2023-09-30T22:02:39.389 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-30T22:02:39.389 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408038 --verbose --owner scheduled_dparmar@teuthology --description fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/dbench}}} --name dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi -- /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408038/orig.config.yaml 2023-09-30T22:02:39.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T22:02:39.526 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408038 branch: fix-nfs-apply-err-reporting description: fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/dbench}}} email: null first_in_suite: false job_id: '7408038' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: fix-nfs-apply-err-reporting ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: bluestore warn on legacy statfs: false bluestore warn on no per pool omap: false mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on osd down out interval zero: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - scrub mismatch - ScrubResult - wrongly marked - \(POOL_APP_NOT_ENABLED\) - \(SLOW_OPS\) - overall HEALTH_ - \(MON_MSGR2_NOT_ENABLED\) - slow request sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-62953 sha1: 6973b24e3d99fd494b753449d2ea12077599cbd6 owner: scheduled_dparmar@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - - client.0 seed: 2683 sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 sleep_before_teardown: 0 suite: fs:upgrade suite_branch: wip-62953 suite_path: /home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa suite_relpath: qa suite_repo: https://github.com/dparmar18/ceph suite_sha1: 6973b24e3d99fd494b753449d2ea12077599cbd6 targets: smithi156.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKu1vwmDNztN6iyHkLdMoF4JU3fFqSvEbgNut54CiIbYLIGEkyLnfI6Q6M1CRI9Zy3xuhuBCzEm5Vvf0KJCtdhg= smithi194.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMmJLqcddXk/AaOZYQx7nzY46fZFwoxkcZ/WDHE/6qEHmlhvokKuJs5Iu1YxoZNW2xMZJGUjh5pXEYZwHN8RZxs= tasks: - install: branch: pacific exclude_packages: - cephadm - ceph-mgr-cephadm - ceph-immutable-object-cache - python3-rados - python3-rgw - python3-rbd - python3-cephfs - ceph-volume extra_packages: - python-rados - python-rgw - python-rbd - python-cephfs extra_system_packages: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - print: '**** done installing pacific' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-ignorelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon - exec: osd.0: - ceph osd set-require-min-compat-client pacific - print: '**** done ceph' - ceph-fuse: null - mds_pre_upgrade: null - print: '**** done mds pre-upgrade sequence' - install.upgrade: mon.a: branch: reef - print: '**** done install.upgrade the host' - ceph.restart: daemons: - mon.* - mgr.* mon-health-to-clog: false wait-for-healthy: false - ceph.healthy: null - ceph.restart: daemons: - osd.* wait-for-healthy: false wait-for-osds-up: true - ceph.stop: - mds.* - ceph.restart: daemons: - mds.* wait-for-healthy: false wait-for-osds-up: true - exec: mon.a: - ceph osd dump -f json-pretty - ceph versions - for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done - ceph osd require-osd-release reef - ceph.healthy: null - print: '**** done ceph.restart' - ceph-fuse: client.0: mounted: false - print: '**** done unmount client.0' - install.upgrade: client.0: null - print: '**** done install.upgrade on client.0' - ceph-fuse: client.0: null - print: '**** done remount client.0' - workunit: clients: all: - suites/dbench.sh teuthology: branch: pacific fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end - if not is_fuse() then reject() end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-09-30_21:53:45 tube: smithi user: dparmar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-09-30T22:02:39.527 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa; will attempt to use it 2023-09-30T22:02:39.527 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks 2023-09-30T22:02:39.528 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-09-30T22:02:39.529 INFO:teuthology.task.internal:Checking packages... 2023-09-30T22:02:39.552 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3d6eb91756d99e822eeed7c6b783104a6ad86054' 2023-09-30T22:02:39.552 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:02:39.552 INFO:teuthology.packaging:ref: None 2023-09-30T22:02:39.552 INFO:teuthology.packaging:tag: None 2023-09-30T22:02:39.552 INFO:teuthology.packaging:branch: fix-nfs-apply-err-reporting 2023-09-30T22:02:39.552 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-09-30T22:02:39.553 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=fix-nfs-apply-err-reporting 2023-09-30T22:02:39.771 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5795.g3d6eb917 2023-09-30T22:02:39.772 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-09-30T22:02:39.779 INFO:teuthology.task.internal:no buildpackages task found 2023-09-30T22:02:39.779 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-09-30T22:02:39.793 INFO:teuthology.task.internal:Saving configuration 2023-09-30T22:02:39.812 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-09-30T22:02:39.820 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T22:02:39.845 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408038', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 21:57:20.157341', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKu1vwmDNztN6iyHkLdMoF4JU3fFqSvEbgNut54CiIbYLIGEkyLnfI6Q6M1CRI9Zy3xuhuBCzEm5Vvf0KJCtdhg='} 2023-09-30T22:02:39.867 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408038', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 21:57:20.155347', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMmJLqcddXk/AaOZYQx7nzY46fZFwoxkcZ/WDHE/6qEHmlhvokKuJs5Iu1YxoZNW2xMZJGUjh5pXEYZwHN8RZxs='} 2023-09-30T22:02:39.868 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-09-30T22:02:39.876 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-09-30T22:02:39.876 INFO:teuthology.task.internal:roles: ubuntu@smithi194.front.sepia.ceph.com - ['client.0'] 2023-09-30T22:02:39.876 INFO:teuthology.run_tasks:Running task console_log... 2023-09-30T22:02:39.944 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f48f3e0ff70>, signals=[15]) 2023-09-30T22:02:39.945 INFO:teuthology.run_tasks:Running task internal.connect... 2023-09-30T22:02:39.952 INFO:teuthology.task.internal:Opening connections... 2023-09-30T22:02:39.952 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi156.front.sepia.ceph.com 2023-09-30T22:02:39.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:02:40.023 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi194.front.sepia.ceph.com 2023-09-30T22:02:40.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:02:40.090 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-09-30T22:02:40.098 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2023-09-30T22:02:40.120 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2023-09-30T22:02:40.120 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-09-30T22:02:40.180 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2023-09-30T22:02:40.180 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8" 2023-09-30T22:02:40.180 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2023-09-30T22:02:40.180 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2023-09-30T22:02:40.181 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8" 2023-09-30T22:02:40.181 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2023-09-30T22:02:40.181 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-30T22:02:40.181 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-09-30T22:02:40.181 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-30T22:02:40.181 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2023-09-30T22:02:40.181 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-30T22:02:40.181 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-30T22:02:40.181 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-30T22:02:40.182 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-09-30T22:02:40.206 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2023-09-30T22:02:40.229 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2023-09-30T22:02:40.229 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2023-09-30T22:02:40.290 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2023-09-30T22:02:40.290 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="8" 2023-09-30T22:02:40.290 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2023-09-30T22:02:40.290 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2023-09-30T22:02:40.290 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="8" 2023-09-30T22:02:40.290 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el8" 2023-09-30T22:02:40.290 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-30T22:02:40.290 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2023-09-30T22:02:40.291 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-30T22:02:40.291 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2023-09-30T22:02:40.291 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-30T22:02:40.291 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-30T22:02:40.291 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-30T22:02:40.291 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2023-09-30T22:02:40.314 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-09-30T22:02:40.323 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-09-30T22:02:40.330 INFO:teuthology.task.internal:Checking for old test directory... 2023-09-30T22:02:40.330 DEBUG:teuthology.orchestra.run.smithi156:> test '!' -e /home/ubuntu/cephtest 2023-09-30T22:02:40.333 DEBUG:teuthology.orchestra.run.smithi194:> test '!' -e /home/ubuntu/cephtest 2023-09-30T22:02:40.353 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-09-30T22:02:40.361 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-09-30T22:02:40.361 DEBUG:teuthology.orchestra.run.smithi156:> test -z $(ls -A /var/lib/ceph) 2023-09-30T22:02:40.393 DEBUG:teuthology.orchestra.run.smithi194:> test -z $(ls -A /var/lib/ceph) 2023-09-30T22:02:40.418 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-09-30T22:02:40.477 INFO:teuthology.run_tasks:Running task kernel... 2023-09-30T22:02:40.498 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-09-30T22:02:40.498 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-09-30T22:02:40.499 DEBUG:teuthology.orchestra.run.smithi156:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-30T22:02:40.499 DEBUG:teuthology.orchestra.run.smithi194:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-30T22:02:40.518 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:02:40.519 DEBUG:teuthology.orchestra.run.smithi156:> uname -r 2023-09-30T22:02:40.520 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:02:40.521 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2023-09-30T22:02:40.579 INFO:teuthology.orchestra.run.smithi156.stdout:4.18.0-489.el8.x86_64 2023-09-30T22:02:40.579 INFO:teuthology.task.kernel:Running kernel on smithi156: 4.18.0-489.el8.x86_64 2023-09-30T22:02:40.579 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum install -y kernel 2023-09-30T22:02:40.580 INFO:teuthology.orchestra.run.smithi194.stdout:4.18.0-489.el8.x86_64 2023-09-30T22:02:40.581 INFO:teuthology.task.kernel:Running kernel on smithi194: 4.18.0-489.el8.x86_64 2023-09-30T22:02:40.581 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum install -y kernel 2023-09-30T22:02:44.658 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 8 - AppStream 21 MB/s | 33 MB 00:01 2023-09-30T22:02:44.884 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 8 - AppStream 21 MB/s | 33 MB 00:01 2023-09-30T22:02:52.283 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 8 - BaseOS 30 MB/s | 48 MB 00:01 2023-09-30T22:02:53.449 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 8 - BaseOS 19 MB/s | 48 MB 00:02 2023-09-30T22:02:59.307 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 8 - Extras 112 kB/s | 18 kB 00:00 2023-09-30T22:02:59.924 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 8 - Extras common packages 16 kB/s | 6.9 kB 00:00 2023-09-30T22:03:00.226 INFO:teuthology.orchestra.run.smithi194.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-09-30T22:03:00.633 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 8 - Extras 60 kB/s | 18 kB 00:00 2023-09-30T22:03:00.993 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 8 - Extras common packages 39 kB/s | 6.9 kB 00:00 2023-09-30T22:03:01.278 INFO:teuthology.orchestra.run.smithi156.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-09-30T22:03:03.022 INFO:teuthology.orchestra.run.smithi156.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2023-09-30T22:03:06.795 INFO:teuthology.orchestra.run.smithi156.stdout:lab-extras 426 kB/s | 24 kB 00:00 2023-09-30T22:03:06.912 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 2.4 MB/s | 16 MB 00:06 2023-09-30T22:03:10.302 INFO:teuthology.orchestra.run.smithi156.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-09-30T22:03:10.303 INFO:teuthology.orchestra.run.smithi156.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-09-30T22:03:10.554 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-09-30T22:03:10.555 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-09-30T22:03:10.555 INFO:teuthology.orchestra.run.smithi156.stdout: Package Architecture Version Repository Size 2023-09-30T22:03:10.555 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-09-30T22:03:10.555 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-09-30T22:03:10.555 INFO:teuthology.orchestra.run.smithi156.stdout: kernel x86_64 4.18.0-514.el8 baseos 10 M 2023-09-30T22:03:10.555 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-09-30T22:03:10.555 INFO:teuthology.orchestra.run.smithi156.stdout: kernel-core x86_64 4.18.0-514.el8 baseos 43 M 2023-09-30T22:03:10.555 INFO:teuthology.orchestra.run.smithi156.stdout: kernel-modules x86_64 4.18.0-514.el8 baseos 35 M 2023-09-30T22:03:10.555 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:03:10.555 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-09-30T22:03:10.556 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-09-30T22:03:10.556 INFO:teuthology.orchestra.run.smithi156.stdout:Install 3 Packages 2023-09-30T22:03:10.556 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:03:10.556 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 88 M 2023-09-30T22:03:10.556 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 96 M 2023-09-30T22:03:10.556 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-09-30T22:03:10.726 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 469 kB/s | 24 kB 00:00 2023-09-30T22:03:11.221 INFO:teuthology.orchestra.run.smithi156.stdout:(1/3): kernel-4.18.0-514.el8.x86_64.rpm 16 MB/s | 10 MB 00:00 2023-09-30T22:03:11.980 INFO:teuthology.orchestra.run.smithi156.stdout:(2/3): kernel-modules-4.18.0-514.el8.x86_64.rpm 26 MB/s | 35 MB 00:01 2023-09-30T22:03:12.580 INFO:teuthology.orchestra.run.smithi156.stdout:(3/3): kernel-core-4.18.0-514.el8.x86_64.rpm 21 MB/s | 43 MB 00:01 2023-09-30T22:03:12.580 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-09-30T22:03:12.580 INFO:teuthology.orchestra.run.smithi156.stdout:Total 43 MB/s | 88 MB 00:02 2023-09-30T22:03:13.247 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-09-30T22:03:13.675 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-09-30T22:03:13.675 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-09-30T22:03:14.308 INFO:teuthology.orchestra.run.smithi194.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-09-30T22:03:14.308 INFO:teuthology.orchestra.run.smithi194.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-09-30T22:03:14.555 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2023-09-30T22:03:14.556 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2023-09-30T22:03:14.556 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2023-09-30T22:03:14.556 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2023-09-30T22:03:14.556 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2023-09-30T22:03:14.556 INFO:teuthology.orchestra.run.smithi194.stdout: kernel x86_64 4.18.0-514.el8 baseos 10 M 2023-09-30T22:03:14.556 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2023-09-30T22:03:14.556 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-core x86_64 4.18.0-514.el8 baseos 43 M 2023-09-30T22:03:14.556 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules x86_64 4.18.0-514.el8 baseos 35 M 2023-09-30T22:03:14.556 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:03:14.557 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2023-09-30T22:03:14.557 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2023-09-30T22:03:14.557 INFO:teuthology.orchestra.run.smithi194.stdout:Install 3 Packages 2023-09-30T22:03:14.557 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:03:14.557 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 88 M 2023-09-30T22:03:14.557 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 96 M 2023-09-30T22:03:14.558 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2023-09-30T22:03:14.892 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-09-30T22:03:14.913 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-09-30T22:03:15.210 INFO:teuthology.orchestra.run.smithi194.stdout:(1/3): kernel-4.18.0-514.el8.x86_64.rpm 16 MB/s | 10 MB 00:00 2023-09-30T22:03:15.902 INFO:teuthology.orchestra.run.smithi194.stdout:(2/3): kernel-modules-4.18.0-514.el8.x86_64.rpm 27 MB/s | 35 MB 00:01 2023-09-30T22:03:16.603 INFO:teuthology.orchestra.run.smithi194.stdout:(3/3): kernel-core-4.18.0-514.el8.x86_64.rpm 21 MB/s | 43 MB 00:02 2023-09-30T22:03:16.603 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2023-09-30T22:03:16.603 INFO:teuthology.orchestra.run.smithi194.stdout:Total 43 MB/s | 88 MB 00:02 2023-09-30T22:03:17.273 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2023-09-30T22:03:17.658 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-09-30T22:03:17.688 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2023-09-30T22:03:17.688 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2023-09-30T22:03:18.156 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : kernel-core-4.18.0-514.el8.x86_64 1/3 2023-09-30T22:03:18.903 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2023-09-30T22:03:18.943 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2023-09-30T22:03:21.711 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2023-09-30T22:03:21.728 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 1/3 2023-09-30T22:03:22.134 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-09-30T22:03:22.213 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-core-4.18.0-514.el8.x86_64 1/3 2023-09-30T22:03:25.512 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-09-30T22:03:25.762 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 1/3 2023-09-30T22:03:25.830 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : kernel-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:03:26.154 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-09-30T22:03:29.536 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-09-30T22:03:29.818 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:03:47.580 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:03:47.604 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:03:47.951 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: kernel-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:03:47.951 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : kernel-4.18.0-514.el8.x86_64 1/3 2023-09-30T22:03:47.951 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : kernel-core-4.18.0-514.el8.x86_64 2/3 2023-09-30T22:03:48.916 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:03:48.917 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:03:48.917 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-09-30T22:03:48.917 INFO:teuthology.orchestra.run.smithi156.stdout: kernel-4.18.0-514.el8.x86_64 kernel-core-4.18.0-514.el8.x86_64 2023-09-30T22:03:48.917 INFO:teuthology.orchestra.run.smithi156.stdout: kernel-modules-4.18.0-514.el8.x86_64 2023-09-30T22:03:48.917 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:03:48.918 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-09-30T22:03:49.063 DEBUG:teuthology.orchestra.run.smithi156:> rpm -q kernel | sort -rV | head -n 1 2023-09-30T22:03:49.280 INFO:teuthology.orchestra.run.smithi156.stdout:kernel-4.18.0-514.el8.x86_64 2023-09-30T22:03:49.281 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-09-30T22:03:49.281 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-514.el8.x86_64 2023-09-30T22:03:49.281 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-09-30T22:03:49.281 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-09-30T22:03:49.281 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-09-30T22:03:49.281 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi156.front.sepia.ceph.com, path=None, version=distro) 2023-09-30T22:03:49.281 DEBUG:teuthology.orchestra.run.smithi156:> rpm -q kernel | sort -rV | head -n 1 2023-09-30T22:03:49.490 INFO:teuthology.orchestra.run.smithi156.stdout:kernel-4.18.0-514.el8.x86_64 2023-09-30T22:03:49.490 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-09-30T22:03:49.490 DEBUG:teuthology.orchestra.run.smithi156:> sudo rpm -qi grub2-tools 2023-09-30T22:03:49.524 INFO:teuthology.orchestra.run.smithi156.stdout:Name : grub2-tools 2023-09-30T22:03:49.524 INFO:teuthology.orchestra.run.smithi156.stdout:Epoch : 1 2023-09-30T22:03:49.525 INFO:teuthology.orchestra.run.smithi156.stdout:Version : 2.02 2023-09-30T22:03:49.525 INFO:teuthology.orchestra.run.smithi156.stdout:Release : 129.el8 2023-09-30T22:03:49.525 INFO:teuthology.orchestra.run.smithi156.stdout:Architecture: x86_64 2023-09-30T22:03:49.525 INFO:teuthology.orchestra.run.smithi156.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-09-30T22:03:49.525 INFO:teuthology.orchestra.run.smithi156.stdout:Group : System Environment/Base 2023-09-30T22:03:49.525 INFO:teuthology.orchestra.run.smithi156.stdout:Size : 9265586 2023-09-30T22:03:49.525 INFO:teuthology.orchestra.run.smithi156.stdout:License : GPLv3+ 2023-09-30T22:03:49.525 INFO:teuthology.orchestra.run.smithi156.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-09-30T22:03:49.525 INFO:teuthology.orchestra.run.smithi156.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-09-30T22:03:49.525 INFO:teuthology.orchestra.run.smithi156.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-09-30T22:03:49.525 INFO:teuthology.orchestra.run.smithi156.stdout:Build Host : kbuilder.bsys.centos.org 2023-09-30T22:03:49.525 INFO:teuthology.orchestra.run.smithi156.stdout:Relocations : (not relocatable) 2023-09-30T22:03:49.526 INFO:teuthology.orchestra.run.smithi156.stdout:Packager : CentOS BuildSystem 2023-09-30T22:03:49.526 INFO:teuthology.orchestra.run.smithi156.stdout:Vendor : CentOS 2023-09-30T22:03:49.526 INFO:teuthology.orchestra.run.smithi156.stdout:URL : http://www.gnu.org/software/grub/ 2023-09-30T22:03:49.526 INFO:teuthology.orchestra.run.smithi156.stdout:Summary : Support tools for GRUB. 2023-09-30T22:03:49.526 INFO:teuthology.orchestra.run.smithi156.stdout:Description : 2023-09-30T22:03:49.526 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:03:49.526 INFO:teuthology.orchestra.run.smithi156.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-09-30T22:03:49.526 INFO:teuthology.orchestra.run.smithi156.stdout:customizable bootloader with modular architecture. It supports a rich 2023-09-30T22:03:49.527 INFO:teuthology.orchestra.run.smithi156.stdout:variety of kernel formats, file systems, computer architectures and 2023-09-30T22:03:49.527 INFO:teuthology.orchestra.run.smithi156.stdout:hardware devices. 2023-09-30T22:03:49.527 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:03:49.527 INFO:teuthology.orchestra.run.smithi156.stdout:This subpackage provides tools for support of all platforms. 2023-09-30T22:03:49.528 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-09-30T22:03:49.528 INFO:teuthology.task.kernel:Updating grub on smithi156 to boot 4.18.0-514.el8.x86_64 2023-09-30T22:03:49.528 DEBUG:teuthology.orchestra.run.smithi156:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-09-30T22:03:50.910 INFO:teuthology.orchestra.run.smithi156.stderr:Generating grub configuration file ... 2023-09-30T22:03:51.496 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:03:51.520 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:03:51.857 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:03:51.857 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-4.18.0-514.el8.x86_64 1/3 2023-09-30T22:03:51.858 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-core-4.18.0-514.el8.x86_64 2/3 2023-09-30T22:03:52.597 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:03:52.598 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:03:52.598 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2023-09-30T22:03:52.598 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-4.18.0-514.el8.x86_64 kernel-core-4.18.0-514.el8.x86_64 2023-09-30T22:03:52.598 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules-4.18.0-514.el8.x86_64 2023-09-30T22:03:52.598 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:03:52.598 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2023-09-30T22:03:52.747 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q kernel | sort -rV | head -n 1 2023-09-30T22:03:52.960 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-4.18.0-514.el8.x86_64 2023-09-30T22:03:52.960 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-09-30T22:03:52.960 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-514.el8.x86_64 2023-09-30T22:03:52.960 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-09-30T22:03:52.960 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-09-30T22:03:52.961 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-09-30T22:03:52.961 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi194.front.sepia.ceph.com, path=None, version=distro) 2023-09-30T22:03:52.961 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q kernel | sort -rV | head -n 1 2023-09-30T22:03:53.014 INFO:teuthology.orchestra.run.smithi156.stderr:done 2023-09-30T22:03:53.015 DEBUG:teuthology.orchestra.run.smithi156:> mktemp 2023-09-30T22:03:53.038 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.c5Vj6c0ki1 2023-09-30T22:03:53.038 DEBUG:teuthology.orchestra.run.smithi156:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.c5Vj6c0ki1 2023-09-30T22:03:53.114 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.c5Vj6c0ki1 2023-09-30T22:03:53.170 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-4.18.0-514.el8.x86_64 2023-09-30T22:03:53.170 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-09-30T22:03:53.170 DEBUG:teuthology.orchestra.run.smithi194:> sudo rpm -qi grub2-tools 2023-09-30T22:03:53.203 INFO:teuthology.orchestra.run.smithi194.stdout:Name : grub2-tools 2023-09-30T22:03:53.203 INFO:teuthology.orchestra.run.smithi194.stdout:Epoch : 1 2023-09-30T22:03:53.203 INFO:teuthology.orchestra.run.smithi194.stdout:Version : 2.02 2023-09-30T22:03:53.203 INFO:teuthology.orchestra.run.smithi194.stdout:Release : 129.el8 2023-09-30T22:03:53.204 INFO:teuthology.orchestra.run.smithi194.stdout:Architecture: x86_64 2023-09-30T22:03:53.204 INFO:teuthology.orchestra.run.smithi194.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-09-30T22:03:53.204 INFO:teuthology.orchestra.run.smithi194.stdout:Group : System Environment/Base 2023-09-30T22:03:53.204 INFO:teuthology.orchestra.run.smithi194.stdout:Size : 9265586 2023-09-30T22:03:53.204 INFO:teuthology.orchestra.run.smithi194.stdout:License : GPLv3+ 2023-09-30T22:03:53.204 INFO:teuthology.orchestra.run.smithi194.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-09-30T22:03:53.204 INFO:teuthology.orchestra.run.smithi194.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-09-30T22:03:53.204 INFO:teuthology.orchestra.run.smithi194.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-09-30T22:03:53.204 INFO:teuthology.orchestra.run.smithi194.stdout:Build Host : kbuilder.bsys.centos.org 2023-09-30T22:03:53.204 INFO:teuthology.orchestra.run.smithi194.stdout:Relocations : (not relocatable) 2023-09-30T22:03:53.204 INFO:teuthology.orchestra.run.smithi194.stdout:Packager : CentOS BuildSystem 2023-09-30T22:03:53.205 INFO:teuthology.orchestra.run.smithi194.stdout:Vendor : CentOS 2023-09-30T22:03:53.205 INFO:teuthology.orchestra.run.smithi194.stdout:URL : http://www.gnu.org/software/grub/ 2023-09-30T22:03:53.205 INFO:teuthology.orchestra.run.smithi194.stdout:Summary : Support tools for GRUB. 2023-09-30T22:03:53.205 INFO:teuthology.orchestra.run.smithi194.stdout:Description : 2023-09-30T22:03:53.205 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:03:53.205 INFO:teuthology.orchestra.run.smithi194.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-09-30T22:03:53.205 INFO:teuthology.orchestra.run.smithi194.stdout:customizable bootloader with modular architecture. It supports a rich 2023-09-30T22:03:53.205 INFO:teuthology.orchestra.run.smithi194.stdout:variety of kernel formats, file systems, computer architectures and 2023-09-30T22:03:53.205 INFO:teuthology.orchestra.run.smithi194.stdout:hardware devices. 2023-09-30T22:03:53.205 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:03:53.205 INFO:teuthology.orchestra.run.smithi194.stdout:This subpackage provides tools for support of all platforms. 2023-09-30T22:03:53.206 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-09-30T22:03:53.206 INFO:teuthology.task.kernel:Updating grub on smithi194 to boot 4.18.0-514.el8.x86_64 2023-09-30T22:03:53.207 DEBUG:teuthology.orchestra.run.smithi194:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-09-30T22:03:53.257 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.c5Vj6c0ki1 is 6KB 2023-09-30T22:03:53.305 DEBUG:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.c5Vj6c0ki1 2023-09-30T22:03:53.323 DEBUG:teuthology.orchestra.run.smithi156:> sudo /bin/ls /boot/loader/entries || true 2023-09-30T22:03:53.408 INFO:teuthology.orchestra.run.smithi156.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-09-30T22:03:53.408 INFO:teuthology.orchestra.run.smithi156.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-09-30T22:03:53.408 INFO:teuthology.orchestra.run.smithi156.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-09-30T22:03:53.408 INFO:teuthology.orchestra.run.smithi156.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64.conf 2023-09-30T22:03:53.409 DEBUG:teuthology.orchestra.run.smithi156:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64 2023-09-30T22:03:53.550 DEBUG:teuthology.orchestra.run.smithi156:> sudo shutdown -r now 2023-09-30T22:03:54.556 INFO:teuthology.orchestra.run.smithi194.stderr:Generating grub configuration file ... 2023-09-30T22:03:57.042 INFO:teuthology.orchestra.run.smithi194.stderr:done 2023-09-30T22:03:57.043 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2023-09-30T22:03:57.076 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.4MD0G44DkV 2023-09-30T22:03:57.076 DEBUG:teuthology.orchestra.run.smithi194:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4MD0G44DkV 2023-09-30T22:03:57.154 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.4MD0G44DkV 2023-09-30T22:03:57.303 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.4MD0G44DkV is 6KB 2023-09-30T22:03:57.351 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.4MD0G44DkV 2023-09-30T22:03:57.369 DEBUG:teuthology.orchestra.run.smithi194:> sudo /bin/ls /boot/loader/entries || true 2023-09-30T22:03:57.451 INFO:teuthology.orchestra.run.smithi194.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-09-30T22:03:57.451 INFO:teuthology.orchestra.run.smithi194.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-09-30T22:03:57.451 INFO:teuthology.orchestra.run.smithi194.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-09-30T22:03:57.451 INFO:teuthology.orchestra.run.smithi194.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64.conf 2023-09-30T22:03:57.452 DEBUG:teuthology.orchestra.run.smithi194:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64 2023-09-30T22:03:57.642 DEBUG:teuthology.orchestra.run.smithi194:> sudo shutdown -r now 2023-09-30T22:04:23.578 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-09-30T22:04:23.579 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-09-30T22:04:23.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:04:27.646 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-09-30T22:04:27.646 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-09-30T22:04:27.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:04:41.978 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-09-30T22:04:46.074 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-09-30T22:04:50.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-09-30T22:04:50.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:04:54.042 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-09-30T22:04:55.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-09-30T22:04:55.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:05:06.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-09-30T22:05:06.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:05:24.474 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-09-30T22:05:39.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-09-30T22:05:39.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:05:39.918 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-09-30T22:05:40.198 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-09-30T22:05:40.198 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-514.el8.x86_64"... 2023-09-30T22:05:40.199 DEBUG:teuthology.orchestra.run.smithi156:> uname -r 2023-09-30T22:05:40.215 INFO:teuthology.orchestra.run.smithi156.stdout:4.18.0-514.el8.x86_64 2023-09-30T22:05:40.216 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-514.el8.x86_64 vs 4.18.0-514.el8.x86_64 2023-09-30T22:05:40.216 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-30T22:05:40.216 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-09-30T22:05:41.217 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-09-30T22:05:41.217 DEBUG:teuthology.orchestra.run.smithi156:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-09-30T22:05:41.310 INFO:teuthology.orchestra.run.smithi156.stdout:ttyS1 2023-09-30T22:05:41.328 DEBUG:teuthology.parallel:result is None 2023-09-30T22:05:55.079 DEBUG:teuthology.orchestra.remote:timed out 2023-09-30T22:06:07.080 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-09-30T22:06:07.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:06:07.426 DEBUG:teuthology.orchestra.run.smithi194:> true 2023-09-30T22:06:07.721 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-09-30T22:06:07.721 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-514.el8.x86_64"... 2023-09-30T22:06:07.721 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2023-09-30T22:06:07.741 INFO:teuthology.orchestra.run.smithi194.stdout:4.18.0-514.el8.x86_64 2023-09-30T22:06:07.741 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-514.el8.x86_64 vs 4.18.0-514.el8.x86_64 2023-09-30T22:06:07.741 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-30T22:06:07.741 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-09-30T22:06:08.742 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2023-09-30T22:06:08.742 DEBUG:teuthology.orchestra.run.smithi194:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-09-30T22:06:08.814 INFO:teuthology.orchestra.run.smithi194.stdout:ttyS1 2023-09-30T22:06:08.831 DEBUG:teuthology.parallel:result is None 2023-09-30T22:06:08.831 INFO:teuthology.run_tasks:Running task internal.base... 2023-09-30T22:06:08.838 INFO:teuthology.task.internal:Creating test directory... 2023-09-30T22:06:08.839 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-30T22:06:08.842 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-30T22:06:08.865 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-09-30T22:06:08.871 INFO:teuthology.run_tasks:Running task internal.archive... 2023-09-30T22:06:08.879 INFO:teuthology.task.internal:Creating archive directory... 2023-09-30T22:06:08.879 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-30T22:06:08.906 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-30T22:06:08.953 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-09-30T22:06:08.960 INFO:teuthology.task.internal:Enabling coredump saving... 2023-09-30T22:06:08.961 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-30T22:06:08.992 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-30T22:06:09.034 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T22:06:09.035 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T22:06:09.043 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T22:06:09.044 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T22:06:09.045 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-09-30T22:06:09.053 INFO:teuthology.task.internal:Configuring sudo... 2023-09-30T22:06:09.053 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-30T22:06:09.088 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-30T22:06:09.120 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-09-30T22:06:09.129 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-09-30T22:06:09.129 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-30T22:06:09.161 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-30T22:06:09.182 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T22:06:09.267 DEBUG:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T22:06:09.324 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T22:06:09.411 DEBUG:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T22:06:09.454 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-30T22:06:09.455 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-30T22:06:09.522 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T22:06:09.571 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T22:06:09.632 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T22:06:09.678 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T22:06:09.722 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-09-30T22:06:09.723 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-30T22:06:09.792 DEBUG:teuthology.orchestra.run.smithi156:> sudo service rsyslog restart 2023-09-30T22:06:09.794 DEBUG:teuthology.orchestra.run.smithi194:> sudo service rsyslog restart 2023-09-30T22:06:09.867 INFO:teuthology.orchestra.run.smithi156.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T22:06:09.891 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T22:06:10.217 INFO:teuthology.run_tasks:Running task internal.timer... 2023-09-30T22:06:10.224 INFO:teuthology.task.internal:Starting timer... 2023-09-30T22:06:10.225 INFO:teuthology.run_tasks:Running task pcp... 2023-09-30T22:06:10.235 INFO:teuthology.run_tasks:Running task selinux... 2023-09-30T22:06:10.244 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-09-30T22:06:10.244 DEBUG:teuthology.orchestra.run.smithi156:> sudo service auditd rotate 2023-09-30T22:06:10.377 INFO:teuthology.orchestra.run.smithi156.stdout:Rotating logs: 2023-09-30T22:06:10.379 DEBUG:teuthology.orchestra.run.smithi194:> sudo service auditd rotate 2023-09-30T22:06:10.465 INFO:teuthology.orchestra.run.smithi194.stdout:Rotating logs: 2023-09-30T22:06:10.467 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-09-30T22:06:10.467 DEBUG:teuthology.orchestra.run.smithi156:> /usr/sbin/getenforce 2023-09-30T22:06:10.506 INFO:teuthology.orchestra.run.smithi156.stdout:Permissive 2023-09-30T22:06:10.506 DEBUG:teuthology.orchestra.run.smithi194:> /usr/sbin/getenforce 2023-09-30T22:06:10.561 INFO:teuthology.orchestra.run.smithi194.stdout:Permissive 2023-09-30T22:06:10.561 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi156.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi194.front.sepia.ceph.com': 'permissive'} 2023-09-30T22:06:10.561 DEBUG:teuthology.orchestra.run.smithi156:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T22:06:10.589 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:06:10.589 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T22:06:10.616 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:06:10.616 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-09-30T22:06:10.617 DEBUG:teuthology.orchestra.run.smithi156:> sudo /usr/sbin/setenforce permissive 2023-09-30T22:06:10.657 DEBUG:teuthology.orchestra.run.smithi194:> sudo /usr/sbin/setenforce permissive 2023-09-30T22:06:10.684 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-09-30T22:06:10.694 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-09-30T22:06:10.701 INFO:teuthology.repo_utils:Fetching main from origin 2023-09-30T22:06:10.817 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-09-30T22:06:10.834 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-09-30T22:06:10.835 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi156.front.sepia.ceph.com,smithi194.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-09-30T22:13:34.749 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi156.front.sepia.ceph.com'), Remote(name='ubuntu@smithi194.front.sepia.ceph.com')] 2023-09-30T22:13:34.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-09-30T22:13:34.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:13:34.822 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-09-30T22:13:34.848 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-09-30T22:13:34.848 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-09-30T22:13:34.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:13:34.916 DEBUG:teuthology.orchestra.run.smithi194:> true 2023-09-30T22:13:34.984 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-09-30T22:13:34.984 INFO:teuthology.run_tasks:Running task clock... 2023-09-30T22:13:34.995 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-09-30T22:13:34.996 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-30T22:13:34.996 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T22:13:34.998 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-30T22:13:34.999 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T22:13:35.029 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-30T22:13:35.043 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-30T22:13:35.055 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-30T22:13:35.069 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-30T22:13:35.109 INFO:teuthology.orchestra.run.smithi156.stderr:sudo: ntpd: command not found 2023-09-30T22:13:35.120 INFO:teuthology.orchestra.run.smithi156.stdout:506 Cannot talk to daemon 2023-09-30T22:13:35.134 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-30T22:13:35.141 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: ntpd: command not found 2023-09-30T22:13:35.148 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-30T22:13:35.152 INFO:teuthology.orchestra.run.smithi194.stdout:506 Cannot talk to daemon 2023-09-30T22:13:35.166 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-30T22:13:35.180 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-30T22:13:35.212 INFO:teuthology.orchestra.run.smithi156.stderr:bash: ntpq: command not found 2023-09-30T22:13:35.215 INFO:teuthology.orchestra.run.smithi156.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T22:13:35.215 INFO:teuthology.orchestra.run.smithi156.stdout:=============================================================================== 2023-09-30T22:13:35.215 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:13:35.215 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:13:35.215 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:13:35.215 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:13:35.247 INFO:teuthology.orchestra.run.smithi194.stderr:bash: ntpq: command not found 2023-09-30T22:13:35.250 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T22:13:35.250 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2023-09-30T22:13:35.251 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:13:35.251 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:13:35.251 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:13:35.251 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:13:35.252 INFO:teuthology.run_tasks:Running task install... 2023-09-30T22:13:35.260 DEBUG:teuthology.task.install:project ceph 2023-09-30T22:13:35.260 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}} 2023-09-30T22:13:35.260 DEBUG:teuthology.task.install:config {'branch': 'pacific', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'} 2023-09-30T22:13:35.261 INFO:teuthology.task.install:Using flavor: default 2023-09-30T22:13:35.267 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-30T22:13:35.267 INFO:teuthology.task.install:extra packages: ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'] 2023-09-30T22:13:35.267 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'tag': None, 'wait_for_package': False} 2023-09-30T22:13:35.268 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:13:35.268 INFO:teuthology.packaging:ref: None 2023-09-30T22:13:35.268 INFO:teuthology.packaging:tag: None 2023-09-30T22:13:35.268 INFO:teuthology.packaging:branch: pacific 2023-09-30T22:13:35.268 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-09-30T22:13:35.268 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-09-30T22:13:35.270 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'tag': None, 'wait_for_package': False} 2023-09-30T22:13:35.270 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:13:35.270 INFO:teuthology.packaging:ref: None 2023-09-30T22:13:35.271 INFO:teuthology.packaging:tag: None 2023-09-30T22:13:35.271 INFO:teuthology.packaging:branch: pacific 2023-09-30T22:13:35.271 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-09-30T22:13:35.271 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-09-30T22:13:35.478 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/ 2023-09-30T22:13:35.479 INFO:teuthology.task.install.rpm:Package version is 16.2.14-44.geeb13ac9 2023-09-30T22:13:35.499 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/ 2023-09-30T22:13:35.500 INFO:teuthology.task.install.rpm:Package version is 16.2.14-44.geeb13ac9 2023-09-30T22:13:35.609 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-30T22:13:35.609 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-30T22:13:35.609 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-30T22:13:35.638 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux on remote rpm x86_64 2023-09-30T22:13:35.639 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:13:35.639 INFO:teuthology.packaging:ref: None 2023-09-30T22:13:35.639 INFO:teuthology.packaging:tag: None 2023-09-30T22:13:35.639 INFO:teuthology.packaging:branch: pacific 2023-09-30T22:13:35.639 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-09-30T22:13:35.639 DEBUG:teuthology.orchestra.run.smithi156:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-30T22:13:35.646 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-30T22:13:35.646 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-09-30T22:13:35.646 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-30T22:13:35.674 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux on remote rpm x86_64 2023-09-30T22:13:35.675 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:13:35.675 INFO:teuthology.packaging:ref: None 2023-09-30T22:13:35.675 INFO:teuthology.packaging:tag: None 2023-09-30T22:13:35.675 INFO:teuthology.packaging:branch: pacific 2023-09-30T22:13:35.675 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-09-30T22:13:35.675 DEBUG:teuthology.orchestra.run.smithi194:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-30T22:13:35.707 DEBUG:teuthology.orchestra.run.smithi156:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-30T22:13:35.743 DEBUG:teuthology.orchestra.run.smithi194:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-30T22:13:35.785 DEBUG:teuthology.orchestra.run.smithi156:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-30T22:13:35.820 DEBUG:teuthology.orchestra.run.smithi194:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-30T22:13:35.852 INFO:teuthology.orchestra.run.smithi156.stdout:check_obsoletes = 1 2023-09-30T22:13:35.853 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum clean all 2023-09-30T22:13:35.886 INFO:teuthology.orchestra.run.smithi194.stdout:check_obsoletes = 1 2023-09-30T22:13:35.888 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum clean all 2023-09-30T22:13:36.132 INFO:teuthology.orchestra.run.smithi156.stdout:76 files removed 2023-09-30T22:13:36.156 INFO:teuthology.orchestra.run.smithi194.stdout:76 files removed 2023-09-30T22:13:36.160 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 rbd-fuse rbd-mirror rbd-nbd python-rados python-rgw python-rbd python-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux 2023-09-30T22:13:36.184 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 rbd-fuse rbd-mirror rbd-nbd python-rados python-rgw python-rbd python-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux 2023-09-30T22:13:36.911 INFO:teuthology.orchestra.run.smithi194.stdout:ceph packages for x86_64 237 kB/s | 76 kB 00:00 2023-09-30T22:13:36.922 INFO:teuthology.orchestra.run.smithi156.stdout:ceph packages for x86_64 215 kB/s | 76 kB 00:00 2023-09-30T22:13:37.223 INFO:teuthology.orchestra.run.smithi156.stdout:ceph noarch packages 58 kB/s | 15 kB 00:00 2023-09-30T22:13:37.311 INFO:teuthology.orchestra.run.smithi194.stdout:ceph noarch packages 42 kB/s | 15 kB 00:00 2023-09-30T22:13:37.490 INFO:teuthology.orchestra.run.smithi156.stdout:ceph source packages 6.0 kB/s | 1.4 kB 00:00 2023-09-30T22:13:37.670 INFO:teuthology.orchestra.run.smithi194.stdout:ceph source packages 4.3 kB/s | 1.4 kB 00:00 2023-09-30T22:13:39.599 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 8 - AppStream 16 MB/s | 33 MB 00:02 2023-09-30T22:13:39.862 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 8 - AppStream 15 MB/s | 33 MB 00:02 2023-09-30T22:13:48.703 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 8 - BaseOS 16 MB/s | 48 MB 00:02 2023-09-30T22:13:48.946 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 8 - BaseOS 16 MB/s | 48 MB 00:02 2023-09-30T22:13:55.833 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 8 - Extras 107 kB/s | 18 kB 00:00 2023-09-30T22:13:56.029 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 8 - Extras 100 kB/s | 18 kB 00:00 2023-09-30T22:13:56.408 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.9 kB 00:00 2023-09-30T22:13:56.605 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.9 kB 00:00 2023-09-30T22:13:57.435 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 8 - PowerTools 7.4 MB/s | 6.5 MB 00:00 2023-09-30T22:13:57.773 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 8 - PowerTools 6.4 MB/s | 6.5 MB 00:01 2023-09-30T22:13:58.854 INFO:teuthology.orchestra.run.smithi156.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-09-30T22:13:59.207 INFO:teuthology.orchestra.run.smithi194.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-09-30T22:13:59.842 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 33 MB/s | 16 MB 00:00 2023-09-30T22:14:00.648 INFO:teuthology.orchestra.run.smithi156.stdout:Extra Packages for Enterprise Linux 9.7 MB/s | 16 MB 00:01 2023-09-30T22:14:03.658 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 436 kB/s | 24 kB 00:00 2023-09-30T22:14:04.571 INFO:teuthology.orchestra.run.smithi156.stdout:lab-extras 374 kB/s | 24 kB 00:00 2023-09-30T22:14:07.919 INFO:teuthology.orchestra.run.smithi194.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-30T22:14:07.919 INFO:teuthology.orchestra.run.smithi194.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-30T22:14:07.944 INFO:teuthology.orchestra.run.smithi194.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-09-30T22:14:07.944 INFO:teuthology.orchestra.run.smithi194.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-09-30T22:14:07.945 INFO:teuthology.orchestra.run.smithi194.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-09-30T22:14:07.946 INFO:teuthology.orchestra.run.smithi194.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-09-30T22:14:08.150 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2023-09-30T22:14:08.161 INFO:teuthology.orchestra.run.smithi194.stdout:==================================================================================================== 2023-09-30T22:14:08.161 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2023-09-30T22:14:08.161 INFO:teuthology.orchestra.run.smithi194.stdout:==================================================================================================== 2023-09-30T22:14:08.161 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2023-09-30T22:14:08.161 INFO:teuthology.orchestra.run.smithi194.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-09-30T22:14:08.161 INFO:teuthology.orchestra.run.smithi194.stdout: ceph x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.4 k 2023-09-30T22:14:08.161 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.1 M 2023-09-30T22:14:08.162 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 910 k 2023-09-30T22:14:08.162 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 1.6 M 2023-09-30T22:14:08.162 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 3.1 M 2023-09-30T22:14:08.162 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 8.6 M 2023-09-30T22:14:08.162 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 27 k 2023-09-30T22:14:08.162 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 12 M 2023-09-30T22:14:08.162 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 52 M 2023-09-30T22:14:08.162 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-09-30T22:14:08.162 INFO:teuthology.orchestra.run.smithi194.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-09-30T22:14:08.162 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 25 k 2023-09-30T22:14:08.162 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 824 k 2023-09-30T22:14:08.163 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 131 k 2023-09-30T22:14:08.163 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-09-30T22:14:08.163 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 215 k 2023-09-30T22:14:08.163 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 390 k 2023-09-30T22:14:08.163 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 369 k 2023-09-30T22:14:08.163 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 114 k 2023-09-30T22:14:08.163 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 88 k 2023-09-30T22:14:08.163 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-09-30T22:14:08.163 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 173 k 2023-09-30T22:14:08.163 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrading: 2023-09-30T22:14:08.163 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-09-30T22:14:08.163 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-09-30T22:14:08.164 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-09-30T22:14:08.164 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-09-30T22:14:08.164 INFO:teuthology.orchestra.run.smithi194.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-09-30T22:14:08.164 INFO:teuthology.orchestra.run.smithi194.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-09-30T22:14:08.164 INFO:teuthology.orchestra.run.smithi194.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-09-30T22:14:08.164 INFO:teuthology.orchestra.run.smithi194.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-09-30T22:14:08.164 INFO:teuthology.orchestra.run.smithi194.stdout: librados2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-09-30T22:14:08.164 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 4.2 M 2023-09-30T22:14:08.164 INFO:teuthology.orchestra.run.smithi194.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-09-30T22:14:08.164 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-09-30T22:14:08.164 INFO:teuthology.orchestra.run.smithi194.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-09-30T22:14:08.164 INFO:teuthology.orchestra.run.smithi194.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-09-30T22:14:08.165 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2023-09-30T22:14:08.165 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 24 M 2023-09-30T22:14:08.165 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 24 k 2023-09-30T22:14:08.165 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 2.4 M 2023-09-30T22:14:08.165 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 244 k 2023-09-30T22:14:08.165 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 5.0 M 2023-09-30T22:14:08.165 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 18 M 2023-09-30T22:14:08.165 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 15 k 2023-09-30T22:14:08.165 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 26 k 2023-09-30T22:14:08.165 INFO:teuthology.orchestra.run.smithi194.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-09-30T22:14:08.165 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-30T22:14:08.166 INFO:teuthology.orchestra.run.smithi194.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-09-30T22:14:08.166 INFO:teuthology.orchestra.run.smithi194.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-09-30T22:14:08.166 INFO:teuthology.orchestra.run.smithi194.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-09-30T22:14:08.166 INFO:teuthology.orchestra.run.smithi194.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-09-30T22:14:08.166 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 174 k 2023-09-30T22:14:08.166 INFO:teuthology.orchestra.run.smithi194.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-09-30T22:14:08.166 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-09-30T22:14:08.166 INFO:teuthology.orchestra.run.smithi194.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-30T22:14:08.166 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-09-30T22:14:08.166 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-09-30T22:14:08.166 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 493 k 2023-09-30T22:14:08.166 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-09-30T22:14:08.167 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.8 M 2023-09-30T22:14:08.167 INFO:teuthology.orchestra.run.smithi194.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-09-30T22:14:08.167 INFO:teuthology.orchestra.run.smithi194.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-09-30T22:14:08.167 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-30T22:14:08.167 INFO:teuthology.orchestra.run.smithi194.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-09-30T22:14:08.167 INFO:teuthology.orchestra.run.smithi194.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-09-30T22:14:08.167 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-09-30T22:14:08.167 INFO:teuthology.orchestra.run.smithi194.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-09-30T22:14:08.167 INFO:teuthology.orchestra.run.smithi194.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-09-30T22:14:08.167 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-09-30T22:14:08.168 INFO:teuthology.orchestra.run.smithi194.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-09-30T22:14:08.168 INFO:teuthology.orchestra.run.smithi194.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-09-30T22:14:08.168 INFO:teuthology.orchestra.run.smithi194.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-09-30T22:14:08.168 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-30T22:14:08.168 INFO:teuthology.orchestra.run.smithi194.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-30T22:14:08.168 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-30T22:14:08.168 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 45 k 2023-09-30T22:14:08.168 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 99 k 2023-09-30T22:14:08.168 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-30T22:14:08.169 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-09-30T22:14:08.169 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-30T22:14:08.169 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-30T22:14:08.169 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-09-30T22:14:08.169 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-30T22:14:08.169 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-30T22:14:08.169 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-30T22:14:08.169 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-09-30T22:14:08.169 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-09-30T22:14:08.169 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-09-30T22:14:08.169 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-30T22:14:08.169 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-30T22:14:08.170 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-09-30T22:14:08.170 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-09-30T22:14:08.170 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-30T22:14:08.170 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-09-30T22:14:08.170 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-09-30T22:14:08.171 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-09-30T22:14:08.171 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-30T22:14:08.171 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-30T22:14:08.171 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-09-30T22:14:08.171 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-09-30T22:14:08.171 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-09-30T22:14:08.171 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-09-30T22:14:08.171 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-09-30T22:14:08.171 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-09-30T22:14:08.171 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-30T22:14:08.171 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-09-30T22:14:08.171 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-30T22:14:08.172 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-30T22:14:08.172 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-09-30T22:14:08.172 INFO:teuthology.orchestra.run.smithi194.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-30T22:14:08.172 INFO:teuthology.orchestra.run.smithi194.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-30T22:14:08.172 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-30T22:14:08.172 INFO:teuthology.orchestra.run.smithi194.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-30T22:14:08.172 INFO:teuthology.orchestra.run.smithi194.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-30T22:14:08.172 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-30T22:14:08.172 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-30T22:14:08.172 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-30T22:14:08.172 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-09-30T22:14:08.172 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-30T22:14:08.173 INFO:teuthology.orchestra.run.smithi194.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-09-30T22:14:08.173 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-09-30T22:14:08.173 INFO:teuthology.orchestra.run.smithi194.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-09-30T22:14:08.173 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:14:08.173 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2023-09-30T22:14:08.173 INFO:teuthology.orchestra.run.smithi194.stdout:==================================================================================================== 2023-09-30T22:14:08.173 INFO:teuthology.orchestra.run.smithi194.stdout:Install 108 Packages 2023-09-30T22:14:08.173 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrade 14 Packages 2023-09-30T22:14:08.173 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:14:08.174 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 200 M 2023-09-30T22:14:08.174 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2023-09-30T22:14:08.882 INFO:teuthology.orchestra.run.smithi156.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-30T22:14:08.883 INFO:teuthology.orchestra.run.smithi156.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-30T22:14:08.908 INFO:teuthology.orchestra.run.smithi156.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-09-30T22:14:08.909 INFO:teuthology.orchestra.run.smithi156.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-09-30T22:14:08.909 INFO:teuthology.orchestra.run.smithi156.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-09-30T22:14:08.910 INFO:teuthology.orchestra.run.smithi156.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-09-30T22:14:09.117 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-09-30T22:14:09.128 INFO:teuthology.orchestra.run.smithi156.stdout:==================================================================================================== 2023-09-30T22:14:09.128 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-09-30T22:14:09.128 INFO:teuthology.orchestra.run.smithi156.stdout:==================================================================================================== 2023-09-30T22:14:09.128 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-09-30T22:14:09.128 INFO:teuthology.orchestra.run.smithi156.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-09-30T22:14:09.129 INFO:teuthology.orchestra.run.smithi156.stdout: ceph x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.4 k 2023-09-30T22:14:09.129 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.1 M 2023-09-30T22:14:09.129 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 910 k 2023-09-30T22:14:09.129 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 1.6 M 2023-09-30T22:14:09.129 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 3.1 M 2023-09-30T22:14:09.129 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 8.6 M 2023-09-30T22:14:09.129 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-rook noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 27 k 2023-09-30T22:14:09.129 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 12 M 2023-09-30T22:14:09.129 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 52 M 2023-09-30T22:14:09.129 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-09-30T22:14:09.129 INFO:teuthology.orchestra.run.smithi156.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-09-30T22:14:09.130 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 25 k 2023-09-30T22:14:09.130 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 824 k 2023-09-30T22:14:09.130 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 131 k 2023-09-30T22:14:09.130 INFO:teuthology.orchestra.run.smithi156.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-09-30T22:14:09.130 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cephfs x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 215 k 2023-09-30T22:14:09.130 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 390 k 2023-09-30T22:14:09.130 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 369 k 2023-09-30T22:14:09.130 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 114 k 2023-09-30T22:14:09.130 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 88 k 2023-09-30T22:14:09.130 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-mirror x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-09-30T22:14:09.130 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 173 k 2023-09-30T22:14:09.131 INFO:teuthology.orchestra.run.smithi156.stdout:Upgrading: 2023-09-30T22:14:09.131 INFO:teuthology.orchestra.run.smithi156.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-09-30T22:14:09.131 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-09-30T22:14:09.131 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-09-30T22:14:09.131 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-09-30T22:14:09.131 INFO:teuthology.orchestra.run.smithi156.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-09-30T22:14:09.131 INFO:teuthology.orchestra.run.smithi156.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-09-30T22:14:09.131 INFO:teuthology.orchestra.run.smithi156.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-09-30T22:14:09.131 INFO:teuthology.orchestra.run.smithi156.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-09-30T22:14:09.131 INFO:teuthology.orchestra.run.smithi156.stdout: librados2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-09-30T22:14:09.131 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 4.2 M 2023-09-30T22:14:09.131 INFO:teuthology.orchestra.run.smithi156.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-09-30T22:14:09.132 INFO:teuthology.orchestra.run.smithi156.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-09-30T22:14:09.132 INFO:teuthology.orchestra.run.smithi156.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-09-30T22:14:09.132 INFO:teuthology.orchestra.run.smithi156.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-09-30T22:14:09.132 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-09-30T22:14:09.132 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 24 M 2023-09-30T22:14:09.132 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-grafana-dashboards noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 24 k 2023-09-30T22:14:09.132 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 2.4 M 2023-09-30T22:14:09.132 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 244 k 2023-09-30T22:14:09.132 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 5.0 M 2023-09-30T22:14:09.132 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 18 M 2023-09-30T22:14:09.132 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-prometheus-alerts noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 15 k 2023-09-30T22:14:09.133 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-selinux x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 26 k 2023-09-30T22:14:09.133 INFO:teuthology.orchestra.run.smithi156.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-09-30T22:14:09.133 INFO:teuthology.orchestra.run.smithi156.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-30T22:14:09.133 INFO:teuthology.orchestra.run.smithi156.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-09-30T22:14:09.133 INFO:teuthology.orchestra.run.smithi156.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-09-30T22:14:09.133 INFO:teuthology.orchestra.run.smithi156.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-09-30T22:14:09.133 INFO:teuthology.orchestra.run.smithi156.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-09-30T22:14:09.133 INFO:teuthology.orchestra.run.smithi156.stdout: libcephsqlite x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 174 k 2023-09-30T22:14:09.133 INFO:teuthology.orchestra.run.smithi156.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-09-30T22:14:09.133 INFO:teuthology.orchestra.run.smithi156.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-09-30T22:14:09.134 INFO:teuthology.orchestra.run.smithi156.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-30T22:14:09.134 INFO:teuthology.orchestra.run.smithi156.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-09-30T22:14:09.134 INFO:teuthology.orchestra.run.smithi156.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-09-30T22:14:09.134 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 493 k 2023-09-30T22:14:09.134 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-09-30T22:14:09.134 INFO:teuthology.orchestra.run.smithi156.stdout: librgw2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.8 M 2023-09-30T22:14:09.134 INFO:teuthology.orchestra.run.smithi156.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-09-30T22:14:09.134 INFO:teuthology.orchestra.run.smithi156.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-09-30T22:14:09.134 INFO:teuthology.orchestra.run.smithi156.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-30T22:14:09.134 INFO:teuthology.orchestra.run.smithi156.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-09-30T22:14:09.134 INFO:teuthology.orchestra.run.smithi156.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-09-30T22:14:09.134 INFO:teuthology.orchestra.run.smithi156.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-09-30T22:14:09.135 INFO:teuthology.orchestra.run.smithi156.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-09-30T22:14:09.135 INFO:teuthology.orchestra.run.smithi156.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-09-30T22:14:09.135 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-09-30T22:14:09.135 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-09-30T22:14:09.135 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-09-30T22:14:09.135 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-09-30T22:14:09.135 INFO:teuthology.orchestra.run.smithi156.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-30T22:14:09.135 INFO:teuthology.orchestra.run.smithi156.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-30T22:14:09.135 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-30T22:14:09.135 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 45 k 2023-09-30T22:14:09.135 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 99 k 2023-09-30T22:14:09.136 INFO:teuthology.orchestra.run.smithi156.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-30T22:14:09.136 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-09-30T22:14:09.136 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-30T22:14:09.136 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-30T22:14:09.136 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-09-30T22:14:09.136 INFO:teuthology.orchestra.run.smithi156.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-30T22:14:09.136 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-30T22:14:09.136 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-30T22:14:09.136 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-09-30T22:14:09.136 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-09-30T22:14:09.136 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-09-30T22:14:09.136 INFO:teuthology.orchestra.run.smithi156.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-30T22:14:09.137 INFO:teuthology.orchestra.run.smithi156.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-30T22:14:09.137 INFO:teuthology.orchestra.run.smithi156.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-09-30T22:14:09.137 INFO:teuthology.orchestra.run.smithi156.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-09-30T22:14:09.137 INFO:teuthology.orchestra.run.smithi156.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-30T22:14:09.137 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-09-30T22:14:09.137 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-09-30T22:14:09.137 INFO:teuthology.orchestra.run.smithi156.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-09-30T22:14:09.137 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-30T22:14:09.137 INFO:teuthology.orchestra.run.smithi156.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-30T22:14:09.137 INFO:teuthology.orchestra.run.smithi156.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-09-30T22:14:09.137 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-09-30T22:14:09.137 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-09-30T22:14:09.138 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-09-30T22:14:09.138 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-09-30T22:14:09.138 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-09-30T22:14:09.138 INFO:teuthology.orchestra.run.smithi156.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-30T22:14:09.138 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-09-30T22:14:09.138 INFO:teuthology.orchestra.run.smithi156.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-30T22:14:09.138 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-30T22:14:09.138 INFO:teuthology.orchestra.run.smithi156.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-09-30T22:14:09.138 INFO:teuthology.orchestra.run.smithi156.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-30T22:14:09.138 INFO:teuthology.orchestra.run.smithi156.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-30T22:14:09.138 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-30T22:14:09.139 INFO:teuthology.orchestra.run.smithi156.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-30T22:14:09.139 INFO:teuthology.orchestra.run.smithi156.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-30T22:14:09.139 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-30T22:14:09.139 INFO:teuthology.orchestra.run.smithi156.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-30T22:14:09.139 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-30T22:14:09.139 INFO:teuthology.orchestra.run.smithi156.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-09-30T22:14:09.139 INFO:teuthology.orchestra.run.smithi156.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-30T22:14:09.139 INFO:teuthology.orchestra.run.smithi156.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-09-30T22:14:09.139 INFO:teuthology.orchestra.run.smithi156.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-09-30T22:14:09.139 INFO:teuthology.orchestra.run.smithi156.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-09-30T22:14:09.139 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:14:09.140 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-09-30T22:14:09.140 INFO:teuthology.orchestra.run.smithi156.stdout:==================================================================================================== 2023-09-30T22:14:09.140 INFO:teuthology.orchestra.run.smithi156.stdout:Install 108 Packages 2023-09-30T22:14:09.140 INFO:teuthology.orchestra.run.smithi156.stdout:Upgrade 14 Packages 2023-09-30T22:14:09.140 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:14:09.141 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 200 M 2023-09-30T22:14:09.141 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-09-30T22:14:10.092 INFO:teuthology.orchestra.run.smithi194.stdout:(1/122): ceph-16.2.14-44.geeb13ac9.el8.x86_64.r 33 kB/s | 6.4 kB 00:00 2023-09-30T22:14:10.443 INFO:teuthology.orchestra.run.smithi194.stdout:(2/122): ceph-base-16.2.14-44.geeb13ac9.el8.x86 11 MB/s | 6.1 MB 00:00 2023-09-30T22:14:10.679 INFO:teuthology.orchestra.run.smithi194.stdout:(3/122): ceph-mds-16.2.14-44.geeb13ac9.el8.x86_ 10 MB/s | 2.4 MB 00:00 2023-09-30T22:14:10.752 INFO:teuthology.orchestra.run.smithi194.stdout:(4/122): ceph-fuse-16.2.14-44.geeb13ac9.el8.x86 1.3 MB/s | 910 kB 00:00 2023-09-30T22:14:10.794 INFO:teuthology.orchestra.run.smithi194.stdout:(5/122): ceph-mgr-16.2.14-44.geeb13ac9.el8.x86_ 14 MB/s | 1.6 MB 00:00 2023-09-30T22:14:12.069 INFO:teuthology.orchestra.run.smithi194.stdout:(6/122): ceph-osd-16.2.14-44.geeb13ac9.el8.x86_ 14 MB/s | 18 MB 00:01 2023-09-30T22:14:12.411 INFO:teuthology.orchestra.run.smithi194.stdout:(7/122): ceph-mon-16.2.14-44.geeb13ac9.el8.x86_ 3.0 MB/s | 5.0 MB 00:01 2023-09-30T22:14:12.469 INFO:teuthology.orchestra.run.smithi194.stdout:(8/122): ceph-selinux-16.2.14-44.geeb13ac9.el8. 440 kB/s | 26 kB 00:00 2023-09-30T22:14:12.681 INFO:teuthology.orchestra.run.smithi156.stdout:(1/122): ceph-16.2.14-44.geeb13ac9.el8.x86_64.r 32 kB/s | 6.4 kB 00:00 2023-09-30T22:14:12.728 INFO:teuthology.orchestra.run.smithi194.stdout:(9/122): ceph-common-16.2.14-44.geeb13ac9.el8.x 8.5 MB/s | 24 MB 00:02 2023-09-30T22:14:12.895 INFO:teuthology.orchestra.run.smithi194.stdout:(10/122): libcephfs-devel-16.2.14-44.geeb13ac9. 153 kB/s | 25 kB 00:00 2023-09-30T22:14:13.153 INFO:teuthology.orchestra.run.smithi194.stdout:(11/122): libcephfs2-16.2.14-44.geeb13ac9.el8.x 3.1 MB/s | 824 kB 00:00 2023-09-30T22:14:13.164 INFO:teuthology.orchestra.run.smithi156.stdout:(2/122): ceph-base-16.2.14-44.geeb13ac9.el8.x86 8.9 MB/s | 6.1 MB 00:00 2023-09-30T22:14:13.245 INFO:teuthology.orchestra.run.smithi194.stdout:(12/122): libcephsqlite-16.2.14-44.geeb13ac9.el 1.9 MB/s | 174 kB 00:00 2023-09-30T22:14:13.329 INFO:teuthology.orchestra.run.smithi194.stdout:(13/122): librados-devel-16.2.14-44.geeb13ac9.e 1.5 MB/s | 131 kB 00:00 2023-09-30T22:14:13.390 INFO:teuthology.orchestra.run.smithi156.stdout:(3/122): ceph-fuse-16.2.14-44.geeb13ac9.el8.x86 1.3 MB/s | 910 kB 00:00 2023-09-30T22:14:13.498 INFO:teuthology.orchestra.run.smithi156.stdout:(4/122): ceph-mds-16.2.14-44.geeb13ac9.el8.x86_ 7.3 MB/s | 2.4 MB 00:00 2023-09-30T22:14:13.521 INFO:teuthology.orchestra.run.smithi194.stdout:(14/122): libradosstriper1-16.2.14-44.geeb13ac9 2.5 MB/s | 493 kB 00:00 2023-09-30T22:14:14.232 INFO:teuthology.orchestra.run.smithi156.stdout:(5/122): ceph-mon-16.2.14-44.geeb13ac9.el8.x86_ 6.9 MB/s | 5.0 MB 00:00 2023-09-30T22:14:14.274 INFO:teuthology.orchestra.run.smithi156.stdout:(6/122): ceph-mgr-16.2.14-44.geeb13ac9.el8.x86_ 1.8 MB/s | 1.6 MB 00:00 2023-09-30T22:14:14.313 INFO:teuthology.orchestra.run.smithi194.stdout:(15/122): librgw2-16.2.14-44.geeb13ac9.el8.x86_ 4.8 MB/s | 3.8 MB 00:00 2023-09-30T22:14:14.413 INFO:teuthology.orchestra.run.smithi194.stdout:(16/122): python3-ceph-argparse-16.2.14-44.geeb 451 kB/s | 45 kB 00:00 2023-09-30T22:14:14.513 INFO:teuthology.orchestra.run.smithi194.stdout:(17/122): python3-ceph-common-16.2.14-44.geeb13 987 kB/s | 99 kB 00:00 2023-09-30T22:14:14.622 INFO:teuthology.orchestra.run.smithi194.stdout:(18/122): python3-cephfs-16.2.14-44.geeb13ac9.e 1.9 MB/s | 215 kB 00:00 2023-09-30T22:14:14.814 INFO:teuthology.orchestra.run.smithi194.stdout:(19/122): python3-rados-16.2.14-44.geeb13ac9.el 2.0 MB/s | 390 kB 00:00 2023-09-30T22:14:15.006 INFO:teuthology.orchestra.run.smithi194.stdout:(20/122): python3-rbd-16.2.14-44.geeb13ac9.el8. 1.9 MB/s | 369 kB 00:00 2023-09-30T22:14:15.114 INFO:teuthology.orchestra.run.smithi194.stdout:(21/122): python3-rgw-16.2.14-44.geeb13ac9.el8. 1.0 MB/s | 114 kB 00:00 2023-09-30T22:14:15.223 INFO:teuthology.orchestra.run.smithi194.stdout:(22/122): rbd-fuse-16.2.14-44.geeb13ac9.el8.x86 816 kB/s | 88 kB 00:00 2023-09-30T22:14:15.949 INFO:teuthology.orchestra.run.smithi194.stdout:(23/122): ceph-radosgw-16.2.14-44.geeb13ac9.el8 3.0 MB/s | 12 MB 00:03 2023-09-30T22:14:16.082 INFO:teuthology.orchestra.run.smithi194.stdout:(24/122): rbd-mirror-16.2.14-44.geeb13ac9.el8.x 4.3 MB/s | 3.7 MB 00:00 2023-09-30T22:14:16.107 INFO:teuthology.orchestra.run.smithi194.stdout:(25/122): rbd-nbd-16.2.14-44.geeb13ac9.el8.x86_ 1.1 MB/s | 173 kB 00:00 2023-09-30T22:14:16.174 INFO:teuthology.orchestra.run.smithi194.stdout:(26/122): ceph-grafana-dashboards-16.2.14-44.ge 266 kB/s | 24 kB 00:00 2023-09-30T22:14:16.357 INFO:teuthology.orchestra.run.smithi156.stdout:(7/122): ceph-osd-16.2.14-44.geeb13ac9.el8.x86_ 8.6 MB/s | 18 MB 00:02 2023-09-30T22:14:16.424 INFO:teuthology.orchestra.run.smithi156.stdout:(8/122): ceph-selinux-16.2.14-44.geeb13ac9.el8. 386 kB/s | 26 kB 00:00 2023-09-30T22:14:17.236 INFO:teuthology.orchestra.run.smithi156.stdout:(9/122): ceph-radosgw-16.2.14-44.geeb13ac9.el8. 3.9 MB/s | 12 MB 00:02 2023-09-30T22:14:17.383 INFO:teuthology.orchestra.run.smithi156.stdout:(10/122): libcephfs-devel-16.2.14-44.geeb13ac9. 174 kB/s | 25 kB 00:00 2023-09-30T22:14:17.424 INFO:teuthology.orchestra.run.smithi194.stdout:(27/122): ceph-mgr-dashboard-16.2.14-44.geeb13a 2.4 MB/s | 3.1 MB 00:01 2023-09-30T22:14:17.591 INFO:teuthology.orchestra.run.smithi194.stdout:(28/122): ceph-mgr-modules-core-16.2.14-44.geeb 1.4 MB/s | 244 kB 00:00 2023-09-30T22:14:17.642 INFO:teuthology.orchestra.run.smithi156.stdout:(11/122): libcephfs2-16.2.14-44.geeb13ac9.el8.x 3.1 MB/s | 824 kB 00:00 2023-09-30T22:14:17.666 INFO:teuthology.orchestra.run.smithi194.stdout:(29/122): ceph-mgr-rook-16.2.14-44.geeb13ac9.el 366 kB/s | 27 kB 00:00 2023-09-30T22:14:17.734 INFO:teuthology.orchestra.run.smithi156.stdout:(12/122): libcephsqlite-16.2.14-44.geeb13ac9.el 1.9 MB/s | 174 kB 00:00 2023-09-30T22:14:17.784 INFO:teuthology.orchestra.run.smithi194.stdout:(30/122): ceph-mgr-diskprediction-local-16.2.14 5.3 MB/s | 8.6 MB 00:01 2023-09-30T22:14:17.809 INFO:teuthology.orchestra.run.smithi194.stdout:(31/122): ceph-prometheus-alerts-16.2.14-44.gee 104 kB/s | 15 kB 00:00 2023-09-30T22:14:17.817 INFO:teuthology.orchestra.run.smithi156.stdout:(13/122): librados-devel-16.2.14-44.geeb13ac9.e 1.5 MB/s | 131 kB 00:00 2023-09-30T22:14:17.968 INFO:teuthology.orchestra.run.smithi156.stdout:(14/122): libradosstriper1-16.2.14-44.geeb13ac9 3.2 MB/s | 493 kB 00:00 2023-09-30T22:14:18.655 INFO:teuthology.orchestra.run.smithi156.stdout:(15/122): librgw2-16.2.14-44.geeb13ac9.el8.x86_ 5.5 MB/s | 3.8 MB 00:00 2023-09-30T22:14:18.726 INFO:teuthology.orchestra.run.smithi156.stdout:(16/122): python3-ceph-argparse-16.2.14-44.geeb 635 kB/s | 45 kB 00:00 2023-09-30T22:14:18.784 INFO:teuthology.orchestra.run.smithi194.stdout:(32/122): ceph-test-16.2.14-44.geeb13ac9.el8.x8 8.2 MB/s | 52 MB 00:06 2023-09-30T22:14:18.809 INFO:teuthology.orchestra.run.smithi194.stdout:(33/122): flex-2.6.1-9.el8.x86_64.rpm 319 kB/s | 320 kB 00:01 2023-09-30T22:14:18.810 INFO:teuthology.orchestra.run.smithi156.stdout:(17/122): python3-ceph-common-16.2.14-44.geeb13 1.2 MB/s | 99 kB 00:00 2023-09-30T22:14:18.843 INFO:teuthology.orchestra.run.smithi194.stdout:(34/122): bison-3.0.4-10.el8.x86_64.rpm 650 kB/s | 688 kB 00:01 2023-09-30T22:14:18.894 INFO:teuthology.orchestra.run.smithi156.stdout:(18/122): python3-cephfs-16.2.14-44.geeb13ac9.e 2.5 MB/s | 215 kB 00:00 2023-09-30T22:14:18.976 INFO:teuthology.orchestra.run.smithi194.stdout:(35/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.9 MB/s | 259 kB 00:00 2023-09-30T22:14:19.002 INFO:teuthology.orchestra.run.smithi194.stdout:(36/122): librdkafka-0.11.4-3.el8.x86_64.rpm 1.8 MB/s | 354 kB 00:00 2023-09-30T22:14:19.043 INFO:teuthology.orchestra.run.smithi156.stdout:(19/122): python3-rados-16.2.14-44.geeb13ac9.el 2.6 MB/s | 390 kB 00:00 2023-09-30T22:14:19.094 INFO:teuthology.orchestra.run.smithi194.stdout:(37/122): oniguruma-6.8.2-2.el8.x86_64.rpm 1.6 MB/s | 187 kB 00:00 2023-09-30T22:14:19.128 INFO:teuthology.orchestra.run.smithi156.stdout:(20/122): python3-rbd-16.2.14-44.geeb13ac9.el8. 4.2 MB/s | 369 kB 00:00 2023-09-30T22:14:19.212 INFO:teuthology.orchestra.run.smithi156.stdout:(21/122): python3-rgw-16.2.14-44.geeb13ac9.el8. 1.3 MB/s | 114 kB 00:00 2023-09-30T22:14:19.279 INFO:teuthology.orchestra.run.smithi156.stdout:(22/122): rbd-fuse-16.2.14-44.geeb13ac9.el8.x86 1.3 MB/s | 88 kB 00:00 2023-09-30T22:14:19.302 INFO:teuthology.orchestra.run.smithi194.stdout:(38/122): jq-1.6-7.el8.x86_64.rpm 391 kB/s | 202 kB 00:00 2023-09-30T22:14:19.411 INFO:teuthology.orchestra.run.smithi194.stdout:(39/122): python3-jsonpatch-1.21-2.el8.noarch.r 246 kB/s | 27 kB 00:00 2023-09-30T22:14:19.478 INFO:teuthology.orchestra.run.smithi194.stdout:(40/122): openblas-0.3.15-4.el8.x86_64.rpm 9.9 MB/s | 4.7 MB 00:00 2023-09-30T22:14:19.545 INFO:teuthology.orchestra.run.smithi194.stdout:(41/122): openblas-threads-0.3.15-4.el8.x86_64. 11 MB/s | 4.9 MB 00:00 2023-09-30T22:14:19.570 INFO:teuthology.orchestra.run.smithi194.stdout:(42/122): python3-jsonpointer-1.10-11.el8.noarc 125 kB/s | 20 kB 00:00 2023-09-30T22:14:19.595 INFO:teuthology.orchestra.run.smithi194.stdout:(43/122): python3-mako-1.0.6-14.el8.noarch.rpm 1.3 MB/s | 157 kB 00:00 2023-09-30T22:14:19.646 INFO:teuthology.orchestra.run.smithi194.stdout:(44/122): python3-markupsafe-0.23-19.el8.x86_64 386 kB/s | 39 kB 00:00 2023-09-30T22:14:19.704 INFO:teuthology.orchestra.run.smithi194.stdout:(45/122): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.0 MB/s | 225 kB 00:00 2023-09-30T22:14:19.746 INFO:teuthology.orchestra.run.smithi194.stdout:(46/122): python3-prettytable-0.7.2-14.el8.noar 437 kB/s | 44 kB 00:00 2023-09-30T22:14:19.833 INFO:teuthology.orchestra.run.smithi194.stdout:(47/122): python3-pyOpenSSL-19.0.0-1.el8.noarch 802 kB/s | 103 kB 00:00 2023-09-30T22:14:19.846 INFO:teuthology.orchestra.run.smithi156.stdout:(23/122): rbd-mirror-16.2.14-44.geeb13ac9.el8.x 6.5 MB/s | 3.7 MB 00:00 2023-09-30T22:14:19.855 INFO:teuthology.orchestra.run.smithi194.stdout:(48/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-09-30T22:14:19.929 INFO:teuthology.orchestra.run.smithi156.stdout:(24/122): rbd-nbd-16.2.14-44.geeb13ac9.el8.x86_ 2.0 MB/s | 173 kB 00:00 2023-09-30T22:14:19.930 INFO:teuthology.orchestra.run.smithi194.stdout:(49/122): python3-pyasn1-modules-0.3.7-6.el8.no 1.1 MB/s | 110 kB 00:00 2023-09-30T22:14:19.956 INFO:teuthology.orchestra.run.smithi194.stdout:(50/122): python3-pytz-2017.2-11.el8.noarch.rpm 569 kB/s | 57 kB 00:00 2023-09-30T22:14:20.021 INFO:teuthology.orchestra.run.smithi156.stdout:(25/122): ceph-grafana-dashboards-16.2.14-44.ge 265 kB/s | 24 kB 00:00 2023-09-30T22:14:20.065 INFO:teuthology.orchestra.run.smithi194.stdout:(51/122): python3-werkzeug-0.12.2-4.el8.noarch. 4.1 MB/s | 457 kB 00:00 2023-09-30T22:14:20.123 INFO:teuthology.orchestra.run.smithi194.stdout:(52/122): python3-numpy-1.14.3-10.el8.x86_64.rp 6.8 MB/s | 3.7 MB 00:00 2023-09-30T22:14:20.173 INFO:teuthology.orchestra.run.smithi194.stdout:(53/122): socat-1.7.4.1-1.el8.x86_64.rpm 2.9 MB/s | 323 kB 00:00 2023-09-30T22:14:20.223 INFO:teuthology.orchestra.run.smithi194.stdout:(54/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 705 kB/s | 71 kB 00:00 2023-09-30T22:14:20.307 INFO:teuthology.orchestra.run.smithi194.stdout:(55/122): elfutils-libelf-devel-0.189-3.el8.x86 463 kB/s | 62 kB 00:00 2023-09-30T22:14:20.357 INFO:teuthology.orchestra.run.smithi194.stdout:(56/122): fuse-2.9.7-17.el8.x86_64.rpm 621 kB/s | 83 kB 00:00 2023-09-30T22:14:20.383 INFO:teuthology.orchestra.run.smithi194.stdout:(57/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 638 kB/s | 48 kB 00:00 2023-09-30T22:14:20.558 INFO:teuthology.orchestra.run.smithi194.stdout:(58/122): python3-scipy-1.0.0-21.module_el8.5.0 22 MB/s | 14 MB 00:00 2023-09-30T22:14:20.583 INFO:teuthology.orchestra.run.smithi194.stdout:(59/122): libcom_err-devel-1.45.6-5.el8.x86_64. 193 kB/s | 39 kB 00:00 2023-09-30T22:14:20.608 INFO:teuthology.orchestra.run.smithi194.stdout:(60/122): krb5-devel-1.18.2-22.el8.x86_64.rpm 2.2 MB/s | 561 kB 00:00 2023-09-30T22:14:20.659 INFO:teuthology.orchestra.run.smithi194.stdout:(61/122): librabbitmq-0.9.0-4.el8.x86_64.rpm 939 kB/s | 47 kB 00:00 2023-09-30T22:14:20.684 INFO:teuthology.orchestra.run.smithi194.stdout:(62/122): libquadmath-8.5.0-20.el8.x86_64.rpm 1.7 MB/s | 172 kB 00:00 2023-09-30T22:14:20.734 INFO:teuthology.orchestra.run.smithi194.stdout:(63/122): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-09-30T22:14:20.759 INFO:teuthology.orchestra.run.smithi194.stdout:(64/122): libselinux-devel-2.9-8.el8.x86_64.rpm 1.9 MB/s | 200 kB 00:00 2023-09-30T22:14:20.785 INFO:teuthology.orchestra.run.smithi194.stdout:(65/122): libverto-devel-0.3.2-2.el8.x86_64.rpm 360 kB/s | 18 kB 00:00 2023-09-30T22:14:20.810 INFO:teuthology.orchestra.run.smithi194.stdout:(66/122): libzstd-devel-1.4.4-1.el8.x86_64.rpm 872 kB/s | 44 kB 00:00 2023-09-30T22:14:20.822 INFO:teuthology.orchestra.run.smithi156.stdout:(26/122): ceph-test-16.2.14-44.geeb13ac9.el8.x8 12 MB/s | 52 MB 00:04 2023-09-30T22:14:20.843 INFO:teuthology.orchestra.run.smithi194.stdout:(67/122): libgfortran-8.5.0-20.el8.x86_64.rpm 2.2 MB/s | 645 kB 00:00 2023-09-30T22:14:20.902 INFO:teuthology.orchestra.run.smithi194.stdout:(68/122): pcre2-utf16-10.32-3.el8.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2023-09-30T22:14:20.927 INFO:teuthology.orchestra.run.smithi194.stdout:(69/122): pcre2-devel-10.32-3.el8.x86_64.rpm 5.0 MB/s | 605 kB 00:00 2023-09-30T22:14:20.961 INFO:teuthology.orchestra.run.smithi194.stdout:(70/122): pcre2-utf32-10.32-3.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-09-30T22:14:20.986 INFO:teuthology.orchestra.run.smithi194.stdout:(71/122): python3-cffi-1.11.5-6.el8.x86_64.rpm 4.2 MB/s | 249 kB 00:00 2023-09-30T22:14:21.036 INFO:teuthology.orchestra.run.smithi194.stdout:(72/122): python3-jwt-1.6.1-2.el8.noarch.rpm 854 kB/s | 43 kB 00:00 2023-09-30T22:14:21.064 INFO:teuthology.orchestra.run.smithi156.stdout:(27/122): ceph-common-16.2.14-44.geeb13ac9.el8. 2.8 MB/s | 24 MB 00:08 2023-09-30T22:14:21.095 INFO:teuthology.orchestra.run.smithi194.stdout:(73/122): python3-cryptography-3.2.1-6.el8.x86_ 4.7 MB/s | 641 kB 00:00 2023-09-30T22:14:21.120 INFO:teuthology.orchestra.run.smithi194.stdout:(74/122): python3-oauthlib-2.1.0-1.el8.noarch.r 1.8 MB/s | 155 kB 00:00 2023-09-30T22:14:21.145 INFO:teuthology.orchestra.run.smithi156.stdout:(28/122): ceph-mgr-dashboard-16.2.14-44.geeb13a 2.8 MB/s | 3.1 MB 00:01 2023-09-30T22:14:21.154 INFO:teuthology.orchestra.run.smithi194.stdout:(75/122): python3-pycparser-2.14-14.el8.noarch. 1.8 MB/s | 109 kB 00:00 2023-09-30T22:14:21.179 INFO:teuthology.orchestra.run.smithi194.stdout:(76/122): python3-requests-oauthlib-1.0.0-1.el8 729 kB/s | 43 kB 00:00 2023-09-30T22:14:21.214 INFO:teuthology.orchestra.run.smithi156.stdout:(29/122): ceph-mgr-modules-core-16.2.14-44.geeb 1.6 MB/s | 244 kB 00:00 2023-09-30T22:14:21.240 INFO:teuthology.orchestra.run.smithi156.stdout:(30/122): ceph-mgr-rook-16.2.14-44.geeb13ac9.el 292 kB/s | 27 kB 00:00 2023-09-30T22:14:21.246 INFO:teuthology.orchestra.run.smithi194.stdout:(77/122): openssl-devel-1.1.1k-9.el8.x86_64.rpm 6.9 MB/s | 3.2 MB 00:00 2023-09-30T22:14:21.280 INFO:teuthology.orchestra.run.smithi194.stdout:(78/122): zlib-devel-1.2.11-21.el8.x86_64.rpm 462 kB/s | 58 kB 00:00 2023-09-30T22:14:21.282 INFO:teuthology.orchestra.run.smithi156.stdout:(31/122): ceph-prometheus-alerts-16.2.14-44.gee 223 kB/s | 15 kB 00:00 2023-09-30T22:14:21.490 INFO:teuthology.orchestra.run.smithi156.stdout:(32/122): ceph-mgr-diskprediction-local-16.2.14 13 MB/s | 8.6 MB 00:00 2023-09-30T22:14:21.789 INFO:teuthology.orchestra.run.smithi194.stdout:(79/122): liboath-2.6.2-3.el8.x86_64.rpm 117 kB/s | 59 kB 00:00 2023-09-30T22:14:21.824 INFO:teuthology.orchestra.run.smithi156.stdout:(33/122): flex-2.6.1-9.el8.x86_64.rpm 590 kB/s | 320 kB 00:00 2023-09-30T22:14:21.839 INFO:teuthology.orchestra.run.smithi194.stdout:(80/122): leveldb-1.22-1.el8.x86_64.rpm 305 kB/s | 181 kB 00:00 2023-09-30T22:14:21.916 INFO:teuthology.orchestra.run.smithi156.stdout:(34/122): bison-3.0.4-10.el8.x86_64.rpm 1.0 MB/s | 688 kB 00:00 2023-09-30T22:14:21.956 INFO:teuthology.orchestra.run.smithi194.stdout:(81/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 374 kB/s | 44 kB 00:00 2023-09-30T22:14:21.981 INFO:teuthology.orchestra.run.smithi194.stdout:(82/122): libunwind-1.3.1-3.el8.x86_64.rpm 391 kB/s | 75 kB 00:00 2023-09-30T22:14:21.999 INFO:teuthology.orchestra.run.smithi156.stdout:(35/122): jq-1.6-7.el8.x86_64.rpm 398 kB/s | 202 kB 00:00 2023-09-30T22:14:22.014 INFO:teuthology.orchestra.run.smithi194.stdout:(83/122): gperftools-libs-2.7-9.el8.x86_64.rpm 367 kB/s | 306 kB 00:00 2023-09-30T22:14:22.033 INFO:teuthology.orchestra.run.smithi156.stdout:(36/122): librdkafka-0.11.4-3.el8.x86_64.rpm 1.7 MB/s | 354 kB 00:00 2023-09-30T22:14:22.058 INFO:teuthology.orchestra.run.smithi156.stdout:(37/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.8 MB/s | 259 kB 00:00 2023-09-30T22:14:22.073 INFO:teuthology.orchestra.run.smithi194.stdout:(84/122): python3-cachetools-3.1.1-4.el8.noarch 359 kB/s | 33 kB 00:00 2023-09-30T22:14:22.107 INFO:teuthology.orchestra.run.smithi194.stdout:(85/122): python3-certifi-2018.10.15-7.el8.noar 177 kB/s | 16 kB 00:00 2023-09-30T22:14:22.224 INFO:teuthology.orchestra.run.smithi194.stdout:(86/122): python3-beautifulsoup4-4.6.3-2.el8.1. 692 kB/s | 185 kB 00:00 2023-09-30T22:14:22.259 INFO:teuthology.orchestra.run.smithi156.stdout:(38/122): oniguruma-6.8.2-2.el8.x86_64.rpm 723 kB/s | 187 kB 00:00 2023-09-30T22:14:22.341 INFO:teuthology.orchestra.run.smithi194.stdout:(87/122): python3-cheroot-8.5.2-1.el8.noarch.rp 646 kB/s | 173 kB 00:00 2023-09-30T22:14:22.367 INFO:teuthology.orchestra.run.smithi156.stdout:(39/122): python3-jsonpatch-1.21-2.el8.noarch.r 246 kB/s | 27 kB 00:00 2023-09-30T22:14:22.408 INFO:teuthology.orchestra.run.smithi194.stdout:(88/122): python3-google-auth-1.1.1-10.el8.noar 443 kB/s | 81 kB 00:00 2023-09-30T22:14:22.441 INFO:teuthology.orchestra.run.smithi194.stdout:(89/122): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2023-09-30T22:14:22.442 INFO:teuthology.orchestra.run.smithi156.stdout:(40/122): openblas-threads-0.3.15-4.el8.x86_64. 13 MB/s | 4.9 MB 00:00 2023-09-30T22:14:22.509 INFO:teuthology.orchestra.run.smithi194.stdout:(90/122): python3-jaraco-functools-2.0-4.el8.no 175 kB/s | 18 kB 00:00 2023-09-30T22:14:22.510 INFO:teuthology.orchestra.run.smithi156.stdout:(41/122): openblas-0.3.15-4.el8.x86_64.rpm 9.9 MB/s | 4.7 MB 00:00 2023-09-30T22:14:22.527 INFO:teuthology.orchestra.run.smithi156.stdout:(42/122): python3-jsonpointer-1.10-11.el8.noarc 125 kB/s | 20 kB 00:00 2023-09-30T22:14:22.552 INFO:teuthology.orchestra.run.smithi156.stdout:(43/122): python3-mako-1.0.6-14.el8.noarch.rpm 1.4 MB/s | 157 kB 00:00 2023-09-30T22:14:22.602 INFO:teuthology.orchestra.run.smithi156.stdout:(44/122): python3-markupsafe-0.23-19.el8.x86_64 421 kB/s | 39 kB 00:00 2023-09-30T22:14:22.608 INFO:teuthology.orchestra.run.smithi194.stdout:(91/122): python3-cherrypy-18.4.0-1.el8.noarch. 767 kB/s | 384 kB 00:00 2023-09-30T22:14:22.658 INFO:teuthology.orchestra.run.smithi194.stdout:(92/122): python3-logutils-0.3.5-11.el8.noarch. 324 kB/s | 49 kB 00:00 2023-09-30T22:14:22.701 INFO:teuthology.orchestra.run.smithi156.stdout:(45/122): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.5 MB/s | 225 kB 00:00 2023-09-30T22:14:22.708 INFO:teuthology.orchestra.run.smithi194.stdout:(93/122): python3-more-itertools-7.2.0-3.el8.no 586 kB/s | 59 kB 00:00 2023-09-30T22:14:22.720 INFO:teuthology.orchestra.run.smithi156.stdout:(46/122): python3-prettytable-0.7.2-14.el8.noar 374 kB/s | 44 kB 00:00 2023-09-30T22:14:22.809 INFO:teuthology.orchestra.run.smithi194.stdout:(94/122): python3-portend-2.6-1.el8.noarch.rpm 156 kB/s | 16 kB 00:00 2023-09-30T22:14:22.853 INFO:teuthology.orchestra.run.smithi156.stdout:(47/122): python3-pyOpenSSL-19.0.0-1.el8.noarch 679 kB/s | 103 kB 00:00 2023-09-30T22:14:22.870 INFO:teuthology.orchestra.run.smithi156.stdout:(48/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 841 kB/s | 126 kB 00:00 2023-09-30T22:14:22.909 INFO:teuthology.orchestra.run.smithi194.stdout:(95/122): python3-repoze-lru-0.7-6.el8.noarch.r 337 kB/s | 34 kB 00:00 2023-09-30T22:14:22.954 INFO:teuthology.orchestra.run.smithi156.stdout:(49/122): python3-pyasn1-modules-0.3.7-6.el8.no 1.1 MB/s | 110 kB 00:00 2023-09-30T22:14:22.979 INFO:teuthology.orchestra.run.smithi156.stdout:(50/122): python3-pytz-2017.2-11.el8.noarch.rpm 525 kB/s | 57 kB 00:00 2023-09-30T22:14:23.018 INFO:teuthology.orchestra.run.smithi194.stdout:(96/122): python3-pecan-1.3.2-9.el8.noarch.rpm 787 kB/s | 283 kB 00:00 2023-09-30T22:14:23.079 INFO:teuthology.orchestra.run.smithi156.stdout:(51/122): python3-numpy-1.14.3-10.el8.x86_64.rp 6.8 MB/s | 3.7 MB 00:00 2023-09-30T22:14:23.113 INFO:teuthology.orchestra.run.smithi156.stdout:(52/122): python3-werkzeug-0.12.2-4.el8.noarch. 3.3 MB/s | 457 kB 00:00 2023-09-30T22:14:23.126 INFO:teuthology.orchestra.run.smithi194.stdout:(97/122): python3-rsa-4.9-2.el8.noarch.rpm 595 kB/s | 64 kB 00:00 2023-09-30T22:14:23.201 INFO:teuthology.orchestra.run.smithi194.stdout:(98/122): python3-routes-2.4.1-12.el8.noarch.rp 673 kB/s | 196 kB 00:00 2023-09-30T22:14:23.205 INFO:teuthology.orchestra.run.smithi156.stdout:(53/122): socat-1.7.4.1-1.el8.x86_64.rpm 2.5 MB/s | 323 kB 00:00 2023-09-30T22:14:23.227 INFO:teuthology.orchestra.run.smithi194.stdout:(99/122): python3-simplegeneric-0.8.1-17.el8.no 186 kB/s | 19 kB 00:00 2023-09-30T22:14:23.230 INFO:teuthology.orchestra.run.smithi156.stdout:(54/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 605 kB/s | 71 kB 00:00 2023-09-30T22:14:23.302 INFO:teuthology.orchestra.run.smithi194.stdout:(100/122): python3-singledispatch-3.4.0.3-18.el 238 kB/s | 24 kB 00:00 2023-09-30T22:14:23.352 INFO:teuthology.orchestra.run.smithi194.stdout:(101/122): python3-tempora-1.14.1-5.el8.noarch. 234 kB/s | 29 kB 00:00 2023-09-30T22:14:23.389 INFO:teuthology.orchestra.run.smithi156.stdout:(55/122): elfutils-libelf-devel-0.189-3.el8.x86 336 kB/s | 62 kB 00:00 2023-09-30T22:14:23.403 INFO:teuthology.orchestra.run.smithi194.stdout:(102/122): python3-trustme-0.6.0-4.el8.noarch.r 274 kB/s | 27 kB 00:00 2023-09-30T22:14:23.414 INFO:teuthology.orchestra.run.smithi156.stdout:(56/122): fuse-2.9.7-17.el8.x86_64.rpm 452 kB/s | 83 kB 00:00 2023-09-30T22:14:23.474 INFO:teuthology.orchestra.run.smithi156.stdout:(57/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 576 kB/s | 48 kB 00:00 2023-09-30T22:14:23.534 INFO:teuthology.orchestra.run.smithi156.stdout:(58/122): libcom_err-devel-1.45.6-5.el8.x86_64. 667 kB/s | 39 kB 00:00 2023-09-30T22:14:23.674 INFO:teuthology.orchestra.run.smithi156.stdout:(59/122): python3-scipy-1.0.0-21.module_el8.5.0 19 MB/s | 14 MB 00:00 2023-09-30T22:14:23.695 INFO:teuthology.orchestra.run.smithi194.stdout:(103/122): python3-waitress-1.4.3-1.el8.noarch. 747 kB/s | 255 kB 00:00 2023-09-30T22:14:23.699 INFO:teuthology.orchestra.run.smithi156.stdout:(60/122): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.9 MB/s | 561 kB 00:00 2023-09-30T22:14:23.745 INFO:teuthology.orchestra.run.smithi194.stdout:(104/122): python3-webob-1.8.5-1.el8.1.noarch.r 735 kB/s | 251 kB 00:00 2023-09-30T22:14:23.758 INFO:teuthology.orchestra.run.smithi156.stdout:(61/122): librabbitmq-0.9.0-4.el8.x86_64.rpm 805 kB/s | 47 kB 00:00 2023-09-30T22:14:23.783 INFO:teuthology.orchestra.run.smithi156.stdout:(62/122): libgfortran-8.5.0-20.el8.x86_64.rpm 2.5 MB/s | 645 kB 00:00 2023-09-30T22:14:23.795 INFO:teuthology.orchestra.run.smithi194.stdout:(105/122): python3-websocket-client-0.56.0-5.el 612 kB/s | 61 kB 00:00 2023-09-30T22:14:23.850 INFO:teuthology.orchestra.run.smithi156.stdout:(63/122): libselinux-devel-2.9-8.el8.x86_64.rpm 2.1 MB/s | 200 kB 00:00 2023-09-30T22:14:23.875 INFO:teuthology.orchestra.run.smithi156.stdout:(64/122): libquadmath-8.5.0-20.el8.x86_64.rpm 859 kB/s | 172 kB 00:00 2023-09-30T22:14:23.900 INFO:teuthology.orchestra.run.smithi156.stdout:(65/122): libsepol-devel-2.9-3.el8.x86_64.rpm 743 kB/s | 87 kB 00:00 2023-09-30T22:14:23.903 INFO:teuthology.orchestra.run.smithi194.stdout:(106/122): python3-zc-lockfile-2.0-2.el8.noarch 212 kB/s | 23 kB 00:00 2023-09-30T22:14:23.926 INFO:teuthology.orchestra.run.smithi156.stdout:(66/122): libverto-devel-0.3.2-2.el8.x86_64.rpm 240 kB/s | 18 kB 00:00 2023-09-30T22:14:23.929 INFO:teuthology.orchestra.run.smithi194.stdout:(107/122): python3-webtest-2.0.33-1.el8.noarch. 464 kB/s | 85 kB 00:00 2023-09-30T22:14:23.951 INFO:teuthology.orchestra.run.smithi156.stdout:(67/122): libzstd-devel-1.4.4-1.el8.x86_64.rpm 875 kB/s | 44 kB 00:00 2023-09-30T22:14:24.009 INFO:teuthology.orchestra.run.smithi156.stdout:(68/122): pcre2-utf16-10.32-3.el8.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2023-09-30T22:14:24.034 INFO:teuthology.orchestra.run.smithi156.stdout:(69/122): pcre2-devel-10.32-3.el8.x86_64.rpm 5.4 MB/s | 605 kB 00:00 2023-09-30T22:14:24.063 INFO:teuthology.orchestra.run.smithi194.stdout:(108/122): python3-kubernetes-11.0.0-6.el8.noar 736 kB/s | 1.2 MB 00:01 2023-09-30T22:14:24.077 INFO:teuthology.orchestra.run.smithi156.stdout:(70/122): pcre2-utf32-10.32-3.el8.x86_64.rpm 3.2 MB/s | 220 kB 00:00 2023-09-30T22:14:24.118 INFO:teuthology.orchestra.run.smithi156.stdout:(71/122): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.9 MB/s | 249 kB 00:00 2023-09-30T22:14:24.177 INFO:teuthology.orchestra.run.smithi156.stdout:(72/122): python3-jwt-1.6.1-2.el8.noarch.rpm 731 kB/s | 43 kB 00:00 2023-09-30T22:14:24.238 INFO:teuthology.orchestra.run.smithi194.stdout:(109/122): NetworkManager-initscripts-updown-1. 820 kB/s | 143 kB 00:00 2023-09-30T22:14:24.261 INFO:teuthology.orchestra.run.smithi156.stdout:(73/122): python3-cryptography-3.2.1-6.el8.x86_ 3.4 MB/s | 641 kB 00:00 2023-09-30T22:14:24.295 INFO:teuthology.orchestra.run.smithi156.stdout:(74/122): python3-oauthlib-2.1.0-1.el8.noarch.r 1.3 MB/s | 155 kB 00:00 2023-09-30T22:14:24.336 INFO:teuthology.orchestra.run.smithi156.stdout:(75/122): python3-pycparser-2.14-14.el8.noarch. 1.4 MB/s | 109 kB 00:00 2023-09-30T22:14:24.347 INFO:teuthology.orchestra.run.smithi194.stdout:(110/122): elfutils-debuginfod-client-0.189-3.e 703 kB/s | 76 kB 00:00 2023-09-30T22:14:24.362 INFO:teuthology.orchestra.run.smithi156.stdout:(76/122): python3-requests-oauthlib-1.0.0-1.el8 638 kB/s | 43 kB 00:00 2023-09-30T22:14:24.404 INFO:teuthology.orchestra.run.smithi156.stdout:(77/122): zlib-devel-1.2.11-21.el8.x86_64.rpm 867 kB/s | 58 kB 00:00 2023-09-30T22:14:24.405 INFO:teuthology.orchestra.run.smithi194.stdout:(111/122): librados2-16.2.14-44.geeb13ac9.el8.x 7.5 MB/s | 3.7 MB 00:00 2023-09-30T22:14:24.496 INFO:teuthology.orchestra.run.smithi156.stdout:(78/122): openssl-devel-1.1.1k-9.el8.x86_64.rpm 5.3 MB/s | 3.2 MB 00:00 2023-09-30T22:14:24.497 INFO:teuthology.orchestra.run.smithi194.stdout:(112/122): elfutils-libelf-0.189-3.el8.x86_64.r 1.5 MB/s | 232 kB 00:00 2023-09-30T22:14:24.581 INFO:teuthology.orchestra.run.smithi194.stdout:(113/122): elfutils-libs-0.189-3.el8.x86_64.rpm 1.7 MB/s | 303 kB 00:00 2023-09-30T22:14:24.639 INFO:teuthology.orchestra.run.smithi194.stdout:(114/122): libblkid-2.32.1-43.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-09-30T22:14:24.706 INFO:teuthology.orchestra.run.smithi194.stdout:(115/122): libfdisk-2.32.1-43.el8.x86_64.rpm 3.7 MB/s | 254 kB 00:00 2023-09-30T22:14:24.782 INFO:teuthology.orchestra.run.smithi194.stdout:(116/122): libmount-2.32.1-43.el8.x86_64.rpm 3.1 MB/s | 236 kB 00:00 2023-09-30T22:14:24.840 INFO:teuthology.orchestra.run.smithi194.stdout:(117/122): iproute-6.2.0-2.el8.x86_64.rpm 2.5 MB/s | 880 kB 00:00 2023-09-30T22:14:24.882 INFO:teuthology.orchestra.run.smithi194.stdout:(118/122): libsmartcols-2.32.1-43.el8.x86_64.rp 1.8 MB/s | 179 kB 00:00 2023-09-30T22:14:24.907 INFO:teuthology.orchestra.run.smithi194.stdout:(119/122): libuuid-2.32.1-43.el8.x86_64.rpm 1.4 MB/s | 99 kB 00:00 2023-09-30T22:14:24.966 INFO:teuthology.orchestra.run.smithi194.stdout:(120/122): librbd1-16.2.14-44.geeb13ac9.el8.x86 4.0 MB/s | 4.2 MB 00:01 2023-09-30T22:14:24.991 INFO:teuthology.orchestra.run.smithi194.stdout:(121/122): util-linux-user-2.32.1-43.el8.x86_64 1.2 MB/s | 103 kB 00:00 2023-09-30T22:14:25.233 INFO:teuthology.orchestra.run.smithi194.stdout:(122/122): util-linux-2.32.1-43.el8.x86_64.rpm 7.1 MB/s | 2.5 MB 00:00 2023-09-30T22:14:25.239 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2023-09-30T22:14:25.239 INFO:teuthology.orchestra.run.smithi194.stdout:Total 12 MB/s | 200 MB 00:17 2023-09-30T22:14:25.579 INFO:teuthology.orchestra.run.smithi156.stdout:(79/122): liboath-2.6.2-3.el8.x86_64.rpm 54 kB/s | 59 kB 00:01 2023-09-30T22:14:25.788 INFO:teuthology.orchestra.run.smithi156.stdout:(80/122): leveldb-1.22-1.el8.x86_64.rpm 131 kB/s | 181 kB 00:01 2023-09-30T22:14:25.930 INFO:teuthology.orchestra.run.smithi156.stdout:(81/122): gperftools-libs-2.7-9.el8.x86_64.rpm 195 kB/s | 306 kB 00:01 2023-09-30T22:14:25.936 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2023-09-30T22:14:25.955 INFO:teuthology.orchestra.run.smithi156.stdout:(82/122): libunwind-1.3.1-3.el8.x86_64.rpm 200 kB/s | 75 kB 00:00 2023-09-30T22:14:26.047 INFO:teuthology.orchestra.run.smithi156.stdout:(83/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 168 kB/s | 44 kB 00:00 2023-09-30T22:14:26.161 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2023-09-30T22:14:26.161 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2023-09-30T22:14:26.231 INFO:teuthology.orchestra.run.smithi156.stdout:(84/122): python3-cachetools-3.1.1-4.el8.noarch 120 kB/s | 33 kB 00:00 2023-09-30T22:14:26.256 INFO:teuthology.orchestra.run.smithi156.stdout:(85/122): python3-beautifulsoup4-4.6.3-2.el8.1. 569 kB/s | 185 kB 00:00 2023-09-30T22:14:26.273 INFO:teuthology.orchestra.run.smithi156.stdout:(86/122): python3-certifi-2018.10.15-7.el8.noar 72 kB/s | 16 kB 00:00 2023-09-30T22:14:26.565 INFO:teuthology.orchestra.run.smithi156.stdout:(87/122): python3-google-auth-1.1.1-10.el8.noar 278 kB/s | 81 kB 00:00 2023-09-30T22:14:26.682 INFO:teuthology.orchestra.run.smithi156.stdout:(88/122): python3-cherrypy-18.4.0-1.el8.noarch. 904 kB/s | 384 kB 00:00 2023-09-30T22:14:26.740 INFO:teuthology.orchestra.run.smithi156.stdout:(89/122): python3-cheroot-8.5.2-1.el8.noarch.rp 339 kB/s | 173 kB 00:00 2023-09-30T22:14:26.799 INFO:teuthology.orchestra.run.smithi156.stdout:(90/122): python3-jaraco-6.2-6.el8.noarch.rpm 47 kB/s | 11 kB 00:00 2023-09-30T22:14:26.925 INFO:teuthology.orchestra.run.smithi156.stdout:(91/122): python3-jaraco-functools-2.0-4.el8.no 72 kB/s | 18 kB 00:00 2023-09-30T22:14:27.066 INFO:teuthology.orchestra.run.smithi156.stdout:(92/122): python3-logutils-0.3.5-11.el8.noarch. 182 kB/s | 49 kB 00:00 2023-09-30T22:14:27.183 INFO:teuthology.orchestra.run.smithi156.stdout:(93/122): python3-more-itertools-7.2.0-3.el8.no 227 kB/s | 59 kB 00:00 2023-09-30T22:14:27.433 INFO:teuthology.orchestra.run.smithi156.stdout:(94/122): python3-portend-2.6-1.el8.noarch.rpm 62 kB/s | 16 kB 00:00 2023-09-30T22:14:27.509 INFO:teuthology.orchestra.run.smithi156.stdout:(95/122): python3-pecan-1.3.2-9.el8.noarch.rpm 639 kB/s | 283 kB 00:00 2023-09-30T22:14:27.531 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2023-09-30T22:14:27.534 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2023-09-30T22:14:27.684 INFO:teuthology.orchestra.run.smithi156.stdout:(96/122): python3-repoze-lru-0.7-6.el8.noarch.r 134 kB/s | 34 kB 00:00 2023-09-30T22:14:27.759 INFO:teuthology.orchestra.run.smithi156.stdout:(97/122): python3-kubernetes-11.0.0-6.el8.noarc 1.1 MB/s | 1.2 MB 00:01 2023-09-30T22:14:27.793 INFO:teuthology.orchestra.run.smithi156.stdout:(98/122): python3-routes-2.4.1-12.el8.noarch.rp 692 kB/s | 196 kB 00:00 2023-09-30T22:14:28.227 INFO:teuthology.orchestra.run.smithi156.stdout:(99/122): python3-rsa-4.9-2.el8.noarch.rpm 118 kB/s | 64 kB 00:00 2023-09-30T22:14:28.285 INFO:teuthology.orchestra.run.smithi156.stdout:(100/122): python3-simplegeneric-0.8.1-17.el8.n 36 kB/s | 19 kB 00:00 2023-09-30T22:14:28.319 INFO:teuthology.orchestra.run.smithi156.stdout:(101/122): python3-singledispatch-3.4.0.3-18.el 45 kB/s | 24 kB 00:00 2023-09-30T22:14:28.478 INFO:teuthology.orchestra.run.smithi156.stdout:(102/122): python3-tempora-1.14.1-5.el8.noarch. 117 kB/s | 29 kB 00:00 2023-09-30T22:14:28.570 INFO:teuthology.orchestra.run.smithi156.stdout:(103/122): python3-trustme-0.6.0-4.el8.noarch.r 110 kB/s | 27 kB 00:00 2023-09-30T22:14:28.595 INFO:teuthology.orchestra.run.smithi156.stdout:(104/122): python3-waitress-1.4.3-1.el8.noarch. 927 kB/s | 255 kB 00:00 2023-09-30T22:14:28.803 INFO:teuthology.orchestra.run.smithi156.stdout:(105/122): python3-webob-1.8.5-1.el8.1.noarch.r 772 kB/s | 251 kB 00:00 2023-09-30T22:14:28.829 INFO:teuthology.orchestra.run.smithi156.stdout:(106/122): python3-websocket-client-0.56.0-5.el 236 kB/s | 61 kB 00:00 2023-09-30T22:14:28.854 INFO:teuthology.orchestra.run.smithi156.stdout:(107/122): python3-webtest-2.0.33-1.el8.noarch. 330 kB/s | 85 kB 00:00 2023-09-30T22:14:29.046 INFO:teuthology.orchestra.run.smithi156.stdout:(108/122): python3-zc-lockfile-2.0-2.el8.noarch 95 kB/s | 23 kB 00:00 2023-09-30T22:14:29.188 INFO:teuthology.orchestra.run.smithi156.stdout:(109/122): NetworkManager-initscripts-updown-1. 1.0 MB/s | 143 kB 00:00 2023-09-30T22:14:29.247 INFO:teuthology.orchestra.run.smithi156.stdout:(110/122): librbd1-16.2.14-44.geeb13ac9.el8.x86 11 MB/s | 4.2 MB 00:00 2023-09-30T22:14:29.272 INFO:teuthology.orchestra.run.smithi156.stdout:(111/122): elfutils-debuginfod-client-0.189-3.e 911 kB/s | 76 kB 00:00 2023-09-30T22:14:29.356 INFO:teuthology.orchestra.run.smithi156.stdout:(112/122): elfutils-libs-0.189-3.el8.x86_64.rpm 3.6 MB/s | 303 kB 00:00 2023-09-30T22:14:29.406 INFO:teuthology.orchestra.run.smithi156.stdout:(113/122): elfutils-libelf-0.189-3.el8.x86_64.r 1.4 MB/s | 232 kB 00:00 2023-09-30T22:14:29.465 INFO:teuthology.orchestra.run.smithi156.stdout:(114/122): libblkid-2.32.1-43.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-09-30T22:14:29.548 INFO:teuthology.orchestra.run.smithi156.stdout:(115/122): librados2-16.2.14-44.geeb13ac9.el8.x 5.2 MB/s | 3.7 MB 00:00 2023-09-30T22:14:29.582 INFO:teuthology.orchestra.run.smithi156.stdout:(116/122): iproute-6.2.0-2.el8.x86_64.rpm 3.8 MB/s | 880 kB 00:00 2023-09-30T22:14:29.607 INFO:teuthology.orchestra.run.smithi156.stdout:(117/122): libfdisk-2.32.1-43.el8.x86_64.rpm 1.7 MB/s | 254 kB 00:00 2023-09-30T22:14:29.641 INFO:teuthology.orchestra.run.smithi156.stdout:(118/122): libsmartcols-2.32.1-43.el8.x86_64.rp 3.0 MB/s | 179 kB 00:00 2023-09-30T22:14:29.666 INFO:teuthology.orchestra.run.smithi156.stdout:(119/122): libuuid-2.32.1-43.el8.x86_64.rpm 1.6 MB/s | 99 kB 00:00 2023-09-30T22:14:29.716 INFO:teuthology.orchestra.run.smithi156.stdout:(120/122): util-linux-user-2.32.1-43.el8.x86_64 2.0 MB/s | 103 kB 00:00 2023-09-30T22:14:29.750 INFO:teuthology.orchestra.run.smithi156.stdout:(121/122): libmount-2.32.1-43.el8.x86_64.rpm 1.1 MB/s | 236 kB 00:00 2023-09-30T22:14:29.975 INFO:teuthology.orchestra.run.smithi156.stdout:(122/122): util-linux-2.32.1-43.el8.x86_64.rpm 7.4 MB/s | 2.5 MB 00:00 2023-09-30T22:14:29.980 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-09-30T22:14:29.980 INFO:teuthology.orchestra.run.smithi156.stdout:Total 9.6 MB/s | 200 MB 00:20 2023-09-30T22:14:30.718 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-09-30T22:14:30.941 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-09-30T22:14:30.941 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-09-30T22:14:32.173 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2023-09-30T22:14:32.270 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-09-30T22:14:32.272 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: liboath-2.6.2-3.el8.x86_64 1/1 2023-09-30T22:14:32.273 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-09-30T22:14:32.466 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/136 2023-09-30T22:14:32.680 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/136 2023-09-30T22:14:32.833 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/136 2023-09-30T22:14:32.911 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/136 2023-09-30T22:14:33.100 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/136 2023-09-30T22:14:33.199 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/136 2023-09-30T22:14:33.404 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 5/136 2023-09-30T22:14:33.590 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/136 2023-09-30T22:14:33.741 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-09-30T22:14:34.107 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-09-30T22:14:34.291 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-09-30T22:14:34.687 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-09-30T22:14:34.857 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-09-30T22:14:34.992 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-09-30T22:14:35.174 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-09-30T22:14:35.278 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-09-30T22:14:35.505 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-09-30T22:14:35.657 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/136 2023-09-30T22:14:36.028 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/136 2023-09-30T22:14:36.174 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-09-30T22:14:36.244 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-09-30T22:14:36.452 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/136 2023-09-30T22:14:36.655 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/136 2023-09-30T22:14:36.799 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-09-30T22:14:36.884 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-09-30T22:14:37.015 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-09-30T22:14:37.116 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-09-30T22:14:37.278 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-09-30T22:14:37.312 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: liboath-2.6.2-3.el8.x86_64 1/1 2023-09-30T22:14:37.380 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 18/136 2023-09-30T22:14:37.543 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/136 2023-09-30T22:14:37.561 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 19/136 2023-09-30T22:14:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 20/136 2023-09-30T22:14:37.749 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/136 2023-09-30T22:14:37.815 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 20/136 2023-09-30T22:14:37.942 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/136 2023-09-30T22:14:37.948 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 21/136 2023-09-30T22:14:38.019 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/136 2023-09-30T22:14:38.175 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/136 2023-09-30T22:14:38.295 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/136 2023-09-30T22:14:38.480 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 5/136 2023-09-30T22:14:38.541 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 21/136 2023-09-30T22:14:38.713 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/136 2023-09-30T22:14:38.715 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-0.3.15-4.el8.x86_64 22/136 2023-09-30T22:14:38.900 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-09-30T22:14:39.285 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-09-30T22:14:39.325 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 22/136 2023-09-30T22:14:39.490 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-09-30T22:14:39.516 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-09-30T22:14:39.933 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-09-30T22:14:40.140 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-09-30T22:14:40.198 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-09-30T22:14:40.253 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-09-30T22:14:40.425 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-09-30T22:14:40.530 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-09-30T22:14:40.532 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 24/136 2023-09-30T22:14:40.732 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-09-30T22:14:40.743 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 25/136 2023-09-30T22:14:40.908 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/136 2023-09-30T22:14:40.921 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 26/136 2023-09-30T22:14:41.095 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 27/136 2023-09-30T22:14:41.297 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/136 2023-09-30T22:14:41.302 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 28/136 2023-09-30T22:14:41.466 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-09-30T22:14:41.481 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-09-30T22:14:41.537 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-09-30T22:14:41.780 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/136 2023-09-30T22:14:41.990 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/136 2023-09-30T22:14:42.158 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-09-30T22:14:42.270 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-09-30T22:14:42.441 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-09-30T22:14:42.545 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-09-30T22:14:42.706 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 18/136 2023-09-30T22:14:42.906 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 19/136 2023-09-30T22:14:43.024 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 20/136 2023-09-30T22:14:43.153 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 20/136 2023-09-30T22:14:43.257 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-09-30T22:14:43.307 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 21/136 2023-09-30T22:14:43.543 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 30/136 2023-09-30T22:14:43.739 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 31/136 2023-09-30T22:14:43.909 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 21/136 2023-09-30T22:14:43.993 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/136 2023-09-30T22:14:44.150 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openblas-0.3.15-4.el8.x86_64 22/136 2023-09-30T22:14:44.243 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 33/136 2023-09-30T22:14:44.419 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 34/136 2023-09-30T22:14:44.651 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 35/136 2023-09-30T22:14:44.773 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 22/136 2023-09-30T22:14:44.837 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 36/136 2023-09-30T22:14:44.941 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-09-30T22:14:45.023 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 37/136 2023-09-30T22:14:45.239 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 38/136 2023-09-30T22:14:45.313 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 38/136 2023-09-30T22:14:45.489 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 39/136 2023-09-30T22:14:45.560 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 39/136 2023-09-30T22:14:45.622 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-09-30T22:14:45.739 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-09-30T22:14:45.943 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 24/136 2023-09-30T22:14:46.178 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 25/136 2023-09-30T22:14:46.211 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-09-30T22:14:46.422 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 26/136 2023-09-30T22:14:46.465 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 41/136 2023-09-30T22:14:46.479 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 41/136 2023-09-30T22:14:46.580 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 27/136 2023-09-30T22:14:46.676 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 42/136 2023-09-30T22:14:46.813 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 28/136 2023-09-30T22:14:46.925 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 43/136 2023-09-30T22:14:47.015 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-09-30T22:14:47.170 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 44/136 2023-09-30T22:14:47.376 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 45/136 2023-09-30T22:14:47.541 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 46/136 2023-09-30T22:14:47.748 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 47/136 2023-09-30T22:14:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 48/136 2023-09-30T22:14:48.158 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/136 2023-09-30T22:14:48.345 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/136 2023-09-30T22:14:48.513 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/136 2023-09-30T22:14:48.680 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 52/136 2023-09-30T22:14:48.822 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-09-30T22:14:48.914 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 53/136 2023-09-30T22:14:49.147 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 54/136 2023-09-30T22:14:49.152 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 30/136 2023-09-30T22:14:49.334 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 55/136 2023-09-30T22:14:49.357 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 31/136 2023-09-30T22:14:49.569 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/136 2023-09-30T22:14:49.590 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 56/136 2023-09-30T22:14:49.791 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 57/136 2023-09-30T22:14:49.848 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 33/136 2023-09-30T22:14:50.014 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 58/136 2023-09-30T22:14:50.020 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 34/136 2023-09-30T22:14:50.262 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 59/136 2023-09-30T22:14:50.265 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 35/136 2023-09-30T22:14:50.438 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 36/136 2023-09-30T22:14:50.621 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 60/136 2023-09-30T22:14:50.648 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 37/136 2023-09-30T22:14:50.881 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 38/136 2023-09-30T22:14:50.898 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 61/136 2023-09-30T22:14:50.962 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 38/136 2023-09-30T22:14:51.106 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/136 2023-09-30T22:14:51.150 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 39/136 2023-09-30T22:14:51.259 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 39/136 2023-09-30T22:14:51.342 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 63/136 2023-09-30T22:14:51.423 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-09-30T22:14:51.567 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 64/136 2023-09-30T22:14:51.932 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-09-30T22:14:52.224 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 41/136 2023-09-30T22:14:52.239 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 41/136 2023-09-30T22:14:52.426 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 42/136 2023-09-30T22:14:52.625 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 65/136 2023-09-30T22:14:52.658 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 43/136 2023-09-30T22:14:52.862 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 66/136 2023-09-30T22:14:52.938 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 44/136 2023-09-30T22:14:53.104 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 67/136 2023-09-30T22:14:53.119 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 45/136 2023-09-30T22:14:53.297 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 68/136 2023-09-30T22:14:53.326 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 46/136 2023-09-30T22:14:53.498 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 69/136 2023-09-30T22:14:53.526 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 47/136 2023-09-30T22:14:53.707 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 70/136 2023-09-30T22:14:53.777 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 48/136 2023-09-30T22:14:53.959 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/136 2023-09-30T22:14:53.993 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 71/136 2023-09-30T22:14:54.137 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/136 2023-09-30T22:14:54.193 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 72/136 2023-09-30T22:14:54.298 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/136 2023-09-30T22:14:54.323 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 73/136 2023-09-30T22:14:54.498 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 52/136 2023-09-30T22:14:54.509 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 74/136 2023-09-30T22:14:54.707 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 53/136 2023-09-30T22:14:54.793 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 75/136 2023-09-30T22:14:54.939 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 54/136 2023-09-30T22:14:55.008 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 76/136 2023-09-30T22:14:55.159 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 55/136 2023-09-30T22:14:55.207 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 77/136 2023-09-30T22:14:55.374 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 56/136 2023-09-30T22:14:55.408 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 78/136 2023-09-30T22:14:55.596 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 79/136 2023-09-30T22:14:55.616 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 57/136 2023-09-30T22:14:55.764 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : fuse-2.9.7-17.el8.x86_64 80/136 2023-09-30T22:14:55.839 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 58/136 2023-09-30T22:14:56.033 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 81/136 2023-09-30T22:14:56.104 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 59/136 2023-09-30T22:14:56.210 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 82/136 2023-09-30T22:14:56.382 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 83/136 2023-09-30T22:14:56.499 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 60/136 2023-09-30T22:14:56.617 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/136 2023-09-30T22:14:56.796 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 61/136 2023-09-30T22:14:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/136 2023-09-30T22:14:56.982 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/136 2023-09-30T22:14:57.162 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/136 2023-09-30T22:14:57.244 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 63/136 2023-09-30T22:14:57.338 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 87/136 2023-09-30T22:14:57.510 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 64/136 2023-09-30T22:14:58.572 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 65/136 2023-09-30T22:14:58.772 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 66/136 2023-09-30T22:14:59.006 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 67/136 2023-09-30T22:14:59.214 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 68/136 2023-09-30T22:14:59.474 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 69/136 2023-09-30T22:14:59.817 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 70/136 2023-09-30T22:14:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-09-30T22:15:00.070 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-09-30T22:15:00.395 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 71/136 2023-09-30T22:15:00.635 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 72/136 2023-09-30T22:15:00.774 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-09-30T22:15:00.774 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 73/136 2023-09-30T22:15:00.918 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 74/136 2023-09-30T22:15:01.054 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-09-30T22:15:01.166 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-09-30T22:15:01.223 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 75/136 2023-09-30T22:15:01.311 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-09-30T22:15:01.568 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 76/136 2023-09-30T22:15:01.736 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 77/136 2023-09-30T22:15:01.941 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 78/136 2023-09-30T22:15:02.182 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 79/136 2023-09-30T22:15:02.383 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : fuse-2.9.7-17.el8.x86_64 80/136 2023-09-30T22:15:02.678 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 81/136 2023-09-30T22:15:02.913 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 82/136 2023-09-30T22:15:03.093 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 83/136 2023-09-30T22:15:03.335 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/136 2023-09-30T22:15:03.601 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/136 2023-09-30T22:15:03.855 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/136 2023-09-30T22:15:04.038 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 87/136 2023-09-30T22:15:06.580 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-09-30T22:15:06.838 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-09-30T22:15:07.533 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-09-30T22:15:07.880 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-09-30T22:15:07.988 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-09-30T22:15:08.128 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-09-30T22:15:19.335 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-09-30T22:15:19.336 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /sys 2023-09-30T22:15:19.336 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /proc 2023-09-30T22:15:19.336 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /dev 2023-09-30T22:15:19.336 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /run 2023-09-30T22:15:19.336 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /mnt 2023-09-30T22:15:19.336 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /var/tmp 2023-09-30T22:15:19.336 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /home 2023-09-30T22:15:19.336 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /tmp 2023-09-30T22:15:19.336 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /dev 2023-09-30T22:15:19.336 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:19.764 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-09-30T22:15:20.187 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-09-30T22:15:20.375 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-09-30T22:15:21.854 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-09-30T22:15:22.108 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-09-30T22:15:22.142 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-09-30T22:15:22.377 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 94/136 2023-09-30T22:15:22.716 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 95/136 2023-09-30T22:15:23.006 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 96/136 2023-09-30T22:15:23.207 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 97/136 2023-09-30T22:15:23.419 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 98/136 2023-09-30T22:15:23.591 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 99/136 2023-09-30T22:15:23.659 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 99/136 2023-09-30T22:15:23.844 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : jq-1.6-7.el8.x86_64 100/136 2023-09-30T22:15:23.973 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 101/136 2023-09-30T22:15:25.027 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 102/136 2023-09-30T22:15:25.316 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-09-30T22:15:26.354 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-09-30T22:15:26.532 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-09-30T22:15:26.621 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-09-30T22:15:26.906 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-09-30T22:15:26.907 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /sys 2023-09-30T22:15:26.907 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /proc 2023-09-30T22:15:26.907 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /dev 2023-09-30T22:15:26.907 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /run 2023-09-30T22:15:26.907 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /mnt 2023-09-30T22:15:26.907 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /var/tmp 2023-09-30T22:15:26.907 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /home 2023-09-30T22:15:26.907 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /tmp 2023-09-30T22:15:26.907 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /dev 2023-09-30T22:15:26.907 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:26.999 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 105/136 2023-09-30T22:15:27.233 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-09-30T22:15:27.259 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-09-30T22:15:27.365 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-09-30T22:15:27.415 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-09-30T22:15:27.426 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-09-30T22:15:27.797 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-09-30T22:15:27.951 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-09-30T22:15:29.436 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-09-30T22:15:29.675 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-09-30T22:15:29.710 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-09-30T22:15:29.960 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 94/136 2023-09-30T22:15:30.268 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 95/136 2023-09-30T22:15:30.556 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 96/136 2023-09-30T22:15:30.787 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 97/136 2023-09-30T22:15:31.170 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 98/136 2023-09-30T22:15:31.359 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 99/136 2023-09-30T22:15:31.436 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 99/136 2023-09-30T22:15:31.645 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : jq-1.6-7.el8.x86_64 100/136 2023-09-30T22:15:31.765 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 101/136 2023-09-30T22:15:32.041 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 108/136 2023-09-30T22:15:32.843 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 102/136 2023-09-30T22:15:33.133 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-09-30T22:15:33.281 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-09-30T22:15:33.565 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-09-30T22:15:33.964 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-09-30T22:15:34.180 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-09-30T22:15:34.181 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-09-30T22:15:34.275 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-09-30T22:15:34.349 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-09-30T22:15:34.440 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-09-30T22:15:34.842 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 105/136 2023-09-30T22:15:35.067 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-09-30T22:15:35.093 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-09-30T22:15:35.148 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 112/136 2023-09-30T22:15:35.233 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-09-30T22:15:35.244 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-09-30T22:15:35.394 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 113/136 2023-09-30T22:15:35.625 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 114/136 2023-09-30T22:15:35.801 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 115/136 2023-09-30T22:15:35.972 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 116/136 2023-09-30T22:15:36.154 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 117/136 2023-09-30T22:15:36.476 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 118/136 2023-09-30T22:15:36.774 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 119/136 2023-09-30T22:15:36.964 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-09-30T22:15:37.023 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-09-30T22:15:37.247 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/136 2023-09-30T22:15:37.331 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/136 2023-09-30T22:15:37.522 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : bison-3.0.4-10.el8.x86_64 122/136 2023-09-30T22:15:37.535 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 122/136 2023-09-30T22:15:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 123/136 2023-09-30T22:15:37.891 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 124/136 2023-09-30T22:15:37.891 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-09-30T22:15:38.099 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-09-30T22:15:38.104 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-09-30T22:15:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-09-30T22:15:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/136 2023-09-30T22:15:38.470 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/136 2023-09-30T22:15:38.649 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 128/136 2023-09-30T22:15:38.820 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 129/136 2023-09-30T22:15:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 130/136 2023-09-30T22:15:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 131/136 2023-09-30T22:15:39.291 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 131/136 2023-09-30T22:15:39.291 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 132/136 2023-09-30T22:15:39.491 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 132/136 2023-09-30T22:15:39.491 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 133/136 2023-09-30T22:15:39.758 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 133/136 2023-09-30T22:15:39.758 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 134/136 2023-09-30T22:15:39.889 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 108/136 2023-09-30T22:15:39.965 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 134/136 2023-09-30T22:15:39.966 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-09-30T22:15:40.166 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-09-30T22:15:40.348 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-09-30T22:15:40.951 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-09-30T22:15:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 1/136 2023-09-30T22:15:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2/136 2023-09-30T22:15:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 3/136 2023-09-30T22:15:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 4/136 2023-09-30T22:15:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 5/136 2023-09-30T22:15:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 6/136 2023-09-30T22:15:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 7/136 2023-09-30T22:15:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-09-30T22:15:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-09-30T22:15:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-09-30T22:15:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-09-30T22:15:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 12/136 2023-09-30T22:15:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-09-30T22:15:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 14/136 2023-09-30T22:15:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 15/136 2023-09-30T22:15:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 16/136 2023-09-30T22:15:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 17/136 2023-09-30T22:15:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 18/136 2023-09-30T22:15:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 19/136 2023-09-30T22:15:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 20/136 2023-09-30T22:15:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 21/136 2023-09-30T22:15:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 22/136 2023-09-30T22:15:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 23/136 2023-09-30T22:15:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 24/136 2023-09-30T22:15:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 25/136 2023-09-30T22:15:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 26/136 2023-09-30T22:15:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 27/136 2023-09-30T22:15:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 28/136 2023-09-30T22:15:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 29/136 2023-09-30T22:15:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 30/136 2023-09-30T22:15:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 31/136 2023-09-30T22:15:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 32/136 2023-09-30T22:15:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : bison-3.0.4-10.el8.x86_64 33/136 2023-09-30T22:15:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flex-2.6.1-9.el8.x86_64 34/136 2023-09-30T22:15:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : jq-1.6-7.el8.x86_64 35/136 2023-09-30T22:15:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 36/136 2023-09-30T22:15:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 37/136 2023-09-30T22:15:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 38/136 2023-09-30T22:15:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 39/136 2023-09-30T22:15:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 40/136 2023-09-30T22:15:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 41/136 2023-09-30T22:15:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 42/136 2023-09-30T22:15:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 43/136 2023-09-30T22:15:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 44/136 2023-09-30T22:15:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 45/136 2023-09-30T22:15:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 46/136 2023-09-30T22:15:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 47/136 2023-09-30T22:15:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 48/136 2023-09-30T22:15:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 49/136 2023-09-30T22:15:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 50/136 2023-09-30T22:15:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 51/136 2023-09-30T22:15:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 52/136 2023-09-30T22:15:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 53/136 2023-09-30T22:15:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 54/136 2023-09-30T22:15:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 55/136 2023-09-30T22:15:40.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 56/136 2023-09-30T22:15:40.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 57/136 2023-09-30T22:15:40.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 58/136 2023-09-30T22:15:40.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 59/136 2023-09-30T22:15:40.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 60/136 2023-09-30T22:15:40.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 61/136 2023-09-30T22:15:40.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 62/136 2023-09-30T22:15:40.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 63/136 2023-09-30T22:15:40.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 64/136 2023-09-30T22:15:40.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 65/136 2023-09-30T22:15:40.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 66/136 2023-09-30T22:15:40.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 67/136 2023-09-30T22:15:40.958 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 68/136 2023-09-30T22:15:40.958 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 69/136 2023-09-30T22:15:40.958 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 70/136 2023-09-30T22:15:40.958 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 71/136 2023-09-30T22:15:40.958 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 72/136 2023-09-30T22:15:40.958 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 73/136 2023-09-30T22:15:40.958 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/136 2023-09-30T22:15:40.958 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/136 2023-09-30T22:15:40.958 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/136 2023-09-30T22:15:40.958 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/136 2023-09-30T22:15:40.958 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 78/136 2023-09-30T22:15:40.958 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 79/136 2023-09-30T22:15:40.959 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : leveldb-1.22-1.el8.x86_64 80/136 2023-09-30T22:15:40.959 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 81/136 2023-09-30T22:15:40.959 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 82/136 2023-09-30T22:15:40.959 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/136 2023-09-30T22:15:40.959 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/136 2023-09-30T22:15:40.959 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 85/136 2023-09-30T22:15:40.959 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 86/136 2023-09-30T22:15:40.959 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 87/136 2023-09-30T22:15:40.959 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 88/136 2023-09-30T22:15:40.959 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 89/136 2023-09-30T22:15:40.959 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 90/136 2023-09-30T22:15:40.959 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 91/136 2023-09-30T22:15:40.960 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 92/136 2023-09-30T22:15:40.960 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 93/136 2023-09-30T22:15:40.960 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 94/136 2023-09-30T22:15:40.960 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 95/136 2023-09-30T22:15:40.960 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-portend-2.6-1.el8.noarch 96/136 2023-09-30T22:15:40.960 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 97/136 2023-09-30T22:15:40.960 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 98/136 2023-09-30T22:15:40.960 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 99/136 2023-09-30T22:15:40.960 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 100/136 2023-09-30T22:15:40.960 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 101/136 2023-09-30T22:15:40.960 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 102/136 2023-09-30T22:15:40.961 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 103/136 2023-09-30T22:15:40.961 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 104/136 2023-09-30T22:15:40.961 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 105/136 2023-09-30T22:15:40.961 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 106/136 2023-09-30T22:15:40.961 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 107/136 2023-09-30T22:15:40.961 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 108/136 2023-09-30T22:15:40.961 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-09-30T22:15:40.961 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 110/136 2023-09-30T22:15:40.961 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-09-30T22:15:40.962 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 112/136 2023-09-30T22:15:40.962 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 113/136 2023-09-30T22:15:40.962 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 114/136 2023-09-30T22:15:40.962 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 115/136 2023-09-30T22:15:40.962 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 116/136 2023-09-30T22:15:40.962 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 117/136 2023-09-30T22:15:40.962 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 118/136 2023-09-30T22:15:40.962 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 119/136 2023-09-30T22:15:40.962 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 120/136 2023-09-30T22:15:40.962 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 121/136 2023-09-30T22:15:40.962 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 122/136 2023-09-30T22:15:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 123/136 2023-09-30T22:15:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 124/136 2023-09-30T22:15:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 125/136 2023-09-30T22:15:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 126/136 2023-09-30T22:15:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 127/136 2023-09-30T22:15:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 128/136 2023-09-30T22:15:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 129/136 2023-09-30T22:15:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 130/136 2023-09-30T22:15:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 131/136 2023-09-30T22:15:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 132/136 2023-09-30T22:15:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 133/136 2023-09-30T22:15:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 134/136 2023-09-30T22:15:40.963 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 135/136 2023-09-30T22:15:41.142 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-09-30T22:15:41.399 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-09-30T22:15:41.804 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-09-30T22:15:41.973 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-09-30T22:15:42.067 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-09-30T22:15:42.904 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 112/136 2023-09-30T22:15:42.982 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 136/136 2023-09-30T22:15:42.982 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:42.983 INFO:teuthology.orchestra.run.smithi194.stdout:Upgraded: 2023-09-30T22:15:42.983 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-09-30T22:15:42.983 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-09-30T22:15:42.983 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-09-30T22:15:42.983 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-09-30T22:15:42.983 INFO:teuthology.orchestra.run.smithi194.stdout: iproute-6.2.0-2.el8.x86_64 2023-09-30T22:15:42.983 INFO:teuthology.orchestra.run.smithi194.stdout: libblkid-2.32.1-43.el8.x86_64 2023-09-30T22:15:42.983 INFO:teuthology.orchestra.run.smithi194.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-09-30T22:15:42.983 INFO:teuthology.orchestra.run.smithi194.stdout: libmount-2.32.1-43.el8.x86_64 2023-09-30T22:15:42.983 INFO:teuthology.orchestra.run.smithi194.stdout: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:42.983 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:42.984 INFO:teuthology.orchestra.run.smithi194.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-09-30T22:15:42.984 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid-2.32.1-43.el8.x86_64 2023-09-30T22:15:42.984 INFO:teuthology.orchestra.run.smithi194.stdout: util-linux-2.32.1-43.el8.x86_64 2023-09-30T22:15:42.984 INFO:teuthology.orchestra.run.smithi194.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-09-30T22:15:42.984 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2023-09-30T22:15:42.984 INFO:teuthology.orchestra.run.smithi194.stdout: bison-3.0.4-10.el8.x86_64 2023-09-30T22:15:42.984 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:42.984 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:42.984 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:42.984 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:42.984 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:15:42.984 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:42.985 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:42.985 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:15:42.985 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:15:42.985 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:15:42.985 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:15:42.985 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:42.985 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:42.985 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:15:42.985 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:42.985 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:42.985 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:42.985 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-09-30T22:15:42.986 INFO:teuthology.orchestra.run.smithi194.stdout: flex-2.6.1-9.el8.x86_64 2023-09-30T22:15:42.986 INFO:teuthology.orchestra.run.smithi194.stdout: fuse-2.9.7-17.el8.x86_64 2023-09-30T22:15:42.986 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-30T22:15:42.986 INFO:teuthology.orchestra.run.smithi194.stdout: jq-1.6-7.el8.x86_64 2023-09-30T22:15:42.986 INFO:teuthology.orchestra.run.smithi194.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-30T22:15:42.986 INFO:teuthology.orchestra.run.smithi194.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-09-30T22:15:42.986 INFO:teuthology.orchestra.run.smithi194.stdout: leveldb-1.22-1.el8.x86_64 2023-09-30T22:15:42.986 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:42.986 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:42.986 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:42.987 INFO:teuthology.orchestra.run.smithi194.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-09-30T22:15:42.987 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-09-30T22:15:42.987 INFO:teuthology.orchestra.run.smithi194.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-30T22:15:42.987 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-09-30T22:15:42.987 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-09-30T22:15:42.987 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:42.987 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:42.987 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-30T22:15:42.987 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:42.987 INFO:teuthology.orchestra.run.smithi194.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-09-30T22:15:42.988 INFO:teuthology.orchestra.run.smithi194.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-30T22:15:42.988 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-30T22:15:42.988 INFO:teuthology.orchestra.run.smithi194.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-09-30T22:15:42.988 INFO:teuthology.orchestra.run.smithi194.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-09-30T22:15:42.988 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-30T22:15:42.988 INFO:teuthology.orchestra.run.smithi194.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-30T22:15:42.988 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-0.3.15-4.el8.x86_64 2023-09-30T22:15:42.988 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-09-30T22:15:42.988 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-09-30T22:15:42.988 INFO:teuthology.orchestra.run.smithi194.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-09-30T22:15:42.988 INFO:teuthology.orchestra.run.smithi194.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-09-30T22:15:42.988 INFO:teuthology.orchestra.run.smithi194.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-09-30T22:15:42.989 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-30T22:15:42.989 INFO:teuthology.orchestra.run.smithi194.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-30T22:15:42.989 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-30T22:15:42.989 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:42.989 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:42.989 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:42.989 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-30T22:15:42.989 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-09-30T22:15:42.989 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-30T22:15:42.990 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-30T22:15:42.990 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-09-30T22:15:42.990 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-30T22:15:42.990 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-30T22:15:42.990 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-30T22:15:42.990 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-30T22:15:42.990 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-30T22:15:42.990 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-30T22:15:42.990 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-30T22:15:42.990 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-30T22:15:42.990 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako-1.0.6-14.el8.noarch 2023-09-30T22:15:42.990 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-30T22:15:42.991 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-30T22:15:42.991 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-30T22:15:42.991 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-30T22:15:42.991 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-30T22:15:42.991 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-30T22:15:42.991 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend-2.6-1.el8.noarch 2023-09-30T22:15:42.991 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-30T22:15:42.991 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-30T22:15:42.991 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-30T22:15:42.991 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-30T22:15:42.991 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-30T22:15:42.991 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz-2017.2-11.el8.noarch 2023-09-30T22:15:42.992 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:42.992 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:42.992 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-30T22:15:42.992 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-30T22:15:42.992 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:42.992 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-30T22:15:42.992 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-30T22:15:42.992 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-09-30T22:15:42.992 INFO:teuthology.orchestra.run.smithi194.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-30T22:15:42.992 INFO:teuthology.orchestra.run.smithi194.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-30T22:15:42.992 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-30T22:15:42.992 INFO:teuthology.orchestra.run.smithi194.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-30T22:15:42.993 INFO:teuthology.orchestra.run.smithi194.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-30T22:15:42.993 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-30T22:15:42.993 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-30T22:15:42.993 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-30T22:15:42.993 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-30T22:15:42.993 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-30T22:15:42.993 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:42.993 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:42.993 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:42.993 INFO:teuthology.orchestra.run.smithi194.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-30T22:15:42.993 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-30T22:15:42.994 INFO:teuthology.orchestra.run.smithi194.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-09-30T22:15:42.994 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:42.994 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2023-09-30T22:15:43.219 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 113/136 2023-09-30T22:15:43.254 DEBUG:teuthology.parallel:result is None 2023-09-30T22:15:43.434 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 114/136 2023-09-30T22:15:43.627 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 115/136 2023-09-30T22:15:43.786 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 116/136 2023-09-30T22:15:43.997 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 117/136 2023-09-30T22:15:44.296 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 118/136 2023-09-30T22:15:44.600 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 119/136 2023-09-30T22:15:44.795 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-09-30T22:15:44.854 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-09-30T22:15:45.089 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/136 2023-09-30T22:15:45.195 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/136 2023-09-30T22:15:45.403 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : bison-3.0.4-10.el8.x86_64 122/136 2023-09-30T22:15:45.417 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 122/136 2023-09-30T22:15:45.624 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 123/136 2023-09-30T22:15:45.800 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 124/136 2023-09-30T22:15:45.801 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-09-30T22:15:46.083 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-09-30T22:15:46.089 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-09-30T22:15:46.193 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-09-30T22:15:46.193 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/136 2023-09-30T22:15:46.446 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/136 2023-09-30T22:15:46.622 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 128/136 2023-09-30T22:15:46.812 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 129/136 2023-09-30T22:15:47.072 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 130/136 2023-09-30T22:15:47.072 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 131/136 2023-09-30T22:15:47.283 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 131/136 2023-09-30T22:15:47.283 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 132/136 2023-09-30T22:15:47.500 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 132/136 2023-09-30T22:15:47.500 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 133/136 2023-09-30T22:15:47.725 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 133/136 2023-09-30T22:15:47.725 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 134/136 2023-09-30T22:15:47.975 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 134/136 2023-09-30T22:15:47.975 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-09-30T22:15:48.155 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-09-30T22:15:48.379 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-09-30T22:15:48.963 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-09-30T22:15:48.963 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 1/136 2023-09-30T22:15:48.963 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2/136 2023-09-30T22:15:48.963 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 3/136 2023-09-30T22:15:48.963 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 4/136 2023-09-30T22:15:48.963 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 5/136 2023-09-30T22:15:48.964 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 6/136 2023-09-30T22:15:48.964 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 7/136 2023-09-30T22:15:48.964 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-09-30T22:15:48.964 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-09-30T22:15:48.964 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-09-30T22:15:48.964 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-09-30T22:15:48.964 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 12/136 2023-09-30T22:15:48.964 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-09-30T22:15:48.964 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 14/136 2023-09-30T22:15:48.964 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 15/136 2023-09-30T22:15:48.964 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 16/136 2023-09-30T22:15:48.964 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 17/136 2023-09-30T22:15:48.965 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 18/136 2023-09-30T22:15:48.965 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 19/136 2023-09-30T22:15:48.965 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 20/136 2023-09-30T22:15:48.965 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 21/136 2023-09-30T22:15:48.965 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 22/136 2023-09-30T22:15:48.965 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 23/136 2023-09-30T22:15:48.965 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 24/136 2023-09-30T22:15:48.965 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 25/136 2023-09-30T22:15:48.965 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 26/136 2023-09-30T22:15:48.965 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 27/136 2023-09-30T22:15:48.974 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 28/136 2023-09-30T22:15:48.974 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 29/136 2023-09-30T22:15:48.975 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 30/136 2023-09-30T22:15:48.975 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 31/136 2023-09-30T22:15:48.975 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 32/136 2023-09-30T22:15:48.975 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : bison-3.0.4-10.el8.x86_64 33/136 2023-09-30T22:15:48.975 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flex-2.6.1-9.el8.x86_64 34/136 2023-09-30T22:15:48.975 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : jq-1.6-7.el8.x86_64 35/136 2023-09-30T22:15:48.975 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 36/136 2023-09-30T22:15:48.975 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 37/136 2023-09-30T22:15:48.975 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 38/136 2023-09-30T22:15:48.975 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 39/136 2023-09-30T22:15:48.975 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 40/136 2023-09-30T22:15:48.975 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 41/136 2023-09-30T22:15:48.976 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 42/136 2023-09-30T22:15:48.976 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 43/136 2023-09-30T22:15:48.976 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 44/136 2023-09-30T22:15:48.976 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 45/136 2023-09-30T22:15:48.976 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 46/136 2023-09-30T22:15:48.976 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 47/136 2023-09-30T22:15:48.976 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 48/136 2023-09-30T22:15:48.976 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 49/136 2023-09-30T22:15:48.976 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 50/136 2023-09-30T22:15:48.976 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 51/136 2023-09-30T22:15:48.976 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 52/136 2023-09-30T22:15:48.977 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 53/136 2023-09-30T22:15:48.977 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 54/136 2023-09-30T22:15:48.977 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 55/136 2023-09-30T22:15:48.977 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 56/136 2023-09-30T22:15:48.977 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 57/136 2023-09-30T22:15:48.977 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 58/136 2023-09-30T22:15:48.977 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 59/136 2023-09-30T22:15:48.977 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 60/136 2023-09-30T22:15:48.977 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 61/136 2023-09-30T22:15:48.977 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 62/136 2023-09-30T22:15:48.977 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 63/136 2023-09-30T22:15:48.978 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 64/136 2023-09-30T22:15:48.978 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 65/136 2023-09-30T22:15:48.978 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 66/136 2023-09-30T22:15:48.978 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 67/136 2023-09-30T22:15:48.978 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 68/136 2023-09-30T22:15:48.978 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 69/136 2023-09-30T22:15:48.978 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 70/136 2023-09-30T22:15:48.978 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 71/136 2023-09-30T22:15:48.978 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 72/136 2023-09-30T22:15:48.978 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 73/136 2023-09-30T22:15:48.978 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/136 2023-09-30T22:15:48.978 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/136 2023-09-30T22:15:48.978 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/136 2023-09-30T22:15:48.979 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/136 2023-09-30T22:15:48.979 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 78/136 2023-09-30T22:15:48.979 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 79/136 2023-09-30T22:15:48.979 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : leveldb-1.22-1.el8.x86_64 80/136 2023-09-30T22:15:48.979 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 81/136 2023-09-30T22:15:48.979 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 82/136 2023-09-30T22:15:48.979 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/136 2023-09-30T22:15:48.979 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/136 2023-09-30T22:15:48.979 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 85/136 2023-09-30T22:15:48.979 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 86/136 2023-09-30T22:15:48.979 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 87/136 2023-09-30T22:15:48.979 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 88/136 2023-09-30T22:15:48.980 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 89/136 2023-09-30T22:15:48.980 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 90/136 2023-09-30T22:15:48.980 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 91/136 2023-09-30T22:15:48.980 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 92/136 2023-09-30T22:15:48.980 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 93/136 2023-09-30T22:15:48.980 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 94/136 2023-09-30T22:15:48.980 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 95/136 2023-09-30T22:15:48.980 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-portend-2.6-1.el8.noarch 96/136 2023-09-30T22:15:48.980 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 97/136 2023-09-30T22:15:48.980 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 98/136 2023-09-30T22:15:48.980 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 99/136 2023-09-30T22:15:48.980 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 100/136 2023-09-30T22:15:48.980 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 101/136 2023-09-30T22:15:48.981 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 102/136 2023-09-30T22:15:48.981 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 103/136 2023-09-30T22:15:48.981 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 104/136 2023-09-30T22:15:48.981 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 105/136 2023-09-30T22:15:48.981 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 106/136 2023-09-30T22:15:48.981 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 107/136 2023-09-30T22:15:48.981 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 108/136 2023-09-30T22:15:48.981 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-09-30T22:15:48.981 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 110/136 2023-09-30T22:15:48.981 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-09-30T22:15:48.981 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 112/136 2023-09-30T22:15:48.981 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 113/136 2023-09-30T22:15:48.982 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 114/136 2023-09-30T22:15:48.982 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 115/136 2023-09-30T22:15:48.982 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 116/136 2023-09-30T22:15:48.982 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 117/136 2023-09-30T22:15:48.982 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 118/136 2023-09-30T22:15:48.982 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 119/136 2023-09-30T22:15:48.982 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 120/136 2023-09-30T22:15:48.982 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 121/136 2023-09-30T22:15:48.982 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 122/136 2023-09-30T22:15:48.982 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 123/136 2023-09-30T22:15:48.982 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 124/136 2023-09-30T22:15:48.982 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 125/136 2023-09-30T22:15:48.983 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 126/136 2023-09-30T22:15:48.983 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 127/136 2023-09-30T22:15:48.983 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 128/136 2023-09-30T22:15:48.983 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 129/136 2023-09-30T22:15:48.983 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 130/136 2023-09-30T22:15:48.983 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 131/136 2023-09-30T22:15:48.983 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 132/136 2023-09-30T22:15:48.983 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 133/136 2023-09-30T22:15:48.983 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 134/136 2023-09-30T22:15:48.983 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 135/136 2023-09-30T22:15:50.975 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 136/136 2023-09-30T22:15:50.975 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:50.975 INFO:teuthology.orchestra.run.smithi156.stdout:Upgraded: 2023-09-30T22:15:50.975 INFO:teuthology.orchestra.run.smithi156.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-09-30T22:15:50.975 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-09-30T22:15:50.975 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-09-30T22:15:50.975 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-09-30T22:15:50.975 INFO:teuthology.orchestra.run.smithi156.stdout: iproute-6.2.0-2.el8.x86_64 2023-09-30T22:15:50.975 INFO:teuthology.orchestra.run.smithi156.stdout: libblkid-2.32.1-43.el8.x86_64 2023-09-30T22:15:50.976 INFO:teuthology.orchestra.run.smithi156.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-09-30T22:15:50.976 INFO:teuthology.orchestra.run.smithi156.stdout: libmount-2.32.1-43.el8.x86_64 2023-09-30T22:15:50.976 INFO:teuthology.orchestra.run.smithi156.stdout: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:50.976 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:50.976 INFO:teuthology.orchestra.run.smithi156.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-09-30T22:15:50.976 INFO:teuthology.orchestra.run.smithi156.stdout: libuuid-2.32.1-43.el8.x86_64 2023-09-30T22:15:50.976 INFO:teuthology.orchestra.run.smithi156.stdout: util-linux-2.32.1-43.el8.x86_64 2023-09-30T22:15:50.976 INFO:teuthology.orchestra.run.smithi156.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-09-30T22:15:50.976 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-09-30T22:15:50.976 INFO:teuthology.orchestra.run.smithi156.stdout: bison-3.0.4-10.el8.x86_64 2023-09-30T22:15:50.976 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:50.977 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:50.977 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:50.977 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:50.977 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:15:50.977 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:50.977 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:50.977 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:15:50.977 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:15:50.977 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:15:50.977 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:15:50.977 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:50.978 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:50.978 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:15:50.978 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:50.978 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:50.978 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:50.978 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-09-30T22:15:50.978 INFO:teuthology.orchestra.run.smithi156.stdout: flex-2.6.1-9.el8.x86_64 2023-09-30T22:15:50.978 INFO:teuthology.orchestra.run.smithi156.stdout: fuse-2.9.7-17.el8.x86_64 2023-09-30T22:15:50.978 INFO:teuthology.orchestra.run.smithi156.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-30T22:15:50.978 INFO:teuthology.orchestra.run.smithi156.stdout: jq-1.6-7.el8.x86_64 2023-09-30T22:15:50.978 INFO:teuthology.orchestra.run.smithi156.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-30T22:15:50.979 INFO:teuthology.orchestra.run.smithi156.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-09-30T22:15:50.979 INFO:teuthology.orchestra.run.smithi156.stdout: leveldb-1.22-1.el8.x86_64 2023-09-30T22:15:50.979 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:50.979 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:50.979 INFO:teuthology.orchestra.run.smithi156.stdout: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:50.979 INFO:teuthology.orchestra.run.smithi156.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-09-30T22:15:50.979 INFO:teuthology.orchestra.run.smithi156.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-09-30T22:15:50.979 INFO:teuthology.orchestra.run.smithi156.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-30T22:15:50.979 INFO:teuthology.orchestra.run.smithi156.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-09-30T22:15:50.979 INFO:teuthology.orchestra.run.smithi156.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-09-30T22:15:50.979 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:50.980 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:50.980 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-30T22:15:50.980 INFO:teuthology.orchestra.run.smithi156.stdout: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:50.980 INFO:teuthology.orchestra.run.smithi156.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-09-30T22:15:50.980 INFO:teuthology.orchestra.run.smithi156.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-30T22:15:50.980 INFO:teuthology.orchestra.run.smithi156.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-30T22:15:50.980 INFO:teuthology.orchestra.run.smithi156.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-09-30T22:15:50.980 INFO:teuthology.orchestra.run.smithi156.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-09-30T22:15:50.980 INFO:teuthology.orchestra.run.smithi156.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-30T22:15:50.980 INFO:teuthology.orchestra.run.smithi156.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-30T22:15:50.980 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-0.3.15-4.el8.x86_64 2023-09-30T22:15:50.980 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-09-30T22:15:50.981 INFO:teuthology.orchestra.run.smithi156.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-09-30T22:15:50.981 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-09-30T22:15:50.981 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-09-30T22:15:50.981 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-09-30T22:15:50.981 INFO:teuthology.orchestra.run.smithi156.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-30T22:15:50.981 INFO:teuthology.orchestra.run.smithi156.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-30T22:15:50.981 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-30T22:15:50.981 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:50.981 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:50.981 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:50.981 INFO:teuthology.orchestra.run.smithi156.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-30T22:15:50.981 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-09-30T22:15:50.982 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-30T22:15:50.982 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-30T22:15:50.982 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-09-30T22:15:50.982 INFO:teuthology.orchestra.run.smithi156.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-30T22:15:50.982 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-30T22:15:50.982 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-30T22:15:50.982 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-30T22:15:50.982 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-30T22:15:50.982 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-30T22:15:50.982 INFO:teuthology.orchestra.run.smithi156.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-30T22:15:50.982 INFO:teuthology.orchestra.run.smithi156.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-30T22:15:50.982 INFO:teuthology.orchestra.run.smithi156.stdout: python3-mako-1.0.6-14.el8.noarch 2023-09-30T22:15:50.983 INFO:teuthology.orchestra.run.smithi156.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-30T22:15:50.983 INFO:teuthology.orchestra.run.smithi156.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-30T22:15:50.983 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-30T22:15:50.983 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-30T22:15:50.983 INFO:teuthology.orchestra.run.smithi156.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-30T22:15:50.983 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-30T22:15:50.983 INFO:teuthology.orchestra.run.smithi156.stdout: python3-portend-2.6-1.el8.noarch 2023-09-30T22:15:50.983 INFO:teuthology.orchestra.run.smithi156.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-30T22:15:50.983 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-30T22:15:50.983 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-30T22:15:50.983 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-30T22:15:50.983 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-30T22:15:50.983 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytz-2017.2-11.el8.noarch 2023-09-30T22:15:50.984 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:50.984 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:50.984 INFO:teuthology.orchestra.run.smithi156.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-30T22:15:50.984 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-30T22:15:50.984 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:50.984 INFO:teuthology.orchestra.run.smithi156.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-30T22:15:50.984 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-30T22:15:50.984 INFO:teuthology.orchestra.run.smithi156.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-09-30T22:15:50.984 INFO:teuthology.orchestra.run.smithi156.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-30T22:15:50.984 INFO:teuthology.orchestra.run.smithi156.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-30T22:15:50.984 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-30T22:15:50.985 INFO:teuthology.orchestra.run.smithi156.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-30T22:15:50.985 INFO:teuthology.orchestra.run.smithi156.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-30T22:15:50.985 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-30T22:15:50.985 INFO:teuthology.orchestra.run.smithi156.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-30T22:15:50.985 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-30T22:15:50.985 INFO:teuthology.orchestra.run.smithi156.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-30T22:15:50.985 INFO:teuthology.orchestra.run.smithi156.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-30T22:15:50.985 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:50.985 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:50.985 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:15:50.985 INFO:teuthology.orchestra.run.smithi156.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-30T22:15:50.985 INFO:teuthology.orchestra.run.smithi156.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-30T22:15:50.986 INFO:teuthology.orchestra.run.smithi156.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-09-30T22:15:50.986 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:50.986 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-09-30T22:15:51.167 DEBUG:teuthology.parallel:result is None 2023-09-30T22:15:51.167 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:15:51.167 INFO:teuthology.packaging:ref: None 2023-09-30T22:15:51.167 INFO:teuthology.packaging:tag: None 2023-09-30T22:15:51.167 INFO:teuthology.packaging:branch: pacific 2023-09-30T22:15:51.167 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-09-30T22:15:51.168 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-09-30T22:15:51.505 DEBUG:teuthology.orchestra.run.smithi156:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-30T22:15:51.533 INFO:teuthology.orchestra.run.smithi156.stdout:16.2.14-44.geeb13ac9.el8 2023-09-30T22:15:51.533 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-44.geeb13ac9.el8 2023-09-30T22:15:51.533 INFO:teuthology.task.install:The correct ceph version 16.2.14-44.geeb13ac9 is installed. 2023-09-30T22:15:51.534 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:15:51.534 INFO:teuthology.packaging:ref: None 2023-09-30T22:15:51.534 INFO:teuthology.packaging:tag: None 2023-09-30T22:15:51.534 INFO:teuthology.packaging:branch: pacific 2023-09-30T22:15:51.534 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-09-30T22:15:51.534 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-09-30T22:15:51.874 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-30T22:15:51.907 INFO:teuthology.orchestra.run.smithi194.stdout:16.2.14-44.geeb13ac9.el8 2023-09-30T22:15:51.910 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-44.geeb13ac9.el8 2023-09-30T22:15:51.910 INFO:teuthology.task.install:The correct ceph version 16.2.14-44.geeb13ac9 is installed. 2023-09-30T22:15:51.911 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-09-30T22:15:51.911 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-30T22:15:51.912 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-30T22:15:51.946 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-09-30T22:15:51.947 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-30T22:15:51.986 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-09-30T22:15:51.986 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-30T22:15:51.986 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/daemon-helper 2023-09-30T22:15:52.019 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-30T22:15:52.087 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-09-30T22:15:52.087 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/daemon-helper 2023-09-30T22:15:52.118 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-30T22:15:52.188 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-09-30T22:15:52.188 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-30T22:15:52.188 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-30T22:15:52.216 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-30T22:15:52.285 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-09-30T22:15:52.285 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-30T22:15:52.314 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-30T22:15:52.382 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-09-30T22:15:52.383 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-30T22:15:52.383 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/stdin-killer 2023-09-30T22:15:52.411 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-30T22:15:52.478 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-09-30T22:15:52.478 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/stdin-killer 2023-09-30T22:15:52.507 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-30T22:15:52.576 INFO:teuthology.run_tasks:Running task print... 2023-09-30T22:15:52.584 INFO:teuthology.task.print:**** done installing pacific 2023-09-30T22:15:52.584 INFO:teuthology.run_tasks:Running task ceph... 2023-09-30T22:15:52.645 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-09-30T22:15:52.645 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 777 /var/log/ceph 2023-09-30T22:15:52.648 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 777 /var/log/ceph 2023-09-30T22:15:52.675 INFO:tasks.ceph:Disabling ceph logrotate... 2023-09-30T22:15:52.676 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-30T22:15:52.714 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-30T22:15:52.743 INFO:tasks.ceph:Creating extra log directories... 2023-09-30T22:15:52.743 DEBUG:teuthology.orchestra.run.smithi156:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-30T22:15:52.786 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-30T22:15:52.823 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-09-30T22:15:52.823 INFO:tasks.ceph:config {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-09-30T22:15:52.823 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408038', 'branch': 'fix-nfs-apply-err-reporting', 'description': 'fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/dbench}}}', 'email': None, 'first_in_suite': False, 'job_id': '7408038', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'fix-nfs-apply-err-reporting'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-62953', 'sha1': '6973b24e3d99fd494b753449d2ea12077599cbd6'}}, 'owner': 'scheduled_dparmar@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['client.0']], 'seed': 2683, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'sleep_before_teardown': 0, 'suite': 'fs:upgrade', 'suite_branch': 'wip-62953', 'suite_path': '/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/dparmar18/ceph', 'suite_sha1': '6973b24e3d99fd494b753449d2ea12077599cbd6', 'targets': {'smithi156.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKu1vwmDNztN6iyHkLdMoF4JU3fFqSvEbgNut54CiIbYLIGEkyLnfI6Q6M1CRI9Zy3xuhuBCzEm5Vvf0KJCtdhg=', 'smithi194.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMmJLqcddXk/AaOZYQx7nzY46fZFwoxkcZ/WDHE/6qEHmlhvokKuJs5Iu1YxoZNW2xMZJGUjh5pXEYZwHN8RZxs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'pacific', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}}, {'print': '**** done installing pacific'}, {'ceph': {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'log-ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'flavor': 'default', 'fs': 'xfs', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'cluster': 'ceph'}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client pacific']}}, {'print': '**** done ceph'}, {'ceph-fuse': None}, {'mds_pre_upgrade': None}, {'print': '**** done mds pre-upgrade sequence'}, {'install.upgrade': {'mon.a': {'branch': 'reef'}}}, {'print': '**** done install.upgrade the host'}, {'ceph.restart': {'daemons': ['mon.*', 'mgr.*'], 'mon-health-to-clog': False, 'wait-for-healthy': False}}, {'ceph.healthy': None}, {'ceph.restart': {'daemons': ['osd.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'ceph.stop': ['mds.*']}, {'ceph.restart': {'daemons': ['mds.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'exec': {'mon.a': ['ceph osd dump -f json-pretty', 'ceph versions', 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done', 'ceph osd require-osd-release reef']}}, {'ceph.healthy': None}, {'print': '**** done ceph.restart'}, {'ceph-fuse': {'client.0': {'mounted': False}}}, {'print': '**** done unmount client.0'}, {'install.upgrade': {'client.0': None}}, {'print': '**** done install.upgrade on client.0'}, {'ceph-fuse': {'client.0': None}}, {'print': '**** done remount client.0'}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'branch': 'pacific', 'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end", 'if not is_fuse() then reject() end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-09-30_21:53:45', 'tube': 'smithi', 'user': 'dparmar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-09-30T22:15:52.824 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-30T22:15:52.849 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-30T22:15:52.872 DEBUG:teuthology.orchestra.run.smithi156:> sudo install -d -m0777 -- /var/run/ceph 2023-09-30T22:15:52.908 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/run/ceph 2023-09-30T22:15:52.941 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-30T22:15:52.941 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/scratch_devs of=/dev/stdout 2023-09-30T22:15:52.991 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-30T22:15:52.991 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_1 2023-09-30T22:15:53.049 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-30T22:15:53.049 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T22:15:53.049 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 391062 Links: 1 2023-09-30T22:15:53.049 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T22:15:53.049 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T22:15:53.049 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-09-30 22:15:48.608188470 +0000 2023-09-30T22:15:53.049 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-09-30 22:12:56.608444067 +0000 2023-09-30T22:15:53.050 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-09-30 22:12:56.608444067 +0000 2023-09-30T22:15:53.050 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2023-09-30T22:15:53.050 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-30T22:15:53.115 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-09-30T22:15:53.115 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-09-30T22:15:53.115 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 8.1133e-05 s, 6.3 MB/s 2023-09-30T22:15:53.116 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-30T22:15:53.175 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_2 2023-09-30T22:15:53.233 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-30T22:15:53.234 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T22:15:53.234 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 392791 Links: 1 2023-09-30T22:15:53.234 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T22:15:53.234 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T22:15:53.234 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-09-30 22:15:48.608188470 +0000 2023-09-30T22:15:53.234 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-09-30 22:12:57.113436913 +0000 2023-09-30T22:15:53.234 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-09-30 22:12:57.113436913 +0000 2023-09-30T22:15:53.234 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2023-09-30T22:15:53.235 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-30T22:15:53.298 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-09-30T22:15:53.299 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-09-30T22:15:53.299 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000103439 s, 4.9 MB/s 2023-09-30T22:15:53.300 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-30T22:15:53.359 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_3 2023-09-30T22:15:53.417 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-30T22:15:53.418 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T22:15:53.418 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 385930 Links: 1 2023-09-30T22:15:53.418 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T22:15:53.418 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T22:15:53.418 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-09-30 22:15:48.608188470 +0000 2023-09-30T22:15:53.418 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-09-30 22:12:57.606429929 +0000 2023-09-30T22:15:53.418 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-09-30 22:12:57.606429929 +0000 2023-09-30T22:15:53.418 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2023-09-30T22:15:53.418 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-30T22:15:53.486 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-09-30T22:15:53.486 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-09-30T22:15:53.487 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 9.3957e-05 s, 5.4 MB/s 2023-09-30T22:15:53.488 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-30T22:15:53.548 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_4 2023-09-30T22:15:53.606 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-30T22:15:53.606 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T22:15:53.606 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 396374 Links: 1 2023-09-30T22:15:53.607 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T22:15:53.607 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T22:15:53.607 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-09-30 22:15:48.609188456 +0000 2023-09-30T22:15:53.607 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-09-30 22:12:58.107422831 +0000 2023-09-30T22:15:53.607 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-09-30 22:12:58.107422831 +0000 2023-09-30T22:15:53.607 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2023-09-30T22:15:53.607 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-30T22:15:53.672 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-09-30T22:15:53.672 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-09-30T22:15:53.672 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000100277 s, 5.1 MB/s 2023-09-30T22:15:53.673 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-30T22:15:53.732 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T22:15:53.732 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi156.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2023-09-30T22:15:53.732 INFO:tasks.ceph:Generating config... 2023-09-30T22:15:53.733 INFO:tasks.ceph:[global] mon warn on pool no app = False 2023-09-30T22:15:53.733 INFO:tasks.ceph:[global] ms bind msgr2 = False 2023-09-30T22:15:53.733 INFO:tasks.ceph:[global] bluestore warn on legacy statfs = False 2023-09-30T22:15:53.733 INFO:tasks.ceph:[global] bluestore warn on no per pool omap = False 2023-09-30T22:15:53.733 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2023-09-30T22:15:53.734 INFO:tasks.ceph:[client] client mount timeout = 600 2023-09-30T22:15:53.734 INFO:tasks.ceph:[client] debug client = 20 2023-09-30T22:15:53.734 INFO:tasks.ceph:[client] debug ms = 1 2023-09-30T22:15:53.734 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-09-30T22:15:53.734 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-09-30T22:15:53.734 INFO:tasks.ceph:[mds] debug mds = 20 2023-09-30T22:15:53.734 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-09-30T22:15:53.734 INFO:tasks.ceph:[mds] debug ms = 1 2023-09-30T22:15:53.734 INFO:tasks.ceph:[mds] mds debug frag = True 2023-09-30T22:15:53.734 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-09-30T22:15:53.735 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-09-30T22:15:53.735 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-09-30T22:15:53.735 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-09-30T22:15:53.735 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-09-30T22:15:53.735 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-09-30T22:15:53.735 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-09-30T22:15:53.735 INFO:tasks.ceph:[mgr] debug ms = 1 2023-09-30T22:15:53.735 INFO:tasks.ceph:[mon] debug mon = 20 2023-09-30T22:15:53.735 INFO:tasks.ceph:[mon] debug ms = 1 2023-09-30T22:15:53.735 INFO:tasks.ceph:[mon] debug paxos = 20 2023-09-30T22:15:53.735 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-09-30T22:15:53.736 INFO:tasks.ceph:[mon] mon warn on osd down out interval zero = False 2023-09-30T22:15:53.736 INFO:tasks.ceph:[osd] bdev async discard = True 2023-09-30T22:15:53.736 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-09-30T22:15:53.736 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-09-30T22:15:53.736 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-09-30T22:15:53.736 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-09-30T22:15:53.736 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-09-30T22:15:53.736 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-09-30T22:15:53.736 INFO:tasks.ceph:[osd] debug ms = 1 2023-09-30T22:15:53.736 INFO:tasks.ceph:[osd] debug osd = 20 2023-09-30T22:15:53.736 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-09-30T22:15:53.736 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-09-30T22:15:53.737 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-09-30T22:15:53.737 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-09-30T22:15:53.737 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-09-30T22:15:53.737 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-09-30T22:15:53.737 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-09-30T22:15:53.737 INFO:tasks.ceph:Setting up mon.a... 2023-09-30T22:15:53.737 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-09-30T22:15:53.875 INFO:teuthology.orchestra.run.smithi156.stdout:creating /etc/ceph/ceph.keyring 2023-09-30T22:15:53.877 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-09-30T22:15:53.918 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T22:15:53.985 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.156'), ('mon.b', '[v2:172.21.15.156:3301,v1:172.21.15.156:6790]'), ('mon.c', '[v2:172.21.15.156:3302,v1:172.21.15.156:6791]')] 2023-09-30T22:15:53.986 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.156,[v2:172.21.15.156:3301,v1:172.21.15.156:6790],[v2:172.21.15.156:3302,v1:172.21.15.156:6791]', 'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-09-30T22:15:53.987 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-30T22:15:53.987 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-09-30T22:15:54.043 DEBUG:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.156 --addv b '[v2:172.21.15.156:3301,v1:172.21.15.156:6790]' --addv c '[v2:172.21.15.156:3302,v1:172.21.15.156:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:15:54.127 INFO:teuthology.orchestra.run.smithi156.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:15:54.127 INFO:teuthology.orchestra.run.smithi156.stdout:monmaptool: generated fsid bf403786-ca20-4e4a-92c0-a0a997d43bba 2023-09-30T22:15:54.127 INFO:teuthology.orchestra.run.smithi156.stdout:epoch 0 2023-09-30T22:15:54.128 INFO:teuthology.orchestra.run.smithi156.stdout:fsid bf403786-ca20-4e4a-92c0-a0a997d43bba 2023-09-30T22:15:54.128 INFO:teuthology.orchestra.run.smithi156.stdout:last_changed 2023-09-30T22:15:54.128188+0000 2023-09-30T22:15:54.128 INFO:teuthology.orchestra.run.smithi156.stdout:created 2023-09-30T22:15:54.128188+0000 2023-09-30T22:15:54.128 INFO:teuthology.orchestra.run.smithi156.stdout:min_mon_release 0 (unknown) 2023-09-30T22:15:54.128 INFO:teuthology.orchestra.run.smithi156.stdout:election_strategy: 1 2023-09-30T22:15:54.129 INFO:teuthology.orchestra.run.smithi156.stdout:0: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.a 2023-09-30T22:15:54.129 INFO:teuthology.orchestra.run.smithi156.stdout:1: [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] mon.b 2023-09-30T22:15:54.129 INFO:teuthology.orchestra.run.smithi156.stdout:2: [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] mon.c 2023-09-30T22:15:54.129 INFO:teuthology.orchestra.run.smithi156.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-09-30T22:15:54.131 DEBUG:teuthology.orchestra.run.smithi156:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-09-30T22:15:54.188 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID bf403786-ca20-4e4a-92c0-a0a997d43bba... 2023-09-30T22:15:54.190 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-30T22:15:54.230 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-30T22:15:54.274 INFO:teuthology.orchestra.run.smithi156.stdout:[global] 2023-09-30T22:15:54.274 INFO:teuthology.orchestra.run.smithi156.stdout: chdir = "" 2023-09-30T22:15:54.274 INFO:teuthology.orchestra.run.smithi156.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-30T22:15:54.274 INFO:teuthology.orchestra.run.smithi156.stdout: auth supported = cephx 2023-09-30T22:15:54.274 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.274 INFO:teuthology.orchestra.run.smithi156.stdout: filestore xattr use omap = true 2023-09-30T22:15:54.274 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.274 INFO:teuthology.orchestra.run.smithi156.stdout: mon clock drift allowed = 1.000 2023-09-30T22:15:54.275 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.275 INFO:teuthology.orchestra.run.smithi156.stdout: osd crush chooseleaf type = 0 2023-09-30T22:15:54.275 INFO:teuthology.orchestra.run.smithi156.stdout: auth debug = true 2023-09-30T22:15:54.275 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.275 INFO:teuthology.orchestra.run.smithi156.stdout: ms die on old message = true 2023-09-30T22:15:54.275 INFO:teuthology.orchestra.run.smithi156.stdout: ms die on bug = true 2023-09-30T22:15:54.275 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.275 INFO:teuthology.orchestra.run.smithi156.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-30T22:15:54.275 INFO:teuthology.orchestra.run.smithi156.stdout: mon pg warn max object skew = 0 2023-09-30T22:15:54.275 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.275 INFO:teuthology.orchestra.run.smithi156.stdout: # disable pg_autoscaler by default for new pools 2023-09-30T22:15:54.276 INFO:teuthology.orchestra.run.smithi156.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-30T22:15:54.276 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.276 INFO:teuthology.orchestra.run.smithi156.stdout: osd pool default size = 2 2023-09-30T22:15:54.276 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.276 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd allow primary affinity = true 2023-09-30T22:15:54.276 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd allow pg remap = true 2023-09-30T22:15:54.276 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on legacy crush tunables = false 2023-09-30T22:15:54.276 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on crush straw calc version zero = false 2023-09-30T22:15:54.276 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on no sortbitwise = false 2023-09-30T22:15:54.276 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on osd down out interval zero = false 2023-09-30T22:15:54.277 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on too few osds = false 2023-09-30T22:15:54.277 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-30T22:15:54.277 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-30T22:15:54.277 INFO:teuthology.orchestra.run.smithi156.stdout: mon_allow_pool_size_one = true 2023-09-30T22:15:54.277 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.277 INFO:teuthology.orchestra.run.smithi156.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-30T22:15:54.277 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.277 INFO:teuthology.orchestra.run.smithi156.stdout: osd default data pool replay window = 5 2023-09-30T22:15:54.277 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.277 INFO:teuthology.orchestra.run.smithi156.stdout: mon allow pool delete = true 2023-09-30T22:15:54.278 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.278 INFO:teuthology.orchestra.run.smithi156.stdout: mon cluster log file level = debug 2023-09-30T22:15:54.278 INFO:teuthology.orchestra.run.smithi156.stdout: debug asserts on shutdown = true 2023-09-30T22:15:54.278 INFO:teuthology.orchestra.run.smithi156.stdout: mon health detail to clog = false 2023-09-30T22:15:54.278 INFO:teuthology.orchestra.run.smithi156.stdout: mon host = "172.21.15.156,[v2:172.21.15.156:3301,v1:172.21.15.156:6790],[v2:172.21.15.156:3302,v1:172.21.15.156:6791]" 2023-09-30T22:15:54.278 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on pool no app = False 2023-09-30T22:15:54.278 INFO:teuthology.orchestra.run.smithi156.stdout: ms bind msgr2 = False 2023-09-30T22:15:54.278 INFO:teuthology.orchestra.run.smithi156.stdout: bluestore warn on legacy statfs = False 2023-09-30T22:15:54.278 INFO:teuthology.orchestra.run.smithi156.stdout: bluestore warn on no per pool omap = False 2023-09-30T22:15:54.278 INFO:teuthology.orchestra.run.smithi156.stdout: mon pg warn min per osd = 0 2023-09-30T22:15:54.278 INFO:teuthology.orchestra.run.smithi156.stdout: fsid = bf403786-ca20-4e4a-92c0-a0a997d43bba 2023-09-30T22:15:54.279 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.279 INFO:teuthology.orchestra.run.smithi156.stdout:[osd] 2023-09-30T22:15:54.279 INFO:teuthology.orchestra.run.smithi156.stdout: osd journal size = 100 2023-09-30T22:15:54.279 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.279 INFO:teuthology.orchestra.run.smithi156.stdout: osd scrub load threshold = 5.0 2023-09-30T22:15:54.279 INFO:teuthology.orchestra.run.smithi156.stdout: osd scrub max interval = 600 2023-09-30T22:15:54.279 INFO:teuthology.orchestra.run.smithi156.stdout: osd mclock profile = high_recovery_ops 2023-09-30T22:15:54.279 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.279 INFO:teuthology.orchestra.run.smithi156.stdout: osd recover clone overlap = true 2023-09-30T22:15:54.279 INFO:teuthology.orchestra.run.smithi156.stdout: osd recovery max chunk = 1048576 2023-09-30T22:15:54.279 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.280 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug shutdown = true 2023-09-30T22:15:54.280 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug op order = true 2023-09-30T22:15:54.280 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug verify stray on activate = true 2023-09-30T22:15:54.280 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.280 INFO:teuthology.orchestra.run.smithi156.stdout: osd open classes on start = true 2023-09-30T22:15:54.280 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug pg log writeout = true 2023-09-30T22:15:54.280 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.280 INFO:teuthology.orchestra.run.smithi156.stdout: osd deep scrub update digest min age = 30 2023-09-30T22:15:54.280 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.281 INFO:teuthology.orchestra.run.smithi156.stdout: osd map max advance = 10 2023-09-30T22:15:54.281 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.281 INFO:teuthology.orchestra.run.smithi156.stdout: journal zero on create = true 2023-09-30T22:15:54.281 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.281 INFO:teuthology.orchestra.run.smithi156.stdout: filestore ondisk finisher threads = 3 2023-09-30T22:15:54.281 INFO:teuthology.orchestra.run.smithi156.stdout: filestore apply finisher threads = 3 2023-09-30T22:15:54.281 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.281 INFO:teuthology.orchestra.run.smithi156.stdout: bdev debug aio = true 2023-09-30T22:15:54.281 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug misdirected ops = true 2023-09-30T22:15:54.281 INFO:teuthology.orchestra.run.smithi156.stdout: bdev async discard = True 2023-09-30T22:15:54.282 INFO:teuthology.orchestra.run.smithi156.stdout: bdev enable discard = True 2023-09-30T22:15:54.282 INFO:teuthology.orchestra.run.smithi156.stdout: bluestore allocator = bitmap 2023-09-30T22:15:54.282 INFO:teuthology.orchestra.run.smithi156.stdout: bluestore block size = 96636764160 2023-09-30T22:15:54.282 INFO:teuthology.orchestra.run.smithi156.stdout: bluestore fsck on mount = True 2023-09-30T22:15:54.282 INFO:teuthology.orchestra.run.smithi156.stdout: debug bluefs = 1/20 2023-09-30T22:15:54.282 INFO:teuthology.orchestra.run.smithi156.stdout: debug bluestore = 1/20 2023-09-30T22:15:54.282 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2023-09-30T22:15:54.282 INFO:teuthology.orchestra.run.smithi156.stdout: debug osd = 20 2023-09-30T22:15:54.282 INFO:teuthology.orchestra.run.smithi156.stdout: debug rocksdb = 4/10 2023-09-30T22:15:54.282 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd backfillfull_ratio = 0.85 2023-09-30T22:15:54.283 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd full ratio = 0.9 2023-09-30T22:15:54.283 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd nearfull ratio = 0.8 2023-09-30T22:15:54.283 INFO:teuthology.orchestra.run.smithi156.stdout: osd failsafe full ratio = 0.95 2023-09-30T22:15:54.283 INFO:teuthology.orchestra.run.smithi156.stdout: osd objectstore = bluestore 2023-09-30T22:15:54.283 INFO:teuthology.orchestra.run.smithi156.stdout: osd op complaint time = 180 2023-09-30T22:15:54.283 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.283 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr] 2023-09-30T22:15:54.283 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2023-09-30T22:15:54.283 INFO:teuthology.orchestra.run.smithi156.stdout: debug mgr = 20 2023-09-30T22:15:54.283 INFO:teuthology.orchestra.run.smithi156.stdout: debug mon = 20 2023-09-30T22:15:54.283 INFO:teuthology.orchestra.run.smithi156.stdout: debug auth = 20 2023-09-30T22:15:54.284 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min pgs per osd = 4 2023-09-30T22:15:54.284 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min bytes per osd = 10 2023-09-30T22:15:54.284 INFO:teuthology.orchestra.run.smithi156.stdout: mgr/telemetry/nag = false 2023-09-30T22:15:54.284 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.284 INFO:teuthology.orchestra.run.smithi156.stdout:[mon] 2023-09-30T22:15:54.284 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2023-09-30T22:15:54.284 INFO:teuthology.orchestra.run.smithi156.stdout: debug mon = 20 2023-09-30T22:15:54.284 INFO:teuthology.orchestra.run.smithi156.stdout: debug paxos = 20 2023-09-30T22:15:54.284 INFO:teuthology.orchestra.run.smithi156.stdout: debug auth = 20 2023-09-30T22:15:54.284 INFO:teuthology.orchestra.run.smithi156.stdout: mon data avail warn = 5 2023-09-30T22:15:54.285 INFO:teuthology.orchestra.run.smithi156.stdout: mon mgr mkfs grace = 240 2023-09-30T22:15:54.285 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min pgs per osd = 4 2023-09-30T22:15:54.285 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd reporter subtree level = osd 2023-09-30T22:15:54.285 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd prime pg temp = true 2023-09-30T22:15:54.285 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min bytes per osd = 10 2023-09-30T22:15:54.285 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.285 INFO:teuthology.orchestra.run.smithi156.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-30T22:15:54.285 INFO:teuthology.orchestra.run.smithi156.stdout: auth mon ticket ttl = 660 # 11m 2023-09-30T22:15:54.285 INFO:teuthology.orchestra.run.smithi156.stdout: auth service ticket ttl = 240 # 4m 2023-09-30T22:15:54.285 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.285 INFO:teuthology.orchestra.run.smithi156.stdout: # don't complain about insecure global_id in the test suite 2023-09-30T22:15:54.286 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-30T22:15:54.286 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-30T22:15:54.286 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.286 INFO:teuthology.orchestra.run.smithi156.stdout: # 1m isn't quite enough 2023-09-30T22:15:54.286 INFO:teuthology.orchestra.run.smithi156.stdout: mon_down_mkfs_grace = 2m 2023-09-30T22:15:54.286 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.286 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_filestore_osds = false 2023-09-30T22:15:54.286 INFO:teuthology.orchestra.run.smithi156.stdout: mon op complaint time = 120 2023-09-30T22:15:54.286 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on osd down out interval zero = False 2023-09-30T22:15:54.287 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:15:54.287 INFO:teuthology.orchestra.run.smithi156.stdout:[client] 2023-09-30T22:15:54.287 INFO:teuthology.orchestra.run.smithi156.stdout: rgw cache enabled = true 2023-09-30T22:15:54.287 INFO:teuthology.orchestra.run.smithi156.stdout: rgw enable ops log = true 2023-09-30T22:15:54.287 INFO:teuthology.orchestra.run.smithi156.stdout: rgw enable usage log = true 2023-09-30T22:15:54.287 INFO:teuthology.orchestra.run.smithi156.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-30T22:15:54.287 INFO:teuthology.orchestra.run.smithi156.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-30T22:15:54.287 INFO:teuthology.orchestra.run.smithi156.stdout: client mount timeout = 600 2023-09-30T22:15:54.287 INFO:teuthology.orchestra.run.smithi156.stdout: debug client = 20 2023-09-30T22:15:54.287 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2023-09-30T22:15:54.288 INFO:teuthology.orchestra.run.smithi156.stdout: rados mon op timeout = 900 2023-09-30T22:15:54.288 INFO:teuthology.orchestra.run.smithi156.stdout: rados osd op timeout = 900 2023-09-30T22:15:54.288 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.a] 2023-09-30T22:15:54.288 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.b] 2023-09-30T22:15:54.288 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.c] 2023-09-30T22:15:54.288 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.a] 2023-09-30T22:15:54.288 INFO:teuthology.orchestra.run.smithi156.stdout:[mds] 2023-09-30T22:15:54.288 INFO:teuthology.orchestra.run.smithi156.stdout: debug mds = 20 2023-09-30T22:15:54.288 INFO:teuthology.orchestra.run.smithi156.stdout: debug mds balancer = 20 2023-09-30T22:15:54.288 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2023-09-30T22:15:54.289 INFO:teuthology.orchestra.run.smithi156.stdout: mds debug frag = True 2023-09-30T22:15:54.289 INFO:teuthology.orchestra.run.smithi156.stdout: mds debug scatterstat = True 2023-09-30T22:15:54.289 INFO:teuthology.orchestra.run.smithi156.stdout: mds op complaint time = 180 2023-09-30T22:15:54.289 INFO:teuthology.orchestra.run.smithi156.stdout: mds verify scatter = True 2023-09-30T22:15:54.289 INFO:teuthology.orchestra.run.smithi156.stdout: osd op complaint time = 180 2023-09-30T22:15:54.289 INFO:teuthology.orchestra.run.smithi156.stdout: rados mon op timeout = 900 2023-09-30T22:15:54.289 INFO:teuthology.orchestra.run.smithi156.stdout: rados osd op timeout = 900 2023-09-30T22:15:54.290 INFO:teuthology.orchestra.run.smithi194.stdout:[global] 2023-09-30T22:15:54.290 INFO:teuthology.orchestra.run.smithi194.stdout: chdir = "" 2023-09-30T22:15:54.290 INFO:teuthology.orchestra.run.smithi194.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-30T22:15:54.290 INFO:teuthology.orchestra.run.smithi194.stdout: auth supported = cephx 2023-09-30T22:15:54.290 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.290 INFO:teuthology.orchestra.run.smithi194.stdout: filestore xattr use omap = true 2023-09-30T22:15:54.291 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.291 INFO:teuthology.orchestra.run.smithi194.stdout: mon clock drift allowed = 1.000 2023-09-30T22:15:54.291 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.291 INFO:teuthology.orchestra.run.smithi194.stdout: osd crush chooseleaf type = 0 2023-09-30T22:15:54.291 INFO:teuthology.orchestra.run.smithi194.stdout: auth debug = true 2023-09-30T22:15:54.291 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.291 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on old message = true 2023-09-30T22:15:54.291 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on bug = true 2023-09-30T22:15:54.292 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.292 INFO:teuthology.orchestra.run.smithi194.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-30T22:15:54.292 INFO:teuthology.orchestra.run.smithi194.stdout: mon pg warn max object skew = 0 2023-09-30T22:15:54.292 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.292 INFO:teuthology.orchestra.run.smithi194.stdout: # disable pg_autoscaler by default for new pools 2023-09-30T22:15:54.292 INFO:teuthology.orchestra.run.smithi194.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-30T22:15:54.292 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.292 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default size = 2 2023-09-30T22:15:54.292 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.293 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd allow primary affinity = true 2023-09-30T22:15:54.293 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd allow pg remap = true 2023-09-30T22:15:54.293 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on legacy crush tunables = false 2023-09-30T22:15:54.293 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on crush straw calc version zero = false 2023-09-30T22:15:54.293 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on no sortbitwise = false 2023-09-30T22:15:54.293 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on osd down out interval zero = false 2023-09-30T22:15:54.293 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on too few osds = false 2023-09-30T22:15:54.293 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-30T22:15:54.293 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-30T22:15:54.294 INFO:teuthology.orchestra.run.smithi194.stdout: mon_allow_pool_size_one = true 2023-09-30T22:15:54.294 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.294 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-30T22:15:54.294 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.294 INFO:teuthology.orchestra.run.smithi194.stdout: osd default data pool replay window = 5 2023-09-30T22:15:54.294 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.294 INFO:teuthology.orchestra.run.smithi194.stdout: mon allow pool delete = true 2023-09-30T22:15:54.294 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.294 INFO:teuthology.orchestra.run.smithi194.stdout: mon cluster log file level = debug 2023-09-30T22:15:54.294 INFO:teuthology.orchestra.run.smithi194.stdout: debug asserts on shutdown = true 2023-09-30T22:15:54.294 INFO:teuthology.orchestra.run.smithi194.stdout: mon health detail to clog = false 2023-09-30T22:15:54.295 INFO:teuthology.orchestra.run.smithi194.stdout: mon host = "172.21.15.156,[v2:172.21.15.156:3301,v1:172.21.15.156:6790],[v2:172.21.15.156:3302,v1:172.21.15.156:6791]" 2023-09-30T22:15:54.295 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on pool no app = False 2023-09-30T22:15:54.295 INFO:teuthology.orchestra.run.smithi194.stdout: ms bind msgr2 = False 2023-09-30T22:15:54.295 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore warn on legacy statfs = False 2023-09-30T22:15:54.295 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore warn on no per pool omap = False 2023-09-30T22:15:54.295 INFO:teuthology.orchestra.run.smithi194.stdout: mon pg warn min per osd = 0 2023-09-30T22:15:54.295 INFO:teuthology.orchestra.run.smithi194.stdout: fsid = bf403786-ca20-4e4a-92c0-a0a997d43bba 2023-09-30T22:15:54.295 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.295 INFO:teuthology.orchestra.run.smithi194.stdout:[osd] 2023-09-30T22:15:54.295 INFO:teuthology.orchestra.run.smithi194.stdout: osd journal size = 100 2023-09-30T22:15:54.296 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.296 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub load threshold = 5.0 2023-09-30T22:15:54.296 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub max interval = 600 2023-09-30T22:15:54.296 INFO:teuthology.orchestra.run.smithi194.stdout: osd mclock profile = high_recovery_ops 2023-09-30T22:15:54.296 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.296 INFO:teuthology.orchestra.run.smithi194.stdout: osd recover clone overlap = true 2023-09-30T22:15:54.296 INFO:teuthology.orchestra.run.smithi194.stdout: osd recovery max chunk = 1048576 2023-09-30T22:15:54.296 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.296 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug shutdown = true 2023-09-30T22:15:54.296 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug op order = true 2023-09-30T22:15:54.297 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug verify stray on activate = true 2023-09-30T22:15:54.297 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.297 INFO:teuthology.orchestra.run.smithi194.stdout: osd open classes on start = true 2023-09-30T22:15:54.297 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug pg log writeout = true 2023-09-30T22:15:54.297 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.297 INFO:teuthology.orchestra.run.smithi194.stdout: osd deep scrub update digest min age = 30 2023-09-30T22:15:54.297 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.297 INFO:teuthology.orchestra.run.smithi194.stdout: osd map max advance = 10 2023-09-30T22:15:54.297 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.297 INFO:teuthology.orchestra.run.smithi194.stdout: journal zero on create = true 2023-09-30T22:15:54.298 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.298 INFO:teuthology.orchestra.run.smithi194.stdout: filestore ondisk finisher threads = 3 2023-09-30T22:15:54.298 INFO:teuthology.orchestra.run.smithi194.stdout: filestore apply finisher threads = 3 2023-09-30T22:15:54.298 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.298 INFO:teuthology.orchestra.run.smithi194.stdout: bdev debug aio = true 2023-09-30T22:15:54.298 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug misdirected ops = true 2023-09-30T22:15:54.298 INFO:teuthology.orchestra.run.smithi194.stdout: bdev async discard = True 2023-09-30T22:15:54.298 INFO:teuthology.orchestra.run.smithi194.stdout: bdev enable discard = True 2023-09-30T22:15:54.298 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore allocator = bitmap 2023-09-30T22:15:54.298 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore block size = 96636764160 2023-09-30T22:15:54.298 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore fsck on mount = True 2023-09-30T22:15:54.299 INFO:teuthology.orchestra.run.smithi194.stdout: debug bluefs = 1/20 2023-09-30T22:15:54.299 INFO:teuthology.orchestra.run.smithi194.stdout: debug bluestore = 1/20 2023-09-30T22:15:54.299 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2023-09-30T22:15:54.299 INFO:teuthology.orchestra.run.smithi194.stdout: debug osd = 20 2023-09-30T22:15:54.299 INFO:teuthology.orchestra.run.smithi194.stdout: debug rocksdb = 4/10 2023-09-30T22:15:54.299 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd backfillfull_ratio = 0.85 2023-09-30T22:15:54.299 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd full ratio = 0.9 2023-09-30T22:15:54.299 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd nearfull ratio = 0.8 2023-09-30T22:15:54.299 INFO:teuthology.orchestra.run.smithi194.stdout: osd failsafe full ratio = 0.95 2023-09-30T22:15:54.299 INFO:teuthology.orchestra.run.smithi194.stdout: osd objectstore = bluestore 2023-09-30T22:15:54.300 INFO:teuthology.orchestra.run.smithi194.stdout: osd op complaint time = 180 2023-09-30T22:15:54.300 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.300 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr] 2023-09-30T22:15:54.300 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2023-09-30T22:15:54.300 INFO:teuthology.orchestra.run.smithi194.stdout: debug mgr = 20 2023-09-30T22:15:54.300 INFO:teuthology.orchestra.run.smithi194.stdout: debug mon = 20 2023-09-30T22:15:54.300 INFO:teuthology.orchestra.run.smithi194.stdout: debug auth = 20 2023-09-30T22:15:54.300 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min pgs per osd = 4 2023-09-30T22:15:54.300 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min bytes per osd = 10 2023-09-30T22:15:54.300 INFO:teuthology.orchestra.run.smithi194.stdout: mgr/telemetry/nag = false 2023-09-30T22:15:54.300 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.301 INFO:teuthology.orchestra.run.smithi194.stdout:[mon] 2023-09-30T22:15:54.301 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2023-09-30T22:15:54.301 INFO:teuthology.orchestra.run.smithi194.stdout: debug mon = 20 2023-09-30T22:15:54.301 INFO:teuthology.orchestra.run.smithi194.stdout: debug paxos = 20 2023-09-30T22:15:54.301 INFO:teuthology.orchestra.run.smithi194.stdout: debug auth = 20 2023-09-30T22:15:54.301 INFO:teuthology.orchestra.run.smithi194.stdout: mon data avail warn = 5 2023-09-30T22:15:54.301 INFO:teuthology.orchestra.run.smithi194.stdout: mon mgr mkfs grace = 240 2023-09-30T22:15:54.301 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min pgs per osd = 4 2023-09-30T22:15:54.301 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd reporter subtree level = osd 2023-09-30T22:15:54.301 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd prime pg temp = true 2023-09-30T22:15:54.302 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min bytes per osd = 10 2023-09-30T22:15:54.302 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.302 INFO:teuthology.orchestra.run.smithi194.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-30T22:15:54.302 INFO:teuthology.orchestra.run.smithi194.stdout: auth mon ticket ttl = 660 # 11m 2023-09-30T22:15:54.302 INFO:teuthology.orchestra.run.smithi194.stdout: auth service ticket ttl = 240 # 4m 2023-09-30T22:15:54.302 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.302 INFO:teuthology.orchestra.run.smithi194.stdout: # don't complain about insecure global_id in the test suite 2023-09-30T22:15:54.302 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-30T22:15:54.302 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-30T22:15:54.302 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.303 INFO:teuthology.orchestra.run.smithi194.stdout: # 1m isn't quite enough 2023-09-30T22:15:54.303 INFO:teuthology.orchestra.run.smithi194.stdout: mon_down_mkfs_grace = 2m 2023-09-30T22:15:54.303 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.303 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_filestore_osds = false 2023-09-30T22:15:54.303 INFO:teuthology.orchestra.run.smithi194.stdout: mon op complaint time = 120 2023-09-30T22:15:54.303 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on osd down out interval zero = False 2023-09-30T22:15:54.303 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-09-30T22:15:54.303 INFO:teuthology.orchestra.run.smithi194.stdout:[client] 2023-09-30T22:15:54.303 INFO:teuthology.orchestra.run.smithi194.stdout: rgw cache enabled = true 2023-09-30T22:15:54.303 INFO:teuthology.orchestra.run.smithi194.stdout: rgw enable ops log = true 2023-09-30T22:15:54.304 INFO:teuthology.orchestra.run.smithi194.stdout: rgw enable usage log = true 2023-09-30T22:15:54.304 INFO:teuthology.orchestra.run.smithi194.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-30T22:15:54.304 INFO:teuthology.orchestra.run.smithi194.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-30T22:15:54.304 INFO:teuthology.orchestra.run.smithi194.stdout: client mount timeout = 600 2023-09-30T22:15:54.304 INFO:teuthology.orchestra.run.smithi194.stdout: debug client = 20 2023-09-30T22:15:54.304 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2023-09-30T22:15:54.304 INFO:teuthology.orchestra.run.smithi194.stdout: rados mon op timeout = 900 2023-09-30T22:15:54.304 INFO:teuthology.orchestra.run.smithi194.stdout: rados osd op timeout = 900 2023-09-30T22:15:54.304 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.a] 2023-09-30T22:15:54.304 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.b] 2023-09-30T22:15:54.305 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.c] 2023-09-30T22:15:54.305 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.a] 2023-09-30T22:15:54.305 INFO:teuthology.orchestra.run.smithi194.stdout:[mds] 2023-09-30T22:15:54.305 INFO:teuthology.orchestra.run.smithi194.stdout: debug mds = 20 2023-09-30T22:15:54.305 INFO:teuthology.orchestra.run.smithi194.stdout: debug mds balancer = 20 2023-09-30T22:15:54.305 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2023-09-30T22:15:54.305 INFO:teuthology.orchestra.run.smithi194.stdout: mds debug frag = True 2023-09-30T22:15:54.305 INFO:teuthology.orchestra.run.smithi194.stdout: mds debug scatterstat = True 2023-09-30T22:15:54.305 INFO:teuthology.orchestra.run.smithi194.stdout: mds op complaint time = 180 2023-09-30T22:15:54.305 INFO:teuthology.orchestra.run.smithi194.stdout: mds verify scatter = True 2023-09-30T22:15:54.306 INFO:teuthology.orchestra.run.smithi194.stdout: osd op complaint time = 180 2023-09-30T22:15:54.306 INFO:teuthology.orchestra.run.smithi194.stdout: rados mon op timeout = 900 2023-09-30T22:15:54.306 INFO:teuthology.orchestra.run.smithi194.stdout: rados osd op timeout = 900 2023-09-30T22:15:54.307 INFO:tasks.ceph:Creating admin key on mon.a... 2023-09-30T22:15:54.308 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-09-30T22:15:54.401 INFO:tasks.ceph:Copying monmap to all nodes... 2023-09-30T22:15:54.401 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-30T22:15:54.401 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-09-30T22:15:54.419 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-30T22:15:54.419 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-09-30T22:15:54.477 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi156.front.sepia.ceph.com 2023-09-30T22:15:54.477 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-30T22:15:54.477 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-30T22:15:54.478 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T22:15:54.554 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-30T22:15:54.554 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:15:54.612 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi194.front.sepia.ceph.com 2023-09-30T22:15:54.612 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-09-30T22:15:54.613 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-30T22:15:54.613 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T22:15:54.656 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-09-30T22:15:54.657 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:15:54.717 INFO:tasks.ceph:Setting up mon nodes... 2023-09-30T22:15:54.717 INFO:tasks.ceph:Setting up mgr nodes... 2023-09-30T22:15:54.717 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-09-30T22:15:54.767 INFO:teuthology.orchestra.run.smithi156.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-09-30T22:15:54.769 INFO:tasks.ceph:Setting up mds nodes... 2023-09-30T22:15:54.769 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-09-30T22:15:54.818 INFO:teuthology.orchestra.run.smithi156.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-09-30T22:15:54.821 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-09-30T22:15:54.847 INFO:tasks.ceph_client:Setting up client nodes... 2023-09-30T22:15:54.847 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-09-30T22:15:54.979 INFO:teuthology.orchestra.run.smithi194.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-09-30T22:15:54.993 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-09-30T22:15:54.993 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi156.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2023-09-30T22:15:54.993 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-09-30T22:15:55.021 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T22:15:55.021 INFO:tasks.ceph:role: osd.0 2023-09-30T22:15:55.022 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi156.front.sepia.ceph.com 2023-09-30T22:15:55.022 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-30T22:15:55.088 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T22:15:55.089 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T22:15:55.089 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T22:15:55.089 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T22:15:55.089 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T22:15:55.089 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2023-09-30T22:15:55.089 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T22:15:55.090 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T22:15:55.090 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T22:15:55.090 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T22:15:55.111 INFO:teuthology.orchestra.run.smithi156.stdout:Discarding blocks...Done. 2023-09-30T22:15:55.113 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2023-09-30T22:15:55.113 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-09-30T22:15:55.196 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-09-30T22:15:55.268 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-09-30T22:15:55.335 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T22:15:55.335 INFO:tasks.ceph:role: osd.1 2023-09-30T22:15:55.335 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi156.front.sepia.ceph.com 2023-09-30T22:15:55.336 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-30T22:15:55.403 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T22:15:55.403 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T22:15:55.403 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T22:15:55.403 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T22:15:55.403 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T22:15:55.403 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2023-09-30T22:15:55.403 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T22:15:55.403 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T22:15:55.403 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T22:15:55.404 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T22:15:55.424 INFO:teuthology.orchestra.run.smithi156.stdout:Discarding blocks...Done. 2023-09-30T22:15:55.426 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2023-09-30T22:15:55.426 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-09-30T22:15:55.506 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-09-30T22:15:55.579 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-09-30T22:15:55.646 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T22:15:55.647 INFO:tasks.ceph:role: osd.2 2023-09-30T22:15:55.647 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi156.front.sepia.ceph.com 2023-09-30T22:15:55.647 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-30T22:15:55.713 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T22:15:55.713 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T22:15:55.713 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T22:15:55.713 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T22:15:55.713 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T22:15:55.713 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2023-09-30T22:15:55.714 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T22:15:55.714 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T22:15:55.714 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T22:15:55.714 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T22:15:55.736 INFO:teuthology.orchestra.run.smithi156.stdout:Discarding blocks...Done. 2023-09-30T22:15:55.737 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2023-09-30T22:15:55.737 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-09-30T22:15:55.818 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-09-30T22:15:55.890 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-09-30T22:15:55.957 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T22:15:55.957 INFO:tasks.ceph:role: osd.3 2023-09-30T22:15:55.958 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi156.front.sepia.ceph.com 2023-09-30T22:15:55.958 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-09-30T22:15:56.024 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T22:15:56.024 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T22:15:56.024 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T22:15:56.024 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T22:15:56.024 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T22:15:56.025 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2023-09-30T22:15:56.025 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T22:15:56.025 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T22:15:56.025 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T22:15:56.025 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T22:15:56.047 INFO:teuthology.orchestra.run.smithi156.stdout:Discarding blocks...Done. 2023-09-30T22:15:56.048 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2023-09-30T22:15:56.049 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-09-30T22:15:56.128 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-09-30T22:15:56.199 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:15:56.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:15:56.294+0000 7f2964a65200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-09-30T22:15:56.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:15:56.295+0000 7f2964a65200 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-09-30T22:15:56.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:15:56.295+0000 7f2964a65200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-30T22:15:56.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:15:56.295+0000 7f2964a65200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-30T22:15:56.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:15:56.295+0000 7f2964a65200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-30T22:15:56.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:15:56.295+0000 7f2964a65200 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-09-30T22:15:59.137 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-09-30T22:15:59.169 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:15:59.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:15:59.258+0000 7f40643e4200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-09-30T22:15:59.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:15:59.258+0000 7f40643e4200 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-09-30T22:15:59.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:15:59.258+0000 7f40643e4200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-30T22:15:59.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:15:59.258+0000 7f40643e4200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-30T22:15:59.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:15:59.258+0000 7f40643e4200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-30T22:15:59.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:15:59.259+0000 7f40643e4200 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-09-30T22:16:02.110 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-09-30T22:16:02.142 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:16:02.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:02.230+0000 7fc9ee5e0200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-09-30T22:16:02.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:02.230+0000 7fc9ee5e0200 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-09-30T22:16:02.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:02.230+0000 7fc9ee5e0200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-30T22:16:02.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:02.230+0000 7fc9ee5e0200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-30T22:16:02.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:02.230+0000 7fc9ee5e0200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-30T22:16:02.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:02.230+0000 7fc9ee5e0200 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-09-30T22:16:05.076 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-09-30T22:16:05.109 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:16:05.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:05.196+0000 7f28e8eba200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-09-30T22:16:05.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:05.196+0000 7f28e8eba200 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-09-30T22:16:05.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:05.196+0000 7f28e8eba200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-30T22:16:05.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:05.196+0000 7f28e8eba200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-30T22:16:05.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:05.196+0000 7f28e8eba200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-30T22:16:05.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:05.196+0000 7f28e8eba200 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-09-30T22:16:08.030 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-09-30T22:16:08.062 INFO:tasks.ceph:Reading keys from all nodes... 2023-09-30T22:16:08.062 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-30T22:16:08.062 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-09-30T22:16:08.133 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-30T22:16:08.134 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-09-30T22:16:08.204 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-30T22:16:08.204 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-09-30T22:16:08.274 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-30T22:16:08.274 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-09-30T22:16:08.343 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-30T22:16:08.343 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-09-30T22:16:08.411 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-30T22:16:08.412 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-09-30T22:16:08.479 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-09-30T22:16:08.480 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-09-30T22:16:08.502 INFO:tasks.ceph:Adding keys to all mons... 2023-09-30T22:16:08.502 DEBUG:teuthology.orchestra.run.smithi156:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-30T22:16:08.546 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr.x] 2023-09-30T22:16:08.546 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAanhhlX+LHLRAAXty7OeERgEVPGLFYQxcdzQ== 2023-09-30T22:16:08.546 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.a] 2023-09-30T22:16:08.547 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAanhhlHojcMBAANOd3dIlhykv33EbCVfRapg== 2023-09-30T22:16:08.547 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.0] 2023-09-30T22:16:08.547 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAcnhhlZOqWERAAUv6qNhRfsErJGQCu2yHq2g== 2023-09-30T22:16:08.547 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.1] 2023-09-30T22:16:08.547 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAfnhhl+l1uDxAAYipAhQqHxCC2tgbmcTRjAQ== 2023-09-30T22:16:08.547 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.2] 2023-09-30T22:16:08.547 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAinhhlqVDJDRAA0DnALxTIZegt4vWBS49kEQ== 2023-09-30T22:16:08.547 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.3] 2023-09-30T22:16:08.547 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAlnhhlj6vHCxAAFAheege33cINFAJrU5D12Q== 2023-09-30T22:16:08.547 INFO:teuthology.orchestra.run.smithi156.stdout:[client.0] 2023-09-30T22:16:08.547 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAanhhlTzhxOhAAGQf7oaFM+31JHW4tn29iog== 2023-09-30T22:16:08.548 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-30T22:16:08.771 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T22:16:08.827 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:16:08.888 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:16:09.037 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:16:09.112 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:16:09.193 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T22:16:09.274 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-09-30T22:16:09.274 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-09-30T22:16:09.301 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-30T22:16:09.395 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-09-30T22:16:09.421 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-09-30T22:16:09.488 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-30T22:16:09.581 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-09-30T22:16:09.608 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-09-30T22:16:09.675 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-30T22:16:09.768 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-09-30T22:16:09.795 DEBUG:teuthology.orchestra.run.smithi156:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:16:09.853 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-09-30T22:16:09.853 INFO:tasks.ceph.mon.a:Restarting daemon 2023-09-30T22:16:09.853 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-09-30T22:16:09.896 INFO:tasks.ceph.mon.a:Started 2023-09-30T22:16:09.896 INFO:tasks.ceph.mon.b:Restarting daemon 2023-09-30T22:16:09.896 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-09-30T22:16:09.898 INFO:tasks.ceph.mon.b:Started 2023-09-30T22:16:09.898 INFO:tasks.ceph.mon.c:Restarting daemon 2023-09-30T22:16:09.899 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-09-30T22:16:09.900 INFO:tasks.ceph.mon.c:Started 2023-09-30T22:16:09.900 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-09-30T22:16:09.901 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-09-30T22:16:09.901 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-09-30T22:16:09.903 INFO:tasks.ceph.mgr.x:Started 2023-09-30T22:16:09.903 INFO:tasks.ceph:Setting crush tunables to default 2023-09-30T22:16:09.903 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd crush tunables default 2023-09-30T22:16:10.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.065+0000 7f3df8d7c700 1 Processor -- start 2023-09-30T22:16:10.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.066+0000 7f3df8d7c700 1 -- start start 2023-09-30T22:16:10.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.066+0000 7f3df8d7c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 0x7f3df4096840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:10.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.066+0000 7f3df8d7c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df4069d90 0x7f3df4096d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:10.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.066+0000 7f3df8d7c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3df4067e90 0x7f3df4068320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:10.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.066+0000 7f3df8d7c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df405f940 con 0x7f3df4067e90 2023-09-30T22:16:10.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.066+0000 7f3df8d7c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df40933e0 con 0x7f3df405f560 2023-09-30T22:16:10.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.066+0000 7f3df8d7c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3df40921e0 con 0x7f3df4069d90 2023-09-30T22:16:10.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.066+0000 7f3df1d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df4069d90 0x7f3df4096d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:10.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.066+0000 7f3df2d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3df4067e90 0x7f3df4068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:10.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.066+0000 7f3df259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 0x7f3df4096840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:10.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.066+0000 7f3df2d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3df4067e90 0x7f3df4068320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39358/0 (socket says 172.21.15.156:39358) 2023-09-30T22:16:10.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.066+0000 7f3df1d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df4069d90 0x7f3df4096d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36688/0 (socket says 172.21.15.156:36688) 2023-09-30T22:16:10.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.066+0000 7f3df2d9d700 1 -- 172.21.15.156:0/713640567 learned_addr learned my addr 172.21.15.156:0/713640567 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:10.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.066+0000 7f3df259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 0x7f3df4096840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54414/0 (socket says 172.21.15.156:54414) 2023-09-30T22:16:10.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.066+0000 7f3df2d9d700 1 -- 172.21.15.156:0/713640567 >> v2:172.21.15.156:3300/0 conn(0x7f3df4067e90 msgr2=0x7f3df4068320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-30T22:16:10.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.066+0000 7f3df2d9d700 1 -- 172.21.15.156:0/713640567 >> v2:172.21.15.156:3300/0 conn(0x7f3df4067e90 msgr2=0x7f3df4068320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:16:10.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.066+0000 7f3df1d9b700 1 -- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df4069d90 msgr2=0x7f3df4096d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-30T22:16:10.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.066+0000 7f3df1d9b700 1 -- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df4069d90 msgr2=0x7f3df4096d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:16:10.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.066+0000 7f3df2d9d700 1 --2- 172.21.15.156:0/713640567 >> v2:172.21.15.156:3300/0 conn(0x7f3df4067e90 0x7f3df4068320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:16:10.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.066+0000 7f3df1d9b700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df4069d90 0x7f3df4096d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:16:10.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.066+0000 7f3df259c700 1 -- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 msgr2=0x7f3df4096840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T22:16:10.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.066+0000 7f3df259c700 1 -- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 msgr2=0x7f3df4096840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:16:10.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.066+0000 7f3df1d9b700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df4069d90 0x7f3df4096d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-09-30T22:16:10.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.066+0000 7f3df2d9d700 1 --2- 172.21.15.156:0/713640567 >> v2:172.21.15.156:3300/0 conn(0x7f3df4067e90 0x7f3df4068320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-09-30T22:16:10.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.066+0000 7f3df259c700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 0x7f3df4096840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:16:10.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.067+0000 7f3df259c700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 0x7f3df4096840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-09-30T22:16:10.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.267+0000 7f3df2d9d700 1 --2- 172.21.15.156:0/713640567 >> v2:172.21.15.156:3300/0 conn(0x7f3df4067e90 0x7f3df4068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:10.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.267+0000 7f3df2d9d700 1 -- 172.21.15.156:0/713640567 >> v2:172.21.15.156:3300/0 conn(0x7f3df4067e90 msgr2=0x7f3df4068320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T22:16:10.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.267+0000 7f3df2d9d700 1 -- 172.21.15.156:0/713640567 >> v2:172.21.15.156:3300/0 conn(0x7f3df4067e90 msgr2=0x7f3df4068320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:16:10.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.267+0000 7f3df2d9d700 1 --2- 172.21.15.156:0/713640567 >> v2:172.21.15.156:3300/0 conn(0x7f3df4067e90 0x7f3df4068320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:16:10.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.267+0000 7f3df2d9d700 1 --2- 172.21.15.156:0/713640567 >> v2:172.21.15.156:3300/0 conn(0x7f3df4067e90 0x7f3df4068320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-09-30T22:16:10.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.267+0000 7f3df1d9b700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df4069d90 0x7f3df4096d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:10.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.267+0000 7f3df1d9b700 1 -- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df4069d90 msgr2=0x7f3df4096d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-30T22:16:10.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.267+0000 7f3df1d9b700 1 -- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df4069d90 msgr2=0x7f3df4096d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:16:10.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.267+0000 7f3df1d9b700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df4069d90 0x7f3df4096d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:16:10.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.267+0000 7f3df1d9b700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df4069d90 0x7f3df4096d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-09-30T22:16:10.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.268+0000 7f3df259c700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 0x7f3df4096840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:10.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.268+0000 7f3df259c700 1 -- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 msgr2=0x7f3df4096840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T22:16:10.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.268+0000 7f3df259c700 1 -- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 msgr2=0x7f3df4096840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:16:10.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.268+0000 7f3df259c700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 0x7f3df4096840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:16:10.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.268+0000 7f3df259c700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 0x7f3df4096840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-09-30T22:16:10.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.668+0000 7f3df2d9d700 1 --2- 172.21.15.156:0/713640567 >> v2:172.21.15.156:3300/0 conn(0x7f3df4067e90 0x7f3df4068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:10.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.668+0000 7f3df1d9b700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df4069d90 0x7f3df4096d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:10.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.668+0000 7f3df2d9d700 1 -- 172.21.15.156:0/713640567 >> v2:172.21.15.156:3300/0 conn(0x7f3df4067e90 msgr2=0x7f3df4068320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T22:16:10.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.668+0000 7f3df2d9d700 1 -- 172.21.15.156:0/713640567 >> v2:172.21.15.156:3300/0 conn(0x7f3df4067e90 msgr2=0x7f3df4068320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:16:10.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.668+0000 7f3df2d9d700 1 --2- 172.21.15.156:0/713640567 >> v2:172.21.15.156:3300/0 conn(0x7f3df4067e90 0x7f3df4068320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:16:10.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.668+0000 7f3df1d9b700 1 -- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df4069d90 msgr2=0x7f3df4096d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-30T22:16:10.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.668+0000 7f3df1d9b700 1 -- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df4069d90 msgr2=0x7f3df4096d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:16:10.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.668+0000 7f3df2d9d700 1 --2- 172.21.15.156:0/713640567 >> v2:172.21.15.156:3300/0 conn(0x7f3df4067e90 0x7f3df4068320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-09-30T22:16:10.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.668+0000 7f3df1d9b700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df4069d90 0x7f3df4096d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:16:10.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.668+0000 7f3df1d9b700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df4069d90 0x7f3df4096d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-09-30T22:16:10.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.669+0000 7f3df259c700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 0x7f3df4096840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:10.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.669+0000 7f3df259c700 1 -- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 msgr2=0x7f3df4096840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T22:16:10.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.669+0000 7f3df259c700 1 -- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 msgr2=0x7f3df4096840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:16:10.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.669+0000 7f3df259c700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 0x7f3df4096840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:16:10.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:10.669+0000 7f3df259c700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 0x7f3df4096840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-09-30T22:16:11.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:11.469+0000 7f3df1d9b700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df4069d90 0x7f3df4096d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:11.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:11.469+0000 7f3df2d9d700 1 --2- 172.21.15.156:0/713640567 >> v2:172.21.15.156:3300/0 conn(0x7f3df4067e90 0x7f3df4068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:11.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:11.469+0000 7f3df1d9b700 1 -- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df4069d90 msgr2=0x7f3df4096d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-30T22:16:11.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:11.469+0000 7f3df1d9b700 1 -- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df4069d90 msgr2=0x7f3df4096d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:16:11.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:11.469+0000 7f3df2d9d700 1 -- 172.21.15.156:0/713640567 >> v2:172.21.15.156:3300/0 conn(0x7f3df4067e90 msgr2=0x7f3df4068320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T22:16:11.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:11.469+0000 7f3df2d9d700 1 -- 172.21.15.156:0/713640567 >> v2:172.21.15.156:3300/0 conn(0x7f3df4067e90 msgr2=0x7f3df4068320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:16:11.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:11.469+0000 7f3df1d9b700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df4069d90 0x7f3df4096d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:16:11.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:11.469+0000 7f3df2d9d700 1 --2- 172.21.15.156:0/713640567 >> v2:172.21.15.156:3300/0 conn(0x7f3df4067e90 0x7f3df4068320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:16:11.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:11.469+0000 7f3df1d9b700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df4069d90 0x7f3df4096d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2023-09-30T22:16:11.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:11.469+0000 7f3df2d9d700 1 --2- 172.21.15.156:0/713640567 >> v2:172.21.15.156:3300/0 conn(0x7f3df4067e90 0x7f3df4068320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2023-09-30T22:16:11.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:11.470+0000 7f3df259c700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 0x7f3df4096840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:11.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:11.470+0000 7f3df259c700 1 -- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 msgr2=0x7f3df4096840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T22:16:11.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:11.470+0000 7f3df259c700 1 -- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 msgr2=0x7f3df4096840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:16:11.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:11.470+0000 7f3df259c700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 0x7f3df4096840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:16:11.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:11.470+0000 7f3df259c700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 0x7f3df4096840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2023-09-30T22:16:13.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:13.067+0000 7f3de3fff700 1 -- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df4069d90 msgr2=0x7f3df4096d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:16:13.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:13.067+0000 7f3de3fff700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df4069d90 0x7f3df4096d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:13.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:13.067+0000 7f3de3fff700 1 -- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 msgr2=0x7f3df4096840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:16:13.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:13.067+0000 7f3de3fff700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 0x7f3df4096840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:13.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:13.067+0000 7f3de3fff700 1 -- 172.21.15.156:0/713640567 >> v2:172.21.15.156:3300/0 conn(0x7f3df4067e90 msgr2=0x7f3df4068320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:16:13.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:13.067+0000 7f3de3fff700 1 --2- 172.21.15.156:0/713640567 >> v2:172.21.15.156:3300/0 conn(0x7f3df4067e90 0x7f3df4068320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:13.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:13.067+0000 7f3de3fff700 1 -- 172.21.15.156:0/713640567 --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df4091b90 con 0x7f3ddc003580 2023-09-30T22:16:15.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.248+0000 7f3df159a700 1 -- 172.21.15.156:0/713640567 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170544121 0 0) 0x7f3df4091b90 con 0x7f3ddc003580 2023-09-30T22:16:15.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.249+0000 7f3df159a700 1 -- 172.21.15.156:0/713640567 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dd40033f0 con 0x7f3ddc003580 2023-09-30T22:16:15.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.249+0000 7f3df159a700 1 -- 172.21.15.156:0/713640567 <== mon.0 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3333500389 0 0) 0x7f3dd40033f0 con 0x7f3ddc003580 2023-09-30T22:16:15.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.249+0000 7f3df159a700 1 -- 172.21.15.156:0/713640567 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc008280 con 0x7f3ddc003580 2023-09-30T22:16:15.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.249+0000 7f3df159a700 1 -- 172.21.15.156:0/713640567 <== mon.0 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1830288586 0 0) 0x7f3de800d1c0 con 0x7f3ddc003580 2023-09-30T22:16:15.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.249+0000 7f3df159a700 1 -- 172.21.15.156:0/713640567 >> v1:172.21.15.156:6789/0 conn(0x7f3ddc003580 legacy=0x7f3ddc005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:15.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.249+0000 7f3df159a700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3dd4003930 0x7f3dd4003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:15.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.249+0000 7f3df159a700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 0x7f3dd4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:15.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.249+0000 7f3df159a700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3dd4004bd0 0x7f3dd4005050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:15.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.249+0000 7f3df159a700 1 -- 172.21.15.156:0/713640567 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd400b9e0 con 0x7f3dd4004bd0 2023-09-30T22:16:15.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.249+0000 7f3df159a700 1 -- 172.21.15.156:0/713640567 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd400bb20 con 0x7f3df405f560 2023-09-30T22:16:15.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.249+0000 7f3df159a700 1 -- 172.21.15.156:0/713640567 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd400bce0 con 0x7f3dd4003930 2023-09-30T22:16:15.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.249+0000 7f3df259c700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3dd4003930 0x7f3dd4003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:15.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.249+0000 7f3df1d9b700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 0x7f3dd4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:15.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.249+0000 7f3df2d9d700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3dd4004bd0 0x7f3dd4005050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:15.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.250+0000 7f3df259c700 1 -- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 msgr2=0x7f3dd4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:15.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.250+0000 7f3df259c700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 0x7f3dd4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:15.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.250+0000 7f3df259c700 1 -- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3dd4004bd0 msgr2=0x7f3dd4005050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:15.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.250+0000 7f3df259c700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3dd4004bd0 0x7f3dd4005050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:15.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.250+0000 7f3df259c700 1 -- 172.21.15.156:0/713640567 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd40033f0 con 0x7f3dd4003930 2023-09-30T22:16:15.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.250+0000 7f3df1d9b700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3df405f560 0x7f3dd4004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:15.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.250+0000 7f3df2d9d700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3dd4004bd0 0x7f3dd4005050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:15.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.250+0000 7f3df259c700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3dd4003930 0x7f3dd4003d10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f3de8013360 tx=0x7f3de8008040).ready entity=mon.2 client_cookie=146011230c8c829 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:15.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.250+0000 7f3df159a700 1 -- 172.21.15.156:0/713640567 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de800d9c0 con 0x7f3dd4003930 2023-09-30T22:16:15.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.250+0000 7f3df159a700 1 -- 172.21.15.156:0/713640567 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de8013b90 con 0x7f3dd4003930 2023-09-30T22:16:15.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.250+0000 7f3df159a700 1 -- 172.21.15.156:0/713640567 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de8016460 con 0x7f3dd4003930 2023-09-30T22:16:15.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.251+0000 7f3df8d7c700 1 -- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3dd4003930 msgr2=0x7f3dd4003d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:15.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.251+0000 7f3df8d7c700 1 --2- 172.21.15.156:0/713640567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3dd4003930 0x7f3dd4003d10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f3de8013360 tx=0x7f3de8008040).stop 2023-09-30T22:16:15.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.251+0000 7f3df2d9d700 1 -- 172.21.15.156:0/713640567 reap_dead start 2023-09-30T22:16:15.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.251+0000 7f3df8d7c700 1 -- 172.21.15.156:0/713640567 shutdown_connections 2023-09-30T22:16:15.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.251+0000 7f3df8d7c700 1 -- 172.21.15.156:0/713640567 >> 172.21.15.156:0/713640567 conn(0x7f3df409a1c0 msgr2=0x7f3df409a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:15.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.251+0000 7f3df8d7c700 1 -- 172.21.15.156:0/713640567 shutdown_connections 2023-09-30T22:16:15.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.251+0000 7f3df8d7c700 1 -- 172.21.15.156:0/713640567 wait complete. 2023-09-30T22:16:15.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.252+0000 7f3df8d7c700 1 Processor -- start 2023-09-30T22:16:15.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.252+0000 7f3df8d7c700 1 -- start start 2023-09-30T22:16:15.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.253+0000 7f3df8d7c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3dd4003930 0x7f3df4139c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:15.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.253+0000 7f3df8d7c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3df413a180 0x7f3df413a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:15.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.253+0000 7f3df8d7c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df411a4c0 0x7f3df411a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:15.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.253+0000 7f3df8d7c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df411da00 con 0x7f3df413a180 2023-09-30T22:16:15.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.253+0000 7f3df8d7c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df4091dc0 con 0x7f3dd4003930 2023-09-30T22:16:15.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.253+0000 7f3df8d7c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3df40970b0 con 0x7f3df411a4c0 2023-09-30T22:16:15.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.253+0000 7f3df259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3dd4003930 0x7f3df4139c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:15.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.253+0000 7f3df1d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3df413a180 0x7f3df413a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:15.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.253+0000 7f3df2d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df411a4c0 0x7f3df411a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:15.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.253+0000 7f3df1d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3df413a180 0x7f3df413a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41652/0 (socket says 172.21.15.156:41652) 2023-09-30T22:16:15.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.253+0000 7f3df259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3dd4003930 0x7f3df4139c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:47818/0 (socket says 172.21.15.156:47818) 2023-09-30T22:16:15.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.253+0000 7f3df1d9b700 1 -- 172.21.15.156:0/2202994520 learned_addr learned my addr 172.21.15.156:0/2202994520 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:15.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.253+0000 7f3df1d9b700 1 -- 172.21.15.156:0/2202994520 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df411a4c0 msgr2=0x7f3df411a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:15.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.253+0000 7f3df1d9b700 1 --2- 172.21.15.156:0/2202994520 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df411a4c0 0x7f3df411a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:15.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.253+0000 7f3df1d9b700 1 -- 172.21.15.156:0/2202994520 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3dd4003930 msgr2=0x7f3df4139c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:15.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.253+0000 7f3df1d9b700 1 --2- 172.21.15.156:0/2202994520 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3dd4003930 0x7f3df4139c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:15.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.253+0000 7f3df1d9b700 1 -- 172.21.15.156:0/2202994520 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df411c490 con 0x7f3df413a180 2023-09-30T22:16:15.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.253+0000 7f3df2d9d700 1 --2- 172.21.15.156:0/2202994520 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df411a4c0 0x7f3df411a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:15.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.253+0000 7f3df259c700 1 --2- 172.21.15.156:0/2202994520 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3dd4003930 0x7f3df4139c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:15.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.253+0000 7f3df1d9b700 1 --2- 172.21.15.156:0/2202994520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3df413a180 0x7f3df413a560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f3de4010c70 tx=0x7f3de4014040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:15.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.254+0000 7f3de27fc700 1 -- 172.21.15.156:0/2202994520 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de4017040 con 0x7f3df413a180 2023-09-30T22:16:15.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.254+0000 7f3de27fc700 1 -- 172.21.15.156:0/2202994520 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de400d840 con 0x7f3df413a180 2023-09-30T22:16:15.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.254+0000 7f3df8d7c700 1 -- 172.21.15.156:0/2202994520 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df413aa50 con 0x7f3df413a180 2023-09-30T22:16:15.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.254+0000 7f3de27fc700 1 -- 172.21.15.156:0/2202994520 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de400dbc0 con 0x7f3df413a180 2023-09-30T22:16:15.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.254+0000 7f3df8d7c700 1 -- 172.21.15.156:0/2202994520 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df411e210 con 0x7f3df413a180 2023-09-30T22:16:15.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.254+0000 7f3de27fc700 1 -- 172.21.15.156:0/2202994520 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f3de401c6e0 con 0x7f3df413a180 2023-09-30T22:16:15.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.254+0000 7f3de27fc700 1 -- 172.21.15.156:0/2202994520 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3de4025740 con 0x7f3df413a180 2023-09-30T22:16:15.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.255+0000 7f3df8d7c700 1 -- 172.21.15.156:0/2202994520 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df4068550 con 0x7f3df413a180 2023-09-30T22:16:15.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.257+0000 7f3de27fc700 1 -- 172.21.15.156:0/2202994520 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f3df411e210 con 0x7f3df413a180 2023-09-30T22:16:15.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.330+0000 7f3df8d7c700 1 -- 172.21.15.156:0/2202994520 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f3df411d610 con 0x7f3df413a180 2023-09-30T22:16:15.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.332+0000 7f3de27fc700 1 -- 172.21.15.156:0/2202994520 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f3de402a060 con 0x7f3df413a180 2023-09-30T22:16:15.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.333+0000 7f3df8d7c700 1 -- 172.21.15.156:0/2202994520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3df413a180 msgr2=0x7f3df413a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:15.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.333+0000 7f3df8d7c700 1 --2- 172.21.15.156:0/2202994520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3df413a180 0x7f3df413a560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f3de4010c70 tx=0x7f3de4014040).stop 2023-09-30T22:16:15.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.333+0000 7f3df8d7c700 1 -- 172.21.15.156:0/2202994520 shutdown_connections 2023-09-30T22:16:15.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.333+0000 7f3df8d7c700 1 --2- 172.21.15.156:0/2202994520 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3df411a4c0 0x7f3df411a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:15.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.333+0000 7f3df8d7c700 1 --2- 172.21.15.156:0/2202994520 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3dd4003930 0x7f3df4139c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:15.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.333+0000 7f3df8d7c700 1 --2- 172.21.15.156:0/2202994520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3df413a180 0x7f3df413a560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:15.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.333+0000 7f3df8d7c700 1 -- 172.21.15.156:0/2202994520 >> 172.21.15.156:0/2202994520 conn(0x7f3df409a1c0 msgr2=0x7f3df40955f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:15.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.333+0000 7f3df8d7c700 1 -- 172.21.15.156:0/2202994520 shutdown_connections 2023-09-30T22:16:15.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.333+0000 7f3df8d7c700 1 -- 172.21.15.156:0/2202994520 wait complete. 2023-09-30T22:16:15.335 INFO:teuthology.orchestra.run.smithi156.stderr:adjusted tunables profile to default 2023-09-30T22:16:15.346 INFO:tasks.ceph:check_enable_crimson: False 2023-09-30T22:16:15.346 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-09-30T22:16:15.346 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-30T22:16:15.346 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-09-30T22:16:15.374 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-30T22:16:15.374 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-09-30T22:16:15.442 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-30T22:16:15.443 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-09-30T22:16:15.509 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-30T22:16:15.509 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-09-30T22:16:15.576 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new 3ec2e78a-c61f-473a-bfcb-f956cffe4095 0 2023-09-30T22:16:15.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.730+0000 7f9fe8b52700 1 Processor -- start 2023-09-30T22:16:15.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.730+0000 7f9fe8b52700 1 -- start start 2023-09-30T22:16:15.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.730+0000 7f9fe8b52700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9fe4092190 0x7f9fe41293c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:15.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.730+0000 7f9fe8b52700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fe412dd40 0x7f9fe4130130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:15.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.730+0000 7f9fe8b52700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe4093340 con 0x7f9fe405f560 2023-09-30T22:16:15.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.730+0000 7f9fe8b52700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe405f940 con 0x7f9fe4092190 2023-09-30T22:16:15.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.731+0000 7f9fe8b52700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe4097c30 con 0x7f9fe412dd40 2023-09-30T22:16:15.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.731+0000 7f9fe1d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9fe4092190 0x7f9fe41293c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:15.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.731+0000 7f9fe2d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fe412dd40 0x7f9fe4130130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:15.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.731+0000 7f9fe1d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9fe4092190 0x7f9fe41293c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41666/0 (socket says 172.21.15.156:41666) 2023-09-30T22:16:15.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.731+0000 7f9fe2d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fe412dd40 0x7f9fe4130130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53454/0 (socket says 172.21.15.156:53454) 2023-09-30T22:16:15.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.731+0000 7f9fe1d9b700 1 -- 172.21.15.156:0/530788630 learned_addr learned my addr 172.21.15.156:0/530788630 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:15.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.731+0000 7f9fe259c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f9fe405f560 0x7f9fe4128cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:41446/0 (socket says 172.21.15.156:41446) 2023-09-30T22:16:15.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.731+0000 7f9fe1d9b700 1 -- 172.21.15.156:0/530788630 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fe412dd40 msgr2=0x7f9fe4130130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:15.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.731+0000 7f9fe1d9b700 1 --2- 172.21.15.156:0/530788630 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fe412dd40 0x7f9fe4130130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:15.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.731+0000 7f9fe1d9b700 1 -- 172.21.15.156:0/530788630 >> v1:172.21.15.156:6789/0 conn(0x7f9fe405f560 legacy=0x7f9fe4128cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:15.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.731+0000 7f9fe1d9b700 1 -- 172.21.15.156:0/530788630 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe40941f0 con 0x7f9fe4092190 2023-09-30T22:16:15.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.731+0000 7f9fe159a700 1 -- 172.21.15.156:0/530788630 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 512414551 0 0) 0x7f9fe4093340 con 0x7f9fe405f560 2023-09-30T22:16:15.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.731+0000 7f9fe1d9b700 1 --2- 172.21.15.156:0/530788630 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fe4092190 0x7f9fe41293c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f9fd8006fd0 tx=0x7f9fd80090f0).ready entity=mon.0 client_cookie=a6bb670f97eb7132 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:15.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.731+0000 7f9fe159a700 1 -- 172.21.15.156:0/530788630 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd800b580 con 0x7f9fe4092190 2023-09-30T22:16:15.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.731+0000 7f9fe159a700 1 -- 172.21.15.156:0/530788630 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd800b6e0 con 0x7f9fe4092190 2023-09-30T22:16:15.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.731+0000 7f9fe159a700 1 -- 172.21.15.156:0/530788630 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd800ba80 con 0x7f9fe4092190 2023-09-30T22:16:15.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.732+0000 7f9fe8b52700 1 -- 172.21.15.156:0/530788630 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fe4092190 msgr2=0x7f9fe41293c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:15.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.732+0000 7f9fe8b52700 1 --2- 172.21.15.156:0/530788630 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fe4092190 0x7f9fe41293c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f9fd8006fd0 tx=0x7f9fd80090f0).stop 2023-09-30T22:16:15.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.732+0000 7f9fe8b52700 1 -- 172.21.15.156:0/530788630 shutdown_connections 2023-09-30T22:16:15.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.732+0000 7f9fe8b52700 1 --2- 172.21.15.156:0/530788630 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fe412dd40 0x7f9fe4130130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:15.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.732+0000 7f9fe8b52700 1 --2- 172.21.15.156:0/530788630 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fe4092190 0x7f9fe41293c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:15.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.732+0000 7f9fe8b52700 1 -- 172.21.15.156:0/530788630 >> 172.21.15.156:0/530788630 conn(0x7f9fe409a1c0 msgr2=0x7f9fe409a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:15.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.732+0000 7f9fe8b52700 1 -- 172.21.15.156:0/530788630 shutdown_connections 2023-09-30T22:16:15.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.732+0000 7f9fe8b52700 1 -- 172.21.15.156:0/530788630 wait complete. 2023-09-30T22:16:15.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.733+0000 7f9fe8b52700 1 Processor -- start 2023-09-30T22:16:15.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.733+0000 7f9fe8b52700 1 -- start start 2023-09-30T22:16:15.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.733+0000 7f9fe8b52700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fe405f560 0x7f9fe4110a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:15.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.733+0000 7f9fe8b52700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fe4092190 0x7f9fe4110f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:15.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.733+0000 7f9fe8b52700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fe412dd40 0x7f9fe4111440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:15.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.733+0000 7f9fe8b52700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe4111930 con 0x7f9fe405f560 2023-09-30T22:16:15.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.733+0000 7f9fe8b52700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe4115040 con 0x7f9fe4092190 2023-09-30T22:16:15.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.733+0000 7f9fe8b52700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe4111e60 con 0x7f9fe412dd40 2023-09-30T22:16:15.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.733+0000 7f9fe2d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fe412dd40 0x7f9fe4111440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:15.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.733+0000 7f9fe1d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fe4092190 0x7f9fe4110f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:15.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.733+0000 7f9fe2d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fe412dd40 0x7f9fe4111440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53468/0 (socket says 172.21.15.156:53468) 2023-09-30T22:16:15.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.733+0000 7f9fe2d9d700 1 -- 172.21.15.156:0/2073913203 learned_addr learned my addr 172.21.15.156:0/2073913203 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:15.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.733+0000 7f9fe259c700 1 --2- 172.21.15.156:0/2073913203 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fe405f560 0x7f9fe4110a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:15.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.733+0000 7f9fe2d9d700 1 -- 172.21.15.156:0/2073913203 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fe4092190 msgr2=0x7f9fe4110f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:15.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.733+0000 7f9fe2d9d700 1 --2- 172.21.15.156:0/2073913203 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fe4092190 0x7f9fe4110f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:15.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.733+0000 7f9fe2d9d700 1 -- 172.21.15.156:0/2073913203 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fe405f560 msgr2=0x7f9fe4110a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:15.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.733+0000 7f9fe2d9d700 1 --2- 172.21.15.156:0/2073913203 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fe405f560 0x7f9fe4110a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:15.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.733+0000 7f9fe2d9d700 1 -- 172.21.15.156:0/2073913203 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd8009370 con 0x7f9fe412dd40 2023-09-30T22:16:15.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.734+0000 7f9fe259c700 1 --2- 172.21.15.156:0/2073913203 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fe405f560 0x7f9fe4110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:15.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.734+0000 7f9fe2d9d700 1 --2- 172.21.15.156:0/2073913203 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fe412dd40 0x7f9fe4111440 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f9fdc0124c0 tx=0x7f9fdc00f040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:15.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.734+0000 7f9fd27fc700 1 -- 172.21.15.156:0/2073913203 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc010170 con 0x7f9fe412dd40 2023-09-30T22:16:15.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.734+0000 7f9fd27fc700 1 -- 172.21.15.156:0/2073913203 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fdc013040 con 0x7f9fe412dd40 2023-09-30T22:16:15.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.734+0000 7f9fd27fc700 1 -- 172.21.15.156:0/2073913203 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc00d300 con 0x7f9fe412dd40 2023-09-30T22:16:15.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.734+0000 7f9fe8b52700 1 -- 172.21.15.156:0/2073913203 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe41141e0 con 0x7f9fe412dd40 2023-09-30T22:16:15.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.734+0000 7f9fe8b52700 1 -- 172.21.15.156:0/2073913203 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe4114ba0 con 0x7f9fe412dd40 2023-09-30T22:16:15.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.734+0000 7f9fd27fc700 1 -- 172.21.15.156:0/2073913203 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f9fdc00b9b0 con 0x7f9fe412dd40 2023-09-30T22:16:15.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.734+0000 7f9fd27fc700 1 -- 172.21.15.156:0/2073913203 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f9fdc018a10 con 0x7f9fe412dd40 2023-09-30T22:16:15.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.735+0000 7f9fe8b52700 1 -- 172.21.15.156:0/2073913203 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe4113e20 con 0x7f9fe412dd40 2023-09-30T22:16:15.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.737+0000 7f9fd27fc700 1 -- 172.21.15.156:0/2073913203 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f9fe4113e20 con 0x7f9fe412dd40 2023-09-30T22:16:15.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.813+0000 7f9fe8b52700 1 -- 172.21.15.156:0/2073913203 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd new", "uuid": "3ec2e78a-c61f-473a-bfcb-f956cffe4095", "id": 0} v 0) v1 -- 0x7f9fe4093560 con 0x7f9fe412dd40 2023-09-30T22:16:15.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.816+0000 7f9fd27fc700 1 -- 172.21.15.156:0/2073913203 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3ec2e78a-c61f-473a-bfcb-f956cffe4095", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9fdc01d070 con 0x7f9fe412dd40 2023-09-30T22:16:15.817 INFO:teuthology.orchestra.run.smithi156.stdout:0 2023-09-30T22:16:15.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.817+0000 7f9fe8b52700 1 -- 172.21.15.156:0/2073913203 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fe412dd40 msgr2=0x7f9fe4111440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:15.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.817+0000 7f9fe8b52700 1 --2- 172.21.15.156:0/2073913203 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fe412dd40 0x7f9fe4111440 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f9fdc0124c0 tx=0x7f9fdc00f040).stop 2023-09-30T22:16:15.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.817+0000 7f9fe8b52700 1 -- 172.21.15.156:0/2073913203 shutdown_connections 2023-09-30T22:16:15.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.817+0000 7f9fe8b52700 1 --2- 172.21.15.156:0/2073913203 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fe412dd40 0x7f9fe4111440 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:15.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.817+0000 7f9fe8b52700 1 --2- 172.21.15.156:0/2073913203 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fe405f560 0x7f9fe4110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:15.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.817+0000 7f9fe8b52700 1 --2- 172.21.15.156:0/2073913203 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fe4092190 0x7f9fe4110f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:15.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.817+0000 7f9fe8b52700 1 -- 172.21.15.156:0/2073913203 >> 172.21.15.156:0/2073913203 conn(0x7f9fe409a1c0 msgr2=0x7f9fe4098b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:15.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.817+0000 7f9fe8b52700 1 -- 172.21.15.156:0/2073913203 shutdown_connections 2023-09-30T22:16:15.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.817+0000 7f9fe8b52700 1 -- 172.21.15.156:0/2073913203 wait complete. 2023-09-30T22:16:15.829 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new b682e683-c15a-4bd9-8712-8af96454e9ab 1 2023-09-30T22:16:15.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.943+0000 7fe4ed0ad700 1 Processor -- start 2023-09-30T22:16:15.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.943+0000 7fe4ed0ad700 1 -- start start 2023-09-30T22:16:15.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.944+0000 7fe4ed0ad700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4e8092440 0x7fe4e8127910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:15.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.944+0000 7fe4ed0ad700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4e8126f70 0x7fe4e8123a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:15.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.944+0000 7fe4ed0ad700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe4e8127390 0x7fe4e8123f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:15.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.944+0000 7fe4ed0ad700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4e8092820 con 0x7fe4e8127390 2023-09-30T22:16:15.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.944+0000 7fe4ed0ad700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e8097eb0 con 0x7fe4e8092440 2023-09-30T22:16:15.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.944+0000 7fe4ed0ad700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e8069760 con 0x7fe4e8126f70 2023-09-30T22:16:15.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.944+0000 7fe4e6d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4e8092440 0x7fe4e8127910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:15.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.944+0000 7fe4e759e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe4e8127390 0x7fe4e8123f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:15.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.944+0000 7fe4e659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4e8126f70 0x7fe4e8123a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:15.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.944+0000 7fe4e6d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4e8092440 0x7fe4e8127910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:47824/0 (socket says 172.21.15.156:47824) 2023-09-30T22:16:15.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.944+0000 7fe4e6d9d700 1 -- 172.21.15.156:0/717035398 learned_addr learned my addr 172.21.15.156:0/717035398 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:15.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.944+0000 7fe4e759e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe4e8127390 0x7fe4e8123f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41686/0 (socket says 172.21.15.156:41686) 2023-09-30T22:16:15.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.944+0000 7fe4e6d9d700 1 -- 172.21.15.156:0/717035398 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4e8126f70 msgr2=0x7fe4e8123a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:15.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.944+0000 7fe4e6d9d700 1 --2- 172.21.15.156:0/717035398 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4e8126f70 0x7fe4e8123a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:15.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.944+0000 7fe4e6d9d700 1 -- 172.21.15.156:0/717035398 >> v2:172.21.15.156:3300/0 conn(0x7fe4e8127390 msgr2=0x7fe4e8123f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:15.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.944+0000 7fe4e6d9d700 1 --2- 172.21.15.156:0/717035398 >> v2:172.21.15.156:3300/0 conn(0x7fe4e8127390 0x7fe4e8123f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:15.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.944+0000 7fe4e6d9d700 1 -- 172.21.15.156:0/717035398 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e8091980 con 0x7fe4e8092440 2023-09-30T22:16:15.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.944+0000 7fe4e759e700 1 --2- 172.21.15.156:0/717035398 >> v2:172.21.15.156:3300/0 conn(0x7fe4e8127390 0x7fe4e8123f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:15.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.944+0000 7fe4e659c700 1 --2- 172.21.15.156:0/717035398 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4e8126f70 0x7fe4e8123a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:15.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.944+0000 7fe4e6d9d700 1 --2- 172.21.15.156:0/717035398 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4e8092440 0x7fe4e8127910 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fe4dc006fd0 tx=0x7fe4dc00b3b0).ready entity=mon.1 client_cookie=c15de48df11bd03c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:15.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.944+0000 7fe4e5d9b700 1 -- 172.21.15.156:0/717035398 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc00da70 con 0x7fe4e8092440 2023-09-30T22:16:15.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.945+0000 7fe4e5d9b700 1 -- 172.21.15.156:0/717035398 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4dc00dbd0 con 0x7fe4e8092440 2023-09-30T22:16:15.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.945+0000 7fe4e5d9b700 1 -- 172.21.15.156:0/717035398 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc010470 con 0x7fe4e8092440 2023-09-30T22:16:15.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.945+0000 7fe4ed0ad700 1 -- 172.21.15.156:0/717035398 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4e8092440 msgr2=0x7fe4e8127910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:15.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.945+0000 7fe4ed0ad700 1 --2- 172.21.15.156:0/717035398 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4e8092440 0x7fe4e8127910 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fe4dc006fd0 tx=0x7fe4dc00b3b0).stop 2023-09-30T22:16:15.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.945+0000 7fe4ed0ad700 1 -- 172.21.15.156:0/717035398 shutdown_connections 2023-09-30T22:16:15.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.945+0000 7fe4ed0ad700 1 --2- 172.21.15.156:0/717035398 >> v2:172.21.15.156:3300/0 conn(0x7fe4e8127390 0x7fe4e8123f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:15.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.945+0000 7fe4ed0ad700 1 --2- 172.21.15.156:0/717035398 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4e8092440 0x7fe4e8127910 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:15.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.945+0000 7fe4ed0ad700 1 --2- 172.21.15.156:0/717035398 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4e8126f70 0x7fe4e8123a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:15.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.945+0000 7fe4ed0ad700 1 -- 172.21.15.156:0/717035398 >> 172.21.15.156:0/717035398 conn(0x7fe4e809a1c0 msgr2=0x7fe4e809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:15.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.945+0000 7fe4ed0ad700 1 -- 172.21.15.156:0/717035398 shutdown_connections 2023-09-30T22:16:15.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.945+0000 7fe4ed0ad700 1 -- 172.21.15.156:0/717035398 wait complete. 2023-09-30T22:16:15.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.946+0000 7fe4ed0ad700 1 Processor -- start 2023-09-30T22:16:15.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.946+0000 7fe4ed0ad700 1 -- start start 2023-09-30T22:16:15.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.946+0000 7fe4ed0ad700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4e8092440 0x7fe4e8114400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:15.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.946+0000 7fe4ed0ad700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4e8126f70 0x7fe4e81148f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:15.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.946+0000 7fe4ed0ad700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4e8127390 0x7fe4e8114de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:15.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.946+0000 7fe4ed0ad700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e81141a0 con 0x7fe4e8092440 2023-09-30T22:16:15.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.946+0000 7fe4ed0ad700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e8121810 con 0x7fe4e8126f70 2023-09-30T22:16:15.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.946+0000 7fe4ed0ad700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e8125390 con 0x7fe4e8127390 2023-09-30T22:16:15.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.947+0000 7fe4e759e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4e8127390 0x7fe4e8114de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:15.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.947+0000 7fe4e6d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4e8092440 0x7fe4e8114400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:15.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.947+0000 7fe4e759e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4e8127390 0x7fe4e8114de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53488/0 (socket says 172.21.15.156:53488) 2023-09-30T22:16:15.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.947+0000 7fe4e759e700 1 -- 172.21.15.156:0/2952748500 learned_addr learned my addr 172.21.15.156:0/2952748500 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:15.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.947+0000 7fe4e6d9d700 1 --2- 172.21.15.156:0/2952748500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4e8092440 0x7fe4e8114400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41696/0 (socket says 172.21.15.156:41696) 2023-09-30T22:16:15.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.947+0000 7fe4e659c700 1 --2- 172.21.15.156:0/2952748500 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4e8126f70 0x7fe4e81148f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:15.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.947+0000 7fe4e759e700 1 -- 172.21.15.156:0/2952748500 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4e8126f70 msgr2=0x7fe4e81148f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:15.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.947+0000 7fe4e759e700 1 --2- 172.21.15.156:0/2952748500 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4e8126f70 0x7fe4e81148f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:15.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.947+0000 7fe4e759e700 1 -- 172.21.15.156:0/2952748500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4e8092440 msgr2=0x7fe4e8114400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:15.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.947+0000 7fe4e759e700 1 --2- 172.21.15.156:0/2952748500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4e8092440 0x7fe4e8114400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:15.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.947+0000 7fe4e759e700 1 -- 172.21.15.156:0/2952748500 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d80092a0 con 0x7fe4e8127390 2023-09-30T22:16:15.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.947+0000 7fe4e6d9d700 1 --2- 172.21.15.156:0/2952748500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4e8092440 0x7fe4e8114400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:15.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.947+0000 7fe4e759e700 1 --2- 172.21.15.156:0/2952748500 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4e8127390 0x7fe4e8114de0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fe4e0009fc0 tx=0x7fe4e000b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:15.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.947+0000 7fe4ceffd700 1 -- 172.21.15.156:0/2952748500 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e0009d20 con 0x7fe4e8127390 2023-09-30T22:16:15.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.947+0000 7fe4ceffd700 1 -- 172.21.15.156:0/2952748500 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e000f040 con 0x7fe4e8127390 2023-09-30T22:16:15.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.947+0000 7fe4ed0ad700 1 -- 172.21.15.156:0/2952748500 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e0009a20 con 0x7fe4e8127390 2023-09-30T22:16:15.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.947+0000 7fe4ceffd700 1 -- 172.21.15.156:0/2952748500 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e000cde0 con 0x7fe4e8127390 2023-09-30T22:16:15.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.947+0000 7fe4ed0ad700 1 -- 172.21.15.156:0/2952748500 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4dc00b610 con 0x7fe4e8127390 2023-09-30T22:16:15.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.947+0000 7fe4ceffd700 1 -- 172.21.15.156:0/2952748500 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fe4e0013870 con 0x7fe4e8127390 2023-09-30T22:16:15.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.947+0000 7fe4ceffd700 1 -- 172.21.15.156:0/2952748500 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fe4e001da30 con 0x7fe4e8127390 2023-09-30T22:16:15.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.948+0000 7fe4ed0ad700 1 -- 172.21.15.156:0/2952748500 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e8091ba0 con 0x7fe4e8127390 2023-09-30T22:16:15.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:15.950+0000 7fe4ceffd700 1 -- 172.21.15.156:0/2952748500 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fe4e0013d00 con 0x7fe4e8127390 2023-09-30T22:16:16.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.029+0000 7fe4ed0ad700 1 -- 172.21.15.156:0/2952748500 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd new", "uuid": "b682e683-c15a-4bd9-8712-8af96454e9ab", "id": 1} v 0) v1 -- 0x7fe4e8118070 con 0x7fe4e8127390 2023-09-30T22:16:16.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.032+0000 7fe4ceffd700 1 -- 172.21.15.156:0/2952748500 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b682e683-c15a-4bd9-8712-8af96454e9ab", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe4e001dcc0 con 0x7fe4e8127390 2023-09-30T22:16:16.033 INFO:teuthology.orchestra.run.smithi156.stdout:1 2023-09-30T22:16:16.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.032+0000 7fe4ed0ad700 1 -- 172.21.15.156:0/2952748500 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4e8127390 msgr2=0x7fe4e8114de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:16.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.032+0000 7fe4ed0ad700 1 --2- 172.21.15.156:0/2952748500 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4e8127390 0x7fe4e8114de0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fe4e0009fc0 tx=0x7fe4e000b040).stop 2023-09-30T22:16:16.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.033+0000 7fe4ed0ad700 1 -- 172.21.15.156:0/2952748500 shutdown_connections 2023-09-30T22:16:16.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.033+0000 7fe4ed0ad700 1 --2- 172.21.15.156:0/2952748500 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4e8127390 0x7fe4e8114de0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.033+0000 7fe4ed0ad700 1 --2- 172.21.15.156:0/2952748500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4e8092440 0x7fe4e8114400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.033+0000 7fe4ed0ad700 1 --2- 172.21.15.156:0/2952748500 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4e8126f70 0x7fe4e81148f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.033+0000 7fe4ed0ad700 1 -- 172.21.15.156:0/2952748500 >> 172.21.15.156:0/2952748500 conn(0x7fe4e809a1c0 msgr2=0x7fe4e8121a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:16.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.033+0000 7fe4ed0ad700 1 -- 172.21.15.156:0/2952748500 shutdown_connections 2023-09-30T22:16:16.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.033+0000 7fe4ed0ad700 1 -- 172.21.15.156:0/2952748500 wait complete. 2023-09-30T22:16:16.045 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new 960dbaf0-2e0c-437e-9114-bc22ce522b26 2 2023-09-30T22:16:16.141 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:16:16.140+0000 7fdccb509680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-30T22:16:16.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.161+0000 7f2d921a1700 1 Processor -- start 2023-09-30T22:16:16.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.161+0000 7f2d921a1700 1 -- start start 2023-09-30T22:16:16.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.162+0000 7f2d921a1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2d8c095da0 0x7f2d8c0961c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:16.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.162+0000 7f2d921a1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d8c0966b0 0x7f2d8c132290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:16.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.162+0000 7f2d921a1700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d8c091980 con 0x7f2d8c062b00 2023-09-30T22:16:16.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.162+0000 7f2d921a1700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d8c0973f0 con 0x7f2d8c095da0 2023-09-30T22:16:16.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.162+0000 7f2d921a1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c062ee0 con 0x7f2d8c0966b0 2023-09-30T22:16:16.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.162+0000 7f2d8bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d8c0966b0 0x7f2d8c132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:16.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.162+0000 7f2d83fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2d8c095da0 0x7f2d8c0961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:16.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.162+0000 7f2d8bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d8c0966b0 0x7f2d8c132290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:47846/0 (socket says 172.21.15.156:47846) 2023-09-30T22:16:16.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.162+0000 7f2d8bfff700 1 -- 172.21.15.156:0/2368694705 learned_addr learned my addr 172.21.15.156:0/2368694705 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:16.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.162+0000 7f2d8b7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f2d8c062b00 0x7f2d8c095690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:41458/0 (socket says 172.21.15.156:41458) 2023-09-30T22:16:16.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.162+0000 7f2d8bfff700 1 -- 172.21.15.156:0/2368694705 >> v2:172.21.15.156:3300/0 conn(0x7f2d8c095da0 msgr2=0x7f2d8c0961c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:16.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.162+0000 7f2d8bfff700 1 --2- 172.21.15.156:0/2368694705 >> v2:172.21.15.156:3300/0 conn(0x7f2d8c095da0 0x7f2d8c0961c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.162+0000 7f2d8bfff700 1 -- 172.21.15.156:0/2368694705 >> v1:172.21.15.156:6789/0 conn(0x7f2d8c062b00 legacy=0x7f2d8c095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:16.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.162+0000 7f2d8affd700 1 -- 172.21.15.156:0/2368694705 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3322594037 0 0) 0x7f2d8c091980 con 0x7f2d8c062b00 2023-09-30T22:16:16.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.162+0000 7f2d8bfff700 1 -- 172.21.15.156:0/2368694705 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8c092310 con 0x7f2d8c0966b0 2023-09-30T22:16:16.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.162+0000 7f2d83fff700 1 --2- 172.21.15.156:0/2368694705 >> v2:172.21.15.156:3300/0 conn(0x7f2d8c095da0 0x7f2d8c0961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:16.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.162+0000 7f2d8bfff700 1 --2- 172.21.15.156:0/2368694705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d8c0966b0 0x7f2d8c132290 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f2d84009f20 tx=0x7f2d84009840).ready entity=mon.1 client_cookie=9d1ab9421689016b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:16.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.163+0000 7f2d8affd700 1 -- 172.21.15.156:0/2368694705 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8400e070 con 0x7f2d8c0966b0 2023-09-30T22:16:16.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.163+0000 7f2d8affd700 1 -- 172.21.15.156:0/2368694705 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8400b9d0 con 0x7f2d8c0966b0 2023-09-30T22:16:16.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.163+0000 7f2d8affd700 1 -- 172.21.15.156:0/2368694705 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8400bd50 con 0x7f2d8c0966b0 2023-09-30T22:16:16.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.163+0000 7f2d921a1700 1 -- 172.21.15.156:0/2368694705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d8c0966b0 msgr2=0x7f2d8c132290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:16.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.163+0000 7f2d921a1700 1 --2- 172.21.15.156:0/2368694705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d8c0966b0 0x7f2d8c132290 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f2d84009f20 tx=0x7f2d84009840).stop 2023-09-30T22:16:16.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.163+0000 7f2d921a1700 1 -- 172.21.15.156:0/2368694705 shutdown_connections 2023-09-30T22:16:16.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.163+0000 7f2d921a1700 1 --2- 172.21.15.156:0/2368694705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d8c0966b0 0x7f2d8c132290 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.163+0000 7f2d921a1700 1 --2- 172.21.15.156:0/2368694705 >> v2:172.21.15.156:3300/0 conn(0x7f2d8c095da0 0x7f2d8c0961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.163+0000 7f2d921a1700 1 -- 172.21.15.156:0/2368694705 >> 172.21.15.156:0/2368694705 conn(0x7f2d8c09aa50 msgr2=0x7f2d8c09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:16.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.163+0000 7f2d921a1700 1 -- 172.21.15.156:0/2368694705 shutdown_connections 2023-09-30T22:16:16.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.163+0000 7f2d921a1700 1 -- 172.21.15.156:0/2368694705 wait complete. 2023-09-30T22:16:16.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.164+0000 7f2d921a1700 1 Processor -- start 2023-09-30T22:16:16.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.164+0000 7f2d921a1700 1 -- start start 2023-09-30T22:16:16.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.165+0000 7f2d921a1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d8c062b00 0x7f2d8c1151f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:16.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.165+0000 7f2d921a1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d8c095da0 0x7f2d8c1156e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:16.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.165+0000 7f2d921a1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d8c0966b0 0x7f2d8c115bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:16.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.165+0000 7f2d921a1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c12d330 con 0x7f2d8c0966b0 2023-09-30T22:16:16.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.165+0000 7f2d921a1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c117820 con 0x7f2d8c062b00 2023-09-30T22:16:16.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.165+0000 7f2d921a1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c096da0 con 0x7f2d8c095da0 2023-09-30T22:16:16.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.165+0000 7f2d8bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d8c0966b0 0x7f2d8c115bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:16.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.165+0000 7f2d83fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d8c095da0 0x7f2d8c1156e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:16.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.165+0000 7f2d8bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d8c0966b0 0x7f2d8c115bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41736/0 (socket says 172.21.15.156:41736) 2023-09-30T22:16:16.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.165+0000 7f2d8bfff700 1 -- 172.21.15.156:0/996339924 learned_addr learned my addr 172.21.15.156:0/996339924 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:16.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.165+0000 7f2d8b7fe700 1 --2- 172.21.15.156:0/996339924 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d8c062b00 0x7f2d8c1151f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:16.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.165+0000 7f2d8bfff700 1 -- 172.21.15.156:0/996339924 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d8c095da0 msgr2=0x7f2d8c1156e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:16.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.165+0000 7f2d8bfff700 1 --2- 172.21.15.156:0/996339924 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d8c095da0 0x7f2d8c1156e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.165+0000 7f2d8bfff700 1 -- 172.21.15.156:0/996339924 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d8c062b00 msgr2=0x7f2d8c1151f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:16.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.165+0000 7f2d8bfff700 1 --2- 172.21.15.156:0/996339924 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d8c062b00 0x7f2d8c1151f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.165+0000 7f2d8bfff700 1 -- 172.21.15.156:0/996339924 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d740092a0 con 0x7f2d8c0966b0 2023-09-30T22:16:16.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.165+0000 7f2d83fff700 1 --2- 172.21.15.156:0/996339924 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d8c095da0 0x7f2d8c1156e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:16.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.165+0000 7f2d8bfff700 1 --2- 172.21.15.156:0/996339924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d8c0966b0 0x7f2d8c115bd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f2d8400b610 tx=0x7f2d84009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:16.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.165+0000 7f2d837fe700 1 -- 172.21.15.156:0/996339924 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d840092e0 con 0x7f2d8c0966b0 2023-09-30T22:16:16.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.165+0000 7f2d837fe700 1 -- 172.21.15.156:0/996339924 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d84007610 con 0x7f2d8c0966b0 2023-09-30T22:16:16.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.165+0000 7f2d921a1700 1 -- 172.21.15.156:0/996339924 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d84009ae0 con 0x7f2d8c0966b0 2023-09-30T22:16:16.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.165+0000 7f2d837fe700 1 -- 172.21.15.156:0/996339924 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d840079d0 con 0x7f2d8c0966b0 2023-09-30T22:16:16.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.165+0000 7f2d921a1700 1 -- 172.21.15.156:0/996339924 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d8c119370 con 0x7f2d8c0966b0 2023-09-30T22:16:16.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.166+0000 7f2d837fe700 1 -- 172.21.15.156:0/996339924 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f2d84003040 con 0x7f2d8c0966b0 2023-09-30T22:16:16.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.166+0000 7f2d837fe700 1 -- 172.21.15.156:0/996339924 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f2d8401fae0 con 0x7f2d8c0966b0 2023-09-30T22:16:16.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.166+0000 7f2d921a1700 1 -- 172.21.15.156:0/996339924 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d8c0997d0 con 0x7f2d8c0966b0 2023-09-30T22:16:16.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.169+0000 7f2d837fe700 1 -- 172.21.15.156:0/996339924 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f2d84024070 con 0x7f2d8c0966b0 2023-09-30T22:16:16.216 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:16:16.215+0000 7fdccb509680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-30T22:16:16.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.249+0000 7f2d921a1700 1 -- 172.21.15.156:0/996339924 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd new", "uuid": "960dbaf0-2e0c-437e-9114-bc22ce522b26", "id": 2} v 0) v1 -- 0x7f2d8c05a260 con 0x7f2d8c0966b0 2023-09-30T22:16:16.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.251+0000 7f2d837fe700 1 -- 172.21.15.156:0/996339924 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "960dbaf0-2e0c-437e-9114-bc22ce522b26", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2d8401fd70 con 0x7f2d8c0966b0 2023-09-30T22:16:16.252 INFO:teuthology.orchestra.run.smithi156.stdout:2 2023-09-30T22:16:16.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.252+0000 7f2d921a1700 1 -- 172.21.15.156:0/996339924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d8c0966b0 msgr2=0x7f2d8c115bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:16.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.252+0000 7f2d921a1700 1 --2- 172.21.15.156:0/996339924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d8c0966b0 0x7f2d8c115bd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f2d8400b610 tx=0x7f2d84009840).stop 2023-09-30T22:16:16.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.252+0000 7f2d921a1700 1 -- 172.21.15.156:0/996339924 shutdown_connections 2023-09-30T22:16:16.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.252+0000 7f2d921a1700 1 --2- 172.21.15.156:0/996339924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d8c0966b0 0x7f2d8c115bd0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.252+0000 7f2d921a1700 1 --2- 172.21.15.156:0/996339924 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d8c062b00 0x7f2d8c1151f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.252+0000 7f2d921a1700 1 --2- 172.21.15.156:0/996339924 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d8c095da0 0x7f2d8c1156e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.252+0000 7f2d921a1700 1 -- 172.21.15.156:0/996339924 >> 172.21.15.156:0/996339924 conn(0x7f2d8c09aa50 msgr2=0x7f2d8c131f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:16.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.252+0000 7f2d921a1700 1 -- 172.21.15.156:0/996339924 shutdown_connections 2023-09-30T22:16:16.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.253+0000 7f2d921a1700 1 -- 172.21.15.156:0/996339924 wait complete. 2023-09-30T22:16:16.264 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new c1b19714-78b1-4869-8721-2f6352a64a05 3 2023-09-30T22:16:16.308 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:16:16.308+0000 7fdccb509680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-30T22:16:16.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.384+0000 7f5146ad5700 1 Processor -- start 2023-09-30T22:16:16.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.384+0000 7f5146ad5700 1 -- start start 2023-09-30T22:16:16.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.385+0000 7f5146ad5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5140062b00 0x7f5140095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:16.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.385+0000 7f5146ad5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f51400966b0 0x7f5140132290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:16.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.385+0000 7f5146ad5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5140091980 con 0x7f5140095b80 2023-09-30T22:16:16.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.385+0000 7f5146ad5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51400973f0 con 0x7f51400966b0 2023-09-30T22:16:16.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.385+0000 7f5146ad5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5140062ee0 con 0x7f5140062b00 2023-09-30T22:16:16.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.385+0000 7f5144871700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5140062b00 0x7f5140095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:16.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.385+0000 7f5145072700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f51400966b0 0x7f5140132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:16.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.385+0000 7f513ffff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f5140095b80 0x7f5140095fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:41464/0 (socket says 172.21.15.156:41464) 2023-09-30T22:16:16.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.385+0000 7f5144871700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5140062b00 0x7f5140095690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:47864/0 (socket says 172.21.15.156:47864) 2023-09-30T22:16:16.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.385+0000 7f513ffff700 1 -- 172.21.15.156:0/2122878046 learned_addr learned my addr 172.21.15.156:0/2122878046 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:16.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.385+0000 7f5144871700 1 -- 172.21.15.156:0/2122878046 >> v2:172.21.15.156:3300/0 conn(0x7f51400966b0 msgr2=0x7f5140132290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:16.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.385+0000 7f5144871700 1 --2- 172.21.15.156:0/2122878046 >> v2:172.21.15.156:3300/0 conn(0x7f51400966b0 0x7f5140132290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.385+0000 7f5144871700 1 -- 172.21.15.156:0/2122878046 >> v1:172.21.15.156:6789/0 conn(0x7f5140095b80 legacy=0x7f5140095fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:16.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.385+0000 7f5144871700 1 -- 172.21.15.156:0/2122878046 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5140092310 con 0x7f5140062b00 2023-09-30T22:16:16.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.385+0000 7f513f7fe700 1 -- 172.21.15.156:0/2122878046 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2790619661 0 0) 0x7f5140091980 con 0x7f5140095b80 2023-09-30T22:16:16.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.385+0000 7f5145072700 1 --2- 172.21.15.156:0/2122878046 >> v2:172.21.15.156:3300/0 conn(0x7f51400966b0 0x7f5140132290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:16.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.385+0000 7f5144871700 1 --2- 172.21.15.156:0/2122878046 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5140062b00 0x7f5140095690 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f5134009790 tx=0x7f5134009060).ready entity=mon.1 client_cookie=39588a5b62658f12 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:16.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.385+0000 7f513f7fe700 1 -- 172.21.15.156:0/2122878046 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513400f510 con 0x7f5140062b00 2023-09-30T22:16:16.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.385+0000 7f513f7fe700 1 -- 172.21.15.156:0/2122878046 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513400f670 con 0x7f5140062b00 2023-09-30T22:16:16.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.385+0000 7f513f7fe700 1 -- 172.21.15.156:0/2122878046 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513400f9f0 con 0x7f5140062b00 2023-09-30T22:16:16.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.386+0000 7f5146ad5700 1 -- 172.21.15.156:0/2122878046 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5140062b00 msgr2=0x7f5140095690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:16.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.386+0000 7f5146ad5700 1 --2- 172.21.15.156:0/2122878046 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5140062b00 0x7f5140095690 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f5134009790 tx=0x7f5134009060).stop 2023-09-30T22:16:16.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.386+0000 7f5146ad5700 1 -- 172.21.15.156:0/2122878046 shutdown_connections 2023-09-30T22:16:16.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.386+0000 7f5146ad5700 1 --2- 172.21.15.156:0/2122878046 >> v2:172.21.15.156:3300/0 conn(0x7f51400966b0 0x7f5140132290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.386+0000 7f5146ad5700 1 --2- 172.21.15.156:0/2122878046 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5140062b00 0x7f5140095690 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.386+0000 7f5146ad5700 1 -- 172.21.15.156:0/2122878046 >> 172.21.15.156:0/2122878046 conn(0x7f514009aa50 msgr2=0x7f514009ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:16.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.386+0000 7f5146ad5700 1 -- 172.21.15.156:0/2122878046 shutdown_connections 2023-09-30T22:16:16.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.386+0000 7f5146ad5700 1 -- 172.21.15.156:0/2122878046 wait complete. 2023-09-30T22:16:16.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.387+0000 7f5146ad5700 1 Processor -- start 2023-09-30T22:16:16.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.388+0000 7f5146ad5700 1 -- start start 2023-09-30T22:16:16.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.388+0000 7f5146ad5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5140062b00 0x7f514012d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:16.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.388+0000 7f5146ad5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5140095b80 0x7f51401157c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:16.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.388+0000 7f5146ad5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f51400966b0 0x7f5140115cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:16.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.388+0000 7f5146ad5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51401178b0 con 0x7f5140062b00 2023-09-30T22:16:16.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.388+0000 7f5146ad5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5140096da0 con 0x7f5140095b80 2023-09-30T22:16:16.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.388+0000 7f5146ad5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5140118c30 con 0x7f51400966b0 2023-09-30T22:16:16.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.388+0000 7f5144871700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5140062b00 0x7f514012d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:16.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.388+0000 7f513ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5140095b80 0x7f51401157c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:16.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.388+0000 7f5145072700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f51400966b0 0x7f5140115cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:16.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.388+0000 7f5144871700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5140062b00 0x7f514012d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41754/0 (socket says 172.21.15.156:41754) 2023-09-30T22:16:16.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.388+0000 7f5144871700 1 -- 172.21.15.156:0/848171518 learned_addr learned my addr 172.21.15.156:0/848171518 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:16.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.388+0000 7f513ffff700 1 -- 172.21.15.156:0/848171518 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f51400966b0 msgr2=0x7f5140115cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:16.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.389+0000 7f513ffff700 1 --2- 172.21.15.156:0/848171518 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f51400966b0 0x7f5140115cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.389+0000 7f513ffff700 1 -- 172.21.15.156:0/848171518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5140062b00 msgr2=0x7f514012d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:16.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.389+0000 7f513ffff700 1 --2- 172.21.15.156:0/848171518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5140062b00 0x7f514012d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.389+0000 7f513ffff700 1 -- 172.21.15.156:0/848171518 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5138009a20 con 0x7f5140095b80 2023-09-30T22:16:16.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.389+0000 7f5144871700 1 --2- 172.21.15.156:0/848171518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5140062b00 0x7f514012d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:16.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.389+0000 7f5145072700 1 --2- 172.21.15.156:0/848171518 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f51400966b0 0x7f5140115cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:16.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.389+0000 7f513ffff700 1 --2- 172.21.15.156:0/848171518 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5140095b80 0x7f51401157c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f512c000c00 tx=0x7f512c007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:16.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.389+0000 7f513cff9700 1 -- 172.21.15.156:0/848171518 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c0070d0 con 0x7f5140095b80 2023-09-30T22:16:16.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.389+0000 7f513cff9700 1 -- 172.21.15.156:0/848171518 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512c007250 con 0x7f5140095b80 2023-09-30T22:16:16.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.389+0000 7f5146ad5700 1 -- 172.21.15.156:0/848171518 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51340092a0 con 0x7f5140095b80 2023-09-30T22:16:16.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.389+0000 7f513cff9700 1 -- 172.21.15.156:0/848171518 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c007610 con 0x7f5140095b80 2023-09-30T22:16:16.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.389+0000 7f5146ad5700 1 -- 172.21.15.156:0/848171518 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5140119870 con 0x7f5140095b80 2023-09-30T22:16:16.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.389+0000 7f513cff9700 1 -- 172.21.15.156:0/848171518 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f512c005c10 con 0x7f5140095b80 2023-09-30T22:16:16.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.389+0000 7f513cff9700 1 -- 172.21.15.156:0/848171518 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f512c013c60 con 0x7f5140095b80 2023-09-30T22:16:16.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.390+0000 7f5146ad5700 1 -- 172.21.15.156:0/848171518 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514005a260 con 0x7f5140095b80 2023-09-30T22:16:16.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.392+0000 7f513cff9700 1 -- 172.21.15.156:0/848171518 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f512c0137c0 con 0x7f5140095b80 2023-09-30T22:16:16.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.472+0000 7f5146ad5700 1 -- 172.21.15.156:0/848171518 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c1b19714-78b1-4869-8721-2f6352a64a05", "id": 3} v 0) v1 -- 0x7f51401165c0 con 0x7f5140095b80 2023-09-30T22:16:16.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.475+0000 7f513cff9700 1 -- 172.21.15.156:0/848171518 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c1b19714-78b1-4869-8721-2f6352a64a05", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f512c013a00 con 0x7f5140095b80 2023-09-30T22:16:16.475 INFO:teuthology.orchestra.run.smithi156.stdout:3 2023-09-30T22:16:16.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.476+0000 7f5146ad5700 1 -- 172.21.15.156:0/848171518 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5140095b80 msgr2=0x7f51401157c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:16.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.476+0000 7f5146ad5700 1 --2- 172.21.15.156:0/848171518 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5140095b80 0x7f51401157c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f512c000c00 tx=0x7f512c007b90).stop 2023-09-30T22:16:16.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.476+0000 7f5146ad5700 1 -- 172.21.15.156:0/848171518 shutdown_connections 2023-09-30T22:16:16.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.476+0000 7f5146ad5700 1 --2- 172.21.15.156:0/848171518 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f51400966b0 0x7f5140115cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.476+0000 7f5146ad5700 1 --2- 172.21.15.156:0/848171518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5140062b00 0x7f514012d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.476+0000 7f5146ad5700 1 --2- 172.21.15.156:0/848171518 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5140095b80 0x7f51401157c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.476+0000 7f5146ad5700 1 -- 172.21.15.156:0/848171518 >> 172.21.15.156:0/848171518 conn(0x7f514009aa50 msgr2=0x7f5140098880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:16.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.476+0000 7f5146ad5700 1 -- 172.21.15.156:0/848171518 shutdown_connections 2023-09-30T22:16:16.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.476+0000 7f5146ad5700 1 -- 172.21.15.156:0/848171518 wait complete. 2023-09-30T22:16:16.488 INFO:tasks.ceph.osd.0:Restarting daemon 2023-09-30T22:16:16.488 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-09-30T22:16:16.490 INFO:tasks.ceph.osd.0:Started 2023-09-30T22:16:16.490 INFO:tasks.ceph.osd.1:Restarting daemon 2023-09-30T22:16:16.490 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-09-30T22:16:16.492 INFO:tasks.ceph.osd.1:Started 2023-09-30T22:16:16.492 INFO:tasks.ceph.osd.2:Restarting daemon 2023-09-30T22:16:16.492 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-09-30T22:16:16.494 INFO:tasks.ceph.osd.2:Started 2023-09-30T22:16:16.494 INFO:tasks.ceph.osd.3:Restarting daemon 2023-09-30T22:16:16.494 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-09-30T22:16:16.496 INFO:tasks.ceph.osd.3:Started 2023-09-30T22:16:16.496 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:16:16.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.661+0000 7f9f1380f700 1 Processor -- start 2023-09-30T22:16:16.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.661+0000 7f9f1380f700 1 -- start start 2023-09-30T22:16:16.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.661+0000 7f9f1380f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f0c062b00 0x7f9f0c095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:16.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.661+0000 7f9f1380f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9f0c095b80 0x7f9f0c095fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:16.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.661+0000 7f9f1380f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f0c096490 0x7f9f0c131280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:16.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.661+0000 7f9f1380f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f0c0973f0 con 0x7f9f0c095b80 2023-09-30T22:16:16.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.661+0000 7f9f1380f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c062ee0 con 0x7f9f0c096490 2023-09-30T22:16:16.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.661+0000 7f9f1380f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c091980 con 0x7f9f0c062b00 2023-09-30T22:16:16.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.662+0000 7f9f115ab700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f0c062b00 0x7f9f0c095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:16.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.662+0000 7f9f10daa700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9f0c095b80 0x7f9f0c095fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:16.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.662+0000 7f9f11dac700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f0c096490 0x7f9f0c131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:16.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.662+0000 7f9f115ab700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f0c062b00 0x7f9f0c095690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53544/0 (socket says 172.21.15.156:53544) 2023-09-30T22:16:16.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.662+0000 7f9f115ab700 1 -- 172.21.15.156:0/1901840657 learned_addr learned my addr 172.21.15.156:0/1901840657 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:16.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.662+0000 7f9f115ab700 1 -- 172.21.15.156:0/1901840657 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f0c096490 msgr2=0x7f9f0c131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:16.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.662+0000 7f9f115ab700 1 --2- 172.21.15.156:0/1901840657 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f0c096490 0x7f9f0c131280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.662+0000 7f9f115ab700 1 -- 172.21.15.156:0/1901840657 >> v2:172.21.15.156:3300/0 conn(0x7f9f0c095b80 msgr2=0x7f9f0c095fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:16.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.662+0000 7f9f115ab700 1 --2- 172.21.15.156:0/1901840657 >> v2:172.21.15.156:3300/0 conn(0x7f9f0c095b80 0x7f9f0c095fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.662+0000 7f9f115ab700 1 -- 172.21.15.156:0/1901840657 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0c092310 con 0x7f9f0c062b00 2023-09-30T22:16:16.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.662+0000 7f9f10daa700 1 --2- 172.21.15.156:0/1901840657 >> v2:172.21.15.156:3300/0 conn(0x7f9f0c095b80 0x7f9f0c095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:16.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.662+0000 7f9f11dac700 1 --2- 172.21.15.156:0/1901840657 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f0c096490 0x7f9f0c131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:16.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.662+0000 7f9f115ab700 1 --2- 172.21.15.156:0/1901840657 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f0c062b00 0x7f9f0c095690 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f9f08009830 tx=0x7f9f080090f0).ready entity=mon.2 client_cookie=fea2a482d5366e32 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:16.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.662+0000 7f9f03fff700 1 -- 172.21.15.156:0/1901840657 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0800f510 con 0x7f9f0c062b00 2023-09-30T22:16:16.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.662+0000 7f9f03fff700 1 -- 172.21.15.156:0/1901840657 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0800f670 con 0x7f9f0c062b00 2023-09-30T22:16:16.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.662+0000 7f9f03fff700 1 -- 172.21.15.156:0/1901840657 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0800f9f0 con 0x7f9f0c062b00 2023-09-30T22:16:16.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.663+0000 7f9f1380f700 1 -- 172.21.15.156:0/1901840657 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f0c062b00 msgr2=0x7f9f0c095690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:16.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.663+0000 7f9f1380f700 1 --2- 172.21.15.156:0/1901840657 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f0c062b00 0x7f9f0c095690 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f9f08009830 tx=0x7f9f080090f0).stop 2023-09-30T22:16:16.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.663+0000 7f9f1380f700 1 -- 172.21.15.156:0/1901840657 shutdown_connections 2023-09-30T22:16:16.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.663+0000 7f9f1380f700 1 --2- 172.21.15.156:0/1901840657 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f0c096490 0x7f9f0c131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.663+0000 7f9f1380f700 1 --2- 172.21.15.156:0/1901840657 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f0c062b00 0x7f9f0c095690 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.663+0000 7f9f1380f700 1 --2- 172.21.15.156:0/1901840657 >> v2:172.21.15.156:3300/0 conn(0x7f9f0c095b80 0x7f9f0c095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.663+0000 7f9f1380f700 1 -- 172.21.15.156:0/1901840657 >> 172.21.15.156:0/1901840657 conn(0x7f9f0c09aa50 msgr2=0x7f9f0c09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:16.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.663+0000 7f9f1380f700 1 -- 172.21.15.156:0/1901840657 shutdown_connections 2023-09-30T22:16:16.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.663+0000 7f9f1380f700 1 -- 172.21.15.156:0/1901840657 wait complete. 2023-09-30T22:16:16.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.664+0000 7f9f1380f700 1 Processor -- start 2023-09-30T22:16:16.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.664+0000 7f9f1380f700 1 -- start start 2023-09-30T22:16:16.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.664+0000 7f9f1380f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f0c062b00 0x7f9f0c11a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:16.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.664+0000 7f9f1380f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f0c095b80 0x7f9f0c116880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:16.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.664+0000 7f9f1380f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f0c096490 0x7f9f0c116d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:16.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.664+0000 7f9f1380f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c096da0 con 0x7f9f0c095b80 2023-09-30T22:16:16.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.664+0000 7f9f1380f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c12da40 con 0x7f9f0c062b00 2023-09-30T22:16:16.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.664+0000 7f9f1380f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c11a3b0 con 0x7f9f0c096490 2023-09-30T22:16:16.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.664+0000 7f9f10daa700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f0c095b80 0x7f9f0c116880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:16.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.665+0000 7f9f10daa700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f0c095b80 0x7f9f0c116880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41790/0 (socket says 172.21.15.156:41790) 2023-09-30T22:16:16.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.665+0000 7f9f11dac700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f0c096490 0x7f9f0c116d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:16.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.665+0000 7f9f10daa700 1 -- 172.21.15.156:0/2328817462 learned_addr learned my addr 172.21.15.156:0/2328817462 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:16.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.665+0000 7f9f115ab700 1 --2- 172.21.15.156:0/2328817462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f0c062b00 0x7f9f0c11a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:16.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.665+0000 7f9f11dac700 1 -- 172.21.15.156:0/2328817462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f0c062b00 msgr2=0x7f9f0c11a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:16.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.665+0000 7f9f11dac700 1 --2- 172.21.15.156:0/2328817462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f0c062b00 0x7f9f0c11a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.665+0000 7f9f11dac700 1 -- 172.21.15.156:0/2328817462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f0c095b80 msgr2=0x7f9f0c116880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:16.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.665+0000 7f9f11dac700 1 --2- 172.21.15.156:0/2328817462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f0c095b80 0x7f9f0c116880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.665+0000 7f9f11dac700 1 -- 172.21.15.156:0/2328817462 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9efc0092a0 con 0x7f9f0c096490 2023-09-30T22:16:16.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.665+0000 7f9f10daa700 1 --2- 172.21.15.156:0/2328817462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f0c095b80 0x7f9f0c116880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:16.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.665+0000 7f9f11dac700 1 --2- 172.21.15.156:0/2328817462 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f0c096490 0x7f9f0c116d70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f9f04009f10 tx=0x7f9f0400b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:16.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.665+0000 7f9f017fa700 1 -- 172.21.15.156:0/2328817462 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0400cb70 con 0x7f9f0c096490 2023-09-30T22:16:16.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.665+0000 7f9f017fa700 1 -- 172.21.15.156:0/2328817462 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0400f040 con 0x7f9f0c096490 2023-09-30T22:16:16.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.665+0000 7f9f017fa700 1 -- 172.21.15.156:0/2328817462 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f04013400 con 0x7f9f0c096490 2023-09-30T22:16:16.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.665+0000 7f9f1380f700 1 -- 172.21.15.156:0/2328817462 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f04009a20 con 0x7f9f0c096490 2023-09-30T22:16:16.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.665+0000 7f9f1380f700 1 -- 172.21.15.156:0/2328817462 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f08009370 con 0x7f9f0c096490 2023-09-30T22:16:16.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.665+0000 7f9f017fa700 1 -- 172.21.15.156:0/2328817462 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f9f04013a50 con 0x7f9f0c096490 2023-09-30T22:16:16.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.665+0000 7f9f017fa700 1 -- 172.21.15.156:0/2328817462 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f9f040088b0 con 0x7f9f0c096490 2023-09-30T22:16:16.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.666+0000 7f9f1380f700 1 -- 172.21.15.156:0/2328817462 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f0c119fd0 con 0x7f9f0c096490 2023-09-30T22:16:16.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.668+0000 7f9f017fa700 1 -- 172.21.15.156:0/2328817462 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f9f04008c10 con 0x7f9f0c096490 2023-09-30T22:16:16.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.735+0000 7f9f1380f700 1 -- 172.21.15.156:0/2328817462 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f0c05a260 con 0x7f9f0c096490 2023-09-30T22:16:16.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.735+0000 7f9f017fa700 1 -- 172.21.15.156:0/2328817462 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4109 (secure 0 0 0) 0x7f9f04008db0 con 0x7f9f0c096490 2023-09-30T22:16:16.736 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:16.736 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":6,"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","created":"2023-09-30T22:16:15.239992+0000","modified":"2023-09-30T22:16:16.474206+0000","last_up_change":"0.000000","last_in_change":"2023-09-30T22:16:16.474206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"3ec2e78a-c61f-473a-bfcb-f956cffe4095","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b682e683-c15a-4bd9-8712-8af96454e9ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"960dbaf0-2e0c-437e-9114-bc22ce522b26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c1b19714-78b1-4869-8721-2f6352a64a05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:16:16.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.736+0000 7f9f1380f700 1 -- 172.21.15.156:0/2328817462 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f0c096490 msgr2=0x7f9f0c116d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:16.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.736+0000 7f9f1380f700 1 --2- 172.21.15.156:0/2328817462 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f0c096490 0x7f9f0c116d70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f9f04009f10 tx=0x7f9f0400b040).stop 2023-09-30T22:16:16.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.736+0000 7f9f1380f700 1 -- 172.21.15.156:0/2328817462 shutdown_connections 2023-09-30T22:16:16.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.736+0000 7f9f1380f700 1 --2- 172.21.15.156:0/2328817462 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f0c096490 0x7f9f0c116d70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.736+0000 7f9f1380f700 1 --2- 172.21.15.156:0/2328817462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f0c062b00 0x7f9f0c11a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.736+0000 7f9f1380f700 1 --2- 172.21.15.156:0/2328817462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f0c095b80 0x7f9f0c116880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:16.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.736+0000 7f9f1380f700 1 -- 172.21.15.156:0/2328817462 >> 172.21.15.156:0/2328817462 conn(0x7f9f0c09aa50 msgr2=0x7f9f0c130070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:16.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.737+0000 7f9f1380f700 1 -- 172.21.15.156:0/2328817462 shutdown_connections 2023-09-30T22:16:16.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:16.737+0000 7f9f1380f700 1 -- 172.21.15.156:0/2328817462 wait complete. 2023-09-30T22:16:16.749 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-09-30T22:16:16.749 INFO:tasks.ceph:Waiting for OSDs to come up 2023-09-30T22:16:17.103 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:16:17.103+0000 7fdccb509680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-30T22:16:17.109 INFO:tasks.ceph.osd.3.smithi156.stderr:2023-09-30T22:16:17.107+0000 7f0a50128200 -1 Falling back to public interface 2023-09-30T22:16:17.109 INFO:tasks.ceph.osd.1.smithi156.stderr:2023-09-30T22:16:17.108+0000 7f6af28e4200 -1 Falling back to public interface 2023-09-30T22:16:17.109 INFO:tasks.ceph.osd.3.smithi156.stderr:2023-09-30T22:16:17.108+0000 7f0a4a2d0700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6803/0: (98) Address already in use 2023-09-30T22:16:17.112 INFO:tasks.ceph.osd.2.smithi156.stderr:2023-09-30T22:16:17.111+0000 7fe457628200 -1 Falling back to public interface 2023-09-30T22:16:17.113 INFO:tasks.ceph.osd.0.smithi156.stderr:2023-09-30T22:16:17.112+0000 7fd7c64f4200 -1 Falling back to public interface 2023-09-30T22:16:17.151 DEBUG:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-30T22:16:17.219 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:16:17.219+0000 7fdccb509680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-30T22:16:17.262 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.261+0000 7fa2eb23f700 1 Processor -- start 2023-09-30T22:16:17.262 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.261+0000 7fa2eb23f700 1 -- start start 2023-09-30T22:16:17.264 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.262+0000 7fa2eb23f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2e40661f0 0x7fa2e40973b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:17.264 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.262+0000 7fa2eb23f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2e4127cd0 0x7fa2e4128150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:17.264 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.262+0000 7fa2eb23f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa2e412ab20 0x7fa2e412afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:17.264 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.262+0000 7fa2eb23f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e40665d0 con 0x7fa2e412ab20 2023-09-30T22:16:17.265 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.262+0000 7fa2eb23f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e4064a30 con 0x7fa2e4127cd0 2023-09-30T22:16:17.265 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.262+0000 7fa2eb23f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e4127a30 con 0x7fa2e40661f0 2023-09-30T22:16:17.265 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.262+0000 7fa2e8fdb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2e40661f0 0x7fa2e40973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:17.265 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.262+0000 7fa2e97dc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa2e412ab20 0x7fa2e412afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:17.265 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.262+0000 7fa2e8fdb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2e40661f0 0x7fa2e40973b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53568/0 (socket says 172.21.15.156:53568) 2023-09-30T22:16:17.265 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.262+0000 7fa2e8fdb700 1 -- 172.21.15.156:0/1599762580 learned_addr learned my addr 172.21.15.156:0/1599762580 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:17.265 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.262+0000 7fa2e3fff700 1 --2- 172.21.15.156:0/1599762580 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2e4127cd0 0x7fa2e4128150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:17.265 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.262+0000 7fa2e97dc700 1 -- 172.21.15.156:0/1599762580 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2e40661f0 msgr2=0x7fa2e40973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:17.265 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.262+0000 7fa2e97dc700 1 --2- 172.21.15.156:0/1599762580 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2e40661f0 0x7fa2e40973b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:17.265 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.262+0000 7fa2e97dc700 1 -- 172.21.15.156:0/1599762580 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2e4127cd0 msgr2=0x7fa2e4128150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:17.265 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.262+0000 7fa2e97dc700 1 --2- 172.21.15.156:0/1599762580 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2e4127cd0 0x7fa2e4128150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:17.265 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.262+0000 7fa2e97dc700 1 -- 172.21.15.156:0/1599762580 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e40981c0 con 0x7fa2e412ab20 2023-09-30T22:16:17.266 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.262+0000 7fa2e8fdb700 1 --2- 172.21.15.156:0/1599762580 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2e40661f0 0x7fa2e40973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:17.266 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.262+0000 7fa2e97dc700 1 --2- 172.21.15.156:0/1599762580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2e412ab20 0x7fa2e412afd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fa2dc009e60 tx=0x7fa2dc009780).ready entity=mon.0 client_cookie=db3194e9bb8c3af8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:17.266 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.263+0000 7fa2e37fe700 1 -- 172.21.15.156:0/1599762580 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc00e070 con 0x7fa2e412ab20 2023-09-30T22:16:17.266 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.263+0000 7fa2e37fe700 1 -- 172.21.15.156:0/1599762580 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2dc00bab0 con 0x7fa2e412ab20 2023-09-30T22:16:17.266 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.263+0000 7fa2e37fe700 1 -- 172.21.15.156:0/1599762580 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc00be30 con 0x7fa2e412ab20 2023-09-30T22:16:17.266 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.263+0000 7fa2eb23f700 1 -- 172.21.15.156:0/1599762580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2e412ab20 msgr2=0x7fa2e412afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:17.266 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.263+0000 7fa2eb23f700 1 --2- 172.21.15.156:0/1599762580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2e412ab20 0x7fa2e412afd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fa2dc009e60 tx=0x7fa2dc009780).stop 2023-09-30T22:16:17.266 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.263+0000 7fa2eb23f700 1 -- 172.21.15.156:0/1599762580 shutdown_connections 2023-09-30T22:16:17.266 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.263+0000 7fa2eb23f700 1 --2- 172.21.15.156:0/1599762580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2e412ab20 0x7fa2e412afd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:17.266 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.263+0000 7fa2eb23f700 1 --2- 172.21.15.156:0/1599762580 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2e40661f0 0x7fa2e40973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:17.266 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.263+0000 7fa2eb23f700 1 --2- 172.21.15.156:0/1599762580 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2e4127cd0 0x7fa2e4128150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:17.266 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.263+0000 7fa2eb23f700 1 -- 172.21.15.156:0/1599762580 >> 172.21.15.156:0/1599762580 conn(0x7fa2e409ba00 msgr2=0x7fa2e409be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:17.267 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.263+0000 7fa2eb23f700 1 -- 172.21.15.156:0/1599762580 shutdown_connections 2023-09-30T22:16:17.267 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.263+0000 7fa2eb23f700 1 -- 172.21.15.156:0/1599762580 wait complete. 2023-09-30T22:16:17.269 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.264+0000 7fa2eb23f700 1 Processor -- start 2023-09-30T22:16:17.269 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.265+0000 7fa2eb23f700 1 -- start start 2023-09-30T22:16:17.269 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.265+0000 7fa2eb23f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2e40661f0 0x7fa2e4113c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:17.269 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.265+0000 7fa2eb23f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2e4127cd0 0x7fa2e41140f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:17.269 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.265+0000 7fa2eb23f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2e412ab20 0x7fa2e41145e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:17.269 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.265+0000 7fa2eb23f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e41170d0 con 0x7fa2e40661f0 2023-09-30T22:16:17.269 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.266+0000 7fa2eb23f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e4065130 con 0x7fa2e412ab20 2023-09-30T22:16:17.269 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.266+0000 7fa2eb23f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e4099ea0 con 0x7fa2e4127cd0 2023-09-30T22:16:17.269 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.266+0000 7fa2e8fdb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2e40661f0 0x7fa2e4113c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:17.270 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.266+0000 7fa2e97dc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2e412ab20 0x7fa2e41145e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:17.270 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.266+0000 7fa2e3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2e4127cd0 0x7fa2e41140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:17.270 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.266+0000 7fa2e8fdb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2e40661f0 0x7fa2e4113c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41800/0 (socket says 172.21.15.156:41800) 2023-09-30T22:16:17.270 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.266+0000 7fa2e8fdb700 1 -- 172.21.15.156:0/2448999805 learned_addr learned my addr 172.21.15.156:0/2448999805 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:17.270 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.266+0000 7fa2e3fff700 1 -- 172.21.15.156:0/2448999805 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2e412ab20 msgr2=0x7fa2e41145e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:17.270 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.266+0000 7fa2e3fff700 1 --2- 172.21.15.156:0/2448999805 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2e412ab20 0x7fa2e41145e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:17.270 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.266+0000 7fa2e3fff700 1 -- 172.21.15.156:0/2448999805 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2e40661f0 msgr2=0x7fa2e4113c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:17.270 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.266+0000 7fa2e3fff700 1 --2- 172.21.15.156:0/2448999805 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2e40661f0 0x7fa2e4113c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:17.270 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.266+0000 7fa2e3fff700 1 -- 172.21.15.156:0/2448999805 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d8009370 con 0x7fa2e4127cd0 2023-09-30T22:16:17.270 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.266+0000 7fa2e8fdb700 1 --2- 172.21.15.156:0/2448999805 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2e40661f0 0x7fa2e4113c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:17.270 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.266+0000 7fa2e97dc700 1 --2- 172.21.15.156:0/2448999805 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2e412ab20 0x7fa2e41145e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:17.271 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.266+0000 7fa2e3fff700 1 --2- 172.21.15.156:0/2448999805 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2e4127cd0 0x7fa2e41140f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fa2d000e8d0 tx=0x7fa2d0009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:17.271 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.266+0000 7fa2e0ff9700 1 -- 172.21.15.156:0/2448999805 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0009470 con 0x7fa2e4127cd0 2023-09-30T22:16:17.271 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.266+0000 7fa2e0ff9700 1 -- 172.21.15.156:0/2448999805 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d0012600 con 0x7fa2e4127cd0 2023-09-30T22:16:17.271 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.266+0000 7fa2eb23f700 1 -- 172.21.15.156:0/2448999805 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2dc009a20 con 0x7fa2e4127cd0 2023-09-30T22:16:17.271 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.266+0000 7fa2e0ff9700 1 -- 172.21.15.156:0/2448999805 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0012980 con 0x7fa2e4127cd0 2023-09-30T22:16:17.271 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.266+0000 7fa2eb23f700 1 -- 172.21.15.156:0/2448999805 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e4117700 con 0x7fa2e4127cd0 2023-09-30T22:16:17.271 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.267+0000 7fa2e0ff9700 1 -- 172.21.15.156:0/2448999805 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fa2d001b400 con 0x7fa2e4127cd0 2023-09-30T22:16:17.271 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.267+0000 7fa2e0ff9700 1 -- 172.21.15.156:0/2448999805 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fa2d001a8c0 con 0x7fa2e4127cd0 2023-09-30T22:16:17.271 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.267+0000 7fa2eb23f700 1 -- 172.21.15.156:0/2448999805 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e4065950 con 0x7fa2e4127cd0 2023-09-30T22:16:17.272 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.269+0000 7fa2e0ff9700 1 -- 172.21.15.156:0/2448999805 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fa2d003ae50 con 0x7fa2e4127cd0 2023-09-30T22:16:17.337 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.336+0000 7fa2eb23f700 1 -- 172.21.15.156:0/2448999805 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2e405a260 con 0x7fa2e4127cd0 2023-09-30T22:16:17.338 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.336+0000 7fa2e0ff9700 1 -- 172.21.15.156:0/2448999805 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4109 (secure 0 0 0) 0x7fa2d0029030 con 0x7fa2e4127cd0 2023-09-30T22:16:17.338 INFO:teuthology.misc.health.smithi156.stdout: 2023-09-30T22:16:17.339 INFO:teuthology.misc.health.smithi156.stdout:{"epoch":6,"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","created":"2023-09-30T22:16:15.239992+0000","modified":"2023-09-30T22:16:16.474206+0000","last_up_change":"0.000000","last_in_change":"2023-09-30T22:16:16.474206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"3ec2e78a-c61f-473a-bfcb-f956cffe4095","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b682e683-c15a-4bd9-8712-8af96454e9ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"960dbaf0-2e0c-437e-9114-bc22ce522b26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c1b19714-78b1-4869-8721-2f6352a64a05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:16:17.339 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.337+0000 7fa2eb23f700 1 -- 172.21.15.156:0/2448999805 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2e4127cd0 msgr2=0x7fa2e41140f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:17.339 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.337+0000 7fa2eb23f700 1 --2- 172.21.15.156:0/2448999805 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2e4127cd0 0x7fa2e41140f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fa2d000e8d0 tx=0x7fa2d0009060).stop 2023-09-30T22:16:17.339 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.337+0000 7fa2eb23f700 1 -- 172.21.15.156:0/2448999805 shutdown_connections 2023-09-30T22:16:17.340 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.337+0000 7fa2eb23f700 1 --2- 172.21.15.156:0/2448999805 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2e412ab20 0x7fa2e41145e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:17.340 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.337+0000 7fa2eb23f700 1 --2- 172.21.15.156:0/2448999805 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2e40661f0 0x7fa2e4113c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:17.340 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.337+0000 7fa2eb23f700 1 --2- 172.21.15.156:0/2448999805 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2e4127cd0 0x7fa2e41140f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:17.340 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.337+0000 7fa2eb23f700 1 -- 172.21.15.156:0/2448999805 >> 172.21.15.156:0/2448999805 conn(0x7fa2e409ba00 msgr2=0x7fa2e41288f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:17.340 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.337+0000 7fa2eb23f700 1 -- 172.21.15.156:0/2448999805 shutdown_connections 2023-09-30T22:16:17.340 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:17.337+0000 7fa2eb23f700 1 -- 172.21.15.156:0/2448999805 wait complete. 2023-09-30T22:16:17.349 DEBUG:teuthology.misc:0 of 4 OSDs are up 2023-09-30T22:16:17.360 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:16:17.360+0000 7fdccb509680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-30T22:16:17.787 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:16:17.786+0000 7fdccb509680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-30T22:16:17.961 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:16:17.960+0000 7fdccb509680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-30T22:16:18.026 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:16:18.025+0000 7fdccb509680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-30T22:16:18.102 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:16:18.102+0000 7fdccb509680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-30T22:16:18.171 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:16:18.170+0000 7fdccb509680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-30T22:16:18.521 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:16:18.521+0000 7fdccb509680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-30T22:16:18.607 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:16:18.606+0000 7fdccb509680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-30T22:16:19.240 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:16:19.240+0000 7fdccb509680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-30T22:16:19.311 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:16:19.311+0000 7fdccb509680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-30T22:16:19.388 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:16:19.388+0000 7fdccb509680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-30T22:16:19.687 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:16:19.686+0000 7fdccb509680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-30T22:16:19.757 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:16:19.756+0000 7fdccb509680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-30T22:16:19.937 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:16:19.937+0000 7fdccb509680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-30T22:16:20.117 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:16:20.116+0000 7fdccb509680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-30T22:16:20.264 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:16:20.264+0000 7fdccb509680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-30T22:16:20.335 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:16:20.334+0000 7fdccb509680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-30T22:16:20.621 INFO:tasks.ceph.osd.3.smithi156.stderr:2023-09-30T22:16:20.620+0000 7f0a50128200 -1 osd.3 0 log_to_monitors {default=true} 2023-09-30T22:16:20.627 INFO:tasks.ceph.osd.0.smithi156.stderr:2023-09-30T22:16:20.627+0000 7fd7c64f4200 -1 osd.0 0 log_to_monitors {default=true} 2023-09-30T22:16:20.819 INFO:tasks.ceph.osd.1.smithi156.stderr:2023-09-30T22:16:20.818+0000 7f6af28e4200 -1 osd.1 0 log_to_monitors {default=true} 2023-09-30T22:16:20.848 INFO:tasks.ceph.osd.2.smithi156.stderr:2023-09-30T22:16:20.848+0000 7fe457628200 -1 osd.2 0 log_to_monitors {default=true} 2023-09-30T22:16:21.355 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:16:21.355+0000 7fdc81f46700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-09-30T22:16:21.355 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:16:21.355+0000 7fdc81f46700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-09-30T22:16:22.396 INFO:tasks.ceph.osd.2.smithi156.stderr:2023-09-30T22:16:22.396+0000 7fe44dfc9700 -1 osd.2 0 waiting for initial osdmap 2023-09-30T22:16:22.397 INFO:tasks.ceph.osd.1.smithi156.stderr:2023-09-30T22:16:22.396+0000 7f6ae9285700 -1 osd.1 0 waiting for initial osdmap 2023-09-30T22:16:22.397 INFO:tasks.ceph.osd.3.smithi156.stderr:2023-09-30T22:16:22.397+0000 7f0a46ac9700 -1 osd.3 0 waiting for initial osdmap 2023-09-30T22:16:22.398 INFO:tasks.ceph.osd.0.smithi156.stderr:2023-09-30T22:16:22.398+0000 7fd7bce95700 -1 osd.0 0 waiting for initial osdmap 2023-09-30T22:16:22.402 INFO:tasks.ceph.osd.3.smithi156.stderr:2023-09-30T22:16:22.402+0000 7f0a43245700 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:16:22.402 INFO:tasks.ceph.osd.0.smithi156.stderr:2023-09-30T22:16:22.402+0000 7fd7b9611700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:16:22.403 INFO:tasks.ceph.osd.1.smithi156.stderr:2023-09-30T22:16:22.402+0000 7f6ae5a01700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:16:22.403 INFO:tasks.ceph.osd.2.smithi156.stderr:2023-09-30T22:16:22.402+0000 7fe44a745700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:16:23.755 DEBUG:teuthology.orchestra.run.smithi156:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-30T22:16:23.871 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.868+0000 7f18bdf8e700 1 Processor -- start 2023-09-30T22:16:23.872 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.868+0000 7f18bdf8e700 1 -- start start 2023-09-30T22:16:23.872 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.869+0000 7f18bdf8e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18b80925c0 0x7f18b812ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:23.872 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.869+0000 7f18bdf8e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18b812b6f0 0x7f18b8127c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:23.872 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.869+0000 7f18bdf8e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b80965d0 con 0x7f18b812b270 2023-09-30T22:16:23.872 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.869+0000 7f18bdf8e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b8091dc0 con 0x7f18b812b6f0 2023-09-30T22:16:23.872 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.869+0000 7f18bdf8e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18b8096a20 con 0x7f18b80925c0 2023-09-30T22:16:23.872 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.869+0000 7f18b7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18b812b6f0 0x7f18b8127c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:23.873 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.869+0000 7f18b6ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f18b812b270 0x7f18b8127550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45670/0 (socket says 172.21.15.156:45670) 2023-09-30T22:16:23.873 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.869+0000 7f18b6ffd700 1 -- 172.21.15.156:0/184875469 learned_addr learned my addr 172.21.15.156:0/184875469 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:23.873 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.869+0000 7f18b77fe700 1 --2- 172.21.15.156:0/184875469 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18b80925c0 0x7f18b812ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:23.873 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.869+0000 7f18b7fff700 1 -- 172.21.15.156:0/184875469 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18b80925c0 msgr2=0x7f18b812ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:23.873 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.869+0000 7f18b7fff700 1 --2- 172.21.15.156:0/184875469 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18b80925c0 0x7f18b812ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:23.873 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.869+0000 7f18b7fff700 1 -- 172.21.15.156:0/184875469 >> v1:172.21.15.156:6789/0 conn(0x7f18b812b270 legacy=0x7f18b8127550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:23.873 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.869+0000 7f18b67fc700 1 -- 172.21.15.156:0/184875469 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3102033964 0 0) 0x7f18b80965d0 con 0x7f18b812b270 2023-09-30T22:16:23.873 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.869+0000 7f18b7fff700 1 -- 172.21.15.156:0/184875469 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b8091b00 con 0x7f18b812b6f0 2023-09-30T22:16:23.873 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.869+0000 7f18b77fe700 1 --2- 172.21.15.156:0/184875469 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18b80925c0 0x7f18b812ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:23.873 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.869+0000 7f18b7fff700 1 --2- 172.21.15.156:0/184875469 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18b812b6f0 0x7f18b8127c60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f18b0009e90 tx=0x7f18b0009780).ready entity=mon.1 client_cookie=4ce6b46349002318 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:23.874 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.869+0000 7f18b67fc700 1 -- 172.21.15.156:0/184875469 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b000e070 con 0x7f18b812b6f0 2023-09-30T22:16:23.874 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.869+0000 7f18b67fc700 1 -- 172.21.15.156:0/184875469 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b000bb60 con 0x7f18b812b6f0 2023-09-30T22:16:23.874 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.869+0000 7f18b67fc700 1 -- 172.21.15.156:0/184875469 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b0012410 con 0x7f18b812b6f0 2023-09-30T22:16:23.874 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.870+0000 7f18bdf8e700 1 -- 172.21.15.156:0/184875469 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18b812b6f0 msgr2=0x7f18b8127c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:23.874 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.870+0000 7f18bdf8e700 1 --2- 172.21.15.156:0/184875469 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18b812b6f0 0x7f18b8127c60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f18b0009e90 tx=0x7f18b0009780).stop 2023-09-30T22:16:23.874 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.870+0000 7f18bdf8e700 1 -- 172.21.15.156:0/184875469 shutdown_connections 2023-09-30T22:16:23.874 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.870+0000 7f18bdf8e700 1 --2- 172.21.15.156:0/184875469 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18b812b6f0 0x7f18b8127c60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:23.874 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.870+0000 7f18bdf8e700 1 --2- 172.21.15.156:0/184875469 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18b80925c0 0x7f18b812ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:23.874 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.870+0000 7f18bdf8e700 1 -- 172.21.15.156:0/184875469 >> 172.21.15.156:0/184875469 conn(0x7f18b805ee70 msgr2=0x7f18b8097410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:23.874 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.870+0000 7f18bdf8e700 1 -- 172.21.15.156:0/184875469 shutdown_connections 2023-09-30T22:16:23.875 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.870+0000 7f18bdf8e700 1 -- 172.21.15.156:0/184875469 wait complete. 2023-09-30T22:16:23.875 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.871+0000 7f18bdf8e700 1 Processor -- start 2023-09-30T22:16:23.875 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.871+0000 7f18bdf8e700 1 -- start start 2023-09-30T22:16:23.877 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.871+0000 7f18bdf8e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18b812b270 0x7f18b8126c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:23.877 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.871+0000 7f18bdf8e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18b812b6f0 0x7f18b8115bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:23.877 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.871+0000 7f18bdf8e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18b8127170 0x7f18b81160a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:23.878 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.871+0000 7f18bdf8e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b8118010 con 0x7f18b8127170 2023-09-30T22:16:23.878 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.872+0000 7f18bdf8e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b8096c50 con 0x7f18b812b270 2023-09-30T22:16:23.878 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.872+0000 7f18bdf8e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18b8119650 con 0x7f18b812b6f0 2023-09-30T22:16:23.878 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.872+0000 7f18b77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18b812b270 0x7f18b8126c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:23.878 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.872+0000 7f18b6ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18b812b6f0 0x7f18b8115bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:23.878 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.872+0000 7f18b7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18b8127170 0x7f18b81160a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:23.878 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.872+0000 7f18b77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18b812b270 0x7f18b8126c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:34106/0 (socket says 172.21.15.156:34106) 2023-09-30T22:16:23.878 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.872+0000 7f18b77fe700 1 -- 172.21.15.156:0/1591775799 learned_addr learned my addr 172.21.15.156:0/1591775799 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:23.879 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.872+0000 7f18b6ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18b812b6f0 0x7f18b8115bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55896/0 (socket says 172.21.15.156:55896) 2023-09-30T22:16:23.879 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.872+0000 7f18b7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18b8127170 0x7f18b81160a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60850/0 (socket says 172.21.15.156:60850) 2023-09-30T22:16:23.879 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.872+0000 7f18b77fe700 1 -- 172.21.15.156:0/1591775799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18b812b6f0 msgr2=0x7f18b8115bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:23.879 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.872+0000 7f18b77fe700 1 --2- 172.21.15.156:0/1591775799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18b812b6f0 0x7f18b8115bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:23.879 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.872+0000 7f18b77fe700 1 -- 172.21.15.156:0/1591775799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18b8127170 msgr2=0x7f18b81160a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:23.879 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.872+0000 7f18b77fe700 1 --2- 172.21.15.156:0/1591775799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18b8127170 0x7f18b81160a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:23.879 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.872+0000 7f18b77fe700 1 -- 172.21.15.156:0/1591775799 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ac0092a0 con 0x7f18b812b270 2023-09-30T22:16:23.879 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.872+0000 7f18b77fe700 1 --2- 172.21.15.156:0/1591775799 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18b812b270 0x7f18b8126c80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f18ac00ea20 tx=0x7f18ac009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:23.879 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.872+0000 7f189f7fe700 1 -- 172.21.15.156:0/1591775799 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac00ee60 con 0x7f18b812b270 2023-09-30T22:16:23.879 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.872+0000 7f189f7fe700 1 -- 172.21.15.156:0/1591775799 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ac00c850 con 0x7f18b812b270 2023-09-30T22:16:23.879 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.872+0000 7f18bdf8e700 1 -- 172.21.15.156:0/1591775799 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b0009a20 con 0x7f18b812b270 2023-09-30T22:16:23.879 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.872+0000 7f189f7fe700 1 -- 172.21.15.156:0/1591775799 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac00cbd0 con 0x7f18b812b270 2023-09-30T22:16:23.880 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.872+0000 7f18bdf8e700 1 -- 172.21.15.156:0/1591775799 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b8119ef0 con 0x7f18b812b270 2023-09-30T22:16:23.880 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.873+0000 7f189f7fe700 1 -- 172.21.15.156:0/1591775799 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f18ac01b400 con 0x7f18b812b270 2023-09-30T22:16:23.880 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.873+0000 7f189f7fe700 1 -- 172.21.15.156:0/1591775799 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2069+0+0 (secure 0 0 0) 0x7f18ac03ad80 con 0x7f18b812b270 2023-09-30T22:16:23.880 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.873+0000 7f18bdf8e700 1 -- 172.21.15.156:0/1591775799 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b8119ef0 con 0x7f18b812b270 2023-09-30T22:16:23.880 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:23.878+0000 7f189f7fe700 1 -- 172.21.15.156:0/1591775799 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f18b8119ef0 con 0x7f18b812b270 2023-09-30T22:16:24.038 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:24.037+0000 7f18bdf8e700 1 -- 172.21.15.156:0/1591775799 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18b8119ef0 con 0x7f18b812b270 2023-09-30T22:16:24.038 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:24.038+0000 7f189f7fe700 1 -- 172.21.15.156:0/1591775799 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) v1 ==== 74+0+4968 (secure 0 0 0) 0x7f18b8119ef0 con 0x7f18b812b270 2023-09-30T22:16:24.038 INFO:teuthology.misc.health.smithi156.stdout: 2023-09-30T22:16:24.039 INFO:teuthology.misc.health.smithi156.stdout:{"epoch":9,"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","created":"2023-09-30T22:16:15.239992+0000","modified":"2023-09-30T22:16:23.392557+0000","last_up_change":"2023-09-30T22:16:23.392557+0000","last_in_change":"2023-09-30T22:16:16.474206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"3ec2e78a-c61f-473a-bfcb-f956cffe4095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6812","nonce":118781}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6813","nonce":118781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6815","nonce":118781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6814","nonce":118781}]},"public_addr":"172.21.15.156:6812/118781","cluster_addr":"172.21.15.156:6813/118781","heartbeat_back_addr":"172.21.15.156:6815/118781","heartbeat_front_addr":"172.21.15.156:6814/118781","state":["exists","up"]},{"osd":1,"uuid":"b682e683-c15a-4bd9-8712-8af96454e9ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6803","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6805","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6807","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6806","nonce":118763}]},"public_addr":"172.21.15.156:6803/118763","cluster_addr":"172.21.15.156:6805/118763","heartbeat_back_addr":"172.21.15.156:6807/118763","heartbeat_front_addr":"172.21.15.156:6806/118763","state":["exists","up"]},{"osd":2,"uuid":"960dbaf0-2e0c-437e-9114-bc22ce522b26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6808","nonce":118788}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6809","nonce":118788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6811","nonce":118788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6810","nonce":118788}]},"public_addr":"172.21.15.156:6808/118788","cluster_addr":"172.21.15.156:6809/118788","heartbeat_back_addr":"172.21.15.156:6811/118788","heartbeat_front_addr":"172.21.15.156:6810/118788","state":["exists","up"]},{"osd":3,"uuid":"c1b19714-78b1-4869-8721-2f6352a64a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6800","nonce":118764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6801","nonce":118764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6804","nonce":118764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6802","nonce":118764}]},"public_addr":"172.21.15.156:6800/118764","cluster_addr":"172.21.15.156:6801/118764","heartbeat_back_addr":"172.21.15.156:6804/118764","heartbeat_front_addr":"172.21.15.156:6802/118764","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:16:24.040 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:24.040+0000 7f18bdf8e700 1 -- 172.21.15.156:0/1591775799 >> v1:172.21.15.156:6816/118236 conn(0x7f18a402bb90 legacy=0x7f18a402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:24.040 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:24.040+0000 7f18bdf8e700 1 -- 172.21.15.156:0/1591775799 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18b812b270 msgr2=0x7f18b8126c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:24.040 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:24.040+0000 7f18bdf8e700 1 --2- 172.21.15.156:0/1591775799 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18b812b270 0x7f18b8126c80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f18ac00ea20 tx=0x7f18ac009060).stop 2023-09-30T22:16:24.041 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:24.040+0000 7f18bdf8e700 1 -- 172.21.15.156:0/1591775799 shutdown_connections 2023-09-30T22:16:24.041 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:24.040+0000 7f18bdf8e700 1 --2- 172.21.15.156:0/1591775799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18b8127170 0x7f18b81160a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:24.041 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:24.040+0000 7f18bdf8e700 1 --2- 172.21.15.156:0/1591775799 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18b812b270 0x7f18b8126c80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:24.041 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:24.040+0000 7f18bdf8e700 1 --2- 172.21.15.156:0/1591775799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18b812b6f0 0x7f18b8115bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:24.041 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:24.040+0000 7f18bdf8e700 1 -- 172.21.15.156:0/1591775799 >> 172.21.15.156:0/1591775799 conn(0x7f18b80925c0 msgr2=0x7f18b809ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:24.041 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:24.040+0000 7f18bdf8e700 1 -- 172.21.15.156:0/1591775799 shutdown_connections 2023-09-30T22:16:24.041 INFO:teuthology.misc.health.smithi156.stderr:2023-09-30T22:16:24.040+0000 7f18bdf8e700 1 -- 172.21.15.156:0/1591775799 wait complete. 2023-09-30T22:16:24.051 DEBUG:teuthology.misc:4 of 4 OSDs are up 2023-09-30T22:16:24.052 INFO:tasks.ceph:Creating RBD pool 2023-09-30T22:16:24.052 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd pool create rbd 8 2023-09-30T22:16:24.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.167+0000 7fcf96c8c700 1 Processor -- start 2023-09-30T22:16:24.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.167+0000 7fcf96c8c700 1 -- start start 2023-09-30T22:16:24.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.168+0000 7fcf96c8c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcf9005f560 0x7fcf9012aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:24.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.168+0000 7fcf96c8c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf9012b3d0 0x7fcf90095d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:24.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.168+0000 7fcf96c8c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf9012b850 0x7fcf90096280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:24.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.168+0000 7fcf96c8c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf9005f940 con 0x7fcf9005f560 2023-09-30T22:16:24.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.168+0000 7fcf96c8c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf90097230 con 0x7fcf9012b850 2023-09-30T22:16:24.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.168+0000 7fcf96c8c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9012ac80 con 0x7fcf9012b3d0 2023-09-30T22:16:24.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.168+0000 7fcf95229700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf9012b850 0x7fcf90096280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:24.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.168+0000 7fcf94a28700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcf9005f560 0x7fcf9012aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:24.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.168+0000 7fcf8ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf9012b3d0 0x7fcf90095d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:24.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.168+0000 7fcf95229700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf9012b850 0x7fcf90096280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:34114/0 (socket says 172.21.15.156:34114) 2023-09-30T22:16:24.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.168+0000 7fcf95229700 1 -- 172.21.15.156:0/3258931456 learned_addr learned my addr 172.21.15.156:0/3258931456 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:24.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.168+0000 7fcf94a28700 1 -- 172.21.15.156:0/3258931456 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf9012b3d0 msgr2=0x7fcf90095d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:24.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.168+0000 7fcf94a28700 1 --2- 172.21.15.156:0/3258931456 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf9012b3d0 0x7fcf90095d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:24.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.168+0000 7fcf94a28700 1 -- 172.21.15.156:0/3258931456 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf9012b850 msgr2=0x7fcf90096280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:24.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.168+0000 7fcf94a28700 1 --2- 172.21.15.156:0/3258931456 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf9012b850 0x7fcf90096280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:24.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.168+0000 7fcf94a28700 1 -- 172.21.15.156:0/3258931456 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf90097a10 con 0x7fcf9005f560 2023-09-30T22:16:24.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.168+0000 7fcf95229700 1 --2- 172.21.15.156:0/3258931456 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf9012b850 0x7fcf90096280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:24.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.168+0000 7fcf8ffff700 1 --2- 172.21.15.156:0/3258931456 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf9012b3d0 0x7fcf90095d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:24.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.168+0000 7fcf94a28700 1 --2- 172.21.15.156:0/3258931456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf9005f560 0x7fcf9012aee0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fcf84009760 tx=0x7fcf84009060).ready entity=mon.0 client_cookie=8b09793209c3f89d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:24.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.169+0000 7fcf8f7fe700 1 -- 172.21.15.156:0/3258931456 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf840090d0 con 0x7fcf9005f560 2023-09-30T22:16:24.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.169+0000 7fcf8f7fe700 1 -- 172.21.15.156:0/3258931456 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8400d4a0 con 0x7fcf9005f560 2023-09-30T22:16:24.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.169+0000 7fcf8f7fe700 1 -- 172.21.15.156:0/3258931456 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8400d820 con 0x7fcf9005f560 2023-09-30T22:16:24.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.169+0000 7fcf96c8c700 1 -- 172.21.15.156:0/3258931456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf9005f560 msgr2=0x7fcf9012aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:24.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.169+0000 7fcf96c8c700 1 --2- 172.21.15.156:0/3258931456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf9005f560 0x7fcf9012aee0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fcf84009760 tx=0x7fcf84009060).stop 2023-09-30T22:16:24.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.169+0000 7fcf96c8c700 1 -- 172.21.15.156:0/3258931456 shutdown_connections 2023-09-30T22:16:24.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.169+0000 7fcf96c8c700 1 --2- 172.21.15.156:0/3258931456 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf9012b850 0x7fcf90096280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:24.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.169+0000 7fcf96c8c700 1 --2- 172.21.15.156:0/3258931456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf9005f560 0x7fcf9012aee0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:24.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.169+0000 7fcf96c8c700 1 --2- 172.21.15.156:0/3258931456 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf9012b3d0 0x7fcf90095d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:24.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.169+0000 7fcf96c8c700 1 -- 172.21.15.156:0/3258931456 >> 172.21.15.156:0/3258931456 conn(0x7fcf9009a1c0 msgr2=0x7fcf9009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:24.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.169+0000 7fcf96c8c700 1 -- 172.21.15.156:0/3258931456 shutdown_connections 2023-09-30T22:16:24.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.169+0000 7fcf96c8c700 1 -- 172.21.15.156:0/3258931456 wait complete. 2023-09-30T22:16:24.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.170+0000 7fcf96c8c700 1 Processor -- start 2023-09-30T22:16:24.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.170+0000 7fcf96c8c700 1 -- start start 2023-09-30T22:16:24.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.171+0000 7fcf96c8c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf9005f560 0x7fcf9013a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:24.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.171+0000 7fcf96c8c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf9012b3d0 0x7fcf9013aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:24.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.171+0000 7fcf96c8c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf9012b850 0x7fcf90114ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:24.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.171+0000 7fcf96c8c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf90098c50 con 0x7fcf9012b850 2023-09-30T22:16:24.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.171+0000 7fcf96c8c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9012f280 con 0x7fcf9005f560 2023-09-30T22:16:24.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.171+0000 7fcf96c8c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf90116950 con 0x7fcf9012b3d0 2023-09-30T22:16:24.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.171+0000 7fcf94a28700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf9005f560 0x7fcf9013a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:24.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.171+0000 7fcf94a28700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf9005f560 0x7fcf9013a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:34126/0 (socket says 172.21.15.156:34126) 2023-09-30T22:16:24.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.171+0000 7fcf94a28700 1 -- 172.21.15.156:0/2767627155 learned_addr learned my addr 172.21.15.156:0/2767627155 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:24.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.171+0000 7fcf8ffff700 1 --2- 172.21.15.156:0/2767627155 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf9012b3d0 0x7fcf9013aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:24.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.171+0000 7fcf95229700 1 --2- 172.21.15.156:0/2767627155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf9012b850 0x7fcf90114ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:24.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.171+0000 7fcf8ffff700 1 -- 172.21.15.156:0/2767627155 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf9005f560 msgr2=0x7fcf9013a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:24.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.171+0000 7fcf8ffff700 1 --2- 172.21.15.156:0/2767627155 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf9005f560 0x7fcf9013a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:24.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.171+0000 7fcf8ffff700 1 -- 172.21.15.156:0/2767627155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf9012b850 msgr2=0x7fcf90114ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:24.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.171+0000 7fcf8ffff700 1 --2- 172.21.15.156:0/2767627155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf9012b850 0x7fcf90114ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:24.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.171+0000 7fcf8ffff700 1 -- 172.21.15.156:0/2767627155 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7c0092a0 con 0x7fcf9012b3d0 2023-09-30T22:16:24.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.171+0000 7fcf8ffff700 1 --2- 172.21.15.156:0/2767627155 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf9012b3d0 0x7fcf9013aa20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fcf7c00e980 tx=0x7fcf7c009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:24.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.171+0000 7fcf8cff9700 1 -- 172.21.15.156:0/2767627155 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c009580 con 0x7fcf9012b3d0 2023-09-30T22:16:24.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.171+0000 7fcf8cff9700 1 -- 172.21.15.156:0/2767627155 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7c012600 con 0x7fcf9012b3d0 2023-09-30T22:16:24.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.171+0000 7fcf96c8c700 1 -- 172.21.15.156:0/2767627155 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf88009ae0 con 0x7fcf9012b3d0 2023-09-30T22:16:24.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.171+0000 7fcf8cff9700 1 -- 172.21.15.156:0/2767627155 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c0129a0 con 0x7fcf9012b3d0 2023-09-30T22:16:24.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.171+0000 7fcf96c8c700 1 -- 172.21.15.156:0/2767627155 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf840092a0 con 0x7fcf9012b3d0 2023-09-30T22:16:24.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.172+0000 7fcf8cff9700 1 -- 172.21.15.156:0/2767627155 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fcf7c012d10 con 0x7fcf9012b3d0 2023-09-30T22:16:24.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.172+0000 7fcf8cff9700 1 -- 172.21.15.156:0/2767627155 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2069+0+0 (secure 0 0 0) 0x7fcf7c03adc0 con 0x7fcf9012b3d0 2023-09-30T22:16:24.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.172+0000 7fcf96c8c700 1 -- 172.21.15.156:0/2767627155 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf9005a260 con 0x7fcf9012b3d0 2023-09-30T22:16:24.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.177+0000 7fcf8cff9700 1 -- 172.21.15.156:0/2767627155 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fcf7c019310 con 0x7fcf9012b3d0 2023-09-30T22:16:24.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.335+0000 7fcf96c8c700 1 -- 172.21.15.156:0/2767627155 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fcf900671c0 con 0x7fcf9012b3d0 2023-09-30T22:16:24.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.405+0000 7fcf8cff9700 1 -- 172.21.15.156:0/2767627155 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v10) v1 ==== 109+0+0 (secure 0 0 0) 0x7fcf7c011b00 con 0x7fcf9012b3d0 2023-09-30T22:16:24.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.408+0000 7fcf96c8c700 1 -- 172.21.15.156:0/2767627155 >> v1:172.21.15.156:6816/118236 conn(0x7fcf7402bb60 legacy=0x7fcf7402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:24.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.408+0000 7fcf96c8c700 1 -- 172.21.15.156:0/2767627155 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf9012b3d0 msgr2=0x7fcf9013aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:24.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.408+0000 7fcf96c8c700 1 --2- 172.21.15.156:0/2767627155 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf9012b3d0 0x7fcf9013aa20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fcf7c00e980 tx=0x7fcf7c009060).stop 2023-09-30T22:16:24.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.408+0000 7fcf96c8c700 1 -- 172.21.15.156:0/2767627155 shutdown_connections 2023-09-30T22:16:24.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.408+0000 7fcf96c8c700 1 --2- 172.21.15.156:0/2767627155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf9012b850 0x7fcf90114ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:24.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.408+0000 7fcf96c8c700 1 --2- 172.21.15.156:0/2767627155 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf9005f560 0x7fcf9013a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:24.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.408+0000 7fcf96c8c700 1 --2- 172.21.15.156:0/2767627155 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf9012b3d0 0x7fcf9013aa20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:24.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.408+0000 7fcf96c8c700 1 -- 172.21.15.156:0/2767627155 >> 172.21.15.156:0/2767627155 conn(0x7fcf9009a1c0 msgr2=0x7fcf90095d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:24.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.409+0000 7fcf96c8c700 1 -- 172.21.15.156:0/2767627155 shutdown_connections 2023-09-30T22:16:24.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.409+0000 7fcf96c8c700 1 -- 172.21.15.156:0/2767627155 wait complete. 2023-09-30T22:16:24.410 INFO:teuthology.orchestra.run.smithi156.stderr:pool 'rbd' created 2023-09-30T22:16:24.420 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-09-30T22:16:24.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.537+0000 7ff4cfbfb700 1 Processor -- start 2023-09-30T22:16:24.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.538+0000 7ff4cfbfb700 1 -- start start 2023-09-30T22:16:24.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.538+0000 7ff4cfbfb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4c812abc0 0x7ff4c812cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:24.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.538+0000 7ff4cfbfb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff4c812d4a0 0x7ff4c812f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:24.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.538+0000 7ff4cfbfb700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c8069370 con 0x7ff4c8096930 2023-09-30T22:16:24.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.538+0000 7ff4cfbfb700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c8093700 con 0x7ff4c812d4a0 2023-09-30T22:16:24.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.538+0000 7ff4cfbfb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c8092160 con 0x7ff4c812abc0 2023-09-30T22:16:24.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.538+0000 7ff4cd196700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4c812abc0 0x7ff4c812cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:24.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.538+0000 7ff4cd997700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff4c8096930 0x7ff4c8096d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45680/0 (socket says 172.21.15.156:45680) 2023-09-30T22:16:24.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.538+0000 7ff4ce198700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff4c812d4a0 0x7ff4c812f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:24.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.538+0000 7ff4cd997700 1 -- 172.21.15.156:0/3800794671 learned_addr learned my addr 172.21.15.156:0/3800794671 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:24.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.538+0000 7ff4ce198700 1 -- 172.21.15.156:0/3800794671 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4c812abc0 msgr2=0x7ff4c812cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:24.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.538+0000 7ff4ce198700 1 --2- 172.21.15.156:0/3800794671 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4c812abc0 0x7ff4c812cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:24.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.539+0000 7ff4ce198700 1 -- 172.21.15.156:0/3800794671 >> v1:172.21.15.156:6789/0 conn(0x7ff4c8096930 legacy=0x7ff4c8096d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:24.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.539+0000 7ff4ce198700 1 -- 172.21.15.156:0/3800794671 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c8091b90 con 0x7ff4c812d4a0 2023-09-30T22:16:24.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.539+0000 7ff4cc995700 1 -- 172.21.15.156:0/3800794671 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130396867 0 0) 0x7ff4c8069370 con 0x7ff4c8096930 2023-09-30T22:16:24.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.539+0000 7ff4cd196700 1 --2- 172.21.15.156:0/3800794671 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4c812abc0 0x7ff4c812cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:24.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.539+0000 7ff4ce198700 1 --2- 172.21.15.156:0/3800794671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4c812d4a0 0x7ff4c812f890 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7ff4c0009e90 tx=0x7ff4c0009780).ready entity=mon.0 client_cookie=6b6f22ed6d015799 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:24.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.539+0000 7ff4cc995700 1 -- 172.21.15.156:0/3800794671 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c000e070 con 0x7ff4c812d4a0 2023-09-30T22:16:24.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.539+0000 7ff4cc995700 1 -- 172.21.15.156:0/3800794671 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c000bb20 con 0x7ff4c812d4a0 2023-09-30T22:16:24.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.539+0000 7ff4cc995700 1 -- 172.21.15.156:0/3800794671 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c000bea0 con 0x7ff4c812d4a0 2023-09-30T22:16:24.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.539+0000 7ff4cfbfb700 1 -- 172.21.15.156:0/3800794671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4c812d4a0 msgr2=0x7ff4c812f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:24.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.539+0000 7ff4cfbfb700 1 --2- 172.21.15.156:0/3800794671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4c812d4a0 0x7ff4c812f890 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7ff4c0009e90 tx=0x7ff4c0009780).stop 2023-09-30T22:16:24.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.539+0000 7ff4cfbfb700 1 -- 172.21.15.156:0/3800794671 shutdown_connections 2023-09-30T22:16:24.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.539+0000 7ff4cfbfb700 1 --2- 172.21.15.156:0/3800794671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4c812d4a0 0x7ff4c812f890 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:24.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.539+0000 7ff4cfbfb700 1 --2- 172.21.15.156:0/3800794671 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4c812abc0 0x7ff4c812cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:24.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.539+0000 7ff4cfbfb700 1 -- 172.21.15.156:0/3800794671 >> 172.21.15.156:0/3800794671 conn(0x7ff4c8063720 msgr2=0x7ff4c809a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:24.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.539+0000 7ff4cfbfb700 1 -- 172.21.15.156:0/3800794671 shutdown_connections 2023-09-30T22:16:24.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.540+0000 7ff4cfbfb700 1 -- 172.21.15.156:0/3800794671 wait complete. 2023-09-30T22:16:24.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.540+0000 7ff4cfbfb700 1 Processor -- start 2023-09-30T22:16:24.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.540+0000 7ff4cfbfb700 1 -- start start 2023-09-30T22:16:24.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.541+0000 7ff4cfbfb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4c812abc0 0x7ff4c8119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:24.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.541+0000 7ff4cfbfb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4c812d4a0 0x7ff4c812afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:24.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.541+0000 7ff4cfbfb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4c812b4c0 0x7ff4c812b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:24.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.541+0000 7ff4cfbfb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c812c490 con 0x7ff4c812d4a0 2023-09-30T22:16:24.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.541+0000 7ff4cfbfb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c812be10 con 0x7ff4c812b4c0 2023-09-30T22:16:24.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.541+0000 7ff4cfbfb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c80676a0 con 0x7ff4c812abc0 2023-09-30T22:16:24.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.541+0000 7ff4ce198700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4c812b4c0 0x7ff4c812b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:24.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.541+0000 7ff4cd997700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4c812abc0 0x7ff4c8119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:24.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.541+0000 7ff4cd196700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4c812d4a0 0x7ff4c812afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:24.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.541+0000 7ff4ce198700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4c812b4c0 0x7ff4c812b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:34142/0 (socket says 172.21.15.156:34142) 2023-09-30T22:16:24.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.541+0000 7ff4ce198700 1 -- 172.21.15.156:0/1479365110 learned_addr learned my addr 172.21.15.156:0/1479365110 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:24.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.541+0000 7ff4ce198700 1 -- 172.21.15.156:0/1479365110 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4c812abc0 msgr2=0x7ff4c8119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:24.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.541+0000 7ff4ce198700 1 --2- 172.21.15.156:0/1479365110 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4c812abc0 0x7ff4c8119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:24.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.541+0000 7ff4ce198700 1 -- 172.21.15.156:0/1479365110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4c812d4a0 msgr2=0x7ff4c812afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:24.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.541+0000 7ff4ce198700 1 --2- 172.21.15.156:0/1479365110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4c812d4a0 0x7ff4c812afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:24.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.541+0000 7ff4ce198700 1 -- 172.21.15.156:0/1479365110 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c40092a0 con 0x7ff4c812b4c0 2023-09-30T22:16:24.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.541+0000 7ff4cd196700 1 --2- 172.21.15.156:0/1479365110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4c812d4a0 0x7ff4c812afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:24.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.541+0000 7ff4ce198700 1 --2- 172.21.15.156:0/1479365110 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4c812b4c0 0x7ff4c812b920 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7ff4c8093840 tx=0x7ff4c8091d20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:24.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.541+0000 7ff4bdffb700 1 -- 172.21.15.156:0/1479365110 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c001d630 con 0x7ff4c812b4c0 2023-09-30T22:16:24.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.541+0000 7ff4bdffb700 1 -- 172.21.15.156:0/1479365110 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c001d790 con 0x7ff4c812b4c0 2023-09-30T22:16:24.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.541+0000 7ff4bdffb700 1 -- 172.21.15.156:0/1479365110 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c001db50 con 0x7ff4c812b4c0 2023-09-30T22:16:24.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.541+0000 7ff4cfbfb700 1 -- 172.21.15.156:0/1479365110 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c0009a20 con 0x7ff4c812b4c0 2023-09-30T22:16:24.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.542+0000 7ff4cfbfb700 1 -- 172.21.15.156:0/1479365110 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c8118aa0 con 0x7ff4c812b4c0 2023-09-30T22:16:24.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.542+0000 7ff4bdffb700 1 -- 172.21.15.156:0/1479365110 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7ff4c0003040 con 0x7ff4c812b4c0 2023-09-30T22:16:24.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.542+0000 7ff4bdffb700 1 -- 172.21.15.156:0/1479365110 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2803+0+0 (secure 0 0 0) 0x7ff4c003ca10 con 0x7ff4c812b4c0 2023-09-30T22:16:24.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.543+0000 7ff4cfbfb700 1 -- 172.21.15.156:0/1479365110 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c8118d30 con 0x7ff4c812b4c0 2023-09-30T22:16:24.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.547+0000 7ff4bdffb700 1 -- 172.21.15.156:0/1479365110 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7ff4c001b310 con 0x7ff4c812b4c0 2023-09-30T22:16:24.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:24.707+0000 7ff4cfbfb700 1 -- 172.21.15.156:0/1479365110 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff4c805a260 con 0x7ff4c812b4c0 2023-09-30T22:16:25.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.411+0000 7ff4bdffb700 1 -- 172.21.15.156:0/1479365110 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v11) v1 ==== 173+0+0 (secure 0 0 0) 0x7ff4c0026bb0 con 0x7ff4c812b4c0 2023-09-30T22:16:25.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.415+0000 7ff4cfbfb700 1 -- 172.21.15.156:0/1479365110 >> v1:172.21.15.156:6816/118236 conn(0x7ff4ac02bb30 legacy=0x7ff4ac02dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:25.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.415+0000 7ff4cfbfb700 1 -- 172.21.15.156:0/1479365110 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4c812b4c0 msgr2=0x7ff4c812b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:25.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.415+0000 7ff4cfbfb700 1 --2- 172.21.15.156:0/1479365110 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4c812b4c0 0x7ff4c812b920 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7ff4c8093840 tx=0x7ff4c8091d20).stop 2023-09-30T22:16:25.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.415+0000 7ff4cfbfb700 1 -- 172.21.15.156:0/1479365110 shutdown_connections 2023-09-30T22:16:25.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.415+0000 7ff4cfbfb700 1 --2- 172.21.15.156:0/1479365110 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4c812b4c0 0x7ff4c812b920 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:25.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.415+0000 7ff4cfbfb700 1 --2- 172.21.15.156:0/1479365110 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4c812abc0 0x7ff4c8119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:25.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.415+0000 7ff4cfbfb700 1 --2- 172.21.15.156:0/1479365110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4c812d4a0 0x7ff4c812afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:25.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.415+0000 7ff4cfbfb700 1 -- 172.21.15.156:0/1479365110 >> 172.21.15.156:0/1479365110 conn(0x7ff4c8096930 msgr2=0x7ff4c8099a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:25.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.415+0000 7ff4cfbfb700 1 -- 172.21.15.156:0/1479365110 shutdown_connections 2023-09-30T22:16:25.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.415+0000 7ff4cfbfb700 1 -- 172.21.15.156:0/1479365110 wait complete. 2023-09-30T22:16:25.417 INFO:teuthology.orchestra.run.smithi156.stderr:enabled application 'rbd' on pool 'rbd' 2023-09-30T22:16:25.430 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-09-30T22:16:25.430 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-30T22:16:25.430 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-30T22:16:25.432 INFO:tasks.ceph.mds.a:Started 2023-09-30T22:16:25.433 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-09-30T22:16:25.433 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:16:25.513 INFO:tasks.ceph.mds.a.smithi156.stdout:starting mds.a at 2023-09-30T22:16:25.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.558+0000 7f4ccac3c700 1 Processor -- start 2023-09-30T22:16:25.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.558+0000 7f4ccac3c700 1 -- start start 2023-09-30T22:16:25.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.559+0000 7f4ccac3c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4cc4067f40 0x7f4cc4068320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:25.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.559+0000 7f4ccac3c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4cc412ce50 0x7f4cc412f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:25.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.559+0000 7f4ccac3c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cc4069160 con 0x7f4cc4069790 2023-09-30T22:16:25.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.559+0000 7f4ccac3c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cc4092820 con 0x7f4cc412ce50 2023-09-30T22:16:25.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.559+0000 7f4ccac3c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc40923b0 con 0x7f4cc4067f40 2023-09-30T22:16:25.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.559+0000 7f4cc89d8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4cc4067f40 0x7f4cc4068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:25.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.559+0000 7f4cc91d9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4cc412ce50 0x7f4cc412f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:25.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.559+0000 7f4cc91d9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4cc412ce50 0x7f4cc412f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60886/0 (socket says 172.21.15.156:60886) 2023-09-30T22:16:25.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.559+0000 7f4cc3fff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4cc4069790 0x7f4cc4068810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45722/0 (socket says 172.21.15.156:45722) 2023-09-30T22:16:25.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.559+0000 7f4cc89d8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4cc4067f40 0x7f4cc4068320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55932/0 (socket says 172.21.15.156:55932) 2023-09-30T22:16:25.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.559+0000 7f4cc91d9700 1 -- 172.21.15.156:0/504857026 learned_addr learned my addr 172.21.15.156:0/504857026 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:25.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.559+0000 7f4cc91d9700 1 -- 172.21.15.156:0/504857026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4cc4067f40 msgr2=0x7f4cc4068320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:25.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.559+0000 7f4cc91d9700 1 --2- 172.21.15.156:0/504857026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4cc4067f40 0x7f4cc4068320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:25.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.559+0000 7f4cc91d9700 1 -- 172.21.15.156:0/504857026 >> v1:172.21.15.156:6789/0 conn(0x7f4cc4069790 legacy=0x7f4cc4068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:25.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.559+0000 7f4cc91d9700 1 -- 172.21.15.156:0/504857026 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc4093310 con 0x7f4cc412ce50 2023-09-30T22:16:25.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.559+0000 7f4cc91d9700 1 --2- 172.21.15.156:0/504857026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cc412ce50 0x7f4cc412f240 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f4cbc00d1a0 tx=0x7f4cbc00ba50).ready entity=mon.0 client_cookie=af8b518f09048197 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:25.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.559+0000 7f4cc37fe700 1 -- 172.21.15.156:0/504857026 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc010070 con 0x7f4cc412ce50 2023-09-30T22:16:25.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.559+0000 7f4cc37fe700 1 -- 172.21.15.156:0/504857026 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cbc00de10 con 0x7f4cc412ce50 2023-09-30T22:16:25.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.559+0000 7f4cc37fe700 1 -- 172.21.15.156:0/504857026 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc00b2e0 con 0x7f4cc412ce50 2023-09-30T22:16:25.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.560+0000 7f4ccac3c700 1 -- 172.21.15.156:0/504857026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cc412ce50 msgr2=0x7f4cc412f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:25.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.560+0000 7f4ccac3c700 1 --2- 172.21.15.156:0/504857026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cc412ce50 0x7f4cc412f240 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f4cbc00d1a0 tx=0x7f4cbc00ba50).stop 2023-09-30T22:16:25.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.560+0000 7f4ccac3c700 1 -- 172.21.15.156:0/504857026 shutdown_connections 2023-09-30T22:16:25.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.560+0000 7f4ccac3c700 1 --2- 172.21.15.156:0/504857026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cc412ce50 0x7f4cc412f240 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:25.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.560+0000 7f4ccac3c700 1 --2- 172.21.15.156:0/504857026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4cc4067f40 0x7f4cc4068320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:25.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.560+0000 7f4ccac3c700 1 -- 172.21.15.156:0/504857026 >> 172.21.15.156:0/504857026 conn(0x7f4cc409a230 msgr2=0x7f4cc409a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:25.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.560+0000 7f4ccac3c700 1 -- 172.21.15.156:0/504857026 shutdown_connections 2023-09-30T22:16:25.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.560+0000 7f4ccac3c700 1 -- 172.21.15.156:0/504857026 wait complete. 2023-09-30T22:16:25.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.561+0000 7f4ccac3c700 1 Processor -- start 2023-09-30T22:16:25.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.561+0000 7f4ccac3c700 1 -- start start 2023-09-30T22:16:25.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.562+0000 7f4ccac3c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4cc4067f40 0x7f4cc4111a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:25.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.562+0000 7f4ccac3c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cc4069790 0x7f4cc4111f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:25.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.562+0000 7f4ccac3c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4cc412ce50 0x7f4cc4112460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:25.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.562+0000 7f4ccac3c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc4112950 con 0x7f4cc4069790 2023-09-30T22:16:25.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.562+0000 7f4ccac3c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc4112ef0 con 0x7f4cc412ce50 2023-09-30T22:16:25.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.562+0000 7f4ccac3c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc4115010 con 0x7f4cc4067f40 2023-09-30T22:16:25.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.562+0000 7f4cc3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cc4069790 0x7f4cc4111f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:25.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.562+0000 7f4cc89d8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4cc4067f40 0x7f4cc4111a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:25.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.562+0000 7f4cc3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cc4069790 0x7f4cc4111f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60892/0 (socket says 172.21.15.156:60892) 2023-09-30T22:16:25.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.562+0000 7f4cc3fff700 1 -- 172.21.15.156:0/786639384 learned_addr learned my addr 172.21.15.156:0/786639384 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:25.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.562+0000 7f4cc91d9700 1 --2- 172.21.15.156:0/786639384 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4cc412ce50 0x7f4cc4112460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:25.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.562+0000 7f4cc3fff700 1 -- 172.21.15.156:0/786639384 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4cc4067f40 msgr2=0x7f4cc4111a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:25.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.562+0000 7f4cc3fff700 1 --2- 172.21.15.156:0/786639384 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4cc4067f40 0x7f4cc4111a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:25.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.562+0000 7f4cc3fff700 1 -- 172.21.15.156:0/786639384 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4cc412ce50 msgr2=0x7f4cc4112460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:25.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.562+0000 7f4cc3fff700 1 --2- 172.21.15.156:0/786639384 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4cc412ce50 0x7f4cc4112460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:25.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.562+0000 7f4cc3fff700 1 -- 172.21.15.156:0/786639384 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cbc00bcf0 con 0x7f4cc4069790 2023-09-30T22:16:25.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.562+0000 7f4cc89d8700 1 --2- 172.21.15.156:0/786639384 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4cc4067f40 0x7f4cc4111a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:25.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.563+0000 7f4cc3fff700 1 --2- 172.21.15.156:0/786639384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cc4069790 0x7f4cc4111f70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f4cb800c440 tx=0x7f4cb8007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:25.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.563+0000 7f4cc0ff9700 1 -- 172.21.15.156:0/786639384 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb80070d0 con 0x7f4cc4069790 2023-09-30T22:16:25.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.563+0000 7f4cc0ff9700 1 -- 172.21.15.156:0/786639384 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb8007230 con 0x7f4cc4069790 2023-09-30T22:16:25.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.563+0000 7f4cc0ff9700 1 -- 172.21.15.156:0/786639384 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb80075b0 con 0x7f4cc4069790 2023-09-30T22:16:25.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.563+0000 7f4ccac3c700 1 -- 172.21.15.156:0/786639384 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cc4099020 con 0x7f4cc4069790 2023-09-30T22:16:25.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.563+0000 7f4ccac3c700 1 -- 172.21.15.156:0/786639384 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cc4115c70 con 0x7f4cc4069790 2023-09-30T22:16:25.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.563+0000 7f4cc0ff9700 1 -- 172.21.15.156:0/786639384 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4cb80058f0 con 0x7f4cc4069790 2023-09-30T22:16:25.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.564+0000 7f4cc0ff9700 1 -- 172.21.15.156:0/786639384 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f4cb803a2c0 con 0x7f4cc4069790 2023-09-30T22:16:25.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.564+0000 7f4ccac3c700 1 -- 172.21.15.156:0/786639384 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cc4115510 con 0x7f4cc4069790 2023-09-30T22:16:25.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.569+0000 7f4cc0ff9700 1 -- 172.21.15.156:0/786639384 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4cc4115510 con 0x7f4cc4069790 2023-09-30T22:16:25.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.731+0000 7f4ccac3c700 1 -- 172.21.15.156:0/786639384 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4cc4115510 con 0x7f4cc4069790 2023-09-30T22:16:25.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.731+0000 7f4cc0ff9700 1 -- 172.21.15.156:0/786639384 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+8182 (secure 0 0 0) 0x7f4cc4115510 con 0x7f4cc4069790 2023-09-30T22:16:25.732 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:25.732 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":11,"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","created":"2023-09-30T22:16:15.239992+0000","modified":"2023-09-30T22:16:25.404311+0000","last_up_change":"2023-09-30T22:16:23.392557+0000","last_in_change":"2023-09-30T22:16:16.474206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:16:23.433906+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:16:24.367795+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"3ec2e78a-c61f-473a-bfcb-f956cffe4095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6812","nonce":118781}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6813","nonce":118781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6815","nonce":118781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6814","nonce":118781}]},"public_addr":"172.21.15.156:6812/118781","cluster_addr":"172.21.15.156:6813/118781","heartbeat_back_addr":"172.21.15.156:6815/118781","heartbeat_front_addr":"172.21.15.156:6814/118781","state":["exists","up"]},{"osd":1,"uuid":"b682e683-c15a-4bd9-8712-8af96454e9ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6803","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6805","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6807","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6806","nonce":118763}]},"public_addr":"172.21.15.156:6803/118763","cluster_addr":"172.21.15.156:6805/118763","heartbeat_back_addr":"172.21.15.156:6807/118763","heartbeat_front_addr":"172.21.15.156:6806/118763","state":["exists","up"]},{"osd":2,"uuid":"960dbaf0-2e0c-437e-9114-bc22ce522b26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6808","nonce":118788}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6809","nonce":118788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6811","nonce":118788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6810","nonce":118788}]},"public_addr":"172.21.15.156:6808/118788","cluster_addr":"172.21.15.156:6809/118788","heartbeat_back_addr":"172.21.15.156:6811/118788","heartbeat_front_addr":"172.21.15.156:6810/118788","state":["exists","up"]},{"osd":3,"uuid":"c1b19714-78b1-4869-8721-2f6352a64a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6800","nonce":118764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6801","nonce":118764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6804","nonce":118764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6802","nonce":118764}]},"public_addr":"172.21.15.156:6800/118764","cluster_addr":"172.21.15.156:6801/118764","heartbeat_back_addr":"172.21.15.156:6804/118764","heartbeat_front_addr":"172.21.15.156:6802/118764","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.663343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.827397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.806655+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.634746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:16:25.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.733+0000 7f4ccac3c700 1 -- 172.21.15.156:0/786639384 >> v1:172.21.15.156:6816/118236 conn(0x7f4cb002bb60 legacy=0x7f4cb002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:25.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.733+0000 7f4ccac3c700 1 -- 172.21.15.156:0/786639384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cc4069790 msgr2=0x7f4cc4111f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:25.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.733+0000 7f4ccac3c700 1 --2- 172.21.15.156:0/786639384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cc4069790 0x7f4cc4111f70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f4cb800c440 tx=0x7f4cb8007d90).stop 2023-09-30T22:16:25.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.733+0000 7f4ccac3c700 1 -- 172.21.15.156:0/786639384 shutdown_connections 2023-09-30T22:16:25.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.733+0000 7f4ccac3c700 1 --2- 172.21.15.156:0/786639384 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4cc412ce50 0x7f4cc4112460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:25.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.733+0000 7f4ccac3c700 1 --2- 172.21.15.156:0/786639384 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4cc4067f40 0x7f4cc4111a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:25.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.733+0000 7f4ccac3c700 1 --2- 172.21.15.156:0/786639384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cc4069790 0x7f4cc4111f70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:25.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.733+0000 7f4ccac3c700 1 -- 172.21.15.156:0/786639384 >> 172.21.15.156:0/786639384 conn(0x7f4cc409a230 msgr2=0x7f4cc4097fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:25.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.733+0000 7f4ccac3c700 1 -- 172.21.15.156:0/786639384 shutdown_connections 2023-09-30T22:16:25.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.733+0000 7f4ccac3c700 1 -- 172.21.15.156:0/786639384 wait complete. 2023-09-30T22:16:25.745 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-09-30T22:16:23.433906+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:16:24.367795+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-30T22:16:25.746 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-09-30T22:16:25.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.865+0000 7f3f7f59e700 1 Processor -- start 2023-09-30T22:16:25.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.865+0000 7f3f7f59e700 1 -- start start 2023-09-30T22:16:25.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.866+0000 7f3f7f59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f7805f560 0x7f3f7812ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:25.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.866+0000 7f3f7f59e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f7812b790 0x7f3f780964a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:25.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.866+0000 7f3f7f59e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f78066f90 con 0x7f3f7812b370 2023-09-30T22:16:25.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.866+0000 7f3f7f59e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7805f940 con 0x7f3f7805f560 2023-09-30T22:16:25.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.866+0000 7f3f7f59e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f78067650 con 0x7f3f7812b790 2023-09-30T22:16:25.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.866+0000 7f3f7d33a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f7805f560 0x7f3f7812ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:25.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.866+0000 7f3f7cb39700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f3f7812b370 0x7f3f78095d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45734/0 (socket says 172.21.15.156:45734) 2023-09-30T22:16:25.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.866+0000 7f3f7cb39700 1 -- 172.21.15.156:0/3981835034 learned_addr learned my addr 172.21.15.156:0/3981835034 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:25.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.866+0000 7f3f7db3b700 1 --2- 172.21.15.156:0/3981835034 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f7812b790 0x7f3f780964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:25.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.866+0000 7f3f6ffff700 1 -- 172.21.15.156:0/3981835034 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486757436 0 0) 0x7f3f78066f90 con 0x7f3f7812b370 2023-09-30T22:16:25.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.866+0000 7f3f6ffff700 1 -- 172.21.15.156:0/3981835034 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f640033f0 con 0x7f3f7812b370 2023-09-30T22:16:25.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.866+0000 7f3f7d33a700 1 -- 172.21.15.156:0/3981835034 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f7812b790 msgr2=0x7f3f780964a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:25.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.866+0000 7f3f7d33a700 1 --2- 172.21.15.156:0/3981835034 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f7812b790 0x7f3f780964a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:25.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.866+0000 7f3f7d33a700 1 -- 172.21.15.156:0/3981835034 >> v1:172.21.15.156:6789/0 conn(0x7f3f7812b370 legacy=0x7f3f78095d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:25.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.866+0000 7f3f7d33a700 1 -- 172.21.15.156:0/3981835034 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f78067910 con 0x7f3f7805f560 2023-09-30T22:16:25.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.866+0000 7f3f7db3b700 1 --2- 172.21.15.156:0/3981835034 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f7812b790 0x7f3f780964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:25.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.866+0000 7f3f7d33a700 1 --2- 172.21.15.156:0/3981835034 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f7805f560 0x7f3f7812ae80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f3f68009790 tx=0x7f3f68009060).ready entity=mon.1 client_cookie=ceae7cf98867311d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:25.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.867+0000 7f3f6ffff700 1 -- 172.21.15.156:0/3981835034 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6800f510 con 0x7f3f7805f560 2023-09-30T22:16:25.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.867+0000 7f3f6ffff700 1 -- 172.21.15.156:0/3981835034 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6800f670 con 0x7f3f7805f560 2023-09-30T22:16:25.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.867+0000 7f3f6ffff700 1 -- 172.21.15.156:0/3981835034 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6800f9f0 con 0x7f3f7805f560 2023-09-30T22:16:25.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.867+0000 7f3f7f59e700 1 -- 172.21.15.156:0/3981835034 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f7805f560 msgr2=0x7f3f7812ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:25.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.867+0000 7f3f7f59e700 1 --2- 172.21.15.156:0/3981835034 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f7805f560 0x7f3f7812ae80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f3f68009790 tx=0x7f3f68009060).stop 2023-09-30T22:16:25.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.867+0000 7f3f7f59e700 1 -- 172.21.15.156:0/3981835034 shutdown_connections 2023-09-30T22:16:25.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.867+0000 7f3f7f59e700 1 --2- 172.21.15.156:0/3981835034 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f7805f560 0x7f3f7812ae80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:25.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.867+0000 7f3f7f59e700 1 --2- 172.21.15.156:0/3981835034 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f7812b790 0x7f3f780964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:25.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.867+0000 7f3f7f59e700 1 -- 172.21.15.156:0/3981835034 >> 172.21.15.156:0/3981835034 conn(0x7f3f7809a1c0 msgr2=0x7f3f7809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:25.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.867+0000 7f3f7f59e700 1 -- 172.21.15.156:0/3981835034 shutdown_connections 2023-09-30T22:16:25.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.867+0000 7f3f7f59e700 1 -- 172.21.15.156:0/3981835034 wait complete. 2023-09-30T22:16:25.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.868+0000 7f3f7f59e700 1 Processor -- start 2023-09-30T22:16:25.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.868+0000 7f3f7f59e700 1 -- start start 2023-09-30T22:16:25.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.869+0000 7f3f7f59e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f7805f560 0x7f3f7811b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:25.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.869+0000 7f3f7f59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f7812b370 0x7f3f781172b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:25.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.869+0000 7f3f7f59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f7812b790 0x7f3f781177a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:25.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.869+0000 7f3f7f59e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f78128330 con 0x7f3f7812b370 2023-09-30T22:16:25.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.869+0000 7f3f7f59e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f780671c0 con 0x7f3f7812b790 2023-09-30T22:16:25.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.869+0000 7f3f7f59e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7811a790 con 0x7f3f7805f560 2023-09-30T22:16:25.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.869+0000 7f3f7cb39700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f7812b370 0x7f3f781172b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:25.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.869+0000 7f3f7cb39700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f7812b370 0x7f3f781172b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60902/0 (socket says 172.21.15.156:60902) 2023-09-30T22:16:25.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.869+0000 7f3f7d33a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f7805f560 0x7f3f7811b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:25.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.869+0000 7f3f7cb39700 1 -- 172.21.15.156:0/3181244792 learned_addr learned my addr 172.21.15.156:0/3181244792 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:25.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.869+0000 7f3f7db3b700 1 --2- 172.21.15.156:0/3181244792 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f7812b790 0x7f3f781177a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:25.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.870+0000 7f3f7cb39700 1 -- 172.21.15.156:0/3181244792 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f7805f560 msgr2=0x7f3f7811b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:25.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.870+0000 7f3f7cb39700 1 --2- 172.21.15.156:0/3181244792 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f7805f560 0x7f3f7811b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:25.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.870+0000 7f3f7cb39700 1 -- 172.21.15.156:0/3181244792 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f7812b790 msgr2=0x7f3f781177a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:25.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.870+0000 7f3f7cb39700 1 --2- 172.21.15.156:0/3181244792 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f7812b790 0x7f3f781177a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:25.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.870+0000 7f3f7cb39700 1 -- 172.21.15.156:0/3181244792 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f70009a20 con 0x7f3f7812b370 2023-09-30T22:16:25.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.870+0000 7f3f7d33a700 1 --2- 172.21.15.156:0/3181244792 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f7805f560 0x7f3f7811b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:25.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.870+0000 7f3f7cb39700 1 --2- 172.21.15.156:0/3181244792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f7812b370 0x7f3f781172b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f3f7400c4c0 tx=0x7f3f74007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:25.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.870+0000 7f3f6d7fa700 1 -- 172.21.15.156:0/3181244792 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f740072e0 con 0x7f3f7812b370 2023-09-30T22:16:25.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.870+0000 7f3f6d7fa700 1 -- 172.21.15.156:0/3181244792 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f74007440 con 0x7f3f7812b370 2023-09-30T22:16:25.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.870+0000 7f3f7f59e700 1 -- 172.21.15.156:0/3181244792 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f680092a0 con 0x7f3f7812b370 2023-09-30T22:16:25.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.870+0000 7f3f6d7fa700 1 -- 172.21.15.156:0/3181244792 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f740057a0 con 0x7f3f7812b370 2023-09-30T22:16:25.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.870+0000 7f3f7f59e700 1 -- 172.21.15.156:0/3181244792 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f78118df0 con 0x7f3f7812b370 2023-09-30T22:16:25.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.870+0000 7f3f6d7fa700 1 -- 172.21.15.156:0/3181244792 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3f74005bd0 con 0x7f3f7812b370 2023-09-30T22:16:25.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.871+0000 7f3f6d7fa700 1 -- 172.21.15.156:0/3181244792 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f3f7403a4b0 con 0x7f3f7812b370 2023-09-30T22:16:25.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.871+0000 7f3f7f59e700 1 -- 172.21.15.156:0/3181244792 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f7805a260 con 0x7f3f7812b370 2023-09-30T22:16:25.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:25.875+0000 7f3f6d7fa700 1 -- 172.21.15.156:0/3181244792 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3f7401d3f0 con 0x7f3f7812b370 2023-09-30T22:16:26.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.034+0000 7f3f7f59e700 1 -- 172.21.15.156:0/3181244792 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3f78046c20 con 0x7f3f7812b370 2023-09-30T22:16:26.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.034+0000 7f3f6d7fa700 1 -- 172.21.15.156:0/3181244792 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v11) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3f74007d90 con 0x7f3f7812b370 2023-09-30T22:16:26.035 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 1 2023-09-30T22:16:26.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.036+0000 7f3f7f59e700 1 -- 172.21.15.156:0/3181244792 >> v1:172.21.15.156:6816/118236 conn(0x7f3f5c02bb30 legacy=0x7f3f5c02dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:26.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.036+0000 7f3f7f59e700 1 -- 172.21.15.156:0/3181244792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f7812b370 msgr2=0x7f3f781172b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:26.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.036+0000 7f3f7f59e700 1 --2- 172.21.15.156:0/3181244792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f7812b370 0x7f3f781172b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f3f7400c4c0 tx=0x7f3f74007c50).stop 2023-09-30T22:16:26.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.036+0000 7f3f7f59e700 1 -- 172.21.15.156:0/3181244792 shutdown_connections 2023-09-30T22:16:26.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.036+0000 7f3f7f59e700 1 --2- 172.21.15.156:0/3181244792 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f7812b790 0x7f3f781177a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.036+0000 7f3f7f59e700 1 --2- 172.21.15.156:0/3181244792 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f7805f560 0x7f3f7811b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.036+0000 7f3f7f59e700 1 --2- 172.21.15.156:0/3181244792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f7812b370 0x7f3f781172b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.036+0000 7f3f7f59e700 1 -- 172.21.15.156:0/3181244792 >> 172.21.15.156:0/3181244792 conn(0x7f3f7809a1c0 msgr2=0x7f3f78098650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:26.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.036+0000 7f3f7f59e700 1 -- 172.21.15.156:0/3181244792 shutdown_connections 2023-09-30T22:16:26.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.036+0000 7f3f7f59e700 1 -- 172.21.15.156:0/3181244792 wait complete. 2023-09-30T22:16:26.048 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:16:26.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.167+0000 7f4f2d52c700 1 Processor -- start 2023-09-30T22:16:26.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.167+0000 7f4f2d52c700 1 -- start start 2023-09-30T22:16:26.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.168+0000 7f4f2d52c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f280985e0 0x7f4f280989c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:26.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.168+0000 7f4f2d52c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4f28098eb0 0x7f4f2812f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:26.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.168+0000 7f4f2d52c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f2812f980 0x7f4f28131d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:26.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.168+0000 7f4f2d52c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f2809a3f0 con 0x7f4f28098eb0 2023-09-30T22:16:26.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.168+0000 7f4f2d52c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f280964f0 con 0x7f4f280985e0 2023-09-30T22:16:26.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.168+0000 7f4f2d52c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f28095100 con 0x7f4f2812f980 2023-09-30T22:16:26.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.168+0000 7f4f267fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4f28098eb0 0x7f4f2812f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:26.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.168+0000 7f4f277fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f2812f980 0x7f4f28131d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:26.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.168+0000 7f4f26ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f280985e0 0x7f4f280989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:26.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.168+0000 7f4f267fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4f28098eb0 0x7f4f2812f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60904/0 (socket says 172.21.15.156:60904) 2023-09-30T22:16:26.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.168+0000 7f4f26ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f280985e0 0x7f4f280989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:34176/0 (socket says 172.21.15.156:34176) 2023-09-30T22:16:26.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.168+0000 7f4f277fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f2812f980 0x7f4f28131d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55966/0 (socket says 172.21.15.156:55966) 2023-09-30T22:16:26.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.168+0000 7f4f267fc700 1 -- 172.21.15.156:0/1580076490 learned_addr learned my addr 172.21.15.156:0/1580076490 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:26.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.168+0000 7f4f277fe700 1 -- 172.21.15.156:0/1580076490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f280985e0 msgr2=0x7f4f280989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:26.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.168+0000 7f4f277fe700 1 --2- 172.21.15.156:0/1580076490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f280985e0 0x7f4f280989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.168+0000 7f4f277fe700 1 -- 172.21.15.156:0/1580076490 >> v2:172.21.15.156:3300/0 conn(0x7f4f28098eb0 msgr2=0x7f4f2812f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:26.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.168+0000 7f4f277fe700 1 --2- 172.21.15.156:0/1580076490 >> v2:172.21.15.156:3300/0 conn(0x7f4f28098eb0 0x7f4f2812f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.168+0000 7f4f277fe700 1 -- 172.21.15.156:0/1580076490 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f28099e70 con 0x7f4f2812f980 2023-09-30T22:16:26.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.168+0000 7f4f267fc700 1 --2- 172.21.15.156:0/1580076490 >> v2:172.21.15.156:3300/0 conn(0x7f4f28098eb0 0x7f4f2812f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:26.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.168+0000 7f4f26ffd700 1 --2- 172.21.15.156:0/1580076490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f280985e0 0x7f4f280989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:26.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.169+0000 7f4f277fe700 1 --2- 172.21.15.156:0/1580076490 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f2812f980 0x7f4f28131d70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f4f20009e60 tx=0x7f4f20009780).ready entity=mon.2 client_cookie=56bd698fffc69332 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:26.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.169+0000 7f4f25ffb700 1 -- 172.21.15.156:0/1580076490 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2000e070 con 0x7f4f2812f980 2023-09-30T22:16:26.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.169+0000 7f4f25ffb700 1 -- 172.21.15.156:0/1580076490 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2000bab0 con 0x7f4f2812f980 2023-09-30T22:16:26.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.169+0000 7f4f25ffb700 1 -- 172.21.15.156:0/1580076490 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2000be30 con 0x7f4f2812f980 2023-09-30T22:16:26.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.169+0000 7f4f2d52c700 1 -- 172.21.15.156:0/1580076490 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f2812f980 msgr2=0x7f4f28131d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:26.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.169+0000 7f4f2d52c700 1 --2- 172.21.15.156:0/1580076490 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f2812f980 0x7f4f28131d70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f4f20009e60 tx=0x7f4f20009780).stop 2023-09-30T22:16:26.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.169+0000 7f4f2d52c700 1 -- 172.21.15.156:0/1580076490 shutdown_connections 2023-09-30T22:16:26.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.169+0000 7f4f2d52c700 1 --2- 172.21.15.156:0/1580076490 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f2812f980 0x7f4f28131d70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.169+0000 7f4f2d52c700 1 --2- 172.21.15.156:0/1580076490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f280985e0 0x7f4f280989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.169+0000 7f4f2d52c700 1 --2- 172.21.15.156:0/1580076490 >> v2:172.21.15.156:3300/0 conn(0x7f4f28098eb0 0x7f4f2812f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.169+0000 7f4f2d52c700 1 -- 172.21.15.156:0/1580076490 >> 172.21.15.156:0/1580076490 conn(0x7f4f2809dc40 msgr2=0x7f4f2809e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:26.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.169+0000 7f4f2d52c700 1 -- 172.21.15.156:0/1580076490 shutdown_connections 2023-09-30T22:16:26.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.169+0000 7f4f2d52c700 1 -- 172.21.15.156:0/1580076490 wait complete. 2023-09-30T22:16:26.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.170+0000 7f4f2d52c700 1 Processor -- start 2023-09-30T22:16:26.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.170+0000 7f4f2d52c700 1 -- start start 2023-09-30T22:16:26.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.171+0000 7f4f2d52c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f280985e0 0x7f4f2811e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:26.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.171+0000 7f4f2d52c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f28098eb0 0x7f4f2811a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:26.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.171+0000 7f4f2d52c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f2812f980 0x7f4f2811abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:26.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.171+0000 7f4f2d52c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2811d830 con 0x7f4f2812f980 2023-09-30T22:16:26.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.171+0000 7f4f2d52c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2809cc80 con 0x7f4f28098eb0 2023-09-30T22:16:26.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.171+0000 7f4f2d52c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2809a0f0 con 0x7f4f280985e0 2023-09-30T22:16:26.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.171+0000 7f4f26ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f280985e0 0x7f4f2811e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:26.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.171+0000 7f4f267fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f28098eb0 0x7f4f2811a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:26.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.171+0000 7f4f277fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f2812f980 0x7f4f2811abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:26.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.171+0000 7f4f267fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f28098eb0 0x7f4f2811a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:34188/0 (socket says 172.21.15.156:34188) 2023-09-30T22:16:26.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.171+0000 7f4f277fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f2812f980 0x7f4f2811abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60916/0 (socket says 172.21.15.156:60916) 2023-09-30T22:16:26.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.171+0000 7f4f26ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f280985e0 0x7f4f2811e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55980/0 (socket says 172.21.15.156:55980) 2023-09-30T22:16:26.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.171+0000 7f4f277fe700 1 -- 172.21.15.156:0/3738280884 learned_addr learned my addr 172.21.15.156:0/3738280884 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:26.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.171+0000 7f4f267fc700 1 -- 172.21.15.156:0/3738280884 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f280985e0 msgr2=0x7f4f2811e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:26.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.171+0000 7f4f267fc700 1 --2- 172.21.15.156:0/3738280884 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f280985e0 0x7f4f2811e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.171+0000 7f4f267fc700 1 -- 172.21.15.156:0/3738280884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f2812f980 msgr2=0x7f4f2811abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:26.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.171+0000 7f4f267fc700 1 --2- 172.21.15.156:0/3738280884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f2812f980 0x7f4f2811abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.171+0000 7f4f267fc700 1 -- 172.21.15.156:0/3738280884 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f180092a0 con 0x7f4f28098eb0 2023-09-30T22:16:26.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.171+0000 7f4f277fe700 1 --2- 172.21.15.156:0/3738280884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f2812f980 0x7f4f2811abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:26.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.171+0000 7f4f26ffd700 1 --2- 172.21.15.156:0/3738280884 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f280985e0 0x7f4f2811e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:26.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.171+0000 7f4f267fc700 1 --2- 172.21.15.156:0/3738280884 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f28098eb0 0x7f4f2811a6f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f4f1c006fd0 tx=0x7f4f1c0090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:26.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.171+0000 7f4f0effd700 1 -- 172.21.15.156:0/3738280884 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c009650 con 0x7f4f28098eb0 2023-09-30T22:16:26.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.171+0000 7f4f0effd700 1 -- 172.21.15.156:0/3738280884 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1c00c6a0 con 0x7f4f28098eb0 2023-09-30T22:16:26.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.171+0000 7f4f2d52c700 1 -- 172.21.15.156:0/3738280884 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f1c009370 con 0x7f4f28098eb0 2023-09-30T22:16:26.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.171+0000 7f4f0effd700 1 -- 172.21.15.156:0/3738280884 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c00ca20 con 0x7f4f28098eb0 2023-09-30T22:16:26.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.172+0000 7f4f2d52c700 1 -- 172.21.15.156:0/3738280884 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f20009a20 con 0x7f4f28098eb0 2023-09-30T22:16:26.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.172+0000 7f4f0effd700 1 -- 172.21.15.156:0/3738280884 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4f1c01b400 con 0x7f4f28098eb0 2023-09-30T22:16:26.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.172+0000 7f4f0effd700 1 -- 172.21.15.156:0/3738280884 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f4f1c03b0b0 con 0x7f4f28098eb0 2023-09-30T22:16:26.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.172+0000 7f4f2d52c700 1 -- 172.21.15.156:0/3738280884 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f2805a260 con 0x7f4f28098eb0 2023-09-30T22:16:26.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.177+0000 7f4f0effd700 1 -- 172.21.15.156:0/3738280884 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4f1c019310 con 0x7f4f28098eb0 2023-09-30T22:16:26.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.333+0000 7f4f2d52c700 1 -- 172.21.15.156:0/3738280884 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4f28097030 con 0x7f4f28098eb0 2023-09-30T22:16:26.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.334+0000 7f4f0effd700 1 -- 172.21.15.156:0/3738280884 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v11) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4f1c023350 con 0x7f4f28098eb0 2023-09-30T22:16:26.334 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 8 2023-09-30T22:16:26.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.335+0000 7f4f2d52c700 1 -- 172.21.15.156:0/3738280884 >> v1:172.21.15.156:6816/118236 conn(0x7f4f1402bb60 legacy=0x7f4f1402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:26.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.336+0000 7f4f2d52c700 1 -- 172.21.15.156:0/3738280884 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f28098eb0 msgr2=0x7f4f2811a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:26.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.336+0000 7f4f2d52c700 1 --2- 172.21.15.156:0/3738280884 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f28098eb0 0x7f4f2811a6f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f4f1c006fd0 tx=0x7f4f1c0090f0).stop 2023-09-30T22:16:26.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.336+0000 7f4f2d52c700 1 -- 172.21.15.156:0/3738280884 shutdown_connections 2023-09-30T22:16:26.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.336+0000 7f4f2d52c700 1 --2- 172.21.15.156:0/3738280884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f2812f980 0x7f4f2811abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.336+0000 7f4f2d52c700 1 --2- 172.21.15.156:0/3738280884 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f280985e0 0x7f4f2811e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.336+0000 7f4f2d52c700 1 --2- 172.21.15.156:0/3738280884 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f28098eb0 0x7f4f2811a6f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.336+0000 7f4f2d52c700 1 -- 172.21.15.156:0/3738280884 >> 172.21.15.156:0/3738280884 conn(0x7f4f2809dc40 msgr2=0x7f4f28114300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:26.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.336+0000 7f4f2d52c700 1 -- 172.21.15.156:0/3738280884 shutdown_connections 2023-09-30T22:16:26.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.336+0000 7f4f2d52c700 1 -- 172.21.15.156:0/3738280884 wait complete. 2023-09-30T22:16:26.348 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:16:26.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.468+0000 7f22dac17700 1 Processor -- start 2023-09-30T22:16:26.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.468+0000 7f22dac17700 1 -- start start 2023-09-30T22:16:26.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.468+0000 7f22dac17700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f22d4062b00 0x7f22d41257c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:26.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.468+0000 7f22dac17700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f22d4125330 0x7f22d4125cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:26.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.468+0000 7f22dac17700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22d4095950 con 0x7f22d4093b90 2023-09-30T22:16:26.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.468+0000 7f22dac17700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22d4062ee0 con 0x7f22d4125330 2023-09-30T22:16:26.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.468+0000 7f22dac17700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22d40969c0 con 0x7f22d4062b00 2023-09-30T22:16:26.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.468+0000 7f22d89b3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f22d4062b00 0x7f22d41257c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:26.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.468+0000 7f22d3fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f22d4125330 0x7f22d4125cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:26.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.468+0000 7f22d89b3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f22d4062b00 0x7f22d41257c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55994/0 (socket says 172.21.15.156:55994) 2023-09-30T22:16:26.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.468+0000 7f22d91b4700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f22d4093b90 0x7f22d4094040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45736/0 (socket says 172.21.15.156:45736) 2023-09-30T22:16:26.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.468+0000 7f22d89b3700 1 -- 172.21.15.156:0/2077081096 learned_addr learned my addr 172.21.15.156:0/2077081096 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:26.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.468+0000 7f22d89b3700 1 -- 172.21.15.156:0/2077081096 >> v2:172.21.15.156:3300/0 conn(0x7f22d4125330 msgr2=0x7f22d4125cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:26.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.468+0000 7f22d89b3700 1 --2- 172.21.15.156:0/2077081096 >> v2:172.21.15.156:3300/0 conn(0x7f22d4125330 0x7f22d4125cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.469+0000 7f22d89b3700 1 -- 172.21.15.156:0/2077081096 >> v1:172.21.15.156:6789/0 conn(0x7f22d4093b90 legacy=0x7f22d4094040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:26.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.469+0000 7f22d89b3700 1 -- 172.21.15.156:0/2077081096 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d40635f0 con 0x7f22d4062b00 2023-09-30T22:16:26.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.469+0000 7f22d37fe700 1 -- 172.21.15.156:0/2077081096 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3640002776 0 0) 0x7f22d4095950 con 0x7f22d4093b90 2023-09-30T22:16:26.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.469+0000 7f22d3fff700 1 --2- 172.21.15.156:0/2077081096 >> v2:172.21.15.156:3300/0 conn(0x7f22d4125330 0x7f22d4125cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:26.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.469+0000 7f22d89b3700 1 --2- 172.21.15.156:0/2077081096 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f22d4062b00 0x7f22d41257c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f22c8006fd0 tx=0x7f22c80090f0).ready entity=mon.2 client_cookie=1ba6554e1bbc3235 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:26.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.469+0000 7f22d37fe700 1 -- 172.21.15.156:0/2077081096 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c800b580 con 0x7f22d4062b00 2023-09-30T22:16:26.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.469+0000 7f22d37fe700 1 -- 172.21.15.156:0/2077081096 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c800b6e0 con 0x7f22d4062b00 2023-09-30T22:16:26.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.469+0000 7f22d37fe700 1 -- 172.21.15.156:0/2077081096 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c800ba60 con 0x7f22d4062b00 2023-09-30T22:16:26.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.469+0000 7f22dac17700 1 -- 172.21.15.156:0/2077081096 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f22d4062b00 msgr2=0x7f22d41257c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:26.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.469+0000 7f22dac17700 1 --2- 172.21.15.156:0/2077081096 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f22d4062b00 0x7f22d41257c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f22c8006fd0 tx=0x7f22c80090f0).stop 2023-09-30T22:16:26.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.469+0000 7f22dac17700 1 -- 172.21.15.156:0/2077081096 shutdown_connections 2023-09-30T22:16:26.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.469+0000 7f22dac17700 1 --2- 172.21.15.156:0/2077081096 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f22d4062b00 0x7f22d41257c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.469+0000 7f22dac17700 1 --2- 172.21.15.156:0/2077081096 >> v2:172.21.15.156:3300/0 conn(0x7f22d4125330 0x7f22d4125cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.469+0000 7f22dac17700 1 -- 172.21.15.156:0/2077081096 >> 172.21.15.156:0/2077081096 conn(0x7f22d409aa50 msgr2=0x7f22d409ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:26.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.469+0000 7f22dac17700 1 -- 172.21.15.156:0/2077081096 shutdown_connections 2023-09-30T22:16:26.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.469+0000 7f22dac17700 1 -- 172.21.15.156:0/2077081096 wait complete. 2023-09-30T22:16:26.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.470+0000 7f22dac17700 1 Processor -- start 2023-09-30T22:16:26.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.470+0000 7f22dac17700 1 -- start start 2023-09-30T22:16:26.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.471+0000 7f22dac17700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22d4062b00 0x7f22d4138320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:26.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.471+0000 7f22dac17700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f22d4093b90 0x7f22d4138810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:26.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.471+0000 7f22dac17700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f22d4138d00 0x7f22d4067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:26.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.471+0000 7f22dac17700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d412d0e0 con 0x7f22d4062b00 2023-09-30T22:16:26.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.471+0000 7f22dac17700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d4124bc0 con 0x7f22d4138d00 2023-09-30T22:16:26.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.471+0000 7f22dac17700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22d4095ae0 con 0x7f22d4093b90 2023-09-30T22:16:26.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.471+0000 7f22d3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f22d4093b90 0x7f22d4138810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:26.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.471+0000 7f22d91b4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f22d4138d00 0x7f22d4067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:26.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.471+0000 7f22d89b3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22d4062b00 0x7f22d4138320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:26.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.471+0000 7f22d3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f22d4093b90 0x7f22d4138810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56006/0 (socket says 172.21.15.156:56006) 2023-09-30T22:16:26.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.471+0000 7f22d3fff700 1 -- 172.21.15.156:0/2699563253 learned_addr learned my addr 172.21.15.156:0/2699563253 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:26.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.471+0000 7f22d89b3700 1 -- 172.21.15.156:0/2699563253 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f22d4093b90 msgr2=0x7f22d4138810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:26.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.471+0000 7f22d89b3700 1 --2- 172.21.15.156:0/2699563253 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f22d4093b90 0x7f22d4138810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.471+0000 7f22d89b3700 1 -- 172.21.15.156:0/2699563253 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f22d4138d00 msgr2=0x7f22d4067b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:26.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.471+0000 7f22d89b3700 1 --2- 172.21.15.156:0/2699563253 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f22d4138d00 0x7f22d4067b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.471+0000 7f22d89b3700 1 -- 172.21.15.156:0/2699563253 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c00092a0 con 0x7f22d4062b00 2023-09-30T22:16:26.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.471+0000 7f22d3fff700 1 --2- 172.21.15.156:0/2699563253 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f22d4093b90 0x7f22d4138810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:26.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.471+0000 7f22d91b4700 1 --2- 172.21.15.156:0/2699563253 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f22d4138d00 0x7f22d4067b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:26.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.471+0000 7f22d89b3700 1 --2- 172.21.15.156:0/2699563253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22d4062b00 0x7f22d4138320 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f22c8006fd0 tx=0x7f22c8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:26.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.471+0000 7f22d0ff9700 1 -- 172.21.15.156:0/2699563253 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c8006a40 con 0x7f22d4062b00 2023-09-30T22:16:26.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.472+0000 7f22d0ff9700 1 -- 172.21.15.156:0/2699563253 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c8000bc0 con 0x7f22d4062b00 2023-09-30T22:16:26.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.472+0000 7f22dac17700 1 -- 172.21.15.156:0/2699563253 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c8009370 con 0x7f22d4062b00 2023-09-30T22:16:26.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.472+0000 7f22d0ff9700 1 -- 172.21.15.156:0/2699563253 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c801c420 con 0x7f22d4062b00 2023-09-30T22:16:26.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.472+0000 7f22dac17700 1 -- 172.21.15.156:0/2699563253 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d4111bd0 con 0x7f22d4062b00 2023-09-30T22:16:26.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.472+0000 7f22d0ff9700 1 -- 172.21.15.156:0/2699563253 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f22c801c790 con 0x7f22d4062b00 2023-09-30T22:16:26.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.473+0000 7f22d0ff9700 1 -- 172.21.15.156:0/2699563253 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f22c803c840 con 0x7f22d4062b00 2023-09-30T22:16:26.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.473+0000 7f22dac17700 1 -- 172.21.15.156:0/2699563253 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22d405a260 con 0x7f22d4062b00 2023-09-30T22:16:26.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.477+0000 7f22d0ff9700 1 -- 172.21.15.156:0/2699563253 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f22c8020020 con 0x7f22d4062b00 2023-09-30T22:16:26.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.674+0000 7f22dac17700 1 -- 172.21.15.156:0/2699563253 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22d4046c20 con 0x7f22d4062b00 2023-09-30T22:16:26.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.674+0000 7f22d0ff9700 1 -- 172.21.15.156:0/2699563253 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1198 (secure 0 0 0) 0x7f22c802d940 con 0x7f22d4062b00 2023-09-30T22:16:26.675 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:26.675 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4206,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6817/3817969673","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6817","nonce":3817969673}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-09-30T22:16:26.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.676+0000 7f22dac17700 1 -- 172.21.15.156:0/2699563253 >> v1:172.21.15.156:6816/118236 conn(0x7f22b802bb60 legacy=0x7f22b802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:26.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.676+0000 7f22dac17700 1 -- 172.21.15.156:0/2699563253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22d4062b00 msgr2=0x7f22d4138320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:26.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.676+0000 7f22dac17700 1 --2- 172.21.15.156:0/2699563253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22d4062b00 0x7f22d4138320 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f22c8006fd0 tx=0x7f22c8017000).stop 2023-09-30T22:16:26.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.676+0000 7f22dac17700 1 -- 172.21.15.156:0/2699563253 shutdown_connections 2023-09-30T22:16:26.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.676+0000 7f22dac17700 1 --2- 172.21.15.156:0/2699563253 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f22d4138d00 0x7f22d4067b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.676+0000 7f22dac17700 1 --2- 172.21.15.156:0/2699563253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22d4062b00 0x7f22d4138320 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.676+0000 7f22dac17700 1 --2- 172.21.15.156:0/2699563253 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f22d4093b90 0x7f22d4138810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.676+0000 7f22dac17700 1 -- 172.21.15.156:0/2699563253 >> 172.21.15.156:0/2699563253 conn(0x7f22d409aa50 msgr2=0x7f22d41232a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:26.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.676+0000 7f22dac17700 1 -- 172.21.15.156:0/2699563253 shutdown_connections 2023-09-30T22:16:26.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.676+0000 7f22dac17700 1 -- 172.21.15.156:0/2699563253 wait complete. 2023-09-30T22:16:26.678 INFO:teuthology.orchestra.run.smithi156.stderr:dumped fsmap epoch 2 2023-09-30T22:16:26.689 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:16:26.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.804+0000 7f39bde79700 1 Processor -- start 2023-09-30T22:16:26.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.804+0000 7f39bde79700 1 -- start start 2023-09-30T22:16:26.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.804+0000 7f39bde79700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f39b805f560 0x7f39b812ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:26.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.804+0000 7f39bde79700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f39b812b370 0x7f39b8095d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:26.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.804+0000 7f39bde79700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f39b812b790 0x7f39b8096280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:26.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.804+0000 7f39bde79700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b805f940 con 0x7f39b812b790 2023-09-30T22:16:26.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.804+0000 7f39bde79700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b8066f90 con 0x7f39b812b370 2023-09-30T22:16:26.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.804+0000 7f39bde79700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39b8067650 con 0x7f39b805f560 2023-09-30T22:16:26.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.805+0000 7f39b6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f39b812b370 0x7f39b8095d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:26.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.805+0000 7f39b7fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f39b812b790 0x7f39b8096280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:26.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.805+0000 7f39b77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f39b805f560 0x7f39b812ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:26.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.805+0000 7f39b77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f39b805f560 0x7f39b812ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56020/0 (socket says 172.21.15.156:56020) 2023-09-30T22:16:26.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.805+0000 7f39b7fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f39b812b790 0x7f39b8096280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60954/0 (socket says 172.21.15.156:60954) 2023-09-30T22:16:26.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.805+0000 7f39b6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f39b812b370 0x7f39b8095d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:34206/0 (socket says 172.21.15.156:34206) 2023-09-30T22:16:26.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.805+0000 7f39b77fe700 1 -- 172.21.15.156:0/178128183 learned_addr learned my addr 172.21.15.156:0/178128183 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:26.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.805+0000 7f39b77fe700 1 -- 172.21.15.156:0/178128183 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f39b812b370 msgr2=0x7f39b8095d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:26.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.805+0000 7f39b77fe700 1 --2- 172.21.15.156:0/178128183 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f39b812b370 0x7f39b8095d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.805+0000 7f39b77fe700 1 -- 172.21.15.156:0/178128183 >> v2:172.21.15.156:3300/0 conn(0x7f39b812b790 msgr2=0x7f39b8096280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:26.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.805+0000 7f39b77fe700 1 --2- 172.21.15.156:0/178128183 >> v2:172.21.15.156:3300/0 conn(0x7f39b812b790 0x7f39b8096280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.805+0000 7f39b77fe700 1 -- 172.21.15.156:0/178128183 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b8067910 con 0x7f39b805f560 2023-09-30T22:16:26.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.805+0000 7f39b7fff700 1 --2- 172.21.15.156:0/178128183 >> v2:172.21.15.156:3300/0 conn(0x7f39b812b790 0x7f39b8096280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:26.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.805+0000 7f39b77fe700 1 --2- 172.21.15.156:0/178128183 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f39b805f560 0x7f39b812ae80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f39ac006fd0 tx=0x7f39ac0090f0).ready entity=mon.2 client_cookie=f03267e0b9bdb0e9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:26.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.805+0000 7f39b67fc700 1 -- 172.21.15.156:0/178128183 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac00f510 con 0x7f39b805f560 2023-09-30T22:16:26.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.805+0000 7f39b67fc700 1 -- 172.21.15.156:0/178128183 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac00f670 con 0x7f39b805f560 2023-09-30T22:16:26.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.805+0000 7f39b67fc700 1 -- 172.21.15.156:0/178128183 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac00f9f0 con 0x7f39b805f560 2023-09-30T22:16:26.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.806+0000 7f39bde79700 1 -- 172.21.15.156:0/178128183 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f39b805f560 msgr2=0x7f39b812ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:26.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.806+0000 7f39bde79700 1 --2- 172.21.15.156:0/178128183 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f39b805f560 0x7f39b812ae80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f39ac006fd0 tx=0x7f39ac0090f0).stop 2023-09-30T22:16:26.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.806+0000 7f39bde79700 1 -- 172.21.15.156:0/178128183 shutdown_connections 2023-09-30T22:16:26.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.806+0000 7f39bde79700 1 --2- 172.21.15.156:0/178128183 >> v2:172.21.15.156:3300/0 conn(0x7f39b812b790 0x7f39b8096280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.806+0000 7f39bde79700 1 --2- 172.21.15.156:0/178128183 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f39b805f560 0x7f39b812ae80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.806+0000 7f39bde79700 1 --2- 172.21.15.156:0/178128183 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f39b812b370 0x7f39b8095d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.806+0000 7f39bde79700 1 -- 172.21.15.156:0/178128183 >> 172.21.15.156:0/178128183 conn(0x7f39b809a1c0 msgr2=0x7f39b809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:26.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.806+0000 7f39bde79700 1 -- 172.21.15.156:0/178128183 shutdown_connections 2023-09-30T22:16:26.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.806+0000 7f39bde79700 1 -- 172.21.15.156:0/178128183 wait complete. 2023-09-30T22:16:26.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.807+0000 7f39bde79700 1 Processor -- start 2023-09-30T22:16:26.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.807+0000 7f39bde79700 1 -- start start 2023-09-30T22:16:26.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.807+0000 7f39bde79700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f39b805f560 0x7f39b811b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:26.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.807+0000 7f39bde79700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39b812b370 0x7f39b8117340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:26.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.807+0000 7f39bde79700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f39b812b790 0x7f39b8117830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:26.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.807+0000 7f39bde79700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b8128450 con 0x7f39b812b370 2023-09-30T22:16:26.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.807+0000 7f39bde79700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b8129660 con 0x7f39b812b790 2023-09-30T22:16:26.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.807+0000 7f39bde79700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39b80671c0 con 0x7f39b805f560 2023-09-30T22:16:26.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.807+0000 7f39b6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39b812b370 0x7f39b8117340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:26.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.807+0000 7f39b7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f39b812b790 0x7f39b8117830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:26.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.807+0000 7f39b77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f39b805f560 0x7f39b811b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:26.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.807+0000 7f39b7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f39b812b790 0x7f39b8117830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:34218/0 (socket says 172.21.15.156:34218) 2023-09-30T22:16:26.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.807+0000 7f39b7fff700 1 -- 172.21.15.156:0/3428501015 learned_addr learned my addr 172.21.15.156:0/3428501015 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:26.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.807+0000 7f39b6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39b812b370 0x7f39b8117340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60968/0 (socket says 172.21.15.156:60968) 2023-09-30T22:16:26.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.808+0000 7f39b7fff700 1 -- 172.21.15.156:0/3428501015 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f39b805f560 msgr2=0x7f39b811b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:26.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.808+0000 7f39b7fff700 1 --2- 172.21.15.156:0/3428501015 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f39b805f560 0x7f39b811b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.808+0000 7f39b7fff700 1 -- 172.21.15.156:0/3428501015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39b812b370 msgr2=0x7f39b8117340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:26.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.808+0000 7f39b7fff700 1 --2- 172.21.15.156:0/3428501015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39b812b370 0x7f39b8117340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.808+0000 7f39b7fff700 1 -- 172.21.15.156:0/3428501015 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b0009a20 con 0x7f39b812b790 2023-09-30T22:16:26.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.808+0000 7f39b77fe700 1 --2- 172.21.15.156:0/3428501015 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f39b805f560 0x7f39b811b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:26.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.808+0000 7f39b6ffd700 1 --2- 172.21.15.156:0/3428501015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39b812b370 0x7f39b8117340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:26.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.808+0000 7f39b7fff700 1 --2- 172.21.15.156:0/3428501015 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f39b812b790 0x7f39b8117830 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f39b000ef90 tx=0x7f39b000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:26.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.808+0000 7f399f7fe700 1 -- 172.21.15.156:0/3428501015 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b000cbd0 con 0x7f39b812b790 2023-09-30T22:16:26.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.808+0000 7f399f7fe700 1 -- 172.21.15.156:0/3428501015 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b000f040 con 0x7f39b812b790 2023-09-30T22:16:26.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.808+0000 7f39bde79700 1 -- 172.21.15.156:0/3428501015 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39ac009370 con 0x7f39b812b790 2023-09-30T22:16:26.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.808+0000 7f399f7fe700 1 -- 172.21.15.156:0/3428501015 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0013400 con 0x7f39b812b790 2023-09-30T22:16:26.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.808+0000 7f39bde79700 1 -- 172.21.15.156:0/3428501015 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b811a880 con 0x7f39b812b790 2023-09-30T22:16:26.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.809+0000 7f39bde79700 1 -- 172.21.15.156:0/3428501015 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b8128c00 con 0x7f39b812b790 2023-09-30T22:16:26.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.809+0000 7f399f7fe700 1 -- 172.21.15.156:0/3428501015 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f39b0013830 con 0x7f39b812b790 2023-09-30T22:16:26.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.809+0000 7f399f7fe700 1 -- 172.21.15.156:0/3428501015 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f39b003b590 con 0x7f39b812b790 2023-09-30T22:16:26.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.813+0000 7f399f7fe700 1 -- 172.21.15.156:0/3428501015 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f39b0007990 con 0x7f39b812b790 2023-09-30T22:16:26.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.972+0000 7f39bde79700 1 -- 172.21.15.156:0/3428501015 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39b811aa40 con 0x7f39b812b790 2023-09-30T22:16:26.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.973+0000 7f399f7fe700 1 -- 172.21.15.156:0/3428501015 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+8156 (secure 0 0 0) 0x7f39b0012e60 con 0x7f39b812b790 2023-09-30T22:16:26.973 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:26.973 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":12,"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","created":"2023-09-30T22:16:15.239992+0000","modified":"2023-09-30T22:16:26.408230+0000","last_up_change":"2023-09-30T22:16:23.392557+0000","last_in_change":"2023-09-30T22:16:16.474206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:16:23.433906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:16:24.367795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"3ec2e78a-c61f-473a-bfcb-f956cffe4095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6812","nonce":118781}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6813","nonce":118781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6815","nonce":118781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6814","nonce":118781}]},"public_addr":"172.21.15.156:6812/118781","cluster_addr":"172.21.15.156:6813/118781","heartbeat_back_addr":"172.21.15.156:6815/118781","heartbeat_front_addr":"172.21.15.156:6814/118781","state":["exists","up"]},{"osd":1,"uuid":"b682e683-c15a-4bd9-8712-8af96454e9ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6803","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6805","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6807","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6806","nonce":118763}]},"public_addr":"172.21.15.156:6803/118763","cluster_addr":"172.21.15.156:6805/118763","heartbeat_back_addr":"172.21.15.156:6807/118763","heartbeat_front_addr":"172.21.15.156:6806/118763","state":["exists","up"]},{"osd":2,"uuid":"960dbaf0-2e0c-437e-9114-bc22ce522b26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6808","nonce":118788}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6809","nonce":118788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6811","nonce":118788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6810","nonce":118788}]},"public_addr":"172.21.15.156:6808/118788","cluster_addr":"172.21.15.156:6809/118788","heartbeat_back_addr":"172.21.15.156:6811/118788","heartbeat_front_addr":"172.21.15.156:6810/118788","state":["exists","up"]},{"osd":3,"uuid":"c1b19714-78b1-4869-8721-2f6352a64a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6800","nonce":118764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6801","nonce":118764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6804","nonce":118764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6802","nonce":118764}]},"public_addr":"172.21.15.156:6800/118764","cluster_addr":"172.21.15.156:6801/118764","heartbeat_back_addr":"172.21.15.156:6804/118764","heartbeat_front_addr":"172.21.15.156:6802/118764","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.663343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.827397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.806655+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.634746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:16:26.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.974+0000 7f39bde79700 1 -- 172.21.15.156:0/3428501015 >> v1:172.21.15.156:6816/118236 conn(0x7f39a402bb60 legacy=0x7f39a402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:26.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.974+0000 7f39bde79700 1 -- 172.21.15.156:0/3428501015 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f39b812b790 msgr2=0x7f39b8117830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:26.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.974+0000 7f39bde79700 1 --2- 172.21.15.156:0/3428501015 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f39b812b790 0x7f39b8117830 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f39b000ef90 tx=0x7f39b000b040).stop 2023-09-30T22:16:26.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.974+0000 7f39bde79700 1 -- 172.21.15.156:0/3428501015 shutdown_connections 2023-09-30T22:16:26.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.974+0000 7f39bde79700 1 --2- 172.21.15.156:0/3428501015 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f39b812b790 0x7f39b8117830 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.974+0000 7f39bde79700 1 --2- 172.21.15.156:0/3428501015 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f39b805f560 0x7f39b811b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.974+0000 7f39bde79700 1 --2- 172.21.15.156:0/3428501015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39b812b370 0x7f39b8117340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:26.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.974+0000 7f39bde79700 1 -- 172.21.15.156:0/3428501015 >> 172.21.15.156:0/3428501015 conn(0x7f39b809a1c0 msgr2=0x7f39b8098880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:26.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.974+0000 7f39bde79700 1 -- 172.21.15.156:0/3428501015 shutdown_connections 2023-09-30T22:16:26.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:26.974+0000 7f39bde79700 1 -- 172.21.15.156:0/3428501015 wait complete. 2023-09-30T22:16:26.987 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-09-30T22:16:23.433906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:16:24.367795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-30T22:16:26.988 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-09-30T22:16:27.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.105+0000 7f38f19be700 1 Processor -- start 2023-09-30T22:16:27.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.105+0000 7f38f19be700 1 -- start start 2023-09-30T22:16:27.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.105+0000 7f38f19be700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f38ec0985e0 0x7f38ec0989c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:27.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.105+0000 7f38f19be700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38ec098eb0 0x7f38ec12f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:27.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.105+0000 7f38f19be700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38ec0964f0 con 0x7f38ec12f980 2023-09-30T22:16:27.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.105+0000 7f38f19be700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38ec09a3f0 con 0x7f38ec0985e0 2023-09-30T22:16:27.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.105+0000 7f38f19be700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec095100 con 0x7f38ec098eb0 2023-09-30T22:16:27.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.106+0000 7f38ea7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38ec098eb0 0x7f38ec12f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:27.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.106+0000 7f38eaffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f38ec0985e0 0x7f38ec0989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:27.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.106+0000 7f38eb7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f38ec12f980 0x7f38ec131d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45750/0 (socket says 172.21.15.156:45750) 2023-09-30T22:16:27.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.106+0000 7f38eb7fe700 1 -- 172.21.15.156:0/2795258296 learned_addr learned my addr 172.21.15.156:0/2795258296 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:27.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.106+0000 7f38eaffd700 1 -- 172.21.15.156:0/2795258296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38ec098eb0 msgr2=0x7f38ec12f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:27.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.106+0000 7f38eaffd700 1 --2- 172.21.15.156:0/2795258296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38ec098eb0 0x7f38ec12f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:27.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.106+0000 7f38eaffd700 1 -- 172.21.15.156:0/2795258296 >> v1:172.21.15.156:6789/0 conn(0x7f38ec12f980 legacy=0x7f38ec131d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:27.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.106+0000 7f38eaffd700 1 -- 172.21.15.156:0/2795258296 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ec099e70 con 0x7f38ec0985e0 2023-09-30T22:16:27.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.106+0000 7f38e9ffb700 1 -- 172.21.15.156:0/2795258296 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1962987518 0 0) 0x7f38ec0964f0 con 0x7f38ec12f980 2023-09-30T22:16:27.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.106+0000 7f38ea7fc700 1 --2- 172.21.15.156:0/2795258296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38ec098eb0 0x7f38ec12f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:27.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.106+0000 7f38eaffd700 1 --2- 172.21.15.156:0/2795258296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38ec0985e0 0x7f38ec0989c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f38e0009760 tx=0x7f38e0009060).ready entity=mon.0 client_cookie=75da88bae524f830 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:27.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.106+0000 7f38e9ffb700 1 -- 172.21.15.156:0/2795258296 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e00090d0 con 0x7f38ec0985e0 2023-09-30T22:16:27.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.106+0000 7f38e9ffb700 1 -- 172.21.15.156:0/2795258296 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e000f510 con 0x7f38ec0985e0 2023-09-30T22:16:27.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.106+0000 7f38e9ffb700 1 -- 172.21.15.156:0/2795258296 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e000f890 con 0x7f38ec0985e0 2023-09-30T22:16:27.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.107+0000 7f38f19be700 1 -- 172.21.15.156:0/2795258296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38ec0985e0 msgr2=0x7f38ec0989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:27.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.107+0000 7f38f19be700 1 --2- 172.21.15.156:0/2795258296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38ec0985e0 0x7f38ec0989c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f38e0009760 tx=0x7f38e0009060).stop 2023-09-30T22:16:27.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.107+0000 7f38f19be700 1 -- 172.21.15.156:0/2795258296 shutdown_connections 2023-09-30T22:16:27.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.107+0000 7f38f19be700 1 --2- 172.21.15.156:0/2795258296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38ec0985e0 0x7f38ec0989c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:27.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.107+0000 7f38f19be700 1 --2- 172.21.15.156:0/2795258296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38ec098eb0 0x7f38ec12f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:27.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.107+0000 7f38f19be700 1 -- 172.21.15.156:0/2795258296 >> 172.21.15.156:0/2795258296 conn(0x7f38ec09dc40 msgr2=0x7f38ec09e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:27.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.107+0000 7f38f19be700 1 -- 172.21.15.156:0/2795258296 shutdown_connections 2023-09-30T22:16:27.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.107+0000 7f38f19be700 1 -- 172.21.15.156:0/2795258296 wait complete. 2023-09-30T22:16:27.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.108+0000 7f38f19be700 1 Processor -- start 2023-09-30T22:16:27.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.108+0000 7f38f19be700 1 -- start start 2023-09-30T22:16:27.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.109+0000 7f38f19be700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38ec0985e0 0x7f38ec11a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:27.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.109+0000 7f38f19be700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38ec098eb0 0x7f38ec11ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:27.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.109+0000 7f38f19be700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38ec12f980 0x7f38ec11b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:27.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.109+0000 7f38f19be700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec09ce50 con 0x7f38ec0985e0 2023-09-30T22:16:27.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.109+0000 7f38f19be700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec11ee60 con 0x7f38ec098eb0 2023-09-30T22:16:27.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.109+0000 7f38f19be700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec09a0f0 con 0x7f38ec12f980 2023-09-30T22:16:27.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.109+0000 7f38eaffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38ec0985e0 0x7f38ec11a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:27.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.109+0000 7f38ea7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38ec098eb0 0x7f38ec11ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:27.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.109+0000 7f38eaffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38ec0985e0 0x7f38ec11a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60982/0 (socket says 172.21.15.156:60982) 2023-09-30T22:16:27.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.109+0000 7f38eaffd700 1 -- 172.21.15.156:0/2315378870 learned_addr learned my addr 172.21.15.156:0/2315378870 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:27.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.109+0000 7f38eb7fe700 1 --2- 172.21.15.156:0/2315378870 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38ec12f980 0x7f38ec11b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:27.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.109+0000 7f38eaffd700 1 -- 172.21.15.156:0/2315378870 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38ec12f980 msgr2=0x7f38ec11b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:27.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.109+0000 7f38eaffd700 1 --2- 172.21.15.156:0/2315378870 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38ec12f980 0x7f38ec11b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:27.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.109+0000 7f38eaffd700 1 -- 172.21.15.156:0/2315378870 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38ec098eb0 msgr2=0x7f38ec11ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:27.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.109+0000 7f38eaffd700 1 --2- 172.21.15.156:0/2315378870 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38ec098eb0 0x7f38ec11ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:27.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.109+0000 7f38eaffd700 1 -- 172.21.15.156:0/2315378870 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38dc0092a0 con 0x7f38ec0985e0 2023-09-30T22:16:27.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.109+0000 7f38ea7fc700 1 --2- 172.21.15.156:0/2315378870 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38ec098eb0 0x7f38ec11ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:27.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.109+0000 7f38eaffd700 1 --2- 172.21.15.156:0/2315378870 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38ec0985e0 0x7f38ec11a750 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f38e0009130 tx=0x7f38e0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:27.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.109+0000 7f38d2ffd700 1 -- 172.21.15.156:0/2315378870 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e000f890 con 0x7f38ec0985e0 2023-09-30T22:16:27.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.109+0000 7f38d2ffd700 1 -- 172.21.15.156:0/2315378870 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e000fc50 con 0x7f38ec0985e0 2023-09-30T22:16:27.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.109+0000 7f38f19be700 1 -- 172.21.15.156:0/2315378870 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38e00092a0 con 0x7f38ec0985e0 2023-09-30T22:16:27.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.109+0000 7f38d2ffd700 1 -- 172.21.15.156:0/2315378870 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e001b410 con 0x7f38ec0985e0 2023-09-30T22:16:27.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.109+0000 7f38f19be700 1 -- 172.21.15.156:0/2315378870 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38ec11d9c0 con 0x7f38ec0985e0 2023-09-30T22:16:27.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.110+0000 7f38d2ffd700 1 -- 172.21.15.156:0/2315378870 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f38e001b840 con 0x7f38ec0985e0 2023-09-30T22:16:27.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.110+0000 7f38d2ffd700 1 -- 172.21.15.156:0/2315378870 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f38e003c5c0 con 0x7f38ec0985e0 2023-09-30T22:16:27.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.110+0000 7f38f19be700 1 -- 172.21.15.156:0/2315378870 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38ec05a260 con 0x7f38ec0985e0 2023-09-30T22:16:27.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.115+0000 7f38d2ffd700 1 -- 172.21.15.156:0/2315378870 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f38e0023400 con 0x7f38ec0985e0 2023-09-30T22:16:27.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.272+0000 7f38f19be700 1 -- 172.21.15.156:0/2315378870 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f38ec09c8d0 con 0x7f38ec0985e0 2023-09-30T22:16:27.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.272+0000 7f38d2ffd700 1 -- 172.21.15.156:0/2315378870 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v12) v1 ==== 110+0+10 (secure 0 0 0) 0x7f38e0028020 con 0x7f38ec0985e0 2023-09-30T22:16:27.273 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 1 2023-09-30T22:16:27.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.274+0000 7f38f19be700 1 -- 172.21.15.156:0/2315378870 >> v1:172.21.15.156:6816/118236 conn(0x7f38d802bb60 legacy=0x7f38d802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:27.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.274+0000 7f38f19be700 1 -- 172.21.15.156:0/2315378870 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38ec0985e0 msgr2=0x7f38ec11a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:27.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.274+0000 7f38f19be700 1 --2- 172.21.15.156:0/2315378870 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38ec0985e0 0x7f38ec11a750 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f38e0009130 tx=0x7f38e0017000).stop 2023-09-30T22:16:27.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.274+0000 7f38f19be700 1 -- 172.21.15.156:0/2315378870 shutdown_connections 2023-09-30T22:16:27.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.274+0000 7f38f19be700 1 --2- 172.21.15.156:0/2315378870 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38ec12f980 0x7f38ec11b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:27.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.274+0000 7f38f19be700 1 --2- 172.21.15.156:0/2315378870 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38ec0985e0 0x7f38ec11a750 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:27.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.274+0000 7f38f19be700 1 --2- 172.21.15.156:0/2315378870 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38ec098eb0 0x7f38ec11ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:27.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.274+0000 7f38f19be700 1 -- 172.21.15.156:0/2315378870 >> 172.21.15.156:0/2315378870 conn(0x7f38ec09dc40 msgr2=0x7f38ec114300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:27.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.274+0000 7f38f19be700 1 -- 172.21.15.156:0/2315378870 shutdown_connections 2023-09-30T22:16:27.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.274+0000 7f38f19be700 1 -- 172.21.15.156:0/2315378870 wait complete. 2023-09-30T22:16:27.286 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:16:27.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.404+0000 7f9710bf8700 1 Processor -- start 2023-09-30T22:16:27.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.405+0000 7f9710bf8700 1 -- start start 2023-09-30T22:16:27.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.405+0000 7f9710bf8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f970c066310 0x7f970c0976f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:27.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.405+0000 7f9710bf8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f970c128260 0x7f970c12b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:27.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.405+0000 7f9710bf8700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f970c0980b0 con 0x7f970c127df0 2023-09-30T22:16:27.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.405+0000 7f9710bf8700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f970c0666f0 con 0x7f970c066310 2023-09-30T22:16:27.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.405+0000 7f9710bf8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f970c065530 con 0x7f970c128260 2023-09-30T22:16:27.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.405+0000 7f970ad9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f970c128260 0x7f970c12b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:27.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.405+0000 7f970a59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f970c066310 0x7f970c0976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:27.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.405+0000 7f9709d9b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f970c127df0 0x7f970c12ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45766/0 (socket says 172.21.15.156:45766) 2023-09-30T22:16:27.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.405+0000 7f970a59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f970c066310 0x7f970c0976f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60998/0 (socket says 172.21.15.156:60998) 2023-09-30T22:16:27.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.405+0000 7f970ad9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f970c128260 0x7f970c12b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56048/0 (socket says 172.21.15.156:56048) 2023-09-30T22:16:27.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.405+0000 7f9709d9b700 1 -- 172.21.15.156:0/899365063 learned_addr learned my addr 172.21.15.156:0/899365063 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:27.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.406+0000 7f970a59c700 1 -- 172.21.15.156:0/899365063 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f970c128260 msgr2=0x7f970c12b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:27.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.406+0000 7f970a59c700 1 --2- 172.21.15.156:0/899365063 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f970c128260 0x7f970c12b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:27.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.406+0000 7f970a59c700 1 -- 172.21.15.156:0/899365063 >> v1:172.21.15.156:6789/0 conn(0x7f970c127df0 legacy=0x7f970c12ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:27.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.406+0000 7f970a59c700 1 -- 172.21.15.156:0/899365063 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970c065850 con 0x7f970c066310 2023-09-30T22:16:27.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.406+0000 7f970959a700 1 -- 172.21.15.156:0/899365063 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225038197 0 0) 0x7f970c0980b0 con 0x7f970c127df0 2023-09-30T22:16:27.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.406+0000 7f970ad9d700 1 --2- 172.21.15.156:0/899365063 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f970c128260 0x7f970c12b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:27.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.406+0000 7f970a59c700 1 --2- 172.21.15.156:0/899365063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f970c066310 0x7f970c0976f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f9700009790 tx=0x7f9700009060).ready entity=mon.0 client_cookie=4543333168a02cce server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:27.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.406+0000 7f970959a700 1 -- 172.21.15.156:0/899365063 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97000090d0 con 0x7f970c066310 2023-09-30T22:16:27.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.406+0000 7f970959a700 1 -- 172.21.15.156:0/899365063 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970000f510 con 0x7f970c066310 2023-09-30T22:16:27.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.406+0000 7f970959a700 1 -- 172.21.15.156:0/899365063 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970000f890 con 0x7f970c066310 2023-09-30T22:16:27.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.406+0000 7f9710bf8700 1 -- 172.21.15.156:0/899365063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f970c066310 msgr2=0x7f970c0976f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:27.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.406+0000 7f9710bf8700 1 --2- 172.21.15.156:0/899365063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f970c066310 0x7f970c0976f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f9700009790 tx=0x7f9700009060).stop 2023-09-30T22:16:27.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.406+0000 7f9710bf8700 1 -- 172.21.15.156:0/899365063 shutdown_connections 2023-09-30T22:16:27.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.406+0000 7f9710bf8700 1 --2- 172.21.15.156:0/899365063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f970c066310 0x7f970c0976f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:27.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.406+0000 7f9710bf8700 1 --2- 172.21.15.156:0/899365063 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f970c128260 0x7f970c12b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:27.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.406+0000 7f9710bf8700 1 -- 172.21.15.156:0/899365063 >> 172.21.15.156:0/899365063 conn(0x7f970c09bad0 msgr2=0x7f970c09bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:27.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.407+0000 7f9710bf8700 1 -- 172.21.15.156:0/899365063 shutdown_connections 2023-09-30T22:16:27.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.407+0000 7f9710bf8700 1 -- 172.21.15.156:0/899365063 wait complete. 2023-09-30T22:16:27.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.407+0000 7f9710bf8700 1 Processor -- start 2023-09-30T22:16:27.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.407+0000 7f9710bf8700 1 -- start start 2023-09-30T22:16:27.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.408+0000 7f9710bf8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f970c066310 0x7f970c124e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.408+0000 7f9710bf8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f970c127df0 0x7f970c113e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.408+0000 7f9710bf8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f970c128260 0x7f970c114370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.408+0000 7f9710bf8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c115320 con 0x7f970c066310 2023-09-30T22:16:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.408+0000 7f9710bf8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970c117db0 con 0x7f970c128260 2023-09-30T22:16:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.408+0000 7f9710bf8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f970c0651c0 con 0x7f970c127df0 2023-09-30T22:16:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.408+0000 7f9709d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f970c127df0 0x7f970c113e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.408+0000 7f9709d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f970c127df0 0x7f970c113e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56058/0 (socket says 172.21.15.156:56058) 2023-09-30T22:16:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.408+0000 7f9709d9b700 1 -- 172.21.15.156:0/3870088933 learned_addr learned my addr 172.21.15.156:0/3870088933 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.408+0000 7f970a59c700 1 --2- 172.21.15.156:0/3870088933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f970c066310 0x7f970c124e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.408+0000 7f970ad9d700 1 --2- 172.21.15.156:0/3870088933 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f970c128260 0x7f970c114370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.408+0000 7f9709d9b700 1 -- 172.21.15.156:0/3870088933 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f970c128260 msgr2=0x7f970c114370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:27.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.408+0000 7f9709d9b700 1 --2- 172.21.15.156:0/3870088933 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f970c128260 0x7f970c114370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:27.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.408+0000 7f9709d9b700 1 -- 172.21.15.156:0/3870088933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f970c066310 msgr2=0x7f970c124e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:27.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.408+0000 7f9709d9b700 1 --2- 172.21.15.156:0/3870088933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f970c066310 0x7f970c124e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:27.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.408+0000 7f9709d9b700 1 -- 172.21.15.156:0/3870088933 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9704009a20 con 0x7f970c127df0 2023-09-30T22:16:27.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.408+0000 7f970a59c700 1 --2- 172.21.15.156:0/3870088933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f970c066310 0x7f970c124e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:27.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.408+0000 7f9709d9b700 1 --2- 172.21.15.156:0/3870088933 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f970c127df0 0x7f970c113e80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f96fc00c4f0 tx=0x7f96fc007c10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:27.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.408+0000 7f96fa7fc700 1 -- 172.21.15.156:0/3870088933 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc0072e0 con 0x7f970c127df0 2023-09-30T22:16:27.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.408+0000 7f96fa7fc700 1 -- 172.21.15.156:0/3870088933 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96fc007460 con 0x7f970c127df0 2023-09-30T22:16:27.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.408+0000 7f96fa7fc700 1 -- 172.21.15.156:0/3870088933 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc0059f0 con 0x7f970c127df0 2023-09-30T22:16:27.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.409+0000 7f9710bf8700 1 -- 172.21.15.156:0/3870088933 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97000092a0 con 0x7f970c127df0 2023-09-30T22:16:27.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.409+0000 7f9710bf8700 1 -- 172.21.15.156:0/3870088933 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f970c1293b0 con 0x7f970c127df0 2023-09-30T22:16:27.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.409+0000 7f96fa7fc700 1 -- 172.21.15.156:0/3870088933 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f96fc013450 con 0x7f970c127df0 2023-09-30T22:16:27.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.409+0000 7f96fa7fc700 1 -- 172.21.15.156:0/3870088933 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f96fc03a330 con 0x7f970c127df0 2023-09-30T22:16:27.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.409+0000 7f9710bf8700 1 -- 172.21.15.156:0/3870088933 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f970c05a260 con 0x7f970c127df0 2023-09-30T22:16:27.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.414+0000 7f96fa7fc700 1 -- 172.21.15.156:0/3870088933 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f96fc0075d0 con 0x7f970c127df0 2023-09-30T22:16:27.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.571+0000 7f9710bf8700 1 -- 172.21.15.156:0/3870088933 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f970c128df0 con 0x7f970c127df0 2023-09-30T22:16:27.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.571+0000 7f96fa7fc700 1 -- 172.21.15.156:0/3870088933 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v12) v1 ==== 92+0+10 (secure 0 0 0) 0x7f96fc010ab0 con 0x7f970c127df0 2023-09-30T22:16:27.572 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 8 2023-09-30T22:16:27.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.573+0000 7f9710bf8700 1 -- 172.21.15.156:0/3870088933 >> v1:172.21.15.156:6816/118236 conn(0x7f96ec02bb90 legacy=0x7f96ec02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:27.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.573+0000 7f9710bf8700 1 -- 172.21.15.156:0/3870088933 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f970c127df0 msgr2=0x7f970c113e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:27.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.573+0000 7f9710bf8700 1 --2- 172.21.15.156:0/3870088933 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f970c127df0 0x7f970c113e80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f96fc00c4f0 tx=0x7f96fc007c10).stop 2023-09-30T22:16:27.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.573+0000 7f9710bf8700 1 -- 172.21.15.156:0/3870088933 shutdown_connections 2023-09-30T22:16:27.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.573+0000 7f9710bf8700 1 --2- 172.21.15.156:0/3870088933 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f970c128260 0x7f970c114370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:27.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.573+0000 7f9710bf8700 1 --2- 172.21.15.156:0/3870088933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f970c066310 0x7f970c124e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:27.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.573+0000 7f9710bf8700 1 --2- 172.21.15.156:0/3870088933 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f970c127df0 0x7f970c113e80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:27.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.573+0000 7f9710bf8700 1 -- 172.21.15.156:0/3870088933 >> 172.21.15.156:0/3870088933 conn(0x7f970c09bad0 msgr2=0x7f970c125c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:27.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.573+0000 7f9710bf8700 1 -- 172.21.15.156:0/3870088933 shutdown_connections 2023-09-30T22:16:27.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.573+0000 7f9710bf8700 1 -- 172.21.15.156:0/3870088933 wait complete. 2023-09-30T22:16:27.586 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-30T22:16:27.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.701+0000 7f2e3a20a700 1 Processor -- start 2023-09-30T22:16:27.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.701+0000 7f2e3a20a700 1 -- start start 2023-09-30T22:16:27.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.702+0000 7f2e3a20a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2e34096810 0x7f2e34096bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:27.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.702+0000 7f2e3a20a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e340970e0 0x7f2e340974c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:27.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.702+0000 7f2e3a20a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e340982f0 con 0x7f2e340979b0 2023-09-30T22:16:27.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.702+0000 7f2e3a20a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e34068550 con 0x7f2e34096810 2023-09-30T22:16:27.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.702+0000 7f2e3a20a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e34069e20 con 0x7f2e340970e0 2023-09-30T22:16:27.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.702+0000 7f2e32ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e340970e0 0x7f2e340974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:27.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.702+0000 7f2e337fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2e34096810 0x7f2e34096bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:27.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.702+0000 7f2e33fff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f2e340979b0 0x7f2e3412f2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45768/0 (socket says 172.21.15.156:45768) 2023-09-30T22:16:27.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.702+0000 7f2e33fff700 1 -- 172.21.15.156:0/2082673146 learned_addr learned my addr 172.21.15.156:0/2082673146 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:27.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.702+0000 7f2e32ffd700 1 -- 172.21.15.156:0/2082673146 >> v2:172.21.15.156:3300/0 conn(0x7f2e34096810 msgr2=0x7f2e34096bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:27.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.702+0000 7f2e32ffd700 1 --2- 172.21.15.156:0/2082673146 >> v2:172.21.15.156:3300/0 conn(0x7f2e34096810 0x7f2e34096bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:27.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.702+0000 7f2e32ffd700 1 -- 172.21.15.156:0/2082673146 >> v1:172.21.15.156:6789/0 conn(0x7f2e340979b0 legacy=0x7f2e3412f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:27.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.702+0000 7f2e32ffd700 1 -- 172.21.15.156:0/2082673146 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e34068f60 con 0x7f2e340970e0 2023-09-30T22:16:27.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.702+0000 7f2e337fe700 1 --2- 172.21.15.156:0/2082673146 >> v2:172.21.15.156:3300/0 conn(0x7f2e34096810 0x7f2e34096bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:27.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.702+0000 7f2e32ffd700 1 --2- 172.21.15.156:0/2082673146 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e340970e0 0x7f2e340974c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f2e24009760 tx=0x7f2e24009060).ready entity=mon.2 client_cookie=46023b2160e848f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:27.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.703+0000 7f2e327fc700 1 -- 172.21.15.156:0/2082673146 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e240090d0 con 0x7f2e340970e0 2023-09-30T22:16:27.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.703+0000 7f2e327fc700 1 -- 172.21.15.156:0/2082673146 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2400f510 con 0x7f2e340970e0 2023-09-30T22:16:27.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.703+0000 7f2e327fc700 1 -- 172.21.15.156:0/2082673146 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2400f890 con 0x7f2e340970e0 2023-09-30T22:16:27.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.703+0000 7f2e3a20a700 1 -- 172.21.15.156:0/2082673146 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e340970e0 msgr2=0x7f2e340974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:27.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.703+0000 7f2e3a20a700 1 --2- 172.21.15.156:0/2082673146 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e340970e0 0x7f2e340974c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f2e24009760 tx=0x7f2e24009060).stop 2023-09-30T22:16:27.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.703+0000 7f2e3a20a700 1 -- 172.21.15.156:0/2082673146 shutdown_connections 2023-09-30T22:16:27.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.703+0000 7f2e3a20a700 1 --2- 172.21.15.156:0/2082673146 >> v2:172.21.15.156:3300/0 conn(0x7f2e34096810 0x7f2e34096bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:27.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.703+0000 7f2e3a20a700 1 --2- 172.21.15.156:0/2082673146 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e340970e0 0x7f2e340974c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:27.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.703+0000 7f2e3a20a700 1 -- 172.21.15.156:0/2082673146 >> 172.21.15.156:0/2082673146 conn(0x7f2e3409bad0 msgr2=0x7f2e3409bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:27.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.703+0000 7f2e3a20a700 1 -- 172.21.15.156:0/2082673146 shutdown_connections 2023-09-30T22:16:27.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.703+0000 7f2e3a20a700 1 -- 172.21.15.156:0/2082673146 wait complete. 2023-09-30T22:16:27.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.704+0000 7f2e3a20a700 1 Processor -- start 2023-09-30T22:16:27.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.704+0000 7f2e3a20a700 1 -- start start 2023-09-30T22:16:27.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.705+0000 7f2e3a20a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e34096810 0x7f2e34137e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:27.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.705+0000 7f2e3a20a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e340970e0 0x7f2e34138380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:27.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.705+0000 7f2e3a20a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e340979b0 0x7f2e34138870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:27.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.705+0000 7f2e3a20a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3411bc00 con 0x7f2e340970e0 2023-09-30T22:16:27.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.705+0000 7f2e3a20a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3406a040 con 0x7f2e34096810 2023-09-30T22:16:27.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.705+0000 7f2e3a20a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e34091980 con 0x7f2e340979b0 2023-09-30T22:16:27.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.705+0000 7f2e32ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e340970e0 0x7f2e34138380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:27.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.705+0000 7f2e337fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e34096810 0x7f2e34137e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:27.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.705+0000 7f2e32ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e340970e0 0x7f2e34138380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:32790/0 (socket says 172.21.15.156:32790) 2023-09-30T22:16:27.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.705+0000 7f2e32ffd700 1 -- 172.21.15.156:0/3082547022 learned_addr learned my addr 172.21.15.156:0/3082547022 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:27.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.705+0000 7f2e33fff700 1 --2- 172.21.15.156:0/3082547022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e340979b0 0x7f2e34138870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:27.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.705+0000 7f2e32ffd700 1 -- 172.21.15.156:0/3082547022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e340979b0 msgr2=0x7f2e34138870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:27.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.705+0000 7f2e32ffd700 1 --2- 172.21.15.156:0/3082547022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e340979b0 0x7f2e34138870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:27.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.705+0000 7f2e32ffd700 1 -- 172.21.15.156:0/3082547022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e34096810 msgr2=0x7f2e34137e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:27.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.705+0000 7f2e32ffd700 1 --2- 172.21.15.156:0/3082547022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e34096810 0x7f2e34137e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:27.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.705+0000 7f2e32ffd700 1 -- 172.21.15.156:0/3082547022 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1c0092a0 con 0x7f2e340970e0 2023-09-30T22:16:27.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.705+0000 7f2e337fe700 1 --2- 172.21.15.156:0/3082547022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e34096810 0x7f2e34137e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:27.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.705+0000 7f2e32ffd700 1 --2- 172.21.15.156:0/3082547022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e340970e0 0x7f2e34138380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2e24009190 tx=0x7f2e24017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:27.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.705+0000 7f2e2b7fe700 1 -- 172.21.15.156:0/3082547022 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2400fea0 con 0x7f2e340970e0 2023-09-30T22:16:27.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.705+0000 7f2e2b7fe700 1 -- 172.21.15.156:0/3082547022 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e24006930 con 0x7f2e340970e0 2023-09-30T22:16:27.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.705+0000 7f2e3a20a700 1 -- 172.21.15.156:0/3082547022 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e240092a0 con 0x7f2e340970e0 2023-09-30T22:16:27.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.705+0000 7f2e2b7fe700 1 -- 172.21.15.156:0/3082547022 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2400f8d0 con 0x7f2e340970e0 2023-09-30T22:16:27.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.705+0000 7f2e3a20a700 1 -- 172.21.15.156:0/3082547022 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e3411c410 con 0x7f2e340970e0 2023-09-30T22:16:27.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.706+0000 7f2e2b7fe700 1 -- 172.21.15.156:0/3082547022 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f2e2401b620 con 0x7f2e340970e0 2023-09-30T22:16:27.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.706+0000 7f2e2b7fe700 1 -- 172.21.15.156:0/3082547022 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f2e2403c730 con 0x7f2e340970e0 2023-09-30T22:16:27.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.706+0000 7f2e3a20a700 1 -- 172.21.15.156:0/3082547022 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e3411c410 con 0x7f2e340970e0 2023-09-30T22:16:27.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.711+0000 7f2e2b7fe700 1 -- 172.21.15.156:0/3082547022 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f2e3411c410 con 0x7f2e340970e0 2023-09-30T22:16:27.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.873+0000 7f2e3a20a700 1 -- 172.21.15.156:0/3082547022 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2e3411c410 con 0x7f2e340970e0 2023-09-30T22:16:27.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.873+0000 7f2e2b7fe700 1 -- 172.21.15.156:0/3082547022 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v12) v1 ==== 84+0+143 (secure 0 0 0) 0x7f2e3411c410 con 0x7f2e340970e0 2023-09-30T22:16:27.874 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:27.875 INFO:teuthology.orchestra.run.smithi156.stdout:[ 2023-09-30T22:16:27.875 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:16:27.875 INFO:teuthology.orchestra.run.smithi156.stdout: "poolnum": 1, 2023-09-30T22:16:27.875 INFO:teuthology.orchestra.run.smithi156.stdout: "poolname": "device_health_metrics" 2023-09-30T22:16:27.875 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:16:27.875 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:16:27.875 INFO:teuthology.orchestra.run.smithi156.stdout: "poolnum": 2, 2023-09-30T22:16:27.876 INFO:teuthology.orchestra.run.smithi156.stdout: "poolname": "rbd" 2023-09-30T22:16:27.876 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:16:27.876 INFO:teuthology.orchestra.run.smithi156.stdout:] 2023-09-30T22:16:27.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.875+0000 7f2e3a20a700 1 -- 172.21.15.156:0/3082547022 >> v1:172.21.15.156:6816/118236 conn(0x7f2e1402bb60 legacy=0x7f2e1402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:27.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.875+0000 7f2e3a20a700 1 -- 172.21.15.156:0/3082547022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e340970e0 msgr2=0x7f2e34138380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:27.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.875+0000 7f2e3a20a700 1 --2- 172.21.15.156:0/3082547022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e340970e0 0x7f2e34138380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2e24009190 tx=0x7f2e24017000).stop 2023-09-30T22:16:27.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.875+0000 7f2e3a20a700 1 -- 172.21.15.156:0/3082547022 shutdown_connections 2023-09-30T22:16:27.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.875+0000 7f2e3a20a700 1 --2- 172.21.15.156:0/3082547022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e340979b0 0x7f2e34138870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:27.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.875+0000 7f2e3a20a700 1 --2- 172.21.15.156:0/3082547022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e34096810 0x7f2e34137e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:27.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.875+0000 7f2e3a20a700 1 --2- 172.21.15.156:0/3082547022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e340970e0 0x7f2e34138380 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:27.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.875+0000 7f2e3a20a700 1 -- 172.21.15.156:0/3082547022 >> 172.21.15.156:0/3082547022 conn(0x7f2e3409bad0 msgr2=0x7f2e3409a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:27.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.875+0000 7f2e3a20a700 1 -- 172.21.15.156:0/3082547022 shutdown_connections 2023-09-30T22:16:27.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:27.875+0000 7f2e3a20a700 1 -- 172.21.15.156:0/3082547022 wait complete. 2023-09-30T22:16:27.887 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-30T22:16:27.888 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-30T22:16:28.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.006+0000 7f81d86b9700 1 Processor -- start 2023-09-30T22:16:28.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.006+0000 7f81d86b9700 1 -- start start 2023-09-30T22:16:28.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.007+0000 7f81d86b9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81d0092840 0x7f81d012af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:28.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.007+0000 7f81d86b9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81d012b950 0x7f81d0128070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:28.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.007+0000 7f81d86b9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d0063440 con 0x7f81d012b530 2023-09-30T22:16:28.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.007+0000 7f81d86b9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d0096fc0 con 0x7f81d0092840 2023-09-30T22:16:28.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.007+0000 7f81d86b9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81d0097250 con 0x7f81d012b950 2023-09-30T22:16:28.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.007+0000 7f81d6c56700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81d012b950 0x7f81d0128070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:28.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.007+0000 7f81d5c54700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f81d012b530 0x7f81d0127960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45776/0 (socket says 172.21.15.156:45776) 2023-09-30T22:16:28.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.007+0000 7f81d6455700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81d0092840 0x7f81d012af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:28.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.007+0000 7f81d5c54700 1 -- 172.21.15.156:0/2446975996 learned_addr learned my addr 172.21.15.156:0/2446975996 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:28.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.007+0000 7f81d5453700 1 -- 172.21.15.156:0/2446975996 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 959758014 0 0) 0x7f81d0063440 con 0x7f81d012b530 2023-09-30T22:16:28.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.007+0000 7f81d5453700 1 -- 172.21.15.156:0/2446975996 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81bc0033f0 con 0x7f81d012b530 2023-09-30T22:16:28.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.007+0000 7f81d6455700 1 -- 172.21.15.156:0/2446975996 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81d012b950 msgr2=0x7f81d0128070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:28.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.007+0000 7f81d6455700 1 --2- 172.21.15.156:0/2446975996 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81d012b950 0x7f81d0128070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:28.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.007+0000 7f81d6455700 1 -- 172.21.15.156:0/2446975996 >> v1:172.21.15.156:6789/0 conn(0x7f81d012b530 legacy=0x7f81d0127960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:28.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.007+0000 7f81d6455700 1 -- 172.21.15.156:0/2446975996 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d0092c20 con 0x7f81d0092840 2023-09-30T22:16:28.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.007+0000 7f81d6c56700 1 --2- 172.21.15.156:0/2446975996 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81d012b950 0x7f81d0128070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:28.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.007+0000 7f81d6455700 1 --2- 172.21.15.156:0/2446975996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81d0092840 0x7f81d012af10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f81c0009760 tx=0x7f81c0006f40).ready entity=mon.1 client_cookie=151ea0dbc72b6ae9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:28.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.007+0000 7f81d5453700 1 -- 172.21.15.156:0/2446975996 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0005880 con 0x7f81d0092840 2023-09-30T22:16:28.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.008+0000 7f81d5453700 1 -- 172.21.15.156:0/2446975996 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c00059e0 con 0x7f81d0092840 2023-09-30T22:16:28.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.008+0000 7f81d5453700 1 -- 172.21.15.156:0/2446975996 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0005d60 con 0x7f81d0092840 2023-09-30T22:16:28.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.008+0000 7f81d86b9700 1 -- 172.21.15.156:0/2446975996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81d0092840 msgr2=0x7f81d012af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:28.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.008+0000 7f81d86b9700 1 --2- 172.21.15.156:0/2446975996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81d0092840 0x7f81d012af10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f81c0009760 tx=0x7f81c0006f40).stop 2023-09-30T22:16:28.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.008+0000 7f81d86b9700 1 -- 172.21.15.156:0/2446975996 shutdown_connections 2023-09-30T22:16:28.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.008+0000 7f81d86b9700 1 --2- 172.21.15.156:0/2446975996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81d0092840 0x7f81d012af10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:28.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.008+0000 7f81d86b9700 1 --2- 172.21.15.156:0/2446975996 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81d012b950 0x7f81d0128070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:28.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.008+0000 7f81d86b9700 1 -- 172.21.15.156:0/2446975996 >> 172.21.15.156:0/2446975996 conn(0x7f81d0097640 msgr2=0x7f81d0097a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:28.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.008+0000 7f81d86b9700 1 -- 172.21.15.156:0/2446975996 shutdown_connections 2023-09-30T22:16:28.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.008+0000 7f81d86b9700 1 -- 172.21.15.156:0/2446975996 wait complete. 2023-09-30T22:16:28.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.009+0000 7f81d86b9700 1 Processor -- start 2023-09-30T22:16:28.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.009+0000 7f81d86b9700 1 -- start start 2023-09-30T22:16:28.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.009+0000 7f81d86b9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81d0092840 0x7f81d0127020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:28.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.009+0000 7f81d86b9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81d012b530 0x7f81d0115ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:28.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.009+0000 7f81d86b9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81d012b950 0x7f81d01163b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:28.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.009+0000 7f81d86b9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d01183b0 con 0x7f81d012b530 2023-09-30T22:16:28.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.009+0000 7f81d86b9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d0096bc0 con 0x7f81d012b950 2023-09-30T22:16:28.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.009+0000 7f81d86b9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81d0119a20 con 0x7f81d0092840 2023-09-30T22:16:28.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.009+0000 7f81d6c56700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81d012b950 0x7f81d01163b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:28.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.009+0000 7f81d5c54700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81d012b530 0x7f81d0115ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:28.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.010+0000 7f81d6c56700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81d012b950 0x7f81d01163b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:34276/0 (socket says 172.21.15.156:34276) 2023-09-30T22:16:28.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.010+0000 7f81d6c56700 1 -- 172.21.15.156:0/2802550173 learned_addr learned my addr 172.21.15.156:0/2802550173 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:28.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.010+0000 7f81d6455700 1 --2- 172.21.15.156:0/2802550173 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81d0092840 0x7f81d0127020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:28.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.010+0000 7f81d6c56700 1 -- 172.21.15.156:0/2802550173 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81d0092840 msgr2=0x7f81d0127020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:28.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.010+0000 7f81d6c56700 1 --2- 172.21.15.156:0/2802550173 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81d0092840 0x7f81d0127020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:28.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.010+0000 7f81d6c56700 1 -- 172.21.15.156:0/2802550173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81d012b530 msgr2=0x7f81d0115ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:28.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.010+0000 7f81d6c56700 1 --2- 172.21.15.156:0/2802550173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81d012b530 0x7f81d0115ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:28.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.010+0000 7f81d6c56700 1 -- 172.21.15.156:0/2802550173 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c8009a20 con 0x7f81d012b950 2023-09-30T22:16:28.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.010+0000 7f81d5c54700 1 --2- 172.21.15.156:0/2802550173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81d012b530 0x7f81d0115ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:28.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.010+0000 7f81d6c56700 1 --2- 172.21.15.156:0/2802550173 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81d012b950 0x7f81d01163b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f81c800c0f0 tx=0x7f81c800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:28.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.010+0000 7f81c67fc700 1 -- 172.21.15.156:0/2802550173 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c8009d20 con 0x7f81d012b950 2023-09-30T22:16:28.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.010+0000 7f81c67fc700 1 -- 172.21.15.156:0/2802550173 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c800f040 con 0x7f81d012b950 2023-09-30T22:16:28.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.010+0000 7f81c67fc700 1 -- 172.21.15.156:0/2802550173 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c800ce40 con 0x7f81d012b950 2023-09-30T22:16:28.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.010+0000 7f81d86b9700 1 -- 172.21.15.156:0/2802550173 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c0009250 con 0x7f81d012b950 2023-09-30T22:16:28.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.010+0000 7f81d86b9700 1 -- 172.21.15.156:0/2802550173 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d011a0d0 con 0x7f81d012b950 2023-09-30T22:16:28.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.011+0000 7f81c67fc700 1 -- 172.21.15.156:0/2802550173 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f81c8013610 con 0x7f81d012b950 2023-09-30T22:16:28.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.011+0000 7f81c67fc700 1 -- 172.21.15.156:0/2802550173 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f81c803b520 con 0x7f81d012b950 2023-09-30T22:16:28.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.011+0000 7f81d86b9700 1 -- 172.21.15.156:0/2802550173 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d0065620 con 0x7f81d012b950 2023-09-30T22:16:28.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.016+0000 7f81c67fc700 1 -- 172.21.15.156:0/2802550173 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f81c801d460 con 0x7f81d012b950 2023-09-30T22:16:28.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.172+0000 7f81d86b9700 1 -- 172.21.15.156:0/2802550173 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f81d005a260 con 0x7f81d012b950 2023-09-30T22:16:28.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.421+0000 7f81c67fc700 1 -- 172.21.15.156:0/2802550173 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v13) v1 ==== 138+0+0 (secure 0 0 0) 0x7f81c802c0b0 con 0x7f81d012b950 2023-09-30T22:16:28.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.425+0000 7f81d86b9700 1 -- 172.21.15.156:0/2802550173 >> v1:172.21.15.156:6816/118236 conn(0x7f81b402bb60 legacy=0x7f81b402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:28.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.425+0000 7f81d86b9700 1 -- 172.21.15.156:0/2802550173 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81d012b950 msgr2=0x7f81d01163b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:28.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.425+0000 7f81d86b9700 1 --2- 172.21.15.156:0/2802550173 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81d012b950 0x7f81d01163b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f81c800c0f0 tx=0x7f81c800b040).stop 2023-09-30T22:16:28.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.425+0000 7f81d86b9700 1 -- 172.21.15.156:0/2802550173 shutdown_connections 2023-09-30T22:16:28.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.425+0000 7f81d86b9700 1 --2- 172.21.15.156:0/2802550173 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81d012b950 0x7f81d01163b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:28.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.425+0000 7f81d86b9700 1 --2- 172.21.15.156:0/2802550173 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81d0092840 0x7f81d0127020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:28.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.425+0000 7f81d86b9700 1 --2- 172.21.15.156:0/2802550173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81d012b530 0x7f81d0115ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:28.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.425+0000 7f81d86b9700 1 -- 172.21.15.156:0/2802550173 >> 172.21.15.156:0/2802550173 conn(0x7f81d0097640 msgr2=0x7f81d0127a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:28.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.427+0000 7f81d86b9700 1 -- 172.21.15.156:0/2802550173 shutdown_connections 2023-09-30T22:16:28.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.427+0000 7f81d86b9700 1 -- 172.21.15.156:0/2802550173 wait complete. 2023-09-30T22:16:28.429 INFO:teuthology.orchestra.run.smithi156.stderr:pool 'cephfs_metadata' created 2023-09-30T22:16:28.441 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-30T22:16:28.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.563+0000 7f7c0e2e7700 1 Processor -- start 2023-09-30T22:16:28.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.563+0000 7f7c0e2e7700 1 -- start start 2023-09-30T22:16:28.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.564+0000 7f7c0e2e7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c0805f560 0x7f7c08096840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:28.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.564+0000 7f7c0e2e7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7c0812cbd0 0x7f7c0812efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:28.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.564+0000 7f7c0e2e7700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c080933e0 con 0x7f7c08069d90 2023-09-30T22:16:28.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.564+0000 7f7c0e2e7700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c0805f940 con 0x7f7c0812cbd0 2023-09-30T22:16:28.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.564+0000 7f7c0e2e7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c08097440 con 0x7f7c0805f560 2023-09-30T22:16:28.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.564+0000 7f7c07fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c0805f560 0x7f7c08096840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:28.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.564+0000 7f7c0c884700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7c0812cbd0 0x7f7c0812efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:28.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.564+0000 7f7c07fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c0805f560 0x7f7c08096840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:34282/0 (socket says 172.21.15.156:34282) 2023-09-30T22:16:28.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.564+0000 7f7c07fff700 1 -- 172.21.15.156:0/3551179612 learned_addr learned my addr 172.21.15.156:0/3551179612 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:28.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.564+0000 7f7c077fe700 1 --1- 172.21.15.156:0/3551179612 >> v1:172.21.15.156:6789/0 conn(0x7f7c08069d90 0x7f7c08096d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45786/0 (socket says 172.21.15.156:45786) 2023-09-30T22:16:28.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.564+0000 7f7c07fff700 1 -- 172.21.15.156:0/3551179612 >> v2:172.21.15.156:3300/0 conn(0x7f7c0812cbd0 msgr2=0x7f7c0812efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:28.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.564+0000 7f7c07fff700 1 --2- 172.21.15.156:0/3551179612 >> v2:172.21.15.156:3300/0 conn(0x7f7c0812cbd0 0x7f7c0812efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:28.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.564+0000 7f7c07fff700 1 -- 172.21.15.156:0/3551179612 >> v1:172.21.15.156:6789/0 conn(0x7f7c08069d90 legacy=0x7f7c08096d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:28.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.564+0000 7f7c07fff700 1 -- 172.21.15.156:0/3551179612 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c080921e0 con 0x7f7c0805f560 2023-09-30T22:16:28.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.564+0000 7f7c0c884700 1 --2- 172.21.15.156:0/3551179612 >> v2:172.21.15.156:3300/0 conn(0x7f7c0812cbd0 0x7f7c0812efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:28.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.564+0000 7f7c07fff700 1 --2- 172.21.15.156:0/3551179612 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c0805f560 0x7f7c08096840 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f7bf8006fd0 tx=0x7f7bf80090f0).ready entity=mon.1 client_cookie=7d92af6bdc2cc245 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:28.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.564+0000 7f7c06ffd700 1 -- 172.21.15.156:0/3551179612 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf800b580 con 0x7f7c0805f560 2023-09-30T22:16:28.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.564+0000 7f7c06ffd700 1 -- 172.21.15.156:0/3551179612 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf800b6e0 con 0x7f7c0805f560 2023-09-30T22:16:28.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.564+0000 7f7c06ffd700 1 -- 172.21.15.156:0/3551179612 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf800ba60 con 0x7f7c0805f560 2023-09-30T22:16:28.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.565+0000 7f7c0e2e7700 1 -- 172.21.15.156:0/3551179612 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c0805f560 msgr2=0x7f7c08096840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:28.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.565+0000 7f7c0e2e7700 1 --2- 172.21.15.156:0/3551179612 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c0805f560 0x7f7c08096840 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f7bf8006fd0 tx=0x7f7bf80090f0).stop 2023-09-30T22:16:28.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.565+0000 7f7c0e2e7700 1 -- 172.21.15.156:0/3551179612 shutdown_connections 2023-09-30T22:16:28.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.565+0000 7f7c0e2e7700 1 --2- 172.21.15.156:0/3551179612 >> v2:172.21.15.156:3300/0 conn(0x7f7c0812cbd0 0x7f7c0812efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:28.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.565+0000 7f7c0e2e7700 1 --2- 172.21.15.156:0/3551179612 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c0805f560 0x7f7c08096840 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:28.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.565+0000 7f7c0e2e7700 1 -- 172.21.15.156:0/3551179612 >> 172.21.15.156:0/3551179612 conn(0x7f7c0809a1c0 msgr2=0x7f7c0809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:28.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.565+0000 7f7c0e2e7700 1 -- 172.21.15.156:0/3551179612 shutdown_connections 2023-09-30T22:16:28.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.565+0000 7f7c0e2e7700 1 -- 172.21.15.156:0/3551179612 wait complete. 2023-09-30T22:16:28.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.566+0000 7f7c0e2e7700 1 Processor -- start 2023-09-30T22:16:28.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.566+0000 7f7c0e2e7700 1 -- start start 2023-09-30T22:16:28.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.567+0000 7f7c0e2e7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c0805f560 0x7f7c08116bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:28.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.567+0000 7f7c0e2e7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c0812cbd0 0x7f7c081170c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:28.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.567+0000 7f7c0e2e7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c08117e60 0x7f7c081175b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:28.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.567+0000 7f7c0e2e7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c08117aa0 con 0x7f7c0812cbd0 2023-09-30T22:16:28.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.567+0000 7f7c0e2e7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c081192a0 con 0x7f7c0805f560 2023-09-30T22:16:28.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.567+0000 7f7c0e2e7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0811a160 con 0x7f7c08117e60 2023-09-30T22:16:28.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.567+0000 7f7c07fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c0805f560 0x7f7c08116bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:28.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.567+0000 7f7c07fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c0805f560 0x7f7c08116bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:34284/0 (socket says 172.21.15.156:34284) 2023-09-30T22:16:28.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.567+0000 7f7c077fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c0812cbd0 0x7f7c081170c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:28.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.567+0000 7f7c07fff700 1 -- 172.21.15.156:0/1258499592 learned_addr learned my addr 172.21.15.156:0/1258499592 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:28.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.567+0000 7f7c0c884700 1 --2- 172.21.15.156:0/1258499592 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c08117e60 0x7f7c081175b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:28.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.567+0000 7f7c07fff700 1 -- 172.21.15.156:0/1258499592 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c08117e60 msgr2=0x7f7c081175b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:28.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.567+0000 7f7c07fff700 1 --2- 172.21.15.156:0/1258499592 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c08117e60 0x7f7c081175b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:28.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.567+0000 7f7c07fff700 1 -- 172.21.15.156:0/1258499592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c0812cbd0 msgr2=0x7f7c081170c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:28.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.567+0000 7f7c07fff700 1 --2- 172.21.15.156:0/1258499592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c0812cbd0 0x7f7c081170c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:28.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.567+0000 7f7c07fff700 1 -- 172.21.15.156:0/1258499592 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c00009a20 con 0x7f7c0805f560 2023-09-30T22:16:28.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.567+0000 7f7c07fff700 1 --2- 172.21.15.156:0/1258499592 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c0805f560 0x7f7c08116bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f7bf8009fd0 tx=0x7f7bf8017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:28.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.567+0000 7f7beffff700 1 -- 172.21.15.156:0/1258499592 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8000bc0 con 0x7f7c0805f560 2023-09-30T22:16:28.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.567+0000 7f7beffff700 1 -- 172.21.15.156:0/1258499592 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf800b850 con 0x7f7c0805f560 2023-09-30T22:16:28.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.567+0000 7f7c0e2e7700 1 -- 172.21.15.156:0/1258499592 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf8009370 con 0x7f7c0805f560 2023-09-30T22:16:28.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.567+0000 7f7beffff700 1 -- 172.21.15.156:0/1258499592 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8000d20 con 0x7f7c0805f560 2023-09-30T22:16:28.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.568+0000 7f7c0e2e7700 1 -- 172.21.15.156:0/1258499592 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c08066fd0 con 0x7f7c0805f560 2023-09-30T22:16:28.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.568+0000 7f7beffff700 1 -- 172.21.15.156:0/1258499592 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7bf801c900 con 0x7f7c0805f560 2023-09-30T22:16:28.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.568+0000 7f7beffff700 1 -- 172.21.15.156:0/1258499592 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3208+0+0 (secure 0 0 0) 0x7f7bf803cb00 con 0x7f7c0805f560 2023-09-30T22:16:28.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.569+0000 7f7c0e2e7700 1 -- 172.21.15.156:0/1258499592 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c081193e0 con 0x7f7c0805f560 2023-09-30T22:16:28.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.573+0000 7f7beffff700 1 -- 172.21.15.156:0/1258499592 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f7bf803ce60 con 0x7f7c0805f560 2023-09-30T22:16:28.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:28.730+0000 7f7c0e2e7700 1 -- 172.21.15.156:0/1258499592 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7c0805a260 con 0x7f7c0805f560 2023-09-30T22:16:29.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.431+0000 7f7beffff700 1 -- 172.21.15.156:0/1258499592 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v14) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7c081193e0 con 0x7f7c0805f560 2023-09-30T22:16:29.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.438+0000 7f7c0e2e7700 1 -- 172.21.15.156:0/1258499592 >> v1:172.21.15.156:6816/118236 conn(0x7f7bf402bb90 legacy=0x7f7bf402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:29.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.438+0000 7f7c0e2e7700 1 -- 172.21.15.156:0/1258499592 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c0805f560 msgr2=0x7f7c08116bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:29.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.438+0000 7f7c0e2e7700 1 --2- 172.21.15.156:0/1258499592 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c0805f560 0x7f7c08116bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f7bf8009fd0 tx=0x7f7bf8017000).stop 2023-09-30T22:16:29.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.438+0000 7f7c0e2e7700 1 -- 172.21.15.156:0/1258499592 shutdown_connections 2023-09-30T22:16:29.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.438+0000 7f7c0e2e7700 1 --2- 172.21.15.156:0/1258499592 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c08117e60 0x7f7c081175b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:29.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.438+0000 7f7c0e2e7700 1 --2- 172.21.15.156:0/1258499592 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c0805f560 0x7f7c08116bd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:29.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.438+0000 7f7c0e2e7700 1 --2- 172.21.15.156:0/1258499592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c0812cbd0 0x7f7c081170c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:29.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.438+0000 7f7c0e2e7700 1 -- 172.21.15.156:0/1258499592 >> 172.21.15.156:0/1258499592 conn(0x7f7c0809a1c0 msgr2=0x7f7c08098060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:29.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.446+0000 7f7c0e2e7700 1 -- 172.21.15.156:0/1258499592 shutdown_connections 2023-09-30T22:16:29.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.446+0000 7f7c0e2e7700 1 -- 172.21.15.156:0/1258499592 wait complete. 2023-09-30T22:16:29.454 INFO:teuthology.orchestra.run.smithi156.stderr:pool 'cephfs_data' created 2023-09-30T22:16:29.466 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-30T22:16:29.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.585+0000 7f95fa72c700 1 Processor -- start 2023-09-30T22:16:29.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.585+0000 7f95fa72c700 1 -- start start 2023-09-30T22:16:29.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.585+0000 7f95fa72c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95f405f560 0x7f95f4096840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:29.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.585+0000 7f95fa72c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f95f412cbd0 0x7f95f412efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:29.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.585+0000 7f95fa72c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f40933e0 con 0x7f95f4069d90 2023-09-30T22:16:29.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.585+0000 7f95fa72c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f405f940 con 0x7f95f412cbd0 2023-09-30T22:16:29.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.585+0000 7f95fa72c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95f4097440 con 0x7f95f405f560 2023-09-30T22:16:29.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.586+0000 7f95f3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95f405f560 0x7f95f4096840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:29.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.586+0000 7f95f8cc9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f95f412cbd0 0x7f95f412efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:29.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.586+0000 7f95f3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95f405f560 0x7f95f4096840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56106/0 (socket says 172.21.15.156:56106) 2023-09-30T22:16:29.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.586+0000 7f95f3fff700 1 -- 172.21.15.156:0/3922949515 learned_addr learned my addr 172.21.15.156:0/3922949515 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:29.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.586+0000 7f95f37fe700 1 --1- 172.21.15.156:0/3922949515 >> v1:172.21.15.156:6789/0 conn(0x7f95f4069d90 0x7f95f4096d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45798/0 (socket says 172.21.15.156:45798) 2023-09-30T22:16:29.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.586+0000 7f95f3fff700 1 -- 172.21.15.156:0/3922949515 >> v2:172.21.15.156:3300/0 conn(0x7f95f412cbd0 msgr2=0x7f95f412efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:29.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.586+0000 7f95f3fff700 1 --2- 172.21.15.156:0/3922949515 >> v2:172.21.15.156:3300/0 conn(0x7f95f412cbd0 0x7f95f412efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:29.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.586+0000 7f95f3fff700 1 -- 172.21.15.156:0/3922949515 >> v1:172.21.15.156:6789/0 conn(0x7f95f4069d90 legacy=0x7f95f4096d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:29.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.586+0000 7f95f3fff700 1 -- 172.21.15.156:0/3922949515 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f40921e0 con 0x7f95f405f560 2023-09-30T22:16:29.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.586+0000 7f95f3fff700 1 --2- 172.21.15.156:0/3922949515 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95f405f560 0x7f95f4096840 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f95dc006fd0 tx=0x7f95dc0090f0).ready entity=mon.2 client_cookie=5c0bd6ae2a48bef5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:29.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.586+0000 7f95f2ffd700 1 -- 172.21.15.156:0/3922949515 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc00b580 con 0x7f95f405f560 2023-09-30T22:16:29.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.586+0000 7f95f2ffd700 1 -- 172.21.15.156:0/3922949515 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95dc00b6e0 con 0x7f95f405f560 2023-09-30T22:16:29.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.586+0000 7f95f2ffd700 1 -- 172.21.15.156:0/3922949515 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc00ba60 con 0x7f95f405f560 2023-09-30T22:16:29.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.587+0000 7f95fa72c700 1 -- 172.21.15.156:0/3922949515 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95f405f560 msgr2=0x7f95f4096840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:29.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.587+0000 7f95fa72c700 1 --2- 172.21.15.156:0/3922949515 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95f405f560 0x7f95f4096840 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f95dc006fd0 tx=0x7f95dc0090f0).stop 2023-09-30T22:16:29.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.587+0000 7f95fa72c700 1 -- 172.21.15.156:0/3922949515 shutdown_connections 2023-09-30T22:16:29.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.587+0000 7f95fa72c700 1 --2- 172.21.15.156:0/3922949515 >> v2:172.21.15.156:3300/0 conn(0x7f95f412cbd0 0x7f95f412efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:29.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.587+0000 7f95fa72c700 1 --2- 172.21.15.156:0/3922949515 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95f405f560 0x7f95f4096840 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:29.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.587+0000 7f95fa72c700 1 -- 172.21.15.156:0/3922949515 >> 172.21.15.156:0/3922949515 conn(0x7f95f409a1c0 msgr2=0x7f95f409a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:29.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.587+0000 7f95fa72c700 1 -- 172.21.15.156:0/3922949515 shutdown_connections 2023-09-30T22:16:29.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.587+0000 7f95fa72c700 1 -- 172.21.15.156:0/3922949515 wait complete. 2023-09-30T22:16:29.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.588+0000 7f95fa72c700 1 Processor -- start 2023-09-30T22:16:29.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.588+0000 7f95fa72c700 1 -- start start 2023-09-30T22:16:29.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.589+0000 7f95fa72c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f95f405f560 0x7f95f4136370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:29.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.589+0000 7f95fa72c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95f412cbd0 0x7f95f4136860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:29.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.589+0000 7f95fa72c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95f4114f50 0x7f95f41153b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:29.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.589+0000 7f95fa72c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f4118b90 con 0x7f95f4114f50 2023-09-30T22:16:29.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.589+0000 7f95fa72c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f41163c0 con 0x7f95f405f560 2023-09-30T22:16:29.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.589+0000 7f95fa72c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95f40674c0 con 0x7f95f412cbd0 2023-09-30T22:16:29.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.589+0000 7f95f3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f95f405f560 0x7f95f4136370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:29.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.589+0000 7f95f37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95f412cbd0 0x7f95f4136860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:29.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.589+0000 7f95f3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f95f405f560 0x7f95f4136370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:34286/0 (socket says 172.21.15.156:34286) 2023-09-30T22:16:29.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.589+0000 7f95f3fff700 1 -- 172.21.15.156:0/2607051694 learned_addr learned my addr 172.21.15.156:0/2607051694 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:29.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.589+0000 7f95f8cc9700 1 --2- 172.21.15.156:0/2607051694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95f4114f50 0x7f95f41153b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:29.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.589+0000 7f95f37fe700 1 -- 172.21.15.156:0/2607051694 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f95f405f560 msgr2=0x7f95f4136370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:29.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.589+0000 7f95f37fe700 1 --2- 172.21.15.156:0/2607051694 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f95f405f560 0x7f95f4136370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:29.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.589+0000 7f95f37fe700 1 -- 172.21.15.156:0/2607051694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95f4114f50 msgr2=0x7f95f41153b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:29.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.589+0000 7f95f37fe700 1 --2- 172.21.15.156:0/2607051694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95f4114f50 0x7f95f41153b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:29.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.589+0000 7f95f37fe700 1 -- 172.21.15.156:0/2607051694 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95dc009370 con 0x7f95f412cbd0 2023-09-30T22:16:29.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.589+0000 7f95f37fe700 1 --2- 172.21.15.156:0/2607051694 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95f412cbd0 0x7f95f4136860 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f95f4060170 tx=0x7f95e4007d30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:29.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.589+0000 7f95ebfff700 1 -- 172.21.15.156:0/2607051694 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e40070d0 con 0x7f95f412cbd0 2023-09-30T22:16:29.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.589+0000 7f95ebfff700 1 -- 172.21.15.156:0/2607051694 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e4007230 con 0x7f95f412cbd0 2023-09-30T22:16:29.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.589+0000 7f95fa72c700 1 -- 172.21.15.156:0/2607051694 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f4091e20 con 0x7f95f412cbd0 2023-09-30T22:16:29.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.589+0000 7f95ebfff700 1 -- 172.21.15.156:0/2607051694 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e40075b0 con 0x7f95f412cbd0 2023-09-30T22:16:29.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.589+0000 7f95fa72c700 1 -- 172.21.15.156:0/2607051694 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f4119030 con 0x7f95f412cbd0 2023-09-30T22:16:29.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.590+0000 7f95ebfff700 1 -- 172.21.15.156:0/2607051694 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f95e40058f0 con 0x7f95f412cbd0 2023-09-30T22:16:29.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.590+0000 7f95ebfff700 1 -- 172.21.15.156:0/2607051694 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3590+0+0 (secure 0 0 0) 0x7f95e403a4f0 con 0x7f95f412cbd0 2023-09-30T22:16:29.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.590+0000 7f95fa72c700 1 -- 172.21.15.156:0/2607051694 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f405a260 con 0x7f95f412cbd0 2023-09-30T22:16:29.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.595+0000 7f95ebfff700 1 -- 172.21.15.156:0/2607051694 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f95e4013970 con 0x7f95f412cbd0 2023-09-30T22:16:29.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.790+0000 7f95fa72c700 1 -- 172.21.15.156:0/2607051694 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f95f4046c20 con 0x7f95f412cbd0 2023-09-30T22:16:29.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.805+0000 7f95ebfff700 1 -- 172.21.15.156:0/2607051694 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v3) v1 ==== 172+0+0 (secure 0 0 0) 0x7f95e401c350 con 0x7f95f412cbd0 2023-09-30T22:16:29.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.810+0000 7f95fa72c700 1 -- 172.21.15.156:0/2607051694 >> v1:172.21.15.156:6816/118236 conn(0x7f95d402bb90 legacy=0x7f95d402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:29.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.810+0000 7f95fa72c700 1 -- 172.21.15.156:0/2607051694 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95f412cbd0 msgr2=0x7f95f4136860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:29.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.810+0000 7f95fa72c700 1 --2- 172.21.15.156:0/2607051694 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95f412cbd0 0x7f95f4136860 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f95f4060170 tx=0x7f95e4007d30).stop 2023-09-30T22:16:29.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.810+0000 7f95fa72c700 1 -- 172.21.15.156:0/2607051694 shutdown_connections 2023-09-30T22:16:29.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.810+0000 7f95fa72c700 1 --2- 172.21.15.156:0/2607051694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95f4114f50 0x7f95f41153b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:29.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.810+0000 7f95fa72c700 1 --2- 172.21.15.156:0/2607051694 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f95f405f560 0x7f95f4136370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:29.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.810+0000 7f95fa72c700 1 --2- 172.21.15.156:0/2607051694 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95f412cbd0 0x7f95f4136860 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:29.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.810+0000 7f95fa72c700 1 -- 172.21.15.156:0/2607051694 >> 172.21.15.156:0/2607051694 conn(0x7f95f409a1c0 msgr2=0x7f95f412bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:29.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.811+0000 7f95fa72c700 1 -- 172.21.15.156:0/2607051694 shutdown_connections 2023-09-30T22:16:29.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.812+0000 7f95fa72c700 1 -- 172.21.15.156:0/2607051694 wait complete. 2023-09-30T22:16:29.819 INFO:teuthology.orchestra.run.smithi156.stderr:new fs with metadata pool 3 and data pool 4 2023-09-30T22:16:29.835 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:16:29.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.951+0000 7f7a11593700 1 Processor -- start 2023-09-30T22:16:29.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.952+0000 7f7a11593700 1 -- start start 2023-09-30T22:16:29.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.952+0000 7f7a11593700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7a0c0985e0 0x7f7a0c0989c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:29.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.952+0000 7f7a11593700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a0c130bb0 0x7f7a0c132fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:29.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.952+0000 7f7a11593700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a0c0964f0 con 0x7f7a0c098eb0 2023-09-30T22:16:29.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.952+0000 7f7a11593700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a0c09a3f0 con 0x7f7a0c0985e0 2023-09-30T22:16:29.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.952+0000 7f7a11593700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0c095100 con 0x7f7a0c130bb0 2023-09-30T22:16:29.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.952+0000 7f7a0b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a0c130bb0 0x7f7a0c132fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:29.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.952+0000 7f7a0affd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7a0c0985e0 0x7f7a0c0989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:29.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.952+0000 7f7a0a7fc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f7a0c098eb0 0x7f7a0c12f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45804/0 (socket says 172.21.15.156:45804) 2023-09-30T22:16:29.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.952+0000 7f7a0b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a0c130bb0 0x7f7a0c132fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:34290/0 (socket says 172.21.15.156:34290) 2023-09-30T22:16:29.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.952+0000 7f7a0affd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7a0c0985e0 0x7f7a0c0989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:32854/0 (socket says 172.21.15.156:32854) 2023-09-30T22:16:29.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.952+0000 7f7a0a7fc700 1 -- 172.21.15.156:0/2519257736 learned_addr learned my addr 172.21.15.156:0/2519257736 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:29.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.953+0000 7f7a0b7fe700 1 -- 172.21.15.156:0/2519257736 >> v2:172.21.15.156:3300/0 conn(0x7f7a0c0985e0 msgr2=0x7f7a0c0989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:29.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.953+0000 7f7a0b7fe700 1 --2- 172.21.15.156:0/2519257736 >> v2:172.21.15.156:3300/0 conn(0x7f7a0c0985e0 0x7f7a0c0989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:29.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.953+0000 7f7a0b7fe700 1 -- 172.21.15.156:0/2519257736 >> v1:172.21.15.156:6789/0 conn(0x7f7a0c098eb0 legacy=0x7f7a0c12f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:29.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.953+0000 7f7a09ffb700 1 -- 172.21.15.156:0/2519257736 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1423270093 0 0) 0x7f7a0c0964f0 con 0x7f7a0c098eb0 2023-09-30T22:16:29.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.953+0000 7f7a0b7fe700 1 -- 172.21.15.156:0/2519257736 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0c099e70 con 0x7f7a0c130bb0 2023-09-30T22:16:29.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.953+0000 7f7a0affd700 1 --2- 172.21.15.156:0/2519257736 >> v2:172.21.15.156:3300/0 conn(0x7f7a0c0985e0 0x7f7a0c0989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:29.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.953+0000 7f7a0b7fe700 1 --2- 172.21.15.156:0/2519257736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a0c130bb0 0x7f7a0c132fa0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f7a04009e60 tx=0x7f7a04009780).ready entity=mon.1 client_cookie=72af105dbbfc930e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:29.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.953+0000 7f7a09ffb700 1 -- 172.21.15.156:0/2519257736 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0400e070 con 0x7f7a0c130bb0 2023-09-30T22:16:29.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.953+0000 7f7a09ffb700 1 -- 172.21.15.156:0/2519257736 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0400bb60 con 0x7f7a0c130bb0 2023-09-30T22:16:29.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.953+0000 7f7a09ffb700 1 -- 172.21.15.156:0/2519257736 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a04012410 con 0x7f7a0c130bb0 2023-09-30T22:16:29.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.953+0000 7f7a11593700 1 -- 172.21.15.156:0/2519257736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a0c130bb0 msgr2=0x7f7a0c132fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:29.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.953+0000 7f7a11593700 1 --2- 172.21.15.156:0/2519257736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a0c130bb0 0x7f7a0c132fa0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f7a04009e60 tx=0x7f7a04009780).stop 2023-09-30T22:16:29.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.953+0000 7f7a11593700 1 -- 172.21.15.156:0/2519257736 shutdown_connections 2023-09-30T22:16:29.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.953+0000 7f7a11593700 1 --2- 172.21.15.156:0/2519257736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a0c130bb0 0x7f7a0c132fa0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:29.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.953+0000 7f7a11593700 1 --2- 172.21.15.156:0/2519257736 >> v2:172.21.15.156:3300/0 conn(0x7f7a0c0985e0 0x7f7a0c0989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:29.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.953+0000 7f7a11593700 1 -- 172.21.15.156:0/2519257736 >> 172.21.15.156:0/2519257736 conn(0x7f7a0c09dc40 msgr2=0x7f7a0c09e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:29.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.953+0000 7f7a11593700 1 -- 172.21.15.156:0/2519257736 shutdown_connections 2023-09-30T22:16:29.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.953+0000 7f7a11593700 1 -- 172.21.15.156:0/2519257736 wait complete. 2023-09-30T22:16:29.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.955+0000 7f7a11593700 1 Processor -- start 2023-09-30T22:16:29.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.955+0000 7f7a11593700 1 -- start start 2023-09-30T22:16:29.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.955+0000 7f7a11593700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a0c0985e0 0x7f7a0c11a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:29.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.955+0000 7f7a11593700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a0c098eb0 0x7f7a0c11a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:29.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.955+0000 7f7a11593700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a0c130bb0 0x7f7a0c11ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:29.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.955+0000 7f7a11593700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0c130460 con 0x7f7a0c130bb0 2023-09-30T22:16:29.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.955+0000 7f7a11593700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0c11d650 con 0x7f7a0c0985e0 2023-09-30T22:16:29.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.955+0000 7f7a11593700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0c11dba0 con 0x7f7a0c098eb0 2023-09-30T22:16:29.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.955+0000 7f7a0a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a0c098eb0 0x7f7a0c11a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:29.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.955+0000 7f7a0b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a0c130bb0 0x7f7a0c11ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:29.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.955+0000 7f7a0a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a0c098eb0 0x7f7a0c11a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56124/0 (socket says 172.21.15.156:56124) 2023-09-30T22:16:29.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.955+0000 7f7a0a7fc700 1 -- 172.21.15.156:0/1603218384 learned_addr learned my addr 172.21.15.156:0/1603218384 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:29.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.956+0000 7f7a0affd700 1 --2- 172.21.15.156:0/1603218384 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a0c0985e0 0x7f7a0c11a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:29.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.956+0000 7f7a0b7fe700 1 -- 172.21.15.156:0/1603218384 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a0c098eb0 msgr2=0x7f7a0c11a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:29.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.956+0000 7f7a0b7fe700 1 --2- 172.21.15.156:0/1603218384 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a0c098eb0 0x7f7a0c11a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:29.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.956+0000 7f7a0b7fe700 1 -- 172.21.15.156:0/1603218384 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a0c0985e0 msgr2=0x7f7a0c11a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:29.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.956+0000 7f7a0b7fe700 1 --2- 172.21.15.156:0/1603218384 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a0c0985e0 0x7f7a0c11a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:29.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.956+0000 7f7a0b7fe700 1 -- 172.21.15.156:0/1603218384 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a000092a0 con 0x7f7a0c130bb0 2023-09-30T22:16:29.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.956+0000 7f7a0b7fe700 1 --2- 172.21.15.156:0/1603218384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a0c130bb0 0x7f7a0c11ae00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f7a04014000 tx=0x7f7a0c096680).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:29.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.956+0000 7f79f2ffd700 1 -- 172.21.15.156:0/1603218384 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a04012410 con 0x7f7a0c130bb0 2023-09-30T22:16:29.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.956+0000 7f79f2ffd700 1 -- 172.21.15.156:0/1603218384 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0401d630 con 0x7f7a0c130bb0 2023-09-30T22:16:29.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.956+0000 7f79f2ffd700 1 -- 172.21.15.156:0/1603218384 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a040070e0 con 0x7f7a0c130bb0 2023-09-30T22:16:29.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.956+0000 7f7a11593700 1 -- 172.21.15.156:0/1603218384 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a04009a20 con 0x7f7a0c130bb0 2023-09-30T22:16:29.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.956+0000 7f7a11593700 1 -- 172.21.15.156:0/1603218384 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a0c11c770 con 0x7f7a0c130bb0 2023-09-30T22:16:29.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.957+0000 7f79f2ffd700 1 -- 172.21.15.156:0/1603218384 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7a04003040 con 0x7f7a0c130bb0 2023-09-30T22:16:29.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.957+0000 7f79f2ffd700 1 -- 172.21.15.156:0/1603218384 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f7a0403cc20 con 0x7f7a0c130bb0 2023-09-30T22:16:29.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.957+0000 7f7a11593700 1 -- 172.21.15.156:0/1603218384 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a0c05a260 con 0x7f7a0c130bb0 2023-09-30T22:16:29.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:29.962+0000 7f79f2ffd700 1 -- 172.21.15.156:0/1603218384 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f7a04025dc0 con 0x7f7a0c130bb0 2023-09-30T22:16:30.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.125+0000 7f7a11593700 1 -- 172.21.15.156:0/1603218384 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a0c0661a0 con 0x7f7a0c130bb0 2023-09-30T22:16:30.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.126+0000 7f79f2ffd700 1 -- 172.21.15.156:0/1603218384 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11386 (secure 0 0 0) 0x7f7a04025360 con 0x7f7a0c130bb0 2023-09-30T22:16:30.126 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:30.127 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":15,"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","created":"2023-09-30T22:16:15.239992+0000","modified":"2023-09-30T22:16:29.792418+0000","last_up_change":"2023-09-30T22:16:23.392557+0000","last_in_change":"2023-09-30T22:16:16.474206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:16:23.433906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:16:24.367795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:16:28.204677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:16:28.762804+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3ec2e78a-c61f-473a-bfcb-f956cffe4095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6812","nonce":118781}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6813","nonce":118781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6815","nonce":118781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6814","nonce":118781}]},"public_addr":"172.21.15.156:6812/118781","cluster_addr":"172.21.15.156:6813/118781","heartbeat_back_addr":"172.21.15.156:6815/118781","heartbeat_front_addr":"172.21.15.156:6814/118781","state":["exists","up"]},{"osd":1,"uuid":"b682e683-c15a-4bd9-8712-8af96454e9ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6803","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6805","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6807","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6806","nonce":118763}]},"public_addr":"172.21.15.156:6803/118763","cluster_addr":"172.21.15.156:6805/118763","heartbeat_back_addr":"172.21.15.156:6807/118763","heartbeat_front_addr":"172.21.15.156:6806/118763","state":["exists","up"]},{"osd":2,"uuid":"960dbaf0-2e0c-437e-9114-bc22ce522b26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6808","nonce":118788}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6809","nonce":118788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6811","nonce":118788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6810","nonce":118788}]},"public_addr":"172.21.15.156:6808/118788","cluster_addr":"172.21.15.156:6809/118788","heartbeat_back_addr":"172.21.15.156:6811/118788","heartbeat_front_addr":"172.21.15.156:6810/118788","state":["exists","up"]},{"osd":3,"uuid":"c1b19714-78b1-4869-8721-2f6352a64a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6800","nonce":118764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6801","nonce":118764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6804","nonce":118764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6802","nonce":118764}]},"public_addr":"172.21.15.156:6800/118764","cluster_addr":"172.21.15.156:6801/118764","heartbeat_back_addr":"172.21.15.156:6804/118764","heartbeat_front_addr":"172.21.15.156:6802/118764","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.663343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.827397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.806655+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.634746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:16:30.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.128+0000 7f7a11593700 1 -- 172.21.15.156:0/1603218384 >> v1:172.21.15.156:6816/118236 conn(0x7f79f802bb60 legacy=0x7f79f802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:30.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.128+0000 7f7a11593700 1 -- 172.21.15.156:0/1603218384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a0c130bb0 msgr2=0x7f7a0c11ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:30.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.128+0000 7f7a11593700 1 --2- 172.21.15.156:0/1603218384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a0c130bb0 0x7f7a0c11ae00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f7a04014000 tx=0x7f7a0c096680).stop 2023-09-30T22:16:30.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.128+0000 7f7a11593700 1 -- 172.21.15.156:0/1603218384 shutdown_connections 2023-09-30T22:16:30.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.128+0000 7f7a11593700 1 --2- 172.21.15.156:0/1603218384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a0c130bb0 0x7f7a0c11ae00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:30.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.128+0000 7f7a11593700 1 --2- 172.21.15.156:0/1603218384 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a0c0985e0 0x7f7a0c11a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:30.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.128+0000 7f7a11593700 1 --2- 172.21.15.156:0/1603218384 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a0c098eb0 0x7f7a0c11a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:30.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.128+0000 7f7a11593700 1 -- 172.21.15.156:0/1603218384 >> 172.21.15.156:0/1603218384 conn(0x7f7a0c09dc40 msgr2=0x7f7a0c09bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:30.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.128+0000 7f7a11593700 1 -- 172.21.15.156:0/1603218384 shutdown_connections 2023-09-30T22:16:30.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.128+0000 7f7a11593700 1 -- 172.21.15.156:0/1603218384 wait complete. 2023-09-30T22:16:30.140 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:16:30.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.255+0000 7f1c1869b700 1 Processor -- start 2023-09-30T22:16:30.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.255+0000 7f1c1869b700 1 -- start start 2023-09-30T22:16:30.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.256+0000 7f1c1869b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c10062b00 0x7f1c10095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:30.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.256+0000 7f1c1869b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1c10095b80 0x7f1c10095fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:30.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.256+0000 7f1c1869b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c10096490 0x7f1c10131280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:30.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.256+0000 7f1c1869b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c100973f0 con 0x7f1c10095b80 2023-09-30T22:16:30.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.256+0000 7f1c1869b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c10062ee0 con 0x7f1c10062b00 2023-09-30T22:16:30.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.256+0000 7f1c1869b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c10091980 con 0x7f1c10096490 2023-09-30T22:16:30.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.256+0000 7f1c16437700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c10062b00 0x7f1c10095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:30.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.256+0000 7f1c15c36700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1c10095b80 0x7f1c10095fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:30.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.256+0000 7f1c16c38700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c10096490 0x7f1c10131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:30.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.256+0000 7f1c16437700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c10062b00 0x7f1c10095690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:34320/0 (socket says 172.21.15.156:34320) 2023-09-30T22:16:30.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.256+0000 7f1c15c36700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1c10095b80 0x7f1c10095fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:32866/0 (socket says 172.21.15.156:32866) 2023-09-30T22:16:30.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.256+0000 7f1c16437700 1 -- 172.21.15.156:0/2917214633 learned_addr learned my addr 172.21.15.156:0/2917214633 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:30.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.256+0000 7f1c16c38700 1 -- 172.21.15.156:0/2917214633 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c10062b00 msgr2=0x7f1c10095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:30.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.256+0000 7f1c16c38700 1 --2- 172.21.15.156:0/2917214633 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c10062b00 0x7f1c10095690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:30.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.256+0000 7f1c16c38700 1 -- 172.21.15.156:0/2917214633 >> v2:172.21.15.156:3300/0 conn(0x7f1c10095b80 msgr2=0x7f1c10095fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:30.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.256+0000 7f1c16c38700 1 --2- 172.21.15.156:0/2917214633 >> v2:172.21.15.156:3300/0 conn(0x7f1c10095b80 0x7f1c10095fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:30.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.256+0000 7f1c16c38700 1 -- 172.21.15.156:0/2917214633 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c10092310 con 0x7f1c10096490 2023-09-30T22:16:30.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.256+0000 7f1c16437700 1 --2- 172.21.15.156:0/2917214633 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c10062b00 0x7f1c10095690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:30.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.256+0000 7f1c15c36700 1 --2- 172.21.15.156:0/2917214633 >> v2:172.21.15.156:3300/0 conn(0x7f1c10095b80 0x7f1c10095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:30.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.256+0000 7f1c16c38700 1 --2- 172.21.15.156:0/2917214633 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c10096490 0x7f1c10131280 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f1c08009e90 tx=0x7f1c08009780).ready entity=mon.2 client_cookie=d8247e65273de80a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:30.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.256+0000 7f1c15435700 1 -- 172.21.15.156:0/2917214633 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0800e070 con 0x7f1c10096490 2023-09-30T22:16:30.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.256+0000 7f1c15435700 1 -- 172.21.15.156:0/2917214633 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0800ba70 con 0x7f1c10096490 2023-09-30T22:16:30.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.256+0000 7f1c15435700 1 -- 172.21.15.156:0/2917214633 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0800bdf0 con 0x7f1c10096490 2023-09-30T22:16:30.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.257+0000 7f1c1869b700 1 -- 172.21.15.156:0/2917214633 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c10096490 msgr2=0x7f1c10131280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:30.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.257+0000 7f1c1869b700 1 --2- 172.21.15.156:0/2917214633 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c10096490 0x7f1c10131280 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f1c08009e90 tx=0x7f1c08009780).stop 2023-09-30T22:16:30.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.257+0000 7f1c1869b700 1 -- 172.21.15.156:0/2917214633 shutdown_connections 2023-09-30T22:16:30.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.257+0000 7f1c1869b700 1 --2- 172.21.15.156:0/2917214633 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c10096490 0x7f1c10131280 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:30.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.257+0000 7f1c1869b700 1 --2- 172.21.15.156:0/2917214633 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c10062b00 0x7f1c10095690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:30.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.257+0000 7f1c1869b700 1 --2- 172.21.15.156:0/2917214633 >> v2:172.21.15.156:3300/0 conn(0x7f1c10095b80 0x7f1c10095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:30.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.257+0000 7f1c1869b700 1 -- 172.21.15.156:0/2917214633 >> 172.21.15.156:0/2917214633 conn(0x7f1c1009aa50 msgr2=0x7f1c1009ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:30.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.257+0000 7f1c1869b700 1 -- 172.21.15.156:0/2917214633 shutdown_connections 2023-09-30T22:16:30.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.257+0000 7f1c1869b700 1 -- 172.21.15.156:0/2917214633 wait complete. 2023-09-30T22:16:30.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.258+0000 7f1c1869b700 1 Processor -- start 2023-09-30T22:16:30.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.258+0000 7f1c1869b700 1 -- start start 2023-09-30T22:16:30.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.258+0000 7f1c1869b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c10062b00 0x7f1c1012d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:30.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.258+0000 7f1c1869b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c10095b80 0x7f1c10116570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:30.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.258+0000 7f1c1869b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c10096490 0x7f1c10116a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:30.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.258+0000 7f1c1869b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1011a9f0 con 0x7f1c10062b00 2023-09-30T22:16:30.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.258+0000 7f1c1869b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1011a5d0 con 0x7f1c10096490 2023-09-30T22:16:30.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.258+0000 7f1c1869b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c10096da0 con 0x7f1c10095b80 2023-09-30T22:16:30.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.258+0000 7f1c16437700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c10062b00 0x7f1c1012d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:30.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.258+0000 7f1c15c36700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c10095b80 0x7f1c10116570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:30.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.258+0000 7f1c16437700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c10062b00 0x7f1c1012d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:32874/0 (socket says 172.21.15.156:32874) 2023-09-30T22:16:30.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.258+0000 7f1c16437700 1 -- 172.21.15.156:0/4231093719 learned_addr learned my addr 172.21.15.156:0/4231093719 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:30.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.258+0000 7f1c16c38700 1 --2- 172.21.15.156:0/4231093719 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c10096490 0x7f1c10116a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:30.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.259+0000 7f1c16437700 1 -- 172.21.15.156:0/4231093719 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c10095b80 msgr2=0x7f1c10116570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:30.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.259+0000 7f1c16437700 1 --2- 172.21.15.156:0/4231093719 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c10095b80 0x7f1c10116570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:30.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.259+0000 7f1c16437700 1 -- 172.21.15.156:0/4231093719 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c10096490 msgr2=0x7f1c10116a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:30.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.259+0000 7f1c16437700 1 --2- 172.21.15.156:0/4231093719 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c10096490 0x7f1c10116a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:30.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.259+0000 7f1c16437700 1 -- 172.21.15.156:0/4231093719 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c009370 con 0x7f1c10062b00 2023-09-30T22:16:30.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.259+0000 7f1c15c36700 1 --2- 172.21.15.156:0/4231093719 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c10095b80 0x7f1c10116570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:30.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.259+0000 7f1c16437700 1 --2- 172.21.15.156:0/4231093719 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c10062b00 0x7f1c1012d600 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f1c0c00ea20 tx=0x7f1c0c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:30.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.259+0000 7f1c067fc700 1 -- 172.21.15.156:0/4231093719 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c009650 con 0x7f1c10062b00 2023-09-30T22:16:30.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.259+0000 7f1c067fc700 1 -- 172.21.15.156:0/4231093719 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0c00ee60 con 0x7f1c10062b00 2023-09-30T22:16:30.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.259+0000 7f1c067fc700 1 -- 172.21.15.156:0/4231093719 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c00ca60 con 0x7f1c10062b00 2023-09-30T22:16:30.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.259+0000 7f1c1869b700 1 -- 172.21.15.156:0/4231093719 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c000092a0 con 0x7f1c10062b00 2023-09-30T22:16:30.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.259+0000 7f1c1869b700 1 -- 172.21.15.156:0/4231093719 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c08009a20 con 0x7f1c10062b00 2023-09-30T22:16:30.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.260+0000 7f1c067fc700 1 -- 172.21.15.156:0/4231093719 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f1c0c01b400 con 0x7f1c10062b00 2023-09-30T22:16:30.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.260+0000 7f1c067fc700 1 -- 172.21.15.156:0/4231093719 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f1c0c03b460 con 0x7f1c10062b00 2023-09-30T22:16:30.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.260+0000 7f1c1869b700 1 -- 172.21.15.156:0/4231093719 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c10062770 con 0x7f1c10062b00 2023-09-30T22:16:30.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.264+0000 7f1c067fc700 1 -- 172.21.15.156:0/4231093719 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f1c0c016020 con 0x7f1c10062b00 2023-09-30T22:16:30.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.426+0000 7f1c1869b700 1 -- 172.21.15.156:0/4231093719 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c1005a260 con 0x7f1c10062b00 2023-09-30T22:16:30.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.426+0000 7f1c067fc700 1 -- 172.21.15.156:0/4231093719 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11386 (secure 0 0 0) 0x7f1c0c019310 con 0x7f1c10062b00 2023-09-30T22:16:30.427 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:30.427 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":15,"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","created":"2023-09-30T22:16:15.239992+0000","modified":"2023-09-30T22:16:29.792418+0000","last_up_change":"2023-09-30T22:16:23.392557+0000","last_in_change":"2023-09-30T22:16:16.474206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:16:23.433906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:16:24.367795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:16:28.204677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:16:28.762804+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3ec2e78a-c61f-473a-bfcb-f956cffe4095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6812","nonce":118781}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6813","nonce":118781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6815","nonce":118781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6814","nonce":118781}]},"public_addr":"172.21.15.156:6812/118781","cluster_addr":"172.21.15.156:6813/118781","heartbeat_back_addr":"172.21.15.156:6815/118781","heartbeat_front_addr":"172.21.15.156:6814/118781","state":["exists","up"]},{"osd":1,"uuid":"b682e683-c15a-4bd9-8712-8af96454e9ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6803","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6805","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6807","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6806","nonce":118763}]},"public_addr":"172.21.15.156:6803/118763","cluster_addr":"172.21.15.156:6805/118763","heartbeat_back_addr":"172.21.15.156:6807/118763","heartbeat_front_addr":"172.21.15.156:6806/118763","state":["exists","up"]},{"osd":2,"uuid":"960dbaf0-2e0c-437e-9114-bc22ce522b26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6808","nonce":118788}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6809","nonce":118788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6811","nonce":118788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6810","nonce":118788}]},"public_addr":"172.21.15.156:6808/118788","cluster_addr":"172.21.15.156:6809/118788","heartbeat_back_addr":"172.21.15.156:6811/118788","heartbeat_front_addr":"172.21.15.156:6810/118788","state":["exists","up"]},{"osd":3,"uuid":"c1b19714-78b1-4869-8721-2f6352a64a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6800","nonce":118764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6801","nonce":118764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6804","nonce":118764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6802","nonce":118764}]},"public_addr":"172.21.15.156:6800/118764","cluster_addr":"172.21.15.156:6801/118764","heartbeat_back_addr":"172.21.15.156:6804/118764","heartbeat_front_addr":"172.21.15.156:6802/118764","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.663343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.827397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.806655+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.634746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:16:30.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.428+0000 7f1c1869b700 1 -- 172.21.15.156:0/4231093719 >> v1:172.21.15.156:6816/118236 conn(0x7f1bf402bb60 legacy=0x7f1bf402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:30.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.428+0000 7f1c1869b700 1 -- 172.21.15.156:0/4231093719 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c10062b00 msgr2=0x7f1c1012d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:30.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.428+0000 7f1c1869b700 1 --2- 172.21.15.156:0/4231093719 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c10062b00 0x7f1c1012d600 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f1c0c00ea20 tx=0x7f1c0c0090f0).stop 2023-09-30T22:16:30.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.428+0000 7f1c1869b700 1 -- 172.21.15.156:0/4231093719 shutdown_connections 2023-09-30T22:16:30.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.428+0000 7f1c1869b700 1 --2- 172.21.15.156:0/4231093719 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c10096490 0x7f1c10116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:30.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.428+0000 7f1c1869b700 1 --2- 172.21.15.156:0/4231093719 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c10062b00 0x7f1c1012d600 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:30.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.428+0000 7f1c1869b700 1 --2- 172.21.15.156:0/4231093719 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c10095b80 0x7f1c10116570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:30.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.428+0000 7f1c1869b700 1 -- 172.21.15.156:0/4231093719 >> 172.21.15.156:0/4231093719 conn(0x7f1c1009aa50 msgr2=0x7f1c1012fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:30.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.428+0000 7f1c1869b700 1 -- 172.21.15.156:0/4231093719 shutdown_connections 2023-09-30T22:16:30.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.428+0000 7f1c1869b700 1 -- 172.21.15.156:0/4231093719 wait complete. 2023-09-30T22:16:30.442 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-30T22:16:30.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.559+0000 7fbd56ba1700 1 Processor -- start 2023-09-30T22:16:30.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.559+0000 7fbd56ba1700 1 -- start start 2023-09-30T22:16:30.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.560+0000 7fbd56ba1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd500976f0 0x7fbd5012fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:30.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.560+0000 7fbd56ba1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd50130340 0x7fbd50132730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:30.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.560+0000 7fbd56ba1700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd500980b0 con 0x7fbd50066310 2023-09-30T22:16:30.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.560+0000 7fbd56ba1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd500666f0 con 0x7fbd500976f0 2023-09-30T22:16:30.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.560+0000 7fbd56ba1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd50065530 con 0x7fbd50130340 2023-09-30T22:16:30.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.560+0000 7fbd5513e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd50130340 0x7fbd50132730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:30.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.560+0000 7fbd5493d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fbd50066310 0x7fbd50127df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45816/0 (socket says 172.21.15.156:45816) 2023-09-30T22:16:30.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.560+0000 7fbd5493d700 1 -- 172.21.15.156:0/2197618002 learned_addr learned my addr 172.21.15.156:0/2197618002 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:30.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.560+0000 7fbd4ffff700 1 --2- 172.21.15.156:0/2197618002 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd500976f0 0x7fbd5012fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:30.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.560+0000 7fbd4f7fe700 1 -- 172.21.15.156:0/2197618002 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215098111 0 0) 0x7fbd500980b0 con 0x7fbd50066310 2023-09-30T22:16:30.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.560+0000 7fbd5513e700 1 -- 172.21.15.156:0/2197618002 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd500976f0 msgr2=0x7fbd5012fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:30.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.560+0000 7fbd5513e700 1 --2- 172.21.15.156:0/2197618002 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd500976f0 0x7fbd5012fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:30.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.560+0000 7fbd5513e700 1 -- 172.21.15.156:0/2197618002 >> v1:172.21.15.156:6789/0 conn(0x7fbd50066310 legacy=0x7fbd50127df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:30.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.560+0000 7fbd5513e700 1 -- 172.21.15.156:0/2197618002 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd50128500 con 0x7fbd50130340 2023-09-30T22:16:30.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.560+0000 7fbd4ffff700 1 --2- 172.21.15.156:0/2197618002 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd500976f0 0x7fbd5012fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:30.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.560+0000 7fbd5513e700 1 --2- 172.21.15.156:0/2197618002 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd50130340 0x7fbd50132730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fbd48009ec0 tx=0x7fbd48009780).ready entity=mon.2 client_cookie=6f8cacdcbb2087e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:30.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.561+0000 7fbd4f7fe700 1 -- 172.21.15.156:0/2197618002 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4800e070 con 0x7fbd50130340 2023-09-30T22:16:30.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.561+0000 7fbd4f7fe700 1 -- 172.21.15.156:0/2197618002 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4800bbf0 con 0x7fbd50130340 2023-09-30T22:16:30.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.561+0000 7fbd4f7fe700 1 -- 172.21.15.156:0/2197618002 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd48012410 con 0x7fbd50130340 2023-09-30T22:16:30.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.561+0000 7fbd56ba1700 1 -- 172.21.15.156:0/2197618002 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd50130340 msgr2=0x7fbd50132730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:30.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.561+0000 7fbd56ba1700 1 --2- 172.21.15.156:0/2197618002 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd50130340 0x7fbd50132730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fbd48009ec0 tx=0x7fbd48009780).stop 2023-09-30T22:16:30.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.561+0000 7fbd56ba1700 1 -- 172.21.15.156:0/2197618002 shutdown_connections 2023-09-30T22:16:30.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.561+0000 7fbd56ba1700 1 --2- 172.21.15.156:0/2197618002 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd50130340 0x7fbd50132730 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:30.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.561+0000 7fbd56ba1700 1 --2- 172.21.15.156:0/2197618002 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd500976f0 0x7fbd5012fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:30.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.561+0000 7fbd56ba1700 1 -- 172.21.15.156:0/2197618002 >> 172.21.15.156:0/2197618002 conn(0x7fbd5009bad0 msgr2=0x7fbd5009bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:30.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.561+0000 7fbd56ba1700 1 -- 172.21.15.156:0/2197618002 shutdown_connections 2023-09-30T22:16:30.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.561+0000 7fbd56ba1700 1 -- 172.21.15.156:0/2197618002 wait complete. 2023-09-30T22:16:30.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.562+0000 7fbd56ba1700 1 Processor -- start 2023-09-30T22:16:30.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.563+0000 7fbd56ba1700 1 -- start start 2023-09-30T22:16:30.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.563+0000 7fbd56ba1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd50066310 0x7fbd50112e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:30.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.563+0000 7fbd56ba1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd500976f0 0x7fbd5012cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:30.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.563+0000 7fbd56ba1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd50130340 0x7fbd5012d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:30.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.563+0000 7fbd56ba1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd500651c0 con 0x7fbd500976f0 2023-09-30T22:16:30.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.563+0000 7fbd56ba1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd501123d0 con 0x7fbd50066310 2023-09-30T22:16:30.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.563+0000 7fbd56ba1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd50125000 con 0x7fbd50130340 2023-09-30T22:16:30.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.563+0000 7fbd5493d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd50066310 0x7fbd50112e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:30.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.563+0000 7fbd4ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd500976f0 0x7fbd5012cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:30.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.563+0000 7fbd5493d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd50066310 0x7fbd50112e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:34338/0 (socket says 172.21.15.156:34338) 2023-09-30T22:16:30.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.563+0000 7fbd5493d700 1 -- 172.21.15.156:0/4046590765 learned_addr learned my addr 172.21.15.156:0/4046590765 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:30.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.563+0000 7fbd5513e700 1 --2- 172.21.15.156:0/4046590765 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd50130340 0x7fbd5012d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:30.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.563+0000 7fbd4ffff700 1 -- 172.21.15.156:0/4046590765 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd50130340 msgr2=0x7fbd5012d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:30.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.563+0000 7fbd4ffff700 1 --2- 172.21.15.156:0/4046590765 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd50130340 0x7fbd5012d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:30.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.564+0000 7fbd4ffff700 1 -- 172.21.15.156:0/4046590765 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd50066310 msgr2=0x7fbd50112e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:30.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.564+0000 7fbd4ffff700 1 --2- 172.21.15.156:0/4046590765 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd50066310 0x7fbd50112e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:30.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.564+0000 7fbd4ffff700 1 -- 172.21.15.156:0/4046590765 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3c0092a0 con 0x7fbd500976f0 2023-09-30T22:16:30.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.564+0000 7fbd5493d700 1 --2- 172.21.15.156:0/4046590765 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd50066310 0x7fbd50112e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:30.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.564+0000 7fbd4ffff700 1 --2- 172.21.15.156:0/4046590765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd500976f0 0x7fbd5012cc80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fbd3c00e980 tx=0x7fbd3c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:30.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.564+0000 7fbd4cff9700 1 -- 172.21.15.156:0/4046590765 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c009580 con 0x7fbd500976f0 2023-09-30T22:16:30.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.564+0000 7fbd4cff9700 1 -- 172.21.15.156:0/4046590765 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3c012600 con 0x7fbd500976f0 2023-09-30T22:16:30.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.564+0000 7fbd4cff9700 1 -- 172.21.15.156:0/4046590765 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c012980 con 0x7fbd500976f0 2023-09-30T22:16:30.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.564+0000 7fbd56ba1700 1 -- 172.21.15.156:0/4046590765 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd48009a20 con 0x7fbd500976f0 2023-09-30T22:16:30.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.564+0000 7fbd56ba1700 1 -- 172.21.15.156:0/4046590765 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd5012e080 con 0x7fbd500976f0 2023-09-30T22:16:30.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.565+0000 7fbd4cff9700 1 -- 172.21.15.156:0/4046590765 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fbd3c012d30 con 0x7fbd500976f0 2023-09-30T22:16:30.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.565+0000 7fbd4cff9700 1 -- 172.21.15.156:0/4046590765 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fbd3c03b370 con 0x7fbd500976f0 2023-09-30T22:16:30.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.565+0000 7fbd56ba1700 1 -- 172.21.15.156:0/4046590765 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd5005a260 con 0x7fbd500976f0 2023-09-30T22:16:30.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.569+0000 7fbd4cff9700 1 -- 172.21.15.156:0/4046590765 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fbd3c016070 con 0x7fbd500976f0 2023-09-30T22:16:30.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.763+0000 7fbd56ba1700 1 -- 172.21.15.156:0/4046590765 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbd5012da80 con 0x7fbd500976f0 2023-09-30T22:16:30.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.795+0000 7fbd4cff9700 1 -- 172.21.15.156:0/4046590765 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v4) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbd3c016020 con 0x7fbd500976f0 2023-09-30T22:16:30.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.798+0000 7fbd56ba1700 1 -- 172.21.15.156:0/4046590765 >> v1:172.21.15.156:6816/118236 conn(0x7fbd3402bb60 legacy=0x7fbd3402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:30.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.798+0000 7fbd56ba1700 1 -- 172.21.15.156:0/4046590765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd500976f0 msgr2=0x7fbd5012cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:30.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.798+0000 7fbd56ba1700 1 --2- 172.21.15.156:0/4046590765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd500976f0 0x7fbd5012cc80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fbd3c00e980 tx=0x7fbd3c009060).stop 2023-09-30T22:16:30.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.799+0000 7fbd56ba1700 1 -- 172.21.15.156:0/4046590765 shutdown_connections 2023-09-30T22:16:30.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.799+0000 7fbd56ba1700 1 --2- 172.21.15.156:0/4046590765 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd50130340 0x7fbd5012d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:30.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.799+0000 7fbd56ba1700 1 --2- 172.21.15.156:0/4046590765 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd50066310 0x7fbd50112e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:30.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.799+0000 7fbd56ba1700 1 --2- 172.21.15.156:0/4046590765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd500976f0 0x7fbd5012cc80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:30.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.799+0000 7fbd56ba1700 1 -- 172.21.15.156:0/4046590765 >> 172.21.15.156:0/4046590765 conn(0x7fbd5009bad0 msgr2=0x7fbd5012a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:30.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.799+0000 7fbd56ba1700 1 -- 172.21.15.156:0/4046590765 shutdown_connections 2023-09-30T22:16:30.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.799+0000 7fbd56ba1700 1 -- 172.21.15.156:0/4046590765 wait complete. 2023-09-30T22:16:30.812 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-09-30T22:16:30.813 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-30T22:16:30.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.930+0000 7ff5aba4a700 1 Processor -- start 2023-09-30T22:16:30.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.930+0000 7ff5aba4a700 1 -- start start 2023-09-30T22:16:30.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.931+0000 7ff5aba4a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff5a40968b0 0x7ff5a4096c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:30.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.931+0000 7ff5aba4a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5a40685a0 0x7ff5a412fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:30.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.931+0000 7ff5aba4a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a40692c0 con 0x7ff5a4097180 2023-09-30T22:16:30.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.931+0000 7ff5aba4a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a4092540 con 0x7ff5a40968b0 2023-09-30T22:16:30.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.931+0000 7ff5aba4a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4092210 con 0x7ff5a40685a0 2023-09-30T22:16:30.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.931+0000 7ff5a9fe7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5a40685a0 0x7ff5a412fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:30.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.931+0000 7ff5a97e6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff5a40968b0 0x7ff5a4096c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:30.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.931+0000 7ff5a9fe7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5a40685a0 0x7ff5a412fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56150/0 (socket says 172.21.15.156:56150) 2023-09-30T22:16:30.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.931+0000 7ff5a9fe7700 1 -- 172.21.15.156:0/259013249 learned_addr learned my addr 172.21.15.156:0/259013249 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:30.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.931+0000 7ff5a8fe5700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff5a4097180 0x7ff5a4067e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45832/0 (socket says 172.21.15.156:45832) 2023-09-30T22:16:30.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.931+0000 7ff5a9fe7700 1 -- 172.21.15.156:0/259013249 >> v2:172.21.15.156:3300/0 conn(0x7ff5a40968b0 msgr2=0x7ff5a4096c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:30.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.931+0000 7ff5a9fe7700 1 --2- 172.21.15.156:0/259013249 >> v2:172.21.15.156:3300/0 conn(0x7ff5a40968b0 0x7ff5a4096c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:30.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.931+0000 7ff5a9fe7700 1 -- 172.21.15.156:0/259013249 >> v1:172.21.15.156:6789/0 conn(0x7ff5a4097180 legacy=0x7ff5a4067e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:30.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.931+0000 7ff5a9fe7700 1 -- 172.21.15.156:0/259013249 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a4093430 con 0x7ff5a40685a0 2023-09-30T22:16:30.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.931+0000 7ff5a3fff700 1 -- 172.21.15.156:0/259013249 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256491039 0 0) 0x7ff5a40692c0 con 0x7ff5a4097180 2023-09-30T22:16:30.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.931+0000 7ff5a97e6700 1 --2- 172.21.15.156:0/259013249 >> v2:172.21.15.156:3300/0 conn(0x7ff5a40968b0 0x7ff5a4096c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:30.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.932+0000 7ff5a9fe7700 1 --2- 172.21.15.156:0/259013249 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5a40685a0 0x7ff5a412fc70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7ff594007a60 tx=0x7ff59400a040).ready entity=mon.2 client_cookie=5206b941a6bf6c2b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:30.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.932+0000 7ff5a3fff700 1 -- 172.21.15.156:0/259013249 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59400d040 con 0x7ff5a40685a0 2023-09-30T22:16:30.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.932+0000 7ff5a3fff700 1 -- 172.21.15.156:0/259013249 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff594005a90 con 0x7ff5a40685a0 2023-09-30T22:16:30.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.932+0000 7ff5a3fff700 1 -- 172.21.15.156:0/259013249 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594005e30 con 0x7ff5a40685a0 2023-09-30T22:16:30.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.932+0000 7ff5aba4a700 1 -- 172.21.15.156:0/259013249 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5a40685a0 msgr2=0x7ff5a412fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:30.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.932+0000 7ff5aba4a700 1 --2- 172.21.15.156:0/259013249 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5a40685a0 0x7ff5a412fc70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7ff594007a60 tx=0x7ff59400a040).stop 2023-09-30T22:16:30.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.932+0000 7ff5aba4a700 1 -- 172.21.15.156:0/259013249 shutdown_connections 2023-09-30T22:16:30.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.932+0000 7ff5aba4a700 1 --2- 172.21.15.156:0/259013249 >> v2:172.21.15.156:3300/0 conn(0x7ff5a40968b0 0x7ff5a4096c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:30.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.932+0000 7ff5aba4a700 1 --2- 172.21.15.156:0/259013249 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5a40685a0 0x7ff5a412fc70 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:30.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.932+0000 7ff5aba4a700 1 -- 172.21.15.156:0/259013249 >> 172.21.15.156:0/259013249 conn(0x7ff5a409a1c0 msgr2=0x7ff5a409a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:30.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.932+0000 7ff5aba4a700 1 -- 172.21.15.156:0/259013249 shutdown_connections 2023-09-30T22:16:30.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.932+0000 7ff5aba4a700 1 -- 172.21.15.156:0/259013249 wait complete. 2023-09-30T22:16:30.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.933+0000 7ff5aba4a700 1 Processor -- start 2023-09-30T22:16:30.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.933+0000 7ff5aba4a700 1 -- start start 2023-09-30T22:16:30.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.934+0000 7ff5aba4a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff5a40685a0 0x7ff5a4135c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:30.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.934+0000 7ff5aba4a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5a40968b0 0x7ff5a4136170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:30.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.934+0000 7ff5aba4a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5a4097180 0x7ff5a4115aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:30.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.934+0000 7ff5aba4a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4128a20 con 0x7ff5a4097180 2023-09-30T22:16:30.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.934+0000 7ff5aba4a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4118160 con 0x7ff5a40685a0 2023-09-30T22:16:30.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.934+0000 7ff5aba4a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4091dc0 con 0x7ff5a40968b0 2023-09-30T22:16:30.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.934+0000 7ff5a8fe5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5a40968b0 0x7ff5a4136170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:30.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.934+0000 7ff5a9fe7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5a4097180 0x7ff5a4115aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:30.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.934+0000 7ff5a97e6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff5a40685a0 0x7ff5a4135c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:30.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.934+0000 7ff5a9fe7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5a4097180 0x7ff5a4115aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:32910/0 (socket says 172.21.15.156:32910) 2023-09-30T22:16:30.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.934+0000 7ff5a8fe5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5a40968b0 0x7ff5a4136170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56160/0 (socket says 172.21.15.156:56160) 2023-09-30T22:16:30.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.934+0000 7ff5a9fe7700 1 -- 172.21.15.156:0/3667519930 learned_addr learned my addr 172.21.15.156:0/3667519930 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:30.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.934+0000 7ff5a9fe7700 1 -- 172.21.15.156:0/3667519930 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5a40968b0 msgr2=0x7ff5a4136170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:30.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.934+0000 7ff5a9fe7700 1 --2- 172.21.15.156:0/3667519930 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5a40968b0 0x7ff5a4136170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:30.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.934+0000 7ff5a9fe7700 1 -- 172.21.15.156:0/3667519930 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff5a40685a0 msgr2=0x7ff5a4135c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:30.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.934+0000 7ff5a9fe7700 1 --2- 172.21.15.156:0/3667519930 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff5a40685a0 0x7ff5a4135c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:30.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.934+0000 7ff5a9fe7700 1 -- 172.21.15.156:0/3667519930 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59c0092a0 con 0x7ff5a4097180 2023-09-30T22:16:30.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.934+0000 7ff5a97e6700 1 --2- 172.21.15.156:0/3667519930 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff5a40685a0 0x7ff5a4135c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:30.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.934+0000 7ff5a9fe7700 1 --2- 172.21.15.156:0/3667519930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5a4097180 0x7ff5a4115aa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ff594009ec0 tx=0x7ff59400a040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:30.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.934+0000 7ff5a17fa700 1 -- 172.21.15.156:0/3667519930 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594020070 con 0x7ff5a4097180 2023-09-30T22:16:30.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.934+0000 7ff5a17fa700 1 -- 172.21.15.156:0/3667519930 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff594007a90 con 0x7ff5a4097180 2023-09-30T22:16:30.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.934+0000 7ff5aba4a700 1 -- 172.21.15.156:0/3667519930 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff594009390 con 0x7ff5a4097180 2023-09-30T22:16:30.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.934+0000 7ff5a17fa700 1 -- 172.21.15.156:0/3667519930 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59400d070 con 0x7ff5a4097180 2023-09-30T22:16:30.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.934+0000 7ff5aba4a700 1 -- 172.21.15.156:0/3667519930 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a4119c90 con 0x7ff5a4097180 2023-09-30T22:16:30.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.935+0000 7ff5a17fa700 1 -- 172.21.15.156:0/3667519930 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7ff594012b20 con 0x7ff5a4097180 2023-09-30T22:16:30.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.935+0000 7ff5a17fa700 1 -- 172.21.15.156:0/3667519930 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7ff59403c3b0 con 0x7ff5a4097180 2023-09-30T22:16:30.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.936+0000 7ff5aba4a700 1 -- 172.21.15.156:0/3667519930 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a405a260 con 0x7ff5a4097180 2023-09-30T22:16:30.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:30.940+0000 7ff5a17fa700 1 -- 172.21.15.156:0/3667519930 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7ff594012dd0 con 0x7ff5a4097180 2023-09-30T22:16:31.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:31.136+0000 7ff5aba4a700 1 -- 172.21.15.156:0/3667519930 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff5a4046c20 con 0x7ff5a4097180 2023-09-30T22:16:31.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:31.993+0000 7ff5a17fa700 1 -- 172.21.15.156:0/3667519930 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v5) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff59401a320 con 0x7ff5a4097180 2023-09-30T22:16:31.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:31.996+0000 7ff5aba4a700 1 -- 172.21.15.156:0/3667519930 >> v1:172.21.15.156:6816/118236 conn(0x7ff59002bb60 legacy=0x7ff59002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:31.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:31.996+0000 7ff5aba4a700 1 -- 172.21.15.156:0/3667519930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5a4097180 msgr2=0x7ff5a4115aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:31.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:31.996+0000 7ff5aba4a700 1 --2- 172.21.15.156:0/3667519930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5a4097180 0x7ff5a4115aa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ff594009ec0 tx=0x7ff59400a040).stop 2023-09-30T22:16:31.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:31.996+0000 7ff5aba4a700 1 -- 172.21.15.156:0/3667519930 shutdown_connections 2023-09-30T22:16:31.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:31.996+0000 7ff5aba4a700 1 --2- 172.21.15.156:0/3667519930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5a4097180 0x7ff5a4115aa0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:31.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:31.996+0000 7ff5aba4a700 1 --2- 172.21.15.156:0/3667519930 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff5a40685a0 0x7ff5a4135c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:31.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:31.996+0000 7ff5aba4a700 1 --2- 172.21.15.156:0/3667519930 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5a40968b0 0x7ff5a4136170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:31.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:31.996+0000 7ff5aba4a700 1 -- 172.21.15.156:0/3667519930 >> 172.21.15.156:0/3667519930 conn(0x7ff5a409a1c0 msgr2=0x7ff5a4098ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:31.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:31.996+0000 7ff5aba4a700 1 -- 172.21.15.156:0/3667519930 shutdown_connections 2023-09-30T22:16:31.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:31.996+0000 7ff5aba4a700 1 -- 172.21.15.156:0/3667519930 wait complete. 2023-09-30T22:16:32.011 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-30T22:16:32.012 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:16:32.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.133+0000 7fe9aaf03700 1 Processor -- start 2023-09-30T22:16:32.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.133+0000 7fe9aaf03700 1 -- start start 2023-09-30T22:16:32.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.133+0000 7fe9aaf03700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9a4062b00 0x7fe9a4095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:32.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.133+0000 7fe9aaf03700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9a40966b0 0x7fe9a4132290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:32.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.133+0000 7fe9aaf03700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a4091980 con 0x7fe9a4095b80 2023-09-30T22:16:32.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.133+0000 7fe9aaf03700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a40973f0 con 0x7fe9a40966b0 2023-09-30T22:16:32.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.133+0000 7fe9aaf03700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a4062ee0 con 0x7fe9a4062b00 2023-09-30T22:16:32.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.133+0000 7fe9a8c9f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9a4062b00 0x7fe9a4095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:32.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.133+0000 7fe9a3fff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe9a4095b80 0x7fe9a4095fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37800/0 (socket says 172.21.15.156:37800) 2023-09-30T22:16:32.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.133+0000 7fe9a3fff700 1 -- 172.21.15.156:0/3212413113 learned_addr learned my addr 172.21.15.156:0/3212413113 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:32.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.133+0000 7fe9a94a0700 1 --2- 172.21.15.156:0/3212413113 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9a40966b0 0x7fe9a4132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:32.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.134+0000 7fe9a37fe700 1 -- 172.21.15.156:0/3212413113 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1506508299 0 0) 0x7fe9a4091980 con 0x7fe9a4095b80 2023-09-30T22:16:32.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.134+0000 7fe9a37fe700 1 -- 172.21.15.156:0/3212413113 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9940033f0 con 0x7fe9a4095b80 2023-09-30T22:16:32.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.134+0000 7fe9a8c9f700 1 -- 172.21.15.156:0/3212413113 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9a40966b0 msgr2=0x7fe9a4132290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:32.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.134+0000 7fe9a8c9f700 1 --2- 172.21.15.156:0/3212413113 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9a40966b0 0x7fe9a4132290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:32.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.134+0000 7fe9a8c9f700 1 -- 172.21.15.156:0/3212413113 >> v1:172.21.15.156:6789/0 conn(0x7fe9a4095b80 legacy=0x7fe9a4095fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:32.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.134+0000 7fe9a8c9f700 1 -- 172.21.15.156:0/3212413113 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a4092310 con 0x7fe9a4062b00 2023-09-30T22:16:32.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.134+0000 7fe9a94a0700 1 --2- 172.21.15.156:0/3212413113 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9a40966b0 0x7fe9a4132290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:32.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.134+0000 7fe9a8c9f700 1 --2- 172.21.15.156:0/3212413113 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9a4062b00 0x7fe9a4095690 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fe998009790 tx=0x7fe998009060).ready entity=mon.2 client_cookie=60f1bbcc38fb58a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:32.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.134+0000 7fe9a37fe700 1 -- 172.21.15.156:0/3212413113 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99800f510 con 0x7fe9a4062b00 2023-09-30T22:16:32.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.134+0000 7fe9a37fe700 1 -- 172.21.15.156:0/3212413113 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99800f670 con 0x7fe9a4062b00 2023-09-30T22:16:32.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.134+0000 7fe9a37fe700 1 -- 172.21.15.156:0/3212413113 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99800f9f0 con 0x7fe9a4062b00 2023-09-30T22:16:32.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.134+0000 7fe9aaf03700 1 -- 172.21.15.156:0/3212413113 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9a4062b00 msgr2=0x7fe9a4095690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:32.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.134+0000 7fe9aaf03700 1 --2- 172.21.15.156:0/3212413113 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9a4062b00 0x7fe9a4095690 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fe998009790 tx=0x7fe998009060).stop 2023-09-30T22:16:32.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.134+0000 7fe9aaf03700 1 -- 172.21.15.156:0/3212413113 shutdown_connections 2023-09-30T22:16:32.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.134+0000 7fe9aaf03700 1 --2- 172.21.15.156:0/3212413113 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9a40966b0 0x7fe9a4132290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:32.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.134+0000 7fe9aaf03700 1 --2- 172.21.15.156:0/3212413113 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9a4062b00 0x7fe9a4095690 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:32.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.134+0000 7fe9aaf03700 1 -- 172.21.15.156:0/3212413113 >> 172.21.15.156:0/3212413113 conn(0x7fe9a409aa50 msgr2=0x7fe9a409ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:32.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.134+0000 7fe9aaf03700 1 -- 172.21.15.156:0/3212413113 shutdown_connections 2023-09-30T22:16:32.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.134+0000 7fe9aaf03700 1 -- 172.21.15.156:0/3212413113 wait complete. 2023-09-30T22:16:32.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.135+0000 7fe9aaf03700 1 Processor -- start 2023-09-30T22:16:32.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.135+0000 7fe9aaf03700 1 -- start start 2023-09-30T22:16:32.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.136+0000 7fe9aaf03700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9a4062b00 0x7fe9a41194a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:32.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.136+0000 7fe9aaf03700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9a4095b80 0x7fe9a41154f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:32.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.136+0000 7fe9aaf03700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9a40966b0 0x7fe9a41159e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:32.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.136+0000 7fe9aaf03700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a412d640 con 0x7fe9a4095b80 2023-09-30T22:16:32.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.136+0000 7fe9aaf03700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a41168f0 con 0x7fe9a4062b00 2023-09-30T22:16:32.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.136+0000 7fe9aaf03700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a412da30 con 0x7fe9a40966b0 2023-09-30T22:16:32.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.136+0000 7fe9a8c9f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9a4062b00 0x7fe9a41194a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:32.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.136+0000 7fe9a94a0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9a40966b0 0x7fe9a41159e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:32.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.136+0000 7fe9a8c9f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9a4062b00 0x7fe9a41194a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:47942/0 (socket says 172.21.15.156:47942) 2023-09-30T22:16:32.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.136+0000 7fe9a8c9f700 1 -- 172.21.15.156:0/669938062 learned_addr learned my addr 172.21.15.156:0/669938062 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:32.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.136+0000 7fe9a3fff700 1 --2- 172.21.15.156:0/669938062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9a4095b80 0x7fe9a41154f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:32.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.136+0000 7fe9a8c9f700 1 -- 172.21.15.156:0/669938062 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9a40966b0 msgr2=0x7fe9a41159e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:32.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.136+0000 7fe9a8c9f700 1 --2- 172.21.15.156:0/669938062 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9a40966b0 0x7fe9a41159e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:32.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.136+0000 7fe9a8c9f700 1 -- 172.21.15.156:0/669938062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9a4095b80 msgr2=0x7fe9a41154f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:32.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.136+0000 7fe9a8c9f700 1 --2- 172.21.15.156:0/669938062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9a4095b80 0x7fe9a41154f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:32.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.136+0000 7fe9a8c9f700 1 -- 172.21.15.156:0/669938062 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99c009a20 con 0x7fe9a4062b00 2023-09-30T22:16:32.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.136+0000 7fe9a94a0700 1 --2- 172.21.15.156:0/669938062 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9a40966b0 0x7fe9a41159e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:32.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.136+0000 7fe9a3fff700 1 --2- 172.21.15.156:0/669938062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9a4095b80 0x7fe9a41154f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:32.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.136+0000 7fe9a8c9f700 1 --2- 172.21.15.156:0/669938062 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9a4062b00 0x7fe9a41194a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fe998009d80 tx=0x7fe998017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:32.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.137+0000 7fe9a0ff9700 1 -- 172.21.15.156:0/669938062 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99800f7e0 con 0x7fe9a4062b00 2023-09-30T22:16:32.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.137+0000 7fe9a0ff9700 1 -- 172.21.15.156:0/669938062 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99800f940 con 0x7fe9a4062b00 2023-09-30T22:16:32.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.137+0000 7fe9a0ff9700 1 -- 172.21.15.156:0/669938062 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99801b660 con 0x7fe9a4062b00 2023-09-30T22:16:32.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.137+0000 7fe9aaf03700 1 -- 172.21.15.156:0/669938062 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9980092a0 con 0x7fe9a4062b00 2023-09-30T22:16:32.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.137+0000 7fe9aaf03700 1 -- 172.21.15.156:0/669938062 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a4118a00 con 0x7fe9a4062b00 2023-09-30T22:16:32.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.137+0000 7fe9a0ff9700 1 -- 172.21.15.156:0/669938062 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fe99801b9d0 con 0x7fe9a4062b00 2023-09-30T22:16:32.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.137+0000 7fe9a0ff9700 1 -- 172.21.15.156:0/669938062 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fe99803c890 con 0x7fe9a4062b00 2023-09-30T22:16:32.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.138+0000 7fe9aaf03700 1 -- 172.21.15.156:0/669938062 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a4118fd0 con 0x7fe9a4062b00 2023-09-30T22:16:32.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.142+0000 7fe9a0ff9700 1 -- 172.21.15.156:0/669938062 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fe998029080 con 0x7fe9a4062b00 2023-09-30T22:16:32.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.338+0000 7fe9aaf03700 1 -- 172.21.15.156:0/669938062 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9a4096da0 con 0x7fe9a4062b00 2023-09-30T22:16:32.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.338+0000 7fe9a0ff9700 1 -- 172.21.15.156:0/669938062 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2158 (secure 0 0 0) 0x7fe99801f020 con 0x7fe9a4062b00 2023-09-30T22:16:32.339 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:32.340 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:16:29.792703+0000","modified":"2023-09-30T22:16:31.992241+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4206},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4206":{"gid":4206,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6817/3817969673","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6817","nonce":3817969673}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:16:32.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.340+0000 7fe9aaf03700 1 -- 172.21.15.156:0/669938062 >> v1:172.21.15.156:6816/118236 conn(0x7fe98802bb60 legacy=0x7fe98802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:32.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.340+0000 7fe9aaf03700 1 -- 172.21.15.156:0/669938062 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9a4062b00 msgr2=0x7fe9a41194a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:32.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.340+0000 7fe9aaf03700 1 --2- 172.21.15.156:0/669938062 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9a4062b00 0x7fe9a41194a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fe998009d80 tx=0x7fe998017000).stop 2023-09-30T22:16:32.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.340+0000 7fe9aaf03700 1 -- 172.21.15.156:0/669938062 shutdown_connections 2023-09-30T22:16:32.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.340+0000 7fe9aaf03700 1 --2- 172.21.15.156:0/669938062 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9a40966b0 0x7fe9a41159e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:32.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.340+0000 7fe9aaf03700 1 --2- 172.21.15.156:0/669938062 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9a4062b00 0x7fe9a41194a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:32.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.340+0000 7fe9aaf03700 1 --2- 172.21.15.156:0/669938062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9a4095b80 0x7fe9a41154f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:32.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.340+0000 7fe9aaf03700 1 -- 172.21.15.156:0/669938062 >> 172.21.15.156:0/669938062 conn(0x7fe9a409aa50 msgr2=0x7fe9a412fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:32.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.341+0000 7fe9aaf03700 1 -- 172.21.15.156:0/669938062 shutdown_connections 2023-09-30T22:16:32.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.341+0000 7fe9aaf03700 1 -- 172.21.15.156:0/669938062 wait complete. 2023-09-30T22:16:32.343 INFO:teuthology.orchestra.run.smithi156.stderr:dumped fsmap epoch 5 2023-09-30T22:16:32.353 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:16:32.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.469+0000 7f33ea05f700 1 Processor -- start 2023-09-30T22:16:32.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.469+0000 7f33ea05f700 1 -- start start 2023-09-30T22:16:32.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.469+0000 7f33ea05f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f33e40985e0 0x7f33e40989c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:32.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.469+0000 7f33ea05f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33e4098eb0 0x7f33e412f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:32.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.469+0000 7f33ea05f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33e412f980 0x7f33e4131d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:32.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.469+0000 7f33ea05f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e409a3f0 con 0x7f33e40985e0 2023-09-30T22:16:32.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.469+0000 7f33ea05f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e40964f0 con 0x7f33e4098eb0 2023-09-30T22:16:32.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.469+0000 7f33ea05f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33e4095100 con 0x7f33e412f980 2023-09-30T22:16:32.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.469+0000 7f33e37fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f33e40985e0 0x7f33e40989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:32.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.469+0000 7f33e2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33e4098eb0 0x7f33e412f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:32.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.469+0000 7f33e3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33e412f980 0x7f33e4131d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:32.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.469+0000 7f33e37fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f33e40985e0 0x7f33e40989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36720/0 (socket says 172.21.15.156:36720) 2023-09-30T22:16:32.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.469+0000 7f33e2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33e4098eb0 0x7f33e412f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:47954/0 (socket says 172.21.15.156:47954) 2023-09-30T22:16:32.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.469+0000 7f33e37fe700 1 -- 172.21.15.156:0/486450375 learned_addr learned my addr 172.21.15.156:0/486450375 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:32.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.470+0000 7f33e2ffd700 1 -- 172.21.15.156:0/486450375 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33e412f980 msgr2=0x7f33e4131d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:32.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.470+0000 7f33e2ffd700 1 --2- 172.21.15.156:0/486450375 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33e412f980 0x7f33e4131d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:32.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.470+0000 7f33e2ffd700 1 -- 172.21.15.156:0/486450375 >> v2:172.21.15.156:3300/0 conn(0x7f33e40985e0 msgr2=0x7f33e40989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:32.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.470+0000 7f33e2ffd700 1 --2- 172.21.15.156:0/486450375 >> v2:172.21.15.156:3300/0 conn(0x7f33e40985e0 0x7f33e40989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:32.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.470+0000 7f33e2ffd700 1 -- 172.21.15.156:0/486450375 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e4099e70 con 0x7f33e4098eb0 2023-09-30T22:16:32.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.470+0000 7f33e3fff700 1 --2- 172.21.15.156:0/486450375 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33e412f980 0x7f33e4131d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:32.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.470+0000 7f33e37fe700 1 --2- 172.21.15.156:0/486450375 >> v2:172.21.15.156:3300/0 conn(0x7f33e40985e0 0x7f33e40989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:32.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.470+0000 7f33e2ffd700 1 --2- 172.21.15.156:0/486450375 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33e4098eb0 0x7f33e412f490 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f33d8009760 tx=0x7f33d8009060).ready entity=mon.1 client_cookie=45db2f7b5aa8f8ce server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:32.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.470+0000 7f33e27fc700 1 -- 172.21.15.156:0/486450375 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d80090d0 con 0x7f33e4098eb0 2023-09-30T22:16:32.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.470+0000 7f33e27fc700 1 -- 172.21.15.156:0/486450375 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d800d4a0 con 0x7f33e4098eb0 2023-09-30T22:16:32.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.470+0000 7f33e27fc700 1 -- 172.21.15.156:0/486450375 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d800d820 con 0x7f33e4098eb0 2023-09-30T22:16:32.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.471+0000 7f33ea05f700 1 -- 172.21.15.156:0/486450375 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33e4098eb0 msgr2=0x7f33e412f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:32.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.471+0000 7f33ea05f700 1 --2- 172.21.15.156:0/486450375 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33e4098eb0 0x7f33e412f490 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f33d8009760 tx=0x7f33d8009060).stop 2023-09-30T22:16:32.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.471+0000 7f33ea05f700 1 -- 172.21.15.156:0/486450375 shutdown_connections 2023-09-30T22:16:32.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.471+0000 7f33ea05f700 1 --2- 172.21.15.156:0/486450375 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33e412f980 0x7f33e4131d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:32.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.471+0000 7f33ea05f700 1 --2- 172.21.15.156:0/486450375 >> v2:172.21.15.156:3300/0 conn(0x7f33e40985e0 0x7f33e40989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:32.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.471+0000 7f33ea05f700 1 --2- 172.21.15.156:0/486450375 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33e4098eb0 0x7f33e412f490 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:32.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.471+0000 7f33ea05f700 1 -- 172.21.15.156:0/486450375 >> 172.21.15.156:0/486450375 conn(0x7f33e409dc40 msgr2=0x7f33e409e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:32.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.471+0000 7f33ea05f700 1 -- 172.21.15.156:0/486450375 shutdown_connections 2023-09-30T22:16:32.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.471+0000 7f33ea05f700 1 -- 172.21.15.156:0/486450375 wait complete. 2023-09-30T22:16:32.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.472+0000 7f33ea05f700 1 Processor -- start 2023-09-30T22:16:32.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.472+0000 7f33ea05f700 1 -- start start 2023-09-30T22:16:32.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.472+0000 7f33ea05f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33e40985e0 0x7f33e411e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:32.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.472+0000 7f33ea05f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33e4098eb0 0x7f33e411a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:32.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.472+0000 7f33ea05f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33e412f980 0x7f33e411aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:32.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.472+0000 7f33ea05f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e411d6f0 con 0x7f33e40985e0 2023-09-30T22:16:32.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.472+0000 7f33ea05f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e409d070 con 0x7f33e4098eb0 2023-09-30T22:16:32.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.472+0000 7f33ea05f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33e409a0f0 con 0x7f33e412f980 2023-09-30T22:16:32.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.472+0000 7f33e37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33e40985e0 0x7f33e411e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:32.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.472+0000 7f33e37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33e40985e0 0x7f33e411e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36728/0 (socket says 172.21.15.156:36728) 2023-09-30T22:16:32.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.472+0000 7f33e3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33e412f980 0x7f33e411aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:32.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.472+0000 7f33e37fe700 1 -- 172.21.15.156:0/1766432210 learned_addr learned my addr 172.21.15.156:0/1766432210 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:32.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.472+0000 7f33e2ffd700 1 --2- 172.21.15.156:0/1766432210 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33e4098eb0 0x7f33e411a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:32.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.472+0000 7f33e37fe700 1 -- 172.21.15.156:0/1766432210 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33e412f980 msgr2=0x7f33e411aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:32.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.472+0000 7f33e37fe700 1 --2- 172.21.15.156:0/1766432210 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33e412f980 0x7f33e411aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:32.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.472+0000 7f33e37fe700 1 -- 172.21.15.156:0/1766432210 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33e4098eb0 msgr2=0x7f33e411a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:32.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.472+0000 7f33e37fe700 1 --2- 172.21.15.156:0/1766432210 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33e4098eb0 0x7f33e411a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:32.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.473+0000 7f33e37fe700 1 -- 172.21.15.156:0/1766432210 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d4009370 con 0x7f33e40985e0 2023-09-30T22:16:32.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.473+0000 7f33e3fff700 1 --2- 172.21.15.156:0/1766432210 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33e412f980 0x7f33e411aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:32.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.473+0000 7f33e37fe700 1 --2- 172.21.15.156:0/1766432210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33e40985e0 0x7f33e411e5a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f33d400ea20 tx=0x7f33d40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:32.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.473+0000 7f33cb7fe700 1 -- 172.21.15.156:0/1766432210 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d400ee60 con 0x7f33e40985e0 2023-09-30T22:16:32.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.473+0000 7f33cb7fe700 1 -- 172.21.15.156:0/1766432210 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d400c850 con 0x7f33e40985e0 2023-09-30T22:16:32.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.473+0000 7f33ea05f700 1 -- 172.21.15.156:0/1766432210 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33dc009a20 con 0x7f33e40985e0 2023-09-30T22:16:32.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.473+0000 7f33cb7fe700 1 -- 172.21.15.156:0/1766432210 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d400cbd0 con 0x7f33e40985e0 2023-09-30T22:16:32.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.473+0000 7f33ea05f700 1 -- 172.21.15.156:0/1766432210 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d80092a0 con 0x7f33e40985e0 2023-09-30T22:16:32.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.474+0000 7f33cb7fe700 1 -- 172.21.15.156:0/1766432210 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f33d401b400 con 0x7f33e40985e0 2023-09-30T22:16:32.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.474+0000 7f33cb7fe700 1 -- 172.21.15.156:0/1766432210 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f33d403b560 con 0x7f33e40985e0 2023-09-30T22:16:32.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.474+0000 7f33ea05f700 1 -- 172.21.15.156:0/1766432210 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e411dd20 con 0x7f33e40985e0 2023-09-30T22:16:32.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.478+0000 7f33cb7fe700 1 -- 172.21.15.156:0/1766432210 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f33e411dd20 con 0x7f33e40985e0 2023-09-30T22:16:32.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.637+0000 7f33ea05f700 1 -- 172.21.15.156:0/1766432210 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33e411dd20 con 0x7f33e40985e0 2023-09-30T22:16:32.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.638+0000 7f33cb7fe700 1 -- 172.21.15.156:0/1766432210 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11373 (secure 0 0 0) 0x7f33e411dd20 con 0x7f33e40985e0 2023-09-30T22:16:32.639 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:32.639 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":16,"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","created":"2023-09-30T22:16:15.239992+0000","modified":"2023-09-30T22:16:30.794031+0000","last_up_change":"2023-09-30T22:16:23.392557+0000","last_in_change":"2023-09-30T22:16:16.474206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:16:23.433906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:16:24.367795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:16:28.204677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:16:28.762804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3ec2e78a-c61f-473a-bfcb-f956cffe4095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6812","nonce":118781}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6813","nonce":118781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6815","nonce":118781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6814","nonce":118781}]},"public_addr":"172.21.15.156:6812/118781","cluster_addr":"172.21.15.156:6813/118781","heartbeat_back_addr":"172.21.15.156:6815/118781","heartbeat_front_addr":"172.21.15.156:6814/118781","state":["exists","up"]},{"osd":1,"uuid":"b682e683-c15a-4bd9-8712-8af96454e9ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6803","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6805","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6807","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6806","nonce":118763}]},"public_addr":"172.21.15.156:6803/118763","cluster_addr":"172.21.15.156:6805/118763","heartbeat_back_addr":"172.21.15.156:6807/118763","heartbeat_front_addr":"172.21.15.156:6806/118763","state":["exists","up"]},{"osd":2,"uuid":"960dbaf0-2e0c-437e-9114-bc22ce522b26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6808","nonce":118788}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6809","nonce":118788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6811","nonce":118788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6810","nonce":118788}]},"public_addr":"172.21.15.156:6808/118788","cluster_addr":"172.21.15.156:6809/118788","heartbeat_back_addr":"172.21.15.156:6811/118788","heartbeat_front_addr":"172.21.15.156:6810/118788","state":["exists","up"]},{"osd":3,"uuid":"c1b19714-78b1-4869-8721-2f6352a64a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6800","nonce":118764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6801","nonce":118764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6804","nonce":118764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6802","nonce":118764}]},"public_addr":"172.21.15.156:6800/118764","cluster_addr":"172.21.15.156:6801/118764","heartbeat_back_addr":"172.21.15.156:6804/118764","heartbeat_front_addr":"172.21.15.156:6802/118764","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.663343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.827397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.806655+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.634746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:16:32.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.640+0000 7f33ea05f700 1 -- 172.21.15.156:0/1766432210 >> v1:172.21.15.156:6816/118236 conn(0x7f33d002bb60 legacy=0x7f33d002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:32.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.640+0000 7f33ea05f700 1 -- 172.21.15.156:0/1766432210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33e40985e0 msgr2=0x7f33e411e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:32.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.640+0000 7f33ea05f700 1 --2- 172.21.15.156:0/1766432210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33e40985e0 0x7f33e411e5a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f33d400ea20 tx=0x7f33d40090f0).stop 2023-09-30T22:16:32.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.640+0000 7f33ea05f700 1 -- 172.21.15.156:0/1766432210 shutdown_connections 2023-09-30T22:16:32.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.640+0000 7f33ea05f700 1 --2- 172.21.15.156:0/1766432210 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33e412f980 0x7f33e411aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:32.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.640+0000 7f33ea05f700 1 --2- 172.21.15.156:0/1766432210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33e40985e0 0x7f33e411e5a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:32.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.640+0000 7f33ea05f700 1 --2- 172.21.15.156:0/1766432210 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33e4098eb0 0x7f33e411a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:32.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.640+0000 7f33ea05f700 1 -- 172.21.15.156:0/1766432210 >> 172.21.15.156:0/1766432210 conn(0x7f33e409dc40 msgr2=0x7f33e4114300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:32.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.640+0000 7f33ea05f700 1 -- 172.21.15.156:0/1766432210 shutdown_connections 2023-09-30T22:16:32.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.640+0000 7f33ea05f700 1 -- 172.21.15.156:0/1766432210 wait complete. 2023-09-30T22:16:32.652 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-30T22:16:32.653 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:16:32.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.768+0000 7f8bdbd19700 1 Processor -- start 2023-09-30T22:16:32.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.768+0000 7f8bdbd19700 1 -- start start 2023-09-30T22:16:32.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.769+0000 7f8bdbd19700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bd412de90 0x7f8bd4130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:32.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.769+0000 7f8bdbd19700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd4130770 0x7f8bd4132b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:32.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.769+0000 7f8bdbd19700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd4066e30 con 0x7f8bd412afd0 2023-09-30T22:16:32.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.769+0000 7f8bdbd19700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd412ab10 con 0x7f8bd4130770 2023-09-30T22:16:32.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.769+0000 7f8bdbd19700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd4067500 con 0x7f8bd412de90 2023-09-30T22:16:32.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.769+0000 7f8bd92b4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bd412de90 0x7f8bd4130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:32.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.769+0000 7f8bda2b6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd4130770 0x7f8bd4132b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:32.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.769+0000 7f8bd9ab5700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f8bd412afd0 0x7f8bd412b3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37812/0 (socket says 172.21.15.156:37812) 2023-09-30T22:16:32.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.769+0000 7f8bd9ab5700 1 -- 172.21.15.156:0/3695678357 learned_addr learned my addr 172.21.15.156:0/3695678357 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:32.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.769+0000 7f8bd92b4700 1 -- 172.21.15.156:0/3695678357 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd4130770 msgr2=0x7f8bd4132b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:32.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.769+0000 7f8bd92b4700 1 --2- 172.21.15.156:0/3695678357 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd4130770 0x7f8bd4132b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:32.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.769+0000 7f8bd8ab3700 1 -- 172.21.15.156:0/3695678357 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4148520350 0 0) 0x7f8bd4066e30 con 0x7f8bd412afd0 2023-09-30T22:16:32.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.769+0000 7f8bd92b4700 1 -- 172.21.15.156:0/3695678357 >> v1:172.21.15.156:6789/0 conn(0x7f8bd412afd0 legacy=0x7f8bd412b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:32.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.769+0000 7f8bd92b4700 1 -- 172.21.15.156:0/3695678357 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd412adb0 con 0x7f8bd412de90 2023-09-30T22:16:32.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.769+0000 7f8bda2b6700 1 --2- 172.21.15.156:0/3695678357 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd4130770 0x7f8bd4132b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:32.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.769+0000 7f8bd92b4700 1 --2- 172.21.15.156:0/3695678357 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bd412de90 0x7f8bd4130280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f8bd0009790 tx=0x7f8bd0009060).ready entity=mon.2 client_cookie=e21c556f5bec3927 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:32.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.770+0000 7f8bd8ab3700 1 -- 172.21.15.156:0/3695678357 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd000f510 con 0x7f8bd412de90 2023-09-30T22:16:32.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.770+0000 7f8bd8ab3700 1 -- 172.21.15.156:0/3695678357 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd000f670 con 0x7f8bd412de90 2023-09-30T22:16:32.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.770+0000 7f8bd8ab3700 1 -- 172.21.15.156:0/3695678357 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd000f9f0 con 0x7f8bd412de90 2023-09-30T22:16:32.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.770+0000 7f8bdbd19700 1 -- 172.21.15.156:0/3695678357 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bd412de90 msgr2=0x7f8bd4130280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:32.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.770+0000 7f8bdbd19700 1 --2- 172.21.15.156:0/3695678357 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bd412de90 0x7f8bd4130280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f8bd0009790 tx=0x7f8bd0009060).stop 2023-09-30T22:16:32.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.770+0000 7f8bdbd19700 1 -- 172.21.15.156:0/3695678357 shutdown_connections 2023-09-30T22:16:32.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.770+0000 7f8bdbd19700 1 --2- 172.21.15.156:0/3695678357 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd4130770 0x7f8bd4132b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:32.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.770+0000 7f8bdbd19700 1 --2- 172.21.15.156:0/3695678357 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bd412de90 0x7f8bd4130280 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:32.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.770+0000 7f8bdbd19700 1 -- 172.21.15.156:0/3695678357 >> 172.21.15.156:0/3695678357 conn(0x7f8bd409a230 msgr2=0x7f8bd409a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:32.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.770+0000 7f8bdbd19700 1 -- 172.21.15.156:0/3695678357 shutdown_connections 2023-09-30T22:16:32.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.770+0000 7f8bdbd19700 1 -- 172.21.15.156:0/3695678357 wait complete. 2023-09-30T22:16:32.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.771+0000 7f8bdbd19700 1 Processor -- start 2023-09-30T22:16:32.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.771+0000 7f8bdbd19700 1 -- start start 2023-09-30T22:16:32.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.771+0000 7f8bdbd19700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bd412afd0 0x7f8bd4114820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:32.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.771+0000 7f8bdbd19700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bd412de90 0x7f8bd4114d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:32.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.771+0000 7f8bdbd19700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd4130770 0x7f8bd4115200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:32.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.771+0000 7f8bdbd19700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd41156f0 con 0x7f8bd412afd0 2023-09-30T22:16:32.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.771+0000 7f8bdbd19700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd4130460 con 0x7f8bd4130770 2023-09-30T22:16:32.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.771+0000 7f8bdbd19700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd4067040 con 0x7f8bd412de90 2023-09-30T22:16:32.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.772+0000 7f8bd9ab5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bd412afd0 0x7f8bd4114820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:32.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.772+0000 7f8bda2b6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd4130770 0x7f8bd4115200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:32.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.772+0000 7f8bd92b4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bd412de90 0x7f8bd4114d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:32.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.772+0000 7f8bd9ab5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bd412afd0 0x7f8bd4114820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36732/0 (socket says 172.21.15.156:36732) 2023-09-30T22:16:32.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.772+0000 7f8bda2b6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd4130770 0x7f8bd4115200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:47990/0 (socket says 172.21.15.156:47990) 2023-09-30T22:16:32.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.772+0000 7f8bd9ab5700 1 -- 172.21.15.156:0/3490419965 learned_addr learned my addr 172.21.15.156:0/3490419965 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:32.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.772+0000 7f8bda2b6700 1 -- 172.21.15.156:0/3490419965 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bd412de90 msgr2=0x7f8bd4114d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:32.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.772+0000 7f8bda2b6700 1 --2- 172.21.15.156:0/3490419965 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bd412de90 0x7f8bd4114d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:32.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.772+0000 7f8bda2b6700 1 -- 172.21.15.156:0/3490419965 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bd412afd0 msgr2=0x7f8bd4114820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:32.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.772+0000 7f8bda2b6700 1 --2- 172.21.15.156:0/3490419965 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bd412afd0 0x7f8bd4114820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:32.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.772+0000 7f8bda2b6700 1 -- 172.21.15.156:0/3490419965 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bcc009a20 con 0x7f8bd4130770 2023-09-30T22:16:32.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.772+0000 7f8bd9ab5700 1 --2- 172.21.15.156:0/3490419965 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bd412afd0 0x7f8bd4114820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:32.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.772+0000 7f8bda2b6700 1 --2- 172.21.15.156:0/3490419965 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd4130770 0x7f8bd4115200 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f8bcc009f10 tx=0x7f8bcc00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:32.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.772+0000 7f8bc9ffb700 1 -- 172.21.15.156:0/3490419965 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc009c70 con 0x7f8bd4130770 2023-09-30T22:16:32.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.772+0000 7f8bc9ffb700 1 -- 172.21.15.156:0/3490419965 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bcc00f040 con 0x7f8bd4130770 2023-09-30T22:16:32.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.772+0000 7f8bdbd19700 1 -- 172.21.15.156:0/3490419965 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd00092a0 con 0x7f8bd4130770 2023-09-30T22:16:32.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.772+0000 7f8bc9ffb700 1 -- 172.21.15.156:0/3490419965 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc00cd80 con 0x7f8bd4130770 2023-09-30T22:16:32.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.772+0000 7f8bdbd19700 1 -- 172.21.15.156:0/3490419965 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd4117d20 con 0x7f8bd4130770 2023-09-30T22:16:32.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.773+0000 7f8bc9ffb700 1 -- 172.21.15.156:0/3490419965 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f8bcc013610 con 0x7f8bd4130770 2023-09-30T22:16:32.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.773+0000 7f8bc9ffb700 1 -- 172.21.15.156:0/3490419965 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f8bcc03b790 con 0x7f8bd4130770 2023-09-30T22:16:32.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.773+0000 7f8bdbd19700 1 -- 172.21.15.156:0/3490419965 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd405a260 con 0x7f8bd4130770 2023-09-30T22:16:32.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.778+0000 7f8bc9ffb700 1 -- 172.21.15.156:0/3490419965 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f8bcc01c410 con 0x7f8bd4130770 2023-09-30T22:16:32.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.931+0000 7f8bdbd19700 1 -- 172.21.15.156:0/3490419965 --> v1:172.21.15.156:6816/118236 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8bd4117f40 con 0x7f8bb802bb90 2023-09-30T22:16:32.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.937+0000 7f8bc9ffb700 1 -- 172.21.15.156:0/3490419965 <== mgr.4122 v1:172.21.15.156:6816/118236 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243146 (unknown 2965378022 0 2943379563) 0x7f8bc4001790 con 0x7f8bb802bb90 2023-09-30T22:16:32.945 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:32.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.940+0000 7f8bdbd19700 1 -- 172.21.15.156:0/3490419965 >> v1:172.21.15.156:6816/118236 conn(0x7f8bb802bb90 legacy=0x7f8bb802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:32.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.940+0000 7f8bdbd19700 1 -- 172.21.15.156:0/3490419965 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd4130770 msgr2=0x7f8bd4115200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:32.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.940+0000 7f8bdbd19700 1 --2- 172.21.15.156:0/3490419965 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd4130770 0x7f8bd4115200 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f8bcc009f10 tx=0x7f8bcc00b040).stop 2023-09-30T22:16:32.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.940+0000 7f8bdbd19700 1 -- 172.21.15.156:0/3490419965 shutdown_connections 2023-09-30T22:16:32.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.940+0000 7f8bdbd19700 1 --2- 172.21.15.156:0/3490419965 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd4130770 0x7f8bd4115200 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:32.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.940+0000 7f8bdbd19700 1 --2- 172.21.15.156:0/3490419965 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bd412afd0 0x7f8bd4114820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:32.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.940+0000 7f8bdbd19700 1 --2- 172.21.15.156:0/3490419965 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bd412de90 0x7f8bd4114d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:32.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.940+0000 7f8bdbd19700 1 -- 172.21.15.156:0/3490419965 >> 172.21.15.156:0/3490419965 conn(0x7f8bd409a230 msgr2=0x7f8bd4091980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:32.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.940+0000 7f8bdbd19700 1 -- 172.21.15.156:0/3490419965 shutdown_connections 2023-09-30T22:16:32.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:32.940+0000 7f8bdbd19700 1 -- 172.21.15.156:0/3490419965 wait complete. 2023-09-30T22:16:32.952 INFO:teuthology.orchestra.run.smithi156.stderr:dumped all 2023-09-30T22:16:32.954 INFO:teuthology.orchestra.run.smithi156.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2023-09-30T22:16:32.354278+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188812,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298548,"statfs":{"total":386547056640,"available":385329713152,"internally_reserved":0,"allocated":438272,"data_stored":116486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.426193+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424905+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.425365+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424970+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424620+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424470+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424356+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424094+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424841+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.423784+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424451+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-09-30T22:16:25.781501+0000","last_change":"2023-09-30T22:16:25.780366+0000","last_active":"2023-09-30T22:16:25.781501+0000","last_peered":"2023-09-30T22:16:25.781501+0000","last_clean":"2023-09-30T22:16:25.781501+0000","last_became_active":"2023-09-30T22:16:25.780059+0000","last_became_peered":"2023-09-30T22:16:25.780059+0000","last_unstale":"2023-09-30T22:16:25.781501+0000","last_undegraded":"2023-09-30T22:16:25.781501+0000","last_fullsized":"2023-09-30T22:16:25.781501+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424486+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:16:26.411395+0000","last_change":"2023-09-30T22:16:25.414057+0000","last_active":"2023-09-30T22:16:26.411395+0000","last_peered":"2023-09-30T22:16:26.411395+0000","last_clean":"2023-09-30T22:16:26.411395+0000","last_became_active":"2023-09-30T22:16:25.413712+0000","last_became_peered":"2023-09-30T22:16:25.413712+0000","last_unstale":"2023-09-30T22:16:26.411395+0000","last_undegraded":"2023-09-30T22:16:26.411395+0000","last_fullsized":"2023-09-30T22:16:26.411395+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:16:26.411007+0000","last_change":"2023-09-30T22:16:25.416240+0000","last_active":"2023-09-30T22:16:26.411007+0000","last_peered":"2023-09-30T22:16:26.411007+0000","last_clean":"2023-09-30T22:16:26.411007+0000","last_became_active":"2023-09-30T22:16:25.415852+0000","last_became_peered":"2023-09-30T22:16:25.415852+0000","last_unstale":"2023-09-30T22:16:26.411007+0000","last_undegraded":"2023-09-30T22:16:26.411007+0000","last_fullsized":"2023-09-30T22:16:26.411007+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:16:26.411061+0000","last_change":"2023-09-30T22:16:25.414050+0000","last_active":"2023-09-30T22:16:26.411061+0000","last_peered":"2023-09-30T22:16:26.411061+0000","last_clean":"2023-09-30T22:16:26.411061+0000","last_became_active":"2023-09-30T22:16:25.413709+0000","last_became_peered":"2023-09-30T22:16:25.413709+0000","last_unstale":"2023-09-30T22:16:26.411061+0000","last_undegraded":"2023-09-30T22:16:26.411061+0000","last_fullsized":"2023-09-30T22:16:26.411061+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-09-30T22:16:25.781893+0000","last_change":"2023-09-30T22:16:25.781137+0000","last_active":"2023-09-30T22:16:25.781893+0000","last_peered":"2023-09-30T22:16:25.781893+0000","last_clean":"2023-09-30T22:16:25.781893+0000","last_became_active":"2023-09-30T22:16:25.780923+0000","last_became_peered":"2023-09-30T22:16:25.780923+0000","last_unstale":"2023-09-30T22:16:25.781893+0000","last_undegraded":"2023-09-30T22:16:25.781893+0000","last_fullsized":"2023-09-30T22:16:25.781893+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424012+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:16:26.410930+0000","last_change":"2023-09-30T22:16:25.416399+0000","last_active":"2023-09-30T22:16:26.410930+0000","last_peered":"2023-09-30T22:16:26.410930+0000","last_clean":"2023-09-30T22:16:26.410930+0000","last_became_active":"2023-09-30T22:16:25.416054+0000","last_became_peered":"2023-09-30T22:16:25.416054+0000","last_unstale":"2023-09-30T22:16:26.410930+0000","last_undegraded":"2023-09-30T22:16:26.410930+0000","last_fullsized":"2023-09-30T22:16:26.410930+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:16:26.411037+0000","last_change":"2023-09-30T22:16:25.780298+0000","last_active":"2023-09-30T22:16:26.411037+0000","last_peered":"2023-09-30T22:16:26.411037+0000","last_clean":"2023-09-30T22:16:26.411037+0000","last_became_active":"2023-09-30T22:16:25.780022+0000","last_became_peered":"2023-09-30T22:16:25.780022+0000","last_unstale":"2023-09-30T22:16:26.411037+0000","last_undegraded":"2023-09-30T22:16:26.411037+0000","last_fullsized":"2023-09-30T22:16:26.411037+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.423794+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-09-30T22:16:25.781887+0000","last_change":"2023-09-30T22:16:25.781178+0000","last_active":"2023-09-30T22:16:25.781887+0000","last_peered":"2023-09-30T22:16:25.781887+0000","last_clean":"2023-09-30T22:16:25.781887+0000","last_became_active":"2023-09-30T22:16:25.780121+0000","last_became_peered":"2023-09-30T22:16:25.780121+0000","last_unstale":"2023-09-30T22:16:25.781887+0000","last_undegraded":"2023-09-30T22:16:25.781887+0000","last_fullsized":"2023-09-30T22:16:25.781887+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:16:26.411160+0000","last_change":"2023-09-30T22:16:25.780328+0000","last_active":"2023-09-30T22:16:26.411160+0000","last_peered":"2023-09-30T22:16:26.411160+0000","last_clean":"2023-09-30T22:16:26.411160+0000","last_became_active":"2023-09-30T22:16:25.780026+0000","last_became_peered":"2023-09-30T22:16:25.780026+0000","last_unstale":"2023-09-30T22:16:26.411160+0000","last_undegraded":"2023-09-30T22:16:26.411160+0000","last_fullsized":"2023-09-30T22:16:26.411160+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.426381+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.426321+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705666,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297196,"kb_used_data":100,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074644,"statfs":{"total":96636764160,"available":96332435456,"internally_reserved":0,"allocated":102400,"data_stored":26349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297200,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074640,"statfs":{"total":96636764160,"available":96332431360,"internally_reserved":0,"allocated":106496,"data_stored":27519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:16:32.962 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:16:33.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.110+0000 7f957ed2c700 1 Processor -- start 2023-09-30T22:16:33.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.110+0000 7f957ed2c700 1 -- start start 2023-09-30T22:16:33.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.111+0000 7f957ed2c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9578092390 0x7f9578097aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:33.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.111+0000 7f957ed2c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9578123f10 0x7f95781276f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:33.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.111+0000 7f957ed2c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9578068c10 con 0x7f9578123a90 2023-09-30T22:16:33.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.111+0000 7f957ed2c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9578092770 con 0x7f9578123f10 2023-09-30T22:16:33.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.111+0000 7f957ed2c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9578069550 con 0x7f9578092390 2023-09-30T22:16:33.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.111+0000 7f957cac8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9578092390 0x7f9578097aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:33.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.111+0000 7f9577fff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f9578123a90 0x7f9578126fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37818/0 (socket says 172.21.15.156:37818) 2023-09-30T22:16:33.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.111+0000 7f9577fff700 1 -- 172.21.15.156:0/802253219 learned_addr learned my addr 172.21.15.156:0/802253219 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:33.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.111+0000 7f957d2c9700 1 --2- 172.21.15.156:0/802253219 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9578123f10 0x7f95781276f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:33.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.111+0000 7f957d2c9700 1 -- 172.21.15.156:0/802253219 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9578092390 msgr2=0x7f9578097aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:33.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.111+0000 7f95777fe700 1 -- 172.21.15.156:0/802253219 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2587549730 0 0) 0x7f9578068c10 con 0x7f9578123a90 2023-09-30T22:16:33.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.111+0000 7f957d2c9700 1 --2- 172.21.15.156:0/802253219 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9578092390 0x7f9578097aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:33.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.111+0000 7f957d2c9700 1 -- 172.21.15.156:0/802253219 >> v1:172.21.15.156:6789/0 conn(0x7f9578123a90 legacy=0x7f9578126fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:33.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.111+0000 7f957d2c9700 1 -- 172.21.15.156:0/802253219 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9578124550 con 0x7f9578123f10 2023-09-30T22:16:33.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.111+0000 7f957cac8700 1 --2- 172.21.15.156:0/802253219 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9578092390 0x7f9578097aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:33.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.111+0000 7f957d2c9700 1 --2- 172.21.15.156:0/802253219 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9578123f10 0x7f95781276f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f957000afa0 tx=0x7f957000a890).ready entity=mon.1 client_cookie=a340e9e26874f5f9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:33.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.111+0000 7f95777fe700 1 -- 172.21.15.156:0/802253219 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957000f070 con 0x7f9578123f10 2023-09-30T22:16:33.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.111+0000 7f95777fe700 1 -- 172.21.15.156:0/802253219 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957000a2e0 con 0x7f9578123f10 2023-09-30T22:16:33.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.111+0000 7f95777fe700 1 -- 172.21.15.156:0/802253219 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957000cc60 con 0x7f9578123f10 2023-09-30T22:16:33.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.112+0000 7f957ed2c700 1 -- 172.21.15.156:0/802253219 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9578123f10 msgr2=0x7f95781276f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:33.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.112+0000 7f957ed2c700 1 --2- 172.21.15.156:0/802253219 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9578123f10 0x7f95781276f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f957000afa0 tx=0x7f957000a890).stop 2023-09-30T22:16:33.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.112+0000 7f957ed2c700 1 -- 172.21.15.156:0/802253219 shutdown_connections 2023-09-30T22:16:33.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.112+0000 7f957ed2c700 1 --2- 172.21.15.156:0/802253219 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9578123f10 0x7f95781276f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:33.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.112+0000 7f957ed2c700 1 --2- 172.21.15.156:0/802253219 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9578092390 0x7f9578097aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:33.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.112+0000 7f957ed2c700 1 -- 172.21.15.156:0/802253219 >> 172.21.15.156:0/802253219 conn(0x7f957809a230 msgr2=0x7f957809a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:33.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.112+0000 7f957ed2c700 1 -- 172.21.15.156:0/802253219 shutdown_connections 2023-09-30T22:16:33.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.112+0000 7f957ed2c700 1 -- 172.21.15.156:0/802253219 wait complete. 2023-09-30T22:16:33.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.113+0000 7f957ed2c700 1 Processor -- start 2023-09-30T22:16:33.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.113+0000 7f957ed2c700 1 -- start start 2023-09-30T22:16:33.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.113+0000 7f957ed2c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9578092390 0x7f9578110890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:33.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.113+0000 7f957ed2c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9578123a90 0x7f9578110d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:33.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.113+0000 7f957ed2c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9578123f10 0x7f9578111270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:33.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.113+0000 7f957ed2c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9578111760 con 0x7f9578123a90 2023-09-30T22:16:33.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.113+0000 7f957ed2c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9578112b40 con 0x7f9578123f10 2023-09-30T22:16:33.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.113+0000 7f957ed2c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95780999c0 con 0x7f9578092390 2023-09-30T22:16:33.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.113+0000 7f957cac8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9578092390 0x7f9578110890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:33.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.113+0000 7f9577fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9578123a90 0x7f9578110d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:33.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.113+0000 7f957d2c9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9578123f10 0x7f9578111270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:33.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.113+0000 7f957cac8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9578092390 0x7f9578110890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52922/0 (socket says 172.21.15.156:52922) 2023-09-30T22:16:33.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.113+0000 7f957cac8700 1 -- 172.21.15.156:0/992737301 learned_addr learned my addr 172.21.15.156:0/992737301 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:33.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.114+0000 7f9577fff700 1 -- 172.21.15.156:0/992737301 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9578092390 msgr2=0x7f9578110890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:33.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.114+0000 7f9577fff700 1 --2- 172.21.15.156:0/992737301 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9578092390 0x7f9578110890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:33.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.114+0000 7f9577fff700 1 -- 172.21.15.156:0/992737301 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9578123f10 msgr2=0x7f9578111270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:33.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.114+0000 7f9577fff700 1 --2- 172.21.15.156:0/992737301 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9578123f10 0x7f9578111270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:33.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.114+0000 7f9577fff700 1 -- 172.21.15.156:0/992737301 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f956c0092a0 con 0x7f9578123a90 2023-09-30T22:16:33.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.114+0000 7f957cac8700 1 --2- 172.21.15.156:0/992737301 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9578092390 0x7f9578110890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:33.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.114+0000 7f957d2c9700 1 --2- 172.21.15.156:0/992737301 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9578123f10 0x7f9578111270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:33.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.114+0000 7f9577fff700 1 --2- 172.21.15.156:0/992737301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9578123a90 0x7f9578110d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f9564000c00 tx=0x7f9564007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:33.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.114+0000 7f9574ff9700 1 -- 172.21.15.156:0/992737301 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95640070d0 con 0x7f9578123a90 2023-09-30T22:16:33.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.114+0000 7f9574ff9700 1 -- 172.21.15.156:0/992737301 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9564007270 con 0x7f9578123a90 2023-09-30T22:16:33.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.114+0000 7f957ed2c700 1 -- 172.21.15.156:0/992737301 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f957000ab30 con 0x7f9578123a90 2023-09-30T22:16:33.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.114+0000 7f9574ff9700 1 -- 172.21.15.156:0/992737301 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9564007630 con 0x7f9578123a90 2023-09-30T22:16:33.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.114+0000 7f957ed2c700 1 -- 172.21.15.156:0/992737301 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95780974a0 con 0x7f9578123a90 2023-09-30T22:16:33.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.115+0000 7f9574ff9700 1 -- 172.21.15.156:0/992737301 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f95640059b0 con 0x7f9578123a90 2023-09-30T22:16:33.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.115+0000 7f9574ff9700 1 -- 172.21.15.156:0/992737301 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f956403a4a0 con 0x7f9578123a90 2023-09-30T22:16:33.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.115+0000 7f957ed2c700 1 -- 172.21.15.156:0/992737301 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9578112ee0 con 0x7f9578123a90 2023-09-30T22:16:33.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.119+0000 7f9574ff9700 1 -- 172.21.15.156:0/992737301 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f9564013970 con 0x7f9578123a90 2023-09-30T22:16:33.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.273+0000 7f957ed2c700 1 -- 172.21.15.156:0/992737301 --> v1:172.21.15.156:6816/118236 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f957805a260 con 0x7f955c02bb60 2023-09-30T22:16:33.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.279+0000 7f9574ff9700 1 -- 172.21.15.156:0/992737301 <== mgr.4122 v1:172.21.15.156:6816/118236 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243146 (unknown 2965378022 0 2943379563) 0x7f957805a260 con 0x7f955c02bb60 2023-09-30T22:16:33.284 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:33.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.282+0000 7f957ed2c700 1 -- 172.21.15.156:0/992737301 >> v1:172.21.15.156:6816/118236 conn(0x7f955c02bb60 legacy=0x7f955c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:33.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.282+0000 7f957ed2c700 1 -- 172.21.15.156:0/992737301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9578123a90 msgr2=0x7f9578110d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:33.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.282+0000 7f957ed2c700 1 --2- 172.21.15.156:0/992737301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9578123a90 0x7f9578110d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f9564000c00 tx=0x7f9564007b90).stop 2023-09-30T22:16:33.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.282+0000 7f957ed2c700 1 -- 172.21.15.156:0/992737301 shutdown_connections 2023-09-30T22:16:33.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.282+0000 7f957ed2c700 1 --2- 172.21.15.156:0/992737301 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9578123f10 0x7f9578111270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:33.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.282+0000 7f957ed2c700 1 --2- 172.21.15.156:0/992737301 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9578092390 0x7f9578110890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:33.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.282+0000 7f957ed2c700 1 --2- 172.21.15.156:0/992737301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9578123a90 0x7f9578110d80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:33.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.282+0000 7f957ed2c700 1 -- 172.21.15.156:0/992737301 >> 172.21.15.156:0/992737301 conn(0x7f957809a230 msgr2=0x7f9578122b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:33.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.282+0000 7f957ed2c700 1 -- 172.21.15.156:0/992737301 shutdown_connections 2023-09-30T22:16:33.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.282+0000 7f957ed2c700 1 -- 172.21.15.156:0/992737301 wait complete. 2023-09-30T22:16:33.287 INFO:teuthology.orchestra.run.smithi156.stderr:dumped all 2023-09-30T22:16:33.294 INFO:teuthology.orchestra.run.smithi156.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2023-09-30T22:16:32.354278+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188812,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298548,"statfs":{"total":386547056640,"available":385329713152,"internally_reserved":0,"allocated":438272,"data_stored":116486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.426193+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424905+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.425365+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424970+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424620+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424470+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424356+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424094+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424841+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.423784+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424451+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-09-30T22:16:25.781501+0000","last_change":"2023-09-30T22:16:25.780366+0000","last_active":"2023-09-30T22:16:25.781501+0000","last_peered":"2023-09-30T22:16:25.781501+0000","last_clean":"2023-09-30T22:16:25.781501+0000","last_became_active":"2023-09-30T22:16:25.780059+0000","last_became_peered":"2023-09-30T22:16:25.780059+0000","last_unstale":"2023-09-30T22:16:25.781501+0000","last_undegraded":"2023-09-30T22:16:25.781501+0000","last_fullsized":"2023-09-30T22:16:25.781501+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424486+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:16:26.411395+0000","last_change":"2023-09-30T22:16:25.414057+0000","last_active":"2023-09-30T22:16:26.411395+0000","last_peered":"2023-09-30T22:16:26.411395+0000","last_clean":"2023-09-30T22:16:26.411395+0000","last_became_active":"2023-09-30T22:16:25.413712+0000","last_became_peered":"2023-09-30T22:16:25.413712+0000","last_unstale":"2023-09-30T22:16:26.411395+0000","last_undegraded":"2023-09-30T22:16:26.411395+0000","last_fullsized":"2023-09-30T22:16:26.411395+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:16:26.411007+0000","last_change":"2023-09-30T22:16:25.416240+0000","last_active":"2023-09-30T22:16:26.411007+0000","last_peered":"2023-09-30T22:16:26.411007+0000","last_clean":"2023-09-30T22:16:26.411007+0000","last_became_active":"2023-09-30T22:16:25.415852+0000","last_became_peered":"2023-09-30T22:16:25.415852+0000","last_unstale":"2023-09-30T22:16:26.411007+0000","last_undegraded":"2023-09-30T22:16:26.411007+0000","last_fullsized":"2023-09-30T22:16:26.411007+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:16:26.411061+0000","last_change":"2023-09-30T22:16:25.414050+0000","last_active":"2023-09-30T22:16:26.411061+0000","last_peered":"2023-09-30T22:16:26.411061+0000","last_clean":"2023-09-30T22:16:26.411061+0000","last_became_active":"2023-09-30T22:16:25.413709+0000","last_became_peered":"2023-09-30T22:16:25.413709+0000","last_unstale":"2023-09-30T22:16:26.411061+0000","last_undegraded":"2023-09-30T22:16:26.411061+0000","last_fullsized":"2023-09-30T22:16:26.411061+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-09-30T22:16:25.781893+0000","last_change":"2023-09-30T22:16:25.781137+0000","last_active":"2023-09-30T22:16:25.781893+0000","last_peered":"2023-09-30T22:16:25.781893+0000","last_clean":"2023-09-30T22:16:25.781893+0000","last_became_active":"2023-09-30T22:16:25.780923+0000","last_became_peered":"2023-09-30T22:16:25.780923+0000","last_unstale":"2023-09-30T22:16:25.781893+0000","last_undegraded":"2023-09-30T22:16:25.781893+0000","last_fullsized":"2023-09-30T22:16:25.781893+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424012+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:16:26.410930+0000","last_change":"2023-09-30T22:16:25.416399+0000","last_active":"2023-09-30T22:16:26.410930+0000","last_peered":"2023-09-30T22:16:26.410930+0000","last_clean":"2023-09-30T22:16:26.410930+0000","last_became_active":"2023-09-30T22:16:25.416054+0000","last_became_peered":"2023-09-30T22:16:25.416054+0000","last_unstale":"2023-09-30T22:16:26.410930+0000","last_undegraded":"2023-09-30T22:16:26.410930+0000","last_fullsized":"2023-09-30T22:16:26.410930+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:16:26.411037+0000","last_change":"2023-09-30T22:16:25.780298+0000","last_active":"2023-09-30T22:16:26.411037+0000","last_peered":"2023-09-30T22:16:26.411037+0000","last_clean":"2023-09-30T22:16:26.411037+0000","last_became_active":"2023-09-30T22:16:25.780022+0000","last_became_peered":"2023-09-30T22:16:25.780022+0000","last_unstale":"2023-09-30T22:16:26.411037+0000","last_undegraded":"2023-09-30T22:16:26.411037+0000","last_fullsized":"2023-09-30T22:16:26.411037+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.423794+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-09-30T22:16:25.781887+0000","last_change":"2023-09-30T22:16:25.781178+0000","last_active":"2023-09-30T22:16:25.781887+0000","last_peered":"2023-09-30T22:16:25.781887+0000","last_clean":"2023-09-30T22:16:25.781887+0000","last_became_active":"2023-09-30T22:16:25.780121+0000","last_became_peered":"2023-09-30T22:16:25.780121+0000","last_unstale":"2023-09-30T22:16:25.781887+0000","last_undegraded":"2023-09-30T22:16:25.781887+0000","last_fullsized":"2023-09-30T22:16:25.781887+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:16:26.411160+0000","last_change":"2023-09-30T22:16:25.780328+0000","last_active":"2023-09-30T22:16:26.411160+0000","last_peered":"2023-09-30T22:16:26.411160+0000","last_clean":"2023-09-30T22:16:26.411160+0000","last_became_active":"2023-09-30T22:16:25.780026+0000","last_became_peered":"2023-09-30T22:16:25.780026+0000","last_unstale":"2023-09-30T22:16:26.411160+0000","last_undegraded":"2023-09-30T22:16:26.411160+0000","last_fullsized":"2023-09-30T22:16:26.411160+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.426381+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.426321+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705666,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297196,"kb_used_data":100,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074644,"statfs":{"total":96636764160,"available":96332435456,"internally_reserved":0,"allocated":102400,"data_stored":26349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297200,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074640,"statfs":{"total":96636764160,"available":96332431360,"internally_reserved":0,"allocated":106496,"data_stored":27519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:16:33.300 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:16:33.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.451+0000 7fc6628c1700 1 Processor -- start 2023-09-30T22:16:33.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.452+0000 7fc6628c1700 1 -- start start 2023-09-30T22:16:33.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.452+0000 7fc6628c1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc65c05f560 0x7fc65c128cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:33.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.452+0000 7fc6628c1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc65c092190 0x7fc65c1291a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:33.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.452+0000 7fc6628c1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc65c129690 0x7fc65c066d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:33.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.452+0000 7fc6628c1700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc65c05f940 con 0x7fc65c129690 2023-09-30T22:16:33.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.452+0000 7fc6628c1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c097c30 con 0x7fc65c092190 2023-09-30T22:16:33.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.452+0000 7fc6628c1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c093340 con 0x7fc65c05f560 2023-09-30T22:16:33.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.452+0000 7fc660e5e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc65c129690 0x7fc65c066d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:33.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.452+0000 7fc65bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc65c05f560 0x7fc65c128cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:33.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.452+0000 7fc65b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc65c092190 0x7fc65c1291a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:33.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.452+0000 7fc660e5e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc65c129690 0x7fc65c066d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36754/0 (socket says 172.21.15.156:36754) 2023-09-30T22:16:33.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.452+0000 7fc65bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc65c05f560 0x7fc65c128cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52924/0 (socket says 172.21.15.156:52924) 2023-09-30T22:16:33.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.452+0000 7fc660e5e700 1 -- 172.21.15.156:0/2169028658 learned_addr learned my addr 172.21.15.156:0/2169028658 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:33.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.452+0000 7fc65b7fe700 1 --2- 172.21.15.156:0/2169028658 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc65c092190 0x7fc65c1291a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48024/0 (socket says 172.21.15.156:48024) 2023-09-30T22:16:33.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.453+0000 7fc65b7fe700 1 -- 172.21.15.156:0/2169028658 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc65c05f560 msgr2=0x7fc65c128cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:33.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.453+0000 7fc65b7fe700 1 --2- 172.21.15.156:0/2169028658 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc65c05f560 0x7fc65c128cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:33.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.453+0000 7fc65b7fe700 1 -- 172.21.15.156:0/2169028658 >> v2:172.21.15.156:3300/0 conn(0x7fc65c129690 msgr2=0x7fc65c066d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:33.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.453+0000 7fc65b7fe700 1 --2- 172.21.15.156:0/2169028658 >> v2:172.21.15.156:3300/0 conn(0x7fc65c129690 0x7fc65c066d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:33.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.453+0000 7fc65b7fe700 1 -- 172.21.15.156:0/2169028658 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc65c0941f0 con 0x7fc65c092190 2023-09-30T22:16:33.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.453+0000 7fc65bfff700 1 --2- 172.21.15.156:0/2169028658 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc65c05f560 0x7fc65c128cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:33.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.453+0000 7fc65b7fe700 1 --2- 172.21.15.156:0/2169028658 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc65c092190 0x7fc65c1291a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fc64c009760 tx=0x7fc64c009060).ready entity=mon.1 client_cookie=66c4077d0480d2ca server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:33.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.453+0000 7fc65affd700 1 -- 172.21.15.156:0/2169028658 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c0090d0 con 0x7fc65c092190 2023-09-30T22:16:33.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.453+0000 7fc65affd700 1 -- 172.21.15.156:0/2169028658 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64c00d4a0 con 0x7fc65c092190 2023-09-30T22:16:33.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.453+0000 7fc65affd700 1 -- 172.21.15.156:0/2169028658 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c00d820 con 0x7fc65c092190 2023-09-30T22:16:33.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.453+0000 7fc6628c1700 1 -- 172.21.15.156:0/2169028658 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc65c092190 msgr2=0x7fc65c1291a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:33.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.453+0000 7fc6628c1700 1 --2- 172.21.15.156:0/2169028658 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc65c092190 0x7fc65c1291a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fc64c009760 tx=0x7fc64c009060).stop 2023-09-30T22:16:33.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.453+0000 7fc6628c1700 1 -- 172.21.15.156:0/2169028658 shutdown_connections 2023-09-30T22:16:33.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.453+0000 7fc6628c1700 1 --2- 172.21.15.156:0/2169028658 >> v2:172.21.15.156:3300/0 conn(0x7fc65c129690 0x7fc65c066d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:33.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.453+0000 7fc6628c1700 1 --2- 172.21.15.156:0/2169028658 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc65c05f560 0x7fc65c128cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:33.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.453+0000 7fc6628c1700 1 --2- 172.21.15.156:0/2169028658 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc65c092190 0x7fc65c1291a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:33.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.453+0000 7fc6628c1700 1 -- 172.21.15.156:0/2169028658 >> 172.21.15.156:0/2169028658 conn(0x7fc65c09a1c0 msgr2=0x7fc65c09a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:33.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.453+0000 7fc6628c1700 1 -- 172.21.15.156:0/2169028658 shutdown_connections 2023-09-30T22:16:33.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.453+0000 7fc6628c1700 1 -- 172.21.15.156:0/2169028658 wait complete. 2023-09-30T22:16:33.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.454+0000 7fc6628c1700 1 Processor -- start 2023-09-30T22:16:33.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.454+0000 7fc6628c1700 1 -- start start 2023-09-30T22:16:33.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.455+0000 7fc6628c1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc65c05f560 0x7fc65c1382e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:33.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.455+0000 7fc6628c1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc65c092190 0x7fc65c1387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:33.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.455+0000 7fc6628c1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc65c129690 0x7fc65c113c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:33.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.455+0000 7fc6628c1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c1284f0 con 0x7fc65c129690 2023-09-30T22:16:33.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.455+0000 7fc6628c1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c099c80 con 0x7fc65c092190 2023-09-30T22:16:33.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.455+0000 7fc6628c1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c097d80 con 0x7fc65c05f560 2023-09-30T22:16:33.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.455+0000 7fc65bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc65c05f560 0x7fc65c1382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:33.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.455+0000 7fc65b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc65c092190 0x7fc65c1387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:33.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.455+0000 7fc660e5e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc65c129690 0x7fc65c113c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:33.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.455+0000 7fc65b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc65c092190 0x7fc65c1387d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48028/0 (socket says 172.21.15.156:48028) 2023-09-30T22:16:33.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.455+0000 7fc660e5e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc65c129690 0x7fc65c113c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36766/0 (socket says 172.21.15.156:36766) 2023-09-30T22:16:33.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.455+0000 7fc65b7fe700 1 -- 172.21.15.156:0/1003175282 learned_addr learned my addr 172.21.15.156:0/1003175282 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:33.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.455+0000 7fc65bfff700 1 -- 172.21.15.156:0/1003175282 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc65c092190 msgr2=0x7fc65c1387d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:33.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.455+0000 7fc65bfff700 1 --2- 172.21.15.156:0/1003175282 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc65c092190 0x7fc65c1387d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:33.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.455+0000 7fc65bfff700 1 -- 172.21.15.156:0/1003175282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc65c129690 msgr2=0x7fc65c113c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:33.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.455+0000 7fc65bfff700 1 --2- 172.21.15.156:0/1003175282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc65c129690 0x7fc65c113c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:33.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.455+0000 7fc65bfff700 1 -- 172.21.15.156:0/1003175282 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6440092a0 con 0x7fc65c05f560 2023-09-30T22:16:33.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.455+0000 7fc65bfff700 1 --2- 172.21.15.156:0/1003175282 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc65c05f560 0x7fc65c1382e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fc64400e980 tx=0x7fc644009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:33.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.456+0000 7fc653fff700 1 -- 172.21.15.156:0/1003175282 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc644012600 con 0x7fc65c05f560 2023-09-30T22:16:33.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.456+0000 7fc653fff700 1 -- 172.21.15.156:0/1003175282 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc644012760 con 0x7fc65c05f560 2023-09-30T22:16:33.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.456+0000 7fc6628c1700 1 -- 172.21.15.156:0/1003175282 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64c0092a0 con 0x7fc65c05f560 2023-09-30T22:16:33.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.456+0000 7fc653fff700 1 -- 172.21.15.156:0/1003175282 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc644012ae0 con 0x7fc65c05f560 2023-09-30T22:16:33.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.456+0000 7fc6628c1700 1 -- 172.21.15.156:0/1003175282 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc65c117df0 con 0x7fc65c05f560 2023-09-30T22:16:33.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.456+0000 7fc653fff700 1 -- 172.21.15.156:0/1003175282 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fc64401b400 con 0x7fc65c05f560 2023-09-30T22:16:33.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.457+0000 7fc653fff700 1 -- 172.21.15.156:0/1003175282 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fc64403b400 con 0x7fc65c05f560 2023-09-30T22:16:33.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.457+0000 7fc6628c1700 1 -- 172.21.15.156:0/1003175282 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc65c05a260 con 0x7fc65c05f560 2023-09-30T22:16:33.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.461+0000 7fc653fff700 1 -- 172.21.15.156:0/1003175282 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fc644019310 con 0x7fc65c05f560 2023-09-30T22:16:33.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.614+0000 7fc6628c1700 1 -- 172.21.15.156:0/1003175282 --> v1:172.21.15.156:6816/118236 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc65c046c20 con 0x7fc63c02bb60 2023-09-30T22:16:33.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.620+0000 7fc653fff700 1 -- 172.21.15.156:0/1003175282 <== mgr.4122 v1:172.21.15.156:6816/118236 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243146 (unknown 2965378022 0 2943379563) 0x7fc65c046c20 con 0x7fc63c02bb60 2023-09-30T22:16:33.624 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:33.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.623+0000 7fc6628c1700 1 -- 172.21.15.156:0/1003175282 >> v1:172.21.15.156:6816/118236 conn(0x7fc63c02bb60 legacy=0x7fc63c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:33.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.623+0000 7fc6628c1700 1 -- 172.21.15.156:0/1003175282 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc65c05f560 msgr2=0x7fc65c1382e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:33.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.623+0000 7fc6628c1700 1 --2- 172.21.15.156:0/1003175282 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc65c05f560 0x7fc65c1382e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fc64400e980 tx=0x7fc644009060).stop 2023-09-30T22:16:33.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.623+0000 7fc6628c1700 1 -- 172.21.15.156:0/1003175282 shutdown_connections 2023-09-30T22:16:33.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.623+0000 7fc6628c1700 1 --2- 172.21.15.156:0/1003175282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc65c129690 0x7fc65c113c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:33.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.623+0000 7fc6628c1700 1 --2- 172.21.15.156:0/1003175282 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc65c05f560 0x7fc65c1382e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:33.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.623+0000 7fc6628c1700 1 --2- 172.21.15.156:0/1003175282 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc65c092190 0x7fc65c1387d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:33.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.623+0000 7fc6628c1700 1 -- 172.21.15.156:0/1003175282 >> 172.21.15.156:0/1003175282 conn(0x7fc65c09a1c0 msgr2=0x7fc65c0955b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:33.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.623+0000 7fc6628c1700 1 -- 172.21.15.156:0/1003175282 shutdown_connections 2023-09-30T22:16:33.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.623+0000 7fc6628c1700 1 -- 172.21.15.156:0/1003175282 wait complete. 2023-09-30T22:16:33.628 INFO:teuthology.orchestra.run.smithi156.stderr:dumped all 2023-09-30T22:16:33.635 INFO:teuthology.orchestra.run.smithi156.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2023-09-30T22:16:32.354278+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188812,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298548,"statfs":{"total":386547056640,"available":385329713152,"internally_reserved":0,"allocated":438272,"data_stored":116486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.426193+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424905+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.425365+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424970+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424620+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424470+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424356+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424094+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424841+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.423784+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424451+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-09-30T22:16:25.781501+0000","last_change":"2023-09-30T22:16:25.780366+0000","last_active":"2023-09-30T22:16:25.781501+0000","last_peered":"2023-09-30T22:16:25.781501+0000","last_clean":"2023-09-30T22:16:25.781501+0000","last_became_active":"2023-09-30T22:16:25.780059+0000","last_became_peered":"2023-09-30T22:16:25.780059+0000","last_unstale":"2023-09-30T22:16:25.781501+0000","last_undegraded":"2023-09-30T22:16:25.781501+0000","last_fullsized":"2023-09-30T22:16:25.781501+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424486+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:16:26.411395+0000","last_change":"2023-09-30T22:16:25.414057+0000","last_active":"2023-09-30T22:16:26.411395+0000","last_peered":"2023-09-30T22:16:26.411395+0000","last_clean":"2023-09-30T22:16:26.411395+0000","last_became_active":"2023-09-30T22:16:25.413712+0000","last_became_peered":"2023-09-30T22:16:25.413712+0000","last_unstale":"2023-09-30T22:16:26.411395+0000","last_undegraded":"2023-09-30T22:16:26.411395+0000","last_fullsized":"2023-09-30T22:16:26.411395+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:16:26.411007+0000","last_change":"2023-09-30T22:16:25.416240+0000","last_active":"2023-09-30T22:16:26.411007+0000","last_peered":"2023-09-30T22:16:26.411007+0000","last_clean":"2023-09-30T22:16:26.411007+0000","last_became_active":"2023-09-30T22:16:25.415852+0000","last_became_peered":"2023-09-30T22:16:25.415852+0000","last_unstale":"2023-09-30T22:16:26.411007+0000","last_undegraded":"2023-09-30T22:16:26.411007+0000","last_fullsized":"2023-09-30T22:16:26.411007+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:16:26.411061+0000","last_change":"2023-09-30T22:16:25.414050+0000","last_active":"2023-09-30T22:16:26.411061+0000","last_peered":"2023-09-30T22:16:26.411061+0000","last_clean":"2023-09-30T22:16:26.411061+0000","last_became_active":"2023-09-30T22:16:25.413709+0000","last_became_peered":"2023-09-30T22:16:25.413709+0000","last_unstale":"2023-09-30T22:16:26.411061+0000","last_undegraded":"2023-09-30T22:16:26.411061+0000","last_fullsized":"2023-09-30T22:16:26.411061+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-09-30T22:16:25.781893+0000","last_change":"2023-09-30T22:16:25.781137+0000","last_active":"2023-09-30T22:16:25.781893+0000","last_peered":"2023-09-30T22:16:25.781893+0000","last_clean":"2023-09-30T22:16:25.781893+0000","last_became_active":"2023-09-30T22:16:25.780923+0000","last_became_peered":"2023-09-30T22:16:25.780923+0000","last_unstale":"2023-09-30T22:16:25.781893+0000","last_undegraded":"2023-09-30T22:16:25.781893+0000","last_fullsized":"2023-09-30T22:16:25.781893+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424012+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:16:26.410930+0000","last_change":"2023-09-30T22:16:25.416399+0000","last_active":"2023-09-30T22:16:26.410930+0000","last_peered":"2023-09-30T22:16:26.410930+0000","last_clean":"2023-09-30T22:16:26.410930+0000","last_became_active":"2023-09-30T22:16:25.416054+0000","last_became_peered":"2023-09-30T22:16:25.416054+0000","last_unstale":"2023-09-30T22:16:26.410930+0000","last_undegraded":"2023-09-30T22:16:26.410930+0000","last_fullsized":"2023-09-30T22:16:26.410930+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:16:26.411037+0000","last_change":"2023-09-30T22:16:25.780298+0000","last_active":"2023-09-30T22:16:26.411037+0000","last_peered":"2023-09-30T22:16:26.411037+0000","last_clean":"2023-09-30T22:16:26.411037+0000","last_became_active":"2023-09-30T22:16:25.780022+0000","last_became_peered":"2023-09-30T22:16:25.780022+0000","last_unstale":"2023-09-30T22:16:26.411037+0000","last_undegraded":"2023-09-30T22:16:26.411037+0000","last_fullsized":"2023-09-30T22:16:26.411037+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.423794+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-09-30T22:16:25.781887+0000","last_change":"2023-09-30T22:16:25.781178+0000","last_active":"2023-09-30T22:16:25.781887+0000","last_peered":"2023-09-30T22:16:25.781887+0000","last_clean":"2023-09-30T22:16:25.781887+0000","last_became_active":"2023-09-30T22:16:25.780121+0000","last_became_peered":"2023-09-30T22:16:25.780121+0000","last_unstale":"2023-09-30T22:16:25.781887+0000","last_undegraded":"2023-09-30T22:16:25.781887+0000","last_fullsized":"2023-09-30T22:16:25.781887+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:16:26.411160+0000","last_change":"2023-09-30T22:16:25.780328+0000","last_active":"2023-09-30T22:16:26.411160+0000","last_peered":"2023-09-30T22:16:26.411160+0000","last_clean":"2023-09-30T22:16:26.411160+0000","last_became_active":"2023-09-30T22:16:25.780026+0000","last_became_peered":"2023-09-30T22:16:25.780026+0000","last_unstale":"2023-09-30T22:16:26.411160+0000","last_undegraded":"2023-09-30T22:16:26.411160+0000","last_fullsized":"2023-09-30T22:16:26.411160+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.426381+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.426321+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705666,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297196,"kb_used_data":100,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074644,"statfs":{"total":96636764160,"available":96332435456,"internally_reserved":0,"allocated":102400,"data_stored":26349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297200,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074640,"statfs":{"total":96636764160,"available":96332431360,"internally_reserved":0,"allocated":106496,"data_stored":27519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:16:33.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2023-09-30T22:16:33.641 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2023-09-30T22:16:33.641 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2023-09-30T22:16:33.641 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2023-09-30T22:16:33.641 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.642 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2023-09-30T22:16:33.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.642 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2023-09-30T22:16:33.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.642 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2023-09-30T22:16:33.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.642 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2023-09-30T22:16:33.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2023-09-30T22:16:33.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2023-09-30T22:16:33.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2023-09-30T22:16:33.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2023-09-30T22:16:33.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2023-09-30T22:16:33.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2023-09-30T22:16:33.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2023-09-30T22:16:33.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2023-09-30T22:16:33.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2023-09-30T22:16:33.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2023-09-30T22:16:33.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2023-09-30T22:16:33.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2023-09-30T22:16:33.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2023-09-30T22:16:33.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2023-09-30T22:16:33.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2023-09-30T22:16:33.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.647 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2023-09-30T22:16:33.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.647 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2023-09-30T22:16:33.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.647 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2023-09-30T22:16:33.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.647 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2023-09-30T22:16:33.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.647 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2023-09-30T22:16:33.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.416755+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.648 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-09-30T22:16:33.648 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.648 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2023-09-30T22:16:33.648 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.416755+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.648 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-09-30T22:16:33.648 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.648 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-09-30T22:16:33.648 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.426193+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:16:33.648 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-09-30T22:16:33.649 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.649 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2023-09-30T22:16:33.649 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.416755+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.649 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-09-30T22:16:33.649 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.649 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2023-09-30T22:16:33.649 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.424905+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-30T22:16:33.649 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-09-30T22:16:33.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2023-09-30T22:16:33.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.416755+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-09-30T22:16:33.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2023-09-30T22:16:33.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.425365+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:16:33.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-09-30T22:16:33.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-09-30T22:16:33.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.424970+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:16:33.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-09-30T22:16:33.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2023-09-30T22:16:33.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.416755+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-09-30T22:16:33.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-09-30T22:16:33.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.424620+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:16:33.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-09-30T22:16:33.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2023-09-30T22:16:33.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.416755+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-09-30T22:16:33.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2023-09-30T22:16:33.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.416755+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-09-30T22:16:33.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-09-30T22:16:33.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.424470+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-30T22:16:33.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-09-30T22:16:33.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-09-30T22:16:33.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.424356+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:16:33.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-09-30T22:16:33.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-09-30T22:16:33.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.416755+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-09-30T22:16:33.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2023-09-30T22:16:33.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.424094+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:16:33.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-09-30T22:16:33.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-09-30T22:16:33.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.424841+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:16:33.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-09-30T22:16:33.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2023-09-30T22:16:33.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.423784+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:16:33.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-09-30T22:16:33.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2023-09-30T22:16:33.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.424451+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:16:33.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-09-30T22:16:33.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-09-30T22:16:33.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.424486+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-30T22:16:33.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-09-30T22:16:33.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2023-09-30T22:16:33.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.416755+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-09-30T22:16:33.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2023-09-30T22:16:33.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.416755+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-09-30T22:16:33.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-09-30T22:16:33.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.424012+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:16:33.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-09-30T22:16:33.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2023-09-30T22:16:33.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.416755+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-09-30T22:16:33.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2023-09-30T22:16:33.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.416755+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-09-30T22:16:33.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2023-09-30T22:16:33.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.423794+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:16:33.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-09-30T22:16:33.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2023-09-30T22:16:33.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.416755+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-09-30T22:16:33.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2023-09-30T22:16:33.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.416755+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-09-30T22:16:33.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2023-09-30T22:16:33.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.416755+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-09-30T22:16:33.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-09-30T22:16:33.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.426381+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:16:33.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-09-30T22:16:33.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2023-09-30T22:16:33.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.426321+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:16:33.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-09-30T22:16:33.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2023-09-30T22:16:33.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:28.416755+0000', 'last_change': '2023-09-30T22:16:28.416755+0000', 'last_active': '2023-09-30T22:16:28.416755+0000', 'last_peered': '2023-09-30T22:16:28.416755+0000', 'last_clean': '2023-09-30T22:16:28.416755+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:28.416755+0000', 'last_undegraded': '2023-09-30T22:16:28.416755+0000', 'last_fullsized': '2023-09-30T22:16:28.416755+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:28.416755+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-09-30T22:16:33.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2023-09-30T22:16:33.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2023-09-30T22:16:33.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2023-09-30T22:16:33.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2023-09-30T22:16:33.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.663 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2023-09-30T22:16:33.663 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:16:29.419764+0000', 'last_change': '2023-09-30T22:16:29.419764+0000', 'last_active': '2023-09-30T22:16:29.419764+0000', 'last_peered': '2023-09-30T22:16:29.419764+0000', 'last_clean': '2023-09-30T22:16:29.419764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:16:29.419764+0000', 'last_undegraded': '2023-09-30T22:16:29.419764+0000', 'last_fullsized': '2023-09-30T22:16:29.419764+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'last_clean_scrub_stamp': '2023-09-30T22:16:29.419764+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:16:33.663 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-09-30T22:16:33.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.790+0000 7f0c09585700 1 Processor -- start 2023-09-30T22:16:33.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.790+0000 7f0c09585700 1 -- start start 2023-09-30T22:16:33.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.790+0000 7f0c09585700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c040990d0 0x7f0c041304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:33.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.790+0000 7f0c09585700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0c04130990 0x7f0c04132d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:33.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.790+0000 7f0c09585700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c040964f0 con 0x7f0c040985e0 2023-09-30T22:16:33.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.790+0000 7f0c09585700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c040994b0 con 0x7f0c04130990 2023-09-30T22:16:33.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.790+0000 7f0c09585700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0409a3f0 con 0x7f0c040990d0 2023-09-30T22:16:33.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.791+0000 7f0c02ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f0c040985e0 0x7f0c040989c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37824/0 (socket says 172.21.15.156:37824) 2023-09-30T22:16:33.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.791+0000 7f0c02ffd700 1 -- 172.21.15.156:0/2696305091 learned_addr learned my addr 172.21.15.156:0/2696305091 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:33.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.791+0000 7f0c027fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c040990d0 0x7f0c041304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:33.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.791+0000 7f0c037fe700 1 --2- 172.21.15.156:0/2696305091 >> v2:172.21.15.156:3300/0 conn(0x7f0c04130990 0x7f0c04132d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:33.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.791+0000 7f0c01ffb700 1 -- 172.21.15.156:0/2696305091 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566025465 0 0) 0x7f0c040964f0 con 0x7f0c040985e0 2023-09-30T22:16:33.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.791+0000 7f0c01ffb700 1 -- 172.21.15.156:0/2696305091 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bec0033f0 con 0x7f0c040985e0 2023-09-30T22:16:33.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.791+0000 7f0c037fe700 1 -- 172.21.15.156:0/2696305091 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c040990d0 msgr2=0x7f0c041304a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:33.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.791+0000 7f0c037fe700 1 --2- 172.21.15.156:0/2696305091 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c040990d0 0x7f0c041304a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:33.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.791+0000 7f0c037fe700 1 -- 172.21.15.156:0/2696305091 >> v1:172.21.15.156:6789/0 conn(0x7f0c040985e0 legacy=0x7f0c040989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:33.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.791+0000 7f0c037fe700 1 -- 172.21.15.156:0/2696305091 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c04095100 con 0x7f0c04130990 2023-09-30T22:16:33.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.791+0000 7f0c027fc700 1 --2- 172.21.15.156:0/2696305091 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c040990d0 0x7f0c041304a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:33.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.791+0000 7f0c037fe700 1 --2- 172.21.15.156:0/2696305091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c04130990 0x7f0c04132d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f0bfc009e60 tx=0x7f0bfc009780).ready entity=mon.0 client_cookie=b22d918ed2ab044b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:33.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.791+0000 7f0c01ffb700 1 -- 172.21.15.156:0/2696305091 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc00e070 con 0x7f0c04130990 2023-09-30T22:16:33.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.791+0000 7f0c01ffb700 1 -- 172.21.15.156:0/2696305091 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bfc00bab0 con 0x7f0c04130990 2023-09-30T22:16:33.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.791+0000 7f0c01ffb700 1 -- 172.21.15.156:0/2696305091 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc00be30 con 0x7f0c04130990 2023-09-30T22:16:33.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.792+0000 7f0c09585700 1 -- 172.21.15.156:0/2696305091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c04130990 msgr2=0x7f0c04132d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:33.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.792+0000 7f0c09585700 1 --2- 172.21.15.156:0/2696305091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c04130990 0x7f0c04132d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f0bfc009e60 tx=0x7f0bfc009780).stop 2023-09-30T22:16:33.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.792+0000 7f0c09585700 1 -- 172.21.15.156:0/2696305091 shutdown_connections 2023-09-30T22:16:33.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.792+0000 7f0c09585700 1 --2- 172.21.15.156:0/2696305091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c04130990 0x7f0c04132d80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:33.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.792+0000 7f0c09585700 1 --2- 172.21.15.156:0/2696305091 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c040990d0 0x7f0c041304a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:33.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.792+0000 7f0c09585700 1 -- 172.21.15.156:0/2696305091 >> 172.21.15.156:0/2696305091 conn(0x7f0c0409dc40 msgr2=0x7f0c0409e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:33.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.792+0000 7f0c09585700 1 -- 172.21.15.156:0/2696305091 shutdown_connections 2023-09-30T22:16:33.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.792+0000 7f0c09585700 1 -- 172.21.15.156:0/2696305091 wait complete. 2023-09-30T22:16:33.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.793+0000 7f0c09585700 1 Processor -- start 2023-09-30T22:16:33.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.793+0000 7f0c09585700 1 -- start start 2023-09-30T22:16:33.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.793+0000 7f0c09585700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c040985e0 0x7f0c0411a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:33.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.793+0000 7f0c09585700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c040990d0 0x7f0c0411a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:33.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.793+0000 7f0c09585700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c04130990 0x7f0c0411ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:33.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.793+0000 7f0c09585700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0411c8c0 con 0x7f0c040990d0 2023-09-30T22:16:33.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.793+0000 7f0c09585700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0409a0f0 con 0x7f0c04130990 2023-09-30T22:16:33.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.793+0000 7f0c09585700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0411d790 con 0x7f0c040985e0 2023-09-30T22:16:33.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.793+0000 7f0c02ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c040985e0 0x7f0c0411a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:33.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.793+0000 7f0c027fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c040990d0 0x7f0c0411a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:33.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.793+0000 7f0c02ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c040985e0 0x7f0c0411a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52962/0 (socket says 172.21.15.156:52962) 2023-09-30T22:16:33.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.793+0000 7f0c02ffd700 1 -- 172.21.15.156:0/3671133702 learned_addr learned my addr 172.21.15.156:0/3671133702 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:33.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.793+0000 7f0c037fe700 1 --2- 172.21.15.156:0/3671133702 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c04130990 0x7f0c0411ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:33.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.794+0000 7f0c027fc700 1 -- 172.21.15.156:0/3671133702 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c040985e0 msgr2=0x7f0c0411a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:33.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.794+0000 7f0c027fc700 1 --2- 172.21.15.156:0/3671133702 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c040985e0 0x7f0c0411a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:33.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.794+0000 7f0c027fc700 1 -- 172.21.15.156:0/3671133702 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c04130990 msgr2=0x7f0c0411ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:33.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.794+0000 7f0c027fc700 1 --2- 172.21.15.156:0/3671133702 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c04130990 0x7f0c0411ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:33.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.794+0000 7f0c027fc700 1 -- 172.21.15.156:0/3671133702 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf40092a0 con 0x7f0c040990d0 2023-09-30T22:16:33.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.794+0000 7f0c027fc700 1 --2- 172.21.15.156:0/3671133702 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c040990d0 0x7f0c0411a740 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f0bf400e950 tx=0x7f0bf4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:33.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.794+0000 7f0beaffd700 1 -- 172.21.15.156:0/3671133702 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4009580 con 0x7f0c040990d0 2023-09-30T22:16:33.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.794+0000 7f0beaffd700 1 -- 172.21.15.156:0/3671133702 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf4012600 con 0x7f0c040990d0 2023-09-30T22:16:33.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.794+0000 7f0beaffd700 1 -- 172.21.15.156:0/3671133702 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf40129a0 con 0x7f0c040990d0 2023-09-30T22:16:33.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.794+0000 7f0c09585700 1 -- 172.21.15.156:0/3671133702 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bfc009a20 con 0x7f0c040990d0 2023-09-30T22:16:33.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.794+0000 7f0c09585700 1 -- 172.21.15.156:0/3671133702 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0411e410 con 0x7f0c040990d0 2023-09-30T22:16:33.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.794+0000 7f0beaffd700 1 -- 172.21.15.156:0/3671133702 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f0bf4012d10 con 0x7f0c040990d0 2023-09-30T22:16:33.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.795+0000 7f0beaffd700 1 -- 172.21.15.156:0/3671133702 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f0bf403b490 con 0x7f0c040990d0 2023-09-30T22:16:33.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.795+0000 7f0c09585700 1 -- 172.21.15.156:0/3671133702 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c0405a260 con 0x7f0c040990d0 2023-09-30T22:16:33.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:33.799+0000 7f0beaffd700 1 -- 172.21.15.156:0/3671133702 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f0bf4011b40 con 0x7f0c040990d0 2023-09-30T22:16:34.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.018+0000 7f0c09585700 1 -- 172.21.15.156:0/3671133702 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f0c04099e70 con 0x7f0c040990d0 2023-09-30T22:16:34.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.019+0000 7f0beaffd700 1 -- 172.21.15.156:0/3671133702 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1106 (secure 0 0 0) 0x7f0bf4011b40 con 0x7f0c040990d0 2023-09-30T22:16:34.020 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:34.020 INFO:teuthology.orchestra.run.smithi156.stdout:{"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":18,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":16,"num_osds":4,"num_up_osds":4,"osd_up_since":1696112183,"num_in_osds":4,"osd_in_since":1696112176,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":80},{"state_name":"creating+peering","count":16},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":1217343488,"bytes_avail":385329713152,"bytes_total":386547056640,"unknown_pgs_ratio":0.76190477609634399,"inactive_pgs_ratio":0.15238095819950104},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4206}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-09-30T22:16:15.241048+0000","services":{}},"progress_events":{}} 2023-09-30T22:16:34.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.020+0000 7f0c09585700 1 -- 172.21.15.156:0/3671133702 >> v1:172.21.15.156:6816/118236 conn(0x7f0bf002bb60 legacy=0x7f0bf002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:34.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.020+0000 7f0c09585700 1 -- 172.21.15.156:0/3671133702 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c040990d0 msgr2=0x7f0c0411a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:34.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.020+0000 7f0c09585700 1 --2- 172.21.15.156:0/3671133702 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c040990d0 0x7f0c0411a740 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f0bf400e950 tx=0x7f0bf4009060).stop 2023-09-30T22:16:34.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.020+0000 7f0c09585700 1 -- 172.21.15.156:0/3671133702 shutdown_connections 2023-09-30T22:16:34.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.020+0000 7f0c09585700 1 --2- 172.21.15.156:0/3671133702 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c04130990 0x7f0c0411ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:34.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.020+0000 7f0c09585700 1 --2- 172.21.15.156:0/3671133702 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c040985e0 0x7f0c0411a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:34.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.020+0000 7f0c09585700 1 --2- 172.21.15.156:0/3671133702 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c040990d0 0x7f0c0411a740 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:34.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.020+0000 7f0c09585700 1 -- 172.21.15.156:0/3671133702 >> 172.21.15.156:0/3671133702 conn(0x7f0c0409dc40 msgr2=0x7f0c0409ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:34.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.021+0000 7f0c09585700 1 -- 172.21.15.156:0/3671133702 shutdown_connections 2023-09-30T22:16:34.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.021+0000 7f0c09585700 1 -- 172.21.15.156:0/3671133702 wait complete. 2023-09-30T22:16:34.033 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-09-30T22:16:34.033 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:16:34.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.148+0000 7fe2c204a700 1 Processor -- start 2023-09-30T22:16:34.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.148+0000 7fe2c204a700 1 -- start start 2023-09-30T22:16:34.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.148+0000 7fe2c204a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe2bc0977b0 0x7fe2bc127c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:34.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.148+0000 7fe2c204a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe2bc1280f0 0x7fe2bc12aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:34.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.148+0000 7fe2c204a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2bc12af40 0x7fe2bc12b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:34.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.148+0000 7fe2c204a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2bc097b90 con 0x7fe2bc1280f0 2023-09-30T22:16:34.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.148+0000 7fe2c204a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc065d80 con 0x7fe2bc12af40 2023-09-30T22:16:34.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.148+0000 7fe2c204a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc12b8e0 con 0x7fe2bc0977b0 2023-09-30T22:16:34.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.149+0000 7fe2bbfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2bc12af40 0x7fe2bc12b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:34.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.149+0000 7fe2baffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe2bc1280f0 0x7fe2bc12aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:34.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.149+0000 7fe2bbfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2bc12af40 0x7fe2bc12b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48036/0 (socket says 172.21.15.156:48036) 2023-09-30T22:16:34.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.149+0000 7fe2bbfff700 1 -- 172.21.15.156:0/3381699420 learned_addr learned my addr 172.21.15.156:0/3381699420 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:34.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.149+0000 7fe2bb7fe700 1 --2- 172.21.15.156:0/3381699420 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe2bc0977b0 0x7fe2bc127c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:34.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.149+0000 7fe2bbfff700 1 -- 172.21.15.156:0/3381699420 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe2bc0977b0 msgr2=0x7fe2bc127c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:34.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.149+0000 7fe2bbfff700 1 --2- 172.21.15.156:0/3381699420 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe2bc0977b0 0x7fe2bc127c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:34.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.149+0000 7fe2bbfff700 1 -- 172.21.15.156:0/3381699420 >> v2:172.21.15.156:3300/0 conn(0x7fe2bc1280f0 msgr2=0x7fe2bc12aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:34.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.149+0000 7fe2bbfff700 1 --2- 172.21.15.156:0/3381699420 >> v2:172.21.15.156:3300/0 conn(0x7fe2bc1280f0 0x7fe2bc12aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:34.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.149+0000 7fe2bbfff700 1 -- 172.21.15.156:0/3381699420 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2bc1279b0 con 0x7fe2bc12af40 2023-09-30T22:16:34.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.149+0000 7fe2baffd700 1 --2- 172.21.15.156:0/3381699420 >> v2:172.21.15.156:3300/0 conn(0x7fe2bc1280f0 0x7fe2bc12aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:34.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.149+0000 7fe2bbfff700 1 --2- 172.21.15.156:0/3381699420 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2bc12af40 0x7fe2bc12b3f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fe2b4009f50 tx=0x7fe2b4009840).ready entity=mon.1 client_cookie=9aa93ce1cf15a984 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:34.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.149+0000 7fe2ba7fc700 1 -- 172.21.15.156:0/3381699420 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b400e070 con 0x7fe2bc12af40 2023-09-30T22:16:34.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.149+0000 7fe2ba7fc700 1 -- 172.21.15.156:0/3381699420 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b400b910 con 0x7fe2bc12af40 2023-09-30T22:16:34.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.149+0000 7fe2ba7fc700 1 -- 172.21.15.156:0/3381699420 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b400bc90 con 0x7fe2bc12af40 2023-09-30T22:16:34.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.150+0000 7fe2c204a700 1 -- 172.21.15.156:0/3381699420 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2bc12af40 msgr2=0x7fe2bc12b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:34.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.150+0000 7fe2c204a700 1 --2- 172.21.15.156:0/3381699420 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2bc12af40 0x7fe2bc12b3f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fe2b4009f50 tx=0x7fe2b4009840).stop 2023-09-30T22:16:34.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.150+0000 7fe2c204a700 1 -- 172.21.15.156:0/3381699420 shutdown_connections 2023-09-30T22:16:34.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.150+0000 7fe2c204a700 1 --2- 172.21.15.156:0/3381699420 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2bc12af40 0x7fe2bc12b3f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:34.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.150+0000 7fe2c204a700 1 --2- 172.21.15.156:0/3381699420 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe2bc0977b0 0x7fe2bc127c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:34.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.150+0000 7fe2c204a700 1 --2- 172.21.15.156:0/3381699420 >> v2:172.21.15.156:3300/0 conn(0x7fe2bc1280f0 0x7fe2bc12aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:34.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.150+0000 7fe2c204a700 1 -- 172.21.15.156:0/3381699420 >> 172.21.15.156:0/3381699420 conn(0x7fe2bc09bad0 msgr2=0x7fe2bc09bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:34.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.150+0000 7fe2c204a700 1 -- 172.21.15.156:0/3381699420 shutdown_connections 2023-09-30T22:16:34.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.150+0000 7fe2c204a700 1 -- 172.21.15.156:0/3381699420 wait complete. 2023-09-30T22:16:34.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.151+0000 7fe2c204a700 1 Processor -- start 2023-09-30T22:16:34.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.151+0000 7fe2c204a700 1 -- start start 2023-09-30T22:16:34.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.151+0000 7fe2c204a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2bc0977b0 0x7fe2bc13a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:34.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.151+0000 7fe2c204a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe2bc1280f0 0x7fe2bc13a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:34.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.151+0000 7fe2c204a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2bc12af40 0x7fe2bc1125b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:34.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.151+0000 7fe2c204a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc126d00 con 0x7fe2bc12af40 2023-09-30T22:16:34.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.151+0000 7fe2c204a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc12f0e0 con 0x7fe2bc0977b0 2023-09-30T22:16:34.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.151+0000 7fe2c204a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc12a970 con 0x7fe2bc1280f0 2023-09-30T22:16:34.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.151+0000 7fe2bb7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2bc0977b0 0x7fe2bc13a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:34.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.151+0000 7fe2baffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe2bc1280f0 0x7fe2bc13a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:34.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.151+0000 7fe2bb7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2bc0977b0 0x7fe2bc13a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48044/0 (socket says 172.21.15.156:48044) 2023-09-30T22:16:34.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.151+0000 7fe2bb7fe700 1 -- 172.21.15.156:0/3803224499 learned_addr learned my addr 172.21.15.156:0/3803224499 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:34.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.151+0000 7fe2bbfff700 1 --2- 172.21.15.156:0/3803224499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2bc12af40 0x7fe2bc1125b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:34.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.152+0000 7fe2baffd700 1 -- 172.21.15.156:0/3803224499 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2bc0977b0 msgr2=0x7fe2bc13a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:34.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.152+0000 7fe2baffd700 1 --2- 172.21.15.156:0/3803224499 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2bc0977b0 0x7fe2bc13a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:34.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.152+0000 7fe2baffd700 1 -- 172.21.15.156:0/3803224499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2bc12af40 msgr2=0x7fe2bc1125b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:34.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.152+0000 7fe2baffd700 1 --2- 172.21.15.156:0/3803224499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2bc12af40 0x7fe2bc1125b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:34.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.152+0000 7fe2baffd700 1 -- 172.21.15.156:0/3803224499 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ac0092a0 con 0x7fe2bc1280f0 2023-09-30T22:16:34.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.152+0000 7fe2bb7fe700 1 --2- 172.21.15.156:0/3803224499 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2bc0977b0 0x7fe2bc13a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:34.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.152+0000 7fe2bbfff700 1 --2- 172.21.15.156:0/3803224499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2bc12af40 0x7fe2bc1125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:34.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.152+0000 7fe2baffd700 1 --2- 172.21.15.156:0/3803224499 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe2bc1280f0 0x7fe2bc13a810 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fe2ac00e950 tx=0x7fe2ac009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:34.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.152+0000 7fe2a37fe700 1 -- 172.21.15.156:0/3803224499 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac009580 con 0x7fe2bc1280f0 2023-09-30T22:16:34.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.152+0000 7fe2a37fe700 1 -- 172.21.15.156:0/3803224499 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ac012600 con 0x7fe2bc1280f0 2023-09-30T22:16:34.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.152+0000 7fe2c204a700 1 -- 172.21.15.156:0/3803224499 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b4009ae0 con 0x7fe2bc1280f0 2023-09-30T22:16:34.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.152+0000 7fe2a37fe700 1 -- 172.21.15.156:0/3803224499 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac0129c0 con 0x7fe2bc1280f0 2023-09-30T22:16:34.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.152+0000 7fe2c204a700 1 -- 172.21.15.156:0/3803224499 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2bc116600 con 0x7fe2bc1280f0 2023-09-30T22:16:34.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.153+0000 7fe2a37fe700 1 -- 172.21.15.156:0/3803224499 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fe2ac012d30 con 0x7fe2bc1280f0 2023-09-30T22:16:34.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.153+0000 7fe2a37fe700 1 -- 172.21.15.156:0/3803224499 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fe2ac03b360 con 0x7fe2bc1280f0 2023-09-30T22:16:34.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.153+0000 7fe2c204a700 1 -- 172.21.15.156:0/3803224499 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2bc065990 con 0x7fe2bc1280f0 2023-09-30T22:16:34.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.157+0000 7fe2a37fe700 1 -- 172.21.15.156:0/3803224499 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fe2ac016070 con 0x7fe2bc1280f0 2023-09-30T22:16:34.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.311+0000 7fe2c204a700 1 -- 172.21.15.156:0/3803224499 --> v1:172.21.15.156:6816/118236 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe2bc115ba0 con 0x7fe2a802bb60 2023-09-30T22:16:34.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.317+0000 7fe2a37fe700 1 -- 172.21.15.156:0/3803224499 <== mgr.4122 v1:172.21.15.156:6816/118236 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243146 (unknown 2965378022 0 2943379563) 0x7fe2b0009b80 con 0x7fe2a802bb60 2023-09-30T22:16:34.320 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:34.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.320+0000 7fe2c204a700 1 -- 172.21.15.156:0/3803224499 >> v1:172.21.15.156:6816/118236 conn(0x7fe2a802bb60 legacy=0x7fe2a802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:34.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.320+0000 7fe2c204a700 1 -- 172.21.15.156:0/3803224499 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe2bc1280f0 msgr2=0x7fe2bc13a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:34.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.320+0000 7fe2c204a700 1 --2- 172.21.15.156:0/3803224499 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe2bc1280f0 0x7fe2bc13a810 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fe2ac00e950 tx=0x7fe2ac009060).stop 2023-09-30T22:16:34.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.320+0000 7fe2c204a700 1 -- 172.21.15.156:0/3803224499 shutdown_connections 2023-09-30T22:16:34.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.320+0000 7fe2c204a700 1 --2- 172.21.15.156:0/3803224499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2bc12af40 0x7fe2bc1125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:34.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.320+0000 7fe2c204a700 1 --2- 172.21.15.156:0/3803224499 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2bc0977b0 0x7fe2bc13a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:34.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.320+0000 7fe2c204a700 1 --2- 172.21.15.156:0/3803224499 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe2bc1280f0 0x7fe2bc13a810 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:34.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.320+0000 7fe2c204a700 1 -- 172.21.15.156:0/3803224499 >> 172.21.15.156:0/3803224499 conn(0x7fe2bc09bad0 msgr2=0x7fe2bc069790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:34.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.320+0000 7fe2c204a700 1 -- 172.21.15.156:0/3803224499 shutdown_connections 2023-09-30T22:16:34.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:34.320+0000 7fe2c204a700 1 -- 172.21.15.156:0/3803224499 wait complete. 2023-09-30T22:16:34.323 INFO:teuthology.orchestra.run.smithi156.stderr:dumped all 2023-09-30T22:16:34.332 INFO:teuthology.orchestra.run.smithi156.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2023-09-30T22:16:32.354278+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188812,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298548,"statfs":{"total":386547056640,"available":385329713152,"internally_reserved":0,"allocated":438272,"data_stored":116486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.426193+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424905+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.425365+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424970+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424620+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424470+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424356+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424094+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424841+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.423784+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424451+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-09-30T22:16:25.781501+0000","last_change":"2023-09-30T22:16:25.780366+0000","last_active":"2023-09-30T22:16:25.781501+0000","last_peered":"2023-09-30T22:16:25.781501+0000","last_clean":"2023-09-30T22:16:25.781501+0000","last_became_active":"2023-09-30T22:16:25.780059+0000","last_became_peered":"2023-09-30T22:16:25.780059+0000","last_unstale":"2023-09-30T22:16:25.781501+0000","last_undegraded":"2023-09-30T22:16:25.781501+0000","last_fullsized":"2023-09-30T22:16:25.781501+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424486+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:16:26.411395+0000","last_change":"2023-09-30T22:16:25.414057+0000","last_active":"2023-09-30T22:16:26.411395+0000","last_peered":"2023-09-30T22:16:26.411395+0000","last_clean":"2023-09-30T22:16:26.411395+0000","last_became_active":"2023-09-30T22:16:25.413712+0000","last_became_peered":"2023-09-30T22:16:25.413712+0000","last_unstale":"2023-09-30T22:16:26.411395+0000","last_undegraded":"2023-09-30T22:16:26.411395+0000","last_fullsized":"2023-09-30T22:16:26.411395+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:16:26.411007+0000","last_change":"2023-09-30T22:16:25.416240+0000","last_active":"2023-09-30T22:16:26.411007+0000","last_peered":"2023-09-30T22:16:26.411007+0000","last_clean":"2023-09-30T22:16:26.411007+0000","last_became_active":"2023-09-30T22:16:25.415852+0000","last_became_peered":"2023-09-30T22:16:25.415852+0000","last_unstale":"2023-09-30T22:16:26.411007+0000","last_undegraded":"2023-09-30T22:16:26.411007+0000","last_fullsized":"2023-09-30T22:16:26.411007+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:16:26.411061+0000","last_change":"2023-09-30T22:16:25.414050+0000","last_active":"2023-09-30T22:16:26.411061+0000","last_peered":"2023-09-30T22:16:26.411061+0000","last_clean":"2023-09-30T22:16:26.411061+0000","last_became_active":"2023-09-30T22:16:25.413709+0000","last_became_peered":"2023-09-30T22:16:25.413709+0000","last_unstale":"2023-09-30T22:16:26.411061+0000","last_undegraded":"2023-09-30T22:16:26.411061+0000","last_fullsized":"2023-09-30T22:16:26.411061+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-09-30T22:16:25.781893+0000","last_change":"2023-09-30T22:16:25.781137+0000","last_active":"2023-09-30T22:16:25.781893+0000","last_peered":"2023-09-30T22:16:25.781893+0000","last_clean":"2023-09-30T22:16:25.781893+0000","last_became_active":"2023-09-30T22:16:25.780923+0000","last_became_peered":"2023-09-30T22:16:25.780923+0000","last_unstale":"2023-09-30T22:16:25.781893+0000","last_undegraded":"2023-09-30T22:16:25.781893+0000","last_fullsized":"2023-09-30T22:16:25.781893+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.424012+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:16:26.410930+0000","last_change":"2023-09-30T22:16:25.416399+0000","last_active":"2023-09-30T22:16:26.410930+0000","last_peered":"2023-09-30T22:16:26.410930+0000","last_clean":"2023-09-30T22:16:26.410930+0000","last_became_active":"2023-09-30T22:16:25.416054+0000","last_became_peered":"2023-09-30T22:16:25.416054+0000","last_unstale":"2023-09-30T22:16:26.410930+0000","last_undegraded":"2023-09-30T22:16:26.410930+0000","last_fullsized":"2023-09-30T22:16:26.410930+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:16:26.411037+0000","last_change":"2023-09-30T22:16:25.780298+0000","last_active":"2023-09-30T22:16:26.411037+0000","last_peered":"2023-09-30T22:16:26.411037+0000","last_clean":"2023-09-30T22:16:26.411037+0000","last_became_active":"2023-09-30T22:16:25.780022+0000","last_became_peered":"2023-09-30T22:16:25.780022+0000","last_unstale":"2023-09-30T22:16:26.411037+0000","last_undegraded":"2023-09-30T22:16:26.411037+0000","last_fullsized":"2023-09-30T22:16:26.411037+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.423794+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-09-30T22:16:25.781887+0000","last_change":"2023-09-30T22:16:25.781178+0000","last_active":"2023-09-30T22:16:25.781887+0000","last_peered":"2023-09-30T22:16:25.781887+0000","last_clean":"2023-09-30T22:16:25.781887+0000","last_became_active":"2023-09-30T22:16:25.780121+0000","last_became_peered":"2023-09-30T22:16:25.780121+0000","last_unstale":"2023-09-30T22:16:25.781887+0000","last_undegraded":"2023-09-30T22:16:25.781887+0000","last_fullsized":"2023-09-30T22:16:25.781887+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:16:26.411160+0000","last_change":"2023-09-30T22:16:25.780328+0000","last_active":"2023-09-30T22:16:26.411160+0000","last_peered":"2023-09-30T22:16:26.411160+0000","last_clean":"2023-09-30T22:16:26.411160+0000","last_became_active":"2023-09-30T22:16:25.780026+0000","last_became_peered":"2023-09-30T22:16:25.780026+0000","last_unstale":"2023-09-30T22:16:26.411160+0000","last_undegraded":"2023-09-30T22:16:26.411160+0000","last_fullsized":"2023-09-30T22:16:26.411160+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.426381+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.426321+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:28.416755+0000","last_change":"2023-09-30T22:16:28.416755+0000","last_active":"2023-09-30T22:16:28.416755+0000","last_peered":"2023-09-30T22:16:28.416755+0000","last_clean":"2023-09-30T22:16:28.416755+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:28.416755+0000","last_undegraded":"2023-09-30T22:16:28.416755+0000","last_fullsized":"2023-09-30T22:16:28.416755+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:16:29.419764+0000","last_change":"2023-09-30T22:16:29.419764+0000","last_active":"2023-09-30T22:16:29.419764+0000","last_peered":"2023-09-30T22:16:29.419764+0000","last_clean":"2023-09-30T22:16:29.419764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:16:29.419764+0000","last_undegraded":"2023-09-30T22:16:29.419764+0000","last_fullsized":"2023-09-30T22:16:29.419764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705666,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297196,"kb_used_data":100,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074644,"statfs":{"total":96636764160,"available":96332435456,"internally_reserved":0,"allocated":102400,"data_stored":26349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297200,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074640,"statfs":{"total":96636764160,"available":96332431360,"internally_reserved":0,"allocated":106496,"data_stored":27519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:16:35.532 INFO:tasks.ceph.mds.a.smithi156.stderr:2023-09-30T22:16:35.532+0000 7fe8b0eba700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T22:16:37.340 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:16:37.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.470+0000 7f3e9e1f1700 1 Processor -- start 2023-09-30T22:16:37.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.470+0000 7f3e9e1f1700 1 -- start start 2023-09-30T22:16:37.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.471+0000 7f3e9e1f1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e98093950 0x7f3e98095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:37.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.471+0000 7f3e9e1f1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e9812d250 0x7f3e9812f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:37.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.471+0000 7f3e9e1f1700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e98094ba0 con 0x7f3e98095c50 2023-09-30T22:16:37.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.471+0000 7f3e9e1f1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e98092e90 con 0x7f3e98093950 2023-09-30T22:16:37.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.471+0000 7f3e9e1f1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e98096b60 con 0x7f3e9812d250 2023-09-30T22:16:37.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.471+0000 7f3e97fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e9812d250 0x7f3e9812f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:37.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.471+0000 7f3e977fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e98093950 0x7f3e98095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:37.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.471+0000 7f3e96ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f3e98095c50 0x7f3e98096030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37832/0 (socket says 172.21.15.156:37832) 2023-09-30T22:16:37.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.471+0000 7f3e96ffd700 1 -- 172.21.15.156:0/3148639291 learned_addr learned my addr 172.21.15.156:0/3148639291 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:37.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.471+0000 7f3e977fe700 1 -- 172.21.15.156:0/3148639291 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e9812d250 msgr2=0x7f3e9812f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:37.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.471+0000 7f3e977fe700 1 --2- 172.21.15.156:0/3148639291 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e9812d250 0x7f3e9812f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:37.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.471+0000 7f3e967fc700 1 -- 172.21.15.156:0/3148639291 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1224822220 0 0) 0x7f3e98094ba0 con 0x7f3e98095c50 2023-09-30T22:16:37.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.471+0000 7f3e977fe700 1 -- 172.21.15.156:0/3148639291 >> v1:172.21.15.156:6789/0 conn(0x7f3e98095c50 legacy=0x7f3e98096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:37.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.471+0000 7f3e977fe700 1 -- 172.21.15.156:0/3148639291 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e98093150 con 0x7f3e98093950 2023-09-30T22:16:37.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.471+0000 7f3e97fff700 1 --2- 172.21.15.156:0/3148639291 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e9812d250 0x7f3e9812f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:37.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.471+0000 7f3e977fe700 1 --2- 172.21.15.156:0/3148639291 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e98093950 0x7f3e98095760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f3e88009790 tx=0x7f3e88009060).ready entity=mon.1 client_cookie=c5735d049bf58bd3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:37.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.472+0000 7f3e967fc700 1 -- 172.21.15.156:0/3148639291 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e880090d0 con 0x7f3e98093950 2023-09-30T22:16:37.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.472+0000 7f3e967fc700 1 -- 172.21.15.156:0/3148639291 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8800f510 con 0x7f3e98093950 2023-09-30T22:16:37.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.472+0000 7f3e967fc700 1 -- 172.21.15.156:0/3148639291 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8800f890 con 0x7f3e98093950 2023-09-30T22:16:37.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.472+0000 7f3e9e1f1700 1 -- 172.21.15.156:0/3148639291 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e98093950 msgr2=0x7f3e98095760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:37.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.472+0000 7f3e9e1f1700 1 --2- 172.21.15.156:0/3148639291 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e98093950 0x7f3e98095760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f3e88009790 tx=0x7f3e88009060).stop 2023-09-30T22:16:37.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.472+0000 7f3e9e1f1700 1 -- 172.21.15.156:0/3148639291 shutdown_connections 2023-09-30T22:16:37.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.472+0000 7f3e9e1f1700 1 --2- 172.21.15.156:0/3148639291 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e98093950 0x7f3e98095760 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:37.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.472+0000 7f3e9e1f1700 1 --2- 172.21.15.156:0/3148639291 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e9812d250 0x7f3e9812f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:37.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.472+0000 7f3e9e1f1700 1 -- 172.21.15.156:0/3148639291 >> 172.21.15.156:0/3148639291 conn(0x7f3e9809aa50 msgr2=0x7f3e9809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:37.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.472+0000 7f3e9e1f1700 1 -- 172.21.15.156:0/3148639291 shutdown_connections 2023-09-30T22:16:37.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.472+0000 7f3e9e1f1700 1 -- 172.21.15.156:0/3148639291 wait complete. 2023-09-30T22:16:37.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.473+0000 7f3e9e1f1700 1 Processor -- start 2023-09-30T22:16:37.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.473+0000 7f3e9e1f1700 1 -- start start 2023-09-30T22:16:37.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.474+0000 7f3e9e1f1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e98093950 0x7f3e9811ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:37.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.474+0000 7f3e9e1f1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e98095c50 0x7f3e98116e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:37.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.474+0000 7f3e9e1f1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e9812d250 0x7f3e98117370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:37.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.474+0000 7f3e9e1f1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e98092410 con 0x7f3e9812d250 2023-09-30T22:16:37.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.474+0000 7f3e9e1f1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9811a640 con 0x7f3e98095c50 2023-09-30T22:16:37.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.474+0000 7f3e9e1f1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9811a380 con 0x7f3e98093950 2023-09-30T22:16:37.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.474+0000 7f3e96ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e98095c50 0x7f3e98116e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:37.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.474+0000 7f3e97fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e9812d250 0x7f3e98117370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:37.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.474+0000 7f3e977fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e98093950 0x7f3e9811ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:37.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.474+0000 7f3e96ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e98095c50 0x7f3e98116e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48052/0 (socket says 172.21.15.156:48052) 2023-09-30T22:16:37.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.474+0000 7f3e96ffd700 1 -- 172.21.15.156:0/1423263542 learned_addr learned my addr 172.21.15.156:0/1423263542 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.474+0000 7f3e977fe700 1 -- 172.21.15.156:0/1423263542 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e98095c50 msgr2=0x7f3e98116e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.474+0000 7f3e977fe700 1 --2- 172.21.15.156:0/1423263542 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e98095c50 0x7f3e98116e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.474+0000 7f3e977fe700 1 -- 172.21.15.156:0/1423263542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e9812d250 msgr2=0x7f3e98117370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.474+0000 7f3e977fe700 1 --2- 172.21.15.156:0/1423263542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e9812d250 0x7f3e98117370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.474+0000 7f3e977fe700 1 -- 172.21.15.156:0/1423263542 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e90009a20 con 0x7f3e98093950 2023-09-30T22:16:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.474+0000 7f3e97fff700 1 --2- 172.21.15.156:0/1423263542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e9812d250 0x7f3e98117370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.474+0000 7f3e977fe700 1 --2- 172.21.15.156:0/1423263542 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e98093950 0x7f3e9811ae20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f3e88014000 tx=0x7f3e88017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.474+0000 7f3e8f7fe700 1 -- 172.21.15.156:0/1423263542 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8800f890 con 0x7f3e98093950 2023-09-30T22:16:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.474+0000 7f3e8f7fe700 1 -- 172.21.15.156:0/1423263542 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8800fc50 con 0x7f3e98093950 2023-09-30T22:16:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.474+0000 7f3e8f7fe700 1 -- 172.21.15.156:0/1423263542 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8801b410 con 0x7f3e98093950 2023-09-30T22:16:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.474+0000 7f3e9e1f1700 1 -- 172.21.15.156:0/1423263542 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e880092a0 con 0x7f3e98093950 2023-09-30T22:16:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.475+0000 7f3e9e1f1700 1 -- 172.21.15.156:0/1423263542 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e98118a10 con 0x7f3e98093950 2023-09-30T22:16:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.475+0000 7f3e9e1f1700 1 -- 172.21.15.156:0/1423263542 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e9809a770 con 0x7f3e98093950 2023-09-30T22:16:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.476+0000 7f3e8f7fe700 1 -- 172.21.15.156:0/1423263542 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3e8801b780 con 0x7f3e98093950 2023-09-30T22:16:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.476+0000 7f3e8f7fe700 1 -- 172.21.15.156:0/1423263542 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f3e8803cb20 con 0x7f3e98093950 2023-09-30T22:16:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.480+0000 7f3e8f7fe700 1 -- 172.21.15.156:0/1423263542 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3e8801ba30 con 0x7f3e98093950 2023-09-30T22:16:37.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.632+0000 7f3e9e1f1700 1 -- 172.21.15.156:0/1423263542 --> v1:172.21.15.156:6816/118236 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3e98118ba0 con 0x7f3e7802bb90 2023-09-30T22:16:37.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.639+0000 7f3e8f7fe700 1 -- 172.21.15.156:0/1423263542 <== mgr.4122 v1:172.21.15.156:6816/118236 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250032 (unknown 2965378022 0 2456753480) 0x7f3e98118ba0 con 0x7f3e7802bb90 2023-09-30T22:16:37.642 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:37.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.641+0000 7f3e9e1f1700 1 -- 172.21.15.156:0/1423263542 >> v1:172.21.15.156:6816/118236 conn(0x7f3e7802bb90 legacy=0x7f3e7802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:37.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.641+0000 7f3e9e1f1700 1 -- 172.21.15.156:0/1423263542 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e98093950 msgr2=0x7f3e9811ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:37.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.641+0000 7f3e9e1f1700 1 --2- 172.21.15.156:0/1423263542 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e98093950 0x7f3e9811ae20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f3e88014000 tx=0x7f3e88017000).stop 2023-09-30T22:16:37.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.641+0000 7f3e9e1f1700 1 -- 172.21.15.156:0/1423263542 shutdown_connections 2023-09-30T22:16:37.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.641+0000 7f3e9e1f1700 1 --2- 172.21.15.156:0/1423263542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e9812d250 0x7f3e98117370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:37.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.641+0000 7f3e9e1f1700 1 --2- 172.21.15.156:0/1423263542 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e98093950 0x7f3e9811ae20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:37.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.641+0000 7f3e9e1f1700 1 --2- 172.21.15.156:0/1423263542 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e98095c50 0x7f3e98116e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:37.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.641+0000 7f3e9e1f1700 1 -- 172.21.15.156:0/1423263542 >> 172.21.15.156:0/1423263542 conn(0x7f3e9809aa50 msgr2=0x7f3e98098880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:37.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.641+0000 7f3e9e1f1700 1 -- 172.21.15.156:0/1423263542 shutdown_connections 2023-09-30T22:16:37.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.641+0000 7f3e9e1f1700 1 -- 172.21.15.156:0/1423263542 wait complete. 2023-09-30T22:16:37.645 INFO:teuthology.orchestra.run.smithi156.stderr:dumped all 2023-09-30T22:16:37.653 INFO:teuthology.orchestra.run.smithi156.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-09-30T22:16:36.355210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188988,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298372,"statfs":{"total":386547056640,"available":385329532928,"internally_reserved":0,"allocated":618496,"data_stored":181498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1640,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000435"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.818548+0000","last_change":"2023-09-30T22:16:29.812173+0000","last_active":"2023-09-30T22:16:29.818548+0000","last_peered":"2023-09-30T22:16:29.818548+0000","last_clean":"2023-09-30T22:16:29.818548+0000","last_became_active":"2023-09-30T22:16:29.811948+0000","last_became_peered":"2023-09-30T22:16:29.811948+0000","last_unstale":"2023-09-30T22:16:29.818548+0000","last_undegraded":"2023-09-30T22:16:29.818548+0000","last_fullsized":"2023-09-30T22:16:29.818548+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.829503+0000","last_change":"2023-09-30T22:16:29.827324+0000","last_active":"2023-09-30T22:16:29.829503+0000","last_peered":"2023-09-30T22:16:29.829503+0000","last_clean":"2023-09-30T22:16:29.829503+0000","last_became_active":"2023-09-30T22:16:29.826847+0000","last_became_peered":"2023-09-30T22:16:29.826847+0000","last_unstale":"2023-09-30T22:16:29.829503+0000","last_undegraded":"2023-09-30T22:16:29.829503+0000","last_fullsized":"2023-09-30T22:16:29.829503+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828371+0000","last_change":"2023-09-30T22:16:29.825941+0000","last_active":"2023-09-30T22:16:29.828371+0000","last_peered":"2023-09-30T22:16:29.828371+0000","last_clean":"2023-09-30T22:16:29.828371+0000","last_became_active":"2023-09-30T22:16:29.825655+0000","last_became_peered":"2023-09-30T22:16:29.825655+0000","last_unstale":"2023-09-30T22:16:29.828371+0000","last_undegraded":"2023-09-30T22:16:29.828371+0000","last_fullsized":"2023-09-30T22:16:29.828371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828040+0000","last_change":"2023-09-30T22:16:29.822545+0000","last_active":"2023-09-30T22:16:29.828040+0000","last_peered":"2023-09-30T22:16:29.828040+0000","last_clean":"2023-09-30T22:16:29.828040+0000","last_became_active":"2023-09-30T22:16:29.822264+0000","last_became_peered":"2023-09-30T22:16:29.822264+0000","last_unstale":"2023-09-30T22:16:29.828040+0000","last_undegraded":"2023-09-30T22:16:29.828040+0000","last_fullsized":"2023-09-30T22:16:29.828040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.835961+0000","last_change":"2023-09-30T22:16:29.831319+0000","last_active":"2023-09-30T22:16:29.835961+0000","last_peered":"2023-09-30T22:16:29.835961+0000","last_clean":"2023-09-30T22:16:29.835961+0000","last_became_active":"2023-09-30T22:16:29.831024+0000","last_became_peered":"2023-09-30T22:16:29.831024+0000","last_unstale":"2023-09-30T22:16:29.835961+0000","last_undegraded":"2023-09-30T22:16:29.835961+0000","last_fullsized":"2023-09-30T22:16:29.835961+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828212+0000","last_change":"2023-09-30T22:16:29.820688+0000","last_active":"2023-09-30T22:16:29.828212+0000","last_peered":"2023-09-30T22:16:29.828212+0000","last_clean":"2023-09-30T22:16:29.828212+0000","last_became_active":"2023-09-30T22:16:29.820480+0000","last_became_peered":"2023-09-30T22:16:29.820480+0000","last_unstale":"2023-09-30T22:16:29.828212+0000","last_undegraded":"2023-09-30T22:16:29.828212+0000","last_fullsized":"2023-09-30T22:16:29.828212+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.840140+0000","last_change":"2023-09-30T22:16:29.834595+0000","last_active":"2023-09-30T22:16:29.840140+0000","last_peered":"2023-09-30T22:16:29.840140+0000","last_clean":"2023-09-30T22:16:29.840140+0000","last_became_active":"2023-09-30T22:16:29.834156+0000","last_became_peered":"2023-09-30T22:16:29.834156+0000","last_unstale":"2023-09-30T22:16:29.840140+0000","last_undegraded":"2023-09-30T22:16:29.840140+0000","last_fullsized":"2023-09-30T22:16:29.840140+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.829014+0000","last_change":"2023-09-30T22:16:29.822064+0000","last_active":"2023-09-30T22:16:29.829014+0000","last_peered":"2023-09-30T22:16:29.829014+0000","last_clean":"2023-09-30T22:16:29.829014+0000","last_became_active":"2023-09-30T22:16:29.821816+0000","last_became_peered":"2023-09-30T22:16:29.821816+0000","last_unstale":"2023-09-30T22:16:29.829014+0000","last_undegraded":"2023-09-30T22:16:29.829014+0000","last_fullsized":"2023-09-30T22:16:29.829014+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828723+0000","last_change":"2023-09-30T22:16:29.828044+0000","last_active":"2023-09-30T22:16:29.828723+0000","last_peered":"2023-09-30T22:16:29.828723+0000","last_clean":"2023-09-30T22:16:29.828723+0000","last_became_active":"2023-09-30T22:16:29.827740+0000","last_became_peered":"2023-09-30T22:16:29.827740+0000","last_unstale":"2023-09-30T22:16:29.828723+0000","last_undegraded":"2023-09-30T22:16:29.828723+0000","last_fullsized":"2023-09-30T22:16:29.828723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.829021+0000","last_change":"2023-09-30T22:16:29.824597+0000","last_active":"2023-09-30T22:16:29.829021+0000","last_peered":"2023-09-30T22:16:29.829021+0000","last_clean":"2023-09-30T22:16:29.829021+0000","last_became_active":"2023-09-30T22:16:29.824344+0000","last_became_peered":"2023-09-30T22:16:29.824344+0000","last_unstale":"2023-09-30T22:16:29.829021+0000","last_undegraded":"2023-09-30T22:16:29.829021+0000","last_fullsized":"2023-09-30T22:16:29.829021+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839137+0000","last_change":"2023-09-30T22:16:29.830182+0000","last_active":"2023-09-30T22:16:29.839137+0000","last_peered":"2023-09-30T22:16:29.839137+0000","last_clean":"2023-09-30T22:16:29.839137+0000","last_became_active":"2023-09-30T22:16:29.828962+0000","last_became_peered":"2023-09-30T22:16:29.828962+0000","last_unstale":"2023-09-30T22:16:29.839137+0000","last_undegraded":"2023-09-30T22:16:29.839137+0000","last_fullsized":"2023-09-30T22:16:29.839137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.835722+0000","last_change":"2023-09-30T22:16:29.833916+0000","last_active":"2023-09-30T22:16:29.835722+0000","last_peered":"2023-09-30T22:16:29.835722+0000","last_clean":"2023-09-30T22:16:29.835722+0000","last_became_active":"2023-09-30T22:16:29.833664+0000","last_became_peered":"2023-09-30T22:16:29.833664+0000","last_unstale":"2023-09-30T22:16:29.835722+0000","last_undegraded":"2023-09-30T22:16:29.835722+0000","last_fullsized":"2023-09-30T22:16:29.835722+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828781+0000","last_change":"2023-09-30T22:16:29.823993+0000","last_active":"2023-09-30T22:16:29.828781+0000","last_peered":"2023-09-30T22:16:29.828781+0000","last_clean":"2023-09-30T22:16:29.828781+0000","last_became_active":"2023-09-30T22:16:29.823725+0000","last_became_peered":"2023-09-30T22:16:29.823725+0000","last_unstale":"2023-09-30T22:16:29.828781+0000","last_undegraded":"2023-09-30T22:16:29.828781+0000","last_fullsized":"2023-09-30T22:16:29.828781+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839359+0000","last_change":"2023-09-30T22:16:29.832518+0000","last_active":"2023-09-30T22:16:29.839359+0000","last_peered":"2023-09-30T22:16:29.839359+0000","last_clean":"2023-09-30T22:16:29.839359+0000","last_became_active":"2023-09-30T22:16:29.832228+0000","last_became_peered":"2023-09-30T22:16:29.832228+0000","last_unstale":"2023-09-30T22:16:29.839359+0000","last_undegraded":"2023-09-30T22:16:29.839359+0000","last_fullsized":"2023-09-30T22:16:29.839359+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.822394+0000","last_change":"2023-09-30T22:16:29.814680+0000","last_active":"2023-09-30T22:16:29.822394+0000","last_peered":"2023-09-30T22:16:29.822394+0000","last_clean":"2023-09-30T22:16:29.822394+0000","last_became_active":"2023-09-30T22:16:29.814427+0000","last_became_peered":"2023-09-30T22:16:29.814427+0000","last_unstale":"2023-09-30T22:16:29.822394+0000","last_undegraded":"2023-09-30T22:16:29.822394+0000","last_fullsized":"2023-09-30T22:16:29.822394+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839868+0000","last_change":"2023-09-30T22:16:29.833416+0000","last_active":"2023-09-30T22:16:29.839868+0000","last_peered":"2023-09-30T22:16:29.839868+0000","last_clean":"2023-09-30T22:16:29.839868+0000","last_became_active":"2023-09-30T22:16:29.833121+0000","last_became_peered":"2023-09-30T22:16:29.833121+0000","last_unstale":"2023-09-30T22:16:29.839868+0000","last_undegraded":"2023-09-30T22:16:29.839868+0000","last_fullsized":"2023-09-30T22:16:29.839868+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828415+0000","last_change":"2023-09-30T22:16:29.823463+0000","last_active":"2023-09-30T22:16:29.828415+0000","last_peered":"2023-09-30T22:16:29.828415+0000","last_clean":"2023-09-30T22:16:29.828415+0000","last_became_active":"2023-09-30T22:16:29.823207+0000","last_became_peered":"2023-09-30T22:16:29.823207+0000","last_unstale":"2023-09-30T22:16:29.828415+0000","last_undegraded":"2023-09-30T22:16:29.828415+0000","last_fullsized":"2023-09-30T22:16:29.828415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.827618+0000","last_change":"2023-09-30T22:16:29.816722+0000","last_active":"2023-09-30T22:16:29.827618+0000","last_peered":"2023-09-30T22:16:29.827618+0000","last_clean":"2023-09-30T22:16:29.827618+0000","last_became_active":"2023-09-30T22:16:29.816461+0000","last_became_peered":"2023-09-30T22:16:29.816461+0000","last_unstale":"2023-09-30T22:16:29.827618+0000","last_undegraded":"2023-09-30T22:16:29.827618+0000","last_fullsized":"2023-09-30T22:16:29.827618+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.835733+0000","last_change":"2023-09-30T22:16:29.833443+0000","last_active":"2023-09-30T22:16:29.835733+0000","last_peered":"2023-09-30T22:16:29.835733+0000","last_clean":"2023-09-30T22:16:29.835733+0000","last_became_active":"2023-09-30T22:16:29.833187+0000","last_became_peered":"2023-09-30T22:16:29.833187+0000","last_unstale":"2023-09-30T22:16:29.835733+0000","last_undegraded":"2023-09-30T22:16:29.835733+0000","last_fullsized":"2023-09-30T22:16:29.835733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.838620+0000","last_change":"2023-09-30T22:16:29.828875+0000","last_active":"2023-09-30T22:16:29.838620+0000","last_peered":"2023-09-30T22:16:29.838620+0000","last_clean":"2023-09-30T22:16:29.838620+0000","last_became_active":"2023-09-30T22:16:29.828593+0000","last_became_peered":"2023-09-30T22:16:29.828593+0000","last_unstale":"2023-09-30T22:16:29.838620+0000","last_undegraded":"2023-09-30T22:16:29.838620+0000","last_fullsized":"2023-09-30T22:16:29.838620+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.829249+0000","last_change":"2023-09-30T22:16:29.827607+0000","last_active":"2023-09-30T22:16:29.829249+0000","last_peered":"2023-09-30T22:16:29.829249+0000","last_clean":"2023-09-30T22:16:29.829249+0000","last_became_active":"2023-09-30T22:16:29.826392+0000","last_became_peered":"2023-09-30T22:16:29.826392+0000","last_unstale":"2023-09-30T22:16:29.829249+0000","last_undegraded":"2023-09-30T22:16:29.829249+0000","last_fullsized":"2023-09-30T22:16:29.829249+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828165+0000","last_change":"2023-09-30T22:16:29.823191+0000","last_active":"2023-09-30T22:16:29.828165+0000","last_peered":"2023-09-30T22:16:29.828165+0000","last_clean":"2023-09-30T22:16:29.828165+0000","last_became_active":"2023-09-30T22:16:29.822796+0000","last_became_peered":"2023-09-30T22:16:29.822796+0000","last_unstale":"2023-09-30T22:16:29.828165+0000","last_undegraded":"2023-09-30T22:16:29.828165+0000","last_fullsized":"2023-09-30T22:16:29.828165+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.840103+0000","last_change":"2023-09-30T22:16:29.834377+0000","last_active":"2023-09-30T22:16:29.840103+0000","last_peered":"2023-09-30T22:16:29.840103+0000","last_clean":"2023-09-30T22:16:29.840103+0000","last_became_active":"2023-09-30T22:16:29.833873+0000","last_became_peered":"2023-09-30T22:16:29.833873+0000","last_unstale":"2023-09-30T22:16:29.840103+0000","last_undegraded":"2023-09-30T22:16:29.840103+0000","last_fullsized":"2023-09-30T22:16:29.840103+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.823195+0000","last_change":"2023-09-30T22:16:29.821578+0000","last_active":"2023-09-30T22:16:29.823195+0000","last_peered":"2023-09-30T22:16:29.823195+0000","last_clean":"2023-09-30T22:16:29.823195+0000","last_became_active":"2023-09-30T22:16:29.818116+0000","last_became_peered":"2023-09-30T22:16:29.818116+0000","last_unstale":"2023-09-30T22:16:29.823195+0000","last_undegraded":"2023-09-30T22:16:29.823195+0000","last_fullsized":"2023-09-30T22:16:29.823195+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.838596+0000","last_change":"2023-09-30T22:16:29.829048+0000","last_active":"2023-09-30T22:16:29.838596+0000","last_peered":"2023-09-30T22:16:29.838596+0000","last_clean":"2023-09-30T22:16:29.838596+0000","last_became_active":"2023-09-30T22:16:29.828174+0000","last_became_peered":"2023-09-30T22:16:29.828174+0000","last_unstale":"2023-09-30T22:16:29.838596+0000","last_undegraded":"2023-09-30T22:16:29.838596+0000","last_fullsized":"2023-09-30T22:16:29.838596+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839543+0000","last_change":"2023-09-30T22:16:29.834779+0000","last_active":"2023-09-30T22:16:29.839543+0000","last_peered":"2023-09-30T22:16:29.839543+0000","last_clean":"2023-09-30T22:16:29.839543+0000","last_became_active":"2023-09-30T22:16:29.833042+0000","last_became_peered":"2023-09-30T22:16:29.833042+0000","last_unstale":"2023-09-30T22:16:29.839543+0000","last_undegraded":"2023-09-30T22:16:29.839543+0000","last_fullsized":"2023-09-30T22:16:29.839543+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839810+0000","last_change":"2023-09-30T22:16:29.832499+0000","last_active":"2023-09-30T22:16:29.839810+0000","last_peered":"2023-09-30T22:16:29.839810+0000","last_clean":"2023-09-30T22:16:29.839810+0000","last_became_active":"2023-09-30T22:16:29.831898+0000","last_became_peered":"2023-09-30T22:16:29.831898+0000","last_unstale":"2023-09-30T22:16:29.839810+0000","last_undegraded":"2023-09-30T22:16:29.839810+0000","last_fullsized":"2023-09-30T22:16:29.839810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.832635+0000","last_change":"2023-09-30T22:16:29.448332+0000","last_active":"2023-09-30T22:16:29.832635+0000","last_peered":"2023-09-30T22:16:29.832635+0000","last_clean":"2023-09-30T22:16:29.832635+0000","last_became_active":"2023-09-30T22:16:29.448043+0000","last_became_peered":"2023-09-30T22:16:29.448043+0000","last_unstale":"2023-09-30T22:16:29.832635+0000","last_undegraded":"2023-09-30T22:16:29.832635+0000","last_fullsized":"2023-09-30T22:16:29.832635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839699+0000","last_change":"2023-09-30T22:16:29.831419+0000","last_active":"2023-09-30T22:16:29.839699+0000","last_peered":"2023-09-30T22:16:29.839699+0000","last_clean":"2023-09-30T22:16:29.839699+0000","last_became_active":"2023-09-30T22:16:29.830841+0000","last_became_peered":"2023-09-30T22:16:29.830841+0000","last_unstale":"2023-09-30T22:16:29.839699+0000","last_undegraded":"2023-09-30T22:16:29.839699+0000","last_fullsized":"2023-09-30T22:16:29.839699+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.797808+0000","last_change":"2023-09-30T22:16:29.449809+0000","last_active":"2023-09-30T22:16:29.797808+0000","last_peered":"2023-09-30T22:16:29.797808+0000","last_clean":"2023-09-30T22:16:29.797808+0000","last_became_active":"2023-09-30T22:16:29.449538+0000","last_became_peered":"2023-09-30T22:16:29.449538+0000","last_unstale":"2023-09-30T22:16:29.797808+0000","last_undegraded":"2023-09-30T22:16:29.797808+0000","last_fullsized":"2023-09-30T22:16:29.797808+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.827987+0000","last_change":"2023-09-30T22:16:29.822995+0000","last_active":"2023-09-30T22:16:29.827987+0000","last_peered":"2023-09-30T22:16:29.827987+0000","last_clean":"2023-09-30T22:16:29.827987+0000","last_became_active":"2023-09-30T22:16:29.822621+0000","last_became_peered":"2023-09-30T22:16:29.822621+0000","last_unstale":"2023-09-30T22:16:29.827987+0000","last_undegraded":"2023-09-30T22:16:29.827987+0000","last_fullsized":"2023-09-30T22:16:29.827987+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.814238+0000","last_change":"2023-09-30T22:16:29.452955+0000","last_active":"2023-09-30T22:16:29.814238+0000","last_peered":"2023-09-30T22:16:29.814238+0000","last_clean":"2023-09-30T22:16:29.814238+0000","last_became_active":"2023-09-30T22:16:29.449928+0000","last_became_peered":"2023-09-30T22:16:29.449928+0000","last_unstale":"2023-09-30T22:16:29.814238+0000","last_undegraded":"2023-09-30T22:16:29.814238+0000","last_fullsized":"2023-09-30T22:16:29.814238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839729+0000","last_change":"2023-09-30T22:16:29.831592+0000","last_active":"2023-09-30T22:16:29.839729+0000","last_peered":"2023-09-30T22:16:29.839729+0000","last_clean":"2023-09-30T22:16:29.839729+0000","last_became_active":"2023-09-30T22:16:29.831170+0000","last_became_peered":"2023-09-30T22:16:29.831170+0000","last_unstale":"2023-09-30T22:16:29.839729+0000","last_undegraded":"2023-09-30T22:16:29.839729+0000","last_fullsized":"2023-09-30T22:16:29.839729+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.803377+0000","last_change":"2023-09-30T22:16:29.452637+0000","last_active":"2023-09-30T22:16:29.803377+0000","last_peered":"2023-09-30T22:16:29.803377+0000","last_clean":"2023-09-30T22:16:29.803377+0000","last_became_active":"2023-09-30T22:16:29.452263+0000","last_became_peered":"2023-09-30T22:16:29.452263+0000","last_unstale":"2023-09-30T22:16:29.803377+0000","last_undegraded":"2023-09-30T22:16:29.803377+0000","last_fullsized":"2023-09-30T22:16:29.803377+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.840008+0000","last_change":"2023-09-30T22:16:29.835756+0000","last_active":"2023-09-30T22:16:29.840008+0000","last_peered":"2023-09-30T22:16:29.840008+0000","last_clean":"2023-09-30T22:16:29.840008+0000","last_became_active":"2023-09-30T22:16:29.834448+0000","last_became_peered":"2023-09-30T22:16:29.834448+0000","last_unstale":"2023-09-30T22:16:29.840008+0000","last_undegraded":"2023-09-30T22:16:29.840008+0000","last_fullsized":"2023-09-30T22:16:29.840008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.799766+0000","last_change":"2023-09-30T22:16:29.448611+0000","last_active":"2023-09-30T22:16:29.799766+0000","last_peered":"2023-09-30T22:16:29.799766+0000","last_clean":"2023-09-30T22:16:29.799766+0000","last_became_active":"2023-09-30T22:16:29.448289+0000","last_became_peered":"2023-09-30T22:16:29.448289+0000","last_unstale":"2023-09-30T22:16:29.799766+0000","last_undegraded":"2023-09-30T22:16:29.799766+0000","last_fullsized":"2023-09-30T22:16:29.799766+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.840157+0000","last_change":"2023-09-30T22:16:29.836465+0000","last_active":"2023-09-30T22:16:29.840157+0000","last_peered":"2023-09-30T22:16:29.840157+0000","last_clean":"2023-09-30T22:16:29.840157+0000","last_became_active":"2023-09-30T22:16:29.834303+0000","last_became_peered":"2023-09-30T22:16:29.834303+0000","last_unstale":"2023-09-30T22:16:29.840157+0000","last_undegraded":"2023-09-30T22:16:29.840157+0000","last_fullsized":"2023-09-30T22:16:29.840157+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.827908+0000","last_change":"2023-09-30T22:16:29.448241+0000","last_active":"2023-09-30T22:16:29.827908+0000","last_peered":"2023-09-30T22:16:29.827908+0000","last_clean":"2023-09-30T22:16:29.827908+0000","last_became_active":"2023-09-30T22:16:29.447960+0000","last_became_peered":"2023-09-30T22:16:29.447960+0000","last_unstale":"2023-09-30T22:16:29.827908+0000","last_undegraded":"2023-09-30T22:16:29.827908+0000","last_fullsized":"2023-09-30T22:16:29.827908+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828838+0000","last_change":"2023-09-30T22:16:29.825275+0000","last_active":"2023-09-30T22:16:29.828838+0000","last_peered":"2023-09-30T22:16:29.828838+0000","last_clean":"2023-09-30T22:16:29.828838+0000","last_became_active":"2023-09-30T22:16:29.825002+0000","last_became_peered":"2023-09-30T22:16:29.825002+0000","last_unstale":"2023-09-30T22:16:29.828838+0000","last_undegraded":"2023-09-30T22:16:29.828838+0000","last_fullsized":"2023-09-30T22:16:29.828838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.840394+0000","last_change":"2023-09-30T22:16:29.449099+0000","last_active":"2023-09-30T22:16:29.840394+0000","last_peered":"2023-09-30T22:16:29.840394+0000","last_clean":"2023-09-30T22:16:29.840394+0000","last_became_active":"2023-09-30T22:16:29.448827+0000","last_became_peered":"2023-09-30T22:16:29.448827+0000","last_unstale":"2023-09-30T22:16:29.840394+0000","last_undegraded":"2023-09-30T22:16:29.840394+0000","last_fullsized":"2023-09-30T22:16:29.840394+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.819093+0000","last_change":"2023-09-30T22:16:29.811836+0000","last_active":"2023-09-30T22:16:29.819093+0000","last_peered":"2023-09-30T22:16:29.819093+0000","last_clean":"2023-09-30T22:16:29.819093+0000","last_became_active":"2023-09-30T22:16:29.811605+0000","last_became_peered":"2023-09-30T22:16:29.811605+0000","last_unstale":"2023-09-30T22:16:29.819093+0000","last_undegraded":"2023-09-30T22:16:29.819093+0000","last_fullsized":"2023-09-30T22:16:29.819093+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.833443+0000","last_change":"2023-09-30T22:16:29.446893+0000","last_active":"2023-09-30T22:16:29.833443+0000","last_peered":"2023-09-30T22:16:29.833443+0000","last_clean":"2023-09-30T22:16:29.833443+0000","last_became_active":"2023-09-30T22:16:29.446554+0000","last_became_peered":"2023-09-30T22:16:29.446554+0000","last_unstale":"2023-09-30T22:16:29.833443+0000","last_undegraded":"2023-09-30T22:16:29.833443+0000","last_fullsized":"2023-09-30T22:16:29.833443+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.838932+0000","last_change":"2023-09-30T22:16:29.830170+0000","last_active":"2023-09-30T22:16:29.838932+0000","last_peered":"2023-09-30T22:16:29.838932+0000","last_clean":"2023-09-30T22:16:29.838932+0000","last_became_active":"2023-09-30T22:16:29.829909+0000","last_became_peered":"2023-09-30T22:16:29.829909+0000","last_unstale":"2023-09-30T22:16:29.838932+0000","last_undegraded":"2023-09-30T22:16:29.838932+0000","last_fullsized":"2023-09-30T22:16:29.838932+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.802776+0000","last_change":"2023-09-30T22:16:29.453090+0000","last_active":"2023-09-30T22:16:29.802776+0000","last_peered":"2023-09-30T22:16:29.802776+0000","last_clean":"2023-09-30T22:16:29.802776+0000","last_became_active":"2023-09-30T22:16:29.452814+0000","last_became_peered":"2023-09-30T22:16:29.452814+0000","last_unstale":"2023-09-30T22:16:29.802776+0000","last_undegraded":"2023-09-30T22:16:29.802776+0000","last_fullsized":"2023-09-30T22:16:29.802776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839830+0000","last_change":"2023-09-30T22:16:29.832660+0000","last_active":"2023-09-30T22:16:29.839830+0000","last_peered":"2023-09-30T22:16:29.839830+0000","last_clean":"2023-09-30T22:16:29.839830+0000","last_became_active":"2023-09-30T22:16:29.832233+0000","last_became_peered":"2023-09-30T22:16:29.832233+0000","last_unstale":"2023-09-30T22:16:29.839830+0000","last_undegraded":"2023-09-30T22:16:29.839830+0000","last_fullsized":"2023-09-30T22:16:29.839830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.811008+0000","last_change":"2023-09-30T22:16:29.450700+0000","last_active":"2023-09-30T22:16:29.811008+0000","last_peered":"2023-09-30T22:16:29.811008+0000","last_clean":"2023-09-30T22:16:29.811008+0000","last_became_active":"2023-09-30T22:16:29.450434+0000","last_became_peered":"2023-09-30T22:16:29.450434+0000","last_unstale":"2023-09-30T22:16:29.811008+0000","last_undegraded":"2023-09-30T22:16:29.811008+0000","last_fullsized":"2023-09-30T22:16:29.811008+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.827638+0000","last_change":"2023-09-30T22:16:29.821215+0000","last_active":"2023-09-30T22:16:29.827638+0000","last_peered":"2023-09-30T22:16:29.827638+0000","last_clean":"2023-09-30T22:16:29.827638+0000","last_became_active":"2023-09-30T22:16:29.820939+0000","last_became_peered":"2023-09-30T22:16:29.820939+0000","last_unstale":"2023-09-30T22:16:29.827638+0000","last_undegraded":"2023-09-30T22:16:29.827638+0000","last_fullsized":"2023-09-30T22:16:29.827638+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.837411+0000","last_change":"2023-09-30T22:16:29.445251+0000","last_active":"2023-09-30T22:16:29.837411+0000","last_peered":"2023-09-30T22:16:29.837411+0000","last_clean":"2023-09-30T22:16:29.837411+0000","last_became_active":"2023-09-30T22:16:29.441736+0000","last_became_peered":"2023-09-30T22:16:29.441736+0000","last_unstale":"2023-09-30T22:16:29.837411+0000","last_undegraded":"2023-09-30T22:16:29.837411+0000","last_fullsized":"2023-09-30T22:16:29.837411+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.840261+0000","last_change":"2023-09-30T22:16:29.836710+0000","last_active":"2023-09-30T22:16:29.840261+0000","last_peered":"2023-09-30T22:16:29.840261+0000","last_clean":"2023-09-30T22:16:29.840261+0000","last_became_active":"2023-09-30T22:16:29.831551+0000","last_became_peered":"2023-09-30T22:16:29.831551+0000","last_unstale":"2023-09-30T22:16:29.840261+0000","last_undegraded":"2023-09-30T22:16:29.840261+0000","last_fullsized":"2023-09-30T22:16:29.840261+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.825857+0000","last_change":"2023-09-30T22:16:29.444871+0000","last_active":"2023-09-30T22:16:29.825857+0000","last_peered":"2023-09-30T22:16:29.825857+0000","last_clean":"2023-09-30T22:16:29.825857+0000","last_became_active":"2023-09-30T22:16:29.444600+0000","last_became_peered":"2023-09-30T22:16:29.444600+0000","last_unstale":"2023-09-30T22:16:29.825857+0000","last_undegraded":"2023-09-30T22:16:29.825857+0000","last_fullsized":"2023-09-30T22:16:29.825857+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.840410+0000","last_change":"2023-09-30T22:16:29.839223+0000","last_active":"2023-09-30T22:16:29.840410+0000","last_peered":"2023-09-30T22:16:29.840410+0000","last_clean":"2023-09-30T22:16:29.840410+0000","last_became_active":"2023-09-30T22:16:29.838955+0000","last_became_peered":"2023-09-30T22:16:29.838955+0000","last_unstale":"2023-09-30T22:16:29.840410+0000","last_undegraded":"2023-09-30T22:16:29.840410+0000","last_fullsized":"2023-09-30T22:16:29.840410+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.823621+0000","last_change":"2023-09-30T22:16:29.451861+0000","last_active":"2023-09-30T22:16:29.823621+0000","last_peered":"2023-09-30T22:16:29.823621+0000","last_clean":"2023-09-30T22:16:29.823621+0000","last_became_active":"2023-09-30T22:16:29.451069+0000","last_became_peered":"2023-09-30T22:16:29.451069+0000","last_unstale":"2023-09-30T22:16:29.823621+0000","last_undegraded":"2023-09-30T22:16:29.823621+0000","last_fullsized":"2023-09-30T22:16:29.823621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.823858+0000","last_change":"2023-09-30T22:16:29.818789+0000","last_active":"2023-09-30T22:16:29.823858+0000","last_peered":"2023-09-30T22:16:29.823858+0000","last_clean":"2023-09-30T22:16:29.823858+0000","last_became_active":"2023-09-30T22:16:29.818283+0000","last_became_peered":"2023-09-30T22:16:29.818283+0000","last_unstale":"2023-09-30T22:16:29.823858+0000","last_undegraded":"2023-09-30T22:16:29.823858+0000","last_fullsized":"2023-09-30T22:16:29.823858+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.834215+0000","last_change":"2023-09-30T22:16:29.446443+0000","last_active":"2023-09-30T22:16:29.834215+0000","last_peered":"2023-09-30T22:16:29.834215+0000","last_clean":"2023-09-30T22:16:29.834215+0000","last_became_active":"2023-09-30T22:16:29.445833+0000","last_became_peered":"2023-09-30T22:16:29.445833+0000","last_unstale":"2023-09-30T22:16:29.834215+0000","last_undegraded":"2023-09-30T22:16:29.834215+0000","last_fullsized":"2023-09-30T22:16:29.834215+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.835697+0000","last_change":"2023-09-30T22:16:29.833040+0000","last_active":"2023-09-30T22:16:29.835697+0000","last_peered":"2023-09-30T22:16:29.835697+0000","last_clean":"2023-09-30T22:16:29.835697+0000","last_became_active":"2023-09-30T22:16:29.832651+0000","last_became_peered":"2023-09-30T22:16:29.832651+0000","last_unstale":"2023-09-30T22:16:29.835697+0000","last_undegraded":"2023-09-30T22:16:29.835697+0000","last_fullsized":"2023-09-30T22:16:29.835697+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.804809+0000","last_change":"2023-09-30T22:16:29.451667+0000","last_active":"2023-09-30T22:16:29.804809+0000","last_peered":"2023-09-30T22:16:29.804809+0000","last_clean":"2023-09-30T22:16:29.804809+0000","last_became_active":"2023-09-30T22:16:29.451422+0000","last_became_peered":"2023-09-30T22:16:29.451422+0000","last_unstale":"2023-09-30T22:16:29.804809+0000","last_undegraded":"2023-09-30T22:16:29.804809+0000","last_fullsized":"2023-09-30T22:16:29.804809+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.831417+0000","last_change":"2023-09-30T22:16:29.815304+0000","last_active":"2023-09-30T22:16:29.831417+0000","last_peered":"2023-09-30T22:16:29.831417+0000","last_clean":"2023-09-30T22:16:29.831417+0000","last_became_active":"2023-09-30T22:16:29.814885+0000","last_became_peered":"2023-09-30T22:16:29.814885+0000","last_unstale":"2023-09-30T22:16:29.831417+0000","last_undegraded":"2023-09-30T22:16:29.831417+0000","last_fullsized":"2023-09-30T22:16:29.831417+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.833324+0000","last_change":"2023-09-30T22:16:29.452814+0000","last_active":"2023-09-30T22:16:29.833324+0000","last_peered":"2023-09-30T22:16:29.833324+0000","last_clean":"2023-09-30T22:16:29.833324+0000","last_became_active":"2023-09-30T22:16:29.452404+0000","last_became_peered":"2023-09-30T22:16:29.452404+0000","last_unstale":"2023-09-30T22:16:29.833324+0000","last_undegraded":"2023-09-30T22:16:29.833324+0000","last_fullsized":"2023-09-30T22:16:29.833324+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828340+0000","last_change":"2023-09-30T22:16:29.825581+0000","last_active":"2023-09-30T22:16:29.828340+0000","last_peered":"2023-09-30T22:16:29.828340+0000","last_clean":"2023-09-30T22:16:29.828340+0000","last_became_active":"2023-09-30T22:16:29.822823+0000","last_became_peered":"2023-09-30T22:16:29.822823+0000","last_unstale":"2023-09-30T22:16:29.828340+0000","last_undegraded":"2023-09-30T22:16:29.828340+0000","last_fullsized":"2023-09-30T22:16:29.828340+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.808099+0000","last_change":"2023-09-30T22:16:29.447931+0000","last_active":"2023-09-30T22:16:29.808099+0000","last_peered":"2023-09-30T22:16:29.808099+0000","last_clean":"2023-09-30T22:16:29.808099+0000","last_became_active":"2023-09-30T22:16:29.447158+0000","last_became_peered":"2023-09-30T22:16:29.447158+0000","last_unstale":"2023-09-30T22:16:29.808099+0000","last_undegraded":"2023-09-30T22:16:29.808099+0000","last_fullsized":"2023-09-30T22:16:29.808099+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839723+0000","last_change":"2023-09-30T22:16:29.831438+0000","last_active":"2023-09-30T22:16:29.839723+0000","last_peered":"2023-09-30T22:16:29.839723+0000","last_clean":"2023-09-30T22:16:29.839723+0000","last_became_active":"2023-09-30T22:16:29.831158+0000","last_became_peered":"2023-09-30T22:16:29.831158+0000","last_unstale":"2023-09-30T22:16:29.839723+0000","last_undegraded":"2023-09-30T22:16:29.839723+0000","last_fullsized":"2023-09-30T22:16:29.839723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.810962+0000","last_change":"2023-09-30T22:16:29.449264+0000","last_active":"2023-09-30T22:16:29.810962+0000","last_peered":"2023-09-30T22:16:29.810962+0000","last_clean":"2023-09-30T22:16:29.810962+0000","last_became_active":"2023-09-30T22:16:29.448995+0000","last_became_peered":"2023-09-30T22:16:29.448995+0000","last_unstale":"2023-09-30T22:16:29.810962+0000","last_undegraded":"2023-09-30T22:16:29.810962+0000","last_fullsized":"2023-09-30T22:16:29.810962+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.835638+0000","last_change":"2023-09-30T22:16:29.832641+0000","last_active":"2023-09-30T22:16:29.835638+0000","last_peered":"2023-09-30T22:16:29.835638+0000","last_clean":"2023-09-30T22:16:29.835638+0000","last_became_active":"2023-09-30T22:16:29.832399+0000","last_became_peered":"2023-09-30T22:16:29.832399+0000","last_unstale":"2023-09-30T22:16:29.835638+0000","last_undegraded":"2023-09-30T22:16:29.835638+0000","last_fullsized":"2023-09-30T22:16:29.835638+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.813819+0000","last_change":"2023-09-30T22:16:29.451927+0000","last_active":"2023-09-30T22:16:29.813819+0000","last_peered":"2023-09-30T22:16:29.813819+0000","last_clean":"2023-09-30T22:16:29.813819+0000","last_became_active":"2023-09-30T22:16:29.449397+0000","last_became_peered":"2023-09-30T22:16:29.449397+0000","last_unstale":"2023-09-30T22:16:29.813819+0000","last_undegraded":"2023-09-30T22:16:29.813819+0000","last_fullsized":"2023-09-30T22:16:29.813819+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.838623+0000","last_change":"2023-09-30T22:16:29.829224+0000","last_active":"2023-09-30T22:16:29.838623+0000","last_peered":"2023-09-30T22:16:29.838623+0000","last_clean":"2023-09-30T22:16:29.838623+0000","last_became_active":"2023-09-30T22:16:29.828558+0000","last_became_peered":"2023-09-30T22:16:29.828558+0000","last_unstale":"2023-09-30T22:16:29.838623+0000","last_undegraded":"2023-09-30T22:16:29.838623+0000","last_fullsized":"2023-09-30T22:16:29.838623+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.801275+0000","last_change":"2023-09-30T22:16:25.780366+0000","last_active":"2023-09-30T22:16:29.801275+0000","last_peered":"2023-09-30T22:16:29.801275+0000","last_clean":"2023-09-30T22:16:29.801275+0000","last_became_active":"2023-09-30T22:16:25.780059+0000","last_became_peered":"2023-09-30T22:16:25.780059+0000","last_unstale":"2023-09-30T22:16:29.801275+0000","last_undegraded":"2023-09-30T22:16:29.801275+0000","last_fullsized":"2023-09-30T22:16:29.801275+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.799168+0000","last_change":"2023-09-30T22:16:29.448527+0000","last_active":"2023-09-30T22:16:29.799168+0000","last_peered":"2023-09-30T22:16:29.799168+0000","last_clean":"2023-09-30T22:16:29.799168+0000","last_became_active":"2023-09-30T22:16:29.448223+0000","last_became_peered":"2023-09-30T22:16:29.448223+0000","last_unstale":"2023-09-30T22:16:29.799168+0000","last_undegraded":"2023-09-30T22:16:29.799168+0000","last_fullsized":"2023-09-30T22:16:29.799168+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.829283+0000","last_change":"2023-09-30T22:16:29.827919+0000","last_active":"2023-09-30T22:16:29.829283+0000","last_peered":"2023-09-30T22:16:29.829283+0000","last_clean":"2023-09-30T22:16:29.829283+0000","last_became_active":"2023-09-30T22:16:29.827646+0000","last_became_peered":"2023-09-30T22:16:29.827646+0000","last_unstale":"2023-09-30T22:16:29.829283+0000","last_undegraded":"2023-09-30T22:16:29.829283+0000","last_fullsized":"2023-09-30T22:16:29.829283+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.808000+0000","last_change":"2023-09-30T22:16:25.414057+0000","last_active":"2023-09-30T22:16:29.808000+0000","last_peered":"2023-09-30T22:16:29.808000+0000","last_clean":"2023-09-30T22:16:29.808000+0000","last_became_active":"2023-09-30T22:16:25.413712+0000","last_became_peered":"2023-09-30T22:16:25.413712+0000","last_unstale":"2023-09-30T22:16:29.808000+0000","last_undegraded":"2023-09-30T22:16:29.808000+0000","last_fullsized":"2023-09-30T22:16:29.808000+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.804113+0000","last_change":"2023-09-30T22:16:29.446619+0000","last_active":"2023-09-30T22:16:29.804113+0000","last_peered":"2023-09-30T22:16:29.804113+0000","last_clean":"2023-09-30T22:16:29.804113+0000","last_became_active":"2023-09-30T22:16:29.446314+0000","last_became_peered":"2023-09-30T22:16:29.446314+0000","last_unstale":"2023-09-30T22:16:29.804113+0000","last_undegraded":"2023-09-30T22:16:29.804113+0000","last_fullsized":"2023-09-30T22:16:29.804113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839921+0000","last_change":"2023-09-30T22:16:29.835339+0000","last_active":"2023-09-30T22:16:29.839921+0000","last_peered":"2023-09-30T22:16:29.839921+0000","last_clean":"2023-09-30T22:16:29.839921+0000","last_became_active":"2023-09-30T22:16:29.833186+0000","last_became_peered":"2023-09-30T22:16:29.833186+0000","last_unstale":"2023-09-30T22:16:29.839921+0000","last_undegraded":"2023-09-30T22:16:29.839921+0000","last_fullsized":"2023-09-30T22:16:29.839921+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.798210+0000","last_change":"2023-09-30T22:16:25.416240+0000","last_active":"2023-09-30T22:16:29.798210+0000","last_peered":"2023-09-30T22:16:29.798210+0000","last_clean":"2023-09-30T22:16:29.798210+0000","last_became_active":"2023-09-30T22:16:25.415852+0000","last_became_peered":"2023-09-30T22:16:25.415852+0000","last_unstale":"2023-09-30T22:16:29.798210+0000","last_undegraded":"2023-09-30T22:16:29.798210+0000","last_fullsized":"2023-09-30T22:16:29.798210+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.798384+0000","last_change":"2023-09-30T22:16:29.449007+0000","last_active":"2023-09-30T22:16:29.798384+0000","last_peered":"2023-09-30T22:16:29.798384+0000","last_clean":"2023-09-30T22:16:29.798384+0000","last_became_active":"2023-09-30T22:16:29.448746+0000","last_became_peered":"2023-09-30T22:16:29.448746+0000","last_unstale":"2023-09-30T22:16:29.798384+0000","last_undegraded":"2023-09-30T22:16:29.798384+0000","last_fullsized":"2023-09-30T22:16:29.798384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.822579+0000","last_change":"2023-09-30T22:16:29.819140+0000","last_active":"2023-09-30T22:16:29.822579+0000","last_peered":"2023-09-30T22:16:29.822579+0000","last_clean":"2023-09-30T22:16:29.822579+0000","last_became_active":"2023-09-30T22:16:29.818875+0000","last_became_peered":"2023-09-30T22:16:29.818875+0000","last_unstale":"2023-09-30T22:16:29.822579+0000","last_undegraded":"2023-09-30T22:16:29.822579+0000","last_fullsized":"2023-09-30T22:16:29.822579+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.809554+0000","last_change":"2023-09-30T22:16:25.414050+0000","last_active":"2023-09-30T22:16:29.809554+0000","last_peered":"2023-09-30T22:16:29.809554+0000","last_clean":"2023-09-30T22:16:29.809554+0000","last_became_active":"2023-09-30T22:16:25.413709+0000","last_became_peered":"2023-09-30T22:16:25.413709+0000","last_unstale":"2023-09-30T22:16:29.809554+0000","last_undegraded":"2023-09-30T22:16:29.809554+0000","last_fullsized":"2023-09-30T22:16:29.809554+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.798287+0000","last_change":"2023-09-30T22:16:25.781137+0000","last_active":"2023-09-30T22:16:29.798287+0000","last_peered":"2023-09-30T22:16:29.798287+0000","last_clean":"2023-09-30T22:16:29.798287+0000","last_became_active":"2023-09-30T22:16:25.780923+0000","last_became_peered":"2023-09-30T22:16:25.780923+0000","last_unstale":"2023-09-30T22:16:29.798287+0000","last_undegraded":"2023-09-30T22:16:29.798287+0000","last_fullsized":"2023-09-30T22:16:29.798287+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.807854+0000","last_change":"2023-09-30T22:16:29.448514+0000","last_active":"2023-09-30T22:16:29.807854+0000","last_peered":"2023-09-30T22:16:29.807854+0000","last_clean":"2023-09-30T22:16:29.807854+0000","last_became_active":"2023-09-30T22:16:29.448270+0000","last_became_peered":"2023-09-30T22:16:29.448270+0000","last_unstale":"2023-09-30T22:16:29.807854+0000","last_undegraded":"2023-09-30T22:16:29.807854+0000","last_fullsized":"2023-09-30T22:16:29.807854+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839741+0000","last_change":"2023-09-30T22:16:29.831589+0000","last_active":"2023-09-30T22:16:29.839741+0000","last_peered":"2023-09-30T22:16:29.839741+0000","last_clean":"2023-09-30T22:16:29.839741+0000","last_became_active":"2023-09-30T22:16:29.831205+0000","last_became_peered":"2023-09-30T22:16:29.831205+0000","last_unstale":"2023-09-30T22:16:29.839741+0000","last_undegraded":"2023-09-30T22:16:29.839741+0000","last_fullsized":"2023-09-30T22:16:29.839741+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.814110+0000","last_change":"2023-09-30T22:16:25.416399+0000","last_active":"2023-09-30T22:16:29.814110+0000","last_peered":"2023-09-30T22:16:29.814110+0000","last_clean":"2023-09-30T22:16:29.814110+0000","last_became_active":"2023-09-30T22:16:25.416054+0000","last_became_peered":"2023-09-30T22:16:25.416054+0000","last_unstale":"2023-09-30T22:16:29.814110+0000","last_undegraded":"2023-09-30T22:16:29.814110+0000","last_fullsized":"2023-09-30T22:16:29.814110+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.803190+0000","last_change":"2023-09-30T22:16:29.450979+0000","last_active":"2023-09-30T22:16:29.803190+0000","last_peered":"2023-09-30T22:16:29.803190+0000","last_clean":"2023-09-30T22:16:29.803190+0000","last_became_active":"2023-09-30T22:16:29.450724+0000","last_became_peered":"2023-09-30T22:16:29.450724+0000","last_unstale":"2023-09-30T22:16:29.803190+0000","last_undegraded":"2023-09-30T22:16:29.803190+0000","last_fullsized":"2023-09-30T22:16:29.803190+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828390+0000","last_change":"2023-09-30T22:16:29.827233+0000","last_active":"2023-09-30T22:16:29.828390+0000","last_peered":"2023-09-30T22:16:29.828390+0000","last_clean":"2023-09-30T22:16:29.828390+0000","last_became_active":"2023-09-30T22:16:29.822966+0000","last_became_peered":"2023-09-30T22:16:29.822966+0000","last_unstale":"2023-09-30T22:16:29.828390+0000","last_undegraded":"2023-09-30T22:16:29.828390+0000","last_fullsized":"2023-09-30T22:16:29.828390+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.813696+0000","last_change":"2023-09-30T22:16:25.780298+0000","last_active":"2023-09-30T22:16:29.813696+0000","last_peered":"2023-09-30T22:16:29.813696+0000","last_clean":"2023-09-30T22:16:29.813696+0000","last_became_active":"2023-09-30T22:16:25.780022+0000","last_became_peered":"2023-09-30T22:16:25.780022+0000","last_unstale":"2023-09-30T22:16:29.813696+0000","last_undegraded":"2023-09-30T22:16:29.813696+0000","last_fullsized":"2023-09-30T22:16:29.813696+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.801091+0000","last_change":"2023-09-30T22:16:29.448428+0000","last_active":"2023-09-30T22:16:29.801091+0000","last_peered":"2023-09-30T22:16:29.801091+0000","last_clean":"2023-09-30T22:16:29.801091+0000","last_became_active":"2023-09-30T22:16:29.447613+0000","last_became_peered":"2023-09-30T22:16:29.447613+0000","last_unstale":"2023-09-30T22:16:29.801091+0000","last_undegraded":"2023-09-30T22:16:29.801091+0000","last_fullsized":"2023-09-30T22:16:29.801091+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.831435+0000","last_change":"2023-09-30T22:16:29.815447+0000","last_active":"2023-09-30T22:16:29.831435+0000","last_peered":"2023-09-30T22:16:29.831435+0000","last_clean":"2023-09-30T22:16:29.831435+0000","last_became_active":"2023-09-30T22:16:29.815169+0000","last_became_peered":"2023-09-30T22:16:29.815169+0000","last_unstale":"2023-09-30T22:16:29.831435+0000","last_undegraded":"2023-09-30T22:16:29.831435+0000","last_fullsized":"2023-09-30T22:16:29.831435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.837122+0000","last_change":"2023-09-30T22:16:29.448448+0000","last_active":"2023-09-30T22:16:29.837122+0000","last_peered":"2023-09-30T22:16:29.837122+0000","last_clean":"2023-09-30T22:16:29.837122+0000","last_became_active":"2023-09-30T22:16:29.448177+0000","last_became_peered":"2023-09-30T22:16:29.448177+0000","last_unstale":"2023-09-30T22:16:29.837122+0000","last_undegraded":"2023-09-30T22:16:29.837122+0000","last_fullsized":"2023-09-30T22:16:29.837122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.801487+0000","last_change":"2023-09-30T22:16:25.781178+0000","last_active":"2023-09-30T22:16:29.801487+0000","last_peered":"2023-09-30T22:16:29.801487+0000","last_clean":"2023-09-30T22:16:29.801487+0000","last_became_active":"2023-09-30T22:16:25.780121+0000","last_became_peered":"2023-09-30T22:16:25.780121+0000","last_unstale":"2023-09-30T22:16:29.801487+0000","last_undegraded":"2023-09-30T22:16:29.801487+0000","last_fullsized":"2023-09-30T22:16:29.801487+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839571+0000","last_change":"2023-09-30T22:16:29.830888+0000","last_active":"2023-09-30T22:16:29.839571+0000","last_peered":"2023-09-30T22:16:29.839571+0000","last_clean":"2023-09-30T22:16:29.839571+0000","last_became_active":"2023-09-30T22:16:29.830569+0000","last_became_peered":"2023-09-30T22:16:29.830569+0000","last_unstale":"2023-09-30T22:16:29.839571+0000","last_undegraded":"2023-09-30T22:16:29.839571+0000","last_fullsized":"2023-09-30T22:16:29.839571+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.809542+0000","last_change":"2023-09-30T22:16:25.780328+0000","last_active":"2023-09-30T22:16:29.809542+0000","last_peered":"2023-09-30T22:16:29.809542+0000","last_clean":"2023-09-30T22:16:29.809542+0000","last_became_active":"2023-09-30T22:16:25.780026+0000","last_became_peered":"2023-09-30T22:16:25.780026+0000","last_unstale":"2023-09-30T22:16:29.809542+0000","last_undegraded":"2023-09-30T22:16:29.809542+0000","last_fullsized":"2023-09-30T22:16:29.809542+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.807902+0000","last_change":"2023-09-30T22:16:29.444398+0000","last_active":"2023-09-30T22:16:29.807902+0000","last_peered":"2023-09-30T22:16:29.807902+0000","last_clean":"2023-09-30T22:16:29.807902+0000","last_became_active":"2023-09-30T22:16:29.444126+0000","last_became_peered":"2023-09-30T22:16:29.444126+0000","last_unstale":"2023-09-30T22:16:29.807902+0000","last_undegraded":"2023-09-30T22:16:29.807902+0000","last_fullsized":"2023-09-30T22:16:29.807902+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828900+0000","last_change":"2023-09-30T22:16:29.820636+0000","last_active":"2023-09-30T22:16:29.828900+0000","last_peered":"2023-09-30T22:16:29.828900+0000","last_clean":"2023-09-30T22:16:29.828900+0000","last_became_active":"2023-09-30T22:16:29.820372+0000","last_became_peered":"2023-09-30T22:16:29.820372+0000","last_unstale":"2023-09-30T22:16:29.828900+0000","last_undegraded":"2023-09-30T22:16:29.828900+0000","last_fullsized":"2023-09-30T22:16:29.828900+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.831903+0000","last_change":"2023-09-30T22:16:29.452715+0000","last_active":"2023-09-30T22:16:29.831903+0000","last_peered":"2023-09-30T22:16:29.831903+0000","last_clean":"2023-09-30T22:16:29.831903+0000","last_became_active":"2023-09-30T22:16:29.452405+0000","last_became_peered":"2023-09-30T22:16:29.452405+0000","last_unstale":"2023-09-30T22:16:29.831903+0000","last_undegraded":"2023-09-30T22:16:29.831903+0000","last_fullsized":"2023-09-30T22:16:29.831903+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.829507+0000","last_change":"2023-09-30T22:16:29.827280+0000","last_active":"2023-09-30T22:16:29.829507+0000","last_peered":"2023-09-30T22:16:29.829507+0000","last_clean":"2023-09-30T22:16:29.829507+0000","last_became_active":"2023-09-30T22:16:29.827006+0000","last_became_peered":"2023-09-30T22:16:29.827006+0000","last_unstale":"2023-09-30T22:16:29.829507+0000","last_undegraded":"2023-09-30T22:16:29.829507+0000","last_fullsized":"2023-09-30T22:16:29.829507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828875+0000","last_change":"2023-09-30T22:16:29.441940+0000","last_active":"2023-09-30T22:16:29.828875+0000","last_peered":"2023-09-30T22:16:29.828875+0000","last_clean":"2023-09-30T22:16:29.828875+0000","last_became_active":"2023-09-30T22:16:29.441296+0000","last_became_peered":"2023-09-30T22:16:29.441296+0000","last_unstale":"2023-09-30T22:16:29.828875+0000","last_undegraded":"2023-09-30T22:16:29.828875+0000","last_fullsized":"2023-09-30T22:16:29.828875+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828802+0000","last_change":"2023-09-30T22:16:29.824467+0000","last_active":"2023-09-30T22:16:29.828802+0000","last_peered":"2023-09-30T22:16:29.828802+0000","last_clean":"2023-09-30T22:16:29.828802+0000","last_became_active":"2023-09-30T22:16:29.824206+0000","last_became_peered":"2023-09-30T22:16:29.824206+0000","last_unstale":"2023-09-30T22:16:29.828802+0000","last_undegraded":"2023-09-30T22:16:29.828802+0000","last_fullsized":"2023-09-30T22:16:29.828802+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.832904+0000","last_change":"2023-09-30T22:16:29.446705+0000","last_active":"2023-09-30T22:16:29.832904+0000","last_peered":"2023-09-30T22:16:29.832904+0000","last_clean":"2023-09-30T22:16:29.832904+0000","last_became_active":"2023-09-30T22:16:29.446173+0000","last_became_peered":"2023-09-30T22:16:29.446173+0000","last_unstale":"2023-09-30T22:16:29.832904+0000","last_undegraded":"2023-09-30T22:16:29.832904+0000","last_fullsized":"2023-09-30T22:16:29.832904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.835674+0000","last_change":"2023-09-30T22:16:29.832880+0000","last_active":"2023-09-30T22:16:29.835674+0000","last_peered":"2023-09-30T22:16:29.835674+0000","last_clean":"2023-09-30T22:16:29.835674+0000","last_became_active":"2023-09-30T22:16:29.832321+0000","last_became_peered":"2023-09-30T22:16:29.832321+0000","last_unstale":"2023-09-30T22:16:29.835674+0000","last_undegraded":"2023-09-30T22:16:29.835674+0000","last_fullsized":"2023-09-30T22:16:29.835674+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.824980+0000","last_change":"2023-09-30T22:16:29.451645+0000","last_active":"2023-09-30T22:16:29.824980+0000","last_peered":"2023-09-30T22:16:29.824980+0000","last_clean":"2023-09-30T22:16:29.824980+0000","last_became_active":"2023-09-30T22:16:29.451283+0000","last_became_peered":"2023-09-30T22:16:29.451283+0000","last_unstale":"2023-09-30T22:16:29.824980+0000","last_undegraded":"2023-09-30T22:16:29.824980+0000","last_fullsized":"2023-09-30T22:16:29.824980+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.834482+0000","last_change":"2023-09-30T22:16:29.825999+0000","last_active":"2023-09-30T22:16:29.834482+0000","last_peered":"2023-09-30T22:16:29.834482+0000","last_clean":"2023-09-30T22:16:29.834482+0000","last_became_active":"2023-09-30T22:16:29.825211+0000","last_became_peered":"2023-09-30T22:16:29.825211+0000","last_unstale":"2023-09-30T22:16:29.834482+0000","last_undegraded":"2023-09-30T22:16:29.834482+0000","last_fullsized":"2023-09-30T22:16:29.834482+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.825934+0000","last_change":"2023-09-30T22:16:29.443167+0000","last_active":"2023-09-30T22:16:29.825934+0000","last_peered":"2023-09-30T22:16:29.825934+0000","last_clean":"2023-09-30T22:16:29.825934+0000","last_became_active":"2023-09-30T22:16:29.442895+0000","last_became_peered":"2023-09-30T22:16:29.442895+0000","last_unstale":"2023-09-30T22:16:29.825934+0000","last_undegraded":"2023-09-30T22:16:29.825934+0000","last_fullsized":"2023-09-30T22:16:29.825934+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.829174+0000","last_change":"2023-09-30T22:16:29.827232+0000","last_active":"2023-09-30T22:16:29.829174+0000","last_peered":"2023-09-30T22:16:29.829174+0000","last_clean":"2023-09-30T22:16:29.829174+0000","last_became_active":"2023-09-30T22:16:29.826971+0000","last_became_peered":"2023-09-30T22:16:29.826971+0000","last_unstale":"2023-09-30T22:16:29.829174+0000","last_undegraded":"2023-09-30T22:16:29.829174+0000","last_fullsized":"2023-09-30T22:16:29.829174+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839680+0000","last_change":"2023-09-30T22:16:29.833273+0000","last_active":"2023-09-30T22:16:29.839680+0000","last_peered":"2023-09-30T22:16:29.839680+0000","last_clean":"2023-09-30T22:16:29.839680+0000","last_became_active":"2023-09-30T22:16:29.832627+0000","last_became_peered":"2023-09-30T22:16:29.832627+0000","last_unstale":"2023-09-30T22:16:29.839680+0000","last_undegraded":"2023-09-30T22:16:29.839680+0000","last_fullsized":"2023-09-30T22:16:29.839680+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.840122+0000","last_change":"2023-09-30T22:16:29.834527+0000","last_active":"2023-09-30T22:16:29.840122+0000","last_peered":"2023-09-30T22:16:29.840122+0000","last_clean":"2023-09-30T22:16:29.840122+0000","last_became_active":"2023-09-30T22:16:29.830063+0000","last_became_peered":"2023-09-30T22:16:29.830063+0000","last_unstale":"2023-09-30T22:16:29.840122+0000","last_undegraded":"2023-09-30T22:16:29.840122+0000","last_fullsized":"2023-09-30T22:16:29.840122+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.826932+0000","last_change":"2023-09-30T22:16:29.821730+0000","last_active":"2023-09-30T22:16:29.826932+0000","last_peered":"2023-09-30T22:16:29.826932+0000","last_clean":"2023-09-30T22:16:29.826932+0000","last_became_active":"2023-09-30T22:16:29.821455+0000","last_became_peered":"2023-09-30T22:16:29.821455+0000","last_unstale":"2023-09-30T22:16:29.826932+0000","last_undegraded":"2023-09-30T22:16:29.826932+0000","last_fullsized":"2023-09-30T22:16:29.826932+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839638+0000","last_change":"2023-09-30T22:16:29.830760+0000","last_active":"2023-09-30T22:16:29.839638+0000","last_peered":"2023-09-30T22:16:29.839638+0000","last_clean":"2023-09-30T22:16:29.839638+0000","last_became_active":"2023-09-30T22:16:29.830307+0000","last_became_peered":"2023-09-30T22:16:29.830307+0000","last_unstale":"2023-09-30T22:16:29.839638+0000","last_undegraded":"2023-09-30T22:16:29.839638+0000","last_fullsized":"2023-09-30T22:16:29.839638+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839900+0000","last_change":"2023-09-30T22:16:29.835169+0000","last_active":"2023-09-30T22:16:29.839900+0000","last_peered":"2023-09-30T22:16:29.839900+0000","last_clean":"2023-09-30T22:16:29.839900+0000","last_became_active":"2023-09-30T22:16:29.832849+0000","last_became_peered":"2023-09-30T22:16:29.832849+0000","last_unstale":"2023-09-30T22:16:29.839900+0000","last_undegraded":"2023-09-30T22:16:29.839900+0000","last_fullsized":"2023-09-30T22:16:29.839900+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":46244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":46050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":44044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":45160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:16:37.659 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-30T22:16:37.660 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-30T22:16:37.660 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-30T22:16:37.660 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-30T22:16:37.660 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-09-30T22:16:37.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.809+0000 7f8eefdc2700 1 Processor -- start 2023-09-30T22:16:37.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.809+0000 7f8eefdc2700 1 -- start start 2023-09-30T22:16:37.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.810+0000 7f8eefdc2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ee8097aa0 0x7f8ee812c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:37.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.810+0000 7f8eefdc2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8ee812c840 0x7f8ee812ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:37.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.810+0000 7f8eefdc2700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee8068c10 con 0x7f8ee8092390 2023-09-30T22:16:37.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.810+0000 7f8eefdc2700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee8092770 con 0x7f8ee812c840 2023-09-30T22:16:37.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.810+0000 7f8eefdc2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee8097f20 con 0x7f8ee8097aa0 2023-09-30T22:16:37.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.810+0000 7f8eedb5e700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f8ee8092390 0x7f8ee8123a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37836/0 (socket says 172.21.15.156:37836) 2023-09-30T22:16:37.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.810+0000 7f8eedb5e700 1 -- 172.21.15.156:0/4044541144 learned_addr learned my addr 172.21.15.156:0/4044541144 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:37.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.810+0000 7f8eee35f700 1 --2- 172.21.15.156:0/4044541144 >> v2:172.21.15.156:3300/0 conn(0x7f8ee812c840 0x7f8ee812ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:37.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.810+0000 7f8eed35d700 1 --2- 172.21.15.156:0/4044541144 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ee8097aa0 0x7f8ee812c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:37.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.810+0000 7f8eee35f700 1 -- 172.21.15.156:0/4044541144 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ee8097aa0 msgr2=0x7f8ee812c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:37.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.810+0000 7f8eee35f700 1 --2- 172.21.15.156:0/4044541144 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ee8097aa0 0x7f8ee812c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:37.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.810+0000 7f8eee35f700 1 -- 172.21.15.156:0/4044541144 >> v1:172.21.15.156:6789/0 conn(0x7f8ee8092390 legacy=0x7f8ee8123a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:37.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.810+0000 7f8eee35f700 1 -- 172.21.15.156:0/4044541144 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee8124550 con 0x7f8ee812c840 2023-09-30T22:16:37.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.810+0000 7f8eecb5c700 1 -- 172.21.15.156:0/4044541144 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1259178652 0 0) 0x7f8ee8068c10 con 0x7f8ee8092390 2023-09-30T22:16:37.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.810+0000 7f8eed35d700 1 --2- 172.21.15.156:0/4044541144 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ee8097aa0 0x7f8ee812c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:16:37.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.810+0000 7f8eee35f700 1 --2- 172.21.15.156:0/4044541144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ee812c840 0x7f8ee812ec30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f8ee0009e90 tx=0x7f8ee0009780).ready entity=mon.0 client_cookie=9f394ac3d7d45786 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:37.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.811+0000 7f8eecb5c700 1 -- 172.21.15.156:0/4044541144 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee000e070 con 0x7f8ee812c840 2023-09-30T22:16:37.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.811+0000 7f8eecb5c700 1 -- 172.21.15.156:0/4044541144 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee000bbf0 con 0x7f8ee812c840 2023-09-30T22:16:37.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.811+0000 7f8eecb5c700 1 -- 172.21.15.156:0/4044541144 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee0012410 con 0x7f8ee812c840 2023-09-30T22:16:37.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.811+0000 7f8eefdc2700 1 -- 172.21.15.156:0/4044541144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ee812c840 msgr2=0x7f8ee812ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:37.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.811+0000 7f8eefdc2700 1 --2- 172.21.15.156:0/4044541144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ee812c840 0x7f8ee812ec30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f8ee0009e90 tx=0x7f8ee0009780).stop 2023-09-30T22:16:37.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.811+0000 7f8eefdc2700 1 -- 172.21.15.156:0/4044541144 shutdown_connections 2023-09-30T22:16:37.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.811+0000 7f8eefdc2700 1 --2- 172.21.15.156:0/4044541144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ee812c840 0x7f8ee812ec30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:37.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.811+0000 7f8eefdc2700 1 --2- 172.21.15.156:0/4044541144 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ee8097aa0 0x7f8ee812c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:37.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.811+0000 7f8eefdc2700 1 -- 172.21.15.156:0/4044541144 >> 172.21.15.156:0/4044541144 conn(0x7f8ee809a230 msgr2=0x7f8ee809a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:37.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.811+0000 7f8eefdc2700 1 -- 172.21.15.156:0/4044541144 shutdown_connections 2023-09-30T22:16:37.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.811+0000 7f8eefdc2700 1 -- 172.21.15.156:0/4044541144 wait complete. 2023-09-30T22:16:37.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.812+0000 7f8eefdc2700 1 Processor -- start 2023-09-30T22:16:37.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.812+0000 7f8eefdc2700 1 -- start start 2023-09-30T22:16:37.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.812+0000 7f8eefdc2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ee8092390 0x7f8ee8092a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:37.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.812+0000 7f8eefdc2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ee8097aa0 0x7f8ee8092f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:37.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.813+0000 7f8eefdc2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ee812c840 0x7f8ee8093430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:37.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.813+0000 7f8eefdc2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee8093920 con 0x7f8ee812c840 2023-09-30T22:16:37.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.813+0000 7f8eefdc2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee80697f0 con 0x7f8ee8097aa0 2023-09-30T22:16:37.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.813+0000 7f8eefdc2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee812c220 con 0x7f8ee8092390 2023-09-30T22:16:37.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.813+0000 7f8eee35f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ee812c840 0x7f8ee8093430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:37.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.813+0000 7f8eee35f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ee812c840 0x7f8ee8093430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36842/0 (socket says 172.21.15.156:36842) 2023-09-30T22:16:37.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.813+0000 7f8eed35d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ee8097aa0 0x7f8ee8092f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:37.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.813+0000 7f8eee35f700 1 -- 172.21.15.156:0/4099779173 learned_addr learned my addr 172.21.15.156:0/4099779173 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:37.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.813+0000 7f8eedb5e700 1 --2- 172.21.15.156:0/4099779173 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ee8092390 0x7f8ee8092a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:37.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.813+0000 7f8eed35d700 1 -- 172.21.15.156:0/4099779173 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ee8092390 msgr2=0x7f8ee8092a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:37.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.813+0000 7f8eed35d700 1 --2- 172.21.15.156:0/4099779173 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ee8092390 0x7f8ee8092a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:37.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.813+0000 7f8eed35d700 1 -- 172.21.15.156:0/4099779173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ee812c840 msgr2=0x7f8ee8093430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:37.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.813+0000 7f8eed35d700 1 --2- 172.21.15.156:0/4099779173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ee812c840 0x7f8ee8093430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:37.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.813+0000 7f8eed35d700 1 -- 172.21.15.156:0/4099779173 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee0009a20 con 0x7f8ee8097aa0 2023-09-30T22:16:37.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.813+0000 7f8eedb5e700 1 --2- 172.21.15.156:0/4099779173 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ee8092390 0x7f8ee8092a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:37.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.813+0000 7f8eee35f700 1 --2- 172.21.15.156:0/4099779173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ee812c840 0x7f8ee8093430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:37.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.813+0000 7f8eed35d700 1 --2- 172.21.15.156:0/4099779173 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ee8097aa0 0x7f8ee8092f40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f8ee400beb0 tx=0x7f8ee4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:37.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.813+0000 7f8eddffb700 1 -- 172.21.15.156:0/4099779173 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee40128c0 con 0x7f8ee8097aa0 2023-09-30T22:16:37.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.813+0000 7f8eddffb700 1 -- 172.21.15.156:0/4099779173 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee4012a20 con 0x7f8ee8097aa0 2023-09-30T22:16:37.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.813+0000 7f8eefdc2700 1 -- 172.21.15.156:0/4099779173 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee80954b0 con 0x7f8ee8097aa0 2023-09-30T22:16:37.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.813+0000 7f8eddffb700 1 -- 172.21.15.156:0/4099779173 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee4012da0 con 0x7f8ee8097aa0 2023-09-30T22:16:37.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.814+0000 7f8eefdc2700 1 -- 172.21.15.156:0/4099779173 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee812b860 con 0x7f8ee8097aa0 2023-09-30T22:16:37.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.815+0000 7f8eefdc2700 1 -- 172.21.15.156:0/4099779173 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee8094230 con 0x7f8ee8097aa0 2023-09-30T22:16:37.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.815+0000 7f8eddffb700 1 -- 172.21.15.156:0/4099779173 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f8ee4018070 con 0x7f8ee8097aa0 2023-09-30T22:16:37.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.815+0000 7f8eddffb700 1 -- 172.21.15.156:0/4099779173 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f8ee403eca0 con 0x7f8ee8097aa0 2023-09-30T22:16:37.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:37.819+0000 7f8eddffb700 1 -- 172.21.15.156:0/4099779173 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f8ee4018730 con 0x7f8ee8097aa0 2023-09-30T22:16:38.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.019+0000 7f8eefdc2700 1 -- 172.21.15.156:0/4099779173 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f8ee805a260 con 0x7f8ee8097aa0 2023-09-30T22:16:38.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.021+0000 7f8eddffb700 1 -- 172.21.15.156:0/4099779173 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+64134 (secure 0 0 0) 0x7f8ee402a090 con 0x7f8ee8097aa0 2023-09-30T22:16:38.022 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:38.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.023+0000 7f8eefdc2700 1 -- 172.21.15.156:0/4099779173 >> v1:172.21.15.156:6816/118236 conn(0x7f8ecc02bb60 legacy=0x7f8ecc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.023+0000 7f8eefdc2700 1 -- 172.21.15.156:0/4099779173 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ee8097aa0 msgr2=0x7f8ee8092f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.023+0000 7f8eefdc2700 1 --2- 172.21.15.156:0/4099779173 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ee8097aa0 0x7f8ee8092f40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f8ee400beb0 tx=0x7f8ee4008040).stop 2023-09-30T22:16:38.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.023+0000 7f8eefdc2700 1 -- 172.21.15.156:0/4099779173 shutdown_connections 2023-09-30T22:16:38.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.023+0000 7f8eefdc2700 1 --2- 172.21.15.156:0/4099779173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ee812c840 0x7f8ee8093430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.023+0000 7f8eefdc2700 1 --2- 172.21.15.156:0/4099779173 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ee8092390 0x7f8ee8092a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.023+0000 7f8eefdc2700 1 --2- 172.21.15.156:0/4099779173 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ee8097aa0 0x7f8ee8092f40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.023+0000 7f8eefdc2700 1 -- 172.21.15.156:0/4099779173 >> 172.21.15.156:0/4099779173 conn(0x7f8ee809a230 msgr2=0x7f8ee8126e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:38.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.023+0000 7f8eefdc2700 1 -- 172.21.15.156:0/4099779173 shutdown_connections 2023-09-30T22:16:38.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.023+0000 7f8eefdc2700 1 -- 172.21.15.156:0/4099779173 wait complete. 2023-09-30T22:16:38.035 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":4,"active_gid":4122,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6816","nonce":118236}]},"active_addr":"172.21.15.156:6816/118236","active_change":"2023-09-30T22:16:20.349113+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":2593263545}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":1464735255}]}]} 2023-09-30T22:16:38.037 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-30T22:16:38.037 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-30T22:16:38.037 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:16:38.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.152+0000 7f51f74c5700 1 Processor -- start 2023-09-30T22:16:38.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.153+0000 7f51f74c5700 1 -- start start 2023-09-30T22:16:38.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.153+0000 7f51f74c5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f51f005f560 0x7f51f012ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.153+0000 7f51f74c5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51f012b250 0x7f51f012b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.153+0000 7f51f74c5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f0097ac0 con 0x7f51f0095d90 2023-09-30T22:16:38.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.153+0000 7f51f74c5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f005f940 con 0x7f51f005f560 2023-09-30T22:16:38.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.153+0000 7f51f74c5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f012ab20 con 0x7f51f012b250 2023-09-30T22:16:38.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.153+0000 7f51f5261700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f51f005f560 0x7f51f012ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.153+0000 7f51f4a60700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51f012b250 0x7f51f012b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.153+0000 7f51f5a62700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f51f0095d90 0x7f51f0096220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37842/0 (socket says 172.21.15.156:37842) 2023-09-30T22:16:38.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.153+0000 7f51f5a62700 1 -- 172.21.15.156:0/2175922089 learned_addr learned my addr 172.21.15.156:0/2175922089 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:38.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.153+0000 7f51f4a60700 1 -- 172.21.15.156:0/2175922089 >> v2:172.21.15.156:3300/0 conn(0x7f51f005f560 msgr2=0x7f51f012ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:38.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.153+0000 7f51f4a60700 1 --2- 172.21.15.156:0/2175922089 >> v2:172.21.15.156:3300/0 conn(0x7f51f005f560 0x7f51f012ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.153+0000 7f51f4a60700 1 -- 172.21.15.156:0/2175922089 >> v1:172.21.15.156:6789/0 conn(0x7f51f0095d90 legacy=0x7f51f0096220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.153+0000 7f51e7fff700 1 -- 172.21.15.156:0/2175922089 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2379476719 0 0) 0x7f51f0097ac0 con 0x7f51f0095d90 2023-09-30T22:16:38.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.153+0000 7f51f4a60700 1 -- 172.21.15.156:0/2175922089 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f0066f90 con 0x7f51f012b250 2023-09-30T22:16:38.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.154+0000 7f51f5261700 1 --2- 172.21.15.156:0/2175922089 >> v2:172.21.15.156:3300/0 conn(0x7f51f005f560 0x7f51f012ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:38.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.154+0000 7f51f4a60700 1 --2- 172.21.15.156:0/2175922089 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51f012b250 0x7f51f012b650 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f51ec009790 tx=0x7f51ec009060).ready entity=mon.1 client_cookie=fe1d6647ffda3f9b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:38.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.154+0000 7f51e7fff700 1 -- 172.21.15.156:0/2175922089 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec00f510 con 0x7f51f012b250 2023-09-30T22:16:38.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.154+0000 7f51e7fff700 1 -- 172.21.15.156:0/2175922089 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec00f670 con 0x7f51f012b250 2023-09-30T22:16:38.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.154+0000 7f51e7fff700 1 -- 172.21.15.156:0/2175922089 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec00f9f0 con 0x7f51f012b250 2023-09-30T22:16:38.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.154+0000 7f51f74c5700 1 -- 172.21.15.156:0/2175922089 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51f012b250 msgr2=0x7f51f012b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.154+0000 7f51f74c5700 1 --2- 172.21.15.156:0/2175922089 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51f012b250 0x7f51f012b650 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f51ec009790 tx=0x7f51ec009060).stop 2023-09-30T22:16:38.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.154+0000 7f51f74c5700 1 -- 172.21.15.156:0/2175922089 shutdown_connections 2023-09-30T22:16:38.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.154+0000 7f51f74c5700 1 --2- 172.21.15.156:0/2175922089 >> v2:172.21.15.156:3300/0 conn(0x7f51f005f560 0x7f51f012ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.154+0000 7f51f74c5700 1 --2- 172.21.15.156:0/2175922089 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51f012b250 0x7f51f012b650 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.154+0000 7f51f74c5700 1 -- 172.21.15.156:0/2175922089 >> 172.21.15.156:0/2175922089 conn(0x7f51f009a1c0 msgr2=0x7f51f009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:38.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.154+0000 7f51f74c5700 1 -- 172.21.15.156:0/2175922089 shutdown_connections 2023-09-30T22:16:38.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.154+0000 7f51f74c5700 1 -- 172.21.15.156:0/2175922089 wait complete. 2023-09-30T22:16:38.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.155+0000 7f51f74c5700 1 Processor -- start 2023-09-30T22:16:38.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.155+0000 7f51f74c5700 1 -- start start 2023-09-30T22:16:38.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.156+0000 7f51f74c5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51f005f560 0x7f51f013a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.156+0000 7f51f74c5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51f0095d90 0x7f51f013aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.156+0000 7f51f74c5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f51f012b250 0x7f51f0113a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.156+0000 7f51f74c5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f012f2d0 con 0x7f51f0095d90 2023-09-30T22:16:38.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.156+0000 7f51f74c5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f0116f00 con 0x7f51f005f560 2023-09-30T22:16:38.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.156+0000 7f51f74c5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51f0129290 con 0x7f51f012b250 2023-09-30T22:16:38.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.156+0000 7f51f5261700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51f005f560 0x7f51f013a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.156+0000 7f51f5261700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51f005f560 0x7f51f013a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48066/0 (socket says 172.21.15.156:48066) 2023-09-30T22:16:38.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.156+0000 7f51f4a60700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51f0095d90 0x7f51f013aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.156+0000 7f51f5261700 1 -- 172.21.15.156:0/3332165037 learned_addr learned my addr 172.21.15.156:0/3332165037 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:38.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.156+0000 7f51f5a62700 1 --2- 172.21.15.156:0/3332165037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f51f012b250 0x7f51f0113a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.156+0000 7f51f4a60700 1 -- 172.21.15.156:0/3332165037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f51f012b250 msgr2=0x7f51f0113a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.156+0000 7f51f4a60700 1 --2- 172.21.15.156:0/3332165037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f51f012b250 0x7f51f0113a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.156+0000 7f51f4a60700 1 -- 172.21.15.156:0/3332165037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51f005f560 msgr2=0x7f51f013a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.156+0000 7f51f4a60700 1 --2- 172.21.15.156:0/3332165037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51f005f560 0x7f51f013a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.156+0000 7f51f4a60700 1 -- 172.21.15.156:0/3332165037 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e00092a0 con 0x7f51f0095d90 2023-09-30T22:16:38.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.156+0000 7f51f5261700 1 --2- 172.21.15.156:0/3332165037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51f005f560 0x7f51f013a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:38.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.156+0000 7f51f4a60700 1 --2- 172.21.15.156:0/3332165037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51f0095d90 0x7f51f013aa00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f51ec014000 tx=0x7f51ec017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:38.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.156+0000 7f51e57fa700 1 -- 172.21.15.156:0/3332165037 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec00f7e0 con 0x7f51f0095d90 2023-09-30T22:16:38.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.157+0000 7f51e57fa700 1 -- 172.21.15.156:0/3332165037 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec00f960 con 0x7f51f0095d90 2023-09-30T22:16:38.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.157+0000 7f51e57fa700 1 -- 172.21.15.156:0/3332165037 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec01c670 con 0x7f51f0095d90 2023-09-30T22:16:38.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.157+0000 7f51f74c5700 1 -- 172.21.15.156:0/3332165037 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ec0092a0 con 0x7f51f0095d90 2023-09-30T22:16:38.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.157+0000 7f51f74c5700 1 -- 172.21.15.156:0/3332165037 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f0116be0 con 0x7f51f0095d90 2023-09-30T22:16:38.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.157+0000 7f51e57fa700 1 -- 172.21.15.156:0/3332165037 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f51ec01ca60 con 0x7f51f0095d90 2023-09-30T22:16:38.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.157+0000 7f51e57fa700 1 -- 172.21.15.156:0/3332165037 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f51ec03cbe0 con 0x7f51f0095d90 2023-09-30T22:16:38.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.158+0000 7f51f74c5700 1 -- 172.21.15.156:0/3332165037 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f005a260 con 0x7f51f0095d90 2023-09-30T22:16:38.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.162+0000 7f51e57fa700 1 -- 172.21.15.156:0/3332165037 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f51ec02a080 con 0x7f51f0095d90 2023-09-30T22:16:38.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.320+0000 7f51f74c5700 1 -- 172.21.15.156:0/3332165037 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51f0117120 con 0x7f51f0095d90 2023-09-30T22:16:38.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.320+0000 7f51e57fa700 1 -- 172.21.15.156:0/3332165037 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11373 (secure 0 0 0) 0x7f51ec020020 con 0x7f51f0095d90 2023-09-30T22:16:38.321 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:38.321 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":16,"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","created":"2023-09-30T22:16:15.239992+0000","modified":"2023-09-30T22:16:30.794031+0000","last_up_change":"2023-09-30T22:16:23.392557+0000","last_in_change":"2023-09-30T22:16:16.474206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:16:23.433906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:16:24.367795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:16:28.204677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:16:28.762804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3ec2e78a-c61f-473a-bfcb-f956cffe4095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6812","nonce":118781}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6813","nonce":118781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6815","nonce":118781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6814","nonce":118781}]},"public_addr":"172.21.15.156:6812/118781","cluster_addr":"172.21.15.156:6813/118781","heartbeat_back_addr":"172.21.15.156:6815/118781","heartbeat_front_addr":"172.21.15.156:6814/118781","state":["exists","up"]},{"osd":1,"uuid":"b682e683-c15a-4bd9-8712-8af96454e9ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6803","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6805","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6807","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6806","nonce":118763}]},"public_addr":"172.21.15.156:6803/118763","cluster_addr":"172.21.15.156:6805/118763","heartbeat_back_addr":"172.21.15.156:6807/118763","heartbeat_front_addr":"172.21.15.156:6806/118763","state":["exists","up"]},{"osd":2,"uuid":"960dbaf0-2e0c-437e-9114-bc22ce522b26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6808","nonce":118788}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6809","nonce":118788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6811","nonce":118788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6810","nonce":118788}]},"public_addr":"172.21.15.156:6808/118788","cluster_addr":"172.21.15.156:6809/118788","heartbeat_back_addr":"172.21.15.156:6811/118788","heartbeat_front_addr":"172.21.15.156:6810/118788","state":["exists","up"]},{"osd":3,"uuid":"c1b19714-78b1-4869-8721-2f6352a64a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6800","nonce":118764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6801","nonce":118764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6804","nonce":118764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6802","nonce":118764}]},"public_addr":"172.21.15.156:6800/118764","cluster_addr":"172.21.15.156:6801/118764","heartbeat_back_addr":"172.21.15.156:6804/118764","heartbeat_front_addr":"172.21.15.156:6802/118764","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.663343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.827397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.806655+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.634746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:16:38.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.322+0000 7f51f74c5700 1 -- 172.21.15.156:0/3332165037 >> v1:172.21.15.156:6816/118236 conn(0x7f51d402bb60 legacy=0x7f51d402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.322+0000 7f51f74c5700 1 -- 172.21.15.156:0/3332165037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51f0095d90 msgr2=0x7f51f013aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.322+0000 7f51f74c5700 1 --2- 172.21.15.156:0/3332165037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51f0095d90 0x7f51f013aa00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f51ec014000 tx=0x7f51ec017000).stop 2023-09-30T22:16:38.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.322+0000 7f51f74c5700 1 -- 172.21.15.156:0/3332165037 shutdown_connections 2023-09-30T22:16:38.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.322+0000 7f51f74c5700 1 --2- 172.21.15.156:0/3332165037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f51f012b250 0x7f51f0113a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.322+0000 7f51f74c5700 1 --2- 172.21.15.156:0/3332165037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51f005f560 0x7f51f013a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.322+0000 7f51f74c5700 1 --2- 172.21.15.156:0/3332165037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51f0095d90 0x7f51f013aa00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.322+0000 7f51f74c5700 1 -- 172.21.15.156:0/3332165037 >> 172.21.15.156:0/3332165037 conn(0x7f51f009a1c0 msgr2=0x7f51f012e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:38.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.322+0000 7f51f74c5700 1 -- 172.21.15.156:0/3332165037 shutdown_connections 2023-09-30T22:16:38.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.322+0000 7f51f74c5700 1 -- 172.21.15.156:0/3332165037 wait complete. 2023-09-30T22:16:38.334 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-30T22:16:38.335 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:16:38.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.450+0000 7f18b03ba700 1 Processor -- start 2023-09-30T22:16:38.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.450+0000 7f18b03ba700 1 -- start start 2023-09-30T22:16:38.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.451+0000 7f18b03ba700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f18a812b470 0x7f18a812fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.451+0000 7f18b03ba700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18a8130390 0x7f18a8132780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.451+0000 7f18b03ba700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a8097ac0 con 0x7f18a805f560 2023-09-30T22:16:38.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.451+0000 7f18b03ba700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a805f940 con 0x7f18a812b470 2023-09-30T22:16:38.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.451+0000 7f18b03ba700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18a812ab20 con 0x7f18a8130390 2023-09-30T22:16:38.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.451+0000 7f18ae957700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18a8130390 0x7f18a8132780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.451+0000 7f18ad955700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f18a812b470 0x7f18a812fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.451+0000 7f18ae156700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f18a805f560 0x7f18a812ad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37850/0 (socket says 172.21.15.156:37850) 2023-09-30T22:16:38.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.451+0000 7f18ae957700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18a8130390 0x7f18a8132780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53044/0 (socket says 172.21.15.156:53044) 2023-09-30T22:16:38.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.451+0000 7f18ae156700 1 -- 172.21.15.156:0/3411369994 learned_addr learned my addr 172.21.15.156:0/3411369994 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:38.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.451+0000 7f18ae957700 1 -- 172.21.15.156:0/3411369994 >> v2:172.21.15.156:3300/0 conn(0x7f18a812b470 msgr2=0x7f18a812fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:38.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.451+0000 7f18ae957700 1 --2- 172.21.15.156:0/3411369994 >> v2:172.21.15.156:3300/0 conn(0x7f18a812b470 0x7f18a812fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.451+0000 7f18ae957700 1 -- 172.21.15.156:0/3411369994 >> v1:172.21.15.156:6789/0 conn(0x7f18a805f560 legacy=0x7f18a812ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.451+0000 7f18ae957700 1 -- 172.21.15.156:0/3411369994 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a8066f90 con 0x7f18a8130390 2023-09-30T22:16:38.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.451+0000 7f18ad154700 1 -- 172.21.15.156:0/3411369994 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400342852 0 0) 0x7f18a8097ac0 con 0x7f18a805f560 2023-09-30T22:16:38.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.451+0000 7f18ad955700 1 --2- 172.21.15.156:0/3411369994 >> v2:172.21.15.156:3300/0 conn(0x7f18a812b470 0x7f18a812fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:38.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.452+0000 7f18ae957700 1 --2- 172.21.15.156:0/3411369994 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18a8130390 0x7f18a8132780 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f18a0009e60 tx=0x7f18a0009780).ready entity=mon.2 client_cookie=2386351cf1f9d91f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:38.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.452+0000 7f18ad154700 1 -- 172.21.15.156:0/3411369994 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a000e070 con 0x7f18a8130390 2023-09-30T22:16:38.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.452+0000 7f18ad154700 1 -- 172.21.15.156:0/3411369994 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a000bb60 con 0x7f18a8130390 2023-09-30T22:16:38.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.452+0000 7f18ad154700 1 -- 172.21.15.156:0/3411369994 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a0012410 con 0x7f18a8130390 2023-09-30T22:16:38.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.452+0000 7f18b03ba700 1 -- 172.21.15.156:0/3411369994 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18a8130390 msgr2=0x7f18a8132780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.452+0000 7f18b03ba700 1 --2- 172.21.15.156:0/3411369994 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18a8130390 0x7f18a8132780 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f18a0009e60 tx=0x7f18a0009780).stop 2023-09-30T22:16:38.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.452+0000 7f18b03ba700 1 -- 172.21.15.156:0/3411369994 shutdown_connections 2023-09-30T22:16:38.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.452+0000 7f18b03ba700 1 --2- 172.21.15.156:0/3411369994 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18a8130390 0x7f18a8132780 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.452+0000 7f18b03ba700 1 --2- 172.21.15.156:0/3411369994 >> v2:172.21.15.156:3300/0 conn(0x7f18a812b470 0x7f18a812fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.452+0000 7f18b03ba700 1 -- 172.21.15.156:0/3411369994 >> 172.21.15.156:0/3411369994 conn(0x7f18a809a1c0 msgr2=0x7f18a809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:38.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.452+0000 7f18b03ba700 1 -- 172.21.15.156:0/3411369994 shutdown_connections 2023-09-30T22:16:38.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.452+0000 7f18b03ba700 1 -- 172.21.15.156:0/3411369994 wait complete. 2023-09-30T22:16:38.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.453+0000 7f18b03ba700 1 Processor -- start 2023-09-30T22:16:38.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.453+0000 7f18b03ba700 1 -- start start 2023-09-30T22:16:38.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.454+0000 7f18b03ba700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18a805f560 0x7f18a8113640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.454+0000 7f18b03ba700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18a812b470 0x7f18a8113b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.454+0000 7f18b03ba700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18a8130390 0x7f18a8114020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.454+0000 7f18b03ba700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a8114510 con 0x7f18a8130390 2023-09-30T22:16:38.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.454+0000 7f18b03ba700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a8117d50 con 0x7f18a805f560 2023-09-30T22:16:38.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.454+0000 7f18b03ba700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18a80671c0 con 0x7f18a812b470 2023-09-30T22:16:38.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.454+0000 7f18ae156700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18a805f560 0x7f18a8113640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.454+0000 7f18ae957700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18a8130390 0x7f18a8114020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.454+0000 7f18ae957700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18a8130390 0x7f18a8114020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36882/0 (socket says 172.21.15.156:36882) 2023-09-30T22:16:38.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.454+0000 7f18ae957700 1 -- 172.21.15.156:0/2000655736 learned_addr learned my addr 172.21.15.156:0/2000655736 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:38.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.454+0000 7f18ae156700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18a805f560 0x7f18a8113640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48080/0 (socket says 172.21.15.156:48080) 2023-09-30T22:16:38.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.454+0000 7f18ad955700 1 --2- 172.21.15.156:0/2000655736 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18a812b470 0x7f18a8113b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.454+0000 7f18ae957700 1 -- 172.21.15.156:0/2000655736 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18a812b470 msgr2=0x7f18a8113b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.454+0000 7f18ae957700 1 --2- 172.21.15.156:0/2000655736 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18a812b470 0x7f18a8113b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.454+0000 7f18ae957700 1 -- 172.21.15.156:0/2000655736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18a805f560 msgr2=0x7f18a8113640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.454+0000 7f18ae957700 1 --2- 172.21.15.156:0/2000655736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18a805f560 0x7f18a8113640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.454+0000 7f18ae957700 1 -- 172.21.15.156:0/2000655736 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a40092a0 con 0x7f18a8130390 2023-09-30T22:16:38.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.454+0000 7f18ae957700 1 --2- 172.21.15.156:0/2000655736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18a8130390 0x7f18a8114020 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f18a0011000 tx=0x7f18a8067f80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:38.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.454+0000 7f189e7fc700 1 -- 172.21.15.156:0/2000655736 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a0012410 con 0x7f18a8130390 2023-09-30T22:16:38.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.454+0000 7f189e7fc700 1 -- 172.21.15.156:0/2000655736 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a001d630 con 0x7f18a8130390 2023-09-30T22:16:38.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.454+0000 7f18b03ba700 1 -- 172.21.15.156:0/2000655736 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a0009a20 con 0x7f18a8130390 2023-09-30T22:16:38.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.454+0000 7f189e7fc700 1 -- 172.21.15.156:0/2000655736 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a001d9f0 con 0x7f18a8130390 2023-09-30T22:16:38.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.454+0000 7f18b03ba700 1 -- 172.21.15.156:0/2000655736 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a81168b0 con 0x7f18a8130390 2023-09-30T22:16:38.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.455+0000 7f189e7fc700 1 -- 172.21.15.156:0/2000655736 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f18a0003040 con 0x7f18a8130390 2023-09-30T22:16:38.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.455+0000 7f189e7fc700 1 -- 172.21.15.156:0/2000655736 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f18a003ccb0 con 0x7f18a8130390 2023-09-30T22:16:38.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.455+0000 7f18b03ba700 1 -- 172.21.15.156:0/2000655736 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a80666c0 con 0x7f18a8130390 2023-09-30T22:16:38.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.460+0000 7f189e7fc700 1 -- 172.21.15.156:0/2000655736 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f18a0025dc0 con 0x7f18a8130390 2023-09-30T22:16:38.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.618+0000 7f18b03ba700 1 -- 172.21.15.156:0/2000655736 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18a81170d0 con 0x7f18a8130390 2023-09-30T22:16:38.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.619+0000 7f189e7fc700 1 -- 172.21.15.156:0/2000655736 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11373 (secure 0 0 0) 0x7f18a0035090 con 0x7f18a8130390 2023-09-30T22:16:38.620 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:38.620 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":16,"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","created":"2023-09-30T22:16:15.239992+0000","modified":"2023-09-30T22:16:30.794031+0000","last_up_change":"2023-09-30T22:16:23.392557+0000","last_in_change":"2023-09-30T22:16:16.474206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:16:23.433906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:16:24.367795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:16:28.204677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:16:28.762804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3ec2e78a-c61f-473a-bfcb-f956cffe4095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6812","nonce":118781}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6813","nonce":118781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6815","nonce":118781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6814","nonce":118781}]},"public_addr":"172.21.15.156:6812/118781","cluster_addr":"172.21.15.156:6813/118781","heartbeat_back_addr":"172.21.15.156:6815/118781","heartbeat_front_addr":"172.21.15.156:6814/118781","state":["exists","up"]},{"osd":1,"uuid":"b682e683-c15a-4bd9-8712-8af96454e9ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6803","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6805","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6807","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6806","nonce":118763}]},"public_addr":"172.21.15.156:6803/118763","cluster_addr":"172.21.15.156:6805/118763","heartbeat_back_addr":"172.21.15.156:6807/118763","heartbeat_front_addr":"172.21.15.156:6806/118763","state":["exists","up"]},{"osd":2,"uuid":"960dbaf0-2e0c-437e-9114-bc22ce522b26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6808","nonce":118788}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6809","nonce":118788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6811","nonce":118788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6810","nonce":118788}]},"public_addr":"172.21.15.156:6808/118788","cluster_addr":"172.21.15.156:6809/118788","heartbeat_back_addr":"172.21.15.156:6811/118788","heartbeat_front_addr":"172.21.15.156:6810/118788","state":["exists","up"]},{"osd":3,"uuid":"c1b19714-78b1-4869-8721-2f6352a64a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6800","nonce":118764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6801","nonce":118764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6804","nonce":118764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6802","nonce":118764}]},"public_addr":"172.21.15.156:6800/118764","cluster_addr":"172.21.15.156:6801/118764","heartbeat_back_addr":"172.21.15.156:6804/118764","heartbeat_front_addr":"172.21.15.156:6802/118764","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.663343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.827397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.806655+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.634746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:16:38.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.621+0000 7f18b03ba700 1 -- 172.21.15.156:0/2000655736 >> v1:172.21.15.156:6816/118236 conn(0x7f188c02bb60 legacy=0x7f188c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.621+0000 7f18b03ba700 1 -- 172.21.15.156:0/2000655736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18a8130390 msgr2=0x7f18a8114020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.621+0000 7f18b03ba700 1 --2- 172.21.15.156:0/2000655736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18a8130390 0x7f18a8114020 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f18a0011000 tx=0x7f18a8067f80).stop 2023-09-30T22:16:38.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.621+0000 7f18b03ba700 1 -- 172.21.15.156:0/2000655736 shutdown_connections 2023-09-30T22:16:38.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.621+0000 7f18b03ba700 1 --2- 172.21.15.156:0/2000655736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18a8130390 0x7f18a8114020 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.621+0000 7f18b03ba700 1 --2- 172.21.15.156:0/2000655736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18a805f560 0x7f18a8113640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.621+0000 7f18b03ba700 1 --2- 172.21.15.156:0/2000655736 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18a812b470 0x7f18a8113b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.621+0000 7f18b03ba700 1 -- 172.21.15.156:0/2000655736 >> 172.21.15.156:0/2000655736 conn(0x7f18a809a1c0 msgr2=0x7f18a8099790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:38.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.621+0000 7f18b03ba700 1 -- 172.21.15.156:0/2000655736 shutdown_connections 2023-09-30T22:16:38.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.621+0000 7f18b03ba700 1 -- 172.21.15.156:0/2000655736 wait complete. 2023-09-30T22:16:38.633 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-30T22:16:38.634 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-30T22:16:38.634 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-30T22:16:38.635 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-09-30T22:16:38.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.759+0000 7fad409e9700 1 Processor -- start 2023-09-30T22:16:38.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.759+0000 7fad409e9700 1 -- start start 2023-09-30T22:16:38.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.760+0000 7fad409e9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad3c092390 0x7fad3c097aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.760+0000 7fad409e9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fad3c123a90 0x7fad3c123f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.760+0000 7fad409e9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad3c126fe0 0x7fad3c127490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.760+0000 7fad409e9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad3c092770 con 0x7fad3c123a90 2023-09-30T22:16:38.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.760+0000 7fad409e9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c069550 con 0x7fad3c092390 2023-09-30T22:16:38.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.760+0000 7fad409e9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c068c10 con 0x7fad3c126fe0 2023-09-30T22:16:38.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.760+0000 7fad39d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fad3c123a90 0x7fad3c123f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.760+0000 7fad3a59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad3c092390 0x7fad3c097aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.760+0000 7fad39d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fad3c123a90 0x7fad3c123f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36884/0 (socket says 172.21.15.156:36884) 2023-09-30T22:16:38.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.760+0000 7fad3a59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad3c092390 0x7fad3c097aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48096/0 (socket says 172.21.15.156:48096) 2023-09-30T22:16:38.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.760+0000 7fad39d9b700 1 -- 172.21.15.156:0/703155476 learned_addr learned my addr 172.21.15.156:0/703155476 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:38.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.760+0000 7fad39d9b700 1 -- 172.21.15.156:0/703155476 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad3c126fe0 msgr2=0x7fad3c127490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:38.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.760+0000 7fccf9921700 1 Processor -- start 2023-09-30T22:16:38.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.760+0000 7fccf9921700 1 -- start start 2023-09-30T22:16:38.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.761+0000 7fccf9921700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fccf4093950 0x7fccf4095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.761+0000 7fccf9921700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fccf4095c50 0x7fccf4096030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.761+0000 7fccf9921700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fccf412c240 0x7fccf412e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.761+0000 7fccf9921700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccf4094ba0 con 0x7fccf4093950 2023-09-30T22:16:38.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.761+0000 7fccf9921700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf4092e90 con 0x7fccf4095c50 2023-09-30T22:16:38.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.761+0000 7fccf9921700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccf4096b60 con 0x7fccf412c240 2023-09-30T22:16:38.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.760+0000 7fad3ad9d700 1 --2- 172.21.15.156:0/703155476 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad3c126fe0 0x7fad3c127490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.761+0000 7fad39d9b700 1 --2- 172.21.15.156:0/703155476 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad3c126fe0 0x7fad3c127490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.761+0000 7fad39d9b700 1 -- 172.21.15.156:0/703155476 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad3c092390 msgr2=0x7fad3c097aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:38.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.761+0000 7fad39d9b700 1 --2- 172.21.15.156:0/703155476 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad3c092390 0x7fad3c097aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.761+0000 7fad39d9b700 1 -- 172.21.15.156:0/703155476 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3c124550 con 0x7fad3c123a90 2023-09-30T22:16:38.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.761+0000 7fad3a59c700 1 --2- 172.21.15.156:0/703155476 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad3c092390 0x7fad3c097aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:38.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.761+0000 7fad3ad9d700 1 --2- 172.21.15.156:0/703155476 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad3c126fe0 0x7fad3c127490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:16:38.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.761+0000 7fccf2ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fccf4093950 0x7fccf4095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.761+0000 7fccf2ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fccf4093950 0x7fccf4095760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36888/0 (socket says 172.21.15.156:36888) 2023-09-30T22:16:38.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.761+0000 7fccf2ffd700 1 -- 172.21.15.156:0/1760710918 learned_addr learned my addr 172.21.15.156:0/1760710918 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:38.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.761+0000 7fccf37fe700 1 --2- 172.21.15.156:0/1760710918 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fccf412c240 0x7fccf412e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.761+0000 7fad39d9b700 1 --2- 172.21.15.156:0/703155476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad3c123a90 0x7fad3c123f10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fad30006fd0 tx=0x7fad300090f0).ready entity=mon.0 client_cookie=1ffe9c518997882d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:38.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.761+0000 7fccf27fc700 1 --2- 172.21.15.156:0/1760710918 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fccf4095c50 0x7fccf4096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.761+0000 7fccf2ffd700 1 -- 172.21.15.156:0/1760710918 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fccf412c240 msgr2=0x7fccf412e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:38.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.761+0000 7fccf2ffd700 1 --2- 172.21.15.156:0/1760710918 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fccf412c240 0x7fccf412e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.761+0000 7fccf2ffd700 1 -- 172.21.15.156:0/1760710918 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fccf4095c50 msgr2=0x7fccf4096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:38.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.761+0000 7fccf2ffd700 1 --2- 172.21.15.156:0/1760710918 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fccf4095c50 0x7fccf4096030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.761+0000 7fccf2ffd700 1 -- 172.21.15.156:0/1760710918 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf4093150 con 0x7fccf4093950 2023-09-30T22:16:38.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.761+0000 7fad3959a700 1 -- 172.21.15.156:0/703155476 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad30009790 con 0x7fad3c123a90 2023-09-30T22:16:38.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.761+0000 7fccf27fc700 1 --2- 172.21.15.156:0/1760710918 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fccf4095c50 0x7fccf4096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:16:38.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.762+0000 7fccf2ffd700 1 --2- 172.21.15.156:0/1760710918 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fccf4093950 0x7fccf4095760 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fcce400b8e0 tx=0x7fcce40090f0).ready entity=mon.0 client_cookie=a3a9bb08a9c81f06 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:38.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.762+0000 7fccf1ffb700 1 -- 172.21.15.156:0/1760710918 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce400c840 con 0x7fccf4093950 2023-09-30T22:16:38.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.762+0000 7fccf1ffb700 1 -- 172.21.15.156:0/1760710918 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce400c9a0 con 0x7fccf4093950 2023-09-30T22:16:38.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.762+0000 7fccf1ffb700 1 -- 172.21.15.156:0/1760710918 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce400cd20 con 0x7fccf4093950 2023-09-30T22:16:38.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.762+0000 7fad3959a700 1 -- 172.21.15.156:0/703155476 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad300098f0 con 0x7fad3c123a90 2023-09-30T22:16:38.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.762+0000 7fad3959a700 1 -- 172.21.15.156:0/703155476 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad30009c70 con 0x7fad3c123a90 2023-09-30T22:16:38.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.762+0000 7fad409e9700 1 -- 172.21.15.156:0/703155476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad3c123a90 msgr2=0x7fad3c123f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.762+0000 7fad409e9700 1 --2- 172.21.15.156:0/703155476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad3c123a90 0x7fad3c123f10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fad30006fd0 tx=0x7fad300090f0).stop 2023-09-30T22:16:38.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.762+0000 7fad409e9700 1 -- 172.21.15.156:0/703155476 shutdown_connections 2023-09-30T22:16:38.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.762+0000 7fad409e9700 1 --2- 172.21.15.156:0/703155476 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad3c126fe0 0x7fad3c127490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.762+0000 7fad409e9700 1 --2- 172.21.15.156:0/703155476 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad3c092390 0x7fad3c097aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.762+0000 7fad409e9700 1 --2- 172.21.15.156:0/703155476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad3c123a90 0x7fad3c123f10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.762+0000 7fad409e9700 1 -- 172.21.15.156:0/703155476 >> 172.21.15.156:0/703155476 conn(0x7fad3c09a230 msgr2=0x7fad3c09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:38.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.763+0000 7fad409e9700 1 -- 172.21.15.156:0/703155476 shutdown_connections 2023-09-30T22:16:38.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.763+0000 7fad409e9700 1 -- 172.21.15.156:0/703155476 wait complete. 2023-09-30T22:16:38.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.763+0000 7fccf9921700 1 -- 172.21.15.156:0/1760710918 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fccf4093950 msgr2=0x7fccf4095760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.763+0000 7fccf9921700 1 --2- 172.21.15.156:0/1760710918 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fccf4093950 0x7fccf4095760 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fcce400b8e0 tx=0x7fcce40090f0).stop 2023-09-30T22:16:38.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.763+0000 7fad409e9700 1 Processor -- start 2023-09-30T22:16:38.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.763+0000 7fad409e9700 1 -- start start 2023-09-30T22:16:38.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.764+0000 7fccf9921700 1 -- 172.21.15.156:0/1760710918 shutdown_connections 2023-09-30T22:16:38.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.764+0000 7fccf9921700 1 --2- 172.21.15.156:0/1760710918 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fccf412c240 0x7fccf412e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.764+0000 7fccf9921700 1 --2- 172.21.15.156:0/1760710918 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fccf4093950 0x7fccf4095760 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.764+0000 7fccf9921700 1 --2- 172.21.15.156:0/1760710918 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fccf4095c50 0x7fccf4096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.764+0000 7fccf9921700 1 -- 172.21.15.156:0/1760710918 >> 172.21.15.156:0/1760710918 conn(0x7fccf409aa50 msgr2=0x7fccf409ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:38.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.764+0000 7fad409e9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad3c092390 0x7fad3c113c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.764+0000 7fad409e9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad3c123a90 0x7fad3c114170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.764+0000 7fad409e9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad3c126fe0 0x7fad3c114660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.764+0000 7fad409e9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c1274f0 con 0x7fad3c126fe0 2023-09-30T22:16:38.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.764+0000 7fad409e9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c1179f0 con 0x7fad3c092390 2023-09-30T22:16:38.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.764+0000 7fad409e9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c118390 con 0x7fad3c123a90 2023-09-30T22:16:38.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.764+0000 7fad3ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad3c126fe0 0x7fad3c114660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.764+0000 7fad3ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad3c126fe0 0x7fad3c114660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36904/0 (socket says 172.21.15.156:36904) 2023-09-30T22:16:38.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.764+0000 7fad3ad9d700 1 -- 172.21.15.156:0/1041467969 learned_addr learned my addr 172.21.15.156:0/1041467969 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:38.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.764+0000 7fad39d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad3c123a90 0x7fad3c114170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.764+0000 7fad3ad9d700 1 -- 172.21.15.156:0/1041467969 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad3c123a90 msgr2=0x7fad3c114170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.764+0000 7fad3ad9d700 1 --2- 172.21.15.156:0/1041467969 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad3c123a90 0x7fad3c114170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.764+0000 7fad3ad9d700 1 -- 172.21.15.156:0/1041467969 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad3c092390 msgr2=0x7fad3c113c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.764+0000 7fad3ad9d700 1 --2- 172.21.15.156:0/1041467969 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad3c092390 0x7fad3c113c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:16:38.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.764+0000 7fad3ad9d700 1 -- 172.21.15.156:0/1041467969 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2c00c310 con 0x7fad3c126fe0 2023-09-30T22:16:38.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.765+0000 7fccf9921700 1 -- 172.21.15.156:0/1760710918 shutdown_connections 2023-09-30T22:16:38.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.765+0000 7fad3ad9d700 1 --2- 172.21.15.156:0/1041467969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad3c126fe0 0x7fad3c114660 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fad3400a380 tx=0x7fad34007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:38.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.765+0000 7fccf9921700 1 -- 172.21.15.156:0/1760710918 wait complete. 2023-09-30T22:16:38.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.765+0000 7fad2a7fc700 1 -- 172.21.15.156:0/1041467969 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad34016470 con 0x7fad3c126fe0 2023-09-30T22:16:38.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.765+0000 7fad2a7fc700 1 -- 172.21.15.156:0/1041467969 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad340165d0 con 0x7fad3c126fe0 2023-09-30T22:16:38.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.765+0000 7fad409e9700 1 -- 172.21.15.156:0/1041467969 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad3000d3f0 con 0x7fad3c126fe0 2023-09-30T22:16:38.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.765+0000 7fad409e9700 1 -- 172.21.15.156:0/1041467969 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad3c117e70 con 0x7fad3c126fe0 2023-09-30T22:16:38.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.765+0000 7fad2a7fc700 1 -- 172.21.15.156:0/1041467969 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad34016970 con 0x7fad3c126fe0 2023-09-30T22:16:38.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.766+0000 7fccf9921700 1 Processor -- start 2023-09-30T22:16:38.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.766+0000 7fccf9921700 1 -- start start 2023-09-30T22:16:38.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.766+0000 7fad2a7fc700 1 -- 172.21.15.156:0/1041467969 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fad34013070 con 0x7fad3c126fe0 2023-09-30T22:16:38.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.766+0000 7fad2a7fc700 1 -- 172.21.15.156:0/1041467969 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fad3403ba20 con 0x7fad3c126fe0 2023-09-30T22:16:38.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.767+0000 7fccf9921700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fccf4093950 0x7fccf4115eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.767+0000 7fccf9921700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fccf4095c50 0x7fccf41163a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.767+0000 7fccf9921700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fccf412c240 0x7fccf4116890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.767+0000 7fccf9921700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf4116d80 con 0x7fccf4095c50 2023-09-30T22:16:38.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.767+0000 7fccf9921700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf4117c50 con 0x7fccf4093950 2023-09-30T22:16:38.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.767+0000 7fccf9921700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccf4119440 con 0x7fccf412c240 2023-09-30T22:16:38.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.767+0000 7fccf2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fccf4093950 0x7fccf4115eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.767+0000 7fccf2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fccf4093950 0x7fccf4115eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48132/0 (socket says 172.21.15.156:48132) 2023-09-30T22:16:38.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.767+0000 7fccf2ffd700 1 -- 172.21.15.156:0/2097000788 learned_addr learned my addr 172.21.15.156:0/2097000788 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:38.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.767+0000 7fccf27fc700 1 --2- 172.21.15.156:0/2097000788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fccf4095c50 0x7fccf41163a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.767+0000 7fccf37fe700 1 --2- 172.21.15.156:0/2097000788 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fccf412c240 0x7fccf4116890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.767+0000 7fccf2ffd700 1 -- 172.21.15.156:0/2097000788 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fccf412c240 msgr2=0x7fccf4116890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.767+0000 7fccf2ffd700 1 --2- 172.21.15.156:0/2097000788 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fccf412c240 0x7fccf4116890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.767+0000 7fccf2ffd700 1 -- 172.21.15.156:0/2097000788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fccf4095c50 msgr2=0x7fccf41163a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.767+0000 7fccf2ffd700 1 --2- 172.21.15.156:0/2097000788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fccf4095c50 0x7fccf41163a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.767+0000 7fccf2ffd700 1 -- 172.21.15.156:0/2097000788 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce400b420 con 0x7fccf4093950 2023-09-30T22:16:38.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.767+0000 7fccf2ffd700 1 --2- 172.21.15.156:0/2097000788 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fccf4093950 0x7fccf4115eb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fcce4006fd0 tx=0x7fcce4017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:38.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.767+0000 7fccdaffd700 1 -- 172.21.15.156:0/2097000788 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce401e070 con 0x7fccf4093950 2023-09-30T22:16:38.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.768+0000 7fccdaffd700 1 -- 172.21.15.156:0/2097000788 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce400fb20 con 0x7fccf4093950 2023-09-30T22:16:38.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.768+0000 7fccf9921700 1 -- 172.21.15.156:0/2097000788 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf41172f0 con 0x7fccf4093950 2023-09-30T22:16:38.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.768+0000 7fccdaffd700 1 -- 172.21.15.156:0/2097000788 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce400fea0 con 0x7fccf4093950 2023-09-30T22:16:38.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.768+0000 7fccf9921700 1 -- 172.21.15.156:0/2097000788 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf4092490 con 0x7fccf4093950 2023-09-30T22:16:38.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.768+0000 7fccf9921700 1 -- 172.21.15.156:0/2097000788 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fccf40984b0 con 0x7fccf4093950 2023-09-30T22:16:38.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.769+0000 7fccdaffd700 1 -- 172.21.15.156:0/2097000788 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fcce4023670 con 0x7fccf4093950 2023-09-30T22:16:38.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.769+0000 7fad409e9700 1 -- 172.21.15.156:0/1041467969 --> v1:172.21.15.156:6808/118788 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fad200053b0 con 0x7fad200015c0 2023-09-30T22:16:38.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.769+0000 7fccdaffd700 1 -- 172.21.15.156:0/2097000788 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fcce403c4b0 con 0x7fccf4093950 2023-09-30T22:16:38.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.769+0000 7fccdaffd700 1 -- 172.21.15.156:0/2097000788 --> v1:172.21.15.156:6812/118781 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcce0038460 con 0x7fcce0034770 2023-09-30T22:16:38.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.769+0000 7fccdaffd700 1 -- 172.21.15.156:0/2097000788 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcce4018420 con 0x7fccf4093950 2023-09-30T22:16:38.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.769+0000 7f35587ac700 1 Processor -- start 2023-09-30T22:16:38.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.769+0000 7f35587ac700 1 -- start start 2023-09-30T22:16:38.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.770+0000 7f9a61f65700 1 Processor -- start 2023-09-30T22:16:38.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.770+0000 7fccdaffd700 1 -- 172.21.15.156:0/2097000788 <== osd.0 v1:172.21.15.156:6812/118781 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7fcce0038460 con 0x7fcce0034770 2023-09-30T22:16:38.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.770+0000 7f35587ac700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3550091200 0x7f35500915e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.770+0000 7f35587ac700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3550091ad0 0x7f355008ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.770+0000 7f35587ac700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3550091ef0 0x7f35500904d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.770+0000 7f35587ac700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35500935f0 con 0x7f3550091200 2023-09-30T22:16:38.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.770+0000 7f35587ac700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3550094190 con 0x7f3550091ad0 2023-09-30T22:16:38.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.770+0000 7f35587ac700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3550092a10 con 0x7f3550091ef0 2023-09-30T22:16:38.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.770+0000 7f3555d47700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3550091ad0 0x7f355008ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.770+0000 7f3556548700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3550091200 0x7f35500915e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.770+0000 7f3555d47700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3550091ad0 0x7f355008ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48140/0 (socket says 172.21.15.156:48140) 2023-09-30T22:16:38.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.770+0000 7f3556548700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3550091200 0x7f35500915e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36910/0 (socket says 172.21.15.156:36910) 2023-09-30T22:16:38.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.770+0000 7f3555d47700 1 -- 172.21.15.156:0/4049721932 learned_addr learned my addr 172.21.15.156:0/4049721932 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:38.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.770+0000 7f3556d49700 1 --2- 172.21.15.156:0/4049721932 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3550091ef0 0x7f35500904d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.771+0000 7f3556548700 1 -- 172.21.15.156:0/4049721932 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3550091ef0 msgr2=0x7f35500904d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:38.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.771+0000 7f3556548700 1 --2- 172.21.15.156:0/4049721932 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3550091ef0 0x7f35500904d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.771+0000 7f3556548700 1 -- 172.21.15.156:0/4049721932 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3550091ad0 msgr2=0x7f355008ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:38.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.771+0000 7f3556548700 1 --2- 172.21.15.156:0/4049721932 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3550091ad0 0x7f355008ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.771+0000 7f3556548700 1 -- 172.21.15.156:0/4049721932 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3550096490 con 0x7f3550091200 2023-09-30T22:16:38.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.771+0000 7f3555d47700 1 --2- 172.21.15.156:0/4049721932 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3550091ad0 0x7f355008ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:38.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.771+0000 7f3556548700 1 --2- 172.21.15.156:0/4049721932 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3550091200 0x7f35500915e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f354c006fd0 tx=0x7f354c006f40).ready entity=mon.0 client_cookie=8e53373ab95343f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:38.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.770+0000 7f9a61f65700 1 -- start start 2023-09-30T22:16:38.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.770+0000 7f9a61f65700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9a5c065380 0x7f9a5c0985e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.770+0000 7f9a61f65700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a5c098ad0 0x7f9a5c098ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.770+0000 7f9a61f65700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5c0661e0 con 0x7f9a5c133c80 2023-09-30T22:16:38.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.770+0000 7f9a61f65700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a5c065760 con 0x7f9a5c065380 2023-09-30T22:16:38.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.770+0000 7f9a61f65700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c097950 con 0x7f9a5c098ad0 2023-09-30T22:16:38.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.771+0000 7f9a5affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a5c098ad0 0x7f9a5c098ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.771+0000 7f9a5affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a5c098ad0 0x7f9a5c098ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48150/0 (socket says 172.21.15.156:48150) 2023-09-30T22:16:38.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.771+0000 7f9a5affd700 1 -- 172.21.15.156:0/3753091474 learned_addr learned my addr 172.21.15.156:0/3753091474 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:38.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.771+0000 7f3555546700 1 -- 172.21.15.156:0/4049721932 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c005880 con 0x7f3550091200 2023-09-30T22:16:38.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.771+0000 7f3555546700 1 -- 172.21.15.156:0/4049721932 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354c0059e0 con 0x7f3550091200 2023-09-30T22:16:38.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.771+0000 7f3555546700 1 -- 172.21.15.156:0/4049721932 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c005d60 con 0x7f3550091200 2023-09-30T22:16:38.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.771+0000 7f9a5a7fc700 1 -- 172.21.15.156:0/3753091474 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 753135041 0 0) 0x7f9a5c0661e0 con 0x7f9a5c133c80 2023-09-30T22:16:38.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.771+0000 7f9a5affd700 1 -- 172.21.15.156:0/3753091474 >> v2:172.21.15.156:3300/0 conn(0x7f9a5c065380 msgr2=0x7f9a5c0985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:38.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.771+0000 7f9a5affd700 1 --2- 172.21.15.156:0/3753091474 >> v2:172.21.15.156:3300/0 conn(0x7f9a5c065380 0x7f9a5c0985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:16:38.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.771+0000 7f9a5affd700 1 -- 172.21.15.156:0/3753091474 >> v1:172.21.15.156:6789/0 conn(0x7f9a5c133c80 legacy=0x7f9a5c136070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.771+0000 7f9a5affd700 1 -- 172.21.15.156:0/3753091474 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5c097f00 con 0x7f9a5c098ad0 2023-09-30T22:16:38.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.771+0000 7f9a5affd700 1 --2- 172.21.15.156:0/3753091474 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a5c098ad0 0x7f9a5c098ed0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f9a50006fd0 tx=0x7f9a500090f0).ready entity=mon.1 client_cookie=cf75f8e55685d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:38.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.772+0000 7fad2a7fc700 1 -- 172.21.15.156:0/1041467969 <== osd.2 v1:172.21.15.156:6808/118788 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7fad200053b0 con 0x7fad200015c0 2023-09-30T22:16:38.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.772+0000 7f9a5a7fc700 1 -- 172.21.15.156:0/3753091474 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5000b600 con 0x7f9a5c098ad0 2023-09-30T22:16:38.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.772+0000 7f9a5a7fc700 1 -- 172.21.15.156:0/3753091474 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5000b760 con 0x7f9a5c098ad0 2023-09-30T22:16:38.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.772+0000 7f9a5a7fc700 1 -- 172.21.15.156:0/3753091474 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5000bb00 con 0x7f9a5c098ad0 2023-09-30T22:16:38.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.772+0000 7f35587ac700 1 -- 172.21.15.156:0/4049721932 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3550091200 msgr2=0x7f35500915e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.772+0000 7f35587ac700 1 --2- 172.21.15.156:0/4049721932 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3550091200 0x7f35500915e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f354c006fd0 tx=0x7f354c006f40).stop 2023-09-30T22:16:38.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.772+0000 7f35587ac700 1 -- 172.21.15.156:0/4049721932 shutdown_connections 2023-09-30T22:16:38.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.772+0000 7f35587ac700 1 --2- 172.21.15.156:0/4049721932 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3550091ef0 0x7f35500904d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.772+0000 7f35587ac700 1 --2- 172.21.15.156:0/4049721932 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3550091200 0x7f35500915e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.772+0000 7f35587ac700 1 --2- 172.21.15.156:0/4049721932 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3550091ad0 0x7f355008ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.772+0000 7f35587ac700 1 -- 172.21.15.156:0/4049721932 >> 172.21.15.156:0/4049721932 conn(0x7f35500971d0 msgr2=0x7f3550099c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:38.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.772+0000 7f9a61f65700 1 -- 172.21.15.156:0/3753091474 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a5c098ad0 msgr2=0x7f9a5c098ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.772+0000 7f9a61f65700 1 --2- 172.21.15.156:0/3753091474 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a5c098ad0 0x7f9a5c098ed0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f9a50006fd0 tx=0x7f9a500090f0).stop 2023-09-30T22:16:38.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.772+0000 7f9a61f65700 1 -- 172.21.15.156:0/3753091474 shutdown_connections 2023-09-30T22:16:38.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.772+0000 7f9a61f65700 1 --2- 172.21.15.156:0/3753091474 >> v2:172.21.15.156:3300/0 conn(0x7f9a5c065380 0x7f9a5c0985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:16:38.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.772+0000 7f9a61f65700 1 --2- 172.21.15.156:0/3753091474 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a5c098ad0 0x7f9a5c098ed0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.772+0000 7f9a61f65700 1 -- 172.21.15.156:0/3753091474 >> 172.21.15.156:0/3753091474 conn(0x7f9a5c09dc40 msgr2=0x7f9a5c09e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:38.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.774+0000 7f35587ac700 1 -- 172.21.15.156:0/4049721932 shutdown_connections 2023-09-30T22:16:38.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.774+0000 7f35587ac700 1 -- 172.21.15.156:0/4049721932 wait complete. 2023-09-30T22:16:38.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.774+0000 7f35587ac700 1 Processor -- start 2023-09-30T22:16:38.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.774+0000 7f35587ac700 1 -- start start 2023-09-30T22:16:38.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.775+0000 7f35587ac700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3550091200 0x7f355013a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.775+0000 7f35587ac700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3550091ad0 0x7f355013a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.775+0000 7f35587ac700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3550091ef0 0x7f355013ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.775+0000 7f35587ac700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3550096280 con 0x7f3550091200 2023-09-30T22:16:38.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.775+0000 7f35587ac700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3550090d80 con 0x7f3550091ef0 2023-09-30T22:16:38.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.775+0000 7f35587ac700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f355008fc00 con 0x7f3550091ad0 2023-09-30T22:16:38.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.775+0000 7f3555d47700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3550091ad0 0x7f355013a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.775+0000 7f3556d49700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3550091ef0 0x7f355013ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.775+0000 7f3556d49700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3550091ef0 0x7f355013ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48158/0 (socket says 172.21.15.156:48158) 2023-09-30T22:16:38.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.775+0000 7f3555d47700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3550091ad0 0x7f355013a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53106/0 (socket says 172.21.15.156:53106) 2023-09-30T22:16:38.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.775+0000 7f3556d49700 1 -- 172.21.15.156:0/2591435427 learned_addr learned my addr 172.21.15.156:0/2591435427 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:38.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.775+0000 7f3556d49700 1 -- 172.21.15.156:0/2591435427 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3550091ad0 msgr2=0x7f355013a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.775+0000 7f3556d49700 1 --2- 172.21.15.156:0/2591435427 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3550091ad0 0x7f355013a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.775+0000 7f3556d49700 1 -- 172.21.15.156:0/2591435427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3550091200 msgr2=0x7f355013a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.775+0000 7f3556d49700 1 --2- 172.21.15.156:0/2591435427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3550091200 0x7f355013a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:16:38.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.775+0000 7f3556d49700 1 -- 172.21.15.156:0/2591435427 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3540009370 con 0x7f3550091ef0 2023-09-30T22:16:38.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.775+0000 7f3555d47700 1 --2- 172.21.15.156:0/2591435427 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3550091ad0 0x7f355013a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:38.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.776+0000 7f3556d49700 1 --2- 172.21.15.156:0/2591435427 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3550091ef0 0x7f355013ac40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3548009fa0 tx=0x7f3548009900).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:38.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.776+0000 7f35467fc700 1 -- 172.21.15.156:0/2591435427 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354800ec70 con 0x7f3550091ef0 2023-09-30T22:16:38.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.776+0000 7f35467fc700 1 -- 172.21.15.156:0/2591435427 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354800edd0 con 0x7f3550091ef0 2023-09-30T22:16:38.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.776+0000 7f35587ac700 1 -- 172.21.15.156:0/2591435427 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f354c009250 con 0x7f3550091ef0 2023-09-30T22:16:38.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.776+0000 7f35467fc700 1 -- 172.21.15.156:0/2591435427 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3548014610 con 0x7f3550091ef0 2023-09-30T22:16:38.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.776+0000 7f35587ac700 1 -- 172.21.15.156:0/2591435427 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3550090880 con 0x7f3550091ef0 2023-09-30T22:16:38.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.777+0000 7f35467fc700 1 -- 172.21.15.156:0/2591435427 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f354801d3b0 con 0x7f3550091ef0 2023-09-30T22:16:38.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.777+0000 7f9a61f65700 1 -- 172.21.15.156:0/3753091474 shutdown_connections 2023-09-30T22:16:38.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.777+0000 7f35587ac700 1 -- 172.21.15.156:0/2591435427 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f355005a260 con 0x7f3550091ef0 2023-09-30T22:16:38.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.777+0000 7f9a61f65700 1 -- 172.21.15.156:0/3753091474 wait complete. 2023-09-30T22:16:38.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.777+0000 7f35467fc700 1 -- 172.21.15.156:0/2591435427 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f354803b590 con 0x7f3550091ef0 2023-09-30T22:16:38.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.777+0000 7f35467fc700 1 -- 172.21.15.156:0/2591435427 --> v1:172.21.15.156:6800/118764 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3534038460 con 0x7f3534034770 2023-09-30T22:16:38.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.777+0000 7f35467fc700 1 -- 172.21.15.156:0/2591435427 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3548006000 con 0x7f3550091ef0 2023-09-30T22:16:38.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.778+0000 7f9a61f65700 1 Processor -- start 2023-09-30T22:16:38.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.778+0000 7f9a61f65700 1 -- start start 2023-09-30T22:16:38.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.778+0000 7f9a61f65700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9a5c065380 0x7f9a5c067770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.778+0000 7f9a61f65700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a5c098ad0 0x7f9a5c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.778+0000 7f9a61f65700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a5c133c80 0x7f9a5c068150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.778+0000 7f9a61f65700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c068640 con 0x7f9a5c133c80 2023-09-30T22:16:38.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.778+0000 7f9a61f65700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c09f5f0 con 0x7f9a5c098ad0 2023-09-30T22:16:38.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.778+0000 7f9a61f65700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c068be0 con 0x7f9a5c065380 2023-09-30T22:16:38.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.778+0000 7f9a5affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a5c098ad0 0x7f9a5c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.778+0000 7f9a5bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a5c133c80 0x7f9a5c068150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.778+0000 7f9a5affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a5c098ad0 0x7f9a5c067c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48164/0 (socket says 172.21.15.156:48164) 2023-09-30T22:16:38.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.778+0000 7f9a5bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a5c133c80 0x7f9a5c068150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36944/0 (socket says 172.21.15.156:36944) 2023-09-30T22:16:38.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.778+0000 7f9a5affd700 1 -- 172.21.15.156:0/370196563 learned_addr learned my addr 172.21.15.156:0/370196563 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:38.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.779+0000 7f9a5affd700 1 -- 172.21.15.156:0/370196563 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9a5c065380 msgr2=0x7f9a5c067770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.779+0000 7f9a5affd700 1 --2- 172.21.15.156:0/370196563 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9a5c065380 0x7f9a5c067770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:16:38.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.779+0000 7f9a5affd700 1 -- 172.21.15.156:0/370196563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a5c133c80 msgr2=0x7f9a5c068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.779+0000 7f9a5affd700 1 --2- 172.21.15.156:0/370196563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a5c133c80 0x7f9a5c068150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.779+0000 7f9a5affd700 1 -- 172.21.15.156:0/370196563 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a50009370 con 0x7f9a5c098ad0 2023-09-30T22:16:38.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.779+0000 7f9a5bfff700 1 --2- 172.21.15.156:0/370196563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a5c133c80 0x7f9a5c068150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:38.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.779+0000 7f9a5affd700 1 --2- 172.21.15.156:0/370196563 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a5c098ad0 0x7f9a5c067c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f9a50011fb0 tx=0x7f9a50017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:38.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.779+0000 7f9a437fe700 1 -- 172.21.15.156:0/370196563 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5000bec0 con 0x7f9a5c098ad0 2023-09-30T22:16:38.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.779+0000 7f9a437fe700 1 -- 172.21.15.156:0/370196563 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5000b8d0 con 0x7f9a5c098ad0 2023-09-30T22:16:38.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.779+0000 7f9a61f65700 1 -- 172.21.15.156:0/370196563 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a5c0698b0 con 0x7f9a5c098ad0 2023-09-30T22:16:38.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.779+0000 7f9a61f65700 1 -- 172.21.15.156:0/370196563 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a5c069af0 con 0x7f9a5c098ad0 2023-09-30T22:16:38.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.779+0000 7f9a437fe700 1 -- 172.21.15.156:0/370196563 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a50024470 con 0x7f9a5c098ad0 2023-09-30T22:16:38.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.780+0000 7f9a437fe700 1 -- 172.21.15.156:0/370196563 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f9a50021070 con 0x7f9a5c098ad0 2023-09-30T22:16:38.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.780+0000 7f9a61f65700 1 -- 172.21.15.156:0/370196563 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9a3c000fc0 con 0x7f9a5c098ad0 2023-09-30T22:16:38.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.780+0000 7f9a437fe700 1 -- 172.21.15.156:0/370196563 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f9a5003cc90 con 0x7f9a5c098ad0 2023-09-30T22:16:38.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.780+0000 7f9a437fe700 1 -- 172.21.15.156:0/370196563 --> v1:172.21.15.156:6803/118763 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a480384e0 con 0x7f9a480347f0 2023-09-30T22:16:38.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.781+0000 7f9a437fe700 1 -- 172.21.15.156:0/370196563 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a5001b410 con 0x7f9a5c098ad0 2023-09-30T22:16:38.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.782+0000 7f35467fc700 1 -- 172.21.15.156:0/2591435427 <== osd.3 v1:172.21.15.156:6800/118764 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f3534038460 con 0x7f3534034770 2023-09-30T22:16:38.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.782+0000 7f9a437fe700 1 -- 172.21.15.156:0/370196563 <== osd.1 v1:172.21.15.156:6803/118763 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f9a480384e0 con 0x7f9a480347f0 2023-09-30T22:16:38.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.788+0000 7fad409e9700 1 -- 172.21.15.156:0/1041467969 --> v1:172.21.15.156:6808/118788 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fad20006f20 con 0x7fad200015c0 2023-09-30T22:16:38.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.789+0000 7fad2a7fc700 1 -- 172.21.15.156:0/1041467969 <== osd.2 v1:172.21.15.156:6808/118788 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 3659784045) 0x7fad20006f20 con 0x7fad200015c0 2023-09-30T22:16:38.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.789+0000 7fad409e9700 1 -- 172.21.15.156:0/1041467969 >> v1:172.21.15.156:6808/118788 conn(0x7fad200015c0 legacy=0x7fad20003a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.789+0000 7fad409e9700 1 -- 172.21.15.156:0/1041467969 >> v1:172.21.15.156:6816/118236 conn(0x7fad1c02bb60 legacy=0x7fad1c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.789+0000 7fad409e9700 1 -- 172.21.15.156:0/1041467969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad3c126fe0 msgr2=0x7fad3c114660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.789+0000 7fad409e9700 1 --2- 172.21.15.156:0/1041467969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad3c126fe0 0x7fad3c114660 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fad3400a380 tx=0x7fad34007900).stop 2023-09-30T22:16:38.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.789+0000 7fad3ad9d700 1 -- 172.21.15.156:0/1041467969 reap_dead start 2023-09-30T22:16:38.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.793+0000 7fad409e9700 1 -- 172.21.15.156:0/1041467969 shutdown_connections 2023-09-30T22:16:38.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.793+0000 7fad409e9700 1 -- 172.21.15.156:0/1041467969 >> 172.21.15.156:0/1041467969 conn(0x7fad3c09a230 msgr2=0x7fad3c1227d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:38.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.794+0000 7fad409e9700 1 -- 172.21.15.156:0/1041467969 shutdown_connections 2023-09-30T22:16:38.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.794+0000 7fccf9921700 1 -- 172.21.15.156:0/2097000788 --> v1:172.21.15.156:6812/118781 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fccf4119940 con 0x7fcce0034770 2023-09-30T22:16:38.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.794+0000 7fad409e9700 1 -- 172.21.15.156:0/1041467969 wait complete. 2023-09-30T22:16:38.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.794+0000 7fccdaffd700 1 -- 172.21.15.156:0/2097000788 <== osd.0 v1:172.21.15.156:6812/118781 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7fccec013040 con 0x7fcce0034770 2023-09-30T22:16:38.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.794+0000 7fccf9921700 1 -- 172.21.15.156:0/2097000788 >> v1:172.21.15.156:6812/118781 conn(0x7fcce0034770 legacy=0x7fcce0036bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.795+0000 7fccf9921700 1 -- 172.21.15.156:0/2097000788 >> v1:172.21.15.156:6816/118236 conn(0x7fcce002bb60 legacy=0x7fcce002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.795+0000 7fccf9921700 1 -- 172.21.15.156:0/2097000788 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fccf4093950 msgr2=0x7fccf4115eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.795+0000 7fccf9921700 1 --2- 172.21.15.156:0/2097000788 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fccf4093950 0x7fccf4115eb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fcce4006fd0 tx=0x7fcce4017000).stop 2023-09-30T22:16:38.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.795+0000 7fccf37fe700 1 -- 172.21.15.156:0/2097000788 reap_dead start 2023-09-30T22:16:38.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.795+0000 7fccf9921700 1 -- 172.21.15.156:0/2097000788 shutdown_connections 2023-09-30T22:16:38.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.795+0000 7fccf9921700 1 -- 172.21.15.156:0/2097000788 >> 172.21.15.156:0/2097000788 conn(0x7fccf409aa50 msgr2=0x7fccf4098880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:38.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.796+0000 7fccf9921700 1 -- 172.21.15.156:0/2097000788 shutdown_connections 2023-09-30T22:16:38.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.796+0000 7fccf9921700 1 -- 172.21.15.156:0/2097000788 wait complete. 2023-09-30T22:16:38.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.797+0000 7f9a61f65700 1 -- 172.21.15.156:0/370196563 --> v1:172.21.15.156:6803/118763 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9a3c002b10 con 0x7f9a480347f0 2023-09-30T22:16:38.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.797+0000 7f9a437fe700 1 -- 172.21.15.156:0/370196563 <== osd.1 v1:172.21.15.156:6803/118763 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7f9a3c002b10 con 0x7f9a480347f0 2023-09-30T22:16:38.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.797+0000 7f9a61f65700 1 -- 172.21.15.156:0/370196563 >> v1:172.21.15.156:6803/118763 conn(0x7f9a480347f0 legacy=0x7f9a48036c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.798+0000 7f9a61f65700 1 -- 172.21.15.156:0/370196563 >> v1:172.21.15.156:6816/118236 conn(0x7f9a4802bb60 legacy=0x7f9a4802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.798+0000 7f9a61f65700 1 -- 172.21.15.156:0/370196563 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a5c098ad0 msgr2=0x7f9a5c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.798+0000 7f9a61f65700 1 --2- 172.21.15.156:0/370196563 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a5c098ad0 0x7f9a5c067c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f9a50011fb0 tx=0x7f9a50017000).stop 2023-09-30T22:16:38.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.798+0000 7f9a5bfff700 1 -- 172.21.15.156:0/370196563 reap_dead start 2023-09-30T22:16:38.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.798+0000 7f9a61f65700 1 -- 172.21.15.156:0/370196563 shutdown_connections 2023-09-30T22:16:38.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.798+0000 7f9a61f65700 1 -- 172.21.15.156:0/370196563 >> 172.21.15.156:0/370196563 conn(0x7f9a5c09dc40 msgr2=0x7f9a5c09c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:38.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.798+0000 7f9a61f65700 1 -- 172.21.15.156:0/370196563 shutdown_connections 2023-09-30T22:16:38.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.798+0000 7f9a61f65700 1 -- 172.21.15.156:0/370196563 wait complete. 2023-09-30T22:16:38.817 INFO:teuthology.orchestra.run.smithi156.stdout:38654705668 2023-09-30T22:16:38.818 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:16:38.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.808+0000 7f35587ac700 1 -- 172.21.15.156:0/2591435427 --> v1:172.21.15.156:6800/118764 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3550046c20 con 0x7f3534034770 2023-09-30T22:16:38.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.808+0000 7f35467fc700 1 -- 172.21.15.156:0/2591435427 <== osd.3 v1:172.21.15.156:6800/118764 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 3659784045) 0x7f3550046c20 con 0x7f3534034770 2023-09-30T22:16:38.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.808+0000 7f35587ac700 1 -- 172.21.15.156:0/2591435427 >> v1:172.21.15.156:6800/118764 conn(0x7f3534034770 legacy=0x7f3534036bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.808+0000 7f35587ac700 1 -- 172.21.15.156:0/2591435427 >> v1:172.21.15.156:6816/118236 conn(0x7f353402bb60 legacy=0x7f353402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.809+0000 7f35587ac700 1 -- 172.21.15.156:0/2591435427 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3550091ef0 msgr2=0x7f355013ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.809+0000 7f35587ac700 1 --2- 172.21.15.156:0/2591435427 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3550091ef0 0x7f355013ac40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3548009fa0 tx=0x7f3548009900).stop 2023-09-30T22:16:38.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.809+0000 7f3556d49700 1 -- 172.21.15.156:0/2591435427 reap_dead start 2023-09-30T22:16:38.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.809+0000 7f35587ac700 1 -- 172.21.15.156:0/2591435427 shutdown_connections 2023-09-30T22:16:38.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.809+0000 7f35587ac700 1 -- 172.21.15.156:0/2591435427 >> 172.21.15.156:0/2591435427 conn(0x7f35500971d0 msgr2=0x7f35500694c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:38.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.809+0000 7f35587ac700 1 -- 172.21.15.156:0/2591435427 shutdown_connections 2023-09-30T22:16:38.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.809+0000 7f35587ac700 1 -- 172.21.15.156:0/2591435427 wait complete. 2023-09-30T22:16:38.821 INFO:teuthology.orchestra.run.smithi156.stdout:38654705669 2023-09-30T22:16:38.821 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:16:38.822 INFO:teuthology.orchestra.run.smithi156.stdout:38654705669 2023-09-30T22:16:38.822 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:16:38.823 INFO:teuthology.orchestra.run.smithi156.stdout:38654705668 2023-09-30T22:16:38.823 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:16:38.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.989+0000 7f01e3610700 1 Processor -- start 2023-09-30T22:16:38.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.989+0000 7fe41d2e1700 1 Processor -- start 2023-09-30T22:16:38.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.990+0000 7f01e3610700 1 -- start start 2023-09-30T22:16:38.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.990+0000 7fe41d2e1700 1 -- start start 2023-09-30T22:16:38.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.990+0000 7fe41d2e1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe418092390 0x7fe418097aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.990+0000 7fe41d2e1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe418123a90 0x7fe418123f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.990+0000 7fe41d2e1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe418126fe0 0x7fe418127460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.990+0000 7fe41d2e1700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe418092770 con 0x7fe418126fe0 2023-09-30T22:16:38.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.990+0000 7fe41d2e1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe418069550 con 0x7fe418123a90 2023-09-30T22:16:38.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.990+0000 7fe41d2e1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe418068c10 con 0x7fe418092390 2023-09-30T22:16:38.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.990+0000 7f01e3610700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f01dc05f560 0x7f01dc128d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.990+0000 7f01e3610700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01dc068650 0x7f01dc129210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.990+0000 7f01e3610700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f01dc129700 0x7f01dc066e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:38.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.990+0000 7f01e3610700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01dc05f940 con 0x7f01dc129700 2023-09-30T22:16:38.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.990+0000 7f01e3610700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc097b70 con 0x7f01dc068650 2023-09-30T22:16:38.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.990+0000 7f01e3610700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc094130 con 0x7f01dc05f560 2023-09-30T22:16:38.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.990+0000 7f01e0bab700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01dc068650 0x7f01dc129210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.990+0000 7f01e1bad700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f01dc129700 0x7f01dc066e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.990+0000 7f01e0bab700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01dc068650 0x7f01dc129210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48176/0 (socket says 172.21.15.156:48176) 2023-09-30T22:16:38.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.990+0000 7f01e1bad700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f01dc129700 0x7f01dc066e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36958/0 (socket says 172.21.15.156:36958) 2023-09-30T22:16:38.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.990+0000 7f01e0bab700 1 -- 172.21.15.156:0/1163002865 learned_addr learned my addr 172.21.15.156:0/1163002865 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:38.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.991+0000 7f01e0bab700 1 -- 172.21.15.156:0/1163002865 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f01dc05f560 msgr2=0x7f01dc128d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:38.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.991+0000 7f01e0bab700 1 --2- 172.21.15.156:0/1163002865 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f01dc05f560 0x7f01dc128d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:16:38.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.991+0000 7f01e0bab700 1 -- 172.21.15.156:0/1163002865 >> v2:172.21.15.156:3300/0 conn(0x7f01dc129700 msgr2=0x7f01dc066e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:38.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.991+0000 7f01e0bab700 1 --2- 172.21.15.156:0/1163002865 >> v2:172.21.15.156:3300/0 conn(0x7f01dc129700 0x7f01dc066e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.991+0000 7f01e0bab700 1 -- 172.21.15.156:0/1163002865 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01dc069a50 con 0x7f01dc068650 2023-09-30T22:16:38.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.991+0000 7f01e1bad700 1 --2- 172.21.15.156:0/1163002865 >> v2:172.21.15.156:3300/0 conn(0x7f01dc129700 0x7f01dc066e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:38.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.991+0000 7f01e0bab700 1 --2- 172.21.15.156:0/1163002865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01dc068650 0x7f01dc129210 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f01cc006fd0 tx=0x7f01cc0090f0).ready entity=mon.1 client_cookie=7122f903998a81ce server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:38.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.991+0000 7f01d3fff700 1 -- 172.21.15.156:0/1163002865 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc00b580 con 0x7f01dc068650 2023-09-30T22:16:38.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.991+0000 7f01d3fff700 1 -- 172.21.15.156:0/1163002865 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01cc00b6e0 con 0x7f01dc068650 2023-09-30T22:16:38.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.991+0000 7f01d3fff700 1 -- 172.21.15.156:0/1163002865 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc00ba60 con 0x7f01dc068650 2023-09-30T22:16:38.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.991+0000 7fe4177fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe418126fe0 0x7fe418127460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.991+0000 7fe4177fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe418126fe0 0x7fe418127460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36972/0 (socket says 172.21.15.156:36972) 2023-09-30T22:16:38.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.991+0000 7fe4177fe700 1 -- 172.21.15.156:0/3774039043 learned_addr learned my addr 172.21.15.156:0/3774039043 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:38.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.991+0000 7fe416ffd700 1 --2- 172.21.15.156:0/3774039043 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe418092390 0x7fe418097aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.991+0000 7fe4167fc700 1 --2- 172.21.15.156:0/3774039043 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe418123a90 0x7fe418123f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:38.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.992+0000 7fe4177fe700 1 -- 172.21.15.156:0/3774039043 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe418092390 msgr2=0x7fe418097aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:38.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.992+0000 7fe4177fe700 1 --2- 172.21.15.156:0/3774039043 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe418092390 0x7fe418097aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.992+0000 7fe4177fe700 1 -- 172.21.15.156:0/3774039043 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe418123a90 msgr2=0x7fe418123f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:38.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.992+0000 7fe4177fe700 1 --2- 172.21.15.156:0/3774039043 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe418123a90 0x7fe418123f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.992+0000 7f01e3610700 1 -- 172.21.15.156:0/1163002865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01dc068650 msgr2=0x7f01dc129210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:38.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.992+0000 7fe4177fe700 1 -- 172.21.15.156:0/3774039043 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe418124550 con 0x7fe418126fe0 2023-09-30T22:16:38.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.992+0000 7f01e3610700 1 --2- 172.21.15.156:0/1163002865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01dc068650 0x7f01dc129210 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f01cc006fd0 tx=0x7f01cc0090f0).stop 2023-09-30T22:16:38.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.992+0000 7f01e3610700 1 -- 172.21.15.156:0/1163002865 shutdown_connections 2023-09-30T22:16:38.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.992+0000 7f01e3610700 1 --2- 172.21.15.156:0/1163002865 >> v2:172.21.15.156:3300/0 conn(0x7f01dc129700 0x7f01dc066e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.992+0000 7f01e3610700 1 --2- 172.21.15.156:0/1163002865 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f01dc05f560 0x7f01dc128d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:16:38.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.992+0000 7f01e3610700 1 --2- 172.21.15.156:0/1163002865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01dc068650 0x7f01dc129210 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:38.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.992+0000 7f01e3610700 1 -- 172.21.15.156:0/1163002865 >> 172.21.15.156:0/1163002865 conn(0x7f01dc09a230 msgr2=0x7f01dc09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:38.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.992+0000 7fe416ffd700 1 --2- 172.21.15.156:0/3774039043 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe418092390 0x7fe418097aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:38.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.992+0000 7fe4167fc700 1 --2- 172.21.15.156:0/3774039043 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe418123a90 0x7fe418123f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:16:38.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.992+0000 7f01e3610700 1 -- 172.21.15.156:0/1163002865 shutdown_connections 2023-09-30T22:16:39.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.992+0000 7fe4177fe700 1 --2- 172.21.15.156:0/3774039043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe418126fe0 0x7fe418127460 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fe41000c100 tx=0x7fe41000a950).ready entity=mon.0 client_cookie=48efc87d48e93c8b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:39.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.992+0000 7f01e3610700 1 -- 172.21.15.156:0/1163002865 wait complete. 2023-09-30T22:16:39.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.992+0000 7fe415ffb700 1 -- 172.21.15.156:0/3774039043 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41000f070 con 0x7fe418126fe0 2023-09-30T22:16:39.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.992+0000 7fe415ffb700 1 -- 172.21.15.156:0/3774039043 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41000a2e0 con 0x7fe418126fe0 2023-09-30T22:16:39.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.992+0000 7fe415ffb700 1 -- 172.21.15.156:0/3774039043 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41000cd30 con 0x7fe418126fe0 2023-09-30T22:16:39.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.993+0000 7f01e3610700 1 Processor -- start 2023-09-30T22:16:39.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.993+0000 7f01e3610700 1 -- start start 2023-09-30T22:16:39.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.993+0000 7fe41d2e1700 1 -- 172.21.15.156:0/3774039043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe418126fe0 msgr2=0x7fe418127460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:39.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.993+0000 7fe41d2e1700 1 --2- 172.21.15.156:0/3774039043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe418126fe0 0x7fe418127460 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fe41000c100 tx=0x7fe41000a950).stop 2023-09-30T22:16:39.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.993+0000 7f01e3610700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f01dc05f560 0x7f01dc13a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:39.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.993+0000 7f01e3610700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01dc068650 0x7f01dc13aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:39.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.993+0000 7f01e3610700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01dc129700 0x7f01dc0919b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:39.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.993+0000 7f01e3610700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc1182c0 con 0x7f01dc129700 2023-09-30T22:16:39.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.993+0000 7f01e3610700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc12d300 con 0x7f01dc068650 2023-09-30T22:16:39.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.993+0000 7f01e3610700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc099b20 con 0x7f01dc05f560 2023-09-30T22:16:39.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.994+0000 7f01e0bab700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01dc068650 0x7f01dc13aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:39.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.994+0000 7f01e13ac700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f01dc05f560 0x7f01dc13a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:39.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.994+0000 7f01e0bab700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01dc068650 0x7f01dc13aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48194/0 (socket says 172.21.15.156:48194) 2023-09-30T22:16:39.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.994+0000 7fe41d2e1700 1 -- 172.21.15.156:0/3774039043 shutdown_connections 2023-09-30T22:16:39.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.994+0000 7f01e0bab700 1 -- 172.21.15.156:0/23324022 learned_addr learned my addr 172.21.15.156:0/23324022 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:39.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.994+0000 7f01e1bad700 1 --2- 172.21.15.156:0/23324022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01dc129700 0x7f01dc0919b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:39.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.994+0000 7fe41d2e1700 1 --2- 172.21.15.156:0/3774039043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe418126fe0 0x7fe418127460 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:39.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.994+0000 7fe41d2e1700 1 --2- 172.21.15.156:0/3774039043 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe418092390 0x7fe418097aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:39.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.994+0000 7fe41d2e1700 1 --2- 172.21.15.156:0/3774039043 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe418123a90 0x7fe418123f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:39.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.994+0000 7fe41d2e1700 1 -- 172.21.15.156:0/3774039043 >> 172.21.15.156:0/3774039043 conn(0x7fe41809a230 msgr2=0x7fe41809a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:39.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.994+0000 7f01e0bab700 1 -- 172.21.15.156:0/23324022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f01dc05f560 msgr2=0x7f01dc13a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:39.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.994+0000 7f01e0bab700 1 --2- 172.21.15.156:0/23324022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f01dc05f560 0x7f01dc13a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:39.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.994+0000 7f01e0bab700 1 -- 172.21.15.156:0/23324022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01dc129700 msgr2=0x7f01dc0919b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:39.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.994+0000 7f01e0bab700 1 --2- 172.21.15.156:0/23324022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01dc129700 0x7f01dc0919b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:39.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.994+0000 7f01e0bab700 1 -- 172.21.15.156:0/23324022 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d4009a20 con 0x7f01dc068650 2023-09-30T22:16:39.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.994+0000 7f01e0bab700 1 --2- 172.21.15.156:0/23324022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01dc068650 0x7f01dc13aa50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f01cc009ea0 tx=0x7f01cc017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:39.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.994+0000 7fe41d2e1700 1 -- 172.21.15.156:0/3774039043 shutdown_connections 2023-09-30T22:16:39.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.994+0000 7fe41d2e1700 1 -- 172.21.15.156:0/3774039043 wait complete. 2023-09-30T22:16:39.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.994+0000 7f01d17fa700 1 -- 172.21.15.156:0/23324022 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc00b850 con 0x7f01dc068650 2023-09-30T22:16:39.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.994+0000 7f01d17fa700 1 -- 172.21.15.156:0/23324022 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01cc00b9b0 con 0x7f01dc068650 2023-09-30T22:16:39.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.994+0000 7f01e3610700 1 -- 172.21.15.156:0/23324022 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01cc009370 con 0x7f01dc068650 2023-09-30T22:16:39.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.994+0000 7f01d17fa700 1 -- 172.21.15.156:0/23324022 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc01c670 con 0x7f01dc068650 2023-09-30T22:16:39.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.994+0000 7f01e3610700 1 -- 172.21.15.156:0/23324022 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01dc119150 con 0x7f01dc068650 2023-09-30T22:16:39.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.995+0000 7f01d17fa700 1 -- 172.21.15.156:0/23324022 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f01cc01ca20 con 0x7f01dc068650 2023-09-30T22:16:39.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.996+0000 7f01d17fa700 1 -- 172.21.15.156:0/23324022 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f01cc03cd50 con 0x7f01dc068650 2023-09-30T22:16:39.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.996+0000 7fe41d2e1700 1 Processor -- start 2023-09-30T22:16:39.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.996+0000 7fe41d2e1700 1 -- start start 2023-09-30T22:16:39.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.996+0000 7f01e3610700 1 -- 172.21.15.156:0/23324022 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01bc005120 con 0x7f01dc068650 2023-09-30T22:16:39.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.996+0000 7fe41d2e1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe418092390 0x7fe418096900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:39.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.996+0000 7fe41d2e1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe418123a90 0x7fe418110890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:39.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.996+0000 7fe41d2e1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe418126fe0 0x7fe418110d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:39.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.996+0000 7fe41d2e1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4181181b0 con 0x7fe418126fe0 2023-09-30T22:16:39.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.996+0000 7fe41d2e1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe418069780 con 0x7fe418092390 2023-09-30T22:16:39.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.996+0000 7fe41d2e1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe418117030 con 0x7fe418123a90 2023-09-30T22:16:39.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.996+0000 7fe416ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe418092390 0x7fe418096900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:39.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.997+0000 7fe416ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe418092390 0x7fe418096900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48202/0 (socket says 172.21.15.156:48202) 2023-09-30T22:16:39.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.997+0000 7fe416ffd700 1 -- 172.21.15.156:0/3777944388 learned_addr learned my addr 172.21.15.156:0/3777944388 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:39.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.997+0000 7fe4167fc700 1 --2- 172.21.15.156:0/3777944388 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe418123a90 0x7fe418110890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:39.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.997+0000 7fe4177fe700 1 --2- 172.21.15.156:0/3777944388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe418126fe0 0x7fe418110d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:39.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.997+0000 7fe4167fc700 1 -- 172.21.15.156:0/3777944388 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe418092390 msgr2=0x7fe418096900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:39.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.997+0000 7fe4167fc700 1 --2- 172.21.15.156:0/3777944388 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe418092390 0x7fe418096900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:39.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.997+0000 7fe4167fc700 1 -- 172.21.15.156:0/3777944388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe418126fe0 msgr2=0x7fe418110d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:39.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.997+0000 7fe4167fc700 1 --2- 172.21.15.156:0/3777944388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe418126fe0 0x7fe418110d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:39.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.997+0000 7fe4167fc700 1 -- 172.21.15.156:0/3777944388 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4080092a0 con 0x7fe418123a90 2023-09-30T22:16:39.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.997+0000 7fe4177fe700 1 --2- 172.21.15.156:0/3777944388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe418126fe0 0x7fe418110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:39.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.997+0000 7fe416ffd700 1 --2- 172.21.15.156:0/3777944388 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe418092390 0x7fe418096900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:39.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.997+0000 7fe4167fc700 1 --2- 172.21.15.156:0/3777944388 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe418123a90 0x7fe418110890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fe418063990 tx=0x7fe40c008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:39.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.998+0000 7f378a268700 1 Processor -- start 2023-09-30T22:16:39.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.998+0000 7f378a268700 1 -- start start 2023-09-30T22:16:39.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.997+0000 7fe3feffd700 1 -- 172.21.15.156:0/3777944388 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c011590 con 0x7fe418123a90 2023-09-30T22:16:39.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.997+0000 7fe3feffd700 1 -- 172.21.15.156:0/3777944388 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c0116f0 con 0x7fe418123a90 2023-09-30T22:16:39.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.997+0000 7fe3feffd700 1 -- 172.21.15.156:0/3777944388 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c011a70 con 0x7fe418123a90 2023-09-30T22:16:39.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.998+0000 7fe41d2e1700 1 -- 172.21.15.156:0/3777944388 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41000abf0 con 0x7fe418123a90 2023-09-30T22:16:39.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.998+0000 7ffa7226c700 1 Processor -- start 2023-09-30T22:16:39.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.998+0000 7ffa7226c700 1 -- start start 2023-09-30T22:16:39.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.998+0000 7fe41d2e1700 1 -- 172.21.15.156:0/3777944388 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe418097960 con 0x7fe418123a90 2023-09-30T22:16:39.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7ffa7226c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffa6c096810 0x7ffa6c096bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:39.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7ffa7226c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffa6c0970e0 0x7ffa6c0974c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:39.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7ffa7226c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6c0982f0 con 0x7ffa6c0979b0 2023-09-30T22:16:39.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7ffa7226c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c068550 con 0x7ffa6c096810 2023-09-30T22:16:39.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7ffa7226c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c069e20 con 0x7ffa6c0970e0 2023-09-30T22:16:39.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7ffa6bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffa6c096810 0x7ffa6c096bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:39.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7ffa6bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffa6c096810 0x7ffa6c096bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48216/0 (socket says 172.21.15.156:48216) 2023-09-30T22:16:39.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7ffa6bfff700 1 -- 172.21.15.156:0/2369577325 learned_addr learned my addr 172.21.15.156:0/2369577325 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:39.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7f378a268700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3784093950 0x7f3784095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:39.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7f378a268700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3784095c50 0x7f3784096030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:39.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7f378a268700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f378412c240 0x7f378412e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:39.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7f378a268700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3784094ba0 con 0x7f378412c240 2023-09-30T22:16:39.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7f378a268700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3784092e90 con 0x7f3784095c50 2023-09-30T22:16:39.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7f378a268700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3784096b60 con 0x7f3784093950 2023-09-30T22:16:39.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7f37837fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3784095c50 0x7f3784096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:39.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7f3783fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3784093950 0x7f3784095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:39.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7f37837fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3784095c50 0x7f3784096030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48204/0 (socket says 172.21.15.156:48204) 2023-09-30T22:16:39.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7f37837fe700 1 -- 172.21.15.156:0/1262837272 learned_addr learned my addr 172.21.15.156:0/1262837272 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:39.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7f37837fe700 1 -- 172.21.15.156:0/1262837272 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3784093950 msgr2=0x7f3784095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:39.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7f37837fe700 1 --2- 172.21.15.156:0/1262837272 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3784093950 0x7f3784095760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:39.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7f37837fe700 1 -- 172.21.15.156:0/1262837272 >> v2:172.21.15.156:3300/0 conn(0x7f378412c240 msgr2=0x7f378412e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:39.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7f37837fe700 1 --2- 172.21.15.156:0/1262837272 >> v2:172.21.15.156:3300/0 conn(0x7f378412c240 0x7f378412e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:16:39.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7f37837fe700 1 -- 172.21.15.156:0/1262837272 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3784093150 con 0x7f3784095c50 2023-09-30T22:16:39.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7f37837fe700 1 --2- 172.21.15.156:0/1262837272 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3784095c50 0x7f3784096030 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f3778006fd0 tx=0x7f37780090f0).ready entity=mon.1 client_cookie=4c18faddc799312e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:39.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7ffa6bfff700 1 -- 172.21.15.156:0/2369577325 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffa6c0970e0 msgr2=0x7ffa6c0974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:39.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7ffa6bfff700 1 --2- 172.21.15.156:0/2369577325 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffa6c0970e0 0x7ffa6c0974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:16:39.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7ffa6bfff700 1 -- 172.21.15.156:0/2369577325 >> v1:172.21.15.156:6789/0 conn(0x7ffa6c0979b0 legacy=0x7ffa6c12f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:39.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7ffa6bfff700 1 -- 172.21.15.156:0/2369577325 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c068f60 con 0x7ffa6c096810 2023-09-30T22:16:39.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.000+0000 7ffa6bfff700 1 --2- 172.21.15.156:0/2369577325 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffa6c096810 0x7ffa6c096bf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ffa5c009830 tx=0x7ffa5c0090f0).ready entity=mon.1 client_cookie=3555e4ebdef9aa3a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:39.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:38.999+0000 7fe3feffd700 1 -- 172.21.15.156:0/3777944388 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fe40c012420 con 0x7fe418123a90 2023-09-30T22:16:39.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.000+0000 7fe3feffd700 1 -- 172.21.15.156:0/3777944388 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fe40c03a910 con 0x7fe418123a90 2023-09-30T22:16:39.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.000+0000 7fe41d2e1700 1 -- 172.21.15.156:0/3777944388 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe41805a260 con 0x7fe418123a90 2023-09-30T22:16:39.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.002+0000 7f3782ffd700 1 -- 172.21.15.156:0/1262837272 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377800b600 con 0x7f3784095c50 2023-09-30T22:16:39.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.002+0000 7f3782ffd700 1 -- 172.21.15.156:0/1262837272 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377800b760 con 0x7f3784095c50 2023-09-30T22:16:39.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.002+0000 7f3782ffd700 1 -- 172.21.15.156:0/1262837272 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377800bb00 con 0x7f3784095c50 2023-09-30T22:16:39.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.002+0000 7ffa6affd700 1 -- 172.21.15.156:0/2369577325 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c00b600 con 0x7ffa6c096810 2023-09-30T22:16:39.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.002+0000 7f01d17fa700 1 -- 172.21.15.156:0/23324022 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f01cc02a080 con 0x7f01dc068650 2023-09-30T22:16:39.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.002+0000 7ffa6affd700 1 -- 172.21.15.156:0/2369577325 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5c00b760 con 0x7ffa6c096810 2023-09-30T22:16:39.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.002+0000 7ffa6affd700 1 -- 172.21.15.156:0/2369577325 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c00bb00 con 0x7ffa6c096810 2023-09-30T22:16:39.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.003+0000 7f378a268700 1 -- 172.21.15.156:0/1262837272 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3784095c50 msgr2=0x7f3784096030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:39.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.003+0000 7f378a268700 1 --2- 172.21.15.156:0/1262837272 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3784095c50 0x7f3784096030 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f3778006fd0 tx=0x7f37780090f0).stop 2023-09-30T22:16:39.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.003+0000 7ffa7226c700 1 -- 172.21.15.156:0/2369577325 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffa6c096810 msgr2=0x7ffa6c096bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:39.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.003+0000 7ffa7226c700 1 --2- 172.21.15.156:0/2369577325 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffa6c096810 0x7ffa6c096bf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ffa5c009830 tx=0x7ffa5c0090f0).stop 2023-09-30T22:16:39.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.003+0000 7f378a268700 1 -- 172.21.15.156:0/1262837272 shutdown_connections 2023-09-30T22:16:39.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.003+0000 7f378a268700 1 --2- 172.21.15.156:0/1262837272 >> v2:172.21.15.156:3300/0 conn(0x7f378412c240 0x7f378412e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:16:39.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.003+0000 7f378a268700 1 --2- 172.21.15.156:0/1262837272 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3784093950 0x7f3784095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:39.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.003+0000 7f378a268700 1 --2- 172.21.15.156:0/1262837272 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3784095c50 0x7f3784096030 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:39.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.003+0000 7f378a268700 1 -- 172.21.15.156:0/1262837272 >> 172.21.15.156:0/1262837272 conn(0x7f378409aa50 msgr2=0x7f378409ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:39.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.003+0000 7ffa7226c700 1 -- 172.21.15.156:0/2369577325 shutdown_connections 2023-09-30T22:16:39.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.003+0000 7ffa7226c700 1 --2- 172.21.15.156:0/2369577325 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffa6c096810 0x7ffa6c096bf0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:39.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.003+0000 7ffa7226c700 1 --2- 172.21.15.156:0/2369577325 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffa6c0970e0 0x7ffa6c0974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:16:39.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.003+0000 7ffa7226c700 1 -- 172.21.15.156:0/2369577325 >> 172.21.15.156:0/2369577325 conn(0x7ffa6c09bad0 msgr2=0x7ffa6c09bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:39.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.003+0000 7ffa7226c700 1 -- 172.21.15.156:0/2369577325 shutdown_connections 2023-09-30T22:16:39.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.003+0000 7ffa7226c700 1 -- 172.21.15.156:0/2369577325 wait complete. 2023-09-30T22:16:39.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.004+0000 7f378a268700 1 -- 172.21.15.156:0/1262837272 shutdown_connections 2023-09-30T22:16:39.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.004+0000 7f378a268700 1 -- 172.21.15.156:0/1262837272 wait complete. 2023-09-30T22:16:39.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.004+0000 7ffa7226c700 1 Processor -- start 2023-09-30T22:16:39.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.004+0000 7ffa7226c700 1 -- start start 2023-09-30T22:16:39.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.004+0000 7f378a268700 1 Processor -- start 2023-09-30T22:16:39.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.005+0000 7f378a268700 1 -- start start 2023-09-30T22:16:39.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.005+0000 7ffa7226c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffa6c096810 0x7ffa6c118bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:39.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.005+0000 7ffa7226c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffa6c0970e0 0x7ffa6c1190e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:39.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.005+0000 7ffa7226c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa6c0979b0 0x7ffa6c1195d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:39.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.005+0000 7ffa7226c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c1189c0 con 0x7ffa6c0979b0 2023-09-30T22:16:39.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.005+0000 7ffa7226c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c06a040 con 0x7ffa6c0970e0 2023-09-30T22:16:39.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.005+0000 7ffa7226c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c091b80 con 0x7ffa6c096810 2023-09-30T22:16:39.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.005+0000 7f378a268700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3784093950 0x7f378412bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:39.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.005+0000 7f378a268700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3784095c50 0x7f3784115c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:39.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.005+0000 7f378a268700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f378412c240 0x7f3784116100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:39.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.005+0000 7f378a268700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378411a070 con 0x7f378412c240 2023-09-30T22:16:39.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.005+0000 7f378a268700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3784099730 con 0x7f3784095c50 2023-09-30T22:16:39.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.005+0000 7f378a268700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3784092410 con 0x7f3784093950 2023-09-30T22:16:39.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.005+0000 7f37837fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3784095c50 0x7f3784115c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:39.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.005+0000 7f37837fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3784095c50 0x7f3784115c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48236/0 (socket says 172.21.15.156:48236) 2023-09-30T22:16:39.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.005+0000 7f37837fe700 1 -- 172.21.15.156:0/2172029820 learned_addr learned my addr 172.21.15.156:0/2172029820 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:39.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.005+0000 7f3783fff700 1 --2- 172.21.15.156:0/2172029820 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3784093950 0x7f378412bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:39.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.005+0000 7f3788805700 1 --2- 172.21.15.156:0/2172029820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f378412c240 0x7f3784116100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:39.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.005+0000 7ffa6b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffa6c0970e0 0x7ffa6c1190e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:39.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.005+0000 7ffa6b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffa6c0970e0 0x7ffa6c1190e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48230/0 (socket says 172.21.15.156:48230) 2023-09-30T22:16:39.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.005+0000 7ffa6b7fe700 1 -- 172.21.15.156:0/1741633770 learned_addr learned my addr 172.21.15.156:0/1741633770 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:39.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.005+0000 7ffa70809700 1 --2- 172.21.15.156:0/1741633770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa6c0979b0 0x7ffa6c1195d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:39.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.006+0000 7ffa6bfff700 1 --2- 172.21.15.156:0/1741633770 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffa6c096810 0x7ffa6c118bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:39.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.006+0000 7f37837fe700 1 -- 172.21.15.156:0/2172029820 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3784093950 msgr2=0x7f378412bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:39.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.006+0000 7f37837fe700 1 --2- 172.21.15.156:0/2172029820 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3784093950 0x7f378412bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:39.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.006+0000 7f37837fe700 1 -- 172.21.15.156:0/2172029820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f378412c240 msgr2=0x7f3784116100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:39.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.006+0000 7f37837fe700 1 --2- 172.21.15.156:0/2172029820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f378412c240 0x7f3784116100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:39.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.006+0000 7f37837fe700 1 -- 172.21.15.156:0/2172029820 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3778009370 con 0x7f3784095c50 2023-09-30T22:16:39.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.006+0000 7f3783fff700 1 --2- 172.21.15.156:0/2172029820 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3784093950 0x7f378412bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:39.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.006+0000 7ffa6bfff700 1 -- 172.21.15.156:0/1741633770 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffa6c0970e0 msgr2=0x7ffa6c1190e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:39.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.006+0000 7ffa6bfff700 1 --2- 172.21.15.156:0/1741633770 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffa6c0970e0 0x7ffa6c1190e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:39.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.006+0000 7ffa6bfff700 1 -- 172.21.15.156:0/1741633770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa6c0979b0 msgr2=0x7ffa6c1195d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:39.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.006+0000 7ffa6bfff700 1 --2- 172.21.15.156:0/1741633770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa6c0979b0 0x7ffa6c1195d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:39.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.006+0000 7ffa6bfff700 1 -- 172.21.15.156:0/1741633770 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c009370 con 0x7ffa6c096810 2023-09-30T22:16:39.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.006+0000 7f37837fe700 1 --2- 172.21.15.156:0/2172029820 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3784095c50 0x7f3784115c10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f3778009f50 tx=0x7f3778017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:39.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.006+0000 7ffa6bfff700 1 --2- 172.21.15.156:0/1741633770 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffa6c096810 0x7ffa6c118bf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7ffa5c014000 tx=0x7ffa5c017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:39.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.006+0000 7f376bfff700 1 -- 172.21.15.156:0/2172029820 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3778006d90 con 0x7f3784095c50 2023-09-30T22:16:39.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.006+0000 7f376bfff700 1 -- 172.21.15.156:0/2172029820 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3778006950 con 0x7f3784095c50 2023-09-30T22:16:39.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.006+0000 7f376bfff700 1 -- 172.21.15.156:0/2172029820 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377800bb00 con 0x7f3784095c50 2023-09-30T22:16:39.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.006+0000 7f378a268700 1 -- 172.21.15.156:0/2172029820 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3784119cd0 con 0x7f3784095c50 2023-09-30T22:16:39.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.007+0000 7fe3feffd700 1 -- 172.21.15.156:0/3777944388 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fe40c0108d0 con 0x7fe418123a90 2023-09-30T22:16:39.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.007+0000 7f378a268700 1 -- 172.21.15.156:0/2172029820 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3784119170 con 0x7f3784095c50 2023-09-30T22:16:39.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.007+0000 7ffa53fff700 1 -- 172.21.15.156:0/1741633770 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c011b00 con 0x7ffa6c096810 2023-09-30T22:16:39.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.007+0000 7ffa53fff700 1 -- 172.21.15.156:0/1741633770 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5c011c80 con 0x7ffa6c096810 2023-09-30T22:16:39.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.007+0000 7ffa53fff700 1 -- 172.21.15.156:0/1741633770 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c01c420 con 0x7ffa6c096810 2023-09-30T22:16:39.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.008+0000 7f378a268700 1 -- 172.21.15.156:0/2172029820 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f378405a260 con 0x7f3784095c50 2023-09-30T22:16:39.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.009+0000 7f376bfff700 1 -- 172.21.15.156:0/2172029820 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3778021070 con 0x7f3784095c50 2023-09-30T22:16:39.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.009+0000 7f376bfff700 1 -- 172.21.15.156:0/2172029820 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f377803c620 con 0x7f3784095c50 2023-09-30T22:16:39.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.008+0000 7ffa7226c700 1 -- 172.21.15.156:0/1741633770 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa6c11ab70 con 0x7ffa6c096810 2023-09-30T22:16:39.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.008+0000 7ffa7226c700 1 -- 172.21.15.156:0/1741633770 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6c11c8f0 con 0x7ffa6c096810 2023-09-30T22:16:39.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.012+0000 7ffa53fff700 1 -- 172.21.15.156:0/1741633770 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7ffa5c01c810 con 0x7ffa6c096810 2023-09-30T22:16:39.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.012+0000 7ffa53fff700 1 -- 172.21.15.156:0/1741633770 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7ffa5c03c9f0 con 0x7ffa6c096810 2023-09-30T22:16:39.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.014+0000 7ffa7226c700 1 -- 172.21.15.156:0/1741633770 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6c11c8f0 con 0x7ffa6c096810 2023-09-30T22:16:39.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.017+0000 7f376bfff700 1 -- 172.21.15.156:0/2172029820 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f37780103a0 con 0x7f3784095c50 2023-09-30T22:16:39.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.022+0000 7ffa53fff700 1 -- 172.21.15.156:0/1741633770 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7ffa6c11c8f0 con 0x7ffa6c096810 2023-09-30T22:16:39.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.178+0000 7fe41d2e1700 1 -- 172.21.15.156:0/3777944388 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe418046c20 con 0x7fe418123a90 2023-09-30T22:16:39.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.178+0000 7fe3feffd700 1 -- 172.21.15.156:0/3777944388 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe40c0102e0 con 0x7fe418123a90 2023-09-30T22:16:39.179 INFO:teuthology.orchestra.run.smithi156.stdout:38654705667 2023-09-30T22:16:39.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.179+0000 7f01e3610700 1 -- 172.21.15.156:0/23324022 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f01bc0057f0 con 0x7f01dc068650 2023-09-30T22:16:39.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.179+0000 7f01d17fa700 1 -- 172.21.15.156:0/23324022 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f01cc020020 con 0x7f01dc068650 2023-09-30T22:16:39.180 INFO:teuthology.orchestra.run.smithi156.stdout:38654705667 2023-09-30T22:16:39.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.181+0000 7fe41d2e1700 1 -- 172.21.15.156:0/3777944388 >> v1:172.21.15.156:6816/118236 conn(0x7fe40402bb60 legacy=0x7fe40402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:39.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.181+0000 7fe41d2e1700 1 -- 172.21.15.156:0/3777944388 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe418123a90 msgr2=0x7fe418110890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:39.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.181+0000 7fe41d2e1700 1 --2- 172.21.15.156:0/3777944388 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe418123a90 0x7fe418110890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fe418063990 tx=0x7fe40c008040).stop 2023-09-30T22:16:39.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.181+0000 7fe41d2e1700 1 -- 172.21.15.156:0/3777944388 shutdown_connections 2023-09-30T22:16:39.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.181+0000 7fe41d2e1700 1 --2- 172.21.15.156:0/3777944388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe418126fe0 0x7fe418110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:39.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.181+0000 7fe41d2e1700 1 --2- 172.21.15.156:0/3777944388 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe418092390 0x7fe418096900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:39.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.181+0000 7fe41d2e1700 1 --2- 172.21.15.156:0/3777944388 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe418123a90 0x7fe418110890 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:39.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.181+0000 7fe41d2e1700 1 -- 172.21.15.156:0/3777944388 >> 172.21.15.156:0/3777944388 conn(0x7fe41809a230 msgr2=0x7fe418066cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:39.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.181+0000 7fe41d2e1700 1 -- 172.21.15.156:0/3777944388 shutdown_connections 2023-09-30T22:16:39.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.181+0000 7fe41d2e1700 1 -- 172.21.15.156:0/3777944388 wait complete. 2023-09-30T22:16:39.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.182+0000 7f01e3610700 1 -- 172.21.15.156:0/23324022 >> v1:172.21.15.156:6816/118236 conn(0x7f01c002bb60 legacy=0x7f01c002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:39.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.182+0000 7f01e3610700 1 -- 172.21.15.156:0/23324022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01dc068650 msgr2=0x7f01dc13aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:39.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.182+0000 7f01e3610700 1 --2- 172.21.15.156:0/23324022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01dc068650 0x7f01dc13aa50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f01cc009ea0 tx=0x7f01cc017000).stop 2023-09-30T22:16:39.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.182+0000 7f01e3610700 1 -- 172.21.15.156:0/23324022 shutdown_connections 2023-09-30T22:16:39.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.182+0000 7f01e3610700 1 --2- 172.21.15.156:0/23324022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01dc129700 0x7f01dc0919b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:39.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.182+0000 7f01e3610700 1 --2- 172.21.15.156:0/23324022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f01dc05f560 0x7f01dc13a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:39.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.182+0000 7f01e3610700 1 --2- 172.21.15.156:0/23324022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01dc068650 0x7f01dc13aa50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:39.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.182+0000 7f01e3610700 1 -- 172.21.15.156:0/23324022 >> 172.21.15.156:0/23324022 conn(0x7f01dc09a230 msgr2=0x7f01dc12bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:39.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.182+0000 7f01e3610700 1 -- 172.21.15.156:0/23324022 shutdown_connections 2023-09-30T22:16:39.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.182+0000 7f01e3610700 1 -- 172.21.15.156:0/23324022 wait complete. 2023-09-30T22:16:39.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.187+0000 7f378a268700 1 -- 172.21.15.156:0/2172029820 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3784119cd0 con 0x7f3784095c50 2023-09-30T22:16:39.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.187+0000 7f376bfff700 1 -- 172.21.15.156:0/2172029820 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3784119cd0 con 0x7f3784095c50 2023-09-30T22:16:39.188 INFO:teuthology.orchestra.run.smithi156.stdout:38654705667 2023-09-30T22:16:39.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.189+0000 7f378a268700 1 -- 172.21.15.156:0/2172029820 >> v1:172.21.15.156:6816/118236 conn(0x7f377002bb60 legacy=0x7f377002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:39.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.189+0000 7f378a268700 1 -- 172.21.15.156:0/2172029820 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3784095c50 msgr2=0x7f3784115c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:39.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.189+0000 7f378a268700 1 --2- 172.21.15.156:0/2172029820 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3784095c50 0x7f3784115c10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f3778009f50 tx=0x7f3778017000).stop 2023-09-30T22:16:39.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.189+0000 7f378a268700 1 -- 172.21.15.156:0/2172029820 shutdown_connections 2023-09-30T22:16:39.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.189+0000 7f378a268700 1 --2- 172.21.15.156:0/2172029820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f378412c240 0x7f3784116100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:39.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.189+0000 7f378a268700 1 --2- 172.21.15.156:0/2172029820 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3784093950 0x7f378412bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:39.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.189+0000 7f378a268700 1 --2- 172.21.15.156:0/2172029820 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3784095c50 0x7f3784115c10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:39.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.190+0000 7f378a268700 1 -- 172.21.15.156:0/2172029820 >> 172.21.15.156:0/2172029820 conn(0x7f378409aa50 msgr2=0x7f3784062b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:39.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.190+0000 7f378a268700 1 -- 172.21.15.156:0/2172029820 shutdown_connections 2023-09-30T22:16:39.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.190+0000 7f378a268700 1 -- 172.21.15.156:0/2172029820 wait complete. 2023-09-30T22:16:39.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.191+0000 7ffa7226c700 1 -- 172.21.15.156:0/1741633770 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffa6c11bfb0 con 0x7ffa6c096810 2023-09-30T22:16:39.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.192+0000 7ffa53fff700 1 -- 172.21.15.156:0/1741633770 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffa6c11bfb0 con 0x7ffa6c096810 2023-09-30T22:16:39.192 INFO:teuthology.orchestra.run.smithi156.stdout:38654705667 2023-09-30T22:16:39.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.195+0000 7ffa7226c700 1 -- 172.21.15.156:0/1741633770 >> v1:172.21.15.156:6816/118236 conn(0x7ffa5802bb60 legacy=0x7ffa5802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:39.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.195+0000 7ffa7226c700 1 -- 172.21.15.156:0/1741633770 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffa6c096810 msgr2=0x7ffa6c118bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:39.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.195+0000 7ffa7226c700 1 --2- 172.21.15.156:0/1741633770 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffa6c096810 0x7ffa6c118bf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7ffa5c014000 tx=0x7ffa5c017000).stop 2023-09-30T22:16:39.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.195+0000 7ffa7226c700 1 -- 172.21.15.156:0/1741633770 shutdown_connections 2023-09-30T22:16:39.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.195+0000 7ffa7226c700 1 --2- 172.21.15.156:0/1741633770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa6c0979b0 0x7ffa6c1195d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:39.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.195+0000 7ffa7226c700 1 --2- 172.21.15.156:0/1741633770 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffa6c096810 0x7ffa6c118bf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:39.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.195+0000 7ffa7226c700 1 --2- 172.21.15.156:0/1741633770 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffa6c0970e0 0x7ffa6c1190e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:39.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.195+0000 7ffa7226c700 1 -- 172.21.15.156:0/1741633770 >> 172.21.15.156:0/1741633770 conn(0x7ffa6c09bad0 msgr2=0x7ffa6c09a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:39.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.195+0000 7ffa7226c700 1 -- 172.21.15.156:0/1741633770 shutdown_connections 2023-09-30T22:16:39.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:39.195+0000 7ffa7226c700 1 -- 172.21.15.156:0/1741633770 wait complete. 2023-09-30T22:16:39.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.1 2023-09-30T22:16:39.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.0 2023-09-30T22:16:39.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.2 2023-09-30T22:16:39.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.3 2023-09-30T22:16:40.198 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:16:40.199 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:16:40.207 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:16:40.209 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:16:40.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.342+0000 7f72ab747700 1 Processor -- start 2023-09-30T22:16:40.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.342+0000 7f72ab747700 1 -- start start 2023-09-30T22:16:40.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.343+0000 7f72ab747700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f72a4065a60 0x7f72a412fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:40.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.343+0000 7f72ab747700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72a4130350 0x7f72a4132740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:40.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.343+0000 7f72ab747700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a4097730 con 0x7f72a4092990 2023-09-30T22:16:40.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.343+0000 7f72ab747700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72a4092d70 con 0x7f72a4065a60 2023-09-30T22:16:40.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.343+0000 7f72ab747700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72a40974b0 con 0x7f72a4130350 2023-09-30T22:16:40.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.343+0000 7f72a94e3700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f72a4092990 0x7f72a4066050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37874/0 (socket says 172.21.15.156:37874) 2023-09-30T22:16:40.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.343+0000 7f72a94e3700 1 -- 172.21.15.156:0/863811541 learned_addr learned my addr 172.21.15.156:0/863811541 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:40.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.343+0000 7f72a8ce2700 1 --2- 172.21.15.156:0/863811541 >> v2:172.21.15.156:3300/0 conn(0x7f72a4065a60 0x7f72a412fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:40.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.343+0000 7f72a9ce4700 1 --2- 172.21.15.156:0/863811541 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72a4130350 0x7f72a4132740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:40.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.343+0000 7f729bfff700 1 -- 172.21.15.156:0/863811541 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2595459951 0 0) 0x7f72a4097730 con 0x7f72a4092990 2023-09-30T22:16:40.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.343+0000 7f729bfff700 1 -- 172.21.15.156:0/863811541 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72900033f0 con 0x7f72a4092990 2023-09-30T22:16:40.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.344+0000 7f729bfff700 1 -- 172.21.15.156:0/863811541 <== mon.0 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 378583025 0 0) 0x7f72900033f0 con 0x7f72a4092990 2023-09-30T22:16:40.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.344+0000 7f729bfff700 1 -- 172.21.15.156:0/863811541 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72a4130350 msgr2=0x7f72a4132740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:40.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.344+0000 7f729bfff700 1 --2- 172.21.15.156:0/863811541 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72a4130350 0x7f72a4132740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:40.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.344+0000 7f729bfff700 1 -- 172.21.15.156:0/863811541 >> v2:172.21.15.156:3300/0 conn(0x7f72a4065a60 msgr2=0x7f72a412fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:40.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.344+0000 7f729bfff700 1 --2- 172.21.15.156:0/863811541 >> v2:172.21.15.156:3300/0 conn(0x7f72a4065a60 0x7f72a412fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:40.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.344+0000 7f729bfff700 1 -- 172.21.15.156:0/863811541 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a4064740 con 0x7f72a4092990 2023-09-30T22:16:40.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.344+0000 7f729bfff700 1 -- 172.21.15.156:0/863811541 <== mon.0 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1830288586 0 0) 0x7f72a0001470 con 0x7f72a4092990 2023-09-30T22:16:40.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.344+0000 7f729bfff700 1 -- 172.21.15.156:0/863811541 >> v1:172.21.15.156:6789/0 conn(0x7f72a4092990 legacy=0x7f72a4066050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:40.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.344+0000 7f729bfff700 1 --2- 172.21.15.156:0/863811541 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72900038e0 0x7f7290003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:40.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.344+0000 7f729bfff700 1 --2- 172.21.15.156:0/863811541 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7290004690 0x7f7290004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:40.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.344+0000 7f729bfff700 1 --2- 172.21.15.156:0/863811541 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7290005000 0x7f729000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:40.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.344+0000 7f729bfff700 1 -- 172.21.15.156:0/863811541 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a4092d70 con 0x7f7290005000 2023-09-30T22:16:40.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.344+0000 7f729bfff700 1 -- 172.21.15.156:0/863811541 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a40974b0 con 0x7f72900038e0 2023-09-30T22:16:40.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.344+0000 7f729bfff700 1 -- 172.21.15.156:0/863811541 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f729000be80 con 0x7f7290004690 2023-09-30T22:16:40.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.344+0000 7f72a94e3700 1 --2- 172.21.15.156:0/863811541 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72900038e0 0x7f7290003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:40.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.344+0000 7f72a8ce2700 1 --2- 172.21.15.156:0/863811541 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7290004690 0x7f7290004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:40.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.344+0000 7f72a8ce2700 1 -- 172.21.15.156:0/863811541 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72900038e0 msgr2=0x7f7290003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:40.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.344+0000 7f72a8ce2700 1 --2- 172.21.15.156:0/863811541 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72900038e0 0x7f7290003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:40.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.344+0000 7f72a8ce2700 1 -- 172.21.15.156:0/863811541 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7290005000 msgr2=0x7f729000b8e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:16:40.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.344+0000 7f72a8ce2700 1 --2- 172.21.15.156:0/863811541 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7290005000 0x7f729000b8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:16:40.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.344+0000 7f72a8ce2700 1 -- 172.21.15.156:0/863811541 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72900033f0 con 0x7f7290004690 2023-09-30T22:16:40.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.344+0000 7f72a8ce2700 1 --2- 172.21.15.156:0/863811541 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7290004690 0x7f7290004b10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f7294009a80 tx=0x7f7294009060).ready entity=mon.2 client_cookie=81594f079743fee4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:40.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.344+0000 7f72a9ce4700 1 --2- 172.21.15.156:0/863811541 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72a4130350 0x7f72a4132740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:16:40.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.345+0000 7f59fac2b700 1 Processor -- start 2023-09-30T22:16:40.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.345+0000 7f729bfff700 1 -- 172.21.15.156:0/863811541 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7294009430 con 0x7f7290004690 2023-09-30T22:16:40.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.345+0000 7f729bfff700 1 -- 172.21.15.156:0/863811541 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729400e640 con 0x7f7290004690 2023-09-30T22:16:40.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.345+0000 7f729bfff700 1 -- 172.21.15.156:0/863811541 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729400e9c0 con 0x7f7290004690 2023-09-30T22:16:40.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.345+0000 7f59fac2b700 1 -- start start 2023-09-30T22:16:40.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.345+0000 7f72ab747700 1 -- 172.21.15.156:0/863811541 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7290004690 msgr2=0x7f7290004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:40.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.345+0000 7f72ab747700 1 --2- 172.21.15.156:0/863811541 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7290004690 0x7f7290004b10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f7294009a80 tx=0x7f7294009060).stop 2023-09-30T22:16:40.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.345+0000 7f72a9ce4700 1 -- 172.21.15.156:0/863811541 reap_dead start 2023-09-30T22:16:40.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.345+0000 7f59fac2b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f59f40985e0 0x7f59f40989c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:40.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.345+0000 7f59fac2b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f59f4098eb0 0x7f59f412f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:40.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.345+0000 7f59fac2b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f40964f0 con 0x7f59f412f980 2023-09-30T22:16:40.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.345+0000 7f59fac2b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f409a3f0 con 0x7f59f4098eb0 2023-09-30T22:16:40.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.345+0000 7f59fac2b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59f4095100 con 0x7f59f40985e0 2023-09-30T22:16:40.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.346+0000 7f72ab747700 1 -- 172.21.15.156:0/863811541 shutdown_connections 2023-09-30T22:16:40.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.346+0000 7f72ab747700 1 -- 172.21.15.156:0/863811541 >> 172.21.15.156:0/863811541 conn(0x7f72a409bba0 msgr2=0x7f72a409bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:40.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.346+0000 7f59f89c7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f59f40985e0 0x7f59f40989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:40.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.346+0000 7f59f89c7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f59f40985e0 0x7f59f40989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53216/0 (socket says 172.21.15.156:53216) 2023-09-30T22:16:40.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.346+0000 7f59f89c7700 1 -- 172.21.15.156:0/1993849235 learned_addr learned my addr 172.21.15.156:0/1993849235 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:40.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.346+0000 7f59f3fff700 1 --2- 172.21.15.156:0/1993849235 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f59f4098eb0 0x7f59f412f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:40.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.346+0000 7f72ab747700 1 -- 172.21.15.156:0/863811541 shutdown_connections 2023-09-30T22:16:40.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.346+0000 7f72ab747700 1 -- 172.21.15.156:0/863811541 wait complete. 2023-09-30T22:16:40.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.346+0000 7f59f89c7700 1 -- 172.21.15.156:0/1993849235 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f59f4098eb0 msgr2=0x7f59f412f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:40.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.346+0000 7f59f89c7700 1 --2- 172.21.15.156:0/1993849235 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f59f4098eb0 0x7f59f412f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:40.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.346+0000 7f59f89c7700 1 -- 172.21.15.156:0/1993849235 >> v1:172.21.15.156:6789/0 conn(0x7f59f412f980 legacy=0x7f59f4131d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:40.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.346+0000 7f59f37fe700 1 -- 172.21.15.156:0/1993849235 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 954580100 0 0) 0x7f59f40964f0 con 0x7f59f412f980 2023-09-30T22:16:40.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.346+0000 7f59f89c7700 1 -- 172.21.15.156:0/1993849235 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f4099e70 con 0x7f59f40985e0 2023-09-30T22:16:40.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.346+0000 7f59f3fff700 1 --2- 172.21.15.156:0/1993849235 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f59f4098eb0 0x7f59f412f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:40.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.347+0000 7f59f89c7700 1 --2- 172.21.15.156:0/1993849235 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f59f40985e0 0x7f59f40989c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f59e8009860 tx=0x7f59e80090f0).ready entity=mon.2 client_cookie=ac08eb264aeb28a3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:40.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.347+0000 7f59f37fe700 1 -- 172.21.15.156:0/1993849235 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e800b580 con 0x7f59f40985e0 2023-09-30T22:16:40.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.347+0000 7f59f37fe700 1 -- 172.21.15.156:0/1993849235 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e800b6e0 con 0x7f59f40985e0 2023-09-30T22:16:40.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.347+0000 7f59f37fe700 1 -- 172.21.15.156:0/1993849235 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e800ba80 con 0x7f59f40985e0 2023-09-30T22:16:40.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.347+0000 7f72ab747700 1 Processor -- start 2023-09-30T22:16:40.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.348+0000 7f59fac2b700 1 -- 172.21.15.156:0/1993849235 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f59f40985e0 msgr2=0x7f59f40989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:40.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.348+0000 7f59fac2b700 1 --2- 172.21.15.156:0/1993849235 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f59f40985e0 0x7f59f40989c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f59e8009860 tx=0x7f59e80090f0).stop 2023-09-30T22:16:40.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.348+0000 7f59fac2b700 1 -- 172.21.15.156:0/1993849235 shutdown_connections 2023-09-30T22:16:40.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.348+0000 7f59fac2b700 1 --2- 172.21.15.156:0/1993849235 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f59f40985e0 0x7f59f40989c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:40.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.348+0000 7f59fac2b700 1 --2- 172.21.15.156:0/1993849235 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f59f4098eb0 0x7f59f412f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:40.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.348+0000 7f59fac2b700 1 -- 172.21.15.156:0/1993849235 >> 172.21.15.156:0/1993849235 conn(0x7f59f409dc40 msgr2=0x7f59f409e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:40.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.348+0000 7f59fac2b700 1 -- 172.21.15.156:0/1993849235 shutdown_connections 2023-09-30T22:16:40.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.348+0000 7f59fac2b700 1 -- 172.21.15.156:0/1993849235 wait complete. 2023-09-30T22:16:40.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.347+0000 7f72ab747700 1 -- start start 2023-09-30T22:16:40.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.348+0000 7f72ab747700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7290004690 0x7f72a4113da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:40.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.348+0000 7f72ab747700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72a4114290 0x7f72a4112200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:40.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.348+0000 7f72ab747700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72a41126f0 0x7f72a4112b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:40.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.348+0000 7f72ab747700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a406a710 con 0x7f7290004690 2023-09-30T22:16:40.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.348+0000 7f72ab747700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a4114d60 con 0x7f72a41126f0 2023-09-30T22:16:40.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.348+0000 7f72ab747700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72a4114aa0 con 0x7f72a4114290 2023-09-30T22:16:40.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.348+0000 7f72a94e3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7290004690 0x7f72a4113da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:40.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.348+0000 7f72a94e3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7290004690 0x7f72a4113da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:37030/0 (socket says 172.21.15.156:37030) 2023-09-30T22:16:40.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.348+0000 7f72a94e3700 1 -- 172.21.15.156:0/33600331 learned_addr learned my addr 172.21.15.156:0/33600331 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:40.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.348+0000 7f72a9ce4700 1 --2- 172.21.15.156:0/33600331 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72a41126f0 0x7f72a4112b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:40.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.349+0000 7f72a8ce2700 1 --2- 172.21.15.156:0/33600331 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72a4114290 0x7f72a4112200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:40.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.349+0000 7f72a9ce4700 1 -- 172.21.15.156:0/33600331 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72a4114290 msgr2=0x7f72a4112200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:40.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.349+0000 7f72a9ce4700 1 --2- 172.21.15.156:0/33600331 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72a4114290 0x7f72a4112200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:40.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.349+0000 7f72a9ce4700 1 -- 172.21.15.156:0/33600331 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7290004690 msgr2=0x7f72a4113da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:40.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.349+0000 7f72a9ce4700 1 --2- 172.21.15.156:0/33600331 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7290004690 0x7f72a4113da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:40.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.349+0000 7f72a9ce4700 1 -- 172.21.15.156:0/33600331 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a4113920 con 0x7f72a41126f0 2023-09-30T22:16:40.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.349+0000 7f72a8ce2700 1 --2- 172.21.15.156:0/33600331 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72a4114290 0x7f72a4112200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:16:40.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.349+0000 7f59fac2b700 1 Processor -- start 2023-09-30T22:16:40.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.349+0000 7f72a9ce4700 1 --2- 172.21.15.156:0/33600331 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72a41126f0 0x7f72a4112b70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f72a4092f10 tx=0x7f729c009840).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:40.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.349+0000 7f72997fa700 1 -- 172.21.15.156:0/33600331 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c00d8d0 con 0x7f72a41126f0 2023-09-30T22:16:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.349+0000 7f59fac2b700 1 -- start start 2023-09-30T22:16:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.350+0000 7f59fac2b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f59f40985e0 0x7f59f411a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.349+0000 7f72997fa700 1 -- 172.21.15.156:0/33600331 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729c00f040 con 0x7f72a41126f0 2023-09-30T22:16:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.349+0000 7f72ab747700 1 -- 172.21.15.156:0/33600331 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a4113060 con 0x7f72a41126f0 2023-09-30T22:16:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.349+0000 7f72997fa700 1 -- 172.21.15.156:0/33600331 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c00dc60 con 0x7f72a41126f0 2023-09-30T22:16:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.349+0000 7f72ab747700 1 -- 172.21.15.156:0/33600331 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a4114870 con 0x7f72a41126f0 2023-09-30T22:16:40.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.350+0000 7f59fac2b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f59f4098eb0 0x7f59f411aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:40.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.350+0000 7f59fac2b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59f412f980 0x7f59f411af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:40.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.350+0000 7f59fac2b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f411b9a0 con 0x7f59f412f980 2023-09-30T22:16:40.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.350+0000 7f59fac2b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f411b410 con 0x7f59f40985e0 2023-09-30T22:16:40.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.350+0000 7f59fac2b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59f409a0f0 con 0x7f59f4098eb0 2023-09-30T22:16:40.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.350+0000 7f59f91c8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59f412f980 0x7f59f411af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:40.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.350+0000 7f59f91c8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59f412f980 0x7f59f411af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:37032/0 (socket says 172.21.15.156:37032) 2023-09-30T22:16:40.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.350+0000 7f59f91c8700 1 -- 172.21.15.156:0/138388792 learned_addr learned my addr 172.21.15.156:0/138388792 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:40.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.350+0000 7f59f3fff700 1 --2- 172.21.15.156:0/138388792 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f59f4098eb0 0x7f59f411aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:40.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.351+0000 7f59f3fff700 1 -- 172.21.15.156:0/138388792 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f59f40985e0 msgr2=0x7f59f411a540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:16:40.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.351+0000 7f59f89c7700 1 --2- 172.21.15.156:0/138388792 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f59f40985e0 0x7f59f411a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:40.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.351+0000 7f59f3fff700 1 --2- 172.21.15.156:0/138388792 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f59f40985e0 0x7f59f411a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:40.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.351+0000 7f59f3fff700 1 -- 172.21.15.156:0/138388792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59f412f980 msgr2=0x7f59f411af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:40.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.351+0000 7f59f3fff700 1 --2- 172.21.15.156:0/138388792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59f412f980 0x7f59f411af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:40.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.351+0000 7f59f3fff700 1 -- 172.21.15.156:0/138388792 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e00092a0 con 0x7f59f4098eb0 2023-09-30T22:16:40.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.351+0000 7f59f91c8700 1 --2- 172.21.15.156:0/138388792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59f412f980 0x7f59f411af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:16:40.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.351+0000 7f59f89c7700 1 --2- 172.21.15.156:0/138388792 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f59f40985e0 0x7f59f411a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:16:40.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.351+0000 7f59f3fff700 1 --2- 172.21.15.156:0/138388792 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f59f4098eb0 0x7f59f411aa30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f59e000e950 tx=0x7f59e0009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:40.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.351+0000 7f72ab747700 1 -- 172.21.15.156:0/33600331 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7284005120 con 0x7f72a41126f0 2023-09-30T22:16:40.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.351+0000 7f59f0ff9700 1 -- 172.21.15.156:0/138388792 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e000c7f0 con 0x7f59f4098eb0 2023-09-30T22:16:40.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.351+0000 7f59f0ff9700 1 -- 172.21.15.156:0/138388792 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e000c950 con 0x7f59f4098eb0 2023-09-30T22:16:40.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.351+0000 7f59fac2b700 1 -- 172.21.15.156:0/138388792 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e8009370 con 0x7f59f4098eb0 2023-09-30T22:16:40.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.351+0000 7f59f0ff9700 1 -- 172.21.15.156:0/138388792 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e000ccf0 con 0x7f59f4098eb0 2023-09-30T22:16:40.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.351+0000 7f59fac2b700 1 -- 172.21.15.156:0/138388792 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f411dd90 con 0x7f59f4098eb0 2023-09-30T22:16:40.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.353+0000 7f59fac2b700 1 -- 172.21.15.156:0/138388792 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f411e040 con 0x7f59f4098eb0 2023-09-30T22:16:40.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.353+0000 7f59f0ff9700 1 -- 172.21.15.156:0/138388792 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f59e0012600 con 0x7f59f4098eb0 2023-09-30T22:16:40.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.353+0000 7f59f0ff9700 1 -- 172.21.15.156:0/138388792 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f59e003b6e0 con 0x7f59f4098eb0 2023-09-30T22:16:40.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.352+0000 7f72997fa700 1 -- 172.21.15.156:0/33600331 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f729c0133f0 con 0x7f72a41126f0 2023-09-30T22:16:40.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.352+0000 7f72997fa700 1 -- 172.21.15.156:0/33600331 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f729c03b120 con 0x7f72a41126f0 2023-09-30T22:16:40.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.358+0000 7f59f0ff9700 1 -- 172.21.15.156:0/138388792 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f59e0019720 con 0x7f59f4098eb0 2023-09-30T22:16:40.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.359+0000 7f72997fa700 1 -- 172.21.15.156:0/33600331 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f729c011700 con 0x7f72a41126f0 2023-09-30T22:16:40.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.377+0000 7fabf2ffe700 1 Processor -- start 2023-09-30T22:16:40.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.377+0000 7fabf2ffe700 1 -- start start 2023-09-30T22:16:40.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.378+0000 7fabf2ffe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabec066e30 0x7fabec067210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:40.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.378+0000 7fabf2ffe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabec134440 0x7fabec136830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:40.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.378+0000 7fabf2ffe700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabec0694e0 con 0x7fabec068680 2023-09-30T22:16:40.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.378+0000 7fabf2ffe700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabec069a10 con 0x7fabec066e30 2023-09-30T22:16:40.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.378+0000 7fabf2ffe700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabec068b00 con 0x7fabec134440 2023-09-30T22:16:40.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.378+0000 7fabebfff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fabec068680 0x7fabec067700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37890/0 (socket says 172.21.15.156:37890) 2023-09-30T22:16:40.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.378+0000 7fabebfff700 1 -- 172.21.15.156:0/4074801250 learned_addr learned my addr 172.21.15.156:0/4074801250 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:40.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.378+0000 7fabf159b700 1 --2- 172.21.15.156:0/4074801250 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabec134440 0x7fabec136830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:40.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.378+0000 7fabf0d9a700 1 --2- 172.21.15.156:0/4074801250 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabec066e30 0x7fabec067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:40.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.378+0000 7fabf0d9a700 1 -- 172.21.15.156:0/4074801250 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabec134440 msgr2=0x7fabec136830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:40.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.378+0000 7fabf0d9a700 1 --2- 172.21.15.156:0/4074801250 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabec134440 0x7fabec136830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:40.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.378+0000 7fabf0d9a700 1 -- 172.21.15.156:0/4074801250 >> v1:172.21.15.156:6789/0 conn(0x7fabec068680 legacy=0x7fabec067700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:40.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.379+0000 7fabf0d9a700 1 -- 172.21.15.156:0/4074801250 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec092120 con 0x7fabec066e30 2023-09-30T22:16:40.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.379+0000 7fabf0d9a700 1 --2- 172.21.15.156:0/4074801250 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabec066e30 0x7fabec067210 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fabe0009790 tx=0x7fabe0009060).ready entity=mon.1 client_cookie=ac69998de01ccb17 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:40.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.380+0000 7fabeb7fe700 1 -- 172.21.15.156:0/4074801250 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe000f510 con 0x7fabec066e30 2023-09-30T22:16:40.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.380+0000 7f27cc4e9700 1 Processor -- start 2023-09-30T22:16:40.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.380+0000 7fabeb7fe700 1 -- 172.21.15.156:0/4074801250 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe000f670 con 0x7fabec066e30 2023-09-30T22:16:40.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.380+0000 7fabeb7fe700 1 -- 172.21.15.156:0/4074801250 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe000f9f0 con 0x7fabec066e30 2023-09-30T22:16:40.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.381+0000 7f27cc4e9700 1 -- start start 2023-09-30T22:16:40.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.381+0000 7fabf2ffe700 1 -- 172.21.15.156:0/4074801250 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabec066e30 msgr2=0x7fabec067210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:40.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.381+0000 7fabf2ffe700 1 --2- 172.21.15.156:0/4074801250 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabec066e30 0x7fabec067210 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fabe0009790 tx=0x7fabe0009060).stop 2023-09-30T22:16:40.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.381+0000 7fabf2ffe700 1 -- 172.21.15.156:0/4074801250 shutdown_connections 2023-09-30T22:16:40.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.381+0000 7fabf2ffe700 1 --2- 172.21.15.156:0/4074801250 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabec066e30 0x7fabec067210 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:40.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.381+0000 7fabf2ffe700 1 --2- 172.21.15.156:0/4074801250 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabec134440 0x7fabec136830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:40.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.381+0000 7fabf2ffe700 1 -- 172.21.15.156:0/4074801250 >> 172.21.15.156:0/4074801250 conn(0x7fabec09a230 msgr2=0x7fabec09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:40.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.381+0000 7fabf2ffe700 1 -- 172.21.15.156:0/4074801250 shutdown_connections 2023-09-30T22:16:40.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.381+0000 7fabf2ffe700 1 -- 172.21.15.156:0/4074801250 wait complete. 2023-09-30T22:16:40.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.381+0000 7f27cc4e9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27c4062b00 0x7f27c4095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:40.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.381+0000 7f27cc4e9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f27c4095b80 0x7f27c4095fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:40.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.381+0000 7f27cc4e9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c4091980 con 0x7f27c4096490 2023-09-30T22:16:40.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.381+0000 7f27cc4e9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27c40973f0 con 0x7f27c4095b80 2023-09-30T22:16:40.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.381+0000 7f27cc4e9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c4062ee0 con 0x7f27c4062b00 2023-09-30T22:16:40.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.382+0000 7f27ca285700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27c4062b00 0x7f27c4095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:40.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.382+0000 7f27ca285700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27c4062b00 0x7f27c4095690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48292/0 (socket says 172.21.15.156:48292) 2023-09-30T22:16:40.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.382+0000 7f27ca285700 1 -- 172.21.15.156:0/986853490 learned_addr learned my addr 172.21.15.156:0/986853490 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:40.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.382+0000 7fabf2ffe700 1 Processor -- start 2023-09-30T22:16:40.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.382+0000 7f27ca285700 1 -- 172.21.15.156:0/986853490 >> v2:172.21.15.156:3300/0 conn(0x7f27c4095b80 msgr2=0x7f27c4095fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:40.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.382+0000 7f27ca285700 1 --2- 172.21.15.156:0/986853490 >> v2:172.21.15.156:3300/0 conn(0x7f27c4095b80 0x7f27c4095fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:16:40.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.382+0000 7f27ca285700 1 -- 172.21.15.156:0/986853490 >> v1:172.21.15.156:6789/0 conn(0x7f27c4096490 legacy=0x7f27c4131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:40.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.382+0000 7f27ca285700 1 -- 172.21.15.156:0/986853490 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c4092310 con 0x7f27c4062b00 2023-09-30T22:16:40.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.382+0000 7f27ca285700 1 --2- 172.21.15.156:0/986853490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27c4062b00 0x7f27c4095690 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f27c0009830 tx=0x7f27c00090f0).ready entity=mon.1 client_cookie=f6613ac2f93052a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:40.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.382+0000 7fabf2ffe700 1 -- start start 2023-09-30T22:16:40.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.383+0000 7f27c9283700 1 -- 172.21.15.156:0/986853490 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c000b600 con 0x7f27c4062b00 2023-09-30T22:16:40.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.383+0000 7f27c9283700 1 -- 172.21.15.156:0/986853490 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c000b760 con 0x7f27c4062b00 2023-09-30T22:16:40.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.383+0000 7f27c9283700 1 -- 172.21.15.156:0/986853490 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c000bae0 con 0x7f27c4062b00 2023-09-30T22:16:40.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.383+0000 7fabf2ffe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabec066e30 0x7fabec096410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:40.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.383+0000 7fabf2ffe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabec068680 0x7fabec1190a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:40.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.383+0000 7fabf2ffe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabec134440 0x7fabec119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:40.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.383+0000 7fabf2ffe700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec130660 con 0x7fabec134440 2023-09-30T22:16:40.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.383+0000 7fabf2ffe700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabec1348e0 con 0x7fabec068680 2023-09-30T22:16:40.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.383+0000 7fabf2ffe700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabec0691e0 con 0x7fabec066e30 2023-09-30T22:16:40.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.383+0000 7fabebfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabec068680 0x7fabec1190a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:40.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.383+0000 7fabebfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabec068680 0x7fabec1190a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48294/0 (socket says 172.21.15.156:48294) 2023-09-30T22:16:40.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.383+0000 7fabebfff700 1 -- 172.21.15.156:0/2309222660 learned_addr learned my addr 172.21.15.156:0/2309222660 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:40.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.383+0000 7fabf0d9a700 1 --2- 172.21.15.156:0/2309222660 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabec066e30 0x7fabec096410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:40.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.383+0000 7fabebfff700 1 -- 172.21.15.156:0/2309222660 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabec066e30 msgr2=0x7fabec096410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:40.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.383+0000 7fabebfff700 1 --2- 172.21.15.156:0/2309222660 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabec066e30 0x7fabec096410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:40.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.383+0000 7fabebfff700 1 -- 172.21.15.156:0/2309222660 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabec134440 msgr2=0x7fabec119590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:16:40.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.383+0000 7fabebfff700 1 --2- 172.21.15.156:0/2309222660 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabec134440 0x7fabec119590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:16:40.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.383+0000 7fabebfff700 1 -- 172.21.15.156:0/2309222660 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe00092a0 con 0x7fabec068680 2023-09-30T22:16:40.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.383+0000 7f27cc4e9700 1 -- 172.21.15.156:0/986853490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27c4062b00 msgr2=0x7f27c4095690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:40.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.383+0000 7f27cc4e9700 1 --2- 172.21.15.156:0/986853490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27c4062b00 0x7f27c4095690 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f27c0009830 tx=0x7f27c00090f0).stop 2023-09-30T22:16:40.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.384+0000 7fabebfff700 1 --2- 172.21.15.156:0/2309222660 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabec068680 0x7fabec1190a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fabd800c4f0 tx=0x7fabd8007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:40.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.384+0000 7f27cc4e9700 1 -- 172.21.15.156:0/986853490 shutdown_connections 2023-09-30T22:16:40.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.384+0000 7f27cc4e9700 1 --2- 172.21.15.156:0/986853490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27c4062b00 0x7f27c4095690 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:40.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.384+0000 7f27cc4e9700 1 --2- 172.21.15.156:0/986853490 >> v2:172.21.15.156:3300/0 conn(0x7f27c4095b80 0x7f27c4095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:16:40.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.384+0000 7f27cc4e9700 1 -- 172.21.15.156:0/986853490 >> 172.21.15.156:0/986853490 conn(0x7f27c409aa50 msgr2=0x7f27c409ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:40.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.384+0000 7fabe8ff9700 1 -- 172.21.15.156:0/2309222660 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd80072e0 con 0x7fabec068680 2023-09-30T22:16:40.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.384+0000 7fabf2ffe700 1 -- 172.21.15.156:0/2309222660 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabec11b590 con 0x7fabec068680 2023-09-30T22:16:40.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.384+0000 7fabe8ff9700 1 -- 172.21.15.156:0/2309222660 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd8007440 con 0x7fabec068680 2023-09-30T22:16:40.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.384+0000 7fabe8ff9700 1 -- 172.21.15.156:0/2309222660 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd80057a0 con 0x7fabec068680 2023-09-30T22:16:40.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.384+0000 7fabf2ffe700 1 -- 172.21.15.156:0/2309222660 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabec11bbc0 con 0x7fabec068680 2023-09-30T22:16:40.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.385+0000 7f27cc4e9700 1 -- 172.21.15.156:0/986853490 shutdown_connections 2023-09-30T22:16:40.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.385+0000 7fabe8ff9700 1 -- 172.21.15.156:0/2309222660 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fabd8005bd0 con 0x7fabec068680 2023-09-30T22:16:40.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.385+0000 7fabf2ffe700 1 -- 172.21.15.156:0/2309222660 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabec11ba20 con 0x7fabec068680 2023-09-30T22:16:40.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.385+0000 7fabe8ff9700 1 -- 172.21.15.156:0/2309222660 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fabd803a7b0 con 0x7fabec068680 2023-09-30T22:16:40.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.386+0000 7f27cc4e9700 1 -- 172.21.15.156:0/986853490 wait complete. 2023-09-30T22:16:40.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.386+0000 7f27cc4e9700 1 Processor -- start 2023-09-30T22:16:40.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.390+0000 7f27cc4e9700 1 -- start start 2023-09-30T22:16:40.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.390+0000 7f27cc4e9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27c4062b00 0x7f27c4066860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:40.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.390+0000 7f27cc4e9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27c4095b80 0x7f27c4066d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:40.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.390+0000 7f27cc4e9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27c4096490 0x7f27c4067240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:40.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.390+0000 7f27cc4e9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c4099e30 con 0x7f27c4095b80 2023-09-30T22:16:40.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.390+0000 7f27cc4e9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c4069ea0 con 0x7f27c4062b00 2023-09-30T22:16:40.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.390+0000 7f27cc4e9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27c4069940 con 0x7f27c4096490 2023-09-30T22:16:40.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.390+0000 7f27c9a84700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27c4095b80 0x7f27c4066d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:40.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.390+0000 7f27c9a84700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27c4095b80 0x7f27c4066d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:37064/0 (socket says 172.21.15.156:37064) 2023-09-30T22:16:40.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.390+0000 7f27c9a84700 1 -- 172.21.15.156:0/2059618201 learned_addr learned my addr 172.21.15.156:0/2059618201 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:40.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.390+0000 7fabe8ff9700 1 -- 172.21.15.156:0/2309222660 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fabec11ba20 con 0x7fabec068680 2023-09-30T22:16:40.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.390+0000 7f27caa86700 1 --2- 172.21.15.156:0/2059618201 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27c4096490 0x7f27c4067240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:40.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.391+0000 7f27ca285700 1 --2- 172.21.15.156:0/2059618201 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27c4062b00 0x7f27c4066860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:40.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.391+0000 7f27c9a84700 1 -- 172.21.15.156:0/2059618201 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27c4096490 msgr2=0x7f27c4067240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:40.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.391+0000 7f27c9a84700 1 --2- 172.21.15.156:0/2059618201 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27c4096490 0x7f27c4067240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:40.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.391+0000 7f27c9a84700 1 -- 172.21.15.156:0/2059618201 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27c4062b00 msgr2=0x7f27c4066860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:40.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.391+0000 7f27c9a84700 1 --2- 172.21.15.156:0/2059618201 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27c4062b00 0x7f27c4066860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:40.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.391+0000 7f27c9a84700 1 -- 172.21.15.156:0/2059618201 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c0009370 con 0x7f27c4095b80 2023-09-30T22:16:40.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.391+0000 7f27ca285700 1 --2- 172.21.15.156:0/2059618201 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27c4062b00 0x7f27c4066860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:16:40.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.394+0000 7f27c9a84700 1 --2- 172.21.15.156:0/2059618201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27c4095b80 0x7f27c4066d50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f27b400b500 tx=0x7f27b40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:40.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.394+0000 7f27ba7fc700 1 -- 172.21.15.156:0/2059618201 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b4002320 con 0x7f27c4095b80 2023-09-30T22:16:40.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.394+0000 7f27ba7fc700 1 -- 172.21.15.156:0/2059618201 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b40024c0 con 0x7f27c4095b80 2023-09-30T22:16:40.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.394+0000 7f27cc4e9700 1 -- 172.21.15.156:0/2059618201 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c4068310 con 0x7f27c4095b80 2023-09-30T22:16:40.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.394+0000 7f27ba7fc700 1 -- 172.21.15.156:0/2059618201 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b4002880 con 0x7f27c4095b80 2023-09-30T22:16:40.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.394+0000 7f27cc4e9700 1 -- 172.21.15.156:0/2059618201 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c4068b10 con 0x7f27c4095b80 2023-09-30T22:16:40.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.395+0000 7f27ba7fc700 1 -- 172.21.15.156:0/2059618201 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f27b4002bf0 con 0x7f27c4095b80 2023-09-30T22:16:40.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.395+0000 7f27ba7fc700 1 -- 172.21.15.156:0/2059618201 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f27b4010d30 con 0x7f27c4095b80 2023-09-30T22:16:40.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.395+0000 7f27cc4e9700 1 -- 172.21.15.156:0/2059618201 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c4069fe0 con 0x7f27c4095b80 2023-09-30T22:16:40.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.399+0000 7f27ba7fc700 1 -- 172.21.15.156:0/2059618201 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f27c4069fe0 con 0x7f27c4095b80 2023-09-30T22:16:40.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.558+0000 7f59fac2b700 1 -- 172.21.15.156:0/138388792 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f59f405a260 con 0x7f59f4098eb0 2023-09-30T22:16:40.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.558+0000 7f59f0ff9700 1 -- 172.21.15.156:0/138388792 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f59e0016030 con 0x7f59f4098eb0 2023-09-30T22:16:40.559 INFO:teuthology.orchestra.run.smithi156.stdout:38654705667 2023-09-30T22:16:40.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.560+0000 7fabf2ffe700 1 -- 172.21.15.156:0/2309222660 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fabec11ba20 con 0x7fabec068680 2023-09-30T22:16:40.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.560+0000 7f59fac2b700 1 -- 172.21.15.156:0/138388792 >> v1:172.21.15.156:6816/118236 conn(0x7f59d802bb60 legacy=0x7f59d802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:40.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.560+0000 7f59fac2b700 1 -- 172.21.15.156:0/138388792 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f59f4098eb0 msgr2=0x7f59f411aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:40.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.560+0000 7f59fac2b700 1 --2- 172.21.15.156:0/138388792 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f59f4098eb0 0x7f59f411aa30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f59e000e950 tx=0x7f59e0009060).stop 2023-09-30T22:16:40.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.560+0000 7f59fac2b700 1 -- 172.21.15.156:0/138388792 shutdown_connections 2023-09-30T22:16:40.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.560+0000 7f59fac2b700 1 --2- 172.21.15.156:0/138388792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59f412f980 0x7f59f411af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:40.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.560+0000 7f59fac2b700 1 --2- 172.21.15.156:0/138388792 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f59f40985e0 0x7f59f411a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:40.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.560+0000 7f59fac2b700 1 --2- 172.21.15.156:0/138388792 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f59f4098eb0 0x7f59f411aa30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:40.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.560+0000 7f59fac2b700 1 -- 172.21.15.156:0/138388792 >> 172.21.15.156:0/138388792 conn(0x7f59f409dc40 msgr2=0x7f59f4114300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:40.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.560+0000 7f59fac2b700 1 -- 172.21.15.156:0/138388792 shutdown_connections 2023-09-30T22:16:40.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.560+0000 7f59fac2b700 1 -- 172.21.15.156:0/138388792 wait complete. 2023-09-30T22:16:40.563 INFO:teuthology.orchestra.run.smithi156.stdout:38654705667 2023-09-30T22:16:40.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.560+0000 7fabe8ff9700 1 -- 172.21.15.156:0/2309222660 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fabec11ba20 con 0x7fabec068680 2023-09-30T22:16:40.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.561+0000 7f72ab747700 1 -- 172.21.15.156:0/33600331 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7284005ac0 con 0x7f72a41126f0 2023-09-30T22:16:40.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.561+0000 7f72997fa700 1 -- 172.21.15.156:0/33600331 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f729c0112f0 con 0x7f72a41126f0 2023-09-30T22:16:40.564 INFO:teuthology.orchestra.run.smithi156.stdout:38654705667 2023-09-30T22:16:40.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.562+0000 7fabf2ffe700 1 -- 172.21.15.156:0/2309222660 >> v1:172.21.15.156:6816/118236 conn(0x7fabd002bb60 legacy=0x7fabd002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:40.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.562+0000 7fabf2ffe700 1 -- 172.21.15.156:0/2309222660 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabec068680 msgr2=0x7fabec1190a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:40.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.562+0000 7fabf2ffe700 1 --2- 172.21.15.156:0/2309222660 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabec068680 0x7fabec1190a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fabd800c4f0 tx=0x7fabd8007dc0).stop 2023-09-30T22:16:40.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.563+0000 7fabf2ffe700 1 -- 172.21.15.156:0/2309222660 shutdown_connections 2023-09-30T22:16:40.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.563+0000 7fabf2ffe700 1 --2- 172.21.15.156:0/2309222660 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabec134440 0x7fabec119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:16:40.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.563+0000 7fabf2ffe700 1 --2- 172.21.15.156:0/2309222660 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabec066e30 0x7fabec096410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:40.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.563+0000 7fabf2ffe700 1 --2- 172.21.15.156:0/2309222660 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabec068680 0x7fabec1190a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:40.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.563+0000 7fabf2ffe700 1 -- 172.21.15.156:0/2309222660 >> 172.21.15.156:0/2309222660 conn(0x7fabec09a230 msgr2=0x7fabec098060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:40.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.563+0000 7fabf2ffe700 1 -- 172.21.15.156:0/2309222660 shutdown_connections 2023-09-30T22:16:40.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.563+0000 7fabf2ffe700 1 -- 172.21.15.156:0/2309222660 wait complete. 2023-09-30T22:16:40.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.563+0000 7f72ab747700 1 -- 172.21.15.156:0/33600331 >> v1:172.21.15.156:6816/118236 conn(0x7f728802bb60 legacy=0x7f728802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:40.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.563+0000 7f72ab747700 1 -- 172.21.15.156:0/33600331 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72a41126f0 msgr2=0x7f72a4112b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:40.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.563+0000 7f72ab747700 1 --2- 172.21.15.156:0/33600331 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72a41126f0 0x7f72a4112b70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f72a4092f10 tx=0x7f729c009840).stop 2023-09-30T22:16:40.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.564+0000 7f72ab747700 1 -- 172.21.15.156:0/33600331 shutdown_connections 2023-09-30T22:16:40.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.564+0000 7f72ab747700 1 --2- 172.21.15.156:0/33600331 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72a41126f0 0x7f72a4112b70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:40.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.564+0000 7f72ab747700 1 --2- 172.21.15.156:0/33600331 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7290004690 0x7f72a4113da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:40.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.564+0000 7f72ab747700 1 --2- 172.21.15.156:0/33600331 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72a4114290 0x7f72a4112200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:40.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.564+0000 7f72ab747700 1 -- 172.21.15.156:0/33600331 >> 172.21.15.156:0/33600331 conn(0x7f72a409bba0 msgr2=0x7f72a4095000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:40.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.564+0000 7f72ab747700 1 -- 172.21.15.156:0/33600331 shutdown_connections 2023-09-30T22:16:40.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.564+0000 7f72ab747700 1 -- 172.21.15.156:0/33600331 wait complete. 2023-09-30T22:16:40.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.564+0000 7f27cc4e9700 1 -- 172.21.15.156:0/2059618201 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f27c4069fe0 con 0x7f27c4095b80 2023-09-30T22:16:40.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.565+0000 7f27ba7fc700 1 -- 172.21.15.156:0/2059618201 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f27c4069fe0 con 0x7f27c4095b80 2023-09-30T22:16:40.568 INFO:teuthology.orchestra.run.smithi156.stdout:38654705667 2023-09-30T22:16:40.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.566+0000 7f27cc4e9700 1 -- 172.21.15.156:0/2059618201 >> v1:172.21.15.156:6816/118236 conn(0x7f27a802bb60 legacy=0x7f27a802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:40.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.567+0000 7f27cc4e9700 1 -- 172.21.15.156:0/2059618201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27c4095b80 msgr2=0x7f27c4066d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:40.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.567+0000 7f27cc4e9700 1 --2- 172.21.15.156:0/2059618201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27c4095b80 0x7f27c4066d50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f27b400b500 tx=0x7f27b40090f0).stop 2023-09-30T22:16:40.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.567+0000 7f27cc4e9700 1 -- 172.21.15.156:0/2059618201 shutdown_connections 2023-09-30T22:16:40.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.567+0000 7f27cc4e9700 1 --2- 172.21.15.156:0/2059618201 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27c4096490 0x7f27c4067240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:40.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.567+0000 7f27cc4e9700 1 --2- 172.21.15.156:0/2059618201 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27c4062b00 0x7f27c4066860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:40.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.567+0000 7f27cc4e9700 1 --2- 172.21.15.156:0/2059618201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27c4095b80 0x7f27c4066d50 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0x7f27b400b500 tx=0x7f27b40090f0).stop 2023-09-30T22:16:40.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.567+0000 7f27cc4e9700 1 -- 172.21.15.156:0/2059618201 >> 172.21.15.156:0/2059618201 conn(0x7f27c409aa50 msgr2=0x7f27c4130180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:40.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.567+0000 7f27cc4e9700 1 -- 172.21.15.156:0/2059618201 shutdown_connections 2023-09-30T22:16:40.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:40.567+0000 7f27cc4e9700 1 -- 172.21.15.156:0/2059618201 wait complete. 2023-09-30T22:16:40.580 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.2 2023-09-30T22:16:40.582 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.3 2023-09-30T22:16:40.583 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.0 2023-09-30T22:16:40.585 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.1 2023-09-30T22:16:41.581 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:16:41.582 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:16:41.583 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:16:41.586 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:16:41.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.727+0000 7f1ff27f5700 1 Processor -- start 2023-09-30T22:16:41.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.727+0000 7f1ff27f5700 1 -- start start 2023-09-30T22:16:41.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.727+0000 7f1ff27f5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fec065a60 0x7f1fec12fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:41.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.727+0000 7f1ff27f5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1fec130350 0x7f1fec132740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:41.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.727+0000 7f1ff27f5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fec097730 con 0x7f1fec092990 2023-09-30T22:16:41.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.727+0000 7f1ff27f5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fec092d70 con 0x7f1fec130350 2023-09-30T22:16:41.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.727+0000 7f1ff27f5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec0974b0 con 0x7f1fec065a60 2023-09-30T22:16:41.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.727+0000 7f1febfff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f1fec092990 0x7f1fec066050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47290/0 (socket says 172.21.15.156:47290) 2023-09-30T22:16:41.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.727+0000 7f1febfff700 1 -- 172.21.15.156:0/2190902369 learned_addr learned my addr 172.21.15.156:0/2190902369 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:41.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.727+0000 7f1ff0d92700 1 --2- 172.21.15.156:0/2190902369 >> v2:172.21.15.156:3300/0 conn(0x7f1fec130350 0x7f1fec132740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:41.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.728+0000 7f1feb7fe700 1 --2- 172.21.15.156:0/2190902369 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fec065a60 0x7f1fec12fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:41.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.728+0000 7f1ff0d92700 1 -- 172.21.15.156:0/2190902369 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fec065a60 msgr2=0x7f1fec12fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:41.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.728+0000 7f1ff0d92700 1 --2- 172.21.15.156:0/2190902369 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fec065a60 0x7f1fec12fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:41.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.728+0000 7f1ff0d92700 1 -- 172.21.15.156:0/2190902369 >> v1:172.21.15.156:6789/0 conn(0x7f1fec092990 legacy=0x7f1fec066050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:41.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.728+0000 7f1feaffd700 1 -- 172.21.15.156:0/2190902369 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176106720 0 0) 0x7f1fec097730 con 0x7f1fec092990 2023-09-30T22:16:41.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.728+0000 7f1ff0d92700 1 -- 172.21.15.156:0/2190902369 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fec064740 con 0x7f1fec130350 2023-09-30T22:16:41.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.728+0000 7f1ff0d92700 1 --2- 172.21.15.156:0/2190902369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fec130350 0x7f1fec132740 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f1fe4009e60 tx=0x7f1fe4009780).ready entity=mon.0 client_cookie=11dbe0c8ad997e9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:41.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.728+0000 7f1feaffd700 1 -- 172.21.15.156:0/2190902369 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe400e070 con 0x7f1fec130350 2023-09-30T22:16:41.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.728+0000 7f1feaffd700 1 -- 172.21.15.156:0/2190902369 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe400bb60 con 0x7f1fec130350 2023-09-30T22:16:41.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.728+0000 7f1feaffd700 1 -- 172.21.15.156:0/2190902369 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4012410 con 0x7f1fec130350 2023-09-30T22:16:41.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.729+0000 7f4be6d41700 1 Processor -- start 2023-09-30T22:16:41.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.729+0000 7f4be6d41700 1 -- start start 2023-09-30T22:16:41.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.729+0000 7f1ff27f5700 1 -- 172.21.15.156:0/2190902369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fec130350 msgr2=0x7f1fec132740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:41.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.729+0000 7f1ff27f5700 1 --2- 172.21.15.156:0/2190902369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fec130350 0x7f1fec132740 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f1fe4009e60 tx=0x7f1fe4009780).stop 2023-09-30T22:16:41.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.729+0000 7f4be6d41700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4be0095680 0x7f4be0095a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:41.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.729+0000 7f1ff27f5700 1 -- 172.21.15.156:0/2190902369 shutdown_connections 2023-09-30T22:16:41.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.729+0000 7f1ff27f5700 1 --2- 172.21.15.156:0/2190902369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fec130350 0x7f1fec132740 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:41.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.729+0000 7f1ff27f5700 1 --2- 172.21.15.156:0/2190902369 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fec065a60 0x7f1fec12fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:41.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.729+0000 7f1ff27f5700 1 -- 172.21.15.156:0/2190902369 >> 172.21.15.156:0/2190902369 conn(0x7f1fec09bba0 msgr2=0x7f1fec09bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:41.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.729+0000 7f4be6d41700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4be0095f50 0x7f4be012eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:41.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.729+0000 7f4be6d41700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4be012f390 0x7f4be0131780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:41.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.729+0000 7f4be6d41700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be0091410 con 0x7f4be0095f50 2023-09-30T22:16:41.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.729+0000 7f4be6d41700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be0065550 con 0x7f4be012f390 2023-09-30T22:16:41.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.729+0000 7f4be6d41700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4be0063bc0 con 0x7f4be0095680 2023-09-30T22:16:41.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.729+0000 7f4bdffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4be0095f50 0x7f4be012eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:41.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.729+0000 7f4bdffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4be0095f50 0x7f4be012eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:35510/0 (socket says 172.21.15.156:35510) 2023-09-30T22:16:41.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.729+0000 7f4bdffff700 1 -- 172.21.15.156:0/2308556464 learned_addr learned my addr 172.21.15.156:0/2308556464 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:41.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.729+0000 7f4be4add700 1 --2- 172.21.15.156:0/2308556464 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4be0095680 0x7f4be0095a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:41.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.730+0000 7f4be52de700 1 --2- 172.21.15.156:0/2308556464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4be012f390 0x7f4be0131780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:41.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.730+0000 7f1ff27f5700 1 -- 172.21.15.156:0/2190902369 shutdown_connections 2023-09-30T22:16:41.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.730+0000 7f1ff27f5700 1 -- 172.21.15.156:0/2190902369 wait complete. 2023-09-30T22:16:41.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.730+0000 7f4bdffff700 1 -- 172.21.15.156:0/2308556464 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4be0095680 msgr2=0x7f4be0095a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:41.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.730+0000 7f4bdffff700 1 --2- 172.21.15.156:0/2308556464 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4be0095680 0x7f4be0095a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:41.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.730+0000 7f4bdffff700 1 -- 172.21.15.156:0/2308556464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4be012f390 msgr2=0x7f4be0131780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:41.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.730+0000 7f4bdffff700 1 --2- 172.21.15.156:0/2308556464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4be012f390 0x7f4be0131780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:41.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.730+0000 7f4bdffff700 1 -- 172.21.15.156:0/2308556464 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be0091de0 con 0x7f4be0095f50 2023-09-30T22:16:41.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.730+0000 7f4bdffff700 1 --2- 172.21.15.156:0/2308556464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4be0095f50 0x7f4be012eea0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f4bcc006fd0 tx=0x7f4bcc0090f0).ready entity=mon.0 client_cookie=3315379d9f9863b9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:41.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.730+0000 7f4bdf7fe700 1 -- 172.21.15.156:0/2308556464 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc00f510 con 0x7f4be0095f50 2023-09-30T22:16:41.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.730+0000 7f4bdf7fe700 1 -- 172.21.15.156:0/2308556464 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bcc00f670 con 0x7f4be0095f50 2023-09-30T22:16:41.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.730+0000 7f4bdf7fe700 1 -- 172.21.15.156:0/2308556464 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc00f9f0 con 0x7f4be0095f50 2023-09-30T22:16:41.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.731+0000 7f1ff27f5700 1 Processor -- start 2023-09-30T22:16:41.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.731+0000 7f4be6d41700 1 -- 172.21.15.156:0/2308556464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4be0095f50 msgr2=0x7f4be012eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:41.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.731+0000 7f4be6d41700 1 --2- 172.21.15.156:0/2308556464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4be0095f50 0x7f4be012eea0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f4bcc006fd0 tx=0x7f4bcc0090f0).stop 2023-09-30T22:16:41.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.731+0000 7f4be6d41700 1 -- 172.21.15.156:0/2308556464 shutdown_connections 2023-09-30T22:16:41.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.731+0000 7f4be6d41700 1 --2- 172.21.15.156:0/2308556464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4be012f390 0x7f4be0131780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:41.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.731+0000 7f4be6d41700 1 --2- 172.21.15.156:0/2308556464 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4be0095680 0x7f4be0095a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:41.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.731+0000 7f4be6d41700 1 --2- 172.21.15.156:0/2308556464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4be0095f50 0x7f4be012eea0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:41.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.731+0000 7f4be6d41700 1 -- 172.21.15.156:0/2308556464 >> 172.21.15.156:0/2308556464 conn(0x7f4be00971d0 msgr2=0x7f4be0099c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:41.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.731+0000 7f4be6d41700 1 -- 172.21.15.156:0/2308556464 shutdown_connections 2023-09-30T22:16:41.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.731+0000 7f4be6d41700 1 -- 172.21.15.156:0/2308556464 wait complete. 2023-09-30T22:16:41.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.731+0000 7f1ff27f5700 1 -- start start 2023-09-30T22:16:41.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.732+0000 7f4be6d41700 1 Processor -- start 2023-09-30T22:16:41.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.732+0000 7f1ff27f5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1fec065a60 0x7f1fec12ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:41.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.732+0000 7f1ff27f5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fec092990 0x7f1fec112200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:41.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.732+0000 7f1ff27f5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fec130350 0x7f1fec1126f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:41.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.732+0000 7f1ff27f5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec06a710 con 0x7f1fec130350 2023-09-30T22:16:41.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.732+0000 7f1ff27f5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec114ad0 con 0x7f1fec092990 2023-09-30T22:16:41.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.732+0000 7f1ff27f5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec12b410 con 0x7f1fec065a60 2023-09-30T22:16:41.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.732+0000 7f1ff0d92700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fec130350 0x7f1fec1126f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:41.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.732+0000 7f1ff0d92700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fec130350 0x7f1fec1126f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:35526/0 (socket says 172.21.15.156:35526) 2023-09-30T22:16:41.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.732+0000 7f1ff0d92700 1 -- 172.21.15.156:0/874765067 learned_addr learned my addr 172.21.15.156:0/874765067 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:41.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.732+0000 7f1febfff700 1 --2- 172.21.15.156:0/874765067 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1fec065a60 0x7f1fec12ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:41.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.732+0000 7f1feb7fe700 1 --2- 172.21.15.156:0/874765067 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fec092990 0x7f1fec112200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:41.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.732+0000 7f1febfff700 1 -- 172.21.15.156:0/874765067 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fec092990 msgr2=0x7f1fec112200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:41.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.732+0000 7f1febfff700 1 --2- 172.21.15.156:0/874765067 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fec092990 0x7f1fec112200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:41.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.732+0000 7f1febfff700 1 -- 172.21.15.156:0/874765067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fec130350 msgr2=0x7f1fec1126f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:41.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.732+0000 7f1febfff700 1 --2- 172.21.15.156:0/874765067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fec130350 0x7f1fec1126f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:41.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.732+0000 7f1febfff700 1 -- 172.21.15.156:0/874765067 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe4009a20 con 0x7f1fec065a60 2023-09-30T22:16:41.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.733+0000 7f1febfff700 1 --2- 172.21.15.156:0/874765067 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1fec065a60 0x7f1fec12ec50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1fdc001eb0 tx=0x7f1fdc007b90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:41.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.733+0000 7f1fd3fff700 1 -- 172.21.15.156:0/874765067 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc0070d0 con 0x7f1fec065a60 2023-09-30T22:16:41.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.733+0000 7f1fd3fff700 1 -- 172.21.15.156:0/874765067 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc007250 con 0x7f1fec065a60 2023-09-30T22:16:41.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.733+0000 7f1fd3fff700 1 -- 172.21.15.156:0/874765067 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc007610 con 0x7f1fec065a60 2023-09-30T22:16:41.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.732+0000 7f4be6d41700 1 -- start start 2023-09-30T22:16:41.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.733+0000 7f4be6d41700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4be0095680 0x7f4be008f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:41.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.733+0000 7f4be6d41700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4be0095f50 0x7f4be008fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:41.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.733+0000 7f4be6d41700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4be012f390 0x7f4be0082f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:41.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.733+0000 7f4be6d41700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be008a4b0 con 0x7f4be0095f50 2023-09-30T22:16:41.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.733+0000 7f4be6d41700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be0085290 con 0x7f4be0095680 2023-09-30T22:16:41.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.733+0000 7f4be6d41700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4be00903b0 con 0x7f4be012f390 2023-09-30T22:16:41.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.733+0000 7f4bdffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4be0095f50 0x7f4be008fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:41.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.733+0000 7f4bdffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4be0095f50 0x7f4be008fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:35536/0 (socket says 172.21.15.156:35536) 2023-09-30T22:16:41.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.733+0000 7f4bdffff700 1 -- 172.21.15.156:0/1115254100 learned_addr learned my addr 172.21.15.156:0/1115254100 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:41.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.733+0000 7f4bdffff700 1 -- 172.21.15.156:0/1115254100 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4be012f390 msgr2=0x7f4be0082f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:41.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.733+0000 7f4bdffff700 1 --2- 172.21.15.156:0/1115254100 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4be012f390 0x7f4be0082f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:16:41.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.733+0000 7f4bdffff700 1 -- 172.21.15.156:0/1115254100 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4be0095680 msgr2=0x7f4be008f9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:16:41.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.733+0000 7f4bdffff700 1 --2- 172.21.15.156:0/1115254100 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4be0095680 0x7f4be008f9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:16:41.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.733+0000 7f4bdffff700 1 -- 172.21.15.156:0/1115254100 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bcc009370 con 0x7f4be0095f50 2023-09-30T22:16:41.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.734+0000 7f4bdffff700 1 --2- 172.21.15.156:0/1115254100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4be0095f50 0x7f4be008fec0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f4be00912c0 tx=0x7f4bcc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:41.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.733+0000 7f1ff27f5700 1 -- 172.21.15.156:0/874765067 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fec113820 con 0x7f1fec065a60 2023-09-30T22:16:41.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.733+0000 7f1ff27f5700 1 -- 172.21.15.156:0/874765067 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fec12fa20 con 0x7f1fec065a60 2023-09-30T22:16:41.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.734+0000 7f4bdcff9700 1 -- 172.21.15.156:0/1115254100 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc00f7e0 con 0x7f4be0095f50 2023-09-30T22:16:41.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.734+0000 7f4bdcff9700 1 -- 172.21.15.156:0/1115254100 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bcc00f940 con 0x7f4be0095f50 2023-09-30T22:16:41.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.734+0000 7f4be6d41700 1 -- 172.21.15.156:0/1115254100 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be0086100 con 0x7f4be0095f50 2023-09-30T22:16:41.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.734+0000 7f4be6d41700 1 -- 172.21.15.156:0/1115254100 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be00866d0 con 0x7f4be0095f50 2023-09-30T22:16:41.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.734+0000 7f1ff27f5700 1 -- 172.21.15.156:0/874765067 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fec114910 con 0x7f1fec065a60 2023-09-30T22:16:41.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.734+0000 7f4bdcff9700 1 -- 172.21.15.156:0/1115254100 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc01c670 con 0x7f4be0095f50 2023-09-30T22:16:41.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.735+0000 7f1fd3fff700 1 -- 172.21.15.156:0/874765067 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f1fdc0059b0 con 0x7f1fec065a60 2023-09-30T22:16:41.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.735+0000 7f1fd3fff700 1 -- 172.21.15.156:0/874765067 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f1fdc03a5a0 con 0x7f1fec065a60 2023-09-30T22:16:41.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.735+0000 7f4bdcff9700 1 -- 172.21.15.156:0/1115254100 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4bcc01ca60 con 0x7f4be0095f50 2023-09-30T22:16:41.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.735+0000 7f4bdcff9700 1 -- 172.21.15.156:0/1115254100 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f4bcc03cca0 con 0x7f4be0095f50 2023-09-30T22:16:41.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.735+0000 7f4be6d41700 1 -- 172.21.15.156:0/1115254100 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc0005120 con 0x7f4be0095f50 2023-09-30T22:16:41.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.740+0000 7f4bdcff9700 1 -- 172.21.15.156:0/1115254100 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4bcc020030 con 0x7f4be0095f50 2023-09-30T22:16:41.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.740+0000 7f1fd3fff700 1 -- 172.21.15.156:0/874765067 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f1fdc005e40 con 0x7f1fec065a60 2023-09-30T22:16:41.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.771+0000 7f01d2c4c700 1 Processor -- start 2023-09-30T22:16:41.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.771+0000 7f01d2c4c700 1 -- start start 2023-09-30T22:16:41.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.772+0000 7f01d2c4c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f01cc095e70 0x7f01cc096250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:41.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.772+0000 7f01d2c4c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f01cc12d250 0x7f01cc12f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:41.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.772+0000 7f01d2c4c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01cc094ba0 con 0x7f01cc093950 2023-09-30T22:16:41.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.772+0000 7f01d2c4c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01cc092e90 con 0x7f01cc095e70 2023-09-30T22:16:41.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.772+0000 7f01d2c4c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc096b60 con 0x7f01cc12d250 2023-09-30T22:16:41.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.772+0000 7f5dbe146700 1 Processor -- start 2023-09-30T22:16:41.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.772+0000 7f01cbfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f01cc095e70 0x7f01cc096250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:41.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.772+0000 7f01cbfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f01cc095e70 0x7f01cc096250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:35548/0 (socket says 172.21.15.156:35548) 2023-09-30T22:16:41.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.772+0000 7f01cbfff700 1 -- 172.21.15.156:0/1642888316 learned_addr learned my addr 172.21.15.156:0/1642888316 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:41.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.772+0000 7f01d09e8700 1 --1- 172.21.15.156:0/1642888316 >> v1:172.21.15.156:6789/0 conn(0x7f01cc093950 0x7f01cc095760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47298/0 (socket says 172.21.15.156:47298) 2023-09-30T22:16:41.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.772+0000 7f01d11e9700 1 --2- 172.21.15.156:0/1642888316 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f01cc12d250 0x7f01cc12f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:41.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.772+0000 7f5dbe146700 1 -- start start 2023-09-30T22:16:41.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.773+0000 7f01cbfff700 1 -- 172.21.15.156:0/1642888316 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f01cc12d250 msgr2=0x7f01cc12f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:41.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.773+0000 7f01cbfff700 1 --2- 172.21.15.156:0/1642888316 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f01cc12d250 0x7f01cc12f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:41.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.773+0000 7f01cbfff700 1 -- 172.21.15.156:0/1642888316 >> v1:172.21.15.156:6789/0 conn(0x7f01cc093950 legacy=0x7f01cc095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:41.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.773+0000 7f01cbfff700 1 -- 172.21.15.156:0/1642888316 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc093150 con 0x7f01cc095e70 2023-09-30T22:16:41.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.773+0000 7f01cbfff700 1 --2- 172.21.15.156:0/1642888316 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01cc095e70 0x7f01cc096250 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f01b8006fd0 tx=0x7f01b800b3b0).ready entity=mon.0 client_cookie=8d41f5be95d3e101 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:41.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.773+0000 7f5dbe146700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5db8095da0 0x7f5db80961c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:41.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.773+0000 7f5dbe146700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5db80966b0 0x7f5db8132290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:41.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.773+0000 7f5dbe146700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5db8091980 con 0x7f5db8062b00 2023-09-30T22:16:41.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.773+0000 7f5dbe146700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5db80973f0 con 0x7f5db8095da0 2023-09-30T22:16:41.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.773+0000 7f5dbe146700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5db8062ee0 con 0x7f5db80966b0 2023-09-30T22:16:41.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.773+0000 7f5db7fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5db80966b0 0x7f5db8132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:41.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.773+0000 7f5db7fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5db80966b0 0x7f5db8132290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39874/0 (socket says 172.21.15.156:39874) 2023-09-30T22:16:41.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.773+0000 7f5db7fff700 1 -- 172.21.15.156:0/1451673637 learned_addr learned my addr 172.21.15.156:0/1451673637 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:41.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.773+0000 7f5db6ffd700 1 --2- 172.21.15.156:0/1451673637 >> v2:172.21.15.156:3300/0 conn(0x7f5db8095da0 0x7f5db80961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:41.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.773+0000 7f5db7fff700 1 -- 172.21.15.156:0/1451673637 >> v2:172.21.15.156:3300/0 conn(0x7f5db8095da0 msgr2=0x7f5db80961c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:41.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.773+0000 7f5db7fff700 1 --2- 172.21.15.156:0/1451673637 >> v2:172.21.15.156:3300/0 conn(0x7f5db8095da0 0x7f5db80961c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:41.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.773+0000 7f5db7fff700 1 -- 172.21.15.156:0/1451673637 >> v1:172.21.15.156:6789/0 conn(0x7f5db8062b00 legacy=0x7f5db8095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:41.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.774+0000 7f5db7fff700 1 -- 172.21.15.156:0/1451673637 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db8092310 con 0x7f5db80966b0 2023-09-30T22:16:41.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.774+0000 7f5db7fff700 1 --2- 172.21.15.156:0/1451673637 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5db80966b0 0x7f5db8132290 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f5db0009f20 tx=0x7f5db0009840).ready entity=mon.2 client_cookie=4b6aefb585947eec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:41.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.774+0000 7f01cb7fe700 1 -- 172.21.15.156:0/1642888316 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b800db40 con 0x7f01cc095e70 2023-09-30T22:16:41.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.774+0000 7f5db67fc700 1 -- 172.21.15.156:0/1451673637 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db000e070 con 0x7f5db80966b0 2023-09-30T22:16:41.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.774+0000 7f5db67fc700 1 -- 172.21.15.156:0/1451673637 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db000b9d0 con 0x7f5db80966b0 2023-09-30T22:16:41.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.774+0000 7f5db67fc700 1 -- 172.21.15.156:0/1451673637 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db000bd50 con 0x7f5db80966b0 2023-09-30T22:16:41.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.774+0000 7f5dbe146700 1 -- 172.21.15.156:0/1451673637 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5db80966b0 msgr2=0x7f5db8132290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:41.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.774+0000 7f5dbe146700 1 --2- 172.21.15.156:0/1451673637 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5db80966b0 0x7f5db8132290 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f5db0009f20 tx=0x7f5db0009840).stop 2023-09-30T22:16:41.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.774+0000 7f01cb7fe700 1 -- 172.21.15.156:0/1642888316 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b800dca0 con 0x7f01cc095e70 2023-09-30T22:16:41.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.774+0000 7f01cb7fe700 1 -- 172.21.15.156:0/1642888316 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b8010680 con 0x7f01cc095e70 2023-09-30T22:16:41.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.775+0000 7f01d2c4c700 1 -- 172.21.15.156:0/1642888316 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01cc095e70 msgr2=0x7f01cc096250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:41.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.775+0000 7f01d2c4c700 1 --2- 172.21.15.156:0/1642888316 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01cc095e70 0x7f01cc096250 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f01b8006fd0 tx=0x7f01b800b3b0).stop 2023-09-30T22:16:41.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.775+0000 7f5dbe146700 1 -- 172.21.15.156:0/1451673637 shutdown_connections 2023-09-30T22:16:41.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.775+0000 7f5dbe146700 1 --2- 172.21.15.156:0/1451673637 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5db80966b0 0x7f5db8132290 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:41.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.775+0000 7f5dbe146700 1 --2- 172.21.15.156:0/1451673637 >> v2:172.21.15.156:3300/0 conn(0x7f5db8095da0 0x7f5db80961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:41.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.775+0000 7f5dbe146700 1 -- 172.21.15.156:0/1451673637 >> 172.21.15.156:0/1451673637 conn(0x7f5db809aa50 msgr2=0x7f5db809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:41.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.775+0000 7f5dbe146700 1 -- 172.21.15.156:0/1451673637 shutdown_connections 2023-09-30T22:16:41.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.775+0000 7f01d2c4c700 1 -- 172.21.15.156:0/1642888316 shutdown_connections 2023-09-30T22:16:41.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.775+0000 7f01d2c4c700 1 --2- 172.21.15.156:0/1642888316 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f01cc12d250 0x7f01cc12f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:41.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.775+0000 7f01d2c4c700 1 --2- 172.21.15.156:0/1642888316 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01cc095e70 0x7f01cc096250 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:41.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.775+0000 7f01d2c4c700 1 -- 172.21.15.156:0/1642888316 >> 172.21.15.156:0/1642888316 conn(0x7f01cc09aa50 msgr2=0x7f01cc09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:41.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.775+0000 7f5dbe146700 1 -- 172.21.15.156:0/1451673637 wait complete. 2023-09-30T22:16:41.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.775+0000 7f01d2c4c700 1 -- 172.21.15.156:0/1642888316 shutdown_connections 2023-09-30T22:16:41.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.775+0000 7f01d2c4c700 1 -- 172.21.15.156:0/1642888316 wait complete. 2023-09-30T22:16:41.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.776+0000 7f01d2c4c700 1 Processor -- start 2023-09-30T22:16:41.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.776+0000 7f5dbe146700 1 Processor -- start 2023-09-30T22:16:41.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.776+0000 7f5dbe146700 1 -- start start 2023-09-30T22:16:41.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.776+0000 7f5dbe146700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5db8062b00 0x7f5db8066860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:41.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.776+0000 7f5dbe146700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5db8095da0 0x7f5db8066d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:41.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.776+0000 7f5dbe146700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5db80966b0 0x7f5db8067240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:41.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.776+0000 7f5dbe146700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db8099980 con 0x7f5db8062b00 2023-09-30T22:16:41.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.776+0000 7f5dbe146700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db8096da0 con 0x7f5db80966b0 2023-09-30T22:16:41.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.776+0000 7f5dbe146700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5db8069790 con 0x7f5db8095da0 2023-09-30T22:16:41.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.776+0000 7f5db6ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5db8095da0 0x7f5db8066d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:41.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.776+0000 7f5db6ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5db8095da0 0x7f5db8066d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39880/0 (socket says 172.21.15.156:39880) 2023-09-30T22:16:41.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.776+0000 7f5db6ffd700 1 -- 172.21.15.156:0/3498135335 learned_addr learned my addr 172.21.15.156:0/3498135335 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:41.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.777+0000 7f5db7fff700 1 --2- 172.21.15.156:0/3498135335 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5db80966b0 0x7f5db8067240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:41.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.777+0000 7f5db6ffd700 1 -- 172.21.15.156:0/3498135335 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5db80966b0 msgr2=0x7f5db8067240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:41.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.777+0000 7f5db6ffd700 1 --2- 172.21.15.156:0/3498135335 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5db80966b0 0x7f5db8067240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:41.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.777+0000 7f5db6ffd700 1 -- 172.21.15.156:0/3498135335 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5db8062b00 msgr2=0x7f5db8066860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:16:41.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.777+0000 7f5db6ffd700 1 --2- 172.21.15.156:0/3498135335 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5db8062b00 0x7f5db8066860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:16:41.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.777+0000 7f5db6ffd700 1 -- 172.21.15.156:0/3498135335 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db0009ae0 con 0x7f5db8095da0 2023-09-30T22:16:41.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.777+0000 7f5db6ffd700 1 --2- 172.21.15.156:0/3498135335 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5db8095da0 0x7f5db8066d50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f5dac00e930 tx=0x7f5dac009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:41.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.776+0000 7f01d2c4c700 1 -- start start 2023-09-30T22:16:41.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.776+0000 7f01d2c4c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01cc093950 0x7f01cc12af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:41.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.776+0000 7f01d2c4c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01cc095e70 0x7f01cc12b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:41.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.776+0000 7f01d2c4c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f01cc12d250 0x7f01cc12baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:41.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.776+0000 7f01d2c4c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc129f30 con 0x7f01cc095e70 2023-09-30T22:16:41.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.776+0000 7f01d2c4c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc092410 con 0x7f01cc093950 2023-09-30T22:16:41.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.776+0000 7f01d2c4c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc12a480 con 0x7f01cc12d250 2023-09-30T22:16:41.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.777+0000 7f01d11e9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f01cc12d250 0x7f01cc12baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:41.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.777+0000 7f01d11e9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f01cc12d250 0x7f01cc12baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39890/0 (socket says 172.21.15.156:39890) 2023-09-30T22:16:41.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.777+0000 7f01d11e9700 1 -- 172.21.15.156:0/3930807585 learned_addr learned my addr 172.21.15.156:0/3930807585 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:41.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.777+0000 7f01d09e8700 1 --2- 172.21.15.156:0/3930807585 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01cc093950 0x7f01cc12af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:41.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.777+0000 7f01d09e8700 1 -- 172.21.15.156:0/3930807585 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f01cc12d250 msgr2=0x7f01cc12baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:41.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.777+0000 7f01d09e8700 1 --2- 172.21.15.156:0/3930807585 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f01cc12d250 0x7f01cc12baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:41.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.777+0000 7f01d09e8700 1 -- 172.21.15.156:0/3930807585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01cc095e70 msgr2=0x7f01cc12b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:41.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.777+0000 7f01d09e8700 1 --2- 172.21.15.156:0/3930807585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01cc095e70 0x7f01cc12b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:16:41.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.777+0000 7f01d09e8700 1 -- 172.21.15.156:0/3930807585 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b800b610 con 0x7f01cc093950 2023-09-30T22:16:41.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.777+0000 7f5d9f7fe700 1 -- 172.21.15.156:0/3498135335 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac009510 con 0x7f5db8095da0 2023-09-30T22:16:41.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.777+0000 7f01d09e8700 1 --2- 172.21.15.156:0/3930807585 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01cc093950 0x7f01cc12af20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f01c000c410 tx=0x7f01c0007d30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:41.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.777+0000 7f01c8ff9700 1 -- 172.21.15.156:0/3930807585 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c000ce70 con 0x7f01cc093950 2023-09-30T22:16:41.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.777+0000 7f01c8ff9700 1 -- 172.21.15.156:0/3930807585 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c00072e0 con 0x7f01cc093950 2023-09-30T22:16:41.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.777+0000 7f01d2c4c700 1 -- 172.21.15.156:0/3930807585 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01cc12a740 con 0x7f01cc093950 2023-09-30T22:16:41.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.778+0000 7f01c8ff9700 1 -- 172.21.15.156:0/3930807585 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c00056e0 con 0x7f01cc093950 2023-09-30T22:16:41.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.778+0000 7f01d2c4c700 1 -- 172.21.15.156:0/3930807585 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01cc12bfe0 con 0x7f01cc093950 2023-09-30T22:16:41.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.777+0000 7f5d9f7fe700 1 -- 172.21.15.156:0/3498135335 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dac00c670 con 0x7f5db8095da0 2023-09-30T22:16:41.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.777+0000 7f5dbe146700 1 -- 172.21.15.156:0/3498135335 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db806a140 con 0x7f5db8095da0 2023-09-30T22:16:41.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.777+0000 7f5d9f7fe700 1 -- 172.21.15.156:0/3498135335 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac00c9f0 con 0x7f5db8095da0 2023-09-30T22:16:41.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.777+0000 7f5dbe146700 1 -- 172.21.15.156:0/3498135335 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db80683f0 con 0x7f5db8095da0 2023-09-30T22:16:41.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.779+0000 7f5dbe146700 1 -- 172.21.15.156:0/3498135335 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5db805a260 con 0x7f5db8095da0 2023-09-30T22:16:41.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.779+0000 7f01d2c4c700 1 -- 172.21.15.156:0/3930807585 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01cc09a040 con 0x7f01cc093950 2023-09-30T22:16:41.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.779+0000 7f5d9f7fe700 1 -- 172.21.15.156:0/3498135335 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f5dac01b400 con 0x7f5db8095da0 2023-09-30T22:16:41.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.779+0000 7f01c8ff9700 1 -- 172.21.15.156:0/3930807585 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f01c0005ad0 con 0x7f01cc093950 2023-09-30T22:16:41.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.780+0000 7f01c8ff9700 1 -- 172.21.15.156:0/3930807585 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f01c003a6c0 con 0x7f01cc093950 2023-09-30T22:16:41.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.780+0000 7f5d9f7fe700 1 -- 172.21.15.156:0/3498135335 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f5dac03b450 con 0x7f5db8095da0 2023-09-30T22:16:41.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.784+0000 7f5d9f7fe700 1 -- 172.21.15.156:0/3498135335 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f5dac011b00 con 0x7f5db8095da0 2023-09-30T22:16:41.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.784+0000 7f01c8ff9700 1 -- 172.21.15.156:0/3930807585 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f01c0005d80 con 0x7f01cc093950 2023-09-30T22:16:41.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.909+0000 7f1ff27f5700 1 -- 172.21.15.156:0/874765067 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1fec114700 con 0x7f1fec065a60 2023-09-30T22:16:41.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.909+0000 7f1fd3fff700 1 -- 172.21.15.156:0/874765067 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1fdc010910 con 0x7f1fec065a60 2023-09-30T22:16:41.910 INFO:teuthology.orchestra.run.smithi156.stdout:38654705669 2023-09-30T22:16:41.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.912+0000 7f1ff27f5700 1 -- 172.21.15.156:0/874765067 >> v1:172.21.15.156:6816/118236 conn(0x7f1fd802bb60 legacy=0x7f1fd802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:41.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.912+0000 7f1ff27f5700 1 -- 172.21.15.156:0/874765067 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1fec065a60 msgr2=0x7f1fec12ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:41.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.912+0000 7f1ff27f5700 1 --2- 172.21.15.156:0/874765067 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1fec065a60 0x7f1fec12ec50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1fdc001eb0 tx=0x7f1fdc007b90).stop 2023-09-30T22:16:41.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.912+0000 7f1ff27f5700 1 -- 172.21.15.156:0/874765067 shutdown_connections 2023-09-30T22:16:41.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.912+0000 7f1ff27f5700 1 --2- 172.21.15.156:0/874765067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fec130350 0x7f1fec1126f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:41.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.912+0000 7f1ff27f5700 1 --2- 172.21.15.156:0/874765067 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1fec065a60 0x7f1fec12ec50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:41.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.912+0000 7f1ff27f5700 1 --2- 172.21.15.156:0/874765067 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fec092990 0x7f1fec112200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:41.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.912+0000 7f1ff27f5700 1 -- 172.21.15.156:0/874765067 >> 172.21.15.156:0/874765067 conn(0x7f1fec09bba0 msgr2=0x7f1fec099aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:41.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.912+0000 7f1ff27f5700 1 -- 172.21.15.156:0/874765067 shutdown_connections 2023-09-30T22:16:41.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.912+0000 7f1ff27f5700 1 -- 172.21.15.156:0/874765067 wait complete. 2023-09-30T22:16:41.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.919+0000 7f4be6d41700 1 -- 172.21.15.156:0/1115254100 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4bc00057f0 con 0x7f4be0095f50 2023-09-30T22:16:41.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.919+0000 7f4bdcff9700 1 -- 172.21.15.156:0/1115254100 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4bcc034090 con 0x7f4be0095f50 2023-09-30T22:16:41.920 INFO:teuthology.orchestra.run.smithi156.stdout:38654705669 2023-09-30T22:16:41.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.921+0000 7f4be6d41700 1 -- 172.21.15.156:0/1115254100 >> v1:172.21.15.156:6816/118236 conn(0x7f4bc402bb60 legacy=0x7f4bc402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:41.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.921+0000 7f4be6d41700 1 -- 172.21.15.156:0/1115254100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4be0095f50 msgr2=0x7f4be008fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:41.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.921+0000 7f4be6d41700 1 --2- 172.21.15.156:0/1115254100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4be0095f50 0x7f4be008fec0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f4be00912c0 tx=0x7f4bcc017000).stop 2023-09-30T22:16:41.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.921+0000 7f4be6d41700 1 -- 172.21.15.156:0/1115254100 shutdown_connections 2023-09-30T22:16:41.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.921+0000 7f4be6d41700 1 --2- 172.21.15.156:0/1115254100 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4be012f390 0x7f4be0082f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:16:41.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.922+0000 7f4be6d41700 1 --2- 172.21.15.156:0/1115254100 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4be0095680 0x7f4be008f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:16:41.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.922+0000 7f4be6d41700 1 --2- 172.21.15.156:0/1115254100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4be0095f50 0x7f4be008fec0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:41.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.922+0000 7f4be6d41700 1 -- 172.21.15.156:0/1115254100 >> 172.21.15.156:0/1115254100 conn(0x7f4be00971d0 msgr2=0x7f4be012e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:41.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.922+0000 7f4be6d41700 1 -- 172.21.15.156:0/1115254100 shutdown_connections 2023-09-30T22:16:41.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.922+0000 7f4be6d41700 1 -- 172.21.15.156:0/1115254100 wait complete. 2023-09-30T22:16:41.927 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705669 for osd.3 2023-09-30T22:16:41.928 DEBUG:teuthology.parallel:result is None 2023-09-30T22:16:41.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705669 for osd.2 2023-09-30T22:16:41.935 DEBUG:teuthology.parallel:result is None 2023-09-30T22:16:41.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.952+0000 7f01d2c4c700 1 -- 172.21.15.156:0/3930807585 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f01cc12c6b0 con 0x7f01cc093950 2023-09-30T22:16:41.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.952+0000 7f01c8ff9700 1 -- 172.21.15.156:0/3930807585 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f01c001c350 con 0x7f01cc093950 2023-09-30T22:16:41.953 INFO:teuthology.orchestra.run.smithi156.stdout:38654705669 2023-09-30T22:16:41.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.953+0000 7f5dbe146700 1 -- 172.21.15.156:0/3498135335 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5db8046c20 con 0x7f5db8095da0 2023-09-30T22:16:41.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.954+0000 7f5d9f7fe700 1 -- 172.21.15.156:0/3498135335 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5dac011b00 con 0x7f5db8095da0 2023-09-30T22:16:41.954 INFO:teuthology.orchestra.run.smithi156.stdout:38654705669 2023-09-30T22:16:41.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.954+0000 7f01d2c4c700 1 -- 172.21.15.156:0/3930807585 >> v1:172.21.15.156:6816/118236 conn(0x7f01b002bb60 legacy=0x7f01b002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:41.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.954+0000 7f01d2c4c700 1 -- 172.21.15.156:0/3930807585 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01cc093950 msgr2=0x7f01cc12af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:41.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.954+0000 7f01d2c4c700 1 --2- 172.21.15.156:0/3930807585 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01cc093950 0x7f01cc12af20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f01c000c410 tx=0x7f01c0007d30).stop 2023-09-30T22:16:41.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.954+0000 7f01d2c4c700 1 -- 172.21.15.156:0/3930807585 shutdown_connections 2023-09-30T22:16:41.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.954+0000 7f01d2c4c700 1 --2- 172.21.15.156:0/3930807585 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f01cc12d250 0x7f01cc12baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:41.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.954+0000 7f01d2c4c700 1 --2- 172.21.15.156:0/3930807585 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01cc093950 0x7f01cc12af20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:41.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.954+0000 7f01d2c4c700 1 --2- 172.21.15.156:0/3930807585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01cc095e70 0x7f01cc12b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:16:41.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.954+0000 7f01d2c4c700 1 -- 172.21.15.156:0/3930807585 >> 172.21.15.156:0/3930807585 conn(0x7f01cc09aa50 msgr2=0x7f01cc062aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:41.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.954+0000 7f01d2c4c700 1 -- 172.21.15.156:0/3930807585 shutdown_connections 2023-09-30T22:16:41.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.954+0000 7f01d2c4c700 1 -- 172.21.15.156:0/3930807585 wait complete. 2023-09-30T22:16:41.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.956+0000 7f5dbe146700 1 -- 172.21.15.156:0/3498135335 >> v1:172.21.15.156:6816/118236 conn(0x7f5da402bb30 legacy=0x7f5da402dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:41.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.956+0000 7f5dbe146700 1 -- 172.21.15.156:0/3498135335 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5db8095da0 msgr2=0x7f5db8066d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:41.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.956+0000 7f5dbe146700 1 --2- 172.21.15.156:0/3498135335 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5db8095da0 0x7f5db8066d50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f5dac00e930 tx=0x7f5dac009060).stop 2023-09-30T22:16:41.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.956+0000 7f5dbe146700 1 -- 172.21.15.156:0/3498135335 shutdown_connections 2023-09-30T22:16:41.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.956+0000 7f5dbe146700 1 --2- 172.21.15.156:0/3498135335 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5db80966b0 0x7f5db8067240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:41.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.956+0000 7f5dbe146700 1 --2- 172.21.15.156:0/3498135335 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5db8062b00 0x7f5db8066860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:16:41.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.956+0000 7f5dbe146700 1 --2- 172.21.15.156:0/3498135335 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5db8095da0 0x7f5db8066d50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:41.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.956+0000 7f5dbe146700 1 -- 172.21.15.156:0/3498135335 >> 172.21.15.156:0/3498135335 conn(0x7f5db809aa50 msgr2=0x7f5db8132000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:41.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.956+0000 7f5dbe146700 1 -- 172.21.15.156:0/3498135335 shutdown_connections 2023-09-30T22:16:41.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:41.956+0000 7f5dbe146700 1 -- 172.21.15.156:0/3498135335 wait complete. 2023-09-30T22:16:41.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2023-09-30T22:16:41.968 DEBUG:teuthology.parallel:result is None 2023-09-30T22:16:41.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.1 2023-09-30T22:16:41.969 DEBUG:teuthology.parallel:result is None 2023-09-30T22:16:41.969 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-30T22:16:41.969 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:16:42.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.125+0000 7f7f1b2b6700 1 Processor -- start 2023-09-30T22:16:42.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.125+0000 7f7f1b2b6700 1 -- start start 2023-09-30T22:16:42.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.125+0000 7f7f1b2b6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7f14095e70 0x7f7f14096250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:42.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.125+0000 7f7f1b2b6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7f1412d250 0x7f7f1412f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:42.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.125+0000 7f7f1b2b6700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f14094ba0 con 0x7f7f14093950 2023-09-30T22:16:42.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.125+0000 7f7f1b2b6700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f14092e90 con 0x7f7f14095e70 2023-09-30T22:16:42.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.125+0000 7f7f1b2b6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f14096b60 con 0x7f7f1412d250 2023-09-30T22:16:42.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.125+0000 7f7f19853700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7f1412d250 0x7f7f1412f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:42.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.125+0000 7f7f19853700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7f1412d250 0x7f7f1412f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39902/0 (socket says 172.21.15.156:39902) 2023-09-30T22:16:42.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.125+0000 7f7f18851700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7f14095e70 0x7f7f14096250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:42.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.125+0000 7f7f19853700 1 -- 172.21.15.156:0/1524289108 learned_addr learned my addr 172.21.15.156:0/1524289108 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:42.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.125+0000 7f7f19052700 1 --1- 172.21.15.156:0/1524289108 >> v1:172.21.15.156:6789/0 conn(0x7f7f14093950 0x7f7f14095760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47316/0 (socket says 172.21.15.156:47316) 2023-09-30T22:16:42.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.126+0000 7f7f18851700 1 -- 172.21.15.156:0/1524289108 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7f1412d250 msgr2=0x7f7f1412f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:42.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.126+0000 7f7f18851700 1 --2- 172.21.15.156:0/1524289108 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7f1412d250 0x7f7f1412f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:42.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.126+0000 7f7f18851700 1 -- 172.21.15.156:0/1524289108 >> v1:172.21.15.156:6789/0 conn(0x7f7f14093950 legacy=0x7f7f14095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:42.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.126+0000 7f7f0bfff700 1 -- 172.21.15.156:0/1524289108 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2978511344 0 0) 0x7f7f14094ba0 con 0x7f7f14093950 2023-09-30T22:16:42.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.126+0000 7f7f18851700 1 -- 172.21.15.156:0/1524289108 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f14093150 con 0x7f7f14095e70 2023-09-30T22:16:42.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.126+0000 7f7f19853700 1 --2- 172.21.15.156:0/1524289108 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7f1412d250 0x7f7f1412f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:42.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.126+0000 7f7f18851700 1 --2- 172.21.15.156:0/1524289108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f14095e70 0x7f7f14096250 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f7f04009760 tx=0x7f7f04009060).ready entity=mon.0 client_cookie=2619cec13843312b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:42.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.126+0000 7f7f0bfff700 1 -- 172.21.15.156:0/1524289108 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f040090d0 con 0x7f7f14095e70 2023-09-30T22:16:42.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.126+0000 7f7f0bfff700 1 -- 172.21.15.156:0/1524289108 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0400f510 con 0x7f7f14095e70 2023-09-30T22:16:42.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.126+0000 7f7f0bfff700 1 -- 172.21.15.156:0/1524289108 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0400f890 con 0x7f7f14095e70 2023-09-30T22:16:42.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.126+0000 7f7f1b2b6700 1 -- 172.21.15.156:0/1524289108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f14095e70 msgr2=0x7f7f14096250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:42.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.126+0000 7f7f1b2b6700 1 --2- 172.21.15.156:0/1524289108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f14095e70 0x7f7f14096250 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f7f04009760 tx=0x7f7f04009060).stop 2023-09-30T22:16:42.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.127+0000 7f7f1b2b6700 1 -- 172.21.15.156:0/1524289108 shutdown_connections 2023-09-30T22:16:42.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.127+0000 7f7f1b2b6700 1 --2- 172.21.15.156:0/1524289108 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7f1412d250 0x7f7f1412f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:42.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.127+0000 7f7f1b2b6700 1 --2- 172.21.15.156:0/1524289108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f14095e70 0x7f7f14096250 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:42.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.127+0000 7f7f1b2b6700 1 -- 172.21.15.156:0/1524289108 >> 172.21.15.156:0/1524289108 conn(0x7f7f1409aa50 msgr2=0x7f7f1409ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:42.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.127+0000 7f7f1b2b6700 1 -- 172.21.15.156:0/1524289108 shutdown_connections 2023-09-30T22:16:42.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.127+0000 7f7f1b2b6700 1 -- 172.21.15.156:0/1524289108 wait complete. 2023-09-30T22:16:42.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.127+0000 7f7f1b2b6700 1 Processor -- start 2023-09-30T22:16:42.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.127+0000 7f7f1b2b6700 1 -- start start 2023-09-30T22:16:42.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.128+0000 7f7f1b2b6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7f14093950 0x7f7f14116d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:42.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.128+0000 7f7f1b2b6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7f14095e70 0x7f7f14117210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:42.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.128+0000 7f7f1b2b6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f1412d250 0x7f7f14117700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:42.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.128+0000 7f7f1b2b6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1411d3c0 con 0x7f7f1412d250 2023-09-30T22:16:42.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.128+0000 7f7f1b2b6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1411e730 con 0x7f7f14093950 2023-09-30T22:16:42.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.128+0000 7f7f1b2b6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1409a320 con 0x7f7f14095e70 2023-09-30T22:16:42.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.128+0000 7f7f19853700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f1412d250 0x7f7f14117700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:42.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.128+0000 7f7f19052700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7f14093950 0x7f7f14116d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:42.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.128+0000 7f7f19853700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f1412d250 0x7f7f14117700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:35576/0 (socket says 172.21.15.156:35576) 2023-09-30T22:16:42.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.128+0000 7f7f19853700 1 -- 172.21.15.156:0/3196138439 learned_addr learned my addr 172.21.15.156:0/3196138439 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:42.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.128+0000 7f7f18851700 1 --2- 172.21.15.156:0/3196138439 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7f14095e70 0x7f7f14117210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:42.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.128+0000 7f7f19052700 1 -- 172.21.15.156:0/3196138439 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7f14095e70 msgr2=0x7f7f14117210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:42.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.128+0000 7f7f19052700 1 --2- 172.21.15.156:0/3196138439 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7f14095e70 0x7f7f14117210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:42.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.128+0000 7f7f19052700 1 -- 172.21.15.156:0/3196138439 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f1412d250 msgr2=0x7f7f14117700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:42.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.128+0000 7f7f19052700 1 --2- 172.21.15.156:0/3196138439 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f1412d250 0x7f7f14117700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:42.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.128+0000 7f7f19052700 1 -- 172.21.15.156:0/3196138439 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0c009ae0 con 0x7f7f14093950 2023-09-30T22:16:42.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.128+0000 7f7f19853700 1 --2- 172.21.15.156:0/3196138439 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f1412d250 0x7f7f14117700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:42.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.129+0000 7f7f19052700 1 --2- 172.21.15.156:0/3196138439 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7f14093950 0x7f7f14116d20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f7f10000c00 tx=0x7f7f10007bb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:42.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.129+0000 7f7f097fa700 1 -- 172.21.15.156:0/3196138439 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f100070d0 con 0x7f7f14093950 2023-09-30T22:16:42.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.129+0000 7f7f097fa700 1 -- 172.21.15.156:0/3196138439 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f10007230 con 0x7f7f14093950 2023-09-30T22:16:42.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.129+0000 7f7f097fa700 1 -- 172.21.15.156:0/3196138439 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f100056e0 con 0x7f7f14093950 2023-09-30T22:16:42.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.129+0000 7f7f1b2b6700 1 -- 172.21.15.156:0/3196138439 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f040092a0 con 0x7f7f14093950 2023-09-30T22:16:42.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.129+0000 7f7f1b2b6700 1 -- 172.21.15.156:0/3196138439 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f14062cc0 con 0x7f7f14093950 2023-09-30T22:16:42.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.129+0000 7f7f097fa700 1 -- 172.21.15.156:0/3196138439 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7f10005a90 con 0x7f7f14093950 2023-09-30T22:16:42.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.130+0000 7f7f097fa700 1 -- 172.21.15.156:0/3196138439 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f7f1003a5c0 con 0x7f7f14093950 2023-09-30T22:16:42.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.130+0000 7f7f1b2b6700 1 -- 172.21.15.156:0/3196138439 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f1405a260 con 0x7f7f14093950 2023-09-30T22:16:42.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.134+0000 7f7f097fa700 1 -- 172.21.15.156:0/3196138439 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f7f1001c350 con 0x7f7f14093950 2023-09-30T22:16:42.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.290+0000 7f7f1b2b6700 1 -- 172.21.15.156:0/3196138439 --> v1:172.21.15.156:6816/118236 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7f14046c20 con 0x7f7ef802bb90 2023-09-30T22:16:42.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.296+0000 7f7f097fa700 1 -- 172.21.15.156:0/3196138439 <== mgr.4122 v1:172.21.15.156:6816/118236 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249955 (unknown 2965378022 0 3742791872) 0x7f7f14046c20 con 0x7f7ef802bb90 2023-09-30T22:16:42.299 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:42.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.299+0000 7f7f1b2b6700 1 -- 172.21.15.156:0/3196138439 >> v1:172.21.15.156:6816/118236 conn(0x7f7ef802bb90 legacy=0x7f7ef802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:42.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.299+0000 7f7f1b2b6700 1 -- 172.21.15.156:0/3196138439 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7f14093950 msgr2=0x7f7f14116d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:42.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.299+0000 7f7f1b2b6700 1 --2- 172.21.15.156:0/3196138439 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7f14093950 0x7f7f14116d20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f7f10000c00 tx=0x7f7f10007bb0).stop 2023-09-30T22:16:42.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.299+0000 7f7f1b2b6700 1 -- 172.21.15.156:0/3196138439 shutdown_connections 2023-09-30T22:16:42.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.299+0000 7f7f1b2b6700 1 --2- 172.21.15.156:0/3196138439 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f1412d250 0x7f7f14117700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:42.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.299+0000 7f7f1b2b6700 1 --2- 172.21.15.156:0/3196138439 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7f14093950 0x7f7f14116d20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:42.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.299+0000 7f7f1b2b6700 1 --2- 172.21.15.156:0/3196138439 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7f14095e70 0x7f7f14117210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:42.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.299+0000 7f7f1b2b6700 1 -- 172.21.15.156:0/3196138439 >> 172.21.15.156:0/3196138439 conn(0x7f7f1409aa50 msgr2=0x7f7f141110b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:42.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.299+0000 7f7f1b2b6700 1 -- 172.21.15.156:0/3196138439 shutdown_connections 2023-09-30T22:16:42.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.299+0000 7f7f1b2b6700 1 -- 172.21.15.156:0/3196138439 wait complete. 2023-09-30T22:16:42.302 INFO:teuthology.orchestra.run.smithi156.stderr:dumped all 2023-09-30T22:16:42.311 INFO:teuthology.orchestra.run.smithi156.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-09-30T22:16:40.355991+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188988,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298372,"statfs":{"total":386547056640,"available":385329532928,"internally_reserved":0,"allocated":618496,"data_stored":181498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1640,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001217"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.818548+0000","last_change":"2023-09-30T22:16:29.812173+0000","last_active":"2023-09-30T22:16:29.818548+0000","last_peered":"2023-09-30T22:16:29.818548+0000","last_clean":"2023-09-30T22:16:29.818548+0000","last_became_active":"2023-09-30T22:16:29.811948+0000","last_became_peered":"2023-09-30T22:16:29.811948+0000","last_unstale":"2023-09-30T22:16:29.818548+0000","last_undegraded":"2023-09-30T22:16:29.818548+0000","last_fullsized":"2023-09-30T22:16:29.818548+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.829503+0000","last_change":"2023-09-30T22:16:29.827324+0000","last_active":"2023-09-30T22:16:29.829503+0000","last_peered":"2023-09-30T22:16:29.829503+0000","last_clean":"2023-09-30T22:16:29.829503+0000","last_became_active":"2023-09-30T22:16:29.826847+0000","last_became_peered":"2023-09-30T22:16:29.826847+0000","last_unstale":"2023-09-30T22:16:29.829503+0000","last_undegraded":"2023-09-30T22:16:29.829503+0000","last_fullsized":"2023-09-30T22:16:29.829503+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828371+0000","last_change":"2023-09-30T22:16:29.825941+0000","last_active":"2023-09-30T22:16:29.828371+0000","last_peered":"2023-09-30T22:16:29.828371+0000","last_clean":"2023-09-30T22:16:29.828371+0000","last_became_active":"2023-09-30T22:16:29.825655+0000","last_became_peered":"2023-09-30T22:16:29.825655+0000","last_unstale":"2023-09-30T22:16:29.828371+0000","last_undegraded":"2023-09-30T22:16:29.828371+0000","last_fullsized":"2023-09-30T22:16:29.828371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828040+0000","last_change":"2023-09-30T22:16:29.822545+0000","last_active":"2023-09-30T22:16:29.828040+0000","last_peered":"2023-09-30T22:16:29.828040+0000","last_clean":"2023-09-30T22:16:29.828040+0000","last_became_active":"2023-09-30T22:16:29.822264+0000","last_became_peered":"2023-09-30T22:16:29.822264+0000","last_unstale":"2023-09-30T22:16:29.828040+0000","last_undegraded":"2023-09-30T22:16:29.828040+0000","last_fullsized":"2023-09-30T22:16:29.828040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.835961+0000","last_change":"2023-09-30T22:16:29.831319+0000","last_active":"2023-09-30T22:16:29.835961+0000","last_peered":"2023-09-30T22:16:29.835961+0000","last_clean":"2023-09-30T22:16:29.835961+0000","last_became_active":"2023-09-30T22:16:29.831024+0000","last_became_peered":"2023-09-30T22:16:29.831024+0000","last_unstale":"2023-09-30T22:16:29.835961+0000","last_undegraded":"2023-09-30T22:16:29.835961+0000","last_fullsized":"2023-09-30T22:16:29.835961+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828212+0000","last_change":"2023-09-30T22:16:29.820688+0000","last_active":"2023-09-30T22:16:29.828212+0000","last_peered":"2023-09-30T22:16:29.828212+0000","last_clean":"2023-09-30T22:16:29.828212+0000","last_became_active":"2023-09-30T22:16:29.820480+0000","last_became_peered":"2023-09-30T22:16:29.820480+0000","last_unstale":"2023-09-30T22:16:29.828212+0000","last_undegraded":"2023-09-30T22:16:29.828212+0000","last_fullsized":"2023-09-30T22:16:29.828212+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.840140+0000","last_change":"2023-09-30T22:16:29.834595+0000","last_active":"2023-09-30T22:16:29.840140+0000","last_peered":"2023-09-30T22:16:29.840140+0000","last_clean":"2023-09-30T22:16:29.840140+0000","last_became_active":"2023-09-30T22:16:29.834156+0000","last_became_peered":"2023-09-30T22:16:29.834156+0000","last_unstale":"2023-09-30T22:16:29.840140+0000","last_undegraded":"2023-09-30T22:16:29.840140+0000","last_fullsized":"2023-09-30T22:16:29.840140+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.829014+0000","last_change":"2023-09-30T22:16:29.822064+0000","last_active":"2023-09-30T22:16:29.829014+0000","last_peered":"2023-09-30T22:16:29.829014+0000","last_clean":"2023-09-30T22:16:29.829014+0000","last_became_active":"2023-09-30T22:16:29.821816+0000","last_became_peered":"2023-09-30T22:16:29.821816+0000","last_unstale":"2023-09-30T22:16:29.829014+0000","last_undegraded":"2023-09-30T22:16:29.829014+0000","last_fullsized":"2023-09-30T22:16:29.829014+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828723+0000","last_change":"2023-09-30T22:16:29.828044+0000","last_active":"2023-09-30T22:16:29.828723+0000","last_peered":"2023-09-30T22:16:29.828723+0000","last_clean":"2023-09-30T22:16:29.828723+0000","last_became_active":"2023-09-30T22:16:29.827740+0000","last_became_peered":"2023-09-30T22:16:29.827740+0000","last_unstale":"2023-09-30T22:16:29.828723+0000","last_undegraded":"2023-09-30T22:16:29.828723+0000","last_fullsized":"2023-09-30T22:16:29.828723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.829021+0000","last_change":"2023-09-30T22:16:29.824597+0000","last_active":"2023-09-30T22:16:29.829021+0000","last_peered":"2023-09-30T22:16:29.829021+0000","last_clean":"2023-09-30T22:16:29.829021+0000","last_became_active":"2023-09-30T22:16:29.824344+0000","last_became_peered":"2023-09-30T22:16:29.824344+0000","last_unstale":"2023-09-30T22:16:29.829021+0000","last_undegraded":"2023-09-30T22:16:29.829021+0000","last_fullsized":"2023-09-30T22:16:29.829021+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839137+0000","last_change":"2023-09-30T22:16:29.830182+0000","last_active":"2023-09-30T22:16:29.839137+0000","last_peered":"2023-09-30T22:16:29.839137+0000","last_clean":"2023-09-30T22:16:29.839137+0000","last_became_active":"2023-09-30T22:16:29.828962+0000","last_became_peered":"2023-09-30T22:16:29.828962+0000","last_unstale":"2023-09-30T22:16:29.839137+0000","last_undegraded":"2023-09-30T22:16:29.839137+0000","last_fullsized":"2023-09-30T22:16:29.839137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.835722+0000","last_change":"2023-09-30T22:16:29.833916+0000","last_active":"2023-09-30T22:16:29.835722+0000","last_peered":"2023-09-30T22:16:29.835722+0000","last_clean":"2023-09-30T22:16:29.835722+0000","last_became_active":"2023-09-30T22:16:29.833664+0000","last_became_peered":"2023-09-30T22:16:29.833664+0000","last_unstale":"2023-09-30T22:16:29.835722+0000","last_undegraded":"2023-09-30T22:16:29.835722+0000","last_fullsized":"2023-09-30T22:16:29.835722+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828781+0000","last_change":"2023-09-30T22:16:29.823993+0000","last_active":"2023-09-30T22:16:29.828781+0000","last_peered":"2023-09-30T22:16:29.828781+0000","last_clean":"2023-09-30T22:16:29.828781+0000","last_became_active":"2023-09-30T22:16:29.823725+0000","last_became_peered":"2023-09-30T22:16:29.823725+0000","last_unstale":"2023-09-30T22:16:29.828781+0000","last_undegraded":"2023-09-30T22:16:29.828781+0000","last_fullsized":"2023-09-30T22:16:29.828781+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839359+0000","last_change":"2023-09-30T22:16:29.832518+0000","last_active":"2023-09-30T22:16:29.839359+0000","last_peered":"2023-09-30T22:16:29.839359+0000","last_clean":"2023-09-30T22:16:29.839359+0000","last_became_active":"2023-09-30T22:16:29.832228+0000","last_became_peered":"2023-09-30T22:16:29.832228+0000","last_unstale":"2023-09-30T22:16:29.839359+0000","last_undegraded":"2023-09-30T22:16:29.839359+0000","last_fullsized":"2023-09-30T22:16:29.839359+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.822394+0000","last_change":"2023-09-30T22:16:29.814680+0000","last_active":"2023-09-30T22:16:29.822394+0000","last_peered":"2023-09-30T22:16:29.822394+0000","last_clean":"2023-09-30T22:16:29.822394+0000","last_became_active":"2023-09-30T22:16:29.814427+0000","last_became_peered":"2023-09-30T22:16:29.814427+0000","last_unstale":"2023-09-30T22:16:29.822394+0000","last_undegraded":"2023-09-30T22:16:29.822394+0000","last_fullsized":"2023-09-30T22:16:29.822394+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839868+0000","last_change":"2023-09-30T22:16:29.833416+0000","last_active":"2023-09-30T22:16:29.839868+0000","last_peered":"2023-09-30T22:16:29.839868+0000","last_clean":"2023-09-30T22:16:29.839868+0000","last_became_active":"2023-09-30T22:16:29.833121+0000","last_became_peered":"2023-09-30T22:16:29.833121+0000","last_unstale":"2023-09-30T22:16:29.839868+0000","last_undegraded":"2023-09-30T22:16:29.839868+0000","last_fullsized":"2023-09-30T22:16:29.839868+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828415+0000","last_change":"2023-09-30T22:16:29.823463+0000","last_active":"2023-09-30T22:16:29.828415+0000","last_peered":"2023-09-30T22:16:29.828415+0000","last_clean":"2023-09-30T22:16:29.828415+0000","last_became_active":"2023-09-30T22:16:29.823207+0000","last_became_peered":"2023-09-30T22:16:29.823207+0000","last_unstale":"2023-09-30T22:16:29.828415+0000","last_undegraded":"2023-09-30T22:16:29.828415+0000","last_fullsized":"2023-09-30T22:16:29.828415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.827618+0000","last_change":"2023-09-30T22:16:29.816722+0000","last_active":"2023-09-30T22:16:29.827618+0000","last_peered":"2023-09-30T22:16:29.827618+0000","last_clean":"2023-09-30T22:16:29.827618+0000","last_became_active":"2023-09-30T22:16:29.816461+0000","last_became_peered":"2023-09-30T22:16:29.816461+0000","last_unstale":"2023-09-30T22:16:29.827618+0000","last_undegraded":"2023-09-30T22:16:29.827618+0000","last_fullsized":"2023-09-30T22:16:29.827618+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.835733+0000","last_change":"2023-09-30T22:16:29.833443+0000","last_active":"2023-09-30T22:16:29.835733+0000","last_peered":"2023-09-30T22:16:29.835733+0000","last_clean":"2023-09-30T22:16:29.835733+0000","last_became_active":"2023-09-30T22:16:29.833187+0000","last_became_peered":"2023-09-30T22:16:29.833187+0000","last_unstale":"2023-09-30T22:16:29.835733+0000","last_undegraded":"2023-09-30T22:16:29.835733+0000","last_fullsized":"2023-09-30T22:16:29.835733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.838620+0000","last_change":"2023-09-30T22:16:29.828875+0000","last_active":"2023-09-30T22:16:29.838620+0000","last_peered":"2023-09-30T22:16:29.838620+0000","last_clean":"2023-09-30T22:16:29.838620+0000","last_became_active":"2023-09-30T22:16:29.828593+0000","last_became_peered":"2023-09-30T22:16:29.828593+0000","last_unstale":"2023-09-30T22:16:29.838620+0000","last_undegraded":"2023-09-30T22:16:29.838620+0000","last_fullsized":"2023-09-30T22:16:29.838620+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.829249+0000","last_change":"2023-09-30T22:16:29.827607+0000","last_active":"2023-09-30T22:16:29.829249+0000","last_peered":"2023-09-30T22:16:29.829249+0000","last_clean":"2023-09-30T22:16:29.829249+0000","last_became_active":"2023-09-30T22:16:29.826392+0000","last_became_peered":"2023-09-30T22:16:29.826392+0000","last_unstale":"2023-09-30T22:16:29.829249+0000","last_undegraded":"2023-09-30T22:16:29.829249+0000","last_fullsized":"2023-09-30T22:16:29.829249+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828165+0000","last_change":"2023-09-30T22:16:29.823191+0000","last_active":"2023-09-30T22:16:29.828165+0000","last_peered":"2023-09-30T22:16:29.828165+0000","last_clean":"2023-09-30T22:16:29.828165+0000","last_became_active":"2023-09-30T22:16:29.822796+0000","last_became_peered":"2023-09-30T22:16:29.822796+0000","last_unstale":"2023-09-30T22:16:29.828165+0000","last_undegraded":"2023-09-30T22:16:29.828165+0000","last_fullsized":"2023-09-30T22:16:29.828165+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.840103+0000","last_change":"2023-09-30T22:16:29.834377+0000","last_active":"2023-09-30T22:16:29.840103+0000","last_peered":"2023-09-30T22:16:29.840103+0000","last_clean":"2023-09-30T22:16:29.840103+0000","last_became_active":"2023-09-30T22:16:29.833873+0000","last_became_peered":"2023-09-30T22:16:29.833873+0000","last_unstale":"2023-09-30T22:16:29.840103+0000","last_undegraded":"2023-09-30T22:16:29.840103+0000","last_fullsized":"2023-09-30T22:16:29.840103+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.823195+0000","last_change":"2023-09-30T22:16:29.821578+0000","last_active":"2023-09-30T22:16:29.823195+0000","last_peered":"2023-09-30T22:16:29.823195+0000","last_clean":"2023-09-30T22:16:29.823195+0000","last_became_active":"2023-09-30T22:16:29.818116+0000","last_became_peered":"2023-09-30T22:16:29.818116+0000","last_unstale":"2023-09-30T22:16:29.823195+0000","last_undegraded":"2023-09-30T22:16:29.823195+0000","last_fullsized":"2023-09-30T22:16:29.823195+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.838596+0000","last_change":"2023-09-30T22:16:29.829048+0000","last_active":"2023-09-30T22:16:29.838596+0000","last_peered":"2023-09-30T22:16:29.838596+0000","last_clean":"2023-09-30T22:16:29.838596+0000","last_became_active":"2023-09-30T22:16:29.828174+0000","last_became_peered":"2023-09-30T22:16:29.828174+0000","last_unstale":"2023-09-30T22:16:29.838596+0000","last_undegraded":"2023-09-30T22:16:29.838596+0000","last_fullsized":"2023-09-30T22:16:29.838596+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839543+0000","last_change":"2023-09-30T22:16:29.834779+0000","last_active":"2023-09-30T22:16:29.839543+0000","last_peered":"2023-09-30T22:16:29.839543+0000","last_clean":"2023-09-30T22:16:29.839543+0000","last_became_active":"2023-09-30T22:16:29.833042+0000","last_became_peered":"2023-09-30T22:16:29.833042+0000","last_unstale":"2023-09-30T22:16:29.839543+0000","last_undegraded":"2023-09-30T22:16:29.839543+0000","last_fullsized":"2023-09-30T22:16:29.839543+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839810+0000","last_change":"2023-09-30T22:16:29.832499+0000","last_active":"2023-09-30T22:16:29.839810+0000","last_peered":"2023-09-30T22:16:29.839810+0000","last_clean":"2023-09-30T22:16:29.839810+0000","last_became_active":"2023-09-30T22:16:29.831898+0000","last_became_peered":"2023-09-30T22:16:29.831898+0000","last_unstale":"2023-09-30T22:16:29.839810+0000","last_undegraded":"2023-09-30T22:16:29.839810+0000","last_fullsized":"2023-09-30T22:16:29.839810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.832635+0000","last_change":"2023-09-30T22:16:29.448332+0000","last_active":"2023-09-30T22:16:29.832635+0000","last_peered":"2023-09-30T22:16:29.832635+0000","last_clean":"2023-09-30T22:16:29.832635+0000","last_became_active":"2023-09-30T22:16:29.448043+0000","last_became_peered":"2023-09-30T22:16:29.448043+0000","last_unstale":"2023-09-30T22:16:29.832635+0000","last_undegraded":"2023-09-30T22:16:29.832635+0000","last_fullsized":"2023-09-30T22:16:29.832635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839699+0000","last_change":"2023-09-30T22:16:29.831419+0000","last_active":"2023-09-30T22:16:29.839699+0000","last_peered":"2023-09-30T22:16:29.839699+0000","last_clean":"2023-09-30T22:16:29.839699+0000","last_became_active":"2023-09-30T22:16:29.830841+0000","last_became_peered":"2023-09-30T22:16:29.830841+0000","last_unstale":"2023-09-30T22:16:29.839699+0000","last_undegraded":"2023-09-30T22:16:29.839699+0000","last_fullsized":"2023-09-30T22:16:29.839699+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.797808+0000","last_change":"2023-09-30T22:16:29.449809+0000","last_active":"2023-09-30T22:16:29.797808+0000","last_peered":"2023-09-30T22:16:29.797808+0000","last_clean":"2023-09-30T22:16:29.797808+0000","last_became_active":"2023-09-30T22:16:29.449538+0000","last_became_peered":"2023-09-30T22:16:29.449538+0000","last_unstale":"2023-09-30T22:16:29.797808+0000","last_undegraded":"2023-09-30T22:16:29.797808+0000","last_fullsized":"2023-09-30T22:16:29.797808+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.827987+0000","last_change":"2023-09-30T22:16:29.822995+0000","last_active":"2023-09-30T22:16:29.827987+0000","last_peered":"2023-09-30T22:16:29.827987+0000","last_clean":"2023-09-30T22:16:29.827987+0000","last_became_active":"2023-09-30T22:16:29.822621+0000","last_became_peered":"2023-09-30T22:16:29.822621+0000","last_unstale":"2023-09-30T22:16:29.827987+0000","last_undegraded":"2023-09-30T22:16:29.827987+0000","last_fullsized":"2023-09-30T22:16:29.827987+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.814238+0000","last_change":"2023-09-30T22:16:29.452955+0000","last_active":"2023-09-30T22:16:29.814238+0000","last_peered":"2023-09-30T22:16:29.814238+0000","last_clean":"2023-09-30T22:16:29.814238+0000","last_became_active":"2023-09-30T22:16:29.449928+0000","last_became_peered":"2023-09-30T22:16:29.449928+0000","last_unstale":"2023-09-30T22:16:29.814238+0000","last_undegraded":"2023-09-30T22:16:29.814238+0000","last_fullsized":"2023-09-30T22:16:29.814238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839729+0000","last_change":"2023-09-30T22:16:29.831592+0000","last_active":"2023-09-30T22:16:29.839729+0000","last_peered":"2023-09-30T22:16:29.839729+0000","last_clean":"2023-09-30T22:16:29.839729+0000","last_became_active":"2023-09-30T22:16:29.831170+0000","last_became_peered":"2023-09-30T22:16:29.831170+0000","last_unstale":"2023-09-30T22:16:29.839729+0000","last_undegraded":"2023-09-30T22:16:29.839729+0000","last_fullsized":"2023-09-30T22:16:29.839729+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.803377+0000","last_change":"2023-09-30T22:16:29.452637+0000","last_active":"2023-09-30T22:16:29.803377+0000","last_peered":"2023-09-30T22:16:29.803377+0000","last_clean":"2023-09-30T22:16:29.803377+0000","last_became_active":"2023-09-30T22:16:29.452263+0000","last_became_peered":"2023-09-30T22:16:29.452263+0000","last_unstale":"2023-09-30T22:16:29.803377+0000","last_undegraded":"2023-09-30T22:16:29.803377+0000","last_fullsized":"2023-09-30T22:16:29.803377+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.840008+0000","last_change":"2023-09-30T22:16:29.835756+0000","last_active":"2023-09-30T22:16:29.840008+0000","last_peered":"2023-09-30T22:16:29.840008+0000","last_clean":"2023-09-30T22:16:29.840008+0000","last_became_active":"2023-09-30T22:16:29.834448+0000","last_became_peered":"2023-09-30T22:16:29.834448+0000","last_unstale":"2023-09-30T22:16:29.840008+0000","last_undegraded":"2023-09-30T22:16:29.840008+0000","last_fullsized":"2023-09-30T22:16:29.840008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.799766+0000","last_change":"2023-09-30T22:16:29.448611+0000","last_active":"2023-09-30T22:16:29.799766+0000","last_peered":"2023-09-30T22:16:29.799766+0000","last_clean":"2023-09-30T22:16:29.799766+0000","last_became_active":"2023-09-30T22:16:29.448289+0000","last_became_peered":"2023-09-30T22:16:29.448289+0000","last_unstale":"2023-09-30T22:16:29.799766+0000","last_undegraded":"2023-09-30T22:16:29.799766+0000","last_fullsized":"2023-09-30T22:16:29.799766+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.840157+0000","last_change":"2023-09-30T22:16:29.836465+0000","last_active":"2023-09-30T22:16:29.840157+0000","last_peered":"2023-09-30T22:16:29.840157+0000","last_clean":"2023-09-30T22:16:29.840157+0000","last_became_active":"2023-09-30T22:16:29.834303+0000","last_became_peered":"2023-09-30T22:16:29.834303+0000","last_unstale":"2023-09-30T22:16:29.840157+0000","last_undegraded":"2023-09-30T22:16:29.840157+0000","last_fullsized":"2023-09-30T22:16:29.840157+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.827908+0000","last_change":"2023-09-30T22:16:29.448241+0000","last_active":"2023-09-30T22:16:29.827908+0000","last_peered":"2023-09-30T22:16:29.827908+0000","last_clean":"2023-09-30T22:16:29.827908+0000","last_became_active":"2023-09-30T22:16:29.447960+0000","last_became_peered":"2023-09-30T22:16:29.447960+0000","last_unstale":"2023-09-30T22:16:29.827908+0000","last_undegraded":"2023-09-30T22:16:29.827908+0000","last_fullsized":"2023-09-30T22:16:29.827908+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828838+0000","last_change":"2023-09-30T22:16:29.825275+0000","last_active":"2023-09-30T22:16:29.828838+0000","last_peered":"2023-09-30T22:16:29.828838+0000","last_clean":"2023-09-30T22:16:29.828838+0000","last_became_active":"2023-09-30T22:16:29.825002+0000","last_became_peered":"2023-09-30T22:16:29.825002+0000","last_unstale":"2023-09-30T22:16:29.828838+0000","last_undegraded":"2023-09-30T22:16:29.828838+0000","last_fullsized":"2023-09-30T22:16:29.828838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.840394+0000","last_change":"2023-09-30T22:16:29.449099+0000","last_active":"2023-09-30T22:16:29.840394+0000","last_peered":"2023-09-30T22:16:29.840394+0000","last_clean":"2023-09-30T22:16:29.840394+0000","last_became_active":"2023-09-30T22:16:29.448827+0000","last_became_peered":"2023-09-30T22:16:29.448827+0000","last_unstale":"2023-09-30T22:16:29.840394+0000","last_undegraded":"2023-09-30T22:16:29.840394+0000","last_fullsized":"2023-09-30T22:16:29.840394+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.819093+0000","last_change":"2023-09-30T22:16:29.811836+0000","last_active":"2023-09-30T22:16:29.819093+0000","last_peered":"2023-09-30T22:16:29.819093+0000","last_clean":"2023-09-30T22:16:29.819093+0000","last_became_active":"2023-09-30T22:16:29.811605+0000","last_became_peered":"2023-09-30T22:16:29.811605+0000","last_unstale":"2023-09-30T22:16:29.819093+0000","last_undegraded":"2023-09-30T22:16:29.819093+0000","last_fullsized":"2023-09-30T22:16:29.819093+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.833443+0000","last_change":"2023-09-30T22:16:29.446893+0000","last_active":"2023-09-30T22:16:29.833443+0000","last_peered":"2023-09-30T22:16:29.833443+0000","last_clean":"2023-09-30T22:16:29.833443+0000","last_became_active":"2023-09-30T22:16:29.446554+0000","last_became_peered":"2023-09-30T22:16:29.446554+0000","last_unstale":"2023-09-30T22:16:29.833443+0000","last_undegraded":"2023-09-30T22:16:29.833443+0000","last_fullsized":"2023-09-30T22:16:29.833443+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.838932+0000","last_change":"2023-09-30T22:16:29.830170+0000","last_active":"2023-09-30T22:16:29.838932+0000","last_peered":"2023-09-30T22:16:29.838932+0000","last_clean":"2023-09-30T22:16:29.838932+0000","last_became_active":"2023-09-30T22:16:29.829909+0000","last_became_peered":"2023-09-30T22:16:29.829909+0000","last_unstale":"2023-09-30T22:16:29.838932+0000","last_undegraded":"2023-09-30T22:16:29.838932+0000","last_fullsized":"2023-09-30T22:16:29.838932+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.802776+0000","last_change":"2023-09-30T22:16:29.453090+0000","last_active":"2023-09-30T22:16:29.802776+0000","last_peered":"2023-09-30T22:16:29.802776+0000","last_clean":"2023-09-30T22:16:29.802776+0000","last_became_active":"2023-09-30T22:16:29.452814+0000","last_became_peered":"2023-09-30T22:16:29.452814+0000","last_unstale":"2023-09-30T22:16:29.802776+0000","last_undegraded":"2023-09-30T22:16:29.802776+0000","last_fullsized":"2023-09-30T22:16:29.802776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839830+0000","last_change":"2023-09-30T22:16:29.832660+0000","last_active":"2023-09-30T22:16:29.839830+0000","last_peered":"2023-09-30T22:16:29.839830+0000","last_clean":"2023-09-30T22:16:29.839830+0000","last_became_active":"2023-09-30T22:16:29.832233+0000","last_became_peered":"2023-09-30T22:16:29.832233+0000","last_unstale":"2023-09-30T22:16:29.839830+0000","last_undegraded":"2023-09-30T22:16:29.839830+0000","last_fullsized":"2023-09-30T22:16:29.839830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.811008+0000","last_change":"2023-09-30T22:16:29.450700+0000","last_active":"2023-09-30T22:16:29.811008+0000","last_peered":"2023-09-30T22:16:29.811008+0000","last_clean":"2023-09-30T22:16:29.811008+0000","last_became_active":"2023-09-30T22:16:29.450434+0000","last_became_peered":"2023-09-30T22:16:29.450434+0000","last_unstale":"2023-09-30T22:16:29.811008+0000","last_undegraded":"2023-09-30T22:16:29.811008+0000","last_fullsized":"2023-09-30T22:16:29.811008+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.827638+0000","last_change":"2023-09-30T22:16:29.821215+0000","last_active":"2023-09-30T22:16:29.827638+0000","last_peered":"2023-09-30T22:16:29.827638+0000","last_clean":"2023-09-30T22:16:29.827638+0000","last_became_active":"2023-09-30T22:16:29.820939+0000","last_became_peered":"2023-09-30T22:16:29.820939+0000","last_unstale":"2023-09-30T22:16:29.827638+0000","last_undegraded":"2023-09-30T22:16:29.827638+0000","last_fullsized":"2023-09-30T22:16:29.827638+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.837411+0000","last_change":"2023-09-30T22:16:29.445251+0000","last_active":"2023-09-30T22:16:29.837411+0000","last_peered":"2023-09-30T22:16:29.837411+0000","last_clean":"2023-09-30T22:16:29.837411+0000","last_became_active":"2023-09-30T22:16:29.441736+0000","last_became_peered":"2023-09-30T22:16:29.441736+0000","last_unstale":"2023-09-30T22:16:29.837411+0000","last_undegraded":"2023-09-30T22:16:29.837411+0000","last_fullsized":"2023-09-30T22:16:29.837411+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.840261+0000","last_change":"2023-09-30T22:16:29.836710+0000","last_active":"2023-09-30T22:16:29.840261+0000","last_peered":"2023-09-30T22:16:29.840261+0000","last_clean":"2023-09-30T22:16:29.840261+0000","last_became_active":"2023-09-30T22:16:29.831551+0000","last_became_peered":"2023-09-30T22:16:29.831551+0000","last_unstale":"2023-09-30T22:16:29.840261+0000","last_undegraded":"2023-09-30T22:16:29.840261+0000","last_fullsized":"2023-09-30T22:16:29.840261+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.825857+0000","last_change":"2023-09-30T22:16:29.444871+0000","last_active":"2023-09-30T22:16:29.825857+0000","last_peered":"2023-09-30T22:16:29.825857+0000","last_clean":"2023-09-30T22:16:29.825857+0000","last_became_active":"2023-09-30T22:16:29.444600+0000","last_became_peered":"2023-09-30T22:16:29.444600+0000","last_unstale":"2023-09-30T22:16:29.825857+0000","last_undegraded":"2023-09-30T22:16:29.825857+0000","last_fullsized":"2023-09-30T22:16:29.825857+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.840410+0000","last_change":"2023-09-30T22:16:29.839223+0000","last_active":"2023-09-30T22:16:29.840410+0000","last_peered":"2023-09-30T22:16:29.840410+0000","last_clean":"2023-09-30T22:16:29.840410+0000","last_became_active":"2023-09-30T22:16:29.838955+0000","last_became_peered":"2023-09-30T22:16:29.838955+0000","last_unstale":"2023-09-30T22:16:29.840410+0000","last_undegraded":"2023-09-30T22:16:29.840410+0000","last_fullsized":"2023-09-30T22:16:29.840410+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.823621+0000","last_change":"2023-09-30T22:16:29.451861+0000","last_active":"2023-09-30T22:16:29.823621+0000","last_peered":"2023-09-30T22:16:29.823621+0000","last_clean":"2023-09-30T22:16:29.823621+0000","last_became_active":"2023-09-30T22:16:29.451069+0000","last_became_peered":"2023-09-30T22:16:29.451069+0000","last_unstale":"2023-09-30T22:16:29.823621+0000","last_undegraded":"2023-09-30T22:16:29.823621+0000","last_fullsized":"2023-09-30T22:16:29.823621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.823858+0000","last_change":"2023-09-30T22:16:29.818789+0000","last_active":"2023-09-30T22:16:29.823858+0000","last_peered":"2023-09-30T22:16:29.823858+0000","last_clean":"2023-09-30T22:16:29.823858+0000","last_became_active":"2023-09-30T22:16:29.818283+0000","last_became_peered":"2023-09-30T22:16:29.818283+0000","last_unstale":"2023-09-30T22:16:29.823858+0000","last_undegraded":"2023-09-30T22:16:29.823858+0000","last_fullsized":"2023-09-30T22:16:29.823858+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.834215+0000","last_change":"2023-09-30T22:16:29.446443+0000","last_active":"2023-09-30T22:16:29.834215+0000","last_peered":"2023-09-30T22:16:29.834215+0000","last_clean":"2023-09-30T22:16:29.834215+0000","last_became_active":"2023-09-30T22:16:29.445833+0000","last_became_peered":"2023-09-30T22:16:29.445833+0000","last_unstale":"2023-09-30T22:16:29.834215+0000","last_undegraded":"2023-09-30T22:16:29.834215+0000","last_fullsized":"2023-09-30T22:16:29.834215+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.835697+0000","last_change":"2023-09-30T22:16:29.833040+0000","last_active":"2023-09-30T22:16:29.835697+0000","last_peered":"2023-09-30T22:16:29.835697+0000","last_clean":"2023-09-30T22:16:29.835697+0000","last_became_active":"2023-09-30T22:16:29.832651+0000","last_became_peered":"2023-09-30T22:16:29.832651+0000","last_unstale":"2023-09-30T22:16:29.835697+0000","last_undegraded":"2023-09-30T22:16:29.835697+0000","last_fullsized":"2023-09-30T22:16:29.835697+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.804809+0000","last_change":"2023-09-30T22:16:29.451667+0000","last_active":"2023-09-30T22:16:29.804809+0000","last_peered":"2023-09-30T22:16:29.804809+0000","last_clean":"2023-09-30T22:16:29.804809+0000","last_became_active":"2023-09-30T22:16:29.451422+0000","last_became_peered":"2023-09-30T22:16:29.451422+0000","last_unstale":"2023-09-30T22:16:29.804809+0000","last_undegraded":"2023-09-30T22:16:29.804809+0000","last_fullsized":"2023-09-30T22:16:29.804809+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.831417+0000","last_change":"2023-09-30T22:16:29.815304+0000","last_active":"2023-09-30T22:16:29.831417+0000","last_peered":"2023-09-30T22:16:29.831417+0000","last_clean":"2023-09-30T22:16:29.831417+0000","last_became_active":"2023-09-30T22:16:29.814885+0000","last_became_peered":"2023-09-30T22:16:29.814885+0000","last_unstale":"2023-09-30T22:16:29.831417+0000","last_undegraded":"2023-09-30T22:16:29.831417+0000","last_fullsized":"2023-09-30T22:16:29.831417+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.833324+0000","last_change":"2023-09-30T22:16:29.452814+0000","last_active":"2023-09-30T22:16:29.833324+0000","last_peered":"2023-09-30T22:16:29.833324+0000","last_clean":"2023-09-30T22:16:29.833324+0000","last_became_active":"2023-09-30T22:16:29.452404+0000","last_became_peered":"2023-09-30T22:16:29.452404+0000","last_unstale":"2023-09-30T22:16:29.833324+0000","last_undegraded":"2023-09-30T22:16:29.833324+0000","last_fullsized":"2023-09-30T22:16:29.833324+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828340+0000","last_change":"2023-09-30T22:16:29.825581+0000","last_active":"2023-09-30T22:16:29.828340+0000","last_peered":"2023-09-30T22:16:29.828340+0000","last_clean":"2023-09-30T22:16:29.828340+0000","last_became_active":"2023-09-30T22:16:29.822823+0000","last_became_peered":"2023-09-30T22:16:29.822823+0000","last_unstale":"2023-09-30T22:16:29.828340+0000","last_undegraded":"2023-09-30T22:16:29.828340+0000","last_fullsized":"2023-09-30T22:16:29.828340+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.808099+0000","last_change":"2023-09-30T22:16:29.447931+0000","last_active":"2023-09-30T22:16:29.808099+0000","last_peered":"2023-09-30T22:16:29.808099+0000","last_clean":"2023-09-30T22:16:29.808099+0000","last_became_active":"2023-09-30T22:16:29.447158+0000","last_became_peered":"2023-09-30T22:16:29.447158+0000","last_unstale":"2023-09-30T22:16:29.808099+0000","last_undegraded":"2023-09-30T22:16:29.808099+0000","last_fullsized":"2023-09-30T22:16:29.808099+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839723+0000","last_change":"2023-09-30T22:16:29.831438+0000","last_active":"2023-09-30T22:16:29.839723+0000","last_peered":"2023-09-30T22:16:29.839723+0000","last_clean":"2023-09-30T22:16:29.839723+0000","last_became_active":"2023-09-30T22:16:29.831158+0000","last_became_peered":"2023-09-30T22:16:29.831158+0000","last_unstale":"2023-09-30T22:16:29.839723+0000","last_undegraded":"2023-09-30T22:16:29.839723+0000","last_fullsized":"2023-09-30T22:16:29.839723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.810962+0000","last_change":"2023-09-30T22:16:29.449264+0000","last_active":"2023-09-30T22:16:29.810962+0000","last_peered":"2023-09-30T22:16:29.810962+0000","last_clean":"2023-09-30T22:16:29.810962+0000","last_became_active":"2023-09-30T22:16:29.448995+0000","last_became_peered":"2023-09-30T22:16:29.448995+0000","last_unstale":"2023-09-30T22:16:29.810962+0000","last_undegraded":"2023-09-30T22:16:29.810962+0000","last_fullsized":"2023-09-30T22:16:29.810962+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.835638+0000","last_change":"2023-09-30T22:16:29.832641+0000","last_active":"2023-09-30T22:16:29.835638+0000","last_peered":"2023-09-30T22:16:29.835638+0000","last_clean":"2023-09-30T22:16:29.835638+0000","last_became_active":"2023-09-30T22:16:29.832399+0000","last_became_peered":"2023-09-30T22:16:29.832399+0000","last_unstale":"2023-09-30T22:16:29.835638+0000","last_undegraded":"2023-09-30T22:16:29.835638+0000","last_fullsized":"2023-09-30T22:16:29.835638+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.813819+0000","last_change":"2023-09-30T22:16:29.451927+0000","last_active":"2023-09-30T22:16:29.813819+0000","last_peered":"2023-09-30T22:16:29.813819+0000","last_clean":"2023-09-30T22:16:29.813819+0000","last_became_active":"2023-09-30T22:16:29.449397+0000","last_became_peered":"2023-09-30T22:16:29.449397+0000","last_unstale":"2023-09-30T22:16:29.813819+0000","last_undegraded":"2023-09-30T22:16:29.813819+0000","last_fullsized":"2023-09-30T22:16:29.813819+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.838623+0000","last_change":"2023-09-30T22:16:29.829224+0000","last_active":"2023-09-30T22:16:29.838623+0000","last_peered":"2023-09-30T22:16:29.838623+0000","last_clean":"2023-09-30T22:16:29.838623+0000","last_became_active":"2023-09-30T22:16:29.828558+0000","last_became_peered":"2023-09-30T22:16:29.828558+0000","last_unstale":"2023-09-30T22:16:29.838623+0000","last_undegraded":"2023-09-30T22:16:29.838623+0000","last_fullsized":"2023-09-30T22:16:29.838623+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.801275+0000","last_change":"2023-09-30T22:16:25.780366+0000","last_active":"2023-09-30T22:16:29.801275+0000","last_peered":"2023-09-30T22:16:29.801275+0000","last_clean":"2023-09-30T22:16:29.801275+0000","last_became_active":"2023-09-30T22:16:25.780059+0000","last_became_peered":"2023-09-30T22:16:25.780059+0000","last_unstale":"2023-09-30T22:16:29.801275+0000","last_undegraded":"2023-09-30T22:16:29.801275+0000","last_fullsized":"2023-09-30T22:16:29.801275+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.799168+0000","last_change":"2023-09-30T22:16:29.448527+0000","last_active":"2023-09-30T22:16:29.799168+0000","last_peered":"2023-09-30T22:16:29.799168+0000","last_clean":"2023-09-30T22:16:29.799168+0000","last_became_active":"2023-09-30T22:16:29.448223+0000","last_became_peered":"2023-09-30T22:16:29.448223+0000","last_unstale":"2023-09-30T22:16:29.799168+0000","last_undegraded":"2023-09-30T22:16:29.799168+0000","last_fullsized":"2023-09-30T22:16:29.799168+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.829283+0000","last_change":"2023-09-30T22:16:29.827919+0000","last_active":"2023-09-30T22:16:29.829283+0000","last_peered":"2023-09-30T22:16:29.829283+0000","last_clean":"2023-09-30T22:16:29.829283+0000","last_became_active":"2023-09-30T22:16:29.827646+0000","last_became_peered":"2023-09-30T22:16:29.827646+0000","last_unstale":"2023-09-30T22:16:29.829283+0000","last_undegraded":"2023-09-30T22:16:29.829283+0000","last_fullsized":"2023-09-30T22:16:29.829283+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.808000+0000","last_change":"2023-09-30T22:16:25.414057+0000","last_active":"2023-09-30T22:16:29.808000+0000","last_peered":"2023-09-30T22:16:29.808000+0000","last_clean":"2023-09-30T22:16:29.808000+0000","last_became_active":"2023-09-30T22:16:25.413712+0000","last_became_peered":"2023-09-30T22:16:25.413712+0000","last_unstale":"2023-09-30T22:16:29.808000+0000","last_undegraded":"2023-09-30T22:16:29.808000+0000","last_fullsized":"2023-09-30T22:16:29.808000+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.804113+0000","last_change":"2023-09-30T22:16:29.446619+0000","last_active":"2023-09-30T22:16:29.804113+0000","last_peered":"2023-09-30T22:16:29.804113+0000","last_clean":"2023-09-30T22:16:29.804113+0000","last_became_active":"2023-09-30T22:16:29.446314+0000","last_became_peered":"2023-09-30T22:16:29.446314+0000","last_unstale":"2023-09-30T22:16:29.804113+0000","last_undegraded":"2023-09-30T22:16:29.804113+0000","last_fullsized":"2023-09-30T22:16:29.804113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839921+0000","last_change":"2023-09-30T22:16:29.835339+0000","last_active":"2023-09-30T22:16:29.839921+0000","last_peered":"2023-09-30T22:16:29.839921+0000","last_clean":"2023-09-30T22:16:29.839921+0000","last_became_active":"2023-09-30T22:16:29.833186+0000","last_became_peered":"2023-09-30T22:16:29.833186+0000","last_unstale":"2023-09-30T22:16:29.839921+0000","last_undegraded":"2023-09-30T22:16:29.839921+0000","last_fullsized":"2023-09-30T22:16:29.839921+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.798210+0000","last_change":"2023-09-30T22:16:25.416240+0000","last_active":"2023-09-30T22:16:29.798210+0000","last_peered":"2023-09-30T22:16:29.798210+0000","last_clean":"2023-09-30T22:16:29.798210+0000","last_became_active":"2023-09-30T22:16:25.415852+0000","last_became_peered":"2023-09-30T22:16:25.415852+0000","last_unstale":"2023-09-30T22:16:29.798210+0000","last_undegraded":"2023-09-30T22:16:29.798210+0000","last_fullsized":"2023-09-30T22:16:29.798210+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.798384+0000","last_change":"2023-09-30T22:16:29.449007+0000","last_active":"2023-09-30T22:16:29.798384+0000","last_peered":"2023-09-30T22:16:29.798384+0000","last_clean":"2023-09-30T22:16:29.798384+0000","last_became_active":"2023-09-30T22:16:29.448746+0000","last_became_peered":"2023-09-30T22:16:29.448746+0000","last_unstale":"2023-09-30T22:16:29.798384+0000","last_undegraded":"2023-09-30T22:16:29.798384+0000","last_fullsized":"2023-09-30T22:16:29.798384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.822579+0000","last_change":"2023-09-30T22:16:29.819140+0000","last_active":"2023-09-30T22:16:29.822579+0000","last_peered":"2023-09-30T22:16:29.822579+0000","last_clean":"2023-09-30T22:16:29.822579+0000","last_became_active":"2023-09-30T22:16:29.818875+0000","last_became_peered":"2023-09-30T22:16:29.818875+0000","last_unstale":"2023-09-30T22:16:29.822579+0000","last_undegraded":"2023-09-30T22:16:29.822579+0000","last_fullsized":"2023-09-30T22:16:29.822579+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.809554+0000","last_change":"2023-09-30T22:16:25.414050+0000","last_active":"2023-09-30T22:16:29.809554+0000","last_peered":"2023-09-30T22:16:29.809554+0000","last_clean":"2023-09-30T22:16:29.809554+0000","last_became_active":"2023-09-30T22:16:25.413709+0000","last_became_peered":"2023-09-30T22:16:25.413709+0000","last_unstale":"2023-09-30T22:16:29.809554+0000","last_undegraded":"2023-09-30T22:16:29.809554+0000","last_fullsized":"2023-09-30T22:16:29.809554+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.798287+0000","last_change":"2023-09-30T22:16:25.781137+0000","last_active":"2023-09-30T22:16:29.798287+0000","last_peered":"2023-09-30T22:16:29.798287+0000","last_clean":"2023-09-30T22:16:29.798287+0000","last_became_active":"2023-09-30T22:16:25.780923+0000","last_became_peered":"2023-09-30T22:16:25.780923+0000","last_unstale":"2023-09-30T22:16:29.798287+0000","last_undegraded":"2023-09-30T22:16:29.798287+0000","last_fullsized":"2023-09-30T22:16:29.798287+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.807854+0000","last_change":"2023-09-30T22:16:29.448514+0000","last_active":"2023-09-30T22:16:29.807854+0000","last_peered":"2023-09-30T22:16:29.807854+0000","last_clean":"2023-09-30T22:16:29.807854+0000","last_became_active":"2023-09-30T22:16:29.448270+0000","last_became_peered":"2023-09-30T22:16:29.448270+0000","last_unstale":"2023-09-30T22:16:29.807854+0000","last_undegraded":"2023-09-30T22:16:29.807854+0000","last_fullsized":"2023-09-30T22:16:29.807854+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839741+0000","last_change":"2023-09-30T22:16:29.831589+0000","last_active":"2023-09-30T22:16:29.839741+0000","last_peered":"2023-09-30T22:16:29.839741+0000","last_clean":"2023-09-30T22:16:29.839741+0000","last_became_active":"2023-09-30T22:16:29.831205+0000","last_became_peered":"2023-09-30T22:16:29.831205+0000","last_unstale":"2023-09-30T22:16:29.839741+0000","last_undegraded":"2023-09-30T22:16:29.839741+0000","last_fullsized":"2023-09-30T22:16:29.839741+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.814110+0000","last_change":"2023-09-30T22:16:25.416399+0000","last_active":"2023-09-30T22:16:29.814110+0000","last_peered":"2023-09-30T22:16:29.814110+0000","last_clean":"2023-09-30T22:16:29.814110+0000","last_became_active":"2023-09-30T22:16:25.416054+0000","last_became_peered":"2023-09-30T22:16:25.416054+0000","last_unstale":"2023-09-30T22:16:29.814110+0000","last_undegraded":"2023-09-30T22:16:29.814110+0000","last_fullsized":"2023-09-30T22:16:29.814110+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.803190+0000","last_change":"2023-09-30T22:16:29.450979+0000","last_active":"2023-09-30T22:16:29.803190+0000","last_peered":"2023-09-30T22:16:29.803190+0000","last_clean":"2023-09-30T22:16:29.803190+0000","last_became_active":"2023-09-30T22:16:29.450724+0000","last_became_peered":"2023-09-30T22:16:29.450724+0000","last_unstale":"2023-09-30T22:16:29.803190+0000","last_undegraded":"2023-09-30T22:16:29.803190+0000","last_fullsized":"2023-09-30T22:16:29.803190+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828390+0000","last_change":"2023-09-30T22:16:29.827233+0000","last_active":"2023-09-30T22:16:29.828390+0000","last_peered":"2023-09-30T22:16:29.828390+0000","last_clean":"2023-09-30T22:16:29.828390+0000","last_became_active":"2023-09-30T22:16:29.822966+0000","last_became_peered":"2023-09-30T22:16:29.822966+0000","last_unstale":"2023-09-30T22:16:29.828390+0000","last_undegraded":"2023-09-30T22:16:29.828390+0000","last_fullsized":"2023-09-30T22:16:29.828390+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.813696+0000","last_change":"2023-09-30T22:16:25.780298+0000","last_active":"2023-09-30T22:16:29.813696+0000","last_peered":"2023-09-30T22:16:29.813696+0000","last_clean":"2023-09-30T22:16:29.813696+0000","last_became_active":"2023-09-30T22:16:25.780022+0000","last_became_peered":"2023-09-30T22:16:25.780022+0000","last_unstale":"2023-09-30T22:16:29.813696+0000","last_undegraded":"2023-09-30T22:16:29.813696+0000","last_fullsized":"2023-09-30T22:16:29.813696+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.801091+0000","last_change":"2023-09-30T22:16:29.448428+0000","last_active":"2023-09-30T22:16:29.801091+0000","last_peered":"2023-09-30T22:16:29.801091+0000","last_clean":"2023-09-30T22:16:29.801091+0000","last_became_active":"2023-09-30T22:16:29.447613+0000","last_became_peered":"2023-09-30T22:16:29.447613+0000","last_unstale":"2023-09-30T22:16:29.801091+0000","last_undegraded":"2023-09-30T22:16:29.801091+0000","last_fullsized":"2023-09-30T22:16:29.801091+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.831435+0000","last_change":"2023-09-30T22:16:29.815447+0000","last_active":"2023-09-30T22:16:29.831435+0000","last_peered":"2023-09-30T22:16:29.831435+0000","last_clean":"2023-09-30T22:16:29.831435+0000","last_became_active":"2023-09-30T22:16:29.815169+0000","last_became_peered":"2023-09-30T22:16:29.815169+0000","last_unstale":"2023-09-30T22:16:29.831435+0000","last_undegraded":"2023-09-30T22:16:29.831435+0000","last_fullsized":"2023-09-30T22:16:29.831435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.837122+0000","last_change":"2023-09-30T22:16:29.448448+0000","last_active":"2023-09-30T22:16:29.837122+0000","last_peered":"2023-09-30T22:16:29.837122+0000","last_clean":"2023-09-30T22:16:29.837122+0000","last_became_active":"2023-09-30T22:16:29.448177+0000","last_became_peered":"2023-09-30T22:16:29.448177+0000","last_unstale":"2023-09-30T22:16:29.837122+0000","last_undegraded":"2023-09-30T22:16:29.837122+0000","last_fullsized":"2023-09-30T22:16:29.837122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.801487+0000","last_change":"2023-09-30T22:16:25.781178+0000","last_active":"2023-09-30T22:16:29.801487+0000","last_peered":"2023-09-30T22:16:29.801487+0000","last_clean":"2023-09-30T22:16:29.801487+0000","last_became_active":"2023-09-30T22:16:25.780121+0000","last_became_peered":"2023-09-30T22:16:25.780121+0000","last_unstale":"2023-09-30T22:16:29.801487+0000","last_undegraded":"2023-09-30T22:16:29.801487+0000","last_fullsized":"2023-09-30T22:16:29.801487+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839571+0000","last_change":"2023-09-30T22:16:29.830888+0000","last_active":"2023-09-30T22:16:29.839571+0000","last_peered":"2023-09-30T22:16:29.839571+0000","last_clean":"2023-09-30T22:16:29.839571+0000","last_became_active":"2023-09-30T22:16:29.830569+0000","last_became_peered":"2023-09-30T22:16:29.830569+0000","last_unstale":"2023-09-30T22:16:29.839571+0000","last_undegraded":"2023-09-30T22:16:29.839571+0000","last_fullsized":"2023-09-30T22:16:29.839571+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.809542+0000","last_change":"2023-09-30T22:16:25.780328+0000","last_active":"2023-09-30T22:16:29.809542+0000","last_peered":"2023-09-30T22:16:29.809542+0000","last_clean":"2023-09-30T22:16:29.809542+0000","last_became_active":"2023-09-30T22:16:25.780026+0000","last_became_peered":"2023-09-30T22:16:25.780026+0000","last_unstale":"2023-09-30T22:16:29.809542+0000","last_undegraded":"2023-09-30T22:16:29.809542+0000","last_fullsized":"2023-09-30T22:16:29.809542+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:16:31.453480+0000","last_change":"2023-09-30T22:16:29.444398+0000","last_active":"2023-09-30T22:16:31.453480+0000","last_peered":"2023-09-30T22:16:31.453480+0000","last_clean":"2023-09-30T22:16:31.453480+0000","last_became_active":"2023-09-30T22:16:29.444126+0000","last_became_peered":"2023-09-30T22:16:29.444126+0000","last_unstale":"2023-09-30T22:16:31.453480+0000","last_undegraded":"2023-09-30T22:16:31.453480+0000","last_fullsized":"2023-09-30T22:16:31.453480+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828900+0000","last_change":"2023-09-30T22:16:29.820636+0000","last_active":"2023-09-30T22:16:29.828900+0000","last_peered":"2023-09-30T22:16:29.828900+0000","last_clean":"2023-09-30T22:16:29.828900+0000","last_became_active":"2023-09-30T22:16:29.820372+0000","last_became_peered":"2023-09-30T22:16:29.820372+0000","last_unstale":"2023-09-30T22:16:29.828900+0000","last_undegraded":"2023-09-30T22:16:29.828900+0000","last_fullsized":"2023-09-30T22:16:29.828900+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.831903+0000","last_change":"2023-09-30T22:16:29.452715+0000","last_active":"2023-09-30T22:16:29.831903+0000","last_peered":"2023-09-30T22:16:29.831903+0000","last_clean":"2023-09-30T22:16:29.831903+0000","last_became_active":"2023-09-30T22:16:29.452405+0000","last_became_peered":"2023-09-30T22:16:29.452405+0000","last_unstale":"2023-09-30T22:16:29.831903+0000","last_undegraded":"2023-09-30T22:16:29.831903+0000","last_fullsized":"2023-09-30T22:16:29.831903+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.829507+0000","last_change":"2023-09-30T22:16:29.827280+0000","last_active":"2023-09-30T22:16:29.829507+0000","last_peered":"2023-09-30T22:16:29.829507+0000","last_clean":"2023-09-30T22:16:29.829507+0000","last_became_active":"2023-09-30T22:16:29.827006+0000","last_became_peered":"2023-09-30T22:16:29.827006+0000","last_unstale":"2023-09-30T22:16:29.829507+0000","last_undegraded":"2023-09-30T22:16:29.829507+0000","last_fullsized":"2023-09-30T22:16:29.829507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828875+0000","last_change":"2023-09-30T22:16:29.441940+0000","last_active":"2023-09-30T22:16:29.828875+0000","last_peered":"2023-09-30T22:16:29.828875+0000","last_clean":"2023-09-30T22:16:29.828875+0000","last_became_active":"2023-09-30T22:16:29.441296+0000","last_became_peered":"2023-09-30T22:16:29.441296+0000","last_unstale":"2023-09-30T22:16:29.828875+0000","last_undegraded":"2023-09-30T22:16:29.828875+0000","last_fullsized":"2023-09-30T22:16:29.828875+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828802+0000","last_change":"2023-09-30T22:16:29.824467+0000","last_active":"2023-09-30T22:16:29.828802+0000","last_peered":"2023-09-30T22:16:29.828802+0000","last_clean":"2023-09-30T22:16:29.828802+0000","last_became_active":"2023-09-30T22:16:29.824206+0000","last_became_peered":"2023-09-30T22:16:29.824206+0000","last_unstale":"2023-09-30T22:16:29.828802+0000","last_undegraded":"2023-09-30T22:16:29.828802+0000","last_fullsized":"2023-09-30T22:16:29.828802+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.832904+0000","last_change":"2023-09-30T22:16:29.446705+0000","last_active":"2023-09-30T22:16:29.832904+0000","last_peered":"2023-09-30T22:16:29.832904+0000","last_clean":"2023-09-30T22:16:29.832904+0000","last_became_active":"2023-09-30T22:16:29.446173+0000","last_became_peered":"2023-09-30T22:16:29.446173+0000","last_unstale":"2023-09-30T22:16:29.832904+0000","last_undegraded":"2023-09-30T22:16:29.832904+0000","last_fullsized":"2023-09-30T22:16:29.832904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.835674+0000","last_change":"2023-09-30T22:16:29.832880+0000","last_active":"2023-09-30T22:16:29.835674+0000","last_peered":"2023-09-30T22:16:29.835674+0000","last_clean":"2023-09-30T22:16:29.835674+0000","last_became_active":"2023-09-30T22:16:29.832321+0000","last_became_peered":"2023-09-30T22:16:29.832321+0000","last_unstale":"2023-09-30T22:16:29.835674+0000","last_undegraded":"2023-09-30T22:16:29.835674+0000","last_fullsized":"2023-09-30T22:16:29.835674+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.824980+0000","last_change":"2023-09-30T22:16:29.451645+0000","last_active":"2023-09-30T22:16:29.824980+0000","last_peered":"2023-09-30T22:16:29.824980+0000","last_clean":"2023-09-30T22:16:29.824980+0000","last_became_active":"2023-09-30T22:16:29.451283+0000","last_became_peered":"2023-09-30T22:16:29.451283+0000","last_unstale":"2023-09-30T22:16:29.824980+0000","last_undegraded":"2023-09-30T22:16:29.824980+0000","last_fullsized":"2023-09-30T22:16:29.824980+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.834482+0000","last_change":"2023-09-30T22:16:29.825999+0000","last_active":"2023-09-30T22:16:29.834482+0000","last_peered":"2023-09-30T22:16:29.834482+0000","last_clean":"2023-09-30T22:16:29.834482+0000","last_became_active":"2023-09-30T22:16:29.825211+0000","last_became_peered":"2023-09-30T22:16:29.825211+0000","last_unstale":"2023-09-30T22:16:29.834482+0000","last_undegraded":"2023-09-30T22:16:29.834482+0000","last_fullsized":"2023-09-30T22:16:29.834482+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.825934+0000","last_change":"2023-09-30T22:16:29.443167+0000","last_active":"2023-09-30T22:16:29.825934+0000","last_peered":"2023-09-30T22:16:29.825934+0000","last_clean":"2023-09-30T22:16:29.825934+0000","last_became_active":"2023-09-30T22:16:29.442895+0000","last_became_peered":"2023-09-30T22:16:29.442895+0000","last_unstale":"2023-09-30T22:16:29.825934+0000","last_undegraded":"2023-09-30T22:16:29.825934+0000","last_fullsized":"2023-09-30T22:16:29.825934+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.829174+0000","last_change":"2023-09-30T22:16:29.827232+0000","last_active":"2023-09-30T22:16:29.829174+0000","last_peered":"2023-09-30T22:16:29.829174+0000","last_clean":"2023-09-30T22:16:29.829174+0000","last_became_active":"2023-09-30T22:16:29.826971+0000","last_became_peered":"2023-09-30T22:16:29.826971+0000","last_unstale":"2023-09-30T22:16:29.829174+0000","last_undegraded":"2023-09-30T22:16:29.829174+0000","last_fullsized":"2023-09-30T22:16:29.829174+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839680+0000","last_change":"2023-09-30T22:16:29.833273+0000","last_active":"2023-09-30T22:16:29.839680+0000","last_peered":"2023-09-30T22:16:29.839680+0000","last_clean":"2023-09-30T22:16:29.839680+0000","last_became_active":"2023-09-30T22:16:29.832627+0000","last_became_peered":"2023-09-30T22:16:29.832627+0000","last_unstale":"2023-09-30T22:16:29.839680+0000","last_undegraded":"2023-09-30T22:16:29.839680+0000","last_fullsized":"2023-09-30T22:16:29.839680+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.840122+0000","last_change":"2023-09-30T22:16:29.834527+0000","last_active":"2023-09-30T22:16:29.840122+0000","last_peered":"2023-09-30T22:16:29.840122+0000","last_clean":"2023-09-30T22:16:29.840122+0000","last_became_active":"2023-09-30T22:16:29.830063+0000","last_became_peered":"2023-09-30T22:16:29.830063+0000","last_unstale":"2023-09-30T22:16:29.840122+0000","last_undegraded":"2023-09-30T22:16:29.840122+0000","last_fullsized":"2023-09-30T22:16:29.840122+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.826932+0000","last_change":"2023-09-30T22:16:29.821730+0000","last_active":"2023-09-30T22:16:29.826932+0000","last_peered":"2023-09-30T22:16:29.826932+0000","last_clean":"2023-09-30T22:16:29.826932+0000","last_became_active":"2023-09-30T22:16:29.821455+0000","last_became_peered":"2023-09-30T22:16:29.821455+0000","last_unstale":"2023-09-30T22:16:29.826932+0000","last_undegraded":"2023-09-30T22:16:29.826932+0000","last_fullsized":"2023-09-30T22:16:29.826932+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839638+0000","last_change":"2023-09-30T22:16:29.830760+0000","last_active":"2023-09-30T22:16:29.839638+0000","last_peered":"2023-09-30T22:16:29.839638+0000","last_clean":"2023-09-30T22:16:29.839638+0000","last_became_active":"2023-09-30T22:16:29.830307+0000","last_became_peered":"2023-09-30T22:16:29.830307+0000","last_unstale":"2023-09-30T22:16:29.839638+0000","last_undegraded":"2023-09-30T22:16:29.839638+0000","last_fullsized":"2023-09-30T22:16:29.839638+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839900+0000","last_change":"2023-09-30T22:16:29.835169+0000","last_active":"2023-09-30T22:16:29.839900+0000","last_peered":"2023-09-30T22:16:29.839900+0000","last_clean":"2023-09-30T22:16:29.839900+0000","last_became_active":"2023-09-30T22:16:29.832849+0000","last_became_peered":"2023-09-30T22:16:29.832849+0000","last_unstale":"2023-09-30T22:16:29.839900+0000","last_undegraded":"2023-09-30T22:16:29.839900+0000","last_fullsized":"2023-09-30T22:16:29.839900+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":46244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":46050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":44044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":45160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:16:42.322 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:16:42.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.465+0000 7fe3a68e6700 1 Processor -- start 2023-09-30T22:16:42.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.466+0000 7fe3a68e6700 1 -- start start 2023-09-30T22:16:42.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.466+0000 7fe3a68e6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3a005f560 0x7fe3a012ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:42.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.466+0000 7fe3a68e6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe3a012b370 0x7fe3a0095d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:42.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.466+0000 7fe3a68e6700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a0066f90 con 0x7fe3a012b790 2023-09-30T22:16:42.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.466+0000 7fe3a68e6700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a005f940 con 0x7fe3a012b370 2023-09-30T22:16:42.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.466+0000 7fe3a68e6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a0067650 con 0x7fe3a005f560 2023-09-30T22:16:42.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.466+0000 7fe39ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3a005f560 0x7fe3a012ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:42.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.466+0000 7fe39f7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe3a012b370 0x7fe3a0095d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:42.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.466+0000 7fe39ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3a005f560 0x7fe3a012ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54404/0 (socket says 172.21.15.156:54404) 2023-09-30T22:16:42.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.466+0000 7fe3a4e83700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe3a012b790 0x7fe3a0096280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47320/0 (socket says 172.21.15.156:47320) 2023-09-30T22:16:42.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.466+0000 7fe39ffff700 1 -- 172.21.15.156:0/2109989569 learned_addr learned my addr 172.21.15.156:0/2109989569 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:42.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.466+0000 7fe39ffff700 1 -- 172.21.15.156:0/2109989569 >> v2:172.21.15.156:3300/0 conn(0x7fe3a012b370 msgr2=0x7fe3a0095d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:42.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.466+0000 7fe39ffff700 1 --2- 172.21.15.156:0/2109989569 >> v2:172.21.15.156:3300/0 conn(0x7fe3a012b370 0x7fe3a0095d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:42.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.466+0000 7fe39ffff700 1 -- 172.21.15.156:0/2109989569 >> v1:172.21.15.156:6789/0 conn(0x7fe3a012b790 legacy=0x7fe3a0096280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:42.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.466+0000 7fe39ffff700 1 -- 172.21.15.156:0/2109989569 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a0067910 con 0x7fe3a005f560 2023-09-30T22:16:42.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.466+0000 7fe39effd700 1 -- 172.21.15.156:0/2109989569 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373323524 0 0) 0x7fe3a0066f90 con 0x7fe3a012b790 2023-09-30T22:16:42.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.466+0000 7fe39f7fe700 1 --2- 172.21.15.156:0/2109989569 >> v2:172.21.15.156:3300/0 conn(0x7fe3a012b370 0x7fe3a0095d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:42.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.467+0000 7fe39ffff700 1 --2- 172.21.15.156:0/2109989569 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3a005f560 0x7fe3a012ae80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fe388009830 tx=0x7fe3880090f0).ready entity=mon.1 client_cookie=7d544ebc5eab00ca server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:42.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.467+0000 7fe39effd700 1 -- 172.21.15.156:0/2109989569 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38800b580 con 0x7fe3a005f560 2023-09-30T22:16:42.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.467+0000 7fe39effd700 1 -- 172.21.15.156:0/2109989569 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38800b6e0 con 0x7fe3a005f560 2023-09-30T22:16:42.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.467+0000 7fe39effd700 1 -- 172.21.15.156:0/2109989569 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38800ba60 con 0x7fe3a005f560 2023-09-30T22:16:42.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.467+0000 7fe3a68e6700 1 -- 172.21.15.156:0/2109989569 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3a005f560 msgr2=0x7fe3a012ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:42.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.467+0000 7fe3a68e6700 1 --2- 172.21.15.156:0/2109989569 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3a005f560 0x7fe3a012ae80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fe388009830 tx=0x7fe3880090f0).stop 2023-09-30T22:16:42.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.467+0000 7fe3a68e6700 1 -- 172.21.15.156:0/2109989569 shutdown_connections 2023-09-30T22:16:42.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.467+0000 7fe3a68e6700 1 --2- 172.21.15.156:0/2109989569 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3a005f560 0x7fe3a012ae80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:42.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.467+0000 7fe3a68e6700 1 --2- 172.21.15.156:0/2109989569 >> v2:172.21.15.156:3300/0 conn(0x7fe3a012b370 0x7fe3a0095d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:42.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.467+0000 7fe3a68e6700 1 -- 172.21.15.156:0/2109989569 >> 172.21.15.156:0/2109989569 conn(0x7fe3a009a1c0 msgr2=0x7fe3a009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:42.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.467+0000 7fe3a68e6700 1 -- 172.21.15.156:0/2109989569 shutdown_connections 2023-09-30T22:16:42.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.467+0000 7fe3a68e6700 1 -- 172.21.15.156:0/2109989569 wait complete. 2023-09-30T22:16:42.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.468+0000 7fe3a68e6700 1 Processor -- start 2023-09-30T22:16:42.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.468+0000 7fe3a68e6700 1 -- start start 2023-09-30T22:16:42.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.469+0000 7fe3a68e6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe3a005f560 0x7fe3a013a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:42.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.469+0000 7fe3a68e6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3a012b370 0x7fe3a013a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:42.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.469+0000 7fe3a68e6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3a012b790 0x7fe3a0114bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:42.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.469+0000 7fe3a68e6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a00671c0 con 0x7fe3a012b370 2023-09-30T22:16:42.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.469+0000 7fe3a68e6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a0116040 con 0x7fe3a012b790 2023-09-30T22:16:42.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.469+0000 7fe3a68e6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a01180d0 con 0x7fe3a005f560 2023-09-30T22:16:42.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.469+0000 7fe39ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe3a005f560 0x7fe3a013a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:42.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.469+0000 7fe3a4e83700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3a012b790 0x7fe3a0114bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:42.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.469+0000 7fe39f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3a012b370 0x7fe3a013a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:42.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.469+0000 7fe39f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3a012b370 0x7fe3a013a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:35584/0 (socket says 172.21.15.156:35584) 2023-09-30T22:16:42.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.469+0000 7fe39ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe3a005f560 0x7fe3a013a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39928/0 (socket says 172.21.15.156:39928) 2023-09-30T22:16:42.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.469+0000 7fe39f7fe700 1 -- 172.21.15.156:0/3818922700 learned_addr learned my addr 172.21.15.156:0/3818922700 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:42.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.469+0000 7fe3a4e83700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3a012b790 0x7fe3a0114bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54414/0 (socket says 172.21.15.156:54414) 2023-09-30T22:16:42.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.469+0000 7fe39f7fe700 1 -- 172.21.15.156:0/3818922700 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe3a005f560 msgr2=0x7fe3a013a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:42.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.469+0000 7fe39f7fe700 1 --2- 172.21.15.156:0/3818922700 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe3a005f560 0x7fe3a013a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:42.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.469+0000 7fe39f7fe700 1 -- 172.21.15.156:0/3818922700 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3a012b790 msgr2=0x7fe3a0114bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:42.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.469+0000 7fe39f7fe700 1 --2- 172.21.15.156:0/3818922700 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3a012b790 0x7fe3a0114bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:42.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.469+0000 7fe39f7fe700 1 -- 172.21.15.156:0/3818922700 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3900092a0 con 0x7fe3a012b370 2023-09-30T22:16:42.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.469+0000 7fe3a4e83700 1 --2- 172.21.15.156:0/3818922700 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3a012b790 0x7fe3a0114bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:42.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.469+0000 7fe39f7fe700 1 --2- 172.21.15.156:0/3818922700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3a012b370 0x7fe3a013a9d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fe39000e9d0 tx=0x7fe390009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:42.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.469+0000 7fe397fff700 1 -- 172.21.15.156:0/3818922700 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39000c6a0 con 0x7fe3a012b370 2023-09-30T22:16:42.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.469+0000 7fe397fff700 1 -- 172.21.15.156:0/3818922700 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39000c800 con 0x7fe3a012b370 2023-09-30T22:16:42.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.469+0000 7fe397fff700 1 -- 172.21.15.156:0/3818922700 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39000cb80 con 0x7fe3a012b370 2023-09-30T22:16:42.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.469+0000 7fe3a68e6700 1 -- 172.21.15.156:0/3818922700 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe388009370 con 0x7fe3a012b370 2023-09-30T22:16:42.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.470+0000 7fe3a68e6700 1 -- 172.21.15.156:0/3818922700 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a0118700 con 0x7fe3a012b370 2023-09-30T22:16:42.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.470+0000 7fe397fff700 1 -- 172.21.15.156:0/3818922700 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fe39001b400 con 0x7fe3a012b370 2023-09-30T22:16:42.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.470+0000 7fe397fff700 1 -- 172.21.15.156:0/3818922700 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fe39003b4b0 con 0x7fe3a012b370 2023-09-30T22:16:42.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.471+0000 7fe3a68e6700 1 -- 172.21.15.156:0/3818922700 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a005a260 con 0x7fe3a012b370 2023-09-30T22:16:42.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.475+0000 7fe397fff700 1 -- 172.21.15.156:0/3818922700 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fe390016070 con 0x7fe3a012b370 2023-09-30T22:16:42.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.627+0000 7fe3a68e6700 1 -- 172.21.15.156:0/3818922700 --> v1:172.21.15.156:6816/118236 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe3a012ab70 con 0x7fe38002bb60 2023-09-30T22:16:42.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.634+0000 7fe397fff700 1 -- 172.21.15.156:0/3818922700 <== mgr.4122 v1:172.21.15.156:6816/118236 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249955 (unknown 2965378022 0 3718852276) 0x7fe3a012ab70 con 0x7fe38002bb60 2023-09-30T22:16:42.637 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:42.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.636+0000 7fe3a68e6700 1 -- 172.21.15.156:0/3818922700 >> v1:172.21.15.156:6816/118236 conn(0x7fe38002bb60 legacy=0x7fe38002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:42.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.636+0000 7fe3a68e6700 1 -- 172.21.15.156:0/3818922700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3a012b370 msgr2=0x7fe3a013a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:42.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.636+0000 7fe3a68e6700 1 --2- 172.21.15.156:0/3818922700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3a012b370 0x7fe3a013a9d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fe39000e9d0 tx=0x7fe390009060).stop 2023-09-30T22:16:42.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.636+0000 7fe3a68e6700 1 -- 172.21.15.156:0/3818922700 shutdown_connections 2023-09-30T22:16:42.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.636+0000 7fe3a68e6700 1 --2- 172.21.15.156:0/3818922700 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3a012b790 0x7fe3a0114bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:42.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.636+0000 7fe3a68e6700 1 --2- 172.21.15.156:0/3818922700 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe3a005f560 0x7fe3a013a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:42.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.636+0000 7fe3a68e6700 1 --2- 172.21.15.156:0/3818922700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3a012b370 0x7fe3a013a9d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:42.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.636+0000 7fe3a68e6700 1 -- 172.21.15.156:0/3818922700 >> 172.21.15.156:0/3818922700 conn(0x7fe3a009a1c0 msgr2=0x7fe3a0065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:42.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.637+0000 7fe3a68e6700 1 -- 172.21.15.156:0/3818922700 shutdown_connections 2023-09-30T22:16:42.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.637+0000 7fe3a68e6700 1 -- 172.21.15.156:0/3818922700 wait complete. 2023-09-30T22:16:42.641 INFO:teuthology.orchestra.run.smithi156.stderr:dumped all 2023-09-30T22:16:42.649 INFO:teuthology.orchestra.run.smithi156.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-09-30T22:16:42.356410+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188988,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298372,"statfs":{"total":386547056640,"available":385329532928,"internally_reserved":0,"allocated":618496,"data_stored":181498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1640,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001636"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.818548+0000","last_change":"2023-09-30T22:16:29.812173+0000","last_active":"2023-09-30T22:16:29.818548+0000","last_peered":"2023-09-30T22:16:29.818548+0000","last_clean":"2023-09-30T22:16:29.818548+0000","last_became_active":"2023-09-30T22:16:29.811948+0000","last_became_peered":"2023-09-30T22:16:29.811948+0000","last_unstale":"2023-09-30T22:16:29.818548+0000","last_undegraded":"2023-09-30T22:16:29.818548+0000","last_fullsized":"2023-09-30T22:16:29.818548+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.829503+0000","last_change":"2023-09-30T22:16:29.827324+0000","last_active":"2023-09-30T22:16:29.829503+0000","last_peered":"2023-09-30T22:16:29.829503+0000","last_clean":"2023-09-30T22:16:29.829503+0000","last_became_active":"2023-09-30T22:16:29.826847+0000","last_became_peered":"2023-09-30T22:16:29.826847+0000","last_unstale":"2023-09-30T22:16:29.829503+0000","last_undegraded":"2023-09-30T22:16:29.829503+0000","last_fullsized":"2023-09-30T22:16:29.829503+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828371+0000","last_change":"2023-09-30T22:16:29.825941+0000","last_active":"2023-09-30T22:16:29.828371+0000","last_peered":"2023-09-30T22:16:29.828371+0000","last_clean":"2023-09-30T22:16:29.828371+0000","last_became_active":"2023-09-30T22:16:29.825655+0000","last_became_peered":"2023-09-30T22:16:29.825655+0000","last_unstale":"2023-09-30T22:16:29.828371+0000","last_undegraded":"2023-09-30T22:16:29.828371+0000","last_fullsized":"2023-09-30T22:16:29.828371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828040+0000","last_change":"2023-09-30T22:16:29.822545+0000","last_active":"2023-09-30T22:16:29.828040+0000","last_peered":"2023-09-30T22:16:29.828040+0000","last_clean":"2023-09-30T22:16:29.828040+0000","last_became_active":"2023-09-30T22:16:29.822264+0000","last_became_peered":"2023-09-30T22:16:29.822264+0000","last_unstale":"2023-09-30T22:16:29.828040+0000","last_undegraded":"2023-09-30T22:16:29.828040+0000","last_fullsized":"2023-09-30T22:16:29.828040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.835961+0000","last_change":"2023-09-30T22:16:29.831319+0000","last_active":"2023-09-30T22:16:29.835961+0000","last_peered":"2023-09-30T22:16:29.835961+0000","last_clean":"2023-09-30T22:16:29.835961+0000","last_became_active":"2023-09-30T22:16:29.831024+0000","last_became_peered":"2023-09-30T22:16:29.831024+0000","last_unstale":"2023-09-30T22:16:29.835961+0000","last_undegraded":"2023-09-30T22:16:29.835961+0000","last_fullsized":"2023-09-30T22:16:29.835961+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828212+0000","last_change":"2023-09-30T22:16:29.820688+0000","last_active":"2023-09-30T22:16:29.828212+0000","last_peered":"2023-09-30T22:16:29.828212+0000","last_clean":"2023-09-30T22:16:29.828212+0000","last_became_active":"2023-09-30T22:16:29.820480+0000","last_became_peered":"2023-09-30T22:16:29.820480+0000","last_unstale":"2023-09-30T22:16:29.828212+0000","last_undegraded":"2023-09-30T22:16:29.828212+0000","last_fullsized":"2023-09-30T22:16:29.828212+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.840140+0000","last_change":"2023-09-30T22:16:29.834595+0000","last_active":"2023-09-30T22:16:29.840140+0000","last_peered":"2023-09-30T22:16:29.840140+0000","last_clean":"2023-09-30T22:16:29.840140+0000","last_became_active":"2023-09-30T22:16:29.834156+0000","last_became_peered":"2023-09-30T22:16:29.834156+0000","last_unstale":"2023-09-30T22:16:29.840140+0000","last_undegraded":"2023-09-30T22:16:29.840140+0000","last_fullsized":"2023-09-30T22:16:29.840140+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.829014+0000","last_change":"2023-09-30T22:16:29.822064+0000","last_active":"2023-09-30T22:16:29.829014+0000","last_peered":"2023-09-30T22:16:29.829014+0000","last_clean":"2023-09-30T22:16:29.829014+0000","last_became_active":"2023-09-30T22:16:29.821816+0000","last_became_peered":"2023-09-30T22:16:29.821816+0000","last_unstale":"2023-09-30T22:16:29.829014+0000","last_undegraded":"2023-09-30T22:16:29.829014+0000","last_fullsized":"2023-09-30T22:16:29.829014+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828723+0000","last_change":"2023-09-30T22:16:29.828044+0000","last_active":"2023-09-30T22:16:29.828723+0000","last_peered":"2023-09-30T22:16:29.828723+0000","last_clean":"2023-09-30T22:16:29.828723+0000","last_became_active":"2023-09-30T22:16:29.827740+0000","last_became_peered":"2023-09-30T22:16:29.827740+0000","last_unstale":"2023-09-30T22:16:29.828723+0000","last_undegraded":"2023-09-30T22:16:29.828723+0000","last_fullsized":"2023-09-30T22:16:29.828723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.829021+0000","last_change":"2023-09-30T22:16:29.824597+0000","last_active":"2023-09-30T22:16:29.829021+0000","last_peered":"2023-09-30T22:16:29.829021+0000","last_clean":"2023-09-30T22:16:29.829021+0000","last_became_active":"2023-09-30T22:16:29.824344+0000","last_became_peered":"2023-09-30T22:16:29.824344+0000","last_unstale":"2023-09-30T22:16:29.829021+0000","last_undegraded":"2023-09-30T22:16:29.829021+0000","last_fullsized":"2023-09-30T22:16:29.829021+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839137+0000","last_change":"2023-09-30T22:16:29.830182+0000","last_active":"2023-09-30T22:16:29.839137+0000","last_peered":"2023-09-30T22:16:29.839137+0000","last_clean":"2023-09-30T22:16:29.839137+0000","last_became_active":"2023-09-30T22:16:29.828962+0000","last_became_peered":"2023-09-30T22:16:29.828962+0000","last_unstale":"2023-09-30T22:16:29.839137+0000","last_undegraded":"2023-09-30T22:16:29.839137+0000","last_fullsized":"2023-09-30T22:16:29.839137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.835722+0000","last_change":"2023-09-30T22:16:29.833916+0000","last_active":"2023-09-30T22:16:29.835722+0000","last_peered":"2023-09-30T22:16:29.835722+0000","last_clean":"2023-09-30T22:16:29.835722+0000","last_became_active":"2023-09-30T22:16:29.833664+0000","last_became_peered":"2023-09-30T22:16:29.833664+0000","last_unstale":"2023-09-30T22:16:29.835722+0000","last_undegraded":"2023-09-30T22:16:29.835722+0000","last_fullsized":"2023-09-30T22:16:29.835722+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828781+0000","last_change":"2023-09-30T22:16:29.823993+0000","last_active":"2023-09-30T22:16:29.828781+0000","last_peered":"2023-09-30T22:16:29.828781+0000","last_clean":"2023-09-30T22:16:29.828781+0000","last_became_active":"2023-09-30T22:16:29.823725+0000","last_became_peered":"2023-09-30T22:16:29.823725+0000","last_unstale":"2023-09-30T22:16:29.828781+0000","last_undegraded":"2023-09-30T22:16:29.828781+0000","last_fullsized":"2023-09-30T22:16:29.828781+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839359+0000","last_change":"2023-09-30T22:16:29.832518+0000","last_active":"2023-09-30T22:16:29.839359+0000","last_peered":"2023-09-30T22:16:29.839359+0000","last_clean":"2023-09-30T22:16:29.839359+0000","last_became_active":"2023-09-30T22:16:29.832228+0000","last_became_peered":"2023-09-30T22:16:29.832228+0000","last_unstale":"2023-09-30T22:16:29.839359+0000","last_undegraded":"2023-09-30T22:16:29.839359+0000","last_fullsized":"2023-09-30T22:16:29.839359+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.822394+0000","last_change":"2023-09-30T22:16:29.814680+0000","last_active":"2023-09-30T22:16:29.822394+0000","last_peered":"2023-09-30T22:16:29.822394+0000","last_clean":"2023-09-30T22:16:29.822394+0000","last_became_active":"2023-09-30T22:16:29.814427+0000","last_became_peered":"2023-09-30T22:16:29.814427+0000","last_unstale":"2023-09-30T22:16:29.822394+0000","last_undegraded":"2023-09-30T22:16:29.822394+0000","last_fullsized":"2023-09-30T22:16:29.822394+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839868+0000","last_change":"2023-09-30T22:16:29.833416+0000","last_active":"2023-09-30T22:16:29.839868+0000","last_peered":"2023-09-30T22:16:29.839868+0000","last_clean":"2023-09-30T22:16:29.839868+0000","last_became_active":"2023-09-30T22:16:29.833121+0000","last_became_peered":"2023-09-30T22:16:29.833121+0000","last_unstale":"2023-09-30T22:16:29.839868+0000","last_undegraded":"2023-09-30T22:16:29.839868+0000","last_fullsized":"2023-09-30T22:16:29.839868+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828415+0000","last_change":"2023-09-30T22:16:29.823463+0000","last_active":"2023-09-30T22:16:29.828415+0000","last_peered":"2023-09-30T22:16:29.828415+0000","last_clean":"2023-09-30T22:16:29.828415+0000","last_became_active":"2023-09-30T22:16:29.823207+0000","last_became_peered":"2023-09-30T22:16:29.823207+0000","last_unstale":"2023-09-30T22:16:29.828415+0000","last_undegraded":"2023-09-30T22:16:29.828415+0000","last_fullsized":"2023-09-30T22:16:29.828415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.827618+0000","last_change":"2023-09-30T22:16:29.816722+0000","last_active":"2023-09-30T22:16:29.827618+0000","last_peered":"2023-09-30T22:16:29.827618+0000","last_clean":"2023-09-30T22:16:29.827618+0000","last_became_active":"2023-09-30T22:16:29.816461+0000","last_became_peered":"2023-09-30T22:16:29.816461+0000","last_unstale":"2023-09-30T22:16:29.827618+0000","last_undegraded":"2023-09-30T22:16:29.827618+0000","last_fullsized":"2023-09-30T22:16:29.827618+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.835733+0000","last_change":"2023-09-30T22:16:29.833443+0000","last_active":"2023-09-30T22:16:29.835733+0000","last_peered":"2023-09-30T22:16:29.835733+0000","last_clean":"2023-09-30T22:16:29.835733+0000","last_became_active":"2023-09-30T22:16:29.833187+0000","last_became_peered":"2023-09-30T22:16:29.833187+0000","last_unstale":"2023-09-30T22:16:29.835733+0000","last_undegraded":"2023-09-30T22:16:29.835733+0000","last_fullsized":"2023-09-30T22:16:29.835733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.838620+0000","last_change":"2023-09-30T22:16:29.828875+0000","last_active":"2023-09-30T22:16:29.838620+0000","last_peered":"2023-09-30T22:16:29.838620+0000","last_clean":"2023-09-30T22:16:29.838620+0000","last_became_active":"2023-09-30T22:16:29.828593+0000","last_became_peered":"2023-09-30T22:16:29.828593+0000","last_unstale":"2023-09-30T22:16:29.838620+0000","last_undegraded":"2023-09-30T22:16:29.838620+0000","last_fullsized":"2023-09-30T22:16:29.838620+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.829249+0000","last_change":"2023-09-30T22:16:29.827607+0000","last_active":"2023-09-30T22:16:29.829249+0000","last_peered":"2023-09-30T22:16:29.829249+0000","last_clean":"2023-09-30T22:16:29.829249+0000","last_became_active":"2023-09-30T22:16:29.826392+0000","last_became_peered":"2023-09-30T22:16:29.826392+0000","last_unstale":"2023-09-30T22:16:29.829249+0000","last_undegraded":"2023-09-30T22:16:29.829249+0000","last_fullsized":"2023-09-30T22:16:29.829249+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828165+0000","last_change":"2023-09-30T22:16:29.823191+0000","last_active":"2023-09-30T22:16:29.828165+0000","last_peered":"2023-09-30T22:16:29.828165+0000","last_clean":"2023-09-30T22:16:29.828165+0000","last_became_active":"2023-09-30T22:16:29.822796+0000","last_became_peered":"2023-09-30T22:16:29.822796+0000","last_unstale":"2023-09-30T22:16:29.828165+0000","last_undegraded":"2023-09-30T22:16:29.828165+0000","last_fullsized":"2023-09-30T22:16:29.828165+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.840103+0000","last_change":"2023-09-30T22:16:29.834377+0000","last_active":"2023-09-30T22:16:29.840103+0000","last_peered":"2023-09-30T22:16:29.840103+0000","last_clean":"2023-09-30T22:16:29.840103+0000","last_became_active":"2023-09-30T22:16:29.833873+0000","last_became_peered":"2023-09-30T22:16:29.833873+0000","last_unstale":"2023-09-30T22:16:29.840103+0000","last_undegraded":"2023-09-30T22:16:29.840103+0000","last_fullsized":"2023-09-30T22:16:29.840103+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.823195+0000","last_change":"2023-09-30T22:16:29.821578+0000","last_active":"2023-09-30T22:16:29.823195+0000","last_peered":"2023-09-30T22:16:29.823195+0000","last_clean":"2023-09-30T22:16:29.823195+0000","last_became_active":"2023-09-30T22:16:29.818116+0000","last_became_peered":"2023-09-30T22:16:29.818116+0000","last_unstale":"2023-09-30T22:16:29.823195+0000","last_undegraded":"2023-09-30T22:16:29.823195+0000","last_fullsized":"2023-09-30T22:16:29.823195+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.838596+0000","last_change":"2023-09-30T22:16:29.829048+0000","last_active":"2023-09-30T22:16:29.838596+0000","last_peered":"2023-09-30T22:16:29.838596+0000","last_clean":"2023-09-30T22:16:29.838596+0000","last_became_active":"2023-09-30T22:16:29.828174+0000","last_became_peered":"2023-09-30T22:16:29.828174+0000","last_unstale":"2023-09-30T22:16:29.838596+0000","last_undegraded":"2023-09-30T22:16:29.838596+0000","last_fullsized":"2023-09-30T22:16:29.838596+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839543+0000","last_change":"2023-09-30T22:16:29.834779+0000","last_active":"2023-09-30T22:16:29.839543+0000","last_peered":"2023-09-30T22:16:29.839543+0000","last_clean":"2023-09-30T22:16:29.839543+0000","last_became_active":"2023-09-30T22:16:29.833042+0000","last_became_peered":"2023-09-30T22:16:29.833042+0000","last_unstale":"2023-09-30T22:16:29.839543+0000","last_undegraded":"2023-09-30T22:16:29.839543+0000","last_fullsized":"2023-09-30T22:16:29.839543+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839810+0000","last_change":"2023-09-30T22:16:29.832499+0000","last_active":"2023-09-30T22:16:29.839810+0000","last_peered":"2023-09-30T22:16:29.839810+0000","last_clean":"2023-09-30T22:16:29.839810+0000","last_became_active":"2023-09-30T22:16:29.831898+0000","last_became_peered":"2023-09-30T22:16:29.831898+0000","last_unstale":"2023-09-30T22:16:29.839810+0000","last_undegraded":"2023-09-30T22:16:29.839810+0000","last_fullsized":"2023-09-30T22:16:29.839810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.832635+0000","last_change":"2023-09-30T22:16:29.448332+0000","last_active":"2023-09-30T22:16:29.832635+0000","last_peered":"2023-09-30T22:16:29.832635+0000","last_clean":"2023-09-30T22:16:29.832635+0000","last_became_active":"2023-09-30T22:16:29.448043+0000","last_became_peered":"2023-09-30T22:16:29.448043+0000","last_unstale":"2023-09-30T22:16:29.832635+0000","last_undegraded":"2023-09-30T22:16:29.832635+0000","last_fullsized":"2023-09-30T22:16:29.832635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839699+0000","last_change":"2023-09-30T22:16:29.831419+0000","last_active":"2023-09-30T22:16:29.839699+0000","last_peered":"2023-09-30T22:16:29.839699+0000","last_clean":"2023-09-30T22:16:29.839699+0000","last_became_active":"2023-09-30T22:16:29.830841+0000","last_became_peered":"2023-09-30T22:16:29.830841+0000","last_unstale":"2023-09-30T22:16:29.839699+0000","last_undegraded":"2023-09-30T22:16:29.839699+0000","last_fullsized":"2023-09-30T22:16:29.839699+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.797808+0000","last_change":"2023-09-30T22:16:29.449809+0000","last_active":"2023-09-30T22:16:29.797808+0000","last_peered":"2023-09-30T22:16:29.797808+0000","last_clean":"2023-09-30T22:16:29.797808+0000","last_became_active":"2023-09-30T22:16:29.449538+0000","last_became_peered":"2023-09-30T22:16:29.449538+0000","last_unstale":"2023-09-30T22:16:29.797808+0000","last_undegraded":"2023-09-30T22:16:29.797808+0000","last_fullsized":"2023-09-30T22:16:29.797808+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.827987+0000","last_change":"2023-09-30T22:16:29.822995+0000","last_active":"2023-09-30T22:16:29.827987+0000","last_peered":"2023-09-30T22:16:29.827987+0000","last_clean":"2023-09-30T22:16:29.827987+0000","last_became_active":"2023-09-30T22:16:29.822621+0000","last_became_peered":"2023-09-30T22:16:29.822621+0000","last_unstale":"2023-09-30T22:16:29.827987+0000","last_undegraded":"2023-09-30T22:16:29.827987+0000","last_fullsized":"2023-09-30T22:16:29.827987+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.814238+0000","last_change":"2023-09-30T22:16:29.452955+0000","last_active":"2023-09-30T22:16:29.814238+0000","last_peered":"2023-09-30T22:16:29.814238+0000","last_clean":"2023-09-30T22:16:29.814238+0000","last_became_active":"2023-09-30T22:16:29.449928+0000","last_became_peered":"2023-09-30T22:16:29.449928+0000","last_unstale":"2023-09-30T22:16:29.814238+0000","last_undegraded":"2023-09-30T22:16:29.814238+0000","last_fullsized":"2023-09-30T22:16:29.814238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839729+0000","last_change":"2023-09-30T22:16:29.831592+0000","last_active":"2023-09-30T22:16:29.839729+0000","last_peered":"2023-09-30T22:16:29.839729+0000","last_clean":"2023-09-30T22:16:29.839729+0000","last_became_active":"2023-09-30T22:16:29.831170+0000","last_became_peered":"2023-09-30T22:16:29.831170+0000","last_unstale":"2023-09-30T22:16:29.839729+0000","last_undegraded":"2023-09-30T22:16:29.839729+0000","last_fullsized":"2023-09-30T22:16:29.839729+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.803377+0000","last_change":"2023-09-30T22:16:29.452637+0000","last_active":"2023-09-30T22:16:29.803377+0000","last_peered":"2023-09-30T22:16:29.803377+0000","last_clean":"2023-09-30T22:16:29.803377+0000","last_became_active":"2023-09-30T22:16:29.452263+0000","last_became_peered":"2023-09-30T22:16:29.452263+0000","last_unstale":"2023-09-30T22:16:29.803377+0000","last_undegraded":"2023-09-30T22:16:29.803377+0000","last_fullsized":"2023-09-30T22:16:29.803377+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.840008+0000","last_change":"2023-09-30T22:16:29.835756+0000","last_active":"2023-09-30T22:16:29.840008+0000","last_peered":"2023-09-30T22:16:29.840008+0000","last_clean":"2023-09-30T22:16:29.840008+0000","last_became_active":"2023-09-30T22:16:29.834448+0000","last_became_peered":"2023-09-30T22:16:29.834448+0000","last_unstale":"2023-09-30T22:16:29.840008+0000","last_undegraded":"2023-09-30T22:16:29.840008+0000","last_fullsized":"2023-09-30T22:16:29.840008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.799766+0000","last_change":"2023-09-30T22:16:29.448611+0000","last_active":"2023-09-30T22:16:29.799766+0000","last_peered":"2023-09-30T22:16:29.799766+0000","last_clean":"2023-09-30T22:16:29.799766+0000","last_became_active":"2023-09-30T22:16:29.448289+0000","last_became_peered":"2023-09-30T22:16:29.448289+0000","last_unstale":"2023-09-30T22:16:29.799766+0000","last_undegraded":"2023-09-30T22:16:29.799766+0000","last_fullsized":"2023-09-30T22:16:29.799766+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.840157+0000","last_change":"2023-09-30T22:16:29.836465+0000","last_active":"2023-09-30T22:16:29.840157+0000","last_peered":"2023-09-30T22:16:29.840157+0000","last_clean":"2023-09-30T22:16:29.840157+0000","last_became_active":"2023-09-30T22:16:29.834303+0000","last_became_peered":"2023-09-30T22:16:29.834303+0000","last_unstale":"2023-09-30T22:16:29.840157+0000","last_undegraded":"2023-09-30T22:16:29.840157+0000","last_fullsized":"2023-09-30T22:16:29.840157+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.827908+0000","last_change":"2023-09-30T22:16:29.448241+0000","last_active":"2023-09-30T22:16:29.827908+0000","last_peered":"2023-09-30T22:16:29.827908+0000","last_clean":"2023-09-30T22:16:29.827908+0000","last_became_active":"2023-09-30T22:16:29.447960+0000","last_became_peered":"2023-09-30T22:16:29.447960+0000","last_unstale":"2023-09-30T22:16:29.827908+0000","last_undegraded":"2023-09-30T22:16:29.827908+0000","last_fullsized":"2023-09-30T22:16:29.827908+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828838+0000","last_change":"2023-09-30T22:16:29.825275+0000","last_active":"2023-09-30T22:16:29.828838+0000","last_peered":"2023-09-30T22:16:29.828838+0000","last_clean":"2023-09-30T22:16:29.828838+0000","last_became_active":"2023-09-30T22:16:29.825002+0000","last_became_peered":"2023-09-30T22:16:29.825002+0000","last_unstale":"2023-09-30T22:16:29.828838+0000","last_undegraded":"2023-09-30T22:16:29.828838+0000","last_fullsized":"2023-09-30T22:16:29.828838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.840394+0000","last_change":"2023-09-30T22:16:29.449099+0000","last_active":"2023-09-30T22:16:29.840394+0000","last_peered":"2023-09-30T22:16:29.840394+0000","last_clean":"2023-09-30T22:16:29.840394+0000","last_became_active":"2023-09-30T22:16:29.448827+0000","last_became_peered":"2023-09-30T22:16:29.448827+0000","last_unstale":"2023-09-30T22:16:29.840394+0000","last_undegraded":"2023-09-30T22:16:29.840394+0000","last_fullsized":"2023-09-30T22:16:29.840394+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.819093+0000","last_change":"2023-09-30T22:16:29.811836+0000","last_active":"2023-09-30T22:16:29.819093+0000","last_peered":"2023-09-30T22:16:29.819093+0000","last_clean":"2023-09-30T22:16:29.819093+0000","last_became_active":"2023-09-30T22:16:29.811605+0000","last_became_peered":"2023-09-30T22:16:29.811605+0000","last_unstale":"2023-09-30T22:16:29.819093+0000","last_undegraded":"2023-09-30T22:16:29.819093+0000","last_fullsized":"2023-09-30T22:16:29.819093+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.833443+0000","last_change":"2023-09-30T22:16:29.446893+0000","last_active":"2023-09-30T22:16:29.833443+0000","last_peered":"2023-09-30T22:16:29.833443+0000","last_clean":"2023-09-30T22:16:29.833443+0000","last_became_active":"2023-09-30T22:16:29.446554+0000","last_became_peered":"2023-09-30T22:16:29.446554+0000","last_unstale":"2023-09-30T22:16:29.833443+0000","last_undegraded":"2023-09-30T22:16:29.833443+0000","last_fullsized":"2023-09-30T22:16:29.833443+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.838932+0000","last_change":"2023-09-30T22:16:29.830170+0000","last_active":"2023-09-30T22:16:29.838932+0000","last_peered":"2023-09-30T22:16:29.838932+0000","last_clean":"2023-09-30T22:16:29.838932+0000","last_became_active":"2023-09-30T22:16:29.829909+0000","last_became_peered":"2023-09-30T22:16:29.829909+0000","last_unstale":"2023-09-30T22:16:29.838932+0000","last_undegraded":"2023-09-30T22:16:29.838932+0000","last_fullsized":"2023-09-30T22:16:29.838932+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.802776+0000","last_change":"2023-09-30T22:16:29.453090+0000","last_active":"2023-09-30T22:16:29.802776+0000","last_peered":"2023-09-30T22:16:29.802776+0000","last_clean":"2023-09-30T22:16:29.802776+0000","last_became_active":"2023-09-30T22:16:29.452814+0000","last_became_peered":"2023-09-30T22:16:29.452814+0000","last_unstale":"2023-09-30T22:16:29.802776+0000","last_undegraded":"2023-09-30T22:16:29.802776+0000","last_fullsized":"2023-09-30T22:16:29.802776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839830+0000","last_change":"2023-09-30T22:16:29.832660+0000","last_active":"2023-09-30T22:16:29.839830+0000","last_peered":"2023-09-30T22:16:29.839830+0000","last_clean":"2023-09-30T22:16:29.839830+0000","last_became_active":"2023-09-30T22:16:29.832233+0000","last_became_peered":"2023-09-30T22:16:29.832233+0000","last_unstale":"2023-09-30T22:16:29.839830+0000","last_undegraded":"2023-09-30T22:16:29.839830+0000","last_fullsized":"2023-09-30T22:16:29.839830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.811008+0000","last_change":"2023-09-30T22:16:29.450700+0000","last_active":"2023-09-30T22:16:29.811008+0000","last_peered":"2023-09-30T22:16:29.811008+0000","last_clean":"2023-09-30T22:16:29.811008+0000","last_became_active":"2023-09-30T22:16:29.450434+0000","last_became_peered":"2023-09-30T22:16:29.450434+0000","last_unstale":"2023-09-30T22:16:29.811008+0000","last_undegraded":"2023-09-30T22:16:29.811008+0000","last_fullsized":"2023-09-30T22:16:29.811008+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.827638+0000","last_change":"2023-09-30T22:16:29.821215+0000","last_active":"2023-09-30T22:16:29.827638+0000","last_peered":"2023-09-30T22:16:29.827638+0000","last_clean":"2023-09-30T22:16:29.827638+0000","last_became_active":"2023-09-30T22:16:29.820939+0000","last_became_peered":"2023-09-30T22:16:29.820939+0000","last_unstale":"2023-09-30T22:16:29.827638+0000","last_undegraded":"2023-09-30T22:16:29.827638+0000","last_fullsized":"2023-09-30T22:16:29.827638+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.837411+0000","last_change":"2023-09-30T22:16:29.445251+0000","last_active":"2023-09-30T22:16:29.837411+0000","last_peered":"2023-09-30T22:16:29.837411+0000","last_clean":"2023-09-30T22:16:29.837411+0000","last_became_active":"2023-09-30T22:16:29.441736+0000","last_became_peered":"2023-09-30T22:16:29.441736+0000","last_unstale":"2023-09-30T22:16:29.837411+0000","last_undegraded":"2023-09-30T22:16:29.837411+0000","last_fullsized":"2023-09-30T22:16:29.837411+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.840261+0000","last_change":"2023-09-30T22:16:29.836710+0000","last_active":"2023-09-30T22:16:29.840261+0000","last_peered":"2023-09-30T22:16:29.840261+0000","last_clean":"2023-09-30T22:16:29.840261+0000","last_became_active":"2023-09-30T22:16:29.831551+0000","last_became_peered":"2023-09-30T22:16:29.831551+0000","last_unstale":"2023-09-30T22:16:29.840261+0000","last_undegraded":"2023-09-30T22:16:29.840261+0000","last_fullsized":"2023-09-30T22:16:29.840261+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.825857+0000","last_change":"2023-09-30T22:16:29.444871+0000","last_active":"2023-09-30T22:16:29.825857+0000","last_peered":"2023-09-30T22:16:29.825857+0000","last_clean":"2023-09-30T22:16:29.825857+0000","last_became_active":"2023-09-30T22:16:29.444600+0000","last_became_peered":"2023-09-30T22:16:29.444600+0000","last_unstale":"2023-09-30T22:16:29.825857+0000","last_undegraded":"2023-09-30T22:16:29.825857+0000","last_fullsized":"2023-09-30T22:16:29.825857+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.840410+0000","last_change":"2023-09-30T22:16:29.839223+0000","last_active":"2023-09-30T22:16:29.840410+0000","last_peered":"2023-09-30T22:16:29.840410+0000","last_clean":"2023-09-30T22:16:29.840410+0000","last_became_active":"2023-09-30T22:16:29.838955+0000","last_became_peered":"2023-09-30T22:16:29.838955+0000","last_unstale":"2023-09-30T22:16:29.840410+0000","last_undegraded":"2023-09-30T22:16:29.840410+0000","last_fullsized":"2023-09-30T22:16:29.840410+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.823621+0000","last_change":"2023-09-30T22:16:29.451861+0000","last_active":"2023-09-30T22:16:29.823621+0000","last_peered":"2023-09-30T22:16:29.823621+0000","last_clean":"2023-09-30T22:16:29.823621+0000","last_became_active":"2023-09-30T22:16:29.451069+0000","last_became_peered":"2023-09-30T22:16:29.451069+0000","last_unstale":"2023-09-30T22:16:29.823621+0000","last_undegraded":"2023-09-30T22:16:29.823621+0000","last_fullsized":"2023-09-30T22:16:29.823621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.823858+0000","last_change":"2023-09-30T22:16:29.818789+0000","last_active":"2023-09-30T22:16:29.823858+0000","last_peered":"2023-09-30T22:16:29.823858+0000","last_clean":"2023-09-30T22:16:29.823858+0000","last_became_active":"2023-09-30T22:16:29.818283+0000","last_became_peered":"2023-09-30T22:16:29.818283+0000","last_unstale":"2023-09-30T22:16:29.823858+0000","last_undegraded":"2023-09-30T22:16:29.823858+0000","last_fullsized":"2023-09-30T22:16:29.823858+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.834215+0000","last_change":"2023-09-30T22:16:29.446443+0000","last_active":"2023-09-30T22:16:29.834215+0000","last_peered":"2023-09-30T22:16:29.834215+0000","last_clean":"2023-09-30T22:16:29.834215+0000","last_became_active":"2023-09-30T22:16:29.445833+0000","last_became_peered":"2023-09-30T22:16:29.445833+0000","last_unstale":"2023-09-30T22:16:29.834215+0000","last_undegraded":"2023-09-30T22:16:29.834215+0000","last_fullsized":"2023-09-30T22:16:29.834215+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.835697+0000","last_change":"2023-09-30T22:16:29.833040+0000","last_active":"2023-09-30T22:16:29.835697+0000","last_peered":"2023-09-30T22:16:29.835697+0000","last_clean":"2023-09-30T22:16:29.835697+0000","last_became_active":"2023-09-30T22:16:29.832651+0000","last_became_peered":"2023-09-30T22:16:29.832651+0000","last_unstale":"2023-09-30T22:16:29.835697+0000","last_undegraded":"2023-09-30T22:16:29.835697+0000","last_fullsized":"2023-09-30T22:16:29.835697+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.804809+0000","last_change":"2023-09-30T22:16:29.451667+0000","last_active":"2023-09-30T22:16:29.804809+0000","last_peered":"2023-09-30T22:16:29.804809+0000","last_clean":"2023-09-30T22:16:29.804809+0000","last_became_active":"2023-09-30T22:16:29.451422+0000","last_became_peered":"2023-09-30T22:16:29.451422+0000","last_unstale":"2023-09-30T22:16:29.804809+0000","last_undegraded":"2023-09-30T22:16:29.804809+0000","last_fullsized":"2023-09-30T22:16:29.804809+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.831417+0000","last_change":"2023-09-30T22:16:29.815304+0000","last_active":"2023-09-30T22:16:29.831417+0000","last_peered":"2023-09-30T22:16:29.831417+0000","last_clean":"2023-09-30T22:16:29.831417+0000","last_became_active":"2023-09-30T22:16:29.814885+0000","last_became_peered":"2023-09-30T22:16:29.814885+0000","last_unstale":"2023-09-30T22:16:29.831417+0000","last_undegraded":"2023-09-30T22:16:29.831417+0000","last_fullsized":"2023-09-30T22:16:29.831417+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.833324+0000","last_change":"2023-09-30T22:16:29.452814+0000","last_active":"2023-09-30T22:16:29.833324+0000","last_peered":"2023-09-30T22:16:29.833324+0000","last_clean":"2023-09-30T22:16:29.833324+0000","last_became_active":"2023-09-30T22:16:29.452404+0000","last_became_peered":"2023-09-30T22:16:29.452404+0000","last_unstale":"2023-09-30T22:16:29.833324+0000","last_undegraded":"2023-09-30T22:16:29.833324+0000","last_fullsized":"2023-09-30T22:16:29.833324+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828340+0000","last_change":"2023-09-30T22:16:29.825581+0000","last_active":"2023-09-30T22:16:29.828340+0000","last_peered":"2023-09-30T22:16:29.828340+0000","last_clean":"2023-09-30T22:16:29.828340+0000","last_became_active":"2023-09-30T22:16:29.822823+0000","last_became_peered":"2023-09-30T22:16:29.822823+0000","last_unstale":"2023-09-30T22:16:29.828340+0000","last_undegraded":"2023-09-30T22:16:29.828340+0000","last_fullsized":"2023-09-30T22:16:29.828340+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.808099+0000","last_change":"2023-09-30T22:16:29.447931+0000","last_active":"2023-09-30T22:16:29.808099+0000","last_peered":"2023-09-30T22:16:29.808099+0000","last_clean":"2023-09-30T22:16:29.808099+0000","last_became_active":"2023-09-30T22:16:29.447158+0000","last_became_peered":"2023-09-30T22:16:29.447158+0000","last_unstale":"2023-09-30T22:16:29.808099+0000","last_undegraded":"2023-09-30T22:16:29.808099+0000","last_fullsized":"2023-09-30T22:16:29.808099+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839723+0000","last_change":"2023-09-30T22:16:29.831438+0000","last_active":"2023-09-30T22:16:29.839723+0000","last_peered":"2023-09-30T22:16:29.839723+0000","last_clean":"2023-09-30T22:16:29.839723+0000","last_became_active":"2023-09-30T22:16:29.831158+0000","last_became_peered":"2023-09-30T22:16:29.831158+0000","last_unstale":"2023-09-30T22:16:29.839723+0000","last_undegraded":"2023-09-30T22:16:29.839723+0000","last_fullsized":"2023-09-30T22:16:29.839723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.810962+0000","last_change":"2023-09-30T22:16:29.449264+0000","last_active":"2023-09-30T22:16:29.810962+0000","last_peered":"2023-09-30T22:16:29.810962+0000","last_clean":"2023-09-30T22:16:29.810962+0000","last_became_active":"2023-09-30T22:16:29.448995+0000","last_became_peered":"2023-09-30T22:16:29.448995+0000","last_unstale":"2023-09-30T22:16:29.810962+0000","last_undegraded":"2023-09-30T22:16:29.810962+0000","last_fullsized":"2023-09-30T22:16:29.810962+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.835638+0000","last_change":"2023-09-30T22:16:29.832641+0000","last_active":"2023-09-30T22:16:29.835638+0000","last_peered":"2023-09-30T22:16:29.835638+0000","last_clean":"2023-09-30T22:16:29.835638+0000","last_became_active":"2023-09-30T22:16:29.832399+0000","last_became_peered":"2023-09-30T22:16:29.832399+0000","last_unstale":"2023-09-30T22:16:29.835638+0000","last_undegraded":"2023-09-30T22:16:29.835638+0000","last_fullsized":"2023-09-30T22:16:29.835638+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.813819+0000","last_change":"2023-09-30T22:16:29.451927+0000","last_active":"2023-09-30T22:16:29.813819+0000","last_peered":"2023-09-30T22:16:29.813819+0000","last_clean":"2023-09-30T22:16:29.813819+0000","last_became_active":"2023-09-30T22:16:29.449397+0000","last_became_peered":"2023-09-30T22:16:29.449397+0000","last_unstale":"2023-09-30T22:16:29.813819+0000","last_undegraded":"2023-09-30T22:16:29.813819+0000","last_fullsized":"2023-09-30T22:16:29.813819+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.838623+0000","last_change":"2023-09-30T22:16:29.829224+0000","last_active":"2023-09-30T22:16:29.838623+0000","last_peered":"2023-09-30T22:16:29.838623+0000","last_clean":"2023-09-30T22:16:29.838623+0000","last_became_active":"2023-09-30T22:16:29.828558+0000","last_became_peered":"2023-09-30T22:16:29.828558+0000","last_unstale":"2023-09-30T22:16:29.838623+0000","last_undegraded":"2023-09-30T22:16:29.838623+0000","last_fullsized":"2023-09-30T22:16:29.838623+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.801275+0000","last_change":"2023-09-30T22:16:25.780366+0000","last_active":"2023-09-30T22:16:29.801275+0000","last_peered":"2023-09-30T22:16:29.801275+0000","last_clean":"2023-09-30T22:16:29.801275+0000","last_became_active":"2023-09-30T22:16:25.780059+0000","last_became_peered":"2023-09-30T22:16:25.780059+0000","last_unstale":"2023-09-30T22:16:29.801275+0000","last_undegraded":"2023-09-30T22:16:29.801275+0000","last_fullsized":"2023-09-30T22:16:29.801275+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.799168+0000","last_change":"2023-09-30T22:16:29.448527+0000","last_active":"2023-09-30T22:16:29.799168+0000","last_peered":"2023-09-30T22:16:29.799168+0000","last_clean":"2023-09-30T22:16:29.799168+0000","last_became_active":"2023-09-30T22:16:29.448223+0000","last_became_peered":"2023-09-30T22:16:29.448223+0000","last_unstale":"2023-09-30T22:16:29.799168+0000","last_undegraded":"2023-09-30T22:16:29.799168+0000","last_fullsized":"2023-09-30T22:16:29.799168+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.829283+0000","last_change":"2023-09-30T22:16:29.827919+0000","last_active":"2023-09-30T22:16:29.829283+0000","last_peered":"2023-09-30T22:16:29.829283+0000","last_clean":"2023-09-30T22:16:29.829283+0000","last_became_active":"2023-09-30T22:16:29.827646+0000","last_became_peered":"2023-09-30T22:16:29.827646+0000","last_unstale":"2023-09-30T22:16:29.829283+0000","last_undegraded":"2023-09-30T22:16:29.829283+0000","last_fullsized":"2023-09-30T22:16:29.829283+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.808000+0000","last_change":"2023-09-30T22:16:25.414057+0000","last_active":"2023-09-30T22:16:29.808000+0000","last_peered":"2023-09-30T22:16:29.808000+0000","last_clean":"2023-09-30T22:16:29.808000+0000","last_became_active":"2023-09-30T22:16:25.413712+0000","last_became_peered":"2023-09-30T22:16:25.413712+0000","last_unstale":"2023-09-30T22:16:29.808000+0000","last_undegraded":"2023-09-30T22:16:29.808000+0000","last_fullsized":"2023-09-30T22:16:29.808000+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.804113+0000","last_change":"2023-09-30T22:16:29.446619+0000","last_active":"2023-09-30T22:16:29.804113+0000","last_peered":"2023-09-30T22:16:29.804113+0000","last_clean":"2023-09-30T22:16:29.804113+0000","last_became_active":"2023-09-30T22:16:29.446314+0000","last_became_peered":"2023-09-30T22:16:29.446314+0000","last_unstale":"2023-09-30T22:16:29.804113+0000","last_undegraded":"2023-09-30T22:16:29.804113+0000","last_fullsized":"2023-09-30T22:16:29.804113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839921+0000","last_change":"2023-09-30T22:16:29.835339+0000","last_active":"2023-09-30T22:16:29.839921+0000","last_peered":"2023-09-30T22:16:29.839921+0000","last_clean":"2023-09-30T22:16:29.839921+0000","last_became_active":"2023-09-30T22:16:29.833186+0000","last_became_peered":"2023-09-30T22:16:29.833186+0000","last_unstale":"2023-09-30T22:16:29.839921+0000","last_undegraded":"2023-09-30T22:16:29.839921+0000","last_fullsized":"2023-09-30T22:16:29.839921+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.798210+0000","last_change":"2023-09-30T22:16:25.416240+0000","last_active":"2023-09-30T22:16:29.798210+0000","last_peered":"2023-09-30T22:16:29.798210+0000","last_clean":"2023-09-30T22:16:29.798210+0000","last_became_active":"2023-09-30T22:16:25.415852+0000","last_became_peered":"2023-09-30T22:16:25.415852+0000","last_unstale":"2023-09-30T22:16:29.798210+0000","last_undegraded":"2023-09-30T22:16:29.798210+0000","last_fullsized":"2023-09-30T22:16:29.798210+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.798384+0000","last_change":"2023-09-30T22:16:29.449007+0000","last_active":"2023-09-30T22:16:29.798384+0000","last_peered":"2023-09-30T22:16:29.798384+0000","last_clean":"2023-09-30T22:16:29.798384+0000","last_became_active":"2023-09-30T22:16:29.448746+0000","last_became_peered":"2023-09-30T22:16:29.448746+0000","last_unstale":"2023-09-30T22:16:29.798384+0000","last_undegraded":"2023-09-30T22:16:29.798384+0000","last_fullsized":"2023-09-30T22:16:29.798384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.822579+0000","last_change":"2023-09-30T22:16:29.819140+0000","last_active":"2023-09-30T22:16:29.822579+0000","last_peered":"2023-09-30T22:16:29.822579+0000","last_clean":"2023-09-30T22:16:29.822579+0000","last_became_active":"2023-09-30T22:16:29.818875+0000","last_became_peered":"2023-09-30T22:16:29.818875+0000","last_unstale":"2023-09-30T22:16:29.822579+0000","last_undegraded":"2023-09-30T22:16:29.822579+0000","last_fullsized":"2023-09-30T22:16:29.822579+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.809554+0000","last_change":"2023-09-30T22:16:25.414050+0000","last_active":"2023-09-30T22:16:29.809554+0000","last_peered":"2023-09-30T22:16:29.809554+0000","last_clean":"2023-09-30T22:16:29.809554+0000","last_became_active":"2023-09-30T22:16:25.413709+0000","last_became_peered":"2023-09-30T22:16:25.413709+0000","last_unstale":"2023-09-30T22:16:29.809554+0000","last_undegraded":"2023-09-30T22:16:29.809554+0000","last_fullsized":"2023-09-30T22:16:29.809554+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.798287+0000","last_change":"2023-09-30T22:16:25.781137+0000","last_active":"2023-09-30T22:16:29.798287+0000","last_peered":"2023-09-30T22:16:29.798287+0000","last_clean":"2023-09-30T22:16:29.798287+0000","last_became_active":"2023-09-30T22:16:25.780923+0000","last_became_peered":"2023-09-30T22:16:25.780923+0000","last_unstale":"2023-09-30T22:16:29.798287+0000","last_undegraded":"2023-09-30T22:16:29.798287+0000","last_fullsized":"2023-09-30T22:16:29.798287+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.807854+0000","last_change":"2023-09-30T22:16:29.448514+0000","last_active":"2023-09-30T22:16:29.807854+0000","last_peered":"2023-09-30T22:16:29.807854+0000","last_clean":"2023-09-30T22:16:29.807854+0000","last_became_active":"2023-09-30T22:16:29.448270+0000","last_became_peered":"2023-09-30T22:16:29.448270+0000","last_unstale":"2023-09-30T22:16:29.807854+0000","last_undegraded":"2023-09-30T22:16:29.807854+0000","last_fullsized":"2023-09-30T22:16:29.807854+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839741+0000","last_change":"2023-09-30T22:16:29.831589+0000","last_active":"2023-09-30T22:16:29.839741+0000","last_peered":"2023-09-30T22:16:29.839741+0000","last_clean":"2023-09-30T22:16:29.839741+0000","last_became_active":"2023-09-30T22:16:29.831205+0000","last_became_peered":"2023-09-30T22:16:29.831205+0000","last_unstale":"2023-09-30T22:16:29.839741+0000","last_undegraded":"2023-09-30T22:16:29.839741+0000","last_fullsized":"2023-09-30T22:16:29.839741+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.814110+0000","last_change":"2023-09-30T22:16:25.416399+0000","last_active":"2023-09-30T22:16:29.814110+0000","last_peered":"2023-09-30T22:16:29.814110+0000","last_clean":"2023-09-30T22:16:29.814110+0000","last_became_active":"2023-09-30T22:16:25.416054+0000","last_became_peered":"2023-09-30T22:16:25.416054+0000","last_unstale":"2023-09-30T22:16:29.814110+0000","last_undegraded":"2023-09-30T22:16:29.814110+0000","last_fullsized":"2023-09-30T22:16:29.814110+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.803190+0000","last_change":"2023-09-30T22:16:29.450979+0000","last_active":"2023-09-30T22:16:29.803190+0000","last_peered":"2023-09-30T22:16:29.803190+0000","last_clean":"2023-09-30T22:16:29.803190+0000","last_became_active":"2023-09-30T22:16:29.450724+0000","last_became_peered":"2023-09-30T22:16:29.450724+0000","last_unstale":"2023-09-30T22:16:29.803190+0000","last_undegraded":"2023-09-30T22:16:29.803190+0000","last_fullsized":"2023-09-30T22:16:29.803190+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828390+0000","last_change":"2023-09-30T22:16:29.827233+0000","last_active":"2023-09-30T22:16:29.828390+0000","last_peered":"2023-09-30T22:16:29.828390+0000","last_clean":"2023-09-30T22:16:29.828390+0000","last_became_active":"2023-09-30T22:16:29.822966+0000","last_became_peered":"2023-09-30T22:16:29.822966+0000","last_unstale":"2023-09-30T22:16:29.828390+0000","last_undegraded":"2023-09-30T22:16:29.828390+0000","last_fullsized":"2023-09-30T22:16:29.828390+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.813696+0000","last_change":"2023-09-30T22:16:25.780298+0000","last_active":"2023-09-30T22:16:29.813696+0000","last_peered":"2023-09-30T22:16:29.813696+0000","last_clean":"2023-09-30T22:16:29.813696+0000","last_became_active":"2023-09-30T22:16:25.780022+0000","last_became_peered":"2023-09-30T22:16:25.780022+0000","last_unstale":"2023-09-30T22:16:29.813696+0000","last_undegraded":"2023-09-30T22:16:29.813696+0000","last_fullsized":"2023-09-30T22:16:29.813696+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.801091+0000","last_change":"2023-09-30T22:16:29.448428+0000","last_active":"2023-09-30T22:16:29.801091+0000","last_peered":"2023-09-30T22:16:29.801091+0000","last_clean":"2023-09-30T22:16:29.801091+0000","last_became_active":"2023-09-30T22:16:29.447613+0000","last_became_peered":"2023-09-30T22:16:29.447613+0000","last_unstale":"2023-09-30T22:16:29.801091+0000","last_undegraded":"2023-09-30T22:16:29.801091+0000","last_fullsized":"2023-09-30T22:16:29.801091+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.831435+0000","last_change":"2023-09-30T22:16:29.815447+0000","last_active":"2023-09-30T22:16:29.831435+0000","last_peered":"2023-09-30T22:16:29.831435+0000","last_clean":"2023-09-30T22:16:29.831435+0000","last_became_active":"2023-09-30T22:16:29.815169+0000","last_became_peered":"2023-09-30T22:16:29.815169+0000","last_unstale":"2023-09-30T22:16:29.831435+0000","last_undegraded":"2023-09-30T22:16:29.831435+0000","last_fullsized":"2023-09-30T22:16:29.831435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.837122+0000","last_change":"2023-09-30T22:16:29.448448+0000","last_active":"2023-09-30T22:16:29.837122+0000","last_peered":"2023-09-30T22:16:29.837122+0000","last_clean":"2023-09-30T22:16:29.837122+0000","last_became_active":"2023-09-30T22:16:29.448177+0000","last_became_peered":"2023-09-30T22:16:29.448177+0000","last_unstale":"2023-09-30T22:16:29.837122+0000","last_undegraded":"2023-09-30T22:16:29.837122+0000","last_fullsized":"2023-09-30T22:16:29.837122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.801487+0000","last_change":"2023-09-30T22:16:25.781178+0000","last_active":"2023-09-30T22:16:29.801487+0000","last_peered":"2023-09-30T22:16:29.801487+0000","last_clean":"2023-09-30T22:16:29.801487+0000","last_became_active":"2023-09-30T22:16:25.780121+0000","last_became_peered":"2023-09-30T22:16:25.780121+0000","last_unstale":"2023-09-30T22:16:29.801487+0000","last_undegraded":"2023-09-30T22:16:29.801487+0000","last_fullsized":"2023-09-30T22:16:29.801487+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839571+0000","last_change":"2023-09-30T22:16:29.830888+0000","last_active":"2023-09-30T22:16:29.839571+0000","last_peered":"2023-09-30T22:16:29.839571+0000","last_clean":"2023-09-30T22:16:29.839571+0000","last_became_active":"2023-09-30T22:16:29.830569+0000","last_became_peered":"2023-09-30T22:16:29.830569+0000","last_unstale":"2023-09-30T22:16:29.839571+0000","last_undegraded":"2023-09-30T22:16:29.839571+0000","last_fullsized":"2023-09-30T22:16:29.839571+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.809542+0000","last_change":"2023-09-30T22:16:25.780328+0000","last_active":"2023-09-30T22:16:29.809542+0000","last_peered":"2023-09-30T22:16:29.809542+0000","last_clean":"2023-09-30T22:16:29.809542+0000","last_became_active":"2023-09-30T22:16:25.780026+0000","last_became_peered":"2023-09-30T22:16:25.780026+0000","last_unstale":"2023-09-30T22:16:29.809542+0000","last_undegraded":"2023-09-30T22:16:29.809542+0000","last_fullsized":"2023-09-30T22:16:29.809542+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:16:31.453480+0000","last_change":"2023-09-30T22:16:29.444398+0000","last_active":"2023-09-30T22:16:31.453480+0000","last_peered":"2023-09-30T22:16:31.453480+0000","last_clean":"2023-09-30T22:16:31.453480+0000","last_became_active":"2023-09-30T22:16:29.444126+0000","last_became_peered":"2023-09-30T22:16:29.444126+0000","last_unstale":"2023-09-30T22:16:31.453480+0000","last_undegraded":"2023-09-30T22:16:31.453480+0000","last_fullsized":"2023-09-30T22:16:31.453480+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828900+0000","last_change":"2023-09-30T22:16:29.820636+0000","last_active":"2023-09-30T22:16:29.828900+0000","last_peered":"2023-09-30T22:16:29.828900+0000","last_clean":"2023-09-30T22:16:29.828900+0000","last_became_active":"2023-09-30T22:16:29.820372+0000","last_became_peered":"2023-09-30T22:16:29.820372+0000","last_unstale":"2023-09-30T22:16:29.828900+0000","last_undegraded":"2023-09-30T22:16:29.828900+0000","last_fullsized":"2023-09-30T22:16:29.828900+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.831903+0000","last_change":"2023-09-30T22:16:29.452715+0000","last_active":"2023-09-30T22:16:29.831903+0000","last_peered":"2023-09-30T22:16:29.831903+0000","last_clean":"2023-09-30T22:16:29.831903+0000","last_became_active":"2023-09-30T22:16:29.452405+0000","last_became_peered":"2023-09-30T22:16:29.452405+0000","last_unstale":"2023-09-30T22:16:29.831903+0000","last_undegraded":"2023-09-30T22:16:29.831903+0000","last_fullsized":"2023-09-30T22:16:29.831903+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.829507+0000","last_change":"2023-09-30T22:16:29.827280+0000","last_active":"2023-09-30T22:16:29.829507+0000","last_peered":"2023-09-30T22:16:29.829507+0000","last_clean":"2023-09-30T22:16:29.829507+0000","last_became_active":"2023-09-30T22:16:29.827006+0000","last_became_peered":"2023-09-30T22:16:29.827006+0000","last_unstale":"2023-09-30T22:16:29.829507+0000","last_undegraded":"2023-09-30T22:16:29.829507+0000","last_fullsized":"2023-09-30T22:16:29.829507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828875+0000","last_change":"2023-09-30T22:16:29.441940+0000","last_active":"2023-09-30T22:16:29.828875+0000","last_peered":"2023-09-30T22:16:29.828875+0000","last_clean":"2023-09-30T22:16:29.828875+0000","last_became_active":"2023-09-30T22:16:29.441296+0000","last_became_peered":"2023-09-30T22:16:29.441296+0000","last_unstale":"2023-09-30T22:16:29.828875+0000","last_undegraded":"2023-09-30T22:16:29.828875+0000","last_fullsized":"2023-09-30T22:16:29.828875+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.828802+0000","last_change":"2023-09-30T22:16:29.824467+0000","last_active":"2023-09-30T22:16:29.828802+0000","last_peered":"2023-09-30T22:16:29.828802+0000","last_clean":"2023-09-30T22:16:29.828802+0000","last_became_active":"2023-09-30T22:16:29.824206+0000","last_became_peered":"2023-09-30T22:16:29.824206+0000","last_unstale":"2023-09-30T22:16:29.828802+0000","last_undegraded":"2023-09-30T22:16:29.828802+0000","last_fullsized":"2023-09-30T22:16:29.828802+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.832904+0000","last_change":"2023-09-30T22:16:29.446705+0000","last_active":"2023-09-30T22:16:29.832904+0000","last_peered":"2023-09-30T22:16:29.832904+0000","last_clean":"2023-09-30T22:16:29.832904+0000","last_became_active":"2023-09-30T22:16:29.446173+0000","last_became_peered":"2023-09-30T22:16:29.446173+0000","last_unstale":"2023-09-30T22:16:29.832904+0000","last_undegraded":"2023-09-30T22:16:29.832904+0000","last_fullsized":"2023-09-30T22:16:29.832904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.835674+0000","last_change":"2023-09-30T22:16:29.832880+0000","last_active":"2023-09-30T22:16:29.835674+0000","last_peered":"2023-09-30T22:16:29.835674+0000","last_clean":"2023-09-30T22:16:29.835674+0000","last_became_active":"2023-09-30T22:16:29.832321+0000","last_became_peered":"2023-09-30T22:16:29.832321+0000","last_unstale":"2023-09-30T22:16:29.835674+0000","last_undegraded":"2023-09-30T22:16:29.835674+0000","last_fullsized":"2023-09-30T22:16:29.835674+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.824980+0000","last_change":"2023-09-30T22:16:29.451645+0000","last_active":"2023-09-30T22:16:29.824980+0000","last_peered":"2023-09-30T22:16:29.824980+0000","last_clean":"2023-09-30T22:16:29.824980+0000","last_became_active":"2023-09-30T22:16:29.451283+0000","last_became_peered":"2023-09-30T22:16:29.451283+0000","last_unstale":"2023-09-30T22:16:29.824980+0000","last_undegraded":"2023-09-30T22:16:29.824980+0000","last_fullsized":"2023-09-30T22:16:29.824980+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.834482+0000","last_change":"2023-09-30T22:16:29.825999+0000","last_active":"2023-09-30T22:16:29.834482+0000","last_peered":"2023-09-30T22:16:29.834482+0000","last_clean":"2023-09-30T22:16:29.834482+0000","last_became_active":"2023-09-30T22:16:29.825211+0000","last_became_peered":"2023-09-30T22:16:29.825211+0000","last_unstale":"2023-09-30T22:16:29.834482+0000","last_undegraded":"2023-09-30T22:16:29.834482+0000","last_fullsized":"2023-09-30T22:16:29.834482+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.825934+0000","last_change":"2023-09-30T22:16:29.443167+0000","last_active":"2023-09-30T22:16:29.825934+0000","last_peered":"2023-09-30T22:16:29.825934+0000","last_clean":"2023-09-30T22:16:29.825934+0000","last_became_active":"2023-09-30T22:16:29.442895+0000","last_became_peered":"2023-09-30T22:16:29.442895+0000","last_unstale":"2023-09-30T22:16:29.825934+0000","last_undegraded":"2023-09-30T22:16:29.825934+0000","last_fullsized":"2023-09-30T22:16:29.825934+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.829174+0000","last_change":"2023-09-30T22:16:29.827232+0000","last_active":"2023-09-30T22:16:29.829174+0000","last_peered":"2023-09-30T22:16:29.829174+0000","last_clean":"2023-09-30T22:16:29.829174+0000","last_became_active":"2023-09-30T22:16:29.826971+0000","last_became_peered":"2023-09-30T22:16:29.826971+0000","last_unstale":"2023-09-30T22:16:29.829174+0000","last_undegraded":"2023-09-30T22:16:29.829174+0000","last_fullsized":"2023-09-30T22:16:29.829174+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839680+0000","last_change":"2023-09-30T22:16:29.833273+0000","last_active":"2023-09-30T22:16:29.839680+0000","last_peered":"2023-09-30T22:16:29.839680+0000","last_clean":"2023-09-30T22:16:29.839680+0000","last_became_active":"2023-09-30T22:16:29.832627+0000","last_became_peered":"2023-09-30T22:16:29.832627+0000","last_unstale":"2023-09-30T22:16:29.839680+0000","last_undegraded":"2023-09-30T22:16:29.839680+0000","last_fullsized":"2023-09-30T22:16:29.839680+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.840122+0000","last_change":"2023-09-30T22:16:29.834527+0000","last_active":"2023-09-30T22:16:29.840122+0000","last_peered":"2023-09-30T22:16:29.840122+0000","last_clean":"2023-09-30T22:16:29.840122+0000","last_became_active":"2023-09-30T22:16:29.830063+0000","last_became_peered":"2023-09-30T22:16:29.830063+0000","last_unstale":"2023-09-30T22:16:29.840122+0000","last_undegraded":"2023-09-30T22:16:29.840122+0000","last_fullsized":"2023-09-30T22:16:29.840122+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.826932+0000","last_change":"2023-09-30T22:16:29.821730+0000","last_active":"2023-09-30T22:16:29.826932+0000","last_peered":"2023-09-30T22:16:29.826932+0000","last_clean":"2023-09-30T22:16:29.826932+0000","last_became_active":"2023-09-30T22:16:29.821455+0000","last_became_peered":"2023-09-30T22:16:29.821455+0000","last_unstale":"2023-09-30T22:16:29.826932+0000","last_undegraded":"2023-09-30T22:16:29.826932+0000","last_fullsized":"2023-09-30T22:16:29.826932+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839638+0000","last_change":"2023-09-30T22:16:29.830760+0000","last_active":"2023-09-30T22:16:29.839638+0000","last_peered":"2023-09-30T22:16:29.839638+0000","last_clean":"2023-09-30T22:16:29.839638+0000","last_became_active":"2023-09-30T22:16:29.830307+0000","last_became_peered":"2023-09-30T22:16:29.830307+0000","last_unstale":"2023-09-30T22:16:29.839638+0000","last_undegraded":"2023-09-30T22:16:29.839638+0000","last_fullsized":"2023-09-30T22:16:29.839638+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:16:29.839900+0000","last_change":"2023-09-30T22:16:29.835169+0000","last_active":"2023-09-30T22:16:29.839900+0000","last_peered":"2023-09-30T22:16:29.839900+0000","last_clean":"2023-09-30T22:16:29.839900+0000","last_became_active":"2023-09-30T22:16:29.832849+0000","last_became_peered":"2023-09-30T22:16:29.832849+0000","last_unstale":"2023-09-30T22:16:29.839900+0000","last_undegraded":"2023-09-30T22:16:29.839900+0000","last_fullsized":"2023-09-30T22:16:29.839900+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":46244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":46050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":44044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":45160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:16:42.657 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-30T22:16:42.657 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-30T22:16:42.657 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-09-30T22:16:42.658 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T22:16:42.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.804+0000 7fb2ca29a700 1 Processor -- start 2023-09-30T22:16:42.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.804+0000 7fb2ca29a700 1 -- start start 2023-09-30T22:16:42.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.804+0000 7fb2ca29a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb2c4092390 0x7fb2c4097aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:42.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.804+0000 7fb2ca29a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2c4123a90 0x7fb2c4123f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:42.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.804+0000 7fb2ca29a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2c4126fe0 0x7fb2c4127490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:42.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.804+0000 7fb2ca29a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c4092770 con 0x7fb2c4092390 2023-09-30T22:16:42.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.804+0000 7fb2ca29a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c4069550 con 0x7fb2c4123a90 2023-09-30T22:16:42.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.804+0000 7fb2ca29a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c4068c10 con 0x7fb2c4126fe0 2023-09-30T22:16:42.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.804+0000 7fb2c3fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb2c4092390 0x7fb2c4097aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:42.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.804+0000 7fb2c37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2c4123a90 0x7fb2c4123f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:42.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.804+0000 7fb2c8837700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2c4126fe0 0x7fb2c4127490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:42.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.804+0000 7fb2c3fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb2c4092390 0x7fb2c4097aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:35600/0 (socket says 172.21.15.156:35600) 2023-09-30T22:16:42.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.804+0000 7fb2c37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2c4123a90 0x7fb2c4123f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54424/0 (socket says 172.21.15.156:54424) 2023-09-30T22:16:42.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.804+0000 7fb2c3fff700 1 -- 172.21.15.156:0/855838301 learned_addr learned my addr 172.21.15.156:0/855838301 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:42.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.805+0000 7fb2c8837700 1 -- 172.21.15.156:0/855838301 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2c4123a90 msgr2=0x7fb2c4123f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:42.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.805+0000 7fb2c8837700 1 --2- 172.21.15.156:0/855838301 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2c4123a90 0x7fb2c4123f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:42.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.805+0000 7fb2c8837700 1 -- 172.21.15.156:0/855838301 >> v2:172.21.15.156:3300/0 conn(0x7fb2c4092390 msgr2=0x7fb2c4097aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:42.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.805+0000 7fb2c8837700 1 --2- 172.21.15.156:0/855838301 >> v2:172.21.15.156:3300/0 conn(0x7fb2c4092390 0x7fb2c4097aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:42.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.805+0000 7fb2c8837700 1 -- 172.21.15.156:0/855838301 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c4124550 con 0x7fb2c4126fe0 2023-09-30T22:16:42.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.805+0000 7fb2c37fe700 1 --2- 172.21.15.156:0/855838301 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2c4123a90 0x7fb2c4123f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:42.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.805+0000 7fb2c3fff700 1 --2- 172.21.15.156:0/855838301 >> v2:172.21.15.156:3300/0 conn(0x7fb2c4092390 0x7fb2c4097aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:42.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.805+0000 7fb2c8837700 1 --2- 172.21.15.156:0/855838301 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2c4126fe0 0x7fb2c4127490 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fb2bc009e60 tx=0x7fb2bc009780).ready entity=mon.2 client_cookie=84b75eb3b2798e10 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:42.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.805+0000 7fb2c2ffd700 1 -- 172.21.15.156:0/855838301 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc00e070 con 0x7fb2c4126fe0 2023-09-30T22:16:42.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.805+0000 7fb2c2ffd700 1 -- 172.21.15.156:0/855838301 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2bc00bab0 con 0x7fb2c4126fe0 2023-09-30T22:16:42.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.805+0000 7fb2c2ffd700 1 -- 172.21.15.156:0/855838301 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc00be30 con 0x7fb2c4126fe0 2023-09-30T22:16:42.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.805+0000 7fb2ca29a700 1 -- 172.21.15.156:0/855838301 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2c4126fe0 msgr2=0x7fb2c4127490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:42.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.805+0000 7fb2ca29a700 1 --2- 172.21.15.156:0/855838301 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2c4126fe0 0x7fb2c4127490 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fb2bc009e60 tx=0x7fb2bc009780).stop 2023-09-30T22:16:42.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.805+0000 7fb2ca29a700 1 -- 172.21.15.156:0/855838301 shutdown_connections 2023-09-30T22:16:42.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.805+0000 7fb2ca29a700 1 --2- 172.21.15.156:0/855838301 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2c4126fe0 0x7fb2c4127490 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:42.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.805+0000 7fb2ca29a700 1 --2- 172.21.15.156:0/855838301 >> v2:172.21.15.156:3300/0 conn(0x7fb2c4092390 0x7fb2c4097aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:42.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.805+0000 7fb2ca29a700 1 --2- 172.21.15.156:0/855838301 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2c4123a90 0x7fb2c4123f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:42.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.805+0000 7fb2ca29a700 1 -- 172.21.15.156:0/855838301 >> 172.21.15.156:0/855838301 conn(0x7fb2c409a230 msgr2=0x7fb2c409a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:42.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.805+0000 7fb2ca29a700 1 -- 172.21.15.156:0/855838301 shutdown_connections 2023-09-30T22:16:42.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.806+0000 7fb2ca29a700 1 -- 172.21.15.156:0/855838301 wait complete. 2023-09-30T22:16:42.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.806+0000 7fb2ca29a700 1 Processor -- start 2023-09-30T22:16:42.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.807+0000 7fb2ca29a700 1 -- start start 2023-09-30T22:16:42.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.807+0000 7fb2ca29a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2c4092390 0x7fb2c412c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:42.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.807+0000 7fb2ca29a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2c4123a90 0x7fb2c412c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:42.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.807+0000 7fb2ca29a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2c4126fe0 0x7fb2c412cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:42.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.807+0000 7fb2ca29a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c4110c60 con 0x7fb2c4092390 2023-09-30T22:16:42.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.807+0000 7fb2ca29a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c4069780 con 0x7fb2c4126fe0 2023-09-30T22:16:42.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.807+0000 7fb2ca29a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c4097400 con 0x7fb2c4123a90 2023-09-30T22:16:42.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.807+0000 7fb2c37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2c4123a90 0x7fb2c412c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:42.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.807+0000 7fb2c37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2c4123a90 0x7fb2c412c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39946/0 (socket says 172.21.15.156:39946) 2023-09-30T22:16:42.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.807+0000 7fb2c8837700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2c4126fe0 0x7fb2c412cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:42.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.807+0000 7fb2c37fe700 1 -- 172.21.15.156:0/3644264367 learned_addr learned my addr 172.21.15.156:0/3644264367 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:42.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.807+0000 7fb2c3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2c4092390 0x7fb2c412c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:42.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.807+0000 7fb2c37fe700 1 -- 172.21.15.156:0/3644264367 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2c4126fe0 msgr2=0x7fb2c412cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:42.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.807+0000 7fb2c37fe700 1 --2- 172.21.15.156:0/3644264367 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2c4126fe0 0x7fb2c412cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:42.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.807+0000 7fb2c37fe700 1 -- 172.21.15.156:0/3644264367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2c4092390 msgr2=0x7fb2c412c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:42.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.807+0000 7fb2c37fe700 1 --2- 172.21.15.156:0/3644264367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2c4092390 0x7fb2c412c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:42.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.807+0000 7fb2c37fe700 1 -- 172.21.15.156:0/3644264367 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b8009370 con 0x7fb2c4123a90 2023-09-30T22:16:42.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.807+0000 7fb2c3fff700 1 --2- 172.21.15.156:0/3644264367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2c4092390 0x7fb2c412c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:42.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.808+0000 7fb2c37fe700 1 --2- 172.21.15.156:0/3644264367 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2c4123a90 0x7fb2c412c9b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fb2b400e9d0 tx=0x7fb2b4009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:42.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.808+0000 7fb2abfff700 1 -- 172.21.15.156:0/3644264367 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4009600 con 0x7fb2c4123a90 2023-09-30T22:16:42.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.808+0000 7fb2abfff700 1 -- 172.21.15.156:0/3644264367 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b400c6a0 con 0x7fb2c4123a90 2023-09-30T22:16:42.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.808+0000 7fb2ca29a700 1 -- 172.21.15.156:0/3644264367 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b40092a0 con 0x7fb2c4123a90 2023-09-30T22:16:42.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.808+0000 7fb2abfff700 1 -- 172.21.15.156:0/3644264367 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b400ca20 con 0x7fb2c4123a90 2023-09-30T22:16:42.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.808+0000 7fb2ca29a700 1 -- 172.21.15.156:0/3644264367 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2bc009a20 con 0x7fb2c4123a90 2023-09-30T22:16:42.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.808+0000 7fb2abfff700 1 -- 172.21.15.156:0/3644264367 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb2b400cd90 con 0x7fb2c4123a90 2023-09-30T22:16:42.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.808+0000 7fb2abfff700 1 -- 172.21.15.156:0/3644264367 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb2b403b430 con 0x7fb2c4123a90 2023-09-30T22:16:42.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.809+0000 7fb2ca29a700 1 -- 172.21.15.156:0/3644264367 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2c412e4a0 con 0x7fb2c4123a90 2023-09-30T22:16:42.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:42.813+0000 7fb2abfff700 1 -- 172.21.15.156:0/3644264367 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb2b4016070 con 0x7fb2c4123a90 2023-09-30T22:16:43.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.006+0000 7fb2ca29a700 1 -- 172.21.15.156:0/3644264367 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb2c405a260 con 0x7fb2c4123a90 2023-09-30T22:16:43.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.006+0000 7fb2abfff700 1 -- 172.21.15.156:0/3644264367 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fb2b4029080 con 0x7fb2c4123a90 2023-09-30T22:16:43.007 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:43.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.008+0000 7fb2ca29a700 1 -- 172.21.15.156:0/3644264367 >> v1:172.21.15.156:6816/118236 conn(0x7fb2b002bb60 legacy=0x7fb2b002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:43.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.008+0000 7fb2ca29a700 1 -- 172.21.15.156:0/3644264367 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2c4123a90 msgr2=0x7fb2c412c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:43.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.008+0000 7fb2ca29a700 1 --2- 172.21.15.156:0/3644264367 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2c4123a90 0x7fb2c412c9b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fb2b400e9d0 tx=0x7fb2b4009060).stop 2023-09-30T22:16:43.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.008+0000 7fb2ca29a700 1 -- 172.21.15.156:0/3644264367 shutdown_connections 2023-09-30T22:16:43.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.008+0000 7fb2ca29a700 1 --2- 172.21.15.156:0/3644264367 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2c4126fe0 0x7fb2c412cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:43.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.008+0000 7fb2ca29a700 1 --2- 172.21.15.156:0/3644264367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2c4092390 0x7fb2c412c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:43.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.008+0000 7fb2ca29a700 1 --2- 172.21.15.156:0/3644264367 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2c4123a90 0x7fb2c412c9b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:43.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.008+0000 7fb2ca29a700 1 -- 172.21.15.156:0/3644264367 >> 172.21.15.156:0/3644264367 conn(0x7fb2c409a230 msgr2=0x7fb2c4099990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:43.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.008+0000 7fb2ca29a700 1 -- 172.21.15.156:0/3644264367 shutdown_connections 2023-09-30T22:16:43.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.008+0000 7fb2ca29a700 1 -- 172.21.15.156:0/3644264367 wait complete. 2023-09-30T22:16:43.020 INFO:teuthology.orchestra.run.smithi156.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-09-30T22:16:43.020 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-09-30T22:16:43.021 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:16:43.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.136+0000 7ff6f19a5700 1 Processor -- start 2023-09-30T22:16:43.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.136+0000 7ff6f19a5700 1 -- start start 2023-09-30T22:16:43.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.137+0000 7ff6f19a5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6ec0990d0 0x7ff6ec1304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:43.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.137+0000 7ff6f19a5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff6ec130990 0x7ff6ec132d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:43.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.137+0000 7ff6f19a5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6ec095650 con 0x7ff6ec0985e0 2023-09-30T22:16:43.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.137+0000 7ff6f19a5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6ec0994b0 con 0x7ff6ec130990 2023-09-30T22:16:43.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.137+0000 7ff6f19a5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec09a3f0 con 0x7ff6ec0990d0 2023-09-30T22:16:43.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.137+0000 7ff6ea7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6ec0990d0 0x7ff6ec1304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:43.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.137+0000 7ff6eb7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff6ec130990 0x7ff6ec132d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:43.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.137+0000 7ff6eb7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff6ec130990 0x7ff6ec132d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:35628/0 (socket says 172.21.15.156:35628) 2023-09-30T22:16:43.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.137+0000 7ff6ea7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6ec0990d0 0x7ff6ec1304a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54440/0 (socket says 172.21.15.156:54440) 2023-09-30T22:16:43.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.137+0000 7ff6eb7fe700 1 -- 172.21.15.156:0/4031459156 learned_addr learned my addr 172.21.15.156:0/4031459156 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:43.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.137+0000 7ff6eaffd700 1 --1- 172.21.15.156:0/4031459156 >> v1:172.21.15.156:6789/0 conn(0x7ff6ec0985e0 0x7ff6ec0989c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47324/0 (socket says 172.21.15.156:47324) 2023-09-30T22:16:43.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.137+0000 7ff6ea7fc700 1 -- 172.21.15.156:0/4031459156 >> v2:172.21.15.156:3300/0 conn(0x7ff6ec130990 msgr2=0x7ff6ec132d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:43.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.137+0000 7ff6ea7fc700 1 --2- 172.21.15.156:0/4031459156 >> v2:172.21.15.156:3300/0 conn(0x7ff6ec130990 0x7ff6ec132d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:43.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.137+0000 7ff6ea7fc700 1 -- 172.21.15.156:0/4031459156 >> v1:172.21.15.156:6789/0 conn(0x7ff6ec0985e0 legacy=0x7ff6ec0989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:43.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.137+0000 7ff6e9ffb700 1 -- 172.21.15.156:0/4031459156 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989449710 0 0) 0x7ff6ec095650 con 0x7ff6ec0985e0 2023-09-30T22:16:43.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.137+0000 7ff6ea7fc700 1 -- 172.21.15.156:0/4031459156 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ec095100 con 0x7ff6ec0990d0 2023-09-30T22:16:43.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.137+0000 7ff6eb7fe700 1 --2- 172.21.15.156:0/4031459156 >> v2:172.21.15.156:3300/0 conn(0x7ff6ec130990 0x7ff6ec132d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:43.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.137+0000 7ff6ea7fc700 1 --2- 172.21.15.156:0/4031459156 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6ec0990d0 0x7ff6ec1304a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff6e0009760 tx=0x7ff6e0009060).ready entity=mon.1 client_cookie=7ddf6a3035ed4ce1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:43.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.138+0000 7ff6e9ffb700 1 -- 172.21.15.156:0/4031459156 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e000f510 con 0x7ff6ec0990d0 2023-09-30T22:16:43.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.138+0000 7ff6e9ffb700 1 -- 172.21.15.156:0/4031459156 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e000f670 con 0x7ff6ec0990d0 2023-09-30T22:16:43.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.138+0000 7ff6e9ffb700 1 -- 172.21.15.156:0/4031459156 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e000f9f0 con 0x7ff6ec0990d0 2023-09-30T22:16:43.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.138+0000 7ff6f19a5700 1 -- 172.21.15.156:0/4031459156 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6ec0990d0 msgr2=0x7ff6ec1304a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:43.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.138+0000 7ff6f19a5700 1 --2- 172.21.15.156:0/4031459156 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6ec0990d0 0x7ff6ec1304a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff6e0009760 tx=0x7ff6e0009060).stop 2023-09-30T22:16:43.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.138+0000 7ff6f19a5700 1 -- 172.21.15.156:0/4031459156 shutdown_connections 2023-09-30T22:16:43.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.138+0000 7ff6f19a5700 1 --2- 172.21.15.156:0/4031459156 >> v2:172.21.15.156:3300/0 conn(0x7ff6ec130990 0x7ff6ec132d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:43.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.138+0000 7ff6f19a5700 1 --2- 172.21.15.156:0/4031459156 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6ec0990d0 0x7ff6ec1304a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:43.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.138+0000 7ff6f19a5700 1 -- 172.21.15.156:0/4031459156 >> 172.21.15.156:0/4031459156 conn(0x7ff6ec09dc40 msgr2=0x7ff6ec09e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:43.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.138+0000 7ff6f19a5700 1 -- 172.21.15.156:0/4031459156 shutdown_connections 2023-09-30T22:16:43.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.138+0000 7ff6f19a5700 1 -- 172.21.15.156:0/4031459156 wait complete. 2023-09-30T22:16:43.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.139+0000 7ff6f19a5700 1 Processor -- start 2023-09-30T22:16:43.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.139+0000 7ff6f19a5700 1 -- start start 2023-09-30T22:16:43.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.140+0000 7ff6f19a5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6ec0985e0 0x7ff6ec11e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:43.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.140+0000 7ff6f19a5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6ec0990d0 0x7ff6ec11a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:43.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.140+0000 7ff6f19a5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff6ec130990 0x7ff6ec11aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:43.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.140+0000 7ff6f19a5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec11daf0 con 0x7ff6ec0990d0 2023-09-30T22:16:43.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.140+0000 7ff6f19a5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec09ccd0 con 0x7ff6ec0985e0 2023-09-30T22:16:43.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.140+0000 7ff6f19a5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec09a0f0 con 0x7ff6ec130990 2023-09-30T22:16:43.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.140+0000 7ff6eaffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6ec0985e0 0x7ff6ec11e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:43.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.140+0000 7ff6ea7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6ec0990d0 0x7ff6ec11a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:43.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.140+0000 7ff6eaffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6ec0985e0 0x7ff6ec11e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54444/0 (socket says 172.21.15.156:54444) 2023-09-30T22:16:43.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.140+0000 7ff6ea7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6ec0990d0 0x7ff6ec11a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:35638/0 (socket says 172.21.15.156:35638) 2023-09-30T22:16:43.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.140+0000 7ff6eaffd700 1 -- 172.21.15.156:0/469613356 learned_addr learned my addr 172.21.15.156:0/469613356 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:43.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.140+0000 7ff6eb7fe700 1 --2- 172.21.15.156:0/469613356 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff6ec130990 0x7ff6ec11aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:43.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.140+0000 7ff6eaffd700 1 -- 172.21.15.156:0/469613356 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff6ec130990 msgr2=0x7ff6ec11aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:43.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.140+0000 7ff6eaffd700 1 --2- 172.21.15.156:0/469613356 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff6ec130990 0x7ff6ec11aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:43.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.140+0000 7ff6eaffd700 1 -- 172.21.15.156:0/469613356 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6ec0990d0 msgr2=0x7ff6ec11a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:43.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.140+0000 7ff6eaffd700 1 --2- 172.21.15.156:0/469613356 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6ec0990d0 0x7ff6ec11a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:43.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.141+0000 7ff6eaffd700 1 -- 172.21.15.156:0/469613356 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e4009ae0 con 0x7ff6ec0985e0 2023-09-30T22:16:43.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.141+0000 7ff6ea7fc700 1 --2- 172.21.15.156:0/469613356 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6ec0990d0 0x7ff6ec11a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:43.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.141+0000 7ff6eaffd700 1 --2- 172.21.15.156:0/469613356 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6ec0985e0 0x7ff6ec11e590 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7ff6dc00c4c0 tx=0x7ff6dc007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:43.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.141+0000 7ff6d2ffd700 1 -- 172.21.15.156:0/469613356 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc00ce30 con 0x7ff6ec0985e0 2023-09-30T22:16:43.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.141+0000 7ff6d2ffd700 1 -- 172.21.15.156:0/469613356 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6dc0072e0 con 0x7ff6ec0985e0 2023-09-30T22:16:43.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.141+0000 7ff6f19a5700 1 -- 172.21.15.156:0/469613356 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e00092a0 con 0x7ff6ec0985e0 2023-09-30T22:16:43.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.141+0000 7ff6d2ffd700 1 -- 172.21.15.156:0/469613356 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc0056e0 con 0x7ff6ec0985e0 2023-09-30T22:16:43.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.141+0000 7ff6f19a5700 1 -- 172.21.15.156:0/469613356 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6ec11c200 con 0x7ff6ec0985e0 2023-09-30T22:16:43.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.142+0000 7ff6f19a5700 1 -- 172.21.15.156:0/469613356 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6ec11dfc0 con 0x7ff6ec0985e0 2023-09-30T22:16:43.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.142+0000 7ff6d2ffd700 1 -- 172.21.15.156:0/469613356 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7ff6dc005a90 con 0x7ff6ec0985e0 2023-09-30T22:16:43.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.142+0000 7ff6d2ffd700 1 -- 172.21.15.156:0/469613356 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7ff6dc03a640 con 0x7ff6ec0985e0 2023-09-30T22:16:43.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.146+0000 7ff6d2ffd700 1 -- 172.21.15.156:0/469613356 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7ff6dc01c350 con 0x7ff6ec0985e0 2023-09-30T22:16:43.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.304+0000 7ff6f19a5700 1 -- 172.21.15.156:0/469613356 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6ec05a260 con 0x7ff6ec0985e0 2023-09-30T22:16:43.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.305+0000 7ff6d2ffd700 1 -- 172.21.15.156:0/469613356 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11373 (secure 0 0 0) 0x7ff6dc010af0 con 0x7ff6ec0985e0 2023-09-30T22:16:43.306 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:43.306 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":16,"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","created":"2023-09-30T22:16:15.239992+0000","modified":"2023-09-30T22:16:30.794031+0000","last_up_change":"2023-09-30T22:16:23.392557+0000","last_in_change":"2023-09-30T22:16:16.474206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:16:23.433906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:16:24.367795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:16:28.204677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:16:28.762804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3ec2e78a-c61f-473a-bfcb-f956cffe4095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6812","nonce":118781}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6813","nonce":118781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6815","nonce":118781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6814","nonce":118781}]},"public_addr":"172.21.15.156:6812/118781","cluster_addr":"172.21.15.156:6813/118781","heartbeat_back_addr":"172.21.15.156:6815/118781","heartbeat_front_addr":"172.21.15.156:6814/118781","state":["exists","up"]},{"osd":1,"uuid":"b682e683-c15a-4bd9-8712-8af96454e9ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6803","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6805","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6807","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6806","nonce":118763}]},"public_addr":"172.21.15.156:6803/118763","cluster_addr":"172.21.15.156:6805/118763","heartbeat_back_addr":"172.21.15.156:6807/118763","heartbeat_front_addr":"172.21.15.156:6806/118763","state":["exists","up"]},{"osd":2,"uuid":"960dbaf0-2e0c-437e-9114-bc22ce522b26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6808","nonce":118788}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6809","nonce":118788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6811","nonce":118788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6810","nonce":118788}]},"public_addr":"172.21.15.156:6808/118788","cluster_addr":"172.21.15.156:6809/118788","heartbeat_back_addr":"172.21.15.156:6811/118788","heartbeat_front_addr":"172.21.15.156:6810/118788","state":["exists","up"]},{"osd":3,"uuid":"c1b19714-78b1-4869-8721-2f6352a64a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6800","nonce":118764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6801","nonce":118764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6804","nonce":118764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6802","nonce":118764}]},"public_addr":"172.21.15.156:6800/118764","cluster_addr":"172.21.15.156:6801/118764","heartbeat_back_addr":"172.21.15.156:6804/118764","heartbeat_front_addr":"172.21.15.156:6802/118764","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.663343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.827397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.806655+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.634746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:16:43.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.306+0000 7ff6f19a5700 1 -- 172.21.15.156:0/469613356 >> v1:172.21.15.156:6816/118236 conn(0x7ff6d802bb90 legacy=0x7ff6d802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:43.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.306+0000 7ff6f19a5700 1 -- 172.21.15.156:0/469613356 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6ec0985e0 msgr2=0x7ff6ec11e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:43.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.307+0000 7ff6f19a5700 1 --2- 172.21.15.156:0/469613356 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6ec0985e0 0x7ff6ec11e590 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7ff6dc00c4c0 tx=0x7ff6dc007c10).stop 2023-09-30T22:16:43.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.307+0000 7ff6f19a5700 1 -- 172.21.15.156:0/469613356 shutdown_connections 2023-09-30T22:16:43.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.307+0000 7ff6f19a5700 1 --2- 172.21.15.156:0/469613356 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff6ec130990 0x7ff6ec11aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:43.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.307+0000 7ff6f19a5700 1 --2- 172.21.15.156:0/469613356 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6ec0985e0 0x7ff6ec11e590 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:43.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.307+0000 7ff6f19a5700 1 --2- 172.21.15.156:0/469613356 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6ec0990d0 0x7ff6ec11a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:43.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.307+0000 7ff6f19a5700 1 -- 172.21.15.156:0/469613356 >> 172.21.15.156:0/469613356 conn(0x7ff6ec09dc40 msgr2=0x7ff6ec114300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:43.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.307+0000 7ff6f19a5700 1 -- 172.21.15.156:0/469613356 shutdown_connections 2023-09-30T22:16:43.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.307+0000 7ff6f19a5700 1 -- 172.21.15.156:0/469613356 wait complete. 2023-09-30T22:16:43.319 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-09-30T22:16:23.433906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:16:24.367795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:16:28.204677+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:16:28.762804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T22:16:43.320 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-09-30T22:16:43.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.447+0000 7fef637f1700 1 Processor -- start 2023-09-30T22:16:43.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.448+0000 7fef637f1700 1 -- start start 2023-09-30T22:16:43.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.448+0000 7fef637f1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef5c093950 0x7fef5c095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:43.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.448+0000 7fef637f1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef5c12d250 0x7fef5c12f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:43.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.448+0000 7fef637f1700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5c094ba0 con 0x7fef5c095c50 2023-09-30T22:16:43.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.448+0000 7fef637f1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c092e90 con 0x7fef5c12d250 2023-09-30T22:16:43.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.448+0000 7fef637f1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c096b60 con 0x7fef5c093950 2023-09-30T22:16:43.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.448+0000 7fef6158d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef5c093950 0x7fef5c095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:43.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.448+0000 7fef60d8c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fef5c095c50 0x7fef5c096030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47326/0 (socket says 172.21.15.156:47326) 2023-09-30T22:16:43.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.448+0000 7fef61d8e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef5c12d250 0x7fef5c12f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:43.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.448+0000 7fef60d8c700 1 -- 172.21.15.156:0/564090456 learned_addr learned my addr 172.21.15.156:0/564090456 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:43.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.448+0000 7fef53fff700 1 -- 172.21.15.156:0/564090456 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3749693397 0 0) 0x7fef5c094ba0 con 0x7fef5c095c50 2023-09-30T22:16:43.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.448+0000 7fef53fff700 1 -- 172.21.15.156:0/564090456 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef480033f0 con 0x7fef5c095c50 2023-09-30T22:16:43.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.448+0000 7fef61d8e700 1 -- 172.21.15.156:0/564090456 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef5c093950 msgr2=0x7fef5c095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:43.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.448+0000 7fef61d8e700 1 --2- 172.21.15.156:0/564090456 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef5c093950 0x7fef5c095760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:43.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.448+0000 7fef61d8e700 1 -- 172.21.15.156:0/564090456 >> v1:172.21.15.156:6789/0 conn(0x7fef5c095c50 legacy=0x7fef5c096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:43.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.448+0000 7fef61d8e700 1 -- 172.21.15.156:0/564090456 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c093150 con 0x7fef5c12d250 2023-09-30T22:16:43.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.448+0000 7fef6158d700 1 --2- 172.21.15.156:0/564090456 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef5c093950 0x7fef5c095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:43.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.449+0000 7fef61d8e700 1 --2- 172.21.15.156:0/564090456 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef5c12d250 0x7fef5c12f640 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fef54009e90 tx=0x7fef54009780).ready entity=mon.1 client_cookie=cce7de20e1b47b36 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:43.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.449+0000 7fef53fff700 1 -- 172.21.15.156:0/564090456 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5400e070 con 0x7fef5c12d250 2023-09-30T22:16:43.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.449+0000 7fef53fff700 1 -- 172.21.15.156:0/564090456 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5400bab0 con 0x7fef5c12d250 2023-09-30T22:16:43.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.449+0000 7fef53fff700 1 -- 172.21.15.156:0/564090456 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5400be30 con 0x7fef5c12d250 2023-09-30T22:16:43.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.449+0000 7fef637f1700 1 -- 172.21.15.156:0/564090456 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef5c12d250 msgr2=0x7fef5c12f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:43.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.449+0000 7fef637f1700 1 --2- 172.21.15.156:0/564090456 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef5c12d250 0x7fef5c12f640 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fef54009e90 tx=0x7fef54009780).stop 2023-09-30T22:16:43.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.449+0000 7fef637f1700 1 -- 172.21.15.156:0/564090456 shutdown_connections 2023-09-30T22:16:43.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.449+0000 7fef637f1700 1 --2- 172.21.15.156:0/564090456 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef5c12d250 0x7fef5c12f640 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:43.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.449+0000 7fef637f1700 1 --2- 172.21.15.156:0/564090456 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef5c093950 0x7fef5c095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:43.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.449+0000 7fef637f1700 1 -- 172.21.15.156:0/564090456 >> 172.21.15.156:0/564090456 conn(0x7fef5c09aa50 msgr2=0x7fef5c09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:43.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.449+0000 7fef637f1700 1 -- 172.21.15.156:0/564090456 shutdown_connections 2023-09-30T22:16:43.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.449+0000 7fef637f1700 1 -- 172.21.15.156:0/564090456 wait complete. 2023-09-30T22:16:43.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.450+0000 7fef637f1700 1 Processor -- start 2023-09-30T22:16:43.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.450+0000 7fef637f1700 1 -- start start 2023-09-30T22:16:43.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.451+0000 7fef637f1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef5c093950 0x7fef5c11ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:43.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.451+0000 7fef637f1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef5c095c50 0x7fef5c116b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:43.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.451+0000 7fef637f1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef5c12d250 0x7fef5c117070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:43.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.451+0000 7fef637f1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c12cca0 con 0x7fef5c093950 2023-09-30T22:16:43.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.451+0000 7fef637f1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c1191b0 con 0x7fef5c12d250 2023-09-30T22:16:43.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.451+0000 7fef637f1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c092410 con 0x7fef5c095c50 2023-09-30T22:16:43.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.451+0000 7fef6158d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef5c093950 0x7fef5c11ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:43.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.451+0000 7fef6158d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef5c093950 0x7fef5c11ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:35648/0 (socket says 172.21.15.156:35648) 2023-09-30T22:16:43.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.451+0000 7fef6158d700 1 -- 172.21.15.156:0/4241272924 learned_addr learned my addr 172.21.15.156:0/4241272924 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:43.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.451+0000 7fef61d8e700 1 --2- 172.21.15.156:0/4241272924 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef5c12d250 0x7fef5c117070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:43.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.451+0000 7fef60d8c700 1 --2- 172.21.15.156:0/4241272924 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef5c095c50 0x7fef5c116b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:43.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.451+0000 7fef6158d700 1 -- 172.21.15.156:0/4241272924 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef5c095c50 msgr2=0x7fef5c116b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:43.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.451+0000 7fef6158d700 1 --2- 172.21.15.156:0/4241272924 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef5c095c50 0x7fef5c116b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:43.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.451+0000 7fef6158d700 1 -- 172.21.15.156:0/4241272924 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef5c12d250 msgr2=0x7fef5c117070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:43.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.451+0000 7fef6158d700 1 --2- 172.21.15.156:0/4241272924 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef5c12d250 0x7fef5c117070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:43.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.451+0000 7fef6158d700 1 -- 172.21.15.156:0/4241272924 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4c0092a0 con 0x7fef5c093950 2023-09-30T22:16:43.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.451+0000 7fef61d8e700 1 --2- 172.21.15.156:0/4241272924 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef5c12d250 0x7fef5c117070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:43.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.451+0000 7fef6158d700 1 --2- 172.21.15.156:0/4241272924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef5c093950 0x7fef5c11ab20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fef4c00ea20 tx=0x7fef4c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:43.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.452+0000 7fef517fa700 1 -- 172.21.15.156:0/4241272924 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c00ee60 con 0x7fef5c093950 2023-09-30T22:16:43.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.452+0000 7fef517fa700 1 -- 172.21.15.156:0/4241272924 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4c009600 con 0x7fef5c093950 2023-09-30T22:16:43.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.452+0000 7fef637f1700 1 -- 172.21.15.156:0/4241272924 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef54009a20 con 0x7fef5c093950 2023-09-30T22:16:43.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.452+0000 7fef517fa700 1 -- 172.21.15.156:0/4241272924 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c00ca60 con 0x7fef5c093950 2023-09-30T22:16:43.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.452+0000 7fef637f1700 1 -- 172.21.15.156:0/4241272924 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5c117f80 con 0x7fef5c093950 2023-09-30T22:16:43.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.453+0000 7fef637f1700 1 -- 172.21.15.156:0/4241272924 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5c09a410 con 0x7fef5c093950 2023-09-30T22:16:43.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.453+0000 7fef517fa700 1 -- 172.21.15.156:0/4241272924 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fef4c01b400 con 0x7fef5c093950 2023-09-30T22:16:43.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.453+0000 7fef517fa700 1 -- 172.21.15.156:0/4241272924 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fef4c03b460 con 0x7fef5c093950 2023-09-30T22:16:43.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.457+0000 7fef517fa700 1 -- 172.21.15.156:0/4241272924 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fef4c019310 con 0x7fef5c093950 2023-09-30T22:16:43.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.615+0000 7fef637f1700 1 -- 172.21.15.156:0/4241272924 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fef5c05a290 con 0x7fef5c093950 2023-09-30T22:16:43.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.615+0000 7fef517fa700 1 -- 172.21.15.156:0/4241272924 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v16) v1 ==== 110+0+10 (secure 0 0 0) 0x7fef4c016070 con 0x7fef5c093950 2023-09-30T22:16:43.618 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 1 2023-09-30T22:16:43.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.617+0000 7fef637f1700 1 -- 172.21.15.156:0/4241272924 >> v1:172.21.15.156:6816/118236 conn(0x7fef4002bb60 legacy=0x7fef4002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:43.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.617+0000 7fef637f1700 1 -- 172.21.15.156:0/4241272924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef5c093950 msgr2=0x7fef5c11ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:43.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.617+0000 7fef637f1700 1 --2- 172.21.15.156:0/4241272924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef5c093950 0x7fef5c11ab20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fef4c00ea20 tx=0x7fef4c009060).stop 2023-09-30T22:16:43.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.617+0000 7fef637f1700 1 -- 172.21.15.156:0/4241272924 shutdown_connections 2023-09-30T22:16:43.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.617+0000 7fef637f1700 1 --2- 172.21.15.156:0/4241272924 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef5c12d250 0x7fef5c117070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:43.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.617+0000 7fef637f1700 1 --2- 172.21.15.156:0/4241272924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef5c093950 0x7fef5c11ab20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:43.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.617+0000 7fef637f1700 1 --2- 172.21.15.156:0/4241272924 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef5c095c50 0x7fef5c116b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:43.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.617+0000 7fef637f1700 1 -- 172.21.15.156:0/4241272924 >> 172.21.15.156:0/4241272924 conn(0x7fef5c09aa50 msgr2=0x7fef5c0692b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:43.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.617+0000 7fef637f1700 1 -- 172.21.15.156:0/4241272924 shutdown_connections 2023-09-30T22:16:43.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.617+0000 7fef637f1700 1 -- 172.21.15.156:0/4241272924 wait complete. 2023-09-30T22:16:43.629 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:16:43.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.750+0000 7f90c3f10700 1 Processor -- start 2023-09-30T22:16:43.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.750+0000 7f90c3f10700 1 -- start start 2023-09-30T22:16:43.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.750+0000 7f90c3f10700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f90bc093950 0x7f90bc095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:43.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.750+0000 7f90c3f10700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90bc095c50 0x7f90bc096030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:43.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.750+0000 7f90c3f10700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90bc094ba0 con 0x7f90bc12c240 2023-09-30T22:16:43.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.750+0000 7f90c3f10700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90bc092e90 con 0x7f90bc093950 2023-09-30T22:16:43.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.750+0000 7f90c3f10700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc096b60 con 0x7f90bc095c50 2023-09-30T22:16:43.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.750+0000 7f90c1cac700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f90bc093950 0x7f90bc095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:43.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.750+0000 7f90c24ad700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f90bc12c240 0x7f90bc12e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47342/0 (socket says 172.21.15.156:47342) 2023-09-30T22:16:43.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.750+0000 7f90c14ab700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90bc095c50 0x7f90bc096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:43.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.750+0000 7f90c24ad700 1 -- 172.21.15.156:0/3611936811 learned_addr learned my addr 172.21.15.156:0/3611936811 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:43.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.751+0000 7f90c14ab700 1 -- 172.21.15.156:0/3611936811 >> v2:172.21.15.156:3300/0 conn(0x7f90bc093950 msgr2=0x7f90bc095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:43.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.751+0000 7f90c14ab700 1 --2- 172.21.15.156:0/3611936811 >> v2:172.21.15.156:3300/0 conn(0x7f90bc093950 0x7f90bc095760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:43.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.751+0000 7f90c14ab700 1 -- 172.21.15.156:0/3611936811 >> v1:172.21.15.156:6789/0 conn(0x7f90bc12c240 legacy=0x7f90bc12e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:43.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.751+0000 7f90c14ab700 1 -- 172.21.15.156:0/3611936811 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90bc093150 con 0x7f90bc095c50 2023-09-30T22:16:43.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.751+0000 7f90c0caa700 1 -- 172.21.15.156:0/3611936811 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786643502 0 0) 0x7f90bc094ba0 con 0x7f90bc12c240 2023-09-30T22:16:43.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.751+0000 7f90c1cac700 1 --2- 172.21.15.156:0/3611936811 >> v2:172.21.15.156:3300/0 conn(0x7f90bc093950 0x7f90bc095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:43.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.751+0000 7f90c14ab700 1 --2- 172.21.15.156:0/3611936811 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90bc095c50 0x7f90bc096030 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f90ac009760 tx=0x7f90ac009060).ready entity=mon.1 client_cookie=2343fb72fb532fb7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:43.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.751+0000 7f90c0caa700 1 -- 172.21.15.156:0/3611936811 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac0090d0 con 0x7f90bc095c50 2023-09-30T22:16:43.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.751+0000 7f90c0caa700 1 -- 172.21.15.156:0/3611936811 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ac00f510 con 0x7f90bc095c50 2023-09-30T22:16:43.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.751+0000 7f90c0caa700 1 -- 172.21.15.156:0/3611936811 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac00f890 con 0x7f90bc095c50 2023-09-30T22:16:43.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.751+0000 7f90c3f10700 1 -- 172.21.15.156:0/3611936811 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90bc095c50 msgr2=0x7f90bc096030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:43.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.751+0000 7f90c3f10700 1 --2- 172.21.15.156:0/3611936811 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90bc095c50 0x7f90bc096030 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f90ac009760 tx=0x7f90ac009060).stop 2023-09-30T22:16:43.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.752+0000 7f90c3f10700 1 -- 172.21.15.156:0/3611936811 shutdown_connections 2023-09-30T22:16:43.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.752+0000 7f90c3f10700 1 --2- 172.21.15.156:0/3611936811 >> v2:172.21.15.156:3300/0 conn(0x7f90bc093950 0x7f90bc095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:43.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.752+0000 7f90c3f10700 1 --2- 172.21.15.156:0/3611936811 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90bc095c50 0x7f90bc096030 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:43.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.752+0000 7f90c3f10700 1 -- 172.21.15.156:0/3611936811 >> 172.21.15.156:0/3611936811 conn(0x7f90bc09aa50 msgr2=0x7f90bc09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:43.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.752+0000 7f90c3f10700 1 -- 172.21.15.156:0/3611936811 shutdown_connections 2023-09-30T22:16:43.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.752+0000 7f90c3f10700 1 -- 172.21.15.156:0/3611936811 wait complete. 2023-09-30T22:16:43.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.752+0000 7f90c3f10700 1 Processor -- start 2023-09-30T22:16:43.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.752+0000 7f90c3f10700 1 -- start start 2023-09-30T22:16:43.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.753+0000 7f90c3f10700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90bc093950 0x7f90bc12ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:43.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.753+0000 7f90c3f10700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f90bc095c50 0x7f90bc12b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:43.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.753+0000 7f90c3f10700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90bc12c240 0x7f90bc12b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:43.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.753+0000 7f90c3f10700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc112000 con 0x7f90bc12c240 2023-09-30T22:16:43.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.753+0000 7f90c3f10700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc092410 con 0x7f90bc093950 2023-09-30T22:16:43.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.753+0000 7f90c3f10700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc112ed0 con 0x7f90bc095c50 2023-09-30T22:16:43.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.753+0000 7f90c1cac700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90bc093950 0x7f90bc12ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:43.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.753+0000 7f90c1cac700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90bc093950 0x7f90bc12ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54496/0 (socket says 172.21.15.156:54496) 2023-09-30T22:16:43.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.753+0000 7f90c1cac700 1 -- 172.21.15.156:0/3343502920 learned_addr learned my addr 172.21.15.156:0/3343502920 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:43.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.753+0000 7f90c24ad700 1 --2- 172.21.15.156:0/3343502920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90bc12c240 0x7f90bc12b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:43.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.753+0000 7f90c14ab700 1 --2- 172.21.15.156:0/3343502920 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f90bc095c50 0x7f90bc12b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:43.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.753+0000 7f90c1cac700 1 -- 172.21.15.156:0/3343502920 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f90bc095c50 msgr2=0x7f90bc12b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:43.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.753+0000 7f90c1cac700 1 --2- 172.21.15.156:0/3343502920 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f90bc095c50 0x7f90bc12b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:43.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.753+0000 7f90c1cac700 1 -- 172.21.15.156:0/3343502920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90bc12c240 msgr2=0x7f90bc12b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:43.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.753+0000 7f90c1cac700 1 --2- 172.21.15.156:0/3343502920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90bc12c240 0x7f90bc12b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:43.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.753+0000 7f90c1cac700 1 -- 172.21.15.156:0/3343502920 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b80092a0 con 0x7f90bc093950 2023-09-30T22:16:43.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.753+0000 7f90c24ad700 1 --2- 172.21.15.156:0/3343502920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90bc12c240 0x7f90bc12b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:43.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.753+0000 7f90c1cac700 1 --2- 172.21.15.156:0/3343502920 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90bc093950 0x7f90bc12ab60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f90b800ea20 tx=0x7f90b8009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:43.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.754+0000 7f90b1ffb700 1 -- 172.21.15.156:0/3343502920 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b800ee60 con 0x7f90bc093950 2023-09-30T22:16:43.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.754+0000 7f90b1ffb700 1 -- 172.21.15.156:0/3343502920 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b8009600 con 0x7f90bc093950 2023-09-30T22:16:43.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.754+0000 7f90c3f10700 1 -- 172.21.15.156:0/3343502920 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90ac0092a0 con 0x7f90bc093950 2023-09-30T22:16:43.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.754+0000 7f90b1ffb700 1 -- 172.21.15.156:0/3343502920 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b800ca60 con 0x7f90bc093950 2023-09-30T22:16:43.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.754+0000 7f90c3f10700 1 -- 172.21.15.156:0/3343502920 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90bc113b50 con 0x7f90bc093950 2023-09-30T22:16:43.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.754+0000 7f90b1ffb700 1 -- 172.21.15.156:0/3343502920 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f90b801b400 con 0x7f90bc093950 2023-09-30T22:16:43.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.755+0000 7f90b1ffb700 1 -- 172.21.15.156:0/3343502920 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f90b803b460 con 0x7f90bc093950 2023-09-30T22:16:43.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.755+0000 7f90c3f10700 1 -- 172.21.15.156:0/3343502920 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90bc098d90 con 0x7f90bc093950 2023-09-30T22:16:43.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.759+0000 7f90b1ffb700 1 -- 172.21.15.156:0/3343502920 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f90b8016020 con 0x7f90bc093950 2023-09-30T22:16:43.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.915+0000 7f90c3f10700 1 -- 172.21.15.156:0/3343502920 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f90bc05a260 con 0x7f90bc093950 2023-09-30T22:16:43.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.915+0000 7f90b1ffb700 1 -- 172.21.15.156:0/3343502920 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f90b8011d20 con 0x7f90bc093950 2023-09-30T22:16:43.917 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 8 2023-09-30T22:16:43.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.917+0000 7f90c3f10700 1 -- 172.21.15.156:0/3343502920 >> v1:172.21.15.156:6816/118236 conn(0x7f90a002bb60 legacy=0x7f90a002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:43.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.917+0000 7f90c3f10700 1 -- 172.21.15.156:0/3343502920 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90bc093950 msgr2=0x7f90bc12ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:43.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.917+0000 7f90c3f10700 1 --2- 172.21.15.156:0/3343502920 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90bc093950 0x7f90bc12ab60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f90b800ea20 tx=0x7f90b8009060).stop 2023-09-30T22:16:43.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.917+0000 7f90c3f10700 1 -- 172.21.15.156:0/3343502920 shutdown_connections 2023-09-30T22:16:43.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.917+0000 7f90c3f10700 1 --2- 172.21.15.156:0/3343502920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90bc12c240 0x7f90bc12b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:43.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.917+0000 7f90c3f10700 1 --2- 172.21.15.156:0/3343502920 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90bc093950 0x7f90bc12ab60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:43.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.917+0000 7f90c3f10700 1 --2- 172.21.15.156:0/3343502920 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f90bc095c50 0x7f90bc12b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:43.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.917+0000 7f90c3f10700 1 -- 172.21.15.156:0/3343502920 >> 172.21.15.156:0/3343502920 conn(0x7f90bc09aa50 msgr2=0x7f90bc062aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:43.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.917+0000 7f90c3f10700 1 -- 172.21.15.156:0/3343502920 shutdown_connections 2023-09-30T22:16:43.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:43.917+0000 7f90c3f10700 1 -- 172.21.15.156:0/3343502920 wait complete. 2023-09-30T22:16:43.930 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:16:44.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.051+0000 7f32f3cd3700 1 Processor -- start 2023-09-30T22:16:44.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.052+0000 7f32f3cd3700 1 -- start start 2023-09-30T22:16:44.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.052+0000 7f32f3cd3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32ec092440 0x7f32ec127910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:44.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.052+0000 7f32f3cd3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f32ec126f70 0x7f32ec123a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:44.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.052+0000 7f32f3cd3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ec127390 0x7f32ec123f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:44.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.052+0000 7f32f3cd3700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32ec092820 con 0x7f32ec126f70 2023-09-30T22:16:44.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.052+0000 7f32f3cd3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec097eb0 con 0x7f32ec127390 2023-09-30T22:16:44.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.052+0000 7f32f3cd3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec069760 con 0x7f32ec092440 2023-09-30T22:16:44.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.052+0000 7f32f126e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f32ec126f70 0x7f32ec123a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:44.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.052+0000 7f32f2270700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ec127390 0x7f32ec123f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:44.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.052+0000 7f32f1a6f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32ec092440 0x7f32ec127910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:44.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.052+0000 7f32f2270700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ec127390 0x7f32ec123f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54512/0 (socket says 172.21.15.156:54512) 2023-09-30T22:16:44.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.052+0000 7f32f126e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f32ec126f70 0x7f32ec123a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:35664/0 (socket says 172.21.15.156:35664) 2023-09-30T22:16:44.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.052+0000 7f32f1a6f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32ec092440 0x7f32ec127910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39984/0 (socket says 172.21.15.156:39984) 2023-09-30T22:16:44.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.052+0000 7f32f2270700 1 -- 172.21.15.156:0/2892734908 learned_addr learned my addr 172.21.15.156:0/2892734908 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:44.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.053+0000 7f32f2270700 1 -- 172.21.15.156:0/2892734908 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32ec092440 msgr2=0x7f32ec127910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:44.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.053+0000 7f32f2270700 1 --2- 172.21.15.156:0/2892734908 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32ec092440 0x7f32ec127910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.053+0000 7f32f2270700 1 -- 172.21.15.156:0/2892734908 >> v2:172.21.15.156:3300/0 conn(0x7f32ec126f70 msgr2=0x7f32ec123a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:44.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.053+0000 7f32f2270700 1 --2- 172.21.15.156:0/2892734908 >> v2:172.21.15.156:3300/0 conn(0x7f32ec126f70 0x7f32ec123a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.053+0000 7f32f2270700 1 -- 172.21.15.156:0/2892734908 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ec091980 con 0x7f32ec127390 2023-09-30T22:16:44.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.053+0000 7f32f1a6f700 1 --2- 172.21.15.156:0/2892734908 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32ec092440 0x7f32ec127910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:44.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.053+0000 7f32f126e700 1 --2- 172.21.15.156:0/2892734908 >> v2:172.21.15.156:3300/0 conn(0x7f32ec126f70 0x7f32ec123a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:44.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.053+0000 7f32f2270700 1 --2- 172.21.15.156:0/2892734908 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ec127390 0x7f32ec123f80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f32e4009f20 tx=0x7f32e4009840).ready entity=mon.1 client_cookie=9c68300506b2dc6c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:44.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.053+0000 7f32f0a6d700 1 -- 172.21.15.156:0/2892734908 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e400e070 con 0x7f32ec127390 2023-09-30T22:16:44.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.053+0000 7f32f0a6d700 1 -- 172.21.15.156:0/2892734908 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e400b970 con 0x7f32ec127390 2023-09-30T22:16:44.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.053+0000 7f32f0a6d700 1 -- 172.21.15.156:0/2892734908 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e400bcf0 con 0x7f32ec127390 2023-09-30T22:16:44.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.054+0000 7f32f3cd3700 1 -- 172.21.15.156:0/2892734908 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ec127390 msgr2=0x7f32ec123f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:44.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.054+0000 7f32f3cd3700 1 --2- 172.21.15.156:0/2892734908 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ec127390 0x7f32ec123f80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f32e4009f20 tx=0x7f32e4009840).stop 2023-09-30T22:16:44.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.054+0000 7f32f3cd3700 1 -- 172.21.15.156:0/2892734908 shutdown_connections 2023-09-30T22:16:44.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.054+0000 7f32f3cd3700 1 --2- 172.21.15.156:0/2892734908 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ec127390 0x7f32ec123f80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.054+0000 7f32f3cd3700 1 --2- 172.21.15.156:0/2892734908 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32ec092440 0x7f32ec127910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.054+0000 7f32f3cd3700 1 --2- 172.21.15.156:0/2892734908 >> v2:172.21.15.156:3300/0 conn(0x7f32ec126f70 0x7f32ec123a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.054+0000 7f32f3cd3700 1 -- 172.21.15.156:0/2892734908 >> 172.21.15.156:0/2892734908 conn(0x7f32ec09a1c0 msgr2=0x7f32ec09a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:44.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.054+0000 7f32f3cd3700 1 -- 172.21.15.156:0/2892734908 shutdown_connections 2023-09-30T22:16:44.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.054+0000 7f32f3cd3700 1 -- 172.21.15.156:0/2892734908 wait complete. 2023-09-30T22:16:44.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.054+0000 7f32f3cd3700 1 Processor -- start 2023-09-30T22:16:44.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.054+0000 7f32f3cd3700 1 -- start start 2023-09-30T22:16:44.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.055+0000 7f32f3cd3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32ec092440 0x7f32ec114c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:44.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.055+0000 7f32f3cd3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ec126f70 0x7f32ec115120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:44.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.055+0000 7f32f3cd3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32ec127390 0x7f32ec115610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:44.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.055+0000 7f32f3cd3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec115b00 con 0x7f32ec092440 2023-09-30T22:16:44.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.055+0000 7f32f3cd3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec116ec0 con 0x7f32ec126f70 2023-09-30T22:16:44.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.055+0000 7f32f3cd3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec0975e0 con 0x7f32ec127390 2023-09-30T22:16:44.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.055+0000 7f32f1a6f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32ec092440 0x7f32ec114c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:44.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.055+0000 7f32f126e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ec126f70 0x7f32ec115120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:44.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.055+0000 7f32f1a6f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32ec092440 0x7f32ec114c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:35678/0 (socket says 172.21.15.156:35678) 2023-09-30T22:16:44.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.055+0000 7f32f126e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ec126f70 0x7f32ec115120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54522/0 (socket says 172.21.15.156:54522) 2023-09-30T22:16:44.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.055+0000 7f32f2270700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32ec127390 0x7f32ec115610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:44.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.055+0000 7f32f1a6f700 1 -- 172.21.15.156:0/1396997971 learned_addr learned my addr 172.21.15.156:0/1396997971 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:44.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.055+0000 7f32f126e700 1 -- 172.21.15.156:0/1396997971 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32ec127390 msgr2=0x7f32ec115610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:44.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.055+0000 7f32f126e700 1 --2- 172.21.15.156:0/1396997971 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32ec127390 0x7f32ec115610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.055+0000 7f32f126e700 1 -- 172.21.15.156:0/1396997971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32ec092440 msgr2=0x7f32ec114c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:44.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.055+0000 7f32f126e700 1 --2- 172.21.15.156:0/1396997971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32ec092440 0x7f32ec114c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.055+0000 7f32f126e700 1 -- 172.21.15.156:0/1396997971 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32dc0092a0 con 0x7f32ec126f70 2023-09-30T22:16:44.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.055+0000 7f32f1a6f700 1 --2- 172.21.15.156:0/1396997971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32ec092440 0x7f32ec114c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:44.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.055+0000 7f32f126e700 1 --2- 172.21.15.156:0/1396997971 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ec126f70 0x7f32ec115120 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f32e800e950 tx=0x7f32e8009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:44.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.056+0000 7f32e1ffb700 1 -- 172.21.15.156:0/1396997971 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e8009580 con 0x7f32ec126f70 2023-09-30T22:16:44.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.056+0000 7f32e1ffb700 1 -- 172.21.15.156:0/1396997971 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e8012600 con 0x7f32ec126f70 2023-09-30T22:16:44.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.056+0000 7f32f3cd3700 1 -- 172.21.15.156:0/1396997971 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e80092a0 con 0x7f32ec126f70 2023-09-30T22:16:44.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.056+0000 7f32e1ffb700 1 -- 172.21.15.156:0/1396997971 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e80129a0 con 0x7f32ec126f70 2023-09-30T22:16:44.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.056+0000 7f32f3cd3700 1 -- 172.21.15.156:0/1396997971 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e4009ae0 con 0x7f32ec126f70 2023-09-30T22:16:44.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.056+0000 7f32e1ffb700 1 -- 172.21.15.156:0/1396997971 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f32e8012d10 con 0x7f32ec126f70 2023-09-30T22:16:44.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.056+0000 7f32e1ffb700 1 -- 172.21.15.156:0/1396997971 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f32e803b3e0 con 0x7f32ec126f70 2023-09-30T22:16:44.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.057+0000 7f32f3cd3700 1 -- 172.21.15.156:0/1396997971 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32ec05a260 con 0x7f32ec126f70 2023-09-30T22:16:44.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.061+0000 7f32e1ffb700 1 -- 172.21.15.156:0/1396997971 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f32e8011b40 con 0x7f32ec126f70 2023-09-30T22:16:44.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.216+0000 7f32f3cd3700 1 -- 172.21.15.156:0/1396997971 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f32ec1170e0 con 0x7f32ec126f70 2023-09-30T22:16:44.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.216+0000 7f32e1ffb700 1 -- 172.21.15.156:0/1396997971 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v16) v1 ==== 104+0+11 (secure 0 0 0) 0x7f32e80290a0 con 0x7f32ec126f70 2023-09-30T22:16:44.217 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 32 2023-09-30T22:16:44.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.218+0000 7f32f3cd3700 1 -- 172.21.15.156:0/1396997971 >> v1:172.21.15.156:6816/118236 conn(0x7f32d002bb90 legacy=0x7f32d002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:44.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.218+0000 7f32f3cd3700 1 -- 172.21.15.156:0/1396997971 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ec126f70 msgr2=0x7f32ec115120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:44.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.218+0000 7f32f3cd3700 1 --2- 172.21.15.156:0/1396997971 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ec126f70 0x7f32ec115120 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f32e800e950 tx=0x7f32e8009060).stop 2023-09-30T22:16:44.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.218+0000 7f32f3cd3700 1 -- 172.21.15.156:0/1396997971 shutdown_connections 2023-09-30T22:16:44.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.218+0000 7f32f3cd3700 1 --2- 172.21.15.156:0/1396997971 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32ec127390 0x7f32ec115610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.218+0000 7f32f3cd3700 1 --2- 172.21.15.156:0/1396997971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32ec092440 0x7f32ec114c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.218+0000 7f32f3cd3700 1 --2- 172.21.15.156:0/1396997971 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ec126f70 0x7f32ec115120 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.218+0000 7f32f3cd3700 1 -- 172.21.15.156:0/1396997971 >> 172.21.15.156:0/1396997971 conn(0x7f32ec09a1c0 msgr2=0x7f32ec099350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:44.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.218+0000 7f32f3cd3700 1 -- 172.21.15.156:0/1396997971 shutdown_connections 2023-09-30T22:16:44.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.218+0000 7f32f3cd3700 1 -- 172.21.15.156:0/1396997971 wait complete. 2023-09-30T22:16:44.231 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:16:44.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.349+0000 7f3bb5feb700 1 Processor -- start 2023-09-30T22:16:44.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.349+0000 7f3bb5feb700 1 -- start start 2023-09-30T22:16:44.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.350+0000 7f3bb5feb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3bb005f560 0x7f3bb012ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:44.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.350+0000 7f3bb5feb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3bb012b370 0x7f3bb0095d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:44.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.350+0000 7f3bb5feb700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb0066f90 con 0x7f3bb012b790 2023-09-30T22:16:44.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.350+0000 7f3bb5feb700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb005f940 con 0x7f3bb012b370 2023-09-30T22:16:44.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.350+0000 7f3bb5feb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb0067650 con 0x7f3bb005f560 2023-09-30T22:16:44.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.350+0000 7f3baf7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3bb005f560 0x7f3bb012ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:44.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.350+0000 7f3baeffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3bb012b370 0x7f3bb0095d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:44.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.350+0000 7f3baffff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f3bb012b790 0x7f3bb0096280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47344/0 (socket says 172.21.15.156:47344) 2023-09-30T22:16:44.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.350+0000 7f3baf7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3bb005f560 0x7f3bb012ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39994/0 (socket says 172.21.15.156:39994) 2023-09-30T22:16:44.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.350+0000 7f3baffff700 1 -- 172.21.15.156:0/3324125472 learned_addr learned my addr 172.21.15.156:0/3324125472 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:44.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.350+0000 7f3baf7fe700 1 -- 172.21.15.156:0/3324125472 >> v2:172.21.15.156:3300/0 conn(0x7f3bb012b370 msgr2=0x7f3bb0095d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:44.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.350+0000 7f3baf7fe700 1 --2- 172.21.15.156:0/3324125472 >> v2:172.21.15.156:3300/0 conn(0x7f3bb012b370 0x7f3bb0095d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.350+0000 7f3baf7fe700 1 -- 172.21.15.156:0/3324125472 >> v1:172.21.15.156:6789/0 conn(0x7f3bb012b790 legacy=0x7f3bb0096280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:44.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.350+0000 7f3baf7fe700 1 -- 172.21.15.156:0/3324125472 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb0067910 con 0x7f3bb005f560 2023-09-30T22:16:44.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.350+0000 7f3bae7fc700 1 -- 172.21.15.156:0/3324125472 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135663066 0 0) 0x7f3bb0066f90 con 0x7f3bb012b790 2023-09-30T22:16:44.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.350+0000 7f3baeffd700 1 --2- 172.21.15.156:0/3324125472 >> v2:172.21.15.156:3300/0 conn(0x7f3bb012b370 0x7f3bb0095d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:44.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.350+0000 7f3baf7fe700 1 --2- 172.21.15.156:0/3324125472 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3bb005f560 0x7f3bb012ae80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f3ba4009790 tx=0x7f3ba4009060).ready entity=mon.2 client_cookie=325ca2d5761b092c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:44.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.350+0000 7f3bae7fc700 1 -- 172.21.15.156:0/3324125472 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba400f510 con 0x7f3bb005f560 2023-09-30T22:16:44.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.351+0000 7f3bae7fc700 1 -- 172.21.15.156:0/3324125472 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba400f670 con 0x7f3bb005f560 2023-09-30T22:16:44.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.351+0000 7f3bae7fc700 1 -- 172.21.15.156:0/3324125472 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba400f9f0 con 0x7f3bb005f560 2023-09-30T22:16:44.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.351+0000 7f3bb5feb700 1 -- 172.21.15.156:0/3324125472 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3bb005f560 msgr2=0x7f3bb012ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:44.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.351+0000 7f3bb5feb700 1 --2- 172.21.15.156:0/3324125472 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3bb005f560 0x7f3bb012ae80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f3ba4009790 tx=0x7f3ba4009060).stop 2023-09-30T22:16:44.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.351+0000 7f3bb5feb700 1 -- 172.21.15.156:0/3324125472 shutdown_connections 2023-09-30T22:16:44.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.351+0000 7f3bb5feb700 1 --2- 172.21.15.156:0/3324125472 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3bb005f560 0x7f3bb012ae80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.351+0000 7f3bb5feb700 1 --2- 172.21.15.156:0/3324125472 >> v2:172.21.15.156:3300/0 conn(0x7f3bb012b370 0x7f3bb0095d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.351+0000 7f3bb5feb700 1 -- 172.21.15.156:0/3324125472 >> 172.21.15.156:0/3324125472 conn(0x7f3bb009a1c0 msgr2=0x7f3bb009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:44.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.351+0000 7f3bb5feb700 1 -- 172.21.15.156:0/3324125472 shutdown_connections 2023-09-30T22:16:44.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.351+0000 7f3bb5feb700 1 -- 172.21.15.156:0/3324125472 wait complete. 2023-09-30T22:16:44.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.352+0000 7f3bb5feb700 1 Processor -- start 2023-09-30T22:16:44.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.352+0000 7f3bb5feb700 1 -- start start 2023-09-30T22:16:44.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.352+0000 7f3bb5feb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3bb005f560 0x7f3bb013a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:44.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.352+0000 7f3bb5feb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3bb012b370 0x7f3bb013a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:44.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.352+0000 7f3bb5feb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3bb012b790 0x7f3bb013ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:44.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.352+0000 7f3bb5feb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb0115630 con 0x7f3bb012b790 2023-09-30T22:16:44.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.352+0000 7f3bb5feb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb0129260 con 0x7f3bb005f560 2023-09-30T22:16:44.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.352+0000 7f3bb5feb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb00671c0 con 0x7f3bb012b370 2023-09-30T22:16:44.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.353+0000 7f3baffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3bb012b790 0x7f3bb013ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:44.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.353+0000 7f3baf7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3bb005f560 0x7f3bb013a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:44.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.353+0000 7f3baeffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3bb012b370 0x7f3bb013a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:44.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.353+0000 7f3baf7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3bb005f560 0x7f3bb013a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54532/0 (socket says 172.21.15.156:54532) 2023-09-30T22:16:44.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.353+0000 7f3baeffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3bb012b370 0x7f3bb013a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:40002/0 (socket says 172.21.15.156:40002) 2023-09-30T22:16:44.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.353+0000 7f3baffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3bb012b790 0x7f3bb013ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:35708/0 (socket says 172.21.15.156:35708) 2023-09-30T22:16:44.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.353+0000 7f3baf7fe700 1 -- 172.21.15.156:0/3814073260 learned_addr learned my addr 172.21.15.156:0/3814073260 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:44.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.353+0000 7f3baf7fe700 1 -- 172.21.15.156:0/3814073260 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3bb012b370 msgr2=0x7f3bb013a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:44.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.353+0000 7f3baf7fe700 1 --2- 172.21.15.156:0/3814073260 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3bb012b370 0x7f3bb013a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.353+0000 7f3baf7fe700 1 -- 172.21.15.156:0/3814073260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3bb012b790 msgr2=0x7f3bb013ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:44.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.353+0000 7f3baf7fe700 1 --2- 172.21.15.156:0/3814073260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3bb012b790 0x7f3bb013ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.353+0000 7f3baf7fe700 1 -- 172.21.15.156:0/3814073260 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba00092a0 con 0x7f3bb005f560 2023-09-30T22:16:44.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.353+0000 7f3baffff700 1 --2- 172.21.15.156:0/3814073260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3bb012b790 0x7f3bb013ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:44.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.353+0000 7f3baeffd700 1 --2- 172.21.15.156:0/3814073260 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3bb012b370 0x7f3bb013a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:44.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.353+0000 7f3baf7fe700 1 --2- 172.21.15.156:0/3814073260 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3bb005f560 0x7f3bb013a4a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f3bb0067790 tx=0x7f3ba4017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:44.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.353+0000 7f3b977fe700 1 -- 172.21.15.156:0/3814073260 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba400f7e0 con 0x7f3bb005f560 2023-09-30T22:16:44.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.353+0000 7f3b977fe700 1 -- 172.21.15.156:0/3814073260 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba400f960 con 0x7f3bb005f560 2023-09-30T22:16:44.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.353+0000 7f3bb5feb700 1 -- 172.21.15.156:0/3814073260 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba40092a0 con 0x7f3bb005f560 2023-09-30T22:16:44.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.353+0000 7f3b977fe700 1 -- 172.21.15.156:0/3814073260 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba401b660 con 0x7f3bb005f560 2023-09-30T22:16:44.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.353+0000 7f3bb5feb700 1 -- 172.21.15.156:0/3814073260 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb0117540 con 0x7f3bb005f560 2023-09-30T22:16:44.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.354+0000 7f3b977fe700 1 -- 172.21.15.156:0/3814073260 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3ba401ba10 con 0x7f3bb005f560 2023-09-30T22:16:44.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.354+0000 7f3b977fe700 1 -- 172.21.15.156:0/3814073260 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f3ba403c870 con 0x7f3bb005f560 2023-09-30T22:16:44.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.354+0000 7f3bb5feb700 1 -- 172.21.15.156:0/3814073260 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb005a260 con 0x7f3bb005f560 2023-09-30T22:16:44.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.359+0000 7f3b977fe700 1 -- 172.21.15.156:0/3814073260 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3ba4029080 con 0x7f3bb005f560 2023-09-30T22:16:44.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.516+0000 7f3bb5feb700 1 -- 172.21.15.156:0/3814073260 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3bb012ab70 con 0x7f3bb005f560 2023-09-30T22:16:44.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.516+0000 7f3b977fe700 1 -- 172.21.15.156:0/3814073260 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v16) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3ba401f020 con 0x7f3bb005f560 2023-09-30T22:16:44.517 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 64 2023-09-30T22:16:44.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.518+0000 7f3bb5feb700 1 -- 172.21.15.156:0/3814073260 >> v1:172.21.15.156:6816/118236 conn(0x7f3b9c02bb60 legacy=0x7f3b9c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:44.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.518+0000 7f3bb5feb700 1 -- 172.21.15.156:0/3814073260 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3bb005f560 msgr2=0x7f3bb013a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:44.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.518+0000 7f3bb5feb700 1 --2- 172.21.15.156:0/3814073260 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3bb005f560 0x7f3bb013a4a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f3bb0067790 tx=0x7f3ba4017000).stop 2023-09-30T22:16:44.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.518+0000 7f3bb5feb700 1 -- 172.21.15.156:0/3814073260 shutdown_connections 2023-09-30T22:16:44.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.518+0000 7f3bb5feb700 1 --2- 172.21.15.156:0/3814073260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3bb012b790 0x7f3bb013ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.518+0000 7f3bb5feb700 1 --2- 172.21.15.156:0/3814073260 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3bb005f560 0x7f3bb013a4a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.518+0000 7f3bb5feb700 1 --2- 172.21.15.156:0/3814073260 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3bb012b370 0x7f3bb013a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.518+0000 7f3bb5feb700 1 -- 172.21.15.156:0/3814073260 >> 172.21.15.156:0/3814073260 conn(0x7f3bb009a1c0 msgr2=0x7f3bb012e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:44.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.518+0000 7f3bb5feb700 1 -- 172.21.15.156:0/3814073260 shutdown_connections 2023-09-30T22:16:44.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.518+0000 7f3bb5feb700 1 -- 172.21.15.156:0/3814073260 wait complete. 2023-09-30T22:16:44.530 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:16:44.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.646+0000 7f4f1c6a4700 1 Processor -- start 2023-09-30T22:16:44.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.646+0000 7f4f1c6a4700 1 -- start start 2023-09-30T22:16:44.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.647+0000 7f4f1c6a4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f14066310 0x7f4f140976f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:44.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.647+0000 7f4f1c6a4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f14127df0 0x7f4f1412ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:44.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.647+0000 7f4f1c6a4700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f140980b0 con 0x7f4f14128230 2023-09-30T22:16:44.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.647+0000 7f4f1c6a4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f140666f0 con 0x7f4f14066310 2023-09-30T22:16:44.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.647+0000 7f4f1c6a4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f14065530 con 0x7f4f14127df0 2023-09-30T22:16:44.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.647+0000 7f4f1a440700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f14066310 0x7f4f140976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:44.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.647+0000 7f4f19c3f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f14127df0 0x7f4f1412ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:44.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.647+0000 7f4f1ac41700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4f14128230 0x7f4f1412b010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47358/0 (socket says 172.21.15.156:47358) 2023-09-30T22:16:44.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.647+0000 7f4f1ac41700 1 -- 172.21.15.156:0/901555787 learned_addr learned my addr 172.21.15.156:0/901555787 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:44.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.647+0000 7f4f1943e700 1 -- 172.21.15.156:0/901555787 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1665579097 0 0) 0x7f4f140980b0 con 0x7f4f14128230 2023-09-30T22:16:44.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.648+0000 7f4f19c3f700 1 -- 172.21.15.156:0/901555787 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f14066310 msgr2=0x7f4f140976f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:44.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.648+0000 7f4f19c3f700 1 --2- 172.21.15.156:0/901555787 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f14066310 0x7f4f140976f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.648+0000 7f4f19c3f700 1 -- 172.21.15.156:0/901555787 >> v1:172.21.15.156:6789/0 conn(0x7f4f14128230 legacy=0x7f4f1412b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:44.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.648+0000 7f4f19c3f700 1 -- 172.21.15.156:0/901555787 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f14065850 con 0x7f4f14127df0 2023-09-30T22:16:44.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.648+0000 7f4f1a440700 1 --2- 172.21.15.156:0/901555787 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f14066310 0x7f4f140976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:44.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.648+0000 7f4f19c3f700 1 --2- 172.21.15.156:0/901555787 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f14127df0 0x7f4f1412ab20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f4f10009790 tx=0x7f4f10009060).ready entity=mon.2 client_cookie=9e8efee901c95889 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:44.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.648+0000 7f4f1943e700 1 -- 172.21.15.156:0/901555787 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f100090d0 con 0x7f4f14127df0 2023-09-30T22:16:44.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.648+0000 7f4f1943e700 1 -- 172.21.15.156:0/901555787 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1000f510 con 0x7f4f14127df0 2023-09-30T22:16:44.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.648+0000 7f4f1943e700 1 -- 172.21.15.156:0/901555787 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1000f890 con 0x7f4f14127df0 2023-09-30T22:16:44.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.648+0000 7f4f1c6a4700 1 -- 172.21.15.156:0/901555787 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f14127df0 msgr2=0x7f4f1412ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:44.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.648+0000 7f4f1c6a4700 1 --2- 172.21.15.156:0/901555787 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f14127df0 0x7f4f1412ab20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f4f10009790 tx=0x7f4f10009060).stop 2023-09-30T22:16:44.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.648+0000 7f4f1c6a4700 1 -- 172.21.15.156:0/901555787 shutdown_connections 2023-09-30T22:16:44.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.648+0000 7f4f1c6a4700 1 --2- 172.21.15.156:0/901555787 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f14066310 0x7f4f140976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.648+0000 7f4f1c6a4700 1 --2- 172.21.15.156:0/901555787 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f14127df0 0x7f4f1412ab20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.648+0000 7f4f1c6a4700 1 -- 172.21.15.156:0/901555787 >> 172.21.15.156:0/901555787 conn(0x7f4f1409bad0 msgr2=0x7f4f1409bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:44.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.648+0000 7f4f1c6a4700 1 -- 172.21.15.156:0/901555787 shutdown_connections 2023-09-30T22:16:44.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.648+0000 7f4f1c6a4700 1 -- 172.21.15.156:0/901555787 wait complete. 2023-09-30T22:16:44.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.649+0000 7f4f1c6a4700 1 Processor -- start 2023-09-30T22:16:44.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.649+0000 7f4f1c6a4700 1 -- start start 2023-09-30T22:16:44.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.650+0000 7f4f1c6a4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f14066310 0x7f4f1413a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:44.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.650+0000 7f4f1c6a4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f14127df0 0x7f4f1413aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:44.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.650+0000 7f4f1c6a4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f14128230 0x7f4f14068e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:44.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.650+0000 7f4f1c6a4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f14112b60 con 0x7f4f14127df0 2023-09-30T22:16:44.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.650+0000 7f4f1c6a4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1409a140 con 0x7f4f14128230 2023-09-30T22:16:44.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.650+0000 7f4f1c6a4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f140651c0 con 0x7f4f14066310 2023-09-30T22:16:44.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.650+0000 7f4f1a440700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f14066310 0x7f4f1413a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:44.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.650+0000 7f4f1a440700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f14066310 0x7f4f1413a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:40008/0 (socket says 172.21.15.156:40008) 2023-09-30T22:16:44.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.650+0000 7f4f1ac41700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f14128230 0x7f4f14068e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:44.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.650+0000 7f4f19c3f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f14127df0 0x7f4f1413aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:44.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.650+0000 7f4f1a440700 1 -- 172.21.15.156:0/4082956475 learned_addr learned my addr 172.21.15.156:0/4082956475 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:44.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.650+0000 7f4f1a440700 1 -- 172.21.15.156:0/4082956475 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f14128230 msgr2=0x7f4f14068e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:44.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.650+0000 7f4f1a440700 1 --2- 172.21.15.156:0/4082956475 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f14128230 0x7f4f14068e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.650+0000 7f4f1a440700 1 -- 172.21.15.156:0/4082956475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f14127df0 msgr2=0x7f4f1413aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:44.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.650+0000 7f4f1a440700 1 --2- 172.21.15.156:0/4082956475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f14127df0 0x7f4f1413aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.650+0000 7f4f1a440700 1 -- 172.21.15.156:0/4082956475 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f040092a0 con 0x7f4f14066310 2023-09-30T22:16:44.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.650+0000 7f4f1ac41700 1 --2- 172.21.15.156:0/4082956475 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f14128230 0x7f4f14068e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:44.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.650+0000 7f4f19c3f700 1 --2- 172.21.15.156:0/4082956475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f14127df0 0x7f4f1413aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:44.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.650+0000 7f4f1a440700 1 --2- 172.21.15.156:0/4082956475 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f14066310 0x7f4f1413a590 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4f0400ea50 tx=0x7f4f04009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:44.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.650+0000 7f4f0a7fc700 1 -- 172.21.15.156:0/4082956475 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0400ee90 con 0x7f4f14066310 2023-09-30T22:16:44.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.650+0000 7f4f0a7fc700 1 -- 172.21.15.156:0/4082956475 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0400c850 con 0x7f4f14066310 2023-09-30T22:16:44.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.650+0000 7f4f1c6a4700 1 -- 172.21.15.156:0/4082956475 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f100092a0 con 0x7f4f14066310 2023-09-30T22:16:44.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.650+0000 7f4f0a7fc700 1 -- 172.21.15.156:0/4082956475 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0400cbd0 con 0x7f4f14066310 2023-09-30T22:16:44.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.650+0000 7f4f1c6a4700 1 -- 172.21.15.156:0/4082956475 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f14112130 con 0x7f4f14066310 2023-09-30T22:16:44.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.651+0000 7f4f0a7fc700 1 -- 172.21.15.156:0/4082956475 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4f0401b400 con 0x7f4f14066310 2023-09-30T22:16:44.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.651+0000 7f4f0a7fc700 1 -- 172.21.15.156:0/4082956475 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f4f0403b4e0 con 0x7f4f14066310 2023-09-30T22:16:44.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.651+0000 7f4f1c6a4700 1 -- 172.21.15.156:0/4082956475 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1405a260 con 0x7f4f14066310 2023-09-30T22:16:44.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.656+0000 7f4f0a7fc700 1 -- 172.21.15.156:0/4082956475 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4f0401be60 con 0x7f4f14066310 2023-09-30T22:16:44.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.852+0000 7f4f1c6a4700 1 -- 172.21.15.156:0/4082956475 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f140647e0 con 0x7f4f14066310 2023-09-30T22:16:44.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.852+0000 7f4f0a7fc700 1 -- 172.21.15.156:0/4082956475 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2158 (secure 0 0 0) 0x7f4f0401be60 con 0x7f4f14066310 2023-09-30T22:16:44.853 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:44.853 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:16:29.792703+0000","modified":"2023-09-30T22:16:31.992241+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4206},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4206":{"gid":4206,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6817/3817969673","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6817","nonce":3817969673}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:16:44.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.854+0000 7f4f1c6a4700 1 -- 172.21.15.156:0/4082956475 >> v1:172.21.15.156:6816/118236 conn(0x7f4ef802bb60 legacy=0x7f4ef802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:44.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.854+0000 7f4f1c6a4700 1 -- 172.21.15.156:0/4082956475 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f14066310 msgr2=0x7f4f1413a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:44.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.854+0000 7f4f1c6a4700 1 --2- 172.21.15.156:0/4082956475 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f14066310 0x7f4f1413a590 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4f0400ea50 tx=0x7f4f04009060).stop 2023-09-30T22:16:44.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.854+0000 7f4f1c6a4700 1 -- 172.21.15.156:0/4082956475 shutdown_connections 2023-09-30T22:16:44.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.854+0000 7f4f1c6a4700 1 --2- 172.21.15.156:0/4082956475 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f14128230 0x7f4f14068e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.854+0000 7f4f1c6a4700 1 --2- 172.21.15.156:0/4082956475 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f14066310 0x7f4f1413a590 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.854+0000 7f4f1c6a4700 1 --2- 172.21.15.156:0/4082956475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f14127df0 0x7f4f1413aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.854+0000 7f4f1c6a4700 1 -- 172.21.15.156:0/4082956475 >> 172.21.15.156:0/4082956475 conn(0x7f4f1409bad0 msgr2=0x7f4f1412e060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:44.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.854+0000 7f4f1c6a4700 1 -- 172.21.15.156:0/4082956475 shutdown_connections 2023-09-30T22:16:44.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.854+0000 7f4f1c6a4700 1 -- 172.21.15.156:0/4082956475 wait complete. 2023-09-30T22:16:44.856 INFO:teuthology.orchestra.run.smithi156.stderr:dumped fsmap epoch 5 2023-09-30T22:16:44.866 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:16:44.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.982+0000 7f621beb5700 1 Processor -- start 2023-09-30T22:16:44.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.982+0000 7f621beb5700 1 -- start start 2023-09-30T22:16:44.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.982+0000 7f621beb5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6214095e70 0x7f6214096250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:44.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.982+0000 7f621beb5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f621412d250 0x7f621412f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:44.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.982+0000 7f621beb5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6214094ba0 con 0x7f6214093950 2023-09-30T22:16:44.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.982+0000 7f621beb5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6214092e90 con 0x7f621412d250 2023-09-30T22:16:44.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.982+0000 7f621beb5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6214096b60 con 0x7f6214095e70 2023-09-30T22:16:44.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.982+0000 7f6219450700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6214095e70 0x7f6214096250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:44.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.982+0000 7f621a452700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f621412d250 0x7f621412f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:44.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.982+0000 7f6219450700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6214095e70 0x7f6214096250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54546/0 (socket says 172.21.15.156:54546) 2023-09-30T22:16:44.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.982+0000 7f6219450700 1 -- 172.21.15.156:0/3745017594 learned_addr learned my addr 172.21.15.156:0/3745017594 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:44.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.982+0000 7f6219c51700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6214093950 0x7f6214095760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47374/0 (socket says 172.21.15.156:47374) 2023-09-30T22:16:44.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.983+0000 7f6219450700 1 -- 172.21.15.156:0/3745017594 >> v2:172.21.15.156:3300/0 conn(0x7f621412d250 msgr2=0x7f621412f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:44.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.983+0000 7f6219450700 1 --2- 172.21.15.156:0/3745017594 >> v2:172.21.15.156:3300/0 conn(0x7f621412d250 0x7f621412f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.983+0000 7f6219450700 1 -- 172.21.15.156:0/3745017594 >> v1:172.21.15.156:6789/0 conn(0x7f6214093950 legacy=0x7f6214095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:44.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.983+0000 7f6219450700 1 -- 172.21.15.156:0/3745017594 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6214093150 con 0x7f6214095e70 2023-09-30T22:16:44.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.983+0000 7f6218c4f700 1 -- 172.21.15.156:0/3745017594 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2721019670 0 0) 0x7f6214094ba0 con 0x7f6214093950 2023-09-30T22:16:44.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.983+0000 7f621a452700 1 --2- 172.21.15.156:0/3745017594 >> v2:172.21.15.156:3300/0 conn(0x7f621412d250 0x7f621412f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:44.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.983+0000 7f6219450700 1 --2- 172.21.15.156:0/3745017594 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6214095e70 0x7f6214096250 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f6210006fd0 tx=0x7f62100090f0).ready entity=mon.1 client_cookie=bc9af184ce63ae19 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:44.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.983+0000 7f6218c4f700 1 -- 172.21.15.156:0/3745017594 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621000b580 con 0x7f6214095e70 2023-09-30T22:16:44.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.983+0000 7f6218c4f700 1 -- 172.21.15.156:0/3745017594 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621000b6e0 con 0x7f6214095e70 2023-09-30T22:16:44.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.983+0000 7f6218c4f700 1 -- 172.21.15.156:0/3745017594 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621000ba80 con 0x7f6214095e70 2023-09-30T22:16:44.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.983+0000 7f621beb5700 1 -- 172.21.15.156:0/3745017594 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6214095e70 msgr2=0x7f6214096250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:44.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.983+0000 7f621beb5700 1 --2- 172.21.15.156:0/3745017594 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6214095e70 0x7f6214096250 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f6210006fd0 tx=0x7f62100090f0).stop 2023-09-30T22:16:44.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.984+0000 7f621beb5700 1 -- 172.21.15.156:0/3745017594 shutdown_connections 2023-09-30T22:16:44.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.984+0000 7f621beb5700 1 --2- 172.21.15.156:0/3745017594 >> v2:172.21.15.156:3300/0 conn(0x7f621412d250 0x7f621412f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.984+0000 7f621beb5700 1 --2- 172.21.15.156:0/3745017594 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6214095e70 0x7f6214096250 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.984+0000 7f621beb5700 1 -- 172.21.15.156:0/3745017594 >> 172.21.15.156:0/3745017594 conn(0x7f621409aa50 msgr2=0x7f621409ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:44.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.984+0000 7f621beb5700 1 -- 172.21.15.156:0/3745017594 shutdown_connections 2023-09-30T22:16:44.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.984+0000 7f621beb5700 1 -- 172.21.15.156:0/3745017594 wait complete. 2023-09-30T22:16:44.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.984+0000 7f621beb5700 1 Processor -- start 2023-09-30T22:16:44.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.984+0000 7f621beb5700 1 -- start start 2023-09-30T22:16:44.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.985+0000 7f621beb5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6214093950 0x7f6214117c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:44.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.985+0000 7f621beb5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6214095e70 0x7f6214118130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:44.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.985+0000 7f621beb5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f621412d250 0x7f6214118620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:44.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.985+0000 7f621beb5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621411a1d0 con 0x7f621412d250 2023-09-30T22:16:44.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.985+0000 7f621beb5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621412cca0 con 0x7f6214093950 2023-09-30T22:16:44.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.985+0000 7f621beb5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f621411b600 con 0x7f6214095e70 2023-09-30T22:16:44.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.985+0000 7f6219c51700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6214093950 0x7f6214117c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:44.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.985+0000 7f6219c51700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6214093950 0x7f6214117c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54560/0 (socket says 172.21.15.156:54560) 2023-09-30T22:16:44.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.985+0000 7f621a452700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f621412d250 0x7f6214118620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:44.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.985+0000 7f6219c51700 1 -- 172.21.15.156:0/1017095869 learned_addr learned my addr 172.21.15.156:0/1017095869 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:44.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.985+0000 7f6219450700 1 --2- 172.21.15.156:0/1017095869 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6214095e70 0x7f6214118130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:44.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.985+0000 7f621a452700 1 -- 172.21.15.156:0/1017095869 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6214095e70 msgr2=0x7f6214118130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:44.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.985+0000 7f621a452700 1 --2- 172.21.15.156:0/1017095869 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6214095e70 0x7f6214118130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.985+0000 7f621a452700 1 -- 172.21.15.156:0/1017095869 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6214093950 msgr2=0x7f6214117c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:44.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.985+0000 7f621a452700 1 --2- 172.21.15.156:0/1017095869 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6214093950 0x7f6214117c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:44.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.985+0000 7f621a452700 1 -- 172.21.15.156:0/1017095869 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f620c009a20 con 0x7f621412d250 2023-09-30T22:16:44.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.985+0000 7f6219c51700 1 --2- 172.21.15.156:0/1017095869 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6214093950 0x7f6214117c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:44.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.985+0000 7f621a452700 1 --2- 172.21.15.156:0/1017095869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f621412d250 0x7f6214118620 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f6214092d80 tx=0x7f620c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:44.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.986+0000 7f6209ffb700 1 -- 172.21.15.156:0/1017095869 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c00cb70 con 0x7f621412d250 2023-09-30T22:16:44.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.986+0000 7f6209ffb700 1 -- 172.21.15.156:0/1017095869 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620c00f040 con 0x7f621412d250 2023-09-30T22:16:44.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.986+0000 7f6209ffb700 1 -- 172.21.15.156:0/1017095869 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c013400 con 0x7f621412d250 2023-09-30T22:16:44.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.986+0000 7f621beb5700 1 -- 172.21.15.156:0/1017095869 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6210009370 con 0x7f621412d250 2023-09-30T22:16:44.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.986+0000 7f621beb5700 1 -- 172.21.15.156:0/1017095869 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621411bce0 con 0x7f621412d250 2023-09-30T22:16:44.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.986+0000 7f6209ffb700 1 -- 172.21.15.156:0/1017095869 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f620c0137f0 con 0x7f621412d250 2023-09-30T22:16:44.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.986+0000 7f6209ffb700 1 -- 172.21.15.156:0/1017095869 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f620c03b7f0 con 0x7f621412d250 2023-09-30T22:16:44.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.987+0000 7f621beb5700 1 -- 172.21.15.156:0/1017095869 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f621411be70 con 0x7f621412d250 2023-09-30T22:16:44.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:44.991+0000 7f6209ffb700 1 -- 172.21.15.156:0/1017095869 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f620c013aa0 con 0x7f621412d250 2023-09-30T22:16:45.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.152+0000 7f621beb5700 1 -- 172.21.15.156:0/1017095869 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f621405a260 con 0x7f621412d250 2023-09-30T22:16:45.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.152+0000 7f6209ffb700 1 -- 172.21.15.156:0/1017095869 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11373 (secure 0 0 0) 0x7f620c02b090 con 0x7f621412d250 2023-09-30T22:16:45.153 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:45.153 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":16,"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","created":"2023-09-30T22:16:15.239992+0000","modified":"2023-09-30T22:16:30.794031+0000","last_up_change":"2023-09-30T22:16:23.392557+0000","last_in_change":"2023-09-30T22:16:16.474206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:16:23.433906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:16:24.367795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:16:28.204677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:16:28.762804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3ec2e78a-c61f-473a-bfcb-f956cffe4095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6812","nonce":118781}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6813","nonce":118781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6815","nonce":118781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6814","nonce":118781}]},"public_addr":"172.21.15.156:6812/118781","cluster_addr":"172.21.15.156:6813/118781","heartbeat_back_addr":"172.21.15.156:6815/118781","heartbeat_front_addr":"172.21.15.156:6814/118781","state":["exists","up"]},{"osd":1,"uuid":"b682e683-c15a-4bd9-8712-8af96454e9ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6803","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6805","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6807","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6806","nonce":118763}]},"public_addr":"172.21.15.156:6803/118763","cluster_addr":"172.21.15.156:6805/118763","heartbeat_back_addr":"172.21.15.156:6807/118763","heartbeat_front_addr":"172.21.15.156:6806/118763","state":["exists","up"]},{"osd":2,"uuid":"960dbaf0-2e0c-437e-9114-bc22ce522b26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6808","nonce":118788}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6809","nonce":118788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6811","nonce":118788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6810","nonce":118788}]},"public_addr":"172.21.15.156:6808/118788","cluster_addr":"172.21.15.156:6809/118788","heartbeat_back_addr":"172.21.15.156:6811/118788","heartbeat_front_addr":"172.21.15.156:6810/118788","state":["exists","up"]},{"osd":3,"uuid":"c1b19714-78b1-4869-8721-2f6352a64a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6800","nonce":118764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6801","nonce":118764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6804","nonce":118764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6802","nonce":118764}]},"public_addr":"172.21.15.156:6800/118764","cluster_addr":"172.21.15.156:6801/118764","heartbeat_back_addr":"172.21.15.156:6804/118764","heartbeat_front_addr":"172.21.15.156:6802/118764","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.663343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.827397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.806655+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.634746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:16:45.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.154+0000 7f621beb5700 1 -- 172.21.15.156:0/1017095869 >> v1:172.21.15.156:6816/118236 conn(0x7f61f802bb60 legacy=0x7f61f802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:45.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.154+0000 7f621beb5700 1 -- 172.21.15.156:0/1017095869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f621412d250 msgr2=0x7f6214118620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:45.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.154+0000 7f621beb5700 1 --2- 172.21.15.156:0/1017095869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f621412d250 0x7f6214118620 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f6214092d80 tx=0x7f620c00b040).stop 2023-09-30T22:16:45.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.154+0000 7f621beb5700 1 -- 172.21.15.156:0/1017095869 shutdown_connections 2023-09-30T22:16:45.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.154+0000 7f621beb5700 1 --2- 172.21.15.156:0/1017095869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f621412d250 0x7f6214118620 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:45.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.154+0000 7f621beb5700 1 --2- 172.21.15.156:0/1017095869 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6214093950 0x7f6214117c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:45.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.154+0000 7f621beb5700 1 --2- 172.21.15.156:0/1017095869 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6214095e70 0x7f6214118130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:45.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.154+0000 7f621beb5700 1 -- 172.21.15.156:0/1017095869 >> 172.21.15.156:0/1017095869 conn(0x7f621409aa50 msgr2=0x7f621412e190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:45.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.154+0000 7f621beb5700 1 -- 172.21.15.156:0/1017095869 shutdown_connections 2023-09-30T22:16:45.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.154+0000 7f621beb5700 1 -- 172.21.15.156:0/1017095869 wait complete. 2023-09-30T22:16:45.166 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-09-30T22:16:23.433906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:16:24.367795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:16:28.204677+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:16:28.762804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T22:16:45.167 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-09-30T22:16:45.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.286+0000 7fc57c177700 1 Processor -- start 2023-09-30T22:16:45.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.286+0000 7fc57c177700 1 -- start start 2023-09-30T22:16:45.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.287+0000 7fc57c177700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc574096810 0x7fc574096bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:45.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.287+0000 7fc57c177700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc5740970e0 0x7fc5740974c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:45.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.287+0000 7fc57c177700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5740982f0 con 0x7fc5740979b0 2023-09-30T22:16:45.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.287+0000 7fc57c177700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc574068550 con 0x7fc574096810 2023-09-30T22:16:45.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.287+0000 7fc57c177700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc574069e20 con 0x7fc5740970e0 2023-09-30T22:16:45.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.287+0000 7fc579712700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc5740970e0 0x7fc5740974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:45.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.287+0000 7fc579f13700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc574096810 0x7fc574096bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:45.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.287+0000 7fc57a714700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc5740979b0 0x7fc57412f2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47382/0 (socket says 172.21.15.156:47382) 2023-09-30T22:16:45.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.287+0000 7fc57a714700 1 -- 172.21.15.156:0/1852551240 learned_addr learned my addr 172.21.15.156:0/1852551240 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:45.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.287+0000 7fc579712700 1 -- 172.21.15.156:0/1852551240 >> v2:172.21.15.156:3300/0 conn(0x7fc574096810 msgr2=0x7fc574096bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:45.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.287+0000 7fc579712700 1 --2- 172.21.15.156:0/1852551240 >> v2:172.21.15.156:3300/0 conn(0x7fc574096810 0x7fc574096bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:45.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.287+0000 7fc579712700 1 -- 172.21.15.156:0/1852551240 >> v1:172.21.15.156:6789/0 conn(0x7fc5740979b0 legacy=0x7fc57412f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:45.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.287+0000 7fc578f11700 1 -- 172.21.15.156:0/1852551240 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3646750655 0 0) 0x7fc5740982f0 con 0x7fc5740979b0 2023-09-30T22:16:45.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.287+0000 7fc579712700 1 -- 172.21.15.156:0/1852551240 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc574068f60 con 0x7fc5740970e0 2023-09-30T22:16:45.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.287+0000 7fc579f13700 1 --2- 172.21.15.156:0/1852551240 >> v2:172.21.15.156:3300/0 conn(0x7fc574096810 0x7fc574096bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:45.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.287+0000 7fc579712700 1 --2- 172.21.15.156:0/1852551240 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc5740970e0 0x7fc5740974c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fc570009760 tx=0x7fc570009060).ready entity=mon.2 client_cookie=b91fd257cbd8a085 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:45.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.287+0000 7fc578f11700 1 -- 172.21.15.156:0/1852551240 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5700090d0 con 0x7fc5740970e0 2023-09-30T22:16:45.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.287+0000 7fc578f11700 1 -- 172.21.15.156:0/1852551240 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57000f510 con 0x7fc5740970e0 2023-09-30T22:16:45.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.287+0000 7fc578f11700 1 -- 172.21.15.156:0/1852551240 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57000f890 con 0x7fc5740970e0 2023-09-30T22:16:45.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.288+0000 7fc57c177700 1 -- 172.21.15.156:0/1852551240 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc5740970e0 msgr2=0x7fc5740974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:45.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.288+0000 7fc57c177700 1 --2- 172.21.15.156:0/1852551240 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc5740970e0 0x7fc5740974c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fc570009760 tx=0x7fc570009060).stop 2023-09-30T22:16:45.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.288+0000 7fc57c177700 1 -- 172.21.15.156:0/1852551240 shutdown_connections 2023-09-30T22:16:45.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.288+0000 7fc57c177700 1 --2- 172.21.15.156:0/1852551240 >> v2:172.21.15.156:3300/0 conn(0x7fc574096810 0x7fc574096bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:45.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.288+0000 7fc57c177700 1 --2- 172.21.15.156:0/1852551240 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc5740970e0 0x7fc5740974c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:45.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.288+0000 7fc57c177700 1 -- 172.21.15.156:0/1852551240 >> 172.21.15.156:0/1852551240 conn(0x7fc57409bad0 msgr2=0x7fc57409bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:45.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.288+0000 7fc57c177700 1 -- 172.21.15.156:0/1852551240 shutdown_connections 2023-09-30T22:16:45.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.288+0000 7fc57c177700 1 -- 172.21.15.156:0/1852551240 wait complete. 2023-09-30T22:16:45.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.289+0000 7fc57c177700 1 Processor -- start 2023-09-30T22:16:45.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.289+0000 7fc57c177700 1 -- start start 2023-09-30T22:16:45.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.289+0000 7fc57c177700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc574096810 0x7fc574137cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:45.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.289+0000 7fc57c177700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc5740970e0 0x7fc5741381b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:45.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.289+0000 7fc57c177700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc5740979b0 0x7fc5741386a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:45.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.289+0000 7fc57c177700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57411ba30 con 0x7fc574096810 2023-09-30T22:16:45.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.289+0000 7fc57c177700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57406a040 con 0x7fc5740979b0 2023-09-30T22:16:45.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.289+0000 7fc57c177700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc574095990 con 0x7fc5740970e0 2023-09-30T22:16:45.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.289+0000 7fc579f13700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc574096810 0x7fc574137cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:45.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.289+0000 7fc579f13700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc574096810 0x7fc574137cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:35742/0 (socket says 172.21.15.156:35742) 2023-09-30T22:16:45.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.289+0000 7fc579712700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc5740970e0 0x7fc5741381b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:45.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.289+0000 7fc579f13700 1 -- 172.21.15.156:0/106035004 learned_addr learned my addr 172.21.15.156:0/106035004 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:45.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.289+0000 7fc57a714700 1 --2- 172.21.15.156:0/106035004 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc5740979b0 0x7fc5741386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:45.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.290+0000 7fc579f13700 1 -- 172.21.15.156:0/106035004 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc5740970e0 msgr2=0x7fc5741381b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:45.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.290+0000 7fc579f13700 1 --2- 172.21.15.156:0/106035004 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc5740970e0 0x7fc5741381b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:45.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.290+0000 7fc579f13700 1 -- 172.21.15.156:0/106035004 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc5740979b0 msgr2=0x7fc5741386a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:45.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.290+0000 7fc579f13700 1 --2- 172.21.15.156:0/106035004 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc5740979b0 0x7fc5741386a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:45.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.290+0000 7fc579f13700 1 -- 172.21.15.156:0/106035004 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5640092a0 con 0x7fc574096810 2023-09-30T22:16:45.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.290+0000 7fc579712700 1 --2- 172.21.15.156:0/106035004 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc5740970e0 0x7fc5741381b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:45.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.290+0000 7fc579f13700 1 --2- 172.21.15.156:0/106035004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc574096810 0x7fc574137cc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fc56400ea50 tx=0x7fc564009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:45.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.290+0000 7fc569ffb700 1 -- 172.21.15.156:0/106035004 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56400ee90 con 0x7fc574096810 2023-09-30T22:16:45.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.290+0000 7fc569ffb700 1 -- 172.21.15.156:0/106035004 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56400c850 con 0x7fc574096810 2023-09-30T22:16:45.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.290+0000 7fc569ffb700 1 -- 172.21.15.156:0/106035004 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56400cbd0 con 0x7fc574096810 2023-09-30T22:16:45.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.290+0000 7fc57c177700 1 -- 172.21.15.156:0/106035004 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5700092a0 con 0x7fc574096810 2023-09-30T22:16:45.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.290+0000 7fc57c177700 1 -- 172.21.15.156:0/106035004 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57411c240 con 0x7fc574096810 2023-09-30T22:16:45.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.291+0000 7fc569ffb700 1 -- 172.21.15.156:0/106035004 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fc56401b400 con 0x7fc574096810 2023-09-30T22:16:45.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.291+0000 7fc569ffb700 1 -- 172.21.15.156:0/106035004 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fc56403b310 con 0x7fc574096810 2023-09-30T22:16:45.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.291+0000 7fc57c177700 1 -- 172.21.15.156:0/106035004 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57411c240 con 0x7fc574096810 2023-09-30T22:16:45.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.295+0000 7fc569ffb700 1 -- 172.21.15.156:0/106035004 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fc57411c240 con 0x7fc574096810 2023-09-30T22:16:45.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.454+0000 7fc57c177700 1 -- 172.21.15.156:0/106035004 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc57411c240 con 0x7fc574096810 2023-09-30T22:16:45.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.454+0000 7fc569ffb700 1 -- 172.21.15.156:0/106035004 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v16) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc57411c240 con 0x7fc574096810 2023-09-30T22:16:45.455 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 1 2023-09-30T22:16:45.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.456+0000 7fc57c177700 1 -- 172.21.15.156:0/106035004 >> v1:172.21.15.156:6816/118236 conn(0x7fc55802bb60 legacy=0x7fc55802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:45.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.456+0000 7fc57c177700 1 -- 172.21.15.156:0/106035004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc574096810 msgr2=0x7fc574137cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:45.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.456+0000 7fc57c177700 1 --2- 172.21.15.156:0/106035004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc574096810 0x7fc574137cc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fc56400ea50 tx=0x7fc564009060).stop 2023-09-30T22:16:45.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.456+0000 7fc57c177700 1 -- 172.21.15.156:0/106035004 shutdown_connections 2023-09-30T22:16:45.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.456+0000 7fc57c177700 1 --2- 172.21.15.156:0/106035004 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc5740979b0 0x7fc5741386a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:45.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.456+0000 7fc57c177700 1 --2- 172.21.15.156:0/106035004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc574096810 0x7fc574137cc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:45.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.456+0000 7fc57c177700 1 --2- 172.21.15.156:0/106035004 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc5740970e0 0x7fc5741381b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:45.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.456+0000 7fc57c177700 1 -- 172.21.15.156:0/106035004 >> 172.21.15.156:0/106035004 conn(0x7fc57409bad0 msgr2=0x7fc5740999b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:45.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.456+0000 7fc57c177700 1 -- 172.21.15.156:0/106035004 shutdown_connections 2023-09-30T22:16:45.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.456+0000 7fc57c177700 1 -- 172.21.15.156:0/106035004 wait complete. 2023-09-30T22:16:45.469 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:16:45.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.588+0000 7f1190358700 1 Processor -- start 2023-09-30T22:16:45.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.588+0000 7f1190358700 1 -- start start 2023-09-30T22:16:45.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.588+0000 7f1190358700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1188096810 0x7f1188096bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:45.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.588+0000 7f1190358700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f118812e2d0 0x7f11881306c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:45.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.588+0000 7f1190358700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11880982f0 con 0x7f11880970e0 2023-09-30T22:16:45.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.588+0000 7f1190358700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1188068550 con 0x7f1188096810 2023-09-30T22:16:45.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.588+0000 7f1190358700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1188069e20 con 0x7f118812e2d0 2023-09-30T22:16:45.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.588+0000 7f118e8f5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f118812e2d0 0x7f11881306c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:45.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.588+0000 7f118e8f5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f118812e2d0 0x7f11881306c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54568/0 (socket says 172.21.15.156:54568) 2023-09-30T22:16:45.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.588+0000 7f118e0f4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1188096810 0x7f1188096bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:45.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.588+0000 7f118e8f5700 1 -- 172.21.15.156:0/162601914 learned_addr learned my addr 172.21.15.156:0/162601914 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:45.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.588+0000 7f118d8f3700 1 --1- 172.21.15.156:0/162601914 >> v1:172.21.15.156:6789/0 conn(0x7f11880970e0 0x7f11880974c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47398/0 (socket says 172.21.15.156:47398) 2023-09-30T22:16:45.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.589+0000 7f118e8f5700 1 -- 172.21.15.156:0/162601914 >> v2:172.21.15.156:3300/0 conn(0x7f1188096810 msgr2=0x7f1188096bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:45.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.589+0000 7f118e8f5700 1 --2- 172.21.15.156:0/162601914 >> v2:172.21.15.156:3300/0 conn(0x7f1188096810 0x7f1188096bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:45.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.589+0000 7f118e8f5700 1 -- 172.21.15.156:0/162601914 >> v1:172.21.15.156:6789/0 conn(0x7f11880970e0 legacy=0x7f11880974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:45.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.589+0000 7f118d0f2700 1 -- 172.21.15.156:0/162601914 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 763451140 0 0) 0x7f11880982f0 con 0x7f11880970e0 2023-09-30T22:16:45.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.589+0000 7f118e8f5700 1 -- 172.21.15.156:0/162601914 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1188097bd0 con 0x7f118812e2d0 2023-09-30T22:16:45.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.589+0000 7f118e0f4700 1 --2- 172.21.15.156:0/162601914 >> v2:172.21.15.156:3300/0 conn(0x7f1188096810 0x7f1188096bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:45.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.589+0000 7f118e8f5700 1 --2- 172.21.15.156:0/162601914 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f118812e2d0 0x7f11881306c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f1180009f20 tx=0x7f1180009840).ready entity=mon.1 client_cookie=de50aa6d0a8ac0af server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:45.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.589+0000 7f118d0f2700 1 -- 172.21.15.156:0/162601914 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118000e070 con 0x7f118812e2d0 2023-09-30T22:16:45.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.589+0000 7f118d0f2700 1 -- 172.21.15.156:0/162601914 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118000b9d0 con 0x7f118812e2d0 2023-09-30T22:16:45.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.589+0000 7f118d0f2700 1 -- 172.21.15.156:0/162601914 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118000bd50 con 0x7f118812e2d0 2023-09-30T22:16:45.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.589+0000 7f1190358700 1 -- 172.21.15.156:0/162601914 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f118812e2d0 msgr2=0x7f11881306c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:45.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.589+0000 7f1190358700 1 --2- 172.21.15.156:0/162601914 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f118812e2d0 0x7f11881306c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f1180009f20 tx=0x7f1180009840).stop 2023-09-30T22:16:45.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.590+0000 7f1190358700 1 -- 172.21.15.156:0/162601914 shutdown_connections 2023-09-30T22:16:45.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.590+0000 7f1190358700 1 --2- 172.21.15.156:0/162601914 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f118812e2d0 0x7f11881306c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:45.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.590+0000 7f1190358700 1 --2- 172.21.15.156:0/162601914 >> v2:172.21.15.156:3300/0 conn(0x7f1188096810 0x7f1188096bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:45.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.590+0000 7f1190358700 1 -- 172.21.15.156:0/162601914 >> 172.21.15.156:0/162601914 conn(0x7f118809bad0 msgr2=0x7f118809bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:45.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.590+0000 7f1190358700 1 -- 172.21.15.156:0/162601914 shutdown_connections 2023-09-30T22:16:45.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.590+0000 7f1190358700 1 -- 172.21.15.156:0/162601914 wait complete. 2023-09-30T22:16:45.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.590+0000 7f1190358700 1 Processor -- start 2023-09-30T22:16:45.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.590+0000 7f1190358700 1 -- start start 2023-09-30T22:16:45.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.591+0000 7f1190358700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1188096810 0x7f11880646d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:45.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.591+0000 7f1190358700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11880970e0 0x7f1188064bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:45.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.591+0000 7f1190358700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f118812e2d0 0x7f11880650b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:45.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.591+0000 7f1190358700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11881180b0 con 0x7f11880970e0 2023-09-30T22:16:45.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.591+0000 7f1190358700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1188099030 con 0x7f118812e2d0 2023-09-30T22:16:45.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.591+0000 7f1190358700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f118806a040 con 0x7f1188096810 2023-09-30T22:16:45.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.591+0000 7f118e8f5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f118812e2d0 0x7f11880650b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:45.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.591+0000 7f118e0f4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1188096810 0x7f11880646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:45.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.591+0000 7f118e8f5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f118812e2d0 0x7f11880650b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54578/0 (socket says 172.21.15.156:54578) 2023-09-30T22:16:45.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.591+0000 7f118e8f5700 1 -- 172.21.15.156:0/975336925 learned_addr learned my addr 172.21.15.156:0/975336925 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:45.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.591+0000 7f118d8f3700 1 --2- 172.21.15.156:0/975336925 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11880970e0 0x7f1188064bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:45.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.591+0000 7f118e8f5700 1 -- 172.21.15.156:0/975336925 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1188096810 msgr2=0x7f11880646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:45.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.591+0000 7f118e8f5700 1 --2- 172.21.15.156:0/975336925 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1188096810 0x7f11880646d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:45.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.591+0000 7f118e8f5700 1 -- 172.21.15.156:0/975336925 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11880970e0 msgr2=0x7f1188064bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:45.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.591+0000 7f118e8f5700 1 --2- 172.21.15.156:0/975336925 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11880970e0 0x7f1188064bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:45.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.591+0000 7f118e8f5700 1 -- 172.21.15.156:0/975336925 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11840092a0 con 0x7f118812e2d0 2023-09-30T22:16:45.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.591+0000 7f118e0f4700 1 --2- 172.21.15.156:0/975336925 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1188096810 0x7f11880646d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:45.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.591+0000 7f118d8f3700 1 --2- 172.21.15.156:0/975336925 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11880970e0 0x7f1188064bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:45.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.591+0000 7f118e8f5700 1 --2- 172.21.15.156:0/975336925 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f118812e2d0 0x7f11880650b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f1188069f60 tx=0x7f1188069660).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:45.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.591+0000 7f117e7fc700 1 -- 172.21.15.156:0/975336925 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1180007080 con 0x7f118812e2d0 2023-09-30T22:16:45.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.591+0000 7f117e7fc700 1 -- 172.21.15.156:0/975336925 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11800092e0 con 0x7f118812e2d0 2023-09-30T22:16:45.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.592+0000 7f1190358700 1 -- 172.21.15.156:0/975336925 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1180009ae0 con 0x7f118812e2d0 2023-09-30T22:16:45.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.592+0000 7f117e7fc700 1 -- 172.21.15.156:0/975336925 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1180007840 con 0x7f118812e2d0 2023-09-30T22:16:45.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.592+0000 7f1190358700 1 -- 172.21.15.156:0/975336925 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1188118db0 con 0x7f118812e2d0 2023-09-30T22:16:45.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.592+0000 7f117e7fc700 1 -- 172.21.15.156:0/975336925 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f1180003040 con 0x7f118812e2d0 2023-09-30T22:16:45.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.592+0000 7f117e7fc700 1 -- 172.21.15.156:0/975336925 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f118003caf0 con 0x7f118812e2d0 2023-09-30T22:16:45.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.593+0000 7f1190358700 1 -- 172.21.15.156:0/975336925 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1188118450 con 0x7f118812e2d0 2023-09-30T22:16:45.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.597+0000 7f117e7fc700 1 -- 172.21.15.156:0/975336925 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f1180024070 con 0x7f118812e2d0 2023-09-30T22:16:45.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.753+0000 7f1190358700 1 -- 172.21.15.156:0/975336925 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f118805a260 con 0x7f118812e2d0 2023-09-30T22:16:45.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.753+0000 7f117e7fc700 1 -- 172.21.15.156:0/975336925 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1180024020 con 0x7f118812e2d0 2023-09-30T22:16:45.754 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 8 2023-09-30T22:16:45.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.755+0000 7f1190358700 1 -- 172.21.15.156:0/975336925 >> v1:172.21.15.156:6816/118236 conn(0x7f116c02bb60 legacy=0x7f116c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:45.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.755+0000 7f1190358700 1 -- 172.21.15.156:0/975336925 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f118812e2d0 msgr2=0x7f11880650b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:45.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.755+0000 7f1190358700 1 --2- 172.21.15.156:0/975336925 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f118812e2d0 0x7f11880650b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f1188069f60 tx=0x7f1188069660).stop 2023-09-30T22:16:45.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.755+0000 7f1190358700 1 -- 172.21.15.156:0/975336925 shutdown_connections 2023-09-30T22:16:45.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.755+0000 7f1190358700 1 --2- 172.21.15.156:0/975336925 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f118812e2d0 0x7f11880650b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:45.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.755+0000 7f1190358700 1 --2- 172.21.15.156:0/975336925 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1188096810 0x7f11880646d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:45.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.755+0000 7f1190358700 1 --2- 172.21.15.156:0/975336925 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11880970e0 0x7f1188064bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:45.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.755+0000 7f1190358700 1 -- 172.21.15.156:0/975336925 >> 172.21.15.156:0/975336925 conn(0x7f118809bad0 msgr2=0x7f118809a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:45.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.755+0000 7f1190358700 1 -- 172.21.15.156:0/975336925 shutdown_connections 2023-09-30T22:16:45.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.755+0000 7f1190358700 1 -- 172.21.15.156:0/975336925 wait complete. 2023-09-30T22:16:45.767 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:16:45.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.889+0000 7f7068ffc700 1 Processor -- start 2023-09-30T22:16:45.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.889+0000 7f7068ffc700 1 -- start start 2023-09-30T22:16:45.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.890+0000 7f7068ffc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7064062b00 0x7f7064095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:45.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.890+0000 7f7068ffc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7064095b80 0x7f7064095fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:45.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.890+0000 7f7068ffc700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7064091980 con 0x7f7064096490 2023-09-30T22:16:45.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.890+0000 7f7068ffc700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70640973f0 con 0x7f7064095b80 2023-09-30T22:16:45.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.890+0000 7f7068ffc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7064062ee0 con 0x7f7064062b00 2023-09-30T22:16:45.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.890+0000 7f706259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7064062b00 0x7f7064095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:45.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.890+0000 7f706259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7064062b00 0x7f7064095690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:40060/0 (socket says 172.21.15.156:40060) 2023-09-30T22:16:45.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.890+0000 7f706259c700 1 -- 172.21.15.156:0/2734150207 learned_addr learned my addr 172.21.15.156:0/2734150207 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:45.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.890+0000 7f7061d9b700 1 --2- 172.21.15.156:0/2734150207 >> v2:172.21.15.156:3300/0 conn(0x7f7064095b80 0x7f7064095fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:45.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.890+0000 7f706259c700 1 -- 172.21.15.156:0/2734150207 >> v2:172.21.15.156:3300/0 conn(0x7f7064095b80 msgr2=0x7f7064095fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:45.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.890+0000 7f706259c700 1 --2- 172.21.15.156:0/2734150207 >> v2:172.21.15.156:3300/0 conn(0x7f7064095b80 0x7f7064095fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:45.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.890+0000 7f706259c700 1 -- 172.21.15.156:0/2734150207 >> v1:172.21.15.156:6789/0 conn(0x7f7064096490 legacy=0x7f7064131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:45.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.890+0000 7f706259c700 1 -- 172.21.15.156:0/2734150207 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7064092310 con 0x7f7064062b00 2023-09-30T22:16:45.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.890+0000 7f706159a700 1 -- 172.21.15.156:0/2734150207 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394508991 0 0) 0x7f7064091980 con 0x7f7064096490 2023-09-30T22:16:45.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.890+0000 7f7061d9b700 1 --2- 172.21.15.156:0/2734150207 >> v2:172.21.15.156:3300/0 conn(0x7f7064095b80 0x7f7064095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:45.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.891+0000 7f706259c700 1 --2- 172.21.15.156:0/2734150207 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7064062b00 0x7f7064095690 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f7058009830 tx=0x7f70580090f0).ready entity=mon.2 client_cookie=2f8ef7b46815abc2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:45.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.891+0000 7f706159a700 1 -- 172.21.15.156:0/2734150207 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705800b580 con 0x7f7064062b00 2023-09-30T22:16:45.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.891+0000 7f706159a700 1 -- 172.21.15.156:0/2734150207 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705800b6e0 con 0x7f7064062b00 2023-09-30T22:16:45.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.891+0000 7f706159a700 1 -- 172.21.15.156:0/2734150207 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705800ba60 con 0x7f7064062b00 2023-09-30T22:16:45.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.891+0000 7f7068ffc700 1 -- 172.21.15.156:0/2734150207 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7064062b00 msgr2=0x7f7064095690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:45.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.891+0000 7f7068ffc700 1 --2- 172.21.15.156:0/2734150207 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7064062b00 0x7f7064095690 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f7058009830 tx=0x7f70580090f0).stop 2023-09-30T22:16:45.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.891+0000 7f7068ffc700 1 -- 172.21.15.156:0/2734150207 shutdown_connections 2023-09-30T22:16:45.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.891+0000 7f7068ffc700 1 --2- 172.21.15.156:0/2734150207 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7064062b00 0x7f7064095690 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:45.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.891+0000 7f7068ffc700 1 --2- 172.21.15.156:0/2734150207 >> v2:172.21.15.156:3300/0 conn(0x7f7064095b80 0x7f7064095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:45.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.891+0000 7f7068ffc700 1 -- 172.21.15.156:0/2734150207 >> 172.21.15.156:0/2734150207 conn(0x7f706409aa50 msgr2=0x7f706409ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:45.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.891+0000 7f7068ffc700 1 -- 172.21.15.156:0/2734150207 shutdown_connections 2023-09-30T22:16:45.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.891+0000 7f7068ffc700 1 -- 172.21.15.156:0/2734150207 wait complete. 2023-09-30T22:16:45.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.892+0000 7f7068ffc700 1 Processor -- start 2023-09-30T22:16:45.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.892+0000 7f7068ffc700 1 -- start start 2023-09-30T22:16:45.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.893+0000 7f7068ffc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7064062b00 0x7f7064119620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:45.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.893+0000 7f7068ffc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7064095b80 0x7f70641156d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:45.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.893+0000 7f7068ffc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7064096490 0x7f7064115bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:45.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.893+0000 7f7068ffc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7064096da0 con 0x7f7064062b00 2023-09-30T22:16:45.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.893+0000 7f7068ffc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706412d7c0 con 0x7f7064096490 2023-09-30T22:16:45.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.893+0000 7f7068ffc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7064119120 con 0x7f7064095b80 2023-09-30T22:16:45.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.893+0000 7f706259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7064062b00 0x7f7064119620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:45.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.893+0000 7f7061d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7064095b80 0x7f70641156d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:45.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.893+0000 7f706259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7064062b00 0x7f7064119620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:35780/0 (socket says 172.21.15.156:35780) 2023-09-30T22:16:45.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.893+0000 7f706259c700 1 -- 172.21.15.156:0/3341956710 learned_addr learned my addr 172.21.15.156:0/3341956710 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:45.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.893+0000 7f7062d9d700 1 --2- 172.21.15.156:0/3341956710 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7064096490 0x7f7064115bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:45.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.893+0000 7f706259c700 1 -- 172.21.15.156:0/3341956710 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7064095b80 msgr2=0x7f70641156d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:45.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.893+0000 7f706259c700 1 --2- 172.21.15.156:0/3341956710 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7064095b80 0x7f70641156d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:45.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.893+0000 7f706259c700 1 -- 172.21.15.156:0/3341956710 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7064096490 msgr2=0x7f7064115bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:45.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.893+0000 7f706259c700 1 --2- 172.21.15.156:0/3341956710 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7064096490 0x7f7064115bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:45.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.893+0000 7f706259c700 1 -- 172.21.15.156:0/3341956710 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70540092a0 con 0x7f7064062b00 2023-09-30T22:16:45.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.893+0000 7f706259c700 1 --2- 172.21.15.156:0/3341956710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7064062b00 0x7f7064119620 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f7064092730 tx=0x7f7058017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:45.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.893+0000 7f70527fc700 1 -- 172.21.15.156:0/3341956710 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7058000bc0 con 0x7f7064062b00 2023-09-30T22:16:45.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.893+0000 7f70527fc700 1 -- 172.21.15.156:0/3341956710 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705800b850 con 0x7f7064062b00 2023-09-30T22:16:45.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.893+0000 7f7068ffc700 1 -- 172.21.15.156:0/3341956710 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7058009370 con 0x7f7064062b00 2023-09-30T22:16:45.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.893+0000 7f70527fc700 1 -- 172.21.15.156:0/3341956710 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7058000d20 con 0x7f7064062b00 2023-09-30T22:16:45.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.893+0000 7f7068ffc700 1 -- 172.21.15.156:0/3341956710 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7064118b80 con 0x7f7064062b00 2023-09-30T22:16:45.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.894+0000 7f70527fc700 1 -- 172.21.15.156:0/3341956710 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f705801ca90 con 0x7f7064062b00 2023-09-30T22:16:45.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.894+0000 7f70527fc700 1 -- 172.21.15.156:0/3341956710 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f705803ce20 con 0x7f7064062b00 2023-09-30T22:16:45.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.894+0000 7f7068ffc700 1 -- 172.21.15.156:0/3341956710 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7064118f40 con 0x7f7064062b00 2023-09-30T22:16:45.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:45.899+0000 7f70527fc700 1 -- 172.21.15.156:0/3341956710 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f7058020020 con 0x7f7064062b00 2023-09-30T22:16:46.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.055+0000 7f7068ffc700 1 -- 172.21.15.156:0/3341956710 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f706405a260 con 0x7f7064062b00 2023-09-30T22:16:46.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.055+0000 7f70527fc700 1 -- 172.21.15.156:0/3341956710 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v16) v1 ==== 104+0+11 (secure 0 0 0) 0x7f705801b3b0 con 0x7f7064062b00 2023-09-30T22:16:46.056 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 32 2023-09-30T22:16:46.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.057+0000 7f7068ffc700 1 -- 172.21.15.156:0/3341956710 >> v1:172.21.15.156:6816/118236 conn(0x7f704402bb60 legacy=0x7f704402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:46.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.057+0000 7f7068ffc700 1 -- 172.21.15.156:0/3341956710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7064062b00 msgr2=0x7f7064119620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:46.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.057+0000 7f7068ffc700 1 --2- 172.21.15.156:0/3341956710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7064062b00 0x7f7064119620 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f7064092730 tx=0x7f7058017000).stop 2023-09-30T22:16:46.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.057+0000 7f7068ffc700 1 -- 172.21.15.156:0/3341956710 shutdown_connections 2023-09-30T22:16:46.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.057+0000 7f7068ffc700 1 --2- 172.21.15.156:0/3341956710 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7064096490 0x7f7064115bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.057+0000 7f7068ffc700 1 --2- 172.21.15.156:0/3341956710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7064062b00 0x7f7064119620 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.057+0000 7f7068ffc700 1 --2- 172.21.15.156:0/3341956710 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7064095b80 0x7f70641156d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.057+0000 7f7068ffc700 1 -- 172.21.15.156:0/3341956710 >> 172.21.15.156:0/3341956710 conn(0x7f706409aa50 msgr2=0x7f706412ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:46.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.057+0000 7f7068ffc700 1 -- 172.21.15.156:0/3341956710 shutdown_connections 2023-09-30T22:16:46.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.057+0000 7f7068ffc700 1 -- 172.21.15.156:0/3341956710 wait complete. 2023-09-30T22:16:46.069 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:16:46.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.187+0000 7ff0f9866700 1 Processor -- start 2023-09-30T22:16:46.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.187+0000 7ff0f9866700 1 -- start start 2023-09-30T22:16:46.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.187+0000 7ff0f9866700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff0f40990f0 0x7ff0f41304c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:46.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.187+0000 7ff0f9866700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0f41309b0 0x7ff0f4132da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:46.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.187+0000 7ff0f9866700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f4095540 con 0x7ff0f4098600 2023-09-30T22:16:46.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.187+0000 7ff0f9866700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f409a410 con 0x7ff0f40990f0 2023-09-30T22:16:46.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.187+0000 7ff0f9866700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f4096510 con 0x7ff0f41309b0 2023-09-30T22:16:46.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.187+0000 7ff0f37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0f41309b0 0x7ff0f4132da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:46.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.187+0000 7ff0f27fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff0f40990f0 0x7ff0f41304c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:46.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.187+0000 7ff0f2ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff0f4098600 0x7ff0f40989e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47408/0 (socket says 172.21.15.156:47408) 2023-09-30T22:16:46.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.188+0000 7ff0f37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0f41309b0 0x7ff0f4132da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:40088/0 (socket says 172.21.15.156:40088) 2023-09-30T22:16:46.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.188+0000 7ff0f2ffd700 1 -- 172.21.15.156:0/3979136718 learned_addr learned my addr 172.21.15.156:0/3979136718 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:46.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.188+0000 7ff0f37fe700 1 -- 172.21.15.156:0/3979136718 >> v2:172.21.15.156:3300/0 conn(0x7ff0f40990f0 msgr2=0x7ff0f41304c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:46.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.188+0000 7ff0f37fe700 1 --2- 172.21.15.156:0/3979136718 >> v2:172.21.15.156:3300/0 conn(0x7ff0f40990f0 0x7ff0f41304c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.188+0000 7ff0f37fe700 1 -- 172.21.15.156:0/3979136718 >> v1:172.21.15.156:6789/0 conn(0x7ff0f4098600 legacy=0x7ff0f40989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:46.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.188+0000 7ff0f37fe700 1 -- 172.21.15.156:0/3979136718 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f4096790 con 0x7ff0f41309b0 2023-09-30T22:16:46.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.188+0000 7ff0f1ffb700 1 -- 172.21.15.156:0/3979136718 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2721501550 0 0) 0x7ff0f4095540 con 0x7ff0f4098600 2023-09-30T22:16:46.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.188+0000 7ff0f27fc700 1 --2- 172.21.15.156:0/3979136718 >> v2:172.21.15.156:3300/0 conn(0x7ff0f40990f0 0x7ff0f41304c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:46.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.188+0000 7ff0f37fe700 1 --2- 172.21.15.156:0/3979136718 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0f41309b0 0x7ff0f4132da0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7ff0ec009e60 tx=0x7ff0ec009780).ready entity=mon.2 client_cookie=95dc5364905eedd0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:46.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.188+0000 7ff0f1ffb700 1 -- 172.21.15.156:0/3979136718 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec00e070 con 0x7ff0f41309b0 2023-09-30T22:16:46.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.188+0000 7ff0f1ffb700 1 -- 172.21.15.156:0/3979136718 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ec00bb60 con 0x7ff0f41309b0 2023-09-30T22:16:46.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.188+0000 7ff0f1ffb700 1 -- 172.21.15.156:0/3979136718 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec012410 con 0x7ff0f41309b0 2023-09-30T22:16:46.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.189+0000 7ff0f9866700 1 -- 172.21.15.156:0/3979136718 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0f41309b0 msgr2=0x7ff0f4132da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:46.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.189+0000 7ff0f9866700 1 --2- 172.21.15.156:0/3979136718 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0f41309b0 0x7ff0f4132da0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7ff0ec009e60 tx=0x7ff0ec009780).stop 2023-09-30T22:16:46.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.189+0000 7ff0f9866700 1 -- 172.21.15.156:0/3979136718 shutdown_connections 2023-09-30T22:16:46.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.189+0000 7ff0f9866700 1 --2- 172.21.15.156:0/3979136718 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0f41309b0 0x7ff0f4132da0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.189+0000 7ff0f9866700 1 --2- 172.21.15.156:0/3979136718 >> v2:172.21.15.156:3300/0 conn(0x7ff0f40990f0 0x7ff0f41304c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.189+0000 7ff0f9866700 1 -- 172.21.15.156:0/3979136718 >> 172.21.15.156:0/3979136718 conn(0x7ff0f409a720 msgr2=0x7ff0f409ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:46.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.189+0000 7ff0f9866700 1 -- 172.21.15.156:0/3979136718 shutdown_connections 2023-09-30T22:16:46.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.189+0000 7ff0f9866700 1 -- 172.21.15.156:0/3979136718 wait complete. 2023-09-30T22:16:46.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.190+0000 7ff0f9866700 1 Processor -- start 2023-09-30T22:16:46.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.190+0000 7ff0f9866700 1 -- start start 2023-09-30T22:16:46.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.190+0000 7ff0f9866700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0f4098600 0x7ff0f411e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:46.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.190+0000 7ff0f9866700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0f40990f0 0x7ff0f411a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:46.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.190+0000 7ff0f9866700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0f41309b0 0x7ff0f411a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:46.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.190+0000 7ff0f9866700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f4130870 con 0x7ff0f41309b0 2023-09-30T22:16:46.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.190+0000 7ff0f9866700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f409a110 con 0x7ff0f4098600 2023-09-30T22:16:46.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.190+0000 7ff0f9866700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f4130300 con 0x7ff0f40990f0 2023-09-30T22:16:46.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.190+0000 7ff0f27fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0f40990f0 0x7ff0f411a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:46.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.190+0000 7ff0f2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0f4098600 0x7ff0f411e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:46.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.190+0000 7ff0f27fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0f40990f0 0x7ff0f411a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:40102/0 (socket says 172.21.15.156:40102) 2023-09-30T22:16:46.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.190+0000 7ff0f37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0f41309b0 0x7ff0f411a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:46.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.190+0000 7ff0f27fc700 1 -- 172.21.15.156:0/1755856715 learned_addr learned my addr 172.21.15.156:0/1755856715 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:46.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.190+0000 7ff0f2ffd700 1 -- 172.21.15.156:0/1755856715 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0f40990f0 msgr2=0x7ff0f411a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:46.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.190+0000 7ff0f2ffd700 1 --2- 172.21.15.156:0/1755856715 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0f40990f0 0x7ff0f411a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.190+0000 7ff0f2ffd700 1 -- 172.21.15.156:0/1755856715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0f41309b0 msgr2=0x7ff0f411a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:46.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.190+0000 7ff0f2ffd700 1 --2- 172.21.15.156:0/1755856715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0f41309b0 0x7ff0f411a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.190+0000 7ff0f2ffd700 1 -- 172.21.15.156:0/1755856715 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e80092a0 con 0x7ff0f4098600 2023-09-30T22:16:46.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.190+0000 7ff0f37fe700 1 --2- 172.21.15.156:0/1755856715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0f41309b0 0x7ff0f411a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:46.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.190+0000 7ff0f27fc700 1 --2- 172.21.15.156:0/1755856715 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0f40990f0 0x7ff0f411a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:46.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.191+0000 7ff0f2ffd700 1 --2- 172.21.15.156:0/1755856715 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0f4098600 0x7ff0f411e180 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7ff0e4000c00 tx=0x7ff0e4007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:46.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.191+0000 7ff0daffd700 1 -- 172.21.15.156:0/1755856715 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e40070d0 con 0x7ff0f4098600 2023-09-30T22:16:46.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.191+0000 7ff0daffd700 1 -- 172.21.15.156:0/1755856715 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e4007250 con 0x7ff0f4098600 2023-09-30T22:16:46.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.191+0000 7ff0f9866700 1 -- 172.21.15.156:0/1755856715 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0ec009a20 con 0x7ff0f4098600 2023-09-30T22:16:46.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.191+0000 7ff0daffd700 1 -- 172.21.15.156:0/1755856715 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4007610 con 0x7ff0f4098600 2023-09-30T22:16:46.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.191+0000 7ff0f9866700 1 -- 172.21.15.156:0/1755856715 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f411d6e0 con 0x7ff0f4098600 2023-09-30T22:16:46.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.191+0000 7ff0daffd700 1 -- 172.21.15.156:0/1755856715 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7ff0e40059b0 con 0x7ff0f4098600 2023-09-30T22:16:46.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.192+0000 7ff0daffd700 1 -- 172.21.15.156:0/1755856715 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7ff0e403a5d0 con 0x7ff0f4098600 2023-09-30T22:16:46.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.192+0000 7ff0f9866700 1 -- 172.21.15.156:0/1755856715 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f405a260 con 0x7ff0f4098600 2023-09-30T22:16:46.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.196+0000 7ff0daffd700 1 -- 172.21.15.156:0/1755856715 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7ff0e4013970 con 0x7ff0f4098600 2023-09-30T22:16:46.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.353+0000 7ff0f9866700 1 -- 172.21.15.156:0/1755856715 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff0f411afe0 con 0x7ff0f4098600 2023-09-30T22:16:46.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.353+0000 7ff0daffd700 1 -- 172.21.15.156:0/1755856715 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v16) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff0e4012e40 con 0x7ff0f4098600 2023-09-30T22:16:46.354 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 64 2023-09-30T22:16:46.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.355+0000 7ff0f9866700 1 -- 172.21.15.156:0/1755856715 >> v1:172.21.15.156:6816/118236 conn(0x7ff0e002bb60 legacy=0x7ff0e002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:46.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.355+0000 7ff0f9866700 1 -- 172.21.15.156:0/1755856715 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0f4098600 msgr2=0x7ff0f411e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:46.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.355+0000 7ff0f9866700 1 --2- 172.21.15.156:0/1755856715 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0f4098600 0x7ff0f411e180 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7ff0e4000c00 tx=0x7ff0e4007b90).stop 2023-09-30T22:16:46.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.356+0000 7ff0f9866700 1 -- 172.21.15.156:0/1755856715 shutdown_connections 2023-09-30T22:16:46.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.356+0000 7ff0f9866700 1 --2- 172.21.15.156:0/1755856715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0f41309b0 0x7ff0f411a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.356+0000 7ff0f9866700 1 --2- 172.21.15.156:0/1755856715 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0f4098600 0x7ff0f411e180 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.356+0000 7ff0f9866700 1 --2- 172.21.15.156:0/1755856715 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0f40990f0 0x7ff0f411a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.356+0000 7ff0f9866700 1 -- 172.21.15.156:0/1755856715 >> 172.21.15.156:0/1755856715 conn(0x7ff0f409a720 msgr2=0x7ff0f409bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:46.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.356+0000 7ff0f9866700 1 -- 172.21.15.156:0/1755856715 shutdown_connections 2023-09-30T22:16:46.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.356+0000 7ff0f9866700 1 -- 172.21.15.156:0/1755856715 wait complete. 2023-09-30T22:16:46.368 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:16:46.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.484+0000 7fce80de1700 1 Processor -- start 2023-09-30T22:16:46.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.484+0000 7fce80de1700 1 -- start start 2023-09-30T22:16:46.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.485+0000 7fce80de1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce7c092190 0x7fce7c1293c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:46.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.485+0000 7fce80de1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce7c12dd40 0x7fce7c130130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:46.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.485+0000 7fce80de1700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce7c093340 con 0x7fce7c05f560 2023-09-30T22:16:46.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.485+0000 7fce80de1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c05f940 con 0x7fce7c12dd40 2023-09-30T22:16:46.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.485+0000 7fce80de1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c097c30 con 0x7fce7c092190 2023-09-30T22:16:46.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.485+0000 7fce79d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce7c092190 0x7fce7c1293c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:46.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.485+0000 7fce7a59c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fce7c05f560 0x7fce7c128cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47412/0 (socket says 172.21.15.156:47412) 2023-09-30T22:16:46.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.485+0000 7fce7a59c700 1 -- 172.21.15.156:0/365450532 learned_addr learned my addr 172.21.15.156:0/365450532 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:46.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.485+0000 7fce7ad9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce7c12dd40 0x7fce7c130130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:46.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.485+0000 7fce7959a700 1 -- 172.21.15.156:0/365450532 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1969168385 0 0) 0x7fce7c093340 con 0x7fce7c05f560 2023-09-30T22:16:46.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.485+0000 7fce7959a700 1 -- 172.21.15.156:0/365450532 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce640033f0 con 0x7fce7c05f560 2023-09-30T22:16:46.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.485+0000 7fce7ad9d700 1 -- 172.21.15.156:0/365450532 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce7c092190 msgr2=0x7fce7c1293c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:46.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.485+0000 7fce7ad9d700 1 --2- 172.21.15.156:0/365450532 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce7c092190 0x7fce7c1293c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.485+0000 7fce7ad9d700 1 -- 172.21.15.156:0/365450532 >> v1:172.21.15.156:6789/0 conn(0x7fce7c05f560 legacy=0x7fce7c128cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:46.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.485+0000 7fce7ad9d700 1 -- 172.21.15.156:0/365450532 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7c0941f0 con 0x7fce7c12dd40 2023-09-30T22:16:46.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.485+0000 7fce79d9b700 1 --2- 172.21.15.156:0/365450532 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce7c092190 0x7fce7c1293c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:46.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.485+0000 7fce7ad9d700 1 --2- 172.21.15.156:0/365450532 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce7c12dd40 0x7fce7c130130 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fce74009ec0 tx=0x7fce74009780).ready entity=mon.1 client_cookie=7a8a52a7344960dc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:46.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.485+0000 7fce7959a700 1 -- 172.21.15.156:0/365450532 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7400e070 con 0x7fce7c12dd40 2023-09-30T22:16:46.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.485+0000 7fce7959a700 1 -- 172.21.15.156:0/365450532 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7400bb40 con 0x7fce7c12dd40 2023-09-30T22:16:46.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.485+0000 7fce7959a700 1 -- 172.21.15.156:0/365450532 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74012410 con 0x7fce7c12dd40 2023-09-30T22:16:46.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.486+0000 7fce80de1700 1 -- 172.21.15.156:0/365450532 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce7c12dd40 msgr2=0x7fce7c130130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:46.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.486+0000 7fce80de1700 1 --2- 172.21.15.156:0/365450532 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce7c12dd40 0x7fce7c130130 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fce74009ec0 tx=0x7fce74009780).stop 2023-09-30T22:16:46.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.486+0000 7fce80de1700 1 -- 172.21.15.156:0/365450532 shutdown_connections 2023-09-30T22:16:46.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.486+0000 7fce80de1700 1 --2- 172.21.15.156:0/365450532 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce7c12dd40 0x7fce7c130130 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.486+0000 7fce80de1700 1 --2- 172.21.15.156:0/365450532 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce7c092190 0x7fce7c1293c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.486+0000 7fce80de1700 1 -- 172.21.15.156:0/365450532 >> 172.21.15.156:0/365450532 conn(0x7fce7c09a1c0 msgr2=0x7fce7c09a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:46.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.486+0000 7fce80de1700 1 -- 172.21.15.156:0/365450532 shutdown_connections 2023-09-30T22:16:46.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.486+0000 7fce80de1700 1 -- 172.21.15.156:0/365450532 wait complete. 2023-09-30T22:16:46.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.487+0000 7fce80de1700 1 Processor -- start 2023-09-30T22:16:46.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.487+0000 7fce80de1700 1 -- start start 2023-09-30T22:16:46.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.488+0000 7fce80de1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce7c05f560 0x7fce7c128400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:46.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.488+0000 7fce80de1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce7c092190 0x7fce7c110820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:46.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.488+0000 7fce80de1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce7c12dd40 0x7fce7c110d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:46.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.488+0000 7fce80de1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c113e70 con 0x7fce7c092190 2023-09-30T22:16:46.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.488+0000 7fce80de1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c1147d0 con 0x7fce7c05f560 2023-09-30T22:16:46.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.488+0000 7fce80de1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c097d80 con 0x7fce7c12dd40 2023-09-30T22:16:46.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.488+0000 7fce7a59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce7c05f560 0x7fce7c128400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:46.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.488+0000 7fce7a59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce7c05f560 0x7fce7c128400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54618/0 (socket says 172.21.15.156:54618) 2023-09-30T22:16:46.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.488+0000 7fce7a59c700 1 -- 172.21.15.156:0/478031971 learned_addr learned my addr 172.21.15.156:0/478031971 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:46.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.488+0000 7fce7ad9d700 1 --2- 172.21.15.156:0/478031971 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce7c12dd40 0x7fce7c110d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:46.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.488+0000 7fce79d9b700 1 --2- 172.21.15.156:0/478031971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce7c092190 0x7fce7c110820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:46.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.488+0000 7fce7a59c700 1 -- 172.21.15.156:0/478031971 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce7c12dd40 msgr2=0x7fce7c110d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:46.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.488+0000 7fce7a59c700 1 --2- 172.21.15.156:0/478031971 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce7c12dd40 0x7fce7c110d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.488+0000 7fce7a59c700 1 -- 172.21.15.156:0/478031971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce7c092190 msgr2=0x7fce7c110820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:46.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.488+0000 7fce7a59c700 1 --2- 172.21.15.156:0/478031971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce7c092190 0x7fce7c110820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.488+0000 7fce7a59c700 1 -- 172.21.15.156:0/478031971 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6c0092a0 con 0x7fce7c05f560 2023-09-30T22:16:46.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.488+0000 7fce7a59c700 1 --2- 172.21.15.156:0/478031971 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce7c05f560 0x7fce7c128400 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fce7000c5c0 tx=0x7fce70007c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:46.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.488+0000 7fce6a7fc700 1 -- 172.21.15.156:0/478031971 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce700072e0 con 0x7fce7c05f560 2023-09-30T22:16:46.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.488+0000 7fce6a7fc700 1 -- 172.21.15.156:0/478031971 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce70007440 con 0x7fce7c05f560 2023-09-30T22:16:46.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.488+0000 7fce6a7fc700 1 -- 172.21.15.156:0/478031971 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce700057a0 con 0x7fce7c05f560 2023-09-30T22:16:46.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.488+0000 7fce80de1700 1 -- 172.21.15.156:0/478031971 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce74009a20 con 0x7fce7c05f560 2023-09-30T22:16:46.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.488+0000 7fce80de1700 1 -- 172.21.15.156:0/478031971 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7c113860 con 0x7fce7c05f560 2023-09-30T22:16:46.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.489+0000 7fce80de1700 1 -- 172.21.15.156:0/478031971 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce7c093560 con 0x7fce7c05f560 2023-09-30T22:16:46.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.490+0000 7fce6a7fc700 1 -- 172.21.15.156:0/478031971 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fce70005bd0 con 0x7fce7c05f560 2023-09-30T22:16:46.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.490+0000 7fce6a7fc700 1 -- 172.21.15.156:0/478031971 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fce7003a8a0 con 0x7fce7c05f560 2023-09-30T22:16:46.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.494+0000 7fce6a7fc700 1 -- 172.21.15.156:0/478031971 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fce7001b710 con 0x7fce7c05f560 2023-09-30T22:16:46.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.688+0000 7fce80de1700 1 -- 172.21.15.156:0/478031971 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce7c113cb0 con 0x7fce7c05f560 2023-09-30T22:16:46.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.688+0000 7fce6a7fc700 1 -- 172.21.15.156:0/478031971 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2158 (secure 0 0 0) 0x7fce70022030 con 0x7fce7c05f560 2023-09-30T22:16:46.689 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:46.689 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:16:29.792703+0000","modified":"2023-09-30T22:16:31.992241+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4206},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4206":{"gid":4206,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6817/3817969673","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6817","nonce":3817969673}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:16:46.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.690+0000 7fce80de1700 1 -- 172.21.15.156:0/478031971 >> v1:172.21.15.156:6816/118236 conn(0x7fce5c02bb60 legacy=0x7fce5c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:46.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.690+0000 7fce80de1700 1 -- 172.21.15.156:0/478031971 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce7c05f560 msgr2=0x7fce7c128400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:46.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.690+0000 7fce80de1700 1 --2- 172.21.15.156:0/478031971 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce7c05f560 0x7fce7c128400 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fce7000c5c0 tx=0x7fce70007c80).stop 2023-09-30T22:16:46.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.690+0000 7fce80de1700 1 -- 172.21.15.156:0/478031971 shutdown_connections 2023-09-30T22:16:46.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.690+0000 7fce80de1700 1 --2- 172.21.15.156:0/478031971 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce7c12dd40 0x7fce7c110d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.690+0000 7fce80de1700 1 --2- 172.21.15.156:0/478031971 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce7c05f560 0x7fce7c128400 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.690+0000 7fce80de1700 1 --2- 172.21.15.156:0/478031971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce7c092190 0x7fce7c110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.690+0000 7fce80de1700 1 -- 172.21.15.156:0/478031971 >> 172.21.15.156:0/478031971 conn(0x7fce7c09a1c0 msgr2=0x7fce7c12fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:46.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.690+0000 7fce80de1700 1 -- 172.21.15.156:0/478031971 shutdown_connections 2023-09-30T22:16:46.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.690+0000 7fce80de1700 1 -- 172.21.15.156:0/478031971 wait complete. 2023-09-30T22:16:46.692 INFO:teuthology.orchestra.run.smithi156.stderr:dumped fsmap epoch 5 2023-09-30T22:16:46.702 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:16:46.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.818+0000 7f6d28418700 1 Processor -- start 2023-09-30T22:16:46.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.818+0000 7f6d28418700 1 -- start start 2023-09-30T22:16:46.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.819+0000 7f6d28418700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d20062b00 0x7f6d20095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:46.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.819+0000 7f6d28418700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6d20095b80 0x7f6d20095fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:46.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.819+0000 7f6d28418700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d20096490 0x7f6d20131280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:46.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.819+0000 7f6d28418700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d200973f0 con 0x7f6d20095b80 2023-09-30T22:16:46.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.819+0000 7f6d28418700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d20062ee0 con 0x7f6d20096490 2023-09-30T22:16:46.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.819+0000 7f6d28418700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d20091980 con 0x7f6d20062b00 2023-09-30T22:16:46.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.819+0000 7f6d261b4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d20062b00 0x7f6d20095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:46.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.819+0000 7f6d269b5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d20096490 0x7f6d20131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:46.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.819+0000 7f6d259b3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6d20095b80 0x7f6d20095fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:46.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.819+0000 7f6d269b5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d20096490 0x7f6d20131280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54630/0 (socket says 172.21.15.156:54630) 2023-09-30T22:16:46.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.819+0000 7f6d259b3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6d20095b80 0x7f6d20095fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:35800/0 (socket says 172.21.15.156:35800) 2023-09-30T22:16:46.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.819+0000 7f6d261b4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d20062b00 0x7f6d20095690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:40132/0 (socket says 172.21.15.156:40132) 2023-09-30T22:16:46.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.819+0000 7f6d259b3700 1 -- 172.21.15.156:0/451809789 learned_addr learned my addr 172.21.15.156:0/451809789 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:46.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.819+0000 7f6d259b3700 1 -- 172.21.15.156:0/451809789 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d20062b00 msgr2=0x7f6d20095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:46.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.819+0000 7f6d259b3700 1 --2- 172.21.15.156:0/451809789 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d20062b00 0x7f6d20095690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.819+0000 7f6d259b3700 1 -- 172.21.15.156:0/451809789 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d20096490 msgr2=0x7f6d20131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:46.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.819+0000 7f6d259b3700 1 --2- 172.21.15.156:0/451809789 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d20096490 0x7f6d20131280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.819+0000 7f6d259b3700 1 -- 172.21.15.156:0/451809789 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d20092310 con 0x7f6d20095b80 2023-09-30T22:16:46.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.819+0000 7f6d261b4700 1 --2- 172.21.15.156:0/451809789 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d20062b00 0x7f6d20095690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:46.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.819+0000 7f6d269b5700 1 --2- 172.21.15.156:0/451809789 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d20096490 0x7f6d20131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:46.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.819+0000 7f6d259b3700 1 --2- 172.21.15.156:0/451809789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d20095b80 0x7f6d20095fa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f6d1c009830 tx=0x7f6d1c0090f0).ready entity=mon.0 client_cookie=265af0fe1f9c4e10 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:46.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.819+0000 7f6d251b2700 1 -- 172.21.15.156:0/451809789 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c00f510 con 0x7f6d20095b80 2023-09-30T22:16:46.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.819+0000 7f6d251b2700 1 -- 172.21.15.156:0/451809789 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1c00f670 con 0x7f6d20095b80 2023-09-30T22:16:46.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.819+0000 7f6d251b2700 1 -- 172.21.15.156:0/451809789 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c00f9f0 con 0x7f6d20095b80 2023-09-30T22:16:46.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.820+0000 7f6d28418700 1 -- 172.21.15.156:0/451809789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d20095b80 msgr2=0x7f6d20095fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:46.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.820+0000 7f6d28418700 1 --2- 172.21.15.156:0/451809789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d20095b80 0x7f6d20095fa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f6d1c009830 tx=0x7f6d1c0090f0).stop 2023-09-30T22:16:46.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.820+0000 7f6d28418700 1 -- 172.21.15.156:0/451809789 shutdown_connections 2023-09-30T22:16:46.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.820+0000 7f6d28418700 1 --2- 172.21.15.156:0/451809789 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d20096490 0x7f6d20131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.820+0000 7f6d28418700 1 --2- 172.21.15.156:0/451809789 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d20062b00 0x7f6d20095690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.820+0000 7f6d28418700 1 --2- 172.21.15.156:0/451809789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d20095b80 0x7f6d20095fa0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.820+0000 7f6d28418700 1 -- 172.21.15.156:0/451809789 >> 172.21.15.156:0/451809789 conn(0x7f6d2009aa50 msgr2=0x7f6d2009ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:46.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.820+0000 7f6d28418700 1 -- 172.21.15.156:0/451809789 shutdown_connections 2023-09-30T22:16:46.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.820+0000 7f6d28418700 1 -- 172.21.15.156:0/451809789 wait complete. 2023-09-30T22:16:46.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.821+0000 7f6d28418700 1 Processor -- start 2023-09-30T22:16:46.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.821+0000 7f6d28418700 1 -- start start 2023-09-30T22:16:46.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.822+0000 7f6d28418700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d20062b00 0x7f6d20116b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:46.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.822+0000 7f6d28418700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d20095b80 0x7f6d20117000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:46.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.822+0000 7f6d28418700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d20096490 0x7f6d201174f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:46.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.822+0000 7f6d28418700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d201179e0 con 0x7f6d20062b00 2023-09-30T22:16:46.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.822+0000 7f6d28418700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d20119ba0 con 0x7f6d20096490 2023-09-30T22:16:46.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.822+0000 7f6d28418700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d20096da0 con 0x7f6d20095b80 2023-09-30T22:16:46.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.822+0000 7f6d259b3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d20095b80 0x7f6d20117000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:46.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.822+0000 7f6d259b3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d20095b80 0x7f6d20117000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:40138/0 (socket says 172.21.15.156:40138) 2023-09-30T22:16:46.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.822+0000 7f6d261b4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d20062b00 0x7f6d20116b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:46.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.822+0000 7f6d259b3700 1 -- 172.21.15.156:0/3553190048 learned_addr learned my addr 172.21.15.156:0/3553190048 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:46.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.822+0000 7f6d269b5700 1 --2- 172.21.15.156:0/3553190048 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d20096490 0x7f6d201174f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:46.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.822+0000 7f6d259b3700 1 -- 172.21.15.156:0/3553190048 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d20096490 msgr2=0x7f6d201174f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:46.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.822+0000 7f6d259b3700 1 --2- 172.21.15.156:0/3553190048 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d20096490 0x7f6d201174f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.822+0000 7f6d259b3700 1 -- 172.21.15.156:0/3553190048 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d20062b00 msgr2=0x7f6d20116b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:46.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.822+0000 7f6d259b3700 1 --2- 172.21.15.156:0/3553190048 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d20062b00 0x7f6d20116b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.822+0000 7f6d259b3700 1 -- 172.21.15.156:0/3553190048 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d100092a0 con 0x7f6d20095b80 2023-09-30T22:16:46.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.822+0000 7f6d261b4700 1 --2- 172.21.15.156:0/3553190048 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d20062b00 0x7f6d20116b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:46.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.822+0000 7f6d259b3700 1 --2- 172.21.15.156:0/3553190048 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d20095b80 0x7f6d20117000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f6d1c011000 tx=0x7f6d1c015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:46.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.823+0000 7f6d167fc700 1 -- 172.21.15.156:0/3553190048 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c006a40 con 0x7f6d20095b80 2023-09-30T22:16:46.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.823+0000 7f6d167fc700 1 -- 172.21.15.156:0/3553190048 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1c00f7e0 con 0x7f6d20095b80 2023-09-30T22:16:46.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.823+0000 7f6d28418700 1 -- 172.21.15.156:0/3553190048 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d18009a20 con 0x7f6d20095b80 2023-09-30T22:16:46.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.823+0000 7f6d167fc700 1 -- 172.21.15.156:0/3553190048 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c01c670 con 0x7f6d20095b80 2023-09-30T22:16:46.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.823+0000 7f6d28418700 1 -- 172.21.15.156:0/3553190048 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d1c009370 con 0x7f6d20095b80 2023-09-30T22:16:46.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.823+0000 7f6d167fc700 1 -- 172.21.15.156:0/3553190048 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f6d1c01ca60 con 0x7f6d20095b80 2023-09-30T22:16:46.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.823+0000 7f6d167fc700 1 -- 172.21.15.156:0/3553190048 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f6d1c03c580 con 0x7f6d20095b80 2023-09-30T22:16:46.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.824+0000 7f6d28418700 1 -- 172.21.15.156:0/3553190048 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d20119dd0 con 0x7f6d20095b80 2023-09-30T22:16:46.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.828+0000 7f6d167fc700 1 -- 172.21.15.156:0/3553190048 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f6d1c01a3d0 con 0x7f6d20095b80 2023-09-30T22:16:46.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.988+0000 7f6d28418700 1 -- 172.21.15.156:0/3553190048 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d2005a260 con 0x7f6d20095b80 2023-09-30T22:16:46.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.989+0000 7f6d167fc700 1 -- 172.21.15.156:0/3553190048 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11373 (secure 0 0 0) 0x7f6d1c020020 con 0x7f6d20095b80 2023-09-30T22:16:46.989 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:46.990 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":16,"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","created":"2023-09-30T22:16:15.239992+0000","modified":"2023-09-30T22:16:30.794031+0000","last_up_change":"2023-09-30T22:16:23.392557+0000","last_in_change":"2023-09-30T22:16:16.474206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:16:23.433906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:16:24.367795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:16:28.204677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:16:28.762804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3ec2e78a-c61f-473a-bfcb-f956cffe4095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6812","nonce":118781}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6813","nonce":118781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6815","nonce":118781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6814","nonce":118781}]},"public_addr":"172.21.15.156:6812/118781","cluster_addr":"172.21.15.156:6813/118781","heartbeat_back_addr":"172.21.15.156:6815/118781","heartbeat_front_addr":"172.21.15.156:6814/118781","state":["exists","up"]},{"osd":1,"uuid":"b682e683-c15a-4bd9-8712-8af96454e9ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6803","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6805","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6807","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6806","nonce":118763}]},"public_addr":"172.21.15.156:6803/118763","cluster_addr":"172.21.15.156:6805/118763","heartbeat_back_addr":"172.21.15.156:6807/118763","heartbeat_front_addr":"172.21.15.156:6806/118763","state":["exists","up"]},{"osd":2,"uuid":"960dbaf0-2e0c-437e-9114-bc22ce522b26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6808","nonce":118788}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6809","nonce":118788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6811","nonce":118788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6810","nonce":118788}]},"public_addr":"172.21.15.156:6808/118788","cluster_addr":"172.21.15.156:6809/118788","heartbeat_back_addr":"172.21.15.156:6811/118788","heartbeat_front_addr":"172.21.15.156:6810/118788","state":["exists","up"]},{"osd":3,"uuid":"c1b19714-78b1-4869-8721-2f6352a64a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6800","nonce":118764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6801","nonce":118764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6804","nonce":118764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6802","nonce":118764}]},"public_addr":"172.21.15.156:6800/118764","cluster_addr":"172.21.15.156:6801/118764","heartbeat_back_addr":"172.21.15.156:6804/118764","heartbeat_front_addr":"172.21.15.156:6802/118764","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.663343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.827397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.806655+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.634746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:16:46.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.991+0000 7f6d28418700 1 -- 172.21.15.156:0/3553190048 >> v1:172.21.15.156:6816/118236 conn(0x7f6d0402bb30 legacy=0x7f6d0402dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:46.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.991+0000 7f6d28418700 1 -- 172.21.15.156:0/3553190048 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d20095b80 msgr2=0x7f6d20117000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:46.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.991+0000 7f6d28418700 1 --2- 172.21.15.156:0/3553190048 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d20095b80 0x7f6d20117000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f6d1c011000 tx=0x7f6d1c015000).stop 2023-09-30T22:16:46.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.991+0000 7f6d28418700 1 -- 172.21.15.156:0/3553190048 shutdown_connections 2023-09-30T22:16:46.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.991+0000 7f6d28418700 1 --2- 172.21.15.156:0/3553190048 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d20096490 0x7f6d201174f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.991+0000 7f6d28418700 1 --2- 172.21.15.156:0/3553190048 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d20062b00 0x7f6d20116b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.991+0000 7f6d28418700 1 --2- 172.21.15.156:0/3553190048 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d20095b80 0x7f6d20117000 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:46.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.991+0000 7f6d28418700 1 -- 172.21.15.156:0/3553190048 >> 172.21.15.156:0/3553190048 conn(0x7f6d2009aa50 msgr2=0x7f6d201300e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:46.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.991+0000 7f6d28418700 1 -- 172.21.15.156:0/3553190048 shutdown_connections 2023-09-30T22:16:46.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:46.991+0000 7f6d28418700 1 -- 172.21.15.156:0/3553190048 wait complete. 2023-09-30T22:16:47.003 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:16:47.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.120+0000 7fbe76abd700 1 Processor -- start 2023-09-30T22:16:47.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.120+0000 7fbe76abd700 1 -- start start 2023-09-30T22:16:47.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.121+0000 7fbe76abd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbe70092390 0x7fbe70097aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:47.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.121+0000 7fbe76abd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe70123a90 0x7fbe70123f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:47.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.121+0000 7fbe76abd700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe70068c10 con 0x7fbe70126fe0 2023-09-30T22:16:47.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.121+0000 7fbe76abd700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe70092770 con 0x7fbe70092390 2023-09-30T22:16:47.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.121+0000 7fbe76abd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe70069550 con 0x7fbe70123a90 2023-09-30T22:16:47.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.121+0000 7fbe6ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe70123a90 0x7fbe70123f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:47.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.121+0000 7fbe74859700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbe70092390 0x7fbe70097aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:47.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.121+0000 7fbe6ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe70123a90 0x7fbe70123f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:40142/0 (socket says 172.21.15.156:40142) 2023-09-30T22:16:47.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.121+0000 7fbe74859700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbe70092390 0x7fbe70097aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:35812/0 (socket says 172.21.15.156:35812) 2023-09-30T22:16:47.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.121+0000 7fbe6ffff700 1 -- 172.21.15.156:0/3978604776 learned_addr learned my addr 172.21.15.156:0/3978604776 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:47.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.121+0000 7fbe7505a700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fbe70126fe0 0x7fbe70127490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47428/0 (socket says 172.21.15.156:47428) 2023-09-30T22:16:47.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.121+0000 7fbe6ffff700 1 -- 172.21.15.156:0/3978604776 >> v2:172.21.15.156:3300/0 conn(0x7fbe70092390 msgr2=0x7fbe70097aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:47.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.121+0000 7fbe6ffff700 1 --2- 172.21.15.156:0/3978604776 >> v2:172.21.15.156:3300/0 conn(0x7fbe70092390 0x7fbe70097aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.121+0000 7fbe6ffff700 1 -- 172.21.15.156:0/3978604776 >> v1:172.21.15.156:6789/0 conn(0x7fbe70126fe0 legacy=0x7fbe70127490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:47.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.122+0000 7fbe6ffff700 1 -- 172.21.15.156:0/3978604776 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe70124550 con 0x7fbe70123a90 2023-09-30T22:16:47.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.122+0000 7fbe74859700 1 --2- 172.21.15.156:0/3978604776 >> v2:172.21.15.156:3300/0 conn(0x7fbe70092390 0x7fbe70097aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:47.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.122+0000 7fbe6ffff700 1 --2- 172.21.15.156:0/3978604776 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe70123a90 0x7fbe70123f10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fbe58006fd0 tx=0x7fbe580090f0).ready entity=mon.2 client_cookie=e6a1f5c70b999f3b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:47.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.122+0000 7fbe6f7fe700 1 -- 172.21.15.156:0/3978604776 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5800b580 con 0x7fbe70123a90 2023-09-30T22:16:47.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.122+0000 7fbe6f7fe700 1 -- 172.21.15.156:0/3978604776 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5800b6e0 con 0x7fbe70123a90 2023-09-30T22:16:47.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.122+0000 7fbe6f7fe700 1 -- 172.21.15.156:0/3978604776 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5800ba60 con 0x7fbe70123a90 2023-09-30T22:16:47.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.122+0000 7fbe76abd700 1 -- 172.21.15.156:0/3978604776 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe70123a90 msgr2=0x7fbe70123f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:47.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.122+0000 7fbe76abd700 1 --2- 172.21.15.156:0/3978604776 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe70123a90 0x7fbe70123f10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fbe58006fd0 tx=0x7fbe580090f0).stop 2023-09-30T22:16:47.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.122+0000 7fbe76abd700 1 -- 172.21.15.156:0/3978604776 shutdown_connections 2023-09-30T22:16:47.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.122+0000 7fbe76abd700 1 --2- 172.21.15.156:0/3978604776 >> v2:172.21.15.156:3300/0 conn(0x7fbe70092390 0x7fbe70097aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.122+0000 7fbe76abd700 1 --2- 172.21.15.156:0/3978604776 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe70123a90 0x7fbe70123f10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.122+0000 7fbe76abd700 1 -- 172.21.15.156:0/3978604776 >> 172.21.15.156:0/3978604776 conn(0x7fbe7009a230 msgr2=0x7fbe7009a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:47.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.122+0000 7fbe76abd700 1 -- 172.21.15.156:0/3978604776 shutdown_connections 2023-09-30T22:16:47.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.122+0000 7fbe76abd700 1 -- 172.21.15.156:0/3978604776 wait complete. 2023-09-30T22:16:47.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.123+0000 7fbe76abd700 1 Processor -- start 2023-09-30T22:16:47.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.123+0000 7fbe76abd700 1 -- start start 2023-09-30T22:16:47.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.124+0000 7fbe76abd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe70092390 0x7fbe70096e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:47.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.124+0000 7fbe76abd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe70123a90 0x7fbe70115130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:47.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.124+0000 7fbe76abd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe70126fe0 0x7fbe70115620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:47.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.124+0000 7fbe76abd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe70097a30 con 0x7fbe70123a90 2023-09-30T22:16:47.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.124+0000 7fbe76abd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe700697f0 con 0x7fbe70092390 2023-09-30T22:16:47.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.124+0000 7fbe76abd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe701183e0 con 0x7fbe70126fe0 2023-09-30T22:16:47.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.124+0000 7fbe74859700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe70092390 0x7fbe70096e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:47.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.124+0000 7fbe6ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe70123a90 0x7fbe70115130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:47.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.124+0000 7fbe6ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe70123a90 0x7fbe70115130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:35826/0 (socket says 172.21.15.156:35826) 2023-09-30T22:16:47.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.124+0000 7fbe74859700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe70092390 0x7fbe70096e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54646/0 (socket says 172.21.15.156:54646) 2023-09-30T22:16:47.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.124+0000 7fbe6ffff700 1 -- 172.21.15.156:0/1360982179 learned_addr learned my addr 172.21.15.156:0/1360982179 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:47.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.124+0000 7fbe7505a700 1 --2- 172.21.15.156:0/1360982179 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe70126fe0 0x7fbe70115620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:47.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.124+0000 7fbe6ffff700 1 -- 172.21.15.156:0/1360982179 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe70126fe0 msgr2=0x7fbe70115620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:47.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.124+0000 7fbe6ffff700 1 --2- 172.21.15.156:0/1360982179 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe70126fe0 0x7fbe70115620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.124+0000 7fbe6ffff700 1 -- 172.21.15.156:0/1360982179 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe70092390 msgr2=0x7fbe70096e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:47.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.124+0000 7fbe6ffff700 1 --2- 172.21.15.156:0/1360982179 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe70092390 0x7fbe70096e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.124+0000 7fbe6ffff700 1 -- 172.21.15.156:0/1360982179 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6800bc30 con 0x7fbe70123a90 2023-09-30T22:16:47.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.124+0000 7fbe74859700 1 --2- 172.21.15.156:0/1360982179 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe70092390 0x7fbe70096e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:47.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.124+0000 7fbe6ffff700 1 --2- 172.21.15.156:0/1360982179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe70123a90 0x7fbe70115130 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fbe58009130 tx=0x7fbe58017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:47.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.124+0000 7fbe6cff9700 1 -- 172.21.15.156:0/1360982179 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe58000bc0 con 0x7fbe70123a90 2023-09-30T22:16:47.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.124+0000 7fbe6cff9700 1 -- 172.21.15.156:0/1360982179 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5800b850 con 0x7fbe70123a90 2023-09-30T22:16:47.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.124+0000 7fbe6cff9700 1 -- 172.21.15.156:0/1360982179 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe58000d20 con 0x7fbe70123a90 2023-09-30T22:16:47.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.124+0000 7fbe76abd700 1 -- 172.21.15.156:0/1360982179 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe58009370 con 0x7fbe70123a90 2023-09-30T22:16:47.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.125+0000 7fbe76abd700 1 -- 172.21.15.156:0/1360982179 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe70114ca0 con 0x7fbe70123a90 2023-09-30T22:16:47.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.125+0000 7fbe76abd700 1 -- 172.21.15.156:0/1360982179 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe70117930 con 0x7fbe70123a90 2023-09-30T22:16:47.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.126+0000 7fbe6cff9700 1 -- 172.21.15.156:0/1360982179 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fbe5801cab0 con 0x7fbe70123a90 2023-09-30T22:16:47.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.126+0000 7fbe6cff9700 1 -- 172.21.15.156:0/1360982179 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fbe5803d240 con 0x7fbe70123a90 2023-09-30T22:16:47.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.130+0000 7fbe6cff9700 1 -- 172.21.15.156:0/1360982179 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fbe58006a40 con 0x7fbe70123a90 2023-09-30T22:16:47.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.324+0000 7fbe76abd700 1 -- 172.21.15.156:0/1360982179 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe70114ec0 con 0x7fbe70123a90 2023-09-30T22:16:47.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.324+0000 7fbe6cff9700 1 -- 172.21.15.156:0/1360982179 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2158 (secure 0 0 0) 0x7fbe5802a030 con 0x7fbe70123a90 2023-09-30T22:16:47.325 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:47.325 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:16:29.792703+0000","modified":"2023-09-30T22:16:31.992241+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4206},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4206":{"gid":4206,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6817/3817969673","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6817","nonce":3817969673}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:16:47.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.326+0000 7fbe76abd700 1 -- 172.21.15.156:0/1360982179 >> v1:172.21.15.156:6816/118236 conn(0x7fbe5002bb60 legacy=0x7fbe5002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:47.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.326+0000 7fbe76abd700 1 -- 172.21.15.156:0/1360982179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe70123a90 msgr2=0x7fbe70115130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:47.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.326+0000 7fbe76abd700 1 --2- 172.21.15.156:0/1360982179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe70123a90 0x7fbe70115130 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fbe58009130 tx=0x7fbe58017000).stop 2023-09-30T22:16:47.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.326+0000 7fbe76abd700 1 -- 172.21.15.156:0/1360982179 shutdown_connections 2023-09-30T22:16:47.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.326+0000 7fbe76abd700 1 --2- 172.21.15.156:0/1360982179 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe70126fe0 0x7fbe70115620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.326+0000 7fbe76abd700 1 --2- 172.21.15.156:0/1360982179 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe70092390 0x7fbe70096e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.326+0000 7fbe76abd700 1 --2- 172.21.15.156:0/1360982179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe70123a90 0x7fbe70115130 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.326+0000 7fbe76abd700 1 -- 172.21.15.156:0/1360982179 >> 172.21.15.156:0/1360982179 conn(0x7fbe7009a230 msgr2=0x7fbe70066cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:47.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.326+0000 7fbe76abd700 1 -- 172.21.15.156:0/1360982179 shutdown_connections 2023-09-30T22:16:47.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.326+0000 7fbe76abd700 1 -- 172.21.15.156:0/1360982179 wait complete. 2023-09-30T22:16:47.328 INFO:teuthology.orchestra.run.smithi156.stderr:dumped fsmap epoch 5 2023-09-30T22:16:47.439 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T22:16:29.792703+0000', 'modified': '2023-09-30T22:16:31.992241+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4206}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4206': {'gid': 4206, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.156:6817/3817969673', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.156:6817', 'nonce': 3817969673}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-09-30T22:16:47.439 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T22:16:47.440 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-09-30T22:16:47.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.556+0000 7f103a306700 1 Processor -- start 2023-09-30T22:16:47.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.556+0000 7f103a306700 1 -- start start 2023-09-30T22:16:47.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.557+0000 7f103a306700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f103405f560 0x7f103412ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:47.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.557+0000 7f103a306700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f103412b370 0x7f1034095d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:47.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.557+0000 7f103a306700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1034066f90 con 0x7f103412b790 2023-09-30T22:16:47.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.557+0000 7f103a306700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f103405f940 con 0x7f103412b370 2023-09-30T22:16:47.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.557+0000 7f103a306700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1034067650 con 0x7f103405f560 2023-09-30T22:16:47.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.557+0000 7f10337fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f103412b370 0x7f1034095d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:47.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.557+0000 7f1033fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f103405f560 0x7f103412ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:47.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.557+0000 7f10388a3700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f103412b790 0x7f1034096280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47444/0 (socket says 172.21.15.156:47444) 2023-09-30T22:16:47.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.557+0000 7f1033fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f103405f560 0x7f103412ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:40154/0 (socket says 172.21.15.156:40154) 2023-09-30T22:16:47.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.557+0000 7f10388a3700 1 -- 172.21.15.156:0/4153240872 learned_addr learned my addr 172.21.15.156:0/4153240872 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:47.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.557+0000 7f10337fe700 1 -- 172.21.15.156:0/4153240872 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f103405f560 msgr2=0x7f103412ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:47.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.557+0000 7f10337fe700 1 --2- 172.21.15.156:0/4153240872 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f103405f560 0x7f103412ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.557+0000 7f10337fe700 1 -- 172.21.15.156:0/4153240872 >> v1:172.21.15.156:6789/0 conn(0x7f103412b790 legacy=0x7f1034096280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:47.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.557+0000 7f1032ffd700 1 -- 172.21.15.156:0/4153240872 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170082863 0 0) 0x7f1034066f90 con 0x7f103412b790 2023-09-30T22:16:47.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.557+0000 7f10337fe700 1 -- 172.21.15.156:0/4153240872 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1034067910 con 0x7f103412b370 2023-09-30T22:16:47.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.557+0000 7f1033fff700 1 --2- 172.21.15.156:0/4153240872 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f103405f560 0x7f103412ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:47.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.557+0000 7f10337fe700 1 --2- 172.21.15.156:0/4153240872 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f103412b370 0x7f1034095d90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f1024009790 tx=0x7f1024009060).ready entity=mon.1 client_cookie=d8f94592c6abc48b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:47.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.557+0000 7f1032ffd700 1 -- 172.21.15.156:0/4153240872 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102400f510 con 0x7f103412b370 2023-09-30T22:16:47.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.557+0000 7f1032ffd700 1 -- 172.21.15.156:0/4153240872 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102400f670 con 0x7f103412b370 2023-09-30T22:16:47.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.558+0000 7f1032ffd700 1 -- 172.21.15.156:0/4153240872 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102400f9f0 con 0x7f103412b370 2023-09-30T22:16:47.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.558+0000 7f103a306700 1 -- 172.21.15.156:0/4153240872 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f103412b370 msgr2=0x7f1034095d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:47.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.558+0000 7f103a306700 1 --2- 172.21.15.156:0/4153240872 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f103412b370 0x7f1034095d90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f1024009790 tx=0x7f1024009060).stop 2023-09-30T22:16:47.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.558+0000 7f103a306700 1 -- 172.21.15.156:0/4153240872 shutdown_connections 2023-09-30T22:16:47.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.558+0000 7f103a306700 1 --2- 172.21.15.156:0/4153240872 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f103405f560 0x7f103412ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.558+0000 7f103a306700 1 --2- 172.21.15.156:0/4153240872 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f103412b370 0x7f1034095d90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.558+0000 7f103a306700 1 -- 172.21.15.156:0/4153240872 >> 172.21.15.156:0/4153240872 conn(0x7f103409a1c0 msgr2=0x7f103409a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:47.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.558+0000 7f103a306700 1 -- 172.21.15.156:0/4153240872 shutdown_connections 2023-09-30T22:16:47.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.558+0000 7f103a306700 1 -- 172.21.15.156:0/4153240872 wait complete. 2023-09-30T22:16:47.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.559+0000 7f103a306700 1 Processor -- start 2023-09-30T22:16:47.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.559+0000 7f103a306700 1 -- start start 2023-09-30T22:16:47.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.559+0000 7f103a306700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f103405f560 0x7f103413a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:47.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.559+0000 7f103a306700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f103412b370 0x7f103413a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:47.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.559+0000 7f103a306700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f103412b790 0x7f103413ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:47.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.559+0000 7f103a306700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103413b0f0 con 0x7f103412b370 2023-09-30T22:16:47.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.559+0000 7f103a306700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1034118860 con 0x7f103412b790 2023-09-30T22:16:47.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.559+0000 7f103a306700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10341292d0 con 0x7f103405f560 2023-09-30T22:16:47.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.559+0000 7f1033fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f103405f560 0x7f103413a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:47.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.560+0000 7f10337fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f103412b370 0x7f103413a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:47.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.560+0000 7f1033fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f103405f560 0x7f103413a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:40164/0 (socket says 172.21.15.156:40164) 2023-09-30T22:16:47.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.560+0000 7f1033fff700 1 -- 172.21.15.156:0/1947898503 learned_addr learned my addr 172.21.15.156:0/1947898503 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:47.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.560+0000 7f10388a3700 1 --2- 172.21.15.156:0/1947898503 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f103412b790 0x7f103413ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:47.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.560+0000 7f10337fe700 1 -- 172.21.15.156:0/1947898503 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f103405f560 msgr2=0x7f103413a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:47.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.560+0000 7f10337fe700 1 --2- 172.21.15.156:0/1947898503 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f103405f560 0x7f103413a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.560+0000 7f10337fe700 1 -- 172.21.15.156:0/1947898503 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f103412b790 msgr2=0x7f103413ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:47.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.560+0000 7f10337fe700 1 --2- 172.21.15.156:0/1947898503 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f103412b790 0x7f103413ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.560+0000 7f10337fe700 1 -- 172.21.15.156:0/1947898503 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10280092a0 con 0x7f103412b370 2023-09-30T22:16:47.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.560+0000 7f1033fff700 1 --2- 172.21.15.156:0/1947898503 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f103405f560 0x7f103413a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:47.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.560+0000 7f10337fe700 1 --2- 172.21.15.156:0/1947898503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f103412b370 0x7f103413a710 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f1024014000 tx=0x7f1024017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:47.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.560+0000 7f101bfff700 1 -- 172.21.15.156:0/1947898503 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102400f7e0 con 0x7f103412b370 2023-09-30T22:16:47.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.560+0000 7f101bfff700 1 -- 172.21.15.156:0/1947898503 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102400f940 con 0x7f103412b370 2023-09-30T22:16:47.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.560+0000 7f103a306700 1 -- 172.21.15.156:0/1947898503 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10240092a0 con 0x7f103412b370 2023-09-30T22:16:47.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.560+0000 7f101bfff700 1 -- 172.21.15.156:0/1947898503 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102401b640 con 0x7f103412b370 2023-09-30T22:16:47.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.560+0000 7f103a306700 1 -- 172.21.15.156:0/1947898503 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1034118ed0 con 0x7f103412b370 2023-09-30T22:16:47.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.561+0000 7f101bfff700 1 -- 172.21.15.156:0/1947898503 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f102401ba70 con 0x7f103412b370 2023-09-30T22:16:47.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.561+0000 7f101bfff700 1 -- 172.21.15.156:0/1947898503 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f102403c940 con 0x7f103412b370 2023-09-30T22:16:47.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.563+0000 7f104bcb9b80 1 Processor -- start 2023-09-30T22:16:47.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.564+0000 7f104bcb9b80 1 -- start start 2023-09-30T22:16:47.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.564+0000 7f104bcb9b80 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55848863c170 0x55848863c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:47.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.564+0000 7f104bcb9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55848863ca40 0x5584886660c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:47.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.564+0000 7f104bcb9b80 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584886665b0 0x5584886689a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:47.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.564+0000 7f104bcb9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558488606610 con 0x55848863ca40 2023-09-30T22:16:47.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.564+0000 7f104bcb9b80 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x55848857cdb0 con 0x5584886665b0 2023-09-30T22:16:47.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.564+0000 7f104bcb9b80 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x558488592030 con 0x55848863c170 2023-09-30T22:16:47.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.564+0000 7f10337fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55848863ca40 0x5584886660c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:47.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.564+0000 7f10388a3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584886665b0 0x5584886689a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:47.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.564+0000 7f10337fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55848863ca40 0x5584886660c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:35840/0 (socket says 172.21.15.156:35840) 2023-09-30T22:16:47.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.564+0000 7f10337fe700 1 -- 172.21.15.156:0/1842830107 learned_addr learned my addr 172.21.15.156:0/1842830107 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:47.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.564+0000 7f1033fff700 1 --2- 172.21.15.156:0/1842830107 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55848863c170 0x55848863c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:47.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.564+0000 7f10388a3700 1 -- 172.21.15.156:0/1842830107 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55848863c170 msgr2=0x55848863c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:47.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.564+0000 7f10388a3700 1 --2- 172.21.15.156:0/1842830107 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55848863c170 0x55848863c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.564+0000 7f10388a3700 1 -- 172.21.15.156:0/1842830107 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55848863ca40 msgr2=0x5584886660c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:47.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.564+0000 7f10388a3700 1 --2- 172.21.15.156:0/1842830107 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55848863ca40 0x5584886660c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.565+0000 7f10388a3700 1 -- 172.21.15.156:0/1842830107 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55848842d710 con 0x5584886665b0 2023-09-30T22:16:47.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.565+0000 7f1033fff700 1 --2- 172.21.15.156:0/1842830107 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55848863c170 0x55848863c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:47.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.565+0000 7f10337fe700 1 --2- 172.21.15.156:0/1842830107 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55848863ca40 0x5584886660c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:47.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.565+0000 7f10388a3700 1 --2- 172.21.15.156:0/1842830107 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584886665b0 0x5584886689a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f103412bbe0 tx=0x7f102c007eb0).ready entity=mon.1 client_cookie=a6cfea3b9cf8dfff server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:47.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.565+0000 7f10197fa700 1 -- 172.21.15.156:0/1842830107 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c004c00 con 0x5584886665b0 2023-09-30T22:16:47.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.565+0000 7f10197fa700 1 -- 172.21.15.156:0/1842830107 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102c007340 con 0x5584886665b0 2023-09-30T22:16:47.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.565+0000 7f10197fa700 1 -- 172.21.15.156:0/1842830107 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c0076e0 con 0x5584886665b0 2023-09-30T22:16:47.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.565+0000 7f104bcb9b80 1 -- 172.21.15.156:0/1842830107 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584886665b0 msgr2=0x5584886689a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:47.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.565+0000 7f104bcb9b80 1 --2- 172.21.15.156:0/1842830107 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584886665b0 0x5584886689a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f103412bbe0 tx=0x7f102c007eb0).stop 2023-09-30T22:16:47.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.565+0000 7f104bcb9b80 1 -- 172.21.15.156:0/1842830107 shutdown_connections 2023-09-30T22:16:47.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.565+0000 7f104bcb9b80 1 --2- 172.21.15.156:0/1842830107 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584886665b0 0x5584886689a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.565+0000 7f104bcb9b80 1 --2- 172.21.15.156:0/1842830107 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55848863c170 0x55848863c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.565+0000 7f104bcb9b80 1 --2- 172.21.15.156:0/1842830107 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55848863ca40 0x5584886660c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.565+0000 7f104bcb9b80 1 -- 172.21.15.156:0/1842830107 >> 172.21.15.156:0/1842830107 conn(0x5584884aa940 msgr2=0x55848865ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:47.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.566+0000 7f104bcb9b80 1 -- 172.21.15.156:0/1842830107 shutdown_connections 2023-09-30T22:16:47.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.566+0000 7f104bcb9b80 1 -- 172.21.15.156:0/1842830107 wait complete. 2023-09-30T22:16:47.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.566+0000 7f104bcb9b80 1 -- start start 2023-09-30T22:16:47.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.566+0000 7f104bcb9b80 1 Processor -- start 2023-09-30T22:16:47.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.566+0000 7f104bcb9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55848863c170 0x55848866bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:47.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.566+0000 7f104bcb9b80 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55848863ca40 0x55848866bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:47.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.566+0000 7f104bcb9b80 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x5584886665b0 0x55848866c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:47.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.566+0000 7f104bcb9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558488592170 con 0x55848863c170 2023-09-30T22:16:47.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.566+0000 7f104bcb9b80 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x5584885923f0 con 0x55848863ca40 2023-09-30T22:16:47.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.566+0000 7f104bcb9b80 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x55848855d920 con 0x5584886665b0 2023-09-30T22:16:47.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.567+0000 7f104bcb9b80 10 client.0 ll_register_callbacks cb 0x558488532ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:16:47.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.567+0000 7f10337fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55848863ca40 0x55848866bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:47.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.567+0000 7f10388a3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x5584886665b0 0x55848866c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:47.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.567+0000 7f10337fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55848863ca40 0x55848866bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54694/0 (socket says 172.21.15.156:54694) 2023-09-30T22:16:47.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.567+0000 7f10337fe700 1 -- 172.21.15.156:0/417447931 learned_addr learned my addr 172.21.15.156:0/417447931 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:47.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.567+0000 7f10388a3700 1 --2- 172.21.15.156:0/417447931 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x5584886665b0 0x55848866c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:40182/0 (socket says 172.21.15.156:40182) 2023-09-30T22:16:47.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.567+0000 7f1033fff700 1 --2- 172.21.15.156:0/417447931 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55848863c170 0x55848866bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:47.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.567+0000 7f10388a3700 1 -- 172.21.15.156:0/417447931 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55848863ca40 msgr2=0x55848866bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:47.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.567+0000 7f10388a3700 1 --2- 172.21.15.156:0/417447931 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55848863ca40 0x55848866bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.567+0000 7f10388a3700 1 -- 172.21.15.156:0/417447931 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55848863c170 msgr2=0x55848866bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:47.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.567+0000 7f10388a3700 1 --2- 172.21.15.156:0/417447931 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55848863c170 0x55848866bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.567+0000 7f10388a3700 1 -- 172.21.15.156:0/417447931 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f102c004df0 con 0x5584886665b0 2023-09-30T22:16:47.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.567+0000 7f10388a3700 1 --2- 172.21.15.156:0/417447931 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x5584886665b0 0x55848866c4a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f102c016000 tx=0x7f102c017000).ready entity=mon.2 client_cookie=b3ec7eb28734bcd8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:47.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.567+0000 7f10127fc700 10 client.0 ms_handle_connect on v2:172.21.15.156:3302/0 2023-09-30T22:16:47.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.567+0000 7f10127fc700 1 -- 172.21.15.156:0/417447931 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c0150d0 con 0x5584886665b0 2023-09-30T22:16:47.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.567+0000 7f10127fc700 1 -- 172.21.15.156:0/417447931 <== mon.2 v2:172.21.15.156:3302/0 2 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f102c015230 con 0x5584886665b0 2023-09-30T22:16:47.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.567+0000 7f104bcb9b80 1 -- 172.21.15.156:0/417447931 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558488634f20 con 0x5584886665b0 2023-09-30T22:16:47.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.567+0000 7f10127fc700 1 -- 172.21.15.156:0/417447931 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_get_version_reply(handle=1 version=5) v2 ==== 24+0+0 (secure 0 0 0) 0x7f102c015980 con 0x5584886665b0 2023-09-30T22:16:47.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.567+0000 7f104bcb9b80 10 client.4496 fetch_fsmap learned FSMap version 5 2023-09-30T22:16:47.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.567+0000 7f104bcb9b80 1 -- 172.21.15.156:0/417447931 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,fsmap=5,monmap=2+}) v3 -- 0x558488564b00 con 0x5584886665b0 2023-09-30T22:16:47.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.567+0000 7f10127fc700 1 -- 172.21.15.156:0/417447931 <== mon.2 v2:172.21.15.156:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558488634f20 con 0x5584886665b0 2023-09-30T22:16:47.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.567+0000 7f10127fc700 1 -- 172.21.15.156:0/417447931 <== mon.2 v2:172.21.15.156:3302/0 5 ==== fsmap(e 5) v1 ==== 1430+0+0 (secure 0 0 0) 0x7f102c012070 con 0x5584886665b0 2023-09-30T22:16:47.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.567+0000 7f104bcb9b80 10 client.4496 fetch_fsmap finished waiting for FSMap version 5 2023-09-30T22:16:47.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.568+0000 7f104bcb9b80 10 client.4496 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:16:47.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.568+0000 7f104bcb9b80 20 client.4496 populate_metadata read hostname 'smithi156' 2023-09-30T22:16:47.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.568+0000 7f104bcb9b80 4 client.4496 mds_command: new command op to 4206 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-30T22:16:47.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.568+0000 7f104bcb9b80 1 -- 172.21.15.156:0/417447931 --> v1:172.21.15.156:6817/3817969673 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55848860a250 con 0x558488662ce0 2023-09-30T22:16:47.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.568+0000 7f10127fc700 10 client.4496 ms_handle_connect on v1:172.21.15.156:6817/3817969673 2023-09-30T22:16:47.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.568+0000 7f10127fc700 1 -- 172.21.15.156:0/417447931 <== mds.0 v1:172.21.15.156:6817/3817969673 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x55848860a250 con 0x558488662ce0 2023-09-30T22:16:47.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.568+0000 7f10127fc700 10 client.4496 handle_command_reply: tid=0 2023-09-30T22:16:47.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.568+0000 7f104bcb9b80 1 client.4496 shutdown 2023-09-30T22:16:47.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.569+0000 7f104bcb9b80 1 -- 172.21.15.156:0/417447931 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x5584886665b0 msgr2=0x55848866c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:47.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.569+0000 7f104bcb9b80 1 --2- 172.21.15.156:0/417447931 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x5584886665b0 0x55848866c4a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f102c016000 tx=0x7f102c017000).stop 2023-09-30T22:16:47.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.569+0000 7f104bcb9b80 1 -- 172.21.15.156:0/417447931 shutdown_connections 2023-09-30T22:16:47.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.569+0000 7f104bcb9b80 1 --2- 172.21.15.156:0/417447931 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x5584886665b0 0x55848866c4a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.569+0000 7f10127fc700 0 client.4496 ms_handle_reset on v1:172.21.15.156:6817/3817969673 2023-09-30T22:16:47.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.569+0000 7f104bcb9b80 1 --2- 172.21.15.156:0/417447931 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55848863c170 0x55848866bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.569+0000 7f104bcb9b80 1 --2- 172.21.15.156:0/417447931 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55848863ca40 0x55848866bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.569+0000 7f104bcb9b80 1 -- 172.21.15.156:0/417447931 >> 172.21.15.156:0/417447931 conn(0x5584884aa940 msgr2=0x55848865cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:47.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.569+0000 7f104bcb9b80 1 -- 172.21.15.156:0/417447931 shutdown_connections 2023-09-30T22:16:47.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.569+0000 7f104bcb9b80 1 -- 172.21.15.156:0/417447931 wait complete. 2023-09-30T22:16:47.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.569+0000 7f104bcb9b80 20 client.4496 trim_cache size 0 max 16384 2023-09-30T22:16:47.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.585+0000 7f104bcb9b80 1 Processor -- start 2023-09-30T22:16:47.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.585+0000 7f104bcb9b80 1 -- start start 2023-09-30T22:16:47.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.585+0000 7f104bcb9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55848863c170 0x55848863c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:47.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.585+0000 7f104bcb9b80 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55848863ca40 0x558488657310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:47.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.585+0000 7f104bcb9b80 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584886665b0 0x558488678140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:47.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.585+0000 7f104bcb9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55848865d310 con 0x55848863c170 2023-09-30T22:16:47.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.585+0000 7f104bcb9b80 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x55848863d6a0 con 0x5584886665b0 2023-09-30T22:16:47.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.585+0000 7f104bcb9b80 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x5584886657a0 con 0x55848863ca40 2023-09-30T22:16:47.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.585+0000 7f1033fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55848863c170 0x55848863c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:47.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.585+0000 7f10337fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55848863ca40 0x558488657310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:47.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.585+0000 7f1033fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55848863c170 0x55848863c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:35848/0 (socket says 172.21.15.156:35848) 2023-09-30T22:16:47.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.585+0000 7f1033fff700 1 -- 172.21.15.156:0/78000364 learned_addr learned my addr 172.21.15.156:0/78000364 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:47.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.585+0000 7f10388a3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584886665b0 0x558488678140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:47.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.586+0000 7f10337fe700 1 -- 172.21.15.156:0/78000364 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584886665b0 msgr2=0x558488678140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:47.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.586+0000 7f10337fe700 1 --2- 172.21.15.156:0/78000364 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584886665b0 0x558488678140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.586+0000 7f10337fe700 1 -- 172.21.15.156:0/78000364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55848863c170 msgr2=0x55848863c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:47.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.586+0000 7f10337fe700 1 --2- 172.21.15.156:0/78000364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55848863c170 0x55848863c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.586+0000 7f10337fe700 1 -- 172.21.15.156:0/78000364 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55848858af70 con 0x55848863ca40 2023-09-30T22:16:47.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.586+0000 7f1033fff700 1 --2- 172.21.15.156:0/78000364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55848863c170 0x55848863c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:47.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.586+0000 7f10337fe700 1 --2- 172.21.15.156:0/78000364 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55848863ca40 0x558488657310 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f102403cc70 tx=0x7f102401c000).ready entity=mon.2 client_cookie=da43456d83fc8a86 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:47.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.586+0000 7f1019ffb700 1 -- 172.21.15.156:0/78000364 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1024018500 con 0x55848863ca40 2023-09-30T22:16:47.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.586+0000 7f1019ffb700 1 -- 172.21.15.156:0/78000364 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1024018320 con 0x55848863ca40 2023-09-30T22:16:47.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.586+0000 7f1019ffb700 1 -- 172.21.15.156:0/78000364 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1024019380 con 0x55848863ca40 2023-09-30T22:16:47.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.586+0000 7f104bcb9b80 1 -- 172.21.15.156:0/78000364 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55848863ca40 msgr2=0x558488657310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:47.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.586+0000 7f104bcb9b80 1 --2- 172.21.15.156:0/78000364 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55848863ca40 0x558488657310 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f102403cc70 tx=0x7f102401c000).stop 2023-09-30T22:16:47.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.586+0000 7f104bcb9b80 1 -- 172.21.15.156:0/78000364 shutdown_connections 2023-09-30T22:16:47.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.586+0000 7f104bcb9b80 1 --2- 172.21.15.156:0/78000364 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584886665b0 0x558488678140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.586+0000 7f104bcb9b80 1 --2- 172.21.15.156:0/78000364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55848863c170 0x55848863c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.586+0000 7f104bcb9b80 1 --2- 172.21.15.156:0/78000364 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55848863ca40 0x558488657310 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.586+0000 7f104bcb9b80 1 -- 172.21.15.156:0/78000364 >> 172.21.15.156:0/78000364 conn(0x5584884aa940 msgr2=0x5584886403e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:47.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.587+0000 7f104bcb9b80 1 -- 172.21.15.156:0/78000364 shutdown_connections 2023-09-30T22:16:47.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.587+0000 7f104bcb9b80 1 -- 172.21.15.156:0/78000364 wait complete. 2023-09-30T22:16:47.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.587+0000 7f104bcb9b80 1 -- start start 2023-09-30T22:16:47.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.587+0000 7f104bcb9b80 1 Processor -- start 2023-09-30T22:16:47.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.587+0000 7f104bcb9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55848863c170 0x558488668d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:47.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.587+0000 7f104bcb9b80 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55848863ca40 0x558488669200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:47.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.587+0000 7f104bcb9b80 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584886665b0 0x5584886c0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:47.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.587+0000 7f104bcb9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558488660560 con 0x55848863c170 2023-09-30T22:16:47.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.587+0000 7f104bcb9b80 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x55848866b5e0 con 0x5584886665b0 2023-09-30T22:16:47.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.587+0000 7f104bcb9b80 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x55848866ab20 con 0x55848863ca40 2023-09-30T22:16:47.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.588+0000 7f104bcb9b80 10 client.0 ll_register_callbacks cb 0x558488532ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:16:47.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.588+0000 7f1033fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55848863c170 0x558488668d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:47.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.588+0000 7f10388a3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584886665b0 0x5584886c0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:47.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.588+0000 7f10337fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55848863ca40 0x558488669200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:47.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.588+0000 7f1033fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55848863c170 0x558488668d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:35850/0 (socket says 172.21.15.156:35850) 2023-09-30T22:16:47.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.588+0000 7f1033fff700 1 -- 172.21.15.156:0/1418067701 learned_addr learned my addr 172.21.15.156:0/1418067701 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:47.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.588+0000 7f10388a3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584886665b0 0x5584886c0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54706/0 (socket says 172.21.15.156:54706) 2023-09-30T22:16:47.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.588+0000 7f1033fff700 1 -- 172.21.15.156:0/1418067701 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55848863ca40 msgr2=0x558488669200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:47.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.588+0000 7f1033fff700 1 --2- 172.21.15.156:0/1418067701 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55848863ca40 0x558488669200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.588+0000 7f1033fff700 1 -- 172.21.15.156:0/1418067701 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584886665b0 msgr2=0x5584886c0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:47.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.588+0000 7f1033fff700 1 --2- 172.21.15.156:0/1418067701 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584886665b0 0x5584886c0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.588+0000 7f1033fff700 1 -- 172.21.15.156:0/1418067701 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1028011a30 con 0x55848863c170 2023-09-30T22:16:47.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.588+0000 7f10388a3700 1 --2- 172.21.15.156:0/1418067701 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584886665b0 0x5584886c0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:47.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.588+0000 7f1033fff700 1 --2- 172.21.15.156:0/1418067701 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55848863c170 0x558488668d10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f1028015820 tx=0x7f1028008040).ready entity=mon.0 client_cookie=70dd2868cb9d255e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:47.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.588+0000 7f10127fc700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-30T22:16:47.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.588+0000 7f10127fc700 1 -- 172.21.15.156:0/1418067701 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102801b070 con 0x55848863c170 2023-09-30T22:16:47.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.588+0000 7f10127fc700 1 -- 172.21.15.156:0/1418067701 <== mon.0 v2:172.21.15.156:3300/0 2 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f10280146f0 con 0x55848863c170 2023-09-30T22:16:47.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.588+0000 7f104bcb9b80 1 -- 172.21.15.156:0/1418067701 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f102c007340 con 0x55848863c170 2023-09-30T22:16:47.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.588+0000 7f10127fc700 1 -- 172.21.15.156:0/1418067701 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=5) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1028011c70 con 0x55848863c170 2023-09-30T22:16:47.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.588+0000 7f104bcb9b80 10 client.4635 fetch_fsmap learned FSMap version 5 2023-09-30T22:16:47.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.588+0000 7f104bcb9b80 1 -- 172.21.15.156:0/1418067701 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=5,monmap=2+}) v3 -- 0x7f10240092a0 con 0x55848863c170 2023-09-30T22:16:47.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.588+0000 7f10127fc700 1 -- 172.21.15.156:0/1418067701 <== mon.0 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102c007340 con 0x55848863c170 2023-09-30T22:16:47.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.588+0000 7f10127fc700 1 -- 172.21.15.156:0/1418067701 <== mon.0 v2:172.21.15.156:3300/0 5 ==== fsmap(e 5) v1 ==== 1430+0+0 (secure 0 0 0) 0x7f1028014ac0 con 0x55848863c170 2023-09-30T22:16:47.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.588+0000 7f104bcb9b80 10 client.4635 fetch_fsmap finished waiting for FSMap version 5 2023-09-30T22:16:47.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.588+0000 7f104bcb9b80 10 client.4635 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:16:47.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.589+0000 7f104bcb9b80 20 client.4635 populate_metadata read hostname 'smithi156' 2023-09-30T22:16:47.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.589+0000 7f104bcb9b80 4 client.4635 mds_command: new command op to 4206 tid=0[{"prefix": "status"}] 2023-09-30T22:16:47.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.589+0000 7f104bcb9b80 1 -- 172.21.15.156:0/1418067701 --> v1:172.21.15.156:6817/3817969673 -- command(tid 0: {"prefix": "status"}) v1 -- 0x5584883faef0 con 0x5584886c7b20 2023-09-30T22:16:47.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.589+0000 7f10127fc700 10 client.4635 ms_handle_connect on v1:172.21.15.156:6817/3817969673 2023-09-30T22:16:47.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.589+0000 7f10127fc700 1 -- 172.21.15.156:0/1418067701 <== mds.0 v1:172.21.15.156:6817/3817969673 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (unknown 0 0 3401994050) 0x5584883faef0 con 0x5584886c7b20 2023-09-30T22:16:47.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.589+0000 7f10127fc700 10 client.4635 handle_command_reply: tid=0 2023-09-30T22:16:47.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.589+0000 7f104bcb9b80 1 client.4635 shutdown 2023-09-30T22:16:47.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.589+0000 7f104bcb9b80 1 -- 172.21.15.156:0/1418067701 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55848863c170 msgr2=0x558488668d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:47.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.589+0000 7f104bcb9b80 1 --2- 172.21.15.156:0/1418067701 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55848863c170 0x558488668d10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f1028015820 tx=0x7f1028008040).stop 2023-09-30T22:16:47.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.589+0000 7f104bcb9b80 1 -- 172.21.15.156:0/1418067701 shutdown_connections 2023-09-30T22:16:47.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.589+0000 7f104bcb9b80 1 --2- 172.21.15.156:0/1418067701 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x5584886665b0 0x5584886c0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.589+0000 7f10127fc700 0 client.4635 ms_handle_reset on v1:172.21.15.156:6817/3817969673 2023-09-30T22:16:47.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.589+0000 7f104bcb9b80 1 --2- 172.21.15.156:0/1418067701 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55848863c170 0x558488668d10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.589+0000 7f104bcb9b80 1 --2- 172.21.15.156:0/1418067701 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55848863ca40 0x558488669200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.589+0000 7f104bcb9b80 1 -- 172.21.15.156:0/1418067701 >> 172.21.15.156:0/1418067701 conn(0x5584884aa940 msgr2=0x558488640370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:47.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.589+0000 7f104bcb9b80 1 -- 172.21.15.156:0/1418067701 shutdown_connections 2023-09-30T22:16:47.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.589+0000 7f104bcb9b80 1 -- 172.21.15.156:0/1418067701 wait complete. 2023-09-30T22:16:47.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.589+0000 7f104bcb9b80 20 client.4635 trim_cache size 0 max 16384 2023-09-30T22:16:47.598 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2023-09-30T22:16:47.598 INFO:teuthology.orchestra.run.smithi156.stdout: "cluster_fsid": "bf403786-ca20-4e4a-92c0-a0a997d43bba", 2023-09-30T22:16:47.598 INFO:teuthology.orchestra.run.smithi156.stdout: "whoami": 0, 2023-09-30T22:16:47.598 INFO:teuthology.orchestra.run.smithi156.stdout: "id": 4206, 2023-09-30T22:16:47.598 INFO:teuthology.orchestra.run.smithi156.stdout: "want_state": "up:active", 2023-09-30T22:16:47.598 INFO:teuthology.orchestra.run.smithi156.stdout: "state": "up:active", 2023-09-30T22:16:47.598 INFO:teuthology.orchestra.run.smithi156.stdout: "fs_name": "cephfs", 2023-09-30T22:16:47.598 INFO:teuthology.orchestra.run.smithi156.stdout: "rank_uptime": 17.796636485000001, 2023-09-30T22:16:47.599 INFO:teuthology.orchestra.run.smithi156.stdout: "mdsmap_epoch": 5, 2023-09-30T22:16:47.599 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_epoch": 16, 2023-09-30T22:16:47.599 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_epoch_barrier": 16, 2023-09-30T22:16:47.599 INFO:teuthology.orchestra.run.smithi156.stdout: "uptime": 22.076099928000001 2023-09-30T22:16:47.599 INFO:teuthology.orchestra.run.smithi156.stdout:} 2023-09-30T22:16:47.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.590+0000 7f103a306700 1 -- 172.21.15.156:0/1947898503 >> v1:172.21.15.156:6816/118236 conn(0x7f102002bb60 legacy=0x7f102002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:47.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.590+0000 7f103a306700 1 -- 172.21.15.156:0/1947898503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f103412b370 msgr2=0x7f103413a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:47.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.590+0000 7f103a306700 1 --2- 172.21.15.156:0/1947898503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f103412b370 0x7f103413a710 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f1024014000 tx=0x7f1024017000).stop 2023-09-30T22:16:47.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.590+0000 7f103a306700 1 -- 172.21.15.156:0/1947898503 shutdown_connections 2023-09-30T22:16:47.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.590+0000 7f103a306700 1 --2- 172.21.15.156:0/1947898503 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f103412b790 0x7f103413ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.590+0000 7f103a306700 1 --2- 172.21.15.156:0/1947898503 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f103405f560 0x7f103413a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.590+0000 7f103a306700 1 --2- 172.21.15.156:0/1947898503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f103412b370 0x7f103413a710 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.590+0000 7f103a306700 1 -- 172.21.15.156:0/1947898503 >> 172.21.15.156:0/1947898503 conn(0x7f103409a1c0 msgr2=0x7f103412d200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:47.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.590+0000 7f103a306700 1 -- 172.21.15.156:0/1947898503 shutdown_connections 2023-09-30T22:16:47.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.590+0000 7f103a306700 1 -- 172.21.15.156:0/1947898503 wait complete. 2023-09-30T22:16:47.602 INFO:teuthology.run_tasks:Running task exec... 2023-09-30T22:16:47.612 INFO:teuthology.task.exec:Executing custom commands... 2023-09-30T22:16:47.612 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@smithi156.front.sepia.ceph.com 2023-09-30T22:16:47.612 DEBUG:teuthology.orchestra.run.smithi156:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client pacific' 2023-09-30T22:16:47.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.727+0000 7fd81e8dc700 1 Processor -- start 2023-09-30T22:16:47.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.727+0000 7fd81e8dc700 1 -- start start 2023-09-30T22:16:47.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.727+0000 7fd81e8dc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd818059070 0x7fd81812add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:47.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.727+0000 7fd81e8dc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd81812b2c0 0x7fd818068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:47.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.727+0000 7fd81e8dc700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8180982b0 con 0x7fd81812b6c0 2023-09-30T22:16:47.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.727+0000 7fd81e8dc700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd818059450 con 0x7fd818059070 2023-09-30T22:16:47.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.727+0000 7fd81e8dc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd818099670 con 0x7fd81812b2c0 2023-09-30T22:16:47.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.728+0000 7fd8177fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd81812b2c0 0x7fd818068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:47.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.728+0000 7fd817fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd818059070 0x7fd81812add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:47.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.728+0000 7fd8177fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd81812b2c0 0x7fd818068dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:40218/0 (socket says 172.21.15.156:40218) 2023-09-30T22:16:47.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.728+0000 7fd8177fe700 1 -- 172.21.15.156:0/122141301 learned_addr learned my addr 172.21.15.156:0/122141301 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:47.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.728+0000 7fd8177fe700 1 -- 172.21.15.156:0/122141301 >> v2:172.21.15.156:3300/0 conn(0x7fd818059070 msgr2=0x7fd81812add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:47.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.728+0000 7fd8177fe700 1 --2- 172.21.15.156:0/122141301 >> v2:172.21.15.156:3300/0 conn(0x7fd818059070 0x7fd81812add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.728+0000 7fd8177fe700 1 -- 172.21.15.156:0/122141301 >> v1:172.21.15.156:6789/0 conn(0x7fd81812b6c0 legacy=0x7fd8180692b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:47.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.728+0000 7fd8177fe700 1 -- 172.21.15.156:0/122141301 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd818093770 con 0x7fd81812b2c0 2023-09-30T22:16:47.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.728+0000 7fd816ffd700 1 -- 172.21.15.156:0/122141301 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3241428818 0 0) 0x7fd8180982b0 con 0x7fd81812b6c0 2023-09-30T22:16:47.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.728+0000 7fd817fff700 1 --2- 172.21.15.156:0/122141301 >> v2:172.21.15.156:3300/0 conn(0x7fd818059070 0x7fd81812add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:47.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.728+0000 7fd8177fe700 1 --2- 172.21.15.156:0/122141301 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd81812b2c0 0x7fd818068dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fd808006fd0 tx=0x7fd8080090f0).ready entity=mon.2 client_cookie=2cee55bef2c63799 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:47.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.728+0000 7fd816ffd700 1 -- 172.21.15.156:0/122141301 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80800b580 con 0x7fd81812b2c0 2023-09-30T22:16:47.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.728+0000 7fd816ffd700 1 -- 172.21.15.156:0/122141301 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80800b6e0 con 0x7fd81812b2c0 2023-09-30T22:16:47.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.728+0000 7fd816ffd700 1 -- 172.21.15.156:0/122141301 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80800ba60 con 0x7fd81812b2c0 2023-09-30T22:16:47.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.729+0000 7fd81e8dc700 1 -- 172.21.15.156:0/122141301 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd81812b2c0 msgr2=0x7fd818068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:47.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.729+0000 7fd81e8dc700 1 --2- 172.21.15.156:0/122141301 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd81812b2c0 0x7fd818068dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fd808006fd0 tx=0x7fd8080090f0).stop 2023-09-30T22:16:47.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.729+0000 7fd81e8dc700 1 -- 172.21.15.156:0/122141301 shutdown_connections 2023-09-30T22:16:47.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.729+0000 7fd81e8dc700 1 --2- 172.21.15.156:0/122141301 >> v2:172.21.15.156:3300/0 conn(0x7fd818059070 0x7fd81812add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.729+0000 7fd81e8dc700 1 --2- 172.21.15.156:0/122141301 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd81812b2c0 0x7fd818068dc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.729+0000 7fd81e8dc700 1 -- 172.21.15.156:0/122141301 >> 172.21.15.156:0/122141301 conn(0x7fd81809ac50 msgr2=0x7fd818062b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:47.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.729+0000 7fd81e8dc700 1 -- 172.21.15.156:0/122141301 shutdown_connections 2023-09-30T22:16:47.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.729+0000 7fd81e8dc700 1 -- 172.21.15.156:0/122141301 wait complete. 2023-09-30T22:16:47.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.730+0000 7fd81e8dc700 1 Processor -- start 2023-09-30T22:16:47.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.730+0000 7fd81e8dc700 1 -- start start 2023-09-30T22:16:47.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.730+0000 7fd81e8dc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd818059070 0x7fd8181156e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:47.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.730+0000 7fd81e8dc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd81812b2c0 0x7fd818115bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:47.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.730+0000 7fd81e8dc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd81812b6c0 0x7fd8181160c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:47.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.730+0000 7fd81e8dc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8180685b0 con 0x7fd818059070 2023-09-30T22:16:47.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.730+0000 7fd81e8dc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd818093330 con 0x7fd81812b6c0 2023-09-30T22:16:47.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.730+0000 7fd81e8dc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8181188a0 con 0x7fd81812b2c0 2023-09-30T22:16:47.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.730+0000 7fd8177fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd81812b2c0 0x7fd818115bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:47.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.730+0000 7fd817fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd818059070 0x7fd8181156e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:47.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.730+0000 7fd8177fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd81812b2c0 0x7fd818115bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:40230/0 (socket says 172.21.15.156:40230) 2023-09-30T22:16:47.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.730+0000 7fd8177fe700 1 -- 172.21.15.156:0/3257627518 learned_addr learned my addr 172.21.15.156:0/3257627518 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:47.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.730+0000 7fd817fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd818059070 0x7fd8181156e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:35880/0 (socket says 172.21.15.156:35880) 2023-09-30T22:16:47.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.730+0000 7fd81ce79700 1 --2- 172.21.15.156:0/3257627518 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd81812b6c0 0x7fd8181160c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:47.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.731+0000 7fd817fff700 1 -- 172.21.15.156:0/3257627518 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd81812b2c0 msgr2=0x7fd818115bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:47.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.731+0000 7fd817fff700 1 --2- 172.21.15.156:0/3257627518 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd81812b2c0 0x7fd818115bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.731+0000 7fd817fff700 1 -- 172.21.15.156:0/3257627518 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd81812b6c0 msgr2=0x7fd8181160c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:47.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.731+0000 7fd817fff700 1 --2- 172.21.15.156:0/3257627518 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd81812b6c0 0x7fd8181160c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:47.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.731+0000 7fd817fff700 1 -- 172.21.15.156:0/3257627518 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80c0092a0 con 0x7fd818059070 2023-09-30T22:16:47.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.731+0000 7fd8177fe700 1 --2- 172.21.15.156:0/3257627518 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd81812b2c0 0x7fd818115bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:47.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.731+0000 7fd81ce79700 1 --2- 172.21.15.156:0/3257627518 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd81812b6c0 0x7fd8181160c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:47.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.731+0000 7fd817fff700 1 --2- 172.21.15.156:0/3257627518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd818059070 0x7fd8181156e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fd80c00e9b0 tx=0x7fd80c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:47.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.731+0000 7fd7fffff700 1 -- 172.21.15.156:0/3257627518 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c012600 con 0x7fd818059070 2023-09-30T22:16:47.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.731+0000 7fd7fffff700 1 -- 172.21.15.156:0/3257627518 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80c012760 con 0x7fd818059070 2023-09-30T22:16:47.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.731+0000 7fd81e8dc700 1 -- 172.21.15.156:0/3257627518 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd808009370 con 0x7fd818059070 2023-09-30T22:16:47.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.731+0000 7fd7fffff700 1 -- 172.21.15.156:0/3257627518 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c012ae0 con 0x7fd818059070 2023-09-30T22:16:47.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.731+0000 7fd81e8dc700 1 -- 172.21.15.156:0/3257627518 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8181191f0 con 0x7fd818059070 2023-09-30T22:16:47.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.732+0000 7fd7fffff700 1 -- 172.21.15.156:0/3257627518 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fd80c01b400 con 0x7fd818059070 2023-09-30T22:16:47.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.732+0000 7fd7fffff700 1 -- 172.21.15.156:0/3257627518 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fd80c03b410 con 0x7fd818059070 2023-09-30T22:16:47.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.732+0000 7fd81e8dc700 1 -- 172.21.15.156:0/3257627518 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd818118700 con 0x7fd818059070 2023-09-30T22:16:47.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.736+0000 7fd7fffff700 1 -- 172.21.15.156:0/3257627518 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fd818118700 con 0x7fd818059070 2023-09-30T22:16:47.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:47.903+0000 7fd81e8dc700 1 -- 172.21.15.156:0/3257627518 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "pacific"} v 0) v1 -- 0x7fd818118700 con 0x7fd818059070 2023-09-30T22:16:48.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.041+0000 7fd7fffff700 1 -- 172.21.15.156:0/3257627518 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "pacific"}]=0 set require_min_compat_client to pacific v17) v1 ==== 143+0+0 (secure 0 0 0) 0x7fd818118700 con 0x7fd818059070 2023-09-30T22:16:48.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.044+0000 7fd81e8dc700 1 -- 172.21.15.156:0/3257627518 >> v1:172.21.15.156:6816/118236 conn(0x7fd80402bb60 legacy=0x7fd80402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:48.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.044+0000 7fd81e8dc700 1 -- 172.21.15.156:0/3257627518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd818059070 msgr2=0x7fd8181156e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:48.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.044+0000 7fd81e8dc700 1 --2- 172.21.15.156:0/3257627518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd818059070 0x7fd8181156e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fd80c00e9b0 tx=0x7fd80c009060).stop 2023-09-30T22:16:48.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.045+0000 7fd81e8dc700 1 -- 172.21.15.156:0/3257627518 shutdown_connections 2023-09-30T22:16:48.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.045+0000 7fd81e8dc700 1 --2- 172.21.15.156:0/3257627518 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd81812b6c0 0x7fd8181160c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:48.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.045+0000 7fd81e8dc700 1 --2- 172.21.15.156:0/3257627518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd818059070 0x7fd8181156e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:48.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.045+0000 7fd81e8dc700 1 --2- 172.21.15.156:0/3257627518 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd81812b2c0 0x7fd818115bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:48.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.045+0000 7fd81e8dc700 1 -- 172.21.15.156:0/3257627518 >> 172.21.15.156:0/3257627518 conn(0x7fd81809ac50 msgr2=0x7fd818065da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:48.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.046+0000 7fd81e8dc700 1 -- 172.21.15.156:0/3257627518 shutdown_connections 2023-09-30T22:16:48.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.046+0000 7fd81e8dc700 1 -- 172.21.15.156:0/3257627518 wait complete. 2023-09-30T22:16:48.047 INFO:teuthology.orchestra.run.smithi156.stderr:set require_min_compat_client to pacific 2023-09-30T22:16:48.058 INFO:teuthology.run_tasks:Running task print... 2023-09-30T22:16:48.067 INFO:teuthology.task.print:**** done ceph 2023-09-30T22:16:48.067 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-09-30T22:16:48.090 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-09-30T22:16:48.090 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-09-30T22:16:48.091 INFO:tasks.ceph_fuse:client.0 config is {} 2023-09-30T22:16:48.091 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-30T22:16:48.091 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T22:16:48.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:16:48.091 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2023-09-30T22:16:48.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:16:48.114 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link delete ceph-brx 2023-09-30T22:16:48.191 INFO:teuthology.orchestra.run.smithi194.stderr:Cannot find device "ceph-brx" 2023-09-30T22:16:48.192 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:16:48.193 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-09-30T22:16:48.193 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T22:16:48.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.308+0000 7f6861c59700 1 Processor -- start 2023-09-30T22:16:48.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.308+0000 7f6861c59700 1 -- start start 2023-09-30T22:16:48.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.309+0000 7f6861c59700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f685c0990d0 0x7f685c1304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:48.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.309+0000 7f6861c59700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f685c130990 0x7f685c132d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:48.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.309+0000 7f6861c59700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685c0964f0 con 0x7f685c0985e0 2023-09-30T22:16:48.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.309+0000 7f6861c59700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685c0994b0 con 0x7f685c0990d0 2023-09-30T22:16:48.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.309+0000 7f6861c59700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f685c09a3f0 con 0x7f685c130990 2023-09-30T22:16:48.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.309+0000 7f685bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f685c130990 0x7f685c132d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:48.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.309+0000 7f685affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f685c0990d0 0x7f685c1304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:48.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.309+0000 7f685b7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f685c0985e0 0x7f685c0989c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47472/0 (socket says 172.21.15.156:47472) 2023-09-30T22:16:48.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.309+0000 7f685b7fe700 1 -- 172.21.15.156:0/3094870090 learned_addr learned my addr 172.21.15.156:0/3094870090 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:48.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.309+0000 7f685bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f685c130990 0x7f685c132d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:40244/0 (socket says 172.21.15.156:40244) 2023-09-30T22:16:48.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.309+0000 7f685a7fc700 1 -- 172.21.15.156:0/3094870090 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196037741 0 0) 0x7f685c0964f0 con 0x7f685c0985e0 2023-09-30T22:16:48.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.309+0000 7f685affd700 1 -- 172.21.15.156:0/3094870090 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f685c130990 msgr2=0x7f685c132d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:48.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.309+0000 7f685affd700 1 --2- 172.21.15.156:0/3094870090 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f685c130990 0x7f685c132d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:48.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.309+0000 7f685affd700 1 -- 172.21.15.156:0/3094870090 >> v1:172.21.15.156:6789/0 conn(0x7f685c0985e0 legacy=0x7f685c0989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:48.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.309+0000 7f685affd700 1 -- 172.21.15.156:0/3094870090 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685c095100 con 0x7f685c0990d0 2023-09-30T22:16:48.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.309+0000 7f685bfff700 1 --2- 172.21.15.156:0/3094870090 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f685c130990 0x7f685c132d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:48.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.310+0000 7f685affd700 1 --2- 172.21.15.156:0/3094870090 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f685c0990d0 0x7f685c1304a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f684c0097c0 tx=0x7f684c009060).ready entity=mon.1 client_cookie=4f060c146fef5315 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:48.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.310+0000 7f685a7fc700 1 -- 172.21.15.156:0/3094870090 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c0090d0 con 0x7f685c0990d0 2023-09-30T22:16:48.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.310+0000 7f685a7fc700 1 -- 172.21.15.156:0/3094870090 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684c00f510 con 0x7f685c0990d0 2023-09-30T22:16:48.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.310+0000 7f685a7fc700 1 -- 172.21.15.156:0/3094870090 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c00f890 con 0x7f685c0990d0 2023-09-30T22:16:48.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.310+0000 7f6861c59700 1 -- 172.21.15.156:0/3094870090 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f685c0990d0 msgr2=0x7f685c1304a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:48.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.310+0000 7f6861c59700 1 --2- 172.21.15.156:0/3094870090 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f685c0990d0 0x7f685c1304a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f684c0097c0 tx=0x7f684c009060).stop 2023-09-30T22:16:48.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.310+0000 7f6861c59700 1 -- 172.21.15.156:0/3094870090 shutdown_connections 2023-09-30T22:16:48.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.310+0000 7f6861c59700 1 --2- 172.21.15.156:0/3094870090 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f685c130990 0x7f685c132d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:48.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.310+0000 7f6861c59700 1 --2- 172.21.15.156:0/3094870090 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f685c0990d0 0x7f685c1304a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:48.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.310+0000 7f6861c59700 1 -- 172.21.15.156:0/3094870090 >> 172.21.15.156:0/3094870090 conn(0x7f685c09dc40 msgr2=0x7f685c09e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:48.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.310+0000 7f6861c59700 1 -- 172.21.15.156:0/3094870090 shutdown_connections 2023-09-30T22:16:48.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.310+0000 7f6861c59700 1 -- 172.21.15.156:0/3094870090 wait complete. 2023-09-30T22:16:48.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.312+0000 7f6861c59700 1 Processor -- start 2023-09-30T22:16:48.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.312+0000 7f6861c59700 1 -- start start 2023-09-30T22:16:48.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.312+0000 7f6861c59700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f685c0985e0 0x7f685c1192d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:48.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.312+0000 7f6861c59700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f685c0990d0 0x7f685c1197c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:48.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.312+0000 7f6861c59700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f685c130990 0x7f685c119cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:48.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.312+0000 7f6861c59700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c11a1a0 con 0x7f685c0985e0 2023-09-30T22:16:48.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.312+0000 7f6861c59700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685c11a780 con 0x7f685c0990d0 2023-09-30T22:16:48.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.312+0000 7f6861c59700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f685c11ae00 con 0x7f685c130990 2023-09-30T22:16:48.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.312+0000 7f685b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f685c0985e0 0x7f685c1192d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:48.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.312+0000 7f685b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f685c0985e0 0x7f685c1192d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:35882/0 (socket says 172.21.15.156:35882) 2023-09-30T22:16:48.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.312+0000 7f685b7fe700 1 -- 172.21.15.156:0/3138287308 learned_addr learned my addr 172.21.15.156:0/3138287308 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:48.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.312+0000 7f685affd700 1 --2- 172.21.15.156:0/3138287308 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f685c0990d0 0x7f685c1197c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:48.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.312+0000 7f685bfff700 1 --2- 172.21.15.156:0/3138287308 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f685c130990 0x7f685c119cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:48.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.313+0000 7f685b7fe700 1 -- 172.21.15.156:0/3138287308 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f685c130990 msgr2=0x7f685c119cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:48.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.313+0000 7f685b7fe700 1 --2- 172.21.15.156:0/3138287308 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f685c130990 0x7f685c119cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:48.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.313+0000 7f685b7fe700 1 -- 172.21.15.156:0/3138287308 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f685c0990d0 msgr2=0x7f685c1197c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:48.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.313+0000 7f685b7fe700 1 --2- 172.21.15.156:0/3138287308 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f685c0990d0 0x7f685c1197c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:48.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.313+0000 7f685b7fe700 1 -- 172.21.15.156:0/3138287308 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6854009a20 con 0x7f685c0985e0 2023-09-30T22:16:48.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.313+0000 7f685affd700 1 --2- 172.21.15.156:0/3138287308 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f685c0990d0 0x7f685c1197c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:48.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.313+0000 7f685b7fe700 1 --2- 172.21.15.156:0/3138287308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f685c0985e0 0x7f685c1192d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f685000c4f0 tx=0x7f6850007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:48.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.313+0000 7f68437fe700 1 -- 172.21.15.156:0/3138287308 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685000ce20 con 0x7f685c0985e0 2023-09-30T22:16:48.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.313+0000 7f68437fe700 1 -- 172.21.15.156:0/3138287308 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68500072e0 con 0x7f685c0985e0 2023-09-30T22:16:48.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.313+0000 7f6861c59700 1 -- 172.21.15.156:0/3138287308 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f684c0092a0 con 0x7f685c0985e0 2023-09-30T22:16:48.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.313+0000 7f68437fe700 1 -- 172.21.15.156:0/3138287308 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68500057a0 con 0x7f685c0985e0 2023-09-30T22:16:48.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.313+0000 7f6861c59700 1 -- 172.21.15.156:0/3138287308 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f685c09a0f0 con 0x7f685c0985e0 2023-09-30T22:16:48.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.314+0000 7f68437fe700 1 -- 172.21.15.156:0/3138287308 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f6850005bd0 con 0x7f685c0985e0 2023-09-30T22:16:48.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.314+0000 7f68437fe700 1 -- 172.21.15.156:0/3138287308 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f685003a610 con 0x7f685c0985e0 2023-09-30T22:16:48.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.314+0000 7f6861c59700 1 -- 172.21.15.156:0/3138287308 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f685c11c630 con 0x7f685c0985e0 2023-09-30T22:16:48.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.318+0000 7f68437fe700 1 -- 172.21.15.156:0/3138287308 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f685001d3f0 con 0x7f685c0985e0 2023-09-30T22:16:48.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.515+0000 7f6861c59700 1 -- 172.21.15.156:0/3138287308 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f685c05a260 con 0x7f685c0985e0 2023-09-30T22:16:48.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.515+0000 7f68437fe700 1 -- 172.21.15.156:0/3138287308 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v5) v1 ==== 53+0+73 (secure 0 0 0) 0x7f685001c350 con 0x7f685c0985e0 2023-09-30T22:16:48.516 INFO:teuthology.orchestra.run.smithi156.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T22:16:48.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.517+0000 7f6861c59700 1 -- 172.21.15.156:0/3138287308 >> v1:172.21.15.156:6816/118236 conn(0x7f684802bb60 legacy=0x7f684802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:48.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.517+0000 7f6861c59700 1 -- 172.21.15.156:0/3138287308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f685c0985e0 msgr2=0x7f685c1192d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:48.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.517+0000 7f6861c59700 1 --2- 172.21.15.156:0/3138287308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f685c0985e0 0x7f685c1192d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f685000c4f0 tx=0x7f6850007c10).stop 2023-09-30T22:16:48.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.517+0000 7f6861c59700 1 -- 172.21.15.156:0/3138287308 shutdown_connections 2023-09-30T22:16:48.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.517+0000 7f6861c59700 1 --2- 172.21.15.156:0/3138287308 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f685c130990 0x7f685c119cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:48.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.517+0000 7f6861c59700 1 --2- 172.21.15.156:0/3138287308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f685c0985e0 0x7f685c1192d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:48.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.517+0000 7f6861c59700 1 --2- 172.21.15.156:0/3138287308 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f685c0990d0 0x7f685c1197c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:48.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.517+0000 7f6861c59700 1 -- 172.21.15.156:0/3138287308 >> 172.21.15.156:0/3138287308 conn(0x7f685c09dc40 msgr2=0x7f685c12f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:48.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.517+0000 7f6861c59700 1 -- 172.21.15.156:0/3138287308 shutdown_connections 2023-09-30T22:16:48.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:48.517+0000 7f6861c59700 1 -- 172.21.15.156:0/3138287308 wait complete. 2023-09-30T22:16:48.530 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-30T22:16:48.530 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T22:16:48.530 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi194.front.sepia.ceph.com 2023-09-30T22:16:48.530 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-30T22:16:48.530 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T22:16:48.530 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-30T22:16:48.530 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-30T22:16:48.530 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T22:16:48.530 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:16:48.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:16:48.531 DEBUG:teuthology.orchestra.run.smithi194:> ip addr 2023-09-30T22:16:48.554 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T22:16:48.554 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T22:16:48.554 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T22:16:48.554 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:16:48.554 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2023-09-30T22:16:48.554 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:16:48.555 INFO:teuthology.orchestra.run.smithi194.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:16:48.555 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:fe brd ff:ff:ff:ff:ff:ff 2023-09-30T22:16:48.555 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f0 2023-09-30T22:16:48.555 INFO:teuthology.orchestra.run.smithi194.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:16:48.555 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:ff brd ff:ff:ff:ff:ff:ff 2023-09-30T22:16:48.555 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f1 2023-09-30T22:16:48.555 INFO:teuthology.orchestra.run.smithi194.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:16:48.555 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a4 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:16:48.555 INFO:teuthology.orchestra.run.smithi194.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T22:16:48.555 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a5 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:16:48.555 INFO:teuthology.orchestra.run.smithi194.stdout: inet 172.21.15.194/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T22:16:48.555 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft 42524sec preferred_lft 42524sec 2023-09-30T22:16:48.556 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::ec4:7aff:fe88:7ea5/64 scope link 2023-09-30T22:16:48.556 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:16:48.556 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-30T22:16:48.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:16:48.556 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2023-09-30T22:16:48.556 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2023-09-30T22:16:48.557 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link add name ceph-brx type bridge 2023-09-30T22:16:48.557 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip addr flush dev ceph-brx 2023-09-30T22:16:48.557 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set ceph-brx up 2023-09-30T22:16:48.557 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-30T22:16:48.557 DEBUG:teuthology.orchestra.run.smithi194:> ') 2023-09-30T22:16:48.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:16:48.726 DEBUG:teuthology.orchestra.run.smithi194:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T22:16:48.760 INFO:teuthology.orchestra.run.smithi194.stdout:1 2023-09-30T22:16:48.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:16:48.761 DEBUG:teuthology.orchestra.run.smithi194:> route 2023-09-30T22:16:48.850 INFO:teuthology.orchestra.run.smithi194.stdout:Kernel IP routing table 2023-09-30T22:16:48.850 INFO:teuthology.orchestra.run.smithi194.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T22:16:48.850 INFO:teuthology.orchestra.run.smithi194.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T22:16:48.850 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T22:16:48.850 INFO:teuthology.orchestra.run.smithi194.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T22:16:48.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:16:48.851 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2023-09-30T22:16:48.851 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2023-09-30T22:16:48.851 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T22:16:48.851 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T22:16:48.851 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T22:16:48.851 DEBUG:teuthology.orchestra.run.smithi194:> ') 2023-09-30T22:16:49.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:16:49.076 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2023-09-30T22:16:49.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:16:49.094 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list-id 2023-09-30T22:16:49.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:16:49.152 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2023-09-30T22:16:49.153 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2023-09-30T22:16:49.153 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:16:49.153 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-09-30T22:16:49.153 DEBUG:teuthology.orchestra.run.smithi194:> ') 2023-09-30T22:16:49.247 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-09-30T22:16:49.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:16:49.248 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2023-09-30T22:16:49.248 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2023-09-30T22:16:49.248 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-09-30T22:16:49.248 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-30T22:16:49.248 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-09-30T22:16:49.248 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-09-30T22:16:49.248 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-09-30T22:16:49.248 DEBUG:teuthology.orchestra.run.smithi194:> ') 2023-09-30T22:16:49.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:16:49.443 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2023-09-30T22:16:49.443 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2023-09-30T22:16:49.443 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set brx.0 up 2023-09-30T22:16:49.443 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set dev brx.0 master ceph-brx 2023-09-30T22:16:49.443 DEBUG:teuthology.orchestra.run.smithi194:> ') 2023-09-30T22:16:49.541 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-09-30T22:16:49.541 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:16:49.541 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-30T22:16:49.558 INFO:teuthology.orchestra.run.smithi194.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:16:49.559 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:16:49.559 DEBUG:teuthology.orchestra.run.smithi194:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-30T22:16:49.617 DEBUG:teuthology.orchestra.run.smithi194:> sudo modprobe fuse 2023-09-30T22:16:49.685 DEBUG:teuthology.orchestra.run.smithi194:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T22:16:49.744 INFO:teuthology.orchestra.run.smithi194.stdout:/sys 2023-09-30T22:16:49.744 INFO:teuthology.orchestra.run.smithi194.stdout:/proc 2023-09-30T22:16:49.744 INFO:teuthology.orchestra.run.smithi194.stdout:/dev 2023-09-30T22:16:49.744 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/security 2023-09-30T22:16:49.744 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/shm 2023-09-30T22:16:49.744 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/pts 2023-09-30T22:16:49.744 INFO:teuthology.orchestra.run.smithi194.stdout:/run 2023-09-30T22:16:49.745 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup 2023-09-30T22:16:49.745 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup/systemd 2023-09-30T22:16:49.745 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/pstore 2023-09-30T22:16:49.745 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/bpf 2023-09-30T22:16:49.745 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup/memory 2023-09-30T22:16:49.745 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup/cpuset 2023-09-30T22:16:49.745 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-09-30T22:16:49.745 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup/perf_event 2023-09-30T22:16:49.745 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup/devices 2023-09-30T22:16:49.745 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup/freezer 2023-09-30T22:16:49.745 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup/blkio 2023-09-30T22:16:49.746 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup/hugetlb 2023-09-30T22:16:49.746 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup/rdma 2023-09-30T22:16:49.746 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-09-30T22:16:49.746 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup/pids 2023-09-30T22:16:49.746 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/tracing 2023-09-30T22:16:49.746 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/config 2023-09-30T22:16:49.746 INFO:teuthology.orchestra.run.smithi194.stdout:/ 2023-09-30T22:16:49.746 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/selinux 2023-09-30T22:16:49.746 INFO:teuthology.orchestra.run.smithi194.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T22:16:49.746 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/debug 2023-09-30T22:16:49.746 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/mqueue 2023-09-30T22:16:49.746 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/hugepages 2023-09-30T22:16:49.747 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/fuse/connections 2023-09-30T22:16:49.747 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/nfs/rpc_pipefs 2023-09-30T22:16:49.747 INFO:teuthology.orchestra.run.smithi194.stdout:/run/user/1000 2023-09-30T22:16:49.747 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/ceph 2023-09-30T22:16:49.747 INFO:teuthology.orchestra.run.smithi194.stdout:/run/netns 2023-09-30T22:16:49.747 INFO:teuthology.orchestra.run.smithi194.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:16:49.747 INFO:teuthology.orchestra.run.smithi194.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:16:49.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:16:49.747 DEBUG:teuthology.orchestra.run.smithi194:> ls /sys/fs/fuse/connections 2023-09-30T22:16:49.802 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-09-30T22:16:49.803 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-09-30T22:16:49.844 DEBUG:teuthology.orchestra.run.smithi194:> sudo modprobe fuse 2023-09-30T22:16:49.873 DEBUG:teuthology.orchestra.run.smithi194:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T22:16:49.931 INFO:teuthology.orchestra.run.smithi194.stdout:/sys 2023-09-30T22:16:49.931 INFO:teuthology.orchestra.run.smithi194.stdout:/proc 2023-09-30T22:16:49.931 INFO:teuthology.orchestra.run.smithi194.stdout:/dev 2023-09-30T22:16:49.931 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/security 2023-09-30T22:16:49.931 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/shm 2023-09-30T22:16:49.931 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/pts 2023-09-30T22:16:49.931 INFO:teuthology.orchestra.run.smithi194.stdout:/run 2023-09-30T22:16:49.931 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup 2023-09-30T22:16:49.931 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup/systemd 2023-09-30T22:16:49.932 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/pstore 2023-09-30T22:16:49.932 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/bpf 2023-09-30T22:16:49.932 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup/memory 2023-09-30T22:16:49.932 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup/cpuset 2023-09-30T22:16:49.932 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-09-30T22:16:49.932 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup/perf_event 2023-09-30T22:16:49.932 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup/devices 2023-09-30T22:16:49.932 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup/freezer 2023-09-30T22:16:49.932 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup/blkio 2023-09-30T22:16:49.932 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup/hugetlb 2023-09-30T22:16:49.932 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup/rdma 2023-09-30T22:16:49.933 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-09-30T22:16:49.933 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup/pids 2023-09-30T22:16:49.933 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/tracing 2023-09-30T22:16:49.933 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/config 2023-09-30T22:16:49.933 INFO:teuthology.orchestra.run.smithi194.stdout:/ 2023-09-30T22:16:49.933 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/selinux 2023-09-30T22:16:49.933 INFO:teuthology.orchestra.run.smithi194.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T22:16:49.933 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/debug 2023-09-30T22:16:49.933 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/mqueue 2023-09-30T22:16:49.933 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/hugepages 2023-09-30T22:16:49.933 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/fuse/connections 2023-09-30T22:16:49.934 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/nfs/rpc_pipefs 2023-09-30T22:16:49.934 INFO:teuthology.orchestra.run.smithi194.stdout:/run/user/1000 2023-09-30T22:16:49.934 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/ceph 2023-09-30T22:16:49.934 INFO:teuthology.orchestra.run.smithi194.stdout:/run/netns 2023-09-30T22:16:49.934 INFO:teuthology.orchestra.run.smithi194.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:16:49.934 INFO:teuthology.orchestra.run.smithi194.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:16:49.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:16:49.934 DEBUG:teuthology.orchestra.run.smithi194:> ls /sys/fs/fuse/connections 2023-09-30T22:16:49.937 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi194.stderr:2023-09-30T22:16:49.938+0000 7fe06958d3c0 -1 init, newargv = 0x55ed08f15450 newargc=15 2023-09-30T22:16:49.937 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi194.stderr:ceph-fuse[112280]: starting ceph client 2023-09-30T22:16:49.942 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi194.stderr:ceph-fuse[112280]: starting fuse 2023-09-30T22:16:49.955 INFO:teuthology.orchestra.run.smithi194.stdout:47 2023-09-30T22:16:49.956 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-09-30T22:16:49.956 DEBUG:teuthology.orchestra.run.smithi194:> sudo stdin-killer -- python3 -c ' 2023-09-30T22:16:49.956 DEBUG:teuthology.orchestra.run.smithi194:> import glob 2023-09-30T22:16:49.956 DEBUG:teuthology.orchestra.run.smithi194:> import re 2023-09-30T22:16:49.956 DEBUG:teuthology.orchestra.run.smithi194:> import os 2023-09-30T22:16:49.956 DEBUG:teuthology.orchestra.run.smithi194:> import subprocess 2023-09-30T22:16:49.956 DEBUG:teuthology.orchestra.run.smithi194:> 2023-09-30T22:16:49.957 DEBUG:teuthology.orchestra.run.smithi194:> def _find_admin_socket(client_name): 2023-09-30T22:16:49.957 DEBUG:teuthology.orchestra.run.smithi194:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-09-30T22:16:49.957 DEBUG:teuthology.orchestra.run.smithi194:> files = glob.glob(asok_path) 2023-09-30T22:16:49.957 DEBUG:teuthology.orchestra.run.smithi194:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-09-30T22:16:49.957 DEBUG:teuthology.orchestra.run.smithi194:> 2023-09-30T22:16:49.957 DEBUG:teuthology.orchestra.run.smithi194:> # Given a non-glob path, it better be there 2023-09-30T22:16:49.957 DEBUG:teuthology.orchestra.run.smithi194:> if "*" not in asok_path: 2023-09-30T22:16:49.957 DEBUG:teuthology.orchestra.run.smithi194:> assert(len(files) == 1) 2023-09-30T22:16:49.957 DEBUG:teuthology.orchestra.run.smithi194:> return files[0] 2023-09-30T22:16:49.957 DEBUG:teuthology.orchestra.run.smithi194:> 2023-09-30T22:16:49.957 DEBUG:teuthology.orchestra.run.smithi194:> for f in files: 2023-09-30T22:16:49.957 DEBUG:teuthology.orchestra.run.smithi194:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-30T22:16:49.957 DEBUG:teuthology.orchestra.run.smithi194:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-30T22:16:49.957 DEBUG:teuthology.orchestra.run.smithi194:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-30T22:16:49.958 DEBUG:teuthology.orchestra.run.smithi194:> contents = proc_f.read() 2023-09-30T22:16:49.958 DEBUG:teuthology.orchestra.run.smithi194:> if mountpoint in contents: 2023-09-30T22:16:49.958 DEBUG:teuthology.orchestra.run.smithi194:> return f 2023-09-30T22:16:49.958 DEBUG:teuthology.orchestra.run.smithi194:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-30T22:16:49.958 DEBUG:teuthology.orchestra.run.smithi194:> 2023-09-30T22:16:49.958 DEBUG:teuthology.orchestra.run.smithi194:> print(_find_admin_socket("client.0")) 2023-09-30T22:16:49.958 DEBUG:teuthology.orchestra.run.smithi194:> ' 2023-09-30T22:16:50.080 INFO:teuthology.orchestra.run.smithi194.stdout:/var/run/ceph/ceph-client.0.112280.asok 2023-09-30T22:16:50.083 INFO:teuthology.orchestra.run.smithi194.stderr:2023-09-30T22:16:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-30T22:16:50.090 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.112280.asok 2023-09-30T22:16:50.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:16:50.090 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.112280.asok status 2023-09-30T22:16:50.241 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2023-09-30T22:16:50.241 INFO:teuthology.orchestra.run.smithi194.stdout: "metadata": { 2023-09-30T22:16:50.241 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_sha1": "eeb13ac974775bd0cce96a2c687e8bcc2faca43d", 2023-09-30T22:16:50.241 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_version": "ceph version 16.2.14-44-geeb13ac9 (eeb13ac974775bd0cce96a2c687e8bcc2faca43d) pacific (stable)", 2023-09-30T22:16:50.242 INFO:teuthology.orchestra.run.smithi194.stdout: "entity_id": "0", 2023-09-30T22:16:50.242 INFO:teuthology.orchestra.run.smithi194.stdout: "hostname": "smithi194", 2023-09-30T22:16:50.242 INFO:teuthology.orchestra.run.smithi194.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-09-30T22:16:50.242 INFO:teuthology.orchestra.run.smithi194.stdout: "pid": "112280", 2023-09-30T22:16:50.242 INFO:teuthology.orchestra.run.smithi194.stdout: "root": "/" 2023-09-30T22:16:50.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-09-30T22:16:50.243 INFO:teuthology.orchestra.run.smithi194.stdout: "dentry_count": 0, 2023-09-30T22:16:50.243 INFO:teuthology.orchestra.run.smithi194.stdout: "dentry_pinned_count": 0, 2023-09-30T22:16:50.243 INFO:teuthology.orchestra.run.smithi194.stdout: "id": 4520, 2023-09-30T22:16:50.243 INFO:teuthology.orchestra.run.smithi194.stdout: "inst": { 2023-09-30T22:16:50.244 INFO:teuthology.orchestra.run.smithi194.stdout: "name": { 2023-09-30T22:16:50.244 INFO:teuthology.orchestra.run.smithi194.stdout: "type": "client", 2023-09-30T22:16:50.244 INFO:teuthology.orchestra.run.smithi194.stdout: "num": 4520 2023-09-30T22:16:50.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-09-30T22:16:50.245 INFO:teuthology.orchestra.run.smithi194.stdout: "addr": { 2023-09-30T22:16:50.245 INFO:teuthology.orchestra.run.smithi194.stdout: "type": "v1", 2023-09-30T22:16:50.245 INFO:teuthology.orchestra.run.smithi194.stdout: "addr": "172.21.15.194:0", 2023-09-30T22:16:50.245 INFO:teuthology.orchestra.run.smithi194.stdout: "nonce": 1938707656 2023-09-30T22:16:50.245 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-09-30T22:16:50.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-09-30T22:16:50.245 INFO:teuthology.orchestra.run.smithi194.stdout: "addr": { 2023-09-30T22:16:50.245 INFO:teuthology.orchestra.run.smithi194.stdout: "type": "v1", 2023-09-30T22:16:50.245 INFO:teuthology.orchestra.run.smithi194.stdout: "addr": "172.21.15.194:0", 2023-09-30T22:16:50.245 INFO:teuthology.orchestra.run.smithi194.stdout: "nonce": 1938707656 2023-09-30T22:16:50.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-09-30T22:16:50.246 INFO:teuthology.orchestra.run.smithi194.stdout: "inst_str": "client.4520 172.21.15.194:0/1938707656", 2023-09-30T22:16:50.246 INFO:teuthology.orchestra.run.smithi194.stdout: "addr_str": "172.21.15.194:0/1938707656", 2023-09-30T22:16:50.246 INFO:teuthology.orchestra.run.smithi194.stdout: "inode_count": 1, 2023-09-30T22:16:50.246 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_epoch": 5, 2023-09-30T22:16:50.246 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_epoch": 17, 2023-09-30T22:16:50.246 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_epoch_barrier": 0, 2023-09-30T22:16:50.246 INFO:teuthology.orchestra.run.smithi194.stdout: "blocklisted": false, 2023-09-30T22:16:50.246 INFO:teuthology.orchestra.run.smithi194.stdout: "fs_name": "cephfs" 2023-09-30T22:16:50.247 INFO:teuthology.orchestra.run.smithi194.stdout:} 2023-09-30T22:16:50.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:16:50.251 DEBUG:teuthology.orchestra.run.smithi194:> stat --file-system '--printf=%T 2023-09-30T22:16:50.251 DEBUG:teuthology.orchestra.run.smithi194:> ' -- /home/ubuntu/cephtest/mnt.0 2023-09-30T22:16:50.269 INFO:teuthology.orchestra.run.smithi194.stdout:fuseblk 2023-09-30T22:16:50.269 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-09-30T22:16:50.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:16:50.270 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-30T22:16:50.337 INFO:teuthology.run_tasks:Running task mds_pre_upgrade... 2023-09-30T22:16:50.348 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:16:50.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.476+0000 7fbce11f6700 1 Processor -- start 2023-09-30T22:16:50.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.476+0000 7fbce11f6700 1 -- start start 2023-09-30T22:16:50.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.477+0000 7fbce11f6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbcdc095e70 0x7fbcdc096250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:50.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.477+0000 7fbce11f6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbcdc12d250 0x7fbcdc12f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:50.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.477+0000 7fbce11f6700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcdc094ba0 con 0x7fbcdc093950 2023-09-30T22:16:50.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.477+0000 7fbce11f6700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcdc092e90 con 0x7fbcdc095e70 2023-09-30T22:16:50.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.477+0000 7fbce11f6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc096b60 con 0x7fbcdc12d250 2023-09-30T22:16:50.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.477+0000 7fbcda59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbcdc095e70 0x7fbcdc096250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:50.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.477+0000 7fbcdad9d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fbcdc093950 0x7fbcdc095760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47484/0 (socket says 172.21.15.156:47484) 2023-09-30T22:16:50.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.477+0000 7fbcdad9d700 1 -- 172.21.15.156:0/218213298 learned_addr learned my addr 172.21.15.156:0/218213298 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:50.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.477+0000 7fbcdb59e700 1 --2- 172.21.15.156:0/218213298 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbcdc12d250 0x7fbcdc12f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:50.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.477+0000 7fbcd9d9b700 1 -- 172.21.15.156:0/218213298 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 85196034 0 0) 0x7fbcdc094ba0 con 0x7fbcdc093950 2023-09-30T22:16:50.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.477+0000 7fbcd9d9b700 1 -- 172.21.15.156:0/218213298 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcc40033f0 con 0x7fbcdc093950 2023-09-30T22:16:50.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.477+0000 7fbcda59c700 1 -- 172.21.15.156:0/218213298 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbcdc12d250 msgr2=0x7fbcdc12f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:50.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.477+0000 7fbcda59c700 1 --2- 172.21.15.156:0/218213298 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbcdc12d250 0x7fbcdc12f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:50.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.477+0000 7fbcda59c700 1 -- 172.21.15.156:0/218213298 >> v1:172.21.15.156:6789/0 conn(0x7fbcdc093950 legacy=0x7fbcdc095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:50.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.477+0000 7fbcda59c700 1 -- 172.21.15.156:0/218213298 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcdc093150 con 0x7fbcdc095e70 2023-09-30T22:16:50.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.477+0000 7fbcda59c700 1 --2- 172.21.15.156:0/218213298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcdc095e70 0x7fbcdc096250 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fbccc009760 tx=0x7fbccc009060).ready entity=mon.0 client_cookie=9616604555bdca16 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:50.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.477+0000 7fbcd9d9b700 1 -- 172.21.15.156:0/218213298 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc0090d0 con 0x7fbcdc095e70 2023-09-30T22:16:50.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.477+0000 7fbcd9d9b700 1 -- 172.21.15.156:0/218213298 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbccc00d4a0 con 0x7fbcdc095e70 2023-09-30T22:16:50.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.477+0000 7fbcd9d9b700 1 -- 172.21.15.156:0/218213298 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc00d820 con 0x7fbcdc095e70 2023-09-30T22:16:50.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.478+0000 7fbce11f6700 1 -- 172.21.15.156:0/218213298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcdc095e70 msgr2=0x7fbcdc096250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:50.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.478+0000 7fbce11f6700 1 --2- 172.21.15.156:0/218213298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcdc095e70 0x7fbcdc096250 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fbccc009760 tx=0x7fbccc009060).stop 2023-09-30T22:16:50.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.478+0000 7fbce11f6700 1 -- 172.21.15.156:0/218213298 shutdown_connections 2023-09-30T22:16:50.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.478+0000 7fbce11f6700 1 --2- 172.21.15.156:0/218213298 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbcdc12d250 0x7fbcdc12f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:50.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.478+0000 7fbce11f6700 1 --2- 172.21.15.156:0/218213298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcdc095e70 0x7fbcdc096250 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:50.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.478+0000 7fbce11f6700 1 -- 172.21.15.156:0/218213298 >> 172.21.15.156:0/218213298 conn(0x7fbcdc09aa50 msgr2=0x7fbcdc09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:50.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.478+0000 7fbce11f6700 1 -- 172.21.15.156:0/218213298 shutdown_connections 2023-09-30T22:16:50.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.478+0000 7fbce11f6700 1 -- 172.21.15.156:0/218213298 wait complete. 2023-09-30T22:16:50.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.479+0000 7fbce11f6700 1 Processor -- start 2023-09-30T22:16:50.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.479+0000 7fbce11f6700 1 -- start start 2023-09-30T22:16:50.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.479+0000 7fbce11f6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcdc093950 0x7fbcdc117d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:50.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.479+0000 7fbce11f6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbcdc095e70 0x7fbcdc118220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:50.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.479+0000 7fbce11f6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbcdc12d250 0x7fbcdc118710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:50.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.479+0000 7fbce11f6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc118c00 con 0x7fbcdc093950 2023-09-30T22:16:50.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.479+0000 7fbce11f6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc092410 con 0x7fbcdc12d250 2023-09-30T22:16:50.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.479+0000 7fbce11f6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc1191a0 con 0x7fbcdc095e70 2023-09-30T22:16:50.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.480+0000 7fbcdad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcdc093950 0x7fbcdc117d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:50.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.480+0000 7fbcda59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbcdc095e70 0x7fbcdc118220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:50.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.480+0000 7fbcdad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcdc093950 0x7fbcdc117d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:35900/0 (socket says 172.21.15.156:35900) 2023-09-30T22:16:50.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.480+0000 7fbcdad9d700 1 -- 172.21.15.156:0/3884580747 learned_addr learned my addr 172.21.15.156:0/3884580747 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:50.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.480+0000 7fbcdb59e700 1 --2- 172.21.15.156:0/3884580747 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbcdc12d250 0x7fbcdc118710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:50.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.480+0000 7fbcdad9d700 1 -- 172.21.15.156:0/3884580747 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbcdc095e70 msgr2=0x7fbcdc118220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:50.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.480+0000 7fbcdad9d700 1 --2- 172.21.15.156:0/3884580747 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbcdc095e70 0x7fbcdc118220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:50.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.480+0000 7fbcdad9d700 1 -- 172.21.15.156:0/3884580747 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbcdc12d250 msgr2=0x7fbcdc118710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:50.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.480+0000 7fbcdad9d700 1 --2- 172.21.15.156:0/3884580747 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbcdc12d250 0x7fbcdc118710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:50.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.480+0000 7fbcdad9d700 1 -- 172.21.15.156:0/3884580747 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbccc0092a0 con 0x7fbcdc093950 2023-09-30T22:16:50.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.480+0000 7fbcda59c700 1 --2- 172.21.15.156:0/3884580747 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbcdc095e70 0x7fbcdc118220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:50.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.480+0000 7fbcdad9d700 1 --2- 172.21.15.156:0/3884580747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcdc093950 0x7fbcdc117d30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fbcd000c590 tx=0x7fbcd0007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:50.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.480+0000 7fbcc2ffd700 1 -- 172.21.15.156:0/3884580747 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd00072e0 con 0x7fbcdc093950 2023-09-30T22:16:50.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.480+0000 7fbcc2ffd700 1 -- 172.21.15.156:0/3884580747 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd0007440 con 0x7fbcdc093950 2023-09-30T22:16:50.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.480+0000 7fbce11f6700 1 -- 172.21.15.156:0/3884580747 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcdc12ced0 con 0x7fbcdc093950 2023-09-30T22:16:50.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.480+0000 7fbcc2ffd700 1 -- 172.21.15.156:0/3884580747 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd00057a0 con 0x7fbcdc093950 2023-09-30T22:16:50.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.480+0000 7fbce11f6700 1 -- 172.21.15.156:0/3884580747 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcdc11b2c0 con 0x7fbcdc093950 2023-09-30T22:16:50.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.481+0000 7fbcc2ffd700 1 -- 172.21.15.156:0/3884580747 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fbcd0005bd0 con 0x7fbcdc093950 2023-09-30T22:16:50.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.481+0000 7fbcc2ffd700 1 -- 172.21.15.156:0/3884580747 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fbcd003a6f0 con 0x7fbcdc093950 2023-09-30T22:16:50.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.481+0000 7fbce11f6700 1 -- 172.21.15.156:0/3884580747 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcdc11b4c0 con 0x7fbcdc093950 2023-09-30T22:16:50.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.486+0000 7fbcc2ffd700 1 -- 172.21.15.156:0/3884580747 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fbcdc11b4c0 con 0x7fbcdc093950 2023-09-30T22:16:50.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.646+0000 7fbce11f6700 1 -- 172.21.15.156:0/3884580747 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbcdc11b4c0 con 0x7fbcdc093950 2023-09-30T22:16:50.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.646+0000 7fbcc2ffd700 1 -- 172.21.15.156:0/3884580747 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11372 (secure 0 0 0) 0x7fbcdc11b4c0 con 0x7fbcdc093950 2023-09-30T22:16:50.647 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:50.647 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":17,"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","created":"2023-09-30T22:16:15.239992+0000","modified":"2023-09-30T22:16:48.039226+0000","last_up_change":"2023-09-30T22:16:23.392557+0000","last_in_change":"2023-09-30T22:16:16.474206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:16:23.433906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:16:24.367795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:16:28.204677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:16:28.762804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3ec2e78a-c61f-473a-bfcb-f956cffe4095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6812","nonce":118781}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6813","nonce":118781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6815","nonce":118781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6814","nonce":118781}]},"public_addr":"172.21.15.156:6812/118781","cluster_addr":"172.21.15.156:6813/118781","heartbeat_back_addr":"172.21.15.156:6815/118781","heartbeat_front_addr":"172.21.15.156:6814/118781","state":["exists","up"]},{"osd":1,"uuid":"b682e683-c15a-4bd9-8712-8af96454e9ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6803","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6805","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6807","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6806","nonce":118763}]},"public_addr":"172.21.15.156:6803/118763","cluster_addr":"172.21.15.156:6805/118763","heartbeat_back_addr":"172.21.15.156:6807/118763","heartbeat_front_addr":"172.21.15.156:6806/118763","state":["exists","up"]},{"osd":2,"uuid":"960dbaf0-2e0c-437e-9114-bc22ce522b26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6808","nonce":118788}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6809","nonce":118788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6811","nonce":118788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6810","nonce":118788}]},"public_addr":"172.21.15.156:6808/118788","cluster_addr":"172.21.15.156:6809/118788","heartbeat_back_addr":"172.21.15.156:6811/118788","heartbeat_front_addr":"172.21.15.156:6810/118788","state":["exists","up"]},{"osd":3,"uuid":"c1b19714-78b1-4869-8721-2f6352a64a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6800","nonce":118764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6801","nonce":118764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6804","nonce":118764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6802","nonce":118764}]},"public_addr":"172.21.15.156:6800/118764","cluster_addr":"172.21.15.156:6801/118764","heartbeat_back_addr":"172.21.15.156:6804/118764","heartbeat_front_addr":"172.21.15.156:6802/118764","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.663343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.827397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.806655+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.634746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:16:50.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.648+0000 7fbce11f6700 1 -- 172.21.15.156:0/3884580747 >> v1:172.21.15.156:6816/118236 conn(0x7fbcc802bb60 legacy=0x7fbcc802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:50.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.648+0000 7fbce11f6700 1 -- 172.21.15.156:0/3884580747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcdc093950 msgr2=0x7fbcdc117d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:50.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.648+0000 7fbce11f6700 1 --2- 172.21.15.156:0/3884580747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcdc093950 0x7fbcdc117d30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fbcd000c590 tx=0x7fbcd0007c80).stop 2023-09-30T22:16:50.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.648+0000 7fbce11f6700 1 -- 172.21.15.156:0/3884580747 shutdown_connections 2023-09-30T22:16:50.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.648+0000 7fbce11f6700 1 --2- 172.21.15.156:0/3884580747 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbcdc12d250 0x7fbcdc118710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:50.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.648+0000 7fbce11f6700 1 --2- 172.21.15.156:0/3884580747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcdc093950 0x7fbcdc117d30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:50.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.648+0000 7fbce11f6700 1 --2- 172.21.15.156:0/3884580747 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbcdc095e70 0x7fbcdc118220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:50.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.648+0000 7fbce11f6700 1 -- 172.21.15.156:0/3884580747 >> 172.21.15.156:0/3884580747 conn(0x7fbcdc09aa50 msgr2=0x7fbcdc062b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:50.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.648+0000 7fbce11f6700 1 -- 172.21.15.156:0/3884580747 shutdown_connections 2023-09-30T22:16:50.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.648+0000 7fbce11f6700 1 -- 172.21.15.156:0/3884580747 wait complete. 2023-09-30T22:16:50.661 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-09-30T22:16:23.433906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:16:24.367795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:16:28.204677+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:16:28.762804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T22:16:50.661 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-09-30T22:16:50.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.780+0000 7f3573256700 1 Processor -- start 2023-09-30T22:16:50.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.780+0000 7f3573256700 1 -- start start 2023-09-30T22:16:50.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.780+0000 7f3573256700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f356c095630 0x7f356c095a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:50.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.780+0000 7f3573256700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f356c12e580 0x7f356c130970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:50.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.780+0000 7f3573256700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356c0914a0 con 0x7f356c095f00 2023-09-30T22:16:50.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.780+0000 7f3573256700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f356c062860 con 0x7f356c095630 2023-09-30T22:16:50.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.780+0000 7f3573256700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356c092730 con 0x7f356c12e580 2023-09-30T22:16:50.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.781+0000 7f35717f3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f356c12e580 0x7f356c130970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:50.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.781+0000 7f3570ff2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f356c095630 0x7f356c095a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:50.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.781+0000 7f3570ff2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f356c095630 0x7f356c095a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:35908/0 (socket says 172.21.15.156:35908) 2023-09-30T22:16:50.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.781+0000 7f35717f3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f356c12e580 0x7f356c130970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54750/0 (socket says 172.21.15.156:54750) 2023-09-30T22:16:50.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.781+0000 7f3570ff2700 1 -- 172.21.15.156:0/231227758 learned_addr learned my addr 172.21.15.156:0/231227758 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:50.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.781+0000 7f356bfff700 1 --1- 172.21.15.156:0/231227758 >> v1:172.21.15.156:6789/0 conn(0x7f356c095f00 0x7f356c12ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47490/0 (socket says 172.21.15.156:47490) 2023-09-30T22:16:50.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.781+0000 7f3570ff2700 1 -- 172.21.15.156:0/231227758 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f356c12e580 msgr2=0x7f356c130970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:50.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.781+0000 7f3570ff2700 1 --2- 172.21.15.156:0/231227758 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f356c12e580 0x7f356c130970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:50.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.781+0000 7f3570ff2700 1 -- 172.21.15.156:0/231227758 >> v1:172.21.15.156:6789/0 conn(0x7f356c095f00 legacy=0x7f356c12ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:50.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.781+0000 7f3570ff2700 1 -- 172.21.15.156:0/231227758 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356c093310 con 0x7f356c095630 2023-09-30T22:16:50.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.781+0000 7f356b7fe700 1 -- 172.21.15.156:0/231227758 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488046539 0 0) 0x7f356c0914a0 con 0x7f356c095f00 2023-09-30T22:16:50.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.781+0000 7f35717f3700 1 --2- 172.21.15.156:0/231227758 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f356c12e580 0x7f356c130970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:50.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.781+0000 7f3570ff2700 1 --2- 172.21.15.156:0/231227758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f356c095630 0x7f356c095a10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f3560006fd0 tx=0x7f35600090f0).ready entity=mon.0 client_cookie=e966a016fb99cd32 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:50.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.781+0000 7f356b7fe700 1 -- 172.21.15.156:0/231227758 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356000b580 con 0x7f356c095630 2023-09-30T22:16:50.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.781+0000 7f356b7fe700 1 -- 172.21.15.156:0/231227758 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356000b6e0 con 0x7f356c095630 2023-09-30T22:16:50.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.781+0000 7f356b7fe700 1 -- 172.21.15.156:0/231227758 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356000ba60 con 0x7f356c095630 2023-09-30T22:16:50.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.782+0000 7f3573256700 1 -- 172.21.15.156:0/231227758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f356c095630 msgr2=0x7f356c095a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:50.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.782+0000 7f3573256700 1 --2- 172.21.15.156:0/231227758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f356c095630 0x7f356c095a10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f3560006fd0 tx=0x7f35600090f0).stop 2023-09-30T22:16:50.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.782+0000 7f3573256700 1 -- 172.21.15.156:0/231227758 shutdown_connections 2023-09-30T22:16:50.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.782+0000 7f3573256700 1 --2- 172.21.15.156:0/231227758 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f356c12e580 0x7f356c130970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:50.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.782+0000 7f3573256700 1 --2- 172.21.15.156:0/231227758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f356c095630 0x7f356c095a10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:50.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.782+0000 7f3573256700 1 -- 172.21.15.156:0/231227758 >> 172.21.15.156:0/231227758 conn(0x7f356c09a6c0 msgr2=0x7f356c096790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:50.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.782+0000 7f3573256700 1 -- 172.21.15.156:0/231227758 shutdown_connections 2023-09-30T22:16:50.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.782+0000 7f3573256700 1 -- 172.21.15.156:0/231227758 wait complete. 2023-09-30T22:16:50.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.783+0000 7f3573256700 1 Processor -- start 2023-09-30T22:16:50.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.783+0000 7f3573256700 1 -- start start 2023-09-30T22:16:50.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.783+0000 7f3573256700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f356c095630 0x7f356c08d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:50.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.783+0000 7f3573256700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f356c095f00 0x7f356c08a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:50.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.783+0000 7f3573256700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f356c12e580 0x7f356c08a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:50.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.783+0000 7f3573256700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c08b770 con 0x7f356c095f00 2023-09-30T22:16:50.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.783+0000 7f3573256700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356c08d7a0 con 0x7f356c12e580 2023-09-30T22:16:50.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.783+0000 7f3573256700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f356c08dd40 con 0x7f356c095630 2023-09-30T22:16:50.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.783+0000 7f3570ff2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f356c095630 0x7f356c08d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:50.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.783+0000 7f356bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f356c095f00 0x7f356c08a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:50.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.783+0000 7f35717f3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f356c12e580 0x7f356c08a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:50.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.783+0000 7f3570ff2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f356c095630 0x7f356c08d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:40274/0 (socket says 172.21.15.156:40274) 2023-09-30T22:16:50.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.783+0000 7f3570ff2700 1 -- 172.21.15.156:0/156368017 learned_addr learned my addr 172.21.15.156:0/156368017 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:50.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.784+0000 7f35717f3700 1 -- 172.21.15.156:0/156368017 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f356c095630 msgr2=0x7f356c08d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:50.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.784+0000 7f35717f3700 1 --2- 172.21.15.156:0/156368017 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f356c095630 0x7f356c08d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:50.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.784+0000 7f35717f3700 1 -- 172.21.15.156:0/156368017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f356c095f00 msgr2=0x7f356c08a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:50.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.784+0000 7f35717f3700 1 --2- 172.21.15.156:0/156368017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f356c095f00 0x7f356c08a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:50.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.784+0000 7f35717f3700 1 -- 172.21.15.156:0/156368017 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3564009a20 con 0x7f356c12e580 2023-09-30T22:16:50.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.784+0000 7f356bfff700 1 --2- 172.21.15.156:0/156368017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f356c095f00 0x7f356c08a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:50.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.784+0000 7f35717f3700 1 --2- 172.21.15.156:0/156368017 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f356c12e580 0x7f356c08a860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f356400b430 tx=0x7f356400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:50.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.784+0000 7f3568ff9700 1 -- 172.21.15.156:0/156368017 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3564015070 con 0x7f356c12e580 2023-09-30T22:16:50.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.784+0000 7f3568ff9700 1 -- 172.21.15.156:0/156368017 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356400be40 con 0x7f356c12e580 2023-09-30T22:16:50.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.784+0000 7f3573256700 1 -- 172.21.15.156:0/156368017 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3560009370 con 0x7f356c12e580 2023-09-30T22:16:50.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.784+0000 7f3568ff9700 1 -- 172.21.15.156:0/156368017 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356401a630 con 0x7f356c12e580 2023-09-30T22:16:50.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.784+0000 7f3573256700 1 -- 172.21.15.156:0/156368017 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356c08e240 con 0x7f356c12e580 2023-09-30T22:16:50.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.785+0000 7f3568ff9700 1 -- 172.21.15.156:0/156368017 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f356401aa60 con 0x7f356c12e580 2023-09-30T22:16:50.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.785+0000 7f3568ff9700 1 -- 172.21.15.156:0/156368017 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f356403fac0 con 0x7f356c12e580 2023-09-30T22:16:50.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.785+0000 7f3573256700 1 -- 172.21.15.156:0/156368017 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f356c069380 con 0x7f356c12e580 2023-09-30T22:16:50.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.789+0000 7f3568ff9700 1 -- 172.21.15.156:0/156368017 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f356401ad10 con 0x7f356c12e580 2023-09-30T22:16:50.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.946+0000 7f3573256700 1 -- 172.21.15.156:0/156368017 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f356c05a260 con 0x7f356c12e580 2023-09-30T22:16:50.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.947+0000 7f3568ff9700 1 -- 172.21.15.156:0/156368017 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3564007af0 con 0x7f356c12e580 2023-09-30T22:16:50.947 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 1 2023-09-30T22:16:50.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.948+0000 7f3573256700 1 -- 172.21.15.156:0/156368017 >> v1:172.21.15.156:6816/118236 conn(0x7f355002bb90 legacy=0x7f355002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:50.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.948+0000 7f3573256700 1 -- 172.21.15.156:0/156368017 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f356c12e580 msgr2=0x7f356c08a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:50.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.948+0000 7f3573256700 1 --2- 172.21.15.156:0/156368017 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f356c12e580 0x7f356c08a860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f356400b430 tx=0x7f356400b040).stop 2023-09-30T22:16:50.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.948+0000 7f3573256700 1 -- 172.21.15.156:0/156368017 shutdown_connections 2023-09-30T22:16:50.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.948+0000 7f3573256700 1 --2- 172.21.15.156:0/156368017 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f356c12e580 0x7f356c08a860 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:50.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.948+0000 7f3573256700 1 --2- 172.21.15.156:0/156368017 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f356c095630 0x7f356c08d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:50.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.948+0000 7f3573256700 1 --2- 172.21.15.156:0/156368017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f356c095f00 0x7f356c08a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:50.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.949+0000 7f3573256700 1 -- 172.21.15.156:0/156368017 >> 172.21.15.156:0/156368017 conn(0x7f356c09a6c0 msgr2=0x7f356c069690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:50.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.949+0000 7f3573256700 1 -- 172.21.15.156:0/156368017 shutdown_connections 2023-09-30T22:16:50.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:50.949+0000 7f3573256700 1 -- 172.21.15.156:0/156368017 wait complete. 2023-09-30T22:16:50.961 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:16:51.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.081+0000 7fad7dbdd700 1 Processor -- start 2023-09-30T22:16:51.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.081+0000 7fad7dbdd700 1 -- start start 2023-09-30T22:16:51.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.082+0000 7fad7dbdd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fad7812b470 0x7fad7812fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:51.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.082+0000 7fad7dbdd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad78130390 0x7fad78132780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:51.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.082+0000 7fad7dbdd700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad78097ac0 con 0x7fad7805f560 2023-09-30T22:16:51.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.082+0000 7fad7dbdd700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad7805f940 con 0x7fad7812b470 2023-09-30T22:16:51.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.082+0000 7fad7dbdd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7812ab20 con 0x7fad78130390 2023-09-30T22:16:51.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.082+0000 7fad76ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fad7812b470 0x7fad7812fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:51.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.082+0000 7fad77fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad78130390 0x7fad78132780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:51.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.082+0000 7fad777fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fad7805f560 0x7fad7812ad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47500/0 (socket says 172.21.15.156:47500) 2023-09-30T22:16:51.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.082+0000 7fad777fe700 1 -- 172.21.15.156:0/3338339404 learned_addr learned my addr 172.21.15.156:0/3338339404 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:51.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.082+0000 7fad77fff700 1 -- 172.21.15.156:0/3338339404 >> v2:172.21.15.156:3300/0 conn(0x7fad7812b470 msgr2=0x7fad7812fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:51.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.082+0000 7fad77fff700 1 --2- 172.21.15.156:0/3338339404 >> v2:172.21.15.156:3300/0 conn(0x7fad7812b470 0x7fad7812fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.082+0000 7fad77fff700 1 -- 172.21.15.156:0/3338339404 >> v1:172.21.15.156:6789/0 conn(0x7fad7805f560 legacy=0x7fad7812ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:51.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.082+0000 7fad77fff700 1 -- 172.21.15.156:0/3338339404 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad78066f90 con 0x7fad78130390 2023-09-30T22:16:51.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.082+0000 7fad767fc700 1 -- 172.21.15.156:0/3338339404 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2871184592 0 0) 0x7fad78097ac0 con 0x7fad7805f560 2023-09-30T22:16:51.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.082+0000 7fad76ffd700 1 --2- 172.21.15.156:0/3338339404 >> v2:172.21.15.156:3300/0 conn(0x7fad7812b470 0x7fad7812fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:51.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.082+0000 7fad77fff700 1 --2- 172.21.15.156:0/3338339404 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad78130390 0x7fad78132780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fad70009e60 tx=0x7fad70009780).ready entity=mon.1 client_cookie=96f55329ac7aee88 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:51.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.083+0000 7fad767fc700 1 -- 172.21.15.156:0/3338339404 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7000e070 con 0x7fad78130390 2023-09-30T22:16:51.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.083+0000 7fad767fc700 1 -- 172.21.15.156:0/3338339404 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7000bb60 con 0x7fad78130390 2023-09-30T22:16:51.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.083+0000 7fad767fc700 1 -- 172.21.15.156:0/3338339404 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad70012410 con 0x7fad78130390 2023-09-30T22:16:51.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.083+0000 7fad7dbdd700 1 -- 172.21.15.156:0/3338339404 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad78130390 msgr2=0x7fad78132780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:51.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.083+0000 7fad7dbdd700 1 --2- 172.21.15.156:0/3338339404 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad78130390 0x7fad78132780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fad70009e60 tx=0x7fad70009780).stop 2023-09-30T22:16:51.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.083+0000 7fad7dbdd700 1 -- 172.21.15.156:0/3338339404 shutdown_connections 2023-09-30T22:16:51.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.083+0000 7fad7dbdd700 1 --2- 172.21.15.156:0/3338339404 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad78130390 0x7fad78132780 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.083+0000 7fad7dbdd700 1 --2- 172.21.15.156:0/3338339404 >> v2:172.21.15.156:3300/0 conn(0x7fad7812b470 0x7fad7812fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.083+0000 7fad7dbdd700 1 -- 172.21.15.156:0/3338339404 >> 172.21.15.156:0/3338339404 conn(0x7fad7809a1c0 msgr2=0x7fad7809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:51.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.083+0000 7fad7dbdd700 1 -- 172.21.15.156:0/3338339404 shutdown_connections 2023-09-30T22:16:51.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.083+0000 7fad7dbdd700 1 -- 172.21.15.156:0/3338339404 wait complete. 2023-09-30T22:16:51.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.084+0000 7fad7dbdd700 1 Processor -- start 2023-09-30T22:16:51.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.084+0000 7fad7dbdd700 1 -- start start 2023-09-30T22:16:51.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.085+0000 7fad7dbdd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad7805f560 0x7fad781170b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:51.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.085+0000 7fad7dbdd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad7812b470 0x7fad78113080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:51.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.085+0000 7fad7dbdd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad78130390 0x7fad78113570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:51.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.085+0000 7fad7dbdd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad780671c0 con 0x7fad7805f560 2023-09-30T22:16:51.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.085+0000 7fad7dbdd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad78129230 con 0x7fad7812b470 2023-09-30T22:16:51.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.085+0000 7fad7dbdd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad78116bb0 con 0x7fad78130390 2023-09-30T22:16:51.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.085+0000 7fad777fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad7805f560 0x7fad781170b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:51.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.085+0000 7fad777fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad7805f560 0x7fad781170b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:35946/0 (socket says 172.21.15.156:35946) 2023-09-30T22:16:51.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.085+0000 7fad777fe700 1 -- 172.21.15.156:0/1431422283 learned_addr learned my addr 172.21.15.156:0/1431422283 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:51.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.085+0000 7fad77fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad78130390 0x7fad78113570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:51.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.085+0000 7fad76ffd700 1 --2- 172.21.15.156:0/1431422283 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad7812b470 0x7fad78113080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:51.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.085+0000 7fad777fe700 1 -- 172.21.15.156:0/1431422283 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad78130390 msgr2=0x7fad78113570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:51.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.085+0000 7fad777fe700 1 --2- 172.21.15.156:0/1431422283 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad78130390 0x7fad78113570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.085+0000 7fad777fe700 1 -- 172.21.15.156:0/1431422283 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad7812b470 msgr2=0x7fad78113080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:51.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.085+0000 7fad777fe700 1 --2- 172.21.15.156:0/1431422283 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad7812b470 0x7fad78113080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.085+0000 7fad777fe700 1 -- 172.21.15.156:0/1431422283 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad680092a0 con 0x7fad7805f560 2023-09-30T22:16:51.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.085+0000 7fad76ffd700 1 --2- 172.21.15.156:0/1431422283 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad7812b470 0x7fad78113080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:51.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.085+0000 7fad777fe700 1 --2- 172.21.15.156:0/1431422283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad7805f560 0x7fad781170b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fad6c00c4a0 tx=0x7fad6c007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:51.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.085+0000 7fad5f7fe700 1 -- 172.21.15.156:0/1431422283 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c00ce50 con 0x7fad7805f560 2023-09-30T22:16:51.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.085+0000 7fad5f7fe700 1 -- 172.21.15.156:0/1431422283 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6c0072e0 con 0x7fad7805f560 2023-09-30T22:16:51.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.085+0000 7fad5f7fe700 1 -- 172.21.15.156:0/1431422283 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c007660 con 0x7fad7805f560 2023-09-30T22:16:51.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.085+0000 7fad7dbdd700 1 -- 172.21.15.156:0/1431422283 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad70009a20 con 0x7fad7805f560 2023-09-30T22:16:51.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.085+0000 7fad7dbdd700 1 -- 172.21.15.156:0/1431422283 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad78114480 con 0x7fad7805f560 2023-09-30T22:16:51.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.086+0000 7fad5f7fe700 1 -- 172.21.15.156:0/1431422283 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fad6c0059b0 con 0x7fad7805f560 2023-09-30T22:16:51.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.086+0000 7fad5f7fe700 1 -- 172.21.15.156:0/1431422283 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fad6c03a6b0 con 0x7fad7805f560 2023-09-30T22:16:51.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.086+0000 7fad7dbdd700 1 -- 172.21.15.156:0/1431422283 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad781169d0 con 0x7fad7805f560 2023-09-30T22:16:51.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.090+0000 7fad5f7fe700 1 -- 172.21.15.156:0/1431422283 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fad6c013970 con 0x7fad7805f560 2023-09-30T22:16:51.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.247+0000 7fad7dbdd700 1 -- 172.21.15.156:0/1431422283 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fad7805a260 con 0x7fad7805f560 2023-09-30T22:16:51.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.248+0000 7fad5f7fe700 1 -- 172.21.15.156:0/1431422283 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7fad6c010300 con 0x7fad7805f560 2023-09-30T22:16:51.248 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 8 2023-09-30T22:16:51.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.249+0000 7fad7dbdd700 1 -- 172.21.15.156:0/1431422283 >> v1:172.21.15.156:6816/118236 conn(0x7fad6402bb60 legacy=0x7fad6402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:51.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.249+0000 7fad7dbdd700 1 -- 172.21.15.156:0/1431422283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad7805f560 msgr2=0x7fad781170b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:51.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.249+0000 7fad7dbdd700 1 --2- 172.21.15.156:0/1431422283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad7805f560 0x7fad781170b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fad6c00c4a0 tx=0x7fad6c007c30).stop 2023-09-30T22:16:51.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.250+0000 7fad7dbdd700 1 -- 172.21.15.156:0/1431422283 shutdown_connections 2023-09-30T22:16:51.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.250+0000 7fad7dbdd700 1 --2- 172.21.15.156:0/1431422283 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad78130390 0x7fad78113570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.250+0000 7fad7dbdd700 1 --2- 172.21.15.156:0/1431422283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad7805f560 0x7fad781170b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.250+0000 7fad7dbdd700 1 --2- 172.21.15.156:0/1431422283 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad7812b470 0x7fad78113080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.250+0000 7fad7dbdd700 1 -- 172.21.15.156:0/1431422283 >> 172.21.15.156:0/1431422283 conn(0x7fad7809a1c0 msgr2=0x7fad780995e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:51.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.250+0000 7fad7dbdd700 1 -- 172.21.15.156:0/1431422283 shutdown_connections 2023-09-30T22:16:51.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.250+0000 7fad7dbdd700 1 -- 172.21.15.156:0/1431422283 wait complete. 2023-09-30T22:16:51.263 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:16:51.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.382+0000 7feb30729700 1 Processor -- start 2023-09-30T22:16:51.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.382+0000 7feb30729700 1 -- start start 2023-09-30T22:16:51.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.382+0000 7feb30729700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb28093950 0x7feb28095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:51.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.382+0000 7feb30729700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb28095c50 0x7feb28096030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:51.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.382+0000 7feb30729700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb28094ba0 con 0x7feb2812c240 2023-09-30T22:16:51.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.382+0000 7feb30729700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb28092e90 con 0x7feb28093950 2023-09-30T22:16:51.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.382+0000 7feb30729700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb28096b60 con 0x7feb28095c50 2023-09-30T22:16:51.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.382+0000 7feb2e4c5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb28093950 0x7feb28095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:51.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.382+0000 7feb2dcc4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb28095c50 0x7feb28096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:51.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.382+0000 7feb2ecc6700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7feb2812c240 0x7feb2812e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:39272/0 (socket says 172.21.15.156:39272) 2023-09-30T22:16:51.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.382+0000 7feb2ecc6700 1 -- 172.21.15.156:0/4284435149 learned_addr learned my addr 172.21.15.156:0/4284435149 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:51.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.383+0000 7feb2d4c3700 1 -- 172.21.15.156:0/4284435149 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1425603552 0 0) 0x7feb28094ba0 con 0x7feb2812c240 2023-09-30T22:16:51.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.383+0000 7feb2d4c3700 1 -- 172.21.15.156:0/4284435149 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb140033f0 con 0x7feb2812c240 2023-09-30T22:16:51.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.383+0000 7feb2dcc4700 1 -- 172.21.15.156:0/4284435149 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb28093950 msgr2=0x7feb28095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:51.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.383+0000 7feb2dcc4700 1 --2- 172.21.15.156:0/4284435149 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb28093950 0x7feb28095760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.383+0000 7feb2dcc4700 1 -- 172.21.15.156:0/4284435149 >> v1:172.21.15.156:6789/0 conn(0x7feb2812c240 legacy=0x7feb2812e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:51.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.383+0000 7feb2dcc4700 1 -- 172.21.15.156:0/4284435149 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb28093150 con 0x7feb28095c50 2023-09-30T22:16:51.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.383+0000 7feb2e4c5700 1 --2- 172.21.15.156:0/4284435149 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb28093950 0x7feb28095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:51.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.383+0000 7feb2dcc4700 1 --2- 172.21.15.156:0/4284435149 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb28095c50 0x7feb28096030 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7feb18009790 tx=0x7feb18009060).ready entity=mon.2 client_cookie=551543aef9c97b75 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:51.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.383+0000 7feb2d4c3700 1 -- 172.21.15.156:0/4284435149 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb180090d0 con 0x7feb28095c50 2023-09-30T22:16:51.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.383+0000 7feb2d4c3700 1 -- 172.21.15.156:0/4284435149 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1800f510 con 0x7feb28095c50 2023-09-30T22:16:51.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.383+0000 7feb2d4c3700 1 -- 172.21.15.156:0/4284435149 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1800f890 con 0x7feb28095c50 2023-09-30T22:16:51.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.384+0000 7feb30729700 1 -- 172.21.15.156:0/4284435149 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb28095c50 msgr2=0x7feb28096030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:51.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.384+0000 7feb30729700 1 --2- 172.21.15.156:0/4284435149 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb28095c50 0x7feb28096030 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7feb18009790 tx=0x7feb18009060).stop 2023-09-30T22:16:51.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.384+0000 7feb30729700 1 -- 172.21.15.156:0/4284435149 shutdown_connections 2023-09-30T22:16:51.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.384+0000 7feb30729700 1 --2- 172.21.15.156:0/4284435149 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb28093950 0x7feb28095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.384+0000 7feb30729700 1 --2- 172.21.15.156:0/4284435149 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb28095c50 0x7feb28096030 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.384+0000 7feb30729700 1 -- 172.21.15.156:0/4284435149 >> 172.21.15.156:0/4284435149 conn(0x7feb2809aa50 msgr2=0x7feb2809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:51.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.384+0000 7feb30729700 1 -- 172.21.15.156:0/4284435149 shutdown_connections 2023-09-30T22:16:51.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.384+0000 7feb30729700 1 -- 172.21.15.156:0/4284435149 wait complete. 2023-09-30T22:16:51.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.384+0000 7feb30729700 1 Processor -- start 2023-09-30T22:16:51.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.385+0000 7feb30729700 1 -- start start 2023-09-30T22:16:51.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.385+0000 7feb30729700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb28093950 0x7feb28127660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:51.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.385+0000 7feb30729700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb28095c50 0x7feb2812ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:51.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.385+0000 7feb30729700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb2812c240 0x7feb2812b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:51.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.385+0000 7feb30729700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb28092410 con 0x7feb28093950 2023-09-30T22:16:51.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.385+0000 7feb30729700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb28129c70 con 0x7feb2812c240 2023-09-30T22:16:51.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.385+0000 7feb30729700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb28128100 con 0x7feb28095c50 2023-09-30T22:16:51.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.385+0000 7feb2e4c5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb28093950 0x7feb28127660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:51.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.385+0000 7feb2dcc4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb28095c50 0x7feb2812ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:51.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.385+0000 7feb2ecc6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb2812c240 0x7feb2812b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:51.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.385+0000 7feb2e4c5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb28093950 0x7feb28127660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41920/0 (socket says 172.21.15.156:41920) 2023-09-30T22:16:51.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.385+0000 7feb2dcc4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb28095c50 0x7feb2812ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48414/0 (socket says 172.21.15.156:48414) 2023-09-30T22:16:51.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.385+0000 7feb2e4c5700 1 -- 172.21.15.156:0/1460395861 learned_addr learned my addr 172.21.15.156:0/1460395861 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:51.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.385+0000 7feb2dcc4700 1 -- 172.21.15.156:0/1460395861 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb2812c240 msgr2=0x7feb2812b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:51.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.385+0000 7feb2dcc4700 1 --2- 172.21.15.156:0/1460395861 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb2812c240 0x7feb2812b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.385+0000 7feb2dcc4700 1 -- 172.21.15.156:0/1460395861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb28093950 msgr2=0x7feb28127660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:51.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.385+0000 7feb2dcc4700 1 --2- 172.21.15.156:0/1460395861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb28093950 0x7feb28127660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.385+0000 7feb2dcc4700 1 -- 172.21.15.156:0/1460395861 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb240092a0 con 0x7feb28095c50 2023-09-30T22:16:51.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.385+0000 7feb2e4c5700 1 --2- 172.21.15.156:0/1460395861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb28093950 0x7feb28127660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:51.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.385+0000 7feb2ecc6700 1 --2- 172.21.15.156:0/1460395861 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb2812c240 0x7feb2812b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:51.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.385+0000 7feb2dcc4700 1 --2- 172.21.15.156:0/1460395861 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb28095c50 0x7feb2812ab30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7feb18014000 tx=0x7feb18017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:51.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.386+0000 7feb1e7fc700 1 -- 172.21.15.156:0/1460395861 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb18009db0 con 0x7feb28095c50 2023-09-30T22:16:51.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.386+0000 7feb1e7fc700 1 -- 172.21.15.156:0/1460395861 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb180119a0 con 0x7feb28095c50 2023-09-30T22:16:51.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.386+0000 7feb30729700 1 -- 172.21.15.156:0/1460395861 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb180092a0 con 0x7feb28095c50 2023-09-30T22:16:51.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.386+0000 7feb1e7fc700 1 -- 172.21.15.156:0/1460395861 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb18011d20 con 0x7feb28095c50 2023-09-30T22:16:51.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.386+0000 7feb30729700 1 -- 172.21.15.156:0/1460395861 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb2812a630 con 0x7feb28095c50 2023-09-30T22:16:51.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.386+0000 7feb1e7fc700 1 -- 172.21.15.156:0/1460395861 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7feb1801b620 con 0x7feb28095c50 2023-09-30T22:16:51.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.386+0000 7feb1e7fc700 1 -- 172.21.15.156:0/1460395861 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7feb1803c760 con 0x7feb28095c50 2023-09-30T22:16:51.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.387+0000 7feb30729700 1 -- 172.21.15.156:0/1460395861 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb28129eb0 con 0x7feb28095c50 2023-09-30T22:16:51.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.391+0000 7feb1e7fc700 1 -- 172.21.15.156:0/1460395861 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7feb18023400 con 0x7feb28095c50 2023-09-30T22:16:51.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.547+0000 7feb30729700 1 -- 172.21.15.156:0/1460395861 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feb2805a260 con 0x7feb28095c50 2023-09-30T22:16:51.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.548+0000 7feb1e7fc700 1 -- 172.21.15.156:0/1460395861 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7feb18019b70 con 0x7feb28095c50 2023-09-30T22:16:51.548 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 32 2023-09-30T22:16:51.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.549+0000 7feb30729700 1 -- 172.21.15.156:0/1460395861 >> v1:172.21.15.156:6816/118236 conn(0x7feb0c02bb90 legacy=0x7feb0c02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:51.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.549+0000 7feb30729700 1 -- 172.21.15.156:0/1460395861 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb28095c50 msgr2=0x7feb2812ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:51.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.549+0000 7feb30729700 1 --2- 172.21.15.156:0/1460395861 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb28095c50 0x7feb2812ab30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7feb18014000 tx=0x7feb18017000).stop 2023-09-30T22:16:51.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.549+0000 7feb30729700 1 -- 172.21.15.156:0/1460395861 shutdown_connections 2023-09-30T22:16:51.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.549+0000 7feb30729700 1 --2- 172.21.15.156:0/1460395861 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb2812c240 0x7feb2812b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.549+0000 7feb30729700 1 --2- 172.21.15.156:0/1460395861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb28093950 0x7feb28127660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.549+0000 7feb30729700 1 --2- 172.21.15.156:0/1460395861 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb28095c50 0x7feb2812ab30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.549+0000 7feb30729700 1 -- 172.21.15.156:0/1460395861 >> 172.21.15.156:0/1460395861 conn(0x7feb2809aa50 msgr2=0x7feb28062aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:51.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.549+0000 7feb30729700 1 -- 172.21.15.156:0/1460395861 shutdown_connections 2023-09-30T22:16:51.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.549+0000 7feb30729700 1 -- 172.21.15.156:0/1460395861 wait complete. 2023-09-30T22:16:51.561 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:16:51.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.680+0000 7f102e87c700 1 Processor -- start 2023-09-30T22:16:51.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.680+0000 7f102e87c700 1 -- start start 2023-09-30T22:16:51.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.680+0000 7f102e87c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f102805f560 0x7f1028096840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:51.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.680+0000 7f102e87c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1028069d90 0x7f1028096d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:51.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.680+0000 7f102e87c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10280933e0 con 0x7f1028067e90 2023-09-30T22:16:51.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.680+0000 7f102e87c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102805f940 con 0x7f102805f560 2023-09-30T22:16:51.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.680+0000 7f102e87c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10280921e0 con 0x7f1028069d90 2023-09-30T22:16:51.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.681+0000 7f1027fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f102805f560 0x7f1028096840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:51.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.681+0000 7f10277fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1028069d90 0x7f1028096d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:51.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.681+0000 7f102ce19700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f1028067e90 0x7f1028068320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:39276/0 (socket says 172.21.15.156:39276) 2023-09-30T22:16:51.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.681+0000 7f102ce19700 1 -- 172.21.15.156:0/887849090 learned_addr learned my addr 172.21.15.156:0/887849090 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:51.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.681+0000 7f1026ffd700 1 -- 172.21.15.156:0/887849090 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1811787873 0 0) 0x7f10280933e0 con 0x7f1028067e90 2023-09-30T22:16:51.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.681+0000 7f1027fff700 1 -- 172.21.15.156:0/887849090 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1028069d90 msgr2=0x7f1028096d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:51.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.681+0000 7f1027fff700 1 --2- 172.21.15.156:0/887849090 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1028069d90 0x7f1028096d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.681+0000 7f1027fff700 1 -- 172.21.15.156:0/887849090 >> v1:172.21.15.156:6789/0 conn(0x7f1028067e90 legacy=0x7f1028068320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:51.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.681+0000 7f1027fff700 1 -- 172.21.15.156:0/887849090 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1028091b90 con 0x7f102805f560 2023-09-30T22:16:51.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.681+0000 7f10277fe700 1 --2- 172.21.15.156:0/887849090 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1028069d90 0x7f1028096d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:51.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.681+0000 7f1027fff700 1 --2- 172.21.15.156:0/887849090 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f102805f560 0x7f1028096840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f1018009790 tx=0x7f1018009060).ready entity=mon.1 client_cookie=b1ce045b51cad886 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:51.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.681+0000 7f1026ffd700 1 -- 172.21.15.156:0/887849090 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101800f510 con 0x7f102805f560 2023-09-30T22:16:51.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.681+0000 7f1026ffd700 1 -- 172.21.15.156:0/887849090 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101800f670 con 0x7f102805f560 2023-09-30T22:16:51.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.681+0000 7f1026ffd700 1 -- 172.21.15.156:0/887849090 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101800f9f0 con 0x7f102805f560 2023-09-30T22:16:51.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.682+0000 7f102e87c700 1 -- 172.21.15.156:0/887849090 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f102805f560 msgr2=0x7f1028096840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:51.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.682+0000 7f102e87c700 1 --2- 172.21.15.156:0/887849090 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f102805f560 0x7f1028096840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f1018009790 tx=0x7f1018009060).stop 2023-09-30T22:16:51.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.682+0000 7f102e87c700 1 -- 172.21.15.156:0/887849090 shutdown_connections 2023-09-30T22:16:51.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.682+0000 7f102e87c700 1 --2- 172.21.15.156:0/887849090 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f102805f560 0x7f1028096840 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.682+0000 7f102e87c700 1 --2- 172.21.15.156:0/887849090 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1028069d90 0x7f1028096d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.682+0000 7f102e87c700 1 -- 172.21.15.156:0/887849090 >> 172.21.15.156:0/887849090 conn(0x7f102809a1c0 msgr2=0x7f102809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:51.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.682+0000 7f102e87c700 1 -- 172.21.15.156:0/887849090 shutdown_connections 2023-09-30T22:16:51.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.682+0000 7f102e87c700 1 -- 172.21.15.156:0/887849090 wait complete. 2023-09-30T22:16:51.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.682+0000 7f102e87c700 1 Processor -- start 2023-09-30T22:16:51.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.683+0000 7f102e87c700 1 -- start start 2023-09-30T22:16:51.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.683+0000 7f102e87c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f102805f560 0x7f102812f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:51.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.683+0000 7f102e87c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1028067e90 0x7f1028127530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:51.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.683+0000 7f102e87c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1028127a20 0x7f1028127ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:51.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.683+0000 7f102e87c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102812aea0 con 0x7f102805f560 2023-09-30T22:16:51.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.683+0000 7f102e87c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1028128390 con 0x7f1028127a20 2023-09-30T22:16:51.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.683+0000 7f102e87c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10280987f0 con 0x7f1028067e90 2023-09-30T22:16:51.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.683+0000 7f1027fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f102805f560 0x7f102812f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:51.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.683+0000 7f10277fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1028067e90 0x7f1028127530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:51.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.683+0000 7f1027fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f102805f560 0x7f102812f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41924/0 (socket says 172.21.15.156:41924) 2023-09-30T22:16:51.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.683+0000 7f1027fff700 1 -- 172.21.15.156:0/2574417169 learned_addr learned my addr 172.21.15.156:0/2574417169 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:51.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.683+0000 7f102ce19700 1 --2- 172.21.15.156:0/2574417169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1028127a20 0x7f1028127ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:51.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.683+0000 7f10277fe700 1 -- 172.21.15.156:0/2574417169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1028127a20 msgr2=0x7f1028127ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:51.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.683+0000 7f10277fe700 1 --2- 172.21.15.156:0/2574417169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1028127a20 0x7f1028127ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.683+0000 7f10277fe700 1 -- 172.21.15.156:0/2574417169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f102805f560 msgr2=0x7f102812f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:51.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.683+0000 7f10277fe700 1 --2- 172.21.15.156:0/2574417169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f102805f560 0x7f102812f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.684+0000 7f10277fe700 1 -- 172.21.15.156:0/2574417169 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101c0092a0 con 0x7f1028067e90 2023-09-30T22:16:51.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.684+0000 7f1027fff700 1 --2- 172.21.15.156:0/2574417169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f102805f560 0x7f102812f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:51.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.684+0000 7f10277fe700 1 --2- 172.21.15.156:0/2574417169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1028067e90 0x7f1028127530 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f101c00e9b0 tx=0x7f101c009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:51.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.684+0000 7f100ffff700 1 -- 172.21.15.156:0/2574417169 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c012600 con 0x7f1028067e90 2023-09-30T22:16:51.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.684+0000 7f100ffff700 1 -- 172.21.15.156:0/2574417169 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101c012760 con 0x7f1028067e90 2023-09-30T22:16:51.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.684+0000 7f100ffff700 1 -- 172.21.15.156:0/2574417169 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c012b00 con 0x7f1028067e90 2023-09-30T22:16:51.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.684+0000 7f102e87c700 1 -- 172.21.15.156:0/2574417169 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10180092a0 con 0x7f1028067e90 2023-09-30T22:16:51.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.684+0000 7f102e87c700 1 -- 172.21.15.156:0/2574417169 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f102812a890 con 0x7f1028067e90 2023-09-30T22:16:51.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.684+0000 7f100ffff700 1 -- 172.21.15.156:0/2574417169 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f101c01b400 con 0x7f1028067e90 2023-09-30T22:16:51.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.685+0000 7f100ffff700 1 -- 172.21.15.156:0/2574417169 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f101c03b410 con 0x7f1028067e90 2023-09-30T22:16:51.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.685+0000 7f102e87c700 1 -- 172.21.15.156:0/2574417169 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f102812aab0 con 0x7f1028067e90 2023-09-30T22:16:51.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.689+0000 7f100ffff700 1 -- 172.21.15.156:0/2574417169 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f101c019900 con 0x7f1028067e90 2023-09-30T22:16:51.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.847+0000 7f102e87c700 1 -- 172.21.15.156:0/2574417169 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f102805a260 con 0x7f1028067e90 2023-09-30T22:16:51.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.847+0000 7f100ffff700 1 -- 172.21.15.156:0/2574417169 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7f101c019310 con 0x7f1028067e90 2023-09-30T22:16:51.848 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 64 2023-09-30T22:16:51.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.849+0000 7f102e87c700 1 -- 172.21.15.156:0/2574417169 >> v1:172.21.15.156:6816/118236 conn(0x7f101402bb90 legacy=0x7f101402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:51.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.849+0000 7f102e87c700 1 -- 172.21.15.156:0/2574417169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1028067e90 msgr2=0x7f1028127530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:51.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.849+0000 7f102e87c700 1 --2- 172.21.15.156:0/2574417169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1028067e90 0x7f1028127530 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f101c00e9b0 tx=0x7f101c009060).stop 2023-09-30T22:16:51.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.849+0000 7f102e87c700 1 -- 172.21.15.156:0/2574417169 shutdown_connections 2023-09-30T22:16:51.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.849+0000 7f102e87c700 1 --2- 172.21.15.156:0/2574417169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1028127a20 0x7f1028127ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.849+0000 7f102e87c700 1 --2- 172.21.15.156:0/2574417169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f102805f560 0x7f102812f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.849+0000 7f102e87c700 1 --2- 172.21.15.156:0/2574417169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1028067e90 0x7f1028127530 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.849+0000 7f102e87c700 1 -- 172.21.15.156:0/2574417169 >> 172.21.15.156:0/2574417169 conn(0x7f102809a1c0 msgr2=0x7f1028065f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:51.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.849+0000 7f102e87c700 1 -- 172.21.15.156:0/2574417169 shutdown_connections 2023-09-30T22:16:51.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.849+0000 7f102e87c700 1 -- 172.21.15.156:0/2574417169 wait complete. 2023-09-30T22:16:51.862 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:16:51.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.976+0000 7fd123420700 1 Processor -- start 2023-09-30T22:16:51.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.976+0000 7fd123420700 1 -- start start 2023-09-30T22:16:51.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.977+0000 7fd123420700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd11c095e70 0x7fd11c096250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:51.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.977+0000 7fd123420700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd11c12d250 0x7fd11c12f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:51.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.977+0000 7fd123420700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd11c094ba0 con 0x7fd11c093950 2023-09-30T22:16:51.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.977+0000 7fd123420700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c092e90 con 0x7fd11c12d250 2023-09-30T22:16:51.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.977+0000 7fd123420700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c096b60 con 0x7fd11c095e70 2023-09-30T22:16:51.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.977+0000 7fd1209bb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd11c095e70 0x7fd11c096250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:51.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.977+0000 7fd1211bc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fd11c093950 0x7fd11c095760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:39278/0 (socket says 172.21.15.156:39278) 2023-09-30T22:16:51.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.977+0000 7fd1219bd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd11c12d250 0x7fd11c12f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:51.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.977+0000 7fd1211bc700 1 -- 172.21.15.156:0/3845103903 learned_addr learned my addr 172.21.15.156:0/3845103903 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:51.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.977+0000 7fd113fff700 1 -- 172.21.15.156:0/3845103903 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774075740 0 0) 0x7fd11c094ba0 con 0x7fd11c093950 2023-09-30T22:16:51.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.977+0000 7fd1209bb700 1 -- 172.21.15.156:0/3845103903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd11c12d250 msgr2=0x7fd11c12f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:51.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.977+0000 7fd1209bb700 1 --2- 172.21.15.156:0/3845103903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd11c12d250 0x7fd11c12f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.977+0000 7fd1209bb700 1 -- 172.21.15.156:0/3845103903 >> v1:172.21.15.156:6789/0 conn(0x7fd11c093950 legacy=0x7fd11c095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:51.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.977+0000 7fd1209bb700 1 -- 172.21.15.156:0/3845103903 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11c093150 con 0x7fd11c095e70 2023-09-30T22:16:51.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.977+0000 7fd1219bd700 1 --2- 172.21.15.156:0/3845103903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd11c12d250 0x7fd11c12f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:51.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.977+0000 7fd1209bb700 1 --2- 172.21.15.156:0/3845103903 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd11c095e70 0x7fd11c096250 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fd118009790 tx=0x7fd118009060).ready entity=mon.2 client_cookie=ecc963b60040b9a1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:51.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.977+0000 7fd113fff700 1 -- 172.21.15.156:0/3845103903 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1180090d0 con 0x7fd11c095e70 2023-09-30T22:16:51.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.977+0000 7fd113fff700 1 -- 172.21.15.156:0/3845103903 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11800f510 con 0x7fd11c095e70 2023-09-30T22:16:51.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.977+0000 7fd113fff700 1 -- 172.21.15.156:0/3845103903 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11800f890 con 0x7fd11c095e70 2023-09-30T22:16:51.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.978+0000 7fd123420700 1 -- 172.21.15.156:0/3845103903 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd11c095e70 msgr2=0x7fd11c096250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:51.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.978+0000 7fd123420700 1 --2- 172.21.15.156:0/3845103903 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd11c095e70 0x7fd11c096250 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fd118009790 tx=0x7fd118009060).stop 2023-09-30T22:16:51.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.978+0000 7fd123420700 1 -- 172.21.15.156:0/3845103903 shutdown_connections 2023-09-30T22:16:51.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.978+0000 7fd123420700 1 --2- 172.21.15.156:0/3845103903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd11c12d250 0x7fd11c12f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.978+0000 7fd123420700 1 --2- 172.21.15.156:0/3845103903 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd11c095e70 0x7fd11c096250 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.978+0000 7fd123420700 1 -- 172.21.15.156:0/3845103903 >> 172.21.15.156:0/3845103903 conn(0x7fd11c09aa50 msgr2=0x7fd11c09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:51.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.978+0000 7fd123420700 1 -- 172.21.15.156:0/3845103903 shutdown_connections 2023-09-30T22:16:51.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.978+0000 7fd123420700 1 -- 172.21.15.156:0/3845103903 wait complete. 2023-09-30T22:16:51.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.979+0000 7fd123420700 1 Processor -- start 2023-09-30T22:16:51.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.979+0000 7fd123420700 1 -- start start 2023-09-30T22:16:51.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.979+0000 7fd123420700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd11c093950 0x7fd11c11e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:51.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.979+0000 7fd123420700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd11c095e70 0x7fd11c12bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:51.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.979+0000 7fd123420700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd11c12d250 0x7fd11c12c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:51.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.979+0000 7fd123420700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c11c830 con 0x7fd11c12d250 2023-09-30T22:16:51.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.979+0000 7fd123420700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c099710 con 0x7fd11c093950 2023-09-30T22:16:51.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.979+0000 7fd123420700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c092410 con 0x7fd11c095e70 2023-09-30T22:16:51.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.979+0000 7fd1219bd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd11c12d250 0x7fd11c12c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:51.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.979+0000 7fd1209bb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd11c095e70 0x7fd11c12bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:51.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.980+0000 7fd1211bc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd11c093950 0x7fd11c11e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:51.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.980+0000 7fd1219bd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd11c12d250 0x7fd11c12c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41934/0 (socket says 172.21.15.156:41934) 2023-09-30T22:16:51.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.980+0000 7fd1209bb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd11c095e70 0x7fd11c12bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48450/0 (socket says 172.21.15.156:48450) 2023-09-30T22:16:51.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.980+0000 7fd1219bd700 1 -- 172.21.15.156:0/500103465 learned_addr learned my addr 172.21.15.156:0/500103465 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:51.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.980+0000 7fd1209bb700 1 -- 172.21.15.156:0/500103465 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd11c093950 msgr2=0x7fd11c11e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:51.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.980+0000 7fd1209bb700 1 --2- 172.21.15.156:0/500103465 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd11c093950 0x7fd11c11e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.980+0000 7fd1209bb700 1 -- 172.21.15.156:0/500103465 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd11c12d250 msgr2=0x7fd11c12c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:51.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.980+0000 7fd1209bb700 1 --2- 172.21.15.156:0/500103465 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd11c12d250 0x7fd11c12c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:51.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.980+0000 7fd1209bb700 1 -- 172.21.15.156:0/500103465 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd114009a20 con 0x7fd11c095e70 2023-09-30T22:16:51.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.980+0000 7fd1219bd700 1 --2- 172.21.15.156:0/500103465 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd11c12d250 0x7fd11c12c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:51.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.980+0000 7fd1211bc700 1 --2- 172.21.15.156:0/500103465 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd11c093950 0x7fd11c11e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:51.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.980+0000 7fd1209bb700 1 --2- 172.21.15.156:0/500103465 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd11c095e70 0x7fd11c12bdd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fd118014000 tx=0x7fd118017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:51.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.980+0000 7fd1117fa700 1 -- 172.21.15.156:0/500103465 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11800f890 con 0x7fd11c095e70 2023-09-30T22:16:51.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.980+0000 7fd1117fa700 1 -- 172.21.15.156:0/500103465 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11800fc50 con 0x7fd11c095e70 2023-09-30T22:16:51.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.980+0000 7fd123420700 1 -- 172.21.15.156:0/500103465 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1180092a0 con 0x7fd11c095e70 2023-09-30T22:16:51.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.980+0000 7fd1117fa700 1 -- 172.21.15.156:0/500103465 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11801b410 con 0x7fd11c095e70 2023-09-30T22:16:51.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.980+0000 7fd123420700 1 -- 172.21.15.156:0/500103465 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd11c11e920 con 0x7fd11c095e70 2023-09-30T22:16:51.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.981+0000 7fd123420700 1 -- 172.21.15.156:0/500103465 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd11c05a260 con 0x7fd11c095e70 2023-09-30T22:16:51.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.982+0000 7fd1117fa700 1 -- 172.21.15.156:0/500103465 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fd11801b800 con 0x7fd11c095e70 2023-09-30T22:16:51.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.982+0000 7fd1117fa700 1 -- 172.21.15.156:0/500103465 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fd11803ccf0 con 0x7fd11c095e70 2023-09-30T22:16:51.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:51.986+0000 7fd1117fa700 1 -- 172.21.15.156:0/500103465 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fd11801bab0 con 0x7fd11c095e70 2023-09-30T22:16:52.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.181+0000 7fd123420700 1 -- 172.21.15.156:0/500103465 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd11c094010 con 0x7fd11c095e70 2023-09-30T22:16:52.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.182+0000 7fd1117fa700 1 -- 172.21.15.156:0/500103465 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2158 (secure 0 0 0) 0x7fd118019b70 con 0x7fd11c095e70 2023-09-30T22:16:52.183 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:52.183 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:16:29.792703+0000","modified":"2023-09-30T22:16:31.992241+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4206},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4206":{"gid":4206,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6817/3817969673","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6817","nonce":3817969673}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:16:52.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.184+0000 7fd123420700 1 -- 172.21.15.156:0/500103465 >> v1:172.21.15.156:6816/118236 conn(0x7fd10002bb60 legacy=0x7fd10002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:52.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.184+0000 7fd123420700 1 -- 172.21.15.156:0/500103465 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd11c095e70 msgr2=0x7fd11c12bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:52.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.184+0000 7fd123420700 1 --2- 172.21.15.156:0/500103465 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd11c095e70 0x7fd11c12bdd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fd118014000 tx=0x7fd118017000).stop 2023-09-30T22:16:52.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.184+0000 7fd123420700 1 -- 172.21.15.156:0/500103465 shutdown_connections 2023-09-30T22:16:52.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.184+0000 7fd123420700 1 --2- 172.21.15.156:0/500103465 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd11c12d250 0x7fd11c12c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:52.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.184+0000 7fd123420700 1 --2- 172.21.15.156:0/500103465 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd11c093950 0x7fd11c11e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:52.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.184+0000 7fd123420700 1 --2- 172.21.15.156:0/500103465 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd11c095e70 0x7fd11c12bdd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:52.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.184+0000 7fd123420700 1 -- 172.21.15.156:0/500103465 >> 172.21.15.156:0/500103465 conn(0x7fd11c09aa50 msgr2=0x7fd11c062aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:52.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.184+0000 7fd123420700 1 -- 172.21.15.156:0/500103465 shutdown_connections 2023-09-30T22:16:52.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.184+0000 7fd123420700 1 -- 172.21.15.156:0/500103465 wait complete. 2023-09-30T22:16:52.185 INFO:teuthology.orchestra.run.smithi156.stderr:dumped fsmap epoch 5 2023-09-30T22:16:52.196 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:16:52.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.312+0000 7f7a4cafe700 1 Processor -- start 2023-09-30T22:16:52.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.312+0000 7f7a4cafe700 1 -- start start 2023-09-30T22:16:52.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.313+0000 7f7a4cafe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7a48062b00 0x7f7a48095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:52.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.313+0000 7f7a4cafe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a48095b80 0x7f7a48095fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:52.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.313+0000 7f7a4cafe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a48096490 0x7f7a48131280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:52.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.313+0000 7f7a4cafe700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a480973f0 con 0x7f7a48062b00 2023-09-30T22:16:52.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.313+0000 7f7a4cafe700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a48062ee0 con 0x7f7a48095b80 2023-09-30T22:16:52.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.313+0000 7f7a4cafe700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a48091980 con 0x7f7a48096490 2023-09-30T22:16:52.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.313+0000 7f7a46d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a48096490 0x7f7a48131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:52.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.313+0000 7f7a4659c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7a48062b00 0x7f7a48095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:52.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.313+0000 7f7a45d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a48095b80 0x7f7a48095fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:52.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.313+0000 7f7a4659c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7a48062b00 0x7f7a48095690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41940/0 (socket says 172.21.15.156:41940) 2023-09-30T22:16:52.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.313+0000 7f7a46d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a48096490 0x7f7a48131280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48454/0 (socket says 172.21.15.156:48454) 2023-09-30T22:16:52.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.313+0000 7f7a4659c700 1 -- 172.21.15.156:0/932824726 learned_addr learned my addr 172.21.15.156:0/932824726 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:52.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.313+0000 7f7a45d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a48095b80 0x7f7a48095fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53500/0 (socket says 172.21.15.156:53500) 2023-09-30T22:16:52.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.313+0000 7f7a45d9b700 1 -- 172.21.15.156:0/932824726 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a48096490 msgr2=0x7f7a48131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:52.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.313+0000 7f7a45d9b700 1 --2- 172.21.15.156:0/932824726 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a48096490 0x7f7a48131280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:52.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.313+0000 7f7a45d9b700 1 -- 172.21.15.156:0/932824726 >> v2:172.21.15.156:3300/0 conn(0x7f7a48062b00 msgr2=0x7f7a48095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:52.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.313+0000 7f7a45d9b700 1 --2- 172.21.15.156:0/932824726 >> v2:172.21.15.156:3300/0 conn(0x7f7a48062b00 0x7f7a48095690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:52.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.313+0000 7f7a45d9b700 1 -- 172.21.15.156:0/932824726 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a48092310 con 0x7f7a48095b80 2023-09-30T22:16:52.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.313+0000 7f7a4659c700 1 --2- 172.21.15.156:0/932824726 >> v2:172.21.15.156:3300/0 conn(0x7f7a48062b00 0x7f7a48095690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:52.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.313+0000 7f7a45d9b700 1 --2- 172.21.15.156:0/932824726 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a48095b80 0x7f7a48095fa0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f7a38009760 tx=0x7f7a38009060).ready entity=mon.1 client_cookie=6a2f4a8c64d32747 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:52.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.314+0000 7f7a4559a700 1 -- 172.21.15.156:0/932824726 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3800d4a0 con 0x7f7a48095b80 2023-09-30T22:16:52.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.314+0000 7f7a4559a700 1 -- 172.21.15.156:0/932824726 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3800d600 con 0x7f7a48095b80 2023-09-30T22:16:52.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.314+0000 7f7a4559a700 1 -- 172.21.15.156:0/932824726 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3800d980 con 0x7f7a48095b80 2023-09-30T22:16:52.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.314+0000 7f7a4cafe700 1 -- 172.21.15.156:0/932824726 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a48095b80 msgr2=0x7f7a48095fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:52.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.314+0000 7f7a4cafe700 1 --2- 172.21.15.156:0/932824726 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a48095b80 0x7f7a48095fa0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f7a38009760 tx=0x7f7a38009060).stop 2023-09-30T22:16:52.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.314+0000 7f7a4cafe700 1 -- 172.21.15.156:0/932824726 shutdown_connections 2023-09-30T22:16:52.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.314+0000 7f7a4cafe700 1 --2- 172.21.15.156:0/932824726 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a48096490 0x7f7a48131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:52.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.314+0000 7f7a4cafe700 1 --2- 172.21.15.156:0/932824726 >> v2:172.21.15.156:3300/0 conn(0x7f7a48062b00 0x7f7a48095690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:52.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.314+0000 7f7a4cafe700 1 --2- 172.21.15.156:0/932824726 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a48095b80 0x7f7a48095fa0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:52.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.314+0000 7f7a4cafe700 1 -- 172.21.15.156:0/932824726 >> 172.21.15.156:0/932824726 conn(0x7f7a4809aa50 msgr2=0x7f7a4809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:52.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.314+0000 7f7a4cafe700 1 -- 172.21.15.156:0/932824726 shutdown_connections 2023-09-30T22:16:52.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.314+0000 7f7a4cafe700 1 -- 172.21.15.156:0/932824726 wait complete. 2023-09-30T22:16:52.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.315+0000 7f7a4cafe700 1 Processor -- start 2023-09-30T22:16:52.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.315+0000 7f7a4cafe700 1 -- start start 2023-09-30T22:16:52.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.316+0000 7f7a4cafe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a48062b00 0x7f7a481198c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:52.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.316+0000 7f7a4cafe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a48095b80 0x7f7a48116a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:52.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.316+0000 7f7a4cafe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a48096490 0x7f7a48116f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:52.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.316+0000 7f7a4cafe700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a48096da0 con 0x7f7a48096490 2023-09-30T22:16:52.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.316+0000 7f7a4cafe700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4811a920 con 0x7f7a48095b80 2023-09-30T22:16:52.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.316+0000 7f7a4cafe700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4811aba0 con 0x7f7a48062b00 2023-09-30T22:16:52.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.316+0000 7f7a4659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a48062b00 0x7f7a481198c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:52.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.316+0000 7f7a46d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a48096490 0x7f7a48116f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:52.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.316+0000 7f7a4659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a48062b00 0x7f7a481198c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48458/0 (socket says 172.21.15.156:48458) 2023-09-30T22:16:52.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.316+0000 7f7a4659c700 1 -- 172.21.15.156:0/1756328955 learned_addr learned my addr 172.21.15.156:0/1756328955 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:52.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.316+0000 7f7a45d9b700 1 --2- 172.21.15.156:0/1756328955 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a48095b80 0x7f7a48116a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:52.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.316+0000 7f7a4659c700 1 -- 172.21.15.156:0/1756328955 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a48095b80 msgr2=0x7f7a48116a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:52.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.316+0000 7f7a4659c700 1 --2- 172.21.15.156:0/1756328955 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a48095b80 0x7f7a48116a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:52.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.316+0000 7f7a4659c700 1 -- 172.21.15.156:0/1756328955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a48096490 msgr2=0x7f7a48116f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:52.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.316+0000 7f7a4659c700 1 --2- 172.21.15.156:0/1756328955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a48096490 0x7f7a48116f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:52.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.316+0000 7f7a4659c700 1 -- 172.21.15.156:0/1756328955 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a30009370 con 0x7f7a48062b00 2023-09-30T22:16:52.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.316+0000 7f7a46d9d700 1 --2- 172.21.15.156:0/1756328955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a48096490 0x7f7a48116f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:52.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.316+0000 7f7a4659c700 1 --2- 172.21.15.156:0/1756328955 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a48062b00 0x7f7a481198c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f7a3000ea50 tx=0x7f7a300090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:52.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.316+0000 7f7a3e7fc700 1 -- 172.21.15.156:0/1756328955 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a30009650 con 0x7f7a48062b00 2023-09-30T22:16:52.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.316+0000 7f7a3e7fc700 1 -- 172.21.15.156:0/1756328955 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3000ee90 con 0x7f7a48062b00 2023-09-30T22:16:52.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.316+0000 7f7a4cafe700 1 -- 172.21.15.156:0/1756328955 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a380092a0 con 0x7f7a48062b00 2023-09-30T22:16:52.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.316+0000 7f7a3e7fc700 1 -- 172.21.15.156:0/1756328955 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3000ca60 con 0x7f7a48062b00 2023-09-30T22:16:52.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.316+0000 7f7a4cafe700 1 -- 172.21.15.156:0/1756328955 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a481184a0 con 0x7f7a48062b00 2023-09-30T22:16:52.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.317+0000 7f7a3e7fc700 1 -- 172.21.15.156:0/1756328955 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7a3001b400 con 0x7f7a48062b00 2023-09-30T22:16:52.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.317+0000 7f7a3e7fc700 1 -- 172.21.15.156:0/1756328955 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f7a3003b4e0 con 0x7f7a48062b00 2023-09-30T22:16:52.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.317+0000 7f7a4cafe700 1 -- 172.21.15.156:0/1756328955 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4811a260 con 0x7f7a48062b00 2023-09-30T22:16:52.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.322+0000 7f7a3e7fc700 1 -- 172.21.15.156:0/1756328955 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f7a30016030 con 0x7f7a48062b00 2023-09-30T22:16:52.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.480+0000 7f7a4cafe700 1 -- 172.21.15.156:0/1756328955 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a4805a260 con 0x7f7a48062b00 2023-09-30T22:16:52.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.481+0000 7f7a3e7fc700 1 -- 172.21.15.156:0/1756328955 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11372 (secure 0 0 0) 0x7f7a30011b00 con 0x7f7a48062b00 2023-09-30T22:16:52.481 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:52.481 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":17,"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","created":"2023-09-30T22:16:15.239992+0000","modified":"2023-09-30T22:16:48.039226+0000","last_up_change":"2023-09-30T22:16:23.392557+0000","last_in_change":"2023-09-30T22:16:16.474206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:16:23.433906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:16:24.367795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:16:28.204677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:16:28.762804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3ec2e78a-c61f-473a-bfcb-f956cffe4095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6812","nonce":118781}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6813","nonce":118781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6815","nonce":118781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6814","nonce":118781}]},"public_addr":"172.21.15.156:6812/118781","cluster_addr":"172.21.15.156:6813/118781","heartbeat_back_addr":"172.21.15.156:6815/118781","heartbeat_front_addr":"172.21.15.156:6814/118781","state":["exists","up"]},{"osd":1,"uuid":"b682e683-c15a-4bd9-8712-8af96454e9ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6803","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6805","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6807","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6806","nonce":118763}]},"public_addr":"172.21.15.156:6803/118763","cluster_addr":"172.21.15.156:6805/118763","heartbeat_back_addr":"172.21.15.156:6807/118763","heartbeat_front_addr":"172.21.15.156:6806/118763","state":["exists","up"]},{"osd":2,"uuid":"960dbaf0-2e0c-437e-9114-bc22ce522b26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6808","nonce":118788}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6809","nonce":118788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6811","nonce":118788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6810","nonce":118788}]},"public_addr":"172.21.15.156:6808/118788","cluster_addr":"172.21.15.156:6809/118788","heartbeat_back_addr":"172.21.15.156:6811/118788","heartbeat_front_addr":"172.21.15.156:6810/118788","state":["exists","up"]},{"osd":3,"uuid":"c1b19714-78b1-4869-8721-2f6352a64a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6800","nonce":118764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6801","nonce":118764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6804","nonce":118764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6802","nonce":118764}]},"public_addr":"172.21.15.156:6800/118764","cluster_addr":"172.21.15.156:6801/118764","heartbeat_back_addr":"172.21.15.156:6804/118764","heartbeat_front_addr":"172.21.15.156:6802/118764","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.663343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.827397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.806655+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.634746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:16:52.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.483+0000 7f7a4cafe700 1 -- 172.21.15.156:0/1756328955 >> v1:172.21.15.156:6816/118236 conn(0x7f7a2802bb60 legacy=0x7f7a2802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:52.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.483+0000 7f7a4cafe700 1 -- 172.21.15.156:0/1756328955 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a48062b00 msgr2=0x7f7a481198c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:52.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.483+0000 7f7a4cafe700 1 --2- 172.21.15.156:0/1756328955 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a48062b00 0x7f7a481198c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f7a3000ea50 tx=0x7f7a300090f0).stop 2023-09-30T22:16:52.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.483+0000 7f7a4cafe700 1 -- 172.21.15.156:0/1756328955 shutdown_connections 2023-09-30T22:16:52.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.483+0000 7f7a4cafe700 1 --2- 172.21.15.156:0/1756328955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a48096490 0x7f7a48116f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:52.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.483+0000 7f7a4cafe700 1 --2- 172.21.15.156:0/1756328955 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a48062b00 0x7f7a481198c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:52.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.483+0000 7f7a4cafe700 1 --2- 172.21.15.156:0/1756328955 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a48095b80 0x7f7a48116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:52.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.483+0000 7f7a4cafe700 1 -- 172.21.15.156:0/1756328955 >> 172.21.15.156:0/1756328955 conn(0x7f7a4809aa50 msgr2=0x7f7a48130050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:52.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.483+0000 7f7a4cafe700 1 -- 172.21.15.156:0/1756328955 shutdown_connections 2023-09-30T22:16:52.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.483+0000 7f7a4cafe700 1 -- 172.21.15.156:0/1756328955 wait complete. 2023-09-30T22:16:52.495 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-30T22:16:52.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.614+0000 7fb8d0127700 1 Processor -- start 2023-09-30T22:16:52.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.614+0000 7fb8d0127700 1 -- start start 2023-09-30T22:16:52.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.614+0000 7fb8d0127700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8c8062b00 0x7fb8c8095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:52.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.614+0000 7fb8d0127700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb8c8095b80 0x7fb8c8095fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:52.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.614+0000 7fb8d0127700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8c8096490 0x7fb8c8131280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:52.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.614+0000 7fb8d0127700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c80973f0 con 0x7fb8c8095b80 2023-09-30T22:16:52.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.614+0000 7fb8d0127700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c8062ee0 con 0x7fb8c8062b00 2023-09-30T22:16:52.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.614+0000 7fb8d0127700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c8091980 con 0x7fb8c8096490 2023-09-30T22:16:52.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.615+0000 7fb8ce6c4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8c8096490 0x7fb8c8131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:52.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.615+0000 7fb8cdec3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8c8062b00 0x7fb8c8095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:52.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.615+0000 7fb8cd6c2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb8c8095b80 0x7fb8c8095fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:52.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.615+0000 7fb8cd6c2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb8c8095b80 0x7fb8c8095fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41948/0 (socket says 172.21.15.156:41948) 2023-09-30T22:16:52.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.615+0000 7fb8cdec3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8c8062b00 0x7fb8c8095690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53520/0 (socket says 172.21.15.156:53520) 2023-09-30T22:16:52.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.615+0000 7fb8ce6c4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8c8096490 0x7fb8c8131280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48462/0 (socket says 172.21.15.156:48462) 2023-09-30T22:16:52.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.615+0000 7fb8cd6c2700 1 -- 172.21.15.156:0/2499404787 learned_addr learned my addr 172.21.15.156:0/2499404787 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:52.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.615+0000 7fb8cdec3700 1 -- 172.21.15.156:0/2499404787 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8c8096490 msgr2=0x7fb8c8131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:52.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.615+0000 7fb8cdec3700 1 --2- 172.21.15.156:0/2499404787 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8c8096490 0x7fb8c8131280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:52.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.615+0000 7fb8cdec3700 1 -- 172.21.15.156:0/2499404787 >> v2:172.21.15.156:3300/0 conn(0x7fb8c8095b80 msgr2=0x7fb8c8095fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:52.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.615+0000 7fb8cdec3700 1 --2- 172.21.15.156:0/2499404787 >> v2:172.21.15.156:3300/0 conn(0x7fb8c8095b80 0x7fb8c8095fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:52.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.615+0000 7fb8cdec3700 1 -- 172.21.15.156:0/2499404787 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c8092310 con 0x7fb8c8062b00 2023-09-30T22:16:52.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.615+0000 7fb8cd6c2700 1 --2- 172.21.15.156:0/2499404787 >> v2:172.21.15.156:3300/0 conn(0x7fb8c8095b80 0x7fb8c8095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:52.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.615+0000 7fb8cdec3700 1 --2- 172.21.15.156:0/2499404787 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8c8062b00 0x7fb8c8095690 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fb8c4009760 tx=0x7fb8c4009060).ready entity=mon.1 client_cookie=348155a0dc34dcb2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:52.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.615+0000 7fb8ccec1700 1 -- 172.21.15.156:0/2499404787 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c400d4a0 con 0x7fb8c8062b00 2023-09-30T22:16:52.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.615+0000 7fb8ccec1700 1 -- 172.21.15.156:0/2499404787 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c400d600 con 0x7fb8c8062b00 2023-09-30T22:16:52.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.615+0000 7fb8ccec1700 1 -- 172.21.15.156:0/2499404787 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c400d980 con 0x7fb8c8062b00 2023-09-30T22:16:52.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.616+0000 7fb8d0127700 1 -- 172.21.15.156:0/2499404787 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8c8062b00 msgr2=0x7fb8c8095690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:52.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.616+0000 7fb8d0127700 1 --2- 172.21.15.156:0/2499404787 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8c8062b00 0x7fb8c8095690 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fb8c4009760 tx=0x7fb8c4009060).stop 2023-09-30T22:16:52.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.616+0000 7fb8d0127700 1 -- 172.21.15.156:0/2499404787 shutdown_connections 2023-09-30T22:16:52.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.616+0000 7fb8d0127700 1 --2- 172.21.15.156:0/2499404787 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8c8096490 0x7fb8c8131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:52.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.616+0000 7fb8d0127700 1 --2- 172.21.15.156:0/2499404787 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8c8062b00 0x7fb8c8095690 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:52.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.616+0000 7fb8d0127700 1 --2- 172.21.15.156:0/2499404787 >> v2:172.21.15.156:3300/0 conn(0x7fb8c8095b80 0x7fb8c8095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:52.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.616+0000 7fb8d0127700 1 -- 172.21.15.156:0/2499404787 >> 172.21.15.156:0/2499404787 conn(0x7fb8c809aa50 msgr2=0x7fb8c809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:52.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.616+0000 7fb8d0127700 1 -- 172.21.15.156:0/2499404787 shutdown_connections 2023-09-30T22:16:52.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.616+0000 7fb8d0127700 1 -- 172.21.15.156:0/2499404787 wait complete. 2023-09-30T22:16:52.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.617+0000 7fb8d0127700 1 Processor -- start 2023-09-30T22:16:52.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.617+0000 7fb8d0127700 1 -- start start 2023-09-30T22:16:52.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.617+0000 7fb8d0127700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8c8062b00 0x7fb8c8116bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:52.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.617+0000 7fb8d0127700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8c8095b80 0x7fb8c81170c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:52.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.617+0000 7fb8d0127700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8c8096490 0x7fb8c81175b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:52.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.617+0000 7fb8d0127700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c8117aa0 con 0x7fb8c8062b00 2023-09-30T22:16:52.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.617+0000 7fb8d0127700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c811a160 con 0x7fb8c8096490 2023-09-30T22:16:52.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.617+0000 7fb8d0127700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c8118900 con 0x7fb8c8095b80 2023-09-30T22:16:52.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.617+0000 7fb8cdec3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8c8062b00 0x7fb8c8116bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:52.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.617+0000 7fb8cd6c2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8c8095b80 0x7fb8c81170c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:52.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.617+0000 7fb8cdec3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8c8062b00 0x7fb8c8116bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41962/0 (socket says 172.21.15.156:41962) 2023-09-30T22:16:52.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.617+0000 7fb8cdec3700 1 -- 172.21.15.156:0/140198164 learned_addr learned my addr 172.21.15.156:0/140198164 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:52.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.617+0000 7fb8cd6c2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8c8095b80 0x7fb8c81170c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48466/0 (socket says 172.21.15.156:48466) 2023-09-30T22:16:52.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.617+0000 7fb8ce6c4700 1 --2- 172.21.15.156:0/140198164 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8c8096490 0x7fb8c81175b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:52.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.617+0000 7fb8cdec3700 1 -- 172.21.15.156:0/140198164 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8c8095b80 msgr2=0x7fb8c81170c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:52.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.617+0000 7fb8cdec3700 1 --2- 172.21.15.156:0/140198164 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8c8095b80 0x7fb8c81170c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:52.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.617+0000 7fb8cdec3700 1 -- 172.21.15.156:0/140198164 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8c8096490 msgr2=0x7fb8c81175b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:52.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.617+0000 7fb8cdec3700 1 --2- 172.21.15.156:0/140198164 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8c8096490 0x7fb8c81175b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:52.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.617+0000 7fb8cdec3700 1 -- 172.21.15.156:0/140198164 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b8009370 con 0x7fb8c8062b00 2023-09-30T22:16:52.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.617+0000 7fb8ce6c4700 1 --2- 172.21.15.156:0/140198164 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8c8096490 0x7fb8c81175b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:52.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.618+0000 7fb8cdec3700 1 --2- 172.21.15.156:0/140198164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8c8062b00 0x7fb8c8116bd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fb8c4011fb0 tx=0x7fb8c4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:52.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.618+0000 7fb8bdffb700 1 -- 172.21.15.156:0/140198164 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c400dcf0 con 0x7fb8c8062b00 2023-09-30T22:16:52.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.618+0000 7fb8bdffb700 1 -- 172.21.15.156:0/140198164 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c400de50 con 0x7fb8c8062b00 2023-09-30T22:16:52.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.618+0000 7fb8bdffb700 1 -- 172.21.15.156:0/140198164 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c400d980 con 0x7fb8c8062b00 2023-09-30T22:16:52.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.618+0000 7fb8d0127700 1 -- 172.21.15.156:0/140198164 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c40092a0 con 0x7fb8c8062b00 2023-09-30T22:16:52.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.618+0000 7fb8d0127700 1 -- 172.21.15.156:0/140198164 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c8096da0 con 0x7fb8c8062b00 2023-09-30T22:16:52.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.619+0000 7fb8bdffb700 1 -- 172.21.15.156:0/140198164 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb8c401d640 con 0x7fb8c8062b00 2023-09-30T22:16:52.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.619+0000 7fb8bdffb700 1 -- 172.21.15.156:0/140198164 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb8c403c570 con 0x7fb8c8062b00 2023-09-30T22:16:52.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.619+0000 7fb8d0127700 1 -- 172.21.15.156:0/140198164 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c805a260 con 0x7fb8c8062b00 2023-09-30T22:16:52.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.624+0000 7fb8bdffb700 1 -- 172.21.15.156:0/140198164 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb8c401d8f0 con 0x7fb8c8062b00 2023-09-30T22:16:52.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:52.820+0000 7fb8d0127700 1 -- 172.21.15.156:0/140198164 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb8c809b560 con 0x7fb8c8062b00 2023-09-30T22:16:53.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.000+0000 7fb8bdffb700 1 -- 172.21.15.156:0/140198164 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb8c4018350 con 0x7fb8c8062b00 2023-09-30T22:16:53.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.002+0000 7fb8d0127700 1 -- 172.21.15.156:0/140198164 >> v1:172.21.15.156:6816/118236 conn(0x7fb8ac02bb60 legacy=0x7fb8ac02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:53.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.002+0000 7fb8d0127700 1 -- 172.21.15.156:0/140198164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8c8062b00 msgr2=0x7fb8c8116bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:53.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.002+0000 7fb8d0127700 1 --2- 172.21.15.156:0/140198164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8c8062b00 0x7fb8c8116bd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fb8c4011fb0 tx=0x7fb8c4016000).stop 2023-09-30T22:16:53.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.002+0000 7fb8d0127700 1 -- 172.21.15.156:0/140198164 shutdown_connections 2023-09-30T22:16:53.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.002+0000 7fb8d0127700 1 --2- 172.21.15.156:0/140198164 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8c8096490 0x7fb8c81175b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:53.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.002+0000 7fb8d0127700 1 --2- 172.21.15.156:0/140198164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8c8062b00 0x7fb8c8116bd0 secure :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0x7fb8c4011fb0 tx=0x7fb8c4016000).stop 2023-09-30T22:16:53.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.002+0000 7fb8d0127700 1 --2- 172.21.15.156:0/140198164 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8c8095b80 0x7fb8c81170c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:53.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.002+0000 7fb8d0127700 1 -- 172.21.15.156:0/140198164 >> 172.21.15.156:0/140198164 conn(0x7fb8c809aa50 msgr2=0x7fb8c8130180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:53.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.003+0000 7fb8d0127700 1 -- 172.21.15.156:0/140198164 shutdown_connections 2023-09-30T22:16:53.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.003+0000 7fb8d0127700 1 -- 172.21.15.156:0/140198164 wait complete. 2023-09-30T22:16:53.015 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2023-09-30T22:16:53.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.134+0000 7fa5e9e2a700 1 Processor -- start 2023-09-30T22:16:53.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.134+0000 7fa5e9e2a700 1 -- start start 2023-09-30T22:16:53.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.134+0000 7fa5e9e2a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa5e4097790 0x7fa5e412b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:53.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.134+0000 7fa5e9e2a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa5e412b540 0x7fa5e4127560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:53.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.134+0000 7fa5e9e2a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e412ae10 con 0x7fa5e4127a50 2023-09-30T22:16:53.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.134+0000 7fa5e9e2a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e412b940 con 0x7fa5e4097790 2023-09-30T22:16:53.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.134+0000 7fa5e9e2a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e4064b30 con 0x7fa5e412b540 2023-09-30T22:16:53.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.134+0000 7fa5e2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa5e412b540 0x7fa5e4127560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:53.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.134+0000 7fa5e37fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa5e4097790 0x7fa5e412b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:53.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.134+0000 7fa5e3fff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fa5e4127a50 0x7fa5e4127ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:39290/0 (socket says 172.21.15.156:39290) 2023-09-30T22:16:53.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.134+0000 7fa5e3fff700 1 -- 172.21.15.156:0/3309567760 learned_addr learned my addr 172.21.15.156:0/3309567760 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:53.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.135+0000 7fa5e2ffd700 1 -- 172.21.15.156:0/3309567760 >> v2:172.21.15.156:3300/0 conn(0x7fa5e4097790 msgr2=0x7fa5e412b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:53.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.135+0000 7fa5e2ffd700 1 --2- 172.21.15.156:0/3309567760 >> v2:172.21.15.156:3300/0 conn(0x7fa5e4097790 0x7fa5e412b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:53.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.135+0000 7fa5e2ffd700 1 -- 172.21.15.156:0/3309567760 >> v1:172.21.15.156:6789/0 conn(0x7fa5e4127a50 legacy=0x7fa5e4127ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:53.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.135+0000 7fa5e2ffd700 1 -- 172.21.15.156:0/3309567760 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e4065750 con 0x7fa5e412b540 2023-09-30T22:16:53.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.135+0000 7fa5e37fe700 1 --2- 172.21.15.156:0/3309567760 >> v2:172.21.15.156:3300/0 conn(0x7fa5e4097790 0x7fa5e412b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:53.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.135+0000 7fa5e2ffd700 1 --2- 172.21.15.156:0/3309567760 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa5e412b540 0x7fa5e4127560 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fa5d4009760 tx=0x7fa5d4009060).ready entity=mon.2 client_cookie=b08129361d6f4dd9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:53.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.135+0000 7fa5e27fc700 1 -- 172.21.15.156:0/3309567760 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d400f510 con 0x7fa5e412b540 2023-09-30T22:16:53.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.135+0000 7fa5e27fc700 1 -- 172.21.15.156:0/3309567760 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d400f670 con 0x7fa5e412b540 2023-09-30T22:16:53.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.135+0000 7fa5e27fc700 1 -- 172.21.15.156:0/3309567760 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d400f9f0 con 0x7fa5e412b540 2023-09-30T22:16:53.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.135+0000 7fa5e9e2a700 1 -- 172.21.15.156:0/3309567760 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa5e412b540 msgr2=0x7fa5e4127560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:53.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.135+0000 7fa5e9e2a700 1 --2- 172.21.15.156:0/3309567760 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa5e412b540 0x7fa5e4127560 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fa5d4009760 tx=0x7fa5d4009060).stop 2023-09-30T22:16:53.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.135+0000 7fa5e9e2a700 1 -- 172.21.15.156:0/3309567760 shutdown_connections 2023-09-30T22:16:53.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.135+0000 7fa5e9e2a700 1 --2- 172.21.15.156:0/3309567760 >> v2:172.21.15.156:3300/0 conn(0x7fa5e4097790 0x7fa5e412b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:53.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.135+0000 7fa5e9e2a700 1 --2- 172.21.15.156:0/3309567760 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa5e412b540 0x7fa5e4127560 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:53.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.135+0000 7fa5e9e2a700 1 -- 172.21.15.156:0/3309567760 >> 172.21.15.156:0/3309567760 conn(0x7fa5e409bad0 msgr2=0x7fa5e409bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:53.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.136+0000 7fa5e9e2a700 1 -- 172.21.15.156:0/3309567760 shutdown_connections 2023-09-30T22:16:53.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.136+0000 7fa5e9e2a700 1 -- 172.21.15.156:0/3309567760 wait complete. 2023-09-30T22:16:53.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.136+0000 7fa5e9e2a700 1 Processor -- start 2023-09-30T22:16:53.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.137+0000 7fa5e9e2a700 1 -- start start 2023-09-30T22:16:53.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.137+0000 7fa5e9e2a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5e4097790 0x7fa5e41249d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:53.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.137+0000 7fa5e9e2a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa5e4127a50 0x7fa5e41138c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:53.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.137+0000 7fa5e9e2a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5e412b540 0x7fa5e4113db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:53.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.137+0000 7fa5e9e2a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e4065130 con 0x7fa5e4097790 2023-09-30T22:16:53.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.137+0000 7fa5e9e2a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e41173a0 con 0x7fa5e412b540 2023-09-30T22:16:53.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.137+0000 7fa5e9e2a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e412a070 con 0x7fa5e4127a50 2023-09-30T22:16:53.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.137+0000 7fa5e37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5e4097790 0x7fa5e41249d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:53.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.137+0000 7fa5e37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5e4097790 0x7fa5e41249d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41982/0 (socket says 172.21.15.156:41982) 2023-09-30T22:16:53.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.137+0000 7fa5e37fe700 1 -- 172.21.15.156:0/842913393 learned_addr learned my addr 172.21.15.156:0/842913393 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:53.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.137+0000 7fa5e3fff700 1 --2- 172.21.15.156:0/842913393 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5e412b540 0x7fa5e4113db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:53.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.137+0000 7fa5e2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa5e4127a50 0x7fa5e41138c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:53.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.137+0000 7fa5e2ffd700 1 -- 172.21.15.156:0/842913393 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5e412b540 msgr2=0x7fa5e4113db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:53.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.137+0000 7fa5e2ffd700 1 --2- 172.21.15.156:0/842913393 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5e412b540 0x7fa5e4113db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:53.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.137+0000 7fa5e2ffd700 1 -- 172.21.15.156:0/842913393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5e4097790 msgr2=0x7fa5e41249d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:53.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.137+0000 7fa5e2ffd700 1 --2- 172.21.15.156:0/842913393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5e4097790 0x7fa5e41249d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:53.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.137+0000 7fa5e2ffd700 1 -- 172.21.15.156:0/842913393 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d80092a0 con 0x7fa5e4127a50 2023-09-30T22:16:53.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.137+0000 7fa5e3fff700 1 --2- 172.21.15.156:0/842913393 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5e412b540 0x7fa5e4113db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:53.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.137+0000 7fa5e37fe700 1 --2- 172.21.15.156:0/842913393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5e4097790 0x7fa5e41249d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:53.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.138+0000 7fa5e2ffd700 1 --2- 172.21.15.156:0/842913393 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa5e4127a50 0x7fa5e41138c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fa5d4014000 tx=0x7fa5d4017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:53.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.138+0000 7fa5cb7fe700 1 -- 172.21.15.156:0/842913393 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d400f7e0 con 0x7fa5e4127a50 2023-09-30T22:16:53.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.138+0000 7fa5cb7fe700 1 -- 172.21.15.156:0/842913393 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d400f960 con 0x7fa5e4127a50 2023-09-30T22:16:53.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.138+0000 7fa5e9e2a700 1 -- 172.21.15.156:0/842913393 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d40092a0 con 0x7fa5e4127a50 2023-09-30T22:16:53.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.138+0000 7fa5cb7fe700 1 -- 172.21.15.156:0/842913393 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d401c670 con 0x7fa5e4127a50 2023-09-30T22:16:53.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.138+0000 7fa5e9e2a700 1 -- 172.21.15.156:0/842913393 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e4117c40 con 0x7fa5e4127a50 2023-09-30T22:16:53.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.138+0000 7fa5cb7fe700 1 -- 172.21.15.156:0/842913393 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fa5d401ca60 con 0x7fa5e4127a50 2023-09-30T22:16:53.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.139+0000 7fa5cb7fe700 1 -- 172.21.15.156:0/842913393 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fa5d403c410 con 0x7fa5e4127a50 2023-09-30T22:16:53.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.139+0000 7fa5e9e2a700 1 -- 172.21.15.156:0/842913393 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e4117c40 con 0x7fa5e4127a50 2023-09-30T22:16:53.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.144+0000 7fa5cb7fe700 1 -- 172.21.15.156:0/842913393 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fa5e4117c40 con 0x7fa5e4127a50 2023-09-30T22:16:53.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:53.338+0000 7fa5e9e2a700 1 -- 172.21.15.156:0/842913393 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7fa5e4117c40 con 0x7fa5e4127a50 2023-09-30T22:16:54.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.005+0000 7fa5cb7fe700 1 -- 172.21.15.156:0/842913393 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v7) v1 ==== 105+0+0 (secure 0 0 0) 0x7fa5e4117c40 con 0x7fa5e4127a50 2023-09-30T22:16:54.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.007+0000 7fa5e9e2a700 1 -- 172.21.15.156:0/842913393 >> v1:172.21.15.156:6816/118236 conn(0x7fa5d002bb60 legacy=0x7fa5d002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:54.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.007+0000 7fa5e9e2a700 1 -- 172.21.15.156:0/842913393 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa5e4127a50 msgr2=0x7fa5e41138c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:54.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.007+0000 7fa5e9e2a700 1 --2- 172.21.15.156:0/842913393 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa5e4127a50 0x7fa5e41138c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fa5d4014000 tx=0x7fa5d4017000).stop 2023-09-30T22:16:54.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.007+0000 7fa5e9e2a700 1 -- 172.21.15.156:0/842913393 shutdown_connections 2023-09-30T22:16:54.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.007+0000 7fa5e9e2a700 1 --2- 172.21.15.156:0/842913393 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5e412b540 0x7fa5e4113db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.007+0000 7fa5e9e2a700 1 --2- 172.21.15.156:0/842913393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5e4097790 0x7fa5e41249d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.007+0000 7fa5e9e2a700 1 --2- 172.21.15.156:0/842913393 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa5e4127a50 0x7fa5e41138c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.007+0000 7fa5e9e2a700 1 -- 172.21.15.156:0/842913393 >> 172.21.15.156:0/842913393 conn(0x7fa5e409bad0 msgr2=0x7fa5e409a800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:54.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.007+0000 7fa5e9e2a700 1 -- 172.21.15.156:0/842913393 shutdown_connections 2023-09-30T22:16:54.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.007+0000 7fa5e9e2a700 1 -- 172.21.15.156:0/842913393 wait complete. 2023-09-30T22:16:54.020 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:16:54.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.138+0000 7fc674da6700 1 Processor -- start 2023-09-30T22:16:54.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.138+0000 7fc674da6700 1 -- start start 2023-09-30T22:16:54.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.139+0000 7fc674da6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc670062b00 0x7fc6701257c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:54.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.139+0000 7fc674da6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc670125330 0x7fc670125cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:54.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.139+0000 7fc674da6700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc670095950 con 0x7fc670093b90 2023-09-30T22:16:54.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.139+0000 7fc674da6700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc670062ee0 con 0x7fc670062b00 2023-09-30T22:16:54.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.139+0000 7fc674da6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6700969c0 con 0x7fc670125330 2023-09-30T22:16:54.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.139+0000 7fc66dd9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc670125330 0x7fc670125cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:54.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.139+0000 7fc66e59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc670062b00 0x7fc6701257c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:54.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.139+0000 7fc66dd9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc670125330 0x7fc670125cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48498/0 (socket says 172.21.15.156:48498) 2023-09-30T22:16:54.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.139+0000 7fc66ed9d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc670093b90 0x7fc670094040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:39302/0 (socket says 172.21.15.156:39302) 2023-09-30T22:16:54.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.139+0000 7fc66dd9b700 1 -- 172.21.15.156:0/3282878583 learned_addr learned my addr 172.21.15.156:0/3282878583 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:54.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.139+0000 7fc66e59c700 1 -- 172.21.15.156:0/3282878583 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc670125330 msgr2=0x7fc670125cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:54.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.139+0000 7fc66e59c700 1 --2- 172.21.15.156:0/3282878583 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc670125330 0x7fc670125cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.139+0000 7fc66e59c700 1 -- 172.21.15.156:0/3282878583 >> v1:172.21.15.156:6789/0 conn(0x7fc670093b90 legacy=0x7fc670094040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:54.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.139+0000 7fc66d59a700 1 -- 172.21.15.156:0/3282878583 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2596834746 0 0) 0x7fc670095950 con 0x7fc670093b90 2023-09-30T22:16:54.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.139+0000 7fc66e59c700 1 -- 172.21.15.156:0/3282878583 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6700635f0 con 0x7fc670062b00 2023-09-30T22:16:54.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.139+0000 7fc66dd9b700 1 --2- 172.21.15.156:0/3282878583 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc670125330 0x7fc670125cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:54.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.139+0000 7fc66e59c700 1 --2- 172.21.15.156:0/3282878583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc670062b00 0x7fc6701257c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fc664009790 tx=0x7fc664009060).ready entity=mon.0 client_cookie=ee85712a3b7efaf0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:54.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.139+0000 7fc66d59a700 1 -- 172.21.15.156:0/3282878583 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66400f510 con 0x7fc670062b00 2023-09-30T22:16:54.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.139+0000 7fc66d59a700 1 -- 172.21.15.156:0/3282878583 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66400f670 con 0x7fc670062b00 2023-09-30T22:16:54.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.139+0000 7fc66d59a700 1 -- 172.21.15.156:0/3282878583 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66400f9f0 con 0x7fc670062b00 2023-09-30T22:16:54.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.140+0000 7fc674da6700 1 -- 172.21.15.156:0/3282878583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc670062b00 msgr2=0x7fc6701257c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:54.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.140+0000 7fc674da6700 1 --2- 172.21.15.156:0/3282878583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc670062b00 0x7fc6701257c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fc664009790 tx=0x7fc664009060).stop 2023-09-30T22:16:54.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.140+0000 7fc674da6700 1 -- 172.21.15.156:0/3282878583 shutdown_connections 2023-09-30T22:16:54.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.140+0000 7fc674da6700 1 --2- 172.21.15.156:0/3282878583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc670062b00 0x7fc6701257c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.140+0000 7fc674da6700 1 --2- 172.21.15.156:0/3282878583 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc670125330 0x7fc670125cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.140+0000 7fc674da6700 1 -- 172.21.15.156:0/3282878583 >> 172.21.15.156:0/3282878583 conn(0x7fc67009aa50 msgr2=0x7fc67009ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:54.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.140+0000 7fc674da6700 1 -- 172.21.15.156:0/3282878583 shutdown_connections 2023-09-30T22:16:54.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.140+0000 7fc674da6700 1 -- 172.21.15.156:0/3282878583 wait complete. 2023-09-30T22:16:54.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.141+0000 7fc674da6700 1 Processor -- start 2023-09-30T22:16:54.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.141+0000 7fc674da6700 1 -- start start 2023-09-30T22:16:54.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.142+0000 7fc674da6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc670062b00 0x7fc670068490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:54.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.142+0000 7fc674da6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc670093b90 0x7fc670068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:54.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.142+0000 7fc674da6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc670068e70 0x7fc670138230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:54.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.142+0000 7fc674da6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc670095b60 con 0x7fc670093b90 2023-09-30T22:16:54.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.142+0000 7fc674da6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc670111ad0 con 0x7fc670068e70 2023-09-30T22:16:54.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.142+0000 7fc674da6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc670068180 con 0x7fc670062b00 2023-09-30T22:16:54.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.142+0000 7fc66dd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc670093b90 0x7fc670068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:54.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.142+0000 7fc66dd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc670093b90 0x7fc670068980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:42008/0 (socket says 172.21.15.156:42008) 2023-09-30T22:16:54.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.142+0000 7fc66dd9b700 1 -- 172.21.15.156:0/264635678 learned_addr learned my addr 172.21.15.156:0/264635678 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:54.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.142+0000 7fc66ed9d700 1 --2- 172.21.15.156:0/264635678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc670068e70 0x7fc670138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:54.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.142+0000 7fc66e59c700 1 --2- 172.21.15.156:0/264635678 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc670062b00 0x7fc670068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:54.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.142+0000 7fc66dd9b700 1 -- 172.21.15.156:0/264635678 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc670062b00 msgr2=0x7fc670068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:54.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.142+0000 7fc66dd9b700 1 --2- 172.21.15.156:0/264635678 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc670062b00 0x7fc670068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.142+0000 7fc66dd9b700 1 -- 172.21.15.156:0/264635678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc670068e70 msgr2=0x7fc670138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:54.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.142+0000 7fc66dd9b700 1 --2- 172.21.15.156:0/264635678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc670068e70 0x7fc670138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.142+0000 7fc66dd9b700 1 -- 172.21.15.156:0/264635678 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc660009370 con 0x7fc670093b90 2023-09-30T22:16:54.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.142+0000 7fc66e59c700 1 --2- 172.21.15.156:0/264635678 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc670062b00 0x7fc670068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:54.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.142+0000 7fc66ed9d700 1 --2- 172.21.15.156:0/264635678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc670068e70 0x7fc670138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:54.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.142+0000 7fc66dd9b700 1 --2- 172.21.15.156:0/264635678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc670093b90 0x7fc670068980 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fc66000ea30 tx=0x7fc6600090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:54.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.142+0000 7fc65e7fc700 1 -- 172.21.15.156:0/264635678 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66000ee70 con 0x7fc670093b90 2023-09-30T22:16:54.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.142+0000 7fc65e7fc700 1 -- 172.21.15.156:0/264635678 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66000c850 con 0x7fc670093b90 2023-09-30T22:16:54.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.142+0000 7fc674da6700 1 -- 172.21.15.156:0/264635678 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6640092a0 con 0x7fc670093b90 2023-09-30T22:16:54.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.142+0000 7fc65e7fc700 1 -- 172.21.15.156:0/264635678 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66000cbd0 con 0x7fc670093b90 2023-09-30T22:16:54.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.142+0000 7fc674da6700 1 -- 172.21.15.156:0/264635678 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc670112910 con 0x7fc670093b90 2023-09-30T22:16:54.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.143+0000 7fc674da6700 1 -- 172.21.15.156:0/264635678 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc67005a260 con 0x7fc670093b90 2023-09-30T22:16:54.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.144+0000 7fc65e7fc700 1 -- 172.21.15.156:0/264635678 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fc660025480 con 0x7fc670093b90 2023-09-30T22:16:54.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.144+0000 7fc65e7fc700 1 -- 172.21.15.156:0/264635678 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fc66003b7d0 con 0x7fc670093b90 2023-09-30T22:16:54.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.148+0000 7fc65e7fc700 1 -- 172.21.15.156:0/264635678 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fc660023530 con 0x7fc670093b90 2023-09-30T22:16:54.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.342+0000 7fc674da6700 1 -- 172.21.15.156:0/264635678 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc670112910 con 0x7fc670093b90 2023-09-30T22:16:54.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.342+0000 7fc65e7fc700 1 -- 172.21.15.156:0/264635678 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2158 (secure 0 0 0) 0x7fc670112910 con 0x7fc670093b90 2023-09-30T22:16:54.342 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:16:54.342 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:16:29.792703+0000","modified":"2023-09-30T22:16:54.002618+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4206},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4206":{"gid":4206,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6817/3817969673","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6817","nonce":3817969673}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:16:54.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.344+0000 7fc674da6700 1 -- 172.21.15.156:0/264635678 >> v1:172.21.15.156:6816/118236 conn(0x7fc65002bb60 legacy=0x7fc65002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:54.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.344+0000 7fc674da6700 1 -- 172.21.15.156:0/264635678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc670093b90 msgr2=0x7fc670068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:54.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.344+0000 7fc674da6700 1 --2- 172.21.15.156:0/264635678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc670093b90 0x7fc670068980 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fc66000ea30 tx=0x7fc6600090f0).stop 2023-09-30T22:16:54.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.344+0000 7fc674da6700 1 -- 172.21.15.156:0/264635678 shutdown_connections 2023-09-30T22:16:54.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.344+0000 7fc674da6700 1 --2- 172.21.15.156:0/264635678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc670068e70 0x7fc670138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.344+0000 7fc674da6700 1 --2- 172.21.15.156:0/264635678 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc670062b00 0x7fc670068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.344+0000 7fc674da6700 1 --2- 172.21.15.156:0/264635678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc670093b90 0x7fc670068980 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.344+0000 7fc674da6700 1 -- 172.21.15.156:0/264635678 >> 172.21.15.156:0/264635678 conn(0x7fc67009aa50 msgr2=0x7fc67012bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:54.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.345+0000 7fc674da6700 1 -- 172.21.15.156:0/264635678 shutdown_connections 2023-09-30T22:16:54.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.345+0000 7fc674da6700 1 -- 172.21.15.156:0/264635678 wait complete. 2023-09-30T22:16:54.345 INFO:teuthology.orchestra.run.smithi156.stderr:dumped fsmap epoch 7 2023-09-30T22:16:54.456 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T22:16:29.792703+0000', 'modified': '2023-09-30T22:16:54.002618+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4206}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4206': {'gid': 4206, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.156:6817/3817969673', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.156:6817', 'nonce': 3817969673}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-09-30T22:16:54.457 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T22:16:54.457 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-09-30T22:16:54.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.575+0000 7f93c6cd8700 1 Processor -- start 2023-09-30T22:16:54.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.575+0000 7f93c6cd8700 1 -- start start 2023-09-30T22:16:54.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.575+0000 7f93c6cd8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93c005f560 0x7f93c012ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:54.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.575+0000 7f93c6cd8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f93c012b370 0x7f93c0095d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:54.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.575+0000 7f93c6cd8700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c0066f90 con 0x7f93c012b790 2023-09-30T22:16:54.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.575+0000 7f93c6cd8700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c005f940 con 0x7f93c012b370 2023-09-30T22:16:54.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.575+0000 7f93c6cd8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c0067650 con 0x7f93c005f560 2023-09-30T22:16:54.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.575+0000 7f93c4a74700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93c005f560 0x7f93c012ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:54.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.575+0000 7f93bffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f93c012b370 0x7f93c0095d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:54.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.575+0000 7f93c5275700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f93c012b790 0x7f93c0096280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:39318/0 (socket says 172.21.15.156:39318) 2023-09-30T22:16:54.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.575+0000 7f93c5275700 1 -- 172.21.15.156:0/3745400532 learned_addr learned my addr 172.21.15.156:0/3745400532 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:16:54.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.575+0000 7f93c4a74700 1 --2- 172.21.15.156:0/3745400532 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93c005f560 0x7f93c012ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53570/0 (socket says 172.21.15.156:53570) 2023-09-30T22:16:54.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.576+0000 7f93c4a74700 1 -- 172.21.15.156:0/3745400532 >> v2:172.21.15.156:3300/0 conn(0x7f93c012b370 msgr2=0x7f93c0095d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:54.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.576+0000 7f93c4a74700 1 --2- 172.21.15.156:0/3745400532 >> v2:172.21.15.156:3300/0 conn(0x7f93c012b370 0x7f93c0095d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.576+0000 7f93c4a74700 1 -- 172.21.15.156:0/3745400532 >> v1:172.21.15.156:6789/0 conn(0x7f93c012b790 legacy=0x7f93c0096280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:54.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.576+0000 7f93c4a74700 1 -- 172.21.15.156:0/3745400532 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c0067910 con 0x7f93c005f560 2023-09-30T22:16:54.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.576+0000 7f93bf7fe700 1 -- 172.21.15.156:0/3745400532 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3880100408 0 0) 0x7f93c0066f90 con 0x7f93c012b790 2023-09-30T22:16:54.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.576+0000 7f93bffff700 1 --2- 172.21.15.156:0/3745400532 >> v2:172.21.15.156:3300/0 conn(0x7f93c012b370 0x7f93c0095d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:54.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.576+0000 7f93c4a74700 1 --2- 172.21.15.156:0/3745400532 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93c005f560 0x7f93c012ae80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f93b4009790 tx=0x7f93b4009060).ready entity=mon.1 client_cookie=e9e0ca60a28da36e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:54.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.576+0000 7f93bf7fe700 1 -- 172.21.15.156:0/3745400532 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b400f510 con 0x7f93c005f560 2023-09-30T22:16:54.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.576+0000 7f93bf7fe700 1 -- 172.21.15.156:0/3745400532 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b400f670 con 0x7f93c005f560 2023-09-30T22:16:54.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.576+0000 7f93bf7fe700 1 -- 172.21.15.156:0/3745400532 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b400f9f0 con 0x7f93c005f560 2023-09-30T22:16:54.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.576+0000 7f93c6cd8700 1 -- 172.21.15.156:0/3745400532 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93c005f560 msgr2=0x7f93c012ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:54.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.576+0000 7f93c6cd8700 1 --2- 172.21.15.156:0/3745400532 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93c005f560 0x7f93c012ae80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f93b4009790 tx=0x7f93b4009060).stop 2023-09-30T22:16:54.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.577+0000 7f93c6cd8700 1 -- 172.21.15.156:0/3745400532 shutdown_connections 2023-09-30T22:16:54.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.577+0000 7f93c6cd8700 1 --2- 172.21.15.156:0/3745400532 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93c005f560 0x7f93c012ae80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.577+0000 7f93c6cd8700 1 --2- 172.21.15.156:0/3745400532 >> v2:172.21.15.156:3300/0 conn(0x7f93c012b370 0x7f93c0095d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.577+0000 7f93c6cd8700 1 -- 172.21.15.156:0/3745400532 >> 172.21.15.156:0/3745400532 conn(0x7f93c009a1c0 msgr2=0x7f93c009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:54.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.577+0000 7f93c6cd8700 1 -- 172.21.15.156:0/3745400532 shutdown_connections 2023-09-30T22:16:54.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.577+0000 7f93c6cd8700 1 -- 172.21.15.156:0/3745400532 wait complete. 2023-09-30T22:16:54.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.577+0000 7f93c6cd8700 1 Processor -- start 2023-09-30T22:16:54.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.578+0000 7f93c6cd8700 1 -- start start 2023-09-30T22:16:54.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.578+0000 7f93c6cd8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93c005f560 0x7f93c0115770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:54.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.578+0000 7f93c6cd8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93c012b370 0x7f93c0115c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:54.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.578+0000 7f93c6cd8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f93c012b790 0x7f93c0116150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:54.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.578+0000 7f93c6cd8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c0115520 con 0x7f93c005f560 2023-09-30T22:16:54.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.578+0000 7f93c6cd8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c01293a0 con 0x7f93c012b370 2023-09-30T22:16:54.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.578+0000 7f93c6cd8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93c00671c0 con 0x7f93c012b790 2023-09-30T22:16:54.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.578+0000 7f93c4a74700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93c005f560 0x7f93c0115770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:54.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.578+0000 7f93bffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93c012b370 0x7f93c0115c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:54.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.578+0000 7f93c4a74700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93c005f560 0x7f93c0115770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:42028/0 (socket says 172.21.15.156:42028) 2023-09-30T22:16:54.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.578+0000 7f93c4a74700 1 -- 172.21.15.156:0/171758719 learned_addr learned my addr 172.21.15.156:0/171758719 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:54.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.578+0000 7f93c5275700 1 --2- 172.21.15.156:0/171758719 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f93c012b790 0x7f93c0116150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:54.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.578+0000 7f93c4a74700 1 -- 172.21.15.156:0/171758719 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f93c012b790 msgr2=0x7f93c0116150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:54.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.578+0000 7f93c4a74700 1 --2- 172.21.15.156:0/171758719 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f93c012b790 0x7f93c0116150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.578+0000 7f93c4a74700 1 -- 172.21.15.156:0/171758719 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93c012b370 msgr2=0x7f93c0115c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:54.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.578+0000 7f93c4a74700 1 --2- 172.21.15.156:0/171758719 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93c012b370 0x7f93c0115c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.578+0000 7f93c4a74700 1 -- 172.21.15.156:0/171758719 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac0092a0 con 0x7f93c005f560 2023-09-30T22:16:54.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.579+0000 7f93c4a74700 1 --2- 172.21.15.156:0/171758719 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93c005f560 0x7f93c0115770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f93b4009e30 tx=0x7f93b4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:54.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.579+0000 7f93bcff9700 1 -- 172.21.15.156:0/171758719 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b400f7e0 con 0x7f93c005f560 2023-09-30T22:16:54.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.579+0000 7f93bcff9700 1 -- 172.21.15.156:0/171758719 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b400f940 con 0x7f93c005f560 2023-09-30T22:16:54.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.579+0000 7f93c6cd8700 1 -- 172.21.15.156:0/171758719 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b40092a0 con 0x7f93c005f560 2023-09-30T22:16:54.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.579+0000 7f93bcff9700 1 -- 172.21.15.156:0/171758719 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b401b660 con 0x7f93c005f560 2023-09-30T22:16:54.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.579+0000 7f93c6cd8700 1 -- 172.21.15.156:0/171758719 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c0116c70 con 0x7f93c005f560 2023-09-30T22:16:54.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.579+0000 7f93bcff9700 1 -- 172.21.15.156:0/171758719 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f93b401ba10 con 0x7f93c005f560 2023-09-30T22:16:54.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.580+0000 7f93bcff9700 1 -- 172.21.15.156:0/171758719 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f93b403c7d0 con 0x7f93c005f560 2023-09-30T22:16:54.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.582+0000 7f93d868bb80 1 Processor -- start 2023-09-30T22:16:54.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.582+0000 7f93d868bb80 1 -- start start 2023-09-30T22:16:54.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.583+0000 7f93d868bb80 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c02e655170 0x55c02e655550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:54.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.583+0000 7f93d868bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c02e655a40 0x55c02e67f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:54.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.583+0000 7f93d868bb80 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55c02e67f5b0 0x55c02e6819a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:54.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.583+0000 7f93d868bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02e61f610 con 0x55c02e655a40 2023-09-30T22:16:54.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.583+0000 7f93d868bb80 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c02e595db0 con 0x55c02e655170 2023-09-30T22:16:54.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.583+0000 7f93d868bb80 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x55c02e5ab030 con 0x55c02e67f5b0 2023-09-30T22:16:54.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.583+0000 7f93c4a74700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c02e655170 0x55c02e655550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:54.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.583+0000 7f93c5275700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55c02e67f5b0 0x55c02e6819a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:54.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.583+0000 7f93c4a74700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c02e655170 0x55c02e655550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53586/0 (socket says 172.21.15.156:53586) 2023-09-30T22:16:54.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.583+0000 7f93c5275700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55c02e67f5b0 0x55c02e6819a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48534/0 (socket says 172.21.15.156:48534) 2023-09-30T22:16:54.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.583+0000 7f93c4a74700 1 -- 172.21.15.156:0/1673713218 learned_addr learned my addr 172.21.15.156:0/1673713218 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:54.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.583+0000 7f93bffff700 1 --2- 172.21.15.156:0/1673713218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c02e655a40 0x55c02e67f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:54.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.583+0000 7f93c4a74700 1 -- 172.21.15.156:0/1673713218 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55c02e67f5b0 msgr2=0x55c02e6819a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:54.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.583+0000 7f93c4a74700 1 --2- 172.21.15.156:0/1673713218 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55c02e67f5b0 0x55c02e6819a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.583+0000 7f93c4a74700 1 -- 172.21.15.156:0/1673713218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c02e655a40 msgr2=0x55c02e67f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:54.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.583+0000 7f93c4a74700 1 --2- 172.21.15.156:0/1673713218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c02e655a40 0x55c02e67f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.583+0000 7f93c4a74700 1 -- 172.21.15.156:0/1673713218 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c02e446710 con 0x55c02e655170 2023-09-30T22:16:54.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.583+0000 7f93bffff700 1 --2- 172.21.15.156:0/1673713218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c02e655a40 0x55c02e67f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:54.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.583+0000 7f93c5275700 1 --2- 172.21.15.156:0/1673713218 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55c02e67f5b0 0x55c02e6819a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:54.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.583+0000 7f93c4a74700 1 --2- 172.21.15.156:0/1673713218 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c02e655170 0x55c02e655550 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f93b402c7c0 tx=0x7f93b401c000).ready entity=mon.1 client_cookie=bcaf11c520b60253 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:54.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.583+0000 7f93a9ffb700 1 -- 172.21.15.156:0/1673713218 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4022c60 con 0x55c02e655170 2023-09-30T22:16:54.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.583+0000 7f93a9ffb700 1 -- 172.21.15.156:0/1673713218 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b4022dc0 con 0x55c02e655170 2023-09-30T22:16:54.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.583+0000 7f93a9ffb700 1 -- 172.21.15.156:0/1673713218 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b402cd80 con 0x55c02e655170 2023-09-30T22:16:54.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.584+0000 7f93d868bb80 1 -- 172.21.15.156:0/1673713218 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c02e655170 msgr2=0x55c02e655550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:54.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.584+0000 7f93d868bb80 1 --2- 172.21.15.156:0/1673713218 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c02e655170 0x55c02e655550 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f93b402c7c0 tx=0x7f93b401c000).stop 2023-09-30T22:16:54.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.584+0000 7f93d868bb80 1 -- 172.21.15.156:0/1673713218 shutdown_connections 2023-09-30T22:16:54.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.584+0000 7f93d868bb80 1 --2- 172.21.15.156:0/1673713218 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55c02e67f5b0 0x55c02e6819a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.584+0000 7f93d868bb80 1 --2- 172.21.15.156:0/1673713218 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c02e655170 0x55c02e655550 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.584+0000 7f93d868bb80 1 --2- 172.21.15.156:0/1673713218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c02e655a40 0x55c02e67f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.584+0000 7f93d868bb80 1 -- 172.21.15.156:0/1673713218 >> 172.21.15.156:0/1673713218 conn(0x55c02e4c3940 msgr2=0x55c02e675cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:54.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.584+0000 7f93d868bb80 1 -- 172.21.15.156:0/1673713218 shutdown_connections 2023-09-30T22:16:54.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.584+0000 7f93d868bb80 1 -- 172.21.15.156:0/1673713218 wait complete. 2023-09-30T22:16:54.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.584+0000 7f93d868bb80 1 -- start start 2023-09-30T22:16:54.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.585+0000 7f93d868bb80 1 Processor -- start 2023-09-30T22:16:54.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.585+0000 7f93d868bb80 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c02e655170 0x55c02e67aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:54.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.585+0000 7f93d868bb80 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55c02e655a40 0x55c02e67af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:54.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.585+0000 7f93d868bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c02e67f5b0 0x55c02e67b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:54.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.585+0000 7f93d868bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02e5ab170 con 0x55c02e67f5b0 2023-09-30T22:16:54.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.585+0000 7f93d868bb80 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c02e5ab3f0 con 0x55c02e655170 2023-09-30T22:16:54.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.585+0000 7f93d868bb80 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x55c02e576920 con 0x55c02e655a40 2023-09-30T22:16:54.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.585+0000 7f93d868bb80 10 client.0 ll_register_callbacks cb 0x55c02e54bce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:16:54.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.585+0000 7f93bffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55c02e655a40 0x55c02e67af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:54.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.585+0000 7f93bffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55c02e655a40 0x55c02e67af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48542/0 (socket says 172.21.15.156:48542) 2023-09-30T22:16:54.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.585+0000 7f93bffff700 1 -- 172.21.15.156:0/3954214267 learned_addr learned my addr 172.21.15.156:0/3954214267 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:54.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.585+0000 7f93c4a74700 1 --2- 172.21.15.156:0/3954214267 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c02e655170 0x55c02e67aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:54.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.585+0000 7f93c5275700 1 --2- 172.21.15.156:0/3954214267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c02e67f5b0 0x55c02e67b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:54.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.586+0000 7f93bffff700 1 -- 172.21.15.156:0/3954214267 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c02e655170 msgr2=0x55c02e67aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:54.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.586+0000 7f93bffff700 1 --2- 172.21.15.156:0/3954214267 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c02e655170 0x55c02e67aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.586+0000 7f93bffff700 1 -- 172.21.15.156:0/3954214267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c02e67f5b0 msgr2=0x55c02e67b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:54.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.586+0000 7f93bffff700 1 --2- 172.21.15.156:0/3954214267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c02e67f5b0 0x55c02e67b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.586+0000 7f93bffff700 1 -- 172.21.15.156:0/3954214267 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c0116c70 con 0x55c02e655a40 2023-09-30T22:16:54.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.586+0000 7f93bffff700 1 --2- 172.21.15.156:0/3954214267 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55c02e655a40 0x55c02e67af90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f93ac016fc0 tx=0x7f93ac009060).ready entity=mon.2 client_cookie=96aabee0ed0ab621 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:54.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.586+0000 7f939effd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3302/0 2023-09-30T22:16:54.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.586+0000 7f939effd700 1 -- 172.21.15.156:0/3954214267 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac009cb0 con 0x55c02e655a40 2023-09-30T22:16:54.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.586+0000 7f939effd700 1 -- 172.21.15.156:0/3954214267 <== mon.2 v2:172.21.15.156:3302/0 2 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f93ac014d80 con 0x55c02e655a40 2023-09-30T22:16:54.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.586+0000 7f93d868bb80 1 -- 172.21.15.156:0/3954214267 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c02e64df20 con 0x55c02e655a40 2023-09-30T22:16:54.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.586+0000 7f939effd700 1 -- 172.21.15.156:0/3954214267 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93ac01f600 con 0x55c02e655a40 2023-09-30T22:16:54.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.586+0000 7f93d868bb80 10 client.4583 fetch_fsmap learned FSMap version 7 2023-09-30T22:16:54.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.586+0000 7f93d868bb80 1 -- 172.21.15.156:0/3954214267 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55c02e57db00 con 0x55c02e655a40 2023-09-30T22:16:54.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.586+0000 7f939effd700 1 -- 172.21.15.156:0/3954214267 <== mon.2 v2:172.21.15.156:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c02e64df20 con 0x55c02e655a40 2023-09-30T22:16:54.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.586+0000 7f939effd700 1 -- 172.21.15.156:0/3954214267 <== mon.2 v2:172.21.15.156:3302/0 5 ==== fsmap(e 7) v1 ==== 1430+0+0 (secure 0 0 0) 0x7f93ac011070 con 0x55c02e655a40 2023-09-30T22:16:54.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.586+0000 7f93d868bb80 10 client.4583 fetch_fsmap finished waiting for FSMap version 7 2023-09-30T22:16:54.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.586+0000 7f93d868bb80 10 client.4583 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:16:54.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.586+0000 7f93d868bb80 20 client.4583 populate_metadata read hostname 'smithi156' 2023-09-30T22:16:54.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.586+0000 7f93d868bb80 4 client.4583 mds_command: new command op to 4206 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-30T22:16:54.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.586+0000 7f93d868bb80 1 -- 172.21.15.156:0/3954214267 --> v1:172.21.15.156:6817/3817969673 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c02e623250 con 0x55c02e685400 2023-09-30T22:16:54.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.587+0000 7f939effd700 10 client.4583 ms_handle_connect on v1:172.21.15.156:6817/3817969673 2023-09-30T22:16:54.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.587+0000 7f939effd700 1 -- 172.21.15.156:0/3954214267 <== mds.0 v1:172.21.15.156:6817/3817969673 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x55c02e623250 con 0x55c02e685400 2023-09-30T22:16:54.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.587+0000 7f939effd700 10 client.4583 handle_command_reply: tid=0 2023-09-30T22:16:54.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.587+0000 7f93d868bb80 1 client.4583 shutdown 2023-09-30T22:16:54.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.587+0000 7f93d868bb80 1 -- 172.21.15.156:0/3954214267 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55c02e655a40 msgr2=0x55c02e67af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:54.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.587+0000 7f93d868bb80 1 --2- 172.21.15.156:0/3954214267 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55c02e655a40 0x55c02e67af90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f93ac016fc0 tx=0x7f93ac009060).stop 2023-09-30T22:16:54.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.587+0000 7f93d868bb80 1 -- 172.21.15.156:0/3954214267 shutdown_connections 2023-09-30T22:16:54.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.587+0000 7f93d868bb80 1 --2- 172.21.15.156:0/3954214267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c02e67f5b0 0x55c02e67b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.587+0000 7f93d868bb80 1 --2- 172.21.15.156:0/3954214267 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c02e655170 0x55c02e67aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.587+0000 7f93d868bb80 1 --2- 172.21.15.156:0/3954214267 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55c02e655a40 0x55c02e67af90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.587+0000 7f939effd700 0 client.4583 ms_handle_reset on v1:172.21.15.156:6817/3817969673 2023-09-30T22:16:54.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.587+0000 7f93d868bb80 1 -- 172.21.15.156:0/3954214267 >> 172.21.15.156:0/3954214267 conn(0x55c02e4c3940 msgr2=0x55c02e675c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:54.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.588+0000 7f93d868bb80 1 -- 172.21.15.156:0/3954214267 shutdown_connections 2023-09-30T22:16:54.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.588+0000 7f93d868bb80 1 -- 172.21.15.156:0/3954214267 wait complete. 2023-09-30T22:16:54.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.588+0000 7f93d868bb80 20 client.4583 trim_cache size 0 max 16384 2023-09-30T22:16:54.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.604+0000 7f93d868bb80 1 Processor -- start 2023-09-30T22:16:54.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.604+0000 7f93d868bb80 1 -- start start 2023-09-30T22:16:54.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.604+0000 7f93d868bb80 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55c02e655170 0x55c02e6764d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:54.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.604+0000 7f93d868bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c02e655a40 0x55c02e673040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:54.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.604+0000 7f93d868bb80 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c02e67f5b0 0x55c02e68ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:54.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.604+0000 7f93d868bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02e670970 con 0x55c02e655a40 2023-09-30T22:16:54.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.604+0000 7f93d868bb80 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c02e659330 con 0x55c02e67f5b0 2023-09-30T22:16:54.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.604+0000 7f93d868bb80 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x55c02e596c50 con 0x55c02e655170 2023-09-30T22:16:54.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.604+0000 7f93bffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c02e655a40 0x55c02e673040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:54.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.604+0000 7f93c5275700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c02e67f5b0 0x55c02e68ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:54.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.604+0000 7f93c4a74700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55c02e655170 0x55c02e6764d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:54.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.604+0000 7f93bffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c02e655a40 0x55c02e673040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:42054/0 (socket says 172.21.15.156:42054) 2023-09-30T22:16:54.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.604+0000 7f93c5275700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c02e67f5b0 0x55c02e68ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53606/0 (socket says 172.21.15.156:53606) 2023-09-30T22:16:54.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.604+0000 7f93c4a74700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55c02e655170 0x55c02e6764d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48552/0 (socket says 172.21.15.156:48552) 2023-09-30T22:16:54.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.604+0000 7f93bffff700 1 -- 172.21.15.156:0/381110229 learned_addr learned my addr 172.21.15.156:0/381110229 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:54.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.605+0000 7f93bffff700 1 -- 172.21.15.156:0/381110229 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55c02e655170 msgr2=0x55c02e6764d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:54.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.605+0000 7f93bffff700 1 --2- 172.21.15.156:0/381110229 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55c02e655170 0x55c02e6764d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.605+0000 7f93bffff700 1 -- 172.21.15.156:0/381110229 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c02e67f5b0 msgr2=0x55c02e68ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:54.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.605+0000 7f93bffff700 1 --2- 172.21.15.156:0/381110229 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c02e67f5b0 0x55c02e68ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.605+0000 7f93bffff700 1 -- 172.21.15.156:0/381110229 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c02e5a3f70 con 0x55c02e655a40 2023-09-30T22:16:54.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.605+0000 7f93c4a74700 1 --2- 172.21.15.156:0/381110229 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55c02e655170 0x55c02e6764d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:54.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.605+0000 7f93c5275700 1 --2- 172.21.15.156:0/381110229 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c02e67f5b0 0x55c02e68ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:54.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.605+0000 7f93bffff700 1 --2- 172.21.15.156:0/381110229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c02e655a40 0x55c02e673040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f93ac006e00 tx=0x7f93ac01e000).ready entity=mon.0 client_cookie=b3a5780e1a46a382 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:54.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.605+0000 7f93aa7fc700 1 -- 172.21.15.156:0/381110229 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac030070 con 0x55c02e655a40 2023-09-30T22:16:54.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.605+0000 7f93aa7fc700 1 -- 172.21.15.156:0/381110229 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93ac014d80 con 0x55c02e655a40 2023-09-30T22:16:54.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.605+0000 7f93aa7fc700 1 -- 172.21.15.156:0/381110229 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac014970 con 0x55c02e655a40 2023-09-30T22:16:54.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.605+0000 7f93d868bb80 1 -- 172.21.15.156:0/381110229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c02e655a40 msgr2=0x55c02e673040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:54.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.605+0000 7f93d868bb80 1 --2- 172.21.15.156:0/381110229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c02e655a40 0x55c02e673040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f93ac006e00 tx=0x7f93ac01e000).stop 2023-09-30T22:16:54.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.605+0000 7f93d868bb80 1 -- 172.21.15.156:0/381110229 shutdown_connections 2023-09-30T22:16:54.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.605+0000 7f93d868bb80 1 --2- 172.21.15.156:0/381110229 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c02e67f5b0 0x55c02e68ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.605+0000 7f93d868bb80 1 --2- 172.21.15.156:0/381110229 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55c02e655170 0x55c02e6764d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.605+0000 7f93d868bb80 1 --2- 172.21.15.156:0/381110229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c02e655a40 0x55c02e673040 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.605+0000 7f93d868bb80 1 -- 172.21.15.156:0/381110229 >> 172.21.15.156:0/381110229 conn(0x55c02e4c3940 msgr2=0x55c02e659520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:54.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.605+0000 7f93d868bb80 1 -- 172.21.15.156:0/381110229 shutdown_connections 2023-09-30T22:16:54.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.605+0000 7f93d868bb80 1 -- 172.21.15.156:0/381110229 wait complete. 2023-09-30T22:16:54.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.606+0000 7f93d868bb80 1 -- start start 2023-09-30T22:16:54.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.606+0000 7f93d868bb80 1 Processor -- start 2023-09-30T22:16:54.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.607+0000 7f93d868bb80 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c02e655170 0x55c02e682990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:54.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.607+0000 7f93d868bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c02e655a40 0x55c02e682e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:54.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.607+0000 7f93d868bb80 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55c02e67f5b0 0x55c02e683370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:16:54.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.607+0000 7f93d868bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02e6bd920 con 0x55c02e655a40 2023-09-30T22:16:54.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.607+0000 7f93d868bb80 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c02e68b910 con 0x55c02e655170 2023-09-30T22:16:54.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.607+0000 7f93d868bb80 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x55c02e682670 con 0x55c02e67f5b0 2023-09-30T22:16:54.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.607+0000 7f93d868bb80 10 client.0 ll_register_callbacks cb 0x55c02e54bce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:16:54.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.607+0000 7f93bffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c02e655a40 0x55c02e682e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:54.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.607+0000 7f93c5275700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55c02e67f5b0 0x55c02e683370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:54.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.607+0000 7f93bffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c02e655a40 0x55c02e682e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:42056/0 (socket says 172.21.15.156:42056) 2023-09-30T22:16:54.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.607+0000 7f93bffff700 1 -- 172.21.15.156:0/1807614229 learned_addr learned my addr 172.21.15.156:0/1807614229 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:16:54.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.607+0000 7f93c4a74700 1 --2- 172.21.15.156:0/1807614229 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c02e655170 0x55c02e682990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:16:54.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.607+0000 7f93c5275700 1 -- 172.21.15.156:0/1807614229 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c02e655170 msgr2=0x55c02e682990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:54.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.607+0000 7f93c5275700 1 --2- 172.21.15.156:0/1807614229 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c02e655170 0x55c02e682990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.607+0000 7f93c5275700 1 -- 172.21.15.156:0/1807614229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c02e655a40 msgr2=0x55c02e682e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:16:54.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.607+0000 7f93c5275700 1 --2- 172.21.15.156:0/1807614229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c02e655a40 0x55c02e682e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.607+0000 7f93c5275700 1 -- 172.21.15.156:0/1807614229 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c02e446710 con 0x55c02e67f5b0 2023-09-30T22:16:54.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.607+0000 7f93bffff700 1 --2- 172.21.15.156:0/1807614229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c02e655a40 0x55c02e682e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:16:54.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.607+0000 7f93c5275700 1 --2- 172.21.15.156:0/1807614229 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55c02e67f5b0 0x55c02e683370 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f93b8004fd0 tx=0x7f93b8006040).ready entity=mon.2 client_cookie=3aef1f39e61a7484 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:16:54.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.607+0000 7f939effd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3302/0 2023-09-30T22:16:54.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.607+0000 7f939effd700 1 -- 172.21.15.156:0/1807614229 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b801b070 con 0x55c02e67f5b0 2023-09-30T22:16:54.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.607+0000 7f939effd700 1 -- 172.21.15.156:0/1807614229 <== mon.2 v2:172.21.15.156:3302/0 2 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f93b8016af0 con 0x55c02e67f5b0 2023-09-30T22:16:54.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.607+0000 7f93d868bb80 1 -- 172.21.15.156:0/1807614229 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f93b4022dc0 con 0x55c02e67f5b0 2023-09-30T22:16:54.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.607+0000 7f939effd700 1 -- 172.21.15.156:0/1807614229 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93b8001d30 con 0x55c02e67f5b0 2023-09-30T22:16:54.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.607+0000 7f93d868bb80 10 client.4589 fetch_fsmap learned FSMap version 7 2023-09-30T22:16:54.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.607+0000 7f93d868bb80 1 -- 172.21.15.156:0/1807614229 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x7f93b8001af0 con 0x55c02e67f5b0 2023-09-30T22:16:54.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.608+0000 7f939effd700 1 -- 172.21.15.156:0/1807614229 <== mon.2 v2:172.21.15.156:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b4022dc0 con 0x55c02e67f5b0 2023-09-30T22:16:54.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.608+0000 7f939effd700 1 -- 172.21.15.156:0/1807614229 <== mon.2 v2:172.21.15.156:3302/0 5 ==== fsmap(e 7) v1 ==== 1430+0+0 (secure 0 0 0) 0x7f93b8012030 con 0x55c02e67f5b0 2023-09-30T22:16:54.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.608+0000 7f93d868bb80 10 client.4589 fetch_fsmap finished waiting for FSMap version 7 2023-09-30T22:16:54.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.608+0000 7f93d868bb80 10 client.4589 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:16:54.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.608+0000 7f93d868bb80 20 client.4589 populate_metadata read hostname 'smithi156' 2023-09-30T22:16:54.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.608+0000 7f93d868bb80 4 client.4589 mds_command: new command op to 4206 tid=0[{"prefix": "status"}] 2023-09-30T22:16:54.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.608+0000 7f93d868bb80 1 -- 172.21.15.156:0/1807614229 --> v1:172.21.15.156:6817/3817969673 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c02e413ef0 con 0x55c02e6d9b70 2023-09-30T22:16:54.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.608+0000 7f939effd700 10 client.4589 ms_handle_connect on v1:172.21.15.156:6817/3817969673 2023-09-30T22:16:54.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.608+0000 7f939effd700 1 -- 172.21.15.156:0/1807614229 <== mds.0 v1:172.21.15.156:6817/3817969673 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (unknown 0 0 1813319412) 0x55c02e413ef0 con 0x55c02e6d9b70 2023-09-30T22:16:54.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.608+0000 7f939effd700 10 client.4589 handle_command_reply: tid=0 2023-09-30T22:16:54.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.608+0000 7f93d868bb80 1 client.4589 shutdown 2023-09-30T22:16:54.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.608+0000 7f93d868bb80 1 -- 172.21.15.156:0/1807614229 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55c02e67f5b0 msgr2=0x55c02e683370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:54.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.608+0000 7f93d868bb80 1 --2- 172.21.15.156:0/1807614229 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55c02e67f5b0 0x55c02e683370 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f93b8004fd0 tx=0x7f93b8006040).stop 2023-09-30T22:16:54.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.608+0000 7f93d868bb80 1 -- 172.21.15.156:0/1807614229 shutdown_connections 2023-09-30T22:16:54.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.608+0000 7f93d868bb80 1 --2- 172.21.15.156:0/1807614229 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55c02e67f5b0 0x55c02e683370 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.608+0000 7f939effd700 0 client.4589 ms_handle_reset on v1:172.21.15.156:6817/3817969673 2023-09-30T22:16:54.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.608+0000 7f93d868bb80 1 --2- 172.21.15.156:0/1807614229 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55c02e655170 0x55c02e682990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.608+0000 7f93d868bb80 1 --2- 172.21.15.156:0/1807614229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c02e655a40 0x55c02e682e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.608+0000 7f93d868bb80 1 -- 172.21.15.156:0/1807614229 >> 172.21.15.156:0/1807614229 conn(0x55c02e4c3940 msgr2=0x55c02e67ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:54.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.609+0000 7f93d868bb80 1 -- 172.21.15.156:0/1807614229 shutdown_connections 2023-09-30T22:16:54.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.609+0000 7f93d868bb80 1 -- 172.21.15.156:0/1807614229 wait complete. 2023-09-30T22:16:54.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.609+0000 7f93d868bb80 20 client.4589 trim_cache size 0 max 16384 2023-09-30T22:16:54.617 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2023-09-30T22:16:54.617 INFO:teuthology.orchestra.run.smithi156.stdout: "cluster_fsid": "bf403786-ca20-4e4a-92c0-a0a997d43bba", 2023-09-30T22:16:54.617 INFO:teuthology.orchestra.run.smithi156.stdout: "whoami": 0, 2023-09-30T22:16:54.617 INFO:teuthology.orchestra.run.smithi156.stdout: "id": 4206, 2023-09-30T22:16:54.617 INFO:teuthology.orchestra.run.smithi156.stdout: "want_state": "up:active", 2023-09-30T22:16:54.617 INFO:teuthology.orchestra.run.smithi156.stdout: "state": "up:active", 2023-09-30T22:16:54.617 INFO:teuthology.orchestra.run.smithi156.stdout: "fs_name": "cephfs", 2023-09-30T22:16:54.617 INFO:teuthology.orchestra.run.smithi156.stdout: "rank_uptime": 24.814802842999999, 2023-09-30T22:16:54.617 INFO:teuthology.orchestra.run.smithi156.stdout: "mdsmap_epoch": 7, 2023-09-30T22:16:54.617 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_epoch": 17, 2023-09-30T22:16:54.617 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_epoch_barrier": 17, 2023-09-30T22:16:54.618 INFO:teuthology.orchestra.run.smithi156.stdout: "uptime": 29.094266033 2023-09-30T22:16:54.618 INFO:teuthology.orchestra.run.smithi156.stdout:} 2023-09-30T22:16:54.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.609+0000 7f93c6cd8700 1 -- 172.21.15.156:0/171758719 >> v1:172.21.15.156:6816/118236 conn(0x7f93a402bb90 legacy=0x7f93a402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:54.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.609+0000 7f93c6cd8700 1 -- 172.21.15.156:0/171758719 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93c005f560 msgr2=0x7f93c0115770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:16:54.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.609+0000 7f93c6cd8700 1 --2- 172.21.15.156:0/171758719 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93c005f560 0x7f93c0115770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f93b4009e30 tx=0x7f93b4017000).stop 2023-09-30T22:16:54.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.609+0000 7f93c6cd8700 1 -- 172.21.15.156:0/171758719 shutdown_connections 2023-09-30T22:16:54.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.609+0000 7f93c6cd8700 1 --2- 172.21.15.156:0/171758719 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f93c012b790 0x7f93c0116150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.609+0000 7f93c6cd8700 1 --2- 172.21.15.156:0/171758719 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93c005f560 0x7f93c0115770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.609+0000 7f93c6cd8700 1 --2- 172.21.15.156:0/171758719 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93c012b370 0x7f93c0115c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:16:54.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.609+0000 7f93c6cd8700 1 -- 172.21.15.156:0/171758719 >> 172.21.15.156:0/171758719 conn(0x7f93c009a1c0 msgr2=0x7f93c012d480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:16:54.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.609+0000 7f93c6cd8700 1 -- 172.21.15.156:0/171758719 shutdown_connections 2023-09-30T22:16:54.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:16:54.609+0000 7f93c6cd8700 1 -- 172.21.15.156:0/171758719 wait complete. 2023-09-30T22:16:54.620 INFO:teuthology.run_tasks:Running task print... 2023-09-30T22:16:54.630 INFO:teuthology.task.print:**** done mds pre-upgrade sequence 2023-09-30T22:16:54.630 INFO:teuthology.run_tasks:Running task install.upgrade... 2023-09-30T22:16:54.642 INFO:teuthology.task.install:project ceph config {'mon.a': {'branch': 'reef'}} overrides {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'} 2023-09-30T22:16:54.642 INFO:teuthology.task.install:config contains sha1|tag|branch, removing those keys from override 2023-09-30T22:16:54.642 INFO:teuthology.task.install:remote ubuntu@smithi156.front.sepia.ceph.com config {'branch': 'reef', 'flavor': 'default'} 2023-09-30T22:16:54.643 INFO:teuthology.task.install:extra packages: [] 2023-09-30T22:16:54.648 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-30T22:16:54.648 INFO:teuthology.task.install:Upgrading ceph rpm packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd 2023-09-30T22:16:54.649 DEBUG:teuthology.orchestra.run.smithi156:> rpm -q ceph-common --qf '%{VERSION}-%{RELEASE}' 2023-09-30T22:16:54.672 INFO:teuthology.orchestra.run.smithi156.stdout:16.2.14-44.geeb13ac9.el8 2023-09-30T22:16:54.672 INFO:teuthology.packaging:The installed version of ceph-common is 16.2.14-44.geeb13ac9.el8 2023-09-30T22:16:54.672 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-09-30T22:16:54.985 INFO:teuthology.task.install:Ceph rpm upgrade from 16.2.14-44.geeb13ac9.el8 to 18.2.0-501.gfc1e90a3 2023-09-30T22:16:54.985 INFO:teuthology.task.install.rpm:Host smithi156 is: centos 8 x86_64 2023-09-30T22:16:54.986 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-09-30T22:16:55.195 INFO:teuthology.task.install.rpm:Repo base URL: https://3.chacra.ceph.com/r/ceph/reef/fc1e90a395a6a5631142eb70fd9bf3d22740a9da/centos/8/flavors/default/ 2023-09-30T22:16:55.196 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f /etc/yum.repos.d/ceph.repo 2023-09-30T22:16:55.331 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/fc1e90a395a6a5631142eb70fd9bf3d22740a9da/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/fc1e90a395a6a5631142eb70fd9bf3d22740a9da/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/fc1e90a395a6a5631142eb70fd9bf3d22740a9da/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-30T22:16:55.332 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-30T22:16:55.332 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-30T22:16:55.359 DEBUG:teuthology.orchestra.run.smithi156:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-30T22:16:55.428 DEBUG:teuthology.orchestra.run.smithi156:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-30T22:16:55.495 DEBUG:teuthology.orchestra.run.smithi156:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-30T22:16:55.552 INFO:teuthology.orchestra.run.smithi156.stdout:check_obsoletes = 1 2023-09-30T22:16:55.564 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum clean all 2023-09-30T22:16:55.834 INFO:teuthology.orchestra.run.smithi156.stdout:71 files removed 2023-09-30T22:16:55.863 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd 2023-09-30T22:16:56.612 INFO:teuthology.orchestra.run.smithi156.stdout:ceph packages for x86_64 246 kB/s | 80 kB 00:00 2023-09-30T22:16:56.971 INFO:teuthology.orchestra.run.smithi156.stdout:ceph noarch packages 29 kB/s | 9.4 kB 00:00 2023-09-30T22:16:57.297 INFO:teuthology.orchestra.run.smithi156.stdout:ceph source packages 5.0 kB/s | 1.5 kB 00:00 2023-09-30T22:16:59.348 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 8 - AppStream 16 MB/s | 33 MB 00:02 2023-09-30T22:17:09.564 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 8 - BaseOS 12 MB/s | 48 MB 00:04 2023-09-30T22:17:16.706 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 8 - Extras 87 kB/s | 18 kB 00:00 2023-09-30T22:17:17.282 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.9 kB 00:00 2023-09-30T22:17:18.550 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 8 - PowerTools 5.8 MB/s | 6.5 MB 00:01 2023-09-30T22:17:19.944 INFO:teuthology.orchestra.run.smithi156.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2023-09-30T22:17:21.711 INFO:teuthology.orchestra.run.smithi156.stdout:Extra Packages for Enterprise Linux 9.9 MB/s | 16 MB 00:01 2023-09-30T22:17:25.578 INFO:teuthology.orchestra.run.smithi156.stdout:lab-extras 402 kB/s | 24 kB 00:00 2023-09-30T22:17:29.957 INFO:teuthology.orchestra.run.smithi156.stderr:Package cephadm available, but not installed. 2023-09-30T22:17:29.957 INFO:teuthology.orchestra.run.smithi156.stdout:No match for argument: cephadm 2023-09-30T22:17:29.957 INFO:teuthology.orchestra.run.smithi156.stderr:Package ceph-immutable-object-cache available, but not installed. 2023-09-30T22:17:29.957 INFO:teuthology.orchestra.run.smithi156.stdout:No match for argument: ceph-immutable-object-cache 2023-09-30T22:17:29.970 INFO:teuthology.orchestra.run.smithi156.stderr:Package ceph-mgr-cephadm available, but not installed. 2023-09-30T22:17:29.970 INFO:teuthology.orchestra.run.smithi156.stdout:No match for argument: ceph-mgr-cephadm 2023-09-30T22:17:29.974 INFO:teuthology.orchestra.run.smithi156.stderr:Package ceph-volume available, but not installed. 2023-09-30T22:17:29.974 INFO:teuthology.orchestra.run.smithi156.stdout:No match for argument: ceph-volume 2023-09-30T22:17:30.255 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-09-30T22:17:30.260 INFO:teuthology.orchestra.run.smithi156.stdout:====================================================================================== 2023-09-30T22:17:30.261 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-09-30T22:17:30.261 INFO:teuthology.orchestra.run.smithi156.stdout:====================================================================================== 2023-09-30T22:17:30.261 INFO:teuthology.orchestra.run.smithi156.stdout:Upgrading: 2023-09-30T22:17:30.261 INFO:teuthology.orchestra.run.smithi156.stdout: ceph x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 6.4 k 2023-09-30T22:17:30.261 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 5.4 M 2023-09-30T22:17:30.261 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 22 M 2023-09-30T22:17:30.261 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 847 k 2023-09-30T22:17:30.261 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-grafana-dashboards noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 23 k 2023-09-30T22:17:30.261 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 2.3 M 2023-09-30T22:17:30.261 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 1.5 M 2023-09-30T22:17:30.262 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 1.7 M 2023-09-30T22:17:30.262 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 7.4 M 2023-09-30T22:17:30.262 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 241 k 2023-09-30T22:17:30.262 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-rook noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 47 k 2023-09-30T22:17:30.262 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 4.6 M 2023-09-30T22:17:30.262 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 18 M 2023-09-30T22:17:30.262 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-prometheus-alerts noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 15 k 2023-09-30T22:17:30.262 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 13 M 2023-09-30T22:17:30.262 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-selinux x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 24 k 2023-09-30T22:17:30.262 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 47 M 2023-09-30T22:17:30.262 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs-devel x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 30 k 2023-09-30T22:17:30.263 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2 x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 769 k 2023-09-30T22:17:30.263 INFO:teuthology.orchestra.run.smithi156.stdout: libcephsqlite x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 137 k 2023-09-30T22:17:30.263 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 139 k 2023-09-30T22:17:30.263 INFO:teuthology.orchestra.run.smithi156.stdout: librados2 x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 3.7 M 2023-09-30T22:17:30.263 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1 x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 474 k 2023-09-30T22:17:30.263 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1 x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 3.6 M 2023-09-30T22:17:30.263 INFO:teuthology.orchestra.run.smithi156.stdout: librgw2 x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 6.5 M 2023-09-30T22:17:30.264 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 45 k 2023-09-30T22:17:30.264 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 123 k 2023-09-30T22:17:30.264 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cephfs x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 190 k 2023-09-30T22:17:30.264 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 371 k 2023-09-30T22:17:30.264 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rbd x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 364 k 2023-09-30T22:17:30.264 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rgw x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 107 k 2023-09-30T22:17:30.264 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 94 k 2023-09-30T22:17:30.264 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-mirror x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 3.4 M 2023-09-30T22:17:30.264 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 179 k 2023-09-30T22:17:30.264 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-09-30T22:17:30.264 INFO:teuthology.orchestra.run.smithi156.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-30T22:17:30.265 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:17:30.265 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-09-30T22:17:30.265 INFO:teuthology.orchestra.run.smithi156.stdout:====================================================================================== 2023-09-30T22:17:30.265 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-09-30T22:17:30.265 INFO:teuthology.orchestra.run.smithi156.stdout:Upgrade 34 Packages 2023-09-30T22:17:30.265 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:17:30.265 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 145 M 2023-09-30T22:17:30.266 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-09-30T22:17:30.446 INFO:teuthology.orchestra.run.smithi156.stdout:(1/35): ceph-18.2.0-501.gfc1e90a3.el8.x86_64.rp 51 kB/s | 6.4 kB 00:00 2023-09-30T22:17:30.522 INFO:teuthology.orchestra.run.smithi156.stdout:(2/35): thrift-0.13.0-2.el8.x86_64.rpm 8.6 MB/s | 1.7 MB 00:00 2023-09-30T22:17:30.806 INFO:teuthology.orchestra.run.smithi156.stdout:(3/35): ceph-base-18.2.0-501.gfc1e90a3.el8.x86_ 11 MB/s | 5.4 MB 00:00 2023-09-30T22:17:30.998 INFO:teuthology.orchestra.run.smithi156.stdout:(4/35): ceph-mds-18.2.0-501.gfc1e90a3.el8.x86_6 12 MB/s | 2.3 MB 00:00 2023-09-30T22:17:31.131 INFO:teuthology.orchestra.run.smithi156.stdout:(5/35): ceph-mgr-18.2.0-501.gfc1e90a3.el8.x86_6 12 MB/s | 1.5 MB 00:00 2023-09-30T22:17:31.165 INFO:teuthology.orchestra.run.smithi156.stdout:(6/35): ceph-fuse-18.2.0-501.gfc1e90a3.el8.x86_ 1.3 MB/s | 847 kB 00:00 2023-09-30T22:17:31.499 INFO:teuthology.orchestra.run.smithi156.stdout:(7/35): ceph-mon-18.2.0-501.gfc1e90a3.el8.x86_6 13 MB/s | 4.6 MB 00:00 2023-09-30T22:17:32.474 INFO:teuthology.orchestra.run.smithi156.stdout:(8/35): ceph-radosgw-18.2.0-501.gfc1e90a3.el8.x 13 MB/s | 13 MB 00:00 2023-09-30T22:17:32.566 INFO:teuthology.orchestra.run.smithi156.stdout:(9/35): ceph-selinux-18.2.0-501.gfc1e90a3.el8.x 265 kB/s | 24 kB 00:00 2023-09-30T22:17:32.894 INFO:teuthology.orchestra.run.smithi156.stdout:(10/35): ceph-common-18.2.0-501.gfc1e90a3.el8.x 8.8 MB/s | 22 MB 00:02 2023-09-30T22:17:32.958 INFO:teuthology.orchestra.run.smithi156.stdout:(11/35): libcephfs-devel-18.2.0-501.gfc1e90a3.e 479 kB/s | 30 kB 00:00 2023-09-30T22:17:33.100 INFO:teuthology.orchestra.run.smithi156.stdout:(12/35): libcephfs2-18.2.0-501.gfc1e90a3.el8.x8 5.3 MB/s | 769 kB 00:00 2023-09-30T22:17:33.176 INFO:teuthology.orchestra.run.smithi156.stdout:(13/35): libcephsqlite-18.2.0-501.gfc1e90a3.el8 1.8 MB/s | 137 kB 00:00 2023-09-30T22:17:33.251 INFO:teuthology.orchestra.run.smithi156.stdout:(14/35): librados-devel-18.2.0-501.gfc1e90a3.el 1.8 MB/s | 139 kB 00:00 2023-09-30T22:17:33.743 INFO:teuthology.orchestra.run.smithi156.stdout:(15/35): librados2-18.2.0-501.gfc1e90a3.el8.x86 7.4 MB/s | 3.7 MB 00:00 2023-09-30T22:17:33.843 INFO:teuthology.orchestra.run.smithi156.stdout:(16/35): libradosstriper1-18.2.0-501.gfc1e90a3. 4.6 MB/s | 474 kB 00:00 2023-09-30T22:17:34.310 INFO:teuthology.orchestra.run.smithi156.stdout:(17/35): librbd1-18.2.0-501.gfc1e90a3.el8.x86_6 7.6 MB/s | 3.6 MB 00:00 2023-09-30T22:17:35.111 INFO:teuthology.orchestra.run.smithi156.stdout:(18/35): librgw2-18.2.0-501.gfc1e90a3.el8.x86_6 8.2 MB/s | 6.5 MB 00:00 2023-09-30T22:17:35.203 INFO:teuthology.orchestra.run.smithi156.stdout:(19/35): python3-ceph-argparse-18.2.0-501.gfc1e 488 kB/s | 45 kB 00:00 2023-09-30T22:17:35.678 INFO:teuthology.orchestra.run.smithi156.stdout:(20/35): ceph-test-18.2.0-501.gfc1e90a3.el8.x86 15 MB/s | 47 MB 00:03 2023-09-30T22:17:35.703 INFO:teuthology.orchestra.run.smithi156.stdout:(21/35): python3-ceph-common-18.2.0-501.gfc1e90 247 kB/s | 123 kB 00:00 2023-09-30T22:17:35.728 INFO:teuthology.orchestra.run.smithi156.stdout:(22/35): python3-cephfs-18.2.0-501.gfc1e90a3.el 3.7 MB/s | 190 kB 00:00 2023-09-30T22:17:35.771 INFO:teuthology.orchestra.run.smithi156.stdout:(23/35): python3-rados-18.2.0-501.gfc1e90a3.el8 5.4 MB/s | 371 kB 00:00 2023-09-30T22:17:35.796 INFO:teuthology.orchestra.run.smithi156.stdout:(24/35): python3-rbd-18.2.0-501.gfc1e90a3.el8.x 5.3 MB/s | 364 kB 00:00 2023-09-30T22:17:35.822 INFO:teuthology.orchestra.run.smithi156.stdout:(25/35): python3-rgw-18.2.0-501.gfc1e90a3.el8.x 2.1 MB/s | 107 kB 00:00 2023-09-30T22:17:35.847 INFO:teuthology.orchestra.run.smithi156.stdout:(26/35): rbd-fuse-18.2.0-501.gfc1e90a3.el8.x86_ 1.8 MB/s | 94 kB 00:00 2023-09-30T22:17:36.072 INFO:teuthology.orchestra.run.smithi156.stdout:(27/35): ceph-osd-18.2.0-501.gfc1e90a3.el8.x86_ 3.6 MB/s | 18 MB 00:04 2023-09-30T22:17:36.097 INFO:teuthology.orchestra.run.smithi156.stdout:(28/35): rbd-nbd-18.2.0-501.gfc1e90a3.el8.x86_6 717 kB/s | 179 kB 00:00 2023-09-30T22:17:36.131 INFO:teuthology.orchestra.run.smithi156.stdout:(29/35): ceph-grafana-dashboards-18.2.0-501.gfc 395 kB/s | 23 kB 00:00 2023-09-30T22:17:36.190 INFO:teuthology.orchestra.run.smithi156.stdout:(30/35): rbd-mirror-18.2.0-501.gfc1e90a3.el8.x8 9.4 MB/s | 3.4 MB 00:00 2023-09-30T22:17:36.240 INFO:teuthology.orchestra.run.smithi156.stdout:(31/35): ceph-mgr-dashboard-18.2.0-501.gfc1e90a 12 MB/s | 1.7 MB 00:00 2023-09-30T22:17:36.265 INFO:teuthology.orchestra.run.smithi156.stdout:(32/35): ceph-mgr-modules-core-18.2.0-501.gfc1e 3.1 MB/s | 241 kB 00:00 2023-09-30T22:17:36.290 INFO:teuthology.orchestra.run.smithi156.stdout:(33/35): ceph-mgr-rook-18.2.0-501.gfc1e90a3.el8 945 kB/s | 47 kB 00:00 2023-09-30T22:17:36.316 INFO:teuthology.orchestra.run.smithi156.stdout:(34/35): ceph-prometheus-alerts-18.2.0-501.gfc1 290 kB/s | 15 kB 00:00 2023-09-30T22:17:37.183 INFO:teuthology.orchestra.run.smithi156.stdout:(35/35): ceph-mgr-diskprediction-local-18.2.0-5 7.0 MB/s | 7.4 MB 00:01 2023-09-30T22:17:37.186 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-09-30T22:17:37.186 INFO:teuthology.orchestra.run.smithi156.stdout:Total 21 MB/s | 145 MB 00:06 2023-09-30T22:17:37.187 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-09-30T22:17:37.258 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-09-30T22:17:37.258 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-09-30T22:17:37.993 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-09-30T22:17:37.997 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-09-30T22:17:40.385 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-09-30T22:17:40.557 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-09-30T22:17:41.091 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/69 2023-09-30T22:17:41.371 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : librados2-2:18.2.0-501.gfc1e90a3.el8.x86_64 2/69 2023-09-30T22:17:41.768 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados2-2:18.2.0-501.gfc1e90a3.el8.x86_64 2/69 2023-09-30T22:17:41.976 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : librbd1-2:18.2.0-501.gfc1e90a3.el8.x86_64 3/69 2023-09-30T22:17:42.128 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librbd1-2:18.2.0-501.gfc1e90a3.el8.x86_64 3/69 2023-09-30T22:17:42.304 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : libcephfs2-2:18.2.0-501.gfc1e90a3.el8.x86_64 4/69 2023-09-30T22:17:43.095 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephfs2-2:18.2.0-501.gfc1e90a3.el8.x86_64 4/69 2023-09-30T22:17:43.345 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : librgw2-2:18.2.0-501.gfc1e90a3.el8.x86_64 5/69 2023-09-30T22:17:43.444 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librgw2-2:18.2.0-501.gfc1e90a3.el8.x86_64 5/69 2023-09-30T22:17:43.774 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : python3-rados-2:18.2.0-501.gfc1e90a3.el8.x86_64 6/69 2023-09-30T22:17:43.937 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : libcephsqlite-2:18.2.0-501.gfc1e90a3.el8.x86_64 7/69 2023-09-30T22:17:44.063 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephsqlite-2:18.2.0-501.gfc1e90a3.el8.x86_64 7/69 2023-09-30T22:17:44.267 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : libradosstriper1-2:18.2.0-501.gfc1e90a3.el8.x86_64 8/69 2023-09-30T22:17:44.335 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libradosstriper1-2:18.2.0-501.gfc1e90a3.el8.x86_64 8/69 2023-09-30T22:17:44.521 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : python3-ceph-argparse-2:18.2.0-501.gfc1e90a3.el8.x 9/69 2023-09-30T22:17:44.792 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : python3-cephfs-2:18.2.0-501.gfc1e90a3.el8.x86_64 10/69 2023-09-30T22:17:45.026 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : python3-rbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 11/69 2023-09-30T22:17:45.277 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : python3-rgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 12/69 2023-09-30T22:17:45.456 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : librados-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 13/69 2023-09-30T22:17:45.600 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : ceph-prometheus-alerts-2:18.2.0-501.gfc1e90a3.el8. 14/69 2023-09-30T22:17:45.764 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : ceph-grafana-dashboards-2:18.2.0-501.gfc1e90a3.el8 15/69 2023-09-30T22:17:46.021 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : python3-ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86 16/69 2023-09-30T22:17:48.301 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 17/69 2023-09-30T22:17:48.753 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 17/69 2023-09-30T22:17:49.466 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 17/69 2023-09-30T22:17:49.837 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : ceph-base-2:18.2.0-501.gfc1e90a3.el8.x86_64 18/69 2023-09-30T22:17:49.901 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-base-2:18.2.0-501.gfc1e90a3.el8.x86_64 18/69 2023-09-30T22:17:50.053 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : ceph-selinux-2:18.2.0-501.gfc1e90a3.el8.x86_64 19/69 2023-09-30T22:18:07.446 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-selinux-2:18.2.0-501.gfc1e90a3.el8.x86_64 19/69 2023-09-30T22:18:07.667 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : ceph-mgr-dashboard-2:18.2.0-501.gfc1e90a3.el8.noar 20/69 2023-09-30T22:18:08.883 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-501.gfc1e90a3.el8.noar 20/69 2023-09-30T22:18:09.075 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : ceph-mgr-diskprediction-local-2:18.2.0-501.gfc1e90 21/69 2023-09-30T22:18:09.168 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-501.gfc1e90 21/69 2023-09-30T22:18:09.557 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : ceph-mgr-modules-core-2:18.2.0-501.gfc1e90a3.el8.n 22/69 2023-09-30T22:18:09.792 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : ceph-mgr-2:18.2.0-501.gfc1e90a3.el8.x86_64 23/69 2023-09-30T22:18:09.816 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-2:18.2.0-501.gfc1e90a3.el8.x86_64 23/69 2023-09-30T22:18:09.963 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : ceph-mgr-rook-2:18.2.0-501.gfc1e90a3.el8.noarch 24/69 2023-09-30T22:18:10.171 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-501.gfc1e90a3.el8.noarch 24/69 2023-09-30T22:18:10.425 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : ceph-mds-2:18.2.0-501.gfc1e90a3.el8.x86_64 25/69 2023-09-30T22:18:10.998 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mds-2:18.2.0-501.gfc1e90a3.el8.x86_64 25/69 2023-09-30T22:18:11.191 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : ceph-mon-2:18.2.0-501.gfc1e90a3.el8.x86_64 26/69 2023-09-30T22:18:13.032 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mon-2:18.2.0-501.gfc1e90a3.el8.x86_64 26/69 2023-09-30T22:18:13.342 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : ceph-osd-2:18.2.0-501.gfc1e90a3.el8.x86_64 27/69 2023-09-30T22:18:13.352 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-osd-2:18.2.0-501.gfc1e90a3.el8.x86_64 27/69 2023-09-30T22:18:14.834 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : ceph-2:18.2.0-501.gfc1e90a3.el8.x86_64 28/69 2023-09-30T22:18:16.633 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : ceph-radosgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 29/69 2023-09-30T22:18:16.634 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 29/69 2023-09-30T22:18:16.634 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : rbd-mirror-2:18.2.0-501.gfc1e90a3.el8.x86_64 30/69 2023-09-30T22:18:20.913 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rbd-mirror-2:18.2.0-501.gfc1e90a3.el8.x86_64 30/69 2023-09-30T22:18:21.245 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : ceph-test-2:18.2.0-501.gfc1e90a3.el8.x86_64 31/69 2023-09-30T22:18:21.437 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : libcephfs-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 32/69 2023-09-30T22:18:21.673 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : rbd-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 33/69 2023-09-30T22:18:22.048 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : rbd-nbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 34/69 2023-09-30T22:18:22.308 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : ceph-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 35/69 2023-09-30T22:18:22.400 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 36/69 2023-09-30T22:18:22.632 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 37/69 2023-09-30T22:18:22.640 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-09-30T22:18:22.640 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-09-30T22:18:22.924 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-09-30T22:18:23.113 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 39/69 2023-09-30T22:18:23.113 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 40/69 2023-09-30T22:18:23.255 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 40/69 2023-09-30T22:18:23.261 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-09-30T22:18:23.262 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-09-30T22:18:23.479 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-09-30T22:18:23.657 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.n 42/69 2023-09-30T22:18:23.865 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 43/69 2023-09-30T22:18:23.871 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-09-30T22:18:23.872 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-09-30T22:18:24.074 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-09-30T22:18:24.265 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 45/69 2023-09-30T22:18:24.265 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 46/69 2023-09-30T22:18:24.479 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 46/69 2023-09-30T22:18:24.679 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 47/69 2023-09-30T22:18:24.686 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-09-30T22:18:24.687 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-09-30T22:18:25.097 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-09-30T22:18:25.097 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 49/69 2023-09-30T22:18:25.291 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 49/69 2023-09-30T22:18:25.296 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-09-30T22:18:25.297 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-09-30T22:18:25.495 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-09-30T22:18:25.500 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-09-30T22:18:25.501 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-09-30T22:18:25.670 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-09-30T22:18:25.671 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 52/69 2023-09-30T22:18:25.824 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 52/69 2023-09-30T22:18:25.846 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-09-30T22:18:25.846 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-09-30T22:18:26.177 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-09-30T22:18:26.177 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 54/69 2023-09-30T22:18:26.390 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 54/69 2023-09-30T22:18:26.390 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-09-30T22:18:26.623 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-09-30T22:18:26.789 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 56/69 2023-09-30T22:18:27.007 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 57/69 2023-09-30T22:18:27.007 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 58/69 2023-09-30T22:18:27.282 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 58/69 2023-09-30T22:18:27.482 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 59/69 2023-09-30T22:18:27.482 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 60/69 2023-09-30T22:18:27.745 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 60/69 2023-09-30T22:18:27.940 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 61/69 2023-09-30T22:18:27.940 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 62/69 2023-09-30T22:18:28.208 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 62/69 2023-09-30T22:18:28.381 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 63/69 2023-09-30T22:18:28.524 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x 64/69 2023-09-30T22:18:28.706 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86 65/69 2023-09-30T22:18:28.864 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8 66/69 2023-09-30T22:18:29.200 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8. 67/69 2023-09-30T22:18:29.200 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 68/69 2023-09-30T22:18:29.200 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 68/69 2023-09-30T22:18:29.200 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 69/69 2023-09-30T22:18:29.852 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 69/69 2023-09-30T22:18:31.114 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 1/69 2023-09-30T22:18:31.114 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-2:18.2.0-501.gfc1e90a3.el8.x86_64 2/69 2023-09-30T22:18:31.115 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 3/69 2023-09-30T22:18:31.115 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-base-2:18.2.0-501.gfc1e90a3.el8.x86_64 4/69 2023-09-30T22:18:31.115 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 5/69 2023-09-30T22:18:31.115 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 6/69 2023-09-30T22:18:31.115 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 7/69 2023-09-30T22:18:31.115 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 8/69 2023-09-30T22:18:31.116 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 9/69 2023-09-30T22:18:31.116 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mds-2:18.2.0-501.gfc1e90a3.el8.x86_64 10/69 2023-09-30T22:18:31.116 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 11/69 2023-09-30T22:18:31.116 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-2:18.2.0-501.gfc1e90a3.el8.x86_64 12/69 2023-09-30T22:18:31.116 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 13/69 2023-09-30T22:18:31.116 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mon-2:18.2.0-501.gfc1e90a3.el8.x86_64 14/69 2023-09-30T22:18:31.116 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 15/69 2023-09-30T22:18:31.116 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-osd-2:18.2.0-501.gfc1e90a3.el8.x86_64 16/69 2023-09-30T22:18:31.116 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 17/69 2023-09-30T22:18:31.116 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-radosgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 18/69 2023-09-30T22:18:31.117 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 19/69 2023-09-30T22:18:31.117 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-selinux-2:18.2.0-501.gfc1e90a3.el8.x86_64 20/69 2023-09-30T22:18:31.117 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 21/69 2023-09-30T22:18:31.117 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-test-2:18.2.0-501.gfc1e90a3.el8.x86_64 22/69 2023-09-30T22:18:31.119 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 23/69 2023-09-30T22:18:31.119 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 24/69 2023-09-30T22:18:31.119 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 25/69 2023-09-30T22:18:31.119 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs2-2:18.2.0-501.gfc1e90a3.el8.x86_64 26/69 2023-09-30T22:18:31.119 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 27/69 2023-09-30T22:18:31.119 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephsqlite-2:18.2.0-501.gfc1e90a3.el8.x86_64 28/69 2023-09-30T22:18:31.124 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 29/69 2023-09-30T22:18:31.124 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 30/69 2023-09-30T22:18:31.124 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 31/69 2023-09-30T22:18:31.124 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados2-2:18.2.0-501.gfc1e90a3.el8.x86_64 32/69 2023-09-30T22:18:31.124 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 33/69 2023-09-30T22:18:31.124 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libradosstriper1-2:18.2.0-501.gfc1e90a3.el8.x86_64 34/69 2023-09-30T22:18:31.124 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 35/69 2023-09-30T22:18:31.124 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librbd1-2:18.2.0-501.gfc1e90a3.el8.x86_64 36/69 2023-09-30T22:18:31.124 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 37/69 2023-09-30T22:18:31.124 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librgw2-2:18.2.0-501.gfc1e90a3.el8.x86_64 38/69 2023-09-30T22:18:31.125 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 39/69 2023-09-30T22:18:31.125 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ceph-argparse-2:18.2.0-501.gfc1e90a3.el8.x 40/69 2023-09-30T22:18:31.125 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x 41/69 2023-09-30T22:18:31.125 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86 42/69 2023-09-30T22:18:31.125 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86 43/69 2023-09-30T22:18:31.125 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cephfs-2:18.2.0-501.gfc1e90a3.el8.x86_64 44/69 2023-09-30T22:18:31.125 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 45/69 2023-09-30T22:18:31.125 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rados-2:18.2.0-501.gfc1e90a3.el8.x86_64 46/69 2023-09-30T22:18:31.125 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 47/69 2023-09-30T22:18:31.125 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 48/69 2023-09-30T22:18:31.125 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 49/69 2023-09-30T22:18:31.125 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 50/69 2023-09-30T22:18:31.126 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-09-30T22:18:31.126 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 52/69 2023-09-30T22:18:31.126 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-09-30T22:18:31.126 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-mirror-2:18.2.0-501.gfc1e90a3.el8.x86_64 54/69 2023-09-30T22:18:31.126 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-09-30T22:18:31.126 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-nbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 56/69 2023-09-30T22:18:31.126 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 57/69 2023-09-30T22:18:31.126 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-501.gfc1e90a3.el8 58/69 2023-09-30T22:18:31.126 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8 59/69 2023-09-30T22:18:31.126 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-501.gfc1e90a3.el8.noar 60/69 2023-09-30T22:18:31.126 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 61/69 2023-09-30T22:18:31.126 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-501.gfc1e90 62/69 2023-09-30T22:18:31.127 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 63/69 2023-09-30T22:18:31.127 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-501.gfc1e90a3.el8.n 64/69 2023-09-30T22:18:31.127 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.n 65/69 2023-09-30T22:18:31.127 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-rook-2:18.2.0-501.gfc1e90a3.el8.noarch 66/69 2023-09-30T22:18:31.127 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 67/69 2023-09-30T22:18:31.127 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-501.gfc1e90a3.el8. 68/69 2023-09-30T22:18:31.906 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8. 69/69 2023-09-30T22:18:31.906 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:18:31.906 INFO:teuthology.orchestra.run.smithi156.stdout:Upgraded: 2023-09-30T22:18:31.906 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:18:31.906 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:18:31.906 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:18:31.906 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:18:31.906 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-grafana-dashboards-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-09-30T22:18:31.906 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:18:31.906 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:18:31.907 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-09-30T22:18:31.907 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-09-30T22:18:31.907 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-09-30T22:18:31.907 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-rook-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-09-30T22:18:31.907 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:18:31.907 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:18:31.907 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-prometheus-alerts-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-09-30T22:18:31.907 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:18:31.907 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-selinux-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:18:31.907 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:18:31.907 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:18:31.907 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:18:31.908 INFO:teuthology.orchestra.run.smithi156.stdout: libcephsqlite-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:18:31.908 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:18:31.908 INFO:teuthology.orchestra.run.smithi156.stdout: librados2-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:18:31.908 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:18:31.908 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:18:31.908 INFO:teuthology.orchestra.run.smithi156.stdout: librgw2-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:18:31.908 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:18:31.908 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:18:31.908 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cephfs-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:18:31.908 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:18:31.908 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:18:31.908 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:18:31.908 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:18:31.909 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-mirror-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:18:31.909 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:18:31.909 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-09-30T22:18:31.909 INFO:teuthology.orchestra.run.smithi156.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-30T22:18:31.909 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:18:31.909 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-09-30T22:18:32.050 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-09-30T22:18:32.261 DEBUG:teuthology.orchestra.run.smithi156:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-30T22:18:32.285 INFO:teuthology.orchestra.run.smithi156.stdout:18.2.0-501.gfc1e90a3.el8 2023-09-30T22:18:32.285 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-501.gfc1e90a3.el8 2023-09-30T22:18:32.286 INFO:teuthology.task.install:The correct ceph version 18.2.0-501.gfc1e90a3 is installed. 2023-09-30T22:18:32.286 INFO:teuthology.run_tasks:Running task print... 2023-09-30T22:18:32.304 INFO:teuthology.task.print:**** done install.upgrade the host 2023-09-30T22:18:32.304 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-09-30T22:18:32.316 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-09-30T22:18:32.316 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:18:32.337 INFO:tasks.ceph.mon.a:Stopped 2023-09-30T22:18:32.337 INFO:tasks.ceph.mon.a:Restarting daemon 2023-09-30T22:18:32.337 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-09-30T22:18:32.383 INFO:tasks.ceph.mon.a:Started 2023-09-30T22:18:32.384 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-09-30T22:18:32.384 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:18:32.396 INFO:tasks.ceph.mon.b:Stopped 2023-09-30T22:18:32.396 INFO:tasks.ceph.mon.b:Restarting daemon 2023-09-30T22:18:32.397 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-09-30T22:18:32.441 INFO:tasks.ceph.mon.b:Started 2023-09-30T22:18:32.441 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-09-30T22:18:32.442 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:18:32.453 INFO:tasks.ceph.mon.c:Stopped 2023-09-30T22:18:32.453 INFO:tasks.ceph.mon.c:Restarting daemon 2023-09-30T22:18:32.454 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-09-30T22:18:32.497 INFO:tasks.ceph.mon.c:Started 2023-09-30T22:18:32.498 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-09-30T22:18:32.498 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:18:32.521 INFO:tasks.ceph.mgr.x:Stopped 2023-09-30T22:18:32.522 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-09-30T22:18:32.522 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-09-30T22:18:32.563 INFO:tasks.ceph.mgr.x:Started 2023-09-30T22:18:32.564 INFO:teuthology.run_tasks:Running task ceph.healthy... 2023-09-30T22:18:32.574 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-30T22:18:32.574 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-30T22:18:32.575 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-30T22:18:32.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.701+0000 7fe13077c700 1 Processor -- start 2023-09-30T22:18:32.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.701+0000 7fe13077c700 1 -- start start 2023-09-30T22:18:32.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.701+0000 7fe13077c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe12809e340 0x7fe1281359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:32.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.701+0000 7fe13077c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe128135f20 0x7fe128138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:32.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.701+0000 7fe13077c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe12809aaa0 con 0x7fe12809d860 2023-09-30T22:18:32.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.701+0000 7fe13077c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe12809e730 con 0x7fe128135f20 2023-09-30T22:18:32.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.701+0000 7fe13077c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe12809f870 con 0x7fe12809e340 2023-09-30T22:18:32.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.701+0000 7fe12ed19700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe128135f20 0x7fe128138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:32.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.701+0000 7fe12dd17700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe12809e340 0x7fe1281359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:32.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.701+0000 7fe12dd17700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe12809e340 0x7fe1281359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34508/0 (socket says 172.21.15.156:34508) 2023-09-30T22:18:32.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.701+0000 7fe12ed19700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe128135f20 0x7fe128138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39166/0 (socket says 172.21.15.156:39166) 2023-09-30T22:18:32.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.701+0000 7fe12e518700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe12809d860 0x7fe12809dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:42542/0 (socket says 172.21.15.156:42542) 2023-09-30T22:18:32.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.701+0000 7fe12dd17700 1 -- 172.21.15.156:0/1228177818 learned_addr learned my addr 172.21.15.156:0/1228177818 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:32.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.701+0000 7fe12ed19700 1 -- 172.21.15.156:0/1228177818 >> v2:172.21.15.156:3300/0 conn(0x7fe128135f20 msgr2=0x7fe128138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-30T22:18:32.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.701+0000 7fe12ed19700 1 -- 172.21.15.156:0/1228177818 >> v2:172.21.15.156:3300/0 conn(0x7fe128135f20 msgr2=0x7fe128138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:18:32.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.701+0000 7fe12ed19700 1 --2- 172.21.15.156:0/1228177818 >> v2:172.21.15.156:3300/0 conn(0x7fe128135f20 0x7fe128138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-30T22:18:32.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.701+0000 7fe12dd17700 1 -- 172.21.15.156:0/1228177818 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe12809e340 msgr2=0x7fe1281359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-30T22:18:32.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.701+0000 7fe12dd17700 1 -- 172.21.15.156:0/1228177818 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe12809e340 msgr2=0x7fe1281359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:18:32.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.701+0000 7fe12dd17700 1 --2- 172.21.15.156:0/1228177818 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe12809e340 0x7fe1281359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-30T22:18:32.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.702+0000 7fe12ed19700 1 --2- 172.21.15.156:0/1228177818 >> v2:172.21.15.156:3300/0 conn(0x7fe128135f20 0x7fe128138300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-30T22:18:32.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.702+0000 7fe12dd17700 1 --2- 172.21.15.156:0/1228177818 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe12809e340 0x7fe1281359e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-30T22:18:32.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.734+0000 7fe12d516700 1 -- 172.21.15.156:0/1228177818 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4036380945 0 0) 0x7fe12809aaa0 con 0x7fe12809d860 2023-09-30T22:18:32.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.734+0000 7fe12d516700 1 -- 172.21.15.156:0/1228177818 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1140035b0 con 0x7fe12809d860 2023-09-30T22:18:32.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.734+0000 7fe12d516700 1 -- 172.21.15.156:0/1228177818 <== mon.0 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4258779996 0 0) 0x7fe1140035b0 con 0x7fe12809d860 2023-09-30T22:18:32.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.734+0000 7fe12d516700 1 -- 172.21.15.156:0/1228177818 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe12809e340 msgr2=0x7fe1281359e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:18:32.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.734+0000 7fe12d516700 1 --2- 172.21.15.156:0/1228177818 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe12809e340 0x7fe1281359e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:32.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.734+0000 7fe12d516700 1 -- 172.21.15.156:0/1228177818 >> v2:172.21.15.156:3300/0 conn(0x7fe128135f20 msgr2=0x7fe128138300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:18:32.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.734+0000 7fe12d516700 1 --2- 172.21.15.156:0/1228177818 >> v2:172.21.15.156:3300/0 conn(0x7fe128135f20 0x7fe128138300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:32.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.735+0000 7fe12d516700 1 -- 172.21.15.156:0/1228177818 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe12809b360 con 0x7fe12809d860 2023-09-30T22:18:32.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.735+0000 7fe12d516700 1 -- 172.21.15.156:0/1228177818 <== mon.0 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2864602571 0 0) 0x7fe118001670 con 0x7fe12809d860 2023-09-30T22:18:32.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.735+0000 7fe12d516700 1 -- 172.21.15.156:0/1228177818 >> v1:172.21.15.156:6789/0 conn(0x7fe12809d860 legacy=0x7fe12809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:32.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.735+0000 7fe12d516700 1 --2- 172.21.15.156:0/1228177818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe114003a70 0x7fe114003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:32.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.735+0000 7fe12d516700 1 --2- 172.21.15.156:0/1228177818 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe114004850 0x7fe114004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:32.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.735+0000 7fe12d516700 1 --2- 172.21.15.156:0/1228177818 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe12809e340 0x7fe114005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:32.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.735+0000 7fe12d516700 1 -- 172.21.15.156:0/1228177818 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12809e730 con 0x7fe114003a70 2023-09-30T22:18:32.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.735+0000 7fe12d516700 1 -- 172.21.15.156:0/1228177818 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12809f870 con 0x7fe114004850 2023-09-30T22:18:32.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.735+0000 7fe12d516700 1 -- 172.21.15.156:0/1228177818 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe114009c30 con 0x7fe12809e340 2023-09-30T22:18:32.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.735+0000 7fe12dd17700 1 --2- 172.21.15.156:0/1228177818 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe114004850 0x7fe114004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:32.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.735+0000 7fe12e518700 1 --2- 172.21.15.156:0/1228177818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe114003a70 0x7fe114003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:32.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.735+0000 7fe12dd17700 1 -- 172.21.15.156:0/1228177818 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe12809e340 msgr2=0x7fe114005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:32.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.735+0000 7fe12dd17700 1 --2- 172.21.15.156:0/1228177818 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe12809e340 0x7fe114005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:32.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.735+0000 7fe12dd17700 1 -- 172.21.15.156:0/1228177818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe114003a70 msgr2=0x7fe114003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:32.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.735+0000 7fe12dd17700 1 --2- 172.21.15.156:0/1228177818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe114003a70 0x7fe114003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:32.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.735+0000 7fe12dd17700 1 -- 172.21.15.156:0/1228177818 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1140035b0 con 0x7fe114004850 2023-09-30T22:18:32.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.736+0000 7fe12dd17700 1 --2- 172.21.15.156:0/1228177818 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe114004850 0x7fe114004cc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe124009910 tx=0x7fe114005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2df2b9d2fd41626c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:32.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.737+0000 7fe12d516700 1 -- 172.21.15.156:0/1228177818 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12400c070 con 0x7fe114004850 2023-09-30T22:18:32.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.737+0000 7fe12d516700 1 -- 172.21.15.156:0/1228177818 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe124004020 con 0x7fe114004850 2023-09-30T22:18:32.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.737+0000 7fe12d516700 1 -- 172.21.15.156:0/1228177818 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1240043d0 con 0x7fe114004850 2023-09-30T22:18:32.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.738+0000 7fe13077c700 1 -- 172.21.15.156:0/1228177818 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe114004850 msgr2=0x7fe114004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:32.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.738+0000 7fe13077c700 1 --2- 172.21.15.156:0/1228177818 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe114004850 0x7fe114004cc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe124009910 tx=0x7fe114005880 comp rx=0 tx=0).stop 2023-09-30T22:18:32.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.738+0000 7fe12ed19700 1 -- 172.21.15.156:0/1228177818 reap_dead start 2023-09-30T22:18:32.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.738+0000 7fe13077c700 1 -- 172.21.15.156:0/1228177818 shutdown_connections 2023-09-30T22:18:32.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.738+0000 7fe13077c700 1 -- 172.21.15.156:0/1228177818 >> 172.21.15.156:0/1228177818 conn(0x7fe128099c40 msgr2=0x7fe1280a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:32.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.738+0000 7fe13077c700 1 -- 172.21.15.156:0/1228177818 shutdown_connections 2023-09-30T22:18:32.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.738+0000 7fe13077c700 1 -- 172.21.15.156:0/1228177818 wait complete. 2023-09-30T22:18:32.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.739+0000 7fe13077c700 1 Processor -- start 2023-09-30T22:18:32.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.739+0000 7fe13077c700 1 -- start start 2023-09-30T22:18:32.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.740+0000 7fe13077c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe114004850 0x7fe1281c4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:32.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.740+0000 7fe13077c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1281c4640 0x7fe1281c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:32.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.740+0000 7fe13077c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe12812f2d0 0x7fe12812f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:32.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.740+0000 7fe13077c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe128119dc0 con 0x7fe1281c4640 2023-09-30T22:18:32.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.740+0000 7fe13077c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe128130650 con 0x7fe12812f2d0 2023-09-30T22:18:32.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.740+0000 7fe13077c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1281c4f90 con 0x7fe114004850 2023-09-30T22:18:32.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.740+0000 7fe12e518700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe114004850 0x7fe1281c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:32.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.740+0000 7fe12e518700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe114004850 0x7fe1281c4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34558/0 (socket says 172.21.15.156:34558) 2023-09-30T22:18:32.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.740+0000 7fe12e518700 1 -- 172.21.15.156:0/901673350 learned_addr learned my addr 172.21.15.156:0/901673350 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:32.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.740+0000 7fe12ed19700 1 --2- 172.21.15.156:0/901673350 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe12812f2d0 0x7fe12812f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:32.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.740+0000 7fe12e518700 1 -- 172.21.15.156:0/901673350 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe12812f2d0 msgr2=0x7fe12812f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:32.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.740+0000 7fe12e518700 1 --2- 172.21.15.156:0/901673350 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe12812f2d0 0x7fe12812f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:32.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.740+0000 7fe12e518700 1 -- 172.21.15.156:0/901673350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1281c4640 msgr2=0x7fe1281c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:32.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.740+0000 7fe12dd17700 1 --2- 172.21.15.156:0/901673350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1281c4640 0x7fe1281c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:32.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.740+0000 7fe12e518700 1 --2- 172.21.15.156:0/901673350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1281c4640 0x7fe1281c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:32.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.740+0000 7fe12e518700 1 -- 172.21.15.156:0/901673350 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe12811b3a0 con 0x7fe114004850 2023-09-30T22:18:32.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.740+0000 7fe12dd17700 1 --2- 172.21.15.156:0/901673350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1281c4640 0x7fe1281c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:18:32.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.740+0000 7fe12e518700 1 --2- 172.21.15.156:0/901673350 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe114004850 0x7fe1281c4100 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe118007370 tx=0x7fe118007680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:32.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.741+0000 7fe11effd700 1 -- 172.21.15.156:0/901673350 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11800f6c0 con 0x7fe114004850 2023-09-30T22:18:32.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.741+0000 7fe11effd700 1 -- 172.21.15.156:0/901673350 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11800f860 con 0x7fe114004850 2023-09-30T22:18:32.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.741+0000 7fe11effd700 1 -- 172.21.15.156:0/901673350 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11800fc10 con 0x7fe114004850 2023-09-30T22:18:32.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.741+0000 7fe13077c700 1 -- 172.21.15.156:0/901673350 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1280a2320 con 0x7fe114004850 2023-09-30T22:18:32.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.741+0000 7fe13077c700 1 -- 172.21.15.156:0/901673350 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe12811bb70 con 0x7fe114004850 2023-09-30T22:18:32.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.742+0000 7fe13077c700 1 -- 172.21.15.156:0/901673350 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe12804f2a0 con 0x7fe114004850 2023-09-30T22:18:32.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.742+0000 7fe11effd700 1 -- 172.21.15.156:0/901673350 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fe11800fd70 con 0x7fe114004850 2023-09-30T22:18:32.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.742+0000 7fe11effd700 1 -- 172.21.15.156:0/901673350 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fe11803b7c0 con 0x7fe114004850 2023-09-30T22:18:32.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.742+0000 7fe12dd17700 1 -- 172.21.15.156:0/901673350 >> v1:172.21.15.156:6816/118236 conn(0x7fe10c02c1b0 legacy=0x7fe10c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/118236 2023-09-30T22:18:32.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.750+0000 7fe11effd700 1 -- 172.21.15.156:0/901673350 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fe11801d460 con 0x7fe114004850 2023-09-30T22:18:32.862 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:32.861+0000 7f82ca115240 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-30T22:18:32.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.943+0000 7fe12dd17700 1 -- 172.21.15.156:0/901673350 >> v1:172.21.15.156:6816/118236 conn(0x7fe10c02c1b0 legacy=0x7fe10c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/118236 2023-09-30T22:18:32.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.978+0000 7fe13077c700 1 -- 172.21.15.156:0/901673350 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe1280725a0 con 0x7fe114004850 2023-09-30T22:18:32.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.981+0000 7fe11effd700 1 -- 172.21.15.156:0/901673350 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+64286 (secure 0 0 0) 0x7fe118012350 con 0x7fe114004850 2023-09-30T22:18:32.984 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:18:32.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.983+0000 7fe13077c700 1 -- 172.21.15.156:0/901673350 >> v1:172.21.15.156:6816/118236 conn(0x7fe10c02c1b0 legacy=0x7fe10c02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:18:32.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.983+0000 7fe13077c700 1 -- 172.21.15.156:0/901673350 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe114004850 msgr2=0x7fe1281c4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:32.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.983+0000 7fe13077c700 1 --2- 172.21.15.156:0/901673350 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe114004850 0x7fe1281c4100 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe118007370 tx=0x7fe118007680 comp rx=0 tx=0).stop 2023-09-30T22:18:32.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.985+0000 7fe13077c700 1 -- 172.21.15.156:0/901673350 shutdown_connections 2023-09-30T22:18:32.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.985+0000 7fe13077c700 1 --2- 172.21.15.156:0/901673350 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe12812f2d0 0x7fe12812f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:32.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.985+0000 7fe13077c700 1 --2- 172.21.15.156:0/901673350 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe114004850 0x7fe1281c4100 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:32.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.985+0000 7fe13077c700 1 --2- 172.21.15.156:0/901673350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1281c4640 0x7fe1281c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:32.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.985+0000 7fe13077c700 1 -- 172.21.15.156:0/901673350 >> 172.21.15.156:0/901673350 conn(0x7fe128099c40 msgr2=0x7fe1280a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:32.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.987+0000 7fe13077c700 1 -- 172.21.15.156:0/901673350 shutdown_connections 2023-09-30T22:18:32.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:32.987+0000 7fe13077c700 1 -- 172.21.15.156:0/901673350 wait complete. 2023-09-30T22:18:33.007 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":5,"active_gid":4122,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6816","nonce":118236}]},"active_addr":"172.21.15.156:6816/118236","active_change":"2023-09-30T22:16:20.349113+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":2593263545}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":1464735255}]}]} 2023-09-30T22:18:33.009 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-30T22:18:33.009 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-30T22:18:33.010 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:18:33.018 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:33.017+0000 7f82ca115240 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-30T22:18:33.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.140+0000 7fc4b055b700 1 Processor -- start 2023-09-30T22:18:33.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.140+0000 7fc4b055b700 1 -- start start 2023-09-30T22:18:33.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.141+0000 7fc4b055b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a809d860 0x7fc4a809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.141+0000 7fc4b055b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc4a809e170 0x7fc4a81307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.141+0000 7fc4b055b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a8130ce0 0x7fc4a8131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.141+0000 7fc4b055b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a809aaa0 con 0x7fc4a809e170 2023-09-30T22:18:33.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.141+0000 7fc4b055b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a809f870 con 0x7fc4a809d860 2023-09-30T22:18:33.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.141+0000 7fc4b055b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a809b360 con 0x7fc4a8130ce0 2023-09-30T22:18:33.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.141+0000 7fc4adaf6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc4a809e170 0x7fc4a81307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.141+0000 7fc4ae2f7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a809d860 0x7fc4a809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.141+0000 7fc4aeaf8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a8130ce0 0x7fc4a8131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.141+0000 7fc4ae2f7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a809d860 0x7fc4a809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57702/0 (socket says 172.21.15.156:57702) 2023-09-30T22:18:33.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.141+0000 7fc4adaf6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc4a809e170 0x7fc4a81307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39208/0 (socket says 172.21.15.156:39208) 2023-09-30T22:18:33.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.141+0000 7fc4ae2f7700 1 -- 172.21.15.156:0/2846330511 learned_addr learned my addr 172.21.15.156:0/2846330511 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:33.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.141+0000 7fc4adaf6700 1 -- 172.21.15.156:0/2846330511 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a8130ce0 msgr2=0x7fc4a8131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:33.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.141+0000 7fc4adaf6700 1 --2- 172.21.15.156:0/2846330511 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a8130ce0 0x7fc4a8131180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.141+0000 7fc4adaf6700 1 -- 172.21.15.156:0/2846330511 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a809d860 msgr2=0x7fc4a809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:33.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.141+0000 7fc4adaf6700 1 --2- 172.21.15.156:0/2846330511 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a809d860 0x7fc4a809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.141+0000 7fc4adaf6700 1 -- 172.21.15.156:0/2846330511 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a809b620 con 0x7fc4a809e170 2023-09-30T22:18:33.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.141+0000 7fc4ae2f7700 1 --2- 172.21.15.156:0/2846330511 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a809d860 0x7fc4a809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:33.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.141+0000 7fc4adaf6700 1 --2- 172.21.15.156:0/2846330511 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4a809e170 0x7fc4a81307a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc498009840 tx=0x7fc498009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf365ba5169effab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:33.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.142+0000 7fc4ad2f5700 1 -- 172.21.15.156:0/2846330511 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc498011830 con 0x7fc4a809e170 2023-09-30T22:18:33.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.142+0000 7fc4ad2f5700 1 -- 172.21.15.156:0/2846330511 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc498011990 con 0x7fc4a809e170 2023-09-30T22:18:33.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.142+0000 7fc4ad2f5700 1 -- 172.21.15.156:0/2846330511 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc498011d20 con 0x7fc4a809e170 2023-09-30T22:18:33.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.142+0000 7fc4b055b700 1 -- 172.21.15.156:0/2846330511 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4a809e170 msgr2=0x7fc4a81307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:33.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.142+0000 7fc4b055b700 1 --2- 172.21.15.156:0/2846330511 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4a809e170 0x7fc4a81307a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc498009840 tx=0x7fc498009b50 comp rx=0 tx=0).stop 2023-09-30T22:18:33.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.142+0000 7fc4b055b700 1 -- 172.21.15.156:0/2846330511 shutdown_connections 2023-09-30T22:18:33.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.142+0000 7fc4b055b700 1 --2- 172.21.15.156:0/2846330511 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a8130ce0 0x7fc4a8131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.142+0000 7fc4b055b700 1 --2- 172.21.15.156:0/2846330511 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a809d860 0x7fc4a809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.142+0000 7fc4b055b700 1 --2- 172.21.15.156:0/2846330511 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4a809e170 0x7fc4a81307a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.142+0000 7fc4b055b700 1 -- 172.21.15.156:0/2846330511 >> 172.21.15.156:0/2846330511 conn(0x7fc4a8099c40 msgr2=0x7fc4a80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:33.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.142+0000 7fc4b055b700 1 -- 172.21.15.156:0/2846330511 shutdown_connections 2023-09-30T22:18:33.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.142+0000 7fc4b055b700 1 -- 172.21.15.156:0/2846330511 wait complete. 2023-09-30T22:18:33.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.144+0000 7fc4b055b700 1 Processor -- start 2023-09-30T22:18:33.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.144+0000 7fc4b055b700 1 -- start start 2023-09-30T22:18:33.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.144+0000 7fc4b055b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a809d860 0x7fc4a8119fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.144+0000 7fc4b055b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4a809e170 0x7fc4a811a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.144+0000 7fc4b055b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a8130ce0 0x7fc4a811aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.144+0000 7fc4b055b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a811d480 con 0x7fc4a809e170 2023-09-30T22:18:33.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.144+0000 7fc4b055b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a811e3e0 con 0x7fc4a8130ce0 2023-09-30T22:18:33.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.144+0000 7fc4b055b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a8071c40 con 0x7fc4a809d860 2023-09-30T22:18:33.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.144+0000 7fc4ae2f7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a809d860 0x7fc4a8119fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.144+0000 7fc4ae2f7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a809d860 0x7fc4a8119fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34600/0 (socket says 172.21.15.156:34600) 2023-09-30T22:18:33.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.144+0000 7fc4ae2f7700 1 -- 172.21.15.156:0/2534599504 learned_addr learned my addr 172.21.15.156:0/2534599504 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:33.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.144+0000 7fc4adaf6700 1 --2- 172.21.15.156:0/2534599504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4a809e170 0x7fc4a811a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.144+0000 7fc4aeaf8700 1 --2- 172.21.15.156:0/2534599504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a8130ce0 0x7fc4a811aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.145+0000 7fc4ae2f7700 1 -- 172.21.15.156:0/2534599504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a8130ce0 msgr2=0x7fc4a811aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:33.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.145+0000 7fc4ae2f7700 1 --2- 172.21.15.156:0/2534599504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a8130ce0 0x7fc4a811aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.145+0000 7fc4ae2f7700 1 -- 172.21.15.156:0/2534599504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4a809e170 msgr2=0x7fc4a811a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:33.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.145+0000 7fc4ae2f7700 1 --2- 172.21.15.156:0/2534599504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4a809e170 0x7fc4a811a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.145+0000 7fc4ae2f7700 1 -- 172.21.15.156:0/2534599504 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a400b600 con 0x7fc4a809d860 2023-09-30T22:18:33.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.145+0000 7fc4ae2f7700 1 --2- 172.21.15.156:0/2534599504 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a809d860 0x7fc4a8119fc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc4a400fde0 tx=0x7fc4a400d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:33.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.145+0000 7fc49effd700 1 -- 172.21.15.156:0/2534599504 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a400de40 con 0x7fc4a809d860 2023-09-30T22:18:33.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.145+0000 7fc49effd700 1 -- 172.21.15.156:0/2534599504 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a4004030 con 0x7fc4a809d860 2023-09-30T22:18:33.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.145+0000 7fc4b055b700 1 -- 172.21.15.156:0/2534599504 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4980094a0 con 0x7fc4a809d860 2023-09-30T22:18:33.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.145+0000 7fc49effd700 1 -- 172.21.15.156:0/2534599504 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a40043c0 con 0x7fc4a809d860 2023-09-30T22:18:33.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.145+0000 7fc4b055b700 1 -- 172.21.15.156:0/2534599504 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a811cd60 con 0x7fc4a809d860 2023-09-30T22:18:33.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.146+0000 7fc49effd700 1 -- 172.21.15.156:0/2534599504 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fc4a40036a0 con 0x7fc4a809d860 2023-09-30T22:18:33.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.146+0000 7fc49effd700 1 -- 172.21.15.156:0/2534599504 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fc4a403bed0 con 0x7fc4a809d860 2023-09-30T22:18:33.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.146+0000 7fc4adaf6700 1 -- 172.21.15.156:0/2534599504 >> v1:172.21.15.156:6816/118236 conn(0x7fc48c02c1b0 legacy=0x7fc48c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/118236 2023-09-30T22:18:33.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.146+0000 7fc4b055b700 1 -- 172.21.15.156:0/2534599504 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a811bc80 con 0x7fc4a809d860 2023-09-30T22:18:33.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.150+0000 7fc49effd700 1 -- 172.21.15.156:0/2534599504 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fc4a401f900 con 0x7fc4a809d860 2023-09-30T22:18:33.282 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:33.282+0000 7f82ca115240 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-30T22:18:33.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.322+0000 7fc4b055b700 1 -- 172.21.15.156:0/2534599504 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4a804f2a0 con 0x7fc4a809d860 2023-09-30T22:18:33.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.323+0000 7fc49effd700 1 -- 172.21.15.156:0/2534599504 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12764 (secure 0 0 0) 0x7fc4a401f310 con 0x7fc4a809d860 2023-09-30T22:18:33.324 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:18:33.324 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":19,"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","created":"2023-09-30T22:16:15.239992+0000","modified":"2023-09-30T22:17:22.019045+0000","last_up_change":"2023-09-30T22:16:23.392557+0000","last_in_change":"2023-09-30T22:16:16.474206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:16:23.433906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:16:24.367795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:16:28.204677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:16:28.762804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ec2e78a-c61f-473a-bfcb-f956cffe4095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6812","nonce":118781}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6813","nonce":118781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6815","nonce":118781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6814","nonce":118781}]},"public_addr":"172.21.15.156:6812/118781","cluster_addr":"172.21.15.156:6813/118781","heartbeat_back_addr":"172.21.15.156:6815/118781","heartbeat_front_addr":"172.21.15.156:6814/118781","state":["exists","up"]},{"osd":1,"uuid":"b682e683-c15a-4bd9-8712-8af96454e9ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6803","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6805","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6807","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6806","nonce":118763}]},"public_addr":"172.21.15.156:6803/118763","cluster_addr":"172.21.15.156:6805/118763","heartbeat_back_addr":"172.21.15.156:6807/118763","heartbeat_front_addr":"172.21.15.156:6806/118763","state":["exists","up"]},{"osd":2,"uuid":"960dbaf0-2e0c-437e-9114-bc22ce522b26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6808","nonce":118788}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6809","nonce":118788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6811","nonce":118788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6810","nonce":118788}]},"public_addr":"172.21.15.156:6808/118788","cluster_addr":"172.21.15.156:6809/118788","heartbeat_back_addr":"172.21.15.156:6811/118788","heartbeat_front_addr":"172.21.15.156:6810/118788","state":["exists","up"]},{"osd":3,"uuid":"c1b19714-78b1-4869-8721-2f6352a64a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6800","nonce":118764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6801","nonce":118764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6804","nonce":118764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6802","nonce":118764}]},"public_addr":"172.21.15.156:6800/118764","cluster_addr":"172.21.15.156:6801/118764","heartbeat_back_addr":"172.21.15.156:6804/118764","heartbeat_front_addr":"172.21.15.156:6802/118764","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.663343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.827397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.806655+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.634746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.2","mappings":[{"from":3,"to":0}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:18:33.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.325+0000 7fc4b055b700 1 -- 172.21.15.156:0/2534599504 >> v1:172.21.15.156:6816/118236 conn(0x7fc48c02c1b0 legacy=0x7fc48c02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:18:33.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.325+0000 7fc4b055b700 1 -- 172.21.15.156:0/2534599504 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a809d860 msgr2=0x7fc4a8119fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:33.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.325+0000 7fc4b055b700 1 --2- 172.21.15.156:0/2534599504 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a809d860 0x7fc4a8119fc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc4a400fde0 tx=0x7fc4a400d630 comp rx=0 tx=0).stop 2023-09-30T22:18:33.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.325+0000 7fc4b055b700 1 -- 172.21.15.156:0/2534599504 shutdown_connections 2023-09-30T22:18:33.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.325+0000 7fc4b055b700 1 --2- 172.21.15.156:0/2534599504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a8130ce0 0x7fc4a811aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.325+0000 7fc4b055b700 1 --2- 172.21.15.156:0/2534599504 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a809d860 0x7fc4a8119fc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.325+0000 7fc4b055b700 1 --2- 172.21.15.156:0/2534599504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4a809e170 0x7fc4a811a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.325+0000 7fc4b055b700 1 -- 172.21.15.156:0/2534599504 >> 172.21.15.156:0/2534599504 conn(0x7fc4a8099c40 msgr2=0x7fc4a80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:33.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.325+0000 7fc4b055b700 1 -- 172.21.15.156:0/2534599504 shutdown_connections 2023-09-30T22:18:33.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.325+0000 7fc4b055b700 1 -- 172.21.15.156:0/2534599504 wait complete. 2023-09-30T22:18:33.339 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-30T22:18:33.339 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:18:33.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.502+0000 7fb6f314e700 1 Processor -- start 2023-09-30T22:18:33.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.502+0000 7fb6f314e700 1 -- start start 2023-09-30T22:18:33.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.502+0000 7fb6f314e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6ec09a150 0x7fb6ec09e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.502+0000 7fb6f314e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb6ec09edb0 0x7fb6ec09f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.502+0000 7fb6f314e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb6ec133c20 0x7fb6ec1340a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.502+0000 7fb6f314e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6ec09a520 con 0x7fb6ec09edb0 2023-09-30T22:18:33.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.502+0000 7fb6f314e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec09fe00 con 0x7fb6ec09a150 2023-09-30T22:18:33.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.502+0000 7fb6f314e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec06bec0 con 0x7fb6ec133c20 2023-09-30T22:18:33.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.502+0000 7fb6f0eea700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6ec09a150 0x7fb6ec09e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.502+0000 7fb6ebfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb6ec09edb0 0x7fb6ec09f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.502+0000 7fb6f16eb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb6ec133c20 0x7fb6ec1340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.503+0000 7fb6f0eea700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6ec09a150 0x7fb6ec09e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57720/0 (socket says 172.21.15.156:57720) 2023-09-30T22:18:33.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.503+0000 7fb6ebfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb6ec09edb0 0x7fb6ec09f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39234/0 (socket says 172.21.15.156:39234) 2023-09-30T22:18:33.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.503+0000 7fb6f16eb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb6ec133c20 0x7fb6ec1340a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34602/0 (socket says 172.21.15.156:34602) 2023-09-30T22:18:33.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.503+0000 7fb6f0eea700 1 -- 172.21.15.156:0/464497776 learned_addr learned my addr 172.21.15.156:0/464497776 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:33.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.503+0000 7fb6f0eea700 1 -- 172.21.15.156:0/464497776 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb6ec133c20 msgr2=0x7fb6ec1340a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:33.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.503+0000 7fb6f0eea700 1 --2- 172.21.15.156:0/464497776 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb6ec133c20 0x7fb6ec1340a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.503+0000 7fb6f0eea700 1 -- 172.21.15.156:0/464497776 >> v2:172.21.15.156:3300/0 conn(0x7fb6ec09edb0 msgr2=0x7fb6ec09f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:33.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.503+0000 7fb6f0eea700 1 --2- 172.21.15.156:0/464497776 >> v2:172.21.15.156:3300/0 conn(0x7fb6ec09edb0 0x7fb6ec09f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.503+0000 7fb6f0eea700 1 -- 172.21.15.156:0/464497776 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ec09af80 con 0x7fb6ec09a150 2023-09-30T22:18:33.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.503+0000 7fb6f16eb700 1 --2- 172.21.15.156:0/464497776 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb6ec133c20 0x7fb6ec1340a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:33.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.503+0000 7fb6ebfff700 1 --2- 172.21.15.156:0/464497776 >> v2:172.21.15.156:3300/0 conn(0x7fb6ec09edb0 0x7fb6ec09f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:33.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.503+0000 7fb6f0eea700 1 --2- 172.21.15.156:0/464497776 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6ec09a150 0x7fb6ec09e870 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0009950 tx=0x7fb6e0009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57a9cf34bc1f64d7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:33.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.503+0000 7fb6eb7fe700 1 -- 172.21.15.156:0/464497776 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e0011830 con 0x7fb6ec09a150 2023-09-30T22:18:33.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.503+0000 7fb6eb7fe700 1 -- 172.21.15.156:0/464497776 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e0011990 con 0x7fb6ec09a150 2023-09-30T22:18:33.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.503+0000 7fb6eb7fe700 1 -- 172.21.15.156:0/464497776 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e0011d40 con 0x7fb6ec09a150 2023-09-30T22:18:33.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.504+0000 7fb6f314e700 1 -- 172.21.15.156:0/464497776 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6ec09a150 msgr2=0x7fb6ec09e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:33.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.504+0000 7fb6f314e700 1 --2- 172.21.15.156:0/464497776 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6ec09a150 0x7fb6ec09e870 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0009950 tx=0x7fb6e0009c60 comp rx=0 tx=0).stop 2023-09-30T22:18:33.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.504+0000 7fb6f314e700 1 -- 172.21.15.156:0/464497776 shutdown_connections 2023-09-30T22:18:33.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.504+0000 7fb6f314e700 1 --2- 172.21.15.156:0/464497776 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb6ec133c20 0x7fb6ec1340a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.504+0000 7fb6f314e700 1 --2- 172.21.15.156:0/464497776 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6ec09a150 0x7fb6ec09e870 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.504+0000 7fb6f314e700 1 --2- 172.21.15.156:0/464497776 >> v2:172.21.15.156:3300/0 conn(0x7fb6ec09edb0 0x7fb6ec09f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.504+0000 7fb6f314e700 1 -- 172.21.15.156:0/464497776 >> 172.21.15.156:0/464497776 conn(0x7fb6ec0a4430 msgr2=0x7fb6ec0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:33.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.504+0000 7fb6f314e700 1 -- 172.21.15.156:0/464497776 shutdown_connections 2023-09-30T22:18:33.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.504+0000 7fb6f314e700 1 -- 172.21.15.156:0/464497776 wait complete. 2023-09-30T22:18:33.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.505+0000 7fb6f314e700 1 Processor -- start 2023-09-30T22:18:33.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.505+0000 7fb6f314e700 1 -- start start 2023-09-30T22:18:33.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.505+0000 7fb6f314e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6ec09a150 0x7fb6ec11ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.505+0000 7fb6f314e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb6ec09edb0 0x7fb6ec11f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.505+0000 7fb6f314e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6ec133c20 0x7fb6ec11f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.505+0000 7fb6f314e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec121fd0 con 0x7fb6ec133c20 2023-09-30T22:18:33.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.505+0000 7fb6f314e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec0a13f0 con 0x7fb6ec09a150 2023-09-30T22:18:33.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.505+0000 7fb6f314e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec0a0440 con 0x7fb6ec09edb0 2023-09-30T22:18:33.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.506+0000 7fb6f0eea700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6ec09a150 0x7fb6ec11ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.506+0000 7fb6ebfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb6ec09edb0 0x7fb6ec11f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.506+0000 7fb6f0eea700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6ec09a150 0x7fb6ec11ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57728/0 (socket says 172.21.15.156:57728) 2023-09-30T22:18:33.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.506+0000 7fb6f0eea700 1 -- 172.21.15.156:0/343005635 learned_addr learned my addr 172.21.15.156:0/343005635 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:33.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.506+0000 7fb6f16eb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6ec133c20 0x7fb6ec11f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.506+0000 7fb6f0eea700 1 -- 172.21.15.156:0/343005635 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb6ec09edb0 msgr2=0x7fb6ec11f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:33.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.506+0000 7fb6f0eea700 1 --2- 172.21.15.156:0/343005635 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb6ec09edb0 0x7fb6ec11f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.506+0000 7fb6f0eea700 1 -- 172.21.15.156:0/343005635 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6ec133c20 msgr2=0x7fb6ec11f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:33.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.506+0000 7fb6f0eea700 1 --2- 172.21.15.156:0/343005635 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6ec133c20 0x7fb6ec11f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.506+0000 7fb6f0eea700 1 -- 172.21.15.156:0/343005635 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d80094a0 con 0x7fb6ec09a150 2023-09-30T22:18:33.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.506+0000 7fb6f16eb700 1 --2- 172.21.15.156:0/343005635 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6ec133c20 0x7fb6ec11f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:33.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.506+0000 7fb6ebfff700 1 --2- 172.21.15.156:0/343005635 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb6ec09edb0 0x7fb6ec11f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:33.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.506+0000 7fb6f0eea700 1 --2- 172.21.15.156:0/343005635 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6ec09a150 0x7fb6ec11ead0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec06c5c0 tx=0x7fb6e0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:33.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.506+0000 7fb6e97fa700 1 -- 172.21.15.156:0/343005635 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e0004450 con 0x7fb6ec09a150 2023-09-30T22:18:33.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.506+0000 7fb6f314e700 1 -- 172.21.15.156:0/343005635 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e4009a70 con 0x7fb6ec09a150 2023-09-30T22:18:33.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.506+0000 7fb6e97fa700 1 -- 172.21.15.156:0/343005635 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e001e070 con 0x7fb6ec09a150 2023-09-30T22:18:33.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.506+0000 7fb6e97fa700 1 -- 172.21.15.156:0/343005635 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e00038e0 con 0x7fb6ec09a150 2023-09-30T22:18:33.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.506+0000 7fb6f314e700 1 -- 172.21.15.156:0/343005635 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e0009550 con 0x7fb6ec09a150 2023-09-30T22:18:33.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.507+0000 7fb6e97fa700 1 -- 172.21.15.156:0/343005635 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fb6e0003a40 con 0x7fb6ec09a150 2023-09-30T22:18:33.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.507+0000 7fb6e97fa700 1 -- 172.21.15.156:0/343005635 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fb6e0020070 con 0x7fb6ec09a150 2023-09-30T22:18:33.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.507+0000 7fb6ebfff700 1 -- 172.21.15.156:0/343005635 >> v1:172.21.15.156:6816/118236 conn(0x7fb6d002c1b0 legacy=0x7fb6d002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/118236 2023-09-30T22:18:33.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.507+0000 7fb6f314e700 1 -- 172.21.15.156:0/343005635 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6ec09fa30 con 0x7fb6ec09a150 2023-09-30T22:18:33.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.511+0000 7fb6e97fa700 1 -- 172.21.15.156:0/343005635 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fb6e002a080 con 0x7fb6ec09a150 2023-09-30T22:18:33.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.682+0000 7fb6f314e700 1 -- 172.21.15.156:0/343005635 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6ec04f2a0 con 0x7fb6ec09a150 2023-09-30T22:18:33.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.683+0000 7fb6e97fa700 1 -- 172.21.15.156:0/343005635 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12764 (secure 0 0 0) 0x7fb6e0015070 con 0x7fb6ec09a150 2023-09-30T22:18:33.684 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:18:33.684 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":19,"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","created":"2023-09-30T22:16:15.239992+0000","modified":"2023-09-30T22:17:22.019045+0000","last_up_change":"2023-09-30T22:16:23.392557+0000","last_in_change":"2023-09-30T22:16:16.474206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:16:23.433906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:16:24.367795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:16:28.204677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:16:28.762804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ec2e78a-c61f-473a-bfcb-f956cffe4095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6812","nonce":118781}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6813","nonce":118781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6815","nonce":118781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6814","nonce":118781}]},"public_addr":"172.21.15.156:6812/118781","cluster_addr":"172.21.15.156:6813/118781","heartbeat_back_addr":"172.21.15.156:6815/118781","heartbeat_front_addr":"172.21.15.156:6814/118781","state":["exists","up"]},{"osd":1,"uuid":"b682e683-c15a-4bd9-8712-8af96454e9ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6803","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6805","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6807","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6806","nonce":118763}]},"public_addr":"172.21.15.156:6803/118763","cluster_addr":"172.21.15.156:6805/118763","heartbeat_back_addr":"172.21.15.156:6807/118763","heartbeat_front_addr":"172.21.15.156:6806/118763","state":["exists","up"]},{"osd":2,"uuid":"960dbaf0-2e0c-437e-9114-bc22ce522b26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6808","nonce":118788}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6809","nonce":118788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6811","nonce":118788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6810","nonce":118788}]},"public_addr":"172.21.15.156:6808/118788","cluster_addr":"172.21.15.156:6809/118788","heartbeat_back_addr":"172.21.15.156:6811/118788","heartbeat_front_addr":"172.21.15.156:6810/118788","state":["exists","up"]},{"osd":3,"uuid":"c1b19714-78b1-4869-8721-2f6352a64a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6800","nonce":118764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6801","nonce":118764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6804","nonce":118764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6802","nonce":118764}]},"public_addr":"172.21.15.156:6800/118764","cluster_addr":"172.21.15.156:6801/118764","heartbeat_back_addr":"172.21.15.156:6804/118764","heartbeat_front_addr":"172.21.15.156:6802/118764","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.663343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.827397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.806655+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.634746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.2","mappings":[{"from":3,"to":0}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:18:33.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.685+0000 7fb6f314e700 1 -- 172.21.15.156:0/343005635 >> v1:172.21.15.156:6816/118236 conn(0x7fb6d002c1b0 legacy=0x7fb6d002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:18:33.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.685+0000 7fb6f314e700 1 -- 172.21.15.156:0/343005635 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6ec09a150 msgr2=0x7fb6ec11ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:33.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.685+0000 7fb6f314e700 1 --2- 172.21.15.156:0/343005635 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6ec09a150 0x7fb6ec11ead0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec06c5c0 tx=0x7fb6e0004750 comp rx=0 tx=0).stop 2023-09-30T22:18:33.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.685+0000 7fb6f314e700 1 -- 172.21.15.156:0/343005635 shutdown_connections 2023-09-30T22:18:33.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.685+0000 7fb6f314e700 1 --2- 172.21.15.156:0/343005635 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6ec133c20 0x7fb6ec11f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.685+0000 7fb6f314e700 1 --2- 172.21.15.156:0/343005635 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6ec09a150 0x7fb6ec11ead0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.685+0000 7fb6f314e700 1 --2- 172.21.15.156:0/343005635 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb6ec09edb0 0x7fb6ec11f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.685+0000 7fb6f314e700 1 -- 172.21.15.156:0/343005635 >> 172.21.15.156:0/343005635 conn(0x7fb6ec0a4430 msgr2=0x7fb6ec071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:33.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.685+0000 7fb6f314e700 1 -- 172.21.15.156:0/343005635 shutdown_connections 2023-09-30T22:18:33.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.685+0000 7fb6f314e700 1 -- 172.21.15.156:0/343005635 wait complete. 2023-09-30T22:18:33.699 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-30T22:18:33.699 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-30T22:18:33.700 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-30T22:18:33.700 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-09-30T22:18:33.830 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:33.829+0000 7f82ca115240 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-30T22:18:33.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.839+0000 7f1659bfd700 1 Processor -- start 2023-09-30T22:18:33.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.839+0000 7f1659bfd700 1 -- start start 2023-09-30T22:18:33.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.840+0000 7f1659bfd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f165409d860 0x7f165409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.840+0000 7f1659bfd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f165409e170 0x7f16541307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.840+0000 7f1659bfd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1654130ce0 0x7f1654131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.840+0000 7f1659bfd700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f165409aaa0 con 0x7f1654130ce0 2023-09-30T22:18:33.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.840+0000 7f1659bfd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165409f870 con 0x7f165409d860 2023-09-30T22:18:33.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.840+0000 7f1659bfd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f165409b360 con 0x7f165409e170 2023-09-30T22:18:33.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.840+0000 7f16537fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f165409d860 0x7f165409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.840+0000 7f16537fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f165409d860 0x7f165409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57744/0 (socket says 172.21.15.156:57744) 2023-09-30T22:18:33.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.840+0000 7f16537fe700 1 -- 172.21.15.156:0/175226960 learned_addr learned my addr 172.21.15.156:0/175226960 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:33.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.840+0000 7f1652ffd700 1 --2- 172.21.15.156:0/175226960 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f165409e170 0x7f16541307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.840+0000 7f1652ffd700 1 -- 172.21.15.156:0/175226960 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f165409d860 msgr2=0x7f165409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:33.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.840+0000 7f1652ffd700 1 --2- 172.21.15.156:0/175226960 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f165409d860 0x7f165409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.840+0000 7f1652ffd700 1 -- 172.21.15.156:0/175226960 >> v2:172.21.15.156:3300/0 conn(0x7f1654130ce0 msgr2=0x7f1654131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:33.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.840+0000 7f1652ffd700 1 --2- 172.21.15.156:0/175226960 >> v2:172.21.15.156:3300/0 conn(0x7f1654130ce0 0x7f1654131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.840+0000 7f1652ffd700 1 -- 172.21.15.156:0/175226960 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165409b620 con 0x7f165409e170 2023-09-30T22:18:33.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.841+0000 7f1652ffd700 1 --2- 172.21.15.156:0/175226960 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f165409e170 0x7f16541307a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1648009840 tx=0x7f1648009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b486b65f1e461ad3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:33.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.841+0000 7f16527fc700 1 -- 172.21.15.156:0/175226960 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1648012b80 con 0x7f165409e170 2023-09-30T22:18:33.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.841+0000 7f16527fc700 1 -- 172.21.15.156:0/175226960 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1648012ce0 con 0x7f165409e170 2023-09-30T22:18:33.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.841+0000 7f16527fc700 1 -- 172.21.15.156:0/175226960 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164801b620 con 0x7f165409e170 2023-09-30T22:18:33.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.841+0000 7f1659bfd700 1 -- 172.21.15.156:0/175226960 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f165409e170 msgr2=0x7f16541307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:33.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.841+0000 7f1659bfd700 1 --2- 172.21.15.156:0/175226960 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f165409e170 0x7f16541307a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1648009840 tx=0x7f1648009b50 comp rx=0 tx=0).stop 2023-09-30T22:18:33.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.842+0000 7f1659bfd700 1 -- 172.21.15.156:0/175226960 shutdown_connections 2023-09-30T22:18:33.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.842+0000 7f1659bfd700 1 --2- 172.21.15.156:0/175226960 >> v2:172.21.15.156:3300/0 conn(0x7f1654130ce0 0x7f1654131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.842+0000 7f1659bfd700 1 --2- 172.21.15.156:0/175226960 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f165409d860 0x7f165409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.842+0000 7f1659bfd700 1 --2- 172.21.15.156:0/175226960 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f165409e170 0x7f16541307a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.842+0000 7f1659bfd700 1 -- 172.21.15.156:0/175226960 >> 172.21.15.156:0/175226960 conn(0x7f1654099c40 msgr2=0x7f16540a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:33.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.842+0000 7f1659bfd700 1 -- 172.21.15.156:0/175226960 shutdown_connections 2023-09-30T22:18:33.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.842+0000 7f1659bfd700 1 -- 172.21.15.156:0/175226960 wait complete. 2023-09-30T22:18:33.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.843+0000 7f1659bfd700 1 Processor -- start 2023-09-30T22:18:33.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.843+0000 7f1659bfd700 1 -- start start 2023-09-30T22:18:33.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.843+0000 7f1659bfd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f165409d860 0x7f165411c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.843+0000 7f1659bfd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f165409e170 0x7f165411c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.843+0000 7f1659bfd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1654130ce0 0x7f165411ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.843+0000 7f1659bfd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165411dc10 con 0x7f165409d860 2023-09-30T22:18:33.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.843+0000 7f1659bfd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165411ee60 con 0x7f165409e170 2023-09-30T22:18:33.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.843+0000 7f1659bfd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f165411e200 con 0x7f1654130ce0 2023-09-30T22:18:33.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.843+0000 7f1652ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f165409e170 0x7f165411c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.843+0000 7f1652ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f165409e170 0x7f165411c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57754/0 (socket says 172.21.15.156:57754) 2023-09-30T22:18:33.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.843+0000 7f1652ffd700 1 -- 172.21.15.156:0/2301372987 learned_addr learned my addr 172.21.15.156:0/2301372987 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:33.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.844+0000 7f16537fe700 1 --2- 172.21.15.156:0/2301372987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f165409d860 0x7f165411c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.844+0000 7f1653fff700 1 --2- 172.21.15.156:0/2301372987 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1654130ce0 0x7f165411ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.844+0000 7f16537fe700 1 -- 172.21.15.156:0/2301372987 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1654130ce0 msgr2=0x7f165411ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:33.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.844+0000 7f16537fe700 1 --2- 172.21.15.156:0/2301372987 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1654130ce0 0x7f165411ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.844+0000 7f16537fe700 1 -- 172.21.15.156:0/2301372987 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f165409e170 msgr2=0x7f165411c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:33.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.844+0000 7f16537fe700 1 --2- 172.21.15.156:0/2301372987 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f165409e170 0x7f165411c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.844+0000 7f16537fe700 1 -- 172.21.15.156:0/2301372987 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16480094a0 con 0x7f165409d860 2023-09-30T22:18:33.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.844+0000 7f16537fe700 1 --2- 172.21.15.156:0/2301372987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f165409d860 0x7f165411c000 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f164400e8e0 tx=0x7f164400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:33.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.844+0000 7f163bfff700 1 -- 172.21.15.156:0/2301372987 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164400c690 con 0x7f165409d860 2023-09-30T22:18:33.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.844+0000 7f163bfff700 1 -- 172.21.15.156:0/2301372987 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164400c7f0 con 0x7f165409d860 2023-09-30T22:18:33.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.844+0000 7f163bfff700 1 -- 172.21.15.156:0/2301372987 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164400cb80 con 0x7f165409d860 2023-09-30T22:18:33.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.845+0000 7f1659bfd700 1 -- 172.21.15.156:0/2301372987 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f165411f2b0 con 0x7f165409d860 2023-09-30T22:18:33.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.845+0000 7f1659bfd700 1 -- 172.21.15.156:0/2301372987 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1654071b20 con 0x7f165409d860 2023-09-30T22:18:33.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.845+0000 7f1659bfd700 1 -- 172.21.15.156:0/2301372987 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f165409c090 con 0x7f165409d860 2023-09-30T22:18:33.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.846+0000 7f163bfff700 1 -- 172.21.15.156:0/2301372987 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f164400cce0 con 0x7f165409d860 2023-09-30T22:18:33.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.846+0000 7f163bfff700 1 -- 172.21.15.156:0/2301372987 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f164403c020 con 0x7f165409d860 2023-09-30T22:18:33.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.846+0000 7f1652ffd700 1 -- 172.21.15.156:0/2301372987 >> v1:172.21.15.156:6816/118236 conn(0x7f164002c1e0 legacy=0x7f164002e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/118236 2023-09-30T22:18:33.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.846+0000 7f163bfff700 1 -- 172.21.15.156:0/2301372987 --> v1:172.21.15.156:6812/118781 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1640038e40 con 0x7f1640035140 2023-09-30T22:18:33.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.846+0000 7f163bfff700 1 -- 172.21.15.156:0/2301372987 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f164403c420 con 0x7f165409d860 2023-09-30T22:18:33.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.848+0000 7f163bfff700 1 -- 172.21.15.156:0/2301372987 <== osd.0 v1:172.21.15.156:6812/118781 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f1640038e40 con 0x7f1640035140 2023-09-30T22:18:33.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.863+0000 7f1659bfd700 1 -- 172.21.15.156:0/2301372987 --> v1:172.21.15.156:6812/118781 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1654120260 con 0x7f1640035140 2023-09-30T22:18:33.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.864+0000 7f163bfff700 1 -- 172.21.15.156:0/2301372987 <== osd.0 v1:172.21.15.156:6812/118781 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1454964136) 0x7f1654120260 con 0x7f1640035140 2023-09-30T22:18:33.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.864+0000 7f1659bfd700 1 -- 172.21.15.156:0/2301372987 >> v1:172.21.15.156:6812/118781 conn(0x7f1640035140 legacy=0x7f16400375d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:33.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.864+0000 7f1659bfd700 1 -- 172.21.15.156:0/2301372987 >> v1:172.21.15.156:6816/118236 conn(0x7f164002c1e0 legacy=0x7f164002e690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:18:33.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.864+0000 7f1659bfd700 1 -- 172.21.15.156:0/2301372987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f165409d860 msgr2=0x7f165411c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:33.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.864+0000 7f1659bfd700 1 --2- 172.21.15.156:0/2301372987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f165409d860 0x7f165411c000 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f164400e8e0 tx=0x7f164400ebf0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.864+0000 7f1653fff700 1 -- 172.21.15.156:0/2301372987 reap_dead start 2023-09-30T22:18:33.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.864+0000 7f1659bfd700 1 -- 172.21.15.156:0/2301372987 shutdown_connections 2023-09-30T22:18:33.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.864+0000 7f1659bfd700 1 -- 172.21.15.156:0/2301372987 >> 172.21.15.156:0/2301372987 conn(0x7f1654099c40 msgr2=0x7f16540a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:33.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.865+0000 7f1659bfd700 1 -- 172.21.15.156:0/2301372987 shutdown_connections 2023-09-30T22:18:33.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.865+0000 7f1659bfd700 1 -- 172.21.15.156:0/2301372987 wait complete. 2023-09-30T22:18:33.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.878+0000 7fd1cacf6700 1 Processor -- start 2023-09-30T22:18:33.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.878+0000 7fd1cacf6700 1 -- start start 2023-09-30T22:18:33.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.878+0000 7fd1cacf6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd1c409d860 0x7fd1c409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.878+0000 7fd1cacf6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1c409e170 0x7fd1c41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.878+0000 7fd1cacf6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1c4130ce0 0x7fd1c4131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.878+0000 7fd1cacf6700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c4131670 con 0x7fd1c409d860 2023-09-30T22:18:33.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.878+0000 7fd1cacf6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c409aaa0 con 0x7fd1c4130ce0 2023-09-30T22:18:33.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.878+0000 7fd1cacf6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c409f870 con 0x7fd1c409e170 2023-09-30T22:18:33.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.878+0000 7fd1c8a92700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd1c409d860 0x7fd1c409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.878+0000 7fd1c8a92700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd1c409d860 0x7fd1c409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39284/0 (socket says 172.21.15.156:39284) 2023-09-30T22:18:33.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.878+0000 7fd1c8a92700 1 -- 172.21.15.156:0/3489758822 learned_addr learned my addr 172.21.15.156:0/3489758822 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:33.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.879+0000 7fd1c8a92700 1 -- 172.21.15.156:0/3489758822 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1c409e170 msgr2=0x7fd1c41307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:33.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.879+0000 7fd1c8a92700 1 --2- 172.21.15.156:0/3489758822 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1c409e170 0x7fd1c41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.879+0000 7fd1c8a92700 1 -- 172.21.15.156:0/3489758822 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1c4130ce0 msgr2=0x7fd1c4131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:33.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.879+0000 7fd1c8a92700 1 --2- 172.21.15.156:0/3489758822 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1c4130ce0 0x7fd1c4131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.879+0000 7fd1c8a92700 1 -- 172.21.15.156:0/3489758822 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c409b360 con 0x7fd1c409d860 2023-09-30T22:18:33.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.879+0000 7fd1c8a92700 1 --2- 172.21.15.156:0/3489758822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1c409d860 0x7fd1c409dc30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd1b800bbc0 tx=0x7fd1b800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84341522dde1169f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:33.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.879+0000 7fd1c37fe700 1 -- 172.21.15.156:0/3489758822 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b800dd50 con 0x7fd1c409d860 2023-09-30T22:18:33.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.879+0000 7fd1c37fe700 1 -- 172.21.15.156:0/3489758822 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b8010470 con 0x7fd1c409d860 2023-09-30T22:18:33.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.879+0000 7fd1c37fe700 1 -- 172.21.15.156:0/3489758822 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b8010800 con 0x7fd1c409d860 2023-09-30T22:18:33.882 INFO:teuthology.orchestra.run.smithi156.stdout:38654705692 2023-09-30T22:18:33.882 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:18:33.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.880+0000 7fd1cacf6700 1 -- 172.21.15.156:0/3489758822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1c409d860 msgr2=0x7fd1c409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:33.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.880+0000 7fd1cacf6700 1 --2- 172.21.15.156:0/3489758822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1c409d860 0x7fd1c409dc30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd1b800bbc0 tx=0x7fd1b800bed0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.880+0000 7fd1cacf6700 1 -- 172.21.15.156:0/3489758822 shutdown_connections 2023-09-30T22:18:33.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.880+0000 7fd1cacf6700 1 --2- 172.21.15.156:0/3489758822 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1c4130ce0 0x7fd1c4131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.880+0000 7fd1cacf6700 1 --2- 172.21.15.156:0/3489758822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1c409d860 0x7fd1c409dc30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.880+0000 7fd1cacf6700 1 --2- 172.21.15.156:0/3489758822 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1c409e170 0x7fd1c41307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.880+0000 7fd1cacf6700 1 -- 172.21.15.156:0/3489758822 >> 172.21.15.156:0/3489758822 conn(0x7fd1c4099c40 msgr2=0x7fd1c40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:33.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.880+0000 7fd1cacf6700 1 -- 172.21.15.156:0/3489758822 shutdown_connections 2023-09-30T22:18:33.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.880+0000 7fd1cacf6700 1 -- 172.21.15.156:0/3489758822 wait complete. 2023-09-30T22:18:33.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.881+0000 7fd1cacf6700 1 Processor -- start 2023-09-30T22:18:33.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.881+0000 7fd1cacf6700 1 -- start start 2023-09-30T22:18:33.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.882+0000 7fd1cacf6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1c409d860 0x7fd1c411e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.882+0000 7fd1cacf6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1c409e170 0x7fd1c411e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.882+0000 7fd1cacf6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1c4130ce0 0x7fd1c411ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.882+0000 7fd1cacf6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c4121a70 con 0x7fd1c4130ce0 2023-09-30T22:18:33.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.882+0000 7fd1cacf6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c4130570 con 0x7fd1c409d860 2023-09-30T22:18:33.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.882+0000 7fd1cacf6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c4120ff0 con 0x7fd1c409e170 2023-09-30T22:18:33.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.882+0000 7fd1c9293700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1c4130ce0 0x7fd1c411ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.882+0000 7fd1c3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1c409e170 0x7fd1c411e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.882+0000 7fd1c9293700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1c4130ce0 0x7fd1c411ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39292/0 (socket says 172.21.15.156:39292) 2023-09-30T22:18:33.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.882+0000 7fd1c9293700 1 -- 172.21.15.156:0/3798063348 learned_addr learned my addr 172.21.15.156:0/3798063348 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:33.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.882+0000 7fd1c8a92700 1 --2- 172.21.15.156:0/3798063348 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1c409d860 0x7fd1c411e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.882+0000 7fd1c3fff700 1 -- 172.21.15.156:0/3798063348 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1c409d860 msgr2=0x7fd1c411e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:33.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.882+0000 7fd1c3fff700 1 --2- 172.21.15.156:0/3798063348 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1c409d860 0x7fd1c411e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.882+0000 7fd1c3fff700 1 -- 172.21.15.156:0/3798063348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1c4130ce0 msgr2=0x7fd1c411ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:33.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.882+0000 7fd1c3fff700 1 --2- 172.21.15.156:0/3798063348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1c4130ce0 0x7fd1c411ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.882+0000 7fd1c3fff700 1 -- 172.21.15.156:0/3798063348 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b800b7f0 con 0x7fd1c409e170 2023-09-30T22:18:33.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.882+0000 7fd1c3fff700 1 --2- 172.21.15.156:0/3798063348 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1c409e170 0x7fd1c411e6d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd1b000b480 tx=0x7fd1b000b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:33.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.883+0000 7fd1c17fa700 1 -- 172.21.15.156:0/3798063348 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b0011830 con 0x7fd1c409e170 2023-09-30T22:18:33.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.883+0000 7fd1c17fa700 1 -- 172.21.15.156:0/3798063348 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b0011990 con 0x7fd1c409e170 2023-09-30T22:18:33.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.883+0000 7fd1cacf6700 1 -- 172.21.15.156:0/3798063348 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c4121440 con 0x7fd1c409e170 2023-09-30T22:18:33.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.883+0000 7fd1c17fa700 1 -- 172.21.15.156:0/3798063348 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b0011d40 con 0x7fd1c409e170 2023-09-30T22:18:33.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.883+0000 7fd1cacf6700 1 -- 172.21.15.156:0/3798063348 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c4071c20 con 0x7fd1c409e170 2023-09-30T22:18:33.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.883+0000 7fd1c17fa700 1 -- 172.21.15.156:0/3798063348 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fd1b001a400 con 0x7fd1c409e170 2023-09-30T22:18:33.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.884+0000 7fd1c17fa700 1 -- 172.21.15.156:0/3798063348 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fd1b003b700 con 0x7fd1c409e170 2023-09-30T22:18:33.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.884+0000 7fd1c8a92700 1 -- 172.21.15.156:0/3798063348 >> v1:172.21.15.156:6816/118236 conn(0x7fd1a802c1b0 legacy=0x7fd1a802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/118236 2023-09-30T22:18:33.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.884+0000 7fd1cacf6700 1 -- 172.21.15.156:0/3798063348 --> v1:172.21.15.156:6800/118764 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd1c409b660 con 0x7fd1c41222d0 2023-09-30T22:18:33.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.885+0000 7fd1c17fa700 1 -- 172.21.15.156:0/3798063348 <== osd.3 v1:172.21.15.156:6800/118764 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7fd1bc009b60 con 0x7fd1c41222d0 2023-09-30T22:18:33.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.888+0000 7f2968bab700 1 Processor -- start 2023-09-30T22:18:33.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.888+0000 7f2968bab700 1 -- start start 2023-09-30T22:18:33.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.889+0000 7f2968bab700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2964131980 0x7f2964131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.889+0000 7f2968bab700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f296409bc70 0x7f296409c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.889+0000 7f2968bab700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f296409c5c0 0x7f2964138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.889+0000 7f2968bab700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f296406eb30 con 0x7f296409bc70 2023-09-30T22:18:33.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.889+0000 7f2968bab700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29640a1640 con 0x7f296409c5c0 2023-09-30T22:18:33.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.889+0000 7f2968bab700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29640a22d0 con 0x7f2964131980 2023-09-30T22:18:33.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.889+0000 7f2962d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f296409c5c0 0x7f2964138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.889+0000 7f2962d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f296409c5c0 0x7f2964138700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57770/0 (socket says 172.21.15.156:57770) 2023-09-30T22:18:33.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.889+0000 7f2962d9d700 1 -- 172.21.15.156:0/309731146 learned_addr learned my addr 172.21.15.156:0/309731146 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:33.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.889+0000 7f2961d9b700 1 --2- 172.21.15.156:0/309731146 >> v2:172.21.15.156:3300/0 conn(0x7f296409bc70 0x7f296409c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.890+0000 7f2962d9d700 1 -- 172.21.15.156:0/309731146 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2964131980 msgr2=0x7f2964131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:33.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.890+0000 7f2962d9d700 1 --2- 172.21.15.156:0/309731146 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2964131980 0x7f2964131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.890+0000 7f2962d9d700 1 -- 172.21.15.156:0/309731146 >> v2:172.21.15.156:3300/0 conn(0x7f296409bc70 msgr2=0x7f296409c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:33.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.890+0000 7f2962d9d700 1 --2- 172.21.15.156:0/309731146 >> v2:172.21.15.156:3300/0 conn(0x7f296409bc70 0x7f296409c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.890+0000 7f2962d9d700 1 -- 172.21.15.156:0/309731146 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2964131550 con 0x7f296409c5c0 2023-09-30T22:18:33.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.890+0000 7f2962d9d700 1 --2- 172.21.15.156:0/309731146 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f296409c5c0 0x7f2964138700 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f295c009e50 tx=0x7f295c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=967af3faea665d74 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:33.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.890+0000 7f296159a700 1 -- 172.21.15.156:0/309731146 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c00e070 con 0x7f296409c5c0 2023-09-30T22:18:33.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.890+0000 7f296159a700 1 -- 172.21.15.156:0/309731146 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295c00b910 con 0x7f296409c5c0 2023-09-30T22:18:33.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.890+0000 7f296159a700 1 -- 172.21.15.156:0/309731146 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c00bcc0 con 0x7f296409c5c0 2023-09-30T22:18:33.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.891+0000 7f33f7412700 1 Processor -- start 2023-09-30T22:18:33.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.891+0000 7f2968bab700 1 -- 172.21.15.156:0/309731146 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f296409c5c0 msgr2=0x7f2964138700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:33.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.891+0000 7f2968bab700 1 --2- 172.21.15.156:0/309731146 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f296409c5c0 0x7f2964138700 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f295c009e50 tx=0x7f295c00b330 comp rx=0 tx=0).stop 2023-09-30T22:18:33.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.891+0000 7f2968bab700 1 -- 172.21.15.156:0/309731146 shutdown_connections 2023-09-30T22:18:33.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.891+0000 7f2968bab700 1 --2- 172.21.15.156:0/309731146 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f296409c5c0 0x7f2964138700 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.891+0000 7f2968bab700 1 --2- 172.21.15.156:0/309731146 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2964131980 0x7f2964131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.891+0000 7f2968bab700 1 --2- 172.21.15.156:0/309731146 >> v2:172.21.15.156:3300/0 conn(0x7f296409bc70 0x7f296409c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.891+0000 7f2968bab700 1 -- 172.21.15.156:0/309731146 >> 172.21.15.156:0/309731146 conn(0x7f29640a2980 msgr2=0x7f29640a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:33.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.891+0000 7f2968bab700 1 -- 172.21.15.156:0/309731146 shutdown_connections 2023-09-30T22:18:33.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.891+0000 7f2968bab700 1 -- 172.21.15.156:0/309731146 wait complete. 2023-09-30T22:18:33.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.891+0000 7f33f7412700 1 -- start start 2023-09-30T22:18:33.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.892+0000 7f33f7412700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f33f012f700 0x7f33f012fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.892+0000 7f33f7412700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f0130010 0x7f33f00987d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.892+0000 7f33f7412700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f009a6c0 con 0x7f33f009a0a0 2023-09-30T22:18:33.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.892+0000 7f33f7412700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f009ac80 con 0x7f33f012f700 2023-09-30T22:18:33.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.892+0000 7f33f7412700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33f009bff0 con 0x7f33f0130010 2023-09-30T22:18:33.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.892+0000 7f33f49ad700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f33f009a0a0 0x7f33f00980c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:42546/0 (socket says 172.21.15.156:42546) 2023-09-30T22:18:33.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.892+0000 7f33f49ad700 1 -- 172.21.15.156:0/2534468613 learned_addr learned my addr 172.21.15.156:0/2534468613 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:18:33.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.892+0000 7f33f59af700 1 --2- 172.21.15.156:0/2534468613 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f0130010 0x7f33f00987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.892+0000 7f33f51ae700 1 --2- 172.21.15.156:0/2534468613 >> v2:172.21.15.156:3300/0 conn(0x7f33f012f700 0x7f33f012fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.892+0000 7f2968bab700 1 Processor -- start 2023-09-30T22:18:33.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.893+0000 7f33f59af700 1 -- 172.21.15.156:0/2534468613 >> v2:172.21.15.156:3300/0 conn(0x7f33f012f700 msgr2=0x7f33f012fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:33.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.893+0000 7f33f59af700 1 --2- 172.21.15.156:0/2534468613 >> v2:172.21.15.156:3300/0 conn(0x7f33f012f700 0x7f33f012fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.893+0000 7f33f59af700 1 -- 172.21.15.156:0/2534468613 >> v1:172.21.15.156:6789/0 conn(0x7f33f009a0a0 legacy=0x7f33f00980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:33.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.893+0000 7f33f59af700 1 -- 172.21.15.156:0/2534468613 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f009b9b0 con 0x7f33f0130010 2023-09-30T22:18:33.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.893+0000 7f2968bab700 1 -- start start 2023-09-30T22:18:33.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.893+0000 7f33f59af700 1 --2- 172.21.15.156:0/2534468613 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f0130010 0x7f33f00987d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f33e800aea0 tx=0x7f33e800c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fcb9f14c3451385 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:33.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.893+0000 7f33e7fff700 1 -- 172.21.15.156:0/2534468613 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e8003c20 con 0x7f33f0130010 2023-09-30T22:18:33.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.893+0000 7f33e7fff700 1 -- 172.21.15.156:0/2534468613 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e8003d80 con 0x7f33f0130010 2023-09-30T22:18:33.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.893+0000 7f33e7fff700 1 -- 172.21.15.156:0/2534468613 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e800cb00 con 0x7f33f0130010 2023-09-30T22:18:33.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.893+0000 7f2968bab700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f296409bc70 0x7f29641cc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.893+0000 7f2968bab700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f296409c5c0 0x7f29641cce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.893+0000 7f2968bab700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2964131980 0x7f29641345e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.893+0000 7f2968bab700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29641ca570 con 0x7f296409c5c0 2023-09-30T22:18:33.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.893+0000 7f2968bab700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2964137e60 con 0x7f2964131980 2023-09-30T22:18:33.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.893+0000 7f2968bab700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2964135a40 con 0x7f296409bc70 2023-09-30T22:18:33.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.894+0000 7f296259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f296409bc70 0x7f29641cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.894+0000 7f296259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f296409bc70 0x7f29641cc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34666/0 (socket says 172.21.15.156:34666) 2023-09-30T22:18:33.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.894+0000 7f296259c700 1 -- 172.21.15.156:0/1217019739 learned_addr learned my addr 172.21.15.156:0/1217019739 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:33.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.894+0000 7f2962d9d700 1 --2- 172.21.15.156:0/1217019739 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2964131980 0x7f29641345e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.894+0000 7f296259c700 1 -- 172.21.15.156:0/1217019739 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2964131980 msgr2=0x7f29641345e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:33.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.894+0000 7f296259c700 1 --2- 172.21.15.156:0/1217019739 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2964131980 0x7f29641345e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.894+0000 7f296259c700 1 -- 172.21.15.156:0/1217019739 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f296409c5c0 msgr2=0x7f29641cce90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:18:33.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.894+0000 7f296259c700 1 --2- 172.21.15.156:0/1217019739 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f296409c5c0 0x7f29641cce90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.894+0000 7f296259c700 1 -- 172.21.15.156:0/1217019739 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295c009b30 con 0x7f296409bc70 2023-09-30T22:18:33.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.894+0000 7f2962d9d700 1 --2- 172.21.15.156:0/1217019739 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2964131980 0x7f29641345e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:33.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.894+0000 7f296259c700 1 --2- 172.21.15.156:0/1217019739 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f296409bc70 0x7f29641cc950 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f295400b520 tx=0x7f295400b830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:33.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.894+0000 7f33f7412700 1 -- 172.21.15.156:0/2534468613 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f0130010 msgr2=0x7f33f00987d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:33.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.894+0000 7f33f7412700 1 --2- 172.21.15.156:0/2534468613 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f0130010 0x7f33f00987d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f33e800aea0 tx=0x7f33e800c330 comp rx=0 tx=0).stop 2023-09-30T22:18:33.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.894+0000 7f33f7412700 1 -- 172.21.15.156:0/2534468613 shutdown_connections 2023-09-30T22:18:33.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.894+0000 7f33f7412700 1 --2- 172.21.15.156:0/2534468613 >> v2:172.21.15.156:3300/0 conn(0x7f33f012f700 0x7f33f012fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.894+0000 7f33f7412700 1 --2- 172.21.15.156:0/2534468613 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f0130010 0x7f33f00987d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.894+0000 7f33f7412700 1 -- 172.21.15.156:0/2534468613 >> 172.21.15.156:0/2534468613 conn(0x7f33f00a1ee0 msgr2=0x7f33f00a22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:33.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.894+0000 7f33f7412700 1 -- 172.21.15.156:0/2534468613 shutdown_connections 2023-09-30T22:18:33.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.894+0000 7f33f7412700 1 -- 172.21.15.156:0/2534468613 wait complete. 2023-09-30T22:18:33.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.895+0000 7f2952ffd700 1 -- 172.21.15.156:0/1217019739 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2954005aa0 con 0x7f296409bc70 2023-09-30T22:18:33.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.895+0000 7f2952ffd700 1 -- 172.21.15.156:0/1217019739 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2954005c20 con 0x7f296409bc70 2023-09-30T22:18:33.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.895+0000 7f2968bab700 1 -- 172.21.15.156:0/1217019739 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2964138110 con 0x7f296409bc70 2023-09-30T22:18:33.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.895+0000 7f2952ffd700 1 -- 172.21.15.156:0/1217019739 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2954011630 con 0x7f296409bc70 2023-09-30T22:18:33.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.896+0000 7f33f7412700 1 Processor -- start 2023-09-30T22:18:33.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.896+0000 7f33f7412700 1 -- start start 2023-09-30T22:18:33.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.896+0000 7f33f7412700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33f009a0a0 0x7f33f0094850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.896+0000 7f33f7412700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f012f700 0x7f33f0094d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.895+0000 7f2968bab700 1 -- 172.21.15.156:0/1217019739 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29640a1c40 con 0x7f296409bc70 2023-09-30T22:18:33.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.896+0000 7f2968bab700 1 -- 172.21.15.156:0/1217019739 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2964136a50 con 0x7f296409bc70 2023-09-30T22:18:33.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.896+0000 7f33f7412700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33f0130010 0x7f33f00952d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:33.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.896+0000 7f33f7412700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f0097a20 con 0x7f33f0130010 2023-09-30T22:18:33.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.896+0000 7f33f7412700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f0095c00 con 0x7f33f009a0a0 2023-09-30T22:18:33.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.896+0000 7f33f7412700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33f012f2c0 con 0x7f33f012f700 2023-09-30T22:18:33.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.896+0000 7f33f59af700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33f0130010 0x7f33f00952d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.896+0000 7f33f59af700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33f0130010 0x7f33f00952d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39312/0 (socket says 172.21.15.156:39312) 2023-09-30T22:18:33.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.896+0000 7f33f59af700 1 -- 172.21.15.156:0/779559678 learned_addr learned my addr 172.21.15.156:0/779559678 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:33.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.896+0000 7f33f51ae700 1 --2- 172.21.15.156:0/779559678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33f009a0a0 0x7f33f0094850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:33.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.897+0000 7f33f51ae700 1 -- 172.21.15.156:0/779559678 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f012f700 msgr2=0x7f33f0094d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:33.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.897+0000 7f33f51ae700 1 --2- 172.21.15.156:0/779559678 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f012f700 0x7f33f0094d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.897+0000 7f33f51ae700 1 -- 172.21.15.156:0/779559678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33f0130010 msgr2=0x7f33f00952d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:33.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.897+0000 7f33f51ae700 1 --2- 172.21.15.156:0/779559678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33f0130010 0x7f33f00952d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.897+0000 7f33f51ae700 1 -- 172.21.15.156:0/779559678 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e800ab80 con 0x7f33f009a0a0 2023-09-30T22:18:33.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.897+0000 7f2952ffd700 1 -- 172.21.15.156:0/1217019739 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f2954011790 con 0x7f296409bc70 2023-09-30T22:18:33.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.897+0000 7f33f59af700 1 --2- 172.21.15.156:0/779559678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33f0130010 0x7f33f00952d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:33.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.897+0000 7f33f51ae700 1 --2- 172.21.15.156:0/779559678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33f009a0a0 0x7f33f0094850 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f33e000e7e0 tx=0x7f33e000eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:33.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.897+0000 7f2961d9b700 1 -- 172.21.15.156:0/1217019739 >> v1:172.21.15.156:6816/118236 conn(0x7f294402c1e0 legacy=0x7f294402e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/118236 2023-09-30T22:18:33.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.897+0000 7f33e5ffb700 1 -- 172.21.15.156:0/779559678 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e000c070 con 0x7f33f009a0a0 2023-09-30T22:18:33.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.897+0000 7f33e5ffb700 1 -- 172.21.15.156:0/779559678 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e0013610 con 0x7f33f009a0a0 2023-09-30T22:18:33.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.897+0000 7f33e5ffb700 1 -- 172.21.15.156:0/779559678 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e00139a0 con 0x7f33f009a0a0 2023-09-30T22:18:33.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.897+0000 7f2952ffd700 1 -- 172.21.15.156:0/1217019739 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f2954005fd0 con 0x7f296409bc70 2023-09-30T22:18:33.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.897+0000 7f2952ffd700 1 -- 172.21.15.156:0/1217019739 --> v1:172.21.15.156:6808/118788 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2944038e40 con 0x7f2944035140 2023-09-30T22:18:33.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.897+0000 7f2952ffd700 1 -- 172.21.15.156:0/1217019739 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2954019e80 con 0x7f296409bc70 2023-09-30T22:18:33.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.897+0000 7f33f7412700 1 -- 172.21.15.156:0/779559678 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f00982b0 con 0x7f33f009a0a0 2023-09-30T22:18:33.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.898+0000 7f33f7412700 1 -- 172.21.15.156:0/779559678 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f00963a0 con 0x7f33f009a0a0 2023-09-30T22:18:33.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.898+0000 7f33e5ffb700 1 -- 172.21.15.156:0/779559678 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f33e0013b00 con 0x7f33f009a0a0 2023-09-30T22:18:33.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.899+0000 7f33f7412700 1 -- 172.21.15.156:0/779559678 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f33f01304b0 con 0x7f33f009a0a0 2023-09-30T22:18:33.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.899+0000 7f33f49ad700 1 -- 172.21.15.156:0/779559678 >> v1:172.21.15.156:6816/118236 conn(0x7f33d402c1b0 legacy=0x7f33d402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/118236 2023-09-30T22:18:33.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.899+0000 7f33e5ffb700 1 -- 172.21.15.156:0/779559678 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f33e003b770 con 0x7f33f009a0a0 2023-09-30T22:18:33.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.899+0000 7f33e5ffb700 1 -- 172.21.15.156:0/779559678 --> v1:172.21.15.156:6803/118763 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f33d4038e10 con 0x7f33d4035110 2023-09-30T22:18:33.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.899+0000 7f33e5ffb700 1 -- 172.21.15.156:0/779559678 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33e0010920 con 0x7f33f009a0a0 2023-09-30T22:18:33.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.900+0000 7f2952ffd700 1 -- 172.21.15.156:0/1217019739 <== osd.2 v1:172.21.15.156:6808/118788 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f2944038e40 con 0x7f2944035140 2023-09-30T22:18:33.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.901+0000 7f33e5ffb700 1 -- 172.21.15.156:0/779559678 <== osd.1 v1:172.21.15.156:6803/118763 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f33d4038e10 con 0x7f33d4035110 2023-09-30T22:18:33.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.906+0000 7fd1cacf6700 1 -- 172.21.15.156:0/3798063348 --> v1:172.21.15.156:6800/118764 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd1c4062020 con 0x7fd1c41222d0 2023-09-30T22:18:33.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.906+0000 7fd1c17fa700 1 -- 172.21.15.156:0/3798063348 <== osd.3 v1:172.21.15.156:6800/118764 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1454964136) 0x7fd1c4062020 con 0x7fd1c41222d0 2023-09-30T22:18:33.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.908+0000 7fd1cacf6700 1 -- 172.21.15.156:0/3798063348 >> v1:172.21.15.156:6800/118764 conn(0x7fd1c41222d0 legacy=0x7fd1c40616a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:33.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.908+0000 7fd1cacf6700 1 -- 172.21.15.156:0/3798063348 >> v1:172.21.15.156:6816/118236 conn(0x7fd1a802c1b0 legacy=0x7fd1a802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:18:33.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.908+0000 7fd1cacf6700 1 -- 172.21.15.156:0/3798063348 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1c409e170 msgr2=0x7fd1c411e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:33.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.908+0000 7fd1cacf6700 1 --2- 172.21.15.156:0/3798063348 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1c409e170 0x7fd1c411e6d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd1b000b480 tx=0x7fd1b000b790 comp rx=0 tx=0).stop 2023-09-30T22:18:33.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.908+0000 7fd1c9293700 1 -- 172.21.15.156:0/3798063348 reap_dead start 2023-09-30T22:18:33.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.908+0000 7fd1cacf6700 1 -- 172.21.15.156:0/3798063348 shutdown_connections 2023-09-30T22:18:33.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.908+0000 7fd1cacf6700 1 -- 172.21.15.156:0/3798063348 >> 172.21.15.156:0/3798063348 conn(0x7fd1c4099c40 msgr2=0x7fd1c40713a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:33.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.908+0000 7fd1cacf6700 1 -- 172.21.15.156:0/3798063348 shutdown_connections 2023-09-30T22:18:33.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.908+0000 7fd1cacf6700 1 -- 172.21.15.156:0/3798063348 wait complete. 2023-09-30T22:18:33.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.917+0000 7f33f7412700 1 -- 172.21.15.156:0/779559678 --> v1:172.21.15.156:6803/118763 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f33f004f2a0 con 0x7f33d4035110 2023-09-30T22:18:33.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.918+0000 7f33e5ffb700 1 -- 172.21.15.156:0/779559678 <== osd.1 v1:172.21.15.156:6803/118763 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1454964136) 0x7f33f004f2a0 con 0x7f33d4035110 2023-09-30T22:18:33.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.918+0000 7f33f7412700 1 -- 172.21.15.156:0/779559678 >> v1:172.21.15.156:6803/118763 conn(0x7f33d4035110 legacy=0x7f33d40375a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:33.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.918+0000 7f33f7412700 1 -- 172.21.15.156:0/779559678 >> v1:172.21.15.156:6816/118236 conn(0x7f33d402c1b0 legacy=0x7f33d402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:18:33.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.918+0000 7f33f7412700 1 -- 172.21.15.156:0/779559678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33f009a0a0 msgr2=0x7f33f0094850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:33.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.918+0000 7f33f7412700 1 --2- 172.21.15.156:0/779559678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33f009a0a0 0x7f33f0094850 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f33e000e7e0 tx=0x7f33e000eaf0 comp rx=0 tx=0).stop 2023-09-30T22:18:33.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.918+0000 7f33f59af700 1 -- 172.21.15.156:0/779559678 reap_dead start 2023-09-30T22:18:33.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.918+0000 7f33f7412700 1 -- 172.21.15.156:0/779559678 shutdown_connections 2023-09-30T22:18:33.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.918+0000 7f33f7412700 1 -- 172.21.15.156:0/779559678 >> 172.21.15.156:0/779559678 conn(0x7f33f00a1ee0 msgr2=0x7f33f0128fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:33.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.918+0000 7f33f7412700 1 -- 172.21.15.156:0/779559678 shutdown_connections 2023-09-30T22:18:33.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.918+0000 7f33f7412700 1 -- 172.21.15.156:0/779559678 wait complete. 2023-09-30T22:18:33.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.921+0000 7f2968bab700 1 -- 172.21.15.156:0/1217019739 --> v1:172.21.15.156:6808/118788 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2964132290 con 0x7f2944035140 2023-09-30T22:18:33.923 INFO:teuthology.orchestra.run.smithi156.stdout:38654705692 2023-09-30T22:18:33.924 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:18:33.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.923+0000 7f2952ffd700 1 -- 172.21.15.156:0/1217019739 <== osd.2 v1:172.21.15.156:6808/118788 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1454964136) 0x7f295c0094d0 con 0x7f2944035140 2023-09-30T22:18:33.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.923+0000 7f2968bab700 1 -- 172.21.15.156:0/1217019739 >> v1:172.21.15.156:6808/118788 conn(0x7f2944035140 legacy=0x7f29440375d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:33.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.923+0000 7f2968bab700 1 -- 172.21.15.156:0/1217019739 >> v1:172.21.15.156:6816/118236 conn(0x7f294402c1e0 legacy=0x7f294402e690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:18:33.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.923+0000 7f2968bab700 1 -- 172.21.15.156:0/1217019739 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f296409bc70 msgr2=0x7f29641cc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:33.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.923+0000 7f2968bab700 1 --2- 172.21.15.156:0/1217019739 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f296409bc70 0x7f29641cc950 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f295400b520 tx=0x7f295400b830 comp rx=0 tx=0).stop 2023-09-30T22:18:33.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.923+0000 7f2962d9d700 1 -- 172.21.15.156:0/1217019739 reap_dead start 2023-09-30T22:18:33.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.924+0000 7f2968bab700 1 -- 172.21.15.156:0/1217019739 shutdown_connections 2023-09-30T22:18:33.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.924+0000 7f2968bab700 1 -- 172.21.15.156:0/1217019739 >> 172.21.15.156:0/1217019739 conn(0x7f29640a2980 msgr2=0x7f296409d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:33.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.924+0000 7f2968bab700 1 -- 172.21.15.156:0/1217019739 shutdown_connections 2023-09-30T22:18:33.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:33.925+0000 7f2968bab700 1 -- 172.21.15.156:0/1217019739 wait complete. 2023-09-30T22:18:33.936 INFO:teuthology.orchestra.run.smithi156.stdout:38654705692 2023-09-30T22:18:33.937 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:18:33.940 INFO:teuthology.orchestra.run.smithi156.stdout:38654705692 2023-09-30T22:18:33.940 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:18:33.977 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:33.976+0000 7f82ca115240 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-30T22:18:34.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.042+0000 7f79fa172700 1 Processor -- start 2023-09-30T22:18:34.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.042+0000 7f79fa172700 1 -- start start 2023-09-30T22:18:34.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.043+0000 7f79fa172700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f79f40a0a30 0x7f79f40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:34.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.043+0000 7f79fa172700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79f40a1340 0x7f79f412ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:34.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.043+0000 7f79fa172700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f40a1e70 con 0x7f79f41304a0 2023-09-30T22:18:34.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.043+0000 7f79fa172700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f409a720 con 0x7f79f40a0a30 2023-09-30T22:18:34.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.043+0000 7f79fa172700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79f409b300 con 0x7f79f40a1340 2023-09-30T22:18:34.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.044+0000 7f79f2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79f40a1340 0x7f79f412ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:34.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.044+0000 7f79f2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79f40a1340 0x7f79f412ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34676/0 (socket says 172.21.15.156:34676) 2023-09-30T22:18:34.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.044+0000 7f79f2ffd700 1 -- 172.21.15.156:0/3648816291 learned_addr learned my addr 172.21.15.156:0/3648816291 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:34.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.044+0000 7f79f3fff700 1 --1- 172.21.15.156:0/3648816291 >> v1:172.21.15.156:6789/0 conn(0x7f79f41304a0 0x7f79f41371b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:42548/0 (socket says 172.21.15.156:42548) 2023-09-30T22:18:34.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.044+0000 7f79f37fe700 1 --2- 172.21.15.156:0/3648816291 >> v2:172.21.15.156:3300/0 conn(0x7f79f40a0a30 0x7f79f40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:34.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.044+0000 7f79f37fe700 1 -- 172.21.15.156:0/3648816291 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79f40a1340 msgr2=0x7f79f412ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:34.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.044+0000 7f79f37fe700 1 --2- 172.21.15.156:0/3648816291 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79f40a1340 0x7f79f412ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.044+0000 7f79f37fe700 1 -- 172.21.15.156:0/3648816291 >> v1:172.21.15.156:6789/0 conn(0x7f79f41304a0 legacy=0x7f79f41371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:34.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.044+0000 7f79f37fe700 1 -- 172.21.15.156:0/3648816291 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f409abc0 con 0x7f79f40a0a30 2023-09-30T22:18:34.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.048+0000 7f79f37fe700 1 --2- 172.21.15.156:0/3648816291 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79f40a0a30 0x7f79f40a0e00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f79e400dde0 tx=0x7f79e400f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475e3ef9db79306c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:34.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.048+0000 7f79f27fc700 1 -- 172.21.15.156:0/3648816291 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4012070 con 0x7f79f40a0a30 2023-09-30T22:18:34.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.048+0000 7f79f27fc700 1 -- 172.21.15.156:0/3648816291 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e400fbd0 con 0x7f79f40a0a30 2023-09-30T22:18:34.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.048+0000 7f79f27fc700 1 -- 172.21.15.156:0/3648816291 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4016430 con 0x7f79f40a0a30 2023-09-30T22:18:34.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.049+0000 7f79fa172700 1 -- 172.21.15.156:0/3648816291 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79f40a0a30 msgr2=0x7f79f40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:34.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.049+0000 7f79fa172700 1 --2- 172.21.15.156:0/3648816291 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79f40a0a30 0x7f79f40a0e00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f79e400dde0 tx=0x7f79e400f330 comp rx=0 tx=0).stop 2023-09-30T22:18:34.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.049+0000 7f79fa172700 1 -- 172.21.15.156:0/3648816291 shutdown_connections 2023-09-30T22:18:34.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.049+0000 7f79fa172700 1 --2- 172.21.15.156:0/3648816291 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79f40a0a30 0x7f79f40a0e00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.049+0000 7f79fa172700 1 --2- 172.21.15.156:0/3648816291 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79f40a1340 0x7f79f412ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.049+0000 7f79fa172700 1 -- 172.21.15.156:0/3648816291 >> 172.21.15.156:0/3648816291 conn(0x7f79f40a2980 msgr2=0x7f79f40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:34.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.049+0000 7f79fa172700 1 -- 172.21.15.156:0/3648816291 shutdown_connections 2023-09-30T22:18:34.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.049+0000 7f79fa172700 1 -- 172.21.15.156:0/3648816291 wait complete. 2023-09-30T22:18:34.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.050+0000 7f79fa172700 1 Processor -- start 2023-09-30T22:18:34.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.051+0000 7f79fa172700 1 -- start start 2023-09-30T22:18:34.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.051+0000 7f79fa172700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79f40a0a30 0x7f79f4119c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:34.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.051+0000 7f79fa172700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79f40a1340 0x7f79f411a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:34.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.051+0000 7f79fa172700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79f41304a0 0x7f79f41c3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:34.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.051+0000 7f79fa172700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f411c010 con 0x7f79f40a0a30 2023-09-30T22:18:34.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.051+0000 7f79fa172700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f411cc80 con 0x7f79f40a1340 2023-09-30T22:18:34.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.051+0000 7f79fa172700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79f4119820 con 0x7f79f41304a0 2023-09-30T22:18:34.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.052+0000 7f79f37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79f40a0a30 0x7f79f4119c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:34.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.052+0000 7f79f37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79f40a0a30 0x7f79f4119c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39336/0 (socket says 172.21.15.156:39336) 2023-09-30T22:18:34.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.052+0000 7f79f37fe700 1 -- 172.21.15.156:0/1889533454 learned_addr learned my addr 172.21.15.156:0/1889533454 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:34.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.052+0000 7f79f2ffd700 1 --2- 172.21.15.156:0/1889533454 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79f40a1340 0x7f79f411a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:34.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.052+0000 7f79f3fff700 1 --2- 172.21.15.156:0/1889533454 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79f41304a0 0x7f79f41c3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:34.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.052+0000 7f79f37fe700 1 -- 172.21.15.156:0/1889533454 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79f41304a0 msgr2=0x7f79f41c3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:34.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.052+0000 7f79f37fe700 1 --2- 172.21.15.156:0/1889533454 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79f41304a0 0x7f79f41c3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.052+0000 7f79f37fe700 1 -- 172.21.15.156:0/1889533454 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79f40a1340 msgr2=0x7f79f411a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:34.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.052+0000 7f79f37fe700 1 --2- 172.21.15.156:0/1889533454 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79f40a1340 0x7f79f411a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.052+0000 7f79f37fe700 1 -- 172.21.15.156:0/1889533454 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e400da70 con 0x7f79f40a0a30 2023-09-30T22:18:34.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.052+0000 7f79f2ffd700 1 --2- 172.21.15.156:0/1889533454 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79f40a1340 0x7f79f411a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:34.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.052+0000 7f79f37fe700 1 --2- 172.21.15.156:0/1889533454 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79f40a0a30 0x7f79f4119c50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f79e400f370 tx=0x7f79e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:34.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.053+0000 7f79dbfff700 1 -- 172.21.15.156:0/1889533454 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4003ab0 con 0x7f79f40a0a30 2023-09-30T22:18:34.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.053+0000 7f79dbfff700 1 -- 172.21.15.156:0/1889533454 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e4024070 con 0x7f79f40a0a30 2023-09-30T22:18:34.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.053+0000 7f79dbfff700 1 -- 172.21.15.156:0/1889533454 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4003e70 con 0x7f79f40a0a30 2023-09-30T22:18:34.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.053+0000 7f79fa172700 1 -- 172.21.15.156:0/1889533454 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f411af70 con 0x7f79f40a0a30 2023-09-30T22:18:34.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.053+0000 7f79fa172700 1 -- 172.21.15.156:0/1889533454 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f409ae00 con 0x7f79f40a0a30 2023-09-30T22:18:34.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.054+0000 7f79dbfff700 1 -- 172.21.15.156:0/1889533454 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f79e40165e0 con 0x7f79f40a0a30 2023-09-30T22:18:34.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.054+0000 7f79fa172700 1 -- 172.21.15.156:0/1889533454 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f411d6d0 con 0x7f79f40a0a30 2023-09-30T22:18:34.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.055+0000 7f79dbfff700 1 -- 172.21.15.156:0/1889533454 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f79e4026070 con 0x7f79f40a0a30 2023-09-30T22:18:34.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.055+0000 7f79f2ffd700 1 -- 172.21.15.156:0/1889533454 >> v1:172.21.15.156:6816/118236 conn(0x7f79e002c1b0 legacy=0x7f79e002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/118236 2023-09-30T22:18:34.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.059+0000 7f79dbfff700 1 -- 172.21.15.156:0/1889533454 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f79e402b480 con 0x7f79f40a0a30 2023-09-30T22:18:34.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.064+0000 7f1d2eb43700 1 Processor -- start 2023-09-30T22:18:34.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.064+0000 7f1d2eb43700 1 -- start start 2023-09-30T22:18:34.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.064+0000 7f1d2eb43700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1d28138410 0x7f1d280a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:34.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.064+0000 7f1d2eb43700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d2813dd10 0x7f1d281400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:34.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.064+0000 7f1d2eb43700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d281379e0 con 0x7f1d28138040 2023-09-30T22:18:34.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.064+0000 7f1d2eb43700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d280a2100 con 0x7f1d28138410 2023-09-30T22:18:34.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.064+0000 7f1d2eb43700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2809b9b0 con 0x7f1d2813dd10 2023-09-30T22:18:34.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.065+0000 7f1d27fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1d28138410 0x7f1d280a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:34.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.065+0000 7f1d27fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1d28138410 0x7f1d280a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39344/0 (socket says 172.21.15.156:39344) 2023-09-30T22:18:34.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.065+0000 7f1d27fff700 1 -- 172.21.15.156:0/125821950 learned_addr learned my addr 172.21.15.156:0/125821950 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:34.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.065+0000 7f1d2d0e0700 1 --2- 172.21.15.156:0/125821950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d2813dd10 0x7f1d281400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:34.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.065+0000 7f1d27fff700 1 -- 172.21.15.156:0/125821950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d2813dd10 msgr2=0x7f1d281400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:34.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.065+0000 7f1d27fff700 1 --2- 172.21.15.156:0/125821950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d2813dd10 0x7f1d281400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.065+0000 7f1d27fff700 1 -- 172.21.15.156:0/125821950 >> v1:172.21.15.156:6789/0 conn(0x7f1d28138040 legacy=0x7f1d280a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:34.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.065+0000 7f1d27fff700 1 -- 172.21.15.156:0/125821950 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d28137c10 con 0x7f1d28138410 2023-09-30T22:18:34.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.065+0000 7f1d27fff700 1 --2- 172.21.15.156:0/125821950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d28138410 0x7f1d280a0ff0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1d140098f0 tx=0x7f1d14009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9161044aab78286 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:34.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.066+0000 7f1d277fe700 1 -- 172.21.15.156:0/125821950 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1400b8a0 con 0x7f1d28138410 2023-09-30T22:18:34.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.066+0000 7f1d277fe700 1 -- 172.21.15.156:0/125821950 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1400ba00 con 0x7f1d28138410 2023-09-30T22:18:34.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.066+0000 7f1d277fe700 1 -- 172.21.15.156:0/125821950 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1400bd90 con 0x7f1d28138410 2023-09-30T22:18:34.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.066+0000 7f1d2eb43700 1 -- 172.21.15.156:0/125821950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d28138410 msgr2=0x7f1d280a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:34.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.066+0000 7f1d2eb43700 1 --2- 172.21.15.156:0/125821950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d28138410 0x7f1d280a0ff0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1d140098f0 tx=0x7f1d14009c00 comp rx=0 tx=0).stop 2023-09-30T22:18:34.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.066+0000 7f1d2eb43700 1 -- 172.21.15.156:0/125821950 shutdown_connections 2023-09-30T22:18:34.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.066+0000 7f1d2eb43700 1 --2- 172.21.15.156:0/125821950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d2813dd10 0x7f1d281400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.066+0000 7f1d2eb43700 1 --2- 172.21.15.156:0/125821950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d28138410 0x7f1d280a0ff0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.066+0000 7f1d2eb43700 1 -- 172.21.15.156:0/125821950 >> 172.21.15.156:0/125821950 conn(0x7f1d280a2980 msgr2=0x7f1d280a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:34.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.067+0000 7f1d2eb43700 1 -- 172.21.15.156:0/125821950 shutdown_connections 2023-09-30T22:18:34.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.067+0000 7f1d2eb43700 1 -- 172.21.15.156:0/125821950 wait complete. 2023-09-30T22:18:34.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.067+0000 7f1d2eb43700 1 Processor -- start 2023-09-30T22:18:34.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.068+0000 7f1d2eb43700 1 -- start start 2023-09-30T22:18:34.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.068+0000 7f1d2eb43700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d28138040 0x7f1d2813b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:34.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.068+0000 7f1d2eb43700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d28138410 0x7f1d28137090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:34.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.068+0000 7f1d2eb43700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d2813dd10 0x7f1d28135730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:34.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.068+0000 7f1d2eb43700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2813cff0 con 0x7f1d28138040 2023-09-30T22:18:34.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.068+0000 7f1d2eb43700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2809e8b0 con 0x7f1d2813dd10 2023-09-30T22:18:34.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.068+0000 7f1d2eb43700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2809a240 con 0x7f1d28138410 2023-09-30T22:18:34.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.068+0000 7f1d2c8df700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d28138040 0x7f1d2813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:34.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.068+0000 7f1d2d0e0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d2813dd10 0x7f1d28135730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:34.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.068+0000 7f1d2c8df700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d28138040 0x7f1d2813b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39348/0 (socket says 172.21.15.156:39348) 2023-09-30T22:18:34.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.068+0000 7f1d2c8df700 1 -- 172.21.15.156:0/1149602608 learned_addr learned my addr 172.21.15.156:0/1149602608 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:34.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.069+0000 7f1d27fff700 1 --2- 172.21.15.156:0/1149602608 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d28138410 0x7f1d28137090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:34.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.069+0000 7f1d2d0e0700 1 -- 172.21.15.156:0/1149602608 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d28138410 msgr2=0x7f1d28137090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:34.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.069+0000 7f1d2d0e0700 1 --2- 172.21.15.156:0/1149602608 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d28138410 0x7f1d28137090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.069+0000 7f1d2d0e0700 1 -- 172.21.15.156:0/1149602608 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d28138040 msgr2=0x7f1d2813b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:34.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.069+0000 7f1d2d0e0700 1 --2- 172.21.15.156:0/1149602608 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d28138040 0x7f1d2813b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.069+0000 7f1d2d0e0700 1 -- 172.21.15.156:0/1149602608 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d14009550 con 0x7f1d2813dd10 2023-09-30T22:18:34.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.069+0000 7f1d2d0e0700 1 --2- 172.21.15.156:0/1149602608 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d2813dd10 0x7f1d28135730 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1d2809a9d0 tx=0x7f1d2000e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:34.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.069+0000 7f1d257fa700 1 -- 172.21.15.156:0/1149602608 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d20018070 con 0x7f1d2813dd10 2023-09-30T22:18:34.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.069+0000 7f1d2eb43700 1 -- 172.21.15.156:0/1149602608 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d281198c0 con 0x7f1d2813dd10 2023-09-30T22:18:34.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.069+0000 7f1d2eb43700 1 -- 172.21.15.156:0/1149602608 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d2813c340 con 0x7f1d2813dd10 2023-09-30T22:18:34.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.070+0000 7f1d257fa700 1 -- 172.21.15.156:0/1149602608 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d20007e80 con 0x7f1d2813dd10 2023-09-30T22:18:34.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.070+0000 7f1d257fa700 1 -- 172.21.15.156:0/1149602608 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2000ee20 con 0x7f1d2813dd10 2023-09-30T22:18:34.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.071+0000 7f1d257fa700 1 -- 172.21.15.156:0/1149602608 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f1d20014420 con 0x7f1d2813dd10 2023-09-30T22:18:34.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.071+0000 7f1d257fa700 1 -- 172.21.15.156:0/1149602608 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f1d2003b4e0 con 0x7f1d2813dd10 2023-09-30T22:18:34.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.071+0000 7f1d2c8df700 1 -- 172.21.15.156:0/1149602608 >> v1:172.21.15.156:6816/118236 conn(0x7f1d0c02c1b0 legacy=0x7f1d0c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/118236 2023-09-30T22:18:34.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.071+0000 7f1d2eb43700 1 -- 172.21.15.156:0/1149602608 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d2813da30 con 0x7f1d2813dd10 2023-09-30T22:18:34.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.079+0000 7f1d257fa700 1 -- 172.21.15.156:0/1149602608 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f1d2813da30 con 0x7f1d2813dd10 2023-09-30T22:18:34.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.168+0000 7fea1f5b2700 1 Processor -- start 2023-09-30T22:18:34.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.168+0000 7fea1f5b2700 1 -- start start 2023-09-30T22:18:34.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.169+0000 7fea1f5b2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea1809d860 0x7fea1809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:34.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.169+0000 7fea1f5b2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea18130eb0 0x7fea18138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:34.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.169+0000 7fea1f5b2700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1809aaa0 con 0x7fea1809e170 2023-09-30T22:18:34.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.169+0000 7fea1f5b2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1809f870 con 0x7fea18130eb0 2023-09-30T22:18:34.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.169+0000 7fea1f5b2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea1809b360 con 0x7fea1809d860 2023-09-30T22:18:34.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.169+0000 7fea1cb4d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fea1809e170 0x7fea181307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:42566/0 (socket says 172.21.15.156:42566) 2023-09-30T22:18:34.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.169+0000 7fea1cb4d700 1 -- 172.21.15.156:0/208265012 learned_addr learned my addr 172.21.15.156:0/208265012 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:18:34.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.169+0000 7fea1db4f700 1 --2- 172.21.15.156:0/208265012 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea18130eb0 0x7fea18138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:34.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.169+0000 7fea1d34e700 1 --2- 172.21.15.156:0/208265012 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea1809d860 0x7fea1809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:34.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.170+0000 7fea0ffff700 1 -- 172.21.15.156:0/208265012 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1630346326 0 0) 0x7fea1809aaa0 con 0x7fea1809e170 2023-09-30T22:18:34.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.170+0000 7fea0ffff700 1 -- 172.21.15.156:0/208265012 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea040035b0 con 0x7fea1809e170 2023-09-30T22:18:34.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.170+0000 7fea1db4f700 1 -- 172.21.15.156:0/208265012 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea1809d860 msgr2=0x7fea1809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:34.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.170+0000 7fea1db4f700 1 --2- 172.21.15.156:0/208265012 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea1809d860 0x7fea1809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.170+0000 7fea1db4f700 1 -- 172.21.15.156:0/208265012 >> v1:172.21.15.156:6789/0 conn(0x7fea1809e170 legacy=0x7fea181307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:34.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.170+0000 7fea1db4f700 1 -- 172.21.15.156:0/208265012 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1809b620 con 0x7fea18130eb0 2023-09-30T22:18:34.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.170+0000 7fea1d34e700 1 --2- 172.21.15.156:0/208265012 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea1809d860 0x7fea1809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:34.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.170+0000 7fea1db4f700 1 --2- 172.21.15.156:0/208265012 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea18130eb0 0x7fea18138a00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fea1000be60 tx=0x7fea100092f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f00f57f73e796cf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:34.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.170+0000 7fea0ffff700 1 -- 172.21.15.156:0/208265012 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1000c890 con 0x7fea18130eb0 2023-09-30T22:18:34.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.170+0000 7fea0ffff700 1 -- 172.21.15.156:0/208265012 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1000c9f0 con 0x7fea18130eb0 2023-09-30T22:18:34.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.170+0000 7fea0ffff700 1 -- 172.21.15.156:0/208265012 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1000cda0 con 0x7fea18130eb0 2023-09-30T22:18:34.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.171+0000 7fea1f5b2700 1 -- 172.21.15.156:0/208265012 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea18130eb0 msgr2=0x7fea18138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:34.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.171+0000 7fea1f5b2700 1 --2- 172.21.15.156:0/208265012 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea18130eb0 0x7fea18138a00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fea1000be60 tx=0x7fea100092f0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.171+0000 7fea1f5b2700 1 -- 172.21.15.156:0/208265012 shutdown_connections 2023-09-30T22:18:34.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.171+0000 7fea1f5b2700 1 --2- 172.21.15.156:0/208265012 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea18130eb0 0x7fea18138a00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.171+0000 7fea1f5b2700 1 --2- 172.21.15.156:0/208265012 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea1809d860 0x7fea1809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.171+0000 7fea1f5b2700 1 -- 172.21.15.156:0/208265012 >> 172.21.15.156:0/208265012 conn(0x7fea18099c40 msgr2=0x7fea180a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:34.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.171+0000 7fea1f5b2700 1 -- 172.21.15.156:0/208265012 shutdown_connections 2023-09-30T22:18:34.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.171+0000 7fea1f5b2700 1 -- 172.21.15.156:0/208265012 wait complete. 2023-09-30T22:18:34.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.172+0000 7fea1f5b2700 1 Processor -- start 2023-09-30T22:18:34.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.172+0000 7fea1f5b2700 1 -- start start 2023-09-30T22:18:34.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.173+0000 7fea1f5b2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea1809d860 0x7fea1811e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:34.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.173+0000 7fea1f5b2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea1809e170 0x7fea1811e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:34.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.173+0000 7fea1f5b2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea18130eb0 0x7fea1811ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:34.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.173+0000 7fea1f5b2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1809c8b0 con 0x7fea18130eb0 2023-09-30T22:18:34.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.173+0000 7fea1f5b2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea180a1f40 con 0x7fea1809d860 2023-09-30T22:18:34.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.173+0000 7fea1f5b2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea18120d20 con 0x7fea1809e170 2023-09-30T22:18:34.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.173+0000 7fea1cb4d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea1809e170 0x7fea1811e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:34.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.173+0000 7fea1cb4d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea1809e170 0x7fea1811e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34730/0 (socket says 172.21.15.156:34730) 2023-09-30T22:18:34.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.173+0000 7fea1cb4d700 1 -- 172.21.15.156:0/2110980338 learned_addr learned my addr 172.21.15.156:0/2110980338 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:34.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.173+0000 7fea1db4f700 1 --2- 172.21.15.156:0/2110980338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea18130eb0 0x7fea1811ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:34.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.173+0000 7fea1d34e700 1 --2- 172.21.15.156:0/2110980338 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea1809d860 0x7fea1811e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:34.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.173+0000 7fea1cb4d700 1 -- 172.21.15.156:0/2110980338 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea1809d860 msgr2=0x7fea1811e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:34.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.173+0000 7fea1cb4d700 1 --2- 172.21.15.156:0/2110980338 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea1809d860 0x7fea1811e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.173+0000 7fea1cb4d700 1 -- 172.21.15.156:0/2110980338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea18130eb0 msgr2=0x7fea1811ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:34.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.173+0000 7fea1cb4d700 1 --2- 172.21.15.156:0/2110980338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea18130eb0 0x7fea1811ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.173+0000 7fea1cb4d700 1 -- 172.21.15.156:0/2110980338 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1400d940 con 0x7fea1809e170 2023-09-30T22:18:34.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.173+0000 7fea1db4f700 1 --2- 172.21.15.156:0/2110980338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea18130eb0 0x7fea1811ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:34.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.173+0000 7fea1cb4d700 1 --2- 172.21.15.156:0/2110980338 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea1809e170 0x7fea1811e830 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fea08005910 tx=0x7fea0800c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:34.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.174+0000 7fea0dffb700 1 -- 172.21.15.156:0/2110980338 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea08005b70 con 0x7fea1809e170 2023-09-30T22:18:34.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.174+0000 7fea0dffb700 1 -- 172.21.15.156:0/2110980338 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea08005cd0 con 0x7fea1809e170 2023-09-30T22:18:34.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.174+0000 7fea0dffb700 1 -- 172.21.15.156:0/2110980338 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea080072f0 con 0x7fea1809e170 2023-09-30T22:18:34.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.174+0000 7fea1f5b2700 1 -- 172.21.15.156:0/2110980338 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1000ba90 con 0x7fea1809e170 2023-09-30T22:18:34.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.174+0000 7fea1f5b2700 1 -- 172.21.15.156:0/2110980338 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea18121b30 con 0x7fea1809e170 2023-09-30T22:18:34.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.175+0000 7fe2325a1700 1 Processor -- start 2023-09-30T22:18:34.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.175+0000 7fe2325a1700 1 -- start start 2023-09-30T22:18:34.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.175+0000 7fea1f5b2700 1 -- 172.21.15.156:0/2110980338 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea18121cf0 con 0x7fea1809e170 2023-09-30T22:18:34.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.175+0000 7fea0dffb700 1 -- 172.21.15.156:0/2110980338 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fea08007450 con 0x7fea1809e170 2023-09-30T22:18:34.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.175+0000 7fea0dffb700 1 -- 172.21.15.156:0/2110980338 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fea0804bb10 con 0x7fea1809e170 2023-09-30T22:18:34.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.176+0000 7fea1d34e700 1 -- 172.21.15.156:0/2110980338 >> v1:172.21.15.156:6816/118236 conn(0x7fe9fc02c1b0 legacy=0x7fe9fc02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/118236 2023-09-30T22:18:34.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.176+0000 7fe2325a1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe22c09dde0 0x7fe22c09e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:34.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.176+0000 7fe2325a1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe22c09d680 0x7fe22c1341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:34.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.176+0000 7fe2325a1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe22c134710 0x7fe22c134b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:34.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.176+0000 7fe2325a1700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe22c09eee0 con 0x7fe22c134710 2023-09-30T22:18:34.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.176+0000 7fe2325a1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c1350d0 con 0x7fe22c09d680 2023-09-30T22:18:34.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.176+0000 7fe2325a1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c06b0a0 con 0x7fe22c09dde0 2023-09-30T22:18:34.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.176+0000 7fe23159f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe22c09dde0 0x7fe22c09e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:34.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.176+0000 7fe23159f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe22c09dde0 0x7fe22c09e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34734/0 (socket says 172.21.15.156:34734) 2023-09-30T22:18:34.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.176+0000 7fe23159f700 1 -- 172.21.15.156:0/2912397560 learned_addr learned my addr 172.21.15.156:0/2912397560 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:34.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.176+0000 7fe230d9e700 1 --2- 172.21.15.156:0/2912397560 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe22c09d680 0x7fe22c1341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:34.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.176+0000 7fe23159f700 1 -- 172.21.15.156:0/2912397560 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe22c09d680 msgr2=0x7fe22c1341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:34.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.176+0000 7fe23159f700 1 --2- 172.21.15.156:0/2912397560 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe22c09d680 0x7fe22c1341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.176+0000 7fe23159f700 1 -- 172.21.15.156:0/2912397560 >> v2:172.21.15.156:3300/0 conn(0x7fe22c134710 msgr2=0x7fe22c134b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:34.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.176+0000 7fe23159f700 1 --2- 172.21.15.156:0/2912397560 >> v2:172.21.15.156:3300/0 conn(0x7fe22c134710 0x7fe22c134b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.176+0000 7fe23159f700 1 -- 172.21.15.156:0/2912397560 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22c09aeb0 con 0x7fe22c09dde0 2023-09-30T22:18:34.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.176+0000 7fe23159f700 1 --2- 172.21.15.156:0/2912397560 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe22c09dde0 0x7fe22c09e1b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009920 tx=0x7fe21c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cab2b7d80bd827d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:34.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.183+0000 7fe223fff700 1 -- 172.21.15.156:0/2912397560 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c00ba20 con 0x7fe22c09dde0 2023-09-30T22:18:34.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.183+0000 7fe223fff700 1 -- 172.21.15.156:0/2912397560 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21c00bb80 con 0x7fe22c09dde0 2023-09-30T22:18:34.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.183+0000 7fe223fff700 1 -- 172.21.15.156:0/2912397560 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c009e70 con 0x7fe22c09dde0 2023-09-30T22:18:34.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.183+0000 7fea0dffb700 1 -- 172.21.15.156:0/2110980338 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fea0802c3b0 con 0x7fea1809e170 2023-09-30T22:18:34.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.184+0000 7fe2325a1700 1 -- 172.21.15.156:0/2912397560 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe22c09dde0 msgr2=0x7fe22c09e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:34.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.184+0000 7fe2325a1700 1 --2- 172.21.15.156:0/2912397560 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe22c09dde0 0x7fe22c09e1b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009920 tx=0x7fe21c009c30 comp rx=0 tx=0).stop 2023-09-30T22:18:34.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.184+0000 7fe2325a1700 1 -- 172.21.15.156:0/2912397560 shutdown_connections 2023-09-30T22:18:34.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.184+0000 7fe2325a1700 1 --2- 172.21.15.156:0/2912397560 >> v2:172.21.15.156:3300/0 conn(0x7fe22c134710 0x7fe22c134b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.184+0000 7fe2325a1700 1 --2- 172.21.15.156:0/2912397560 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe22c09dde0 0x7fe22c09e1b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.184+0000 7fe2325a1700 1 --2- 172.21.15.156:0/2912397560 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe22c09d680 0x7fe22c1341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.184+0000 7fe2325a1700 1 -- 172.21.15.156:0/2912397560 >> 172.21.15.156:0/2912397560 conn(0x7fe22c0a2d80 msgr2=0x7fe22c0a3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:34.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.185+0000 7fe2325a1700 1 -- 172.21.15.156:0/2912397560 shutdown_connections 2023-09-30T22:18:34.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.185+0000 7fe2325a1700 1 -- 172.21.15.156:0/2912397560 wait complete. 2023-09-30T22:18:34.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.186+0000 7fe2325a1700 1 Processor -- start 2023-09-30T22:18:34.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.186+0000 7fe2325a1700 1 -- start start 2023-09-30T22:18:34.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.186+0000 7fe2325a1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe22c09d680 0x7fe22c11a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:34.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.187+0000 7fe2325a1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe22c09dde0 0x7fe22c11a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:34.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.187+0000 7fe2325a1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe22c134710 0x7fe22c11aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:34.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.187+0000 7fe2325a1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c11b7f0 con 0x7fe22c134710 2023-09-30T22:18:34.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.187+0000 7fe2325a1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c09f020 con 0x7fe22c09dde0 2023-09-30T22:18:34.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.187+0000 7fe2325a1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c11c830 con 0x7fe22c09d680 2023-09-30T22:18:34.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.187+0000 7fe23159f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe22c09d680 0x7fe22c11a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:34.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.187+0000 7fe23159f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe22c09d680 0x7fe22c11a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34736/0 (socket says 172.21.15.156:34736) 2023-09-30T22:18:34.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.187+0000 7fe23159f700 1 -- 172.21.15.156:0/2470028573 learned_addr learned my addr 172.21.15.156:0/2470028573 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:34.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.187+0000 7fe231da0700 1 --2- 172.21.15.156:0/2470028573 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe22c134710 0x7fe22c11aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:34.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.187+0000 7fe23159f700 1 -- 172.21.15.156:0/2470028573 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe22c09dde0 msgr2=0x7fe22c11a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:34.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.187+0000 7fe23159f700 1 --2- 172.21.15.156:0/2470028573 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe22c09dde0 0x7fe22c11a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.187+0000 7fe23159f700 1 -- 172.21.15.156:0/2470028573 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe22c134710 msgr2=0x7fe22c11aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:34.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.187+0000 7fe23159f700 1 --2- 172.21.15.156:0/2470028573 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe22c134710 0x7fe22c11aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.187+0000 7fe23159f700 1 -- 172.21.15.156:0/2470028573 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21c009550 con 0x7fe22c09d680 2023-09-30T22:18:34.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.187+0000 7fe231da0700 1 --2- 172.21.15.156:0/2470028573 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe22c134710 0x7fe22c11aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:18:34.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.187+0000 7fe23159f700 1 --2- 172.21.15.156:0/2470028573 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe22c09d680 0x7fe22c11a420 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009c70 tx=0x7fe21c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:34.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.188+0000 7fe221ffb700 1 -- 172.21.15.156:0/2470028573 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c004590 con 0x7fe22c09d680 2023-09-30T22:18:34.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.188+0000 7fe221ffb700 1 -- 172.21.15.156:0/2470028573 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21c0036a0 con 0x7fe22c09d680 2023-09-30T22:18:34.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.188+0000 7fe221ffb700 1 -- 172.21.15.156:0/2470028573 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c003a50 con 0x7fe22c09d680 2023-09-30T22:18:34.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.188+0000 7fe2325a1700 1 -- 172.21.15.156:0/2470028573 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22c11bf10 con 0x7fe22c09d680 2023-09-30T22:18:34.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.188+0000 7fe2325a1700 1 -- 172.21.15.156:0/2470028573 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe22c125ff0 con 0x7fe22c09d680 2023-09-30T22:18:34.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.189+0000 7fe2325a1700 1 -- 172.21.15.156:0/2470028573 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe22c06b470 con 0x7fe22c09d680 2023-09-30T22:18:34.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.190+0000 7fe221ffb700 1 -- 172.21.15.156:0/2470028573 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fe21c003bb0 con 0x7fe22c09d680 2023-09-30T22:18:34.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.190+0000 7fe221ffb700 1 -- 172.21.15.156:0/2470028573 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fe21c03d040 con 0x7fe22c09d680 2023-09-30T22:18:34.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.194+0000 7fe230d9e700 1 -- 172.21.15.156:0/2470028573 >> v1:172.21.15.156:6816/118236 conn(0x7fe21002c1b0 legacy=0x7fe21002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/118236 2023-09-30T22:18:34.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.197+0000 7fe221ffb700 1 -- 172.21.15.156:0/2470028573 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fe21c003e60 con 0x7fe22c09d680 2023-09-30T22:18:34.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.242+0000 7f79fa172700 1 -- 172.21.15.156:0/1889533454 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f79f404f2a0 con 0x7f79f40a0a30 2023-09-30T22:18:34.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.242+0000 7f79dbfff700 1 -- 172.21.15.156:0/1889533454 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f79e4030020 con 0x7f79f40a0a30 2023-09-30T22:18:34.243 INFO:teuthology.orchestra.run.smithi156.stdout:38654705691 2023-09-30T22:18:34.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.244+0000 7f79fa172700 1 -- 172.21.15.156:0/1889533454 >> v1:172.21.15.156:6816/118236 conn(0x7f79e002c1b0 legacy=0x7f79e002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:18:34.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.244+0000 7f79fa172700 1 -- 172.21.15.156:0/1889533454 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79f40a0a30 msgr2=0x7f79f4119c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:34.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.244+0000 7f79fa172700 1 --2- 172.21.15.156:0/1889533454 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79f40a0a30 0x7f79f4119c50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f79e400f370 tx=0x7f79e4004750 comp rx=0 tx=0).stop 2023-09-30T22:18:34.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.244+0000 7f79fa172700 1 -- 172.21.15.156:0/1889533454 shutdown_connections 2023-09-30T22:18:34.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.244+0000 7f79fa172700 1 --2- 172.21.15.156:0/1889533454 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79f41304a0 0x7f79f41c3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.244+0000 7f79fa172700 1 --2- 172.21.15.156:0/1889533454 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79f40a0a30 0x7f79f4119c50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.244+0000 7f79fa172700 1 --2- 172.21.15.156:0/1889533454 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79f40a1340 0x7f79f411a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.244+0000 7f79fa172700 1 -- 172.21.15.156:0/1889533454 >> 172.21.15.156:0/1889533454 conn(0x7f79f40a2980 msgr2=0x7f79f412e480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:34.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.244+0000 7f79fa172700 1 -- 172.21.15.156:0/1889533454 shutdown_connections 2023-09-30T22:18:34.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.244+0000 7f79fa172700 1 -- 172.21.15.156:0/1889533454 wait complete. 2023-09-30T22:18:34.258 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705691 for osd.0 2023-09-30T22:18:34.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.272+0000 7f1d2c8df700 1 -- 172.21.15.156:0/1149602608 >> v1:172.21.15.156:6816/118236 conn(0x7f1d0c02c1b0 legacy=0x7f1d0c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/118236 2023-09-30T22:18:34.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.330+0000 7f1d2eb43700 1 -- 172.21.15.156:0/1149602608 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1d2813c340 con 0x7f1d2813dd10 2023-09-30T22:18:34.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.331+0000 7f1d257fa700 1 -- 172.21.15.156:0/1149602608 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1d2813c340 con 0x7f1d2813dd10 2023-09-30T22:18:34.332 INFO:teuthology.orchestra.run.smithi156.stdout:38654705691 2023-09-30T22:18:34.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.334+0000 7f1d2eb43700 1 -- 172.21.15.156:0/1149602608 >> v1:172.21.15.156:6816/118236 conn(0x7f1d0c02c1b0 legacy=0x7f1d0c02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:18:34.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.334+0000 7f1d2eb43700 1 -- 172.21.15.156:0/1149602608 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d2813dd10 msgr2=0x7f1d28135730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:34.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.334+0000 7f1d2eb43700 1 --2- 172.21.15.156:0/1149602608 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d2813dd10 0x7f1d28135730 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1d2809a9d0 tx=0x7f1d2000e3c0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.334+0000 7f1d2eb43700 1 -- 172.21.15.156:0/1149602608 shutdown_connections 2023-09-30T22:18:34.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.334+0000 7f1d2eb43700 1 --2- 172.21.15.156:0/1149602608 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d2813dd10 0x7f1d28135730 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.334+0000 7f1d2eb43700 1 --2- 172.21.15.156:0/1149602608 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d28138040 0x7f1d2813b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.334+0000 7f1d2eb43700 1 --2- 172.21.15.156:0/1149602608 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d28138410 0x7f1d28137090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.334+0000 7f1d2eb43700 1 -- 172.21.15.156:0/1149602608 >> 172.21.15.156:0/1149602608 conn(0x7f1d280a2980 msgr2=0x7f1d2813e380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:34.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.334+0000 7f1d2eb43700 1 -- 172.21.15.156:0/1149602608 shutdown_connections 2023-09-30T22:18:34.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.334+0000 7f1d2eb43700 1 -- 172.21.15.156:0/1149602608 wait complete. 2023-09-30T22:18:34.344 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:34.343+0000 7f82ca115240 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-30T22:18:34.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705691 for osd.3 2023-09-30T22:18:34.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.358+0000 7fea1f5b2700 1 -- 172.21.15.156:0/2110980338 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fea1804f2a0 con 0x7fea1809e170 2023-09-30T22:18:34.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.358+0000 7fea0dffb700 1 -- 172.21.15.156:0/2110980338 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fea08028030 con 0x7fea1809e170 2023-09-30T22:18:34.359 INFO:teuthology.orchestra.run.smithi156.stdout:38654705691 2023-09-30T22:18:34.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.360+0000 7fea1f5b2700 1 -- 172.21.15.156:0/2110980338 >> v1:172.21.15.156:6816/118236 conn(0x7fe9fc02c1b0 legacy=0x7fe9fc02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:18:34.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.360+0000 7fea1f5b2700 1 -- 172.21.15.156:0/2110980338 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea1809e170 msgr2=0x7fea1811e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:34.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.360+0000 7fea1f5b2700 1 --2- 172.21.15.156:0/2110980338 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea1809e170 0x7fea1811e830 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fea08005910 tx=0x7fea0800c9e0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.360+0000 7fea1f5b2700 1 -- 172.21.15.156:0/2110980338 shutdown_connections 2023-09-30T22:18:34.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.360+0000 7fea1f5b2700 1 --2- 172.21.15.156:0/2110980338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea18130eb0 0x7fea1811ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.360+0000 7fea1f5b2700 1 --2- 172.21.15.156:0/2110980338 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea1809d860 0x7fea1811e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.360+0000 7fea1f5b2700 1 --2- 172.21.15.156:0/2110980338 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea1809e170 0x7fea1811e830 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.360+0000 7fea1f5b2700 1 -- 172.21.15.156:0/2110980338 >> 172.21.15.156:0/2110980338 conn(0x7fea18099c40 msgr2=0x7fea180a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:34.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.360+0000 7fea1f5b2700 1 -- 172.21.15.156:0/2110980338 shutdown_connections 2023-09-30T22:18:34.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.360+0000 7fea1f5b2700 1 -- 172.21.15.156:0/2110980338 wait complete. 2023-09-30T22:18:34.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705691 for osd.2 2023-09-30T22:18:34.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.396+0000 7fe230d9e700 1 -- 172.21.15.156:0/2470028573 >> v1:172.21.15.156:6816/118236 conn(0x7fe21002c1b0 legacy=0x7fe21002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/118236 2023-09-30T22:18:34.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.439+0000 7fe2325a1700 1 -- 172.21.15.156:0/2470028573 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe22c06b470 con 0x7fe22c09d680 2023-09-30T22:18:34.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.439+0000 7fe221ffb700 1 -- 172.21.15.156:0/2470028573 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe22c06b470 con 0x7fe22c09d680 2023-09-30T22:18:34.440 INFO:teuthology.orchestra.run.smithi156.stdout:38654705691 2023-09-30T22:18:34.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.441+0000 7fe2325a1700 1 -- 172.21.15.156:0/2470028573 >> v1:172.21.15.156:6816/118236 conn(0x7fe21002c1b0 legacy=0x7fe21002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:18:34.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.441+0000 7fe2325a1700 1 -- 172.21.15.156:0/2470028573 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe22c09d680 msgr2=0x7fe22c11a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:34.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.441+0000 7fe2325a1700 1 --2- 172.21.15.156:0/2470028573 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe22c09d680 0x7fe22c11a420 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009c70 tx=0x7fe21c004750 comp rx=0 tx=0).stop 2023-09-30T22:18:34.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.441+0000 7fe2325a1700 1 -- 172.21.15.156:0/2470028573 shutdown_connections 2023-09-30T22:18:34.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.441+0000 7fe2325a1700 1 --2- 172.21.15.156:0/2470028573 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe22c134710 0x7fe22c11aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.441+0000 7fe2325a1700 1 --2- 172.21.15.156:0/2470028573 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe22c09d680 0x7fe22c11a420 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.441+0000 7fe2325a1700 1 --2- 172.21.15.156:0/2470028573 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe22c09dde0 0x7fe22c11a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:34.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.441+0000 7fe2325a1700 1 -- 172.21.15.156:0/2470028573 >> 172.21.15.156:0/2470028573 conn(0x7fe22c0a2d80 msgr2=0x7fe22c0a1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:34.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.441+0000 7fe2325a1700 1 -- 172.21.15.156:0/2470028573 shutdown_connections 2023-09-30T22:18:34.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:34.441+0000 7fe2325a1700 1 -- 172.21.15.156:0/2470028573 wait complete. 2023-09-30T22:18:34.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705691 for osd.1 2023-09-30T22:18:34.491 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:34.490+0000 7f82ca115240 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-30T22:18:34.564 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:34.563+0000 7f82ca115240 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-30T22:18:34.697 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:34.696+0000 7f82ca115240 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-30T22:18:34.769 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:34.768+0000 7f82ca115240 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-30T22:18:34.929 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:34.928+0000 7f82ca115240 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-30T22:18:35.007 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:35.007+0000 7f82ca115240 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-30T22:18:35.085 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:35.084+0000 7f82ca115240 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-30T22:18:35.178 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:35.177+0000 7f82ca115240 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-30T22:18:35.259 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:18:35.349 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:18:35.374 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:18:35.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.391+0000 7f25a1cf4700 1 Processor -- start 2023-09-30T22:18:35.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.391+0000 7f25a1cf4700 1 -- start start 2023-09-30T22:18:35.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.392+0000 7f25a1cf4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f259c09e870 0x7f259c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:35.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.392+0000 7f25a1cf4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f259c09f180 0x7f259c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:35.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.392+0000 7f25a1cf4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f259c131d70 0x7f259c132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:35.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.392+0000 7f25a1cf4700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f259c0a0920 con 0x7f259c131d70 2023-09-30T22:18:35.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.392+0000 7f25a1cf4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259c09c970 con 0x7f259c09e870 2023-09-30T22:18:35.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.392+0000 7f25a1cf4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f259c09bab0 con 0x7f259c09f180 2023-09-30T22:18:35.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.392+0000 7f259affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f259c09f180 0x7f259c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:35.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.392+0000 7f259bfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f259c131d70 0x7f259c132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:35.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.392+0000 7f259bfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f259c131d70 0x7f259c132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39382/0 (socket says 172.21.15.156:39382) 2023-09-30T22:18:35.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.392+0000 7f259bfff700 1 -- 172.21.15.156:0/3196052291 learned_addr learned my addr 172.21.15.156:0/3196052291 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:35.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.392+0000 7f259affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f259c09f180 0x7f259c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34748/0 (socket says 172.21.15.156:34748) 2023-09-30T22:18:35.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.392+0000 7f259b7fe700 1 --2- 172.21.15.156:0/3196052291 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f259c09e870 0x7f259c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:35.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.392+0000 7f259bfff700 1 -- 172.21.15.156:0/3196052291 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f259c09f180 msgr2=0x7f259c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:35.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.392+0000 7f259bfff700 1 --2- 172.21.15.156:0/3196052291 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f259c09f180 0x7f259c131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.392+0000 7f259bfff700 1 -- 172.21.15.156:0/3196052291 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f259c09e870 msgr2=0x7f259c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:35.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.392+0000 7f259bfff700 1 --2- 172.21.15.156:0/3196052291 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f259c09e870 0x7f259c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.392+0000 7f259bfff700 1 -- 172.21.15.156:0/3196052291 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259c09f9c0 con 0x7f259c131d70 2023-09-30T22:18:35.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.392+0000 7f259b7fe700 1 --2- 172.21.15.156:0/3196052291 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f259c09e870 0x7f259c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:35.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.393+0000 7f259bfff700 1 --2- 172.21.15.156:0/3196052291 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f259c131d70 0x7f259c132210 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2594009e50 tx=0x7f259400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eac3af62ff541e90 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:35.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.393+0000 7f259a7fc700 1 -- 172.21.15.156:0/3196052291 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259400e070 con 0x7f259c131d70 2023-09-30T22:18:35.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.393+0000 7f259a7fc700 1 -- 172.21.15.156:0/3196052291 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259400b910 con 0x7f259c131d70 2023-09-30T22:18:35.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.393+0000 7f259a7fc700 1 -- 172.21.15.156:0/3196052291 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259400bcc0 con 0x7f259c131d70 2023-09-30T22:18:35.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.393+0000 7f25a1cf4700 1 -- 172.21.15.156:0/3196052291 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f259c131d70 msgr2=0x7f259c132210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:35.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.393+0000 7f25a1cf4700 1 --2- 172.21.15.156:0/3196052291 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f259c131d70 0x7f259c132210 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2594009e50 tx=0x7f259400b330 comp rx=0 tx=0).stop 2023-09-30T22:18:35.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.394+0000 7f25a1cf4700 1 -- 172.21.15.156:0/3196052291 shutdown_connections 2023-09-30T22:18:35.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.394+0000 7f25a1cf4700 1 --2- 172.21.15.156:0/3196052291 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f259c131d70 0x7f259c132210 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.394+0000 7f25a1cf4700 1 --2- 172.21.15.156:0/3196052291 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f259c09e870 0x7f259c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.394+0000 7f25a1cf4700 1 --2- 172.21.15.156:0/3196052291 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f259c09f180 0x7f259c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.394+0000 7f25a1cf4700 1 -- 172.21.15.156:0/3196052291 >> 172.21.15.156:0/3196052291 conn(0x7f259c0a4430 msgr2=0x7f259c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:35.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.394+0000 7f25a1cf4700 1 -- 172.21.15.156:0/3196052291 shutdown_connections 2023-09-30T22:18:35.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.395+0000 7f25a1cf4700 1 -- 172.21.15.156:0/3196052291 wait complete. 2023-09-30T22:18:35.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.396+0000 7f25a1cf4700 1 Processor -- start 2023-09-30T22:18:35.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.396+0000 7f25a1cf4700 1 -- start start 2023-09-30T22:18:35.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.397+0000 7f25a1cf4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f259c09e870 0x7f259c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:35.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.397+0000 7f25a1cf4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f259c09f180 0x7f259c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:35.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.397+0000 7f25a1cf4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f259c131d70 0x7f259c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:35.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.397+0000 7f25a1cf4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c124d00 con 0x7f259c09f180 2023-09-30T22:18:35.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.397+0000 7f25a1cf4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259c124490 con 0x7f259c131d70 2023-09-30T22:18:35.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.397+0000 7f25a1cf4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f259c130590 con 0x7f259c09e870 2023-09-30T22:18:35.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.397+0000 7f259b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f259c09e870 0x7f259c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:35.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.397+0000 7f259affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f259c09f180 0x7f259c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:35.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.397+0000 7f259b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f259c09e870 0x7f259c06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34750/0 (socket says 172.21.15.156:34750) 2023-09-30T22:18:35.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.397+0000 7f259b7fe700 1 -- 172.21.15.156:0/2203243564 learned_addr learned my addr 172.21.15.156:0/2203243564 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:35.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.397+0000 7f259bfff700 1 --2- 172.21.15.156:0/2203243564 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f259c131d70 0x7f259c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:35.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.397+0000 7f259b7fe700 1 -- 172.21.15.156:0/2203243564 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f259c131d70 msgr2=0x7f259c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:35.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.397+0000 7f259b7fe700 1 --2- 172.21.15.156:0/2203243564 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f259c131d70 0x7f259c06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.397+0000 7f259b7fe700 1 -- 172.21.15.156:0/2203243564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f259c09f180 msgr2=0x7f259c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:35.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.397+0000 7f259b7fe700 1 --2- 172.21.15.156:0/2203243564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f259c09f180 0x7f259c06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.397+0000 7f259b7fe700 1 -- 172.21.15.156:0/2203243564 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258c0094a0 con 0x7f259c09e870 2023-09-30T22:18:35.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.398+0000 7f259b7fe700 1 --2- 172.21.15.156:0/2203243564 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f259c09e870 0x7f259c06b8b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f258c00ebe0 tx=0x7f258c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:35.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.398+0000 7f2583fff700 1 -- 172.21.15.156:0/2203243564 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c009780 con 0x7f259c09e870 2023-09-30T22:18:35.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.398+0000 7f2583fff700 1 -- 172.21.15.156:0/2203243564 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258c00c850 con 0x7f259c09e870 2023-09-30T22:18:35.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.398+0000 7f25a1cf4700 1 -- 172.21.15.156:0/2203243564 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2594009b30 con 0x7f259c09e870 2023-09-30T22:18:35.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.398+0000 7f2583fff700 1 -- 172.21.15.156:0/2203243564 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c00cbe0 con 0x7f259c09e870 2023-09-30T22:18:35.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.398+0000 7f25a1cf4700 1 -- 172.21.15.156:0/2203243564 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f259c131830 con 0x7f259c09e870 2023-09-30T22:18:35.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.399+0000 7f2583fff700 1 -- 172.21.15.156:0/2203243564 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f258c00cd40 con 0x7f259c09e870 2023-09-30T22:18:35.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.399+0000 7f2583fff700 1 -- 172.21.15.156:0/2203243564 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f258c03bc60 con 0x7f259c09e870 2023-09-30T22:18:35.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.399+0000 7f259affd700 1 -- 172.21.15.156:0/2203243564 >> v1:172.21.15.156:6816/118236 conn(0x7f258802c1b0 legacy=0x7f258802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/118236 2023-09-30T22:18:35.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.399+0000 7f25a1cf4700 1 -- 172.21.15.156:0/2203243564 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f259c0a0270 con 0x7f259c09e870 2023-09-30T22:18:35.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.407+0000 7f2583fff700 1 -- 172.21.15.156:0/2203243564 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f258c017070 con 0x7f259c09e870 2023-09-30T22:18:35.455 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:18:35.462 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:35.462+0000 7f82ca115240 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-30T22:18:35.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.490+0000 7ff7f6eb0700 1 Processor -- start 2023-09-30T22:18:35.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.490+0000 7ff7f6eb0700 1 -- start start 2023-09-30T22:18:35.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.491+0000 7ff7f6eb0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff7f0138410 0x7ff7f00a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:35.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.491+0000 7ff7f6eb0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7f013dd10 0x7ff7f01400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:35.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.491+0000 7ff7f6eb0700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f01379e0 con 0x7ff7f0138040 2023-09-30T22:18:35.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.491+0000 7ff7f6eb0700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f00a2100 con 0x7ff7f0138410 2023-09-30T22:18:35.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.491+0000 7ff7f6eb0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f009b9b0 con 0x7ff7f013dd10 2023-09-30T22:18:35.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.491+0000 7ff7f544d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7f013dd10 0x7ff7f01400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:35.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.491+0000 7ff7f544d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7f013dd10 0x7ff7f01400f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34756/0 (socket says 172.21.15.156:34756) 2023-09-30T22:18:35.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.491+0000 7ff7f544d700 1 -- 172.21.15.156:0/4190171997 learned_addr learned my addr 172.21.15.156:0/4190171997 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:35.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.492+0000 7ff7f544d700 1 -- 172.21.15.156:0/4190171997 >> v2:172.21.15.156:3300/0 conn(0x7ff7f0138410 msgr2=0x7ff7f00a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:35.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.492+0000 7ff7f544d700 1 --2- 172.21.15.156:0/4190171997 >> v2:172.21.15.156:3300/0 conn(0x7ff7f0138410 0x7ff7f00a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.492+0000 7ff7f544d700 1 -- 172.21.15.156:0/4190171997 >> v1:172.21.15.156:6789/0 conn(0x7ff7f0138040 legacy=0x7ff7f00a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:35.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.492+0000 7ff7f544d700 1 -- 172.21.15.156:0/4190171997 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f0137c10 con 0x7ff7f013dd10 2023-09-30T22:18:35.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.492+0000 7ff7f544d700 1 --2- 172.21.15.156:0/4190171997 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7f013dd10 0x7ff7f01400f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8009e80 tx=0x7ff7e800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee49915206a4be43 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:35.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.492+0000 7ff7ef7fe700 1 -- 172.21.15.156:0/4190171997 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e800e070 con 0x7ff7f013dd10 2023-09-30T22:18:35.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.492+0000 7ff7ef7fe700 1 -- 172.21.15.156:0/4190171997 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e8003a20 con 0x7ff7f013dd10 2023-09-30T22:18:35.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.492+0000 7ff7ef7fe700 1 -- 172.21.15.156:0/4190171997 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8003dd0 con 0x7ff7f013dd10 2023-09-30T22:18:35.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.493+0000 7ff7f6eb0700 1 -- 172.21.15.156:0/4190171997 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7f013dd10 msgr2=0x7ff7f01400f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:35.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.493+0000 7ff7f6eb0700 1 --2- 172.21.15.156:0/4190171997 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7f013dd10 0x7ff7f01400f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8009e80 tx=0x7ff7e800b330 comp rx=0 tx=0).stop 2023-09-30T22:18:35.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.493+0000 7ff7f6eb0700 1 -- 172.21.15.156:0/4190171997 shutdown_connections 2023-09-30T22:18:35.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.493+0000 7ff7f6eb0700 1 --2- 172.21.15.156:0/4190171997 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7f013dd10 0x7ff7f01400f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.493+0000 7ff7f6eb0700 1 --2- 172.21.15.156:0/4190171997 >> v2:172.21.15.156:3300/0 conn(0x7ff7f0138410 0x7ff7f00a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.493+0000 7ff7f6eb0700 1 -- 172.21.15.156:0/4190171997 >> 172.21.15.156:0/4190171997 conn(0x7ff7f00a2980 msgr2=0x7ff7f00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:35.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.493+0000 7ff7f6eb0700 1 -- 172.21.15.156:0/4190171997 shutdown_connections 2023-09-30T22:18:35.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.493+0000 7ff7f6eb0700 1 -- 172.21.15.156:0/4190171997 wait complete. 2023-09-30T22:18:35.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.494+0000 7ff7f6eb0700 1 Processor -- start 2023-09-30T22:18:35.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.494+0000 7ff7f6eb0700 1 -- start start 2023-09-30T22:18:35.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.495+0000 7ff7f6eb0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7f0138040 0x7ff7f0121600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:35.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.495+0000 7ff7f6eb0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7f0138410 0x7ff7f0121b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:35.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.495+0000 7ff7f6eb0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7f013dd10 0x7ff7f0122080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:35.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.495+0000 7ff7f6eb0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f01229d0 con 0x7ff7f0138410 2023-09-30T22:18:35.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.495+0000 7ff7f6eb0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f009a240 con 0x7ff7f013dd10 2023-09-30T22:18:35.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.495+0000 7ff7f6eb0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f009f050 con 0x7ff7f0138040 2023-09-30T22:18:35.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.495+0000 7ff7f4c4c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7f0138040 0x7ff7f0121600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:35.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.495+0000 7ff7f4c4c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7f0138040 0x7ff7f0121600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34758/0 (socket says 172.21.15.156:34758) 2023-09-30T22:18:35.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.495+0000 7ff7f4c4c700 1 -- 172.21.15.156:0/810594931 learned_addr learned my addr 172.21.15.156:0/810594931 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:35.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.495+0000 7ff7f544d700 1 --2- 172.21.15.156:0/810594931 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7f013dd10 0x7ff7f0122080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:35.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.496+0000 7ff7f4c4c700 1 -- 172.21.15.156:0/810594931 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7f013dd10 msgr2=0x7ff7f0122080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:35.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.496+0000 7ff7f4c4c700 1 --2- 172.21.15.156:0/810594931 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7f013dd10 0x7ff7f0122080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.496+0000 7ff7f4c4c700 1 -- 172.21.15.156:0/810594931 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7f0138410 msgr2=0x7ff7f0121b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:35.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.496+0000 7ff7f4c4c700 1 --2- 172.21.15.156:0/810594931 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7f0138410 0x7ff7f0121b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.496+0000 7ff7f4c4c700 1 -- 172.21.15.156:0/810594931 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e8009b30 con 0x7ff7f0138040 2023-09-30T22:18:35.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.496+0000 7ff7f4c4c700 1 --2- 172.21.15.156:0/810594931 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7f0138040 0x7ff7f0121600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400c480 tx=0x7ff7e400c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:35.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.496+0000 7ff7ed7fa700 1 -- 172.21.15.156:0/810594931 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e400cea0 con 0x7ff7f0138040 2023-09-30T22:18:35.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.496+0000 7ff7ed7fa700 1 -- 172.21.15.156:0/810594931 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e4005500 con 0x7ff7f0138040 2023-09-30T22:18:35.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.496+0000 7ff7ed7fa700 1 -- 172.21.15.156:0/810594931 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e40038c0 con 0x7ff7f0138040 2023-09-30T22:18:35.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.497+0000 7ff7f6eb0700 1 -- 172.21.15.156:0/810594931 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f0124760 con 0x7ff7f0138040 2023-09-30T22:18:35.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.497+0000 7ff7f6eb0700 1 -- 172.21.15.156:0/810594931 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f01238b0 con 0x7ff7f0138040 2023-09-30T22:18:35.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.498+0000 7ff7ed7fa700 1 -- 172.21.15.156:0/810594931 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7ff7e4003a20 con 0x7ff7f0138040 2023-09-30T22:18:35.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.498+0000 7ff7ed7fa700 1 -- 172.21.15.156:0/810594931 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7ff7e403a980 con 0x7ff7f0138040 2023-09-30T22:18:35.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.498+0000 7ff7f6eb0700 1 -- 172.21.15.156:0/810594931 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f0124950 con 0x7ff7f0138040 2023-09-30T22:18:35.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.498+0000 7ff7effff700 1 -- 172.21.15.156:0/810594931 >> v1:172.21.15.156:6816/118236 conn(0x7ff7d402c1b0 legacy=0x7ff7d402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/118236 2023-09-30T22:18:35.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.506+0000 7ff7ed7fa700 1 -- 172.21.15.156:0/810594931 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7ff7e4018cd0 con 0x7ff7f0138040 2023-09-30T22:18:35.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.534+0000 7f1e2150f700 1 Processor -- start 2023-09-30T22:18:35.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.534+0000 7f1e2150f700 1 -- start start 2023-09-30T22:18:35.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.535+0000 7f1e2150f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1e1c0a1510 0x7f1e1c1351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:35.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.535+0000 7f1e2150f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e1c1356e0 0x7f1e1c137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:35.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.535+0000 7f1e2150f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1c0a1e70 con 0x7f1e1c0a0a30 2023-09-30T22:18:35.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.535+0000 7f1e2150f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1c09a720 con 0x7f1e1c0a1510 2023-09-30T22:18:35.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.535+0000 7f1e2150f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c09b300 con 0x7f1e1c1356e0 2023-09-30T22:18:35.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.535+0000 7f1e1a7fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1e1c0a1510 0x7f1e1c1351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:35.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.535+0000 7f1e1a7fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1e1c0a1510 0x7f1e1c1351a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39414/0 (socket says 172.21.15.156:39414) 2023-09-30T22:18:35.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.535+0000 7f1e1affd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f1e1c0a0a30 0x7f1e1c0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:42570/0 (socket says 172.21.15.156:42570) 2023-09-30T22:18:35.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.535+0000 7f1e1a7fc700 1 -- 172.21.15.156:0/1562007081 learned_addr learned my addr 172.21.15.156:0/1562007081 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:35.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.535+0000 7f1e1b7fe700 1 --2- 172.21.15.156:0/1562007081 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e1c1356e0 0x7f1e1c137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:35.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.536+0000 7f1e1a7fc700 1 -- 172.21.15.156:0/1562007081 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e1c1356e0 msgr2=0x7f1e1c137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:35.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.536+0000 7f1e1a7fc700 1 --2- 172.21.15.156:0/1562007081 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e1c1356e0 0x7f1e1c137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.536+0000 7f1e1a7fc700 1 -- 172.21.15.156:0/1562007081 >> v1:172.21.15.156:6789/0 conn(0x7f1e1c0a0a30 legacy=0x7f1e1c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:35.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.536+0000 7f1e1a7fc700 1 -- 172.21.15.156:0/1562007081 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c09abc0 con 0x7f1e1c0a1510 2023-09-30T22:18:35.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.536+0000 7f1e1a7fc700 1 --2- 172.21.15.156:0/1562007081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e1c0a1510 0x7f1e1c1351a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1e100098f0 tx=0x7f1e10009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b619c6f254446194 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:35.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.536+0000 7f1e19ffb700 1 -- 172.21.15.156:0/1562007081 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e10011830 con 0x7f1e1c0a1510 2023-09-30T22:18:35.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.536+0000 7f1e19ffb700 1 -- 172.21.15.156:0/1562007081 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e10011990 con 0x7f1e1c0a1510 2023-09-30T22:18:35.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.536+0000 7f1e19ffb700 1 -- 172.21.15.156:0/1562007081 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e10011d20 con 0x7f1e1c0a1510 2023-09-30T22:18:35.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.537+0000 7f1e2150f700 1 -- 172.21.15.156:0/1562007081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e1c0a1510 msgr2=0x7f1e1c1351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:35.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.537+0000 7f1e2150f700 1 --2- 172.21.15.156:0/1562007081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e1c0a1510 0x7f1e1c1351a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1e100098f0 tx=0x7f1e10009c00 comp rx=0 tx=0).stop 2023-09-30T22:18:35.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.537+0000 7f1e2150f700 1 -- 172.21.15.156:0/1562007081 shutdown_connections 2023-09-30T22:18:35.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.537+0000 7f1e2150f700 1 --2- 172.21.15.156:0/1562007081 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e1c1356e0 0x7f1e1c137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.537+0000 7f1e2150f700 1 --2- 172.21.15.156:0/1562007081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e1c0a1510 0x7f1e1c1351a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.537+0000 7f1e2150f700 1 -- 172.21.15.156:0/1562007081 >> 172.21.15.156:0/1562007081 conn(0x7f1e1c0a2980 msgr2=0x7f1e1c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:35.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.537+0000 7f1e2150f700 1 -- 172.21.15.156:0/1562007081 shutdown_connections 2023-09-30T22:18:35.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.537+0000 7f1e2150f700 1 -- 172.21.15.156:0/1562007081 wait complete. 2023-09-30T22:18:35.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.538+0000 7f1e2150f700 1 Processor -- start 2023-09-30T22:18:35.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.538+0000 7f1e2150f700 1 -- start start 2023-09-30T22:18:35.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.539+0000 7f1e2150f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e1c0a0a30 0x7f1e1c138900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:35.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.539+0000 7f1e2150f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e1c0a1510 0x7f1e1c138e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:35.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.539+0000 7f1e2150f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e1c1356e0 0x7f1e1c1c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:35.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.539+0000 7f1e2150f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c135490 con 0x7f1e1c0a1510 2023-09-30T22:18:35.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.539+0000 7f1e2150f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c09f8e0 con 0x7f1e1c1356e0 2023-09-30T22:18:35.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.539+0000 7f1e2150f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c1311d0 con 0x7f1e1c0a0a30 2023-09-30T22:18:35.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.539+0000 7f1e1b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e1c1356e0 0x7f1e1c1c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:35.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.539+0000 7f1e1b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e1c1356e0 0x7f1e1c1c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57884/0 (socket says 172.21.15.156:57884) 2023-09-30T22:18:35.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.539+0000 7f1e1b7fe700 1 -- 172.21.15.156:0/2429778649 learned_addr learned my addr 172.21.15.156:0/2429778649 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:35.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.539+0000 7f1e1a7fc700 1 --2- 172.21.15.156:0/2429778649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e1c0a1510 0x7f1e1c138e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:35.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.540+0000 7f1e1b7fe700 1 -- 172.21.15.156:0/2429778649 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e1c0a0a30 msgr2=0x7f1e1c138900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:35.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.540+0000 7f1e1b7fe700 1 --2- 172.21.15.156:0/2429778649 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e1c0a0a30 0x7f1e1c138900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.540+0000 7f1e1b7fe700 1 -- 172.21.15.156:0/2429778649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e1c0a1510 msgr2=0x7f1e1c138e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:35.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.540+0000 7f1e1b7fe700 1 --2- 172.21.15.156:0/2429778649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e1c0a1510 0x7f1e1c138e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.540+0000 7f1e1b7fe700 1 -- 172.21.15.156:0/2429778649 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e10009550 con 0x7f1e1c1356e0 2023-09-30T22:18:35.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.540+0000 7f1e1a7fc700 1 --2- 172.21.15.156:0/2429778649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e1c0a1510 0x7f1e1c138e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:35.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.540+0000 7f1e1b7fe700 1 --2- 172.21.15.156:0/2429778649 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e1c1356e0 0x7f1e1c1c6310 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1e14009e30 tx=0x7f1e1400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:35.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.540+0000 7f1e037fe700 1 -- 172.21.15.156:0/2429778649 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e14009ca0 con 0x7f1e1c1356e0 2023-09-30T22:18:35.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.540+0000 7f1e2150f700 1 -- 172.21.15.156:0/2429778649 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1c12f5a0 con 0x7f1e1c1356e0 2023-09-30T22:18:35.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.540+0000 7f1e2150f700 1 -- 172.21.15.156:0/2429778649 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1c12fd90 con 0x7f1e1c1356e0 2023-09-30T22:18:35.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.541+0000 7f1e037fe700 1 -- 172.21.15.156:0/2429778649 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1400f040 con 0x7f1e1c1356e0 2023-09-30T22:18:35.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.541+0000 7f1e2150f700 1 -- 172.21.15.156:0/2429778649 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1c131d00 con 0x7f1e1c1356e0 2023-09-30T22:18:35.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.541+0000 7f1e037fe700 1 -- 172.21.15.156:0/2429778649 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e14014480 con 0x7f1e1c1356e0 2023-09-30T22:18:35.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.542+0000 7f1e037fe700 1 -- 172.21.15.156:0/2429778649 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f1e140145e0 con 0x7f1e1c1356e0 2023-09-30T22:18:35.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.542+0000 7f1e037fe700 1 -- 172.21.15.156:0/2429778649 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f1e1403c5f0 con 0x7f1e1c1356e0 2023-09-30T22:18:35.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.542+0000 7f1e1affd700 1 -- 172.21.15.156:0/2429778649 >> v1:172.21.15.156:6816/118236 conn(0x7f1e0802c1b0 legacy=0x7f1e0802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/118236 2023-09-30T22:18:35.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.546+0000 7f1e037fe700 1 -- 172.21.15.156:0/2429778649 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f1e14012930 con 0x7f1e1c1356e0 2023-09-30T22:18:35.578 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:35.577+0000 7f82ca115240 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-30T22:18:35.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.600+0000 7f259affd700 1 -- 172.21.15.156:0/2203243564 >> v1:172.21.15.156:6816/118236 conn(0x7f258802c1b0 legacy=0x7f258802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/118236 2023-09-30T22:18:35.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.633+0000 7fd6bd56c700 1 Processor -- start 2023-09-30T22:18:35.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.633+0000 7fd6bd56c700 1 -- start start 2023-09-30T22:18:35.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.634+0000 7fd6bd56c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6b809f350 0x7fd6b8136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:35.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.634+0000 7fd6bd56c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd6b81371c0 0x7fd6b81395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:35.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.634+0000 7fd6bd56c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b809c970 con 0x7fd6b809e870 2023-09-30T22:18:35.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.634+0000 7fd6bd56c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b80a0920 con 0x7fd6b81371c0 2023-09-30T22:18:35.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.634+0000 7fd6bd56c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b809f9c0 con 0x7fd6b809f350 2023-09-30T22:18:35.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.634+0000 7fd6b67fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6b809f350 0x7fd6b8136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:35.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.634+0000 7fd6b67fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6b809f350 0x7fd6b8136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34780/0 (socket says 172.21.15.156:34780) 2023-09-30T22:18:35.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.634+0000 7fd6b67fc700 1 -- 172.21.15.156:0/1444844881 learned_addr learned my addr 172.21.15.156:0/1444844881 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:35.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.634+0000 7fd6b77fe700 1 --2- 172.21.15.156:0/1444844881 >> v2:172.21.15.156:3300/0 conn(0x7fd6b81371c0 0x7fd6b81395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:35.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.634+0000 7fd6b5ffb700 1 -- 172.21.15.156:0/1444844881 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3354773316 0 0) 0x7fd6b809c970 con 0x7fd6b809e870 2023-09-30T22:18:35.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.634+0000 7fd6b77fe700 1 -- 172.21.15.156:0/1444844881 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6b809f350 msgr2=0x7fd6b8136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:35.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.635+0000 7fd6b77fe700 1 --2- 172.21.15.156:0/1444844881 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6b809f350 0x7fd6b8136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.635+0000 7fd6b77fe700 1 -- 172.21.15.156:0/1444844881 >> v1:172.21.15.156:6789/0 conn(0x7fd6b809e870 legacy=0x7fd6b809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:35.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.635+0000 7fd6b77fe700 1 -- 172.21.15.156:0/1444844881 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b809bab0 con 0x7fd6b81371c0 2023-09-30T22:18:35.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.635+0000 7fd6b67fc700 1 --2- 172.21.15.156:0/1444844881 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6b809f350 0x7fd6b8136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:35.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.635+0000 7fd6b77fe700 1 --2- 172.21.15.156:0/1444844881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6b81371c0 0x7fd6b81395a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0009d90 tx=0x7fd6b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905f9e8aaa018c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:35.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.635+0000 7fd6b5ffb700 1 -- 172.21.15.156:0/1444844881 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b000e070 con 0x7fd6b81371c0 2023-09-30T22:18:35.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.635+0000 7fd6b5ffb700 1 -- 172.21.15.156:0/1444844881 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b000bb20 con 0x7fd6b81371c0 2023-09-30T22:18:35.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.635+0000 7fd6b5ffb700 1 -- 172.21.15.156:0/1444844881 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0012430 con 0x7fd6b81371c0 2023-09-30T22:18:35.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.636+0000 7fd6bd56c700 1 -- 172.21.15.156:0/1444844881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6b81371c0 msgr2=0x7fd6b81395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:35.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.636+0000 7fd6bd56c700 1 --2- 172.21.15.156:0/1444844881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6b81371c0 0x7fd6b81395a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0009d90 tx=0x7fd6b000b330 comp rx=0 tx=0).stop 2023-09-30T22:18:35.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.636+0000 7fd6bd56c700 1 -- 172.21.15.156:0/1444844881 shutdown_connections 2023-09-30T22:18:35.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.636+0000 7fd6bd56c700 1 --2- 172.21.15.156:0/1444844881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6b81371c0 0x7fd6b81395a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.636+0000 7fd6bd56c700 1 --2- 172.21.15.156:0/1444844881 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6b809f350 0x7fd6b8136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.636+0000 7fd6bd56c700 1 -- 172.21.15.156:0/1444844881 >> 172.21.15.156:0/1444844881 conn(0x7fd6b80a4430 msgr2=0x7fd6b80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:35.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.636+0000 7fd6bd56c700 1 -- 172.21.15.156:0/1444844881 shutdown_connections 2023-09-30T22:18:35.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.636+0000 7fd6bd56c700 1 -- 172.21.15.156:0/1444844881 wait complete. 2023-09-30T22:18:35.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.637+0000 7fd6bd56c700 1 Processor -- start 2023-09-30T22:18:35.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.637+0000 7fd6bd56c700 1 -- start start 2023-09-30T22:18:35.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.638+0000 7fd6bd56c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6b809e870 0x7fd6b812f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:35.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.638+0000 7fd6bd56c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6b809f350 0x7fd6b812f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:35.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.638+0000 7fd6bd56c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6b81371c0 0x7fd6b812fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:35.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.638+0000 7fd6bd56c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b8130760 con 0x7fd6b809e870 2023-09-30T22:18:35.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.638+0000 7fd6bd56c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b8136550 con 0x7fd6b81371c0 2023-09-30T22:18:35.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.638+0000 7fd6bd56c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b81316c0 con 0x7fd6b809f350 2023-09-30T22:18:35.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.638+0000 7fd6b6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6b809e870 0x7fd6b812f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:35.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.638+0000 7fd6b6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6b809e870 0x7fd6b812f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39446/0 (socket says 172.21.15.156:39446) 2023-09-30T22:18:35.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.638+0000 7fd6b6ffd700 1 -- 172.21.15.156:0/1064657131 learned_addr learned my addr 172.21.15.156:0/1064657131 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:35.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.638+0000 7fd6b67fc700 1 --2- 172.21.15.156:0/1064657131 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6b809f350 0x7fd6b812f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:35.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.639+0000 7fd6b6ffd700 1 -- 172.21.15.156:0/1064657131 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6b809f350 msgr2=0x7fd6b812f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:35.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.639+0000 7fd6b6ffd700 1 --2- 172.21.15.156:0/1064657131 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6b809f350 0x7fd6b812f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.639+0000 7fd6b6ffd700 1 -- 172.21.15.156:0/1064657131 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6b81371c0 msgr2=0x7fd6b812fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:35.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.639+0000 7fd6b6ffd700 1 --2- 172.21.15.156:0/1064657131 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6b81371c0 0x7fd6b812fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.639+0000 7fd6b6ffd700 1 -- 172.21.15.156:0/1064657131 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ac009550 con 0x7fd6b809e870 2023-09-30T22:18:35.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.639+0000 7fd6b6ffd700 1 --2- 172.21.15.156:0/1064657131 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6b809e870 0x7fd6b812f300 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd6a800c520 tx=0x7fd6a800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:35.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.639+0000 7fd69f7fe700 1 -- 172.21.15.156:0/1064657131 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a80054e0 con 0x7fd6b809e870 2023-09-30T22:18:35.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.639+0000 7fd69f7fe700 1 -- 172.21.15.156:0/1064657131 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a8003680 con 0x7fd6b809e870 2023-09-30T22:18:35.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.639+0000 7fd69f7fe700 1 -- 172.21.15.156:0/1064657131 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a80039f0 con 0x7fd6b809e870 2023-09-30T22:18:35.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.639+0000 7fd6bd56c700 1 -- 172.21.15.156:0/1064657131 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b0009a70 con 0x7fd6b809e870 2023-09-30T22:18:35.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.639+0000 7fd6bd56c700 1 -- 172.21.15.156:0/1064657131 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b806cce0 con 0x7fd6b809e870 2023-09-30T22:18:35.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.640+0000 7fd69f7fe700 1 -- 172.21.15.156:0/1064657131 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fd6a8003b50 con 0x7fd6b809e870 2023-09-30T22:18:35.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.640+0000 7fd69f7fe700 1 -- 172.21.15.156:0/1064657131 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fd6a803ae10 con 0x7fd6b809e870 2023-09-30T22:18:35.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.640+0000 7fd6b67fc700 1 -- 172.21.15.156:0/1064657131 >> v1:172.21.15.156:6816/118236 conn(0x7fd6a402c1b0 legacy=0x7fd6a402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/118236 2023-09-30T22:18:35.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.641+0000 7fd6bd56c700 1 -- 172.21.15.156:0/1064657131 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b8132110 con 0x7fd6b809e870 2023-09-30T22:18:35.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.648+0000 7fd69f7fe700 1 -- 172.21.15.156:0/1064657131 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fd6a8017070 con 0x7fd6b809e870 2023-09-30T22:18:35.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.678+0000 7f25a1cf4700 1 -- 172.21.15.156:0/2203243564 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f259c11be60 con 0x7f259c09e870 2023-09-30T22:18:35.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.678+0000 7f2583fff700 1 -- 172.21.15.156:0/2203243564 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f258c017020 con 0x7f259c09e870 2023-09-30T22:18:35.679 INFO:teuthology.orchestra.run.smithi156.stdout:38654705691 2023-09-30T22:18:35.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.681+0000 7f25a1cf4700 1 -- 172.21.15.156:0/2203243564 >> v1:172.21.15.156:6816/118236 conn(0x7f258802c1b0 legacy=0x7f258802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:18:35.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.681+0000 7f25a1cf4700 1 -- 172.21.15.156:0/2203243564 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f259c09e870 msgr2=0x7f259c06b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:35.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.681+0000 7f25a1cf4700 1 --2- 172.21.15.156:0/2203243564 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f259c09e870 0x7f259c06b8b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f258c00ebe0 tx=0x7f258c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.681+0000 7f25a1cf4700 1 -- 172.21.15.156:0/2203243564 shutdown_connections 2023-09-30T22:18:35.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.681+0000 7f25a1cf4700 1 --2- 172.21.15.156:0/2203243564 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f259c131d70 0x7f259c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.681+0000 7f25a1cf4700 1 --2- 172.21.15.156:0/2203243564 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f259c09e870 0x7f259c06b8b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.681+0000 7f25a1cf4700 1 --2- 172.21.15.156:0/2203243564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f259c09f180 0x7f259c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.681+0000 7f25a1cf4700 1 -- 172.21.15.156:0/2203243564 >> 172.21.15.156:0/2203243564 conn(0x7f259c0a4430 msgr2=0x7f259c1310f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:35.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.682+0000 7f25a1cf4700 1 -- 172.21.15.156:0/2203243564 shutdown_connections 2023-09-30T22:18:35.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.682+0000 7f25a1cf4700 1 -- 172.21.15.156:0/2203243564 wait complete. 2023-09-30T22:18:35.700 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705691 for osd.0 2023-09-30T22:18:35.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.699+0000 7ff7effff700 1 -- 172.21.15.156:0/810594931 >> v1:172.21.15.156:6816/118236 conn(0x7ff7d402c1b0 legacy=0x7ff7d402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/118236 2023-09-30T22:18:35.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.720+0000 7f1e2150f700 1 -- 172.21.15.156:0/2429778649 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1e1c04f2a0 con 0x7f1e1c1356e0 2023-09-30T22:18:35.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.720+0000 7f1e037fe700 1 -- 172.21.15.156:0/2429778649 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1e1401c3b0 con 0x7f1e1c1356e0 2023-09-30T22:18:35.721 INFO:teuthology.orchestra.run.smithi156.stdout:38654705691 2023-09-30T22:18:35.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.722+0000 7f1e2150f700 1 -- 172.21.15.156:0/2429778649 >> v1:172.21.15.156:6816/118236 conn(0x7f1e0802c1b0 legacy=0x7f1e0802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:18:35.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.722+0000 7f1e2150f700 1 -- 172.21.15.156:0/2429778649 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e1c1356e0 msgr2=0x7f1e1c1c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:35.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.722+0000 7f1e2150f700 1 --2- 172.21.15.156:0/2429778649 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e1c1356e0 0x7f1e1c1c6310 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1e14009e30 tx=0x7f1e1400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.722+0000 7f1e2150f700 1 -- 172.21.15.156:0/2429778649 shutdown_connections 2023-09-30T22:18:35.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.722+0000 7f1e2150f700 1 --2- 172.21.15.156:0/2429778649 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e1c1356e0 0x7f1e1c1c6310 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.722+0000 7f1e2150f700 1 --2- 172.21.15.156:0/2429778649 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e1c0a0a30 0x7f1e1c138900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.722+0000 7f1e2150f700 1 --2- 172.21.15.156:0/2429778649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e1c0a1510 0x7f1e1c138e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.722+0000 7f1e2150f700 1 -- 172.21.15.156:0/2429778649 >> 172.21.15.156:0/2429778649 conn(0x7f1e1c0a2980 msgr2=0x7f1e1c12e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:35.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.722+0000 7f1e2150f700 1 -- 172.21.15.156:0/2429778649 shutdown_connections 2023-09-30T22:18:35.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.722+0000 7f1e2150f700 1 -- 172.21.15.156:0/2429778649 wait complete. 2023-09-30T22:18:35.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705691 for osd.2 2023-09-30T22:18:35.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.775+0000 7ff7f6eb0700 1 -- 172.21.15.156:0/810594931 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff7f0124310 con 0x7ff7f0138040 2023-09-30T22:18:35.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.775+0000 7ff7ed7fa700 1 -- 172.21.15.156:0/810594931 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff7e4017020 con 0x7ff7f0138040 2023-09-30T22:18:35.776 INFO:teuthology.orchestra.run.smithi156.stdout:38654705691 2023-09-30T22:18:35.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.777+0000 7ff7f6eb0700 1 -- 172.21.15.156:0/810594931 >> v1:172.21.15.156:6816/118236 conn(0x7ff7d402c1b0 legacy=0x7ff7d402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:18:35.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.777+0000 7ff7f6eb0700 1 -- 172.21.15.156:0/810594931 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7f0138040 msgr2=0x7ff7f0121600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:35.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.777+0000 7ff7f6eb0700 1 --2- 172.21.15.156:0/810594931 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7f0138040 0x7ff7f0121600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400c480 tx=0x7ff7e400c790 comp rx=0 tx=0).stop 2023-09-30T22:18:35.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.777+0000 7ff7f6eb0700 1 -- 172.21.15.156:0/810594931 shutdown_connections 2023-09-30T22:18:35.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.777+0000 7ff7f6eb0700 1 --2- 172.21.15.156:0/810594931 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7f013dd10 0x7ff7f0122080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.777+0000 7ff7f6eb0700 1 --2- 172.21.15.156:0/810594931 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7f0138040 0x7ff7f0121600 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.777+0000 7ff7f6eb0700 1 --2- 172.21.15.156:0/810594931 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7f0138410 0x7ff7f0121b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.777+0000 7ff7f6eb0700 1 -- 172.21.15.156:0/810594931 >> 172.21.15.156:0/810594931 conn(0x7ff7f00a2980 msgr2=0x7ff7f009d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:35.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.777+0000 7ff7f6eb0700 1 -- 172.21.15.156:0/810594931 shutdown_connections 2023-09-30T22:18:35.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.777+0000 7ff7f6eb0700 1 -- 172.21.15.156:0/810594931 wait complete. 2023-09-30T22:18:35.790 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705691 for osd.3 2023-09-30T22:18:35.811 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:35.811+0000 7f82ca115240 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-30T22:18:35.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.841+0000 7fd6b67fc700 1 -- 172.21.15.156:0/1064657131 >> v1:172.21.15.156:6816/118236 conn(0x7fd6a402c1b0 legacy=0x7fd6a402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/118236 2023-09-30T22:18:35.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.879+0000 7fd6bd56c700 1 -- 172.21.15.156:0/1064657131 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd6b804f2a0 con 0x7fd6b809e870 2023-09-30T22:18:35.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.880+0000 7fd69f7fe700 1 -- 172.21.15.156:0/1064657131 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd6a8017030 con 0x7fd6b809e870 2023-09-30T22:18:35.881 INFO:teuthology.orchestra.run.smithi156.stdout:38654705691 2023-09-30T22:18:35.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.882+0000 7fd6bd56c700 1 -- 172.21.15.156:0/1064657131 >> v1:172.21.15.156:6816/118236 conn(0x7fd6a402c1b0 legacy=0x7fd6a402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:18:35.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.882+0000 7fd6bd56c700 1 -- 172.21.15.156:0/1064657131 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6b809e870 msgr2=0x7fd6b812f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:35.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.882+0000 7fd6bd56c700 1 --2- 172.21.15.156:0/1064657131 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6b809e870 0x7fd6b812f300 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd6a800c520 tx=0x7fd6a800c830 comp rx=0 tx=0).stop 2023-09-30T22:18:35.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.882+0000 7fd6bd56c700 1 -- 172.21.15.156:0/1064657131 shutdown_connections 2023-09-30T22:18:35.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.882+0000 7fd6bd56c700 1 --2- 172.21.15.156:0/1064657131 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6b81371c0 0x7fd6b812fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.882+0000 7fd6bd56c700 1 --2- 172.21.15.156:0/1064657131 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6b809e870 0x7fd6b812f300 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.882+0000 7fd6bd56c700 1 --2- 172.21.15.156:0/1064657131 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6b809f350 0x7fd6b812f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:35.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.882+0000 7fd6bd56c700 1 -- 172.21.15.156:0/1064657131 >> 172.21.15.156:0/1064657131 conn(0x7fd6b80a4430 msgr2=0x7fd6b8136a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:35.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.882+0000 7fd6bd56c700 1 -- 172.21.15.156:0/1064657131 shutdown_connections 2023-09-30T22:18:35.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:35.882+0000 7fd6bd56c700 1 -- 172.21.15.156:0/1064657131 wait complete. 2023-09-30T22:18:35.884 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:35.884+0000 7f82ca115240 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-30T22:18:35.895 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705691 for osd.1 2023-09-30T22:18:36.524 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:36.523+0000 7f82ca115240 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-30T22:18:36.645 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:36.644+0000 7f82ca115240 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-30T22:18:36.700 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:18:36.737 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:18:36.772 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:36.772+0000 7f82ca115240 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-30T22:18:36.791 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:18:36.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.843+0000 7f72ced1c700 1 Processor -- start 2023-09-30T22:18:36.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.843+0000 7f72ced1c700 1 -- start start 2023-09-30T22:18:36.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.844+0000 7f72ced1c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f72c809e340 0x7f72c81359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:36.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.844+0000 7f72ced1c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72c8135f20 0x7f72c8138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:36.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.844+0000 7f72ced1c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c809aaa0 con 0x7f72c809d860 2023-09-30T22:18:36.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.844+0000 7f72ced1c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c809e730 con 0x7f72c809e340 2023-09-30T22:18:36.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.844+0000 7f72ced1c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72c809f870 con 0x7f72c8135f20 2023-09-30T22:18:36.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.844+0000 7f72c7fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f72c809e340 0x7f72c81359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:36.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.844+0000 7f72ccab8700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f72c809d860 0x7f72c809dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:42602/0 (socket says 172.21.15.156:42602) 2023-09-30T22:18:36.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.844+0000 7f72c7fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f72c809e340 0x7f72c81359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39456/0 (socket says 172.21.15.156:39456) 2023-09-30T22:18:36.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.844+0000 7f72ccab8700 1 -- 172.21.15.156:0/581737382 learned_addr learned my addr 172.21.15.156:0/581737382 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:18:36.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.844+0000 7f72cd2b9700 1 --2- 172.21.15.156:0/581737382 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72c8135f20 0x7f72c8138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:36.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.845+0000 7f72cd2b9700 1 -- 172.21.15.156:0/581737382 >> v2:172.21.15.156:3300/0 conn(0x7f72c809e340 msgr2=0x7f72c81359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:36.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.845+0000 7f72cd2b9700 1 --2- 172.21.15.156:0/581737382 >> v2:172.21.15.156:3300/0 conn(0x7f72c809e340 0x7f72c81359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:36.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.845+0000 7f72cd2b9700 1 -- 172.21.15.156:0/581737382 >> v1:172.21.15.156:6789/0 conn(0x7f72c809d860 legacy=0x7f72c809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:36.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.845+0000 7f72cd2b9700 1 -- 172.21.15.156:0/581737382 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c809b360 con 0x7f72c8135f20 2023-09-30T22:18:36.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.845+0000 7f72cd2b9700 1 --2- 172.21.15.156:0/581737382 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72c8135f20 0x7f72c8138300 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f72c00103d0 tx=0x7f72c00106e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ad7e562bcca54ce server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:36.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.845+0000 7f72c77fe700 1 -- 172.21.15.156:0/581737382 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c001b680 con 0x7f72c8135f20 2023-09-30T22:18:36.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.845+0000 7f72c77fe700 1 -- 172.21.15.156:0/581737382 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c001b7e0 con 0x7f72c8135f20 2023-09-30T22:18:36.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.845+0000 7f72c77fe700 1 -- 172.21.15.156:0/581737382 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c001bb70 con 0x7f72c8135f20 2023-09-30T22:18:36.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.846+0000 7f72ced1c700 1 -- 172.21.15.156:0/581737382 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72c8135f20 msgr2=0x7f72c8138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:36.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.846+0000 7f72ced1c700 1 --2- 172.21.15.156:0/581737382 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72c8135f20 0x7f72c8138300 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f72c00103d0 tx=0x7f72c00106e0 comp rx=0 tx=0).stop 2023-09-30T22:18:36.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.846+0000 7f72ced1c700 1 -- 172.21.15.156:0/581737382 shutdown_connections 2023-09-30T22:18:36.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.846+0000 7f72ced1c700 1 --2- 172.21.15.156:0/581737382 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72c8135f20 0x7f72c8138300 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:36.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.846+0000 7f72ced1c700 1 --2- 172.21.15.156:0/581737382 >> v2:172.21.15.156:3300/0 conn(0x7f72c809e340 0x7f72c81359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:36.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.846+0000 7f72ced1c700 1 -- 172.21.15.156:0/581737382 >> 172.21.15.156:0/581737382 conn(0x7f72c8099c40 msgr2=0x7f72c80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:36.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.846+0000 7f72ced1c700 1 -- 172.21.15.156:0/581737382 shutdown_connections 2023-09-30T22:18:36.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.846+0000 7f72ced1c700 1 -- 172.21.15.156:0/581737382 wait complete. 2023-09-30T22:18:36.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.847+0000 7f72ced1c700 1 Processor -- start 2023-09-30T22:18:36.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.847+0000 7f72ced1c700 1 -- start start 2023-09-30T22:18:36.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.848+0000 7f72ced1c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72c809d860 0x7f72c8119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:36.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.848+0000 7f72ced1c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72c809e340 0x7f72c8119b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:36.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.848+0000 7f72ced1c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72c8135f20 0x7f72c811a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:36.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.848+0000 7f72ced1c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c811cb50 con 0x7f72c8135f20 2023-09-30T22:18:36.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.848+0000 7f72ced1c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c811b460 con 0x7f72c809d860 2023-09-30T22:18:36.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.848+0000 7f72ced1c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72c80a0840 con 0x7f72c809e340 2023-09-30T22:18:36.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.848+0000 7f72cd2b9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72c8135f20 0x7f72c811a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:36.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.848+0000 7f72cd2b9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72c8135f20 0x7f72c811a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39464/0 (socket says 172.21.15.156:39464) 2023-09-30T22:18:36.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.848+0000 7f72cd2b9700 1 -- 172.21.15.156:0/340499053 learned_addr learned my addr 172.21.15.156:0/340499053 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:36.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.848+0000 7f72ccab8700 1 --2- 172.21.15.156:0/340499053 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72c809d860 0x7f72c8119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:36.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.849+0000 7f72c7fff700 1 --2- 172.21.15.156:0/340499053 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72c809e340 0x7f72c8119b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:36.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.849+0000 7f72cd2b9700 1 -- 172.21.15.156:0/340499053 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72c809e340 msgr2=0x7f72c8119b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:36.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.849+0000 7f72cd2b9700 1 --2- 172.21.15.156:0/340499053 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72c809e340 0x7f72c8119b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:36.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.849+0000 7f72cd2b9700 1 -- 172.21.15.156:0/340499053 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72c809d860 msgr2=0x7f72c8119630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:36.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.849+0000 7f72cd2b9700 1 --2- 172.21.15.156:0/340499053 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72c809d860 0x7f72c8119630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:36.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.849+0000 7f72cd2b9700 1 -- 172.21.15.156:0/340499053 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c000bc50 con 0x7f72c8135f20 2023-09-30T22:18:36.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.849+0000 7f72cd2b9700 1 --2- 172.21.15.156:0/340499053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72c8135f20 0x7f72c811a0b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f72c0010720 tx=0x7f72c0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:36.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.849+0000 7f72c57fa700 1 -- 172.21.15.156:0/340499053 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c0003c20 con 0x7f72c8135f20 2023-09-30T22:18:36.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.849+0000 7f72c57fa700 1 -- 172.21.15.156:0/340499053 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c0020050 con 0x7f72c8135f20 2023-09-30T22:18:36.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.849+0000 7f72c57fa700 1 -- 172.21.15.156:0/340499053 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c0004040 con 0x7f72c8135f20 2023-09-30T22:18:36.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.849+0000 7f72ced1c700 1 -- 172.21.15.156:0/340499053 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c811b6a0 con 0x7f72c8135f20 2023-09-30T22:18:36.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.849+0000 7f72ced1c700 1 -- 172.21.15.156:0/340499053 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c811d330 con 0x7f72c8135f20 2023-09-30T22:18:36.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.850+0000 7f72c57fa700 1 -- 172.21.15.156:0/340499053 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f72c00041a0 con 0x7f72c8135f20 2023-09-30T22:18:36.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.850+0000 7f72ced1c700 1 -- 172.21.15.156:0/340499053 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c811c990 con 0x7f72c8135f20 2023-09-30T22:18:36.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.851+0000 7f72ccab8700 1 -- 172.21.15.156:0/340499053 >> v1:172.21.15.156:6816/118236 conn(0x7f72ac02c1b0 legacy=0x7f72ac02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/118236 2023-09-30T22:18:36.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.851+0000 7f72c57fa700 1 -- 172.21.15.156:0/340499053 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f72c0016070 con 0x7f72c8135f20 2023-09-30T22:18:36.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.858+0000 7f72c57fa700 1 -- 172.21.15.156:0/340499053 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f72c000e3b0 con 0x7f72c8135f20 2023-09-30T22:18:36.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.887+0000 7ff74ed9c700 1 Processor -- start 2023-09-30T22:18:36.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.887+0000 7ff74ed9c700 1 -- start start 2023-09-30T22:18:36.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.888+0000 7ff74ed9c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff74809e870 0x7ff74809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:36.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.888+0000 7ff74ed9c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff74809f180 0x7ff748131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:36.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.888+0000 7ff74ed9c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff74809c970 con 0x7ff748131d70 2023-09-30T22:18:36.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.888+0000 7ff74ed9c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7480a0920 con 0x7ff74809f180 2023-09-30T22:18:36.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.888+0000 7ff74ed9c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74809f9c0 con 0x7ff74809e870 2023-09-30T22:18:36.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.888+0000 7ff74cb38700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff74809e870 0x7ff74809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:36.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.888+0000 7ff74cb38700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff74809e870 0x7ff74809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57914/0 (socket says 172.21.15.156:57914) 2023-09-30T22:18:36.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.888+0000 7ff74cb38700 1 -- 172.21.15.156:0/3240194201 learned_addr learned my addr 172.21.15.156:0/3240194201 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:36.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.888+0000 7ff747fff700 1 --2- 172.21.15.156:0/3240194201 >> v2:172.21.15.156:3300/0 conn(0x7ff74809f180 0x7ff748131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:36.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.888+0000 7ff74cb38700 1 -- 172.21.15.156:0/3240194201 >> v2:172.21.15.156:3300/0 conn(0x7ff74809f180 msgr2=0x7ff748131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:36.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.888+0000 7ff74cb38700 1 --2- 172.21.15.156:0/3240194201 >> v2:172.21.15.156:3300/0 conn(0x7ff74809f180 0x7ff748131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:36.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.888+0000 7ff74cb38700 1 -- 172.21.15.156:0/3240194201 >> v1:172.21.15.156:6789/0 conn(0x7ff748131d70 legacy=0x7ff748138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:36.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.888+0000 7ff74cb38700 1 -- 172.21.15.156:0/3240194201 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74809bab0 con 0x7ff74809e870 2023-09-30T22:18:36.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.889+0000 7ff74cb38700 1 --2- 172.21.15.156:0/3240194201 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff74809e870 0x7ff74809ec40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff73c0098f0 tx=0x7ff73c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3c7e68ca2c53f4d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:36.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.889+0000 7ff7477fe700 1 -- 172.21.15.156:0/3240194201 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c011830 con 0x7ff74809e870 2023-09-30T22:18:36.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.889+0000 7ff7477fe700 1 -- 172.21.15.156:0/3240194201 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73c011990 con 0x7ff74809e870 2023-09-30T22:18:36.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.889+0000 7ff7477fe700 1 -- 172.21.15.156:0/3240194201 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c011d20 con 0x7ff74809e870 2023-09-30T22:18:36.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.890+0000 7ff74ed9c700 1 -- 172.21.15.156:0/3240194201 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff74809e870 msgr2=0x7ff74809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:36.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.890+0000 7ff74ed9c700 1 --2- 172.21.15.156:0/3240194201 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff74809e870 0x7ff74809ec40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff73c0098f0 tx=0x7ff73c009c00 comp rx=0 tx=0).stop 2023-09-30T22:18:36.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.890+0000 7ff74ed9c700 1 -- 172.21.15.156:0/3240194201 shutdown_connections 2023-09-30T22:18:36.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.890+0000 7ff74ed9c700 1 --2- 172.21.15.156:0/3240194201 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff74809e870 0x7ff74809ec40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:36.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.890+0000 7ff74ed9c700 1 --2- 172.21.15.156:0/3240194201 >> v2:172.21.15.156:3300/0 conn(0x7ff74809f180 0x7ff748131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:36.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.890+0000 7ff74ed9c700 1 -- 172.21.15.156:0/3240194201 >> 172.21.15.156:0/3240194201 conn(0x7ff7480a4430 msgr2=0x7ff7480a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:36.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.890+0000 7ff74ed9c700 1 -- 172.21.15.156:0/3240194201 shutdown_connections 2023-09-30T22:18:36.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.890+0000 7ff74ed9c700 1 -- 172.21.15.156:0/3240194201 wait complete. 2023-09-30T22:18:36.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.891+0000 7ff74ed9c700 1 Processor -- start 2023-09-30T22:18:36.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.891+0000 7ff74ed9c700 1 -- start start 2023-09-30T22:18:36.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.892+0000 7ff74ed9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff74809e870 0x7ff7481203e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:36.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.892+0000 7ff74ed9c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff74809f180 0x7ff748120920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:36.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.892+0000 7ff74ed9c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff748131d70 0x7ff748120e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:36.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.892+0000 7ff74ed9c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff748121840 con 0x7ff74809e870 2023-09-30T22:18:36.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.892+0000 7ff74ed9c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74809dba0 con 0x7ff748131d70 2023-09-30T22:18:36.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.892+0000 7ff74ed9c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff748122850 con 0x7ff74809f180 2023-09-30T22:18:36.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.892+0000 7ff747fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff74809f180 0x7ff748120920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:36.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.892+0000 7ff74cb38700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff74809e870 0x7ff7481203e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:36.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.892+0000 7ff747fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff74809f180 0x7ff748120920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34802/0 (socket says 172.21.15.156:34802) 2023-09-30T22:18:36.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.892+0000 7ff74cb38700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff74809e870 0x7ff7481203e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39488/0 (socket says 172.21.15.156:39488) 2023-09-30T22:18:36.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.892+0000 7ff747fff700 1 -- 172.21.15.156:0/331125656 learned_addr learned my addr 172.21.15.156:0/331125656 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:36.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.892+0000 7ff74d339700 1 --2- 172.21.15.156:0/331125656 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff748131d70 0x7ff748120e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:36.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.892+0000 7ff74cb38700 1 -- 172.21.15.156:0/331125656 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff74809f180 msgr2=0x7ff748120920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:36.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.892+0000 7ff74cb38700 1 --2- 172.21.15.156:0/331125656 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff74809f180 0x7ff748120920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:36.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.892+0000 7ff74cb38700 1 -- 172.21.15.156:0/331125656 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff748131d70 msgr2=0x7ff748120e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:36.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.892+0000 7ff74cb38700 1 --2- 172.21.15.156:0/331125656 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff748131d70 0x7ff748120e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:36.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.892+0000 7ff74cb38700 1 -- 172.21.15.156:0/331125656 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff73c009550 con 0x7ff74809e870 2023-09-30T22:18:36.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.893+0000 7ff74cb38700 1 --2- 172.21.15.156:0/331125656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff74809e870 0x7ff7481203e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff74809afc0 tx=0x7ff73c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:36.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.893+0000 7ff7457fa700 1 -- 172.21.15.156:0/331125656 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c004450 con 0x7ff74809e870 2023-09-30T22:18:36.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.893+0000 7ff74ed9c700 1 -- 172.21.15.156:0/331125656 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff748121ff0 con 0x7ff74809e870 2023-09-30T22:18:36.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.893+0000 7ff7457fa700 1 -- 172.21.15.156:0/331125656 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73c01e070 con 0x7ff74809e870 2023-09-30T22:18:36.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.893+0000 7ff7457fa700 1 -- 172.21.15.156:0/331125656 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c0038e0 con 0x7ff74809e870 2023-09-30T22:18:36.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.893+0000 7ff74ed9c700 1 -- 172.21.15.156:0/331125656 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff748130f00 con 0x7ff74809e870 2023-09-30T22:18:36.897 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:18:36.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.894+0000 7ff74ed9c700 1 -- 172.21.15.156:0/331125656 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7481238c0 con 0x7ff74809e870 2023-09-30T22:18:36.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.895+0000 7ff7457fa700 1 -- 172.21.15.156:0/331125656 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7ff73c003a40 con 0x7ff74809e870 2023-09-30T22:18:36.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.895+0000 7ff7457fa700 1 -- 172.21.15.156:0/331125656 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7ff73c03c800 con 0x7ff74809e870 2023-09-30T22:18:36.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.895+0000 7ff747fff700 1 -- 172.21.15.156:0/331125656 >> v1:172.21.15.156:6816/118236 conn(0x7ff72c02c1b0 legacy=0x7ff72c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/118236 2023-09-30T22:18:36.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.899+0000 7ff7457fa700 1 -- 172.21.15.156:0/331125656 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7ff73c0193b0 con 0x7ff74809e870 2023-09-30T22:18:36.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.951+0000 7fecb8195700 1 Processor -- start 2023-09-30T22:18:36.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.951+0000 7fecb8195700 1 -- start start 2023-09-30T22:18:36.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.952+0000 7fecb8195700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fecb009ad40 0x7fecb0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:36.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.952+0000 7fecb8195700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecb01343a0 0x7fecb00a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:36.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.952+0000 7fecb8195700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb009b110 con 0x7fecb0133f70 2023-09-30T22:18:36.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.952+0000 7fecb8195700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb00a3b60 con 0x7fecb01343a0 2023-09-30T22:18:36.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.952+0000 7fecb8195700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecb00a2fa0 con 0x7fecb009ad40 2023-09-30T22:18:36.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.952+0000 7fecb5f31700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fecb009ad40 0x7fecb0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:36.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.952+0000 7fecb5730700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fecb0133f70 0x7fecb00a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:42626/0 (socket says 172.21.15.156:42626) 2023-09-30T22:18:36.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.952+0000 7fecb5730700 1 -- 172.21.15.156:0/2308189303 learned_addr learned my addr 172.21.15.156:0/2308189303 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:18:36.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.952+0000 7fecb6732700 1 --2- 172.21.15.156:0/2308189303 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecb01343a0 0x7fecb00a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:36.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.952+0000 7fecb4f2f700 1 -- 172.21.15.156:0/2308189303 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2504619916 0 0) 0x7fecb009b110 con 0x7fecb0133f70 2023-09-30T22:18:36.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.952+0000 7fecb4f2f700 1 -- 172.21.15.156:0/2308189303 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec9c0035b0 con 0x7fecb0133f70 2023-09-30T22:18:36.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.953+0000 7fecb5f31700 1 -- 172.21.15.156:0/2308189303 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecb01343a0 msgr2=0x7fecb00a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:36.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.953+0000 7fecb5f31700 1 --2- 172.21.15.156:0/2308189303 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecb01343a0 0x7fecb00a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:36.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.953+0000 7fecb5f31700 1 -- 172.21.15.156:0/2308189303 >> v1:172.21.15.156:6789/0 conn(0x7fecb0133f70 legacy=0x7fecb00a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:36.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.953+0000 7fecb5f31700 1 -- 172.21.15.156:0/2308189303 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb009a280 con 0x7fecb009ad40 2023-09-30T22:18:36.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.953+0000 7fecb6732700 1 --2- 172.21.15.156:0/2308189303 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecb01343a0 0x7fecb00a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:36.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.953+0000 7fecb5f31700 1 --2- 172.21.15.156:0/2308189303 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fecb009ad40 0x7fecb0133a30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fecac013180 tx=0x7fecac013490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1acdfdb6a860590c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:36.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.953+0000 7fecb4f2f700 1 -- 172.21.15.156:0/2308189303 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac016070 con 0x7fecb009ad40 2023-09-30T22:18:36.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.953+0000 7fecb4f2f700 1 -- 172.21.15.156:0/2308189303 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecac013d40 con 0x7fecb009ad40 2023-09-30T22:18:36.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.953+0000 7fecb4f2f700 1 -- 172.21.15.156:0/2308189303 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac0112d0 con 0x7fecb009ad40 2023-09-30T22:18:36.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.954+0000 7fecb8195700 1 -- 172.21.15.156:0/2308189303 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fecb009ad40 msgr2=0x7fecb0133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:36.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.954+0000 7fecb8195700 1 --2- 172.21.15.156:0/2308189303 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fecb009ad40 0x7fecb0133a30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fecac013180 tx=0x7fecac013490 comp rx=0 tx=0).stop 2023-09-30T22:18:36.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.954+0000 7fecb8195700 1 -- 172.21.15.156:0/2308189303 shutdown_connections 2023-09-30T22:18:36.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.954+0000 7fecb8195700 1 --2- 172.21.15.156:0/2308189303 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecb01343a0 0x7fecb00a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:36.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.954+0000 7fecb8195700 1 --2- 172.21.15.156:0/2308189303 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fecb009ad40 0x7fecb0133a30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:36.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.954+0000 7fecb8195700 1 -- 172.21.15.156:0/2308189303 >> 172.21.15.156:0/2308189303 conn(0x7fecb0099c40 msgr2=0x7fecb006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:36.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.954+0000 7fecb8195700 1 -- 172.21.15.156:0/2308189303 shutdown_connections 2023-09-30T22:18:36.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.954+0000 7fecb8195700 1 -- 172.21.15.156:0/2308189303 wait complete. 2023-09-30T22:18:36.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.956+0000 7fecb8195700 1 Processor -- start 2023-09-30T22:18:36.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.956+0000 7fecb8195700 1 -- start start 2023-09-30T22:18:36.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.957+0000 7fecb8195700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fecb009ad40 0x7fecb011e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:36.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.957+0000 7fecb8195700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecb0133f70 0x7fecb011ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:36.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.957+0000 7fecb8195700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecb01343a0 0x7fecb01c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:36.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.957+0000 7fecb8195700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb0121090 con 0x7fecb01343a0 2023-09-30T22:18:36.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.957+0000 7fecb8195700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb0121720 con 0x7fecb0133f70 2023-09-30T22:18:36.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.957+0000 7fecb8195700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecb011e380 con 0x7fecb009ad40 2023-09-30T22:18:36.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.957+0000 7fecb6732700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecb01343a0 0x7fecb01c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:36.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.957+0000 7fecb6732700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecb01343a0 0x7fecb01c3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39504/0 (socket says 172.21.15.156:39504) 2023-09-30T22:18:36.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.957+0000 7fecb6732700 1 -- 172.21.15.156:0/1686480515 learned_addr learned my addr 172.21.15.156:0/1686480515 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:36.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.957+0000 7fecb5730700 1 --2- 172.21.15.156:0/1686480515 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecb0133f70 0x7fecb011ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:36.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.957+0000 7fecb5f31700 1 --2- 172.21.15.156:0/1686480515 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fecb009ad40 0x7fecb011e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:36.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.957+0000 7fecb5730700 1 -- 172.21.15.156:0/1686480515 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fecb009ad40 msgr2=0x7fecb011e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:36.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.957+0000 7fecb5730700 1 --2- 172.21.15.156:0/1686480515 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fecb009ad40 0x7fecb011e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:36.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.957+0000 7fecb5730700 1 -- 172.21.15.156:0/1686480515 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecb01343a0 msgr2=0x7fecb01c3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:36.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.957+0000 7fecb5730700 1 --2- 172.21.15.156:0/1686480515 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecb01343a0 0x7fecb01c3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:36.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.957+0000 7fecb5730700 1 -- 172.21.15.156:0/1686480515 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca8009a70 con 0x7fecb0133f70 2023-09-30T22:18:36.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.958+0000 7fecb5730700 1 --2- 172.21.15.156:0/1686480515 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecb0133f70 0x7fecb011ec80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7feca000c460 tx=0x7feca000c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:36.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.958+0000 7feca67fc700 1 -- 172.21.15.156:0/1686480515 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca0005d70 con 0x7fecb0133f70 2023-09-30T22:18:36.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.958+0000 7fecb8195700 1 -- 172.21.15.156:0/1686480515 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecac011d40 con 0x7fecb0133f70 2023-09-30T22:18:36.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.958+0000 7fecb8195700 1 -- 172.21.15.156:0/1686480515 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb0120270 con 0x7fecb0133f70 2023-09-30T22:18:36.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.959+0000 7feca67fc700 1 -- 172.21.15.156:0/1686480515 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca00070d0 con 0x7fecb0133f70 2023-09-30T22:18:36.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.959+0000 7feca67fc700 1 -- 172.21.15.156:0/1686480515 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca0007440 con 0x7fecb0133f70 2023-09-30T22:18:36.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.959+0000 7feca67fc700 1 -- 172.21.15.156:0/1686480515 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7feca00075a0 con 0x7fecb0133f70 2023-09-30T22:18:36.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.959+0000 7fecb5f31700 1 -- 172.21.15.156:0/1686480515 >> v1:172.21.15.156:6816/118236 conn(0x7fec9402c1e0 legacy=0x7fec9402e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/118236 2023-09-30T22:18:36.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.959+0000 7feca67fc700 1 -- 172.21.15.156:0/1686480515 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7feca0011e10 con 0x7fecb0133f70 2023-09-30T22:18:36.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.959+0000 7fecb8195700 1 -- 172.21.15.156:0/1686480515 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec980052e0 con 0x7fecb0133f70 2023-09-30T22:18:36.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:36.968+0000 7feca67fc700 1 -- 172.21.15.156:0/1686480515 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7feca0017030 con 0x7fecb0133f70 2023-09-30T22:18:37.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.032+0000 7f75837f9700 1 Processor -- start 2023-09-30T22:18:37.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.032+0000 7f75837f9700 1 -- start start 2023-09-30T22:18:37.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.032+0000 7f75837f9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f757c133b80 0x7f757c133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:37.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.032+0000 7f75837f9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f757c099a60 0x7f757c0a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:37.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.032+0000 7f75837f9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757c09aa00 con 0x7f757c0a0e20 2023-09-30T22:18:37.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.032+0000 7f75837f9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757c09a080 con 0x7f757c099a60 2023-09-30T22:18:37.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.032+0000 7f75837f9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f757c133750 con 0x7f757c133b80 2023-09-30T22:18:37.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.033+0000 7f7581d96700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f757c0a0e20 0x7f757c13a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:42642/0 (socket says 172.21.15.156:42642) 2023-09-30T22:18:37.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.033+0000 7f7581d96700 1 -- 172.21.15.156:0/720654966 learned_addr learned my addr 172.21.15.156:0/720654966 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:18:37.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.033+0000 7f7580d94700 1 --2- 172.21.15.156:0/720654966 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f757c099a60 0x7f757c0a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:37.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.033+0000 7f7581595700 1 --2- 172.21.15.156:0/720654966 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f757c133b80 0x7f757c133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:37.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.033+0000 7f7573fff700 1 -- 172.21.15.156:0/720654966 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 973192856 0 0) 0x7f757c09aa00 con 0x7f757c0a0e20 2023-09-30T22:18:37.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.033+0000 7f7573fff700 1 -- 172.21.15.156:0/720654966 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75680035b0 con 0x7f757c0a0e20 2023-09-30T22:18:37.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.033+0000 7f7581595700 1 -- 172.21.15.156:0/720654966 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f757c099a60 msgr2=0x7f757c0a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:37.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.033+0000 7f7581595700 1 --2- 172.21.15.156:0/720654966 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f757c099a60 0x7f757c0a08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:37.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.033+0000 7f7581595700 1 -- 172.21.15.156:0/720654966 >> v1:172.21.15.156:6789/0 conn(0x7f757c0a0e20 legacy=0x7f757c13a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:37.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.033+0000 7f7581595700 1 -- 172.21.15.156:0/720654966 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c09a760 con 0x7f757c133b80 2023-09-30T22:18:37.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.033+0000 7f7581595700 1 --2- 172.21.15.156:0/720654966 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f757c133b80 0x7f757c133f50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7578009850 tx=0x7f7578009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ee73bfda28b674f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:37.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.034+0000 7f7573fff700 1 -- 172.21.15.156:0/720654966 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7578005e30 con 0x7f757c133b80 2023-09-30T22:18:37.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.034+0000 7f7573fff700 1 -- 172.21.15.156:0/720654966 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7578006030 con 0x7f757c133b80 2023-09-30T22:18:37.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.034+0000 7f7573fff700 1 -- 172.21.15.156:0/720654966 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75780063a0 con 0x7f757c133b80 2023-09-30T22:18:37.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.034+0000 7f75837f9700 1 -- 172.21.15.156:0/720654966 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f757c133b80 msgr2=0x7f757c133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:37.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.034+0000 7f75837f9700 1 --2- 172.21.15.156:0/720654966 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f757c133b80 0x7f757c133f50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7578009850 tx=0x7f7578009b60 comp rx=0 tx=0).stop 2023-09-30T22:18:37.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.034+0000 7f75837f9700 1 -- 172.21.15.156:0/720654966 shutdown_connections 2023-09-30T22:18:37.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.034+0000 7f75837f9700 1 --2- 172.21.15.156:0/720654966 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f757c133b80 0x7f757c133f50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:37.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.034+0000 7f75837f9700 1 --2- 172.21.15.156:0/720654966 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f757c099a60 0x7f757c0a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:37.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.034+0000 7f75837f9700 1 -- 172.21.15.156:0/720654966 >> 172.21.15.156:0/720654966 conn(0x7f757c0a2980 msgr2=0x7f757c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:37.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.035+0000 7f75837f9700 1 -- 172.21.15.156:0/720654966 shutdown_connections 2023-09-30T22:18:37.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.035+0000 7f75837f9700 1 -- 172.21.15.156:0/720654966 wait complete. 2023-09-30T22:18:37.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.035+0000 7f75837f9700 1 Processor -- start 2023-09-30T22:18:37.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.035+0000 7f75837f9700 1 -- start start 2023-09-30T22:18:37.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.036+0000 7f75837f9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f757c099a60 0x7f757c11d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:37.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.036+0000 7f75837f9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f757c0a0e20 0x7f757c11dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:37.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.036+0000 7f75837f9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f757c133b80 0x7f757c11e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:37.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.036+0000 7f75837f9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c120fd0 con 0x7f757c0a0e20 2023-09-30T22:18:37.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.036+0000 7f75837f9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757c11f340 con 0x7f757c099a60 2023-09-30T22:18:37.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.036+0000 7f75837f9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f757c121220 con 0x7f757c133b80 2023-09-30T22:18:37.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.036+0000 7f7581d96700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f757c133b80 0x7f757c11e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:37.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.036+0000 7f7581d96700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f757c133b80 0x7f757c11e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34828/0 (socket says 172.21.15.156:34828) 2023-09-30T22:18:37.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.036+0000 7f7581d96700 1 -- 172.21.15.156:0/568374656 learned_addr learned my addr 172.21.15.156:0/568374656 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:37.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.036+0000 7f7580d94700 1 --2- 172.21.15.156:0/568374656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f757c0a0e20 0x7f757c11dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:37.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.036+0000 7f7581d96700 1 -- 172.21.15.156:0/568374656 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f757c099a60 msgr2=0x7f757c11d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:37.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.036+0000 7f7581d96700 1 --2- 172.21.15.156:0/568374656 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f757c099a60 0x7f757c11d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:37.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.036+0000 7f7581d96700 1 -- 172.21.15.156:0/568374656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f757c0a0e20 msgr2=0x7f757c11dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:37.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.036+0000 7f7581d96700 1 --2- 172.21.15.156:0/568374656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f757c0a0e20 0x7f757c11dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:37.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.036+0000 7f7581d96700 1 -- 172.21.15.156:0/568374656 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7578009430 con 0x7f757c133b80 2023-09-30T22:18:37.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.036+0000 7f7580d94700 1 --2- 172.21.15.156:0/568374656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f757c0a0e20 0x7f757c11dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:18:37.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.037+0000 7f7581d96700 1 --2- 172.21.15.156:0/568374656 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f757c133b80 0x7f757c11e250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f757400cb70 tx=0x7f757400cf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:37.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.037+0000 7f7571ffb700 1 -- 172.21.15.156:0/568374656 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757400ab10 con 0x7f757c133b80 2023-09-30T22:18:37.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.037+0000 7f7571ffb700 1 -- 172.21.15.156:0/568374656 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757400ac70 con 0x7f757c133b80 2023-09-30T22:18:37.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.037+0000 7f75837f9700 1 -- 172.21.15.156:0/568374656 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f757c09c280 con 0x7f757c133b80 2023-09-30T22:18:37.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.037+0000 7f7571ffb700 1 -- 172.21.15.156:0/568374656 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574012400 con 0x7f757c133b80 2023-09-30T22:18:37.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.037+0000 7f75837f9700 1 -- 172.21.15.156:0/568374656 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757c09a320 con 0x7f757c133b80 2023-09-30T22:18:37.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.038+0000 7f75837f9700 1 -- 172.21.15.156:0/568374656 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f757c11a590 con 0x7f757c133b80 2023-09-30T22:18:37.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.039+0000 7f7571ffb700 1 -- 172.21.15.156:0/568374656 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f757401b3b0 con 0x7f757c133b80 2023-09-30T22:18:37.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.039+0000 7f7571ffb700 1 -- 172.21.15.156:0/568374656 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f757401be10 con 0x7f757c133b80 2023-09-30T22:18:37.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.039+0000 7f7581595700 1 -- 172.21.15.156:0/568374656 >> v1:172.21.15.156:6816/118236 conn(0x7f756002c200 legacy=0x7f756002e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/118236 2023-09-30T22:18:37.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.043+0000 7f7571ffb700 1 -- 172.21.15.156:0/568374656 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f7574041060 con 0x7f757c133b80 2023-09-30T22:18:37.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.052+0000 7f72ccab8700 1 -- 172.21.15.156:0/340499053 >> v1:172.21.15.156:6816/118236 conn(0x7f72ac02c1b0 legacy=0x7f72ac02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/118236 2023-09-30T22:18:37.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.060+0000 7f72ced1c700 1 -- 172.21.15.156:0/340499053 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f72c804f2a0 con 0x7f72c8135f20 2023-09-30T22:18:37.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.061+0000 7f72c57fa700 1 -- 172.21.15.156:0/340499053 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f72c00232d0 con 0x7f72c8135f20 2023-09-30T22:18:37.062 INFO:teuthology.orchestra.run.smithi156.stdout:38654705691 2023-09-30T22:18:37.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.063+0000 7f72ced1c700 1 -- 172.21.15.156:0/340499053 >> v1:172.21.15.156:6816/118236 conn(0x7f72ac02c1b0 legacy=0x7f72ac02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:18:37.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.063+0000 7f72ced1c700 1 -- 172.21.15.156:0/340499053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72c8135f20 msgr2=0x7f72c811a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:37.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.063+0000 7f72ced1c700 1 --2- 172.21.15.156:0/340499053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72c8135f20 0x7f72c811a0b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f72c0010720 tx=0x7f72c0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:18:37.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.063+0000 7f72ced1c700 1 -- 172.21.15.156:0/340499053 shutdown_connections 2023-09-30T22:18:37.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.063+0000 7f72ced1c700 1 --2- 172.21.15.156:0/340499053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72c8135f20 0x7f72c811a0b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:37.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.063+0000 7f72ced1c700 1 --2- 172.21.15.156:0/340499053 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72c809d860 0x7f72c8119630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:37.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.063+0000 7f72ced1c700 1 --2- 172.21.15.156:0/340499053 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72c809e340 0x7f72c8119b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:37.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.063+0000 7f72ced1c700 1 -- 172.21.15.156:0/340499053 >> 172.21.15.156:0/340499053 conn(0x7f72c8099c40 msgr2=0x7f72c81329c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:37.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.063+0000 7f72ced1c700 1 -- 172.21.15.156:0/340499053 shutdown_connections 2023-09-30T22:18:37.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.064+0000 7f72ced1c700 1 -- 172.21.15.156:0/340499053 wait complete. 2023-09-30T22:18:37.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705691 for osd.0 2023-09-30T22:18:37.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.096+0000 7ff747fff700 1 -- 172.21.15.156:0/331125656 >> v1:172.21.15.156:6816/118236 conn(0x7ff72c02c1b0 legacy=0x7ff72c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/118236 2023-09-30T22:18:37.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.154+0000 7ff74ed9c700 1 -- 172.21.15.156:0/331125656 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff74804f2a0 con 0x7ff74809e870 2023-09-30T22:18:37.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.155+0000 7ff7457fa700 1 -- 172.21.15.156:0/331125656 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff73c015020 con 0x7ff74809e870 2023-09-30T22:18:37.155 INFO:teuthology.orchestra.run.smithi156.stdout:38654705691 2023-09-30T22:18:37.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.157+0000 7ff74ed9c700 1 -- 172.21.15.156:0/331125656 >> v1:172.21.15.156:6816/118236 conn(0x7ff72c02c1b0 legacy=0x7ff72c02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:18:37.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.157+0000 7ff74ed9c700 1 -- 172.21.15.156:0/331125656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff74809e870 msgr2=0x7ff7481203e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:37.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.157+0000 7ff74ed9c700 1 --2- 172.21.15.156:0/331125656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff74809e870 0x7ff7481203e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff74809afc0 tx=0x7ff73c004750 comp rx=0 tx=0).stop 2023-09-30T22:18:37.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.157+0000 7ff74ed9c700 1 -- 172.21.15.156:0/331125656 shutdown_connections 2023-09-30T22:18:37.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.157+0000 7ff74ed9c700 1 --2- 172.21.15.156:0/331125656 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff748131d70 0x7ff748120e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:37.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.157+0000 7ff74ed9c700 1 --2- 172.21.15.156:0/331125656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff74809e870 0x7ff7481203e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:37.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.157+0000 7ff74ed9c700 1 --2- 172.21.15.156:0/331125656 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff74809f180 0x7ff748120920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:37.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.157+0000 7ff74ed9c700 1 -- 172.21.15.156:0/331125656 >> 172.21.15.156:0/331125656 conn(0x7ff7480a4430 msgr2=0x7ff74806fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:37.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.157+0000 7ff74ed9c700 1 -- 172.21.15.156:0/331125656 shutdown_connections 2023-09-30T22:18:37.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.157+0000 7ff74ed9c700 1 -- 172.21.15.156:0/331125656 wait complete. 2023-09-30T22:18:37.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.160+0000 7fecb5f31700 1 -- 172.21.15.156:0/1686480515 >> v1:172.21.15.156:6816/118236 conn(0x7fec9402c1e0 legacy=0x7fec9402e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/118236 2023-09-30T22:18:37.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705691 for osd.2 2023-09-30T22:18:37.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.201+0000 7fecb8195700 1 -- 172.21.15.156:0/1686480515 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fec98005590 con 0x7fecb0133f70 2023-09-30T22:18:37.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.201+0000 7feca67fc700 1 -- 172.21.15.156:0/1686480515 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feca0011be0 con 0x7fecb0133f70 2023-09-30T22:18:37.202 INFO:teuthology.orchestra.run.smithi156.stdout:38654705691 2023-09-30T22:18:37.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.203+0000 7fecb8195700 1 -- 172.21.15.156:0/1686480515 >> v1:172.21.15.156:6816/118236 conn(0x7fec9402c1e0 legacy=0x7fec9402e690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:18:37.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.203+0000 7fecb8195700 1 -- 172.21.15.156:0/1686480515 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecb0133f70 msgr2=0x7fecb011ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:37.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.203+0000 7fecb8195700 1 --2- 172.21.15.156:0/1686480515 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecb0133f70 0x7fecb011ec80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7feca000c460 tx=0x7feca000c770 comp rx=0 tx=0).stop 2023-09-30T22:18:37.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.203+0000 7fecb8195700 1 -- 172.21.15.156:0/1686480515 shutdown_connections 2023-09-30T22:18:37.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.203+0000 7fecb8195700 1 --2- 172.21.15.156:0/1686480515 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecb01343a0 0x7fecb01c3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:37.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.203+0000 7fecb8195700 1 --2- 172.21.15.156:0/1686480515 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fecb009ad40 0x7fecb011e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:37.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.203+0000 7fecb8195700 1 --2- 172.21.15.156:0/1686480515 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecb0133f70 0x7fecb011ec80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:37.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.203+0000 7fecb8195700 1 -- 172.21.15.156:0/1686480515 >> 172.21.15.156:0/1686480515 conn(0x7fecb0099c40 msgr2=0x7fecb00a6890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:37.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.203+0000 7fecb8195700 1 -- 172.21.15.156:0/1686480515 shutdown_connections 2023-09-30T22:18:37.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.204+0000 7fecb8195700 1 -- 172.21.15.156:0/1686480515 wait complete. 2023-09-30T22:18:37.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705691 for osd.3 2023-09-30T22:18:37.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.224+0000 7f75837f9700 1 -- 172.21.15.156:0/568374656 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f757c04f2a0 con 0x7f757c133b80 2023-09-30T22:18:37.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.224+0000 7f7571ffb700 1 -- 172.21.15.156:0/568374656 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7574041070 con 0x7f757c133b80 2023-09-30T22:18:37.225 INFO:teuthology.orchestra.run.smithi156.stdout:38654705691 2023-09-30T22:18:37.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.227+0000 7f75837f9700 1 -- 172.21.15.156:0/568374656 >> v1:172.21.15.156:6816/118236 conn(0x7f756002c200 legacy=0x7f756002e6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:18:37.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.227+0000 7f75837f9700 1 -- 172.21.15.156:0/568374656 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f757c133b80 msgr2=0x7f757c11e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:37.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.227+0000 7f75837f9700 1 --2- 172.21.15.156:0/568374656 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f757c133b80 0x7f757c11e250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f757400cb70 tx=0x7f757400cf30 comp rx=0 tx=0).stop 2023-09-30T22:18:37.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.227+0000 7f75837f9700 1 -- 172.21.15.156:0/568374656 shutdown_connections 2023-09-30T22:18:37.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.227+0000 7f75837f9700 1 --2- 172.21.15.156:0/568374656 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f757c133b80 0x7f757c11e250 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:37.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.227+0000 7f75837f9700 1 --2- 172.21.15.156:0/568374656 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f757c099a60 0x7f757c11d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:37.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.227+0000 7f75837f9700 1 --2- 172.21.15.156:0/568374656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f757c0a0e20 0x7f757c11dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:37.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.227+0000 7f75837f9700 1 -- 172.21.15.156:0/568374656 >> 172.21.15.156:0/568374656 conn(0x7f757c0a2980 msgr2=0x7f757c1bac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:37.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.227+0000 7f75837f9700 1 -- 172.21.15.156:0/568374656 shutdown_connections 2023-09-30T22:18:37.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:37.227+0000 7f75837f9700 1 -- 172.21.15.156:0/568374656 wait complete. 2023-09-30T22:18:37.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705691 for osd.1 2023-09-30T22:18:37.376 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:37.375+0000 7f82ca115240 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-30T22:18:37.497 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:37.496+0000 7f82ca115240 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-30T22:18:37.650 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:37.650+0000 7f82ca115240 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-30T22:18:37.753 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:37.753+0000 7f82ca115240 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-30T22:18:37.833 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:37.832+0000 7f8244fa6700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:18:37.833 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:37.832+0000 7f8244fa6700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:18:37.833 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:37.832+0000 7f8244fa6700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:18:37.834 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:37.832+0000 7f8244fa6700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:18:37.834 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:37.832+0000 7f8244fa6700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:18:37.834 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:37.833+0000 7f8248fae700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:18:37.834 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:37.833+0000 7f8248fae700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:18:37.834 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:37.833+0000 7f8248fae700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:18:37.834 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:37.833+0000 7f8248fae700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:18:37.834 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:37.833+0000 7f8248fae700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:18:38.084 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:18:38.171 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:18:38.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.208+0000 7fcb0b6c7700 1 Processor -- start 2023-09-30T22:18:38.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.208+0000 7fcb0b6c7700 1 -- start start 2023-09-30T22:18:38.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.209+0000 7fcb0b6c7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcb0409e870 0x7fcb0409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:38.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.209+0000 7fcb0b6c7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcb0409f180 0x7fcb04131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:38.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.209+0000 7fcb0b6c7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcb04131d70 0x7fcb041321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:38.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.209+0000 7fcb0b6c7700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb040a0920 con 0x7fcb0409e870 2023-09-30T22:18:38.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.209+0000 7fcb0b6c7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0409c970 con 0x7fcb0409f180 2023-09-30T22:18:38.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.209+0000 7fcb0b6c7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0409bab0 con 0x7fcb04131d70 2023-09-30T22:18:38.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.209+0000 7fcb09463700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcb0409e870 0x7fcb0409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:38.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.209+0000 7fcb08c62700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcb0409f180 0x7fcb04131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:38.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.209+0000 7fcb09c64700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcb04131d70 0x7fcb041321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:38.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.209+0000 7fcb08c62700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcb0409f180 0x7fcb04131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:58054/0 (socket says 172.21.15.156:58054) 2023-09-30T22:18:38.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.209+0000 7fcb09c64700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcb04131d70 0x7fcb041321f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34900/0 (socket says 172.21.15.156:34900) 2023-09-30T22:18:38.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.209+0000 7fcb09463700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcb0409e870 0x7fcb0409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39608/0 (socket says 172.21.15.156:39608) 2023-09-30T22:18:38.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.209+0000 7fcb08c62700 1 -- 172.21.15.156:0/1486454124 learned_addr learned my addr 172.21.15.156:0/1486454124 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:38.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.209+0000 7fcb08c62700 1 -- 172.21.15.156:0/1486454124 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcb04131d70 msgr2=0x7fcb041321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:38.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.209+0000 7fcb08c62700 1 --2- 172.21.15.156:0/1486454124 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcb04131d70 0x7fcb041321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.209+0000 7fcb08c62700 1 -- 172.21.15.156:0/1486454124 >> v2:172.21.15.156:3300/0 conn(0x7fcb0409e870 msgr2=0x7fcb0409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:38.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.209+0000 7fcb08c62700 1 --2- 172.21.15.156:0/1486454124 >> v2:172.21.15.156:3300/0 conn(0x7fcb0409e870 0x7fcb0409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.209+0000 7fcb08c62700 1 -- 172.21.15.156:0/1486454124 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0409f9c0 con 0x7fcb0409f180 2023-09-30T22:18:38.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.209+0000 7fcb09463700 1 --2- 172.21.15.156:0/1486454124 >> v2:172.21.15.156:3300/0 conn(0x7fcb0409e870 0x7fcb0409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:38.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.209+0000 7fcb09c64700 1 --2- 172.21.15.156:0/1486454124 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcb04131d70 0x7fcb041321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:38.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.210+0000 7fcb08c62700 1 --2- 172.21.15.156:0/1486454124 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcb0409f180 0x7fcb04131830 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4009920 tx=0x7fcaf4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=208f89d1dd04afc1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:38.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.210+0000 7fcafbfff700 1 -- 172.21.15.156:0/1486454124 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4011830 con 0x7fcb0409f180 2023-09-30T22:18:38.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.210+0000 7fcafbfff700 1 -- 172.21.15.156:0/1486454124 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf4011990 con 0x7fcb0409f180 2023-09-30T22:18:38.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.210+0000 7fcafbfff700 1 -- 172.21.15.156:0/1486454124 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4011d20 con 0x7fcb0409f180 2023-09-30T22:18:38.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.210+0000 7fcb0b6c7700 1 -- 172.21.15.156:0/1486454124 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcb0409f180 msgr2=0x7fcb04131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:38.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.210+0000 7fcb0b6c7700 1 --2- 172.21.15.156:0/1486454124 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcb0409f180 0x7fcb04131830 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4009920 tx=0x7fcaf4009c30 comp rx=0 tx=0).stop 2023-09-30T22:18:38.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.210+0000 7fcb0b6c7700 1 -- 172.21.15.156:0/1486454124 shutdown_connections 2023-09-30T22:18:38.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.210+0000 7fcb0b6c7700 1 --2- 172.21.15.156:0/1486454124 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcb04131d70 0x7fcb041321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.210+0000 7fcb0b6c7700 1 --2- 172.21.15.156:0/1486454124 >> v2:172.21.15.156:3300/0 conn(0x7fcb0409e870 0x7fcb0409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.210+0000 7fcb0b6c7700 1 --2- 172.21.15.156:0/1486454124 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcb0409f180 0x7fcb04131830 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.210+0000 7fcb0b6c7700 1 -- 172.21.15.156:0/1486454124 >> 172.21.15.156:0/1486454124 conn(0x7fcb040a4430 msgr2=0x7fcb040a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:38.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.210+0000 7fcb0b6c7700 1 -- 172.21.15.156:0/1486454124 shutdown_connections 2023-09-30T22:18:38.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.211+0000 7fcb0b6c7700 1 -- 172.21.15.156:0/1486454124 wait complete. 2023-09-30T22:18:38.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.211+0000 7fcb0b6c7700 1 Processor -- start 2023-09-30T22:18:38.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.211+0000 7fcb0b6c7700 1 -- start start 2023-09-30T22:18:38.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.212+0000 7fcb0b6c7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcb0409e870 0x7fcb04120310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:38.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.212+0000 7fcb0b6c7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcb0409f180 0x7fcb04120850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:38.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.212+0000 7fcb0b6c7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb04131d70 0x7fcb04120d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:38.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.212+0000 7fcb0b6c7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb04123b50 con 0x7fcb04131d70 2023-09-30T22:18:38.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.212+0000 7fcb0b6c7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb04123e30 con 0x7fcb0409f180 2023-09-30T22:18:38.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.212+0000 7fcb0b6c7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0409b160 con 0x7fcb0409e870 2023-09-30T22:18:38.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.212+0000 7fcb09463700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcb0409e870 0x7fcb04120310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:38.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.212+0000 7fcb09463700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcb0409e870 0x7fcb04120310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34916/0 (socket says 172.21.15.156:34916) 2023-09-30T22:18:38.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.212+0000 7fcb09463700 1 -- 172.21.15.156:0/3403985603 learned_addr learned my addr 172.21.15.156:0/3403985603 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:38.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.212+0000 7fcb09c64700 1 --2- 172.21.15.156:0/3403985603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb04131d70 0x7fcb04120d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:38.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.212+0000 7fcb08c62700 1 --2- 172.21.15.156:0/3403985603 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcb0409f180 0x7fcb04120850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:38.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.212+0000 7fcb09463700 1 -- 172.21.15.156:0/3403985603 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcb0409f180 msgr2=0x7fcb04120850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:38.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.212+0000 7fcb09463700 1 --2- 172.21.15.156:0/3403985603 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcb0409f180 0x7fcb04120850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.212+0000 7fcb09463700 1 -- 172.21.15.156:0/3403985603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb04131d70 msgr2=0x7fcb04120d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:38.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.212+0000 7fcb09463700 1 --2- 172.21.15.156:0/3403985603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb04131d70 0x7fcb04120d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.212+0000 7fcb09463700 1 -- 172.21.15.156:0/3403985603 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb000094a0 con 0x7fcb0409e870 2023-09-30T22:18:38.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.212+0000 7fcb09463700 1 --2- 172.21.15.156:0/3403985603 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcb0409e870 0x7fcb04120310 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000ebe0 tx=0x7fcb0000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:38.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.213+0000 7fcaf9ffb700 1 -- 172.21.15.156:0/3403985603 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb00009780 con 0x7fcb0409e870 2023-09-30T22:18:38.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.213+0000 7fcaf9ffb700 1 -- 172.21.15.156:0/3403985603 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0000c850 con 0x7fcb0409e870 2023-09-30T22:18:38.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.213+0000 7fcb0b6c7700 1 -- 172.21.15.156:0/3403985603 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcafc009a70 con 0x7fcb0409e870 2023-09-30T22:18:38.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.213+0000 7fcaf9ffb700 1 -- 172.21.15.156:0/3403985603 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0000cbe0 con 0x7fcb0409e870 2023-09-30T22:18:38.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.213+0000 7fcb0b6c7700 1 -- 172.21.15.156:0/3403985603 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf4009550 con 0x7fcb0409e870 2023-09-30T22:18:38.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.213+0000 7fcaf9ffb700 1 -- 172.21.15.156:0/3403985603 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7fcb0000cd40 con 0x7fcb0409e870 2023-09-30T22:18:38.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.214+0000 7fcaf9ffb700 1 -- 172.21.15.156:0/3403985603 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4055+0+0 (secure 0 0 0) 0x7fcb0003f990 con 0x7fcb0409e870 2023-09-30T22:18:38.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.214+0000 7fcb0b6c7700 1 -- 172.21.15.156:0/3403985603 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb0409b640 con 0x7fcb0409e870 2023-09-30T22:18:38.219 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:18:38.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.218+0000 7fcaf9ffb700 1 -- 172.21.15.156:0/3403985603 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fcb00011b00 con 0x7fcb0409e870 2023-09-30T22:18:38.242 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:18:38.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.312+0000 7f33f046f700 1 Processor -- start 2023-09-30T22:18:38.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.313+0000 7f33f046f700 1 -- start start 2023-09-30T22:18:38.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.313+0000 7f33f046f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f33e80a09f0 0x7f33e80a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:38.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.313+0000 7f33f046f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33e8130670 0x7f33e81381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:38.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.313+0000 7f33f046f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e809a7c0 con 0x7f33e80a1300 2023-09-30T22:18:38.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.313+0000 7f33f046f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e809ad40 con 0x7f33e80a09f0 2023-09-30T22:18:38.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.313+0000 7f33f046f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e809b5c0 con 0x7f33e8130670 2023-09-30T22:18:38.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.313+0000 7f33eea0c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33e8130670 0x7f33e81381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:38.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.313+0000 7f33eea0c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33e8130670 0x7f33e81381c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:58064/0 (socket says 172.21.15.156:58064) 2023-09-30T22:18:38.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.313+0000 7f33eea0c700 1 -- 172.21.15.156:0/2528090496 learned_addr learned my addr 172.21.15.156:0/2528090496 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:38.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.314+0000 7f33ee20b700 1 --2- 172.21.15.156:0/2528090496 >> v2:172.21.15.156:3300/0 conn(0x7f33e80a09f0 0x7f33e80a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:38.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.314+0000 7f33eea0c700 1 -- 172.21.15.156:0/2528090496 >> v2:172.21.15.156:3300/0 conn(0x7f33e80a09f0 msgr2=0x7f33e80a0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:38.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.314+0000 7f33eea0c700 1 --2- 172.21.15.156:0/2528090496 >> v2:172.21.15.156:3300/0 conn(0x7f33e80a09f0 0x7f33e80a0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.314+0000 7f33eea0c700 1 -- 172.21.15.156:0/2528090496 >> v1:172.21.15.156:6789/0 conn(0x7f33e80a1300 legacy=0x7f33e812ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:38.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.314+0000 7f33eea0c700 1 -- 172.21.15.156:0/2528090496 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e809c480 con 0x7f33e8130670 2023-09-30T22:18:38.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.314+0000 7f33eea0c700 1 --2- 172.21.15.156:0/2528090496 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33e8130670 0x7f33e81381c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f33e000af90 tx=0x7f33e000c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=481f8faa7fa5175d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:38.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.314+0000 7f33ed209700 1 -- 172.21.15.156:0/2528090496 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e000f070 con 0x7f33e8130670 2023-09-30T22:18:38.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.314+0000 7f33ed209700 1 -- 172.21.15.156:0/2528090496 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e000a2e0 con 0x7f33e8130670 2023-09-30T22:18:38.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.314+0000 7f33ed209700 1 -- 172.21.15.156:0/2528090496 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e000cca0 con 0x7f33e8130670 2023-09-30T22:18:38.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.315+0000 7f33f046f700 1 -- 172.21.15.156:0/2528090496 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33e8130670 msgr2=0x7f33e81381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:38.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.315+0000 7f33f046f700 1 --2- 172.21.15.156:0/2528090496 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33e8130670 0x7f33e81381c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f33e000af90 tx=0x7f33e000c330 comp rx=0 tx=0).stop 2023-09-30T22:18:38.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.315+0000 7f33f046f700 1 -- 172.21.15.156:0/2528090496 shutdown_connections 2023-09-30T22:18:38.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.315+0000 7f33f046f700 1 --2- 172.21.15.156:0/2528090496 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33e8130670 0x7f33e81381c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.315+0000 7f33f046f700 1 --2- 172.21.15.156:0/2528090496 >> v2:172.21.15.156:3300/0 conn(0x7f33e80a09f0 0x7f33e80a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.315+0000 7f33f046f700 1 -- 172.21.15.156:0/2528090496 >> 172.21.15.156:0/2528090496 conn(0x7f33e80a2980 msgr2=0x7f33e80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:38.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.315+0000 7f33f046f700 1 -- 172.21.15.156:0/2528090496 shutdown_connections 2023-09-30T22:18:38.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.315+0000 7f33f046f700 1 -- 172.21.15.156:0/2528090496 wait complete. 2023-09-30T22:18:38.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.316+0000 7f33f046f700 1 Processor -- start 2023-09-30T22:18:38.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.316+0000 7f33f046f700 1 -- start start 2023-09-30T22:18:38.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.317+0000 7f33f046f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33e80a09f0 0x7f33e811a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:38.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.317+0000 7f33f046f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33e80a1300 0x7f33e811aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:38.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.317+0000 7f33f046f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33e8130670 0x7f33e81c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:38.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.317+0000 7f33f046f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e811d940 con 0x7f33e8130670 2023-09-30T22:18:38.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.317+0000 7f33f046f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e811c240 con 0x7f33e80a1300 2023-09-30T22:18:38.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.317+0000 7f33f046f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33e811db20 con 0x7f33e80a09f0 2023-09-30T22:18:38.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.317+0000 7f33eea0c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33e8130670 0x7f33e81c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:38.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.317+0000 7f33eea0c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33e8130670 0x7f33e81c3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39634/0 (socket says 172.21.15.156:39634) 2023-09-30T22:18:38.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.317+0000 7f33eea0c700 1 -- 172.21.15.156:0/2555090767 learned_addr learned my addr 172.21.15.156:0/2555090767 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:38.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.317+0000 7f33eda0a700 1 --2- 172.21.15.156:0/2555090767 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33e80a1300 0x7f33e811aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:38.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.318+0000 7f33ee20b700 1 --2- 172.21.15.156:0/2555090767 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33e80a09f0 0x7f33e811a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:38.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.318+0000 7f33eea0c700 1 -- 172.21.15.156:0/2555090767 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33e80a09f0 msgr2=0x7f33e811a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:38.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.318+0000 7f33eea0c700 1 --2- 172.21.15.156:0/2555090767 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33e80a09f0 0x7f33e811a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.318+0000 7f33eea0c700 1 -- 172.21.15.156:0/2555090767 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33e80a1300 msgr2=0x7f33e811aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:38.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.318+0000 7f33eea0c700 1 --2- 172.21.15.156:0/2555090767 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33e80a1300 0x7f33e811aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.318+0000 7f33eea0c700 1 -- 172.21.15.156:0/2555090767 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e000ac40 con 0x7f33e8130670 2023-09-30T22:18:38.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.318+0000 7f33eea0c700 1 --2- 172.21.15.156:0/2555090767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33e8130670 0x7f33e81c3d70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f33e809b700 tx=0x7f33e0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:38.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.318+0000 7f33deffd700 1 -- 172.21.15.156:0/2555090767 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e0004930 con 0x7f33e8130670 2023-09-30T22:18:38.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.318+0000 7f33deffd700 1 -- 172.21.15.156:0/2555090767 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e00082b0 con 0x7f33e8130670 2023-09-30T22:18:38.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.318+0000 7f33f046f700 1 -- 172.21.15.156:0/2555090767 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e811a4c0 con 0x7f33e8130670 2023-09-30T22:18:38.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.318+0000 7f33deffd700 1 -- 172.21.15.156:0/2555090767 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e0008740 con 0x7f33e8130670 2023-09-30T22:18:38.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.318+0000 7f33f046f700 1 -- 172.21.15.156:0/2555090767 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e809fe80 con 0x7f33e8130670 2023-09-30T22:18:38.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.319+0000 7f33deffd700 1 -- 172.21.15.156:0/2555090767 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f33e00088a0 con 0x7f33e8130670 2023-09-30T22:18:38.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.319+0000 7f33deffd700 1 -- 172.21.15.156:0/2555090767 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4055+0+0 (secure 0 0 0) 0x7f33e00412e0 con 0x7f33e8130670 2023-09-30T22:18:38.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.319+0000 7f33f046f700 1 -- 172.21.15.156:0/2555090767 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e811c460 con 0x7f33e8130670 2023-09-30T22:18:38.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.328+0000 7f33deffd700 1 -- 172.21.15.156:0/2555090767 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f33e00257d0 con 0x7f33e8130670 2023-09-30T22:18:38.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.354+0000 7f2515c76700 1 Processor -- start 2023-09-30T22:18:38.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.354+0000 7f2515c76700 1 -- start start 2023-09-30T22:18:38.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.354+0000 7f2515c76700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2510138040 0x7f2510138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:38.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.354+0000 7f2515c76700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25100a08e0 0x7f25100a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:38.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.354+0000 7f2515c76700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25101379e0 con 0x7f25100a1230 2023-09-30T22:18:38.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.354+0000 7f2515c76700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25100a2100 con 0x7f2510138040 2023-09-30T22:18:38.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.354+0000 7f2515c76700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2510138950 con 0x7f25100a08e0 2023-09-30T22:18:38.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.355+0000 7f250effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25100a08e0 0x7f25100a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:38.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.355+0000 7f250effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25100a08e0 0x7f25100a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34932/0 (socket says 172.21.15.156:34932) 2023-09-30T22:18:38.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.355+0000 7f250effd700 1 -- 172.21.15.156:0/1347929021 learned_addr learned my addr 172.21.15.156:0/1347929021 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:38.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.355+0000 7f250f7fe700 1 --2- 172.21.15.156:0/1347929021 >> v2:172.21.15.156:3300/0 conn(0x7f2510138040 0x7f2510138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:38.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.355+0000 7f250e7fc700 1 -- 172.21.15.156:0/1347929021 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 608183328 0 0) 0x7f25101379e0 con 0x7f25100a1230 2023-09-30T22:18:38.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.355+0000 7f250e7fc700 1 -- 172.21.15.156:0/1347929021 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24f80035b0 con 0x7f25100a1230 2023-09-30T22:18:38.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.355+0000 7f250effd700 1 -- 172.21.15.156:0/1347929021 >> v2:172.21.15.156:3300/0 conn(0x7f2510138040 msgr2=0x7f2510138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:38.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.355+0000 7f250effd700 1 --2- 172.21.15.156:0/1347929021 >> v2:172.21.15.156:3300/0 conn(0x7f2510138040 0x7f2510138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.355+0000 7f250effd700 1 -- 172.21.15.156:0/1347929021 >> v1:172.21.15.156:6789/0 conn(0x7f25100a1230 legacy=0x7f251013ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:38.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.355+0000 7f250effd700 1 -- 172.21.15.156:0/1347929021 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251009b9b0 con 0x7f25100a08e0 2023-09-30T22:18:38.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.355+0000 7f250f7fe700 1 --2- 172.21.15.156:0/1347929021 >> v2:172.21.15.156:3300/0 conn(0x7f2510138040 0x7f2510138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:18:38.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.355+0000 7f250effd700 1 --2- 172.21.15.156:0/1347929021 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25100a08e0 0x7f25100a0cf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2504009920 tx=0x7f2504009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1803997ec8e3e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:38.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.356+0000 7f250e7fc700 1 -- 172.21.15.156:0/1347929021 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2504011830 con 0x7f25100a08e0 2023-09-30T22:18:38.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.356+0000 7f250e7fc700 1 -- 172.21.15.156:0/1347929021 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2504011990 con 0x7f25100a08e0 2023-09-30T22:18:38.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.356+0000 7f250e7fc700 1 -- 172.21.15.156:0/1347929021 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2504011d20 con 0x7f25100a08e0 2023-09-30T22:18:38.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.356+0000 7f2515c76700 1 -- 172.21.15.156:0/1347929021 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25100a08e0 msgr2=0x7f25100a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:38.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.356+0000 7f2515c76700 1 --2- 172.21.15.156:0/1347929021 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25100a08e0 0x7f25100a0cf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2504009920 tx=0x7f2504009c30 comp rx=0 tx=0).stop 2023-09-30T22:18:38.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.356+0000 7f2515c76700 1 -- 172.21.15.156:0/1347929021 shutdown_connections 2023-09-30T22:18:38.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.356+0000 7f2515c76700 1 --2- 172.21.15.156:0/1347929021 >> v2:172.21.15.156:3300/0 conn(0x7f2510138040 0x7f2510138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.356+0000 7f2515c76700 1 --2- 172.21.15.156:0/1347929021 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25100a08e0 0x7f25100a0cf0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.356+0000 7f2515c76700 1 -- 172.21.15.156:0/1347929021 >> 172.21.15.156:0/1347929021 conn(0x7f25100a2980 msgr2=0x7f25100a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:38.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.356+0000 7f2515c76700 1 -- 172.21.15.156:0/1347929021 shutdown_connections 2023-09-30T22:18:38.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.356+0000 7f2515c76700 1 -- 172.21.15.156:0/1347929021 wait complete. 2023-09-30T22:18:38.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.357+0000 7f2515c76700 1 Processor -- start 2023-09-30T22:18:38.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.358+0000 7f2515c76700 1 -- start start 2023-09-30T22:18:38.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.358+0000 7f2515c76700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25100a08e0 0x7f2510137100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:38.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.358+0000 7f2515c76700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25100a1230 0x7f2510135900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:38.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.358+0000 7f2515c76700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2510138040 0x7f2510135e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:38.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.358+0000 7f2515c76700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2510119000 con 0x7f2510138040 2023-09-30T22:18:38.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.358+0000 7f2515c76700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251012ffd0 con 0x7f25100a1230 2023-09-30T22:18:38.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.358+0000 7f2515c76700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2510140d60 con 0x7f25100a08e0 2023-09-30T22:18:38.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.358+0000 7f250f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25100a08e0 0x7f2510137100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:38.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.358+0000 7f250f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25100a08e0 0x7f2510137100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34948/0 (socket says 172.21.15.156:34948) 2023-09-30T22:18:38.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.358+0000 7f250f7fe700 1 -- 172.21.15.156:0/973100839 learned_addr learned my addr 172.21.15.156:0/973100839 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:38.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.358+0000 7f250effd700 1 --2- 172.21.15.156:0/973100839 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25100a1230 0x7f2510135900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:38.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.358+0000 7f250ffff700 1 --2- 172.21.15.156:0/973100839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2510138040 0x7f2510135e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:38.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.359+0000 7f250f7fe700 1 -- 172.21.15.156:0/973100839 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25100a1230 msgr2=0x7f2510135900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:38.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.359+0000 7f250f7fe700 1 --2- 172.21.15.156:0/973100839 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25100a1230 0x7f2510135900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.359+0000 7f250f7fe700 1 -- 172.21.15.156:0/973100839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2510138040 msgr2=0x7f2510135e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:38.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.359+0000 7f250f7fe700 1 --2- 172.21.15.156:0/973100839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2510138040 0x7f2510135e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.359+0000 7f250f7fe700 1 -- 172.21.15.156:0/973100839 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2504009550 con 0x7f25100a08e0 2023-09-30T22:18:38.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.359+0000 7f250effd700 1 --2- 172.21.15.156:0/973100839 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25100a1230 0x7f2510135900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:38.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.359+0000 7f250f7fe700 1 --2- 172.21.15.156:0/973100839 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25100a08e0 0x7f2510137100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f250000e840 tx=0x7f250000eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:38.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.359+0000 7f24f7fff700 1 -- 172.21.15.156:0/973100839 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2500005c20 con 0x7f25100a08e0 2023-09-30T22:18:38.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.359+0000 7f24f7fff700 1 -- 172.21.15.156:0/973100839 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2500005d80 con 0x7f25100a08e0 2023-09-30T22:18:38.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.359+0000 7f24f7fff700 1 -- 172.21.15.156:0/973100839 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2500006230 con 0x7f25100a08e0 2023-09-30T22:18:38.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.359+0000 7f2515c76700 1 -- 172.21.15.156:0/973100839 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2510140370 con 0x7f25100a08e0 2023-09-30T22:18:38.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.359+0000 7f2515c76700 1 -- 172.21.15.156:0/973100839 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251013f090 con 0x7f25100a08e0 2023-09-30T22:18:38.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.360+0000 7f2515c76700 1 -- 172.21.15.156:0/973100839 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251004f2a0 con 0x7f25100a08e0 2023-09-30T22:18:38.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.360+0000 7f24f7fff700 1 -- 172.21.15.156:0/973100839 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f2500006390 con 0x7f25100a08e0 2023-09-30T22:18:38.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.361+0000 7f24f7fff700 1 -- 172.21.15.156:0/973100839 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4055+0+0 (secure 0 0 0) 0x7f250003ef90 con 0x7f25100a08e0 2023-09-30T22:18:38.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.369+0000 7f24f7fff700 1 -- 172.21.15.156:0/973100839 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f25000228f0 con 0x7f25100a08e0 2023-09-30T22:18:38.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.400+0000 7f12e6c44700 1 Processor -- start 2023-09-30T22:18:38.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.400+0000 7f12e6c44700 1 -- start start 2023-09-30T22:18:38.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.401+0000 7f12e6c44700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f12e009e950 0x7f12e009ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:38.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.401+0000 7f12e6c44700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12e009f260 0x7f12e0131890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:38.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.401+0000 7f12e6c44700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12e0131dd0 0x7f12e0132250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:38.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.401+0000 7f12e6c44700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e009b6d0 con 0x7f12e009e950 2023-09-30T22:18:38.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.401+0000 7f12e6c44700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e009afb0 con 0x7f12e009f260 2023-09-30T22:18:38.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.401+0000 7f12e6c44700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12e00a0970 con 0x7f12e0131dd0 2023-09-30T22:18:38.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.401+0000 7f12e49e0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f12e009e950 0x7f12e009ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:38.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.401+0000 7f12dffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12e009f260 0x7f12e0131890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:38.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.401+0000 7f12e49e0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f12e009e950 0x7f12e009ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39654/0 (socket says 172.21.15.156:39654) 2023-09-30T22:18:38.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.401+0000 7f12e49e0700 1 -- 172.21.15.156:0/2253861717 learned_addr learned my addr 172.21.15.156:0/2253861717 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:38.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.401+0000 7f12e51e1700 1 --2- 172.21.15.156:0/2253861717 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12e0131dd0 0x7f12e0132250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:38.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.401+0000 7f12dffff700 1 -- 172.21.15.156:0/2253861717 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12e0131dd0 msgr2=0x7f12e0132250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:38.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.401+0000 7f12dffff700 1 --2- 172.21.15.156:0/2253861717 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12e0131dd0 0x7f12e0132250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.401+0000 7f12dffff700 1 -- 172.21.15.156:0/2253861717 >> v2:172.21.15.156:3300/0 conn(0x7f12e009e950 msgr2=0x7f12e009ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:38.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.401+0000 7f12dffff700 1 --2- 172.21.15.156:0/2253861717 >> v2:172.21.15.156:3300/0 conn(0x7f12e009e950 0x7f12e009ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.401+0000 7f12dffff700 1 -- 172.21.15.156:0/2253861717 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e00a0320 con 0x7f12e009f260 2023-09-30T22:18:38.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.401+0000 7f12dffff700 1 --2- 172.21.15.156:0/2253861717 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12e009f260 0x7f12e0131890 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f12cc009840 tx=0x7f12cc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36b4af5c45f7c1a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:38.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.402+0000 7f12df7fe700 1 -- 172.21.15.156:0/2253861717 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc011830 con 0x7f12e009f260 2023-09-30T22:18:38.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.402+0000 7f12df7fe700 1 -- 172.21.15.156:0/2253861717 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12cc011990 con 0x7f12e009f260 2023-09-30T22:18:38.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.402+0000 7f12df7fe700 1 -- 172.21.15.156:0/2253861717 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc011d20 con 0x7f12e009f260 2023-09-30T22:18:38.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.402+0000 7f12e6c44700 1 -- 172.21.15.156:0/2253861717 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12e009f260 msgr2=0x7f12e0131890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:38.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.402+0000 7f12e6c44700 1 --2- 172.21.15.156:0/2253861717 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12e009f260 0x7f12e0131890 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f12cc009840 tx=0x7f12cc009b50 comp rx=0 tx=0).stop 2023-09-30T22:18:38.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.402+0000 7f12e6c44700 1 -- 172.21.15.156:0/2253861717 shutdown_connections 2023-09-30T22:18:38.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.402+0000 7f12e6c44700 1 --2- 172.21.15.156:0/2253861717 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12e0131dd0 0x7f12e0132250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.402+0000 7f12e6c44700 1 --2- 172.21.15.156:0/2253861717 >> v2:172.21.15.156:3300/0 conn(0x7f12e009e950 0x7f12e009ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.402+0000 7f12e6c44700 1 --2- 172.21.15.156:0/2253861717 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12e009f260 0x7f12e0131890 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.402+0000 7f12e6c44700 1 -- 172.21.15.156:0/2253861717 >> 172.21.15.156:0/2253861717 conn(0x7f12e00a0f70 msgr2=0x7f12e00a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:38.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.402+0000 7f12e6c44700 1 -- 172.21.15.156:0/2253861717 shutdown_connections 2023-09-30T22:18:38.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.402+0000 7f12e6c44700 1 -- 172.21.15.156:0/2253861717 wait complete. 2023-09-30T22:18:38.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.404+0000 7f12e6c44700 1 Processor -- start 2023-09-30T22:18:38.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.404+0000 7f12e6c44700 1 -- start start 2023-09-30T22:18:38.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.404+0000 7f12e6c44700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12e009e950 0x7f12e01c5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:38.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.405+0000 7f12e6c44700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12e009f260 0x7f12e01c56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:38.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.405+0000 7f12e6c44700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12e0131dd0 0x7f12e01c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:38.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.405+0000 7f12e6c44700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e009d0f0 con 0x7f12e0131dd0 2023-09-30T22:18:38.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.405+0000 7f12e6c44700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e01c5c00 con 0x7f12e009e950 2023-09-30T22:18:38.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.405+0000 7f12e6c44700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12e0131c10 con 0x7f12e009f260 2023-09-30T22:18:38.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.405+0000 7f12e49e0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12e009e950 0x7f12e01c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:38.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.405+0000 7f12e49e0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12e009e950 0x7f12e01c5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:58104/0 (socket says 172.21.15.156:58104) 2023-09-30T22:18:38.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.405+0000 7f12e49e0700 1 -- 172.21.15.156:0/694075022 learned_addr learned my addr 172.21.15.156:0/694075022 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:38.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.405+0000 7f12dffff700 1 --2- 172.21.15.156:0/694075022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12e009f260 0x7f12e01c56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:38.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.405+0000 7f12e51e1700 1 --2- 172.21.15.156:0/694075022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12e0131dd0 0x7f12e01c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:38.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.405+0000 7f12e49e0700 1 -- 172.21.15.156:0/694075022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12e009f260 msgr2=0x7f12e01c56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:38.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.405+0000 7f12e49e0700 1 --2- 172.21.15.156:0/694075022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12e009f260 0x7f12e01c56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.405+0000 7f12e49e0700 1 -- 172.21.15.156:0/694075022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12e0131dd0 msgr2=0x7f12e01c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:38.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.405+0000 7f12e49e0700 1 --2- 172.21.15.156:0/694075022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12e0131dd0 0x7f12e01c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.405+0000 7f12e49e0700 1 -- 172.21.15.156:0/694075022 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12cc0094a0 con 0x7f12e009e950 2023-09-30T22:18:38.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.405+0000 7f12e49e0700 1 --2- 172.21.15.156:0/694075022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12e009e950 0x7f12e01c5180 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f12d400e8f0 tx=0x7f12d400ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:38.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.405+0000 7f12dd7fa700 1 -- 172.21.15.156:0/694075022 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d4013680 con 0x7f12e009e950 2023-09-30T22:18:38.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.405+0000 7f12dd7fa700 1 -- 172.21.15.156:0/694075022 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d40137e0 con 0x7f12e009e950 2023-09-30T22:18:38.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.405+0000 7f12dd7fa700 1 -- 172.21.15.156:0/694075022 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d4013b90 con 0x7f12e009e950 2023-09-30T22:18:38.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.405+0000 7f12e6c44700 1 -- 172.21.15.156:0/694075022 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e009daa0 con 0x7f12e009e950 2023-09-30T22:18:38.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.405+0000 7f12e6c44700 1 -- 172.21.15.156:0/694075022 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e011bd50 con 0x7f12e009e950 2023-09-30T22:18:38.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.407+0000 7f12dd7fa700 1 -- 172.21.15.156:0/694075022 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f12d4013cf0 con 0x7f12e009e950 2023-09-30T22:18:38.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.407+0000 7f12e6c44700 1 -- 172.21.15.156:0/694075022 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e011b920 con 0x7f12e009e950 2023-09-30T22:18:38.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.407+0000 7f12dd7fa700 1 -- 172.21.15.156:0/694075022 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4055+0+0 (secure 0 0 0) 0x7f12d403f940 con 0x7f12e009e950 2023-09-30T22:18:38.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.415+0000 7f12dd7fa700 1 -- 172.21.15.156:0/694075022 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f12d4011b80 con 0x7f12e009e950 2023-09-30T22:18:38.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.431+0000 7fcb0b6c7700 1 -- 172.21.15.156:0/3403985603 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcb0404f2a0 con 0x7fcb0409e870 2023-09-30T22:18:38.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.432+0000 7fcaf9ffb700 1 -- 172.21.15.156:0/3403985603 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcb00021020 con 0x7fcb0409e870 2023-09-30T22:18:38.433 INFO:teuthology.orchestra.run.smithi156.stdout:38654705691 2023-09-30T22:18:38.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.434+0000 7fcb0b6c7700 1 -- 172.21.15.156:0/3403985603 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcb0409e870 msgr2=0x7fcb04120310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:38.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.434+0000 7fcb0b6c7700 1 --2- 172.21.15.156:0/3403985603 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcb0409e870 0x7fcb04120310 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000ebe0 tx=0x7fcb0000eef0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.434+0000 7fcb0b6c7700 1 -- 172.21.15.156:0/3403985603 shutdown_connections 2023-09-30T22:18:38.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.434+0000 7fcb0b6c7700 1 --2- 172.21.15.156:0/3403985603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb04131d70 0x7fcb04120d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.434+0000 7fcb0b6c7700 1 --2- 172.21.15.156:0/3403985603 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcb0409e870 0x7fcb04120310 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.434+0000 7fcb0b6c7700 1 --2- 172.21.15.156:0/3403985603 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcb0409f180 0x7fcb04120850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.434+0000 7fcb0b6c7700 1 -- 172.21.15.156:0/3403985603 >> 172.21.15.156:0/3403985603 conn(0x7fcb040a4430 msgr2=0x7fcb0406f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:38.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.435+0000 7fcb0b6c7700 1 -- 172.21.15.156:0/3403985603 shutdown_connections 2023-09-30T22:18:38.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.435+0000 7fcb0b6c7700 1 -- 172.21.15.156:0/3403985603 wait complete. 2023-09-30T22:18:38.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705691 for osd.0 2023-09-30T22:18:38.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.506+0000 7f33f046f700 1 -- 172.21.15.156:0/2555090767 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f33e804f2a0 con 0x7f33e8130670 2023-09-30T22:18:38.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.507+0000 7f33deffd700 1 -- 172.21.15.156:0/2555090767 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f33e0034090 con 0x7f33e8130670 2023-09-30T22:18:38.508 INFO:teuthology.orchestra.run.smithi156.stdout:38654705691 2023-09-30T22:18:38.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.509+0000 7f33f046f700 1 -- 172.21.15.156:0/2555090767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33e8130670 msgr2=0x7f33e81c3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:38.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.509+0000 7f33f046f700 1 --2- 172.21.15.156:0/2555090767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33e8130670 0x7f33e81c3d70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f33e809b700 tx=0x7f33e0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.509+0000 7f33f046f700 1 -- 172.21.15.156:0/2555090767 shutdown_connections 2023-09-30T22:18:38.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.509+0000 7f33f046f700 1 --2- 172.21.15.156:0/2555090767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33e8130670 0x7f33e81c3d70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.509+0000 7f33f046f700 1 --2- 172.21.15.156:0/2555090767 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33e80a09f0 0x7f33e811a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.509+0000 7f33f046f700 1 --2- 172.21.15.156:0/2555090767 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33e80a1300 0x7f33e811aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.509+0000 7f33f046f700 1 -- 172.21.15.156:0/2555090767 >> 172.21.15.156:0/2555090767 conn(0x7f33e80a2980 msgr2=0x7f33e809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:38.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.509+0000 7f33f046f700 1 -- 172.21.15.156:0/2555090767 shutdown_connections 2023-09-30T22:18:38.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.509+0000 7f33f046f700 1 -- 172.21.15.156:0/2555090767 wait complete. 2023-09-30T22:18:38.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705691 for osd.2 2023-09-30T22:18:38.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.545+0000 7f2515c76700 1 -- 172.21.15.156:0/973100839 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f251006bce0 con 0x7f25100a08e0 2023-09-30T22:18:38.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.545+0000 7f24f7fff700 1 -- 172.21.15.156:0/973100839 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2500020030 con 0x7f25100a08e0 2023-09-30T22:18:38.546 INFO:teuthology.orchestra.run.smithi156.stdout:38654705691 2023-09-30T22:18:38.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.547+0000 7f2515c76700 1 -- 172.21.15.156:0/973100839 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25100a08e0 msgr2=0x7f2510137100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:38.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.547+0000 7f2515c76700 1 --2- 172.21.15.156:0/973100839 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25100a08e0 0x7f2510137100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f250000e840 tx=0x7f250000eb50 comp rx=0 tx=0).stop 2023-09-30T22:18:38.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.547+0000 7f2515c76700 1 -- 172.21.15.156:0/973100839 shutdown_connections 2023-09-30T22:18:38.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.547+0000 7f2515c76700 1 --2- 172.21.15.156:0/973100839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2510138040 0x7f2510135e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.547+0000 7f2515c76700 1 --2- 172.21.15.156:0/973100839 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25100a08e0 0x7f2510137100 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.547+0000 7f2515c76700 1 --2- 172.21.15.156:0/973100839 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25100a1230 0x7f2510135900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.547+0000 7f2515c76700 1 -- 172.21.15.156:0/973100839 >> 172.21.15.156:0/973100839 conn(0x7f25100a2980 msgr2=0x7f2510071aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:38.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.547+0000 7f2515c76700 1 -- 172.21.15.156:0/973100839 shutdown_connections 2023-09-30T22:18:38.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.547+0000 7f2515c76700 1 -- 172.21.15.156:0/973100839 wait complete. 2023-09-30T22:18:38.560 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705691 for osd.3 2023-09-30T22:18:38.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.588+0000 7f12e6c44700 1 -- 172.21.15.156:0/694075022 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f12e004f2a0 con 0x7f12e009e950 2023-09-30T22:18:38.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.588+0000 7f12dd7fa700 1 -- 172.21.15.156:0/694075022 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f12d4021070 con 0x7f12e009e950 2023-09-30T22:18:38.589 INFO:teuthology.orchestra.run.smithi156.stdout:38654705691 2023-09-30T22:18:38.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.590+0000 7f12e6c44700 1 -- 172.21.15.156:0/694075022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12e009e950 msgr2=0x7f12e01c5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:38.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.590+0000 7f12e6c44700 1 --2- 172.21.15.156:0/694075022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12e009e950 0x7f12e01c5180 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f12d400e8f0 tx=0x7f12d400ec00 comp rx=0 tx=0).stop 2023-09-30T22:18:38.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.590+0000 7f12e6c44700 1 -- 172.21.15.156:0/694075022 shutdown_connections 2023-09-30T22:18:38.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.590+0000 7f12e6c44700 1 --2- 172.21.15.156:0/694075022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12e0131dd0 0x7f12e01c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.590+0000 7f12e6c44700 1 --2- 172.21.15.156:0/694075022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12e009e950 0x7f12e01c5180 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.590+0000 7f12e6c44700 1 --2- 172.21.15.156:0/694075022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12e009f260 0x7f12e01c56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:38.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.590+0000 7f12e6c44700 1 -- 172.21.15.156:0/694075022 >> 172.21.15.156:0/694075022 conn(0x7f12e00a0f70 msgr2=0x7f12e00713a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:38.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.590+0000 7f12e6c44700 1 -- 172.21.15.156:0/694075022 shutdown_connections 2023-09-30T22:18:38.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:38.590+0000 7f12e6c44700 1 -- 172.21.15.156:0/694075022 wait complete. 2023-09-30T22:18:38.603 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705691 for osd.1 2023-09-30T22:18:38.777 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:38.777+0000 7f828b530700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-09-30T22:18:38.777 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:38.777+0000 7f828b530700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-09-30T22:18:38.778 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-09-30T22:18:38.777+0000 7f828b530700 -1 mgr.server handle_report got status from non-daemon mon.a 2023-09-30T22:18:39.449 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:18:39.522 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:18:39.560 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:18:39.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.586+0000 7fabbfb43700 1 Processor -- start 2023-09-30T22:18:39.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.586+0000 7fabbfb43700 1 -- start start 2023-09-30T22:18:39.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.587+0000 7fabbfb43700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabb809e340 0x7fabb81359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:39.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.587+0000 7fabbfb43700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fabb8135f20 0x7fabb8138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:39.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.587+0000 7fabbfb43700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb809aaa0 con 0x7fabb809d860 2023-09-30T22:18:39.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.587+0000 7fabbfb43700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb809e730 con 0x7fabb8135f20 2023-09-30T22:18:39.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.587+0000 7fabbfb43700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb809f870 con 0x7fabb809e340 2023-09-30T22:18:39.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.587+0000 7fabbd8df700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fabb809d860 0x7fabb809dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:42668/0 (socket says 172.21.15.156:42668) 2023-09-30T22:18:39.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.587+0000 7fabbd0de700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabb809e340 0x7fabb81359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:39.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.587+0000 7fabbd8df700 1 -- 172.21.15.156:0/1845612222 learned_addr learned my addr 172.21.15.156:0/1845612222 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:18:39.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.587+0000 7fabbe0e0700 1 --2- 172.21.15.156:0/1845612222 >> v2:172.21.15.156:3300/0 conn(0x7fabb8135f20 0x7fabb8138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:39.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.587+0000 7fabbd0de700 1 -- 172.21.15.156:0/1845612222 >> v2:172.21.15.156:3300/0 conn(0x7fabb8135f20 msgr2=0x7fabb8138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:39.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.587+0000 7fabbd0de700 1 --2- 172.21.15.156:0/1845612222 >> v2:172.21.15.156:3300/0 conn(0x7fabb8135f20 0x7fabb8138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.587+0000 7fabbc8dd700 1 -- 172.21.15.156:0/1845612222 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774466665 0 0) 0x7fabb809aaa0 con 0x7fabb809d860 2023-09-30T22:18:39.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.587+0000 7fabbd0de700 1 -- 172.21.15.156:0/1845612222 >> v1:172.21.15.156:6789/0 conn(0x7fabb809d860 legacy=0x7fabb809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:39.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.587+0000 7fabbd0de700 1 -- 172.21.15.156:0/1845612222 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb809b360 con 0x7fabb809e340 2023-09-30T22:18:39.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.588+0000 7fabbd0de700 1 --2- 172.21.15.156:0/1845612222 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabb809e340 0x7fabb81359e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7faba8009840 tx=0x7faba8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da8a4c0f70e95ba3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:39.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.588+0000 7fabbc8dd700 1 -- 172.21.15.156:0/1845612222 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba8011830 con 0x7fabb809e340 2023-09-30T22:18:39.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.588+0000 7fabbc8dd700 1 -- 172.21.15.156:0/1845612222 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba8011990 con 0x7fabb809e340 2023-09-30T22:18:39.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.588+0000 7fabbc8dd700 1 -- 172.21.15.156:0/1845612222 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba8011d20 con 0x7fabb809e340 2023-09-30T22:18:39.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.588+0000 7fabbfb43700 1 -- 172.21.15.156:0/1845612222 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabb809e340 msgr2=0x7fabb81359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:39.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.588+0000 7fabbfb43700 1 --2- 172.21.15.156:0/1845612222 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabb809e340 0x7fabb81359e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7faba8009840 tx=0x7faba8009b50 comp rx=0 tx=0).stop 2023-09-30T22:18:39.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.588+0000 7fabbfb43700 1 -- 172.21.15.156:0/1845612222 shutdown_connections 2023-09-30T22:18:39.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.588+0000 7fabbfb43700 1 --2- 172.21.15.156:0/1845612222 >> v2:172.21.15.156:3300/0 conn(0x7fabb8135f20 0x7fabb8138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.588+0000 7fabbfb43700 1 --2- 172.21.15.156:0/1845612222 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabb809e340 0x7fabb81359e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.588+0000 7fabbfb43700 1 -- 172.21.15.156:0/1845612222 >> 172.21.15.156:0/1845612222 conn(0x7fabb8099c40 msgr2=0x7fabb80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:39.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.589+0000 7fabbfb43700 1 -- 172.21.15.156:0/1845612222 shutdown_connections 2023-09-30T22:18:39.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.589+0000 7fabbfb43700 1 -- 172.21.15.156:0/1845612222 wait complete. 2023-09-30T22:18:39.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.589+0000 7fabbfb43700 1 Processor -- start 2023-09-30T22:18:39.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.589+0000 7fabbfb43700 1 -- start start 2023-09-30T22:18:39.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.590+0000 7fabbfb43700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabb809d860 0x7fabb8119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:39.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.590+0000 7fabbfb43700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabb809e340 0x7fabb8119b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:39.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.590+0000 7fabbfb43700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabb8135f20 0x7fabb811a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:39.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.590+0000 7fabbfb43700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb811c890 con 0x7fabb8135f20 2023-09-30T22:18:39.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.590+0000 7fabbfb43700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb809c8b0 con 0x7fabb809e340 2023-09-30T22:18:39.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.590+0000 7fabbfb43700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabb811b470 con 0x7fabb809d860 2023-09-30T22:18:39.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.590+0000 7fabbe0e0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabb8135f20 0x7fabb811a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:39.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.590+0000 7fabbe0e0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabb8135f20 0x7fabb811a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39684/0 (socket says 172.21.15.156:39684) 2023-09-30T22:18:39.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.590+0000 7fabbe0e0700 1 -- 172.21.15.156:0/681442444 learned_addr learned my addr 172.21.15.156:0/681442444 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:39.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.590+0000 7fabbd8df700 1 --2- 172.21.15.156:0/681442444 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabb809d860 0x7fabb8119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:39.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.590+0000 7fabbd0de700 1 --2- 172.21.15.156:0/681442444 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabb809e340 0x7fabb8119b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:39.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.590+0000 7fabbd8df700 1 -- 172.21.15.156:0/681442444 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabb809e340 msgr2=0x7fabb8119b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:39.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.590+0000 7fabbd8df700 1 --2- 172.21.15.156:0/681442444 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabb809e340 0x7fabb8119b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.590+0000 7fabbd8df700 1 -- 172.21.15.156:0/681442444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabb8135f20 msgr2=0x7fabb811a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:39.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.590+0000 7fabbd8df700 1 --2- 172.21.15.156:0/681442444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabb8135f20 0x7fabb811a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.590+0000 7fabbd8df700 1 -- 172.21.15.156:0/681442444 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba80094a0 con 0x7fabb809d860 2023-09-30T22:18:39.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.590+0000 7fabbd0de700 1 --2- 172.21.15.156:0/681442444 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabb809e340 0x7fabb8119b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:18:39.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.590+0000 7fabbe0e0700 1 --2- 172.21.15.156:0/681442444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabb8135f20 0x7fabb811a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:39.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.591+0000 7fabbd8df700 1 --2- 172.21.15.156:0/681442444 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabb809d860 0x7fabb8119630 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fabb400c4a0 tx=0x7fabb400c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:39.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.591+0000 7fabae7fc700 1 -- 172.21.15.156:0/681442444 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb4004c80 con 0x7fabb809d860 2023-09-30T22:18:39.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.591+0000 7fabae7fc700 1 -- 172.21.15.156:0/681442444 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb4004de0 con 0x7fabb809d860 2023-09-30T22:18:39.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.591+0000 7fabbfb43700 1 -- 172.21.15.156:0/681442444 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb8072740 con 0x7fabb809d860 2023-09-30T22:18:39.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.591+0000 7fabae7fc700 1 -- 172.21.15.156:0/681442444 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb4007310 con 0x7fabb809d860 2023-09-30T22:18:39.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.592+0000 7fabae7fc700 1 -- 172.21.15.156:0/681442444 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7fabb4007470 con 0x7fabb809d860 2023-09-30T22:18:39.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.592+0000 7fabbfb43700 1 -- 172.21.15.156:0/681442444 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb811ca70 con 0x7fabb809d860 2023-09-30T22:18:39.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.592+0000 7fabae7fc700 1 -- 172.21.15.156:0/681442444 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4038+0+0 (secure 0 0 0) 0x7fabb4011db0 con 0x7fabb809d860 2023-09-30T22:18:39.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.593+0000 7fabbfb43700 1 -- 172.21.15.156:0/681442444 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb811c6c0 con 0x7fabb809d860 2023-09-30T22:18:39.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.598+0000 7fabae7fc700 1 -- 172.21.15.156:0/681442444 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fabb4044060 con 0x7fabb809d860 2023-09-30T22:18:39.604 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:18:39.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.665+0000 7f8575c4a700 1 Processor -- start 2023-09-30T22:18:39.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.665+0000 7f8575c4a700 1 -- start start 2023-09-30T22:18:39.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.666+0000 7f8575c4a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f85700a1550 0x7f8570138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:39.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.666+0000 7f8575c4a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8570139200 0x7f857013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:39.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.666+0000 7f8575c4a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f857009e9d0 con 0x7f85700a0a70 2023-09-30T22:18:39.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.666+0000 7f8575c4a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f857009dc00 con 0x7f85700a1550 2023-09-30T22:18:39.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.666+0000 7f8575c4a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f857009dec0 con 0x7f8570139200 2023-09-30T22:18:39.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.666+0000 7f856ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8570139200 0x7f857013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:39.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.666+0000 7f856effd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f85700a1550 0x7f8570138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:39.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.666+0000 7f856ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8570139200 0x7f857013b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34976/0 (socket says 172.21.15.156:34976) 2023-09-30T22:18:39.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.666+0000 7f856ffff700 1 -- 172.21.15.156:0/2531151362 learned_addr learned my addr 172.21.15.156:0/2531151362 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:39.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.666+0000 7f856effd700 1 -- 172.21.15.156:0/2531151362 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8570139200 msgr2=0x7f857013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:39.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.666+0000 7f856effd700 1 --2- 172.21.15.156:0/2531151362 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8570139200 0x7f857013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.666+0000 7f856effd700 1 -- 172.21.15.156:0/2531151362 >> v1:172.21.15.156:6789/0 conn(0x7f85700a0a70 legacy=0x7f85700a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:39.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.666+0000 7f856e7fc700 1 -- 172.21.15.156:0/2531151362 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135253003 0 0) 0x7f857009e9d0 con 0x7f85700a0a70 2023-09-30T22:18:39.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.666+0000 7f856effd700 1 -- 172.21.15.156:0/2531151362 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857009e6a0 con 0x7f85700a1550 2023-09-30T22:18:39.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.666+0000 7f856ffff700 1 --2- 172.21.15.156:0/2531151362 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8570139200 0x7f857013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:39.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.667+0000 7f856effd700 1 --2- 172.21.15.156:0/2531151362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85700a1550 0x7f8570138cc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8564009840 tx=0x7f8564009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ddc6886cb35a915 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:39.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.667+0000 7f856e7fc700 1 -- 172.21.15.156:0/2531151362 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8564011830 con 0x7f85700a1550 2023-09-30T22:18:39.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.667+0000 7f856e7fc700 1 -- 172.21.15.156:0/2531151362 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8564011990 con 0x7f85700a1550 2023-09-30T22:18:39.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.667+0000 7f856e7fc700 1 -- 172.21.15.156:0/2531151362 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8564011d20 con 0x7f85700a1550 2023-09-30T22:18:39.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.668+0000 7f8575c4a700 1 -- 172.21.15.156:0/2531151362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85700a1550 msgr2=0x7f8570138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:39.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.668+0000 7f8575c4a700 1 --2- 172.21.15.156:0/2531151362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85700a1550 0x7f8570138cc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8564009840 tx=0x7f8564009b50 comp rx=0 tx=0).stop 2023-09-30T22:18:39.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.668+0000 7f8575c4a700 1 -- 172.21.15.156:0/2531151362 shutdown_connections 2023-09-30T22:18:39.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.668+0000 7f8575c4a700 1 --2- 172.21.15.156:0/2531151362 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8570139200 0x7f857013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.668+0000 7f8575c4a700 1 --2- 172.21.15.156:0/2531151362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85700a1550 0x7f8570138cc0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.668+0000 7f8575c4a700 1 -- 172.21.15.156:0/2531151362 >> 172.21.15.156:0/2531151362 conn(0x7f85700a6610 msgr2=0x7f85700a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:39.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.668+0000 7f8575c4a700 1 -- 172.21.15.156:0/2531151362 shutdown_connections 2023-09-30T22:18:39.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.668+0000 7f8575c4a700 1 -- 172.21.15.156:0/2531151362 wait complete. 2023-09-30T22:18:39.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.669+0000 7f8575c4a700 1 Processor -- start 2023-09-30T22:18:39.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.670+0000 7f8575c4a700 1 -- start start 2023-09-30T22:18:39.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.670+0000 7f8575c4a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85700a0a70 0x7f857011e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:39.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.670+0000 7f8575c4a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f85700a1550 0x7f857011ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:39.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.670+0000 7f8575c4a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8570139200 0x7f857011f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:39.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.670+0000 7f8575c4a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85701219d0 con 0x7f85700a0a70 2023-09-30T22:18:39.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.670+0000 7f8575c4a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85700a5100 con 0x7f8570139200 2023-09-30T22:18:39.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.670+0000 7f8575c4a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85700a03e0 con 0x7f85700a1550 2023-09-30T22:18:39.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.670+0000 7f856f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85700a0a70 0x7f857011e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:39.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.670+0000 7f856f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85700a0a70 0x7f857011e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39704/0 (socket says 172.21.15.156:39704) 2023-09-30T22:18:39.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.670+0000 7f856f7fe700 1 -- 172.21.15.156:0/1878565544 learned_addr learned my addr 172.21.15.156:0/1878565544 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:39.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.670+0000 7f856effd700 1 --2- 172.21.15.156:0/1878565544 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f85700a1550 0x7f857011ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:39.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.671+0000 7f856ffff700 1 --2- 172.21.15.156:0/1878565544 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8570139200 0x7f857011f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:39.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.671+0000 7f856f7fe700 1 -- 172.21.15.156:0/1878565544 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f85700a1550 msgr2=0x7f857011ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:39.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.671+0000 7f856f7fe700 1 --2- 172.21.15.156:0/1878565544 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f85700a1550 0x7f857011ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.671+0000 7f856f7fe700 1 -- 172.21.15.156:0/1878565544 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8570139200 msgr2=0x7f857011f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:39.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.671+0000 7f856f7fe700 1 --2- 172.21.15.156:0/1878565544 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8570139200 0x7f857011f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.671+0000 7f856f7fe700 1 -- 172.21.15.156:0/1878565544 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8568009b30 con 0x7f85700a0a70 2023-09-30T22:18:39.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.671+0000 7f856effd700 1 --2- 172.21.15.156:0/1878565544 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f85700a1550 0x7f857011ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:39.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.671+0000 7f856f7fe700 1 --2- 172.21.15.156:0/1878565544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85700a0a70 0x7f857011e770 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8560001eb0 tx=0x7f856000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:39.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.671+0000 7f8557fff700 1 -- 172.21.15.156:0/1878565544 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85600054e0 con 0x7f85700a0a70 2023-09-30T22:18:39.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.671+0000 7f8557fff700 1 -- 172.21.15.156:0/1878565544 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8560003680 con 0x7f85700a0a70 2023-09-30T22:18:39.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.671+0000 7f8557fff700 1 -- 172.21.15.156:0/1878565544 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85600039f0 con 0x7f85700a0a70 2023-09-30T22:18:39.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.671+0000 7f8575c4a700 1 -- 172.21.15.156:0/1878565544 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85640094a0 con 0x7f85700a0a70 2023-09-30T22:18:39.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.671+0000 7f8575c4a700 1 -- 172.21.15.156:0/1878565544 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8570120ae0 con 0x7f85700a0a70 2023-09-30T22:18:39.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.673+0000 7f8557fff700 1 -- 172.21.15.156:0/1878565544 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f8560003b50 con 0x7f85700a0a70 2023-09-30T22:18:39.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.673+0000 7f8557fff700 1 -- 172.21.15.156:0/1878565544 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4038+0+0 (secure 0 0 0) 0x7f856003ea70 con 0x7f85700a0a70 2023-09-30T22:18:39.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.674+0000 7f8575c4a700 1 -- 172.21.15.156:0/1878565544 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8570134610 con 0x7f85700a0a70 2023-09-30T22:18:39.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.682+0000 7f8557fff700 1 -- 172.21.15.156:0/1878565544 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8560017020 con 0x7f85700a0a70 2023-09-30T22:18:39.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.704+0000 7f80c0673700 1 Processor -- start 2023-09-30T22:18:39.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.705+0000 7f80c0673700 1 -- start start 2023-09-30T22:18:39.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.705+0000 7f80c0673700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f80b8099e20 0x7f80b809a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:39.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.705+0000 7f80c0673700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80b809a730 0x7f80b8130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:39.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.705+0000 7f80c0673700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b8099a60 con 0x7f80b8130890 2023-09-30T22:18:39.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.705+0000 7f80c0673700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b809bf50 con 0x7f80b8099e20 2023-09-30T22:18:39.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.705+0000 7f80c0673700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80b809b230 con 0x7f80b809a730 2023-09-30T22:18:39.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.705+0000 7f80bec10700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f80b8130890 0x7f80b8137680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:42690/0 (socket says 172.21.15.156:42690) 2023-09-30T22:18:39.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.705+0000 7f80be40f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f80b8099e20 0x7f80b809a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:39.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.705+0000 7f80bec10700 1 -- 172.21.15.156:0/2624156611 learned_addr learned my addr 172.21.15.156:0/2624156611 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:18:39.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.706+0000 7f80bdc0e700 1 --2- 172.21.15.156:0/2624156611 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80b809a730 0x7f80b8130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:39.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.706+0000 7f80be40f700 1 -- 172.21.15.156:0/2624156611 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80b809a730 msgr2=0x7f80b8130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:39.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.706+0000 7f80be40f700 1 --2- 172.21.15.156:0/2624156611 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80b809a730 0x7f80b8130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.706+0000 7f80be40f700 1 -- 172.21.15.156:0/2624156611 >> v1:172.21.15.156:6789/0 conn(0x7f80b8130890 legacy=0x7f80b8137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:39.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.706+0000 7f80bd40d700 1 -- 172.21.15.156:0/2624156611 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3822930895 0 0) 0x7f80b8099a60 con 0x7f80b8130890 2023-09-30T22:18:39.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.706+0000 7f80be40f700 1 -- 172.21.15.156:0/2624156611 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b809bb90 con 0x7f80b8099e20 2023-09-30T22:18:39.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.706+0000 7f80be40f700 1 --2- 172.21.15.156:0/2624156611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80b8099e20 0x7f80b809a1f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f80b4009820 tx=0x7f80b4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569981fc15e4e645 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:39.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.706+0000 7f80bd40d700 1 -- 172.21.15.156:0/2624156611 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b4005e30 con 0x7f80b8099e20 2023-09-30T22:18:39.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.706+0000 7f80bd40d700 1 -- 172.21.15.156:0/2624156611 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b4006030 con 0x7f80b8099e20 2023-09-30T22:18:39.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.706+0000 7f80bd40d700 1 -- 172.21.15.156:0/2624156611 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b40063c0 con 0x7f80b8099e20 2023-09-30T22:18:39.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.707+0000 7f80c0673700 1 -- 172.21.15.156:0/2624156611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80b8099e20 msgr2=0x7f80b809a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:39.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.707+0000 7f80c0673700 1 --2- 172.21.15.156:0/2624156611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80b8099e20 0x7f80b809a1f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f80b4009820 tx=0x7f80b4009b30 comp rx=0 tx=0).stop 2023-09-30T22:18:39.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.707+0000 7f80c0673700 1 -- 172.21.15.156:0/2624156611 shutdown_connections 2023-09-30T22:18:39.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.707+0000 7f80c0673700 1 --2- 172.21.15.156:0/2624156611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80b8099e20 0x7f80b809a1f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.707+0000 7f80c0673700 1 --2- 172.21.15.156:0/2624156611 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80b809a730 0x7f80b8130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.707+0000 7f80c0673700 1 -- 172.21.15.156:0/2624156611 >> 172.21.15.156:0/2624156611 conn(0x7f80b80a2980 msgr2=0x7f80b80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:39.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.707+0000 7f80c0673700 1 -- 172.21.15.156:0/2624156611 shutdown_connections 2023-09-30T22:18:39.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.707+0000 7f80c0673700 1 -- 172.21.15.156:0/2624156611 wait complete. 2023-09-30T22:18:39.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.708+0000 7f80c0673700 1 Processor -- start 2023-09-30T22:18:39.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.708+0000 7f80c0673700 1 -- start start 2023-09-30T22:18:39.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.709+0000 7f80c0673700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f80b8099e20 0x7f80b81c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:39.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.709+0000 7f80c0673700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80b809a730 0x7f80b81c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:39.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.709+0000 7f80c0673700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80b8130890 0x7f80b81c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:39.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.709+0000 7f80c0673700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b8139760 con 0x7f80b809a730 2023-09-30T22:18:39.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.709+0000 7f80c0673700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b812c800 con 0x7f80b8099e20 2023-09-30T22:18:39.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.709+0000 7f80c0673700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80b812c040 con 0x7f80b8130890 2023-09-30T22:18:39.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.709+0000 7f80bdc0e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80b809a730 0x7f80b81c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:39.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.709+0000 7f80bdc0e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80b809a730 0x7f80b81c63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39732/0 (socket says 172.21.15.156:39732) 2023-09-30T22:18:39.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.709+0000 7f80bdc0e700 1 -- 172.21.15.156:0/452693087 learned_addr learned my addr 172.21.15.156:0/452693087 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:39.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.709+0000 7f80bec10700 1 --2- 172.21.15.156:0/452693087 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80b8130890 0x7f80b81c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:39.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.709+0000 7f80be40f700 1 --2- 172.21.15.156:0/452693087 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f80b8099e20 0x7f80b81c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:39.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.709+0000 7f80bdc0e700 1 -- 172.21.15.156:0/452693087 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80b8130890 msgr2=0x7f80b81c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:39.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.709+0000 7f80bdc0e700 1 --2- 172.21.15.156:0/452693087 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80b8130890 0x7f80b81c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.709+0000 7f80bdc0e700 1 -- 172.21.15.156:0/452693087 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f80b8099e20 msgr2=0x7f80b81c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:39.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.709+0000 7f80bdc0e700 1 --2- 172.21.15.156:0/452693087 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f80b8099e20 0x7f80b81c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.709+0000 7f80bdc0e700 1 -- 172.21.15.156:0/452693087 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b4009430 con 0x7f80b809a730 2023-09-30T22:18:39.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.709+0000 7f80be40f700 1 --2- 172.21.15.156:0/452693087 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f80b8099e20 0x7f80b81c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:18:39.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.709+0000 7f80bdc0e700 1 --2- 172.21.15.156:0/452693087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80b809a730 0x7f80b81c63d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f80a800e9e0 tx=0x7f80a800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:39.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.709+0000 7f80aeffd700 1 -- 172.21.15.156:0/452693087 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a8009710 con 0x7f80b809a730 2023-09-30T22:18:39.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.709+0000 7f80aeffd700 1 -- 172.21.15.156:0/452693087 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a800c850 con 0x7f80b809a730 2023-09-30T22:18:39.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.710+0000 7f80c0673700 1 -- 172.21.15.156:0/452693087 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b812c510 con 0x7f80b809a730 2023-09-30T22:18:39.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.710+0000 7f80aeffd700 1 -- 172.21.15.156:0/452693087 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a800cbc0 con 0x7f80b809a730 2023-09-30T22:18:39.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.710+0000 7f80c0673700 1 -- 172.21.15.156:0/452693087 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b8131990 con 0x7f80b809a730 2023-09-30T22:18:39.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.711+0000 7f80c0673700 1 -- 172.21.15.156:0/452693087 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b8072480 con 0x7f80b809a730 2023-09-30T22:18:39.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.711+0000 7f80aeffd700 1 -- 172.21.15.156:0/452693087 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f80a800cd20 con 0x7f80b809a730 2023-09-30T22:18:39.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.711+0000 7f80aeffd700 1 -- 172.21.15.156:0/452693087 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4038+0+0 (secure 0 0 0) 0x7f80a803f860 con 0x7f80b809a730 2023-09-30T22:18:39.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.716+0000 7f80aeffd700 1 -- 172.21.15.156:0/452693087 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f80b8072480 con 0x7f80b809a730 2023-09-30T22:18:39.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.736+0000 7f62bcd27700 1 Processor -- start 2023-09-30T22:18:39.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.736+0000 7f62bcd27700 1 -- start start 2023-09-30T22:18:39.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.736+0000 7f62bcd27700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f62b8138040 0x7f62b8138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:39.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.736+0000 7f62bcd27700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62b80a08e0 0x7f62b80a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:39.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.736+0000 7f62bcd27700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62b80a1230 0x7f62b813ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:39.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.736+0000 7f62bcd27700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b80a2100 con 0x7f62b8138040 2023-09-30T22:18:39.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.736+0000 7f62bcd27700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b8138950 con 0x7f62b80a08e0 2023-09-30T22:18:39.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.736+0000 7f62bcd27700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62b81379e0 con 0x7f62b80a1230 2023-09-30T22:18:39.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.736+0000 7f62b6d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62b80a1230 0x7f62b813ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:39.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.737+0000 7f62b6d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62b80a1230 0x7f62b813ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:35014/0 (socket says 172.21.15.156:35014) 2023-09-30T22:18:39.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.737+0000 7f62b6d9d700 1 -- 172.21.15.156:0/2966875334 learned_addr learned my addr 172.21.15.156:0/2966875334 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:39.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.737+0000 7f62b659c700 1 --2- 172.21.15.156:0/2966875334 >> v2:172.21.15.156:3300/0 conn(0x7f62b8138040 0x7f62b8138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:39.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.737+0000 7f62b5d9b700 1 --2- 172.21.15.156:0/2966875334 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62b80a08e0 0x7f62b80a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:39.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.737+0000 7f62b6d9d700 1 -- 172.21.15.156:0/2966875334 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62b80a08e0 msgr2=0x7f62b80a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:39.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.737+0000 7f62b6d9d700 1 --2- 172.21.15.156:0/2966875334 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62b80a08e0 0x7f62b80a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.737+0000 7f62b6d9d700 1 -- 172.21.15.156:0/2966875334 >> v2:172.21.15.156:3300/0 conn(0x7f62b8138040 msgr2=0x7f62b8138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:39.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.737+0000 7f62b6d9d700 1 --2- 172.21.15.156:0/2966875334 >> v2:172.21.15.156:3300/0 conn(0x7f62b8138040 0x7f62b8138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.737+0000 7f62b6d9d700 1 -- 172.21.15.156:0/2966875334 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b809b9b0 con 0x7f62b80a1230 2023-09-30T22:18:39.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.737+0000 7f62b6d9d700 1 --2- 172.21.15.156:0/2966875334 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62b80a1230 0x7f62b813ed10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f62b0009eb0 tx=0x7f62b000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7ea94c9d3f57c4c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:39.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.737+0000 7f62b559a700 1 -- 172.21.15.156:0/2966875334 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b000e070 con 0x7f62b80a1230 2023-09-30T22:18:39.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.737+0000 7f62b559a700 1 -- 172.21.15.156:0/2966875334 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b000b890 con 0x7f62b80a1230 2023-09-30T22:18:39.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.737+0000 7f62b559a700 1 -- 172.21.15.156:0/2966875334 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b000bc40 con 0x7f62b80a1230 2023-09-30T22:18:39.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.738+0000 7f62bcd27700 1 -- 172.21.15.156:0/2966875334 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62b80a1230 msgr2=0x7f62b813ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:39.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.738+0000 7f62bcd27700 1 --2- 172.21.15.156:0/2966875334 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62b80a1230 0x7f62b813ed10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f62b0009eb0 tx=0x7f62b000b330 comp rx=0 tx=0).stop 2023-09-30T22:18:39.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.738+0000 7f62bcd27700 1 -- 172.21.15.156:0/2966875334 shutdown_connections 2023-09-30T22:18:39.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.738+0000 7f62bcd27700 1 --2- 172.21.15.156:0/2966875334 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62b80a1230 0x7f62b813ed10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.738+0000 7f62bcd27700 1 --2- 172.21.15.156:0/2966875334 >> v2:172.21.15.156:3300/0 conn(0x7f62b8138040 0x7f62b8138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.738+0000 7f62bcd27700 1 --2- 172.21.15.156:0/2966875334 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62b80a08e0 0x7f62b80a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.738+0000 7f62bcd27700 1 -- 172.21.15.156:0/2966875334 >> 172.21.15.156:0/2966875334 conn(0x7f62b80a2980 msgr2=0x7f62b80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:39.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.738+0000 7f62bcd27700 1 -- 172.21.15.156:0/2966875334 shutdown_connections 2023-09-30T22:18:39.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.738+0000 7f62bcd27700 1 -- 172.21.15.156:0/2966875334 wait complete. 2023-09-30T22:18:39.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.739+0000 7f62bcd27700 1 Processor -- start 2023-09-30T22:18:39.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.739+0000 7f62bcd27700 1 -- start start 2023-09-30T22:18:39.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.740+0000 7f62bcd27700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62b80a08e0 0x7f62b81348c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:39.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.740+0000 7f62bcd27700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62b80a1230 0x7f62b8134e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:39.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.740+0000 7f62bcd27700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62b8138040 0x7f62b81d4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:39.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.740+0000 7f62bcd27700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b81344e0 con 0x7f62b80a1230 2023-09-30T22:18:39.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.740+0000 7f62bcd27700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b811adb0 con 0x7f62b80a08e0 2023-09-30T22:18:39.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.740+0000 7f62bcd27700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62b811aae0 con 0x7f62b8138040 2023-09-30T22:18:39.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.740+0000 7f62b5d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62b80a1230 0x7f62b8134e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:39.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.740+0000 7f62b5d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62b80a1230 0x7f62b8134e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39760/0 (socket says 172.21.15.156:39760) 2023-09-30T22:18:39.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.740+0000 7f62b5d9b700 1 -- 172.21.15.156:0/2990909686 learned_addr learned my addr 172.21.15.156:0/2990909686 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:39.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.740+0000 7f62b6d9d700 1 --2- 172.21.15.156:0/2990909686 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62b8138040 0x7f62b81d4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:39.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.740+0000 7f62b659c700 1 --2- 172.21.15.156:0/2990909686 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62b80a08e0 0x7f62b81348c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:39.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.740+0000 7f62b6d9d700 1 -- 172.21.15.156:0/2990909686 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62b80a08e0 msgr2=0x7f62b81348c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:39.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.740+0000 7f62b6d9d700 1 --2- 172.21.15.156:0/2990909686 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62b80a08e0 0x7f62b81348c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.740+0000 7f62b6d9d700 1 -- 172.21.15.156:0/2990909686 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62b80a1230 msgr2=0x7f62b8134e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:39.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.740+0000 7f62b6d9d700 1 --2- 172.21.15.156:0/2990909686 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62b80a1230 0x7f62b8134e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.740+0000 7f62b6d9d700 1 -- 172.21.15.156:0/2990909686 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b0009b30 con 0x7f62b8138040 2023-09-30T22:18:39.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.741+0000 7f62b6d9d700 1 --2- 172.21.15.156:0/2990909686 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62b8138040 0x7f62b81d4f70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f62b0015000 tx=0x7f62b0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:39.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.741+0000 7f62a6ffd700 1 -- 172.21.15.156:0/2990909686 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b00092e0 con 0x7f62b8138040 2023-09-30T22:18:39.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.741+0000 7f62a6ffd700 1 -- 172.21.15.156:0/2990909686 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b0004250 con 0x7f62b8138040 2023-09-30T22:18:39.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.741+0000 7f62bcd27700 1 -- 172.21.15.156:0/2990909686 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b8135340 con 0x7f62b8138040 2023-09-30T22:18:39.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.741+0000 7f62a6ffd700 1 -- 172.21.15.156:0/2990909686 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b0004600 con 0x7f62b8138040 2023-09-30T22:18:39.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.741+0000 7f62bcd27700 1 -- 172.21.15.156:0/2990909686 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b813d9d0 con 0x7f62b8138040 2023-09-30T22:18:39.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.742+0000 7f62a6ffd700 1 -- 172.21.15.156:0/2990909686 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f62b0004760 con 0x7f62b8138040 2023-09-30T22:18:39.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.742+0000 7f62bcd27700 1 -- 172.21.15.156:0/2990909686 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b804f2a0 con 0x7f62b8138040 2023-09-30T22:18:39.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.742+0000 7f62a6ffd700 1 -- 172.21.15.156:0/2990909686 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4038+0+0 (secure 0 0 0) 0x7f62b0040590 con 0x7f62b8138040 2023-09-30T22:18:39.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.751+0000 7f62a6ffd700 1 -- 172.21.15.156:0/2990909686 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f62b0019320 con 0x7f62b8138040 2023-09-30T22:18:39.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.834+0000 7fabbfb43700 1 -- 172.21.15.156:0/681442444 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fabb804f2a0 con 0x7fabb809d860 2023-09-30T22:18:39.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.835+0000 7fabae7fc700 1 -- 172.21.15.156:0/681442444 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fabb4007720 con 0x7fabb809d860 2023-09-30T22:18:39.836 INFO:teuthology.orchestra.run.smithi156.stdout:38654705693 2023-09-30T22:18:39.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.837+0000 7fabbfb43700 1 -- 172.21.15.156:0/681442444 >> v1:172.21.15.156:6816/126965 conn(0x7fab9c02f240 legacy=0x7fab9c0316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:39.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.837+0000 7fabbfb43700 1 -- 172.21.15.156:0/681442444 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabb809d860 msgr2=0x7fabb8119630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:39.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.837+0000 7fabbfb43700 1 --2- 172.21.15.156:0/681442444 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabb809d860 0x7fabb8119630 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fabb400c4a0 tx=0x7fabb400c7b0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.837+0000 7fabbfb43700 1 -- 172.21.15.156:0/681442444 shutdown_connections 2023-09-30T22:18:39.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.837+0000 7fabbfb43700 1 --2- 172.21.15.156:0/681442444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabb8135f20 0x7fabb811a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.837+0000 7fabbfb43700 1 --2- 172.21.15.156:0/681442444 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabb809d860 0x7fabb8119630 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.837+0000 7fabbfb43700 1 --2- 172.21.15.156:0/681442444 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabb809e340 0x7fabb8119b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.837+0000 7fabbfb43700 1 -- 172.21.15.156:0/681442444 >> 172.21.15.156:0/681442444 conn(0x7fabb8099c40 msgr2=0x7fabb8132930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:39.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.838+0000 7fabbfb43700 1 -- 172.21.15.156:0/681442444 shutdown_connections 2023-09-30T22:18:39.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.838+0000 7fabbfb43700 1 -- 172.21.15.156:0/681442444 wait complete. 2023-09-30T22:18:39.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705693 for osd.0 2023-09-30T22:18:39.855 DEBUG:teuthology.parallel:result is None 2023-09-30T22:18:39.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.937+0000 7f8575c4a700 1 -- 172.21.15.156:0/1878565544 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f857004f2a0 con 0x7f85700a0a70 2023-09-30T22:18:39.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.937+0000 7f8557fff700 1 -- 172.21.15.156:0/1878565544 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f856001b3b0 con 0x7f85700a0a70 2023-09-30T22:18:39.938 INFO:teuthology.orchestra.run.smithi156.stdout:38654705693 2023-09-30T22:18:39.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.940+0000 7f8575c4a700 1 -- 172.21.15.156:0/1878565544 >> v1:172.21.15.156:6816/126965 conn(0x7f855c02f240 legacy=0x7f855c0316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:39.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.940+0000 7f8575c4a700 1 -- 172.21.15.156:0/1878565544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85700a0a70 msgr2=0x7f857011e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:39.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.940+0000 7f8575c4a700 1 --2- 172.21.15.156:0/1878565544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85700a0a70 0x7f857011e770 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8560001eb0 tx=0x7f856000c800 comp rx=0 tx=0).stop 2023-09-30T22:18:39.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.940+0000 7f8575c4a700 1 -- 172.21.15.156:0/1878565544 shutdown_connections 2023-09-30T22:18:39.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.940+0000 7f8575c4a700 1 --2- 172.21.15.156:0/1878565544 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8570139200 0x7f857011f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.940+0000 7f8575c4a700 1 --2- 172.21.15.156:0/1878565544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85700a0a70 0x7f857011e770 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.940+0000 7f8575c4a700 1 --2- 172.21.15.156:0/1878565544 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f85700a1550 0x7f857011ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.940+0000 7f8575c4a700 1 -- 172.21.15.156:0/1878565544 >> 172.21.15.156:0/1878565544 conn(0x7f85700a6610 msgr2=0x7f85700a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:39.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.940+0000 7f8575c4a700 1 -- 172.21.15.156:0/1878565544 shutdown_connections 2023-09-30T22:18:39.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.940+0000 7f8575c4a700 1 -- 172.21.15.156:0/1878565544 wait complete. 2023-09-30T22:18:39.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705693 for osd.2 2023-09-30T22:18:39.952 DEBUG:teuthology.parallel:result is None 2023-09-30T22:18:39.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.964+0000 7f80c0673700 1 -- 172.21.15.156:0/452693087 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f80b8072480 con 0x7f80b809a730 2023-09-30T22:18:39.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.965+0000 7f80aeffd700 1 -- 172.21.15.156:0/452693087 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f80b8072480 con 0x7f80b809a730 2023-09-30T22:18:39.965 INFO:teuthology.orchestra.run.smithi156.stdout:38654705693 2023-09-30T22:18:39.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.967+0000 7f80c0673700 1 -- 172.21.15.156:0/452693087 >> v1:172.21.15.156:6816/126965 conn(0x7f809c02f240 legacy=0x7f809c0316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:39.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.967+0000 7f80c0673700 1 -- 172.21.15.156:0/452693087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80b809a730 msgr2=0x7f80b81c63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:39.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.967+0000 7f80c0673700 1 --2- 172.21.15.156:0/452693087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80b809a730 0x7f80b81c63d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f80a800e9e0 tx=0x7f80a800ecf0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.967+0000 7f80c0673700 1 -- 172.21.15.156:0/452693087 shutdown_connections 2023-09-30T22:18:39.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.967+0000 7f80c0673700 1 --2- 172.21.15.156:0/452693087 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80b8130890 0x7f80b81c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.967+0000 7f80c0673700 1 --2- 172.21.15.156:0/452693087 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f80b8099e20 0x7f80b81c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.967+0000 7f80c0673700 1 --2- 172.21.15.156:0/452693087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80b809a730 0x7f80b81c63d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.967+0000 7f80c0673700 1 -- 172.21.15.156:0/452693087 >> 172.21.15.156:0/452693087 conn(0x7f80b80a2980 msgr2=0x7f80b806df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:39.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.967+0000 7f80c0673700 1 -- 172.21.15.156:0/452693087 shutdown_connections 2023-09-30T22:18:39.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.967+0000 7f80c0673700 1 -- 172.21.15.156:0/452693087 wait complete. 2023-09-30T22:18:39.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705693 for osd.3 2023-09-30T22:18:39.983 DEBUG:teuthology.parallel:result is None 2023-09-30T22:18:39.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.990+0000 7f62bcd27700 1 -- 172.21.15.156:0/2990909686 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f62b806bce0 con 0x7f62b8138040 2023-09-30T22:18:39.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.990+0000 7f62a6ffd700 1 -- 172.21.15.156:0/2990909686 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f62b001a390 con 0x7f62b8138040 2023-09-30T22:18:39.991 INFO:teuthology.orchestra.run.smithi156.stdout:38654705693 2023-09-30T22:18:39.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.993+0000 7f62bcd27700 1 -- 172.21.15.156:0/2990909686 >> v1:172.21.15.156:6816/126965 conn(0x7f629802f240 legacy=0x7f62980316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:39.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.993+0000 7f62bcd27700 1 -- 172.21.15.156:0/2990909686 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62b8138040 msgr2=0x7f62b81d4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:39.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.993+0000 7f62bcd27700 1 --2- 172.21.15.156:0/2990909686 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62b8138040 0x7f62b81d4f70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f62b0015000 tx=0x7f62b0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.993+0000 7f62bcd27700 1 -- 172.21.15.156:0/2990909686 shutdown_connections 2023-09-30T22:18:39.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.993+0000 7f62bcd27700 1 --2- 172.21.15.156:0/2990909686 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62b8138040 0x7f62b81d4f70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.993+0000 7f62bcd27700 1 --2- 172.21.15.156:0/2990909686 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62b80a08e0 0x7f62b81348c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.993+0000 7f62bcd27700 1 --2- 172.21.15.156:0/2990909686 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62b80a1230 0x7f62b8134e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:39.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.993+0000 7f62bcd27700 1 -- 172.21.15.156:0/2990909686 >> 172.21.15.156:0/2990909686 conn(0x7f62b80a2980 msgr2=0x7f62b8070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:39.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.993+0000 7f62bcd27700 1 -- 172.21.15.156:0/2990909686 shutdown_connections 2023-09-30T22:18:39.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:39.993+0000 7f62bcd27700 1 -- 172.21.15.156:0/2990909686 wait complete. 2023-09-30T22:18:40.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705693 for osd.1 2023-09-30T22:18:40.005 DEBUG:teuthology.parallel:result is None 2023-09-30T22:18:40.006 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-30T22:18:40.006 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:18:40.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.172+0000 7f2e2ea3d700 1 Processor -- start 2023-09-30T22:18:40.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.172+0000 7f2e2ea3d700 1 -- start start 2023-09-30T22:18:40.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.173+0000 7f2e2ea3d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2e2812feb0 0x7f2e28130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:40.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.173+0000 7f2e2ea3d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e28099af0 0x7f2e28137ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:40.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.173+0000 7f2e2ea3d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2809a540 con 0x7f2e281307c0 2023-09-30T22:18:40.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.173+0000 7f2e2ea3d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e2809ad40 con 0x7f2e2812feb0 2023-09-30T22:18:40.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.173+0000 7f2e2ea3d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2809e640 con 0x7f2e28099af0 2023-09-30T22:18:40.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.173+0000 7f2e27fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2e2812feb0 0x7f2e28130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:40.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.173+0000 7f2e277fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f2e281307c0 0x7f2e280993e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:42694/0 (socket says 172.21.15.156:42694) 2023-09-30T22:18:40.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.173+0000 7f2e277fe700 1 -- 172.21.15.156:0/2541139229 learned_addr learned my addr 172.21.15.156:0/2541139229 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:18:40.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.173+0000 7f2e2cfda700 1 --2- 172.21.15.156:0/2541139229 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e28099af0 0x7f2e28137ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:40.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.173+0000 7f2e26ffd700 1 -- 172.21.15.156:0/2541139229 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 703602156 0 0) 0x7f2e2809a540 con 0x7f2e281307c0 2023-09-30T22:18:40.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.173+0000 7f2e26ffd700 1 -- 172.21.15.156:0/2541139229 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e100035b0 con 0x7f2e281307c0 2023-09-30T22:18:40.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.173+0000 7f2e27fff700 1 -- 172.21.15.156:0/2541139229 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e28099af0 msgr2=0x7f2e28137ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:40.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.173+0000 7f2e27fff700 1 --2- 172.21.15.156:0/2541139229 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e28099af0 0x7f2e28137ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:40.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.173+0000 7f2e27fff700 1 -- 172.21.15.156:0/2541139229 >> v1:172.21.15.156:6789/0 conn(0x7f2e281307c0 legacy=0x7f2e280993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:40.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.173+0000 7f2e27fff700 1 -- 172.21.15.156:0/2541139229 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2809e3c0 con 0x7f2e2812feb0 2023-09-30T22:18:40.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.173+0000 7f2e27fff700 1 --2- 172.21.15.156:0/2541139229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e2812feb0 0x7f2e28130280 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2e1800bac0 tx=0x7f2e1800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a45c5548c5dacc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:40.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.173+0000 7f2e26ffd700 1 -- 172.21.15.156:0/2541139229 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e18005e30 con 0x7f2e2812feb0 2023-09-30T22:18:40.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.173+0000 7f2e26ffd700 1 -- 172.21.15.156:0/2541139229 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1800d860 con 0x7f2e2812feb0 2023-09-30T22:18:40.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.173+0000 7f2e26ffd700 1 -- 172.21.15.156:0/2541139229 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1800dbf0 con 0x7f2e2812feb0 2023-09-30T22:18:40.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.174+0000 7f2e2ea3d700 1 -- 172.21.15.156:0/2541139229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e2812feb0 msgr2=0x7f2e28130280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:40.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.174+0000 7f2e2ea3d700 1 --2- 172.21.15.156:0/2541139229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e2812feb0 0x7f2e28130280 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2e1800bac0 tx=0x7f2e1800bdd0 comp rx=0 tx=0).stop 2023-09-30T22:18:40.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.174+0000 7f2e2ea3d700 1 -- 172.21.15.156:0/2541139229 shutdown_connections 2023-09-30T22:18:40.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.174+0000 7f2e2ea3d700 1 --2- 172.21.15.156:0/2541139229 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e28099af0 0x7f2e28137ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:40.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.174+0000 7f2e2ea3d700 1 --2- 172.21.15.156:0/2541139229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e2812feb0 0x7f2e28130280 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:40.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.174+0000 7f2e2ea3d700 1 -- 172.21.15.156:0/2541139229 >> 172.21.15.156:0/2541139229 conn(0x7f2e280a2b30 msgr2=0x7f2e2809e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:40.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.174+0000 7f2e2ea3d700 1 -- 172.21.15.156:0/2541139229 shutdown_connections 2023-09-30T22:18:40.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.174+0000 7f2e2ea3d700 1 -- 172.21.15.156:0/2541139229 wait complete. 2023-09-30T22:18:40.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.175+0000 7f2e2ea3d700 1 Processor -- start 2023-09-30T22:18:40.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.175+0000 7f2e2ea3d700 1 -- start start 2023-09-30T22:18:40.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.176+0000 7f2e2ea3d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e28099af0 0x7f2e281c7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:40.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.176+0000 7f2e2ea3d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e2812feb0 0x7f2e281c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:40.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.176+0000 7f2e2ea3d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e281307c0 0x7f2e281c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:40.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.176+0000 7f2e2ea3d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2812a2c0 con 0x7f2e2812feb0 2023-09-30T22:18:40.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.176+0000 7f2e2ea3d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e28128480 con 0x7f2e281307c0 2023-09-30T22:18:40.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.176+0000 7f2e2ea3d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2808b810 con 0x7f2e28099af0 2023-09-30T22:18:40.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.176+0000 7f2e2cfda700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e281307c0 0x7f2e281c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:40.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.176+0000 7f2e27fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e28099af0 0x7f2e281c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:40.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.176+0000 7f2e2cfda700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e281307c0 0x7f2e281c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:58200/0 (socket says 172.21.15.156:58200) 2023-09-30T22:18:40.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.176+0000 7f2e2cfda700 1 -- 172.21.15.156:0/1249290171 learned_addr learned my addr 172.21.15.156:0/1249290171 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:40.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.176+0000 7f2e277fe700 1 --2- 172.21.15.156:0/1249290171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e2812feb0 0x7f2e281c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:40.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.176+0000 7f2e2cfda700 1 -- 172.21.15.156:0/1249290171 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e28099af0 msgr2=0x7f2e281c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:40.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.176+0000 7f2e2cfda700 1 --2- 172.21.15.156:0/1249290171 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e28099af0 0x7f2e281c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:40.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.176+0000 7f2e2cfda700 1 -- 172.21.15.156:0/1249290171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e2812feb0 msgr2=0x7f2e281c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:40.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.176+0000 7f2e2cfda700 1 --2- 172.21.15.156:0/1249290171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e2812feb0 0x7f2e281c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:40.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.176+0000 7f2e2cfda700 1 -- 172.21.15.156:0/1249290171 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1800b6d0 con 0x7f2e281307c0 2023-09-30T22:18:40.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.176+0000 7f2e27fff700 1 --2- 172.21.15.156:0/1249290171 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e28099af0 0x7f2e281c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:40.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.176+0000 7f2e2cfda700 1 --2- 172.21.15.156:0/1249290171 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e281307c0 0x7f2e281c7f80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2e2000efc0 tx=0x7f2e2000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:40.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.176+0000 7f2e24ff9700 1 -- 172.21.15.156:0/1249290171 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e20009ea0 con 0x7f2e281307c0 2023-09-30T22:18:40.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.176+0000 7f2e24ff9700 1 -- 172.21.15.156:0/1249290171 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2000f040 con 0x7f2e281307c0 2023-09-30T22:18:40.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.176+0000 7f2e24ff9700 1 -- 172.21.15.156:0/1249290171 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2000ced0 con 0x7f2e281307c0 2023-09-30T22:18:40.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.176+0000 7f2e2ea3d700 1 -- 172.21.15.156:0/1249290171 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e28098e90 con 0x7f2e281307c0 2023-09-30T22:18:40.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.176+0000 7f2e2ea3d700 1 -- 172.21.15.156:0/1249290171 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e281c7cd0 con 0x7f2e281307c0 2023-09-30T22:18:40.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.177+0000 7f2e2ea3d700 1 -- 172.21.15.156:0/1249290171 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e2804f2a0 con 0x7f2e281307c0 2023-09-30T22:18:40.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.178+0000 7f2e24ff9700 1 -- 172.21.15.156:0/1249290171 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f2e20014480 con 0x7f2e281307c0 2023-09-30T22:18:40.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.178+0000 7f2e24ff9700 1 -- 172.21.15.156:0/1249290171 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f2e20040770 con 0x7f2e281307c0 2023-09-30T22:18:40.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.183+0000 7f2e24ff9700 1 -- 172.21.15.156:0/1249290171 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e20012910 con 0x7f2e281307c0 2023-09-30T22:18:40.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.377+0000 7f2e2ea3d700 1 -- 172.21.15.156:0/1249290171 --> v1:172.21.15.156:6816/126965 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2e2809aa80 con 0x7f2e1402f240 2023-09-30T22:18:40.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.384+0000 7f2e24ff9700 1 -- 172.21.15.156:0/1249290171 <== mgr.14098 v1:172.21.15.156:6816/126965 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270511 (unknown 2965378022 0 1677684060) 0x7f2e18010470 con 0x7f2e1402f240 2023-09-30T22:18:40.388 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:18:40.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.388+0000 7f2e2ea3d700 1 -- 172.21.15.156:0/1249290171 >> v1:172.21.15.156:6816/126965 conn(0x7f2e1402f240 legacy=0x7f2e140316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:40.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.388+0000 7f2e2ea3d700 1 -- 172.21.15.156:0/1249290171 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e281307c0 msgr2=0x7f2e281c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:40.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.388+0000 7f2e2ea3d700 1 --2- 172.21.15.156:0/1249290171 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e281307c0 0x7f2e281c7f80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2e2000efc0 tx=0x7f2e2000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:18:40.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.388+0000 7f2e2ea3d700 1 -- 172.21.15.156:0/1249290171 shutdown_connections 2023-09-30T22:18:40.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.388+0000 7f2e2ea3d700 1 --2- 172.21.15.156:0/1249290171 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e281307c0 0x7f2e281c7f80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:40.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.388+0000 7f2e2ea3d700 1 --2- 172.21.15.156:0/1249290171 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e28099af0 0x7f2e281c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:40.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.388+0000 7f2e2ea3d700 1 --2- 172.21.15.156:0/1249290171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e2812feb0 0x7f2e281c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:40.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.388+0000 7f2e2ea3d700 1 -- 172.21.15.156:0/1249290171 >> 172.21.15.156:0/1249290171 conn(0x7f2e280a2b30 msgr2=0x7f2e2812ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:40.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.388+0000 7f2e2ea3d700 1 -- 172.21.15.156:0/1249290171 shutdown_connections 2023-09-30T22:18:40.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.388+0000 7f2e2ea3d700 1 -- 172.21.15.156:0/1249290171 wait complete. 2023-09-30T22:18:40.391 INFO:teuthology.orchestra.run.smithi156.stderr:dumped all 2023-09-30T22:18:40.402 INFO:teuthology.orchestra.run.smithi156.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2023-09-30T22:18:39.778477+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189096,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298264,"statfs":{"total":386547056640,"available":385329422336,"internally_reserved":0,"allocated":729088,"data_stored":247081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.999368"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.818760+0000","last_change":"2023-09-30T22:16:29.812173+0000","last_active":"2023-09-30T22:18:37.818760+0000","last_peered":"2023-09-30T22:18:37.818760+0000","last_clean":"2023-09-30T22:18:37.818760+0000","last_became_active":"2023-09-30T22:16:29.811948+0000","last_became_peered":"2023-09-30T22:16:29.811948+0000","last_unstale":"2023-09-30T22:18:37.818760+0000","last_undegraded":"2023-09-30T22:18:37.818760+0000","last_fullsized":"2023-09-30T22:18:37.818760+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.819492+0000","last_change":"2023-09-30T22:16:29.827324+0000","last_active":"2023-09-30T22:18:37.819492+0000","last_peered":"2023-09-30T22:18:37.819492+0000","last_clean":"2023-09-30T22:18:37.819492+0000","last_became_active":"2023-09-30T22:16:29.826847+0000","last_became_peered":"2023-09-30T22:16:29.826847+0000","last_unstale":"2023-09-30T22:18:37.819492+0000","last_undegraded":"2023-09-30T22:18:37.819492+0000","last_fullsized":"2023-09-30T22:18:37.819492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.028037+0000","last_change":"2023-09-30T22:16:29.825941+0000","last_active":"2023-09-30T22:17:22.028037+0000","last_peered":"2023-09-30T22:17:22.028037+0000","last_clean":"2023-09-30T22:17:22.028037+0000","last_became_active":"2023-09-30T22:16:29.825655+0000","last_became_peered":"2023-09-30T22:16:29.825655+0000","last_unstale":"2023-09-30T22:17:22.028037+0000","last_undegraded":"2023-09-30T22:17:22.028037+0000","last_fullsized":"2023-09-30T22:17:22.028037+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.026216+0000","last_change":"2023-09-30T22:16:29.822545+0000","last_active":"2023-09-30T22:17:22.026216+0000","last_peered":"2023-09-30T22:17:22.026216+0000","last_clean":"2023-09-30T22:17:22.026216+0000","last_became_active":"2023-09-30T22:16:29.822264+0000","last_became_peered":"2023-09-30T22:16:29.822264+0000","last_unstale":"2023-09-30T22:17:22.026216+0000","last_undegraded":"2023-09-30T22:17:22.026216+0000","last_fullsized":"2023-09-30T22:17:22.026216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.032606+0000","last_change":"2023-09-30T22:17:22.029358+0000","last_active":"2023-09-30T22:17:22.032606+0000","last_peered":"2023-09-30T22:17:22.032606+0000","last_clean":"2023-09-30T22:17:22.032606+0000","last_became_active":"2023-09-30T22:17:22.029070+0000","last_became_peered":"2023-09-30T22:17:22.029070+0000","last_unstale":"2023-09-30T22:17:22.032606+0000","last_undegraded":"2023-09-30T22:17:22.032606+0000","last_fullsized":"2023-09-30T22:17:22.032606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025191+0000","last_change":"2023-09-30T22:16:29.820688+0000","last_active":"2023-09-30T22:17:22.025191+0000","last_peered":"2023-09-30T22:17:22.025191+0000","last_clean":"2023-09-30T22:17:22.025191+0000","last_became_active":"2023-09-30T22:16:29.820480+0000","last_became_peered":"2023-09-30T22:16:29.820480+0000","last_unstale":"2023-09-30T22:17:22.025191+0000","last_undegraded":"2023-09-30T22:17:22.025191+0000","last_fullsized":"2023-09-30T22:17:22.025191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.023822+0000","last_change":"2023-09-30T22:16:29.834595+0000","last_active":"2023-09-30T22:17:22.023822+0000","last_peered":"2023-09-30T22:17:22.023822+0000","last_clean":"2023-09-30T22:17:22.023822+0000","last_became_active":"2023-09-30T22:16:29.834156+0000","last_became_peered":"2023-09-30T22:16:29.834156+0000","last_unstale":"2023-09-30T22:17:22.023822+0000","last_undegraded":"2023-09-30T22:17:22.023822+0000","last_fullsized":"2023-09-30T22:17:22.023822+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024290+0000","last_change":"2023-09-30T22:16:29.822064+0000","last_active":"2023-09-30T22:17:22.024290+0000","last_peered":"2023-09-30T22:17:22.024290+0000","last_clean":"2023-09-30T22:17:22.024290+0000","last_became_active":"2023-09-30T22:16:29.821816+0000","last_became_peered":"2023-09-30T22:16:29.821816+0000","last_unstale":"2023-09-30T22:17:22.024290+0000","last_undegraded":"2023-09-30T22:17:22.024290+0000","last_fullsized":"2023-09-30T22:17:22.024290+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.028402+0000","last_change":"2023-09-30T22:16:29.828044+0000","last_active":"2023-09-30T22:17:22.028402+0000","last_peered":"2023-09-30T22:17:22.028402+0000","last_clean":"2023-09-30T22:17:22.028402+0000","last_became_active":"2023-09-30T22:16:29.827740+0000","last_became_peered":"2023-09-30T22:16:29.827740+0000","last_unstale":"2023-09-30T22:17:22.028402+0000","last_undegraded":"2023-09-30T22:17:22.028402+0000","last_fullsized":"2023-09-30T22:17:22.028402+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027827+0000","last_change":"2023-09-30T22:16:29.824597+0000","last_active":"2023-09-30T22:17:22.027827+0000","last_peered":"2023-09-30T22:17:22.027827+0000","last_clean":"2023-09-30T22:17:22.027827+0000","last_became_active":"2023-09-30T22:16:29.824344+0000","last_became_peered":"2023-09-30T22:16:29.824344+0000","last_unstale":"2023-09-30T22:17:22.027827+0000","last_undegraded":"2023-09-30T22:17:22.027827+0000","last_fullsized":"2023-09-30T22:17:22.027827+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027417+0000","last_change":"2023-09-30T22:16:29.830182+0000","last_active":"2023-09-30T22:17:22.027417+0000","last_peered":"2023-09-30T22:17:22.027417+0000","last_clean":"2023-09-30T22:17:22.027417+0000","last_became_active":"2023-09-30T22:16:29.828962+0000","last_became_peered":"2023-09-30T22:16:29.828962+0000","last_unstale":"2023-09-30T22:17:22.027417+0000","last_undegraded":"2023-09-30T22:17:22.027417+0000","last_fullsized":"2023-09-30T22:17:22.027417+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.819345+0000","last_change":"2023-09-30T22:16:29.833916+0000","last_active":"2023-09-30T22:18:37.819345+0000","last_peered":"2023-09-30T22:18:37.819345+0000","last_clean":"2023-09-30T22:18:37.819345+0000","last_became_active":"2023-09-30T22:16:29.833664+0000","last_became_peered":"2023-09-30T22:16:29.833664+0000","last_unstale":"2023-09-30T22:18:37.819345+0000","last_undegraded":"2023-09-30T22:18:37.819345+0000","last_fullsized":"2023-09-30T22:18:37.819345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.819174+0000","last_change":"2023-09-30T22:16:29.823993+0000","last_active":"2023-09-30T22:18:37.819174+0000","last_peered":"2023-09-30T22:18:37.819174+0000","last_clean":"2023-09-30T22:18:37.819174+0000","last_became_active":"2023-09-30T22:16:29.823725+0000","last_became_peered":"2023-09-30T22:16:29.823725+0000","last_unstale":"2023-09-30T22:18:37.819174+0000","last_undegraded":"2023-09-30T22:18:37.819174+0000","last_fullsized":"2023-09-30T22:18:37.819174+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024773+0000","last_change":"2023-09-30T22:16:29.832518+0000","last_active":"2023-09-30T22:17:22.024773+0000","last_peered":"2023-09-30T22:17:22.024773+0000","last_clean":"2023-09-30T22:17:22.024773+0000","last_became_active":"2023-09-30T22:16:29.832228+0000","last_became_peered":"2023-09-30T22:16:29.832228+0000","last_unstale":"2023-09-30T22:17:22.024773+0000","last_undegraded":"2023-09-30T22:17:22.024773+0000","last_fullsized":"2023-09-30T22:17:22.024773+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025614+0000","last_change":"2023-09-30T22:16:29.814680+0000","last_active":"2023-09-30T22:17:22.025614+0000","last_peered":"2023-09-30T22:17:22.025614+0000","last_clean":"2023-09-30T22:17:22.025614+0000","last_became_active":"2023-09-30T22:16:29.814427+0000","last_became_peered":"2023-09-30T22:16:29.814427+0000","last_unstale":"2023-09-30T22:17:22.025614+0000","last_undegraded":"2023-09-30T22:17:22.025614+0000","last_fullsized":"2023-09-30T22:17:22.025614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.022449+0000","last_change":"2023-09-30T22:16:29.833416+0000","last_active":"2023-09-30T22:17:22.022449+0000","last_peered":"2023-09-30T22:17:22.022449+0000","last_clean":"2023-09-30T22:17:22.022449+0000","last_became_active":"2023-09-30T22:16:29.833121+0000","last_became_peered":"2023-09-30T22:16:29.833121+0000","last_unstale":"2023-09-30T22:17:22.022449+0000","last_undegraded":"2023-09-30T22:17:22.022449+0000","last_fullsized":"2023-09-30T22:17:22.022449+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.028379+0000","last_change":"2023-09-30T22:16:29.823463+0000","last_active":"2023-09-30T22:17:22.028379+0000","last_peered":"2023-09-30T22:17:22.028379+0000","last_clean":"2023-09-30T22:17:22.028379+0000","last_became_active":"2023-09-30T22:16:29.823207+0000","last_became_peered":"2023-09-30T22:16:29.823207+0000","last_unstale":"2023-09-30T22:17:22.028379+0000","last_undegraded":"2023-09-30T22:17:22.028379+0000","last_fullsized":"2023-09-30T22:17:22.028379+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.028369+0000","last_change":"2023-09-30T22:16:29.816722+0000","last_active":"2023-09-30T22:17:22.028369+0000","last_peered":"2023-09-30T22:17:22.028369+0000","last_clean":"2023-09-30T22:17:22.028369+0000","last_became_active":"2023-09-30T22:16:29.816461+0000","last_became_peered":"2023-09-30T22:16:29.816461+0000","last_unstale":"2023-09-30T22:17:22.028369+0000","last_undegraded":"2023-09-30T22:17:22.028369+0000","last_fullsized":"2023-09-30T22:17:22.028369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.819454+0000","last_change":"2023-09-30T22:16:29.833443+0000","last_active":"2023-09-30T22:18:37.819454+0000","last_peered":"2023-09-30T22:18:37.819454+0000","last_clean":"2023-09-30T22:18:37.819454+0000","last_became_active":"2023-09-30T22:16:29.833187+0000","last_became_peered":"2023-09-30T22:16:29.833187+0000","last_unstale":"2023-09-30T22:18:37.819454+0000","last_undegraded":"2023-09-30T22:18:37.819454+0000","last_fullsized":"2023-09-30T22:18:37.819454+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027443+0000","last_change":"2023-09-30T22:16:29.828875+0000","last_active":"2023-09-30T22:17:22.027443+0000","last_peered":"2023-09-30T22:17:22.027443+0000","last_clean":"2023-09-30T22:17:22.027443+0000","last_became_active":"2023-09-30T22:16:29.828593+0000","last_became_peered":"2023-09-30T22:16:29.828593+0000","last_unstale":"2023-09-30T22:17:22.027443+0000","last_undegraded":"2023-09-30T22:17:22.027443+0000","last_fullsized":"2023-09-30T22:17:22.027443+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027086+0000","last_change":"2023-09-30T22:16:29.827607+0000","last_active":"2023-09-30T22:17:22.027086+0000","last_peered":"2023-09-30T22:17:22.027086+0000","last_clean":"2023-09-30T22:17:22.027086+0000","last_became_active":"2023-09-30T22:16:29.826392+0000","last_became_peered":"2023-09-30T22:16:29.826392+0000","last_unstale":"2023-09-30T22:17:22.027086+0000","last_undegraded":"2023-09-30T22:17:22.027086+0000","last_fullsized":"2023-09-30T22:17:22.027086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025201+0000","last_change":"2023-09-30T22:16:29.823191+0000","last_active":"2023-09-30T22:17:22.025201+0000","last_peered":"2023-09-30T22:17:22.025201+0000","last_clean":"2023-09-30T22:17:22.025201+0000","last_became_active":"2023-09-30T22:16:29.822796+0000","last_became_peered":"2023-09-30T22:16:29.822796+0000","last_unstale":"2023-09-30T22:17:22.025201+0000","last_undegraded":"2023-09-30T22:17:22.025201+0000","last_fullsized":"2023-09-30T22:17:22.025201+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.023751+0000","last_change":"2023-09-30T22:16:29.834377+0000","last_active":"2023-09-30T22:17:22.023751+0000","last_peered":"2023-09-30T22:17:22.023751+0000","last_clean":"2023-09-30T22:17:22.023751+0000","last_became_active":"2023-09-30T22:16:29.833873+0000","last_became_peered":"2023-09-30T22:16:29.833873+0000","last_unstale":"2023-09-30T22:17:22.023751+0000","last_undegraded":"2023-09-30T22:17:22.023751+0000","last_fullsized":"2023-09-30T22:17:22.023751+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024373+0000","last_change":"2023-09-30T22:16:29.821578+0000","last_active":"2023-09-30T22:17:22.024373+0000","last_peered":"2023-09-30T22:17:22.024373+0000","last_clean":"2023-09-30T22:17:22.024373+0000","last_became_active":"2023-09-30T22:16:29.818116+0000","last_became_peered":"2023-09-30T22:16:29.818116+0000","last_unstale":"2023-09-30T22:17:22.024373+0000","last_undegraded":"2023-09-30T22:17:22.024373+0000","last_fullsized":"2023-09-30T22:17:22.024373+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027535+0000","last_change":"2023-09-30T22:16:29.829048+0000","last_active":"2023-09-30T22:17:22.027535+0000","last_peered":"2023-09-30T22:17:22.027535+0000","last_clean":"2023-09-30T22:17:22.027535+0000","last_became_active":"2023-09-30T22:16:29.828174+0000","last_became_peered":"2023-09-30T22:16:29.828174+0000","last_unstale":"2023-09-30T22:17:22.027535+0000","last_undegraded":"2023-09-30T22:17:22.027535+0000","last_fullsized":"2023-09-30T22:17:22.027535+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027754+0000","last_change":"2023-09-30T22:16:29.834779+0000","last_active":"2023-09-30T22:17:22.027754+0000","last_peered":"2023-09-30T22:17:22.027754+0000","last_clean":"2023-09-30T22:17:22.027754+0000","last_became_active":"2023-09-30T22:16:29.833042+0000","last_became_peered":"2023-09-30T22:16:29.833042+0000","last_unstale":"2023-09-30T22:17:22.027754+0000","last_undegraded":"2023-09-30T22:17:22.027754+0000","last_fullsized":"2023-09-30T22:17:22.027754+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024034+0000","last_change":"2023-09-30T22:16:29.832499+0000","last_active":"2023-09-30T22:17:22.024034+0000","last_peered":"2023-09-30T22:17:22.024034+0000","last_clean":"2023-09-30T22:17:22.024034+0000","last_became_active":"2023-09-30T22:16:29.831898+0000","last_became_peered":"2023-09-30T22:16:29.831898+0000","last_unstale":"2023-09-30T22:17:22.024034+0000","last_undegraded":"2023-09-30T22:17:22.024034+0000","last_fullsized":"2023-09-30T22:17:22.024034+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024183+0000","last_change":"2023-09-30T22:16:29.448332+0000","last_active":"2023-09-30T22:17:22.024183+0000","last_peered":"2023-09-30T22:17:22.024183+0000","last_clean":"2023-09-30T22:17:22.024183+0000","last_became_active":"2023-09-30T22:16:29.448043+0000","last_became_peered":"2023-09-30T22:16:29.448043+0000","last_unstale":"2023-09-30T22:17:22.024183+0000","last_undegraded":"2023-09-30T22:17:22.024183+0000","last_fullsized":"2023-09-30T22:17:22.024183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.023734+0000","last_change":"2023-09-30T22:16:29.831419+0000","last_active":"2023-09-30T22:17:22.023734+0000","last_peered":"2023-09-30T22:17:22.023734+0000","last_clean":"2023-09-30T22:17:22.023734+0000","last_became_active":"2023-09-30T22:16:29.830841+0000","last_became_peered":"2023-09-30T22:16:29.830841+0000","last_unstale":"2023-09-30T22:17:22.023734+0000","last_undegraded":"2023-09-30T22:17:22.023734+0000","last_fullsized":"2023-09-30T22:17:22.023734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024625+0000","last_change":"2023-09-30T22:16:29.449809+0000","last_active":"2023-09-30T22:17:22.024625+0000","last_peered":"2023-09-30T22:17:22.024625+0000","last_clean":"2023-09-30T22:17:22.024625+0000","last_became_active":"2023-09-30T22:16:29.449538+0000","last_became_peered":"2023-09-30T22:16:29.449538+0000","last_unstale":"2023-09-30T22:17:22.024625+0000","last_undegraded":"2023-09-30T22:17:22.024625+0000","last_fullsized":"2023-09-30T22:17:22.024625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.028453+0000","last_change":"2023-09-30T22:16:29.822995+0000","last_active":"2023-09-30T22:17:22.028453+0000","last_peered":"2023-09-30T22:17:22.028453+0000","last_clean":"2023-09-30T22:17:22.028453+0000","last_became_active":"2023-09-30T22:16:29.822621+0000","last_became_peered":"2023-09-30T22:16:29.822621+0000","last_unstale":"2023-09-30T22:17:22.028453+0000","last_undegraded":"2023-09-30T22:17:22.028453+0000","last_fullsized":"2023-09-30T22:17:22.028453+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.022890+0000","last_change":"2023-09-30T22:16:29.452955+0000","last_active":"2023-09-30T22:17:22.022890+0000","last_peered":"2023-09-30T22:17:22.022890+0000","last_clean":"2023-09-30T22:17:22.022890+0000","last_became_active":"2023-09-30T22:16:29.449928+0000","last_became_peered":"2023-09-30T22:16:29.449928+0000","last_unstale":"2023-09-30T22:17:22.022890+0000","last_undegraded":"2023-09-30T22:17:22.022890+0000","last_fullsized":"2023-09-30T22:17:22.022890+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.026890+0000","last_change":"2023-09-30T22:16:29.831592+0000","last_active":"2023-09-30T22:17:22.026890+0000","last_peered":"2023-09-30T22:17:22.026890+0000","last_clean":"2023-09-30T22:17:22.026890+0000","last_became_active":"2023-09-30T22:16:29.831170+0000","last_became_peered":"2023-09-30T22:16:29.831170+0000","last_unstale":"2023-09-30T22:17:22.026890+0000","last_undegraded":"2023-09-30T22:17:22.026890+0000","last_fullsized":"2023-09-30T22:17:22.026890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.028306+0000","last_change":"2023-09-30T22:16:29.452637+0000","last_active":"2023-09-30T22:17:22.028306+0000","last_peered":"2023-09-30T22:17:22.028306+0000","last_clean":"2023-09-30T22:17:22.028306+0000","last_became_active":"2023-09-30T22:16:29.452263+0000","last_became_peered":"2023-09-30T22:16:29.452263+0000","last_unstale":"2023-09-30T22:17:22.028306+0000","last_undegraded":"2023-09-30T22:17:22.028306+0000","last_fullsized":"2023-09-30T22:17:22.028306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.032764+0000","last_change":"2023-09-30T22:17:22.031503+0000","last_active":"2023-09-30T22:17:22.032764+0000","last_peered":"2023-09-30T22:17:22.032764+0000","last_clean":"2023-09-30T22:17:22.032764+0000","last_became_active":"2023-09-30T22:17:22.031171+0000","last_became_peered":"2023-09-30T22:17:22.031171+0000","last_unstale":"2023-09-30T22:17:22.032764+0000","last_undegraded":"2023-09-30T22:17:22.032764+0000","last_fullsized":"2023-09-30T22:17:22.032764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.819337+0000","last_change":"2023-09-30T22:16:29.448611+0000","last_active":"2023-09-30T22:18:37.819337+0000","last_peered":"2023-09-30T22:18:37.819337+0000","last_clean":"2023-09-30T22:18:37.819337+0000","last_became_active":"2023-09-30T22:16:29.448289+0000","last_became_peered":"2023-09-30T22:16:29.448289+0000","last_unstale":"2023-09-30T22:18:37.819337+0000","last_undegraded":"2023-09-30T22:18:37.819337+0000","last_fullsized":"2023-09-30T22:18:37.819337+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024057+0000","last_change":"2023-09-30T22:16:29.836465+0000","last_active":"2023-09-30T22:17:22.024057+0000","last_peered":"2023-09-30T22:17:22.024057+0000","last_clean":"2023-09-30T22:17:22.024057+0000","last_became_active":"2023-09-30T22:16:29.834303+0000","last_became_peered":"2023-09-30T22:16:29.834303+0000","last_unstale":"2023-09-30T22:17:22.024057+0000","last_undegraded":"2023-09-30T22:17:22.024057+0000","last_fullsized":"2023-09-30T22:17:22.024057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027961+0000","last_change":"2023-09-30T22:16:29.448241+0000","last_active":"2023-09-30T22:17:22.027961+0000","last_peered":"2023-09-30T22:17:22.027961+0000","last_clean":"2023-09-30T22:17:22.027961+0000","last_became_active":"2023-09-30T22:16:29.447960+0000","last_became_peered":"2023-09-30T22:16:29.447960+0000","last_unstale":"2023-09-30T22:17:22.027961+0000","last_undegraded":"2023-09-30T22:17:22.027961+0000","last_fullsized":"2023-09-30T22:17:22.027961+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024695+0000","last_change":"2023-09-30T22:16:29.825275+0000","last_active":"2023-09-30T22:17:22.024695+0000","last_peered":"2023-09-30T22:17:22.024695+0000","last_clean":"2023-09-30T22:17:22.024695+0000","last_became_active":"2023-09-30T22:16:29.825002+0000","last_became_peered":"2023-09-30T22:16:29.825002+0000","last_unstale":"2023-09-30T22:17:22.024695+0000","last_undegraded":"2023-09-30T22:17:22.024695+0000","last_fullsized":"2023-09-30T22:17:22.024695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'12","reported_seq":26,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.840239+0000","last_change":"2023-09-30T22:16:29.449099+0000","last_active":"2023-09-30T22:18:37.840239+0000","last_peered":"2023-09-30T22:18:37.840239+0000","last_clean":"2023-09-30T22:18:37.840239+0000","last_became_active":"2023-09-30T22:16:29.448827+0000","last_became_peered":"2023-09-30T22:16:29.448827+0000","last_unstale":"2023-09-30T22:18:37.840239+0000","last_undegraded":"2023-09-30T22:18:37.840239+0000","last_fullsized":"2023-09-30T22:18:37.840239+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3563,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.818761+0000","last_change":"2023-09-30T22:16:29.811836+0000","last_active":"2023-09-30T22:18:37.818761+0000","last_peered":"2023-09-30T22:18:37.818761+0000","last_clean":"2023-09-30T22:18:37.818761+0000","last_became_active":"2023-09-30T22:16:29.811605+0000","last_became_peered":"2023-09-30T22:16:29.811605+0000","last_unstale":"2023-09-30T22:18:37.818761+0000","last_undegraded":"2023-09-30T22:18:37.818761+0000","last_fullsized":"2023-09-30T22:18:37.818761+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024375+0000","last_change":"2023-09-30T22:16:29.446893+0000","last_active":"2023-09-30T22:17:22.024375+0000","last_peered":"2023-09-30T22:17:22.024375+0000","last_clean":"2023-09-30T22:17:22.024375+0000","last_became_active":"2023-09-30T22:16:29.446554+0000","last_became_peered":"2023-09-30T22:16:29.446554+0000","last_unstale":"2023-09-30T22:17:22.024375+0000","last_undegraded":"2023-09-30T22:17:22.024375+0000","last_fullsized":"2023-09-30T22:17:22.024375+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024051+0000","last_change":"2023-09-30T22:16:29.830170+0000","last_active":"2023-09-30T22:17:22.024051+0000","last_peered":"2023-09-30T22:17:22.024051+0000","last_clean":"2023-09-30T22:17:22.024051+0000","last_became_active":"2023-09-30T22:16:29.829909+0000","last_became_peered":"2023-09-30T22:16:29.829909+0000","last_unstale":"2023-09-30T22:17:22.024051+0000","last_undegraded":"2023-09-30T22:17:22.024051+0000","last_fullsized":"2023-09-30T22:17:22.024051+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025238+0000","last_change":"2023-09-30T22:16:29.453090+0000","last_active":"2023-09-30T22:17:22.025238+0000","last_peered":"2023-09-30T22:17:22.025238+0000","last_clean":"2023-09-30T22:17:22.025238+0000","last_became_active":"2023-09-30T22:16:29.452814+0000","last_became_peered":"2023-09-30T22:16:29.452814+0000","last_unstale":"2023-09-30T22:17:22.025238+0000","last_undegraded":"2023-09-30T22:17:22.025238+0000","last_fullsized":"2023-09-30T22:17:22.025238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025838+0000","last_change":"2023-09-30T22:16:29.832660+0000","last_active":"2023-09-30T22:17:22.025838+0000","last_peered":"2023-09-30T22:17:22.025838+0000","last_clean":"2023-09-30T22:17:22.025838+0000","last_became_active":"2023-09-30T22:16:29.832233+0000","last_became_peered":"2023-09-30T22:16:29.832233+0000","last_unstale":"2023-09-30T22:17:22.025838+0000","last_undegraded":"2023-09-30T22:17:22.025838+0000","last_fullsized":"2023-09-30T22:17:22.025838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.023976+0000","last_change":"2023-09-30T22:16:29.450700+0000","last_active":"2023-09-30T22:17:22.023976+0000","last_peered":"2023-09-30T22:17:22.023976+0000","last_clean":"2023-09-30T22:17:22.023976+0000","last_became_active":"2023-09-30T22:16:29.450434+0000","last_became_peered":"2023-09-30T22:16:29.450434+0000","last_unstale":"2023-09-30T22:17:22.023976+0000","last_undegraded":"2023-09-30T22:17:22.023976+0000","last_fullsized":"2023-09-30T22:17:22.023976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.028538+0000","last_change":"2023-09-30T22:16:29.821215+0000","last_active":"2023-09-30T22:17:22.028538+0000","last_peered":"2023-09-30T22:17:22.028538+0000","last_clean":"2023-09-30T22:17:22.028538+0000","last_became_active":"2023-09-30T22:16:29.820939+0000","last_became_peered":"2023-09-30T22:16:29.820939+0000","last_unstale":"2023-09-30T22:17:22.028538+0000","last_undegraded":"2023-09-30T22:17:22.028538+0000","last_fullsized":"2023-09-30T22:17:22.028538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024998+0000","last_change":"2023-09-30T22:16:29.445251+0000","last_active":"2023-09-30T22:17:22.024998+0000","last_peered":"2023-09-30T22:17:22.024998+0000","last_clean":"2023-09-30T22:17:22.024998+0000","last_became_active":"2023-09-30T22:16:29.441736+0000","last_became_peered":"2023-09-30T22:16:29.441736+0000","last_unstale":"2023-09-30T22:17:22.024998+0000","last_undegraded":"2023-09-30T22:17:22.024998+0000","last_fullsized":"2023-09-30T22:17:22.024998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.026818+0000","last_change":"2023-09-30T22:16:29.836710+0000","last_active":"2023-09-30T22:17:22.026818+0000","last_peered":"2023-09-30T22:17:22.026818+0000","last_clean":"2023-09-30T22:17:22.026818+0000","last_became_active":"2023-09-30T22:16:29.831551+0000","last_became_peered":"2023-09-30T22:16:29.831551+0000","last_unstale":"2023-09-30T22:17:22.026818+0000","last_undegraded":"2023-09-30T22:17:22.026818+0000","last_fullsized":"2023-09-30T22:17:22.026818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.028236+0000","last_change":"2023-09-30T22:16:29.444871+0000","last_active":"2023-09-30T22:17:22.028236+0000","last_peered":"2023-09-30T22:17:22.028236+0000","last_clean":"2023-09-30T22:17:22.028236+0000","last_became_active":"2023-09-30T22:16:29.444600+0000","last_became_peered":"2023-09-30T22:16:29.444600+0000","last_unstale":"2023-09-30T22:17:22.028236+0000","last_undegraded":"2023-09-30T22:17:22.028236+0000","last_fullsized":"2023-09-30T22:17:22.028236+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.023333+0000","last_change":"2023-09-30T22:16:29.839223+0000","last_active":"2023-09-30T22:17:22.023333+0000","last_peered":"2023-09-30T22:17:22.023333+0000","last_clean":"2023-09-30T22:17:22.023333+0000","last_became_active":"2023-09-30T22:16:29.838955+0000","last_became_peered":"2023-09-30T22:16:29.838955+0000","last_unstale":"2023-09-30T22:17:22.023333+0000","last_undegraded":"2023-09-30T22:17:22.023333+0000","last_fullsized":"2023-09-30T22:17:22.023333+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.819410+0000","last_change":"2023-09-30T22:16:29.451861+0000","last_active":"2023-09-30T22:18:37.819410+0000","last_peered":"2023-09-30T22:18:37.819410+0000","last_clean":"2023-09-30T22:18:37.819410+0000","last_became_active":"2023-09-30T22:16:29.451069+0000","last_became_peered":"2023-09-30T22:16:29.451069+0000","last_unstale":"2023-09-30T22:18:37.819410+0000","last_undegraded":"2023-09-30T22:18:37.819410+0000","last_fullsized":"2023-09-30T22:18:37.819410+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.032458+0000","last_change":"2023-09-30T22:17:22.031380+0000","last_active":"2023-09-30T22:17:22.032458+0000","last_peered":"2023-09-30T22:17:22.032458+0000","last_clean":"2023-09-30T22:17:22.032458+0000","last_became_active":"2023-09-30T22:17:22.031091+0000","last_became_peered":"2023-09-30T22:17:22.031091+0000","last_unstale":"2023-09-30T22:17:22.032458+0000","last_undegraded":"2023-09-30T22:17:22.032458+0000","last_fullsized":"2023-09-30T22:17:22.032458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025387+0000","last_change":"2023-09-30T22:16:29.446443+0000","last_active":"2023-09-30T22:17:22.025387+0000","last_peered":"2023-09-30T22:17:22.025387+0000","last_clean":"2023-09-30T22:17:22.025387+0000","last_became_active":"2023-09-30T22:16:29.445833+0000","last_became_peered":"2023-09-30T22:16:29.445833+0000","last_unstale":"2023-09-30T22:17:22.025387+0000","last_undegraded":"2023-09-30T22:17:22.025387+0000","last_fullsized":"2023-09-30T22:17:22.025387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.819161+0000","last_change":"2023-09-30T22:17:22.033367+0000","last_active":"2023-09-30T22:18:37.819161+0000","last_peered":"2023-09-30T22:18:37.819161+0000","last_clean":"2023-09-30T22:18:37.819161+0000","last_became_active":"2023-09-30T22:17:22.033061+0000","last_became_peered":"2023-09-30T22:17:22.033061+0000","last_unstale":"2023-09-30T22:18:37.819161+0000","last_undegraded":"2023-09-30T22:18:37.819161+0000","last_fullsized":"2023-09-30T22:18:37.819161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.026662+0000","last_change":"2023-09-30T22:16:29.451667+0000","last_active":"2023-09-30T22:17:22.026662+0000","last_peered":"2023-09-30T22:17:22.026662+0000","last_clean":"2023-09-30T22:17:22.026662+0000","last_became_active":"2023-09-30T22:16:29.451422+0000","last_became_peered":"2023-09-30T22:16:29.451422+0000","last_unstale":"2023-09-30T22:17:22.026662+0000","last_undegraded":"2023-09-30T22:17:22.026662+0000","last_fullsized":"2023-09-30T22:17:22.026662+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025172+0000","last_change":"2023-09-30T22:16:29.815304+0000","last_active":"2023-09-30T22:17:22.025172+0000","last_peered":"2023-09-30T22:17:22.025172+0000","last_clean":"2023-09-30T22:17:22.025172+0000","last_became_active":"2023-09-30T22:16:29.814885+0000","last_became_peered":"2023-09-30T22:16:29.814885+0000","last_unstale":"2023-09-30T22:17:22.025172+0000","last_undegraded":"2023-09-30T22:17:22.025172+0000","last_fullsized":"2023-09-30T22:17:22.025172+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024216+0000","last_change":"2023-09-30T22:16:29.452814+0000","last_active":"2023-09-30T22:17:22.024216+0000","last_peered":"2023-09-30T22:17:22.024216+0000","last_clean":"2023-09-30T22:17:22.024216+0000","last_became_active":"2023-09-30T22:16:29.452404+0000","last_became_peered":"2023-09-30T22:16:29.452404+0000","last_unstale":"2023-09-30T22:17:22.024216+0000","last_undegraded":"2023-09-30T22:17:22.024216+0000","last_fullsized":"2023-09-30T22:17:22.024216+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.031802+0000","last_change":"2023-09-30T22:17:22.030997+0000","last_active":"2023-09-30T22:17:22.031802+0000","last_peered":"2023-09-30T22:17:22.031802+0000","last_clean":"2023-09-30T22:17:22.031802+0000","last_became_active":"2023-09-30T22:17:22.030696+0000","last_became_peered":"2023-09-30T22:17:22.030696+0000","last_unstale":"2023-09-30T22:17:22.031802+0000","last_undegraded":"2023-09-30T22:17:22.031802+0000","last_fullsized":"2023-09-30T22:17:22.031802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025118+0000","last_change":"2023-09-30T22:16:29.447931+0000","last_active":"2023-09-30T22:17:22.025118+0000","last_peered":"2023-09-30T22:17:22.025118+0000","last_clean":"2023-09-30T22:17:22.025118+0000","last_became_active":"2023-09-30T22:16:29.447158+0000","last_became_peered":"2023-09-30T22:16:29.447158+0000","last_unstale":"2023-09-30T22:17:22.025118+0000","last_undegraded":"2023-09-30T22:17:22.025118+0000","last_fullsized":"2023-09-30T22:17:22.025118+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025676+0000","last_change":"2023-09-30T22:16:29.831438+0000","last_active":"2023-09-30T22:17:22.025676+0000","last_peered":"2023-09-30T22:17:22.025676+0000","last_clean":"2023-09-30T22:17:22.025676+0000","last_became_active":"2023-09-30T22:16:29.831158+0000","last_became_peered":"2023-09-30T22:16:29.831158+0000","last_unstale":"2023-09-30T22:17:22.025676+0000","last_undegraded":"2023-09-30T22:17:22.025676+0000","last_fullsized":"2023-09-30T22:17:22.025676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.023897+0000","last_change":"2023-09-30T22:16:29.449264+0000","last_active":"2023-09-30T22:17:22.023897+0000","last_peered":"2023-09-30T22:17:22.023897+0000","last_clean":"2023-09-30T22:17:22.023897+0000","last_became_active":"2023-09-30T22:16:29.448995+0000","last_became_peered":"2023-09-30T22:16:29.448995+0000","last_unstale":"2023-09-30T22:17:22.023897+0000","last_undegraded":"2023-09-30T22:17:22.023897+0000","last_fullsized":"2023-09-30T22:17:22.023897+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.819428+0000","last_change":"2023-09-30T22:16:29.832641+0000","last_active":"2023-09-30T22:18:37.819428+0000","last_peered":"2023-09-30T22:18:37.819428+0000","last_clean":"2023-09-30T22:18:37.819428+0000","last_became_active":"2023-09-30T22:16:29.832399+0000","last_became_peered":"2023-09-30T22:16:29.832399+0000","last_unstale":"2023-09-30T22:18:37.819428+0000","last_undegraded":"2023-09-30T22:18:37.819428+0000","last_fullsized":"2023-09-30T22:18:37.819428+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.022534+0000","last_change":"2023-09-30T22:16:29.451927+0000","last_active":"2023-09-30T22:17:22.022534+0000","last_peered":"2023-09-30T22:17:22.022534+0000","last_clean":"2023-09-30T22:17:22.022534+0000","last_became_active":"2023-09-30T22:16:29.449397+0000","last_became_peered":"2023-09-30T22:16:29.449397+0000","last_unstale":"2023-09-30T22:17:22.022534+0000","last_undegraded":"2023-09-30T22:17:22.022534+0000","last_fullsized":"2023-09-30T22:17:22.022534+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027475+0000","last_change":"2023-09-30T22:16:29.829224+0000","last_active":"2023-09-30T22:17:22.027475+0000","last_peered":"2023-09-30T22:17:22.027475+0000","last_clean":"2023-09-30T22:17:22.027475+0000","last_became_active":"2023-09-30T22:16:29.828558+0000","last_became_peered":"2023-09-30T22:16:29.828558+0000","last_unstale":"2023-09-30T22:17:22.027475+0000","last_undegraded":"2023-09-30T22:17:22.027475+0000","last_fullsized":"2023-09-30T22:17:22.027475+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027383+0000","last_change":"2023-09-30T22:16:25.780366+0000","last_active":"2023-09-30T22:17:22.027383+0000","last_peered":"2023-09-30T22:17:22.027383+0000","last_clean":"2023-09-30T22:17:22.027383+0000","last_became_active":"2023-09-30T22:16:25.780059+0000","last_became_peered":"2023-09-30T22:16:25.780059+0000","last_unstale":"2023-09-30T22:17:22.027383+0000","last_undegraded":"2023-09-30T22:17:22.027383+0000","last_fullsized":"2023-09-30T22:17:22.027383+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.819405+0000","last_change":"2023-09-30T22:16:29.448527+0000","last_active":"2023-09-30T22:18:37.819405+0000","last_peered":"2023-09-30T22:18:37.819405+0000","last_clean":"2023-09-30T22:18:37.819405+0000","last_became_active":"2023-09-30T22:16:29.448223+0000","last_became_peered":"2023-09-30T22:16:29.448223+0000","last_unstale":"2023-09-30T22:18:37.819405+0000","last_undegraded":"2023-09-30T22:18:37.819405+0000","last_fullsized":"2023-09-30T22:18:37.819405+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.033729+0000","last_change":"2023-09-30T22:17:22.031511+0000","last_active":"2023-09-30T22:17:22.033729+0000","last_peered":"2023-09-30T22:17:22.033729+0000","last_clean":"2023-09-30T22:17:22.033729+0000","last_became_active":"2023-09-30T22:17:22.031211+0000","last_became_peered":"2023-09-30T22:17:22.031211+0000","last_unstale":"2023-09-30T22:17:22.033729+0000","last_undegraded":"2023-09-30T22:17:22.033729+0000","last_fullsized":"2023-09-30T22:17:22.033729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025046+0000","last_change":"2023-09-30T22:16:25.414057+0000","last_active":"2023-09-30T22:17:22.025046+0000","last_peered":"2023-09-30T22:17:22.025046+0000","last_clean":"2023-09-30T22:17:22.025046+0000","last_became_active":"2023-09-30T22:16:25.413712+0000","last_became_peered":"2023-09-30T22:16:25.413712+0000","last_unstale":"2023-09-30T22:17:22.025046+0000","last_undegraded":"2023-09-30T22:17:22.025046+0000","last_fullsized":"2023-09-30T22:17:22.025046+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024879+0000","last_change":"2023-09-30T22:16:29.446619+0000","last_active":"2023-09-30T22:17:22.024879+0000","last_peered":"2023-09-30T22:17:22.024879+0000","last_clean":"2023-09-30T22:17:22.024879+0000","last_became_active":"2023-09-30T22:16:29.446314+0000","last_became_peered":"2023-09-30T22:16:29.446314+0000","last_unstale":"2023-09-30T22:17:22.024879+0000","last_undegraded":"2023-09-30T22:17:22.024879+0000","last_fullsized":"2023-09-30T22:17:22.024879+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027267+0000","last_change":"2023-09-30T22:16:29.835339+0000","last_active":"2023-09-30T22:17:22.027267+0000","last_peered":"2023-09-30T22:17:22.027267+0000","last_clean":"2023-09-30T22:17:22.027267+0000","last_became_active":"2023-09-30T22:16:29.833186+0000","last_became_peered":"2023-09-30T22:16:29.833186+0000","last_unstale":"2023-09-30T22:17:22.027267+0000","last_undegraded":"2023-09-30T22:17:22.027267+0000","last_fullsized":"2023-09-30T22:17:22.027267+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.819028+0000","last_change":"2023-09-30T22:16:25.416240+0000","last_active":"2023-09-30T22:18:37.819028+0000","last_peered":"2023-09-30T22:18:37.819028+0000","last_clean":"2023-09-30T22:18:37.819028+0000","last_became_active":"2023-09-30T22:16:25.415852+0000","last_became_peered":"2023-09-30T22:16:25.415852+0000","last_unstale":"2023-09-30T22:18:37.819028+0000","last_undegraded":"2023-09-30T22:18:37.819028+0000","last_fullsized":"2023-09-30T22:18:37.819028+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024654+0000","last_change":"2023-09-30T22:16:29.449007+0000","last_active":"2023-09-30T22:17:22.024654+0000","last_peered":"2023-09-30T22:17:22.024654+0000","last_clean":"2023-09-30T22:17:22.024654+0000","last_became_active":"2023-09-30T22:16:29.448746+0000","last_became_peered":"2023-09-30T22:16:29.448746+0000","last_unstale":"2023-09-30T22:17:22.024654+0000","last_undegraded":"2023-09-30T22:17:22.024654+0000","last_fullsized":"2023-09-30T22:17:22.024654+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027320+0000","last_change":"2023-09-30T22:16:29.819140+0000","last_active":"2023-09-30T22:17:22.027320+0000","last_peered":"2023-09-30T22:17:22.027320+0000","last_clean":"2023-09-30T22:17:22.027320+0000","last_became_active":"2023-09-30T22:16:29.818875+0000","last_became_peered":"2023-09-30T22:16:29.818875+0000","last_unstale":"2023-09-30T22:17:22.027320+0000","last_undegraded":"2023-09-30T22:17:22.027320+0000","last_fullsized":"2023-09-30T22:17:22.027320+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024291+0000","last_change":"2023-09-30T22:16:25.414050+0000","last_active":"2023-09-30T22:17:22.024291+0000","last_peered":"2023-09-30T22:17:22.024291+0000","last_clean":"2023-09-30T22:17:22.024291+0000","last_became_active":"2023-09-30T22:16:25.413709+0000","last_became_peered":"2023-09-30T22:16:25.413709+0000","last_unstale":"2023-09-30T22:17:22.024291+0000","last_undegraded":"2023-09-30T22:17:22.024291+0000","last_fullsized":"2023-09-30T22:17:22.024291+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024450+0000","last_change":"2023-09-30T22:16:25.781137+0000","last_active":"2023-09-30T22:17:22.024450+0000","last_peered":"2023-09-30T22:17:22.024450+0000","last_clean":"2023-09-30T22:17:22.024450+0000","last_became_active":"2023-09-30T22:16:25.780923+0000","last_became_peered":"2023-09-30T22:16:25.780923+0000","last_unstale":"2023-09-30T22:17:22.024450+0000","last_undegraded":"2023-09-30T22:17:22.024450+0000","last_fullsized":"2023-09-30T22:17:22.024450+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024919+0000","last_change":"2023-09-30T22:16:29.448514+0000","last_active":"2023-09-30T22:17:22.024919+0000","last_peered":"2023-09-30T22:17:22.024919+0000","last_clean":"2023-09-30T22:17:22.024919+0000","last_became_active":"2023-09-30T22:16:29.448270+0000","last_became_peered":"2023-09-30T22:16:29.448270+0000","last_unstale":"2023-09-30T22:17:22.024919+0000","last_undegraded":"2023-09-30T22:17:22.024919+0000","last_fullsized":"2023-09-30T22:17:22.024919+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.819332+0000","last_change":"2023-09-30T22:17:22.029261+0000","last_active":"2023-09-30T22:18:37.819332+0000","last_peered":"2023-09-30T22:18:37.819332+0000","last_clean":"2023-09-30T22:18:37.819332+0000","last_became_active":"2023-09-30T22:17:22.029030+0000","last_became_peered":"2023-09-30T22:17:22.029030+0000","last_unstale":"2023-09-30T22:18:37.819332+0000","last_undegraded":"2023-09-30T22:18:37.819332+0000","last_fullsized":"2023-09-30T22:18:37.819332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.022754+0000","last_change":"2023-09-30T22:16:25.416399+0000","last_active":"2023-09-30T22:17:22.022754+0000","last_peered":"2023-09-30T22:17:22.022754+0000","last_clean":"2023-09-30T22:17:22.022754+0000","last_became_active":"2023-09-30T22:16:25.416054+0000","last_became_peered":"2023-09-30T22:16:25.416054+0000","last_unstale":"2023-09-30T22:17:22.022754+0000","last_undegraded":"2023-09-30T22:17:22.022754+0000","last_fullsized":"2023-09-30T22:17:22.022754+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025538+0000","last_change":"2023-09-30T22:16:29.450979+0000","last_active":"2023-09-30T22:17:22.025538+0000","last_peered":"2023-09-30T22:17:22.025538+0000","last_clean":"2023-09-30T22:17:22.025538+0000","last_became_active":"2023-09-30T22:16:29.450724+0000","last_became_peered":"2023-09-30T22:16:29.450724+0000","last_unstale":"2023-09-30T22:17:22.025538+0000","last_undegraded":"2023-09-30T22:17:22.025538+0000","last_fullsized":"2023-09-30T22:17:22.025538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.028625+0000","last_change":"2023-09-30T22:16:29.827233+0000","last_active":"2023-09-30T22:17:22.028625+0000","last_peered":"2023-09-30T22:17:22.028625+0000","last_clean":"2023-09-30T22:17:22.028625+0000","last_became_active":"2023-09-30T22:16:29.822966+0000","last_became_peered":"2023-09-30T22:16:29.822966+0000","last_unstale":"2023-09-30T22:17:22.028625+0000","last_undegraded":"2023-09-30T22:17:22.028625+0000","last_fullsized":"2023-09-30T22:17:22.028625+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025518+0000","last_change":"2023-09-30T22:16:25.780298+0000","last_active":"2023-09-30T22:17:22.025518+0000","last_peered":"2023-09-30T22:17:22.025518+0000","last_clean":"2023-09-30T22:17:22.025518+0000","last_became_active":"2023-09-30T22:16:25.780022+0000","last_became_peered":"2023-09-30T22:16:25.780022+0000","last_unstale":"2023-09-30T22:17:22.025518+0000","last_undegraded":"2023-09-30T22:17:22.025518+0000","last_fullsized":"2023-09-30T22:17:22.025518+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027226+0000","last_change":"2023-09-30T22:16:29.448428+0000","last_active":"2023-09-30T22:17:22.027226+0000","last_peered":"2023-09-30T22:17:22.027226+0000","last_clean":"2023-09-30T22:17:22.027226+0000","last_became_active":"2023-09-30T22:16:29.447613+0000","last_became_peered":"2023-09-30T22:16:29.447613+0000","last_unstale":"2023-09-30T22:17:22.027226+0000","last_undegraded":"2023-09-30T22:17:22.027226+0000","last_fullsized":"2023-09-30T22:17:22.027226+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025039+0000","last_change":"2023-09-30T22:16:29.815447+0000","last_active":"2023-09-30T22:17:22.025039+0000","last_peered":"2023-09-30T22:17:22.025039+0000","last_clean":"2023-09-30T22:17:22.025039+0000","last_became_active":"2023-09-30T22:16:29.815169+0000","last_became_peered":"2023-09-30T22:16:29.815169+0000","last_unstale":"2023-09-30T22:17:22.025039+0000","last_undegraded":"2023-09-30T22:17:22.025039+0000","last_fullsized":"2023-09-30T22:17:22.025039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.026677+0000","last_change":"2023-09-30T22:16:29.448448+0000","last_active":"2023-09-30T22:17:22.026677+0000","last_peered":"2023-09-30T22:17:22.026677+0000","last_clean":"2023-09-30T22:17:22.026677+0000","last_became_active":"2023-09-30T22:16:29.448177+0000","last_became_peered":"2023-09-30T22:16:29.448177+0000","last_unstale":"2023-09-30T22:17:22.026677+0000","last_undegraded":"2023-09-30T22:17:22.026677+0000","last_fullsized":"2023-09-30T22:17:22.026677+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027765+0000","last_change":"2023-09-30T22:16:25.781178+0000","last_active":"2023-09-30T22:17:22.027765+0000","last_peered":"2023-09-30T22:17:22.027765+0000","last_clean":"2023-09-30T22:17:22.027765+0000","last_became_active":"2023-09-30T22:16:25.780121+0000","last_became_peered":"2023-09-30T22:16:25.780121+0000","last_unstale":"2023-09-30T22:17:22.027765+0000","last_undegraded":"2023-09-30T22:17:22.027765+0000","last_fullsized":"2023-09-30T22:17:22.027765+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.818816+0000","last_change":"2023-09-30T22:17:22.029786+0000","last_active":"2023-09-30T22:18:37.818816+0000","last_peered":"2023-09-30T22:18:37.818816+0000","last_clean":"2023-09-30T22:18:37.818816+0000","last_became_active":"2023-09-30T22:17:22.028699+0000","last_became_peered":"2023-09-30T22:17:22.028699+0000","last_unstale":"2023-09-30T22:18:37.818816+0000","last_undegraded":"2023-09-30T22:18:37.818816+0000","last_fullsized":"2023-09-30T22:18:37.818816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.026747+0000","last_change":"2023-09-30T22:16:25.780328+0000","last_active":"2023-09-30T22:17:22.026747+0000","last_peered":"2023-09-30T22:17:22.026747+0000","last_clean":"2023-09-30T22:17:22.026747+0000","last_became_active":"2023-09-30T22:16:25.780026+0000","last_became_peered":"2023-09-30T22:16:25.780026+0000","last_unstale":"2023-09-30T22:17:22.026747+0000","last_undegraded":"2023-09-30T22:17:22.026747+0000","last_fullsized":"2023-09-30T22:17:22.026747+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.028376+0000","last_change":"2023-09-30T22:16:29.444398+0000","last_active":"2023-09-30T22:17:22.028376+0000","last_peered":"2023-09-30T22:17:22.028376+0000","last_clean":"2023-09-30T22:17:22.028376+0000","last_became_active":"2023-09-30T22:16:29.444126+0000","last_became_peered":"2023-09-30T22:16:29.444126+0000","last_unstale":"2023-09-30T22:17:22.028376+0000","last_undegraded":"2023-09-30T22:17:22.028376+0000","last_fullsized":"2023-09-30T22:17:22.028376+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.818950+0000","last_change":"2023-09-30T22:16:29.820636+0000","last_active":"2023-09-30T22:18:37.818950+0000","last_peered":"2023-09-30T22:18:37.818950+0000","last_clean":"2023-09-30T22:18:37.818950+0000","last_became_active":"2023-09-30T22:16:29.820372+0000","last_became_peered":"2023-09-30T22:16:29.820372+0000","last_unstale":"2023-09-30T22:18:37.818950+0000","last_undegraded":"2023-09-30T22:18:37.818950+0000","last_fullsized":"2023-09-30T22:18:37.818950+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024974+0000","last_change":"2023-09-30T22:16:29.452715+0000","last_active":"2023-09-30T22:17:22.024974+0000","last_peered":"2023-09-30T22:17:22.024974+0000","last_clean":"2023-09-30T22:17:22.024974+0000","last_became_active":"2023-09-30T22:16:29.452405+0000","last_became_peered":"2023-09-30T22:16:29.452405+0000","last_unstale":"2023-09-30T22:17:22.024974+0000","last_undegraded":"2023-09-30T22:17:22.024974+0000","last_fullsized":"2023-09-30T22:17:22.024974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.819437+0000","last_change":"2023-09-30T22:16:29.827280+0000","last_active":"2023-09-30T22:18:37.819437+0000","last_peered":"2023-09-30T22:18:37.819437+0000","last_clean":"2023-09-30T22:18:37.819437+0000","last_became_active":"2023-09-30T22:16:29.827006+0000","last_became_peered":"2023-09-30T22:16:29.827006+0000","last_unstale":"2023-09-30T22:18:37.819437+0000","last_undegraded":"2023-09-30T22:18:37.819437+0000","last_fullsized":"2023-09-30T22:18:37.819437+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027303+0000","last_change":"2023-09-30T22:16:29.441940+0000","last_active":"2023-09-30T22:17:22.027303+0000","last_peered":"2023-09-30T22:17:22.027303+0000","last_clean":"2023-09-30T22:17:22.027303+0000","last_became_active":"2023-09-30T22:16:29.441296+0000","last_became_peered":"2023-09-30T22:16:29.441296+0000","last_unstale":"2023-09-30T22:17:22.027303+0000","last_undegraded":"2023-09-30T22:17:22.027303+0000","last_fullsized":"2023-09-30T22:17:22.027303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.819192+0000","last_change":"2023-09-30T22:16:29.824467+0000","last_active":"2023-09-30T22:18:37.819192+0000","last_peered":"2023-09-30T22:18:37.819192+0000","last_clean":"2023-09-30T22:18:37.819192+0000","last_became_active":"2023-09-30T22:16:29.824206+0000","last_became_peered":"2023-09-30T22:16:29.824206+0000","last_unstale":"2023-09-30T22:18:37.819192+0000","last_undegraded":"2023-09-30T22:18:37.819192+0000","last_fullsized":"2023-09-30T22:18:37.819192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025601+0000","last_change":"2023-09-30T22:16:29.446705+0000","last_active":"2023-09-30T22:17:22.025601+0000","last_peered":"2023-09-30T22:17:22.025601+0000","last_clean":"2023-09-30T22:17:22.025601+0000","last_became_active":"2023-09-30T22:16:29.446173+0000","last_became_peered":"2023-09-30T22:16:29.446173+0000","last_unstale":"2023-09-30T22:17:22.025601+0000","last_undegraded":"2023-09-30T22:17:22.025601+0000","last_fullsized":"2023-09-30T22:17:22.025601+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.819103+0000","last_change":"2023-09-30T22:16:29.832880+0000","last_active":"2023-09-30T22:18:37.819103+0000","last_peered":"2023-09-30T22:18:37.819103+0000","last_clean":"2023-09-30T22:18:37.819103+0000","last_became_active":"2023-09-30T22:16:29.832321+0000","last_became_peered":"2023-09-30T22:16:29.832321+0000","last_unstale":"2023-09-30T22:18:37.819103+0000","last_undegraded":"2023-09-30T22:18:37.819103+0000","last_fullsized":"2023-09-30T22:18:37.819103+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.026287+0000","last_change":"2023-09-30T22:16:29.451645+0000","last_active":"2023-09-30T22:17:22.026287+0000","last_peered":"2023-09-30T22:17:22.026287+0000","last_clean":"2023-09-30T22:17:22.026287+0000","last_became_active":"2023-09-30T22:16:29.451283+0000","last_became_peered":"2023-09-30T22:16:29.451283+0000","last_unstale":"2023-09-30T22:17:22.026287+0000","last_undegraded":"2023-09-30T22:17:22.026287+0000","last_fullsized":"2023-09-30T22:17:22.026287+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024126+0000","last_change":"2023-09-30T22:16:29.825999+0000","last_active":"2023-09-30T22:17:22.024126+0000","last_peered":"2023-09-30T22:17:22.024126+0000","last_clean":"2023-09-30T22:17:22.024126+0000","last_became_active":"2023-09-30T22:16:29.825211+0000","last_became_peered":"2023-09-30T22:16:29.825211+0000","last_unstale":"2023-09-30T22:17:22.024126+0000","last_undegraded":"2023-09-30T22:17:22.024126+0000","last_fullsized":"2023-09-30T22:17:22.024126+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.028316+0000","last_change":"2023-09-30T22:16:29.443167+0000","last_active":"2023-09-30T22:17:22.028316+0000","last_peered":"2023-09-30T22:17:22.028316+0000","last_clean":"2023-09-30T22:17:22.028316+0000","last_became_active":"2023-09-30T22:16:29.442895+0000","last_became_peered":"2023-09-30T22:16:29.442895+0000","last_unstale":"2023-09-30T22:17:22.028316+0000","last_undegraded":"2023-09-30T22:17:22.028316+0000","last_fullsized":"2023-09-30T22:17:22.028316+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.818883+0000","last_change":"2023-09-30T22:16:29.827232+0000","last_active":"2023-09-30T22:18:37.818883+0000","last_peered":"2023-09-30T22:18:37.818883+0000","last_clean":"2023-09-30T22:18:37.818883+0000","last_became_active":"2023-09-30T22:16:29.826971+0000","last_became_peered":"2023-09-30T22:16:29.826971+0000","last_unstale":"2023-09-30T22:18:37.818883+0000","last_undegraded":"2023-09-30T22:18:37.818883+0000","last_fullsized":"2023-09-30T22:18:37.818883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024917+0000","last_change":"2023-09-30T22:16:29.833273+0000","last_active":"2023-09-30T22:17:22.024917+0000","last_peered":"2023-09-30T22:17:22.024917+0000","last_clean":"2023-09-30T22:17:22.024917+0000","last_became_active":"2023-09-30T22:16:29.832627+0000","last_became_peered":"2023-09-30T22:16:29.832627+0000","last_unstale":"2023-09-30T22:17:22.024917+0000","last_undegraded":"2023-09-30T22:17:22.024917+0000","last_fullsized":"2023-09-30T22:17:22.024917+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024246+0000","last_change":"2023-09-30T22:16:29.834527+0000","last_active":"2023-09-30T22:17:22.024246+0000","last_peered":"2023-09-30T22:17:22.024246+0000","last_clean":"2023-09-30T22:17:22.024246+0000","last_became_active":"2023-09-30T22:16:29.830063+0000","last_became_peered":"2023-09-30T22:16:29.830063+0000","last_unstale":"2023-09-30T22:17:22.024246+0000","last_undegraded":"2023-09-30T22:17:22.024246+0000","last_fullsized":"2023-09-30T22:17:22.024246+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025280+0000","last_change":"2023-09-30T22:16:29.821730+0000","last_active":"2023-09-30T22:17:22.025280+0000","last_peered":"2023-09-30T22:17:22.025280+0000","last_clean":"2023-09-30T22:17:22.025280+0000","last_became_active":"2023-09-30T22:16:29.821455+0000","last_became_peered":"2023-09-30T22:16:29.821455+0000","last_unstale":"2023-09-30T22:17:22.025280+0000","last_undegraded":"2023-09-30T22:17:22.025280+0000","last_fullsized":"2023-09-30T22:17:22.025280+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024452+0000","last_change":"2023-09-30T22:16:29.830760+0000","last_active":"2023-09-30T22:17:22.024452+0000","last_peered":"2023-09-30T22:17:22.024452+0000","last_clean":"2023-09-30T22:17:22.024452+0000","last_became_active":"2023-09-30T22:16:29.830307+0000","last_became_peered":"2023-09-30T22:16:29.830307+0000","last_unstale":"2023-09-30T22:17:22.024452+0000","last_undegraded":"2023-09-30T22:17:22.024452+0000","last_fullsized":"2023-09-30T22:17:22.024452+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027358+0000","last_change":"2023-09-30T22:16:29.835169+0000","last_active":"2023-09-30T22:17:22.027358+0000","last_peered":"2023-09-30T22:17:22.027358+0000","last_clean":"2023-09-30T22:17:22.027358+0000","last_became_active":"2023-09-30T22:16:29.832849+0000","last_became_peered":"2023-09-30T22:16:29.832849+0000","last_unstale":"2023-09-30T22:17:22.027358+0000","last_undegraded":"2023-09-30T22:17:22.027358+0000","last_fullsized":"2023-09-30T22:17:22.027358+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705693,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297284,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074556,"statfs":{"total":96636764160,"available":96332345344,"internally_reserved":0,"allocated":192512,"data_stored":64656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.28100000000000003,"5min":0.28799999999999998,"15min":0.28899999999999998},"min":{"1min":0.21099999999999999,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.375,"5min":0.38300000000000001,"15min":0.38300000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.28799999999999998,"5min":0.29999999999999999,"15min":0.30199999999999999},"min":{"1min":0.23899999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.41299999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.33900000000000002}]},{"osd":1,"last update":"Sat Sep 30 22:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.308,"15min":0.311},"min":{"1min":0.23599999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.40200000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.311,"5min":0.317,"15min":0.318},"min":{"1min":0.251,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.39200000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.38100000000000001}]},{"osd":2,"last update":"Sat Sep 30 22:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.436,"5min":0.498,"15min":0.498},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.28399999999999997,"5min":0.309,"15min":0.313},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.42299999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.34899999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705693,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":64462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.20200000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.29099999999999998,"15min":0.28899999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.34499999999999997}]},{"osd":1,"last update":"Sat Sep 30 22:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.29199999999999998,"5min":0.29799999999999999,"15min":0.29899999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.308,"15min":0.30599999999999999},"min":{"1min":0.253,"5min":0.215,"15min":0.215},"max":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.29699999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.318,"15min":0.318},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"last":0.318},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34499999999999997,"15min":0.34599999999999997},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.32500000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705693,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297268,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074572,"statfs":{"total":96636764160,"available":96332361728,"internally_reserved":0,"allocated":176128,"data_stored":56418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.26500000000000001,"5min":0.27600000000000002,"15min":0.27800000000000002},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.38700000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.26500000000000001,"5min":0.28100000000000003,"15min":0.28399999999999997},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.311,"5min":0.41399999999999998,"15min":0.41399999999999998},"last":0.247}]},{"osd":2,"last update":"Sat Sep 30 22:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.31900000000000001,"15min":0.32300000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.34999999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.32600000000000001,"15min":0.33000000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.39300000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.32900000000000001}]},{"osd":3,"last update":"Sat Sep 30 22:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.316,"15min":0.318},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.374,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.27700000000000002,"5min":0.30499999999999999,"15min":0.31},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.32000000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"last":0.312}]}]},{"osd":1,"up_from":9,"seq":38654705693,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":61545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.34499999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.32900000000000001,"15min":0.33000000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.42299999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.36899999999999999}]},{"osd":2,"last update":"Sat Sep 30 22:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.28100000000000003,"5min":0.29599999999999999,"15min":0.29799999999999999},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.375,"5min":0.45300000000000001,"15min":0.45300000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.29199999999999998,"5min":0.307,"15min":0.309},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.39800000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.44}]},{"osd":3,"last update":"Sat Sep 30 22:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.28799999999999998,"5min":0.29599999999999999,"15min":0.29699999999999999},"min":{"1min":0.252,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.375,"5min":0.45800000000000002,"15min":0.45800000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.312,"5min":0.32000000000000001,"15min":0.32100000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.41799999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.63800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:18:40.409 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:18:40.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.564+0000 7f1660afe700 1 Processor -- start 2023-09-30T22:18:40.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.564+0000 7f1660afe700 1 -- start start 2023-09-30T22:18:40.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.564+0000 7f1660afe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f165c06a770 0x7f165c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:40.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.564+0000 7f1660afe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f165c06b080 0x7f165c1317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:40.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.564+0000 7f1660afe700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f165c09da80 con 0x7f165c131cf0 2023-09-30T22:18:40.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.564+0000 7f1660afe700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165c09dce0 con 0x7f165c06a770 2023-09-30T22:18:40.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.564+0000 7f1660afe700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f165c09eb20 con 0x7f165c06b080 2023-09-30T22:18:40.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.564+0000 7f165a59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f165c06a770 0x7f165c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:40.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.564+0000 7f1659d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f165c06b080 0x7f165c1317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:40.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.564+0000 7f165ad9d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f165c131cf0 0x7f165c138c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:42700/0 (socket says 172.21.15.156:42700) 2023-09-30T22:18:40.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.564+0000 7f165ad9d700 1 -- 172.21.15.156:0/1435711371 learned_addr learned my addr 172.21.15.156:0/1435711371 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:18:40.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.565+0000 7f165a59c700 1 -- 172.21.15.156:0/1435711371 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f165c06b080 msgr2=0x7f165c1317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:40.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.565+0000 7f165959a700 1 -- 172.21.15.156:0/1435711371 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1132036047 0 0) 0x7f165c09da80 con 0x7f165c131cf0 2023-09-30T22:18:40.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.565+0000 7f165a59c700 1 --2- 172.21.15.156:0/1435711371 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f165c06b080 0x7f165c1317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:40.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.565+0000 7f165a59c700 1 -- 172.21.15.156:0/1435711371 >> v1:172.21.15.156:6789/0 conn(0x7f165c131cf0 legacy=0x7f165c138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:40.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.565+0000 7f165a59c700 1 -- 172.21.15.156:0/1435711371 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165c09d860 con 0x7f165c06a770 2023-09-30T22:18:40.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.565+0000 7f1659d9b700 1 --2- 172.21.15.156:0/1435711371 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f165c06b080 0x7f165c1317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:40.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.565+0000 7f165a59c700 1 --2- 172.21.15.156:0/1435711371 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f165c06a770 0x7f165c06ab40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f164c0098a0 tx=0x7f164c009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3db89f51511a99f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:40.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.565+0000 7f165959a700 1 -- 172.21.15.156:0/1435711371 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c011830 con 0x7f165c06a770 2023-09-30T22:18:40.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.565+0000 7f165959a700 1 -- 172.21.15.156:0/1435711371 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164c011990 con 0x7f165c06a770 2023-09-30T22:18:40.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.565+0000 7f165959a700 1 -- 172.21.15.156:0/1435711371 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c011d20 con 0x7f165c06a770 2023-09-30T22:18:40.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.566+0000 7f1660afe700 1 -- 172.21.15.156:0/1435711371 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f165c06a770 msgr2=0x7f165c06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:40.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.566+0000 7f1660afe700 1 --2- 172.21.15.156:0/1435711371 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f165c06a770 0x7f165c06ab40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f164c0098a0 tx=0x7f164c009bb0 comp rx=0 tx=0).stop 2023-09-30T22:18:40.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.566+0000 7f1660afe700 1 -- 172.21.15.156:0/1435711371 shutdown_connections 2023-09-30T22:18:40.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.566+0000 7f1660afe700 1 --2- 172.21.15.156:0/1435711371 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f165c06a770 0x7f165c06ab40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:40.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.566+0000 7f1660afe700 1 --2- 172.21.15.156:0/1435711371 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f165c06b080 0x7f165c1317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:40.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.566+0000 7f1660afe700 1 -- 172.21.15.156:0/1435711371 >> 172.21.15.156:0/1435711371 conn(0x7f165c099c40 msgr2=0x7f165c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:40.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.566+0000 7f1660afe700 1 -- 172.21.15.156:0/1435711371 shutdown_connections 2023-09-30T22:18:40.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.566+0000 7f1660afe700 1 -- 172.21.15.156:0/1435711371 wait complete. 2023-09-30T22:18:40.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.567+0000 7f1660afe700 1 Processor -- start 2023-09-30T22:18:40.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.567+0000 7f1660afe700 1 -- start start 2023-09-30T22:18:40.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.567+0000 7f1660afe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f165c06a770 0x7f165c1c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:40.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.567+0000 7f1660afe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f165c06b080 0x7f165c1c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:40.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.567+0000 7f1660afe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f165c131cf0 0x7f165c1c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:40.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.567+0000 7f1660afe700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165c131130 con 0x7f165c131cf0 2023-09-30T22:18:40.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.567+0000 7f1660afe700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165c11e530 con 0x7f165c06b080 2023-09-30T22:18:40.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.567+0000 7f1660afe700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f165c0a0630 con 0x7f165c06a770 2023-09-30T22:18:40.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.567+0000 7f165ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f165c131cf0 0x7f165c1c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:40.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.567+0000 7f1659d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f165c06b080 0x7f165c1c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:40.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.567+0000 7f165ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f165c131cf0 0x7f165c1c6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39816/0 (socket says 172.21.15.156:39816) 2023-09-30T22:18:40.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.567+0000 7f1659d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f165c06b080 0x7f165c1c63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:58228/0 (socket says 172.21.15.156:58228) 2023-09-30T22:18:40.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.567+0000 7f165ad9d700 1 -- 172.21.15.156:0/1662776470 learned_addr learned my addr 172.21.15.156:0/1662776470 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:40.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.567+0000 7f165a59c700 1 --2- 172.21.15.156:0/1662776470 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f165c06a770 0x7f165c1c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:40.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.568+0000 7f165ad9d700 1 -- 172.21.15.156:0/1662776470 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f165c06a770 msgr2=0x7f165c1c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:40.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.568+0000 7f165ad9d700 1 --2- 172.21.15.156:0/1662776470 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f165c06a770 0x7f165c1c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:40.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.568+0000 7f165ad9d700 1 -- 172.21.15.156:0/1662776470 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f165c06b080 msgr2=0x7f165c1c63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:40.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.568+0000 7f165ad9d700 1 --2- 172.21.15.156:0/1662776470 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f165c06b080 0x7f165c1c63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:40.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.568+0000 7f165ad9d700 1 -- 172.21.15.156:0/1662776470 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16500094a0 con 0x7f165c131cf0 2023-09-30T22:18:40.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.568+0000 7f1659d9b700 1 --2- 172.21.15.156:0/1662776470 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f165c06b080 0x7f165c1c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:40.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.568+0000 7f165ad9d700 1 --2- 172.21.15.156:0/1662776470 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f165c131cf0 0x7f165c1c6900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f165400cc70 tx=0x7f165400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:40.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.568+0000 7f164affd700 1 -- 172.21.15.156:0/1662776470 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165400aac0 con 0x7f165c131cf0 2023-09-30T22:18:40.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.568+0000 7f164affd700 1 -- 172.21.15.156:0/1662776470 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165400ac40 con 0x7f165c131cf0 2023-09-30T22:18:40.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.568+0000 7f1660afe700 1 -- 172.21.15.156:0/1662776470 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164c0094a0 con 0x7f165c131cf0 2023-09-30T22:18:40.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.568+0000 7f164affd700 1 -- 172.21.15.156:0/1662776470 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16540070d0 con 0x7f165c131cf0 2023-09-30T22:18:40.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.568+0000 7f1660afe700 1 -- 172.21.15.156:0/1662776470 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f165c11eba0 con 0x7f165c131cf0 2023-09-30T22:18:40.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.569+0000 7f164affd700 1 -- 172.21.15.156:0/1662776470 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f1654007250 con 0x7f165c131cf0 2023-09-30T22:18:40.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.569+0000 7f164affd700 1 -- 172.21.15.156:0/1662776470 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f165403f530 con 0x7f165c131cf0 2023-09-30T22:18:40.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.569+0000 7f1660afe700 1 -- 172.21.15.156:0/1662776470 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f165c11fc80 con 0x7f165c131cf0 2023-09-30T22:18:40.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.574+0000 7f164affd700 1 -- 172.21.15.156:0/1662776470 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f165c11fc80 con 0x7f165c131cf0 2023-09-30T22:18:40.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.755+0000 7f1660afe700 1 -- 172.21.15.156:0/1662776470 --> v1:172.21.15.156:6816/126965 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f165c09d330 con 0x7f163c02f240 2023-09-30T22:18:40.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.762+0000 7f164affd700 1 -- 172.21.15.156:0/1662776470 <== mgr.14098 v1:172.21.15.156:6816/126965 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270511 (unknown 2965378022 0 1677684060) 0x7f164c011630 con 0x7f163c02f240 2023-09-30T22:18:40.765 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:18:40.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.765+0000 7f1660afe700 1 -- 172.21.15.156:0/1662776470 >> v1:172.21.15.156:6816/126965 conn(0x7f163c02f240 legacy=0x7f163c0316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:40.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.765+0000 7f1660afe700 1 -- 172.21.15.156:0/1662776470 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f165c131cf0 msgr2=0x7f165c1c6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:40.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.765+0000 7f1660afe700 1 --2- 172.21.15.156:0/1662776470 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f165c131cf0 0x7f165c1c6900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f165400cc70 tx=0x7f165400cf80 comp rx=0 tx=0).stop 2023-09-30T22:18:40.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.765+0000 7f1660afe700 1 -- 172.21.15.156:0/1662776470 shutdown_connections 2023-09-30T22:18:40.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.765+0000 7f1660afe700 1 --2- 172.21.15.156:0/1662776470 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f165c131cf0 0x7f165c1c6900 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:40.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.765+0000 7f1660afe700 1 --2- 172.21.15.156:0/1662776470 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f165c06a770 0x7f165c1c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:40.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.765+0000 7f1660afe700 1 --2- 172.21.15.156:0/1662776470 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f165c06b080 0x7f165c1c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:40.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.765+0000 7f1660afe700 1 -- 172.21.15.156:0/1662776470 >> 172.21.15.156:0/1662776470 conn(0x7f165c099c40 msgr2=0x7f165c1b99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:40.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.765+0000 7f1660afe700 1 -- 172.21.15.156:0/1662776470 shutdown_connections 2023-09-30T22:18:40.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.765+0000 7f1660afe700 1 -- 172.21.15.156:0/1662776470 wait complete. 2023-09-30T22:18:40.768 INFO:teuthology.orchestra.run.smithi156.stderr:dumped all 2023-09-30T22:18:40.778 INFO:teuthology.orchestra.run.smithi156.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2023-09-30T22:18:39.778477+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189096,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298264,"statfs":{"total":386547056640,"available":385329422336,"internally_reserved":0,"allocated":729088,"data_stored":247081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.999368"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.818760+0000","last_change":"2023-09-30T22:16:29.812173+0000","last_active":"2023-09-30T22:18:37.818760+0000","last_peered":"2023-09-30T22:18:37.818760+0000","last_clean":"2023-09-30T22:18:37.818760+0000","last_became_active":"2023-09-30T22:16:29.811948+0000","last_became_peered":"2023-09-30T22:16:29.811948+0000","last_unstale":"2023-09-30T22:18:37.818760+0000","last_undegraded":"2023-09-30T22:18:37.818760+0000","last_fullsized":"2023-09-30T22:18:37.818760+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.819492+0000","last_change":"2023-09-30T22:16:29.827324+0000","last_active":"2023-09-30T22:18:37.819492+0000","last_peered":"2023-09-30T22:18:37.819492+0000","last_clean":"2023-09-30T22:18:37.819492+0000","last_became_active":"2023-09-30T22:16:29.826847+0000","last_became_peered":"2023-09-30T22:16:29.826847+0000","last_unstale":"2023-09-30T22:18:37.819492+0000","last_undegraded":"2023-09-30T22:18:37.819492+0000","last_fullsized":"2023-09-30T22:18:37.819492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.028037+0000","last_change":"2023-09-30T22:16:29.825941+0000","last_active":"2023-09-30T22:17:22.028037+0000","last_peered":"2023-09-30T22:17:22.028037+0000","last_clean":"2023-09-30T22:17:22.028037+0000","last_became_active":"2023-09-30T22:16:29.825655+0000","last_became_peered":"2023-09-30T22:16:29.825655+0000","last_unstale":"2023-09-30T22:17:22.028037+0000","last_undegraded":"2023-09-30T22:17:22.028037+0000","last_fullsized":"2023-09-30T22:17:22.028037+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.026216+0000","last_change":"2023-09-30T22:16:29.822545+0000","last_active":"2023-09-30T22:17:22.026216+0000","last_peered":"2023-09-30T22:17:22.026216+0000","last_clean":"2023-09-30T22:17:22.026216+0000","last_became_active":"2023-09-30T22:16:29.822264+0000","last_became_peered":"2023-09-30T22:16:29.822264+0000","last_unstale":"2023-09-30T22:17:22.026216+0000","last_undegraded":"2023-09-30T22:17:22.026216+0000","last_fullsized":"2023-09-30T22:17:22.026216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.032606+0000","last_change":"2023-09-30T22:17:22.029358+0000","last_active":"2023-09-30T22:17:22.032606+0000","last_peered":"2023-09-30T22:17:22.032606+0000","last_clean":"2023-09-30T22:17:22.032606+0000","last_became_active":"2023-09-30T22:17:22.029070+0000","last_became_peered":"2023-09-30T22:17:22.029070+0000","last_unstale":"2023-09-30T22:17:22.032606+0000","last_undegraded":"2023-09-30T22:17:22.032606+0000","last_fullsized":"2023-09-30T22:17:22.032606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025191+0000","last_change":"2023-09-30T22:16:29.820688+0000","last_active":"2023-09-30T22:17:22.025191+0000","last_peered":"2023-09-30T22:17:22.025191+0000","last_clean":"2023-09-30T22:17:22.025191+0000","last_became_active":"2023-09-30T22:16:29.820480+0000","last_became_peered":"2023-09-30T22:16:29.820480+0000","last_unstale":"2023-09-30T22:17:22.025191+0000","last_undegraded":"2023-09-30T22:17:22.025191+0000","last_fullsized":"2023-09-30T22:17:22.025191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.023822+0000","last_change":"2023-09-30T22:16:29.834595+0000","last_active":"2023-09-30T22:17:22.023822+0000","last_peered":"2023-09-30T22:17:22.023822+0000","last_clean":"2023-09-30T22:17:22.023822+0000","last_became_active":"2023-09-30T22:16:29.834156+0000","last_became_peered":"2023-09-30T22:16:29.834156+0000","last_unstale":"2023-09-30T22:17:22.023822+0000","last_undegraded":"2023-09-30T22:17:22.023822+0000","last_fullsized":"2023-09-30T22:17:22.023822+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024290+0000","last_change":"2023-09-30T22:16:29.822064+0000","last_active":"2023-09-30T22:17:22.024290+0000","last_peered":"2023-09-30T22:17:22.024290+0000","last_clean":"2023-09-30T22:17:22.024290+0000","last_became_active":"2023-09-30T22:16:29.821816+0000","last_became_peered":"2023-09-30T22:16:29.821816+0000","last_unstale":"2023-09-30T22:17:22.024290+0000","last_undegraded":"2023-09-30T22:17:22.024290+0000","last_fullsized":"2023-09-30T22:17:22.024290+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.028402+0000","last_change":"2023-09-30T22:16:29.828044+0000","last_active":"2023-09-30T22:17:22.028402+0000","last_peered":"2023-09-30T22:17:22.028402+0000","last_clean":"2023-09-30T22:17:22.028402+0000","last_became_active":"2023-09-30T22:16:29.827740+0000","last_became_peered":"2023-09-30T22:16:29.827740+0000","last_unstale":"2023-09-30T22:17:22.028402+0000","last_undegraded":"2023-09-30T22:17:22.028402+0000","last_fullsized":"2023-09-30T22:17:22.028402+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027827+0000","last_change":"2023-09-30T22:16:29.824597+0000","last_active":"2023-09-30T22:17:22.027827+0000","last_peered":"2023-09-30T22:17:22.027827+0000","last_clean":"2023-09-30T22:17:22.027827+0000","last_became_active":"2023-09-30T22:16:29.824344+0000","last_became_peered":"2023-09-30T22:16:29.824344+0000","last_unstale":"2023-09-30T22:17:22.027827+0000","last_undegraded":"2023-09-30T22:17:22.027827+0000","last_fullsized":"2023-09-30T22:17:22.027827+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027417+0000","last_change":"2023-09-30T22:16:29.830182+0000","last_active":"2023-09-30T22:17:22.027417+0000","last_peered":"2023-09-30T22:17:22.027417+0000","last_clean":"2023-09-30T22:17:22.027417+0000","last_became_active":"2023-09-30T22:16:29.828962+0000","last_became_peered":"2023-09-30T22:16:29.828962+0000","last_unstale":"2023-09-30T22:17:22.027417+0000","last_undegraded":"2023-09-30T22:17:22.027417+0000","last_fullsized":"2023-09-30T22:17:22.027417+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.819345+0000","last_change":"2023-09-30T22:16:29.833916+0000","last_active":"2023-09-30T22:18:37.819345+0000","last_peered":"2023-09-30T22:18:37.819345+0000","last_clean":"2023-09-30T22:18:37.819345+0000","last_became_active":"2023-09-30T22:16:29.833664+0000","last_became_peered":"2023-09-30T22:16:29.833664+0000","last_unstale":"2023-09-30T22:18:37.819345+0000","last_undegraded":"2023-09-30T22:18:37.819345+0000","last_fullsized":"2023-09-30T22:18:37.819345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.819174+0000","last_change":"2023-09-30T22:16:29.823993+0000","last_active":"2023-09-30T22:18:37.819174+0000","last_peered":"2023-09-30T22:18:37.819174+0000","last_clean":"2023-09-30T22:18:37.819174+0000","last_became_active":"2023-09-30T22:16:29.823725+0000","last_became_peered":"2023-09-30T22:16:29.823725+0000","last_unstale":"2023-09-30T22:18:37.819174+0000","last_undegraded":"2023-09-30T22:18:37.819174+0000","last_fullsized":"2023-09-30T22:18:37.819174+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024773+0000","last_change":"2023-09-30T22:16:29.832518+0000","last_active":"2023-09-30T22:17:22.024773+0000","last_peered":"2023-09-30T22:17:22.024773+0000","last_clean":"2023-09-30T22:17:22.024773+0000","last_became_active":"2023-09-30T22:16:29.832228+0000","last_became_peered":"2023-09-30T22:16:29.832228+0000","last_unstale":"2023-09-30T22:17:22.024773+0000","last_undegraded":"2023-09-30T22:17:22.024773+0000","last_fullsized":"2023-09-30T22:17:22.024773+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025614+0000","last_change":"2023-09-30T22:16:29.814680+0000","last_active":"2023-09-30T22:17:22.025614+0000","last_peered":"2023-09-30T22:17:22.025614+0000","last_clean":"2023-09-30T22:17:22.025614+0000","last_became_active":"2023-09-30T22:16:29.814427+0000","last_became_peered":"2023-09-30T22:16:29.814427+0000","last_unstale":"2023-09-30T22:17:22.025614+0000","last_undegraded":"2023-09-30T22:17:22.025614+0000","last_fullsized":"2023-09-30T22:17:22.025614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.022449+0000","last_change":"2023-09-30T22:16:29.833416+0000","last_active":"2023-09-30T22:17:22.022449+0000","last_peered":"2023-09-30T22:17:22.022449+0000","last_clean":"2023-09-30T22:17:22.022449+0000","last_became_active":"2023-09-30T22:16:29.833121+0000","last_became_peered":"2023-09-30T22:16:29.833121+0000","last_unstale":"2023-09-30T22:17:22.022449+0000","last_undegraded":"2023-09-30T22:17:22.022449+0000","last_fullsized":"2023-09-30T22:17:22.022449+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.028379+0000","last_change":"2023-09-30T22:16:29.823463+0000","last_active":"2023-09-30T22:17:22.028379+0000","last_peered":"2023-09-30T22:17:22.028379+0000","last_clean":"2023-09-30T22:17:22.028379+0000","last_became_active":"2023-09-30T22:16:29.823207+0000","last_became_peered":"2023-09-30T22:16:29.823207+0000","last_unstale":"2023-09-30T22:17:22.028379+0000","last_undegraded":"2023-09-30T22:17:22.028379+0000","last_fullsized":"2023-09-30T22:17:22.028379+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.028369+0000","last_change":"2023-09-30T22:16:29.816722+0000","last_active":"2023-09-30T22:17:22.028369+0000","last_peered":"2023-09-30T22:17:22.028369+0000","last_clean":"2023-09-30T22:17:22.028369+0000","last_became_active":"2023-09-30T22:16:29.816461+0000","last_became_peered":"2023-09-30T22:16:29.816461+0000","last_unstale":"2023-09-30T22:17:22.028369+0000","last_undegraded":"2023-09-30T22:17:22.028369+0000","last_fullsized":"2023-09-30T22:17:22.028369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.819454+0000","last_change":"2023-09-30T22:16:29.833443+0000","last_active":"2023-09-30T22:18:37.819454+0000","last_peered":"2023-09-30T22:18:37.819454+0000","last_clean":"2023-09-30T22:18:37.819454+0000","last_became_active":"2023-09-30T22:16:29.833187+0000","last_became_peered":"2023-09-30T22:16:29.833187+0000","last_unstale":"2023-09-30T22:18:37.819454+0000","last_undegraded":"2023-09-30T22:18:37.819454+0000","last_fullsized":"2023-09-30T22:18:37.819454+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027443+0000","last_change":"2023-09-30T22:16:29.828875+0000","last_active":"2023-09-30T22:17:22.027443+0000","last_peered":"2023-09-30T22:17:22.027443+0000","last_clean":"2023-09-30T22:17:22.027443+0000","last_became_active":"2023-09-30T22:16:29.828593+0000","last_became_peered":"2023-09-30T22:16:29.828593+0000","last_unstale":"2023-09-30T22:17:22.027443+0000","last_undegraded":"2023-09-30T22:17:22.027443+0000","last_fullsized":"2023-09-30T22:17:22.027443+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027086+0000","last_change":"2023-09-30T22:16:29.827607+0000","last_active":"2023-09-30T22:17:22.027086+0000","last_peered":"2023-09-30T22:17:22.027086+0000","last_clean":"2023-09-30T22:17:22.027086+0000","last_became_active":"2023-09-30T22:16:29.826392+0000","last_became_peered":"2023-09-30T22:16:29.826392+0000","last_unstale":"2023-09-30T22:17:22.027086+0000","last_undegraded":"2023-09-30T22:17:22.027086+0000","last_fullsized":"2023-09-30T22:17:22.027086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025201+0000","last_change":"2023-09-30T22:16:29.823191+0000","last_active":"2023-09-30T22:17:22.025201+0000","last_peered":"2023-09-30T22:17:22.025201+0000","last_clean":"2023-09-30T22:17:22.025201+0000","last_became_active":"2023-09-30T22:16:29.822796+0000","last_became_peered":"2023-09-30T22:16:29.822796+0000","last_unstale":"2023-09-30T22:17:22.025201+0000","last_undegraded":"2023-09-30T22:17:22.025201+0000","last_fullsized":"2023-09-30T22:17:22.025201+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.023751+0000","last_change":"2023-09-30T22:16:29.834377+0000","last_active":"2023-09-30T22:17:22.023751+0000","last_peered":"2023-09-30T22:17:22.023751+0000","last_clean":"2023-09-30T22:17:22.023751+0000","last_became_active":"2023-09-30T22:16:29.833873+0000","last_became_peered":"2023-09-30T22:16:29.833873+0000","last_unstale":"2023-09-30T22:17:22.023751+0000","last_undegraded":"2023-09-30T22:17:22.023751+0000","last_fullsized":"2023-09-30T22:17:22.023751+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024373+0000","last_change":"2023-09-30T22:16:29.821578+0000","last_active":"2023-09-30T22:17:22.024373+0000","last_peered":"2023-09-30T22:17:22.024373+0000","last_clean":"2023-09-30T22:17:22.024373+0000","last_became_active":"2023-09-30T22:16:29.818116+0000","last_became_peered":"2023-09-30T22:16:29.818116+0000","last_unstale":"2023-09-30T22:17:22.024373+0000","last_undegraded":"2023-09-30T22:17:22.024373+0000","last_fullsized":"2023-09-30T22:17:22.024373+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027535+0000","last_change":"2023-09-30T22:16:29.829048+0000","last_active":"2023-09-30T22:17:22.027535+0000","last_peered":"2023-09-30T22:17:22.027535+0000","last_clean":"2023-09-30T22:17:22.027535+0000","last_became_active":"2023-09-30T22:16:29.828174+0000","last_became_peered":"2023-09-30T22:16:29.828174+0000","last_unstale":"2023-09-30T22:17:22.027535+0000","last_undegraded":"2023-09-30T22:17:22.027535+0000","last_fullsized":"2023-09-30T22:17:22.027535+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027754+0000","last_change":"2023-09-30T22:16:29.834779+0000","last_active":"2023-09-30T22:17:22.027754+0000","last_peered":"2023-09-30T22:17:22.027754+0000","last_clean":"2023-09-30T22:17:22.027754+0000","last_became_active":"2023-09-30T22:16:29.833042+0000","last_became_peered":"2023-09-30T22:16:29.833042+0000","last_unstale":"2023-09-30T22:17:22.027754+0000","last_undegraded":"2023-09-30T22:17:22.027754+0000","last_fullsized":"2023-09-30T22:17:22.027754+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024034+0000","last_change":"2023-09-30T22:16:29.832499+0000","last_active":"2023-09-30T22:17:22.024034+0000","last_peered":"2023-09-30T22:17:22.024034+0000","last_clean":"2023-09-30T22:17:22.024034+0000","last_became_active":"2023-09-30T22:16:29.831898+0000","last_became_peered":"2023-09-30T22:16:29.831898+0000","last_unstale":"2023-09-30T22:17:22.024034+0000","last_undegraded":"2023-09-30T22:17:22.024034+0000","last_fullsized":"2023-09-30T22:17:22.024034+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024183+0000","last_change":"2023-09-30T22:16:29.448332+0000","last_active":"2023-09-30T22:17:22.024183+0000","last_peered":"2023-09-30T22:17:22.024183+0000","last_clean":"2023-09-30T22:17:22.024183+0000","last_became_active":"2023-09-30T22:16:29.448043+0000","last_became_peered":"2023-09-30T22:16:29.448043+0000","last_unstale":"2023-09-30T22:17:22.024183+0000","last_undegraded":"2023-09-30T22:17:22.024183+0000","last_fullsized":"2023-09-30T22:17:22.024183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.023734+0000","last_change":"2023-09-30T22:16:29.831419+0000","last_active":"2023-09-30T22:17:22.023734+0000","last_peered":"2023-09-30T22:17:22.023734+0000","last_clean":"2023-09-30T22:17:22.023734+0000","last_became_active":"2023-09-30T22:16:29.830841+0000","last_became_peered":"2023-09-30T22:16:29.830841+0000","last_unstale":"2023-09-30T22:17:22.023734+0000","last_undegraded":"2023-09-30T22:17:22.023734+0000","last_fullsized":"2023-09-30T22:17:22.023734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024625+0000","last_change":"2023-09-30T22:16:29.449809+0000","last_active":"2023-09-30T22:17:22.024625+0000","last_peered":"2023-09-30T22:17:22.024625+0000","last_clean":"2023-09-30T22:17:22.024625+0000","last_became_active":"2023-09-30T22:16:29.449538+0000","last_became_peered":"2023-09-30T22:16:29.449538+0000","last_unstale":"2023-09-30T22:17:22.024625+0000","last_undegraded":"2023-09-30T22:17:22.024625+0000","last_fullsized":"2023-09-30T22:17:22.024625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.028453+0000","last_change":"2023-09-30T22:16:29.822995+0000","last_active":"2023-09-30T22:17:22.028453+0000","last_peered":"2023-09-30T22:17:22.028453+0000","last_clean":"2023-09-30T22:17:22.028453+0000","last_became_active":"2023-09-30T22:16:29.822621+0000","last_became_peered":"2023-09-30T22:16:29.822621+0000","last_unstale":"2023-09-30T22:17:22.028453+0000","last_undegraded":"2023-09-30T22:17:22.028453+0000","last_fullsized":"2023-09-30T22:17:22.028453+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.022890+0000","last_change":"2023-09-30T22:16:29.452955+0000","last_active":"2023-09-30T22:17:22.022890+0000","last_peered":"2023-09-30T22:17:22.022890+0000","last_clean":"2023-09-30T22:17:22.022890+0000","last_became_active":"2023-09-30T22:16:29.449928+0000","last_became_peered":"2023-09-30T22:16:29.449928+0000","last_unstale":"2023-09-30T22:17:22.022890+0000","last_undegraded":"2023-09-30T22:17:22.022890+0000","last_fullsized":"2023-09-30T22:17:22.022890+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.026890+0000","last_change":"2023-09-30T22:16:29.831592+0000","last_active":"2023-09-30T22:17:22.026890+0000","last_peered":"2023-09-30T22:17:22.026890+0000","last_clean":"2023-09-30T22:17:22.026890+0000","last_became_active":"2023-09-30T22:16:29.831170+0000","last_became_peered":"2023-09-30T22:16:29.831170+0000","last_unstale":"2023-09-30T22:17:22.026890+0000","last_undegraded":"2023-09-30T22:17:22.026890+0000","last_fullsized":"2023-09-30T22:17:22.026890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.028306+0000","last_change":"2023-09-30T22:16:29.452637+0000","last_active":"2023-09-30T22:17:22.028306+0000","last_peered":"2023-09-30T22:17:22.028306+0000","last_clean":"2023-09-30T22:17:22.028306+0000","last_became_active":"2023-09-30T22:16:29.452263+0000","last_became_peered":"2023-09-30T22:16:29.452263+0000","last_unstale":"2023-09-30T22:17:22.028306+0000","last_undegraded":"2023-09-30T22:17:22.028306+0000","last_fullsized":"2023-09-30T22:17:22.028306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.032764+0000","last_change":"2023-09-30T22:17:22.031503+0000","last_active":"2023-09-30T22:17:22.032764+0000","last_peered":"2023-09-30T22:17:22.032764+0000","last_clean":"2023-09-30T22:17:22.032764+0000","last_became_active":"2023-09-30T22:17:22.031171+0000","last_became_peered":"2023-09-30T22:17:22.031171+0000","last_unstale":"2023-09-30T22:17:22.032764+0000","last_undegraded":"2023-09-30T22:17:22.032764+0000","last_fullsized":"2023-09-30T22:17:22.032764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.819337+0000","last_change":"2023-09-30T22:16:29.448611+0000","last_active":"2023-09-30T22:18:37.819337+0000","last_peered":"2023-09-30T22:18:37.819337+0000","last_clean":"2023-09-30T22:18:37.819337+0000","last_became_active":"2023-09-30T22:16:29.448289+0000","last_became_peered":"2023-09-30T22:16:29.448289+0000","last_unstale":"2023-09-30T22:18:37.819337+0000","last_undegraded":"2023-09-30T22:18:37.819337+0000","last_fullsized":"2023-09-30T22:18:37.819337+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024057+0000","last_change":"2023-09-30T22:16:29.836465+0000","last_active":"2023-09-30T22:17:22.024057+0000","last_peered":"2023-09-30T22:17:22.024057+0000","last_clean":"2023-09-30T22:17:22.024057+0000","last_became_active":"2023-09-30T22:16:29.834303+0000","last_became_peered":"2023-09-30T22:16:29.834303+0000","last_unstale":"2023-09-30T22:17:22.024057+0000","last_undegraded":"2023-09-30T22:17:22.024057+0000","last_fullsized":"2023-09-30T22:17:22.024057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027961+0000","last_change":"2023-09-30T22:16:29.448241+0000","last_active":"2023-09-30T22:17:22.027961+0000","last_peered":"2023-09-30T22:17:22.027961+0000","last_clean":"2023-09-30T22:17:22.027961+0000","last_became_active":"2023-09-30T22:16:29.447960+0000","last_became_peered":"2023-09-30T22:16:29.447960+0000","last_unstale":"2023-09-30T22:17:22.027961+0000","last_undegraded":"2023-09-30T22:17:22.027961+0000","last_fullsized":"2023-09-30T22:17:22.027961+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024695+0000","last_change":"2023-09-30T22:16:29.825275+0000","last_active":"2023-09-30T22:17:22.024695+0000","last_peered":"2023-09-30T22:17:22.024695+0000","last_clean":"2023-09-30T22:17:22.024695+0000","last_became_active":"2023-09-30T22:16:29.825002+0000","last_became_peered":"2023-09-30T22:16:29.825002+0000","last_unstale":"2023-09-30T22:17:22.024695+0000","last_undegraded":"2023-09-30T22:17:22.024695+0000","last_fullsized":"2023-09-30T22:17:22.024695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'12","reported_seq":26,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.840239+0000","last_change":"2023-09-30T22:16:29.449099+0000","last_active":"2023-09-30T22:18:37.840239+0000","last_peered":"2023-09-30T22:18:37.840239+0000","last_clean":"2023-09-30T22:18:37.840239+0000","last_became_active":"2023-09-30T22:16:29.448827+0000","last_became_peered":"2023-09-30T22:16:29.448827+0000","last_unstale":"2023-09-30T22:18:37.840239+0000","last_undegraded":"2023-09-30T22:18:37.840239+0000","last_fullsized":"2023-09-30T22:18:37.840239+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3563,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.818761+0000","last_change":"2023-09-30T22:16:29.811836+0000","last_active":"2023-09-30T22:18:37.818761+0000","last_peered":"2023-09-30T22:18:37.818761+0000","last_clean":"2023-09-30T22:18:37.818761+0000","last_became_active":"2023-09-30T22:16:29.811605+0000","last_became_peered":"2023-09-30T22:16:29.811605+0000","last_unstale":"2023-09-30T22:18:37.818761+0000","last_undegraded":"2023-09-30T22:18:37.818761+0000","last_fullsized":"2023-09-30T22:18:37.818761+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024375+0000","last_change":"2023-09-30T22:16:29.446893+0000","last_active":"2023-09-30T22:17:22.024375+0000","last_peered":"2023-09-30T22:17:22.024375+0000","last_clean":"2023-09-30T22:17:22.024375+0000","last_became_active":"2023-09-30T22:16:29.446554+0000","last_became_peered":"2023-09-30T22:16:29.446554+0000","last_unstale":"2023-09-30T22:17:22.024375+0000","last_undegraded":"2023-09-30T22:17:22.024375+0000","last_fullsized":"2023-09-30T22:17:22.024375+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024051+0000","last_change":"2023-09-30T22:16:29.830170+0000","last_active":"2023-09-30T22:17:22.024051+0000","last_peered":"2023-09-30T22:17:22.024051+0000","last_clean":"2023-09-30T22:17:22.024051+0000","last_became_active":"2023-09-30T22:16:29.829909+0000","last_became_peered":"2023-09-30T22:16:29.829909+0000","last_unstale":"2023-09-30T22:17:22.024051+0000","last_undegraded":"2023-09-30T22:17:22.024051+0000","last_fullsized":"2023-09-30T22:17:22.024051+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025238+0000","last_change":"2023-09-30T22:16:29.453090+0000","last_active":"2023-09-30T22:17:22.025238+0000","last_peered":"2023-09-30T22:17:22.025238+0000","last_clean":"2023-09-30T22:17:22.025238+0000","last_became_active":"2023-09-30T22:16:29.452814+0000","last_became_peered":"2023-09-30T22:16:29.452814+0000","last_unstale":"2023-09-30T22:17:22.025238+0000","last_undegraded":"2023-09-30T22:17:22.025238+0000","last_fullsized":"2023-09-30T22:17:22.025238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025838+0000","last_change":"2023-09-30T22:16:29.832660+0000","last_active":"2023-09-30T22:17:22.025838+0000","last_peered":"2023-09-30T22:17:22.025838+0000","last_clean":"2023-09-30T22:17:22.025838+0000","last_became_active":"2023-09-30T22:16:29.832233+0000","last_became_peered":"2023-09-30T22:16:29.832233+0000","last_unstale":"2023-09-30T22:17:22.025838+0000","last_undegraded":"2023-09-30T22:17:22.025838+0000","last_fullsized":"2023-09-30T22:17:22.025838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.023976+0000","last_change":"2023-09-30T22:16:29.450700+0000","last_active":"2023-09-30T22:17:22.023976+0000","last_peered":"2023-09-30T22:17:22.023976+0000","last_clean":"2023-09-30T22:17:22.023976+0000","last_became_active":"2023-09-30T22:16:29.450434+0000","last_became_peered":"2023-09-30T22:16:29.450434+0000","last_unstale":"2023-09-30T22:17:22.023976+0000","last_undegraded":"2023-09-30T22:17:22.023976+0000","last_fullsized":"2023-09-30T22:17:22.023976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.028538+0000","last_change":"2023-09-30T22:16:29.821215+0000","last_active":"2023-09-30T22:17:22.028538+0000","last_peered":"2023-09-30T22:17:22.028538+0000","last_clean":"2023-09-30T22:17:22.028538+0000","last_became_active":"2023-09-30T22:16:29.820939+0000","last_became_peered":"2023-09-30T22:16:29.820939+0000","last_unstale":"2023-09-30T22:17:22.028538+0000","last_undegraded":"2023-09-30T22:17:22.028538+0000","last_fullsized":"2023-09-30T22:17:22.028538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024998+0000","last_change":"2023-09-30T22:16:29.445251+0000","last_active":"2023-09-30T22:17:22.024998+0000","last_peered":"2023-09-30T22:17:22.024998+0000","last_clean":"2023-09-30T22:17:22.024998+0000","last_became_active":"2023-09-30T22:16:29.441736+0000","last_became_peered":"2023-09-30T22:16:29.441736+0000","last_unstale":"2023-09-30T22:17:22.024998+0000","last_undegraded":"2023-09-30T22:17:22.024998+0000","last_fullsized":"2023-09-30T22:17:22.024998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.026818+0000","last_change":"2023-09-30T22:16:29.836710+0000","last_active":"2023-09-30T22:17:22.026818+0000","last_peered":"2023-09-30T22:17:22.026818+0000","last_clean":"2023-09-30T22:17:22.026818+0000","last_became_active":"2023-09-30T22:16:29.831551+0000","last_became_peered":"2023-09-30T22:16:29.831551+0000","last_unstale":"2023-09-30T22:17:22.026818+0000","last_undegraded":"2023-09-30T22:17:22.026818+0000","last_fullsized":"2023-09-30T22:17:22.026818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.028236+0000","last_change":"2023-09-30T22:16:29.444871+0000","last_active":"2023-09-30T22:17:22.028236+0000","last_peered":"2023-09-30T22:17:22.028236+0000","last_clean":"2023-09-30T22:17:22.028236+0000","last_became_active":"2023-09-30T22:16:29.444600+0000","last_became_peered":"2023-09-30T22:16:29.444600+0000","last_unstale":"2023-09-30T22:17:22.028236+0000","last_undegraded":"2023-09-30T22:17:22.028236+0000","last_fullsized":"2023-09-30T22:17:22.028236+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.023333+0000","last_change":"2023-09-30T22:16:29.839223+0000","last_active":"2023-09-30T22:17:22.023333+0000","last_peered":"2023-09-30T22:17:22.023333+0000","last_clean":"2023-09-30T22:17:22.023333+0000","last_became_active":"2023-09-30T22:16:29.838955+0000","last_became_peered":"2023-09-30T22:16:29.838955+0000","last_unstale":"2023-09-30T22:17:22.023333+0000","last_undegraded":"2023-09-30T22:17:22.023333+0000","last_fullsized":"2023-09-30T22:17:22.023333+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.819410+0000","last_change":"2023-09-30T22:16:29.451861+0000","last_active":"2023-09-30T22:18:37.819410+0000","last_peered":"2023-09-30T22:18:37.819410+0000","last_clean":"2023-09-30T22:18:37.819410+0000","last_became_active":"2023-09-30T22:16:29.451069+0000","last_became_peered":"2023-09-30T22:16:29.451069+0000","last_unstale":"2023-09-30T22:18:37.819410+0000","last_undegraded":"2023-09-30T22:18:37.819410+0000","last_fullsized":"2023-09-30T22:18:37.819410+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.032458+0000","last_change":"2023-09-30T22:17:22.031380+0000","last_active":"2023-09-30T22:17:22.032458+0000","last_peered":"2023-09-30T22:17:22.032458+0000","last_clean":"2023-09-30T22:17:22.032458+0000","last_became_active":"2023-09-30T22:17:22.031091+0000","last_became_peered":"2023-09-30T22:17:22.031091+0000","last_unstale":"2023-09-30T22:17:22.032458+0000","last_undegraded":"2023-09-30T22:17:22.032458+0000","last_fullsized":"2023-09-30T22:17:22.032458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025387+0000","last_change":"2023-09-30T22:16:29.446443+0000","last_active":"2023-09-30T22:17:22.025387+0000","last_peered":"2023-09-30T22:17:22.025387+0000","last_clean":"2023-09-30T22:17:22.025387+0000","last_became_active":"2023-09-30T22:16:29.445833+0000","last_became_peered":"2023-09-30T22:16:29.445833+0000","last_unstale":"2023-09-30T22:17:22.025387+0000","last_undegraded":"2023-09-30T22:17:22.025387+0000","last_fullsized":"2023-09-30T22:17:22.025387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.819161+0000","last_change":"2023-09-30T22:17:22.033367+0000","last_active":"2023-09-30T22:18:37.819161+0000","last_peered":"2023-09-30T22:18:37.819161+0000","last_clean":"2023-09-30T22:18:37.819161+0000","last_became_active":"2023-09-30T22:17:22.033061+0000","last_became_peered":"2023-09-30T22:17:22.033061+0000","last_unstale":"2023-09-30T22:18:37.819161+0000","last_undegraded":"2023-09-30T22:18:37.819161+0000","last_fullsized":"2023-09-30T22:18:37.819161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.026662+0000","last_change":"2023-09-30T22:16:29.451667+0000","last_active":"2023-09-30T22:17:22.026662+0000","last_peered":"2023-09-30T22:17:22.026662+0000","last_clean":"2023-09-30T22:17:22.026662+0000","last_became_active":"2023-09-30T22:16:29.451422+0000","last_became_peered":"2023-09-30T22:16:29.451422+0000","last_unstale":"2023-09-30T22:17:22.026662+0000","last_undegraded":"2023-09-30T22:17:22.026662+0000","last_fullsized":"2023-09-30T22:17:22.026662+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025172+0000","last_change":"2023-09-30T22:16:29.815304+0000","last_active":"2023-09-30T22:17:22.025172+0000","last_peered":"2023-09-30T22:17:22.025172+0000","last_clean":"2023-09-30T22:17:22.025172+0000","last_became_active":"2023-09-30T22:16:29.814885+0000","last_became_peered":"2023-09-30T22:16:29.814885+0000","last_unstale":"2023-09-30T22:17:22.025172+0000","last_undegraded":"2023-09-30T22:17:22.025172+0000","last_fullsized":"2023-09-30T22:17:22.025172+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024216+0000","last_change":"2023-09-30T22:16:29.452814+0000","last_active":"2023-09-30T22:17:22.024216+0000","last_peered":"2023-09-30T22:17:22.024216+0000","last_clean":"2023-09-30T22:17:22.024216+0000","last_became_active":"2023-09-30T22:16:29.452404+0000","last_became_peered":"2023-09-30T22:16:29.452404+0000","last_unstale":"2023-09-30T22:17:22.024216+0000","last_undegraded":"2023-09-30T22:17:22.024216+0000","last_fullsized":"2023-09-30T22:17:22.024216+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.031802+0000","last_change":"2023-09-30T22:17:22.030997+0000","last_active":"2023-09-30T22:17:22.031802+0000","last_peered":"2023-09-30T22:17:22.031802+0000","last_clean":"2023-09-30T22:17:22.031802+0000","last_became_active":"2023-09-30T22:17:22.030696+0000","last_became_peered":"2023-09-30T22:17:22.030696+0000","last_unstale":"2023-09-30T22:17:22.031802+0000","last_undegraded":"2023-09-30T22:17:22.031802+0000","last_fullsized":"2023-09-30T22:17:22.031802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025118+0000","last_change":"2023-09-30T22:16:29.447931+0000","last_active":"2023-09-30T22:17:22.025118+0000","last_peered":"2023-09-30T22:17:22.025118+0000","last_clean":"2023-09-30T22:17:22.025118+0000","last_became_active":"2023-09-30T22:16:29.447158+0000","last_became_peered":"2023-09-30T22:16:29.447158+0000","last_unstale":"2023-09-30T22:17:22.025118+0000","last_undegraded":"2023-09-30T22:17:22.025118+0000","last_fullsized":"2023-09-30T22:17:22.025118+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025676+0000","last_change":"2023-09-30T22:16:29.831438+0000","last_active":"2023-09-30T22:17:22.025676+0000","last_peered":"2023-09-30T22:17:22.025676+0000","last_clean":"2023-09-30T22:17:22.025676+0000","last_became_active":"2023-09-30T22:16:29.831158+0000","last_became_peered":"2023-09-30T22:16:29.831158+0000","last_unstale":"2023-09-30T22:17:22.025676+0000","last_undegraded":"2023-09-30T22:17:22.025676+0000","last_fullsized":"2023-09-30T22:17:22.025676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.023897+0000","last_change":"2023-09-30T22:16:29.449264+0000","last_active":"2023-09-30T22:17:22.023897+0000","last_peered":"2023-09-30T22:17:22.023897+0000","last_clean":"2023-09-30T22:17:22.023897+0000","last_became_active":"2023-09-30T22:16:29.448995+0000","last_became_peered":"2023-09-30T22:16:29.448995+0000","last_unstale":"2023-09-30T22:17:22.023897+0000","last_undegraded":"2023-09-30T22:17:22.023897+0000","last_fullsized":"2023-09-30T22:17:22.023897+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.819428+0000","last_change":"2023-09-30T22:16:29.832641+0000","last_active":"2023-09-30T22:18:37.819428+0000","last_peered":"2023-09-30T22:18:37.819428+0000","last_clean":"2023-09-30T22:18:37.819428+0000","last_became_active":"2023-09-30T22:16:29.832399+0000","last_became_peered":"2023-09-30T22:16:29.832399+0000","last_unstale":"2023-09-30T22:18:37.819428+0000","last_undegraded":"2023-09-30T22:18:37.819428+0000","last_fullsized":"2023-09-30T22:18:37.819428+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.022534+0000","last_change":"2023-09-30T22:16:29.451927+0000","last_active":"2023-09-30T22:17:22.022534+0000","last_peered":"2023-09-30T22:17:22.022534+0000","last_clean":"2023-09-30T22:17:22.022534+0000","last_became_active":"2023-09-30T22:16:29.449397+0000","last_became_peered":"2023-09-30T22:16:29.449397+0000","last_unstale":"2023-09-30T22:17:22.022534+0000","last_undegraded":"2023-09-30T22:17:22.022534+0000","last_fullsized":"2023-09-30T22:17:22.022534+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027475+0000","last_change":"2023-09-30T22:16:29.829224+0000","last_active":"2023-09-30T22:17:22.027475+0000","last_peered":"2023-09-30T22:17:22.027475+0000","last_clean":"2023-09-30T22:17:22.027475+0000","last_became_active":"2023-09-30T22:16:29.828558+0000","last_became_peered":"2023-09-30T22:16:29.828558+0000","last_unstale":"2023-09-30T22:17:22.027475+0000","last_undegraded":"2023-09-30T22:17:22.027475+0000","last_fullsized":"2023-09-30T22:17:22.027475+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027383+0000","last_change":"2023-09-30T22:16:25.780366+0000","last_active":"2023-09-30T22:17:22.027383+0000","last_peered":"2023-09-30T22:17:22.027383+0000","last_clean":"2023-09-30T22:17:22.027383+0000","last_became_active":"2023-09-30T22:16:25.780059+0000","last_became_peered":"2023-09-30T22:16:25.780059+0000","last_unstale":"2023-09-30T22:17:22.027383+0000","last_undegraded":"2023-09-30T22:17:22.027383+0000","last_fullsized":"2023-09-30T22:17:22.027383+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.819405+0000","last_change":"2023-09-30T22:16:29.448527+0000","last_active":"2023-09-30T22:18:37.819405+0000","last_peered":"2023-09-30T22:18:37.819405+0000","last_clean":"2023-09-30T22:18:37.819405+0000","last_became_active":"2023-09-30T22:16:29.448223+0000","last_became_peered":"2023-09-30T22:16:29.448223+0000","last_unstale":"2023-09-30T22:18:37.819405+0000","last_undegraded":"2023-09-30T22:18:37.819405+0000","last_fullsized":"2023-09-30T22:18:37.819405+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.033729+0000","last_change":"2023-09-30T22:17:22.031511+0000","last_active":"2023-09-30T22:17:22.033729+0000","last_peered":"2023-09-30T22:17:22.033729+0000","last_clean":"2023-09-30T22:17:22.033729+0000","last_became_active":"2023-09-30T22:17:22.031211+0000","last_became_peered":"2023-09-30T22:17:22.031211+0000","last_unstale":"2023-09-30T22:17:22.033729+0000","last_undegraded":"2023-09-30T22:17:22.033729+0000","last_fullsized":"2023-09-30T22:17:22.033729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025046+0000","last_change":"2023-09-30T22:16:25.414057+0000","last_active":"2023-09-30T22:17:22.025046+0000","last_peered":"2023-09-30T22:17:22.025046+0000","last_clean":"2023-09-30T22:17:22.025046+0000","last_became_active":"2023-09-30T22:16:25.413712+0000","last_became_peered":"2023-09-30T22:16:25.413712+0000","last_unstale":"2023-09-30T22:17:22.025046+0000","last_undegraded":"2023-09-30T22:17:22.025046+0000","last_fullsized":"2023-09-30T22:17:22.025046+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024879+0000","last_change":"2023-09-30T22:16:29.446619+0000","last_active":"2023-09-30T22:17:22.024879+0000","last_peered":"2023-09-30T22:17:22.024879+0000","last_clean":"2023-09-30T22:17:22.024879+0000","last_became_active":"2023-09-30T22:16:29.446314+0000","last_became_peered":"2023-09-30T22:16:29.446314+0000","last_unstale":"2023-09-30T22:17:22.024879+0000","last_undegraded":"2023-09-30T22:17:22.024879+0000","last_fullsized":"2023-09-30T22:17:22.024879+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027267+0000","last_change":"2023-09-30T22:16:29.835339+0000","last_active":"2023-09-30T22:17:22.027267+0000","last_peered":"2023-09-30T22:17:22.027267+0000","last_clean":"2023-09-30T22:17:22.027267+0000","last_became_active":"2023-09-30T22:16:29.833186+0000","last_became_peered":"2023-09-30T22:16:29.833186+0000","last_unstale":"2023-09-30T22:17:22.027267+0000","last_undegraded":"2023-09-30T22:17:22.027267+0000","last_fullsized":"2023-09-30T22:17:22.027267+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.819028+0000","last_change":"2023-09-30T22:16:25.416240+0000","last_active":"2023-09-30T22:18:37.819028+0000","last_peered":"2023-09-30T22:18:37.819028+0000","last_clean":"2023-09-30T22:18:37.819028+0000","last_became_active":"2023-09-30T22:16:25.415852+0000","last_became_peered":"2023-09-30T22:16:25.415852+0000","last_unstale":"2023-09-30T22:18:37.819028+0000","last_undegraded":"2023-09-30T22:18:37.819028+0000","last_fullsized":"2023-09-30T22:18:37.819028+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024654+0000","last_change":"2023-09-30T22:16:29.449007+0000","last_active":"2023-09-30T22:17:22.024654+0000","last_peered":"2023-09-30T22:17:22.024654+0000","last_clean":"2023-09-30T22:17:22.024654+0000","last_became_active":"2023-09-30T22:16:29.448746+0000","last_became_peered":"2023-09-30T22:16:29.448746+0000","last_unstale":"2023-09-30T22:17:22.024654+0000","last_undegraded":"2023-09-30T22:17:22.024654+0000","last_fullsized":"2023-09-30T22:17:22.024654+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027320+0000","last_change":"2023-09-30T22:16:29.819140+0000","last_active":"2023-09-30T22:17:22.027320+0000","last_peered":"2023-09-30T22:17:22.027320+0000","last_clean":"2023-09-30T22:17:22.027320+0000","last_became_active":"2023-09-30T22:16:29.818875+0000","last_became_peered":"2023-09-30T22:16:29.818875+0000","last_unstale":"2023-09-30T22:17:22.027320+0000","last_undegraded":"2023-09-30T22:17:22.027320+0000","last_fullsized":"2023-09-30T22:17:22.027320+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024291+0000","last_change":"2023-09-30T22:16:25.414050+0000","last_active":"2023-09-30T22:17:22.024291+0000","last_peered":"2023-09-30T22:17:22.024291+0000","last_clean":"2023-09-30T22:17:22.024291+0000","last_became_active":"2023-09-30T22:16:25.413709+0000","last_became_peered":"2023-09-30T22:16:25.413709+0000","last_unstale":"2023-09-30T22:17:22.024291+0000","last_undegraded":"2023-09-30T22:17:22.024291+0000","last_fullsized":"2023-09-30T22:17:22.024291+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024450+0000","last_change":"2023-09-30T22:16:25.781137+0000","last_active":"2023-09-30T22:17:22.024450+0000","last_peered":"2023-09-30T22:17:22.024450+0000","last_clean":"2023-09-30T22:17:22.024450+0000","last_became_active":"2023-09-30T22:16:25.780923+0000","last_became_peered":"2023-09-30T22:16:25.780923+0000","last_unstale":"2023-09-30T22:17:22.024450+0000","last_undegraded":"2023-09-30T22:17:22.024450+0000","last_fullsized":"2023-09-30T22:17:22.024450+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024919+0000","last_change":"2023-09-30T22:16:29.448514+0000","last_active":"2023-09-30T22:17:22.024919+0000","last_peered":"2023-09-30T22:17:22.024919+0000","last_clean":"2023-09-30T22:17:22.024919+0000","last_became_active":"2023-09-30T22:16:29.448270+0000","last_became_peered":"2023-09-30T22:16:29.448270+0000","last_unstale":"2023-09-30T22:17:22.024919+0000","last_undegraded":"2023-09-30T22:17:22.024919+0000","last_fullsized":"2023-09-30T22:17:22.024919+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.819332+0000","last_change":"2023-09-30T22:17:22.029261+0000","last_active":"2023-09-30T22:18:37.819332+0000","last_peered":"2023-09-30T22:18:37.819332+0000","last_clean":"2023-09-30T22:18:37.819332+0000","last_became_active":"2023-09-30T22:17:22.029030+0000","last_became_peered":"2023-09-30T22:17:22.029030+0000","last_unstale":"2023-09-30T22:18:37.819332+0000","last_undegraded":"2023-09-30T22:18:37.819332+0000","last_fullsized":"2023-09-30T22:18:37.819332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.022754+0000","last_change":"2023-09-30T22:16:25.416399+0000","last_active":"2023-09-30T22:17:22.022754+0000","last_peered":"2023-09-30T22:17:22.022754+0000","last_clean":"2023-09-30T22:17:22.022754+0000","last_became_active":"2023-09-30T22:16:25.416054+0000","last_became_peered":"2023-09-30T22:16:25.416054+0000","last_unstale":"2023-09-30T22:17:22.022754+0000","last_undegraded":"2023-09-30T22:17:22.022754+0000","last_fullsized":"2023-09-30T22:17:22.022754+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025538+0000","last_change":"2023-09-30T22:16:29.450979+0000","last_active":"2023-09-30T22:17:22.025538+0000","last_peered":"2023-09-30T22:17:22.025538+0000","last_clean":"2023-09-30T22:17:22.025538+0000","last_became_active":"2023-09-30T22:16:29.450724+0000","last_became_peered":"2023-09-30T22:16:29.450724+0000","last_unstale":"2023-09-30T22:17:22.025538+0000","last_undegraded":"2023-09-30T22:17:22.025538+0000","last_fullsized":"2023-09-30T22:17:22.025538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.028625+0000","last_change":"2023-09-30T22:16:29.827233+0000","last_active":"2023-09-30T22:17:22.028625+0000","last_peered":"2023-09-30T22:17:22.028625+0000","last_clean":"2023-09-30T22:17:22.028625+0000","last_became_active":"2023-09-30T22:16:29.822966+0000","last_became_peered":"2023-09-30T22:16:29.822966+0000","last_unstale":"2023-09-30T22:17:22.028625+0000","last_undegraded":"2023-09-30T22:17:22.028625+0000","last_fullsized":"2023-09-30T22:17:22.028625+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025518+0000","last_change":"2023-09-30T22:16:25.780298+0000","last_active":"2023-09-30T22:17:22.025518+0000","last_peered":"2023-09-30T22:17:22.025518+0000","last_clean":"2023-09-30T22:17:22.025518+0000","last_became_active":"2023-09-30T22:16:25.780022+0000","last_became_peered":"2023-09-30T22:16:25.780022+0000","last_unstale":"2023-09-30T22:17:22.025518+0000","last_undegraded":"2023-09-30T22:17:22.025518+0000","last_fullsized":"2023-09-30T22:17:22.025518+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027226+0000","last_change":"2023-09-30T22:16:29.448428+0000","last_active":"2023-09-30T22:17:22.027226+0000","last_peered":"2023-09-30T22:17:22.027226+0000","last_clean":"2023-09-30T22:17:22.027226+0000","last_became_active":"2023-09-30T22:16:29.447613+0000","last_became_peered":"2023-09-30T22:16:29.447613+0000","last_unstale":"2023-09-30T22:17:22.027226+0000","last_undegraded":"2023-09-30T22:17:22.027226+0000","last_fullsized":"2023-09-30T22:17:22.027226+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025039+0000","last_change":"2023-09-30T22:16:29.815447+0000","last_active":"2023-09-30T22:17:22.025039+0000","last_peered":"2023-09-30T22:17:22.025039+0000","last_clean":"2023-09-30T22:17:22.025039+0000","last_became_active":"2023-09-30T22:16:29.815169+0000","last_became_peered":"2023-09-30T22:16:29.815169+0000","last_unstale":"2023-09-30T22:17:22.025039+0000","last_undegraded":"2023-09-30T22:17:22.025039+0000","last_fullsized":"2023-09-30T22:17:22.025039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.026677+0000","last_change":"2023-09-30T22:16:29.448448+0000","last_active":"2023-09-30T22:17:22.026677+0000","last_peered":"2023-09-30T22:17:22.026677+0000","last_clean":"2023-09-30T22:17:22.026677+0000","last_became_active":"2023-09-30T22:16:29.448177+0000","last_became_peered":"2023-09-30T22:16:29.448177+0000","last_unstale":"2023-09-30T22:17:22.026677+0000","last_undegraded":"2023-09-30T22:17:22.026677+0000","last_fullsized":"2023-09-30T22:17:22.026677+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027765+0000","last_change":"2023-09-30T22:16:25.781178+0000","last_active":"2023-09-30T22:17:22.027765+0000","last_peered":"2023-09-30T22:17:22.027765+0000","last_clean":"2023-09-30T22:17:22.027765+0000","last_became_active":"2023-09-30T22:16:25.780121+0000","last_became_peered":"2023-09-30T22:16:25.780121+0000","last_unstale":"2023-09-30T22:17:22.027765+0000","last_undegraded":"2023-09-30T22:17:22.027765+0000","last_fullsized":"2023-09-30T22:17:22.027765+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.818816+0000","last_change":"2023-09-30T22:17:22.029786+0000","last_active":"2023-09-30T22:18:37.818816+0000","last_peered":"2023-09-30T22:18:37.818816+0000","last_clean":"2023-09-30T22:18:37.818816+0000","last_became_active":"2023-09-30T22:17:22.028699+0000","last_became_peered":"2023-09-30T22:17:22.028699+0000","last_unstale":"2023-09-30T22:18:37.818816+0000","last_undegraded":"2023-09-30T22:18:37.818816+0000","last_fullsized":"2023-09-30T22:18:37.818816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.026747+0000","last_change":"2023-09-30T22:16:25.780328+0000","last_active":"2023-09-30T22:17:22.026747+0000","last_peered":"2023-09-30T22:17:22.026747+0000","last_clean":"2023-09-30T22:17:22.026747+0000","last_became_active":"2023-09-30T22:16:25.780026+0000","last_became_peered":"2023-09-30T22:16:25.780026+0000","last_unstale":"2023-09-30T22:17:22.026747+0000","last_undegraded":"2023-09-30T22:17:22.026747+0000","last_fullsized":"2023-09-30T22:17:22.026747+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:24.400890+0000","last_clean_scrub_stamp":"2023-09-30T22:16:24.400890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.028376+0000","last_change":"2023-09-30T22:16:29.444398+0000","last_active":"2023-09-30T22:17:22.028376+0000","last_peered":"2023-09-30T22:17:22.028376+0000","last_clean":"2023-09-30T22:17:22.028376+0000","last_became_active":"2023-09-30T22:16:29.444126+0000","last_became_peered":"2023-09-30T22:16:29.444126+0000","last_unstale":"2023-09-30T22:17:22.028376+0000","last_undegraded":"2023-09-30T22:17:22.028376+0000","last_fullsized":"2023-09-30T22:17:22.028376+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.818950+0000","last_change":"2023-09-30T22:16:29.820636+0000","last_active":"2023-09-30T22:18:37.818950+0000","last_peered":"2023-09-30T22:18:37.818950+0000","last_clean":"2023-09-30T22:18:37.818950+0000","last_became_active":"2023-09-30T22:16:29.820372+0000","last_became_peered":"2023-09-30T22:16:29.820372+0000","last_unstale":"2023-09-30T22:18:37.818950+0000","last_undegraded":"2023-09-30T22:18:37.818950+0000","last_fullsized":"2023-09-30T22:18:37.818950+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024974+0000","last_change":"2023-09-30T22:16:29.452715+0000","last_active":"2023-09-30T22:17:22.024974+0000","last_peered":"2023-09-30T22:17:22.024974+0000","last_clean":"2023-09-30T22:17:22.024974+0000","last_became_active":"2023-09-30T22:16:29.452405+0000","last_became_peered":"2023-09-30T22:16:29.452405+0000","last_unstale":"2023-09-30T22:17:22.024974+0000","last_undegraded":"2023-09-30T22:17:22.024974+0000","last_fullsized":"2023-09-30T22:17:22.024974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.819437+0000","last_change":"2023-09-30T22:16:29.827280+0000","last_active":"2023-09-30T22:18:37.819437+0000","last_peered":"2023-09-30T22:18:37.819437+0000","last_clean":"2023-09-30T22:18:37.819437+0000","last_became_active":"2023-09-30T22:16:29.827006+0000","last_became_peered":"2023-09-30T22:16:29.827006+0000","last_unstale":"2023-09-30T22:18:37.819437+0000","last_undegraded":"2023-09-30T22:18:37.819437+0000","last_fullsized":"2023-09-30T22:18:37.819437+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027303+0000","last_change":"2023-09-30T22:16:29.441940+0000","last_active":"2023-09-30T22:17:22.027303+0000","last_peered":"2023-09-30T22:17:22.027303+0000","last_clean":"2023-09-30T22:17:22.027303+0000","last_became_active":"2023-09-30T22:16:29.441296+0000","last_became_peered":"2023-09-30T22:16:29.441296+0000","last_unstale":"2023-09-30T22:17:22.027303+0000","last_undegraded":"2023-09-30T22:17:22.027303+0000","last_fullsized":"2023-09-30T22:17:22.027303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.819192+0000","last_change":"2023-09-30T22:16:29.824467+0000","last_active":"2023-09-30T22:18:37.819192+0000","last_peered":"2023-09-30T22:18:37.819192+0000","last_clean":"2023-09-30T22:18:37.819192+0000","last_became_active":"2023-09-30T22:16:29.824206+0000","last_became_peered":"2023-09-30T22:16:29.824206+0000","last_unstale":"2023-09-30T22:18:37.819192+0000","last_undegraded":"2023-09-30T22:18:37.819192+0000","last_fullsized":"2023-09-30T22:18:37.819192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025601+0000","last_change":"2023-09-30T22:16:29.446705+0000","last_active":"2023-09-30T22:17:22.025601+0000","last_peered":"2023-09-30T22:17:22.025601+0000","last_clean":"2023-09-30T22:17:22.025601+0000","last_became_active":"2023-09-30T22:16:29.446173+0000","last_became_peered":"2023-09-30T22:16:29.446173+0000","last_unstale":"2023-09-30T22:17:22.025601+0000","last_undegraded":"2023-09-30T22:17:22.025601+0000","last_fullsized":"2023-09-30T22:17:22.025601+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.819103+0000","last_change":"2023-09-30T22:16:29.832880+0000","last_active":"2023-09-30T22:18:37.819103+0000","last_peered":"2023-09-30T22:18:37.819103+0000","last_clean":"2023-09-30T22:18:37.819103+0000","last_became_active":"2023-09-30T22:16:29.832321+0000","last_became_peered":"2023-09-30T22:16:29.832321+0000","last_unstale":"2023-09-30T22:18:37.819103+0000","last_undegraded":"2023-09-30T22:18:37.819103+0000","last_fullsized":"2023-09-30T22:18:37.819103+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.026287+0000","last_change":"2023-09-30T22:16:29.451645+0000","last_active":"2023-09-30T22:17:22.026287+0000","last_peered":"2023-09-30T22:17:22.026287+0000","last_clean":"2023-09-30T22:17:22.026287+0000","last_became_active":"2023-09-30T22:16:29.451283+0000","last_became_peered":"2023-09-30T22:16:29.451283+0000","last_unstale":"2023-09-30T22:17:22.026287+0000","last_undegraded":"2023-09-30T22:17:22.026287+0000","last_fullsized":"2023-09-30T22:17:22.026287+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024126+0000","last_change":"2023-09-30T22:16:29.825999+0000","last_active":"2023-09-30T22:17:22.024126+0000","last_peered":"2023-09-30T22:17:22.024126+0000","last_clean":"2023-09-30T22:17:22.024126+0000","last_became_active":"2023-09-30T22:16:29.825211+0000","last_became_peered":"2023-09-30T22:16:29.825211+0000","last_unstale":"2023-09-30T22:17:22.024126+0000","last_undegraded":"2023-09-30T22:17:22.024126+0000","last_fullsized":"2023-09-30T22:17:22.024126+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.028316+0000","last_change":"2023-09-30T22:16:29.443167+0000","last_active":"2023-09-30T22:17:22.028316+0000","last_peered":"2023-09-30T22:17:22.028316+0000","last_clean":"2023-09-30T22:17:22.028316+0000","last_became_active":"2023-09-30T22:16:29.442895+0000","last_became_peered":"2023-09-30T22:16:29.442895+0000","last_unstale":"2023-09-30T22:17:22.028316+0000","last_undegraded":"2023-09-30T22:17:22.028316+0000","last_fullsized":"2023-09-30T22:17:22.028316+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:28.416755+0000","last_clean_scrub_stamp":"2023-09-30T22:16:28.416755+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:18:37.818883+0000","last_change":"2023-09-30T22:16:29.827232+0000","last_active":"2023-09-30T22:18:37.818883+0000","last_peered":"2023-09-30T22:18:37.818883+0000","last_clean":"2023-09-30T22:18:37.818883+0000","last_became_active":"2023-09-30T22:16:29.826971+0000","last_became_peered":"2023-09-30T22:16:29.826971+0000","last_unstale":"2023-09-30T22:18:37.818883+0000","last_undegraded":"2023-09-30T22:18:37.818883+0000","last_fullsized":"2023-09-30T22:18:37.818883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024917+0000","last_change":"2023-09-30T22:16:29.833273+0000","last_active":"2023-09-30T22:17:22.024917+0000","last_peered":"2023-09-30T22:17:22.024917+0000","last_clean":"2023-09-30T22:17:22.024917+0000","last_became_active":"2023-09-30T22:16:29.832627+0000","last_became_peered":"2023-09-30T22:16:29.832627+0000","last_unstale":"2023-09-30T22:17:22.024917+0000","last_undegraded":"2023-09-30T22:17:22.024917+0000","last_fullsized":"2023-09-30T22:17:22.024917+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024246+0000","last_change":"2023-09-30T22:16:29.834527+0000","last_active":"2023-09-30T22:17:22.024246+0000","last_peered":"2023-09-30T22:17:22.024246+0000","last_clean":"2023-09-30T22:17:22.024246+0000","last_became_active":"2023-09-30T22:16:29.830063+0000","last_became_peered":"2023-09-30T22:16:29.830063+0000","last_unstale":"2023-09-30T22:17:22.024246+0000","last_undegraded":"2023-09-30T22:17:22.024246+0000","last_fullsized":"2023-09-30T22:17:22.024246+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.025280+0000","last_change":"2023-09-30T22:16:29.821730+0000","last_active":"2023-09-30T22:17:22.025280+0000","last_peered":"2023-09-30T22:17:22.025280+0000","last_clean":"2023-09-30T22:17:22.025280+0000","last_became_active":"2023-09-30T22:16:29.821455+0000","last_became_peered":"2023-09-30T22:16:29.821455+0000","last_unstale":"2023-09-30T22:17:22.025280+0000","last_undegraded":"2023-09-30T22:17:22.025280+0000","last_fullsized":"2023-09-30T22:17:22.025280+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.024452+0000","last_change":"2023-09-30T22:16:29.830760+0000","last_active":"2023-09-30T22:17:22.024452+0000","last_peered":"2023-09-30T22:17:22.024452+0000","last_clean":"2023-09-30T22:17:22.024452+0000","last_became_active":"2023-09-30T22:16:29.830307+0000","last_became_peered":"2023-09-30T22:16:29.830307+0000","last_unstale":"2023-09-30T22:17:22.024452+0000","last_undegraded":"2023-09-30T22:17:22.024452+0000","last_fullsized":"2023-09-30T22:17:22.024452+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T22:17:22.027358+0000","last_change":"2023-09-30T22:16:29.835169+0000","last_active":"2023-09-30T22:17:22.027358+0000","last_peered":"2023-09-30T22:17:22.027358+0000","last_clean":"2023-09-30T22:17:22.027358+0000","last_became_active":"2023-09-30T22:16:29.832849+0000","last_became_peered":"2023-09-30T22:16:29.832849+0000","last_unstale":"2023-09-30T22:17:22.027358+0000","last_undegraded":"2023-09-30T22:17:22.027358+0000","last_fullsized":"2023-09-30T22:17:22.027358+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:16:29.419764+0000","last_clean_scrub_stamp":"2023-09-30T22:16:29.419764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705693,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297284,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074556,"statfs":{"total":96636764160,"available":96332345344,"internally_reserved":0,"allocated":192512,"data_stored":64656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.28100000000000003,"5min":0.28799999999999998,"15min":0.28899999999999998},"min":{"1min":0.21099999999999999,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.375,"5min":0.38300000000000001,"15min":0.38300000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.28799999999999998,"5min":0.29999999999999999,"15min":0.30199999999999999},"min":{"1min":0.23899999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.41299999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.33900000000000002}]},{"osd":1,"last update":"Sat Sep 30 22:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.308,"15min":0.311},"min":{"1min":0.23599999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.40200000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.311,"5min":0.317,"15min":0.318},"min":{"1min":0.251,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.39200000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.38100000000000001}]},{"osd":2,"last update":"Sat Sep 30 22:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.436,"5min":0.498,"15min":0.498},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.28399999999999997,"5min":0.309,"15min":0.313},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.42299999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.34899999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705693,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":64462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.20200000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.29099999999999998,"15min":0.28899999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.34499999999999997}]},{"osd":1,"last update":"Sat Sep 30 22:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.29199999999999998,"5min":0.29799999999999999,"15min":0.29899999999999999},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.308,"15min":0.30599999999999999},"min":{"1min":0.253,"5min":0.215,"15min":0.215},"max":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.29699999999999999}]},{"osd":3,"last update":"Sat Sep 30 22:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.318,"15min":0.318},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"last":0.318},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34499999999999997,"15min":0.34599999999999997},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.32500000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705693,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297268,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074572,"statfs":{"total":96636764160,"available":96332361728,"internally_reserved":0,"allocated":176128,"data_stored":56418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.26500000000000001,"5min":0.27600000000000002,"15min":0.27800000000000002},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.38700000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.26500000000000001,"5min":0.28100000000000003,"15min":0.28399999999999997},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.311,"5min":0.41399999999999998,"15min":0.41399999999999998},"last":0.247}]},{"osd":2,"last update":"Sat Sep 30 22:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.31900000000000001,"15min":0.32300000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.34999999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.32600000000000001,"15min":0.33000000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.39300000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.32900000000000001}]},{"osd":3,"last update":"Sat Sep 30 22:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.316,"15min":0.318},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.374,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.27700000000000002,"5min":0.30499999999999999,"15min":0.31},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.32000000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"last":0.312}]}]},{"osd":1,"up_from":9,"seq":38654705693,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":61545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.34499999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.32900000000000001,"15min":0.33000000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.42299999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.36899999999999999}]},{"osd":2,"last update":"Sat Sep 30 22:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.28100000000000003,"5min":0.29599999999999999,"15min":0.29799999999999999},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.375,"5min":0.45300000000000001,"15min":0.45300000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.29199999999999998,"5min":0.307,"15min":0.309},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.39800000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.44}]},{"osd":3,"last update":"Sat Sep 30 22:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.28799999999999998,"5min":0.29599999999999999,"15min":0.29699999999999999},"min":{"1min":0.252,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.375,"5min":0.45800000000000002,"15min":0.45800000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.312,"5min":0.32000000000000001,"15min":0.32100000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.41799999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.63800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:18:40.784 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-30T22:18:40.784 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-30T22:18:40.784 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-09-30T22:18:40.784 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T22:18:40.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.938+0000 7fb6c930c700 1 Processor -- start 2023-09-30T22:18:40.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.938+0000 7fb6c930c700 1 -- start start 2023-09-30T22:18:40.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.939+0000 7fb6c930c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6c409e950 0x7fb6c409ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:40.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.939+0000 7fb6c930c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb6c409f260 0x7fb6c4137c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:40.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.939+0000 7fb6c930c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6c40a06a0 con 0x7fb6c4138180 2023-09-30T22:18:40.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.939+0000 7fb6c930c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6c40a0150 con 0x7fb6c409f260 2023-09-30T22:18:40.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.939+0000 7fb6c930c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c406b920 con 0x7fb6c409e950 2023-09-30T22:18:40.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.939+0000 7fb6c2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6c409e950 0x7fb6c409ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:40.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.939+0000 7fb6c27fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb6c409f260 0x7fb6c4137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:40.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.939+0000 7fb6c27fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb6c409f260 0x7fb6c4137c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39824/0 (socket says 172.21.15.156:39824) 2023-09-30T22:18:40.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.939+0000 7fb6c2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6c409e950 0x7fb6c409ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:58244/0 (socket says 172.21.15.156:58244) 2023-09-30T22:18:40.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.939+0000 7fb6c27fc700 1 -- 172.21.15.156:0/2628006038 learned_addr learned my addr 172.21.15.156:0/2628006038 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:40.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.939+0000 7fb6c37fe700 1 --1- 172.21.15.156:0/2628006038 >> v1:172.21.15.156:6789/0 conn(0x7fb6c4138180 0x7fb6c413a560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:42706/0 (socket says 172.21.15.156:42706) 2023-09-30T22:18:40.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.939+0000 7fb6c2ffd700 1 -- 172.21.15.156:0/2628006038 >> v2:172.21.15.156:3300/0 conn(0x7fb6c409f260 msgr2=0x7fb6c4137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:40.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.939+0000 7fb6c2ffd700 1 --2- 172.21.15.156:0/2628006038 >> v2:172.21.15.156:3300/0 conn(0x7fb6c409f260 0x7fb6c4137c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:40.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.939+0000 7fb6c2ffd700 1 -- 172.21.15.156:0/2628006038 >> v1:172.21.15.156:6789/0 conn(0x7fb6c4138180 legacy=0x7fb6c413a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:40.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.939+0000 7fb6c2ffd700 1 -- 172.21.15.156:0/2628006038 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c406d8e0 con 0x7fb6c409e950 2023-09-30T22:18:40.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.939+0000 7fb6c27fc700 1 --2- 172.21.15.156:0/2628006038 >> v2:172.21.15.156:3300/0 conn(0x7fb6c409f260 0x7fb6c4137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:40.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.940+0000 7fb6c2ffd700 1 --2- 172.21.15.156:0/2628006038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6c409e950 0x7fb6c409ed20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac009820 tx=0x7fb6ac009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=122cf1d840c00661 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:40.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.940+0000 7fb6c1ffb700 1 -- 172.21.15.156:0/2628006038 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac005e30 con 0x7fb6c409e950 2023-09-30T22:18:40.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.940+0000 7fb6c1ffb700 1 -- 172.21.15.156:0/2628006038 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ac006030 con 0x7fb6c409e950 2023-09-30T22:18:40.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.940+0000 7fb6c1ffb700 1 -- 172.21.15.156:0/2628006038 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac0063c0 con 0x7fb6c409e950 2023-09-30T22:18:40.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.940+0000 7fb6c930c700 1 -- 172.21.15.156:0/2628006038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6c409e950 msgr2=0x7fb6c409ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:40.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.940+0000 7fb6c930c700 1 --2- 172.21.15.156:0/2628006038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6c409e950 0x7fb6c409ed20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac009820 tx=0x7fb6ac009b30 comp rx=0 tx=0).stop 2023-09-30T22:18:40.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.940+0000 7fb6c930c700 1 -- 172.21.15.156:0/2628006038 shutdown_connections 2023-09-30T22:18:40.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.940+0000 7fb6c930c700 1 --2- 172.21.15.156:0/2628006038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6c409e950 0x7fb6c409ed20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:40.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.940+0000 7fb6c930c700 1 --2- 172.21.15.156:0/2628006038 >> v2:172.21.15.156:3300/0 conn(0x7fb6c409f260 0x7fb6c4137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:40.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.940+0000 7fb6c930c700 1 -- 172.21.15.156:0/2628006038 >> 172.21.15.156:0/2628006038 conn(0x7fb6c40a4470 msgr2=0x7fb6c40a4870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:40.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.940+0000 7fb6c930c700 1 -- 172.21.15.156:0/2628006038 shutdown_connections 2023-09-30T22:18:40.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.940+0000 7fb6c930c700 1 -- 172.21.15.156:0/2628006038 wait complete. 2023-09-30T22:18:40.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.941+0000 7fb6c930c700 1 Processor -- start 2023-09-30T22:18:40.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.941+0000 7fb6c930c700 1 -- start start 2023-09-30T22:18:40.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.942+0000 7fb6c930c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6c409e950 0x7fb6c4120ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:40.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.942+0000 7fb6c930c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb6c409f260 0x7fb6c4121000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:40.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.942+0000 7fb6c930c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6c4138180 0x7fb6c41c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:40.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.942+0000 7fb6c930c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c4120670 con 0x7fb6c409e950 2023-09-30T22:18:40.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.942+0000 7fb6c930c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c4121540 con 0x7fb6c4138180 2023-09-30T22:18:40.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.942+0000 7fb6c930c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c406ccc0 con 0x7fb6c409f260 2023-09-30T22:18:40.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.942+0000 7fb6c2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6c409e950 0x7fb6c4120ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:40.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.942+0000 7fb6c27fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb6c409f260 0x7fb6c4121000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:40.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.942+0000 7fb6c37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6c4138180 0x7fb6c41c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:40.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.942+0000 7fb6c2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6c409e950 0x7fb6c4120ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39834/0 (socket says 172.21.15.156:39834) 2023-09-30T22:18:40.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.942+0000 7fb6c2ffd700 1 -- 172.21.15.156:0/3258655079 learned_addr learned my addr 172.21.15.156:0/3258655079 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:40.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.942+0000 7fb6c2ffd700 1 -- 172.21.15.156:0/3258655079 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb6c409f260 msgr2=0x7fb6c4121000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:40.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.942+0000 7fb6c2ffd700 1 --2- 172.21.15.156:0/3258655079 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb6c409f260 0x7fb6c4121000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:40.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.942+0000 7fb6c2ffd700 1 -- 172.21.15.156:0/3258655079 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6c4138180 msgr2=0x7fb6c41c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:40.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.942+0000 7fb6c2ffd700 1 --2- 172.21.15.156:0/3258655079 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6c4138180 0x7fb6c41c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:40.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.942+0000 7fb6c2ffd700 1 -- 172.21.15.156:0/3258655079 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b4009500 con 0x7fb6c409e950 2023-09-30T22:18:40.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.942+0000 7fb6c37fe700 1 --2- 172.21.15.156:0/3258655079 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6c4138180 0x7fb6c41c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:40.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.942+0000 7fb6c27fc700 1 --2- 172.21.15.156:0/3258655079 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb6c409f260 0x7fb6c4121000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:40.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.942+0000 7fb6c2ffd700 1 --2- 172.21.15.156:0/3258655079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6c409e950 0x7fb6c4120ac0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac000c00 tx=0x7fb6ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:40.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.942+0000 7fb6bb7fe700 1 -- 172.21.15.156:0/3258655079 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac0061a0 con 0x7fb6c409e950 2023-09-30T22:18:40.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.942+0000 7fb6bb7fe700 1 -- 172.21.15.156:0/3258655079 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ac020070 con 0x7fb6c409e950 2023-09-30T22:18:40.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.943+0000 7fb6c930c700 1 -- 172.21.15.156:0/3258655079 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6ac009430 con 0x7fb6c409e950 2023-09-30T22:18:40.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.943+0000 7fb6bb7fe700 1 -- 172.21.15.156:0/3258655079 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac006540 con 0x7fb6c409e950 2023-09-30T22:18:40.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.943+0000 7fb6c930c700 1 -- 172.21.15.156:0/3258655079 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c4122940 con 0x7fb6c409e950 2023-09-30T22:18:40.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.943+0000 7fb6bb7fe700 1 -- 172.21.15.156:0/3258655079 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7fb6ac022030 con 0x7fb6c409e950 2023-09-30T22:18:40.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.943+0000 7fb6bb7fe700 1 -- 172.21.15.156:0/3258655079 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fb6ac040f80 con 0x7fb6c409e950 2023-09-30T22:18:40.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.944+0000 7fb6c930c700 1 -- 172.21.15.156:0/3258655079 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c4123540 con 0x7fb6c409e950 2023-09-30T22:18:40.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:40.948+0000 7fb6bb7fe700 1 -- 172.21.15.156:0/3258655079 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb6ac0247e0 con 0x7fb6c409e950 2023-09-30T22:18:41.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.169+0000 7fb6c930c700 1 -- 172.21.15.156:0/3258655079 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb6c404f2a0 con 0x7fb6c409e950 2023-09-30T22:18:41.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.169+0000 7fb6bb7fe700 1 -- 172.21.15.156:0/3258655079 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fb6ac01b410 con 0x7fb6c409e950 2023-09-30T22:18:41.170 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:18:41.170 INFO:teuthology.orchestra.run.smithi156.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-09-30T22:18:41.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.171+0000 7fb6c930c700 1 -- 172.21.15.156:0/3258655079 >> v1:172.21.15.156:6816/126965 conn(0x7fb6a402f480 legacy=0x7fb6a4031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:41.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.171+0000 7fb6c930c700 1 -- 172.21.15.156:0/3258655079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6c409e950 msgr2=0x7fb6c4120ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:41.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.171+0000 7fb6c930c700 1 --2- 172.21.15.156:0/3258655079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6c409e950 0x7fb6c4120ac0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac000c00 tx=0x7fb6ac004750 comp rx=0 tx=0).stop 2023-09-30T22:18:41.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.172+0000 7fb6c930c700 1 -- 172.21.15.156:0/3258655079 shutdown_connections 2023-09-30T22:18:41.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.172+0000 7fb6c930c700 1 --2- 172.21.15.156:0/3258655079 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6c4138180 0x7fb6c41c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.172+0000 7fb6c930c700 1 --2- 172.21.15.156:0/3258655079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6c409e950 0x7fb6c4120ac0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.172+0000 7fb6c930c700 1 --2- 172.21.15.156:0/3258655079 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb6c409f260 0x7fb6c4121000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.172+0000 7fb6c930c700 1 -- 172.21.15.156:0/3258655079 >> 172.21.15.156:0/3258655079 conn(0x7fb6c40a4470 msgr2=0x7fb6c4136e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:41.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.172+0000 7fb6c930c700 1 -- 172.21.15.156:0/3258655079 shutdown_connections 2023-09-30T22:18:41.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.172+0000 7fb6c930c700 1 -- 172.21.15.156:0/3258655079 wait complete. 2023-09-30T22:18:41.184 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-09-30T22:18:41.184 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:18:41.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.305+0000 7fdc54b42700 1 Processor -- start 2023-09-30T22:18:41.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.305+0000 7fdc54b42700 1 -- start start 2023-09-30T22:18:41.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.305+0000 7fdc54b42700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc50133ad0 0x7fdc50133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:41.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.306+0000 7fdc54b42700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc501300a0 0x7fdc501304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:41.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.306+0000 7fdc54b42700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdc501309f0 0x7fdc5013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:41.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.306+0000 7fdc54b42700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc5006b2d0 con 0x7fdc501309f0 2023-09-30T22:18:41.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.306+0000 7fdc54b42700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc50133610 con 0x7fdc50133ad0 2023-09-30T22:18:41.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.306+0000 7fdc54b42700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5009a500 con 0x7fdc501300a0 2023-09-30T22:18:41.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.306+0000 7fdc4e59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc50133ad0 0x7fdc50133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:41.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.306+0000 7fdc4ed9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdc501309f0 0x7fdc5013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:41.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.306+0000 7fdc4dd9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc501300a0 0x7fdc501304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:41.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.306+0000 7fdc4ed9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdc501309f0 0x7fdc5013a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47838/0 (socket says 172.21.15.156:47838) 2023-09-30T22:18:41.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.306+0000 7fdc4e59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc50133ad0 0x7fdc50133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:60142/0 (socket says 172.21.15.156:60142) 2023-09-30T22:18:41.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.306+0000 7fdc4dd9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc501300a0 0x7fdc501304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45160/0 (socket says 172.21.15.156:45160) 2023-09-30T22:18:41.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.306+0000 7fdc4ed9d700 1 -- 172.21.15.156:0/138528823 learned_addr learned my addr 172.21.15.156:0/138528823 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:41.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.306+0000 7fdc4e59c700 1 -- 172.21.15.156:0/138528823 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc501300a0 msgr2=0x7fdc501304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:41.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.306+0000 7fdc4e59c700 1 --2- 172.21.15.156:0/138528823 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc501300a0 0x7fdc501304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.306+0000 7fdc4e59c700 1 -- 172.21.15.156:0/138528823 >> v2:172.21.15.156:3300/0 conn(0x7fdc501309f0 msgr2=0x7fdc5013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:41.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.306+0000 7fdc4e59c700 1 --2- 172.21.15.156:0/138528823 >> v2:172.21.15.156:3300/0 conn(0x7fdc501309f0 0x7fdc5013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.306+0000 7fdc4e59c700 1 -- 172.21.15.156:0/138528823 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc501338b0 con 0x7fdc50133ad0 2023-09-30T22:18:41.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.306+0000 7fdc4ed9d700 1 --2- 172.21.15.156:0/138528823 >> v2:172.21.15.156:3300/0 conn(0x7fdc501309f0 0x7fdc5013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:41.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.306+0000 7fdc4dd9b700 1 --2- 172.21.15.156:0/138528823 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc501300a0 0x7fdc501304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:41.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.306+0000 7fdc4e59c700 1 --2- 172.21.15.156:0/138528823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc50133ad0 0x7fdc50133ea0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdc44009840 tx=0x7fdc44009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75651cf2ad0c77e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:41.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.306+0000 7fdc4d59a700 1 -- 172.21.15.156:0/138528823 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc44011830 con 0x7fdc50133ad0 2023-09-30T22:18:41.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.306+0000 7fdc4d59a700 1 -- 172.21.15.156:0/138528823 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc44011990 con 0x7fdc50133ad0 2023-09-30T22:18:41.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.306+0000 7fdc4d59a700 1 -- 172.21.15.156:0/138528823 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc44011d20 con 0x7fdc50133ad0 2023-09-30T22:18:41.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.307+0000 7fdc54b42700 1 -- 172.21.15.156:0/138528823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc50133ad0 msgr2=0x7fdc50133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:41.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.307+0000 7fdc54b42700 1 --2- 172.21.15.156:0/138528823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc50133ad0 0x7fdc50133ea0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdc44009840 tx=0x7fdc44009b50 comp rx=0 tx=0).stop 2023-09-30T22:18:41.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.307+0000 7fdc54b42700 1 -- 172.21.15.156:0/138528823 shutdown_connections 2023-09-30T22:18:41.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.307+0000 7fdc54b42700 1 --2- 172.21.15.156:0/138528823 >> v2:172.21.15.156:3300/0 conn(0x7fdc501309f0 0x7fdc5013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.307+0000 7fdc54b42700 1 --2- 172.21.15.156:0/138528823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc50133ad0 0x7fdc50133ea0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.307+0000 7fdc54b42700 1 --2- 172.21.15.156:0/138528823 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc501300a0 0x7fdc501304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.307+0000 7fdc54b42700 1 -- 172.21.15.156:0/138528823 >> 172.21.15.156:0/138528823 conn(0x7fdc50099c40 msgr2=0x7fdc500a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:41.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.307+0000 7fdc54b42700 1 -- 172.21.15.156:0/138528823 shutdown_connections 2023-09-30T22:18:41.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.307+0000 7fdc54b42700 1 -- 172.21.15.156:0/138528823 wait complete. 2023-09-30T22:18:41.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.308+0000 7fdc54b42700 1 Processor -- start 2023-09-30T22:18:41.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.308+0000 7fdc54b42700 1 -- start start 2023-09-30T22:18:41.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.308+0000 7fdc54b42700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc501300a0 0x7fdc5011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:41.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.308+0000 7fdc54b42700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc501309f0 0x7fdc5011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:41.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.308+0000 7fdc54b42700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc50133ad0 0x7fdc5011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:41.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.309+0000 7fdc54b42700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc50120b30 con 0x7fdc501309f0 2023-09-30T22:18:41.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.309+0000 7fdc54b42700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5011f550 con 0x7fdc501300a0 2023-09-30T22:18:41.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.309+0000 7fdc54b42700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5012dd00 con 0x7fdc50133ad0 2023-09-30T22:18:41.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.309+0000 7fdc4e59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc501300a0 0x7fdc5011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:41.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.309+0000 7fdc4ed9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc50133ad0 0x7fdc5011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:41.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.309+0000 7fdc4dd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc501309f0 0x7fdc5011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:41.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.309+0000 7fdc4e59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc501300a0 0x7fdc5011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:60150/0 (socket says 172.21.15.156:60150) 2023-09-30T22:18:41.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.309+0000 7fdc4e59c700 1 -- 172.21.15.156:0/4022082351 learned_addr learned my addr 172.21.15.156:0/4022082351 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:41.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.309+0000 7fdc4ed9d700 1 -- 172.21.15.156:0/4022082351 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc501300a0 msgr2=0x7fdc5011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:41.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.309+0000 7fdc4ed9d700 1 --2- 172.21.15.156:0/4022082351 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc501300a0 0x7fdc5011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.309+0000 7fdc4ed9d700 1 -- 172.21.15.156:0/4022082351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc501309f0 msgr2=0x7fdc5011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:41.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.309+0000 7fdc4ed9d700 1 --2- 172.21.15.156:0/4022082351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc501309f0 0x7fdc5011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.309+0000 7fdc4ed9d700 1 -- 172.21.15.156:0/4022082351 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc400094a0 con 0x7fdc50133ad0 2023-09-30T22:18:41.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.309+0000 7fdc4ed9d700 1 --2- 172.21.15.156:0/4022082351 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc50133ad0 0x7fdc5011e4c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009db0 tx=0x7fdc4800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:41.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.309+0000 7fdc3effd700 1 -- 172.21.15.156:0/4022082351 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc48018070 con 0x7fdc50133ad0 2023-09-30T22:18:41.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.309+0000 7fdc54b42700 1 -- 172.21.15.156:0/4022082351 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc48009b30 con 0x7fdc50133ad0 2023-09-30T22:18:41.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.309+0000 7fdc3effd700 1 -- 172.21.15.156:0/4022082351 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4800f040 con 0x7fdc50133ad0 2023-09-30T22:18:41.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.309+0000 7fdc3effd700 1 -- 172.21.15.156:0/4022082351 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc48003c40 con 0x7fdc50133ad0 2023-09-30T22:18:41.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.309+0000 7fdc54b42700 1 -- 172.21.15.156:0/4022082351 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc440094a0 con 0x7fdc50133ad0 2023-09-30T22:18:41.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.310+0000 7fdc3effd700 1 -- 172.21.15.156:0/4022082351 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7fdc4800c880 con 0x7fdc50133ad0 2023-09-30T22:18:41.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.310+0000 7fdc3effd700 1 -- 172.21.15.156:0/4022082351 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fdc4803fb70 con 0x7fdc50133ad0 2023-09-30T22:18:41.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.310+0000 7fdc54b42700 1 -- 172.21.15.156:0/4022082351 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc5004f2a0 con 0x7fdc50133ad0 2023-09-30T22:18:41.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.315+0000 7fdc3effd700 1 -- 172.21.15.156:0/4022082351 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc48012340 con 0x7fdc50133ad0 2023-09-30T22:18:41.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.505+0000 7fdc54b42700 1 -- 172.21.15.156:0/4022082351 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc5011f040 con 0x7fdc50133ad0 2023-09-30T22:18:41.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.506+0000 7fdc3effd700 1 -- 172.21.15.156:0/4022082351 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+12943 (secure 0 0 0) 0x7fdc4801cbb0 con 0x7fdc50133ad0 2023-09-30T22:18:41.507 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:18:41.507 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":22,"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","created":"2023-09-30T22:16:15.239992+0000","modified":"2023-09-30T22:18:39.769833+0000","last_up_change":"2023-09-30T22:16:23.392557+0000","last_in_change":"2023-09-30T22:16:16.474206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:16:23.433906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:16:24.367795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:16:28.204677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:16:28.762804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ec2e78a-c61f-473a-bfcb-f956cffe4095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6812","nonce":118781}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6813","nonce":118781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6815","nonce":118781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6814","nonce":118781}]},"public_addr":"172.21.15.156:6812/118781","cluster_addr":"172.21.15.156:6813/118781","heartbeat_back_addr":"172.21.15.156:6815/118781","heartbeat_front_addr":"172.21.15.156:6814/118781","state":["exists","up"]},{"osd":1,"uuid":"b682e683-c15a-4bd9-8712-8af96454e9ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6803","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6805","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6807","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6806","nonce":118763}]},"public_addr":"172.21.15.156:6803/118763","cluster_addr":"172.21.15.156:6805/118763","heartbeat_back_addr":"172.21.15.156:6807/118763","heartbeat_front_addr":"172.21.15.156:6806/118763","state":["exists","up"]},{"osd":2,"uuid":"960dbaf0-2e0c-437e-9114-bc22ce522b26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6808","nonce":118788}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6809","nonce":118788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6811","nonce":118788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6810","nonce":118788}]},"public_addr":"172.21.15.156:6808/118788","cluster_addr":"172.21.15.156:6809/118788","heartbeat_back_addr":"172.21.15.156:6811/118788","heartbeat_front_addr":"172.21.15.156:6810/118788","state":["exists","up"]},{"osd":3,"uuid":"c1b19714-78b1-4869-8721-2f6352a64a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6800","nonce":118764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6801","nonce":118764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6804","nonce":118764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6802","nonce":118764}]},"public_addr":"172.21.15.156:6800/118764","cluster_addr":"172.21.15.156:6801/118764","heartbeat_back_addr":"172.21.15.156:6804/118764","heartbeat_front_addr":"172.21.15.156:6802/118764","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.663343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.827397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.806655+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.634746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.2","mappings":[{"from":3,"to":0}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.156:6816/118236":"2023-10-01T22:18:37.767496+0000","172.21.15.156:0/1464735255":"2023-10-01T22:18:37.767496+0000","172.21.15.156:0/2593263545":"2023-10-01T22:18:37.767496+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:18:41.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.508+0000 7fdc54b42700 1 -- 172.21.15.156:0/4022082351 >> v1:172.21.15.156:6816/126965 conn(0x7fdc3002f480 legacy=0x7fdc30031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:41.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.508+0000 7fdc54b42700 1 -- 172.21.15.156:0/4022082351 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc50133ad0 msgr2=0x7fdc5011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:41.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.508+0000 7fdc54b42700 1 --2- 172.21.15.156:0/4022082351 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc50133ad0 0x7fdc5011e4c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009db0 tx=0x7fdc4800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.508+0000 7fdc54b42700 1 -- 172.21.15.156:0/4022082351 shutdown_connections 2023-09-30T22:18:41.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.508+0000 7fdc54b42700 1 --2- 172.21.15.156:0/4022082351 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc50133ad0 0x7fdc5011e4c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.508+0000 7fdc54b42700 1 --2- 172.21.15.156:0/4022082351 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc501300a0 0x7fdc5011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.508+0000 7fdc54b42700 1 --2- 172.21.15.156:0/4022082351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc501309f0 0x7fdc5011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.508+0000 7fdc54b42700 1 -- 172.21.15.156:0/4022082351 >> 172.21.15.156:0/4022082351 conn(0x7fdc50099c40 msgr2=0x7fdc50131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:41.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.508+0000 7fdc54b42700 1 -- 172.21.15.156:0/4022082351 shutdown_connections 2023-09-30T22:18:41.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.508+0000 7fdc54b42700 1 -- 172.21.15.156:0/4022082351 wait complete. 2023-09-30T22:18:41.521 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:16:23.433906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:16:24.367795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:16:28.204677+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:16:28.762804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.059999942779541, 'score_stable': 1.059999942779541, 'optimal_score': 1, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T22:18:41.522 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:18:41.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.645+0000 7efd05cef700 1 Processor -- start 2023-09-30T22:18:41.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.645+0000 7efd05cef700 1 -- start start 2023-09-30T22:18:41.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.645+0000 7efd05cef700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efd00133a10 0x7efd00133de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:41.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.645+0000 7efd05cef700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7efd0006ea60 0x7efd0009de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:41.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.645+0000 7efd05cef700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd0009e3b0 0x7efd0009e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:41.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.646+0000 7efd05cef700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd00070020 con 0x7efd0006ea60 2023-09-30T22:18:41.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.646+0000 7efd05cef700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd00070990 con 0x7efd0009e3b0 2023-09-30T22:18:41.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.646+0000 7efd05cef700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd001335e0 con 0x7efd00133a10 2023-09-30T22:18:41.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.646+0000 7efcfeffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7efd0006ea60 0x7efd0009de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:41.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.646+0000 7efcff7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efd00133a10 0x7efd00133de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:41.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.646+0000 7efcfffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd0009e3b0 0x7efd0009e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:41.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.646+0000 7efcfeffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7efd0006ea60 0x7efd0009de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47860/0 (socket says 172.21.15.156:47860) 2023-09-30T22:18:41.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.646+0000 7efcfeffd700 1 -- 172.21.15.156:0/3220605151 learned_addr learned my addr 172.21.15.156:0/3220605151 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:41.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.646+0000 7efcfeffd700 1 -- 172.21.15.156:0/3220605151 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efd00133a10 msgr2=0x7efd00133de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:41.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.646+0000 7efcfeffd700 1 --2- 172.21.15.156:0/3220605151 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efd00133a10 0x7efd00133de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.646+0000 7efcfeffd700 1 -- 172.21.15.156:0/3220605151 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd0009e3b0 msgr2=0x7efd0009e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:41.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.646+0000 7efcfeffd700 1 --2- 172.21.15.156:0/3220605151 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd0009e3b0 0x7efd0009e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.646+0000 7efcfeffd700 1 -- 172.21.15.156:0/3220605151 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0006f430 con 0x7efd0006ea60 2023-09-30T22:18:41.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.646+0000 7efcfffff700 1 --2- 172.21.15.156:0/3220605151 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd0009e3b0 0x7efd0009e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:41.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.646+0000 7efcfeffd700 1 --2- 172.21.15.156:0/3220605151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd0006ea60 0x7efd0009de70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efcf00098f0 tx=0x7efcf0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4422a89d6e75dec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:41.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.646+0000 7efcfe7fc700 1 -- 172.21.15.156:0/3220605151 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf0011830 con 0x7efd0006ea60 2023-09-30T22:18:41.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.646+0000 7efcfe7fc700 1 -- 172.21.15.156:0/3220605151 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf0011990 con 0x7efd0006ea60 2023-09-30T22:18:41.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.646+0000 7efcfe7fc700 1 -- 172.21.15.156:0/3220605151 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf0011d20 con 0x7efd0006ea60 2023-09-30T22:18:41.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.647+0000 7efd05cef700 1 -- 172.21.15.156:0/3220605151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd0006ea60 msgr2=0x7efd0009de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:41.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.647+0000 7efd05cef700 1 --2- 172.21.15.156:0/3220605151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd0006ea60 0x7efd0009de70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efcf00098f0 tx=0x7efcf0009c00 comp rx=0 tx=0).stop 2023-09-30T22:18:41.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.647+0000 7efd05cef700 1 -- 172.21.15.156:0/3220605151 shutdown_connections 2023-09-30T22:18:41.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.647+0000 7efd05cef700 1 --2- 172.21.15.156:0/3220605151 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd0009e3b0 0x7efd0009e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.647+0000 7efd05cef700 1 --2- 172.21.15.156:0/3220605151 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efd00133a10 0x7efd00133de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.647+0000 7efd05cef700 1 --2- 172.21.15.156:0/3220605151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd0006ea60 0x7efd0009de70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.647+0000 7efd05cef700 1 -- 172.21.15.156:0/3220605151 >> 172.21.15.156:0/3220605151 conn(0x7efd0009f3f0 msgr2=0x7efd0009f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:41.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.647+0000 7efd05cef700 1 -- 172.21.15.156:0/3220605151 shutdown_connections 2023-09-30T22:18:41.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.647+0000 7efd05cef700 1 -- 172.21.15.156:0/3220605151 wait complete. 2023-09-30T22:18:41.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.648+0000 7efd05cef700 1 Processor -- start 2023-09-30T22:18:41.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.648+0000 7efd05cef700 1 -- start start 2023-09-30T22:18:41.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.648+0000 7efd05cef700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efd0006ea60 0x7efd0011b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:41.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.648+0000 7efd05cef700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd0009e3b0 0x7efd0011bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:41.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.648+0000 7efd05cef700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd00133a10 0x7efd0011c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:41.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.648+0000 7efd05cef700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0011f3b0 con 0x7efd0009e3b0 2023-09-30T22:18:41.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.648+0000 7efd05cef700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0011e6f0 con 0x7efd00133a10 2023-09-30T22:18:41.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.648+0000 7efd05cef700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd0011da80 con 0x7efd0006ea60 2023-09-30T22:18:41.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.648+0000 7efcfffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd00133a10 0x7efd0011c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:41.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.648+0000 7efcff7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efd0006ea60 0x7efd0011b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:41.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.649+0000 7efcfffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd00133a10 0x7efd0011c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:60164/0 (socket says 172.21.15.156:60164) 2023-09-30T22:18:41.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.649+0000 7efcfffff700 1 -- 172.21.15.156:0/442089861 learned_addr learned my addr 172.21.15.156:0/442089861 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:41.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.649+0000 7efcfeffd700 1 --2- 172.21.15.156:0/442089861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd0009e3b0 0x7efd0011bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:41.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.649+0000 7efcfeffd700 1 -- 172.21.15.156:0/442089861 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efd0006ea60 msgr2=0x7efd0011b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:41.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.649+0000 7efcfeffd700 1 --2- 172.21.15.156:0/442089861 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efd0006ea60 0x7efd0011b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.649+0000 7efcfeffd700 1 -- 172.21.15.156:0/442089861 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd00133a10 msgr2=0x7efd0011c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:41.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.649+0000 7efcfeffd700 1 --2- 172.21.15.156:0/442089861 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd00133a10 0x7efd0011c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.649+0000 7efcfeffd700 1 -- 172.21.15.156:0/442089861 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf8009a70 con 0x7efd0009e3b0 2023-09-30T22:18:41.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.649+0000 7efcfffff700 1 --2- 172.21.15.156:0/442089861 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd00133a10 0x7efd0011c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:41.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.649+0000 7efcff7fe700 1 --2- 172.21.15.156:0/442089861 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efd0006ea60 0x7efd0011b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:41.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.649+0000 7efcfeffd700 1 --2- 172.21.15.156:0/442089861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd0009e3b0 0x7efd0011bdd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efcf0016000 tx=0x7efcf0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:41.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.649+0000 7efce7fff700 1 -- 172.21.15.156:0/442089861 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf0004240 con 0x7efd0009e3b0 2023-09-30T22:18:41.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.649+0000 7efce7fff700 1 -- 172.21.15.156:0/442089861 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf001f070 con 0x7efd0009e3b0 2023-09-30T22:18:41.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.649+0000 7efd05cef700 1 -- 172.21.15.156:0/442089861 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf0009550 con 0x7efd0009e3b0 2023-09-30T22:18:41.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.649+0000 7efce7fff700 1 -- 172.21.15.156:0/442089861 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf00036a0 con 0x7efd0009e3b0 2023-09-30T22:18:41.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.649+0000 7efd05cef700 1 -- 172.21.15.156:0/442089861 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd0006f670 con 0x7efd0009e3b0 2023-09-30T22:18:41.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.650+0000 7efce7fff700 1 -- 172.21.15.156:0/442089861 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7efcf0021030 con 0x7efd0009e3b0 2023-09-30T22:18:41.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.650+0000 7efce7fff700 1 -- 172.21.15.156:0/442089861 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7efcf0040d90 con 0x7efd0009e3b0 2023-09-30T22:18:41.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.650+0000 7efd05cef700 1 -- 172.21.15.156:0/442089861 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd0004f2a0 con 0x7efd0009e3b0 2023-09-30T22:18:41.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.655+0000 7efce7fff700 1 -- 172.21.15.156:0/442089861 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efcf0015080 con 0x7efd0009e3b0 2023-09-30T22:18:41.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.841+0000 7efd05cef700 1 -- 172.21.15.156:0/442089861 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efd000a24b0 con 0x7efd0009e3b0 2023-09-30T22:18:41.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.842+0000 7efce7fff700 1 -- 172.21.15.156:0/442089861 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7efcf00239c0 con 0x7efd0009e3b0 2023-09-30T22:18:41.843 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 1 2023-09-30T22:18:41.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.844+0000 7efd05cef700 1 -- 172.21.15.156:0/442089861 >> v1:172.21.15.156:6816/126965 conn(0x7efcec02f480 legacy=0x7efcec031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:41.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.844+0000 7efd05cef700 1 -- 172.21.15.156:0/442089861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd0009e3b0 msgr2=0x7efd0011bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:41.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.844+0000 7efd05cef700 1 --2- 172.21.15.156:0/442089861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd0009e3b0 0x7efd0011bdd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efcf0016000 tx=0x7efcf0004750 comp rx=0 tx=0).stop 2023-09-30T22:18:41.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.844+0000 7efd05cef700 1 -- 172.21.15.156:0/442089861 shutdown_connections 2023-09-30T22:18:41.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.844+0000 7efd05cef700 1 --2- 172.21.15.156:0/442089861 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd00133a10 0x7efd0011c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.844+0000 7efd05cef700 1 --2- 172.21.15.156:0/442089861 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efd0006ea60 0x7efd0011b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.844+0000 7efd05cef700 1 --2- 172.21.15.156:0/442089861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd0009e3b0 0x7efd0011bdd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.844+0000 7efd05cef700 1 -- 172.21.15.156:0/442089861 >> 172.21.15.156:0/442089861 conn(0x7efd0009f3f0 msgr2=0x7efd00130780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:41.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.844+0000 7efd05cef700 1 -- 172.21.15.156:0/442089861 shutdown_connections 2023-09-30T22:18:41.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.844+0000 7efd05cef700 1 -- 172.21.15.156:0/442089861 wait complete. 2023-09-30T22:18:41.858 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:18:41.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.982+0000 7fe209208700 1 Processor -- start 2023-09-30T22:18:41.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.982+0000 7fe209208700 1 -- start start 2023-09-30T22:18:41.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.983+0000 7fe209208700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe20409e870 0x7fe20409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:41.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.983+0000 7fe209208700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe20409f180 0x7fe204133b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:41.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.983+0000 7fe209208700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe20409af40 con 0x7fe2041340c0 2023-09-30T22:18:41.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.983+0000 7fe209208700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe20406b990 con 0x7fe20409e870 2023-09-30T22:18:41.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.983+0000 7fe209208700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe20406bec0 con 0x7fe20409f180 2023-09-30T22:18:41.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.983+0000 7fe20259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe20409f180 0x7fe204133b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:41.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.983+0000 7fe202d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe20409e870 0x7fe20409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:41.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.983+0000 7fe20259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe20409f180 0x7fe204133b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45172/0 (socket says 172.21.15.156:45172) 2023-09-30T22:18:41.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.983+0000 7fe20359e700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe2041340c0 0x7fe20413ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:56860/0 (socket says 172.21.15.156:56860) 2023-09-30T22:18:41.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.983+0000 7fe20259c700 1 -- 172.21.15.156:0/3578474646 learned_addr learned my addr 172.21.15.156:0/3578474646 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:41.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.983+0000 7fe202d9d700 1 -- 172.21.15.156:0/3578474646 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe20409f180 msgr2=0x7fe204133b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:41.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.983+0000 7fe202d9d700 1 --2- 172.21.15.156:0/3578474646 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe20409f180 0x7fe204133b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.983+0000 7fe202d9d700 1 -- 172.21.15.156:0/3578474646 >> v1:172.21.15.156:6789/0 conn(0x7fe2041340c0 legacy=0x7fe20413ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:41.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.983+0000 7fe202d9d700 1 -- 172.21.15.156:0/3578474646 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2040a0870 con 0x7fe20409e870 2023-09-30T22:18:41.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.983+0000 7fe201d9b700 1 -- 172.21.15.156:0/3578474646 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1694412384 0 0) 0x7fe1fc001490 con 0x7fe2041340c0 2023-09-30T22:18:41.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.983+0000 7fe20259c700 1 --2- 172.21.15.156:0/3578474646 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe20409f180 0x7fe204133b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:41.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.983+0000 7fe202d9d700 1 --2- 172.21.15.156:0/3578474646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe20409e870 0x7fe20409ec40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8009820 tx=0x7fe1f8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad0bc50d0b5a8a3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:41.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.983+0000 7fe201d9b700 1 -- 172.21.15.156:0/3578474646 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8005e30 con 0x7fe20409e870 2023-09-30T22:18:41.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.983+0000 7fe201d9b700 1 -- 172.21.15.156:0/3578474646 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f8006030 con 0x7fe20409e870 2023-09-30T22:18:41.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.983+0000 7fe201d9b700 1 -- 172.21.15.156:0/3578474646 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f80063c0 con 0x7fe20409e870 2023-09-30T22:18:41.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.984+0000 7fe209208700 1 -- 172.21.15.156:0/3578474646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe20409e870 msgr2=0x7fe20409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:41.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.984+0000 7fe209208700 1 --2- 172.21.15.156:0/3578474646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe20409e870 0x7fe20409ec40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8009820 tx=0x7fe1f8009b30 comp rx=0 tx=0).stop 2023-09-30T22:18:41.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.984+0000 7fe209208700 1 -- 172.21.15.156:0/3578474646 shutdown_connections 2023-09-30T22:18:41.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.984+0000 7fe209208700 1 --2- 172.21.15.156:0/3578474646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe20409e870 0x7fe20409ec40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.984+0000 7fe209208700 1 --2- 172.21.15.156:0/3578474646 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe20409f180 0x7fe204133b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.984+0000 7fe209208700 1 -- 172.21.15.156:0/3578474646 >> 172.21.15.156:0/3578474646 conn(0x7fe2040a4390 msgr2=0x7fe2040a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:41.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.984+0000 7fe209208700 1 -- 172.21.15.156:0/3578474646 shutdown_connections 2023-09-30T22:18:41.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.984+0000 7fe209208700 1 -- 172.21.15.156:0/3578474646 wait complete. 2023-09-30T22:18:41.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.985+0000 7fe209208700 1 Processor -- start 2023-09-30T22:18:41.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.985+0000 7fe209208700 1 -- start start 2023-09-30T22:18:41.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.986+0000 7fe209208700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe20409e870 0x7fe20411ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:41.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.986+0000 7fe209208700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe20409f180 0x7fe20411ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:41.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.986+0000 7fe209208700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2041340c0 0x7fe20411f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:41.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.986+0000 7fe209208700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe204120600 con 0x7fe2041340c0 2023-09-30T22:18:41.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.986+0000 7fe209208700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2041334b0 con 0x7fe20409f180 2023-09-30T22:18:41.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.986+0000 7fe209208700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe204121ed0 con 0x7fe20409e870 2023-09-30T22:18:41.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.986+0000 7fe202d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe20409e870 0x7fe20411ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:41.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.986+0000 7fe20359e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2041340c0 0x7fe20411f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:41.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.986+0000 7fe202d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe20409e870 0x7fe20411ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45180/0 (socket says 172.21.15.156:45180) 2023-09-30T22:18:41.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.986+0000 7fe202d9d700 1 -- 172.21.15.156:0/1268672149 learned_addr learned my addr 172.21.15.156:0/1268672149 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:41.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.986+0000 7fe20259c700 1 --2- 172.21.15.156:0/1268672149 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe20409f180 0x7fe20411ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:41.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.986+0000 7fe20359e700 1 -- 172.21.15.156:0/1268672149 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe20409e870 msgr2=0x7fe20411ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:41.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.986+0000 7fe20359e700 1 --2- 172.21.15.156:0/1268672149 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe20409e870 0x7fe20411ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.986+0000 7fe20359e700 1 -- 172.21.15.156:0/1268672149 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe20409f180 msgr2=0x7fe20411ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:41.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.986+0000 7fe20359e700 1 --2- 172.21.15.156:0/1268672149 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe20409f180 0x7fe20411ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:41.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.986+0000 7fe20359e700 1 -- 172.21.15.156:0/1268672149 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f4009550 con 0x7fe2041340c0 2023-09-30T22:18:41.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.986+0000 7fe202d9d700 1 --2- 172.21.15.156:0/1268672149 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe20409e870 0x7fe20411ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:41.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.986+0000 7fe20359e700 1 --2- 172.21.15.156:0/1268672149 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2041340c0 0x7fe20411f4b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00cc10 tx=0x7fe1fc00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:41.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.986+0000 7fe1eb7fe700 1 -- 172.21.15.156:0/1268672149 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc00aaa0 con 0x7fe2041340c0 2023-09-30T22:18:41.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.986+0000 7fe1eb7fe700 1 -- 172.21.15.156:0/1268672149 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1fc00ac20 con 0x7fe2041340c0 2023-09-30T22:18:41.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.986+0000 7fe209208700 1 -- 172.21.15.156:0/1268672149 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f8009430 con 0x7fe2041340c0 2023-09-30T22:18:41.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.986+0000 7fe1eb7fe700 1 -- 172.21.15.156:0/1268672149 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc0070d0 con 0x7fe2041340c0 2023-09-30T22:18:41.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.986+0000 7fe209208700 1 -- 172.21.15.156:0/1268672149 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe204122190 con 0x7fe2041340c0 2023-09-30T22:18:41.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.987+0000 7fe1eb7fe700 1 -- 172.21.15.156:0/1268672149 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7fe1fc007230 con 0x7fe2041340c0 2023-09-30T22:18:41.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.987+0000 7fe1eb7fe700 1 -- 172.21.15.156:0/1268672149 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fe1fc03f5f0 con 0x7fe2041340c0 2023-09-30T22:18:41.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.987+0000 7fe209208700 1 -- 172.21.15.156:0/1268672149 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe20409af40 con 0x7fe2041340c0 2023-09-30T22:18:41.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:41.992+0000 7fe1eb7fe700 1 -- 172.21.15.156:0/1268672149 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe20409af40 con 0x7fe2041340c0 2023-09-30T22:18:42.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.178+0000 7fe209208700 1 -- 172.21.15.156:0/1268672149 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe20409af40 con 0x7fe2041340c0 2023-09-30T22:18:42.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.178+0000 7fe1eb7fe700 1 -- 172.21.15.156:0/1268672149 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe20409af40 con 0x7fe2041340c0 2023-09-30T22:18:42.238 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 8 2023-09-30T22:18:42.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.180+0000 7fe209208700 1 -- 172.21.15.156:0/1268672149 >> v1:172.21.15.156:6816/126965 conn(0x7fe1f002f480 legacy=0x7fe1f0031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:42.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.181+0000 7fe209208700 1 -- 172.21.15.156:0/1268672149 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2041340c0 msgr2=0x7fe20411f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:42.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.181+0000 7fe209208700 1 --2- 172.21.15.156:0/1268672149 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2041340c0 0x7fe20411f4b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00cc10 tx=0x7fe1fc00cf20 comp rx=0 tx=0).stop 2023-09-30T22:18:42.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.181+0000 7fe209208700 1 -- 172.21.15.156:0/1268672149 shutdown_connections 2023-09-30T22:18:42.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.181+0000 7fe209208700 1 --2- 172.21.15.156:0/1268672149 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2041340c0 0x7fe20411f4b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:42.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.181+0000 7fe209208700 1 --2- 172.21.15.156:0/1268672149 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe20409e870 0x7fe20411ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:42.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.181+0000 7fe209208700 1 --2- 172.21.15.156:0/1268672149 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe20409f180 0x7fe20411ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:42.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.181+0000 7fe209208700 1 -- 172.21.15.156:0/1268672149 >> 172.21.15.156:0/1268672149 conn(0x7fe2040a4390 msgr2=0x7fe2040a1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:42.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.181+0000 7fe209208700 1 -- 172.21.15.156:0/1268672149 shutdown_connections 2023-09-30T22:18:42.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.181+0000 7fe209208700 1 -- 172.21.15.156:0/1268672149 wait complete. 2023-09-30T22:18:42.241 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:18:42.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.365+0000 7fd45c88e700 1 Processor -- start 2023-09-30T22:18:42.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.365+0000 7fd45c88e700 1 -- start start 2023-09-30T22:18:42.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.366+0000 7fd45c88e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd458131730 0x7fd458131b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:42.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.366+0000 7fd45c88e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd45809ed40 0x7fd458071410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:42.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.366+0000 7fd45c88e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd458132040 0x7fd458071950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:42.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.366+0000 7fd45c88e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd458131340 con 0x7fd458132040 2023-09-30T22:18:42.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.366+0000 7fd45c88e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45806e690 con 0x7fd45809ed40 2023-09-30T22:18:42.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.366+0000 7fd45c88e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd45809b3d0 con 0x7fd458131730 2023-09-30T22:18:42.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.366+0000 7fd456d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd458132040 0x7fd458071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:42.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.366+0000 7fd455d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd45809ed40 0x7fd458071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:42.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.366+0000 7fd45659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd458131730 0x7fd458131b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:42.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.366+0000 7fd45659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd458131730 0x7fd458131b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45190/0 (socket says 172.21.15.156:45190) 2023-09-30T22:18:42.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.366+0000 7fd455d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd45809ed40 0x7fd458071410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:60194/0 (socket says 172.21.15.156:60194) 2023-09-30T22:18:42.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.366+0000 7fd456d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd458132040 0x7fd458071950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47912/0 (socket says 172.21.15.156:47912) 2023-09-30T22:18:42.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.366+0000 7fd45659c700 1 -- 172.21.15.156:0/1751071993 learned_addr learned my addr 172.21.15.156:0/1751071993 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:42.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.366+0000 7fd45659c700 1 -- 172.21.15.156:0/1751071993 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd45809ed40 msgr2=0x7fd458071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:42.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.366+0000 7fd45659c700 1 --2- 172.21.15.156:0/1751071993 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd45809ed40 0x7fd458071410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:42.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.366+0000 7fd45659c700 1 -- 172.21.15.156:0/1751071993 >> v2:172.21.15.156:3300/0 conn(0x7fd458132040 msgr2=0x7fd458071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:42.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.366+0000 7fd45659c700 1 --2- 172.21.15.156:0/1751071993 >> v2:172.21.15.156:3300/0 conn(0x7fd458132040 0x7fd458071950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:42.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.366+0000 7fd45659c700 1 -- 172.21.15.156:0/1751071993 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45809a530 con 0x7fd458131730 2023-09-30T22:18:42.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.366+0000 7fd455d9b700 1 --2- 172.21.15.156:0/1751071993 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd45809ed40 0x7fd458071410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:42.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.366+0000 7fd456d9d700 1 --2- 172.21.15.156:0/1751071993 >> v2:172.21.15.156:3300/0 conn(0x7fd458132040 0x7fd458071950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:42.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.366+0000 7fd45659c700 1 --2- 172.21.15.156:0/1751071993 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd458131730 0x7fd458131b00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd44c0098f0 tx=0x7fd44c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9e987197da74ee server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:42.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.366+0000 7fd45559a700 1 -- 172.21.15.156:0/1751071993 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c011830 con 0x7fd458131730 2023-09-30T22:18:42.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.366+0000 7fd45559a700 1 -- 172.21.15.156:0/1751071993 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44c011990 con 0x7fd458131730 2023-09-30T22:18:42.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.366+0000 7fd45559a700 1 -- 172.21.15.156:0/1751071993 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c011d20 con 0x7fd458131730 2023-09-30T22:18:42.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.367+0000 7fd45c88e700 1 -- 172.21.15.156:0/1751071993 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd458131730 msgr2=0x7fd458131b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:42.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.367+0000 7fd45c88e700 1 --2- 172.21.15.156:0/1751071993 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd458131730 0x7fd458131b00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd44c0098f0 tx=0x7fd44c009c00 comp rx=0 tx=0).stop 2023-09-30T22:18:42.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.367+0000 7fd45c88e700 1 -- 172.21.15.156:0/1751071993 shutdown_connections 2023-09-30T22:18:42.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.367+0000 7fd45c88e700 1 --2- 172.21.15.156:0/1751071993 >> v2:172.21.15.156:3300/0 conn(0x7fd458132040 0x7fd458071950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:42.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.367+0000 7fd45c88e700 1 --2- 172.21.15.156:0/1751071993 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd458131730 0x7fd458131b00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:42.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.367+0000 7fd45c88e700 1 --2- 172.21.15.156:0/1751071993 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd45809ed40 0x7fd458071410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:42.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.367+0000 7fd45c88e700 1 -- 172.21.15.156:0/1751071993 >> 172.21.15.156:0/1751071993 conn(0x7fd45809f3f0 msgr2=0x7fd45809f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:42.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.367+0000 7fd45c88e700 1 -- 172.21.15.156:0/1751071993 shutdown_connections 2023-09-30T22:18:42.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.367+0000 7fd45c88e700 1 -- 172.21.15.156:0/1751071993 wait complete. 2023-09-30T22:18:42.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.368+0000 7fd45c88e700 1 Processor -- start 2023-09-30T22:18:42.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.368+0000 7fd45c88e700 1 -- start start 2023-09-30T22:18:42.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.369+0000 7fd45c88e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd45809ed40 0x7fd45811b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:42.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.369+0000 7fd45c88e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd458131730 0x7fd45811bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:42.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.369+0000 7fd45c88e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd458132040 0x7fd45811c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:42.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.369+0000 7fd45c88e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45811d380 con 0x7fd45809ed40 2023-09-30T22:18:42.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.369+0000 7fd45c88e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45811d9a0 con 0x7fd458131730 2023-09-30T22:18:42.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.369+0000 7fd45c88e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd45811e5d0 con 0x7fd458132040 2023-09-30T22:18:42.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.369+0000 7fd45659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd45809ed40 0x7fd45811b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:42.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.369+0000 7fd456d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd458132040 0x7fd45811c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:42.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.369+0000 7fd45659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd45809ed40 0x7fd45811b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47920/0 (socket says 172.21.15.156:47920) 2023-09-30T22:18:42.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.369+0000 7fd45659c700 1 -- 172.21.15.156:0/2032063544 learned_addr learned my addr 172.21.15.156:0/2032063544 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:42.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.369+0000 7fd455d9b700 1 --2- 172.21.15.156:0/2032063544 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd458131730 0x7fd45811bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:42.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.369+0000 7fd45659c700 1 -- 172.21.15.156:0/2032063544 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd458132040 msgr2=0x7fd45811c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:42.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.369+0000 7fd45659c700 1 --2- 172.21.15.156:0/2032063544 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd458132040 0x7fd45811c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:42.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.369+0000 7fd45659c700 1 -- 172.21.15.156:0/2032063544 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd458131730 msgr2=0x7fd45811bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:42.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.369+0000 7fd45659c700 1 --2- 172.21.15.156:0/2032063544 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd458131730 0x7fd45811bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:42.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.369+0000 7fd45659c700 1 -- 172.21.15.156:0/2032063544 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44800d940 con 0x7fd45809ed40 2023-09-30T22:18:42.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.369+0000 7fd455d9b700 1 --2- 172.21.15.156:0/2032063544 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd458131730 0x7fd45811bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:42.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.369+0000 7fd45659c700 1 --2- 172.21.15.156:0/2032063544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd45809ed40 0x7fd45811b7c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd44c009c40 tx=0x7fd44c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:42.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.369+0000 7fd446ffd700 1 -- 172.21.15.156:0/2032063544 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c004240 con 0x7fd45809ed40 2023-09-30T22:18:42.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.369+0000 7fd446ffd700 1 -- 172.21.15.156:0/2032063544 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44c01f070 con 0x7fd45809ed40 2023-09-30T22:18:42.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.369+0000 7fd45c88e700 1 -- 172.21.15.156:0/2032063544 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd450009a70 con 0x7fd45809ed40 2023-09-30T22:18:42.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.369+0000 7fd446ffd700 1 -- 172.21.15.156:0/2032063544 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c0045c0 con 0x7fd45809ed40 2023-09-30T22:18:42.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.369+0000 7fd45c88e700 1 -- 172.21.15.156:0/2032063544 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd44c009550 con 0x7fd45809ed40 2023-09-30T22:18:42.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.370+0000 7fd446ffd700 1 -- 172.21.15.156:0/2032063544 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7fd44c021030 con 0x7fd45809ed40 2023-09-30T22:18:42.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.370+0000 7fd446ffd700 1 -- 172.21.15.156:0/2032063544 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fd44c040a30 con 0x7fd45809ed40 2023-09-30T22:18:42.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.370+0000 7fd45c88e700 1 -- 172.21.15.156:0/2032063544 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd45809de60 con 0x7fd45809ed40 2023-09-30T22:18:42.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.375+0000 7fd446ffd700 1 -- 172.21.15.156:0/2032063544 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd44c015020 con 0x7fd45809ed40 2023-09-30T22:18:42.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.559+0000 7fd45c88e700 1 -- 172.21.15.156:0/2032063544 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd458099eb0 con 0x7fd45809ed40 2023-09-30T22:18:42.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.559+0000 7fd446ffd700 1 -- 172.21.15.156:0/2032063544 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd44c01a450 con 0x7fd45809ed40 2023-09-30T22:18:42.560 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 32 2023-09-30T22:18:42.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.561+0000 7fd45c88e700 1 -- 172.21.15.156:0/2032063544 >> v1:172.21.15.156:6816/126965 conn(0x7fd43802f4b0 legacy=0x7fd438031960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:42.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.561+0000 7fd45c88e700 1 -- 172.21.15.156:0/2032063544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd45809ed40 msgr2=0x7fd45811b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:42.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.561+0000 7fd45c88e700 1 --2- 172.21.15.156:0/2032063544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd45809ed40 0x7fd45811b7c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd44c009c40 tx=0x7fd44c004750 comp rx=0 tx=0).stop 2023-09-30T22:18:42.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.561+0000 7fd45c88e700 1 -- 172.21.15.156:0/2032063544 shutdown_connections 2023-09-30T22:18:42.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.561+0000 7fd45c88e700 1 --2- 172.21.15.156:0/2032063544 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd458132040 0x7fd45811c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:42.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.561+0000 7fd45c88e700 1 --2- 172.21.15.156:0/2032063544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd45809ed40 0x7fd45811b7c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:42.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.561+0000 7fd45c88e700 1 --2- 172.21.15.156:0/2032063544 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd458131730 0x7fd45811bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:42.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.561+0000 7fd45c88e700 1 -- 172.21.15.156:0/2032063544 >> 172.21.15.156:0/2032063544 conn(0x7fd45809f3f0 msgr2=0x7fd458071730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:42.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.561+0000 7fd45c88e700 1 -- 172.21.15.156:0/2032063544 shutdown_connections 2023-09-30T22:18:42.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.561+0000 7fd45c88e700 1 -- 172.21.15.156:0/2032063544 wait complete. 2023-09-30T22:18:42.573 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:18:42.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.696+0000 7f774cbc2700 1 Processor -- start 2023-09-30T22:18:42.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.696+0000 7f774cbc2700 1 -- start start 2023-09-30T22:18:42.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.697+0000 7f774cbc2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f774809d780 0x7f774809db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:42.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.697+0000 7f774cbc2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f774809ad70 0x7f774809e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:42.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.697+0000 7f774cbc2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7748133a80 0x7f7748133f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:42.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.697+0000 7f774cbc2700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f774809a590 con 0x7f7748133a80 2023-09-30T22:18:42.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.697+0000 7f774cbc2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f774809e5d0 con 0x7f774809ad70 2023-09-30T22:18:42.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.697+0000 7f774cbc2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f774806b450 con 0x7f774809d780 2023-09-30T22:18:42.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.697+0000 7f7745d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f774809ad70 0x7f774809e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:42.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.697+0000 7f7746d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7748133a80 0x7f7748133f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:42.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.697+0000 7f7746d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7748133a80 0x7f7748133f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47936/0 (socket says 172.21.15.156:47936) 2023-09-30T22:18:42.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.697+0000 7f7745d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f774809ad70 0x7f774809e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:60202/0 (socket says 172.21.15.156:60202) 2023-09-30T22:18:42.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.697+0000 7f7746d9d700 1 -- 172.21.15.156:0/371239668 learned_addr learned my addr 172.21.15.156:0/371239668 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:42.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.697+0000 7f774659c700 1 --2- 172.21.15.156:0/371239668 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f774809d780 0x7f774809db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:42.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.698+0000 7f7746d9d700 1 -- 172.21.15.156:0/371239668 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f774809d780 msgr2=0x7f774809db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:42.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.698+0000 7f7746d9d700 1 --2- 172.21.15.156:0/371239668 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f774809d780 0x7f774809db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:42.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.698+0000 7f7746d9d700 1 -- 172.21.15.156:0/371239668 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f774809ad70 msgr2=0x7f774809e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:42.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.698+0000 7f7746d9d700 1 --2- 172.21.15.156:0/371239668 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f774809ad70 0x7f774809e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:42.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.698+0000 7f7746d9d700 1 -- 172.21.15.156:0/371239668 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f774806a9e0 con 0x7f7748133a80 2023-09-30T22:18:42.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.698+0000 7f774659c700 1 --2- 172.21.15.156:0/371239668 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f774809d780 0x7f774809db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:42.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.698+0000 7f7746d9d700 1 --2- 172.21.15.156:0/371239668 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7748133a80 0x7f7748133f20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7740009e50 tx=0x7f774000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b63fca2753cd82 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:42.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.698+0000 7f774559a700 1 -- 172.21.15.156:0/371239668 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774000e070 con 0x7f7748133a80 2023-09-30T22:18:42.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.698+0000 7f774559a700 1 -- 172.21.15.156:0/371239668 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774000b910 con 0x7f7748133a80 2023-09-30T22:18:42.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.698+0000 7f774559a700 1 -- 172.21.15.156:0/371239668 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774000bcc0 con 0x7f7748133a80 2023-09-30T22:18:42.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.698+0000 7f774cbc2700 1 -- 172.21.15.156:0/371239668 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7748133a80 msgr2=0x7f7748133f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:42.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.698+0000 7f774cbc2700 1 --2- 172.21.15.156:0/371239668 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7748133a80 0x7f7748133f20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7740009e50 tx=0x7f774000b330 comp rx=0 tx=0).stop 2023-09-30T22:18:42.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.698+0000 7f774cbc2700 1 -- 172.21.15.156:0/371239668 shutdown_connections 2023-09-30T22:18:42.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.698+0000 7f774cbc2700 1 --2- 172.21.15.156:0/371239668 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7748133a80 0x7f7748133f20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:42.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.698+0000 7f774cbc2700 1 --2- 172.21.15.156:0/371239668 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f774809d780 0x7f774809db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:42.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.698+0000 7f774cbc2700 1 --2- 172.21.15.156:0/371239668 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f774809ad70 0x7f774809e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:42.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.698+0000 7f774cbc2700 1 -- 172.21.15.156:0/371239668 >> 172.21.15.156:0/371239668 conn(0x7f774809f980 msgr2=0x7f774809fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:42.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.699+0000 7f774cbc2700 1 -- 172.21.15.156:0/371239668 shutdown_connections 2023-09-30T22:18:42.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.699+0000 7f774cbc2700 1 -- 172.21.15.156:0/371239668 wait complete. 2023-09-30T22:18:42.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.700+0000 7f774cbc2700 1 Processor -- start 2023-09-30T22:18:42.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.700+0000 7f774cbc2700 1 -- start start 2023-09-30T22:18:42.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.700+0000 7f774cbc2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f774809ad70 0x7f774811e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:42.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.700+0000 7f774cbc2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f774809d780 0x7f774811e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:42.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.700+0000 7f774cbc2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7748133a80 0x7f774811ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:42.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.700+0000 7f774cbc2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77481203f0 con 0x7f774809ad70 2023-09-30T22:18:42.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.700+0000 7f774cbc2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77481214b0 con 0x7f774809d780 2023-09-30T22:18:42.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.700+0000 7f774cbc2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f774809c710 con 0x7f7748133a80 2023-09-30T22:18:42.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.700+0000 7f774659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f774809ad70 0x7f774811e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:42.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.700+0000 7f774659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f774809ad70 0x7f774811e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47942/0 (socket says 172.21.15.156:47942) 2023-09-30T22:18:42.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.700+0000 7f7745d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f774809d780 0x7f774811e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:42.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.700+0000 7f774659c700 1 -- 172.21.15.156:0/274551448 learned_addr learned my addr 172.21.15.156:0/274551448 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:42.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.700+0000 7f7746d9d700 1 --2- 172.21.15.156:0/274551448 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7748133a80 0x7f774811ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:42.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.700+0000 7f7745d9b700 1 -- 172.21.15.156:0/274551448 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7748133a80 msgr2=0x7f774811ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:42.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.700+0000 7f7745d9b700 1 --2- 172.21.15.156:0/274551448 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7748133a80 0x7f774811ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:42.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.700+0000 7f7745d9b700 1 -- 172.21.15.156:0/274551448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f774809ad70 msgr2=0x7f774811e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:42.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.700+0000 7f7745d9b700 1 --2- 172.21.15.156:0/274551448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f774809ad70 0x7f774811e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:42.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.700+0000 7f7745d9b700 1 -- 172.21.15.156:0/274551448 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773c0094a0 con 0x7f774809d780 2023-09-30T22:18:42.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.700+0000 7f774659c700 1 --2- 172.21.15.156:0/274551448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f774809ad70 0x7f774811e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:42.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.701+0000 7f7745d9b700 1 --2- 172.21.15.156:0/274551448 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f774809d780 0x7f774811e7d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f773800e840 tx=0x7f773800eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:42.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.701+0000 7f7736ffd700 1 -- 172.21.15.156:0/274551448 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7738013680 con 0x7f774809d780 2023-09-30T22:18:42.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.701+0000 7f7736ffd700 1 -- 172.21.15.156:0/274551448 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77380137e0 con 0x7f774809d780 2023-09-30T22:18:42.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.701+0000 7f774cbc2700 1 -- 172.21.15.156:0/274551448 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7740009b30 con 0x7f774809d780 2023-09-30T22:18:42.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.701+0000 7f7736ffd700 1 -- 172.21.15.156:0/274551448 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7738013b70 con 0x7f774809d780 2023-09-30T22:18:42.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.701+0000 7f774cbc2700 1 -- 172.21.15.156:0/274551448 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f774811fe10 con 0x7f774809d780 2023-09-30T22:18:42.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.701+0000 7f7736ffd700 1 -- 172.21.15.156:0/274551448 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f7738013cd0 con 0x7f774809d780 2023-09-30T22:18:42.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.702+0000 7f7736ffd700 1 -- 172.21.15.156:0/274551448 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f773803f980 con 0x7f774809d780 2023-09-30T22:18:42.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.702+0000 7f774cbc2700 1 -- 172.21.15.156:0/274551448 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7748070070 con 0x7f774809d780 2023-09-30T22:18:42.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.707+0000 7f7736ffd700 1 -- 172.21.15.156:0/274551448 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7738017080 con 0x7f774809d780 2023-09-30T22:18:42.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.792+0000 7f7736ffd700 1 -- 172.21.15.156:0/274551448 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f77380128f0 con 0x7f774809d780 2023-09-30T22:18:42.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.894+0000 7f774cbc2700 1 -- 172.21.15.156:0/274551448 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f774804f2a0 con 0x7f774809d780 2023-09-30T22:18:42.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.895+0000 7f7736ffd700 1 -- 172.21.15.156:0/274551448 <== mon.1 v2:172.21.15.156:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7738021020 con 0x7f774809d780 2023-09-30T22:18:42.895 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 64 2023-09-30T22:18:42.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.897+0000 7f774cbc2700 1 -- 172.21.15.156:0/274551448 >> v1:172.21.15.156:6816/126965 conn(0x7f772802f480 legacy=0x7f7728031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:42.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.897+0000 7f774cbc2700 1 -- 172.21.15.156:0/274551448 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f774809d780 msgr2=0x7f774811e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:42.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.897+0000 7f774cbc2700 1 --2- 172.21.15.156:0/274551448 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f774809d780 0x7f774811e7d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f773800e840 tx=0x7f773800eb50 comp rx=0 tx=0).stop 2023-09-30T22:18:42.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.897+0000 7f774cbc2700 1 -- 172.21.15.156:0/274551448 shutdown_connections 2023-09-30T22:18:42.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.897+0000 7f774cbc2700 1 --2- 172.21.15.156:0/274551448 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7748133a80 0x7f774811ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:42.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.897+0000 7f774cbc2700 1 --2- 172.21.15.156:0/274551448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f774809ad70 0x7f774811e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:42.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.897+0000 7f774cbc2700 1 --2- 172.21.15.156:0/274551448 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f774809d780 0x7f774811e7d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:42.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.897+0000 7f774cbc2700 1 -- 172.21.15.156:0/274551448 >> 172.21.15.156:0/274551448 conn(0x7f774809f980 msgr2=0x7f7748133260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:42.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.897+0000 7f774cbc2700 1 -- 172.21.15.156:0/274551448 shutdown_connections 2023-09-30T22:18:42.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:42.897+0000 7f774cbc2700 1 -- 172.21.15.156:0/274551448 wait complete. 2023-09-30T22:18:42.909 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:18:43.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.030+0000 7fbc42b67700 1 Processor -- start 2023-09-30T22:18:43.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.030+0000 7fbc42b67700 1 -- start start 2023-09-30T22:18:43.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.030+0000 7fbc42b67700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbc3c133ad0 0x7fbc3c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:43.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.030+0000 7fbc42b67700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc3c130bc0 0x7fbc3c13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:43.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.030+0000 7fbc42b67700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc3c06b2d0 con 0x7fbc3c1300a0 2023-09-30T22:18:43.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.030+0000 7fbc42b67700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3c133610 con 0x7fbc3c133ad0 2023-09-30T22:18:43.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.030+0000 7fbc42b67700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c09a500 con 0x7fbc3c130bc0 2023-09-30T22:18:43.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.030+0000 7fbc41104700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc3c130bc0 0x7fbc3c13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:43.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.030+0000 7fbc40903700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbc3c133ad0 0x7fbc3c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:43.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.030+0000 7fbc41104700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc3c130bc0 0x7fbc3c13b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:60208/0 (socket says 172.21.15.156:60208) 2023-09-30T22:18:43.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.030+0000 7fbc41104700 1 -- 172.21.15.156:0/941350370 learned_addr learned my addr 172.21.15.156:0/941350370 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:43.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.030+0000 7fbc3bfff700 1 --1- 172.21.15.156:0/941350370 >> v1:172.21.15.156:6789/0 conn(0x7fbc3c1300a0 0x7fbc3c1304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:56876/0 (socket says 172.21.15.156:56876) 2023-09-30T22:18:43.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.031+0000 7fbc41104700 1 -- 172.21.15.156:0/941350370 >> v2:172.21.15.156:3300/0 conn(0x7fbc3c133ad0 msgr2=0x7fbc3c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:43.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.031+0000 7fbc41104700 1 --2- 172.21.15.156:0/941350370 >> v2:172.21.15.156:3300/0 conn(0x7fbc3c133ad0 0x7fbc3c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:43.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.031+0000 7fbc41104700 1 -- 172.21.15.156:0/941350370 >> v1:172.21.15.156:6789/0 conn(0x7fbc3c1300a0 legacy=0x7fbc3c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:43.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.031+0000 7fbc41104700 1 -- 172.21.15.156:0/941350370 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c1338b0 con 0x7fbc3c130bc0 2023-09-30T22:18:43.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.031+0000 7fbc40903700 1 --2- 172.21.15.156:0/941350370 >> v2:172.21.15.156:3300/0 conn(0x7fbc3c133ad0 0x7fbc3c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:43.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.031+0000 7fbc41104700 1 --2- 172.21.15.156:0/941350370 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc3c130bc0 0x7fbc3c13b990 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbc34009e50 tx=0x7fbc3400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52f1efc1c7a2fd0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:43.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.031+0000 7fbc3b7fe700 1 -- 172.21.15.156:0/941350370 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3400e070 con 0x7fbc3c130bc0 2023-09-30T22:18:43.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.031+0000 7fbc3b7fe700 1 -- 172.21.15.156:0/941350370 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3400b910 con 0x7fbc3c130bc0 2023-09-30T22:18:43.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.031+0000 7fbc3b7fe700 1 -- 172.21.15.156:0/941350370 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3400bcc0 con 0x7fbc3c130bc0 2023-09-30T22:18:43.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.032+0000 7fbc42b67700 1 -- 172.21.15.156:0/941350370 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc3c130bc0 msgr2=0x7fbc3c13b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:43.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.032+0000 7fbc42b67700 1 --2- 172.21.15.156:0/941350370 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc3c130bc0 0x7fbc3c13b990 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbc34009e50 tx=0x7fbc3400b330 comp rx=0 tx=0).stop 2023-09-30T22:18:43.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.032+0000 7fbc42b67700 1 -- 172.21.15.156:0/941350370 shutdown_connections 2023-09-30T22:18:43.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.032+0000 7fbc42b67700 1 --2- 172.21.15.156:0/941350370 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc3c130bc0 0x7fbc3c13b990 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:43.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.032+0000 7fbc42b67700 1 --2- 172.21.15.156:0/941350370 >> v2:172.21.15.156:3300/0 conn(0x7fbc3c133ad0 0x7fbc3c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:43.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.032+0000 7fbc42b67700 1 -- 172.21.15.156:0/941350370 >> 172.21.15.156:0/941350370 conn(0x7fbc3c099c40 msgr2=0x7fbc3c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:43.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.032+0000 7fbc42b67700 1 -- 172.21.15.156:0/941350370 shutdown_connections 2023-09-30T22:18:43.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.032+0000 7fbc42b67700 1 -- 172.21.15.156:0/941350370 wait complete. 2023-09-30T22:18:43.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.032+0000 7fbc42b67700 1 Processor -- start 2023-09-30T22:18:43.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.033+0000 7fbc42b67700 1 -- start start 2023-09-30T22:18:43.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.033+0000 7fbc42b67700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc3c1300a0 0x7fbc3c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:43.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.033+0000 7fbc42b67700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbc3c130bc0 0x7fbc3c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:43.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.033+0000 7fbc42b67700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc3c133ad0 0x7fbc3c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:43.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.033+0000 7fbc42b67700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c12d8f0 con 0x7fbc3c133ad0 2023-09-30T22:18:43.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.033+0000 7fbc42b67700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c11ffa0 con 0x7fbc3c1300a0 2023-09-30T22:18:43.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.033+0000 7fbc42b67700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c12dd00 con 0x7fbc3c130bc0 2023-09-30T22:18:43.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.033+0000 7fbc40903700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc3c1300a0 0x7fbc3c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:43.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.033+0000 7fbc41104700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc3c133ad0 0x7fbc3c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:43.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.033+0000 7fbc41104700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc3c133ad0 0x7fbc3c11e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47972/0 (socket says 172.21.15.156:47972) 2023-09-30T22:18:43.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.033+0000 7fbc40903700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc3c1300a0 0x7fbc3c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:60224/0 (socket says 172.21.15.156:60224) 2023-09-30T22:18:43.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.033+0000 7fbc41104700 1 -- 172.21.15.156:0/4008618435 learned_addr learned my addr 172.21.15.156:0/4008618435 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:43.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.033+0000 7fbc3bfff700 1 --2- 172.21.15.156:0/4008618435 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbc3c130bc0 0x7fbc3c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:43.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.034+0000 7fbc41104700 1 -- 172.21.15.156:0/4008618435 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbc3c130bc0 msgr2=0x7fbc3c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:43.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.034+0000 7fbc41104700 1 --2- 172.21.15.156:0/4008618435 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbc3c130bc0 0x7fbc3c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:43.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.034+0000 7fbc41104700 1 -- 172.21.15.156:0/4008618435 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc3c1300a0 msgr2=0x7fbc3c11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:43.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.034+0000 7fbc41104700 1 --2- 172.21.15.156:0/4008618435 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc3c1300a0 0x7fbc3c11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:43.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.034+0000 7fbc41104700 1 -- 172.21.15.156:0/4008618435 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc300094a0 con 0x7fbc3c133ad0 2023-09-30T22:18:43.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.034+0000 7fbc40903700 1 --2- 172.21.15.156:0/4008618435 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc3c1300a0 0x7fbc3c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:43.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.034+0000 7fbc41104700 1 --2- 172.21.15.156:0/4008618435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc3c133ad0 0x7fbc3c11e4c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c09a640 tx=0x7fbc34004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:43.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.034+0000 7fbc397fa700 1 -- 172.21.15.156:0/4008618435 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc34004800 con 0x7fbc3c133ad0 2023-09-30T22:18:43.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.034+0000 7fbc397fa700 1 -- 172.21.15.156:0/4008618435 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc34004960 con 0x7fbc3c133ad0 2023-09-30T22:18:43.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.034+0000 7fbc42b67700 1 -- 172.21.15.156:0/4008618435 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc34009b30 con 0x7fbc3c133ad0 2023-09-30T22:18:43.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.034+0000 7fbc397fa700 1 -- 172.21.15.156:0/4008618435 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3401c680 con 0x7fbc3c133ad0 2023-09-30T22:18:43.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.034+0000 7fbc42b67700 1 -- 172.21.15.156:0/4008618435 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc3c11f2e0 con 0x7fbc3c133ad0 2023-09-30T22:18:43.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.035+0000 7fbc397fa700 1 -- 172.21.15.156:0/4008618435 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fbc3401c7e0 con 0x7fbc3c133ad0 2023-09-30T22:18:43.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.035+0000 7fbc397fa700 1 -- 172.21.15.156:0/4008618435 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fbc340417d0 con 0x7fbc3c133ad0 2023-09-30T22:18:43.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.035+0000 7fbc42b67700 1 -- 172.21.15.156:0/4008618435 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc3c04f2a0 con 0x7fbc3c133ad0 2023-09-30T22:18:43.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.040+0000 7fbc397fa700 1 -- 172.21.15.156:0/4008618435 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbc340257d0 con 0x7fbc3c133ad0 2023-09-30T22:18:43.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.261+0000 7fbc42b67700 1 -- 172.21.15.156:0/4008618435 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc3c06c3b0 con 0x7fbc3c133ad0 2023-09-30T22:18:43.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.261+0000 7fbc397fa700 1 -- 172.21.15.156:0/4008618435 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2317 (secure 0 0 0) 0x7fbc3402db40 con 0x7fbc3c133ad0 2023-09-30T22:18:43.262 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:18:43.262 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:16:29.792703+0000","modified":"2023-09-30T22:16:54.002618+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4206},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4206":{"gid":4206,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6817/3817969673","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6817","nonce":3817969673}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T22:18:43.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.263+0000 7fbc42b67700 1 -- 172.21.15.156:0/4008618435 >> v1:172.21.15.156:6816/126965 conn(0x7fbc2002f540 legacy=0x7fbc200319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:43.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.263+0000 7fbc42b67700 1 -- 172.21.15.156:0/4008618435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc3c133ad0 msgr2=0x7fbc3c11e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:43.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.263+0000 7fbc42b67700 1 --2- 172.21.15.156:0/4008618435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc3c133ad0 0x7fbc3c11e4c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c09a640 tx=0x7fbc34004ad0 comp rx=0 tx=0).stop 2023-09-30T22:18:43.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.263+0000 7fbc42b67700 1 -- 172.21.15.156:0/4008618435 shutdown_connections 2023-09-30T22:18:43.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.263+0000 7fbc42b67700 1 --2- 172.21.15.156:0/4008618435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc3c133ad0 0x7fbc3c11e4c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:43.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.263+0000 7fbc42b67700 1 --2- 172.21.15.156:0/4008618435 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc3c1300a0 0x7fbc3c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:43.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.263+0000 7fbc42b67700 1 --2- 172.21.15.156:0/4008618435 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbc3c130bc0 0x7fbc3c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:43.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.263+0000 7fbc42b67700 1 -- 172.21.15.156:0/4008618435 >> 172.21.15.156:0/4008618435 conn(0x7fbc3c099c40 msgr2=0x7fbc3c12e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:43.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.263+0000 7fbc42b67700 1 -- 172.21.15.156:0/4008618435 shutdown_connections 2023-09-30T22:18:43.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.263+0000 7fbc42b67700 1 -- 172.21.15.156:0/4008618435 wait complete. 2023-09-30T22:18:43.265 INFO:teuthology.orchestra.run.smithi156.stderr:dumped fsmap epoch 7 2023-09-30T22:18:43.276 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:18:43.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.396+0000 7f68b1269700 1 Processor -- start 2023-09-30T22:18:43.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.397+0000 7f68b1269700 1 -- start start 2023-09-30T22:18:43.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.397+0000 7f68b1269700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f68ac1309f0 0x7f68ac130dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:43.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.397+0000 7f68b1269700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68ac09d8f0 0x7f68ac09dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:43.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.397+0000 7f68b1269700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68ac09c1f0 con 0x7f68ac09e280 2023-09-30T22:18:43.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.397+0000 7f68b1269700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68ac06dc20 con 0x7f68ac1309f0 2023-09-30T22:18:43.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.397+0000 7f68b1269700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac09b1f0 con 0x7f68ac09d8f0 2023-09-30T22:18:43.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.397+0000 7f68aaffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f68ac1309f0 0x7f68ac130dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:43.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.397+0000 7f68aa7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68ac09d8f0 0x7f68ac09dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:43.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.397+0000 7f68ab7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f68ac09e280 0x7f68ac137750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:56878/0 (socket says 172.21.15.156:56878) 2023-09-30T22:18:43.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.397+0000 7f68ab7fe700 1 -- 172.21.15.156:0/956871797 learned_addr learned my addr 172.21.15.156:0/956871797 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:18:43.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.397+0000 7f68a9ffb700 1 -- 172.21.15.156:0/956871797 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1203586322 0 0) 0x7f68ac09c1f0 con 0x7f68ac09e280 2023-09-30T22:18:43.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.397+0000 7f68aaffd700 1 -- 172.21.15.156:0/956871797 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68ac09d8f0 msgr2=0x7f68ac09dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:43.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.397+0000 7f68aaffd700 1 --2- 172.21.15.156:0/956871797 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68ac09d8f0 0x7f68ac09dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:43.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.397+0000 7f68aaffd700 1 -- 172.21.15.156:0/956871797 >> v1:172.21.15.156:6789/0 conn(0x7f68ac09e280 legacy=0x7f68ac137750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:43.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.397+0000 7f68aaffd700 1 -- 172.21.15.156:0/956871797 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ac09e700 con 0x7f68ac1309f0 2023-09-30T22:18:43.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.397+0000 7f68aa7fc700 1 --2- 172.21.15.156:0/956871797 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68ac09d8f0 0x7f68ac09dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:43.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.398+0000 7f68aaffd700 1 --2- 172.21.15.156:0/956871797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68ac1309f0 0x7f68ac130dc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f68a0009820 tx=0x7f68a0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0c9ebe1ce4df22 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:43.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.398+0000 7f68a9ffb700 1 -- 172.21.15.156:0/956871797 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a0005e30 con 0x7f68ac1309f0 2023-09-30T22:18:43.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.398+0000 7f68a9ffb700 1 -- 172.21.15.156:0/956871797 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a0006030 con 0x7f68ac1309f0 2023-09-30T22:18:43.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.398+0000 7f68a9ffb700 1 -- 172.21.15.156:0/956871797 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a00063c0 con 0x7f68ac1309f0 2023-09-30T22:18:43.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.398+0000 7f68b1269700 1 -- 172.21.15.156:0/956871797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68ac1309f0 msgr2=0x7f68ac130dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:43.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.398+0000 7f68b1269700 1 --2- 172.21.15.156:0/956871797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68ac1309f0 0x7f68ac130dc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f68a0009820 tx=0x7f68a0009b30 comp rx=0 tx=0).stop 2023-09-30T22:18:43.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.398+0000 7f68b1269700 1 -- 172.21.15.156:0/956871797 shutdown_connections 2023-09-30T22:18:43.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.398+0000 7f68b1269700 1 --2- 172.21.15.156:0/956871797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68ac1309f0 0x7f68ac130dc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:43.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.398+0000 7f68b1269700 1 --2- 172.21.15.156:0/956871797 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68ac09d8f0 0x7f68ac09dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:43.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.398+0000 7f68b1269700 1 -- 172.21.15.156:0/956871797 >> 172.21.15.156:0/956871797 conn(0x7f68ac0a2b30 msgr2=0x7f68ac09e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:43.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.398+0000 7f68b1269700 1 -- 172.21.15.156:0/956871797 shutdown_connections 2023-09-30T22:18:43.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.398+0000 7f68b1269700 1 -- 172.21.15.156:0/956871797 wait complete. 2023-09-30T22:18:43.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.399+0000 7f68b1269700 1 Processor -- start 2023-09-30T22:18:43.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.399+0000 7f68b1269700 1 -- start start 2023-09-30T22:18:43.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.400+0000 7f68b1269700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68ac09d8f0 0x7f68ac126fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:43.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.400+0000 7f68b1269700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68ac09e280 0x7f68ac1274e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:43.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.400+0000 7f68b1269700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f68ac1309f0 0x7f68ac127a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:43.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.400+0000 7f68b1269700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac1291c0 con 0x7f68ac09e280 2023-09-30T22:18:43.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.400+0000 7f68b1269700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac128550 con 0x7f68ac09d8f0 2023-09-30T22:18:43.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.400+0000 7f68b1269700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac128740 con 0x7f68ac1309f0 2023-09-30T22:18:43.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.400+0000 7f68aaffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68ac09d8f0 0x7f68ac126fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:43.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.400+0000 7f68aa7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68ac09e280 0x7f68ac1274e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:43.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.400+0000 7f68aaffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68ac09d8f0 0x7f68ac126fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:60242/0 (socket says 172.21.15.156:60242) 2023-09-30T22:18:43.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.400+0000 7f68aa7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68ac09e280 0x7f68ac1274e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47990/0 (socket says 172.21.15.156:47990) 2023-09-30T22:18:43.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.400+0000 7f68aaffd700 1 -- 172.21.15.156:0/2587093875 learned_addr learned my addr 172.21.15.156:0/2587093875 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:43.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.400+0000 7f68ab7fe700 1 --2- 172.21.15.156:0/2587093875 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f68ac1309f0 0x7f68ac127a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:43.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.400+0000 7f68aaffd700 1 -- 172.21.15.156:0/2587093875 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f68ac1309f0 msgr2=0x7f68ac127a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:43.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.400+0000 7f68aaffd700 1 --2- 172.21.15.156:0/2587093875 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f68ac1309f0 0x7f68ac127a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:43.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.400+0000 7f68aaffd700 1 -- 172.21.15.156:0/2587093875 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68ac09e280 msgr2=0x7f68ac1274e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:43.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.400+0000 7f68aaffd700 1 --2- 172.21.15.156:0/2587093875 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68ac09e280 0x7f68ac1274e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:43.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.400+0000 7f68aaffd700 1 -- 172.21.15.156:0/2587093875 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689c00b740 con 0x7f68ac09d8f0 2023-09-30T22:18:43.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.400+0000 7f68aaffd700 1 --2- 172.21.15.156:0/2587093875 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68ac09d8f0 0x7f68ac126fa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f68ac09c380 tx=0x7f68a0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:43.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.401+0000 7f68937fe700 1 -- 172.21.15.156:0/2587093875 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a0004240 con 0x7f68ac09d8f0 2023-09-30T22:18:43.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.401+0000 7f68937fe700 1 -- 172.21.15.156:0/2587093875 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a00043a0 con 0x7f68ac09d8f0 2023-09-30T22:18:43.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.401+0000 7f68b1269700 1 -- 172.21.15.156:0/2587093875 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a0009430 con 0x7f68ac09d8f0 2023-09-30T22:18:43.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.401+0000 7f68937fe700 1 -- 172.21.15.156:0/2587093875 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a0006910 con 0x7f68ac09d8f0 2023-09-30T22:18:43.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.401+0000 7f68b1269700 1 -- 172.21.15.156:0/2587093875 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68ac0a0520 con 0x7f68ac09d8f0 2023-09-30T22:18:43.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.401+0000 7f68937fe700 1 -- 172.21.15.156:0/2587093875 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f68a0022070 con 0x7f68ac09d8f0 2023-09-30T22:18:43.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.401+0000 7f68937fe700 1 -- 172.21.15.156:0/2587093875 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f68a00411e0 con 0x7f68ac09d8f0 2023-09-30T22:18:43.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.401+0000 7f68b1269700 1 -- 172.21.15.156:0/2587093875 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68ac09b430 con 0x7f68ac09d8f0 2023-09-30T22:18:43.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.406+0000 7f68937fe700 1 -- 172.21.15.156:0/2587093875 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68a002e9c0 con 0x7f68ac09d8f0 2023-09-30T22:18:43.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.590+0000 7f68b1269700 1 -- 172.21.15.156:0/2587093875 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68ac04f2a0 con 0x7f68ac09d8f0 2023-09-30T22:18:43.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.591+0000 7f68937fe700 1 -- 172.21.15.156:0/2587093875 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+12943 (secure 0 0 0) 0x7f68a002e3f0 con 0x7f68ac09d8f0 2023-09-30T22:18:43.592 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:18:43.592 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":22,"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","created":"2023-09-30T22:16:15.239992+0000","modified":"2023-09-30T22:18:39.769833+0000","last_up_change":"2023-09-30T22:16:23.392557+0000","last_in_change":"2023-09-30T22:16:16.474206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:16:23.433906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:16:24.367795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:16:28.204677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:16:28.762804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ec2e78a-c61f-473a-bfcb-f956cffe4095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6812","nonce":118781}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6813","nonce":118781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6815","nonce":118781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6814","nonce":118781}]},"public_addr":"172.21.15.156:6812/118781","cluster_addr":"172.21.15.156:6813/118781","heartbeat_back_addr":"172.21.15.156:6815/118781","heartbeat_front_addr":"172.21.15.156:6814/118781","state":["exists","up"]},{"osd":1,"uuid":"b682e683-c15a-4bd9-8712-8af96454e9ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6803","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6805","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6807","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6806","nonce":118763}]},"public_addr":"172.21.15.156:6803/118763","cluster_addr":"172.21.15.156:6805/118763","heartbeat_back_addr":"172.21.15.156:6807/118763","heartbeat_front_addr":"172.21.15.156:6806/118763","state":["exists","up"]},{"osd":2,"uuid":"960dbaf0-2e0c-437e-9114-bc22ce522b26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6808","nonce":118788}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6809","nonce":118788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6811","nonce":118788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6810","nonce":118788}]},"public_addr":"172.21.15.156:6808/118788","cluster_addr":"172.21.15.156:6809/118788","heartbeat_back_addr":"172.21.15.156:6811/118788","heartbeat_front_addr":"172.21.15.156:6810/118788","state":["exists","up"]},{"osd":3,"uuid":"c1b19714-78b1-4869-8721-2f6352a64a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6800","nonce":118764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6801","nonce":118764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6804","nonce":118764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6802","nonce":118764}]},"public_addr":"172.21.15.156:6800/118764","cluster_addr":"172.21.15.156:6801/118764","heartbeat_back_addr":"172.21.15.156:6804/118764","heartbeat_front_addr":"172.21.15.156:6802/118764","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.663343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.827397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.806655+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.634746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.2","mappings":[{"from":3,"to":0}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.156:6816/118236":"2023-10-01T22:18:37.767496+0000","172.21.15.156:0/1464735255":"2023-10-01T22:18:37.767496+0000","172.21.15.156:0/2593263545":"2023-10-01T22:18:37.767496+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:18:43.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.593+0000 7f68b1269700 1 -- 172.21.15.156:0/2587093875 >> v1:172.21.15.156:6816/126965 conn(0x7f689802f510 legacy=0x7f68980319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:43.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.593+0000 7f68b1269700 1 -- 172.21.15.156:0/2587093875 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68ac09d8f0 msgr2=0x7f68ac126fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:43.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.593+0000 7f68b1269700 1 --2- 172.21.15.156:0/2587093875 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68ac09d8f0 0x7f68ac126fa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f68ac09c380 tx=0x7f68a0004750 comp rx=0 tx=0).stop 2023-09-30T22:18:43.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.593+0000 7f68b1269700 1 -- 172.21.15.156:0/2587093875 shutdown_connections 2023-09-30T22:18:43.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.593+0000 7f68b1269700 1 --2- 172.21.15.156:0/2587093875 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f68ac1309f0 0x7f68ac127a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:43.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.593+0000 7f68b1269700 1 --2- 172.21.15.156:0/2587093875 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68ac09d8f0 0x7f68ac126fa0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:43.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.593+0000 7f68b1269700 1 --2- 172.21.15.156:0/2587093875 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68ac09e280 0x7f68ac1274e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:43.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.593+0000 7f68b1269700 1 -- 172.21.15.156:0/2587093875 >> 172.21.15.156:0/2587093875 conn(0x7f68ac0a2b30 msgr2=0x7f68ac0988b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:43.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.593+0000 7f68b1269700 1 -- 172.21.15.156:0/2587093875 shutdown_connections 2023-09-30T22:18:43.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.593+0000 7f68b1269700 1 -- 172.21.15.156:0/2587093875 wait complete. 2023-09-30T22:18:43.606 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:16:23.433906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:16:24.367795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:16:28.204677+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:16:28.762804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.059999942779541, 'score_stable': 1.059999942779541, 'optimal_score': 1, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T22:18:43.607 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:18:43.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.730+0000 7f8438b2e700 1 Processor -- start 2023-09-30T22:18:43.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.730+0000 7f8438b2e700 1 -- start start 2023-09-30T22:18:43.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.731+0000 7f8438b2e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f843409d780 0x7f843409db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:43.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.731+0000 7f8438b2e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f843409e090 0x7f8434134190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:43.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.731+0000 7f8438b2e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f843409a590 con 0x7f843409ad70 2023-09-30T22:18:43.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.731+0000 7f8438b2e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843406b450 con 0x7f843409e090 2023-09-30T22:18:43.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.731+0000 7f8438b2e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f843406a9e0 con 0x7f843409d780 2023-09-30T22:18:43.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.731+0000 7f8432d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f843409e090 0x7f8434134190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:43.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.731+0000 7f843259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f843409d780 0x7f843409db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:43.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.731+0000 7f8432d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f843409e090 0x7f8434134190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47998/0 (socket says 172.21.15.156:47998) 2023-09-30T22:18:43.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.731+0000 7f8432d9d700 1 -- 172.21.15.156:0/3136900270 learned_addr learned my addr 172.21.15.156:0/3136900270 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:43.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.731+0000 7f843259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f843409d780 0x7f843409db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45254/0 (socket says 172.21.15.156:45254) 2023-09-30T22:18:43.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.731+0000 7f843259c700 1 -- 172.21.15.156:0/3136900270 >> v2:172.21.15.156:3300/0 conn(0x7f843409e090 msgr2=0x7f8434134190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:43.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.731+0000 7f843259c700 1 --2- 172.21.15.156:0/3136900270 >> v2:172.21.15.156:3300/0 conn(0x7f843409e090 0x7f8434134190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:43.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.731+0000 7f843259c700 1 -- 172.21.15.156:0/3136900270 >> v1:172.21.15.156:6789/0 conn(0x7f843409ad70 legacy=0x7f8434133a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:43.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.731+0000 7f843259c700 1 -- 172.21.15.156:0/3136900270 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843409e4d0 con 0x7f843409d780 2023-09-30T22:18:43.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.731+0000 7f8432d9d700 1 --2- 172.21.15.156:0/3136900270 >> v2:172.21.15.156:3300/0 conn(0x7f843409e090 0x7f8434134190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:43.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.731+0000 7f843259c700 1 --2- 172.21.15.156:0/3136900270 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f843409d780 0x7f843409db50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8428009840 tx=0x7f8428009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18acbecf8793b171 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:43.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.731+0000 7f843159a700 1 -- 172.21.15.156:0/3136900270 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8428011830 con 0x7f843409d780 2023-09-30T22:18:43.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.731+0000 7f843159a700 1 -- 172.21.15.156:0/3136900270 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8428011990 con 0x7f843409d780 2023-09-30T22:18:43.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.731+0000 7f843159a700 1 -- 172.21.15.156:0/3136900270 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8428011d20 con 0x7f843409d780 2023-09-30T22:18:43.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.732+0000 7f8438b2e700 1 -- 172.21.15.156:0/3136900270 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f843409d780 msgr2=0x7f843409db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:43.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.732+0000 7f8438b2e700 1 --2- 172.21.15.156:0/3136900270 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f843409d780 0x7f843409db50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8428009840 tx=0x7f8428009b50 comp rx=0 tx=0).stop 2023-09-30T22:18:43.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.732+0000 7f8438b2e700 1 -- 172.21.15.156:0/3136900270 shutdown_connections 2023-09-30T22:18:43.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.732+0000 7f8438b2e700 1 --2- 172.21.15.156:0/3136900270 >> v2:172.21.15.156:3300/0 conn(0x7f843409e090 0x7f8434134190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:43.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.732+0000 7f8438b2e700 1 --2- 172.21.15.156:0/3136900270 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f843409d780 0x7f843409db50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:43.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.732+0000 7f8438b2e700 1 -- 172.21.15.156:0/3136900270 >> 172.21.15.156:0/3136900270 conn(0x7f843409f980 msgr2=0x7f843409fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:43.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.732+0000 7f8438b2e700 1 -- 172.21.15.156:0/3136900270 shutdown_connections 2023-09-30T22:18:43.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.732+0000 7f8438b2e700 1 -- 172.21.15.156:0/3136900270 wait complete. 2023-09-30T22:18:43.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.733+0000 7f8438b2e700 1 Processor -- start 2023-09-30T22:18:43.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.733+0000 7f8438b2e700 1 -- start start 2023-09-30T22:18:43.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.734+0000 7f8438b2e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f843409ad70 0x7f84341224c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:43.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.734+0000 7f8438b2e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f843409d780 0x7f8434122a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:43.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.734+0000 7f8438b2e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f843409e090 0x7f8434122f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:43.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.734+0000 7f8438b2e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84340a1f20 con 0x7f843409e090 2023-09-30T22:18:43.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.734+0000 7f8438b2e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8434124920 con 0x7f843409d780 2023-09-30T22:18:43.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.734+0000 7f8438b2e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f843409c710 con 0x7f843409ad70 2023-09-30T22:18:43.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.734+0000 7f8432d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f843409e090 0x7f8434122f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:43.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.734+0000 7f8431d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f843409d780 0x7f8434122a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:43.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.734+0000 7f8432d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f843409e090 0x7f8434122f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48014/0 (socket says 172.21.15.156:48014) 2023-09-30T22:18:43.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.734+0000 7f843259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f843409ad70 0x7f84341224c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:43.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.734+0000 7f8432d9d700 1 -- 172.21.15.156:0/4118442998 learned_addr learned my addr 172.21.15.156:0/4118442998 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:43.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.734+0000 7f8432d9d700 1 -- 172.21.15.156:0/4118442998 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f843409ad70 msgr2=0x7f84341224c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:43.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.734+0000 7f8432d9d700 1 --2- 172.21.15.156:0/4118442998 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f843409ad70 0x7f84341224c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:43.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.734+0000 7f8432d9d700 1 -- 172.21.15.156:0/4118442998 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f843409d780 msgr2=0x7f8434122a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:43.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.734+0000 7f8432d9d700 1 --2- 172.21.15.156:0/4118442998 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f843409d780 0x7f8434122a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:43.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.734+0000 7f8432d9d700 1 -- 172.21.15.156:0/4118442998 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842c009b30 con 0x7f843409e090 2023-09-30T22:18:43.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.734+0000 7f8431d9b700 1 --2- 172.21.15.156:0/4118442998 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f843409d780 0x7f8434122a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:43.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.734+0000 7f843259c700 1 --2- 172.21.15.156:0/4118442998 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f843409ad70 0x7f84341224c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:43.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.734+0000 7f8432d9d700 1 --2- 172.21.15.156:0/4118442998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f843409e090 0x7f8434122f40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f842c009f10 tx=0x7f842c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:43.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.734+0000 7f8422ffd700 1 -- 172.21.15.156:0/4118442998 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c018070 con 0x7f843409e090 2023-09-30T22:18:43.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.734+0000 7f8422ffd700 1 -- 172.21.15.156:0/4118442998 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842c00f040 con 0x7f843409e090 2023-09-30T22:18:43.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.734+0000 7f8422ffd700 1 -- 172.21.15.156:0/4118442998 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c003c40 con 0x7f843409e090 2023-09-30T22:18:43.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.734+0000 7f8438b2e700 1 -- 172.21.15.156:0/4118442998 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84280094a0 con 0x7f843409e090 2023-09-30T22:18:43.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.734+0000 7f8438b2e700 1 -- 172.21.15.156:0/4118442998 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8434125770 con 0x7f843409e090 2023-09-30T22:18:43.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.735+0000 7f8422ffd700 1 -- 172.21.15.156:0/4118442998 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f842c00c940 con 0x7f843409e090 2023-09-30T22:18:43.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.735+0000 7f8422ffd700 1 -- 172.21.15.156:0/4118442998 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f842c03fda0 con 0x7f843409e090 2023-09-30T22:18:43.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.735+0000 7f8438b2e700 1 -- 172.21.15.156:0/4118442998 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84341260e0 con 0x7f843409e090 2023-09-30T22:18:43.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.740+0000 7f8422ffd700 1 -- 172.21.15.156:0/4118442998 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f842c014480 con 0x7f843409e090 2023-09-30T22:18:43.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.928+0000 7f8438b2e700 1 -- 172.21.15.156:0/4118442998 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f843404f2a0 con 0x7f843409e090 2023-09-30T22:18:43.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.928+0000 7f8422ffd700 1 -- 172.21.15.156:0/4118442998 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f842c01cbb0 con 0x7f843409e090 2023-09-30T22:18:43.929 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 1 2023-09-30T22:18:43.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.930+0000 7f8438b2e700 1 -- 172.21.15.156:0/4118442998 >> v1:172.21.15.156:6816/126965 conn(0x7f841402f510 legacy=0x7f84140319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:43.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.930+0000 7f8438b2e700 1 -- 172.21.15.156:0/4118442998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f843409e090 msgr2=0x7f8434122f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:43.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.930+0000 7f8438b2e700 1 --2- 172.21.15.156:0/4118442998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f843409e090 0x7f8434122f40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f842c009f10 tx=0x7f842c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:18:43.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.930+0000 7f8438b2e700 1 -- 172.21.15.156:0/4118442998 shutdown_connections 2023-09-30T22:18:43.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.930+0000 7f8438b2e700 1 --2- 172.21.15.156:0/4118442998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f843409e090 0x7f8434122f40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:43.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.930+0000 7f8438b2e700 1 --2- 172.21.15.156:0/4118442998 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f843409ad70 0x7f84341224c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:43.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.930+0000 7f8438b2e700 1 --2- 172.21.15.156:0/4118442998 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f843409d780 0x7f8434122a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:43.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.930+0000 7f8438b2e700 1 -- 172.21.15.156:0/4118442998 >> 172.21.15.156:0/4118442998 conn(0x7f843409f980 msgr2=0x7f843406f330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:43.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.930+0000 7f8438b2e700 1 -- 172.21.15.156:0/4118442998 shutdown_connections 2023-09-30T22:18:43.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:43.930+0000 7f8438b2e700 1 -- 172.21.15.156:0/4118442998 wait complete. 2023-09-30T22:18:43.943 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:18:44.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.066+0000 7f6e41798700 1 Processor -- start 2023-09-30T22:18:44.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.066+0000 7f6e41798700 1 -- start start 2023-09-30T22:18:44.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.066+0000 7f6e41798700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e3c0a35f0 0x7f6e3c136a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:44.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.066+0000 7f6e41798700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e3c0a2970 0x7f6e3c138fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:44.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.066+0000 7f6e41798700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e3c0a2f50 con 0x7f6e3c0a1e90 2023-09-30T22:18:44.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.066+0000 7f6e41798700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c09e490 con 0x7f6e3c0a2970 2023-09-30T22:18:44.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.066+0000 7f6e41798700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c09ca80 con 0x7f6e3c0a35f0 2023-09-30T22:18:44.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.067+0000 7f6e3a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e3c0a35f0 0x7f6e3c136a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:44.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.067+0000 7f6e3b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e3c0a2970 0x7f6e3c138fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:44.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.067+0000 7f6e3a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e3c0a35f0 0x7f6e3c136a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45264/0 (socket says 172.21.15.156:45264) 2023-09-30T22:18:44.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.067+0000 7f6e3affd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6e3c0a1e90 0x7f6e3c0a2260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:56898/0 (socket says 172.21.15.156:56898) 2023-09-30T22:18:44.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.067+0000 7f6e3a7fc700 1 -- 172.21.15.156:0/3313130439 learned_addr learned my addr 172.21.15.156:0/3313130439 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:44.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.067+0000 7f6e39ffb700 1 -- 172.21.15.156:0/3313130439 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406347766 0 0) 0x7f6e3c0a2f50 con 0x7f6e3c0a1e90 2023-09-30T22:18:44.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.067+0000 7f6e3a7fc700 1 -- 172.21.15.156:0/3313130439 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e3c0a2970 msgr2=0x7f6e3c138fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:44.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.067+0000 7f6e3a7fc700 1 --2- 172.21.15.156:0/3313130439 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e3c0a2970 0x7f6e3c138fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:44.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.067+0000 7f6e3a7fc700 1 -- 172.21.15.156:0/3313130439 >> v1:172.21.15.156:6789/0 conn(0x7f6e3c0a1e90 legacy=0x7f6e3c0a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:44.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.067+0000 7f6e3a7fc700 1 -- 172.21.15.156:0/3313130439 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3c0a3170 con 0x7f6e3c0a35f0 2023-09-30T22:18:44.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.067+0000 7f6e3b7fe700 1 --2- 172.21.15.156:0/3313130439 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e3c0a2970 0x7f6e3c138fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:44.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.067+0000 7f6e3a7fc700 1 --2- 172.21.15.156:0/3313130439 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e3c0a35f0 0x7f6e3c136a60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c009920 tx=0x7f6e2c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b468b8073c73ceea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:44.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.067+0000 7f6e39ffb700 1 -- 172.21.15.156:0/3313130439 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c011830 con 0x7f6e3c0a35f0 2023-09-30T22:18:44.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.067+0000 7f6e39ffb700 1 -- 172.21.15.156:0/3313130439 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2c011990 con 0x7f6e3c0a35f0 2023-09-30T22:18:44.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.067+0000 7f6e39ffb700 1 -- 172.21.15.156:0/3313130439 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c011d20 con 0x7f6e3c0a35f0 2023-09-30T22:18:44.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.068+0000 7f6e41798700 1 -- 172.21.15.156:0/3313130439 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e3c0a35f0 msgr2=0x7f6e3c136a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:44.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.068+0000 7f6e41798700 1 --2- 172.21.15.156:0/3313130439 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e3c0a35f0 0x7f6e3c136a60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c009920 tx=0x7f6e2c009c30 comp rx=0 tx=0).stop 2023-09-30T22:18:44.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.068+0000 7f6e41798700 1 -- 172.21.15.156:0/3313130439 shutdown_connections 2023-09-30T22:18:44.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.068+0000 7f6e41798700 1 --2- 172.21.15.156:0/3313130439 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e3c0a2970 0x7f6e3c138fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:44.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.068+0000 7f6e41798700 1 --2- 172.21.15.156:0/3313130439 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e3c0a35f0 0x7f6e3c136a60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:44.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.068+0000 7f6e41798700 1 -- 172.21.15.156:0/3313130439 >> 172.21.15.156:0/3313130439 conn(0x7f6e3c0a43d0 msgr2=0x7f6e3c0a47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:44.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.068+0000 7f6e41798700 1 -- 172.21.15.156:0/3313130439 shutdown_connections 2023-09-30T22:18:44.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.068+0000 7f6e41798700 1 -- 172.21.15.156:0/3313130439 wait complete. 2023-09-30T22:18:44.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.069+0000 7f6e41798700 1 Processor -- start 2023-09-30T22:18:44.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.069+0000 7f6e41798700 1 -- start start 2023-09-30T22:18:44.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.069+0000 7f6e41798700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e3c0a1e90 0x7f6e3c11a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:44.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.069+0000 7f6e41798700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e3c0a2970 0x7f6e3c11ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:44.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.069+0000 7f6e41798700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e3c0a35f0 0x7f6e3c11b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:44.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.069+0000 7f6e41798700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c11da90 con 0x7f6e3c0a35f0 2023-09-30T22:18:44.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.069+0000 7f6e41798700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c09f980 con 0x7f6e3c0a2970 2023-09-30T22:18:44.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.069+0000 7f6e41798700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c072ab0 con 0x7f6e3c0a1e90 2023-09-30T22:18:44.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.069+0000 7f6e3affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e3c0a1e90 0x7f6e3c11a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:44.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.069+0000 7f6e3affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e3c0a1e90 0x7f6e3c11a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45280/0 (socket says 172.21.15.156:45280) 2023-09-30T22:18:44.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.069+0000 7f6e3affd700 1 -- 172.21.15.156:0/1648200180 learned_addr learned my addr 172.21.15.156:0/1648200180 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:44.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.069+0000 7f6e3b7fe700 1 --2- 172.21.15.156:0/1648200180 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e3c0a35f0 0x7f6e3c11b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:44.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.069+0000 7f6e3a7fc700 1 --2- 172.21.15.156:0/1648200180 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e3c0a2970 0x7f6e3c11ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:44.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.070+0000 7f6e3affd700 1 -- 172.21.15.156:0/1648200180 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e3c0a2970 msgr2=0x7f6e3c11ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:44.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.070+0000 7f6e3affd700 1 --2- 172.21.15.156:0/1648200180 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e3c0a2970 0x7f6e3c11ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:44.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.070+0000 7f6e3affd700 1 -- 172.21.15.156:0/1648200180 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e3c0a35f0 msgr2=0x7f6e3c11b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:44.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.070+0000 7f6e3affd700 1 --2- 172.21.15.156:0/1648200180 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e3c0a35f0 0x7f6e3c11b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:44.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.070+0000 7f6e3affd700 1 -- 172.21.15.156:0/1648200180 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e34009a70 con 0x7f6e3c0a1e90 2023-09-30T22:18:44.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.070+0000 7f6e3b7fe700 1 --2- 172.21.15.156:0/1648200180 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e3c0a35f0 0x7f6e3c11b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:44.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.070+0000 7f6e3affd700 1 --2- 172.21.15.156:0/1648200180 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e3c0a1e90 0x7f6e3c11a640 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6e3000c520 tx=0x7f6e3000c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:44.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.070+0000 7f6e237fe700 1 -- 172.21.15.156:0/1648200180 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e30004c80 con 0x7f6e3c0a1e90 2023-09-30T22:18:44.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.070+0000 7f6e237fe700 1 -- 172.21.15.156:0/1648200180 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e30004e00 con 0x7f6e3c0a1e90 2023-09-30T22:18:44.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.070+0000 7f6e41798700 1 -- 172.21.15.156:0/1648200180 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e2c009550 con 0x7f6e3c0a1e90 2023-09-30T22:18:44.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.070+0000 7f6e237fe700 1 -- 172.21.15.156:0/1648200180 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e30007310 con 0x7f6e3c0a1e90 2023-09-30T22:18:44.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.070+0000 7f6e41798700 1 -- 172.21.15.156:0/1648200180 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e3c11dd70 con 0x7f6e3c0a1e90 2023-09-30T22:18:44.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.071+0000 7f6e237fe700 1 -- 172.21.15.156:0/1648200180 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6e30007470 con 0x7f6e3c0a1e90 2023-09-30T22:18:44.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.071+0000 7f6e237fe700 1 -- 172.21.15.156:0/1648200180 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f6e3003f7b0 con 0x7f6e3c0a1e90 2023-09-30T22:18:44.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.071+0000 7f6e41798700 1 -- 172.21.15.156:0/1648200180 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e3c04f2a0 con 0x7f6e3c0a1e90 2023-09-30T22:18:44.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.076+0000 7f6e237fe700 1 -- 172.21.15.156:0/1648200180 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6e300123b0 con 0x7f6e3c0a1e90 2023-09-30T22:18:44.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.260+0000 7f6e41798700 1 -- 172.21.15.156:0/1648200180 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6e3c0a3a70 con 0x7f6e3c0a1e90 2023-09-30T22:18:44.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.260+0000 7f6e237fe700 1 -- 172.21.15.156:0/1648200180 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6e300102c0 con 0x7f6e3c0a1e90 2023-09-30T22:18:44.261 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 8 2023-09-30T22:18:44.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.262+0000 7f6e41798700 1 -- 172.21.15.156:0/1648200180 >> v1:172.21.15.156:6816/126965 conn(0x7f6e2802f510 legacy=0x7f6e280319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:44.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.262+0000 7f6e41798700 1 -- 172.21.15.156:0/1648200180 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e3c0a1e90 msgr2=0x7f6e3c11a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:44.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.262+0000 7f6e41798700 1 --2- 172.21.15.156:0/1648200180 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e3c0a1e90 0x7f6e3c11a640 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6e3000c520 tx=0x7f6e3000c830 comp rx=0 tx=0).stop 2023-09-30T22:18:44.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.262+0000 7f6e41798700 1 -- 172.21.15.156:0/1648200180 shutdown_connections 2023-09-30T22:18:44.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.262+0000 7f6e41798700 1 --2- 172.21.15.156:0/1648200180 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e3c0a35f0 0x7f6e3c11b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:44.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.262+0000 7f6e41798700 1 --2- 172.21.15.156:0/1648200180 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e3c0a1e90 0x7f6e3c11a640 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:44.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.262+0000 7f6e41798700 1 --2- 172.21.15.156:0/1648200180 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e3c0a2970 0x7f6e3c11ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:44.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.262+0000 7f6e41798700 1 -- 172.21.15.156:0/1648200180 >> 172.21.15.156:0/1648200180 conn(0x7f6e3c0a43d0 msgr2=0x7f6e3c09cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:44.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.263+0000 7f6e41798700 1 -- 172.21.15.156:0/1648200180 shutdown_connections 2023-09-30T22:18:44.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.263+0000 7f6e41798700 1 -- 172.21.15.156:0/1648200180 wait complete. 2023-09-30T22:18:44.278 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:18:44.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.402+0000 7f7455b30700 1 Processor -- start 2023-09-30T22:18:44.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.402+0000 7f7455b30700 1 -- start start 2023-09-30T22:18:44.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.402+0000 7f7455b30700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f745009d780 0x7f745009db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:44.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.402+0000 7f7455b30700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f745009e090 0x7f7450134190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:44.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.402+0000 7f7455b30700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f745009a590 con 0x7f745009ad70 2023-09-30T22:18:44.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.402+0000 7f7455b30700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f745006b450 con 0x7f745009d780 2023-09-30T22:18:44.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.402+0000 7f7455b30700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745006a9e0 con 0x7f745009e090 2023-09-30T22:18:44.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.403+0000 7f744f7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f745009d780 0x7f745009db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:44.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.403+0000 7f744ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f745009e090 0x7f7450134190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:44.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.403+0000 7f744effd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f745009ad70 0x7f7450133a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:56914/0 (socket says 172.21.15.156:56914) 2023-09-30T22:18:44.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.403+0000 7f744effd700 1 -- 172.21.15.156:0/2247299905 learned_addr learned my addr 172.21.15.156:0/2247299905 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:18:44.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.403+0000 7f744f7fe700 1 -- 172.21.15.156:0/2247299905 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f745009e090 msgr2=0x7f7450134190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:44.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.403+0000 7f744f7fe700 1 --2- 172.21.15.156:0/2247299905 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f745009e090 0x7f7450134190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:44.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.403+0000 7f744f7fe700 1 -- 172.21.15.156:0/2247299905 >> v1:172.21.15.156:6789/0 conn(0x7f745009ad70 legacy=0x7f7450133a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:44.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.403+0000 7f744f7fe700 1 -- 172.21.15.156:0/2247299905 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745009e4f0 con 0x7f745009d780 2023-09-30T22:18:44.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.403+0000 7f744e7fc700 1 -- 172.21.15.156:0/2247299905 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4031603413 0 0) 0x7f745009a590 con 0x7f745009ad70 2023-09-30T22:18:44.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.403+0000 7f744ffff700 1 --2- 172.21.15.156:0/2247299905 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f745009e090 0x7f7450134190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:44.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.403+0000 7f744f7fe700 1 --2- 172.21.15.156:0/2247299905 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f745009d780 0x7f745009db50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7444009840 tx=0x7f7444009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba4b8b10821bd3c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:44.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.403+0000 7f744e7fc700 1 -- 172.21.15.156:0/2247299905 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7444011830 con 0x7f745009d780 2023-09-30T22:18:44.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.403+0000 7f744e7fc700 1 -- 172.21.15.156:0/2247299905 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7444011990 con 0x7f745009d780 2023-09-30T22:18:44.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.403+0000 7f744e7fc700 1 -- 172.21.15.156:0/2247299905 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7444011d20 con 0x7f745009d780 2023-09-30T22:18:44.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.404+0000 7f7455b30700 1 -- 172.21.15.156:0/2247299905 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f745009d780 msgr2=0x7f745009db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:44.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.404+0000 7f7455b30700 1 --2- 172.21.15.156:0/2247299905 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f745009d780 0x7f745009db50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7444009840 tx=0x7f7444009b50 comp rx=0 tx=0).stop 2023-09-30T22:18:44.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.404+0000 7f7455b30700 1 -- 172.21.15.156:0/2247299905 shutdown_connections 2023-09-30T22:18:44.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.404+0000 7f7455b30700 1 --2- 172.21.15.156:0/2247299905 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f745009e090 0x7f7450134190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:44.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.404+0000 7f7455b30700 1 --2- 172.21.15.156:0/2247299905 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f745009d780 0x7f745009db50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:44.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.404+0000 7f7455b30700 1 -- 172.21.15.156:0/2247299905 >> 172.21.15.156:0/2247299905 conn(0x7f745009f980 msgr2=0x7f745009fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:44.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.404+0000 7f7455b30700 1 -- 172.21.15.156:0/2247299905 shutdown_connections 2023-09-30T22:18:44.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.404+0000 7f7455b30700 1 -- 172.21.15.156:0/2247299905 wait complete. 2023-09-30T22:18:44.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.405+0000 7f7455b30700 1 Processor -- start 2023-09-30T22:18:44.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.405+0000 7f7455b30700 1 -- start start 2023-09-30T22:18:44.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.406+0000 7f7455b30700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f745009ad70 0x7f7450133640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:44.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.406+0000 7f7455b30700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f745009d780 0x7f74501224c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:44.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.406+0000 7f7455b30700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f745009e090 0x7f7450122a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:44.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.406+0000 7f7455b30700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7450124db0 con 0x7f745009d780 2023-09-30T22:18:44.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.406+0000 7f7455b30700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7450124540 con 0x7f745009e090 2023-09-30T22:18:44.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.406+0000 7f7455b30700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7450124090 con 0x7f745009ad70 2023-09-30T22:18:44.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.406+0000 7f744effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f745009d780 0x7f74501224c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:44.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.406+0000 7f744ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f745009e090 0x7f7450122a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:44.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.406+0000 7f744effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f745009d780 0x7f74501224c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48042/0 (socket says 172.21.15.156:48042) 2023-09-30T22:18:44.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.406+0000 7f744effd700 1 -- 172.21.15.156:0/3263265902 learned_addr learned my addr 172.21.15.156:0/3263265902 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:44.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.406+0000 7f744f7fe700 1 --2- 172.21.15.156:0/3263265902 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f745009ad70 0x7f7450133640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:44.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.406+0000 7f744effd700 1 -- 172.21.15.156:0/3263265902 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f745009ad70 msgr2=0x7f7450133640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:44.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.406+0000 7f744effd700 1 --2- 172.21.15.156:0/3263265902 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f745009ad70 0x7f7450133640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:44.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.406+0000 7f744effd700 1 -- 172.21.15.156:0/3263265902 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f745009e090 msgr2=0x7f7450122a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:44.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.406+0000 7f744effd700 1 --2- 172.21.15.156:0/3263265902 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f745009e090 0x7f7450122a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:44.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.406+0000 7f744effd700 1 -- 172.21.15.156:0/3263265902 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7448009a70 con 0x7f745009d780 2023-09-30T22:18:44.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.406+0000 7f744ffff700 1 --2- 172.21.15.156:0/3263265902 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f745009e090 0x7f7450122a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:44.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.406+0000 7f744effd700 1 --2- 172.21.15.156:0/3263265902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f745009d780 0x7f74501224c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f744000c580 tx=0x7f744000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:44.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.406+0000 7f7437fff700 1 -- 172.21.15.156:0/3263265902 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7440004c80 con 0x7f745009d780 2023-09-30T22:18:44.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.407+0000 7f7437fff700 1 -- 172.21.15.156:0/3263265902 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7440004e00 con 0x7f745009d780 2023-09-30T22:18:44.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.407+0000 7f7455b30700 1 -- 172.21.15.156:0/3263265902 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74440094a0 con 0x7f745009d780 2023-09-30T22:18:44.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.407+0000 7f7437fff700 1 -- 172.21.15.156:0/3263265902 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7440007310 con 0x7f745009d780 2023-09-30T22:18:44.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.407+0000 7f7455b30700 1 -- 172.21.15.156:0/3263265902 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f745009c710 con 0x7f745009d780 2023-09-30T22:18:44.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.407+0000 7f7437fff700 1 -- 172.21.15.156:0/3263265902 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7440007470 con 0x7f745009d780 2023-09-30T22:18:44.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.408+0000 7f7437fff700 1 -- 172.21.15.156:0/3263265902 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f744003f790 con 0x7f745009d780 2023-09-30T22:18:44.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.408+0000 7f7455b30700 1 -- 172.21.15.156:0/3263265902 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f745011f0c0 con 0x7f745009d780 2023-09-30T22:18:44.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.412+0000 7f7437fff700 1 -- 172.21.15.156:0/3263265902 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f74400123b0 con 0x7f745009d780 2023-09-30T22:18:44.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.595+0000 7f7455b30700 1 -- 172.21.15.156:0/3263265902 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7450125fb0 con 0x7f745009d780 2023-09-30T22:18:44.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.596+0000 7f7437fff700 1 -- 172.21.15.156:0/3263265902 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f74400102c0 con 0x7f745009d780 2023-09-30T22:18:44.596 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 32 2023-09-30T22:18:44.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.598+0000 7f7455b30700 1 -- 172.21.15.156:0/3263265902 >> v1:172.21.15.156:6816/126965 conn(0x7f743c02f540 legacy=0x7f743c0319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:44.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.598+0000 7f7455b30700 1 -- 172.21.15.156:0/3263265902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f745009d780 msgr2=0x7f74501224c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:44.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.598+0000 7f7455b30700 1 --2- 172.21.15.156:0/3263265902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f745009d780 0x7f74501224c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f744000c580 tx=0x7f744000c890 comp rx=0 tx=0).stop 2023-09-30T22:18:44.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.598+0000 7f7455b30700 1 -- 172.21.15.156:0/3263265902 shutdown_connections 2023-09-30T22:18:44.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.598+0000 7f7455b30700 1 --2- 172.21.15.156:0/3263265902 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f745009e090 0x7f7450122a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:44.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.598+0000 7f7455b30700 1 --2- 172.21.15.156:0/3263265902 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f745009ad70 0x7f7450133640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:44.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.598+0000 7f7455b30700 1 --2- 172.21.15.156:0/3263265902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f745009d780 0x7f74501224c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:44.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.598+0000 7f7455b30700 1 -- 172.21.15.156:0/3263265902 >> 172.21.15.156:0/3263265902 conn(0x7f745009f980 msgr2=0x7f7450133eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:44.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.598+0000 7f7455b30700 1 -- 172.21.15.156:0/3263265902 shutdown_connections 2023-09-30T22:18:44.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.598+0000 7f7455b30700 1 -- 172.21.15.156:0/3263265902 wait complete. 2023-09-30T22:18:44.610 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:18:44.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.733+0000 7f399327c700 1 Processor -- start 2023-09-30T22:18:44.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.733+0000 7f399327c700 1 -- start start 2023-09-30T22:18:44.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.734+0000 7f399327c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f398c09e260 0x7f398c135ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:44.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.734+0000 7f399327c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f398c136010 0x7f398c1383f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:44.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.734+0000 7f399327c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398c09e690 con 0x7f398c09d780 2023-09-30T22:18:44.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.734+0000 7f399327c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398c09d430 con 0x7f398c136010 2023-09-30T22:18:44.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.734+0000 7f399327c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f398c09e910 con 0x7f398c09e260 2023-09-30T22:18:44.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.734+0000 7f3990817700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f398c09e260 0x7f398c135ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:44.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.734+0000 7f3991018700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f398c09d780 0x7f398c09db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:56924/0 (socket says 172.21.15.156:56924) 2023-09-30T22:18:44.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.734+0000 7f3991819700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f398c136010 0x7f398c1383f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:44.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.734+0000 7f3991018700 1 -- 172.21.15.156:0/2765921238 learned_addr learned my addr 172.21.15.156:0/2765921238 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:18:44.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.734+0000 7f3990817700 1 --2- 172.21.15.156:0/2765921238 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f398c09e260 0x7f398c135ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45294/0 (socket says 172.21.15.156:45294) 2023-09-30T22:18:44.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.734+0000 7f3990817700 1 -- 172.21.15.156:0/2765921238 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f398c136010 msgr2=0x7f398c1383f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:44.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.734+0000 7f3990817700 1 --2- 172.21.15.156:0/2765921238 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f398c136010 0x7f398c1383f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:44.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.734+0000 7f3990817700 1 -- 172.21.15.156:0/2765921238 >> v1:172.21.15.156:6789/0 conn(0x7f398c09d780 legacy=0x7f398c09db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:44.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.734+0000 7f3990817700 1 -- 172.21.15.156:0/2765921238 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c09b380 con 0x7f398c09e260 2023-09-30T22:18:44.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.734+0000 7f3991819700 1 --2- 172.21.15.156:0/2765921238 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f398c136010 0x7f398c1383f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:44.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.734+0000 7f3990817700 1 --2- 172.21.15.156:0/2765921238 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f398c09e260 0x7f398c135ad0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f398800b920 tx=0x7f398800bc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcd8a1dd7176f805 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:44.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.734+0000 7f3983fff700 1 -- 172.21.15.156:0/2765921238 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398800ca30 con 0x7f398c09e260 2023-09-30T22:18:44.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.735+0000 7f3983fff700 1 -- 172.21.15.156:0/2765921238 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398800cb90 con 0x7f398c09e260 2023-09-30T22:18:44.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.735+0000 7f3983fff700 1 -- 172.21.15.156:0/2765921238 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398800f460 con 0x7f398c09e260 2023-09-30T22:18:44.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.735+0000 7f399327c700 1 -- 172.21.15.156:0/2765921238 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f398c09e260 msgr2=0x7f398c135ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:44.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.735+0000 7f399327c700 1 --2- 172.21.15.156:0/2765921238 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f398c09e260 0x7f398c135ad0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f398800b920 tx=0x7f398800bc30 comp rx=0 tx=0).stop 2023-09-30T22:18:44.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.735+0000 7f399327c700 1 -- 172.21.15.156:0/2765921238 shutdown_connections 2023-09-30T22:18:44.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.735+0000 7f399327c700 1 --2- 172.21.15.156:0/2765921238 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f398c136010 0x7f398c1383f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:44.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.735+0000 7f399327c700 1 --2- 172.21.15.156:0/2765921238 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f398c09e260 0x7f398c135ad0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:44.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.735+0000 7f399327c700 1 -- 172.21.15.156:0/2765921238 >> 172.21.15.156:0/2765921238 conn(0x7f398c09f980 msgr2=0x7f398c09fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:44.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.735+0000 7f399327c700 1 -- 172.21.15.156:0/2765921238 shutdown_connections 2023-09-30T22:18:44.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.735+0000 7f399327c700 1 -- 172.21.15.156:0/2765921238 wait complete. 2023-09-30T22:18:44.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.736+0000 7f399327c700 1 Processor -- start 2023-09-30T22:18:44.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.736+0000 7f399327c700 1 -- start start 2023-09-30T22:18:44.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.737+0000 7f399327c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f398c09d780 0x7f398c119510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:44.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.737+0000 7f399327c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f398c09e260 0x7f398c119a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:44.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.737+0000 7f399327c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f398c136010 0x7f398c119f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:44.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.737+0000 7f399327c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c11cbe0 con 0x7f398c136010 2023-09-30T22:18:44.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.737+0000 7f399327c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398c072260 con 0x7f398c09e260 2023-09-30T22:18:44.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.737+0000 7f399327c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f398c09c8d0 con 0x7f398c09d780 2023-09-30T22:18:44.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.737+0000 7f3991018700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f398c09d780 0x7f398c119510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:44.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.737+0000 7f3990817700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f398c09e260 0x7f398c119a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:44.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.737+0000 7f3991819700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f398c136010 0x7f398c119f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:44.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.737+0000 7f3991018700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f398c09d780 0x7f398c119510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45298/0 (socket says 172.21.15.156:45298) 2023-09-30T22:18:44.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.737+0000 7f3990817700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f398c09e260 0x7f398c119a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:60324/0 (socket says 172.21.15.156:60324) 2023-09-30T22:18:44.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.737+0000 7f3991819700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f398c136010 0x7f398c119f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48052/0 (socket says 172.21.15.156:48052) 2023-09-30T22:18:44.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.737+0000 7f3991018700 1 -- 172.21.15.156:0/4017931921 learned_addr learned my addr 172.21.15.156:0/4017931921 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:44.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.737+0000 7f3991018700 1 -- 172.21.15.156:0/4017931921 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f398c09e260 msgr2=0x7f398c119a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:44.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.737+0000 7f3991018700 1 --2- 172.21.15.156:0/4017931921 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f398c09e260 0x7f398c119a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:44.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.737+0000 7f3991018700 1 -- 172.21.15.156:0/4017931921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f398c136010 msgr2=0x7f398c119f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:44.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.737+0000 7f3991018700 1 --2- 172.21.15.156:0/4017931921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f398c136010 0x7f398c119f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:44.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.737+0000 7f3991018700 1 -- 172.21.15.156:0/4017931921 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398400f050 con 0x7f398c09d780 2023-09-30T22:18:44.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.737+0000 7f3991819700 1 --2- 172.21.15.156:0/4017931921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f398c136010 0x7f398c119f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:44.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.737+0000 7f3990817700 1 --2- 172.21.15.156:0/4017931921 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f398c09e260 0x7f398c119a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:44.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.737+0000 7f3991018700 1 --2- 172.21.15.156:0/4017931921 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f398c09d780 0x7f398c119510 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f397c00c520 tx=0x7f397c00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:44.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.737+0000 7f3981ffb700 1 -- 172.21.15.156:0/4017931921 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c005d70 con 0x7f398c09d780 2023-09-30T22:18:44.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.737+0000 7f3981ffb700 1 -- 172.21.15.156:0/4017931921 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c0070d0 con 0x7f398c09d780 2023-09-30T22:18:44.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.737+0000 7f399327c700 1 -- 172.21.15.156:0/4017931921 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398800b550 con 0x7f398c09d780 2023-09-30T22:18:44.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.737+0000 7f3981ffb700 1 -- 172.21.15.156:0/4017931921 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c007440 con 0x7f398c09d780 2023-09-30T22:18:44.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.738+0000 7f399327c700 1 -- 172.21.15.156:0/4017931921 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f398c11d650 con 0x7f398c09d780 2023-09-30T22:18:44.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.738+0000 7f3981ffb700 1 -- 172.21.15.156:0/4017931921 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f397c0075a0 con 0x7f398c09d780 2023-09-30T22:18:44.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.738+0000 7f3981ffb700 1 -- 172.21.15.156:0/4017931921 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f397c03eed0 con 0x7f398c09d780 2023-09-30T22:18:44.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.739+0000 7f399327c700 1 -- 172.21.15.156:0/4017931921 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f398c04f2a0 con 0x7f398c09d780 2023-09-30T22:18:44.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.743+0000 7f3981ffb700 1 -- 172.21.15.156:0/4017931921 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f397c017070 con 0x7f398c09d780 2023-09-30T22:18:44.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.927+0000 7f399327c700 1 -- 172.21.15.156:0/4017931921 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f398c09b5a0 con 0x7f398c09d780 2023-09-30T22:18:44.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.928+0000 7f3981ffb700 1 -- 172.21.15.156:0/4017931921 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f397c019b40 con 0x7f398c09d780 2023-09-30T22:18:44.929 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 64 2023-09-30T22:18:44.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.930+0000 7f399327c700 1 -- 172.21.15.156:0/4017931921 >> v1:172.21.15.156:6816/126965 conn(0x7f397002f510 legacy=0x7f39700319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:44.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.930+0000 7f399327c700 1 -- 172.21.15.156:0/4017931921 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f398c09d780 msgr2=0x7f398c119510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:44.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.930+0000 7f399327c700 1 --2- 172.21.15.156:0/4017931921 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f398c09d780 0x7f398c119510 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f397c00c520 tx=0x7f397c00c830 comp rx=0 tx=0).stop 2023-09-30T22:18:44.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.930+0000 7f399327c700 1 -- 172.21.15.156:0/4017931921 shutdown_connections 2023-09-30T22:18:44.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.930+0000 7f399327c700 1 --2- 172.21.15.156:0/4017931921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f398c136010 0x7f398c119f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:44.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.930+0000 7f399327c700 1 --2- 172.21.15.156:0/4017931921 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f398c09d780 0x7f398c119510 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:44.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.930+0000 7f399327c700 1 --2- 172.21.15.156:0/4017931921 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f398c09e260 0x7f398c119a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:44.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.930+0000 7f399327c700 1 -- 172.21.15.156:0/4017931921 >> 172.21.15.156:0/4017931921 conn(0x7f398c09f980 msgr2=0x7f398c0a24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:44.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.930+0000 7f399327c700 1 -- 172.21.15.156:0/4017931921 shutdown_connections 2023-09-30T22:18:44.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:44.930+0000 7f399327c700 1 -- 172.21.15.156:0/4017931921 wait complete. 2023-09-30T22:18:44.943 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:18:45.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.063+0000 7f87e96a5700 1 Processor -- start 2023-09-30T22:18:45.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.063+0000 7f87e96a5700 1 -- start start 2023-09-30T22:18:45.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.064+0000 7f87e96a5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87e409d860 0x7f87e409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:45.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.064+0000 7f87e96a5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87e409e170 0x7f87e41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:45.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.064+0000 7f87e96a5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f87e4130ce0 0x7f87e4131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:45.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.064+0000 7f87e96a5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e409aaa0 con 0x7f87e4130ce0 2023-09-30T22:18:45.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.064+0000 7f87e96a5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e409f870 con 0x7f87e409d860 2023-09-30T22:18:45.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.064+0000 7f87e96a5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87e409b360 con 0x7f87e409e170 2023-09-30T22:18:45.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.064+0000 7f87e2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87e409d860 0x7f87e409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:45.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.064+0000 7f87e27fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87e409e170 0x7f87e41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:45.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.064+0000 7f87e37fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f87e4130ce0 0x7f87e4131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:45.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.064+0000 7f87e2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87e409d860 0x7f87e409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:60334/0 (socket says 172.21.15.156:60334) 2023-09-30T22:18:45.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.064+0000 7f87e2ffd700 1 -- 172.21.15.156:0/4031277787 learned_addr learned my addr 172.21.15.156:0/4031277787 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:45.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.064+0000 7f87e2ffd700 1 -- 172.21.15.156:0/4031277787 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87e409e170 msgr2=0x7f87e41307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:45.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.064+0000 7f87e2ffd700 1 --2- 172.21.15.156:0/4031277787 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87e409e170 0x7f87e41307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:45.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.064+0000 7f87e2ffd700 1 -- 172.21.15.156:0/4031277787 >> v2:172.21.15.156:3300/0 conn(0x7f87e4130ce0 msgr2=0x7f87e4131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:45.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.064+0000 7f87e2ffd700 1 --2- 172.21.15.156:0/4031277787 >> v2:172.21.15.156:3300/0 conn(0x7f87e4130ce0 0x7f87e4131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:45.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.064+0000 7f87e2ffd700 1 -- 172.21.15.156:0/4031277787 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e409b620 con 0x7f87e409d860 2023-09-30T22:18:45.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.064+0000 7f87e27fc700 1 --2- 172.21.15.156:0/4031277787 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87e409e170 0x7f87e41307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:45.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.064+0000 7f87e37fe700 1 --2- 172.21.15.156:0/4031277787 >> v2:172.21.15.156:3300/0 conn(0x7f87e4130ce0 0x7f87e4131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:45.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.064+0000 7f87e2ffd700 1 --2- 172.21.15.156:0/4031277787 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87e409d860 0x7f87e409dc30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f87d80098f0 tx=0x7f87d8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c8d57eb34da6285 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:45.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.064+0000 7f87e1ffb700 1 -- 172.21.15.156:0/4031277787 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d8011830 con 0x7f87e409d860 2023-09-30T22:18:45.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.065+0000 7f87e1ffb700 1 -- 172.21.15.156:0/4031277787 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d8011990 con 0x7f87e409d860 2023-09-30T22:18:45.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.065+0000 7f87e1ffb700 1 -- 172.21.15.156:0/4031277787 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d8011d20 con 0x7f87e409d860 2023-09-30T22:18:45.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.065+0000 7f87e96a5700 1 -- 172.21.15.156:0/4031277787 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87e409d860 msgr2=0x7f87e409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:45.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.065+0000 7f87e96a5700 1 --2- 172.21.15.156:0/4031277787 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87e409d860 0x7f87e409dc30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f87d80098f0 tx=0x7f87d8009c00 comp rx=0 tx=0).stop 2023-09-30T22:18:45.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.065+0000 7f87e96a5700 1 -- 172.21.15.156:0/4031277787 shutdown_connections 2023-09-30T22:18:45.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.065+0000 7f87e96a5700 1 --2- 172.21.15.156:0/4031277787 >> v2:172.21.15.156:3300/0 conn(0x7f87e4130ce0 0x7f87e4131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:45.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.065+0000 7f87e96a5700 1 --2- 172.21.15.156:0/4031277787 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87e409d860 0x7f87e409dc30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:45.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.065+0000 7f87e96a5700 1 --2- 172.21.15.156:0/4031277787 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87e409e170 0x7f87e41307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:45.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.065+0000 7f87e96a5700 1 -- 172.21.15.156:0/4031277787 >> 172.21.15.156:0/4031277787 conn(0x7f87e4099c40 msgr2=0x7f87e40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:45.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.065+0000 7f87e96a5700 1 -- 172.21.15.156:0/4031277787 shutdown_connections 2023-09-30T22:18:45.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.065+0000 7f87e96a5700 1 -- 172.21.15.156:0/4031277787 wait complete. 2023-09-30T22:18:45.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.066+0000 7f87e96a5700 1 Processor -- start 2023-09-30T22:18:45.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.066+0000 7f87e96a5700 1 -- start start 2023-09-30T22:18:45.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.067+0000 7f87e96a5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87e409d860 0x7f87e411e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:45.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.067+0000 7f87e96a5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87e409e170 0x7f87e411e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:45.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.067+0000 7f87e96a5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87e4130ce0 0x7f87e411eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:45.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.067+0000 7f87e96a5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e4120450 con 0x7f87e409e170 2023-09-30T22:18:45.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.067+0000 7f87e96a5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e4130600 con 0x7f87e409d860 2023-09-30T22:18:45.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.067+0000 7f87e96a5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87e409c8b0 con 0x7f87e4130ce0 2023-09-30T22:18:45.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.067+0000 7f87e2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87e409d860 0x7f87e411e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:45.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.067+0000 7f87e27fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87e409e170 0x7f87e411e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:45.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.067+0000 7f87e2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87e409d860 0x7f87e411e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:60350/0 (socket says 172.21.15.156:60350) 2023-09-30T22:18:45.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.067+0000 7f87e37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87e4130ce0 0x7f87e411eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:45.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.067+0000 7f87e2ffd700 1 -- 172.21.15.156:0/1701144176 learned_addr learned my addr 172.21.15.156:0/1701144176 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:45.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.067+0000 7f87e2ffd700 1 -- 172.21.15.156:0/1701144176 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87e4130ce0 msgr2=0x7f87e411eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:45.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.067+0000 7f87e2ffd700 1 --2- 172.21.15.156:0/1701144176 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87e4130ce0 0x7f87e411eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:45.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.067+0000 7f87e2ffd700 1 -- 172.21.15.156:0/1701144176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87e409e170 msgr2=0x7f87e411e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:45.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.067+0000 7f87e2ffd700 1 --2- 172.21.15.156:0/1701144176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87e409e170 0x7f87e411e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:45.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.067+0000 7f87e2ffd700 1 -- 172.21.15.156:0/1701144176 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d400b740 con 0x7f87e409d860 2023-09-30T22:18:45.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.067+0000 7f87e27fc700 1 --2- 172.21.15.156:0/1701144176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87e409e170 0x7f87e411e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:45.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.067+0000 7f87e2ffd700 1 --2- 172.21.15.156:0/1701144176 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87e409d860 0x7f87e411e220 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f87d8000c00 tx=0x7f87d8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:45.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.067+0000 7f87cb7fe700 1 -- 172.21.15.156:0/1701144176 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d8004240 con 0x7f87e409d860 2023-09-30T22:18:45.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.067+0000 7f87cb7fe700 1 -- 172.21.15.156:0/1701144176 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d801f070 con 0x7f87e409d860 2023-09-30T22:18:45.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.067+0000 7f87cb7fe700 1 -- 172.21.15.156:0/1701144176 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d80045c0 con 0x7f87e409d860 2023-09-30T22:18:45.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.067+0000 7f87e96a5700 1 -- 172.21.15.156:0/1701144176 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87dc009a70 con 0x7f87e409d860 2023-09-30T22:18:45.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.067+0000 7f87e96a5700 1 -- 172.21.15.156:0/1701144176 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d8009550 con 0x7f87e409d860 2023-09-30T22:18:45.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.068+0000 7f87cb7fe700 1 -- 172.21.15.156:0/1701144176 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f87d8021030 con 0x7f87e409d860 2023-09-30T22:18:45.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.068+0000 7f87cb7fe700 1 -- 172.21.15.156:0/1701144176 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f87d8040b30 con 0x7f87e409d860 2023-09-30T22:18:45.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.068+0000 7f87e96a5700 1 -- 172.21.15.156:0/1701144176 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e404f2a0 con 0x7f87e409d860 2023-09-30T22:18:45.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.073+0000 7f87cb7fe700 1 -- 172.21.15.156:0/1701144176 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f87d8015070 con 0x7f87e409d860 2023-09-30T22:18:45.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.294+0000 7f87e96a5700 1 -- 172.21.15.156:0/1701144176 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87e4121080 con 0x7f87e409d860 2023-09-30T22:18:45.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.295+0000 7f87cb7fe700 1 -- 172.21.15.156:0/1701144176 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2317 (secure 0 0 0) 0x7f87d801a450 con 0x7f87e409d860 2023-09-30T22:18:45.296 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:18:45.296 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:16:29.792703+0000","modified":"2023-09-30T22:16:54.002618+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4206},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4206":{"gid":4206,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6817/3817969673","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6817","nonce":3817969673}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T22:18:45.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.297+0000 7f87e96a5700 1 -- 172.21.15.156:0/1701144176 >> v1:172.21.15.156:6816/126965 conn(0x7f87d002f510 legacy=0x7f87d00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:45.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.297+0000 7f87e96a5700 1 -- 172.21.15.156:0/1701144176 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87e409d860 msgr2=0x7f87e411e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:45.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.297+0000 7f87e96a5700 1 --2- 172.21.15.156:0/1701144176 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87e409d860 0x7f87e411e220 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f87d8000c00 tx=0x7f87d8004750 comp rx=0 tx=0).stop 2023-09-30T22:18:45.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.297+0000 7f87e96a5700 1 -- 172.21.15.156:0/1701144176 shutdown_connections 2023-09-30T22:18:45.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.297+0000 7f87e96a5700 1 --2- 172.21.15.156:0/1701144176 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87e4130ce0 0x7f87e411eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:45.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.297+0000 7f87e96a5700 1 --2- 172.21.15.156:0/1701144176 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87e409d860 0x7f87e411e220 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:45.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.297+0000 7f87e96a5700 1 --2- 172.21.15.156:0/1701144176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87e409e170 0x7f87e411e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:45.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.297+0000 7f87e96a5700 1 -- 172.21.15.156:0/1701144176 >> 172.21.15.156:0/1701144176 conn(0x7f87e4099c40 msgr2=0x7f87e40a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:45.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.297+0000 7f87e96a5700 1 -- 172.21.15.156:0/1701144176 shutdown_connections 2023-09-30T22:18:45.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.297+0000 7f87e96a5700 1 -- 172.21.15.156:0/1701144176 wait complete. 2023-09-30T22:18:45.299 INFO:teuthology.orchestra.run.smithi156.stderr:dumped fsmap epoch 7 2023-09-30T22:18:45.309 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:18:45.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.430+0000 7fc427b5b700 1 Processor -- start 2023-09-30T22:18:45.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.430+0000 7fc427b5b700 1 -- start start 2023-09-30T22:18:45.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.430+0000 7fc427b5b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc420133ad0 0x7fc420133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:45.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.430+0000 7fc427b5b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc420130bc0 0x7fc42013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:45.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.430+0000 7fc427b5b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc42006b2d0 con 0x7fc4201300a0 2023-09-30T22:18:45.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.430+0000 7fc427b5b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc420133610 con 0x7fc420133ad0 2023-09-30T22:18:45.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.430+0000 7fc427b5b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc42009a500 con 0x7fc420130bc0 2023-09-30T22:18:45.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.430+0000 7fc4260f8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc420130bc0 0x7fc42013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:45.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.430+0000 7fc4258f7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc420133ad0 0x7fc420133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:45.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.430+0000 7fc4258f7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc420133ad0 0x7fc420133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48088/0 (socket says 172.21.15.156:48088) 2023-09-30T22:18:45.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.430+0000 7fc4260f8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc420130bc0 0x7fc42013b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45308/0 (socket says 172.21.15.156:45308) 2023-09-30T22:18:45.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.430+0000 7fc4258f7700 1 -- 172.21.15.156:0/123623163 learned_addr learned my addr 172.21.15.156:0/123623163 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:45.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.431+0000 7fc4260f8700 1 -- 172.21.15.156:0/123623163 >> v2:172.21.15.156:3300/0 conn(0x7fc420133ad0 msgr2=0x7fc420133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:45.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.431+0000 7fc4260f8700 1 --2- 172.21.15.156:0/123623163 >> v2:172.21.15.156:3300/0 conn(0x7fc420133ad0 0x7fc420133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:45.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.431+0000 7fc4260f8700 1 -- 172.21.15.156:0/123623163 >> v1:172.21.15.156:6789/0 conn(0x7fc4201300a0 legacy=0x7fc4201304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:45.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.431+0000 7fc4260f8700 1 -- 172.21.15.156:0/123623163 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4201338b0 con 0x7fc420130bc0 2023-09-30T22:18:45.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.431+0000 7fc4248f5700 1 -- 172.21.15.156:0/123623163 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1002211536 0 0) 0x7fc42006b2d0 con 0x7fc4201300a0 2023-09-30T22:18:45.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.431+0000 7fc4258f7700 1 --2- 172.21.15.156:0/123623163 >> v2:172.21.15.156:3300/0 conn(0x7fc420133ad0 0x7fc420133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:45.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.431+0000 7fc4260f8700 1 --2- 172.21.15.156:0/123623163 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc420130bc0 0x7fc42013b990 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc418009d90 tx=0x7fc41800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1b4cf14643f237e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:45.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.431+0000 7fc4248f5700 1 -- 172.21.15.156:0/123623163 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41800e070 con 0x7fc420130bc0 2023-09-30T22:18:45.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.431+0000 7fc4248f5700 1 -- 172.21.15.156:0/123623163 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc41800bb20 con 0x7fc420130bc0 2023-09-30T22:18:45.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.431+0000 7fc4248f5700 1 -- 172.21.15.156:0/123623163 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc418012430 con 0x7fc420130bc0 2023-09-30T22:18:45.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.432+0000 7fc427b5b700 1 -- 172.21.15.156:0/123623163 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc420130bc0 msgr2=0x7fc42013b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:45.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.432+0000 7fc427b5b700 1 --2- 172.21.15.156:0/123623163 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc420130bc0 0x7fc42013b990 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc418009d90 tx=0x7fc41800b330 comp rx=0 tx=0).stop 2023-09-30T22:18:45.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.432+0000 7fc427b5b700 1 -- 172.21.15.156:0/123623163 shutdown_connections 2023-09-30T22:18:45.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.432+0000 7fc427b5b700 1 --2- 172.21.15.156:0/123623163 >> v2:172.21.15.156:3300/0 conn(0x7fc420133ad0 0x7fc420133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:45.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.432+0000 7fc427b5b700 1 --2- 172.21.15.156:0/123623163 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc420130bc0 0x7fc42013b990 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:45.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.432+0000 7fc427b5b700 1 -- 172.21.15.156:0/123623163 >> 172.21.15.156:0/123623163 conn(0x7fc420099c40 msgr2=0x7fc4200a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:45.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.432+0000 7fc427b5b700 1 -- 172.21.15.156:0/123623163 shutdown_connections 2023-09-30T22:18:45.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.432+0000 7fc427b5b700 1 -- 172.21.15.156:0/123623163 wait complete. 2023-09-30T22:18:45.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.432+0000 7fc427b5b700 1 Processor -- start 2023-09-30T22:18:45.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.433+0000 7fc427b5b700 1 -- start start 2023-09-30T22:18:45.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.433+0000 7fc427b5b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4201300a0 0x7fc420071370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:45.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.433+0000 7fc427b5b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc420130bc0 0x7fc4200718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:45.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.433+0000 7fc427b5b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc420133ad0 0x7fc420071df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:45.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.433+0000 7fc427b5b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42011e100 con 0x7fc4201300a0 2023-09-30T22:18:45.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.433+0000 7fc427b5b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc42012f6f0 con 0x7fc420130bc0 2023-09-30T22:18:45.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.433+0000 7fc427b5b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc42012dd00 con 0x7fc420133ad0 2023-09-30T22:18:45.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.433+0000 7fc4258f7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4201300a0 0x7fc420071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:45.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.433+0000 7fc4260f8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc420133ad0 0x7fc420071df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:45.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.433+0000 7fc4258f7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4201300a0 0x7fc420071370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48102/0 (socket says 172.21.15.156:48102) 2023-09-30T22:18:45.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.433+0000 7fc4258f7700 1 -- 172.21.15.156:0/3002554665 learned_addr learned my addr 172.21.15.156:0/3002554665 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:45.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.433+0000 7fc4250f6700 1 --2- 172.21.15.156:0/3002554665 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc420130bc0 0x7fc4200718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:45.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.433+0000 7fc4258f7700 1 -- 172.21.15.156:0/3002554665 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc420133ad0 msgr2=0x7fc420071df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:45.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.433+0000 7fc4258f7700 1 --2- 172.21.15.156:0/3002554665 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc420133ad0 0x7fc420071df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:45.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.433+0000 7fc4258f7700 1 -- 172.21.15.156:0/3002554665 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc420130bc0 msgr2=0x7fc4200718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:45.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.433+0000 7fc4258f7700 1 --2- 172.21.15.156:0/3002554665 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc420130bc0 0x7fc4200718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:45.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.433+0000 7fc4258f7700 1 -- 172.21.15.156:0/3002554665 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41c009550 con 0x7fc4201300a0 2023-09-30T22:18:45.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.433+0000 7fc4260f8700 1 --2- 172.21.15.156:0/3002554665 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc420133ad0 0x7fc420071df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:45.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.433+0000 7fc4258f7700 1 --2- 172.21.15.156:0/3002554665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4201300a0 0x7fc420071370 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc41c00ebe0 tx=0x7fc41c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:45.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.434+0000 7fc4167fc700 1 -- 172.21.15.156:0/3002554665 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c00c850 con 0x7fc4201300a0 2023-09-30T22:18:45.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.434+0000 7fc4167fc700 1 -- 172.21.15.156:0/3002554665 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc41c00c9b0 con 0x7fc4201300a0 2023-09-30T22:18:45.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.434+0000 7fc427b5b700 1 -- 172.21.15.156:0/3002554665 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc418009a70 con 0x7fc4201300a0 2023-09-30T22:18:45.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.434+0000 7fc4167fc700 1 -- 172.21.15.156:0/3002554665 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c00cd40 con 0x7fc4201300a0 2023-09-30T22:18:45.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.434+0000 7fc427b5b700 1 -- 172.21.15.156:0/3002554665 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc42011f960 con 0x7fc4201300a0 2023-09-30T22:18:45.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.434+0000 7fc4167fc700 1 -- 172.21.15.156:0/3002554665 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc41c013470 con 0x7fc4201300a0 2023-09-30T22:18:45.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.434+0000 7fc427b5b700 1 -- 172.21.15.156:0/3002554665 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc42009cb20 con 0x7fc4201300a0 2023-09-30T22:18:45.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.435+0000 7fc4167fc700 1 -- 172.21.15.156:0/3002554665 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fc41c03fd90 con 0x7fc4201300a0 2023-09-30T22:18:45.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.439+0000 7fc4167fc700 1 -- 172.21.15.156:0/3002554665 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc41c01bcb0 con 0x7fc4201300a0 2023-09-30T22:18:45.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.628+0000 7fc427b5b700 1 -- 172.21.15.156:0/3002554665 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc42004f2a0 con 0x7fc4201300a0 2023-09-30T22:18:45.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.630+0000 7fc4167fc700 1 -- 172.21.15.156:0/3002554665 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+12943 (secure 0 0 0) 0x7fc41c021030 con 0x7fc4201300a0 2023-09-30T22:18:45.630 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:18:45.630 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":22,"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","created":"2023-09-30T22:16:15.239992+0000","modified":"2023-09-30T22:18:39.769833+0000","last_up_change":"2023-09-30T22:16:23.392557+0000","last_in_change":"2023-09-30T22:16:16.474206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:16:23.433906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:16:24.367795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:16:28.204677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:16:28.762804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ec2e78a-c61f-473a-bfcb-f956cffe4095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6812","nonce":118781}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6813","nonce":118781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6815","nonce":118781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6814","nonce":118781}]},"public_addr":"172.21.15.156:6812/118781","cluster_addr":"172.21.15.156:6813/118781","heartbeat_back_addr":"172.21.15.156:6815/118781","heartbeat_front_addr":"172.21.15.156:6814/118781","state":["exists","up"]},{"osd":1,"uuid":"b682e683-c15a-4bd9-8712-8af96454e9ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6803","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6805","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6807","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6806","nonce":118763}]},"public_addr":"172.21.15.156:6803/118763","cluster_addr":"172.21.15.156:6805/118763","heartbeat_back_addr":"172.21.15.156:6807/118763","heartbeat_front_addr":"172.21.15.156:6806/118763","state":["exists","up"]},{"osd":2,"uuid":"960dbaf0-2e0c-437e-9114-bc22ce522b26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6808","nonce":118788}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6809","nonce":118788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6811","nonce":118788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6810","nonce":118788}]},"public_addr":"172.21.15.156:6808/118788","cluster_addr":"172.21.15.156:6809/118788","heartbeat_back_addr":"172.21.15.156:6811/118788","heartbeat_front_addr":"172.21.15.156:6810/118788","state":["exists","up"]},{"osd":3,"uuid":"c1b19714-78b1-4869-8721-2f6352a64a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6800","nonce":118764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6801","nonce":118764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6804","nonce":118764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6802","nonce":118764}]},"public_addr":"172.21.15.156:6800/118764","cluster_addr":"172.21.15.156:6801/118764","heartbeat_back_addr":"172.21.15.156:6804/118764","heartbeat_front_addr":"172.21.15.156:6802/118764","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.663343+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.827397+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.806655+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.634746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.2","mappings":[{"from":3,"to":0}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.156:6816/118236":"2023-10-01T22:18:37.767496+0000","172.21.15.156:0/1464735255":"2023-10-01T22:18:37.767496+0000","172.21.15.156:0/2593263545":"2023-10-01T22:18:37.767496+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:18:45.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.632+0000 7fc427b5b700 1 -- 172.21.15.156:0/3002554665 >> v1:172.21.15.156:6816/126965 conn(0x7fc40402f510 legacy=0x7fc4040319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:45.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.632+0000 7fc427b5b700 1 -- 172.21.15.156:0/3002554665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4201300a0 msgr2=0x7fc420071370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:45.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.632+0000 7fc427b5b700 1 --2- 172.21.15.156:0/3002554665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4201300a0 0x7fc420071370 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc41c00ebe0 tx=0x7fc41c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:18:45.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.632+0000 7fc427b5b700 1 -- 172.21.15.156:0/3002554665 shutdown_connections 2023-09-30T22:18:45.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.632+0000 7fc427b5b700 1 --2- 172.21.15.156:0/3002554665 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc420133ad0 0x7fc420071df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:45.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.632+0000 7fc427b5b700 1 --2- 172.21.15.156:0/3002554665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4201300a0 0x7fc420071370 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:45.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.632+0000 7fc427b5b700 1 --2- 172.21.15.156:0/3002554665 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc420130bc0 0x7fc4200718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:45.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.632+0000 7fc427b5b700 1 -- 172.21.15.156:0/3002554665 >> 172.21.15.156:0/3002554665 conn(0x7fc420099c40 msgr2=0x7fc420132a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:45.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.632+0000 7fc427b5b700 1 -- 172.21.15.156:0/3002554665 shutdown_connections 2023-09-30T22:18:45.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.632+0000 7fc427b5b700 1 -- 172.21.15.156:0/3002554665 wait complete. 2023-09-30T22:18:45.645 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:18:45.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.766+0000 7fb8f7ebd700 1 Processor -- start 2023-09-30T22:18:45.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.766+0000 7fb8f7ebd700 1 -- start start 2023-09-30T22:18:45.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.767+0000 7fb8f7ebd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8f009e870 0x7fb8f009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:45.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.767+0000 7fb8f7ebd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8f009f180 0x7fb8f0133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:45.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.767+0000 7fb8f7ebd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb8f0134160 0x7fb8f0134600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:45.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.767+0000 7fb8f7ebd700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f00a0370 con 0x7fb8f0134160 2023-09-30T22:18:45.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.767+0000 7fb8f7ebd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f009fa00 con 0x7fb8f009f180 2023-09-30T22:18:45.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.767+0000 7fb8f7ebd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f009ada0 con 0x7fb8f009e870 2023-09-30T22:18:45.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.767+0000 7fb8f5458700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8f009f180 0x7fb8f0133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:45.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.767+0000 7fb8f645a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb8f0134160 0x7fb8f0134600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:45.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.767+0000 7fb8f5458700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8f009f180 0x7fb8f0133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:60378/0 (socket says 172.21.15.156:60378) 2023-09-30T22:18:45.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.767+0000 7fb8f5458700 1 -- 172.21.15.156:0/3521800711 learned_addr learned my addr 172.21.15.156:0/3521800711 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:45.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.767+0000 7fb8f5c59700 1 --2- 172.21.15.156:0/3521800711 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8f009e870 0x7fb8f009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:45.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.767+0000 7fb8f645a700 1 -- 172.21.15.156:0/3521800711 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8f009e870 msgr2=0x7fb8f009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:45.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.767+0000 7fb8f645a700 1 --2- 172.21.15.156:0/3521800711 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8f009e870 0x7fb8f009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:45.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.767+0000 7fb8f645a700 1 -- 172.21.15.156:0/3521800711 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8f009f180 msgr2=0x7fb8f0133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:45.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.767+0000 7fb8f645a700 1 --2- 172.21.15.156:0/3521800711 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8f009f180 0x7fb8f0133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:45.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.767+0000 7fb8f645a700 1 -- 172.21.15.156:0/3521800711 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f006bec0 con 0x7fb8f0134160 2023-09-30T22:18:45.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.767+0000 7fb8f5458700 1 --2- 172.21.15.156:0/3521800711 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8f009f180 0x7fb8f0133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:45.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.767+0000 7fb8f5c59700 1 --2- 172.21.15.156:0/3521800711 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8f009e870 0x7fb8f009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:45.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.767+0000 7fb8f645a700 1 --2- 172.21.15.156:0/3521800711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8f0134160 0x7fb8f0134600 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8009d90 tx=0x7fb8e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=863943ee9a5303aa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:45.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.767+0000 7fb8f4c57700 1 -- 172.21.15.156:0/3521800711 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e800e070 con 0x7fb8f0134160 2023-09-30T22:18:45.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.768+0000 7fb8f4c57700 1 -- 172.21.15.156:0/3521800711 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e800bb20 con 0x7fb8f0134160 2023-09-30T22:18:45.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.768+0000 7fb8f4c57700 1 -- 172.21.15.156:0/3521800711 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8012430 con 0x7fb8f0134160 2023-09-30T22:18:45.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.768+0000 7fb8f7ebd700 1 -- 172.21.15.156:0/3521800711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8f0134160 msgr2=0x7fb8f0134600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:45.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.768+0000 7fb8f7ebd700 1 --2- 172.21.15.156:0/3521800711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8f0134160 0x7fb8f0134600 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8009d90 tx=0x7fb8e800b330 comp rx=0 tx=0).stop 2023-09-30T22:18:45.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.768+0000 7fb8f7ebd700 1 -- 172.21.15.156:0/3521800711 shutdown_connections 2023-09-30T22:18:45.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.768+0000 7fb8f7ebd700 1 --2- 172.21.15.156:0/3521800711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8f0134160 0x7fb8f0134600 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:45.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.768+0000 7fb8f7ebd700 1 --2- 172.21.15.156:0/3521800711 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8f009e870 0x7fb8f009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:45.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.768+0000 7fb8f7ebd700 1 --2- 172.21.15.156:0/3521800711 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8f009f180 0x7fb8f0133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:45.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.768+0000 7fb8f7ebd700 1 -- 172.21.15.156:0/3521800711 >> 172.21.15.156:0/3521800711 conn(0x7fb8f00a4430 msgr2=0x7fb8f00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:45.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.768+0000 7fb8f7ebd700 1 -- 172.21.15.156:0/3521800711 shutdown_connections 2023-09-30T22:18:45.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.768+0000 7fb8f7ebd700 1 -- 172.21.15.156:0/3521800711 wait complete. 2023-09-30T22:18:45.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.769+0000 7fb8f7ebd700 1 Processor -- start 2023-09-30T22:18:45.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.769+0000 7fb8f7ebd700 1 -- start start 2023-09-30T22:18:45.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.769+0000 7fb8f7ebd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8f009e870 0x7fb8f01214d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:45.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.769+0000 7fb8f7ebd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8f009f180 0x7fb8f0121a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:45.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.769+0000 7fb8f7ebd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8f0134160 0x7fb8f0121f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:45.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.769+0000 7fb8f7ebd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f01230e0 con 0x7fb8f009e870 2023-09-30T22:18:45.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.769+0000 7fb8f7ebd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f0123f70 con 0x7fb8f0134160 2023-09-30T22:18:45.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.769+0000 7fb8f7ebd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f0124a50 con 0x7fb8f009f180 2023-09-30T22:18:45.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.770+0000 7fb8f645a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8f0134160 0x7fb8f0121f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:45.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.770+0000 7fb8f5458700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8f009f180 0x7fb8f0121a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:45.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.770+0000 7fb8f645a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8f0134160 0x7fb8f0121f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:60386/0 (socket says 172.21.15.156:60386) 2023-09-30T22:18:45.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.770+0000 7fb8f645a700 1 -- 172.21.15.156:0/1830014593 learned_addr learned my addr 172.21.15.156:0/1830014593 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:45.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.770+0000 7fb8f5c59700 1 --2- 172.21.15.156:0/1830014593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8f009e870 0x7fb8f01214d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:45.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.770+0000 7fb8f645a700 1 -- 172.21.15.156:0/1830014593 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8f009f180 msgr2=0x7fb8f0121a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:45.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.770+0000 7fb8f645a700 1 --2- 172.21.15.156:0/1830014593 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8f009f180 0x7fb8f0121a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:45.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.770+0000 7fb8f645a700 1 -- 172.21.15.156:0/1830014593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8f009e870 msgr2=0x7fb8f01214d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:45.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.770+0000 7fb8f645a700 1 --2- 172.21.15.156:0/1830014593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8f009e870 0x7fb8f01214d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:45.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.770+0000 7fb8f645a700 1 -- 172.21.15.156:0/1830014593 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e00094a0 con 0x7fb8f0134160 2023-09-30T22:18:45.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.770+0000 7fb8f5458700 1 --2- 172.21.15.156:0/1830014593 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8f009f180 0x7fb8f0121a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:45.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.770+0000 7fb8f645a700 1 --2- 172.21.15.156:0/1830014593 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8f0134160 0x7fb8f0121f50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8004270 tx=0x7fb8e8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:45.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.770+0000 7fb8e67fc700 1 -- 172.21.15.156:0/1830014593 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e80048a0 con 0x7fb8f0134160 2023-09-30T22:18:45.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.770+0000 7fb8e67fc700 1 -- 172.21.15.156:0/1830014593 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e8020070 con 0x7fb8f0134160 2023-09-30T22:18:45.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.770+0000 7fb8e67fc700 1 -- 172.21.15.156:0/1830014593 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e80276c0 con 0x7fb8f0134160 2023-09-30T22:18:45.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.770+0000 7fb8f7ebd700 1 -- 172.21.15.156:0/1830014593 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ec009550 con 0x7fb8f0134160 2023-09-30T22:18:45.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.770+0000 7fb8f7ebd700 1 -- 172.21.15.156:0/1830014593 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e8009a70 con 0x7fb8f0134160 2023-09-30T22:18:45.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.771+0000 7fb8e67fc700 1 -- 172.21.15.156:0/1830014593 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb8e8012430 con 0x7fb8f0134160 2023-09-30T22:18:45.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.771+0000 7fb8e67fc700 1 -- 172.21.15.156:0/1830014593 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fb8e8022070 con 0x7fb8f0134160 2023-09-30T22:18:45.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.771+0000 7fb8f7ebd700 1 -- 172.21.15.156:0/1830014593 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f0124b90 con 0x7fb8f0134160 2023-09-30T22:18:45.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:45.776+0000 7fb8e67fc700 1 -- 172.21.15.156:0/1830014593 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb8e802c020 con 0x7fb8f0134160 2023-09-30T22:18:46.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.005+0000 7fb8f7ebd700 1 -- 172.21.15.156:0/1830014593 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8f006cfa0 con 0x7fb8f0134160 2023-09-30T22:18:46.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.006+0000 7fb8e67fc700 1 -- 172.21.15.156:0/1830014593 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2317 (secure 0 0 0) 0x7fb8e8003e10 con 0x7fb8f0134160 2023-09-30T22:18:46.007 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:18:46.007 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:16:29.792703+0000","modified":"2023-09-30T22:16:54.002618+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4206},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4206":{"gid":4206,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6817/3817969673","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6817","nonce":3817969673}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T22:18:46.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.008+0000 7fb8f7ebd700 1 -- 172.21.15.156:0/1830014593 >> v1:172.21.15.156:6816/126965 conn(0x7fb8d402f540 legacy=0x7fb8d40319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:46.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.008+0000 7fb8f7ebd700 1 -- 172.21.15.156:0/1830014593 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8f0134160 msgr2=0x7fb8f0121f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:46.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.008+0000 7fb8f7ebd700 1 --2- 172.21.15.156:0/1830014593 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8f0134160 0x7fb8f0121f50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8004270 tx=0x7fb8e8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.008+0000 7fb8f7ebd700 1 -- 172.21.15.156:0/1830014593 shutdown_connections 2023-09-30T22:18:46.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.008+0000 7fb8f7ebd700 1 --2- 172.21.15.156:0/1830014593 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8f0134160 0x7fb8f0121f50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.008+0000 7fb8f7ebd700 1 --2- 172.21.15.156:0/1830014593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8f009e870 0x7fb8f01214d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.008+0000 7fb8f7ebd700 1 --2- 172.21.15.156:0/1830014593 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8f009f180 0x7fb8f0121a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.008+0000 7fb8f7ebd700 1 -- 172.21.15.156:0/1830014593 >> 172.21.15.156:0/1830014593 conn(0x7fb8f00a4430 msgr2=0x7fb8f0133500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:46.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.008+0000 7fb8f7ebd700 1 -- 172.21.15.156:0/1830014593 shutdown_connections 2023-09-30T22:18:46.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.008+0000 7fb8f7ebd700 1 -- 172.21.15.156:0/1830014593 wait complete. 2023-09-30T22:18:46.010 INFO:teuthology.orchestra.run.smithi156.stderr:dumped fsmap epoch 7 2023-09-30T22:18:46.121 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T22:16:29.792703+0000', 'modified': '2023-09-30T22:16:54.002618+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4206}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4206': {'gid': 4206, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.156:6817/3817969673', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.156:6817', 'nonce': 3817969673}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-30T22:18:46.121 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T22:18:46.122 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-09-30T22:18:46.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.243+0000 7f80fd5f2700 1 Processor -- start 2023-09-30T22:18:46.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.244+0000 7f80fd5f2700 1 -- start start 2023-09-30T22:18:46.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.244+0000 7f80fd5f2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80f812feb0 0x7f80f8130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:46.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.244+0000 7f80fd5f2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f80f81307c0 0x7f80f80993e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:46.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.244+0000 7f80fd5f2700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f809a540 con 0x7f80f8099920 2023-09-30T22:18:46.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.244+0000 7f80fd5f2700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f809ad40 con 0x7f80f81307c0 2023-09-30T22:18:46.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.244+0000 7f80fd5f2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80f809e640 con 0x7f80f812feb0 2023-09-30T22:18:46.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.244+0000 7f80f6ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80f812feb0 0x7f80f8130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:46.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.244+0000 7f80f67fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f80f81307c0 0x7f80f80993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:46.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.244+0000 7f80f77fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f80f8099920 0x7f80f8136e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:56938/0 (socket says 172.21.15.156:56938) 2023-09-30T22:18:46.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.244+0000 7f80f77fe700 1 -- 172.21.15.156:0/2788046133 learned_addr learned my addr 172.21.15.156:0/2788046133 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:18:46.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.244+0000 7f80f67fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f80f81307c0 0x7f80f80993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48132/0 (socket says 172.21.15.156:48132) 2023-09-30T22:18:46.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.244+0000 7f80f6ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80f812feb0 0x7f80f8130280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45346/0 (socket says 172.21.15.156:45346) 2023-09-30T22:18:46.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.244+0000 7f80f6ffd700 1 -- 172.21.15.156:0/2788046133 >> v2:172.21.15.156:3300/0 conn(0x7f80f81307c0 msgr2=0x7f80f80993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:46.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.244+0000 7f80f6ffd700 1 --2- 172.21.15.156:0/2788046133 >> v2:172.21.15.156:3300/0 conn(0x7f80f81307c0 0x7f80f80993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.244+0000 7f80f6ffd700 1 -- 172.21.15.156:0/2788046133 >> v1:172.21.15.156:6789/0 conn(0x7f80f8099920 legacy=0x7f80f8136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:46.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.244+0000 7f80f6ffd700 1 -- 172.21.15.156:0/2788046133 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f809e3c0 con 0x7f80f812feb0 2023-09-30T22:18:46.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.244+0000 7f80f5ffb700 1 -- 172.21.15.156:0/2788046133 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2329518297 0 0) 0x7f80f809a540 con 0x7f80f8099920 2023-09-30T22:18:46.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.244+0000 7f80f67fc700 1 --2- 172.21.15.156:0/2788046133 >> v2:172.21.15.156:3300/0 conn(0x7f80f81307c0 0x7f80f80993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:46.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.245+0000 7f80f6ffd700 1 --2- 172.21.15.156:0/2788046133 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80f812feb0 0x7f80f8130280 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f80e0009820 tx=0x7f80e0009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c675c9ada44370b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:46.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.245+0000 7f80f5ffb700 1 -- 172.21.15.156:0/2788046133 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e0005e30 con 0x7f80f812feb0 2023-09-30T22:18:46.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.245+0000 7f80f5ffb700 1 -- 172.21.15.156:0/2788046133 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e0006030 con 0x7f80f812feb0 2023-09-30T22:18:46.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.245+0000 7f80f5ffb700 1 -- 172.21.15.156:0/2788046133 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e00063c0 con 0x7f80f812feb0 2023-09-30T22:18:46.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.245+0000 7f80fd5f2700 1 -- 172.21.15.156:0/2788046133 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80f812feb0 msgr2=0x7f80f8130280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:46.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.245+0000 7f80fd5f2700 1 --2- 172.21.15.156:0/2788046133 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80f812feb0 0x7f80f8130280 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f80e0009820 tx=0x7f80e0009b30 comp rx=0 tx=0).stop 2023-09-30T22:18:46.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.245+0000 7f80fd5f2700 1 -- 172.21.15.156:0/2788046133 shutdown_connections 2023-09-30T22:18:46.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.245+0000 7f80fd5f2700 1 --2- 172.21.15.156:0/2788046133 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80f812feb0 0x7f80f8130280 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.245+0000 7f80fd5f2700 1 --2- 172.21.15.156:0/2788046133 >> v2:172.21.15.156:3300/0 conn(0x7f80f81307c0 0x7f80f80993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.245+0000 7f80fd5f2700 1 -- 172.21.15.156:0/2788046133 >> 172.21.15.156:0/2788046133 conn(0x7f80f80a2b30 msgr2=0x7f80f809e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:46.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.245+0000 7f80fd5f2700 1 -- 172.21.15.156:0/2788046133 shutdown_connections 2023-09-30T22:18:46.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.245+0000 7f80fd5f2700 1 -- 172.21.15.156:0/2788046133 wait complete. 2023-09-30T22:18:46.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.246+0000 7f80fd5f2700 1 Processor -- start 2023-09-30T22:18:46.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.246+0000 7f80fd5f2700 1 -- start start 2023-09-30T22:18:46.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.247+0000 7f80fd5f2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80f8099920 0x7f80f8135060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:46.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.247+0000 7f80fd5f2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f80f812feb0 0x7f80f81355a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:46.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.247+0000 7f80fd5f2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80f81307c0 0x7f80f8135ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:46.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.247+0000 7f80fd5f2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f8138800 con 0x7f80f8099920 2023-09-30T22:18:46.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.247+0000 7f80fd5f2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f8137050 con 0x7f80f812feb0 2023-09-30T22:18:46.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.247+0000 7f80fd5f2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80f8139000 con 0x7f80f81307c0 2023-09-30T22:18:46.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.247+0000 7f80f77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80f81307c0 0x7f80f8135ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:46.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.247+0000 7f80f67fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f80f812feb0 0x7f80f81355a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:46.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.247+0000 7f80f6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80f8099920 0x7f80f8135060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:46.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.247+0000 7f80f67fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f80f812feb0 0x7f80f81355a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:60392/0 (socket says 172.21.15.156:60392) 2023-09-30T22:18:46.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.247+0000 7f80f77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80f81307c0 0x7f80f8135ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45348/0 (socket says 172.21.15.156:45348) 2023-09-30T22:18:46.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.247+0000 7f80f67fc700 1 -- 172.21.15.156:0/2857966182 learned_addr learned my addr 172.21.15.156:0/2857966182 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:46.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.247+0000 7f80f6ffd700 1 -- 172.21.15.156:0/2857966182 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80f81307c0 msgr2=0x7f80f8135ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:46.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.247+0000 7f80f6ffd700 1 --2- 172.21.15.156:0/2857966182 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80f81307c0 0x7f80f8135ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.247+0000 7f80f6ffd700 1 -- 172.21.15.156:0/2857966182 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f80f812feb0 msgr2=0x7f80f81355a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:46.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.247+0000 7f80f6ffd700 1 --2- 172.21.15.156:0/2857966182 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f80f812feb0 0x7f80f81355a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.247+0000 7f80f6ffd700 1 -- 172.21.15.156:0/2857966182 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e80094a0 con 0x7f80f8099920 2023-09-30T22:18:46.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.247+0000 7f80f6ffd700 1 --2- 172.21.15.156:0/2857966182 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80f8099920 0x7f80f8135060 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f80f806cf80 tx=0x7f80e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:46.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.247+0000 7f80ef7fe700 1 -- 172.21.15.156:0/2857966182 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e0004240 con 0x7f80f8099920 2023-09-30T22:18:46.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.248+0000 7f80ef7fe700 1 -- 172.21.15.156:0/2857966182 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e00043a0 con 0x7f80f8099920 2023-09-30T22:18:46.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.248+0000 7f80ef7fe700 1 -- 172.21.15.156:0/2857966182 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e0006910 con 0x7f80f8099920 2023-09-30T22:18:46.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.248+0000 7f80fd5f2700 1 -- 172.21.15.156:0/2857966182 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e0009430 con 0x7f80f8099920 2023-09-30T22:18:46.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.248+0000 7f80fd5f2700 1 -- 172.21.15.156:0/2857966182 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f812a2b0 con 0x7f80f8099920 2023-09-30T22:18:46.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.248+0000 7f80ef7fe700 1 -- 172.21.15.156:0/2857966182 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f80e0022020 con 0x7f80f8099920 2023-09-30T22:18:46.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.248+0000 7f80ef7fe700 1 -- 172.21.15.156:0/2857966182 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f80e0040dd0 con 0x7f80f8099920 2023-09-30T22:18:46.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.251+0000 7f8109795b80 1 Processor -- start 2023-09-30T22:18:46.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.251+0000 7f8109795b80 1 -- start start 2023-09-30T22:18:46.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.252+0000 7f8109795b80 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55ec0c19cc50 0x55ec0c19d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:46.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.252+0000 7f8109795b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec0c1b9100 0x55ec0c19d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:46.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.252+0000 7f8109795b80 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55ec0c1b38f0 0x55ec0c1b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:46.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.252+0000 7f8109795b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec0c0ffc60 con 0x55ec0c1b9100 2023-09-30T22:18:46.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.252+0000 7f8109795b80 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ec0c0faa10 con 0x55ec0c1b38f0 2023-09-30T22:18:46.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.252+0000 7f8109795b80 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x55ec0c0f8210 con 0x55ec0c19cc50 2023-09-30T22:18:46.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.252+0000 7f80f6ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55ec0c19cc50 0x55ec0c19d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:46.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.252+0000 7f80f67fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec0c1b9100 0x55ec0c19d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:46.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.252+0000 7f80f77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55ec0c1b38f0 0x55ec0c1b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:46.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.252+0000 7f80f6ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55ec0c19cc50 0x55ec0c19d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45364/0 (socket says 172.21.15.156:45364) 2023-09-30T22:18:46.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.252+0000 7f80f67fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec0c1b9100 0x55ec0c19d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48158/0 (socket says 172.21.15.156:48158) 2023-09-30T22:18:46.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.252+0000 7f80f6ffd700 1 -- 172.21.15.156:0/1824411477 learned_addr learned my addr 172.21.15.156:0/1824411477 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:46.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.252+0000 7f80f6ffd700 1 -- 172.21.15.156:0/1824411477 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55ec0c1b38f0 msgr2=0x55ec0c1b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:46.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.252+0000 7f80f6ffd700 1 --2- 172.21.15.156:0/1824411477 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55ec0c1b38f0 0x55ec0c1b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.252+0000 7f80f6ffd700 1 -- 172.21.15.156:0/1824411477 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec0c1b9100 msgr2=0x55ec0c19d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:46.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.252+0000 7f80f6ffd700 1 --2- 172.21.15.156:0/1824411477 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec0c1b9100 0x55ec0c19d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.252+0000 7f80f6ffd700 1 -- 172.21.15.156:0/1824411477 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec0bee7790 con 0x55ec0c19cc50 2023-09-30T22:18:46.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.252+0000 7f80f77fe700 1 --2- 172.21.15.156:0/1824411477 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55ec0c1b38f0 0x55ec0c1b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:46.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.252+0000 7f80f67fc700 1 --2- 172.21.15.156:0/1824411477 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec0c1b9100 0x55ec0c19d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:46.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.252+0000 7f80f6ffd700 1 --2- 172.21.15.156:0/1824411477 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55ec0c19cc50 0x55ec0c19d020 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f80e003f9c0 tx=0x7f80e000b050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1a4de027746dbc1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:46.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.252+0000 7f80ecff9700 1 -- 172.21.15.156:0/1824411477 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e001b7f0 con 0x55ec0c19cc50 2023-09-30T22:18:46.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.252+0000 7f80ecff9700 1 -- 172.21.15.156:0/1824411477 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e00243d0 con 0x55ec0c19cc50 2023-09-30T22:18:46.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.252+0000 7f80ecff9700 1 -- 172.21.15.156:0/1824411477 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e0019e10 con 0x55ec0c19cc50 2023-09-30T22:18:46.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.253+0000 7f8109795b80 1 -- 172.21.15.156:0/1824411477 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55ec0c19cc50 msgr2=0x55ec0c19d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:46.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.253+0000 7f8109795b80 1 --2- 172.21.15.156:0/1824411477 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55ec0c19cc50 0x55ec0c19d020 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f80e003f9c0 tx=0x7f80e000b050 comp rx=0 tx=0).stop 2023-09-30T22:18:46.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.253+0000 7f8109795b80 1 -- 172.21.15.156:0/1824411477 shutdown_connections 2023-09-30T22:18:46.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.253+0000 7f8109795b80 1 --2- 172.21.15.156:0/1824411477 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55ec0c1b38f0 0x55ec0c1b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.253+0000 7f8109795b80 1 --2- 172.21.15.156:0/1824411477 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55ec0c19cc50 0x55ec0c19d020 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.253+0000 7f8109795b80 1 --2- 172.21.15.156:0/1824411477 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec0c1b9100 0x55ec0c19d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.253+0000 7f8109795b80 1 -- 172.21.15.156:0/1824411477 >> 172.21.15.156:0/1824411477 conn(0x55ec0c1a10f0 msgr2=0x55ec0c1a0690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:46.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.253+0000 7f8109795b80 1 -- 172.21.15.156:0/1824411477 shutdown_connections 2023-09-30T22:18:46.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.253+0000 7f8109795b80 1 -- 172.21.15.156:0/1824411477 wait complete. 2023-09-30T22:18:46.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.254+0000 7f8109795b80 1 -- start start 2023-09-30T22:18:46.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.254+0000 7f8109795b80 1 Processor -- start 2023-09-30T22:18:46.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.254+0000 7f8109795b80 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55ec0c19cc50 0x55ec0c1c21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:46.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.254+0000 7f8109795b80 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55ec0c1b38f0 0x55ec0c1c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:46.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.254+0000 7f8109795b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec0c1b9100 0x55ec0c1c2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:46.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.254+0000 7f8109795b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec0c0f3b00 con 0x55ec0c1b9100 2023-09-30T22:18:46.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.254+0000 7f8109795b80 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ec0c08f770 con 0x55ec0c1b38f0 2023-09-30T22:18:46.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.254+0000 7f8109795b80 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x55ec0c0b26f0 con 0x55ec0c19cc50 2023-09-30T22:18:46.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.254+0000 7f8109795b80 10 client.0 _ll_register_callbacks cb 0x55ec0befb5a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:18:46.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.254+0000 7f80f6ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55ec0c19cc50 0x55ec0c1c21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:46.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.254+0000 7f80f6ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55ec0c19cc50 0x55ec0c1c21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45372/0 (socket says 172.21.15.156:45372) 2023-09-30T22:18:46.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.254+0000 7f80f77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec0c1b9100 0x55ec0c1c2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:46.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.254+0000 7f80f6ffd700 1 -- 172.21.15.156:0/1945713807 learned_addr learned my addr 172.21.15.156:0/1945713807 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:46.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.254+0000 7f80f67fc700 1 --2- 172.21.15.156:0/1945713807 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55ec0c1b38f0 0x55ec0c1c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:46.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.254+0000 7f80f77fe700 1 -- 172.21.15.156:0/1945713807 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55ec0c19cc50 msgr2=0x55ec0c1c21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:46.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.254+0000 7f80f77fe700 1 --2- 172.21.15.156:0/1945713807 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55ec0c19cc50 0x55ec0c1c21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.254+0000 7f80f77fe700 1 -- 172.21.15.156:0/1945713807 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55ec0c1b38f0 msgr2=0x55ec0c1c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:46.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.254+0000 7f80f77fe700 1 --2- 172.21.15.156:0/1945713807 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55ec0c1b38f0 0x55ec0c1c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.255+0000 7f80f77fe700 1 -- 172.21.15.156:0/1945713807 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e8009df0 con 0x55ec0c1b9100 2023-09-30T22:18:46.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.255+0000 7f80f67fc700 1 --2- 172.21.15.156:0/1945713807 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55ec0c1b38f0 0x55ec0c1c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:46.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.255+0000 7f80f6ffd700 1 --2- 172.21.15.156:0/1945713807 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55ec0c19cc50 0x55ec0c1c21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:46.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.255+0000 7f80f77fe700 1 --2- 172.21.15.156:0/1945713807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec0c1b9100 0x55ec0c1c2c20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f80f00012e0 tx=0x7f80f00125a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b077b80a476fa3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:46.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.255+0000 7f80d5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-30T22:18:46.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.255+0000 7f80d5ffb700 1 -- 172.21.15.156:0/1945713807 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0012c60 con 0x55ec0c1b9100 2023-09-30T22:18:46.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.255+0000 7f80d5ffb700 1 -- 172.21.15.156:0/1945713807 <== mon.0 v2:172.21.15.156:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f80f0012dc0 con 0x55ec0c1b9100 2023-09-30T22:18:46.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.255+0000 7f8109795b80 1 -- 172.21.15.156:0/1945713807 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ec0c1952b0 con 0x55ec0c1b9100 2023-09-30T22:18:46.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.255+0000 7f80d5ffb700 1 -- 172.21.15.156:0/1945713807 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80f0020460 con 0x55ec0c1b9100 2023-09-30T22:18:46.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.255+0000 7f8109795b80 10 client.14451 fetch_fsmap learned FSMap version 7 2023-09-30T22:18:46.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.255+0000 7f8109795b80 1 -- 172.21.15.156:0/1945713807 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=3+}) v3 -- 0x7f80f812a2b0 con 0x55ec0c1b9100 2023-09-30T22:18:46.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.255+0000 7f80d5ffb700 1 -- 172.21.15.156:0/1945713807 <== mon.0 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f0024020 con 0x55ec0c1b9100 2023-09-30T22:18:46.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.255+0000 7f80d5ffb700 1 -- 172.21.15.156:0/1945713807 <== mon.0 v2:172.21.15.156:3300/0 5 ==== fsmap(e 7) v1 ==== 1436+0+0 (secure 0 0 0) 0x7f80f0020c00 con 0x55ec0c1b9100 2023-09-30T22:18:46.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.255+0000 7f8109795b80 10 client.14451 fetch_fsmap finished waiting for FSMap version 7 2023-09-30T22:18:46.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.255+0000 7f8109795b80 10 client.14451 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:18:46.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.255+0000 7f8109795b80 20 client.14451 populate_metadata read hostname 'smithi156' 2023-09-30T22:18:46.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.255+0000 7f8109795b80 4 client.14451 mds_command: new command op to 4206 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-30T22:18:46.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.255+0000 7f8109795b80 1 -- 172.21.15.156:0/1945713807 --> v1:172.21.15.156:6817/3817969673 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ec0c171f40 con 0x55ec0c1b3260 2023-09-30T22:18:46.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.255+0000 7f80d5ffb700 10 client.14451 ms_handle_connect on v1:172.21.15.156:6817/3817969673 2023-09-30T22:18:46.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.256+0000 7f80d5ffb700 1 -- 172.21.15.156:0/1945713807 <== mds.0 v1:172.21.15.156:6817/3817969673 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x55ec0c171f40 con 0x55ec0c1b3260 2023-09-30T22:18:46.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.256+0000 7f80d5ffb700 10 client.14451 handle_command_reply: tid=0 2023-09-30T22:18:46.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.256+0000 7f8109795b80 1 client.14451 shutdown 2023-09-30T22:18:46.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.256+0000 7f8109795b80 1 -- 172.21.15.156:0/1945713807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec0c1b9100 msgr2=0x55ec0c1c2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:46.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.256+0000 7f8109795b80 1 --2- 172.21.15.156:0/1945713807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec0c1b9100 0x55ec0c1c2c20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f80f00012e0 tx=0x7f80f00125a0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.256+0000 7f8109795b80 1 -- 172.21.15.156:0/1945713807 shutdown_connections 2023-09-30T22:18:46.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.256+0000 7f8109795b80 1 --2- 172.21.15.156:0/1945713807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec0c1b9100 0x55ec0c1c2c20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.256+0000 7f8109795b80 1 --2- 172.21.15.156:0/1945713807 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55ec0c19cc50 0x55ec0c1c21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.256+0000 7f80d5ffb700 0 client.14451 ms_handle_reset on v1:172.21.15.156:6817/3817969673 2023-09-30T22:18:46.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.256+0000 7f8109795b80 1 --2- 172.21.15.156:0/1945713807 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55ec0c1b38f0 0x55ec0c1c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.256+0000 7f8109795b80 1 -- 172.21.15.156:0/1945713807 >> 172.21.15.156:0/1945713807 conn(0x55ec0c1a10f0 msgr2=0x55ec0c19d230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:46.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.256+0000 7f8109795b80 1 -- 172.21.15.156:0/1945713807 shutdown_connections 2023-09-30T22:18:46.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.256+0000 7f8109795b80 1 -- 172.21.15.156:0/1945713807 wait complete. 2023-09-30T22:18:46.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.256+0000 7f8109795b80 20 client.14451 trim_cache size 0 max 16384 2023-09-30T22:18:46.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.273+0000 7f8109795b80 1 Processor -- start 2023-09-30T22:18:46.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.273+0000 7f8109795b80 1 -- start start 2023-09-30T22:18:46.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.273+0000 7f8109795b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec0c19cc50 0x55ec0c1ddd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:46.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.273+0000 7f8109795b80 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55ec0c1b38f0 0x55ec0c1a0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:46.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.273+0000 7f8109795b80 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55ec0c1b9100 0x55ec0c19d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:46.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.273+0000 7f8109795b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec0bee8390 con 0x55ec0c19cc50 2023-09-30T22:18:46.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.273+0000 7f8109795b80 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ec0c1bb790 con 0x55ec0c1b38f0 2023-09-30T22:18:46.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.273+0000 7f8109795b80 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x55ec0c1bd700 con 0x55ec0c1b9100 2023-09-30T22:18:46.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.273+0000 7f80f6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec0c19cc50 0x55ec0c1ddd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:46.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.273+0000 7f80f67fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55ec0c1b38f0 0x55ec0c1a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:46.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.273+0000 7f80f77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55ec0c1b9100 0x55ec0c19d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:46.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.273+0000 7f80f67fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55ec0c1b38f0 0x55ec0c1a0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:60420/0 (socket says 172.21.15.156:60420) 2023-09-30T22:18:46.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.273+0000 7f80f6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec0c19cc50 0x55ec0c1ddd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48188/0 (socket says 172.21.15.156:48188) 2023-09-30T22:18:46.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.273+0000 7f80f67fc700 1 -- 172.21.15.156:0/2192009452 learned_addr learned my addr 172.21.15.156:0/2192009452 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:46.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.273+0000 7f80f77fe700 1 -- 172.21.15.156:0/2192009452 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55ec0c1b38f0 msgr2=0x55ec0c1a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:46.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.273+0000 7f80f77fe700 1 --2- 172.21.15.156:0/2192009452 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55ec0c1b38f0 0x55ec0c1a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.274+0000 7f80f77fe700 1 -- 172.21.15.156:0/2192009452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec0c19cc50 msgr2=0x55ec0c1ddd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:46.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.274+0000 7f80f77fe700 1 --2- 172.21.15.156:0/2192009452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec0c19cc50 0x55ec0c1ddd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.274+0000 7f80f77fe700 1 -- 172.21.15.156:0/2192009452 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec0bfd40a0 con 0x55ec0c1b9100 2023-09-30T22:18:46.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.274+0000 7f80f6ffd700 1 --2- 172.21.15.156:0/2192009452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec0c19cc50 0x55ec0c1ddd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:46.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.274+0000 7f80f77fe700 1 --2- 172.21.15.156:0/2192009452 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55ec0c1b9100 0x55ec0c19d230 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x55ec0c1bc230 tx=0x7f80f000c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24723751fb539c63 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:46.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.274+0000 7f80ed7fa700 1 -- 172.21.15.156:0/2192009452 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0012c60 con 0x55ec0c1b9100 2023-09-30T22:18:46.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.274+0000 7f80ed7fa700 1 -- 172.21.15.156:0/2192009452 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f0024070 con 0x55ec0c1b9100 2023-09-30T22:18:46.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.274+0000 7f80ed7fa700 1 -- 172.21.15.156:0/2192009452 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f00157c0 con 0x55ec0c1b9100 2023-09-30T22:18:46.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.274+0000 7f8109795b80 1 -- 172.21.15.156:0/2192009452 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55ec0c1b9100 msgr2=0x55ec0c19d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:46.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.274+0000 7f8109795b80 1 --2- 172.21.15.156:0/2192009452 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55ec0c1b9100 0x55ec0c19d230 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x55ec0c1bc230 tx=0x7f80f000c000 comp rx=0 tx=0).stop 2023-09-30T22:18:46.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.274+0000 7f8109795b80 1 -- 172.21.15.156:0/2192009452 shutdown_connections 2023-09-30T22:18:46.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.274+0000 7f8109795b80 1 --2- 172.21.15.156:0/2192009452 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55ec0c1b9100 0x55ec0c19d230 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.274+0000 7f8109795b80 1 --2- 172.21.15.156:0/2192009452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec0c19cc50 0x55ec0c1ddd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.274+0000 7f8109795b80 1 --2- 172.21.15.156:0/2192009452 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55ec0c1b38f0 0x55ec0c1a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.274+0000 7f8109795b80 1 -- 172.21.15.156:0/2192009452 >> 172.21.15.156:0/2192009452 conn(0x55ec0c1a10f0 msgr2=0x55ec0c19fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:46.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.274+0000 7f8109795b80 1 -- 172.21.15.156:0/2192009452 shutdown_connections 2023-09-30T22:18:46.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.274+0000 7f8109795b80 1 -- 172.21.15.156:0/2192009452 wait complete. 2023-09-30T22:18:46.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.275+0000 7f8109795b80 1 -- start start 2023-09-30T22:18:46.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.275+0000 7f8109795b80 1 Processor -- start 2023-09-30T22:18:46.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.275+0000 7f8109795b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec0c19cc50 0x55ec0c1dcad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:46.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.275+0000 7f8109795b80 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55ec0c1b38f0 0x55ec0c1dd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:46.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.275+0000 7f8109795b80 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55ec0c1b9100 0x55ec0c1dd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:46.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.275+0000 7f8109795b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec0c1bca50 con 0x55ec0c19cc50 2023-09-30T22:18:46.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.275+0000 7f8109795b80 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ec0c1b2160 con 0x55ec0c1b38f0 2023-09-30T22:18:46.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.275+0000 7f8109795b80 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x55ec0c1d1030 con 0x55ec0c1b9100 2023-09-30T22:18:46.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.275+0000 7f80f6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec0c19cc50 0x55ec0c1dcad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:46.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.275+0000 7f8109795b80 10 client.0 _ll_register_callbacks cb 0x7f80f0007460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:18:46.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.275+0000 7f80f6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec0c19cc50 0x55ec0c1dcad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48194/0 (socket says 172.21.15.156:48194) 2023-09-30T22:18:46.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.275+0000 7f80f6ffd700 1 -- 172.21.15.156:0/2026754198 learned_addr learned my addr 172.21.15.156:0/2026754198 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:46.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.275+0000 7f80f67fc700 1 --2- 172.21.15.156:0/2026754198 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55ec0c1b38f0 0x55ec0c1dd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:46.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.276+0000 7f80f77fe700 1 --2- 172.21.15.156:0/2026754198 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55ec0c1b9100 0x55ec0c1dd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:46.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.276+0000 7f80f6ffd700 1 -- 172.21.15.156:0/2026754198 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55ec0c1b9100 msgr2=0x55ec0c1dd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:46.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.276+0000 7f80f6ffd700 1 --2- 172.21.15.156:0/2026754198 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55ec0c1b9100 0x55ec0c1dd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.276+0000 7f80f6ffd700 1 -- 172.21.15.156:0/2026754198 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55ec0c1b38f0 msgr2=0x55ec0c1dd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:46.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.276+0000 7f80f6ffd700 1 --2- 172.21.15.156:0/2026754198 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55ec0c1b38f0 0x55ec0c1dd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.276+0000 7f80f6ffd700 1 -- 172.21.15.156:0/2026754198 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ec0bee7790 con 0x55ec0c19cc50 2023-09-30T22:18:46.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.276+0000 7f80f6ffd700 1 --2- 172.21.15.156:0/2026754198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec0c19cc50 0x55ec0c1dcad0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f80e0019b60 tx=0x7f80e0008000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede5df4565b6e0c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:46.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.276+0000 7f80d5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-30T22:18:46.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.276+0000 7f80d5ffb700 1 -- 172.21.15.156:0/2026754198 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e0024540 con 0x55ec0c19cc50 2023-09-30T22:18:46.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.276+0000 7f80d5ffb700 1 -- 172.21.15.156:0/2026754198 <== mon.0 v2:172.21.15.156:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f80e0019bd0 con 0x55ec0c19cc50 2023-09-30T22:18:46.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.276+0000 7f8109795b80 1 -- 172.21.15.156:0/2026754198 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f80e00243d0 con 0x55ec0c19cc50 2023-09-30T22:18:46.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.276+0000 7f80d5ffb700 1 -- 172.21.15.156:0/2026754198 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80e0019d90 con 0x55ec0c19cc50 2023-09-30T22:18:46.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.276+0000 7f8109795b80 10 client.14457 fetch_fsmap learned FSMap version 7 2023-09-30T22:18:46.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.276+0000 7f8109795b80 1 -- 172.21.15.156:0/2026754198 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=3+}) v3 -- 0x7f80f812a2b0 con 0x55ec0c19cc50 2023-09-30T22:18:46.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.276+0000 7f80d5ffb700 1 -- 172.21.15.156:0/2026754198 <== mon.0 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e00243d0 con 0x55ec0c19cc50 2023-09-30T22:18:46.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.276+0000 7f80d5ffb700 1 -- 172.21.15.156:0/2026754198 <== mon.0 v2:172.21.15.156:3300/0 5 ==== fsmap(e 7) v1 ==== 1436+0+0 (secure 0 0 0) 0x7f80e001b3f0 con 0x55ec0c19cc50 2023-09-30T22:18:46.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.276+0000 7f8109795b80 10 client.14457 fetch_fsmap finished waiting for FSMap version 7 2023-09-30T22:18:46.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.276+0000 7f8109795b80 10 client.14457 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:18:46.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.276+0000 7f8109795b80 20 client.14457 populate_metadata read hostname 'smithi156' 2023-09-30T22:18:46.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.276+0000 7f8109795b80 4 client.14457 mds_command: new command op to 4206 tid=0[{"prefix": "status"}] 2023-09-30T22:18:46.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.276+0000 7f8109795b80 1 -- 172.21.15.156:0/2026754198 --> v1:172.21.15.156:6817/3817969673 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ec0c0ecce0 con 0x55ec0c21ee10 2023-09-30T22:18:46.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.277+0000 7f80d5ffb700 10 client.14457 ms_handle_connect on v1:172.21.15.156:6817/3817969673 2023-09-30T22:18:46.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.277+0000 7f80d5ffb700 1 -- 172.21.15.156:0/2026754198 <== mds.0 v1:172.21.15.156:6817/3817969673 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (unknown 0 0 619269030) 0x55ec0c0ecce0 con 0x55ec0c21ee10 2023-09-30T22:18:46.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.277+0000 7f80d5ffb700 10 client.14457 handle_command_reply: tid=0 2023-09-30T22:18:46.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.277+0000 7f8109795b80 1 client.14457 shutdown 2023-09-30T22:18:46.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.277+0000 7f8109795b80 1 -- 172.21.15.156:0/2026754198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec0c19cc50 msgr2=0x55ec0c1dcad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:46.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.277+0000 7f8109795b80 1 --2- 172.21.15.156:0/2026754198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec0c19cc50 0x55ec0c1dcad0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f80e0019b60 tx=0x7f80e0008000 comp rx=0 tx=0).stop 2023-09-30T22:18:46.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.277+0000 7f8109795b80 1 -- 172.21.15.156:0/2026754198 shutdown_connections 2023-09-30T22:18:46.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.277+0000 7f8109795b80 1 --2- 172.21.15.156:0/2026754198 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x55ec0c1b9100 0x55ec0c1dd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.277+0000 7f80d5ffb700 0 client.14457 ms_handle_reset on v1:172.21.15.156:6817/3817969673 2023-09-30T22:18:46.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.277+0000 7f8109795b80 1 --2- 172.21.15.156:0/2026754198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec0c19cc50 0x55ec0c1dcad0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.277+0000 7f8109795b80 1 --2- 172.21.15.156:0/2026754198 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x55ec0c1b38f0 0x55ec0c1dd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.277+0000 7f8109795b80 1 -- 172.21.15.156:0/2026754198 >> 172.21.15.156:0/2026754198 conn(0x55ec0c1a10f0 msgr2=0x55ec0c1a0610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:46.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.277+0000 7f8109795b80 1 -- 172.21.15.156:0/2026754198 shutdown_connections 2023-09-30T22:18:46.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.277+0000 7f8109795b80 1 -- 172.21.15.156:0/2026754198 wait complete. 2023-09-30T22:18:46.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.277+0000 7f8109795b80 20 client.14457 trim_cache size 0 max 16384 2023-09-30T22:18:46.286 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2023-09-30T22:18:46.286 INFO:teuthology.orchestra.run.smithi156.stdout: "cluster_fsid": "bf403786-ca20-4e4a-92c0-a0a997d43bba", 2023-09-30T22:18:46.286 INFO:teuthology.orchestra.run.smithi156.stdout: "whoami": 0, 2023-09-30T22:18:46.286 INFO:teuthology.orchestra.run.smithi156.stdout: "id": 4206, 2023-09-30T22:18:46.286 INFO:teuthology.orchestra.run.smithi156.stdout: "want_state": "up:active", 2023-09-30T22:18:46.286 INFO:teuthology.orchestra.run.smithi156.stdout: "state": "up:active", 2023-09-30T22:18:46.286 INFO:teuthology.orchestra.run.smithi156.stdout: "fs_name": "cephfs", 2023-09-30T22:18:46.286 INFO:teuthology.orchestra.run.smithi156.stdout: "rank_uptime": 136.48453150500001, 2023-09-30T22:18:46.286 INFO:teuthology.orchestra.run.smithi156.stdout: "mdsmap_epoch": 7, 2023-09-30T22:18:46.286 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_epoch": 22, 2023-09-30T22:18:46.287 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_epoch_barrier": 17, 2023-09-30T22:18:46.287 INFO:teuthology.orchestra.run.smithi156.stdout: "uptime": 140.763993161 2023-09-30T22:18:46.287 INFO:teuthology.orchestra.run.smithi156.stdout:} 2023-09-30T22:18:46.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.278+0000 7f80fd5f2700 1 -- 172.21.15.156:0/2857966182 >> v1:172.21.15.156:6816/126965 conn(0x7f80d802f540 legacy=0x7f80d80319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:46.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.278+0000 7f80fd5f2700 1 -- 172.21.15.156:0/2857966182 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80f8099920 msgr2=0x7f80f8135060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:46.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.278+0000 7f80fd5f2700 1 --2- 172.21.15.156:0/2857966182 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80f8099920 0x7f80f8135060 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f80f806cf80 tx=0x7f80e0004750 comp rx=0 tx=0).stop 2023-09-30T22:18:46.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.278+0000 7f80fd5f2700 1 -- 172.21.15.156:0/2857966182 shutdown_connections 2023-09-30T22:18:46.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.278+0000 7f80fd5f2700 1 --2- 172.21.15.156:0/2857966182 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80f81307c0 0x7f80f8135ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.278+0000 7f80fd5f2700 1 --2- 172.21.15.156:0/2857966182 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80f8099920 0x7f80f8135060 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.278+0000 7f80fd5f2700 1 --2- 172.21.15.156:0/2857966182 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f80f812feb0 0x7f80f81355a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.278+0000 7f80fd5f2700 1 -- 172.21.15.156:0/2857966182 >> 172.21.15.156:0/2857966182 conn(0x7f80f80a2b30 msgr2=0x7f80f812f730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:46.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.278+0000 7f80fd5f2700 1 -- 172.21.15.156:0/2857966182 shutdown_connections 2023-09-30T22:18:46.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.278+0000 7f80fd5f2700 1 -- 172.21.15.156:0/2857966182 wait complete. 2023-09-30T22:18:46.290 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-09-30T22:18:46.301 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-09-30T22:18:46.301 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:18:46.330 INFO:tasks.ceph.osd.0:Stopped 2023-09-30T22:18:46.330 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 0 2023-09-30T22:18:46.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.491+0000 7f6f9228a700 1 Processor -- start 2023-09-30T22:18:46.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.491+0000 7f6f9228a700 1 -- start start 2023-09-30T22:18:46.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.492+0000 7f6f9228a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f8c133900 0x7f6f8c133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:46.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.492+0000 7f6f9228a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f8c134210 0x7f6f8c0a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:46.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.492+0000 7f6f9228a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f8c09a760 con 0x7f6f8c0a0ee0 2023-09-30T22:18:46.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.492+0000 7f6f9228a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c1336e0 con 0x7f6f8c134210 2023-09-30T22:18:46.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.492+0000 7f6f9228a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c09a080 con 0x7f6f8c133900 2023-09-30T22:18:46.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.492+0000 7f6f8b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f8c134210 0x7f6f8c0a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:46.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.492+0000 7f6f8bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f8c133900 0x7f6f8c133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:46.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.492+0000 7f6f8bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f8c133900 0x7f6f8c133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45394/0 (socket says 172.21.15.156:45394) 2023-09-30T22:18:46.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.492+0000 7f6f8b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f8c134210 0x7f6f8c0a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:60432/0 (socket says 172.21.15.156:60432) 2023-09-30T22:18:46.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.492+0000 7f6f8bfff700 1 -- 172.21.15.156:0/1837353227 learned_addr learned my addr 172.21.15.156:0/1837353227 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:46.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.492+0000 7f6f8affd700 1 -- 172.21.15.156:0/1837353227 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311873491 0 0) 0x7f6f8c09a760 con 0x7f6f8c0a0ee0 2023-09-30T22:18:46.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.492+0000 7f6f8affd700 1 -- 172.21.15.156:0/1837353227 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f740035b0 con 0x7f6f8c0a0ee0 2023-09-30T22:18:46.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.492+0000 7f6f8bfff700 1 -- 172.21.15.156:0/1837353227 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f8c134210 msgr2=0x7f6f8c0a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:46.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.492+0000 7f6f8bfff700 1 --2- 172.21.15.156:0/1837353227 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f8c134210 0x7f6f8c0a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.492+0000 7f6f8bfff700 1 -- 172.21.15.156:0/1837353227 >> v1:172.21.15.156:6789/0 conn(0x7f6f8c0a0ee0 legacy=0x7f6f8c13a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:46.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.492+0000 7f6f8bfff700 1 -- 172.21.15.156:0/1837353227 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8c0a23e0 con 0x7f6f8c133900 2023-09-30T22:18:46.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.492+0000 7f6f8b7fe700 1 --2- 172.21.15.156:0/1837353227 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f8c134210 0x7f6f8c0a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:46.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.493+0000 7f6f8bfff700 1 --2- 172.21.15.156:0/1837353227 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f8c133900 0x7f6f8c133cd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6f800098f0 tx=0x7f6f80009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d37c45f139ba35bb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:46.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.493+0000 7f6f8affd700 1 -- 172.21.15.156:0/1837353227 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f80005e30 con 0x7f6f8c133900 2023-09-30T22:18:46.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.493+0000 7f6f8affd700 1 -- 172.21.15.156:0/1837353227 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f80004030 con 0x7f6f8c133900 2023-09-30T22:18:46.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.493+0000 7f6f8affd700 1 -- 172.21.15.156:0/1837353227 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f800043e0 con 0x7f6f8c133900 2023-09-30T22:18:46.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.493+0000 7f6f9228a700 1 -- 172.21.15.156:0/1837353227 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f8c133900 msgr2=0x7f6f8c133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:46.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.493+0000 7f6f9228a700 1 --2- 172.21.15.156:0/1837353227 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f8c133900 0x7f6f8c133cd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6f800098f0 tx=0x7f6f80009c00 comp rx=0 tx=0).stop 2023-09-30T22:18:46.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.493+0000 7f6f9228a700 1 -- 172.21.15.156:0/1837353227 shutdown_connections 2023-09-30T22:18:46.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.493+0000 7f6f9228a700 1 --2- 172.21.15.156:0/1837353227 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f8c133900 0x7f6f8c133cd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.493+0000 7f6f9228a700 1 --2- 172.21.15.156:0/1837353227 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f8c134210 0x7f6f8c0a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.493+0000 7f6f9228a700 1 -- 172.21.15.156:0/1837353227 >> 172.21.15.156:0/1837353227 conn(0x7f6f8c0a2980 msgr2=0x7f6f8c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:46.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.493+0000 7f6f9228a700 1 -- 172.21.15.156:0/1837353227 shutdown_connections 2023-09-30T22:18:46.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.493+0000 7f6f9228a700 1 -- 172.21.15.156:0/1837353227 wait complete. 2023-09-30T22:18:46.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.494+0000 7f6f9228a700 1 Processor -- start 2023-09-30T22:18:46.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.494+0000 7f6f9228a700 1 -- start start 2023-09-30T22:18:46.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.495+0000 7f6f9228a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f8c0a0ee0 0x7f6f8c11d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:46.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.495+0000 7f6f9228a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f8c133900 0x7f6f8c11dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:46.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.495+0000 7f6f9228a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f8c134210 0x7f6f8c11e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:46.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.495+0000 7f6f9228a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c11ec40 con 0x7f6f8c0a0ee0 2023-09-30T22:18:46.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.495+0000 7f6f9228a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c121210 con 0x7f6f8c133900 2023-09-30T22:18:46.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.495+0000 7f6f9228a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c1205c0 con 0x7f6f8c134210 2023-09-30T22:18:46.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.495+0000 7f6f8bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f8c0a0ee0 0x7f6f8c11d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:46.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.495+0000 7f6f8bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f8c0a0ee0 0x7f6f8c11d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48198/0 (socket says 172.21.15.156:48198) 2023-09-30T22:18:46.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.495+0000 7f6f8bfff700 1 -- 172.21.15.156:0/1508651984 learned_addr learned my addr 172.21.15.156:0/1508651984 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:46.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.495+0000 7f6f8b7fe700 1 --2- 172.21.15.156:0/1508651984 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f8c133900 0x7f6f8c11dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:46.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.495+0000 7f6f90827700 1 --2- 172.21.15.156:0/1508651984 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f8c134210 0x7f6f8c11e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:46.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.495+0000 7f6f90827700 1 -- 172.21.15.156:0/1508651984 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f8c133900 msgr2=0x7f6f8c11dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:46.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.495+0000 7f6f90827700 1 --2- 172.21.15.156:0/1508651984 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f8c133900 0x7f6f8c11dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.495+0000 7f6f90827700 1 -- 172.21.15.156:0/1508651984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f8c0a0ee0 msgr2=0x7f6f8c11d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:46.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.495+0000 7f6f90827700 1 --2- 172.21.15.156:0/1508651984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f8c0a0ee0 0x7f6f8c11d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.495+0000 7f6f90827700 1 -- 172.21.15.156:0/1508651984 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7c0094a0 con 0x7f6f8c134210 2023-09-30T22:18:46.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.495+0000 7f6f8bfff700 1 --2- 172.21.15.156:0/1508651984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f8c0a0ee0 0x7f6f8c11d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:46.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.495+0000 7f6f90827700 1 --2- 172.21.15.156:0/1508651984 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f8c134210 0x7f6f8c11e210 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400cbc0 tx=0x7f6f8400ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:46.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.496+0000 7f6f88ff9700 1 -- 172.21.15.156:0/1508651984 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f84003c00 con 0x7f6f8c134210 2023-09-30T22:18:46.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.496+0000 7f6f88ff9700 1 -- 172.21.15.156:0/1508651984 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f84003d60 con 0x7f6f8c134210 2023-09-30T22:18:46.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.496+0000 7f6f88ff9700 1 -- 172.21.15.156:0/1508651984 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8400aa80 con 0x7f6f8c134210 2023-09-30T22:18:46.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.496+0000 7f6f9228a700 1 -- 172.21.15.156:0/1508651984 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f80009500 con 0x7f6f8c134210 2023-09-30T22:18:46.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.496+0000 7f6f9228a700 1 -- 172.21.15.156:0/1508651984 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8c09a2c0 con 0x7f6f8c134210 2023-09-30T22:18:46.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.496+0000 7f6f88ff9700 1 -- 172.21.15.156:0/1508651984 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6f8400abe0 con 0x7f6f8c134210 2023-09-30T22:18:46.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.496+0000 7f6f88ff9700 1 -- 172.21.15.156:0/1508651984 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f6f8403fae0 con 0x7f6f8c134210 2023-09-30T22:18:46.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.497+0000 7f6f9228a700 1 -- 172.21.15.156:0/1508651984 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f8c120e90 con 0x7f6f8c134210 2023-09-30T22:18:46.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.501+0000 7f6f88ff9700 1 -- 172.21.15.156:0/1508651984 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f8c120e90 con 0x7f6f8c134210 2023-09-30T22:18:46.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.696+0000 7f6f9228a700 1 -- 172.21.15.156:0/1508651984 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd down", "ids": ["0"]} v 0) v1 -- 0x7f6f8c120e90 con 0x7f6f8c134210 2023-09-30T22:18:46.697 INFO:tasks.ceph.mon.a.smithi156.stderr:2023-09-30T22:18:46.697+0000 7feb8e324700 -1 mon.a@0(leader).osd e22 definitely_dead 0 2023-09-30T22:18:46.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.801+0000 7f6f88ff9700 1 -- 172.21.15.156:0/1508651984 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["0"]}]=0 marked down osd.0. v23) v1 ==== 89+0+0 (secure 0 0 0) 0x7f6f8c120e90 con 0x7f6f8c134210 2023-09-30T22:18:46.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.804+0000 7f6f9228a700 1 -- 172.21.15.156:0/1508651984 >> v1:172.21.15.156:6816/126965 conn(0x7f6f7802f510 legacy=0x7f6f780319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:46.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.804+0000 7f6f9228a700 1 -- 172.21.15.156:0/1508651984 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f8c134210 msgr2=0x7f6f8c11e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:46.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.804+0000 7f6f9228a700 1 --2- 172.21.15.156:0/1508651984 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f8c134210 0x7f6f8c11e210 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400cbc0 tx=0x7f6f8400ced0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.805+0000 7f6f9228a700 1 -- 172.21.15.156:0/1508651984 shutdown_connections 2023-09-30T22:18:46.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.805+0000 7f6f9228a700 1 --2- 172.21.15.156:0/1508651984 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f8c134210 0x7f6f8c11e210 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.805+0000 7f6f9228a700 1 --2- 172.21.15.156:0/1508651984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f8c0a0ee0 0x7f6f8c11d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.805+0000 7f6f9228a700 1 --2- 172.21.15.156:0/1508651984 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f8c133900 0x7f6f8c11dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:46.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.805+0000 7f6f9228a700 1 -- 172.21.15.156:0/1508651984 >> 172.21.15.156:0/1508651984 conn(0x7f6f8c0a2980 msgr2=0x7f6f8c1bab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:46.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.805+0000 7f6f9228a700 1 -- 172.21.15.156:0/1508651984 shutdown_connections 2023-09-30T22:18:46.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:46.806+0000 7f6f9228a700 1 -- 172.21.15.156:0/1508651984 wait complete. 2023-09-30T22:18:46.807 INFO:teuthology.orchestra.run.smithi156.stderr:marked down osd.0. 2023-09-30T22:18:46.819 INFO:tasks.ceph.osd.0:Restarting daemon 2023-09-30T22:18:46.819 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-09-30T22:18:46.821 INFO:tasks.ceph.osd.0:Started 2023-09-30T22:18:46.821 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-09-30T22:18:46.821 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:18:46.851 INFO:tasks.ceph.osd.1:Stopped 2023-09-30T22:18:46.852 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 1 2023-09-30T22:18:47.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.015+0000 7f5ae095f700 1 Processor -- start 2023-09-30T22:18:47.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.015+0000 7f5ae095f700 1 -- start start 2023-09-30T22:18:47.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.015+0000 7f5ae095f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5adc133900 0x7f5adc133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:47.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.015+0000 7f5ae095f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5adc134210 0x7f5adc0a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:47.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.015+0000 7f5ae095f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5adc0a0ee0 0x7f5adc0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:47.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.015+0000 7f5ae095f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5adc09a760 con 0x7f5adc133900 2023-09-30T22:18:47.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.015+0000 7f5ae095f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc1336e0 con 0x7f5adc0a0ee0 2023-09-30T22:18:47.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.015+0000 7f5ae095f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc09a080 con 0x7f5adc134210 2023-09-30T22:18:47.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.015+0000 7f5ada59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5adc133900 0x7f5adc133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:47.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.015+0000 7f5ad9d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5adc134210 0x7f5adc0a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:47.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.015+0000 7f5adad9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5adc0a0ee0 0x7f5adc0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:47.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.016+0000 7f5ada59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5adc133900 0x7f5adc133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48206/0 (socket says 172.21.15.156:48206) 2023-09-30T22:18:47.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.016+0000 7f5ad9d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5adc134210 0x7f5adc0a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45426/0 (socket says 172.21.15.156:45426) 2023-09-30T22:18:47.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.016+0000 7f5adad9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5adc0a0ee0 0x7f5adc0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:60454/0 (socket says 172.21.15.156:60454) 2023-09-30T22:18:47.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.016+0000 7f5ada59c700 1 -- 172.21.15.156:0/2218161163 learned_addr learned my addr 172.21.15.156:0/2218161163 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:47.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.016+0000 7f5ad9d9b700 1 -- 172.21.15.156:0/2218161163 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5adc0a0ee0 msgr2=0x7f5adc0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:47.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.016+0000 7f5ad9d9b700 1 --2- 172.21.15.156:0/2218161163 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5adc0a0ee0 0x7f5adc0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:47.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.016+0000 7f5ad9d9b700 1 -- 172.21.15.156:0/2218161163 >> v2:172.21.15.156:3300/0 conn(0x7f5adc133900 msgr2=0x7f5adc133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:47.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.016+0000 7f5ad9d9b700 1 --2- 172.21.15.156:0/2218161163 >> v2:172.21.15.156:3300/0 conn(0x7f5adc133900 0x7f5adc133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:47.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.016+0000 7f5ad9d9b700 1 -- 172.21.15.156:0/2218161163 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5adc0a23e0 con 0x7f5adc134210 2023-09-30T22:18:47.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.016+0000 7f5ada59c700 1 --2- 172.21.15.156:0/2218161163 >> v2:172.21.15.156:3300/0 conn(0x7f5adc133900 0x7f5adc133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:47.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.016+0000 7f5ad9d9b700 1 --2- 172.21.15.156:0/2218161163 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5adc134210 0x7f5adc0a09a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0009840 tx=0x7f5ad0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d6ada3fae923654 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:47.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.016+0000 7f5ad959a700 1 -- 172.21.15.156:0/2218161163 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0011830 con 0x7f5adc134210 2023-09-30T22:18:47.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.016+0000 7f5ad959a700 1 -- 172.21.15.156:0/2218161163 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad0011990 con 0x7f5adc134210 2023-09-30T22:18:47.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.016+0000 7f5ad959a700 1 -- 172.21.15.156:0/2218161163 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0011d20 con 0x7f5adc134210 2023-09-30T22:18:47.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.017+0000 7f5ae095f700 1 -- 172.21.15.156:0/2218161163 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5adc134210 msgr2=0x7f5adc0a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:47.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.017+0000 7f5ae095f700 1 --2- 172.21.15.156:0/2218161163 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5adc134210 0x7f5adc0a09a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0009840 tx=0x7f5ad0009b50 comp rx=0 tx=0).stop 2023-09-30T22:18:47.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.017+0000 7f5ae095f700 1 -- 172.21.15.156:0/2218161163 shutdown_connections 2023-09-30T22:18:47.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.017+0000 7f5ae095f700 1 --2- 172.21.15.156:0/2218161163 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5adc0a0ee0 0x7f5adc0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:47.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.017+0000 7f5ae095f700 1 --2- 172.21.15.156:0/2218161163 >> v2:172.21.15.156:3300/0 conn(0x7f5adc133900 0x7f5adc133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:47.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.017+0000 7f5ae095f700 1 --2- 172.21.15.156:0/2218161163 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5adc134210 0x7f5adc0a09a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:47.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.017+0000 7f5ae095f700 1 -- 172.21.15.156:0/2218161163 >> 172.21.15.156:0/2218161163 conn(0x7f5adc0a2980 msgr2=0x7f5adc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:47.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.017+0000 7f5ae095f700 1 -- 172.21.15.156:0/2218161163 shutdown_connections 2023-09-30T22:18:47.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.017+0000 7f5ae095f700 1 -- 172.21.15.156:0/2218161163 wait complete. 2023-09-30T22:18:47.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.018+0000 7f5ae095f700 1 Processor -- start 2023-09-30T22:18:47.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.018+0000 7f5ae095f700 1 -- start start 2023-09-30T22:18:47.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.018+0000 7f5ae095f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5adc0a0ee0 0x7f5adc11d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:47.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.018+0000 7f5ae095f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5adc133900 0x7f5adc11dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:47.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.018+0000 7f5ae095f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5adc134210 0x7f5adc11e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:47.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.018+0000 7f5ae095f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc11f890 con 0x7f5adc134210 2023-09-30T22:18:47.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.018+0000 7f5ae095f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc120950 con 0x7f5adc133900 2023-09-30T22:18:47.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.018+0000 7f5ae095f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc09a2c0 con 0x7f5adc0a0ee0 2023-09-30T22:18:47.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.018+0000 7f5ada59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5adc0a0ee0 0x7f5adc11d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:47.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.018+0000 7f5ad9d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5adc133900 0x7f5adc11dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:47.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.018+0000 7f5adad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5adc134210 0x7f5adc11e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:47.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.018+0000 7f5ada59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5adc0a0ee0 0x7f5adc11d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45432/0 (socket says 172.21.15.156:45432) 2023-09-30T22:18:47.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.018+0000 7f5ad9d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5adc133900 0x7f5adc11dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:60470/0 (socket says 172.21.15.156:60470) 2023-09-30T22:18:47.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.018+0000 7f5ada59c700 1 -- 172.21.15.156:0/1488359499 learned_addr learned my addr 172.21.15.156:0/1488359499 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:47.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.019+0000 7f5adad9d700 1 -- 172.21.15.156:0/1488359499 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5adc0a0ee0 msgr2=0x7f5adc11d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:47.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.019+0000 7f5adad9d700 1 --2- 172.21.15.156:0/1488359499 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5adc0a0ee0 0x7f5adc11d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:47.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.019+0000 7f5adad9d700 1 -- 172.21.15.156:0/1488359499 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5adc133900 msgr2=0x7f5adc11dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:47.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.019+0000 7f5adad9d700 1 --2- 172.21.15.156:0/1488359499 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5adc133900 0x7f5adc11dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:47.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.019+0000 7f5adad9d700 1 -- 172.21.15.156:0/1488359499 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5acc009500 con 0x7f5adc134210 2023-09-30T22:18:47.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.019+0000 7f5ada59c700 1 --2- 172.21.15.156:0/1488359499 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5adc0a0ee0 0x7f5adc11d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:47.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.019+0000 7f5adad9d700 1 --2- 172.21.15.156:0/1488359499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5adc134210 0x7f5adc11e170 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5ad400efc0 tx=0x7f5ad400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:47.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.019+0000 7f5acaffd700 1 -- 172.21.15.156:0/1488359499 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad400cc90 con 0x7f5adc134210 2023-09-30T22:18:47.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.019+0000 7f5acaffd700 1 -- 172.21.15.156:0/1488359499 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad400f040 con 0x7f5adc134210 2023-09-30T22:18:47.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.019+0000 7f5ae095f700 1 -- 172.21.15.156:0/1488359499 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad00094a0 con 0x7f5adc134210 2023-09-30T22:18:47.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.019+0000 7f5acaffd700 1 -- 172.21.15.156:0/1488359499 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad40146c0 con 0x7f5adc134210 2023-09-30T22:18:47.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.019+0000 7f5ae095f700 1 -- 172.21.15.156:0/1488359499 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5adc11f2b0 con 0x7f5adc134210 2023-09-30T22:18:47.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.020+0000 7f5acaffd700 1 -- 172.21.15.156:0/1488359499 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5ad4014820 con 0x7f5adc134210 2023-09-30T22:18:47.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.020+0000 7f5acaffd700 1 -- 172.21.15.156:0/1488359499 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f5ad40407c0 con 0x7f5adc134210 2023-09-30T22:18:47.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.020+0000 7f5ae095f700 1 -- 172.21.15.156:0/1488359499 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5adc11a590 con 0x7f5adc134210 2023-09-30T22:18:47.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.025+0000 7f5acaffd700 1 -- 172.21.15.156:0/1488359499 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ad4009e60 con 0x7f5adc134210 2023-09-30T22:18:47.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.220+0000 7f5ae095f700 1 -- 172.21.15.156:0/1488359499 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd down", "ids": ["1"]} v 0) v1 -- 0x7f5adc04f2a0 con 0x7f5adc134210 2023-09-30T22:18:47.220 INFO:tasks.ceph.mon.a.smithi156.stderr:2023-09-30T22:18:47.220+0000 7feb8e324700 -1 mon.a@0(leader).osd e23 definitely_dead 0 2023-09-30T22:18:47.417 INFO:tasks.ceph.osd.0.smithi156.stderr:2023-09-30T22:18:47.416+0000 7f1bab3c2680 -1 Falling back to public interface 2023-09-30T22:18:47.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.802+0000 7f5acaffd700 1 -- 172.21.15.156:0/1488359499 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["1"]}]=0 marked down osd.1. v24) v1 ==== 89+0+0 (secure 0 0 0) 0x7f5ad402c080 con 0x7f5adc134210 2023-09-30T22:18:47.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.805+0000 7f5ae095f700 1 -- 172.21.15.156:0/1488359499 >> v1:172.21.15.156:6816/126965 conn(0x7f5abc02f510 legacy=0x7f5abc0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:47.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.805+0000 7f5ae095f700 1 -- 172.21.15.156:0/1488359499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5adc134210 msgr2=0x7f5adc11e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:47.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.805+0000 7f5ae095f700 1 --2- 172.21.15.156:0/1488359499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5adc134210 0x7f5adc11e170 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5ad400efc0 tx=0x7f5ad400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:18:47.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.806+0000 7f5ae095f700 1 -- 172.21.15.156:0/1488359499 shutdown_connections 2023-09-30T22:18:47.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.806+0000 7f5ae095f700 1 --2- 172.21.15.156:0/1488359499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5adc134210 0x7f5adc11e170 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:47.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.806+0000 7f5ae095f700 1 --2- 172.21.15.156:0/1488359499 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5adc0a0ee0 0x7f5adc11d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:47.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.806+0000 7f5ae095f700 1 --2- 172.21.15.156:0/1488359499 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5adc133900 0x7f5adc11dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:47.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.806+0000 7f5ae095f700 1 -- 172.21.15.156:0/1488359499 >> 172.21.15.156:0/1488359499 conn(0x7f5adc0a2980 msgr2=0x7f5adc1bae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:47.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.808+0000 7f5ae095f700 1 -- 172.21.15.156:0/1488359499 shutdown_connections 2023-09-30T22:18:47.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:47.808+0000 7f5ae095f700 1 -- 172.21.15.156:0/1488359499 wait complete. 2023-09-30T22:18:47.815 INFO:teuthology.orchestra.run.smithi156.stderr:marked down osd.1. 2023-09-30T22:18:47.827 INFO:tasks.ceph.osd.1:Restarting daemon 2023-09-30T22:18:47.828 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-09-30T22:18:47.830 INFO:tasks.ceph.osd.1:Started 2023-09-30T22:18:47.831 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-09-30T22:18:47.831 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:18:47.860 INFO:tasks.ceph.osd.2:Stopped 2023-09-30T22:18:47.860 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 2 2023-09-30T22:18:48.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.023+0000 7f84872c5700 1 Processor -- start 2023-09-30T22:18:48.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.023+0000 7f84872c5700 1 -- start start 2023-09-30T22:18:48.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.024+0000 7f84872c5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f848009a150 0x7f848009e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:48.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.024+0000 7f84872c5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f848009edb0 0x7f848009f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:48.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.024+0000 7f84872c5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8480133c20 0x7f84801340a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:48.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.024+0000 7f84872c5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848009a520 con 0x7f848009edb0 2023-09-30T22:18:48.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.024+0000 7f84872c5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848009fe00 con 0x7f8480133c20 2023-09-30T22:18:48.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.024+0000 7f84872c5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f848006bec0 con 0x7f848009a150 2023-09-30T22:18:48.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.024+0000 7f8485061700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f848009a150 0x7f848009e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:48.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.024+0000 7f8484860700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f848009edb0 0x7f848009f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:48.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.024+0000 7f8485862700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8480133c20 0x7f84801340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:48.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.024+0000 7f8484860700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f848009edb0 0x7f848009f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48236/0 (socket says 172.21.15.156:48236) 2023-09-30T22:18:48.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.024+0000 7f8485862700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8480133c20 0x7f84801340a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:60474/0 (socket says 172.21.15.156:60474) 2023-09-30T22:18:48.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.024+0000 7f8485061700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f848009a150 0x7f848009e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45444/0 (socket says 172.21.15.156:45444) 2023-09-30T22:18:48.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.024+0000 7f8485862700 1 -- 172.21.15.156:0/3649396684 learned_addr learned my addr 172.21.15.156:0/3649396684 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:48.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.024+0000 7f8485862700 1 -- 172.21.15.156:0/3649396684 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f848009a150 msgr2=0x7f848009e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:48.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.024+0000 7f8485862700 1 --2- 172.21.15.156:0/3649396684 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f848009a150 0x7f848009e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:48.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.024+0000 7f8485862700 1 -- 172.21.15.156:0/3649396684 >> v2:172.21.15.156:3300/0 conn(0x7f848009edb0 msgr2=0x7f848009f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:48.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.024+0000 7f8485862700 1 --2- 172.21.15.156:0/3649396684 >> v2:172.21.15.156:3300/0 conn(0x7f848009edb0 0x7f848009f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:48.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.024+0000 7f8485862700 1 -- 172.21.15.156:0/3649396684 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848009af80 con 0x7f8480133c20 2023-09-30T22:18:48.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.024+0000 7f8484860700 1 --2- 172.21.15.156:0/3649396684 >> v2:172.21.15.156:3300/0 conn(0x7f848009edb0 0x7f848009f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:48.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.024+0000 7f8485061700 1 --2- 172.21.15.156:0/3649396684 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f848009a150 0x7f848009e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:48.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.024+0000 7f8485862700 1 --2- 172.21.15.156:0/3649396684 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8480133c20 0x7f84801340a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8478009eb0 tx=0x7f847800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7c56929a3e4f62 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:48.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.025+0000 7f8477fff700 1 -- 172.21.15.156:0/3649396684 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847800e070 con 0x7f8480133c20 2023-09-30T22:18:48.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.025+0000 7f8477fff700 1 -- 172.21.15.156:0/3649396684 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f847800b890 con 0x7f8480133c20 2023-09-30T22:18:48.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.025+0000 7f8477fff700 1 -- 172.21.15.156:0/3649396684 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847800bc40 con 0x7f8480133c20 2023-09-30T22:18:48.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.025+0000 7f84872c5700 1 -- 172.21.15.156:0/3649396684 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8480133c20 msgr2=0x7f84801340a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:48.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.025+0000 7f84872c5700 1 --2- 172.21.15.156:0/3649396684 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8480133c20 0x7f84801340a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8478009eb0 tx=0x7f847800b330 comp rx=0 tx=0).stop 2023-09-30T22:18:48.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.025+0000 7f84872c5700 1 -- 172.21.15.156:0/3649396684 shutdown_connections 2023-09-30T22:18:48.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.025+0000 7f84872c5700 1 --2- 172.21.15.156:0/3649396684 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8480133c20 0x7f84801340a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:48.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.025+0000 7f84872c5700 1 --2- 172.21.15.156:0/3649396684 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f848009a150 0x7f848009e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:48.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.025+0000 7f84872c5700 1 --2- 172.21.15.156:0/3649396684 >> v2:172.21.15.156:3300/0 conn(0x7f848009edb0 0x7f848009f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:48.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.025+0000 7f84872c5700 1 -- 172.21.15.156:0/3649396684 >> 172.21.15.156:0/3649396684 conn(0x7f84800a4430 msgr2=0x7f84800a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:48.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.025+0000 7f84872c5700 1 -- 172.21.15.156:0/3649396684 shutdown_connections 2023-09-30T22:18:48.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.025+0000 7f84872c5700 1 -- 172.21.15.156:0/3649396684 wait complete. 2023-09-30T22:18:48.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.026+0000 7f84872c5700 1 Processor -- start 2023-09-30T22:18:48.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.026+0000 7f84872c5700 1 -- start start 2023-09-30T22:18:48.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.027+0000 7f84872c5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f848009a150 0x7f8480122b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:48.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.027+0000 7f84872c5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f848009edb0 0x7f8480123060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:48.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.027+0000 7f84872c5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8480133c20 0x7f84801235a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:48.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.027+0000 7f84872c5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8480126360 con 0x7f848009edb0 2023-09-30T22:18:48.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.027+0000 7f84872c5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8480124840 con 0x7f8480133c20 2023-09-30T22:18:48.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.027+0000 7f84872c5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8480124ce0 con 0x7f848009a150 2023-09-30T22:18:48.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.027+0000 7f8485061700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f848009a150 0x7f8480122b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:48.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.027+0000 7f8485862700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8480133c20 0x7f84801235a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:48.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.027+0000 7f8484860700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f848009edb0 0x7f8480123060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:48.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.027+0000 7f8485061700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f848009a150 0x7f8480122b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45454/0 (socket says 172.21.15.156:45454) 2023-09-30T22:18:48.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.027+0000 7f8485862700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8480133c20 0x7f84801235a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:60488/0 (socket says 172.21.15.156:60488) 2023-09-30T22:18:48.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.027+0000 7f8485061700 1 -- 172.21.15.156:0/2596059855 learned_addr learned my addr 172.21.15.156:0/2596059855 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:48.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.027+0000 7f8485061700 1 -- 172.21.15.156:0/2596059855 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8480133c20 msgr2=0x7f84801235a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:48.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.027+0000 7f8485061700 1 --2- 172.21.15.156:0/2596059855 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8480133c20 0x7f84801235a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:48.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.027+0000 7f8485061700 1 -- 172.21.15.156:0/2596059855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f848009edb0 msgr2=0x7f8480123060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:48.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.027+0000 7f8485061700 1 --2- 172.21.15.156:0/2596059855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f848009edb0 0x7f8480123060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:48.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.027+0000 7f8485061700 1 -- 172.21.15.156:0/2596059855 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84700094a0 con 0x7f848009a150 2023-09-30T22:18:48.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.027+0000 7f8485862700 1 --2- 172.21.15.156:0/2596059855 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8480133c20 0x7f84801235a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:48.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.027+0000 7f8485061700 1 --2- 172.21.15.156:0/2596059855 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f848009a150 0x7f8480122b20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f847000ebe0 tx=0x7f847000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:48.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.027+0000 7f8475ffb700 1 -- 172.21.15.156:0/2596059855 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8470009760 con 0x7f848009a150 2023-09-30T22:18:48.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.027+0000 7f8475ffb700 1 -- 172.21.15.156:0/2596059855 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f847000c850 con 0x7f848009a150 2023-09-30T22:18:48.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.027+0000 7f84872c5700 1 -- 172.21.15.156:0/2596059855 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f847c0094a0 con 0x7f848009a150 2023-09-30T22:18:48.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.027+0000 7f8475ffb700 1 -- 172.21.15.156:0/2596059855 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847000cbe0 con 0x7f848009a150 2023-09-30T22:18:48.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.028+0000 7f84872c5700 1 -- 172.21.15.156:0/2596059855 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8478009b30 con 0x7f848009a150 2023-09-30T22:18:48.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.028+0000 7f8475ffb700 1 -- 172.21.15.156:0/2596059855 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f847000cd40 con 0x7f848009a150 2023-09-30T22:18:48.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.028+0000 7f8475ffb700 1 -- 172.21.15.156:0/2596059855 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f847003ffb0 con 0x7f848009a150 2023-09-30T22:18:48.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.028+0000 7f84872c5700 1 -- 172.21.15.156:0/2596059855 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f848009fa30 con 0x7f848009a150 2023-09-30T22:18:48.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.033+0000 7f8475ffb700 1 -- 172.21.15.156:0/2596059855 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8470021080 con 0x7f848009a150 2023-09-30T22:18:48.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.230+0000 7f84872c5700 1 -- 172.21.15.156:0/2596059855 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd down", "ids": ["2"]} v 0) v1 -- 0x7f8480126160 con 0x7f848009a150 2023-09-30T22:18:48.231 INFO:tasks.ceph.mon.a.smithi156.stderr:2023-09-30T22:18:48.231+0000 7feb8e324700 -1 mon.a@0(leader).osd e24 definitely_dead 0 2023-09-30T22:18:48.422 INFO:tasks.ceph.osd.1.smithi156.stderr:2023-09-30T22:18:48.421+0000 7f68a9e97680 -1 Falling back to public interface 2023-09-30T22:18:48.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.808+0000 7f8475ffb700 1 -- 172.21.15.156:0/2596059855 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["2"]}]=0 marked down osd.2. v25) v1 ==== 89+0+0 (secure 0 0 0) 0x7f847001b3b0 con 0x7f848009a150 2023-09-30T22:18:48.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.812+0000 7f84872c5700 1 -- 172.21.15.156:0/2596059855 >> v1:172.21.15.156:6816/126965 conn(0x7f846402f510 legacy=0x7f84640319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:48.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.812+0000 7f84872c5700 1 -- 172.21.15.156:0/2596059855 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f848009a150 msgr2=0x7f8480122b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:48.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.812+0000 7f84872c5700 1 --2- 172.21.15.156:0/2596059855 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f848009a150 0x7f8480122b20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f847000ebe0 tx=0x7f847000eef0 comp rx=0 tx=0).stop 2023-09-30T22:18:48.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.812+0000 7f84872c5700 1 -- 172.21.15.156:0/2596059855 shutdown_connections 2023-09-30T22:18:48.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.812+0000 7f84872c5700 1 --2- 172.21.15.156:0/2596059855 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8480133c20 0x7f84801235a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:48.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.812+0000 7f84872c5700 1 --2- 172.21.15.156:0/2596059855 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f848009a150 0x7f8480122b20 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f847000ebe0 tx=0x7f847000eef0 comp rx=0 tx=0).stop 2023-09-30T22:18:48.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.812+0000 7f84872c5700 1 --2- 172.21.15.156:0/2596059855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f848009edb0 0x7f8480123060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:48.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.812+0000 7f84872c5700 1 -- 172.21.15.156:0/2596059855 >> 172.21.15.156:0/2596059855 conn(0x7f84800a4430 msgr2=0x7f848009c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:48.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.813+0000 7f84872c5700 1 -- 172.21.15.156:0/2596059855 shutdown_connections 2023-09-30T22:18:48.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:48.813+0000 7f84872c5700 1 -- 172.21.15.156:0/2596059855 wait complete. 2023-09-30T22:18:48.815 INFO:teuthology.orchestra.run.smithi156.stderr:marked down osd.2. 2023-09-30T22:18:48.829 INFO:tasks.ceph.osd.2:Restarting daemon 2023-09-30T22:18:48.829 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-09-30T22:18:48.832 INFO:tasks.ceph.osd.2:Started 2023-09-30T22:18:48.832 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-09-30T22:18:48.832 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:18:48.865 INFO:tasks.ceph.osd.3:Stopped 2023-09-30T22:18:48.865 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 3 2023-09-30T22:18:49.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.028+0000 7f0819d96700 1 Processor -- start 2023-09-30T22:18:49.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.028+0000 7f0819d96700 1 -- start start 2023-09-30T22:18:49.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.029+0000 7f0819d96700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0814099e20 0x7f081409a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:49.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.029+0000 7f0819d96700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f081409a730 0x7f0814130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:49.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.029+0000 7f0819d96700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0814099a60 con 0x7f0814130890 2023-09-30T22:18:49.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.029+0000 7f0819d96700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f081409bf50 con 0x7f0814099e20 2023-09-30T22:18:49.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.029+0000 7f0819d96700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f081409b230 con 0x7f081409a730 2023-09-30T22:18:49.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.029+0000 7f08137fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0814099e20 0x7f081409a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:49.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.029+0000 7f0812ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f081409a730 0x7f0814130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:49.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.029+0000 7f0813fff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f0814130890 0x7f0814137680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:56970/0 (socket says 172.21.15.156:56970) 2023-09-30T22:18:49.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.029+0000 7f0813fff700 1 -- 172.21.15.156:0/2551599042 learned_addr learned my addr 172.21.15.156:0/2551599042 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:18:49.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.029+0000 7f08137fe700 1 -- 172.21.15.156:0/2551599042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f081409a730 msgr2=0x7f0814130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:49.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.029+0000 7f08137fe700 1 --2- 172.21.15.156:0/2551599042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f081409a730 0x7f0814130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:49.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.029+0000 7f08137fe700 1 -- 172.21.15.156:0/2551599042 >> v1:172.21.15.156:6789/0 conn(0x7f0814130890 legacy=0x7f0814137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:49.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.029+0000 7f08137fe700 1 -- 172.21.15.156:0/2551599042 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081409bb90 con 0x7f0814099e20 2023-09-30T22:18:49.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.029+0000 7f0812ffd700 1 --2- 172.21.15.156:0/2551599042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f081409a730 0x7f0814130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:49.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.029+0000 7f08137fe700 1 --2- 172.21.15.156:0/2551599042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0814099e20 0x7f081409a1f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0808009820 tx=0x7f0808009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35ebd82346008f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:49.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.029+0000 7f08127fc700 1 -- 172.21.15.156:0/2551599042 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0808005e30 con 0x7f0814099e20 2023-09-30T22:18:49.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.029+0000 7f08127fc700 1 -- 172.21.15.156:0/2551599042 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0808006030 con 0x7f0814099e20 2023-09-30T22:18:49.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.029+0000 7f08127fc700 1 -- 172.21.15.156:0/2551599042 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08080063c0 con 0x7f0814099e20 2023-09-30T22:18:49.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.030+0000 7f0819d96700 1 -- 172.21.15.156:0/2551599042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0814099e20 msgr2=0x7f081409a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:49.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.030+0000 7f0819d96700 1 --2- 172.21.15.156:0/2551599042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0814099e20 0x7f081409a1f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0808009820 tx=0x7f0808009b30 comp rx=0 tx=0).stop 2023-09-30T22:18:49.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.030+0000 7f0819d96700 1 -- 172.21.15.156:0/2551599042 shutdown_connections 2023-09-30T22:18:49.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.030+0000 7f0819d96700 1 --2- 172.21.15.156:0/2551599042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0814099e20 0x7f081409a1f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:49.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.030+0000 7f0819d96700 1 --2- 172.21.15.156:0/2551599042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f081409a730 0x7f0814130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:49.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.030+0000 7f0819d96700 1 -- 172.21.15.156:0/2551599042 >> 172.21.15.156:0/2551599042 conn(0x7f08140a2980 msgr2=0x7f08140a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:49.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.030+0000 7f0819d96700 1 -- 172.21.15.156:0/2551599042 shutdown_connections 2023-09-30T22:18:49.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.030+0000 7f0819d96700 1 -- 172.21.15.156:0/2551599042 wait complete. 2023-09-30T22:18:49.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.031+0000 7f0819d96700 1 Processor -- start 2023-09-30T22:18:49.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.031+0000 7f0819d96700 1 -- start start 2023-09-30T22:18:49.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.031+0000 7f0819d96700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0814099e20 0x7f081412ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:49.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.031+0000 7f0819d96700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f081409a730 0x7f081412b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:49.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.031+0000 7f0819d96700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0814130890 0x7f08141c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:49.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.031+0000 7f0819d96700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081412ddf0 con 0x7f0814099e20 2023-09-30T22:18:49.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.031+0000 7f0819d96700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08141399f0 con 0x7f0814130890 2023-09-30T22:18:49.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.031+0000 7f0819d96700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f081412aa00 con 0x7f081409a730 2023-09-30T22:18:49.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.032+0000 7f08137fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0814099e20 0x7f081412ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:49.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.032+0000 7f0812ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f081409a730 0x7f081412b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:49.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.032+0000 7f08137fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0814099e20 0x7f081412ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48276/0 (socket says 172.21.15.156:48276) 2023-09-30T22:18:49.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.032+0000 7f08137fe700 1 -- 172.21.15.156:0/3574429867 learned_addr learned my addr 172.21.15.156:0/3574429867 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:49.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.032+0000 7f0812ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f081409a730 0x7f081412b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45498/0 (socket says 172.21.15.156:45498) 2023-09-30T22:18:49.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.032+0000 7f0813fff700 1 --2- 172.21.15.156:0/3574429867 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0814130890 0x7f08141c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:49.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.032+0000 7f08137fe700 1 -- 172.21.15.156:0/3574429867 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f081409a730 msgr2=0x7f081412b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:49.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.032+0000 7f08137fe700 1 --2- 172.21.15.156:0/3574429867 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f081409a730 0x7f081412b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:49.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.032+0000 7f08137fe700 1 -- 172.21.15.156:0/3574429867 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0814130890 msgr2=0x7f08141c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:49.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.032+0000 7f08137fe700 1 --2- 172.21.15.156:0/3574429867 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0814130890 0x7f08141c5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:49.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.032+0000 7f08137fe700 1 -- 172.21.15.156:0/3574429867 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08040094a0 con 0x7f0814099e20 2023-09-30T22:18:49.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.032+0000 7f0812ffd700 1 --2- 172.21.15.156:0/3574429867 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f081409a730 0x7f081412b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:49.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.032+0000 7f0813fff700 1 --2- 172.21.15.156:0/3574429867 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0814130890 0x7f08141c5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:49.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.032+0000 7f08137fe700 1 --2- 172.21.15.156:0/3574429867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0814099e20 0x7f081412ae80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0808000c00 tx=0x7f0808004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:49.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.032+0000 7f07fbfff700 1 -- 172.21.15.156:0/3574429867 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0808022070 con 0x7f0814099e20 2023-09-30T22:18:49.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.032+0000 7f07fbfff700 1 -- 172.21.15.156:0/3574429867 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080801c720 con 0x7f0814099e20 2023-09-30T22:18:49.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.032+0000 7f0819d96700 1 -- 172.21.15.156:0/3574429867 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0808009430 con 0x7f0814099e20 2023-09-30T22:18:49.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.032+0000 7f07fbfff700 1 -- 172.21.15.156:0/3574429867 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080801cad0 con 0x7f0814099e20 2023-09-30T22:18:49.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.032+0000 7f0819d96700 1 -- 172.21.15.156:0/3574429867 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f081412b900 con 0x7f0814099e20 2023-09-30T22:18:49.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.033+0000 7f07fbfff700 1 -- 172.21.15.156:0/3574429867 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f080801cc30 con 0x7f0814099e20 2023-09-30T22:18:49.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.033+0000 7f07fbfff700 1 -- 172.21.15.156:0/3574429867 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f08080448d0 con 0x7f0814099e20 2023-09-30T22:18:49.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.033+0000 7f0819d96700 1 -- 172.21.15.156:0/3574429867 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0814072480 con 0x7f0814099e20 2023-09-30T22:18:49.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.038+0000 7f07fbfff700 1 -- 172.21.15.156:0/3574429867 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0814072480 con 0x7f0814099e20 2023-09-30T22:18:49.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.233+0000 7f0819d96700 1 -- 172.21.15.156:0/3574429867 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd down", "ids": ["3"]} v 0) v1 -- 0x7f0814072480 con 0x7f0814099e20 2023-09-30T22:18:49.234 INFO:tasks.ceph.mon.a.smithi156.stderr:2023-09-30T22:18:49.234+0000 7feb8e324700 -1 mon.a@0(leader).osd e25 definitely_dead 0 2023-09-30T22:18:49.426 INFO:tasks.ceph.osd.2.smithi156.stderr:2023-09-30T22:18:49.426+0000 7fa525bbf680 -1 Falling back to public interface 2023-09-30T22:18:49.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.812+0000 7f07fbfff700 1 -- 172.21.15.156:0/3574429867 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["3"]}]=0 marked down osd.3. v26) v1 ==== 89+0+0 (secure 0 0 0) 0x7f0814072480 con 0x7f0814099e20 2023-09-30T22:18:49.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.815+0000 7f0819d96700 1 -- 172.21.15.156:0/3574429867 >> v1:172.21.15.156:6816/126965 conn(0x7f080002f510 legacy=0x7f08000319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:49.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.815+0000 7f0819d96700 1 -- 172.21.15.156:0/3574429867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0814099e20 msgr2=0x7f081412ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:49.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.815+0000 7f0819d96700 1 --2- 172.21.15.156:0/3574429867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0814099e20 0x7f081412ae80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0808000c00 tx=0x7f0808004750 comp rx=0 tx=0).stop 2023-09-30T22:18:49.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.815+0000 7f0819d96700 1 -- 172.21.15.156:0/3574429867 shutdown_connections 2023-09-30T22:18:49.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.815+0000 7f0819d96700 1 --2- 172.21.15.156:0/3574429867 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0814130890 0x7f08141c5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:49.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.815+0000 7f0819d96700 1 --2- 172.21.15.156:0/3574429867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0814099e20 0x7f081412ae80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:49.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.815+0000 7f0819d96700 1 --2- 172.21.15.156:0/3574429867 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f081409a730 0x7f081412b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:49.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.815+0000 7f0819d96700 1 -- 172.21.15.156:0/3574429867 >> 172.21.15.156:0/3574429867 conn(0x7f08140a2980 msgr2=0x7f081406df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:49.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.815+0000 7f0819d96700 1 -- 172.21.15.156:0/3574429867 shutdown_connections 2023-09-30T22:18:49.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.815+0000 7f0819d96700 1 -- 172.21.15.156:0/3574429867 wait complete. 2023-09-30T22:18:49.818 INFO:teuthology.orchestra.run.smithi156.stderr:marked down osd.3. 2023-09-30T22:18:49.829 INFO:tasks.ceph.osd.3:Restarting daemon 2023-09-30T22:18:49.829 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-09-30T22:18:49.831 INFO:tasks.ceph.osd.3:Started 2023-09-30T22:18:49.831 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-30T22:18:49.831 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:18:49.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.957+0000 7fa1068b9700 1 Processor -- start 2023-09-30T22:18:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.957+0000 7fa1068b9700 1 -- start start 2023-09-30T22:18:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.958+0000 7fa1068b9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa100133ad0 0x7fa100133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.958+0000 7fa1068b9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1001300a0 0x7fa1001304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.958+0000 7fa1068b9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa10006b2d0 con 0x7fa1001309f0 2023-09-30T22:18:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.958+0000 7fa1068b9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa100133610 con 0x7fa100133ad0 2023-09-30T22:18:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.958+0000 7fa1068b9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa10009a500 con 0x7fa1001300a0 2023-09-30T22:18:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.958+0000 7fa0ff7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1001300a0 0x7fa1001304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.958+0000 7fa104e56700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fa1001309f0 0x7fa10013a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:56988/0 (socket says 172.21.15.156:56988) 2023-09-30T22:18:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.958+0000 7fa104e56700 1 -- 172.21.15.156:0/3201791101 learned_addr learned my addr 172.21.15.156:0/3201791101 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:18:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.958+0000 7fa0fffff700 1 --2- 172.21.15.156:0/3201791101 >> v2:172.21.15.156:3300/0 conn(0x7fa100133ad0 0x7fa100133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:49.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.958+0000 7fa0feffd700 1 -- 172.21.15.156:0/3201791101 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2392769180 0 0) 0x7fa10006b2d0 con 0x7fa1001309f0 2023-09-30T22:18:49.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.958+0000 7fa0fffff700 1 -- 172.21.15.156:0/3201791101 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1001300a0 msgr2=0x7fa1001304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:49.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.958+0000 7fa0fffff700 1 --2- 172.21.15.156:0/3201791101 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1001300a0 0x7fa1001304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:49.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.958+0000 7fa0fffff700 1 -- 172.21.15.156:0/3201791101 >> v1:172.21.15.156:6789/0 conn(0x7fa1001309f0 legacy=0x7fa10013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:49.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.958+0000 7fa0fffff700 1 -- 172.21.15.156:0/3201791101 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1001338b0 con 0x7fa100133ad0 2023-09-30T22:18:49.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.958+0000 7fa0ff7fe700 1 --2- 172.21.15.156:0/3201791101 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1001300a0 0x7fa1001304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:49.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.958+0000 7fa0fffff700 1 --2- 172.21.15.156:0/3201791101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa100133ad0 0x7fa100133ea0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0009840 tx=0x7fa0f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96acdd6c8348ecf6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:49.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.958+0000 7fa0feffd700 1 -- 172.21.15.156:0/3201791101 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0011830 con 0x7fa100133ad0 2023-09-30T22:18:49.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.958+0000 7fa0feffd700 1 -- 172.21.15.156:0/3201791101 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f0011990 con 0x7fa100133ad0 2023-09-30T22:18:49.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.958+0000 7fa0feffd700 1 -- 172.21.15.156:0/3201791101 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0011d20 con 0x7fa100133ad0 2023-09-30T22:18:49.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.959+0000 7fa1068b9700 1 -- 172.21.15.156:0/3201791101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa100133ad0 msgr2=0x7fa100133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:49.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.959+0000 7fa1068b9700 1 --2- 172.21.15.156:0/3201791101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa100133ad0 0x7fa100133ea0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0009840 tx=0x7fa0f0009b50 comp rx=0 tx=0).stop 2023-09-30T22:18:49.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.959+0000 7fa1068b9700 1 -- 172.21.15.156:0/3201791101 shutdown_connections 2023-09-30T22:18:49.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.959+0000 7fa1068b9700 1 --2- 172.21.15.156:0/3201791101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa100133ad0 0x7fa100133ea0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:49.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.959+0000 7fa1068b9700 1 --2- 172.21.15.156:0/3201791101 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1001300a0 0x7fa1001304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:49.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.959+0000 7fa1068b9700 1 -- 172.21.15.156:0/3201791101 >> 172.21.15.156:0/3201791101 conn(0x7fa100099c40 msgr2=0x7fa1000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:49.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.959+0000 7fa1068b9700 1 -- 172.21.15.156:0/3201791101 shutdown_connections 2023-09-30T22:18:49.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.959+0000 7fa1068b9700 1 -- 172.21.15.156:0/3201791101 wait complete. 2023-09-30T22:18:49.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.960+0000 7fa1068b9700 1 Processor -- start 2023-09-30T22:18:49.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.960+0000 7fa1068b9700 1 -- start start 2023-09-30T22:18:49.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.960+0000 7fa1068b9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1001300a0 0x7fa10011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:49.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.960+0000 7fa1068b9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1001309f0 0x7fa10011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:49.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.960+0000 7fa1068b9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa100133ad0 0x7fa10011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:49.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.960+0000 7fa1068b9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1000a3350 con 0x7fa1001309f0 2023-09-30T22:18:49.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.960+0000 7fa1068b9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10012dd00 con 0x7fa100133ad0 2023-09-30T22:18:49.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.960+0000 7fa1068b9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa100072330 con 0x7fa1001300a0 2023-09-30T22:18:49.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.961+0000 7fa0ff7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1001309f0 0x7fa10011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:49.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.961+0000 7fa104e56700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa100133ad0 0x7fa10011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:49.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.961+0000 7fa0ff7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1001309f0 0x7fa10011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48296/0 (socket says 172.21.15.156:48296) 2023-09-30T22:18:49.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.961+0000 7fa0ff7fe700 1 -- 172.21.15.156:0/2063913314 learned_addr learned my addr 172.21.15.156:0/2063913314 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:49.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.961+0000 7fa0fffff700 1 --2- 172.21.15.156:0/2063913314 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1001300a0 0x7fa10011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:49.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.961+0000 7fa104e56700 1 -- 172.21.15.156:0/2063913314 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1001300a0 msgr2=0x7fa10011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:49.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.961+0000 7fa104e56700 1 --2- 172.21.15.156:0/2063913314 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1001300a0 0x7fa10011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:49.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.961+0000 7fa104e56700 1 -- 172.21.15.156:0/2063913314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1001309f0 msgr2=0x7fa10011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:49.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.961+0000 7fa104e56700 1 --2- 172.21.15.156:0/2063913314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1001309f0 0x7fa10011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:49.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.961+0000 7fa104e56700 1 -- 172.21.15.156:0/2063913314 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f40094a0 con 0x7fa100133ad0 2023-09-30T22:18:49.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.961+0000 7fa0ff7fe700 1 --2- 172.21.15.156:0/2063913314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1001309f0 0x7fa10011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:49.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.961+0000 7fa0fffff700 1 --2- 172.21.15.156:0/2063913314 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1001300a0 0x7fa10011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:49.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.961+0000 7fa104e56700 1 --2- 172.21.15.156:0/2063913314 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa100133ad0 0x7fa10011e4c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa0f800cbe0 tx=0x7fa0f800cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:49.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.961+0000 7fa0fcff9700 1 -- 172.21.15.156:0/2063913314 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f800aa40 con 0x7fa100133ad0 2023-09-30T22:18:49.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.961+0000 7fa0fcff9700 1 -- 172.21.15.156:0/2063913314 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f800abc0 con 0x7fa100133ad0 2023-09-30T22:18:49.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.961+0000 7fa0fcff9700 1 -- 172.21.15.156:0/2063913314 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f80070d0 con 0x7fa100133ad0 2023-09-30T22:18:49.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.961+0000 7fa1068b9700 1 -- 172.21.15.156:0/2063913314 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f00094a0 con 0x7fa100133ad0 2023-09-30T22:18:49.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.961+0000 7fa1068b9700 1 -- 172.21.15.156:0/2063913314 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa10012d290 con 0x7fa100133ad0 2023-09-30T22:18:49.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.962+0000 7fa0fcff9700 1 -- 172.21.15.156:0/2063913314 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa0f8007230 con 0x7fa100133ad0 2023-09-30T22:18:49.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.962+0000 7fa0fcff9700 1 -- 172.21.15.156:0/2063913314 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fa0f803f4b0 con 0x7fa100133ad0 2023-09-30T22:18:49.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.962+0000 7fa1068b9700 1 -- 172.21.15.156:0/2063913314 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa100131120 con 0x7fa100133ad0 2023-09-30T22:18:49.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:49.967+0000 7fa0fcff9700 1 -- 172.21.15.156:0/2063913314 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa0f8018020 con 0x7fa100133ad0 2023-09-30T22:18:50.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:50.154+0000 7fa1068b9700 1 -- 172.21.15.156:0/2063913314 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa10004f2a0 con 0x7fa100133ad0 2023-09-30T22:18:50.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:50.154+0000 7fa0fcff9700 1 -- 172.21.15.156:0/2063913314 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+11979 (secure 0 0 0) 0x7fa0f80074e0 con 0x7fa100133ad0 2023-09-30T22:18:50.155 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:18:50.156 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":26,"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","created":"2023-09-30T22:16:15.239992+0000","modified":"2023-09-30T22:18:49.807414+0000","last_up_change":"2023-09-30T22:18:49.807414+0000","last_in_change":"2023-09-30T22:16:16.474206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:16:23.433906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:16:24.367795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:16:28.204677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:16:28.762804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3ec2e78a-c61f-473a-bfcb-f956cffe4095","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6812","nonce":118781}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6813","nonce":118781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6815","nonce":118781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6814","nonce":118781}]},"public_addr":"172.21.15.156:6812/118781","cluster_addr":"172.21.15.156:6813/118781","heartbeat_back_addr":"172.21.15.156:6815/118781","heartbeat_front_addr":"172.21.15.156:6814/118781","state":["exists"]},{"osd":1,"uuid":"b682e683-c15a-4bd9-8712-8af96454e9ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6803","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6805","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6807","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6806","nonce":118763}]},"public_addr":"172.21.15.156:6803/118763","cluster_addr":"172.21.15.156:6805/118763","heartbeat_back_addr":"172.21.15.156:6807/118763","heartbeat_front_addr":"172.21.15.156:6806/118763","state":["exists"]},{"osd":2,"uuid":"960dbaf0-2e0c-437e-9114-bc22ce522b26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6808","nonce":118788}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6809","nonce":118788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6811","nonce":118788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6810","nonce":118788}]},"public_addr":"172.21.15.156:6808/118788","cluster_addr":"172.21.15.156:6809/118788","heartbeat_back_addr":"172.21.15.156:6811/118788","heartbeat_front_addr":"172.21.15.156:6810/118788","state":["exists"]},{"osd":3,"uuid":"c1b19714-78b1-4869-8721-2f6352a64a05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6800","nonce":118764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6801","nonce":118764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6804","nonce":118764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6802","nonce":118764}]},"public_addr":"172.21.15.156:6800/118764","cluster_addr":"172.21.15.156:6801/118764","heartbeat_back_addr":"172.21.15.156:6804/118764","heartbeat_front_addr":"172.21.15.156:6802/118764","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.663343+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.827397+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.806655+0000","dead_epoch":25},{"osd":3,"down_stamp":"2023-09-30T22:18:49.807414+0000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.634746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.2","mappings":[{"from":3,"to":0}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.156:6816/118236":"2023-10-01T22:18:37.767496+0000","172.21.15.156:0/1464735255":"2023-10-01T22:18:37.767496+0000","172.21.15.156:0/2593263545":"2023-10-01T22:18:37.767496+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:18:50.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:50.157+0000 7fa1068b9700 1 -- 172.21.15.156:0/2063913314 >> v1:172.21.15.156:6816/126965 conn(0x7fa0ec02f510 legacy=0x7fa0ec0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:50.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:50.157+0000 7fa1068b9700 1 -- 172.21.15.156:0/2063913314 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa100133ad0 msgr2=0x7fa10011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:50.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:50.157+0000 7fa1068b9700 1 --2- 172.21.15.156:0/2063913314 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa100133ad0 0x7fa10011e4c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa0f800cbe0 tx=0x7fa0f800cef0 comp rx=0 tx=0).stop 2023-09-30T22:18:50.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:50.157+0000 7fa1068b9700 1 -- 172.21.15.156:0/2063913314 shutdown_connections 2023-09-30T22:18:50.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:50.157+0000 7fa1068b9700 1 --2- 172.21.15.156:0/2063913314 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa100133ad0 0x7fa10011e4c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:50.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:50.157+0000 7fa1068b9700 1 --2- 172.21.15.156:0/2063913314 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1001300a0 0x7fa10011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:50.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:50.157+0000 7fa1068b9700 1 --2- 172.21.15.156:0/2063913314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1001309f0 0x7fa10011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:50.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:50.157+0000 7fa1068b9700 1 -- 172.21.15.156:0/2063913314 >> 172.21.15.156:0/2063913314 conn(0x7fa100099c40 msgr2=0x7fa100132be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:50.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:50.157+0000 7fa1068b9700 1 -- 172.21.15.156:0/2063913314 shutdown_connections 2023-09-30T22:18:50.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:50.157+0000 7fa1068b9700 1 -- 172.21.15.156:0/2063913314 wait complete. 2023-09-30T22:18:50.426 INFO:tasks.ceph.osd.3.smithi156.stderr:2023-09-30T22:18:50.425+0000 7fcca839b680 -1 Falling back to public interface 2023-09-30T22:18:50.977 INFO:tasks.ceph.osd.0.smithi156.stderr:2023-09-30T22:18:50.977+0000 7f1bab3c2680 -1 osd.0 22 log_to_monitors true 2023-09-30T22:18:52.214 INFO:tasks.ceph.osd.1.smithi156.stderr:2023-09-30T22:18:52.214+0000 7f68a9e97680 -1 osd.1 22 log_to_monitors true 2023-09-30T22:18:52.556 INFO:tasks.ceph.osd.0.smithi156.stderr:2023-09-30T22:18:52.556+0000 7f1b9733d700 -1 osd.0 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:18:53.170 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:18:53.184 INFO:tasks.ceph.osd.2.smithi156.stderr:2023-09-30T22:18:53.183+0000 7fa525bbf680 -1 osd.2 24 log_to_monitors true 2023-09-30T22:18:53.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.345+0000 7f7ddd187700 1 Processor -- start 2023-09-30T22:18:53.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.345+0000 7f7ddd187700 1 -- start start 2023-09-30T22:18:53.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.345+0000 7f7ddd187700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7dd809e870 0x7f7dd809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:53.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.345+0000 7f7ddd187700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7dd809f180 0x7f7dd8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:53.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.345+0000 7f7ddd187700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd809c970 con 0x7f7dd8131d70 2023-09-30T22:18:53.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.345+0000 7f7ddd187700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd80a0920 con 0x7f7dd809e870 2023-09-30T22:18:53.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.345+0000 7f7ddd187700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd809f9c0 con 0x7f7dd809f180 2023-09-30T22:18:53.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.346+0000 7f7dd6d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7dd809e870 0x7f7dd809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:53.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.346+0000 7f7dd6d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7dd809e870 0x7f7dd809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59560/0 (socket says 172.21.15.156:59560) 2023-09-30T22:18:53.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.346+0000 7f7dd6d9d700 1 -- 172.21.15.156:0/1098439885 learned_addr learned my addr 172.21.15.156:0/1098439885 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:53.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.346+0000 7f7dd659c700 1 --2- 172.21.15.156:0/1098439885 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7dd809f180 0x7f7dd8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:53.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.346+0000 7f7dd6d9d700 1 -- 172.21.15.156:0/1098439885 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7dd809f180 msgr2=0x7f7dd8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:53.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.346+0000 7f7dd6d9d700 1 --2- 172.21.15.156:0/1098439885 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7dd809f180 0x7f7dd8131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:53.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.346+0000 7f7dd6d9d700 1 -- 172.21.15.156:0/1098439885 >> v1:172.21.15.156:6789/0 conn(0x7f7dd8131d70 legacy=0x7f7dd8138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:53.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.346+0000 7f7dd6d9d700 1 -- 172.21.15.156:0/1098439885 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd809bab0 con 0x7f7dd809e870 2023-09-30T22:18:53.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.346+0000 7f7dd6d9d700 1 --2- 172.21.15.156:0/1098439885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dd809e870 0x7f7dd809ec40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80098f0 tx=0x7f7dc8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1fcecb1403db183 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:53.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.346+0000 7f7dd5d9b700 1 -- 172.21.15.156:0/1098439885 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8011830 con 0x7f7dd809e870 2023-09-30T22:18:53.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.346+0000 7f7dd5d9b700 1 -- 172.21.15.156:0/1098439885 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc8011990 con 0x7f7dd809e870 2023-09-30T22:18:53.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.346+0000 7f7dd5d9b700 1 -- 172.21.15.156:0/1098439885 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8011d20 con 0x7f7dd809e870 2023-09-30T22:18:53.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.347+0000 7f7ddd187700 1 -- 172.21.15.156:0/1098439885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dd809e870 msgr2=0x7f7dd809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:53.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.347+0000 7f7ddd187700 1 --2- 172.21.15.156:0/1098439885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dd809e870 0x7f7dd809ec40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80098f0 tx=0x7f7dc8009c00 comp rx=0 tx=0).stop 2023-09-30T22:18:53.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.347+0000 7f7ddd187700 1 -- 172.21.15.156:0/1098439885 shutdown_connections 2023-09-30T22:18:53.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.347+0000 7f7ddd187700 1 --2- 172.21.15.156:0/1098439885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dd809e870 0x7f7dd809ec40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:53.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.347+0000 7f7ddd187700 1 --2- 172.21.15.156:0/1098439885 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7dd809f180 0x7f7dd8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:53.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.347+0000 7f7ddd187700 1 -- 172.21.15.156:0/1098439885 >> 172.21.15.156:0/1098439885 conn(0x7f7dd80a4430 msgr2=0x7f7dd80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:53.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.347+0000 7f7ddd187700 1 -- 172.21.15.156:0/1098439885 shutdown_connections 2023-09-30T22:18:53.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.347+0000 7f7ddd187700 1 -- 172.21.15.156:0/1098439885 wait complete. 2023-09-30T22:18:53.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.349+0000 7f7ddd187700 1 Processor -- start 2023-09-30T22:18:53.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.349+0000 7f7ddd187700 1 -- start start 2023-09-30T22:18:53.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.349+0000 7f7ddd187700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dd809e870 0x7f7dd811f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:53.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.349+0000 7f7ddd187700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7dd809f180 0x7f7dd811f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:53.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.349+0000 7f7ddd187700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7dd8131d70 0x7f7dd811fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:53.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.349+0000 7f7ddd187700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd81206b0 con 0x7f7dd809e870 2023-09-30T22:18:53.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.349+0000 7f7ddd187700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd81305b0 con 0x7f7dd809f180 2023-09-30T22:18:53.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.349+0000 7f7ddd187700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd8121c80 con 0x7f7dd8131d70 2023-09-30T22:18:53.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.350+0000 7f7dd6d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dd809e870 0x7f7dd811f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:53.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.350+0000 7f7dd6d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dd809e870 0x7f7dd811f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59572/0 (socket says 172.21.15.156:59572) 2023-09-30T22:18:53.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.350+0000 7f7dd6d9d700 1 -- 172.21.15.156:0/1896701404 learned_addr learned my addr 172.21.15.156:0/1896701404 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:53.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.350+0000 7f7dd759e700 1 --2- 172.21.15.156:0/1896701404 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7dd8131d70 0x7f7dd811fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:53.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.350+0000 7f7dd6d9d700 1 -- 172.21.15.156:0/1896701404 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7dd8131d70 msgr2=0x7f7dd811fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:53.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.350+0000 7f7dd6d9d700 1 --2- 172.21.15.156:0/1896701404 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7dd8131d70 0x7f7dd811fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:53.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.350+0000 7f7dd6d9d700 1 -- 172.21.15.156:0/1896701404 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7dd809f180 msgr2=0x7f7dd811f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:53.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.350+0000 7f7dd6d9d700 1 --2- 172.21.15.156:0/1896701404 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7dd809f180 0x7f7dd811f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:53.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.350+0000 7f7dd6d9d700 1 -- 172.21.15.156:0/1896701404 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc8009550 con 0x7f7dd809e870 2023-09-30T22:18:53.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.350+0000 7f7dd759e700 1 --2- 172.21.15.156:0/1896701404 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7dd8131d70 0x7f7dd811fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:18:53.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.350+0000 7f7dd6d9d700 1 --2- 172.21.15.156:0/1896701404 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dd809e870 0x7f7dd811f1e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8014040 tx=0x7f7dc8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:53.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.350+0000 7f7dbf7fe700 1 -- 172.21.15.156:0/1896701404 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8004590 con 0x7f7dd809e870 2023-09-30T22:18:53.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.350+0000 7f7dbf7fe700 1 -- 172.21.15.156:0/1896701404 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc801e070 con 0x7f7dd809e870 2023-09-30T22:18:53.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.350+0000 7f7ddd187700 1 -- 172.21.15.156:0/1896701404 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd8122760 con 0x7f7dd809e870 2023-09-30T22:18:53.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.350+0000 7f7dbf7fe700 1 -- 172.21.15.156:0/1896701404 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc80038e0 con 0x7f7dd809e870 2023-09-30T22:18:53.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.350+0000 7f7ddd187700 1 -- 172.21.15.156:0/1896701404 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd809dba0 con 0x7f7dd809e870 2023-09-30T22:18:53.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.351+0000 7f7dbf7fe700 1 -- 172.21.15.156:0/1896701404 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7dc8003a40 con 0x7f7dd809e870 2023-09-30T22:18:53.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.351+0000 7f7dbf7fe700 1 -- 172.21.15.156:0/1896701404 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f7dc8040b80 con 0x7f7dd809e870 2023-09-30T22:18:53.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.352+0000 7f7ddd187700 1 -- 172.21.15.156:0/1896701404 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd804f2a0 con 0x7f7dd809e870 2023-09-30T22:18:53.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.360+0000 7f7dbf7fe700 1 -- 172.21.15.156:0/1896701404 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7dc8040e60 con 0x7f7dd809e870 2023-09-30T22:18:53.588 INFO:tasks.ceph.osd.1.smithi156.stderr:2023-09-30T22:18:53.588+0000 7f6895e12700 -1 osd.1 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:18:53.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.621+0000 7f7ddd187700 1 -- 172.21.15.156:0/1896701404 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7dd8122a80 con 0x7f7dd809e870 2023-09-30T22:18:53.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.622+0000 7f7dbf7fe700 1 -- 172.21.15.156:0/1896701404 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12767 (secure 0 0 0) 0x7f7dc80381f0 con 0x7f7dd809e870 2023-09-30T22:18:53.622 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:18:53.622 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":28,"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","created":"2023-09-30T22:16:15.239992+0000","modified":"2023-09-30T22:18:52.816329+0000","last_up_change":"2023-09-30T22:18:52.816329+0000","last_in_change":"2023-09-30T22:16:16.474206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:16:23.433906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.25,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:16:24.367795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"error_message":"pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.0), read balance score may not be reliable","score_acting":0,"score_stable":0}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:16:28.204677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"error_message":"pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.0), read balance score may not be reliable","score_acting":0,"score_stable":0}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:16:28.762804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"error_message":"pool 4 has some PGs where all OSDs are with primary_affinity 0 (at least pg 4.0), read balance score may not be reliable","score_acting":0,"score_stable":0}}],"osds":[{"osd":0,"uuid":"3ec2e78a-c61f-473a-bfcb-f956cffe4095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":18,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6803","nonce":129485}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6805","nonce":129485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6807","nonce":129485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6806","nonce":129485}]},"public_addr":"172.21.15.156:6803/129485","cluster_addr":"172.21.15.156:6805/129485","heartbeat_back_addr":"172.21.15.156:6807/129485","heartbeat_front_addr":"172.21.15.156:6806/129485","state":["exists","up"]},{"osd":1,"uuid":"b682e683-c15a-4bd9-8712-8af96454e9ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6803","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6805","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6807","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6806","nonce":118763}]},"public_addr":"172.21.15.156:6803/118763","cluster_addr":"172.21.15.156:6805/118763","heartbeat_back_addr":"172.21.15.156:6807/118763","heartbeat_front_addr":"172.21.15.156:6806/118763","state":["exists"]},{"osd":2,"uuid":"960dbaf0-2e0c-437e-9114-bc22ce522b26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6808","nonce":118788}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6809","nonce":118788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6811","nonce":118788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6810","nonce":118788}]},"public_addr":"172.21.15.156:6808/118788","cluster_addr":"172.21.15.156:6809/118788","heartbeat_back_addr":"172.21.15.156:6811/118788","heartbeat_front_addr":"172.21.15.156:6810/118788","state":["exists"]},{"osd":3,"uuid":"c1b19714-78b1-4869-8721-2f6352a64a05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6800","nonce":118764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6801","nonce":118764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6804","nonce":118764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6802","nonce":118764}]},"public_addr":"172.21.15.156:6800/118764","cluster_addr":"172.21.15.156:6801/118764","heartbeat_back_addr":"172.21.15.156:6804/118764","heartbeat_front_addr":"172.21.15.156:6802/118764","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.663343+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.827397+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.806655+0000","dead_epoch":25},{"osd":3,"down_stamp":"2023-09-30T22:18:49.807414+0000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.634746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.2","mappings":[{"from":3,"to":0}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.156:6816/118236":"2023-10-01T22:18:37.767496+0000","172.21.15.156:0/1464735255":"2023-10-01T22:18:37.767496+0000","172.21.15.156:0/2593263545":"2023-10-01T22:18:37.767496+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:18:53.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.624+0000 7f7ddd187700 1 -- 172.21.15.156:0/1896701404 >> v1:172.21.15.156:6816/126965 conn(0x7f7dc402f510 legacy=0x7f7dc40319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:53.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.624+0000 7f7ddd187700 1 -- 172.21.15.156:0/1896701404 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dd809e870 msgr2=0x7f7dd811f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:53.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.624+0000 7f7ddd187700 1 --2- 172.21.15.156:0/1896701404 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dd809e870 0x7f7dd811f1e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8014040 tx=0x7f7dc8004750 comp rx=0 tx=0).stop 2023-09-30T22:18:53.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.624+0000 7f7ddd187700 1 -- 172.21.15.156:0/1896701404 shutdown_connections 2023-09-30T22:18:53.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.624+0000 7f7ddd187700 1 --2- 172.21.15.156:0/1896701404 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7dd8131d70 0x7f7dd811fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:53.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.624+0000 7f7ddd187700 1 --2- 172.21.15.156:0/1896701404 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dd809e870 0x7f7dd811f1e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:53.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.624+0000 7f7ddd187700 1 --2- 172.21.15.156:0/1896701404 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7dd809f180 0x7f7dd811f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:53.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.624+0000 7f7ddd187700 1 -- 172.21.15.156:0/1896701404 >> 172.21.15.156:0/1896701404 conn(0x7f7dd80a4430 msgr2=0x7f7dd80719a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:53.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.624+0000 7f7ddd187700 1 -- 172.21.15.156:0/1896701404 shutdown_connections 2023-09-30T22:18:53.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:53.624+0000 7f7ddd187700 1 -- 172.21.15.156:0/1896701404 wait complete. 2023-09-30T22:18:54.224 INFO:tasks.ceph.osd.3.smithi156.stderr:2023-09-30T22:18:54.223+0000 7fcca839b680 -1 osd.3 25 log_to_monitors true 2023-09-30T22:18:54.542 INFO:tasks.ceph.osd.2.smithi156.stderr:2023-09-30T22:18:54.542+0000 7fa511b3a700 -1 osd.2 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:18:55.591 INFO:tasks.ceph.osd.3.smithi156.stderr:2023-09-30T22:18:55.590+0000 7fcc94316700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:18:56.637 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:18:56.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.772+0000 7f1db77bc700 1 Processor -- start 2023-09-30T22:18:56.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.772+0000 7f1db77bc700 1 -- start start 2023-09-30T22:18:56.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.773+0000 7f1db77bc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1db009ad40 0x7f1db0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:56.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.773+0000 7f1db77bc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1db0133f70 0x7f1db01343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:56.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.773+0000 7f1db77bc700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db009b110 con 0x7f1db00a0a70 2023-09-30T22:18:56.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.773+0000 7f1db77bc700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db00a3b60 con 0x7f1db0133f70 2023-09-30T22:18:56.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.773+0000 7f1db77bc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db01348e0 con 0x7f1db009ad40 2023-09-30T22:18:56.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.773+0000 7f1db5558700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1db009ad40 0x7f1db0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:56.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.773+0000 7f1db4d57700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1db0133f70 0x7f1db01343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:56.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.773+0000 7f1db5558700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1db009ad40 0x7f1db0133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:56852/0 (socket says 172.21.15.156:56852) 2023-09-30T22:18:56.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.773+0000 7f1db5d59700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f1db00a0a70 0x7f1db00a0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53360/0 (socket says 172.21.15.156:53360) 2023-09-30T22:18:56.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.773+0000 7f1db4d57700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1db0133f70 0x7f1db01343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59576/0 (socket says 172.21.15.156:59576) 2023-09-30T22:18:56.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.773+0000 7f1db5558700 1 -- 172.21.15.156:0/1083489310 learned_addr learned my addr 172.21.15.156:0/1083489310 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:56.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.773+0000 7f1db4d57700 1 -- 172.21.15.156:0/1083489310 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1db009ad40 msgr2=0x7f1db0133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:18:56.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.773+0000 7f1db4d57700 1 --2- 172.21.15.156:0/1083489310 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1db009ad40 0x7f1db0133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:56.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.773+0000 7f1db4d57700 1 -- 172.21.15.156:0/1083489310 >> v1:172.21.15.156:6789/0 conn(0x7f1db00a0a70 legacy=0x7f1db00a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:56.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.773+0000 7f1da3fff700 1 -- 172.21.15.156:0/1083489310 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678055533 0 0) 0x7f1db009b110 con 0x7f1db00a0a70 2023-09-30T22:18:56.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.773+0000 7f1db4d57700 1 -- 172.21.15.156:0/1083489310 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db00a2fa0 con 0x7f1db0133f70 2023-09-30T22:18:56.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.774+0000 7f1db4d57700 1 --2- 172.21.15.156:0/1083489310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1db0133f70 0x7f1db01343a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1da4009840 tx=0x7f1da4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d5371234d0bbec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:56.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.774+0000 7f1da3fff700 1 -- 172.21.15.156:0/1083489310 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da4011830 con 0x7f1db0133f70 2023-09-30T22:18:56.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.774+0000 7f1da3fff700 1 -- 172.21.15.156:0/1083489310 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da4011990 con 0x7f1db0133f70 2023-09-30T22:18:56.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.774+0000 7f1da3fff700 1 -- 172.21.15.156:0/1083489310 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da4011d20 con 0x7f1db0133f70 2023-09-30T22:18:56.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.774+0000 7f1db77bc700 1 -- 172.21.15.156:0/1083489310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1db0133f70 msgr2=0x7f1db01343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:56.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.774+0000 7f1db77bc700 1 --2- 172.21.15.156:0/1083489310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1db0133f70 0x7f1db01343a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1da4009840 tx=0x7f1da4009b50 comp rx=0 tx=0).stop 2023-09-30T22:18:56.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.774+0000 7f1db77bc700 1 -- 172.21.15.156:0/1083489310 shutdown_connections 2023-09-30T22:18:56.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.774+0000 7f1db77bc700 1 --2- 172.21.15.156:0/1083489310 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1db009ad40 0x7f1db0133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:56.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.774+0000 7f1db77bc700 1 --2- 172.21.15.156:0/1083489310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1db0133f70 0x7f1db01343a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:56.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.774+0000 7f1db77bc700 1 -- 172.21.15.156:0/1083489310 >> 172.21.15.156:0/1083489310 conn(0x7f1db0099c40 msgr2=0x7f1db006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:56.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.774+0000 7f1db77bc700 1 -- 172.21.15.156:0/1083489310 shutdown_connections 2023-09-30T22:18:56.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.774+0000 7f1db77bc700 1 -- 172.21.15.156:0/1083489310 wait complete. 2023-09-30T22:18:56.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.775+0000 7f1db77bc700 1 Processor -- start 2023-09-30T22:18:56.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.775+0000 7f1db77bc700 1 -- start start 2023-09-30T22:18:56.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.776+0000 7f1db77bc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1db009ad40 0x7f1db011f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:56.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.776+0000 7f1db77bc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1db00a0a70 0x7f1db011fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:56.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.776+0000 7f1db77bc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1db0133f70 0x7f1db01c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:18:56.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.776+0000 7f1db77bc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db01224b0 con 0x7f1db009ad40 2023-09-30T22:18:56.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.776+0000 7f1db77bc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db011f040 con 0x7f1db00a0a70 2023-09-30T22:18:56.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.776+0000 7f1db77bc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1db0133520 con 0x7f1db0133f70 2023-09-30T22:18:56.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.776+0000 7f1db5558700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1db009ad40 0x7f1db011f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:56.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.776+0000 7f1db5558700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1db009ad40 0x7f1db011f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59580/0 (socket says 172.21.15.156:59580) 2023-09-30T22:18:56.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.776+0000 7f1db5558700 1 -- 172.21.15.156:0/3530017098 learned_addr learned my addr 172.21.15.156:0/3530017098 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:18:56.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.776+0000 7f1db4d57700 1 --2- 172.21.15.156:0/3530017098 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1db00a0a70 0x7f1db011fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:56.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.776+0000 7f1db5d59700 1 --2- 172.21.15.156:0/3530017098 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1db0133f70 0x7f1db01c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:18:56.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.776+0000 7f1db5558700 1 -- 172.21.15.156:0/3530017098 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1db0133f70 msgr2=0x7f1db01c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:56.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.776+0000 7f1db5558700 1 --2- 172.21.15.156:0/3530017098 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1db0133f70 0x7f1db01c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:56.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.776+0000 7f1db5558700 1 -- 172.21.15.156:0/3530017098 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1db00a0a70 msgr2=0x7f1db011fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:56.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.776+0000 7f1db5558700 1 --2- 172.21.15.156:0/3530017098 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1db00a0a70 0x7f1db011fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:56.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.776+0000 7f1db5558700 1 -- 172.21.15.156:0/3530017098 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da40094a0 con 0x7f1db009ad40 2023-09-30T22:18:56.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.776+0000 7f1db5558700 1 --2- 172.21.15.156:0/3530017098 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1db009ad40 0x7f1db011f620 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1dac00e910 tx=0x7f1dac00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:18:56.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.776+0000 7f1da1ffb700 1 -- 172.21.15.156:0/3530017098 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac009600 con 0x7f1db009ad40 2023-09-30T22:18:56.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.776+0000 7f1da1ffb700 1 -- 172.21.15.156:0/3530017098 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dac013680 con 0x7f1db009ad40 2023-09-30T22:18:56.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.776+0000 7f1db77bc700 1 -- 172.21.15.156:0/3530017098 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db009c7e0 con 0x7f1db009ad40 2023-09-30T22:18:56.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.776+0000 7f1da1ffb700 1 -- 172.21.15.156:0/3530017098 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac013a30 con 0x7f1db009ad40 2023-09-30T22:18:56.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.777+0000 7f1db77bc700 1 -- 172.21.15.156:0/3530017098 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db0120f90 con 0x7f1db009ad40 2023-09-30T22:18:56.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.777+0000 7f1da1ffb700 1 -- 172.21.15.156:0/3530017098 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1dac013b90 con 0x7f1db009ad40 2023-09-30T22:18:56.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.777+0000 7f1db77bc700 1 -- 172.21.15.156:0/3530017098 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db004f2a0 con 0x7f1db009ad40 2023-09-30T22:18:56.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.778+0000 7f1da1ffb700 1 -- 172.21.15.156:0/3530017098 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f1dac03ff40 con 0x7f1db009ad40 2023-09-30T22:18:56.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.782+0000 7f1da1ffb700 1 -- 172.21.15.156:0/3530017098 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1dac0128f0 con 0x7f1db009ad40 2023-09-30T22:18:56.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.988+0000 7f1db77bc700 1 -- 172.21.15.156:0/3530017098 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1db00729d0 con 0x7f1db009ad40 2023-09-30T22:18:56.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.989+0000 7f1da1ffb700 1 -- 172.21.15.156:0/3530017098 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+12981 (secure 0 0 0) 0x7f1dac021070 con 0x7f1db009ad40 2023-09-30T22:18:56.992 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:18:56.992 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":32,"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","created":"2023-09-30T22:16:15.239992+0000","modified":"2023-09-30T22:18:56.823652+0000","last_up_change":"2023-09-30T22:18:55.822352+0000","last_in_change":"2023-09-30T22:16:16.474206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:16:23.433906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:16:24.367795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:16:28.204677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:16:28.762804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ec2e78a-c61f-473a-bfcb-f956cffe4095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6803","nonce":129485}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6805","nonce":129485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6807","nonce":129485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6806","nonce":129485}]},"public_addr":"172.21.15.156:6803/129485","cluster_addr":"172.21.15.156:6805/129485","heartbeat_back_addr":"172.21.15.156:6807/129485","heartbeat_front_addr":"172.21.15.156:6806/129485","state":["exists","up"]},{"osd":1,"uuid":"b682e683-c15a-4bd9-8712-8af96454e9ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6808","nonce":129583}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6809","nonce":129583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6811","nonce":129583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6810","nonce":129583}]},"public_addr":"172.21.15.156:6808/129583","cluster_addr":"172.21.15.156:6809/129583","heartbeat_back_addr":"172.21.15.156:6811/129583","heartbeat_front_addr":"172.21.15.156:6810/129583","state":["exists","up"]},{"osd":2,"uuid":"960dbaf0-2e0c-437e-9114-bc22ce522b26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6800","nonce":129693}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6801","nonce":129693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6804","nonce":129693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6802","nonce":129693}]},"public_addr":"172.21.15.156:6800/129693","cluster_addr":"172.21.15.156:6801/129693","heartbeat_back_addr":"172.21.15.156:6804/129693","heartbeat_front_addr":"172.21.15.156:6802/129693","state":["exists","up"]},{"osd":3,"uuid":"c1b19714-78b1-4869-8721-2f6352a64a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6812","nonce":129849}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6813","nonce":129849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6815","nonce":129849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6814","nonce":129849}]},"public_addr":"172.21.15.156:6812/129849","cluster_addr":"172.21.15.156:6813/129849","heartbeat_back_addr":"172.21.15.156:6815/129849","heartbeat_front_addr":"172.21.15.156:6814/129849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.663343+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.827397+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.806655+0000","dead_epoch":25},{"osd":3,"down_stamp":"2023-09-30T22:18:49.807414+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.634746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.2","mappings":[{"from":3,"to":0}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.156:6816/118236":"2023-10-01T22:18:37.767496+0000","172.21.15.156:0/1464735255":"2023-10-01T22:18:37.767496+0000","172.21.15.156:0/2593263545":"2023-10-01T22:18:37.767496+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:18:56.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.991+0000 7f1db77bc700 1 -- 172.21.15.156:0/3530017098 >> v1:172.21.15.156:6816/126965 conn(0x7f1d9402f510 legacy=0x7f1d940319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:56.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.991+0000 7f1db77bc700 1 -- 172.21.15.156:0/3530017098 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1db009ad40 msgr2=0x7f1db011f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:18:56.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.991+0000 7f1db77bc700 1 --2- 172.21.15.156:0/3530017098 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1db009ad40 0x7f1db011f620 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1dac00e910 tx=0x7f1dac00ec20 comp rx=0 tx=0).stop 2023-09-30T22:18:56.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.991+0000 7f1db77bc700 1 -- 172.21.15.156:0/3530017098 shutdown_connections 2023-09-30T22:18:56.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.991+0000 7f1db77bc700 1 --2- 172.21.15.156:0/3530017098 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1db0133f70 0x7f1db01c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:56.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.991+0000 7f1db77bc700 1 --2- 172.21.15.156:0/3530017098 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1db009ad40 0x7f1db011f620 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:56.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.991+0000 7f1db77bc700 1 --2- 172.21.15.156:0/3530017098 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1db00a0a70 0x7f1db011fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:18:56.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.991+0000 7f1db77bc700 1 -- 172.21.15.156:0/3530017098 >> 172.21.15.156:0/3530017098 conn(0x7f1db0099c40 msgr2=0x7f1db009b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:18:56.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.991+0000 7f1db77bc700 1 -- 172.21.15.156:0/3530017098 shutdown_connections 2023-09-30T22:18:56.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:18:56.991+0000 7f1db77bc700 1 -- 172.21.15.156:0/3530017098 wait complete. 2023-09-30T22:18:57.004 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-30T22:18:57.005 INFO:teuthology.run_tasks:Running task ceph.stop... 2023-09-30T22:18:57.016 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-30T22:18:57.016 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:18:57.027 INFO:tasks.ceph.mds.a:Stopped 2023-09-30T22:19:00.555 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog finished 2023-09-30T22:19:00.556 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-09-30T22:19:00.567 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2023-09-30T22:19:00.567 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-30T22:19:00.567 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-30T22:19:00.570 INFO:tasks.ceph.mds.a:Started 2023-09-30T22:19:00.570 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-30T22:19:00.570 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:19:00.662 INFO:tasks.ceph.mds.a.smithi156.stdout:starting mds.a at 2023-09-30T22:19:00.677 INFO:tasks.ceph.mon.a.smithi156.stderr:2023-09-30T22:19:00.677+0000 7feb8e324700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-30T22:19:00.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.715+0000 7f156ff89700 1 Processor -- start 2023-09-30T22:19:00.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.716+0000 7f156ff89700 1 -- start start 2023-09-30T22:19:00.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.716+0000 7f156ff89700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1568134140 0x7f1568138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:00.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.716+0000 7f156ff89700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1568134570 0x7f156813b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:00.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.716+0000 7f156ff89700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f156809b110 con 0x7f156809ad40 2023-09-30T22:19:00.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.716+0000 7f156ff89700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15680a3b60 con 0x7f1568134570 2023-09-30T22:19:00.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.716+0000 7f156ff89700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15680a1a80 con 0x7f1568134140 2023-09-30T22:19:00.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.716+0000 7f156d524700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1568134140 0x7f1568138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:00.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.716+0000 7f156e526700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1568134570 0x7f156813b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:00.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.716+0000 7f156e526700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1568134570 0x7f156813b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59602/0 (socket says 172.21.15.156:59602) 2023-09-30T22:19:00.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.716+0000 7f156d524700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1568134140 0x7f1568138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:37992/0 (socket says 172.21.15.156:37992) 2023-09-30T22:19:00.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.716+0000 7f156e526700 1 -- 172.21.15.156:0/1218868711 learned_addr learned my addr 172.21.15.156:0/1218868711 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:00.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.716+0000 7f156dd25700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f156809ad40 0x7f1568133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53386/0 (socket says 172.21.15.156:53386) 2023-09-30T22:19:00.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.716+0000 7f156e526700 1 -- 172.21.15.156:0/1218868711 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1568134140 msgr2=0x7f1568138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:00.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.716+0000 7f156e526700 1 --2- 172.21.15.156:0/1218868711 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1568134140 0x7f1568138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:00.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.716+0000 7f156e526700 1 -- 172.21.15.156:0/1218868711 >> v1:172.21.15.156:6789/0 conn(0x7f156809ad40 legacy=0x7f1568133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:00.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.716+0000 7f156e526700 1 -- 172.21.15.156:0/1218868711 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15680a2fa0 con 0x7f1568134570 2023-09-30T22:19:00.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.716+0000 7f156cd23700 1 -- 172.21.15.156:0/1218868711 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2419136927 0 0) 0x7f156809b110 con 0x7f156809ad40 2023-09-30T22:19:00.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.716+0000 7f156d524700 1 --2- 172.21.15.156:0/1218868711 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1568134140 0x7f1568138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:00.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.717+0000 7f156e526700 1 --2- 172.21.15.156:0/1218868711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1568134570 0x7f156813b3d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1560009e50 tx=0x7f156000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4064ccec322e6b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:00.725 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.717+0000 7f156cd23700 1 -- 172.21.15.156:0/1218868711 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156000e070 con 0x7f1568134570 2023-09-30T22:19:00.725 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.717+0000 7f156cd23700 1 -- 172.21.15.156:0/1218868711 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156000b910 con 0x7f1568134570 2023-09-30T22:19:00.725 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.717+0000 7f156cd23700 1 -- 172.21.15.156:0/1218868711 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156000bcc0 con 0x7f1568134570 2023-09-30T22:19:00.725 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.717+0000 7f156ff89700 1 -- 172.21.15.156:0/1218868711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1568134570 msgr2=0x7f156813b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:00.725 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.717+0000 7f156ff89700 1 --2- 172.21.15.156:0/1218868711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1568134570 0x7f156813b3d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1560009e50 tx=0x7f156000b330 comp rx=0 tx=0).stop 2023-09-30T22:19:00.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.717+0000 7f156ff89700 1 -- 172.21.15.156:0/1218868711 shutdown_connections 2023-09-30T22:19:00.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.717+0000 7f156ff89700 1 --2- 172.21.15.156:0/1218868711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1568134570 0x7f156813b3d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:00.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.717+0000 7f156ff89700 1 --2- 172.21.15.156:0/1218868711 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1568134140 0x7f1568138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:00.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.717+0000 7f156ff89700 1 -- 172.21.15.156:0/1218868711 >> 172.21.15.156:0/1218868711 conn(0x7f1568099c40 msgr2=0x7f156806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:00.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.717+0000 7f156ff89700 1 -- 172.21.15.156:0/1218868711 shutdown_connections 2023-09-30T22:19:00.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.717+0000 7f156ff89700 1 -- 172.21.15.156:0/1218868711 wait complete. 2023-09-30T22:19:00.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.718+0000 7f156ff89700 1 Processor -- start 2023-09-30T22:19:00.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.718+0000 7f156ff89700 1 -- start start 2023-09-30T22:19:00.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.719+0000 7f156ff89700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f156809ad40 0x7f15681393d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:00.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.719+0000 7f156ff89700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1568134140 0x7f1568139910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:00.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.719+0000 7f156ff89700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1568134570 0x7f1568139e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:00.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.719+0000 7f156ff89700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156811e4a0 con 0x7f1568134140 2023-09-30T22:19:00.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.719+0000 7f156ff89700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156809c7e0 con 0x7f156809ad40 2023-09-30T22:19:00.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.719+0000 7f156ff89700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15680a43a0 con 0x7f1568134570 2023-09-30T22:19:00.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.719+0000 7f156d524700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1568134140 0x7f1568139910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:00.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.719+0000 7f156dd25700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f156809ad40 0x7f15681393d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:00.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.719+0000 7f156d524700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1568134140 0x7f1568139910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59608/0 (socket says 172.21.15.156:59608) 2023-09-30T22:19:00.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.719+0000 7f156d524700 1 -- 172.21.15.156:0/1620319382 learned_addr learned my addr 172.21.15.156:0/1620319382 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:00.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.719+0000 7f156e526700 1 --2- 172.21.15.156:0/1620319382 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1568134570 0x7f1568139e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:00.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.719+0000 7f156dd25700 1 --2- 172.21.15.156:0/1620319382 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f156809ad40 0x7f15681393d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:56894/0 (socket says 172.21.15.156:56894) 2023-09-30T22:19:00.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.719+0000 7f156d524700 1 -- 172.21.15.156:0/1620319382 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1568134570 msgr2=0x7f1568139e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:00.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.719+0000 7f156d524700 1 --2- 172.21.15.156:0/1620319382 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1568134570 0x7f1568139e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:00.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.719+0000 7f156d524700 1 -- 172.21.15.156:0/1620319382 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f156809ad40 msgr2=0x7f15681393d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:00.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.719+0000 7f156d524700 1 --2- 172.21.15.156:0/1620319382 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f156809ad40 0x7f15681393d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:00.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.719+0000 7f156d524700 1 -- 172.21.15.156:0/1620319382 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15640094a0 con 0x7f1568134140 2023-09-30T22:19:00.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.719+0000 7f156dd25700 1 --2- 172.21.15.156:0/1620319382 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f156809ad40 0x7f15681393d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:00.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.719+0000 7f156d524700 1 --2- 172.21.15.156:0/1620319382 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1568134140 0x7f1568139910 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f156400ebe0 tx=0x7f156400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:00.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.719+0000 7f155e7fc700 1 -- 172.21.15.156:0/1620319382 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1564009760 con 0x7f1568134140 2023-09-30T22:19:00.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.719+0000 7f155e7fc700 1 -- 172.21.15.156:0/1620319382 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156400c850 con 0x7f1568134140 2023-09-30T22:19:00.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.719+0000 7f156ff89700 1 -- 172.21.15.156:0/1620319382 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1560009b30 con 0x7f1568134140 2023-09-30T22:19:00.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.719+0000 7f155e7fc700 1 -- 172.21.15.156:0/1620319382 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156400cbe0 con 0x7f1568134140 2023-09-30T22:19:00.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.720+0000 7f156ff89700 1 -- 172.21.15.156:0/1620319382 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156811e050 con 0x7f1568134140 2023-09-30T22:19:00.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.720+0000 7f155e7fc700 1 -- 172.21.15.156:0/1620319382 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f156400cd40 con 0x7f1568134140 2023-09-30T22:19:00.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.720+0000 7f155e7fc700 1 -- 172.21.15.156:0/1620319382 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f156403fbe0 con 0x7f1568134140 2023-09-30T22:19:00.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.721+0000 7f156ff89700 1 -- 172.21.15.156:0/1620319382 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15681361e0 con 0x7f1568134140 2023-09-30T22:19:00.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.725+0000 7f155e7fc700 1 -- 172.21.15.156:0/1620319382 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1564021080 con 0x7f1568134140 2023-09-30T22:19:00.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.913+0000 7f156ff89700 1 -- 172.21.15.156:0/1620319382 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f156804f2a0 con 0x7f1568134140 2023-09-30T22:19:00.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.914+0000 7f155e7fc700 1 -- 172.21.15.156:0/1620319382 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+13047 (secure 0 0 0) 0x7f156401bd80 con 0x7f1568134140 2023-09-30T22:19:00.915 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:19:00.915 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":33,"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","created":"2023-09-30T22:16:15.239992+0000","modified":"2023-09-30T22:19:00.677705+0000","last_up_change":"2023-09-30T22:18:55.822352+0000","last_in_change":"2023-09-30T22:16:16.474206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:16:23.433906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:16:24.367795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:16:28.204677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:16:28.762804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ec2e78a-c61f-473a-bfcb-f956cffe4095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6803","nonce":129485}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6805","nonce":129485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6807","nonce":129485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6806","nonce":129485}]},"public_addr":"172.21.15.156:6803/129485","cluster_addr":"172.21.15.156:6805/129485","heartbeat_back_addr":"172.21.15.156:6807/129485","heartbeat_front_addr":"172.21.15.156:6806/129485","state":["exists","up"]},{"osd":1,"uuid":"b682e683-c15a-4bd9-8712-8af96454e9ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6808","nonce":129583}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6809","nonce":129583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6811","nonce":129583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6810","nonce":129583}]},"public_addr":"172.21.15.156:6808/129583","cluster_addr":"172.21.15.156:6809/129583","heartbeat_back_addr":"172.21.15.156:6811/129583","heartbeat_front_addr":"172.21.15.156:6810/129583","state":["exists","up"]},{"osd":2,"uuid":"960dbaf0-2e0c-437e-9114-bc22ce522b26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6800","nonce":129693}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6801","nonce":129693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6804","nonce":129693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6802","nonce":129693}]},"public_addr":"172.21.15.156:6800/129693","cluster_addr":"172.21.15.156:6801/129693","heartbeat_back_addr":"172.21.15.156:6804/129693","heartbeat_front_addr":"172.21.15.156:6802/129693","state":["exists","up"]},{"osd":3,"uuid":"c1b19714-78b1-4869-8721-2f6352a64a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6812","nonce":129849}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6813","nonce":129849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6815","nonce":129849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6814","nonce":129849}]},"public_addr":"172.21.15.156:6812/129849","cluster_addr":"172.21.15.156:6813/129849","heartbeat_back_addr":"172.21.15.156:6815/129849","heartbeat_front_addr":"172.21.15.156:6814/129849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.663343+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.827397+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.806655+0000","dead_epoch":25},{"osd":3,"down_stamp":"2023-09-30T22:18:49.807414+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.634746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.2","mappings":[{"from":3,"to":0}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.156:6816/118236":"2023-10-01T22:18:37.767496+0000","172.21.15.156:0/1464735255":"2023-10-01T22:18:37.767496+0000","172.21.15.156:6817/3817969673":"2023-10-01T22:19:00.677676+0000","172.21.15.156:0/2593263545":"2023-10-01T22:18:37.767496+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:19:00.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.917+0000 7f156ff89700 1 -- 172.21.15.156:0/1620319382 >> v1:172.21.15.156:6816/126965 conn(0x7f154c02f510 legacy=0x7f154c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:00.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.917+0000 7f156ff89700 1 -- 172.21.15.156:0/1620319382 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1568134140 msgr2=0x7f1568139910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:00.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.917+0000 7f156ff89700 1 --2- 172.21.15.156:0/1620319382 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1568134140 0x7f1568139910 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f156400ebe0 tx=0x7f156400eef0 comp rx=0 tx=0).stop 2023-09-30T22:19:00.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.917+0000 7f156ff89700 1 -- 172.21.15.156:0/1620319382 shutdown_connections 2023-09-30T22:19:00.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.917+0000 7f156ff89700 1 --2- 172.21.15.156:0/1620319382 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1568134570 0x7f1568139e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:00.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.917+0000 7f156ff89700 1 --2- 172.21.15.156:0/1620319382 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f156809ad40 0x7f15681393d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:00.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.917+0000 7f156ff89700 1 --2- 172.21.15.156:0/1620319382 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1568134140 0x7f1568139910 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:00.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.917+0000 7f156ff89700 1 -- 172.21.15.156:0/1620319382 >> 172.21.15.156:0/1620319382 conn(0x7f1568099c40 msgr2=0x7f156813b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:00.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.917+0000 7f156ff89700 1 -- 172.21.15.156:0/1620319382 shutdown_connections 2023-09-30T22:19:00.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:00.917+0000 7f156ff89700 1 -- 172.21.15.156:0/1620319382 wait complete. 2023-09-30T22:19:00.929 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-30T22:19:00.930 INFO:teuthology.run_tasks:Running task exec... 2023-09-30T22:19:00.940 INFO:teuthology.task.exec:Executing custom commands... 2023-09-30T22:19:00.940 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi156.front.sepia.ceph.com 2023-09-30T22:19:00.940 DEBUG:teuthology.orchestra.run.smithi156:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd dump -f json-pretty' 2023-09-30T22:19:01.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.059+0000 7f9243e74700 1 Processor -- start 2023-09-30T22:19:01.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.059+0000 7f9243e74700 1 -- start start 2023-09-30T22:19:01.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.059+0000 7f9243e74700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f923c09da00 0x7f923c09ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:01.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.059+0000 7f9243e74700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f923c09e310 0x7f923c133910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:01.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.059+0000 7f9243e74700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f923c09f340 con 0x7f923c133e50 2023-09-30T22:19:01.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.059+0000 7f9243e74700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923c06b4b0 con 0x7f923c09e310 2023-09-30T22:19:01.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.059+0000 7f9243e74700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f923c09ee00 con 0x7f923c09da00 2023-09-30T22:19:01.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.059+0000 7f924140f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f923c09e310 0x7f923c133910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:01.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.059+0000 7f9241c10700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f923c09da00 0x7f923c09ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:01.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.059+0000 7f9242411700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f923c133e50 0x7f923c13ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53400/0 (socket says 172.21.15.156:53400) 2023-09-30T22:19:01.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.059+0000 7f9242411700 1 -- 172.21.15.156:0/3242671674 learned_addr learned my addr 172.21.15.156:0/3242671674 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:01.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.060+0000 7f9241c10700 1 -- 172.21.15.156:0/3242671674 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f923c09e310 msgr2=0x7f923c133910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:01.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.060+0000 7f9241c10700 1 --2- 172.21.15.156:0/3242671674 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f923c09e310 0x7f923c133910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:01.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.060+0000 7f9241c10700 1 -- 172.21.15.156:0/3242671674 >> v1:172.21.15.156:6789/0 conn(0x7f923c133e50 legacy=0x7f923c13ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:01.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.060+0000 7f9241c10700 1 -- 172.21.15.156:0/3242671674 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923c06b0e0 con 0x7f923c09da00 2023-09-30T22:19:01.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.060+0000 7f9240c0e700 1 -- 172.21.15.156:0/3242671674 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159787789 0 0) 0x7f923c09f340 con 0x7f923c133e50 2023-09-30T22:19:01.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.060+0000 7f9241c10700 1 --2- 172.21.15.156:0/3242671674 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f923c09da00 0x7f923c09ddd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f92380098a0 tx=0x7f9238009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47b1e06d3f43f6a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:01.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.060+0000 7f9240c0e700 1 -- 172.21.15.156:0/3242671674 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9238011830 con 0x7f923c09da00 2023-09-30T22:19:01.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.060+0000 7f9240c0e700 1 -- 172.21.15.156:0/3242671674 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9238011990 con 0x7f923c09da00 2023-09-30T22:19:01.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.060+0000 7f9240c0e700 1 -- 172.21.15.156:0/3242671674 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9238011d20 con 0x7f923c09da00 2023-09-30T22:19:01.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.060+0000 7f9243e74700 1 -- 172.21.15.156:0/3242671674 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f923c09da00 msgr2=0x7f923c09ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:01.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.060+0000 7f9243e74700 1 --2- 172.21.15.156:0/3242671674 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f923c09da00 0x7f923c09ddd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f92380098a0 tx=0x7f9238009bb0 comp rx=0 tx=0).stop 2023-09-30T22:19:01.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.061+0000 7f9243e74700 1 -- 172.21.15.156:0/3242671674 shutdown_connections 2023-09-30T22:19:01.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.061+0000 7f9243e74700 1 --2- 172.21.15.156:0/3242671674 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f923c09da00 0x7f923c09ddd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:01.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.061+0000 7f9243e74700 1 --2- 172.21.15.156:0/3242671674 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f923c09e310 0x7f923c133910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:01.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.061+0000 7f9243e74700 1 -- 172.21.15.156:0/3242671674 >> 172.21.15.156:0/3242671674 conn(0x7f923c099e60 msgr2=0x7f923c0a3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:01.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.061+0000 7f9243e74700 1 -- 172.21.15.156:0/3242671674 shutdown_connections 2023-09-30T22:19:01.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.061+0000 7f9243e74700 1 -- 172.21.15.156:0/3242671674 wait complete. 2023-09-30T22:19:01.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.061+0000 7f9243e74700 1 Processor -- start 2023-09-30T22:19:01.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.062+0000 7f9243e74700 1 -- start start 2023-09-30T22:19:01.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.062+0000 7f9243e74700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f923c09da00 0x7f923c11e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:01.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.062+0000 7f9243e74700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f923c09e310 0x7f923c11ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:01.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.062+0000 7f9243e74700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f923c133e50 0x7f923c11f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:01.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.062+0000 7f9243e74700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c121260 con 0x7f923c133e50 2023-09-30T22:19:01.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.062+0000 7f9243e74700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923c122270 con 0x7f923c09da00 2023-09-30T22:19:01.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.062+0000 7f9243e74700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f923c121d60 con 0x7f923c09e310 2023-09-30T22:19:01.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.062+0000 7f9242411700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f923c133e50 0x7f923c11f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:01.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.062+0000 7f9241c10700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f923c09da00 0x7f923c11e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:01.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.062+0000 7f924140f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f923c09e310 0x7f923c11ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:01.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.062+0000 7f9241c10700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f923c09da00 0x7f923c11e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:56910/0 (socket says 172.21.15.156:56910) 2023-09-30T22:19:01.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.062+0000 7f9242411700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f923c133e50 0x7f923c11f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59614/0 (socket says 172.21.15.156:59614) 2023-09-30T22:19:01.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.062+0000 7f9241c10700 1 -- 172.21.15.156:0/2133251164 learned_addr learned my addr 172.21.15.156:0/2133251164 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:01.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.062+0000 7f9241c10700 1 -- 172.21.15.156:0/2133251164 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f923c09e310 msgr2=0x7f923c11ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:01.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.062+0000 7f9241c10700 1 --2- 172.21.15.156:0/2133251164 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f923c09e310 0x7f923c11ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:01.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.062+0000 7f9241c10700 1 -- 172.21.15.156:0/2133251164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f923c133e50 msgr2=0x7f923c11f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:01.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.062+0000 7f9241c10700 1 --2- 172.21.15.156:0/2133251164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f923c133e50 0x7f923c11f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:01.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.062+0000 7f9241c10700 1 -- 172.21.15.156:0/2133251164 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92380094a0 con 0x7f923c09da00 2023-09-30T22:19:01.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.062+0000 7f924140f700 1 --2- 172.21.15.156:0/2133251164 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f923c09e310 0x7f923c11ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:01.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.063+0000 7f9241c10700 1 --2- 172.21.15.156:0/2133251164 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f923c09da00 0x7f923c11e7e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9238000c00 tx=0x7f9238004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:01.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.063+0000 7f92327fc700 1 -- 172.21.15.156:0/2133251164 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9238004450 con 0x7f923c09da00 2023-09-30T22:19:01.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.063+0000 7f92327fc700 1 -- 172.21.15.156:0/2133251164 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923801f070 con 0x7f923c09da00 2023-09-30T22:19:01.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.063+0000 7f9243e74700 1 -- 172.21.15.156:0/2133251164 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f923c09a350 con 0x7f923c09da00 2023-09-30T22:19:01.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.063+0000 7f92327fc700 1 -- 172.21.15.156:0/2133251164 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92380038a0 con 0x7f923c09da00 2023-09-30T22:19:01.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.063+0000 7f9243e74700 1 -- 172.21.15.156:0/2133251164 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f923c121a00 con 0x7f923c09da00 2023-09-30T22:19:01.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.064+0000 7f92327fc700 1 -- 172.21.15.156:0/2133251164 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9238003a00 con 0x7f923c09da00 2023-09-30T22:19:01.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.064+0000 7f92327fc700 1 -- 172.21.15.156:0/2133251164 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f9238021070 con 0x7f923c09da00 2023-09-30T22:19:01.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.064+0000 7f9243e74700 1 -- 172.21.15.156:0/2133251164 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f923c122ac0 con 0x7f923c09da00 2023-09-30T22:19:01.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.069+0000 7f92327fc700 1 -- 172.21.15.156:0/2133251164 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9238015020 con 0x7f923c09da00 2023-09-30T22:19:01.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.251+0000 7f9243e74700 1 -- 172.21.15.156:0/2133251164 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f923c09eb30 con 0x7f923c09da00 2023-09-30T22:19:01.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.253+0000 7f92327fc700 1 -- 172.21.15.156:0/2133251164 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v33) v1 ==== 81+0+24374 (secure 0 0 0) 0x7f923802b070 con 0x7f923c09da00 2023-09-30T22:19:01.253 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:19:01.253 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2023-09-30T22:19:01.254 INFO:teuthology.orchestra.run.smithi156.stdout: "epoch": 33, 2023-09-30T22:19:01.254 INFO:teuthology.orchestra.run.smithi156.stdout: "fsid": "bf403786-ca20-4e4a-92c0-a0a997d43bba", 2023-09-30T22:19:01.254 INFO:teuthology.orchestra.run.smithi156.stdout: "created": "2023-09-30T22:16:15.239992+0000", 2023-09-30T22:19:01.254 INFO:teuthology.orchestra.run.smithi156.stdout: "modified": "2023-09-30T22:19:00.677705+0000", 2023-09-30T22:19:01.254 INFO:teuthology.orchestra.run.smithi156.stdout: "last_up_change": "2023-09-30T22:18:55.822352+0000", 2023-09-30T22:19:01.254 INFO:teuthology.orchestra.run.smithi156.stdout: "last_in_change": "2023-09-30T22:16:16.474206+0000", 2023-09-30T22:19:01.254 INFO:teuthology.orchestra.run.smithi156.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T22:19:01.254 INFO:teuthology.orchestra.run.smithi156.stdout: "flags_num": 5799936, 2023-09-30T22:19:01.254 INFO:teuthology.orchestra.run.smithi156.stdout: "flags_set": [ 2023-09-30T22:19:01.254 INFO:teuthology.orchestra.run.smithi156.stdout: "pglog_hardlimit", 2023-09-30T22:19:01.255 INFO:teuthology.orchestra.run.smithi156.stdout: "purged_snapdirs", 2023-09-30T22:19:01.255 INFO:teuthology.orchestra.run.smithi156.stdout: "recovery_deletes", 2023-09-30T22:19:01.255 INFO:teuthology.orchestra.run.smithi156.stdout: "sortbitwise" 2023-09-30T22:19:01.255 INFO:teuthology.orchestra.run.smithi156.stdout: ], 2023-09-30T22:19:01.255 INFO:teuthology.orchestra.run.smithi156.stdout: "crush_version": 8, 2023-09-30T22:19:01.255 INFO:teuthology.orchestra.run.smithi156.stdout: "full_ratio": 0.94999998807907104, 2023-09-30T22:19:01.255 INFO:teuthology.orchestra.run.smithi156.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-09-30T22:19:01.255 INFO:teuthology.orchestra.run.smithi156.stdout: "nearfull_ratio": 0.85000002384185791, 2023-09-30T22:19:01.255 INFO:teuthology.orchestra.run.smithi156.stdout: "cluster_snapshot": "", 2023-09-30T22:19:01.255 INFO:teuthology.orchestra.run.smithi156.stdout: "pool_max": 4, 2023-09-30T22:19:01.255 INFO:teuthology.orchestra.run.smithi156.stdout: "max_osd": 4, 2023-09-30T22:19:01.256 INFO:teuthology.orchestra.run.smithi156.stdout: "require_min_compat_client": "pacific", 2023-09-30T22:19:01.256 INFO:teuthology.orchestra.run.smithi156.stdout: "min_compat_client": "luminous", 2023-09-30T22:19:01.256 INFO:teuthology.orchestra.run.smithi156.stdout: "require_osd_release": "pacific", 2023-09-30T22:19:01.256 INFO:teuthology.orchestra.run.smithi156.stdout: "allow_crimson": false, 2023-09-30T22:19:01.256 INFO:teuthology.orchestra.run.smithi156.stdout: "pools": [ 2023-09-30T22:19:01.256 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.256 INFO:teuthology.orchestra.run.smithi156.stdout: "pool": 1, 2023-09-30T22:19:01.256 INFO:teuthology.orchestra.run.smithi156.stdout: "pool_name": ".mgr", 2023-09-30T22:19:01.256 INFO:teuthology.orchestra.run.smithi156.stdout: "create_time": "2023-09-30T22:16:23.433906+0000", 2023-09-30T22:19:01.256 INFO:teuthology.orchestra.run.smithi156.stdout: "flags": 1, 2023-09-30T22:19:01.256 INFO:teuthology.orchestra.run.smithi156.stdout: "flags_names": "hashpspool", 2023-09-30T22:19:01.256 INFO:teuthology.orchestra.run.smithi156.stdout: "type": 1, 2023-09-30T22:19:01.257 INFO:teuthology.orchestra.run.smithi156.stdout: "size": 2, 2023-09-30T22:19:01.257 INFO:teuthology.orchestra.run.smithi156.stdout: "min_size": 1, 2023-09-30T22:19:01.257 INFO:teuthology.orchestra.run.smithi156.stdout: "crush_rule": 0, 2023-09-30T22:19:01.257 INFO:teuthology.orchestra.run.smithi156.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:19:01.257 INFO:teuthology.orchestra.run.smithi156.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:19:01.257 INFO:teuthology.orchestra.run.smithi156.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:19:01.257 INFO:teuthology.orchestra.run.smithi156.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:19:01.257 INFO:teuthology.orchestra.run.smithi156.stdout: "object_hash": 2, 2023-09-30T22:19:01.257 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:19:01.257 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_num": 1, 2023-09-30T22:19:01.257 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_placement_num": 1, 2023-09-30T22:19:01.258 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_placement_num_target": 1, 2023-09-30T22:19:01.258 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_num_target": 1, 2023-09-30T22:19:01.258 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_num_pending": 1, 2023-09-30T22:19:01.258 INFO:teuthology.orchestra.run.smithi156.stdout: "last_pg_merge_meta": { 2023-09-30T22:19:01.258 INFO:teuthology.orchestra.run.smithi156.stdout: "source_pgid": "0.0", 2023-09-30T22:19:01.258 INFO:teuthology.orchestra.run.smithi156.stdout: "ready_epoch": 0, 2023-09-30T22:19:01.258 INFO:teuthology.orchestra.run.smithi156.stdout: "last_epoch_started": 0, 2023-09-30T22:19:01.258 INFO:teuthology.orchestra.run.smithi156.stdout: "last_epoch_clean": 0, 2023-09-30T22:19:01.258 INFO:teuthology.orchestra.run.smithi156.stdout: "source_version": "0'0", 2023-09-30T22:19:01.258 INFO:teuthology.orchestra.run.smithi156.stdout: "target_version": "0'0" 2023-09-30T22:19:01.258 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.259 INFO:teuthology.orchestra.run.smithi156.stdout: "last_change": "22", 2023-09-30T22:19:01.259 INFO:teuthology.orchestra.run.smithi156.stdout: "last_force_op_resend": "0", 2023-09-30T22:19:01.259 INFO:teuthology.orchestra.run.smithi156.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:19:01.259 INFO:teuthology.orchestra.run.smithi156.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:19:01.259 INFO:teuthology.orchestra.run.smithi156.stdout: "auid": 0, 2023-09-30T22:19:01.259 INFO:teuthology.orchestra.run.smithi156.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:19:01.259 INFO:teuthology.orchestra.run.smithi156.stdout: "snap_seq": 0, 2023-09-30T22:19:01.259 INFO:teuthology.orchestra.run.smithi156.stdout: "snap_epoch": 0, 2023-09-30T22:19:01.259 INFO:teuthology.orchestra.run.smithi156.stdout: "pool_snaps": [], 2023-09-30T22:19:01.259 INFO:teuthology.orchestra.run.smithi156.stdout: "removed_snaps": "[]", 2023-09-30T22:19:01.259 INFO:teuthology.orchestra.run.smithi156.stdout: "quota_max_bytes": 0, 2023-09-30T22:19:01.260 INFO:teuthology.orchestra.run.smithi156.stdout: "quota_max_objects": 0, 2023-09-30T22:19:01.260 INFO:teuthology.orchestra.run.smithi156.stdout: "tiers": [], 2023-09-30T22:19:01.260 INFO:teuthology.orchestra.run.smithi156.stdout: "tier_of": -1, 2023-09-30T22:19:01.260 INFO:teuthology.orchestra.run.smithi156.stdout: "read_tier": -1, 2023-09-30T22:19:01.260 INFO:teuthology.orchestra.run.smithi156.stdout: "write_tier": -1, 2023-09-30T22:19:01.260 INFO:teuthology.orchestra.run.smithi156.stdout: "cache_mode": "none", 2023-09-30T22:19:01.260 INFO:teuthology.orchestra.run.smithi156.stdout: "target_max_bytes": 0, 2023-09-30T22:19:01.260 INFO:teuthology.orchestra.run.smithi156.stdout: "target_max_objects": 0, 2023-09-30T22:19:01.261 INFO:teuthology.orchestra.run.smithi156.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:19:01.261 INFO:teuthology.orchestra.run.smithi156.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:19:01.261 INFO:teuthology.orchestra.run.smithi156.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:19:01.261 INFO:teuthology.orchestra.run.smithi156.stdout: "cache_min_flush_age": 0, 2023-09-30T22:19:01.261 INFO:teuthology.orchestra.run.smithi156.stdout: "cache_min_evict_age": 0, 2023-09-30T22:19:01.261 INFO:teuthology.orchestra.run.smithi156.stdout: "erasure_code_profile": "", 2023-09-30T22:19:01.261 INFO:teuthology.orchestra.run.smithi156.stdout: "hit_set_params": { 2023-09-30T22:19:01.261 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "none" 2023-09-30T22:19:01.261 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.261 INFO:teuthology.orchestra.run.smithi156.stdout: "hit_set_period": 0, 2023-09-30T22:19:01.261 INFO:teuthology.orchestra.run.smithi156.stdout: "hit_set_count": 0, 2023-09-30T22:19:01.262 INFO:teuthology.orchestra.run.smithi156.stdout: "use_gmt_hitset": true, 2023-09-30T22:19:01.262 INFO:teuthology.orchestra.run.smithi156.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:19:01.262 INFO:teuthology.orchestra.run.smithi156.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:19:01.262 INFO:teuthology.orchestra.run.smithi156.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:19:01.262 INFO:teuthology.orchestra.run.smithi156.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:19:01.262 INFO:teuthology.orchestra.run.smithi156.stdout: "grade_table": [], 2023-09-30T22:19:01.262 INFO:teuthology.orchestra.run.smithi156.stdout: "stripe_width": 0, 2023-09-30T22:19:01.262 INFO:teuthology.orchestra.run.smithi156.stdout: "expected_num_objects": 0, 2023-09-30T22:19:01.262 INFO:teuthology.orchestra.run.smithi156.stdout: "fast_read": false, 2023-09-30T22:19:01.262 INFO:teuthology.orchestra.run.smithi156.stdout: "options": { 2023-09-30T22:19:01.262 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_num_max": 32, 2023-09-30T22:19:01.263 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_num_min": 1 2023-09-30T22:19:01.263 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.263 INFO:teuthology.orchestra.run.smithi156.stdout: "application_metadata": { 2023-09-30T22:19:01.263 INFO:teuthology.orchestra.run.smithi156.stdout: "mgr": {}, 2023-09-30T22:19:01.263 INFO:teuthology.orchestra.run.smithi156.stdout: "mgr_devicehealth": {} 2023-09-30T22:19:01.263 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.263 INFO:teuthology.orchestra.run.smithi156.stdout: "read_balance": { 2023-09-30T22:19:01.263 INFO:teuthology.orchestra.run.smithi156.stdout: "score_acting": 4, 2023-09-30T22:19:01.263 INFO:teuthology.orchestra.run.smithi156.stdout: "score_stable": 4, 2023-09-30T22:19:01.263 INFO:teuthology.orchestra.run.smithi156.stdout: "optimal_score": 0.5, 2023-09-30T22:19:01.263 INFO:teuthology.orchestra.run.smithi156.stdout: "raw_score_acting": 2, 2023-09-30T22:19:01.263 INFO:teuthology.orchestra.run.smithi156.stdout: "raw_score_stable": 2, 2023-09-30T22:19:01.263 INFO:teuthology.orchestra.run.smithi156.stdout: "primary_affinity_weighted": 1, 2023-09-30T22:19:01.264 INFO:teuthology.orchestra.run.smithi156.stdout: "average_primary_affinity": 1, 2023-09-30T22:19:01.264 INFO:teuthology.orchestra.run.smithi156.stdout: "average_primary_affinity_weighted": 1 2023-09-30T22:19:01.264 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.264 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.264 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.264 INFO:teuthology.orchestra.run.smithi156.stdout: "pool": 2, 2023-09-30T22:19:01.264 INFO:teuthology.orchestra.run.smithi156.stdout: "pool_name": "rbd", 2023-09-30T22:19:01.264 INFO:teuthology.orchestra.run.smithi156.stdout: "create_time": "2023-09-30T22:16:24.367795+0000", 2023-09-30T22:19:01.264 INFO:teuthology.orchestra.run.smithi156.stdout: "flags": 1, 2023-09-30T22:19:01.264 INFO:teuthology.orchestra.run.smithi156.stdout: "flags_names": "hashpspool", 2023-09-30T22:19:01.264 INFO:teuthology.orchestra.run.smithi156.stdout: "type": 1, 2023-09-30T22:19:01.264 INFO:teuthology.orchestra.run.smithi156.stdout: "size": 2, 2023-09-30T22:19:01.265 INFO:teuthology.orchestra.run.smithi156.stdout: "min_size": 1, 2023-09-30T22:19:01.265 INFO:teuthology.orchestra.run.smithi156.stdout: "crush_rule": 0, 2023-09-30T22:19:01.265 INFO:teuthology.orchestra.run.smithi156.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:19:01.265 INFO:teuthology.orchestra.run.smithi156.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:19:01.265 INFO:teuthology.orchestra.run.smithi156.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:19:01.265 INFO:teuthology.orchestra.run.smithi156.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:19:01.265 INFO:teuthology.orchestra.run.smithi156.stdout: "object_hash": 2, 2023-09-30T22:19:01.265 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:19:01.265 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_num": 8, 2023-09-30T22:19:01.265 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_placement_num": 8, 2023-09-30T22:19:01.265 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_placement_num_target": 8, 2023-09-30T22:19:01.265 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_num_target": 8, 2023-09-30T22:19:01.265 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_num_pending": 8, 2023-09-30T22:19:01.266 INFO:teuthology.orchestra.run.smithi156.stdout: "last_pg_merge_meta": { 2023-09-30T22:19:01.266 INFO:teuthology.orchestra.run.smithi156.stdout: "source_pgid": "0.0", 2023-09-30T22:19:01.266 INFO:teuthology.orchestra.run.smithi156.stdout: "ready_epoch": 0, 2023-09-30T22:19:01.266 INFO:teuthology.orchestra.run.smithi156.stdout: "last_epoch_started": 0, 2023-09-30T22:19:01.266 INFO:teuthology.orchestra.run.smithi156.stdout: "last_epoch_clean": 0, 2023-09-30T22:19:01.266 INFO:teuthology.orchestra.run.smithi156.stdout: "source_version": "0'0", 2023-09-30T22:19:01.266 INFO:teuthology.orchestra.run.smithi156.stdout: "target_version": "0'0" 2023-09-30T22:19:01.266 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.266 INFO:teuthology.orchestra.run.smithi156.stdout: "last_change": "12", 2023-09-30T22:19:01.266 INFO:teuthology.orchestra.run.smithi156.stdout: "last_force_op_resend": "0", 2023-09-30T22:19:01.266 INFO:teuthology.orchestra.run.smithi156.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:19:01.266 INFO:teuthology.orchestra.run.smithi156.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:19:01.267 INFO:teuthology.orchestra.run.smithi156.stdout: "auid": 0, 2023-09-30T22:19:01.267 INFO:teuthology.orchestra.run.smithi156.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:19:01.267 INFO:teuthology.orchestra.run.smithi156.stdout: "snap_seq": 0, 2023-09-30T22:19:01.267 INFO:teuthology.orchestra.run.smithi156.stdout: "snap_epoch": 0, 2023-09-30T22:19:01.267 INFO:teuthology.orchestra.run.smithi156.stdout: "pool_snaps": [], 2023-09-30T22:19:01.267 INFO:teuthology.orchestra.run.smithi156.stdout: "removed_snaps": "[]", 2023-09-30T22:19:01.267 INFO:teuthology.orchestra.run.smithi156.stdout: "quota_max_bytes": 0, 2023-09-30T22:19:01.267 INFO:teuthology.orchestra.run.smithi156.stdout: "quota_max_objects": 0, 2023-09-30T22:19:01.267 INFO:teuthology.orchestra.run.smithi156.stdout: "tiers": [], 2023-09-30T22:19:01.267 INFO:teuthology.orchestra.run.smithi156.stdout: "tier_of": -1, 2023-09-30T22:19:01.267 INFO:teuthology.orchestra.run.smithi156.stdout: "read_tier": -1, 2023-09-30T22:19:01.267 INFO:teuthology.orchestra.run.smithi156.stdout: "write_tier": -1, 2023-09-30T22:19:01.268 INFO:teuthology.orchestra.run.smithi156.stdout: "cache_mode": "none", 2023-09-30T22:19:01.268 INFO:teuthology.orchestra.run.smithi156.stdout: "target_max_bytes": 0, 2023-09-30T22:19:01.268 INFO:teuthology.orchestra.run.smithi156.stdout: "target_max_objects": 0, 2023-09-30T22:19:01.268 INFO:teuthology.orchestra.run.smithi156.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:19:01.268 INFO:teuthology.orchestra.run.smithi156.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:19:01.268 INFO:teuthology.orchestra.run.smithi156.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:19:01.268 INFO:teuthology.orchestra.run.smithi156.stdout: "cache_min_flush_age": 0, 2023-09-30T22:19:01.268 INFO:teuthology.orchestra.run.smithi156.stdout: "cache_min_evict_age": 0, 2023-09-30T22:19:01.268 INFO:teuthology.orchestra.run.smithi156.stdout: "erasure_code_profile": "", 2023-09-30T22:19:01.268 INFO:teuthology.orchestra.run.smithi156.stdout: "hit_set_params": { 2023-09-30T22:19:01.268 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "none" 2023-09-30T22:19:01.268 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.268 INFO:teuthology.orchestra.run.smithi156.stdout: "hit_set_period": 0, 2023-09-30T22:19:01.269 INFO:teuthology.orchestra.run.smithi156.stdout: "hit_set_count": 0, 2023-09-30T22:19:01.269 INFO:teuthology.orchestra.run.smithi156.stdout: "use_gmt_hitset": true, 2023-09-30T22:19:01.269 INFO:teuthology.orchestra.run.smithi156.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:19:01.269 INFO:teuthology.orchestra.run.smithi156.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:19:01.269 INFO:teuthology.orchestra.run.smithi156.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:19:01.269 INFO:teuthology.orchestra.run.smithi156.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:19:01.269 INFO:teuthology.orchestra.run.smithi156.stdout: "grade_table": [], 2023-09-30T22:19:01.269 INFO:teuthology.orchestra.run.smithi156.stdout: "stripe_width": 0, 2023-09-30T22:19:01.269 INFO:teuthology.orchestra.run.smithi156.stdout: "expected_num_objects": 0, 2023-09-30T22:19:01.269 INFO:teuthology.orchestra.run.smithi156.stdout: "fast_read": false, 2023-09-30T22:19:01.269 INFO:teuthology.orchestra.run.smithi156.stdout: "options": {}, 2023-09-30T22:19:01.269 INFO:teuthology.orchestra.run.smithi156.stdout: "application_metadata": { 2023-09-30T22:19:01.270 INFO:teuthology.orchestra.run.smithi156.stdout: "rbd": {} 2023-09-30T22:19:01.270 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.270 INFO:teuthology.orchestra.run.smithi156.stdout: "read_balance": { 2023-09-30T22:19:01.270 INFO:teuthology.orchestra.run.smithi156.stdout: "score_acting": 2.5, 2023-09-30T22:19:01.270 INFO:teuthology.orchestra.run.smithi156.stdout: "score_stable": 2.5, 2023-09-30T22:19:01.270 INFO:teuthology.orchestra.run.smithi156.stdout: "optimal_score": 1, 2023-09-30T22:19:01.270 INFO:teuthology.orchestra.run.smithi156.stdout: "raw_score_acting": 2.5, 2023-09-30T22:19:01.270 INFO:teuthology.orchestra.run.smithi156.stdout: "raw_score_stable": 2.5, 2023-09-30T22:19:01.270 INFO:teuthology.orchestra.run.smithi156.stdout: "primary_affinity_weighted": 1, 2023-09-30T22:19:01.271 INFO:teuthology.orchestra.run.smithi156.stdout: "average_primary_affinity": 1, 2023-09-30T22:19:01.271 INFO:teuthology.orchestra.run.smithi156.stdout: "average_primary_affinity_weighted": 1 2023-09-30T22:19:01.271 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.271 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.271 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.271 INFO:teuthology.orchestra.run.smithi156.stdout: "pool": 3, 2023-09-30T22:19:01.271 INFO:teuthology.orchestra.run.smithi156.stdout: "pool_name": "cephfs_metadata", 2023-09-30T22:19:01.272 INFO:teuthology.orchestra.run.smithi156.stdout: "create_time": "2023-09-30T22:16:28.204677+0000", 2023-09-30T22:19:01.272 INFO:teuthology.orchestra.run.smithi156.stdout: "flags": 1, 2023-09-30T22:19:01.272 INFO:teuthology.orchestra.run.smithi156.stdout: "flags_names": "hashpspool", 2023-09-30T22:19:01.272 INFO:teuthology.orchestra.run.smithi156.stdout: "type": 1, 2023-09-30T22:19:01.272 INFO:teuthology.orchestra.run.smithi156.stdout: "size": 2, 2023-09-30T22:19:01.272 INFO:teuthology.orchestra.run.smithi156.stdout: "min_size": 1, 2023-09-30T22:19:01.272 INFO:teuthology.orchestra.run.smithi156.stdout: "crush_rule": 0, 2023-09-30T22:19:01.272 INFO:teuthology.orchestra.run.smithi156.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:19:01.272 INFO:teuthology.orchestra.run.smithi156.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:19:01.272 INFO:teuthology.orchestra.run.smithi156.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:19:01.272 INFO:teuthology.orchestra.run.smithi156.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:19:01.272 INFO:teuthology.orchestra.run.smithi156.stdout: "object_hash": 2, 2023-09-30T22:19:01.272 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:19:01.273 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_num": 32, 2023-09-30T22:19:01.273 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_placement_num": 32, 2023-09-30T22:19:01.273 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_placement_num_target": 32, 2023-09-30T22:19:01.273 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_num_target": 32, 2023-09-30T22:19:01.273 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_num_pending": 32, 2023-09-30T22:19:01.273 INFO:teuthology.orchestra.run.smithi156.stdout: "last_pg_merge_meta": { 2023-09-30T22:19:01.273 INFO:teuthology.orchestra.run.smithi156.stdout: "source_pgid": "0.0", 2023-09-30T22:19:01.273 INFO:teuthology.orchestra.run.smithi156.stdout: "ready_epoch": 0, 2023-09-30T22:19:01.273 INFO:teuthology.orchestra.run.smithi156.stdout: "last_epoch_started": 0, 2023-09-30T22:19:01.273 INFO:teuthology.orchestra.run.smithi156.stdout: "last_epoch_clean": 0, 2023-09-30T22:19:01.273 INFO:teuthology.orchestra.run.smithi156.stdout: "source_version": "0'0", 2023-09-30T22:19:01.273 INFO:teuthology.orchestra.run.smithi156.stdout: "target_version": "0'0" 2023-09-30T22:19:01.274 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.274 INFO:teuthology.orchestra.run.smithi156.stdout: "last_change": "15", 2023-09-30T22:19:01.274 INFO:teuthology.orchestra.run.smithi156.stdout: "last_force_op_resend": "0", 2023-09-30T22:19:01.274 INFO:teuthology.orchestra.run.smithi156.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:19:01.274 INFO:teuthology.orchestra.run.smithi156.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:19:01.274 INFO:teuthology.orchestra.run.smithi156.stdout: "auid": 0, 2023-09-30T22:19:01.274 INFO:teuthology.orchestra.run.smithi156.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:19:01.274 INFO:teuthology.orchestra.run.smithi156.stdout: "snap_seq": 0, 2023-09-30T22:19:01.274 INFO:teuthology.orchestra.run.smithi156.stdout: "snap_epoch": 0, 2023-09-30T22:19:01.274 INFO:teuthology.orchestra.run.smithi156.stdout: "pool_snaps": [], 2023-09-30T22:19:01.274 INFO:teuthology.orchestra.run.smithi156.stdout: "removed_snaps": "[]", 2023-09-30T22:19:01.275 INFO:teuthology.orchestra.run.smithi156.stdout: "quota_max_bytes": 0, 2023-09-30T22:19:01.275 INFO:teuthology.orchestra.run.smithi156.stdout: "quota_max_objects": 0, 2023-09-30T22:19:01.275 INFO:teuthology.orchestra.run.smithi156.stdout: "tiers": [], 2023-09-30T22:19:01.275 INFO:teuthology.orchestra.run.smithi156.stdout: "tier_of": -1, 2023-09-30T22:19:01.275 INFO:teuthology.orchestra.run.smithi156.stdout: "read_tier": -1, 2023-09-30T22:19:01.275 INFO:teuthology.orchestra.run.smithi156.stdout: "write_tier": -1, 2023-09-30T22:19:01.275 INFO:teuthology.orchestra.run.smithi156.stdout: "cache_mode": "none", 2023-09-30T22:19:01.275 INFO:teuthology.orchestra.run.smithi156.stdout: "target_max_bytes": 0, 2023-09-30T22:19:01.275 INFO:teuthology.orchestra.run.smithi156.stdout: "target_max_objects": 0, 2023-09-30T22:19:01.275 INFO:teuthology.orchestra.run.smithi156.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:19:01.275 INFO:teuthology.orchestra.run.smithi156.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:19:01.276 INFO:teuthology.orchestra.run.smithi156.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:19:01.276 INFO:teuthology.orchestra.run.smithi156.stdout: "cache_min_flush_age": 0, 2023-09-30T22:19:01.276 INFO:teuthology.orchestra.run.smithi156.stdout: "cache_min_evict_age": 0, 2023-09-30T22:19:01.276 INFO:teuthology.orchestra.run.smithi156.stdout: "erasure_code_profile": "", 2023-09-30T22:19:01.276 INFO:teuthology.orchestra.run.smithi156.stdout: "hit_set_params": { 2023-09-30T22:19:01.276 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "none" 2023-09-30T22:19:01.276 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.276 INFO:teuthology.orchestra.run.smithi156.stdout: "hit_set_period": 0, 2023-09-30T22:19:01.276 INFO:teuthology.orchestra.run.smithi156.stdout: "hit_set_count": 0, 2023-09-30T22:19:01.276 INFO:teuthology.orchestra.run.smithi156.stdout: "use_gmt_hitset": true, 2023-09-30T22:19:01.276 INFO:teuthology.orchestra.run.smithi156.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:19:01.276 INFO:teuthology.orchestra.run.smithi156.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:19:01.277 INFO:teuthology.orchestra.run.smithi156.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:19:01.277 INFO:teuthology.orchestra.run.smithi156.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:19:01.277 INFO:teuthology.orchestra.run.smithi156.stdout: "grade_table": [], 2023-09-30T22:19:01.277 INFO:teuthology.orchestra.run.smithi156.stdout: "stripe_width": 0, 2023-09-30T22:19:01.277 INFO:teuthology.orchestra.run.smithi156.stdout: "expected_num_objects": 0, 2023-09-30T22:19:01.277 INFO:teuthology.orchestra.run.smithi156.stdout: "fast_read": false, 2023-09-30T22:19:01.277 INFO:teuthology.orchestra.run.smithi156.stdout: "options": { 2023-09-30T22:19:01.277 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_autoscale_bias": 4, 2023-09-30T22:19:01.277 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_num_min": 16, 2023-09-30T22:19:01.277 INFO:teuthology.orchestra.run.smithi156.stdout: "recovery_priority": 5 2023-09-30T22:19:01.277 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.278 INFO:teuthology.orchestra.run.smithi156.stdout: "application_metadata": { 2023-09-30T22:19:01.278 INFO:teuthology.orchestra.run.smithi156.stdout: "cephfs": { 2023-09-30T22:19:01.278 INFO:teuthology.orchestra.run.smithi156.stdout: "metadata": "cephfs" 2023-09-30T22:19:01.278 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.278 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.278 INFO:teuthology.orchestra.run.smithi156.stdout: "read_balance": { 2023-09-30T22:19:01.278 INFO:teuthology.orchestra.run.smithi156.stdout: "score_acting": 1.6299999952316284, 2023-09-30T22:19:01.278 INFO:teuthology.orchestra.run.smithi156.stdout: "score_stable": 1.6299999952316284, 2023-09-30T22:19:01.279 INFO:teuthology.orchestra.run.smithi156.stdout: "optimal_score": 1, 2023-09-30T22:19:01.279 INFO:teuthology.orchestra.run.smithi156.stdout: "raw_score_acting": 1.6299999952316284, 2023-09-30T22:19:01.279 INFO:teuthology.orchestra.run.smithi156.stdout: "raw_score_stable": 1.6299999952316284, 2023-09-30T22:19:01.279 INFO:teuthology.orchestra.run.smithi156.stdout: "primary_affinity_weighted": 1, 2023-09-30T22:19:01.279 INFO:teuthology.orchestra.run.smithi156.stdout: "average_primary_affinity": 1, 2023-09-30T22:19:01.279 INFO:teuthology.orchestra.run.smithi156.stdout: "average_primary_affinity_weighted": 1 2023-09-30T22:19:01.279 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.279 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.279 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.279 INFO:teuthology.orchestra.run.smithi156.stdout: "pool": 4, 2023-09-30T22:19:01.279 INFO:teuthology.orchestra.run.smithi156.stdout: "pool_name": "cephfs_data", 2023-09-30T22:19:01.280 INFO:teuthology.orchestra.run.smithi156.stdout: "create_time": "2023-09-30T22:16:28.762804+0000", 2023-09-30T22:19:01.280 INFO:teuthology.orchestra.run.smithi156.stdout: "flags": 1, 2023-09-30T22:19:01.280 INFO:teuthology.orchestra.run.smithi156.stdout: "flags_names": "hashpspool", 2023-09-30T22:19:01.280 INFO:teuthology.orchestra.run.smithi156.stdout: "type": 1, 2023-09-30T22:19:01.280 INFO:teuthology.orchestra.run.smithi156.stdout: "size": 2, 2023-09-30T22:19:01.280 INFO:teuthology.orchestra.run.smithi156.stdout: "min_size": 1, 2023-09-30T22:19:01.280 INFO:teuthology.orchestra.run.smithi156.stdout: "crush_rule": 0, 2023-09-30T22:19:01.280 INFO:teuthology.orchestra.run.smithi156.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:19:01.280 INFO:teuthology.orchestra.run.smithi156.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:19:01.280 INFO:teuthology.orchestra.run.smithi156.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:19:01.280 INFO:teuthology.orchestra.run.smithi156.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:19:01.281 INFO:teuthology.orchestra.run.smithi156.stdout: "object_hash": 2, 2023-09-30T22:19:01.281 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:19:01.281 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_num": 64, 2023-09-30T22:19:01.281 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_placement_num": 64, 2023-09-30T22:19:01.281 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_placement_num_target": 64, 2023-09-30T22:19:01.281 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_num_target": 64, 2023-09-30T22:19:01.281 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_num_pending": 64, 2023-09-30T22:19:01.281 INFO:teuthology.orchestra.run.smithi156.stdout: "last_pg_merge_meta": { 2023-09-30T22:19:01.281 INFO:teuthology.orchestra.run.smithi156.stdout: "source_pgid": "0.0", 2023-09-30T22:19:01.282 INFO:teuthology.orchestra.run.smithi156.stdout: "ready_epoch": 0, 2023-09-30T22:19:01.282 INFO:teuthology.orchestra.run.smithi156.stdout: "last_epoch_started": 0, 2023-09-30T22:19:01.282 INFO:teuthology.orchestra.run.smithi156.stdout: "last_epoch_clean": 0, 2023-09-30T22:19:01.282 INFO:teuthology.orchestra.run.smithi156.stdout: "source_version": "0'0", 2023-09-30T22:19:01.282 INFO:teuthology.orchestra.run.smithi156.stdout: "target_version": "0'0" 2023-09-30T22:19:01.282 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.282 INFO:teuthology.orchestra.run.smithi156.stdout: "last_change": "16", 2023-09-30T22:19:01.282 INFO:teuthology.orchestra.run.smithi156.stdout: "last_force_op_resend": "0", 2023-09-30T22:19:01.282 INFO:teuthology.orchestra.run.smithi156.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:19:01.282 INFO:teuthology.orchestra.run.smithi156.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:19:01.282 INFO:teuthology.orchestra.run.smithi156.stdout: "auid": 0, 2023-09-30T22:19:01.283 INFO:teuthology.orchestra.run.smithi156.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:19:01.283 INFO:teuthology.orchestra.run.smithi156.stdout: "snap_seq": 0, 2023-09-30T22:19:01.283 INFO:teuthology.orchestra.run.smithi156.stdout: "snap_epoch": 0, 2023-09-30T22:19:01.283 INFO:teuthology.orchestra.run.smithi156.stdout: "pool_snaps": [], 2023-09-30T22:19:01.283 INFO:teuthology.orchestra.run.smithi156.stdout: "removed_snaps": "[]", 2023-09-30T22:19:01.283 INFO:teuthology.orchestra.run.smithi156.stdout: "quota_max_bytes": 0, 2023-09-30T22:19:01.283 INFO:teuthology.orchestra.run.smithi156.stdout: "quota_max_objects": 0, 2023-09-30T22:19:01.283 INFO:teuthology.orchestra.run.smithi156.stdout: "tiers": [], 2023-09-30T22:19:01.283 INFO:teuthology.orchestra.run.smithi156.stdout: "tier_of": -1, 2023-09-30T22:19:01.283 INFO:teuthology.orchestra.run.smithi156.stdout: "read_tier": -1, 2023-09-30T22:19:01.283 INFO:teuthology.orchestra.run.smithi156.stdout: "write_tier": -1, 2023-09-30T22:19:01.284 INFO:teuthology.orchestra.run.smithi156.stdout: "cache_mode": "none", 2023-09-30T22:19:01.284 INFO:teuthology.orchestra.run.smithi156.stdout: "target_max_bytes": 0, 2023-09-30T22:19:01.284 INFO:teuthology.orchestra.run.smithi156.stdout: "target_max_objects": 0, 2023-09-30T22:19:01.284 INFO:teuthology.orchestra.run.smithi156.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:19:01.284 INFO:teuthology.orchestra.run.smithi156.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:19:01.284 INFO:teuthology.orchestra.run.smithi156.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:19:01.284 INFO:teuthology.orchestra.run.smithi156.stdout: "cache_min_flush_age": 0, 2023-09-30T22:19:01.284 INFO:teuthology.orchestra.run.smithi156.stdout: "cache_min_evict_age": 0, 2023-09-30T22:19:01.284 INFO:teuthology.orchestra.run.smithi156.stdout: "erasure_code_profile": "", 2023-09-30T22:19:01.284 INFO:teuthology.orchestra.run.smithi156.stdout: "hit_set_params": { 2023-09-30T22:19:01.284 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "none" 2023-09-30T22:19:01.285 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.285 INFO:teuthology.orchestra.run.smithi156.stdout: "hit_set_period": 0, 2023-09-30T22:19:01.285 INFO:teuthology.orchestra.run.smithi156.stdout: "hit_set_count": 0, 2023-09-30T22:19:01.285 INFO:teuthology.orchestra.run.smithi156.stdout: "use_gmt_hitset": true, 2023-09-30T22:19:01.285 INFO:teuthology.orchestra.run.smithi156.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:19:01.285 INFO:teuthology.orchestra.run.smithi156.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:19:01.285 INFO:teuthology.orchestra.run.smithi156.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:19:01.285 INFO:teuthology.orchestra.run.smithi156.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:19:01.285 INFO:teuthology.orchestra.run.smithi156.stdout: "grade_table": [], 2023-09-30T22:19:01.285 INFO:teuthology.orchestra.run.smithi156.stdout: "stripe_width": 0, 2023-09-30T22:19:01.285 INFO:teuthology.orchestra.run.smithi156.stdout: "expected_num_objects": 0, 2023-09-30T22:19:01.285 INFO:teuthology.orchestra.run.smithi156.stdout: "fast_read": false, 2023-09-30T22:19:01.286 INFO:teuthology.orchestra.run.smithi156.stdout: "options": { 2023-09-30T22:19:01.286 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_num_min": 64, 2023-09-30T22:19:01.286 INFO:teuthology.orchestra.run.smithi156.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T22:19:01.286 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.286 INFO:teuthology.orchestra.run.smithi156.stdout: "application_metadata": { 2023-09-30T22:19:01.286 INFO:teuthology.orchestra.run.smithi156.stdout: "cephfs": { 2023-09-30T22:19:01.286 INFO:teuthology.orchestra.run.smithi156.stdout: "data": "cephfs" 2023-09-30T22:19:01.286 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.286 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.286 INFO:teuthology.orchestra.run.smithi156.stdout: "read_balance": { 2023-09-30T22:19:01.286 INFO:teuthology.orchestra.run.smithi156.stdout: "score_acting": 1.059999942779541, 2023-09-30T22:19:01.287 INFO:teuthology.orchestra.run.smithi156.stdout: "score_stable": 1.059999942779541, 2023-09-30T22:19:01.287 INFO:teuthology.orchestra.run.smithi156.stdout: "optimal_score": 1, 2023-09-30T22:19:01.287 INFO:teuthology.orchestra.run.smithi156.stdout: "raw_score_acting": 1.059999942779541, 2023-09-30T22:19:01.287 INFO:teuthology.orchestra.run.smithi156.stdout: "raw_score_stable": 1.059999942779541, 2023-09-30T22:19:01.287 INFO:teuthology.orchestra.run.smithi156.stdout: "primary_affinity_weighted": 1, 2023-09-30T22:19:01.287 INFO:teuthology.orchestra.run.smithi156.stdout: "average_primary_affinity": 1, 2023-09-30T22:19:01.287 INFO:teuthology.orchestra.run.smithi156.stdout: "average_primary_affinity_weighted": 1 2023-09-30T22:19:01.287 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.287 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.287 INFO:teuthology.orchestra.run.smithi156.stdout: ], 2023-09-30T22:19:01.287 INFO:teuthology.orchestra.run.smithi156.stdout: "osds": [ 2023-09-30T22:19:01.288 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.288 INFO:teuthology.orchestra.run.smithi156.stdout: "osd": 0, 2023-09-30T22:19:01.288 INFO:teuthology.orchestra.run.smithi156.stdout: "uuid": "3ec2e78a-c61f-473a-bfcb-f956cffe4095", 2023-09-30T22:19:01.288 INFO:teuthology.orchestra.run.smithi156.stdout: "up": 1, 2023-09-30T22:19:01.288 INFO:teuthology.orchestra.run.smithi156.stdout: "in": 1, 2023-09-30T22:19:01.288 INFO:teuthology.orchestra.run.smithi156.stdout: "weight": 1, 2023-09-30T22:19:01.288 INFO:teuthology.orchestra.run.smithi156.stdout: "primary_affinity": 1, 2023-09-30T22:19:01.288 INFO:teuthology.orchestra.run.smithi156.stdout: "last_clean_begin": 9, 2023-09-30T22:19:01.288 INFO:teuthology.orchestra.run.smithi156.stdout: "last_clean_end": 22, 2023-09-30T22:19:01.288 INFO:teuthology.orchestra.run.smithi156.stdout: "up_from": 28, 2023-09-30T22:19:01.288 INFO:teuthology.orchestra.run.smithi156.stdout: "up_thru": 31, 2023-09-30T22:19:01.289 INFO:teuthology.orchestra.run.smithi156.stdout: "down_at": 23, 2023-09-30T22:19:01.289 INFO:teuthology.orchestra.run.smithi156.stdout: "lost_at": 0, 2023-09-30T22:19:01.289 INFO:teuthology.orchestra.run.smithi156.stdout: "public_addrs": { 2023-09-30T22:19:01.289 INFO:teuthology.orchestra.run.smithi156.stdout: "addrvec": [ 2023-09-30T22:19:01.289 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.289 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "v1", 2023-09-30T22:19:01.289 INFO:teuthology.orchestra.run.smithi156.stdout: "addr": "172.21.15.156:6803", 2023-09-30T22:19:01.289 INFO:teuthology.orchestra.run.smithi156.stdout: "nonce": 129485 2023-09-30T22:19:01.289 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.289 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-30T22:19:01.289 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.290 INFO:teuthology.orchestra.run.smithi156.stdout: "cluster_addrs": { 2023-09-30T22:19:01.290 INFO:teuthology.orchestra.run.smithi156.stdout: "addrvec": [ 2023-09-30T22:19:01.290 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.290 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "v1", 2023-09-30T22:19:01.290 INFO:teuthology.orchestra.run.smithi156.stdout: "addr": "172.21.15.156:6805", 2023-09-30T22:19:01.290 INFO:teuthology.orchestra.run.smithi156.stdout: "nonce": 129485 2023-09-30T22:19:01.290 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.290 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-30T22:19:01.290 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.290 INFO:teuthology.orchestra.run.smithi156.stdout: "heartbeat_back_addrs": { 2023-09-30T22:19:01.290 INFO:teuthology.orchestra.run.smithi156.stdout: "addrvec": [ 2023-09-30T22:19:01.291 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.291 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "v1", 2023-09-30T22:19:01.291 INFO:teuthology.orchestra.run.smithi156.stdout: "addr": "172.21.15.156:6807", 2023-09-30T22:19:01.291 INFO:teuthology.orchestra.run.smithi156.stdout: "nonce": 129485 2023-09-30T22:19:01.291 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.291 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-30T22:19:01.291 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.291 INFO:teuthology.orchestra.run.smithi156.stdout: "heartbeat_front_addrs": { 2023-09-30T22:19:01.291 INFO:teuthology.orchestra.run.smithi156.stdout: "addrvec": [ 2023-09-30T22:19:01.291 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.291 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "v1", 2023-09-30T22:19:01.292 INFO:teuthology.orchestra.run.smithi156.stdout: "addr": "172.21.15.156:6806", 2023-09-30T22:19:01.292 INFO:teuthology.orchestra.run.smithi156.stdout: "nonce": 129485 2023-09-30T22:19:01.292 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.292 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-30T22:19:01.292 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.292 INFO:teuthology.orchestra.run.smithi156.stdout: "public_addr": "172.21.15.156:6803/129485", 2023-09-30T22:19:01.292 INFO:teuthology.orchestra.run.smithi156.stdout: "cluster_addr": "172.21.15.156:6805/129485", 2023-09-30T22:19:01.292 INFO:teuthology.orchestra.run.smithi156.stdout: "heartbeat_back_addr": "172.21.15.156:6807/129485", 2023-09-30T22:19:01.292 INFO:teuthology.orchestra.run.smithi156.stdout: "heartbeat_front_addr": "172.21.15.156:6806/129485", 2023-09-30T22:19:01.292 INFO:teuthology.orchestra.run.smithi156.stdout: "state": [ 2023-09-30T22:19:01.292 INFO:teuthology.orchestra.run.smithi156.stdout: "exists", 2023-09-30T22:19:01.292 INFO:teuthology.orchestra.run.smithi156.stdout: "up" 2023-09-30T22:19:01.293 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-30T22:19:01.293 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.293 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.293 INFO:teuthology.orchestra.run.smithi156.stdout: "osd": 1, 2023-09-30T22:19:01.293 INFO:teuthology.orchestra.run.smithi156.stdout: "uuid": "b682e683-c15a-4bd9-8712-8af96454e9ab", 2023-09-30T22:19:01.293 INFO:teuthology.orchestra.run.smithi156.stdout: "up": 1, 2023-09-30T22:19:01.293 INFO:teuthology.orchestra.run.smithi156.stdout: "in": 1, 2023-09-30T22:19:01.293 INFO:teuthology.orchestra.run.smithi156.stdout: "weight": 1, 2023-09-30T22:19:01.293 INFO:teuthology.orchestra.run.smithi156.stdout: "primary_affinity": 1, 2023-09-30T22:19:01.293 INFO:teuthology.orchestra.run.smithi156.stdout: "last_clean_begin": 9, 2023-09-30T22:19:01.293 INFO:teuthology.orchestra.run.smithi156.stdout: "last_clean_end": 22, 2023-09-30T22:19:01.294 INFO:teuthology.orchestra.run.smithi156.stdout: "up_from": 29, 2023-09-30T22:19:01.294 INFO:teuthology.orchestra.run.smithi156.stdout: "up_thru": 31, 2023-09-30T22:19:01.294 INFO:teuthology.orchestra.run.smithi156.stdout: "down_at": 24, 2023-09-30T22:19:01.294 INFO:teuthology.orchestra.run.smithi156.stdout: "lost_at": 0, 2023-09-30T22:19:01.294 INFO:teuthology.orchestra.run.smithi156.stdout: "public_addrs": { 2023-09-30T22:19:01.294 INFO:teuthology.orchestra.run.smithi156.stdout: "addrvec": [ 2023-09-30T22:19:01.294 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.294 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "v1", 2023-09-30T22:19:01.294 INFO:teuthology.orchestra.run.smithi156.stdout: "addr": "172.21.15.156:6808", 2023-09-30T22:19:01.294 INFO:teuthology.orchestra.run.smithi156.stdout: "nonce": 129583 2023-09-30T22:19:01.294 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.295 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-30T22:19:01.295 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.295 INFO:teuthology.orchestra.run.smithi156.stdout: "cluster_addrs": { 2023-09-30T22:19:01.295 INFO:teuthology.orchestra.run.smithi156.stdout: "addrvec": [ 2023-09-30T22:19:01.295 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.295 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "v1", 2023-09-30T22:19:01.295 INFO:teuthology.orchestra.run.smithi156.stdout: "addr": "172.21.15.156:6809", 2023-09-30T22:19:01.295 INFO:teuthology.orchestra.run.smithi156.stdout: "nonce": 129583 2023-09-30T22:19:01.295 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.295 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-30T22:19:01.295 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.295 INFO:teuthology.orchestra.run.smithi156.stdout: "heartbeat_back_addrs": { 2023-09-30T22:19:01.296 INFO:teuthology.orchestra.run.smithi156.stdout: "addrvec": [ 2023-09-30T22:19:01.296 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.296 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "v1", 2023-09-30T22:19:01.296 INFO:teuthology.orchestra.run.smithi156.stdout: "addr": "172.21.15.156:6811", 2023-09-30T22:19:01.296 INFO:teuthology.orchestra.run.smithi156.stdout: "nonce": 129583 2023-09-30T22:19:01.296 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.296 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-30T22:19:01.296 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.296 INFO:teuthology.orchestra.run.smithi156.stdout: "heartbeat_front_addrs": { 2023-09-30T22:19:01.296 INFO:teuthology.orchestra.run.smithi156.stdout: "addrvec": [ 2023-09-30T22:19:01.296 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.296 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "v1", 2023-09-30T22:19:01.297 INFO:teuthology.orchestra.run.smithi156.stdout: "addr": "172.21.15.156:6810", 2023-09-30T22:19:01.297 INFO:teuthology.orchestra.run.smithi156.stdout: "nonce": 129583 2023-09-30T22:19:01.297 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.297 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-30T22:19:01.297 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.297 INFO:teuthology.orchestra.run.smithi156.stdout: "public_addr": "172.21.15.156:6808/129583", 2023-09-30T22:19:01.297 INFO:teuthology.orchestra.run.smithi156.stdout: "cluster_addr": "172.21.15.156:6809/129583", 2023-09-30T22:19:01.297 INFO:teuthology.orchestra.run.smithi156.stdout: "heartbeat_back_addr": "172.21.15.156:6811/129583", 2023-09-30T22:19:01.297 INFO:teuthology.orchestra.run.smithi156.stdout: "heartbeat_front_addr": "172.21.15.156:6810/129583", 2023-09-30T22:19:01.297 INFO:teuthology.orchestra.run.smithi156.stdout: "state": [ 2023-09-30T22:19:01.297 INFO:teuthology.orchestra.run.smithi156.stdout: "exists", 2023-09-30T22:19:01.297 INFO:teuthology.orchestra.run.smithi156.stdout: "up" 2023-09-30T22:19:01.298 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-30T22:19:01.298 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.298 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.298 INFO:teuthology.orchestra.run.smithi156.stdout: "osd": 2, 2023-09-30T22:19:01.298 INFO:teuthology.orchestra.run.smithi156.stdout: "uuid": "960dbaf0-2e0c-437e-9114-bc22ce522b26", 2023-09-30T22:19:01.298 INFO:teuthology.orchestra.run.smithi156.stdout: "up": 1, 2023-09-30T22:19:01.298 INFO:teuthology.orchestra.run.smithi156.stdout: "in": 1, 2023-09-30T22:19:01.298 INFO:teuthology.orchestra.run.smithi156.stdout: "weight": 1, 2023-09-30T22:19:01.298 INFO:teuthology.orchestra.run.smithi156.stdout: "primary_affinity": 1, 2023-09-30T22:19:01.298 INFO:teuthology.orchestra.run.smithi156.stdout: "last_clean_begin": 9, 2023-09-30T22:19:01.298 INFO:teuthology.orchestra.run.smithi156.stdout: "last_clean_end": 24, 2023-09-30T22:19:01.298 INFO:teuthology.orchestra.run.smithi156.stdout: "up_from": 30, 2023-09-30T22:19:01.299 INFO:teuthology.orchestra.run.smithi156.stdout: "up_thru": 31, 2023-09-30T22:19:01.299 INFO:teuthology.orchestra.run.smithi156.stdout: "down_at": 25, 2023-09-30T22:19:01.299 INFO:teuthology.orchestra.run.smithi156.stdout: "lost_at": 0, 2023-09-30T22:19:01.299 INFO:teuthology.orchestra.run.smithi156.stdout: "public_addrs": { 2023-09-30T22:19:01.299 INFO:teuthology.orchestra.run.smithi156.stdout: "addrvec": [ 2023-09-30T22:19:01.299 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.299 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "v1", 2023-09-30T22:19:01.299 INFO:teuthology.orchestra.run.smithi156.stdout: "addr": "172.21.15.156:6800", 2023-09-30T22:19:01.299 INFO:teuthology.orchestra.run.smithi156.stdout: "nonce": 129693 2023-09-30T22:19:01.299 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.299 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-30T22:19:01.299 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.300 INFO:teuthology.orchestra.run.smithi156.stdout: "cluster_addrs": { 2023-09-30T22:19:01.300 INFO:teuthology.orchestra.run.smithi156.stdout: "addrvec": [ 2023-09-30T22:19:01.300 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.300 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "v1", 2023-09-30T22:19:01.300 INFO:teuthology.orchestra.run.smithi156.stdout: "addr": "172.21.15.156:6801", 2023-09-30T22:19:01.300 INFO:teuthology.orchestra.run.smithi156.stdout: "nonce": 129693 2023-09-30T22:19:01.300 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.300 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-30T22:19:01.300 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.300 INFO:teuthology.orchestra.run.smithi156.stdout: "heartbeat_back_addrs": { 2023-09-30T22:19:01.300 INFO:teuthology.orchestra.run.smithi156.stdout: "addrvec": [ 2023-09-30T22:19:01.300 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.301 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "v1", 2023-09-30T22:19:01.301 INFO:teuthology.orchestra.run.smithi156.stdout: "addr": "172.21.15.156:6804", 2023-09-30T22:19:01.301 INFO:teuthology.orchestra.run.smithi156.stdout: "nonce": 129693 2023-09-30T22:19:01.301 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.301 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-30T22:19:01.301 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.301 INFO:teuthology.orchestra.run.smithi156.stdout: "heartbeat_front_addrs": { 2023-09-30T22:19:01.301 INFO:teuthology.orchestra.run.smithi156.stdout: "addrvec": [ 2023-09-30T22:19:01.301 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.301 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "v1", 2023-09-30T22:19:01.301 INFO:teuthology.orchestra.run.smithi156.stdout: "addr": "172.21.15.156:6802", 2023-09-30T22:19:01.301 INFO:teuthology.orchestra.run.smithi156.stdout: "nonce": 129693 2023-09-30T22:19:01.301 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.302 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-30T22:19:01.302 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.302 INFO:teuthology.orchestra.run.smithi156.stdout: "public_addr": "172.21.15.156:6800/129693", 2023-09-30T22:19:01.302 INFO:teuthology.orchestra.run.smithi156.stdout: "cluster_addr": "172.21.15.156:6801/129693", 2023-09-30T22:19:01.302 INFO:teuthology.orchestra.run.smithi156.stdout: "heartbeat_back_addr": "172.21.15.156:6804/129693", 2023-09-30T22:19:01.302 INFO:teuthology.orchestra.run.smithi156.stdout: "heartbeat_front_addr": "172.21.15.156:6802/129693", 2023-09-30T22:19:01.302 INFO:teuthology.orchestra.run.smithi156.stdout: "state": [ 2023-09-30T22:19:01.302 INFO:teuthology.orchestra.run.smithi156.stdout: "exists", 2023-09-30T22:19:01.302 INFO:teuthology.orchestra.run.smithi156.stdout: "up" 2023-09-30T22:19:01.302 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-30T22:19:01.302 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.302 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.303 INFO:teuthology.orchestra.run.smithi156.stdout: "osd": 3, 2023-09-30T22:19:01.303 INFO:teuthology.orchestra.run.smithi156.stdout: "uuid": "c1b19714-78b1-4869-8721-2f6352a64a05", 2023-09-30T22:19:01.303 INFO:teuthology.orchestra.run.smithi156.stdout: "up": 1, 2023-09-30T22:19:01.303 INFO:teuthology.orchestra.run.smithi156.stdout: "in": 1, 2023-09-30T22:19:01.303 INFO:teuthology.orchestra.run.smithi156.stdout: "weight": 1, 2023-09-30T22:19:01.303 INFO:teuthology.orchestra.run.smithi156.stdout: "primary_affinity": 1, 2023-09-30T22:19:01.303 INFO:teuthology.orchestra.run.smithi156.stdout: "last_clean_begin": 9, 2023-09-30T22:19:01.303 INFO:teuthology.orchestra.run.smithi156.stdout: "last_clean_end": 25, 2023-09-30T22:19:01.303 INFO:teuthology.orchestra.run.smithi156.stdout: "up_from": 31, 2023-09-30T22:19:01.303 INFO:teuthology.orchestra.run.smithi156.stdout: "up_thru": 31, 2023-09-30T22:19:01.303 INFO:teuthology.orchestra.run.smithi156.stdout: "down_at": 26, 2023-09-30T22:19:01.303 INFO:teuthology.orchestra.run.smithi156.stdout: "lost_at": 0, 2023-09-30T22:19:01.303 INFO:teuthology.orchestra.run.smithi156.stdout: "public_addrs": { 2023-09-30T22:19:01.304 INFO:teuthology.orchestra.run.smithi156.stdout: "addrvec": [ 2023-09-30T22:19:01.304 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.304 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "v1", 2023-09-30T22:19:01.304 INFO:teuthology.orchestra.run.smithi156.stdout: "addr": "172.21.15.156:6812", 2023-09-30T22:19:01.304 INFO:teuthology.orchestra.run.smithi156.stdout: "nonce": 129849 2023-09-30T22:19:01.304 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.304 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-30T22:19:01.304 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.304 INFO:teuthology.orchestra.run.smithi156.stdout: "cluster_addrs": { 2023-09-30T22:19:01.304 INFO:teuthology.orchestra.run.smithi156.stdout: "addrvec": [ 2023-09-30T22:19:01.304 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.304 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "v1", 2023-09-30T22:19:01.305 INFO:teuthology.orchestra.run.smithi156.stdout: "addr": "172.21.15.156:6813", 2023-09-30T22:19:01.305 INFO:teuthology.orchestra.run.smithi156.stdout: "nonce": 129849 2023-09-30T22:19:01.305 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.305 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-30T22:19:01.305 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.305 INFO:teuthology.orchestra.run.smithi156.stdout: "heartbeat_back_addrs": { 2023-09-30T22:19:01.305 INFO:teuthology.orchestra.run.smithi156.stdout: "addrvec": [ 2023-09-30T22:19:01.305 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.305 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "v1", 2023-09-30T22:19:01.305 INFO:teuthology.orchestra.run.smithi156.stdout: "addr": "172.21.15.156:6815", 2023-09-30T22:19:01.305 INFO:teuthology.orchestra.run.smithi156.stdout: "nonce": 129849 2023-09-30T22:19:01.305 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.306 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-30T22:19:01.306 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.306 INFO:teuthology.orchestra.run.smithi156.stdout: "heartbeat_front_addrs": { 2023-09-30T22:19:01.306 INFO:teuthology.orchestra.run.smithi156.stdout: "addrvec": [ 2023-09-30T22:19:01.306 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.306 INFO:teuthology.orchestra.run.smithi156.stdout: "type": "v1", 2023-09-30T22:19:01.306 INFO:teuthology.orchestra.run.smithi156.stdout: "addr": "172.21.15.156:6814", 2023-09-30T22:19:01.306 INFO:teuthology.orchestra.run.smithi156.stdout: "nonce": 129849 2023-09-30T22:19:01.306 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.306 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-30T22:19:01.306 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.306 INFO:teuthology.orchestra.run.smithi156.stdout: "public_addr": "172.21.15.156:6812/129849", 2023-09-30T22:19:01.307 INFO:teuthology.orchestra.run.smithi156.stdout: "cluster_addr": "172.21.15.156:6813/129849", 2023-09-30T22:19:01.307 INFO:teuthology.orchestra.run.smithi156.stdout: "heartbeat_back_addr": "172.21.15.156:6815/129849", 2023-09-30T22:19:01.307 INFO:teuthology.orchestra.run.smithi156.stdout: "heartbeat_front_addr": "172.21.15.156:6814/129849", 2023-09-30T22:19:01.307 INFO:teuthology.orchestra.run.smithi156.stdout: "state": [ 2023-09-30T22:19:01.307 INFO:teuthology.orchestra.run.smithi156.stdout: "exists", 2023-09-30T22:19:01.307 INFO:teuthology.orchestra.run.smithi156.stdout: "up" 2023-09-30T22:19:01.307 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-30T22:19:01.307 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.307 INFO:teuthology.orchestra.run.smithi156.stdout: ], 2023-09-30T22:19:01.307 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_xinfo": [ 2023-09-30T22:19:01.307 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.307 INFO:teuthology.orchestra.run.smithi156.stdout: "osd": 0, 2023-09-30T22:19:01.307 INFO:teuthology.orchestra.run.smithi156.stdout: "down_stamp": "0.000000", 2023-09-30T22:19:01.308 INFO:teuthology.orchestra.run.smithi156.stdout: "laggy_probability": 0, 2023-09-30T22:19:01.308 INFO:teuthology.orchestra.run.smithi156.stdout: "laggy_interval": 0, 2023-09-30T22:19:01.308 INFO:teuthology.orchestra.run.smithi156.stdout: "features": 4540138322906710015, 2023-09-30T22:19:01.308 INFO:teuthology.orchestra.run.smithi156.stdout: "old_weight": 0, 2023-09-30T22:19:01.308 INFO:teuthology.orchestra.run.smithi156.stdout: "last_purged_snaps_scrub": "2023-09-30T22:16:21.663343+0000", 2023-09-30T22:19:01.308 INFO:teuthology.orchestra.run.smithi156.stdout: "dead_epoch": 23 2023-09-30T22:19:01.308 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.308 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.308 INFO:teuthology.orchestra.run.smithi156.stdout: "osd": 1, 2023-09-30T22:19:01.308 INFO:teuthology.orchestra.run.smithi156.stdout: "down_stamp": "0.000000", 2023-09-30T22:19:01.308 INFO:teuthology.orchestra.run.smithi156.stdout: "laggy_probability": 0, 2023-09-30T22:19:01.308 INFO:teuthology.orchestra.run.smithi156.stdout: "laggy_interval": 0, 2023-09-30T22:19:01.309 INFO:teuthology.orchestra.run.smithi156.stdout: "features": 4540138322906710015, 2023-09-30T22:19:01.309 INFO:teuthology.orchestra.run.smithi156.stdout: "old_weight": 0, 2023-09-30T22:19:01.309 INFO:teuthology.orchestra.run.smithi156.stdout: "last_purged_snaps_scrub": "2023-09-30T22:16:21.827397+0000", 2023-09-30T22:19:01.309 INFO:teuthology.orchestra.run.smithi156.stdout: "dead_epoch": 24 2023-09-30T22:19:01.309 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.309 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.309 INFO:teuthology.orchestra.run.smithi156.stdout: "osd": 2, 2023-09-30T22:19:01.309 INFO:teuthology.orchestra.run.smithi156.stdout: "down_stamp": "0.000000", 2023-09-30T22:19:01.309 INFO:teuthology.orchestra.run.smithi156.stdout: "laggy_probability": 0, 2023-09-30T22:19:01.309 INFO:teuthology.orchestra.run.smithi156.stdout: "laggy_interval": 0, 2023-09-30T22:19:01.309 INFO:teuthology.orchestra.run.smithi156.stdout: "features": 4540138322906710015, 2023-09-30T22:19:01.309 INFO:teuthology.orchestra.run.smithi156.stdout: "old_weight": 0, 2023-09-30T22:19:01.310 INFO:teuthology.orchestra.run.smithi156.stdout: "last_purged_snaps_scrub": "2023-09-30T22:16:21.806655+0000", 2023-09-30T22:19:01.310 INFO:teuthology.orchestra.run.smithi156.stdout: "dead_epoch": 25 2023-09-30T22:19:01.310 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.310 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.310 INFO:teuthology.orchestra.run.smithi156.stdout: "osd": 3, 2023-09-30T22:19:01.310 INFO:teuthology.orchestra.run.smithi156.stdout: "down_stamp": "2023-09-30T22:18:49.807414+0000", 2023-09-30T22:19:01.310 INFO:teuthology.orchestra.run.smithi156.stdout: "laggy_probability": 0, 2023-09-30T22:19:01.310 INFO:teuthology.orchestra.run.smithi156.stdout: "laggy_interval": 0, 2023-09-30T22:19:01.310 INFO:teuthology.orchestra.run.smithi156.stdout: "features": 4540138322906710015, 2023-09-30T22:19:01.310 INFO:teuthology.orchestra.run.smithi156.stdout: "old_weight": 0, 2023-09-30T22:19:01.310 INFO:teuthology.orchestra.run.smithi156.stdout: "last_purged_snaps_scrub": "2023-09-30T22:16:21.634746+0000", 2023-09-30T22:19:01.310 INFO:teuthology.orchestra.run.smithi156.stdout: "dead_epoch": 0 2023-09-30T22:19:01.311 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.311 INFO:teuthology.orchestra.run.smithi156.stdout: ], 2023-09-30T22:19:01.311 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_upmap": [], 2023-09-30T22:19:01.311 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_upmap_items": [ 2023-09-30T22:19:01.311 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.311 INFO:teuthology.orchestra.run.smithi156.stdout: "pgid": "4.0", 2023-09-30T22:19:01.311 INFO:teuthology.orchestra.run.smithi156.stdout: "mappings": [ 2023-09-30T22:19:01.311 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.311 INFO:teuthology.orchestra.run.smithi156.stdout: "from": 3, 2023-09-30T22:19:01.311 INFO:teuthology.orchestra.run.smithi156.stdout: "to": 2 2023-09-30T22:19:01.311 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.311 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-30T22:19:01.312 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.312 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.312 INFO:teuthology.orchestra.run.smithi156.stdout: "pgid": "4.2", 2023-09-30T22:19:01.312 INFO:teuthology.orchestra.run.smithi156.stdout: "mappings": [ 2023-09-30T22:19:01.312 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.312 INFO:teuthology.orchestra.run.smithi156.stdout: "from": 3, 2023-09-30T22:19:01.312 INFO:teuthology.orchestra.run.smithi156.stdout: "to": 0 2023-09-30T22:19:01.312 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.312 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-30T22:19:01.312 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.312 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.312 INFO:teuthology.orchestra.run.smithi156.stdout: "pgid": "4.5", 2023-09-30T22:19:01.312 INFO:teuthology.orchestra.run.smithi156.stdout: "mappings": [ 2023-09-30T22:19:01.313 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.313 INFO:teuthology.orchestra.run.smithi156.stdout: "from": 3, 2023-09-30T22:19:01.313 INFO:teuthology.orchestra.run.smithi156.stdout: "to": 2 2023-09-30T22:19:01.313 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.313 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-30T22:19:01.313 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.313 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.313 INFO:teuthology.orchestra.run.smithi156.stdout: "pgid": "4.9", 2023-09-30T22:19:01.313 INFO:teuthology.orchestra.run.smithi156.stdout: "mappings": [ 2023-09-30T22:19:01.313 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.313 INFO:teuthology.orchestra.run.smithi156.stdout: "from": 3, 2023-09-30T22:19:01.313 INFO:teuthology.orchestra.run.smithi156.stdout: "to": 0 2023-09-30T22:19:01.314 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.314 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-30T22:19:01.314 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.314 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.314 INFO:teuthology.orchestra.run.smithi156.stdout: "pgid": "4.a", 2023-09-30T22:19:01.314 INFO:teuthology.orchestra.run.smithi156.stdout: "mappings": [ 2023-09-30T22:19:01.314 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.314 INFO:teuthology.orchestra.run.smithi156.stdout: "from": 3, 2023-09-30T22:19:01.314 INFO:teuthology.orchestra.run.smithi156.stdout: "to": 0 2023-09-30T22:19:01.314 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.314 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-30T22:19:01.314 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.315 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.315 INFO:teuthology.orchestra.run.smithi156.stdout: "pgid": "4.c", 2023-09-30T22:19:01.315 INFO:teuthology.orchestra.run.smithi156.stdout: "mappings": [ 2023-09-30T22:19:01.315 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.315 INFO:teuthology.orchestra.run.smithi156.stdout: "from": 3, 2023-09-30T22:19:01.315 INFO:teuthology.orchestra.run.smithi156.stdout: "to": 2 2023-09-30T22:19:01.315 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.315 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-30T22:19:01.315 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.315 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.315 INFO:teuthology.orchestra.run.smithi156.stdout: "pgid": "4.10", 2023-09-30T22:19:01.315 INFO:teuthology.orchestra.run.smithi156.stdout: "mappings": [ 2023-09-30T22:19:01.315 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.316 INFO:teuthology.orchestra.run.smithi156.stdout: "from": 1, 2023-09-30T22:19:01.316 INFO:teuthology.orchestra.run.smithi156.stdout: "to": 2 2023-09-30T22:19:01.316 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.316 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-30T22:19:01.316 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.316 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.316 INFO:teuthology.orchestra.run.smithi156.stdout: "pgid": "4.3b", 2023-09-30T22:19:01.316 INFO:teuthology.orchestra.run.smithi156.stdout: "mappings": [ 2023-09-30T22:19:01.316 INFO:teuthology.orchestra.run.smithi156.stdout: { 2023-09-30T22:19:01.316 INFO:teuthology.orchestra.run.smithi156.stdout: "from": 3, 2023-09-30T22:19:01.316 INFO:teuthology.orchestra.run.smithi156.stdout: "to": 2 2023-09-30T22:19:01.316 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.316 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-30T22:19:01.317 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.317 INFO:teuthology.orchestra.run.smithi156.stdout: ], 2023-09-30T22:19:01.317 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_upmap_primaries": [], 2023-09-30T22:19:01.317 INFO:teuthology.orchestra.run.smithi156.stdout: "pg_temp": [], 2023-09-30T22:19:01.317 INFO:teuthology.orchestra.run.smithi156.stdout: "primary_temp": [], 2023-09-30T22:19:01.317 INFO:teuthology.orchestra.run.smithi156.stdout: "blocklist": { 2023-09-30T22:19:01.317 INFO:teuthology.orchestra.run.smithi156.stdout: "172.21.15.156:6816/118236": "2023-10-01T22:18:37.767496+0000", 2023-09-30T22:19:01.317 INFO:teuthology.orchestra.run.smithi156.stdout: "172.21.15.156:0/1464735255": "2023-10-01T22:18:37.767496+0000", 2023-09-30T22:19:01.317 INFO:teuthology.orchestra.run.smithi156.stdout: "172.21.15.156:6817/3817969673": "2023-10-01T22:19:00.677676+0000", 2023-09-30T22:19:01.317 INFO:teuthology.orchestra.run.smithi156.stdout: "172.21.15.156:0/2593263545": "2023-10-01T22:18:37.767496+0000" 2023-09-30T22:19:01.317 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.317 INFO:teuthology.orchestra.run.smithi156.stdout: "range_blocklist": {}, 2023-09-30T22:19:01.318 INFO:teuthology.orchestra.run.smithi156.stdout: "erasure_code_profiles": { 2023-09-30T22:19:01.318 INFO:teuthology.orchestra.run.smithi156.stdout: "default": { 2023-09-30T22:19:01.318 INFO:teuthology.orchestra.run.smithi156.stdout: "crush-failure-domain": "osd", 2023-09-30T22:19:01.318 INFO:teuthology.orchestra.run.smithi156.stdout: "k": "2", 2023-09-30T22:19:01.318 INFO:teuthology.orchestra.run.smithi156.stdout: "m": "1", 2023-09-30T22:19:01.318 INFO:teuthology.orchestra.run.smithi156.stdout: "plugin": "jerasure", 2023-09-30T22:19:01.318 INFO:teuthology.orchestra.run.smithi156.stdout: "technique": "reed_sol_van" 2023-09-30T22:19:01.318 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.318 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.318 INFO:teuthology.orchestra.run.smithi156.stdout: "removed_snaps_queue": [], 2023-09-30T22:19:01.318 INFO:teuthology.orchestra.run.smithi156.stdout: "new_removed_snaps": [], 2023-09-30T22:19:01.318 INFO:teuthology.orchestra.run.smithi156.stdout: "new_purged_snaps": [], 2023-09-30T22:19:01.318 INFO:teuthology.orchestra.run.smithi156.stdout: "crush_node_flags": {}, 2023-09-30T22:19:01.319 INFO:teuthology.orchestra.run.smithi156.stdout: "device_class_flags": {}, 2023-09-30T22:19:01.319 INFO:teuthology.orchestra.run.smithi156.stdout: "stretch_mode": { 2023-09-30T22:19:01.319 INFO:teuthology.orchestra.run.smithi156.stdout: "stretch_mode_enabled": false, 2023-09-30T22:19:01.319 INFO:teuthology.orchestra.run.smithi156.stdout: "stretch_bucket_count": 0, 2023-09-30T22:19:01.319 INFO:teuthology.orchestra.run.smithi156.stdout: "degraded_stretch_mode": 0, 2023-09-30T22:19:01.319 INFO:teuthology.orchestra.run.smithi156.stdout: "recovering_stretch_mode": 0, 2023-09-30T22:19:01.319 INFO:teuthology.orchestra.run.smithi156.stdout: "stretch_mode_bucket": 0 2023-09-30T22:19:01.319 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.319 INFO:teuthology.orchestra.run.smithi156.stdout:} 2023-09-30T22:19:01.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.254+0000 7f9243e74700 1 -- 172.21.15.156:0/2133251164 >> v1:172.21.15.156:6816/126965 conn(0x7f922002f510 legacy=0x7f92200319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:01.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.254+0000 7f9243e74700 1 -- 172.21.15.156:0/2133251164 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f923c09da00 msgr2=0x7f923c11e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:01.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.254+0000 7f9243e74700 1 --2- 172.21.15.156:0/2133251164 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f923c09da00 0x7f923c11e7e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9238000c00 tx=0x7f9238004750 comp rx=0 tx=0).stop 2023-09-30T22:19:01.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.255+0000 7f9243e74700 1 -- 172.21.15.156:0/2133251164 shutdown_connections 2023-09-30T22:19:01.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.255+0000 7f9243e74700 1 --2- 172.21.15.156:0/2133251164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f923c133e50 0x7f923c11f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:01.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.255+0000 7f9243e74700 1 --2- 172.21.15.156:0/2133251164 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f923c09da00 0x7f923c11e7e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:01.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.255+0000 7f9243e74700 1 --2- 172.21.15.156:0/2133251164 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f923c09e310 0x7f923c11ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:01.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.255+0000 7f9243e74700 1 -- 172.21.15.156:0/2133251164 >> 172.21.15.156:0/2133251164 conn(0x7f923c099e60 msgr2=0x7f923c132ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:01.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.255+0000 7f9243e74700 1 -- 172.21.15.156:0/2133251164 shutdown_connections 2023-09-30T22:19:01.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.255+0000 7f9243e74700 1 -- 172.21.15.156:0/2133251164 wait complete. 2023-09-30T22:19:01.322 DEBUG:teuthology.orchestra.run.smithi156:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph versions' 2023-09-30T22:19:01.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.439+0000 7fceb0538700 1 Processor -- start 2023-09-30T22:19:01.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.439+0000 7fceb0538700 1 -- start start 2023-09-30T22:19:01.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.439+0000 7fceb0538700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcea81318a0 0x7fcea8131c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:01.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.439+0000 7fceb0538700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcea81321b0 0x7fcea806a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:01.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.439+0000 7fceb0538700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcea806acb0 0x7fcea806b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:01.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.439+0000 7fceb0538700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcea809f100 con 0x7fcea806acb0 2023-09-30T22:19:01.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.439+0000 7fceb0538700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea809e760 con 0x7fcea81318a0 2023-09-30T22:19:01.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.439+0000 7fceb0538700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcea8131680 con 0x7fcea81321b0 2023-09-30T22:19:01.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.439+0000 7fceae2d4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcea81318a0 0x7fcea8131c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:01.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.439+0000 7fceadad3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcea81321b0 0x7fcea806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:01.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.439+0000 7fceaead5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcea806acb0 0x7fcea806b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:01.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.439+0000 7fceaead5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcea806acb0 0x7fcea806b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58632/0 (socket says 172.21.15.156:58632) 2023-09-30T22:19:01.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.439+0000 7fceae2d4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcea81318a0 0x7fcea8131c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48256/0 (socket says 172.21.15.156:48256) 2023-09-30T22:19:01.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.439+0000 7fceaead5700 1 -- 172.21.15.156:0/2207749333 learned_addr learned my addr 172.21.15.156:0/2207749333 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:01.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.439+0000 7fceadad3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcea81321b0 0x7fcea806a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45174/0 (socket says 172.21.15.156:45174) 2023-09-30T22:19:01.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.440+0000 7fceaead5700 1 -- 172.21.15.156:0/2207749333 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcea81321b0 msgr2=0x7fcea806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:01.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.440+0000 7fceaead5700 1 --2- 172.21.15.156:0/2207749333 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcea81321b0 0x7fcea806a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:01.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.440+0000 7fceaead5700 1 -- 172.21.15.156:0/2207749333 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcea81318a0 msgr2=0x7fcea8131c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:01.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.440+0000 7fceaead5700 1 --2- 172.21.15.156:0/2207749333 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcea81318a0 0x7fcea8131c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:01.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.440+0000 7fceaead5700 1 -- 172.21.15.156:0/2207749333 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea809eb60 con 0x7fcea806acb0 2023-09-30T22:19:01.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.440+0000 7fceadad3700 1 --2- 172.21.15.156:0/2207749333 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcea81321b0 0x7fcea806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:01.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.440+0000 7fceaead5700 1 --2- 172.21.15.156:0/2207749333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcea806acb0 0x7fcea806b150 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009e50 tx=0x7fcea000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be3f54e4e6c28988 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:01.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.440+0000 7fcead2d2700 1 -- 172.21.15.156:0/2207749333 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea000e070 con 0x7fcea806acb0 2023-09-30T22:19:01.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.440+0000 7fcead2d2700 1 -- 172.21.15.156:0/2207749333 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea000b910 con 0x7fcea806acb0 2023-09-30T22:19:01.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.440+0000 7fcead2d2700 1 -- 172.21.15.156:0/2207749333 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea000bcc0 con 0x7fcea806acb0 2023-09-30T22:19:01.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.441+0000 7fceb0538700 1 -- 172.21.15.156:0/2207749333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcea806acb0 msgr2=0x7fcea806b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:01.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.441+0000 7fceb0538700 1 --2- 172.21.15.156:0/2207749333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcea806acb0 0x7fcea806b150 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009e50 tx=0x7fcea000b330 comp rx=0 tx=0).stop 2023-09-30T22:19:01.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.441+0000 7fceb0538700 1 -- 172.21.15.156:0/2207749333 shutdown_connections 2023-09-30T22:19:01.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.441+0000 7fceb0538700 1 --2- 172.21.15.156:0/2207749333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcea806acb0 0x7fcea806b150 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:01.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.441+0000 7fceb0538700 1 --2- 172.21.15.156:0/2207749333 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcea81318a0 0x7fcea8131c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:01.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.441+0000 7fceb0538700 1 --2- 172.21.15.156:0/2207749333 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcea81321b0 0x7fcea806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:01.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.441+0000 7fceb0538700 1 -- 172.21.15.156:0/2207749333 >> 172.21.15.156:0/2207749333 conn(0x7fcea8099e60 msgr2=0x7fcea80a3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:01.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.441+0000 7fceb0538700 1 -- 172.21.15.156:0/2207749333 shutdown_connections 2023-09-30T22:19:01.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.441+0000 7fceb0538700 1 -- 172.21.15.156:0/2207749333 wait complete. 2023-09-30T22:19:01.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.442+0000 7fceb0538700 1 Processor -- start 2023-09-30T22:19:01.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.442+0000 7fceb0538700 1 -- start start 2023-09-30T22:19:01.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.442+0000 7fceb0538700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcea806acb0 0x7fcea8119770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:01.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.442+0000 7fceb0538700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcea81318a0 0x7fcea8119cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:01.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.442+0000 7fceb0538700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcea81321b0 0x7fcea811a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:01.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.442+0000 7fceb0538700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea812bbf0 con 0x7fcea806acb0 2023-09-30T22:19:01.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.442+0000 7fceb0538700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea8072a40 con 0x7fcea81318a0 2023-09-30T22:19:01.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.442+0000 7fceb0538700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcea811bff0 con 0x7fcea81321b0 2023-09-30T22:19:01.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.442+0000 7fceadad3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcea81318a0 0x7fcea8119cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:01.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.442+0000 7fceaead5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcea81321b0 0x7fcea811a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:01.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.442+0000 7fceae2d4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcea806acb0 0x7fcea8119770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:01.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.442+0000 7fceadad3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcea81318a0 0x7fcea8119cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48272/0 (socket says 172.21.15.156:48272) 2023-09-30T22:19:01.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.442+0000 7fceadad3700 1 -- 172.21.15.156:0/106216015 learned_addr learned my addr 172.21.15.156:0/106216015 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:01.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.442+0000 7fceaead5700 1 -- 172.21.15.156:0/106216015 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcea81318a0 msgr2=0x7fcea8119cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:01.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.442+0000 7fceaead5700 1 --2- 172.21.15.156:0/106216015 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcea81318a0 0x7fcea8119cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:01.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.442+0000 7fceaead5700 1 -- 172.21.15.156:0/106216015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcea806acb0 msgr2=0x7fcea8119770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:01.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.442+0000 7fceaead5700 1 --2- 172.21.15.156:0/106216015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcea806acb0 0x7fcea8119770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:01.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.442+0000 7fceaead5700 1 -- 172.21.15.156:0/106216015 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9800d940 con 0x7fcea81321b0 2023-09-30T22:19:01.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.442+0000 7fceae2d4700 1 --2- 172.21.15.156:0/106216015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcea806acb0 0x7fcea8119770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:01.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.442+0000 7fceadad3700 1 --2- 172.21.15.156:0/106216015 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcea81318a0 0x7fcea8119cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:01.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.443+0000 7fceaead5700 1 --2- 172.21.15.156:0/106216015 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcea81321b0 0x7fcea811a1f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcea0015000 tx=0x7fcea0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:01.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.443+0000 7fce9effd700 1 -- 172.21.15.156:0/106216015 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea00092e0 con 0x7fcea81321b0 2023-09-30T22:19:01.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.443+0000 7fce9effd700 1 -- 172.21.15.156:0/106216015 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea000ce80 con 0x7fcea81321b0 2023-09-30T22:19:01.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.443+0000 7fceb0538700 1 -- 172.21.15.156:0/106216015 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea0009b30 con 0x7fcea81321b0 2023-09-30T22:19:01.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.443+0000 7fce9effd700 1 -- 172.21.15.156:0/106216015 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea00044b0 con 0x7fcea81321b0 2023-09-30T22:19:01.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.443+0000 7fceb0538700 1 -- 172.21.15.156:0/106216015 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea811a910 con 0x7fcea81321b0 2023-09-30T22:19:01.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.444+0000 7fce9effd700 1 -- 172.21.15.156:0/106216015 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fcea0004610 con 0x7fcea81321b0 2023-09-30T22:19:01.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.444+0000 7fce9effd700 1 -- 172.21.15.156:0/106216015 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fcea0041050 con 0x7fcea81321b0 2023-09-30T22:19:01.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.444+0000 7fceb0538700 1 -- 172.21.15.156:0/106216015 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea811bc40 con 0x7fcea81321b0 2023-09-30T22:19:01.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.448+0000 7fce9effd700 1 -- 172.21.15.156:0/106216015 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcea00048c0 con 0x7fcea81321b0 2023-09-30T22:19:01.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.710+0000 7fceb0538700 1 -- 172.21.15.156:0/106216015 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcea809ed80 con 0x7fcea81321b0 2023-09-30T22:19:01.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.711+0000 7fce9effd700 1 -- 172.21.15.156:0/106216015 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+627 (secure 0 0 0) 0x7fcea0011b80 con 0x7fcea81321b0 2023-09-30T22:19:01.711 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2023-09-30T22:19:01.712 INFO:teuthology.orchestra.run.smithi156.stdout: "mon": { 2023-09-30T22:19:01.712 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable)": 3 2023-09-30T22:19:01.712 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.712 INFO:teuthology.orchestra.run.smithi156.stdout: "mgr": { 2023-09-30T22:19:01.712 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable)": 1 2023-09-30T22:19:01.712 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.712 INFO:teuthology.orchestra.run.smithi156.stdout: "osd": { 2023-09-30T22:19:01.712 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable)": 4 2023-09-30T22:19:01.712 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.712 INFO:teuthology.orchestra.run.smithi156.stdout: "mds": { 2023-09-30T22:19:01.712 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable)": 1 2023-09-30T22:19:01.713 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-30T22:19:01.713 INFO:teuthology.orchestra.run.smithi156.stdout: "overall": { 2023-09-30T22:19:01.713 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable)": 9 2023-09-30T22:19:01.713 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-30T22:19:01.713 INFO:teuthology.orchestra.run.smithi156.stdout:} 2023-09-30T22:19:01.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.713+0000 7fceb0538700 1 -- 172.21.15.156:0/106216015 >> v1:172.21.15.156:6816/126965 conn(0x7fce8c02f510 legacy=0x7fce8c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:01.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.713+0000 7fceb0538700 1 -- 172.21.15.156:0/106216015 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcea81321b0 msgr2=0x7fcea811a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:01.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.713+0000 7fceb0538700 1 --2- 172.21.15.156:0/106216015 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcea81321b0 0x7fcea811a1f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcea0015000 tx=0x7fcea0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:19:01.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.713+0000 7fceb0538700 1 -- 172.21.15.156:0/106216015 shutdown_connections 2023-09-30T22:19:01.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.713+0000 7fceb0538700 1 --2- 172.21.15.156:0/106216015 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcea81321b0 0x7fcea811a1f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:01.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.713+0000 7fceb0538700 1 --2- 172.21.15.156:0/106216015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcea806acb0 0x7fcea8119770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:01.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.713+0000 7fceb0538700 1 --2- 172.21.15.156:0/106216015 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcea81318a0 0x7fcea8119cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:01.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.713+0000 7fceb0538700 1 -- 172.21.15.156:0/106216015 >> 172.21.15.156:0/106216015 conn(0x7fcea8099e60 msgr2=0x7fcea80a32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:01.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.713+0000 7fceb0538700 1 -- 172.21.15.156:0/106216015 shutdown_connections 2023-09-30T22:19:01.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.713+0000 7fceb0538700 1 -- 172.21.15.156:0/106216015 wait complete. 2023-09-30T22:19:01.725 DEBUG:teuthology.orchestra.run.smithi156:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done' 2023-09-30T22:19:01.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.847+0000 7f45502cd700 1 Processor -- start 2023-09-30T22:19:01.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.847+0000 7f45502cd700 1 -- start start 2023-09-30T22:19:01.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.847+0000 7f45502cd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4548134860 0x7f4548136c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:01.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.847+0000 7f45502cd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4548137180 0x7f4548139560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:01.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.847+0000 7f45502cd700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45480a2280 con 0x7f4548131a40 2023-09-30T22:19:01.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.847+0000 7f45502cd700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4548131820 con 0x7f4548134860 2023-09-30T22:19:01.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.847+0000 7f45502cd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45480a1920 con 0x7f4548137180 2023-09-30T22:19:01.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.848+0000 7f454d868700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4548134860 0x7f4548136c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:01.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.848+0000 7f454e86a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4548137180 0x7f4548139560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:01.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.848+0000 7f454d868700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4548134860 0x7f4548136c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58648/0 (socket says 172.21.15.156:58648) 2023-09-30T22:19:01.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.848+0000 7f454d868700 1 -- 172.21.15.156:0/3587100038 learned_addr learned my addr 172.21.15.156:0/3587100038 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:01.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.848+0000 7f454e86a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4548137180 0x7f4548139560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48280/0 (socket says 172.21.15.156:48280) 2023-09-30T22:19:01.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.848+0000 7f454e069700 1 --1- 172.21.15.156:0/3587100038 >> v1:172.21.15.156:6789/0 conn(0x7f4548131a40 0x7f4548131e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:33848/0 (socket says 172.21.15.156:33848) 2023-09-30T22:19:01.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.848+0000 7f454d868700 1 -- 172.21.15.156:0/3587100038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4548137180 msgr2=0x7f4548139560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:01.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.848+0000 7f454d868700 1 --2- 172.21.15.156:0/3587100038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4548137180 0x7f4548139560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:01.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.848+0000 7f454d868700 1 -- 172.21.15.156:0/3587100038 >> v1:172.21.15.156:6789/0 conn(0x7f4548131a40 legacy=0x7f4548131e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:01.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.848+0000 7f454d868700 1 -- 172.21.15.156:0/3587100038 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4548131550 con 0x7f4548134860 2023-09-30T22:19:01.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.848+0000 7f454d067700 1 -- 172.21.15.156:0/3587100038 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989300296 0 0) 0x7f45480a2280 con 0x7f4548131a40 2023-09-30T22:19:01.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.848+0000 7f454e86a700 1 --2- 172.21.15.156:0/3587100038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4548137180 0x7f4548139560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:01.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.848+0000 7f454d868700 1 --2- 172.21.15.156:0/3587100038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4548134860 0x7f4548136c40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f45380098f0 tx=0x7f4538009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=324048026b6ecf11 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:01.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.848+0000 7f454d067700 1 -- 172.21.15.156:0/3587100038 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4538011830 con 0x7f4548134860 2023-09-30T22:19:01.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.848+0000 7f454d067700 1 -- 172.21.15.156:0/3587100038 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4538011990 con 0x7f4548134860 2023-09-30T22:19:01.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.848+0000 7f454d067700 1 -- 172.21.15.156:0/3587100038 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4538011d20 con 0x7f4548134860 2023-09-30T22:19:01.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.849+0000 7f45502cd700 1 -- 172.21.15.156:0/3587100038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4548134860 msgr2=0x7f4548136c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:01.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.849+0000 7f45502cd700 1 --2- 172.21.15.156:0/3587100038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4548134860 0x7f4548136c40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f45380098f0 tx=0x7f4538009c00 comp rx=0 tx=0).stop 2023-09-30T22:19:01.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.849+0000 7f45502cd700 1 -- 172.21.15.156:0/3587100038 shutdown_connections 2023-09-30T22:19:01.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.849+0000 7f45502cd700 1 --2- 172.21.15.156:0/3587100038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4548137180 0x7f4548139560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:01.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.849+0000 7f45502cd700 1 --2- 172.21.15.156:0/3587100038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4548134860 0x7f4548136c40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:01.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.849+0000 7f45502cd700 1 -- 172.21.15.156:0/3587100038 >> 172.21.15.156:0/3587100038 conn(0x7f45480a2b70 msgr2=0x7f45480a2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:01.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.849+0000 7f45502cd700 1 -- 172.21.15.156:0/3587100038 shutdown_connections 2023-09-30T22:19:01.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.849+0000 7f45502cd700 1 -- 172.21.15.156:0/3587100038 wait complete. 2023-09-30T22:19:01.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.850+0000 7f45502cd700 1 Processor -- start 2023-09-30T22:19:01.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.850+0000 7f45502cd700 1 -- start start 2023-09-30T22:19:01.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.850+0000 7f45502cd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4548131a40 0x7f4548118fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:01.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.850+0000 7f45502cd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4548134860 0x7f4548119520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:01.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.850+0000 7f45502cd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4548137180 0x7f4548119a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:01.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.850+0000 7f45502cd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454811b170 con 0x7f4548137180 2023-09-30T22:19:01.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.850+0000 7f45502cd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454811b720 con 0x7f4548134860 2023-09-30T22:19:01.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.850+0000 7f45502cd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f454811b460 con 0x7f4548131a40 2023-09-30T22:19:01.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.850+0000 7f454e069700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4548131a40 0x7f4548118fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:01.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.850+0000 7f454e86a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4548137180 0x7f4548119a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:01.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.850+0000 7f454e069700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4548131a40 0x7f4548118fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45196/0 (socket says 172.21.15.156:45196) 2023-09-30T22:19:01.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.850+0000 7f454e069700 1 -- 172.21.15.156:0/1437887792 learned_addr learned my addr 172.21.15.156:0/1437887792 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:01.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.850+0000 7f454e86a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4548137180 0x7f4548119a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58662/0 (socket says 172.21.15.156:58662) 2023-09-30T22:19:01.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.850+0000 7f454d868700 1 --2- 172.21.15.156:0/1437887792 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4548134860 0x7f4548119520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:01.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.851+0000 7f454d868700 1 -- 172.21.15.156:0/1437887792 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4548131a40 msgr2=0x7f4548118fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:01.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.851+0000 7f454d868700 1 --2- 172.21.15.156:0/1437887792 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4548131a40 0x7f4548118fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:01.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.851+0000 7f454d868700 1 -- 172.21.15.156:0/1437887792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4548137180 msgr2=0x7f4548119a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:01.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.851+0000 7f454d868700 1 --2- 172.21.15.156:0/1437887792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4548137180 0x7f4548119a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:01.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.851+0000 7f454d868700 1 -- 172.21.15.156:0/1437887792 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4540009a70 con 0x7f4548134860 2023-09-30T22:19:01.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.851+0000 7f454e86a700 1 --2- 172.21.15.156:0/1437887792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4548137180 0x7f4548119a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:01.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.851+0000 7f454e069700 1 --2- 172.21.15.156:0/1437887792 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4548131a40 0x7f4548118fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:01.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.851+0000 7f454d868700 1 --2- 172.21.15.156:0/1437887792 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4548134860 0x7f4548119520 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4538016000 tx=0x7f4538004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:01.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.851+0000 7f453effd700 1 -- 172.21.15.156:0/1437887792 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4538004510 con 0x7f4548134860 2023-09-30T22:19:01.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.851+0000 7f453effd700 1 -- 172.21.15.156:0/1437887792 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45380036a0 con 0x7f4548134860 2023-09-30T22:19:01.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.851+0000 7f45502cd700 1 -- 172.21.15.156:0/1437887792 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4538009550 con 0x7f4548134860 2023-09-30T22:19:01.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.851+0000 7f453effd700 1 -- 172.21.15.156:0/1437887792 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4538003a30 con 0x7f4548134860 2023-09-30T22:19:01.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.851+0000 7f45502cd700 1 -- 172.21.15.156:0/1437887792 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45480a1b40 con 0x7f4548134860 2023-09-30T22:19:01.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.852+0000 7f453effd700 1 -- 172.21.15.156:0/1437887792 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4538021070 con 0x7f4548134860 2023-09-30T22:19:01.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.852+0000 7f453effd700 1 -- 172.21.15.156:0/1437887792 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f4538040e80 con 0x7f4548134860 2023-09-30T22:19:01.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.852+0000 7f45502cd700 1 -- 172.21.15.156:0/1437887792 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f454812ddd0 con 0x7f4548134860 2023-09-30T22:19:01.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:01.856+0000 7f453effd700 1 -- 172.21.15.156:0/1437887792 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4538015080 con 0x7f4548134860 2023-09-30T22:19:02.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.041+0000 7f45502cd700 1 -- 172.21.15.156:0/1437887792 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd pool ls"} v 0) v1 -- 0x7f4548068580 con 0x7f4548134860 2023-09-30T22:19:02.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.041+0000 7f453effd700 1 -- 172.21.15.156:0/1437887792 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v33) v1 ==== 59+0+37 (secure 0 0 0) 0x7f4538029020 con 0x7f4548134860 2023-09-30T22:19:02.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.043+0000 7f45502cd700 1 -- 172.21.15.156:0/1437887792 >> v1:172.21.15.156:6816/126965 conn(0x7f452c02f510 legacy=0x7f452c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:02.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.043+0000 7f45502cd700 1 -- 172.21.15.156:0/1437887792 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4548134860 msgr2=0x7f4548119520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:02.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.043+0000 7f45502cd700 1 --2- 172.21.15.156:0/1437887792 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4548134860 0x7f4548119520 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4538016000 tx=0x7f4538004750 comp rx=0 tx=0).stop 2023-09-30T22:19:02.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.043+0000 7f45502cd700 1 -- 172.21.15.156:0/1437887792 shutdown_connections 2023-09-30T22:19:02.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.043+0000 7f45502cd700 1 --2- 172.21.15.156:0/1437887792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4548137180 0x7f4548119a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:02.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.043+0000 7f45502cd700 1 --2- 172.21.15.156:0/1437887792 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4548131a40 0x7f4548118fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:02.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.043+0000 7f45502cd700 1 --2- 172.21.15.156:0/1437887792 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4548134860 0x7f4548119520 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:02.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.043+0000 7f45502cd700 1 -- 172.21.15.156:0/1437887792 >> 172.21.15.156:0/1437887792 conn(0x7f45480a2b70 msgr2=0x7f454812e340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:02.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.043+0000 7f45502cd700 1 -- 172.21.15.156:0/1437887792 shutdown_connections 2023-09-30T22:19:02.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.043+0000 7f45502cd700 1 -- 172.21.15.156:0/1437887792 wait complete. 2023-09-30T22:19:02.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.150+0000 7fd2c2583700 1 Processor -- start 2023-09-30T22:19:02.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.150+0000 7fd2c2583700 1 -- start start 2023-09-30T22:19:02.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.150+0000 7fd2c2583700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2bc06ae80 0x7fd2bc139360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:02.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.150+0000 7fd2c2583700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd2bc06b2d0 0x7fd2bc13b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:02.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.150+0000 7fd2c2583700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2bc09d4e0 con 0x7fd2bc09eba0 2023-09-30T22:19:02.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.150+0000 7fd2c2583700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2bc09ef70 con 0x7fd2bc06b2d0 2023-09-30T22:19:02.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.150+0000 7fd2c2583700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc06e480 con 0x7fd2bc06ae80 2023-09-30T22:19:02.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.151+0000 7fd2c0b20700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd2bc06b2d0 0x7fd2bc13b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:02.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.151+0000 7fd2bb7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2bc06ae80 0x7fd2bc139360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:02.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.151+0000 7fd2bbfff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fd2bc09eba0 0x7fd2bc06a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:33864/0 (socket says 172.21.15.156:33864) 2023-09-30T22:19:02.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.151+0000 7fd2c0b20700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd2bc06b2d0 0x7fd2bc13b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58674/0 (socket says 172.21.15.156:58674) 2023-09-30T22:19:02.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.151+0000 7fd2bb7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2bc06ae80 0x7fd2bc139360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45206/0 (socket says 172.21.15.156:45206) 2023-09-30T22:19:02.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.151+0000 7fd2bbfff700 1 -- 172.21.15.156:0/2559876657 learned_addr learned my addr 172.21.15.156:0/2559876657 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:02.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.151+0000 7fd2c0b20700 1 -- 172.21.15.156:0/2559876657 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2bc06ae80 msgr2=0x7fd2bc139360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:02.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.151+0000 7fd2c0b20700 1 --2- 172.21.15.156:0/2559876657 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2bc06ae80 0x7fd2bc139360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:02.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.151+0000 7fd2c0b20700 1 -- 172.21.15.156:0/2559876657 >> v1:172.21.15.156:6789/0 conn(0x7fd2bc09eba0 legacy=0x7fd2bc06a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:02.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.151+0000 7fd2baffd700 1 -- 172.21.15.156:0/2559876657 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2804274745 0 0) 0x7fd2bc09d4e0 con 0x7fd2bc09eba0 2023-09-30T22:19:02.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.151+0000 7fd2c0b20700 1 -- 172.21.15.156:0/2559876657 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc09ad10 con 0x7fd2bc06b2d0 2023-09-30T22:19:02.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.151+0000 7fd2c0b20700 1 --2- 172.21.15.156:0/2559876657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2bc06b2d0 0x7fd2bc13b8b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4009d90 tx=0x7fd2b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dee7f3ad20caa78 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:02.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.151+0000 7fd2baffd700 1 -- 172.21.15.156:0/2559876657 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b400e070 con 0x7fd2bc06b2d0 2023-09-30T22:19:02.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.151+0000 7fd2baffd700 1 -- 172.21.15.156:0/2559876657 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b400bb20 con 0x7fd2bc06b2d0 2023-09-30T22:19:02.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.151+0000 7fd2baffd700 1 -- 172.21.15.156:0/2559876657 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b4012430 con 0x7fd2bc06b2d0 2023-09-30T22:19:02.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.152+0000 7fd2c2583700 1 -- 172.21.15.156:0/2559876657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2bc06b2d0 msgr2=0x7fd2bc13b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:02.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.152+0000 7fd2c2583700 1 --2- 172.21.15.156:0/2559876657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2bc06b2d0 0x7fd2bc13b8b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4009d90 tx=0x7fd2b400b330 comp rx=0 tx=0).stop 2023-09-30T22:19:02.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.152+0000 7fd2c2583700 1 -- 172.21.15.156:0/2559876657 shutdown_connections 2023-09-30T22:19:02.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.152+0000 7fd2c2583700 1 --2- 172.21.15.156:0/2559876657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2bc06b2d0 0x7fd2bc13b8b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:02.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.152+0000 7fd2c2583700 1 --2- 172.21.15.156:0/2559876657 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2bc06ae80 0x7fd2bc139360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:02.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.152+0000 7fd2c2583700 1 -- 172.21.15.156:0/2559876657 >> 172.21.15.156:0/2559876657 conn(0x7fd2bc09fc90 msgr2=0x7fd2bc0a0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:02.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.152+0000 7fd2c2583700 1 -- 172.21.15.156:0/2559876657 shutdown_connections 2023-09-30T22:19:02.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.152+0000 7fd2c2583700 1 -- 172.21.15.156:0/2559876657 wait complete. 2023-09-30T22:19:02.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.153+0000 7fd2c2583700 1 Processor -- start 2023-09-30T22:19:02.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.153+0000 7fd2c2583700 1 -- start start 2023-09-30T22:19:02.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.153+0000 7fd2c2583700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2bc06ae80 0x7fd2bc0914c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:02.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.153+0000 7fd2c2583700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2bc06b2d0 0x7fd2bc091a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:02.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.153+0000 7fd2c2583700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2bc09eba0 0x7fd2bc091f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:02.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.153+0000 7fd2c2583700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc095f40 con 0x7fd2bc06b2d0 2023-09-30T22:19:02.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.153+0000 7fd2c2583700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc0a2230 con 0x7fd2bc09eba0 2023-09-30T22:19:02.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.153+0000 7fd2c2583700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc094cb0 con 0x7fd2bc06ae80 2023-09-30T22:19:02.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.153+0000 7fd2bbfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2bc06ae80 0x7fd2bc0914c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:02.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.153+0000 7fd2bbfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2bc06ae80 0x7fd2bc0914c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45214/0 (socket says 172.21.15.156:45214) 2023-09-30T22:19:02.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.153+0000 7fd2bbfff700 1 -- 172.21.15.156:0/2451381102 learned_addr learned my addr 172.21.15.156:0/2451381102 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:02.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.153+0000 7fd2bb7fe700 1 --2- 172.21.15.156:0/2451381102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2bc06b2d0 0x7fd2bc091a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:02.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.153+0000 7fd2c0b20700 1 --2- 172.21.15.156:0/2451381102 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2bc09eba0 0x7fd2bc091f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:02.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.154+0000 7fd2bbfff700 1 -- 172.21.15.156:0/2451381102 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2bc09eba0 msgr2=0x7fd2bc091f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:02.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.154+0000 7fd2bbfff700 1 --2- 172.21.15.156:0/2451381102 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2bc09eba0 0x7fd2bc091f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:02.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.154+0000 7fd2bbfff700 1 -- 172.21.15.156:0/2451381102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2bc06b2d0 msgr2=0x7fd2bc091a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:02.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.154+0000 7fd2bbfff700 1 --2- 172.21.15.156:0/2451381102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2bc06b2d0 0x7fd2bc091a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:02.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.154+0000 7fd2bbfff700 1 -- 172.21.15.156:0/2451381102 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b4009a70 con 0x7fd2bc06ae80 2023-09-30T22:19:02.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.154+0000 7fd2bb7fe700 1 --2- 172.21.15.156:0/2451381102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2bc06b2d0 0x7fd2bc091a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:02.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.154+0000 7fd2bbfff700 1 --2- 172.21.15.156:0/2451381102 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2bc06ae80 0x7fd2bc0914c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000c520 tx=0x7fd2b000c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:02.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.154+0000 7fd2b8ff9700 1 -- 172.21.15.156:0/2451381102 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0004c80 con 0x7fd2bc06ae80 2023-09-30T22:19:02.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.154+0000 7fd2b8ff9700 1 -- 172.21.15.156:0/2451381102 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b0004e00 con 0x7fd2bc06ae80 2023-09-30T22:19:02.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.154+0000 7fd2b8ff9700 1 -- 172.21.15.156:0/2451381102 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0007310 con 0x7fd2bc06ae80 2023-09-30T22:19:02.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.154+0000 7fd2c2583700 1 -- 172.21.15.156:0/2451381102 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2bc095b70 con 0x7fd2bc06ae80 2023-09-30T22:19:02.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.154+0000 7fd2c2583700 1 -- 172.21.15.156:0/2451381102 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2bc0935e0 con 0x7fd2bc06ae80 2023-09-30T22:19:02.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.155+0000 7fd2b8ff9700 1 -- 172.21.15.156:0/2451381102 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd2b0007470 con 0x7fd2bc06ae80 2023-09-30T22:19:02.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.155+0000 7fd2b8ff9700 1 -- 172.21.15.156:0/2451381102 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fd2b003f770 con 0x7fd2bc06ae80 2023-09-30T22:19:02.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.155+0000 7fd2c2583700 1 -- 172.21.15.156:0/2451381102 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2bc09b160 con 0x7fd2bc06ae80 2023-09-30T22:19:02.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.160+0000 7fd2b8ff9700 1 -- 172.21.15.156:0/2451381102 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd2b00123b0 con 0x7fd2bc06ae80 2023-09-30T22:19:02.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.343+0000 7fd2c2583700 1 -- 172.21.15.156:0/2451381102 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fd2bc068580 con 0x7fd2bc06ae80 2023-09-30T22:19:02.696 INFO:tasks.ceph.mgr.x.smithi156.stderr:terminate called recursively 2023-09-30T22:19:02.696 INFO:tasks.ceph.mgr.x.smithi156.stderr:*** Caught signal (Aborted) ** 2023-09-30T22:19:02.696 INFO:tasks.ceph.mgr.x.smithi156.stderr: in thread 7f823cf96700 thread_name:ms_dispatch 2023-09-30T22:19:02.696 INFO:tasks.ceph.mgr.x.smithi156.stderr:terminate called after throwing an instance of 'ceph::buffer::v15_2_0::end_of_buffer' 2023-09-30T22:19:02.696 INFO:tasks.ceph.mgr.x.smithi156.stderr: what(): End of buffer [buffer:2] 2023-09-30T22:19:02.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.851+0000 7fd2b8ff9700 1 -- 172.21.15.156:0/2451381102 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 1 pg_autoscale_mode to off v34) v1 ==== 153+0+0 (secure 0 0 0) 0x7fd2b00102c0 con 0x7fd2bc06ae80 2023-09-30T22:19:02.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.853+0000 7fd2c2583700 1 -- 172.21.15.156:0/2451381102 >> v1:172.21.15.156:6816/126965 conn(0x7fd2a802f510 legacy=0x7fd2a80319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:02.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.853+0000 7fd2c2583700 1 -- 172.21.15.156:0/2451381102 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2bc06ae80 msgr2=0x7fd2bc0914c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:02.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.853+0000 7fd2c2583700 1 --2- 172.21.15.156:0/2451381102 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2bc06ae80 0x7fd2bc0914c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000c520 tx=0x7fd2b000c830 comp rx=0 tx=0).stop 2023-09-30T22:19:02.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.853+0000 7fd2c2583700 1 -- 172.21.15.156:0/2451381102 shutdown_connections 2023-09-30T22:19:02.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.853+0000 7fd2c2583700 1 --2- 172.21.15.156:0/2451381102 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2bc09eba0 0x7fd2bc091f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:02.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.853+0000 7fd2c2583700 1 --2- 172.21.15.156:0/2451381102 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2bc06ae80 0x7fd2bc0914c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:02.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.853+0000 7fd2c2583700 1 --2- 172.21.15.156:0/2451381102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2bc06b2d0 0x7fd2bc091a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:02.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.853+0000 7fd2c2583700 1 -- 172.21.15.156:0/2451381102 >> 172.21.15.156:0/2451381102 conn(0x7fd2bc09fc90 msgr2=0x7fd2bc099bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:02.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.854+0000 7fd2c2583700 1 -- 172.21.15.156:0/2451381102 shutdown_connections 2023-09-30T22:19:02.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.854+0000 7fd2c2583700 1 -- 172.21.15.156:0/2451381102 wait complete. 2023-09-30T22:19:02.855 INFO:teuthology.orchestra.run.smithi156.stderr:set pool 1 pg_autoscale_mode to off 2023-09-30T22:19:02.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.969+0000 7fa725816700 1 Processor -- start 2023-09-30T22:19:02.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.969+0000 7fa725816700 1 -- start start 2023-09-30T22:19:02.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.969+0000 7fa725816700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa720131b60 0x7fa720131f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:02.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.969+0000 7fa725816700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa72006fce0 0x7fa7200700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:02.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.969+0000 7fa725816700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7200719b0 con 0x7fa720070630 2023-09-30T22:19:02.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.969+0000 7fa725816700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7201316c0 con 0x7fa720131b60 2023-09-30T22:19:02.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.969+0000 7fa725816700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa720071430 con 0x7fa72006fce0 2023-09-30T22:19:02.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.969+0000 7fa71effd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa720131b60 0x7fa720131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:02.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.969+0000 7fa71e7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa72006fce0 0x7fa7200700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:02.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.970+0000 7fa71f7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fa720070630 0x7fa7201389f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:33868/0 (socket says 172.21.15.156:33868) 2023-09-30T22:19:02.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.970+0000 7fa71effd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa720131b60 0x7fa720131f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48304/0 (socket says 172.21.15.156:48304) 2023-09-30T22:19:02.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.970+0000 7fa71f7fe700 1 -- 172.21.15.156:0/2584575721 learned_addr learned my addr 172.21.15.156:0/2584575721 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:02.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.970+0000 7fa71dffb700 1 -- 172.21.15.156:0/2584575721 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2377315557 0 0) 0x7fa7200719b0 con 0x7fa720070630 2023-09-30T22:19:02.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.970+0000 7fa71effd700 1 -- 172.21.15.156:0/2584575721 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa72006fce0 msgr2=0x7fa7200700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:02.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.970+0000 7fa71effd700 1 --2- 172.21.15.156:0/2584575721 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa72006fce0 0x7fa7200700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:02.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.970+0000 7fa71effd700 1 -- 172.21.15.156:0/2584575721 >> v1:172.21.15.156:6789/0 conn(0x7fa720070630 legacy=0x7fa7201389f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:02.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.970+0000 7fa71effd700 1 -- 172.21.15.156:0/2584575721 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7200a0550 con 0x7fa720131b60 2023-09-30T22:19:02.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.970+0000 7fa71e7fc700 1 --2- 172.21.15.156:0/2584575721 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa72006fce0 0x7fa7200700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:02.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.970+0000 7fa71effd700 1 --2- 172.21.15.156:0/2584575721 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa720131b60 0x7fa720131f30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa71800f3a0 tx=0x7fa71800f6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5821a1ee2f973b71 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:02.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.970+0000 7fa71dffb700 1 -- 172.21.15.156:0/2584575721 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa718012070 con 0x7fa720131b60 2023-09-30T22:19:02.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.970+0000 7fa71dffb700 1 -- 172.21.15.156:0/2584575721 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71800d0d0 con 0x7fa720131b60 2023-09-30T22:19:02.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.970+0000 7fa71dffb700 1 -- 172.21.15.156:0/2584575721 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71800fea0 con 0x7fa720131b60 2023-09-30T22:19:02.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.971+0000 7fa725816700 1 -- 172.21.15.156:0/2584575721 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa720131b60 msgr2=0x7fa720131f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:02.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.971+0000 7fa725816700 1 --2- 172.21.15.156:0/2584575721 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa720131b60 0x7fa720131f30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa71800f3a0 tx=0x7fa71800f6b0 comp rx=0 tx=0).stop 2023-09-30T22:19:02.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.971+0000 7fa725816700 1 -- 172.21.15.156:0/2584575721 shutdown_connections 2023-09-30T22:19:02.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.971+0000 7fa725816700 1 --2- 172.21.15.156:0/2584575721 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa720131b60 0x7fa720131f30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:02.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.971+0000 7fa725816700 1 --2- 172.21.15.156:0/2584575721 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa72006fce0 0x7fa7200700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:02.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.971+0000 7fa725816700 1 -- 172.21.15.156:0/2584575721 >> 172.21.15.156:0/2584575721 conn(0x7fa7200a4230 msgr2=0x7fa7200a4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:02.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.971+0000 7fa725816700 1 -- 172.21.15.156:0/2584575721 shutdown_connections 2023-09-30T22:19:02.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.971+0000 7fa725816700 1 -- 172.21.15.156:0/2584575721 wait complete. 2023-09-30T22:19:02.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.971+0000 7fa725816700 1 Processor -- start 2023-09-30T22:19:02.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.972+0000 7fa725816700 1 -- start start 2023-09-30T22:19:02.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.972+0000 7fa725816700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa72006fce0 0x7fa72012dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:02.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.972+0000 7fa725816700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa720070630 0x7fa72012e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:02.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.972+0000 7fa725816700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa720131b60 0x7fa72012ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:02.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.972+0000 7fa725816700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72008b1b0 con 0x7fa720131b60 2023-09-30T22:19:02.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.972+0000 7fa725816700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa72009af00 con 0x7fa720070630 2023-09-30T22:19:02.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.972+0000 7fa725816700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7200729e0 con 0x7fa72006fce0 2023-09-30T22:19:02.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.972+0000 7fa71effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa72006fce0 0x7fa72012dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:02.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.972+0000 7fa71e7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa720070630 0x7fa72012e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:02.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.972+0000 7fa71f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa720131b60 0x7fa72012ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:02.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.972+0000 7fa71effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa72006fce0 0x7fa72012dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45228/0 (socket says 172.21.15.156:45228) 2023-09-30T22:19:02.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.972+0000 7fa71e7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa720070630 0x7fa72012e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48318/0 (socket says 172.21.15.156:48318) 2023-09-30T22:19:02.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.972+0000 7fa71effd700 1 -- 172.21.15.156:0/4015866099 learned_addr learned my addr 172.21.15.156:0/4015866099 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:02.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.972+0000 7fa71e7fc700 1 -- 172.21.15.156:0/4015866099 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa72006fce0 msgr2=0x7fa72012dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:02.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.972+0000 7fa71e7fc700 1 --2- 172.21.15.156:0/4015866099 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa72006fce0 0x7fa72012dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:02.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.972+0000 7fa71e7fc700 1 -- 172.21.15.156:0/4015866099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa720131b60 msgr2=0x7fa72012ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:02.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.973+0000 7fa71e7fc700 1 --2- 172.21.15.156:0/4015866099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa720131b60 0x7fa72012ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:02.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.973+0000 7fa71e7fc700 1 -- 172.21.15.156:0/4015866099 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7080094a0 con 0x7fa720070630 2023-09-30T22:19:02.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.973+0000 7fa71e7fc700 1 --2- 172.21.15.156:0/4015866099 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa720070630 0x7fa72012e4e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa70800e980 tx=0x7fa70800ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:02.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.973+0000 7fa717fff700 1 -- 172.21.15.156:0/4015866099 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70800c690 con 0x7fa720070630 2023-09-30T22:19:02.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.973+0000 7fa717fff700 1 -- 172.21.15.156:0/4015866099 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70800c7f0 con 0x7fa720070630 2023-09-30T22:19:02.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.973+0000 7fa725816700 1 -- 172.21.15.156:0/4015866099 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa71800f050 con 0x7fa720070630 2023-09-30T22:19:02.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.973+0000 7fa717fff700 1 -- 172.21.15.156:0/4015866099 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70800cb80 con 0x7fa720070630 2023-09-30T22:19:02.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.973+0000 7fa725816700 1 -- 172.21.15.156:0/4015866099 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa72006aa90 con 0x7fa720070630 2023-09-30T22:19:02.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.974+0000 7fa717fff700 1 -- 172.21.15.156:0/4015866099 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa70800cce0 con 0x7fa720070630 2023-09-30T22:19:02.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.974+0000 7fa71effd700 1 -- 172.21.15.156:0/4015866099 >> v1:172.21.15.156:6816/126965 conn(0x7fa70002f510 legacy=0x7fa7000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:02.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.974+0000 7fa717fff700 1 -- 172.21.15.156:0/4015866099 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fa70803fbc0 con 0x7fa720070630 2023-09-30T22:19:02.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.974+0000 7fa725816700 1 -- 172.21.15.156:0/4015866099 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa72012aaf0 con 0x7fa720070630 2023-09-30T22:19:02.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:02.979+0000 7fa717fff700 1 -- 172.21.15.156:0/4015866099 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa708017080 con 0x7fa720070630 2023-09-30T22:19:03.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.164+0000 7fa725816700 1 -- 172.21.15.156:0/4015866099 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fa720130ac0 con 0x7fa720070630 2023-09-30T22:19:03.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.175+0000 7fa71effd700 1 -- 172.21.15.156:0/4015866099 >> v1:172.21.15.156:6816/126965 conn(0x7fa70002f510 legacy=0x7fa7000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:03.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.576+0000 7fa71effd700 1 -- 172.21.15.156:0/4015866099 >> v1:172.21.15.156:6816/126965 conn(0x7fa70002f510 legacy=0x7fa7000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:03.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.855+0000 7fa717fff700 1 -- 172.21.15.156:0/4015866099 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 2 pg_autoscale_mode to off v35) v1 ==== 152+0+0 (secure 0 0 0) 0x7fa708021030 con 0x7fa720070630 2023-09-30T22:19:03.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.860+0000 7fa725816700 1 -- 172.21.15.156:0/4015866099 >> v1:172.21.15.156:6816/126965 conn(0x7fa70002f510 legacy=0x7fa7000319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:03.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.860+0000 7fa725816700 1 -- 172.21.15.156:0/4015866099 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa720070630 msgr2=0x7fa72012e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:03.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.860+0000 7fa725816700 1 --2- 172.21.15.156:0/4015866099 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa720070630 0x7fa72012e4e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa70800e980 tx=0x7fa70800ec90 comp rx=0 tx=0).stop 2023-09-30T22:19:03.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.860+0000 7fa725816700 1 -- 172.21.15.156:0/4015866099 shutdown_connections 2023-09-30T22:19:03.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.860+0000 7fa725816700 1 --2- 172.21.15.156:0/4015866099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa720131b60 0x7fa72012ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:03.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.860+0000 7fa725816700 1 --2- 172.21.15.156:0/4015866099 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa72006fce0 0x7fa72012dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:03.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.860+0000 7fa725816700 1 --2- 172.21.15.156:0/4015866099 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa720070630 0x7fa72012e4e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:03.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.860+0000 7fa725816700 1 -- 172.21.15.156:0/4015866099 >> 172.21.15.156:0/4015866099 conn(0x7fa7200a4230 msgr2=0x7fa72009dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:03.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.860+0000 7fa725816700 1 -- 172.21.15.156:0/4015866099 shutdown_connections 2023-09-30T22:19:03.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.861+0000 7fa725816700 1 -- 172.21.15.156:0/4015866099 wait complete. 2023-09-30T22:19:03.862 INFO:teuthology.orchestra.run.smithi156.stderr:set pool 2 pg_autoscale_mode to off 2023-09-30T22:19:03.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.976+0000 7f044e7ec700 1 Processor -- start 2023-09-30T22:19:03.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.976+0000 7f044e7ec700 1 -- start start 2023-09-30T22:19:03.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.976+0000 7f044e7ec700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f044809eba0 0x7f044806a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:03.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.976+0000 7f044e7ec700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f044806acb0 0x7f044806b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:03.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.976+0000 7f044e7ec700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0448138350 0x7f044813a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:03.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.976+0000 7f044e7ec700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f044809ef70 con 0x7f044809eba0 2023-09-30T22:19:03.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.976+0000 7f044e7ec700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044806b640 con 0x7f0448138350 2023-09-30T22:19:03.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.976+0000 7f044e7ec700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f044806e480 con 0x7f044806acb0 2023-09-30T22:19:03.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.976+0000 7f044cd89700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0448138350 0x7f044813a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:03.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.976+0000 7f04477fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f044806acb0 0x7f044806b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:03.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.976+0000 7f0447fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f044809eba0 0x7f044806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:03.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.976+0000 7f044cd89700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0448138350 0x7f044813a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48334/0 (socket says 172.21.15.156:48334) 2023-09-30T22:19:03.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.976+0000 7f044cd89700 1 -- 172.21.15.156:0/1607326945 learned_addr learned my addr 172.21.15.156:0/1607326945 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:03.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.976+0000 7f0447fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f044809eba0 0x7f044806a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58704/0 (socket says 172.21.15.156:58704) 2023-09-30T22:19:03.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.976+0000 7f04477fe700 1 -- 172.21.15.156:0/1607326945 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0448138350 msgr2=0x7f044813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:03.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.976+0000 7f04477fe700 1 --2- 172.21.15.156:0/1607326945 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0448138350 0x7f044813a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:03.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.977+0000 7f04477fe700 1 -- 172.21.15.156:0/1607326945 >> v2:172.21.15.156:3300/0 conn(0x7f044809eba0 msgr2=0x7f044806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:03.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.977+0000 7f04477fe700 1 --2- 172.21.15.156:0/1607326945 >> v2:172.21.15.156:3300/0 conn(0x7f044809eba0 0x7f044806a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:03.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.977+0000 7f04477fe700 1 -- 172.21.15.156:0/1607326945 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044809d4e0 con 0x7f044806acb0 2023-09-30T22:19:03.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.977+0000 7f044cd89700 1 --2- 172.21.15.156:0/1607326945 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0448138350 0x7f044813a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:03.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.977+0000 7f0447fff700 1 --2- 172.21.15.156:0/1607326945 >> v2:172.21.15.156:3300/0 conn(0x7f044809eba0 0x7f044806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:03.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.977+0000 7f04477fe700 1 --2- 172.21.15.156:0/1607326945 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f044806acb0 0x7f044806b100 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0438009840 tx=0x7f0438009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68528d606639833 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:03.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.977+0000 7f0446ffd700 1 -- 172.21.15.156:0/1607326945 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0438011830 con 0x7f044806acb0 2023-09-30T22:19:03.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.977+0000 7f0446ffd700 1 -- 172.21.15.156:0/1607326945 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0438011990 con 0x7f044806acb0 2023-09-30T22:19:03.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.977+0000 7f0446ffd700 1 -- 172.21.15.156:0/1607326945 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0438011d20 con 0x7f044806acb0 2023-09-30T22:19:03.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.977+0000 7f044e7ec700 1 -- 172.21.15.156:0/1607326945 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f044806acb0 msgr2=0x7f044806b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:03.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.977+0000 7f044e7ec700 1 --2- 172.21.15.156:0/1607326945 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f044806acb0 0x7f044806b100 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0438009840 tx=0x7f0438009b50 comp rx=0 tx=0).stop 2023-09-30T22:19:03.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.977+0000 7f044e7ec700 1 -- 172.21.15.156:0/1607326945 shutdown_connections 2023-09-30T22:19:03.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.977+0000 7f044e7ec700 1 --2- 172.21.15.156:0/1607326945 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0448138350 0x7f044813a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:03.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.977+0000 7f044e7ec700 1 --2- 172.21.15.156:0/1607326945 >> v2:172.21.15.156:3300/0 conn(0x7f044809eba0 0x7f044806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:03.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.977+0000 7f044e7ec700 1 --2- 172.21.15.156:0/1607326945 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f044806acb0 0x7f044806b100 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:03.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.977+0000 7f044e7ec700 1 -- 172.21.15.156:0/1607326945 >> 172.21.15.156:0/1607326945 conn(0x7f044809fc90 msgr2=0x7f04480a0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:03.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.977+0000 7f044e7ec700 1 -- 172.21.15.156:0/1607326945 shutdown_connections 2023-09-30T22:19:03.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.977+0000 7f044e7ec700 1 -- 172.21.15.156:0/1607326945 wait complete. 2023-09-30T22:19:03.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.978+0000 7f044e7ec700 1 Processor -- start 2023-09-30T22:19:03.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.979+0000 7f044e7ec700 1 -- start start 2023-09-30T22:19:03.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.979+0000 7f044e7ec700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f044806acb0 0x7f04480952c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:03.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.979+0000 7f044e7ec700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f044809eba0 0x7f0448095800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:03.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.979+0000 7f044e7ec700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0448138350 0x7f04481c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:03.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.979+0000 7f044e7ec700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0448091bf0 con 0x7f044806acb0 2023-09-30T22:19:03.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.979+0000 7f044e7ec700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0448093200 con 0x7f044809eba0 2023-09-30T22:19:03.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.979+0000 7f044e7ec700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f044809a8c0 con 0x7f0448138350 2023-09-30T22:19:03.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.979+0000 7f0447fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f044806acb0 0x7f04480952c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:03.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.979+0000 7f044cd89700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0448138350 0x7f04481c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:03.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.979+0000 7f04477fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f044809eba0 0x7f0448095800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:03.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.979+0000 7f044cd89700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0448138350 0x7f04481c87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45236/0 (socket says 172.21.15.156:45236) 2023-09-30T22:19:03.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.979+0000 7f0447fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f044806acb0 0x7f04480952c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58716/0 (socket says 172.21.15.156:58716) 2023-09-30T22:19:03.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.979+0000 7f044cd89700 1 -- 172.21.15.156:0/3373716020 learned_addr learned my addr 172.21.15.156:0/3373716020 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:03.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.979+0000 7f0447fff700 1 -- 172.21.15.156:0/3373716020 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0448138350 msgr2=0x7f04481c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:03.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.979+0000 7f0447fff700 1 --2- 172.21.15.156:0/3373716020 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0448138350 0x7f04481c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:03.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.979+0000 7f0447fff700 1 -- 172.21.15.156:0/3373716020 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f044809eba0 msgr2=0x7f0448095800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:03.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.979+0000 7f0447fff700 1 --2- 172.21.15.156:0/3373716020 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f044809eba0 0x7f0448095800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:03.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.979+0000 7f0447fff700 1 -- 172.21.15.156:0/3373716020 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c0094a0 con 0x7f044806acb0 2023-09-30T22:19:03.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.980+0000 7f04477fe700 1 --2- 172.21.15.156:0/3373716020 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f044809eba0 0x7f0448095800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:03.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.980+0000 7f044cd89700 1 --2- 172.21.15.156:0/3373716020 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0448138350 0x7f04481c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:03.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.980+0000 7f0447fff700 1 --2- 172.21.15.156:0/3373716020 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f044806acb0 0x7f04480952c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f043c00e9b0 tx=0x7f043c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:03.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.980+0000 7f0444ff9700 1 -- 172.21.15.156:0/3373716020 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c00ee50 con 0x7f044806acb0 2023-09-30T22:19:03.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.980+0000 7f0444ff9700 1 -- 172.21.15.156:0/3373716020 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043c00c850 con 0x7f044806acb0 2023-09-30T22:19:03.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.980+0000 7f0444ff9700 1 -- 172.21.15.156:0/3373716020 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c00cc00 con 0x7f044806acb0 2023-09-30T22:19:03.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.980+0000 7f044e7ec700 1 -- 172.21.15.156:0/3373716020 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0440009b30 con 0x7f044806acb0 2023-09-30T22:19:03.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.980+0000 7f044e7ec700 1 -- 172.21.15.156:0/3373716020 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04380094a0 con 0x7f044806acb0 2023-09-30T22:19:03.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.981+0000 7f0444ff9700 1 -- 172.21.15.156:0/3373716020 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f043c013470 con 0x7f044806acb0 2023-09-30T22:19:03.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.981+0000 7f0444ff9700 1 -- 172.21.15.156:0/3373716020 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f043c03ffc0 con 0x7f044806acb0 2023-09-30T22:19:03.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.981+0000 7f04477fe700 1 -- 172.21.15.156:0/3373716020 >> v1:172.21.15.156:6816/126965 conn(0x7f043402f510 legacy=0x7f04340319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:03.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.981+0000 7f044e7ec700 1 -- 172.21.15.156:0/3373716020 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f044809ad10 con 0x7f044806acb0 2023-09-30T22:19:03.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:03.986+0000 7f0444ff9700 1 -- 172.21.15.156:0/3373716020 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f043c017080 con 0x7f044806acb0 2023-09-30T22:19:04.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.168+0000 7f044e7ec700 1 -- 172.21.15.156:0/3373716020 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f044809f0b0 con 0x7f044806acb0 2023-09-30T22:19:04.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.182+0000 7f04477fe700 1 -- 172.21.15.156:0/3373716020 >> v1:172.21.15.156:6816/126965 conn(0x7f043402f510 legacy=0x7f04340319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:04.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.583+0000 7f04477fe700 1 -- 172.21.15.156:0/3373716020 >> v1:172.21.15.156:6816/126965 conn(0x7f043402f510 legacy=0x7f04340319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:04.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.859+0000 7f0444ff9700 1 -- 172.21.15.156:0/3373716020 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 3 pg_autoscale_mode to off v36) v1 ==== 164+0+0 (secure 0 0 0) 0x7f043c013720 con 0x7f044806acb0 2023-09-30T22:19:04.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.864+0000 7f044e7ec700 1 -- 172.21.15.156:0/3373716020 >> v1:172.21.15.156:6816/126965 conn(0x7f043402f510 legacy=0x7f04340319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:04.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.864+0000 7f044e7ec700 1 -- 172.21.15.156:0/3373716020 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f044806acb0 msgr2=0x7f04480952c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:04.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.864+0000 7f044e7ec700 1 --2- 172.21.15.156:0/3373716020 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f044806acb0 0x7f04480952c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f043c00e9b0 tx=0x7f043c00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:19:04.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.864+0000 7f044e7ec700 1 -- 172.21.15.156:0/3373716020 shutdown_connections 2023-09-30T22:19:04.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.864+0000 7f044e7ec700 1 --2- 172.21.15.156:0/3373716020 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0448138350 0x7f04481c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:04.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.864+0000 7f044e7ec700 1 --2- 172.21.15.156:0/3373716020 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f044806acb0 0x7f04480952c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:04.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.864+0000 7f044e7ec700 1 --2- 172.21.15.156:0/3373716020 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f044809eba0 0x7f0448095800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:04.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.864+0000 7f044e7ec700 1 -- 172.21.15.156:0/3373716020 >> 172.21.15.156:0/3373716020 conn(0x7f044809fc90 msgr2=0x7f0448137570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:04.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.864+0000 7f044e7ec700 1 -- 172.21.15.156:0/3373716020 shutdown_connections 2023-09-30T22:19:04.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.864+0000 7f044e7ec700 1 -- 172.21.15.156:0/3373716020 wait complete. 2023-09-30T22:19:04.866 INFO:teuthology.orchestra.run.smithi156.stderr:set pool 3 pg_autoscale_mode to off 2023-09-30T22:19:04.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.975+0000 7fb4cffc5700 1 Processor -- start 2023-09-30T22:19:04.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.975+0000 7fb4cffc5700 1 -- start start 2023-09-30T22:19:04.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.976+0000 7fb4cffc5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb4c8131b60 0x7fb4c8131f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:04.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.976+0000 7fb4cffc5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4c806fce0 0x7fb4c80700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:04.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.976+0000 7fb4cffc5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4c8070630 0x7fb4c81389f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:04.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.976+0000 7fb4cffc5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c80719b0 con 0x7fb4c8131b60 2023-09-30T22:19:04.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.976+0000 7fb4cffc5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c806aa90 con 0x7fb4c8070630 2023-09-30T22:19:04.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.976+0000 7fb4cffc5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c80a0550 con 0x7fb4c806fce0 2023-09-30T22:19:04.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.976+0000 7fb4cd560700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4c806fce0 0x7fb4c80700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:04.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.976+0000 7fb4cdd61700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb4c8131b60 0x7fb4c8131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:04.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.976+0000 7fb4ce562700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4c8070630 0x7fb4c81389f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:04.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.976+0000 7fb4cdd61700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb4c8131b60 0x7fb4c8131f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58720/0 (socket says 172.21.15.156:58720) 2023-09-30T22:19:04.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.976+0000 7fb4ce562700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4c8070630 0x7fb4c81389f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48348/0 (socket says 172.21.15.156:48348) 2023-09-30T22:19:04.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.976+0000 7fb4cd560700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4c806fce0 0x7fb4c80700f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45238/0 (socket says 172.21.15.156:45238) 2023-09-30T22:19:04.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.976+0000 7fb4cdd61700 1 -- 172.21.15.156:0/15183778 learned_addr learned my addr 172.21.15.156:0/15183778 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:04.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.976+0000 7fb4cdd61700 1 -- 172.21.15.156:0/15183778 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4c806fce0 msgr2=0x7fb4c80700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:04.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.976+0000 7fb4cdd61700 1 --2- 172.21.15.156:0/15183778 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4c806fce0 0x7fb4c80700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:04.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.976+0000 7fb4cdd61700 1 -- 172.21.15.156:0/15183778 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4c8070630 msgr2=0x7fb4c81389f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:04.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.976+0000 7fb4cdd61700 1 --2- 172.21.15.156:0/15183778 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4c8070630 0x7fb4c81389f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:04.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.976+0000 7fb4cdd61700 1 -- 172.21.15.156:0/15183778 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c81316c0 con 0x7fb4c8131b60 2023-09-30T22:19:04.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.976+0000 7fb4ce562700 1 --2- 172.21.15.156:0/15183778 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4c8070630 0x7fb4c81389f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:04.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.976+0000 7fb4cdd61700 1 --2- 172.21.15.156:0/15183778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4c8131b60 0x7fb4c8131f30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8009920 tx=0x7fb4b8009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3717cabb999f4882 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:04.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.977+0000 7fb4ccd5f700 1 -- 172.21.15.156:0/15183778 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b8011830 con 0x7fb4c8131b60 2023-09-30T22:19:04.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.977+0000 7fb4ccd5f700 1 -- 172.21.15.156:0/15183778 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b8011990 con 0x7fb4c8131b60 2023-09-30T22:19:04.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.977+0000 7fb4ccd5f700 1 -- 172.21.15.156:0/15183778 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b8011d20 con 0x7fb4c8131b60 2023-09-30T22:19:04.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.977+0000 7fb4cffc5700 1 -- 172.21.15.156:0/15183778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4c8131b60 msgr2=0x7fb4c8131f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:04.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.977+0000 7fb4cffc5700 1 --2- 172.21.15.156:0/15183778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4c8131b60 0x7fb4c8131f30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8009920 tx=0x7fb4b8009c30 comp rx=0 tx=0).stop 2023-09-30T22:19:04.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.977+0000 7fb4cffc5700 1 -- 172.21.15.156:0/15183778 shutdown_connections 2023-09-30T22:19:04.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.977+0000 7fb4cffc5700 1 --2- 172.21.15.156:0/15183778 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4c8070630 0x7fb4c81389f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:04.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.977+0000 7fb4cffc5700 1 --2- 172.21.15.156:0/15183778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4c8131b60 0x7fb4c8131f30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:04.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.977+0000 7fb4cffc5700 1 --2- 172.21.15.156:0/15183778 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4c806fce0 0x7fb4c80700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:04.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.977+0000 7fb4cffc5700 1 -- 172.21.15.156:0/15183778 >> 172.21.15.156:0/15183778 conn(0x7fb4c80a4230 msgr2=0x7fb4c80a4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:04.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.977+0000 7fb4cffc5700 1 -- 172.21.15.156:0/15183778 shutdown_connections 2023-09-30T22:19:04.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.977+0000 7fb4cffc5700 1 -- 172.21.15.156:0/15183778 wait complete. 2023-09-30T22:19:04.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.978+0000 7fb4cffc5700 1 Processor -- start 2023-09-30T22:19:04.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.978+0000 7fb4cffc5700 1 -- start start 2023-09-30T22:19:04.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.979+0000 7fb4cffc5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4c806fce0 0x7fb4c81c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:04.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.979+0000 7fb4cffc5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4c8070630 0x7fb4c81c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:04.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.979+0000 7fb4cffc5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4c8131b60 0x7fb4c81c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:04.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.979+0000 7fb4cffc5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c8090380 con 0x7fb4c806fce0 2023-09-30T22:19:04.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.979+0000 7fb4cffc5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c8130be0 con 0x7fb4c8070630 2023-09-30T22:19:04.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.979+0000 7fb4cffc5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c809ae90 con 0x7fb4c8131b60 2023-09-30T22:19:04.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.979+0000 7fb4cd560700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4c8070630 0x7fb4c81c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:04.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.979+0000 7fb4ce562700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4c8131b60 0x7fb4c81c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:04.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.979+0000 7fb4ce562700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4c8131b60 0x7fb4c81c9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45246/0 (socket says 172.21.15.156:45246) 2023-09-30T22:19:04.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.979+0000 7fb4cd560700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4c8070630 0x7fb4c81c8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48354/0 (socket says 172.21.15.156:48354) 2023-09-30T22:19:04.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.979+0000 7fb4ce562700 1 -- 172.21.15.156:0/1909871782 learned_addr learned my addr 172.21.15.156:0/1909871782 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:04.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.979+0000 7fb4cdd61700 1 --2- 172.21.15.156:0/1909871782 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4c806fce0 0x7fb4c81c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:04.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.979+0000 7fb4ce562700 1 -- 172.21.15.156:0/1909871782 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4c8070630 msgr2=0x7fb4c81c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:04.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.979+0000 7fb4ce562700 1 --2- 172.21.15.156:0/1909871782 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4c8070630 0x7fb4c81c8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:04.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.979+0000 7fb4ce562700 1 -- 172.21.15.156:0/1909871782 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4c806fce0 msgr2=0x7fb4c81c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:04.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.979+0000 7fb4ce562700 1 --2- 172.21.15.156:0/1909871782 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4c806fce0 0x7fb4c81c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:04.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.979+0000 7fb4ce562700 1 -- 172.21.15.156:0/1909871782 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c0009a70 con 0x7fb4c8131b60 2023-09-30T22:19:04.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.979+0000 7fb4ce562700 1 --2- 172.21.15.156:0/1909871782 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4c8131b60 0x7fb4c81c9260 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0009f00 tx=0x7fb4c000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:04.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.979+0000 7fb4be7fc700 1 -- 172.21.15.156:0/1909871782 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c0009d70 con 0x7fb4c8131b60 2023-09-30T22:19:04.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.979+0000 7fb4be7fc700 1 -- 172.21.15.156:0/1909871782 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c000f040 con 0x7fb4c8131b60 2023-09-30T22:19:04.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.979+0000 7fb4cffc5700 1 -- 172.21.15.156:0/1909871782 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b8009550 con 0x7fb4c8131b60 2023-09-30T22:19:04.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.979+0000 7fb4be7fc700 1 -- 172.21.15.156:0/1909871782 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c000cd70 con 0x7fb4c8131b60 2023-09-30T22:19:04.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.979+0000 7fb4cffc5700 1 -- 172.21.15.156:0/1909871782 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c80729e0 con 0x7fb4c8131b60 2023-09-30T22:19:04.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.980+0000 7fb4be7fc700 1 -- 172.21.15.156:0/1909871782 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb4c0014480 con 0x7fb4c8131b60 2023-09-30T22:19:04.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.980+0000 7fb4cdd61700 1 -- 172.21.15.156:0/1909871782 >> v1:172.21.15.156:6816/126965 conn(0x7fb4ac02f510 legacy=0x7fb4ac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:04.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.980+0000 7fb4be7fc700 1 -- 172.21.15.156:0/1909871782 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fb4c00402b0 con 0x7fb4c8131b60 2023-09-30T22:19:04.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.980+0000 7fb4cffc5700 1 -- 172.21.15.156:0/1909871782 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c8075190 con 0x7fb4c8131b60 2023-09-30T22:19:04.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:04.985+0000 7fb4be7fc700 1 -- 172.21.15.156:0/1909871782 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4c0018020 con 0x7fb4c8131b60 2023-09-30T22:19:05.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:05.166+0000 7fb4cffc5700 1 -- 172.21.15.156:0/1909871782 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fb4c8068580 con 0x7fb4c8131b60 2023-09-30T22:19:05.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:05.181+0000 7fb4cdd61700 1 -- 172.21.15.156:0/1909871782 >> v1:172.21.15.156:6816/126965 conn(0x7fb4ac02f510 legacy=0x7fb4ac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:05.466 INFO:tasks.ceph.mgr.x.smithi156.stderr:daemon-helper: command crashed with signal 6 2023-09-30T22:19:05.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:05.582+0000 7fb4cdd61700 1 -- 172.21.15.156:0/1909871782 >> v1:172.21.15.156:6816/126965 conn(0x7fb4ac02f510 legacy=0x7fb4ac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:05.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:05.866+0000 7fb4be7fc700 1 -- 172.21.15.156:0/1909871782 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 4 pg_autoscale_mode to off v37) v1 ==== 160+0+0 (secure 0 0 0) 0x7fb4c0012930 con 0x7fb4c8131b60 2023-09-30T22:19:05.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:05.868+0000 7fb4cffc5700 1 -- 172.21.15.156:0/1909871782 >> v1:172.21.15.156:6816/126965 conn(0x7fb4ac02f510 legacy=0x7fb4ac0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:05.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:05.868+0000 7fb4cffc5700 1 -- 172.21.15.156:0/1909871782 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4c8131b60 msgr2=0x7fb4c81c9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:05.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:05.868+0000 7fb4cffc5700 1 --2- 172.21.15.156:0/1909871782 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4c8131b60 0x7fb4c81c9260 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0009f00 tx=0x7fb4c000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:19:05.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:05.869+0000 7fb4cffc5700 1 -- 172.21.15.156:0/1909871782 shutdown_connections 2023-09-30T22:19:05.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:05.869+0000 7fb4cffc5700 1 --2- 172.21.15.156:0/1909871782 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4c8131b60 0x7fb4c81c9260 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:05.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:05.869+0000 7fb4cffc5700 1 --2- 172.21.15.156:0/1909871782 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4c806fce0 0x7fb4c81c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:05.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:05.869+0000 7fb4cffc5700 1 --2- 172.21.15.156:0/1909871782 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4c8070630 0x7fb4c81c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:05.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:05.869+0000 7fb4cffc5700 1 -- 172.21.15.156:0/1909871782 >> 172.21.15.156:0/1909871782 conn(0x7fb4c80a4230 msgr2=0x7fb4c80a2130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:05.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:05.869+0000 7fb4cffc5700 1 -- 172.21.15.156:0/1909871782 shutdown_connections 2023-09-30T22:19:05.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:05.869+0000 7fb4cffc5700 1 -- 172.21.15.156:0/1909871782 wait complete. 2023-09-30T22:19:05.872 INFO:teuthology.orchestra.run.smithi156.stderr:set pool 4 pg_autoscale_mode to off 2023-09-30T22:19:05.884 DEBUG:teuthology.orchestra.run.smithi156:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd require-osd-release reef' 2023-09-30T22:19:06.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.008+0000 7f5ea9cb6700 1 Processor -- start 2023-09-30T22:19:06.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.008+0000 7f5ea9cb6700 1 -- start start 2023-09-30T22:19:06.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.009+0000 7f5ea9cb6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ea409da00 0x7f5ea409ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:06.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.009+0000 7f5ea9cb6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ea409e310 0x7f5ea4133910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:06.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.009+0000 7f5ea9cb6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5ea4133e50 0x7f5ea41342f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:06.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.009+0000 7f5ea9cb6700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea406b4b0 con 0x7f5ea4133e50 2023-09-30T22:19:06.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.009+0000 7f5ea9cb6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea409f340 con 0x7f5ea409e310 2023-09-30T22:19:06.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.009+0000 7f5ea9cb6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea406b0e0 con 0x7f5ea409da00 2023-09-30T22:19:06.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.009+0000 7f5ea37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ea409da00 0x7f5ea409ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:06.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.009+0000 7f5ea2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ea409e310 0x7f5ea4133910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:06.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.009+0000 7f5ea37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ea409da00 0x7f5ea409ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45262/0 (socket says 172.21.15.156:45262) 2023-09-30T22:19:06.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.009+0000 7f5ea2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ea409e310 0x7f5ea4133910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48366/0 (socket says 172.21.15.156:48366) 2023-09-30T22:19:06.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.009+0000 7f5ea37fe700 1 -- 172.21.15.156:0/2838510708 learned_addr learned my addr 172.21.15.156:0/2838510708 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:06.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.009+0000 7f5ea3fff700 1 --2- 172.21.15.156:0/2838510708 >> v2:172.21.15.156:3300/0 conn(0x7f5ea4133e50 0x7f5ea41342f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:06.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.009+0000 7f5ea3fff700 1 -- 172.21.15.156:0/2838510708 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ea409da00 msgr2=0x7f5ea409ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:06.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.009+0000 7f5ea3fff700 1 --2- 172.21.15.156:0/2838510708 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ea409da00 0x7f5ea409ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:06.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.009+0000 7f5ea3fff700 1 -- 172.21.15.156:0/2838510708 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ea409e310 msgr2=0x7f5ea4133910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:06.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.009+0000 7f5ea3fff700 1 --2- 172.21.15.156:0/2838510708 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ea409e310 0x7f5ea4133910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:06.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.009+0000 7f5ea3fff700 1 -- 172.21.15.156:0/2838510708 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea409ee00 con 0x7f5ea4133e50 2023-09-30T22:19:06.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.009+0000 7f5ea2ffd700 1 --2- 172.21.15.156:0/2838510708 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ea409e310 0x7f5ea4133910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:06.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.009+0000 7f5ea37fe700 1 --2- 172.21.15.156:0/2838510708 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ea409da00 0x7f5ea409ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:06.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.009+0000 7f5ea3fff700 1 --2- 172.21.15.156:0/2838510708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ea4133e50 0x7f5ea41342f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c009df0 tx=0x7f5e9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b1bd47ed3ca303c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:06.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.010+0000 7f5ea27fc700 1 -- 172.21.15.156:0/2838510708 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c00e070 con 0x7f5ea4133e50 2023-09-30T22:19:06.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.010+0000 7f5ea27fc700 1 -- 172.21.15.156:0/2838510708 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9c00baa0 con 0x7f5ea4133e50 2023-09-30T22:19:06.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.010+0000 7f5ea27fc700 1 -- 172.21.15.156:0/2838510708 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c00be50 con 0x7f5ea4133e50 2023-09-30T22:19:06.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.010+0000 7f5ea9cb6700 1 -- 172.21.15.156:0/2838510708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ea4133e50 msgr2=0x7f5ea41342f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:06.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.010+0000 7f5ea9cb6700 1 --2- 172.21.15.156:0/2838510708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ea4133e50 0x7f5ea41342f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c009df0 tx=0x7f5e9c00b330 comp rx=0 tx=0).stop 2023-09-30T22:19:06.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.010+0000 7f5ea9cb6700 1 -- 172.21.15.156:0/2838510708 shutdown_connections 2023-09-30T22:19:06.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.010+0000 7f5ea9cb6700 1 --2- 172.21.15.156:0/2838510708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ea4133e50 0x7f5ea41342f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:06.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.010+0000 7f5ea9cb6700 1 --2- 172.21.15.156:0/2838510708 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ea409da00 0x7f5ea409ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:06.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.010+0000 7f5ea9cb6700 1 --2- 172.21.15.156:0/2838510708 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ea409e310 0x7f5ea4133910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:06.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.010+0000 7f5ea9cb6700 1 -- 172.21.15.156:0/2838510708 >> 172.21.15.156:0/2838510708 conn(0x7f5ea4099e60 msgr2=0x7f5ea40a3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:06.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.010+0000 7f5ea9cb6700 1 -- 172.21.15.156:0/2838510708 shutdown_connections 2023-09-30T22:19:06.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.010+0000 7f5ea9cb6700 1 -- 172.21.15.156:0/2838510708 wait complete. 2023-09-30T22:19:06.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.011+0000 7f5ea9cb6700 1 Processor -- start 2023-09-30T22:19:06.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.011+0000 7f5ea9cb6700 1 -- start start 2023-09-30T22:19:06.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.012+0000 7f5ea9cb6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ea409da00 0x7f5ea411cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:06.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.012+0000 7f5ea9cb6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ea409e310 0x7f5ea411d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:06.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.012+0000 7f5ea9cb6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ea4133e50 0x7f5ea411da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:06.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.012+0000 7f5ea9cb6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea4121480 con 0x7f5ea4133e50 2023-09-30T22:19:06.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.012+0000 7f5ea9cb6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea411ebb0 con 0x7f5ea409e310 2023-09-30T22:19:06.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.012+0000 7f5ea9cb6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea411f1d0 con 0x7f5ea409da00 2023-09-30T22:19:06.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.012+0000 7f5ea3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ea4133e50 0x7f5ea411da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:06.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.012+0000 7f5ea2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ea409e310 0x7f5ea411d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:06.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.012+0000 7f5ea37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ea409da00 0x7f5ea411cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:06.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.012+0000 7f5ea2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ea409e310 0x7f5ea411d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48368/0 (socket says 172.21.15.156:48368) 2023-09-30T22:19:06.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.012+0000 7f5ea2ffd700 1 -- 172.21.15.156:0/3304461825 learned_addr learned my addr 172.21.15.156:0/3304461825 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:06.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.012+0000 7f5ea2ffd700 1 -- 172.21.15.156:0/3304461825 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ea409da00 msgr2=0x7f5ea411cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:06.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.012+0000 7f5ea2ffd700 1 --2- 172.21.15.156:0/3304461825 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ea409da00 0x7f5ea411cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:06.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.012+0000 7f5ea2ffd700 1 -- 172.21.15.156:0/3304461825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ea4133e50 msgr2=0x7f5ea411da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:06.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.012+0000 7f5ea2ffd700 1 --2- 172.21.15.156:0/3304461825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ea4133e50 0x7f5ea411da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:06.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.012+0000 7f5ea2ffd700 1 -- 172.21.15.156:0/3304461825 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e98009550 con 0x7f5ea409e310 2023-09-30T22:19:06.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.012+0000 7f5ea37fe700 1 --2- 172.21.15.156:0/3304461825 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ea409da00 0x7f5ea411cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:06.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.012+0000 7f5ea3fff700 1 --2- 172.21.15.156:0/3304461825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ea4133e50 0x7f5ea411da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:06.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.012+0000 7f5ea2ffd700 1 --2- 172.21.15.156:0/3304461825 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ea409e310 0x7f5ea411d4e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400ebe0 tx=0x7f5e9400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:06.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.012+0000 7f5e8bfff700 1 -- 172.21.15.156:0/3304461825 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9400c850 con 0x7f5ea409e310 2023-09-30T22:19:06.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.012+0000 7f5e8bfff700 1 -- 172.21.15.156:0/3304461825 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9400c9b0 con 0x7f5ea409e310 2023-09-30T22:19:06.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.012+0000 7f5e8bfff700 1 -- 172.21.15.156:0/3304461825 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9400cd40 con 0x7f5ea409e310 2023-09-30T22:19:06.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.012+0000 7f5ea9cb6700 1 -- 172.21.15.156:0/3304461825 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e940094a0 con 0x7f5ea409e310 2023-09-30T22:19:06.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.012+0000 7f5ea9cb6700 1 -- 172.21.15.156:0/3304461825 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e9c009a70 con 0x7f5ea409e310 2023-09-30T22:19:06.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.013+0000 7f5e8bfff700 1 -- 172.21.15.156:0/3304461825 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5e94013470 con 0x7f5ea409e310 2023-09-30T22:19:06.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.013+0000 7f5e8bfff700 1 -- 172.21.15.156:0/3304461825 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f5e9403ff50 con 0x7f5ea409e310 2023-09-30T22:19:06.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.013+0000 7f5ea37fe700 1 -- 172.21.15.156:0/3304461825 >> v1:172.21.15.156:6816/126965 conn(0x7f5e9002f510 legacy=0x7f5e900319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:06.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.014+0000 7f5ea9cb6700 1 -- 172.21.15.156:0/3304461825 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea40a2400 con 0x7f5ea409e310 2023-09-30T22:19:06.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.018+0000 7f5e8bfff700 1 -- 172.21.15.156:0/3304461825 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e94021020 con 0x7f5ea409e310 2023-09-30T22:19:06.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.211+0000 7f5ea9cb6700 1 -- 172.21.15.156:0/3304461825 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd require-osd-release", "release": "reef"} v 0) v1 -- 0x7f5ea409eb30 con 0x7f5ea409e310 2023-09-30T22:19:06.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.214+0000 7f5ea37fe700 1 -- 172.21.15.156:0/3304461825 >> v1:172.21.15.156:6816/126965 conn(0x7f5e9002f510 legacy=0x7f5e900319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:06.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.615+0000 7f5ea37fe700 1 -- 172.21.15.156:0/3304461825 >> v1:172.21.15.156:6816/126965 conn(0x7f5e9002f510 legacy=0x7f5e900319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:06.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.864+0000 7f5e8bfff700 1 -- 172.21.15.156:0/3304461825 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd require-osd-release", "release": "reef"}]=0 v38) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5e94017070 con 0x7f5ea409e310 2023-09-30T22:19:06.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.869+0000 7f5ea9cb6700 1 -- 172.21.15.156:0/3304461825 >> v1:172.21.15.156:6816/126965 conn(0x7f5e9002f510 legacy=0x7f5e900319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:06.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.869+0000 7f5ea9cb6700 1 -- 172.21.15.156:0/3304461825 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ea409e310 msgr2=0x7f5ea411d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:06.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.869+0000 7f5ea9cb6700 1 --2- 172.21.15.156:0/3304461825 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ea409e310 0x7f5ea411d4e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400ebe0 tx=0x7f5e9400eef0 comp rx=0 tx=0).stop 2023-09-30T22:19:06.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.870+0000 7f5ea9cb6700 1 -- 172.21.15.156:0/3304461825 shutdown_connections 2023-09-30T22:19:06.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.870+0000 7f5ea9cb6700 1 --2- 172.21.15.156:0/3304461825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ea4133e50 0x7f5ea411da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:06.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.870+0000 7f5ea9cb6700 1 --2- 172.21.15.156:0/3304461825 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ea409da00 0x7f5ea411cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:06.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.870+0000 7f5ea9cb6700 1 --2- 172.21.15.156:0/3304461825 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ea409e310 0x7f5ea411d4e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:06.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.870+0000 7f5ea9cb6700 1 -- 172.21.15.156:0/3304461825 >> 172.21.15.156:0/3304461825 conn(0x7f5ea4099e60 msgr2=0x7f5ea41320e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:06.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.870+0000 7f5ea9cb6700 1 -- 172.21.15.156:0/3304461825 shutdown_connections 2023-09-30T22:19:06.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:06.870+0000 7f5ea9cb6700 1 -- 172.21.15.156:0/3304461825 wait complete. 2023-09-30T22:19:06.884 INFO:teuthology.run_tasks:Running task ceph.healthy... 2023-09-30T22:19:06.895 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-30T22:19:06.895 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-30T22:19:06.895 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-30T22:19:07.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.016+0000 7f17cacaa700 1 Processor -- start 2023-09-30T22:19:07.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.017+0000 7f17cacaa700 1 -- start start 2023-09-30T22:19:07.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.017+0000 7f17cacaa700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f17c4131980 0x7f17c4131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:07.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.017+0000 7f17cacaa700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f17c409c790 0x7f17c4139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:07.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.017+0000 7f17cacaa700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c40a1640 con 0x7f17c409bc70 2023-09-30T22:19:07.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.017+0000 7f17cacaa700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c406eb30 con 0x7f17c409c790 2023-09-30T22:19:07.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.017+0000 7f17cacaa700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17c40a22d0 con 0x7f17c4131980 2023-09-30T22:19:07.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.017+0000 7f17c8a46700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f17c4131980 0x7f17c4131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:07.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.017+0000 7f17c9247700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f17c409c790 0x7f17c4139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:07.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.017+0000 7f17c9247700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f17c409c790 0x7f17c4139710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58756/0 (socket says 172.21.15.156:58756) 2023-09-30T22:19:07.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.017+0000 7f17c8a46700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f17c4131980 0x7f17c4131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45290/0 (socket says 172.21.15.156:45290) 2023-09-30T22:19:07.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.017+0000 7f17c9247700 1 -- 172.21.15.156:0/3153591695 learned_addr learned my addr 172.21.15.156:0/3153591695 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:07.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.017+0000 7f17c9247700 1 -- 172.21.15.156:0/3153591695 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f17c4131980 msgr2=0x7f17c4131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:07.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.017+0000 7f17c9247700 1 --2- 172.21.15.156:0/3153591695 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f17c4131980 0x7f17c4131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:07.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.017+0000 7f17c9247700 1 -- 172.21.15.156:0/3153591695 >> v1:172.21.15.156:6789/0 conn(0x7f17c409bc70 legacy=0x7f17c409c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:07.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.017+0000 7f17c9247700 1 -- 172.21.15.156:0/3153591695 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c4131550 con 0x7f17c409c790 2023-09-30T22:19:07.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.017+0000 7f17c8a46700 1 --2- 172.21.15.156:0/3153591695 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f17c4131980 0x7f17c4131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:07.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.018+0000 7f17c9247700 1 --2- 172.21.15.156:0/3153591695 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17c409c790 0x7f17c4139710 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f17bc009e50 tx=0x7f17bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb932431041056c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:07.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.018+0000 7f17c37fe700 1 -- 172.21.15.156:0/3153591695 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc00e070 con 0x7f17c409c790 2023-09-30T22:19:07.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.018+0000 7f17c37fe700 1 -- 172.21.15.156:0/3153591695 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17bc00b910 con 0x7f17c409c790 2023-09-30T22:19:07.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.018+0000 7f17c37fe700 1 -- 172.21.15.156:0/3153591695 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc00bcc0 con 0x7f17c409c790 2023-09-30T22:19:07.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.018+0000 7f17cacaa700 1 -- 172.21.15.156:0/3153591695 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17c409c790 msgr2=0x7f17c4139710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:07.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.018+0000 7f17cacaa700 1 --2- 172.21.15.156:0/3153591695 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17c409c790 0x7f17c4139710 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f17bc009e50 tx=0x7f17bc00b330 comp rx=0 tx=0).stop 2023-09-30T22:19:07.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.018+0000 7f17cacaa700 1 -- 172.21.15.156:0/3153591695 shutdown_connections 2023-09-30T22:19:07.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.018+0000 7f17cacaa700 1 --2- 172.21.15.156:0/3153591695 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17c409c790 0x7f17c4139710 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:07.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.018+0000 7f17cacaa700 1 --2- 172.21.15.156:0/3153591695 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f17c4131980 0x7f17c4131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:07.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.018+0000 7f17cacaa700 1 -- 172.21.15.156:0/3153591695 >> 172.21.15.156:0/3153591695 conn(0x7f17c40a2980 msgr2=0x7f17c40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:07.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.018+0000 7f17cacaa700 1 -- 172.21.15.156:0/3153591695 shutdown_connections 2023-09-30T22:19:07.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.018+0000 7f17cacaa700 1 -- 172.21.15.156:0/3153591695 wait complete. 2023-09-30T22:19:07.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.019+0000 7f17cacaa700 1 Processor -- start 2023-09-30T22:19:07.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.019+0000 7f17cacaa700 1 -- start start 2023-09-30T22:19:07.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.020+0000 7f17cacaa700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f17c409bc70 0x7f17c411b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:07.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.020+0000 7f17cacaa700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17c409c790 0x7f17c411bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:07.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.020+0000 7f17cacaa700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f17c4131980 0x7f17c411c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:07.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.020+0000 7f17cacaa700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c411ee70 con 0x7f17c409c790 2023-09-30T22:19:07.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.020+0000 7f17cacaa700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c411d350 con 0x7f17c409bc70 2023-09-30T22:19:07.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.020+0000 7f17cacaa700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17c4130d80 con 0x7f17c4131980 2023-09-30T22:19:07.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.020+0000 7f17c9247700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f17c4131980 0x7f17c411c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:07.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.020+0000 7f17c3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17c409c790 0x7f17c411bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:07.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.020+0000 7f17c8a46700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f17c409bc70 0x7f17c411b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:07.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.020+0000 7f17c9247700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f17c4131980 0x7f17c411c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45296/0 (socket says 172.21.15.156:45296) 2023-09-30T22:19:07.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.020+0000 7f17c9247700 1 -- 172.21.15.156:0/1465380145 learned_addr learned my addr 172.21.15.156:0/1465380145 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:07.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.020+0000 7f17c9247700 1 -- 172.21.15.156:0/1465380145 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f17c409bc70 msgr2=0x7f17c411b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:07.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.020+0000 7f17c9247700 1 --2- 172.21.15.156:0/1465380145 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f17c409bc70 0x7f17c411b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:07.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.020+0000 7f17c9247700 1 -- 172.21.15.156:0/1465380145 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17c409c790 msgr2=0x7f17c411bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:07.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.020+0000 7f17c9247700 1 --2- 172.21.15.156:0/1465380145 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17c409c790 0x7f17c411bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:07.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.020+0000 7f17c9247700 1 -- 172.21.15.156:0/1465380145 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b8009430 con 0x7f17c4131980 2023-09-30T22:19:07.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.020+0000 7f17c3fff700 1 --2- 172.21.15.156:0/1465380145 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17c409c790 0x7f17c411bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:07.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.020+0000 7f17c8a46700 1 --2- 172.21.15.156:0/1465380145 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f17c409bc70 0x7f17c411b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:07.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.020+0000 7f17c9247700 1 --2- 172.21.15.156:0/1465380145 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f17c4131980 0x7f17c411c0b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f17c409cc30 tx=0x7f17bc004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:07.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.020+0000 7f17c17fa700 1 -- 172.21.15.156:0/1465380145 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc004800 con 0x7f17c4131980 2023-09-30T22:19:07.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.020+0000 7f17c17fa700 1 -- 172.21.15.156:0/1465380145 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17bc004960 con 0x7f17c4131980 2023-09-30T22:19:07.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.020+0000 7f17cacaa700 1 -- 172.21.15.156:0/1465380145 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17bc009b30 con 0x7f17c4131980 2023-09-30T22:19:07.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.021+0000 7f17c17fa700 1 -- 172.21.15.156:0/1465380145 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc01c680 con 0x7f17c4131980 2023-09-30T22:19:07.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.021+0000 7f17cacaa700 1 -- 172.21.15.156:0/1465380145 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c411e490 con 0x7f17c4131980 2023-09-30T22:19:07.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.021+0000 7f17c17fa700 1 -- 172.21.15.156:0/1465380145 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f17bc01c7e0 con 0x7f17c4131980 2023-09-30T22:19:07.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.021+0000 7f17c8a46700 1 -- 172.21.15.156:0/1465380145 >> v1:172.21.15.156:6816/126965 conn(0x7f17a802f510 legacy=0x7f17a80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:07.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.021+0000 7f17c17fa700 1 -- 172.21.15.156:0/1465380145 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f17bc0417a0 con 0x7f17c4131980 2023-09-30T22:19:07.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.021+0000 7f17cacaa700 1 -- 172.21.15.156:0/1465380145 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c411efb0 con 0x7f17c4131980 2023-09-30T22:19:07.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.026+0000 7f17c17fa700 1 -- 172.21.15.156:0/1465380145 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f17c411efb0 con 0x7f17c4131980 2023-09-30T22:19:07.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.222+0000 7f17c8a46700 1 -- 172.21.15.156:0/1465380145 >> v1:172.21.15.156:6816/126965 conn(0x7f17a802f510 legacy=0x7f17a80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:07.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.261+0000 7f17cacaa700 1 -- 172.21.15.156:0/1465380145 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f17c411efb0 con 0x7f17c4131980 2023-09-30T22:19:07.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.262+0000 7f17c17fa700 1 -- 172.21.15.156:0/1465380145 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v9) v1 ==== 74+0+70491 (secure 0 0 0) 0x7f17c411efb0 con 0x7f17c4131980 2023-09-30T22:19:07.264 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:19:07.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.264+0000 7f17cacaa700 1 -- 172.21.15.156:0/1465380145 >> v1:172.21.15.156:6816/126965 conn(0x7f17a802f510 legacy=0x7f17a80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:07.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.264+0000 7f17cacaa700 1 -- 172.21.15.156:0/1465380145 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f17c4131980 msgr2=0x7f17c411c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:07.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.264+0000 7f17cacaa700 1 --2- 172.21.15.156:0/1465380145 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f17c4131980 0x7f17c411c0b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f17c409cc30 tx=0x7f17bc004ad0 comp rx=0 tx=0).stop 2023-09-30T22:19:07.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.264+0000 7f17cacaa700 1 -- 172.21.15.156:0/1465380145 shutdown_connections 2023-09-30T22:19:07.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.264+0000 7f17cacaa700 1 --2- 172.21.15.156:0/1465380145 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f17c4131980 0x7f17c411c0b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:07.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.264+0000 7f17cacaa700 1 --2- 172.21.15.156:0/1465380145 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f17c409bc70 0x7f17c411b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:07.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.264+0000 7f17cacaa700 1 --2- 172.21.15.156:0/1465380145 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17c409c790 0x7f17c411bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:07.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.264+0000 7f17cacaa700 1 -- 172.21.15.156:0/1465380145 >> 172.21.15.156:0/1465380145 conn(0x7f17c40a2980 msgr2=0x7f17c409fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:07.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.264+0000 7f17cacaa700 1 -- 172.21.15.156:0/1465380145 shutdown_connections 2023-09-30T22:19:07.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.264+0000 7f17cacaa700 1 -- 172.21.15.156:0/1465380145 wait complete. 2023-09-30T22:19:07.277 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":9,"active_gid":14098,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6816","nonce":126965}]},"active_addr":"172.21.15.156:6816/126965","active_change":"2023-09-30T22:18:37.767660+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":20,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":1669701082}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":1153199602}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":417912451}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":1695265592}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":1136044187}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":3331241925}]}]} 2023-09-30T22:19:07.279 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-30T22:19:07.280 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-30T22:19:07.280 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:19:07.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.400+0000 7fda677d1700 1 Processor -- start 2023-09-30T22:19:07.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.400+0000 7fda677d1700 1 -- start start 2023-09-30T22:19:07.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.400+0000 7fda677d1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fda6009e870 0x7fda6009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:07.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.400+0000 7fda677d1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda6009f180 0x7fda60133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:07.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.400+0000 7fda677d1700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda6009fa00 con 0x7fda60134160 2023-09-30T22:19:07.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.400+0000 7fda677d1700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda600a0370 con 0x7fda6009e870 2023-09-30T22:19:07.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.400+0000 7fda677d1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda6006bec0 con 0x7fda6009f180 2023-09-30T22:19:07.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.400+0000 7fda6556d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fda6009e870 0x7fda6009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:07.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.400+0000 7fda64d6c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda6009f180 0x7fda60133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:07.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.400+0000 7fda6556d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fda6009e870 0x7fda6009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58778/0 (socket says 172.21.15.156:58778) 2023-09-30T22:19:07.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.400+0000 7fda6556d700 1 -- 172.21.15.156:0/4196374734 learned_addr learned my addr 172.21.15.156:0/4196374734 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:07.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.401+0000 7fda64d6c700 1 -- 172.21.15.156:0/4196374734 >> v2:172.21.15.156:3300/0 conn(0x7fda6009e870 msgr2=0x7fda6009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:07.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.401+0000 7fda64d6c700 1 --2- 172.21.15.156:0/4196374734 >> v2:172.21.15.156:3300/0 conn(0x7fda6009e870 0x7fda6009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:07.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.401+0000 7fda64d6c700 1 -- 172.21.15.156:0/4196374734 >> v1:172.21.15.156:6789/0 conn(0x7fda60134160 legacy=0x7fda6013ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:07.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.401+0000 7fda64d6c700 1 -- 172.21.15.156:0/4196374734 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda6009ada0 con 0x7fda6009f180 2023-09-30T22:19:07.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.401+0000 7fda57fff700 1 -- 172.21.15.156:0/4196374734 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1451891231 0 0) 0x7fda6009fa00 con 0x7fda60134160 2023-09-30T22:19:07.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.401+0000 7fda6556d700 1 --2- 172.21.15.156:0/4196374734 >> v2:172.21.15.156:3300/0 conn(0x7fda6009e870 0x7fda6009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:07.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.401+0000 7fda64d6c700 1 --2- 172.21.15.156:0/4196374734 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda6009f180 0x7fda60133c20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fda5c009840 tx=0x7fda5c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe2a3f8496bb424b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:07.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.401+0000 7fda57fff700 1 -- 172.21.15.156:0/4196374734 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c011830 con 0x7fda6009f180 2023-09-30T22:19:07.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.401+0000 7fda57fff700 1 -- 172.21.15.156:0/4196374734 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5c011990 con 0x7fda6009f180 2023-09-30T22:19:07.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.401+0000 7fda57fff700 1 -- 172.21.15.156:0/4196374734 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c011d20 con 0x7fda6009f180 2023-09-30T22:19:07.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.401+0000 7fda677d1700 1 -- 172.21.15.156:0/4196374734 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda6009f180 msgr2=0x7fda60133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:07.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.401+0000 7fda677d1700 1 --2- 172.21.15.156:0/4196374734 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda6009f180 0x7fda60133c20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fda5c009840 tx=0x7fda5c009b50 comp rx=0 tx=0).stop 2023-09-30T22:19:07.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.401+0000 7fda677d1700 1 -- 172.21.15.156:0/4196374734 shutdown_connections 2023-09-30T22:19:07.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.401+0000 7fda677d1700 1 --2- 172.21.15.156:0/4196374734 >> v2:172.21.15.156:3300/0 conn(0x7fda6009e870 0x7fda6009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:07.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.401+0000 7fda677d1700 1 --2- 172.21.15.156:0/4196374734 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda6009f180 0x7fda60133c20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:07.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.401+0000 7fda677d1700 1 -- 172.21.15.156:0/4196374734 >> 172.21.15.156:0/4196374734 conn(0x7fda600a4430 msgr2=0x7fda600a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:07.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.402+0000 7fda677d1700 1 -- 172.21.15.156:0/4196374734 shutdown_connections 2023-09-30T22:19:07.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.402+0000 7fda677d1700 1 -- 172.21.15.156:0/4196374734 wait complete. 2023-09-30T22:19:07.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.402+0000 7fda677d1700 1 Processor -- start 2023-09-30T22:19:07.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.402+0000 7fda677d1700 1 -- start start 2023-09-30T22:19:07.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.403+0000 7fda677d1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fda6009e870 0x7fda60122940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:07.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.403+0000 7fda677d1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda6009f180 0x7fda60122e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:07.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.403+0000 7fda677d1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda60134160 0x7fda601233c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:07.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.403+0000 7fda677d1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda60125bd0 con 0x7fda6009f180 2023-09-30T22:19:07.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.403+0000 7fda677d1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda60125f50 con 0x7fda6009e870 2023-09-30T22:19:07.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.403+0000 7fda677d1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda60126460 con 0x7fda60134160 2023-09-30T22:19:07.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.403+0000 7fda64d6c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda6009f180 0x7fda60122e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:07.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.403+0000 7fda65d6e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda60134160 0x7fda601233c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:07.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.403+0000 7fda6556d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fda6009e870 0x7fda60122940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:07.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.403+0000 7fda64d6c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda6009f180 0x7fda60122e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58794/0 (socket says 172.21.15.156:58794) 2023-09-30T22:19:07.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.403+0000 7fda6556d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fda6009e870 0x7fda60122940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48396/0 (socket says 172.21.15.156:48396) 2023-09-30T22:19:07.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.403+0000 7fda64d6c700 1 -- 172.21.15.156:0/1387123266 learned_addr learned my addr 172.21.15.156:0/1387123266 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:07.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.403+0000 7fda65d6e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda60134160 0x7fda601233c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45312/0 (socket says 172.21.15.156:45312) 2023-09-30T22:19:07.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.403+0000 7fda64d6c700 1 -- 172.21.15.156:0/1387123266 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda60134160 msgr2=0x7fda601233c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:07.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.403+0000 7fda64d6c700 1 --2- 172.21.15.156:0/1387123266 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda60134160 0x7fda601233c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:07.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.403+0000 7fda64d6c700 1 -- 172.21.15.156:0/1387123266 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fda6009e870 msgr2=0x7fda60122940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:07.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.403+0000 7fda64d6c700 1 --2- 172.21.15.156:0/1387123266 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fda6009e870 0x7fda60122940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:07.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.403+0000 7fda64d6c700 1 -- 172.21.15.156:0/1387123266 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda50009550 con 0x7fda6009f180 2023-09-30T22:19:07.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.403+0000 7fda6556d700 1 --2- 172.21.15.156:0/1387123266 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fda6009e870 0x7fda60122940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:07.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.403+0000 7fda65d6e700 1 --2- 172.21.15.156:0/1387123266 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda60134160 0x7fda601233c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:07.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.403+0000 7fda64d6c700 1 --2- 172.21.15.156:0/1387123266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda6009f180 0x7fda60122e80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fda5c0090b0 tx=0x7fda5c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:07.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.404+0000 7fda55ffb700 1 -- 172.21.15.156:0/1387123266 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c004550 con 0x7fda6009f180 2023-09-30T22:19:07.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.404+0000 7fda55ffb700 1 -- 172.21.15.156:0/1387123266 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5c01f070 con 0x7fda6009f180 2023-09-30T22:19:07.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.404+0000 7fda677d1700 1 -- 172.21.15.156:0/1387123266 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5c0094a0 con 0x7fda6009f180 2023-09-30T22:19:07.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.404+0000 7fda55ffb700 1 -- 172.21.15.156:0/1387123266 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c0038e0 con 0x7fda6009f180 2023-09-30T22:19:07.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.404+0000 7fda677d1700 1 -- 172.21.15.156:0/1387123266 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda60124550 con 0x7fda6009f180 2023-09-30T22:19:07.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.405+0000 7fda55ffb700 1 -- 172.21.15.156:0/1387123266 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fda5c003a40 con 0x7fda6009f180 2023-09-30T22:19:07.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.405+0000 7fda55ffb700 1 -- 172.21.15.156:0/1387123266 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fda5c021070 con 0x7fda6009f180 2023-09-30T22:19:07.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.405+0000 7fda6556d700 1 -- 172.21.15.156:0/1387123266 >> v1:172.21.15.156:6816/126965 conn(0x7fda4402f510 legacy=0x7fda440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:07.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.405+0000 7fda677d1700 1 -- 172.21.15.156:0/1387123266 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda6004f2a0 con 0x7fda6009f180 2023-09-30T22:19:07.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.410+0000 7fda55ffb700 1 -- 172.21.15.156:0/1387123266 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fda5c01a430 con 0x7fda6009f180 2023-09-30T22:19:07.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.595+0000 7fda677d1700 1 -- 172.21.15.156:0/1387123266 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda60126240 con 0x7fda6009f180 2023-09-30T22:19:07.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.596+0000 7fda55ffb700 1 -- 172.21.15.156:0/1387123266 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+13044 (secure 0 0 0) 0x7fda5c015030 con 0x7fda6009f180 2023-09-30T22:19:07.596 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:19:07.597 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":38,"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","created":"2023-09-30T22:16:15.239992+0000","modified":"2023-09-30T22:19:06.862323+0000","last_up_change":"2023-09-30T22:18:55.822352+0000","last_in_change":"2023-09-30T22:16:16.474206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:16:23.433906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:16:24.367795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:16:28.204677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:16:28.762804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ec2e78a-c61f-473a-bfcb-f956cffe4095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6803","nonce":129485}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6805","nonce":129485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6807","nonce":129485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6806","nonce":129485}]},"public_addr":"172.21.15.156:6803/129485","cluster_addr":"172.21.15.156:6805/129485","heartbeat_back_addr":"172.21.15.156:6807/129485","heartbeat_front_addr":"172.21.15.156:6806/129485","state":["exists","up"]},{"osd":1,"uuid":"b682e683-c15a-4bd9-8712-8af96454e9ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6808","nonce":129583}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6809","nonce":129583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6811","nonce":129583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6810","nonce":129583}]},"public_addr":"172.21.15.156:6808/129583","cluster_addr":"172.21.15.156:6809/129583","heartbeat_back_addr":"172.21.15.156:6811/129583","heartbeat_front_addr":"172.21.15.156:6810/129583","state":["exists","up"]},{"osd":2,"uuid":"960dbaf0-2e0c-437e-9114-bc22ce522b26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6800","nonce":129693}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6801","nonce":129693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6804","nonce":129693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6802","nonce":129693}]},"public_addr":"172.21.15.156:6800/129693","cluster_addr":"172.21.15.156:6801/129693","heartbeat_back_addr":"172.21.15.156:6804/129693","heartbeat_front_addr":"172.21.15.156:6802/129693","state":["exists","up"]},{"osd":3,"uuid":"c1b19714-78b1-4869-8721-2f6352a64a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6812","nonce":129849}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6813","nonce":129849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6815","nonce":129849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6814","nonce":129849}]},"public_addr":"172.21.15.156:6812/129849","cluster_addr":"172.21.15.156:6813/129849","heartbeat_back_addr":"172.21.15.156:6815/129849","heartbeat_front_addr":"172.21.15.156:6814/129849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.663343+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.827397+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.806655+0000","dead_epoch":25},{"osd":3,"down_stamp":"2023-09-30T22:18:49.807414+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.634746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.2","mappings":[{"from":3,"to":0}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.156:6816/118236":"2023-10-01T22:18:37.767496+0000","172.21.15.156:0/1464735255":"2023-10-01T22:18:37.767496+0000","172.21.15.156:6817/3817969673":"2023-10-01T22:19:00.677676+0000","172.21.15.156:0/2593263545":"2023-10-01T22:18:37.767496+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:19:07.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.598+0000 7fda677d1700 1 -- 172.21.15.156:0/1387123266 >> v1:172.21.15.156:6816/126965 conn(0x7fda4402f510 legacy=0x7fda440319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:07.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.598+0000 7fda677d1700 1 -- 172.21.15.156:0/1387123266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda6009f180 msgr2=0x7fda60122e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:07.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.598+0000 7fda677d1700 1 --2- 172.21.15.156:0/1387123266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda6009f180 0x7fda60122e80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fda5c0090b0 tx=0x7fda5c004750 comp rx=0 tx=0).stop 2023-09-30T22:19:07.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.598+0000 7fda677d1700 1 -- 172.21.15.156:0/1387123266 shutdown_connections 2023-09-30T22:19:07.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.598+0000 7fda677d1700 1 --2- 172.21.15.156:0/1387123266 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda60134160 0x7fda601233c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:07.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.598+0000 7fda677d1700 1 --2- 172.21.15.156:0/1387123266 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fda6009e870 0x7fda60122940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:07.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.598+0000 7fda677d1700 1 --2- 172.21.15.156:0/1387123266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda6009f180 0x7fda60122e80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:07.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.598+0000 7fda677d1700 1 -- 172.21.15.156:0/1387123266 >> 172.21.15.156:0/1387123266 conn(0x7fda600a4430 msgr2=0x7fda600a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:07.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.598+0000 7fda677d1700 1 -- 172.21.15.156:0/1387123266 shutdown_connections 2023-09-30T22:19:07.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.598+0000 7fda677d1700 1 -- 172.21.15.156:0/1387123266 wait complete. 2023-09-30T22:19:07.611 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-30T22:19:07.611 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:19:07.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.732+0000 7f0014797700 1 Processor -- start 2023-09-30T22:19:07.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.732+0000 7f0014797700 1 -- start start 2023-09-30T22:19:07.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.733+0000 7f0014797700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f000c131980 0x7f000c131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:07.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.733+0000 7f0014797700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f000c09c790 0x7f000c139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:07.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.733+0000 7f0014797700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f000c0a1640 con 0x7f000c09bc70 2023-09-30T22:19:07.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.733+0000 7f0014797700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f000c06eb30 con 0x7f000c09c790 2023-09-30T22:19:07.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.733+0000 7f0014797700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000c0a22d0 con 0x7f000c131980 2023-09-30T22:19:07.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.733+0000 7f0012d34700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f000c09c790 0x7f000c139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:07.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.733+0000 7f0012d34700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f000c09c790 0x7f000c139710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58808/0 (socket says 172.21.15.156:58808) 2023-09-30T22:19:07.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.733+0000 7f0012d34700 1 -- 172.21.15.156:0/3700089004 learned_addr learned my addr 172.21.15.156:0/3700089004 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:07.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.733+0000 7f0012533700 1 --2- 172.21.15.156:0/3700089004 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f000c131980 0x7f000c131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:07.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.733+0000 7f0012533700 1 -- 172.21.15.156:0/3700089004 >> v2:172.21.15.156:3300/0 conn(0x7f000c09c790 msgr2=0x7f000c139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:07.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.733+0000 7f0012533700 1 --2- 172.21.15.156:0/3700089004 >> v2:172.21.15.156:3300/0 conn(0x7f000c09c790 0x7f000c139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:07.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.733+0000 7f0012533700 1 -- 172.21.15.156:0/3700089004 >> v1:172.21.15.156:6789/0 conn(0x7f000c09bc70 legacy=0x7f000c09c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:07.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.733+0000 7f0012533700 1 -- 172.21.15.156:0/3700089004 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000c131550 con 0x7f000c131980 2023-09-30T22:19:07.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.733+0000 7f0012d34700 1 --2- 172.21.15.156:0/3700089004 >> v2:172.21.15.156:3300/0 conn(0x7f000c09c790 0x7f000c139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:07.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.733+0000 7f0012533700 1 --2- 172.21.15.156:0/3700089004 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f000c131980 0x7f000c131d50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efffc009820 tx=0x7efffc009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f25a32a8360addb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:07.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.733+0000 7f0011531700 1 -- 172.21.15.156:0/3700089004 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc005e30 con 0x7f000c131980 2023-09-30T22:19:07.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.733+0000 7f0011531700 1 -- 172.21.15.156:0/3700089004 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efffc006030 con 0x7f000c131980 2023-09-30T22:19:07.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.733+0000 7f0011531700 1 -- 172.21.15.156:0/3700089004 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc0063c0 con 0x7f000c131980 2023-09-30T22:19:07.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.734+0000 7f0014797700 1 -- 172.21.15.156:0/3700089004 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f000c131980 msgr2=0x7f000c131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:07.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.734+0000 7f0014797700 1 --2- 172.21.15.156:0/3700089004 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f000c131980 0x7f000c131d50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efffc009820 tx=0x7efffc009b30 comp rx=0 tx=0).stop 2023-09-30T22:19:07.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.734+0000 7f0014797700 1 -- 172.21.15.156:0/3700089004 shutdown_connections 2023-09-30T22:19:07.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.734+0000 7f0014797700 1 --2- 172.21.15.156:0/3700089004 >> v2:172.21.15.156:3300/0 conn(0x7f000c09c790 0x7f000c139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:07.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.734+0000 7f0014797700 1 --2- 172.21.15.156:0/3700089004 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f000c131980 0x7f000c131d50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:07.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.734+0000 7f0014797700 1 -- 172.21.15.156:0/3700089004 >> 172.21.15.156:0/3700089004 conn(0x7f000c0a2980 msgr2=0x7f000c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:07.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.734+0000 7f0014797700 1 -- 172.21.15.156:0/3700089004 shutdown_connections 2023-09-30T22:19:07.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.734+0000 7f0014797700 1 -- 172.21.15.156:0/3700089004 wait complete. 2023-09-30T22:19:07.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.735+0000 7f0014797700 1 Processor -- start 2023-09-30T22:19:07.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.735+0000 7f0014797700 1 -- start start 2023-09-30T22:19:07.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.735+0000 7f0014797700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f000c09bc70 0x7f000c099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:07.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.735+0000 7f0014797700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f000c09c790 0x7f000c099fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:07.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.735+0000 7f0014797700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f000c131980 0x7f000c09a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:07.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.735+0000 7f0014797700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000c09aef0 con 0x7f000c09c790 2023-09-30T22:19:07.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.735+0000 7f0014797700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000c122190 con 0x7f000c131980 2023-09-30T22:19:07.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.735+0000 7f0014797700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f000c130f50 con 0x7f000c09bc70 2023-09-30T22:19:07.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.735+0000 7f0011d32700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f000c09c790 0x7f000c099fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:07.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.735+0000 7f0012533700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f000c09bc70 0x7f000c099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:07.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.735+0000 7f0012d34700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f000c131980 0x7f000c09a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:07.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.735+0000 7f0012d34700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f000c131980 0x7f000c09a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48424/0 (socket says 172.21.15.156:48424) 2023-09-30T22:19:07.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.735+0000 7f0012533700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f000c09bc70 0x7f000c099a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45324/0 (socket says 172.21.15.156:45324) 2023-09-30T22:19:07.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.735+0000 7f0011d32700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f000c09c790 0x7f000c099fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58814/0 (socket says 172.21.15.156:58814) 2023-09-30T22:19:07.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.735+0000 7f0012d34700 1 -- 172.21.15.156:0/4188571773 learned_addr learned my addr 172.21.15.156:0/4188571773 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:07.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.736+0000 7f0011d32700 1 -- 172.21.15.156:0/4188571773 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f000c09bc70 msgr2=0x7f000c099a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:07.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.736+0000 7f0011d32700 1 --2- 172.21.15.156:0/4188571773 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f000c09bc70 0x7f000c099a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:07.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.736+0000 7f0011d32700 1 -- 172.21.15.156:0/4188571773 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f000c131980 msgr2=0x7f000c09a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:07.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.736+0000 7f0011d32700 1 --2- 172.21.15.156:0/4188571773 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f000c131980 0x7f000c09a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:07.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.736+0000 7f0011d32700 1 -- 172.21.15.156:0/4188571773 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0004009b30 con 0x7f000c09c790 2023-09-30T22:19:07.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.736+0000 7f0012d34700 1 --2- 172.21.15.156:0/4188571773 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f000c131980 0x7f000c09a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:07.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.736+0000 7f0012533700 1 --2- 172.21.15.156:0/4188571773 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f000c09bc70 0x7f000c099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:07.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.736+0000 7f0011d32700 1 --2- 172.21.15.156:0/4188571773 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f000c09c790 0x7f000c099fd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0008000f60 tx=0x7f000800c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:07.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.736+0000 7f0002ffd700 1 -- 172.21.15.156:0/4188571773 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00080052d0 con 0x7f000c09c790 2023-09-30T22:19:07.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.736+0000 7f0002ffd700 1 -- 172.21.15.156:0/4188571773 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0008005430 con 0x7f000c09c790 2023-09-30T22:19:07.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.736+0000 7f0014797700 1 -- 172.21.15.156:0/4188571773 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efffc009430 con 0x7f000c09c790 2023-09-30T22:19:07.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.736+0000 7f0002ffd700 1 -- 172.21.15.156:0/4188571773 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00080038c0 con 0x7f000c09c790 2023-09-30T22:19:07.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.736+0000 7f0014797700 1 -- 172.21.15.156:0/4188571773 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f000c0a1c90 con 0x7f000c09c790 2023-09-30T22:19:07.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.737+0000 7f0002ffd700 1 -- 172.21.15.156:0/4188571773 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0008003a20 con 0x7f000c09c790 2023-09-30T22:19:07.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.737+0000 7f0002ffd700 1 -- 172.21.15.156:0/4188571773 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f000803ee90 con 0x7f000c09c790 2023-09-30T22:19:07.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.737+0000 7f0012533700 1 -- 172.21.15.156:0/4188571773 >> v1:172.21.15.156:6816/126965 conn(0x7efff002f510 legacy=0x7efff00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:07.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.737+0000 7f0014797700 1 -- 172.21.15.156:0/4188571773 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f000c122f80 con 0x7f000c09c790 2023-09-30T22:19:07.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.742+0000 7f0002ffd700 1 -- 172.21.15.156:0/4188571773 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f000806a750 con 0x7f000c09c790 2023-09-30T22:19:07.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.927+0000 7f0014797700 1 -- 172.21.15.156:0/4188571773 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f000c04f2a0 con 0x7f000c09c790 2023-09-30T22:19:07.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.928+0000 7f0002ffd700 1 -- 172.21.15.156:0/4188571773 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+13044 (secure 0 0 0) 0x7f0008019d20 con 0x7f000c09c790 2023-09-30T22:19:07.929 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:19:07.929 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":38,"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","created":"2023-09-30T22:16:15.239992+0000","modified":"2023-09-30T22:19:06.862323+0000","last_up_change":"2023-09-30T22:18:55.822352+0000","last_in_change":"2023-09-30T22:16:16.474206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:16:23.433906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:16:24.367795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:16:28.204677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:16:28.762804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ec2e78a-c61f-473a-bfcb-f956cffe4095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6803","nonce":129485}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6805","nonce":129485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6807","nonce":129485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6806","nonce":129485}]},"public_addr":"172.21.15.156:6803/129485","cluster_addr":"172.21.15.156:6805/129485","heartbeat_back_addr":"172.21.15.156:6807/129485","heartbeat_front_addr":"172.21.15.156:6806/129485","state":["exists","up"]},{"osd":1,"uuid":"b682e683-c15a-4bd9-8712-8af96454e9ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6808","nonce":129583}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6809","nonce":129583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6811","nonce":129583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6810","nonce":129583}]},"public_addr":"172.21.15.156:6808/129583","cluster_addr":"172.21.15.156:6809/129583","heartbeat_back_addr":"172.21.15.156:6811/129583","heartbeat_front_addr":"172.21.15.156:6810/129583","state":["exists","up"]},{"osd":2,"uuid":"960dbaf0-2e0c-437e-9114-bc22ce522b26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6800","nonce":129693}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6801","nonce":129693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6804","nonce":129693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6802","nonce":129693}]},"public_addr":"172.21.15.156:6800/129693","cluster_addr":"172.21.15.156:6801/129693","heartbeat_back_addr":"172.21.15.156:6804/129693","heartbeat_front_addr":"172.21.15.156:6802/129693","state":["exists","up"]},{"osd":3,"uuid":"c1b19714-78b1-4869-8721-2f6352a64a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6812","nonce":129849}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6813","nonce":129849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6815","nonce":129849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6814","nonce":129849}]},"public_addr":"172.21.15.156:6812/129849","cluster_addr":"172.21.15.156:6813/129849","heartbeat_back_addr":"172.21.15.156:6815/129849","heartbeat_front_addr":"172.21.15.156:6814/129849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.663343+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.827397+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.806655+0000","dead_epoch":25},{"osd":3,"down_stamp":"2023-09-30T22:18:49.807414+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.634746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.2","mappings":[{"from":3,"to":0}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.156:6816/118236":"2023-10-01T22:18:37.767496+0000","172.21.15.156:0/1464735255":"2023-10-01T22:18:37.767496+0000","172.21.15.156:6817/3817969673":"2023-10-01T22:19:00.677676+0000","172.21.15.156:0/2593263545":"2023-10-01T22:18:37.767496+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:19:07.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.930+0000 7f0014797700 1 -- 172.21.15.156:0/4188571773 >> v1:172.21.15.156:6816/126965 conn(0x7efff002f510 legacy=0x7efff00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:07.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.930+0000 7f0014797700 1 -- 172.21.15.156:0/4188571773 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f000c09c790 msgr2=0x7f000c099fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:07.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.930+0000 7f0014797700 1 --2- 172.21.15.156:0/4188571773 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f000c09c790 0x7f000c099fd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0008000f60 tx=0x7f000800c730 comp rx=0 tx=0).stop 2023-09-30T22:19:07.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.930+0000 7f0014797700 1 -- 172.21.15.156:0/4188571773 shutdown_connections 2023-09-30T22:19:07.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.930+0000 7f0014797700 1 --2- 172.21.15.156:0/4188571773 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f000c131980 0x7f000c09a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:07.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.930+0000 7f0014797700 1 --2- 172.21.15.156:0/4188571773 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f000c09bc70 0x7f000c099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:07.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.930+0000 7f0014797700 1 --2- 172.21.15.156:0/4188571773 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f000c09c790 0x7f000c099fd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:07.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.930+0000 7f0014797700 1 -- 172.21.15.156:0/4188571773 >> 172.21.15.156:0/4188571773 conn(0x7f000c0a2980 msgr2=0x7f000c09f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:07.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.930+0000 7f0014797700 1 -- 172.21.15.156:0/4188571773 shutdown_connections 2023-09-30T22:19:07.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:07.930+0000 7f0014797700 1 -- 172.21.15.156:0/4188571773 wait complete. 2023-09-30T22:19:07.943 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-30T22:19:07.944 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-30T22:19:07.944 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-30T22:19:07.944 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-09-30T22:19:08.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.075+0000 7faddf422700 1 Processor -- start 2023-09-30T22:19:08.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.075+0000 7ff37e01a700 1 Processor -- start 2023-09-30T22:19:08.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.075+0000 7faddf422700 1 -- start start 2023-09-30T22:19:08.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.075+0000 7ff37e01a700 1 -- start start 2023-09-30T22:19:08.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.076+0000 7faddf422700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fadd80a0a90 0x7fadd80a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.076+0000 7faddf422700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fadd8134140 0x7fadd813bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.076+0000 7faddf422700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd80a1fe0 con 0x7fadd80a13a0 2023-09-30T22:19:08.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.076+0000 7faddf422700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd80a3aa0 con 0x7fadd8134140 2023-09-30T22:19:08.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.076+0000 7faddf422700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fadd809a540 con 0x7fadd80a0a90 2023-09-30T22:19:08.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.076+0000 7faddd1be700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fadd80a0a90 0x7fadd80a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.076+0000 7faddd1be700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fadd80a0a90 0x7fadd80a0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45326/0 (socket says 172.21.15.156:45326) 2023-09-30T22:19:08.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.076+0000 7faddd1be700 1 -- 172.21.15.156:0/2751101027 learned_addr learned my addr 172.21.15.156:0/2751101027 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:08.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.076+0000 7ff37e01a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff37809ad40 0x7ff378133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.076+0000 7ff37e01a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff378133f70 0x7ff3781343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.076+0000 7ff37e01a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff37809b110 con 0x7ff3780a0a70 2023-09-30T22:19:08.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.076+0000 7ff37e01a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3780a3b60 con 0x7ff378133f70 2023-09-30T22:19:08.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.076+0000 7ff37e01a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3781348e0 con 0x7ff37809ad40 2023-09-30T22:19:08.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.076+0000 7ff376ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff378133f70 0x7ff3781343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.076+0000 7ff377fff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff3780a0a70 0x7ff3780a0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:33908/0 (socket says 172.21.15.156:33908) 2023-09-30T22:19:08.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.076+0000 7ff377fff700 1 -- 172.21.15.156:0/2678511068 learned_addr learned my addr 172.21.15.156:0/2678511068 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:08.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.076+0000 7faddd1be700 1 -- 172.21.15.156:0/2751101027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fadd8134140 msgr2=0x7fadd813bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:08.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.076+0000 7faddd1be700 1 --2- 172.21.15.156:0/2751101027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fadd8134140 0x7fadd813bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.076+0000 7faddd1be700 1 -- 172.21.15.156:0/2751101027 >> v1:172.21.15.156:6789/0 conn(0x7fadd80a13a0 legacy=0x7fadd8133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.076+0000 7faddd1be700 1 -- 172.21.15.156:0/2751101027 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd809a280 con 0x7fadd80a0a90 2023-09-30T22:19:08.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.077+0000 7ff3767fc700 1 -- 172.21.15.156:0/2678511068 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3885189818 0 0) 0x7ff37809b110 con 0x7ff3780a0a70 2023-09-30T22:19:08.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.077+0000 7ff3767fc700 1 -- 172.21.15.156:0/2678511068 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3600035b0 con 0x7ff3780a0a70 2023-09-30T22:19:08.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.077+0000 7ff3777fe700 1 --2- 172.21.15.156:0/2678511068 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff37809ad40 0x7ff378133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.077+0000 7ff376ffd700 1 -- 172.21.15.156:0/2678511068 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff37809ad40 msgr2=0x7ff378133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:08.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.077+0000 7ff376ffd700 1 --2- 172.21.15.156:0/2678511068 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff37809ad40 0x7ff378133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.077+0000 7ff376ffd700 1 -- 172.21.15.156:0/2678511068 >> v1:172.21.15.156:6789/0 conn(0x7ff3780a0a70 legacy=0x7ff3780a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.077+0000 7ff376ffd700 1 -- 172.21.15.156:0/2678511068 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3780a2fa0 con 0x7ff378133f70 2023-09-30T22:19:08.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.077+0000 7faddd1be700 1 --2- 172.21.15.156:0/2751101027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fadd80a0a90 0x7fadd80a0e60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fadd4009920 tx=0x7fadd4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a194cf5f5b244164 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:08.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.077+0000 7fadcffff700 1 -- 172.21.15.156:0/2751101027 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd400ba60 con 0x7fadd80a0a90 2023-09-30T22:19:08.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.077+0000 7fadcffff700 1 -- 172.21.15.156:0/2751101027 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd400bbc0 con 0x7fadd80a0a90 2023-09-30T22:19:08.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.077+0000 7fadcffff700 1 -- 172.21.15.156:0/2751101027 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd4009e70 con 0x7fadd80a0a90 2023-09-30T22:19:08.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.077+0000 7ff376ffd700 1 --2- 172.21.15.156:0/2678511068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff378133f70 0x7ff3781343a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff36c009840 tx=0x7ff36c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfcf42b0810cac1b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:08.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.077+0000 7ff3767fc700 1 -- 172.21.15.156:0/2678511068 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c011830 con 0x7ff378133f70 2023-09-30T22:19:08.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.077+0000 7ff3767fc700 1 -- 172.21.15.156:0/2678511068 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36c011990 con 0x7ff378133f70 2023-09-30T22:19:08.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.077+0000 7ff3767fc700 1 -- 172.21.15.156:0/2678511068 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c011d20 con 0x7ff378133f70 2023-09-30T22:19:08.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.078+0000 7faddf422700 1 -- 172.21.15.156:0/2751101027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fadd80a0a90 msgr2=0x7fadd80a0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.078+0000 7faddf422700 1 --2- 172.21.15.156:0/2751101027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fadd80a0a90 0x7fadd80a0e60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fadd4009920 tx=0x7fadd4009c30 comp rx=0 tx=0).stop 2023-09-30T22:19:08.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.078+0000 7faddf422700 1 -- 172.21.15.156:0/2751101027 shutdown_connections 2023-09-30T22:19:08.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.078+0000 7faddf422700 1 --2- 172.21.15.156:0/2751101027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fadd8134140 0x7fadd813bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.078+0000 7faddf422700 1 --2- 172.21.15.156:0/2751101027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fadd80a0a90 0x7fadd80a0e60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.078+0000 7faddf422700 1 -- 172.21.15.156:0/2751101027 >> 172.21.15.156:0/2751101027 conn(0x7fadd8099c40 msgr2=0x7fadd806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:08.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.078+0000 7faddf422700 1 -- 172.21.15.156:0/2751101027 shutdown_connections 2023-09-30T22:19:08.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.078+0000 7faddf422700 1 -- 172.21.15.156:0/2751101027 wait complete. 2023-09-30T22:19:08.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.078+0000 7ff37e01a700 1 -- 172.21.15.156:0/2678511068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff378133f70 msgr2=0x7ff3781343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.078+0000 7ff37e01a700 1 --2- 172.21.15.156:0/2678511068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff378133f70 0x7ff3781343a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff36c009840 tx=0x7ff36c009b50 comp rx=0 tx=0).stop 2023-09-30T22:19:08.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.078+0000 7ff37e01a700 1 -- 172.21.15.156:0/2678511068 shutdown_connections 2023-09-30T22:19:08.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.078+0000 7ff37e01a700 1 --2- 172.21.15.156:0/2678511068 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff37809ad40 0x7ff378133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.078+0000 7ff37e01a700 1 --2- 172.21.15.156:0/2678511068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff378133f70 0x7ff3781343a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.078+0000 7ff37e01a700 1 -- 172.21.15.156:0/2678511068 >> 172.21.15.156:0/2678511068 conn(0x7ff378099c40 msgr2=0x7ff37806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:08.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.078+0000 7ff37e01a700 1 -- 172.21.15.156:0/2678511068 shutdown_connections 2023-09-30T22:19:08.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.078+0000 7ff37e01a700 1 -- 172.21.15.156:0/2678511068 wait complete. 2023-09-30T22:19:08.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.079+0000 7faddf422700 1 Processor -- start 2023-09-30T22:19:08.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.079+0000 7ff37e01a700 1 Processor -- start 2023-09-30T22:19:08.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.079+0000 7faddf422700 1 -- start start 2023-09-30T22:19:08.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.080+0000 7ff37e01a700 1 -- start start 2023-09-30T22:19:08.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.080+0000 7faddf422700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fadd80a0a90 0x7fadd8122470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.080+0000 7faddf422700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fadd80a13a0 0x7fadd81229b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.080+0000 7faddf422700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fadd8134140 0x7fadd8122ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.080+0000 7faddf422700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd8125f00 con 0x7fadd80a0a90 2023-09-30T22:19:08.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.080+0000 7faddf422700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd81259f0 con 0x7fadd80a13a0 2023-09-30T22:19:08.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.080+0000 7faddf422700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fadd8124e80 con 0x7fadd8134140 2023-09-30T22:19:08.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.080+0000 7ff37e01a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff37809ad40 0x7ff3781c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.080+0000 7ff37e01a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff3780a0a70 0x7ff3781c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.080+0000 7ff37e01a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff378133f70 0x7ff3781c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.080+0000 7ff37e01a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff378122200 con 0x7ff37809ad40 2023-09-30T22:19:08.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.080+0000 7ff37e01a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3781206e0 con 0x7ff3780a0a70 2023-09-30T22:19:08.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.080+0000 7ff37e01a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff378133520 con 0x7ff378133f70 2023-09-30T22:19:08.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.080+0000 7ff3777fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff37809ad40 0x7ff3781c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.080+0000 7ff3777fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff37809ad40 0x7ff3781c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58842/0 (socket says 172.21.15.156:58842) 2023-09-30T22:19:08.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.080+0000 7ff3777fe700 1 -- 172.21.15.156:0/2684065292 learned_addr learned my addr 172.21.15.156:0/2684065292 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:08.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.080+0000 7ff376ffd700 1 --2- 172.21.15.156:0/2684065292 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff3780a0a70 0x7ff3781c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.080+0000 7faddd1be700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fadd80a0a90 0x7fadd8122470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.080+0000 7faddd9bf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fadd8134140 0x7fadd8122ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.080+0000 7faddd1be700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fadd80a0a90 0x7fadd8122470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58834/0 (socket says 172.21.15.156:58834) 2023-09-30T22:19:08.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.080+0000 7faddd1be700 1 -- 172.21.15.156:0/1879049316 learned_addr learned my addr 172.21.15.156:0/1879049316 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:08.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.080+0000 7faddc9bd700 1 --2- 172.21.15.156:0/1879049316 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fadd80a13a0 0x7fadd81229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.081+0000 7ff376ffd700 1 -- 172.21.15.156:0/2684065292 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff378133f70 msgr2=0x7ff3781c8c10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:08.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.081+0000 7ff376ffd700 1 --2- 172.21.15.156:0/2684065292 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff378133f70 0x7ff3781c8c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.081+0000 7ff376ffd700 1 -- 172.21.15.156:0/2684065292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff37809ad40 msgr2=0x7ff3781c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.081+0000 7ff376ffd700 1 --2- 172.21.15.156:0/2684065292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff37809ad40 0x7ff3781c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.081+0000 7ff376ffd700 1 -- 172.21.15.156:0/2684065292 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c0094a0 con 0x7ff3780a0a70 2023-09-30T22:19:08.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.081+0000 7faddd9bf700 1 -- 172.21.15.156:0/1879049316 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fadd80a13a0 msgr2=0x7fadd81229b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.081+0000 7faddd9bf700 1 --2- 172.21.15.156:0/1879049316 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fadd80a13a0 0x7fadd81229b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.081+0000 7faddd9bf700 1 -- 172.21.15.156:0/1879049316 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fadd80a0a90 msgr2=0x7fadd8122470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.081+0000 7faddd9bf700 1 --2- 172.21.15.156:0/1879049316 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fadd80a0a90 0x7fadd8122470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.081+0000 7faddd9bf700 1 -- 172.21.15.156:0/1879049316 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd4009550 con 0x7fadd8134140 2023-09-30T22:19:08.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.081+0000 7faddd9bf700 1 --2- 172.21.15.156:0/1879049316 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fadd8134140 0x7fadd8122ef0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fadd000be20 tx=0x7fadd0009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:08.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.081+0000 7ff376ffd700 1 --2- 172.21.15.156:0/2684065292 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff3780a0a70 0x7ff3781c86d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff37806bec0 tx=0x7ff36c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:08.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.081+0000 7fadcdffb700 1 -- 172.21.15.156:0/1879049316 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd000cb90 con 0x7fadd8134140 2023-09-30T22:19:08.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.081+0000 7ff35ffff700 1 -- 172.21.15.156:0/2684065292 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c004480 con 0x7ff3780a0a70 2023-09-30T22:19:08.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.081+0000 7fadcdffb700 1 -- 172.21.15.156:0/1879049316 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd000cd10 con 0x7fadd8134140 2023-09-30T22:19:08.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.081+0000 7faddf422700 1 -- 172.21.15.156:0/1879049316 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd809c7e0 con 0x7fadd8134140 2023-09-30T22:19:08.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.081+0000 7fadcdffb700 1 -- 172.21.15.156:0/1879049316 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd0014680 con 0x7fadd8134140 2023-09-30T22:19:08.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.081+0000 7ff35ffff700 1 -- 172.21.15.156:0/2684065292 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36c01f070 con 0x7ff3780a0a70 2023-09-30T22:19:08.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.081+0000 7ff37e01a700 1 -- 172.21.15.156:0/2684065292 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff378121f40 con 0x7ff3780a0a70 2023-09-30T22:19:08.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.081+0000 7ff35ffff700 1 -- 172.21.15.156:0/2684065292 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c0038c0 con 0x7ff3780a0a70 2023-09-30T22:19:08.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.081+0000 7ff37e01a700 1 -- 172.21.15.156:0/2684065292 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff378120dc0 con 0x7ff3780a0a70 2023-09-30T22:19:08.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.082+0000 7faddf422700 1 -- 172.21.15.156:0/1879049316 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd81256e0 con 0x7fadd8134140 2023-09-30T22:19:08.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.082+0000 7ff35ffff700 1 -- 172.21.15.156:0/2684065292 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff36c021030 con 0x7ff3780a0a70 2023-09-30T22:19:08.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.082+0000 7ff3777fe700 1 -- 172.21.15.156:0/2684065292 >> v1:172.21.15.156:6816/126965 conn(0x7ff36402f510 legacy=0x7ff3640319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:08.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.082+0000 7ff35ffff700 1 -- 172.21.15.156:0/2684065292 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7ff36c040e90 con 0x7ff3780a0a70 2023-09-30T22:19:08.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.083+0000 7ff37e01a700 1 -- 172.21.15.156:0/2684065292 --> v1:172.21.15.156:6803/129485 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff358005390 con 0x7ff3580015b0 2023-09-30T22:19:08.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.083+0000 7faddf422700 1 -- 172.21.15.156:0/1879049316 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fadd80a17d0 con 0x7fadd8134140 2023-09-30T22:19:08.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.084+0000 7fadcdffb700 1 -- 172.21.15.156:0/1879049316 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fadd001d3b0 con 0x7fadd8134140 2023-09-30T22:19:08.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.084+0000 7ff35ffff700 1 -- 172.21.15.156:0/2684065292 <== osd.0 v1:172.21.15.156:6803/129485 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7ff358005390 con 0x7ff3580015b0 2023-09-30T22:19:08.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.084+0000 7fadcdffb700 1 -- 172.21.15.156:0/1879049316 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fadd0006e40 con 0x7fadd8134140 2023-09-30T22:19:08.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.084+0000 7faddd1be700 1 -- 172.21.15.156:0/1879049316 >> v1:172.21.15.156:6816/126965 conn(0x7fadbc02f510 legacy=0x7fadbc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:08.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.084+0000 7fadcdffb700 1 -- 172.21.15.156:0/1879049316 --> v1:172.21.15.156:6808/129583 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fadbc03c360 con 0x7fadbc038660 2023-09-30T22:19:08.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.084+0000 7fadcdffb700 1 -- 172.21.15.156:0/1879049316 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fadd00404b0 con 0x7fadd8134140 2023-09-30T22:19:08.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.085+0000 7fb1bc03e700 1 Processor -- start 2023-09-30T22:19:08.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.085+0000 7fb1bc03e700 1 -- start start 2023-09-30T22:19:08.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.086+0000 7fadcdffb700 1 -- 172.21.15.156:0/1879049316 <== osd.1 v1:172.21.15.156:6808/129583 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7fadbc03c360 con 0x7fadbc038660 2023-09-30T22:19:08.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.086+0000 7fc3e3421700 1 Processor -- start 2023-09-30T22:19:08.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.086+0000 7fb1bc03e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb1b409d860 0x7fb1b409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.086+0000 7fb1bc03e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb1b409e170 0x7fb1b41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.086+0000 7fb1bc03e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b409aaa0 con 0x7fb1b4130ce0 2023-09-30T22:19:08.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.086+0000 7fb1bc03e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b409f870 con 0x7fb1b409d860 2023-09-30T22:19:08.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.086+0000 7fb1bc03e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b409b360 con 0x7fb1b409e170 2023-09-30T22:19:08.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.086+0000 7fb1b95d9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb1b409e170 0x7fb1b41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.086+0000 7fb1b95d9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb1b409e170 0x7fb1b41307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45358/0 (socket says 172.21.15.156:45358) 2023-09-30T22:19:08.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.086+0000 7fb1b95d9700 1 -- 172.21.15.156:0/2180497880 learned_addr learned my addr 172.21.15.156:0/2180497880 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:08.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.086+0000 7fc3e3421700 1 -- start start 2023-09-30T22:19:08.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.087+0000 7fb1b9dda700 1 --2- 172.21.15.156:0/2180497880 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb1b409d860 0x7fb1b409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.087+0000 7fb1b8dd8700 1 -- 172.21.15.156:0/2180497880 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 940566589 0 0) 0x7fb1b409aaa0 con 0x7fb1b4130ce0 2023-09-30T22:19:08.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.087+0000 7fb1b8dd8700 1 -- 172.21.15.156:0/2180497880 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1a00035b0 con 0x7fb1b4130ce0 2023-09-30T22:19:08.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.087+0000 7fb1b95d9700 1 -- 172.21.15.156:0/2180497880 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb1b409d860 msgr2=0x7fb1b409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:08.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.087+0000 7fb1b95d9700 1 --2- 172.21.15.156:0/2180497880 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb1b409d860 0x7fb1b409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.087+0000 7fb1b95d9700 1 -- 172.21.15.156:0/2180497880 >> v1:172.21.15.156:6789/0 conn(0x7fb1b4130ce0 legacy=0x7fb1b41379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.087+0000 7fb1b95d9700 1 -- 172.21.15.156:0/2180497880 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b409b620 con 0x7fb1b409e170 2023-09-30T22:19:08.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.087+0000 7fb1b95d9700 1 --2- 172.21.15.156:0/2180497880 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb1b409e170 0x7fb1b41307a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4009920 tx=0x7fb1a4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c1d2dabaecfad37 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:08.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.087+0000 7fc3e3421700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3dc133900 0x7fc3dc133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.087+0000 7fc3e3421700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc3dc134210 0x7fc3dc0a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.087+0000 7fc3e3421700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3dc0a0ee0 0x7fc3dc0a1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.087+0000 7fc3e3421700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3dc09a760 con 0x7fc3dc134210 2023-09-30T22:19:08.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.087+0000 7fc3e3421700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc1336e0 con 0x7fc3dc133900 2023-09-30T22:19:08.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.087+0000 7fc3e3421700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc09a080 con 0x7fc3dc0a0ee0 2023-09-30T22:19:08.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.087+0000 7fc3e11bd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3dc133900 0x7fc3dc133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.087+0000 7fc3e11bd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3dc133900 0x7fc3dc133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48478/0 (socket says 172.21.15.156:48478) 2023-09-30T22:19:08.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.087+0000 7fc3e11bd700 1 -- 172.21.15.156:0/3790827176 learned_addr learned my addr 172.21.15.156:0/3790827176 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:08.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.087+0000 7fc3e09bc700 1 --2- 172.21.15.156:0/3790827176 >> v2:172.21.15.156:3300/0 conn(0x7fc3dc134210 0x7fc3dc0a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.087+0000 7fc3e19be700 1 --2- 172.21.15.156:0/3790827176 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3dc0a0ee0 0x7fc3dc0a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.087+0000 7fc3e11bd700 1 -- 172.21.15.156:0/3790827176 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3dc0a0ee0 msgr2=0x7fc3dc0a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:08.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.087+0000 7fc3e11bd700 1 --2- 172.21.15.156:0/3790827176 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3dc0a0ee0 0x7fc3dc0a1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.087+0000 7fc3e11bd700 1 -- 172.21.15.156:0/3790827176 >> v2:172.21.15.156:3300/0 conn(0x7fc3dc134210 msgr2=0x7fc3dc0a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:08.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.087+0000 7fc3e11bd700 1 --2- 172.21.15.156:0/3790827176 >> v2:172.21.15.156:3300/0 conn(0x7fc3dc134210 0x7fc3dc0a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.087+0000 7fc3e11bd700 1 -- 172.21.15.156:0/3790827176 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3dc0a23e0 con 0x7fc3dc133900 2023-09-30T22:19:08.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.087+0000 7fc3e19be700 1 --2- 172.21.15.156:0/3790827176 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3dc0a0ee0 0x7fc3dc0a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:19:08.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.088+0000 7fc3e11bd700 1 --2- 172.21.15.156:0/3790827176 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3dc133900 0x7fc3dc133cd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8006fd0 tx=0x7fc3d8009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fee9152af559887 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:08.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.088+0000 7fc3d3fff700 1 -- 172.21.15.156:0/3790827176 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8005e30 con 0x7fc3dc133900 2023-09-30T22:19:08.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.088+0000 7fc3d3fff700 1 -- 172.21.15.156:0/3790827176 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d8004030 con 0x7fc3dc133900 2023-09-30T22:19:08.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.088+0000 7fc3d3fff700 1 -- 172.21.15.156:0/3790827176 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d80043e0 con 0x7fc3dc133900 2023-09-30T22:19:08.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.088+0000 7fc3e3421700 1 -- 172.21.15.156:0/3790827176 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3dc133900 msgr2=0x7fc3dc133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.088+0000 7fc3e3421700 1 --2- 172.21.15.156:0/3790827176 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3dc133900 0x7fc3dc133cd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8006fd0 tx=0x7fc3d8009bd0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.089+0000 7fc3e3421700 1 -- 172.21.15.156:0/3790827176 shutdown_connections 2023-09-30T22:19:08.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.089+0000 7fc3e3421700 1 --2- 172.21.15.156:0/3790827176 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3dc0a0ee0 0x7fc3dc0a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.089+0000 7fc3e3421700 1 --2- 172.21.15.156:0/3790827176 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3dc133900 0x7fc3dc133cd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.089+0000 7fc3e3421700 1 --2- 172.21.15.156:0/3790827176 >> v2:172.21.15.156:3300/0 conn(0x7fc3dc134210 0x7fc3dc0a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.089+0000 7fc3e3421700 1 -- 172.21.15.156:0/3790827176 >> 172.21.15.156:0/3790827176 conn(0x7fc3dc0a2980 msgr2=0x7fc3dc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:08.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.089+0000 7fc3e3421700 1 -- 172.21.15.156:0/3790827176 shutdown_connections 2023-09-30T22:19:08.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.089+0000 7fc3e3421700 1 -- 172.21.15.156:0/3790827176 wait complete. 2023-09-30T22:19:08.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.089+0000 7fc3e3421700 1 Processor -- start 2023-09-30T22:19:08.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.090+0000 7fc3e3421700 1 -- start start 2023-09-30T22:19:08.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.090+0000 7fc3e3421700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3dc0a0ee0 0x7fc3dc11c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.090+0000 7fc3e3421700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3dc133900 0x7fc3dc11cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.090+0000 7fc3e3421700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3dc134210 0x7fc3dc11d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.090+0000 7fc3e3421700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc11db60 con 0x7fc3dc133900 2023-09-30T22:19:08.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.090+0000 7fc3e3421700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc11e2c0 con 0x7fc3dc134210 2023-09-30T22:19:08.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.090+0000 7fc3e3421700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc11f510 con 0x7fc3dc0a0ee0 2023-09-30T22:19:08.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.090+0000 7fc3e09bc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3dc133900 0x7fc3dc11cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.090+0000 7fc3e09bc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3dc133900 0x7fc3dc11cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58860/0 (socket says 172.21.15.156:58860) 2023-09-30T22:19:08.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.090+0000 7fc3e09bc700 1 -- 172.21.15.156:0/3589063976 learned_addr learned my addr 172.21.15.156:0/3589063976 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:08.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.090+0000 7fc3e11bd700 1 --2- 172.21.15.156:0/3589063976 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3dc0a0ee0 0x7fc3dc11c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.090+0000 7fc3e19be700 1 --2- 172.21.15.156:0/3589063976 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3dc134210 0x7fc3dc11d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.090+0000 7fc3e09bc700 1 -- 172.21.15.156:0/3589063976 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3dc0a0ee0 msgr2=0x7fc3dc11c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.090+0000 7fc3e09bc700 1 --2- 172.21.15.156:0/3589063976 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3dc0a0ee0 0x7fc3dc11c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.090+0000 7fc3e09bc700 1 -- 172.21.15.156:0/3589063976 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3dc134210 msgr2=0x7fc3dc11d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.090+0000 7fc3e09bc700 1 --2- 172.21.15.156:0/3589063976 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3dc134210 0x7fc3dc11d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.090+0000 7fc3e09bc700 1 -- 172.21.15.156:0/3589063976 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d8009500 con 0x7fc3dc133900 2023-09-30T22:19:08.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.090+0000 7fc3e11bd700 1 --2- 172.21.15.156:0/3589063976 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3dc0a0ee0 0x7fc3dc11c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:08.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.091+0000 7fc3e09bc700 1 --2- 172.21.15.156:0/3589063976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3dc133900 0x7fc3dc11cbf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00e9b0 tx=0x7fc3cc00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:08.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.091+0000 7fc3d1ffb700 1 -- 172.21.15.156:0/3589063976 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc009710 con 0x7fc3dc133900 2023-09-30T22:19:08.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.091+0000 7fc3d1ffb700 1 -- 172.21.15.156:0/3589063976 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3cc00ee50 con 0x7fc3dc133900 2023-09-30T22:19:08.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.091+0000 7fc3e3421700 1 -- 172.21.15.156:0/3589063976 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3dc11fef0 con 0x7fc3dc133900 2023-09-30T22:19:08.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.091+0000 7fc3d1ffb700 1 -- 172.21.15.156:0/3589063976 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc00ca70 con 0x7fc3dc133900 2023-09-30T22:19:08.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.091+0000 7fc3e3421700 1 -- 172.21.15.156:0/3589063976 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3dc09a2c0 con 0x7fc3dc133900 2023-09-30T22:19:08.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.092+0000 7fc3e3421700 1 -- 172.21.15.156:0/3589063976 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc3dc066680 con 0x7fc3dc133900 2023-09-30T22:19:08.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.092+0000 7fc3d1ffb700 1 -- 172.21.15.156:0/3589063976 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc3cc00cbd0 con 0x7fc3dc133900 2023-09-30T22:19:08.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.092+0000 7fc3d1ffb700 1 -- 172.21.15.156:0/3589063976 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fc3cc03fba0 con 0x7fc3dc133900 2023-09-30T22:19:08.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.092+0000 7fc3e11bd700 1 -- 172.21.15.156:0/3589063976 >> v1:172.21.15.156:6816/126965 conn(0x7fc3c002f510 legacy=0x7fc3c00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:08.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.092+0000 7fc3d1ffb700 1 -- 172.21.15.156:0/3589063976 --> v1:172.21.15.156:6812/129849 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc3c003c360 con 0x7fc3c0038660 2023-09-30T22:19:08.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.092+0000 7fc3d1ffb700 1 -- 172.21.15.156:0/3589063976 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3cc0442c0 con 0x7fc3dc133900 2023-09-30T22:19:08.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.093+0000 7fc3d1ffb700 1 -- 172.21.15.156:0/3589063976 <== osd.3 v1:172.21.15.156:6812/129849 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7fc3d4015220 con 0x7fc3c0038660 2023-09-30T22:19:08.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.093+0000 7fb1b8dd8700 1 -- 172.21.15.156:0/2180497880 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4011830 con 0x7fb1b409e170 2023-09-30T22:19:08.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.093+0000 7fb1b8dd8700 1 -- 172.21.15.156:0/2180497880 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a4011990 con 0x7fb1b409e170 2023-09-30T22:19:08.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.093+0000 7fb1b8dd8700 1 -- 172.21.15.156:0/2180497880 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4011d20 con 0x7fb1b409e170 2023-09-30T22:19:08.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.094+0000 7fb1bc03e700 1 -- 172.21.15.156:0/2180497880 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb1b409e170 msgr2=0x7fb1b41307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.094+0000 7fb1bc03e700 1 --2- 172.21.15.156:0/2180497880 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb1b409e170 0x7fb1b41307a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4009920 tx=0x7fb1a4009c30 comp rx=0 tx=0).stop 2023-09-30T22:19:08.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.094+0000 7fb1bc03e700 1 -- 172.21.15.156:0/2180497880 shutdown_connections 2023-09-30T22:19:08.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.094+0000 7fb1bc03e700 1 --2- 172.21.15.156:0/2180497880 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb1b409d860 0x7fb1b409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.094+0000 7fb1bc03e700 1 --2- 172.21.15.156:0/2180497880 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb1b409e170 0x7fb1b41307a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.094+0000 7fb1bc03e700 1 -- 172.21.15.156:0/2180497880 >> 172.21.15.156:0/2180497880 conn(0x7fb1b4099c40 msgr2=0x7fb1b40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:08.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.094+0000 7fb1bc03e700 1 -- 172.21.15.156:0/2180497880 shutdown_connections 2023-09-30T22:19:08.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.094+0000 7fb1bc03e700 1 -- 172.21.15.156:0/2180497880 wait complete. 2023-09-30T22:19:08.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.095+0000 7fb1bc03e700 1 Processor -- start 2023-09-30T22:19:08.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.096+0000 7fb1bc03e700 1 -- start start 2023-09-30T22:19:08.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.096+0000 7fb1bc03e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb1b409d860 0x7fb1b41d4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.096+0000 7fb1bc03e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb1b409e170 0x7fb1b41d52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.096+0000 7fb1bc03e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb1b4130ce0 0x7fb1b41d57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.096+0000 7fb1bc03e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b40728d0 con 0x7fb1b409d860 2023-09-30T22:19:08.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.096+0000 7fb1bc03e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b409c8b0 con 0x7fb1b409e170 2023-09-30T22:19:08.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.096+0000 7fb1bc03e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b41b7ad0 con 0x7fb1b4130ce0 2023-09-30T22:19:08.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.096+0000 7fb1ba5db700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb1b4130ce0 0x7fb1b41d57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.096+0000 7fb1b95d9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb1b409e170 0x7fb1b41d52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.096+0000 7fb1ba5db700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb1b4130ce0 0x7fb1b41d57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45378/0 (socket says 172.21.15.156:45378) 2023-09-30T22:19:08.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.096+0000 7fb1b95d9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb1b409e170 0x7fb1b41d52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48486/0 (socket says 172.21.15.156:48486) 2023-09-30T22:19:08.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.096+0000 7fb1ba5db700 1 -- 172.21.15.156:0/3927548021 learned_addr learned my addr 172.21.15.156:0/3927548021 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:08.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.096+0000 7fb1b9dda700 1 --2- 172.21.15.156:0/3927548021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb1b409d860 0x7fb1b41d4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.097+0000 7fb1ba5db700 1 -- 172.21.15.156:0/3927548021 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb1b409e170 msgr2=0x7fb1b41d52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.097+0000 7fb1ba5db700 1 --2- 172.21.15.156:0/3927548021 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb1b409e170 0x7fb1b41d52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.097+0000 7fb1ba5db700 1 -- 172.21.15.156:0/3927548021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb1b409d860 msgr2=0x7fb1b41d4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.097+0000 7fb1ba5db700 1 --2- 172.21.15.156:0/3927548021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb1b409d860 0x7fb1b41d4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.097+0000 7fb1ba5db700 1 -- 172.21.15.156:0/3927548021 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a4009550 con 0x7fb1b4130ce0 2023-09-30T22:19:08.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.097+0000 7fb1ba5db700 1 --2- 172.21.15.156:0/3927548021 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb1b4130ce0 0x7fb1b41d57e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00cc50 tx=0x7fb1ac00cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:08.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.097+0000 7fb1aa7fc700 1 -- 172.21.15.156:0/3927548021 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac003c00 con 0x7fb1b4130ce0 2023-09-30T22:19:08.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.097+0000 7fb1aa7fc700 1 -- 172.21.15.156:0/3927548021 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ac003d60 con 0x7fb1b4130ce0 2023-09-30T22:19:08.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.097+0000 7fb1bc03e700 1 -- 172.21.15.156:0/3927548021 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b412f760 con 0x7fb1b4130ce0 2023-09-30T22:19:08.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.097+0000 7fb1bc03e700 1 -- 172.21.15.156:0/3927548021 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b41300f0 con 0x7fb1b4130ce0 2023-09-30T22:19:08.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.098+0000 7fb1aa7fc700 1 -- 172.21.15.156:0/3927548021 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac00ab80 con 0x7fb1b4130ce0 2023-09-30T22:19:08.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.098+0000 7fb1aa7fc700 1 -- 172.21.15.156:0/3927548021 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb1ac0050d0 con 0x7fb1b4130ce0 2023-09-30T22:19:08.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.098+0000 7fb1aa7fc700 1 -- 172.21.15.156:0/3927548021 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fb1ac03fc10 con 0x7fb1b4130ce0 2023-09-30T22:19:08.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.098+0000 7fb1b9dda700 1 -- 172.21.15.156:0/3927548021 >> v1:172.21.15.156:6816/126965 conn(0x7fb19802f560 legacy=0x7fb198031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:08.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.098+0000 7fb1bc03e700 1 -- 172.21.15.156:0/3927548021 --> v1:172.21.15.156:6800/129693 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb19c005390 con 0x7fb19c0015b0 2023-09-30T22:19:08.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.100+0000 7fb1aa7fc700 1 -- 172.21.15.156:0/3927548021 <== osd.2 v1:172.21.15.156:6800/129693 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7fb19c005390 con 0x7fb19c0015b0 2023-09-30T22:19:08.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.110+0000 7fc3e3421700 1 -- 172.21.15.156:0/3589063976 --> v1:172.21.15.156:6812/129849 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc3dc04f2a0 con 0x7fc3c0038660 2023-09-30T22:19:08.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.110+0000 7fc3d1ffb700 1 -- 172.21.15.156:0/3589063976 <== osd.3 v1:172.21.15.156:6812/129849 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 1985872850) 0x7fc3dc04f2a0 con 0x7fc3c0038660 2023-09-30T22:19:08.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.111+0000 7fc3e3421700 1 -- 172.21.15.156:0/3589063976 >> v1:172.21.15.156:6812/129849 conn(0x7fc3c0038660 legacy=0x7fc3c003aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.111+0000 7fc3e3421700 1 -- 172.21.15.156:0/3589063976 >> v1:172.21.15.156:6816/126965 conn(0x7fc3c002f510 legacy=0x7fc3c00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:08.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.111+0000 7fc3e3421700 1 -- 172.21.15.156:0/3589063976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3dc133900 msgr2=0x7fc3dc11cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.111+0000 7fc3e3421700 1 --2- 172.21.15.156:0/3589063976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3dc133900 0x7fc3dc11cbf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00e9b0 tx=0x7fc3cc00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.111+0000 7fc3e19be700 1 -- 172.21.15.156:0/3589063976 reap_dead start 2023-09-30T22:19:08.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.111+0000 7fc3e3421700 1 -- 172.21.15.156:0/3589063976 shutdown_connections 2023-09-30T22:19:08.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.111+0000 7fc3e3421700 1 -- 172.21.15.156:0/3589063976 >> 172.21.15.156:0/3589063976 conn(0x7fc3dc0a2980 msgr2=0x7fc3dc1baea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:08.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.111+0000 7fc3e3421700 1 -- 172.21.15.156:0/3589063976 shutdown_connections 2023-09-30T22:19:08.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.111+0000 7fc3e3421700 1 -- 172.21.15.156:0/3589063976 wait complete. 2023-09-30T22:19:08.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.115+0000 7ff37e01a700 1 -- 172.21.15.156:0/2684065292 --> v1:172.21.15.156:6803/129485 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff3580070f0 con 0x7ff3580015b0 2023-09-30T22:19:08.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.115+0000 7ff35ffff700 1 -- 172.21.15.156:0/2684065292 <== osd.0 v1:172.21.15.156:6803/129485 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3232526981) 0x7ff3580070f0 con 0x7ff3580015b0 2023-09-30T22:19:08.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.116+0000 7fb1bc03e700 1 -- 172.21.15.156:0/3927548021 --> v1:172.21.15.156:6800/129693 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb19c0070f0 con 0x7fb19c0015b0 2023-09-30T22:19:08.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.116+0000 7ff37e01a700 1 -- 172.21.15.156:0/2684065292 >> v1:172.21.15.156:6803/129485 conn(0x7ff3580015b0 legacy=0x7ff358003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.116+0000 7ff37e01a700 1 -- 172.21.15.156:0/2684065292 >> v1:172.21.15.156:6816/126965 conn(0x7ff36402f510 legacy=0x7ff3640319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:08.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.116+0000 7ff37e01a700 1 -- 172.21.15.156:0/2684065292 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff3780a0a70 msgr2=0x7ff3781c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.116+0000 7ff37e01a700 1 --2- 172.21.15.156:0/2684065292 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff3780a0a70 0x7ff3781c86d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff37806bec0 tx=0x7ff36c004750 comp rx=0 tx=0).stop 2023-09-30T22:19:08.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.116+0000 7ff377fff700 1 -- 172.21.15.156:0/2684065292 reap_dead start 2023-09-30T22:19:08.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.116+0000 7ff37e01a700 1 -- 172.21.15.156:0/2684065292 shutdown_connections 2023-09-30T22:19:08.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.116+0000 7ff37e01a700 1 -- 172.21.15.156:0/2684065292 >> 172.21.15.156:0/2684065292 conn(0x7ff378099c40 msgr2=0x7ff37809b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:08.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.116+0000 7fb1aa7fc700 1 -- 172.21.15.156:0/3927548021 <== osd.2 v1:172.21.15.156:6800/129693 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2085588430) 0x7fb19c0070f0 con 0x7fb19c0015b0 2023-09-30T22:19:08.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.116+0000 7ff37e01a700 1 -- 172.21.15.156:0/2684065292 shutdown_connections 2023-09-30T22:19:08.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.116+0000 7ff37e01a700 1 -- 172.21.15.156:0/2684065292 wait complete. 2023-09-30T22:19:08.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.116+0000 7fb1bc03e700 1 -- 172.21.15.156:0/3927548021 >> v1:172.21.15.156:6800/129693 conn(0x7fb19c0015b0 legacy=0x7fb19c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.117+0000 7fb1bc03e700 1 -- 172.21.15.156:0/3927548021 >> v1:172.21.15.156:6816/126965 conn(0x7fb19802f560 legacy=0x7fb198031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:08.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.117+0000 7fb1bc03e700 1 -- 172.21.15.156:0/3927548021 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb1b4130ce0 msgr2=0x7fb1b41d57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.117+0000 7fb1bc03e700 1 --2- 172.21.15.156:0/3927548021 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb1b4130ce0 0x7fb1b41d57e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00cc50 tx=0x7fb1ac00cf60 comp rx=0 tx=0).stop 2023-09-30T22:19:08.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.117+0000 7fb1ba5db700 1 -- 172.21.15.156:0/3927548021 reap_dead start 2023-09-30T22:19:08.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.117+0000 7faddf422700 1 -- 172.21.15.156:0/1879049316 --> v1:172.21.15.156:6808/129583 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fadd80a2660 con 0x7fadbc038660 2023-09-30T22:19:08.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.117+0000 7fb1bc03e700 1 -- 172.21.15.156:0/3927548021 shutdown_connections 2023-09-30T22:19:08.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.117+0000 7fb1bc03e700 1 -- 172.21.15.156:0/3927548021 >> 172.21.15.156:0/3927548021 conn(0x7fb1b4099c40 msgr2=0x7fb1b406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:08.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.117+0000 7fb1bc03e700 1 -- 172.21.15.156:0/3927548021 shutdown_connections 2023-09-30T22:19:08.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.117+0000 7fb1bc03e700 1 -- 172.21.15.156:0/3927548021 wait complete. 2023-09-30T22:19:08.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.117+0000 7fadcdffb700 1 -- 172.21.15.156:0/1879049316 <== osd.1 v1:172.21.15.156:6808/129583 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 277563570) 0x7fadc8001360 con 0x7fadbc038660 2023-09-30T22:19:08.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.118+0000 7faddf422700 1 -- 172.21.15.156:0/1879049316 >> v1:172.21.15.156:6808/129583 conn(0x7fadbc038660 legacy=0x7fadbc03aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.118+0000 7faddf422700 1 -- 172.21.15.156:0/1879049316 >> v1:172.21.15.156:6816/126965 conn(0x7fadbc02f510 legacy=0x7fadbc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:08.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.118+0000 7faddf422700 1 -- 172.21.15.156:0/1879049316 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fadd8134140 msgr2=0x7fadd8122ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.118+0000 7faddf422700 1 --2- 172.21.15.156:0/1879049316 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fadd8134140 0x7fadd8122ef0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fadd000be20 tx=0x7fadd0009ed0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.118+0000 7faddd9bf700 1 -- 172.21.15.156:0/1879049316 reap_dead start 2023-09-30T22:19:08.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.118+0000 7faddf422700 1 -- 172.21.15.156:0/1879049316 shutdown_connections 2023-09-30T22:19:08.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.118+0000 7faddf422700 1 -- 172.21.15.156:0/1879049316 >> 172.21.15.156:0/1879049316 conn(0x7fadd8099c40 msgr2=0x7fadd811c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:08.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.118+0000 7faddf422700 1 -- 172.21.15.156:0/1879049316 shutdown_connections 2023-09-30T22:19:08.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.118+0000 7faddf422700 1 -- 172.21.15.156:0/1879049316 wait complete. 2023-09-30T22:19:08.128 INFO:teuthology.orchestra.run.smithi156.stdout:133143986179 2023-09-30T22:19:08.129 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:08.135 INFO:teuthology.orchestra.run.smithi156.stdout:128849018883 2023-09-30T22:19:08.135 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:08.136 INFO:teuthology.orchestra.run.smithi156.stdout:120259084292 2023-09-30T22:19:08.136 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:08.137 INFO:teuthology.orchestra.run.smithi156.stdout:124554051588 2023-09-30T22:19:08.137 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:08.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.260+0000 7f24a5ce8700 1 Processor -- start 2023-09-30T22:19:08.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.260+0000 7f24a5ce8700 1 -- start start 2023-09-30T22:19:08.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.260+0000 7f24a5ce8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24a0133ad0 0x7f24a0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.260+0000 7f24a5ce8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24a01300a0 0x7f24a01304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.260+0000 7f24a5ce8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f24a01309f0 0x7f24a013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.260+0000 7f24a5ce8700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a006b2d0 con 0x7f24a01309f0 2023-09-30T22:19:08.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.260+0000 7f24a5ce8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a0133610 con 0x7f24a0133ad0 2023-09-30T22:19:08.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.260+0000 7f24a5ce8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24a009a500 con 0x7f24a01300a0 2023-09-30T22:19:08.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.260+0000 7f249ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f24a01309f0 0x7f24a013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.260+0000 7f249f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24a0133ad0 0x7f24a0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.261+0000 7f249ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f24a01309f0 0x7f24a013a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58874/0 (socket says 172.21.15.156:58874) 2023-09-30T22:19:08.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.261+0000 7f249ffff700 1 -- 172.21.15.156:0/2045617900 learned_addr learned my addr 172.21.15.156:0/2045617900 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:08.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.261+0000 7f249ffff700 1 -- 172.21.15.156:0/2045617900 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24a01300a0 msgr2=0x7f24a01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:08.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.261+0000 7f249ffff700 1 --2- 172.21.15.156:0/2045617900 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24a01300a0 0x7f24a01304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.261+0000 7f249ffff700 1 -- 172.21.15.156:0/2045617900 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24a0133ad0 msgr2=0x7f24a0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:08.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.261+0000 7f249ffff700 1 --2- 172.21.15.156:0/2045617900 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24a0133ad0 0x7f24a0133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.261+0000 7f249ffff700 1 -- 172.21.15.156:0/2045617900 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a01338b0 con 0x7f24a01309f0 2023-09-30T22:19:08.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.261+0000 7f249f7fe700 1 --2- 172.21.15.156:0/2045617900 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24a0133ad0 0x7f24a0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:08.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.261+0000 7f249ffff700 1 --2- 172.21.15.156:0/2045617900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24a01309f0 0x7f24a013a980 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2498009e50 tx=0x7f249800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4c2869f2b4460b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:08.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.261+0000 7f249e7fc700 1 -- 172.21.15.156:0/2045617900 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249800e070 con 0x7f24a01309f0 2023-09-30T22:19:08.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.261+0000 7f249e7fc700 1 -- 172.21.15.156:0/2045617900 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249800b910 con 0x7f24a01309f0 2023-09-30T22:19:08.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.261+0000 7f249e7fc700 1 -- 172.21.15.156:0/2045617900 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249800bcc0 con 0x7f24a01309f0 2023-09-30T22:19:08.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.262+0000 7f24a5ce8700 1 -- 172.21.15.156:0/2045617900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24a01309f0 msgr2=0x7f24a013a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.262+0000 7f24a5ce8700 1 --2- 172.21.15.156:0/2045617900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24a01309f0 0x7f24a013a980 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2498009e50 tx=0x7f249800b330 comp rx=0 tx=0).stop 2023-09-30T22:19:08.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.262+0000 7f24a5ce8700 1 -- 172.21.15.156:0/2045617900 shutdown_connections 2023-09-30T22:19:08.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.262+0000 7f24a5ce8700 1 --2- 172.21.15.156:0/2045617900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24a01309f0 0x7f24a013a980 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.262+0000 7f24a5ce8700 1 --2- 172.21.15.156:0/2045617900 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24a0133ad0 0x7f24a0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.262+0000 7f24a5ce8700 1 --2- 172.21.15.156:0/2045617900 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24a01300a0 0x7f24a01304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.262+0000 7f24a5ce8700 1 -- 172.21.15.156:0/2045617900 >> 172.21.15.156:0/2045617900 conn(0x7f24a0099c40 msgr2=0x7f24a00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:08.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.262+0000 7f24a5ce8700 1 -- 172.21.15.156:0/2045617900 shutdown_connections 2023-09-30T22:19:08.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.262+0000 7f24a5ce8700 1 -- 172.21.15.156:0/2045617900 wait complete. 2023-09-30T22:19:08.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.263+0000 7f24a5ce8700 1 Processor -- start 2023-09-30T22:19:08.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.264+0000 7f24a5ce8700 1 -- start start 2023-09-30T22:19:08.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.264+0000 7f24a5ce8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24a01300a0 0x7f24a011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.264+0000 7f24a5ce8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24a01309f0 0x7f24a011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.264+0000 7f24a5ce8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24a0133ad0 0x7f24a011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.264+0000 7f24a5ce8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a0072500 con 0x7f24a01300a0 2023-09-30T22:19:08.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.264+0000 7f24a5ce8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a00722d0 con 0x7f24a01309f0 2023-09-30T22:19:08.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.264+0000 7f24a5ce8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24a011fd60 con 0x7f24a0133ad0 2023-09-30T22:19:08.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.264+0000 7f249f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24a01300a0 0x7f24a011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.264+0000 7f249f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24a01300a0 0x7f24a011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58882/0 (socket says 172.21.15.156:58882) 2023-09-30T22:19:08.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.264+0000 7f249f7fe700 1 -- 172.21.15.156:0/3834506703 learned_addr learned my addr 172.21.15.156:0/3834506703 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:08.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.264+0000 7f249effd700 1 --2- 172.21.15.156:0/3834506703 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24a01309f0 0x7f24a011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.264+0000 7f249ffff700 1 --2- 172.21.15.156:0/3834506703 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24a0133ad0 0x7f24a011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.265+0000 7f249f7fe700 1 -- 172.21.15.156:0/3834506703 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24a0133ad0 msgr2=0x7f24a011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.265+0000 7f249f7fe700 1 --2- 172.21.15.156:0/3834506703 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24a0133ad0 0x7f24a011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.265+0000 7f249f7fe700 1 -- 172.21.15.156:0/3834506703 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24a01309f0 msgr2=0x7f24a011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.265+0000 7f249f7fe700 1 --2- 172.21.15.156:0/3834506703 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24a01309f0 0x7f24a011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.265+0000 7f249f7fe700 1 -- 172.21.15.156:0/3834506703 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24900094a0 con 0x7f24a01300a0 2023-09-30T22:19:08.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.265+0000 7f249f7fe700 1 --2- 172.21.15.156:0/3834506703 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24a01300a0 0x7f24a011da40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f249000ec10 tx=0x7f249000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:08.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.265+0000 7f2487fff700 1 -- 172.21.15.156:0/3834506703 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249000c850 con 0x7f24a01300a0 2023-09-30T22:19:08.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.265+0000 7f2487fff700 1 -- 172.21.15.156:0/3834506703 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249000c9b0 con 0x7f24a01300a0 2023-09-30T22:19:08.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.265+0000 7f2487fff700 1 -- 172.21.15.156:0/3834506703 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249000cd20 con 0x7f24a01300a0 2023-09-30T22:19:08.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.265+0000 7f24a5ce8700 1 -- 172.21.15.156:0/3834506703 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2498009b30 con 0x7f24a01300a0 2023-09-30T22:19:08.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.265+0000 7f24a5ce8700 1 -- 172.21.15.156:0/3834506703 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a012dd00 con 0x7f24a01300a0 2023-09-30T22:19:08.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.266+0000 7f24a5ce8700 1 -- 172.21.15.156:0/3834506703 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a004f2a0 con 0x7f24a01300a0 2023-09-30T22:19:08.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.266+0000 7f2487fff700 1 -- 172.21.15.156:0/3834506703 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2490013470 con 0x7f24a01300a0 2023-09-30T22:19:08.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.267+0000 7f2487fff700 1 -- 172.21.15.156:0/3834506703 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f249003fe00 con 0x7f24a01300a0 2023-09-30T22:19:08.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.267+0000 7f249effd700 1 -- 172.21.15.156:0/3834506703 >> v1:172.21.15.156:6816/126965 conn(0x7f248c02f510 legacy=0x7f248c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:08.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.275+0000 7f2487fff700 1 -- 172.21.15.156:0/3834506703 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2490013720 con 0x7f24a01300a0 2023-09-30T22:19:08.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.315+0000 7f1c115f5700 1 Processor -- start 2023-09-30T22:19:08.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.315+0000 7f762d43e700 1 Processor -- start 2023-09-30T22:19:08.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.315+0000 7f1c115f5700 1 -- start start 2023-09-30T22:19:08.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.315+0000 7f762d43e700 1 -- start start 2023-09-30T22:19:08.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.315+0000 7f1c115f5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1c0c138040 0x7f1c0c138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.315+0000 7f1c115f5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c0c0a08e0 0x7f1c0c0a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.315+0000 7f1c115f5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c0c1379e0 con 0x7f1c0c0a1230 2023-09-30T22:19:08.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.315+0000 7f1c115f5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c0c0a2100 con 0x7f1c0c138040 2023-09-30T22:19:08.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.315+0000 7f1c115f5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c138950 con 0x7f1c0c0a08e0 2023-09-30T22:19:08.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.316+0000 7f1c0b7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f1c0c0a1230 0x7f1c0c13ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:33914/0 (socket says 172.21.15.156:33914) 2023-09-30T22:19:08.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.316+0000 7f1c0b7fe700 1 -- 172.21.15.156:0/2578757580 learned_addr learned my addr 172.21.15.156:0/2578757580 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:08.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.316+0000 7f1c0affd700 1 --2- 172.21.15.156:0/2578757580 >> v2:172.21.15.156:3300/0 conn(0x7f1c0c138040 0x7f1c0c138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.316+0000 7f1c0a7fc700 1 --2- 172.21.15.156:0/2578757580 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c0c0a08e0 0x7f1c0c0a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.316+0000 7f1c0affd700 1 -- 172.21.15.156:0/2578757580 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c0c0a08e0 msgr2=0x7f1c0c0a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:08.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.316+0000 7f1c0affd700 1 --2- 172.21.15.156:0/2578757580 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c0c0a08e0 0x7f1c0c0a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.316+0000 7f1c0affd700 1 -- 172.21.15.156:0/2578757580 >> v1:172.21.15.156:6789/0 conn(0x7f1c0c0a1230 legacy=0x7f1c0c13ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.316+0000 7f1c0affd700 1 -- 172.21.15.156:0/2578757580 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c09b9b0 con 0x7f1c0c138040 2023-09-30T22:19:08.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.316+0000 7f762d43e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7628133b80 0x7f7628133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.316+0000 7f762d43e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f76280a0ff0 0x7f762813b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.316+0000 7f762d43e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f762809aa00 con 0x7f7628099a60 2023-09-30T22:19:08.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.316+0000 7f762d43e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f762809a080 con 0x7f7628133b80 2023-09-30T22:19:08.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.316+0000 7f762d43e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7628133750 con 0x7f76280a0ff0 2023-09-30T22:19:08.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.316+0000 7f761ffff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f7628099a60 0x7f76280a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:33916/0 (socket says 172.21.15.156:33916) 2023-09-30T22:19:08.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.316+0000 7f761ffff700 1 -- 172.21.15.156:0/2582684520 learned_addr learned my addr 172.21.15.156:0/2582684520 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:08.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.316+0000 7f7626ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7628133b80 0x7f7628133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.316+0000 7f76277fe700 1 --2- 172.21.15.156:0/2582684520 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f76280a0ff0 0x7f762813b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.316+0000 7f7626ffd700 1 -- 172.21.15.156:0/2582684520 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f76280a0ff0 msgr2=0x7f762813b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:08.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.316+0000 7f7626ffd700 1 --2- 172.21.15.156:0/2582684520 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f76280a0ff0 0x7f762813b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.316+0000 7f7626ffd700 1 -- 172.21.15.156:0/2582684520 >> v1:172.21.15.156:6789/0 conn(0x7f7628099a60 legacy=0x7f76280a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.316+0000 7f7626ffd700 1 -- 172.21.15.156:0/2582684520 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f762809a760 con 0x7f7628133b80 2023-09-30T22:19:08.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.316+0000 7f1c0affd700 1 --2- 172.21.15.156:0/2578757580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c0c138040 0x7f1c0c138410 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc009850 tx=0x7f1bfc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79247d98b11339 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:08.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.317+0000 7f7626ffd700 1 --2- 172.21.15.156:0/2582684520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7628133b80 0x7f7628133f50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7618009820 tx=0x7f7618009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389bde701fe5f0e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:08.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.317+0000 7f76267fc700 1 -- 172.21.15.156:0/2582684520 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7618005e30 con 0x7f7628133b80 2023-09-30T22:19:08.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.317+0000 7f76267fc700 1 -- 172.21.15.156:0/2582684520 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7618006030 con 0x7f7628133b80 2023-09-30T22:19:08.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.317+0000 7f76267fc700 1 -- 172.21.15.156:0/2582684520 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76180063e0 con 0x7f7628133b80 2023-09-30T22:19:08.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.317+0000 7f1c09ffb700 1 -- 172.21.15.156:0/2578757580 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc005e30 con 0x7f1c0c138040 2023-09-30T22:19:08.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.317+0000 7f1c09ffb700 1 -- 172.21.15.156:0/2578757580 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bfc006030 con 0x7f1c0c138040 2023-09-30T22:19:08.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.317+0000 7f1c09ffb700 1 -- 172.21.15.156:0/2578757580 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc0063c0 con 0x7f1c0c138040 2023-09-30T22:19:08.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.318+0000 7f762d43e700 1 -- 172.21.15.156:0/2582684520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7628133b80 msgr2=0x7f7628133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.318+0000 7f762d43e700 1 --2- 172.21.15.156:0/2582684520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7628133b80 0x7f7628133f50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7618009820 tx=0x7f7618009b30 comp rx=0 tx=0).stop 2023-09-30T22:19:08.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.318+0000 7f762d43e700 1 -- 172.21.15.156:0/2582684520 shutdown_connections 2023-09-30T22:19:08.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.318+0000 7f762d43e700 1 --2- 172.21.15.156:0/2582684520 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f76280a0ff0 0x7f762813b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.318+0000 7f762d43e700 1 --2- 172.21.15.156:0/2582684520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7628133b80 0x7f7628133f50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.318+0000 7f762d43e700 1 -- 172.21.15.156:0/2582684520 >> 172.21.15.156:0/2582684520 conn(0x7f76280a2980 msgr2=0x7f76280a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:08.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.318+0000 7f762d43e700 1 -- 172.21.15.156:0/2582684520 shutdown_connections 2023-09-30T22:19:08.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.318+0000 7f1c115f5700 1 -- 172.21.15.156:0/2578757580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c0c138040 msgr2=0x7f1c0c138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.318+0000 7f1c115f5700 1 --2- 172.21.15.156:0/2578757580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c0c138040 0x7f1c0c138410 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc009850 tx=0x7f1bfc009b60 comp rx=0 tx=0).stop 2023-09-30T22:19:08.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.318+0000 7f1c115f5700 1 -- 172.21.15.156:0/2578757580 shutdown_connections 2023-09-30T22:19:08.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.318+0000 7f1c115f5700 1 --2- 172.21.15.156:0/2578757580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c0c138040 0x7f1c0c138410 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.318+0000 7f1c115f5700 1 --2- 172.21.15.156:0/2578757580 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c0c0a08e0 0x7f1c0c0a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.318+0000 7f1c115f5700 1 -- 172.21.15.156:0/2578757580 >> 172.21.15.156:0/2578757580 conn(0x7f1c0c0a2980 msgr2=0x7f1c0c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:08.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.318+0000 7f1c115f5700 1 -- 172.21.15.156:0/2578757580 shutdown_connections 2023-09-30T22:19:08.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.318+0000 7f1c115f5700 1 -- 172.21.15.156:0/2578757580 wait complete. 2023-09-30T22:19:08.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.319+0000 7f1c115f5700 1 Processor -- start 2023-09-30T22:19:08.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.318+0000 7f762d43e700 1 -- 172.21.15.156:0/2582684520 wait complete. 2023-09-30T22:19:08.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.319+0000 7f762d43e700 1 Processor -- start 2023-09-30T22:19:08.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.319+0000 7f1c115f5700 1 -- start start 2023-09-30T22:19:08.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.320+0000 7f1c115f5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c0c0a08e0 0x7f1c0c1263d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.320+0000 7f1c115f5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c0c0a1230 0x7f1c0c126910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.320+0000 7f1c115f5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c0c138040 0x7f1c0c126e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.320+0000 7f1c115f5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c129cb0 con 0x7f1c0c138040 2023-09-30T22:19:08.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.320+0000 7f1c115f5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c128040 con 0x7f1c0c0a08e0 2023-09-30T22:19:08.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.320+0000 7f1c115f5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c129eb0 con 0x7f1c0c0a1230 2023-09-30T22:19:08.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.320+0000 7f1c0a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c0c0a1230 0x7f1c0c126910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.320+0000 7f1c0a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c0c0a1230 0x7f1c0c126910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45414/0 (socket says 172.21.15.156:45414) 2023-09-30T22:19:08.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.320+0000 7f1c0a7fc700 1 -- 172.21.15.156:0/1642190072 learned_addr learned my addr 172.21.15.156:0/1642190072 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:08.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.320+0000 7f1c0b7fe700 1 --2- 172.21.15.156:0/1642190072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c0c138040 0x7f1c0c126e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.320+0000 7f1c0b7fe700 1 -- 172.21.15.156:0/1642190072 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c0c0a1230 msgr2=0x7f1c0c126910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.320+0000 7f1c0b7fe700 1 --2- 172.21.15.156:0/1642190072 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c0c0a1230 0x7f1c0c126910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.320+0000 7f1c0b7fe700 1 -- 172.21.15.156:0/1642190072 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c0c0a08e0 msgr2=0x7f1c0c1263d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.320+0000 7f1c0affd700 1 --2- 172.21.15.156:0/1642190072 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c0c0a08e0 0x7f1c0c1263d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.320+0000 7f1c0b7fe700 1 --2- 172.21.15.156:0/1642190072 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c0c0a08e0 0x7f1c0c1263d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.320+0000 7f1c0b7fe700 1 -- 172.21.15.156:0/1642190072 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc009430 con 0x7f1c0c138040 2023-09-30T22:19:08.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.320+0000 7f1c0affd700 1 --2- 172.21.15.156:0/1642190072 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c0c0a08e0 0x7f1c0c1263d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:19:08.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.319+0000 7f762d43e700 1 -- start start 2023-09-30T22:19:08.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.320+0000 7f762d43e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7628099a60 0x7f7628070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.320+0000 7f762d43e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76280a0ff0 0x7f7628071240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.320+0000 7f762d43e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7628133b80 0x7f7628071780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.320+0000 7f762d43e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762812b190 con 0x7f76280a0ff0 2023-09-30T22:19:08.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.320+0000 7f762d43e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762809a2c0 con 0x7f7628133b80 2023-09-30T22:19:08.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.320+0000 7f762d43e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f762812acf0 con 0x7f7628099a60 2023-09-30T22:19:08.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.320+0000 7f761ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76280a0ff0 0x7f7628071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.320+0000 7f761ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76280a0ff0 0x7f7628071240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58916/0 (socket says 172.21.15.156:58916) 2023-09-30T22:19:08.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.320+0000 7f761ffff700 1 -- 172.21.15.156:0/1183405651 learned_addr learned my addr 172.21.15.156:0/1183405651 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:08.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.320+0000 7f1c0b7fe700 1 --2- 172.21.15.156:0/1642190072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c0c138040 0x7f1c0c126e50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1c0400caa0 tx=0x7f1c0400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:08.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.321+0000 7f1bf37fe700 1 -- 172.21.15.156:0/1642190072 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0400a9e0 con 0x7f1c0c138040 2023-09-30T22:19:08.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.320+0000 7f7626ffd700 1 --2- 172.21.15.156:0/1183405651 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7628099a60 0x7f7628070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.321+0000 7f76277fe700 1 --2- 172.21.15.156:0/1183405651 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7628133b80 0x7f7628071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.321+0000 7f1bf37fe700 1 -- 172.21.15.156:0/1642190072 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0400ab40 con 0x7f1c0c138040 2023-09-30T22:19:08.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.321+0000 7f7626ffd700 1 -- 172.21.15.156:0/1183405651 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7628133b80 msgr2=0x7f7628071780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.321+0000 7f7626ffd700 1 --2- 172.21.15.156:0/1183405651 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7628133b80 0x7f7628071780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.321+0000 7f7626ffd700 1 -- 172.21.15.156:0/1183405651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76280a0ff0 msgr2=0x7f7628071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.321+0000 7f7626ffd700 1 --2- 172.21.15.156:0/1183405651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76280a0ff0 0x7f7628071240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.321+0000 7f7626ffd700 1 -- 172.21.15.156:0/1183405651 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7618009430 con 0x7f7628099a60 2023-09-30T22:19:08.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.321+0000 7f761ffff700 1 --2- 172.21.15.156:0/1183405651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76280a0ff0 0x7f7628071240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:08.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.321+0000 7f1bf37fe700 1 -- 172.21.15.156:0/1642190072 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04012400 con 0x7f1c0c138040 2023-09-30T22:19:08.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.321+0000 7f1c115f5700 1 -- 172.21.15.156:0/1642190072 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c0c09a240 con 0x7f1c0c138040 2023-09-30T22:19:08.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.321+0000 7f1c115f5700 1 -- 172.21.15.156:0/1642190072 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c0c136f00 con 0x7f1c0c138040 2023-09-30T22:19:08.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.322+0000 7f7626ffd700 1 --2- 172.21.15.156:0/1183405651 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7628099a60 0x7f7628070d00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7618015000 tx=0x7f7618004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:08.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.322+0000 7f761f7fe700 1 -- 172.21.15.156:0/1183405651 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7618004240 con 0x7f7628099a60 2023-09-30T22:19:08.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.322+0000 7f1bf37fe700 1 -- 172.21.15.156:0/1642190072 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1c0401b3b0 con 0x7f1c0c138040 2023-09-30T22:19:08.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.322+0000 7f761f7fe700 1 -- 172.21.15.156:0/1183405651 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76180043c0 con 0x7f7628099a60 2023-09-30T22:19:08.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.322+0000 7f761f7fe700 1 -- 172.21.15.156:0/1183405651 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7618006960 con 0x7f7628099a60 2023-09-30T22:19:08.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.322+0000 7f762d43e700 1 -- 172.21.15.156:0/1183405651 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f762812b9f0 con 0x7f7628099a60 2023-09-30T22:19:08.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.322+0000 7f1bf37fe700 1 -- 172.21.15.156:0/1642190072 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f1c0403f810 con 0x7f1c0c138040 2023-09-30T22:19:08.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.322+0000 7f1c115f5700 1 -- 172.21.15.156:0/1642190072 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c0c1372e0 con 0x7f1c0c138040 2023-09-30T22:19:08.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.322+0000 7f762d43e700 1 -- 172.21.15.156:0/1183405651 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f762812a0a0 con 0x7f7628099a60 2023-09-30T22:19:08.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.323+0000 7f761f7fe700 1 -- 172.21.15.156:0/1183405651 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7618022070 con 0x7f7628099a60 2023-09-30T22:19:08.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.323+0000 7f762d43e700 1 -- 172.21.15.156:0/1183405651 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f762804f2a0 con 0x7f7628099a60 2023-09-30T22:19:08.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.322+0000 7f1c0affd700 1 -- 172.21.15.156:0/1642190072 >> v1:172.21.15.156:6816/126965 conn(0x7f1bf802f510 legacy=0x7f1bf80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:08.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.327+0000 7f1bf37fe700 1 -- 172.21.15.156:0/1642190072 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1c04017070 con 0x7f1c0c138040 2023-09-30T22:19:08.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.323+0000 7f761f7fe700 1 -- 172.21.15.156:0/1183405651 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f7618041290 con 0x7f7628099a60 2023-09-30T22:19:08.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.329+0000 7f761ffff700 1 -- 172.21.15.156:0/1183405651 >> v1:172.21.15.156:6816/126965 conn(0x7f760802f500 legacy=0x7f76080319b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:08.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.332+0000 7f761f7fe700 1 -- 172.21.15.156:0/1183405651 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7618003e00 con 0x7f7628099a60 2023-09-30T22:19:08.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.372+0000 7fb2ee084700 1 Processor -- start 2023-09-30T22:19:08.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.372+0000 7fb2ee084700 1 -- start start 2023-09-30T22:19:08.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.373+0000 7fb2ee084700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2e8133ad0 0x7fb2e8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.373+0000 7fb2ee084700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2e8130bc0 0x7fb2e813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.373+0000 7fb2ee084700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e806b2d0 con 0x7fb2e81300a0 2023-09-30T22:19:08.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.373+0000 7fb2ee084700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e8133610 con 0x7fb2e8133ad0 2023-09-30T22:19:08.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.373+0000 7fb2ee084700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e809a500 con 0x7fb2e8130bc0 2023-09-30T22:19:08.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.373+0000 7fb2e7fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2e8130bc0 0x7fb2e813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.373+0000 7fb2e77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2e8133ad0 0x7fb2e8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.373+0000 7fb2e77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2e8133ad0 0x7fb2e8133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48546/0 (socket says 172.21.15.156:48546) 2023-09-30T22:19:08.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.373+0000 7fb2e77fe700 1 -- 172.21.15.156:0/717721674 learned_addr learned my addr 172.21.15.156:0/717721674 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:08.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.373+0000 7fb2e7fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2e8130bc0 0x7fb2e813b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45434/0 (socket says 172.21.15.156:45434) 2023-09-30T22:19:08.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.373+0000 7fb2e7fff700 1 -- 172.21.15.156:0/717721674 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2e8133ad0 msgr2=0x7fb2e8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:08.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.373+0000 7fb2e7fff700 1 --2- 172.21.15.156:0/717721674 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2e8133ad0 0x7fb2e8133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.373+0000 7fb2e7fff700 1 -- 172.21.15.156:0/717721674 >> v1:172.21.15.156:6789/0 conn(0x7fb2e81300a0 legacy=0x7fb2e81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.373+0000 7fb2e67fc700 1 -- 172.21.15.156:0/717721674 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1452586602 0 0) 0x7fb2e806b2d0 con 0x7fb2e81300a0 2023-09-30T22:19:08.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.373+0000 7fb2e7fff700 1 -- 172.21.15.156:0/717721674 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e81338b0 con 0x7fb2e8130bc0 2023-09-30T22:19:08.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.374+0000 7fb2e77fe700 1 --2- 172.21.15.156:0/717721674 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2e8133ad0 0x7fb2e8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:08.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.374+0000 7fb2e7fff700 1 --2- 172.21.15.156:0/717721674 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2e8130bc0 0x7fb2e813b990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0009dc0 tx=0x7fb2e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4936c90432b57f8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:08.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.374+0000 7fb2e67fc700 1 -- 172.21.15.156:0/717721674 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e000e070 con 0x7fb2e8130bc0 2023-09-30T22:19:08.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.374+0000 7fb2e67fc700 1 -- 172.21.15.156:0/717721674 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e000bb20 con 0x7fb2e8130bc0 2023-09-30T22:19:08.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.374+0000 7fb2e67fc700 1 -- 172.21.15.156:0/717721674 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e0012430 con 0x7fb2e8130bc0 2023-09-30T22:19:08.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.374+0000 7fb2ee084700 1 -- 172.21.15.156:0/717721674 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2e8130bc0 msgr2=0x7fb2e813b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.374+0000 7fb2ee084700 1 --2- 172.21.15.156:0/717721674 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2e8130bc0 0x7fb2e813b990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0009dc0 tx=0x7fb2e000b330 comp rx=0 tx=0).stop 2023-09-30T22:19:08.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.374+0000 7fb2ee084700 1 -- 172.21.15.156:0/717721674 shutdown_connections 2023-09-30T22:19:08.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.374+0000 7fb2ee084700 1 --2- 172.21.15.156:0/717721674 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2e8133ad0 0x7fb2e8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.374+0000 7fb2ee084700 1 --2- 172.21.15.156:0/717721674 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2e8130bc0 0x7fb2e813b990 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.374+0000 7fb2ee084700 1 -- 172.21.15.156:0/717721674 >> 172.21.15.156:0/717721674 conn(0x7fb2e8099c40 msgr2=0x7fb2e80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:08.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.375+0000 7fb2ee084700 1 -- 172.21.15.156:0/717721674 shutdown_connections 2023-09-30T22:19:08.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.375+0000 7fb2ee084700 1 -- 172.21.15.156:0/717721674 wait complete. 2023-09-30T22:19:08.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.376+0000 7fb2ee084700 1 Processor -- start 2023-09-30T22:19:08.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.376+0000 7fb2ee084700 1 -- start start 2023-09-30T22:19:08.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.377+0000 7fb2ee084700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2e81300a0 0x7fb2e811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.377+0000 7fb2ee084700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2e8130bc0 0x7fb2e811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.377+0000 7fb2ee084700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2e8133ad0 0x7fb2e811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:08.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.377+0000 7fb2ee084700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e8072170 con 0x7fb2e81300a0 2023-09-30T22:19:08.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.377+0000 7fb2ee084700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e80a33e0 con 0x7fb2e8133ad0 2023-09-30T22:19:08.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.377+0000 7fb2ee084700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e812dd00 con 0x7fb2e8130bc0 2023-09-30T22:19:08.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.377+0000 7fb2e6ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2e8130bc0 0x7fb2e811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.377+0000 7fb2e6ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2e8130bc0 0x7fb2e811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45450/0 (socket says 172.21.15.156:45450) 2023-09-30T22:19:08.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.377+0000 7fb2e6ffd700 1 -- 172.21.15.156:0/848360777 learned_addr learned my addr 172.21.15.156:0/848360777 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:08.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.377+0000 7fb2e7fff700 1 --2- 172.21.15.156:0/848360777 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2e8133ad0 0x7fb2e811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.377+0000 7fb2e77fe700 1 --2- 172.21.15.156:0/848360777 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2e81300a0 0x7fb2e811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:08.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.377+0000 7fb2e7fff700 1 -- 172.21.15.156:0/848360777 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2e8130bc0 msgr2=0x7fb2e811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.377+0000 7fb2e7fff700 1 --2- 172.21.15.156:0/848360777 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2e8130bc0 0x7fb2e811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.377+0000 7fb2e7fff700 1 -- 172.21.15.156:0/848360777 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2e81300a0 msgr2=0x7fb2e811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.377+0000 7fb2e7fff700 1 --2- 172.21.15.156:0/848360777 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2e81300a0 0x7fb2e811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.377+0000 7fb2e7fff700 1 -- 172.21.15.156:0/848360777 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d8009550 con 0x7fb2e8133ad0 2023-09-30T22:19:08.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.377+0000 7fb2e7fff700 1 --2- 172.21.15.156:0/848360777 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2e8133ad0 0x7fb2e811e4c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0016000 tx=0x7fb2e0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:08.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.378+0000 7fb2cffff700 1 -- 172.21.15.156:0/848360777 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e0012430 con 0x7fb2e8133ad0 2023-09-30T22:19:08.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.378+0000 7fb2cffff700 1 -- 172.21.15.156:0/848360777 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e0020070 con 0x7fb2e8133ad0 2023-09-30T22:19:08.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.378+0000 7fb2ee084700 1 -- 172.21.15.156:0/848360777 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e0009a70 con 0x7fb2e8133ad0 2023-09-30T22:19:08.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.378+0000 7fb2cffff700 1 -- 172.21.15.156:0/848360777 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e0004280 con 0x7fb2e8133ad0 2023-09-30T22:19:08.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.378+0000 7fb2ee084700 1 -- 172.21.15.156:0/848360777 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e811fd70 con 0x7fb2e8133ad0 2023-09-30T22:19:08.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.379+0000 7fb2cffff700 1 -- 172.21.15.156:0/848360777 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb2e00043e0 con 0x7fb2e8133ad0 2023-09-30T22:19:08.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.379+0000 7fb2ee084700 1 -- 172.21.15.156:0/848360777 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e809cb20 con 0x7fb2e8133ad0 2023-09-30T22:19:08.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.379+0000 7fb2e77fe700 1 -- 172.21.15.156:0/848360777 >> v1:172.21.15.156:6816/126965 conn(0x7fb2d402f540 legacy=0x7fb2d40319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:08.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.379+0000 7fb2cffff700 1 -- 172.21.15.156:0/848360777 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fb2e0022070 con 0x7fb2e8133ad0 2023-09-30T22:19:08.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.388+0000 7fb2cffff700 1 -- 172.21.15.156:0/848360777 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2e0011d60 con 0x7fb2e8133ad0 2023-09-30T22:19:08.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.468+0000 7f249effd700 1 -- 172.21.15.156:0/3834506703 >> v1:172.21.15.156:6816/126965 conn(0x7f248c02f510 legacy=0x7f248c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:08.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.476+0000 7f24a5ce8700 1 -- 172.21.15.156:0/3834506703 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f24a011ff80 con 0x7f24a01300a0 2023-09-30T22:19:08.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.476+0000 7f2487fff700 1 -- 172.21.15.156:0/3834506703 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f249001bba0 con 0x7f24a01300a0 2023-09-30T22:19:08.477 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:08.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.478+0000 7f24a5ce8700 1 -- 172.21.15.156:0/3834506703 >> v1:172.21.15.156:6816/126965 conn(0x7f248c02f510 legacy=0x7f248c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:08.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.478+0000 7f24a5ce8700 1 -- 172.21.15.156:0/3834506703 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24a01300a0 msgr2=0x7f24a011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.478+0000 7f24a5ce8700 1 --2- 172.21.15.156:0/3834506703 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24a01300a0 0x7f24a011da40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f249000ec10 tx=0x7f249000ef20 comp rx=0 tx=0).stop 2023-09-30T22:19:08.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.480+0000 7f24a5ce8700 1 -- 172.21.15.156:0/3834506703 shutdown_connections 2023-09-30T22:19:08.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.480+0000 7f24a5ce8700 1 --2- 172.21.15.156:0/3834506703 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24a0133ad0 0x7f24a011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.480+0000 7f24a5ce8700 1 --2- 172.21.15.156:0/3834506703 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24a01300a0 0x7f24a011da40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.480+0000 7f24a5ce8700 1 --2- 172.21.15.156:0/3834506703 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24a01309f0 0x7f24a011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.480+0000 7f24a5ce8700 1 -- 172.21.15.156:0/3834506703 >> 172.21.15.156:0/3834506703 conn(0x7f24a0099c40 msgr2=0x7f24a0131410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:08.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.480+0000 7f24a5ce8700 1 -- 172.21.15.156:0/3834506703 shutdown_connections 2023-09-30T22:19:08.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.480+0000 7f24a5ce8700 1 -- 172.21.15.156:0/3834506703 wait complete. 2023-09-30T22:19:08.493 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:08.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.523+0000 7f1c0affd700 1 -- 172.21.15.156:0/1642190072 >> v1:172.21.15.156:6816/126965 conn(0x7f1bf802f510 legacy=0x7f1bf80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:08.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.530+0000 7f761ffff700 1 -- 172.21.15.156:0/1183405651 >> v1:172.21.15.156:6816/126965 conn(0x7f760802f500 legacy=0x7f76080319b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:08.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.530+0000 7f1c115f5700 1 -- 172.21.15.156:0/1642190072 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1c0c04f2a0 con 0x7f1c0c138040 2023-09-30T22:19:08.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.530+0000 7f1bf37fe700 1 -- 172.21.15.156:0/1642190072 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1c040192c0 con 0x7f1c0c138040 2023-09-30T22:19:08.531 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:08.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.532+0000 7f1c115f5700 1 -- 172.21.15.156:0/1642190072 >> v1:172.21.15.156:6816/126965 conn(0x7f1bf802f510 legacy=0x7f1bf80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:08.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.532+0000 7f1c115f5700 1 -- 172.21.15.156:0/1642190072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c0c138040 msgr2=0x7f1c0c126e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.532+0000 7f1c115f5700 1 --2- 172.21.15.156:0/1642190072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c0c138040 0x7f1c0c126e50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1c0400caa0 tx=0x7f1c0400cdb0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.532+0000 7f1c115f5700 1 -- 172.21.15.156:0/1642190072 shutdown_connections 2023-09-30T22:19:08.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.532+0000 7f1c115f5700 1 --2- 172.21.15.156:0/1642190072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c0c138040 0x7f1c0c126e50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.532+0000 7f1c115f5700 1 --2- 172.21.15.156:0/1642190072 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c0c0a08e0 0x7f1c0c1263d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.532+0000 7f1c115f5700 1 --2- 172.21.15.156:0/1642190072 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c0c0a1230 0x7f1c0c126910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.532+0000 7f1c115f5700 1 -- 172.21.15.156:0/1642190072 >> 172.21.15.156:0/1642190072 conn(0x7f1c0c0a2980 msgr2=0x7f1c0c09e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:08.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.532+0000 7f1c115f5700 1 -- 172.21.15.156:0/1642190072 shutdown_connections 2023-09-30T22:19:08.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.532+0000 7f1c115f5700 1 -- 172.21.15.156:0/1642190072 wait complete. 2023-09-30T22:19:08.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:08.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.544+0000 7f762d43e700 1 -- 172.21.15.156:0/1183405651 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7628133330 con 0x7f7628099a60 2023-09-30T22:19:08.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.545+0000 7f761f7fe700 1 -- 172.21.15.156:0/1183405651 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f761802a020 con 0x7f7628099a60 2023-09-30T22:19:08.546 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:08.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.547+0000 7f762d43e700 1 -- 172.21.15.156:0/1183405651 >> v1:172.21.15.156:6816/126965 conn(0x7f760802f500 legacy=0x7f76080319b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:08.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.547+0000 7f762d43e700 1 -- 172.21.15.156:0/1183405651 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7628099a60 msgr2=0x7f7628070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.547+0000 7f762d43e700 1 --2- 172.21.15.156:0/1183405651 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7628099a60 0x7f7628070d00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7618015000 tx=0x7f7618004750 comp rx=0 tx=0).stop 2023-09-30T22:19:08.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.547+0000 7f762d43e700 1 -- 172.21.15.156:0/1183405651 shutdown_connections 2023-09-30T22:19:08.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.547+0000 7f762d43e700 1 --2- 172.21.15.156:0/1183405651 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7628133b80 0x7f7628071780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.547+0000 7f762d43e700 1 --2- 172.21.15.156:0/1183405651 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7628099a60 0x7f7628070d00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.547+0000 7f762d43e700 1 --2- 172.21.15.156:0/1183405651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76280a0ff0 0x7f7628071240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.547+0000 7f762d43e700 1 -- 172.21.15.156:0/1183405651 >> 172.21.15.156:0/1183405651 conn(0x7f76280a2980 msgr2=0x7f76281ba990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:08.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.547+0000 7f762d43e700 1 -- 172.21.15.156:0/1183405651 shutdown_connections 2023-09-30T22:19:08.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.547+0000 7f762d43e700 1 -- 172.21.15.156:0/1183405651 wait complete. 2023-09-30T22:19:08.560 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:08.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.580+0000 7fb2e77fe700 1 -- 172.21.15.156:0/848360777 >> v1:172.21.15.156:6816/126965 conn(0x7fb2d402f540 legacy=0x7fb2d40319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:08.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.585+0000 7fb2ee084700 1 -- 172.21.15.156:0/848360777 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb2e804f2a0 con 0x7fb2e8133ad0 2023-09-30T22:19:08.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.585+0000 7fb2cffff700 1 -- 172.21.15.156:0/848360777 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb2e0011b80 con 0x7fb2e8133ad0 2023-09-30T22:19:08.586 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:08.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.588+0000 7fb2ee084700 1 -- 172.21.15.156:0/848360777 >> v1:172.21.15.156:6816/126965 conn(0x7fb2d402f540 legacy=0x7fb2d40319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:08.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.588+0000 7fb2ee084700 1 -- 172.21.15.156:0/848360777 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2e8133ad0 msgr2=0x7fb2e811e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:08.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.588+0000 7fb2ee084700 1 --2- 172.21.15.156:0/848360777 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2e8133ad0 0x7fb2e811e4c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0016000 tx=0x7fb2e0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.588+0000 7fb2ee084700 1 -- 172.21.15.156:0/848360777 shutdown_connections 2023-09-30T22:19:08.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.588+0000 7fb2ee084700 1 --2- 172.21.15.156:0/848360777 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2e8133ad0 0x7fb2e811e4c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.588+0000 7fb2ee084700 1 --2- 172.21.15.156:0/848360777 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2e81300a0 0x7fb2e811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.588+0000 7fb2ee084700 1 --2- 172.21.15.156:0/848360777 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2e8130bc0 0x7fb2e811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:08.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.588+0000 7fb2ee084700 1 -- 172.21.15.156:0/848360777 >> 172.21.15.156:0/848360777 conn(0x7fb2e8099c40 msgr2=0x7fb2e8132b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:08.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.588+0000 7fb2ee084700 1 -- 172.21.15.156:0/848360777 shutdown_connections 2023-09-30T22:19:08.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:08.588+0000 7fb2ee084700 1 -- 172.21.15.156:0/848360777 wait complete. 2023-09-30T22:19:08.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:09.493 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:09.546 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:09.561 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:09.601 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:09.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.636+0000 7fa2ee3f0700 1 Processor -- start 2023-09-30T22:19:09.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.636+0000 7fa2ee3f0700 1 -- start start 2023-09-30T22:19:09.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.637+0000 7fa2ee3f0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2e8133ad0 0x7fa2e8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:09.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.637+0000 7fa2ee3f0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa2e8130bc0 0x7fa2e813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:09.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.637+0000 7fa2ee3f0700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e806b2d0 con 0x7fa2e81300a0 2023-09-30T22:19:09.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.637+0000 7fa2ee3f0700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e8133610 con 0x7fa2e8130bc0 2023-09-30T22:19:09.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.637+0000 7fa2ee3f0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e809a500 con 0x7fa2e8133ad0 2023-09-30T22:19:09.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.637+0000 7fa2e7fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2e8133ad0 0x7fa2e8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:09.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.637+0000 7fa2e7fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2e8133ad0 0x7fa2e8133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45456/0 (socket says 172.21.15.156:45456) 2023-09-30T22:19:09.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.637+0000 7fa2e7fff700 1 -- 172.21.15.156:0/1280343261 learned_addr learned my addr 172.21.15.156:0/1280343261 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:09.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.637+0000 7fa2ec98d700 1 --2- 172.21.15.156:0/1280343261 >> v2:172.21.15.156:3300/0 conn(0x7fa2e8130bc0 0x7fa2e813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:09.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.637+0000 7fa2ec98d700 1 -- 172.21.15.156:0/1280343261 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2e8133ad0 msgr2=0x7fa2e8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:09.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.637+0000 7fa2ec98d700 1 --2- 172.21.15.156:0/1280343261 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2e8133ad0 0x7fa2e8133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.637+0000 7fa2ec98d700 1 -- 172.21.15.156:0/1280343261 >> v1:172.21.15.156:6789/0 conn(0x7fa2e81300a0 legacy=0x7fa2e81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:09.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.637+0000 7fa2ec98d700 1 -- 172.21.15.156:0/1280343261 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e81338b0 con 0x7fa2e8130bc0 2023-09-30T22:19:09.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.638+0000 7fa2ec98d700 1 --2- 172.21.15.156:0/1280343261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2e8130bc0 0x7fa2e813b990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0009d90 tx=0x7fa2e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a47dd50ef068f941 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:09.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.638+0000 7fa2e6ffd700 1 -- 172.21.15.156:0/1280343261 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e000e070 con 0x7fa2e8130bc0 2023-09-30T22:19:09.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.638+0000 7fa2e6ffd700 1 -- 172.21.15.156:0/1280343261 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e000bbd0 con 0x7fa2e8130bc0 2023-09-30T22:19:09.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.638+0000 7fa2e6ffd700 1 -- 172.21.15.156:0/1280343261 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0012430 con 0x7fa2e8130bc0 2023-09-30T22:19:09.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.639+0000 7fa2ee3f0700 1 -- 172.21.15.156:0/1280343261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2e8130bc0 msgr2=0x7fa2e813b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:09.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.639+0000 7fa2ee3f0700 1 --2- 172.21.15.156:0/1280343261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2e8130bc0 0x7fa2e813b990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0009d90 tx=0x7fa2e000b330 comp rx=0 tx=0).stop 2023-09-30T22:19:09.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.639+0000 7fa2ee3f0700 1 -- 172.21.15.156:0/1280343261 shutdown_connections 2023-09-30T22:19:09.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.639+0000 7fa2ee3f0700 1 --2- 172.21.15.156:0/1280343261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2e8130bc0 0x7fa2e813b990 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.639+0000 7fa2ee3f0700 1 --2- 172.21.15.156:0/1280343261 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2e8133ad0 0x7fa2e8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.639+0000 7fa2ee3f0700 1 -- 172.21.15.156:0/1280343261 >> 172.21.15.156:0/1280343261 conn(0x7fa2e8099c40 msgr2=0x7fa2e80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:09.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.639+0000 7fa2ee3f0700 1 -- 172.21.15.156:0/1280343261 shutdown_connections 2023-09-30T22:19:09.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.639+0000 7fa2ee3f0700 1 -- 172.21.15.156:0/1280343261 wait complete. 2023-09-30T22:19:09.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.640+0000 7fa2ee3f0700 1 Processor -- start 2023-09-30T22:19:09.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.640+0000 7fa2ee3f0700 1 -- start start 2023-09-30T22:19:09.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.641+0000 7fa2ee3f0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2e81300a0 0x7fa2e811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:09.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.641+0000 7fa2ee3f0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2e8130bc0 0x7fa2e811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:09.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.641+0000 7fa2ee3f0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2e8133ad0 0x7fa2e811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:09.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.641+0000 7fa2ee3f0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e8120a60 con 0x7fa2e8133ad0 2023-09-30T22:19:09.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.641+0000 7fa2ee3f0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e811f880 con 0x7fa2e8130bc0 2023-09-30T22:19:09.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.641+0000 7fa2ee3f0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e812f850 con 0x7fa2e81300a0 2023-09-30T22:19:09.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.641+0000 7fa2e77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2e8130bc0 0x7fa2e811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:09.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.641+0000 7fa2e77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2e8130bc0 0x7fa2e811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48562/0 (socket says 172.21.15.156:48562) 2023-09-30T22:19:09.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.641+0000 7fa2e77fe700 1 -- 172.21.15.156:0/1582553454 learned_addr learned my addr 172.21.15.156:0/1582553454 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:09.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.641+0000 7fa2ec98d700 1 --2- 172.21.15.156:0/1582553454 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2e8133ad0 0x7fa2e811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:09.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.641+0000 7fa2e7fff700 1 --2- 172.21.15.156:0/1582553454 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2e81300a0 0x7fa2e811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:09.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.642+0000 7fa2e77fe700 1 -- 172.21.15.156:0/1582553454 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2e81300a0 msgr2=0x7fa2e811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:09.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.642+0000 7fa2e77fe700 1 --2- 172.21.15.156:0/1582553454 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2e81300a0 0x7fa2e811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.642+0000 7fa2e77fe700 1 -- 172.21.15.156:0/1582553454 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2e8133ad0 msgr2=0x7fa2e811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:09.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.642+0000 7fa2e77fe700 1 --2- 172.21.15.156:0/1582553454 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2e8133ad0 0x7fa2e811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.642+0000 7fa2e77fe700 1 -- 172.21.15.156:0/1582553454 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e0009a70 con 0x7fa2e8130bc0 2023-09-30T22:19:09.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.642+0000 7fa2ec98d700 1 --2- 172.21.15.156:0/1582553454 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2e8133ad0 0x7fa2e811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:09.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.642+0000 7fa2e77fe700 1 --2- 172.21.15.156:0/1582553454 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2e8130bc0 0x7fa2e811df80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa2d000c420 tx=0x7fa2d000c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:09.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.642+0000 7fa2e4ff9700 1 -- 172.21.15.156:0/1582553454 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d00052d0 con 0x7fa2e8130bc0 2023-09-30T22:19:09.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.642+0000 7fa2e4ff9700 1 -- 172.21.15.156:0/1582553454 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d0005430 con 0x7fa2e8130bc0 2023-09-30T22:19:09.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.642+0000 7fa2ee3f0700 1 -- 172.21.15.156:0/1582553454 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e812dd00 con 0x7fa2e8130bc0 2023-09-30T22:19:09.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.642+0000 7fa2e4ff9700 1 -- 172.21.15.156:0/1582553454 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d00038c0 con 0x7fa2e8130bc0 2023-09-30T22:19:09.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.642+0000 7fa2ee3f0700 1 -- 172.21.15.156:0/1582553454 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e811fb50 con 0x7fa2e8130bc0 2023-09-30T22:19:09.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.643+0000 7fa2e4ff9700 1 -- 172.21.15.156:0/1582553454 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa2d0003a20 con 0x7fa2e8130bc0 2023-09-30T22:19:09.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.643+0000 7fa2e4ff9700 1 -- 172.21.15.156:0/1582553454 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fa2d003ef60 con 0x7fa2e8130bc0 2023-09-30T22:19:09.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.643+0000 7fa2e7fff700 1 -- 172.21.15.156:0/1582553454 >> v1:172.21.15.156:6816/126965 conn(0x7fa2c802f560 legacy=0x7fa2c8031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:09.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.644+0000 7fa2ee3f0700 1 -- 172.21.15.156:0/1582553454 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e804f2a0 con 0x7fa2e8130bc0 2023-09-30T22:19:09.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.648+0000 7fa2e4ff9700 1 -- 172.21.15.156:0/1582553454 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa2d0017070 con 0x7fa2e8130bc0 2023-09-30T22:19:09.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.690+0000 7f023695e700 1 Processor -- start 2023-09-30T22:19:09.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.690+0000 7f023695e700 1 -- start start 2023-09-30T22:19:09.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.690+0000 7f023695e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f023009d860 0x7f023009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:09.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.690+0000 7f023695e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f023009e170 0x7f02301307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:09.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.690+0000 7f023695e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0230130ce0 0x7f0230131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:09.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.690+0000 7f023695e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0230131670 con 0x7f023009d860 2023-09-30T22:19:09.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.690+0000 7f023695e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023009aaa0 con 0x7f023009e170 2023-09-30T22:19:09.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.690+0000 7f023695e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f023009f870 con 0x7f0230130ce0 2023-09-30T22:19:09.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.691+0000 7f022ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f023009d860 0x7f023009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:09.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.691+0000 7f0234efb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0230130ce0 0x7f0230131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:09.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.691+0000 7f022ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f023009d860 0x7f023009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58942/0 (socket says 172.21.15.156:58942) 2023-09-30T22:19:09.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.691+0000 7f022ffff700 1 -- 172.21.15.156:0/835147030 learned_addr learned my addr 172.21.15.156:0/835147030 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:09.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.691+0000 7f022f7fe700 1 --2- 172.21.15.156:0/835147030 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f023009e170 0x7f02301307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:09.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.691+0000 7f022ffff700 1 -- 172.21.15.156:0/835147030 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0230130ce0 msgr2=0x7f0230131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:09.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.691+0000 7f022ffff700 1 --2- 172.21.15.156:0/835147030 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0230130ce0 0x7f0230131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.691+0000 7f022ffff700 1 -- 172.21.15.156:0/835147030 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f023009e170 msgr2=0x7f02301307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:09.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.691+0000 7f022ffff700 1 --2- 172.21.15.156:0/835147030 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f023009e170 0x7f02301307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.691+0000 7f022ffff700 1 -- 172.21.15.156:0/835147030 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023009b360 con 0x7f023009d860 2023-09-30T22:19:09.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.691+0000 7f022ffff700 1 --2- 172.21.15.156:0/835147030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f023009d860 0x7f023009dc30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f022000b9d0 tx=0x7f022000bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f0c725a581fcc59 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:09.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.691+0000 7f022effd700 1 -- 172.21.15.156:0/835147030 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022000cc20 con 0x7f023009d860 2023-09-30T22:19:09.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.692+0000 7f022effd700 1 -- 172.21.15.156:0/835147030 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022000cd80 con 0x7f023009d860 2023-09-30T22:19:09.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.692+0000 7f022effd700 1 -- 172.21.15.156:0/835147030 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022000f680 con 0x7f023009d860 2023-09-30T22:19:09.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.692+0000 7f023695e700 1 -- 172.21.15.156:0/835147030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f023009d860 msgr2=0x7f023009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:09.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.692+0000 7f023695e700 1 --2- 172.21.15.156:0/835147030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f023009d860 0x7f023009dc30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f022000b9d0 tx=0x7f022000bce0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.693+0000 7f023695e700 1 -- 172.21.15.156:0/835147030 shutdown_connections 2023-09-30T22:19:09.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.693+0000 7f023695e700 1 --2- 172.21.15.156:0/835147030 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0230130ce0 0x7f0230131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.693+0000 7f023695e700 1 --2- 172.21.15.156:0/835147030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f023009d860 0x7f023009dc30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.693+0000 7f023695e700 1 --2- 172.21.15.156:0/835147030 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f023009e170 0x7f02301307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.693+0000 7f023695e700 1 -- 172.21.15.156:0/835147030 >> 172.21.15.156:0/835147030 conn(0x7f0230099c40 msgr2=0x7f02300a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:09.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.693+0000 7f023695e700 1 -- 172.21.15.156:0/835147030 shutdown_connections 2023-09-30T22:19:09.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.693+0000 7f023695e700 1 -- 172.21.15.156:0/835147030 wait complete. 2023-09-30T22:19:09.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.694+0000 7f023695e700 1 Processor -- start 2023-09-30T22:19:09.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.694+0000 7f023695e700 1 -- start start 2023-09-30T22:19:09.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.695+0000 7f023695e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f023009d860 0x7f023011cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:09.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.695+0000 7f023695e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f023009e170 0x7f023011d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:09.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.695+0000 7f023695e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0230130ce0 0x7f023011da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:09.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.695+0000 7f023695e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023011f220 con 0x7f0230130ce0 2023-09-30T22:19:09.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.695+0000 7f023695e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0230120570 con 0x7f023009d860 2023-09-30T22:19:09.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.695+0000 7f023695e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02300a07a0 con 0x7f023009e170 2023-09-30T22:19:09.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.695+0000 7f0234efb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0230130ce0 0x7f023011da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:09.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.695+0000 7f022ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f023009d860 0x7f023011cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:09.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.695+0000 7f022f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f023009e170 0x7f023011d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:09.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.695+0000 7f0234efb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0230130ce0 0x7f023011da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58948/0 (socket says 172.21.15.156:58948) 2023-09-30T22:19:09.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.695+0000 7f0234efb700 1 -- 172.21.15.156:0/894553891 learned_addr learned my addr 172.21.15.156:0/894553891 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:09.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.695+0000 7f022ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f023009d860 0x7f023011cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48572/0 (socket says 172.21.15.156:48572) 2023-09-30T22:19:09.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.696+0000 7f022f7fe700 1 -- 172.21.15.156:0/894553891 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f023009d860 msgr2=0x7f023011cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:09.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.696+0000 7f022f7fe700 1 --2- 172.21.15.156:0/894553891 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f023009d860 0x7f023011cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.696+0000 7f022f7fe700 1 -- 172.21.15.156:0/894553891 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0230130ce0 msgr2=0x7f023011da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:09.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.696+0000 7f022f7fe700 1 --2- 172.21.15.156:0/894553891 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0230130ce0 0x7f023011da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.696+0000 7f022f7fe700 1 -- 172.21.15.156:0/894553891 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022000b600 con 0x7f023009e170 2023-09-30T22:19:09.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.696+0000 7f0234efb700 1 --2- 172.21.15.156:0/894553891 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0230130ce0 0x7f023011da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:09.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.696+0000 7f022f7fe700 1 --2- 172.21.15.156:0/894553891 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f023009e170 0x7f023011d530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f022400e870 tx=0x7f022400eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:09.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.696+0000 7f022cff9700 1 -- 172.21.15.156:0/894553891 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0224013680 con 0x7f023009e170 2023-09-30T22:19:09.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.696+0000 7f022cff9700 1 -- 172.21.15.156:0/894553891 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02240137e0 con 0x7f023009e170 2023-09-30T22:19:09.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.696+0000 7f023695e700 1 -- 172.21.15.156:0/894553891 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f023011fe50 con 0x7f023009e170 2023-09-30T22:19:09.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.696+0000 7f022cff9700 1 -- 172.21.15.156:0/894553891 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0224013b50 con 0x7f023009e170 2023-09-30T22:19:09.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.696+0000 7f023695e700 1 -- 172.21.15.156:0/894553891 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0230120b10 con 0x7f023009e170 2023-09-30T22:19:09.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.697+0000 7f022cff9700 1 -- 172.21.15.156:0/894553891 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0224013cb0 con 0x7f023009e170 2023-09-30T22:19:09.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.698+0000 7f022cff9700 1 -- 172.21.15.156:0/894553891 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f022403fe70 con 0x7f023009e170 2023-09-30T22:19:09.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.698+0000 7f022ffff700 1 -- 172.21.15.156:0/894553891 >> v1:172.21.15.156:6816/126965 conn(0x7f021c02f510 legacy=0x7f021c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:09.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.698+0000 7f023695e700 1 -- 172.21.15.156:0/894553891 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f023004f2a0 con 0x7f023009e170 2023-09-30T22:19:09.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.707+0000 7f022cff9700 1 -- 172.21.15.156:0/894553891 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0224021070 con 0x7f023009e170 2023-09-30T22:19:09.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.731+0000 7f4b9bfce700 1 Processor -- start 2023-09-30T22:19:09.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.732+0000 7f4b9bfce700 1 -- start start 2023-09-30T22:19:09.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.732+0000 7f4b9bfce700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b94133ad0 0x7f4b94133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:09.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.732+0000 7f4b9bfce700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b941300a0 0x7f4b941304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:09.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.732+0000 7f4b9bfce700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4b941309f0 0x7f4b9413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:09.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.732+0000 7f4b9bfce700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b9406b2d0 con 0x7f4b941309f0 2023-09-30T22:19:09.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.732+0000 7f4b9bfce700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b94133610 con 0x7f4b94133ad0 2023-09-30T22:19:09.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.732+0000 7f4b9bfce700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9409a500 con 0x7f4b941300a0 2023-09-30T22:19:09.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.733+0000 7f4b99569700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b941300a0 0x7f4b941304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:09.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.733+0000 7f4b99569700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b941300a0 0x7f4b941304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45498/0 (socket says 172.21.15.156:45498) 2023-09-30T22:19:09.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.733+0000 7f4b99569700 1 -- 172.21.15.156:0/3922076582 learned_addr learned my addr 172.21.15.156:0/3922076582 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:09.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.733+0000 7f4b99d6a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b94133ad0 0x7f4b94133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:09.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.733+0000 7f4b9a56b700 1 --2- 172.21.15.156:0/3922076582 >> v2:172.21.15.156:3300/0 conn(0x7f4b941309f0 0x7f4b9413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:09.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.733+0000 7f4b99d6a700 1 -- 172.21.15.156:0/3922076582 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b941300a0 msgr2=0x7f4b941304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:09.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.733+0000 7f4b99d6a700 1 --2- 172.21.15.156:0/3922076582 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b941300a0 0x7f4b941304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.733+0000 7f4b99d6a700 1 -- 172.21.15.156:0/3922076582 >> v2:172.21.15.156:3300/0 conn(0x7f4b941309f0 msgr2=0x7f4b9413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:09.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.733+0000 7f4b99d6a700 1 --2- 172.21.15.156:0/3922076582 >> v2:172.21.15.156:3300/0 conn(0x7f4b941309f0 0x7f4b9413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.733+0000 7f4b99d6a700 1 -- 172.21.15.156:0/3922076582 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b941338b0 con 0x7f4b94133ad0 2023-09-30T22:19:09.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.733+0000 7f4b9a56b700 1 --2- 172.21.15.156:0/3922076582 >> v2:172.21.15.156:3300/0 conn(0x7f4b941309f0 0x7f4b9413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:19:09.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.733+0000 7f4b99d6a700 1 --2- 172.21.15.156:0/3922076582 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b94133ad0 0x7f4b94133ea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4b90009840 tx=0x7f4b90009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43f9f4f00e98e9b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:09.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.733+0000 7f4b98d68700 1 -- 172.21.15.156:0/3922076582 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b90011830 con 0x7f4b94133ad0 2023-09-30T22:19:09.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.733+0000 7f4b98d68700 1 -- 172.21.15.156:0/3922076582 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b90011990 con 0x7f4b94133ad0 2023-09-30T22:19:09.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.733+0000 7f4b98d68700 1 -- 172.21.15.156:0/3922076582 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b90011d20 con 0x7f4b94133ad0 2023-09-30T22:19:09.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.734+0000 7f4b9bfce700 1 -- 172.21.15.156:0/3922076582 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b94133ad0 msgr2=0x7f4b94133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:09.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.734+0000 7f4b9bfce700 1 --2- 172.21.15.156:0/3922076582 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b94133ad0 0x7f4b94133ea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4b90009840 tx=0x7f4b90009b50 comp rx=0 tx=0).stop 2023-09-30T22:19:09.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.734+0000 7f4b9bfce700 1 -- 172.21.15.156:0/3922076582 shutdown_connections 2023-09-30T22:19:09.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.734+0000 7f4b9bfce700 1 --2- 172.21.15.156:0/3922076582 >> v2:172.21.15.156:3300/0 conn(0x7f4b941309f0 0x7f4b9413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.734+0000 7f4b9bfce700 1 --2- 172.21.15.156:0/3922076582 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b94133ad0 0x7f4b94133ea0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.734+0000 7f4b9bfce700 1 --2- 172.21.15.156:0/3922076582 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b941300a0 0x7f4b941304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.734+0000 7f4b9bfce700 1 -- 172.21.15.156:0/3922076582 >> 172.21.15.156:0/3922076582 conn(0x7f4b94099c40 msgr2=0x7f4b940a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:09.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.734+0000 7f4b9bfce700 1 -- 172.21.15.156:0/3922076582 shutdown_connections 2023-09-30T22:19:09.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.734+0000 7f4b9bfce700 1 -- 172.21.15.156:0/3922076582 wait complete. 2023-09-30T22:19:09.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.735+0000 7f4b9bfce700 1 Processor -- start 2023-09-30T22:19:09.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.735+0000 7f4b9bfce700 1 -- start start 2023-09-30T22:19:09.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.736+0000 7f4b9bfce700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b941300a0 0x7f4b9411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:09.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.736+0000 7f4b9bfce700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b941309f0 0x7f4b9411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:09.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.736+0000 7f4b9bfce700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b94133ad0 0x7f4b9411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:09.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.736+0000 7f4b9bfce700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9411ed30 con 0x7f4b941300a0 2023-09-30T22:19:09.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.736+0000 7f4b9bfce700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b94120ac0 con 0x7f4b941309f0 2023-09-30T22:19:09.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.736+0000 7f4b9bfce700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b940a2ea0 con 0x7f4b94133ad0 2023-09-30T22:19:09.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.736+0000 7f4b99569700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b941309f0 0x7f4b9411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:09.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.736+0000 7f4b99569700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b941309f0 0x7f4b9411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48594/0 (socket says 172.21.15.156:48594) 2023-09-30T22:19:09.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.736+0000 7f4b99569700 1 -- 172.21.15.156:0/504017014 learned_addr learned my addr 172.21.15.156:0/504017014 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:09.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.736+0000 7f4b99d6a700 1 --2- 172.21.15.156:0/504017014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b941300a0 0x7f4b9411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:09.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.736+0000 7f4b9a56b700 1 --2- 172.21.15.156:0/504017014 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b94133ad0 0x7f4b9411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:09.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.736+0000 7f4b99569700 1 -- 172.21.15.156:0/504017014 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b94133ad0 msgr2=0x7f4b9411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:09.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.736+0000 7f4b99569700 1 --2- 172.21.15.156:0/504017014 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b94133ad0 0x7f4b9411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.736+0000 7f4b99569700 1 -- 172.21.15.156:0/504017014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b941300a0 msgr2=0x7f4b9411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:09.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.736+0000 7f4b99569700 1 --2- 172.21.15.156:0/504017014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b941300a0 0x7f4b9411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.736+0000 7f4b99569700 1 -- 172.21.15.156:0/504017014 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b900094a0 con 0x7f4b941309f0 2023-09-30T22:19:09.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.736+0000 7f4b99569700 1 --2- 172.21.15.156:0/504017014 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b941309f0 0x7f4b9411df80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4b8400e840 tx=0x7f4b8400eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:09.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.736+0000 7f4b8a7fc700 1 -- 172.21.15.156:0/504017014 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b84013680 con 0x7f4b941309f0 2023-09-30T22:19:09.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.736+0000 7f4b8a7fc700 1 -- 172.21.15.156:0/504017014 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b840137e0 con 0x7f4b941309f0 2023-09-30T22:19:09.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.737+0000 7f4b8a7fc700 1 -- 172.21.15.156:0/504017014 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b84013b50 con 0x7f4b941309f0 2023-09-30T22:19:09.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.737+0000 7f4b9bfce700 1 -- 172.21.15.156:0/504017014 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b9412dd00 con 0x7f4b941309f0 2023-09-30T22:19:09.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.737+0000 7f4b9bfce700 1 -- 172.21.15.156:0/504017014 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b9411f8e0 con 0x7f4b941309f0 2023-09-30T22:19:09.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.737+0000 7f4b8a7fc700 1 -- 172.21.15.156:0/504017014 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4b84013cb0 con 0x7f4b941309f0 2023-09-30T22:19:09.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.738+0000 7f4b8a7fc700 1 -- 172.21.15.156:0/504017014 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f4b8403fe80 con 0x7f4b941309f0 2023-09-30T22:19:09.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.738+0000 7f4b99d6a700 1 -- 172.21.15.156:0/504017014 >> v1:172.21.15.156:6816/126965 conn(0x7f4b7802f510 legacy=0x7f4b780319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:09.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.738+0000 7f4b9bfce700 1 -- 172.21.15.156:0/504017014 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b9404f2a0 con 0x7f4b941309f0 2023-09-30T22:19:09.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.743+0000 7f4b8a7fc700 1 -- 172.21.15.156:0/504017014 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b84021080 con 0x7f4b941309f0 2023-09-30T22:19:09.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.797+0000 7ff20913f700 1 Processor -- start 2023-09-30T22:19:09.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.797+0000 7ff20913f700 1 -- start start 2023-09-30T22:19:09.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.797+0000 7ff20913f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff204133ad0 0x7ff204133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:09.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.797+0000 7ff20913f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff2041300a0 0x7ff2041304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:09.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.797+0000 7ff20913f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff20406b2d0 con 0x7ff2041309f0 2023-09-30T22:19:09.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.797+0000 7ff20913f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff204133610 con 0x7ff2041300a0 2023-09-30T22:19:09.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.797+0000 7ff20913f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff20409a500 con 0x7ff204133ad0 2023-09-30T22:19:09.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.798+0000 7ff202d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff204133ad0 0x7ff204133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:09.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.798+0000 7ff20259c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff2041300a0 0x7ff2041304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:09.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.798+0000 7ff20259c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff2041300a0 0x7ff2041304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58978/0 (socket says 172.21.15.156:58978) 2023-09-30T22:19:09.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.798+0000 7ff20259c700 1 -- 172.21.15.156:0/3096844114 learned_addr learned my addr 172.21.15.156:0/3096844114 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:09.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.798+0000 7ff20259c700 1 -- 172.21.15.156:0/3096844114 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff204133ad0 msgr2=0x7ff204133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:09.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.798+0000 7ff202d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff204133ad0 0x7ff204133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45522/0 (socket says 172.21.15.156:45522) 2023-09-30T22:19:09.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.798+0000 7ff20259c700 1 --2- 172.21.15.156:0/3096844114 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff204133ad0 0x7ff204133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.798+0000 7ff20259c700 1 -- 172.21.15.156:0/3096844114 >> v1:172.21.15.156:6789/0 conn(0x7ff2041309f0 legacy=0x7ff20413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:09.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.798+0000 7ff20259c700 1 -- 172.21.15.156:0/3096844114 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2041338b0 con 0x7ff2041300a0 2023-09-30T22:19:09.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.798+0000 7ff201d9b700 1 -- 172.21.15.156:0/3096844114 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163909542 0 0) 0x7ff20406b2d0 con 0x7ff2041309f0 2023-09-30T22:19:09.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.798+0000 7ff202d9d700 1 --2- 172.21.15.156:0/3096844114 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff204133ad0 0x7ff204133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:19:09.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.798+0000 7ff20259c700 1 --2- 172.21.15.156:0/3096844114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2041300a0 0x7ff2041304b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff1f80098f0 tx=0x7ff1f8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e60f293045c5ab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:09.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.798+0000 7ff201d9b700 1 -- 172.21.15.156:0/3096844114 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f800b8a0 con 0x7ff2041300a0 2023-09-30T22:19:09.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.798+0000 7ff201d9b700 1 -- 172.21.15.156:0/3096844114 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f800ba00 con 0x7ff2041300a0 2023-09-30T22:19:09.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.798+0000 7ff201d9b700 1 -- 172.21.15.156:0/3096844114 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f800bd90 con 0x7ff2041300a0 2023-09-30T22:19:09.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.799+0000 7ff20913f700 1 -- 172.21.15.156:0/3096844114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2041300a0 msgr2=0x7ff2041304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:09.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.799+0000 7ff20913f700 1 --2- 172.21.15.156:0/3096844114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2041300a0 0x7ff2041304b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff1f80098f0 tx=0x7ff1f8009c00 comp rx=0 tx=0).stop 2023-09-30T22:19:09.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.799+0000 7ff20913f700 1 -- 172.21.15.156:0/3096844114 shutdown_connections 2023-09-30T22:19:09.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.799+0000 7ff20913f700 1 --2- 172.21.15.156:0/3096844114 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff204133ad0 0x7ff204133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.799+0000 7ff20913f700 1 --2- 172.21.15.156:0/3096844114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2041300a0 0x7ff2041304b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.799+0000 7ff20913f700 1 -- 172.21.15.156:0/3096844114 >> 172.21.15.156:0/3096844114 conn(0x7ff204099c40 msgr2=0x7ff2040a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:09.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.799+0000 7ff20913f700 1 -- 172.21.15.156:0/3096844114 shutdown_connections 2023-09-30T22:19:09.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.799+0000 7ff20913f700 1 -- 172.21.15.156:0/3096844114 wait complete. 2023-09-30T22:19:09.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.800+0000 7ff20913f700 1 Processor -- start 2023-09-30T22:19:09.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.801+0000 7ff20913f700 1 -- start start 2023-09-30T22:19:09.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.801+0000 7ff20913f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2041300a0 0x7ff204071290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:09.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.801+0000 7ff20913f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2041309f0 0x7ff2040717d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:09.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.801+0000 7ff20913f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff204133ad0 0x7ff204071d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:09.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.801+0000 7ff20913f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff204072740 con 0x7ff2041300a0 2023-09-30T22:19:09.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.801+0000 7ff20913f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2040a3400 con 0x7ff2041309f0 2023-09-30T22:19:09.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.801+0000 7ff20913f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff20412dd00 con 0x7ff204133ad0 2023-09-30T22:19:09.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.801+0000 7ff20259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2041309f0 0x7ff2040717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:09.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.801+0000 7ff202d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2041300a0 0x7ff204071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:09.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.801+0000 7ff20259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2041309f0 0x7ff2040717d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48606/0 (socket says 172.21.15.156:48606) 2023-09-30T22:19:09.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.801+0000 7ff20259c700 1 -- 172.21.15.156:0/4226865649 learned_addr learned my addr 172.21.15.156:0/4226865649 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:09.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.801+0000 7ff20359e700 1 --2- 172.21.15.156:0/4226865649 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff204133ad0 0x7ff204071d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:09.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.802+0000 7ff20259c700 1 -- 172.21.15.156:0/4226865649 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff204133ad0 msgr2=0x7ff204071d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:09.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.802+0000 7ff20259c700 1 --2- 172.21.15.156:0/4226865649 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff204133ad0 0x7ff204071d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.802+0000 7ff20259c700 1 -- 172.21.15.156:0/4226865649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2041300a0 msgr2=0x7ff204071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:09.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.802+0000 7ff20259c700 1 --2- 172.21.15.156:0/4226865649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2041300a0 0x7ff204071290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.802+0000 7ff20259c700 1 -- 172.21.15.156:0/4226865649 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f8009550 con 0x7ff2041309f0 2023-09-30T22:19:09.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.802+0000 7ff20259c700 1 --2- 172.21.15.156:0/4226865649 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2041309f0 0x7ff2040717d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8013000 tx=0x7ff1f8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:09.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.802+0000 7ff1eb7fe700 1 -- 172.21.15.156:0/4226865649 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f8004510 con 0x7ff2041309f0 2023-09-30T22:19:09.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.802+0000 7ff1eb7fe700 1 -- 172.21.15.156:0/4226865649 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f80036a0 con 0x7ff2041309f0 2023-09-30T22:19:09.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.802+0000 7ff20913f700 1 -- 172.21.15.156:0/4226865649 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff20411f880 con 0x7ff2041309f0 2023-09-30T22:19:09.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.802+0000 7ff1eb7fe700 1 -- 172.21.15.156:0/4226865649 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f8003a30 con 0x7ff2041309f0 2023-09-30T22:19:09.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.802+0000 7ff20913f700 1 -- 172.21.15.156:0/4226865649 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff20411df30 con 0x7ff2041309f0 2023-09-30T22:19:09.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.804+0000 7ff1eb7fe700 1 -- 172.21.15.156:0/4226865649 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff1f8021070 con 0x7ff2041309f0 2023-09-30T22:19:09.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.804+0000 7ff1eb7fe700 1 -- 172.21.15.156:0/4226865649 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7ff1f8041120 con 0x7ff2041309f0 2023-09-30T22:19:09.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.804+0000 7ff202d9d700 1 -- 172.21.15.156:0/4226865649 >> v1:172.21.15.156:6816/126965 conn(0x7ff1f002f510 legacy=0x7ff1f00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:09.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.805+0000 7ff1e17fa700 1 -- 172.21.15.156:0/4226865649 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff20411e120 con 0x7ff2041309f0 2023-09-30T22:19:09.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.810+0000 7ff1eb7fe700 1 -- 172.21.15.156:0/4226865649 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff1f8015020 con 0x7ff2041309f0 2023-09-30T22:19:09.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.844+0000 7fa2e7fff700 1 -- 172.21.15.156:0/1582553454 >> v1:172.21.15.156:6816/126965 conn(0x7fa2c802f560 legacy=0x7fa2c8031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:09.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.855+0000 7fa2ee3f0700 1 -- 172.21.15.156:0/1582553454 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa2e806c3b0 con 0x7fa2e8130bc0 2023-09-30T22:19:09.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.856+0000 7fa2e4ff9700 1 -- 172.21.15.156:0/1582553454 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa2d0017030 con 0x7fa2e8130bc0 2023-09-30T22:19:09.856 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:09.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.859+0000 7fa2ee3f0700 1 -- 172.21.15.156:0/1582553454 >> v1:172.21.15.156:6816/126965 conn(0x7fa2c802f560 legacy=0x7fa2c8031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:09.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.859+0000 7fa2ee3f0700 1 -- 172.21.15.156:0/1582553454 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2e8130bc0 msgr2=0x7fa2e811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:09.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.859+0000 7fa2ee3f0700 1 --2- 172.21.15.156:0/1582553454 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2e8130bc0 0x7fa2e811df80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa2d000c420 tx=0x7fa2d000c730 comp rx=0 tx=0).stop 2023-09-30T22:19:09.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.859+0000 7fa2ee3f0700 1 -- 172.21.15.156:0/1582553454 shutdown_connections 2023-09-30T22:19:09.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.859+0000 7fa2ee3f0700 1 --2- 172.21.15.156:0/1582553454 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2e8133ad0 0x7fa2e811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.859+0000 7fa2ee3f0700 1 --2- 172.21.15.156:0/1582553454 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2e81300a0 0x7fa2e811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.859+0000 7fa2ee3f0700 1 --2- 172.21.15.156:0/1582553454 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2e8130bc0 0x7fa2e811df80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.859+0000 7fa2ee3f0700 1 -- 172.21.15.156:0/1582553454 >> 172.21.15.156:0/1582553454 conn(0x7fa2e8099c40 msgr2=0x7fa2e812e620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:09.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.859+0000 7fa2ee3f0700 1 -- 172.21.15.156:0/1582553454 shutdown_connections 2023-09-30T22:19:09.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.859+0000 7fa2ee3f0700 1 -- 172.21.15.156:0/1582553454 wait complete. 2023-09-30T22:19:09.872 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:09.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.899+0000 7f022ffff700 1 -- 172.21.15.156:0/894553891 >> v1:172.21.15.156:6816/126965 conn(0x7f021c02f510 legacy=0x7f021c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:09.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.939+0000 7f4b99d6a700 1 -- 172.21.15.156:0/504017014 >> v1:172.21.15.156:6816/126965 conn(0x7f4b7802f510 legacy=0x7f4b780319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:09.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.940+0000 7f4b9bfce700 1 -- 172.21.15.156:0/504017014 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4b9406c3b0 con 0x7f4b941309f0 2023-09-30T22:19:09.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.941+0000 7f4b8a7fc700 1 -- 172.21.15.156:0/504017014 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b84017020 con 0x7f4b941309f0 2023-09-30T22:19:09.942 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:09.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.943+0000 7f4b9bfce700 1 -- 172.21.15.156:0/504017014 >> v1:172.21.15.156:6816/126965 conn(0x7f4b7802f510 legacy=0x7f4b780319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:09.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.943+0000 7f4b9bfce700 1 -- 172.21.15.156:0/504017014 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b941309f0 msgr2=0x7f4b9411df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:09.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.943+0000 7f4b9bfce700 1 --2- 172.21.15.156:0/504017014 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b941309f0 0x7f4b9411df80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4b8400e840 tx=0x7f4b8400eb50 comp rx=0 tx=0).stop 2023-09-30T22:19:09.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.943+0000 7f4b9bfce700 1 -- 172.21.15.156:0/504017014 shutdown_connections 2023-09-30T22:19:09.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.943+0000 7f4b9bfce700 1 --2- 172.21.15.156:0/504017014 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b94133ad0 0x7f4b9411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.943+0000 7f4b9bfce700 1 --2- 172.21.15.156:0/504017014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b941300a0 0x7f4b9411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.943+0000 7f4b9bfce700 1 --2- 172.21.15.156:0/504017014 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b941309f0 0x7f4b9411df80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.943+0000 7f4b9bfce700 1 -- 172.21.15.156:0/504017014 >> 172.21.15.156:0/504017014 conn(0x7f4b94099c40 msgr2=0x7f4b9412f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:09.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.943+0000 7f4b9bfce700 1 -- 172.21.15.156:0/504017014 shutdown_connections 2023-09-30T22:19:09.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.943+0000 7f4b9bfce700 1 -- 172.21.15.156:0/504017014 wait complete. 2023-09-30T22:19:09.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:09.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.969+0000 7f023695e700 1 -- 172.21.15.156:0/894553891 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f023006c3b0 con 0x7f023009e170 2023-09-30T22:19:09.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.969+0000 7f022cff9700 1 -- 172.21.15.156:0/894553891 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0224017030 con 0x7f023009e170 2023-09-30T22:19:09.970 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:09.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.971+0000 7f023695e700 1 -- 172.21.15.156:0/894553891 >> v1:172.21.15.156:6816/126965 conn(0x7f021c02f510 legacy=0x7f021c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:09.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.971+0000 7f023695e700 1 -- 172.21.15.156:0/894553891 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f023009e170 msgr2=0x7f023011d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:09.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.971+0000 7f023695e700 1 --2- 172.21.15.156:0/894553891 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f023009e170 0x7f023011d530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f022400e870 tx=0x7f022400eb80 comp rx=0 tx=0).stop 2023-09-30T22:19:09.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.971+0000 7f023695e700 1 -- 172.21.15.156:0/894553891 shutdown_connections 2023-09-30T22:19:09.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.971+0000 7f023695e700 1 --2- 172.21.15.156:0/894553891 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0230130ce0 0x7f023011da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.971+0000 7f023695e700 1 --2- 172.21.15.156:0/894553891 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f023009d860 0x7f023011cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.971+0000 7f023695e700 1 --2- 172.21.15.156:0/894553891 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f023009e170 0x7f023011d530 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:09.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.971+0000 7f023695e700 1 -- 172.21.15.156:0/894553891 >> 172.21.15.156:0/894553891 conn(0x7f0230099c40 msgr2=0x7f023012ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:09.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.971+0000 7f023695e700 1 -- 172.21.15.156:0/894553891 shutdown_connections 2023-09-30T22:19:09.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:09.971+0000 7f023695e700 1 -- 172.21.15.156:0/894553891 wait complete. 2023-09-30T22:19:09.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:10.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:10.005+0000 7ff202d9d700 1 -- 172.21.15.156:0/4226865649 >> v1:172.21.15.156:6816/126965 conn(0x7ff1f002f510 legacy=0x7ff1f00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:10.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:10.027+0000 7ff1e17fa700 1 -- 172.21.15.156:0/4226865649 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff20404f2a0 con 0x7ff2041309f0 2023-09-30T22:19:10.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:10.028+0000 7ff1eb7fe700 1 -- 172.21.15.156:0/4226865649 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff1f8024470 con 0x7ff2041309f0 2023-09-30T22:19:10.028 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:10.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:10.030+0000 7ff1e17fa700 1 -- 172.21.15.156:0/4226865649 >> v1:172.21.15.156:6816/126965 conn(0x7ff1f002f510 legacy=0x7ff1f00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:10.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:10.030+0000 7ff1e17fa700 1 -- 172.21.15.156:0/4226865649 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2041309f0 msgr2=0x7ff2040717d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:10.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:10.030+0000 7ff1e17fa700 1 --2- 172.21.15.156:0/4226865649 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2041309f0 0x7ff2040717d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8013000 tx=0x7ff1f8004750 comp rx=0 tx=0).stop 2023-09-30T22:19:10.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:10.030+0000 7ff1e17fa700 1 -- 172.21.15.156:0/4226865649 shutdown_connections 2023-09-30T22:19:10.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:10.030+0000 7ff1e17fa700 1 --2- 172.21.15.156:0/4226865649 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff204133ad0 0x7ff204071d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:10.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:10.030+0000 7ff1e17fa700 1 --2- 172.21.15.156:0/4226865649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2041300a0 0x7ff204071290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:10.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:10.030+0000 7ff1e17fa700 1 --2- 172.21.15.156:0/4226865649 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2041309f0 0x7ff2040717d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:10.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:10.030+0000 7ff1e17fa700 1 -- 172.21.15.156:0/4226865649 >> 172.21.15.156:0/4226865649 conn(0x7ff204099c40 msgr2=0x7ff2041329d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:10.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:10.030+0000 7ff1e17fa700 1 -- 172.21.15.156:0/4226865649 shutdown_connections 2023-09-30T22:19:10.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:10.030+0000 7ff1e17fa700 1 -- 172.21.15.156:0/4226865649 wait complete. 2023-09-30T22:19:10.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:10.873 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:10.957 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:10.985 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:11.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.001+0000 7ff547dc0700 1 Processor -- start 2023-09-30T22:19:11.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.001+0000 7ff547dc0700 1 -- start start 2023-09-30T22:19:11.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.002+0000 7ff547dc0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff5400a0a30 0x7ff5400a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:11.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.002+0000 7ff547dc0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff540130670 0x7ff5401381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:11.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.002+0000 7ff547dc0700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5400a1e70 con 0x7ff5400a1340 2023-09-30T22:19:11.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.002+0000 7ff547dc0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff54009a720 con 0x7ff5400a0a30 2023-09-30T22:19:11.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.002+0000 7ff547dc0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff54009b300 con 0x7ff540130670 2023-09-30T22:19:11.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.002+0000 7ff54635d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff540130670 0x7ff5401381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:11.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.002+0000 7ff54635d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff540130670 0x7ff5401381c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45542/0 (socket says 172.21.15.156:45542) 2023-09-30T22:19:11.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.002+0000 7ff54635d700 1 -- 172.21.15.156:0/1844336338 learned_addr learned my addr 172.21.15.156:0/1844336338 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:11.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.002+0000 7ff545b5c700 1 --2- 172.21.15.156:0/1844336338 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff5400a0a30 0x7ff5400a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:11.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.002+0000 7ff544b5a700 1 -- 172.21.15.156:0/1844336338 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534078264 0 0) 0x7ff5400a1e70 con 0x7ff5400a1340 2023-09-30T22:19:11.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.002+0000 7ff54635d700 1 -- 172.21.15.156:0/1844336338 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff5400a0a30 msgr2=0x7ff5400a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:11.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.002+0000 7ff54635d700 1 --2- 172.21.15.156:0/1844336338 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff5400a0a30 0x7ff5400a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.002+0000 7ff54635d700 1 -- 172.21.15.156:0/1844336338 >> v1:172.21.15.156:6789/0 conn(0x7ff5400a1340 legacy=0x7ff54012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:11.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.002+0000 7ff54635d700 1 -- 172.21.15.156:0/1844336338 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff54009abc0 con 0x7ff540130670 2023-09-30T22:19:11.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.002+0000 7ff54635d700 1 --2- 172.21.15.156:0/1844336338 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff540130670 0x7ff5401381c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff538009e80 tx=0x7ff53800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b6641a41f283ff0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:11.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.003+0000 7ff544b5a700 1 -- 172.21.15.156:0/1844336338 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53800e070 con 0x7ff540130670 2023-09-30T22:19:11.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.003+0000 7ff544b5a700 1 -- 172.21.15.156:0/1844336338 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53800b910 con 0x7ff540130670 2023-09-30T22:19:11.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.003+0000 7ff544b5a700 1 -- 172.21.15.156:0/1844336338 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53800bcc0 con 0x7ff540130670 2023-09-30T22:19:11.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.003+0000 7ff547dc0700 1 -- 172.21.15.156:0/1844336338 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff540130670 msgr2=0x7ff5401381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:11.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.003+0000 7ff547dc0700 1 --2- 172.21.15.156:0/1844336338 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff540130670 0x7ff5401381c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff538009e80 tx=0x7ff53800b330 comp rx=0 tx=0).stop 2023-09-30T22:19:11.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.003+0000 7ff547dc0700 1 -- 172.21.15.156:0/1844336338 shutdown_connections 2023-09-30T22:19:11.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.003+0000 7ff547dc0700 1 --2- 172.21.15.156:0/1844336338 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff5400a0a30 0x7ff5400a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.003+0000 7ff547dc0700 1 --2- 172.21.15.156:0/1844336338 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff540130670 0x7ff5401381c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.003+0000 7ff547dc0700 1 -- 172.21.15.156:0/1844336338 >> 172.21.15.156:0/1844336338 conn(0x7ff5400a2980 msgr2=0x7ff5400a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:11.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.003+0000 7ff547dc0700 1 -- 172.21.15.156:0/1844336338 shutdown_connections 2023-09-30T22:19:11.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.003+0000 7ff547dc0700 1 -- 172.21.15.156:0/1844336338 wait complete. 2023-09-30T22:19:11.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.004+0000 7ff547dc0700 1 Processor -- start 2023-09-30T22:19:11.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.004+0000 7ff547dc0700 1 -- start start 2023-09-30T22:19:11.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.005+0000 7ff547dc0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5400a0a30 0x7ff5401c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:11.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.005+0000 7ff547dc0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5400a1340 0x7ff5401c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:11.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.005+0000 7ff547dc0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff540130670 0x7ff5401c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:11.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.005+0000 7ff547dc0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5401209d0 con 0x7ff5400a1340 2023-09-30T22:19:11.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.005+0000 7ff547dc0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff540121170 con 0x7ff540130670 2023-09-30T22:19:11.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.005+0000 7ff547dc0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5401c90e0 con 0x7ff5400a0a30 2023-09-30T22:19:11.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.005+0000 7ff54535b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5400a1340 0x7ff5401c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:11.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.005+0000 7ff54635d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff540130670 0x7ff5401c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:11.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.005+0000 7ff54535b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5400a1340 0x7ff5401c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58994/0 (socket says 172.21.15.156:58994) 2023-09-30T22:19:11.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.005+0000 7ff54535b700 1 -- 172.21.15.156:0/1382296019 learned_addr learned my addr 172.21.15.156:0/1382296019 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:11.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.005+0000 7ff545b5c700 1 --2- 172.21.15.156:0/1382296019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5400a0a30 0x7ff5401c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:11.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.005+0000 7ff54635d700 1 -- 172.21.15.156:0/1382296019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5400a0a30 msgr2=0x7ff5401c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:11.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.005+0000 7ff54635d700 1 --2- 172.21.15.156:0/1382296019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5400a0a30 0x7ff5401c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.005+0000 7ff54635d700 1 -- 172.21.15.156:0/1382296019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5400a1340 msgr2=0x7ff5401c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:11.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.005+0000 7ff54635d700 1 --2- 172.21.15.156:0/1382296019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5400a1340 0x7ff5401c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.005+0000 7ff54635d700 1 -- 172.21.15.156:0/1382296019 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff538009b30 con 0x7ff540130670 2023-09-30T22:19:11.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.005+0000 7ff54535b700 1 --2- 172.21.15.156:0/1382296019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5400a1340 0x7ff5401c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:11.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.006+0000 7ff54635d700 1 --2- 172.21.15.156:0/1382296019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff540130670 0x7ff5401c4c40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff538015000 tx=0x7ff538004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:11.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.006+0000 7ff5367fc700 1 -- 172.21.15.156:0/1382296019 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff538004240 con 0x7ff540130670 2023-09-30T22:19:11.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.006+0000 7ff5367fc700 1 -- 172.21.15.156:0/1382296019 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5380043a0 con 0x7ff540130670 2023-09-30T22:19:11.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.006+0000 7ff547dc0700 1 -- 172.21.15.156:0/1382296019 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff54009fb30 con 0x7ff540130670 2023-09-30T22:19:11.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.006+0000 7ff5367fc700 1 -- 172.21.15.156:0/1382296019 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff538004730 con 0x7ff540130670 2023-09-30T22:19:11.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.006+0000 7ff547dc0700 1 -- 172.21.15.156:0/1382296019 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff540121ee0 con 0x7ff540130670 2023-09-30T22:19:11.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.007+0000 7ff5367fc700 1 -- 172.21.15.156:0/1382296019 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff538025460 con 0x7ff540130670 2023-09-30T22:19:11.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.007+0000 7ff547dc0700 1 -- 172.21.15.156:0/1382296019 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff54004f2a0 con 0x7ff540130670 2023-09-30T22:19:11.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.007+0000 7ff5367fc700 1 -- 172.21.15.156:0/1382296019 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7ff538041770 con 0x7ff540130670 2023-09-30T22:19:11.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.007+0000 7ff545b5c700 1 -- 172.21.15.156:0/1382296019 >> v1:172.21.15.156:6816/126965 conn(0x7ff52402f510 legacy=0x7ff5240319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:11.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.012+0000 7ff5367fc700 1 -- 172.21.15.156:0/1382296019 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff538025710 con 0x7ff540130670 2023-09-30T22:19:11.043 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:11.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.091+0000 7f2cbb751700 1 Processor -- start 2023-09-30T22:19:11.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.091+0000 7f2cbb751700 1 -- start start 2023-09-30T22:19:11.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.091+0000 7f2cbb751700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2cb4133ad0 0x7f2cb4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:11.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.091+0000 7f2cbb751700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2cb41300a0 0x7f2cb41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:11.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.091+0000 7f2cbb751700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb406b2d0 con 0x7f2cb41309f0 2023-09-30T22:19:11.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.091+0000 7f2cbb751700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb4133610 con 0x7f2cb4133ad0 2023-09-30T22:19:11.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.091+0000 7f2cbb751700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb409a500 con 0x7f2cb41300a0 2023-09-30T22:19:11.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.092+0000 7f2cb9cee700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f2cb41309f0 0x7f2cb413a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:33956/0 (socket says 172.21.15.156:33956) 2023-09-30T22:19:11.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.092+0000 7f2cb9cee700 1 -- 172.21.15.156:0/2895453493 learned_addr learned my addr 172.21.15.156:0/2895453493 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:11.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.092+0000 7f2cb8cec700 1 --2- 172.21.15.156:0/2895453493 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2cb41300a0 0x7f2cb41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:11.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.092+0000 7f2cb94ed700 1 --2- 172.21.15.156:0/2895453493 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2cb4133ad0 0x7f2cb4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:11.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.092+0000 7f2cb8cec700 1 -- 172.21.15.156:0/2895453493 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2cb4133ad0 msgr2=0x7f2cb4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:11.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.092+0000 7f2cabfff700 1 -- 172.21.15.156:0/2895453493 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4068343187 0 0) 0x7f2cb406b2d0 con 0x7f2cb41309f0 2023-09-30T22:19:11.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.092+0000 7f2cb8cec700 1 --2- 172.21.15.156:0/2895453493 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2cb4133ad0 0x7f2cb4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.092+0000 7f2cb8cec700 1 -- 172.21.15.156:0/2895453493 >> v1:172.21.15.156:6789/0 conn(0x7f2cb41309f0 legacy=0x7f2cb413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:11.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.092+0000 7f2cb8cec700 1 -- 172.21.15.156:0/2895453493 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb41338b0 con 0x7f2cb41300a0 2023-09-30T22:19:11.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.092+0000 7f2cb8cec700 1 --2- 172.21.15.156:0/2895453493 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2cb41300a0 0x7f2cb41304b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4009870 tx=0x7f2ca4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d7952ecba8339c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:11.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.092+0000 7f2cabfff700 1 -- 172.21.15.156:0/2895453493 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4011830 con 0x7f2cb41300a0 2023-09-30T22:19:11.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.092+0000 7f2cabfff700 1 -- 172.21.15.156:0/2895453493 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca4011990 con 0x7f2cb41300a0 2023-09-30T22:19:11.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.092+0000 7f2cabfff700 1 -- 172.21.15.156:0/2895453493 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4011d20 con 0x7f2cb41300a0 2023-09-30T22:19:11.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.093+0000 7f2cbb751700 1 -- 172.21.15.156:0/2895453493 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2cb41300a0 msgr2=0x7f2cb41304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:11.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.093+0000 7f2cbb751700 1 --2- 172.21.15.156:0/2895453493 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2cb41300a0 0x7f2cb41304b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4009870 tx=0x7f2ca4009b80 comp rx=0 tx=0).stop 2023-09-30T22:19:11.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.093+0000 7f2cbb751700 1 -- 172.21.15.156:0/2895453493 shutdown_connections 2023-09-30T22:19:11.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.093+0000 7f2cbb751700 1 --2- 172.21.15.156:0/2895453493 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2cb4133ad0 0x7f2cb4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.093+0000 7f2cbb751700 1 --2- 172.21.15.156:0/2895453493 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2cb41300a0 0x7f2cb41304b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.093+0000 7f2cbb751700 1 -- 172.21.15.156:0/2895453493 >> 172.21.15.156:0/2895453493 conn(0x7f2cb4099c40 msgr2=0x7f2cb40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:11.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.093+0000 7f2cbb751700 1 -- 172.21.15.156:0/2895453493 shutdown_connections 2023-09-30T22:19:11.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.094+0000 7f2cbb751700 1 -- 172.21.15.156:0/2895453493 wait complete. 2023-09-30T22:19:11.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.095+0000 7f2cbb751700 1 Processor -- start 2023-09-30T22:19:11.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.095+0000 7f2cbb751700 1 -- start start 2023-09-30T22:19:11.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.096+0000 7f2cbb751700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2cb41300a0 0x7f2cb411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:11.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.096+0000 7f2cbb751700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cb41309f0 0x7f2cb411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:11.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.096+0000 7f2cbb751700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2cb4133ad0 0x7f2cb411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:11.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.096+0000 7f2cbb751700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb411fd50 con 0x7f2cb41309f0 2023-09-30T22:19:11.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.096+0000 7f2cbb751700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb4120030 con 0x7f2cb4133ad0 2023-09-30T22:19:11.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.096+0000 7f2cbb751700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb40a3390 con 0x7f2cb41300a0 2023-09-30T22:19:11.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.096+0000 7f2cb94ed700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2cb41300a0 0x7f2cb411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:11.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.096+0000 7f2cb94ed700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2cb41300a0 0x7f2cb411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45568/0 (socket says 172.21.15.156:45568) 2023-09-30T22:19:11.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.096+0000 7f2cb94ed700 1 -- 172.21.15.156:0/1982011798 learned_addr learned my addr 172.21.15.156:0/1982011798 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:11.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.096+0000 7f2cb8cec700 1 --2- 172.21.15.156:0/1982011798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cb41309f0 0x7f2cb411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:11.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.096+0000 7f2cb9cee700 1 --2- 172.21.15.156:0/1982011798 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2cb4133ad0 0x7f2cb411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:11.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.096+0000 7f2cb94ed700 1 -- 172.21.15.156:0/1982011798 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2cb4133ad0 msgr2=0x7f2cb411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:11.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.096+0000 7f2cb94ed700 1 --2- 172.21.15.156:0/1982011798 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2cb4133ad0 0x7f2cb411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.096+0000 7f2cb94ed700 1 -- 172.21.15.156:0/1982011798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cb41309f0 msgr2=0x7f2cb411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:11.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.096+0000 7f2cb94ed700 1 --2- 172.21.15.156:0/1982011798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cb41309f0 0x7f2cb411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.096+0000 7f2cb94ed700 1 -- 172.21.15.156:0/1982011798 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca40094a0 con 0x7f2cb41300a0 2023-09-30T22:19:11.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.096+0000 7f2cb94ed700 1 --2- 172.21.15.156:0/1982011798 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2cb41300a0 0x7f2cb411da40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2cb000e9b0 tx=0x7f2cb000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:11.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.096+0000 7f2ca9ffb700 1 -- 172.21.15.156:0/1982011798 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb000ee50 con 0x7f2cb41300a0 2023-09-30T22:19:11.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.097+0000 7f2ca9ffb700 1 -- 172.21.15.156:0/1982011798 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb000c850 con 0x7f2cb41300a0 2023-09-30T22:19:11.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.097+0000 7f2cbb751700 1 -- 172.21.15.156:0/1982011798 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb412dd00 con 0x7f2cb41300a0 2023-09-30T22:19:11.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.097+0000 7f2ca9ffb700 1 -- 172.21.15.156:0/1982011798 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb000cbc0 con 0x7f2cb41300a0 2023-09-30T22:19:11.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.097+0000 7f2cbb751700 1 -- 172.21.15.156:0/1982011798 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb411ed90 con 0x7f2cb41300a0 2023-09-30T22:19:11.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.097+0000 7f2ca9ffb700 1 -- 172.21.15.156:0/1982011798 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2cb000cd20 con 0x7f2cb41300a0 2023-09-30T22:19:11.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.098+0000 7f2ca9ffb700 1 -- 172.21.15.156:0/1982011798 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f2cb00400a0 con 0x7f2cb41300a0 2023-09-30T22:19:11.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.098+0000 7f2cb8cec700 1 -- 172.21.15.156:0/1982011798 >> v1:172.21.15.156:6816/126965 conn(0x7f2c9802f510 legacy=0x7f2c980319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:11.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.098+0000 7f2cbb751700 1 -- 172.21.15.156:0/1982011798 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb411f9f0 con 0x7f2cb41300a0 2023-09-30T22:19:11.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.107+0000 7f2ca9ffb700 1 -- 172.21.15.156:0/1982011798 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2cb411f9f0 con 0x7f2cb41300a0 2023-09-30T22:19:11.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.143+0000 7f7b51d91700 1 Processor -- start 2023-09-30T22:19:11.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.143+0000 7f7b51d91700 1 -- start start 2023-09-30T22:19:11.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.143+0000 7f7b51d91700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b4c133b80 0x7f7b4c133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:11.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.143+0000 7f7b51d91700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7b4c099a60 0x7f7b4c0a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:11.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.144+0000 7f7b51d91700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4c09aa00 con 0x7f7b4c0a0e20 2023-09-30T22:19:11.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.144+0000 7f7b51d91700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b4c09a080 con 0x7f7b4c099a60 2023-09-30T22:19:11.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.144+0000 7f7b51d91700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c133750 con 0x7f7b4c133b80 2023-09-30T22:19:11.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.144+0000 7f7b4affd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7b4c099a60 0x7f7b4c0a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:11.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.144+0000 7f7b4b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b4c133b80 0x7f7b4c133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:11.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.144+0000 7f7b4affd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7b4c099a60 0x7f7b4c0a08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59002/0 (socket says 172.21.15.156:59002) 2023-09-30T22:19:11.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.144+0000 7f7b4affd700 1 -- 172.21.15.156:0/1323742688 learned_addr learned my addr 172.21.15.156:0/1323742688 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:11.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.144+0000 7f7b4bfff700 1 --1- 172.21.15.156:0/1323742688 >> v1:172.21.15.156:6789/0 conn(0x7f7b4c0a0e20 0x7f7b4c13a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:33972/0 (socket says 172.21.15.156:33972) 2023-09-30T22:19:11.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.144+0000 7f7b4b7fe700 1 -- 172.21.15.156:0/1323742688 >> v2:172.21.15.156:3300/0 conn(0x7f7b4c099a60 msgr2=0x7f7b4c0a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:11.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.144+0000 7f7b4b7fe700 1 --2- 172.21.15.156:0/1323742688 >> v2:172.21.15.156:3300/0 conn(0x7f7b4c099a60 0x7f7b4c0a08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.144+0000 7f7b4b7fe700 1 -- 172.21.15.156:0/1323742688 >> v1:172.21.15.156:6789/0 conn(0x7f7b4c0a0e20 legacy=0x7f7b4c13a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:11.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.144+0000 7f7b4b7fe700 1 -- 172.21.15.156:0/1323742688 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4c09a760 con 0x7f7b4c133b80 2023-09-30T22:19:11.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.144+0000 7f7b4b7fe700 1 --2- 172.21.15.156:0/1323742688 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b4c133b80 0x7f7b4c133f50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009820 tx=0x7f7b3c009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=853da0bf0d14886d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:11.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.145+0000 7f7b4a7fc700 1 -- 172.21.15.156:0/1323742688 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c005e30 con 0x7f7b4c133b80 2023-09-30T22:19:11.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.145+0000 7f7b4a7fc700 1 -- 172.21.15.156:0/1323742688 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c006030 con 0x7f7b4c133b80 2023-09-30T22:19:11.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.145+0000 7f7b4a7fc700 1 -- 172.21.15.156:0/1323742688 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c0063c0 con 0x7f7b4c133b80 2023-09-30T22:19:11.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.145+0000 7f7b51d91700 1 -- 172.21.15.156:0/1323742688 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b4c133b80 msgr2=0x7f7b4c133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:11.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.145+0000 7f7b51d91700 1 --2- 172.21.15.156:0/1323742688 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b4c133b80 0x7f7b4c133f50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009820 tx=0x7f7b3c009b30 comp rx=0 tx=0).stop 2023-09-30T22:19:11.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.146+0000 7f7b51d91700 1 -- 172.21.15.156:0/1323742688 shutdown_connections 2023-09-30T22:19:11.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.146+0000 7f7b51d91700 1 --2- 172.21.15.156:0/1323742688 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b4c133b80 0x7f7b4c133f50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.146+0000 7f7b51d91700 1 --2- 172.21.15.156:0/1323742688 >> v2:172.21.15.156:3300/0 conn(0x7f7b4c099a60 0x7f7b4c0a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.146+0000 7f7b51d91700 1 -- 172.21.15.156:0/1323742688 >> 172.21.15.156:0/1323742688 conn(0x7f7b4c0a2980 msgr2=0x7f7b4c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:11.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.146+0000 7f7b51d91700 1 -- 172.21.15.156:0/1323742688 shutdown_connections 2023-09-30T22:19:11.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.146+0000 7f7b51d91700 1 -- 172.21.15.156:0/1323742688 wait complete. 2023-09-30T22:19:11.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.147+0000 7f7b51d91700 1 Processor -- start 2023-09-30T22:19:11.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.147+0000 7f7b51d91700 1 -- start start 2023-09-30T22:19:11.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.148+0000 7f7b51d91700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b4c099a60 0x7f7b4c11fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:11.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.148+0000 7f7b51d91700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b4c0a0e20 0x7f7b4c120060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:11.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.148+0000 7f7b51d91700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b4c133b80 0x7f7b4c1205a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:11.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.148+0000 7f7b51d91700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c123640 con 0x7f7b4c133b80 2023-09-30T22:19:11.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.148+0000 7f7b51d91700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c09a2c0 con 0x7f7b4c0a0e20 2023-09-30T22:19:11.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.148+0000 7f7b51d91700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c1217d0 con 0x7f7b4c099a60 2023-09-30T22:19:11.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.148+0000 7f7b4affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b4c0a0e20 0x7f7b4c120060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:11.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.148+0000 7f7b4b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b4c099a60 0x7f7b4c11fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:11.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.148+0000 7f7b4affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b4c0a0e20 0x7f7b4c120060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48638/0 (socket says 172.21.15.156:48638) 2023-09-30T22:19:11.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.148+0000 7f7b4affd700 1 -- 172.21.15.156:0/1628541443 learned_addr learned my addr 172.21.15.156:0/1628541443 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:11.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.148+0000 7f7b4bfff700 1 --2- 172.21.15.156:0/1628541443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b4c133b80 0x7f7b4c1205a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:11.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.149+0000 7f7b4bfff700 1 -- 172.21.15.156:0/1628541443 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b4c099a60 msgr2=0x7f7b4c11fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:11.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.149+0000 7f7b4bfff700 1 --2- 172.21.15.156:0/1628541443 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b4c099a60 0x7f7b4c11fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.149+0000 7f7b4bfff700 1 -- 172.21.15.156:0/1628541443 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b4c0a0e20 msgr2=0x7f7b4c120060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:11.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.149+0000 7f7b4bfff700 1 --2- 172.21.15.156:0/1628541443 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b4c0a0e20 0x7f7b4c120060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.149+0000 7f7b4bfff700 1 -- 172.21.15.156:0/1628541443 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3c009430 con 0x7f7b4c133b80 2023-09-30T22:19:11.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.149+0000 7f7b4b7fe700 1 --2- 172.21.15.156:0/1628541443 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b4c099a60 0x7f7b4c11fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:11.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.149+0000 7f7b4affd700 1 --2- 172.21.15.156:0/1628541443 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b4c0a0e20 0x7f7b4c120060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:11.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.149+0000 7f7b4bfff700 1 --2- 172.21.15.156:0/1628541443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b4c133b80 0x7f7b4c1205a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400cb10 tx=0x7f7b4400ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:11.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.149+0000 7f7b33fff700 1 -- 172.21.15.156:0/1628541443 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4400a9e0 con 0x7f7b4c133b80 2023-09-30T22:19:11.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.149+0000 7f7b33fff700 1 -- 172.21.15.156:0/1628541443 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4400ab40 con 0x7f7b4c133b80 2023-09-30T22:19:11.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.149+0000 7f7b51d91700 1 -- 172.21.15.156:0/1628541443 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b4c130640 con 0x7f7b4c133b80 2023-09-30T22:19:11.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.149+0000 7f7b33fff700 1 -- 172.21.15.156:0/1628541443 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b44007070 con 0x7f7b4c133b80 2023-09-30T22:19:11.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.149+0000 7f7b51d91700 1 -- 172.21.15.156:0/1628541443 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4c1230f0 con 0x7f7b4c133b80 2023-09-30T22:19:11.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.150+0000 7f7b33fff700 1 -- 172.21.15.156:0/1628541443 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7b440071d0 con 0x7f7b4c133b80 2023-09-30T22:19:11.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.150+0000 7f7b33fff700 1 -- 172.21.15.156:0/1628541443 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f7b4403f7c0 con 0x7f7b4c133b80 2023-09-30T22:19:11.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.150+0000 7f7b4b7fe700 1 -- 172.21.15.156:0/1628541443 >> v1:172.21.15.156:6816/126965 conn(0x7f7b3802f510 legacy=0x7f7b380319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:11.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.150+0000 7f7b51d91700 1 -- 172.21.15.156:0/1628541443 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b4c04f2a0 con 0x7f7b4c133b80 2023-09-30T22:19:11.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.155+0000 7f7b33fff700 1 -- 172.21.15.156:0/1628541443 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7b44017070 con 0x7f7b4c133b80 2023-09-30T22:19:11.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.185+0000 7fae0e184700 1 Processor -- start 2023-09-30T22:19:11.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.185+0000 7fae0e184700 1 -- start start 2023-09-30T22:19:11.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.186+0000 7fae0e184700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fae0809a090 0x7fae0809e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:11.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.186+0000 7fae0e184700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae0809ee90 0x7fae0809f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:11.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.186+0000 7fae0e184700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae0813c470 0x7fae0813e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:11.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.186+0000 7fae0e184700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae0809a460 con 0x7fae0809a090 2023-09-30T22:19:11.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.186+0000 7fae0e184700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0806c0f0 con 0x7fae0813c470 2023-09-30T22:19:11.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.186+0000 7fae0e184700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae0809f7e0 con 0x7fae0809ee90 2023-09-30T22:19:11.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.186+0000 7fae06ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae0809ee90 0x7fae0809f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:11.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.186+0000 7fae06ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae0809ee90 0x7fae0809f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45600/0 (socket says 172.21.15.156:45600) 2023-09-30T22:19:11.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.186+0000 7fae06ffd700 1 -- 172.21.15.156:0/821348091 learned_addr learned my addr 172.21.15.156:0/821348091 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:11.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.186+0000 7fae07fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae0813c470 0x7fae0813e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:11.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.186+0000 7fae077fe700 1 --2- 172.21.15.156:0/821348091 >> v2:172.21.15.156:3300/0 conn(0x7fae0809a090 0x7fae0809e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:11.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.186+0000 7fae077fe700 1 -- 172.21.15.156:0/821348091 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae0809ee90 msgr2=0x7fae0809f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:11.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.186+0000 7fae077fe700 1 --2- 172.21.15.156:0/821348091 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae0809ee90 0x7fae0809f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.186+0000 7fae077fe700 1 -- 172.21.15.156:0/821348091 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae0813c470 msgr2=0x7fae0813e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:11.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.186+0000 7fae077fe700 1 --2- 172.21.15.156:0/821348091 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae0813c470 0x7fae0813e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.186+0000 7fae077fe700 1 -- 172.21.15.156:0/821348091 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0806bc80 con 0x7fae0809a090 2023-09-30T22:19:11.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.186+0000 7fae07fff700 1 --2- 172.21.15.156:0/821348091 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae0813c470 0x7fae0813e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:11.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.186+0000 7fae06ffd700 1 --2- 172.21.15.156:0/821348091 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae0809ee90 0x7fae0809f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:19:11.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.187+0000 7fae077fe700 1 --2- 172.21.15.156:0/821348091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae0809a090 0x7fae0809e950 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fadf8009880 tx=0x7fadf8009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9320d46a55a38f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:11.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.187+0000 7fae067fc700 1 -- 172.21.15.156:0/821348091 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8005e30 con 0x7fae0809a090 2023-09-30T22:19:11.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.187+0000 7fae067fc700 1 -- 172.21.15.156:0/821348091 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf8006030 con 0x7fae0809a090 2023-09-30T22:19:11.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.187+0000 7fae067fc700 1 -- 172.21.15.156:0/821348091 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf80063c0 con 0x7fae0809a090 2023-09-30T22:19:11.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.187+0000 7fae0e184700 1 -- 172.21.15.156:0/821348091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae0809a090 msgr2=0x7fae0809e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:11.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.187+0000 7fae0e184700 1 --2- 172.21.15.156:0/821348091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae0809a090 0x7fae0809e950 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fadf8009880 tx=0x7fadf8009b90 comp rx=0 tx=0).stop 2023-09-30T22:19:11.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.187+0000 7fae0e184700 1 -- 172.21.15.156:0/821348091 shutdown_connections 2023-09-30T22:19:11.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.187+0000 7fae0e184700 1 --2- 172.21.15.156:0/821348091 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae0813c470 0x7fae0813e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.187+0000 7fae0e184700 1 --2- 172.21.15.156:0/821348091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae0809a090 0x7fae0809e950 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.187+0000 7fae0e184700 1 --2- 172.21.15.156:0/821348091 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae0809ee90 0x7fae0809f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.187+0000 7fae0e184700 1 -- 172.21.15.156:0/821348091 >> 172.21.15.156:0/821348091 conn(0x7fae080a0f70 msgr2=0x7fae080a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:11.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.187+0000 7fae0e184700 1 -- 172.21.15.156:0/821348091 shutdown_connections 2023-09-30T22:19:11.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.188+0000 7fae0e184700 1 -- 172.21.15.156:0/821348091 wait complete. 2023-09-30T22:19:11.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.188+0000 7fae0e184700 1 Processor -- start 2023-09-30T22:19:11.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.189+0000 7fae0e184700 1 -- start start 2023-09-30T22:19:11.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.189+0000 7fae0e184700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae0809a090 0x7fae08127340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:11.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.189+0000 7fae0e184700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae0809ee90 0x7fae08127880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:11.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.189+0000 7fae0e184700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae0813c470 0x7fae08127dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:11.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.189+0000 7fae0e184700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0811e4c0 con 0x7fae0809ee90 2023-09-30T22:19:11.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.189+0000 7fae0e184700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0813af70 con 0x7fae0813c470 2023-09-30T22:19:11.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.189+0000 7fae0e184700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae0809e0b0 con 0x7fae0809a090 2023-09-30T22:19:11.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.189+0000 7fae077fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae0809a090 0x7fae08127340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:11.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.189+0000 7fae077fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae0809a090 0x7fae08127340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45602/0 (socket says 172.21.15.156:45602) 2023-09-30T22:19:11.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.189+0000 7fae077fe700 1 -- 172.21.15.156:0/908642921 learned_addr learned my addr 172.21.15.156:0/908642921 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:11.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.189+0000 7fae07fff700 1 --2- 172.21.15.156:0/908642921 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae0813c470 0x7fae08127dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:11.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.189+0000 7fae06ffd700 1 --2- 172.21.15.156:0/908642921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae0809ee90 0x7fae08127880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:11.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.190+0000 7fae06ffd700 1 -- 172.21.15.156:0/908642921 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae0809a090 msgr2=0x7fae08127340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:11.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.190+0000 7fae06ffd700 1 --2- 172.21.15.156:0/908642921 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae0809a090 0x7fae08127340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.190+0000 7fae06ffd700 1 -- 172.21.15.156:0/908642921 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae0813c470 msgr2=0x7fae08127dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:11.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.190+0000 7fae06ffd700 1 --2- 172.21.15.156:0/908642921 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae0813c470 0x7fae08127dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.190+0000 7fae06ffd700 1 -- 172.21.15.156:0/908642921 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae00009a70 con 0x7fae0809ee90 2023-09-30T22:19:11.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.190+0000 7fae06ffd700 1 --2- 172.21.15.156:0/908642921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae0809ee90 0x7fae08127880 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00d800 tx=0x7fadfc00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:11.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.190+0000 7fadeffff700 1 -- 172.21.15.156:0/908642921 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc004030 con 0x7fae0809ee90 2023-09-30T22:19:11.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.190+0000 7fadeffff700 1 -- 172.21.15.156:0/908642921 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc004190 con 0x7fae0809ee90 2023-09-30T22:19:11.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.190+0000 7fadeffff700 1 -- 172.21.15.156:0/908642921 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc004500 con 0x7fae0809ee90 2023-09-30T22:19:11.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.190+0000 7fae0e184700 1 -- 172.21.15.156:0/908642921 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf8009430 con 0x7fae0809ee90 2023-09-30T22:19:11.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.190+0000 7fae0e184700 1 -- 172.21.15.156:0/908642921 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae081287a0 con 0x7fae0809ee90 2023-09-30T22:19:11.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.191+0000 7fae0e184700 1 -- 172.21.15.156:0/908642921 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae080a0460 con 0x7fae0809ee90 2023-09-30T22:19:11.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.191+0000 7fadeffff700 1 -- 172.21.15.156:0/908642921 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fadfc0036a0 con 0x7fae0809ee90 2023-09-30T22:19:11.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.191+0000 7fadeffff700 1 -- 172.21.15.156:0/908642921 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fadfc03f210 con 0x7fae0809ee90 2023-09-30T22:19:11.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.191+0000 7fae077fe700 1 -- 172.21.15.156:0/908642921 >> v1:172.21.15.156:6816/126965 conn(0x7fadf402f510 legacy=0x7fadf40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:11.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.200+0000 7fadeffff700 1 -- 172.21.15.156:0/908642921 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fadfc011bc0 con 0x7fae0809ee90 2023-09-30T22:19:11.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.208+0000 7ff545b5c700 1 -- 172.21.15.156:0/1382296019 >> v1:172.21.15.156:6816/126965 conn(0x7ff52402f510 legacy=0x7ff5240319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:11.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.221+0000 7ff547dc0700 1 -- 172.21.15.156:0/1382296019 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff540123140 con 0x7ff540130670 2023-09-30T22:19:11.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.221+0000 7ff5367fc700 1 -- 172.21.15.156:0/1382296019 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff53802a020 con 0x7ff540130670 2023-09-30T22:19:11.222 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:11.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.223+0000 7ff547dc0700 1 -- 172.21.15.156:0/1382296019 >> v1:172.21.15.156:6816/126965 conn(0x7ff52402f510 legacy=0x7ff5240319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:11.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.223+0000 7ff547dc0700 1 -- 172.21.15.156:0/1382296019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff540130670 msgr2=0x7ff5401c4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:11.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.223+0000 7ff547dc0700 1 --2- 172.21.15.156:0/1382296019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff540130670 0x7ff5401c4c40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff538015000 tx=0x7ff538004ad0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.223+0000 7ff547dc0700 1 -- 172.21.15.156:0/1382296019 shutdown_connections 2023-09-30T22:19:11.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.223+0000 7ff547dc0700 1 --2- 172.21.15.156:0/1382296019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff540130670 0x7ff5401c4c40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.223+0000 7ff547dc0700 1 --2- 172.21.15.156:0/1382296019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5400a0a30 0x7ff5401c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.223+0000 7ff547dc0700 1 --2- 172.21.15.156:0/1382296019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5400a1340 0x7ff5401c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.223+0000 7ff547dc0700 1 -- 172.21.15.156:0/1382296019 >> 172.21.15.156:0/1382296019 conn(0x7ff5400a2980 msgr2=0x7ff5401b7880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:11.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.223+0000 7ff547dc0700 1 -- 172.21.15.156:0/1382296019 shutdown_connections 2023-09-30T22:19:11.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.223+0000 7ff547dc0700 1 -- 172.21.15.156:0/1382296019 wait complete. 2023-09-30T22:19:11.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:11.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.299+0000 7f2cb8cec700 1 -- 172.21.15.156:0/1982011798 >> v1:172.21.15.156:6816/126965 conn(0x7f2c9802f510 legacy=0x7f2c980319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:11.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.316+0000 7f2cbb751700 1 -- 172.21.15.156:0/1982011798 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2cb411fbb0 con 0x7f2cb41300a0 2023-09-30T22:19:11.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.316+0000 7f2ca9ffb700 1 -- 172.21.15.156:0/1982011798 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2cb411fbb0 con 0x7f2cb41300a0 2023-09-30T22:19:11.317 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:11.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.319+0000 7f2cbb751700 1 -- 172.21.15.156:0/1982011798 >> v1:172.21.15.156:6816/126965 conn(0x7f2c9802f510 legacy=0x7f2c980319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:11.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.319+0000 7f2cbb751700 1 -- 172.21.15.156:0/1982011798 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2cb41300a0 msgr2=0x7f2cb411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:11.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.319+0000 7f2cbb751700 1 --2- 172.21.15.156:0/1982011798 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2cb41300a0 0x7f2cb411da40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2cb000e9b0 tx=0x7f2cb000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.319+0000 7f2cbb751700 1 -- 172.21.15.156:0/1982011798 shutdown_connections 2023-09-30T22:19:11.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.319+0000 7f2cbb751700 1 --2- 172.21.15.156:0/1982011798 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2cb4133ad0 0x7f2cb411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.319+0000 7f2cbb751700 1 --2- 172.21.15.156:0/1982011798 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2cb41300a0 0x7f2cb411da40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.319+0000 7f2cbb751700 1 --2- 172.21.15.156:0/1982011798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cb41309f0 0x7f2cb411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.319+0000 7f2cbb751700 1 -- 172.21.15.156:0/1982011798 >> 172.21.15.156:0/1982011798 conn(0x7f2cb4099c40 msgr2=0x7f2cb4132a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:11.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.319+0000 7f2cbb751700 1 -- 172.21.15.156:0/1982011798 shutdown_connections 2023-09-30T22:19:11.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.319+0000 7f2cbb751700 1 -- 172.21.15.156:0/1982011798 wait complete. 2023-09-30T22:19:11.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:11.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.351+0000 7f7b4b7fe700 1 -- 172.21.15.156:0/1628541443 >> v1:172.21.15.156:6816/126965 conn(0x7f7b3802f510 legacy=0x7f7b380319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:11.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.366+0000 7f7b51d91700 1 -- 172.21.15.156:0/1628541443 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7b4c123e30 con 0x7f7b4c133b80 2023-09-30T22:19:11.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.366+0000 7f7b33fff700 1 -- 172.21.15.156:0/1628541443 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7b44017070 con 0x7f7b4c133b80 2023-09-30T22:19:11.367 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:11.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.368+0000 7f7b51d91700 1 -- 172.21.15.156:0/1628541443 >> v1:172.21.15.156:6816/126965 conn(0x7f7b3802f510 legacy=0x7f7b380319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:11.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.368+0000 7f7b51d91700 1 -- 172.21.15.156:0/1628541443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b4c133b80 msgr2=0x7f7b4c1205a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:11.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.368+0000 7f7b51d91700 1 --2- 172.21.15.156:0/1628541443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b4c133b80 0x7f7b4c1205a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400cb10 tx=0x7f7b4400ce20 comp rx=0 tx=0).stop 2023-09-30T22:19:11.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.369+0000 7f7b51d91700 1 -- 172.21.15.156:0/1628541443 shutdown_connections 2023-09-30T22:19:11.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.369+0000 7f7b51d91700 1 --2- 172.21.15.156:0/1628541443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b4c133b80 0x7f7b4c1205a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.369+0000 7f7b51d91700 1 --2- 172.21.15.156:0/1628541443 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b4c099a60 0x7f7b4c11fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.369+0000 7f7b51d91700 1 --2- 172.21.15.156:0/1628541443 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b4c0a0e20 0x7f7b4c120060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.369+0000 7f7b51d91700 1 -- 172.21.15.156:0/1628541443 >> 172.21.15.156:0/1628541443 conn(0x7f7b4c0a2980 msgr2=0x7f7b4c132360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:11.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.369+0000 7f7b51d91700 1 -- 172.21.15.156:0/1628541443 shutdown_connections 2023-09-30T22:19:11.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.369+0000 7f7b51d91700 1 -- 172.21.15.156:0/1628541443 wait complete. 2023-09-30T22:19:11.381 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:11.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.392+0000 7fae077fe700 1 -- 172.21.15.156:0/908642921 >> v1:172.21.15.156:6816/126965 conn(0x7fadf402f510 legacy=0x7fadf40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:11.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.396+0000 7fae0e184700 1 -- 172.21.15.156:0/908642921 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fae08128560 con 0x7fae0809ee90 2023-09-30T22:19:11.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.396+0000 7fadeffff700 1 -- 172.21.15.156:0/908642921 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fadfc018020 con 0x7fae0809ee90 2023-09-30T22:19:11.396 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:11.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.398+0000 7fae0e184700 1 -- 172.21.15.156:0/908642921 >> v1:172.21.15.156:6816/126965 conn(0x7fadf402f510 legacy=0x7fadf40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:11.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.398+0000 7fae0e184700 1 -- 172.21.15.156:0/908642921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae0809ee90 msgr2=0x7fae08127880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:11.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.398+0000 7fae0e184700 1 --2- 172.21.15.156:0/908642921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae0809ee90 0x7fae08127880 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00d800 tx=0x7fadfc00db10 comp rx=0 tx=0).stop 2023-09-30T22:19:11.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.398+0000 7fae0e184700 1 -- 172.21.15.156:0/908642921 shutdown_connections 2023-09-30T22:19:11.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.398+0000 7fae0e184700 1 --2- 172.21.15.156:0/908642921 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae0813c470 0x7fae08127dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.398+0000 7fae0e184700 1 --2- 172.21.15.156:0/908642921 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae0809a090 0x7fae08127340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.398+0000 7fae0e184700 1 --2- 172.21.15.156:0/908642921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae0809ee90 0x7fae08127880 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:11.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.398+0000 7fae0e184700 1 -- 172.21.15.156:0/908642921 >> 172.21.15.156:0/908642921 conn(0x7fae080a0f70 msgr2=0x7fae0813b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:11.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.398+0000 7fae0e184700 1 -- 172.21.15.156:0/908642921 shutdown_connections 2023-09-30T22:19:11.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:11.398+0000 7fae0e184700 1 -- 172.21.15.156:0/908642921 wait complete. 2023-09-30T22:19:11.411 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:12.238 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:12.337 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:12.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.373+0000 7f0ddaa34700 1 Processor -- start 2023-09-30T22:19:12.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.373+0000 7f0ddaa34700 1 -- start start 2023-09-30T22:19:12.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.374+0000 7f0ddaa34700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0dd40a1570 0x7f0dd4138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:12.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.374+0000 7f0ddaa34700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0dd41393c0 0x7f0dd413b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:12.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.374+0000 7f0ddaa34700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dd40a1fe0 con 0x7f0dd40a0a90 2023-09-30T22:19:12.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.374+0000 7f0ddaa34700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd40a3aa0 con 0x7f0dd40a1570 2023-09-30T22:19:12.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.374+0000 7f0ddaa34700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd409a540 con 0x7f0dd41393c0 2023-09-30T22:19:12.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.374+0000 7f0dd37fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0dd40a1570 0x7f0dd4138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:12.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.374+0000 7f0dd8fd1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0dd41393c0 0x7f0dd413b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:12.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.374+0000 7f0dd37fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0dd40a1570 0x7f0dd4138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40138/0 (socket says 172.21.15.156:40138) 2023-09-30T22:19:12.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.374+0000 7f0dd37fe700 1 -- 172.21.15.156:0/2289696185 learned_addr learned my addr 172.21.15.156:0/2289696185 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:12.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.374+0000 7f0dd8fd1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0dd41393c0 0x7f0dd413b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48196/0 (socket says 172.21.15.156:48196) 2023-09-30T22:19:12.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.374+0000 7f0dd8fd1700 1 -- 172.21.15.156:0/2289696185 >> v2:172.21.15.156:3300/0 conn(0x7f0dd40a1570 msgr2=0x7f0dd4138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:12.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.374+0000 7f0dd8fd1700 1 --2- 172.21.15.156:0/2289696185 >> v2:172.21.15.156:3300/0 conn(0x7f0dd40a1570 0x7f0dd4138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.374+0000 7f0dd8fd1700 1 -- 172.21.15.156:0/2289696185 >> v1:172.21.15.156:6789/0 conn(0x7f0dd40a0a90 legacy=0x7f0dd40a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:12.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.374+0000 7f0dd8fd1700 1 -- 172.21.15.156:0/2289696185 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd409a280 con 0x7f0dd41393c0 2023-09-30T22:19:12.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.374+0000 7f0dd37fe700 1 --2- 172.21.15.156:0/2289696185 >> v2:172.21.15.156:3300/0 conn(0x7f0dd40a1570 0x7f0dd4138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:12.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.374+0000 7f0dd8fd1700 1 --2- 172.21.15.156:0/2289696185 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0dd41393c0 0x7f0dd413b7a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc009d90 tx=0x7f0dcc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a21278784cfeee1f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:12.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.374+0000 7f0dd2ffd700 1 -- 172.21.15.156:0/2289696185 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc00e070 con 0x7f0dd41393c0 2023-09-30T22:19:12.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.374+0000 7f0dd2ffd700 1 -- 172.21.15.156:0/2289696185 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dcc00bb20 con 0x7f0dd41393c0 2023-09-30T22:19:12.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.374+0000 7f0dd2ffd700 1 -- 172.21.15.156:0/2289696185 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc012430 con 0x7f0dd41393c0 2023-09-30T22:19:12.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.375+0000 7f0ddaa34700 1 -- 172.21.15.156:0/2289696185 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0dd41393c0 msgr2=0x7f0dd413b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:12.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.375+0000 7f0ddaa34700 1 --2- 172.21.15.156:0/2289696185 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0dd41393c0 0x7f0dd413b7a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc009d90 tx=0x7f0dcc00b330 comp rx=0 tx=0).stop 2023-09-30T22:19:12.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.375+0000 7f0ddaa34700 1 -- 172.21.15.156:0/2289696185 shutdown_connections 2023-09-30T22:19:12.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.375+0000 7f0ddaa34700 1 --2- 172.21.15.156:0/2289696185 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0dd41393c0 0x7f0dd413b7a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.375+0000 7f0ddaa34700 1 --2- 172.21.15.156:0/2289696185 >> v2:172.21.15.156:3300/0 conn(0x7f0dd40a1570 0x7f0dd4138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.375+0000 7f0ddaa34700 1 -- 172.21.15.156:0/2289696185 >> 172.21.15.156:0/2289696185 conn(0x7f0dd4099c40 msgr2=0x7f0dd406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:12.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.375+0000 7f0ddaa34700 1 -- 172.21.15.156:0/2289696185 shutdown_connections 2023-09-30T22:19:12.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.375+0000 7f0ddaa34700 1 -- 172.21.15.156:0/2289696185 wait complete. 2023-09-30T22:19:12.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.376+0000 7f0ddaa34700 1 Processor -- start 2023-09-30T22:19:12.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.376+0000 7f0ddaa34700 1 -- start start 2023-09-30T22:19:12.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.377+0000 7f0ddaa34700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dd40a0a90 0x7f0dd4122b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:12.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.377+0000 7f0ddaa34700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0dd40a1570 0x7f0dd4123080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:12.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.377+0000 7f0ddaa34700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0dd41393c0 0x7f0dd41235c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:12.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.377+0000 7f0ddaa34700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd4124860 con 0x7f0dd40a0a90 2023-09-30T22:19:12.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.377+0000 7f0ddaa34700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd409c7e0 con 0x7f0dd41393c0 2023-09-30T22:19:12.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.377+0000 7f0ddaa34700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd4138c70 con 0x7f0dd40a1570 2023-09-30T22:19:12.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.377+0000 7f0dd3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dd40a0a90 0x7f0dd4122b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:12.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.377+0000 7f0dd8fd1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0dd41393c0 0x7f0dd41235c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:12.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.377+0000 7f0dd8fd1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0dd41393c0 0x7f0dd41235c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52620/0 (socket says 172.21.15.156:52620) 2023-09-30T22:19:12.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.377+0000 7f0dd3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dd40a0a90 0x7f0dd4122b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40144/0 (socket says 172.21.15.156:40144) 2023-09-30T22:19:12.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.377+0000 7f0dd8fd1700 1 -- 172.21.15.156:0/561746456 learned_addr learned my addr 172.21.15.156:0/561746456 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:12.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.377+0000 7f0dd37fe700 1 --2- 172.21.15.156:0/561746456 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0dd40a1570 0x7f0dd4123080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:12.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.377+0000 7f0dd3fff700 1 -- 172.21.15.156:0/561746456 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0dd40a1570 msgr2=0x7f0dd4123080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:12.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.377+0000 7f0dd3fff700 1 --2- 172.21.15.156:0/561746456 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0dd40a1570 0x7f0dd4123080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.377+0000 7f0dd3fff700 1 -- 172.21.15.156:0/561746456 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0dd41393c0 msgr2=0x7f0dd41235c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:12.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.377+0000 7f0dd3fff700 1 --2- 172.21.15.156:0/561746456 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0dd41393c0 0x7f0dd41235c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.377+0000 7f0dd3fff700 1 -- 172.21.15.156:0/561746456 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc8009550 con 0x7f0dd40a0a90 2023-09-30T22:19:12.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.377+0000 7f0dd3fff700 1 --2- 172.21.15.156:0/561746456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dd40a0a90 0x7f0dd4122b40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4000f60 tx=0x7f0dc400c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:12.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.377+0000 7f0dd0ff9700 1 -- 172.21.15.156:0/561746456 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc40052d0 con 0x7f0dd40a0a90 2023-09-30T22:19:12.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.377+0000 7f0dd0ff9700 1 -- 172.21.15.156:0/561746456 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc4005430 con 0x7f0dd40a0a90 2023-09-30T22:19:12.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.377+0000 7f0dd0ff9700 1 -- 172.21.15.156:0/561746456 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc40038c0 con 0x7f0dd40a0a90 2023-09-30T22:19:12.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.377+0000 7f0ddaa34700 1 -- 172.21.15.156:0/561746456 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dcc009a70 con 0x7f0dd40a0a90 2023-09-30T22:19:12.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.377+0000 7f0ddaa34700 1 -- 172.21.15.156:0/561746456 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd409b130 con 0x7f0dd40a0a90 2023-09-30T22:19:12.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.378+0000 7f0dd0ff9700 1 -- 172.21.15.156:0/561746456 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0dc4003a20 con 0x7f0dd40a0a90 2023-09-30T22:19:12.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.378+0000 7f0ddaa34700 1 -- 172.21.15.156:0/561746456 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd40a10d0 con 0x7f0dd40a0a90 2023-09-30T22:19:12.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.378+0000 7f0dd37fe700 1 -- 172.21.15.156:0/561746456 >> v1:172.21.15.156:6816/126965 conn(0x7f0dc002f510 legacy=0x7f0dc00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:12.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.378+0000 7f0dd0ff9700 1 -- 172.21.15.156:0/561746456 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f0dc403eef0 con 0x7f0dd40a0a90 2023-09-30T22:19:12.383 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:12.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.383+0000 7f0dd0ff9700 1 -- 172.21.15.156:0/561746456 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0dc400ce30 con 0x7f0dd40a0a90 2023-09-30T22:19:12.411 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:12.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.470+0000 7ff5b7fa2700 1 Processor -- start 2023-09-30T22:19:12.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.470+0000 7ff5b7fa2700 1 -- start start 2023-09-30T22:19:12.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.470+0000 7ff5b7fa2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5b009d860 0x7ff5b009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:12.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.470+0000 7ff5b7fa2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff5b0130eb0 0x7ff5b0138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:12.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.470+0000 7ff5b7fa2700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b009aaa0 con 0x7ff5b009e170 2023-09-30T22:19:12.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.470+0000 7ff5b7fa2700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b009f870 con 0x7ff5b0130eb0 2023-09-30T22:19:12.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.470+0000 7ff5b7fa2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b009b360 con 0x7ff5b009d860 2023-09-30T22:19:12.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.470+0000 7ff5b5d3e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5b009d860 0x7ff5b009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:12.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.470+0000 7ff5b5d3e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5b009d860 0x7ff5b009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48216/0 (socket says 172.21.15.156:48216) 2023-09-30T22:19:12.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.470+0000 7ff5b5d3e700 1 -- 172.21.15.156:0/1598349480 learned_addr learned my addr 172.21.15.156:0/1598349480 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:12.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.470+0000 7ff5b653f700 1 --2- 172.21.15.156:0/1598349480 >> v2:172.21.15.156:3300/0 conn(0x7ff5b0130eb0 0x7ff5b0138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:12.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.471+0000 7ff5b4d3c700 1 -- 172.21.15.156:0/1598349480 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 94950953 0 0) 0x7ff5b009aaa0 con 0x7ff5b009e170 2023-09-30T22:19:12.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.471+0000 7ff5b4d3c700 1 -- 172.21.15.156:0/1598349480 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff59c0057c0 con 0x7ff5b009e170 2023-09-30T22:19:12.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.471+0000 7ff5b5d3e700 1 -- 172.21.15.156:0/1598349480 >> v2:172.21.15.156:3300/0 conn(0x7ff5b0130eb0 msgr2=0x7ff5b0138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:12.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.471+0000 7ff5b5d3e700 1 --2- 172.21.15.156:0/1598349480 >> v2:172.21.15.156:3300/0 conn(0x7ff5b0130eb0 0x7ff5b0138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.471+0000 7ff5b5d3e700 1 -- 172.21.15.156:0/1598349480 >> v1:172.21.15.156:6789/0 conn(0x7ff5b009e170 legacy=0x7ff5b01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:12.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.471+0000 7ff5b5d3e700 1 -- 172.21.15.156:0/1598349480 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b009b620 con 0x7ff5b009d860 2023-09-30T22:19:12.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.471+0000 7ff5b653f700 1 --2- 172.21.15.156:0/1598349480 >> v2:172.21.15.156:3300/0 conn(0x7ff5b0130eb0 0x7ff5b0138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:12.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.471+0000 7ff5b5d3e700 1 --2- 172.21.15.156:0/1598349480 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5b009d860 0x7ff5b009dc30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0098f0 tx=0x7ff5ac009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a62b6d3341716161 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:12.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.471+0000 7ff5b4d3c700 1 -- 172.21.15.156:0/1598349480 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac011830 con 0x7ff5b009d860 2023-09-30T22:19:12.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.471+0000 7ff5b4d3c700 1 -- 172.21.15.156:0/1598349480 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ac011990 con 0x7ff5b009d860 2023-09-30T22:19:12.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.471+0000 7ff5b4d3c700 1 -- 172.21.15.156:0/1598349480 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac011d00 con 0x7ff5b009d860 2023-09-30T22:19:12.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.472+0000 7ff5b7fa2700 1 -- 172.21.15.156:0/1598349480 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5b009d860 msgr2=0x7ff5b009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:12.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.472+0000 7ff5b7fa2700 1 --2- 172.21.15.156:0/1598349480 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5b009d860 0x7ff5b009dc30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0098f0 tx=0x7ff5ac009c00 comp rx=0 tx=0).stop 2023-09-30T22:19:12.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.472+0000 7ff5b7fa2700 1 -- 172.21.15.156:0/1598349480 shutdown_connections 2023-09-30T22:19:12.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.472+0000 7ff5b7fa2700 1 --2- 172.21.15.156:0/1598349480 >> v2:172.21.15.156:3300/0 conn(0x7ff5b0130eb0 0x7ff5b0138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.472+0000 7ff5b7fa2700 1 --2- 172.21.15.156:0/1598349480 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5b009d860 0x7ff5b009dc30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.472+0000 7ff5b7fa2700 1 -- 172.21.15.156:0/1598349480 >> 172.21.15.156:0/1598349480 conn(0x7ff5b0099c40 msgr2=0x7ff5b00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:12.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.472+0000 7ff5b7fa2700 1 -- 172.21.15.156:0/1598349480 shutdown_connections 2023-09-30T22:19:12.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.472+0000 7ff5b7fa2700 1 -- 172.21.15.156:0/1598349480 wait complete. 2023-09-30T22:19:12.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.474+0000 7ff5b7fa2700 1 Processor -- start 2023-09-30T22:19:12.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.474+0000 7ff5b7fa2700 1 -- start start 2023-09-30T22:19:12.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.474+0000 7ff5b7fa2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5b009d860 0x7ff5b0122720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:12.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.474+0000 7ff5b7fa2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5b009e170 0x7ff5b0122c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:12.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.474+0000 7ff5b7fa2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff5b0130eb0 0x7ff5b01231a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:12.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.474+0000 7ff5b7fa2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b0125ec0 con 0x7ff5b009d860 2023-09-30T22:19:12.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.474+0000 7ff5b7fa2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b01243a0 con 0x7ff5b0130eb0 2023-09-30T22:19:12.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.474+0000 7ff5b7fa2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b00a0730 con 0x7ff5b009e170 2023-09-30T22:19:12.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.474+0000 7ff5b553d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5b009e170 0x7ff5b0122c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:12.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.474+0000 7ff5b5d3e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5b009d860 0x7ff5b0122720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:12.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.474+0000 7ff5b553d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5b009e170 0x7ff5b0122c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48218/0 (socket says 172.21.15.156:48218) 2023-09-30T22:19:12.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.474+0000 7ff5b5d3e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5b009d860 0x7ff5b0122720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40168/0 (socket says 172.21.15.156:40168) 2023-09-30T22:19:12.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.474+0000 7ff5b553d700 1 -- 172.21.15.156:0/2704993167 learned_addr learned my addr 172.21.15.156:0/2704993167 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:12.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.475+0000 7ff5b653f700 1 --2- 172.21.15.156:0/2704993167 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff5b0130eb0 0x7ff5b01231a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:12.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.475+0000 7ff5b5d3e700 1 -- 172.21.15.156:0/2704993167 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5b009e170 msgr2=0x7ff5b0122c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:12.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.475+0000 7ff5b5d3e700 1 --2- 172.21.15.156:0/2704993167 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5b009e170 0x7ff5b0122c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.475+0000 7ff5b5d3e700 1 -- 172.21.15.156:0/2704993167 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff5b0130eb0 msgr2=0x7ff5b01231a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:12.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.475+0000 7ff5b5d3e700 1 --2- 172.21.15.156:0/2704993167 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff5b0130eb0 0x7ff5b01231a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.475+0000 7ff5b5d3e700 1 -- 172.21.15.156:0/2704993167 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a8009a70 con 0x7ff5b009d860 2023-09-30T22:19:12.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.475+0000 7ff5b5d3e700 1 --2- 172.21.15.156:0/2704993167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5b009d860 0x7ff5b0122720 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac016000 tx=0x7ff5ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:12.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.475+0000 7ff5a67fc700 1 -- 172.21.15.156:0/2704993167 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac0042c0 con 0x7ff5b009d860 2023-09-30T22:19:12.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.476+0000 7ff5a67fc700 1 -- 172.21.15.156:0/2704993167 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ac01f070 con 0x7ff5b009d860 2023-09-30T22:19:12.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.476+0000 7ff5a67fc700 1 -- 172.21.15.156:0/2704993167 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac006bb0 con 0x7ff5b009d860 2023-09-30T22:19:12.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.476+0000 7ff5b7fa2700 1 -- 172.21.15.156:0/2704993167 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ac009550 con 0x7ff5b009d860 2023-09-30T22:19:12.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.476+0000 7ff5b7fa2700 1 -- 172.21.15.156:0/2704993167 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b009c900 con 0x7ff5b009d860 2023-09-30T22:19:12.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.477+0000 7ff5b7fa2700 1 -- 172.21.15.156:0/2704993167 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b01269f0 con 0x7ff5b009d860 2023-09-30T22:19:12.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.477+0000 7ff5a67fc700 1 -- 172.21.15.156:0/2704993167 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff5ac021070 con 0x7ff5b009d860 2023-09-30T22:19:12.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.478+0000 7ff5a67fc700 1 -- 172.21.15.156:0/2704993167 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7ff5ac040bc0 con 0x7ff5b009d860 2023-09-30T22:19:12.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.478+0000 7ff5b553d700 1 -- 172.21.15.156:0/2704993167 >> v1:172.21.15.156:6816/126965 conn(0x7ff59402f510 legacy=0x7ff5940319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:12.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.486+0000 7ff5a67fc700 1 -- 172.21.15.156:0/2704993167 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff5ac0193b0 con 0x7ff5b009d860 2023-09-30T22:19:12.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.516+0000 7f7049123700 1 Processor -- start 2023-09-30T22:19:12.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.517+0000 7f7049123700 1 -- start start 2023-09-30T22:19:12.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.517+0000 7f7049123700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f704412cef0 0x7f704412d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:12.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.517+0000 7f7049123700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7044133540 0x7f7044133910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:12.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.517+0000 7f7049123700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f704409ac40 con 0x7f7044133e50 2023-09-30T22:19:12.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.517+0000 7f7049123700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f704409a740 con 0x7f704412cef0 2023-09-30T22:19:12.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.517+0000 7f7049123700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704409f3a0 con 0x7f7044133540 2023-09-30T22:19:12.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.517+0000 7f704259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7044133540 0x7f7044133910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:12.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.517+0000 7f704259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7044133540 0x7f7044133910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52638/0 (socket says 172.21.15.156:52638) 2023-09-30T22:19:12.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.517+0000 7f704259c700 1 -- 172.21.15.156:0/2487478641 learned_addr learned my addr 172.21.15.156:0/2487478641 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:12.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.518+0000 7f704259c700 1 -- 172.21.15.156:0/2487478641 >> v2:172.21.15.156:3300/0 conn(0x7f704412cef0 msgr2=0x7f704412d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:12.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.518+0000 7f704259c700 1 --2- 172.21.15.156:0/2487478641 >> v2:172.21.15.156:3300/0 conn(0x7f704412cef0 0x7f704412d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.518+0000 7f704259c700 1 -- 172.21.15.156:0/2487478641 >> v1:172.21.15.156:6789/0 conn(0x7f7044133e50 legacy=0x7f704413a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:12.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.518+0000 7f704259c700 1 -- 172.21.15.156:0/2487478641 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704409b010 con 0x7f7044133540 2023-09-30T22:19:12.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.518+0000 7f704259c700 1 --2- 172.21.15.156:0/2487478641 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7044133540 0x7f7044133910 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f70380098f0 tx=0x7f7038009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fe4f1f440002bac server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:12.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.518+0000 7f7041d9b700 1 -- 172.21.15.156:0/2487478641 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7038004230 con 0x7f7044133540 2023-09-30T22:19:12.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.518+0000 7f7041d9b700 1 -- 172.21.15.156:0/2487478641 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7038004390 con 0x7f7044133540 2023-09-30T22:19:12.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.518+0000 7f7041d9b700 1 -- 172.21.15.156:0/2487478641 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70380036a0 con 0x7f7044133540 2023-09-30T22:19:12.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.518+0000 7f7049123700 1 -- 172.21.15.156:0/2487478641 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7044133540 msgr2=0x7f7044133910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:12.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.518+0000 7f7049123700 1 --2- 172.21.15.156:0/2487478641 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7044133540 0x7f7044133910 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f70380098f0 tx=0x7f7038009c00 comp rx=0 tx=0).stop 2023-09-30T22:19:12.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.519+0000 7f7049123700 1 -- 172.21.15.156:0/2487478641 shutdown_connections 2023-09-30T22:19:12.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.519+0000 7f7049123700 1 --2- 172.21.15.156:0/2487478641 >> v2:172.21.15.156:3300/0 conn(0x7f704412cef0 0x7f704412d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.519+0000 7f7049123700 1 --2- 172.21.15.156:0/2487478641 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7044133540 0x7f7044133910 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.519+0000 7f7049123700 1 -- 172.21.15.156:0/2487478641 >> 172.21.15.156:0/2487478641 conn(0x7f7044099c40 msgr2=0x7f70440a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:12.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.519+0000 7f7049123700 1 -- 172.21.15.156:0/2487478641 shutdown_connections 2023-09-30T22:19:12.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.519+0000 7f7049123700 1 -- 172.21.15.156:0/2487478641 wait complete. 2023-09-30T22:19:12.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.520+0000 7f7049123700 1 Processor -- start 2023-09-30T22:19:12.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.520+0000 7f7049123700 1 -- start start 2023-09-30T22:19:12.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.520+0000 7f7049123700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f704412cef0 0x7f70441c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:12.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.520+0000 7f7049123700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7044133540 0x7f70441c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:12.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.520+0000 7f7049123700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7044133e50 0x7f70441c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:12.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.520+0000 7f7049123700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704412dbb0 con 0x7f7044133e50 2023-09-30T22:19:12.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.520+0000 7f7049123700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704411f0d0 con 0x7f704412cef0 2023-09-30T22:19:12.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.520+0000 7f7049123700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f704411da40 con 0x7f7044133540 2023-09-30T22:19:12.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.520+0000 7f7042d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f704412cef0 0x7f70441c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:12.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.521+0000 7f7042d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f704412cef0 0x7f70441c8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52646/0 (socket says 172.21.15.156:52646) 2023-09-30T22:19:12.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.521+0000 7f7042d9d700 1 -- 172.21.15.156:0/3167232894 learned_addr learned my addr 172.21.15.156:0/3167232894 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:12.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.521+0000 7f704359e700 1 --2- 172.21.15.156:0/3167232894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7044133e50 0x7f70441c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:12.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.521+0000 7f704259c700 1 --2- 172.21.15.156:0/3167232894 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7044133540 0x7f70441c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:12.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.521+0000 7f7042d9d700 1 -- 172.21.15.156:0/3167232894 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7044133540 msgr2=0x7f70441c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:12.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.521+0000 7f7042d9d700 1 --2- 172.21.15.156:0/3167232894 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7044133540 0x7f70441c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.521+0000 7f7042d9d700 1 -- 172.21.15.156:0/3167232894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7044133e50 msgr2=0x7f70441c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:12.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.521+0000 7f7042d9d700 1 --2- 172.21.15.156:0/3167232894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7044133e50 0x7f70441c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.521+0000 7f7042d9d700 1 -- 172.21.15.156:0/3167232894 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7038009550 con 0x7f704412cef0 2023-09-30T22:19:12.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.521+0000 7f7042d9d700 1 --2- 172.21.15.156:0/3167232894 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f704412cef0 0x7f70441c8780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f703400b560 tx=0x7f703400b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:12.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.521+0000 7f702b7fe700 1 -- 172.21.15.156:0/3167232894 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7034011830 con 0x7f704412cef0 2023-09-30T22:19:12.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.521+0000 7f702b7fe700 1 -- 172.21.15.156:0/3167232894 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7034011990 con 0x7f704412cef0 2023-09-30T22:19:12.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.521+0000 7f702b7fe700 1 -- 172.21.15.156:0/3167232894 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7034011d40 con 0x7f704412cef0 2023-09-30T22:19:12.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.521+0000 7f7049123700 1 -- 172.21.15.156:0/3167232894 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f704411f390 con 0x7f704412cef0 2023-09-30T22:19:12.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.521+0000 7f7049123700 1 -- 172.21.15.156:0/3167232894 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f704411fd70 con 0x7f704412cef0 2023-09-30T22:19:12.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.522+0000 7f7049123700 1 -- 172.21.15.156:0/3167232894 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70440a2a00 con 0x7f704412cef0 2023-09-30T22:19:12.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.523+0000 7f702b7fe700 1 -- 172.21.15.156:0/3167232894 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f703401a400 con 0x7f704412cef0 2023-09-30T22:19:12.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.523+0000 7f702b7fe700 1 -- 172.21.15.156:0/3167232894 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f703403fb60 con 0x7f704412cef0 2023-09-30T22:19:12.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.523+0000 7f704259c700 1 -- 172.21.15.156:0/3167232894 >> v1:172.21.15.156:6816/126965 conn(0x7f703002f510 legacy=0x7f70300319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:12.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.532+0000 7f702b7fe700 1 -- 172.21.15.156:0/3167232894 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f703400f8d0 con 0x7f704412cef0 2023-09-30T22:19:12.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.564+0000 7f1e12bf4700 1 Processor -- start 2023-09-30T22:19:12.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.564+0000 7f1e12bf4700 1 -- start start 2023-09-30T22:19:12.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.565+0000 7f1e12bf4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1e0c09f430 0x7f1e0c136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:12.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.565+0000 7f1e12bf4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e0c137010 0x7f1e0c1393f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:12.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.565+0000 7f1e12bf4700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e0c09b6d0 con 0x7f1e0c09e950 2023-09-30T22:19:12.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.565+0000 7f1e12bf4700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e0c09afb0 con 0x7f1e0c09f430 2023-09-30T22:19:12.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.565+0000 7f1e12bf4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c0a0970 con 0x7f1e0c137010 2023-09-30T22:19:12.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.565+0000 7f1e0bfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1e0c09f430 0x7f1e0c136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:12.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.565+0000 7f1e10990700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f1e0c09e950 0x7f1e0c09ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:36164/0 (socket says 172.21.15.156:36164) 2023-09-30T22:19:12.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.565+0000 7f1e10990700 1 -- 172.21.15.156:0/2108892724 learned_addr learned my addr 172.21.15.156:0/2108892724 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:12.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.565+0000 7f1e11191700 1 --2- 172.21.15.156:0/2108892724 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e0c137010 0x7f1e0c1393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:12.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.565+0000 7f1e0b7fe700 1 -- 172.21.15.156:0/2108892724 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046811652 0 0) 0x7f1e0c09b6d0 con 0x7f1e0c09e950 2023-09-30T22:19:12.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.565+0000 7f1e0b7fe700 1 -- 172.21.15.156:0/2108892724 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dfc0035b0 con 0x7f1e0c09e950 2023-09-30T22:19:12.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.565+0000 7f1e0bfff700 1 -- 172.21.15.156:0/2108892724 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e0c137010 msgr2=0x7f1e0c1393f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:12.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.565+0000 7f1e0bfff700 1 --2- 172.21.15.156:0/2108892724 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e0c137010 0x7f1e0c1393f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.565+0000 7f1e0bfff700 1 -- 172.21.15.156:0/2108892724 >> v1:172.21.15.156:6789/0 conn(0x7f1e0c09e950 legacy=0x7f1e0c09ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:12.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.565+0000 7f1e0bfff700 1 -- 172.21.15.156:0/2108892724 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0c0a0320 con 0x7f1e0c09f430 2023-09-30T22:19:12.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.565+0000 7f1e0bfff700 1 --2- 172.21.15.156:0/2108892724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e0c09f430 0x7f1e0c136ad0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1df8009840 tx=0x7f1df8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b10984ff8bd1f324 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:12.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.566+0000 7f1e0b7fe700 1 -- 172.21.15.156:0/2108892724 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df8011830 con 0x7f1e0c09f430 2023-09-30T22:19:12.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.566+0000 7f1e0b7fe700 1 -- 172.21.15.156:0/2108892724 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df8011990 con 0x7f1e0c09f430 2023-09-30T22:19:12.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.566+0000 7f1e0b7fe700 1 -- 172.21.15.156:0/2108892724 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df8011d20 con 0x7f1e0c09f430 2023-09-30T22:19:12.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.566+0000 7f1e12bf4700 1 -- 172.21.15.156:0/2108892724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e0c09f430 msgr2=0x7f1e0c136ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:12.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.566+0000 7f1e12bf4700 1 --2- 172.21.15.156:0/2108892724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e0c09f430 0x7f1e0c136ad0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1df8009840 tx=0x7f1df8009b50 comp rx=0 tx=0).stop 2023-09-30T22:19:12.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.566+0000 7f1e12bf4700 1 -- 172.21.15.156:0/2108892724 shutdown_connections 2023-09-30T22:19:12.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.566+0000 7f1e12bf4700 1 --2- 172.21.15.156:0/2108892724 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e0c137010 0x7f1e0c1393f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.566+0000 7f1e12bf4700 1 --2- 172.21.15.156:0/2108892724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e0c09f430 0x7f1e0c136ad0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.566+0000 7f1e12bf4700 1 -- 172.21.15.156:0/2108892724 >> 172.21.15.156:0/2108892724 conn(0x7f1e0c0a0f70 msgr2=0x7f1e0c0a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:12.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.566+0000 7f1e12bf4700 1 -- 172.21.15.156:0/2108892724 shutdown_connections 2023-09-30T22:19:12.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.567+0000 7f1e12bf4700 1 -- 172.21.15.156:0/2108892724 wait complete. 2023-09-30T22:19:12.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.567+0000 7f1e12bf4700 1 Processor -- start 2023-09-30T22:19:12.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.567+0000 7f1e12bf4700 1 -- start start 2023-09-30T22:19:12.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.568+0000 7f1e12bf4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e0c09e950 0x7f1e0c1c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:12.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.568+0000 7f1e12bf4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e0c09f430 0x7f1e0c1c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:12.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.568+0000 7f1e12bf4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e0c137010 0x7f1e0c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:12.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.568+0000 7f1e12bf4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c1346d0 con 0x7f1e0c09f430 2023-09-30T22:19:12.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.568+0000 7f1e12bf4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c1340d0 con 0x7f1e0c137010 2023-09-30T22:19:12.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.568+0000 7f1e12bf4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c06d640 con 0x7f1e0c09e950 2023-09-30T22:19:12.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.568+0000 7f1e0bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e0c09f430 0x7f1e0c1c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:12.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.568+0000 7f1e0bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e0c09f430 0x7f1e0c1c8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40196/0 (socket says 172.21.15.156:40196) 2023-09-30T22:19:12.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.568+0000 7f1e0bfff700 1 -- 172.21.15.156:0/1415512457 learned_addr learned my addr 172.21.15.156:0/1415512457 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:12.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.568+0000 7f1e11191700 1 --2- 172.21.15.156:0/1415512457 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e0c137010 0x7f1e0c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:12.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.568+0000 7f1e10990700 1 --2- 172.21.15.156:0/1415512457 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e0c09e950 0x7f1e0c1c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:12.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.568+0000 7f1e0bfff700 1 -- 172.21.15.156:0/1415512457 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e0c09e950 msgr2=0x7f1e0c1c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:12.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.568+0000 7f1e0bfff700 1 --2- 172.21.15.156:0/1415512457 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e0c09e950 0x7f1e0c1c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.568+0000 7f1e0bfff700 1 -- 172.21.15.156:0/1415512457 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e0c137010 msgr2=0x7f1e0c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:12.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.568+0000 7f1e0bfff700 1 --2- 172.21.15.156:0/1415512457 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e0c137010 0x7f1e0c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.568+0000 7f1e0bfff700 1 -- 172.21.15.156:0/1415512457 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df80094a0 con 0x7f1e0c09f430 2023-09-30T22:19:12.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.569+0000 7f1e0bfff700 1 --2- 172.21.15.156:0/1415512457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e0c09f430 0x7f1e0c1c8a20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1df8000c00 tx=0x7f1df8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:12.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.569+0000 7f1e097fa700 1 -- 172.21.15.156:0/1415512457 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df80036a0 con 0x7f1e0c09f430 2023-09-30T22:19:12.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.569+0000 7f1e097fa700 1 -- 172.21.15.156:0/1415512457 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df801f070 con 0x7f1e0c09f430 2023-09-30T22:19:12.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.569+0000 7f1e097fa700 1 -- 172.21.15.156:0/1415512457 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df8003a60 con 0x7f1e0c09f430 2023-09-30T22:19:12.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.569+0000 7f1e12bf4700 1 -- 172.21.15.156:0/1415512457 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e0c072140 con 0x7f1e0c09f430 2023-09-30T22:19:12.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.569+0000 7f1e12bf4700 1 -- 172.21.15.156:0/1415512457 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e0c122b70 con 0x7f1e0c09f430 2023-09-30T22:19:12.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.570+0000 7f1e12bf4700 1 -- 172.21.15.156:0/1415512457 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e0c04f2a0 con 0x7f1e0c09f430 2023-09-30T22:19:12.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.570+0000 7f1e097fa700 1 -- 172.21.15.156:0/1415512457 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1df8003bc0 con 0x7f1e0c09f430 2023-09-30T22:19:12.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.570+0000 7f1e097fa700 1 -- 172.21.15.156:0/1415512457 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f1df8021070 con 0x7f1e0c09f430 2023-09-30T22:19:12.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.570+0000 7f1e10990700 1 -- 172.21.15.156:0/1415512457 >> v1:172.21.15.156:6816/126965 conn(0x7f1df002f510 legacy=0x7f1df00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:12.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.579+0000 7f0dd37fe700 1 -- 172.21.15.156:0/561746456 >> v1:172.21.15.156:6816/126965 conn(0x7f0dc002f510 legacy=0x7f0dc00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:12.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.579+0000 7f1e097fa700 1 -- 172.21.15.156:0/1415512457 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1df8024d50 con 0x7f1e0c09f430 2023-09-30T22:19:12.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.597+0000 7f0ddaa34700 1 -- 172.21.15.156:0/561746456 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0dd404f2a0 con 0x7f0dd40a0a90 2023-09-30T22:19:12.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.598+0000 7f0dd0ff9700 1 -- 172.21.15.156:0/561746456 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0dc40192c0 con 0x7f0dd40a0a90 2023-09-30T22:19:12.598 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:12.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.600+0000 7f0ddaa34700 1 -- 172.21.15.156:0/561746456 >> v1:172.21.15.156:6816/126965 conn(0x7f0dc002f510 legacy=0x7f0dc00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:12.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.600+0000 7f0ddaa34700 1 -- 172.21.15.156:0/561746456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dd40a0a90 msgr2=0x7f0dd4122b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:12.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.600+0000 7f0ddaa34700 1 --2- 172.21.15.156:0/561746456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dd40a0a90 0x7f0dd4122b40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4000f60 tx=0x7f0dc400c730 comp rx=0 tx=0).stop 2023-09-30T22:19:12.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.600+0000 7f0ddaa34700 1 -- 172.21.15.156:0/561746456 shutdown_connections 2023-09-30T22:19:12.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.600+0000 7f0ddaa34700 1 --2- 172.21.15.156:0/561746456 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0dd41393c0 0x7f0dd41235c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.600+0000 7f0ddaa34700 1 --2- 172.21.15.156:0/561746456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dd40a0a90 0x7f0dd4122b40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.600+0000 7f0ddaa34700 1 --2- 172.21.15.156:0/561746456 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0dd40a1570 0x7f0dd4123080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.600+0000 7f0ddaa34700 1 -- 172.21.15.156:0/561746456 >> 172.21.15.156:0/561746456 conn(0x7f0dd4099c40 msgr2=0x7f0dd411c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:12.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.600+0000 7f0ddaa34700 1 -- 172.21.15.156:0/561746456 shutdown_connections 2023-09-30T22:19:12.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.600+0000 7f0ddaa34700 1 -- 172.21.15.156:0/561746456 wait complete. 2023-09-30T22:19:12.613 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:12.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.679+0000 7ff5b553d700 1 -- 172.21.15.156:0/2704993167 >> v1:172.21.15.156:6816/126965 conn(0x7ff59402f510 legacy=0x7ff5940319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:12.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.724+0000 7f704259c700 1 -- 172.21.15.156:0/3167232894 >> v1:172.21.15.156:6816/126965 conn(0x7f703002f510 legacy=0x7f70300319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:12.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.736+0000 7ff5b7fa2700 1 -- 172.21.15.156:0/2704993167 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff5b004f2a0 con 0x7ff5b009d860 2023-09-30T22:19:12.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.737+0000 7ff5a67fc700 1 -- 172.21.15.156:0/2704993167 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff5ac029020 con 0x7ff5b009d860 2023-09-30T22:19:12.737 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:12.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.739+0000 7ff5b7fa2700 1 -- 172.21.15.156:0/2704993167 >> v1:172.21.15.156:6816/126965 conn(0x7ff59402f510 legacy=0x7ff5940319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:12.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.739+0000 7ff5b7fa2700 1 -- 172.21.15.156:0/2704993167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5b009d860 msgr2=0x7ff5b0122720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:12.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.739+0000 7ff5b7fa2700 1 --2- 172.21.15.156:0/2704993167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5b009d860 0x7ff5b0122720 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac016000 tx=0x7ff5ac004750 comp rx=0 tx=0).stop 2023-09-30T22:19:12.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.739+0000 7ff5b7fa2700 1 -- 172.21.15.156:0/2704993167 shutdown_connections 2023-09-30T22:19:12.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.739+0000 7ff5b7fa2700 1 --2- 172.21.15.156:0/2704993167 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff5b0130eb0 0x7ff5b01231a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.739+0000 7ff5b7fa2700 1 --2- 172.21.15.156:0/2704993167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5b009d860 0x7ff5b0122720 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.739+0000 7ff5b7fa2700 1 --2- 172.21.15.156:0/2704993167 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5b009e170 0x7ff5b0122c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.739+0000 7ff5b7fa2700 1 -- 172.21.15.156:0/2704993167 >> 172.21.15.156:0/2704993167 conn(0x7ff5b0099c40 msgr2=0x7ff5b00a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:12.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.739+0000 7ff5b7fa2700 1 -- 172.21.15.156:0/2704993167 shutdown_connections 2023-09-30T22:19:12.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.739+0000 7ff5b7fa2700 1 -- 172.21.15.156:0/2704993167 wait complete. 2023-09-30T22:19:12.752 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:12.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.771+0000 7f1e10990700 1 -- 172.21.15.156:0/1415512457 >> v1:172.21.15.156:6816/126965 conn(0x7f1df002f510 legacy=0x7f1df00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:12.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.773+0000 7f1e12bf4700 1 -- 172.21.15.156:0/1415512457 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1e0c124050 con 0x7f1e0c09f430 2023-09-30T22:19:12.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.774+0000 7f1e097fa700 1 -- 172.21.15.156:0/1415512457 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1df8015090 con 0x7f1e0c09f430 2023-09-30T22:19:12.774 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:12.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.776+0000 7f1e12bf4700 1 -- 172.21.15.156:0/1415512457 >> v1:172.21.15.156:6816/126965 conn(0x7f1df002f510 legacy=0x7f1df00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:12.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.776+0000 7f1e12bf4700 1 -- 172.21.15.156:0/1415512457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e0c09f430 msgr2=0x7f1e0c1c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:12.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.776+0000 7f1e12bf4700 1 --2- 172.21.15.156:0/1415512457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e0c09f430 0x7f1e0c1c8a20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1df8000c00 tx=0x7f1df8004750 comp rx=0 tx=0).stop 2023-09-30T22:19:12.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.776+0000 7f1e12bf4700 1 -- 172.21.15.156:0/1415512457 shutdown_connections 2023-09-30T22:19:12.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.776+0000 7f1e12bf4700 1 --2- 172.21.15.156:0/1415512457 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e0c137010 0x7f1e0c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.776+0000 7f1e12bf4700 1 --2- 172.21.15.156:0/1415512457 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e0c09e950 0x7f1e0c1c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.776+0000 7f1e12bf4700 1 --2- 172.21.15.156:0/1415512457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e0c09f430 0x7f1e0c1c8a20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.776+0000 7f1e12bf4700 1 -- 172.21.15.156:0/1415512457 >> 172.21.15.156:0/1415512457 conn(0x7f1e0c0a0f70 msgr2=0x7f1e0c1349a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:12.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.776+0000 7f1e12bf4700 1 -- 172.21.15.156:0/1415512457 shutdown_connections 2023-09-30T22:19:12.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.776+0000 7f1e12bf4700 1 -- 172.21.15.156:0/1415512457 wait complete. 2023-09-30T22:19:12.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.779+0000 7f7049123700 1 -- 172.21.15.156:0/3167232894 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7044074f10 con 0x7f704412cef0 2023-09-30T22:19:12.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.779+0000 7f702b7fe700 1 -- 172.21.15.156:0/3167232894 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7034015070 con 0x7f704412cef0 2023-09-30T22:19:12.780 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:12.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.782+0000 7f7049123700 1 -- 172.21.15.156:0/3167232894 >> v1:172.21.15.156:6816/126965 conn(0x7f703002f510 legacy=0x7f70300319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:12.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.782+0000 7f7049123700 1 -- 172.21.15.156:0/3167232894 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f704412cef0 msgr2=0x7f70441c8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:12.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.782+0000 7f7049123700 1 --2- 172.21.15.156:0/3167232894 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f704412cef0 0x7f70441c8780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f703400b560 tx=0x7f703400b870 comp rx=0 tx=0).stop 2023-09-30T22:19:12.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.782+0000 7f7049123700 1 -- 172.21.15.156:0/3167232894 shutdown_connections 2023-09-30T22:19:12.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.782+0000 7f7049123700 1 --2- 172.21.15.156:0/3167232894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7044133e50 0x7f70441c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.782+0000 7f7049123700 1 --2- 172.21.15.156:0/3167232894 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f704412cef0 0x7f70441c8780 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.782+0000 7f7049123700 1 --2- 172.21.15.156:0/3167232894 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7044133540 0x7f70441c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:12.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.782+0000 7f7049123700 1 -- 172.21.15.156:0/3167232894 >> 172.21.15.156:0/3167232894 conn(0x7f7044099c40 msgr2=0x7f704409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:12.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.782+0000 7f7049123700 1 -- 172.21.15.156:0/3167232894 shutdown_connections 2023-09-30T22:19:12.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:12.782+0000 7f7049123700 1 -- 172.21.15.156:0/3167232894 wait complete. 2023-09-30T22:19:12.790 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:12.795 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:13.614 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:13.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.740+0000 7f137a9a9700 1 Processor -- start 2023-09-30T22:19:13.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.740+0000 7f137a9a9700 1 -- start start 2023-09-30T22:19:13.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.741+0000 7f137a9a9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f13740a1510 0x7f13741351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:13.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.741+0000 7f137a9a9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13741356e0 0x7f1374137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:13.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.741+0000 7f137a9a9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13740a1e70 con 0x7f13740a0a30 2023-09-30T22:19:13.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.741+0000 7f137a9a9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f137409a720 con 0x7f13740a1510 2023-09-30T22:19:13.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.741+0000 7f137a9a9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137409b300 con 0x7f13741356e0 2023-09-30T22:19:13.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.741+0000 7f13737fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f13740a1510 0x7f13741351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:13.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.741+0000 7f13737fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f13740a1510 0x7f13741351a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40200/0 (socket says 172.21.15.156:40200) 2023-09-30T22:19:13.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.741+0000 7f13737fe700 1 -- 172.21.15.156:0/100040974 learned_addr learned my addr 172.21.15.156:0/100040974 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:13.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.741+0000 7f1378f46700 1 --2- 172.21.15.156:0/100040974 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13741356e0 0x7f1374137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:13.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.741+0000 7f13737fe700 1 -- 172.21.15.156:0/100040974 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13741356e0 msgr2=0x7f1374137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:13.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.741+0000 7f13737fe700 1 --2- 172.21.15.156:0/100040974 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13741356e0 0x7f1374137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:13.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.741+0000 7f13737fe700 1 -- 172.21.15.156:0/100040974 >> v1:172.21.15.156:6789/0 conn(0x7f13740a0a30 legacy=0x7f13740a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:13.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.741+0000 7f13737fe700 1 -- 172.21.15.156:0/100040974 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137409abc0 con 0x7f13740a1510 2023-09-30T22:19:13.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.741+0000 7f1378f46700 1 --2- 172.21.15.156:0/100040974 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13741356e0 0x7f1374137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:13.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.741+0000 7f13737fe700 1 --2- 172.21.15.156:0/100040974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13740a1510 0x7f13741351a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f13680098f0 tx=0x7f1368009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75618d9c59abc563 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:13.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.741+0000 7f1372ffd700 1 -- 172.21.15.156:0/100040974 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1368011830 con 0x7f13740a1510 2023-09-30T22:19:13.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.741+0000 7f1372ffd700 1 -- 172.21.15.156:0/100040974 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1368011990 con 0x7f13740a1510 2023-09-30T22:19:13.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.741+0000 7f1372ffd700 1 -- 172.21.15.156:0/100040974 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1368011d20 con 0x7f13740a1510 2023-09-30T22:19:13.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.742+0000 7f137a9a9700 1 -- 172.21.15.156:0/100040974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13740a1510 msgr2=0x7f13741351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:13.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.742+0000 7f137a9a9700 1 --2- 172.21.15.156:0/100040974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13740a1510 0x7f13741351a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f13680098f0 tx=0x7f1368009c00 comp rx=0 tx=0).stop 2023-09-30T22:19:13.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.742+0000 7f137a9a9700 1 -- 172.21.15.156:0/100040974 shutdown_connections 2023-09-30T22:19:13.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.742+0000 7f137a9a9700 1 --2- 172.21.15.156:0/100040974 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13741356e0 0x7f1374137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:13.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.742+0000 7f137a9a9700 1 --2- 172.21.15.156:0/100040974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13740a1510 0x7f13741351a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:13.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.742+0000 7f137a9a9700 1 -- 172.21.15.156:0/100040974 >> 172.21.15.156:0/100040974 conn(0x7f13740a2980 msgr2=0x7f13740a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:13.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.742+0000 7f137a9a9700 1 -- 172.21.15.156:0/100040974 shutdown_connections 2023-09-30T22:19:13.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.742+0000 7f137a9a9700 1 -- 172.21.15.156:0/100040974 wait complete. 2023-09-30T22:19:13.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.743+0000 7f137a9a9700 1 Processor -- start 2023-09-30T22:19:13.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.743+0000 7f137a9a9700 1 -- start start 2023-09-30T22:19:13.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.743+0000 7f137a9a9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13740a0a30 0x7f13741c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:13.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.743+0000 7f137a9a9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13740a1510 0x7f13741c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:13.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.743+0000 7f137a9a9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13741356e0 0x7f13741c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:13.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.743+0000 7f137a9a9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137412c9c0 con 0x7f13741356e0 2023-09-30T22:19:13.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.743+0000 7f137a9a9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1374134d20 con 0x7f13740a0a30 2023-09-30T22:19:13.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.743+0000 7f137a9a9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f137412bce0 con 0x7f13740a1510 2023-09-30T22:19:13.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.744+0000 7f1373fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13740a0a30 0x7f13741c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:13.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.744+0000 7f13737fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13740a1510 0x7f13741c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:13.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.744+0000 7f13737fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13740a1510 0x7f13741c8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48248/0 (socket says 172.21.15.156:48248) 2023-09-30T22:19:13.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.744+0000 7f1373fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13740a0a30 0x7f13741c8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52686/0 (socket says 172.21.15.156:52686) 2023-09-30T22:19:13.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.744+0000 7f13737fe700 1 -- 172.21.15.156:0/4052862848 learned_addr learned my addr 172.21.15.156:0/4052862848 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:13.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.744+0000 7f1378f46700 1 --2- 172.21.15.156:0/4052862848 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13741356e0 0x7f13741c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:13.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.744+0000 7f13737fe700 1 -- 172.21.15.156:0/4052862848 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13740a0a30 msgr2=0x7f13741c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:13.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.744+0000 7f13737fe700 1 --2- 172.21.15.156:0/4052862848 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13740a0a30 0x7f13741c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:13.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.744+0000 7f13737fe700 1 -- 172.21.15.156:0/4052862848 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13741356e0 msgr2=0x7f13741c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:13.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.744+0000 7f13737fe700 1 --2- 172.21.15.156:0/4052862848 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13741356e0 0x7f13741c8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:13.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.744+0000 7f13737fe700 1 -- 172.21.15.156:0/4052862848 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c009a70 con 0x7f13740a1510 2023-09-30T22:19:13.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.744+0000 7f1373fff700 1 --2- 172.21.15.156:0/4052862848 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13740a0a30 0x7f13741c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:13.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.744+0000 7f13737fe700 1 --2- 172.21.15.156:0/4052862848 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13740a1510 0x7f13741c8a50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1368009c40 tx=0x7f1368004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:13.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.744+0000 7f1370ff9700 1 -- 172.21.15.156:0/4052862848 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13680043c0 con 0x7f13740a1510 2023-09-30T22:19:13.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.744+0000 7f1370ff9700 1 -- 172.21.15.156:0/4052862848 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136801f070 con 0x7f13740a1510 2023-09-30T22:19:13.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.744+0000 7f137a9a9700 1 -- 172.21.15.156:0/4052862848 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1368009550 con 0x7f13740a1510 2023-09-30T22:19:13.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.744+0000 7f1370ff9700 1 -- 172.21.15.156:0/4052862848 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13680036a0 con 0x7f13740a1510 2023-09-30T22:19:13.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.744+0000 7f137a9a9700 1 -- 172.21.15.156:0/4052862848 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1374134780 con 0x7f13740a1510 2023-09-30T22:19:13.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.745+0000 7f1370ff9700 1 -- 172.21.15.156:0/4052862848 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1368021030 con 0x7f13740a1510 2023-09-30T22:19:13.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.745+0000 7f1370ff9700 1 -- 172.21.15.156:0/4052862848 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f1368040e00 con 0x7f13740a1510 2023-09-30T22:19:13.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.745+0000 7f1373fff700 1 -- 172.21.15.156:0/4052862848 >> v1:172.21.15.156:6816/126965 conn(0x7f136002f510 legacy=0x7f13600319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:13.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.745+0000 7f137a9a9700 1 -- 172.21.15.156:0/4052862848 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f137412b980 con 0x7f13740a1510 2023-09-30T22:19:13.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.750+0000 7f1370ff9700 1 -- 172.21.15.156:0/4052862848 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f13680199a0 con 0x7f13740a1510 2023-09-30T22:19:13.752 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:13.791 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:13.796 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:13.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.880+0000 7f522f31e700 1 Processor -- start 2023-09-30T22:19:13.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.880+0000 7f522f31e700 1 -- start start 2023-09-30T22:19:13.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.881+0000 7f522f31e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5228133ad0 0x7f5228133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:13.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.881+0000 7f522f31e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5228130bc0 0x7f522813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:13.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.881+0000 7f522f31e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f522806b2d0 con 0x7f52281300a0 2023-09-30T22:19:13.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.881+0000 7f522f31e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5228133610 con 0x7f5228130bc0 2023-09-30T22:19:13.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.881+0000 7f522f31e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f522809a500 con 0x7f5228133ad0 2023-09-30T22:19:13.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.881+0000 7f522d8bb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5228130bc0 0x7f522813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:13.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.881+0000 7f522c8b9700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f52281300a0 0x7f52281304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:36184/0 (socket says 172.21.15.156:36184) 2023-09-30T22:19:13.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.881+0000 7f522c8b9700 1 -- 172.21.15.156:0/3264730117 learned_addr learned my addr 172.21.15.156:0/3264730117 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:13.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.881+0000 7f522d8bb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5228130bc0 0x7f522813b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52688/0 (socket says 172.21.15.156:52688) 2023-09-30T22:19:13.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.881+0000 7f522d0ba700 1 --2- 172.21.15.156:0/3264730117 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5228133ad0 0x7f5228133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:13.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.881+0000 7f522d8bb700 1 -- 172.21.15.156:0/3264730117 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5228133ad0 msgr2=0x7f5228133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:13.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.881+0000 7f522d8bb700 1 --2- 172.21.15.156:0/3264730117 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5228133ad0 0x7f5228133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:13.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.881+0000 7f522d8bb700 1 -- 172.21.15.156:0/3264730117 >> v1:172.21.15.156:6789/0 conn(0x7f52281300a0 legacy=0x7f52281304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:13.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.881+0000 7f522d8bb700 1 -- 172.21.15.156:0/3264730117 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52281338b0 con 0x7f5228130bc0 2023-09-30T22:19:13.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.882+0000 7f522d8bb700 1 --2- 172.21.15.156:0/3264730117 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5228130bc0 0x7f522813b990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5220009dc0 tx=0x7f522000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4332feee8588f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:13.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.882+0000 7f521ffff700 1 -- 172.21.15.156:0/3264730117 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522000e070 con 0x7f5228130bc0 2023-09-30T22:19:13.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.882+0000 7f521ffff700 1 -- 172.21.15.156:0/3264730117 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522000bbd0 con 0x7f5228130bc0 2023-09-30T22:19:13.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.882+0000 7f521ffff700 1 -- 172.21.15.156:0/3264730117 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220012430 con 0x7f5228130bc0 2023-09-30T22:19:13.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.882+0000 7f522f31e700 1 -- 172.21.15.156:0/3264730117 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5228130bc0 msgr2=0x7f522813b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:13.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.882+0000 7f522f31e700 1 --2- 172.21.15.156:0/3264730117 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5228130bc0 0x7f522813b990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5220009dc0 tx=0x7f522000b330 comp rx=0 tx=0).stop 2023-09-30T22:19:13.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.882+0000 7f522f31e700 1 -- 172.21.15.156:0/3264730117 shutdown_connections 2023-09-30T22:19:13.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.882+0000 7f522f31e700 1 --2- 172.21.15.156:0/3264730117 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5228130bc0 0x7f522813b990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:13.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.882+0000 7f522f31e700 1 --2- 172.21.15.156:0/3264730117 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5228133ad0 0x7f5228133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:13.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.883+0000 7f522f31e700 1 -- 172.21.15.156:0/3264730117 >> 172.21.15.156:0/3264730117 conn(0x7f5228099c40 msgr2=0x7f52280a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:13.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.883+0000 7f522f31e700 1 -- 172.21.15.156:0/3264730117 shutdown_connections 2023-09-30T22:19:13.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.883+0000 7f522f31e700 1 -- 172.21.15.156:0/3264730117 wait complete. 2023-09-30T22:19:13.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.884+0000 7f522f31e700 1 Processor -- start 2023-09-30T22:19:13.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.884+0000 7f522f31e700 1 -- start start 2023-09-30T22:19:13.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.885+0000 7f522f31e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f52281300a0 0x7f522811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:13.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.885+0000 7f522f31e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5228130bc0 0x7f522811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:13.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.885+0000 7f522f31e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5228133ad0 0x7f522811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:13.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.885+0000 7f522f31e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5228120bb0 con 0x7f5228130bc0 2023-09-30T22:19:13.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.885+0000 7f522f31e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5228072210 con 0x7f5228133ad0 2023-09-30T22:19:13.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.885+0000 7f522f31e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f522811fc10 con 0x7f52281300a0 2023-09-30T22:19:13.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.885+0000 7f522c8b9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5228130bc0 0x7f522811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:13.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.885+0000 7f522c8b9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5228130bc0 0x7f522811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40210/0 (socket says 172.21.15.156:40210) 2023-09-30T22:19:13.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.885+0000 7f522c8b9700 1 -- 172.21.15.156:0/3010732552 learned_addr learned my addr 172.21.15.156:0/3010732552 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:13.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.885+0000 7f522d8bb700 1 --2- 172.21.15.156:0/3010732552 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5228133ad0 0x7f522811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:13.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.885+0000 7f522d0ba700 1 --2- 172.21.15.156:0/3010732552 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f52281300a0 0x7f522811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:13.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.885+0000 7f522d8bb700 1 -- 172.21.15.156:0/3010732552 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f52281300a0 msgr2=0x7f522811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:13.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.885+0000 7f522d8bb700 1 --2- 172.21.15.156:0/3010732552 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f52281300a0 0x7f522811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:13.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.885+0000 7f522d8bb700 1 -- 172.21.15.156:0/3010732552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5228130bc0 msgr2=0x7f522811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:13.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.885+0000 7f522d8bb700 1 --2- 172.21.15.156:0/3010732552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5228130bc0 0x7f522811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:13.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.885+0000 7f522d8bb700 1 -- 172.21.15.156:0/3010732552 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5220009a70 con 0x7f5228133ad0 2023-09-30T22:19:13.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.885+0000 7f522d8bb700 1 --2- 172.21.15.156:0/3010732552 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5228133ad0 0x7f522811e4c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5220016000 tx=0x7f5220004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:13.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.886+0000 7f521dffb700 1 -- 172.21.15.156:0/3010732552 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220012430 con 0x7f5228133ad0 2023-09-30T22:19:13.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.886+0000 7f521dffb700 1 -- 172.21.15.156:0/3010732552 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5220020070 con 0x7f5228133ad0 2023-09-30T22:19:13.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.886+0000 7f521dffb700 1 -- 172.21.15.156:0/3010732552 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220004280 con 0x7f5228133ad0 2023-09-30T22:19:13.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.886+0000 7f522f31e700 1 -- 172.21.15.156:0/3010732552 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f522812d220 con 0x7f5228133ad0 2023-09-30T22:19:13.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.886+0000 7f522f31e700 1 -- 172.21.15.156:0/3010732552 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52280a2ea0 con 0x7f5228133ad0 2023-09-30T22:19:13.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.887+0000 7f521dffb700 1 -- 172.21.15.156:0/3010732552 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f52200043e0 con 0x7f5228133ad0 2023-09-30T22:19:13.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.887+0000 7f521dffb700 1 -- 172.21.15.156:0/3010732552 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f5220022070 con 0x7f5228133ad0 2023-09-30T22:19:13.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.887+0000 7f522f31e700 1 -- 172.21.15.156:0/3010732552 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f522811fdc0 con 0x7f5228133ad0 2023-09-30T22:19:13.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.887+0000 7f522d0ba700 1 -- 172.21.15.156:0/3010732552 >> v1:172.21.15.156:6816/126965 conn(0x7f520c02f510 legacy=0x7f520c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:13.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.892+0000 7f521dffb700 1 -- 172.21.15.156:0/3010732552 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f522002c080 con 0x7f5228133ad0 2023-09-30T22:19:13.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.926+0000 7fd1cd159700 1 Processor -- start 2023-09-30T22:19:13.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.926+0000 7fd1cd159700 1 -- start start 2023-09-30T22:19:13.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.926+0000 7fd1cd159700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1c809f430 0x7fd1c8136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:13.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.926+0000 7fd1cd159700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd1c8137010 0x7fd1c81393f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:13.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.926+0000 7fd1cd159700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c809b6d0 con 0x7fd1c809e950 2023-09-30T22:19:13.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.926+0000 7fd1cd159700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c809afb0 con 0x7fd1c8137010 2023-09-30T22:19:13.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.926+0000 7fd1cd159700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c80a0970 con 0x7fd1c809f430 2023-09-30T22:19:13.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.926+0000 7fd1c759e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd1c8137010 0x7fd1c81393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:13.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.926+0000 7fd1c659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1c809f430 0x7fd1c8136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:13.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.926+0000 7fd1c759e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd1c8137010 0x7fd1c81393f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40214/0 (socket says 172.21.15.156:40214) 2023-09-30T22:19:13.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.926+0000 7fd1c759e700 1 -- 172.21.15.156:0/2775967073 learned_addr learned my addr 172.21.15.156:0/2775967073 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:13.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.927+0000 7fd1c759e700 1 -- 172.21.15.156:0/2775967073 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1c809f430 msgr2=0x7fd1c8136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:13.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.927+0000 7fd1c759e700 1 --2- 172.21.15.156:0/2775967073 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1c809f430 0x7fd1c8136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:13.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.927+0000 7fd1c759e700 1 -- 172.21.15.156:0/2775967073 >> v1:172.21.15.156:6789/0 conn(0x7fd1c809e950 legacy=0x7fd1c809ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:13.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.927+0000 7fd1c759e700 1 -- 172.21.15.156:0/2775967073 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c80a0320 con 0x7fd1c8137010 2023-09-30T22:19:13.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.927+0000 7fd1c5d9b700 1 -- 172.21.15.156:0/2775967073 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1148078688 0 0) 0x7fd1c809b6d0 con 0x7fd1c809e950 2023-09-30T22:19:13.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.927+0000 7fd1c659c700 1 --2- 172.21.15.156:0/2775967073 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1c809f430 0x7fd1c8136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:13.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.927+0000 7fd1c759e700 1 --2- 172.21.15.156:0/2775967073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1c8137010 0x7fd1c81393f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0009e50 tx=0x7fd1c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a29763cb77d6af4b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:13.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.927+0000 7fd1c5d9b700 1 -- 172.21.15.156:0/2775967073 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c000e070 con 0x7fd1c8137010 2023-09-30T22:19:13.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.927+0000 7fd1c5d9b700 1 -- 172.21.15.156:0/2775967073 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c000b910 con 0x7fd1c8137010 2023-09-30T22:19:13.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.927+0000 7fd1c5d9b700 1 -- 172.21.15.156:0/2775967073 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c000bcc0 con 0x7fd1c8137010 2023-09-30T22:19:13.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.928+0000 7fd1cd159700 1 -- 172.21.15.156:0/2775967073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1c8137010 msgr2=0x7fd1c81393f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:13.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.928+0000 7fd1cd159700 1 --2- 172.21.15.156:0/2775967073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1c8137010 0x7fd1c81393f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0009e50 tx=0x7fd1c000b330 comp rx=0 tx=0).stop 2023-09-30T22:19:13.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.928+0000 7fd1cd159700 1 -- 172.21.15.156:0/2775967073 shutdown_connections 2023-09-30T22:19:13.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.928+0000 7fd1cd159700 1 --2- 172.21.15.156:0/2775967073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1c8137010 0x7fd1c81393f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:13.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.928+0000 7fd1cd159700 1 --2- 172.21.15.156:0/2775967073 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1c809f430 0x7fd1c8136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:13.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.928+0000 7fd1cd159700 1 -- 172.21.15.156:0/2775967073 >> 172.21.15.156:0/2775967073 conn(0x7fd1c80a0f70 msgr2=0x7fd1c80a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:13.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.928+0000 7fd1cd159700 1 -- 172.21.15.156:0/2775967073 shutdown_connections 2023-09-30T22:19:13.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.928+0000 7fd1cd159700 1 -- 172.21.15.156:0/2775967073 wait complete. 2023-09-30T22:19:13.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.929+0000 7fd1cd159700 1 Processor -- start 2023-09-30T22:19:13.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.929+0000 7fd1cd159700 1 -- start start 2023-09-30T22:19:13.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.929+0000 7fd1cd159700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1c809e950 0x7fd1c81c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:13.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.929+0000 7fd1cd159700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1c809f430 0x7fd1c81c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:13.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.929+0000 7fd1cd159700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1c8137010 0x7fd1c806b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:13.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.929+0000 7fd1cd159700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c81bc190 con 0x7fd1c8137010 2023-09-30T22:19:13.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.929+0000 7fd1cd159700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c81c9010 con 0x7fd1c809f430 2023-09-30T22:19:13.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.929+0000 7fd1cd159700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c80a45e0 con 0x7fd1c809e950 2023-09-30T22:19:13.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.930+0000 7fd1c6d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1c809e950 0x7fd1c81c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:13.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.930+0000 7fd1c6d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1c809e950 0x7fd1c81c8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48282/0 (socket says 172.21.15.156:48282) 2023-09-30T22:19:13.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.930+0000 7fd1c6d9d700 1 -- 172.21.15.156:0/1089382320 learned_addr learned my addr 172.21.15.156:0/1089382320 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:13.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.930+0000 7fd1c759e700 1 --2- 172.21.15.156:0/1089382320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1c8137010 0x7fd1c806b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:13.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.930+0000 7fd1c659c700 1 --2- 172.21.15.156:0/1089382320 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1c809f430 0x7fd1c81c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:13.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.930+0000 7fd1c6d9d700 1 -- 172.21.15.156:0/1089382320 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1c809f430 msgr2=0x7fd1c81c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:13.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.930+0000 7fd1c6d9d700 1 --2- 172.21.15.156:0/1089382320 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1c809f430 0x7fd1c81c8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:13.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.930+0000 7fd1c6d9d700 1 -- 172.21.15.156:0/1089382320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1c8137010 msgr2=0x7fd1c806b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:13.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.930+0000 7fd1c6d9d700 1 --2- 172.21.15.156:0/1089382320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1c8137010 0x7fd1c806b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:13.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.930+0000 7fd1c6d9d700 1 -- 172.21.15.156:0/1089382320 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc0094a0 con 0x7fd1c809e950 2023-09-30T22:19:13.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.930+0000 7fd1c759e700 1 --2- 172.21.15.156:0/1089382320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1c8137010 0x7fd1c806b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:13.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.930+0000 7fd1c6d9d700 1 --2- 172.21.15.156:0/1089382320 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1c809e950 0x7fd1c81c8590 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd1b800c580 tx=0x7fd1b800c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:13.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.930+0000 7fd1af7fe700 1 -- 172.21.15.156:0/1089382320 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b80054e0 con 0x7fd1c809e950 2023-09-30T22:19:13.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.930+0000 7fd1af7fe700 1 -- 172.21.15.156:0/1089382320 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b8003680 con 0x7fd1c809e950 2023-09-30T22:19:13.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.930+0000 7fd1cd159700 1 -- 172.21.15.156:0/1089382320 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c0009b30 con 0x7fd1c809e950 2023-09-30T22:19:13.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.930+0000 7fd1af7fe700 1 -- 172.21.15.156:0/1089382320 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b8003a30 con 0x7fd1c809e950 2023-09-30T22:19:13.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.931+0000 7fd1cd159700 1 -- 172.21.15.156:0/1089382320 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c8134670 con 0x7fd1c809e950 2023-09-30T22:19:13.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.931+0000 7fd1af7fe700 1 -- 172.21.15.156:0/1089382320 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd1b8003b90 con 0x7fd1c809e950 2023-09-30T22:19:13.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.931+0000 7fd1af7fe700 1 -- 172.21.15.156:0/1089382320 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fd1b803f000 con 0x7fd1c809e950 2023-09-30T22:19:13.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.931+0000 7fd1c659c700 1 -- 172.21.15.156:0/1089382320 >> v1:172.21.15.156:6816/126965 conn(0x7fd1b402f510 legacy=0x7fd1b40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:13.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.932+0000 7fd1cd159700 1 -- 172.21.15.156:0/1089382320 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c804f2a0 con 0x7fd1c809e950 2023-09-30T22:19:13.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.933+0000 7fd57f40a700 1 Processor -- start 2023-09-30T22:19:13.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.933+0000 7fd57f40a700 1 -- start start 2023-09-30T22:19:13.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.934+0000 7fd57f40a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd578138040 0x7fd578138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:13.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.934+0000 7fd57f40a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd5780a1400 0x7fd57813fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:13.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.934+0000 7fd57f40a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5781379e0 con 0x7fd5780a08e0 2023-09-30T22:19:13.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.934+0000 7fd57f40a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5780a2100 con 0x7fd5780a1400 2023-09-30T22:19:13.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.934+0000 7fd57f40a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd578138950 con 0x7fd578138040 2023-09-30T22:19:13.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.934+0000 7fd57c9a5700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fd5780a08e0 0x7fd5780a0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:36194/0 (socket says 172.21.15.156:36194) 2023-09-30T22:19:13.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.934+0000 7fd57c9a5700 1 -- 172.21.15.156:0/3808912282 learned_addr learned my addr 172.21.15.156:0/3808912282 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:13.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.934+0000 7fd57d1a6700 1 --2- 172.21.15.156:0/3808912282 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd578138040 0x7fd578138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:13.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.934+0000 7fd57d9a7700 1 --2- 172.21.15.156:0/3808912282 >> v2:172.21.15.156:3300/0 conn(0x7fd5780a1400 0x7fd57813fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:13.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.934+0000 7fd56ffff700 1 -- 172.21.15.156:0/3808912282 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351172437 0 0) 0x7fd5781379e0 con 0x7fd5780a08e0 2023-09-30T22:19:13.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.934+0000 7fd56ffff700 1 -- 172.21.15.156:0/3808912282 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5640035b0 con 0x7fd5780a08e0 2023-09-30T22:19:13.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.934+0000 7fd57d9a7700 1 -- 172.21.15.156:0/3808912282 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd578138040 msgr2=0x7fd578138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:13.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.934+0000 7fd57d9a7700 1 --2- 172.21.15.156:0/3808912282 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd578138040 0x7fd578138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:13.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.934+0000 7fd57d9a7700 1 -- 172.21.15.156:0/3808912282 >> v1:172.21.15.156:6789/0 conn(0x7fd5780a08e0 legacy=0x7fd5780a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:13.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.934+0000 7fd57d9a7700 1 -- 172.21.15.156:0/3808912282 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57809b9b0 con 0x7fd5780a1400 2023-09-30T22:19:13.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.935+0000 7fd57d9a7700 1 --2- 172.21.15.156:0/3808912282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5780a1400 0x7fd57813fd20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd570009dc0 tx=0x7fd57000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63bbfd3e0720976 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:13.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.935+0000 7fd56ffff700 1 -- 172.21.15.156:0/3808912282 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57000e070 con 0x7fd5780a1400 2023-09-30T22:19:13.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.935+0000 7fd56ffff700 1 -- 172.21.15.156:0/3808912282 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57000bae0 con 0x7fd5780a1400 2023-09-30T22:19:13.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.935+0000 7fd56ffff700 1 -- 172.21.15.156:0/3808912282 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57000be90 con 0x7fd5780a1400 2023-09-30T22:19:13.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.935+0000 7fd57f40a700 1 -- 172.21.15.156:0/3808912282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5780a1400 msgr2=0x7fd57813fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:13.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.935+0000 7fd57f40a700 1 --2- 172.21.15.156:0/3808912282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5780a1400 0x7fd57813fd20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd570009dc0 tx=0x7fd57000b330 comp rx=0 tx=0).stop 2023-09-30T22:19:13.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.935+0000 7fd57f40a700 1 -- 172.21.15.156:0/3808912282 shutdown_connections 2023-09-30T22:19:13.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.935+0000 7fd57f40a700 1 --2- 172.21.15.156:0/3808912282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5780a1400 0x7fd57813fd20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:13.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.935+0000 7fd57f40a700 1 --2- 172.21.15.156:0/3808912282 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd578138040 0x7fd578138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:13.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.935+0000 7fd57f40a700 1 -- 172.21.15.156:0/3808912282 >> 172.21.15.156:0/3808912282 conn(0x7fd5780a2980 msgr2=0x7fd5780a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:13.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.936+0000 7fd57f40a700 1 -- 172.21.15.156:0/3808912282 shutdown_connections 2023-09-30T22:19:13.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.936+0000 7fd57f40a700 1 -- 172.21.15.156:0/3808912282 wait complete. 2023-09-30T22:19:13.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.936+0000 7fd57f40a700 1 Processor -- start 2023-09-30T22:19:13.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.937+0000 7fd57f40a700 1 -- start start 2023-09-30T22:19:13.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.937+0000 7fd57f40a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd5780a08e0 0x7fd5781262d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:13.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.937+0000 7fd57f40a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd5780a1400 0x7fd578126810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:13.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.937+0000 7fd57f40a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd578138040 0x7fd578126d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:13.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.937+0000 7fd57f40a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5781377f0 con 0x7fd578138040 2023-09-30T22:19:13.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.937+0000 7fd57f40a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd578127f70 con 0x7fd5780a1400 2023-09-30T22:19:13.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.937+0000 7fd57f40a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd57809a240 con 0x7fd5780a08e0 2023-09-30T22:19:13.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.937+0000 7fd57c9a5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd5780a1400 0x7fd578126810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:13.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.937+0000 7fd57c9a5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd5780a1400 0x7fd578126810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52742/0 (socket says 172.21.15.156:52742) 2023-09-30T22:19:13.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.937+0000 7fd57c9a5700 1 -- 172.21.15.156:0/3836293334 learned_addr learned my addr 172.21.15.156:0/3836293334 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:13.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.937+0000 7fd57d9a7700 1 --2- 172.21.15.156:0/3836293334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd578138040 0x7fd578126d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:13.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.937+0000 7fd57d1a6700 1 --2- 172.21.15.156:0/3836293334 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd5780a08e0 0x7fd5781262d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:13.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.937+0000 7fd57c9a5700 1 -- 172.21.15.156:0/3836293334 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd5780a08e0 msgr2=0x7fd5781262d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:13.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.937+0000 7fd57c9a5700 1 --2- 172.21.15.156:0/3836293334 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd5780a08e0 0x7fd5781262d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:13.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.937+0000 7fd57c9a5700 1 -- 172.21.15.156:0/3836293334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd578138040 msgr2=0x7fd578126d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:13.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.937+0000 7fd57c9a5700 1 --2- 172.21.15.156:0/3836293334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd578138040 0x7fd578126d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:13.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.937+0000 7fd57c9a5700 1 -- 172.21.15.156:0/3836293334 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd570009a70 con 0x7fd5780a1400 2023-09-30T22:19:13.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.938+0000 7fd57c9a5700 1 --2- 172.21.15.156:0/3836293334 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd5780a1400 0x7fd578126810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd568005910 tx=0x7fd56800c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:13.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.938+0000 7fd1af7fe700 1 -- 172.21.15.156:0/1089382320 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd1b8017070 con 0x7fd1c809e950 2023-09-30T22:19:13.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.938+0000 7fd56dffb700 1 -- 172.21.15.156:0/3836293334 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd568005d70 con 0x7fd5780a1400 2023-09-30T22:19:13.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.938+0000 7fd56dffb700 1 -- 172.21.15.156:0/3836293334 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56800ce80 con 0x7fd5780a1400 2023-09-30T22:19:13.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.938+0000 7fd56dffb700 1 -- 172.21.15.156:0/3836293334 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5680072d0 con 0x7fd5780a1400 2023-09-30T22:19:13.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.939+0000 7fd57f40a700 1 -- 172.21.15.156:0/3836293334 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5781297d0 con 0x7fd5780a1400 2023-09-30T22:19:13.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.939+0000 7fd57f40a700 1 -- 172.21.15.156:0/3836293334 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd578129a90 con 0x7fd5780a1400 2023-09-30T22:19:13.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.940+0000 7fd57f40a700 1 -- 172.21.15.156:0/3836293334 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd57804f2a0 con 0x7fd5780a1400 2023-09-30T22:19:13.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.946+0000 7f1373fff700 1 -- 172.21.15.156:0/4052862848 >> v1:172.21.15.156:6816/126965 conn(0x7f136002f510 legacy=0x7f13600319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:13.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.947+0000 7fd56dffb700 1 -- 172.21.15.156:0/3836293334 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd568007430 con 0x7fd5780a1400 2023-09-30T22:19:13.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.947+0000 7fd56dffb700 1 -- 172.21.15.156:0/3836293334 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fd56803f820 con 0x7fd5780a1400 2023-09-30T22:19:13.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.947+0000 7fd57d1a6700 1 -- 172.21.15.156:0/3836293334 >> v1:172.21.15.156:6816/126965 conn(0x7fd55c02f510 legacy=0x7fd55c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:13.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.948+0000 7fd56dffb700 1 -- 172.21.15.156:0/3836293334 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd56801ae30 con 0x7fd5780a1400 2023-09-30T22:19:13.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.959+0000 7f137a9a9700 1 -- 172.21.15.156:0/4052862848 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f137404f2a0 con 0x7f13740a1510 2023-09-30T22:19:13.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.960+0000 7f1370ff9700 1 -- 172.21.15.156:0/4052862848 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f13680193b0 con 0x7f13740a1510 2023-09-30T22:19:13.961 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:13.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.963+0000 7f137a9a9700 1 -- 172.21.15.156:0/4052862848 >> v1:172.21.15.156:6816/126965 conn(0x7f136002f510 legacy=0x7f13600319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:13.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.963+0000 7f137a9a9700 1 -- 172.21.15.156:0/4052862848 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13740a1510 msgr2=0x7f13741c8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:13.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.963+0000 7f137a9a9700 1 --2- 172.21.15.156:0/4052862848 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13740a1510 0x7f13741c8a50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1368009c40 tx=0x7f1368004750 comp rx=0 tx=0).stop 2023-09-30T22:19:13.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.963+0000 7f137a9a9700 1 -- 172.21.15.156:0/4052862848 shutdown_connections 2023-09-30T22:19:13.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.963+0000 7f137a9a9700 1 --2- 172.21.15.156:0/4052862848 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13741356e0 0x7f13741c8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:13.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.963+0000 7f137a9a9700 1 --2- 172.21.15.156:0/4052862848 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13740a0a30 0x7f13741c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:13.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.963+0000 7f137a9a9700 1 --2- 172.21.15.156:0/4052862848 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13740a1510 0x7f13741c8a50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:13.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.963+0000 7f137a9a9700 1 -- 172.21.15.156:0/4052862848 >> 172.21.15.156:0/4052862848 conn(0x7f13740a2980 msgr2=0x7f1374128f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:13.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.963+0000 7f137a9a9700 1 -- 172.21.15.156:0/4052862848 shutdown_connections 2023-09-30T22:19:13.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:13.963+0000 7f137a9a9700 1 -- 172.21.15.156:0/4052862848 wait complete. 2023-09-30T22:19:13.982 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:14.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.089+0000 7f522d0ba700 1 -- 172.21.15.156:0/3010732552 >> v1:172.21.15.156:6816/126965 conn(0x7f520c02f510 legacy=0x7f520c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:14.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.133+0000 7fd1c659c700 1 -- 172.21.15.156:0/1089382320 >> v1:172.21.15.156:6816/126965 conn(0x7fd1b402f510 legacy=0x7fd1b40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:14.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.148+0000 7f522f31e700 1 -- 172.21.15.156:0/3010732552 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f522812dd00 con 0x7f5228133ad0 2023-09-30T22:19:14.148 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:14.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.148+0000 7f521dffb700 1 -- 172.21.15.156:0/3010732552 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5220012e30 con 0x7f5228133ad0 2023-09-30T22:19:14.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.149+0000 7fd57d1a6700 1 -- 172.21.15.156:0/3836293334 >> v1:172.21.15.156:6816/126965 conn(0x7fd55c02f510 legacy=0x7fd55c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:14.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.151+0000 7f522f31e700 1 -- 172.21.15.156:0/3010732552 >> v1:172.21.15.156:6816/126965 conn(0x7f520c02f510 legacy=0x7f520c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:14.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.151+0000 7f522f31e700 1 -- 172.21.15.156:0/3010732552 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5228133ad0 msgr2=0x7f522811e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:14.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.151+0000 7f522f31e700 1 --2- 172.21.15.156:0/3010732552 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5228133ad0 0x7f522811e4c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5220016000 tx=0x7f5220004ad0 comp rx=0 tx=0).stop 2023-09-30T22:19:14.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.151+0000 7f522f31e700 1 -- 172.21.15.156:0/3010732552 shutdown_connections 2023-09-30T22:19:14.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.151+0000 7f522f31e700 1 --2- 172.21.15.156:0/3010732552 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5228133ad0 0x7f522811e4c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:14.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.151+0000 7f522f31e700 1 --2- 172.21.15.156:0/3010732552 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f52281300a0 0x7f522811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:14.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.151+0000 7f522f31e700 1 --2- 172.21.15.156:0/3010732552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5228130bc0 0x7f522811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:14.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.151+0000 7f522f31e700 1 -- 172.21.15.156:0/3010732552 >> 172.21.15.156:0/3010732552 conn(0x7f5228099c40 msgr2=0x7f522812f620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:14.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.151+0000 7f522f31e700 1 -- 172.21.15.156:0/3010732552 shutdown_connections 2023-09-30T22:19:14.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.151+0000 7f522f31e700 1 -- 172.21.15.156:0/3010732552 wait complete. 2023-09-30T22:19:14.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.154+0000 7fd57f40a700 1 -- 172.21.15.156:0/3836293334 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd57812a560 con 0x7fd5780a1400 2023-09-30T22:19:14.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.154+0000 7fd56dffb700 1 -- 172.21.15.156:0/3836293334 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd568010bd0 con 0x7fd5780a1400 2023-09-30T22:19:14.154 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:14.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.157+0000 7fd57f40a700 1 -- 172.21.15.156:0/3836293334 >> v1:172.21.15.156:6816/126965 conn(0x7fd55c02f510 legacy=0x7fd55c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:14.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.157+0000 7fd57f40a700 1 -- 172.21.15.156:0/3836293334 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd5780a1400 msgr2=0x7fd578126810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:14.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.157+0000 7fd57f40a700 1 --2- 172.21.15.156:0/3836293334 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd5780a1400 0x7fd578126810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd568005910 tx=0x7fd56800c7b0 comp rx=0 tx=0).stop 2023-09-30T22:19:14.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.157+0000 7fd57f40a700 1 -- 172.21.15.156:0/3836293334 shutdown_connections 2023-09-30T22:19:14.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.157+0000 7fd57f40a700 1 --2- 172.21.15.156:0/3836293334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd578138040 0x7fd578126d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:14.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.157+0000 7fd57f40a700 1 --2- 172.21.15.156:0/3836293334 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd5780a08e0 0x7fd5781262d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:14.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.157+0000 7fd57f40a700 1 --2- 172.21.15.156:0/3836293334 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd5780a1400 0x7fd578126810 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:14.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.157+0000 7fd57f40a700 1 -- 172.21.15.156:0/3836293334 >> 172.21.15.156:0/3836293334 conn(0x7fd5780a2980 msgr2=0x7fd57809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:14.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.157+0000 7fd57f40a700 1 -- 172.21.15.156:0/3836293334 shutdown_connections 2023-09-30T22:19:14.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.157+0000 7fd57f40a700 1 -- 172.21.15.156:0/3836293334 wait complete. 2023-09-30T22:19:14.164 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:14.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:14.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.188+0000 7fd1cd159700 1 -- 172.21.15.156:0/1089382320 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd1c809b8b0 con 0x7fd1c809e950 2023-09-30T22:19:14.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.189+0000 7fd1af7fe700 1 -- 172.21.15.156:0/1089382320 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd1b8003e40 con 0x7fd1c809e950 2023-09-30T22:19:14.188 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:14.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.191+0000 7fd1cd159700 1 -- 172.21.15.156:0/1089382320 >> v1:172.21.15.156:6816/126965 conn(0x7fd1b402f510 legacy=0x7fd1b40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:14.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.191+0000 7fd1cd159700 1 -- 172.21.15.156:0/1089382320 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1c809e950 msgr2=0x7fd1c81c8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:14.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.191+0000 7fd1cd159700 1 --2- 172.21.15.156:0/1089382320 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1c809e950 0x7fd1c81c8590 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd1b800c580 tx=0x7fd1b800c890 comp rx=0 tx=0).stop 2023-09-30T22:19:14.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.191+0000 7fd1cd159700 1 -- 172.21.15.156:0/1089382320 shutdown_connections 2023-09-30T22:19:14.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.191+0000 7fd1cd159700 1 --2- 172.21.15.156:0/1089382320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1c8137010 0x7fd1c806b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:14.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.191+0000 7fd1cd159700 1 --2- 172.21.15.156:0/1089382320 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1c809e950 0x7fd1c81c8590 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:14.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.191+0000 7fd1cd159700 1 --2- 172.21.15.156:0/1089382320 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1c809f430 0x7fd1c81c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:14.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.191+0000 7fd1cd159700 1 -- 172.21.15.156:0/1089382320 >> 172.21.15.156:0/1089382320 conn(0x7fd1c80a0f70 msgr2=0x7fd1c8071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:14.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.191+0000 7fd1cd159700 1 -- 172.21.15.156:0/1089382320 shutdown_connections 2023-09-30T22:19:14.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:14.191+0000 7fd1cd159700 1 -- 172.21.15.156:0/1089382320 wait complete. 2023-09-30T22:19:14.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:14.983 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:15.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.114+0000 7fe0865c2700 1 Processor -- start 2023-09-30T22:19:15.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.114+0000 7fe0865c2700 1 -- start start 2023-09-30T22:19:15.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.114+0000 7fe0865c2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe0801346e0 0x7fe080136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:15.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.114+0000 7fe0865c2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe080137000 0x7fe0801393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:15.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.114+0000 7fe0865c2700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0800a1640 con 0x7fe080131980 2023-09-30T22:19:15.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.114+0000 7fe0865c2700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe08006eb30 con 0x7fe0801346e0 2023-09-30T22:19:15.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.114+0000 7fe0865c2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800a22d0 con 0x7fe080137000 2023-09-30T22:19:15.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.115+0000 7fe084b5f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe080137000 0x7fe0801393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:15.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.115+0000 7fe07f7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe0801346e0 0x7fe080136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:15.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.115+0000 7fe084b5f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe080137000 0x7fe0801393e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48292/0 (socket says 172.21.15.156:48292) 2023-09-30T22:19:15.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.115+0000 7fe07f7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe0801346e0 0x7fe080136ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40258/0 (socket says 172.21.15.156:40258) 2023-09-30T22:19:15.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.115+0000 7fe084b5f700 1 -- 172.21.15.156:0/2395350958 learned_addr learned my addr 172.21.15.156:0/2395350958 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:15.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.115+0000 7fe084b5f700 1 -- 172.21.15.156:0/2395350958 >> v2:172.21.15.156:3300/0 conn(0x7fe0801346e0 msgr2=0x7fe080136ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:15.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.115+0000 7fe084b5f700 1 --2- 172.21.15.156:0/2395350958 >> v2:172.21.15.156:3300/0 conn(0x7fe0801346e0 0x7fe080136ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.115+0000 7fe084b5f700 1 -- 172.21.15.156:0/2395350958 >> v1:172.21.15.156:6789/0 conn(0x7fe080131980 legacy=0x7fe080131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:15.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.115+0000 7fe084b5f700 1 -- 172.21.15.156:0/2395350958 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe080131550 con 0x7fe080137000 2023-09-30T22:19:15.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.115+0000 7fe07f7fe700 1 --2- 172.21.15.156:0/2395350958 >> v2:172.21.15.156:3300/0 conn(0x7fe0801346e0 0x7fe080136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:15.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.115+0000 7fe084b5f700 1 --2- 172.21.15.156:0/2395350958 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe080137000 0x7fe0801393e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe078009e50 tx=0x7fe07800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=486955445515c287 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:15.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.115+0000 7fe07effd700 1 -- 172.21.15.156:0/2395350958 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07800e070 con 0x7fe080137000 2023-09-30T22:19:15.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.115+0000 7fe07effd700 1 -- 172.21.15.156:0/2395350958 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07800b910 con 0x7fe080137000 2023-09-30T22:19:15.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.115+0000 7fe07effd700 1 -- 172.21.15.156:0/2395350958 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07800bcc0 con 0x7fe080137000 2023-09-30T22:19:15.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.116+0000 7fe0865c2700 1 -- 172.21.15.156:0/2395350958 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe080137000 msgr2=0x7fe0801393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:15.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.116+0000 7fe0865c2700 1 --2- 172.21.15.156:0/2395350958 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe080137000 0x7fe0801393e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe078009e50 tx=0x7fe07800b330 comp rx=0 tx=0).stop 2023-09-30T22:19:15.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.116+0000 7fe0865c2700 1 -- 172.21.15.156:0/2395350958 shutdown_connections 2023-09-30T22:19:15.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.116+0000 7fe0865c2700 1 --2- 172.21.15.156:0/2395350958 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe080137000 0x7fe0801393e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.116+0000 7fe0865c2700 1 --2- 172.21.15.156:0/2395350958 >> v2:172.21.15.156:3300/0 conn(0x7fe0801346e0 0x7fe080136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.116+0000 7fe0865c2700 1 -- 172.21.15.156:0/2395350958 >> 172.21.15.156:0/2395350958 conn(0x7fe0800a2980 msgr2=0x7fe0800a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:15.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.116+0000 7fe0865c2700 1 -- 172.21.15.156:0/2395350958 shutdown_connections 2023-09-30T22:19:15.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.116+0000 7fe0865c2700 1 -- 172.21.15.156:0/2395350958 wait complete. 2023-09-30T22:19:15.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.117+0000 7fe0865c2700 1 Processor -- start 2023-09-30T22:19:15.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.117+0000 7fe0865c2700 1 -- start start 2023-09-30T22:19:15.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.117+0000 7fe0865c2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe080131980 0x7fe080119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:15.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.117+0000 7fe0865c2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0801346e0 0x7fe080119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:15.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.117+0000 7fe0865c2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe080137000 0x7fe080119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:15.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.117+0000 7fe0865c2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08011ca80 con 0x7fe080131980 2023-09-30T22:19:15.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.117+0000 7fe0865c2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08011b330 con 0x7fe0801346e0 2023-09-30T22:19:15.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.117+0000 7fe0865c2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe080136d60 con 0x7fe080137000 2023-09-30T22:19:15.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.117+0000 7fe07ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe080131980 0x7fe080119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:15.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.117+0000 7fe084b5f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe080137000 0x7fe080119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:15.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.117+0000 7fe07f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0801346e0 0x7fe080119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:15.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.117+0000 7fe07ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe080131980 0x7fe080119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40268/0 (socket says 172.21.15.156:40268) 2023-09-30T22:19:15.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.117+0000 7fe084b5f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe080137000 0x7fe080119ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48300/0 (socket says 172.21.15.156:48300) 2023-09-30T22:19:15.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.117+0000 7fe07ffff700 1 -- 172.21.15.156:0/1790396386 learned_addr learned my addr 172.21.15.156:0/1790396386 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:15.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.118+0000 7fe07ffff700 1 -- 172.21.15.156:0/1790396386 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe080137000 msgr2=0x7fe080119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:15.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.118+0000 7fe07ffff700 1 --2- 172.21.15.156:0/1790396386 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe080137000 0x7fe080119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.118+0000 7fe07ffff700 1 -- 172.21.15.156:0/1790396386 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0801346e0 msgr2=0x7fe080119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:15.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.118+0000 7fe07ffff700 1 --2- 172.21.15.156:0/1790396386 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0801346e0 0x7fe080119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.118+0000 7fe07ffff700 1 -- 172.21.15.156:0/1790396386 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0700094a0 con 0x7fe080131980 2023-09-30T22:19:15.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.118+0000 7fe084b5f700 1 --2- 172.21.15.156:0/1790396386 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe080137000 0x7fe080119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:15.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.118+0000 7fe07ffff700 1 --2- 172.21.15.156:0/1790396386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe080131980 0x7fe080119050 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe07400c500 tx=0x7fe07400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:15.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.118+0000 7fe07cff9700 1 -- 172.21.15.156:0/1790396386 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0740054e0 con 0x7fe080131980 2023-09-30T22:19:15.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.118+0000 7fe07cff9700 1 -- 172.21.15.156:0/1790396386 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe074003680 con 0x7fe080131980 2023-09-30T22:19:15.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.118+0000 7fe07cff9700 1 -- 172.21.15.156:0/1790396386 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074003a30 con 0x7fe080131980 2023-09-30T22:19:15.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.118+0000 7fe0865c2700 1 -- 172.21.15.156:0/1790396386 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe078009b30 con 0x7fe080131980 2023-09-30T22:19:15.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.118+0000 7fe0865c2700 1 -- 172.21.15.156:0/1790396386 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe08011c170 con 0x7fe080131980 2023-09-30T22:19:15.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.119+0000 7fe07cff9700 1 -- 172.21.15.156:0/1790396386 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe074003b90 con 0x7fe080131980 2023-09-30T22:19:15.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.119+0000 7fe07cff9700 1 -- 172.21.15.156:0/1790396386 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fe07403ef60 con 0x7fe080131980 2023-09-30T22:19:15.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.119+0000 7fe07f7fe700 1 -- 172.21.15.156:0/1790396386 >> v1:172.21.15.156:6816/126965 conn(0x7fe06c02f510 legacy=0x7fe06c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:15.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.119+0000 7fe0865c2700 1 -- 172.21.15.156:0/1790396386 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe08011c360 con 0x7fe080131980 2023-09-30T22:19:15.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.124+0000 7fe07cff9700 1 -- 172.21.15.156:0/1790396386 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe074017070 con 0x7fe080131980 2023-09-30T22:19:15.165 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:15.170 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:15.203 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:15.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.295+0000 7f8f61e64700 1 Processor -- start 2023-09-30T22:19:15.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.295+0000 7f8f61e64700 1 -- start start 2023-09-30T22:19:15.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.295+0000 7f8f61e64700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8f5c133ad0 0x7f8f5c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:15.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.295+0000 7f8f61e64700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f5c130bc0 0x7f8f5c13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:15.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.295+0000 7f8f61e64700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f5c06b2d0 con 0x7f8f5c1300a0 2023-09-30T22:19:15.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.296+0000 7f8f61e64700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f5c133610 con 0x7f8f5c133ad0 2023-09-30T22:19:15.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.296+0000 7f8f61e64700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c09a500 con 0x7f8f5c130bc0 2023-09-30T22:19:15.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.296+0000 7f8f5bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f5c130bc0 0x7f8f5c13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:15.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.296+0000 7f8f5bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f5c130bc0 0x7f8f5c13b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48306/0 (socket says 172.21.15.156:48306) 2023-09-30T22:19:15.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.296+0000 7f8f5bfff700 1 -- 172.21.15.156:0/1739436384 learned_addr learned my addr 172.21.15.156:0/1739436384 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:15.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.296+0000 7f8f5b7fe700 1 --2- 172.21.15.156:0/1739436384 >> v2:172.21.15.156:3300/0 conn(0x7f8f5c133ad0 0x7f8f5c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:15.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.296+0000 7f8f5b7fe700 1 -- 172.21.15.156:0/1739436384 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f5c130bc0 msgr2=0x7f8f5c13b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:15.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.296+0000 7f8f5a7fc700 1 -- 172.21.15.156:0/1739436384 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4203772416 0 0) 0x7f8f5c06b2d0 con 0x7f8f5c1300a0 2023-09-30T22:19:15.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.296+0000 7f8f5b7fe700 1 --2- 172.21.15.156:0/1739436384 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f5c130bc0 0x7f8f5c13b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.296+0000 7f8f5b7fe700 1 -- 172.21.15.156:0/1739436384 >> v1:172.21.15.156:6789/0 conn(0x7f8f5c1300a0 legacy=0x7f8f5c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:15.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.296+0000 7f8f5b7fe700 1 -- 172.21.15.156:0/1739436384 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c1338b0 con 0x7f8f5c133ad0 2023-09-30T22:19:15.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.296+0000 7f8f5bfff700 1 --2- 172.21.15.156:0/1739436384 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f5c130bc0 0x7f8f5c13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:15.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.296+0000 7f8f5b7fe700 1 --2- 172.21.15.156:0/1739436384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f5c133ad0 0x7f8f5c133ea0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c009840 tx=0x7f8f4c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700bcffb6ed98c60 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:15.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.296+0000 7f8f5a7fc700 1 -- 172.21.15.156:0/1739436384 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c011830 con 0x7f8f5c133ad0 2023-09-30T22:19:15.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.297+0000 7f8f5a7fc700 1 -- 172.21.15.156:0/1739436384 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4c011990 con 0x7f8f5c133ad0 2023-09-30T22:19:15.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.297+0000 7f8f5a7fc700 1 -- 172.21.15.156:0/1739436384 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c011d20 con 0x7f8f5c133ad0 2023-09-30T22:19:15.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.297+0000 7f8f61e64700 1 -- 172.21.15.156:0/1739436384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f5c133ad0 msgr2=0x7f8f5c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:15.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.297+0000 7f8f61e64700 1 --2- 172.21.15.156:0/1739436384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f5c133ad0 0x7f8f5c133ea0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c009840 tx=0x7f8f4c009b50 comp rx=0 tx=0).stop 2023-09-30T22:19:15.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.297+0000 7f8f61e64700 1 -- 172.21.15.156:0/1739436384 shutdown_connections 2023-09-30T22:19:15.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.297+0000 7f8f61e64700 1 --2- 172.21.15.156:0/1739436384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f5c133ad0 0x7f8f5c133ea0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.297+0000 7f8f61e64700 1 --2- 172.21.15.156:0/1739436384 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f5c130bc0 0x7f8f5c13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.297+0000 7f8f61e64700 1 -- 172.21.15.156:0/1739436384 >> 172.21.15.156:0/1739436384 conn(0x7f8f5c099c40 msgr2=0x7f8f5c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:15.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.297+0000 7f8f61e64700 1 -- 172.21.15.156:0/1739436384 shutdown_connections 2023-09-30T22:19:15.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.297+0000 7f8f61e64700 1 -- 172.21.15.156:0/1739436384 wait complete. 2023-09-30T22:19:15.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.298+0000 7f8f61e64700 1 Processor -- start 2023-09-30T22:19:15.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.298+0000 7f8f61e64700 1 -- start start 2023-09-30T22:19:15.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.299+0000 7f8f61e64700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f5c1300a0 0x7f8f5c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:15.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.299+0000 7f8f61e64700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f5c130bc0 0x7f8f5c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:15.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.299+0000 7f8f61e64700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f5c133ad0 0x7f8f5c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:15.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.299+0000 7f8f61e64700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c1208e0 con 0x7f8f5c1300a0 2023-09-30T22:19:15.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.299+0000 7f8f61e64700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c072150 con 0x7f8f5c130bc0 2023-09-30T22:19:15.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.299+0000 7f8f61e64700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c11f9d0 con 0x7f8f5c133ad0 2023-09-30T22:19:15.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.299+0000 7f8f5affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f5c130bc0 0x7f8f5c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:15.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.299+0000 7f8f5affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f5c130bc0 0x7f8f5c11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52762/0 (socket says 172.21.15.156:52762) 2023-09-30T22:19:15.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.299+0000 7f8f5bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f5c133ad0 0x7f8f5c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:15.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.299+0000 7f8f5affd700 1 -- 172.21.15.156:0/2638231952 learned_addr learned my addr 172.21.15.156:0/2638231952 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:15.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.299+0000 7f8f5b7fe700 1 --2- 172.21.15.156:0/2638231952 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f5c1300a0 0x7f8f5c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:15.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.299+0000 7f8f5affd700 1 -- 172.21.15.156:0/2638231952 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f5c133ad0 msgr2=0x7f8f5c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:15.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.299+0000 7f8f5affd700 1 --2- 172.21.15.156:0/2638231952 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f5c133ad0 0x7f8f5c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.299+0000 7f8f5affd700 1 -- 172.21.15.156:0/2638231952 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f5c1300a0 msgr2=0x7f8f5c11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:15.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.299+0000 7f8f5affd700 1 --2- 172.21.15.156:0/2638231952 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f5c1300a0 0x7f8f5c11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.299+0000 7f8f5affd700 1 -- 172.21.15.156:0/2638231952 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f54009b30 con 0x7f8f5c130bc0 2023-09-30T22:19:15.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.299+0000 7f8f5bfff700 1 --2- 172.21.15.156:0/2638231952 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f5c133ad0 0x7f8f5c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:15.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.299+0000 7f8f5b7fe700 1 --2- 172.21.15.156:0/2638231952 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f5c1300a0 0x7f8f5c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:19:15.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.300+0000 7f8f5affd700 1 --2- 172.21.15.156:0/2638231952 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f5c130bc0 0x7f8f5c11df80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8f5000c550 tx=0x7f8f5000c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:15.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.300+0000 7f8f43fff700 1 -- 172.21.15.156:0/2638231952 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f500054e0 con 0x7f8f5c130bc0 2023-09-30T22:19:15.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.300+0000 7f8f43fff700 1 -- 172.21.15.156:0/2638231952 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f50003680 con 0x7f8f5c130bc0 2023-09-30T22:19:15.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.300+0000 7f8f61e64700 1 -- 172.21.15.156:0/2638231952 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f4c0094a0 con 0x7f8f5c130bc0 2023-09-30T22:19:15.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.300+0000 7f8f43fff700 1 -- 172.21.15.156:0/2638231952 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f50003a30 con 0x7f8f5c130bc0 2023-09-30T22:19:15.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.300+0000 7f8f61e64700 1 -- 172.21.15.156:0/2638231952 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f5c11edd0 con 0x7f8f5c130bc0 2023-09-30T22:19:15.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.301+0000 7f8f43fff700 1 -- 172.21.15.156:0/2638231952 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8f50003b90 con 0x7f8f5c130bc0 2023-09-30T22:19:15.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.301+0000 7f8f61e64700 1 -- 172.21.15.156:0/2638231952 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f5c0a2620 con 0x7f8f5c130bc0 2023-09-30T22:19:15.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.301+0000 7f8f43fff700 1 -- 172.21.15.156:0/2638231952 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f8f5003f000 con 0x7f8f5c130bc0 2023-09-30T22:19:15.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.301+0000 7f8f5b7fe700 1 -- 172.21.15.156:0/2638231952 >> v1:172.21.15.156:6816/126965 conn(0x7f8f4802f510 legacy=0x7f8f480319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:15.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.310+0000 7f8f43fff700 1 -- 172.21.15.156:0/2638231952 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f50003e40 con 0x7f8f5c130bc0 2023-09-30T22:19:15.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.320+0000 7fe07f7fe700 1 -- 172.21.15.156:0/1790396386 >> v1:172.21.15.156:6816/126965 conn(0x7fe06c02f510 legacy=0x7fe06c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:15.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.330+0000 7fe0865c2700 1 -- 172.21.15.156:0/1790396386 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe08004f2a0 con 0x7fe080131980 2023-09-30T22:19:15.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.331+0000 7fe07cff9700 1 -- 172.21.15.156:0/1790396386 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe074003e40 con 0x7fe080131980 2023-09-30T22:19:15.331 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:15.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.333+0000 7fe0865c2700 1 -- 172.21.15.156:0/1790396386 >> v1:172.21.15.156:6816/126965 conn(0x7fe06c02f510 legacy=0x7fe06c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:15.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.333+0000 7fe0865c2700 1 -- 172.21.15.156:0/1790396386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe080131980 msgr2=0x7fe080119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:15.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.333+0000 7fe0865c2700 1 --2- 172.21.15.156:0/1790396386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe080131980 0x7fe080119050 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe07400c500 tx=0x7fe07400c810 comp rx=0 tx=0).stop 2023-09-30T22:19:15.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.333+0000 7fe0865c2700 1 -- 172.21.15.156:0/1790396386 shutdown_connections 2023-09-30T22:19:15.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.333+0000 7fe0865c2700 1 --2- 172.21.15.156:0/1790396386 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe080137000 0x7fe080119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.333+0000 7fe0865c2700 1 --2- 172.21.15.156:0/1790396386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe080131980 0x7fe080119050 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.333+0000 7fe0865c2700 1 --2- 172.21.15.156:0/1790396386 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0801346e0 0x7fe080119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.333+0000 7fe0865c2700 1 -- 172.21.15.156:0/1790396386 >> 172.21.15.156:0/1790396386 conn(0x7fe0800a2980 msgr2=0x7fe080133560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:15.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.333+0000 7fe0865c2700 1 -- 172.21.15.156:0/1790396386 shutdown_connections 2023-09-30T22:19:15.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.333+0000 7fe0865c2700 1 -- 172.21.15.156:0/1790396386 wait complete. 2023-09-30T22:19:15.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.338+0000 7fa8409d8700 1 Processor -- start 2023-09-30T22:19:15.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.339+0000 7f11dd7ca700 1 Processor -- start 2023-09-30T22:19:15.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.339+0000 7fa8409d8700 1 -- start start 2023-09-30T22:19:15.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.339+0000 7f11dd7ca700 1 -- start start 2023-09-30T22:19:15.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.339+0000 7f11dd7ca700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f11d809d860 0x7f11d809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:15.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.339+0000 7f11dd7ca700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f11d8130eb0 0x7f11d8138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:15.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.339+0000 7f11dd7ca700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d809aaa0 con 0x7f11d809e170 2023-09-30T22:19:15.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.339+0000 7f11dd7ca700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d809f870 con 0x7f11d8130eb0 2023-09-30T22:19:15.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.339+0000 7f11dd7ca700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d809b360 con 0x7f11d809d860 2023-09-30T22:19:15.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.339+0000 7fa8409d8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa83c09e340 0x7fa83c1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:15.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.339+0000 7fa8409d8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa83c135f20 0x7fa83c138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:15.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.339+0000 7fa8409d8700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa83c09aaa0 con 0x7fa83c09d860 2023-09-30T22:19:15.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.339+0000 7fa8409d8700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa83c09e730 con 0x7fa83c135f20 2023-09-30T22:19:15.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.339+0000 7fa8409d8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c09f870 con 0x7fa83c09e340 2023-09-30T22:19:15.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.339+0000 7f11d6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f11d809d860 0x7f11d809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:15.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.339+0000 7f11d6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f11d809d860 0x7f11d809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52768/0 (socket says 172.21.15.156:52768) 2023-09-30T22:19:15.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.339+0000 7f11d6ffd700 1 -- 172.21.15.156:0/2307442165 learned_addr learned my addr 172.21.15.156:0/2307442165 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:15.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.339+0000 7fa839d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa83c09e340 0x7fa83c1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:15.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.339+0000 7fa839d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa83c09e340 0x7fa83c1359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48320/0 (socket says 172.21.15.156:48320) 2023-09-30T22:19:15.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.339+0000 7fa839d9b700 1 -- 172.21.15.156:0/1761472712 learned_addr learned my addr 172.21.15.156:0/1761472712 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:15.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.340+0000 7fa83ad9d700 1 --2- 172.21.15.156:0/1761472712 >> v2:172.21.15.156:3300/0 conn(0x7fa83c135f20 0x7fa83c138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:15.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.340+0000 7fa839d9b700 1 -- 172.21.15.156:0/1761472712 >> v2:172.21.15.156:3300/0 conn(0x7fa83c135f20 msgr2=0x7fa83c138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:15.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.340+0000 7fa839d9b700 1 --2- 172.21.15.156:0/1761472712 >> v2:172.21.15.156:3300/0 conn(0x7fa83c135f20 0x7fa83c138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.340+0000 7fa839d9b700 1 -- 172.21.15.156:0/1761472712 >> v1:172.21.15.156:6789/0 conn(0x7fa83c09d860 legacy=0x7fa83c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:15.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.340+0000 7f11d6ffd700 1 -- 172.21.15.156:0/2307442165 >> v2:172.21.15.156:3300/0 conn(0x7f11d8130eb0 msgr2=0x7f11d8138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:15.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.340+0000 7f11d6ffd700 1 --2- 172.21.15.156:0/2307442165 >> v2:172.21.15.156:3300/0 conn(0x7f11d8130eb0 0x7f11d8138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.340+0000 7f11d6ffd700 1 -- 172.21.15.156:0/2307442165 >> v1:172.21.15.156:6789/0 conn(0x7f11d809e170 legacy=0x7f11d81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:15.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.340+0000 7f11d6ffd700 1 -- 172.21.15.156:0/2307442165 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d809b620 con 0x7f11d809d860 2023-09-30T22:19:15.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.340+0000 7fa839d9b700 1 -- 172.21.15.156:0/1761472712 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c09b360 con 0x7fa83c09e340 2023-09-30T22:19:15.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.340+0000 7fa83ad9d700 1 --2- 172.21.15.156:0/1761472712 >> v2:172.21.15.156:3300/0 conn(0x7fa83c135f20 0x7fa83c138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:19:15.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.340+0000 7f11d6ffd700 1 --2- 172.21.15.156:0/2307442165 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f11d809d860 0x7f11d809dc30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f11cc00bb90 tx=0x7f11cc00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0e337d2c7429329 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:15.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.340+0000 7fa839d9b700 1 --2- 172.21.15.156:0/1761472712 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa83c09e340 0x7fa83c1359e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa83000bb90 tx=0x7fa83000bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb5b6a704fe7d7ed server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:15.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.340+0000 7fa83959a700 1 -- 172.21.15.156:0/1761472712 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83000dd10 con 0x7fa83c09e340 2023-09-30T22:19:15.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.340+0000 7f11d5ffb700 1 -- 172.21.15.156:0/2307442165 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc00dd10 con 0x7f11d809d860 2023-09-30T22:19:15.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.340+0000 7fa83959a700 1 -- 172.21.15.156:0/1761472712 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83000de70 con 0x7fa83c09e340 2023-09-30T22:19:15.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.340+0000 7fa83959a700 1 -- 172.21.15.156:0/1761472712 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa830004230 con 0x7fa83c09e340 2023-09-30T22:19:15.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.340+0000 7f11d5ffb700 1 -- 172.21.15.156:0/2307442165 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11cc00de70 con 0x7f11d809d860 2023-09-30T22:19:15.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.340+0000 7f11d5ffb700 1 -- 172.21.15.156:0/2307442165 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc004230 con 0x7f11d809d860 2023-09-30T22:19:15.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.341+0000 7f11dd7ca700 1 -- 172.21.15.156:0/2307442165 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f11d809d860 msgr2=0x7f11d809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:15.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.341+0000 7f11dd7ca700 1 --2- 172.21.15.156:0/2307442165 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f11d809d860 0x7f11d809dc30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f11cc00bb90 tx=0x7f11cc00bea0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.341+0000 7f11dd7ca700 1 -- 172.21.15.156:0/2307442165 shutdown_connections 2023-09-30T22:19:15.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.341+0000 7f11dd7ca700 1 --2- 172.21.15.156:0/2307442165 >> v2:172.21.15.156:3300/0 conn(0x7f11d8130eb0 0x7f11d8138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.341+0000 7f11dd7ca700 1 --2- 172.21.15.156:0/2307442165 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f11d809d860 0x7f11d809dc30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.341+0000 7f11dd7ca700 1 -- 172.21.15.156:0/2307442165 >> 172.21.15.156:0/2307442165 conn(0x7f11d8099c40 msgr2=0x7f11d80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.341+0000 7f11dd7ca700 1 -- 172.21.15.156:0/2307442165 shutdown_connections 2023-09-30T22:19:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.341+0000 7f11dd7ca700 1 -- 172.21.15.156:0/2307442165 wait complete. 2023-09-30T22:19:15.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.341+0000 7fa8409d8700 1 -- 172.21.15.156:0/1761472712 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa83c09e340 msgr2=0x7fa83c1359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:15.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.341+0000 7fa8409d8700 1 --2- 172.21.15.156:0/1761472712 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa83c09e340 0x7fa83c1359e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa83000bb90 tx=0x7fa83000bea0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.342+0000 7fa8409d8700 1 -- 172.21.15.156:0/1761472712 shutdown_connections 2023-09-30T22:19:15.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.342+0000 7fa8409d8700 1 --2- 172.21.15.156:0/1761472712 >> v2:172.21.15.156:3300/0 conn(0x7fa83c135f20 0x7fa83c138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.342+0000 7fa8409d8700 1 --2- 172.21.15.156:0/1761472712 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa83c09e340 0x7fa83c1359e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.342+0000 7fa8409d8700 1 -- 172.21.15.156:0/1761472712 >> 172.21.15.156:0/1761472712 conn(0x7fa83c099c40 msgr2=0x7fa83c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:15.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.342+0000 7fa8409d8700 1 -- 172.21.15.156:0/1761472712 shutdown_connections 2023-09-30T22:19:15.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.342+0000 7fa8409d8700 1 -- 172.21.15.156:0/1761472712 wait complete. 2023-09-30T22:19:15.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.342+0000 7f11dd7ca700 1 Processor -- start 2023-09-30T22:19:15.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.342+0000 7f11dd7ca700 1 -- start start 2023-09-30T22:19:15.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.343+0000 7f11dd7ca700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f11d809d860 0x7f11d8123340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:15.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.343+0000 7f11dd7ca700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f11d809e170 0x7f11d8123880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:15.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.343+0000 7f11dd7ca700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11d8130eb0 0x7f11d81c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:15.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.343+0000 7f11dd7ca700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d8126300 con 0x7f11d8130eb0 2023-09-30T22:19:15.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.343+0000 7f11dd7ca700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d8126500 con 0x7f11d809d860 2023-09-30T22:19:15.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.343+0000 7f11dd7ca700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11d81245f0 con 0x7f11d809e170 2023-09-30T22:19:15.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.343+0000 7fa8409d8700 1 Processor -- start 2023-09-30T22:19:15.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.343+0000 7f11d67fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f11d809e170 0x7f11d8123880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:15.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.343+0000 7f11d6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f11d809d860 0x7f11d8123340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:15.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.343+0000 7f11d67fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f11d809e170 0x7f11d8123880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48324/0 (socket says 172.21.15.156:48324) 2023-09-30T22:19:15.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.343+0000 7f11d67fc700 1 -- 172.21.15.156:0/4026456971 learned_addr learned my addr 172.21.15.156:0/4026456971 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:15.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.343+0000 7f11d6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f11d809d860 0x7f11d8123340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52772/0 (socket says 172.21.15.156:52772) 2023-09-30T22:19:15.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.343+0000 7f11d77fe700 1 --2- 172.21.15.156:0/4026456971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11d8130eb0 0x7f11d81c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:15.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.344+0000 7f11d77fe700 1 -- 172.21.15.156:0/4026456971 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f11d809e170 msgr2=0x7f11d8123880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:15.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.344+0000 7f11d77fe700 1 --2- 172.21.15.156:0/4026456971 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f11d809e170 0x7f11d8123880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.344+0000 7f11d77fe700 1 -- 172.21.15.156:0/4026456971 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f11d809d860 msgr2=0x7f11d8123340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:15.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.344+0000 7f11d77fe700 1 --2- 172.21.15.156:0/4026456971 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f11d809d860 0x7f11d8123340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.344+0000 7f11d77fe700 1 -- 172.21.15.156:0/4026456971 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11cc00b7f0 con 0x7f11d8130eb0 2023-09-30T22:19:15.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.344+0000 7f11d67fc700 1 --2- 172.21.15.156:0/4026456971 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f11d809e170 0x7f11d8123880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:15.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.344+0000 7f11d6ffd700 1 --2- 172.21.15.156:0/4026456971 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f11d809d860 0x7f11d8123340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:15.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.344+0000 7f11d77fe700 1 --2- 172.21.15.156:0/4026456971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11d8130eb0 0x7f11d81c83d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f11d000be20 tx=0x7f11d0009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:15.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.344+0000 7f11bf7fe700 1 -- 172.21.15.156:0/4026456971 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d000cb90 con 0x7f11d8130eb0 2023-09-30T22:19:15.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.343+0000 7fa8409d8700 1 -- start start 2023-09-30T22:19:15.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.344+0000 7fa8409d8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa83c09d860 0x7fa83c119e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:15.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.344+0000 7fa8409d8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa83c09e340 0x7fa83c11a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:15.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.344+0000 7fa8409d8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa83c135f20 0x7fa83c1cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:15.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.344+0000 7fa8409d8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c11b5e0 con 0x7fa83c135f20 2023-09-30T22:19:15.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.344+0000 7fa8409d8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c11cea0 con 0x7fa83c09e340 2023-09-30T22:19:15.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.344+0000 7fa8409d8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c11c030 con 0x7fa83c09d860 2023-09-30T22:19:15.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.344+0000 7f11bf7fe700 1 -- 172.21.15.156:0/4026456971 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d000cd10 con 0x7f11d8130eb0 2023-09-30T22:19:15.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.344+0000 7f11dd7ca700 1 -- 172.21.15.156:0/4026456971 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d809c8b0 con 0x7f11d8130eb0 2023-09-30T22:19:15.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.344+0000 7f11dd7ca700 1 -- 172.21.15.156:0/4026456971 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d8126c90 con 0x7f11d8130eb0 2023-09-30T22:19:15.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.344+0000 7fa83a59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa83c09d860 0x7fa83c119e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:15.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.344+0000 7fa83a59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa83c09d860 0x7fa83c119e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48336/0 (socket says 172.21.15.156:48336) 2023-09-30T22:19:15.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.344+0000 7fa83a59c700 1 -- 172.21.15.156:0/570478578 learned_addr learned my addr 172.21.15.156:0/570478578 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:15.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.344+0000 7fa839d9b700 1 --2- 172.21.15.156:0/570478578 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa83c09e340 0x7fa83c11a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:15.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.344+0000 7fa83ad9d700 1 --2- 172.21.15.156:0/570478578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa83c135f20 0x7fa83c1cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:15.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.345+0000 7f11bf7fe700 1 -- 172.21.15.156:0/4026456971 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d0014680 con 0x7f11d8130eb0 2023-09-30T22:19:15.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.345+0000 7fa83ad9d700 1 -- 172.21.15.156:0/570478578 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa83c09d860 msgr2=0x7fa83c119e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:15.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.345+0000 7fa83ad9d700 1 --2- 172.21.15.156:0/570478578 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa83c09d860 0x7fa83c119e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.345+0000 7fa83ad9d700 1 -- 172.21.15.156:0/570478578 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa83c09e340 msgr2=0x7fa83c11a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:15.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.345+0000 7fa83ad9d700 1 --2- 172.21.15.156:0/570478578 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa83c09e340 0x7fa83c11a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.345+0000 7fa83ad9d700 1 -- 172.21.15.156:0/570478578 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83000b7f0 con 0x7fa83c135f20 2023-09-30T22:19:15.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.345+0000 7fa83a59c700 1 --2- 172.21.15.156:0/570478578 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa83c09d860 0x7fa83c119e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:15.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.345+0000 7fa83ad9d700 1 --2- 172.21.15.156:0/570478578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa83c135f20 0x7fa83c1cc570 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa83400cdf0 tx=0x7fa83400ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:15.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.346+0000 7f11dd7ca700 1 -- 172.21.15.156:0/4026456971 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b80052e0 con 0x7f11d8130eb0 2023-09-30T22:19:15.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.346+0000 7f11bf7fe700 1 -- 172.21.15.156:0/4026456971 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f11d001d3b0 con 0x7f11d8130eb0 2023-09-30T22:19:15.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.346+0000 7fa82affd700 1 -- 172.21.15.156:0/570478578 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83400ac80 con 0x7fa83c135f20 2023-09-30T22:19:15.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.346+0000 7f11bf7fe700 1 -- 172.21.15.156:0/4026456971 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f11d0006e40 con 0x7f11d8130eb0 2023-09-30T22:19:15.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.346+0000 7f11d6ffd700 1 -- 172.21.15.156:0/4026456971 >> v1:172.21.15.156:6816/126965 conn(0x7f11c402f510 legacy=0x7f11c40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:15.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.346+0000 7fa8409d8700 1 -- 172.21.15.156:0/570478578 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa83c119a10 con 0x7fa83c135f20 2023-09-30T22:19:15.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.346+0000 7fa8409d8700 1 -- 172.21.15.156:0/570478578 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83c0a2270 con 0x7fa83c135f20 2023-09-30T22:19:15.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:15.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.349+0000 7fa8409d8700 1 -- 172.21.15.156:0/570478578 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa83c11c860 con 0x7fa83c135f20 2023-09-30T22:19:15.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.351+0000 7f11bf7fe700 1 -- 172.21.15.156:0/4026456971 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f11d001c360 con 0x7f11d8130eb0 2023-09-30T22:19:15.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.351+0000 7fa82affd700 1 -- 172.21.15.156:0/570478578 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa834007940 con 0x7fa83c135f20 2023-09-30T22:19:15.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.351+0000 7fa82affd700 1 -- 172.21.15.156:0/570478578 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83401f440 con 0x7fa83c135f20 2023-09-30T22:19:15.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.352+0000 7fa82affd700 1 -- 172.21.15.156:0/570478578 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa834015440 con 0x7fa83c135f20 2023-09-30T22:19:15.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.352+0000 7fa82affd700 1 -- 172.21.15.156:0/570478578 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fa834040720 con 0x7fa83c135f20 2023-09-30T22:19:15.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.352+0000 7fa83a59c700 1 -- 172.21.15.156:0/570478578 >> v1:172.21.15.156:6816/126965 conn(0x7fa81c02f510 legacy=0x7fa81c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:15.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.356+0000 7fa82affd700 1 -- 172.21.15.156:0/570478578 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa834015b10 con 0x7fa83c135f20 2023-09-30T22:19:15.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.502+0000 7f8f5b7fe700 1 -- 172.21.15.156:0/2638231952 >> v1:172.21.15.156:6816/126965 conn(0x7f8f4802f510 legacy=0x7f8f480319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:15.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.507+0000 7f8f61e64700 1 -- 172.21.15.156:0/2638231952 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8f5c04f2a0 con 0x7f8f5c130bc0 2023-09-30T22:19:15.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.507+0000 7f8f43fff700 1 -- 172.21.15.156:0/2638231952 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f50017020 con 0x7f8f5c130bc0 2023-09-30T22:19:15.507 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:15.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.509+0000 7f8f61e64700 1 -- 172.21.15.156:0/2638231952 >> v1:172.21.15.156:6816/126965 conn(0x7f8f4802f510 legacy=0x7f8f480319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:15.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.509+0000 7f8f61e64700 1 -- 172.21.15.156:0/2638231952 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f5c130bc0 msgr2=0x7f8f5c11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:15.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.509+0000 7f8f61e64700 1 --2- 172.21.15.156:0/2638231952 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f5c130bc0 0x7f8f5c11df80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8f5000c550 tx=0x7f8f5000c860 comp rx=0 tx=0).stop 2023-09-30T22:19:15.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.509+0000 7f8f61e64700 1 -- 172.21.15.156:0/2638231952 shutdown_connections 2023-09-30T22:19:15.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.509+0000 7f8f61e64700 1 --2- 172.21.15.156:0/2638231952 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f5c133ad0 0x7f8f5c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.509+0000 7f8f61e64700 1 --2- 172.21.15.156:0/2638231952 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f5c1300a0 0x7f8f5c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.509+0000 7f8f61e64700 1 --2- 172.21.15.156:0/2638231952 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f5c130bc0 0x7f8f5c11df80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.509+0000 7f8f61e64700 1 -- 172.21.15.156:0/2638231952 >> 172.21.15.156:0/2638231952 conn(0x7f8f5c099c40 msgr2=0x7f8f5c132bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:15.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.509+0000 7f8f61e64700 1 -- 172.21.15.156:0/2638231952 shutdown_connections 2023-09-30T22:19:15.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.509+0000 7f8f61e64700 1 -- 172.21.15.156:0/2638231952 wait complete. 2023-09-30T22:19:15.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:15.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.547+0000 7f11d6ffd700 1 -- 172.21.15.156:0/4026456971 >> v1:172.21.15.156:6816/126965 conn(0x7f11c402f510 legacy=0x7f11c40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:15.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.548+0000 7f11dd7ca700 1 -- 172.21.15.156:0/4026456971 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f11b8005860 con 0x7f11d8130eb0 2023-09-30T22:19:15.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.548+0000 7f11bf7fe700 1 -- 172.21.15.156:0/4026456971 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f11d0019020 con 0x7f11d8130eb0 2023-09-30T22:19:15.548 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:15.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.550+0000 7fa8409d8700 1 -- 172.21.15.156:0/570478578 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa83c11c860 con 0x7fa83c135f20 2023-09-30T22:19:15.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.550+0000 7f11dd7ca700 1 -- 172.21.15.156:0/4026456971 >> v1:172.21.15.156:6816/126965 conn(0x7f11c402f510 legacy=0x7f11c40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:15.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.550+0000 7f11dd7ca700 1 -- 172.21.15.156:0/4026456971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11d8130eb0 msgr2=0x7f11d81c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:15.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.550+0000 7f11dd7ca700 1 --2- 172.21.15.156:0/4026456971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11d8130eb0 0x7f11d81c83d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f11d000be20 tx=0x7f11d0009ed0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.550+0000 7fa82affd700 1 -- 172.21.15.156:0/570478578 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa83401a070 con 0x7fa83c135f20 2023-09-30T22:19:15.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.550+0000 7f11dd7ca700 1 -- 172.21.15.156:0/4026456971 shutdown_connections 2023-09-30T22:19:15.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.550+0000 7f11dd7ca700 1 --2- 172.21.15.156:0/4026456971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11d8130eb0 0x7f11d81c83d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.550+0000 7f11dd7ca700 1 --2- 172.21.15.156:0/4026456971 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f11d809d860 0x7f11d8123340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.550+0000 7f11dd7ca700 1 --2- 172.21.15.156:0/4026456971 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f11d809e170 0x7f11d8123880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.550+0000 7f11dd7ca700 1 -- 172.21.15.156:0/4026456971 >> 172.21.15.156:0/4026456971 conn(0x7f11d8099c40 msgr2=0x7f11d8070fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:15.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.550+0000 7f11dd7ca700 1 -- 172.21.15.156:0/4026456971 shutdown_connections 2023-09-30T22:19:15.552 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:15.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.550+0000 7f11dd7ca700 1 -- 172.21.15.156:0/4026456971 wait complete. 2023-09-30T22:19:15.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.552+0000 7fa8409d8700 1 -- 172.21.15.156:0/570478578 >> v1:172.21.15.156:6816/126965 conn(0x7fa81c02f510 legacy=0x7fa81c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:15.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.552+0000 7fa8409d8700 1 -- 172.21.15.156:0/570478578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa83c135f20 msgr2=0x7fa83c1cc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:15.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.552+0000 7fa8409d8700 1 --2- 172.21.15.156:0/570478578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa83c135f20 0x7fa83c1cc570 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa83400cdf0 tx=0x7fa83400ce20 comp rx=0 tx=0).stop 2023-09-30T22:19:15.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.552+0000 7fa8409d8700 1 -- 172.21.15.156:0/570478578 shutdown_connections 2023-09-30T22:19:15.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.552+0000 7fa8409d8700 1 --2- 172.21.15.156:0/570478578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa83c135f20 0x7fa83c1cc570 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.552+0000 7fa8409d8700 1 --2- 172.21.15.156:0/570478578 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa83c09d860 0x7fa83c119e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.552+0000 7fa8409d8700 1 --2- 172.21.15.156:0/570478578 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa83c09e340 0x7fa83c11a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:15.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.552+0000 7fa8409d8700 1 -- 172.21.15.156:0/570478578 >> 172.21.15.156:0/570478578 conn(0x7fa83c099c40 msgr2=0x7fa83c132a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:15.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.552+0000 7fa8409d8700 1 -- 172.21.15.156:0/570478578 shutdown_connections 2023-09-30T22:19:15.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:15.552+0000 7fa8409d8700 1 -- 172.21.15.156:0/570478578 wait complete. 2023-09-30T22:19:15.563 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:15.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:16.361 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:16.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.484+0000 7fe9fcc92700 1 Processor -- start 2023-09-30T22:19:16.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.484+0000 7fe9fcc92700 1 -- start start 2023-09-30T22:19:16.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.485+0000 7fe9fcc92700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9f812e490 0x7fe9f812e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:16.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.485+0000 7fe9fcc92700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe9f809da10 0x7fe9f806a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:16.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.485+0000 7fe9fcc92700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9f806acb0 0x7fe9f806b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:16.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.485+0000 7fe9fcc92700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f812de50 con 0x7fe9f809da10 2023-09-30T22:19:16.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.485+0000 7fe9fcc92700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f809f6e0 con 0x7fe9f812e490 2023-09-30T22:19:16.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.485+0000 7fe9fcc92700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f809eb00 con 0x7fe9f806acb0 2023-09-30T22:19:16.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.485+0000 7fe9f5d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe9f809da10 0x7fe9f806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:16.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.485+0000 7fe9f6d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9f806acb0 0x7fe9f806b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:16.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.485+0000 7fe9f6d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9f806acb0 0x7fe9f806b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48352/0 (socket says 172.21.15.156:48352) 2023-09-30T22:19:16.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.485+0000 7fe9f5d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe9f809da10 0x7fe9f806a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40318/0 (socket says 172.21.15.156:40318) 2023-09-30T22:19:16.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.485+0000 7fe9f659c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9f812e490 0x7fe9f812e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:16.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.485+0000 7fe9f6d9d700 1 -- 172.21.15.156:0/935751572 learned_addr learned my addr 172.21.15.156:0/935751572 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:16.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.486+0000 7fe9f6d9d700 1 -- 172.21.15.156:0/935751572 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9f812e490 msgr2=0x7fe9f812e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:16.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.486+0000 7fe9f6d9d700 1 --2- 172.21.15.156:0/935751572 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9f812e490 0x7fe9f812e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.486+0000 7fe9f6d9d700 1 -- 172.21.15.156:0/935751572 >> v2:172.21.15.156:3300/0 conn(0x7fe9f809da10 msgr2=0x7fe9f806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:16.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.486+0000 7fe9f6d9d700 1 --2- 172.21.15.156:0/935751572 >> v2:172.21.15.156:3300/0 conn(0x7fe9f809da10 0x7fe9f806a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.486+0000 7fe9f6d9d700 1 -- 172.21.15.156:0/935751572 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f809e780 con 0x7fe9f806acb0 2023-09-30T22:19:16.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.486+0000 7fe9f5d9b700 1 --2- 172.21.15.156:0/935751572 >> v2:172.21.15.156:3300/0 conn(0x7fe9f809da10 0x7fe9f806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:16.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.486+0000 7fe9f6d9d700 1 --2- 172.21.15.156:0/935751572 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9f806acb0 0x7fe9f806b150 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0009e50 tx=0x7fe9f000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89a9a281993396af server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:16.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.486+0000 7fe9f559a700 1 -- 172.21.15.156:0/935751572 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f000e070 con 0x7fe9f806acb0 2023-09-30T22:19:16.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.486+0000 7fe9f559a700 1 -- 172.21.15.156:0/935751572 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f000b8b0 con 0x7fe9f806acb0 2023-09-30T22:19:16.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.486+0000 7fe9f559a700 1 -- 172.21.15.156:0/935751572 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f000bc60 con 0x7fe9f806acb0 2023-09-30T22:19:16.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.486+0000 7fe9fcc92700 1 -- 172.21.15.156:0/935751572 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9f806acb0 msgr2=0x7fe9f806b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:16.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.486+0000 7fe9fcc92700 1 --2- 172.21.15.156:0/935751572 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9f806acb0 0x7fe9f806b150 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0009e50 tx=0x7fe9f000b330 comp rx=0 tx=0).stop 2023-09-30T22:19:16.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.486+0000 7fe9fcc92700 1 -- 172.21.15.156:0/935751572 shutdown_connections 2023-09-30T22:19:16.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.486+0000 7fe9fcc92700 1 --2- 172.21.15.156:0/935751572 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9f806acb0 0x7fe9f806b150 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.486+0000 7fe9fcc92700 1 --2- 172.21.15.156:0/935751572 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9f812e490 0x7fe9f812e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.486+0000 7fe9fcc92700 1 --2- 172.21.15.156:0/935751572 >> v2:172.21.15.156:3300/0 conn(0x7fe9f809da10 0x7fe9f806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.486+0000 7fe9fcc92700 1 -- 172.21.15.156:0/935751572 >> 172.21.15.156:0/935751572 conn(0x7fe9f8099c40 msgr2=0x7fe9f80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:16.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.486+0000 7fe9fcc92700 1 -- 172.21.15.156:0/935751572 shutdown_connections 2023-09-30T22:19:16.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.487+0000 7fe9fcc92700 1 -- 172.21.15.156:0/935751572 wait complete. 2023-09-30T22:19:16.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.488+0000 7fe9fcc92700 1 Processor -- start 2023-09-30T22:19:16.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.488+0000 7fe9fcc92700 1 -- start start 2023-09-30T22:19:16.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.488+0000 7fe9fcc92700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9f806acb0 0x7fe9f8070a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:16.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.488+0000 7fe9fcc92700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9f809da10 0x7fe9f8070f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:16.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.488+0000 7fe9fcc92700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9f812e490 0x7fe9f8071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:16.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.488+0000 7fe9fcc92700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f811a820 con 0x7fe9f812e490 2023-09-30T22:19:16.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.488+0000 7fe9fcc92700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f81196d0 con 0x7fe9f806acb0 2023-09-30T22:19:16.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.488+0000 7fe9fcc92700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f812bab0 con 0x7fe9f809da10 2023-09-30T22:19:16.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.488+0000 7fe9f659c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9f806acb0 0x7fe9f8070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:16.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.488+0000 7fe9f659c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9f806acb0 0x7fe9f8070a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52798/0 (socket says 172.21.15.156:52798) 2023-09-30T22:19:16.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.488+0000 7fe9f5d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9f809da10 0x7fe9f8070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:16.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.488+0000 7fe9f659c700 1 -- 172.21.15.156:0/1831803741 learned_addr learned my addr 172.21.15.156:0/1831803741 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:16.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.488+0000 7fe9f6d9d700 1 --2- 172.21.15.156:0/1831803741 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9f812e490 0x7fe9f8071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:16.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.488+0000 7fe9f659c700 1 -- 172.21.15.156:0/1831803741 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9f809da10 msgr2=0x7fe9f8070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:16.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.488+0000 7fe9f659c700 1 --2- 172.21.15.156:0/1831803741 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9f809da10 0x7fe9f8070f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.488+0000 7fe9f659c700 1 -- 172.21.15.156:0/1831803741 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9f812e490 msgr2=0x7fe9f8071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:16.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.488+0000 7fe9f659c700 1 --2- 172.21.15.156:0/1831803741 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9f812e490 0x7fe9f8071490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.488+0000 7fe9f659c700 1 -- 172.21.15.156:0/1831803741 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e80094a0 con 0x7fe9f806acb0 2023-09-30T22:19:16.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.488+0000 7fe9f6d9d700 1 --2- 172.21.15.156:0/1831803741 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9f812e490 0x7fe9f8071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:16.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.489+0000 7fe9f659c700 1 --2- 172.21.15.156:0/1831803741 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9f806acb0 0x7fe9f8070a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec00e9e0 tx=0x7fe9ec00ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:16.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.489+0000 7fe9e6ffd700 1 -- 172.21.15.156:0/1831803741 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec009710 con 0x7fe9f806acb0 2023-09-30T22:19:16.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.489+0000 7fe9e6ffd700 1 -- 172.21.15.156:0/1831803741 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ec00ee80 con 0x7fe9f806acb0 2023-09-30T22:19:16.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.489+0000 7fe9fcc92700 1 -- 172.21.15.156:0/1831803741 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f0009b30 con 0x7fe9f806acb0 2023-09-30T22:19:16.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.489+0000 7fe9e6ffd700 1 -- 172.21.15.156:0/1831803741 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec00ca50 con 0x7fe9f806acb0 2023-09-30T22:19:16.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.489+0000 7fe9fcc92700 1 -- 172.21.15.156:0/1831803741 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f811ad20 con 0x7fe9f806acb0 2023-09-30T22:19:16.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.490+0000 7fe9fcc92700 1 -- 172.21.15.156:0/1831803741 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f811b850 con 0x7fe9f806acb0 2023-09-30T22:19:16.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.490+0000 7fe9e6ffd700 1 -- 172.21.15.156:0/1831803741 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe9ec00cbb0 con 0x7fe9f806acb0 2023-09-30T22:19:16.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.490+0000 7fe9f5d9b700 1 -- 172.21.15.156:0/1831803741 >> v1:172.21.15.156:6816/126965 conn(0x7fe9d802f510 legacy=0x7fe9d80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:16.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.490+0000 7fe9e6ffd700 1 -- 172.21.15.156:0/1831803741 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fe9ec040410 con 0x7fe9f806acb0 2023-09-30T22:19:16.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.494+0000 7fe9e6ffd700 1 -- 172.21.15.156:0/1831803741 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe9ec011350 con 0x7fe9f806acb0 2023-09-30T22:19:16.522 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:16.565 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:16.565 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:16.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.652+0000 7f7b82f53700 1 Processor -- start 2023-09-30T22:19:16.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.652+0000 7f7b82f53700 1 -- start start 2023-09-30T22:19:16.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.653+0000 7f7b82f53700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b7c09f350 0x7f7b7c136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:16.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.653+0000 7f7b82f53700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b7c137000 0x7f7b7c1393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:16.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.653+0000 7f7b82f53700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b7c09b6a0 con 0x7f7b7c09e870 2023-09-30T22:19:16.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.653+0000 7f7b82f53700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c09f720 con 0x7f7b7c137000 2023-09-30T22:19:16.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.653+0000 7f7b82f53700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c09ad60 con 0x7f7b7c09f350 2023-09-30T22:19:16.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.653+0000 7f7b814f0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b7c137000 0x7f7b7c1393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:16.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.653+0000 7f7b814f0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b7c137000 0x7f7b7c1393e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52808/0 (socket says 172.21.15.156:52808) 2023-09-30T22:19:16.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.653+0000 7f7b814f0700 1 -- 172.21.15.156:0/470606091 learned_addr learned my addr 172.21.15.156:0/470606091 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:16.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.653+0000 7f7b7bfff700 1 --2- 172.21.15.156:0/470606091 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b7c09f350 0x7f7b7c136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:16.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.653+0000 7f7b814f0700 1 -- 172.21.15.156:0/470606091 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b7c09f350 msgr2=0x7f7b7c136ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:16.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.653+0000 7f7b814f0700 1 --2- 172.21.15.156:0/470606091 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b7c09f350 0x7f7b7c136ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.653+0000 7f7b814f0700 1 -- 172.21.15.156:0/470606091 >> v1:172.21.15.156:6789/0 conn(0x7f7b7c09e870 legacy=0x7f7b7c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:16.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.653+0000 7f7b814f0700 1 -- 172.21.15.156:0/470606091 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7c0a0650 con 0x7f7b7c137000 2023-09-30T22:19:16.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.653+0000 7f7b814f0700 1 --2- 172.21.15.156:0/470606091 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b7c137000 0x7f7b7c1393e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7b74009e80 tx=0x7f7b7400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9bbc3e0c58717b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:16.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.654+0000 7f7b7b7fe700 1 -- 172.21.15.156:0/470606091 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7400e070 con 0x7f7b7c137000 2023-09-30T22:19:16.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.654+0000 7f7b7b7fe700 1 -- 172.21.15.156:0/470606091 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7400b9c0 con 0x7f7b7c137000 2023-09-30T22:19:16.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.654+0000 7f7b7b7fe700 1 -- 172.21.15.156:0/470606091 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7400bd70 con 0x7f7b7c137000 2023-09-30T22:19:16.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.654+0000 7f7b82f53700 1 -- 172.21.15.156:0/470606091 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b7c137000 msgr2=0x7f7b7c1393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:16.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.654+0000 7f7b82f53700 1 --2- 172.21.15.156:0/470606091 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b7c137000 0x7f7b7c1393e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7b74009e80 tx=0x7f7b7400b330 comp rx=0 tx=0).stop 2023-09-30T22:19:16.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.654+0000 7f7b82f53700 1 -- 172.21.15.156:0/470606091 shutdown_connections 2023-09-30T22:19:16.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.654+0000 7f7b82f53700 1 --2- 172.21.15.156:0/470606091 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b7c137000 0x7f7b7c1393e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.654+0000 7f7b82f53700 1 --2- 172.21.15.156:0/470606091 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b7c09f350 0x7f7b7c136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.654+0000 7f7b82f53700 1 -- 172.21.15.156:0/470606091 >> 172.21.15.156:0/470606091 conn(0x7f7b7c0a4150 msgr2=0x7f7b7c0a4550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:16.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.654+0000 7f7b82f53700 1 -- 172.21.15.156:0/470606091 shutdown_connections 2023-09-30T22:19:16.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.654+0000 7f7b82f53700 1 -- 172.21.15.156:0/470606091 wait complete. 2023-09-30T22:19:16.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.655+0000 7f7b82f53700 1 Processor -- start 2023-09-30T22:19:16.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.655+0000 7f7b82f53700 1 -- start start 2023-09-30T22:19:16.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.656+0000 7f7b82f53700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b7c09e870 0x7f7b7c1c6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:16.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.656+0000 7f7b82f53700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b7c09f350 0x7f7b7c1c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:16.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.656+0000 7f7b82f53700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b7c137000 0x7f7b7c11f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:16.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.656+0000 7f7b82f53700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c1233c0 con 0x7f7b7c137000 2023-09-30T22:19:16.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.656+0000 7f7b82f53700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c1bc180 con 0x7f7b7c09e870 2023-09-30T22:19:16.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.656+0000 7f7b82f53700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c122be0 con 0x7f7b7c09f350 2023-09-30T22:19:16.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.656+0000 7f7b80cef700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b7c09e870 0x7f7b7c1c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:16.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.656+0000 7f7b80cef700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b7c09e870 0x7f7b7c1c6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52816/0 (socket says 172.21.15.156:52816) 2023-09-30T22:19:16.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.656+0000 7f7b80cef700 1 -- 172.21.15.156:0/416893017 learned_addr learned my addr 172.21.15.156:0/416893017 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:16.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.656+0000 7f7b7bfff700 1 --2- 172.21.15.156:0/416893017 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b7c09f350 0x7f7b7c1c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:16.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.656+0000 7f7b814f0700 1 --2- 172.21.15.156:0/416893017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b7c137000 0x7f7b7c11f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:16.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.656+0000 7f7b80cef700 1 -- 172.21.15.156:0/416893017 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b7c09f350 msgr2=0x7f7b7c1c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:16.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.656+0000 7f7b80cef700 1 --2- 172.21.15.156:0/416893017 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b7c09f350 0x7f7b7c1c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.656+0000 7f7b80cef700 1 -- 172.21.15.156:0/416893017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b7c137000 msgr2=0x7f7b7c11f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:16.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.656+0000 7f7b80cef700 1 --2- 172.21.15.156:0/416893017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b7c137000 0x7f7b7c11f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.656+0000 7f7b80cef700 1 -- 172.21.15.156:0/416893017 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b74009b30 con 0x7f7b7c09e870 2023-09-30T22:19:16.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.657+0000 7f7b814f0700 1 --2- 172.21.15.156:0/416893017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b7c137000 0x7f7b7c11f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:16.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.657+0000 7f7b80cef700 1 --2- 172.21.15.156:0/416893017 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b7c09e870 0x7f7b7c1c6590 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000c4e0 tx=0x7f7b7000c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:16.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.657+0000 7f7b797fa700 1 -- 172.21.15.156:0/416893017 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b700052d0 con 0x7f7b7c09e870 2023-09-30T22:19:16.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.657+0000 7f7b82f53700 1 -- 172.21.15.156:0/416893017 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b7c09d820 con 0x7f7b7c09e870 2023-09-30T22:19:16.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.657+0000 7f7b797fa700 1 -- 172.21.15.156:0/416893017 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b70005430 con 0x7f7b7c09e870 2023-09-30T22:19:16.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.657+0000 7f7b797fa700 1 -- 172.21.15.156:0/416893017 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b700038c0 con 0x7f7b7c09e870 2023-09-30T22:19:16.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.657+0000 7f7b82f53700 1 -- 172.21.15.156:0/416893017 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b7c1c7010 con 0x7f7b7c09e870 2023-09-30T22:19:16.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.658+0000 7f7b797fa700 1 -- 172.21.15.156:0/416893017 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7b70003a20 con 0x7f7b7c09e870 2023-09-30T22:19:16.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.658+0000 7f7b82f53700 1 -- 172.21.15.156:0/416893017 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b7c04f2a0 con 0x7f7b7c09e870 2023-09-30T22:19:16.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.658+0000 7f7b7bfff700 1 -- 172.21.15.156:0/416893017 >> v1:172.21.15.156:6816/126965 conn(0x7f7b6002f510 legacy=0x7f7b600319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:16.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.658+0000 7f7b797fa700 1 -- 172.21.15.156:0/416893017 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f7b7003efb0 con 0x7f7b7c09e870 2023-09-30T22:19:16.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.663+0000 7f7b797fa700 1 -- 172.21.15.156:0/416893017 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7b70017030 con 0x7f7b7c09e870 2023-09-30T22:19:16.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.691+0000 7fe9f5d9b700 1 -- 172.21.15.156:0/1831803741 >> v1:172.21.15.156:6816/126965 conn(0x7fe9d802f510 legacy=0x7fe9d80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:16.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.695+0000 7f05f6547700 1 Processor -- start 2023-09-30T22:19:16.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.695+0000 7f05f6547700 1 -- start start 2023-09-30T22:19:16.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.695+0000 7f05f6547700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05f0133b80 0x7f05f0133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:16.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.696+0000 7f05f6547700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05f00a0ff0 0x7f05f013b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:16.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.696+0000 7f05f6547700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05f009aa00 con 0x7f05f0099a60 2023-09-30T22:19:16.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.696+0000 7f05f6547700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f009a080 con 0x7f05f00a0ff0 2023-09-30T22:19:16.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.696+0000 7f05f6547700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05f0133750 con 0x7f05f0133b80 2023-09-30T22:19:16.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.696+0000 7f05ef7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f05f0099a60 0x7f05f00a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:36278/0 (socket says 172.21.15.156:36278) 2023-09-30T22:19:16.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.696+0000 7f05ef7fe700 1 -- 172.21.15.156:0/3594685117 learned_addr learned my addr 172.21.15.156:0/3594685117 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:16.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.696+0000 7f05f4ae4700 1 --2- 172.21.15.156:0/3594685117 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05f00a0ff0 0x7f05f013b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:16.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.696+0000 7f05effff700 1 --2- 172.21.15.156:0/3594685117 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05f0133b80 0x7f05f0133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:16.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.696+0000 7f05eeffd700 1 -- 172.21.15.156:0/3594685117 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595608546 0 0) 0x7f05f009aa00 con 0x7f05f0099a60 2023-09-30T22:19:16.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.696+0000 7f05f4ae4700 1 -- 172.21.15.156:0/3594685117 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05f0133b80 msgr2=0x7f05f0133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:16.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.696+0000 7f05f4ae4700 1 --2- 172.21.15.156:0/3594685117 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05f0133b80 0x7f05f0133f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.696+0000 7f05f4ae4700 1 -- 172.21.15.156:0/3594685117 >> v1:172.21.15.156:6789/0 conn(0x7f05f0099a60 legacy=0x7f05f00a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:16.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.696+0000 7f05f4ae4700 1 -- 172.21.15.156:0/3594685117 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f009a760 con 0x7f05f00a0ff0 2023-09-30T22:19:16.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.696+0000 7f05f4ae4700 1 --2- 172.21.15.156:0/3594685117 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05f00a0ff0 0x7f05f013b910 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009dc0 tx=0x7f05e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4aefc32d5a30071e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:16.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.696+0000 7f05eeffd700 1 -- 172.21.15.156:0/3594685117 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e800e070 con 0x7f05f00a0ff0 2023-09-30T22:19:16.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.697+0000 7f05eeffd700 1 -- 172.21.15.156:0/3594685117 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e800bb20 con 0x7f05f00a0ff0 2023-09-30T22:19:16.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.697+0000 7f05eeffd700 1 -- 172.21.15.156:0/3594685117 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e8012430 con 0x7f05f00a0ff0 2023-09-30T22:19:16.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.697+0000 7f05f6547700 1 -- 172.21.15.156:0/3594685117 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05f00a0ff0 msgr2=0x7f05f013b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:16.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.697+0000 7f05f6547700 1 --2- 172.21.15.156:0/3594685117 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05f00a0ff0 0x7f05f013b910 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009dc0 tx=0x7f05e800b330 comp rx=0 tx=0).stop 2023-09-30T22:19:16.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.697+0000 7f05f6547700 1 -- 172.21.15.156:0/3594685117 shutdown_connections 2023-09-30T22:19:16.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.697+0000 7f05f6547700 1 --2- 172.21.15.156:0/3594685117 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05f00a0ff0 0x7f05f013b910 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.697+0000 7f05f6547700 1 --2- 172.21.15.156:0/3594685117 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05f0133b80 0x7f05f0133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.697+0000 7f05f6547700 1 -- 172.21.15.156:0/3594685117 >> 172.21.15.156:0/3594685117 conn(0x7f05f00a2980 msgr2=0x7f05f00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:16.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.697+0000 7f05f6547700 1 -- 172.21.15.156:0/3594685117 shutdown_connections 2023-09-30T22:19:16.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.697+0000 7f05f6547700 1 -- 172.21.15.156:0/3594685117 wait complete. 2023-09-30T22:19:16.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.698+0000 7f05f6547700 1 Processor -- start 2023-09-30T22:19:16.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.698+0000 7f05f6547700 1 -- start start 2023-09-30T22:19:16.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.699+0000 7f05f6547700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05f0099a60 0x7f05f011a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:16.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.699+0000 7f05f6547700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05f00a0ff0 0x7f05f011ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:16.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.699+0000 7f05f6547700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05f0133b80 0x7f05f011b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:16.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.699+0000 7f05f6547700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f011c330 con 0x7f05f0133b80 2023-09-30T22:19:16.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.699+0000 7f05f6547700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f009a2c0 con 0x7f05f0099a60 2023-09-30T22:19:16.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.699+0000 7f05f6547700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05f011df60 con 0x7f05f00a0ff0 2023-09-30T22:19:16.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.699+0000 7f05ef7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05f00a0ff0 0x7f05f011ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:16.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.699+0000 7f05ef7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05f00a0ff0 0x7f05f011ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48380/0 (socket says 172.21.15.156:48380) 2023-09-30T22:19:16.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.699+0000 7f05ef7fe700 1 -- 172.21.15.156:0/2489409725 learned_addr learned my addr 172.21.15.156:0/2489409725 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:16.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.699+0000 7f043850a700 1 Processor -- start 2023-09-30T22:19:16.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.699+0000 7f05effff700 1 --2- 172.21.15.156:0/2489409725 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05f0099a60 0x7f05f011a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:16.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.699+0000 7f043850a700 1 -- start start 2023-09-30T22:19:16.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.699+0000 7f05ef7fe700 1 -- 172.21.15.156:0/2489409725 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05f0099a60 msgr2=0x7f05f011a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:16.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.699+0000 7f05ef7fe700 1 --2- 172.21.15.156:0/2489409725 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05f0099a60 0x7f05f011a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.699+0000 7f05ef7fe700 1 -- 172.21.15.156:0/2489409725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05f0133b80 msgr2=0x7f05f011b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:16.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.699+0000 7f05ef7fe700 1 --2- 172.21.15.156:0/2489409725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05f0133b80 0x7f05f011b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.699+0000 7f05ef7fe700 1 -- 172.21.15.156:0/2489409725 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e8009a70 con 0x7f05f00a0ff0 2023-09-30T22:19:16.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.700+0000 7f05ef7fe700 1 --2- 172.21.15.156:0/2489409725 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05f00a0ff0 0x7f05f011ad30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f05e400c480 tx=0x7f05e400c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:16.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.700+0000 7f05ecff9700 1 -- 172.21.15.156:0/2489409725 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e4004c80 con 0x7f05f00a0ff0 2023-09-30T22:19:16.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.700+0000 7f05ecff9700 1 -- 172.21.15.156:0/2489409725 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e4004de0 con 0x7f05f00a0ff0 2023-09-30T22:19:16.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.700+0000 7f043850a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0430138040 0x7f0430138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:16.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.700+0000 7f043850a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f04300a08e0 0x7f04300a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:16.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.700+0000 7f043850a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04300a1230 0x7f043013ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:16.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.700+0000 7f043850a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04300a2100 con 0x7f04300a08e0 2023-09-30T22:19:16.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.700+0000 7f043850a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0430138950 con 0x7f04300a1230 2023-09-30T22:19:16.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.700+0000 7f043850a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04301379e0 con 0x7f0430138040 2023-09-30T22:19:16.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.700+0000 7f0436aa7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04300a1230 0x7f043013ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:16.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.700+0000 7f0435aa5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f04300a08e0 0x7f04300a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:16.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.700+0000 7f0436aa7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04300a1230 0x7f043013ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52844/0 (socket says 172.21.15.156:52844) 2023-09-30T22:19:16.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.700+0000 7f0436aa7700 1 -- 172.21.15.156:0/3783813792 learned_addr learned my addr 172.21.15.156:0/3783813792 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:16.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.700+0000 7f05ecff9700 1 -- 172.21.15.156:0/2489409725 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e40072d0 con 0x7f05f00a0ff0 2023-09-30T22:19:16.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.700+0000 7f05f6547700 1 -- 172.21.15.156:0/2489409725 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f0130a20 con 0x7f05f00a0ff0 2023-09-30T22:19:16.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.700+0000 7f05f6547700 1 -- 172.21.15.156:0/2489409725 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f011d9d0 con 0x7f05f00a0ff0 2023-09-30T22:19:16.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.701+0000 7f0435aa5700 1 -- 172.21.15.156:0/3783813792 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0430138040 msgr2=0x7f0430138410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:19:16.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.701+0000 7f0435aa5700 1 --2- 172.21.15.156:0/3783813792 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0430138040 0x7f0430138410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.701+0000 7f0435aa5700 1 -- 172.21.15.156:0/3783813792 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04300a1230 msgr2=0x7f043013ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:16.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.701+0000 7f0435aa5700 1 --2- 172.21.15.156:0/3783813792 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04300a1230 0x7f043013ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.701+0000 7f0435aa5700 1 -- 172.21.15.156:0/3783813792 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043009b9b0 con 0x7f04300a08e0 2023-09-30T22:19:16.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.701+0000 7f0435aa5700 1 --2- 172.21.15.156:0/3783813792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04300a08e0 0x7f04300a0cf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0420009870 tx=0x7f0420009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=addebb713c4fc133 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:16.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.701+0000 7f04352a4700 1 -- 172.21.15.156:0/3783813792 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0420011830 con 0x7f04300a08e0 2023-09-30T22:19:16.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.701+0000 7f04352a4700 1 -- 172.21.15.156:0/3783813792 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0420011990 con 0x7f04300a08e0 2023-09-30T22:19:16.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.701+0000 7f04352a4700 1 -- 172.21.15.156:0/3783813792 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0420011d20 con 0x7f04300a08e0 2023-09-30T22:19:16.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.701+0000 7f05ecff9700 1 -- 172.21.15.156:0/2489409725 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f05e4007430 con 0x7f05f00a0ff0 2023-09-30T22:19:16.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.701+0000 7f05f6547700 1 -- 172.21.15.156:0/2489409725 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f009e9b0 con 0x7f05f00a0ff0 2023-09-30T22:19:16.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.702+0000 7f05effff700 1 -- 172.21.15.156:0/2489409725 >> v1:172.21.15.156:6816/126965 conn(0x7f05dc02f510 legacy=0x7f05dc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:16.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.702+0000 7f05ecff9700 1 -- 172.21.15.156:0/2489409725 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f05e403f980 con 0x7f05f00a0ff0 2023-09-30T22:19:16.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.702+0000 7f043850a700 1 -- 172.21.15.156:0/3783813792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04300a08e0 msgr2=0x7f04300a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:16.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.702+0000 7f043850a700 1 --2- 172.21.15.156:0/3783813792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04300a08e0 0x7f04300a0cf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0420009870 tx=0x7f0420009b80 comp rx=0 tx=0).stop 2023-09-30T22:19:16.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.705+0000 7f043850a700 1 -- 172.21.15.156:0/3783813792 shutdown_connections 2023-09-30T22:19:16.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.705+0000 7f043850a700 1 --2- 172.21.15.156:0/3783813792 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04300a1230 0x7f043013ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.705+0000 7f043850a700 1 --2- 172.21.15.156:0/3783813792 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0430138040 0x7f0430138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.705+0000 7f043850a700 1 --2- 172.21.15.156:0/3783813792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04300a08e0 0x7f04300a0cf0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.705+0000 7f043850a700 1 -- 172.21.15.156:0/3783813792 >> 172.21.15.156:0/3783813792 conn(0x7f04300a2980 msgr2=0x7f04300a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:16.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.705+0000 7f043850a700 1 -- 172.21.15.156:0/3783813792 shutdown_connections 2023-09-30T22:19:16.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.705+0000 7f043850a700 1 -- 172.21.15.156:0/3783813792 wait complete. 2023-09-30T22:19:16.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.706+0000 7f043850a700 1 Processor -- start 2023-09-30T22:19:16.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.706+0000 7f043850a700 1 -- start start 2023-09-30T22:19:16.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.706+0000 7f05ecff9700 1 -- 172.21.15.156:0/2489409725 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f05e40076e0 con 0x7f05f00a0ff0 2023-09-30T22:19:16.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.707+0000 7f043850a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04300a08e0 0x7f0430126450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:16.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.707+0000 7f043850a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04300a1230 0x7f0430126990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:16.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.707+0000 7f043850a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0430138040 0x7f0430126ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:16.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.707+0000 7f043850a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0430137050 con 0x7f0430138040 2023-09-30T22:19:16.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.707+0000 7f043850a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04301297f0 con 0x7f04300a1230 2023-09-30T22:19:16.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.707+0000 7f043850a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04301373a0 con 0x7f04300a08e0 2023-09-30T22:19:16.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.707+0000 7f0435aa5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04300a1230 0x7f0430126990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:16.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.707+0000 7f0435aa5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04300a1230 0x7f0430126990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52854/0 (socket says 172.21.15.156:52854) 2023-09-30T22:19:16.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.707+0000 7f0435aa5700 1 -- 172.21.15.156:0/2450135361 learned_addr learned my addr 172.21.15.156:0/2450135361 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:16.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.707+0000 7f0436aa7700 1 --2- 172.21.15.156:0/2450135361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0430138040 0x7f0430126ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:16.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.708+0000 7f0435aa5700 1 -- 172.21.15.156:0/2450135361 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04300a08e0 msgr2=0x7f0430126450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:16.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.708+0000 7f04362a6700 1 --2- 172.21.15.156:0/2450135361 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04300a08e0 0x7f0430126450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:16.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.708+0000 7f0435aa5700 1 --2- 172.21.15.156:0/2450135361 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04300a08e0 0x7f0430126450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.708+0000 7f0435aa5700 1 -- 172.21.15.156:0/2450135361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0430138040 msgr2=0x7f0430126ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:16.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.708+0000 7f0435aa5700 1 --2- 172.21.15.156:0/2450135361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0430138040 0x7f0430126ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.708+0000 7f0435aa5700 1 -- 172.21.15.156:0/2450135361 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04200094a0 con 0x7f04300a1230 2023-09-30T22:19:16.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.708+0000 7f04362a6700 1 --2- 172.21.15.156:0/2450135361 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04300a08e0 0x7f0430126450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:19:16.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.708+0000 7f0435aa5700 1 --2- 172.21.15.156:0/2450135361 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04300a1230 0x7f0430126990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0420000c00 tx=0x7f0420004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:16.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.711+0000 7f0426ffd700 1 -- 172.21.15.156:0/2450135361 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04200036a0 con 0x7f04300a1230 2023-09-30T22:19:16.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.711+0000 7f0426ffd700 1 -- 172.21.15.156:0/2450135361 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042001e070 con 0x7f04300a1230 2023-09-30T22:19:16.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.711+0000 7f0426ffd700 1 -- 172.21.15.156:0/2450135361 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0420003a60 con 0x7f04300a1230 2023-09-30T22:19:16.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.711+0000 7f043850a700 1 -- 172.21.15.156:0/2450135361 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04301299d0 con 0x7f04300a1230 2023-09-30T22:19:16.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.711+0000 7f043850a700 1 -- 172.21.15.156:0/2450135361 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f043012a700 con 0x7f04300a1230 2023-09-30T22:19:16.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.712+0000 7f043850a700 1 -- 172.21.15.156:0/2450135361 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f043004f2a0 con 0x7f04300a1230 2023-09-30T22:19:16.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.712+0000 7f0426ffd700 1 -- 172.21.15.156:0/2450135361 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0420003bc0 con 0x7f04300a1230 2023-09-30T22:19:16.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.712+0000 7fe9fcc92700 1 -- 172.21.15.156:0/1831803741 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe9f804f2a0 con 0x7fe9f806acb0 2023-09-30T22:19:16.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.712+0000 7f0426ffd700 1 -- 172.21.15.156:0/2450135361 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f0420020070 con 0x7f04300a1230 2023-09-30T22:19:16.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.712+0000 7f04362a6700 1 -- 172.21.15.156:0/2450135361 >> v1:172.21.15.156:6816/126965 conn(0x7f041402f560 legacy=0x7f0414031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:16.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.716+0000 7fe9e6ffd700 1 -- 172.21.15.156:0/1831803741 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe9ec024b00 con 0x7fe9f806acb0 2023-09-30T22:19:16.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.717+0000 7f0426ffd700 1 -- 172.21.15.156:0/2450135361 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f04200243e0 con 0x7f04300a1230 2023-09-30T22:19:16.717 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:16.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.719+0000 7fe9fcc92700 1 -- 172.21.15.156:0/1831803741 >> v1:172.21.15.156:6816/126965 conn(0x7fe9d802f510 legacy=0x7fe9d80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:16.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.719+0000 7fe9fcc92700 1 -- 172.21.15.156:0/1831803741 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9f806acb0 msgr2=0x7fe9f8070a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:16.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.719+0000 7fe9fcc92700 1 --2- 172.21.15.156:0/1831803741 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9f806acb0 0x7fe9f8070a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec00e9e0 tx=0x7fe9ec00ecf0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.719+0000 7fe9fcc92700 1 -- 172.21.15.156:0/1831803741 shutdown_connections 2023-09-30T22:19:16.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.719+0000 7fe9fcc92700 1 --2- 172.21.15.156:0/1831803741 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9f812e490 0x7fe9f8071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.719+0000 7fe9fcc92700 1 --2- 172.21.15.156:0/1831803741 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9f806acb0 0x7fe9f8070a10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.719+0000 7fe9fcc92700 1 --2- 172.21.15.156:0/1831803741 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9f809da10 0x7fe9f8070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.719+0000 7fe9fcc92700 1 -- 172.21.15.156:0/1831803741 >> 172.21.15.156:0/1831803741 conn(0x7fe9f8099c40 msgr2=0x7fe9f812cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:16.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.719+0000 7fe9fcc92700 1 -- 172.21.15.156:0/1831803741 shutdown_connections 2023-09-30T22:19:16.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.719+0000 7fe9fcc92700 1 -- 172.21.15.156:0/1831803741 wait complete. 2023-09-30T22:19:16.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:16.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.859+0000 7f7b7bfff700 1 -- 172.21.15.156:0/416893017 >> v1:172.21.15.156:6816/126965 conn(0x7f7b6002f510 legacy=0x7f7b600319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:16.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.887+0000 7f7b82f53700 1 -- 172.21.15.156:0/416893017 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7b7c072840 con 0x7f7b7c09e870 2023-09-30T22:19:16.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.888+0000 7f7b797fa700 1 -- 172.21.15.156:0/416893017 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7b70017070 con 0x7f7b7c09e870 2023-09-30T22:19:16.887 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:16.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.890+0000 7f7b82f53700 1 -- 172.21.15.156:0/416893017 >> v1:172.21.15.156:6816/126965 conn(0x7f7b6002f510 legacy=0x7f7b600319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:16.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.890+0000 7f7b82f53700 1 -- 172.21.15.156:0/416893017 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b7c09e870 msgr2=0x7f7b7c1c6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:16.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.890+0000 7f7b82f53700 1 --2- 172.21.15.156:0/416893017 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b7c09e870 0x7f7b7c1c6590 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000c4e0 tx=0x7f7b7000c7f0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.890+0000 7f7b82f53700 1 -- 172.21.15.156:0/416893017 shutdown_connections 2023-09-30T22:19:16.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.890+0000 7f7b82f53700 1 --2- 172.21.15.156:0/416893017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b7c137000 0x7f7b7c11f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.890+0000 7f7b82f53700 1 --2- 172.21.15.156:0/416893017 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b7c09e870 0x7f7b7c1c6590 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.890+0000 7f7b82f53700 1 --2- 172.21.15.156:0/416893017 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b7c09f350 0x7f7b7c1c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.890+0000 7f7b82f53700 1 -- 172.21.15.156:0/416893017 >> 172.21.15.156:0/416893017 conn(0x7f7b7c0a4150 msgr2=0x7f7b7c135980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:16.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.890+0000 7f7b82f53700 1 -- 172.21.15.156:0/416893017 shutdown_connections 2023-09-30T22:19:16.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.890+0000 7f7b82f53700 1 -- 172.21.15.156:0/416893017 wait complete. 2023-09-30T22:19:16.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:16.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.902+0000 7f05f6547700 1 -- 172.21.15.156:0/2489409725 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f05f004f2a0 con 0x7f05f00a0ff0 2023-09-30T22:19:16.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.903+0000 7f05effff700 1 -- 172.21.15.156:0/2489409725 >> v1:172.21.15.156:6816/126965 conn(0x7f05dc02f510 legacy=0x7f05dc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:16.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.903+0000 7f05ecff9700 1 -- 172.21.15.156:0/2489409725 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f05e401bb30 con 0x7f05f00a0ff0 2023-09-30T22:19:16.903 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:16.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.905+0000 7f05f6547700 1 -- 172.21.15.156:0/2489409725 >> v1:172.21.15.156:6816/126965 conn(0x7f05dc02f510 legacy=0x7f05dc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:16.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.905+0000 7f05f6547700 1 -- 172.21.15.156:0/2489409725 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05f00a0ff0 msgr2=0x7f05f011ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:16.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.905+0000 7f05f6547700 1 --2- 172.21.15.156:0/2489409725 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05f00a0ff0 0x7f05f011ad30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f05e400c480 tx=0x7f05e400c790 comp rx=0 tx=0).stop 2023-09-30T22:19:16.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.905+0000 7f05f6547700 1 -- 172.21.15.156:0/2489409725 shutdown_connections 2023-09-30T22:19:16.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.905+0000 7f05f6547700 1 --2- 172.21.15.156:0/2489409725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05f0133b80 0x7f05f011b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.905+0000 7f05f6547700 1 --2- 172.21.15.156:0/2489409725 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05f0099a60 0x7f05f011a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.905+0000 7f05f6547700 1 --2- 172.21.15.156:0/2489409725 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05f00a0ff0 0x7f05f011ad30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.905+0000 7f05f6547700 1 -- 172.21.15.156:0/2489409725 >> 172.21.15.156:0/2489409725 conn(0x7f05f00a2980 msgr2=0x7f05f012f720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:16.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.905+0000 7f05f6547700 1 -- 172.21.15.156:0/2489409725 shutdown_connections 2023-09-30T22:19:16.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.905+0000 7f05f6547700 1 -- 172.21.15.156:0/2489409725 wait complete. 2023-09-30T22:19:16.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.913+0000 7f04362a6700 1 -- 172.21.15.156:0/2450135361 >> v1:172.21.15.156:6816/126965 conn(0x7f041402f560 legacy=0x7f0414031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:16.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:16.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.942+0000 7f043850a700 1 -- 172.21.15.156:0/2450135361 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0430129fd0 con 0x7f04300a1230 2023-09-30T22:19:16.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.943+0000 7f0426ffd700 1 -- 172.21.15.156:0/2450135361 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0420015070 con 0x7f04300a1230 2023-09-30T22:19:16.942 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:16.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.945+0000 7f043850a700 1 -- 172.21.15.156:0/2450135361 >> v1:172.21.15.156:6816/126965 conn(0x7f041402f560 legacy=0x7f0414031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:16.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.945+0000 7f043850a700 1 -- 172.21.15.156:0/2450135361 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04300a1230 msgr2=0x7f0430126990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:16.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.945+0000 7f043850a700 1 --2- 172.21.15.156:0/2450135361 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04300a1230 0x7f0430126990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0420000c00 tx=0x7f0420004750 comp rx=0 tx=0).stop 2023-09-30T22:19:16.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.945+0000 7f043850a700 1 -- 172.21.15.156:0/2450135361 shutdown_connections 2023-09-30T22:19:16.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.945+0000 7f043850a700 1 --2- 172.21.15.156:0/2450135361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0430138040 0x7f0430126ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.945+0000 7f043850a700 1 --2- 172.21.15.156:0/2450135361 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04300a08e0 0x7f0430126450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.945+0000 7f043850a700 1 --2- 172.21.15.156:0/2450135361 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04300a1230 0x7f0430126990 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:16.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.945+0000 7f043850a700 1 -- 172.21.15.156:0/2450135361 >> 172.21.15.156:0/2450135361 conn(0x7f04300a2980 msgr2=0x7f0430071870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:16.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.945+0000 7f043850a700 1 -- 172.21.15.156:0/2450135361 shutdown_connections 2023-09-30T22:19:16.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:16.945+0000 7f043850a700 1 -- 172.21.15.156:0/2450135361 wait complete. 2023-09-30T22:19:16.957 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:17.733 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:17.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.869+0000 7f64470a8700 1 Processor -- start 2023-09-30T22:19:17.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.869+0000 7f64470a8700 1 -- start start 2023-09-30T22:19:17.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.869+0000 7f64470a8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6440133ad0 0x7f6440133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:17.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.869+0000 7f64470a8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f64401300a0 0x7f64401304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:17.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.869+0000 7f64470a8700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f644006b2d0 con 0x7f64401309f0 2023-09-30T22:19:17.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.869+0000 7f64470a8700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6440133610 con 0x7f64401300a0 2023-09-30T22:19:17.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.869+0000 7f64470a8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f644009a500 con 0x7f6440133ad0 2023-09-30T22:19:17.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.869+0000 7f6444e44700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6440133ad0 0x7f6440133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:17.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.869+0000 7f643ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f64401300a0 0x7f64401304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:17.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.869+0000 7f6444e44700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6440133ad0 0x7f6440133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48400/0 (socket says 172.21.15.156:48400) 2023-09-30T22:19:17.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.869+0000 7f643ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f64401300a0 0x7f64401304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40382/0 (socket says 172.21.15.156:40382) 2023-09-30T22:19:17.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.869+0000 7f6444e44700 1 -- 172.21.15.156:0/2067316926 learned_addr learned my addr 172.21.15.156:0/2067316926 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:17.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.869+0000 7f6445645700 1 --1- 172.21.15.156:0/2067316926 >> v1:172.21.15.156:6789/0 conn(0x7f64401309f0 0x7f644013a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:36284/0 (socket says 172.21.15.156:36284) 2023-09-30T22:19:17.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.870+0000 7f643ffff700 1 -- 172.21.15.156:0/2067316926 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6440133ad0 msgr2=0x7f6440133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:17.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.870+0000 7f643ffff700 1 --2- 172.21.15.156:0/2067316926 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6440133ad0 0x7f6440133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:17.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.870+0000 7f643ffff700 1 -- 172.21.15.156:0/2067316926 >> v1:172.21.15.156:6789/0 conn(0x7f64401309f0 legacy=0x7f644013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:17.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.870+0000 7f643ffff700 1 -- 172.21.15.156:0/2067316926 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64401338b0 con 0x7f64401300a0 2023-09-30T22:19:17.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.870+0000 7f6444e44700 1 --2- 172.21.15.156:0/2067316926 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6440133ad0 0x7f6440133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:17.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.870+0000 7f643ffff700 1 --2- 172.21.15.156:0/2067316926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64401300a0 0x7f64401304b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f642c009840 tx=0x7f642c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7dcc85a606731c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:17.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.870+0000 7f643f7fe700 1 -- 172.21.15.156:0/2067316926 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c011830 con 0x7f64401300a0 2023-09-30T22:19:17.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.870+0000 7f643f7fe700 1 -- 172.21.15.156:0/2067316926 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642c011990 con 0x7f64401300a0 2023-09-30T22:19:17.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.870+0000 7f643f7fe700 1 -- 172.21.15.156:0/2067316926 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c011d20 con 0x7f64401300a0 2023-09-30T22:19:17.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.871+0000 7f64470a8700 1 -- 172.21.15.156:0/2067316926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64401300a0 msgr2=0x7f64401304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:17.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.871+0000 7f64470a8700 1 --2- 172.21.15.156:0/2067316926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64401300a0 0x7f64401304b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f642c009840 tx=0x7f642c009b50 comp rx=0 tx=0).stop 2023-09-30T22:19:17.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.871+0000 7f64470a8700 1 -- 172.21.15.156:0/2067316926 shutdown_connections 2023-09-30T22:19:17.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.871+0000 7f64470a8700 1 --2- 172.21.15.156:0/2067316926 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6440133ad0 0x7f6440133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:17.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.871+0000 7f64470a8700 1 --2- 172.21.15.156:0/2067316926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64401300a0 0x7f64401304b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:17.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.871+0000 7f64470a8700 1 -- 172.21.15.156:0/2067316926 >> 172.21.15.156:0/2067316926 conn(0x7f6440099c40 msgr2=0x7f64400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:17.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.871+0000 7f64470a8700 1 -- 172.21.15.156:0/2067316926 shutdown_connections 2023-09-30T22:19:17.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.871+0000 7f64470a8700 1 -- 172.21.15.156:0/2067316926 wait complete. 2023-09-30T22:19:17.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.871+0000 7f64470a8700 1 Processor -- start 2023-09-30T22:19:17.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.872+0000 7f64470a8700 1 -- start start 2023-09-30T22:19:17.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.872+0000 7f64470a8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f64401300a0 0x7f644011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:17.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.872+0000 7f64470a8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64401309f0 0x7f644011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:17.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.872+0000 7f64470a8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6440133ad0 0x7f644011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:17.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.872+0000 7f64470a8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644011f7c0 con 0x7f64401309f0 2023-09-30T22:19:17.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.872+0000 7f64470a8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644012d910 con 0x7f6440133ad0 2023-09-30T22:19:17.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.872+0000 7f64470a8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f644011fa20 con 0x7f64401300a0 2023-09-30T22:19:17.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.872+0000 7f643ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64401309f0 0x7f644011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:17.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.872+0000 7f6444e44700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f64401300a0 0x7f644011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:17.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.872+0000 7f6444e44700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f64401300a0 0x7f644011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48402/0 (socket says 172.21.15.156:48402) 2023-09-30T22:19:17.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.872+0000 7f643ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64401309f0 0x7f644011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40390/0 (socket says 172.21.15.156:40390) 2023-09-30T22:19:17.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.872+0000 7f6444e44700 1 -- 172.21.15.156:0/1417851191 learned_addr learned my addr 172.21.15.156:0/1417851191 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:17.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.872+0000 7f6445645700 1 --2- 172.21.15.156:0/1417851191 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6440133ad0 0x7f644011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:17.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.873+0000 7f6444e44700 1 -- 172.21.15.156:0/1417851191 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6440133ad0 msgr2=0x7f644011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:17.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.873+0000 7f6444e44700 1 --2- 172.21.15.156:0/1417851191 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6440133ad0 0x7f644011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:17.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.873+0000 7f6444e44700 1 -- 172.21.15.156:0/1417851191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64401309f0 msgr2=0x7f644011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:17.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.873+0000 7f6444e44700 1 --2- 172.21.15.156:0/1417851191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64401309f0 0x7f644011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:17.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.873+0000 7f6444e44700 1 -- 172.21.15.156:0/1417851191 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6434009550 con 0x7f64401300a0 2023-09-30T22:19:17.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.873+0000 7f643ffff700 1 --2- 172.21.15.156:0/1417851191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64401309f0 0x7f644011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:17.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.873+0000 7f6444e44700 1 --2- 172.21.15.156:0/1417851191 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f64401300a0 0x7f644011da40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f643400ebe0 tx=0x7f643400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:17.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.873+0000 7f643d7fa700 1 -- 172.21.15.156:0/1417851191 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643400c850 con 0x7f64401300a0 2023-09-30T22:19:17.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.873+0000 7f643d7fa700 1 -- 172.21.15.156:0/1417851191 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643400c9b0 con 0x7f64401300a0 2023-09-30T22:19:17.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.873+0000 7f64470a8700 1 -- 172.21.15.156:0/1417851191 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f642c0094a0 con 0x7f64401300a0 2023-09-30T22:19:17.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.873+0000 7f643d7fa700 1 -- 172.21.15.156:0/1417851191 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643400cd40 con 0x7f64401300a0 2023-09-30T22:19:17.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.873+0000 7f64470a8700 1 -- 172.21.15.156:0/1417851191 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f644011fce0 con 0x7f64401300a0 2023-09-30T22:19:17.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.874+0000 7f643d7fa700 1 -- 172.21.15.156:0/1417851191 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6434013470 con 0x7f64401300a0 2023-09-30T22:19:17.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.874+0000 7f643ffff700 1 -- 172.21.15.156:0/1417851191 >> v1:172.21.15.156:6816/126965 conn(0x7f642402f540 legacy=0x7f64240319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:17.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.874+0000 7f643d7fa700 1 -- 172.21.15.156:0/1417851191 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f64340401c0 con 0x7f64401300a0 2023-09-30T22:19:17.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.874+0000 7f64470a8700 1 -- 172.21.15.156:0/1417851191 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f644004f2a0 con 0x7f64401300a0 2023-09-30T22:19:17.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:17.879+0000 7f643d7fa700 1 -- 172.21.15.156:0/1417851191 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f643401b3b0 con 0x7f64401300a0 2023-09-30T22:19:17.902 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:17.918 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:17.958 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:18.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.029+0000 7f133b663700 1 Processor -- start 2023-09-30T22:19:18.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.030+0000 7f133b663700 1 -- start start 2023-09-30T22:19:18.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.030+0000 7f133b663700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f133406a770 0x7f133406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:18.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.030+0000 7f133b663700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f133409dec0 0x7f133406b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:18.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.030+0000 7f133b663700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f133406b5c0 con 0x7f1334131a00 2023-09-30T22:19:18.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.030+0000 7f133b663700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133406e900 con 0x7f133406a770 2023-09-30T22:19:18.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.030+0000 7f133b663700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133409d180 con 0x7f133409dec0 2023-09-30T22:19:18.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.031+0000 7f13393ff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f133406a770 0x7f133406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:18.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.031+0000 7f1338bfe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f133409dec0 0x7f133406b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:18.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.031+0000 7f13393ff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f133406a770 0x7f133406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40400/0 (socket says 172.21.15.156:40400) 2023-09-30T22:19:18.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.031+0000 7f1338bfe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f133409dec0 0x7f133406b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52858/0 (socket says 172.21.15.156:52858) 2023-09-30T22:19:18.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.031+0000 7f13393ff700 1 -- 172.21.15.156:0/3056248852 learned_addr learned my addr 172.21.15.156:0/3056248852 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:18.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.031+0000 7f1338bfe700 1 -- 172.21.15.156:0/3056248852 >> v2:172.21.15.156:3300/0 conn(0x7f133406a770 msgr2=0x7f133406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:18.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.031+0000 7f1338bfe700 1 --2- 172.21.15.156:0/3056248852 >> v2:172.21.15.156:3300/0 conn(0x7f133406a770 0x7f133406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.031+0000 7f1338bfe700 1 -- 172.21.15.156:0/3056248852 >> v1:172.21.15.156:6789/0 conn(0x7f1334131a00 legacy=0x7f1334131e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:18.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.031+0000 7f1338bfe700 1 -- 172.21.15.156:0/3056248852 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133409e780 con 0x7f133409dec0 2023-09-30T22:19:18.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.031+0000 7f13393ff700 1 --2- 172.21.15.156:0/3056248852 >> v2:172.21.15.156:3300/0 conn(0x7f133406a770 0x7f133406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:18.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.031+0000 7f1338bfe700 1 --2- 172.21.15.156:0/3056248852 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f133409dec0 0x7f133406b080 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1324009840 tx=0x7f1324009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72c3b4da521fd4a0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:18.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.031+0000 7f132bfff700 1 -- 172.21.15.156:0/3056248852 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1324011830 con 0x7f133409dec0 2023-09-30T22:19:18.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.031+0000 7f132bfff700 1 -- 172.21.15.156:0/3056248852 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1324011990 con 0x7f133409dec0 2023-09-30T22:19:18.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.031+0000 7f132bfff700 1 -- 172.21.15.156:0/3056248852 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1324011d20 con 0x7f133409dec0 2023-09-30T22:19:18.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.032+0000 7f133b663700 1 -- 172.21.15.156:0/3056248852 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f133409dec0 msgr2=0x7f133406b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:18.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.032+0000 7f133b663700 1 --2- 172.21.15.156:0/3056248852 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f133409dec0 0x7f133406b080 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1324009840 tx=0x7f1324009b50 comp rx=0 tx=0).stop 2023-09-30T22:19:18.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.032+0000 7f133b663700 1 -- 172.21.15.156:0/3056248852 shutdown_connections 2023-09-30T22:19:18.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.032+0000 7f133b663700 1 --2- 172.21.15.156:0/3056248852 >> v2:172.21.15.156:3300/0 conn(0x7f133406a770 0x7f133406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.032+0000 7f133b663700 1 --2- 172.21.15.156:0/3056248852 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f133409dec0 0x7f133406b080 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.032+0000 7f133b663700 1 -- 172.21.15.156:0/3056248852 >> 172.21.15.156:0/3056248852 conn(0x7f1334099c40 msgr2=0x7f13340a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:18.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.032+0000 7f133b663700 1 -- 172.21.15.156:0/3056248852 shutdown_connections 2023-09-30T22:19:18.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.032+0000 7f133b663700 1 -- 172.21.15.156:0/3056248852 wait complete. 2023-09-30T22:19:18.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.033+0000 7f133b663700 1 Processor -- start 2023-09-30T22:19:18.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.033+0000 7f133b663700 1 -- start start 2023-09-30T22:19:18.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.034+0000 7f133b663700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f133406a770 0x7f1334119e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:18.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.034+0000 7f133b663700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f133409dec0 0x7f133411a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:18.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.034+0000 7f133b663700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1334131a00 0x7f133411a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:18.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.034+0000 7f133b663700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133411b2a0 con 0x7f1334131a00 2023-09-30T22:19:18.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.034+0000 7f133b663700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133411cca0 con 0x7f133406a770 2023-09-30T22:19:18.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.034+0000 7f133b663700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f133411baf0 con 0x7f133409dec0 2023-09-30T22:19:18.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.034+0000 7f1338bfe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f133409dec0 0x7f133411a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:18.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.034+0000 7f1338bfe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f133409dec0 0x7f133411a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48410/0 (socket says 172.21.15.156:48410) 2023-09-30T22:19:18.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.034+0000 7f1338bfe700 1 -- 172.21.15.156:0/1028253502 learned_addr learned my addr 172.21.15.156:0/1028253502 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:18.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.034+0000 7f1339c00700 1 --2- 172.21.15.156:0/1028253502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1334131a00 0x7f133411a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:18.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.034+0000 7f1338bfe700 1 -- 172.21.15.156:0/1028253502 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f133406a770 msgr2=0x7f1334119e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:18.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.034+0000 7f1338bfe700 1 --2- 172.21.15.156:0/1028253502 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f133406a770 0x7f1334119e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.034+0000 7f1338bfe700 1 -- 172.21.15.156:0/1028253502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1334131a00 msgr2=0x7f133411a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:18.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.034+0000 7f1338bfe700 1 --2- 172.21.15.156:0/1028253502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1334131a00 0x7f133411a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.034+0000 7f1338bfe700 1 -- 172.21.15.156:0/1028253502 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133000d9f0 con 0x7f133409dec0 2023-09-30T22:19:18.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.034+0000 7f1338bfe700 1 --2- 172.21.15.156:0/1028253502 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f133409dec0 0x7f133411a3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1324009fd0 tx=0x7f1324004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:18.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.035+0000 7f1329ffb700 1 -- 172.21.15.156:0/1028253502 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13240036a0 con 0x7f133409dec0 2023-09-30T22:19:18.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.035+0000 7f1329ffb700 1 -- 172.21.15.156:0/1028253502 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132401f070 con 0x7f133409dec0 2023-09-30T22:19:18.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.035+0000 7f133b663700 1 -- 172.21.15.156:0/1028253502 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13240094a0 con 0x7f133409dec0 2023-09-30T22:19:18.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.035+0000 7f1329ffb700 1 -- 172.21.15.156:0/1028253502 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1324003a60 con 0x7f133409dec0 2023-09-30T22:19:18.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.035+0000 7f133b663700 1 -- 172.21.15.156:0/1028253502 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1334071ce0 con 0x7f133409dec0 2023-09-30T22:19:18.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.036+0000 7f1329ffb700 1 -- 172.21.15.156:0/1028253502 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1324003bc0 con 0x7f133409dec0 2023-09-30T22:19:18.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.036+0000 7f1329ffb700 1 -- 172.21.15.156:0/1028253502 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f1324021070 con 0x7f133409dec0 2023-09-30T22:19:18.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.036+0000 7f13393ff700 1 -- 172.21.15.156:0/1028253502 >> v1:172.21.15.156:6816/126965 conn(0x7f131802f510 legacy=0x7f13180319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:18.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.036+0000 7f133b663700 1 -- 172.21.15.156:0/1028253502 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133404f2a0 con 0x7f133409dec0 2023-09-30T22:19:18.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.041+0000 7f1329ffb700 1 -- 172.21.15.156:0/1028253502 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1324010790 con 0x7f133409dec0 2023-09-30T22:19:18.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.075+0000 7f643ffff700 1 -- 172.21.15.156:0/1417851191 >> v1:172.21.15.156:6816/126965 conn(0x7f642402f540 legacy=0x7f64240319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:18.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.077+0000 7f64470a8700 1 -- 172.21.15.156:0/1417851191 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f644006c3b0 con 0x7f64401300a0 2023-09-30T22:19:18.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.077+0000 7f643d7fa700 1 -- 172.21.15.156:0/1417851191 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6434017030 con 0x7f64401300a0 2023-09-30T22:19:18.077 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:18.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.080+0000 7f64470a8700 1 -- 172.21.15.156:0/1417851191 >> v1:172.21.15.156:6816/126965 conn(0x7f642402f540 legacy=0x7f64240319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:18.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.080+0000 7f64470a8700 1 -- 172.21.15.156:0/1417851191 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f64401300a0 msgr2=0x7f644011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:18.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.080+0000 7f64470a8700 1 --2- 172.21.15.156:0/1417851191 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f64401300a0 0x7f644011da40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f643400ebe0 tx=0x7f643400eef0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.080+0000 7f64470a8700 1 -- 172.21.15.156:0/1417851191 shutdown_connections 2023-09-30T22:19:18.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.080+0000 7f64470a8700 1 --2- 172.21.15.156:0/1417851191 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6440133ad0 0x7f644011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.080+0000 7f64470a8700 1 --2- 172.21.15.156:0/1417851191 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f64401300a0 0x7f644011da40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.080+0000 7f64470a8700 1 --2- 172.21.15.156:0/1417851191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64401309f0 0x7f644011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.080+0000 7f64470a8700 1 -- 172.21.15.156:0/1417851191 >> 172.21.15.156:0/1417851191 conn(0x7f6440099c40 msgr2=0x7f6440132050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:18.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.080+0000 7f64470a8700 1 -- 172.21.15.156:0/1417851191 shutdown_connections 2023-09-30T22:19:18.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.080+0000 7f64470a8700 1 -- 172.21.15.156:0/1417851191 wait complete. 2023-09-30T22:19:18.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.091+0000 7f350a22b700 1 Processor -- start 2023-09-30T22:19:18.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.091+0000 7f350a22b700 1 -- start start 2023-09-30T22:19:18.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.091+0000 7f350a22b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350409e340 0x7f35041359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:18.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.091+0000 7f350a22b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3504135f20 0x7f3504138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:18.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.091+0000 7f350a22b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f350409aaa0 con 0x7f350409d860 2023-09-30T22:19:18.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.091+0000 7f350a22b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350409e730 con 0x7f350409e340 2023-09-30T22:19:18.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.091+0000 7f350a22b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f350409f870 con 0x7f3504135f20 2023-09-30T22:19:18.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.091+0000 7f3502ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350409e340 0x7f35041359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:18.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.091+0000 7f3502ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350409e340 0x7f35041359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52878/0 (socket says 172.21.15.156:52878) 2023-09-30T22:19:18.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.091+0000 7f35037fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f350409d860 0x7f350409dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:36300/0 (socket says 172.21.15.156:36300) 2023-09-30T22:19:18.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.091+0000 7f3502ffd700 1 -- 172.21.15.156:0/4119919547 learned_addr learned my addr 172.21.15.156:0/4119919547 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:18.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.091+0000 7f3503fff700 1 --2- 172.21.15.156:0/4119919547 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3504135f20 0x7f3504138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:18.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.092+0000 7f3502ffd700 1 -- 172.21.15.156:0/4119919547 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3504135f20 msgr2=0x7f3504138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:18.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.092+0000 7f3502ffd700 1 --2- 172.21.15.156:0/4119919547 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3504135f20 0x7f3504138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.092+0000 7f3502ffd700 1 -- 172.21.15.156:0/4119919547 >> v1:172.21.15.156:6789/0 conn(0x7f350409d860 legacy=0x7f350409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:18.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.092+0000 7f3502ffd700 1 -- 172.21.15.156:0/4119919547 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350409b360 con 0x7f350409e340 2023-09-30T22:19:18.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.092+0000 7f3502ffd700 1 --2- 172.21.15.156:0/4119919547 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350409e340 0x7f35041359e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009920 tx=0x7f34f8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1835afd1787d618b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:18.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.092+0000 7f35027fc700 1 -- 172.21.15.156:0/4119919547 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f800ba60 con 0x7f350409e340 2023-09-30T22:19:18.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.092+0000 7f35027fc700 1 -- 172.21.15.156:0/4119919547 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f800bbc0 con 0x7f350409e340 2023-09-30T22:19:18.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.092+0000 7f35027fc700 1 -- 172.21.15.156:0/4119919547 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f8009e70 con 0x7f350409e340 2023-09-30T22:19:18.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.093+0000 7f350a22b700 1 -- 172.21.15.156:0/4119919547 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350409e340 msgr2=0x7f35041359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:18.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.093+0000 7f350a22b700 1 --2- 172.21.15.156:0/4119919547 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350409e340 0x7f35041359e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009920 tx=0x7f34f8009c30 comp rx=0 tx=0).stop 2023-09-30T22:19:18.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.093+0000 7f350a22b700 1 -- 172.21.15.156:0/4119919547 shutdown_connections 2023-09-30T22:19:18.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.093+0000 7f350a22b700 1 --2- 172.21.15.156:0/4119919547 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3504135f20 0x7f3504138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.093+0000 7f350a22b700 1 --2- 172.21.15.156:0/4119919547 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350409e340 0x7f35041359e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.093+0000 7f350a22b700 1 -- 172.21.15.156:0/4119919547 >> 172.21.15.156:0/4119919547 conn(0x7f3504099c40 msgr2=0x7f35040a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:18.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.093+0000 7f350a22b700 1 -- 172.21.15.156:0/4119919547 shutdown_connections 2023-09-30T22:19:18.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.093+0000 7f350a22b700 1 -- 172.21.15.156:0/4119919547 wait complete. 2023-09-30T22:19:18.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.094+0000 7f350a22b700 1 Processor -- start 2023-09-30T22:19:18.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.094+0000 7f350a22b700 1 -- start start 2023-09-30T22:19:18.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.095+0000 7f350a22b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350409d860 0x7f350411b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:18.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.095+0000 7f350a22b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f350409e340 0x7f350411bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:18.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.095+0000 7f350a22b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3504135f20 0x7f350411c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:18.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.095+0000 7f350a22b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350411e9b0 con 0x7f350409e340 2023-09-30T22:19:18.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.095+0000 7f350a22b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350411da70 con 0x7f350409d860 2023-09-30T22:19:18.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.095+0000 7f350a22b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f350409c8b0 con 0x7f3504135f20 2023-09-30T22:19:18.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.095+0000 7f3502ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f350409e340 0x7f350411bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:18.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.095+0000 7f3502ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f350409e340 0x7f350411bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40420/0 (socket says 172.21.15.156:40420) 2023-09-30T22:19:18.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.095+0000 7f3502ffd700 1 -- 172.21.15.156:0/847118976 learned_addr learned my addr 172.21.15.156:0/847118976 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:18.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.095+0000 7f35037fe700 1 --2- 172.21.15.156:0/847118976 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350409d860 0x7f350411b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:18.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.095+0000 7f3503fff700 1 --2- 172.21.15.156:0/847118976 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3504135f20 0x7f350411c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:18.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.096+0000 7f3502ffd700 1 -- 172.21.15.156:0/847118976 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3504135f20 msgr2=0x7f350411c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:18.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.096+0000 7f3502ffd700 1 --2- 172.21.15.156:0/847118976 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3504135f20 0x7f350411c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.096+0000 7f3502ffd700 1 -- 172.21.15.156:0/847118976 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350409d860 msgr2=0x7f350411b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:18.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.096+0000 7f3502ffd700 1 --2- 172.21.15.156:0/847118976 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350409d860 0x7f350411b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.096+0000 7f3502ffd700 1 -- 172.21.15.156:0/847118976 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f8009550 con 0x7f350409e340 2023-09-30T22:19:18.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.096+0000 7f3502ffd700 1 --2- 172.21.15.156:0/847118976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f350409e340 0x7f350411bc20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f34f8006d30 tx=0x7f34f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:18.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.096+0000 7f34ebfff700 1 -- 172.21.15.156:0/847118976 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f801a650 con 0x7f350409e340 2023-09-30T22:19:18.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.096+0000 7f350a22b700 1 -- 172.21.15.156:0/847118976 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35040a2980 con 0x7f350409e340 2023-09-30T22:19:18.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.096+0000 7f34ebfff700 1 -- 172.21.15.156:0/847118976 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f801f070 con 0x7f350409e340 2023-09-30T22:19:18.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.096+0000 7f34ebfff700 1 -- 172.21.15.156:0/847118976 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f801aa10 con 0x7f350409e340 2023-09-30T22:19:18.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.096+0000 7f350a22b700 1 -- 172.21.15.156:0/847118976 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f350411e4a0 con 0x7f350409e340 2023-09-30T22:19:18.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.097+0000 7f34ebfff700 1 -- 172.21.15.156:0/847118976 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f34f8021030 con 0x7f350409e340 2023-09-30T22:19:18.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.097+0000 7f350a22b700 1 -- 172.21.15.156:0/847118976 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35040717c0 con 0x7f350409e340 2023-09-30T22:19:18.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.097+0000 7f35037fe700 1 -- 172.21.15.156:0/847118976 >> v1:172.21.15.156:6816/126965 conn(0x7f34f002f510 legacy=0x7f34f00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:18.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.097+0000 7f34ebfff700 1 -- 172.21.15.156:0/847118976 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f34f8040d50 con 0x7f350409e340 2023-09-30T22:19:18.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:18.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.102+0000 7f34ebfff700 1 -- 172.21.15.156:0/847118976 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f34f8045070 con 0x7f350409e340 2023-09-30T22:19:18.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.120+0000 7fc75bac8700 1 Processor -- start 2023-09-30T22:19:18.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.120+0000 7fc75bac8700 1 -- start start 2023-09-30T22:19:18.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.120+0000 7fc75bac8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc75409f350 0x7fc754136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:18.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.120+0000 7fc75bac8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc754137000 0x7fc7541393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:18.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.120+0000 7fc75bac8700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75409f750 con 0x7fc75409e870 2023-09-30T22:19:18.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.121+0000 7fc75bac8700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc75409b6a0 con 0x7fc75409f350 2023-09-30T22:19:18.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.121+0000 7fc75bac8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc75409ad60 con 0x7fc754137000 2023-09-30T22:19:18.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.121+0000 7fc75a065700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc754137000 0x7fc7541393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:18.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.121+0000 7fc759063700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc75409f350 0x7fc754136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:18.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.121+0000 7fc759864700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc75409e870 0x7fc75409ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:36306/0 (socket says 172.21.15.156:36306) 2023-09-30T22:19:18.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.121+0000 7fc75a065700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc754137000 0x7fc7541393e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48426/0 (socket says 172.21.15.156:48426) 2023-09-30T22:19:18.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.121+0000 7fc759063700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc75409f350 0x7fc754136ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40424/0 (socket says 172.21.15.156:40424) 2023-09-30T22:19:18.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.121+0000 7fc759864700 1 -- 172.21.15.156:0/323124298 learned_addr learned my addr 172.21.15.156:0/323124298 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:18.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.121+0000 7fc75a065700 1 -- 172.21.15.156:0/323124298 >> v2:172.21.15.156:3300/0 conn(0x7fc75409f350 msgr2=0x7fc754136ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:18.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.121+0000 7fc75a065700 1 --2- 172.21.15.156:0/323124298 >> v2:172.21.15.156:3300/0 conn(0x7fc75409f350 0x7fc754136ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.121+0000 7fc75a065700 1 -- 172.21.15.156:0/323124298 >> v1:172.21.15.156:6789/0 conn(0x7fc75409e870 legacy=0x7fc75409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:18.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.121+0000 7fc75a065700 1 -- 172.21.15.156:0/323124298 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7540a0650 con 0x7fc754137000 2023-09-30T22:19:18.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.121+0000 7fc758862700 1 -- 172.21.15.156:0/323124298 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408872704 0 0) 0x7fc750001110 con 0x7fc75409e870 2023-09-30T22:19:18.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.121+0000 7fc759063700 1 --2- 172.21.15.156:0/323124298 >> v2:172.21.15.156:3300/0 conn(0x7fc75409f350 0x7fc754136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:18.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.121+0000 7fc75a065700 1 --2- 172.21.15.156:0/323124298 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc754137000 0x7fc7541393e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009d90 tx=0x7fc74c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9a8f9a1229898d1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:18.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.121+0000 7fc758862700 1 -- 172.21.15.156:0/323124298 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c00e070 con 0x7fc754137000 2023-09-30T22:19:18.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.121+0000 7fc758862700 1 -- 172.21.15.156:0/323124298 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74c00bb20 con 0x7fc754137000 2023-09-30T22:19:18.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.121+0000 7fc758862700 1 -- 172.21.15.156:0/323124298 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c012430 con 0x7fc754137000 2023-09-30T22:19:18.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.122+0000 7fc75bac8700 1 -- 172.21.15.156:0/323124298 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc754137000 msgr2=0x7fc7541393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:18.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.122+0000 7fc75bac8700 1 --2- 172.21.15.156:0/323124298 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc754137000 0x7fc7541393e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009d90 tx=0x7fc74c00b330 comp rx=0 tx=0).stop 2023-09-30T22:19:18.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.122+0000 7fc75bac8700 1 -- 172.21.15.156:0/323124298 shutdown_connections 2023-09-30T22:19:18.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.122+0000 7fc75bac8700 1 --2- 172.21.15.156:0/323124298 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc754137000 0x7fc7541393e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.122+0000 7fc75bac8700 1 --2- 172.21.15.156:0/323124298 >> v2:172.21.15.156:3300/0 conn(0x7fc75409f350 0x7fc754136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.122+0000 7fc75bac8700 1 -- 172.21.15.156:0/323124298 >> 172.21.15.156:0/323124298 conn(0x7fc7540a4150 msgr2=0x7fc7540a4550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:18.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.122+0000 7fc75bac8700 1 -- 172.21.15.156:0/323124298 shutdown_connections 2023-09-30T22:19:18.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.122+0000 7fc75bac8700 1 -- 172.21.15.156:0/323124298 wait complete. 2023-09-30T22:19:18.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.123+0000 7fc75bac8700 1 Processor -- start 2023-09-30T22:19:18.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.123+0000 7fc75bac8700 1 -- start start 2023-09-30T22:19:18.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.124+0000 7fc75bac8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc75409e870 0x7fc7541c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:18.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.124+0000 7fc75bac8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc75409f350 0x7fc7541c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:18.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.124+0000 7fc75bac8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc754137000 0x7fc75411c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:18.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.124+0000 7fc75bac8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc754131020 con 0x7fc75409e870 2023-09-30T22:19:18.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.124+0000 7fc75bac8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7541bd300 con 0x7fc754137000 2023-09-30T22:19:18.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.124+0000 7fc75bac8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7541c92f0 con 0x7fc75409f350 2023-09-30T22:19:18.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.124+0000 7fc759864700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc75409e870 0x7fc7541c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:18.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.124+0000 7fc759864700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc75409e870 0x7fc7541c8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40438/0 (socket says 172.21.15.156:40438) 2023-09-30T22:19:18.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.124+0000 7fc759864700 1 -- 172.21.15.156:0/1596183169 learned_addr learned my addr 172.21.15.156:0/1596183169 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:18.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.124+0000 7fc759063700 1 --2- 172.21.15.156:0/1596183169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc75409f350 0x7fc7541c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:18.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.124+0000 7fc75a065700 1 --2- 172.21.15.156:0/1596183169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc754137000 0x7fc75411c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:18.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.124+0000 7fc759063700 1 -- 172.21.15.156:0/1596183169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc754137000 msgr2=0x7fc75411c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:18.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.124+0000 7fc759063700 1 --2- 172.21.15.156:0/1596183169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc754137000 0x7fc75411c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.124+0000 7fc759063700 1 -- 172.21.15.156:0/1596183169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc75409e870 msgr2=0x7fc7541c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:18.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.124+0000 7fc759063700 1 --2- 172.21.15.156:0/1596183169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc75409e870 0x7fc7541c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.124+0000 7fc759063700 1 -- 172.21.15.156:0/1596183169 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7440094a0 con 0x7fc75409f350 2023-09-30T22:19:18.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.124+0000 7fc759063700 1 --2- 172.21.15.156:0/1596183169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc75409f350 0x7fc7541c8db0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc74400e9b0 tx=0x7fc74400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:18.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.124+0000 7fc74a7fc700 1 -- 172.21.15.156:0/1596183169 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74400ee50 con 0x7fc75409f350 2023-09-30T22:19:18.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.124+0000 7fc74a7fc700 1 -- 172.21.15.156:0/1596183169 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74400c850 con 0x7fc75409f350 2023-09-30T22:19:18.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.124+0000 7fc75bac8700 1 -- 172.21.15.156:0/1596183169 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc74c009a70 con 0x7fc75409f350 2023-09-30T22:19:18.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.124+0000 7fc74a7fc700 1 -- 172.21.15.156:0/1596183169 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74400cc00 con 0x7fc75409f350 2023-09-30T22:19:18.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.125+0000 7fc75bac8700 1 -- 172.21.15.156:0/1596183169 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc75411ff10 con 0x7fc75409f350 2023-09-30T22:19:18.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.126+0000 7fc75bac8700 1 -- 172.21.15.156:0/1596183169 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc75404f2a0 con 0x7fc75409f350 2023-09-30T22:19:18.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.126+0000 7fc74a7fc700 1 -- 172.21.15.156:0/1596183169 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc744013470 con 0x7fc75409f350 2023-09-30T22:19:18.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.127+0000 7fc74a7fc700 1 -- 172.21.15.156:0/1596183169 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fc74403fc40 con 0x7fc75409f350 2023-09-30T22:19:18.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.127+0000 7fc759864700 1 -- 172.21.15.156:0/1596183169 >> v1:172.21.15.156:6816/126965 conn(0x7fc73802f510 legacy=0x7fc7380319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:18.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.131+0000 7fc74a7fc700 1 -- 172.21.15.156:0/1596183169 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc744013720 con 0x7fc75409f350 2023-09-30T22:19:18.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.237+0000 7f13393ff700 1 -- 172.21.15.156:0/1028253502 >> v1:172.21.15.156:6816/126965 conn(0x7f131802f510 legacy=0x7f13180319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:18.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.261+0000 7f133b663700 1 -- 172.21.15.156:0/1028253502 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f133409e380 con 0x7f133409dec0 2023-09-30T22:19:18.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.262+0000 7f1329ffb700 1 -- 172.21.15.156:0/1028253502 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f13240193b0 con 0x7f133409dec0 2023-09-30T22:19:18.262 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:18.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.264+0000 7f133b663700 1 -- 172.21.15.156:0/1028253502 >> v1:172.21.15.156:6816/126965 conn(0x7f131802f510 legacy=0x7f13180319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:18.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.264+0000 7f133b663700 1 -- 172.21.15.156:0/1028253502 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f133409dec0 msgr2=0x7f133411a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:18.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.264+0000 7f133b663700 1 --2- 172.21.15.156:0/1028253502 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f133409dec0 0x7f133411a3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1324009fd0 tx=0x7f1324004750 comp rx=0 tx=0).stop 2023-09-30T22:19:18.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.264+0000 7f133b663700 1 -- 172.21.15.156:0/1028253502 shutdown_connections 2023-09-30T22:19:18.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.264+0000 7f133b663700 1 --2- 172.21.15.156:0/1028253502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1334131a00 0x7f133411a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.264+0000 7f133b663700 1 --2- 172.21.15.156:0/1028253502 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f133406a770 0x7f1334119e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.264+0000 7f133b663700 1 --2- 172.21.15.156:0/1028253502 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f133409dec0 0x7f133411a3c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.264+0000 7f133b663700 1 -- 172.21.15.156:0/1028253502 >> 172.21.15.156:0/1028253502 conn(0x7f1334099c40 msgr2=0x7f133412ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:18.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.264+0000 7f133b663700 1 -- 172.21.15.156:0/1028253502 shutdown_connections 2023-09-30T22:19:18.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.264+0000 7f133b663700 1 -- 172.21.15.156:0/1028253502 wait complete. 2023-09-30T22:19:18.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:18.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.296+0000 7f350a22b700 1 -- 172.21.15.156:0/847118976 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f350404f2a0 con 0x7f350409e340 2023-09-30T22:19:18.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.297+0000 7f34ebfff700 1 -- 172.21.15.156:0/847118976 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f34f8023c00 con 0x7f350409e340 2023-09-30T22:19:18.297 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:18.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.298+0000 7f35037fe700 1 -- 172.21.15.156:0/847118976 >> v1:172.21.15.156:6816/126965 conn(0x7f34f002f510 legacy=0x7f34f00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:18.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.299+0000 7f350a22b700 1 -- 172.21.15.156:0/847118976 >> v1:172.21.15.156:6816/126965 conn(0x7f34f002f510 legacy=0x7f34f00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:18.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.299+0000 7f350a22b700 1 -- 172.21.15.156:0/847118976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f350409e340 msgr2=0x7f350411bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:18.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.299+0000 7f350a22b700 1 --2- 172.21.15.156:0/847118976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f350409e340 0x7f350411bc20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f34f8006d30 tx=0x7f34f8004750 comp rx=0 tx=0).stop 2023-09-30T22:19:18.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.299+0000 7f350a22b700 1 -- 172.21.15.156:0/847118976 shutdown_connections 2023-09-30T22:19:18.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.299+0000 7f350a22b700 1 --2- 172.21.15.156:0/847118976 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3504135f20 0x7f350411c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.299+0000 7f350a22b700 1 --2- 172.21.15.156:0/847118976 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350409d860 0x7f350411b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.299+0000 7f350a22b700 1 --2- 172.21.15.156:0/847118976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f350409e340 0x7f350411bc20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.299+0000 7f350a22b700 1 -- 172.21.15.156:0/847118976 >> 172.21.15.156:0/847118976 conn(0x7f3504099c40 msgr2=0x7f350406e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:18.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.299+0000 7f350a22b700 1 -- 172.21.15.156:0/847118976 shutdown_connections 2023-09-30T22:19:18.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.299+0000 7f350a22b700 1 -- 172.21.15.156:0/847118976 wait complete. 2023-09-30T22:19:18.311 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:18.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.324+0000 7fc75bac8700 1 -- 172.21.15.156:0/1596183169 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc75411fb50 con 0x7fc75409f350 2023-09-30T22:19:18.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.325+0000 7fc74a7fc700 1 -- 172.21.15.156:0/1596183169 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc75411fb50 con 0x7fc75409f350 2023-09-30T22:19:18.324 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:18.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.327+0000 7fc75bac8700 1 -- 172.21.15.156:0/1596183169 >> v1:172.21.15.156:6816/126965 conn(0x7fc73802f510 legacy=0x7fc7380319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:18.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.327+0000 7fc75bac8700 1 -- 172.21.15.156:0/1596183169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc75409f350 msgr2=0x7fc7541c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:18.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.327+0000 7fc75bac8700 1 --2- 172.21.15.156:0/1596183169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc75409f350 0x7fc7541c8db0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc74400e9b0 tx=0x7fc74400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.327+0000 7fc75bac8700 1 -- 172.21.15.156:0/1596183169 shutdown_connections 2023-09-30T22:19:18.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.327+0000 7fc75bac8700 1 --2- 172.21.15.156:0/1596183169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc754137000 0x7fc75411c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.327+0000 7fc75bac8700 1 --2- 172.21.15.156:0/1596183169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc75409e870 0x7fc7541c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.327+0000 7fc75bac8700 1 --2- 172.21.15.156:0/1596183169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc75409f350 0x7fc7541c8db0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:18.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.327+0000 7fc75bac8700 1 -- 172.21.15.156:0/1596183169 >> 172.21.15.156:0/1596183169 conn(0x7fc7540a4150 msgr2=0x7fc7541bc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:18.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.327+0000 7fc75bac8700 1 -- 172.21.15.156:0/1596183169 shutdown_connections 2023-09-30T22:19:18.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:18.327+0000 7fc75bac8700 1 -- 172.21.15.156:0/1596183169 wait complete. 2023-09-30T22:19:18.339 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:19.101 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:19.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.231+0000 7f97ea5dc700 1 Processor -- start 2023-09-30T22:19:19.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.231+0000 7f97ea5dc700 1 -- start start 2023-09-30T22:19:19.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.232+0000 7f97ea5dc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97e4133ad0 0x7f97e4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:19.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.232+0000 7f97ea5dc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97e4130bc0 0x7f97e413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:19.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.232+0000 7f97ea5dc700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e406b2d0 con 0x7f97e41300a0 2023-09-30T22:19:19.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.232+0000 7f97ea5dc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e4133610 con 0x7f97e4130bc0 2023-09-30T22:19:19.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.232+0000 7f97ea5dc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97e409a500 con 0x7f97e4133ad0 2023-09-30T22:19:19.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.232+0000 7f97e3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97e4133ad0 0x7f97e4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:19.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.232+0000 7f97e8b79700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97e4130bc0 0x7f97e413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:19.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.232+0000 7f97e3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97e4133ad0 0x7f97e4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48442/0 (socket says 172.21.15.156:48442) 2023-09-30T22:19:19.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.232+0000 7f97e3fff700 1 -- 172.21.15.156:0/1441146550 learned_addr learned my addr 172.21.15.156:0/1441146550 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:19.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.232+0000 7f97e8b79700 1 --2- 172.21.15.156:0/1441146550 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97e4130bc0 0x7f97e413b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52896/0 (socket says 172.21.15.156:52896) 2023-09-30T22:19:19.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.232+0000 7f97e2ffd700 1 -- 172.21.15.156:0/1441146550 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 328854108 0 0) 0x7f97e406b2d0 con 0x7f97e41300a0 2023-09-30T22:19:19.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.232+0000 7f97e3fff700 1 -- 172.21.15.156:0/1441146550 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97e4130bc0 msgr2=0x7f97e413b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:19.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.232+0000 7f97e3fff700 1 --2- 172.21.15.156:0/1441146550 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97e4130bc0 0x7f97e413b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.232+0000 7f97e3fff700 1 -- 172.21.15.156:0/1441146550 >> v1:172.21.15.156:6789/0 conn(0x7f97e41300a0 legacy=0x7f97e41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.232+0000 7f97e3fff700 1 -- 172.21.15.156:0/1441146550 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e41338b0 con 0x7f97e4133ad0 2023-09-30T22:19:19.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.232+0000 7f97e8b79700 1 --2- 172.21.15.156:0/1441146550 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97e4130bc0 0x7f97e413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:19.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.232+0000 7f97e3fff700 1 --2- 172.21.15.156:0/1441146550 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97e4133ad0 0x7f97e4133ea0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f97d8009920 tx=0x7f97d8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a01a601ec6d215bb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:19.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.232+0000 7f97e2ffd700 1 -- 172.21.15.156:0/1441146550 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d8011830 con 0x7f97e4133ad0 2023-09-30T22:19:19.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.232+0000 7f97e2ffd700 1 -- 172.21.15.156:0/1441146550 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d8011990 con 0x7f97e4133ad0 2023-09-30T22:19:19.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.232+0000 7f97e2ffd700 1 -- 172.21.15.156:0/1441146550 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d8011d20 con 0x7f97e4133ad0 2023-09-30T22:19:19.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.233+0000 7f97ea5dc700 1 -- 172.21.15.156:0/1441146550 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97e4133ad0 msgr2=0x7f97e4133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.233+0000 7f97ea5dc700 1 --2- 172.21.15.156:0/1441146550 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97e4133ad0 0x7f97e4133ea0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f97d8009920 tx=0x7f97d8009c30 comp rx=0 tx=0).stop 2023-09-30T22:19:19.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.233+0000 7f97ea5dc700 1 -- 172.21.15.156:0/1441146550 shutdown_connections 2023-09-30T22:19:19.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.233+0000 7f97ea5dc700 1 --2- 172.21.15.156:0/1441146550 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97e4130bc0 0x7f97e413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.233+0000 7f97ea5dc700 1 --2- 172.21.15.156:0/1441146550 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97e4133ad0 0x7f97e4133ea0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.233+0000 7f97ea5dc700 1 -- 172.21.15.156:0/1441146550 >> 172.21.15.156:0/1441146550 conn(0x7f97e4099c40 msgr2=0x7f97e40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:19.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.233+0000 7f97ea5dc700 1 -- 172.21.15.156:0/1441146550 shutdown_connections 2023-09-30T22:19:19.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.233+0000 7f97ea5dc700 1 -- 172.21.15.156:0/1441146550 wait complete. 2023-09-30T22:19:19.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.234+0000 7f97ea5dc700 1 Processor -- start 2023-09-30T22:19:19.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.234+0000 7f97ea5dc700 1 -- start start 2023-09-30T22:19:19.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.235+0000 7f97ea5dc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97e41300a0 0x7f97e411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:19.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.235+0000 7f97ea5dc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97e4130bc0 0x7f97e411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:19.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.235+0000 7f97ea5dc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97e4133ad0 0x7f97e411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:19.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.235+0000 7f97ea5dc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e41200a0 con 0x7f97e4130bc0 2023-09-30T22:19:19.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.235+0000 7f97ea5dc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e411f830 con 0x7f97e41300a0 2023-09-30T22:19:19.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.235+0000 7f97ea5dc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97e411fb00 con 0x7f97e4133ad0 2023-09-30T22:19:19.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.235+0000 7f97e8b79700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97e4133ad0 0x7f97e411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:19.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.235+0000 7f97e37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97e4130bc0 0x7f97e411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:19.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.235+0000 7f97e8b79700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97e4133ad0 0x7f97e411e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48450/0 (socket says 172.21.15.156:48450) 2023-09-30T22:19:19.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.235+0000 7f97e8b79700 1 -- 172.21.15.156:0/3719012007 learned_addr learned my addr 172.21.15.156:0/3719012007 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:19.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.235+0000 7f97e3fff700 1 --2- 172.21.15.156:0/3719012007 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97e41300a0 0x7f97e411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:19.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.235+0000 7f97e8b79700 1 -- 172.21.15.156:0/3719012007 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97e41300a0 msgr2=0x7f97e411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.235+0000 7f97e8b79700 1 --2- 172.21.15.156:0/3719012007 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97e41300a0 0x7f97e411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.235+0000 7f97e8b79700 1 -- 172.21.15.156:0/3719012007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97e4130bc0 msgr2=0x7f97e411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.235+0000 7f97e8b79700 1 --2- 172.21.15.156:0/3719012007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97e4130bc0 0x7f97e411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.235+0000 7f97e8b79700 1 -- 172.21.15.156:0/3719012007 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97dc009a70 con 0x7f97e4133ad0 2023-09-30T22:19:19.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.235+0000 7f97e37fe700 1 --2- 172.21.15.156:0/3719012007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97e4130bc0 0x7f97e411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:19.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.235+0000 7f97e8b79700 1 --2- 172.21.15.156:0/3719012007 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97e4133ad0 0x7f97e411e4c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f97dc00efc0 tx=0x7f97dc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:19.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.236+0000 7f97e0ff9700 1 -- 172.21.15.156:0/3719012007 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc00ca90 con 0x7f97e4133ad0 2023-09-30T22:19:19.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.236+0000 7f97e0ff9700 1 -- 172.21.15.156:0/3719012007 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97dc00f040 con 0x7f97e4133ad0 2023-09-30T22:19:19.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.236+0000 7f97ea5dc700 1 -- 172.21.15.156:0/3719012007 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d8009550 con 0x7f97e4133ad0 2023-09-30T22:19:19.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.236+0000 7f97e0ff9700 1 -- 172.21.15.156:0/3719012007 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc00ce30 con 0x7f97e4133ad0 2023-09-30T22:19:19.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.236+0000 7f97ea5dc700 1 -- 172.21.15.156:0/3719012007 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e412fe60 con 0x7f97e4133ad0 2023-09-30T22:19:19.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.236+0000 7f97e0ff9700 1 -- 172.21.15.156:0/3719012007 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f97dc014480 con 0x7f97e4133ad0 2023-09-30T22:19:19.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.237+0000 7f97e0ff9700 1 -- 172.21.15.156:0/3719012007 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f97dc040350 con 0x7f97e4133ad0 2023-09-30T22:19:19.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.237+0000 7f97e3fff700 1 -- 172.21.15.156:0/3719012007 >> v1:172.21.15.156:6816/126965 conn(0x7f97d002f510 legacy=0x7f97d00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:19.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.237+0000 7f97ea5dc700 1 -- 172.21.15.156:0/3719012007 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e412dd60 con 0x7f97e4133ad0 2023-09-30T22:19:19.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.241+0000 7f97e0ff9700 1 -- 172.21.15.156:0/3719012007 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f97dc018070 con 0x7f97e4133ad0 2023-09-30T22:19:19.277 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:19.312 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:19.340 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:19.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.415+0000 7f022bd86700 1 Processor -- start 2023-09-30T22:19:19.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.415+0000 7f022bd86700 1 -- start start 2023-09-30T22:19:19.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.416+0000 7f022bd86700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f022409f350 0x7f0224138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:19.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.416+0000 7f022bd86700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f02241393a0 0x7f022413b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:19.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.416+0000 7f022bd86700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f022409fa00 con 0x7f022409e870 2023-09-30T22:19:19.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.416+0000 7f022bd86700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02240a0370 con 0x7f02241393a0 2023-09-30T22:19:19.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.416+0000 7f022bd86700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f022406bec0 con 0x7f022409f350 2023-09-30T22:19:19.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.416+0000 7f0229b22700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f022409e870 0x7f022409ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:36330/0 (socket says 172.21.15.156:36330) 2023-09-30T22:19:19.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.416+0000 7f0229b22700 1 -- 172.21.15.156:0/1598953055 learned_addr learned my addr 172.21.15.156:0/1598953055 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:19.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.416+0000 7f022a323700 1 --2- 172.21.15.156:0/1598953055 >> v2:172.21.15.156:3300/0 conn(0x7f02241393a0 0x7f022413b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:19.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.416+0000 7f0229321700 1 --2- 172.21.15.156:0/1598953055 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f022409f350 0x7f0224138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:19.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.416+0000 7f022a323700 1 -- 172.21.15.156:0/1598953055 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f022409f350 msgr2=0x7f0224138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:19.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.416+0000 7f022a323700 1 --2- 172.21.15.156:0/1598953055 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f022409f350 0x7f0224138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.416+0000 7f022a323700 1 -- 172.21.15.156:0/1598953055 >> v1:172.21.15.156:6789/0 conn(0x7f022409e870 legacy=0x7f022409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.416+0000 7f022a323700 1 -- 172.21.15.156:0/1598953055 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022409ada0 con 0x7f02241393a0 2023-09-30T22:19:19.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.416+0000 7f0229321700 1 --2- 172.21.15.156:0/1598953055 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f022409f350 0x7f0224138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:19:19.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.417+0000 7f022a323700 1 --2- 172.21.15.156:0/1598953055 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02241393a0 0x7f022413b780 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f021c009d90 tx=0x7f021c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f123d57f0c49f3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:19.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.417+0000 7f0228b20700 1 -- 172.21.15.156:0/1598953055 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c00e070 con 0x7f02241393a0 2023-09-30T22:19:19.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.417+0000 7f0228b20700 1 -- 172.21.15.156:0/1598953055 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021c00bbd0 con 0x7f02241393a0 2023-09-30T22:19:19.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.417+0000 7f0228b20700 1 -- 172.21.15.156:0/1598953055 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c012430 con 0x7f02241393a0 2023-09-30T22:19:19.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.418+0000 7f022bd86700 1 -- 172.21.15.156:0/1598953055 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02241393a0 msgr2=0x7f022413b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.418+0000 7f022bd86700 1 --2- 172.21.15.156:0/1598953055 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02241393a0 0x7f022413b780 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f021c009d90 tx=0x7f021c00b330 comp rx=0 tx=0).stop 2023-09-30T22:19:19.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.418+0000 7f022bd86700 1 -- 172.21.15.156:0/1598953055 shutdown_connections 2023-09-30T22:19:19.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.418+0000 7f022bd86700 1 --2- 172.21.15.156:0/1598953055 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02241393a0 0x7f022413b780 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.418+0000 7f022bd86700 1 --2- 172.21.15.156:0/1598953055 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f022409f350 0x7f0224138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.418+0000 7f022bd86700 1 -- 172.21.15.156:0/1598953055 >> 172.21.15.156:0/1598953055 conn(0x7f02240a4430 msgr2=0x7f02240a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:19.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.418+0000 7f022bd86700 1 -- 172.21.15.156:0/1598953055 shutdown_connections 2023-09-30T22:19:19.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.418+0000 7f022bd86700 1 -- 172.21.15.156:0/1598953055 wait complete. 2023-09-30T22:19:19.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.419+0000 7f022bd86700 1 Processor -- start 2023-09-30T22:19:19.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.419+0000 7f022bd86700 1 -- start start 2023-09-30T22:19:19.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.420+0000 7f022bd86700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f022409e870 0x7f022411ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:19.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.420+0000 7f022bd86700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f022409f350 0x7f022411f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:19.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.420+0000 7f022bd86700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02241393a0 0x7f022411f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:19.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.420+0000 7f022bd86700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0224120530 con 0x7f022409e870 2023-09-30T22:19:19.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.420+0000 7f022bd86700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0224120da0 con 0x7f022409f350 2023-09-30T22:19:19.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.420+0000 7f022bd86700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f022406f8f0 con 0x7f02241393a0 2023-09-30T22:19:19.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.420+0000 7f0229b22700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f022409e870 0x7f022411ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:19.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.420+0000 7f022a323700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02241393a0 0x7f022411f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:19.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.420+0000 7f0229b22700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f022409e870 0x7f022411ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40458/0 (socket says 172.21.15.156:40458) 2023-09-30T22:19:19.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.420+0000 7f0229b22700 1 -- 172.21.15.156:0/2214467357 learned_addr learned my addr 172.21.15.156:0/2214467357 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:19.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.420+0000 7f0229321700 1 --2- 172.21.15.156:0/2214467357 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f022409f350 0x7f022411f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:19.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.421+0000 7f022a323700 1 -- 172.21.15.156:0/2214467357 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f022409f350 msgr2=0x7f022411f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.421+0000 7f022a323700 1 --2- 172.21.15.156:0/2214467357 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f022409f350 0x7f022411f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.421+0000 7f022a323700 1 -- 172.21.15.156:0/2214467357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f022409e870 msgr2=0x7f022411ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.421+0000 7f022a323700 1 --2- 172.21.15.156:0/2214467357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f022409e870 0x7f022411ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.421+0000 7f022a323700 1 -- 172.21.15.156:0/2214467357 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c009a70 con 0x7f02241393a0 2023-09-30T22:19:19.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.421+0000 7f0229b22700 1 --2- 172.21.15.156:0/2214467357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f022409e870 0x7f022411ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:19.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.421+0000 7f0229321700 1 --2- 172.21.15.156:0/2214467357 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f022409f350 0x7f022411f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:19.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.421+0000 7f022a323700 1 --2- 172.21.15.156:0/2214467357 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02241393a0 0x7f022411f550 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f021c016000 tx=0x7f021c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:19.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.421+0000 7f021a7fc700 1 -- 172.21.15.156:0/2214467357 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c012430 con 0x7f02241393a0 2023-09-30T22:19:19.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.421+0000 7f021a7fc700 1 -- 172.21.15.156:0/2214467357 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021c020070 con 0x7f02241393a0 2023-09-30T22:19:19.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.421+0000 7f021a7fc700 1 -- 172.21.15.156:0/2214467357 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c004040 con 0x7f02241393a0 2023-09-30T22:19:19.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.421+0000 7f022bd86700 1 -- 172.21.15.156:0/2214467357 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f022406cfa0 con 0x7f02241393a0 2023-09-30T22:19:19.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.421+0000 7f022bd86700 1 -- 172.21.15.156:0/2214467357 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0224134840 con 0x7f02241393a0 2023-09-30T22:19:19.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.423+0000 7f021a7fc700 1 -- 172.21.15.156:0/2214467357 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f021c0041a0 con 0x7f02241393a0 2023-09-30T22:19:19.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.423+0000 7f022bd86700 1 -- 172.21.15.156:0/2214467357 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0224122c70 con 0x7f02241393a0 2023-09-30T22:19:19.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.423+0000 7f021a7fc700 1 -- 172.21.15.156:0/2214467357 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f021c022070 con 0x7f02241393a0 2023-09-30T22:19:19.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.423+0000 7f0229b22700 1 -- 172.21.15.156:0/2214467357 >> v1:172.21.15.156:6816/126965 conn(0x7f020802f510 legacy=0x7f02080319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:19.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.431+0000 7f021a7fc700 1 -- 172.21.15.156:0/2214467357 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f021c004910 con 0x7f02241393a0 2023-09-30T22:19:19.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.438+0000 7f97e3fff700 1 -- 172.21.15.156:0/3719012007 >> v1:172.21.15.156:6816/126965 conn(0x7f97d002f510 legacy=0x7f97d00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:19.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.452+0000 7f97ea5dc700 1 -- 172.21.15.156:0/3719012007 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f97e404f2a0 con 0x7f97e4133ad0 2023-09-30T22:19:19.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.452+0000 7f97e0ff9700 1 -- 172.21.15.156:0/3719012007 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f97dc012930 con 0x7f97e4133ad0 2023-09-30T22:19:19.453 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:19.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.455+0000 7f97ea5dc700 1 -- 172.21.15.156:0/3719012007 >> v1:172.21.15.156:6816/126965 conn(0x7f97d002f510 legacy=0x7f97d00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:19.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.455+0000 7f97ea5dc700 1 -- 172.21.15.156:0/3719012007 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97e4133ad0 msgr2=0x7f97e411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.455+0000 7f97ea5dc700 1 --2- 172.21.15.156:0/3719012007 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97e4133ad0 0x7f97e411e4c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f97dc00efc0 tx=0x7f97dc00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.455+0000 7f97ea5dc700 1 -- 172.21.15.156:0/3719012007 shutdown_connections 2023-09-30T22:19:19.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.455+0000 7f97ea5dc700 1 --2- 172.21.15.156:0/3719012007 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97e4133ad0 0x7f97e411e4c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.455+0000 7f97ea5dc700 1 --2- 172.21.15.156:0/3719012007 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97e41300a0 0x7f97e411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.455+0000 7f97ea5dc700 1 --2- 172.21.15.156:0/3719012007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97e4130bc0 0x7f97e411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.455+0000 7f97ea5dc700 1 -- 172.21.15.156:0/3719012007 >> 172.21.15.156:0/3719012007 conn(0x7f97e4099c40 msgr2=0x7f97e41320f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:19.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.455+0000 7f97ea5dc700 1 -- 172.21.15.156:0/3719012007 shutdown_connections 2023-09-30T22:19:19.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.455+0000 7f97ea5dc700 1 -- 172.21.15.156:0/3719012007 wait complete. 2023-09-30T22:19:19.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:19.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.470+0000 7ff1a2240700 1 Processor -- start 2023-09-30T22:19:19.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.470+0000 7ff1a2240700 1 -- start start 2023-09-30T22:19:19.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.470+0000 7ff1a2240700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff19c133ad0 0x7ff19c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:19.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.470+0000 7ff1a2240700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff19c1300a0 0x7ff19c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:19.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.470+0000 7ff1a2240700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff19c06b2d0 con 0x7ff19c1309f0 2023-09-30T22:19:19.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.470+0000 7ff1a2240700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff19c133610 con 0x7ff19c133ad0 2023-09-30T22:19:19.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.470+0000 7ff1a2240700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c09a500 con 0x7ff19c1300a0 2023-09-30T22:19:19.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.470+0000 7ff19affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff19c1300a0 0x7ff19c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:19.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.470+0000 7ff19b7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff19c133ad0 0x7ff19c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:19.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.470+0000 7ff19affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff19c1300a0 0x7ff19c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52922/0 (socket says 172.21.15.156:52922) 2023-09-30T22:19:19.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.470+0000 7ff19b7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff19c133ad0 0x7ff19c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40468/0 (socket says 172.21.15.156:40468) 2023-09-30T22:19:19.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.470+0000 7ff19affd700 1 -- 172.21.15.156:0/2502777109 learned_addr learned my addr 172.21.15.156:0/2502777109 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:19.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.471+0000 7ff19b7fe700 1 -- 172.21.15.156:0/2502777109 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff19c1300a0 msgr2=0x7ff19c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:19.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.471+0000 7ff19b7fe700 1 --2- 172.21.15.156:0/2502777109 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff19c1300a0 0x7ff19c1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.471+0000 7ff19b7fe700 1 -- 172.21.15.156:0/2502777109 >> v1:172.21.15.156:6789/0 conn(0x7ff19c1309f0 legacy=0x7ff19c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.471+0000 7ff19a7fc700 1 -- 172.21.15.156:0/2502777109 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2920545762 0 0) 0x7ff19c06b2d0 con 0x7ff19c1309f0 2023-09-30T22:19:19.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.471+0000 7ff19b7fe700 1 -- 172.21.15.156:0/2502777109 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19c1338b0 con 0x7ff19c133ad0 2023-09-30T22:19:19.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.471+0000 7ff19affd700 1 --2- 172.21.15.156:0/2502777109 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff19c1300a0 0x7ff19c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:19.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.471+0000 7ff19b7fe700 1 --2- 172.21.15.156:0/2502777109 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff19c133ad0 0x7ff19c133ea0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009840 tx=0x7ff18c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c295952eca9fb97 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:19.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.471+0000 7ff19a7fc700 1 -- 172.21.15.156:0/2502777109 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c011830 con 0x7ff19c133ad0 2023-09-30T22:19:19.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.471+0000 7ff19a7fc700 1 -- 172.21.15.156:0/2502777109 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18c011990 con 0x7ff19c133ad0 2023-09-30T22:19:19.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.471+0000 7ff19a7fc700 1 -- 172.21.15.156:0/2502777109 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c011d20 con 0x7ff19c133ad0 2023-09-30T22:19:19.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.472+0000 7ff1a2240700 1 -- 172.21.15.156:0/2502777109 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff19c133ad0 msgr2=0x7ff19c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.472+0000 7ff1a2240700 1 --2- 172.21.15.156:0/2502777109 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff19c133ad0 0x7ff19c133ea0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009840 tx=0x7ff18c009b50 comp rx=0 tx=0).stop 2023-09-30T22:19:19.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.472+0000 7ff1a2240700 1 -- 172.21.15.156:0/2502777109 shutdown_connections 2023-09-30T22:19:19.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.472+0000 7ff1a2240700 1 --2- 172.21.15.156:0/2502777109 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff19c133ad0 0x7ff19c133ea0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.472+0000 7ff1a2240700 1 --2- 172.21.15.156:0/2502777109 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff19c1300a0 0x7ff19c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.472+0000 7ff1a2240700 1 -- 172.21.15.156:0/2502777109 >> 172.21.15.156:0/2502777109 conn(0x7ff19c099c40 msgr2=0x7ff19c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:19.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.472+0000 7ff1a2240700 1 -- 172.21.15.156:0/2502777109 shutdown_connections 2023-09-30T22:19:19.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.472+0000 7ff1a2240700 1 -- 172.21.15.156:0/2502777109 wait complete. 2023-09-30T22:19:19.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.473+0000 7ff1a2240700 1 Processor -- start 2023-09-30T22:19:19.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.473+0000 7ff1a2240700 1 -- start start 2023-09-30T22:19:19.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.474+0000 7ff1a2240700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff19c1300a0 0x7ff19c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:19.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.474+0000 7ff1a2240700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff19c1309f0 0x7ff19c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:19.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.474+0000 7ff1a2240700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff19c133ad0 0x7ff19c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:19.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.474+0000 7ff1a2240700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c11fd70 con 0x7ff19c133ad0 2023-09-30T22:19:19.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.474+0000 7ff1a2240700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c11f080 con 0x7ff19c1309f0 2023-09-30T22:19:19.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.474+0000 7ff1a2240700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c120050 con 0x7ff19c1300a0 2023-09-30T22:19:19.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.474+0000 7ff19bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff19c133ad0 0x7ff19c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:19.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.474+0000 7ff19b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff19c1300a0 0x7ff19c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:19.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.474+0000 7ff19bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff19c133ad0 0x7ff19c11e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40476/0 (socket says 172.21.15.156:40476) 2023-09-30T22:19:19.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.474+0000 7ff19bfff700 1 -- 172.21.15.156:0/3878092427 learned_addr learned my addr 172.21.15.156:0/3878092427 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:19.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.474+0000 7ff19affd700 1 --2- 172.21.15.156:0/3878092427 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff19c1309f0 0x7ff19c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:19.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.475+0000 7ff19b7fe700 1 -- 172.21.15.156:0/3878092427 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff19c1309f0 msgr2=0x7ff19c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.475+0000 7ff19b7fe700 1 --2- 172.21.15.156:0/3878092427 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff19c1309f0 0x7ff19c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.475+0000 7ff19b7fe700 1 -- 172.21.15.156:0/3878092427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff19c133ad0 msgr2=0x7ff19c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.475+0000 7ff19b7fe700 1 --2- 172.21.15.156:0/3878092427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff19c133ad0 0x7ff19c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.475+0000 7ff19b7fe700 1 -- 172.21.15.156:0/3878092427 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff190009550 con 0x7ff19c1300a0 2023-09-30T22:19:19.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.475+0000 7ff19bfff700 1 --2- 172.21.15.156:0/3878092427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff19c133ad0 0x7ff19c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:19.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.475+0000 7ff19b7fe700 1 --2- 172.21.15.156:0/3878092427 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff19c1300a0 0x7ff19c11da40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff18c016000 tx=0x7ff18c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:19.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.475+0000 7ff183fff700 1 -- 172.21.15.156:0/3878092427 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c0036a0 con 0x7ff19c1300a0 2023-09-30T22:19:19.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.475+0000 7ff183fff700 1 -- 172.21.15.156:0/3878092427 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18c01f070 con 0x7ff19c1300a0 2023-09-30T22:19:19.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.475+0000 7ff1a2240700 1 -- 172.21.15.156:0/3878092427 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff18c0094a0 con 0x7ff19c1300a0 2023-09-30T22:19:19.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.475+0000 7ff183fff700 1 -- 172.21.15.156:0/3878092427 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c003a20 con 0x7ff19c1300a0 2023-09-30T22:19:19.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.475+0000 7ff1a2240700 1 -- 172.21.15.156:0/3878092427 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19c0a3350 con 0x7ff19c1300a0 2023-09-30T22:19:19.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.476+0000 7ff183fff700 1 -- 172.21.15.156:0/3878092427 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff18c003b80 con 0x7ff19c1300a0 2023-09-30T22:19:19.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.476+0000 7ff183fff700 1 -- 172.21.15.156:0/3878092427 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7ff18c021070 con 0x7ff19c1300a0 2023-09-30T22:19:19.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.476+0000 7ff19affd700 1 -- 172.21.15.156:0/3878092427 >> v1:172.21.15.156:6816/126965 conn(0x7ff18802f540 legacy=0x7ff1880319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:19.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.476+0000 7ff1a2240700 1 -- 172.21.15.156:0/3878092427 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19c12dd00 con 0x7ff19c1300a0 2023-09-30T22:19:19.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.481+0000 7ff183fff700 1 -- 172.21.15.156:0/3878092427 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff18c015030 con 0x7ff19c1300a0 2023-09-30T22:19:19.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.504+0000 7f6ecddcb700 1 Processor -- start 2023-09-30T22:19:19.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.504+0000 7f6ecddcb700 1 -- start start 2023-09-30T22:19:19.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.504+0000 7f6ecddcb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6ec809d860 0x7f6ec809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:19.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.504+0000 7f6ecddcb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ec8130eb0 0x7f6ec8138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:19.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.504+0000 7f6ecddcb700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec809aaa0 con 0x7f6ec809e170 2023-09-30T22:19:19.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.504+0000 7f6ecddcb700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ec809f870 con 0x7f6ec809d860 2023-09-30T22:19:19.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.504+0000 7f6ecddcb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec809b360 con 0x7f6ec8130eb0 2023-09-30T22:19:19.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.506+0000 7f6ec7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ec8130eb0 0x7f6ec8138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:19.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.506+0000 7f6ec7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ec8130eb0 0x7f6ec8138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52940/0 (socket says 172.21.15.156:52940) 2023-09-30T22:19:19.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.506+0000 7f6ec7fff700 1 -- 172.21.15.156:0/1889003844 learned_addr learned my addr 172.21.15.156:0/1889003844 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:19.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.506+0000 7f6ec7fff700 1 -- 172.21.15.156:0/1889003844 >> v2:172.21.15.156:3300/0 conn(0x7f6ec809d860 msgr2=0x7f6ec809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:19.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.506+0000 7f6ec7fff700 1 --2- 172.21.15.156:0/1889003844 >> v2:172.21.15.156:3300/0 conn(0x7f6ec809d860 0x7f6ec809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.506+0000 7f6ec7fff700 1 -- 172.21.15.156:0/1889003844 >> v1:172.21.15.156:6789/0 conn(0x7f6ec809e170 legacy=0x7f6ec81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:19.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.506+0000 7f6ec7fff700 1 -- 172.21.15.156:0/1889003844 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec809b620 con 0x7f6ec8130eb0 2023-09-30T22:19:19.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.506+0000 7f6ec7fff700 1 --2- 172.21.15.156:0/1889003844 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ec8130eb0 0x7f6ec8138a00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000d150 tx=0x7f6ec000d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e07e3a0f7c3f277 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:19.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.507+0000 7f6ec67fc700 1 -- 172.21.15.156:0/1889003844 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0010070 con 0x7f6ec8130eb0 2023-09-30T22:19:19.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.507+0000 7f6ec67fc700 1 -- 172.21.15.156:0/1889003844 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec000dd80 con 0x7f6ec8130eb0 2023-09-30T22:19:19.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.507+0000 7f6ec67fc700 1 -- 172.21.15.156:0/1889003844 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec000b310 con 0x7f6ec8130eb0 2023-09-30T22:19:19.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.508+0000 7f6ecddcb700 1 -- 172.21.15.156:0/1889003844 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ec8130eb0 msgr2=0x7f6ec8138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.508+0000 7f6ecddcb700 1 --2- 172.21.15.156:0/1889003844 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ec8130eb0 0x7f6ec8138a00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000d150 tx=0x7f6ec000d460 comp rx=0 tx=0).stop 2023-09-30T22:19:19.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.508+0000 7f6ecddcb700 1 -- 172.21.15.156:0/1889003844 shutdown_connections 2023-09-30T22:19:19.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.508+0000 7f6ecddcb700 1 --2- 172.21.15.156:0/1889003844 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ec8130eb0 0x7f6ec8138a00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.508+0000 7f6ecddcb700 1 --2- 172.21.15.156:0/1889003844 >> v2:172.21.15.156:3300/0 conn(0x7f6ec809d860 0x7f6ec809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.508+0000 7f6ecddcb700 1 -- 172.21.15.156:0/1889003844 >> 172.21.15.156:0/1889003844 conn(0x7f6ec8099c40 msgr2=0x7f6ec80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:19.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.508+0000 7f6ecddcb700 1 -- 172.21.15.156:0/1889003844 shutdown_connections 2023-09-30T22:19:19.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.508+0000 7f6ecddcb700 1 -- 172.21.15.156:0/1889003844 wait complete. 2023-09-30T22:19:19.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.509+0000 7f6ecddcb700 1 Processor -- start 2023-09-30T22:19:19.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.509+0000 7f6ecddcb700 1 -- start start 2023-09-30T22:19:19.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.510+0000 7f6ecddcb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ec809d860 0x7f6ec811e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:19.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.510+0000 7f6ecddcb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ec809e170 0x7f6ec811eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:19.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.510+0000 7f6ecddcb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ec8130eb0 0x7f6ec811f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:19.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.510+0000 7f6ecddcb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec8121e20 con 0x7f6ec809d860 2023-09-30T22:19:19.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.510+0000 7f6ecddcb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec8120300 con 0x7f6ec8130eb0 2023-09-30T22:19:19.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.510+0000 7f6ecddcb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec81207a0 con 0x7f6ec809e170 2023-09-30T22:19:19.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.510+0000 7f6ec6ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ec809e170 0x7f6ec811eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:19.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.510+0000 7f6ec77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ec809d860 0x7f6ec811e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:19.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.510+0000 7f6ec6ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ec809e170 0x7f6ec811eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48468/0 (socket says 172.21.15.156:48468) 2023-09-30T22:19:19.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.510+0000 7f6ec6ffd700 1 -- 172.21.15.156:0/3949644313 learned_addr learned my addr 172.21.15.156:0/3949644313 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:19.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.510+0000 7f6ec7fff700 1 --2- 172.21.15.156:0/3949644313 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ec8130eb0 0x7f6ec811f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:19.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.510+0000 7f6ec6ffd700 1 -- 172.21.15.156:0/3949644313 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ec8130eb0 msgr2=0x7f6ec811f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.511+0000 7f6ec6ffd700 1 --2- 172.21.15.156:0/3949644313 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ec8130eb0 0x7f6ec811f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.511+0000 7f6ec6ffd700 1 -- 172.21.15.156:0/3949644313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ec809d860 msgr2=0x7f6ec811e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.511+0000 7f6ec6ffd700 1 --2- 172.21.15.156:0/3949644313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ec809d860 0x7f6ec811e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.511+0000 7f6ec6ffd700 1 -- 172.21.15.156:0/3949644313 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec000bd40 con 0x7f6ec809e170 2023-09-30T22:19:19.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.511+0000 7f6ec77fe700 1 --2- 172.21.15.156:0/3949644313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ec809d860 0x7f6ec811e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:19.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.511+0000 7f6ec6ffd700 1 --2- 172.21.15.156:0/3949644313 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ec809e170 0x7f6ec811eb20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc00c4a0 tx=0x7f6ebc00c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:19.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.511+0000 7f6eaffff700 1 -- 172.21.15.156:0/3949644313 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc011790 con 0x7f6ec809e170 2023-09-30T22:19:19.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.511+0000 7f6eaffff700 1 -- 172.21.15.156:0/3949644313 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ebc0118f0 con 0x7f6ec809e170 2023-09-30T22:19:19.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.511+0000 7f6eaffff700 1 -- 172.21.15.156:0/3949644313 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc011ca0 con 0x7f6ec809e170 2023-09-30T22:19:19.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.511+0000 7f6ecddcb700 1 -- 172.21.15.156:0/3949644313 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec80a1e90 con 0x7f6ec809e170 2023-09-30T22:19:19.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.511+0000 7f6ecddcb700 1 -- 172.21.15.156:0/3949644313 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec8122890 con 0x7f6ec809e170 2023-09-30T22:19:19.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.512+0000 7f6eaffff700 1 -- 172.21.15.156:0/3949644313 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6ebc01c460 con 0x7f6ec809e170 2023-09-30T22:19:19.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.512+0000 7f6ecddcb700 1 -- 172.21.15.156:0/3949644313 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec8130590 con 0x7f6ec809e170 2023-09-30T22:19:19.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.512+0000 7f6ec77fe700 1 -- 172.21.15.156:0/3949644313 >> v1:172.21.15.156:6816/126965 conn(0x7f6eb402f510 legacy=0x7f6eb40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:19.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.512+0000 7f6eaffff700 1 -- 172.21.15.156:0/3949644313 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f6ebc03f910 con 0x7f6ec809e170 2023-09-30T22:19:19.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.516+0000 7f6eaffff700 1 -- 172.21.15.156:0/3949644313 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ebc0108d0 con 0x7f6ec809e170 2023-09-30T22:19:19.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.624+0000 7f0229b22700 1 -- 172.21.15.156:0/2214467357 >> v1:172.21.15.156:6816/126965 conn(0x7f020802f510 legacy=0x7f02080319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:19.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.640+0000 7f022bd86700 1 -- 172.21.15.156:0/2214467357 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f022404f2a0 con 0x7f02241393a0 2023-09-30T22:19:19.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.640+0000 7f021a7fc700 1 -- 172.21.15.156:0/2214467357 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f021c026bd0 con 0x7f02241393a0 2023-09-30T22:19:19.640 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:19.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.642+0000 7f022bd86700 1 -- 172.21.15.156:0/2214467357 >> v1:172.21.15.156:6816/126965 conn(0x7f020802f510 legacy=0x7f02080319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:19.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.642+0000 7f022bd86700 1 -- 172.21.15.156:0/2214467357 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02241393a0 msgr2=0x7f022411f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.642+0000 7f022bd86700 1 --2- 172.21.15.156:0/2214467357 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02241393a0 0x7f022411f550 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f021c016000 tx=0x7f021c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.642+0000 7f022bd86700 1 -- 172.21.15.156:0/2214467357 shutdown_connections 2023-09-30T22:19:19.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.642+0000 7f022bd86700 1 --2- 172.21.15.156:0/2214467357 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02241393a0 0x7f022411f550 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.642+0000 7f022bd86700 1 --2- 172.21.15.156:0/2214467357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f022409e870 0x7f022411ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.642+0000 7f022bd86700 1 --2- 172.21.15.156:0/2214467357 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f022409f350 0x7f022411f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.642+0000 7f022bd86700 1 -- 172.21.15.156:0/2214467357 >> 172.21.15.156:0/2214467357 conn(0x7f02240a4430 msgr2=0x7f02240a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:19.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.642+0000 7f022bd86700 1 -- 172.21.15.156:0/2214467357 shutdown_connections 2023-09-30T22:19:19.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.642+0000 7f022bd86700 1 -- 172.21.15.156:0/2214467357 wait complete. 2023-09-30T22:19:19.654 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:19.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.675+0000 7ff1a2240700 1 -- 172.21.15.156:0/3878092427 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff19c04f2a0 con 0x7ff19c1300a0 2023-09-30T22:19:19.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.676+0000 7ff183fff700 1 -- 172.21.15.156:0/3878092427 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff18c015020 con 0x7ff19c1300a0 2023-09-30T22:19:19.676 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:19.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.677+0000 7ff19affd700 1 -- 172.21.15.156:0/3878092427 >> v1:172.21.15.156:6816/126965 conn(0x7ff18802f540 legacy=0x7ff1880319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:19.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.678+0000 7ff1a2240700 1 -- 172.21.15.156:0/3878092427 >> v1:172.21.15.156:6816/126965 conn(0x7ff18802f540 legacy=0x7ff1880319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:19.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.678+0000 7ff1a2240700 1 -- 172.21.15.156:0/3878092427 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff19c1300a0 msgr2=0x7ff19c11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.678+0000 7ff1a2240700 1 --2- 172.21.15.156:0/3878092427 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff19c1300a0 0x7ff19c11da40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff18c016000 tx=0x7ff18c004750 comp rx=0 tx=0).stop 2023-09-30T22:19:19.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.678+0000 7ff1a2240700 1 -- 172.21.15.156:0/3878092427 shutdown_connections 2023-09-30T22:19:19.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.678+0000 7ff1a2240700 1 --2- 172.21.15.156:0/3878092427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff19c133ad0 0x7ff19c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.678+0000 7ff1a2240700 1 --2- 172.21.15.156:0/3878092427 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff19c1300a0 0x7ff19c11da40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.678+0000 7ff1a2240700 1 --2- 172.21.15.156:0/3878092427 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff19c1309f0 0x7ff19c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.678+0000 7ff1a2240700 1 -- 172.21.15.156:0/3878092427 >> 172.21.15.156:0/3878092427 conn(0x7ff19c099c40 msgr2=0x7ff19c12e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:19.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.678+0000 7ff1a2240700 1 -- 172.21.15.156:0/3878092427 shutdown_connections 2023-09-30T22:19:19.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.678+0000 7ff1a2240700 1 -- 172.21.15.156:0/3878092427 wait complete. 2023-09-30T22:19:19.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:19.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.711+0000 7f6ecddcb700 1 -- 172.21.15.156:0/3949644313 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6ec804f2a0 con 0x7f6ec809e170 2023-09-30T22:19:19.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.711+0000 7f6eaffff700 1 -- 172.21.15.156:0/3949644313 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ebc01a360 con 0x7f6ec809e170 2023-09-30T22:19:19.711 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:19.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.713+0000 7f6ec77fe700 1 -- 172.21.15.156:0/3949644313 >> v1:172.21.15.156:6816/126965 conn(0x7f6eb402f510 legacy=0x7f6eb40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:19.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.714+0000 7f6ecddcb700 1 -- 172.21.15.156:0/3949644313 >> v1:172.21.15.156:6816/126965 conn(0x7f6eb402f510 legacy=0x7f6eb40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:19.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.714+0000 7f6ecddcb700 1 -- 172.21.15.156:0/3949644313 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ec809e170 msgr2=0x7f6ec811eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.714+0000 7f6ecddcb700 1 --2- 172.21.15.156:0/3949644313 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ec809e170 0x7f6ec811eb20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc00c4a0 tx=0x7f6ebc00c7b0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.714+0000 7f6ecddcb700 1 -- 172.21.15.156:0/3949644313 shutdown_connections 2023-09-30T22:19:19.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.714+0000 7f6ecddcb700 1 --2- 172.21.15.156:0/3949644313 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ec8130eb0 0x7f6ec811f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.714+0000 7f6ecddcb700 1 --2- 172.21.15.156:0/3949644313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ec809d860 0x7f6ec811e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.714+0000 7f6ecddcb700 1 --2- 172.21.15.156:0/3949644313 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ec809e170 0x7f6ec811eb20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:19.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.714+0000 7f6ecddcb700 1 -- 172.21.15.156:0/3949644313 >> 172.21.15.156:0/3949644313 conn(0x7f6ec8099c40 msgr2=0x7f6ec80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:19.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.714+0000 7f6ecddcb700 1 -- 172.21.15.156:0/3949644313 shutdown_connections 2023-09-30T22:19:19.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:19.714+0000 7f6ecddcb700 1 -- 172.21.15.156:0/3949644313 wait complete. 2023-09-30T22:19:19.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:20.471 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:20.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.600+0000 7fb01ec8f700 1 Processor -- start 2023-09-30T22:19:20.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.600+0000 7fb01ec8f700 1 -- start start 2023-09-30T22:19:20.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.600+0000 7fb01ec8f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0181346e0 0x7fb018136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:20.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.600+0000 7fb01ec8f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb018137000 0x7fb0181393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:20.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.600+0000 7fb01ec8f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0180a1640 con 0x7fb018131980 2023-09-30T22:19:20.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.600+0000 7fb01ec8f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01806eb30 con 0x7fb0181346e0 2023-09-30T22:19:20.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.600+0000 7fb01ec8f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180a22d0 con 0x7fb018137000 2023-09-30T22:19:20.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.601+0000 7fb017fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0181346e0 0x7fb018136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:20.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.601+0000 7fb01ca2b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb018131980 0x7fb018131d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:36348/0 (socket says 172.21.15.156:36348) 2023-09-30T22:19:20.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.601+0000 7fb01ca2b700 1 -- 172.21.15.156:0/3517722488 learned_addr learned my addr 172.21.15.156:0/3517722488 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:20.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.601+0000 7fb01d22c700 1 --2- 172.21.15.156:0/3517722488 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb018137000 0x7fb0181393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:20.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.601+0000 7fb017fff700 1 -- 172.21.15.156:0/3517722488 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb018137000 msgr2=0x7fb0181393e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:20.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.601+0000 7fb017fff700 1 --2- 172.21.15.156:0/3517722488 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb018137000 0x7fb0181393e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:20.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.601+0000 7fb0177fe700 1 -- 172.21.15.156:0/3517722488 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87086251 0 0) 0x7fb0180a1640 con 0x7fb018131980 2023-09-30T22:19:20.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.601+0000 7fb017fff700 1 -- 172.21.15.156:0/3517722488 >> v1:172.21.15.156:6789/0 conn(0x7fb018131980 legacy=0x7fb018131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:20.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.601+0000 7fb017fff700 1 -- 172.21.15.156:0/3517722488 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb018131550 con 0x7fb0181346e0 2023-09-30T22:19:20.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.601+0000 7fb017fff700 1 --2- 172.21.15.156:0/3517722488 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0181346e0 0x7fb018136ac0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb004009870 tx=0x7fb004009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47cc098e29dfbd4a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:20.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.601+0000 7fb0177fe700 1 -- 172.21.15.156:0/3517722488 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb004011830 con 0x7fb0181346e0 2023-09-30T22:19:20.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.601+0000 7fb0177fe700 1 -- 172.21.15.156:0/3517722488 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb004011990 con 0x7fb0181346e0 2023-09-30T22:19:20.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.601+0000 7fb0177fe700 1 -- 172.21.15.156:0/3517722488 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb004011d20 con 0x7fb0181346e0 2023-09-30T22:19:20.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.602+0000 7fb01ec8f700 1 -- 172.21.15.156:0/3517722488 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0181346e0 msgr2=0x7fb018136ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:20.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.602+0000 7fb01ec8f700 1 --2- 172.21.15.156:0/3517722488 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0181346e0 0x7fb018136ac0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb004009870 tx=0x7fb004009b80 comp rx=0 tx=0).stop 2023-09-30T22:19:20.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.602+0000 7fb01ec8f700 1 -- 172.21.15.156:0/3517722488 shutdown_connections 2023-09-30T22:19:20.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.602+0000 7fb01ec8f700 1 --2- 172.21.15.156:0/3517722488 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb018137000 0x7fb0181393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:20.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.602+0000 7fb01ec8f700 1 --2- 172.21.15.156:0/3517722488 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0181346e0 0x7fb018136ac0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:20.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.602+0000 7fb01ec8f700 1 -- 172.21.15.156:0/3517722488 >> 172.21.15.156:0/3517722488 conn(0x7fb0180a2980 msgr2=0x7fb0180a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:20.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.602+0000 7fb01ec8f700 1 -- 172.21.15.156:0/3517722488 shutdown_connections 2023-09-30T22:19:20.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.602+0000 7fb01ec8f700 1 -- 172.21.15.156:0/3517722488 wait complete. 2023-09-30T22:19:20.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.603+0000 7fb01ec8f700 1 Processor -- start 2023-09-30T22:19:20.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.603+0000 7fb01ec8f700 1 -- start start 2023-09-30T22:19:20.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.603+0000 7fb01ec8f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb018131980 0x7fb018099a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:20.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.603+0000 7fb01ec8f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0181346e0 0x7fb018099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:20.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.603+0000 7fb01ec8f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb018137000 0x7fb01809a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:20.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.603+0000 7fb01ec8f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01811d200 con 0x7fb018131980 2023-09-30T22:19:20.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.603+0000 7fb01ec8f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01811d430 con 0x7fb0181346e0 2023-09-30T22:19:20.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.603+0000 7fb01ec8f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180a1c40 con 0x7fb018137000 2023-09-30T22:19:20.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.603+0000 7fb017fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0181346e0 0x7fb018099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:20.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.603+0000 7fb01d22c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb018137000 0x7fb01809a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:20.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.603+0000 7fb017fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0181346e0 0x7fb018099fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52964/0 (socket says 172.21.15.156:52964) 2023-09-30T22:19:20.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.603+0000 7fb017fff700 1 -- 172.21.15.156:0/1869792633 learned_addr learned my addr 172.21.15.156:0/1869792633 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:20.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.603+0000 7fb01ca2b700 1 --2- 172.21.15.156:0/1869792633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb018131980 0x7fb018099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:20.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.604+0000 7fb017fff700 1 -- 172.21.15.156:0/1869792633 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb018137000 msgr2=0x7fb01809a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:20.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.604+0000 7fb017fff700 1 --2- 172.21.15.156:0/1869792633 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb018137000 0x7fb01809a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:20.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.604+0000 7fb017fff700 1 -- 172.21.15.156:0/1869792633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb018131980 msgr2=0x7fb018099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:20.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.604+0000 7fb017fff700 1 --2- 172.21.15.156:0/1869792633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb018131980 0x7fb018099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:20.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.604+0000 7fb017fff700 1 -- 172.21.15.156:0/1869792633 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0040094a0 con 0x7fb0181346e0 2023-09-30T22:19:20.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.604+0000 7fb01d22c700 1 --2- 172.21.15.156:0/1869792633 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb018137000 0x7fb01809a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:20.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.604+0000 7fb017fff700 1 --2- 172.21.15.156:0/1869792633 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0181346e0 0x7fb018099fa0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb0040090b0 tx=0x7fb004004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:20.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.604+0000 7fb0157fa700 1 -- 172.21.15.156:0/1869792633 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb004004300 con 0x7fb0181346e0 2023-09-30T22:19:20.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.604+0000 7fb0157fa700 1 -- 172.21.15.156:0/1869792633 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00401f070 con 0x7fb0181346e0 2023-09-30T22:19:20.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.604+0000 7fb01ec8f700 1 -- 172.21.15.156:0/1869792633 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01811e540 con 0x7fb0181346e0 2023-09-30T22:19:20.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.604+0000 7fb0157fa700 1 -- 172.21.15.156:0/1869792633 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0040036a0 con 0x7fb0181346e0 2023-09-30T22:19:20.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.604+0000 7fb01ec8f700 1 -- 172.21.15.156:0/1869792633 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01811f1e0 con 0x7fb0181346e0 2023-09-30T22:19:20.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.605+0000 7fb0157fa700 1 -- 172.21.15.156:0/1869792633 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb004021030 con 0x7fb0181346e0 2023-09-30T22:19:20.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.605+0000 7fb0157fa700 1 -- 172.21.15.156:0/1869792633 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fb004040b60 con 0x7fb0181346e0 2023-09-30T22:19:20.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.605+0000 7fb01ca2b700 1 -- 172.21.15.156:0/1869792633 >> v1:172.21.15.156:6816/126965 conn(0x7faffc02f510 legacy=0x7faffc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:20.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.605+0000 7fb01ec8f700 1 -- 172.21.15.156:0/1869792633 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01804f2a0 con 0x7fb0181346e0 2023-09-30T22:19:20.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.609+0000 7fb0157fa700 1 -- 172.21.15.156:0/1869792633 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb004015080 con 0x7fb0181346e0 2023-09-30T22:19:20.655 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:20.691 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:20.726 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:20.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.785+0000 7f46fb780700 1 Processor -- start 2023-09-30T22:19:20.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.786+0000 7f46fb780700 1 -- start start 2023-09-30T22:19:20.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.786+0000 7f46fb780700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46f406a770 0x7f46f406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:20.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.786+0000 7f46fb780700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f46f4136cb0 0x7f46f4139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:20.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.786+0000 7f46fb780700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46f406e900 con 0x7f46f409dec0 2023-09-30T22:19:20.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.786+0000 7f46fb780700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f409d180 con 0x7f46f4136cb0 2023-09-30T22:19:20.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.786+0000 7f46fb780700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f409e780 con 0x7f46f406a770 2023-09-30T22:19:20.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.786+0000 7f46f951c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46f406a770 0x7f46f406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:20.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.787+0000 7f46f951c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46f406a770 0x7f46f406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52974/0 (socket says 172.21.15.156:52974) 2023-09-30T22:19:20.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.787+0000 7f46f951c700 1 -- 172.21.15.156:0/459218533 learned_addr learned my addr 172.21.15.156:0/459218533 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:20.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.787+0000 7f46f9d1d700 1 --2- 172.21.15.156:0/459218533 >> v2:172.21.15.156:3300/0 conn(0x7f46f4136cb0 0x7f46f4139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:20.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.787+0000 7f46f951c700 1 -- 172.21.15.156:0/459218533 >> v2:172.21.15.156:3300/0 conn(0x7f46f4136cb0 msgr2=0x7f46f4139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:20.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.787+0000 7f46f951c700 1 --2- 172.21.15.156:0/459218533 >> v2:172.21.15.156:3300/0 conn(0x7f46f4136cb0 0x7f46f4139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:20.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.787+0000 7f46f951c700 1 -- 172.21.15.156:0/459218533 >> v1:172.21.15.156:6789/0 conn(0x7f46f409dec0 legacy=0x7f46f406b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:20.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.787+0000 7f46f951c700 1 -- 172.21.15.156:0/459218533 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f409d3c0 con 0x7f46f406a770 2023-09-30T22:19:20.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.787+0000 7f46f951c700 1 --2- 172.21.15.156:0/459218533 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46f406a770 0x7f46f406ab40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f46f00098f0 tx=0x7f46f0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa96acdd0a06e20f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:20.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.787+0000 7f46ebfff700 1 -- 172.21.15.156:0/459218533 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f0011830 con 0x7f46f406a770 2023-09-30T22:19:20.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.787+0000 7f46ebfff700 1 -- 172.21.15.156:0/459218533 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f0011990 con 0x7f46f406a770 2023-09-30T22:19:20.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.787+0000 7f46ebfff700 1 -- 172.21.15.156:0/459218533 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f0011d20 con 0x7f46f406a770 2023-09-30T22:19:20.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.788+0000 7f46fb780700 1 -- 172.21.15.156:0/459218533 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46f406a770 msgr2=0x7f46f406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:20.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.788+0000 7f46fb780700 1 --2- 172.21.15.156:0/459218533 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46f406a770 0x7f46f406ab40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f46f00098f0 tx=0x7f46f0009c00 comp rx=0 tx=0).stop 2023-09-30T22:19:20.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.788+0000 7f46fb780700 1 -- 172.21.15.156:0/459218533 shutdown_connections 2023-09-30T22:19:20.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.788+0000 7f46fb780700 1 --2- 172.21.15.156:0/459218533 >> v2:172.21.15.156:3300/0 conn(0x7f46f4136cb0 0x7f46f4139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:20.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.788+0000 7f46fb780700 1 --2- 172.21.15.156:0/459218533 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46f406a770 0x7f46f406ab40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:20.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.788+0000 7f46fb780700 1 -- 172.21.15.156:0/459218533 >> 172.21.15.156:0/459218533 conn(0x7f46f4099c40 msgr2=0x7f46f40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:20.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.788+0000 7f46fb780700 1 -- 172.21.15.156:0/459218533 shutdown_connections 2023-09-30T22:19:20.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.788+0000 7f46fb780700 1 -- 172.21.15.156:0/459218533 wait complete. 2023-09-30T22:19:20.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.790+0000 7f46fb780700 1 Processor -- start 2023-09-30T22:19:20.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.790+0000 7f46fb780700 1 -- start start 2023-09-30T22:19:20.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.790+0000 7f46fb780700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46f406a770 0x7f46f41344c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:20.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.790+0000 7f46fb780700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46f409dec0 0x7f46f4134a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:20.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.791+0000 7f46fb780700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46f4136cb0 0x7f46f4134f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:20.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.791+0000 7f46fb780700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f4119c90 con 0x7f46f409dec0 2023-09-30T22:19:20.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.791+0000 7f46fb780700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f4139300 con 0x7f46f4136cb0 2023-09-30T22:19:20.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.791+0000 7f46fb780700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46f411a430 con 0x7f46f406a770 2023-09-30T22:19:20.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.791+0000 7f46f951c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46f406a770 0x7f46f41344c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:20.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.791+0000 7f46f951c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46f406a770 0x7f46f41344c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48498/0 (socket says 172.21.15.156:48498) 2023-09-30T22:19:20.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.791+0000 7f46f951c700 1 -- 172.21.15.156:0/1637512796 learned_addr learned my addr 172.21.15.156:0/1637512796 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:20.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.791+0000 7f46f8d1b700 1 --2- 172.21.15.156:0/1637512796 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46f409dec0 0x7f46f4134a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:20.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.791+0000 7f46f9d1d700 1 --2- 172.21.15.156:0/1637512796 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46f4136cb0 0x7f46f4134f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:20.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.791+0000 7f46f951c700 1 -- 172.21.15.156:0/1637512796 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46f4136cb0 msgr2=0x7f46f4134f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:20.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.791+0000 7f46f951c700 1 --2- 172.21.15.156:0/1637512796 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46f4136cb0 0x7f46f4134f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:20.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.791+0000 7f46f951c700 1 -- 172.21.15.156:0/1637512796 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46f409dec0 msgr2=0x7f46f4134a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:20.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.791+0000 7f46f951c700 1 --2- 172.21.15.156:0/1637512796 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46f409dec0 0x7f46f4134a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:20.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.791+0000 7f46f951c700 1 -- 172.21.15.156:0/1637512796 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f0009550 con 0x7f46f406a770 2023-09-30T22:19:20.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.791+0000 7f46f8d1b700 1 --2- 172.21.15.156:0/1637512796 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46f409dec0 0x7f46f4134a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:20.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.791+0000 7f46f951c700 1 --2- 172.21.15.156:0/1637512796 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46f406a770 0x7f46f41344c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f46f0000c00 tx=0x7f46f0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:20.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.792+0000 7f46e9ffb700 1 -- 172.21.15.156:0/1637512796 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f00036a0 con 0x7f46f406a770 2023-09-30T22:19:20.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.792+0000 7f46e9ffb700 1 -- 172.21.15.156:0/1637512796 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f0003800 con 0x7f46f406a770 2023-09-30T22:19:20.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.792+0000 7f46fb780700 1 -- 172.21.15.156:0/1637512796 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f411ad40 con 0x7f46f406a770 2023-09-30T22:19:20.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.792+0000 7f46e9ffb700 1 -- 172.21.15.156:0/1637512796 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f0003bb0 con 0x7f46f406a770 2023-09-30T22:19:20.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.792+0000 7f46fb780700 1 -- 172.21.15.156:0/1637512796 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f411a9c0 con 0x7f46f406a770 2023-09-30T22:19:20.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.793+0000 7f46e9ffb700 1 -- 172.21.15.156:0/1637512796 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f46f0021070 con 0x7f46f406a770 2023-09-30T22:19:20.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.793+0000 7f46fb780700 1 -- 172.21.15.156:0/1637512796 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46d40052e0 con 0x7f46f406a770 2023-09-30T22:19:20.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.793+0000 7f46f8d1b700 1 -- 172.21.15.156:0/1637512796 >> v1:172.21.15.156:6816/126965 conn(0x7f46d802f510 legacy=0x7f46d80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:20.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.793+0000 7f46e9ffb700 1 -- 172.21.15.156:0/1637512796 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f46f00410f0 con 0x7f46f406a770 2023-09-30T22:19:20.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.798+0000 7f46e9ffb700 1 -- 172.21.15.156:0/1637512796 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f46f002d3a0 con 0x7f46f406a770 2023-09-30T22:19:20.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.806+0000 7fb01ca2b700 1 -- 172.21.15.156:0/1869792633 >> v1:172.21.15.156:6816/126965 conn(0x7faffc02f510 legacy=0x7faffc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:20.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.809+0000 7fb01ec8f700 1 -- 172.21.15.156:0/1869792633 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb01811ea40 con 0x7fb0181346e0 2023-09-30T22:19:20.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.810+0000 7fb0157fa700 1 -- 172.21.15.156:0/1869792633 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb0040239c0 con 0x7fb0181346e0 2023-09-30T22:19:20.809 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:20.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.812+0000 7fb01ec8f700 1 -- 172.21.15.156:0/1869792633 >> v1:172.21.15.156:6816/126965 conn(0x7faffc02f510 legacy=0x7faffc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:20.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.812+0000 7fb01ec8f700 1 -- 172.21.15.156:0/1869792633 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0181346e0 msgr2=0x7fb018099fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:20.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.812+0000 7fb01ec8f700 1 --2- 172.21.15.156:0/1869792633 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0181346e0 0x7fb018099fa0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb0040090b0 tx=0x7fb004004750 comp rx=0 tx=0).stop 2023-09-30T22:19:20.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.812+0000 7fb01ec8f700 1 -- 172.21.15.156:0/1869792633 shutdown_connections 2023-09-30T22:19:20.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.812+0000 7fb01ec8f700 1 --2- 172.21.15.156:0/1869792633 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb018137000 0x7fb01809a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:20.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.812+0000 7fb01ec8f700 1 --2- 172.21.15.156:0/1869792633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb018131980 0x7fb018099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:20.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.812+0000 7fb01ec8f700 1 --2- 172.21.15.156:0/1869792633 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0181346e0 0x7fb018099fa0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:20.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.812+0000 7fb01ec8f700 1 -- 172.21.15.156:0/1869792633 >> 172.21.15.156:0/1869792633 conn(0x7fb0180a2980 msgr2=0x7fb018133560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:20.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.812+0000 7fb01ec8f700 1 -- 172.21.15.156:0/1869792633 shutdown_connections 2023-09-30T22:19:20.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.812+0000 7fb01ec8f700 1 -- 172.21.15.156:0/1869792633 wait complete. 2023-09-30T22:19:20.826 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:20.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.832+0000 7f5dc4c6a700 1 Processor -- start 2023-09-30T22:19:20.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.832+0000 7f5dc4c6a700 1 -- start start 2023-09-30T22:19:20.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.833+0000 7f5dc4c6a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5dc0131a80 0x7f5dc0131e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:20.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.833+0000 7f5dc4c6a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5dc009bc70 0x7f5dc009c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:20.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.833+0000 7f5dc4c6a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dc009c600 0x7f5dc0138770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:20.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.833+0000 7f5dc4c6a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc0131440 con 0x7f5dc0131a80 2023-09-30T22:19:20.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.833+0000 7f5dc4c6a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc00a23a0 con 0x7f5dc009c600 2023-09-30T22:19:20.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.833+0000 7f5dc4c6a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc0132390 con 0x7f5dc009bc70 2023-09-30T22:19:20.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.833+0000 7f5dbe59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5dc0131a80 0x7f5dc0131e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:20.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.833+0000 7f5dbe59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5dc0131a80 0x7f5dc0131e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40524/0 (socket says 172.21.15.156:40524) 2023-09-30T22:19:20.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.833+0000 7f5dbe59c700 1 -- 172.21.15.156:0/3073541881 learned_addr learned my addr 172.21.15.156:0/3073541881 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:20.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.833+0000 7f5dbed9d700 1 --2- 172.21.15.156:0/3073541881 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dc009c600 0x7f5dc0138770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:20.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.833+0000 7f5dbdd9b700 1 --2- 172.21.15.156:0/3073541881 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5dc009bc70 0x7f5dc009c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:20.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.834+0000 7f5dbed9d700 1 -- 172.21.15.156:0/3073541881 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5dc009bc70 msgr2=0x7f5dc009c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:20.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.834+0000 7f5dbed9d700 1 --2- 172.21.15.156:0/3073541881 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5dc009bc70 0x7f5dc009c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:20.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.834+0000 7f5dbed9d700 1 -- 172.21.15.156:0/3073541881 >> v2:172.21.15.156:3300/0 conn(0x7f5dc0131a80 msgr2=0x7f5dc0131e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:20.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.834+0000 7f5dbed9d700 1 --2- 172.21.15.156:0/3073541881 >> v2:172.21.15.156:3300/0 conn(0x7f5dc0131a80 0x7f5dc0131e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:20.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.834+0000 7f5dbed9d700 1 -- 172.21.15.156:0/3073541881 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc006eaa0 con 0x7f5dc009c600 2023-09-30T22:19:20.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.834+0000 7f5dbe59c700 1 --2- 172.21.15.156:0/3073541881 >> v2:172.21.15.156:3300/0 conn(0x7f5dc0131a80 0x7f5dc0131e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:20.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.834+0000 7f5dbed9d700 1 --2- 172.21.15.156:0/3073541881 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dc009c600 0x7f5dc0138770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5db8009d90 tx=0x7f5db800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7a5b44c012c5f3f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:20.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.834+0000 7f5dbd59a700 1 -- 172.21.15.156:0/3073541881 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db800e070 con 0x7f5dc009c600 2023-09-30T22:19:20.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.834+0000 7f5dbd59a700 1 -- 172.21.15.156:0/3073541881 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db800bac0 con 0x7f5dc009c600 2023-09-30T22:19:20.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.834+0000 7f5dbd59a700 1 -- 172.21.15.156:0/3073541881 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db800be70 con 0x7f5dc009c600 2023-09-30T22:19:20.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.835+0000 7f5dc4c6a700 1 -- 172.21.15.156:0/3073541881 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dc009c600 msgr2=0x7f5dc0138770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:20.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.835+0000 7f5dc4c6a700 1 --2- 172.21.15.156:0/3073541881 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dc009c600 0x7f5dc0138770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5db8009d90 tx=0x7f5db800b330 comp rx=0 tx=0).stop 2023-09-30T22:19:20.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.835+0000 7f5dc4c6a700 1 -- 172.21.15.156:0/3073541881 shutdown_connections 2023-09-30T22:19:20.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.835+0000 7f5dc4c6a700 1 --2- 172.21.15.156:0/3073541881 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dc009c600 0x7f5dc0138770 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:20.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.835+0000 7f5dc4c6a700 1 --2- 172.21.15.156:0/3073541881 >> v2:172.21.15.156:3300/0 conn(0x7f5dc0131a80 0x7f5dc0131e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:20.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.835+0000 7f5dc4c6a700 1 --2- 172.21.15.156:0/3073541881 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5dc009bc70 0x7f5dc009c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:20.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.835+0000 7f5dc4c6a700 1 -- 172.21.15.156:0/3073541881 >> 172.21.15.156:0/3073541881 conn(0x7f5dc00a2980 msgr2=0x7f5dc00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:20.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.835+0000 7f5dc4c6a700 1 -- 172.21.15.156:0/3073541881 shutdown_connections 2023-09-30T22:19:20.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.835+0000 7f5dc4c6a700 1 -- 172.21.15.156:0/3073541881 wait complete. 2023-09-30T22:19:20.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.836+0000 7f5dc4c6a700 1 Processor -- start 2023-09-30T22:19:20.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.836+0000 7f5dc4c6a700 1 -- start start 2023-09-30T22:19:20.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.836+0000 7f5dc4c6a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5dc009bc70 0x7f5dc0099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:20.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.836+0000 7f5dc4c6a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dc009c600 0x7f5dc0099fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:20.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.836+0000 7f5dc4c6a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5dc0131a80 0x7f5dc009a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:20.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.836+0000 7f5dc4c6a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc009b6b0 con 0x7f5dc009bc70 2023-09-30T22:19:20.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.836+0000 7f5dc4c6a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc0121040 con 0x7f5dc009c600 2023-09-30T22:19:20.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.836+0000 7f5dc4c6a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc0130b40 con 0x7f5dc0131a80 2023-09-30T22:19:20.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.836+0000 7f5dbe59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5dc009bc70 0x7f5dc0099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:20.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.836+0000 7f5dbe59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5dc009bc70 0x7f5dc0099a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40526/0 (socket says 172.21.15.156:40526) 2023-09-30T22:19:20.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.836+0000 7f5dbe59c700 1 -- 172.21.15.156:0/4163656491 learned_addr learned my addr 172.21.15.156:0/4163656491 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:20.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.836+0000 7f5dbdd9b700 1 --2- 172.21.15.156:0/4163656491 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dc009c600 0x7f5dc0099fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:20.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.837+0000 7f5dbed9d700 1 --2- 172.21.15.156:0/4163656491 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5dc0131a80 0x7f5dc009a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:20.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.837+0000 7f5dbdd9b700 1 -- 172.21.15.156:0/4163656491 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5dc0131a80 msgr2=0x7f5dc009a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:20.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.837+0000 7f5dbdd9b700 1 --2- 172.21.15.156:0/4163656491 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5dc0131a80 0x7f5dc009a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:20.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.837+0000 7f5dbdd9b700 1 -- 172.21.15.156:0/4163656491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5dc009bc70 msgr2=0x7f5dc0099a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:20.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.837+0000 7f5dbdd9b700 1 --2- 172.21.15.156:0/4163656491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5dc009bc70 0x7f5dc0099a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:20.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.837+0000 7f5dbdd9b700 1 -- 172.21.15.156:0/4163656491 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db0009500 con 0x7f5dc009c600 2023-09-30T22:19:20.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.837+0000 7f5dbe59c700 1 --2- 172.21.15.156:0/4163656491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5dc009bc70 0x7f5dc0099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:20.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.837+0000 7f5dbdd9b700 1 --2- 172.21.15.156:0/4163656491 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dc009c600 0x7f5dc0099fd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5db400e900 tx=0x7f5db400ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:20.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.837+0000 7f5daeffd700 1 -- 172.21.15.156:0/4163656491 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db4013680 con 0x7f5dc009c600 2023-09-30T22:19:20.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.837+0000 7f5daeffd700 1 -- 172.21.15.156:0/4163656491 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db40137e0 con 0x7f5dc009c600 2023-09-30T22:19:20.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.837+0000 7f5daeffd700 1 -- 172.21.15.156:0/4163656491 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db4013b50 con 0x7f5dc009c600 2023-09-30T22:19:20.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.837+0000 7f5dc4c6a700 1 -- 172.21.15.156:0/4163656491 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db8009a70 con 0x7f5dc009c600 2023-09-30T22:19:20.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.837+0000 7f5dc4c6a700 1 -- 172.21.15.156:0/4163656491 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc0120d80 con 0x7f5dc009c600 2023-09-30T22:19:20.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.838+0000 7f5daeffd700 1 -- 172.21.15.156:0/4163656491 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5db4013cb0 con 0x7f5dc009c600 2023-09-30T22:19:20.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.838+0000 7f5dbe59c700 1 -- 172.21.15.156:0/4163656491 >> v1:172.21.15.156:6816/126965 conn(0x7f5da002f510 legacy=0x7f5da00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:20.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.838+0000 7f5daeffd700 1 -- 172.21.15.156:0/4163656491 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f5db403fba0 con 0x7f5dc009c600 2023-09-30T22:19:20.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.838+0000 7f5dc4c6a700 1 -- 172.21.15.156:0/4163656491 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc004f2a0 con 0x7f5dc009c600 2023-09-30T22:19:20.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.847+0000 7f5daeffd700 1 -- 172.21.15.156:0/4163656491 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5db401be10 con 0x7f5dc009c600 2023-09-30T22:19:20.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.881+0000 7fdb3ba7c700 1 Processor -- start 2023-09-30T22:19:20.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.881+0000 7fdb3ba7c700 1 -- start start 2023-09-30T22:19:20.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.881+0000 7fdb3ba7c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb340a1550 0x7fdb34138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:20.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.881+0000 7fdb3ba7c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdb34139200 0x7fdb3413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:20.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.882+0000 7fdb3ba7c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb3409e9d0 con 0x7fdb340a0a70 2023-09-30T22:19:20.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.882+0000 7fdb3ba7c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb3409dc00 con 0x7fdb34139200 2023-09-30T22:19:20.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.882+0000 7fdb3ba7c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3409dec0 con 0x7fdb340a1550 2023-09-30T22:19:20.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.882+0000 7fdb39017700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb340a1550 0x7fdb34138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:20.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.882+0000 7fdb3a019700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdb34139200 0x7fdb3413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:20.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.882+0000 7fdb39017700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb340a1550 0x7fdb34138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53014/0 (socket says 172.21.15.156:53014) 2023-09-30T22:19:20.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.882+0000 7fdb39017700 1 -- 172.21.15.156:0/2701451770 learned_addr learned my addr 172.21.15.156:0/2701451770 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:20.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.882+0000 7fdb3a019700 1 -- 172.21.15.156:0/2701451770 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb340a1550 msgr2=0x7fdb34138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:20.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.882+0000 7fdb3a019700 1 --2- 172.21.15.156:0/2701451770 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb340a1550 0x7fdb34138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:20.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.882+0000 7fdb3a019700 1 -- 172.21.15.156:0/2701451770 >> v1:172.21.15.156:6789/0 conn(0x7fdb340a0a70 legacy=0x7fdb340a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:20.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.882+0000 7fdb3a019700 1 -- 172.21.15.156:0/2701451770 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3409e6a0 con 0x7fdb34139200 2023-09-30T22:19:20.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.882+0000 7fdb39017700 1 --2- 172.21.15.156:0/2701451770 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb340a1550 0x7fdb34138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:20.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.882+0000 7fdb3a019700 1 --2- 172.21.15.156:0/2701451770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb34139200 0x7fdb3413b5e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c009d90 tx=0x7fdb2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45aa6d5a593c055 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:20.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.882+0000 7fdb38816700 1 -- 172.21.15.156:0/2701451770 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c00e070 con 0x7fdb34139200 2023-09-30T22:19:20.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.882+0000 7fdb38816700 1 -- 172.21.15.156:0/2701451770 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c00bb20 con 0x7fdb34139200 2023-09-30T22:19:20.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.882+0000 7fdb38816700 1 -- 172.21.15.156:0/2701451770 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c012430 con 0x7fdb34139200 2023-09-30T22:19:20.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.883+0000 7fdb3ba7c700 1 -- 172.21.15.156:0/2701451770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb34139200 msgr2=0x7fdb3413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:20.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.883+0000 7fdb3ba7c700 1 --2- 172.21.15.156:0/2701451770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb34139200 0x7fdb3413b5e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c009d90 tx=0x7fdb2c00b330 comp rx=0 tx=0).stop 2023-09-30T22:19:20.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.883+0000 7fdb3ba7c700 1 -- 172.21.15.156:0/2701451770 shutdown_connections 2023-09-30T22:19:20.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.883+0000 7fdb3ba7c700 1 --2- 172.21.15.156:0/2701451770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb34139200 0x7fdb3413b5e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:20.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.883+0000 7fdb3ba7c700 1 --2- 172.21.15.156:0/2701451770 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb340a1550 0x7fdb34138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:20.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.883+0000 7fdb3ba7c700 1 -- 172.21.15.156:0/2701451770 >> 172.21.15.156:0/2701451770 conn(0x7fdb340a6610 msgr2=0x7fdb340a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:20.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.883+0000 7fdb3ba7c700 1 -- 172.21.15.156:0/2701451770 shutdown_connections 2023-09-30T22:19:20.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.883+0000 7fdb3ba7c700 1 -- 172.21.15.156:0/2701451770 wait complete. 2023-09-30T22:19:20.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.884+0000 7fdb3ba7c700 1 Processor -- start 2023-09-30T22:19:20.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.884+0000 7fdb3ba7c700 1 -- start start 2023-09-30T22:19:20.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.884+0000 7fdb3ba7c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb340a0a70 0x7fdb3411e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:20.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.884+0000 7fdb3ba7c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb340a1550 0x7fdb3411ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:20.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.884+0000 7fdb3ba7c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb34139200 0x7fdb3411f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:20.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.884+0000 7fdb3ba7c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb34122290 con 0x7fdb340a1550 2023-09-30T22:19:20.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.884+0000 7fdb3ba7c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb34121a40 con 0x7fdb34139200 2023-09-30T22:19:20.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.884+0000 7fdb3ba7c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb340a5100 con 0x7fdb340a0a70 2023-09-30T22:19:20.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.884+0000 7fdb39017700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb340a1550 0x7fdb3411ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:20.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.885+0000 7fdb39017700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb340a1550 0x7fdb3411ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40538/0 (socket says 172.21.15.156:40538) 2023-09-30T22:19:20.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.885+0000 7fdb39017700 1 -- 172.21.15.156:0/3813835490 learned_addr learned my addr 172.21.15.156:0/3813835490 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:20.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.885+0000 7fdb3a019700 1 --2- 172.21.15.156:0/3813835490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb34139200 0x7fdb3411f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:20.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.885+0000 7fdb39818700 1 --2- 172.21.15.156:0/3813835490 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb340a0a70 0x7fdb3411e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:20.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.885+0000 7fdb39017700 1 -- 172.21.15.156:0/3813835490 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb340a0a70 msgr2=0x7fdb3411e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:20.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.885+0000 7fdb39017700 1 --2- 172.21.15.156:0/3813835490 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb340a0a70 0x7fdb3411e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:20.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.885+0000 7fdb39017700 1 -- 172.21.15.156:0/3813835490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb34139200 msgr2=0x7fdb3411f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:20.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.885+0000 7fdb39017700 1 --2- 172.21.15.156:0/3813835490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb34139200 0x7fdb3411f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:20.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.885+0000 7fdb39017700 1 -- 172.21.15.156:0/3813835490 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb24009550 con 0x7fdb340a1550 2023-09-30T22:19:20.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.885+0000 7fdb39017700 1 --2- 172.21.15.156:0/3813835490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb340a1550 0x7fdb3411ed00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdb2400ebe0 tx=0x7fdb2400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:20.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.885+0000 7fdb2a7fc700 1 -- 172.21.15.156:0/3813835490 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2400c850 con 0x7fdb340a1550 2023-09-30T22:19:20.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.885+0000 7fdb2a7fc700 1 -- 172.21.15.156:0/3813835490 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2400c9b0 con 0x7fdb340a1550 2023-09-30T22:19:20.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.885+0000 7fdb3ba7c700 1 -- 172.21.15.156:0/3813835490 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb2c009a70 con 0x7fdb340a1550 2023-09-30T22:19:20.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.885+0000 7fdb2a7fc700 1 -- 172.21.15.156:0/3813835490 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2400cd20 con 0x7fdb340a1550 2023-09-30T22:19:20.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.885+0000 7fdb3ba7c700 1 -- 172.21.15.156:0/3813835490 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb340a03e0 con 0x7fdb340a1550 2023-09-30T22:19:20.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.886+0000 7fdb2a7fc700 1 -- 172.21.15.156:0/3813835490 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fdb24013470 con 0x7fdb340a1550 2023-09-30T22:19:20.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.886+0000 7fdb2a7fc700 1 -- 172.21.15.156:0/3813835490 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fdb2403fd60 con 0x7fdb340a1550 2023-09-30T22:19:20.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.886+0000 7fdb39818700 1 -- 172.21.15.156:0/3813835490 >> v1:172.21.15.156:6816/126965 conn(0x7fdb1802f540 legacy=0x7fdb180319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:20.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.886+0000 7fdb3ba7c700 1 -- 172.21.15.156:0/3813835490 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb3404f2a0 con 0x7fdb340a1550 2023-09-30T22:19:20.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.891+0000 7fdb2a7fc700 1 -- 172.21.15.156:0/3813835490 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb240232f0 con 0x7fdb340a1550 2023-09-30T22:19:20.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:20.994+0000 7f46f8d1b700 1 -- 172.21.15.156:0/1637512796 >> v1:172.21.15.156:6816/126965 conn(0x7f46d802f510 legacy=0x7f46d80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:21.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.001+0000 7f46fb780700 1 -- 172.21.15.156:0/1637512796 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f46d4005150 con 0x7f46f406a770 2023-09-30T22:19:21.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.002+0000 7f46e9ffb700 1 -- 172.21.15.156:0/1637512796 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f46f0019ba0 con 0x7f46f406a770 2023-09-30T22:19:21.001 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:21.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.004+0000 7f46fb780700 1 -- 172.21.15.156:0/1637512796 >> v1:172.21.15.156:6816/126965 conn(0x7f46d802f510 legacy=0x7f46d80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:21.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.004+0000 7f46fb780700 1 -- 172.21.15.156:0/1637512796 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46f406a770 msgr2=0x7f46f41344c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:21.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.004+0000 7f46fb780700 1 --2- 172.21.15.156:0/1637512796 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46f406a770 0x7f46f41344c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f46f0000c00 tx=0x7f46f0004750 comp rx=0 tx=0).stop 2023-09-30T22:19:21.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.004+0000 7f46fb780700 1 -- 172.21.15.156:0/1637512796 shutdown_connections 2023-09-30T22:19:21.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.004+0000 7f46fb780700 1 --2- 172.21.15.156:0/1637512796 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46f4136cb0 0x7f46f4134f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:21.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.004+0000 7f46fb780700 1 --2- 172.21.15.156:0/1637512796 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46f406a770 0x7f46f41344c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:21.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.004+0000 7f46fb780700 1 --2- 172.21.15.156:0/1637512796 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46f409dec0 0x7f46f4134a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:21.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.004+0000 7f46fb780700 1 -- 172.21.15.156:0/1637512796 >> 172.21.15.156:0/1637512796 conn(0x7f46f4099c40 msgr2=0x7f46f4070aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:21.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.004+0000 7f46fb780700 1 -- 172.21.15.156:0/1637512796 shutdown_connections 2023-09-30T22:19:21.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.004+0000 7f46fb780700 1 -- 172.21.15.156:0/1637512796 wait complete. 2023-09-30T22:19:21.016 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:21.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.039+0000 7f5dbe59c700 1 -- 172.21.15.156:0/4163656491 >> v1:172.21.15.156:6816/126965 conn(0x7f5da002f510 legacy=0x7f5da00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:21.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.046+0000 7f5dc4c6a700 1 -- 172.21.15.156:0/4163656491 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5dc006bce0 con 0x7f5dc009c600 2023-09-30T22:19:21.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.046+0000 7f5daeffd700 1 -- 172.21.15.156:0/4163656491 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5db401b3b0 con 0x7f5dc009c600 2023-09-30T22:19:21.046 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:21.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.048+0000 7f5dc4c6a700 1 -- 172.21.15.156:0/4163656491 >> v1:172.21.15.156:6816/126965 conn(0x7f5da002f510 legacy=0x7f5da00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:21.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.048+0000 7f5dc4c6a700 1 -- 172.21.15.156:0/4163656491 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dc009c600 msgr2=0x7f5dc0099fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:21.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.048+0000 7f5dc4c6a700 1 --2- 172.21.15.156:0/4163656491 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dc009c600 0x7f5dc0099fd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5db400e900 tx=0x7f5db400ec10 comp rx=0 tx=0).stop 2023-09-30T22:19:21.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.048+0000 7f5dc4c6a700 1 -- 172.21.15.156:0/4163656491 shutdown_connections 2023-09-30T22:19:21.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.048+0000 7f5dc4c6a700 1 --2- 172.21.15.156:0/4163656491 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5dc0131a80 0x7f5dc009a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:21.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.048+0000 7f5dc4c6a700 1 --2- 172.21.15.156:0/4163656491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5dc009bc70 0x7f5dc0099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:21.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.048+0000 7f5dc4c6a700 1 --2- 172.21.15.156:0/4163656491 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dc009c600 0x7f5dc0099fd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:21.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.048+0000 7f5dc4c6a700 1 -- 172.21.15.156:0/4163656491 >> 172.21.15.156:0/4163656491 conn(0x7f5dc00a2980 msgr2=0x7f5dc01b8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:21.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.048+0000 7f5dc4c6a700 1 -- 172.21.15.156:0/4163656491 shutdown_connections 2023-09-30T22:19:21.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.048+0000 7f5dc4c6a700 1 -- 172.21.15.156:0/4163656491 wait complete. 2023-09-30T22:19:21.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:21.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.087+0000 7fdb39818700 1 -- 172.21.15.156:0/3813835490 >> v1:172.21.15.156:6816/126965 conn(0x7fdb1802f540 legacy=0x7fdb180319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:21.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.087+0000 7fdb3ba7c700 1 -- 172.21.15.156:0/3813835490 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdb34072980 con 0x7fdb340a1550 2023-09-30T22:19:21.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.087+0000 7fdb2a7fc700 1 -- 172.21.15.156:0/3813835490 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb24017030 con 0x7fdb340a1550 2023-09-30T22:19:21.087 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:21.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.089+0000 7fdb3ba7c700 1 -- 172.21.15.156:0/3813835490 >> v1:172.21.15.156:6816/126965 conn(0x7fdb1802f540 legacy=0x7fdb180319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:21.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.089+0000 7fdb3ba7c700 1 -- 172.21.15.156:0/3813835490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb340a1550 msgr2=0x7fdb3411ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:21.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.089+0000 7fdb3ba7c700 1 --2- 172.21.15.156:0/3813835490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb340a1550 0x7fdb3411ed00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdb2400ebe0 tx=0x7fdb2400eef0 comp rx=0 tx=0).stop 2023-09-30T22:19:21.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.089+0000 7fdb3ba7c700 1 -- 172.21.15.156:0/3813835490 shutdown_connections 2023-09-30T22:19:21.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.089+0000 7fdb3ba7c700 1 --2- 172.21.15.156:0/3813835490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb34139200 0x7fdb3411f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:21.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.089+0000 7fdb3ba7c700 1 --2- 172.21.15.156:0/3813835490 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb340a0a70 0x7fdb3411e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:21.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.089+0000 7fdb3ba7c700 1 --2- 172.21.15.156:0/3813835490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb340a1550 0x7fdb3411ed00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:21.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.089+0000 7fdb3ba7c700 1 -- 172.21.15.156:0/3813835490 >> 172.21.15.156:0/3813835490 conn(0x7fdb340a6610 msgr2=0x7fdb340a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:21.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.089+0000 7fdb3ba7c700 1 -- 172.21.15.156:0/3813835490 shutdown_connections 2023-09-30T22:19:21.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.089+0000 7fdb3ba7c700 1 -- 172.21.15.156:0/3813835490 wait complete. 2023-09-30T22:19:21.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:21.827 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:21.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.953+0000 7f7ad6968700 1 Processor -- start 2023-09-30T22:19:21.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.953+0000 7f7ad6968700 1 -- start start 2023-09-30T22:19:21.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.953+0000 7f7ad6968700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7ad0133900 0x7f7ad0133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:21.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.953+0000 7f7ad6968700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ad0134210 0x7f7ad00a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:21.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.953+0000 7f7ad6968700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ad009a760 con 0x7f7ad00a0ee0 2023-09-30T22:19:21.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.953+0000 7f7ad6968700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad01336e0 con 0x7f7ad0133900 2023-09-30T22:19:21.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.953+0000 7f7ad6968700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad009a080 con 0x7f7ad0134210 2023-09-30T22:19:21.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.954+0000 7f7acffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7ad0133900 0x7f7ad0133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:21.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.954+0000 7f7acf7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ad0134210 0x7f7ad00a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:21.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.954+0000 7f7acffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7ad0133900 0x7f7ad0133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54906/0 (socket says 172.21.15.156:54906) 2023-09-30T22:19:21.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.954+0000 7f7acf7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ad0134210 0x7f7ad00a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37782/0 (socket says 172.21.15.156:37782) 2023-09-30T22:19:21.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.954+0000 7f7acffff700 1 -- 172.21.15.156:0/3759545899 learned_addr learned my addr 172.21.15.156:0/3759545899 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:21.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.954+0000 7f7acf7fe700 1 -- 172.21.15.156:0/3759545899 >> v2:172.21.15.156:3300/0 conn(0x7f7ad0133900 msgr2=0x7f7ad0133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:21.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.954+0000 7f7acf7fe700 1 --2- 172.21.15.156:0/3759545899 >> v2:172.21.15.156:3300/0 conn(0x7f7ad0133900 0x7f7ad0133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:21.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.954+0000 7f7acf7fe700 1 -- 172.21.15.156:0/3759545899 >> v1:172.21.15.156:6789/0 conn(0x7f7ad00a0ee0 legacy=0x7f7ad013a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:21.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.954+0000 7f7acf7fe700 1 -- 172.21.15.156:0/3759545899 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad00a23e0 con 0x7f7ad0134210 2023-09-30T22:19:21.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.954+0000 7f7acffff700 1 --2- 172.21.15.156:0/3759545899 >> v2:172.21.15.156:3300/0 conn(0x7f7ad0133900 0x7f7ad0133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:21.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.954+0000 7f7acf7fe700 1 --2- 172.21.15.156:0/3759545899 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ad0134210 0x7f7ad00a09a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0009840 tx=0x7f7ac0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e91b91b67d9fc0d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:21.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.954+0000 7f7aceffd700 1 -- 172.21.15.156:0/3759545899 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac0011830 con 0x7f7ad0134210 2023-09-30T22:19:21.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.954+0000 7f7aceffd700 1 -- 172.21.15.156:0/3759545899 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac0011990 con 0x7f7ad0134210 2023-09-30T22:19:21.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.954+0000 7f7aceffd700 1 -- 172.21.15.156:0/3759545899 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac0011d20 con 0x7f7ad0134210 2023-09-30T22:19:21.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.955+0000 7f7ad6968700 1 -- 172.21.15.156:0/3759545899 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ad0134210 msgr2=0x7f7ad00a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:21.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.955+0000 7f7ad6968700 1 --2- 172.21.15.156:0/3759545899 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ad0134210 0x7f7ad00a09a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0009840 tx=0x7f7ac0009b50 comp rx=0 tx=0).stop 2023-09-30T22:19:21.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.955+0000 7f7ad6968700 1 -- 172.21.15.156:0/3759545899 shutdown_connections 2023-09-30T22:19:21.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.955+0000 7f7ad6968700 1 --2- 172.21.15.156:0/3759545899 >> v2:172.21.15.156:3300/0 conn(0x7f7ad0133900 0x7f7ad0133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:21.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.955+0000 7f7ad6968700 1 --2- 172.21.15.156:0/3759545899 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ad0134210 0x7f7ad00a09a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:21.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.955+0000 7f7ad6968700 1 -- 172.21.15.156:0/3759545899 >> 172.21.15.156:0/3759545899 conn(0x7f7ad00a2980 msgr2=0x7f7ad00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:21.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.955+0000 7f7ad6968700 1 -- 172.21.15.156:0/3759545899 shutdown_connections 2023-09-30T22:19:21.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.955+0000 7f7ad6968700 1 -- 172.21.15.156:0/3759545899 wait complete. 2023-09-30T22:19:21.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.956+0000 7f7ad6968700 1 Processor -- start 2023-09-30T22:19:21.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.956+0000 7f7ad6968700 1 -- start start 2023-09-30T22:19:21.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.956+0000 7f7ad6968700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ad00a0ee0 0x7f7ad011d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:21.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.956+0000 7f7ad6968700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ad0133900 0x7f7ad011dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:21.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.956+0000 7f7ad6968700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7ad0134210 0x7f7ad011e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:21.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.956+0000 7f7ad6968700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad011ecb0 con 0x7f7ad0133900 2023-09-30T22:19:21.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.956+0000 7f7ad6968700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad0121300 con 0x7f7ad00a0ee0 2023-09-30T22:19:21.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.956+0000 7f7ad6968700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad011fa10 con 0x7f7ad0134210 2023-09-30T22:19:21.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.956+0000 7f7acffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ad00a0ee0 0x7f7ad011d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:21.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.956+0000 7f7acffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ad00a0ee0 0x7f7ad011d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37794/0 (socket says 172.21.15.156:37794) 2023-09-30T22:19:21.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.956+0000 7f7acffff700 1 -- 172.21.15.156:0/1738817956 learned_addr learned my addr 172.21.15.156:0/1738817956 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:21.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.956+0000 7f7acf7fe700 1 --2- 172.21.15.156:0/1738817956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ad0133900 0x7f7ad011dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:21.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.956+0000 7f7ad4f05700 1 --2- 172.21.15.156:0/1738817956 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7ad0134210 0x7f7ad011e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:21.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.957+0000 7f7acffff700 1 -- 172.21.15.156:0/1738817956 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7ad0134210 msgr2=0x7f7ad011e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:21.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.957+0000 7f7acffff700 1 --2- 172.21.15.156:0/1738817956 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7ad0134210 0x7f7ad011e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:21.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.957+0000 7f7acffff700 1 -- 172.21.15.156:0/1738817956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ad0133900 msgr2=0x7f7ad011dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:21.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.957+0000 7f7acffff700 1 --2- 172.21.15.156:0/1738817956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ad0133900 0x7f7ad011dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:21.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.957+0000 7f7acffff700 1 -- 172.21.15.156:0/1738817956 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab8009500 con 0x7f7ad00a0ee0 2023-09-30T22:19:21.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.957+0000 7f7acf7fe700 1 --2- 172.21.15.156:0/1738817956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ad0133900 0x7f7ad011dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:21.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.957+0000 7f7acffff700 1 --2- 172.21.15.156:0/1738817956 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ad00a0ee0 0x7f7ad011d7e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800ebb0 tx=0x7f7ab800eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:21.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.957+0000 7f7accff9700 1 -- 172.21.15.156:0/1738817956 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8005a20 con 0x7f7ad00a0ee0 2023-09-30T22:19:21.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.957+0000 7f7accff9700 1 -- 172.21.15.156:0/1738817956 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab8005b80 con 0x7f7ad00a0ee0 2023-09-30T22:19:21.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.957+0000 7f7ad6968700 1 -- 172.21.15.156:0/1738817956 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac00094a0 con 0x7f7ad00a0ee0 2023-09-30T22:19:21.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.957+0000 7f7accff9700 1 -- 172.21.15.156:0/1738817956 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab800c850 con 0x7f7ad00a0ee0 2023-09-30T22:19:21.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.957+0000 7f7ad6968700 1 -- 172.21.15.156:0/1738817956 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad0132eb0 con 0x7f7ad00a0ee0 2023-09-30T22:19:21.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.958+0000 7f7accff9700 1 -- 172.21.15.156:0/1738817956 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7ab800c9b0 con 0x7f7ad00a0ee0 2023-09-30T22:19:21.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.958+0000 7f7accff9700 1 -- 172.21.15.156:0/1738817956 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f7ab803fe90 con 0x7f7ad00a0ee0 2023-09-30T22:19:21.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.958+0000 7f7acf7fe700 1 -- 172.21.15.156:0/1738817956 >> v1:172.21.15.156:6816/126965 conn(0x7f7ab002f510 legacy=0x7f7ab00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:21.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.958+0000 7f7ad6968700 1 -- 172.21.15.156:0/1738817956 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad011a590 con 0x7f7ad00a0ee0 2023-09-30T22:19:21.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:21.963+0000 7f7accff9700 1 -- 172.21.15.156:0/1738817956 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ab806b750 con 0x7f7ad00a0ee0 2023-09-30T22:19:22.016 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:22.061 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:22.102 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:22.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.148+0000 7f0ff8ecb700 1 Processor -- start 2023-09-30T22:19:22.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.148+0000 7f0ff8ecb700 1 -- start start 2023-09-30T22:19:22.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.149+0000 7f0ff8ecb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0ff4133900 0x7f0ff4133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:22.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.149+0000 7f0ff8ecb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0ff4134210 0x7f0ff40a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:22.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.149+0000 7f0ff8ecb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0ff40a0ee0 0x7f0ff40a1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:22.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.149+0000 7f0ff8ecb700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff409a760 con 0x7f0ff4134210 2023-09-30T22:19:22.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.149+0000 7f0ff8ecb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff41336e0 con 0x7f0ff40a0ee0 2023-09-30T22:19:22.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.149+0000 7f0ff8ecb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff409a080 con 0x7f0ff4133900 2023-09-30T22:19:22.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.149+0000 7f0ff1d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0ff4134210 0x7f0ff40a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:22.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.149+0000 7f0ff1d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0ff4134210 0x7f0ff40a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54928/0 (socket says 172.21.15.156:54928) 2023-09-30T22:19:22.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.149+0000 7f0ff1d9b700 1 -- 172.21.15.156:0/4021767090 learned_addr learned my addr 172.21.15.156:0/4021767090 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:22.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.149+0000 7f0ff259c700 1 --2- 172.21.15.156:0/4021767090 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0ff4133900 0x7f0ff4133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:22.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.149+0000 7f0ff2d9d700 1 --2- 172.21.15.156:0/4021767090 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0ff40a0ee0 0x7f0ff40a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:22.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.149+0000 7f0ff1d9b700 1 -- 172.21.15.156:0/4021767090 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0ff4133900 msgr2=0x7f0ff4133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:22.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.149+0000 7f0ff1d9b700 1 --2- 172.21.15.156:0/4021767090 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0ff4133900 0x7f0ff4133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.149+0000 7f0ff1d9b700 1 -- 172.21.15.156:0/4021767090 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0ff40a0ee0 msgr2=0x7f0ff40a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:22.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.149+0000 7f0ff1d9b700 1 --2- 172.21.15.156:0/4021767090 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0ff40a0ee0 0x7f0ff40a1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.149+0000 7f0ff1d9b700 1 -- 172.21.15.156:0/4021767090 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff40a23e0 con 0x7f0ff4134210 2023-09-30T22:19:22.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.150+0000 7f0ff1d9b700 1 --2- 172.21.15.156:0/4021767090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ff4134210 0x7f0ff40a09a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0fe80098f0 tx=0x7f0fe8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42752c37ab80794f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:22.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.150+0000 7f0ff159a700 1 -- 172.21.15.156:0/4021767090 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe8011830 con 0x7f0ff4134210 2023-09-30T22:19:22.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.150+0000 7f0ff159a700 1 -- 172.21.15.156:0/4021767090 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe8011990 con 0x7f0ff4134210 2023-09-30T22:19:22.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.150+0000 7f0ff159a700 1 -- 172.21.15.156:0/4021767090 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe8011d20 con 0x7f0ff4134210 2023-09-30T22:19:22.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.151+0000 7f0ff8ecb700 1 -- 172.21.15.156:0/4021767090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ff4134210 msgr2=0x7f0ff40a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:22.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.151+0000 7f0ff8ecb700 1 --2- 172.21.15.156:0/4021767090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ff4134210 0x7f0ff40a09a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0fe80098f0 tx=0x7f0fe8009c00 comp rx=0 tx=0).stop 2023-09-30T22:19:22.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.151+0000 7f0ff8ecb700 1 -- 172.21.15.156:0/4021767090 shutdown_connections 2023-09-30T22:19:22.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.151+0000 7f0ff8ecb700 1 --2- 172.21.15.156:0/4021767090 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0ff40a0ee0 0x7f0ff40a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.151+0000 7f0ff8ecb700 1 --2- 172.21.15.156:0/4021767090 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0ff4133900 0x7f0ff4133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.151+0000 7f0ff8ecb700 1 --2- 172.21.15.156:0/4021767090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ff4134210 0x7f0ff40a09a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.151+0000 7f0ff8ecb700 1 -- 172.21.15.156:0/4021767090 >> 172.21.15.156:0/4021767090 conn(0x7f0ff40a2980 msgr2=0x7f0ff40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:22.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.151+0000 7f0ff8ecb700 1 -- 172.21.15.156:0/4021767090 shutdown_connections 2023-09-30T22:19:22.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.151+0000 7f0ff8ecb700 1 -- 172.21.15.156:0/4021767090 wait complete. 2023-09-30T22:19:22.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.153+0000 7f0ff8ecb700 1 Processor -- start 2023-09-30T22:19:22.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.153+0000 7f0ff8ecb700 1 -- start start 2023-09-30T22:19:22.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.153+0000 7f0ff8ecb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0ff40a0ee0 0x7f0ff411d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:22.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.153+0000 7f0ff8ecb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0ff4133900 0x7f0ff411dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:22.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.153+0000 7f0ff8ecb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ff4134210 0x7f0ff411e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:22.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.153+0000 7f0ff8ecb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff411f2d0 con 0x7f0ff4134210 2023-09-30T22:19:22.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.153+0000 7f0ff8ecb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff409a2c0 con 0x7f0ff40a0ee0 2023-09-30T22:19:22.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.153+0000 7f0ff8ecb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff4120f00 con 0x7f0ff4133900 2023-09-30T22:19:22.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.154+0000 7f0ff2d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ff4134210 0x7f0ff411e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:22.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.154+0000 7f0ff2d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ff4134210 0x7f0ff411e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54934/0 (socket says 172.21.15.156:54934) 2023-09-30T22:19:22.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.154+0000 7f0ff2d9d700 1 -- 172.21.15.156:0/1215508452 learned_addr learned my addr 172.21.15.156:0/1215508452 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:22.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.154+0000 7f0ff1d9b700 1 --2- 172.21.15.156:0/1215508452 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0ff4133900 0x7f0ff411dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:22.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.154+0000 7f0ff259c700 1 --2- 172.21.15.156:0/1215508452 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0ff40a0ee0 0x7f0ff411d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:22.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.154+0000 7f0ff2d9d700 1 -- 172.21.15.156:0/1215508452 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0ff4133900 msgr2=0x7f0ff411dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:22.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.154+0000 7f0ff2d9d700 1 --2- 172.21.15.156:0/1215508452 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0ff4133900 0x7f0ff411dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.154+0000 7f0ff2d9d700 1 -- 172.21.15.156:0/1215508452 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0ff40a0ee0 msgr2=0x7f0ff411d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:22.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.154+0000 7f0ff2d9d700 1 --2- 172.21.15.156:0/1215508452 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0ff40a0ee0 0x7f0ff411d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.154+0000 7f0ff2d9d700 1 -- 172.21.15.156:0/1215508452 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe8009550 con 0x7f0ff4134210 2023-09-30T22:19:22.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.154+0000 7f0ff2d9d700 1 --2- 172.21.15.156:0/1215508452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ff4134210 0x7f0ff411e1c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0fec00efc0 tx=0x7f0fec00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:22.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.154+0000 7f0fe2ffd700 1 -- 172.21.15.156:0/1215508452 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec009ea0 con 0x7f0ff4134210 2023-09-30T22:19:22.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.155+0000 7f0fe2ffd700 1 -- 172.21.15.156:0/1215508452 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fec00f040 con 0x7f0ff4134210 2023-09-30T22:19:22.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.155+0000 7f0ff8ecb700 1 -- 172.21.15.156:0/1215508452 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff4132cf0 con 0x7f0ff4134210 2023-09-30T22:19:22.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.155+0000 7f0fe2ffd700 1 -- 172.21.15.156:0/1215508452 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec00ced0 con 0x7f0ff4134210 2023-09-30T22:19:22.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.155+0000 7f0ff8ecb700 1 -- 172.21.15.156:0/1215508452 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff4120970 con 0x7f0ff4134210 2023-09-30T22:19:22.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.155+0000 7f0fe2ffd700 1 -- 172.21.15.156:0/1215508452 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0fec014480 con 0x7f0ff4134210 2023-09-30T22:19:22.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.155+0000 7f0fe2ffd700 1 -- 172.21.15.156:0/1215508452 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f0fec040440 con 0x7f0ff4134210 2023-09-30T22:19:22.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.156+0000 7f0ff259c700 1 -- 172.21.15.156:0/1215508452 >> v1:172.21.15.156:6816/126965 conn(0x7f0fd402f510 legacy=0x7f0fd40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:22.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.156+0000 7f0ff8ecb700 1 -- 172.21.15.156:0/1215508452 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff411a590 con 0x7f0ff4134210 2023-09-30T22:19:22.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.161+0000 7f0fe2ffd700 1 -- 172.21.15.156:0/1215508452 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0fec018020 con 0x7f0ff4134210 2023-09-30T22:19:22.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.170+0000 7f7ad6968700 1 -- 172.21.15.156:0/1738817956 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7ad0120cc0 con 0x7f7ad00a0ee0 2023-09-30T22:19:22.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.170+0000 7f7accff9700 1 -- 172.21.15.156:0/1738817956 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7ad0120cc0 con 0x7f7ad00a0ee0 2023-09-30T22:19:22.170 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:22.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.172+0000 7f7ad6968700 1 -- 172.21.15.156:0/1738817956 >> v1:172.21.15.156:6816/126965 conn(0x7f7ab002f510 legacy=0x7f7ab00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-30T22:19:22.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.172+0000 7f7ad6968700 1 -- 172.21.15.156:0/1738817956 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ad00a0ee0 msgr2=0x7f7ad011d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:22.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.172+0000 7f7ad6968700 1 --2- 172.21.15.156:0/1738817956 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ad00a0ee0 0x7f7ad011d7e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800ebb0 tx=0x7f7ab800eec0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.172+0000 7f7ad6968700 1 -- 172.21.15.156:0/1738817956 shutdown_connections 2023-09-30T22:19:22.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.172+0000 7f7ad6968700 1 --2- 172.21.15.156:0/1738817956 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7ad0134210 0x7f7ad011e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.172+0000 7f7ad6968700 1 --2- 172.21.15.156:0/1738817956 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ad00a0ee0 0x7f7ad011d7e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.172+0000 7f7ad6968700 1 --2- 172.21.15.156:0/1738817956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ad0133900 0x7f7ad011dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.172+0000 7f7ad6968700 1 -- 172.21.15.156:0/1738817956 >> 172.21.15.156:0/1738817956 conn(0x7f7ad00a2980 msgr2=0x7f7ad01bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:22.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.172+0000 7f7ad6968700 1 -- 172.21.15.156:0/1738817956 shutdown_connections 2023-09-30T22:19:22.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.172+0000 7f7ad6968700 1 -- 172.21.15.156:0/1738817956 wait complete. 2023-09-30T22:19:22.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:22.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.206+0000 7fad26174700 1 Processor -- start 2023-09-30T22:19:22.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.206+0000 7fad26174700 1 -- start start 2023-09-30T22:19:22.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.207+0000 7fad26174700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad2009d860 0x7fad2009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:22.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.207+0000 7fad26174700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fad2009e170 0x7fad201307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:22.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.207+0000 7fad26174700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad2009aaa0 con 0x7fad20130ce0 2023-09-30T22:19:22.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.207+0000 7fad26174700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad2009f870 con 0x7fad2009e170 2023-09-30T22:19:22.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.207+0000 7fad26174700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad2009b360 con 0x7fad2009d860 2023-09-30T22:19:22.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.207+0000 7fad1ffff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fad20130ce0 0x7fad201379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38316/0 (socket says 172.21.15.156:38316) 2023-09-30T22:19:22.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.207+0000 7fad1f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad2009d860 0x7fad2009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:22.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.207+0000 7fad1ffff700 1 -- 172.21.15.156:0/1699405656 learned_addr learned my addr 172.21.15.156:0/1699405656 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:22.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.207+0000 7fad1effd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fad2009e170 0x7fad201307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:22.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.207+0000 7fad1f7fe700 1 -- 172.21.15.156:0/1699405656 >> v2:172.21.15.156:3300/0 conn(0x7fad2009e170 msgr2=0x7fad201307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:22.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.207+0000 7fad1f7fe700 1 --2- 172.21.15.156:0/1699405656 >> v2:172.21.15.156:3300/0 conn(0x7fad2009e170 0x7fad201307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.207+0000 7fad1f7fe700 1 -- 172.21.15.156:0/1699405656 >> v1:172.21.15.156:6789/0 conn(0x7fad20130ce0 legacy=0x7fad201379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:22.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.207+0000 7fad1f7fe700 1 -- 172.21.15.156:0/1699405656 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2009b620 con 0x7fad2009d860 2023-09-30T22:19:22.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.207+0000 7fad1e7fc700 1 -- 172.21.15.156:0/1699405656 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 449253500 0 0) 0x7fad2009aaa0 con 0x7fad20130ce0 2023-09-30T22:19:22.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.208+0000 7fad1f7fe700 1 --2- 172.21.15.156:0/1699405656 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad2009d860 0x7fad2009dc30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fad10009840 tx=0x7fad10009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4428612e5d67edce server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:22.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.208+0000 7fad1e7fc700 1 -- 172.21.15.156:0/1699405656 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad10011830 con 0x7fad2009d860 2023-09-30T22:19:22.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.208+0000 7fad1e7fc700 1 -- 172.21.15.156:0/1699405656 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad10011990 con 0x7fad2009d860 2023-09-30T22:19:22.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.208+0000 7fad1e7fc700 1 -- 172.21.15.156:0/1699405656 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad10011d20 con 0x7fad2009d860 2023-09-30T22:19:22.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.208+0000 7fad26174700 1 -- 172.21.15.156:0/1699405656 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad2009d860 msgr2=0x7fad2009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:22.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.208+0000 7fad26174700 1 --2- 172.21.15.156:0/1699405656 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad2009d860 0x7fad2009dc30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fad10009840 tx=0x7fad10009b50 comp rx=0 tx=0).stop 2023-09-30T22:19:22.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.208+0000 7fad26174700 1 -- 172.21.15.156:0/1699405656 shutdown_connections 2023-09-30T22:19:22.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.208+0000 7fad26174700 1 --2- 172.21.15.156:0/1699405656 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad2009d860 0x7fad2009dc30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.208+0000 7fad26174700 1 --2- 172.21.15.156:0/1699405656 >> v2:172.21.15.156:3300/0 conn(0x7fad2009e170 0x7fad201307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.208+0000 7fad26174700 1 -- 172.21.15.156:0/1699405656 >> 172.21.15.156:0/1699405656 conn(0x7fad20099c40 msgr2=0x7fad200a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:22.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.208+0000 7fad26174700 1 -- 172.21.15.156:0/1699405656 shutdown_connections 2023-09-30T22:19:22.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.209+0000 7fad26174700 1 -- 172.21.15.156:0/1699405656 wait complete. 2023-09-30T22:19:22.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.209+0000 7fad26174700 1 Processor -- start 2023-09-30T22:19:22.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.210+0000 7fad26174700 1 -- start start 2023-09-30T22:19:22.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.210+0000 7fad26174700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad2009d860 0x7fad2012fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:22.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.210+0000 7fad26174700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad2009e170 0x7fad20130130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:22.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.210+0000 7fad26174700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad20130ce0 0x7fad20130670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:22.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.210+0000 7fad26174700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2013be00 con 0x7fad2009d860 2023-09-30T22:19:22.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.210+0000 7fad26174700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad20136850 con 0x7fad2009e170 2023-09-30T22:19:22.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.210+0000 7fad26174700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad20136b10 con 0x7fad20130ce0 2023-09-30T22:19:22.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.210+0000 7fad1f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad2009d860 0x7fad2012fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:22.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.210+0000 7fad1f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad2009d860 0x7fad2012fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54964/0 (socket says 172.21.15.156:54964) 2023-09-30T22:19:22.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.210+0000 7fad1f7fe700 1 -- 172.21.15.156:0/4097102393 learned_addr learned my addr 172.21.15.156:0/4097102393 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:22.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.210+0000 7fad1effd700 1 --2- 172.21.15.156:0/4097102393 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad2009e170 0x7fad20130130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:22.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.210+0000 7fad1ffff700 1 --2- 172.21.15.156:0/4097102393 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad20130ce0 0x7fad20130670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:22.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.210+0000 7fad1f7fe700 1 -- 172.21.15.156:0/4097102393 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad20130ce0 msgr2=0x7fad20130670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:22.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.210+0000 7fad1f7fe700 1 --2- 172.21.15.156:0/4097102393 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad20130ce0 0x7fad20130670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.210+0000 7fad1f7fe700 1 -- 172.21.15.156:0/4097102393 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad2009e170 msgr2=0x7fad20130130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:22.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.210+0000 7fad1f7fe700 1 --2- 172.21.15.156:0/4097102393 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad2009e170 0x7fad20130130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.210+0000 7fad1f7fe700 1 -- 172.21.15.156:0/4097102393 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad100094a0 con 0x7fad2009d860 2023-09-30T22:19:22.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.211+0000 7fad1f7fe700 1 --2- 172.21.15.156:0/4097102393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad2009d860 0x7fad2012fbf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fad100090b0 tx=0x7fad10004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:22.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.211+0000 7fad07fff700 1 -- 172.21.15.156:0/4097102393 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad10004480 con 0x7fad2009d860 2023-09-30T22:19:22.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.211+0000 7fad07fff700 1 -- 172.21.15.156:0/4097102393 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1001f070 con 0x7fad2009d860 2023-09-30T22:19:22.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.211+0000 7fad26174700 1 -- 172.21.15.156:0/4097102393 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad20135450 con 0x7fad2009d860 2023-09-30T22:19:22.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.211+0000 7fad07fff700 1 -- 172.21.15.156:0/4097102393 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad100038c0 con 0x7fad2009d860 2023-09-30T22:19:22.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.211+0000 7fad26174700 1 -- 172.21.15.156:0/4097102393 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad201379d0 con 0x7fad2009d860 2023-09-30T22:19:22.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.212+0000 7fad07fff700 1 -- 172.21.15.156:0/4097102393 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fad10021030 con 0x7fad2009d860 2023-09-30T22:19:22.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.212+0000 7fad07fff700 1 -- 172.21.15.156:0/4097102393 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fad10040ec0 con 0x7fad2009d860 2023-09-30T22:19:22.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.212+0000 7fad1effd700 1 -- 172.21.15.156:0/4097102393 >> v1:172.21.15.156:6816/126965 conn(0x7fad0c02f510 legacy=0x7fad0c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:22.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.213+0000 7fad26174700 1 -- 172.21.15.156:0/4097102393 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad20136cd0 con 0x7fad2009d860 2023-09-30T22:19:22.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.217+0000 7fad07fff700 1 -- 172.21.15.156:0/4097102393 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad10015080 con 0x7fad2009d860 2023-09-30T22:19:22.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.241+0000 7fc022d27700 1 Processor -- start 2023-09-30T22:19:22.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.241+0000 7fc022d27700 1 -- start start 2023-09-30T22:19:22.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.242+0000 7fc022d27700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc01c09e340 0x7fc01c1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:22.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.242+0000 7fc022d27700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc01c135f20 0x7fc01c138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:22.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.242+0000 7fc022d27700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01c09aaa0 con 0x7fc01c09d860 2023-09-30T22:19:22.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.242+0000 7fc022d27700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c09e730 con 0x7fc01c09e340 2023-09-30T22:19:22.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.242+0000 7fc022d27700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c09f870 con 0x7fc01c135f20 2023-09-30T22:19:22.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.242+0000 7fc0212c4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc01c135f20 0x7fc01c138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:22.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.242+0000 7fc020ac3700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc01c09d860 0x7fc01c09dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38322/0 (socket says 172.21.15.156:38322) 2023-09-30T22:19:22.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.242+0000 7fc020ac3700 1 -- 172.21.15.156:0/1467748075 learned_addr learned my addr 172.21.15.156:0/1467748075 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:22.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.242+0000 7fc01bfff700 1 --2- 172.21.15.156:0/1467748075 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc01c09e340 0x7fc01c1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:22.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.242+0000 7fc01b7fe700 1 -- 172.21.15.156:0/1467748075 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3111686883 0 0) 0x7fc01c09aaa0 con 0x7fc01c09d860 2023-09-30T22:19:22.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.242+0000 7fc01b7fe700 1 -- 172.21.15.156:0/1467748075 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc00c0035b0 con 0x7fc01c09d860 2023-09-30T22:19:22.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.242+0000 7fc0212c4700 1 -- 172.21.15.156:0/1467748075 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc01c09e340 msgr2=0x7fc01c1359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:22.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.242+0000 7fc0212c4700 1 --2- 172.21.15.156:0/1467748075 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc01c09e340 0x7fc01c1359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.242+0000 7fc0212c4700 1 -- 172.21.15.156:0/1467748075 >> v1:172.21.15.156:6789/0 conn(0x7fc01c09d860 legacy=0x7fc01c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:22.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.242+0000 7fc0212c4700 1 -- 172.21.15.156:0/1467748075 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c09b360 con 0x7fc01c135f20 2023-09-30T22:19:22.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.242+0000 7fc01bfff700 1 --2- 172.21.15.156:0/1467748075 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc01c09e340 0x7fc01c1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:22.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.243+0000 7fc0212c4700 1 --2- 172.21.15.156:0/1467748075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc01c135f20 0x7fc01c138300 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc014009df0 tx=0x7fc01400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=990e85d4acb1171d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:22.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.243+0000 7fc01b7fe700 1 -- 172.21.15.156:0/1467748075 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01400e070 con 0x7fc01c135f20 2023-09-30T22:19:22.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.243+0000 7fc01b7fe700 1 -- 172.21.15.156:0/1467748075 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01400bae0 con 0x7fc01c135f20 2023-09-30T22:19:22.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.243+0000 7fc01b7fe700 1 -- 172.21.15.156:0/1467748075 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01400be90 con 0x7fc01c135f20 2023-09-30T22:19:22.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.243+0000 7fc022d27700 1 -- 172.21.15.156:0/1467748075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc01c135f20 msgr2=0x7fc01c138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:22.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.243+0000 7fc022d27700 1 --2- 172.21.15.156:0/1467748075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc01c135f20 0x7fc01c138300 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc014009df0 tx=0x7fc01400b330 comp rx=0 tx=0).stop 2023-09-30T22:19:22.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.243+0000 7fc022d27700 1 -- 172.21.15.156:0/1467748075 shutdown_connections 2023-09-30T22:19:22.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.243+0000 7fc022d27700 1 --2- 172.21.15.156:0/1467748075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc01c135f20 0x7fc01c138300 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.243+0000 7fc022d27700 1 --2- 172.21.15.156:0/1467748075 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc01c09e340 0x7fc01c1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.243+0000 7fc022d27700 1 -- 172.21.15.156:0/1467748075 >> 172.21.15.156:0/1467748075 conn(0x7fc01c099c40 msgr2=0x7fc01c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:22.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.243+0000 7fc022d27700 1 -- 172.21.15.156:0/1467748075 shutdown_connections 2023-09-30T22:19:22.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.243+0000 7fc022d27700 1 -- 172.21.15.156:0/1467748075 wait complete. 2023-09-30T22:19:22.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.244+0000 7fc022d27700 1 Processor -- start 2023-09-30T22:19:22.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.244+0000 7fc022d27700 1 -- start start 2023-09-30T22:19:22.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.245+0000 7fc022d27700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc01c09d860 0x7fc01c139880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:22.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.245+0000 7fc022d27700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc01c09e340 0x7fc01c139dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:22.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.245+0000 7fc022d27700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc01c135f20 0x7fc01c13a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:22.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.245+0000 7fc022d27700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c120f10 con 0x7fc01c09d860 2023-09-30T22:19:22.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.245+0000 7fc022d27700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c13b490 con 0x7fc01c135f20 2023-09-30T22:19:22.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.245+0000 7fc022d27700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c120490 con 0x7fc01c09e340 2023-09-30T22:19:22.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.245+0000 7fc020ac3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc01c09d860 0x7fc01c139880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:22.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.245+0000 7fc020ac3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc01c09d860 0x7fc01c139880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54974/0 (socket says 172.21.15.156:54974) 2023-09-30T22:19:22.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.245+0000 7fc020ac3700 1 -- 172.21.15.156:0/3436627006 learned_addr learned my addr 172.21.15.156:0/3436627006 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:22.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.245+0000 7fc01bfff700 1 --2- 172.21.15.156:0/3436627006 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc01c09e340 0x7fc01c139dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:22.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.245+0000 7fc0212c4700 1 --2- 172.21.15.156:0/3436627006 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc01c135f20 0x7fc01c13a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:22.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.245+0000 7fc020ac3700 1 -- 172.21.15.156:0/3436627006 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc01c09e340 msgr2=0x7fc01c139dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:22.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.245+0000 7fc020ac3700 1 --2- 172.21.15.156:0/3436627006 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc01c09e340 0x7fc01c139dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.245+0000 7fc020ac3700 1 -- 172.21.15.156:0/3436627006 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc01c135f20 msgr2=0x7fc01c13a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:22.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.245+0000 7fc020ac3700 1 --2- 172.21.15.156:0/3436627006 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc01c135f20 0x7fc01c13a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.245+0000 7fc020ac3700 1 -- 172.21.15.156:0/3436627006 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0080094a0 con 0x7fc01c09d860 2023-09-30T22:19:22.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.245+0000 7fc0212c4700 1 --2- 172.21.15.156:0/3436627006 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc01c135f20 0x7fc01c13a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:22.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.246+0000 7fc020ac3700 1 --2- 172.21.15.156:0/3436627006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc01c09d860 0x7fc01c139880 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc01000c730 tx=0x7fc01000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:22.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.246+0000 7fc0197fa700 1 -- 172.21.15.156:0/3436627006 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc010005d70 con 0x7fc01c09d860 2023-09-30T22:19:22.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.246+0000 7fc0197fa700 1 -- 172.21.15.156:0/3436627006 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0100070d0 con 0x7fc01c09d860 2023-09-30T22:19:22.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.246+0000 7fc022d27700 1 -- 172.21.15.156:0/3436627006 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc014009a70 con 0x7fc01c09d860 2023-09-30T22:19:22.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.246+0000 7fc0197fa700 1 -- 172.21.15.156:0/3436627006 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc010007440 con 0x7fc01c09d860 2023-09-30T22:19:22.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.246+0000 7fc022d27700 1 -- 172.21.15.156:0/3436627006 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01c0a06b0 con 0x7fc01c09d860 2023-09-30T22:19:22.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.246+0000 7fc0197fa700 1 -- 172.21.15.156:0/3436627006 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc0100075a0 con 0x7fc01c09d860 2023-09-30T22:19:22.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.247+0000 7fc01bfff700 1 -- 172.21.15.156:0/3436627006 >> v1:172.21.15.156:6816/126965 conn(0x7fc00002f510 legacy=0x7fc0000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:22.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.247+0000 7fc0197fa700 1 -- 172.21.15.156:0/3436627006 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fc01003efd0 con 0x7fc01c09d860 2023-09-30T22:19:22.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.247+0000 7fc022d27700 1 -- 172.21.15.156:0/3436627006 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc01c09c8b0 con 0x7fc01c09d860 2023-09-30T22:19:22.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.252+0000 7fc0197fa700 1 -- 172.21.15.156:0/3436627006 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc010017020 con 0x7fc01c09d860 2023-09-30T22:19:22.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.357+0000 7f0ff259c700 1 -- 172.21.15.156:0/1215508452 >> v1:172.21.15.156:6816/126965 conn(0x7f0fd402f510 legacy=0x7f0fd40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:22.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.399+0000 7f0ff8ecb700 1 -- 172.21.15.156:0/1215508452 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0ff4120cb0 con 0x7f0ff4134210 2023-09-30T22:19:22.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.400+0000 7f0fe2ffd700 1 -- 172.21.15.156:0/1215508452 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0fec01a680 con 0x7f0ff4134210 2023-09-30T22:19:22.400 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:22.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.403+0000 7f0ff8ecb700 1 -- 172.21.15.156:0/1215508452 >> v1:172.21.15.156:6816/126965 conn(0x7f0fd402f510 legacy=0x7f0fd40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:22.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.403+0000 7f0ff8ecb700 1 -- 172.21.15.156:0/1215508452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ff4134210 msgr2=0x7f0ff411e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:22.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.403+0000 7f0ff8ecb700 1 --2- 172.21.15.156:0/1215508452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ff4134210 0x7f0ff411e1c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0fec00efc0 tx=0x7f0fec00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.403+0000 7f0ff8ecb700 1 -- 172.21.15.156:0/1215508452 shutdown_connections 2023-09-30T22:19:22.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.403+0000 7f0ff8ecb700 1 --2- 172.21.15.156:0/1215508452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ff4134210 0x7f0ff411e1c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.403+0000 7f0ff8ecb700 1 --2- 172.21.15.156:0/1215508452 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0ff40a0ee0 0x7f0ff411d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.403+0000 7f0ff8ecb700 1 --2- 172.21.15.156:0/1215508452 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0ff4133900 0x7f0ff411dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.403+0000 7f0ff8ecb700 1 -- 172.21.15.156:0/1215508452 >> 172.21.15.156:0/1215508452 conn(0x7f0ff40a2980 msgr2=0x7f0ff41baea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:22.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.403+0000 7f0ff8ecb700 1 -- 172.21.15.156:0/1215508452 shutdown_connections 2023-09-30T22:19:22.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.403+0000 7f0ff8ecb700 1 -- 172.21.15.156:0/1215508452 wait complete. 2023-09-30T22:19:22.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.413+0000 7fad1effd700 1 -- 172.21.15.156:0/4097102393 >> v1:172.21.15.156:6816/126965 conn(0x7fad0c02f510 legacy=0x7fad0c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:22.418 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:22.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.446+0000 7fad26174700 1 -- 172.21.15.156:0/4097102393 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fad2004f2a0 con 0x7fad2009d860 2023-09-30T22:19:22.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.446+0000 7fc022d27700 1 -- 172.21.15.156:0/3436627006 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc01c04f2a0 con 0x7fc01c09d860 2023-09-30T22:19:22.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.446+0000 7fc0197fa700 1 -- 172.21.15.156:0/3436627006 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc010019b40 con 0x7fc01c09d860 2023-09-30T22:19:22.447 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:22.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.446+0000 7fad07fff700 1 -- 172.21.15.156:0/4097102393 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad10003a20 con 0x7fad2009d860 2023-09-30T22:19:22.447 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:22.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.448+0000 7fc01bfff700 1 -- 172.21.15.156:0/3436627006 >> v1:172.21.15.156:6816/126965 conn(0x7fc00002f510 legacy=0x7fc0000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:22.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.449+0000 7fc022d27700 1 -- 172.21.15.156:0/3436627006 >> v1:172.21.15.156:6816/126965 conn(0x7fc00002f510 legacy=0x7fc0000319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:22.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.449+0000 7fc022d27700 1 -- 172.21.15.156:0/3436627006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc01c09d860 msgr2=0x7fc01c139880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:22.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.449+0000 7fc022d27700 1 --2- 172.21.15.156:0/3436627006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc01c09d860 0x7fc01c139880 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc01000c730 tx=0x7fc01000ca40 comp rx=0 tx=0).stop 2023-09-30T22:19:22.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.449+0000 7fc022d27700 1 -- 172.21.15.156:0/3436627006 shutdown_connections 2023-09-30T22:19:22.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.449+0000 7fc022d27700 1 --2- 172.21.15.156:0/3436627006 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc01c135f20 0x7fc01c13a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.449+0000 7fc022d27700 1 --2- 172.21.15.156:0/3436627006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc01c09d860 0x7fc01c139880 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.449+0000 7fc022d27700 1 --2- 172.21.15.156:0/3436627006 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc01c09e340 0x7fc01c139dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.449+0000 7fc022d27700 1 -- 172.21.15.156:0/3436627006 >> 172.21.15.156:0/3436627006 conn(0x7fc01c099c40 msgr2=0x7fc01c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:22.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.449+0000 7fc022d27700 1 -- 172.21.15.156:0/3436627006 shutdown_connections 2023-09-30T22:19:22.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.449+0000 7fc022d27700 1 -- 172.21.15.156:0/3436627006 wait complete. 2023-09-30T22:19:22.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.449+0000 7fad26174700 1 -- 172.21.15.156:0/4097102393 >> v1:172.21.15.156:6816/126965 conn(0x7fad0c02f510 legacy=0x7fad0c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:22.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.449+0000 7fad26174700 1 -- 172.21.15.156:0/4097102393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad2009d860 msgr2=0x7fad2012fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:22.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.449+0000 7fad26174700 1 --2- 172.21.15.156:0/4097102393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad2009d860 0x7fad2012fbf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fad100090b0 tx=0x7fad10004750 comp rx=0 tx=0).stop 2023-09-30T22:19:22.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.449+0000 7fad26174700 1 -- 172.21.15.156:0/4097102393 shutdown_connections 2023-09-30T22:19:22.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.449+0000 7fad26174700 1 --2- 172.21.15.156:0/4097102393 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad20130ce0 0x7fad20130670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.449+0000 7fad26174700 1 --2- 172.21.15.156:0/4097102393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad2009d860 0x7fad2012fbf0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.449+0000 7fad26174700 1 --2- 172.21.15.156:0/4097102393 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad2009e170 0x7fad20130130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:22.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.449+0000 7fad26174700 1 -- 172.21.15.156:0/4097102393 >> 172.21.15.156:0/4097102393 conn(0x7fad20099c40 msgr2=0x7fad201393e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:22.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.449+0000 7fad26174700 1 -- 172.21.15.156:0/4097102393 shutdown_connections 2023-09-30T22:19:22.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:22.449+0000 7fad26174700 1 -- 172.21.15.156:0/4097102393 wait complete. 2023-09-30T22:19:22.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:22.463 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:23.186 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:23.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.313+0000 7f5be8e8a700 1 Processor -- start 2023-09-30T22:19:23.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.313+0000 7f5be8e8a700 1 -- start start 2023-09-30T22:19:23.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.313+0000 7f5be8e8a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5be4136960 0x7f5be4138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:23.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.313+0000 7f5be8e8a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5be4139280 0x7f5be413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:23.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.313+0000 7f5be8e8a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be406b2d0 con 0x7f5be4133ad0 2023-09-30T22:19:23.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.313+0000 7f5be8e8a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be41345b0 con 0x7f5be4139280 2023-09-30T22:19:23.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.313+0000 7f5be8e8a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5be4133610 con 0x7f5be4136960 2023-09-30T22:19:23.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.314+0000 7f5be1d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5be4136960 0x7f5be4138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:23.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.314+0000 7f5be259c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f5be4133ad0 0x7f5be4133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38330/0 (socket says 172.21.15.156:38330) 2023-09-30T22:19:23.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.314+0000 7f5be259c700 1 -- 172.21.15.156:0/1266023951 learned_addr learned my addr 172.21.15.156:0/1266023951 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:23.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.314+0000 7f5be2d9d700 1 --2- 172.21.15.156:0/1266023951 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5be4139280 0x7f5be413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:23.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.314+0000 7f5be159a700 1 -- 172.21.15.156:0/1266023951 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2044278378 0 0) 0x7f5be406b2d0 con 0x7f5be4133ad0 2023-09-30T22:19:23.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.314+0000 7f5be1d9b700 1 -- 172.21.15.156:0/1266023951 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5be4139280 msgr2=0x7f5be413b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:23.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.314+0000 7f5be1d9b700 1 --2- 172.21.15.156:0/1266023951 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5be4139280 0x7f5be413b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.314+0000 7f5be1d9b700 1 -- 172.21.15.156:0/1266023951 >> v1:172.21.15.156:6789/0 conn(0x7f5be4133ad0 legacy=0x7f5be4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:23.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.314+0000 7f5be1d9b700 1 -- 172.21.15.156:0/1266023951 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be409a500 con 0x7f5be4136960 2023-09-30T22:19:23.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.314+0000 7f5be2d9d700 1 --2- 172.21.15.156:0/1266023951 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5be4139280 0x7f5be413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:23.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.314+0000 7f5be1d9b700 1 --2- 172.21.15.156:0/1266023951 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5be4136960 0x7f5be4138d40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009870 tx=0x7f5bd8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8706188ca6555428 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:23.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.314+0000 7f5be159a700 1 -- 172.21.15.156:0/1266023951 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8011830 con 0x7f5be4136960 2023-09-30T22:19:23.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.314+0000 7f5be159a700 1 -- 172.21.15.156:0/1266023951 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd8011990 con 0x7f5be4136960 2023-09-30T22:19:23.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.314+0000 7f5be159a700 1 -- 172.21.15.156:0/1266023951 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8011d20 con 0x7f5be4136960 2023-09-30T22:19:23.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.315+0000 7f5be8e8a700 1 -- 172.21.15.156:0/1266023951 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5be4136960 msgr2=0x7f5be4138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:23.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.315+0000 7f5be8e8a700 1 --2- 172.21.15.156:0/1266023951 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5be4136960 0x7f5be4138d40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009870 tx=0x7f5bd8009b80 comp rx=0 tx=0).stop 2023-09-30T22:19:23.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.315+0000 7f5be8e8a700 1 -- 172.21.15.156:0/1266023951 shutdown_connections 2023-09-30T22:19:23.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.315+0000 7f5be8e8a700 1 --2- 172.21.15.156:0/1266023951 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5be4139280 0x7f5be413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.315+0000 7f5be8e8a700 1 --2- 172.21.15.156:0/1266023951 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5be4136960 0x7f5be4138d40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.315+0000 7f5be8e8a700 1 -- 172.21.15.156:0/1266023951 >> 172.21.15.156:0/1266023951 conn(0x7f5be4099c40 msgr2=0x7f5be40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:23.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.315+0000 7f5be8e8a700 1 -- 172.21.15.156:0/1266023951 shutdown_connections 2023-09-30T22:19:23.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.315+0000 7f5be8e8a700 1 -- 172.21.15.156:0/1266023951 wait complete. 2023-09-30T22:19:23.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.316+0000 7f5be8e8a700 1 Processor -- start 2023-09-30T22:19:23.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.316+0000 7f5be8e8a700 1 -- start start 2023-09-30T22:19:23.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.316+0000 7f5be8e8a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5be4133ad0 0x7f5be412cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:23.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.316+0000 7f5be8e8a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5be4136960 0x7f5be412d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:23.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.316+0000 7f5be8e8a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5be4139280 0x7f5be412d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:23.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.316+0000 7f5be8e8a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be41316a0 con 0x7f5be4136960 2023-09-30T22:19:23.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.316+0000 7f5be8e8a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be406ede0 con 0x7f5be4133ad0 2023-09-30T22:19:23.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.316+0000 7f5be8e8a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5be409f390 con 0x7f5be4139280 2023-09-30T22:19:23.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.316+0000 7f5be259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5be4133ad0 0x7f5be412cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:23.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.316+0000 7f5be2d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5be4139280 0x7f5be412d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:23.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.316+0000 7f5be1d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5be4136960 0x7f5be412d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:23.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.316+0000 7f5be259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5be4133ad0 0x7f5be412cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37850/0 (socket says 172.21.15.156:37850) 2023-09-30T22:19:23.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.316+0000 7f5be259c700 1 -- 172.21.15.156:0/3964106086 learned_addr learned my addr 172.21.15.156:0/3964106086 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:23.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.317+0000 7f5be2d9d700 1 -- 172.21.15.156:0/3964106086 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5be4133ad0 msgr2=0x7f5be412cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:23.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.317+0000 7f5be2d9d700 1 --2- 172.21.15.156:0/3964106086 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5be4133ad0 0x7f5be412cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.317+0000 7f5be2d9d700 1 -- 172.21.15.156:0/3964106086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5be4136960 msgr2=0x7f5be412d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:23.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.317+0000 7f5be2d9d700 1 --2- 172.21.15.156:0/3964106086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5be4136960 0x7f5be412d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.317+0000 7f5be2d9d700 1 -- 172.21.15.156:0/3964106086 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bdc009a70 con 0x7f5be4139280 2023-09-30T22:19:23.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.317+0000 7f5be259c700 1 --2- 172.21.15.156:0/3964106086 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5be4133ad0 0x7f5be412cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:23.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.317+0000 7f5be1d9b700 1 --2- 172.21.15.156:0/3964106086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5be4136960 0x7f5be412d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:23.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.317+0000 7f5be2d9d700 1 --2- 172.21.15.156:0/3964106086 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5be4139280 0x7f5be412d5b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00efc0 tx=0x7f5bdc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:23.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.317+0000 7f5bd2ffd700 1 -- 172.21.15.156:0/3964106086 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc00ca90 con 0x7f5be4139280 2023-09-30T22:19:23.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.317+0000 7f5bd2ffd700 1 -- 172.21.15.156:0/3964106086 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc00f040 con 0x7f5be4139280 2023-09-30T22:19:23.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.317+0000 7f5be8e8a700 1 -- 172.21.15.156:0/3964106086 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd80094a0 con 0x7f5be4139280 2023-09-30T22:19:23.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.317+0000 7f5bd2ffd700 1 -- 172.21.15.156:0/3964106086 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc00ce30 con 0x7f5be4139280 2023-09-30T22:19:23.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.317+0000 7f5be8e8a700 1 -- 172.21.15.156:0/3964106086 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be4070c20 con 0x7f5be4139280 2023-09-30T22:19:23.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.318+0000 7f5bd2ffd700 1 -- 172.21.15.156:0/3964106086 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5bdc014480 con 0x7f5be4139280 2023-09-30T22:19:23.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.318+0000 7f5bd2ffd700 1 -- 172.21.15.156:0/3964106086 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f5bdc0402a0 con 0x7f5be4139280 2023-09-30T22:19:23.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.318+0000 7f5be259c700 1 -- 172.21.15.156:0/3964106086 >> v1:172.21.15.156:6816/126965 conn(0x7f5bc402f510 legacy=0x7f5bc40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:23.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.318+0000 7f5be8e8a700 1 -- 172.21.15.156:0/3964106086 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be404f2a0 con 0x7f5be4139280 2023-09-30T22:19:23.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.323+0000 7f5bd2ffd700 1 -- 172.21.15.156:0/3964106086 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5bdc018070 con 0x7f5be4139280 2023-09-30T22:19:23.419 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:23.463 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:23.464 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:23.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.519+0000 7f5be259c700 1 -- 172.21.15.156:0/3964106086 >> v1:172.21.15.156:6816/126965 conn(0x7f5bc402f510 legacy=0x7f5bc40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:23.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.520+0000 7f5be8e8a700 1 -- 172.21.15.156:0/3964106086 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5be409f0f0 con 0x7f5be4139280 2023-09-30T22:19:23.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.521+0000 7f5bd2ffd700 1 -- 172.21.15.156:0/3964106086 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5bdc018070 con 0x7f5be4139280 2023-09-30T22:19:23.520 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:23.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.523+0000 7f5be8e8a700 1 -- 172.21.15.156:0/3964106086 >> v1:172.21.15.156:6816/126965 conn(0x7f5bc402f510 legacy=0x7f5bc40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:23.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.523+0000 7f5be8e8a700 1 -- 172.21.15.156:0/3964106086 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5be4139280 msgr2=0x7f5be412d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:23.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.523+0000 7f5be8e8a700 1 --2- 172.21.15.156:0/3964106086 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5be4139280 0x7f5be412d5b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00efc0 tx=0x7f5bdc00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.523+0000 7f5be8e8a700 1 -- 172.21.15.156:0/3964106086 shutdown_connections 2023-09-30T22:19:23.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.523+0000 7f5be8e8a700 1 --2- 172.21.15.156:0/3964106086 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5be4139280 0x7f5be412d5b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.523+0000 7f5be8e8a700 1 --2- 172.21.15.156:0/3964106086 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5be4133ad0 0x7f5be412cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.523+0000 7f5be8e8a700 1 --2- 172.21.15.156:0/3964106086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5be4136960 0x7f5be412d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.523+0000 7f5be8e8a700 1 -- 172.21.15.156:0/3964106086 >> 172.21.15.156:0/3964106086 conn(0x7f5be4099c40 msgr2=0x7f5be40a30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:23.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.523+0000 7f5be8e8a700 1 -- 172.21.15.156:0/3964106086 shutdown_connections 2023-09-30T22:19:23.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.523+0000 7f5be8e8a700 1 -- 172.21.15.156:0/3964106086 wait complete. 2023-09-30T22:19:23.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:23.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.549+0000 7f33aaf43700 1 Processor -- start 2023-09-30T22:19:23.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.549+0000 7f33aaf43700 1 -- start start 2023-09-30T22:19:23.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.549+0000 7f33aaf43700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33a409e340 0x7f33a41359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:23.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.549+0000 7f33aaf43700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f33a4135f20 0x7f33a4138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:23.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.549+0000 7f33aaf43700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a409aaa0 con 0x7f33a409d860 2023-09-30T22:19:23.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.549+0000 7f33aaf43700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33a409e730 con 0x7f33a4135f20 2023-09-30T22:19:23.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.549+0000 7f33aaf43700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33a409f870 con 0x7f33a409e340 2023-09-30T22:19:23.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.549+0000 7f33a94e0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f33a4135f20 0x7f33a4138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:23.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.549+0000 7f33a3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33a409e340 0x7f33a41359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:23.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.549+0000 7f33a94e0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f33a4135f20 0x7f33a4138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54986/0 (socket says 172.21.15.156:54986) 2023-09-30T22:19:23.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.549+0000 7f33a3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33a409e340 0x7f33a41359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43752/0 (socket says 172.21.15.156:43752) 2023-09-30T22:19:23.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.549+0000 7f33a94e0700 1 -- 172.21.15.156:0/201367161 learned_addr learned my addr 172.21.15.156:0/201367161 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:23.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.550+0000 7f33a94e0700 1 -- 172.21.15.156:0/201367161 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33a409e340 msgr2=0x7f33a41359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:23.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.550+0000 7f33a94e0700 1 --2- 172.21.15.156:0/201367161 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33a409e340 0x7f33a41359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.550+0000 7f33a94e0700 1 -- 172.21.15.156:0/201367161 >> v1:172.21.15.156:6789/0 conn(0x7f33a409d860 legacy=0x7f33a409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:23.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.550+0000 7f33a37fe700 1 -- 172.21.15.156:0/201367161 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 613684177 0 0) 0x7f33a409aaa0 con 0x7f33a409d860 2023-09-30T22:19:23.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.550+0000 7f33a94e0700 1 -- 172.21.15.156:0/201367161 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a409b360 con 0x7f33a4135f20 2023-09-30T22:19:23.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.550+0000 7f33a3fff700 1 --2- 172.21.15.156:0/201367161 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33a409e340 0x7f33a41359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:23.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.550+0000 7f33a94e0700 1 --2- 172.21.15.156:0/201367161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33a4135f20 0x7f33a4138300 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f339c009480 tx=0x7f339c00f5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b44609c3f46c6b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:23.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.550+0000 7f33a37fe700 1 -- 172.21.15.156:0/201367161 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c012070 con 0x7f33a4135f20 2023-09-30T22:19:23.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.550+0000 7f33a37fe700 1 -- 172.21.15.156:0/201367161 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339c016430 con 0x7f33a4135f20 2023-09-30T22:19:23.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.550+0000 7f33a37fe700 1 -- 172.21.15.156:0/201367161 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c0167c0 con 0x7f33a4135f20 2023-09-30T22:19:23.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.551+0000 7f33aaf43700 1 -- 172.21.15.156:0/201367161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33a4135f20 msgr2=0x7f33a4138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:23.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.551+0000 7f33aaf43700 1 --2- 172.21.15.156:0/201367161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33a4135f20 0x7f33a4138300 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f339c009480 tx=0x7f339c00f5c0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.551+0000 7f33aaf43700 1 -- 172.21.15.156:0/201367161 shutdown_connections 2023-09-30T22:19:23.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.551+0000 7f33aaf43700 1 --2- 172.21.15.156:0/201367161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33a4135f20 0x7f33a4138300 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.551+0000 7f33aaf43700 1 --2- 172.21.15.156:0/201367161 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33a409e340 0x7f33a41359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.551+0000 7f33aaf43700 1 -- 172.21.15.156:0/201367161 >> 172.21.15.156:0/201367161 conn(0x7f33a4099c40 msgr2=0x7f33a40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:23.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.551+0000 7f33aaf43700 1 -- 172.21.15.156:0/201367161 shutdown_connections 2023-09-30T22:19:23.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.551+0000 7f33aaf43700 1 -- 172.21.15.156:0/201367161 wait complete. 2023-09-30T22:19:23.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.552+0000 7f33aaf43700 1 Processor -- start 2023-09-30T22:19:23.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.552+0000 7f33aaf43700 1 -- start start 2023-09-30T22:19:23.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.552+0000 7f33aaf43700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33a409d860 0x7f33a411c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:23.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.552+0000 7f33aaf43700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33a409e340 0x7f33a411c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:23.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.552+0000 7f33aaf43700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33a4135f20 0x7f33a411cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:23.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.552+0000 7f33aaf43700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a409c8b0 con 0x7f33a409e340 2023-09-30T22:19:23.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.552+0000 7f33aaf43700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a40a0770 con 0x7f33a4135f20 2023-09-30T22:19:23.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.552+0000 7f33aaf43700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33a411f550 con 0x7f33a409d860 2023-09-30T22:19:23.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.552+0000 7f33a8cdf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33a409d860 0x7f33a411c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:23.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.552+0000 7f33a3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33a409e340 0x7f33a411c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:23.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.552+0000 7f33a8cdf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33a409d860 0x7f33a411c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43764/0 (socket says 172.21.15.156:43764) 2023-09-30T22:19:23.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.552+0000 7f33a8cdf700 1 -- 172.21.15.156:0/3889734575 learned_addr learned my addr 172.21.15.156:0/3889734575 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:23.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.553+0000 7f33a94e0700 1 --2- 172.21.15.156:0/3889734575 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33a4135f20 0x7f33a411cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:23.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.553+0000 7f33a3fff700 1 -- 172.21.15.156:0/3889734575 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33a409d860 msgr2=0x7f33a411c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:23.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.553+0000 7f33a3fff700 1 --2- 172.21.15.156:0/3889734575 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33a409d860 0x7f33a411c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.553+0000 7f33a3fff700 1 -- 172.21.15.156:0/3889734575 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33a4135f20 msgr2=0x7f33a411cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:23.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.553+0000 7f33a3fff700 1 --2- 172.21.15.156:0/3889734575 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33a4135f20 0x7f33a411cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.553+0000 7f33a3fff700 1 -- 172.21.15.156:0/3889734575 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33900094a0 con 0x7f33a409e340 2023-09-30T22:19:23.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.553+0000 7f33a94e0700 1 --2- 172.21.15.156:0/3889734575 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33a4135f20 0x7f33a411cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:19:23.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.553+0000 7f33a3fff700 1 --2- 172.21.15.156:0/3889734575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33a409e340 0x7f33a411c830 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f339000e9b0 tx=0x7f339000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:23.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.553+0000 7f33a17fa700 1 -- 172.21.15.156:0/3889734575 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339000c850 con 0x7f33a409e340 2023-09-30T22:19:23.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.553+0000 7f33a17fa700 1 -- 172.21.15.156:0/3889734575 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339000c9b0 con 0x7f33a409e340 2023-09-30T22:19:23.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.553+0000 7f33a17fa700 1 -- 172.21.15.156:0/3889734575 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339000cd60 con 0x7f33a409e340 2023-09-30T22:19:23.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.553+0000 7f33aaf43700 1 -- 172.21.15.156:0/3889734575 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339c00f050 con 0x7f33a409e340 2023-09-30T22:19:23.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.553+0000 7f33aaf43700 1 -- 172.21.15.156:0/3889734575 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a411e660 con 0x7f33a409e340 2023-09-30T22:19:23.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.554+0000 7f33aaf43700 1 -- 172.21.15.156:0/3889734575 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a4071c50 con 0x7f33a409e340 2023-09-30T22:19:23.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.554+0000 7f33a17fa700 1 -- 172.21.15.156:0/3889734575 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3390013470 con 0x7f33a409e340 2023-09-30T22:19:23.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.555+0000 7f33a17fa700 1 -- 172.21.15.156:0/3889734575 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f339003fdb0 con 0x7f33a409e340 2023-09-30T22:19:23.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.555+0000 7f33a8cdf700 1 -- 172.21.15.156:0/3889734575 >> v1:172.21.15.156:6816/126965 conn(0x7f338802f510 legacy=0x7f33880319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:23.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.559+0000 7f33a17fa700 1 -- 172.21.15.156:0/3889734575 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f33900232f0 con 0x7f33a409e340 2023-09-30T22:19:23.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.595+0000 7f1611d9b700 1 Processor -- start 2023-09-30T22:19:23.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.595+0000 7f1611d9b700 1 -- start start 2023-09-30T22:19:23.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.595+0000 7fa7e9f9c700 1 Processor -- start 2023-09-30T22:19:23.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.596+0000 7fa7e9f9c700 1 -- start start 2023-09-30T22:19:23.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.596+0000 7f1611d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f160c09f350 0x7f160c136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:23.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.596+0000 7f1611d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f160c1371c0 0x7f160c1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:23.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.596+0000 7f1611d9b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f160c09c970 con 0x7f160c09e870 2023-09-30T22:19:23.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.596+0000 7f1611d9b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160c0a0920 con 0x7f160c1371c0 2023-09-30T22:19:23.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.596+0000 7f1611d9b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f160c09f9c0 con 0x7f160c09f350 2023-09-30T22:19:23.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.596+0000 7f160affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f160c09f350 0x7f160c136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:23.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.596+0000 7f160affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f160c09f350 0x7f160c136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43772/0 (socket says 172.21.15.156:43772) 2023-09-30T22:19:23.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.596+0000 7f160affd700 1 -- 172.21.15.156:0/4186863989 learned_addr learned my addr 172.21.15.156:0/4186863989 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:23.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.596+0000 7f160bfff700 1 --2- 172.21.15.156:0/4186863989 >> v2:172.21.15.156:3300/0 conn(0x7f160c1371c0 0x7f160c1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:23.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.596+0000 7fa7e9f9c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa7e4131980 0x7fa7e4131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:23.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.596+0000 7fa7e9f9c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7e409c790 0x7fa7e4139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:23.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.596+0000 7fa7e9f9c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e40a1640 con 0x7fa7e409bc70 2023-09-30T22:19:23.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.596+0000 7fa7e9f9c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e406eb30 con 0x7fa7e4131980 2023-09-30T22:19:23.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.596+0000 7fa7e9f9c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e40a22d0 con 0x7fa7e409c790 2023-09-30T22:19:23.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.596+0000 7f160affd700 1 -- 172.21.15.156:0/4186863989 >> v2:172.21.15.156:3300/0 conn(0x7f160c1371c0 msgr2=0x7f160c1395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:23.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.596+0000 7f160affd700 1 --2- 172.21.15.156:0/4186863989 >> v2:172.21.15.156:3300/0 conn(0x7f160c1371c0 0x7f160c1395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.596+0000 7f160affd700 1 -- 172.21.15.156:0/4186863989 >> v1:172.21.15.156:6789/0 conn(0x7f160c09e870 legacy=0x7f160c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:23.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.596+0000 7f160affd700 1 -- 172.21.15.156:0/4186863989 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160c09bab0 con 0x7f160c09f350 2023-09-30T22:19:23.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.596+0000 7fa7e3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7e409c790 0x7fa7e4139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:23.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.596+0000 7fa7e3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7e409c790 0x7fa7e4139710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37858/0 (socket says 172.21.15.156:37858) 2023-09-30T22:19:23.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.596+0000 7fa7e3fff700 1 -- 172.21.15.156:0/3449604868 learned_addr learned my addr 172.21.15.156:0/3449604868 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:23.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.597+0000 7f160affd700 1 --2- 172.21.15.156:0/4186863989 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f160c09f350 0x7f160c136c80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f16000098f0 tx=0x7f1600009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d8551678133476a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:23.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.597+0000 7fa7e3fff700 1 -- 172.21.15.156:0/3449604868 >> v2:172.21.15.156:3300/0 conn(0x7fa7e4131980 msgr2=0x7fa7e4131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:23.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.597+0000 7fa7e37fe700 1 --2- 172.21.15.156:0/3449604868 >> v2:172.21.15.156:3300/0 conn(0x7fa7e4131980 0x7fa7e4131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:23.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.597+0000 7fa7e3fff700 1 --2- 172.21.15.156:0/3449604868 >> v2:172.21.15.156:3300/0 conn(0x7fa7e4131980 0x7fa7e4131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.597+0000 7fa7e3fff700 1 -- 172.21.15.156:0/3449604868 >> v1:172.21.15.156:6789/0 conn(0x7fa7e409bc70 legacy=0x7fa7e409c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:23.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.597+0000 7fa7e3fff700 1 -- 172.21.15.156:0/3449604868 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e4131550 con 0x7fa7e409c790 2023-09-30T22:19:23.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.597+0000 7fa7e37fe700 1 --2- 172.21.15.156:0/3449604868 >> v2:172.21.15.156:3300/0 conn(0x7fa7e4131980 0x7fa7e4131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:19:23.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.597+0000 7f160a7fc700 1 -- 172.21.15.156:0/4186863989 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1600011830 con 0x7f160c09f350 2023-09-30T22:19:23.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.597+0000 7f160a7fc700 1 -- 172.21.15.156:0/4186863989 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1600011990 con 0x7f160c09f350 2023-09-30T22:19:23.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.597+0000 7f160a7fc700 1 -- 172.21.15.156:0/4186863989 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1600011d20 con 0x7f160c09f350 2023-09-30T22:19:23.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.597+0000 7fa7e3fff700 1 --2- 172.21.15.156:0/3449604868 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7e409c790 0x7fa7e4139710 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc009e50 tx=0x7fa7dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fec720920b3e3953 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:23.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.598+0000 7fa7e27fc700 1 -- 172.21.15.156:0/3449604868 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc00e070 con 0x7fa7e409c790 2023-09-30T22:19:23.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.598+0000 7fa7e27fc700 1 -- 172.21.15.156:0/3449604868 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7dc00b9c0 con 0x7fa7e409c790 2023-09-30T22:19:23.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.598+0000 7fa7e27fc700 1 -- 172.21.15.156:0/3449604868 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc00bd70 con 0x7fa7e409c790 2023-09-30T22:19:23.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.598+0000 7f1611d9b700 1 -- 172.21.15.156:0/4186863989 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f160c09f350 msgr2=0x7f160c136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:23.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.598+0000 7f1611d9b700 1 --2- 172.21.15.156:0/4186863989 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f160c09f350 0x7f160c136c80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f16000098f0 tx=0x7f1600009c00 comp rx=0 tx=0).stop 2023-09-30T22:19:23.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.598+0000 7f1611d9b700 1 -- 172.21.15.156:0/4186863989 shutdown_connections 2023-09-30T22:19:23.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.598+0000 7f1611d9b700 1 --2- 172.21.15.156:0/4186863989 >> v2:172.21.15.156:3300/0 conn(0x7f160c1371c0 0x7f160c1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.598+0000 7f1611d9b700 1 --2- 172.21.15.156:0/4186863989 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f160c09f350 0x7f160c136c80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.598+0000 7f1611d9b700 1 -- 172.21.15.156:0/4186863989 >> 172.21.15.156:0/4186863989 conn(0x7f160c0a4430 msgr2=0x7f160c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:23.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.598+0000 7f1611d9b700 1 -- 172.21.15.156:0/4186863989 shutdown_connections 2023-09-30T22:19:23.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.598+0000 7f1611d9b700 1 -- 172.21.15.156:0/4186863989 wait complete. 2023-09-30T22:19:23.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.598+0000 7fa7e9f9c700 1 -- 172.21.15.156:0/3449604868 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7e409c790 msgr2=0x7fa7e4139710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:23.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.598+0000 7fa7e9f9c700 1 --2- 172.21.15.156:0/3449604868 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7e409c790 0x7fa7e4139710 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc009e50 tx=0x7fa7dc00b330 comp rx=0 tx=0).stop 2023-09-30T22:19:23.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.598+0000 7fa7e9f9c700 1 -- 172.21.15.156:0/3449604868 shutdown_connections 2023-09-30T22:19:23.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.598+0000 7fa7e9f9c700 1 --2- 172.21.15.156:0/3449604868 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7e409c790 0x7fa7e4139710 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.598+0000 7fa7e9f9c700 1 --2- 172.21.15.156:0/3449604868 >> v2:172.21.15.156:3300/0 conn(0x7fa7e4131980 0x7fa7e4131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.598+0000 7fa7e9f9c700 1 -- 172.21.15.156:0/3449604868 >> 172.21.15.156:0/3449604868 conn(0x7fa7e40a2980 msgr2=0x7fa7e40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:23.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.599+0000 7f1611d9b700 1 Processor -- start 2023-09-30T22:19:23.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.599+0000 7fa7e9f9c700 1 -- 172.21.15.156:0/3449604868 shutdown_connections 2023-09-30T22:19:23.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.599+0000 7fa7e9f9c700 1 -- 172.21.15.156:0/3449604868 wait complete. 2023-09-30T22:19:23.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.599+0000 7f1611d9b700 1 -- start start 2023-09-30T22:19:23.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.600+0000 7f1611d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f160c09e870 0x7f160c11b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:23.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.600+0000 7f1611d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f160c09f350 0x7f160c11bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:23.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.600+0000 7f1611d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f160c1371c0 0x7f160c11c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:23.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.600+0000 7f1611d9b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c11d650 con 0x7f160c09f350 2023-09-30T22:19:23.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.600+0000 7f1611d9b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160c06d300 con 0x7f160c09e870 2023-09-30T22:19:23.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.600+0000 7f1611d9b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f160c11ef90 con 0x7f160c1371c0 2023-09-30T22:19:23.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.600+0000 7f160b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f160c09e870 0x7f160c11b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:23.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.600+0000 7f160b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f160c09e870 0x7f160c11b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37864/0 (socket says 172.21.15.156:37864) 2023-09-30T22:19:23.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.600+0000 7f160b7fe700 1 -- 172.21.15.156:0/131097910 learned_addr learned my addr 172.21.15.156:0/131097910 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:23.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.600+0000 7f160affd700 1 --2- 172.21.15.156:0/131097910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f160c09f350 0x7f160c11bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:23.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.600+0000 7f160bfff700 1 --2- 172.21.15.156:0/131097910 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f160c1371c0 0x7f160c11c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:23.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.600+0000 7f160b7fe700 1 -- 172.21.15.156:0/131097910 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f160c1371c0 msgr2=0x7f160c11c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:23.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.600+0000 7f160b7fe700 1 --2- 172.21.15.156:0/131097910 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f160c1371c0 0x7f160c11c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.600+0000 7f160b7fe700 1 -- 172.21.15.156:0/131097910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f160c09f350 msgr2=0x7f160c11bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:23.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.600+0000 7f160b7fe700 1 --2- 172.21.15.156:0/131097910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f160c09f350 0x7f160c11bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.600+0000 7f160b7fe700 1 -- 172.21.15.156:0/131097910 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1600009550 con 0x7f160c09e870 2023-09-30T22:19:23.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.600+0000 7f160bfff700 1 --2- 172.21.15.156:0/131097910 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f160c1371c0 0x7f160c11c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:19:23.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.600+0000 7fa7e9f9c700 1 Processor -- start 2023-09-30T22:19:23.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.600+0000 7f160b7fe700 1 --2- 172.21.15.156:0/131097910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f160c09e870 0x7f160c11b710 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f15fc00c4e0 tx=0x7f15fc00c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:23.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.600+0000 7fa7e9f9c700 1 -- start start 2023-09-30T22:19:23.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.601+0000 7fa7e9f9c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7e409bc70 0x7fa7e41cc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:23.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.601+0000 7fa7e9f9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7e409c790 0x7fa7e41cce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:23.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.601+0000 7fa7e9f9c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7e4131980 0x7fa7e41cd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:23.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.601+0000 7fa7e9f9c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e4125ab0 con 0x7fa7e409c790 2023-09-30T22:19:23.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.601+0000 7fa7e9f9c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e40a1c40 con 0x7fa7e409bc70 2023-09-30T22:19:23.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.601+0000 7fa7e9f9c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e411c060 con 0x7fa7e4131980 2023-09-30T22:19:23.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.601+0000 7f15f3fff700 1 -- 172.21.15.156:0/131097910 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc0052d0 con 0x7f160c09e870 2023-09-30T22:19:23.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.601+0000 7f1611d9b700 1 -- 172.21.15.156:0/131097910 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f160c09dba0 con 0x7f160c09e870 2023-09-30T22:19:23.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.601+0000 7f15f3fff700 1 -- 172.21.15.156:0/131097910 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15fc005430 con 0x7f160c09e870 2023-09-30T22:19:23.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.601+0000 7f15f3fff700 1 -- 172.21.15.156:0/131097910 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc0038c0 con 0x7f160c09e870 2023-09-30T22:19:23.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.601+0000 7f1611d9b700 1 -- 172.21.15.156:0/131097910 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f160c11d800 con 0x7f160c09e870 2023-09-30T22:19:23.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.601+0000 7fa7e37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7e409bc70 0x7fa7e41cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:23.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.601+0000 7fa7e2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7e409c790 0x7fa7e41cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:23.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.601+0000 7fa7e37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7e409bc70 0x7fa7e41cc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37878/0 (socket says 172.21.15.156:37878) 2023-09-30T22:19:23.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.601+0000 7fa7e37fe700 1 -- 172.21.15.156:0/3143656441 learned_addr learned my addr 172.21.15.156:0/3143656441 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:23.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.601+0000 7fa7e3fff700 1 --2- 172.21.15.156:0/3143656441 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7e4131980 0x7fa7e41cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:23.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.601+0000 7fa7e2ffd700 1 -- 172.21.15.156:0/3143656441 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7e4131980 msgr2=0x7fa7e41cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:23.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.601+0000 7fa7e2ffd700 1 --2- 172.21.15.156:0/3143656441 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7e4131980 0x7fa7e41cd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.601+0000 7fa7e2ffd700 1 -- 172.21.15.156:0/3143656441 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7e409bc70 msgr2=0x7fa7e41cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:23.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.601+0000 7fa7e2ffd700 1 --2- 172.21.15.156:0/3143656441 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7e409bc70 0x7fa7e41cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.601+0000 7fa7e2ffd700 1 -- 172.21.15.156:0/3143656441 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7dc009b30 con 0x7fa7e409c790 2023-09-30T22:19:23.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.602+0000 7fa7e2ffd700 1 --2- 172.21.15.156:0/3143656441 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7e409c790 0x7fa7e41cce40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8000f60 tx=0x7fa7d800c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:23.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.602+0000 7fa7cbfff700 1 -- 172.21.15.156:0/3143656441 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d800ce30 con 0x7fa7e409c790 2023-09-30T22:19:23.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.602+0000 7fa7cbfff700 1 -- 172.21.15.156:0/3143656441 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d80050d0 con 0x7fa7e409c790 2023-09-30T22:19:23.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.602+0000 7fa7e9f9c700 1 -- 172.21.15.156:0/3143656441 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e411c320 con 0x7fa7e409c790 2023-09-30T22:19:23.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.602+0000 7fa7cbfff700 1 -- 172.21.15.156:0/3143656441 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8005480 con 0x7fa7e409c790 2023-09-30T22:19:23.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.602+0000 7fa7e9f9c700 1 -- 172.21.15.156:0/3143656441 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e411be00 con 0x7fa7e409c790 2023-09-30T22:19:23.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.602+0000 7f15f3fff700 1 -- 172.21.15.156:0/131097910 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f15fc003a20 con 0x7f160c09e870 2023-09-30T22:19:23.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.603+0000 7fa7cbfff700 1 -- 172.21.15.156:0/3143656441 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa7d8003680 con 0x7fa7e409c790 2023-09-30T22:19:23.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.603+0000 7fa7e37fe700 1 -- 172.21.15.156:0/3143656441 >> v1:172.21.15.156:6816/126965 conn(0x7fa7d002f510 legacy=0x7fa7d00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:23.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.603+0000 7fa7cbfff700 1 -- 172.21.15.156:0/3143656441 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fa7d804fd70 con 0x7fa7e409c790 2023-09-30T22:19:23.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.602+0000 7f15f3fff700 1 -- 172.21.15.156:0/131097910 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f15fc03f170 con 0x7f160c09e870 2023-09-30T22:19:23.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.602+0000 7f160affd700 1 -- 172.21.15.156:0/131097910 >> v1:172.21.15.156:6816/126965 conn(0x7f15f802f510 legacy=0x7f15f80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:23.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.602+0000 7f1611d9b700 1 -- 172.21.15.156:0/131097910 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f160c04f2a0 con 0x7f160c09e870 2023-09-30T22:19:23.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.603+0000 7fa7e9f9c700 1 -- 172.21.15.156:0/3143656441 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e404f2a0 con 0x7fa7e409c790 2023-09-30T22:19:23.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.611+0000 7f15f3fff700 1 -- 172.21.15.156:0/131097910 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f15fc017030 con 0x7f160c09e870 2023-09-30T22:19:23.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.612+0000 7fa7cbfff700 1 -- 172.21.15.156:0/3143656441 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa7d8028070 con 0x7fa7e409c790 2023-09-30T22:19:23.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.756+0000 7f33aaf43700 1 -- 172.21.15.156:0/3889734575 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f33a411f720 con 0x7f33a409e340 2023-09-30T22:19:23.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.756+0000 7f33a8cdf700 1 -- 172.21.15.156:0/3889734575 >> v1:172.21.15.156:6816/126965 conn(0x7f338802f510 legacy=0x7f33880319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:23.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.756+0000 7f33a17fa700 1 -- 172.21.15.156:0/3889734575 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3390021070 con 0x7f33a409e340 2023-09-30T22:19:23.756 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:23.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.758+0000 7f33aaf43700 1 -- 172.21.15.156:0/3889734575 >> v1:172.21.15.156:6816/126965 conn(0x7f338802f510 legacy=0x7f33880319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:23.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.758+0000 7f33aaf43700 1 -- 172.21.15.156:0/3889734575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33a409e340 msgr2=0x7f33a411c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:23.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.758+0000 7f33aaf43700 1 --2- 172.21.15.156:0/3889734575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33a409e340 0x7f33a411c830 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f339000e9b0 tx=0x7f339000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.758+0000 7f33aaf43700 1 -- 172.21.15.156:0/3889734575 shutdown_connections 2023-09-30T22:19:23.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.758+0000 7f33aaf43700 1 --2- 172.21.15.156:0/3889734575 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33a4135f20 0x7f33a411cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.758+0000 7f33aaf43700 1 --2- 172.21.15.156:0/3889734575 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33a409d860 0x7f33a411c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.758+0000 7f33aaf43700 1 --2- 172.21.15.156:0/3889734575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33a409e340 0x7f33a411c830 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.758+0000 7f33aaf43700 1 -- 172.21.15.156:0/3889734575 >> 172.21.15.156:0/3889734575 conn(0x7f33a4099c40 msgr2=0x7f33a406ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:23.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.758+0000 7f33aaf43700 1 -- 172.21.15.156:0/3889734575 shutdown_connections 2023-09-30T22:19:23.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.758+0000 7f33aaf43700 1 -- 172.21.15.156:0/3889734575 wait complete. 2023-09-30T22:19:23.770 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:23.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.803+0000 7f160affd700 1 -- 172.21.15.156:0/131097910 >> v1:172.21.15.156:6816/126965 conn(0x7f15f802f510 legacy=0x7f15f80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:23.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.804+0000 7fa7e37fe700 1 -- 172.21.15.156:0/3143656441 >> v1:172.21.15.156:6816/126965 conn(0x7fa7d002f510 legacy=0x7fa7d00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:23.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.806+0000 7f1611d9b700 1 -- 172.21.15.156:0/131097910 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f160c11ea80 con 0x7f160c09e870 2023-09-30T22:19:23.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.807+0000 7f15f3fff700 1 -- 172.21.15.156:0/131097910 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f15fc017020 con 0x7f160c09e870 2023-09-30T22:19:23.806 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:23.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.808+0000 7fa7e9f9c700 1 -- 172.21.15.156:0/3143656441 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa7e40a1020 con 0x7fa7e409c790 2023-09-30T22:19:23.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.808+0000 7fa7cbfff700 1 -- 172.21.15.156:0/3143656441 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa7d8003930 con 0x7fa7e409c790 2023-09-30T22:19:23.808 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:23.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.809+0000 7f1611d9b700 1 -- 172.21.15.156:0/131097910 >> v1:172.21.15.156:6816/126965 conn(0x7f15f802f510 legacy=0x7f15f80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:23.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.809+0000 7f1611d9b700 1 -- 172.21.15.156:0/131097910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f160c09e870 msgr2=0x7f160c11b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:23.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.809+0000 7f1611d9b700 1 --2- 172.21.15.156:0/131097910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f160c09e870 0x7f160c11b710 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f15fc00c4e0 tx=0x7f15fc00c7f0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.809+0000 7f1611d9b700 1 -- 172.21.15.156:0/131097910 shutdown_connections 2023-09-30T22:19:23.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.809+0000 7f1611d9b700 1 --2- 172.21.15.156:0/131097910 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f160c1371c0 0x7f160c11c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.809+0000 7f1611d9b700 1 --2- 172.21.15.156:0/131097910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f160c09e870 0x7f160c11b710 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.809+0000 7f1611d9b700 1 --2- 172.21.15.156:0/131097910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f160c09f350 0x7f160c11bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.809+0000 7f1611d9b700 1 -- 172.21.15.156:0/131097910 >> 172.21.15.156:0/131097910 conn(0x7f160c0a4430 msgr2=0x7f160c071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:23.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.809+0000 7f1611d9b700 1 -- 172.21.15.156:0/131097910 shutdown_connections 2023-09-30T22:19:23.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.809+0000 7f1611d9b700 1 -- 172.21.15.156:0/131097910 wait complete. 2023-09-30T22:19:23.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.810+0000 7fa7e9f9c700 1 -- 172.21.15.156:0/3143656441 >> v1:172.21.15.156:6816/126965 conn(0x7fa7d002f510 legacy=0x7fa7d00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:23.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.810+0000 7fa7e9f9c700 1 -- 172.21.15.156:0/3143656441 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7e409c790 msgr2=0x7fa7e41cce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:23.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.810+0000 7fa7e9f9c700 1 --2- 172.21.15.156:0/3143656441 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7e409c790 0x7fa7e41cce40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8000f60 tx=0x7fa7d800c730 comp rx=0 tx=0).stop 2023-09-30T22:19:23.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.810+0000 7fa7e9f9c700 1 -- 172.21.15.156:0/3143656441 shutdown_connections 2023-09-30T22:19:23.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.810+0000 7fa7e9f9c700 1 --2- 172.21.15.156:0/3143656441 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7e4131980 0x7fa7e41cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.810+0000 7fa7e9f9c700 1 --2- 172.21.15.156:0/3143656441 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7e409bc70 0x7fa7e41cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.810+0000 7fa7e9f9c700 1 --2- 172.21.15.156:0/3143656441 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7e409c790 0x7fa7e41cce40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:23.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.810+0000 7fa7e9f9c700 1 -- 172.21.15.156:0/3143656441 >> 172.21.15.156:0/3143656441 conn(0x7fa7e40a2980 msgr2=0x7fa7e406ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:23.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.811+0000 7fa7e9f9c700 1 -- 172.21.15.156:0/3143656441 shutdown_connections 2023-09-30T22:19:23.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:23.811+0000 7fa7e9f9c700 1 -- 172.21.15.156:0/3143656441 wait complete. 2023-09-30T22:19:23.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:23.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:24.538 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:24.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.669+0000 7f0bc196e700 1 Processor -- start 2023-09-30T22:19:24.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.669+0000 7f0bc196e700 1 -- start start 2023-09-30T22:19:24.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.670+0000 7f0bc196e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bbc133ad0 0x7f0bbc133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:24.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.670+0000 7f0bc196e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bbc130bc0 0x7f0bbc13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:24.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.670+0000 7f0bc196e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bbc06b2d0 con 0x7f0bbc1300a0 2023-09-30T22:19:24.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.670+0000 7f0bc196e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc133610 con 0x7f0bbc130bc0 2023-09-30T22:19:24.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.670+0000 7f0bc196e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc09a500 con 0x7f0bbc133ad0 2023-09-30T22:19:24.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.670+0000 7f0bbb7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bbc130bc0 0x7f0bbc13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:24.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.670+0000 7f0bbaffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bbc133ad0 0x7f0bbc133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:24.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.670+0000 7f0bbaffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bbc133ad0 0x7f0bbc133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43798/0 (socket says 172.21.15.156:43798) 2023-09-30T22:19:24.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.670+0000 7f0bba7fc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f0bbc1300a0 0x7f0bbc1304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38364/0 (socket says 172.21.15.156:38364) 2023-09-30T22:19:24.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.670+0000 7f0bbb7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bbc130bc0 0x7f0bbc13b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37894/0 (socket says 172.21.15.156:37894) 2023-09-30T22:19:24.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.670+0000 7f0bbaffd700 1 -- 172.21.15.156:0/2629980888 learned_addr learned my addr 172.21.15.156:0/2629980888 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:24.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.670+0000 7f0bbaffd700 1 -- 172.21.15.156:0/2629980888 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bbc130bc0 msgr2=0x7f0bbc13b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:24.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.670+0000 7f0bbaffd700 1 --2- 172.21.15.156:0/2629980888 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bbc130bc0 0x7f0bbc13b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:24.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.670+0000 7f0bbaffd700 1 -- 172.21.15.156:0/2629980888 >> v1:172.21.15.156:6789/0 conn(0x7f0bbc1300a0 legacy=0x7f0bbc1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:24.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.670+0000 7f0bb9ffb700 1 -- 172.21.15.156:0/2629980888 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 953404461 0 0) 0x7f0bbc06b2d0 con 0x7f0bbc1300a0 2023-09-30T22:19:24.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.670+0000 7f0bbaffd700 1 -- 172.21.15.156:0/2629980888 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bbc1338b0 con 0x7f0bbc133ad0 2023-09-30T22:19:24.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.670+0000 7f0bbb7fe700 1 --2- 172.21.15.156:0/2629980888 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bbc130bc0 0x7f0bbc13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:24.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.670+0000 7f0bbaffd700 1 --2- 172.21.15.156:0/2629980888 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bbc133ad0 0x7f0bbc133ea0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009920 tx=0x7f0bb0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ea3399441a7beb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:24.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.670+0000 7f0bb9ffb700 1 -- 172.21.15.156:0/2629980888 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0011830 con 0x7f0bbc133ad0 2023-09-30T22:19:24.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.671+0000 7f0bb9ffb700 1 -- 172.21.15.156:0/2629980888 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb0011990 con 0x7f0bbc133ad0 2023-09-30T22:19:24.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.671+0000 7f0bb9ffb700 1 -- 172.21.15.156:0/2629980888 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0011d20 con 0x7f0bbc133ad0 2023-09-30T22:19:24.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.671+0000 7f0bc196e700 1 -- 172.21.15.156:0/2629980888 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bbc133ad0 msgr2=0x7f0bbc133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:24.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.671+0000 7f0bc196e700 1 --2- 172.21.15.156:0/2629980888 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bbc133ad0 0x7f0bbc133ea0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009920 tx=0x7f0bb0009c30 comp rx=0 tx=0).stop 2023-09-30T22:19:24.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.671+0000 7f0bc196e700 1 -- 172.21.15.156:0/2629980888 shutdown_connections 2023-09-30T22:19:24.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.671+0000 7f0bc196e700 1 --2- 172.21.15.156:0/2629980888 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bbc130bc0 0x7f0bbc13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:24.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.671+0000 7f0bc196e700 1 --2- 172.21.15.156:0/2629980888 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bbc133ad0 0x7f0bbc133ea0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:24.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.671+0000 7f0bc196e700 1 -- 172.21.15.156:0/2629980888 >> 172.21.15.156:0/2629980888 conn(0x7f0bbc099c40 msgr2=0x7f0bbc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:24.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.671+0000 7f0bc196e700 1 -- 172.21.15.156:0/2629980888 shutdown_connections 2023-09-30T22:19:24.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.671+0000 7f0bc196e700 1 -- 172.21.15.156:0/2629980888 wait complete. 2023-09-30T22:19:24.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.672+0000 7f0bc196e700 1 Processor -- start 2023-09-30T22:19:24.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.672+0000 7f0bc196e700 1 -- start start 2023-09-30T22:19:24.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.673+0000 7f0bc196e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bbc1300a0 0x7f0bbc11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:24.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.673+0000 7f0bc196e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bbc130bc0 0x7f0bbc11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:24.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.673+0000 7f0bc196e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bbc133ad0 0x7f0bbc11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:24.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.673+0000 7f0bc196e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc120080 con 0x7f0bbc133ad0 2023-09-30T22:19:24.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.673+0000 7f0bc196e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc12dd00 con 0x7f0bbc1300a0 2023-09-30T22:19:24.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.673+0000 7f0bc196e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc1209f0 con 0x7f0bbc130bc0 2023-09-30T22:19:24.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.673+0000 7f0bba7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bbc130bc0 0x7f0bbc11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:24.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.673+0000 7f0bbb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bbc133ad0 0x7f0bbc11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:24.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.673+0000 7f0bbaffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bbc1300a0 0x7f0bbc11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:24.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.673+0000 7f0bbaffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bbc1300a0 0x7f0bbc11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37902/0 (socket says 172.21.15.156:37902) 2023-09-30T22:19:24.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.673+0000 7f0bba7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bbc130bc0 0x7f0bbc11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43810/0 (socket says 172.21.15.156:43810) 2023-09-30T22:19:24.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.673+0000 7f0bbb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bbc133ad0 0x7f0bbc11e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:55050/0 (socket says 172.21.15.156:55050) 2023-09-30T22:19:24.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.673+0000 7f0bbaffd700 1 -- 172.21.15.156:0/1525545891 learned_addr learned my addr 172.21.15.156:0/1525545891 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:24.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.673+0000 7f0bba7fc700 1 -- 172.21.15.156:0/1525545891 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bbc1300a0 msgr2=0x7f0bbc11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:24.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.673+0000 7f0bba7fc700 1 --2- 172.21.15.156:0/1525545891 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bbc1300a0 0x7f0bbc11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:24.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.673+0000 7f0bba7fc700 1 -- 172.21.15.156:0/1525545891 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bbc133ad0 msgr2=0x7f0bbc11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:24.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.673+0000 7f0bba7fc700 1 --2- 172.21.15.156:0/1525545891 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bbc133ad0 0x7f0bbc11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:24.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.673+0000 7f0bba7fc700 1 -- 172.21.15.156:0/1525545891 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb4009a70 con 0x7f0bbc130bc0 2023-09-30T22:19:24.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.673+0000 7f0bbaffd700 1 --2- 172.21.15.156:0/1525545891 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bbc1300a0 0x7f0bbc11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:24.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.673+0000 7f0bbb7fe700 1 --2- 172.21.15.156:0/1525545891 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bbc133ad0 0x7f0bbc11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:24.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.673+0000 7f0bba7fc700 1 --2- 172.21.15.156:0/1525545891 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bbc130bc0 0x7f0bbc11df80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc09ea20 tx=0x7f0bac00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:24.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.673+0000 7f0ba3fff700 1 -- 172.21.15.156:0/1525545891 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac004a70 con 0x7f0bbc130bc0 2023-09-30T22:19:24.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.673+0000 7f0ba3fff700 1 -- 172.21.15.156:0/1525545891 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bac004bd0 con 0x7f0bbc130bc0 2023-09-30T22:19:24.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.673+0000 7f0ba3fff700 1 -- 172.21.15.156:0/1525545891 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac0070d0 con 0x7f0bbc130bc0 2023-09-30T22:19:24.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.673+0000 7f0bc196e700 1 -- 172.21.15.156:0/1525545891 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb0009550 con 0x7f0bbc130bc0 2023-09-30T22:19:24.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.673+0000 7f0bc196e700 1 -- 172.21.15.156:0/1525545891 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bbc11f410 con 0x7f0bbc130bc0 2023-09-30T22:19:24.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.674+0000 7f0ba3fff700 1 -- 172.21.15.156:0/1525545891 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0bac007230 con 0x7f0bbc130bc0 2023-09-30T22:19:24.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.674+0000 7f0ba3fff700 1 -- 172.21.15.156:0/1525545891 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f0bac03f600 con 0x7f0bbc130bc0 2023-09-30T22:19:24.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.674+0000 7f0bbaffd700 1 -- 172.21.15.156:0/1525545891 >> v1:172.21.15.156:6816/126965 conn(0x7f0ba802f510 legacy=0x7f0ba80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:24.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.674+0000 7f0bc196e700 1 -- 172.21.15.156:0/1525545891 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bbc04f2a0 con 0x7f0bbc130bc0 2023-09-30T22:19:24.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.679+0000 7f0ba3fff700 1 -- 172.21.15.156:0/1525545891 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0bac01bb70 con 0x7f0bbc130bc0 2023-09-30T22:19:24.771 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:24.825 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:24.825 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:24.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.872+0000 7f0bc196e700 1 -- 172.21.15.156:0/1525545891 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0bbc12d930 con 0x7f0bbc130bc0 2023-09-30T22:19:24.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.872+0000 7f0ba3fff700 1 -- 172.21.15.156:0/1525545891 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0bac01b760 con 0x7f0bbc130bc0 2023-09-30T22:19:24.872 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:24.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.875+0000 7f0bbaffd700 1 -- 172.21.15.156:0/1525545891 >> v1:172.21.15.156:6816/126965 conn(0x7f0ba802f510 legacy=0x7f0ba80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:24.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.875+0000 7f0bc196e700 1 -- 172.21.15.156:0/1525545891 >> v1:172.21.15.156:6816/126965 conn(0x7f0ba802f510 legacy=0x7f0ba80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:24.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.875+0000 7f0bc196e700 1 -- 172.21.15.156:0/1525545891 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bbc130bc0 msgr2=0x7f0bbc11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:24.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.875+0000 7f0bc196e700 1 --2- 172.21.15.156:0/1525545891 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bbc130bc0 0x7f0bbc11df80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc09ea20 tx=0x7f0bac00c6a0 comp rx=0 tx=0).stop 2023-09-30T22:19:24.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.875+0000 7f0bc196e700 1 -- 172.21.15.156:0/1525545891 shutdown_connections 2023-09-30T22:19:24.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.875+0000 7f0bc196e700 1 --2- 172.21.15.156:0/1525545891 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bbc133ad0 0x7f0bbc11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:24.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.875+0000 7f0bc196e700 1 --2- 172.21.15.156:0/1525545891 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bbc1300a0 0x7f0bbc11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:24.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.875+0000 7f0bc196e700 1 --2- 172.21.15.156:0/1525545891 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bbc130bc0 0x7f0bbc11df80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:24.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.875+0000 7f0bc196e700 1 -- 172.21.15.156:0/1525545891 >> 172.21.15.156:0/1525545891 conn(0x7f0bbc099c40 msgr2=0x7f0bbc132070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:24.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.875+0000 7f0bc196e700 1 -- 172.21.15.156:0/1525545891 shutdown_connections 2023-09-30T22:19:24.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.875+0000 7f0bc196e700 1 -- 172.21.15.156:0/1525545891 wait complete. 2023-09-30T22:19:24.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:24.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.911+0000 7f75d2518700 1 Processor -- start 2023-09-30T22:19:24.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.911+0000 7f75d2518700 1 -- start start 2023-09-30T22:19:24.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.911+0000 7f75d2518700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75cc06a770 0x7f75cc06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:24.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.912+0000 7f75d2518700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f75cc136cb0 0x7f75cc139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:24.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.912+0000 7f75d2518700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75cc06e900 con 0x7f75cc09dec0 2023-09-30T22:19:24.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.912+0000 7f75d2518700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75cc09d180 con 0x7f75cc136cb0 2023-09-30T22:19:24.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.912+0000 7f75d2518700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc09e780 con 0x7f75cc06a770 2023-09-30T22:19:24.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.912+0000 7f75cb7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f75cc09dec0 0x7f75cc06b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38372/0 (socket says 172.21.15.156:38372) 2023-09-30T22:19:24.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.912+0000 7f75cb7fe700 1 -- 172.21.15.156:0/1449332113 learned_addr learned my addr 172.21.15.156:0/1449332113 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:24.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.912+0000 7f75d0ab5700 1 --2- 172.21.15.156:0/1449332113 >> v2:172.21.15.156:3300/0 conn(0x7f75cc136cb0 0x7f75cc139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:24.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.912+0000 7f75cbfff700 1 --2- 172.21.15.156:0/1449332113 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75cc06a770 0x7f75cc06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:24.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.912+0000 7f75d0ab5700 1 -- 172.21.15.156:0/1449332113 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75cc06a770 msgr2=0x7f75cc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:24.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.912+0000 7f75d0ab5700 1 --2- 172.21.15.156:0/1449332113 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75cc06a770 0x7f75cc06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:24.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.912+0000 7f75d0ab5700 1 -- 172.21.15.156:0/1449332113 >> v1:172.21.15.156:6789/0 conn(0x7f75cc09dec0 legacy=0x7f75cc06b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:24.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.912+0000 7f75caffd700 1 -- 172.21.15.156:0/1449332113 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541944080 0 0) 0x7f75cc06e900 con 0x7f75cc09dec0 2023-09-30T22:19:24.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.912+0000 7f75d0ab5700 1 -- 172.21.15.156:0/1449332113 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc09d3c0 con 0x7f75cc136cb0 2023-09-30T22:19:24.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.912+0000 7f75cbfff700 1 --2- 172.21.15.156:0/1449332113 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75cc06a770 0x7f75cc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:24.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.912+0000 7f75d0ab5700 1 --2- 172.21.15.156:0/1449332113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75cc136cb0 0x7f75cc139090 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f75c4009d90 tx=0x7f75c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861cfc0c995d9639 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:24.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.912+0000 7f75caffd700 1 -- 172.21.15.156:0/1449332113 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c400e070 con 0x7f75cc136cb0 2023-09-30T22:19:24.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.912+0000 7f75caffd700 1 -- 172.21.15.156:0/1449332113 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c400bb20 con 0x7f75cc136cb0 2023-09-30T22:19:24.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.912+0000 7f75caffd700 1 -- 172.21.15.156:0/1449332113 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c4012430 con 0x7f75cc136cb0 2023-09-30T22:19:24.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.913+0000 7f75d2518700 1 -- 172.21.15.156:0/1449332113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75cc136cb0 msgr2=0x7f75cc139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:24.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.913+0000 7f75d2518700 1 --2- 172.21.15.156:0/1449332113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75cc136cb0 0x7f75cc139090 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f75c4009d90 tx=0x7f75c400b330 comp rx=0 tx=0).stop 2023-09-30T22:19:24.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.913+0000 7f75d2518700 1 -- 172.21.15.156:0/1449332113 shutdown_connections 2023-09-30T22:19:24.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.913+0000 7f75d2518700 1 --2- 172.21.15.156:0/1449332113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75cc136cb0 0x7f75cc139090 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:24.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.913+0000 7f75d2518700 1 --2- 172.21.15.156:0/1449332113 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75cc06a770 0x7f75cc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:24.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.913+0000 7f75d2518700 1 -- 172.21.15.156:0/1449332113 >> 172.21.15.156:0/1449332113 conn(0x7f75cc099c40 msgr2=0x7f75cc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:24.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.913+0000 7f75d2518700 1 -- 172.21.15.156:0/1449332113 shutdown_connections 2023-09-30T22:19:24.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.913+0000 7f75d2518700 1 -- 172.21.15.156:0/1449332113 wait complete. 2023-09-30T22:19:24.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.914+0000 7f75d2518700 1 Processor -- start 2023-09-30T22:19:24.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.915+0000 7f75d2518700 1 -- start start 2023-09-30T22:19:24.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.915+0000 7f75d2518700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75cc06a770 0x7f75cc09a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:24.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.915+0000 7f75d2518700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75cc09dec0 0x7f75cc09a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:24.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.915+0000 7f75d2518700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75cc136cb0 0x7f75cc09aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:24.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.915+0000 7f75d2518700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc1367a0 con 0x7f75cc09dec0 2023-09-30T22:19:24.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.915+0000 7f75d2518700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc135800 con 0x7f75cc136cb0 2023-09-30T22:19:24.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.915+0000 7f75d2518700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc1392c0 con 0x7f75cc06a770 2023-09-30T22:19:24.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.915+0000 7f75cb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75cc09dec0 0x7f75cc09a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:24.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.915+0000 7f75cb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75cc09dec0 0x7f75cc09a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:55074/0 (socket says 172.21.15.156:55074) 2023-09-30T22:19:24.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.915+0000 7f75cbfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75cc06a770 0x7f75cc09a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:24.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.915+0000 7f75cb7fe700 1 -- 172.21.15.156:0/4244223606 learned_addr learned my addr 172.21.15.156:0/4244223606 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:24.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.915+0000 7f75d0ab5700 1 --2- 172.21.15.156:0/4244223606 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75cc136cb0 0x7f75cc09aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:24.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.915+0000 7f75cb7fe700 1 -- 172.21.15.156:0/4244223606 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75cc06a770 msgr2=0x7f75cc09a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:24.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.915+0000 7f75cb7fe700 1 --2- 172.21.15.156:0/4244223606 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75cc06a770 0x7f75cc09a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:24.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.915+0000 7f75cb7fe700 1 -- 172.21.15.156:0/4244223606 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75cc136cb0 msgr2=0x7f75cc09aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:24.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.915+0000 7f75cb7fe700 1 --2- 172.21.15.156:0/4244223606 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75cc136cb0 0x7f75cc09aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:24.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.915+0000 7f75cb7fe700 1 -- 172.21.15.156:0/4244223606 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc0094a0 con 0x7f75cc09dec0 2023-09-30T22:19:24.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.915+0000 7f75cbfff700 1 --2- 172.21.15.156:0/4244223606 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75cc06a770 0x7f75cc09a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:24.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.915+0000 7f75d0ab5700 1 --2- 172.21.15.156:0/4244223606 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75cc136cb0 0x7f75cc09aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:24.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.916+0000 7f75cb7fe700 1 --2- 172.21.15.156:0/4244223606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75cc09dec0 0x7f75cc09a9a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f75c000c520 tx=0x7f75c000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:24.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.916+0000 7f75c8ff9700 1 -- 172.21.15.156:0/4244223606 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c0004c80 con 0x7f75cc09dec0 2023-09-30T22:19:24.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.916+0000 7f75c8ff9700 1 -- 172.21.15.156:0/4244223606 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c0004e00 con 0x7f75cc09dec0 2023-09-30T22:19:24.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.916+0000 7f75d2518700 1 -- 172.21.15.156:0/4244223606 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c4009a70 con 0x7f75cc09dec0 2023-09-30T22:19:24.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.916+0000 7f75c8ff9700 1 -- 172.21.15.156:0/4244223606 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c0007310 con 0x7f75cc09dec0 2023-09-30T22:19:24.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.916+0000 7f75d2518700 1 -- 172.21.15.156:0/4244223606 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75cc135540 con 0x7f75cc09dec0 2023-09-30T22:19:24.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.917+0000 7f75c8ff9700 1 -- 172.21.15.156:0/4244223606 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f75c0007470 con 0x7f75cc09dec0 2023-09-30T22:19:24.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.917+0000 7f75c8ff9700 1 -- 172.21.15.156:0/4244223606 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f75c003f800 con 0x7f75cc09dec0 2023-09-30T22:19:24.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.917+0000 7f75cbfff700 1 -- 172.21.15.156:0/4244223606 >> v1:172.21.15.156:6816/126965 conn(0x7f75b802f510 legacy=0x7f75b80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:24.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.917+0000 7f75d2518700 1 -- 172.21.15.156:0/4244223606 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75cc04f2a0 con 0x7f75cc09dec0 2023-09-30T22:19:24.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.926+0000 7f75c8ff9700 1 -- 172.21.15.156:0/4244223606 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f75c00123b0 con 0x7f75cc09dec0 2023-09-30T22:19:24.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.957+0000 7f828df0e700 1 Processor -- start 2023-09-30T22:19:24.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.958+0000 7f828df0e700 1 -- start start 2023-09-30T22:19:24.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.958+0000 7f828df0e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f828806a770 0x7f828806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:24.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.958+0000 7f828df0e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f828806b080 0x7f82881317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:24.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.958+0000 7f828df0e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828809da80 con 0x7f8288131cf0 2023-09-30T22:19:24.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.958+0000 7f828df0e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f828809dce0 con 0x7f828806a770 2023-09-30T22:19:24.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.958+0000 7f828df0e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f828809eb20 con 0x7f828806b080 2023-09-30T22:19:24.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.958+0000 7f8286ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f828806b080 0x7f82881317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:24.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.958+0000 7f8286ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f828806b080 0x7f82881317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43840/0 (socket says 172.21.15.156:43840) 2023-09-30T22:19:24.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.958+0000 7f8286ffd700 1 -- 172.21.15.156:0/265047583 learned_addr learned my addr 172.21.15.156:0/265047583 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:24.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.958+0000 7f82877fe700 1 --2- 172.21.15.156:0/265047583 >> v2:172.21.15.156:3300/0 conn(0x7f828806a770 0x7f828806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:24.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.958+0000 7f8286ffd700 1 -- 172.21.15.156:0/265047583 >> v2:172.21.15.156:3300/0 conn(0x7f828806a770 msgr2=0x7f828806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:24.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.958+0000 7f8286ffd700 1 --2- 172.21.15.156:0/265047583 >> v2:172.21.15.156:3300/0 conn(0x7f828806a770 0x7f828806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:24.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.959+0000 7f8286ffd700 1 -- 172.21.15.156:0/265047583 >> v1:172.21.15.156:6789/0 conn(0x7f8288131cf0 legacy=0x7f8288138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:24.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.959+0000 7f8286ffd700 1 -- 172.21.15.156:0/265047583 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828809d860 con 0x7f828806b080 2023-09-30T22:19:24.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.959+0000 7f82877fe700 1 --2- 172.21.15.156:0/265047583 >> v2:172.21.15.156:3300/0 conn(0x7f828806a770 0x7f828806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:24.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.959+0000 7f8286ffd700 1 --2- 172.21.15.156:0/265047583 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f828806b080 0x7f82881317b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f827c0098f0 tx=0x7f827c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=673cd36cf7c796a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:24.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.959+0000 7f82867fc700 1 -- 172.21.15.156:0/265047583 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c011830 con 0x7f828806b080 2023-09-30T22:19:24.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.959+0000 7f82867fc700 1 -- 172.21.15.156:0/265047583 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827c011990 con 0x7f828806b080 2023-09-30T22:19:24.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.959+0000 7f82867fc700 1 -- 172.21.15.156:0/265047583 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c011d20 con 0x7f828806b080 2023-09-30T22:19:24.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.959+0000 7f828df0e700 1 -- 172.21.15.156:0/265047583 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f828806b080 msgr2=0x7f82881317b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:24.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.959+0000 7f828df0e700 1 --2- 172.21.15.156:0/265047583 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f828806b080 0x7f82881317b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f827c0098f0 tx=0x7f827c009c00 comp rx=0 tx=0).stop 2023-09-30T22:19:24.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.959+0000 7f828df0e700 1 -- 172.21.15.156:0/265047583 shutdown_connections 2023-09-30T22:19:24.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.959+0000 7f828df0e700 1 --2- 172.21.15.156:0/265047583 >> v2:172.21.15.156:3300/0 conn(0x7f828806a770 0x7f828806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:24.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.959+0000 7f828df0e700 1 --2- 172.21.15.156:0/265047583 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f828806b080 0x7f82881317b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:24.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.960+0000 7f828df0e700 1 -- 172.21.15.156:0/265047583 >> 172.21.15.156:0/265047583 conn(0x7f8288099c40 msgr2=0x7f82880a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:24.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.960+0000 7f828df0e700 1 -- 172.21.15.156:0/265047583 shutdown_connections 2023-09-30T22:19:24.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.960+0000 7f828df0e700 1 -- 172.21.15.156:0/265047583 wait complete. 2023-09-30T22:19:24.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.961+0000 7f828df0e700 1 Processor -- start 2023-09-30T22:19:24.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.961+0000 7f828df0e700 1 -- start start 2023-09-30T22:19:24.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.962+0000 7f828df0e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f828806a770 0x7f828809a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:24.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.962+0000 7f828df0e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f828806b080 0x7f828809a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:24.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.962+0000 7f828df0e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8288131cf0 0x7f828809af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:24.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.962+0000 7f828df0e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8288123ab0 con 0x7f828806b080 2023-09-30T22:19:24.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.962+0000 7f828df0e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8288123d90 con 0x7f828806a770 2023-09-30T22:19:24.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.962+0000 7f828df0e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82880a2a10 con 0x7f8288131cf0 2023-09-30T22:19:24.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.962+0000 7f8286ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f828806b080 0x7f828809a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:24.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.962+0000 7f8286ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f828806b080 0x7f828809a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:55098/0 (socket says 172.21.15.156:55098) 2023-09-30T22:19:24.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.962+0000 7f8286ffd700 1 -- 172.21.15.156:0/3375206932 learned_addr learned my addr 172.21.15.156:0/3375206932 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:24.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.962+0000 7f8287fff700 1 --2- 172.21.15.156:0/3375206932 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8288131cf0 0x7f828809af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:24.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.962+0000 7f82877fe700 1 --2- 172.21.15.156:0/3375206932 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f828806a770 0x7f828809a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:24.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.962+0000 7f8287fff700 1 -- 172.21.15.156:0/3375206932 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f828806a770 msgr2=0x7f828809a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:24.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.962+0000 7f8287fff700 1 --2- 172.21.15.156:0/3375206932 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f828806a770 0x7f828809a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:24.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.962+0000 7f8287fff700 1 -- 172.21.15.156:0/3375206932 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f828806b080 msgr2=0x7f828809a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:24.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.962+0000 7f8287fff700 1 --2- 172.21.15.156:0/3375206932 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f828806b080 0x7f828809a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:24.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.962+0000 7f8287fff700 1 -- 172.21.15.156:0/3375206932 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82780094a0 con 0x7f8288131cf0 2023-09-30T22:19:24.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.962+0000 7f8286ffd700 1 --2- 172.21.15.156:0/3375206932 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f828806b080 0x7f828809a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:24.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.963+0000 7f8287fff700 1 --2- 172.21.15.156:0/3375206932 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8288131cf0 0x7f828809af10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f828000cb90 tx=0x7f828000cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:24.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.963+0000 7f826ffff700 1 -- 172.21.15.156:0/3375206932 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280003c00 con 0x7f8288131cf0 2023-09-30T22:19:24.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.963+0000 7f826ffff700 1 -- 172.21.15.156:0/3375206932 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8280003d60 con 0x7f8288131cf0 2023-09-30T22:19:24.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.963+0000 7f826ffff700 1 -- 172.21.15.156:0/3375206932 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828000aa80 con 0x7f8288131cf0 2023-09-30T22:19:24.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.963+0000 7f828df0e700 1 -- 172.21.15.156:0/3375206932 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f827c009550 con 0x7f8288131cf0 2023-09-30T22:19:24.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.963+0000 7f828df0e700 1 -- 172.21.15.156:0/3375206932 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82881237f0 con 0x7f8288131cf0 2023-09-30T22:19:24.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.964+0000 7f826ffff700 1 -- 172.21.15.156:0/3375206932 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f828000abe0 con 0x7f8288131cf0 2023-09-30T22:19:24.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.964+0000 7f82877fe700 1 -- 172.21.15.156:0/3375206932 >> v1:172.21.15.156:6816/126965 conn(0x7f827402f510 legacy=0x7f82740319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:24.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.964+0000 7f826ffff700 1 -- 172.21.15.156:0/3375206932 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f828003fba0 con 0x7f8288131cf0 2023-09-30T22:19:24.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.964+0000 7f828df0e700 1 -- 172.21.15.156:0/3375206932 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828811add0 con 0x7f8288131cf0 2023-09-30T22:19:24.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.968+0000 7f826ffff700 1 -- 172.21.15.156:0/3375206932 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f82800050d0 con 0x7f8288131cf0 2023-09-30T22:19:24.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.970+0000 7f7100447700 1 Processor -- start 2023-09-30T22:19:24.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.970+0000 7f7100447700 1 -- start start 2023-09-30T22:19:24.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.971+0000 7f7100447700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70f809d860 0x7f70f809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:24.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.971+0000 7f7100447700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f70f809e170 0x7f70f81307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:24.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.971+0000 7f7100447700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f809aaa0 con 0x7f70f8130ce0 2023-09-30T22:19:24.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.971+0000 7f7100447700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f809f870 con 0x7f70f809e170 2023-09-30T22:19:24.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.971+0000 7f7100447700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f809b360 con 0x7f70f809d860 2023-09-30T22:19:24.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.971+0000 7f70fd9e2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f70f809e170 0x7f70f81307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:24.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.971+0000 7f70fe1e3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70f809d860 0x7f70f809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:24.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.971+0000 7f70fd9e2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f70f809e170 0x7f70f81307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:55114/0 (socket says 172.21.15.156:55114) 2023-09-30T22:19:24.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.971+0000 7f70fe1e3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70f809d860 0x7f70f809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37934/0 (socket says 172.21.15.156:37934) 2023-09-30T22:19:24.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.971+0000 7f70fe9e4700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f70f8130ce0 0x7f70f81379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38380/0 (socket says 172.21.15.156:38380) 2023-09-30T22:19:24.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.971+0000 7f70fd9e2700 1 -- 172.21.15.156:0/3971851417 learned_addr learned my addr 172.21.15.156:0/3971851417 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:24.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.971+0000 7f70fd9e2700 1 -- 172.21.15.156:0/3971851417 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70f809d860 msgr2=0x7f70f809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:24.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.971+0000 7f70fd9e2700 1 --2- 172.21.15.156:0/3971851417 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70f809d860 0x7f70f809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:24.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.971+0000 7f70fd9e2700 1 -- 172.21.15.156:0/3971851417 >> v1:172.21.15.156:6789/0 conn(0x7f70f8130ce0 legacy=0x7f70f81379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:24.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.971+0000 7f70fd9e2700 1 -- 172.21.15.156:0/3971851417 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f809b620 con 0x7f70f809e170 2023-09-30T22:19:24.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.972+0000 7f70fd9e2700 1 --2- 172.21.15.156:0/3971851417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70f809e170 0x7f70f81307a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f70e800b9a0 tx=0x7f70e800bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8419e5c070103e31 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:24.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.972+0000 7f70fd1e1700 1 -- 172.21.15.156:0/3971851417 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e800caa0 con 0x7f70f809e170 2023-09-30T22:19:24.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.972+0000 7f70fd1e1700 1 -- 172.21.15.156:0/3971851417 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e800cc00 con 0x7f70f809e170 2023-09-30T22:19:24.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.972+0000 7f70fd1e1700 1 -- 172.21.15.156:0/3971851417 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e800f460 con 0x7f70f809e170 2023-09-30T22:19:24.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.973+0000 7f7100447700 1 -- 172.21.15.156:0/3971851417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70f809e170 msgr2=0x7f70f81307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:24.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.973+0000 7f7100447700 1 --2- 172.21.15.156:0/3971851417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70f809e170 0x7f70f81307a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f70e800b9a0 tx=0x7f70e800bcb0 comp rx=0 tx=0).stop 2023-09-30T22:19:24.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.973+0000 7f7100447700 1 -- 172.21.15.156:0/3971851417 shutdown_connections 2023-09-30T22:19:24.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.973+0000 7f7100447700 1 --2- 172.21.15.156:0/3971851417 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70f809d860 0x7f70f809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:24.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.973+0000 7f7100447700 1 --2- 172.21.15.156:0/3971851417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70f809e170 0x7f70f81307a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:24.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.973+0000 7f7100447700 1 -- 172.21.15.156:0/3971851417 >> 172.21.15.156:0/3971851417 conn(0x7f70f8099c40 msgr2=0x7f70f80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:24.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.973+0000 7f7100447700 1 -- 172.21.15.156:0/3971851417 shutdown_connections 2023-09-30T22:19:24.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.973+0000 7f7100447700 1 -- 172.21.15.156:0/3971851417 wait complete. 2023-09-30T22:19:24.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.974+0000 7f7100447700 1 Processor -- start 2023-09-30T22:19:24.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.974+0000 7f7100447700 1 -- start start 2023-09-30T22:19:24.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.975+0000 7f7100447700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70f809d860 0x7f70f811e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:24.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.975+0000 7f7100447700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70f809e170 0x7f70f811ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:24.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.975+0000 7f7100447700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70f8130ce0 0x7f70f811f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:24.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.975+0000 7f7100447700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f8120870 con 0x7f70f8130ce0 2023-09-30T22:19:24.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.975+0000 7f7100447700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f81203d0 con 0x7f70f809d860 2023-09-30T22:19:24.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.975+0000 7f7100447700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70f8130610 con 0x7f70f809e170 2023-09-30T22:19:24.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.975+0000 7f70fe1e3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70f809d860 0x7f70f811e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:24.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.975+0000 7f70fe1e3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70f809d860 0x7f70f811e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37944/0 (socket says 172.21.15.156:37944) 2023-09-30T22:19:24.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.975+0000 7f70fe1e3700 1 -- 172.21.15.156:0/3405523394 learned_addr learned my addr 172.21.15.156:0/3405523394 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:24.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.975+0000 7f70fd9e2700 1 --2- 172.21.15.156:0/3405523394 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70f809e170 0x7f70f811ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:24.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.975+0000 7f70fe9e4700 1 --2- 172.21.15.156:0/3405523394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70f8130ce0 0x7f70f811f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:24.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.975+0000 7f70fe9e4700 1 -- 172.21.15.156:0/3405523394 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70f809e170 msgr2=0x7f70f811ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:24.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.975+0000 7f70fe9e4700 1 --2- 172.21.15.156:0/3405523394 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70f809e170 0x7f70f811ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:24.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.975+0000 7f70fe9e4700 1 -- 172.21.15.156:0/3405523394 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70f809d860 msgr2=0x7f70f811e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:24.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.975+0000 7f70fe9e4700 1 --2- 172.21.15.156:0/3405523394 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70f809d860 0x7f70f811e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:24.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.975+0000 7f70fe9e4700 1 -- 172.21.15.156:0/3405523394 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e800b600 con 0x7f70f8130ce0 2023-09-30T22:19:24.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.975+0000 7f70fd9e2700 1 --2- 172.21.15.156:0/3405523394 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70f809e170 0x7f70f811ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:24.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.975+0000 7f70fe9e4700 1 --2- 172.21.15.156:0/3405523394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70f8130ce0 0x7f70f811f130 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f70f000cb10 tx=0x7f70f000ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:24.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.976+0000 7f70eeffd700 1 -- 172.21.15.156:0/3405523394 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f000a9e0 con 0x7f70f8130ce0 2023-09-30T22:19:24.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.976+0000 7f70eeffd700 1 -- 172.21.15.156:0/3405523394 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f000ab40 con 0x7f70f8130ce0 2023-09-30T22:19:24.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.976+0000 7f7100447700 1 -- 172.21.15.156:0/3405523394 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f8121c30 con 0x7f70f8130ce0 2023-09-30T22:19:24.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.976+0000 7f70eeffd700 1 -- 172.21.15.156:0/3405523394 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f0007070 con 0x7f70f8130ce0 2023-09-30T22:19:24.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.976+0000 7f7100447700 1 -- 172.21.15.156:0/3405523394 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f8120ab0 con 0x7f70f8130ce0 2023-09-30T22:19:24.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.976+0000 7f70eeffd700 1 -- 172.21.15.156:0/3405523394 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f70f00071d0 con 0x7f70f8130ce0 2023-09-30T22:19:24.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.977+0000 7f70eeffd700 1 -- 172.21.15.156:0/3405523394 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f70f003f810 con 0x7f70f8130ce0 2023-09-30T22:19:24.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.977+0000 7f70fe1e3700 1 -- 172.21.15.156:0/3405523394 >> v1:172.21.15.156:6816/126965 conn(0x7f70dc02f510 legacy=0x7f70dc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:24.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.977+0000 7f7100447700 1 -- 172.21.15.156:0/3405523394 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f804f2a0 con 0x7f70f8130ce0 2023-09-30T22:19:24.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:24.982+0000 7f70eeffd700 1 -- 172.21.15.156:0/3405523394 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f70f0017020 con 0x7f70f8130ce0 2023-09-30T22:19:25.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.118+0000 7f75cbfff700 1 -- 172.21.15.156:0/4244223606 >> v1:172.21.15.156:6816/126965 conn(0x7f75b802f510 legacy=0x7f75b80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:25.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.122+0000 7f75d2518700 1 -- 172.21.15.156:0/4244223606 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f75cc09e3a0 con 0x7f75cc09dec0 2023-09-30T22:19:25.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.123+0000 7f75c8ff9700 1 -- 172.21.15.156:0/4244223606 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f75c00102c0 con 0x7f75cc09dec0 2023-09-30T22:19:25.122 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:25.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.125+0000 7f75d2518700 1 -- 172.21.15.156:0/4244223606 >> v1:172.21.15.156:6816/126965 conn(0x7f75b802f510 legacy=0x7f75b80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:25.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.125+0000 7f75d2518700 1 -- 172.21.15.156:0/4244223606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75cc09dec0 msgr2=0x7f75cc09a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:25.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.125+0000 7f75d2518700 1 --2- 172.21.15.156:0/4244223606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75cc09dec0 0x7f75cc09a9a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f75c000c520 tx=0x7f75c000c830 comp rx=0 tx=0).stop 2023-09-30T22:19:25.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.125+0000 7f75d2518700 1 -- 172.21.15.156:0/4244223606 shutdown_connections 2023-09-30T22:19:25.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.125+0000 7f75d2518700 1 --2- 172.21.15.156:0/4244223606 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75cc136cb0 0x7f75cc09aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:25.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.125+0000 7f75d2518700 1 --2- 172.21.15.156:0/4244223606 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75cc06a770 0x7f75cc09a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:25.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.125+0000 7f75d2518700 1 --2- 172.21.15.156:0/4244223606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75cc09dec0 0x7f75cc09a9a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:25.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.125+0000 7f75d2518700 1 -- 172.21.15.156:0/4244223606 >> 172.21.15.156:0/4244223606 conn(0x7f75cc099c40 msgr2=0x7f75cc0a2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:25.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.125+0000 7f75d2518700 1 -- 172.21.15.156:0/4244223606 shutdown_connections 2023-09-30T22:19:25.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.125+0000 7f75d2518700 1 -- 172.21.15.156:0/4244223606 wait complete. 2023-09-30T22:19:25.137 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:25.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.164+0000 7f828df0e700 1 -- 172.21.15.156:0/3375206932 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f828804f2a0 con 0x7f8288131cf0 2023-09-30T22:19:25.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.164+0000 7f826ffff700 1 -- 172.21.15.156:0/3375206932 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8280019300 con 0x7f8288131cf0 2023-09-30T22:19:25.164 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:25.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.165+0000 7f82877fe700 1 -- 172.21.15.156:0/3375206932 >> v1:172.21.15.156:6816/126965 conn(0x7f827402f510 legacy=0x7f82740319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:25.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.167+0000 7f828df0e700 1 -- 172.21.15.156:0/3375206932 >> v1:172.21.15.156:6816/126965 conn(0x7f827402f510 legacy=0x7f82740319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:25.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.167+0000 7f828df0e700 1 -- 172.21.15.156:0/3375206932 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8288131cf0 msgr2=0x7f828809af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:25.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.167+0000 7f828df0e700 1 --2- 172.21.15.156:0/3375206932 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8288131cf0 0x7f828809af10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f828000cb90 tx=0x7f828000cea0 comp rx=0 tx=0).stop 2023-09-30T22:19:25.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.167+0000 7f828df0e700 1 -- 172.21.15.156:0/3375206932 shutdown_connections 2023-09-30T22:19:25.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.167+0000 7f828df0e700 1 --2- 172.21.15.156:0/3375206932 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8288131cf0 0x7f828809af10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:25.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.167+0000 7f828df0e700 1 --2- 172.21.15.156:0/3375206932 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f828806a770 0x7f828809a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:25.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.167+0000 7f828df0e700 1 --2- 172.21.15.156:0/3375206932 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f828806b080 0x7f828809a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:25.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.167+0000 7f828df0e700 1 -- 172.21.15.156:0/3375206932 >> 172.21.15.156:0/3375206932 conn(0x7f8288099c40 msgr2=0x7f828812ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:25.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.167+0000 7f828df0e700 1 -- 172.21.15.156:0/3375206932 shutdown_connections 2023-09-30T22:19:25.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.167+0000 7f828df0e700 1 -- 172.21.15.156:0/3375206932 wait complete. 2023-09-30T22:19:25.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.178+0000 7f70fe1e3700 1 -- 172.21.15.156:0/3405523394 >> v1:172.21.15.156:6816/126965 conn(0x7f70dc02f510 legacy=0x7f70dc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:25.183 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:25.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.185+0000 7f7100447700 1 -- 172.21.15.156:0/3405523394 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f70f806c3b0 con 0x7f70f8130ce0 2023-09-30T22:19:25.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.186+0000 7f70eeffd700 1 -- 172.21.15.156:0/3405523394 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f70f001b3b0 con 0x7f70f8130ce0 2023-09-30T22:19:25.185 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:25.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.188+0000 7f7100447700 1 -- 172.21.15.156:0/3405523394 >> v1:172.21.15.156:6816/126965 conn(0x7f70dc02f510 legacy=0x7f70dc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:25.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.188+0000 7f7100447700 1 -- 172.21.15.156:0/3405523394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70f8130ce0 msgr2=0x7f70f811f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:25.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.188+0000 7f7100447700 1 --2- 172.21.15.156:0/3405523394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70f8130ce0 0x7f70f811f130 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f70f000cb10 tx=0x7f70f000ce20 comp rx=0 tx=0).stop 2023-09-30T22:19:25.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.188+0000 7f7100447700 1 -- 172.21.15.156:0/3405523394 shutdown_connections 2023-09-30T22:19:25.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.188+0000 7f7100447700 1 --2- 172.21.15.156:0/3405523394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70f8130ce0 0x7f70f811f130 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:25.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.188+0000 7f7100447700 1 --2- 172.21.15.156:0/3405523394 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70f809d860 0x7f70f811e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:25.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.188+0000 7f7100447700 1 --2- 172.21.15.156:0/3405523394 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70f809e170 0x7f70f811ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:25.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.188+0000 7f7100447700 1 -- 172.21.15.156:0/3405523394 >> 172.21.15.156:0/3405523394 conn(0x7f70f8099c40 msgr2=0x7f70f80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:25.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.188+0000 7f7100447700 1 -- 172.21.15.156:0/3405523394 shutdown_connections 2023-09-30T22:19:25.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:25.188+0000 7f7100447700 1 -- 172.21.15.156:0/3405523394 wait complete. 2023-09-30T22:19:25.200 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:25.890 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:26.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.021+0000 7f339047f700 1 Processor -- start 2023-09-30T22:19:26.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.021+0000 7f339047f700 1 -- start start 2023-09-30T22:19:26.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.021+0000 7f339047f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3388131980 0x7f3388131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:26.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.021+0000 7f339047f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f338809bc70 0x7f338809c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:26.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.021+0000 7f339047f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f338809c5c0 0x7f3388138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:26.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.021+0000 7f339047f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f338806eb30 con 0x7f338809c5c0 2023-09-30T22:19:26.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.021+0000 7f339047f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33880a1640 con 0x7f3388131980 2023-09-30T22:19:26.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.021+0000 7f339047f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33880a22d0 con 0x7f338809bc70 2023-09-30T22:19:26.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.021+0000 7f338da1a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f338809bc70 0x7f338809c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:26.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.021+0000 7f338e21b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3388131980 0x7f3388131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:26.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.021+0000 7f338ea1c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f338809c5c0 0x7f3388138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:26.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.021+0000 7f338ea1c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f338809c5c0 0x7f3388138700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:55134/0 (socket says 172.21.15.156:55134) 2023-09-30T22:19:26.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.021+0000 7f338da1a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f338809bc70 0x7f338809c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43866/0 (socket says 172.21.15.156:43866) 2023-09-30T22:19:26.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.021+0000 7f338ea1c700 1 -- 172.21.15.156:0/1388372769 learned_addr learned my addr 172.21.15.156:0/1388372769 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:26.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.021+0000 7f338e21b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3388131980 0x7f3388131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37950/0 (socket says 172.21.15.156:37950) 2023-09-30T22:19:26.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.022+0000 7f338e21b700 1 -- 172.21.15.156:0/1388372769 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f338809bc70 msgr2=0x7f338809c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:26.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.022+0000 7f338e21b700 1 --2- 172.21.15.156:0/1388372769 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f338809bc70 0x7f338809c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.022+0000 7f338e21b700 1 -- 172.21.15.156:0/1388372769 >> v2:172.21.15.156:3300/0 conn(0x7f338809c5c0 msgr2=0x7f3388138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:26.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.022+0000 7f338e21b700 1 --2- 172.21.15.156:0/1388372769 >> v2:172.21.15.156:3300/0 conn(0x7f338809c5c0 0x7f3388138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.022+0000 7f338e21b700 1 -- 172.21.15.156:0/1388372769 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3388131550 con 0x7f3388131980 2023-09-30T22:19:26.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.022+0000 7f338da1a700 1 --2- 172.21.15.156:0/1388372769 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f338809bc70 0x7f338809c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:26.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.022+0000 7f338ea1c700 1 --2- 172.21.15.156:0/1388372769 >> v2:172.21.15.156:3300/0 conn(0x7f338809c5c0 0x7f3388138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:26.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.022+0000 7f338e21b700 1 --2- 172.21.15.156:0/1388372769 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3388131980 0x7f3388131d50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3378009820 tx=0x7f3378009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=574b0ea62432cfc5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:26.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.022+0000 7f338d219700 1 -- 172.21.15.156:0/1388372769 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3378005e30 con 0x7f3388131980 2023-09-30T22:19:26.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.022+0000 7f338d219700 1 -- 172.21.15.156:0/1388372769 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3378006030 con 0x7f3388131980 2023-09-30T22:19:26.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.022+0000 7f338d219700 1 -- 172.21.15.156:0/1388372769 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33780063c0 con 0x7f3388131980 2023-09-30T22:19:26.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.022+0000 7f339047f700 1 -- 172.21.15.156:0/1388372769 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3388131980 msgr2=0x7f3388131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:26.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.022+0000 7f339047f700 1 --2- 172.21.15.156:0/1388372769 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3388131980 0x7f3388131d50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3378009820 tx=0x7f3378009b30 comp rx=0 tx=0).stop 2023-09-30T22:19:26.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.023+0000 7f339047f700 1 -- 172.21.15.156:0/1388372769 shutdown_connections 2023-09-30T22:19:26.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.023+0000 7f339047f700 1 --2- 172.21.15.156:0/1388372769 >> v2:172.21.15.156:3300/0 conn(0x7f338809c5c0 0x7f3388138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.023+0000 7f339047f700 1 --2- 172.21.15.156:0/1388372769 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3388131980 0x7f3388131d50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.023+0000 7f339047f700 1 --2- 172.21.15.156:0/1388372769 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f338809bc70 0x7f338809c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.023+0000 7f339047f700 1 -- 172.21.15.156:0/1388372769 >> 172.21.15.156:0/1388372769 conn(0x7f33880a2980 msgr2=0x7f33880a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:26.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.023+0000 7f339047f700 1 -- 172.21.15.156:0/1388372769 shutdown_connections 2023-09-30T22:19:26.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.023+0000 7f339047f700 1 -- 172.21.15.156:0/1388372769 wait complete. 2023-09-30T22:19:26.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.023+0000 7f339047f700 1 Processor -- start 2023-09-30T22:19:26.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.024+0000 7f339047f700 1 -- start start 2023-09-30T22:19:26.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.024+0000 7f339047f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f338809bc70 0x7f3388099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:26.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.024+0000 7f339047f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f338809c5c0 0x7f3388099fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:26.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.024+0000 7f339047f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3388131980 0x7f338809a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:26.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.024+0000 7f339047f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3388121350 con 0x7f3388131980 2023-09-30T22:19:26.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.024+0000 7f339047f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3388120ae0 con 0x7f338809bc70 2023-09-30T22:19:26.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.024+0000 7f339047f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f338809b6a0 con 0x7f338809c5c0 2023-09-30T22:19:26.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.024+0000 7f338e21b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f338809bc70 0x7f3388099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:26.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.024+0000 7f338da1a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f338809c5c0 0x7f3388099fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:26.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.024+0000 7f338e21b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f338809bc70 0x7f3388099a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37966/0 (socket says 172.21.15.156:37966) 2023-09-30T22:19:26.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.024+0000 7f338da1a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f338809c5c0 0x7f3388099fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43878/0 (socket says 172.21.15.156:43878) 2023-09-30T22:19:26.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.024+0000 7f338e21b700 1 -- 172.21.15.156:0/1340429773 learned_addr learned my addr 172.21.15.156:0/1340429773 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:26.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.024+0000 7f338ea1c700 1 --2- 172.21.15.156:0/1340429773 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3388131980 0x7f338809a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:26.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.024+0000 7f338da1a700 1 -- 172.21.15.156:0/1340429773 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f338809bc70 msgr2=0x7f3388099a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:26.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.024+0000 7f338da1a700 1 --2- 172.21.15.156:0/1340429773 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f338809bc70 0x7f3388099a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.024+0000 7f338da1a700 1 -- 172.21.15.156:0/1340429773 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3388131980 msgr2=0x7f338809a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:26.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.024+0000 7f338da1a700 1 --2- 172.21.15.156:0/1340429773 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3388131980 0x7f338809a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.024+0000 7f338da1a700 1 -- 172.21.15.156:0/1340429773 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33840094a0 con 0x7f338809c5c0 2023-09-30T22:19:26.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.024+0000 7f338e21b700 1 --2- 172.21.15.156:0/1340429773 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f338809bc70 0x7f3388099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:26.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.024+0000 7f338da1a700 1 --2- 172.21.15.156:0/1340429773 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f338809c5c0 0x7f3388099fd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f33880a0ee0 tx=0x7f338400ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:26.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.025+0000 7f337effd700 1 -- 172.21.15.156:0/1340429773 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3384004240 con 0x7f338809c5c0 2023-09-30T22:19:26.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.025+0000 7f337effd700 1 -- 172.21.15.156:0/1340429773 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33840043a0 con 0x7f338809c5c0 2023-09-30T22:19:26.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.025+0000 7f339047f700 1 -- 172.21.15.156:0/1340429773 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3380009b30 con 0x7f338809c5c0 2023-09-30T22:19:26.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.025+0000 7f337effd700 1 -- 172.21.15.156:0/1340429773 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33840036a0 con 0x7f338809c5c0 2023-09-30T22:19:26.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.025+0000 7f339047f700 1 -- 172.21.15.156:0/1340429773 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3378009430 con 0x7f338809c5c0 2023-09-30T22:19:26.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.025+0000 7f337effd700 1 -- 172.21.15.156:0/1340429773 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3384003800 con 0x7f338809c5c0 2023-09-30T22:19:26.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.026+0000 7f337effd700 1 -- 172.21.15.156:0/1340429773 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f338403fbf0 con 0x7f338809c5c0 2023-09-30T22:19:26.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.026+0000 7f338e21b700 1 -- 172.21.15.156:0/1340429773 >> v1:172.21.15.156:6816/126965 conn(0x7f336c02f510 legacy=0x7f336c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:26.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.026+0000 7f339047f700 1 -- 172.21.15.156:0/1340429773 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3388120690 con 0x7f338809c5c0 2023-09-30T22:19:26.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.030+0000 7f337effd700 1 -- 172.21.15.156:0/1340429773 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3384013470 con 0x7f338809c5c0 2023-09-30T22:19:26.137 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:26.184 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:26.201 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:26.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.221+0000 7f339047f700 1 -- 172.21.15.156:0/1340429773 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3388130c40 con 0x7f338809c5c0 2023-09-30T22:19:26.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.221+0000 7f337effd700 1 -- 172.21.15.156:0/1340429773 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f338402a090 con 0x7f338809c5c0 2023-09-30T22:19:26.222 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:26.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.224+0000 7f339047f700 1 -- 172.21.15.156:0/1340429773 >> v1:172.21.15.156:6816/126965 conn(0x7f336c02f510 legacy=0x7f336c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:26.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.224+0000 7f339047f700 1 -- 172.21.15.156:0/1340429773 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f338809c5c0 msgr2=0x7f3388099fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:26.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.224+0000 7f339047f700 1 --2- 172.21.15.156:0/1340429773 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f338809c5c0 0x7f3388099fd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f33880a0ee0 tx=0x7f338400ec60 comp rx=0 tx=0).stop 2023-09-30T22:19:26.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.224+0000 7f339047f700 1 -- 172.21.15.156:0/1340429773 shutdown_connections 2023-09-30T22:19:26.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.224+0000 7f339047f700 1 --2- 172.21.15.156:0/1340429773 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3388131980 0x7f338809a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.224+0000 7f339047f700 1 --2- 172.21.15.156:0/1340429773 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f338809bc70 0x7f3388099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.224+0000 7f339047f700 1 --2- 172.21.15.156:0/1340429773 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f338809c5c0 0x7f3388099fd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.224+0000 7f339047f700 1 -- 172.21.15.156:0/1340429773 >> 172.21.15.156:0/1340429773 conn(0x7f33880a2980 msgr2=0x7f338809f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:26.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.224+0000 7f339047f700 1 -- 172.21.15.156:0/1340429773 shutdown_connections 2023-09-30T22:19:26.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.224+0000 7f339047f700 1 -- 172.21.15.156:0/1340429773 wait complete. 2023-09-30T22:19:26.239 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:26.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.269+0000 7f41dd0fd700 1 Processor -- start 2023-09-30T22:19:26.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.269+0000 7f41dd0fd700 1 -- start start 2023-09-30T22:19:26.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.269+0000 7f41dd0fd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41d809f350 0x7f41d8138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:26.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.269+0000 7f41dd0fd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41d81393a0 0x7f41d813b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:26.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.269+0000 7f41dd0fd700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d809fa00 con 0x7f41d809e870 2023-09-30T22:19:26.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.269+0000 7f41dd0fd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d80a0370 con 0x7f41d81393a0 2023-09-30T22:19:26.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.269+0000 7f41dd0fd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41d806bec0 con 0x7f41d809f350 2023-09-30T22:19:26.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.270+0000 7f41d659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41d809f350 0x7f41d8138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:26.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.270+0000 7f41d659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41d809f350 0x7f41d8138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43882/0 (socket says 172.21.15.156:43882) 2023-09-30T22:19:26.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.270+0000 7f41d659c700 1 -- 172.21.15.156:0/394081996 learned_addr learned my addr 172.21.15.156:0/394081996 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:26.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.270+0000 7f41d759e700 1 --2- 172.21.15.156:0/394081996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41d81393a0 0x7f41d813b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:26.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.270+0000 7f41d5d9b700 1 -- 172.21.15.156:0/394081996 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1764566588 0 0) 0x7f41d809fa00 con 0x7f41d809e870 2023-09-30T22:19:26.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.270+0000 7f41d759e700 1 -- 172.21.15.156:0/394081996 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41d809f350 msgr2=0x7f41d8138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:26.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.270+0000 7f41d759e700 1 --2- 172.21.15.156:0/394081996 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41d809f350 0x7f41d8138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.270+0000 7f41d759e700 1 -- 172.21.15.156:0/394081996 >> v1:172.21.15.156:6789/0 conn(0x7f41d809e870 legacy=0x7f41d809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:26.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.270+0000 7f41d759e700 1 -- 172.21.15.156:0/394081996 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d809ada0 con 0x7f41d81393a0 2023-09-30T22:19:26.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.270+0000 7f41d659c700 1 --2- 172.21.15.156:0/394081996 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41d809f350 0x7f41d8138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:26.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.270+0000 7f41d759e700 1 --2- 172.21.15.156:0/394081996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41d81393a0 0x7f41d813b780 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f41d0009dc0 tx=0x7f41d000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1fb758a7fd951e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:26.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.270+0000 7f41d5d9b700 1 -- 172.21.15.156:0/394081996 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d000e070 con 0x7f41d81393a0 2023-09-30T22:19:26.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.270+0000 7f41d5d9b700 1 -- 172.21.15.156:0/394081996 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d000bb20 con 0x7f41d81393a0 2023-09-30T22:19:26.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.270+0000 7f41d5d9b700 1 -- 172.21.15.156:0/394081996 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d0012430 con 0x7f41d81393a0 2023-09-30T22:19:26.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.271+0000 7f41dd0fd700 1 -- 172.21.15.156:0/394081996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41d81393a0 msgr2=0x7f41d813b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:26.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.271+0000 7f41dd0fd700 1 --2- 172.21.15.156:0/394081996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41d81393a0 0x7f41d813b780 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f41d0009dc0 tx=0x7f41d000b330 comp rx=0 tx=0).stop 2023-09-30T22:19:26.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.271+0000 7f41dd0fd700 1 -- 172.21.15.156:0/394081996 shutdown_connections 2023-09-30T22:19:26.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.271+0000 7f41dd0fd700 1 --2- 172.21.15.156:0/394081996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41d81393a0 0x7f41d813b780 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.271+0000 7f41dd0fd700 1 --2- 172.21.15.156:0/394081996 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41d809f350 0x7f41d8138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.271+0000 7f41dd0fd700 1 -- 172.21.15.156:0/394081996 >> 172.21.15.156:0/394081996 conn(0x7f41d80a4430 msgr2=0x7f41d80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:26.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.271+0000 7f41dd0fd700 1 -- 172.21.15.156:0/394081996 shutdown_connections 2023-09-30T22:19:26.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.271+0000 7f41dd0fd700 1 -- 172.21.15.156:0/394081996 wait complete. 2023-09-30T22:19:26.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.272+0000 7f41dd0fd700 1 Processor -- start 2023-09-30T22:19:26.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.272+0000 7f41dd0fd700 1 -- start start 2023-09-30T22:19:26.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.273+0000 7f41dd0fd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41d809e870 0x7f41d811ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:26.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.273+0000 7f41dd0fd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41d809f350 0x7f41d811f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:26.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.273+0000 7f41dd0fd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41d81393a0 0x7f41d811f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:26.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.273+0000 7f41dd0fd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d8121ed0 con 0x7f41d809e870 2023-09-30T22:19:26.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.273+0000 7f41dd0fd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d806cfa0 con 0x7f41d809f350 2023-09-30T22:19:26.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.273+0000 7f41dd0fd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41d81220b0 con 0x7f41d81393a0 2023-09-30T22:19:26.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.273+0000 7f41d6d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41d809e870 0x7f41d811ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:26.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.273+0000 7f41d6d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41d809e870 0x7f41d811ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:55160/0 (socket says 172.21.15.156:55160) 2023-09-30T22:19:26.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.273+0000 7f41d6d9d700 1 -- 172.21.15.156:0/3727972801 learned_addr learned my addr 172.21.15.156:0/3727972801 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:26.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.273+0000 7f41d759e700 1 --2- 172.21.15.156:0/3727972801 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41d81393a0 0x7f41d811f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:26.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.273+0000 7f41d659c700 1 --2- 172.21.15.156:0/3727972801 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41d809f350 0x7f41d811f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:26.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.273+0000 7f41d659c700 1 -- 172.21.15.156:0/3727972801 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41d81393a0 msgr2=0x7f41d811f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:26.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.273+0000 7f41d659c700 1 --2- 172.21.15.156:0/3727972801 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41d81393a0 0x7f41d811f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.273+0000 7f41d659c700 1 -- 172.21.15.156:0/3727972801 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41d809e870 msgr2=0x7f41d811ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:26.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.273+0000 7f41d659c700 1 --2- 172.21.15.156:0/3727972801 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41d809e870 0x7f41d811ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.273+0000 7f41d659c700 1 -- 172.21.15.156:0/3727972801 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41cc009550 con 0x7f41d809f350 2023-09-30T22:19:26.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.273+0000 7f41d6d9d700 1 --2- 172.21.15.156:0/3727972801 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41d809e870 0x7f41d811ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:26.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.273+0000 7f41d659c700 1 --2- 172.21.15.156:0/3727972801 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41d809f350 0x7f41d811f010 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00e9d0 tx=0x7f41cc00ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:26.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.274+0000 7f41bf7fe700 1 -- 172.21.15.156:0/3727972801 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc00ee70 con 0x7f41d809f350 2023-09-30T22:19:26.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.274+0000 7f41bf7fe700 1 -- 172.21.15.156:0/3727972801 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc004030 con 0x7f41d809f350 2023-09-30T22:19:26.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.274+0000 7f41bf7fe700 1 -- 172.21.15.156:0/3727972801 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc0043c0 con 0x7f41d809f350 2023-09-30T22:19:26.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.274+0000 7f41dd0fd700 1 -- 172.21.15.156:0/3727972801 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d0009a70 con 0x7f41d809f350 2023-09-30T22:19:26.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.274+0000 7f41dd0fd700 1 -- 172.21.15.156:0/3727972801 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d8120c00 con 0x7f41d809f350 2023-09-30T22:19:26.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.275+0000 7f41bf7fe700 1 -- 172.21.15.156:0/3727972801 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f41cc00c850 con 0x7f41d809f350 2023-09-30T22:19:26.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.275+0000 7f41d6d9d700 1 -- 172.21.15.156:0/3727972801 >> v1:172.21.15.156:6816/126965 conn(0x7f41c402f510 legacy=0x7f41c40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:26.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.275+0000 7f41bf7fe700 1 -- 172.21.15.156:0/3727972801 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f41cc03fb30 con 0x7f41d809f350 2023-09-30T22:19:26.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.275+0000 7f41dd0fd700 1 -- 172.21.15.156:0/3727972801 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41d804f2a0 con 0x7f41d809f350 2023-09-30T22:19:26.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.280+0000 7f41bf7fe700 1 -- 172.21.15.156:0/3727972801 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f41cc019d40 con 0x7f41d809f350 2023-09-30T22:19:26.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.315+0000 7f5a2f1b7700 1 Processor -- start 2023-09-30T22:19:26.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.315+0000 7f5a2f1b7700 1 -- start start 2023-09-30T22:19:26.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.315+0000 7f5a2f1b7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a2809f350 0x7f5a28136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:26.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.315+0000 7f5a2f1b7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5a281371c0 0x7f5a281395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:26.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.315+0000 7f5a2f1b7700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a2809c970 con 0x7f5a2809e870 2023-09-30T22:19:26.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.315+0000 7f5a2f1b7700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a280a0920 con 0x7f5a281371c0 2023-09-30T22:19:26.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.315+0000 7f5a2f1b7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2809f9c0 con 0x7f5a2809f350 2023-09-30T22:19:26.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.315+0000 7f5a27fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a2809f350 0x7f5a28136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:26.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.315+0000 7f5a27fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a2809f350 0x7f5a28136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43902/0 (socket says 172.21.15.156:43902) 2023-09-30T22:19:26.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.315+0000 7f5a27fff700 1 -- 172.21.15.156:0/1713705015 learned_addr learned my addr 172.21.15.156:0/1713705015 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:26.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.316+0000 7f5a2d754700 1 --2- 172.21.15.156:0/1713705015 >> v2:172.21.15.156:3300/0 conn(0x7f5a281371c0 0x7f5a281395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:26.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.316+0000 7f5a2d754700 1 -- 172.21.15.156:0/1713705015 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a2809f350 msgr2=0x7f5a28136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:26.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.316+0000 7f5a2d754700 1 --2- 172.21.15.156:0/1713705015 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a2809f350 0x7f5a28136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.316+0000 7f5a2d754700 1 -- 172.21.15.156:0/1713705015 >> v1:172.21.15.156:6789/0 conn(0x7f5a2809e870 legacy=0x7f5a2809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:26.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.316+0000 7f5a277fe700 1 -- 172.21.15.156:0/1713705015 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2265111881 0 0) 0x7f5a2809c970 con 0x7f5a2809e870 2023-09-30T22:19:26.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.316+0000 7f5a2d754700 1 -- 172.21.15.156:0/1713705015 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2809bab0 con 0x7f5a281371c0 2023-09-30T22:19:26.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.316+0000 7f5a27fff700 1 --2- 172.21.15.156:0/1713705015 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a2809f350 0x7f5a28136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:26.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.316+0000 7f5a2d754700 1 --2- 172.21.15.156:0/1713705015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a281371c0 0x7f5a281395a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5a20009d90 tx=0x7f5a2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d0367c1e1160c8e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:26.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.316+0000 7f5a277fe700 1 -- 172.21.15.156:0/1713705015 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2000e070 con 0x7f5a281371c0 2023-09-30T22:19:26.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.316+0000 7f5a277fe700 1 -- 172.21.15.156:0/1713705015 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2000bb20 con 0x7f5a281371c0 2023-09-30T22:19:26.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.316+0000 7f5a277fe700 1 -- 172.21.15.156:0/1713705015 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a20012430 con 0x7f5a281371c0 2023-09-30T22:19:26.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.317+0000 7f5a2f1b7700 1 -- 172.21.15.156:0/1713705015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a281371c0 msgr2=0x7f5a281395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:26.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.317+0000 7f5a2f1b7700 1 --2- 172.21.15.156:0/1713705015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a281371c0 0x7f5a281395a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5a20009d90 tx=0x7f5a2000b330 comp rx=0 tx=0).stop 2023-09-30T22:19:26.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.317+0000 7f5a2f1b7700 1 -- 172.21.15.156:0/1713705015 shutdown_connections 2023-09-30T22:19:26.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.317+0000 7f5a2f1b7700 1 --2- 172.21.15.156:0/1713705015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a281371c0 0x7f5a281395a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.317+0000 7f5a2f1b7700 1 --2- 172.21.15.156:0/1713705015 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a2809f350 0x7f5a28136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.317+0000 7f5a2f1b7700 1 -- 172.21.15.156:0/1713705015 >> 172.21.15.156:0/1713705015 conn(0x7f5a280a4430 msgr2=0x7f5a280a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:26.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.317+0000 7f5a2f1b7700 1 -- 172.21.15.156:0/1713705015 shutdown_connections 2023-09-30T22:19:26.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.317+0000 7f5a2f1b7700 1 -- 172.21.15.156:0/1713705015 wait complete. 2023-09-30T22:19:26.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.318+0000 7f5a2f1b7700 1 Processor -- start 2023-09-30T22:19:26.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.318+0000 7f5a2f1b7700 1 -- start start 2023-09-30T22:19:26.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.319+0000 7f5a2f1b7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a2809e870 0x7f5a2806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:26.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.319+0000 7f5a2f1b7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a2809f350 0x7f5a2806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:26.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.319+0000 7f5a2f1b7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a281371c0 0x7f5a2806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:26.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.319+0000 7f5a2f1b7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a28126480 con 0x7f5a281371c0 2023-09-30T22:19:26.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.319+0000 7f5a2f1b7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2806d4c0 con 0x7f5a2809f350 2023-09-30T22:19:26.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.319+0000 7f5a2f1b7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a28072230 con 0x7f5a2809e870 2023-09-30T22:19:26.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.319+0000 7f5a2d754700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a281371c0 0x7f5a2806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:26.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.319+0000 7f5a27fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a2809f350 0x7f5a2806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:26.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.319+0000 7f5a27fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a2809f350 0x7f5a2806bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37988/0 (socket says 172.21.15.156:37988) 2023-09-30T22:19:26.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.319+0000 7f5a27fff700 1 -- 172.21.15.156:0/1547241362 learned_addr learned my addr 172.21.15.156:0/1547241362 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:26.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.319+0000 7f5a2cf53700 1 --2- 172.21.15.156:0/1547241362 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a2809e870 0x7f5a2806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:26.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.319+0000 7f5a2d754700 1 -- 172.21.15.156:0/1547241362 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a2809e870 msgr2=0x7f5a2806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:26.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.319+0000 7f5a2d754700 1 --2- 172.21.15.156:0/1547241362 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a2809e870 0x7f5a2806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.319+0000 7f5a2d754700 1 -- 172.21.15.156:0/1547241362 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a2809f350 msgr2=0x7f5a2806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:26.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.320+0000 7f5a2d754700 1 --2- 172.21.15.156:0/1547241362 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a2809f350 0x7f5a2806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.320+0000 7f5a2d754700 1 -- 172.21.15.156:0/1547241362 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a14009550 con 0x7f5a281371c0 2023-09-30T22:19:26.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.320+0000 7f5a2cf53700 1 --2- 172.21.15.156:0/1547241362 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a2809e870 0x7f5a2806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:26.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.320+0000 7f5a27fff700 1 --2- 172.21.15.156:0/1547241362 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a2809f350 0x7f5a2806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:26.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.320+0000 7f5a2d754700 1 --2- 172.21.15.156:0/1547241362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a281371c0 0x7f5a2806c330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5a20016000 tx=0x7f5a20004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:26.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.320+0000 7f5a257fa700 1 -- 172.21.15.156:0/1547241362 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a20012430 con 0x7f5a281371c0 2023-09-30T22:19:26.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.320+0000 7f5a257fa700 1 -- 172.21.15.156:0/1547241362 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a20020070 con 0x7f5a281371c0 2023-09-30T22:19:26.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.320+0000 7f5a2f1b7700 1 -- 172.21.15.156:0/1547241362 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a20009a70 con 0x7f5a281371c0 2023-09-30T22:19:26.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.320+0000 7f5a257fa700 1 -- 172.21.15.156:0/1547241362 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a20004280 con 0x7f5a281371c0 2023-09-30T22:19:26.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.320+0000 7f5a2f1b7700 1 -- 172.21.15.156:0/1547241362 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a28124d60 con 0x7f5a281371c0 2023-09-30T22:19:26.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.321+0000 7f5a2f1b7700 1 -- 172.21.15.156:0/1547241362 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a2804f2a0 con 0x7f5a281371c0 2023-09-30T22:19:26.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.321+0000 7f5a257fa700 1 -- 172.21.15.156:0/1547241362 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5a200043e0 con 0x7f5a281371c0 2023-09-30T22:19:26.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.321+0000 7f5a257fa700 1 -- 172.21.15.156:0/1547241362 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f5a20022070 con 0x7f5a281371c0 2023-09-30T22:19:26.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.321+0000 7f5a2cf53700 1 -- 172.21.15.156:0/1547241362 >> v1:172.21.15.156:6816/126965 conn(0x7f5a0c02f510 legacy=0x7f5a0c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:26.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.326+0000 7f5a257fa700 1 -- 172.21.15.156:0/1547241362 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5a2001b400 con 0x7f5a281371c0 2023-09-30T22:19:26.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.365+0000 7f0bed85e700 1 Processor -- start 2023-09-30T22:19:26.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.365+0000 7f0bed85e700 1 -- start start 2023-09-30T22:19:26.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.365+0000 7f0bed85e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0be80a1550 0x7f0be8138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:26.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.365+0000 7f0bed85e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0be8139200 0x7f0be813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:26.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.365+0000 7f0bed85e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0be809e9d0 con 0x7f0be80a0a70 2023-09-30T22:19:26.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.366+0000 7f0bed85e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0be809dc00 con 0x7f0be80a1550 2023-09-30T22:19:26.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.366+0000 7f0bed85e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0be809dec0 con 0x7f0be8139200 2023-09-30T22:19:26.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.366+0000 7f0be67fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0be80a1550 0x7f0be8138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:26.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.366+0000 7f0be67fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0be80a1550 0x7f0be8138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:55190/0 (socket says 172.21.15.156:55190) 2023-09-30T22:19:26.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.366+0000 7f0be6ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f0be80a0a70 0x7f0be80a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38416/0 (socket says 172.21.15.156:38416) 2023-09-30T22:19:26.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.366+0000 7f0be67fc700 1 -- 172.21.15.156:0/2175723687 learned_addr learned my addr 172.21.15.156:0/2175723687 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:26.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.366+0000 7f0be77fe700 1 --2- 172.21.15.156:0/2175723687 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0be8139200 0x7f0be813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:26.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.366+0000 7f0be67fc700 1 -- 172.21.15.156:0/2175723687 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0be8139200 msgr2=0x7f0be813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:26.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.366+0000 7f0be67fc700 1 --2- 172.21.15.156:0/2175723687 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0be8139200 0x7f0be813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.366+0000 7f0be67fc700 1 -- 172.21.15.156:0/2175723687 >> v1:172.21.15.156:6789/0 conn(0x7f0be80a0a70 legacy=0x7f0be80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:26.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.366+0000 7f0be67fc700 1 -- 172.21.15.156:0/2175723687 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be809e6a0 con 0x7f0be80a1550 2023-09-30T22:19:26.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.366+0000 7f0be5ffb700 1 -- 172.21.15.156:0/2175723687 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036637537 0 0) 0x7f0be809e9d0 con 0x7f0be80a0a70 2023-09-30T22:19:26.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.366+0000 7f0be77fe700 1 --2- 172.21.15.156:0/2175723687 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0be8139200 0x7f0be813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:26.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.366+0000 7f0be67fc700 1 --2- 172.21.15.156:0/2175723687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0be80a1550 0x7f0be8138cc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0098f0 tx=0x7f0bdc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365f1fefe4d7c672 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:26.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.366+0000 7f0be5ffb700 1 -- 172.21.15.156:0/2175723687 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc011830 con 0x7f0be80a1550 2023-09-30T22:19:26.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.366+0000 7f0be5ffb700 1 -- 172.21.15.156:0/2175723687 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bdc011990 con 0x7f0be80a1550 2023-09-30T22:19:26.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.366+0000 7f0be5ffb700 1 -- 172.21.15.156:0/2175723687 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc011d20 con 0x7f0be80a1550 2023-09-30T22:19:26.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.367+0000 7f0bed85e700 1 -- 172.21.15.156:0/2175723687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0be80a1550 msgr2=0x7f0be8138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:26.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.367+0000 7f0bed85e700 1 --2- 172.21.15.156:0/2175723687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0be80a1550 0x7f0be8138cc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0098f0 tx=0x7f0bdc009c00 comp rx=0 tx=0).stop 2023-09-30T22:19:26.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.367+0000 7f0bed85e700 1 -- 172.21.15.156:0/2175723687 shutdown_connections 2023-09-30T22:19:26.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.367+0000 7f0bed85e700 1 --2- 172.21.15.156:0/2175723687 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0be8139200 0x7f0be813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.367+0000 7f0bed85e700 1 --2- 172.21.15.156:0/2175723687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0be80a1550 0x7f0be8138cc0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.367+0000 7f0bed85e700 1 -- 172.21.15.156:0/2175723687 >> 172.21.15.156:0/2175723687 conn(0x7f0be80a6610 msgr2=0x7f0be80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:26.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.367+0000 7f0bed85e700 1 -- 172.21.15.156:0/2175723687 shutdown_connections 2023-09-30T22:19:26.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.367+0000 7f0bed85e700 1 -- 172.21.15.156:0/2175723687 wait complete. 2023-09-30T22:19:26.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.368+0000 7f0bed85e700 1 Processor -- start 2023-09-30T22:19:26.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.368+0000 7f0bed85e700 1 -- start start 2023-09-30T22:19:26.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.369+0000 7f0bed85e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0be80a0a70 0x7f0be811e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:26.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.369+0000 7f0bed85e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0be80a1550 0x7f0be811ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:26.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.369+0000 7f0bed85e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0be8139200 0x7f0be811f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:26.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.369+0000 7f0bed85e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be81219d0 con 0x7f0be80a0a70 2023-09-30T22:19:26.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.369+0000 7f0bed85e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be80a5100 con 0x7f0be8139200 2023-09-30T22:19:26.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.369+0000 7f0bed85e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0be80a03e0 con 0x7f0be80a1550 2023-09-30T22:19:26.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.369+0000 7f0be6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0be80a0a70 0x7f0be811e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:26.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.369+0000 7f0be77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0be8139200 0x7f0be811f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:26.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.369+0000 7f0be6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0be80a0a70 0x7f0be811e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:55202/0 (socket says 172.21.15.156:55202) 2023-09-30T22:19:26.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.369+0000 7f0be6ffd700 1 -- 172.21.15.156:0/2076503752 learned_addr learned my addr 172.21.15.156:0/2076503752 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:26.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.369+0000 7f0be67fc700 1 --2- 172.21.15.156:0/2076503752 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0be80a1550 0x7f0be811ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:26.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.369+0000 7f0be6ffd700 1 -- 172.21.15.156:0/2076503752 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0be80a1550 msgr2=0x7f0be811ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:26.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.369+0000 7f0be6ffd700 1 --2- 172.21.15.156:0/2076503752 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0be80a1550 0x7f0be811ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.369+0000 7f0be6ffd700 1 -- 172.21.15.156:0/2076503752 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0be8139200 msgr2=0x7f0be811f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:26.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.369+0000 7f0be6ffd700 1 --2- 172.21.15.156:0/2076503752 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0be8139200 0x7f0be811f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.369+0000 7f0be6ffd700 1 -- 172.21.15.156:0/2076503752 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be0009a70 con 0x7f0be80a0a70 2023-09-30T22:19:26.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.369+0000 7f0be6ffd700 1 --2- 172.21.15.156:0/2076503752 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0be80a0a70 0x7f0be811e770 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0bd800c520 tx=0x7f0bd800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:26.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.369+0000 7f0bcffff700 1 -- 172.21.15.156:0/2076503752 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8004c80 con 0x7f0be80a0a70 2023-09-30T22:19:26.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.370+0000 7f0bcffff700 1 -- 172.21.15.156:0/2076503752 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd8004de0 con 0x7f0be80a0a70 2023-09-30T22:19:26.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.370+0000 7f0bed85e700 1 -- 172.21.15.156:0/2076503752 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bdc009550 con 0x7f0be80a0a70 2023-09-30T22:19:26.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.370+0000 7f0bcffff700 1 -- 172.21.15.156:0/2076503752 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8007310 con 0x7f0be80a0a70 2023-09-30T22:19:26.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.370+0000 7f0bed85e700 1 -- 172.21.15.156:0/2076503752 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be8120ae0 con 0x7f0be80a0a70 2023-09-30T22:19:26.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.370+0000 7f0bcffff700 1 -- 172.21.15.156:0/2076503752 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0bd8007470 con 0x7f0be80a0a70 2023-09-30T22:19:26.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.371+0000 7f0be67fc700 1 -- 172.21.15.156:0/2076503752 >> v1:172.21.15.156:6816/126965 conn(0x7f0bd402f510 legacy=0x7f0bd40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:26.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.371+0000 7f0bcffff700 1 -- 172.21.15.156:0/2076503752 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f0bd803f870 con 0x7f0be80a0a70 2023-09-30T22:19:26.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.372+0000 7f0bed85e700 1 -- 172.21.15.156:0/2076503752 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0be8134610 con 0x7f0be80a0a70 2023-09-30T22:19:26.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.380+0000 7f0bcffff700 1 -- 172.21.15.156:0/2076503752 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0bd80123b0 con 0x7f0be80a0a70 2023-09-30T22:19:26.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.476+0000 7f41d6d9d700 1 -- 172.21.15.156:0/3727972801 >> v1:172.21.15.156:6816/126965 conn(0x7f41c402f510 legacy=0x7f41c40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:26.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.480+0000 7f41dd0fd700 1 -- 172.21.15.156:0/3727972801 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f41d8072d60 con 0x7f41d809f350 2023-09-30T22:19:26.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.481+0000 7f41bf7fe700 1 -- 172.21.15.156:0/3727972801 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f41cc019300 con 0x7f41d809f350 2023-09-30T22:19:26.480 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:26.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.483+0000 7f41dd0fd700 1 -- 172.21.15.156:0/3727972801 >> v1:172.21.15.156:6816/126965 conn(0x7f41c402f510 legacy=0x7f41c40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:26.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.483+0000 7f41dd0fd700 1 -- 172.21.15.156:0/3727972801 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41d809f350 msgr2=0x7f41d811f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:26.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.483+0000 7f41dd0fd700 1 --2- 172.21.15.156:0/3727972801 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41d809f350 0x7f41d811f010 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00e9d0 tx=0x7f41cc00ece0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.483+0000 7f41dd0fd700 1 -- 172.21.15.156:0/3727972801 shutdown_connections 2023-09-30T22:19:26.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.483+0000 7f41dd0fd700 1 --2- 172.21.15.156:0/3727972801 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41d81393a0 0x7f41d811f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.483+0000 7f41dd0fd700 1 --2- 172.21.15.156:0/3727972801 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41d809e870 0x7f41d811ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.483+0000 7f41dd0fd700 1 --2- 172.21.15.156:0/3727972801 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41d809f350 0x7f41d811f010 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.483+0000 7f41dd0fd700 1 -- 172.21.15.156:0/3727972801 >> 172.21.15.156:0/3727972801 conn(0x7f41d80a4430 msgr2=0x7f41d8136dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:26.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.483+0000 7f41dd0fd700 1 -- 172.21.15.156:0/3727972801 shutdown_connections 2023-09-30T22:19:26.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.483+0000 7f41dd0fd700 1 -- 172.21.15.156:0/3727972801 wait complete. 2023-09-30T22:19:26.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:26.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.523+0000 7f5a2cf53700 1 -- 172.21.15.156:0/1547241362 >> v1:172.21.15.156:6816/126965 conn(0x7f5a0c02f510 legacy=0x7f5a0c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:26.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.553+0000 7f5a2f1b7700 1 -- 172.21.15.156:0/1547241362 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5a2806b2a0 con 0x7f5a281371c0 2023-09-30T22:19:26.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.553+0000 7f5a257fa700 1 -- 172.21.15.156:0/1547241362 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5a200263e0 con 0x7f5a281371c0 2023-09-30T22:19:26.553 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:26.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.555+0000 7f5a2f1b7700 1 -- 172.21.15.156:0/1547241362 >> v1:172.21.15.156:6816/126965 conn(0x7f5a0c02f510 legacy=0x7f5a0c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:26.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.555+0000 7f5a2f1b7700 1 -- 172.21.15.156:0/1547241362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a281371c0 msgr2=0x7f5a2806c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:26.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.555+0000 7f5a2f1b7700 1 --2- 172.21.15.156:0/1547241362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a281371c0 0x7f5a2806c330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5a20016000 tx=0x7f5a20004ad0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.555+0000 7f5a2f1b7700 1 -- 172.21.15.156:0/1547241362 shutdown_connections 2023-09-30T22:19:26.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.555+0000 7f5a2f1b7700 1 --2- 172.21.15.156:0/1547241362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a281371c0 0x7f5a2806c330 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.555+0000 7f5a2f1b7700 1 --2- 172.21.15.156:0/1547241362 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a2809e870 0x7f5a2806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.555+0000 7f5a2f1b7700 1 --2- 172.21.15.156:0/1547241362 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a2809f350 0x7f5a2806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.555+0000 7f5a2f1b7700 1 -- 172.21.15.156:0/1547241362 >> 172.21.15.156:0/1547241362 conn(0x7f5a280a4430 msgr2=0x7f5a280a28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:26.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.555+0000 7f5a2f1b7700 1 -- 172.21.15.156:0/1547241362 shutdown_connections 2023-09-30T22:19:26.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.555+0000 7f5a2f1b7700 1 -- 172.21.15.156:0/1547241362 wait complete. 2023-09-30T22:19:26.567 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:26.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.572+0000 7f0be67fc700 1 -- 172.21.15.156:0/2076503752 >> v1:172.21.15.156:6816/126965 conn(0x7f0bd402f510 legacy=0x7f0bd40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:26.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.592+0000 7f0bed85e700 1 -- 172.21.15.156:0/2076503752 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0be804f2a0 con 0x7f0be80a0a70 2023-09-30T22:19:26.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.592+0000 7f0bcffff700 1 -- 172.21.15.156:0/2076503752 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0bd800ce60 con 0x7f0be80a0a70 2023-09-30T22:19:26.593 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:26.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.595+0000 7f0bed85e700 1 -- 172.21.15.156:0/2076503752 >> v1:172.21.15.156:6816/126965 conn(0x7f0bd402f510 legacy=0x7f0bd40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:26.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.595+0000 7f0bed85e700 1 -- 172.21.15.156:0/2076503752 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0be80a0a70 msgr2=0x7f0be811e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:26.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.595+0000 7f0bed85e700 1 --2- 172.21.15.156:0/2076503752 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0be80a0a70 0x7f0be811e770 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0bd800c520 tx=0x7f0bd800c830 comp rx=0 tx=0).stop 2023-09-30T22:19:26.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.595+0000 7f0bed85e700 1 -- 172.21.15.156:0/2076503752 shutdown_connections 2023-09-30T22:19:26.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.595+0000 7f0bed85e700 1 --2- 172.21.15.156:0/2076503752 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0be8139200 0x7f0be811f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.595+0000 7f0bed85e700 1 --2- 172.21.15.156:0/2076503752 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0be80a0a70 0x7f0be811e770 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.595+0000 7f0bed85e700 1 --2- 172.21.15.156:0/2076503752 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0be80a1550 0x7f0be811ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:26.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.595+0000 7f0bed85e700 1 -- 172.21.15.156:0/2076503752 >> 172.21.15.156:0/2076503752 conn(0x7f0be80a6610 msgr2=0x7f0be80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:26.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.595+0000 7f0bed85e700 1 -- 172.21.15.156:0/2076503752 shutdown_connections 2023-09-30T22:19:26.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:26.595+0000 7f0bed85e700 1 -- 172.21.15.156:0/2076503752 wait complete. 2023-09-30T22:19:26.607 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:27.240 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:27.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.364+0000 7f4e66c43700 1 Processor -- start 2023-09-30T22:19:27.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.364+0000 7f4e66c43700 1 -- start start 2023-09-30T22:19:27.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.365+0000 7f4e66c43700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4e6012cef0 0x7f4e6012d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:27.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.365+0000 7f4e66c43700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e60134020 0x7f4e6013b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:27.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.365+0000 7f4e66c43700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e6009ac40 con 0x7f4e60133540 2023-09-30T22:19:27.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.365+0000 7f4e66c43700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e6009a740 con 0x7f4e6012cef0 2023-09-30T22:19:27.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.365+0000 7f4e66c43700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6009f3a0 con 0x7f4e60134020 2023-09-30T22:19:27.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.365+0000 7f4e649df700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4e6012cef0 0x7f4e6012d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:27.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.365+0000 7f4e651e0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e60134020 0x7f4e6013b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:27.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.365+0000 7f4e649df700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4e6012cef0 0x7f4e6012d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:55206/0 (socket says 172.21.15.156:55206) 2023-09-30T22:19:27.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.365+0000 7f4e649df700 1 -- 172.21.15.156:0/1975303231 learned_addr learned my addr 172.21.15.156:0/1975303231 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:27.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.365+0000 7f4e649df700 1 -- 172.21.15.156:0/1975303231 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e60134020 msgr2=0x7f4e6013b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:27.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.365+0000 7f4e649df700 1 --2- 172.21.15.156:0/1975303231 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e60134020 0x7f4e6013b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.365+0000 7f4e649df700 1 -- 172.21.15.156:0/1975303231 >> v1:172.21.15.156:6789/0 conn(0x7f4e60133540 legacy=0x7f4e60133910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.365+0000 7f4e649df700 1 -- 172.21.15.156:0/1975303231 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6009b010 con 0x7f4e6012cef0 2023-09-30T22:19:27.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.365+0000 7f4e651e0700 1 --2- 172.21.15.156:0/1975303231 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e60134020 0x7f4e6013b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:27.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.366+0000 7f4e649df700 1 --2- 172.21.15.156:0/1975303231 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e6012cef0 0x7f4e6012d2c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4e540098f0 tx=0x7f4e54009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63166d091e4b1c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:27.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.366+0000 7f4e5f7fe700 1 -- 172.21.15.156:0/1975303231 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e54011830 con 0x7f4e6012cef0 2023-09-30T22:19:27.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.366+0000 7f4e5f7fe700 1 -- 172.21.15.156:0/1975303231 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e54011990 con 0x7f4e6012cef0 2023-09-30T22:19:27.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.366+0000 7f4e5f7fe700 1 -- 172.21.15.156:0/1975303231 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e54011d20 con 0x7f4e6012cef0 2023-09-30T22:19:27.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.366+0000 7f4e66c43700 1 -- 172.21.15.156:0/1975303231 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e6012cef0 msgr2=0x7f4e6012d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.366+0000 7f4e66c43700 1 --2- 172.21.15.156:0/1975303231 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e6012cef0 0x7f4e6012d2c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4e540098f0 tx=0x7f4e54009c00 comp rx=0 tx=0).stop 2023-09-30T22:19:27.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.366+0000 7f4e66c43700 1 -- 172.21.15.156:0/1975303231 shutdown_connections 2023-09-30T22:19:27.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.366+0000 7f4e66c43700 1 --2- 172.21.15.156:0/1975303231 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e60134020 0x7f4e6013b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.366+0000 7f4e66c43700 1 --2- 172.21.15.156:0/1975303231 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e6012cef0 0x7f4e6012d2c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.366+0000 7f4e66c43700 1 -- 172.21.15.156:0/1975303231 >> 172.21.15.156:0/1975303231 conn(0x7f4e60099c40 msgr2=0x7f4e600a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:27.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.366+0000 7f4e66c43700 1 -- 172.21.15.156:0/1975303231 shutdown_connections 2023-09-30T22:19:27.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.366+0000 7f4e66c43700 1 -- 172.21.15.156:0/1975303231 wait complete. 2023-09-30T22:19:27.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.367+0000 7f4e66c43700 1 Processor -- start 2023-09-30T22:19:27.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.367+0000 7f4e66c43700 1 -- start start 2023-09-30T22:19:27.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.368+0000 7f4e66c43700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e6012cef0 0x7f4e60070760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:27.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.368+0000 7f4e66c43700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e60133540 0x7f4e60070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:27.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.368+0000 7f4e66c43700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e60134020 0x7f4e600711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:27.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.368+0000 7f4e66c43700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e60071c30 con 0x7f4e60133540 2023-09-30T22:19:27.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.368+0000 7f4e66c43700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6011dae0 con 0x7f4e6012cef0 2023-09-30T22:19:27.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.368+0000 7f4e66c43700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6011ed80 con 0x7f4e60134020 2023-09-30T22:19:27.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.368+0000 7f4e649df700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e6012cef0 0x7f4e60070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:27.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.368+0000 7f4e5ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e60133540 0x7f4e60070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:27.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.368+0000 7f4e649df700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e6012cef0 0x7f4e60070760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38020/0 (socket says 172.21.15.156:38020) 2023-09-30T22:19:27.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.368+0000 7f4e649df700 1 -- 172.21.15.156:0/3825601464 learned_addr learned my addr 172.21.15.156:0/3825601464 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:27.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.368+0000 7f4e651e0700 1 --2- 172.21.15.156:0/3825601464 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e60134020 0x7f4e600711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:27.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.368+0000 7f4e649df700 1 -- 172.21.15.156:0/3825601464 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e60134020 msgr2=0x7f4e600711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.368+0000 7f4e649df700 1 --2- 172.21.15.156:0/3825601464 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e60134020 0x7f4e600711e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.368+0000 7f4e649df700 1 -- 172.21.15.156:0/3825601464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e60133540 msgr2=0x7f4e60070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.368+0000 7f4e649df700 1 --2- 172.21.15.156:0/3825601464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e60133540 0x7f4e60070ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.368+0000 7f4e649df700 1 -- 172.21.15.156:0/3825601464 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e58009a70 con 0x7f4e6012cef0 2023-09-30T22:19:27.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.368+0000 7f4e5ffff700 1 --2- 172.21.15.156:0/3825601464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e60133540 0x7f4e60070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:27.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.368+0000 7f4e649df700 1 --2- 172.21.15.156:0/3825601464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e6012cef0 0x7f4e60070760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4e54000c00 tx=0x7f4e54004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:27.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.368+0000 7f4e5d7fa700 1 -- 172.21.15.156:0/3825601464 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e540043c0 con 0x7f4e6012cef0 2023-09-30T22:19:27.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.369+0000 7f4e5d7fa700 1 -- 172.21.15.156:0/3825601464 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5401f070 con 0x7f4e6012cef0 2023-09-30T22:19:27.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.369+0000 7f4e66c43700 1 -- 172.21.15.156:0/3825601464 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e54009550 con 0x7f4e6012cef0 2023-09-30T22:19:27.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.369+0000 7f4e5d7fa700 1 -- 172.21.15.156:0/3825601464 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e540036a0 con 0x7f4e6012cef0 2023-09-30T22:19:27.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.369+0000 7f4e66c43700 1 -- 172.21.15.156:0/3825601464 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e6011f320 con 0x7f4e6012cef0 2023-09-30T22:19:27.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.369+0000 7f4e5d7fa700 1 -- 172.21.15.156:0/3825601464 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4e54021030 con 0x7f4e6012cef0 2023-09-30T22:19:27.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.369+0000 7f4e5ffff700 1 -- 172.21.15.156:0/3825601464 >> v1:172.21.15.156:6816/126965 conn(0x7f4e4402f510 legacy=0x7f4e440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:27.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.369+0000 7f4e5d7fa700 1 -- 172.21.15.156:0/3825601464 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f4e54040e70 con 0x7f4e6012cef0 2023-09-30T22:19:27.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.369+0000 7f4e66c43700 1 -- 172.21.15.156:0/3825601464 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e6004f2a0 con 0x7f4e6012cef0 2023-09-30T22:19:27.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.374+0000 7f4e5d7fa700 1 -- 172.21.15.156:0/3825601464 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e54015020 con 0x7f4e6012cef0 2023-09-30T22:19:27.496 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:27.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.562+0000 7f4e66c43700 1 -- 172.21.15.156:0/3825601464 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4e6006c3b0 con 0x7f4e6012cef0 2023-09-30T22:19:27.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.562+0000 7f4e5d7fa700 1 -- 172.21.15.156:0/3825601464 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e540199a0 con 0x7f4e6012cef0 2023-09-30T22:19:27.562 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:27.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.564+0000 7f4e66c43700 1 -- 172.21.15.156:0/3825601464 >> v1:172.21.15.156:6816/126965 conn(0x7f4e4402f510 legacy=0x7f4e440319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:27.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.564+0000 7f4e66c43700 1 -- 172.21.15.156:0/3825601464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e6012cef0 msgr2=0x7f4e60070760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.564+0000 7f4e66c43700 1 --2- 172.21.15.156:0/3825601464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e6012cef0 0x7f4e60070760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4e54000c00 tx=0x7f4e54004750 comp rx=0 tx=0).stop 2023-09-30T22:19:27.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.565+0000 7f4e66c43700 1 -- 172.21.15.156:0/3825601464 shutdown_connections 2023-09-30T22:19:27.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.565+0000 7f4e66c43700 1 --2- 172.21.15.156:0/3825601464 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e60134020 0x7f4e600711e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.565+0000 7f4e66c43700 1 --2- 172.21.15.156:0/3825601464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e6012cef0 0x7f4e60070760 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.565+0000 7f4e66c43700 1 --2- 172.21.15.156:0/3825601464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e60133540 0x7f4e60070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.565+0000 7f4e66c43700 1 -- 172.21.15.156:0/3825601464 >> 172.21.15.156:0/3825601464 conn(0x7f4e60099c40 msgr2=0x7f4e6009b320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:27.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.565+0000 7f4e66c43700 1 -- 172.21.15.156:0/3825601464 shutdown_connections 2023-09-30T22:19:27.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.565+0000 7f4e66c43700 1 -- 172.21.15.156:0/3825601464 wait complete. 2023-09-30T22:19:27.568 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:27.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:27.607 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:27.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.624+0000 7fdbed790700 1 Processor -- start 2023-09-30T22:19:27.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.624+0000 7fdbed790700 1 -- start start 2023-09-30T22:19:27.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.625+0000 7fdbed790700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdbe809d860 0x7fdbe809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:27.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.625+0000 7fdbed790700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdbe809e170 0x7fdbe81307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:27.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.625+0000 7fdbed790700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe809aaa0 con 0x7fdbe8130ce0 2023-09-30T22:19:27.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.625+0000 7fdbed790700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe809f870 con 0x7fdbe809d860 2023-09-30T22:19:27.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.625+0000 7fdbed790700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe809b360 con 0x7fdbe809e170 2023-09-30T22:19:27.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.625+0000 7fdbe6ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdbe809d860 0x7fdbe809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:27.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.625+0000 7fdbe6ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdbe809d860 0x7fdbe809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:55226/0 (socket says 172.21.15.156:55226) 2023-09-30T22:19:27.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.625+0000 7fdbe6ffd700 1 -- 172.21.15.156:0/1408111628 learned_addr learned my addr 172.21.15.156:0/1408111628 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:27.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.625+0000 7fdbe67fc700 1 --2- 172.21.15.156:0/1408111628 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdbe809e170 0x7fdbe81307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:27.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.625+0000 7fdbe6ffd700 1 -- 172.21.15.156:0/1408111628 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdbe809e170 msgr2=0x7fdbe81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:27.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.625+0000 7fdbe6ffd700 1 --2- 172.21.15.156:0/1408111628 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdbe809e170 0x7fdbe81307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.626+0000 7fdbe6ffd700 1 -- 172.21.15.156:0/1408111628 >> v1:172.21.15.156:6789/0 conn(0x7fdbe8130ce0 legacy=0x7fdbe81379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.626+0000 7fdbe6ffd700 1 -- 172.21.15.156:0/1408111628 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe809b620 con 0x7fdbe809d860 2023-09-30T22:19:27.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.626+0000 7fdbe6ffd700 1 --2- 172.21.15.156:0/1408111628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdbe809d860 0x7fdbe809dc30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80098f0 tx=0x7fdbd8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f411b5861d05d739 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:27.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.626+0000 7fdbe5ffb700 1 -- 172.21.15.156:0/1408111628 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd800b8a0 con 0x7fdbe809d860 2023-09-30T22:19:27.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.626+0000 7fdbe5ffb700 1 -- 172.21.15.156:0/1408111628 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd800ba00 con 0x7fdbe809d860 2023-09-30T22:19:27.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.626+0000 7fdbe5ffb700 1 -- 172.21.15.156:0/1408111628 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd800bd90 con 0x7fdbe809d860 2023-09-30T22:19:27.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.627+0000 7fdbed790700 1 -- 172.21.15.156:0/1408111628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdbe809d860 msgr2=0x7fdbe809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.627+0000 7fdbed790700 1 --2- 172.21.15.156:0/1408111628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdbe809d860 0x7fdbe809dc30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80098f0 tx=0x7fdbd8009c00 comp rx=0 tx=0).stop 2023-09-30T22:19:27.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.627+0000 7fdbed790700 1 -- 172.21.15.156:0/1408111628 shutdown_connections 2023-09-30T22:19:27.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.627+0000 7fdbed790700 1 --2- 172.21.15.156:0/1408111628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdbe809d860 0x7fdbe809dc30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.627+0000 7fdbed790700 1 --2- 172.21.15.156:0/1408111628 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdbe809e170 0x7fdbe81307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.627+0000 7fdbed790700 1 -- 172.21.15.156:0/1408111628 >> 172.21.15.156:0/1408111628 conn(0x7fdbe8099c40 msgr2=0x7fdbe80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:27.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.627+0000 7fdbed790700 1 -- 172.21.15.156:0/1408111628 shutdown_connections 2023-09-30T22:19:27.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.627+0000 7fdbed790700 1 -- 172.21.15.156:0/1408111628 wait complete. 2023-09-30T22:19:27.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.628+0000 7fdbed790700 1 Processor -- start 2023-09-30T22:19:27.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.628+0000 7fdbed790700 1 -- start start 2023-09-30T22:19:27.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.628+0000 7fdbed790700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdbe809d860 0x7fdbe8137e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:27.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.628+0000 7fdbed790700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdbe809e170 0x7fdbe8138390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:27.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.628+0000 7fdbed790700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdbe8130ce0 0x7fdbe81388d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:27.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.628+0000 7fdbed790700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe8136cd0 con 0x7fdbe809e170 2023-09-30T22:19:27.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.628+0000 7fdbed790700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe80a21b0 con 0x7fdbe809d860 2023-09-30T22:19:27.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.628+0000 7fdbed790700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe809c8b0 con 0x7fdbe8130ce0 2023-09-30T22:19:27.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.629+0000 7fdbe67fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdbe809e170 0x7fdbe8138390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:27.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.629+0000 7fdbe6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdbe809d860 0x7fdbe8137e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:27.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.629+0000 7fdbe6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdbe809d860 0x7fdbe8137e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38038/0 (socket says 172.21.15.156:38038) 2023-09-30T22:19:27.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.629+0000 7fdbe67fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdbe809e170 0x7fdbe8138390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:55228/0 (socket says 172.21.15.156:55228) 2023-09-30T22:19:27.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.629+0000 7fdbe6ffd700 1 -- 172.21.15.156:0/203359849 learned_addr learned my addr 172.21.15.156:0/203359849 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:27.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.629+0000 7fdbe77fe700 1 --2- 172.21.15.156:0/203359849 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdbe8130ce0 0x7fdbe81388d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:27.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.629+0000 7fdbe6ffd700 1 -- 172.21.15.156:0/203359849 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdbe8130ce0 msgr2=0x7fdbe81388d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.629+0000 7fdbe6ffd700 1 --2- 172.21.15.156:0/203359849 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdbe8130ce0 0x7fdbe81388d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.629+0000 7fdbe6ffd700 1 -- 172.21.15.156:0/203359849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdbe809e170 msgr2=0x7fdbe8138390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.629+0000 7fdbe6ffd700 1 --2- 172.21.15.156:0/203359849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdbe809e170 0x7fdbe8138390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.629+0000 7fdbe6ffd700 1 -- 172.21.15.156:0/203359849 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd8009550 con 0x7fdbe809d860 2023-09-30T22:19:27.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.629+0000 7fdbe6ffd700 1 --2- 172.21.15.156:0/203359849 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdbe809d860 0x7fdbe8137e50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8000c00 tx=0x7fdbd8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:27.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.629+0000 7fdbcf7fe700 1 -- 172.21.15.156:0/203359849 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8004510 con 0x7fdbe809d860 2023-09-30T22:19:27.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.629+0000 7fdbed790700 1 -- 172.21.15.156:0/203359849 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe8137300 con 0x7fdbe809d860 2023-09-30T22:19:27.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.629+0000 7fdbcf7fe700 1 -- 172.21.15.156:0/203359849 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd80036a0 con 0x7fdbe809d860 2023-09-30T22:19:27.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.629+0000 7fdbcf7fe700 1 -- 172.21.15.156:0/203359849 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8003a30 con 0x7fdbe809d860 2023-09-30T22:19:27.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.629+0000 7fdbed790700 1 -- 172.21.15.156:0/203359849 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe8136610 con 0x7fdbe809d860 2023-09-30T22:19:27.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.630+0000 7fdbcf7fe700 1 -- 172.21.15.156:0/203359849 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fdbd8021070 con 0x7fdbe809d860 2023-09-30T22:19:27.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.630+0000 7fdbed790700 1 -- 172.21.15.156:0/203359849 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe81328e0 con 0x7fdbe809d860 2023-09-30T22:19:27.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.630+0000 7fdbe67fc700 1 -- 172.21.15.156:0/203359849 >> v1:172.21.15.156:6816/126965 conn(0x7fdbd402f510 legacy=0x7fdbd40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:27.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.631+0000 7fdbcf7fe700 1 -- 172.21.15.156:0/203359849 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fdbd8041050 con 0x7fdbe809d860 2023-09-30T22:19:27.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.635+0000 7fdbcf7fe700 1 -- 172.21.15.156:0/203359849 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdbd8072750 con 0x7fdbe809d860 2023-09-30T22:19:27.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.707+0000 7f90314f8700 1 Processor -- start 2023-09-30T22:19:27.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.707+0000 7f90314f8700 1 -- start start 2023-09-30T22:19:27.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.708+0000 7f90314f8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f902c133660 0x7f902c135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:27.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.708+0000 7f90314f8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f902c135f80 0x7f902c138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:27.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.708+0000 7f90314f8700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f902c09ae40 con 0x7f902c12d280 2023-09-30T22:19:27.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.708+0000 7f90314f8700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902c09b9a0 con 0x7f902c133660 2023-09-30T22:19:27.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.708+0000 7f90314f8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902c12dd60 con 0x7f902c135f80 2023-09-30T22:19:27.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.708+0000 7f902affd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f902c12d280 0x7f902c12d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38448/0 (socket says 172.21.15.156:38448) 2023-09-30T22:19:27.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.708+0000 7f902a7fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f902c133660 0x7f902c135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:27.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.708+0000 7f902affd700 1 -- 172.21.15.156:0/1334765225 learned_addr learned my addr 172.21.15.156:0/1334765225 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:27.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.708+0000 7f902b7fe700 1 --2- 172.21.15.156:0/1334765225 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f902c135f80 0x7f902c138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:27.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.709+0000 7f902a7fc700 1 -- 172.21.15.156:0/1334765225 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f902c135f80 msgr2=0x7f902c138360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:27.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.709+0000 7f902a7fc700 1 --2- 172.21.15.156:0/1334765225 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f902c135f80 0x7f902c138360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.709+0000 7f902a7fc700 1 -- 172.21.15.156:0/1334765225 >> v1:172.21.15.156:6789/0 conn(0x7f902c12d280 legacy=0x7f902c12d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.709+0000 7f9029ffb700 1 -- 172.21.15.156:0/1334765225 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1625586748 0 0) 0x7f902c09ae40 con 0x7f902c12d280 2023-09-30T22:19:27.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.709+0000 7f902a7fc700 1 -- 172.21.15.156:0/1334765225 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902c09bbb0 con 0x7f902c133660 2023-09-30T22:19:27.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.709+0000 7f902b7fe700 1 --2- 172.21.15.156:0/1334765225 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f902c135f80 0x7f902c138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:27.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.709+0000 7f902a7fc700 1 --2- 172.21.15.156:0/1334765225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f902c133660 0x7f902c135a40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9020009840 tx=0x7f9020009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78188c3746ddc5d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:27.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.709+0000 7f9029ffb700 1 -- 172.21.15.156:0/1334765225 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9020011830 con 0x7f902c133660 2023-09-30T22:19:27.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.709+0000 7f9029ffb700 1 -- 172.21.15.156:0/1334765225 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9020011990 con 0x7f902c133660 2023-09-30T22:19:27.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.709+0000 7f9029ffb700 1 -- 172.21.15.156:0/1334765225 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9020011d20 con 0x7f902c133660 2023-09-30T22:19:27.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.710+0000 7f90314f8700 1 -- 172.21.15.156:0/1334765225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f902c133660 msgr2=0x7f902c135a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.710+0000 7f90314f8700 1 --2- 172.21.15.156:0/1334765225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f902c133660 0x7f902c135a40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9020009840 tx=0x7f9020009b50 comp rx=0 tx=0).stop 2023-09-30T22:19:27.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.710+0000 7f90314f8700 1 -- 172.21.15.156:0/1334765225 shutdown_connections 2023-09-30T22:19:27.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.710+0000 7f90314f8700 1 --2- 172.21.15.156:0/1334765225 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f902c135f80 0x7f902c138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.710+0000 7f90314f8700 1 --2- 172.21.15.156:0/1334765225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f902c133660 0x7f902c135a40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.710+0000 7f90314f8700 1 -- 172.21.15.156:0/1334765225 >> 172.21.15.156:0/1334765225 conn(0x7f902c0a2980 msgr2=0x7f902c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:27.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.710+0000 7f90314f8700 1 -- 172.21.15.156:0/1334765225 shutdown_connections 2023-09-30T22:19:27.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.710+0000 7f90314f8700 1 -- 172.21.15.156:0/1334765225 wait complete. 2023-09-30T22:19:27.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.712+0000 7f90314f8700 1 Processor -- start 2023-09-30T22:19:27.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.712+0000 7f90314f8700 1 -- start start 2023-09-30T22:19:27.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.712+0000 7f90314f8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f902c12d280 0x7f902c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:27.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.712+0000 7f90314f8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f902c133660 0x7f902c133f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:27.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.712+0000 7f90314f8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f902c135f80 0x7f902c1344b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:27.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.712+0000 7f90314f8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c11d5d0 con 0x7f902c133660 2023-09-30T22:19:27.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.712+0000 7f90314f8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902c071bc0 con 0x7f902c12d280 2023-09-30T22:19:27.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.712+0000 7f90314f8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f902c130dc0 con 0x7f902c135f80 2023-09-30T22:19:27.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.712+0000 7f902affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f902c12d280 0x7f902c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:27.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.712+0000 7f902affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f902c12d280 0x7f902c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38044/0 (socket says 172.21.15.156:38044) 2023-09-30T22:19:27.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.712+0000 7f902affd700 1 -- 172.21.15.156:0/1243806375 learned_addr learned my addr 172.21.15.156:0/1243806375 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:27.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.713+0000 7f902b7fe700 1 --2- 172.21.15.156:0/1243806375 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f902c135f80 0x7f902c1344b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:27.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.713+0000 7f902a7fc700 1 --2- 172.21.15.156:0/1243806375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f902c133660 0x7f902c133f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:27.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.713+0000 7f902affd700 1 -- 172.21.15.156:0/1243806375 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f902c135f80 msgr2=0x7f902c1344b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.713+0000 7f902affd700 1 --2- 172.21.15.156:0/1243806375 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f902c135f80 0x7f902c1344b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.713+0000 7f902affd700 1 -- 172.21.15.156:0/1243806375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f902c133660 msgr2=0x7f902c133f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.713+0000 7f902affd700 1 --2- 172.21.15.156:0/1243806375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f902c133660 0x7f902c133f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.713+0000 7f902affd700 1 -- 172.21.15.156:0/1243806375 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9024009a70 con 0x7f902c12d280 2023-09-30T22:19:27.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.713+0000 7f902b7fe700 1 --2- 172.21.15.156:0/1243806375 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f902c135f80 0x7f902c1344b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:27.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.713+0000 7f902affd700 1 --2- 172.21.15.156:0/1243806375 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f902c12d280 0x7f902c133a30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f901c00c470 tx=0x7f901c00c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:27.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.713+0000 7f90137fe700 1 -- 172.21.15.156:0/1243806375 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c0074e0 con 0x7f902c12d280 2023-09-30T22:19:27.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.713+0000 7f90137fe700 1 -- 172.21.15.156:0/1243806375 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901c007640 con 0x7f902c12d280 2023-09-30T22:19:27.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.713+0000 7f90314f8700 1 -- 172.21.15.156:0/1243806375 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90200094a0 con 0x7f902c12d280 2023-09-30T22:19:27.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.713+0000 7f90137fe700 1 -- 172.21.15.156:0/1243806375 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c005a70 con 0x7f902c12d280 2023-09-30T22:19:27.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.713+0000 7f90314f8700 1 -- 172.21.15.156:0/1243806375 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f902c134dd0 con 0x7f902c12d280 2023-09-30T22:19:27.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.714+0000 7f90137fe700 1 -- 172.21.15.156:0/1243806375 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f901c005bd0 con 0x7f902c12d280 2023-09-30T22:19:27.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.714+0000 7f902a7fc700 1 -- 172.21.15.156:0/1243806375 >> v1:172.21.15.156:6816/126965 conn(0x7f901802f510 legacy=0x7f90180319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:27.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.714+0000 7f90137fe700 1 -- 172.21.15.156:0/1243806375 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f901c03ef90 con 0x7f902c12d280 2023-09-30T22:19:27.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.715+0000 7f90314f8700 1 -- 172.21.15.156:0/1243806375 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f902c04f2a0 con 0x7f902c12d280 2023-09-30T22:19:27.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.719+0000 7f90137fe700 1 -- 172.21.15.156:0/1243806375 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f901c017020 con 0x7f902c12d280 2023-09-30T22:19:27.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.755+0000 7fe1ba9bb700 1 Processor -- start 2023-09-30T22:19:27.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.755+0000 7fe1ba9bb700 1 -- start start 2023-09-30T22:19:27.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.756+0000 7fe1ba9bb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1b40a1550 0x7fe1b4138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:27.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.756+0000 7fe1ba9bb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1b4139200 0x7fe1b413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:27.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.756+0000 7fe1ba9bb700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b409e9d0 con 0x7fe1b40a0a70 2023-09-30T22:19:27.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.756+0000 7fe1ba9bb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b409dc00 con 0x7fe1b4139200 2023-09-30T22:19:27.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.756+0000 7fe1ba9bb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b409dec0 con 0x7fe1b40a1550 2023-09-30T22:19:27.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.756+0000 7fe1b37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1b40a1550 0x7fe1b4138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:27.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.756+0000 7fe1b8f58700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1b4139200 0x7fe1b413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:27.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.756+0000 7fe1b8f58700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1b4139200 0x7fe1b413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38048/0 (socket says 172.21.15.156:38048) 2023-09-30T22:19:27.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.756+0000 7fe1b37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1b40a1550 0x7fe1b4138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43974/0 (socket says 172.21.15.156:43974) 2023-09-30T22:19:27.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.756+0000 7fe1b8f58700 1 -- 172.21.15.156:0/4288868328 learned_addr learned my addr 172.21.15.156:0/4288868328 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:27.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.756+0000 7fe1b37fe700 1 -- 172.21.15.156:0/4288868328 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1b4139200 msgr2=0x7fe1b413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:27.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.756+0000 7fe1b37fe700 1 --2- 172.21.15.156:0/4288868328 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1b4139200 0x7fe1b413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.756+0000 7fe1b37fe700 1 -- 172.21.15.156:0/4288868328 >> v1:172.21.15.156:6789/0 conn(0x7fe1b40a0a70 legacy=0x7fe1b40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.756+0000 7fe1b37fe700 1 -- 172.21.15.156:0/4288868328 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b409e6a0 con 0x7fe1b40a1550 2023-09-30T22:19:27.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.757+0000 7fe1b37fe700 1 --2- 172.21.15.156:0/4288868328 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1b40a1550 0x7fe1b4138cc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8009870 tx=0x7fe1a8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9927dd21abee87c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:27.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.757+0000 7fe1b2ffd700 1 -- 172.21.15.156:0/4288868328 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a8011830 con 0x7fe1b40a1550 2023-09-30T22:19:27.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.757+0000 7fe1b2ffd700 1 -- 172.21.15.156:0/4288868328 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a8011990 con 0x7fe1b40a1550 2023-09-30T22:19:27.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.757+0000 7fe1b2ffd700 1 -- 172.21.15.156:0/4288868328 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a8011d20 con 0x7fe1b40a1550 2023-09-30T22:19:27.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.757+0000 7fe1ba9bb700 1 -- 172.21.15.156:0/4288868328 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1b40a1550 msgr2=0x7fe1b4138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.757+0000 7fe1ba9bb700 1 --2- 172.21.15.156:0/4288868328 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1b40a1550 0x7fe1b4138cc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8009870 tx=0x7fe1a8009b80 comp rx=0 tx=0).stop 2023-09-30T22:19:27.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.757+0000 7fe1ba9bb700 1 -- 172.21.15.156:0/4288868328 shutdown_connections 2023-09-30T22:19:27.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.757+0000 7fe1ba9bb700 1 --2- 172.21.15.156:0/4288868328 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1b4139200 0x7fe1b413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.757+0000 7fe1ba9bb700 1 --2- 172.21.15.156:0/4288868328 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1b40a1550 0x7fe1b4138cc0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.757+0000 7fe1ba9bb700 1 -- 172.21.15.156:0/4288868328 >> 172.21.15.156:0/4288868328 conn(0x7fe1b40a6610 msgr2=0x7fe1b40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:27.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.757+0000 7fe1ba9bb700 1 -- 172.21.15.156:0/4288868328 shutdown_connections 2023-09-30T22:19:27.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.757+0000 7fe1ba9bb700 1 -- 172.21.15.156:0/4288868328 wait complete. 2023-09-30T22:19:27.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.758+0000 7fe1ba9bb700 1 Processor -- start 2023-09-30T22:19:27.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.758+0000 7fe1ba9bb700 1 -- start start 2023-09-30T22:19:27.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.759+0000 7fe1ba9bb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1b40a0a70 0x7fe1b4133880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:27.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.759+0000 7fe1ba9bb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1b40a1550 0x7fe1b4133dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:27.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.759+0000 7fe1ba9bb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1b4139200 0x7fe1b41c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:27.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.759+0000 7fe1ba9bb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b4120820 con 0x7fe1b40a1550 2023-09-30T22:19:27.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.759+0000 7fe1ba9bb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b4121d40 con 0x7fe1b4139200 2023-09-30T22:19:27.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.759+0000 7fe1ba9bb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b40a03e0 con 0x7fe1b40a0a70 2023-09-30T22:19:27.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.759+0000 7fe1b3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1b40a0a70 0x7fe1b4133880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:27.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.759+0000 7fe1b3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1b40a0a70 0x7fe1b4133880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43984/0 (socket says 172.21.15.156:43984) 2023-09-30T22:19:27.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.759+0000 7fe1b3fff700 1 -- 172.21.15.156:0/3261716069 learned_addr learned my addr 172.21.15.156:0/3261716069 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:27.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.759+0000 7fe1b8f58700 1 --2- 172.21.15.156:0/3261716069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1b4139200 0x7fe1b41c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:27.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.759+0000 7fe1b37fe700 1 --2- 172.21.15.156:0/3261716069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1b40a1550 0x7fe1b4133dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:27.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.759+0000 7fe1b3fff700 1 -- 172.21.15.156:0/3261716069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1b4139200 msgr2=0x7fe1b41c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.759+0000 7fe1b3fff700 1 --2- 172.21.15.156:0/3261716069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1b4139200 0x7fe1b41c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.759+0000 7fe1b3fff700 1 -- 172.21.15.156:0/3261716069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1b40a1550 msgr2=0x7fe1b4133dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.759+0000 7fe1b3fff700 1 --2- 172.21.15.156:0/3261716069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1b40a1550 0x7fe1b4133dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.759+0000 7fe1b3fff700 1 -- 172.21.15.156:0/3261716069 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a80094a0 con 0x7fe1b40a0a70 2023-09-30T22:19:27.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.760+0000 7fe1b3fff700 1 --2- 172.21.15.156:0/3261716069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1b40a0a70 0x7fe1b4133880 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe1a400c4e0 tx=0x7fe1a400c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:27.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.760+0000 7fe1b0ff9700 1 -- 172.21.15.156:0/3261716069 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a40052d0 con 0x7fe1b40a0a70 2023-09-30T22:19:27.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.760+0000 7fe1b0ff9700 1 -- 172.21.15.156:0/3261716069 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a4005430 con 0x7fe1b40a0a70 2023-09-30T22:19:27.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.760+0000 7fe1ba9bb700 1 -- 172.21.15.156:0/3261716069 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b4122010 con 0x7fe1b40a0a70 2023-09-30T22:19:27.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.760+0000 7fe1b0ff9700 1 -- 172.21.15.156:0/3261716069 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a40038c0 con 0x7fe1b40a0a70 2023-09-30T22:19:27.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.760+0000 7fe1ba9bb700 1 -- 172.21.15.156:0/3261716069 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b4122d40 con 0x7fe1b40a0a70 2023-09-30T22:19:27.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.761+0000 7fe1b0ff9700 1 -- 172.21.15.156:0/3261716069 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe1a4003a20 con 0x7fe1b40a0a70 2023-09-30T22:19:27.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.761+0000 7fe1ba9bb700 1 -- 172.21.15.156:0/3261716069 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b404f2a0 con 0x7fe1b40a0a70 2023-09-30T22:19:27.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.761+0000 7fe1b37fe700 1 -- 172.21.15.156:0/3261716069 >> v1:172.21.15.156:6816/126965 conn(0x7fe1a002f540 legacy=0x7fe1a00319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:27.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.761+0000 7fe1b0ff9700 1 -- 172.21.15.156:0/3261716069 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fe1a403ef90 con 0x7fe1b40a0a70 2023-09-30T22:19:27.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.770+0000 7fe1b0ff9700 1 -- 172.21.15.156:0/3261716069 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe1a4019d00 con 0x7fe1b40a0a70 2023-09-30T22:19:27.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.832+0000 7fdbe67fc700 1 -- 172.21.15.156:0/203359849 >> v1:172.21.15.156:6816/126965 conn(0x7fdbd402f510 legacy=0x7fdbd40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:27.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.835+0000 7fdbed790700 1 -- 172.21.15.156:0/203359849 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdbe804f2a0 con 0x7fdbe809d860 2023-09-30T22:19:27.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.835+0000 7fdbcf7fe700 1 -- 172.21.15.156:0/203359849 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdbd8029030 con 0x7fdbe809d860 2023-09-30T22:19:27.835 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:27.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.837+0000 7fdbed790700 1 -- 172.21.15.156:0/203359849 >> v1:172.21.15.156:6816/126965 conn(0x7fdbd402f510 legacy=0x7fdbd40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:27.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.837+0000 7fdbed790700 1 -- 172.21.15.156:0/203359849 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdbe809d860 msgr2=0x7fdbe8137e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.837+0000 7fdbed790700 1 --2- 172.21.15.156:0/203359849 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdbe809d860 0x7fdbe8137e50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8000c00 tx=0x7fdbd8004750 comp rx=0 tx=0).stop 2023-09-30T22:19:27.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.837+0000 7fdbed790700 1 -- 172.21.15.156:0/203359849 shutdown_connections 2023-09-30T22:19:27.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.837+0000 7fdbed790700 1 --2- 172.21.15.156:0/203359849 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdbe8130ce0 0x7fdbe81388d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.837+0000 7fdbed790700 1 --2- 172.21.15.156:0/203359849 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdbe809d860 0x7fdbe8137e50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.837+0000 7fdbed790700 1 --2- 172.21.15.156:0/203359849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdbe809e170 0x7fdbe8138390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.837+0000 7fdbed790700 1 -- 172.21.15.156:0/203359849 >> 172.21.15.156:0/203359849 conn(0x7fdbe8099c40 msgr2=0x7fdbe81396d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:27.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.837+0000 7fdbed790700 1 -- 172.21.15.156:0/203359849 shutdown_connections 2023-09-30T22:19:27.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.837+0000 7fdbed790700 1 -- 172.21.15.156:0/203359849 wait complete. 2023-09-30T22:19:27.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:27.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.915+0000 7f902a7fc700 1 -- 172.21.15.156:0/1243806375 >> v1:172.21.15.156:6816/126965 conn(0x7f901802f510 legacy=0x7f90180319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:27.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.919+0000 7f90314f8700 1 -- 172.21.15.156:0/1243806375 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f902c071180 con 0x7f902c12d280 2023-09-30T22:19:27.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.919+0000 7f90137fe700 1 -- 172.21.15.156:0/1243806375 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f901c018260 con 0x7f902c12d280 2023-09-30T22:19:27.919 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:27.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.922+0000 7f90314f8700 1 -- 172.21.15.156:0/1243806375 >> v1:172.21.15.156:6816/126965 conn(0x7f901802f510 legacy=0x7f90180319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:27.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.922+0000 7f90314f8700 1 -- 172.21.15.156:0/1243806375 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f902c12d280 msgr2=0x7f902c133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.922+0000 7f90314f8700 1 --2- 172.21.15.156:0/1243806375 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f902c12d280 0x7f902c133a30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f901c00c470 tx=0x7f901c00c780 comp rx=0 tx=0).stop 2023-09-30T22:19:27.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.922+0000 7f90314f8700 1 -- 172.21.15.156:0/1243806375 shutdown_connections 2023-09-30T22:19:27.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.922+0000 7f90314f8700 1 --2- 172.21.15.156:0/1243806375 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f902c135f80 0x7f902c1344b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.922+0000 7f90314f8700 1 --2- 172.21.15.156:0/1243806375 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f902c12d280 0x7f902c133a30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.922+0000 7f90314f8700 1 --2- 172.21.15.156:0/1243806375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f902c133660 0x7f902c133f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.922+0000 7f90314f8700 1 -- 172.21.15.156:0/1243806375 >> 172.21.15.156:0/1243806375 conn(0x7f902c0a2980 msgr2=0x7f902c09d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:27.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.922+0000 7f90314f8700 1 -- 172.21.15.156:0/1243806375 shutdown_connections 2023-09-30T22:19:27.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.922+0000 7f90314f8700 1 -- 172.21.15.156:0/1243806375 wait complete. 2023-09-30T22:19:27.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:27.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.962+0000 7fe1b37fe700 1 -- 172.21.15.156:0/3261716069 >> v1:172.21.15.156:6816/126965 conn(0x7fe1a002f540 legacy=0x7fe1a00319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:27.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.972+0000 7fe1ba9bb700 1 -- 172.21.15.156:0/3261716069 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe1b4122200 con 0x7fe1b40a0a70 2023-09-30T22:19:27.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.972+0000 7fe1b0ff9700 1 -- 172.21.15.156:0/3261716069 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe1a4017020 con 0x7fe1b40a0a70 2023-09-30T22:19:27.972 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:27.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.974+0000 7fe1ba9bb700 1 -- 172.21.15.156:0/3261716069 >> v1:172.21.15.156:6816/126965 conn(0x7fe1a002f540 legacy=0x7fe1a00319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:27.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.974+0000 7fe1ba9bb700 1 -- 172.21.15.156:0/3261716069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1b40a0a70 msgr2=0x7fe1b4133880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.974+0000 7fe1ba9bb700 1 --2- 172.21.15.156:0/3261716069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1b40a0a70 0x7fe1b4133880 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe1a400c4e0 tx=0x7fe1a400c7f0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.974+0000 7fe1ba9bb700 1 -- 172.21.15.156:0/3261716069 shutdown_connections 2023-09-30T22:19:27.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.974+0000 7fe1ba9bb700 1 --2- 172.21.15.156:0/3261716069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1b4139200 0x7fe1b41c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.974+0000 7fe1ba9bb700 1 --2- 172.21.15.156:0/3261716069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1b40a0a70 0x7fe1b4133880 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.974+0000 7fe1ba9bb700 1 --2- 172.21.15.156:0/3261716069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1b40a1550 0x7fe1b4133dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:27.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.974+0000 7fe1ba9bb700 1 -- 172.21.15.156:0/3261716069 >> 172.21.15.156:0/3261716069 conn(0x7fe1b40a6610 msgr2=0x7fe1b4136d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:27.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.974+0000 7fe1ba9bb700 1 -- 172.21.15.156:0/3261716069 shutdown_connections 2023-09-30T22:19:27.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:27.974+0000 7fe1ba9bb700 1 -- 172.21.15.156:0/3261716069 wait complete. 2023-09-30T22:19:27.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:28.578 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:28.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.703+0000 7f42ce816700 1 Processor -- start 2023-09-30T22:19:28.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.703+0000 7f42ce816700 1 -- start start 2023-09-30T22:19:28.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.703+0000 7f42ce816700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f42c81346e0 0x7f42c8136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:28.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.704+0000 7f42ce816700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42c8137000 0x7f42c81393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:28.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.704+0000 7f42ce816700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c80a1640 con 0x7f42c8131980 2023-09-30T22:19:28.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.704+0000 7f42ce816700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c806eb30 con 0x7f42c81346e0 2023-09-30T22:19:28.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.704+0000 7f42ce816700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c80a22d0 con 0x7f42c8137000 2023-09-30T22:19:28.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.704+0000 7f42ccdb3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42c8137000 0x7f42c81393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:28.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.704+0000 7f42c77fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f42c81346e0 0x7f42c8136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:28.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.704+0000 7f42ccdb3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42c8137000 0x7f42c81393e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38058/0 (socket says 172.21.15.156:38058) 2023-09-30T22:19:28.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.704+0000 7f42ccdb3700 1 -- 172.21.15.156:0/1916850893 learned_addr learned my addr 172.21.15.156:0/1916850893 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:28.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.704+0000 7f42ccdb3700 1 -- 172.21.15.156:0/1916850893 >> v2:172.21.15.156:3300/0 conn(0x7f42c81346e0 msgr2=0x7f42c8136ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:28.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.704+0000 7f42ccdb3700 1 --2- 172.21.15.156:0/1916850893 >> v2:172.21.15.156:3300/0 conn(0x7f42c81346e0 0x7f42c8136ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:28.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.704+0000 7f42ccdb3700 1 -- 172.21.15.156:0/1916850893 >> v1:172.21.15.156:6789/0 conn(0x7f42c8131980 legacy=0x7f42c8131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:28.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.704+0000 7f42ccdb3700 1 -- 172.21.15.156:0/1916850893 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c8131550 con 0x7f42c8137000 2023-09-30T22:19:28.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.704+0000 7f42c77fe700 1 --2- 172.21.15.156:0/1916850893 >> v2:172.21.15.156:3300/0 conn(0x7f42c81346e0 0x7f42c8136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:28.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.704+0000 7f42ccdb3700 1 --2- 172.21.15.156:0/1916850893 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42c8137000 0x7f42c81393e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f42c0009e50 tx=0x7f42c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93863771532d7e2d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:28.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.704+0000 7f42c6ffd700 1 -- 172.21.15.156:0/1916850893 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c000e070 con 0x7f42c8137000 2023-09-30T22:19:28.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.704+0000 7f42c6ffd700 1 -- 172.21.15.156:0/1916850893 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c000b910 con 0x7f42c8137000 2023-09-30T22:19:28.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.704+0000 7f42c6ffd700 1 -- 172.21.15.156:0/1916850893 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c000bcc0 con 0x7f42c8137000 2023-09-30T22:19:28.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.705+0000 7f42ce816700 1 -- 172.21.15.156:0/1916850893 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42c8137000 msgr2=0x7f42c81393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:28.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.705+0000 7f42ce816700 1 --2- 172.21.15.156:0/1916850893 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42c8137000 0x7f42c81393e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f42c0009e50 tx=0x7f42c000b330 comp rx=0 tx=0).stop 2023-09-30T22:19:28.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.705+0000 7f42ce816700 1 -- 172.21.15.156:0/1916850893 shutdown_connections 2023-09-30T22:19:28.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.705+0000 7f42ce816700 1 --2- 172.21.15.156:0/1916850893 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42c8137000 0x7f42c81393e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:28.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.705+0000 7f42ce816700 1 --2- 172.21.15.156:0/1916850893 >> v2:172.21.15.156:3300/0 conn(0x7f42c81346e0 0x7f42c8136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:28.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.705+0000 7f42ce816700 1 -- 172.21.15.156:0/1916850893 >> 172.21.15.156:0/1916850893 conn(0x7f42c80a2980 msgr2=0x7f42c80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:28.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.705+0000 7f42ce816700 1 -- 172.21.15.156:0/1916850893 shutdown_connections 2023-09-30T22:19:28.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.705+0000 7f42ce816700 1 -- 172.21.15.156:0/1916850893 wait complete. 2023-09-30T22:19:28.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.706+0000 7f42ce816700 1 Processor -- start 2023-09-30T22:19:28.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.706+0000 7f42ce816700 1 -- start start 2023-09-30T22:19:28.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.706+0000 7f42ce816700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42c8131980 0x7f42c8119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:28.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.706+0000 7f42ce816700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42c81346e0 0x7f42c8119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:28.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.706+0000 7f42ce816700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f42c8137000 0x7f42c8119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:28.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.706+0000 7f42ce816700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c811ca80 con 0x7f42c8131980 2023-09-30T22:19:28.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.706+0000 7f42ce816700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c811b330 con 0x7f42c81346e0 2023-09-30T22:19:28.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.706+0000 7f42ce816700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42c8136d60 con 0x7f42c8137000 2023-09-30T22:19:28.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.706+0000 7f42c77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42c81346e0 0x7f42c8119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:28.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.706+0000 7f42c7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42c8131980 0x7f42c8119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:28.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.706+0000 7f42c77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42c81346e0 0x7f42c8119590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38068/0 (socket says 172.21.15.156:38068) 2023-09-30T22:19:28.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.706+0000 7f42c77fe700 1 -- 172.21.15.156:0/2729499673 learned_addr learned my addr 172.21.15.156:0/2729499673 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:28.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.706+0000 7f42ccdb3700 1 --2- 172.21.15.156:0/2729499673 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f42c8137000 0x7f42c8119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:28.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.707+0000 7f42c7fff700 1 -- 172.21.15.156:0/2729499673 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f42c8137000 msgr2=0x7f42c8119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:28.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.707+0000 7f42c7fff700 1 --2- 172.21.15.156:0/2729499673 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f42c8137000 0x7f42c8119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:28.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.707+0000 7f42c7fff700 1 -- 172.21.15.156:0/2729499673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42c81346e0 msgr2=0x7f42c8119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:28.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.707+0000 7f42c7fff700 1 --2- 172.21.15.156:0/2729499673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42c81346e0 0x7f42c8119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:28.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.707+0000 7f42c7fff700 1 -- 172.21.15.156:0/2729499673 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b80094a0 con 0x7f42c8131980 2023-09-30T22:19:28.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.707+0000 7f42c77fe700 1 --2- 172.21.15.156:0/2729499673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42c81346e0 0x7f42c8119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:28.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.707+0000 7f42c7fff700 1 --2- 172.21.15.156:0/2729499673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42c8131980 0x7f42c8119050 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00c4d0 tx=0x7f42bc00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:28.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.707+0000 7f42c4ff9700 1 -- 172.21.15.156:0/2729499673 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc0054e0 con 0x7f42c8131980 2023-09-30T22:19:28.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.707+0000 7f42c4ff9700 1 -- 172.21.15.156:0/2729499673 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc00ce40 con 0x7f42c8131980 2023-09-30T22:19:28.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.707+0000 7f42ce816700 1 -- 172.21.15.156:0/2729499673 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c0009b30 con 0x7f42c8131980 2023-09-30T22:19:28.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.707+0000 7f42c4ff9700 1 -- 172.21.15.156:0/2729499673 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc0038a0 con 0x7f42c8131980 2023-09-30T22:19:28.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.707+0000 7f42ce816700 1 -- 172.21.15.156:0/2729499673 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c811c170 con 0x7f42c8131980 2023-09-30T22:19:28.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.708+0000 7f42c4ff9700 1 -- 172.21.15.156:0/2729499673 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f42bc003a00 con 0x7f42c8131980 2023-09-30T22:19:28.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.708+0000 7f42ce816700 1 -- 172.21.15.156:0/2729499673 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c811c360 con 0x7f42c8131980 2023-09-30T22:19:28.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.708+0000 7f42c77fe700 1 -- 172.21.15.156:0/2729499673 >> v1:172.21.15.156:6816/126965 conn(0x7f42b402f510 legacy=0x7f42b40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:28.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.708+0000 7f42c4ff9700 1 -- 172.21.15.156:0/2729499673 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f42bc03ef10 con 0x7f42c8131980 2023-09-30T22:19:28.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.713+0000 7f42c4ff9700 1 -- 172.21.15.156:0/2729499673 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f42bc019d20 con 0x7f42c8131980 2023-09-30T22:19:28.851 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:28.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.906+0000 7f42ce816700 1 -- 172.21.15.156:0/2729499673 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f42c804f2a0 con 0x7f42c8131980 2023-09-30T22:19:28.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.906+0000 7f42c4ff9700 1 -- 172.21.15.156:0/2729499673 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f42bc0192c0 con 0x7f42c8131980 2023-09-30T22:19:28.906 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:28.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.909+0000 7f42ce816700 1 -- 172.21.15.156:0/2729499673 >> v1:172.21.15.156:6816/126965 conn(0x7f42b402f510 legacy=0x7f42b40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:28.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.909+0000 7f42c77fe700 1 -- 172.21.15.156:0/2729499673 >> v1:172.21.15.156:6816/126965 conn(0x7f42b402f510 legacy=0x7f42b40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:28.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.909+0000 7f42ce816700 1 -- 172.21.15.156:0/2729499673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42c8131980 msgr2=0x7f42c8119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:28.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.909+0000 7f42ce816700 1 --2- 172.21.15.156:0/2729499673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42c8131980 0x7f42c8119050 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00c4d0 tx=0x7f42bc00c7e0 comp rx=0 tx=0).stop 2023-09-30T22:19:28.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.909+0000 7f42ce816700 1 -- 172.21.15.156:0/2729499673 shutdown_connections 2023-09-30T22:19:28.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.909+0000 7f42ce816700 1 --2- 172.21.15.156:0/2729499673 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f42c8137000 0x7f42c8119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:28.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.909+0000 7f42ce816700 1 --2- 172.21.15.156:0/2729499673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42c8131980 0x7f42c8119050 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:28.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.909+0000 7f42ce816700 1 --2- 172.21.15.156:0/2729499673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42c81346e0 0x7f42c8119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:28.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.909+0000 7f42ce816700 1 -- 172.21.15.156:0/2729499673 >> 172.21.15.156:0/2729499673 conn(0x7f42c80a2980 msgr2=0x7f42c8133560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:28.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.909+0000 7f42ce816700 1 -- 172.21.15.156:0/2729499673 shutdown_connections 2023-09-30T22:19:28.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.909+0000 7f42ce816700 1 -- 172.21.15.156:0/2729499673 wait complete. 2023-09-30T22:19:28.922 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:28.939 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:28.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.980+0000 7f1c91d2a700 1 Processor -- start 2023-09-30T22:19:28.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.980+0000 7f1c91d2a700 1 -- start start 2023-09-30T22:19:28.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.981+0000 7f1c91d2a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1c8c09ad40 0x7f1c8c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:28.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.981+0000 7f1c91d2a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c8c133f70 0x7f1c8c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:28.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.981+0000 7f1c91d2a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c8c0a0a70 0x7f1c8c0a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:28.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.981+0000 7f1c91d2a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8c0a3b60 con 0x7f1c8c09ad40 2023-09-30T22:19:28.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.981+0000 7f1c91d2a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c1348e0 con 0x7f1c8c133f70 2023-09-30T22:19:28.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.981+0000 7f1c91d2a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c09b110 con 0x7f1c8c0a0a70 2023-09-30T22:19:28.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.981+0000 7f1c8b7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1c8c09ad40 0x7f1c8c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:28.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.981+0000 7f1c8affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c8c133f70 0x7f1c8c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:28.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.981+0000 7f1c8b7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1c8c09ad40 0x7f1c8c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:55264/0 (socket says 172.21.15.156:55264) 2023-09-30T22:19:28.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.981+0000 7f1c8bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c8c0a0a70 0x7f1c8c0a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:28.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.981+0000 7f1c8b7fe700 1 -- 172.21.15.156:0/3237827144 learned_addr learned my addr 172.21.15.156:0/3237827144 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:28.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.981+0000 7f1c8affd700 1 -- 172.21.15.156:0/3237827144 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c8c0a0a70 msgr2=0x7f1c8c0a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:28.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.981+0000 7f1c8affd700 1 --2- 172.21.15.156:0/3237827144 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c8c0a0a70 0x7f1c8c0a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:28.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.981+0000 7f1c8affd700 1 -- 172.21.15.156:0/3237827144 >> v2:172.21.15.156:3300/0 conn(0x7f1c8c09ad40 msgr2=0x7f1c8c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:28.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.981+0000 7f1c8affd700 1 --2- 172.21.15.156:0/3237827144 >> v2:172.21.15.156:3300/0 conn(0x7f1c8c09ad40 0x7f1c8c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:28.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.981+0000 7f1c8affd700 1 -- 172.21.15.156:0/3237827144 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8c0a2fa0 con 0x7f1c8c133f70 2023-09-30T22:19:28.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.981+0000 7f1c8b7fe700 1 --2- 172.21.15.156:0/3237827144 >> v2:172.21.15.156:3300/0 conn(0x7f1c8c09ad40 0x7f1c8c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:28.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.981+0000 7f1c8bfff700 1 --2- 172.21.15.156:0/3237827144 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c8c0a0a70 0x7f1c8c0a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:28.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.981+0000 7f1c8affd700 1 --2- 172.21.15.156:0/3237827144 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c8c133f70 0x7f1c8c1343a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1c74009840 tx=0x7f1c74009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a8a78f487edfb0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:28.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.982+0000 7f1c8a7fc700 1 -- 172.21.15.156:0/3237827144 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c74011830 con 0x7f1c8c133f70 2023-09-30T22:19:28.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.982+0000 7f1c8a7fc700 1 -- 172.21.15.156:0/3237827144 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c74011990 con 0x7f1c8c133f70 2023-09-30T22:19:28.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.982+0000 7f1c8a7fc700 1 -- 172.21.15.156:0/3237827144 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c74011d20 con 0x7f1c8c133f70 2023-09-30T22:19:28.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.982+0000 7f1c91d2a700 1 -- 172.21.15.156:0/3237827144 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c8c133f70 msgr2=0x7f1c8c1343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:28.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.982+0000 7f1c91d2a700 1 --2- 172.21.15.156:0/3237827144 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c8c133f70 0x7f1c8c1343a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1c74009840 tx=0x7f1c74009b50 comp rx=0 tx=0).stop 2023-09-30T22:19:28.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.982+0000 7f1c91d2a700 1 -- 172.21.15.156:0/3237827144 shutdown_connections 2023-09-30T22:19:28.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.982+0000 7f1c91d2a700 1 --2- 172.21.15.156:0/3237827144 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c8c0a0a70 0x7f1c8c0a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:28.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.982+0000 7f1c91d2a700 1 --2- 172.21.15.156:0/3237827144 >> v2:172.21.15.156:3300/0 conn(0x7f1c8c09ad40 0x7f1c8c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:28.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.982+0000 7f1c91d2a700 1 --2- 172.21.15.156:0/3237827144 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c8c133f70 0x7f1c8c1343a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:28.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.982+0000 7f1c91d2a700 1 -- 172.21.15.156:0/3237827144 >> 172.21.15.156:0/3237827144 conn(0x7f1c8c099c40 msgr2=0x7f1c8c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:28.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.982+0000 7f1c91d2a700 1 -- 172.21.15.156:0/3237827144 shutdown_connections 2023-09-30T22:19:28.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.982+0000 7f1c91d2a700 1 -- 172.21.15.156:0/3237827144 wait complete. 2023-09-30T22:19:28.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.983+0000 7f1c91d2a700 1 Processor -- start 2023-09-30T22:19:28.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.983+0000 7f1c91d2a700 1 -- start start 2023-09-30T22:19:28.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.984+0000 7f1c91d2a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c8c09ad40 0x7f1c8c1c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:28.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.984+0000 7f1c91d2a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c8c0a0a70 0x7f1c8c1c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:28.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.984+0000 7f1c91d2a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c8c133f70 0x7f1c8c1c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:28.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.984+0000 7f1c91d2a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c122330 con 0x7f1c8c09ad40 2023-09-30T22:19:28.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.984+0000 7f1c91d2a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c133aa0 con 0x7f1c8c0a0a70 2023-09-30T22:19:28.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.984+0000 7f1c91d2a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c133800 con 0x7f1c8c133f70 2023-09-30T22:19:28.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.984+0000 7f1c8b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c8c09ad40 0x7f1c8c1c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:28.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.984+0000 7f1c8bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c8c133f70 0x7f1c8c1c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:28.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.984+0000 7f1c8b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c8c09ad40 0x7f1c8c1c8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:55266/0 (socket says 172.21.15.156:55266) 2023-09-30T22:19:28.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.984+0000 7f1c8bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c8c133f70 0x7f1c8c1c8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44018/0 (socket says 172.21.15.156:44018) 2023-09-30T22:19:28.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.984+0000 7f1c8b7fe700 1 -- 172.21.15.156:0/42658510 learned_addr learned my addr 172.21.15.156:0/42658510 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:28.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.984+0000 7f1c8affd700 1 --2- 172.21.15.156:0/42658510 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c8c0a0a70 0x7f1c8c1c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:28.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.984+0000 7f1c8bfff700 1 -- 172.21.15.156:0/42658510 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c8c0a0a70 msgr2=0x7f1c8c1c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:28.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.984+0000 7f1c8bfff700 1 --2- 172.21.15.156:0/42658510 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c8c0a0a70 0x7f1c8c1c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:28.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.984+0000 7f1c8bfff700 1 -- 172.21.15.156:0/42658510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c8c09ad40 msgr2=0x7f1c8c1c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:28.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.984+0000 7f1c8bfff700 1 --2- 172.21.15.156:0/42658510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c8c09ad40 0x7f1c8c1c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:28.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.984+0000 7f1c8bfff700 1 -- 172.21.15.156:0/42658510 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7c009b30 con 0x7f1c8c133f70 2023-09-30T22:19:28.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.984+0000 7f1c8b7fe700 1 --2- 172.21.15.156:0/42658510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c8c09ad40 0x7f1c8c1c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:28.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.985+0000 7f1c8bfff700 1 --2- 172.21.15.156:0/42658510 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c8c133f70 0x7f1c8c1c8d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400e910 tx=0x7f1c8400ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:28.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.985+0000 7f1c83fff700 1 -- 172.21.15.156:0/42658510 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c84004020 con 0x7f1c8c133f70 2023-09-30T22:19:28.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.985+0000 7f1c83fff700 1 -- 172.21.15.156:0/42658510 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c840041a0 con 0x7f1c8c133f70 2023-09-30T22:19:28.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.985+0000 7f1c83fff700 1 -- 172.21.15.156:0/42658510 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c84004550 con 0x7f1c8c133f70 2023-09-30T22:19:28.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.985+0000 7f1c91d2a700 1 -- 172.21.15.156:0/42658510 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c840094a0 con 0x7f1c8c133f70 2023-09-30T22:19:28.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.985+0000 7f1c91d2a700 1 -- 172.21.15.156:0/42658510 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c740094a0 con 0x7f1c8c133f70 2023-09-30T22:19:28.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.985+0000 7f1c83fff700 1 -- 172.21.15.156:0/42658510 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1c840036a0 con 0x7f1c8c133f70 2023-09-30T22:19:28.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.986+0000 7f1c83fff700 1 -- 172.21.15.156:0/42658510 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f1c8403f8a0 con 0x7f1c8c133f70 2023-09-30T22:19:28.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.986+0000 7f1c8b7fe700 1 -- 172.21.15.156:0/42658510 >> v1:172.21.15.156:6816/126965 conn(0x7f1c6c02f510 legacy=0x7f1c6c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:28.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.986+0000 7f1c91d2a700 1 -- 172.21.15.156:0/42658510 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c8c122570 con 0x7f1c8c133f70 2023-09-30T22:19:28.990 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:28.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:28.990+0000 7f1c83fff700 1 -- 172.21.15.156:0/42658510 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1c84017070 con 0x7f1c8c133f70 2023-09-30T22:19:29.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.071+0000 7fa033559700 1 Processor -- start 2023-09-30T22:19:29.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.071+0000 7fa033559700 1 -- start start 2023-09-30T22:19:29.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.072+0000 7fa033559700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa02c06a770 0x7fa02c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:29.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.072+0000 7fa033559700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa02c09dec0 0x7fa02c06b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:29.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.072+0000 7fa033559700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa02c06b5c0 con 0x7fa02c131a00 2023-09-30T22:19:29.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.072+0000 7fa033559700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa02c06e900 con 0x7fa02c06a770 2023-09-30T22:19:29.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.072+0000 7fa033559700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c09d180 con 0x7fa02c09dec0 2023-09-30T22:19:29.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.072+0000 7fa0312f5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa02c06a770 0x7fa02c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:29.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.072+0000 7fa030af4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa02c09dec0 0x7fa02c06b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:29.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.072+0000 7fa0312f5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa02c06a770 0x7fa02c06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:55274/0 (socket says 172.21.15.156:55274) 2023-09-30T22:19:29.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.072+0000 7fa030af4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa02c09dec0 0x7fa02c06b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38086/0 (socket says 172.21.15.156:38086) 2023-09-30T22:19:29.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.072+0000 7fa0312f5700 1 -- 172.21.15.156:0/984217584 learned_addr learned my addr 172.21.15.156:0/984217584 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:29.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.072+0000 7fa030af4700 1 -- 172.21.15.156:0/984217584 >> v2:172.21.15.156:3300/0 conn(0x7fa02c06a770 msgr2=0x7fa02c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:29.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.072+0000 7fa030af4700 1 --2- 172.21.15.156:0/984217584 >> v2:172.21.15.156:3300/0 conn(0x7fa02c06a770 0x7fa02c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:29.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.072+0000 7fa030af4700 1 -- 172.21.15.156:0/984217584 >> v1:172.21.15.156:6789/0 conn(0x7fa02c131a00 legacy=0x7fa02c131e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:29.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.072+0000 7fa030af4700 1 -- 172.21.15.156:0/984217584 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa02c09e780 con 0x7fa02c09dec0 2023-09-30T22:19:29.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.072+0000 7fa0312f5700 1 --2- 172.21.15.156:0/984217584 >> v2:172.21.15.156:3300/0 conn(0x7fa02c06a770 0x7fa02c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:29.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.073+0000 7fa030af4700 1 --2- 172.21.15.156:0/984217584 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa02c09dec0 0x7fa02c06b080 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa01c009840 tx=0x7fa01c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1719236e8aa32b2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:29.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.073+0000 7fa023fff700 1 -- 172.21.15.156:0/984217584 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01c011830 con 0x7fa02c09dec0 2023-09-30T22:19:29.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.073+0000 7fa023fff700 1 -- 172.21.15.156:0/984217584 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01c011990 con 0x7fa02c09dec0 2023-09-30T22:19:29.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.073+0000 7fa023fff700 1 -- 172.21.15.156:0/984217584 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01c011d20 con 0x7fa02c09dec0 2023-09-30T22:19:29.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.074+0000 7fa033559700 1 -- 172.21.15.156:0/984217584 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa02c09dec0 msgr2=0x7fa02c06b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:29.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.074+0000 7fa033559700 1 --2- 172.21.15.156:0/984217584 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa02c09dec0 0x7fa02c06b080 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa01c009840 tx=0x7fa01c009b50 comp rx=0 tx=0).stop 2023-09-30T22:19:29.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.074+0000 7fa033559700 1 -- 172.21.15.156:0/984217584 shutdown_connections 2023-09-30T22:19:29.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.074+0000 7fa033559700 1 --2- 172.21.15.156:0/984217584 >> v2:172.21.15.156:3300/0 conn(0x7fa02c06a770 0x7fa02c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:29.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.074+0000 7fa033559700 1 --2- 172.21.15.156:0/984217584 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa02c09dec0 0x7fa02c06b080 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:29.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.074+0000 7fa033559700 1 -- 172.21.15.156:0/984217584 >> 172.21.15.156:0/984217584 conn(0x7fa02c099c40 msgr2=0x7fa02c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:29.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.074+0000 7fa033559700 1 -- 172.21.15.156:0/984217584 shutdown_connections 2023-09-30T22:19:29.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.074+0000 7fa033559700 1 -- 172.21.15.156:0/984217584 wait complete. 2023-09-30T22:19:29.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.075+0000 7fa033559700 1 Processor -- start 2023-09-30T22:19:29.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.075+0000 7fa033559700 1 -- start start 2023-09-30T22:19:29.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.075+0000 7fa033559700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa02c06a770 0x7fa02c09a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:29.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.075+0000 7fa033559700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa02c09dec0 0x7fa02c09a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:29.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.075+0000 7fa033559700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa02c131a00 0x7fa02c09af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:29.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.075+0000 7fa033559700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c121d40 con 0x7fa02c09dec0 2023-09-30T22:19:29.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.075+0000 7fa033559700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c12f500 con 0x7fa02c131a00 2023-09-30T22:19:29.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.075+0000 7fa033559700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c120920 con 0x7fa02c06a770 2023-09-30T22:19:29.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.075+0000 7fa0312f5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa02c06a770 0x7fa02c09a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:29.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.075+0000 7fa031af6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa02c131a00 0x7fa02c09af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:29.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.075+0000 7fa0312f5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa02c06a770 0x7fa02c09a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44034/0 (socket says 172.21.15.156:44034) 2023-09-30T22:19:29.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.075+0000 7fa0312f5700 1 -- 172.21.15.156:0/337426678 learned_addr learned my addr 172.21.15.156:0/337426678 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:29.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.075+0000 7fa030af4700 1 --2- 172.21.15.156:0/337426678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa02c09dec0 0x7fa02c09a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:29.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.076+0000 7fa0312f5700 1 -- 172.21.15.156:0/337426678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa02c131a00 msgr2=0x7fa02c09af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:29.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.076+0000 7fa0312f5700 1 --2- 172.21.15.156:0/337426678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa02c131a00 0x7fa02c09af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:29.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.076+0000 7fa0312f5700 1 -- 172.21.15.156:0/337426678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa02c09dec0 msgr2=0x7fa02c09a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:29.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.076+0000 7fa0312f5700 1 --2- 172.21.15.156:0/337426678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa02c09dec0 0x7fa02c09a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:29.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.076+0000 7fa0312f5700 1 -- 172.21.15.156:0/337426678 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa028009550 con 0x7fa02c06a770 2023-09-30T22:19:29.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.076+0000 7fa030af4700 1 --2- 172.21.15.156:0/337426678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa02c09dec0 0x7fa02c09a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:29.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.076+0000 7fa031af6700 1 --2- 172.21.15.156:0/337426678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa02c131a00 0x7fa02c09af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:29.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.076+0000 7fa0312f5700 1 --2- 172.21.15.156:0/337426678 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa02c06a770 0x7fa02c09a490 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa02800ec10 tx=0x7fa02800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:29.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.076+0000 7fa021ffb700 1 -- 172.21.15.156:0/337426678 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02800c850 con 0x7fa02c06a770 2023-09-30T22:19:29.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.076+0000 7fa033559700 1 -- 172.21.15.156:0/337426678 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa01c0094a0 con 0x7fa02c06a770 2023-09-30T22:19:29.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.076+0000 7fa021ffb700 1 -- 172.21.15.156:0/337426678 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02800c9b0 con 0x7fa02c06a770 2023-09-30T22:19:29.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.076+0000 7fa021ffb700 1 -- 172.21.15.156:0/337426678 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02800cd40 con 0x7fa02c06a770 2023-09-30T22:19:29.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.076+0000 7fa033559700 1 -- 172.21.15.156:0/337426678 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa02c130df0 con 0x7fa02c06a770 2023-09-30T22:19:29.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.077+0000 7fa033559700 1 -- 172.21.15.156:0/337426678 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa02c071d40 con 0x7fa02c06a770 2023-09-30T22:19:29.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.078+0000 7fa021ffb700 1 -- 172.21.15.156:0/337426678 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa028013470 con 0x7fa02c06a770 2023-09-30T22:19:29.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.078+0000 7fa021ffb700 1 -- 172.21.15.156:0/337426678 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fa0280405b0 con 0x7fa02c06a770 2023-09-30T22:19:29.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.078+0000 7fa030af4700 1 -- 172.21.15.156:0/337426678 >> v1:172.21.15.156:6816/126965 conn(0x7fa01002f510 legacy=0x7fa0100319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:29.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.086+0000 7fa021ffb700 1 -- 172.21.15.156:0/337426678 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa028013720 con 0x7fa02c06a770 2023-09-30T22:19:29.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.118+0000 7fb81f8f6700 1 Processor -- start 2023-09-30T22:19:29.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.118+0000 7fb81f8f6700 1 -- start start 2023-09-30T22:19:29.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.119+0000 7fb81f8f6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb81806a770 0x7fb81806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:29.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.119+0000 7fb81f8f6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb81809dec0 0x7fb81806b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:29.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.119+0000 7fb81f8f6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb818131a00 0x7fb818131e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:29.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.119+0000 7fb81f8f6700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb81806b5c0 con 0x7fb818131a00 2023-09-30T22:19:29.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.119+0000 7fb81f8f6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb81806e900 con 0x7fb81806a770 2023-09-30T22:19:29.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.119+0000 7fb81f8f6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb81809d180 con 0x7fb81809dec0 2023-09-30T22:19:29.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.119+0000 7fb81ce91700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb81809dec0 0x7fb81806b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:29.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.119+0000 7fb81de93700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb818131a00 0x7fb818131e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:29.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.119+0000 7fb81d692700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb81806a770 0x7fb81806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:29.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.119+0000 7fb81ce91700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb81809dec0 0x7fb81806b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44036/0 (socket says 172.21.15.156:44036) 2023-09-30T22:19:29.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.119+0000 7fb81ce91700 1 -- 172.21.15.156:0/4054880371 learned_addr learned my addr 172.21.15.156:0/4054880371 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:29.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.119+0000 7fb81de93700 1 --2- 172.21.15.156:0/4054880371 >> v2:172.21.15.156:3300/0 conn(0x7fb818131a00 0x7fb818131e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:55288/0 (socket says 172.21.15.156:55288) 2023-09-30T22:19:29.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.119+0000 7fb81d692700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb81806a770 0x7fb81806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38112/0 (socket says 172.21.15.156:38112) 2023-09-30T22:19:29.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.120+0000 7fb81d692700 1 -- 172.21.15.156:0/4054880371 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb81809dec0 msgr2=0x7fb81806b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:29.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.120+0000 7fb81d692700 1 --2- 172.21.15.156:0/4054880371 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb81809dec0 0x7fb81806b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:29.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.120+0000 7fb81d692700 1 -- 172.21.15.156:0/4054880371 >> v2:172.21.15.156:3300/0 conn(0x7fb818131a00 msgr2=0x7fb818131e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:29.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.120+0000 7fb81d692700 1 --2- 172.21.15.156:0/4054880371 >> v2:172.21.15.156:3300/0 conn(0x7fb818131a00 0x7fb818131e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:29.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.120+0000 7fb81d692700 1 -- 172.21.15.156:0/4054880371 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81809e780 con 0x7fb81806a770 2023-09-30T22:19:29.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.120+0000 7fb81de93700 1 --2- 172.21.15.156:0/4054880371 >> v2:172.21.15.156:3300/0 conn(0x7fb818131a00 0x7fb818131e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:29.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.120+0000 7fb81d692700 1 --2- 172.21.15.156:0/4054880371 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb81806a770 0x7fb81806ab40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb814009840 tx=0x7fb814009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbb2297d8cbe9835 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:29.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.120+0000 7fb80ffff700 1 -- 172.21.15.156:0/4054880371 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb814011830 con 0x7fb81806a770 2023-09-30T22:19:29.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.120+0000 7fb80ffff700 1 -- 172.21.15.156:0/4054880371 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb814011990 con 0x7fb81806a770 2023-09-30T22:19:29.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.120+0000 7fb80ffff700 1 -- 172.21.15.156:0/4054880371 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb814011d20 con 0x7fb81806a770 2023-09-30T22:19:29.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.121+0000 7fb81f8f6700 1 -- 172.21.15.156:0/4054880371 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb81806a770 msgr2=0x7fb81806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:29.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.121+0000 7fb81f8f6700 1 --2- 172.21.15.156:0/4054880371 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb81806a770 0x7fb81806ab40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb814009840 tx=0x7fb814009b50 comp rx=0 tx=0).stop 2023-09-30T22:19:29.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.121+0000 7fb81f8f6700 1 -- 172.21.15.156:0/4054880371 shutdown_connections 2023-09-30T22:19:29.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.121+0000 7fb81f8f6700 1 --2- 172.21.15.156:0/4054880371 >> v2:172.21.15.156:3300/0 conn(0x7fb818131a00 0x7fb818131e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:29.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.121+0000 7fb81f8f6700 1 --2- 172.21.15.156:0/4054880371 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb81806a770 0x7fb81806ab40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:29.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.121+0000 7fb81f8f6700 1 --2- 172.21.15.156:0/4054880371 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb81809dec0 0x7fb81806b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:29.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.121+0000 7fb81f8f6700 1 -- 172.21.15.156:0/4054880371 >> 172.21.15.156:0/4054880371 conn(0x7fb818099c40 msgr2=0x7fb8180a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:29.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.121+0000 7fb81f8f6700 1 -- 172.21.15.156:0/4054880371 shutdown_connections 2023-09-30T22:19:29.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.121+0000 7fb81f8f6700 1 -- 172.21.15.156:0/4054880371 wait complete. 2023-09-30T22:19:29.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.122+0000 7fb81f8f6700 1 Processor -- start 2023-09-30T22:19:29.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.122+0000 7fb81f8f6700 1 -- start start 2023-09-30T22:19:29.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.122+0000 7fb81f8f6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb81806a770 0x7fb818119dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:29.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.122+0000 7fb81f8f6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb81809dec0 0x7fb81811a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:29.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.122+0000 7fb81f8f6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb818131a00 0x7fb81811a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:29.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.122+0000 7fb81f8f6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81811c030 con 0x7fb81806a770 2023-09-30T22:19:29.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.122+0000 7fb81f8f6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb81811e2b0 con 0x7fb81809dec0 2023-09-30T22:19:29.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.122+0000 7fb81f8f6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb81811d8f0 con 0x7fb818131a00 2023-09-30T22:19:29.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.122+0000 7fb81de93700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb818131a00 0x7fb81811a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:29.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.122+0000 7fb81de93700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb818131a00 0x7fb81811a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44048/0 (socket says 172.21.15.156:44048) 2023-09-30T22:19:29.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.122+0000 7fb81de93700 1 -- 172.21.15.156:0/1365193260 learned_addr learned my addr 172.21.15.156:0/1365193260 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:29.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.122+0000 7fb81d692700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb81806a770 0x7fb818119dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:29.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.122+0000 7fb81ce91700 1 --2- 172.21.15.156:0/1365193260 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb81809dec0 0x7fb81811a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:29.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.123+0000 7fb81de93700 1 -- 172.21.15.156:0/1365193260 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb81809dec0 msgr2=0x7fb81811a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:29.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.123+0000 7fb81de93700 1 --2- 172.21.15.156:0/1365193260 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb81809dec0 0x7fb81811a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:29.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.123+0000 7fb81de93700 1 -- 172.21.15.156:0/1365193260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb81806a770 msgr2=0x7fb818119dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:29.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.123+0000 7fb81de93700 1 --2- 172.21.15.156:0/1365193260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb81806a770 0x7fb818119dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:29.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.123+0000 7fb81de93700 1 -- 172.21.15.156:0/1365193260 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb810014660 con 0x7fb818131a00 2023-09-30T22:19:29.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.123+0000 7fb81ce91700 1 --2- 172.21.15.156:0/1365193260 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb81809dec0 0x7fb81811a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:19:29.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.123+0000 7fb81d692700 1 --2- 172.21.15.156:0/1365193260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb81806a770 0x7fb818119dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:29.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.123+0000 7fb81de93700 1 --2- 172.21.15.156:0/1365193260 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb818131a00 0x7fb81811a850 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb810011650 tx=0x7fb810011960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:29.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.123+0000 7fb80dffb700 1 -- 172.21.15.156:0/1365193260 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb810019040 con 0x7fb818131a00 2023-09-30T22:19:29.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.123+0000 7fb80dffb700 1 -- 172.21.15.156:0/1365193260 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb810003c40 con 0x7fb818131a00 2023-09-30T22:19:29.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.123+0000 7fb81f8f6700 1 -- 172.21.15.156:0/1365193260 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8140094a0 con 0x7fb818131a00 2023-09-30T22:19:29.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.123+0000 7fb80dffb700 1 -- 172.21.15.156:0/1365193260 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8100177c0 con 0x7fb818131a00 2023-09-30T22:19:29.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.123+0000 7fb81f8f6700 1 -- 172.21.15.156:0/1365193260 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb81811d0d0 con 0x7fb818131a00 2023-09-30T22:19:29.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.124+0000 7fb80dffb700 1 -- 172.21.15.156:0/1365193260 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb810017940 con 0x7fb818131a00 2023-09-30T22:19:29.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.124+0000 7fb81f8f6700 1 -- 172.21.15.156:0/1365193260 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb81804f2a0 con 0x7fb818131a00 2023-09-30T22:19:29.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.124+0000 7fb80dffb700 1 -- 172.21.15.156:0/1365193260 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fb810048e80 con 0x7fb818131a00 2023-09-30T22:19:29.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.124+0000 7fb81d692700 1 -- 172.21.15.156:0/1365193260 >> v1:172.21.15.156:6816/126965 conn(0x7fb7fc02f510 legacy=0x7fb7fc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:29.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.129+0000 7fb80dffb700 1 -- 172.21.15.156:0/1365193260 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb810027b50 con 0x7fb818131a00 2023-09-30T22:19:29.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.187+0000 7f1c8b7fe700 1 -- 172.21.15.156:0/42658510 >> v1:172.21.15.156:6816/126965 conn(0x7f1c6c02f510 legacy=0x7f1c6c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:29.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.193+0000 7f1c91d2a700 1 -- 172.21.15.156:0/42658510 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1c8c04f2a0 con 0x7f1c8c133f70 2023-09-30T22:19:29.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.193+0000 7f1c83fff700 1 -- 172.21.15.156:0/42658510 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1c84013680 con 0x7f1c8c133f70 2023-09-30T22:19:29.193 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:29.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.195+0000 7f1c91d2a700 1 -- 172.21.15.156:0/42658510 >> v1:172.21.15.156:6816/126965 conn(0x7f1c6c02f510 legacy=0x7f1c6c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:29.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.195+0000 7f1c91d2a700 1 -- 172.21.15.156:0/42658510 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c8c133f70 msgr2=0x7f1c8c1c8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:29.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.195+0000 7f1c91d2a700 1 --2- 172.21.15.156:0/42658510 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c8c133f70 0x7f1c8c1c8d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400e910 tx=0x7f1c8400ec20 comp rx=0 tx=0).stop 2023-09-30T22:19:29.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.195+0000 7f1c91d2a700 1 -- 172.21.15.156:0/42658510 shutdown_connections 2023-09-30T22:19:29.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.195+0000 7f1c91d2a700 1 --2- 172.21.15.156:0/42658510 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1c8c133f70 0x7f1c8c1c8d80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:29.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.195+0000 7f1c91d2a700 1 --2- 172.21.15.156:0/42658510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c8c09ad40 0x7f1c8c1c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:29.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.195+0000 7f1c91d2a700 1 --2- 172.21.15.156:0/42658510 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1c8c0a0a70 0x7f1c8c1c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:29.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.195+0000 7f1c91d2a700 1 -- 172.21.15.156:0/42658510 >> 172.21.15.156:0/42658510 conn(0x7f1c8c099c40 msgr2=0x7f1c8c09e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:29.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.195+0000 7f1c91d2a700 1 -- 172.21.15.156:0/42658510 shutdown_connections 2023-09-30T22:19:29.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.195+0000 7f1c91d2a700 1 -- 172.21.15.156:0/42658510 wait complete. 2023-09-30T22:19:29.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:29.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.279+0000 7fa030af4700 1 -- 172.21.15.156:0/337426678 >> v1:172.21.15.156:6816/126965 conn(0x7fa01002f510 legacy=0x7fa0100319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:29.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.280+0000 7fa033559700 1 -- 172.21.15.156:0/337426678 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa02c04f2a0 con 0x7fa02c06a770 2023-09-30T22:19:29.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.280+0000 7fa021ffb700 1 -- 172.21.15.156:0/337426678 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa02801ab50 con 0x7fa02c06a770 2023-09-30T22:19:29.280 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:29.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.282+0000 7fa033559700 1 -- 172.21.15.156:0/337426678 >> v1:172.21.15.156:6816/126965 conn(0x7fa01002f510 legacy=0x7fa0100319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:29.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.282+0000 7fa033559700 1 -- 172.21.15.156:0/337426678 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa02c06a770 msgr2=0x7fa02c09a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:29.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.282+0000 7fa033559700 1 --2- 172.21.15.156:0/337426678 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa02c06a770 0x7fa02c09a490 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa02800ec10 tx=0x7fa02800ef20 comp rx=0 tx=0).stop 2023-09-30T22:19:29.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.282+0000 7fa033559700 1 -- 172.21.15.156:0/337426678 shutdown_connections 2023-09-30T22:19:29.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.282+0000 7fa033559700 1 --2- 172.21.15.156:0/337426678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa02c131a00 0x7fa02c09af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:29.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.282+0000 7fa033559700 1 --2- 172.21.15.156:0/337426678 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa02c06a770 0x7fa02c09a490 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:29.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.282+0000 7fa033559700 1 --2- 172.21.15.156:0/337426678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa02c09dec0 0x7fa02c09a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:29.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.282+0000 7fa033559700 1 -- 172.21.15.156:0/337426678 >> 172.21.15.156:0/337426678 conn(0x7fa02c099c40 msgr2=0x7fa02c1b8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:29.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.282+0000 7fa033559700 1 -- 172.21.15.156:0/337426678 shutdown_connections 2023-09-30T22:19:29.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.282+0000 7fa033559700 1 -- 172.21.15.156:0/337426678 wait complete. 2023-09-30T22:19:29.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:29.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.325+0000 7fb81d692700 1 -- 172.21.15.156:0/1365193260 >> v1:172.21.15.156:6816/126965 conn(0x7fb7fc02f510 legacy=0x7fb7fc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:29.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.326+0000 7fb81f8f6700 1 -- 172.21.15.156:0/1365193260 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb81811cc30 con 0x7fb818131a00 2023-09-30T22:19:29.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.326+0000 7fb80dffb700 1 -- 172.21.15.156:0/1365193260 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb810027b50 con 0x7fb818131a00 2023-09-30T22:19:29.325 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:29.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.328+0000 7fb81f8f6700 1 -- 172.21.15.156:0/1365193260 >> v1:172.21.15.156:6816/126965 conn(0x7fb7fc02f510 legacy=0x7fb7fc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:29.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.328+0000 7fb81f8f6700 1 -- 172.21.15.156:0/1365193260 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb818131a00 msgr2=0x7fb81811a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:29.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.328+0000 7fb81f8f6700 1 --2- 172.21.15.156:0/1365193260 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb818131a00 0x7fb81811a850 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb810011650 tx=0x7fb810011960 comp rx=0 tx=0).stop 2023-09-30T22:19:29.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.328+0000 7fb81f8f6700 1 -- 172.21.15.156:0/1365193260 shutdown_connections 2023-09-30T22:19:29.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.328+0000 7fb81f8f6700 1 --2- 172.21.15.156:0/1365193260 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb818131a00 0x7fb81811a850 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:29.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.328+0000 7fb81f8f6700 1 --2- 172.21.15.156:0/1365193260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb81806a770 0x7fb818119dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:29.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.328+0000 7fb81f8f6700 1 --2- 172.21.15.156:0/1365193260 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb81809dec0 0x7fb81811a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:29.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.328+0000 7fb81f8f6700 1 -- 172.21.15.156:0/1365193260 >> 172.21.15.156:0/1365193260 conn(0x7fb818099c40 msgr2=0x7fb81812eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:29.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.328+0000 7fb81f8f6700 1 -- 172.21.15.156:0/1365193260 shutdown_connections 2023-09-30T22:19:29.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:29.328+0000 7fb81f8f6700 1 -- 172.21.15.156:0/1365193260 wait complete. 2023-09-30T22:19:29.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:29.923 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:30.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.047+0000 7f79d31f7700 1 Processor -- start 2023-09-30T22:19:30.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.048+0000 7f79d31f7700 1 -- start start 2023-09-30T22:19:30.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.048+0000 7f79d31f7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79cc09f350 0x7f79cc136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:30.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.048+0000 7f79d31f7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79cc1371c0 0x7f79cc1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:30.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.048+0000 7f79d31f7700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79cc09c970 con 0x7f79cc09e870 2023-09-30T22:19:30.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.048+0000 7f79d31f7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc0a0920 con 0x7f79cc1371c0 2023-09-30T22:19:30.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.048+0000 7f79d31f7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc09f9c0 con 0x7f79cc09f350 2023-09-30T22:19:30.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.048+0000 7f79cbfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79cc09f350 0x7f79cc136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:30.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.048+0000 7f79d1794700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79cc1371c0 0x7f79cc1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:30.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.048+0000 7f79d0f93700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f79cc09e870 0x7f79cc09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38478/0 (socket says 172.21.15.156:38478) 2023-09-30T22:19:30.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.048+0000 7f79d0f93700 1 -- 172.21.15.156:0/822783529 learned_addr learned my addr 172.21.15.156:0/822783529 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:30.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.048+0000 7f79cbfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79cc09f350 0x7f79cc136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44054/0 (socket says 172.21.15.156:44054) 2023-09-30T22:19:30.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.048+0000 7f79cb7fe700 1 -- 172.21.15.156:0/822783529 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2971262211 0 0) 0x7f79cc09c970 con 0x7f79cc09e870 2023-09-30T22:19:30.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.048+0000 7f79cbfff700 1 -- 172.21.15.156:0/822783529 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79cc1371c0 msgr2=0x7f79cc1395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:30.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.048+0000 7f79cbfff700 1 --2- 172.21.15.156:0/822783529 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79cc1371c0 0x7f79cc1395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.048+0000 7f79cbfff700 1 -- 172.21.15.156:0/822783529 >> v1:172.21.15.156:6789/0 conn(0x7f79cc09e870 legacy=0x7f79cc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.048+0000 7f79cbfff700 1 -- 172.21.15.156:0/822783529 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79cc09bab0 con 0x7f79cc09f350 2023-09-30T22:19:30.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.048+0000 7f79d1794700 1 --2- 172.21.15.156:0/822783529 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79cc1371c0 0x7f79cc1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:30.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.049+0000 7f79cbfff700 1 --2- 172.21.15.156:0/822783529 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79cc09f350 0x7f79cc136c80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f79b8009870 tx=0x7f79b8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=822e45664ee5928f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:30.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.049+0000 7f79cb7fe700 1 -- 172.21.15.156:0/822783529 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b8011830 con 0x7f79cc09f350 2023-09-30T22:19:30.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.049+0000 7f79cb7fe700 1 -- 172.21.15.156:0/822783529 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b8011990 con 0x7f79cc09f350 2023-09-30T22:19:30.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.049+0000 7f79cb7fe700 1 -- 172.21.15.156:0/822783529 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b8011d20 con 0x7f79cc09f350 2023-09-30T22:19:30.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.049+0000 7f79d31f7700 1 -- 172.21.15.156:0/822783529 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79cc09f350 msgr2=0x7f79cc136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.049+0000 7f79d31f7700 1 --2- 172.21.15.156:0/822783529 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79cc09f350 0x7f79cc136c80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f79b8009870 tx=0x7f79b8009b80 comp rx=0 tx=0).stop 2023-09-30T22:19:30.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.049+0000 7f79d31f7700 1 -- 172.21.15.156:0/822783529 shutdown_connections 2023-09-30T22:19:30.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.049+0000 7f79d31f7700 1 --2- 172.21.15.156:0/822783529 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79cc1371c0 0x7f79cc1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.049+0000 7f79d31f7700 1 --2- 172.21.15.156:0/822783529 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79cc09f350 0x7f79cc136c80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.049+0000 7f79d31f7700 1 -- 172.21.15.156:0/822783529 >> 172.21.15.156:0/822783529 conn(0x7f79cc0a4430 msgr2=0x7f79cc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:30.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.049+0000 7f79d31f7700 1 -- 172.21.15.156:0/822783529 shutdown_connections 2023-09-30T22:19:30.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.049+0000 7f79d31f7700 1 -- 172.21.15.156:0/822783529 wait complete. 2023-09-30T22:19:30.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.050+0000 7f79d31f7700 1 Processor -- start 2023-09-30T22:19:30.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.050+0000 7f79d31f7700 1 -- start start 2023-09-30T22:19:30.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.051+0000 7f79d31f7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79cc09e870 0x7f79cc1c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:30.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.051+0000 7f79d31f7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79cc09f350 0x7f79cc1c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:30.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.051+0000 7f79d31f7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79cc1371c0 0x7f79cc06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:30.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.051+0000 7f79d31f7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc06d430 con 0x7f79cc09f350 2023-09-30T22:19:30.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.051+0000 7f79d31f7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc1c91f0 con 0x7f79cc09e870 2023-09-30T22:19:30.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.051+0000 7f79d31f7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc09dba0 con 0x7f79cc1371c0 2023-09-30T22:19:30.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.051+0000 7f79cbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79cc09f350 0x7f79cc1c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:30.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.051+0000 7f79d1794700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79cc1371c0 0x7f79cc06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:30.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.051+0000 7f79cbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79cc09f350 0x7f79cc1c8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:55314/0 (socket says 172.21.15.156:55314) 2023-09-30T22:19:30.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.051+0000 7f79cbfff700 1 -- 172.21.15.156:0/1511704533 learned_addr learned my addr 172.21.15.156:0/1511704533 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:30.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.051+0000 7f79d1794700 1 --2- 172.21.15.156:0/1511704533 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79cc1371c0 0x7f79cc06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44066/0 (socket says 172.21.15.156:44066) 2023-09-30T22:19:30.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.051+0000 7f79d0f93700 1 --2- 172.21.15.156:0/1511704533 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79cc09e870 0x7f79cc1c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:30.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.051+0000 7f79cbfff700 1 -- 172.21.15.156:0/1511704533 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79cc1371c0 msgr2=0x7f79cc06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.051+0000 7f79cbfff700 1 --2- 172.21.15.156:0/1511704533 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79cc1371c0 0x7f79cc06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.051+0000 7f79cbfff700 1 -- 172.21.15.156:0/1511704533 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79cc09e870 msgr2=0x7f79cc1c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.051+0000 7f79cbfff700 1 --2- 172.21.15.156:0/1511704533 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79cc09e870 0x7f79cc1c8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.051+0000 7f79cbfff700 1 -- 172.21.15.156:0/1511704533 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c4009a70 con 0x7f79cc09f350 2023-09-30T22:19:30.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.051+0000 7f79d1794700 1 --2- 172.21.15.156:0/1511704533 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79cc1371c0 0x7f79cc06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:30.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.051+0000 7f79cbfff700 1 --2- 172.21.15.156:0/1511704533 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79cc09f350 0x7f79cc1c8cb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f79b8009840 tx=0x7f79b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:30.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.052+0000 7f79c97fa700 1 -- 172.21.15.156:0/1511704533 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b80044d0 con 0x7f79cc09f350 2023-09-30T22:19:30.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.052+0000 7f79c97fa700 1 -- 172.21.15.156:0/1511704533 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b801f070 con 0x7f79cc09f350 2023-09-30T22:19:30.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.052+0000 7f79d31f7700 1 -- 172.21.15.156:0/1511704533 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b80094a0 con 0x7f79cc09f350 2023-09-30T22:19:30.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.052+0000 7f79c97fa700 1 -- 172.21.15.156:0/1511704533 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b80038e0 con 0x7f79cc09f350 2023-09-30T22:19:30.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.052+0000 7f79d31f7700 1 -- 172.21.15.156:0/1511704533 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79cc1261f0 con 0x7f79cc09f350 2023-09-30T22:19:30.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.052+0000 7f79d31f7700 1 -- 172.21.15.156:0/1511704533 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79cc125e90 con 0x7f79cc09f350 2023-09-30T22:19:30.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.053+0000 7f79c97fa700 1 -- 172.21.15.156:0/1511704533 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f79b8003a40 con 0x7f79cc09f350 2023-09-30T22:19:30.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.053+0000 7f79d0f93700 1 -- 172.21.15.156:0/1511704533 >> v1:172.21.15.156:6816/126965 conn(0x7f79b002f510 legacy=0x7f79b00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:30.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.053+0000 7f79c97fa700 1 -- 172.21.15.156:0/1511704533 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f79b8021070 con 0x7f79cc09f350 2023-09-30T22:19:30.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.058+0000 7f79c97fa700 1 -- 172.21.15.156:0/1511704533 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f79b80253e0 con 0x7f79cc09f350 2023-09-30T22:19:30.209 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:30.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.248+0000 7f79d31f7700 1 -- 172.21.15.156:0/1511704533 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f79cc126020 con 0x7f79cc09f350 2023-09-30T22:19:30.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.248+0000 7f79c97fa700 1 -- 172.21.15.156:0/1511704533 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f79b8015030 con 0x7f79cc09f350 2023-09-30T22:19:30.248 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:30.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.252+0000 7f79d31f7700 1 -- 172.21.15.156:0/1511704533 >> v1:172.21.15.156:6816/126965 conn(0x7f79b002f510 legacy=0x7f79b00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:30.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.252+0000 7f79d31f7700 1 -- 172.21.15.156:0/1511704533 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79cc09f350 msgr2=0x7f79cc1c8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.252+0000 7f79d31f7700 1 --2- 172.21.15.156:0/1511704533 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79cc09f350 0x7f79cc1c8cb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f79b8009840 tx=0x7f79b8004750 comp rx=0 tx=0).stop 2023-09-30T22:19:30.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.252+0000 7f79d31f7700 1 -- 172.21.15.156:0/1511704533 shutdown_connections 2023-09-30T22:19:30.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.252+0000 7f79d31f7700 1 --2- 172.21.15.156:0/1511704533 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79cc1371c0 0x7f79cc06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.252+0000 7f79d31f7700 1 --2- 172.21.15.156:0/1511704533 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79cc09e870 0x7f79cc1c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.252+0000 7f79d31f7700 1 --2- 172.21.15.156:0/1511704533 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79cc09f350 0x7f79cc1c8cb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.252+0000 7f79d31f7700 1 -- 172.21.15.156:0/1511704533 >> 172.21.15.156:0/1511704533 conn(0x7f79cc0a4430 msgr2=0x7f79cc09c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:30.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.252+0000 7f79d31f7700 1 -- 172.21.15.156:0/1511704533 shutdown_connections 2023-09-30T22:19:30.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.252+0000 7f79d31f7700 1 -- 172.21.15.156:0/1511704533 wait complete. 2023-09-30T22:19:30.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:30.295 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:30.340 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:30.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.344+0000 7f656747e700 1 Processor -- start 2023-09-30T22:19:30.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.344+0000 7f656747e700 1 -- start start 2023-09-30T22:19:30.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.345+0000 7f656747e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f656006a770 0x7f6560133970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:30.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.345+0000 7f656747e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6560130650 0x7f656013b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:30.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.345+0000 7f656747e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f656009f480 con 0x7f6560133eb0 2023-09-30T22:19:30.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.345+0000 7f656747e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656009a3f0 con 0x7f6560130650 2023-09-30T22:19:30.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.345+0000 7f656747e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f656009ef40 con 0x7f656006a770 2023-09-30T22:19:30.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.345+0000 7f656521a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f656006a770 0x7f6560133970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:30.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.345+0000 7f656521a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f656006a770 0x7f6560133970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44072/0 (socket says 172.21.15.156:44072) 2023-09-30T22:19:30.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.345+0000 7f6564a19700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6560133eb0 0x7f656012ff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38480/0 (socket says 172.21.15.156:38480) 2023-09-30T22:19:30.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.345+0000 7f6565a1b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6560130650 0x7f656013b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:30.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.345+0000 7f656521a700 1 -- 172.21.15.156:0/3591968860 learned_addr learned my addr 172.21.15.156:0/3591968860 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:30.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.345+0000 7f6557fff700 1 -- 172.21.15.156:0/3591968860 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98001567 0 0) 0x7f656009f480 con 0x7f6560133eb0 2023-09-30T22:19:30.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.345+0000 7f656521a700 1 -- 172.21.15.156:0/3591968860 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6560130650 msgr2=0x7f656013b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:30.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.345+0000 7f656521a700 1 --2- 172.21.15.156:0/3591968860 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6560130650 0x7f656013b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.345+0000 7f656521a700 1 -- 172.21.15.156:0/3591968860 >> v1:172.21.15.156:6789/0 conn(0x7f6560133eb0 legacy=0x7f656012ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.345+0000 7f656521a700 1 -- 172.21.15.156:0/3591968860 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656009f6b0 con 0x7f656006a770 2023-09-30T22:19:30.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.345+0000 7f6565a1b700 1 --2- 172.21.15.156:0/3591968860 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6560130650 0x7f656013b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:30.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.345+0000 7f656521a700 1 --2- 172.21.15.156:0/3591968860 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f656006a770 0x7f6560133970 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f655c009950 tx=0x7f655c009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31efd285a80de19c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:30.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.346+0000 7f6557fff700 1 -- 172.21.15.156:0/3591968860 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c011830 con 0x7f656006a770 2023-09-30T22:19:30.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.346+0000 7f6557fff700 1 -- 172.21.15.156:0/3591968860 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655c011990 con 0x7f656006a770 2023-09-30T22:19:30.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.346+0000 7f6557fff700 1 -- 172.21.15.156:0/3591968860 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c011d40 con 0x7f656006a770 2023-09-30T22:19:30.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.346+0000 7f656747e700 1 -- 172.21.15.156:0/3591968860 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f656006a770 msgr2=0x7f6560133970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.346+0000 7f656747e700 1 --2- 172.21.15.156:0/3591968860 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f656006a770 0x7f6560133970 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f655c009950 tx=0x7f655c009c60 comp rx=0 tx=0).stop 2023-09-30T22:19:30.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.346+0000 7f656747e700 1 -- 172.21.15.156:0/3591968860 shutdown_connections 2023-09-30T22:19:30.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.346+0000 7f656747e700 1 --2- 172.21.15.156:0/3591968860 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6560130650 0x7f656013b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.346+0000 7f656747e700 1 --2- 172.21.15.156:0/3591968860 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f656006a770 0x7f6560133970 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.346+0000 7f656747e700 1 -- 172.21.15.156:0/3591968860 >> 172.21.15.156:0/3591968860 conn(0x7f65600a2ef0 msgr2=0x7f65600a32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:30.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.346+0000 7f656747e700 1 -- 172.21.15.156:0/3591968860 shutdown_connections 2023-09-30T22:19:30.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.346+0000 7f656747e700 1 -- 172.21.15.156:0/3591968860 wait complete. 2023-09-30T22:19:30.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.347+0000 7f656747e700 1 Processor -- start 2023-09-30T22:19:30.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.347+0000 7f656747e700 1 -- start start 2023-09-30T22:19:30.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.348+0000 7f656747e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f656006a770 0x7f656011d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:30.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.348+0000 7f656747e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6560130650 0x7f656011de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:30.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.348+0000 7f656747e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6560133eb0 0x7f656011e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:30.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.348+0000 7f656747e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6560072500 con 0x7f6560133eb0 2023-09-30T22:19:30.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.348+0000 7f656747e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656012dba0 con 0x7f6560130650 2023-09-30T22:19:30.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.348+0000 7f656747e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6560120190 con 0x7f656006a770 2023-09-30T22:19:30.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.348+0000 7f656521a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f656006a770 0x7f656011d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:30.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.348+0000 7f656521a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f656006a770 0x7f656011d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44084/0 (socket says 172.21.15.156:44084) 2023-09-30T22:19:30.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.348+0000 7f656521a700 1 -- 172.21.15.156:0/3615005611 learned_addr learned my addr 172.21.15.156:0/3615005611 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:30.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.348+0000 7f6565a1b700 1 --2- 172.21.15.156:0/3615005611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6560133eb0 0x7f656011e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:30.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.348+0000 7f656521a700 1 -- 172.21.15.156:0/3615005611 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6560130650 msgr2=0x7f656011de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.348+0000 7f656521a700 1 --2- 172.21.15.156:0/3615005611 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6560130650 0x7f656011de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.348+0000 7f656521a700 1 -- 172.21.15.156:0/3615005611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6560133eb0 msgr2=0x7f656011e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.348+0000 7f656521a700 1 --2- 172.21.15.156:0/3615005611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6560133eb0 0x7f656011e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.348+0000 7f656521a700 1 -- 172.21.15.156:0/3615005611 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6558009a70 con 0x7f656006a770 2023-09-30T22:19:30.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.348+0000 7f6565a1b700 1 --2- 172.21.15.156:0/3615005611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6560133eb0 0x7f656011e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:30.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.348+0000 7f656521a700 1 --2- 172.21.15.156:0/3615005611 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f656006a770 0x7f656011d950 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f655c000c00 tx=0x7f655c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:30.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.348+0000 7f6555ffb700 1 -- 172.21.15.156:0/3615005611 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c01a830 con 0x7f656006a770 2023-09-30T22:19:30.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.349+0000 7f6555ffb700 1 -- 172.21.15.156:0/3615005611 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655c01e070 con 0x7f656006a770 2023-09-30T22:19:30.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.349+0000 7f656747e700 1 -- 172.21.15.156:0/3615005611 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655c009550 con 0x7f656006a770 2023-09-30T22:19:30.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.349+0000 7f6555ffb700 1 -- 172.21.15.156:0/3615005611 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c01abf0 con 0x7f656006a770 2023-09-30T22:19:30.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.349+0000 7f656747e700 1 -- 172.21.15.156:0/3615005611 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f656012d4c0 con 0x7f656006a770 2023-09-30T22:19:30.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.350+0000 7f6555ffb700 1 -- 172.21.15.156:0/3615005611 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f655c01ad50 con 0x7f656006a770 2023-09-30T22:19:30.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.350+0000 7f656747e700 1 -- 172.21.15.156:0/3615005611 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f656004f2a0 con 0x7f656006a770 2023-09-30T22:19:30.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.350+0000 7f6555ffb700 1 -- 172.21.15.156:0/3615005611 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f655c040ba0 con 0x7f656006a770 2023-09-30T22:19:30.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.350+0000 7f6564a19700 1 -- 172.21.15.156:0/3615005611 >> v1:172.21.15.156:6816/126965 conn(0x7f654402f510 legacy=0x7f65440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:30.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.358+0000 7f6555ffb700 1 -- 172.21.15.156:0/3615005611 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f655c006d80 con 0x7f656006a770 2023-09-30T22:19:30.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.441+0000 7fe03afb8700 1 Processor -- start 2023-09-30T22:19:30.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.441+0000 7fe03afb8700 1 -- start start 2023-09-30T22:19:30.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.441+0000 7fe03afb8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe034098410 0x7fe0340987e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:30.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.441+0000 7fe03afb8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe03409d8f0 0x7fe03409dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:30.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.441+0000 7fe03afb8700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe03406f970 con 0x7fe03409e240 2023-09-30T22:19:30.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.441+0000 7fe03afb8700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0340720a0 con 0x7fe034098410 2023-09-30T22:19:30.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.441+0000 7fe03afb8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe034072290 con 0x7fe03409d8f0 2023-09-30T22:19:30.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.441+0000 7fe033fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe03409d8f0 0x7fe03409dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:30.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.441+0000 7fe038d54700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe034098410 0x7fe0340987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:30.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.441+0000 7fe038d54700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe034098410 0x7fe0340987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:55336/0 (socket says 172.21.15.156:55336) 2023-09-30T22:19:30.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.441+0000 7fe033fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe03409d8f0 0x7fe03409dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38172/0 (socket says 172.21.15.156:38172) 2023-09-30T22:19:30.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.441+0000 7fe038d54700 1 -- 172.21.15.156:0/704625953 learned_addr learned my addr 172.21.15.156:0/704625953 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:30.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.442+0000 7fe033fff700 1 -- 172.21.15.156:0/704625953 >> v2:172.21.15.156:3300/0 conn(0x7fe034098410 msgr2=0x7fe0340987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:30.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.442+0000 7fe033fff700 1 --2- 172.21.15.156:0/704625953 >> v2:172.21.15.156:3300/0 conn(0x7fe034098410 0x7fe0340987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.442+0000 7fe033fff700 1 -- 172.21.15.156:0/704625953 >> v1:172.21.15.156:6789/0 conn(0x7fe03409e240 legacy=0x7fe0341387d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.442+0000 7fe033fff700 1 -- 172.21.15.156:0/704625953 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe034071530 con 0x7fe03409d8f0 2023-09-30T22:19:30.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.442+0000 7fe033fff700 1 --2- 172.21.15.156:0/704625953 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe03409d8f0 0x7fe03409dd00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe020009840 tx=0x7fe020009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a745731ce413e3f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:30.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.442+0000 7fe0337fe700 1 -- 172.21.15.156:0/704625953 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe020011830 con 0x7fe03409d8f0 2023-09-30T22:19:30.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.442+0000 7fe0337fe700 1 -- 172.21.15.156:0/704625953 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe020011990 con 0x7fe03409d8f0 2023-09-30T22:19:30.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.442+0000 7fe0337fe700 1 -- 172.21.15.156:0/704625953 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe020011d20 con 0x7fe03409d8f0 2023-09-30T22:19:30.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.443+0000 7fe03afb8700 1 -- 172.21.15.156:0/704625953 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe03409d8f0 msgr2=0x7fe03409dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.443+0000 7fe03afb8700 1 --2- 172.21.15.156:0/704625953 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe03409d8f0 0x7fe03409dd00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe020009840 tx=0x7fe020009b50 comp rx=0 tx=0).stop 2023-09-30T22:19:30.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.443+0000 7fe03afb8700 1 -- 172.21.15.156:0/704625953 shutdown_connections 2023-09-30T22:19:30.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.443+0000 7fe03afb8700 1 --2- 172.21.15.156:0/704625953 >> v2:172.21.15.156:3300/0 conn(0x7fe034098410 0x7fe0340987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.443+0000 7fe03afb8700 1 --2- 172.21.15.156:0/704625953 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe03409d8f0 0x7fe03409dd00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.443+0000 7fe03afb8700 1 -- 172.21.15.156:0/704625953 >> 172.21.15.156:0/704625953 conn(0x7fe0340a2b30 msgr2=0x7fe03409e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:30.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.443+0000 7fe03afb8700 1 -- 172.21.15.156:0/704625953 shutdown_connections 2023-09-30T22:19:30.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.443+0000 7fe03afb8700 1 -- 172.21.15.156:0/704625953 wait complete. 2023-09-30T22:19:30.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.444+0000 7fe03afb8700 1 Processor -- start 2023-09-30T22:19:30.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.444+0000 7fe03afb8700 1 -- start start 2023-09-30T22:19:30.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.445+0000 7fe03afb8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe034098410 0x7fe03412aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:30.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.445+0000 7fe03afb8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe03409d8f0 0x7fe03412b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:30.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.445+0000 7fe03afb8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe03409e240 0x7fe03412b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:30.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.445+0000 7fe03afb8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03412e290 con 0x7fe034098410 2023-09-30T22:19:30.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.445+0000 7fe03afb8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03412ef10 con 0x7fe03409d8f0 2023-09-30T22:19:30.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.445+0000 7fe03afb8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe03412c2b0 con 0x7fe03409e240 2023-09-30T22:19:30.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.445+0000 7fe038d54700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe034098410 0x7fe03412aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:30.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.445+0000 7fe038d54700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe034098410 0x7fe03412aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:55342/0 (socket says 172.21.15.156:55342) 2023-09-30T22:19:30.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.445+0000 7fe038d54700 1 -- 172.21.15.156:0/4144612671 learned_addr learned my addr 172.21.15.156:0/4144612671 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:30.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.445+0000 7fe033fff700 1 --2- 172.21.15.156:0/4144612671 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe03409d8f0 0x7fe03412b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:30.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.445+0000 7fe039555700 1 --2- 172.21.15.156:0/4144612671 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe03409e240 0x7fe03412b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:30.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.445+0000 7fe038d54700 1 -- 172.21.15.156:0/4144612671 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe03409e240 msgr2=0x7fe03412b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.445+0000 7fe038d54700 1 --2- 172.21.15.156:0/4144612671 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe03409e240 0x7fe03412b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.445+0000 7fe038d54700 1 -- 172.21.15.156:0/4144612671 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe03409d8f0 msgr2=0x7fe03412b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.445+0000 7fe038d54700 1 --2- 172.21.15.156:0/4144612671 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe03409d8f0 0x7fe03412b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.445+0000 7fe038d54700 1 -- 172.21.15.156:0/4144612671 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0200094a0 con 0x7fe034098410 2023-09-30T22:19:30.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.446+0000 7fe038d54700 1 --2- 172.21.15.156:0/4144612671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe034098410 0x7fe03412aec0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe02800e850 tx=0x7fe02800eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:30.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.446+0000 7fe0317fa700 1 -- 172.21.15.156:0/4144612671 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe028013680 con 0x7fe034098410 2023-09-30T22:19:30.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.446+0000 7fe0317fa700 1 -- 172.21.15.156:0/4144612671 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0280137e0 con 0x7fe034098410 2023-09-30T22:19:30.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.446+0000 7fe03afb8700 1 -- 172.21.15.156:0/4144612671 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe03412e830 con 0x7fe034098410 2023-09-30T22:19:30.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.446+0000 7fe0317fa700 1 -- 172.21.15.156:0/4144612671 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe028013b90 con 0x7fe034098410 2023-09-30T22:19:30.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.446+0000 7fe03afb8700 1 -- 172.21.15.156:0/4144612671 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe03412ddf0 con 0x7fe034098410 2023-09-30T22:19:30.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.447+0000 7fe0317fa700 1 -- 172.21.15.156:0/4144612671 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe028013cf0 con 0x7fe034098410 2023-09-30T22:19:30.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.447+0000 7fe0317fa700 1 -- 172.21.15.156:0/4144612671 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fe02803fe40 con 0x7fe034098410 2023-09-30T22:19:30.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.447+0000 7fe033fff700 1 -- 172.21.15.156:0/4144612671 >> v1:172.21.15.156:6816/126965 conn(0x7fe01802f510 legacy=0x7fe0180319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:30.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.447+0000 7fe03afb8700 1 -- 172.21.15.156:0/4144612671 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe03404f2a0 con 0x7fe034098410 2023-09-30T22:19:30.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.452+0000 7fe0317fa700 1 -- 172.21.15.156:0/4144612671 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe028017020 con 0x7fe034098410 2023-09-30T22:19:30.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.472+0000 7f0a60977700 1 Processor -- start 2023-09-30T22:19:30.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.472+0000 7f0a60977700 1 -- start start 2023-09-30T22:19:30.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.473+0000 7f0a60977700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0a5c09d8f0 0x7f0a5c09dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:30.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.473+0000 7f0a60977700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a5c1387c0 0x7f0a5c140310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:30.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.473+0000 7f0a60977700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a5c098680 con 0x7f0a5c09e200 2023-09-30T22:19:30.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.473+0000 7f0a60977700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a5c099560 con 0x7f0a5c09d8f0 2023-09-30T22:19:30.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.473+0000 7f0a60977700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c098bb0 con 0x7f0a5c1387c0 2023-09-30T22:19:30.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.473+0000 7f0a5a59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0a5c09d8f0 0x7f0a5c09dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:30.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.473+0000 7f0a5a59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0a5c09d8f0 0x7f0a5c09dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:55358/0 (socket says 172.21.15.156:55358) 2023-09-30T22:19:30.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.473+0000 7f0a5a59c700 1 -- 172.21.15.156:0/2732832942 learned_addr learned my addr 172.21.15.156:0/2732832942 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:30.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.473+0000 7f0a59d9b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f0a5c09e200 0x7f0a5c1380b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38496/0 (socket says 172.21.15.156:38496) 2023-09-30T22:19:30.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.473+0000 7f0a5ad9d700 1 --2- 172.21.15.156:0/2732832942 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a5c1387c0 0x7f0a5c140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:30.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.474+0000 7f0a5a59c700 1 -- 172.21.15.156:0/2732832942 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a5c1387c0 msgr2=0x7f0a5c140310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:30.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.474+0000 7f0a5a59c700 1 --2- 172.21.15.156:0/2732832942 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a5c1387c0 0x7f0a5c140310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.474+0000 7f0a5a59c700 1 -- 172.21.15.156:0/2732832942 >> v1:172.21.15.156:6789/0 conn(0x7f0a5c09e200 legacy=0x7f0a5c1380b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.474+0000 7f0a5a59c700 1 -- 172.21.15.156:0/2732832942 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5c0980f0 con 0x7f0a5c09d8f0 2023-09-30T22:19:30.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.474+0000 7f0a5959a700 1 -- 172.21.15.156:0/2732832942 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3853306211 0 0) 0x7f0a5c098680 con 0x7f0a5c09e200 2023-09-30T22:19:30.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.474+0000 7f0a5ad9d700 1 --2- 172.21.15.156:0/2732832942 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a5c1387c0 0x7f0a5c140310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:30.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.474+0000 7f0a5a59c700 1 --2- 172.21.15.156:0/2732832942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a5c09d8f0 0x7f0a5c09dcc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c006fd0 tx=0x7f0a4c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=babc9c8afea32dea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:30.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.474+0000 7f0a5959a700 1 -- 172.21.15.156:0/2732832942 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c005e30 con 0x7f0a5c09d8f0 2023-09-30T22:19:30.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.474+0000 7f0a5959a700 1 -- 172.21.15.156:0/2732832942 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4c004030 con 0x7f0a5c09d8f0 2023-09-30T22:19:30.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.474+0000 7f0a5959a700 1 -- 172.21.15.156:0/2732832942 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c0043e0 con 0x7f0a5c09d8f0 2023-09-30T22:19:30.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.474+0000 7f0a60977700 1 -- 172.21.15.156:0/2732832942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a5c09d8f0 msgr2=0x7f0a5c09dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.474+0000 7f0a60977700 1 --2- 172.21.15.156:0/2732832942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a5c09d8f0 0x7f0a5c09dcc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c006fd0 tx=0x7f0a4c009bd0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.475+0000 7f0a60977700 1 -- 172.21.15.156:0/2732832942 shutdown_connections 2023-09-30T22:19:30.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.475+0000 7f0a60977700 1 --2- 172.21.15.156:0/2732832942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a5c09d8f0 0x7f0a5c09dcc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.475+0000 7f0a60977700 1 --2- 172.21.15.156:0/2732832942 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a5c1387c0 0x7f0a5c140310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.475+0000 7f0a60977700 1 -- 172.21.15.156:0/2732832942 >> 172.21.15.156:0/2732832942 conn(0x7f0a5c0a2b30 msgr2=0x7f0a5c09e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:30.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.475+0000 7f0a60977700 1 -- 172.21.15.156:0/2732832942 shutdown_connections 2023-09-30T22:19:30.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.475+0000 7f0a60977700 1 -- 172.21.15.156:0/2732832942 wait complete. 2023-09-30T22:19:30.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.476+0000 7f0a60977700 1 Processor -- start 2023-09-30T22:19:30.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.476+0000 7f0a60977700 1 -- start start 2023-09-30T22:19:30.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.476+0000 7f0a60977700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a5c09d8f0 0x7f0a5c133290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:30.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.476+0000 7f0a60977700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a5c09e200 0x7f0a5c1337d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:30.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.476+0000 7f0a60977700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a5c1387c0 0x7f0a5c136200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:30.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.476+0000 7f0a60977700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c0908e0 con 0x7f0a5c09e200 2023-09-30T22:19:30.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.476+0000 7f0a60977700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c091ef0 con 0x7f0a5c09d8f0 2023-09-30T22:19:30.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.476+0000 7f0a60977700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c071ec0 con 0x7f0a5c1387c0 2023-09-30T22:19:30.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.476+0000 7f0a59d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a5c09e200 0x7f0a5c1337d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:30.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.476+0000 7f0a59d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a5c09e200 0x7f0a5c1337d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:55368/0 (socket says 172.21.15.156:55368) 2023-09-30T22:19:30.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.476+0000 7f0a59d9b700 1 -- 172.21.15.156:0/3484698672 learned_addr learned my addr 172.21.15.156:0/3484698672 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:30.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.476+0000 7f0a5a59c700 1 --2- 172.21.15.156:0/3484698672 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a5c09d8f0 0x7f0a5c133290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:30.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.476+0000 7f0a5ad9d700 1 --2- 172.21.15.156:0/3484698672 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a5c1387c0 0x7f0a5c136200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:30.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.477+0000 7f0a59d9b700 1 -- 172.21.15.156:0/3484698672 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a5c1387c0 msgr2=0x7f0a5c136200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.477+0000 7f0a59d9b700 1 --2- 172.21.15.156:0/3484698672 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a5c1387c0 0x7f0a5c136200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.477+0000 7f0a59d9b700 1 -- 172.21.15.156:0/3484698672 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a5c09d8f0 msgr2=0x7f0a5c133290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.477+0000 7f0a59d9b700 1 --2- 172.21.15.156:0/3484698672 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a5c09d8f0 0x7f0a5c133290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.477+0000 7f0a59d9b700 1 -- 172.21.15.156:0/3484698672 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a54009a70 con 0x7f0a5c09e200 2023-09-30T22:19:30.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.477+0000 7f0a59d9b700 1 --2- 172.21.15.156:0/3484698672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a5c09e200 0x7f0a5c1337d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0a5000c550 tx=0x7f0a5000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:30.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.477+0000 7f0a4affd700 1 -- 172.21.15.156:0/3484698672 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a50004c80 con 0x7f0a5c09e200 2023-09-30T22:19:30.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.477+0000 7f0a4affd700 1 -- 172.21.15.156:0/3484698672 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a50004e00 con 0x7f0a5c09e200 2023-09-30T22:19:30.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.477+0000 7f0a60977700 1 -- 172.21.15.156:0/3484698672 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a4c009500 con 0x7f0a5c09e200 2023-09-30T22:19:30.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.477+0000 7f0a4affd700 1 -- 172.21.15.156:0/3484698672 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a50007310 con 0x7f0a5c09e200 2023-09-30T22:19:30.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.477+0000 7f0a60977700 1 -- 172.21.15.156:0/3484698672 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a5c091c30 con 0x7f0a5c09e200 2023-09-30T22:19:30.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.478+0000 7f0a4affd700 1 -- 172.21.15.156:0/3484698672 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0a50007470 con 0x7f0a5c09e200 2023-09-30T22:19:30.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.478+0000 7f0a60977700 1 -- 172.21.15.156:0/3484698672 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a5c097f20 con 0x7f0a5c09e200 2023-09-30T22:19:30.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.478+0000 7f0a5a59c700 1 -- 172.21.15.156:0/3484698672 >> v1:172.21.15.156:6816/126965 conn(0x7f0a3c02f510 legacy=0x7f0a3c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:30.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.478+0000 7f0a4affd700 1 -- 172.21.15.156:0/3484698672 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f0a5003f7d0 con 0x7f0a5c09e200 2023-09-30T22:19:30.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.483+0000 7f0a4affd700 1 -- 172.21.15.156:0/3484698672 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0a500106d0 con 0x7f0a5c09e200 2023-09-30T22:19:30.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.551+0000 7f6564a19700 1 -- 172.21.15.156:0/3615005611 >> v1:172.21.15.156:6816/126965 conn(0x7f654402f510 legacy=0x7f65440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:30.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.555+0000 7f656747e700 1 -- 172.21.15.156:0/3615005611 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f65601321a0 con 0x7f656006a770 2023-09-30T22:19:30.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.555+0000 7f6555ffb700 1 -- 172.21.15.156:0/3615005611 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f655c0107f0 con 0x7f656006a770 2023-09-30T22:19:30.555 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:30.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.557+0000 7f656747e700 1 -- 172.21.15.156:0/3615005611 >> v1:172.21.15.156:6816/126965 conn(0x7f654402f510 legacy=0x7f65440319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:30.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.557+0000 7f656747e700 1 -- 172.21.15.156:0/3615005611 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f656006a770 msgr2=0x7f656011d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.557+0000 7f656747e700 1 --2- 172.21.15.156:0/3615005611 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f656006a770 0x7f656011d950 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f655c000c00 tx=0x7f655c004750 comp rx=0 tx=0).stop 2023-09-30T22:19:30.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.557+0000 7f656747e700 1 -- 172.21.15.156:0/3615005611 shutdown_connections 2023-09-30T22:19:30.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.557+0000 7f656747e700 1 --2- 172.21.15.156:0/3615005611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6560133eb0 0x7f656011e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.557+0000 7f656747e700 1 --2- 172.21.15.156:0/3615005611 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f656006a770 0x7f656011d950 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.557+0000 7f656747e700 1 --2- 172.21.15.156:0/3615005611 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6560130650 0x7f656011de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.557+0000 7f656747e700 1 -- 172.21.15.156:0/3615005611 >> 172.21.15.156:0/3615005611 conn(0x7f65600a2ef0 msgr2=0x7f656009ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:30.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.557+0000 7f656747e700 1 -- 172.21.15.156:0/3615005611 shutdown_connections 2023-09-30T22:19:30.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.557+0000 7f656747e700 1 -- 172.21.15.156:0/3615005611 wait complete. 2023-09-30T22:19:30.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:30.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.645+0000 7fe03afb8700 1 -- 172.21.15.156:0/4144612671 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe03406b2a0 con 0x7fe034098410 2023-09-30T22:19:30.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.646+0000 7fe0317fa700 1 -- 172.21.15.156:0/4144612671 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe028011d90 con 0x7fe034098410 2023-09-30T22:19:30.645 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:30.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.648+0000 7fe03afb8700 1 -- 172.21.15.156:0/4144612671 >> v1:172.21.15.156:6816/126965 conn(0x7fe01802f510 legacy=0x7fe0180319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:30.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.648+0000 7fe033fff700 1 -- 172.21.15.156:0/4144612671 >> v1:172.21.15.156:6816/126965 conn(0x7fe01802f510 legacy=0x7fe0180319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:30.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.648+0000 7fe03afb8700 1 -- 172.21.15.156:0/4144612671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe034098410 msgr2=0x7fe03412aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.648+0000 7fe03afb8700 1 --2- 172.21.15.156:0/4144612671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe034098410 0x7fe03412aec0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe02800e850 tx=0x7fe02800eb60 comp rx=0 tx=0).stop 2023-09-30T22:19:30.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.648+0000 7fe03afb8700 1 -- 172.21.15.156:0/4144612671 shutdown_connections 2023-09-30T22:19:30.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.648+0000 7fe03afb8700 1 --2- 172.21.15.156:0/4144612671 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe03409e240 0x7fe03412b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.648+0000 7fe03afb8700 1 --2- 172.21.15.156:0/4144612671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe034098410 0x7fe03412aec0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.648+0000 7fe03afb8700 1 --2- 172.21.15.156:0/4144612671 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe03409d8f0 0x7fe03412b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.648+0000 7fe03afb8700 1 -- 172.21.15.156:0/4144612671 >> 172.21.15.156:0/4144612671 conn(0x7fe0340a2b30 msgr2=0x7fe0341313b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:30.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.648+0000 7fe03afb8700 1 -- 172.21.15.156:0/4144612671 shutdown_connections 2023-09-30T22:19:30.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.648+0000 7fe03afb8700 1 -- 172.21.15.156:0/4144612671 wait complete. 2023-09-30T22:19:30.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:30.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.678+0000 7f0a60977700 1 -- 172.21.15.156:0/3484698672 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0a5c0973d0 con 0x7f0a5c09e200 2023-09-30T22:19:30.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.679+0000 7f0a4affd700 1 -- 172.21.15.156:0/3484698672 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0a500102c0 con 0x7f0a5c09e200 2023-09-30T22:19:30.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.679+0000 7f0a5a59c700 1 -- 172.21.15.156:0/3484698672 >> v1:172.21.15.156:6816/126965 conn(0x7f0a3c02f510 legacy=0x7f0a3c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:30.678 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:30.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.680+0000 7f0a60977700 1 -- 172.21.15.156:0/3484698672 >> v1:172.21.15.156:6816/126965 conn(0x7f0a3c02f510 legacy=0x7f0a3c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:30.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.680+0000 7f0a60977700 1 -- 172.21.15.156:0/3484698672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a5c09e200 msgr2=0x7f0a5c1337d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.680+0000 7f0a60977700 1 --2- 172.21.15.156:0/3484698672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a5c09e200 0x7f0a5c1337d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0a5000c550 tx=0x7f0a5000c860 comp rx=0 tx=0).stop 2023-09-30T22:19:30.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.681+0000 7f0a60977700 1 -- 172.21.15.156:0/3484698672 shutdown_connections 2023-09-30T22:19:30.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.681+0000 7f0a60977700 1 --2- 172.21.15.156:0/3484698672 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a5c1387c0 0x7f0a5c136200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.681+0000 7f0a60977700 1 --2- 172.21.15.156:0/3484698672 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a5c09d8f0 0x7f0a5c133290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.681+0000 7f0a60977700 1 --2- 172.21.15.156:0/3484698672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a5c09e200 0x7f0a5c1337d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:30.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.681+0000 7f0a60977700 1 -- 172.21.15.156:0/3484698672 >> 172.21.15.156:0/3484698672 conn(0x7f0a5c0a2b30 msgr2=0x7f0a5c08de10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:30.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.681+0000 7f0a60977700 1 -- 172.21.15.156:0/3484698672 shutdown_connections 2023-09-30T22:19:30.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:30.681+0000 7f0a60977700 1 -- 172.21.15.156:0/3484698672 wait complete. 2023-09-30T22:19:30.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:31.269 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:31.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.396+0000 7fe6a70a7700 1 Processor -- start 2023-09-30T22:19:31.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.396+0000 7fe6a70a7700 1 -- start start 2023-09-30T22:19:31.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.397+0000 7fe6a70a7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe6a009e870 0x7fe6a009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:31.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.397+0000 7fe6a70a7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe6a009f180 0x7fe6a0133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:31.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.397+0000 7fe6a70a7700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a006bec0 con 0x7fe6a01341d0 2023-09-30T22:19:31.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.397+0000 7fe6a70a7700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6a006ce60 con 0x7fe6a009f180 2023-09-30T22:19:31.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.397+0000 7fe6a70a7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a009fa00 con 0x7fe6a009e870 2023-09-30T22:19:31.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.397+0000 7fe6a4e43700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe6a009e870 0x7fe6a009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:31.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.397+0000 7fe69ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe6a009f180 0x7fe6a0133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:31.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.397+0000 7fe6a4e43700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe6a009e870 0x7fe6a009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55952/0 (socket says 172.21.15.156:55952) 2023-09-30T22:19:31.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.397+0000 7fe6a4e43700 1 -- 172.21.15.156:0/634385684 learned_addr learned my addr 172.21.15.156:0/634385684 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:31.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.397+0000 7fe69ffff700 1 -- 172.21.15.156:0/634385684 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe6a009e870 msgr2=0x7fe6a009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:31.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.397+0000 7fe69ffff700 1 --2- 172.21.15.156:0/634385684 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe6a009e870 0x7fe6a009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.397+0000 7fe69ffff700 1 -- 172.21.15.156:0/634385684 >> v1:172.21.15.156:6789/0 conn(0x7fe6a01341d0 legacy=0x7fe6a013af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.397+0000 7fe69ffff700 1 -- 172.21.15.156:0/634385684 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a009ad80 con 0x7fe6a009f180 2023-09-30T22:19:31.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.397+0000 7fe6a4e43700 1 --2- 172.21.15.156:0/634385684 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe6a009e870 0x7fe6a009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:31.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.397+0000 7fe69ffff700 1 --2- 172.21.15.156:0/634385684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6a009f180 0x7fe6a0133c90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe68c009840 tx=0x7fe68c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894c553e3fb1b64c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:31.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.398+0000 7fe69f7fe700 1 -- 172.21.15.156:0/634385684 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c011830 con 0x7fe6a009f180 2023-09-30T22:19:31.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.398+0000 7fe69f7fe700 1 -- 172.21.15.156:0/634385684 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68c011990 con 0x7fe6a009f180 2023-09-30T22:19:31.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.398+0000 7fe69f7fe700 1 -- 172.21.15.156:0/634385684 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c011d20 con 0x7fe6a009f180 2023-09-30T22:19:31.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.398+0000 7fe6a70a7700 1 -- 172.21.15.156:0/634385684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6a009f180 msgr2=0x7fe6a0133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.398+0000 7fe6a70a7700 1 --2- 172.21.15.156:0/634385684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6a009f180 0x7fe6a0133c90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe68c009840 tx=0x7fe68c009b50 comp rx=0 tx=0).stop 2023-09-30T22:19:31.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.398+0000 7fe6a70a7700 1 -- 172.21.15.156:0/634385684 shutdown_connections 2023-09-30T22:19:31.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.398+0000 7fe6a70a7700 1 --2- 172.21.15.156:0/634385684 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe6a009e870 0x7fe6a009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.398+0000 7fe6a70a7700 1 --2- 172.21.15.156:0/634385684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6a009f180 0x7fe6a0133c90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.398+0000 7fe6a70a7700 1 -- 172.21.15.156:0/634385684 >> 172.21.15.156:0/634385684 conn(0x7fe6a00a4430 msgr2=0x7fe6a00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:31.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.398+0000 7fe6a70a7700 1 -- 172.21.15.156:0/634385684 shutdown_connections 2023-09-30T22:19:31.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.398+0000 7fe6a70a7700 1 -- 172.21.15.156:0/634385684 wait complete. 2023-09-30T22:19:31.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.399+0000 7fe6a70a7700 1 Processor -- start 2023-09-30T22:19:31.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.399+0000 7fe6a70a7700 1 -- start start 2023-09-30T22:19:31.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.400+0000 7fe6a70a7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe6a009e870 0x7fe6a01c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:31.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.400+0000 7fe6a70a7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6a009f180 0x7fe6a01c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:31.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.400+0000 7fe6a70a7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6a01341d0 0x7fe6a011ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:31.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.400+0000 7fe6a70a7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a0122370 con 0x7fe6a009f180 2023-09-30T22:19:31.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.400+0000 7fe6a70a7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a01bd590 con 0x7fe6a01341d0 2023-09-30T22:19:31.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.400+0000 7fe6a70a7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a0133630 con 0x7fe6a009e870 2023-09-30T22:19:31.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.400+0000 7fe6a4e43700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe6a009e870 0x7fe6a01c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:31.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.400+0000 7fe69ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6a009f180 0x7fe6a01c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:31.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.400+0000 7fe6a5644700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6a01341d0 0x7fe6a011ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:31.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.400+0000 7fe6a4e43700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe6a009e870 0x7fe6a01c8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55956/0 (socket says 172.21.15.156:55956) 2023-09-30T22:19:31.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.400+0000 7fe6a4e43700 1 -- 172.21.15.156:0/3433146283 learned_addr learned my addr 172.21.15.156:0/3433146283 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:31.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.400+0000 7fe6a4e43700 1 -- 172.21.15.156:0/3433146283 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6a01341d0 msgr2=0x7fe6a011ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.400+0000 7fe6a4e43700 1 --2- 172.21.15.156:0/3433146283 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6a01341d0 0x7fe6a011ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.400+0000 7fe6a4e43700 1 -- 172.21.15.156:0/3433146283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6a009f180 msgr2=0x7fe6a01c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.400+0000 7fe6a4e43700 1 --2- 172.21.15.156:0/3433146283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6a009f180 0x7fe6a01c8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.400+0000 7fe6a4e43700 1 -- 172.21.15.156:0/3433146283 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe694009550 con 0x7fe6a009e870 2023-09-30T22:19:31.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.400+0000 7fe69ffff700 1 --2- 172.21.15.156:0/3433146283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6a009f180 0x7fe6a01c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:31.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.400+0000 7fe6a5644700 1 --2- 172.21.15.156:0/3433146283 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6a01341d0 0x7fe6a011ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:31.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.400+0000 7fe6a4e43700 1 --2- 172.21.15.156:0/3433146283 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe6a009e870 0x7fe6a01c8a00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe69400ec10 tx=0x7fe69400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:31.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.400+0000 7fe69d7fa700 1 -- 172.21.15.156:0/3433146283 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69400c850 con 0x7fe6a009e870 2023-09-30T22:19:31.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.400+0000 7fe69d7fa700 1 -- 172.21.15.156:0/3433146283 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe69400c9b0 con 0x7fe6a009e870 2023-09-30T22:19:31.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.400+0000 7fe6a70a7700 1 -- 172.21.15.156:0/3433146283 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe68c0094a0 con 0x7fe6a009e870 2023-09-30T22:19:31.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.400+0000 7fe69d7fa700 1 -- 172.21.15.156:0/3433146283 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69400cd40 con 0x7fe6a009e870 2023-09-30T22:19:31.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.401+0000 7fe6a70a7700 1 -- 172.21.15.156:0/3433146283 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a0120610 con 0x7fe6a009e870 2023-09-30T22:19:31.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.401+0000 7fe69d7fa700 1 -- 172.21.15.156:0/3433146283 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe694013470 con 0x7fe6a009e870 2023-09-30T22:19:31.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.401+0000 7fe69d7fa700 1 -- 172.21.15.156:0/3433146283 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fe694040160 con 0x7fe6a009e870 2023-09-30T22:19:31.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.401+0000 7fe69ffff700 1 -- 172.21.15.156:0/3433146283 >> v1:172.21.15.156:6816/126965 conn(0x7fe68402f510 legacy=0x7fe6840319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:31.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.401+0000 7fe6a70a7700 1 -- 172.21.15.156:0/3433146283 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a006fc10 con 0x7fe6a009e870 2023-09-30T22:19:31.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.406+0000 7fe69d7fa700 1 -- 172.21.15.156:0/3433146283 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe694013720 con 0x7fe6a009e870 2023-09-30T22:19:31.570 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:31.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.593+0000 7fe6a70a7700 1 -- 172.21.15.156:0/3433146283 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe6a006c670 con 0x7fe6a009e870 2023-09-30T22:19:31.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.594+0000 7fe69d7fa700 1 -- 172.21.15.156:0/3433146283 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe694011b00 con 0x7fe6a009e870 2023-09-30T22:19:31.594 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:31.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.596+0000 7fe6a70a7700 1 -- 172.21.15.156:0/3433146283 >> v1:172.21.15.156:6816/126965 conn(0x7fe68402f510 legacy=0x7fe6840319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:31.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.596+0000 7fe6a70a7700 1 -- 172.21.15.156:0/3433146283 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe6a009e870 msgr2=0x7fe6a01c8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.596+0000 7fe6a70a7700 1 --2- 172.21.15.156:0/3433146283 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe6a009e870 0x7fe6a01c8a00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe69400ec10 tx=0x7fe69400ef20 comp rx=0 tx=0).stop 2023-09-30T22:19:31.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.596+0000 7fe6a70a7700 1 -- 172.21.15.156:0/3433146283 shutdown_connections 2023-09-30T22:19:31.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.596+0000 7fe6a70a7700 1 --2- 172.21.15.156:0/3433146283 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6a01341d0 0x7fe6a011ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.596+0000 7fe6a70a7700 1 --2- 172.21.15.156:0/3433146283 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe6a009e870 0x7fe6a01c8a00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.596+0000 7fe6a70a7700 1 --2- 172.21.15.156:0/3433146283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6a009f180 0x7fe6a01c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.596+0000 7fe6a70a7700 1 -- 172.21.15.156:0/3433146283 >> 172.21.15.156:0/3433146283 conn(0x7fe6a00a4430 msgr2=0x7fe6a009d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:31.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.596+0000 7fe6a70a7700 1 -- 172.21.15.156:0/3433146283 shutdown_connections 2023-09-30T22:19:31.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.596+0000 7fe6a70a7700 1 -- 172.21.15.156:0/3433146283 wait complete. 2023-09-30T22:19:31.609 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:31.660 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:31.693 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:31.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.699+0000 7f9cec15d700 1 Processor -- start 2023-09-30T22:19:31.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.699+0000 7f9cec15d700 1 -- start start 2023-09-30T22:19:31.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.700+0000 7f9cec15d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ce406a770 0x7f9ce406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:31.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.700+0000 7f9cec15d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ce4131ec0 0x7f9ce4139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:31.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.700+0000 7f9cec15d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce409da80 con 0x7f9ce406b080 2023-09-30T22:19:31.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.700+0000 7f9cec15d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce409dce0 con 0x7f9ce406a770 2023-09-30T22:19:31.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.700+0000 7f9cec15d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce409eb20 con 0x7f9ce4131ec0 2023-09-30T22:19:31.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.700+0000 7f9cea6fa700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ce4131ec0 0x7f9ce4139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:31.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.700+0000 7f9ce9ef9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ce406a770 0x7f9ce406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:31.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.700+0000 7f9ce96f8700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f9ce406b080 0x7f9ce41317b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48382/0 (socket says 172.21.15.156:48382) 2023-09-30T22:19:31.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.700+0000 7f9cea6fa700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ce4131ec0 0x7f9ce4139c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55962/0 (socket says 172.21.15.156:55962) 2023-09-30T22:19:31.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.700+0000 7f9ce96f8700 1 -- 172.21.15.156:0/1788210993 learned_addr learned my addr 172.21.15.156:0/1788210993 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:31.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.700+0000 7f9cea6fa700 1 -- 172.21.15.156:0/1788210993 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ce406a770 msgr2=0x7f9ce406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:31.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.700+0000 7f9cea6fa700 1 --2- 172.21.15.156:0/1788210993 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ce406a770 0x7f9ce406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.700+0000 7f9ce8ef7700 1 -- 172.21.15.156:0/1788210993 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362143971 0 0) 0x7f9ce409da80 con 0x7f9ce406b080 2023-09-30T22:19:31.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.700+0000 7f9cea6fa700 1 -- 172.21.15.156:0/1788210993 >> v1:172.21.15.156:6789/0 conn(0x7f9ce406b080 legacy=0x7f9ce41317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.700+0000 7f9cea6fa700 1 -- 172.21.15.156:0/1788210993 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce409d860 con 0x7f9ce4131ec0 2023-09-30T22:19:31.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.700+0000 7f9cea6fa700 1 --2- 172.21.15.156:0/1788210993 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ce4131ec0 0x7f9ce4139c20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc009dc0 tx=0x7f9cdc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89bdbefce99704f7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:31.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.701+0000 7f9ce8ef7700 1 -- 172.21.15.156:0/1788210993 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc00e070 con 0x7f9ce4131ec0 2023-09-30T22:19:31.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.701+0000 7f9ce8ef7700 1 -- 172.21.15.156:0/1788210993 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cdc00bbd0 con 0x7f9ce4131ec0 2023-09-30T22:19:31.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.701+0000 7f9ce8ef7700 1 -- 172.21.15.156:0/1788210993 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc012430 con 0x7f9ce4131ec0 2023-09-30T22:19:31.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.701+0000 7f9cec15d700 1 -- 172.21.15.156:0/1788210993 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ce4131ec0 msgr2=0x7f9ce4139c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.701+0000 7f9cec15d700 1 --2- 172.21.15.156:0/1788210993 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ce4131ec0 0x7f9ce4139c20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc009dc0 tx=0x7f9cdc00b330 comp rx=0 tx=0).stop 2023-09-30T22:19:31.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.701+0000 7f9cec15d700 1 -- 172.21.15.156:0/1788210993 shutdown_connections 2023-09-30T22:19:31.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.701+0000 7f9cec15d700 1 --2- 172.21.15.156:0/1788210993 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ce406a770 0x7f9ce406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.701+0000 7f9cec15d700 1 --2- 172.21.15.156:0/1788210993 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ce4131ec0 0x7f9ce4139c20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.701+0000 7f9cec15d700 1 -- 172.21.15.156:0/1788210993 >> 172.21.15.156:0/1788210993 conn(0x7f9ce4099c40 msgr2=0x7f9ce40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:31.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.702+0000 7f9cec15d700 1 -- 172.21.15.156:0/1788210993 shutdown_connections 2023-09-30T22:19:31.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.702+0000 7f9cec15d700 1 -- 172.21.15.156:0/1788210993 wait complete. 2023-09-30T22:19:31.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.702+0000 7f9cec15d700 1 Processor -- start 2023-09-30T22:19:31.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.702+0000 7f9cec15d700 1 -- start start 2023-09-30T22:19:31.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.703+0000 7f9cec15d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ce406a770 0x7f9ce409a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:31.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.703+0000 7f9cec15d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ce406b080 0x7f9ce409a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:31.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.703+0000 7f9cec15d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ce4131ec0 0x7f9ce409aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:31.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.703+0000 7f9cec15d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce40a2b80 con 0x7f9ce406b080 2023-09-30T22:19:31.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.703+0000 7f9cec15d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce4071e10 con 0x7f9ce4131ec0 2023-09-30T22:19:31.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.703+0000 7f9cec15d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce41235f0 con 0x7f9ce406a770 2023-09-30T22:19:31.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.703+0000 7f9ce96f8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ce406b080 0x7f9ce409a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:31.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.703+0000 7f9ce96f8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ce406b080 0x7f9ce409a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38384/0 (socket says 172.21.15.156:38384) 2023-09-30T22:19:31.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.703+0000 7f9ce96f8700 1 -- 172.21.15.156:0/2687896501 learned_addr learned my addr 172.21.15.156:0/2687896501 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:31.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.703+0000 7f9ce9ef9700 1 --2- 172.21.15.156:0/2687896501 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ce406a770 0x7f9ce409a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:31.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.703+0000 7f9cea6fa700 1 --2- 172.21.15.156:0/2687896501 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ce4131ec0 0x7f9ce409aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:31.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.704+0000 7f9ce96f8700 1 -- 172.21.15.156:0/2687896501 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ce406a770 msgr2=0x7f9ce409a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.704+0000 7f9ce96f8700 1 --2- 172.21.15.156:0/2687896501 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ce406a770 0x7f9ce409a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.704+0000 7f9ce96f8700 1 -- 172.21.15.156:0/2687896501 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ce4131ec0 msgr2=0x7f9ce409aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.704+0000 7f9ce96f8700 1 --2- 172.21.15.156:0/2687896501 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ce4131ec0 0x7f9ce409aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.704+0000 7f9ce96f8700 1 -- 172.21.15.156:0/2687896501 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cdc009a70 con 0x7f9ce406b080 2023-09-30T22:19:31.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.704+0000 7f9cea6fa700 1 --2- 172.21.15.156:0/2687896501 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ce4131ec0 0x7f9ce409aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:31.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.704+0000 7f9ce96f8700 1 --2- 172.21.15.156:0/2687896501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ce406b080 0x7f9ce409a9a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4001eb0 tx=0x7f9cd400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:31.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.704+0000 7f9cda7fc700 1 -- 172.21.15.156:0/2687896501 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4004c80 con 0x7f9ce406b080 2023-09-30T22:19:31.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.704+0000 7f9cda7fc700 1 -- 172.21.15.156:0/2687896501 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd4004de0 con 0x7f9ce406b080 2023-09-30T22:19:31.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.704+0000 7f9cec15d700 1 -- 172.21.15.156:0/2687896501 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce4123f00 con 0x7f9ce406b080 2023-09-30T22:19:31.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.704+0000 7f9cda7fc700 1 -- 172.21.15.156:0/2687896501 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4007310 con 0x7f9ce406b080 2023-09-30T22:19:31.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.704+0000 7f9cec15d700 1 -- 172.21.15.156:0/2687896501 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce41245f0 con 0x7f9ce406b080 2023-09-30T22:19:31.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.705+0000 7f9cda7fc700 1 -- 172.21.15.156:0/2687896501 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9cd4007470 con 0x7f9ce406b080 2023-09-30T22:19:31.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.705+0000 7f9cda7fc700 1 -- 172.21.15.156:0/2687896501 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f9cd403f750 con 0x7f9ce406b080 2023-09-30T22:19:31.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.705+0000 7f9ce9ef9700 1 -- 172.21.15.156:0/2687896501 >> v1:172.21.15.156:6816/126965 conn(0x7f9cc802f510 legacy=0x7f9cc80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:31.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.705+0000 7f9cec15d700 1 -- 172.21.15.156:0/2687896501 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce404f2a0 con 0x7f9ce406b080 2023-09-30T22:19:31.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.710+0000 7f9cda7fc700 1 -- 172.21.15.156:0/2687896501 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9cd40123b0 con 0x7f9ce406b080 2023-09-30T22:19:31.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.790+0000 7feeb51aa700 1 Processor -- start 2023-09-30T22:19:31.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.790+0000 7feeb51aa700 1 -- start start 2023-09-30T22:19:31.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.791+0000 7feeb51aa700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feeb0066410 0x7feeb01319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:31.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.791+0000 7feeb51aa700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feeb01314b0 0x7feeb0131f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:31.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.791+0000 7feeb51aa700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7feeb009bc70 0x7feeb009c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:31.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.791+0000 7feeb51aa700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb00667e0 con 0x7feeb009bc70 2023-09-30T22:19:31.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.791+0000 7feeb51aa700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00a23c0 con 0x7feeb0066410 2023-09-30T22:19:31.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.791+0000 7feeb51aa700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00a0f20 con 0x7feeb01314b0 2023-09-30T22:19:31.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.791+0000 7feeae59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feeb01314b0 0x7feeb0131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:31.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.791+0000 7feeae59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feeb01314b0 0x7feeb0131f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55990/0 (socket says 172.21.15.156:55990) 2023-09-30T22:19:31.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.791+0000 7feeae59c700 1 -- 172.21.15.156:0/1367882209 learned_addr learned my addr 172.21.15.156:0/1367882209 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:31.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.792+0000 7feeaed9d700 1 --2- 172.21.15.156:0/1367882209 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feeb0066410 0x7feeb01319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:31.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.792+0000 7feeaf59e700 1 --2- 172.21.15.156:0/1367882209 >> v2:172.21.15.156:3300/0 conn(0x7feeb009bc70 0x7feeb009c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:31.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.792+0000 7feeae59c700 1 -- 172.21.15.156:0/1367882209 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feeb0066410 msgr2=0x7feeb01319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:31.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.792+0000 7feeae59c700 1 --2- 172.21.15.156:0/1367882209 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feeb0066410 0x7feeb01319f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.792+0000 7feeae59c700 1 -- 172.21.15.156:0/1367882209 >> v2:172.21.15.156:3300/0 conn(0x7feeb009bc70 msgr2=0x7feeb009c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:31.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.792+0000 7feeae59c700 1 --2- 172.21.15.156:0/1367882209 >> v2:172.21.15.156:3300/0 conn(0x7feeb009bc70 0x7feeb009c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.792+0000 7feeae59c700 1 -- 172.21.15.156:0/1367882209 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb00a16e0 con 0x7feeb01314b0 2023-09-30T22:19:31.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.792+0000 7feeaf59e700 1 --2- 172.21.15.156:0/1367882209 >> v2:172.21.15.156:3300/0 conn(0x7feeb009bc70 0x7feeb009c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:19:31.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.792+0000 7feeae59c700 1 --2- 172.21.15.156:0/1367882209 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feeb01314b0 0x7feeb0131f30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7feea4009950 tx=0x7feea4009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51453efd6d4147bd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:31.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.792+0000 7feeadd9b700 1 -- 172.21.15.156:0/1367882209 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea4011830 con 0x7feeb01314b0 2023-09-30T22:19:31.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.792+0000 7feeadd9b700 1 -- 172.21.15.156:0/1367882209 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea4011990 con 0x7feeb01314b0 2023-09-30T22:19:31.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.792+0000 7feeadd9b700 1 -- 172.21.15.156:0/1367882209 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea4011d40 con 0x7feeb01314b0 2023-09-30T22:19:31.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.793+0000 7feeb51aa700 1 -- 172.21.15.156:0/1367882209 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feeb01314b0 msgr2=0x7feeb0131f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.793+0000 7feeb51aa700 1 --2- 172.21.15.156:0/1367882209 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feeb01314b0 0x7feeb0131f30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7feea4009950 tx=0x7feea4009c60 comp rx=0 tx=0).stop 2023-09-30T22:19:31.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.793+0000 7feeb51aa700 1 -- 172.21.15.156:0/1367882209 shutdown_connections 2023-09-30T22:19:31.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.793+0000 7feeb51aa700 1 --2- 172.21.15.156:0/1367882209 >> v2:172.21.15.156:3300/0 conn(0x7feeb009bc70 0x7feeb009c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.793+0000 7feeb51aa700 1 --2- 172.21.15.156:0/1367882209 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feeb0066410 0x7feeb01319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.793+0000 7feeb51aa700 1 --2- 172.21.15.156:0/1367882209 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feeb01314b0 0x7feeb0131f30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.793+0000 7feeb51aa700 1 -- 172.21.15.156:0/1367882209 >> 172.21.15.156:0/1367882209 conn(0x7feeb00a2980 msgr2=0x7feeb00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:31.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.793+0000 7feeb51aa700 1 -- 172.21.15.156:0/1367882209 shutdown_connections 2023-09-30T22:19:31.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.793+0000 7feeb51aa700 1 -- 172.21.15.156:0/1367882209 wait complete. 2023-09-30T22:19:31.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.794+0000 7feeb51aa700 1 Processor -- start 2023-09-30T22:19:31.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.794+0000 7feeb51aa700 1 -- start start 2023-09-30T22:19:31.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.795+0000 7feeb51aa700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feeb0066410 0x7feeb011a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:31.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.795+0000 7feeb51aa700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feeb009bc70 0x7feeb011ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:31.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.795+0000 7feeb51aa700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feeb01314b0 0x7feeb011b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:31.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.795+0000 7feeb51aa700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb011be10 con 0x7feeb01314b0 2023-09-30T22:19:31.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.795+0000 7feeb51aa700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb012dce0 con 0x7feeb0066410 2023-09-30T22:19:31.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.795+0000 7feeb51aa700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feeb011cb20 con 0x7feeb009bc70 2023-09-30T22:19:31.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.795+0000 7feeae59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feeb009bc70 0x7feeb011ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:31.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.795+0000 7feeaed9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feeb0066410 0x7feeb011a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:31.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.795+0000 7feeae59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feeb009bc70 0x7feeb011ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55998/0 (socket says 172.21.15.156:55998) 2023-09-30T22:19:31.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.795+0000 7feeaed9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feeb0066410 0x7feeb011a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52022/0 (socket says 172.21.15.156:52022) 2023-09-30T22:19:31.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.795+0000 7feeae59c700 1 -- 172.21.15.156:0/572864467 learned_addr learned my addr 172.21.15.156:0/572864467 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:31.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.795+0000 7feeaf59e700 1 --2- 172.21.15.156:0/572864467 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feeb01314b0 0x7feeb011b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:31.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.795+0000 7feeae59c700 1 -- 172.21.15.156:0/572864467 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feeb0066410 msgr2=0x7feeb011a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.795+0000 7feeae59c700 1 --2- 172.21.15.156:0/572864467 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feeb0066410 0x7feeb011a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.795+0000 7feeae59c700 1 -- 172.21.15.156:0/572864467 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feeb01314b0 msgr2=0x7feeb011b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.795+0000 7feeae59c700 1 --2- 172.21.15.156:0/572864467 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feeb01314b0 0x7feeb011b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.795+0000 7feeae59c700 1 -- 172.21.15.156:0/572864467 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea4009550 con 0x7feeb009bc70 2023-09-30T22:19:31.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.795+0000 7feeaed9d700 1 --2- 172.21.15.156:0/572864467 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feeb0066410 0x7feeb011a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:31.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.795+0000 7feeae59c700 1 --2- 172.21.15.156:0/572864467 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feeb009bc70 0x7feeb011ae80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7feea4009130 tx=0x7feea4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:31.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.795+0000 7fee977fe700 1 -- 172.21.15.156:0/572864467 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea4020860 con 0x7feeb009bc70 2023-09-30T22:19:31.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.795+0000 7fee977fe700 1 -- 172.21.15.156:0/572864467 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea4024070 con 0x7feeb009bc70 2023-09-30T22:19:31.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.796+0000 7fee977fe700 1 -- 172.21.15.156:0/572864467 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea4020c00 con 0x7feeb009bc70 2023-09-30T22:19:31.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.796+0000 7feeb51aa700 1 -- 172.21.15.156:0/572864467 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb011e130 con 0x7feeb009bc70 2023-09-30T22:19:31.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.796+0000 7feeb51aa700 1 -- 172.21.15.156:0/572864467 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb00a1d50 con 0x7feeb009bc70 2023-09-30T22:19:31.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.796+0000 7fee977fe700 1 -- 172.21.15.156:0/572864467 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7feea402b480 con 0x7feeb009bc70 2023-09-30T22:19:31.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.797+0000 7fee977fe700 1 -- 172.21.15.156:0/572864467 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7feea4026070 con 0x7feeb009bc70 2023-09-30T22:19:31.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.797+0000 7feeaed9d700 1 -- 172.21.15.156:0/572864467 >> v1:172.21.15.156:6816/126965 conn(0x7fee9c02f510 legacy=0x7fee9c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:31.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.797+0000 7feeb51aa700 1 -- 172.21.15.156:0/572864467 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb00704b0 con 0x7feeb009bc70 2023-09-30T22:19:31.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.801+0000 7fee977fe700 1 -- 172.21.15.156:0/572864467 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feea4030070 con 0x7feeb009bc70 2023-09-30T22:19:31.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.828+0000 7f40935b5700 1 Processor -- start 2023-09-30T22:19:31.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.828+0000 7f40935b5700 1 -- start start 2023-09-30T22:19:31.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.829+0000 7f40935b5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f408c133ad0 0x7f408c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:31.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.829+0000 7f40935b5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f408c1300a0 0x7f408c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:31.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.829+0000 7f40935b5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f408c1309f0 0x7f408c13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:31.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.829+0000 7f40935b5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f408c06b2d0 con 0x7f408c133ad0 2023-09-30T22:19:31.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.829+0000 7f40935b5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408c133610 con 0x7f408c1309f0 2023-09-30T22:19:31.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.829+0000 7f40935b5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f408c09a500 con 0x7f408c1300a0 2023-09-30T22:19:31.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.829+0000 7f4090b50700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f408c1300a0 0x7f408c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:31.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.829+0000 7f4090b50700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f408c1300a0 0x7f408c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56014/0 (socket says 172.21.15.156:56014) 2023-09-30T22:19:31.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.829+0000 7f4090b50700 1 -- 172.21.15.156:0/3592156533 learned_addr learned my addr 172.21.15.156:0/3592156533 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:31.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.829+0000 7f4091351700 1 --2- 172.21.15.156:0/3592156533 >> v2:172.21.15.156:3300/0 conn(0x7f408c133ad0 0x7f408c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:31.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.829+0000 7f4091b52700 1 --2- 172.21.15.156:0/3592156533 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f408c1309f0 0x7f408c13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:31.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.829+0000 7f4090b50700 1 -- 172.21.15.156:0/3592156533 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f408c1309f0 msgr2=0x7f408c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:31.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.829+0000 7f4090b50700 1 --2- 172.21.15.156:0/3592156533 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f408c1309f0 0x7f408c13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.829+0000 7f4090b50700 1 -- 172.21.15.156:0/3592156533 >> v2:172.21.15.156:3300/0 conn(0x7f408c133ad0 msgr2=0x7f408c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:31.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.829+0000 7f4090b50700 1 --2- 172.21.15.156:0/3592156533 >> v2:172.21.15.156:3300/0 conn(0x7f408c133ad0 0x7f408c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.829+0000 7f4090b50700 1 -- 172.21.15.156:0/3592156533 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c1338b0 con 0x7f408c1300a0 2023-09-30T22:19:31.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.829+0000 7f4091351700 1 --2- 172.21.15.156:0/3592156533 >> v2:172.21.15.156:3300/0 conn(0x7f408c133ad0 0x7f408c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:31.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.829+0000 7f4091b52700 1 --2- 172.21.15.156:0/3592156533 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f408c1309f0 0x7f408c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:31.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.830+0000 7f4090b50700 1 --2- 172.21.15.156:0/3592156533 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f408c1300a0 0x7f408c1304b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f407c0098f0 tx=0x7f407c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8901b9007c2d13b9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:31.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.830+0000 7f4083fff700 1 -- 172.21.15.156:0/3592156533 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c011830 con 0x7f408c1300a0 2023-09-30T22:19:31.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.830+0000 7f4083fff700 1 -- 172.21.15.156:0/3592156533 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407c011990 con 0x7f408c1300a0 2023-09-30T22:19:31.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.830+0000 7f4083fff700 1 -- 172.21.15.156:0/3592156533 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c011d20 con 0x7f408c1300a0 2023-09-30T22:19:31.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.830+0000 7f40935b5700 1 -- 172.21.15.156:0/3592156533 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f408c1300a0 msgr2=0x7f408c1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.830+0000 7f40935b5700 1 --2- 172.21.15.156:0/3592156533 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f408c1300a0 0x7f408c1304b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f407c0098f0 tx=0x7f407c009c00 comp rx=0 tx=0).stop 2023-09-30T22:19:31.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.830+0000 7f40935b5700 1 -- 172.21.15.156:0/3592156533 shutdown_connections 2023-09-30T22:19:31.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.830+0000 7f40935b5700 1 --2- 172.21.15.156:0/3592156533 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f408c1309f0 0x7f408c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.830+0000 7f40935b5700 1 --2- 172.21.15.156:0/3592156533 >> v2:172.21.15.156:3300/0 conn(0x7f408c133ad0 0x7f408c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.830+0000 7f40935b5700 1 --2- 172.21.15.156:0/3592156533 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f408c1300a0 0x7f408c1304b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.830+0000 7f40935b5700 1 -- 172.21.15.156:0/3592156533 >> 172.21.15.156:0/3592156533 conn(0x7f408c099c40 msgr2=0x7f408c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:31.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.831+0000 7f40935b5700 1 -- 172.21.15.156:0/3592156533 shutdown_connections 2023-09-30T22:19:31.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.831+0000 7f40935b5700 1 -- 172.21.15.156:0/3592156533 wait complete. 2023-09-30T22:19:31.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.832+0000 7f40935b5700 1 Processor -- start 2023-09-30T22:19:31.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.832+0000 7f40935b5700 1 -- start start 2023-09-30T22:19:31.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.832+0000 7f40935b5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f408c1300a0 0x7f408c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:31.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.832+0000 7f40935b5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f408c1309f0 0x7f408c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:31.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.832+0000 7f40935b5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f408c133ad0 0x7f408c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:31.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.832+0000 7f40935b5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c1209f0 con 0x7f408c133ad0 2023-09-30T22:19:31.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.832+0000 7f40935b5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408c12f920 con 0x7f408c1309f0 2023-09-30T22:19:31.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.832+0000 7f40935b5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f408c12d8c0 con 0x7f408c1300a0 2023-09-30T22:19:31.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.833+0000 7f4091351700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f408c1300a0 0x7f408c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:31.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.833+0000 7f4091351700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f408c1300a0 0x7f408c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56026/0 (socket says 172.21.15.156:56026) 2023-09-30T22:19:31.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.833+0000 7f4091351700 1 -- 172.21.15.156:0/2632047324 learned_addr learned my addr 172.21.15.156:0/2632047324 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:31.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.833+0000 7f4090b50700 1 --2- 172.21.15.156:0/2632047324 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f408c1309f0 0x7f408c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:31.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.833+0000 7f4091b52700 1 --2- 172.21.15.156:0/2632047324 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f408c133ad0 0x7f408c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:31.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.833+0000 7f4091351700 1 -- 172.21.15.156:0/2632047324 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f408c1309f0 msgr2=0x7f408c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.833+0000 7f4091351700 1 --2- 172.21.15.156:0/2632047324 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f408c1309f0 0x7f408c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.833+0000 7f4091351700 1 -- 172.21.15.156:0/2632047324 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f408c133ad0 msgr2=0x7f408c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.833+0000 7f4091351700 1 --2- 172.21.15.156:0/2632047324 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f408c133ad0 0x7f408c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.833+0000 7f4091351700 1 -- 172.21.15.156:0/2632047324 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4084009a70 con 0x7f408c1300a0 2023-09-30T22:19:31.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.833+0000 7f4090b50700 1 --2- 172.21.15.156:0/2632047324 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f408c1309f0 0x7f408c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:31.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.833+0000 7f4091b52700 1 --2- 172.21.15.156:0/2632047324 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f408c133ad0 0x7f408c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:19:31.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.833+0000 7f4091351700 1 --2- 172.21.15.156:0/2632047324 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f408c1300a0 0x7f408c11da40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f408800ec10 tx=0x7f408800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:31.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.833+0000 7f4081ffb700 1 -- 172.21.15.156:0/2632047324 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408800c910 con 0x7f408c1300a0 2023-09-30T22:19:31.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.833+0000 7f4081ffb700 1 -- 172.21.15.156:0/2632047324 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408800ca70 con 0x7f408c1300a0 2023-09-30T22:19:31.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.833+0000 7f40935b5700 1 -- 172.21.15.156:0/2632047324 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40880094a0 con 0x7f408c1300a0 2023-09-30T22:19:31.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.833+0000 7f4081ffb700 1 -- 172.21.15.156:0/2632047324 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408800cde0 con 0x7f408c1300a0 2023-09-30T22:19:31.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.833+0000 7f40935b5700 1 -- 172.21.15.156:0/2632047324 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407c009550 con 0x7f408c1300a0 2023-09-30T22:19:31.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.834+0000 7f4081ffb700 1 -- 172.21.15.156:0/2632047324 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4088013470 con 0x7f408c1300a0 2023-09-30T22:19:31.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.834+0000 7f4081ffb700 1 -- 172.21.15.156:0/2632047324 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f408803fce0 con 0x7f408c1300a0 2023-09-30T22:19:31.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.834+0000 7f4090b50700 1 -- 172.21.15.156:0/2632047324 >> v1:172.21.15.156:6816/126965 conn(0x7f407002f510 legacy=0x7f40700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:31.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.834+0000 7f40935b5700 1 -- 172.21.15.156:0/2632047324 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f408c09cb20 con 0x7f408c1300a0 2023-09-30T22:19:31.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.839+0000 7f4081ffb700 1 -- 172.21.15.156:0/2632047324 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4088017080 con 0x7f408c1300a0 2023-09-30T22:19:31.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.906+0000 7f9ce9ef9700 1 -- 172.21.15.156:0/2687896501 >> v1:172.21.15.156:6816/126965 conn(0x7f9cc802f510 legacy=0x7f9cc80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:31.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.923+0000 7f9cec15d700 1 -- 172.21.15.156:0/2687896501 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9ce4071880 con 0x7f9ce406b080 2023-09-30T22:19:31.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.923+0000 7f9cda7fc700 1 -- 172.21.15.156:0/2687896501 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9cd40102c0 con 0x7f9ce406b080 2023-09-30T22:19:31.923 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:31.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.925+0000 7f9cec15d700 1 -- 172.21.15.156:0/2687896501 >> v1:172.21.15.156:6816/126965 conn(0x7f9cc802f510 legacy=0x7f9cc80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:31.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.925+0000 7f9cec15d700 1 -- 172.21.15.156:0/2687896501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ce406b080 msgr2=0x7f9ce409a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.925+0000 7f9cec15d700 1 --2- 172.21.15.156:0/2687896501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ce406b080 0x7f9ce409a9a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4001eb0 tx=0x7f9cd400c800 comp rx=0 tx=0).stop 2023-09-30T22:19:31.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.925+0000 7f9cec15d700 1 -- 172.21.15.156:0/2687896501 shutdown_connections 2023-09-30T22:19:31.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.925+0000 7f9cec15d700 1 --2- 172.21.15.156:0/2687896501 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ce4131ec0 0x7f9ce409aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.925+0000 7f9cec15d700 1 --2- 172.21.15.156:0/2687896501 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ce406a770 0x7f9ce409a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.925+0000 7f9cec15d700 1 --2- 172.21.15.156:0/2687896501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ce406b080 0x7f9ce409a9a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:31.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.925+0000 7f9cec15d700 1 -- 172.21.15.156:0/2687896501 >> 172.21.15.156:0/2687896501 conn(0x7f9ce4099c40 msgr2=0x7f9ce4130010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:31.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.925+0000 7f9cec15d700 1 -- 172.21.15.156:0/2687896501 shutdown_connections 2023-09-30T22:19:31.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.925+0000 7f9cec15d700 1 -- 172.21.15.156:0/2687896501 wait complete. 2023-09-30T22:19:31.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:31.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:31.997+0000 7feeaed9d700 1 -- 172.21.15.156:0/572864467 >> v1:172.21.15.156:6816/126965 conn(0x7fee9c02f510 legacy=0x7fee9c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:32.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:32.013+0000 7feeb51aa700 1 -- 172.21.15.156:0/572864467 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feeb004f2a0 con 0x7feeb009bc70 2023-09-30T22:19:32.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:32.013+0000 7fee977fe700 1 -- 172.21.15.156:0/572864467 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feea4015030 con 0x7feeb009bc70 2023-09-30T22:19:32.014 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:32.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:32.015+0000 7feeb51aa700 1 -- 172.21.15.156:0/572864467 >> v1:172.21.15.156:6816/126965 conn(0x7fee9c02f510 legacy=0x7fee9c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:32.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:32.015+0000 7feeb51aa700 1 -- 172.21.15.156:0/572864467 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feeb009bc70 msgr2=0x7feeb011ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:32.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:32.015+0000 7feeb51aa700 1 --2- 172.21.15.156:0/572864467 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feeb009bc70 0x7feeb011ae80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7feea4009130 tx=0x7feea4004750 comp rx=0 tx=0).stop 2023-09-30T22:19:32.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:32.015+0000 7feeb51aa700 1 -- 172.21.15.156:0/572864467 shutdown_connections 2023-09-30T22:19:32.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:32.015+0000 7feeb51aa700 1 --2- 172.21.15.156:0/572864467 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feeb01314b0 0x7feeb011b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:32.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:32.016+0000 7feeb51aa700 1 --2- 172.21.15.156:0/572864467 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feeb0066410 0x7feeb011a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:32.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:32.016+0000 7feeb51aa700 1 --2- 172.21.15.156:0/572864467 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feeb009bc70 0x7feeb011ae80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:32.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:32.016+0000 7feeb51aa700 1 -- 172.21.15.156:0/572864467 >> 172.21.15.156:0/572864467 conn(0x7feeb00a2980 msgr2=0x7feeb012fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:32.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:32.016+0000 7feeb51aa700 1 -- 172.21.15.156:0/572864467 shutdown_connections 2023-09-30T22:19:32.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:32.016+0000 7feeb51aa700 1 -- 172.21.15.156:0/572864467 wait complete. 2023-09-30T22:19:32.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:32.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:32.031+0000 7f40935b5700 1 -- 172.21.15.156:0/2632047324 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f408c12dd00 con 0x7f408c1300a0 2023-09-30T22:19:32.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:32.032+0000 7f4081ffb700 1 -- 172.21.15.156:0/2632047324 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4088021030 con 0x7f408c1300a0 2023-09-30T22:19:32.033 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:32.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:32.034+0000 7f4090b50700 1 -- 172.21.15.156:0/2632047324 >> v1:172.21.15.156:6816/126965 conn(0x7f407002f510 legacy=0x7f40700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.156:6816/126965 2023-09-30T22:19:32.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:32.034+0000 7f40935b5700 1 -- 172.21.15.156:0/2632047324 >> v1:172.21.15.156:6816/126965 conn(0x7f407002f510 legacy=0x7f40700319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:32.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:32.034+0000 7f40935b5700 1 -- 172.21.15.156:0/2632047324 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f408c1300a0 msgr2=0x7f408c11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:32.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:32.034+0000 7f40935b5700 1 --2- 172.21.15.156:0/2632047324 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f408c1300a0 0x7f408c11da40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f408800ec10 tx=0x7f408800ef20 comp rx=0 tx=0).stop 2023-09-30T22:19:32.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:32.034+0000 7f40935b5700 1 -- 172.21.15.156:0/2632047324 shutdown_connections 2023-09-30T22:19:32.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:32.034+0000 7f40935b5700 1 --2- 172.21.15.156:0/2632047324 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f408c133ad0 0x7f408c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:32.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:32.034+0000 7f40935b5700 1 --2- 172.21.15.156:0/2632047324 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f408c1300a0 0x7f408c11da40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:32.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:32.034+0000 7f40935b5700 1 --2- 172.21.15.156:0/2632047324 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f408c1309f0 0x7f408c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:32.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:32.034+0000 7f40935b5700 1 -- 172.21.15.156:0/2632047324 >> 172.21.15.156:0/2632047324 conn(0x7f408c099c40 msgr2=0x7f408c132ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:32.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:32.034+0000 7f40935b5700 1 -- 172.21.15.156:0/2632047324 shutdown_connections 2023-09-30T22:19:32.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:32.034+0000 7f40935b5700 1 -- 172.21.15.156:0/2632047324 wait complete. 2023-09-30T22:19:32.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:32.609 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:32.994 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:33.029 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:33.048 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:33.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.135+0000 7fdde1f96700 1 Processor -- start 2023-09-30T22:19:33.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.135+0000 7fdde1f96700 1 -- start start 2023-09-30T22:19:33.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.136+0000 7fdde1f96700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdddc09a150 0x7fdddc09e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:33.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.136+0000 7fdde1f96700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdddc09edb0 0x7fdddc09f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:33.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.136+0000 7fdde1f96700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdddc09af80 con 0x7fdddc133c20 2023-09-30T22:19:33.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.136+0000 7fdde1f96700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc09a520 con 0x7fdddc09a150 2023-09-30T22:19:33.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.136+0000 7fdde1f96700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc09fe00 con 0x7fdddc09edb0 2023-09-30T22:19:33.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.136+0000 7fdddb7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdddc09a150 0x7fdddc09e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:33.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.136+0000 7fdddb7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdddc09a150 0x7fdddc09e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52040/0 (socket says 172.21.15.156:52040) 2023-09-30T22:19:33.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.136+0000 7fdddb7fe700 1 -- 172.21.15.156:0/507184926 learned_addr learned my addr 172.21.15.156:0/507184926 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:33.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.136+0000 7f04fff13700 1 Processor -- start 2023-09-30T22:19:33.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.136+0000 7fdddb7fe700 1 -- 172.21.15.156:0/507184926 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdddc09edb0 msgr2=0x7fdddc09f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:33.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.136+0000 7fdddb7fe700 1 --2- 172.21.15.156:0/507184926 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdddc09edb0 0x7fdddc09f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.136+0000 7fdddb7fe700 1 -- 172.21.15.156:0/507184926 >> v1:172.21.15.156:6789/0 conn(0x7fdddc133c20 legacy=0x7fdddc1340c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.136+0000 7fddda7fc700 1 -- 172.21.15.156:0/507184926 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3615896850 0 0) 0x7fdddc09af80 con 0x7fdddc133c20 2023-09-30T22:19:33.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.136+0000 7fdddb7fe700 1 -- 172.21.15.156:0/507184926 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdddc09f6e0 con 0x7fdddc09a150 2023-09-30T22:19:33.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.136+0000 7fdddb7fe700 1 --2- 172.21.15.156:0/507184926 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdddc09a150 0x7fdddc09e870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009950 tx=0x7fddcc009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c05046912b53eeab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:33.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.137+0000 7fddda7fc700 1 -- 172.21.15.156:0/507184926 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc009ea0 con 0x7fdddc09a150 2023-09-30T22:19:33.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.137+0000 7fddda7fc700 1 -- 172.21.15.156:0/507184926 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddcc00ba20 con 0x7fdddc09a150 2023-09-30T22:19:33.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.137+0000 7fddda7fc700 1 -- 172.21.15.156:0/507184926 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc00bdb0 con 0x7fdddc09a150 2023-09-30T22:19:33.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.136+0000 7f04fff13700 1 -- start start 2023-09-30T22:19:33.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.137+0000 7f04fff13700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f04f809a130 0x7f04f809e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:33.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.137+0000 7f04fff13700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04f809f1e0 0x7f04f813fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:33.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.137+0000 7f04fff13700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f8072b30 con 0x7f04f809edb0 2023-09-30T22:19:33.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.137+0000 7f04fff13700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f809a500 con 0x7f04f809a130 2023-09-30T22:19:33.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.137+0000 7f04fff13700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04f809ada0 con 0x7f04f809f1e0 2023-09-30T22:19:33.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.138+0000 7f04fe4b0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04f809f1e0 0x7f04f813fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:33.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.138+0000 7f04fd4ae700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f04f809edb0 0x7f04f813c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48402/0 (socket says 172.21.15.156:48402) 2023-09-30T22:19:33.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.138+0000 7f04fd4ae700 1 -- 172.21.15.156:0/2608891385 learned_addr learned my addr 172.21.15.156:0/2608891385 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:33.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.138+0000 7f04fdcaf700 1 --2- 172.21.15.156:0/2608891385 >> v2:172.21.15.156:3300/0 conn(0x7f04f809a130 0x7f04f809e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:33.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.138+0000 7fdde1f96700 1 -- 172.21.15.156:0/507184926 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdddc09a150 msgr2=0x7fdddc09e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.138+0000 7fdde1f96700 1 --2- 172.21.15.156:0/507184926 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdddc09a150 0x7fdddc09e870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009950 tx=0x7fddcc009c60 comp rx=0 tx=0).stop 2023-09-30T22:19:33.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.138+0000 7fdde1f96700 1 -- 172.21.15.156:0/507184926 shutdown_connections 2023-09-30T22:19:33.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.138+0000 7fdde1f96700 1 --2- 172.21.15.156:0/507184926 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdddc09a150 0x7fdddc09e870 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.138+0000 7fdde1f96700 1 --2- 172.21.15.156:0/507184926 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdddc09edb0 0x7fdddc09f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.138+0000 7fdde1f96700 1 -- 172.21.15.156:0/507184926 >> 172.21.15.156:0/507184926 conn(0x7fdddc0a4430 msgr2=0x7fdddc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:33.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.138+0000 7fdde1f96700 1 -- 172.21.15.156:0/507184926 shutdown_connections 2023-09-30T22:19:33.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.138+0000 7f04fdcaf700 1 -- 172.21.15.156:0/2608891385 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04f809f1e0 msgr2=0x7f04f813fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:33.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.138+0000 7f04fdcaf700 1 --2- 172.21.15.156:0/2608891385 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04f809f1e0 0x7f04f813fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.138+0000 7fdde1f96700 1 -- 172.21.15.156:0/507184926 wait complete. 2023-09-30T22:19:33.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.138+0000 7f04fdcaf700 1 -- 172.21.15.156:0/2608891385 >> v1:172.21.15.156:6789/0 conn(0x7f04f809edb0 legacy=0x7f04f813c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.138+0000 7f04fdcaf700 1 -- 172.21.15.156:0/2608891385 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f809fe00 con 0x7f04f809a130 2023-09-30T22:19:33.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.138+0000 7f04fdcaf700 1 --2- 172.21.15.156:0/2608891385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04f809a130 0x7f04f809e870 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f04f0009d90 tx=0x7f04f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8164925d5dfa3626 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:33.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.139+0000 7f04fccad700 1 -- 172.21.15.156:0/2608891385 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f000e070 con 0x7f04f809a130 2023-09-30T22:19:33.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.139+0000 7f04fccad700 1 -- 172.21.15.156:0/2608891385 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f0003a20 con 0x7f04f809a130 2023-09-30T22:19:33.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.139+0000 7f04fccad700 1 -- 172.21.15.156:0/2608891385 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f0003dd0 con 0x7f04f809a130 2023-09-30T22:19:33.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.139+0000 7fdde1f96700 1 Processor -- start 2023-09-30T22:19:33.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.139+0000 7f04fff13700 1 -- 172.21.15.156:0/2608891385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04f809a130 msgr2=0x7f04f809e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.139+0000 7f04fff13700 1 --2- 172.21.15.156:0/2608891385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04f809a130 0x7f04f809e870 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f04f0009d90 tx=0x7f04f000b330 comp rx=0 tx=0).stop 2023-09-30T22:19:33.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.140+0000 7f04fff13700 1 -- 172.21.15.156:0/2608891385 shutdown_connections 2023-09-30T22:19:33.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.140+0000 7f04fff13700 1 --2- 172.21.15.156:0/2608891385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04f809a130 0x7f04f809e870 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.140+0000 7f04fff13700 1 --2- 172.21.15.156:0/2608891385 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04f809f1e0 0x7f04f813fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.140+0000 7f04fff13700 1 -- 172.21.15.156:0/2608891385 >> 172.21.15.156:0/2608891385 conn(0x7f04f80a4430 msgr2=0x7f04f80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:33.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.140+0000 7fdde1f96700 1 -- start start 2023-09-30T22:19:33.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.140+0000 7f04fff13700 1 -- 172.21.15.156:0/2608891385 shutdown_connections 2023-09-30T22:19:33.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.140+0000 7fdde1f96700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdddc09a150 0x7fdddc1227e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:33.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.140+0000 7fdde1f96700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdddc09edb0 0x7fdddc122d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:33.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.140+0000 7fdde1f96700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdddc133c20 0x7fdddc123260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:33.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.140+0000 7fdde1f96700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc124c80 con 0x7fdddc09edb0 2023-09-30T22:19:33.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.140+0000 7fdde1f96700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc123c40 con 0x7fdddc09a150 2023-09-30T22:19:33.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.140+0000 7fdde1f96700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc124500 con 0x7fdddc133c20 2023-09-30T22:19:33.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.141+0000 7fdddaffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdddc09edb0 0x7fdddc122d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:33.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.141+0000 7fdddb7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdddc09a150 0x7fdddc1227e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:33.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.141+0000 7fdddb7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdddc09a150 0x7fdddc1227e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52054/0 (socket says 172.21.15.156:52054) 2023-09-30T22:19:33.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.141+0000 7fdddb7fe700 1 -- 172.21.15.156:0/4008580736 learned_addr learned my addr 172.21.15.156:0/4008580736 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:33.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.141+0000 7fdddb7fe700 1 -- 172.21.15.156:0/4008580736 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdddc133c20 msgr2=0x7fdddc123260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.141+0000 7fdddb7fe700 1 --2- 172.21.15.156:0/4008580736 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdddc133c20 0x7fdddc123260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.141+0000 7fdddb7fe700 1 -- 172.21.15.156:0/4008580736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdddc09edb0 msgr2=0x7fdddc122d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.141+0000 7fdddb7fe700 1 --2- 172.21.15.156:0/4008580736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdddc09edb0 0x7fdddc122d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.141+0000 7fdddb7fe700 1 -- 172.21.15.156:0/4008580736 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc009550 con 0x7fdddc09a150 2023-09-30T22:19:33.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.140+0000 7f04fff13700 1 -- 172.21.15.156:0/2608891385 wait complete. 2023-09-30T22:19:33.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.141+0000 7f04fff13700 1 Processor -- start 2023-09-30T22:19:33.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.141+0000 7fdddb7fe700 1 --2- 172.21.15.156:0/4008580736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdddc09a150 0x7fdddc1227e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009ca0 tx=0x7fddcc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:33.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.141+0000 7fddc3fff700 1 -- 172.21.15.156:0/4008580736 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc011c90 con 0x7fdddc09a150 2023-09-30T22:19:33.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.141+0000 7fddc3fff700 1 -- 172.21.15.156:0/4008580736 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddcc01e070 con 0x7fdddc09a150 2023-09-30T22:19:33.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.142+0000 7fdde1f96700 1 -- 172.21.15.156:0/4008580736 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdddc126020 con 0x7fdddc09a150 2023-09-30T22:19:33.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.142+0000 7fddc3fff700 1 -- 172.21.15.156:0/4008580736 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc025480 con 0x7fdddc09a150 2023-09-30T22:19:33.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.142+0000 7fdde1f96700 1 -- 172.21.15.156:0/4008580736 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdddc0a39f0 con 0x7fdddc09a150 2023-09-30T22:19:33.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.142+0000 7f04fff13700 1 -- start start 2023-09-30T22:19:33.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.142+0000 7fdde1f96700 1 -- 172.21.15.156:0/4008580736 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdddc04f2a0 con 0x7fdddc09a150 2023-09-30T22:19:33.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.143+0000 7f04fff13700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04f809a130 0x7f04f813fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:33.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.143+0000 7f04fff13700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04f809edb0 0x7f04f811ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:33.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.143+0000 7f04fff13700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04f809f1e0 0x7f04f811f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:33.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.143+0000 7f04fff13700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f80a00f0 con 0x7f04f809edb0 2023-09-30T22:19:33.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.143+0000 7f04fff13700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f8121f50 con 0x7f04f809a130 2023-09-30T22:19:33.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.143+0000 7f04fff13700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04f813ac40 con 0x7f04f809f1e0 2023-09-30T22:19:33.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.143+0000 7fddc3fff700 1 -- 172.21.15.156:0/4008580736 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fddcc01a420 con 0x7fdddc09a150 2023-09-30T22:19:33.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.143+0000 7fddc3fff700 1 -- 172.21.15.156:0/4008580736 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fddcc020070 con 0x7fdddc09a150 2023-09-30T22:19:33.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.143+0000 7f04fd4ae700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04f809edb0 0x7f04f811ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:33.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.143+0000 7f04fd4ae700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04f809edb0 0x7f04f811ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38450/0 (socket says 172.21.15.156:38450) 2023-09-30T22:19:33.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.143+0000 7f04fd4ae700 1 -- 172.21.15.156:0/2674764374 learned_addr learned my addr 172.21.15.156:0/2674764374 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:33.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.143+0000 7f04fd4ae700 1 -- 172.21.15.156:0/2674764374 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04f809f1e0 msgr2=0x7f04f811f010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:33.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.143+0000 7f04fd4ae700 1 --2- 172.21.15.156:0/2674764374 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04f809f1e0 0x7f04f811f010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.143+0000 7f04fd4ae700 1 -- 172.21.15.156:0/2674764374 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04f809a130 msgr2=0x7f04f813fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.143+0000 7f04fd4ae700 1 --2- 172.21.15.156:0/2674764374 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04f809a130 0x7f04f813fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.143+0000 7f04fd4ae700 1 -- 172.21.15.156:0/2674764374 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f0009a70 con 0x7f04f809edb0 2023-09-30T22:19:33.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.143+0000 7f04fd4ae700 1 --2- 172.21.15.156:0/2674764374 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04f809edb0 0x7f04f811ead0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f04e800c780 tx=0x7f04e800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:33.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.143+0000 7f04ee7fc700 1 -- 172.21.15.156:0/2674764374 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e8004c80 con 0x7f04f809edb0 2023-09-30T22:19:33.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.143+0000 7f04ee7fc700 1 -- 172.21.15.156:0/2674764374 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e8004de0 con 0x7f04f809edb0 2023-09-30T22:19:33.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.143+0000 7f04ee7fc700 1 -- 172.21.15.156:0/2674764374 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e80072d0 con 0x7f04f809edb0 2023-09-30T22:19:33.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.143+0000 7f04fff13700 1 -- 172.21.15.156:0/2674764374 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f80a32b0 con 0x7f04f809edb0 2023-09-30T22:19:33.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.144+0000 7f04fff13700 1 -- 172.21.15.156:0/2674764374 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f811fed0 con 0x7f04f809edb0 2023-09-30T22:19:33.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.144+0000 7f04fff13700 1 -- 172.21.15.156:0/2674764374 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f804f2a0 con 0x7f04f809edb0 2023-09-30T22:19:33.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.145+0000 7f04ee7fc700 1 -- 172.21.15.156:0/2674764374 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f04e8007430 con 0x7f04f809edb0 2023-09-30T22:19:33.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.145+0000 7f04ee7fc700 1 -- 172.21.15.156:0/2674764374 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f04e803eda0 con 0x7f04f809edb0 2023-09-30T22:19:33.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.150+0000 7f04ee7fc700 1 -- 172.21.15.156:0/2674764374 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f04e801c3b0 con 0x7f04f809edb0 2023-09-30T22:19:33.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.151+0000 7fddc3fff700 1 -- 172.21.15.156:0/4008580736 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fddcc010b70 con 0x7fdddc09a150 2023-09-30T22:19:33.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.182+0000 7f70f1699700 1 Processor -- start 2023-09-30T22:19:33.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.182+0000 7f70f1699700 1 -- start start 2023-09-30T22:19:33.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.183+0000 7f70f1699700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70ec099e20 0x7f70ec09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:33.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.183+0000 7f70f1699700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f70ec09a730 0x7f70ec130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:33.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.183+0000 7f70f1699700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70ec099a60 con 0x7f70ec130890 2023-09-30T22:19:33.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.183+0000 7f70f1699700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70ec09bf50 con 0x7f70ec09a730 2023-09-30T22:19:33.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.183+0000 7f70f1699700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec09b230 con 0x7f70ec099e20 2023-09-30T22:19:33.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.183+0000 7f70eaffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70ec099e20 0x7f70ec09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:33.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.183+0000 7f70ea7fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f70ec09a730 0x7f70ec130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:33.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.183+0000 7f70eaffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70ec099e20 0x7f70ec09a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52064/0 (socket says 172.21.15.156:52064) 2023-09-30T22:19:33.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.183+0000 7f70eaffd700 1 -- 172.21.15.156:0/2855434150 learned_addr learned my addr 172.21.15.156:0/2855434150 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:33.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.184+0000 7f70eaffd700 1 -- 172.21.15.156:0/2855434150 >> v2:172.21.15.156:3300/0 conn(0x7f70ec09a730 msgr2=0x7f70ec130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:33.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.184+0000 7f70eaffd700 1 --2- 172.21.15.156:0/2855434150 >> v2:172.21.15.156:3300/0 conn(0x7f70ec09a730 0x7f70ec130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.184+0000 7f70eaffd700 1 -- 172.21.15.156:0/2855434150 >> v1:172.21.15.156:6789/0 conn(0x7f70ec130890 legacy=0x7f70ec137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.184+0000 7f70eaffd700 1 -- 172.21.15.156:0/2855434150 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec09bb90 con 0x7f70ec099e20 2023-09-30T22:19:33.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.184+0000 7f70ea7fc700 1 --2- 172.21.15.156:0/2855434150 >> v2:172.21.15.156:3300/0 conn(0x7f70ec09a730 0x7f70ec130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:33.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.184+0000 7f70eaffd700 1 --2- 172.21.15.156:0/2855434150 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70ec099e20 0x7f70ec09a1f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f70dc00bf40 tx=0x7f70dc009370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46767a87fef45230 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:33.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.184+0000 7f70e9ffb700 1 -- 172.21.15.156:0/2855434150 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc00b480 con 0x7f70ec099e20 2023-09-30T22:19:33.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.184+0000 7f70e9ffb700 1 -- 172.21.15.156:0/2855434150 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70dc00c950 con 0x7f70ec099e20 2023-09-30T22:19:33.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.184+0000 7f70e9ffb700 1 -- 172.21.15.156:0/2855434150 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc00cd00 con 0x7f70ec099e20 2023-09-30T22:19:33.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.185+0000 7f70f1699700 1 -- 172.21.15.156:0/2855434150 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70ec099e20 msgr2=0x7f70ec09a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.185+0000 7f70f1699700 1 --2- 172.21.15.156:0/2855434150 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70ec099e20 0x7f70ec09a1f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f70dc00bf40 tx=0x7f70dc009370 comp rx=0 tx=0).stop 2023-09-30T22:19:33.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.185+0000 7f70f1699700 1 -- 172.21.15.156:0/2855434150 shutdown_connections 2023-09-30T22:19:33.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.185+0000 7f70f1699700 1 --2- 172.21.15.156:0/2855434150 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70ec099e20 0x7f70ec09a1f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.185+0000 7f70f1699700 1 --2- 172.21.15.156:0/2855434150 >> v2:172.21.15.156:3300/0 conn(0x7f70ec09a730 0x7f70ec130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.185+0000 7f70f1699700 1 -- 172.21.15.156:0/2855434150 >> 172.21.15.156:0/2855434150 conn(0x7f70ec0a2980 msgr2=0x7f70ec0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:33.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.185+0000 7f70f1699700 1 -- 172.21.15.156:0/2855434150 shutdown_connections 2023-09-30T22:19:33.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.185+0000 7f70f1699700 1 -- 172.21.15.156:0/2855434150 wait complete. 2023-09-30T22:19:33.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.187+0000 7f70f1699700 1 Processor -- start 2023-09-30T22:19:33.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.187+0000 7f70f1699700 1 -- start start 2023-09-30T22:19:33.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.187+0000 7f70f1699700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70ec099e20 0x7f70ec11bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:33.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.187+0000 7f70f1699700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70ec09a730 0x7f70ec11c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:33.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.187+0000 7f70f1699700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70ec130890 0x7f70ec11c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:33.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.187+0000 7f70f1699700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec11f610 con 0x7f70ec09a730 2023-09-30T22:19:33.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.187+0000 7f70f1699700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec11d890 con 0x7f70ec099e20 2023-09-30T22:19:33.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.187+0000 7f70f1699700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec0a1300 con 0x7f70ec130890 2023-09-30T22:19:33.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.187+0000 7f70eaffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70ec099e20 0x7f70ec11bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:33.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.187+0000 7f70ea7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70ec09a730 0x7f70ec11c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:33.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.187+0000 7f70ea7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70ec09a730 0x7f70ec11c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38476/0 (socket says 172.21.15.156:38476) 2023-09-30T22:19:33.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.187+0000 7f70eaffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70ec099e20 0x7f70ec11bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52068/0 (socket says 172.21.15.156:52068) 2023-09-30T22:19:33.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.187+0000 7f70ea7fc700 1 -- 172.21.15.156:0/872394177 learned_addr learned my addr 172.21.15.156:0/872394177 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:33.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.188+0000 7f70eb7fe700 1 --2- 172.21.15.156:0/872394177 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70ec130890 0x7f70ec11c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:33.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.188+0000 7f70ea7fc700 1 -- 172.21.15.156:0/872394177 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70ec130890 msgr2=0x7f70ec11c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.188+0000 7f70ea7fc700 1 --2- 172.21.15.156:0/872394177 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70ec130890 0x7f70ec11c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.188+0000 7f70ea7fc700 1 -- 172.21.15.156:0/872394177 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70ec099e20 msgr2=0x7f70ec11bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.188+0000 7f70ea7fc700 1 --2- 172.21.15.156:0/872394177 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70ec099e20 0x7f70ec11bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.188+0000 7f70ea7fc700 1 -- 172.21.15.156:0/872394177 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e000d940 con 0x7f70ec09a730 2023-09-30T22:19:33.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.188+0000 7f70ea7fc700 1 --2- 172.21.15.156:0/872394177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70ec09a730 0x7f70ec11c300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f70e0012fc0 tx=0x7f70e00103a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:33.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.188+0000 7f70d37fe700 1 -- 172.21.15.156:0/872394177 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e0010b00 con 0x7f70ec09a730 2023-09-30T22:19:33.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.188+0000 7f70d37fe700 1 -- 172.21.15.156:0/872394177 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e0013040 con 0x7f70ec09a730 2023-09-30T22:19:33.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.188+0000 7f70f1699700 1 -- 172.21.15.156:0/872394177 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70dc00bb50 con 0x7f70ec09a730 2023-09-30T22:19:33.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.188+0000 7f70d37fe700 1 -- 172.21.15.156:0/872394177 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e0010e80 con 0x7f70ec09a730 2023-09-30T22:19:33.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.188+0000 7f70f1699700 1 -- 172.21.15.156:0/872394177 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70ec11ee60 con 0x7f70ec09a730 2023-09-30T22:19:33.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.189+0000 7f70d37fe700 1 -- 172.21.15.156:0/872394177 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f70e0018480 con 0x7f70ec09a730 2023-09-30T22:19:33.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.190+0000 7f70f1699700 1 -- 172.21.15.156:0/872394177 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70ec072480 con 0x7f70ec09a730 2023-09-30T22:19:33.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.190+0000 7f70d37fe700 1 -- 172.21.15.156:0/872394177 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f70e0043690 con 0x7f70ec09a730 2023-09-30T22:19:33.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.198+0000 7f70d37fe700 1 -- 172.21.15.156:0/872394177 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f70ec072480 con 0x7f70ec09a730 2023-09-30T22:19:33.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.222+0000 7f04d5bf4700 1 Processor -- start 2023-09-30T22:19:33.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.222+0000 7f04d5bf4700 1 -- start start 2023-09-30T22:19:33.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.222+0000 7f04d5bf4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f04d009e950 0x7f04d009ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:33.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.222+0000 7f04d5bf4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04d01393c0 0x7f04d013b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:33.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.222+0000 7f04d5bf4700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d009ac20 con 0x7f04d009f260 2023-09-30T22:19:33.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.222+0000 7f04d5bf4700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d00a06c0 con 0x7f04d009e950 2023-09-30T22:19:33.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.222+0000 7f04d5bf4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d009ae90 con 0x7f04d01393c0 2023-09-30T22:19:33.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.222+0000 7f04ceffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f04d009f260 0x7f04d0137ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48416/0 (socket says 172.21.15.156:48416) 2023-09-30T22:19:33.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.222+0000 7f04ceffd700 1 -- 172.21.15.156:0/1325548208 learned_addr learned my addr 172.21.15.156:0/1325548208 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:33.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.222+0000 7f04cffff700 1 --2- 172.21.15.156:0/1325548208 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04d01393c0 0x7f04d013b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:33.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.222+0000 7f04cf7fe700 1 --2- 172.21.15.156:0/1325548208 >> v2:172.21.15.156:3300/0 conn(0x7f04d009e950 0x7f04d009ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:33.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.223+0000 7f04cffff700 1 -- 172.21.15.156:0/1325548208 >> v2:172.21.15.156:3300/0 conn(0x7f04d009e950 msgr2=0x7f04d009ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:33.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.223+0000 7f04cffff700 1 --2- 172.21.15.156:0/1325548208 >> v2:172.21.15.156:3300/0 conn(0x7f04d009e950 0x7f04d009ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.223+0000 7f04cffff700 1 -- 172.21.15.156:0/1325548208 >> v1:172.21.15.156:6789/0 conn(0x7f04d009f260 legacy=0x7f04d0137ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.223+0000 7f04ce7fc700 1 -- 172.21.15.156:0/1325548208 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1898734398 0 0) 0x7f04d009ac20 con 0x7f04d009f260 2023-09-30T22:19:33.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.223+0000 7f04cffff700 1 -- 172.21.15.156:0/1325548208 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d006ba00 con 0x7f04d01393c0 2023-09-30T22:19:33.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.223+0000 7f04cffff700 1 --2- 172.21.15.156:0/1325548208 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04d01393c0 0x7f04d013b7a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f04c8009d90 tx=0x7f04c800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e184ed6035e9bf8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:33.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.223+0000 7f04ce7fc700 1 -- 172.21.15.156:0/1325548208 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c800e070 con 0x7f04d01393c0 2023-09-30T22:19:33.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.223+0000 7f04ce7fc700 1 -- 172.21.15.156:0/1325548208 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c800bb20 con 0x7f04d01393c0 2023-09-30T22:19:33.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.223+0000 7f04ce7fc700 1 -- 172.21.15.156:0/1325548208 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c8012430 con 0x7f04d01393c0 2023-09-30T22:19:33.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.224+0000 7f04d5bf4700 1 -- 172.21.15.156:0/1325548208 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04d01393c0 msgr2=0x7f04d013b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.224+0000 7f04d5bf4700 1 --2- 172.21.15.156:0/1325548208 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04d01393c0 0x7f04d013b7a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f04c8009d90 tx=0x7f04c800b330 comp rx=0 tx=0).stop 2023-09-30T22:19:33.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.224+0000 7f04d5bf4700 1 -- 172.21.15.156:0/1325548208 shutdown_connections 2023-09-30T22:19:33.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.224+0000 7f04d5bf4700 1 --2- 172.21.15.156:0/1325548208 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04d01393c0 0x7f04d013b7a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.224+0000 7f04d5bf4700 1 --2- 172.21.15.156:0/1325548208 >> v2:172.21.15.156:3300/0 conn(0x7f04d009e950 0x7f04d009ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.224+0000 7f04d5bf4700 1 -- 172.21.15.156:0/1325548208 >> 172.21.15.156:0/1325548208 conn(0x7f04d00a0f70 msgr2=0x7f04d00a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:33.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.224+0000 7f04d5bf4700 1 -- 172.21.15.156:0/1325548208 shutdown_connections 2023-09-30T22:19:33.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.224+0000 7f04d5bf4700 1 -- 172.21.15.156:0/1325548208 wait complete. 2023-09-30T22:19:33.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.225+0000 7f04d5bf4700 1 Processor -- start 2023-09-30T22:19:33.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.225+0000 7f04d5bf4700 1 -- start start 2023-09-30T22:19:33.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.226+0000 7f04d5bf4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04d009e950 0x7f04d01216c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:33.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.226+0000 7f04d5bf4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04d009f260 0x7f04d0121c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:33.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.226+0000 7f04d5bf4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04d01393c0 0x7f04d0122140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:33.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.226+0000 7f04d5bf4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d0137a50 con 0x7f04d01393c0 2023-09-30T22:19:33.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.226+0000 7f04d5bf4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d0124490 con 0x7f04d009e950 2023-09-30T22:19:33.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.226+0000 7f04d5bf4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04d0124e70 con 0x7f04d009f260 2023-09-30T22:19:33.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.226+0000 7f04cf7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04d009e950 0x7f04d01216c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:33.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.226+0000 7f04cf7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04d009e950 0x7f04d01216c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52086/0 (socket says 172.21.15.156:52086) 2023-09-30T22:19:33.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.226+0000 7f04cf7fe700 1 -- 172.21.15.156:0/2748088182 learned_addr learned my addr 172.21.15.156:0/2748088182 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:33.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.226+0000 7f04cffff700 1 --2- 172.21.15.156:0/2748088182 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04d01393c0 0x7f04d0122140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:33.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.226+0000 7f04ceffd700 1 --2- 172.21.15.156:0/2748088182 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04d009f260 0x7f04d0121c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:33.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.226+0000 7f04cf7fe700 1 -- 172.21.15.156:0/2748088182 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04d009f260 msgr2=0x7f04d0121c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.226+0000 7f04cf7fe700 1 --2- 172.21.15.156:0/2748088182 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04d009f260 0x7f04d0121c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.226+0000 7f04cf7fe700 1 -- 172.21.15.156:0/2748088182 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04d01393c0 msgr2=0x7f04d0122140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.226+0000 7f04cf7fe700 1 --2- 172.21.15.156:0/2748088182 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04d01393c0 0x7f04d0122140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.226+0000 7f04cf7fe700 1 -- 172.21.15.156:0/2748088182 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c8009a70 con 0x7f04d009e950 2023-09-30T22:19:33.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.227+0000 7f04cf7fe700 1 --2- 172.21.15.156:0/2748088182 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04d009e950 0x7f04d01216c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f04c000e990 tx=0x7f04c000eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:33.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.227+0000 7f04b7fff700 1 -- 172.21.15.156:0/2748088182 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c00096f0 con 0x7f04d009e950 2023-09-30T22:19:33.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.227+0000 7f04b7fff700 1 -- 172.21.15.156:0/2748088182 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c000c690 con 0x7f04d009e950 2023-09-30T22:19:33.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.227+0000 7f04d5bf4700 1 -- 172.21.15.156:0/2748088182 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d009e1f0 con 0x7f04d009e950 2023-09-30T22:19:33.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.227+0000 7f04b7fff700 1 -- 172.21.15.156:0/2748088182 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c000ca00 con 0x7f04d009e950 2023-09-30T22:19:33.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.227+0000 7f04d5bf4700 1 -- 172.21.15.156:0/2748088182 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d0123a40 con 0x7f04d009e950 2023-09-30T22:19:33.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.228+0000 7f04b7fff700 1 -- 172.21.15.156:0/2748088182 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f04c000cb60 con 0x7f04d009e950 2023-09-30T22:19:33.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.228+0000 7f04b7fff700 1 -- 172.21.15.156:0/2748088182 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f04c003fae0 con 0x7f04d009e950 2023-09-30T22:19:33.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.228+0000 7f04d5bf4700 1 -- 172.21.15.156:0/2748088182 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d004f2a0 con 0x7f04d009e950 2023-09-30T22:19:33.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.233+0000 7f04b7fff700 1 -- 172.21.15.156:0/2748088182 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f04c0021080 con 0x7f04d009e950 2023-09-30T22:19:33.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.353+0000 7f04fff13700 1 -- 172.21.15.156:0/2674764374 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f04f806be20 con 0x7f04f809edb0 2023-09-30T22:19:33.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.353+0000 7f04ee7fc700 1 -- 172.21.15.156:0/2674764374 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f04e8018020 con 0x7f04f809edb0 2023-09-30T22:19:33.354 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:33.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.354+0000 7fdde1f96700 1 -- 172.21.15.156:0/4008580736 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdddc09f6e0 con 0x7fdddc09a150 2023-09-30T22:19:33.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.355+0000 7fddc3fff700 1 -- 172.21.15.156:0/4008580736 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdddc09f6e0 con 0x7fdddc09a150 2023-09-30T22:19:33.355 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:33.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.355+0000 7f04fff13700 1 -- 172.21.15.156:0/2674764374 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04f809edb0 msgr2=0x7f04f811ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.355+0000 7f04fff13700 1 --2- 172.21.15.156:0/2674764374 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04f809edb0 0x7f04f811ead0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f04e800c780 tx=0x7f04e800cb40 comp rx=0 tx=0).stop 2023-09-30T22:19:33.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.356+0000 7f04fff13700 1 -- 172.21.15.156:0/2674764374 shutdown_connections 2023-09-30T22:19:33.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.356+0000 7f04fff13700 1 --2- 172.21.15.156:0/2674764374 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04f809f1e0 0x7f04f811f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.356+0000 7f04fff13700 1 --2- 172.21.15.156:0/2674764374 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04f809a130 0x7f04f813fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.356+0000 7f04fff13700 1 --2- 172.21.15.156:0/2674764374 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04f809edb0 0x7f04f811ead0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.356+0000 7f04fff13700 1 -- 172.21.15.156:0/2674764374 >> 172.21.15.156:0/2674764374 conn(0x7f04f80a4430 msgr2=0x7f04f809dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:33.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.356+0000 7f04fff13700 1 -- 172.21.15.156:0/2674764374 shutdown_connections 2023-09-30T22:19:33.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.356+0000 7f04fff13700 1 -- 172.21.15.156:0/2674764374 wait complete. 2023-09-30T22:19:33.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.357+0000 7fdde1f96700 1 -- 172.21.15.156:0/4008580736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdddc09a150 msgr2=0x7fdddc1227e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.357+0000 7fdde1f96700 1 --2- 172.21.15.156:0/4008580736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdddc09a150 0x7fdddc1227e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009ca0 tx=0x7fddcc004750 comp rx=0 tx=0).stop 2023-09-30T22:19:33.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.357+0000 7fdde1f96700 1 -- 172.21.15.156:0/4008580736 shutdown_connections 2023-09-30T22:19:33.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.357+0000 7fdde1f96700 1 --2- 172.21.15.156:0/4008580736 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdddc133c20 0x7fdddc123260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.357+0000 7fdde1f96700 1 --2- 172.21.15.156:0/4008580736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdddc09a150 0x7fdddc1227e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.357+0000 7fdde1f96700 1 --2- 172.21.15.156:0/4008580736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdddc09edb0 0x7fdddc122d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.357+0000 7fdde1f96700 1 -- 172.21.15.156:0/4008580736 >> 172.21.15.156:0/4008580736 conn(0x7fdddc0a4430 msgr2=0x7fdddc09a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:33.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.357+0000 7fdde1f96700 1 -- 172.21.15.156:0/4008580736 shutdown_connections 2023-09-30T22:19:33.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.357+0000 7fdde1f96700 1 -- 172.21.15.156:0/4008580736 wait complete. 2023-09-30T22:19:33.370 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:33.371 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:33.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.397+0000 7f70f1699700 1 -- 172.21.15.156:0/872394177 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f70ec072480 con 0x7f70ec09a730 2023-09-30T22:19:33.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.397+0000 7f70d37fe700 1 -- 172.21.15.156:0/872394177 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f70ec072480 con 0x7f70ec09a730 2023-09-30T22:19:33.398 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:33.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.399+0000 7f70f1699700 1 -- 172.21.15.156:0/872394177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70ec09a730 msgr2=0x7f70ec11c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.399+0000 7f70f1699700 1 --2- 172.21.15.156:0/872394177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70ec09a730 0x7f70ec11c300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f70e0012fc0 tx=0x7f70e00103a0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.399+0000 7f70f1699700 1 -- 172.21.15.156:0/872394177 shutdown_connections 2023-09-30T22:19:33.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.399+0000 7f70f1699700 1 --2- 172.21.15.156:0/872394177 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70ec130890 0x7f70ec11c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.399+0000 7f70f1699700 1 --2- 172.21.15.156:0/872394177 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70ec099e20 0x7f70ec11bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.399+0000 7f70f1699700 1 --2- 172.21.15.156:0/872394177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70ec09a730 0x7f70ec11c300 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.399+0000 7f70f1699700 1 -- 172.21.15.156:0/872394177 >> 172.21.15.156:0/872394177 conn(0x7f70ec0a2980 msgr2=0x7f70ec09fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:33.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.399+0000 7f70f1699700 1 -- 172.21.15.156:0/872394177 shutdown_connections 2023-09-30T22:19:33.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.399+0000 7f70f1699700 1 -- 172.21.15.156:0/872394177 wait complete. 2023-09-30T22:19:33.413 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:33.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.428+0000 7f04d5bf4700 1 -- 172.21.15.156:0/2748088182 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f04d006bbe0 con 0x7f04d009e950 2023-09-30T22:19:33.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.428+0000 7f04b7fff700 1 -- 172.21.15.156:0/2748088182 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f04c0017020 con 0x7f04d009e950 2023-09-30T22:19:33.429 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:33.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.431+0000 7f04d5bf4700 1 -- 172.21.15.156:0/2748088182 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04d009e950 msgr2=0x7f04d01216c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.431+0000 7f04d5bf4700 1 --2- 172.21.15.156:0/2748088182 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04d009e950 0x7f04d01216c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f04c000e990 tx=0x7f04c000eca0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.431+0000 7f04d5bf4700 1 -- 172.21.15.156:0/2748088182 shutdown_connections 2023-09-30T22:19:33.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.431+0000 7f04d5bf4700 1 --2- 172.21.15.156:0/2748088182 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04d01393c0 0x7f04d0122140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.431+0000 7f04d5bf4700 1 --2- 172.21.15.156:0/2748088182 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04d009e950 0x7f04d01216c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.431+0000 7f04d5bf4700 1 --2- 172.21.15.156:0/2748088182 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04d009f260 0x7f04d0121c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:33.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.431+0000 7f04d5bf4700 1 -- 172.21.15.156:0/2748088182 >> 172.21.15.156:0/2748088182 conn(0x7f04d00a0f70 msgr2=0x7f04d0070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:33.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.431+0000 7f04d5bf4700 1 -- 172.21.15.156:0/2748088182 shutdown_connections 2023-09-30T22:19:33.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:33.431+0000 7f04d5bf4700 1 -- 172.21.15.156:0/2748088182 wait complete. 2023-09-30T22:19:33.443 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:34.372 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:34.373 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:34.414 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:34.444 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:34.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.512+0000 7fc4ab59e700 1 Processor -- start 2023-09-30T22:19:34.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.512+0000 7fc4ab59e700 1 -- start start 2023-09-30T22:19:34.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.513+0000 7fc4ab59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4ac070bc0 0x7fc4ac1356a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:34.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.513+0000 7fc4ab59e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc4ac135be0 0x7fc4ac137fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:34.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.513+0000 7fc4ab59e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4ac099d90 con 0x7fc4ac0700e0 2023-09-30T22:19:34.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.513+0000 7fc4ab59e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4ac070fb0 con 0x7fc4ac135be0 2023-09-30T22:19:34.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.513+0000 7fc4ab59e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac09aad0 con 0x7fc4ac070bc0 2023-09-30T22:19:34.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.513+0000 7fc4aad9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc4ac135be0 0x7fc4ac137fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:34.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.513+0000 7fc4aa59c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc4ac0700e0 0x7fc4ac0704b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48430/0 (socket says 172.21.15.156:48430) 2023-09-30T22:19:34.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.513+0000 7fc4aa59c700 1 -- 172.21.15.156:0/2392724611 learned_addr learned my addr 172.21.15.156:0/2392724611 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:34.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.513+0000 7fc4a9d9b700 1 --2- 172.21.15.156:0/2392724611 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4ac070bc0 0x7fc4ac1356a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:34.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.513+0000 7fc4aad9d700 1 -- 172.21.15.156:0/2392724611 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4ac070bc0 msgr2=0x7fc4ac1356a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:34.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.513+0000 7fc4a959a700 1 -- 172.21.15.156:0/2392724611 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328323632 0 0) 0x7fc4ac099d90 con 0x7fc4ac0700e0 2023-09-30T22:19:34.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.513+0000 7fc4aad9d700 1 --2- 172.21.15.156:0/2392724611 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4ac070bc0 0x7fc4ac1356a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.513+0000 7fc4aad9d700 1 -- 172.21.15.156:0/2392724611 >> v1:172.21.15.156:6789/0 conn(0x7fc4ac0700e0 legacy=0x7fc4ac0704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.513+0000 7fc4aad9d700 1 -- 172.21.15.156:0/2392724611 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac06b670 con 0x7fc4ac135be0 2023-09-30T22:19:34.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.514+0000 7fc4aad9d700 1 --2- 172.21.15.156:0/2392724611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4ac135be0 0x7fc4ac137fc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4009dc0 tx=0x7fc4a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803219a4319ca472 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:34.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.514+0000 7fc4a959a700 1 -- 172.21.15.156:0/2392724611 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a400e070 con 0x7fc4ac135be0 2023-09-30T22:19:34.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.514+0000 7fc4a959a700 1 -- 172.21.15.156:0/2392724611 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a400bb90 con 0x7fc4ac135be0 2023-09-30T22:19:34.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.514+0000 7fc4a959a700 1 -- 172.21.15.156:0/2392724611 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4012430 con 0x7fc4ac135be0 2023-09-30T22:19:34.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.515+0000 7fc4ab59e700 1 -- 172.21.15.156:0/2392724611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4ac135be0 msgr2=0x7fc4ac137fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.515+0000 7fc4ab59e700 1 --2- 172.21.15.156:0/2392724611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4ac135be0 0x7fc4ac137fc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4009dc0 tx=0x7fc4a400b330 comp rx=0 tx=0).stop 2023-09-30T22:19:34.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.515+0000 7fc4ab59e700 1 -- 172.21.15.156:0/2392724611 shutdown_connections 2023-09-30T22:19:34.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.515+0000 7fc4ab59e700 1 --2- 172.21.15.156:0/2392724611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4ac135be0 0x7fc4ac137fc0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.515+0000 7fc4ab59e700 1 --2- 172.21.15.156:0/2392724611 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4ac070bc0 0x7fc4ac1356a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.515+0000 7fc4ab59e700 1 -- 172.21.15.156:0/2392724611 >> 172.21.15.156:0/2392724611 conn(0x7fc4ac0a27a0 msgr2=0x7fc4ac0a2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:34.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.515+0000 7fc4ab59e700 1 -- 172.21.15.156:0/2392724611 shutdown_connections 2023-09-30T22:19:34.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.515+0000 7fc4ab59e700 1 -- 172.21.15.156:0/2392724611 wait complete. 2023-09-30T22:19:34.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.516+0000 7fc4ab59e700 1 Processor -- start 2023-09-30T22:19:34.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.516+0000 7fc4ab59e700 1 -- start start 2023-09-30T22:19:34.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.516+0000 7fc4ab59e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4ac0700e0 0x7fc4ac1c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:34.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.516+0000 7fc4ab59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4ac070bc0 0x7fc4ac1c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:34.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.516+0000 7fc4ab59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4ac135be0 0x7fc4ac1c1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:34.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.516+0000 7fc4ab59e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac1357b0 con 0x7fc4ac070bc0 2023-09-30T22:19:34.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.516+0000 7fc4ab59e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac1343f0 con 0x7fc4ac135be0 2023-09-30T22:19:34.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.516+0000 7fc4ab59e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac09fc40 con 0x7fc4ac0700e0 2023-09-30T22:19:34.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.516+0000 7fc4a9d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4ac070bc0 0x7fc4ac1c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:34.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.517+0000 7fc4a9d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4ac070bc0 0x7fc4ac1c52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38510/0 (socket says 172.21.15.156:38510) 2023-09-30T22:19:34.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.517+0000 7fc4a9d9b700 1 -- 172.21.15.156:0/2806722479 learned_addr learned my addr 172.21.15.156:0/2806722479 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:34.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.517+0000 7fc4aa59c700 1 --2- 172.21.15.156:0/2806722479 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4ac0700e0 0x7fc4ac1c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:34.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.517+0000 7fc4aad9d700 1 --2- 172.21.15.156:0/2806722479 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4ac135be0 0x7fc4ac1c1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:34.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.517+0000 7fc4a9d9b700 1 -- 172.21.15.156:0/2806722479 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4ac0700e0 msgr2=0x7fc4ac1c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.517+0000 7fc4a9d9b700 1 --2- 172.21.15.156:0/2806722479 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4ac0700e0 0x7fc4ac1c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.517+0000 7fc4a9d9b700 1 -- 172.21.15.156:0/2806722479 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4ac135be0 msgr2=0x7fc4ac1c1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.517+0000 7fc4a9d9b700 1 --2- 172.21.15.156:0/2806722479 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4ac135be0 0x7fc4ac1c1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.517+0000 7fc4a9d9b700 1 -- 172.21.15.156:0/2806722479 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a4009a70 con 0x7fc4ac070bc0 2023-09-30T22:19:34.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.519+0000 7fc4a9d9b700 1 --2- 172.21.15.156:0/2806722479 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4ac070bc0 0x7fc4ac1c52b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc4a000e840 tx=0x7fc4a000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:34.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.519+0000 7fc49affd700 1 -- 172.21.15.156:0/2806722479 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a0013610 con 0x7fc4ac070bc0 2023-09-30T22:19:34.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.519+0000 7fc49affd700 1 -- 172.21.15.156:0/2806722479 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a0013770 con 0x7fc4ac070bc0 2023-09-30T22:19:34.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.519+0000 7fc4ab59e700 1 -- 172.21.15.156:0/2806722479 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4ac133880 con 0x7fc4ac070bc0 2023-09-30T22:19:34.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.519+0000 7fc49affd700 1 -- 172.21.15.156:0/2806722479 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a0013b20 con 0x7fc4ac070bc0 2023-09-30T22:19:34.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.519+0000 7fc4ab59e700 1 -- 172.21.15.156:0/2806722479 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4ac132a80 con 0x7fc4ac070bc0 2023-09-30T22:19:34.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.520+0000 7fc49affd700 1 -- 172.21.15.156:0/2806722479 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc4a0013c80 con 0x7fc4ac070bc0 2023-09-30T22:19:34.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.520+0000 7fc4ab59e700 1 -- 172.21.15.156:0/2806722479 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4ac04f2a0 con 0x7fc4ac070bc0 2023-09-30T22:19:34.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.520+0000 7fc49affd700 1 -- 172.21.15.156:0/2806722479 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc4a003f360 con 0x7fc4ac070bc0 2023-09-30T22:19:34.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.522+0000 7f629f272700 1 Processor -- start 2023-09-30T22:19:34.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.523+0000 7f629f272700 1 -- start start 2023-09-30T22:19:34.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.523+0000 7f629f272700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62981350d0 0x7f629813ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:34.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.523+0000 7f629f272700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f629813d210 0x7f629813f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:34.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.523+0000 7f629f272700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f629809eca0 con 0x7f629806a770 2023-09-30T22:19:34.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.523+0000 7f629f272700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f629809f720 con 0x7f629813d210 2023-09-30T22:19:34.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.523+0000 7f629f272700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629806b480 con 0x7f62981350d0 2023-09-30T22:19:34.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.523+0000 7f629c80d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62981350d0 0x7f629813ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:34.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.523+0000 7f629c80d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62981350d0 0x7f629813ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52100/0 (socket says 172.21.15.156:52100) 2023-09-30T22:19:34.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.523+0000 7f629c80d700 1 -- 172.21.15.156:0/437697807 learned_addr learned my addr 172.21.15.156:0/437697807 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:34.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.524+0000 7f629c80d700 1 -- 172.21.15.156:0/437697807 >> v2:172.21.15.156:3300/0 conn(0x7f629813d210 msgr2=0x7f629813f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:34.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.524+0000 7f629c80d700 1 --2- 172.21.15.156:0/437697807 >> v2:172.21.15.156:3300/0 conn(0x7f629813d210 0x7f629813f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.524+0000 7f629c80d700 1 -- 172.21.15.156:0/437697807 >> v1:172.21.15.156:6789/0 conn(0x7f629806a770 legacy=0x7f62981349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:34.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.524+0000 7f629c80d700 1 -- 172.21.15.156:0/437697807 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629809b010 con 0x7f62981350d0 2023-09-30T22:19:34.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.524+0000 7f629c80d700 1 --2- 172.21.15.156:0/437697807 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62981350d0 0x7f629813ccd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f62880098f0 tx=0x7f6288009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a42be4466a8283d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:34.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.524+0000 7f628ffff700 1 -- 172.21.15.156:0/437697807 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6288004230 con 0x7f62981350d0 2023-09-30T22:19:34.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.524+0000 7f628ffff700 1 -- 172.21.15.156:0/437697807 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6288004390 con 0x7f62981350d0 2023-09-30T22:19:34.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.524+0000 7f628ffff700 1 -- 172.21.15.156:0/437697807 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62880036a0 con 0x7f62981350d0 2023-09-30T22:19:34.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.525+0000 7f629f272700 1 -- 172.21.15.156:0/437697807 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62981350d0 msgr2=0x7f629813ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.525+0000 7f629f272700 1 --2- 172.21.15.156:0/437697807 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62981350d0 0x7f629813ccd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f62880098f0 tx=0x7f6288009c00 comp rx=0 tx=0).stop 2023-09-30T22:19:34.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.525+0000 7f629f272700 1 -- 172.21.15.156:0/437697807 shutdown_connections 2023-09-30T22:19:34.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.525+0000 7f629f272700 1 --2- 172.21.15.156:0/437697807 >> v2:172.21.15.156:3300/0 conn(0x7f629813d210 0x7f629813f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.525+0000 7f629f272700 1 --2- 172.21.15.156:0/437697807 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62981350d0 0x7f629813ccd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.525+0000 7f629f272700 1 -- 172.21.15.156:0/437697807 >> 172.21.15.156:0/437697807 conn(0x7f6298099c40 msgr2=0x7f62980a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:34.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.525+0000 7f629f272700 1 -- 172.21.15.156:0/437697807 shutdown_connections 2023-09-30T22:19:34.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.525+0000 7f629f272700 1 -- 172.21.15.156:0/437697807 wait complete. 2023-09-30T22:19:34.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.526+0000 7f629f272700 1 Processor -- start 2023-09-30T22:19:34.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.526+0000 7f629f272700 1 -- start start 2023-09-30T22:19:34.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.527+0000 7fc49affd700 1 -- 172.21.15.156:0/2806722479 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc4a00126f0 con 0x7fc4ac070bc0 2023-09-30T22:19:34.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.527+0000 7f629f272700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f629806a770 0x7f629806fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:34.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.527+0000 7f629f272700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62981350d0 0x7f62980702d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:34.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.527+0000 7f629f272700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f629813d210 0x7f6298070810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:34.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.527+0000 7f629f272700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62981341e0 con 0x7f629806a770 2023-09-30T22:19:34.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.527+0000 7f629f272700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6298139860 con 0x7f629813d210 2023-09-30T22:19:34.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.527+0000 7f629f272700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62981391e0 con 0x7f62981350d0 2023-09-30T22:19:34.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.527+0000 7f629c80d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62981350d0 0x7f62980702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:34.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.527+0000 7f629c80d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62981350d0 0x7f62980702d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56090/0 (socket says 172.21.15.156:56090) 2023-09-30T22:19:34.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.527+0000 7f629c80d700 1 -- 172.21.15.156:0/1464254361 learned_addr learned my addr 172.21.15.156:0/1464254361 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:34.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.527+0000 7f629d80f700 1 --2- 172.21.15.156:0/1464254361 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f629813d210 0x7f6298070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:34.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.527+0000 7f629c80d700 1 -- 172.21.15.156:0/1464254361 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f629813d210 msgr2=0x7f6298070810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.528+0000 7f629c80d700 1 --2- 172.21.15.156:0/1464254361 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f629813d210 0x7f6298070810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.528+0000 7f629c80d700 1 -- 172.21.15.156:0/1464254361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f629806a770 msgr2=0x7f629806fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.528+0000 7f629c80d700 1 --2- 172.21.15.156:0/1464254361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f629806a770 0x7f629806fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.528+0000 7f629c80d700 1 -- 172.21.15.156:0/1464254361 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6288009550 con 0x7f62981350d0 2023-09-30T22:19:34.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.528+0000 7f629c80d700 1 --2- 172.21.15.156:0/1464254361 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62981350d0 0x7f62980702d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6288009130 tx=0x7f6288004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:34.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.528+0000 7f628dffb700 1 -- 172.21.15.156:0/1464254361 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628800b660 con 0x7f62981350d0 2023-09-30T22:19:34.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.528+0000 7f628dffb700 1 -- 172.21.15.156:0/1464254361 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628800b7c0 con 0x7f62981350d0 2023-09-30T22:19:34.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.528+0000 7f629f272700 1 -- 172.21.15.156:0/1464254361 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62981394a0 con 0x7f62981350d0 2023-09-30T22:19:34.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.528+0000 7f628dffb700 1 -- 172.21.15.156:0/1464254361 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628800bb70 con 0x7f62981350d0 2023-09-30T22:19:34.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.528+0000 7f629f272700 1 -- 172.21.15.156:0/1464254361 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6298071670 con 0x7f62981350d0 2023-09-30T22:19:34.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.529+0000 7f628dffb700 1 -- 172.21.15.156:0/1464254361 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6288021070 con 0x7f62981350d0 2023-09-30T22:19:34.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.529+0000 7f628dffb700 1 -- 172.21.15.156:0/1464254361 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6288041100 con 0x7f62981350d0 2023-09-30T22:19:34.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.529+0000 7f629f272700 1 -- 172.21.15.156:0/1464254361 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6298139690 con 0x7f62981350d0 2023-09-30T22:19:34.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.539+0000 7f628dffb700 1 -- 172.21.15.156:0/1464254361 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f62880193c0 con 0x7f62981350d0 2023-09-30T22:19:34.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.578+0000 7f1750b6b700 1 Processor -- start 2023-09-30T22:19:34.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.578+0000 7f1750b6b700 1 -- start start 2023-09-30T22:19:34.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.579+0000 7f1750b6b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f174c0a1550 0x7f174c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:34.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.579+0000 7f1750b6b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f174c139200 0x7f174c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:34.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.579+0000 7f1750b6b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f174c09e9d0 con 0x7f174c0a0a70 2023-09-30T22:19:34.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.579+0000 7f1750b6b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174c09dc00 con 0x7f174c139200 2023-09-30T22:19:34.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.579+0000 7f1750b6b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f174c09dec0 con 0x7f174c0a1550 2023-09-30T22:19:34.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.579+0000 7f174a59c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f174c0a0a70 0x7f174c0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48448/0 (socket says 172.21.15.156:48448) 2023-09-30T22:19:34.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.579+0000 7f174a59c700 1 -- 172.21.15.156:0/2169144042 learned_addr learned my addr 172.21.15.156:0/2169144042 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:34.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.579+0000 7f1749d9b700 1 --2- 172.21.15.156:0/2169144042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f174c0a1550 0x7f174c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:34.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.580+0000 7f174ad9d700 1 --2- 172.21.15.156:0/2169144042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f174c139200 0x7f174c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:34.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.580+0000 7f1749d9b700 1 -- 172.21.15.156:0/2169144042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f174c139200 msgr2=0x7f174c13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:34.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.580+0000 7f1749d9b700 1 --2- 172.21.15.156:0/2169144042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f174c139200 0x7f174c13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.580+0000 7f1749d9b700 1 -- 172.21.15.156:0/2169144042 >> v1:172.21.15.156:6789/0 conn(0x7f174c0a0a70 legacy=0x7f174c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.580+0000 7f1749d9b700 1 -- 172.21.15.156:0/2169144042 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174c09e6a0 con 0x7f174c0a1550 2023-09-30T22:19:34.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.580+0000 7f174959a700 1 -- 172.21.15.156:0/2169144042 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4211401013 0 0) 0x7f174c09e9d0 con 0x7f174c0a0a70 2023-09-30T22:19:34.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.580+0000 7f174ad9d700 1 --2- 172.21.15.156:0/2169144042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f174c139200 0x7f174c13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:34.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.580+0000 7f1749d9b700 1 --2- 172.21.15.156:0/2169144042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f174c0a1550 0x7f174c138cc0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1740009870 tx=0x7f1740009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8add6d1df2da3ea8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:34.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.580+0000 7f174959a700 1 -- 172.21.15.156:0/2169144042 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740011830 con 0x7f174c0a1550 2023-09-30T22:19:34.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.580+0000 7f174959a700 1 -- 172.21.15.156:0/2169144042 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1740011990 con 0x7f174c0a1550 2023-09-30T22:19:34.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.580+0000 7f174959a700 1 -- 172.21.15.156:0/2169144042 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740011d20 con 0x7f174c0a1550 2023-09-30T22:19:34.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.581+0000 7f1750b6b700 1 -- 172.21.15.156:0/2169144042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f174c0a1550 msgr2=0x7f174c138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.581+0000 7f1750b6b700 1 --2- 172.21.15.156:0/2169144042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f174c0a1550 0x7f174c138cc0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1740009870 tx=0x7f1740009b80 comp rx=0 tx=0).stop 2023-09-30T22:19:34.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.581+0000 7f1750b6b700 1 -- 172.21.15.156:0/2169144042 shutdown_connections 2023-09-30T22:19:34.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.581+0000 7f1750b6b700 1 --2- 172.21.15.156:0/2169144042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f174c139200 0x7f174c13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.581+0000 7f1750b6b700 1 --2- 172.21.15.156:0/2169144042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f174c0a1550 0x7f174c138cc0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.581+0000 7f1750b6b700 1 -- 172.21.15.156:0/2169144042 >> 172.21.15.156:0/2169144042 conn(0x7f174c0a6610 msgr2=0x7f174c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:34.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.581+0000 7f1750b6b700 1 -- 172.21.15.156:0/2169144042 shutdown_connections 2023-09-30T22:19:34.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.581+0000 7f1750b6b700 1 -- 172.21.15.156:0/2169144042 wait complete. 2023-09-30T22:19:34.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.583+0000 7f1750b6b700 1 Processor -- start 2023-09-30T22:19:34.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.583+0000 7f1750b6b700 1 -- start start 2023-09-30T22:19:34.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.583+0000 7f1750b6b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f174c0a0a70 0x7f174c11e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:34.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.583+0000 7f1750b6b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f174c0a1550 0x7f174c11ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:34.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.583+0000 7f1750b6b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f174c139200 0x7f174c11f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:34.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.583+0000 7f1750b6b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c133fd0 con 0x7f174c0a1550 2023-09-30T22:19:34.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.583+0000 7f1750b6b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174c1345b0 con 0x7f174c139200 2023-09-30T22:19:34.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.583+0000 7f1750b6b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f174c0a5100 con 0x7f174c0a0a70 2023-09-30T22:19:34.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.584+0000 7f174a59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f174c0a0a70 0x7f174c11e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:34.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.584+0000 7f174a59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f174c0a0a70 0x7f174c11e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56104/0 (socket says 172.21.15.156:56104) 2023-09-30T22:19:34.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.584+0000 7f174a59c700 1 -- 172.21.15.156:0/449285267 learned_addr learned my addr 172.21.15.156:0/449285267 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:34.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.584+0000 7f1749d9b700 1 --2- 172.21.15.156:0/449285267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f174c0a1550 0x7f174c11ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:34.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.584+0000 7f174ad9d700 1 --2- 172.21.15.156:0/449285267 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f174c139200 0x7f174c11f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:34.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.584+0000 7f1749d9b700 1 -- 172.21.15.156:0/449285267 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f174c0a0a70 msgr2=0x7f174c11e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.584+0000 7f1749d9b700 1 --2- 172.21.15.156:0/449285267 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f174c0a0a70 0x7f174c11e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.584+0000 7f1749d9b700 1 -- 172.21.15.156:0/449285267 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f174c139200 msgr2=0x7f174c11f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.584+0000 7f1749d9b700 1 --2- 172.21.15.156:0/449285267 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f174c139200 0x7f174c11f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.584+0000 7f1749d9b700 1 -- 172.21.15.156:0/449285267 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1744009a70 con 0x7f174c0a1550 2023-09-30T22:19:34.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.584+0000 7f174ad9d700 1 --2- 172.21.15.156:0/449285267 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f174c139200 0x7f174c11f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:19:34.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.584+0000 7f1749d9b700 1 --2- 172.21.15.156:0/449285267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f174c0a1550 0x7f174c11ec00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1740016000 tx=0x7f1740004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:34.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.584+0000 7f173affd700 1 -- 172.21.15.156:0/449285267 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740004590 con 0x7f174c0a1550 2023-09-30T22:19:34.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.584+0000 7f173affd700 1 -- 172.21.15.156:0/449285267 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174001f070 con 0x7f174c0a1550 2023-09-30T22:19:34.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.584+0000 7f1750b6b700 1 -- 172.21.15.156:0/449285267 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17400094a0 con 0x7f174c0a1550 2023-09-30T22:19:34.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.584+0000 7f173affd700 1 -- 172.21.15.156:0/449285267 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17400038a0 con 0x7f174c0a1550 2023-09-30T22:19:34.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.585+0000 7f1750b6b700 1 -- 172.21.15.156:0/449285267 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f174c120b30 con 0x7f174c0a1550 2023-09-30T22:19:34.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.585+0000 7f173affd700 1 -- 172.21.15.156:0/449285267 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1740003a00 con 0x7f174c0a1550 2023-09-30T22:19:34.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.585+0000 7f173affd700 1 -- 172.21.15.156:0/449285267 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1740021070 con 0x7f174c0a1550 2023-09-30T22:19:34.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.586+0000 7f1750b6b700 1 -- 172.21.15.156:0/449285267 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f174c0a0440 con 0x7f174c0a1550 2023-09-30T22:19:34.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.594+0000 7f173affd700 1 -- 172.21.15.156:0/449285267 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1740015020 con 0x7f174c0a1550 2023-09-30T22:19:34.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.612+0000 7fd475a86700 1 Processor -- start 2023-09-30T22:19:34.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.613+0000 7fd475a86700 1 -- start start 2023-09-30T22:19:34.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.613+0000 7fd475a86700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4700a0a30 0x7fd4700a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:34.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.613+0000 7fd475a86700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd470130670 0x7fd4701381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:34.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.613+0000 7fd475a86700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4700a1e70 con 0x7fd4700a1340 2023-09-30T22:19:34.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.613+0000 7fd475a86700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd47009a720 con 0x7fd470130670 2023-09-30T22:19:34.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.613+0000 7fd475a86700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd47009b300 con 0x7fd4700a0a30 2023-09-30T22:19:34.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.614+0000 7fd46ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd470130670 0x7fd4701381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:34.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.614+0000 7fd46ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd470130670 0x7fd4701381c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38544/0 (socket says 172.21.15.156:38544) 2023-09-30T22:19:34.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.614+0000 7fd46ffff700 1 -- 172.21.15.156:0/1345363520 learned_addr learned my addr 172.21.15.156:0/1345363520 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:34.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.614+0000 7fd46f7fe700 1 --2- 172.21.15.156:0/1345363520 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4700a0a30 0x7fd4700a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:34.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.614+0000 7fd46ffff700 1 -- 172.21.15.156:0/1345363520 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4700a0a30 msgr2=0x7fd4700a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:34.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.614+0000 7fd46ffff700 1 --2- 172.21.15.156:0/1345363520 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4700a0a30 0x7fd4700a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.614+0000 7fd46ffff700 1 -- 172.21.15.156:0/1345363520 >> v1:172.21.15.156:6789/0 conn(0x7fd4700a1340 legacy=0x7fd47012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.614+0000 7fd46e7fc700 1 -- 172.21.15.156:0/1345363520 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544510460 0 0) 0x7fd4700a1e70 con 0x7fd4700a1340 2023-09-30T22:19:34.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.614+0000 7fd46ffff700 1 -- 172.21.15.156:0/1345363520 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47009abc0 con 0x7fd470130670 2023-09-30T22:19:34.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.614+0000 7fd46f7fe700 1 --2- 172.21.15.156:0/1345363520 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4700a0a30 0x7fd4700a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:34.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.614+0000 7fd46ffff700 1 --2- 172.21.15.156:0/1345363520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd470130670 0x7fd4701381c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd46800d150 tx=0x7fd46800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10877eb91d039f15 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:34.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.614+0000 7fd46e7fc700 1 -- 172.21.15.156:0/1345363520 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd468010070 con 0x7fd470130670 2023-09-30T22:19:34.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.614+0000 7fd46e7fc700 1 -- 172.21.15.156:0/1345363520 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46800db00 con 0x7fd470130670 2023-09-30T22:19:34.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.614+0000 7fd46e7fc700 1 -- 172.21.15.156:0/1345363520 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd468016400 con 0x7fd470130670 2023-09-30T22:19:34.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.615+0000 7fd475a86700 1 -- 172.21.15.156:0/1345363520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd470130670 msgr2=0x7fd4701381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.615+0000 7fd475a86700 1 --2- 172.21.15.156:0/1345363520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd470130670 0x7fd4701381c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd46800d150 tx=0x7fd46800d460 comp rx=0 tx=0).stop 2023-09-30T22:19:34.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.615+0000 7fd475a86700 1 -- 172.21.15.156:0/1345363520 shutdown_connections 2023-09-30T22:19:34.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.615+0000 7fd475a86700 1 --2- 172.21.15.156:0/1345363520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd470130670 0x7fd4701381c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.615+0000 7fd475a86700 1 --2- 172.21.15.156:0/1345363520 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4700a0a30 0x7fd4700a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.615+0000 7fd475a86700 1 -- 172.21.15.156:0/1345363520 >> 172.21.15.156:0/1345363520 conn(0x7fd4700a2980 msgr2=0x7fd4700a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:34.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.615+0000 7fd475a86700 1 -- 172.21.15.156:0/1345363520 shutdown_connections 2023-09-30T22:19:34.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.615+0000 7fd475a86700 1 -- 172.21.15.156:0/1345363520 wait complete. 2023-09-30T22:19:34.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.616+0000 7fd475a86700 1 Processor -- start 2023-09-30T22:19:34.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.616+0000 7fd475a86700 1 -- start start 2023-09-30T22:19:34.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.616+0000 7fd475a86700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4700a0a30 0x7fd4701c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:34.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.616+0000 7fd475a86700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4700a1340 0x7fd4701c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:34.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.617+0000 7fd475a86700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd470130670 0x7fd4701c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:34.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.617+0000 7fd475a86700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47011cb00 con 0x7fd470130670 2023-09-30T22:19:34.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.617+0000 7fd475a86700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd47012fac0 con 0x7fd4700a1340 2023-09-30T22:19:34.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.617+0000 7fd475a86700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd47009fb10 con 0x7fd4700a0a30 2023-09-30T22:19:34.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.617+0000 7fd46f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4700a0a30 0x7fd4701c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:34.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.617+0000 7fd46ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd470130670 0x7fd4701c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:34.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.617+0000 7fd46f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4700a0a30 0x7fd4701c3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56126/0 (socket says 172.21.15.156:56126) 2023-09-30T22:19:34.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.617+0000 7fd46f7fe700 1 -- 172.21.15.156:0/3623632738 learned_addr learned my addr 172.21.15.156:0/3623632738 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:34.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.617+0000 7fd46effd700 1 --2- 172.21.15.156:0/3623632738 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4700a1340 0x7fd4701c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:34.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.617+0000 7fd46f7fe700 1 -- 172.21.15.156:0/3623632738 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4700a1340 msgr2=0x7fd4701c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.617+0000 7fd46f7fe700 1 --2- 172.21.15.156:0/3623632738 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4700a1340 0x7fd4701c41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.617+0000 7fd46f7fe700 1 -- 172.21.15.156:0/3623632738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd470130670 msgr2=0x7fd4701c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.617+0000 7fd46f7fe700 1 --2- 172.21.15.156:0/3623632738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd470130670 0x7fd4701c4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.617+0000 7fd46f7fe700 1 -- 172.21.15.156:0/3623632738 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd460009430 con 0x7fd4700a0a30 2023-09-30T22:19:34.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.617+0000 7fd46ffff700 1 --2- 172.21.15.156:0/3623632738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd470130670 0x7fd4701c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:34.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.617+0000 7fd46f7fe700 1 --2- 172.21.15.156:0/3623632738 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4700a0a30 0x7fd4701c3ca0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd46000ec10 tx=0x7fd46000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:34.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.617+0000 7fd457fff700 1 -- 172.21.15.156:0/3623632738 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd460005a20 con 0x7fd4700a0a30 2023-09-30T22:19:34.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.617+0000 7fd457fff700 1 -- 172.21.15.156:0/3623632738 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd460005b80 con 0x7fd4700a0a30 2023-09-30T22:19:34.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.617+0000 7fd475a86700 1 -- 172.21.15.156:0/3623632738 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd46800bd40 con 0x7fd4700a0a30 2023-09-30T22:19:34.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.617+0000 7fd457fff700 1 -- 172.21.15.156:0/3623632738 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46000c910 con 0x7fd4700a0a30 2023-09-30T22:19:34.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.618+0000 7fd475a86700 1 -- 172.21.15.156:0/3623632738 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd47011e470 con 0x7fd4700a0a30 2023-09-30T22:19:34.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.618+0000 7fd457fff700 1 -- 172.21.15.156:0/3623632738 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd46000ca70 con 0x7fd4700a0a30 2023-09-30T22:19:34.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.619+0000 7fd457fff700 1 -- 172.21.15.156:0/3623632738 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd46003fa70 con 0x7fd4700a0a30 2023-09-30T22:19:34.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.619+0000 7fd475a86700 1 -- 172.21.15.156:0/3623632738 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd47004f2a0 con 0x7fd4700a0a30 2023-09-30T22:19:34.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.624+0000 7fd457fff700 1 -- 172.21.15.156:0/3623632738 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd460011b40 con 0x7fd4700a0a30 2023-09-30T22:19:34.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.728+0000 7fc4ab59e700 1 -- 172.21.15.156:0/2806722479 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc4ac06b930 con 0x7fc4ac070bc0 2023-09-30T22:19:34.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.728+0000 7fc49affd700 1 -- 172.21.15.156:0/2806722479 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc4a0021070 con 0x7fc4ac070bc0 2023-09-30T22:19:34.729 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:34.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.731+0000 7fc4ab59e700 1 -- 172.21.15.156:0/2806722479 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4ac070bc0 msgr2=0x7fc4ac1c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.731+0000 7fc4ab59e700 1 --2- 172.21.15.156:0/2806722479 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4ac070bc0 0x7fc4ac1c52b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc4a000e840 tx=0x7fc4a000eb50 comp rx=0 tx=0).stop 2023-09-30T22:19:34.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.731+0000 7fc4ab59e700 1 -- 172.21.15.156:0/2806722479 shutdown_connections 2023-09-30T22:19:34.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.731+0000 7fc4ab59e700 1 --2- 172.21.15.156:0/2806722479 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4ac135be0 0x7fc4ac1c1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.731+0000 7fc4ab59e700 1 --2- 172.21.15.156:0/2806722479 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4ac0700e0 0x7fc4ac1c4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.731+0000 7fc4ab59e700 1 --2- 172.21.15.156:0/2806722479 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4ac070bc0 0x7fc4ac1c52b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.731+0000 7fc4ab59e700 1 -- 172.21.15.156:0/2806722479 >> 172.21.15.156:0/2806722479 conn(0x7fc4ac0a27a0 msgr2=0x7fc4ac0a04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:34.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.731+0000 7fc4ab59e700 1 -- 172.21.15.156:0/2806722479 shutdown_connections 2023-09-30T22:19:34.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.731+0000 7fc4ab59e700 1 -- 172.21.15.156:0/2806722479 wait complete. 2023-09-30T22:19:34.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:34.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.797+0000 7f629f272700 1 -- 172.21.15.156:0/1464254361 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f629804f2a0 con 0x7f62981350d0 2023-09-30T22:19:34.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.797+0000 7f628dffb700 1 -- 172.21.15.156:0/1464254361 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f628802dd40 con 0x7f62981350d0 2023-09-30T22:19:34.798 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:34.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.800+0000 7f629f272700 1 -- 172.21.15.156:0/1464254361 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62981350d0 msgr2=0x7f62980702d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.800+0000 7f629f272700 1 --2- 172.21.15.156:0/1464254361 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62981350d0 0x7f62980702d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6288009130 tx=0x7f6288004750 comp rx=0 tx=0).stop 2023-09-30T22:19:34.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.800+0000 7f629f272700 1 -- 172.21.15.156:0/1464254361 shutdown_connections 2023-09-30T22:19:34.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.800+0000 7f629f272700 1 --2- 172.21.15.156:0/1464254361 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f629813d210 0x7f6298070810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.800+0000 7f629f272700 1 --2- 172.21.15.156:0/1464254361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f629806a770 0x7f629806fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.800+0000 7f629f272700 1 --2- 172.21.15.156:0/1464254361 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62981350d0 0x7f62980702d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.800+0000 7f629f272700 1 -- 172.21.15.156:0/1464254361 >> 172.21.15.156:0/1464254361 conn(0x7f6298099c40 msgr2=0x7f629813e200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:34.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.800+0000 7f629f272700 1 -- 172.21.15.156:0/1464254361 shutdown_connections 2023-09-30T22:19:34.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.800+0000 7f629f272700 1 -- 172.21.15.156:0/1464254361 wait complete. 2023-09-30T22:19:34.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:34.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.821+0000 7fd475a86700 1 -- 172.21.15.156:0/3623632738 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd47011d2f0 con 0x7fd4700a0a30 2023-09-30T22:19:34.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.821+0000 7fd457fff700 1 -- 172.21.15.156:0/3623632738 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd46002a090 con 0x7fd4700a0a30 2023-09-30T22:19:34.822 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:34.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.823+0000 7fd475a86700 1 -- 172.21.15.156:0/3623632738 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4700a0a30 msgr2=0x7fd4701c3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.823+0000 7fd475a86700 1 --2- 172.21.15.156:0/3623632738 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4700a0a30 0x7fd4701c3ca0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd46000ec10 tx=0x7fd46000ef20 comp rx=0 tx=0).stop 2023-09-30T22:19:34.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.823+0000 7fd475a86700 1 -- 172.21.15.156:0/3623632738 shutdown_connections 2023-09-30T22:19:34.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.823+0000 7fd475a86700 1 --2- 172.21.15.156:0/3623632738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd470130670 0x7fd4701c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.823+0000 7fd475a86700 1 --2- 172.21.15.156:0/3623632738 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4700a0a30 0x7fd4701c3ca0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.823+0000 7fd475a86700 1 --2- 172.21.15.156:0/3623632738 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4700a1340 0x7fd4701c41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.823+0000 7fd475a86700 1 -- 172.21.15.156:0/3623632738 >> 172.21.15.156:0/3623632738 conn(0x7fd4700a2980 msgr2=0x7fd4701b7880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:34.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.823+0000 7fd475a86700 1 -- 172.21.15.156:0/3623632738 shutdown_connections 2023-09-30T22:19:34.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.823+0000 7fd475a86700 1 -- 172.21.15.156:0/3623632738 wait complete. 2023-09-30T22:19:34.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.825+0000 7f1750b6b700 1 -- 172.21.15.156:0/449285267 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f174c04f2a0 con 0x7f174c0a1550 2023-09-30T22:19:34.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.825+0000 7f173affd700 1 -- 172.21.15.156:0/449285267 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1740034070 con 0x7f174c0a1550 2023-09-30T22:19:34.826 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:34.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.827+0000 7f1750b6b700 1 -- 172.21.15.156:0/449285267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f174c0a1550 msgr2=0x7f174c11ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.827+0000 7f1750b6b700 1 --2- 172.21.15.156:0/449285267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f174c0a1550 0x7f174c11ec00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1740016000 tx=0x7f1740004750 comp rx=0 tx=0).stop 2023-09-30T22:19:34.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.827+0000 7f1750b6b700 1 -- 172.21.15.156:0/449285267 shutdown_connections 2023-09-30T22:19:34.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.827+0000 7f1750b6b700 1 --2- 172.21.15.156:0/449285267 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f174c139200 0x7f174c11f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.827+0000 7f1750b6b700 1 --2- 172.21.15.156:0/449285267 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f174c0a0a70 0x7f174c11e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.827+0000 7f1750b6b700 1 --2- 172.21.15.156:0/449285267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f174c0a1550 0x7f174c11ec00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:34.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.827+0000 7f1750b6b700 1 -- 172.21.15.156:0/449285267 >> 172.21.15.156:0/449285267 conn(0x7f174c0a6610 msgr2=0x7f174c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:34.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.827+0000 7f1750b6b700 1 -- 172.21.15.156:0/449285267 shutdown_connections 2023-09-30T22:19:34.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:34.827+0000 7f1750b6b700 1 -- 172.21.15.156:0/449285267 wait complete. 2023-09-30T22:19:34.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:34.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:35.749 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:35.813 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:35.838 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:35.842 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:35.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.900+0000 7fb5d868f700 1 Processor -- start 2023-09-30T22:19:35.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.900+0000 7fb5d868f700 1 -- start start 2023-09-30T22:19:35.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.901+0000 7fb5d868f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb5d0136960 0x7fb5d0138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:35.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.901+0000 7fb5d868f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb5d0139280 0x7fb5d013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:35.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.901+0000 7fb5d868f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d006b2d0 con 0x7fb5d0133ad0 2023-09-30T22:19:35.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.901+0000 7fb5d868f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5d01345b0 con 0x7fb5d0136960 2023-09-30T22:19:35.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.901+0000 7fb5d868f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d0133610 con 0x7fb5d0139280 2023-09-30T22:19:35.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.901+0000 7fb5d5c2a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb5d0136960 0x7fb5d0138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:35.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.901+0000 7fb5d642b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb5d0133ad0 0x7fb5d0133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48472/0 (socket says 172.21.15.156:48472) 2023-09-30T22:19:35.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.901+0000 7fb5d642b700 1 -- 172.21.15.156:0/3030457950 learned_addr learned my addr 172.21.15.156:0/3030457950 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:35.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.901+0000 7fb5d6c2c700 1 --2- 172.21.15.156:0/3030457950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb5d0139280 0x7fb5d013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:35.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.901+0000 7fb5d5c2a700 1 -- 172.21.15.156:0/3030457950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb5d0139280 msgr2=0x7fb5d013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:35.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.901+0000 7fb5d5c2a700 1 --2- 172.21.15.156:0/3030457950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb5d0139280 0x7fb5d013b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:35.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.901+0000 7fb5d5c2a700 1 -- 172.21.15.156:0/3030457950 >> v1:172.21.15.156:6789/0 conn(0x7fb5d0133ad0 legacy=0x7fb5d0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:35.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.901+0000 7fb5d5c2a700 1 -- 172.21.15.156:0/3030457950 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d009a500 con 0x7fb5d0136960 2023-09-30T22:19:35.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.902+0000 7fb5d5c2a700 1 --2- 172.21.15.156:0/3030457950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5d0136960 0x7fb5d0138d40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0009840 tx=0x7fb5c0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c7e8afffdb58ce1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:35.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.902+0000 7fb5d5429700 1 -- 172.21.15.156:0/3030457950 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0011830 con 0x7fb5d0136960 2023-09-30T22:19:35.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.902+0000 7fb5d5429700 1 -- 172.21.15.156:0/3030457950 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c0011990 con 0x7fb5d0136960 2023-09-30T22:19:35.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.902+0000 7fb5d5429700 1 -- 172.21.15.156:0/3030457950 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0011d20 con 0x7fb5d0136960 2023-09-30T22:19:35.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.903+0000 7fb5d868f700 1 -- 172.21.15.156:0/3030457950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5d0136960 msgr2=0x7fb5d0138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:35.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.903+0000 7fb5d868f700 1 --2- 172.21.15.156:0/3030457950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5d0136960 0x7fb5d0138d40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0009840 tx=0x7fb5c0009b50 comp rx=0 tx=0).stop 2023-09-30T22:19:35.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.903+0000 7fb5d868f700 1 -- 172.21.15.156:0/3030457950 shutdown_connections 2023-09-30T22:19:35.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.903+0000 7fb5d868f700 1 --2- 172.21.15.156:0/3030457950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb5d0139280 0x7fb5d013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:35.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.903+0000 7fb5d868f700 1 --2- 172.21.15.156:0/3030457950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5d0136960 0x7fb5d0138d40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:35.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.903+0000 7fb5d868f700 1 -- 172.21.15.156:0/3030457950 >> 172.21.15.156:0/3030457950 conn(0x7fb5d0099c40 msgr2=0x7fb5d00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:35.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.903+0000 7fb5d868f700 1 -- 172.21.15.156:0/3030457950 shutdown_connections 2023-09-30T22:19:35.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.903+0000 7fb5d868f700 1 -- 172.21.15.156:0/3030457950 wait complete. 2023-09-30T22:19:35.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.904+0000 7fb5d868f700 1 Processor -- start 2023-09-30T22:19:35.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.904+0000 7fb5d868f700 1 -- start start 2023-09-30T22:19:35.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.905+0000 7fb5d868f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb5d0133ad0 0x7fb5d012f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:35.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.905+0000 7fb5d868f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5d0136960 0x7fb5d012fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:35.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.905+0000 7fb5d868f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb5d0139280 0x7fb5d01c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:35.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.905+0000 7fb5d868f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d0070370 con 0x7fb5d0136960 2023-09-30T22:19:35.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.905+0000 7fb5d868f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d0131730 con 0x7fb5d0133ad0 2023-09-30T22:19:35.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.905+0000 7fb5d868f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d006fe40 con 0x7fb5d0139280 2023-09-30T22:19:35.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.905+0000 7fb5d5c2a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5d0136960 0x7fb5d012fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:35.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.905+0000 7fb5d5c2a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5d0136960 0x7fb5d012fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38572/0 (socket says 172.21.15.156:38572) 2023-09-30T22:19:35.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.905+0000 7fb5d6c2c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb5d0139280 0x7fb5d01c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:35.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.905+0000 7fb5d5c2a700 1 -- 172.21.15.156:0/2951007738 learned_addr learned my addr 172.21.15.156:0/2951007738 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:35.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.905+0000 7fb5d642b700 1 --2- 172.21.15.156:0/2951007738 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb5d0133ad0 0x7fb5d012f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:35.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.906+0000 7fb5d6c2c700 1 -- 172.21.15.156:0/2951007738 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb5d0133ad0 msgr2=0x7fb5d012f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:35.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.906+0000 7fb5d6c2c700 1 --2- 172.21.15.156:0/2951007738 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb5d0133ad0 0x7fb5d012f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:35.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.906+0000 7fb5d6c2c700 1 -- 172.21.15.156:0/2951007738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5d0136960 msgr2=0x7fb5d012fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:35.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.906+0000 7fb5d6c2c700 1 --2- 172.21.15.156:0/2951007738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5d0136960 0x7fb5d012fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:35.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.906+0000 7fb5d6c2c700 1 -- 172.21.15.156:0/2951007738 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c00094a0 con 0x7fb5d0139280 2023-09-30T22:19:35.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.906+0000 7fb5d5c2a700 1 --2- 172.21.15.156:0/2951007738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5d0136960 0x7fb5d012fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:35.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.906+0000 7fb5d6c2c700 1 --2- 172.21.15.156:0/2951007738 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb5d0139280 0x7fb5d01c8570 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb5d006c710 tx=0x7fb5c800ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:35.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.906+0000 7fb5c6ffd700 1 -- 172.21.15.156:0/2951007738 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c800ccd0 con 0x7fb5d0139280 2023-09-30T22:19:35.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.906+0000 7fb5c6ffd700 1 -- 172.21.15.156:0/2951007738 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c800f040 con 0x7fb5d0139280 2023-09-30T22:19:35.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.906+0000 7fb5d868f700 1 -- 172.21.15.156:0/2951007738 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d006ef30 con 0x7fb5d0139280 2023-09-30T22:19:35.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.906+0000 7fb5c6ffd700 1 -- 172.21.15.156:0/2951007738 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c80146c0 con 0x7fb5d0139280 2023-09-30T22:19:35.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.906+0000 7fb5d868f700 1 -- 172.21.15.156:0/2951007738 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d0130240 con 0x7fb5d0139280 2023-09-30T22:19:35.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.907+0000 7fb5c6ffd700 1 -- 172.21.15.156:0/2951007738 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb5c8014820 con 0x7fb5d0139280 2023-09-30T22:19:35.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.907+0000 7fb5c6ffd700 1 -- 172.21.15.156:0/2951007738 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb5c8040200 con 0x7fb5d0139280 2023-09-30T22:19:35.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.908+0000 7fb5d868f700 1 -- 172.21.15.156:0/2951007738 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5d00701b0 con 0x7fb5d0139280 2023-09-30T22:19:35.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.916+0000 7fb5c6ffd700 1 -- 172.21.15.156:0/2951007738 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb5c8018080 con 0x7fb5d0139280 2023-09-30T22:19:35.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.955+0000 7fe4c96a2700 1 Processor -- start 2023-09-30T22:19:35.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.955+0000 7fe4c96a2700 1 -- start start 2023-09-30T22:19:35.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.955+0000 7fe4c96a2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4c4138040 0x7fe4c4138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:35.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.955+0000 7fe4c96a2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4c40a1400 0x7fe4c413fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:35.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.955+0000 7fe4c96a2700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4c41379e0 con 0x7fe4c40a08e0 2023-09-30T22:19:35.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.955+0000 7fe4c96a2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c40a2100 con 0x7fe4c40a1400 2023-09-30T22:19:35.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.955+0000 7fe4c96a2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c4138950 con 0x7fe4c4138040 2023-09-30T22:19:35.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.956+0000 7fe4c27fc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe4c40a08e0 0x7fe4c40a0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48486/0 (socket says 172.21.15.156:48486) 2023-09-30T22:19:35.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.956+0000 7fe4c27fc700 1 -- 172.21.15.156:0/2842624160 learned_addr learned my addr 172.21.15.156:0/2842624160 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:35.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.956+0000 7fe4c2ffd700 1 --2- 172.21.15.156:0/2842624160 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4c4138040 0x7fe4c4138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:35.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.956+0000 7fe4c37fe700 1 --2- 172.21.15.156:0/2842624160 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4c40a1400 0x7fe4c413fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:35.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.956+0000 7fe4c2ffd700 1 -- 172.21.15.156:0/2842624160 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4c40a1400 msgr2=0x7fe4c413fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:35.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.956+0000 7fe4c2ffd700 1 --2- 172.21.15.156:0/2842624160 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4c40a1400 0x7fe4c413fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:35.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.956+0000 7fe4c2ffd700 1 -- 172.21.15.156:0/2842624160 >> v1:172.21.15.156:6789/0 conn(0x7fe4c40a08e0 legacy=0x7fe4c40a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:35.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.956+0000 7fe4c1ffb700 1 -- 172.21.15.156:0/2842624160 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1202726623 0 0) 0x7fe4c41379e0 con 0x7fe4c40a08e0 2023-09-30T22:19:35.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.956+0000 7fe4c2ffd700 1 -- 172.21.15.156:0/2842624160 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c409b9b0 con 0x7fe4c4138040 2023-09-30T22:19:35.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.956+0000 7fe4c2ffd700 1 --2- 172.21.15.156:0/2842624160 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4c4138040 0x7fe4c4138410 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4009880 tx=0x7fe4b4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd10b9037585b8c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:35.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.956+0000 7fe4c1ffb700 1 -- 172.21.15.156:0/2842624160 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4005e30 con 0x7fe4c4138040 2023-09-30T22:19:35.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.956+0000 7fe4c1ffb700 1 -- 172.21.15.156:0/2842624160 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b4006030 con 0x7fe4c4138040 2023-09-30T22:19:35.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.956+0000 7fe4c1ffb700 1 -- 172.21.15.156:0/2842624160 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b40063c0 con 0x7fe4c4138040 2023-09-30T22:19:35.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.957+0000 7fe4c96a2700 1 -- 172.21.15.156:0/2842624160 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4c4138040 msgr2=0x7fe4c4138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:35.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.957+0000 7fe4c96a2700 1 --2- 172.21.15.156:0/2842624160 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4c4138040 0x7fe4c4138410 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4009880 tx=0x7fe4b4009b90 comp rx=0 tx=0).stop 2023-09-30T22:19:35.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.957+0000 7fe4c96a2700 1 -- 172.21.15.156:0/2842624160 shutdown_connections 2023-09-30T22:19:35.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.957+0000 7fe4c96a2700 1 --2- 172.21.15.156:0/2842624160 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4c40a1400 0x7fe4c413fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:35.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.957+0000 7fe4c96a2700 1 --2- 172.21.15.156:0/2842624160 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4c4138040 0x7fe4c4138410 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:35.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.957+0000 7fe4c96a2700 1 -- 172.21.15.156:0/2842624160 >> 172.21.15.156:0/2842624160 conn(0x7fe4c40a2980 msgr2=0x7fe4c40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:35.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.957+0000 7fe4c96a2700 1 -- 172.21.15.156:0/2842624160 shutdown_connections 2023-09-30T22:19:35.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.957+0000 7fe4c96a2700 1 -- 172.21.15.156:0/2842624160 wait complete. 2023-09-30T22:19:35.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.958+0000 7fe4c96a2700 1 Processor -- start 2023-09-30T22:19:35.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.958+0000 7fe4c96a2700 1 -- start start 2023-09-30T22:19:35.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.959+0000 7fe4c96a2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4c40a08e0 0x7fe4c4126210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:35.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.959+0000 7fe4c96a2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4c40a1400 0x7fe4c4126750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:35.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.959+0000 7fe4c96a2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4c4138040 0x7fe4c4126c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:35.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.959+0000 7fe4c96a2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c4127fa0 con 0x7fe4c40a08e0 2023-09-30T22:19:35.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.959+0000 7fe4c96a2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c4128cb0 con 0x7fe4c4138040 2023-09-30T22:19:35.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.959+0000 7fe4c96a2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c4129070 con 0x7fe4c40a1400 2023-09-30T22:19:35.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.959+0000 7fe4c2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4c40a08e0 0x7fe4c4126210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:35.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.959+0000 7fe4c2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4c40a08e0 0x7fe4c4126210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38580/0 (socket says 172.21.15.156:38580) 2023-09-30T22:19:35.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.959+0000 7fe4c2ffd700 1 -- 172.21.15.156:0/1589422365 learned_addr learned my addr 172.21.15.156:0/1589422365 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:35.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.959+0000 7fe4c27fc700 1 --2- 172.21.15.156:0/1589422365 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4c40a1400 0x7fe4c4126750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:35.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.959+0000 7fe4c37fe700 1 --2- 172.21.15.156:0/1589422365 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4c4138040 0x7fe4c4126c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:35.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.959+0000 7fe4c27fc700 1 -- 172.21.15.156:0/1589422365 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4c4138040 msgr2=0x7fe4c4126c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:35.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.959+0000 7fe4c27fc700 1 --2- 172.21.15.156:0/1589422365 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4c4138040 0x7fe4c4126c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:35.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.959+0000 7fe4c27fc700 1 -- 172.21.15.156:0/1589422365 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4c40a08e0 msgr2=0x7fe4c4126210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:35.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.959+0000 7fe4c27fc700 1 --2- 172.21.15.156:0/1589422365 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4c40a08e0 0x7fe4c4126210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:35.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.959+0000 7fe4c27fc700 1 -- 172.21.15.156:0/1589422365 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b4009430 con 0x7fe4c40a1400 2023-09-30T22:19:35.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.959+0000 7fe4c37fe700 1 --2- 172.21.15.156:0/1589422365 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4c4138040 0x7fe4c4126c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:35.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.959+0000 7fe4c2ffd700 1 --2- 172.21.15.156:0/1589422365 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4c40a08e0 0x7fe4c4126210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:35.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.959+0000 7fe4c27fc700 1 --2- 172.21.15.156:0/1589422365 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4c40a1400 0x7fe4c4126750 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800c3c0 tx=0x7fe4b800c6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:35.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.960+0000 7fe4ab7fe700 1 -- 172.21.15.156:0/1589422365 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8004a70 con 0x7fe4c40a1400 2023-09-30T22:19:35.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.960+0000 7fe4ab7fe700 1 -- 172.21.15.156:0/1589422365 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b8004bd0 con 0x7fe4c40a1400 2023-09-30T22:19:35.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.960+0000 7fe4c96a2700 1 -- 172.21.15.156:0/1589422365 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c4129d30 con 0x7fe4c40a1400 2023-09-30T22:19:35.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.960+0000 7fe4ab7fe700 1 -- 172.21.15.156:0/1589422365 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b80070d0 con 0x7fe4c40a1400 2023-09-30T22:19:35.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.960+0000 7fe4c96a2700 1 -- 172.21.15.156:0/1589422365 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4c4129a50 con 0x7fe4c40a1400 2023-09-30T22:19:35.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.960+0000 7fe4ab7fe700 1 -- 172.21.15.156:0/1589422365 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe4b8007230 con 0x7fe4c40a1400 2023-09-30T22:19:35.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.961+0000 7fe4ab7fe700 1 -- 172.21.15.156:0/1589422365 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe4b803f100 con 0x7fe4c40a1400 2023-09-30T22:19:35.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.961+0000 7fe4c96a2700 1 -- 172.21.15.156:0/1589422365 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4c404f2a0 con 0x7fe4c40a1400 2023-09-30T22:19:35.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.966+0000 7fe4ab7fe700 1 -- 172.21.15.156:0/1589422365 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4b80074e0 con 0x7fe4c40a1400 2023-09-30T22:19:35.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.993+0000 7f948a156700 1 Processor -- start 2023-09-30T22:19:35.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.993+0000 7f948a156700 1 -- start start 2023-09-30T22:19:35.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.993+0000 7f948a156700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f948406a770 0x7f948406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:35.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.993+0000 7f948a156700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9484131ec0 0x7f9484139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:35.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.993+0000 7f948a156700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948409da80 con 0x7f948406b080 2023-09-30T22:19:35.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.993+0000 7f948a156700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f948409dce0 con 0x7f948406a770 2023-09-30T22:19:35.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.993+0000 7f948a156700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f948409eb20 con 0x7f9484131ec0 2023-09-30T22:19:35.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.993+0000 7f94837fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f948406a770 0x7f948406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:35.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.994+0000 7f9483fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9484131ec0 0x7f9484139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:35.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.994+0000 7f94837fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f948406a770 0x7f948406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38590/0 (socket says 172.21.15.156:38590) 2023-09-30T22:19:35.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.994+0000 7f94837fe700 1 -- 172.21.15.156:0/2324260377 learned_addr learned my addr 172.21.15.156:0/2324260377 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:35.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.994+0000 7f9483fff700 1 -- 172.21.15.156:0/2324260377 >> v2:172.21.15.156:3300/0 conn(0x7f948406a770 msgr2=0x7f948406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:35.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.994+0000 7f9483fff700 1 --2- 172.21.15.156:0/2324260377 >> v2:172.21.15.156:3300/0 conn(0x7f948406a770 0x7f948406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:35.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.994+0000 7f9483fff700 1 -- 172.21.15.156:0/2324260377 >> v1:172.21.15.156:6789/0 conn(0x7f948406b080 legacy=0x7f94841317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:35.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.994+0000 7f9483fff700 1 -- 172.21.15.156:0/2324260377 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948409d860 con 0x7f9484131ec0 2023-09-30T22:19:35.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.994+0000 7f9483fff700 1 --2- 172.21.15.156:0/2324260377 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9484131ec0 0x7f9484139c20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f947c009d90 tx=0x7f947c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83ed0b2fef40dd18 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:35.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.994+0000 7f94827fc700 1 -- 172.21.15.156:0/2324260377 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c00e070 con 0x7f9484131ec0 2023-09-30T22:19:35.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.994+0000 7f94827fc700 1 -- 172.21.15.156:0/2324260377 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c00bb20 con 0x7f9484131ec0 2023-09-30T22:19:35.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.994+0000 7f94827fc700 1 -- 172.21.15.156:0/2324260377 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c012430 con 0x7f9484131ec0 2023-09-30T22:19:35.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.995+0000 7f948a156700 1 -- 172.21.15.156:0/2324260377 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9484131ec0 msgr2=0x7f9484139c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:35.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.995+0000 7f948a156700 1 --2- 172.21.15.156:0/2324260377 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9484131ec0 0x7f9484139c20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f947c009d90 tx=0x7f947c00b330 comp rx=0 tx=0).stop 2023-09-30T22:19:36.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.995+0000 7f948a156700 1 -- 172.21.15.156:0/2324260377 shutdown_connections 2023-09-30T22:19:36.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.995+0000 7f948a156700 1 --2- 172.21.15.156:0/2324260377 >> v2:172.21.15.156:3300/0 conn(0x7f948406a770 0x7f948406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:36.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.995+0000 7f948a156700 1 --2- 172.21.15.156:0/2324260377 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9484131ec0 0x7f9484139c20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:36.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.995+0000 7f948a156700 1 -- 172.21.15.156:0/2324260377 >> 172.21.15.156:0/2324260377 conn(0x7f9484099c40 msgr2=0x7f94840a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:36.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.995+0000 7f948a156700 1 -- 172.21.15.156:0/2324260377 shutdown_connections 2023-09-30T22:19:36.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.995+0000 7f948a156700 1 -- 172.21.15.156:0/2324260377 wait complete. 2023-09-30T22:19:36.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.996+0000 7f948a156700 1 Processor -- start 2023-09-30T22:19:36.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.996+0000 7f948a156700 1 -- start start 2023-09-30T22:19:36.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.997+0000 7f948a156700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f948406a770 0x7f94841c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:36.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.997+0000 7f948a156700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f948406b080 0x7f94841c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:36.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.997+0000 7f948a156700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9484131ec0 0x7f94841c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:36.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.997+0000 7f948a156700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948411eb90 con 0x7f948406b080 2023-09-30T22:19:36.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.997+0000 7f948a156700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94841206b0 con 0x7f948406a770 2023-09-30T22:19:36.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.997+0000 7f948a156700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9484071e60 con 0x7f9484131ec0 2023-09-30T22:19:36.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.997+0000 7f94837fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f948406a770 0x7f94841c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:36.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.997+0000 7f94837fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f948406a770 0x7f94841c5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52188/0 (socket says 172.21.15.156:52188) 2023-09-30T22:19:36.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.997+0000 7f94837fe700 1 -- 172.21.15.156:0/1110300065 learned_addr learned my addr 172.21.15.156:0/1110300065 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:36.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.997+0000 7f9482ffd700 1 --2- 172.21.15.156:0/1110300065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f948406b080 0x7f94841c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:36.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.997+0000 7f9483fff700 1 --2- 172.21.15.156:0/1110300065 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9484131ec0 0x7f94841c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:36.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.997+0000 7f94837fe700 1 -- 172.21.15.156:0/1110300065 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9484131ec0 msgr2=0x7f94841c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:36.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.997+0000 7f94837fe700 1 --2- 172.21.15.156:0/1110300065 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9484131ec0 0x7f94841c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:36.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.997+0000 7f94837fe700 1 -- 172.21.15.156:0/1110300065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f948406b080 msgr2=0x7f94841c64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:36.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.997+0000 7f94837fe700 1 --2- 172.21.15.156:0/1110300065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f948406b080 0x7f94841c64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:36.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.997+0000 7f94837fe700 1 -- 172.21.15.156:0/1110300065 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c009a70 con 0x7f948406a770 2023-09-30T22:19:36.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.997+0000 7f94837fe700 1 --2- 172.21.15.156:0/1110300065 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f948406a770 0x7f94841c5f80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f947400e910 tx=0x7f947400ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:36.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.998+0000 7f946bfff700 1 -- 172.21.15.156:0/1110300065 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94740096a0 con 0x7f948406a770 2023-09-30T22:19:36.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.998+0000 7f946bfff700 1 -- 172.21.15.156:0/1110300065 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9474013980 con 0x7f948406a770 2023-09-30T22:19:36.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.998+0000 7f948a156700 1 -- 172.21.15.156:0/1110300065 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948411ed20 con 0x7f948406a770 2023-09-30T22:19:36.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.998+0000 7f946bfff700 1 -- 172.21.15.156:0/1110300065 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9474013d30 con 0x7f948406a770 2023-09-30T22:19:36.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.998+0000 7f948a156700 1 -- 172.21.15.156:0/1110300065 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f948411e530 con 0x7f948406a770 2023-09-30T22:19:36.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.999+0000 7f948a156700 1 -- 172.21.15.156:0/1110300065 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f948404f2a0 con 0x7f948406a770 2023-09-30T22:19:36.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.999+0000 7f946bfff700 1 -- 172.21.15.156:0/1110300065 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f947401b440 con 0x7f948406a770 2023-09-30T22:19:36.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:35.999+0000 7f946bfff700 1 -- 172.21.15.156:0/1110300065 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9474049460 con 0x7f948406a770 2023-09-30T22:19:36.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.004+0000 7f946bfff700 1 -- 172.21.15.156:0/1110300065 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f94740228b0 con 0x7f948406a770 2023-09-30T22:19:36.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.021+0000 7f3ce1378700 1 Processor -- start 2023-09-30T22:19:36.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.022+0000 7f3ce1378700 1 -- start start 2023-09-30T22:19:36.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.022+0000 7f3ce1378700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3cdc06a770 0x7f3cdc06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:36.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.022+0000 7f3ce1378700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3cdc06b080 0x7f3cdc1317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:36.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.022+0000 7f3ce1378700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cdc131cf0 0x7f3cdc132190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:36.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.022+0000 7f3ce1378700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cdc09f770 con 0x7f3cdc06b080 2023-09-30T22:19:36.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.022+0000 7f3ce1378700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc09dce0 con 0x7f3cdc131cf0 2023-09-30T22:19:36.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.022+0000 7f3ce1378700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc09da80 con 0x7f3cdc06a770 2023-09-30T22:19:36.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.022+0000 7f3cdb7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cdc131cf0 0x7f3cdc132190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:36.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.022+0000 7f3cdb7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cdc131cf0 0x7f3cdc132190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52198/0 (socket says 172.21.15.156:52198) 2023-09-30T22:19:36.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.022+0000 7f3cdb7fe700 1 -- 172.21.15.156:0/2210553406 learned_addr learned my addr 172.21.15.156:0/2210553406 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:36.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.022+0000 7f3cda7fc700 1 --2- 172.21.15.156:0/2210553406 >> v2:172.21.15.156:3300/0 conn(0x7f3cdc06b080 0x7f3cdc1317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:36.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.023+0000 7f3cdaffd700 1 --2- 172.21.15.156:0/2210553406 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3cdc06a770 0x7f3cdc06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:36.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.023+0000 7f3cdb7fe700 1 -- 172.21.15.156:0/2210553406 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3cdc06a770 msgr2=0x7f3cdc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:36.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.023+0000 7f3cdb7fe700 1 --2- 172.21.15.156:0/2210553406 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3cdc06a770 0x7f3cdc06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:36.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.023+0000 7f3cdb7fe700 1 -- 172.21.15.156:0/2210553406 >> v2:172.21.15.156:3300/0 conn(0x7f3cdc06b080 msgr2=0x7f3cdc1317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:36.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.023+0000 7f3cdb7fe700 1 --2- 172.21.15.156:0/2210553406 >> v2:172.21.15.156:3300/0 conn(0x7f3cdc06b080 0x7f3cdc1317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:36.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.023+0000 7f3cdb7fe700 1 -- 172.21.15.156:0/2210553406 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc09eb20 con 0x7f3cdc131cf0 2023-09-30T22:19:36.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.023+0000 7f3cdb7fe700 1 --2- 172.21.15.156:0/2210553406 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cdc131cf0 0x7f3cdc132190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009e50 tx=0x7f3cd400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1407c2e1c33287c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:36.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.023+0000 7f3cd9ffb700 1 -- 172.21.15.156:0/2210553406 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd400e070 con 0x7f3cdc131cf0 2023-09-30T22:19:36.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.023+0000 7f3cd9ffb700 1 -- 172.21.15.156:0/2210553406 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd400b910 con 0x7f3cdc131cf0 2023-09-30T22:19:36.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.023+0000 7f3cd9ffb700 1 -- 172.21.15.156:0/2210553406 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd400bca0 con 0x7f3cdc131cf0 2023-09-30T22:19:36.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.024+0000 7f3ce1378700 1 -- 172.21.15.156:0/2210553406 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cdc131cf0 msgr2=0x7f3cdc132190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:36.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.024+0000 7f3ce1378700 1 --2- 172.21.15.156:0/2210553406 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cdc131cf0 0x7f3cdc132190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009e50 tx=0x7f3cd400b330 comp rx=0 tx=0).stop 2023-09-30T22:19:36.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.024+0000 7f3ce1378700 1 -- 172.21.15.156:0/2210553406 shutdown_connections 2023-09-30T22:19:36.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.024+0000 7f3ce1378700 1 --2- 172.21.15.156:0/2210553406 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cdc131cf0 0x7f3cdc132190 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:36.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.024+0000 7f3ce1378700 1 --2- 172.21.15.156:0/2210553406 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3cdc06a770 0x7f3cdc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:36.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.024+0000 7f3ce1378700 1 --2- 172.21.15.156:0/2210553406 >> v2:172.21.15.156:3300/0 conn(0x7f3cdc06b080 0x7f3cdc1317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:36.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.024+0000 7f3ce1378700 1 -- 172.21.15.156:0/2210553406 >> 172.21.15.156:0/2210553406 conn(0x7f3cdc099c40 msgr2=0x7f3cdc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:36.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.024+0000 7f3ce1378700 1 -- 172.21.15.156:0/2210553406 shutdown_connections 2023-09-30T22:19:36.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.024+0000 7f3ce1378700 1 -- 172.21.15.156:0/2210553406 wait complete. 2023-09-30T22:19:36.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.025+0000 7f3ce1378700 1 Processor -- start 2023-09-30T22:19:36.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.025+0000 7f3ce1378700 1 -- start start 2023-09-30T22:19:36.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.025+0000 7f3ce1378700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3cdc06a770 0x7f3cdc11d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:36.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.025+0000 7f3ce1378700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cdc06b080 0x7f3cdc11d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:36.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.025+0000 7f3ce1378700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3cdc131cf0 0x7f3cdc1c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:36.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.025+0000 7f3ce1378700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc11fe40 con 0x7f3cdc06a770 2023-09-30T22:19:36.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.025+0000 7f3ce1378700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc131250 con 0x7f3cdc06b080 2023-09-30T22:19:36.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.025+0000 7f3ce1378700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc11ed30 con 0x7f3cdc131cf0 2023-09-30T22:19:36.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.026+0000 7f3cda7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cdc06b080 0x7f3cdc11d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:36.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.026+0000 7f3cda7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cdc06b080 0x7f3cdc11d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52206/0 (socket says 172.21.15.156:52206) 2023-09-30T22:19:36.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.026+0000 7f3cda7fc700 1 -- 172.21.15.156:0/4082851521 learned_addr learned my addr 172.21.15.156:0/4082851521 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:36.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.026+0000 7f3cdaffd700 1 --2- 172.21.15.156:0/4082851521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3cdc06a770 0x7f3cdc11d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:36.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.026+0000 7f3cdb7fe700 1 --2- 172.21.15.156:0/4082851521 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3cdc131cf0 0x7f3cdc1c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:36.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.026+0000 7f3cda7fc700 1 -- 172.21.15.156:0/4082851521 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3cdc131cf0 msgr2=0x7f3cdc1c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:36.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.026+0000 7f3cda7fc700 1 --2- 172.21.15.156:0/4082851521 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3cdc131cf0 0x7f3cdc1c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:36.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.026+0000 7f3cda7fc700 1 -- 172.21.15.156:0/4082851521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3cdc06a770 msgr2=0x7f3cdc11d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:36.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.026+0000 7f3cda7fc700 1 --2- 172.21.15.156:0/4082851521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3cdc06a770 0x7f3cdc11d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:36.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.026+0000 7f3cda7fc700 1 -- 172.21.15.156:0/4082851521 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd4009b30 con 0x7f3cdc06b080 2023-09-30T22:19:36.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.026+0000 7f3cdb7fe700 1 --2- 172.21.15.156:0/4082851521 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3cdc131cf0 0x7f3cdc1c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:36.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.026+0000 7f3cda7fc700 1 --2- 172.21.15.156:0/4082851521 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cdc06b080 0x7f3cdc11d8d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000e9b0 tx=0x7f3cd000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:36.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.026+0000 7f3cc37fe700 1 -- 172.21.15.156:0/4082851521 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0009710 con 0x7f3cdc06b080 2023-09-30T22:19:36.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.027+0000 7f3cc37fe700 1 -- 172.21.15.156:0/4082851521 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd000ee50 con 0x7f3cdc06b080 2023-09-30T22:19:36.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.027+0000 7f3cc37fe700 1 -- 172.21.15.156:0/4082851521 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd000ca70 con 0x7f3cdc06b080 2023-09-30T22:19:36.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.027+0000 7f3ce1378700 1 -- 172.21.15.156:0/4082851521 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cdc0a28d0 con 0x7f3cdc06b080 2023-09-30T22:19:36.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.027+0000 7f3ce1378700 1 -- 172.21.15.156:0/4082851521 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cdc11cd80 con 0x7f3cdc06b080 2023-09-30T22:19:36.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.028+0000 7f3ce1378700 1 -- 172.21.15.156:0/4082851521 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cdc04f2a0 con 0x7f3cdc06b080 2023-09-30T22:19:36.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.028+0000 7f3cc37fe700 1 -- 172.21.15.156:0/4082851521 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3cd000cbd0 con 0x7f3cdc06b080 2023-09-30T22:19:36.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.028+0000 7f3cc37fe700 1 -- 172.21.15.156:0/4082851521 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3cd003f780 con 0x7f3cdc06b080 2023-09-30T22:19:36.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.037+0000 7f3cc37fe700 1 -- 172.21.15.156:0/4082851521 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3cd001bdc0 con 0x7f3cdc06b080 2023-09-30T22:19:36.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.154+0000 7fb5d868f700 1 -- 172.21.15.156:0/2951007738 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb5d004f2a0 con 0x7fb5d0139280 2023-09-30T22:19:36.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.154+0000 7fb5c6ffd700 1 -- 172.21.15.156:0/2951007738 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb5c8009e60 con 0x7fb5d0139280 2023-09-30T22:19:36.157 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:36.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.158+0000 7fb5d868f700 1 -- 172.21.15.156:0/2951007738 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb5d0139280 msgr2=0x7fb5d01c8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:36.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.158+0000 7fb5d868f700 1 --2- 172.21.15.156:0/2951007738 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb5d0139280 0x7fb5d01c8570 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb5d006c710 tx=0x7fb5c800ef90 comp rx=0 tx=0).stop 2023-09-30T22:19:36.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.158+0000 7fb5d868f700 1 -- 172.21.15.156:0/2951007738 shutdown_connections 2023-09-30T22:19:36.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.158+0000 7fb5d868f700 1 --2- 172.21.15.156:0/2951007738 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb5d0139280 0x7fb5d01c8570 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:36.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.158+0000 7fb5d868f700 1 --2- 172.21.15.156:0/2951007738 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb5d0133ad0 0x7fb5d012f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:36.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.158+0000 7fb5d868f700 1 --2- 172.21.15.156:0/2951007738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5d0136960 0x7fb5d012fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:36.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.158+0000 7fb5d868f700 1 -- 172.21.15.156:0/2951007738 >> 172.21.15.156:0/2951007738 conn(0x7fb5d0099c40 msgr2=0x7fb5d0134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:36.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.158+0000 7fb5d868f700 1 -- 172.21.15.156:0/2951007738 shutdown_connections 2023-09-30T22:19:36.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.158+0000 7fb5d868f700 1 -- 172.21.15.156:0/2951007738 wait complete. 2023-09-30T22:19:36.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:36.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.171+0000 7fe4c96a2700 1 -- 172.21.15.156:0/1589422365 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe4c406bce0 con 0x7fe4c40a1400 2023-09-30T22:19:36.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.171+0000 7fe4ab7fe700 1 -- 172.21.15.156:0/1589422365 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe4b801b340 con 0x7fe4c40a1400 2023-09-30T22:19:36.172 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:36.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.173+0000 7fe4c96a2700 1 -- 172.21.15.156:0/1589422365 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4c40a1400 msgr2=0x7fe4c4126750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:36.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.173+0000 7fe4c96a2700 1 --2- 172.21.15.156:0/1589422365 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4c40a1400 0x7fe4c4126750 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800c3c0 tx=0x7fe4b800c6d0 comp rx=0 tx=0).stop 2023-09-30T22:19:36.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.173+0000 7fe4c96a2700 1 -- 172.21.15.156:0/1589422365 shutdown_connections 2023-09-30T22:19:36.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.173+0000 7fe4c96a2700 1 --2- 172.21.15.156:0/1589422365 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4c4138040 0x7fe4c4126c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:36.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.173+0000 7fe4c96a2700 1 --2- 172.21.15.156:0/1589422365 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4c40a08e0 0x7fe4c4126210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:36.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.173+0000 7fe4c96a2700 1 --2- 172.21.15.156:0/1589422365 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4c40a1400 0x7fe4c4126750 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:36.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.174+0000 7fe4c96a2700 1 -- 172.21.15.156:0/1589422365 >> 172.21.15.156:0/1589422365 conn(0x7fe4c40a2980 msgr2=0x7fe4c409e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:36.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.174+0000 7fe4c96a2700 1 -- 172.21.15.156:0/1589422365 shutdown_connections 2023-09-30T22:19:36.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.174+0000 7fe4c96a2700 1 -- 172.21.15.156:0/1589422365 wait complete. 2023-09-30T22:19:36.186 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:36.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.201+0000 7f948a156700 1 -- 172.21.15.156:0/1110300065 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9484131820 con 0x7f948406a770 2023-09-30T22:19:36.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.201+0000 7f946bfff700 1 -- 172.21.15.156:0/1110300065 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9484131820 con 0x7f948406a770 2023-09-30T22:19:36.202 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:36.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.203+0000 7f948a156700 1 -- 172.21.15.156:0/1110300065 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f948406a770 msgr2=0x7f94841c5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:36.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.203+0000 7f948a156700 1 --2- 172.21.15.156:0/1110300065 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f948406a770 0x7f94841c5f80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f947400e910 tx=0x7f947400ec20 comp rx=0 tx=0).stop 2023-09-30T22:19:36.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.203+0000 7f948a156700 1 -- 172.21.15.156:0/1110300065 shutdown_connections 2023-09-30T22:19:36.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.203+0000 7f948a156700 1 --2- 172.21.15.156:0/1110300065 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9484131ec0 0x7f94841c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:36.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.204+0000 7f948a156700 1 --2- 172.21.15.156:0/1110300065 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f948406a770 0x7f94841c5f80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:36.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.204+0000 7f948a156700 1 --2- 172.21.15.156:0/1110300065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f948406b080 0x7f94841c64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:36.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.204+0000 7f948a156700 1 -- 172.21.15.156:0/1110300065 >> 172.21.15.156:0/1110300065 conn(0x7f9484099c40 msgr2=0x7f94841b99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:36.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.204+0000 7f948a156700 1 -- 172.21.15.156:0/1110300065 shutdown_connections 2023-09-30T22:19:36.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.204+0000 7f948a156700 1 -- 172.21.15.156:0/1110300065 wait complete. 2023-09-30T22:19:36.217 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:36.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.232+0000 7f3ce1378700 1 -- 172.21.15.156:0/4082851521 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3cdc11ffb0 con 0x7f3cdc06b080 2023-09-30T22:19:36.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.232+0000 7f3cc37fe700 1 -- 172.21.15.156:0/4082851521 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3cd0017030 con 0x7f3cdc06b080 2023-09-30T22:19:36.233 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:36.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.234+0000 7f3ce1378700 1 -- 172.21.15.156:0/4082851521 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cdc06b080 msgr2=0x7f3cdc11d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:36.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.234+0000 7f3ce1378700 1 --2- 172.21.15.156:0/4082851521 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cdc06b080 0x7f3cdc11d8d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000e9b0 tx=0x7f3cd000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:19:36.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.234+0000 7f3ce1378700 1 -- 172.21.15.156:0/4082851521 shutdown_connections 2023-09-30T22:19:36.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.234+0000 7f3ce1378700 1 --2- 172.21.15.156:0/4082851521 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3cdc131cf0 0x7f3cdc1c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:36.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.234+0000 7f3ce1378700 1 --2- 172.21.15.156:0/4082851521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3cdc06a770 0x7f3cdc11d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:36.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.234+0000 7f3ce1378700 1 --2- 172.21.15.156:0/4082851521 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cdc06b080 0x7f3cdc11d8d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:36.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.234+0000 7f3ce1378700 1 -- 172.21.15.156:0/4082851521 >> 172.21.15.156:0/4082851521 conn(0x7f3cdc099c40 msgr2=0x7f3cdc1b79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:36.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.234+0000 7f3ce1378700 1 -- 172.21.15.156:0/4082851521 shutdown_connections 2023-09-30T22:19:36.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:36.234+0000 7f3ce1378700 1 -- 172.21.15.156:0/4082851521 wait complete. 2023-09-30T22:19:36.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:37.171 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:37.187 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:37.217 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:37.248 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:37.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.306+0000 7fafec409700 1 Processor -- start 2023-09-30T22:19:37.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.306+0000 7fafec409700 1 -- start start 2023-09-30T22:19:37.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.307+0000 7fafec409700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fafe4133ad0 0x7fafe4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:37.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.307+0000 7fafec409700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fafe4130bc0 0x7fafe413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:37.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.307+0000 7fafec409700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe406b2d0 con 0x7fafe41300a0 2023-09-30T22:19:37.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.307+0000 7fafec409700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe4133610 con 0x7fafe4133ad0 2023-09-30T22:19:37.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.307+0000 7fafec409700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafe409a500 con 0x7fafe4130bc0 2023-09-30T22:19:37.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.307+0000 7fafea1a5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fafe4133ad0 0x7fafe4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:37.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.307+0000 7fafea1a5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fafe4133ad0 0x7fafe4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38628/0 (socket says 172.21.15.156:38628) 2023-09-30T22:19:37.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.307+0000 7fafea1a5700 1 -- 172.21.15.156:0/2697189993 learned_addr learned my addr 172.21.15.156:0/2697189993 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:37.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.307+0000 7fafea9a6700 1 --2- 172.21.15.156:0/2697189993 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fafe4130bc0 0x7fafe413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:37.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.308+0000 7fafea1a5700 1 -- 172.21.15.156:0/2697189993 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fafe4130bc0 msgr2=0x7fafe413b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:37.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.308+0000 7fafea1a5700 1 --2- 172.21.15.156:0/2697189993 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fafe4130bc0 0x7fafe413b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.308+0000 7fafea1a5700 1 -- 172.21.15.156:0/2697189993 >> v1:172.21.15.156:6789/0 conn(0x7fafe41300a0 legacy=0x7fafe41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.308+0000 7fafea1a5700 1 -- 172.21.15.156:0/2697189993 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe41338b0 con 0x7fafe4133ad0 2023-09-30T22:19:37.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.308+0000 7fafea1a5700 1 --2- 172.21.15.156:0/2697189993 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafe4133ad0 0x7fafe4133ea0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fafe00098f0 tx=0x7fafe0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8ffaa242e26b22 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:37.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.308+0000 7fafe91a3700 1 -- 172.21.15.156:0/2697189993 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe0011830 con 0x7fafe4133ad0 2023-09-30T22:19:37.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.308+0000 7fafe91a3700 1 -- 172.21.15.156:0/2697189993 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe0011990 con 0x7fafe4133ad0 2023-09-30T22:19:37.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.308+0000 7fafe91a3700 1 -- 172.21.15.156:0/2697189993 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe0011d20 con 0x7fafe4133ad0 2023-09-30T22:19:37.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.309+0000 7fafec409700 1 -- 172.21.15.156:0/2697189993 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafe4133ad0 msgr2=0x7fafe4133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.309+0000 7fafec409700 1 --2- 172.21.15.156:0/2697189993 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafe4133ad0 0x7fafe4133ea0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fafe00098f0 tx=0x7fafe0009c00 comp rx=0 tx=0).stop 2023-09-30T22:19:37.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.309+0000 7fafec409700 1 -- 172.21.15.156:0/2697189993 shutdown_connections 2023-09-30T22:19:37.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.309+0000 7fafec409700 1 --2- 172.21.15.156:0/2697189993 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafe4133ad0 0x7fafe4133ea0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.309+0000 7fafec409700 1 --2- 172.21.15.156:0/2697189993 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fafe4130bc0 0x7fafe413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.309+0000 7fafec409700 1 -- 172.21.15.156:0/2697189993 >> 172.21.15.156:0/2697189993 conn(0x7fafe4099c40 msgr2=0x7fafe40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:37.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.309+0000 7fafec409700 1 -- 172.21.15.156:0/2697189993 shutdown_connections 2023-09-30T22:19:37.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.309+0000 7fafec409700 1 -- 172.21.15.156:0/2697189993 wait complete. 2023-09-30T22:19:37.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.310+0000 7fafec409700 1 Processor -- start 2023-09-30T22:19:37.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.310+0000 7fafec409700 1 -- start start 2023-09-30T22:19:37.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.310+0000 7fafec409700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafe41300a0 0x7fafe41c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:37.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.310+0000 7fafec409700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fafe4130bc0 0x7fafe41c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:37.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.310+0000 7fafec409700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafe4133ad0 0x7fafe41c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:37.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.311+0000 7fafec409700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe4120170 con 0x7fafe4133ad0 2023-09-30T22:19:37.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.311+0000 7fafec409700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe412fc60 con 0x7fafe41300a0 2023-09-30T22:19:37.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.311+0000 7fafec409700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafe412dd00 con 0x7fafe4130bc0 2023-09-30T22:19:37.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.311+0000 7fafea9a6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafe4133ad0 0x7fafe41c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:37.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.311+0000 7fafea9a6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafe4133ad0 0x7fafe41c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38642/0 (socket says 172.21.15.156:38642) 2023-09-30T22:19:37.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.311+0000 7fafea1a5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafe41300a0 0x7fafe41c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:37.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.311+0000 7fafea9a6700 1 -- 172.21.15.156:0/2894603049 learned_addr learned my addr 172.21.15.156:0/2894603049 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:37.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.311+0000 7fafe99a4700 1 --2- 172.21.15.156:0/2894603049 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fafe4130bc0 0x7fafe41c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:37.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.311+0000 7fafea9a6700 1 -- 172.21.15.156:0/2894603049 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fafe4130bc0 msgr2=0x7fafe41c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.311+0000 7fafea9a6700 1 --2- 172.21.15.156:0/2894603049 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fafe4130bc0 0x7fafe41c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.311+0000 7fafea9a6700 1 -- 172.21.15.156:0/2894603049 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafe41300a0 msgr2=0x7fafe41c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.311+0000 7fafea9a6700 1 --2- 172.21.15.156:0/2894603049 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafe41300a0 0x7fafe41c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.311+0000 7fafea9a6700 1 -- 172.21.15.156:0/2894603049 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe0009550 con 0x7fafe4133ad0 2023-09-30T22:19:37.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.311+0000 7fafea1a5700 1 --2- 172.21.15.156:0/2894603049 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafe41300a0 0x7fafe41c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:37.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.311+0000 7fafea9a6700 1 --2- 172.21.15.156:0/2894603049 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafe4133ad0 0x7fafe41c91d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fafdc00efc0 tx=0x7fafdc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:37.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.311+0000 7fafdaffd700 1 -- 172.21.15.156:0/2894603049 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc009ea0 con 0x7fafe4133ad0 2023-09-30T22:19:37.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.311+0000 7fafdaffd700 1 -- 172.21.15.156:0/2894603049 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafdc00f040 con 0x7fafe4133ad0 2023-09-30T22:19:37.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.312+0000 7fafdaffd700 1 -- 172.21.15.156:0/2894603049 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc00ceb0 con 0x7fafe4133ad0 2023-09-30T22:19:37.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.312+0000 7fafec409700 1 -- 172.21.15.156:0/2894603049 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe411f4b0 con 0x7fafe4133ad0 2023-09-30T22:19:37.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.312+0000 7fafec409700 1 -- 172.21.15.156:0/2894603049 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe40715e0 con 0x7fafe4133ad0 2023-09-30T22:19:37.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.313+0000 7fafec409700 1 -- 172.21.15.156:0/2894603049 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe411fae0 con 0x7fafe4133ad0 2023-09-30T22:19:37.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.313+0000 7fafdaffd700 1 -- 172.21.15.156:0/2894603049 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fafdc014480 con 0x7fafe4133ad0 2023-09-30T22:19:37.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.314+0000 7fafdaffd700 1 -- 172.21.15.156:0/2894603049 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fafdc03ff00 con 0x7fafe4133ad0 2023-09-30T22:19:37.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.322+0000 7fafdaffd700 1 -- 172.21.15.156:0/2894603049 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fafdc0118b0 con 0x7fafe4133ad0 2023-09-30T22:19:37.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.349+0000 7fe4aa48e700 1 Processor -- start 2023-09-30T22:19:37.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.349+0000 7fe4aa48e700 1 -- start start 2023-09-30T22:19:37.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.349+0000 7fe4aa48e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4a409d860 0x7fe4a409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:37.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.349+0000 7fe4aa48e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe4a4130eb0 0x7fe4a4138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:37.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.349+0000 7fe4aa48e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a409aaa0 con 0x7fe4a409e170 2023-09-30T22:19:37.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.349+0000 7fe4aa48e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a409f870 con 0x7fe4a4130eb0 2023-09-30T22:19:37.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.349+0000 7fe4aa48e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a409b360 con 0x7fe4a409d860 2023-09-30T22:19:37.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.350+0000 7fe4a3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4a409d860 0x7fe4a409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:37.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.350+0000 7fe4a8a2b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe4a4130eb0 0x7fe4a4138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:37.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.350+0000 7fe4a37fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe4a409e170 0x7fe4a41307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48510/0 (socket says 172.21.15.156:48510) 2023-09-30T22:19:37.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.350+0000 7fe4a37fe700 1 -- 172.21.15.156:0/2341881027 learned_addr learned my addr 172.21.15.156:0/2341881027 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:37.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.350+0000 7fe4a2ffd700 1 -- 172.21.15.156:0/2341881027 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3297400511 0 0) 0x7fe4a409aaa0 con 0x7fe4a409e170 2023-09-30T22:19:37.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.350+0000 7fe4a2ffd700 1 -- 172.21.15.156:0/2341881027 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe48c0057c0 con 0x7fe4a409e170 2023-09-30T22:19:37.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.350+0000 7fe4a3fff700 1 -- 172.21.15.156:0/2341881027 >> v2:172.21.15.156:3300/0 conn(0x7fe4a4130eb0 msgr2=0x7fe4a4138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:37.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.350+0000 7fe4a3fff700 1 --2- 172.21.15.156:0/2341881027 >> v2:172.21.15.156:3300/0 conn(0x7fe4a4130eb0 0x7fe4a4138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.350+0000 7fe4a3fff700 1 -- 172.21.15.156:0/2341881027 >> v1:172.21.15.156:6789/0 conn(0x7fe4a409e170 legacy=0x7fe4a41307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.350+0000 7fe4a3fff700 1 -- 172.21.15.156:0/2341881027 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a409b620 con 0x7fe4a409d860 2023-09-30T22:19:37.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.350+0000 7fe4a8a2b700 1 --2- 172.21.15.156:0/2341881027 >> v2:172.21.15.156:3300/0 conn(0x7fe4a4130eb0 0x7fe4a4138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:37.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.350+0000 7fe4a3fff700 1 --2- 172.21.15.156:0/2341881027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4a409d860 0x7fe4a409dc30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe494009840 tx=0x7fe494009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a1847169765be7b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:37.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.350+0000 7fe4a2ffd700 1 -- 172.21.15.156:0/2341881027 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494014e90 con 0x7fe4a409d860 2023-09-30T22:19:37.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.350+0000 7fe4a2ffd700 1 -- 172.21.15.156:0/2341881027 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49401c440 con 0x7fe4a409d860 2023-09-30T22:19:37.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.350+0000 7fe4a2ffd700 1 -- 172.21.15.156:0/2341881027 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49401c7b0 con 0x7fe4a409d860 2023-09-30T22:19:37.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.351+0000 7fe4aa48e700 1 -- 172.21.15.156:0/2341881027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4a409d860 msgr2=0x7fe4a409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.351+0000 7fe4aa48e700 1 --2- 172.21.15.156:0/2341881027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4a409d860 0x7fe4a409dc30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe494009840 tx=0x7fe494009b50 comp rx=0 tx=0).stop 2023-09-30T22:19:37.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.351+0000 7fe4aa48e700 1 -- 172.21.15.156:0/2341881027 shutdown_connections 2023-09-30T22:19:37.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.351+0000 7fe4aa48e700 1 --2- 172.21.15.156:0/2341881027 >> v2:172.21.15.156:3300/0 conn(0x7fe4a4130eb0 0x7fe4a4138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.351+0000 7fe4aa48e700 1 --2- 172.21.15.156:0/2341881027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4a409d860 0x7fe4a409dc30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.351+0000 7fe4aa48e700 1 -- 172.21.15.156:0/2341881027 >> 172.21.15.156:0/2341881027 conn(0x7fe4a4099c40 msgr2=0x7fe4a40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:37.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.351+0000 7fe4aa48e700 1 -- 172.21.15.156:0/2341881027 shutdown_connections 2023-09-30T22:19:37.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.351+0000 7fe4aa48e700 1 -- 172.21.15.156:0/2341881027 wait complete. 2023-09-30T22:19:37.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.352+0000 7fe4aa48e700 1 Processor -- start 2023-09-30T22:19:37.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.352+0000 7fe4aa48e700 1 -- start start 2023-09-30T22:19:37.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.353+0000 7fe4aa48e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4a409d860 0x7fe4a411e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:37.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.353+0000 7fe4aa48e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4a409e170 0x7fe4a411e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:37.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.353+0000 7fe4aa48e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4a4130eb0 0x7fe4a411eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:37.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.353+0000 7fe4aa48e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a4120910 con 0x7fe4a409e170 2023-09-30T22:19:37.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.353+0000 7fe4aa48e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a409c8b0 con 0x7fe4a409d860 2023-09-30T22:19:37.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.353+0000 7fe4aa48e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a4120150 con 0x7fe4a4130eb0 2023-09-30T22:19:37.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.353+0000 7fe4a3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4a409d860 0x7fe4a411e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:37.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.353+0000 7fe4a3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4a409d860 0x7fe4a411e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52228/0 (socket says 172.21.15.156:52228) 2023-09-30T22:19:37.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.353+0000 7fe4a3fff700 1 -- 172.21.15.156:0/2990837183 learned_addr learned my addr 172.21.15.156:0/2990837183 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:37.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.353+0000 7fe4a37fe700 1 --2- 172.21.15.156:0/2990837183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4a409e170 0x7fe4a411e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:37.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.353+0000 7fe4a8a2b700 1 --2- 172.21.15.156:0/2990837183 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4a4130eb0 0x7fe4a411eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:37.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.353+0000 7fe4a3fff700 1 -- 172.21.15.156:0/2990837183 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4a4130eb0 msgr2=0x7fe4a411eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.353+0000 7fe4a3fff700 1 --2- 172.21.15.156:0/2990837183 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4a4130eb0 0x7fe4a411eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.353+0000 7fe4a3fff700 1 -- 172.21.15.156:0/2990837183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4a409e170 msgr2=0x7fe4a411e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.353+0000 7fe4a3fff700 1 --2- 172.21.15.156:0/2990837183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4a409e170 0x7fe4a411e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.353+0000 7fe4a3fff700 1 -- 172.21.15.156:0/2990837183 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c009a70 con 0x7fe4a409d860 2023-09-30T22:19:37.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.353+0000 7fe4a8a2b700 1 --2- 172.21.15.156:0/2990837183 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4a4130eb0 0x7fe4a411eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:37.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.354+0000 7fe4a3fff700 1 --2- 172.21.15.156:0/2990837183 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4a409d860 0x7fe4a411e430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe4940090b0 tx=0x7fe494004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:37.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.354+0000 7fe4a0ff9700 1 -- 172.21.15.156:0/2990837183 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494003ab0 con 0x7fe4a409d860 2023-09-30T22:19:37.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.354+0000 7fe4a0ff9700 1 -- 172.21.15.156:0/2990837183 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe494003c10 con 0x7fe4a409d860 2023-09-30T22:19:37.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.354+0000 7fe4aa48e700 1 -- 172.21.15.156:0/2990837183 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4940094a0 con 0x7fe4a409d860 2023-09-30T22:19:37.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.354+0000 7fe4a0ff9700 1 -- 172.21.15.156:0/2990837183 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49401de20 con 0x7fe4a409d860 2023-09-30T22:19:37.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.354+0000 7fe4aa48e700 1 -- 172.21.15.156:0/2990837183 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a412ff60 con 0x7fe4a409d860 2023-09-30T22:19:37.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.355+0000 7fe4aa48e700 1 -- 172.21.15.156:0/2990837183 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a4121bd0 con 0x7fe4a409d860 2023-09-30T22:19:37.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.355+0000 7fe4a0ff9700 1 -- 172.21.15.156:0/2990837183 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe494023040 con 0x7fe4a409d860 2023-09-30T22:19:37.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.355+0000 7fe4a0ff9700 1 -- 172.21.15.156:0/2990837183 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe494049170 con 0x7fe4a409d860 2023-09-30T22:19:37.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.356+0000 7fa45b69a700 1 Processor -- start 2023-09-30T22:19:37.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.356+0000 7fa45b69a700 1 -- start start 2023-09-30T22:19:37.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.357+0000 7fa45b69a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa45409d860 0x7fa45409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:37.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.357+0000 7fa45b69a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa45409e170 0x7fa4541307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:37.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.357+0000 7fa45b69a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa454130ce0 0x7fa454131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:37.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.357+0000 7fa45b69a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa45409aaa0 con 0x7fa454130ce0 2023-09-30T22:19:37.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.357+0000 7fa45b69a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45409f870 con 0x7fa45409d860 2023-09-30T22:19:37.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.357+0000 7fa45b69a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa45409b360 con 0x7fa45409e170 2023-09-30T22:19:37.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.357+0000 7fa459436700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa45409d860 0x7fa45409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:37.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.357+0000 7fa459436700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa45409d860 0x7fa45409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52232/0 (socket says 172.21.15.156:52232) 2023-09-30T22:19:37.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.357+0000 7fa459436700 1 -- 172.21.15.156:0/1440874716 learned_addr learned my addr 172.21.15.156:0/1440874716 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:37.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.357+0000 7fa458c35700 1 --2- 172.21.15.156:0/1440874716 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa45409e170 0x7fa4541307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:37.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.358+0000 7fa459c37700 1 --2- 172.21.15.156:0/1440874716 >> v2:172.21.15.156:3300/0 conn(0x7fa454130ce0 0x7fa454131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:37.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.358+0000 7fa459436700 1 -- 172.21.15.156:0/1440874716 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa45409e170 msgr2=0x7fa4541307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:37.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.358+0000 7fa459436700 1 --2- 172.21.15.156:0/1440874716 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa45409e170 0x7fa4541307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.358+0000 7fa459436700 1 -- 172.21.15.156:0/1440874716 >> v2:172.21.15.156:3300/0 conn(0x7fa454130ce0 msgr2=0x7fa454131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:37.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.358+0000 7fa459436700 1 --2- 172.21.15.156:0/1440874716 >> v2:172.21.15.156:3300/0 conn(0x7fa454130ce0 0x7fa454131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.358+0000 7fa459436700 1 -- 172.21.15.156:0/1440874716 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45409b620 con 0x7fa45409d860 2023-09-30T22:19:37.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.358+0000 7fa459436700 1 --2- 172.21.15.156:0/1440874716 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa45409d860 0x7fa45409dc30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa4500098f0 tx=0x7fa450009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=432c447591d535f7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:37.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.361+0000 7fa44bfff700 1 -- 172.21.15.156:0/1440874716 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa450010a90 con 0x7fa45409d860 2023-09-30T22:19:37.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.361+0000 7fa44bfff700 1 -- 172.21.15.156:0/1440874716 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa450010bf0 con 0x7fa45409d860 2023-09-30T22:19:37.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.361+0000 7fa44bfff700 1 -- 172.21.15.156:0/1440874716 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa450018440 con 0x7fa45409d860 2023-09-30T22:19:37.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.361+0000 7fe4a0ff9700 1 -- 172.21.15.156:0/2990837183 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe494004560 con 0x7fe4a409d860 2023-09-30T22:19:37.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.362+0000 7fa45b69a700 1 -- 172.21.15.156:0/1440874716 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa45409d860 msgr2=0x7fa45409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.362+0000 7fa45b69a700 1 --2- 172.21.15.156:0/1440874716 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa45409d860 0x7fa45409dc30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa4500098f0 tx=0x7fa450009c00 comp rx=0 tx=0).stop 2023-09-30T22:19:37.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.362+0000 7fa45b69a700 1 -- 172.21.15.156:0/1440874716 shutdown_connections 2023-09-30T22:19:37.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.362+0000 7fa45b69a700 1 --2- 172.21.15.156:0/1440874716 >> v2:172.21.15.156:3300/0 conn(0x7fa454130ce0 0x7fa454131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.362+0000 7fa45b69a700 1 --2- 172.21.15.156:0/1440874716 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa45409d860 0x7fa45409dc30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.362+0000 7fa45b69a700 1 --2- 172.21.15.156:0/1440874716 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa45409e170 0x7fa4541307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.362+0000 7fa45b69a700 1 -- 172.21.15.156:0/1440874716 >> 172.21.15.156:0/1440874716 conn(0x7fa454099c40 msgr2=0x7fa4540a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:37.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.362+0000 7fa45b69a700 1 -- 172.21.15.156:0/1440874716 shutdown_connections 2023-09-30T22:19:37.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.362+0000 7fa45b69a700 1 -- 172.21.15.156:0/1440874716 wait complete. 2023-09-30T22:19:37.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.363+0000 7fa45b69a700 1 Processor -- start 2023-09-30T22:19:37.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.363+0000 7fa45b69a700 1 -- start start 2023-09-30T22:19:37.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.363+0000 7fa45b69a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa45409d860 0x7fa45411cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:37.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.363+0000 7fa45b69a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa45409e170 0x7fa45411d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:37.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.363+0000 7fa45b69a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa454130ce0 0x7fa45411da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:37.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.363+0000 7fa45b69a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45411f170 con 0x7fa45409e170 2023-09-30T22:19:37.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.363+0000 7fa45b69a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa454120230 con 0x7fa45409d860 2023-09-30T22:19:37.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.363+0000 7fa45b69a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa45409c8b0 con 0x7fa454130ce0 2023-09-30T22:19:37.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.363+0000 7fa459436700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa45409d860 0x7fa45411cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:37.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.363+0000 7fa459436700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa45409d860 0x7fa45411cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52236/0 (socket says 172.21.15.156:52236) 2023-09-30T22:19:37.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.363+0000 7fa459436700 1 -- 172.21.15.156:0/960746589 learned_addr learned my addr 172.21.15.156:0/960746589 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:37.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.364+0000 7fa459c37700 1 --2- 172.21.15.156:0/960746589 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa454130ce0 0x7fa45411da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:37.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.364+0000 7fa459436700 1 -- 172.21.15.156:0/960746589 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa454130ce0 msgr2=0x7fa45411da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.364+0000 7fa459436700 1 --2- 172.21.15.156:0/960746589 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa454130ce0 0x7fa45411da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.364+0000 7fa458c35700 1 --2- 172.21.15.156:0/960746589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa45409e170 0x7fa45411d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:37.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.364+0000 7fa459436700 1 -- 172.21.15.156:0/960746589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa45409e170 msgr2=0x7fa45411d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.364+0000 7fa459436700 1 --2- 172.21.15.156:0/960746589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa45409e170 0x7fa45411d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.364+0000 7fa459436700 1 -- 172.21.15.156:0/960746589 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa450009550 con 0x7fa45409d860 2023-09-30T22:19:37.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.364+0000 7fa458c35700 1 --2- 172.21.15.156:0/960746589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa45409e170 0x7fa45411d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:19:37.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.364+0000 7fa459436700 1 --2- 172.21.15.156:0/960746589 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa45409d860 0x7fa45411cf80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa450009c40 tx=0x7fa450004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:37.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.364+0000 7fa449ffb700 1 -- 172.21.15.156:0/960746589 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4500038a0 con 0x7fa45409d860 2023-09-30T22:19:37.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.364+0000 7fa449ffb700 1 -- 172.21.15.156:0/960746589 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa450003a00 con 0x7fa45409d860 2023-09-30T22:19:37.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.364+0000 7fa45b69a700 1 -- 172.21.15.156:0/960746589 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4540a2260 con 0x7fa45409d860 2023-09-30T22:19:37.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.364+0000 7fa449ffb700 1 -- 172.21.15.156:0/960746589 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa450003db0 con 0x7fa45409d860 2023-09-30T22:19:37.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.364+0000 7fa45b69a700 1 -- 172.21.15.156:0/960746589 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa45411fde0 con 0x7fa45409d860 2023-09-30T22:19:37.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.365+0000 7fa449ffb700 1 -- 172.21.15.156:0/960746589 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa450018640 con 0x7fa45409d860 2023-09-30T22:19:37.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.365+0000 7fa45b69a700 1 -- 172.21.15.156:0/960746589 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa45404f2a0 con 0x7fa45409d860 2023-09-30T22:19:37.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.366+0000 7fa449ffb700 1 -- 172.21.15.156:0/960746589 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa450045290 con 0x7fa45409d860 2023-09-30T22:19:37.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.374+0000 7fa449ffb700 1 -- 172.21.15.156:0/960746589 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa45002c7c0 con 0x7fa45409d860 2023-09-30T22:19:37.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.408+0000 7ff033b15700 1 Processor -- start 2023-09-30T22:19:37.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.408+0000 7ff033b15700 1 -- start start 2023-09-30T22:19:37.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.409+0000 7ff033b15700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff02c09f430 0x7ff02c138c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:37.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.409+0000 7ff033b15700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff02c139190 0x7ff02c13b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:37.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.409+0000 7ff033b15700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff02c0a06a0 con 0x7ff02c09e950 2023-09-30T22:19:37.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.409+0000 7ff033b15700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c0a0150 con 0x7ff02c09f430 2023-09-30T22:19:37.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.409+0000 7ff033b15700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c06b920 con 0x7ff02c139190 2023-09-30T22:19:37.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.409+0000 7ff0310b0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff02c09f430 0x7ff02c138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:37.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.409+0000 7ff0318b1700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff02c09e950 0x7ff02c09ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48524/0 (socket says 172.21.15.156:48524) 2023-09-30T22:19:37.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.409+0000 7ff0318b1700 1 -- 172.21.15.156:0/2970439959 learned_addr learned my addr 172.21.15.156:0/2970439959 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:37.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.409+0000 7ff0320b2700 1 --2- 172.21.15.156:0/2970439959 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff02c139190 0x7ff02c13b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:37.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.409+0000 7ff0310b0700 1 -- 172.21.15.156:0/2970439959 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff02c139190 msgr2=0x7ff02c13b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:37.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.409+0000 7ff0310b0700 1 --2- 172.21.15.156:0/2970439959 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff02c139190 0x7ff02c13b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.409+0000 7ff0310b0700 1 -- 172.21.15.156:0/2970439959 >> v1:172.21.15.156:6789/0 conn(0x7ff02c09e950 legacy=0x7ff02c09ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.409+0000 7ff0310b0700 1 -- 172.21.15.156:0/2970439959 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02c06d8e0 con 0x7ff02c09f430 2023-09-30T22:19:37.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.409+0000 7ff0308af700 1 -- 172.21.15.156:0/2970439959 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1803240110 0 0) 0x7ff02c0a06a0 con 0x7ff02c09e950 2023-09-30T22:19:37.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.409+0000 7ff0310b0700 1 --2- 172.21.15.156:0/2970439959 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff02c09f430 0x7ff02c138c50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff01c009850 tx=0x7ff01c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f89aa2cefe08999 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:37.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.410+0000 7ff0308af700 1 -- 172.21.15.156:0/2970439959 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c005e30 con 0x7ff02c09f430 2023-09-30T22:19:37.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.410+0000 7ff0308af700 1 -- 172.21.15.156:0/2970439959 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01c006030 con 0x7ff02c09f430 2023-09-30T22:19:37.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.410+0000 7ff0308af700 1 -- 172.21.15.156:0/2970439959 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c0063c0 con 0x7ff02c09f430 2023-09-30T22:19:37.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.410+0000 7ff033b15700 1 -- 172.21.15.156:0/2970439959 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff02c09f430 msgr2=0x7ff02c138c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.410+0000 7ff033b15700 1 --2- 172.21.15.156:0/2970439959 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff02c09f430 0x7ff02c138c50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff01c009850 tx=0x7ff01c009b60 comp rx=0 tx=0).stop 2023-09-30T22:19:37.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.410+0000 7ff033b15700 1 -- 172.21.15.156:0/2970439959 shutdown_connections 2023-09-30T22:19:37.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.410+0000 7ff033b15700 1 --2- 172.21.15.156:0/2970439959 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff02c139190 0x7ff02c13b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.410+0000 7ff033b15700 1 --2- 172.21.15.156:0/2970439959 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff02c09f430 0x7ff02c138c50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.410+0000 7ff033b15700 1 -- 172.21.15.156:0/2970439959 >> 172.21.15.156:0/2970439959 conn(0x7ff02c0a4470 msgr2=0x7ff02c0a4870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:37.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.410+0000 7ff033b15700 1 -- 172.21.15.156:0/2970439959 shutdown_connections 2023-09-30T22:19:37.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.410+0000 7ff033b15700 1 -- 172.21.15.156:0/2970439959 wait complete. 2023-09-30T22:19:37.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.412+0000 7ff033b15700 1 Processor -- start 2023-09-30T22:19:37.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.412+0000 7ff033b15700 1 -- start start 2023-09-30T22:19:37.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.412+0000 7ff033b15700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff02c09e950 0x7ff02c1209d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:37.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.412+0000 7ff033b15700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff02c09f430 0x7ff02c120f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:37.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.412+0000 7ff033b15700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff02c139190 0x7ff02c121450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:37.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.412+0000 7ff033b15700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c138e10 con 0x7ff02c09f430 2023-09-30T22:19:37.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.412+0000 7ff033b15700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c123830 con 0x7ff02c09e950 2023-09-30T22:19:37.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.412+0000 7ff033b15700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c122e40 con 0x7ff02c139190 2023-09-30T22:19:37.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.413+0000 7ff0318b1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff02c09e950 0x7ff02c1209d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:37.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.413+0000 7ff0318b1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff02c09e950 0x7ff02c1209d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52252/0 (socket says 172.21.15.156:52252) 2023-09-30T22:19:37.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.413+0000 7ff0318b1700 1 -- 172.21.15.156:0/3704716538 learned_addr learned my addr 172.21.15.156:0/3704716538 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:37.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.413+0000 7ff0320b2700 1 --2- 172.21.15.156:0/3704716538 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff02c139190 0x7ff02c121450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:37.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.413+0000 7ff0310b0700 1 --2- 172.21.15.156:0/3704716538 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff02c09f430 0x7ff02c120f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:37.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.413+0000 7ff0320b2700 1 -- 172.21.15.156:0/3704716538 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff02c09e950 msgr2=0x7ff02c1209d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.413+0000 7ff0320b2700 1 --2- 172.21.15.156:0/3704716538 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff02c09e950 0x7ff02c1209d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.413+0000 7ff0320b2700 1 -- 172.21.15.156:0/3704716538 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff02c09f430 msgr2=0x7ff02c120f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.413+0000 7ff0320b2700 1 --2- 172.21.15.156:0/3704716538 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff02c09f430 0x7ff02c120f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.413+0000 7ff0320b2700 1 -- 172.21.15.156:0/3704716538 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c009430 con 0x7ff02c139190 2023-09-30T22:19:37.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.413+0000 7ff0320b2700 1 --2- 172.21.15.156:0/3704716538 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff02c139190 0x7ff02c121450 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff02c06f250 tx=0x7ff02400e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:37.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.413+0000 7ff0227fc700 1 -- 172.21.15.156:0/3704716538 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff024018070 con 0x7ff02c139190 2023-09-30T22:19:37.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.413+0000 7ff0227fc700 1 -- 172.21.15.156:0/3704716538 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff024007e80 con 0x7ff02c139190 2023-09-30T22:19:37.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.413+0000 7ff0227fc700 1 -- 172.21.15.156:0/3704716538 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02400ed50 con 0x7ff02c139190 2023-09-30T22:19:37.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.413+0000 7ff033b15700 1 -- 172.21.15.156:0/3704716538 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff02c124210 con 0x7ff02c139190 2023-09-30T22:19:37.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.413+0000 7ff033b15700 1 -- 172.21.15.156:0/3704716538 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff02c06ccc0 con 0x7ff02c139190 2023-09-30T22:19:37.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.414+0000 7ff033b15700 1 -- 172.21.15.156:0/3704716538 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff02c04f2a0 con 0x7ff02c139190 2023-09-30T22:19:37.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.415+0000 7ff0227fc700 1 -- 172.21.15.156:0/3704716538 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff024003a20 con 0x7ff02c139190 2023-09-30T22:19:37.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.415+0000 7ff0227fc700 1 -- 172.21.15.156:0/3704716538 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff02403ff00 con 0x7ff02c139190 2023-09-30T22:19:37.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.419+0000 7ff0227fc700 1 -- 172.21.15.156:0/3704716538 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0240047d0 con 0x7ff02c139190 2023-09-30T22:19:37.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.556+0000 7fafec409700 1 -- 172.21.15.156:0/2894603049 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fafe404f2a0 con 0x7fafe4133ad0 2023-09-30T22:19:37.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.557+0000 7fafdaffd700 1 -- 172.21.15.156:0/2894603049 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fafdc018030 con 0x7fafe4133ad0 2023-09-30T22:19:37.558 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:37.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.559+0000 7fafec409700 1 -- 172.21.15.156:0/2894603049 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafe4133ad0 msgr2=0x7fafe41c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.559+0000 7fafec409700 1 --2- 172.21.15.156:0/2894603049 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafe4133ad0 0x7fafe41c91d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fafdc00efc0 tx=0x7fafdc00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.559+0000 7fafec409700 1 -- 172.21.15.156:0/2894603049 shutdown_connections 2023-09-30T22:19:37.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.559+0000 7fafec409700 1 --2- 172.21.15.156:0/2894603049 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafe4133ad0 0x7fafe41c91d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.559+0000 7fafec409700 1 --2- 172.21.15.156:0/2894603049 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafe41300a0 0x7fafe41c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.559+0000 7fafec409700 1 --2- 172.21.15.156:0/2894603049 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fafe4130bc0 0x7fafe41c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.559+0000 7fafec409700 1 -- 172.21.15.156:0/2894603049 >> 172.21.15.156:0/2894603049 conn(0x7fafe4099c40 msgr2=0x7fafe4131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:37.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.559+0000 7fafec409700 1 -- 172.21.15.156:0/2894603049 shutdown_connections 2023-09-30T22:19:37.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.559+0000 7fafec409700 1 -- 172.21.15.156:0/2894603049 wait complete. 2023-09-30T22:19:37.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.563+0000 7fe4aa48e700 1 -- 172.21.15.156:0/2990837183 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe4a404f2a0 con 0x7fe4a409d860 2023-09-30T22:19:37.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.564+0000 7fe4a0ff9700 1 -- 172.21.15.156:0/2990837183 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe49402b020 con 0x7fe4a409d860 2023-09-30T22:19:37.564 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:37.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.566+0000 7fe4aa48e700 1 -- 172.21.15.156:0/2990837183 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4a409d860 msgr2=0x7fe4a411e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.566+0000 7fe4aa48e700 1 --2- 172.21.15.156:0/2990837183 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4a409d860 0x7fe4a411e430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe4940090b0 tx=0x7fe494004750 comp rx=0 tx=0).stop 2023-09-30T22:19:37.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.566+0000 7fe4aa48e700 1 -- 172.21.15.156:0/2990837183 shutdown_connections 2023-09-30T22:19:37.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.566+0000 7fe4aa48e700 1 --2- 172.21.15.156:0/2990837183 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4a4130eb0 0x7fe4a411eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.566+0000 7fe4aa48e700 1 --2- 172.21.15.156:0/2990837183 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4a409d860 0x7fe4a411e430 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.566+0000 7fe4aa48e700 1 --2- 172.21.15.156:0/2990837183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4a409e170 0x7fe4a411e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.566+0000 7fe4aa48e700 1 -- 172.21.15.156:0/2990837183 >> 172.21.15.156:0/2990837183 conn(0x7fe4a4099c40 msgr2=0x7fe4a40a1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:37.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.567+0000 7fe4aa48e700 1 -- 172.21.15.156:0/2990837183 shutdown_connections 2023-09-30T22:19:37.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.567+0000 7fe4aa48e700 1 -- 172.21.15.156:0/2990837183 wait complete. 2023-09-30T22:19:37.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.572+0000 7fa45b69a700 1 -- 172.21.15.156:0/960746589 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa45406c3b0 con 0x7fa45409d860 2023-09-30T22:19:37.573 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:37.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.572+0000 7fa449ffb700 1 -- 172.21.15.156:0/960746589 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa45001d030 con 0x7fa45409d860 2023-09-30T22:19:37.574 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:37.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.575+0000 7fa45b69a700 1 -- 172.21.15.156:0/960746589 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa45409d860 msgr2=0x7fa45411cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.575+0000 7fa45b69a700 1 --2- 172.21.15.156:0/960746589 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa45409d860 0x7fa45411cf80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa450009c40 tx=0x7fa450004750 comp rx=0 tx=0).stop 2023-09-30T22:19:37.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.575+0000 7fa45b69a700 1 -- 172.21.15.156:0/960746589 shutdown_connections 2023-09-30T22:19:37.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.575+0000 7fa45b69a700 1 --2- 172.21.15.156:0/960746589 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa454130ce0 0x7fa45411da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.575+0000 7fa45b69a700 1 --2- 172.21.15.156:0/960746589 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa45409d860 0x7fa45411cf80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.575+0000 7fa45b69a700 1 --2- 172.21.15.156:0/960746589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa45409e170 0x7fa45411d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.575+0000 7fa45b69a700 1 -- 172.21.15.156:0/960746589 >> 172.21.15.156:0/960746589 conn(0x7fa454099c40 msgr2=0x7fa45412ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:37.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.575+0000 7fa45b69a700 1 -- 172.21.15.156:0/960746589 shutdown_connections 2023-09-30T22:19:37.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.575+0000 7fa45b69a700 1 -- 172.21.15.156:0/960746589 wait complete. 2023-09-30T22:19:37.581 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:37.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:37.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.633+0000 7ff033b15700 1 -- 172.21.15.156:0/3704716538 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff02c06b2e0 con 0x7ff02c139190 2023-09-30T22:19:37.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.633+0000 7ff0227fc700 1 -- 172.21.15.156:0/3704716538 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff024013380 con 0x7ff02c139190 2023-09-30T22:19:37.634 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:37.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.635+0000 7ff033b15700 1 -- 172.21.15.156:0/3704716538 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff02c139190 msgr2=0x7ff02c121450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.635+0000 7ff033b15700 1 --2- 172.21.15.156:0/3704716538 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff02c139190 0x7ff02c121450 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff02c06f250 tx=0x7ff02400e3c0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.635+0000 7ff033b15700 1 -- 172.21.15.156:0/3704716538 shutdown_connections 2023-09-30T22:19:37.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.635+0000 7ff033b15700 1 --2- 172.21.15.156:0/3704716538 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff02c139190 0x7ff02c121450 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.635+0000 7ff033b15700 1 --2- 172.21.15.156:0/3704716538 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff02c09e950 0x7ff02c1209d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.635+0000 7ff033b15700 1 --2- 172.21.15.156:0/3704716538 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff02c09f430 0x7ff02c120f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:37.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.635+0000 7ff033b15700 1 -- 172.21.15.156:0/3704716538 >> 172.21.15.156:0/3704716538 conn(0x7ff02c0a4470 msgr2=0x7ff02c0a2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:37.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.635+0000 7ff033b15700 1 -- 172.21.15.156:0/3704716538 shutdown_connections 2023-09-30T22:19:37.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:37.635+0000 7ff033b15700 1 -- 172.21.15.156:0/3704716538 wait complete. 2023-09-30T22:19:37.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:38.575 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:38.582 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:38.589 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:38.648 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:38.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.731+0000 7f89de821700 1 Processor -- start 2023-09-30T22:19:38.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.731+0000 7f89de821700 1 -- start start 2023-09-30T22:19:38.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.731+0000 7f89de821700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f89d80a0a70 0x7f89d80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:38.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.731+0000 7f89de821700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89d8134120 0x7f89d813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:38.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.731+0000 7f89de821700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d809dc00 con 0x7f89d80a1380 2023-09-30T22:19:38.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.731+0000 7f89de821700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d809ea90 con 0x7f89d80a0a70 2023-09-30T22:19:38.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.731+0000 7f89de821700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89d809dec0 con 0x7f89d8134120 2023-09-30T22:19:38.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.731+0000 7f89d7fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f89d80a0a70 0x7f89d80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:38.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.731+0000 7f89d7fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f89d80a0a70 0x7f89d80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38708/0 (socket says 172.21.15.156:38708) 2023-09-30T22:19:38.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.731+0000 7f89dcdbe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89d8134120 0x7f89d813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:38.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.731+0000 7f89d7fff700 1 -- 172.21.15.156:0/3859245228 learned_addr learned my addr 172.21.15.156:0/3859245228 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:38.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.732+0000 7f89dcdbe700 1 -- 172.21.15.156:0/3859245228 >> v2:172.21.15.156:3300/0 conn(0x7f89d80a0a70 msgr2=0x7f89d80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:38.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.732+0000 7f89dcdbe700 1 --2- 172.21.15.156:0/3859245228 >> v2:172.21.15.156:3300/0 conn(0x7f89d80a0a70 0x7f89d80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:38.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.732+0000 7f89dcdbe700 1 -- 172.21.15.156:0/3859245228 >> v1:172.21.15.156:6789/0 conn(0x7f89d80a1380 legacy=0x7f89d8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:38.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.732+0000 7f89dcdbe700 1 -- 172.21.15.156:0/3859245228 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d809e6a0 con 0x7f89d8134120 2023-09-30T22:19:38.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.732+0000 7f89dcdbe700 1 --2- 172.21.15.156:0/3859245228 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89d8134120 0x7f89d813bce0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009d90 tx=0x7f89d000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cddc1c87245555f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:38.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.732+0000 7f89d6ffd700 1 -- 172.21.15.156:0/3859245228 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d000e070 con 0x7f89d8134120 2023-09-30T22:19:38.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.732+0000 7f89d6ffd700 1 -- 172.21.15.156:0/3859245228 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d000bae0 con 0x7f89d8134120 2023-09-30T22:19:38.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.732+0000 7f89d6ffd700 1 -- 172.21.15.156:0/3859245228 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d000be90 con 0x7f89d8134120 2023-09-30T22:19:38.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.733+0000 7f89de821700 1 -- 172.21.15.156:0/3859245228 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89d8134120 msgr2=0x7f89d813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:38.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.733+0000 7f89de821700 1 --2- 172.21.15.156:0/3859245228 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89d8134120 0x7f89d813bce0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009d90 tx=0x7f89d000b330 comp rx=0 tx=0).stop 2023-09-30T22:19:38.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.733+0000 7f89de821700 1 -- 172.21.15.156:0/3859245228 shutdown_connections 2023-09-30T22:19:38.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.733+0000 7f89de821700 1 --2- 172.21.15.156:0/3859245228 >> v2:172.21.15.156:3300/0 conn(0x7f89d80a0a70 0x7f89d80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:38.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.733+0000 7f89de821700 1 --2- 172.21.15.156:0/3859245228 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89d8134120 0x7f89d813bce0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:38.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.733+0000 7f89de821700 1 -- 172.21.15.156:0/3859245228 >> 172.21.15.156:0/3859245228 conn(0x7f89d80a6610 msgr2=0x7f89d80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:38.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.733+0000 7f89de821700 1 -- 172.21.15.156:0/3859245228 shutdown_connections 2023-09-30T22:19:38.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.733+0000 7f89de821700 1 -- 172.21.15.156:0/3859245228 wait complete. 2023-09-30T22:19:38.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.734+0000 7f89de821700 1 Processor -- start 2023-09-30T22:19:38.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.735+0000 7f89de821700 1 -- start start 2023-09-30T22:19:38.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.735+0000 7f89de821700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89d80a0a70 0x7f89d8122920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:38.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.735+0000 7f89de821700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89d80a1380 0x7f89d8122e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:38.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.735+0000 7f89de821700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89d8134120 0x7f89d81233a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:38.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.735+0000 7f89de821700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d8133aa0 con 0x7f89d80a0a70 2023-09-30T22:19:38.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.735+0000 7f89de821700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d80a03e0 con 0x7f89d8134120 2023-09-30T22:19:38.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.735+0000 7f89de821700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89d8124540 con 0x7f89d80a1380 2023-09-30T22:19:38.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.735+0000 7f89d7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89d80a0a70 0x7f89d8122920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:38.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.735+0000 7f89d77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89d80a1380 0x7f89d8122e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:38.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.735+0000 7f89d7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89d80a0a70 0x7f89d8122920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38724/0 (socket says 172.21.15.156:38724) 2023-09-30T22:19:38.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.735+0000 7f89d7fff700 1 -- 172.21.15.156:0/4005745499 learned_addr learned my addr 172.21.15.156:0/4005745499 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:38.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.735+0000 7f89dcdbe700 1 --2- 172.21.15.156:0/4005745499 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89d8134120 0x7f89d81233a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:38.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.736+0000 7f89d7fff700 1 -- 172.21.15.156:0/4005745499 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89d80a1380 msgr2=0x7f89d8122e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:38.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.736+0000 7f89d7fff700 1 --2- 172.21.15.156:0/4005745499 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89d80a1380 0x7f89d8122e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:38.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.736+0000 7f89d7fff700 1 -- 172.21.15.156:0/4005745499 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89d8134120 msgr2=0x7f89d81233a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:38.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.736+0000 7f89d7fff700 1 --2- 172.21.15.156:0/4005745499 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89d8134120 0x7f89d81233a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:38.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.736+0000 7f89d7fff700 1 -- 172.21.15.156:0/4005745499 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d0009a70 con 0x7f89d80a0a70 2023-09-30T22:19:38.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.736+0000 7f89dcdbe700 1 --2- 172.21.15.156:0/4005745499 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89d8134120 0x7f89d81233a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:38.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.736+0000 7f89d7fff700 1 --2- 172.21.15.156:0/4005745499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89d80a0a70 0x7f89d8122920 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f89c800e910 tx=0x7f89c800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:38.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.736+0000 7f89d4ff9700 1 -- 172.21.15.156:0/4005745499 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c80096a0 con 0x7f89d80a0a70 2023-09-30T22:19:38.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.736+0000 7f89d4ff9700 1 -- 172.21.15.156:0/4005745499 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c8013680 con 0x7f89d80a0a70 2023-09-30T22:19:38.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.736+0000 7f89d4ff9700 1 -- 172.21.15.156:0/4005745499 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c8013a30 con 0x7f89d80a0a70 2023-09-30T22:19:38.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.736+0000 7f89de821700 1 -- 172.21.15.156:0/4005745499 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d81337e0 con 0x7f89d80a0a70 2023-09-30T22:19:38.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.736+0000 7f89de821700 1 -- 172.21.15.156:0/4005745499 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d8126ab0 con 0x7f89d80a0a70 2023-09-30T22:19:38.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.737+0000 7f89d4ff9700 1 -- 172.21.15.156:0/4005745499 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f89c8013b90 con 0x7f89d80a0a70 2023-09-30T22:19:38.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.737+0000 7f89d4ff9700 1 -- 172.21.15.156:0/4005745499 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f89c803f690 con 0x7f89d80a0a70 2023-09-30T22:19:38.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.738+0000 7f89de821700 1 -- 172.21.15.156:0/4005745499 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d804f2a0 con 0x7f89d80a0a70 2023-09-30T22:19:38.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.743+0000 7f89d4ff9700 1 -- 172.21.15.156:0/4005745499 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f89c801bdf0 con 0x7f89d80a0a70 2023-09-30T22:19:38.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.763+0000 7f88741e5700 1 Processor -- start 2023-09-30T22:19:38.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.763+0000 7f88741e5700 1 -- start start 2023-09-30T22:19:38.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.763+0000 7f88741e5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f886c09d860 0x7f886c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:38.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.763+0000 7f88741e5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f886c09e170 0x7f886c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:38.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.763+0000 7f88741e5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f886c09aaa0 con 0x7f886c130ce0 2023-09-30T22:19:38.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.763+0000 7f88741e5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886c09f870 con 0x7f886c09e170 2023-09-30T22:19:38.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.763+0000 7f88741e5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f886c09b360 con 0x7f886c09d860 2023-09-30T22:19:38.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.764+0000 7f8871f81700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f886c09d860 0x7f886c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:38.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.764+0000 7f8871f81700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f886c09d860 0x7f886c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56302/0 (socket says 172.21.15.156:56302) 2023-09-30T22:19:38.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.764+0000 7f8871f81700 1 -- 172.21.15.156:0/4123665479 learned_addr learned my addr 172.21.15.156:0/4123665479 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:38.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.764+0000 7f8871f81700 1 -- 172.21.15.156:0/4123665479 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f886c09e170 msgr2=0x7f886c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:38.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.764+0000 7f8871f81700 1 --2- 172.21.15.156:0/4123665479 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f886c09e170 0x7f886c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:38.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.764+0000 7f8871f81700 1 -- 172.21.15.156:0/4123665479 >> v1:172.21.15.156:6789/0 conn(0x7f886c130ce0 legacy=0x7f886c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:38.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.764+0000 7f8871f81700 1 -- 172.21.15.156:0/4123665479 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886c09b620 con 0x7f886c09d860 2023-09-30T22:19:38.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.764+0000 7f8871f81700 1 --2- 172.21.15.156:0/4123665479 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f886c09d860 0x7f886c09dc30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f886800bbc0 tx=0x7f886800bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21951af081e380c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:38.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.764+0000 7fbe2a282700 1 Processor -- start 2023-09-30T22:19:38.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.764+0000 7fbe2a282700 1 -- start start 2023-09-30T22:19:38.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.764+0000 7f8870f7f700 1 -- 172.21.15.156:0/4123665479 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886800dd50 con 0x7f886c09d860 2023-09-30T22:19:38.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.765+0000 7f8870f7f700 1 -- 172.21.15.156:0/4123665479 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8868004030 con 0x7f886c09d860 2023-09-30T22:19:38.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.765+0000 7f8870f7f700 1 -- 172.21.15.156:0/4123665479 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88680043c0 con 0x7f886c09d860 2023-09-30T22:19:38.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.765+0000 7fbe2a282700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbe2409d860 0x7fbe2409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:38.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.765+0000 7fbe2a282700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe2409e170 0x7fbe241307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:38.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.765+0000 7fbe2a282700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe2409aaa0 con 0x7fbe24130ce0 2023-09-30T22:19:38.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.765+0000 7fbe2a282700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe2409f870 con 0x7fbe2409d860 2023-09-30T22:19:38.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.765+0000 7fbe2a282700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2409b360 con 0x7fbe2409e170 2023-09-30T22:19:38.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.765+0000 7f88741e5700 1 -- 172.21.15.156:0/4123665479 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f886c09d860 msgr2=0x7f886c09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:38.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.765+0000 7f88741e5700 1 --2- 172.21.15.156:0/4123665479 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f886c09d860 0x7f886c09dc30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f886800bbc0 tx=0x7f886800bed0 comp rx=0 tx=0).stop 2023-09-30T22:19:38.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.765+0000 7fbe23fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbe2409d860 0x7fbe2409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:38.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.765+0000 7fbe2881f700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fbe24130ce0 0x7fbe2406a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48558/0 (socket says 172.21.15.156:48558) 2023-09-30T22:19:38.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.765+0000 7fbe2881f700 1 -- 172.21.15.156:0/1011957314 learned_addr learned my addr 172.21.15.156:0/1011957314 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:38.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.765+0000 7fbe237fe700 1 --2- 172.21.15.156:0/1011957314 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe2409e170 0x7fbe241307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:38.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.765+0000 7f88741e5700 1 -- 172.21.15.156:0/4123665479 shutdown_connections 2023-09-30T22:19:38.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.765+0000 7f88741e5700 1 --2- 172.21.15.156:0/4123665479 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f886c09d860 0x7f886c09dc30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:38.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.765+0000 7f88741e5700 1 --2- 172.21.15.156:0/4123665479 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f886c09e170 0x7f886c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:38.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.766+0000 7f88741e5700 1 -- 172.21.15.156:0/4123665479 >> 172.21.15.156:0/4123665479 conn(0x7f886c099c40 msgr2=0x7f886c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:38.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.766+0000 7fbe23fff700 1 -- 172.21.15.156:0/1011957314 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe2409e170 msgr2=0x7fbe241307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:38.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.766+0000 7fbe23fff700 1 --2- 172.21.15.156:0/1011957314 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe2409e170 0x7fbe241307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:38.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.766+0000 7fbe23fff700 1 -- 172.21.15.156:0/1011957314 >> v1:172.21.15.156:6789/0 conn(0x7fbe24130ce0 legacy=0x7fbe2406a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:38.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.766+0000 7fbe23fff700 1 -- 172.21.15.156:0/1011957314 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe2409b620 con 0x7fbe2409d860 2023-09-30T22:19:38.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.766+0000 7f88741e5700 1 -- 172.21.15.156:0/4123665479 shutdown_connections 2023-09-30T22:19:38.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.766+0000 7f88741e5700 1 -- 172.21.15.156:0/4123665479 wait complete. 2023-09-30T22:19:38.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.766+0000 7fbe23fff700 1 --2- 172.21.15.156:0/1011957314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe2409d860 0x7fbe2409dc30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbe14009840 tx=0x7fbe14009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a722b8d514bc53f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:38.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.767+0000 7f88741e5700 1 Processor -- start 2023-09-30T22:19:38.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.767+0000 7fbe22ffd700 1 -- 172.21.15.156:0/1011957314 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe14004230 con 0x7fbe2409d860 2023-09-30T22:19:38.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.767+0000 7fbe22ffd700 1 -- 172.21.15.156:0/1011957314 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe14004390 con 0x7fbe2409d860 2023-09-30T22:19:38.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.767+0000 7fbe22ffd700 1 -- 172.21.15.156:0/1011957314 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe140036a0 con 0x7fbe2409d860 2023-09-30T22:19:38.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.767+0000 7fbe2a282700 1 -- 172.21.15.156:0/1011957314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe2409d860 msgr2=0x7fbe2409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:38.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.767+0000 7fbe2a282700 1 --2- 172.21.15.156:0/1011957314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe2409d860 0x7fbe2409dc30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbe14009840 tx=0x7fbe14009b50 comp rx=0 tx=0).stop 2023-09-30T22:19:38.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.768+0000 7f88741e5700 1 -- start start 2023-09-30T22:19:38.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.768+0000 7f88741e5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f886c09d860 0x7f886c11e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:38.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.768+0000 7f88741e5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f886c09e170 0x7f886c11ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:38.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.768+0000 7f88741e5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f886c130ce0 0x7f886c11f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:38.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.768+0000 7f88741e5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886c072180 con 0x7f886c09d860 2023-09-30T22:19:38.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.768+0000 7f88741e5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886c120b60 con 0x7f886c09e170 2023-09-30T22:19:38.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.768+0000 7f88741e5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f886c122e90 con 0x7f886c130ce0 2023-09-30T22:19:38.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.768+0000 7f8871f81700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f886c09d860 0x7f886c11e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:38.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.768+0000 7f8871f81700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f886c09d860 0x7f886c11e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38750/0 (socket says 172.21.15.156:38750) 2023-09-30T22:19:38.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.768+0000 7f8871f81700 1 -- 172.21.15.156:0/1850937077 learned_addr learned my addr 172.21.15.156:0/1850937077 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:38.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.768+0000 7fbe2a282700 1 -- 172.21.15.156:0/1011957314 shutdown_connections 2023-09-30T22:19:38.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.768+0000 7fbe2a282700 1 --2- 172.21.15.156:0/1011957314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe2409d860 0x7fbe2409dc30 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:38.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.768+0000 7fbe2a282700 1 --2- 172.21.15.156:0/1011957314 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe2409e170 0x7fbe241307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:38.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.768+0000 7fbe2a282700 1 -- 172.21.15.156:0/1011957314 >> 172.21.15.156:0/1011957314 conn(0x7fbe24099c40 msgr2=0x7fbe240a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:38.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.768+0000 7fbe2a282700 1 -- 172.21.15.156:0/1011957314 shutdown_connections 2023-09-30T22:19:38.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.768+0000 7f8872782700 1 --2- 172.21.15.156:0/1850937077 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f886c130ce0 0x7f886c11f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:38.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.768+0000 7f8871780700 1 --2- 172.21.15.156:0/1850937077 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f886c09e170 0x7f886c11ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:38.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.768+0000 7f8871f81700 1 -- 172.21.15.156:0/1850937077 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f886c130ce0 msgr2=0x7f886c11f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:38.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.768+0000 7f8871f81700 1 --2- 172.21.15.156:0/1850937077 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f886c130ce0 0x7f886c11f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:38.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.768+0000 7f8871f81700 1 -- 172.21.15.156:0/1850937077 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f886c09e170 msgr2=0x7f886c11ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:38.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.768+0000 7f8871f81700 1 --2- 172.21.15.156:0/1850937077 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f886c09e170 0x7f886c11ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:38.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.768+0000 7f8871f81700 1 -- 172.21.15.156:0/1850937077 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886800b7f0 con 0x7f886c09d860 2023-09-30T22:19:38.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.768+0000 7f8872782700 1 --2- 172.21.15.156:0/1850937077 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f886c130ce0 0x7f886c11f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:19:38.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.769+0000 7fbe2a282700 1 -- 172.21.15.156:0/1011957314 wait complete. 2023-09-30T22:19:38.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.769+0000 7f8871f81700 1 --2- 172.21.15.156:0/1850937077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f886c09d860 0x7f886c11e730 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f886800b340 tx=0x7f8868004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:38.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.769+0000 7f88627fc700 1 -- 172.21.15.156:0/1850937077 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8868010470 con 0x7f886c09d860 2023-09-30T22:19:38.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.769+0000 7f88627fc700 1 -- 172.21.15.156:0/1850937077 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88680105d0 con 0x7f886c09d860 2023-09-30T22:19:38.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.769+0000 7f88627fc700 1 -- 172.21.15.156:0/1850937077 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8868010980 con 0x7f886c09d860 2023-09-30T22:19:38.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.769+0000 7fbe2a282700 1 Processor -- start 2023-09-30T22:19:38.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.769+0000 7f88741e5700 1 -- 172.21.15.156:0/1850937077 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f886c1208b0 con 0x7f886c09d860 2023-09-30T22:19:38.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.770+0000 7f88741e5700 1 -- 172.21.15.156:0/1850937077 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f886c1229a0 con 0x7f886c09d860 2023-09-30T22:19:38.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.770+0000 7fbe2a282700 1 -- start start 2023-09-30T22:19:38.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.770+0000 7fbe2a282700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe2409d860 0x7fbe24119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:38.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.770+0000 7fbe2a282700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe2409e170 0x7fbe24119b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:38.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.770+0000 7fbe2a282700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe24130ce0 0x7fbe2411a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:38.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.770+0000 7fbe2a282700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2411b7e0 con 0x7fbe24130ce0 2023-09-30T22:19:38.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.770+0000 7fbe2a282700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe240a2260 con 0x7fbe2409d860 2023-09-30T22:19:38.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.770+0000 7fbe2a282700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2409c8b0 con 0x7fbe2409e170 2023-09-30T22:19:38.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.770+0000 7fbe23fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe2409d860 0x7fbe24119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:38.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.770+0000 7fbe23fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe2409d860 0x7fbe24119630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52288/0 (socket says 172.21.15.156:52288) 2023-09-30T22:19:38.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.770+0000 7fbe23fff700 1 -- 172.21.15.156:0/2202833843 learned_addr learned my addr 172.21.15.156:0/2202833843 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:38.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.771+0000 7f884ffff700 1 -- 172.21.15.156:0/1850937077 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88480052e0 con 0x7f886c09d860 2023-09-30T22:19:38.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.771+0000 7fbe23fff700 1 -- 172.21.15.156:0/2202833843 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe2409e170 msgr2=0x7fbe24119b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:38.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.771+0000 7fbe23fff700 1 --2- 172.21.15.156:0/2202833843 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe2409e170 0x7fbe24119b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:38.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.771+0000 7fbe23fff700 1 -- 172.21.15.156:0/2202833843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe24130ce0 msgr2=0x7fbe2411a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:38.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.771+0000 7fbe23fff700 1 --2- 172.21.15.156:0/2202833843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe24130ce0 0x7fbe2411a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:38.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.771+0000 7fbe23fff700 1 -- 172.21.15.156:0/2202833843 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe140094a0 con 0x7fbe2409d860 2023-09-30T22:19:38.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.771+0000 7fbe23fff700 1 --2- 172.21.15.156:0/2202833843 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe2409d860 0x7fbe24119630 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbe140090b0 tx=0x7fbe14004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:38.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.771+0000 7f88627fc700 1 -- 172.21.15.156:0/1850937077 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f886802c460 con 0x7f886c09d860 2023-09-30T22:19:38.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.773+0000 7fbe20ff9700 1 -- 172.21.15.156:0/2202833843 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe140045f0 con 0x7fbe2409d860 2023-09-30T22:19:38.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.773+0000 7fbe20ff9700 1 -- 172.21.15.156:0/2202833843 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1401f070 con 0x7fbe2409d860 2023-09-30T22:19:38.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.773+0000 7fbe2a282700 1 -- 172.21.15.156:0/2202833843 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe2411bd70 con 0x7fbe2409d860 2023-09-30T22:19:38.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.773+0000 7fbe20ff9700 1 -- 172.21.15.156:0/2202833843 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe14011630 con 0x7fbe2409d860 2023-09-30T22:19:38.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.773+0000 7fbe2a282700 1 -- 172.21.15.156:0/2202833843 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe2413e9a0 con 0x7fbe2409d860 2023-09-30T22:19:38.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.774+0000 7fbe20ff9700 1 -- 172.21.15.156:0/2202833843 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe14021030 con 0x7fbe2409d860 2023-09-30T22:19:38.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.774+0000 7fbe20ff9700 1 -- 172.21.15.156:0/2202833843 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbe14040930 con 0x7fbe2409d860 2023-09-30T22:19:38.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.774+0000 7fbe2a282700 1 -- 172.21.15.156:0/2202833843 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe2404f2a0 con 0x7fbe2409d860 2023-09-30T22:19:38.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.777+0000 7f88627fc700 1 -- 172.21.15.156:0/1850937077 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f886802b590 con 0x7f886c09d860 2023-09-30T22:19:38.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.778+0000 7f88627fc700 1 -- 172.21.15.156:0/1850937077 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f886802a970 con 0x7f886c09d860 2023-09-30T22:19:38.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.781+0000 7fbe20ff9700 1 -- 172.21.15.156:0/2202833843 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe140117b0 con 0x7fbe2409d860 2023-09-30T22:19:38.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.832+0000 7f72bd1c7700 1 Processor -- start 2023-09-30T22:19:38.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.832+0000 7f72bd1c7700 1 -- start start 2023-09-30T22:19:38.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.832+0000 7f72bd1c7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f72b80a0a70 0x7f72b80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:38.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.832+0000 7f72bd1c7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72b8134120 0x7f72b813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:38.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.832+0000 7f72bd1c7700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b809dc00 con 0x7f72b80a1380 2023-09-30T22:19:38.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.832+0000 7f72bd1c7700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b809ea90 con 0x7f72b80a0a70 2023-09-30T22:19:38.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.832+0000 7f72bd1c7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b809dec0 con 0x7f72b8134120 2023-09-30T22:19:38.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.833+0000 7f72b759e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72b8134120 0x7f72b813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:38.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.833+0000 7f72b759e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72b8134120 0x7f72b813bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52304/0 (socket says 172.21.15.156:52304) 2023-09-30T22:19:38.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.833+0000 7f72b759e700 1 -- 172.21.15.156:0/453633863 learned_addr learned my addr 172.21.15.156:0/453633863 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:38.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.833+0000 7f72b6d9d700 1 --2- 172.21.15.156:0/453633863 >> v2:172.21.15.156:3300/0 conn(0x7f72b80a0a70 0x7f72b80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:38.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.833+0000 7f72b6d9d700 1 -- 172.21.15.156:0/453633863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72b8134120 msgr2=0x7f72b813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:38.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.833+0000 7f72b6d9d700 1 --2- 172.21.15.156:0/453633863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72b8134120 0x7f72b813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:38.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.833+0000 7f72b6d9d700 1 -- 172.21.15.156:0/453633863 >> v1:172.21.15.156:6789/0 conn(0x7f72b80a1380 legacy=0x7f72b8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:38.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.833+0000 7f72b6d9d700 1 -- 172.21.15.156:0/453633863 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b809e6a0 con 0x7f72b80a0a70 2023-09-30T22:19:38.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.833+0000 7f72b6d9d700 1 --2- 172.21.15.156:0/453633863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72b80a0a70 0x7f72b80a0e40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009840 tx=0x7f72a8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3bb9508b1801947 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:38.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.833+0000 7f72b5d9b700 1 -- 172.21.15.156:0/453633863 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a8011830 con 0x7f72b80a0a70 2023-09-30T22:19:38.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.833+0000 7f72b5d9b700 1 -- 172.21.15.156:0/453633863 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a8011990 con 0x7f72b80a0a70 2023-09-30T22:19:38.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.833+0000 7f72b5d9b700 1 -- 172.21.15.156:0/453633863 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a8011d20 con 0x7f72b80a0a70 2023-09-30T22:19:38.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.834+0000 7f72bd1c7700 1 -- 172.21.15.156:0/453633863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72b80a0a70 msgr2=0x7f72b80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:38.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.834+0000 7f72bd1c7700 1 --2- 172.21.15.156:0/453633863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72b80a0a70 0x7f72b80a0e40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009840 tx=0x7f72a8009b50 comp rx=0 tx=0).stop 2023-09-30T22:19:38.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.834+0000 7f72bd1c7700 1 -- 172.21.15.156:0/453633863 shutdown_connections 2023-09-30T22:19:38.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.834+0000 7f72bd1c7700 1 --2- 172.21.15.156:0/453633863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72b8134120 0x7f72b813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:38.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.834+0000 7f72bd1c7700 1 --2- 172.21.15.156:0/453633863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72b80a0a70 0x7f72b80a0e40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:38.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.834+0000 7f72bd1c7700 1 -- 172.21.15.156:0/453633863 >> 172.21.15.156:0/453633863 conn(0x7f72b80a6610 msgr2=0x7f72b80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:38.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.834+0000 7f72bd1c7700 1 -- 172.21.15.156:0/453633863 shutdown_connections 2023-09-30T22:19:38.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.834+0000 7f72bd1c7700 1 -- 172.21.15.156:0/453633863 wait complete. 2023-09-30T22:19:38.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.836+0000 7f72bd1c7700 1 Processor -- start 2023-09-30T22:19:38.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.836+0000 7f72bd1c7700 1 -- start start 2023-09-30T22:19:38.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.836+0000 7f72bd1c7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72b80a0a70 0x7f72b81272d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:38.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.836+0000 7f72bd1c7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72b80a1380 0x7f72b8127810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:38.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.837+0000 7f72bd1c7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72b8134120 0x7f72b8127d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:38.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.837+0000 7f72bd1c7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b8128fb0 con 0x7f72b80a0a70 2023-09-30T22:19:38.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.837+0000 7f72bd1c7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b812a0f0 con 0x7f72b80a1380 2023-09-30T22:19:38.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.837+0000 7f72bd1c7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72b8128dc0 con 0x7f72b8134120 2023-09-30T22:19:38.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.837+0000 7f72b759e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72b8134120 0x7f72b8127d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:38.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.837+0000 7f72b759e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72b8134120 0x7f72b8127d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56326/0 (socket says 172.21.15.156:56326) 2023-09-30T22:19:38.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.837+0000 7f72b759e700 1 -- 172.21.15.156:0/1453976640 learned_addr learned my addr 172.21.15.156:0/1453976640 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:38.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.837+0000 7f72b6d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72b80a0a70 0x7f72b81272d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:38.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.837+0000 7f72b659c700 1 --2- 172.21.15.156:0/1453976640 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72b80a1380 0x7f72b8127810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:38.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.837+0000 7f72b6d9d700 1 -- 172.21.15.156:0/1453976640 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72b8134120 msgr2=0x7f72b8127d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:38.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.837+0000 7f72b6d9d700 1 --2- 172.21.15.156:0/1453976640 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72b8134120 0x7f72b8127d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:38.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.837+0000 7f72b6d9d700 1 -- 172.21.15.156:0/1453976640 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72b80a1380 msgr2=0x7f72b8127810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:38.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.837+0000 7f72b6d9d700 1 --2- 172.21.15.156:0/1453976640 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72b80a1380 0x7f72b8127810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:38.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.837+0000 7f72b6d9d700 1 -- 172.21.15.156:0/1453976640 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a80094a0 con 0x7f72b80a0a70 2023-09-30T22:19:38.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.837+0000 7f72b759e700 1 --2- 172.21.15.156:0/1453976640 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72b8134120 0x7f72b8127d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:38.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.837+0000 7f72b6d9d700 1 --2- 172.21.15.156:0/1453976640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72b80a0a70 0x7f72b81272d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f72b809ff60 tx=0x7f72a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:38.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.838+0000 7f729f7fe700 1 -- 172.21.15.156:0/1453976640 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a80036a0 con 0x7f72b80a0a70 2023-09-30T22:19:38.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.838+0000 7f729f7fe700 1 -- 172.21.15.156:0/1453976640 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a801f070 con 0x7f72b80a0a70 2023-09-30T22:19:38.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.838+0000 7f72bd1c7700 1 -- 172.21.15.156:0/1453976640 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b80a03e0 con 0x7f72b80a0a70 2023-09-30T22:19:38.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.838+0000 7f729f7fe700 1 -- 172.21.15.156:0/1453976640 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a8003a60 con 0x7f72b80a0a70 2023-09-30T22:19:38.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.838+0000 7f72bd1c7700 1 -- 172.21.15.156:0/1453976640 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b812a9f0 con 0x7f72b80a0a70 2023-09-30T22:19:38.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.839+0000 7f729f7fe700 1 -- 172.21.15.156:0/1453976640 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f72a8003bc0 con 0x7f72b80a0a70 2023-09-30T22:19:38.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.839+0000 7f72bd1c7700 1 -- 172.21.15.156:0/1453976640 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b80a2970 con 0x7f72b80a0a70 2023-09-30T22:19:38.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.839+0000 7f729f7fe700 1 -- 172.21.15.156:0/1453976640 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f72a8021070 con 0x7f72b80a0a70 2023-09-30T22:19:38.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.844+0000 7f729f7fe700 1 -- 172.21.15.156:0/1453976640 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f72a802b070 con 0x7f72b80a0a70 2023-09-30T22:19:38.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.972+0000 7f884ffff700 1 -- 172.21.15.156:0/1850937077 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8848005860 con 0x7f886c09d860 2023-09-30T22:19:38.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.974+0000 7f88627fc700 1 -- 172.21.15.156:0/1850937077 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f886802b3d0 con 0x7f886c09d860 2023-09-30T22:19:38.974 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:38.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.977+0000 7f884ffff700 1 -- 172.21.15.156:0/1850937077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f886c09d860 msgr2=0x7f886c11e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:38.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.977+0000 7f884ffff700 1 --2- 172.21.15.156:0/1850937077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f886c09d860 0x7f886c11e730 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f886800b340 tx=0x7f8868004750 comp rx=0 tx=0).stop 2023-09-30T22:19:38.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.977+0000 7f884ffff700 1 -- 172.21.15.156:0/1850937077 shutdown_connections 2023-09-30T22:19:38.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.977+0000 7f884ffff700 1 --2- 172.21.15.156:0/1850937077 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f886c130ce0 0x7f886c11f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:38.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.977+0000 7f884ffff700 1 --2- 172.21.15.156:0/1850937077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f886c09d860 0x7f886c11e730 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:38.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.977+0000 7f884ffff700 1 --2- 172.21.15.156:0/1850937077 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f886c09e170 0x7f886c11ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:38.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.977+0000 7f884ffff700 1 -- 172.21.15.156:0/1850937077 >> 172.21.15.156:0/1850937077 conn(0x7f886c099c40 msgr2=0x7f886c070f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:38.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.977+0000 7f884ffff700 1 -- 172.21.15.156:0/1850937077 shutdown_connections 2023-09-30T22:19:38.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.977+0000 7f884ffff700 1 -- 172.21.15.156:0/1850937077 wait complete. 2023-09-30T22:19:38.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.978+0000 7fbe2a282700 1 -- 172.21.15.156:0/2202833843 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbe2404f2a0 con 0x7fbe2409d860 2023-09-30T22:19:38.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.978+0000 7fbe20ff9700 1 -- 172.21.15.156:0/2202833843 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbe140233d0 con 0x7fbe2409d860 2023-09-30T22:19:38.979 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:38.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.981+0000 7fbe2a282700 1 -- 172.21.15.156:0/2202833843 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe2409d860 msgr2=0x7fbe24119630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:38.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.981+0000 7fbe2a282700 1 --2- 172.21.15.156:0/2202833843 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe2409d860 0x7fbe24119630 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbe140090b0 tx=0x7fbe14004750 comp rx=0 tx=0).stop 2023-09-30T22:19:38.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.981+0000 7fbe2a282700 1 -- 172.21.15.156:0/2202833843 shutdown_connections 2023-09-30T22:19:38.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.981+0000 7fbe2a282700 1 --2- 172.21.15.156:0/2202833843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe24130ce0 0x7fbe2411a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:38.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.981+0000 7fbe2a282700 1 --2- 172.21.15.156:0/2202833843 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe2409d860 0x7fbe24119630 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:38.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.981+0000 7fbe2a282700 1 --2- 172.21.15.156:0/2202833843 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe2409e170 0x7fbe24119b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:38.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.981+0000 7fbe2a282700 1 -- 172.21.15.156:0/2202833843 >> 172.21.15.156:0/2202833843 conn(0x7fbe24099c40 msgr2=0x7fbe24070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:38.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.981+0000 7fbe2a282700 1 -- 172.21.15.156:0/2202833843 shutdown_connections 2023-09-30T22:19:38.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:38.982+0000 7fbe2a282700 1 -- 172.21.15.156:0/2202833843 wait complete. 2023-09-30T22:19:38.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:39.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:39.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:39.005+0000 7f89de821700 1 -- 172.21.15.156:0/4005745499 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f89d8125fa0 con 0x7f89d80a0a70 2023-09-30T22:19:39.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:39.006+0000 7f89d4ff9700 1 -- 172.21.15.156:0/4005745499 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f89d8125fa0 con 0x7f89d80a0a70 2023-09-30T22:19:39.006 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:39.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:39.008+0000 7f89de821700 1 -- 172.21.15.156:0/4005745499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89d80a0a70 msgr2=0x7f89d8122920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:39.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:39.008+0000 7f89de821700 1 --2- 172.21.15.156:0/4005745499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89d80a0a70 0x7f89d8122920 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f89c800e910 tx=0x7f89c800ec20 comp rx=0 tx=0).stop 2023-09-30T22:19:39.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:39.008+0000 7f89de821700 1 -- 172.21.15.156:0/4005745499 shutdown_connections 2023-09-30T22:19:39.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:39.008+0000 7f89de821700 1 --2- 172.21.15.156:0/4005745499 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89d8134120 0x7f89d81233a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:39.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:39.008+0000 7f89de821700 1 --2- 172.21.15.156:0/4005745499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89d80a0a70 0x7f89d8122920 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:39.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:39.008+0000 7f89de821700 1 --2- 172.21.15.156:0/4005745499 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89d80a1380 0x7f89d8122e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:39.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:39.008+0000 7f89de821700 1 -- 172.21.15.156:0/4005745499 >> 172.21.15.156:0/4005745499 conn(0x7f89d80a6610 msgr2=0x7f89d80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:39.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:39.008+0000 7f89de821700 1 -- 172.21.15.156:0/4005745499 shutdown_connections 2023-09-30T22:19:39.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:39.008+0000 7f89de821700 1 -- 172.21.15.156:0/4005745499 wait complete. 2023-09-30T22:19:39.021 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:39.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:39.055+0000 7f72bd1c7700 1 -- 172.21.15.156:0/1453976640 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f72b804f2a0 con 0x7f72b80a0a70 2023-09-30T22:19:39.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:39.055+0000 7f729f7fe700 1 -- 172.21.15.156:0/1453976640 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f72a8015030 con 0x7f72b80a0a70 2023-09-30T22:19:39.056 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:39.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:39.057+0000 7f72bd1c7700 1 -- 172.21.15.156:0/1453976640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72b80a0a70 msgr2=0x7f72b81272d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:39.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:39.057+0000 7f72bd1c7700 1 --2- 172.21.15.156:0/1453976640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72b80a0a70 0x7f72b81272d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f72b809ff60 tx=0x7f72a8004750 comp rx=0 tx=0).stop 2023-09-30T22:19:39.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:39.057+0000 7f72bd1c7700 1 -- 172.21.15.156:0/1453976640 shutdown_connections 2023-09-30T22:19:39.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:39.057+0000 7f72bd1c7700 1 --2- 172.21.15.156:0/1453976640 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72b8134120 0x7f72b8127d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:39.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:39.057+0000 7f72bd1c7700 1 --2- 172.21.15.156:0/1453976640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72b80a0a70 0x7f72b81272d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:39.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:39.057+0000 7f72bd1c7700 1 --2- 172.21.15.156:0/1453976640 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72b80a1380 0x7f72b8127810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:39.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:39.057+0000 7f72bd1c7700 1 -- 172.21.15.156:0/1453976640 >> 172.21.15.156:0/1453976640 conn(0x7f72b80a6610 msgr2=0x7f72b80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:39.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:39.057+0000 7f72bd1c7700 1 -- 172.21.15.156:0/1453976640 shutdown_connections 2023-09-30T22:19:39.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:39.057+0000 7f72bd1c7700 1 -- 172.21.15.156:0/1453976640 wait complete. 2023-09-30T22:19:39.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:39.992 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:40.001 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:40.022 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:40.071 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:40.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.135+0000 7f4bd5587700 1 Processor -- start 2023-09-30T22:19:40.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.135+0000 7f4bd5587700 1 -- start start 2023-09-30T22:19:40.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.136+0000 7f4bd5587700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bd00a0a30 0x7f4bd00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:40.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.136+0000 7f4bd5587700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4bd00a1340 0x7f4bd012ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:40.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.136+0000 7f4bd5587700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4bd01304a0 0x7f4bd01308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:40.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.136+0000 7f4bd5587700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd0130e30 con 0x7f4bd01304a0 2023-09-30T22:19:40.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.136+0000 7f4bd5587700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd00a1e70 con 0x7f4bd00a0a30 2023-09-30T22:19:40.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.136+0000 7f4bd5587700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd009a720 con 0x7f4bd00a1340 2023-09-30T22:19:40.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.136+0000 7f4bce7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4bd00a1340 0x7f4bd012ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:40.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.136+0000 7f4bce7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4bd00a1340 0x7f4bd012ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56328/0 (socket says 172.21.15.156:56328) 2023-09-30T22:19:40.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.136+0000 7f4bce7fc700 1 -- 172.21.15.156:0/3684023473 learned_addr learned my addr 172.21.15.156:0/3684023473 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:40.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.136+0000 7f4bcf7fe700 1 --2- 172.21.15.156:0/3684023473 >> v2:172.21.15.156:3300/0 conn(0x7f4bd01304a0 0x7f4bd01308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:40.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.136+0000 7f4bceffd700 1 --2- 172.21.15.156:0/3684023473 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bd00a0a30 0x7f4bd00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:40.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.136+0000 7f4bce7fc700 1 -- 172.21.15.156:0/3684023473 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bd00a0a30 msgr2=0x7f4bd00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:40.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.136+0000 7f4bce7fc700 1 --2- 172.21.15.156:0/3684023473 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bd00a0a30 0x7f4bd00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.136+0000 7f4bce7fc700 1 -- 172.21.15.156:0/3684023473 >> v2:172.21.15.156:3300/0 conn(0x7f4bd01304a0 msgr2=0x7f4bd01308f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:40.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.136+0000 7f4bce7fc700 1 --2- 172.21.15.156:0/3684023473 >> v2:172.21.15.156:3300/0 conn(0x7f4bd01304a0 0x7f4bd01308f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.136+0000 7f4bce7fc700 1 -- 172.21.15.156:0/3684023473 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd009b300 con 0x7f4bd00a1340 2023-09-30T22:19:40.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.136+0000 7f4bce7fc700 1 --2- 172.21.15.156:0/3684023473 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4bd00a1340 0x7f4bd012ff60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4006e60 tx=0x7f4bc4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1247743bd922a1bf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:40.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.137+0000 7f4bcdffb700 1 -- 172.21.15.156:0/3684023473 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc4004230 con 0x7f4bd00a1340 2023-09-30T22:19:40.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.137+0000 7f4bcdffb700 1 -- 172.21.15.156:0/3684023473 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc4004390 con 0x7f4bd00a1340 2023-09-30T22:19:40.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.137+0000 7f4bcdffb700 1 -- 172.21.15.156:0/3684023473 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc4010380 con 0x7f4bd00a1340 2023-09-30T22:19:40.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.138+0000 7f4bd5587700 1 -- 172.21.15.156:0/3684023473 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4bd00a1340 msgr2=0x7f4bd012ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:40.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.138+0000 7f4bd5587700 1 --2- 172.21.15.156:0/3684023473 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4bd00a1340 0x7f4bd012ff60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4006e60 tx=0x7f4bc4009c30 comp rx=0 tx=0).stop 2023-09-30T22:19:40.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.138+0000 7f4bd5587700 1 -- 172.21.15.156:0/3684023473 shutdown_connections 2023-09-30T22:19:40.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.138+0000 7f4bd5587700 1 --2- 172.21.15.156:0/3684023473 >> v2:172.21.15.156:3300/0 conn(0x7f4bd01304a0 0x7f4bd01308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.138+0000 7f4bd5587700 1 --2- 172.21.15.156:0/3684023473 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bd00a0a30 0x7f4bd00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.138+0000 7f4bd5587700 1 --2- 172.21.15.156:0/3684023473 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4bd00a1340 0x7f4bd012ff60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.138+0000 7f4bd5587700 1 -- 172.21.15.156:0/3684023473 >> 172.21.15.156:0/3684023473 conn(0x7f4bd00a2980 msgr2=0x7f4bd00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:40.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.138+0000 7f4bd5587700 1 -- 172.21.15.156:0/3684023473 shutdown_connections 2023-09-30T22:19:40.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.138+0000 7f4bd5587700 1 -- 172.21.15.156:0/3684023473 wait complete. 2023-09-30T22:19:40.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.139+0000 7f4bd5587700 1 Processor -- start 2023-09-30T22:19:40.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.139+0000 7f4bd5587700 1 -- start start 2023-09-30T22:19:40.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.139+0000 7f4bd5587700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4bd00a0a30 0x7f4bd011ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:40.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.139+0000 7f4bd5587700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bd00a1340 0x7f4bd011b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:40.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.139+0000 7f4bd5587700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4bd01304a0 0x7f4bd011b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:40.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.139+0000 7f4bd5587700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd011e640 con 0x7f4bd01304a0 2023-09-30T22:19:40.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.139+0000 7f4bd5587700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd011cb20 con 0x7f4bd00a1340 2023-09-30T22:19:40.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.139+0000 7f4bd5587700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd009ae00 con 0x7f4bd00a0a30 2023-09-30T22:19:40.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.140+0000 7f4bce7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bd00a1340 0x7f4bd011b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:40.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.140+0000 7f4bcf7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4bd01304a0 0x7f4bd011b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:40.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.140+0000 7f4bce7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bd00a1340 0x7f4bd011b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52328/0 (socket says 172.21.15.156:52328) 2023-09-30T22:19:40.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.140+0000 7f4bce7fc700 1 -- 172.21.15.156:0/2197765544 learned_addr learned my addr 172.21.15.156:0/2197765544 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:40.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.140+0000 7f4bcf7fe700 1 -- 172.21.15.156:0/2197765544 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4bd00a0a30 msgr2=0x7f4bd011ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:40.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.140+0000 7f4bcf7fe700 1 --2- 172.21.15.156:0/2197765544 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4bd00a0a30 0x7f4bd011ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.140+0000 7f4bcf7fe700 1 -- 172.21.15.156:0/2197765544 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bd00a1340 msgr2=0x7f4bd011b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:40.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.140+0000 7f4bcf7fe700 1 --2- 172.21.15.156:0/2197765544 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bd00a1340 0x7f4bd011b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.140+0000 7f4bcf7fe700 1 -- 172.21.15.156:0/2197765544 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc4009550 con 0x7f4bd01304a0 2023-09-30T22:19:40.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.140+0000 7f4bce7fc700 1 --2- 172.21.15.156:0/2197765544 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bd00a1340 0x7f4bd011b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:40.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.140+0000 7f4bcf7fe700 1 --2- 172.21.15.156:0/2197765544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4bd01304a0 0x7f4bd011b910 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4bc800efc0 tx=0x7f4bc800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:40.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.140+0000 7f4bb77fe700 1 -- 172.21.15.156:0/2197765544 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc800cd40 con 0x7f4bd01304a0 2023-09-30T22:19:40.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.140+0000 7f4bb77fe700 1 -- 172.21.15.156:0/2197765544 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc800f040 con 0x7f4bd01304a0 2023-09-30T22:19:40.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.140+0000 7f4bb77fe700 1 -- 172.21.15.156:0/2197765544 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc80146c0 con 0x7f4bd01304a0 2023-09-30T22:19:40.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.140+0000 7f4bd5587700 1 -- 172.21.15.156:0/2197765544 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd009f050 con 0x7f4bd01304a0 2023-09-30T22:19:40.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.141+0000 7f4bd5587700 1 -- 172.21.15.156:0/2197765544 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd011f0b0 con 0x7f4bd01304a0 2023-09-30T22:19:40.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.141+0000 7f4bb77fe700 1 -- 172.21.15.156:0/2197765544 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4bc8014820 con 0x7f4bd01304a0 2023-09-30T22:19:40.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.142+0000 7f4bb77fe700 1 -- 172.21.15.156:0/2197765544 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4bc8040250 con 0x7f4bd01304a0 2023-09-30T22:19:40.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.142+0000 7f4bd5587700 1 -- 172.21.15.156:0/2197765544 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd011e2c0 con 0x7f4bd01304a0 2023-09-30T22:19:40.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.151+0000 7f4bb77fe700 1 -- 172.21.15.156:0/2197765544 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4bd011e2c0 con 0x7f4bd01304a0 2023-09-30T22:19:40.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.179+0000 7faec8e9d700 1 Processor -- start 2023-09-30T22:19:40.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.179+0000 7faec8e9d700 1 -- start start 2023-09-30T22:19:40.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.180+0000 7faec8e9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faec4099e20 0x7faec409a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:40.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.180+0000 7faec8e9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7faec409a730 0x7faec4130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:40.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.180+0000 7faec8e9d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec4099a60 con 0x7faec4130890 2023-09-30T22:19:40.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.180+0000 7faec8e9d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec409bf50 con 0x7faec409a730 2023-09-30T22:19:40.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.180+0000 7faec8e9d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faec409b230 con 0x7faec4099e20 2023-09-30T22:19:40.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.180+0000 7faec259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faec4099e20 0x7faec409a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:40.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.180+0000 7faec259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faec4099e20 0x7faec409a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56344/0 (socket says 172.21.15.156:56344) 2023-09-30T22:19:40.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.180+0000 7faec259c700 1 -- 172.21.15.156:0/3371442808 learned_addr learned my addr 172.21.15.156:0/3371442808 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:40.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.180+0000 7faec1d9b700 1 --2- 172.21.15.156:0/3371442808 >> v2:172.21.15.156:3300/0 conn(0x7faec409a730 0x7faec4130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:40.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.180+0000 7faec159a700 1 -- 172.21.15.156:0/3371442808 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916060667 0 0) 0x7faec4099a60 con 0x7faec4130890 2023-09-30T22:19:40.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.180+0000 7faec259c700 1 -- 172.21.15.156:0/3371442808 >> v2:172.21.15.156:3300/0 conn(0x7faec409a730 msgr2=0x7faec4130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:40.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.180+0000 7faec259c700 1 --2- 172.21.15.156:0/3371442808 >> v2:172.21.15.156:3300/0 conn(0x7faec409a730 0x7faec4130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.180+0000 7faec259c700 1 -- 172.21.15.156:0/3371442808 >> v1:172.21.15.156:6789/0 conn(0x7faec4130890 legacy=0x7faec4137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:40.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.180+0000 7faec259c700 1 -- 172.21.15.156:0/3371442808 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec409bb90 con 0x7faec4099e20 2023-09-30T22:19:40.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.181+0000 7faec259c700 1 --2- 172.21.15.156:0/3371442808 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faec4099e20 0x7faec409a1f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faeb4006fd0 tx=0x7faeb400be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeefab4c35f22899 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:40.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.181+0000 7faec159a700 1 -- 172.21.15.156:0/3371442808 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4005e30 con 0x7faec4099e20 2023-09-30T22:19:40.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.181+0000 7faec159a700 1 -- 172.21.15.156:0/3371442808 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb4004030 con 0x7faec4099e20 2023-09-30T22:19:40.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.181+0000 7faec159a700 1 -- 172.21.15.156:0/3371442808 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb40043e0 con 0x7faec4099e20 2023-09-30T22:19:40.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.181+0000 7faec8e9d700 1 -- 172.21.15.156:0/3371442808 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faec4099e20 msgr2=0x7faec409a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:40.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.181+0000 7faec8e9d700 1 --2- 172.21.15.156:0/3371442808 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faec4099e20 0x7faec409a1f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faeb4006fd0 tx=0x7faeb400be70 comp rx=0 tx=0).stop 2023-09-30T22:19:40.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.181+0000 7faec8e9d700 1 -- 172.21.15.156:0/3371442808 shutdown_connections 2023-09-30T22:19:40.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.181+0000 7faec8e9d700 1 --2- 172.21.15.156:0/3371442808 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faec4099e20 0x7faec409a1f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.181+0000 7faec8e9d700 1 --2- 172.21.15.156:0/3371442808 >> v2:172.21.15.156:3300/0 conn(0x7faec409a730 0x7faec4130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.181+0000 7faec8e9d700 1 -- 172.21.15.156:0/3371442808 >> 172.21.15.156:0/3371442808 conn(0x7faec40a2980 msgr2=0x7faec40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:40.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.182+0000 7faec8e9d700 1 -- 172.21.15.156:0/3371442808 shutdown_connections 2023-09-30T22:19:40.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.182+0000 7faec8e9d700 1 -- 172.21.15.156:0/3371442808 wait complete. 2023-09-30T22:19:40.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.183+0000 7faec8e9d700 1 Processor -- start 2023-09-30T22:19:40.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.183+0000 7faec8e9d700 1 -- start start 2023-09-30T22:19:40.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.183+0000 7fca6ab01700 1 Processor -- start 2023-09-30T22:19:40.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.183+0000 7fca6ab01700 1 -- start start 2023-09-30T22:19:40.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.183+0000 7fca6ab01700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca641347c0 0x7fca64136ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:40.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.183+0000 7fca6ab01700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca641370e0 0x7fca641394c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:40.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.183+0000 7fca6ab01700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca640a1870 con 0x7fca64131830 2023-09-30T22:19:40.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.183+0000 7fca6ab01700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca64131630 con 0x7fca641347c0 2023-09-30T22:19:40.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.183+0000 7fca6ab01700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca640a2300 con 0x7fca641370e0 2023-09-30T22:19:40.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.184+0000 7faec8e9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faec4099e20 0x7faec41c4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:40.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.184+0000 7faec8e9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faec409a730 0x7faec41c4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:40.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.184+0000 7faec8e9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faec4130890 0x7faec41c0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:40.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.184+0000 7faec8e9d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec411b9e0 con 0x7faec4099e20 2023-09-30T22:19:40.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.184+0000 7faec8e9d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec411d3f0 con 0x7faec4130890 2023-09-30T22:19:40.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.184+0000 7faec8e9d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faec411daa0 con 0x7faec409a730 2023-09-30T22:19:40.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.184+0000 7fca6889d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fca64131830 0x7fca64131c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48580/0 (socket says 172.21.15.156:48580) 2023-09-30T22:19:40.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.184+0000 7fca6889d700 1 -- 172.21.15.156:0/2076127349 learned_addr learned my addr 172.21.15.156:0/2076127349 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:40.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.184+0000 7faec259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faec4099e20 0x7faec41c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:40.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.184+0000 7faec259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faec4099e20 0x7faec41c4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38802/0 (socket says 172.21.15.156:38802) 2023-09-30T22:19:40.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.184+0000 7faec259c700 1 -- 172.21.15.156:0/2819613260 learned_addr learned my addr 172.21.15.156:0/2819613260 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:40.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.184+0000 7faec259c700 1 -- 172.21.15.156:0/2819613260 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faec409a730 msgr2=0x7faec41c4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:40.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.184+0000 7faec259c700 1 --2- 172.21.15.156:0/2819613260 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faec409a730 0x7faec41c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.184+0000 7faec259c700 1 -- 172.21.15.156:0/2819613260 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faec4130890 msgr2=0x7faec41c0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:40.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.184+0000 7faec259c700 1 --2- 172.21.15.156:0/2819613260 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faec4130890 0x7faec41c0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.184+0000 7faec259c700 1 -- 172.21.15.156:0/2819613260 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb400b7a0 con 0x7faec4099e20 2023-09-30T22:19:40.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.184+0000 7faec259c700 1 --2- 172.21.15.156:0/2819613260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faec4099e20 0x7faec41c4020 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7faeb4000c00 tx=0x7faeb4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:40.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.184+0000 7fca63fff700 1 --2- 172.21.15.156:0/2076127349 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca641347c0 0x7fca64136ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:40.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.185+0000 7fca6909e700 1 --2- 172.21.15.156:0/2076127349 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca641370e0 0x7fca641394c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:40.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.185+0000 7fca63fff700 1 -- 172.21.15.156:0/2076127349 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca641370e0 msgr2=0x7fca641394c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:40.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.185+0000 7fca63fff700 1 --2- 172.21.15.156:0/2076127349 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca641370e0 0x7fca641394c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.185+0000 7fca63fff700 1 -- 172.21.15.156:0/2076127349 >> v1:172.21.15.156:6789/0 conn(0x7fca64131830 legacy=0x7fca64131c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:40.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.185+0000 7fca63fff700 1 -- 172.21.15.156:0/2076127349 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca6406e130 con 0x7fca641347c0 2023-09-30T22:19:40.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.185+0000 7faeb2ffd700 1 -- 172.21.15.156:0/2819613260 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb401e070 con 0x7faec4099e20 2023-09-30T22:19:40.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.185+0000 7faeb2ffd700 1 -- 172.21.15.156:0/2819613260 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb40038b0 con 0x7faec4099e20 2023-09-30T22:19:40.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.185+0000 7fca63fff700 1 --2- 172.21.15.156:0/2076127349 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca641347c0 0x7fca64136ba0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fca50009870 tx=0x7fca50009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e407c821e5acba38 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:40.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.185+0000 7faeb2ffd700 1 -- 172.21.15.156:0/2819613260 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4003c40 con 0x7faec4099e20 2023-09-30T22:19:40.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.185+0000 7faec8e9d700 1 -- 172.21.15.156:0/2819613260 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec411dd60 con 0x7faec4099e20 2023-09-30T22:19:40.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.185+0000 7faec8e9d700 1 -- 172.21.15.156:0/2819613260 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec411cf30 con 0x7faec4099e20 2023-09-30T22:19:40.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.185+0000 7fca637fe700 1 -- 172.21.15.156:0/2076127349 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca50011830 con 0x7fca641347c0 2023-09-30T22:19:40.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.185+0000 7fca637fe700 1 -- 172.21.15.156:0/2076127349 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca50011990 con 0x7fca641347c0 2023-09-30T22:19:40.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.185+0000 7fca637fe700 1 -- 172.21.15.156:0/2076127349 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca50011d20 con 0x7fca641347c0 2023-09-30T22:19:40.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.186+0000 7faec8e9d700 1 -- 172.21.15.156:0/2819613260 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec404f2a0 con 0x7faec4099e20 2023-09-30T22:19:40.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.186+0000 7faeb2ffd700 1 -- 172.21.15.156:0/2819613260 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faeb4022410 con 0x7faec4099e20 2023-09-30T22:19:40.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.186+0000 7faeb2ffd700 1 -- 172.21.15.156:0/2819613260 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faeb40407e0 con 0x7faec4099e20 2023-09-30T22:19:40.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.186+0000 7fca6ab01700 1 -- 172.21.15.156:0/2076127349 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca641347c0 msgr2=0x7fca64136ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:40.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.186+0000 7fca6ab01700 1 --2- 172.21.15.156:0/2076127349 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca641347c0 0x7fca64136ba0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fca50009870 tx=0x7fca50009b80 comp rx=0 tx=0).stop 2023-09-30T22:19:40.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.186+0000 7fca6ab01700 1 -- 172.21.15.156:0/2076127349 shutdown_connections 2023-09-30T22:19:40.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.186+0000 7fca6ab01700 1 --2- 172.21.15.156:0/2076127349 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca641370e0 0x7fca641394c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.186+0000 7fca6ab01700 1 --2- 172.21.15.156:0/2076127349 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca641347c0 0x7fca64136ba0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.186+0000 7fca6ab01700 1 -- 172.21.15.156:0/2076127349 >> 172.21.15.156:0/2076127349 conn(0x7fca640a2980 msgr2=0x7fca640a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:40.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.187+0000 7fca6ab01700 1 -- 172.21.15.156:0/2076127349 shutdown_connections 2023-09-30T22:19:40.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.187+0000 7fca6ab01700 1 -- 172.21.15.156:0/2076127349 wait complete. 2023-09-30T22:19:40.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.188+0000 7fca6ab01700 1 Processor -- start 2023-09-30T22:19:40.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.188+0000 7fca6ab01700 1 -- start start 2023-09-30T22:19:40.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.189+0000 7fca6ab01700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca64131830 0x7fca641c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:40.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.189+0000 7fca6ab01700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca641347c0 0x7fca641c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:40.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.189+0000 7fca6ab01700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca641370e0 0x7fca6409e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:40.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.189+0000 7fca6ab01700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6409bb00 con 0x7fca641370e0 2023-09-30T22:19:40.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.189+0000 7fca6ab01700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca64130f40 con 0x7fca641347c0 2023-09-30T22:19:40.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.189+0000 7fca6ab01700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca640a1e50 con 0x7fca64131830 2023-09-30T22:19:40.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.189+0000 7fca63fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca641347c0 0x7fca641c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:40.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.189+0000 7fca63fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca641347c0 0x7fca641c8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52358/0 (socket says 172.21.15.156:52358) 2023-09-30T22:19:40.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.189+0000 7fca63fff700 1 -- 172.21.15.156:0/2512186385 learned_addr learned my addr 172.21.15.156:0/2512186385 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:40.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.189+0000 7fca6909e700 1 --2- 172.21.15.156:0/2512186385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca641370e0 0x7fca6409e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:40.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.189+0000 7fca63fff700 1 -- 172.21.15.156:0/2512186385 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca64131830 msgr2=0x7fca641c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:40.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.189+0000 7fca63fff700 1 --2- 172.21.15.156:0/2512186385 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca64131830 0x7fca641c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.189+0000 7fca63fff700 1 -- 172.21.15.156:0/2512186385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca641370e0 msgr2=0x7fca6409e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:40.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.189+0000 7fca63fff700 1 --2- 172.21.15.156:0/2512186385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca641370e0 0x7fca6409e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.189+0000 7fca63fff700 1 -- 172.21.15.156:0/2512186385 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca500094a0 con 0x7fca641347c0 2023-09-30T22:19:40.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.189+0000 7fca63fff700 1 --2- 172.21.15.156:0/2512186385 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca641347c0 0x7fca641c8e40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fca50000c00 tx=0x7fca50004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:40.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.190+0000 7fca617fa700 1 -- 172.21.15.156:0/2512186385 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca50004590 con 0x7fca641347c0 2023-09-30T22:19:40.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.190+0000 7fca617fa700 1 -- 172.21.15.156:0/2512186385 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5001f070 con 0x7fca641347c0 2023-09-30T22:19:40.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.190+0000 7fca617fa700 1 -- 172.21.15.156:0/2512186385 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca500038e0 con 0x7fca641347c0 2023-09-30T22:19:40.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.190+0000 7fca6ab01700 1 -- 172.21.15.156:0/2512186385 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca6411d2a0 con 0x7fca641347c0 2023-09-30T22:19:40.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.190+0000 7fca6ab01700 1 -- 172.21.15.156:0/2512186385 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca6409b270 con 0x7fca641347c0 2023-09-30T22:19:40.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.191+0000 7fca617fa700 1 -- 172.21.15.156:0/2512186385 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fca50003a40 con 0x7fca641347c0 2023-09-30T22:19:40.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.191+0000 7fca617fa700 1 -- 172.21.15.156:0/2512186385 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fca50021070 con 0x7fca641347c0 2023-09-30T22:19:40.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.191+0000 7fca6ab01700 1 -- 172.21.15.156:0/2512186385 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca6409ffb0 con 0x7fca641347c0 2023-09-30T22:19:40.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.193+0000 7faeb2ffd700 1 -- 172.21.15.156:0/2819613260 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faeb4003da0 con 0x7faec4099e20 2023-09-30T22:19:40.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.199+0000 7fca617fa700 1 -- 172.21.15.156:0/2512186385 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fca5002b080 con 0x7fca641347c0 2023-09-30T22:19:40.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.229+0000 7f280401c700 1 Processor -- start 2023-09-30T22:19:40.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.229+0000 7f280401c700 1 -- start start 2023-09-30T22:19:40.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.229+0000 7f280401c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27fc06a770 0x7f27fc06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:40.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.229+0000 7f280401c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27fc131ec0 0x7f27fc139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:40.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.229+0000 7f280401c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27fc09da80 con 0x7f27fc06b080 2023-09-30T22:19:40.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.229+0000 7f280401c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc09dce0 con 0x7f27fc06a770 2023-09-30T22:19:40.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.229+0000 7f280401c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc09eb20 con 0x7f27fc131ec0 2023-09-30T22:19:40.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.230+0000 7f28015b7700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f27fc06b080 0x7f27fc1317b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48596/0 (socket says 172.21.15.156:48596) 2023-09-30T22:19:40.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.230+0000 7f28015b7700 1 -- 172.21.15.156:0/338690105 learned_addr learned my addr 172.21.15.156:0/338690105 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:40.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.230+0000 7f2801db8700 1 --2- 172.21.15.156:0/338690105 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27fc06a770 0x7f27fc06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:40.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.230+0000 7f28025b9700 1 --2- 172.21.15.156:0/338690105 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27fc131ec0 0x7f27fc139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:40.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.230+0000 7f2801db8700 1 -- 172.21.15.156:0/338690105 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27fc131ec0 msgr2=0x7f27fc139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:40.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.230+0000 7f2801db8700 1 --2- 172.21.15.156:0/338690105 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27fc131ec0 0x7f27fc139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.230+0000 7f2801db8700 1 -- 172.21.15.156:0/338690105 >> v1:172.21.15.156:6789/0 conn(0x7f27fc06b080 legacy=0x7f27fc1317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:40.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.230+0000 7f2801db8700 1 -- 172.21.15.156:0/338690105 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27fc09d860 con 0x7f27fc06a770 2023-09-30T22:19:40.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.230+0000 7f28025b9700 1 --2- 172.21.15.156:0/338690105 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27fc131ec0 0x7f27fc139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:40.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.230+0000 7f2801db8700 1 --2- 172.21.15.156:0/338690105 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27fc06a770 0x7f27fc06ab40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f27f8009870 tx=0x7f27f8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=128947051b066b1c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:40.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.230+0000 7f2800db6700 1 -- 172.21.15.156:0/338690105 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f8011830 con 0x7f27fc06a770 2023-09-30T22:19:40.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.231+0000 7f2800db6700 1 -- 172.21.15.156:0/338690105 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f8011990 con 0x7f27fc06a770 2023-09-30T22:19:40.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.231+0000 7f2800db6700 1 -- 172.21.15.156:0/338690105 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f8011d20 con 0x7f27fc06a770 2023-09-30T22:19:40.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.231+0000 7f280401c700 1 -- 172.21.15.156:0/338690105 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27fc06a770 msgr2=0x7f27fc06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:40.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.231+0000 7f280401c700 1 --2- 172.21.15.156:0/338690105 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27fc06a770 0x7f27fc06ab40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f27f8009870 tx=0x7f27f8009b80 comp rx=0 tx=0).stop 2023-09-30T22:19:40.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.231+0000 7f280401c700 1 -- 172.21.15.156:0/338690105 shutdown_connections 2023-09-30T22:19:40.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.231+0000 7f280401c700 1 --2- 172.21.15.156:0/338690105 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27fc06a770 0x7f27fc06ab40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.231+0000 7f280401c700 1 --2- 172.21.15.156:0/338690105 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27fc131ec0 0x7f27fc139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.231+0000 7f280401c700 1 -- 172.21.15.156:0/338690105 >> 172.21.15.156:0/338690105 conn(0x7f27fc099c40 msgr2=0x7f27fc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:40.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.231+0000 7f280401c700 1 -- 172.21.15.156:0/338690105 shutdown_connections 2023-09-30T22:19:40.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.231+0000 7f280401c700 1 -- 172.21.15.156:0/338690105 wait complete. 2023-09-30T22:19:40.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.232+0000 7f280401c700 1 Processor -- start 2023-09-30T22:19:40.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.232+0000 7f280401c700 1 -- start start 2023-09-30T22:19:40.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.233+0000 7f280401c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27fc06a770 0x7f27fc120060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:40.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.233+0000 7f280401c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27fc06b080 0x7f27fc1205a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:40.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.233+0000 7f280401c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27fc131ec0 0x7f27fc120ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:40.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.233+0000 7f280401c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc121530 con 0x7f27fc131ec0 2023-09-30T22:19:40.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.233+0000 7f280401c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc121e10 con 0x7f27fc06b080 2023-09-30T22:19:40.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.233+0000 7f280401c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc122b20 con 0x7f27fc06a770 2023-09-30T22:19:40.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.233+0000 7f2801db8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27fc06a770 0x7f27fc120060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:40.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.233+0000 7f2801db8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27fc06a770 0x7f27fc120060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56388/0 (socket says 172.21.15.156:56388) 2023-09-30T22:19:40.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.233+0000 7f28025b9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27fc131ec0 0x7f27fc120ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:40.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.233+0000 7f2801db8700 1 -- 172.21.15.156:0/862395053 learned_addr learned my addr 172.21.15.156:0/862395053 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:40.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.233+0000 7f28025b9700 1 -- 172.21.15.156:0/862395053 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27fc06a770 msgr2=0x7f27fc120060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:40.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.233+0000 7f28025b9700 1 --2- 172.21.15.156:0/862395053 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27fc06a770 0x7f27fc120060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.233+0000 7f28015b7700 1 --2- 172.21.15.156:0/862395053 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27fc06b080 0x7f27fc1205a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:40.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.233+0000 7f28025b9700 1 -- 172.21.15.156:0/862395053 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27fc06b080 msgr2=0x7f27fc1205a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:40.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.233+0000 7f28025b9700 1 --2- 172.21.15.156:0/862395053 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27fc06b080 0x7f27fc1205a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.233+0000 7f28025b9700 1 -- 172.21.15.156:0/862395053 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f4009a70 con 0x7f27fc131ec0 2023-09-30T22:19:40.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.233+0000 7f28015b7700 1 --2- 172.21.15.156:0/862395053 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27fc06b080 0x7f27fc1205a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:19:40.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.233+0000 7f28025b9700 1 --2- 172.21.15.156:0/862395053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27fc131ec0 0x7f27fc120ae0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f27f400efc0 tx=0x7f27f400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:40.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.234+0000 7f27f27fc700 1 -- 172.21.15.156:0/862395053 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f400cb40 con 0x7f27fc131ec0 2023-09-30T22:19:40.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.234+0000 7f27f27fc700 1 -- 172.21.15.156:0/862395053 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f400f040 con 0x7f27fc131ec0 2023-09-30T22:19:40.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.234+0000 7f27f27fc700 1 -- 172.21.15.156:0/862395053 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f4003a20 con 0x7f27fc131ec0 2023-09-30T22:19:40.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.234+0000 7f280401c700 1 -- 172.21.15.156:0/862395053 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f80094a0 con 0x7f27fc131ec0 2023-09-30T22:19:40.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.234+0000 7f280401c700 1 -- 172.21.15.156:0/862395053 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27fc123590 con 0x7f27fc131ec0 2023-09-30T22:19:40.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.235+0000 7f280401c700 1 -- 172.21.15.156:0/862395053 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27fc11cde0 con 0x7f27fc131ec0 2023-09-30T22:19:40.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.236+0000 7f27f27fc700 1 -- 172.21.15.156:0/862395053 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f27f4014480 con 0x7f27fc131ec0 2023-09-30T22:19:40.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.236+0000 7f27f27fc700 1 -- 172.21.15.156:0/862395053 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f27f4040c00 con 0x7f27fc131ec0 2023-09-30T22:19:40.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.240+0000 7f27f27fc700 1 -- 172.21.15.156:0/862395053 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f27f401c590 con 0x7f27fc131ec0 2023-09-30T22:19:40.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.357+0000 7f4bd5587700 1 -- 172.21.15.156:0/2197765544 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4bd011e2c0 con 0x7f4bd01304a0 2023-09-30T22:19:40.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.357+0000 7f4bb77fe700 1 -- 172.21.15.156:0/2197765544 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4bd011e2c0 con 0x7f4bd01304a0 2023-09-30T22:19:40.358 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.359+0000 7f4bd5587700 1 -- 172.21.15.156:0/2197765544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4bd01304a0 msgr2=0x7f4bd011b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.359+0000 7f4bd5587700 1 --2- 172.21.15.156:0/2197765544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4bd01304a0 0x7f4bd011b910 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4bc800efc0 tx=0x7f4bc800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.359+0000 7f4bd5587700 1 -- 172.21.15.156:0/2197765544 shutdown_connections 2023-09-30T22:19:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.359+0000 7f4bd5587700 1 --2- 172.21.15.156:0/2197765544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4bd01304a0 0x7f4bd011b910 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.359+0000 7f4bd5587700 1 --2- 172.21.15.156:0/2197765544 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4bd00a0a30 0x7f4bd011ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.359+0000 7f4bd5587700 1 --2- 172.21.15.156:0/2197765544 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bd00a1340 0x7f4bd011b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.359+0000 7f4bd5587700 1 -- 172.21.15.156:0/2197765544 >> 172.21.15.156:0/2197765544 conn(0x7f4bd00a2980 msgr2=0x7f4bd009deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.359+0000 7f4bd5587700 1 -- 172.21.15.156:0/2197765544 shutdown_connections 2023-09-30T22:19:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.359+0000 7f4bd5587700 1 -- 172.21.15.156:0/2197765544 wait complete. 2023-09-30T22:19:40.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:40.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.392+0000 7fca6ab01700 1 -- 172.21.15.156:0/2512186385 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fca6404f2a0 con 0x7fca641347c0 2023-09-30T22:19:40.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.393+0000 7fca617fa700 1 -- 172.21.15.156:0/2512186385 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fca50015020 con 0x7fca641347c0 2023-09-30T22:19:40.394 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:40.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.395+0000 7fca6ab01700 1 -- 172.21.15.156:0/2512186385 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca641347c0 msgr2=0x7fca641c8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:40.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.395+0000 7fca6ab01700 1 --2- 172.21.15.156:0/2512186385 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca641347c0 0x7fca641c8e40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fca50000c00 tx=0x7fca50004750 comp rx=0 tx=0).stop 2023-09-30T22:19:40.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.395+0000 7fca6ab01700 1 -- 172.21.15.156:0/2512186385 shutdown_connections 2023-09-30T22:19:40.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.395+0000 7fca6ab01700 1 --2- 172.21.15.156:0/2512186385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca641370e0 0x7fca6409e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.395+0000 7fca6ab01700 1 --2- 172.21.15.156:0/2512186385 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca64131830 0x7fca641c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.395+0000 7fca6ab01700 1 --2- 172.21.15.156:0/2512186385 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca641347c0 0x7fca641c8e40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.395+0000 7fca6ab01700 1 -- 172.21.15.156:0/2512186385 >> 172.21.15.156:0/2512186385 conn(0x7fca640a2980 msgr2=0x7fca6412e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:40.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.395+0000 7fca6ab01700 1 -- 172.21.15.156:0/2512186385 shutdown_connections 2023-09-30T22:19:40.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.395+0000 7fca6ab01700 1 -- 172.21.15.156:0/2512186385 wait complete. 2023-09-30T22:19:40.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.396+0000 7faec8e9d700 1 -- 172.21.15.156:0/2819613260 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faec406bce0 con 0x7faec4099e20 2023-09-30T22:19:40.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.396+0000 7faeb2ffd700 1 -- 172.21.15.156:0/2819613260 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faeb4027070 con 0x7faec4099e20 2023-09-30T22:19:40.397 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:40.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.398+0000 7faec8e9d700 1 -- 172.21.15.156:0/2819613260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faec4099e20 msgr2=0x7faec41c4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:40.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.398+0000 7faec8e9d700 1 --2- 172.21.15.156:0/2819613260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faec4099e20 0x7faec41c4020 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7faeb4000c00 tx=0x7faeb4004750 comp rx=0 tx=0).stop 2023-09-30T22:19:40.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.398+0000 7faec8e9d700 1 -- 172.21.15.156:0/2819613260 shutdown_connections 2023-09-30T22:19:40.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.398+0000 7faec8e9d700 1 --2- 172.21.15.156:0/2819613260 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faec4130890 0x7faec41c0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.398+0000 7faec8e9d700 1 --2- 172.21.15.156:0/2819613260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faec4099e20 0x7faec41c4020 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.398+0000 7faec8e9d700 1 --2- 172.21.15.156:0/2819613260 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faec409a730 0x7faec41c4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.398+0000 7faec8e9d700 1 -- 172.21.15.156:0/2819613260 >> 172.21.15.156:0/2819613260 conn(0x7faec40a2980 msgr2=0x7faec412d500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:40.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.398+0000 7faec8e9d700 1 -- 172.21.15.156:0/2819613260 shutdown_connections 2023-09-30T22:19:40.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.398+0000 7faec8e9d700 1 -- 172.21.15.156:0/2819613260 wait complete. 2023-09-30T22:19:40.410 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:40.412 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:40.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.436+0000 7f280401c700 1 -- 172.21.15.156:0/862395053 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f27fc09d2f0 con 0x7f27fc131ec0 2023-09-30T22:19:40.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.436+0000 7f27f27fc700 1 -- 172.21.15.156:0/862395053 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f27f401c3b0 con 0x7f27fc131ec0 2023-09-30T22:19:40.437 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:40.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.438+0000 7f280401c700 1 -- 172.21.15.156:0/862395053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27fc131ec0 msgr2=0x7f27fc120ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:40.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.438+0000 7f280401c700 1 --2- 172.21.15.156:0/862395053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27fc131ec0 0x7f27fc120ae0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f27f400efc0 tx=0x7f27f400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.438+0000 7f280401c700 1 -- 172.21.15.156:0/862395053 shutdown_connections 2023-09-30T22:19:40.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.438+0000 7f280401c700 1 --2- 172.21.15.156:0/862395053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27fc131ec0 0x7f27fc120ae0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.438+0000 7f280401c700 1 --2- 172.21.15.156:0/862395053 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27fc06a770 0x7f27fc120060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.438+0000 7f280401c700 1 --2- 172.21.15.156:0/862395053 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27fc06b080 0x7f27fc1205a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:40.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.438+0000 7f280401c700 1 -- 172.21.15.156:0/862395053 >> 172.21.15.156:0/862395053 conn(0x7f27fc099c40 msgr2=0x7f27fc071290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:40.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.438+0000 7f280401c700 1 -- 172.21.15.156:0/862395053 shutdown_connections 2023-09-30T22:19:40.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:40.438+0000 7f280401c700 1 -- 172.21.15.156:0/862395053 wait complete. 2023-09-30T22:19:40.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:41.374 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:41.411 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:41.413 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:41.452 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:41.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.518+0000 7f15c6a59700 1 Processor -- start 2023-09-30T22:19:41.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.518+0000 7f15c6a59700 1 -- start start 2023-09-30T22:19:41.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.519+0000 7f15c6a59700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15c009ad40 0x7f15c0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:41.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.519+0000 7f15c6a59700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15c0133f70 0x7f15c01343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:41.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.519+0000 7f15c6a59700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c009b110 con 0x7f15c00a0a70 2023-09-30T22:19:41.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.519+0000 7f15c6a59700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c00a3b60 con 0x7f15c0133f70 2023-09-30T22:19:41.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.519+0000 7f15c6a59700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15c01348e0 con 0x7f15c009ad40 2023-09-30T22:19:41.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.519+0000 7f15bffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15c009ad40 0x7f15c0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:41.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.519+0000 7f15bf7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15c0133f70 0x7f15c01343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:41.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.519+0000 7f15bffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15c009ad40 0x7f15c0133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43702/0 (socket says 172.21.15.156:43702) 2023-09-30T22:19:41.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.519+0000 7f15bffff700 1 -- 172.21.15.156:0/1626840324 learned_addr learned my addr 172.21.15.156:0/1626840324 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:41.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.520+0000 7f15bf7fe700 1 -- 172.21.15.156:0/1626840324 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15c009ad40 msgr2=0x7f15c0133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:41.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.520+0000 7f15bf7fe700 1 --2- 172.21.15.156:0/1626840324 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15c009ad40 0x7f15c0133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.520+0000 7f15bf7fe700 1 -- 172.21.15.156:0/1626840324 >> v1:172.21.15.156:6789/0 conn(0x7f15c00a0a70 legacy=0x7f15c00a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.520+0000 7f15bf7fe700 1 -- 172.21.15.156:0/1626840324 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c00a2fa0 con 0x7f15c0133f70 2023-09-30T22:19:41.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.520+0000 7f15bffff700 1 --2- 172.21.15.156:0/1626840324 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15c009ad40 0x7f15c0133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:41.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.520+0000 7f15bf7fe700 1 --2- 172.21.15.156:0/1626840324 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15c0133f70 0x7f15c01343a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f15b4009870 tx=0x7f15b4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2eec8de49d25e7d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:41.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.520+0000 7f15beffd700 1 -- 172.21.15.156:0/1626840324 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b4011830 con 0x7f15c0133f70 2023-09-30T22:19:41.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.520+0000 7f15beffd700 1 -- 172.21.15.156:0/1626840324 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b4011990 con 0x7f15c0133f70 2023-09-30T22:19:41.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.520+0000 7f15beffd700 1 -- 172.21.15.156:0/1626840324 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b4011d20 con 0x7f15c0133f70 2023-09-30T22:19:41.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.521+0000 7f15c6a59700 1 -- 172.21.15.156:0/1626840324 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15c0133f70 msgr2=0x7f15c01343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.521+0000 7f15c6a59700 1 --2- 172.21.15.156:0/1626840324 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15c0133f70 0x7f15c01343a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f15b4009870 tx=0x7f15b4009b80 comp rx=0 tx=0).stop 2023-09-30T22:19:41.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.521+0000 7f15c6a59700 1 -- 172.21.15.156:0/1626840324 shutdown_connections 2023-09-30T22:19:41.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.521+0000 7f15c6a59700 1 --2- 172.21.15.156:0/1626840324 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15c009ad40 0x7f15c0133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.521+0000 7f15c6a59700 1 --2- 172.21.15.156:0/1626840324 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15c0133f70 0x7f15c01343a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.521+0000 7f15c6a59700 1 -- 172.21.15.156:0/1626840324 >> 172.21.15.156:0/1626840324 conn(0x7f15c0099c40 msgr2=0x7f15c006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:41.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.521+0000 7f15c6a59700 1 -- 172.21.15.156:0/1626840324 shutdown_connections 2023-09-30T22:19:41.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.521+0000 7f15c6a59700 1 -- 172.21.15.156:0/1626840324 wait complete. 2023-09-30T22:19:41.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.522+0000 7f15c6a59700 1 Processor -- start 2023-09-30T22:19:41.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.522+0000 7f15c6a59700 1 -- start start 2023-09-30T22:19:41.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.522+0000 7f15c6a59700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15c009ad40 0x7f15c011e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:41.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.522+0000 7f15c6a59700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15c00a0a70 0x7f15c011e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:41.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.522+0000 7f15c6a59700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15c0133f70 0x7f15c011eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:41.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.522+0000 7f15c6a59700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c0121be0 con 0x7f15c009ad40 2023-09-30T22:19:41.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.522+0000 7f15c6a59700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c01202f0 con 0x7f15c0133f70 2023-09-30T22:19:41.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.522+0000 7f15c6a59700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15c0122580 con 0x7f15c00a0a70 2023-09-30T22:19:41.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.523+0000 7f15bf7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15c00a0a70 0x7f15c011e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:41.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.523+0000 7f15bf7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15c00a0a70 0x7f15c011e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43710/0 (socket says 172.21.15.156:43710) 2023-09-30T22:19:41.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.523+0000 7f15bf7fe700 1 -- 172.21.15.156:0/4099710099 learned_addr learned my addr 172.21.15.156:0/4099710099 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:41.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.523+0000 7f15c4ff6700 1 --2- 172.21.15.156:0/4099710099 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15c0133f70 0x7f15c011eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:41.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.523+0000 7f15bffff700 1 --2- 172.21.15.156:0/4099710099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15c009ad40 0x7f15c011e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:41.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.523+0000 7f15c4ff6700 1 -- 172.21.15.156:0/4099710099 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15c00a0a70 msgr2=0x7f15c011e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.523+0000 7f15c4ff6700 1 --2- 172.21.15.156:0/4099710099 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15c00a0a70 0x7f15c011e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.523+0000 7f15c4ff6700 1 -- 172.21.15.156:0/4099710099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15c009ad40 msgr2=0x7f15c011e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.523+0000 7f15c4ff6700 1 --2- 172.21.15.156:0/4099710099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15c009ad40 0x7f15c011e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.523+0000 7f15c4ff6700 1 -- 172.21.15.156:0/4099710099 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b0009550 con 0x7f15c0133f70 2023-09-30T22:19:41.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.523+0000 7f15bf7fe700 1 --2- 172.21.15.156:0/4099710099 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15c00a0a70 0x7f15c011e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:41.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.523+0000 7f15c4ff6700 1 --2- 172.21.15.156:0/4099710099 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15c0133f70 0x7f15c011eb40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f15b800cbc0 tx=0x7f15b800ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:41.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.523+0000 7f15bcff9700 1 -- 172.21.15.156:0/4099710099 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b8003c00 con 0x7f15c0133f70 2023-09-30T22:19:41.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.523+0000 7f15bcff9700 1 -- 172.21.15.156:0/4099710099 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b8003d60 con 0x7f15c0133f70 2023-09-30T22:19:41.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.524+0000 7f15c6a59700 1 -- 172.21.15.156:0/4099710099 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b40094a0 con 0x7f15c0133f70 2023-09-30T22:19:41.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.524+0000 7f15c6a59700 1 -- 172.21.15.156:0/4099710099 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c011fcd0 con 0x7f15c0133f70 2023-09-30T22:19:41.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.524+0000 7f15bcff9700 1 -- 172.21.15.156:0/4099710099 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b800a980 con 0x7f15c0133f70 2023-09-30T22:19:41.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.525+0000 7f15bcff9700 1 -- 172.21.15.156:0/4099710099 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f15b800aae0 con 0x7f15c0133f70 2023-09-30T22:19:41.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.525+0000 7f15bcff9700 1 -- 172.21.15.156:0/4099710099 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f15b803f5c0 con 0x7f15c0133f70 2023-09-30T22:19:41.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.525+0000 7f15c6a59700 1 -- 172.21.15.156:0/4099710099 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a00052e0 con 0x7f15c0133f70 2023-09-30T22:19:41.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.530+0000 7f15bcff9700 1 -- 172.21.15.156:0/4099710099 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f15b8012420 con 0x7f15c0133f70 2023-09-30T22:19:41.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.555+0000 7fbd7ea37700 1 Processor -- start 2023-09-30T22:19:41.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.555+0000 7fbd7ea37700 1 -- start start 2023-09-30T22:19:41.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.555+0000 7fbd7ea37700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd78133ad0 0x7fbd78133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:41.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.555+0000 7fbd7ea37700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbd78130bc0 0x7fbd7813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:41.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.555+0000 7fbd7ea37700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd7806b2d0 con 0x7fbd781300a0 2023-09-30T22:19:41.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.555+0000 7fbd7ea37700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd78133610 con 0x7fbd78130bc0 2023-09-30T22:19:41.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.555+0000 7fbd7ea37700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7809a500 con 0x7fbd78133ad0 2023-09-30T22:19:41.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.556+0000 7fbd7cfd4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbd78130bc0 0x7fbd7813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:41.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.556+0000 7fbd7cfd4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbd78130bc0 0x7fbd7813b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51286/0 (socket says 172.21.15.156:51286) 2023-09-30T22:19:41.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.556+0000 7fbd77fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd78133ad0 0x7fbd78133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:41.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.556+0000 7fbd7cfd4700 1 -- 172.21.15.156:0/3793611658 learned_addr learned my addr 172.21.15.156:0/3793611658 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:41.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.556+0000 7fbd7cfd4700 1 -- 172.21.15.156:0/3793611658 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd78133ad0 msgr2=0x7fbd78133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:41.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.556+0000 7fbd7cfd4700 1 --2- 172.21.15.156:0/3793611658 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd78133ad0 0x7fbd78133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.556+0000 7fbd7cfd4700 1 -- 172.21.15.156:0/3793611658 >> v1:172.21.15.156:6789/0 conn(0x7fbd781300a0 legacy=0x7fbd781304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.556+0000 7fbd7cfd4700 1 -- 172.21.15.156:0/3793611658 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd781338b0 con 0x7fbd78130bc0 2023-09-30T22:19:41.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.556+0000 7fbd77fff700 1 --2- 172.21.15.156:0/3793611658 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd78133ad0 0x7fbd78133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:41.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.556+0000 7fbd7cfd4700 1 --2- 172.21.15.156:0/3793611658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd78130bc0 0x7fbd7813b990 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009e50 tx=0x7fbd7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d529587bc7fa17 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:41.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.556+0000 7fbd76ffd700 1 -- 172.21.15.156:0/3793611658 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7000e070 con 0x7fbd78130bc0 2023-09-30T22:19:41.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.556+0000 7fbd76ffd700 1 -- 172.21.15.156:0/3793611658 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7000b910 con 0x7fbd78130bc0 2023-09-30T22:19:41.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.556+0000 7fbd76ffd700 1 -- 172.21.15.156:0/3793611658 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7000bcc0 con 0x7fbd78130bc0 2023-09-30T22:19:41.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.557+0000 7fbd7ea37700 1 -- 172.21.15.156:0/3793611658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd78130bc0 msgr2=0x7fbd7813b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.557+0000 7fbd7ea37700 1 --2- 172.21.15.156:0/3793611658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd78130bc0 0x7fbd7813b990 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009e50 tx=0x7fbd7000b330 comp rx=0 tx=0).stop 2023-09-30T22:19:41.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.557+0000 7fbd7ea37700 1 -- 172.21.15.156:0/3793611658 shutdown_connections 2023-09-30T22:19:41.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.557+0000 7fbd7ea37700 1 --2- 172.21.15.156:0/3793611658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd78130bc0 0x7fbd7813b990 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.557+0000 7fbd7ea37700 1 --2- 172.21.15.156:0/3793611658 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd78133ad0 0x7fbd78133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.557+0000 7fbd7ea37700 1 -- 172.21.15.156:0/3793611658 >> 172.21.15.156:0/3793611658 conn(0x7fbd78099c40 msgr2=0x7fbd780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:41.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.557+0000 7fbd7ea37700 1 -- 172.21.15.156:0/3793611658 shutdown_connections 2023-09-30T22:19:41.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.557+0000 7fbd7ea37700 1 -- 172.21.15.156:0/3793611658 wait complete. 2023-09-30T22:19:41.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.558+0000 7fbd7ea37700 1 Processor -- start 2023-09-30T22:19:41.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.558+0000 7fbd7ea37700 1 -- start start 2023-09-30T22:19:41.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.559+0000 7fbd7ea37700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd781300a0 0x7fbd7811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:41.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.559+0000 7fbd7ea37700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd78130bc0 0x7fbd7811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:41.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.559+0000 7fbd7ea37700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd78133ad0 0x7fbd7811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:41.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.559+0000 7fbd7ea37700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd78120100 con 0x7fbd781300a0 2023-09-30T22:19:41.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.559+0000 7fbd7ea37700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd780722d0 con 0x7fbd78130bc0 2023-09-30T22:19:41.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.559+0000 7fbd7ea37700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd78120c70 con 0x7fbd78133ad0 2023-09-30T22:19:41.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.559+0000 7fbd777fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd78130bc0 0x7fbd7811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:41.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.559+0000 7fbd777fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd78130bc0 0x7fbd7811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53612/0 (socket says 172.21.15.156:53612) 2023-09-30T22:19:41.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.559+0000 7fbd777fe700 1 -- 172.21.15.156:0/1748622190 learned_addr learned my addr 172.21.15.156:0/1748622190 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:41.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.559+0000 7fbd77fff700 1 --2- 172.21.15.156:0/1748622190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd781300a0 0x7fbd7811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:41.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.559+0000 7fbd77fff700 1 -- 172.21.15.156:0/1748622190 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd78133ad0 msgr2=0x7fbd7811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.559+0000 7fbd77fff700 1 --2- 172.21.15.156:0/1748622190 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd78133ad0 0x7fbd7811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.559+0000 7fbd77fff700 1 -- 172.21.15.156:0/1748622190 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd78130bc0 msgr2=0x7fbd7811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.559+0000 7fbd77fff700 1 --2- 172.21.15.156:0/1748622190 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd78130bc0 0x7fbd7811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.559+0000 7fbd77fff700 1 -- 172.21.15.156:0/1748622190 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd680094a0 con 0x7fbd781300a0 2023-09-30T22:19:41.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.559+0000 7fbd777fe700 1 --2- 172.21.15.156:0/1748622190 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd78130bc0 0x7fbd7811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:41.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.559+0000 7fbd77fff700 1 --2- 172.21.15.156:0/1748622190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd781300a0 0x7fbd7811da40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbd6800e9b0 tx=0x7fbd6800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:41.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.560+0000 7fbd74ff9700 1 -- 172.21.15.156:0/1748622190 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6800c850 con 0x7fbd781300a0 2023-09-30T22:19:41.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.560+0000 7fbd7ea37700 1 -- 172.21.15.156:0/1748622190 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd70009b30 con 0x7fbd781300a0 2023-09-30T22:19:41.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.560+0000 7fbd74ff9700 1 -- 172.21.15.156:0/1748622190 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6800c9b0 con 0x7fbd781300a0 2023-09-30T22:19:41.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.560+0000 7fbd74ff9700 1 -- 172.21.15.156:0/1748622190 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6800cd60 con 0x7fbd781300a0 2023-09-30T22:19:41.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.560+0000 7fbd7ea37700 1 -- 172.21.15.156:0/1748622190 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd780a33c0 con 0x7fbd781300a0 2023-09-30T22:19:41.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.561+0000 7fbd74ff9700 1 -- 172.21.15.156:0/1748622190 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbd68013470 con 0x7fbd781300a0 2023-09-30T22:19:41.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.561+0000 7fbd74ff9700 1 -- 172.21.15.156:0/1748622190 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbd6803fbb0 con 0x7fbd781300a0 2023-09-30T22:19:41.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.562+0000 7fbd7ea37700 1 -- 172.21.15.156:0/1748622190 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd7812dd00 con 0x7fbd781300a0 2023-09-30T22:19:41.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.566+0000 7f670ffb3700 1 Processor -- start 2023-09-30T22:19:41.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.566+0000 7f670ffb3700 1 -- start start 2023-09-30T22:19:41.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.566+0000 7f670ffb3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f670809a150 0x7f670809e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:41.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.567+0000 7f670ffb3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f670809edb0 0x7f670809f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:41.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.567+0000 7f670ffb3700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670809af80 con 0x7f6708133c20 2023-09-30T22:19:41.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.567+0000 7f670ffb3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f670809a520 con 0x7f670809edb0 2023-09-30T22:19:41.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.567+0000 7f670ffb3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f670809fe00 con 0x7f670809a150 2023-09-30T22:19:41.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.567+0000 7fbd74ff9700 1 -- 172.21.15.156:0/1748622190 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd6801b3b0 con 0x7fbd781300a0 2023-09-30T22:19:41.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.567+0000 7f670d54e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f670809edb0 0x7f670809f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:41.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.567+0000 7f670d54e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f670809edb0 0x7f670809f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53626/0 (socket says 172.21.15.156:53626) 2023-09-30T22:19:41.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.567+0000 7f670d54e700 1 -- 172.21.15.156:0/2506902615 learned_addr learned my addr 172.21.15.156:0/2506902615 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:41.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.567+0000 7f670dd4f700 1 --2- 172.21.15.156:0/2506902615 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f670809a150 0x7f670809e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:41.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.567+0000 7f670cd4d700 1 -- 172.21.15.156:0/2506902615 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3590214470 0 0) 0x7f670809af80 con 0x7f6708133c20 2023-09-30T22:19:41.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.567+0000 7f670cd4d700 1 -- 172.21.15.156:0/2506902615 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66f40035b0 con 0x7f6708133c20 2023-09-30T22:19:41.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.567+0000 7f670dd4f700 1 -- 172.21.15.156:0/2506902615 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f670809edb0 msgr2=0x7f670809f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:41.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.567+0000 7f670dd4f700 1 --2- 172.21.15.156:0/2506902615 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f670809edb0 0x7f670809f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.567+0000 7f670dd4f700 1 -- 172.21.15.156:0/2506902615 >> v1:172.21.15.156:6789/0 conn(0x7f6708133c20 legacy=0x7f67081340c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.567+0000 7f670dd4f700 1 -- 172.21.15.156:0/2506902615 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670809f6e0 con 0x7f670809a150 2023-09-30T22:19:41.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.567+0000 7f670d54e700 1 --2- 172.21.15.156:0/2506902615 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f670809edb0 0x7f670809f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:41.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.568+0000 7f670dd4f700 1 --2- 172.21.15.156:0/2506902615 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f670809a150 0x7f670809e870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6704009870 tx=0x7f6704009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14624b2630dec331 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:41.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.568+0000 7f670cd4d700 1 -- 172.21.15.156:0/2506902615 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6704011830 con 0x7f670809a150 2023-09-30T22:19:41.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.568+0000 7f670cd4d700 1 -- 172.21.15.156:0/2506902615 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6704011990 con 0x7f670809a150 2023-09-30T22:19:41.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.568+0000 7f670cd4d700 1 -- 172.21.15.156:0/2506902615 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6704011d20 con 0x7f670809a150 2023-09-30T22:19:41.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.569+0000 7f670ffb3700 1 -- 172.21.15.156:0/2506902615 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f670809a150 msgr2=0x7f670809e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.569+0000 7f670ffb3700 1 --2- 172.21.15.156:0/2506902615 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f670809a150 0x7f670809e870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6704009870 tx=0x7f6704009b80 comp rx=0 tx=0).stop 2023-09-30T22:19:41.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.569+0000 7f670ffb3700 1 -- 172.21.15.156:0/2506902615 shutdown_connections 2023-09-30T22:19:41.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.569+0000 7f670ffb3700 1 --2- 172.21.15.156:0/2506902615 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f670809a150 0x7f670809e870 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.569+0000 7f670ffb3700 1 --2- 172.21.15.156:0/2506902615 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f670809edb0 0x7f670809f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.569+0000 7f670ffb3700 1 -- 172.21.15.156:0/2506902615 >> 172.21.15.156:0/2506902615 conn(0x7f67080a4430 msgr2=0x7f67080a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:41.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.569+0000 7f670ffb3700 1 -- 172.21.15.156:0/2506902615 shutdown_connections 2023-09-30T22:19:41.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.569+0000 7f670ffb3700 1 -- 172.21.15.156:0/2506902615 wait complete. 2023-09-30T22:19:41.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.570+0000 7f670ffb3700 1 Processor -- start 2023-09-30T22:19:41.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.570+0000 7f670ffb3700 1 -- start start 2023-09-30T22:19:41.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.570+0000 7f670ffb3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f670809a150 0x7f67081225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:41.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.570+0000 7f670ffb3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f670809edb0 0x7f6708122ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:41.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.570+0000 7f670ffb3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6708133c20 0x7f6708123020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:41.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.570+0000 7f670ffb3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6708123a70 con 0x7f6708133c20 2023-09-30T22:19:41.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.570+0000 7f670ffb3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6708133920 con 0x7f670809edb0 2023-09-30T22:19:41.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.570+0000 7f670ffb3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6708124ff0 con 0x7f670809a150 2023-09-30T22:19:41.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.570+0000 7f670d54e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f670809edb0 0x7f6708122ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:41.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.570+0000 7f670d54e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f670809edb0 0x7f6708122ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53636/0 (socket says 172.21.15.156:53636) 2023-09-30T22:19:41.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.571+0000 7f670d54e700 1 -- 172.21.15.156:0/3976775452 learned_addr learned my addr 172.21.15.156:0/3976775452 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:41.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.571+0000 7f670e550700 1 --2- 172.21.15.156:0/3976775452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6708133c20 0x7f6708123020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:41.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.571+0000 7f670dd4f700 1 --2- 172.21.15.156:0/3976775452 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f670809a150 0x7f67081225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:41.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.571+0000 7f670d54e700 1 -- 172.21.15.156:0/3976775452 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f670809a150 msgr2=0x7f67081225a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.571+0000 7f670d54e700 1 --2- 172.21.15.156:0/3976775452 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f670809a150 0x7f67081225a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.571+0000 7f670d54e700 1 -- 172.21.15.156:0/3976775452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6708133c20 msgr2=0x7f6708123020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.571+0000 7f670d54e700 1 --2- 172.21.15.156:0/3976775452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6708133c20 0x7f6708123020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.571+0000 7f670d54e700 1 -- 172.21.15.156:0/3976775452 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f8009550 con 0x7f670809edb0 2023-09-30T22:19:41.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.571+0000 7f670d54e700 1 --2- 172.21.15.156:0/3976775452 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f670809edb0 0x7f6708122ae0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f66f800ec40 tx=0x7f66f800ef50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:41.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.571+0000 7f66fe7fc700 1 -- 172.21.15.156:0/3976775452 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f800c910 con 0x7f670809edb0 2023-09-30T22:19:41.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.571+0000 7f66fe7fc700 1 -- 172.21.15.156:0/3976775452 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f800ca70 con 0x7f670809edb0 2023-09-30T22:19:41.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.571+0000 7f670ffb3700 1 -- 172.21.15.156:0/3976775452 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67040094a0 con 0x7f670809edb0 2023-09-30T22:19:41.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.571+0000 7f66fe7fc700 1 -- 172.21.15.156:0/3976775452 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f800ce20 con 0x7f670809edb0 2023-09-30T22:19:41.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.571+0000 7f670ffb3700 1 -- 172.21.15.156:0/3976775452 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6708125800 con 0x7f670809edb0 2023-09-30T22:19:41.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.572+0000 7f66fe7fc700 1 -- 172.21.15.156:0/3976775452 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f66f8013470 con 0x7f670809edb0 2023-09-30T22:19:41.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.572+0000 7f66fe7fc700 1 -- 172.21.15.156:0/3976775452 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f66f803f880 con 0x7f670809edb0 2023-09-30T22:19:41.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.573+0000 7f670ffb3700 1 -- 172.21.15.156:0/3976775452 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f670809fa30 con 0x7f670809edb0 2023-09-30T22:19:41.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.581+0000 7f66fe7fc700 1 -- 172.21.15.156:0/3976775452 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66f80232f0 con 0x7f670809edb0 2023-09-30T22:19:41.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.613+0000 7f0481260700 1 Processor -- start 2023-09-30T22:19:41.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.613+0000 7f0481260700 1 -- start start 2023-09-30T22:19:41.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.614+0000 7f0481260700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f047c09d860 0x7f047c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:41.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.614+0000 7f0481260700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f047c09e170 0x7f047c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:41.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.614+0000 7f0481260700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047c09aaa0 con 0x7f047c130ce0 2023-09-30T22:19:41.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.614+0000 7f0481260700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047c09f870 con 0x7f047c09e170 2023-09-30T22:19:41.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.614+0000 7f0481260700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f047c09b360 con 0x7f047c09d860 2023-09-30T22:19:41.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.614+0000 7f047ad9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f047c09d860 0x7f047c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:41.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.614+0000 7f047ad9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f047c09d860 0x7f047c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43766/0 (socket says 172.21.15.156:43766) 2023-09-30T22:19:41.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.614+0000 7f047a59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f047c09e170 0x7f047c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:41.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.614+0000 7f047ad9d700 1 -- 172.21.15.156:0/1336927367 learned_addr learned my addr 172.21.15.156:0/1336927367 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:41.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.615+0000 7f047ad9d700 1 -- 172.21.15.156:0/1336927367 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f047c09e170 msgr2=0x7f047c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:41.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.615+0000 7f047ad9d700 1 --2- 172.21.15.156:0/1336927367 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f047c09e170 0x7f047c1307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.615+0000 7f047ad9d700 1 -- 172.21.15.156:0/1336927367 >> v1:172.21.15.156:6789/0 conn(0x7f047c130ce0 legacy=0x7f047c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.615+0000 7f047ad9d700 1 -- 172.21.15.156:0/1336927367 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047c09b620 con 0x7f047c09d860 2023-09-30T22:19:41.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.615+0000 7f047ad9d700 1 --2- 172.21.15.156:0/1336927367 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f047c09d860 0x7f047c09dc30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f046c009920 tx=0x7f046c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=365d229edfa41a06 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:41.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.615+0000 7f0479d9b700 1 -- 172.21.15.156:0/1336927367 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c00f8a0 con 0x7f047c09d860 2023-09-30T22:19:41.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.615+0000 7f0479d9b700 1 -- 172.21.15.156:0/1336927367 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046c00fa00 con 0x7f047c09d860 2023-09-30T22:19:41.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.615+0000 7f0479d9b700 1 -- 172.21.15.156:0/1336927367 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c00fd90 con 0x7f047c09d860 2023-09-30T22:19:41.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.616+0000 7f0481260700 1 -- 172.21.15.156:0/1336927367 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f047c09d860 msgr2=0x7f047c09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.616+0000 7f0481260700 1 --2- 172.21.15.156:0/1336927367 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f047c09d860 0x7f047c09dc30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f046c009920 tx=0x7f046c009c30 comp rx=0 tx=0).stop 2023-09-30T22:19:41.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.616+0000 7f0481260700 1 -- 172.21.15.156:0/1336927367 shutdown_connections 2023-09-30T22:19:41.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.616+0000 7f0481260700 1 --2- 172.21.15.156:0/1336927367 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f047c09d860 0x7f047c09dc30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.616+0000 7f0481260700 1 --2- 172.21.15.156:0/1336927367 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f047c09e170 0x7f047c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.616+0000 7f0481260700 1 -- 172.21.15.156:0/1336927367 >> 172.21.15.156:0/1336927367 conn(0x7f047c099c40 msgr2=0x7f047c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:41.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.616+0000 7f0481260700 1 -- 172.21.15.156:0/1336927367 shutdown_connections 2023-09-30T22:19:41.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.616+0000 7f0481260700 1 -- 172.21.15.156:0/1336927367 wait complete. 2023-09-30T22:19:41.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.618+0000 7f0481260700 1 Processor -- start 2023-09-30T22:19:41.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.618+0000 7f0481260700 1 -- start start 2023-09-30T22:19:41.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.619+0000 7f0481260700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f047c09d860 0x7f047c1272a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:41.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.619+0000 7f0481260700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f047c09e170 0x7f047c1277e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:41.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.619+0000 7f0481260700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f047c130ce0 0x7f047c127d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:41.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.619+0000 7f0481260700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047c129aa0 con 0x7f047c09e170 2023-09-30T22:19:41.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.619+0000 7f0481260700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047c072210 con 0x7f047c09d860 2023-09-30T22:19:41.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.619+0000 7f0481260700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f047c09c8b0 con 0x7f047c130ce0 2023-09-30T22:19:41.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.619+0000 7f047ad9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f047c09d860 0x7f047c1272a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:41.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.619+0000 7f047b59e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f047c130ce0 0x7f047c127d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:41.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.619+0000 7f047ad9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f047c09d860 0x7f047c1272a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53664/0 (socket says 172.21.15.156:53664) 2023-09-30T22:19:41.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.619+0000 7f047ad9d700 1 -- 172.21.15.156:0/724430454 learned_addr learned my addr 172.21.15.156:0/724430454 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:41.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.619+0000 7f047a59c700 1 --2- 172.21.15.156:0/724430454 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f047c09e170 0x7f047c1277e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:41.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.619+0000 7f047b59e700 1 -- 172.21.15.156:0/724430454 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f047c09d860 msgr2=0x7f047c1272a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.619+0000 7f047b59e700 1 --2- 172.21.15.156:0/724430454 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f047c09d860 0x7f047c1272a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.619+0000 7f047b59e700 1 -- 172.21.15.156:0/724430454 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f047c09e170 msgr2=0x7f047c1277e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.619+0000 7f047b59e700 1 --2- 172.21.15.156:0/724430454 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f047c09e170 0x7f047c1277e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.619+0000 7f047b59e700 1 -- 172.21.15.156:0/724430454 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f046c009550 con 0x7f047c130ce0 2023-09-30T22:19:41.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.619+0000 7f047b59e700 1 --2- 172.21.15.156:0/724430454 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f047c130ce0 0x7f047c127d20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f047400cbf0 tx=0x7f047400cf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:41.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.620+0000 7f04637fe700 1 -- 172.21.15.156:0/724430454 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0474003c00 con 0x7f047c130ce0 2023-09-30T22:19:41.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.620+0000 7f0481260700 1 -- 172.21.15.156:0/724430454 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f047c12a1e0 con 0x7f047c130ce0 2023-09-30T22:19:41.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.620+0000 7f0481260700 1 -- 172.21.15.156:0/724430454 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f047c12a780 con 0x7f047c130ce0 2023-09-30T22:19:41.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.620+0000 7f04637fe700 1 -- 172.21.15.156:0/724430454 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0474003d60 con 0x7f047c130ce0 2023-09-30T22:19:41.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.620+0000 7f04637fe700 1 -- 172.21.15.156:0/724430454 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047400aa00 con 0x7f047c130ce0 2023-09-30T22:19:41.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.621+0000 7f04637fe700 1 -- 172.21.15.156:0/724430454 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f047400ab60 con 0x7f047c130ce0 2023-09-30T22:19:41.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.621+0000 7f04637fe700 1 -- 172.21.15.156:0/724430454 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f047403f640 con 0x7f047c130ce0 2023-09-30T22:19:41.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.621+0000 7f0481260700 1 -- 172.21.15.156:0/724430454 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f045c0052e0 con 0x7f047c130ce0 2023-09-30T22:19:41.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.630+0000 7f04637fe700 1 -- 172.21.15.156:0/724430454 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f04740198f0 con 0x7f047c130ce0 2023-09-30T22:19:41.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.751+0000 7f15c6a59700 1 -- 172.21.15.156:0/4099710099 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f15a0005590 con 0x7f15c0133f70 2023-09-30T22:19:41.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.751+0000 7f15bcff9700 1 -- 172.21.15.156:0/4099710099 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f15b801a360 con 0x7f15c0133f70 2023-09-30T22:19:41.752 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:41.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.753+0000 7f15c6a59700 1 -- 172.21.15.156:0/4099710099 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15c0133f70 msgr2=0x7f15c011eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.753+0000 7f15c6a59700 1 --2- 172.21.15.156:0/4099710099 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15c0133f70 0x7f15c011eb40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f15b800cbc0 tx=0x7f15b800ced0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.753+0000 7f15c6a59700 1 -- 172.21.15.156:0/4099710099 shutdown_connections 2023-09-30T22:19:41.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.753+0000 7f15c6a59700 1 --2- 172.21.15.156:0/4099710099 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15c0133f70 0x7f15c011eb40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.753+0000 7f15c6a59700 1 --2- 172.21.15.156:0/4099710099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15c009ad40 0x7f15c011e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.753+0000 7f15c6a59700 1 --2- 172.21.15.156:0/4099710099 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15c00a0a70 0x7f15c011e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.753+0000 7f15c6a59700 1 -- 172.21.15.156:0/4099710099 >> 172.21.15.156:0/4099710099 conn(0x7f15c0099c40 msgr2=0x7f15c01330f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:41.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.754+0000 7f15c6a59700 1 -- 172.21.15.156:0/4099710099 shutdown_connections 2023-09-30T22:19:41.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.754+0000 7f15c6a59700 1 -- 172.21.15.156:0/4099710099 wait complete. 2023-09-30T22:19:41.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.765+0000 7fbd7ea37700 1 -- 172.21.15.156:0/1748622190 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbd7804f2a0 con 0x7fbd781300a0 2023-09-30T22:19:41.767 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:41.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.766+0000 7fbd74ff9700 1 -- 172.21.15.156:0/1748622190 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbd6802b090 con 0x7fbd781300a0 2023-09-30T22:19:41.767 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:41.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.768+0000 7fbd7ea37700 1 -- 172.21.15.156:0/1748622190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd781300a0 msgr2=0x7fbd7811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.768+0000 7fbd7ea37700 1 --2- 172.21.15.156:0/1748622190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd781300a0 0x7fbd7811da40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbd6800e9b0 tx=0x7fbd6800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.768+0000 7fbd7ea37700 1 -- 172.21.15.156:0/1748622190 shutdown_connections 2023-09-30T22:19:41.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.768+0000 7fbd7ea37700 1 --2- 172.21.15.156:0/1748622190 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd78133ad0 0x7fbd7811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.768+0000 7fbd7ea37700 1 --2- 172.21.15.156:0/1748622190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd781300a0 0x7fbd7811da40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.768+0000 7fbd7ea37700 1 --2- 172.21.15.156:0/1748622190 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd78130bc0 0x7fbd7811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.768+0000 7fbd7ea37700 1 -- 172.21.15.156:0/1748622190 >> 172.21.15.156:0/1748622190 conn(0x7fbd78099c40 msgr2=0x7fbd7812e620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:41.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.768+0000 7fbd7ea37700 1 -- 172.21.15.156:0/1748622190 shutdown_connections 2023-09-30T22:19:41.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.768+0000 7fbd7ea37700 1 -- 172.21.15.156:0/1748622190 wait complete. 2023-09-30T22:19:41.780 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:41.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.781+0000 7f670ffb3700 1 -- 172.21.15.156:0/3976775452 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f67080a0440 con 0x7f670809edb0 2023-09-30T22:19:41.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.781+0000 7f66fe7fc700 1 -- 172.21.15.156:0/3976775452 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f66f8017020 con 0x7f670809edb0 2023-09-30T22:19:41.782 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:41.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.783+0000 7f670ffb3700 1 -- 172.21.15.156:0/3976775452 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f670809edb0 msgr2=0x7f6708122ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.783+0000 7f670ffb3700 1 --2- 172.21.15.156:0/3976775452 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f670809edb0 0x7f6708122ae0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f66f800ec40 tx=0x7f66f800ef50 comp rx=0 tx=0).stop 2023-09-30T22:19:41.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.783+0000 7f670ffb3700 1 -- 172.21.15.156:0/3976775452 shutdown_connections 2023-09-30T22:19:41.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.783+0000 7f670ffb3700 1 --2- 172.21.15.156:0/3976775452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6708133c20 0x7f6708123020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.783+0000 7f670ffb3700 1 --2- 172.21.15.156:0/3976775452 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f670809a150 0x7f67081225a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.783+0000 7f670ffb3700 1 --2- 172.21.15.156:0/3976775452 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f670809edb0 0x7f6708122ae0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.783+0000 7f670ffb3700 1 -- 172.21.15.156:0/3976775452 >> 172.21.15.156:0/3976775452 conn(0x7f67080a4430 msgr2=0x7f6708071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:41.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.783+0000 7f670ffb3700 1 -- 172.21.15.156:0/3976775452 shutdown_connections 2023-09-30T22:19:41.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.783+0000 7f670ffb3700 1 -- 172.21.15.156:0/3976775452 wait complete. 2023-09-30T22:19:41.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:41.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.828+0000 7f0481260700 1 -- 172.21.15.156:0/724430454 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f045c005590 con 0x7f047c130ce0 2023-09-30T22:19:41.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.829+0000 7f04637fe700 1 -- 172.21.15.156:0/724430454 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0474001c20 con 0x7f047c130ce0 2023-09-30T22:19:41.829 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:41.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.831+0000 7f0481260700 1 -- 172.21.15.156:0/724430454 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f047c130ce0 msgr2=0x7f047c127d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.831+0000 7f0481260700 1 --2- 172.21.15.156:0/724430454 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f047c130ce0 0x7f047c127d20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f047400cbf0 tx=0x7f047400cf00 comp rx=0 tx=0).stop 2023-09-30T22:19:41.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.831+0000 7f0481260700 1 -- 172.21.15.156:0/724430454 shutdown_connections 2023-09-30T22:19:41.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.831+0000 7f0481260700 1 --2- 172.21.15.156:0/724430454 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f047c130ce0 0x7f047c127d20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.831+0000 7f0481260700 1 --2- 172.21.15.156:0/724430454 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f047c09d860 0x7f047c1272a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.831+0000 7f0481260700 1 --2- 172.21.15.156:0/724430454 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f047c09e170 0x7f047c1277e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:41.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.831+0000 7f0481260700 1 -- 172.21.15.156:0/724430454 >> 172.21.15.156:0/724430454 conn(0x7f047c099c40 msgr2=0x7f047c0a1850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:41.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.831+0000 7f0481260700 1 -- 172.21.15.156:0/724430454 shutdown_connections 2023-09-30T22:19:41.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:41.831+0000 7f0481260700 1 -- 172.21.15.156:0/724430454 wait complete. 2023-09-30T22:19:41.843 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:42.768 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:42.781 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:42.797 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:42.844 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:42.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.917+0000 7fab50482700 1 Processor -- start 2023-09-30T22:19:42.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.917+0000 7fab50482700 1 -- start start 2023-09-30T22:19:42.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.918+0000 7fab50482700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab4812d380 0x7fab4812d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:42.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.918+0000 7fab50482700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fab4809a5a0 0x7fab48138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:42.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.918+0000 7fab50482700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4809bb90 con 0x7fab48099a60 2023-09-30T22:19:42.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.918+0000 7fab50482700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4809c210 con 0x7fab4809a5a0 2023-09-30T22:19:42.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.918+0000 7fab50482700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab4809ced0 con 0x7fab4812d380 2023-09-30T22:19:42.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.918+0000 7fab4da1d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fab48099a60 0x7fab48099e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:36126/0 (socket says 172.21.15.156:36126) 2023-09-30T22:19:42.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.918+0000 7fab4da1d700 1 -- 172.21.15.156:0/1246381036 learned_addr learned my addr 172.21.15.156:0/1246381036 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:42.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.918+0000 7fab4ea1f700 1 --2- 172.21.15.156:0/1246381036 >> v2:172.21.15.156:3300/0 conn(0x7fab4809a5a0 0x7fab48138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:42.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.918+0000 7fab4e21e700 1 --2- 172.21.15.156:0/1246381036 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab4812d380 0x7fab4812d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:42.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.919+0000 7fab4e21e700 1 -- 172.21.15.156:0/1246381036 >> v2:172.21.15.156:3300/0 conn(0x7fab4809a5a0 msgr2=0x7fab48138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:42.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.919+0000 7fab4e21e700 1 --2- 172.21.15.156:0/1246381036 >> v2:172.21.15.156:3300/0 conn(0x7fab4809a5a0 0x7fab48138620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:42.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.919+0000 7fab4e21e700 1 -- 172.21.15.156:0/1246381036 >> v1:172.21.15.156:6789/0 conn(0x7fab48099a60 legacy=0x7fab48099e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.919+0000 7fab4e21e700 1 -- 172.21.15.156:0/1246381036 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4809ac30 con 0x7fab4812d380 2023-09-30T22:19:42.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.919+0000 7fab4d21c700 1 -- 172.21.15.156:0/1246381036 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 545555195 0 0) 0x7fab4809bb90 con 0x7fab48099a60 2023-09-30T22:19:42.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.919+0000 7fab4e21e700 1 --2- 172.21.15.156:0/1246381036 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab4812d380 0x7fab4812d750 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fab44009820 tx=0x7fab44009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ca9f6e8827c20d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:42.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.919+0000 7fab4d21c700 1 -- 172.21.15.156:0/1246381036 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab44005e30 con 0x7fab4812d380 2023-09-30T22:19:42.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.919+0000 7fab4d21c700 1 -- 172.21.15.156:0/1246381036 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab44006030 con 0x7fab4812d380 2023-09-30T22:19:42.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.919+0000 7fab4d21c700 1 -- 172.21.15.156:0/1246381036 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab440063c0 con 0x7fab4812d380 2023-09-30T22:19:42.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.920+0000 7fab50482700 1 -- 172.21.15.156:0/1246381036 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab4812d380 msgr2=0x7fab4812d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.920+0000 7fab50482700 1 --2- 172.21.15.156:0/1246381036 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab4812d380 0x7fab4812d750 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fab44009820 tx=0x7fab44009b30 comp rx=0 tx=0).stop 2023-09-30T22:19:42.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.920+0000 7fab50482700 1 -- 172.21.15.156:0/1246381036 shutdown_connections 2023-09-30T22:19:42.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.920+0000 7fab50482700 1 --2- 172.21.15.156:0/1246381036 >> v2:172.21.15.156:3300/0 conn(0x7fab4809a5a0 0x7fab48138620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:42.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.920+0000 7fab50482700 1 --2- 172.21.15.156:0/1246381036 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab4812d380 0x7fab4812d750 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:42.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.920+0000 7fab50482700 1 -- 172.21.15.156:0/1246381036 >> 172.21.15.156:0/1246381036 conn(0x7fab480a2980 msgr2=0x7fab480a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:42.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.920+0000 7fab50482700 1 -- 172.21.15.156:0/1246381036 shutdown_connections 2023-09-30T22:19:42.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.920+0000 7fab50482700 1 -- 172.21.15.156:0/1246381036 wait complete. 2023-09-30T22:19:42.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.921+0000 7fab50482700 1 Processor -- start 2023-09-30T22:19:42.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.921+0000 7fab50482700 1 -- start start 2023-09-30T22:19:42.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.921+0000 7fab50482700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab48099a60 0x7fab4811cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:42.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.922+0000 7fab50482700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab4809a5a0 0x7fab4811d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:42.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.922+0000 7fab50482700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab4812d380 0x7fab4811d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:42.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.922+0000 7fab50482700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4811f0e0 con 0x7fab48099a60 2023-09-30T22:19:42.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.922+0000 7fab50482700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4811e830 con 0x7fab4809a5a0 2023-09-30T22:19:42.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.922+0000 7fab50482700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab4811e080 con 0x7fab4812d380 2023-09-30T22:19:42.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.922+0000 7fab4e21e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab48099a60 0x7fab4811cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:42.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.922+0000 7fab4e21e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab48099a60 0x7fab4811cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51346/0 (socket says 172.21.15.156:51346) 2023-09-30T22:19:42.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.922+0000 7fab4e21e700 1 -- 172.21.15.156:0/3235254340 learned_addr learned my addr 172.21.15.156:0/3235254340 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:42.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.922+0000 7fab4ea1f700 1 --2- 172.21.15.156:0/3235254340 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab4812d380 0x7fab4811d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:42.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.922+0000 7fab4da1d700 1 --2- 172.21.15.156:0/3235254340 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab4809a5a0 0x7fab4811d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:42.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.922+0000 7fab4e21e700 1 -- 172.21.15.156:0/3235254340 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab4812d380 msgr2=0x7fab4811d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.922+0000 7fab4e21e700 1 --2- 172.21.15.156:0/3235254340 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab4812d380 0x7fab4811d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:42.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.922+0000 7fab4e21e700 1 -- 172.21.15.156:0/3235254340 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab4809a5a0 msgr2=0x7fab4811d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.922+0000 7fab4e21e700 1 --2- 172.21.15.156:0/3235254340 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab4809a5a0 0x7fab4811d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:42.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.922+0000 7fab4e21e700 1 -- 172.21.15.156:0/3235254340 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab44009430 con 0x7fab48099a60 2023-09-30T22:19:42.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.922+0000 7fab4da1d700 1 --2- 172.21.15.156:0/3235254340 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab4809a5a0 0x7fab4811d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:19:42.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.922+0000 7fab4e21e700 1 --2- 172.21.15.156:0/3235254340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab48099a60 0x7fab4811cc20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fab4809d010 tx=0x7fab44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:42.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.922+0000 7fab3effd700 1 -- 172.21.15.156:0/3235254340 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab440063a0 con 0x7fab48099a60 2023-09-30T22:19:42.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.922+0000 7fab3effd700 1 -- 172.21.15.156:0/3235254340 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab44020070 con 0x7fab48099a60 2023-09-30T22:19:42.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.923+0000 7fab50482700 1 -- 172.21.15.156:0/3235254340 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab48120740 con 0x7fab48099a60 2023-09-30T22:19:42.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.923+0000 7fab3effd700 1 -- 172.21.15.156:0/3235254340 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab44006760 con 0x7fab48099a60 2023-09-30T22:19:42.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.923+0000 7fab50482700 1 -- 172.21.15.156:0/3235254340 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab4809b3e0 con 0x7fab48099a60 2023-09-30T22:19:42.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.923+0000 7fab3effd700 1 -- 172.21.15.156:0/3235254340 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab44022030 con 0x7fab48099a60 2023-09-30T22:19:42.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.924+0000 7fab50482700 1 -- 172.21.15.156:0/3235254340 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab4809efe0 con 0x7fab48099a60 2023-09-30T22:19:42.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.924+0000 7fab3effd700 1 -- 172.21.15.156:0/3235254340 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fab44040c80 con 0x7fab48099a60 2023-09-30T22:19:42.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.933+0000 7fab3effd700 1 -- 172.21.15.156:0/3235254340 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab4402e440 con 0x7fab48099a60 2023-09-30T22:19:42.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.955+0000 7f0060dfc700 1 Processor -- start 2023-09-30T22:19:42.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.955+0000 7f0060dfc700 1 -- start start 2023-09-30T22:19:42.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.956+0000 7f0060dfc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f005c09d860 0x7f005c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:42.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.956+0000 7f0060dfc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f005c09e170 0x7f005c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:42.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.956+0000 7f0060dfc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f005c130ce0 0x7f005c131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:42.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.956+0000 7f0060dfc700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f005c131670 con 0x7f005c09d860 2023-09-30T22:19:42.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.956+0000 7f0060dfc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005c09aaa0 con 0x7f005c09e170 2023-09-30T22:19:42.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.956+0000 7f0060dfc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f005c09f870 con 0x7f005c130ce0 2023-09-30T22:19:42.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.957+0000 7f005ad9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f005c130ce0 0x7f005c131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:42.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.957+0000 7f005ad9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f005c130ce0 0x7f005c131130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43802/0 (socket says 172.21.15.156:43802) 2023-09-30T22:19:42.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.957+0000 7f005ad9d700 1 -- 172.21.15.156:0/1667728093 learned_addr learned my addr 172.21.15.156:0/1667728093 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:42.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.957+0000 7f005a59c700 1 --2- 172.21.15.156:0/1667728093 >> v2:172.21.15.156:3300/0 conn(0x7f005c09d860 0x7f005c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:42.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.957+0000 7f005ad9d700 1 -- 172.21.15.156:0/1667728093 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f005c09e170 msgr2=0x7f005c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:42.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.957+0000 7f005ad9d700 1 --2- 172.21.15.156:0/1667728093 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f005c09e170 0x7f005c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:42.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.957+0000 7f005ad9d700 1 -- 172.21.15.156:0/1667728093 >> v2:172.21.15.156:3300/0 conn(0x7f005c09d860 msgr2=0x7f005c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:42.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.957+0000 7f005ad9d700 1 --2- 172.21.15.156:0/1667728093 >> v2:172.21.15.156:3300/0 conn(0x7f005c09d860 0x7f005c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:42.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.957+0000 7f005ad9d700 1 -- 172.21.15.156:0/1667728093 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005c09b360 con 0x7f005c130ce0 2023-09-30T22:19:42.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.957+0000 7f005a59c700 1 --2- 172.21.15.156:0/1667728093 >> v2:172.21.15.156:3300/0 conn(0x7f005c09d860 0x7f005c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:42.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.957+0000 7f005ad9d700 1 --2- 172.21.15.156:0/1667728093 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f005c130ce0 0x7f005c131130 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0054009f00 tx=0x7f005400d540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab672e8858a609f7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:42.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.957+0000 7f005959a700 1 -- 172.21.15.156:0/1667728093 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005400dda0 con 0x7f005c130ce0 2023-09-30T22:19:42.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.957+0000 7f005959a700 1 -- 172.21.15.156:0/1667728093 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0054011460 con 0x7f005c130ce0 2023-09-30T22:19:42.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.957+0000 7f005959a700 1 -- 172.21.15.156:0/1667728093 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0054011810 con 0x7f005c130ce0 2023-09-30T22:19:42.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.958+0000 7f0060dfc700 1 -- 172.21.15.156:0/1667728093 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f005c130ce0 msgr2=0x7f005c131130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.958+0000 7f0060dfc700 1 --2- 172.21.15.156:0/1667728093 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f005c130ce0 0x7f005c131130 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0054009f00 tx=0x7f005400d540 comp rx=0 tx=0).stop 2023-09-30T22:19:42.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.958+0000 7f0060dfc700 1 -- 172.21.15.156:0/1667728093 shutdown_connections 2023-09-30T22:19:42.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.958+0000 7f0060dfc700 1 --2- 172.21.15.156:0/1667728093 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f005c130ce0 0x7f005c131130 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:42.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.958+0000 7f0060dfc700 1 --2- 172.21.15.156:0/1667728093 >> v2:172.21.15.156:3300/0 conn(0x7f005c09d860 0x7f005c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:42.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.958+0000 7f0060dfc700 1 --2- 172.21.15.156:0/1667728093 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f005c09e170 0x7f005c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:42.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.958+0000 7f0060dfc700 1 -- 172.21.15.156:0/1667728093 >> 172.21.15.156:0/1667728093 conn(0x7f005c099c40 msgr2=0x7f005c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:42.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.958+0000 7f0060dfc700 1 -- 172.21.15.156:0/1667728093 shutdown_connections 2023-09-30T22:19:42.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.958+0000 7f0060dfc700 1 -- 172.21.15.156:0/1667728093 wait complete. 2023-09-30T22:19:42.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.959+0000 7f0060dfc700 1 Processor -- start 2023-09-30T22:19:42.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.959+0000 7f0060dfc700 1 -- start start 2023-09-30T22:19:42.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.960+0000 7f0060dfc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f005c09d860 0x7f005c126280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:42.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.960+0000 7f0060dfc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f005c09e170 0x7f005c1267c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:42.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.960+0000 7f0060dfc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f005c130ce0 0x7f005c126d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:42.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.960+0000 7f0060dfc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c0a0690 con 0x7f005c130ce0 2023-09-30T22:19:42.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.960+0000 7f0060dfc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005c129ac0 con 0x7f005c09d860 2023-09-30T22:19:42.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.960+0000 7f0060dfc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f005c12a980 con 0x7f005c09e170 2023-09-30T22:19:42.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.960+0000 7f005a59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f005c09d860 0x7f005c126280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:42.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.960+0000 7f005a59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f005c09d860 0x7f005c126280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53674/0 (socket says 172.21.15.156:53674) 2023-09-30T22:19:42.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.960+0000 7f005a59c700 1 -- 172.21.15.156:0/3722265178 learned_addr learned my addr 172.21.15.156:0/3722265178 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:42.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.960+0000 7f005ad9d700 1 --2- 172.21.15.156:0/3722265178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f005c130ce0 0x7f005c126d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:42.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.960+0000 7f0059d9b700 1 --2- 172.21.15.156:0/3722265178 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f005c09e170 0x7f005c1267c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:42.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.960+0000 7f005a59c700 1 -- 172.21.15.156:0/3722265178 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f005c09e170 msgr2=0x7f005c1267c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.960+0000 7f005a59c700 1 --2- 172.21.15.156:0/3722265178 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f005c09e170 0x7f005c1267c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:42.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.960+0000 7f005a59c700 1 -- 172.21.15.156:0/3722265178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f005c130ce0 msgr2=0x7f005c126d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.960+0000 7f005a59c700 1 --2- 172.21.15.156:0/3722265178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f005c130ce0 0x7f005c126d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:42.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.960+0000 7f005a59c700 1 -- 172.21.15.156:0/3722265178 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004c0094a0 con 0x7f005c09d860 2023-09-30T22:19:42.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.961+0000 7f005a59c700 1 --2- 172.21.15.156:0/3722265178 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f005c09d860 0x7f005c126280 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f004c00ebe0 tx=0x7f004c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:42.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.961+0000 7f004affd700 1 -- 172.21.15.156:0/3722265178 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c00c910 con 0x7f005c09d860 2023-09-30T22:19:42.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.961+0000 7f004affd700 1 -- 172.21.15.156:0/3722265178 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c00ca70 con 0x7f005c09d860 2023-09-30T22:19:42.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.961+0000 7f0060dfc700 1 -- 172.21.15.156:0/3722265178 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0054009b30 con 0x7f005c09d860 2023-09-30T22:19:42.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.961+0000 7f004affd700 1 -- 172.21.15.156:0/3722265178 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c00cde0 con 0x7f005c09d860 2023-09-30T22:19:42.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.961+0000 7f0060dfc700 1 -- 172.21.15.156:0/3722265178 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005c128680 con 0x7f005c09d860 2023-09-30T22:19:42.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.962+0000 7f004affd700 1 -- 172.21.15.156:0/3722265178 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f004c013470 con 0x7f005c09d860 2023-09-30T22:19:42.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.962+0000 7f0060dfc700 1 -- 172.21.15.156:0/3722265178 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f005c129c00 con 0x7f005c09d860 2023-09-30T22:19:42.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.962+0000 7f004affd700 1 -- 172.21.15.156:0/3722265178 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f004c03f8c0 con 0x7f005c09d860 2023-09-30T22:19:42.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.964+0000 7fdc2b933700 1 Processor -- start 2023-09-30T22:19:42.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.964+0000 7fdc2b933700 1 -- start start 2023-09-30T22:19:42.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.964+0000 7fdc2b933700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc24133ad0 0x7fdc24133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:42.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.964+0000 7fdc2b933700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdc24130bc0 0x7fdc2413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:42.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.964+0000 7fdc2b933700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc2406b2d0 con 0x7fdc241300a0 2023-09-30T22:19:42.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.964+0000 7fdc2b933700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc24133610 con 0x7fdc24130bc0 2023-09-30T22:19:42.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.964+0000 7fdc2b933700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2409a500 con 0x7fdc24133ad0 2023-09-30T22:19:42.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.964+0000 7fdc296cf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc24133ad0 0x7fdc24133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:42.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.964+0000 7fdc296cf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc24133ad0 0x7fdc24133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53686/0 (socket says 172.21.15.156:53686) 2023-09-30T22:19:42.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.964+0000 7fdc296cf700 1 -- 172.21.15.156:0/1275111176 learned_addr learned my addr 172.21.15.156:0/1275111176 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:42.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.965+0000 7fdc29ed0700 1 --2- 172.21.15.156:0/1275111176 >> v2:172.21.15.156:3300/0 conn(0x7fdc24130bc0 0x7fdc2413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:42.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.965+0000 7fdc296cf700 1 -- 172.21.15.156:0/1275111176 >> v2:172.21.15.156:3300/0 conn(0x7fdc24130bc0 msgr2=0x7fdc2413b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:42.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.965+0000 7fdc296cf700 1 --2- 172.21.15.156:0/1275111176 >> v2:172.21.15.156:3300/0 conn(0x7fdc24130bc0 0x7fdc2413b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:42.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.965+0000 7fdc296cf700 1 -- 172.21.15.156:0/1275111176 >> v1:172.21.15.156:6789/0 conn(0x7fdc241300a0 legacy=0x7fdc241304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.965+0000 7fdc296cf700 1 -- 172.21.15.156:0/1275111176 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc241338b0 con 0x7fdc24133ad0 2023-09-30T22:19:42.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.965+0000 7fdc296cf700 1 --2- 172.21.15.156:0/1275111176 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc24133ad0 0x7fdc24133ea0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdc200098f0 tx=0x7fdc20009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fb9ad716f6f0291 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:42.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.971+0000 7fdc1bfff700 1 -- 172.21.15.156:0/1275111176 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc20011830 con 0x7fdc24133ad0 2023-09-30T22:19:42.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.971+0000 7fdc1bfff700 1 -- 172.21.15.156:0/1275111176 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc20011990 con 0x7fdc24133ad0 2023-09-30T22:19:42.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.971+0000 7fdc1bfff700 1 -- 172.21.15.156:0/1275111176 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc20011d20 con 0x7fdc24133ad0 2023-09-30T22:19:42.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.971+0000 7f004affd700 1 -- 172.21.15.156:0/3722265178 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f005c129c00 con 0x7f005c09d860 2023-09-30T22:19:42.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.972+0000 7fdc2b933700 1 -- 172.21.15.156:0/1275111176 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc24133ad0 msgr2=0x7fdc24133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.972+0000 7fdc2b933700 1 --2- 172.21.15.156:0/1275111176 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc24133ad0 0x7fdc24133ea0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdc200098f0 tx=0x7fdc20009c00 comp rx=0 tx=0).stop 2023-09-30T22:19:42.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.972+0000 7fdc2b933700 1 -- 172.21.15.156:0/1275111176 shutdown_connections 2023-09-30T22:19:42.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.972+0000 7fdc2b933700 1 --2- 172.21.15.156:0/1275111176 >> v2:172.21.15.156:3300/0 conn(0x7fdc24130bc0 0x7fdc2413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:42.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.972+0000 7fdc2b933700 1 --2- 172.21.15.156:0/1275111176 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc24133ad0 0x7fdc24133ea0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:42.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.972+0000 7fdc2b933700 1 -- 172.21.15.156:0/1275111176 >> 172.21.15.156:0/1275111176 conn(0x7fdc24099c40 msgr2=0x7fdc240a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:42.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.972+0000 7fdc2b933700 1 -- 172.21.15.156:0/1275111176 shutdown_connections 2023-09-30T22:19:42.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.972+0000 7fdc2b933700 1 -- 172.21.15.156:0/1275111176 wait complete. 2023-09-30T22:19:42.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.974+0000 7fdc2b933700 1 Processor -- start 2023-09-30T22:19:42.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.974+0000 7fdc2b933700 1 -- start start 2023-09-30T22:19:42.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.974+0000 7fdc2b933700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc241300a0 0x7fdc2411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:42.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.974+0000 7fdc2b933700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc24130bc0 0x7fdc2411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:42.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.975+0000 7fdc2b933700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc24133ad0 0x7fdc2411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:42.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.975+0000 7fdc2b933700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2411f0d0 con 0x7fdc24130bc0 2023-09-30T22:19:42.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.975+0000 7fdc2b933700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2411fd70 con 0x7fdc24133ad0 2023-09-30T22:19:42.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.975+0000 7fdc2b933700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2412dd00 con 0x7fdc241300a0 2023-09-30T22:19:42.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.975+0000 7fdc296cf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc241300a0 0x7fdc2411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:42.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.975+0000 7fdc296cf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc241300a0 0x7fdc2411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43818/0 (socket says 172.21.15.156:43818) 2023-09-30T22:19:42.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.975+0000 7fdc296cf700 1 -- 172.21.15.156:0/901759519 learned_addr learned my addr 172.21.15.156:0/901759519 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:42.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.975+0000 7fdc29ed0700 1 --2- 172.21.15.156:0/901759519 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc24133ad0 0x7fdc2411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:42.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.975+0000 7fdc28ece700 1 --2- 172.21.15.156:0/901759519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc24130bc0 0x7fdc2411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:42.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.975+0000 7fdc29ed0700 1 -- 172.21.15.156:0/901759519 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc241300a0 msgr2=0x7fdc2411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.975+0000 7fdc29ed0700 1 --2- 172.21.15.156:0/901759519 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc241300a0 0x7fdc2411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:42.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.975+0000 7fdc29ed0700 1 -- 172.21.15.156:0/901759519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc24130bc0 msgr2=0x7fdc2411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.975+0000 7fdc29ed0700 1 --2- 172.21.15.156:0/901759519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc24130bc0 0x7fdc2411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:42.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.975+0000 7fdc29ed0700 1 -- 172.21.15.156:0/901759519 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc20009550 con 0x7fdc24133ad0 2023-09-30T22:19:42.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.975+0000 7fdc28ece700 1 --2- 172.21.15.156:0/901759519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc24130bc0 0x7fdc2411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:42.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.975+0000 7fdc296cf700 1 --2- 172.21.15.156:0/901759519 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc241300a0 0x7fdc2411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:42.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.975+0000 7fdc29ed0700 1 --2- 172.21.15.156:0/901759519 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc24133ad0 0x7fdc2411e4c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c00efc0 tx=0x7fdc1c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:42.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.976+0000 7fdc19ffb700 1 -- 172.21.15.156:0/901759519 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c00cc90 con 0x7fdc24133ad0 2023-09-30T22:19:42.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.976+0000 7fdc19ffb700 1 -- 172.21.15.156:0/901759519 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1c00f040 con 0x7fdc24133ad0 2023-09-30T22:19:42.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.976+0000 7fdc19ffb700 1 -- 172.21.15.156:0/901759519 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c0146c0 con 0x7fdc24133ad0 2023-09-30T22:19:42.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.976+0000 7fdc2b933700 1 -- 172.21.15.156:0/901759519 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc2412da20 con 0x7fdc24133ad0 2023-09-30T22:19:42.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.976+0000 7fdc2b933700 1 -- 172.21.15.156:0/901759519 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc2411fab0 con 0x7fdc24133ad0 2023-09-30T22:19:42.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.977+0000 7fdc19ffb700 1 -- 172.21.15.156:0/901759519 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc1c014820 con 0x7fdc24133ad0 2023-09-30T22:19:42.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.977+0000 7fdc19ffb700 1 -- 172.21.15.156:0/901759519 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdc1c0401a0 con 0x7fdc24133ad0 2023-09-30T22:19:42.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.977+0000 7fdc2b933700 1 -- 172.21.15.156:0/901759519 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc2411feb0 con 0x7fdc24133ad0 2023-09-30T22:19:42.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:42.985+0000 7fdc19ffb700 1 -- 172.21.15.156:0/901759519 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc2411feb0 con 0x7fdc24133ad0 2023-09-30T22:19:43.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.004+0000 7f7059897700 1 Processor -- start 2023-09-30T22:19:43.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.005+0000 7f7059897700 1 -- start start 2023-09-30T22:19:43.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.005+0000 7f7059897700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f705409e870 0x7f705409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:43.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.005+0000 7f7059897700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7054134330 0x7f705413be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:43.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.005+0000 7f7059897700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f705409fa00 con 0x7f705409f180 2023-09-30T22:19:43.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.005+0000 7f7059897700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70540a0370 con 0x7f7054134330 2023-09-30T22:19:43.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.005+0000 7f7059897700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705406bec0 con 0x7f705409e870 2023-09-30T22:19:43.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.005+0000 7f7052ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f705409e870 0x7f705409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:43.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.005+0000 7f7052ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f705409e870 0x7f705409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53710/0 (socket says 172.21.15.156:53710) 2023-09-30T22:19:43.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.005+0000 7f7052ffd700 1 -- 172.21.15.156:0/2158498272 learned_addr learned my addr 172.21.15.156:0/2158498272 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:43.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.005+0000 7f70537fe700 1 --2- 172.21.15.156:0/2158498272 >> v2:172.21.15.156:3300/0 conn(0x7f7054134330 0x7f705413be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:43.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.006+0000 7f70537fe700 1 -- 172.21.15.156:0/2158498272 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f705409e870 msgr2=0x7f705409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:43.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.006+0000 7f70537fe700 1 --2- 172.21.15.156:0/2158498272 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f705409e870 0x7f705409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:43.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.006+0000 7f70537fe700 1 -- 172.21.15.156:0/2158498272 >> v1:172.21.15.156:6789/0 conn(0x7f705409f180 legacy=0x7f7054133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:43.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.006+0000 7f7051ffb700 1 -- 172.21.15.156:0/2158498272 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678866473 0 0) 0x7f705409fa00 con 0x7f705409f180 2023-09-30T22:19:43.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.006+0000 7f70537fe700 1 -- 172.21.15.156:0/2158498272 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705409ada0 con 0x7f7054134330 2023-09-30T22:19:43.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.006+0000 7f7052ffd700 1 --2- 172.21.15.156:0/2158498272 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f705409e870 0x7f705409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:43.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.006+0000 7f70537fe700 1 --2- 172.21.15.156:0/2158498272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7054134330 0x7f705413be80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f704c009d90 tx=0x7f704c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b4032117a37690 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:43.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.006+0000 7f7051ffb700 1 -- 172.21.15.156:0/2158498272 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c00e070 con 0x7f7054134330 2023-09-30T22:19:43.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.006+0000 7f7051ffb700 1 -- 172.21.15.156:0/2158498272 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704c00bb20 con 0x7f7054134330 2023-09-30T22:19:43.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.006+0000 7f7051ffb700 1 -- 172.21.15.156:0/2158498272 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c012430 con 0x7f7054134330 2023-09-30T22:19:43.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.007+0000 7f7059897700 1 -- 172.21.15.156:0/2158498272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7054134330 msgr2=0x7f705413be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:43.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.007+0000 7f7059897700 1 --2- 172.21.15.156:0/2158498272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7054134330 0x7f705413be80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f704c009d90 tx=0x7f704c00b330 comp rx=0 tx=0).stop 2023-09-30T22:19:43.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.007+0000 7f7059897700 1 -- 172.21.15.156:0/2158498272 shutdown_connections 2023-09-30T22:19:43.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.007+0000 7f7059897700 1 --2- 172.21.15.156:0/2158498272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7054134330 0x7f705413be80 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:43.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.007+0000 7f7059897700 1 --2- 172.21.15.156:0/2158498272 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f705409e870 0x7f705409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:43.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.007+0000 7f7059897700 1 -- 172.21.15.156:0/2158498272 >> 172.21.15.156:0/2158498272 conn(0x7f70540a4430 msgr2=0x7f70540a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:43.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.007+0000 7f7059897700 1 -- 172.21.15.156:0/2158498272 shutdown_connections 2023-09-30T22:19:43.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.007+0000 7f7059897700 1 -- 172.21.15.156:0/2158498272 wait complete. 2023-09-30T22:19:43.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.008+0000 7f7059897700 1 Processor -- start 2023-09-30T22:19:43.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.009+0000 7f7059897700 1 -- start start 2023-09-30T22:19:43.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.009+0000 7f7059897700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f705409e870 0x7f705411a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:43.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.009+0000 7f7059897700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f705409f180 0x7f705411ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:43.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.009+0000 7f7059897700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7054134330 0x7f705411b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:43.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.009+0000 7f7059897700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705411dc30 con 0x7f705409e870 2023-09-30T22:19:43.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.009+0000 7f7059897700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705411c3d0 con 0x7f7054134330 2023-09-30T22:19:43.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.009+0000 7f7059897700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f705411def0 con 0x7f705409f180 2023-09-30T22:19:43.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.010+0000 7f7052ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f705409e870 0x7f705411a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:43.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.010+0000 7f7052ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f705409e870 0x7f705411a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51412/0 (socket says 172.21.15.156:51412) 2023-09-30T22:19:43.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.010+0000 7f7052ffd700 1 -- 172.21.15.156:0/732018028 learned_addr learned my addr 172.21.15.156:0/732018028 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:43.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.010+0000 7f70527fc700 1 --2- 172.21.15.156:0/732018028 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f705409f180 0x7f705411ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:43.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.010+0000 7f70537fe700 1 --2- 172.21.15.156:0/732018028 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7054134330 0x7f705411b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:43.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.010+0000 7f70527fc700 1 -- 172.21.15.156:0/732018028 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7054134330 msgr2=0x7f705411b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:43.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.010+0000 7f70527fc700 1 --2- 172.21.15.156:0/732018028 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7054134330 0x7f705411b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:43.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.010+0000 7f70527fc700 1 -- 172.21.15.156:0/732018028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f705409e870 msgr2=0x7f705411a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:43.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.010+0000 7f70527fc700 1 --2- 172.21.15.156:0/732018028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f705409e870 0x7f705411a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:43.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.010+0000 7f70527fc700 1 -- 172.21.15.156:0/732018028 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7044009550 con 0x7f705409f180 2023-09-30T22:19:43.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.010+0000 7f7052ffd700 1 --2- 172.21.15.156:0/732018028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f705409e870 0x7f705411a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:43.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.010+0000 7f70527fc700 1 --2- 172.21.15.156:0/732018028 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f705409f180 0x7f705411ac30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7054067390 tx=0x7f704800c710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:43.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.011+0000 7f703bfff700 1 -- 172.21.15.156:0/732018028 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70480054e0 con 0x7f705409f180 2023-09-30T22:19:43.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.011+0000 7f703bfff700 1 -- 172.21.15.156:0/732018028 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704800ce10 con 0x7f705409f180 2023-09-30T22:19:43.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.011+0000 7f703bfff700 1 -- 172.21.15.156:0/732018028 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70480038c0 con 0x7f705409f180 2023-09-30T22:19:43.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.011+0000 7f7059897700 1 -- 172.21.15.156:0/732018028 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f704c009a70 con 0x7f705409f180 2023-09-30T22:19:43.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.011+0000 7f7059897700 1 -- 172.21.15.156:0/732018028 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7054133c80 con 0x7f705409f180 2023-09-30T22:19:43.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.012+0000 7f703bfff700 1 -- 172.21.15.156:0/732018028 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7048003a20 con 0x7f705409f180 2023-09-30T22:19:43.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.012+0000 7f703bfff700 1 -- 172.21.15.156:0/732018028 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f704803eba0 con 0x7f705409f180 2023-09-30T22:19:43.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.013+0000 7f7059897700 1 -- 172.21.15.156:0/732018028 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f705404f2a0 con 0x7f705409f180 2023-09-30T22:19:43.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.022+0000 7f703bfff700 1 -- 172.21.15.156:0/732018028 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7048017020 con 0x7f705409f180 2023-09-30T22:19:43.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.137+0000 7fab50482700 1 -- 172.21.15.156:0/3235254340 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fab4804f2a0 con 0x7fab48099a60 2023-09-30T22:19:43.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.137+0000 7fab3effd700 1 -- 172.21.15.156:0/3235254340 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab440243d0 con 0x7fab48099a60 2023-09-30T22:19:43.138 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:43.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.139+0000 7fab50482700 1 -- 172.21.15.156:0/3235254340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab48099a60 msgr2=0x7fab4811cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:43.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.139+0000 7fab50482700 1 --2- 172.21.15.156:0/3235254340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab48099a60 0x7fab4811cc20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fab4809d010 tx=0x7fab44004750 comp rx=0 tx=0).stop 2023-09-30T22:19:43.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.139+0000 7fab50482700 1 -- 172.21.15.156:0/3235254340 shutdown_connections 2023-09-30T22:19:43.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.139+0000 7fab50482700 1 --2- 172.21.15.156:0/3235254340 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab4812d380 0x7fab4811d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:43.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.139+0000 7fab50482700 1 --2- 172.21.15.156:0/3235254340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab48099a60 0x7fab4811cc20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:43.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.139+0000 7fab50482700 1 --2- 172.21.15.156:0/3235254340 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab4809a5a0 0x7fab4811d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:43.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.139+0000 7fab50482700 1 -- 172.21.15.156:0/3235254340 >> 172.21.15.156:0/3235254340 conn(0x7fab480a2980 msgr2=0x7fab480a09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:43.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.139+0000 7fab50482700 1 -- 172.21.15.156:0/3235254340 shutdown_connections 2023-09-30T22:19:43.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.139+0000 7fab50482700 1 -- 172.21.15.156:0/3235254340 wait complete. 2023-09-30T22:19:43.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:43.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.174+0000 7f0060dfc700 1 -- 172.21.15.156:0/3722265178 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f005c129c00 con 0x7f005c09d860 2023-09-30T22:19:43.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.175+0000 7f004affd700 1 -- 172.21.15.156:0/3722265178 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f005c129c00 con 0x7f005c09d860 2023-09-30T22:19:43.175 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:43.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.177+0000 7f0060dfc700 1 -- 172.21.15.156:0/3722265178 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f005c09d860 msgr2=0x7f005c126280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:43.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.177+0000 7f0060dfc700 1 --2- 172.21.15.156:0/3722265178 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f005c09d860 0x7f005c126280 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f004c00ebe0 tx=0x7f004c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:19:43.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.177+0000 7f0060dfc700 1 -- 172.21.15.156:0/3722265178 shutdown_connections 2023-09-30T22:19:43.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.177+0000 7f0060dfc700 1 --2- 172.21.15.156:0/3722265178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f005c130ce0 0x7f005c126d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:43.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.177+0000 7f0060dfc700 1 --2- 172.21.15.156:0/3722265178 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f005c09d860 0x7f005c126280 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:43.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.177+0000 7f0060dfc700 1 --2- 172.21.15.156:0/3722265178 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f005c09e170 0x7f005c1267c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:43.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.177+0000 7f0060dfc700 1 -- 172.21.15.156:0/3722265178 >> 172.21.15.156:0/3722265178 conn(0x7f005c099c40 msgr2=0x7f005c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:43.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.177+0000 7f0060dfc700 1 -- 172.21.15.156:0/3722265178 shutdown_connections 2023-09-30T22:19:43.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.177+0000 7f0060dfc700 1 -- 172.21.15.156:0/3722265178 wait complete. 2023-09-30T22:19:43.190 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:43.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.213+0000 7fdc2b933700 1 -- 172.21.15.156:0/901759519 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdc2411feb0 con 0x7fdc24133ad0 2023-09-30T22:19:43.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.213+0000 7fdc19ffb700 1 -- 172.21.15.156:0/901759519 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdc2411feb0 con 0x7fdc24133ad0 2023-09-30T22:19:43.214 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:43.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.215+0000 7fdc2b933700 1 -- 172.21.15.156:0/901759519 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc24133ad0 msgr2=0x7fdc2411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:43.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.215+0000 7fdc2b933700 1 --2- 172.21.15.156:0/901759519 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc24133ad0 0x7fdc2411e4c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c00efc0 tx=0x7fdc1c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:19:43.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.215+0000 7fdc2b933700 1 -- 172.21.15.156:0/901759519 shutdown_connections 2023-09-30T22:19:43.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.215+0000 7fdc2b933700 1 --2- 172.21.15.156:0/901759519 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc24133ad0 0x7fdc2411e4c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:43.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.215+0000 7fdc2b933700 1 --2- 172.21.15.156:0/901759519 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc241300a0 0x7fdc2411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:43.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.215+0000 7fdc2b933700 1 --2- 172.21.15.156:0/901759519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc24130bc0 0x7fdc2411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:43.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.215+0000 7fdc2b933700 1 -- 172.21.15.156:0/901759519 >> 172.21.15.156:0/901759519 conn(0x7fdc24099c40 msgr2=0x7fdc24132b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:43.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.216+0000 7fdc2b933700 1 -- 172.21.15.156:0/901759519 shutdown_connections 2023-09-30T22:19:43.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.216+0000 7fdc2b933700 1 -- 172.21.15.156:0/901759519 wait complete. 2023-09-30T22:19:43.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:43.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.240+0000 7f7059897700 1 -- 172.21.15.156:0/732018028 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7054072d60 con 0x7f705409f180 2023-09-30T22:19:43.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.240+0000 7f703bfff700 1 -- 172.21.15.156:0/732018028 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7048019b40 con 0x7f705409f180 2023-09-30T22:19:43.241 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:43.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.242+0000 7f7059897700 1 -- 172.21.15.156:0/732018028 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f705409f180 msgr2=0x7f705411ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:43.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.242+0000 7f7059897700 1 --2- 172.21.15.156:0/732018028 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f705409f180 0x7f705411ac30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7054067390 tx=0x7f704800c710 comp rx=0 tx=0).stop 2023-09-30T22:19:43.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.242+0000 7f7059897700 1 -- 172.21.15.156:0/732018028 shutdown_connections 2023-09-30T22:19:43.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.242+0000 7f7059897700 1 --2- 172.21.15.156:0/732018028 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7054134330 0x7f705411b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:43.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.242+0000 7f7059897700 1 --2- 172.21.15.156:0/732018028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f705409e870 0x7f705411a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:43.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.242+0000 7f7059897700 1 --2- 172.21.15.156:0/732018028 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f705409f180 0x7f705411ac30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:43.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.242+0000 7f7059897700 1 -- 172.21.15.156:0/732018028 >> 172.21.15.156:0/732018028 conn(0x7f70540a4430 msgr2=0x7f70540a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:43.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.243+0000 7f7059897700 1 -- 172.21.15.156:0/732018028 shutdown_connections 2023-09-30T22:19:43.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:43.243+0000 7f7059897700 1 -- 172.21.15.156:0/732018028 wait complete. 2023-09-30T22:19:43.255 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:44.153 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:44.191 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:44.229 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:44.256 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:44.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.286+0000 7f77cc95d700 1 Processor -- start 2023-09-30T22:19:44.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.287+0000 7f77cc95d700 1 -- start start 2023-09-30T22:19:44.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.287+0000 7f77cc95d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f77c8133660 0x7f77c8135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:44.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.287+0000 7f77cc95d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77c8135f80 0x7f77c8138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:44.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.287+0000 7f77cc95d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c8099a60 con 0x7f77c8099e20 2023-09-30T22:19:44.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.287+0000 7f77cc95d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c809bf50 con 0x7f77c8135f80 2023-09-30T22:19:44.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.287+0000 7f77cc95d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77c809b230 con 0x7f77c8133660 2023-09-30T22:19:44.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.287+0000 7f77c6d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77c8135f80 0x7f77c8138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:44.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.287+0000 7f77c6d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77c8135f80 0x7f77c8138360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53736/0 (socket says 172.21.15.156:53736) 2023-09-30T22:19:44.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.287+0000 7f77c6d9d700 1 -- 172.21.15.156:0/2629094695 learned_addr learned my addr 172.21.15.156:0/2629094695 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:44.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.288+0000 7f77c6d9d700 1 -- 172.21.15.156:0/2629094695 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f77c8133660 msgr2=0x7f77c8135a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:44.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.288+0000 7f77c6d9d700 1 --2- 172.21.15.156:0/2629094695 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f77c8133660 0x7f77c8135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.288+0000 7f77c6d9d700 1 -- 172.21.15.156:0/2629094695 >> v1:172.21.15.156:6789/0 conn(0x7f77c8099e20 legacy=0x7f77c809a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.288+0000 7f77c6d9d700 1 -- 172.21.15.156:0/2629094695 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c809bb90 con 0x7f77c8135f80 2023-09-30T22:19:44.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.288+0000 7f77c6d9d700 1 --2- 172.21.15.156:0/2629094695 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77c8135f80 0x7f77c8138360 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f77c0009e80 tx=0x7f77c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a766bbfd75e7c8ae server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:44.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.288+0000 7f77c559a700 1 -- 172.21.15.156:0/2629094695 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c000bbc0 con 0x7f77c8135f80 2023-09-30T22:19:44.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.288+0000 7f77c559a700 1 -- 172.21.15.156:0/2629094695 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c000bd20 con 0x7f77c8135f80 2023-09-30T22:19:44.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.288+0000 7f77c559a700 1 -- 172.21.15.156:0/2629094695 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c00116a0 con 0x7f77c8135f80 2023-09-30T22:19:44.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.289+0000 7f77cc95d700 1 -- 172.21.15.156:0/2629094695 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77c8135f80 msgr2=0x7f77c8138360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.289+0000 7f77cc95d700 1 --2- 172.21.15.156:0/2629094695 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77c8135f80 0x7f77c8138360 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f77c0009e80 tx=0x7f77c000b330 comp rx=0 tx=0).stop 2023-09-30T22:19:44.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.289+0000 7f77cc95d700 1 -- 172.21.15.156:0/2629094695 shutdown_connections 2023-09-30T22:19:44.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.289+0000 7f77cc95d700 1 --2- 172.21.15.156:0/2629094695 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77c8135f80 0x7f77c8138360 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.289+0000 7f77cc95d700 1 --2- 172.21.15.156:0/2629094695 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f77c8133660 0x7f77c8135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.289+0000 7f77cc95d700 1 -- 172.21.15.156:0/2629094695 >> 172.21.15.156:0/2629094695 conn(0x7f77c80a2980 msgr2=0x7f77c80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:44.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.289+0000 7f77cc95d700 1 -- 172.21.15.156:0/2629094695 shutdown_connections 2023-09-30T22:19:44.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.289+0000 7f77cc95d700 1 -- 172.21.15.156:0/2629094695 wait complete. 2023-09-30T22:19:44.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.291+0000 7f77cc95d700 1 Processor -- start 2023-09-30T22:19:44.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.291+0000 7f77cc95d700 1 -- start start 2023-09-30T22:19:44.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.291+0000 7f77cc95d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77c8099e20 0x7f77c812cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:44.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.291+0000 7f77cc95d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77c8133660 0x7f77c812d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:44.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.291+0000 7f77cc95d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f77c8135f80 0x7f77c806fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:44.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.291+0000 7f77cc95d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c81356c0 con 0x7f77c8133660 2023-09-30T22:19:44.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.291+0000 7f77cc95d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c809b470 con 0x7f77c8099e20 2023-09-30T22:19:44.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.291+0000 7f77cc95d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77c8071b20 con 0x7f77c8135f80 2023-09-30T22:19:44.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.291+0000 7f77c6d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f77c8135f80 0x7f77c806fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:44.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.291+0000 7f77c6d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f77c8135f80 0x7f77c806fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43836/0 (socket says 172.21.15.156:43836) 2023-09-30T22:19:44.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.291+0000 7f77c6d9d700 1 -- 172.21.15.156:0/3881555997 learned_addr learned my addr 172.21.15.156:0/3881555997 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:44.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.292+0000 7f77c5d9b700 1 --2- 172.21.15.156:0/3881555997 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77c8133660 0x7f77c812d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:44.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.292+0000 7f77c6d9d700 1 -- 172.21.15.156:0/3881555997 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77c8099e20 msgr2=0x7f77c812cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.292+0000 7f77c6d9d700 1 --2- 172.21.15.156:0/3881555997 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77c8099e20 0x7f77c812cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.292+0000 7f77c6d9d700 1 -- 172.21.15.156:0/3881555997 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77c8133660 msgr2=0x7f77c812d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.292+0000 7f77c6d9d700 1 --2- 172.21.15.156:0/3881555997 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77c8133660 0x7f77c812d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.292+0000 7f77c6d9d700 1 -- 172.21.15.156:0/3881555997 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c0009b30 con 0x7f77c8135f80 2023-09-30T22:19:44.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.292+0000 7f77c6d9d700 1 --2- 172.21.15.156:0/3881555997 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f77c8135f80 0x7f77c806fe20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f77c000b370 tx=0x7f77c0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:44.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.292+0000 7f77b6ffd700 1 -- 172.21.15.156:0/3881555997 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c0004790 con 0x7f77c8135f80 2023-09-30T22:19:44.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.292+0000 7f77b6ffd700 1 -- 172.21.15.156:0/3881555997 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c000be90 con 0x7f77c8135f80 2023-09-30T22:19:44.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.292+0000 7f77cc95d700 1 -- 172.21.15.156:0/3881555997 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c811e800 con 0x7f77c8135f80 2023-09-30T22:19:44.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.292+0000 7f77b6ffd700 1 -- 172.21.15.156:0/3881555997 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c00116a0 con 0x7f77c8135f80 2023-09-30T22:19:44.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.292+0000 7f77cc95d700 1 -- 172.21.15.156:0/3881555997 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c812dae0 con 0x7f77c8135f80 2023-09-30T22:19:44.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.293+0000 7f77b4ff9700 1 -- 172.21.15.156:0/3881555997 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a00052e0 con 0x7f77c8135f80 2023-09-30T22:19:44.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.294+0000 7f77b6ffd700 1 -- 172.21.15.156:0/3881555997 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f77c0011800 con 0x7f77c8135f80 2023-09-30T22:19:44.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.294+0000 7f77b6ffd700 1 -- 172.21.15.156:0/3881555997 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f77c0041410 con 0x7f77c8135f80 2023-09-30T22:19:44.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.302+0000 7f77b6ffd700 1 -- 172.21.15.156:0/3881555997 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f77c0022980 con 0x7f77c8135f80 2023-09-30T22:19:44.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.334+0000 7f300d6ba700 1 Processor -- start 2023-09-30T22:19:44.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.334+0000 7f300d6ba700 1 -- start start 2023-09-30T22:19:44.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.335+0000 7f300d6ba700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f300809f350 0x7f3008136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:44.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.335+0000 7f300d6ba700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f30081371c0 0x7f30081395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:44.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.335+0000 7f300d6ba700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f300809c970 con 0x7f300809e870 2023-09-30T22:19:44.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.335+0000 7f300d6ba700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30080a0920 con 0x7f30081371c0 2023-09-30T22:19:44.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.335+0000 7f300d6ba700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f300809f9c0 con 0x7f300809f350 2023-09-30T22:19:44.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.335+0000 7f3006ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f300809e870 0x7f300809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:36144/0 (socket says 172.21.15.156:36144) 2023-09-30T22:19:44.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.335+0000 7f30067fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f300809f350 0x7f3008136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:44.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.335+0000 7f3006ffd700 1 -- 172.21.15.156:0/2525070252 learned_addr learned my addr 172.21.15.156:0/2525070252 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:44.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.335+0000 7f30077fe700 1 --2- 172.21.15.156:0/2525070252 >> v2:172.21.15.156:3300/0 conn(0x7f30081371c0 0x7f30081395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:44.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.336+0000 7f30067fc700 1 -- 172.21.15.156:0/2525070252 >> v2:172.21.15.156:3300/0 conn(0x7f30081371c0 msgr2=0x7f30081395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:44.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.336+0000 7f30067fc700 1 --2- 172.21.15.156:0/2525070252 >> v2:172.21.15.156:3300/0 conn(0x7f30081371c0 0x7f30081395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.336+0000 7f30067fc700 1 -- 172.21.15.156:0/2525070252 >> v1:172.21.15.156:6789/0 conn(0x7f300809e870 legacy=0x7f300809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.336+0000 7f30067fc700 1 -- 172.21.15.156:0/2525070252 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f300809bab0 con 0x7f300809f350 2023-09-30T22:19:44.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.336+0000 7f30077fe700 1 --2- 172.21.15.156:0/2525070252 >> v2:172.21.15.156:3300/0 conn(0x7f30081371c0 0x7f30081395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:44.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.336+0000 7f30067fc700 1 --2- 172.21.15.156:0/2525070252 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f300809f350 0x7f3008136c80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009840 tx=0x7f2ffc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=857fac09ebf32d5f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:44.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.336+0000 7f3005ffb700 1 -- 172.21.15.156:0/2525070252 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc011830 con 0x7f300809f350 2023-09-30T22:19:44.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.336+0000 7f3005ffb700 1 -- 172.21.15.156:0/2525070252 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ffc011990 con 0x7f300809f350 2023-09-30T22:19:44.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.336+0000 7f3005ffb700 1 -- 172.21.15.156:0/2525070252 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc011d20 con 0x7f300809f350 2023-09-30T22:19:44.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.337+0000 7f300d6ba700 1 -- 172.21.15.156:0/2525070252 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f300809f350 msgr2=0x7f3008136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.337+0000 7f300d6ba700 1 --2- 172.21.15.156:0/2525070252 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f300809f350 0x7f3008136c80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009840 tx=0x7f2ffc009b50 comp rx=0 tx=0).stop 2023-09-30T22:19:44.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.337+0000 7f300d6ba700 1 -- 172.21.15.156:0/2525070252 shutdown_connections 2023-09-30T22:19:44.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.337+0000 7f300d6ba700 1 --2- 172.21.15.156:0/2525070252 >> v2:172.21.15.156:3300/0 conn(0x7f30081371c0 0x7f30081395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.337+0000 7f300d6ba700 1 --2- 172.21.15.156:0/2525070252 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f300809f350 0x7f3008136c80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.337+0000 7f300d6ba700 1 -- 172.21.15.156:0/2525070252 >> 172.21.15.156:0/2525070252 conn(0x7f30080a4430 msgr2=0x7f30080a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:44.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.337+0000 7f300d6ba700 1 -- 172.21.15.156:0/2525070252 shutdown_connections 2023-09-30T22:19:44.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.337+0000 7f300d6ba700 1 -- 172.21.15.156:0/2525070252 wait complete. 2023-09-30T22:19:44.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.338+0000 7f300d6ba700 1 Processor -- start 2023-09-30T22:19:44.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.338+0000 7f300d6ba700 1 -- start start 2023-09-30T22:19:44.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.339+0000 7f300d6ba700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f300809e870 0x7f30081c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:44.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.339+0000 7f300d6ba700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f300809f350 0x7f30081c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:44.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.339+0000 7f300d6ba700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30081371c0 0x7f30081c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:44.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.339+0000 7f300d6ba700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3008125400 con 0x7f30081371c0 2023-09-30T22:19:44.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.339+0000 7f300d6ba700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3008123df0 con 0x7f300809f350 2023-09-30T22:19:44.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.339+0000 7f300d6ba700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3008124d80 con 0x7f300809e870 2023-09-30T22:19:44.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.339+0000 7f30067fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f300809f350 0x7f30081c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:44.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.339+0000 7f30067fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f300809f350 0x7f30081c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53760/0 (socket says 172.21.15.156:53760) 2023-09-30T22:19:44.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.339+0000 7f30067fc700 1 -- 172.21.15.156:0/2181618332 learned_addr learned my addr 172.21.15.156:0/2181618332 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:44.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.339+0000 7f30077fe700 1 --2- 172.21.15.156:0/2181618332 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30081371c0 0x7f30081c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:44.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.339+0000 7f30067fc700 1 -- 172.21.15.156:0/2181618332 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f300809e870 msgr2=0x7f30081c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.339+0000 7f30067fc700 1 --2- 172.21.15.156:0/2181618332 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f300809e870 0x7f30081c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.339+0000 7f30067fc700 1 -- 172.21.15.156:0/2181618332 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30081371c0 msgr2=0x7f30081c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.339+0000 7f30067fc700 1 --2- 172.21.15.156:0/2181618332 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30081371c0 0x7f30081c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.339+0000 7f30067fc700 1 -- 172.21.15.156:0/2181618332 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3000009a70 con 0x7f300809f350 2023-09-30T22:19:44.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.339+0000 7f30067fc700 1 --2- 172.21.15.156:0/2181618332 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f300809f350 0x7f30081c8910 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009fd0 tx=0x7f2ffc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:44.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.340+0000 7f2fef7fe700 1 -- 172.21.15.156:0/2181618332 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc0036a0 con 0x7f300809f350 2023-09-30T22:19:44.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.340+0000 7f2fef7fe700 1 -- 172.21.15.156:0/2181618332 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ffc01f070 con 0x7f300809f350 2023-09-30T22:19:44.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.340+0000 7f2fef7fe700 1 -- 172.21.15.156:0/2181618332 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc003a20 con 0x7f300809f350 2023-09-30T22:19:44.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.340+0000 7f300d6ba700 1 -- 172.21.15.156:0/2181618332 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ffc0094a0 con 0x7f300809f350 2023-09-30T22:19:44.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.340+0000 7f300d6ba700 1 -- 172.21.15.156:0/2181618332 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3008125ab0 con 0x7f300809f350 2023-09-30T22:19:44.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.341+0000 7f300d6ba700 1 -- 172.21.15.156:0/2181618332 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f300809dc50 con 0x7f300809f350 2023-09-30T22:19:44.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.342+0000 7f2fef7fe700 1 -- 172.21.15.156:0/2181618332 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2ffc003b80 con 0x7f300809f350 2023-09-30T22:19:44.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.342+0000 7f2fef7fe700 1 -- 172.21.15.156:0/2181618332 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2ffc021070 con 0x7f300809f350 2023-09-30T22:19:44.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.350+0000 7f2fef7fe700 1 -- 172.21.15.156:0/2181618332 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2ffc0253e0 con 0x7f300809f350 2023-09-30T22:19:44.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.376+0000 7f61ca840700 1 Processor -- start 2023-09-30T22:19:44.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.376+0000 7f61ca840700 1 -- start start 2023-09-30T22:19:44.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.377+0000 7f61ca840700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61c4099e20 0x7f61c409a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:44.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.377+0000 7f61ca840700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f61c409a730 0x7f61c4130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:44.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.377+0000 7f61ca840700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61c4130890 0x7f61c4130d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:44.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.377+0000 7f61ca840700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c409bf50 con 0x7f61c409a730 2023-09-30T22:19:44.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.377+0000 7f61ca840700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c4099a60 con 0x7f61c4130890 2023-09-30T22:19:44.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.377+0000 7f61ca840700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61c409b230 con 0x7f61c4099e20 2023-09-30T22:19:44.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.377+0000 7f61c8ddd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61c4130890 0x7f61c4130d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:44.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.377+0000 7f61c8ddd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61c4130890 0x7f61c4130d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53772/0 (socket says 172.21.15.156:53772) 2023-09-30T22:19:44.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.377+0000 7f61c37fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f61c409a730 0x7f61c4130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:44.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.377+0000 7f61c8ddd700 1 -- 172.21.15.156:0/2614575443 learned_addr learned my addr 172.21.15.156:0/2614575443 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:44.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.377+0000 7f61c3fff700 1 --2- 172.21.15.156:0/2614575443 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61c4099e20 0x7f61c409a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:44.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.377+0000 7f61c37fe700 1 -- 172.21.15.156:0/2614575443 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61c4099e20 msgr2=0x7f61c409a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:44.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.377+0000 7f61c37fe700 1 --2- 172.21.15.156:0/2614575443 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61c4099e20 0x7f61c409a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.377+0000 7f61c37fe700 1 -- 172.21.15.156:0/2614575443 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61c4130890 msgr2=0x7f61c4130d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:44.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.377+0000 7f61c37fe700 1 --2- 172.21.15.156:0/2614575443 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61c4130890 0x7f61c4130d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.377+0000 7f61c37fe700 1 -- 172.21.15.156:0/2614575443 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c409bb90 con 0x7f61c409a730 2023-09-30T22:19:44.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.377+0000 7f61c8ddd700 1 --2- 172.21.15.156:0/2614575443 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61c4130890 0x7f61c4130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:44.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.377+0000 7f61c37fe700 1 --2- 172.21.15.156:0/2614575443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61c409a730 0x7f61c4130350 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f61b80098a0 tx=0x7f61b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b65cc0443016ad server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:44.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.378+0000 7f61c2ffd700 1 -- 172.21.15.156:0/2614575443 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8011830 con 0x7f61c409a730 2023-09-30T22:19:44.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.378+0000 7f61c2ffd700 1 -- 172.21.15.156:0/2614575443 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b8011990 con 0x7f61c409a730 2023-09-30T22:19:44.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.378+0000 7f61c2ffd700 1 -- 172.21.15.156:0/2614575443 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8011d20 con 0x7f61c409a730 2023-09-30T22:19:44.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.378+0000 7f61ca840700 1 -- 172.21.15.156:0/2614575443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61c409a730 msgr2=0x7f61c4130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.378+0000 7f61ca840700 1 --2- 172.21.15.156:0/2614575443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61c409a730 0x7f61c4130350 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f61b80098a0 tx=0x7f61b8009bb0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.378+0000 7f61ca840700 1 -- 172.21.15.156:0/2614575443 shutdown_connections 2023-09-30T22:19:44.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.378+0000 7f61ca840700 1 --2- 172.21.15.156:0/2614575443 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61c4130890 0x7f61c4130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.378+0000 7f61ca840700 1 --2- 172.21.15.156:0/2614575443 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61c4099e20 0x7f61c409a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.378+0000 7f61ca840700 1 --2- 172.21.15.156:0/2614575443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61c409a730 0x7f61c4130350 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.378+0000 7f61ca840700 1 -- 172.21.15.156:0/2614575443 >> 172.21.15.156:0/2614575443 conn(0x7f61c40a2980 msgr2=0x7f61c40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:44.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.378+0000 7f61ca840700 1 -- 172.21.15.156:0/2614575443 shutdown_connections 2023-09-30T22:19:44.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.378+0000 7f61ca840700 1 -- 172.21.15.156:0/2614575443 wait complete. 2023-09-30T22:19:44.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.380+0000 7f61ca840700 1 Processor -- start 2023-09-30T22:19:44.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.380+0000 7f61ca840700 1 -- start start 2023-09-30T22:19:44.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.380+0000 7f61ca840700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61c4099e20 0x7f61c412d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:44.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.380+0000 7f61ca840700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61c409a730 0x7f61c412d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:44.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.380+0000 7f61ca840700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61c4130890 0x7f61c4134230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:44.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.381+0000 7f61ca840700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c4137090 con 0x7f61c4130890 2023-09-30T22:19:44.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.381+0000 7f61ca840700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c40a1200 con 0x7f61c4099e20 2023-09-30T22:19:44.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.381+0000 7f61ca840700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61c41366a0 con 0x7f61c409a730 2023-09-30T22:19:44.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.381+0000 7f61c3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61c4099e20 0x7f61c412d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:44.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.381+0000 7f61c3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61c4099e20 0x7f61c412d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53774/0 (socket says 172.21.15.156:53774) 2023-09-30T22:19:44.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.381+0000 7f61c3fff700 1 -- 172.21.15.156:0/1535922519 learned_addr learned my addr 172.21.15.156:0/1535922519 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:44.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.381+0000 7f61c8ddd700 1 --2- 172.21.15.156:0/1535922519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61c4130890 0x7f61c4134230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:44.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.381+0000 7f61c37fe700 1 --2- 172.21.15.156:0/1535922519 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61c409a730 0x7f61c412d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:44.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.381+0000 7f61c8ddd700 1 -- 172.21.15.156:0/1535922519 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61c409a730 msgr2=0x7f61c412d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.381+0000 7f61c8ddd700 1 --2- 172.21.15.156:0/1535922519 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61c409a730 0x7f61c412d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.381+0000 7f61c8ddd700 1 -- 172.21.15.156:0/1535922519 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61c4099e20 msgr2=0x7f61c412d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.381+0000 7f61c8ddd700 1 --2- 172.21.15.156:0/1535922519 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61c4099e20 0x7f61c412d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.381+0000 7f61c8ddd700 1 -- 172.21.15.156:0/1535922519 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61bc009b30 con 0x7f61c4130890 2023-09-30T22:19:44.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.381+0000 7f61c37fe700 1 --2- 172.21.15.156:0/1535922519 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61c409a730 0x7f61c412d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:44.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.381+0000 7f61c8ddd700 1 --2- 172.21.15.156:0/1535922519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61c4130890 0x7f61c4134230 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f61bc009e50 tx=0x7f61bc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:44.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.381+0000 7f61c0ff9700 1 -- 172.21.15.156:0/1535922519 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc018070 con 0x7f61c4130890 2023-09-30T22:19:44.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.381+0000 7f61c0ff9700 1 -- 172.21.15.156:0/1535922519 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61bc00f040 con 0x7f61c4130890 2023-09-30T22:19:44.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.381+0000 7f61ca840700 1 -- 172.21.15.156:0/1535922519 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b80094a0 con 0x7f61c4130890 2023-09-30T22:19:44.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.381+0000 7f61c0ff9700 1 -- 172.21.15.156:0/1535922519 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc003c40 con 0x7f61c4130890 2023-09-30T22:19:44.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.382+0000 7f61ca840700 1 -- 172.21.15.156:0/1535922519 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c41377b0 con 0x7f61c4130890 2023-09-30T22:19:44.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.383+0000 7f61ca840700 1 -- 172.21.15.156:0/1535922519 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c41375a0 con 0x7f61c4130890 2023-09-30T22:19:44.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.384+0000 7f61c0ff9700 1 -- 172.21.15.156:0/1535922519 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f61bc00c880 con 0x7f61c4130890 2023-09-30T22:19:44.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.384+0000 7f61c0ff9700 1 -- 172.21.15.156:0/1535922519 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f61bc040400 con 0x7f61c4130890 2023-09-30T22:19:44.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.388+0000 7f61c0ff9700 1 -- 172.21.15.156:0/1535922519 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f61bc00cb30 con 0x7f61c4130890 2023-09-30T22:19:44.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.420+0000 7f55f9dfc700 1 Processor -- start 2023-09-30T22:19:44.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.420+0000 7f55f9dfc700 1 -- start start 2023-09-30T22:19:44.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.421+0000 7f55f9dfc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55f409e870 0x7f55f409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:44.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.421+0000 7f55f9dfc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f55f409f180 0x7f55f4131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:44.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.421+0000 7f55f9dfc700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f409c970 con 0x7f55f4131d70 2023-09-30T22:19:44.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.421+0000 7f55f9dfc700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f40a0920 con 0x7f55f409f180 2023-09-30T22:19:44.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.421+0000 7f55f9dfc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55f409f9c0 con 0x7f55f409e870 2023-09-30T22:19:44.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.421+0000 7f55f37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55f409e870 0x7f55f409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:44.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.421+0000 7f55f37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55f409e870 0x7f55f409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43872/0 (socket says 172.21.15.156:43872) 2023-09-30T22:19:44.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.421+0000 7f55f37fe700 1 -- 172.21.15.156:0/3928064101 learned_addr learned my addr 172.21.15.156:0/3928064101 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:44.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.421+0000 7f55f2ffd700 1 --2- 172.21.15.156:0/3928064101 >> v2:172.21.15.156:3300/0 conn(0x7f55f409f180 0x7f55f4131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:44.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.422+0000 7f55f37fe700 1 -- 172.21.15.156:0/3928064101 >> v2:172.21.15.156:3300/0 conn(0x7f55f409f180 msgr2=0x7f55f4131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:44.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.422+0000 7f55f37fe700 1 --2- 172.21.15.156:0/3928064101 >> v2:172.21.15.156:3300/0 conn(0x7f55f409f180 0x7f55f4131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.422+0000 7f55f37fe700 1 -- 172.21.15.156:0/3928064101 >> v1:172.21.15.156:6789/0 conn(0x7f55f4131d70 legacy=0x7f55f4138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.422+0000 7f55f37fe700 1 -- 172.21.15.156:0/3928064101 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f409bab0 con 0x7f55f409e870 2023-09-30T22:19:44.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.422+0000 7f55f37fe700 1 --2- 172.21.15.156:0/3928064101 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55f409e870 0x7f55f409ec40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f55e40098f0 tx=0x7f55e4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1eb367b1adec7099 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:44.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.422+0000 7f55f27fc700 1 -- 172.21.15.156:0/3928064101 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e4011830 con 0x7f55f409e870 2023-09-30T22:19:44.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.422+0000 7f55f27fc700 1 -- 172.21.15.156:0/3928064101 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e4011990 con 0x7f55f409e870 2023-09-30T22:19:44.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.422+0000 7f55f27fc700 1 -- 172.21.15.156:0/3928064101 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e4011d20 con 0x7f55f409e870 2023-09-30T22:19:44.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.423+0000 7f55f9dfc700 1 -- 172.21.15.156:0/3928064101 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55f409e870 msgr2=0x7f55f409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.423+0000 7f55f9dfc700 1 --2- 172.21.15.156:0/3928064101 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55f409e870 0x7f55f409ec40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f55e40098f0 tx=0x7f55e4009c00 comp rx=0 tx=0).stop 2023-09-30T22:19:44.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.423+0000 7f55f9dfc700 1 -- 172.21.15.156:0/3928064101 shutdown_connections 2023-09-30T22:19:44.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.423+0000 7f55f9dfc700 1 --2- 172.21.15.156:0/3928064101 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55f409e870 0x7f55f409ec40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.423+0000 7f55f9dfc700 1 --2- 172.21.15.156:0/3928064101 >> v2:172.21.15.156:3300/0 conn(0x7f55f409f180 0x7f55f4131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.423+0000 7f55f9dfc700 1 -- 172.21.15.156:0/3928064101 >> 172.21.15.156:0/3928064101 conn(0x7f55f40a4430 msgr2=0x7f55f40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:44.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.423+0000 7f55f9dfc700 1 -- 172.21.15.156:0/3928064101 shutdown_connections 2023-09-30T22:19:44.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.423+0000 7f55f9dfc700 1 -- 172.21.15.156:0/3928064101 wait complete. 2023-09-30T22:19:44.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.425+0000 7f55f9dfc700 1 Processor -- start 2023-09-30T22:19:44.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.425+0000 7f55f9dfc700 1 -- start start 2023-09-30T22:19:44.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.426+0000 7f55f9dfc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55f409e870 0x7f55f41203a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:44.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.426+0000 7f55f9dfc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55f409f180 0x7f55f41208e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:44.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.426+0000 7f55f9dfc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55f4131d70 0x7f55f4120e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:44.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.426+0000 7f55f9dfc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f4121800 con 0x7f55f409e870 2023-09-30T22:19:44.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.426+0000 7f55f9dfc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f409dba0 con 0x7f55f409f180 2023-09-30T22:19:44.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.426+0000 7f55f9dfc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55f40a2d10 con 0x7f55f4131d70 2023-09-30T22:19:44.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.426+0000 7f55f2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55f409f180 0x7f55f41208e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:44.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.426+0000 7f55f2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55f409f180 0x7f55f41208e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53778/0 (socket says 172.21.15.156:53778) 2023-09-30T22:19:44.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.426+0000 7f55f2ffd700 1 -- 172.21.15.156:0/4173441754 learned_addr learned my addr 172.21.15.156:0/4173441754 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:44.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.426+0000 7f55f37fe700 1 --2- 172.21.15.156:0/4173441754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55f409e870 0x7f55f41203a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:44.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.426+0000 7f55f3fff700 1 --2- 172.21.15.156:0/4173441754 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55f4131d70 0x7f55f4120e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:44.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.426+0000 7f55f2ffd700 1 -- 172.21.15.156:0/4173441754 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55f4131d70 msgr2=0x7f55f4120e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.426+0000 7f55f2ffd700 1 --2- 172.21.15.156:0/4173441754 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55f4131d70 0x7f55f4120e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.426+0000 7f55f2ffd700 1 -- 172.21.15.156:0/4173441754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55f409e870 msgr2=0x7f55f41203a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.426+0000 7f55f2ffd700 1 --2- 172.21.15.156:0/4173441754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55f409e870 0x7f55f41203a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.426+0000 7f55f2ffd700 1 -- 172.21.15.156:0/4173441754 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e4009550 con 0x7f55f409f180 2023-09-30T22:19:44.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.427+0000 7f55f2ffd700 1 --2- 172.21.15.156:0/4173441754 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55f409f180 0x7f55f41208e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f55e800e980 tx=0x7f55e800ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:44.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.427+0000 7f55dbfff700 1 -- 172.21.15.156:0/4173441754 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e8009710 con 0x7f55f409f180 2023-09-30T22:19:44.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.427+0000 7f55dbfff700 1 -- 172.21.15.156:0/4173441754 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e800c690 con 0x7f55f409f180 2023-09-30T22:19:44.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.427+0000 7f55f9dfc700 1 -- 172.21.15.156:0/4173441754 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f4122810 con 0x7f55f409f180 2023-09-30T22:19:44.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.427+0000 7f55dbfff700 1 -- 172.21.15.156:0/4173441754 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e800ca20 con 0x7f55f409f180 2023-09-30T22:19:44.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.427+0000 7f55f9dfc700 1 -- 172.21.15.156:0/4173441754 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f4122000 con 0x7f55f409f180 2023-09-30T22:19:44.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.428+0000 7f55dbfff700 1 -- 172.21.15.156:0/4173441754 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f55e800cb80 con 0x7f55f409f180 2023-09-30T22:19:44.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.429+0000 7f55dbfff700 1 -- 172.21.15.156:0/4173441754 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f55e803fb00 con 0x7f55f409f180 2023-09-30T22:19:44.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.429+0000 7f55f9dfc700 1 -- 172.21.15.156:0/4173441754 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f4123880 con 0x7f55f409f180 2023-09-30T22:19:44.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.437+0000 7f55dbfff700 1 -- 172.21.15.156:0/4173441754 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f55f4123880 con 0x7f55f409f180 2023-09-30T22:19:44.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.505+0000 7f77b4ff9700 1 -- 172.21.15.156:0/3881555997 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f77a0005590 con 0x7f77c8135f80 2023-09-30T22:19:44.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.505+0000 7f77b6ffd700 1 -- 172.21.15.156:0/3881555997 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f77c0015070 con 0x7f77c8135f80 2023-09-30T22:19:44.506 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:44.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.507+0000 7f77b4ff9700 1 -- 172.21.15.156:0/3881555997 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f77c8135f80 msgr2=0x7f77c806fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.507+0000 7f77b4ff9700 1 --2- 172.21.15.156:0/3881555997 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f77c8135f80 0x7f77c806fe20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f77c000b370 tx=0x7f77c0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.507+0000 7f77b4ff9700 1 -- 172.21.15.156:0/3881555997 shutdown_connections 2023-09-30T22:19:44.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.507+0000 7f77b4ff9700 1 --2- 172.21.15.156:0/3881555997 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f77c8135f80 0x7f77c806fe20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.507+0000 7f77b4ff9700 1 --2- 172.21.15.156:0/3881555997 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77c8099e20 0x7f77c812cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.507+0000 7f77b4ff9700 1 --2- 172.21.15.156:0/3881555997 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77c8133660 0x7f77c812d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.507+0000 7f77b4ff9700 1 -- 172.21.15.156:0/3881555997 >> 172.21.15.156:0/3881555997 conn(0x7f77c80a2980 msgr2=0x7f77c8133a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:44.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.508+0000 7f77b4ff9700 1 -- 172.21.15.156:0/3881555997 shutdown_connections 2023-09-30T22:19:44.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.508+0000 7f77b4ff9700 1 -- 172.21.15.156:0/3881555997 wait complete. 2023-09-30T22:19:44.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:44.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.551+0000 7f300d6ba700 1 -- 172.21.15.156:0/2181618332 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f300804f2a0 con 0x7f300809f350 2023-09-30T22:19:44.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.552+0000 7f2fef7fe700 1 -- 172.21.15.156:0/2181618332 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2ffc015030 con 0x7f300809f350 2023-09-30T22:19:44.552 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:44.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.554+0000 7f300d6ba700 1 -- 172.21.15.156:0/2181618332 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f300809f350 msgr2=0x7f30081c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.554+0000 7f300d6ba700 1 --2- 172.21.15.156:0/2181618332 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f300809f350 0x7f30081c8910 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009fd0 tx=0x7f2ffc004750 comp rx=0 tx=0).stop 2023-09-30T22:19:44.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.554+0000 7f300d6ba700 1 -- 172.21.15.156:0/2181618332 shutdown_connections 2023-09-30T22:19:44.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.554+0000 7f300d6ba700 1 --2- 172.21.15.156:0/2181618332 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30081371c0 0x7f30081c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.554+0000 7f300d6ba700 1 --2- 172.21.15.156:0/2181618332 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f300809e870 0x7f30081c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.554+0000 7f300d6ba700 1 --2- 172.21.15.156:0/2181618332 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f300809f350 0x7f30081c8910 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.554+0000 7f300d6ba700 1 -- 172.21.15.156:0/2181618332 >> 172.21.15.156:0/2181618332 conn(0x7f30080a4430 msgr2=0x7f30080a36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:44.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.554+0000 7f300d6ba700 1 -- 172.21.15.156:0/2181618332 shutdown_connections 2023-09-30T22:19:44.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.554+0000 7f300d6ba700 1 -- 172.21.15.156:0/2181618332 wait complete. 2023-09-30T22:19:44.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:44.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.585+0000 7f61ca840700 1 -- 172.21.15.156:0/1535922519 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f61c404f2a0 con 0x7f61c4130890 2023-09-30T22:19:44.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.585+0000 7f61c0ff9700 1 -- 172.21.15.156:0/1535922519 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f61bc02c090 con 0x7f61c4130890 2023-09-30T22:19:44.586 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:44.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.588+0000 7f61ca840700 1 -- 172.21.15.156:0/1535922519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61c4130890 msgr2=0x7f61c4134230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.588+0000 7f61ca840700 1 --2- 172.21.15.156:0/1535922519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61c4130890 0x7f61c4134230 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f61bc009e50 tx=0x7f61bc00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.588+0000 7f61ca840700 1 -- 172.21.15.156:0/1535922519 shutdown_connections 2023-09-30T22:19:44.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.588+0000 7f61ca840700 1 --2- 172.21.15.156:0/1535922519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61c4130890 0x7f61c4134230 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.588+0000 7f61ca840700 1 --2- 172.21.15.156:0/1535922519 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61c4099e20 0x7f61c412d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.588+0000 7f61ca840700 1 --2- 172.21.15.156:0/1535922519 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61c409a730 0x7f61c412d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.588+0000 7f61ca840700 1 -- 172.21.15.156:0/1535922519 >> 172.21.15.156:0/1535922519 conn(0x7f61c40a2980 msgr2=0x7f61c409e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:44.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.588+0000 7f61ca840700 1 -- 172.21.15.156:0/1535922519 shutdown_connections 2023-09-30T22:19:44.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.588+0000 7f61ca840700 1 -- 172.21.15.156:0/1535922519 wait complete. 2023-09-30T22:19:44.605 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:44.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.639+0000 7f55f9dfc700 1 -- 172.21.15.156:0/4173441754 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f55f4123880 con 0x7f55f409f180 2023-09-30T22:19:44.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.640+0000 7f55dbfff700 1 -- 172.21.15.156:0/4173441754 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f55f4123880 con 0x7f55f409f180 2023-09-30T22:19:44.640 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:44.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.642+0000 7f55f9dfc700 1 -- 172.21.15.156:0/4173441754 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55f409f180 msgr2=0x7f55f41208e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.642+0000 7f55f9dfc700 1 --2- 172.21.15.156:0/4173441754 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55f409f180 0x7f55f41208e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f55e800e980 tx=0x7f55e800ec90 comp rx=0 tx=0).stop 2023-09-30T22:19:44.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.642+0000 7f55f9dfc700 1 -- 172.21.15.156:0/4173441754 shutdown_connections 2023-09-30T22:19:44.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.642+0000 7f55f9dfc700 1 --2- 172.21.15.156:0/4173441754 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55f4131d70 0x7f55f4120e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.642+0000 7f55f9dfc700 1 --2- 172.21.15.156:0/4173441754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55f409e870 0x7f55f41203a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.642+0000 7f55f9dfc700 1 --2- 172.21.15.156:0/4173441754 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55f409f180 0x7f55f41208e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:44.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.642+0000 7f55f9dfc700 1 -- 172.21.15.156:0/4173441754 >> 172.21.15.156:0/4173441754 conn(0x7f55f40a4430 msgr2=0x7f55f4072380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:44.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.642+0000 7f55f9dfc700 1 -- 172.21.15.156:0/4173441754 shutdown_connections 2023-09-30T22:19:44.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:44.642+0000 7f55f9dfc700 1 -- 172.21.15.156:0/4173441754 wait complete. 2023-09-30T22:19:44.654 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:45.521 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:45.568 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:45.606 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:45.655 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:45.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.663+0000 7f1b9a150700 1 Processor -- start 2023-09-30T22:19:45.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.663+0000 7f1b9a150700 1 -- start start 2023-09-30T22:19:45.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.664+0000 7f1b9a150700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b9406a770 0x7f1b941349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:45.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.664+0000 7f1b9a150700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b9409e070 0x7f1b9413fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:45.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.664+0000 7f1b9a150700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b9409eca0 con 0x7f1b94134f00 2023-09-30T22:19:45.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.664+0000 7f1b9a150700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9406b2e0 con 0x7f1b9406a770 2023-09-30T22:19:45.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.664+0000 7f1b9a150700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9409f720 con 0x7f1b9409e070 2023-09-30T22:19:45.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.664+0000 7f1b937fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b9406a770 0x7f1b941349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:45.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.664+0000 7f1b937fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b9406a770 0x7f1b941349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53782/0 (socket says 172.21.15.156:53782) 2023-09-30T22:19:45.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.664+0000 7f1b937fe700 1 -- 172.21.15.156:0/1388038298 learned_addr learned my addr 172.21.15.156:0/1388038298 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:45.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.664+0000 7f1b93fff700 1 --2- 172.21.15.156:0/1388038298 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b9409e070 0x7f1b9413fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:45.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.664+0000 7f1b93fff700 1 -- 172.21.15.156:0/1388038298 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b9406a770 msgr2=0x7f1b941349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:45.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.664+0000 7f1b93fff700 1 --2- 172.21.15.156:0/1388038298 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b9406a770 0x7f1b941349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.664+0000 7f1b93fff700 1 -- 172.21.15.156:0/1388038298 >> v1:172.21.15.156:6789/0 conn(0x7f1b94134f00 legacy=0x7f1b9409d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:45.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.664+0000 7f1b93fff700 1 -- 172.21.15.156:0/1388038298 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9406b480 con 0x7f1b9409e070 2023-09-30T22:19:45.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.664+0000 7f1b937fe700 1 --2- 172.21.15.156:0/1388038298 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b9406a770 0x7f1b941349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:45.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.665+0000 7f1b93fff700 1 --2- 172.21.15.156:0/1388038298 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b9409e070 0x7f1b9413fcf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c009dc0 tx=0x7f1b8c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=220b21e50990a16a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:45.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.665+0000 7f1b927fc700 1 -- 172.21.15.156:0/1388038298 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c00e070 con 0x7f1b9409e070 2023-09-30T22:19:45.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.665+0000 7f1b927fc700 1 -- 172.21.15.156:0/1388038298 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8c00bae0 con 0x7f1b9409e070 2023-09-30T22:19:45.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.665+0000 7f1b927fc700 1 -- 172.21.15.156:0/1388038298 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c00be90 con 0x7f1b9409e070 2023-09-30T22:19:45.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.666+0000 7f1b9a150700 1 -- 172.21.15.156:0/1388038298 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b9409e070 msgr2=0x7f1b9413fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.666+0000 7f1b9a150700 1 --2- 172.21.15.156:0/1388038298 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b9409e070 0x7f1b9413fcf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c009dc0 tx=0x7f1b8c00b330 comp rx=0 tx=0).stop 2023-09-30T22:19:45.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.666+0000 7f1b9a150700 1 -- 172.21.15.156:0/1388038298 shutdown_connections 2023-09-30T22:19:45.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.666+0000 7f1b9a150700 1 --2- 172.21.15.156:0/1388038298 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b9406a770 0x7f1b941349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.666+0000 7f1b9a150700 1 --2- 172.21.15.156:0/1388038298 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b9409e070 0x7f1b9413fcf0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.666+0000 7f1b9a150700 1 -- 172.21.15.156:0/1388038298 >> 172.21.15.156:0/1388038298 conn(0x7f1b94099c40 msgr2=0x7f1b940a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:45.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.666+0000 7f1b9a150700 1 -- 172.21.15.156:0/1388038298 shutdown_connections 2023-09-30T22:19:45.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.666+0000 7f1b9a150700 1 -- 172.21.15.156:0/1388038298 wait complete. 2023-09-30T22:19:45.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.667+0000 7f1b9a150700 1 Processor -- start 2023-09-30T22:19:45.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.668+0000 7f1b9a150700 1 -- start start 2023-09-30T22:19:45.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.668+0000 7f1b9a150700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b9406a770 0x7f1b9406f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:45.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.668+0000 7f1b9a150700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b9409e070 0x7f1b9406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:45.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.668+0000 7f1b9a150700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b94134f00 0x7f1b940703d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:45.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.668+0000 7f1b9a150700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b94126900 con 0x7f1b94134f00 2023-09-30T22:19:45.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.668+0000 7f1b9a150700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b94070d20 con 0x7f1b9406a770 2023-09-30T22:19:45.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.668+0000 7f1b9a150700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b94126e20 con 0x7f1b9409e070 2023-09-30T22:19:45.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.668+0000 7f1b92ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b9409e070 0x7f1b9406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:45.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.668+0000 7f1b92ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b9409e070 0x7f1b9406fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43892/0 (socket says 172.21.15.156:43892) 2023-09-30T22:19:45.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.668+0000 7f1b92ffd700 1 -- 172.21.15.156:0/2292818909 learned_addr learned my addr 172.21.15.156:0/2292818909 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:45.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.669+0000 7f1b93fff700 1 --2- 172.21.15.156:0/2292818909 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b94134f00 0x7f1b940703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:45.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.669+0000 7f1b92ffd700 1 -- 172.21.15.156:0/2292818909 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b9406a770 msgr2=0x7f1b9406f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.669+0000 7f1b92ffd700 1 --2- 172.21.15.156:0/2292818909 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b9406a770 0x7f1b9406f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.669+0000 7f1b92ffd700 1 -- 172.21.15.156:0/2292818909 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b94134f00 msgr2=0x7f1b940703d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.669+0000 7f1b92ffd700 1 --2- 172.21.15.156:0/2292818909 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b94134f00 0x7f1b940703d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.669+0000 7f1b92ffd700 1 -- 172.21.15.156:0/2292818909 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b84009550 con 0x7f1b9409e070 2023-09-30T22:19:45.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.669+0000 7f1b92ffd700 1 --2- 172.21.15.156:0/2292818909 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b9409e070 0x7f1b9406fe90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1b8800c4a0 tx=0x7f1b8800c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:45.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.669+0000 7f1b7bfff700 1 -- 172.21.15.156:0/2292818909 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b880054e0 con 0x7f1b9409e070 2023-09-30T22:19:45.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.670+0000 7f1b7bfff700 1 -- 172.21.15.156:0/2292818909 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b88003680 con 0x7f1b9409e070 2023-09-30T22:19:45.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.670+0000 7f1b7bfff700 1 -- 172.21.15.156:0/2292818909 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b88003a10 con 0x7f1b9409e070 2023-09-30T22:19:45.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.670+0000 7f1b9a150700 1 -- 172.21.15.156:0/2292818909 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b8c009a70 con 0x7f1b9409e070 2023-09-30T22:19:45.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.670+0000 7f1b9a150700 1 -- 172.21.15.156:0/2292818909 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b940725b0 con 0x7f1b9409e070 2023-09-30T22:19:45.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.671+0000 7f1b9a150700 1 -- 172.21.15.156:0/2292818909 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b740052e0 con 0x7f1b9409e070 2023-09-30T22:19:45.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.671+0000 7f1b7bfff700 1 -- 172.21.15.156:0/2292818909 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1b88003b70 con 0x7f1b9409e070 2023-09-30T22:19:45.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.671+0000 7f1b7bfff700 1 -- 172.21.15.156:0/2292818909 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1b8803e890 con 0x7f1b9409e070 2023-09-30T22:19:45.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.676+0000 7f1b7bfff700 1 -- 172.21.15.156:0/2292818909 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1b88011be0 con 0x7f1b9409e070 2023-09-30T22:19:45.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.707+0000 7fedf950d700 1 Processor -- start 2023-09-30T22:19:45.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.707+0000 7fedf950d700 1 -- start start 2023-09-30T22:19:45.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.707+0000 7fedf950d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fedf409d860 0x7fedf409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:45.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.707+0000 7fedf950d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fedf409e170 0x7fedf41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:45.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.708+0000 7fedf950d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fedf4130ce0 0x7fedf4131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:45.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.708+0000 7fedf950d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf409aaa0 con 0x7fedf4130ce0 2023-09-30T22:19:45.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.708+0000 7fedf950d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf409f870 con 0x7fedf409d860 2023-09-30T22:19:45.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.708+0000 7fedf950d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedf409b360 con 0x7fedf409e170 2023-09-30T22:19:45.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.708+0000 7fedebfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fedf409e170 0x7fedf41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:45.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.708+0000 7fedebfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fedf409e170 0x7fedf41307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43896/0 (socket says 172.21.15.156:43896) 2023-09-30T22:19:45.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.708+0000 7fedebfff700 1 -- 172.21.15.156:0/3733379697 learned_addr learned my addr 172.21.15.156:0/3733379697 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:45.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.708+0000 7fedf37fe700 1 --2- 172.21.15.156:0/3733379697 >> v2:172.21.15.156:3300/0 conn(0x7fedf4130ce0 0x7fedf4131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:45.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.708+0000 7fedf2ffd700 1 --2- 172.21.15.156:0/3733379697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fedf409d860 0x7fedf409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:45.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.708+0000 7fedebfff700 1 -- 172.21.15.156:0/3733379697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fedf409d860 msgr2=0x7fedf409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:45.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.708+0000 7fedebfff700 1 --2- 172.21.15.156:0/3733379697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fedf409d860 0x7fedf409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.708+0000 7fedebfff700 1 -- 172.21.15.156:0/3733379697 >> v2:172.21.15.156:3300/0 conn(0x7fedf4130ce0 msgr2=0x7fedf4131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:45.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.708+0000 7fedebfff700 1 --2- 172.21.15.156:0/3733379697 >> v2:172.21.15.156:3300/0 conn(0x7fedf4130ce0 0x7fedf4131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.708+0000 7fedebfff700 1 -- 172.21.15.156:0/3733379697 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf409b620 con 0x7fedf409e170 2023-09-30T22:19:45.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.708+0000 7fedf2ffd700 1 --2- 172.21.15.156:0/3733379697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fedf409d860 0x7fedf409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:19:45.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.708+0000 7fedebfff700 1 --2- 172.21.15.156:0/3733379697 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fedf409e170 0x7fedf41307a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7feddc0098f0 tx=0x7feddc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99c8961398c9c56c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:45.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.709+0000 7fedf27fc700 1 -- 172.21.15.156:0/3733379697 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc011830 con 0x7fedf409e170 2023-09-30T22:19:45.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.709+0000 7fedf27fc700 1 -- 172.21.15.156:0/3733379697 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feddc011990 con 0x7fedf409e170 2023-09-30T22:19:45.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.709+0000 7fedf27fc700 1 -- 172.21.15.156:0/3733379697 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc011d20 con 0x7fedf409e170 2023-09-30T22:19:45.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.709+0000 7fedf950d700 1 -- 172.21.15.156:0/3733379697 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fedf409e170 msgr2=0x7fedf41307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.709+0000 7fedf950d700 1 --2- 172.21.15.156:0/3733379697 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fedf409e170 0x7fedf41307a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7feddc0098f0 tx=0x7feddc009c00 comp rx=0 tx=0).stop 2023-09-30T22:19:45.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.709+0000 7fedf950d700 1 -- 172.21.15.156:0/3733379697 shutdown_connections 2023-09-30T22:19:45.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.709+0000 7fedf950d700 1 --2- 172.21.15.156:0/3733379697 >> v2:172.21.15.156:3300/0 conn(0x7fedf4130ce0 0x7fedf4131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.709+0000 7fedf950d700 1 --2- 172.21.15.156:0/3733379697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fedf409d860 0x7fedf409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.709+0000 7fedf950d700 1 --2- 172.21.15.156:0/3733379697 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fedf409e170 0x7fedf41307a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.709+0000 7fedf950d700 1 -- 172.21.15.156:0/3733379697 >> 172.21.15.156:0/3733379697 conn(0x7fedf4099c40 msgr2=0x7fedf40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:45.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.709+0000 7fedf950d700 1 -- 172.21.15.156:0/3733379697 shutdown_connections 2023-09-30T22:19:45.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.710+0000 7fedf950d700 1 -- 172.21.15.156:0/3733379697 wait complete. 2023-09-30T22:19:45.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.710+0000 7fedf950d700 1 Processor -- start 2023-09-30T22:19:45.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.710+0000 7fedf950d700 1 -- start start 2023-09-30T22:19:45.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.711+0000 7fedf950d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fedf409d860 0x7fedf41c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:45.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.711+0000 7fedf950d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fedf409e170 0x7fedf41c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:45.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.711+0000 7fedf950d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedf4130ce0 0x7fedf41c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:45.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.711+0000 7fedf950d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf412f8f0 con 0x7fedf4130ce0 2023-09-30T22:19:45.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.711+0000 7fedf950d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf412c440 con 0x7fedf409d860 2023-09-30T22:19:45.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.711+0000 7fedf950d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedf40a1f20 con 0x7fedf409e170 2023-09-30T22:19:45.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.711+0000 7fedf2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fedf409d860 0x7fedf41c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:45.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.711+0000 7fedf2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fedf409d860 0x7fedf41c8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53814/0 (socket says 172.21.15.156:53814) 2023-09-30T22:19:45.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.711+0000 7fedf2ffd700 1 -- 172.21.15.156:0/2683508491 learned_addr learned my addr 172.21.15.156:0/2683508491 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:45.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.711+0000 7fedf37fe700 1 --2- 172.21.15.156:0/2683508491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedf4130ce0 0x7fedf41c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:45.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.711+0000 7fedebfff700 1 --2- 172.21.15.156:0/2683508491 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fedf409e170 0x7fedf41c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:45.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.711+0000 7fedf2ffd700 1 -- 172.21.15.156:0/2683508491 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fedf409e170 msgr2=0x7fedf41c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.711+0000 7fedf2ffd700 1 --2- 172.21.15.156:0/2683508491 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fedf409e170 0x7fedf41c85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.711+0000 7fedf2ffd700 1 -- 172.21.15.156:0/2683508491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedf4130ce0 msgr2=0x7fedf41c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.711+0000 7fedf2ffd700 1 --2- 172.21.15.156:0/2683508491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedf4130ce0 0x7fedf41c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.711+0000 7fedf2ffd700 1 -- 172.21.15.156:0/2683508491 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feddc009550 con 0x7fedf409d860 2023-09-30T22:19:45.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.711+0000 7fedf37fe700 1 --2- 172.21.15.156:0/2683508491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedf4130ce0 0x7fedf41c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:45.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.712+0000 7fedf2ffd700 1 --2- 172.21.15.156:0/2683508491 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fedf409d860 0x7fedf41c8060 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fede400c740 tx=0x7fede400ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:45.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.712+0000 7fedeb7fe700 1 -- 172.21.15.156:0/2683508491 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede401d430 con 0x7fedf409d860 2023-09-30T22:19:45.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.712+0000 7fedeb7fe700 1 -- 172.21.15.156:0/2683508491 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede401d590 con 0x7fedf409d860 2023-09-30T22:19:45.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.712+0000 7fedf950d700 1 -- 172.21.15.156:0/2683508491 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf409c8b0 con 0x7fedf409d860 2023-09-30T22:19:45.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.712+0000 7fedeb7fe700 1 -- 172.21.15.156:0/2683508491 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede401d900 con 0x7fedf409d860 2023-09-30T22:19:45.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.712+0000 7fedf950d700 1 -- 172.21.15.156:0/2683508491 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf412e5d0 con 0x7fedf409d860 2023-09-30T22:19:45.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.713+0000 7fedeb7fe700 1 -- 172.21.15.156:0/2683508491 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fede401da60 con 0x7fedf409d860 2023-09-30T22:19:45.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.713+0000 7fedf950d700 1 -- 172.21.15.156:0/2683508491 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf412f750 con 0x7fedf409d860 2023-09-30T22:19:45.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.715+0000 7fedeb7fe700 1 -- 172.21.15.156:0/2683508491 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fede401b340 con 0x7fedf409d860 2023-09-30T22:19:45.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.722+0000 7fedeb7fe700 1 -- 172.21.15.156:0/2683508491 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fedf412f750 con 0x7fedf409d860 2023-09-30T22:19:45.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.752+0000 7fbdb721b700 1 Processor -- start 2023-09-30T22:19:45.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.752+0000 7fbdb721b700 1 -- start start 2023-09-30T22:19:45.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.753+0000 7fbdb721b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbdb0138040 0x7fbdb0138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:45.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.753+0000 7fbdb721b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbdb00a1400 0x7fbdb013fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:45.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.753+0000 7fbdb721b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb01379e0 con 0x7fbdb00a08e0 2023-09-30T22:19:45.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.753+0000 7fbdb721b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdb00a2100 con 0x7fbdb00a1400 2023-09-30T22:19:45.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.753+0000 7fbdb721b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb0138950 con 0x7fbdb0138040 2023-09-30T22:19:45.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.753+0000 7fbdaffff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fbdb00a08e0 0x7fbdb00a0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:36170/0 (socket says 172.21.15.156:36170) 2023-09-30T22:19:45.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.753+0000 7fbdaffff700 1 -- 172.21.15.156:0/4281504077 learned_addr learned my addr 172.21.15.156:0/4281504077 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:45.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.753+0000 7fbdb4fb7700 1 --2- 172.21.15.156:0/4281504077 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbdb0138040 0x7fbdb0138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:45.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.753+0000 7fbdb57b8700 1 --2- 172.21.15.156:0/4281504077 >> v2:172.21.15.156:3300/0 conn(0x7fbdb00a1400 0x7fbdb013fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:45.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.753+0000 7fbdb4fb7700 1 -- 172.21.15.156:0/4281504077 >> v2:172.21.15.156:3300/0 conn(0x7fbdb00a1400 msgr2=0x7fbdb013fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:45.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.753+0000 7fbdb4fb7700 1 --2- 172.21.15.156:0/4281504077 >> v2:172.21.15.156:3300/0 conn(0x7fbdb00a1400 0x7fbdb013fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.753+0000 7fbdb4fb7700 1 -- 172.21.15.156:0/4281504077 >> v1:172.21.15.156:6789/0 conn(0x7fbdb00a08e0 legacy=0x7fbdb00a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.753+0000 7fbdb4fb7700 1 -- 172.21.15.156:0/4281504077 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb009b9b0 con 0x7fbdb0138040 2023-09-30T22:19:45.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.753+0000 7fbdaf7fe700 1 -- 172.21.15.156:0/4281504077 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3840677731 0 0) 0x7fbdb01379e0 con 0x7fbdb00a08e0 2023-09-30T22:19:45.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.753+0000 7fbdb4fb7700 1 --2- 172.21.15.156:0/4281504077 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbdb0138040 0x7fbdb0138410 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbda4009850 tx=0x7fbda4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=414092b667bed423 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:45.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.754+0000 7fbdaf7fe700 1 -- 172.21.15.156:0/4281504077 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda4005e30 con 0x7fbdb0138040 2023-09-30T22:19:45.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.754+0000 7fbdaf7fe700 1 -- 172.21.15.156:0/4281504077 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda4006030 con 0x7fbdb0138040 2023-09-30T22:19:45.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.754+0000 7fbdaf7fe700 1 -- 172.21.15.156:0/4281504077 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda40063c0 con 0x7fbdb0138040 2023-09-30T22:19:45.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.755+0000 7fbdb721b700 1 -- 172.21.15.156:0/4281504077 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbdb0138040 msgr2=0x7fbdb0138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.755+0000 7fbdb721b700 1 --2- 172.21.15.156:0/4281504077 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbdb0138040 0x7fbdb0138410 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbda4009850 tx=0x7fbda4009b60 comp rx=0 tx=0).stop 2023-09-30T22:19:45.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.755+0000 7fbdb721b700 1 -- 172.21.15.156:0/4281504077 shutdown_connections 2023-09-30T22:19:45.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.755+0000 7fbdb721b700 1 --2- 172.21.15.156:0/4281504077 >> v2:172.21.15.156:3300/0 conn(0x7fbdb00a1400 0x7fbdb013fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.755+0000 7fbdb721b700 1 --2- 172.21.15.156:0/4281504077 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbdb0138040 0x7fbdb0138410 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.755+0000 7fbdb721b700 1 -- 172.21.15.156:0/4281504077 >> 172.21.15.156:0/4281504077 conn(0x7fbdb00a2980 msgr2=0x7fbdb00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:45.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.755+0000 7fbdb721b700 1 -- 172.21.15.156:0/4281504077 shutdown_connections 2023-09-30T22:19:45.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.755+0000 7fbdb721b700 1 -- 172.21.15.156:0/4281504077 wait complete. 2023-09-30T22:19:45.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.756+0000 7fbdb721b700 1 Processor -- start 2023-09-30T22:19:45.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.756+0000 7fbdb721b700 1 -- start start 2023-09-30T22:19:45.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.756+0000 7fbdb721b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbdb00a08e0 0x7fbdb0126340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:45.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.756+0000 7fbdb721b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbdb00a1400 0x7fbdb0126880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:45.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.756+0000 7fbdb721b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbdb0138040 0x7fbdb0126dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:45.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.756+0000 7fbdb721b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb009a2b0 con 0x7fbdb00a08e0 2023-09-30T22:19:45.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.756+0000 7fbdb721b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb0127780 con 0x7fbdb00a1400 2023-09-30T22:19:45.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.756+0000 7fbdb721b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb0129af0 con 0x7fbdb0138040 2023-09-30T22:19:45.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.756+0000 7fbdb4fb7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbdb00a08e0 0x7fbdb0126340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:45.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.756+0000 7fbdb4fb7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbdb00a08e0 0x7fbdb0126340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51540/0 (socket says 172.21.15.156:51540) 2023-09-30T22:19:45.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.756+0000 7fbdb4fb7700 1 -- 172.21.15.156:0/3202431125 learned_addr learned my addr 172.21.15.156:0/3202431125 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:45.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.756+0000 7fbdb57b8700 1 --2- 172.21.15.156:0/3202431125 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbdb0138040 0x7fbdb0126dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:45.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.756+0000 7fbdaffff700 1 --2- 172.21.15.156:0/3202431125 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbdb00a1400 0x7fbdb0126880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:45.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.757+0000 7fbdb4fb7700 1 -- 172.21.15.156:0/3202431125 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbdb0138040 msgr2=0x7fbdb0126dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.757+0000 7fbdb4fb7700 1 --2- 172.21.15.156:0/3202431125 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbdb0138040 0x7fbdb0126dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.757+0000 7fbdb4fb7700 1 -- 172.21.15.156:0/3202431125 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbdb00a1400 msgr2=0x7fbdb0126880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.757+0000 7fbdb4fb7700 1 --2- 172.21.15.156:0/3202431125 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbdb00a1400 0x7fbdb0126880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.757+0000 7fbdb4fb7700 1 -- 172.21.15.156:0/3202431125 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda4009430 con 0x7fbdb00a08e0 2023-09-30T22:19:45.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.757+0000 7fbdaffff700 1 --2- 172.21.15.156:0/3202431125 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbdb00a1400 0x7fbdb0126880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:45.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.757+0000 7fbdb4fb7700 1 --2- 172.21.15.156:0/3202431125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbdb00a08e0 0x7fbdb0126340 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbda4013040 tx=0x7fbda4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:45.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.757+0000 7fbdad7fa700 1 -- 172.21.15.156:0/3202431125 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda4006950 con 0x7fbdb00a08e0 2023-09-30T22:19:45.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.757+0000 7fbdad7fa700 1 -- 172.21.15.156:0/3202431125 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda4020070 con 0x7fbdb00a08e0 2023-09-30T22:19:45.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.757+0000 7fbdad7fa700 1 -- 172.21.15.156:0/3202431125 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda4025670 con 0x7fbdb00a08e0 2023-09-30T22:19:45.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.757+0000 7fbdb721b700 1 -- 172.21.15.156:0/3202431125 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb01286e0 con 0x7fbdb00a08e0 2023-09-30T22:19:45.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.758+0000 7fbdb721b700 1 -- 172.21.15.156:0/3202431125 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb0137200 con 0x7fbdb00a08e0 2023-09-30T22:19:45.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.758+0000 7fbdb721b700 1 -- 172.21.15.156:0/3202431125 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb004f2a0 con 0x7fbdb00a08e0 2023-09-30T22:19:45.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.759+0000 7fbdad7fa700 1 -- 172.21.15.156:0/3202431125 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbda4022030 con 0x7fbdb00a08e0 2023-09-30T22:19:45.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.759+0000 7fbdad7fa700 1 -- 172.21.15.156:0/3202431125 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbda4040fd0 con 0x7fbdb00a08e0 2023-09-30T22:19:45.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.764+0000 7fbdad7fa700 1 -- 172.21.15.156:0/3202431125 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbda40197c0 con 0x7fbdb00a08e0 2023-09-30T22:19:45.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.794+0000 7ff13f89c700 1 Processor -- start 2023-09-30T22:19:45.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.794+0000 7ff13f89c700 1 -- start start 2023-09-30T22:19:45.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.795+0000 7ff13f89c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff13812feb0 0x7ff138130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:45.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.795+0000 7ff13f89c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff138099af0 0x7ff138137ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:45.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.795+0000 7ff13f89c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff13809a540 con 0x7ff1381307c0 2023-09-30T22:19:45.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.795+0000 7ff13f89c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff13809ad40 con 0x7ff13812feb0 2023-09-30T22:19:45.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.795+0000 7ff13f89c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13809e640 con 0x7ff138099af0 2023-09-30T22:19:45.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.795+0000 7ff13de39700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff138099af0 0x7ff138137ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:45.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.795+0000 7ff13ce37700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff1381307c0 0x7ff1380993e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:36174/0 (socket says 172.21.15.156:36174) 2023-09-30T22:19:45.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.795+0000 7ff13ce37700 1 -- 172.21.15.156:0/2421804795 learned_addr learned my addr 172.21.15.156:0/2421804795 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:45.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.795+0000 7ff13d638700 1 --2- 172.21.15.156:0/2421804795 >> v2:172.21.15.156:3300/0 conn(0x7ff13812feb0 0x7ff138130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:45.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.795+0000 7ff13de39700 1 -- 172.21.15.156:0/2421804795 >> v2:172.21.15.156:3300/0 conn(0x7ff13812feb0 msgr2=0x7ff138130280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:45.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.795+0000 7ff13de39700 1 --2- 172.21.15.156:0/2421804795 >> v2:172.21.15.156:3300/0 conn(0x7ff13812feb0 0x7ff138130280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.795+0000 7ff13de39700 1 -- 172.21.15.156:0/2421804795 >> v1:172.21.15.156:6789/0 conn(0x7ff1381307c0 legacy=0x7ff1380993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.795+0000 7ff13de39700 1 -- 172.21.15.156:0/2421804795 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13809e3c0 con 0x7ff138099af0 2023-09-30T22:19:45.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.795+0000 7ff13de39700 1 --2- 172.21.15.156:0/2421804795 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff138099af0 0x7ff138137ea0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff130009e10 tx=0x7ff13000d540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49640927679b2dcc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:45.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.796+0000 7ff12ffff700 1 -- 172.21.15.156:0/2421804795 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff130011460 con 0x7ff138099af0 2023-09-30T22:19:45.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.796+0000 7ff12ffff700 1 -- 172.21.15.156:0/2421804795 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1300115c0 con 0x7ff138099af0 2023-09-30T22:19:45.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.796+0000 7ff12ffff700 1 -- 172.21.15.156:0/2421804795 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff130011950 con 0x7ff138099af0 2023-09-30T22:19:45.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.796+0000 7ff13f89c700 1 -- 172.21.15.156:0/2421804795 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff138099af0 msgr2=0x7ff138137ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.796+0000 7ff13f89c700 1 --2- 172.21.15.156:0/2421804795 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff138099af0 0x7ff138137ea0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff130009e10 tx=0x7ff13000d540 comp rx=0 tx=0).stop 2023-09-30T22:19:45.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.796+0000 7ff13f89c700 1 -- 172.21.15.156:0/2421804795 shutdown_connections 2023-09-30T22:19:45.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.796+0000 7ff13f89c700 1 --2- 172.21.15.156:0/2421804795 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff138099af0 0x7ff138137ea0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.796+0000 7ff13f89c700 1 --2- 172.21.15.156:0/2421804795 >> v2:172.21.15.156:3300/0 conn(0x7ff13812feb0 0x7ff138130280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.796+0000 7ff13f89c700 1 -- 172.21.15.156:0/2421804795 >> 172.21.15.156:0/2421804795 conn(0x7ff1380a2b30 msgr2=0x7ff13809e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:45.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.796+0000 7ff13f89c700 1 -- 172.21.15.156:0/2421804795 shutdown_connections 2023-09-30T22:19:45.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.796+0000 7ff13f89c700 1 -- 172.21.15.156:0/2421804795 wait complete. 2023-09-30T22:19:45.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.798+0000 7ff13f89c700 1 Processor -- start 2023-09-30T22:19:45.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.798+0000 7ff13f89c700 1 -- start start 2023-09-30T22:19:45.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.798+0000 7ff13f89c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff138099af0 0x7ff1380984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:45.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.798+0000 7ff13f89c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff13812feb0 0x7ff1380989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:45.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.798+0000 7ff13f89c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1381307c0 0x7ff1381285e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:45.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.798+0000 7ff13f89c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13806f4a0 con 0x7ff13812feb0 2023-09-30T22:19:45.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.798+0000 7ff13f89c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13812a300 con 0x7ff1381307c0 2023-09-30T22:19:45.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.798+0000 7ff13f89c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff138070080 con 0x7ff138099af0 2023-09-30T22:19:45.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.799+0000 7ff13ce37700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff13812feb0 0x7ff1380989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:45.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.799+0000 7ff13ce37700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff13812feb0 0x7ff1380989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51562/0 (socket says 172.21.15.156:51562) 2023-09-30T22:19:45.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.799+0000 7ff13ce37700 1 -- 172.21.15.156:0/2330817682 learned_addr learned my addr 172.21.15.156:0/2330817682 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:45.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.799+0000 7ff13d638700 1 --2- 172.21.15.156:0/2330817682 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff138099af0 0x7ff1380984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:45.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.799+0000 7ff13de39700 1 --2- 172.21.15.156:0/2330817682 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1381307c0 0x7ff1381285e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:45.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.799+0000 7ff13d638700 1 -- 172.21.15.156:0/2330817682 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1381307c0 msgr2=0x7ff1381285e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.799+0000 7ff13d638700 1 --2- 172.21.15.156:0/2330817682 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1381307c0 0x7ff1381285e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.799+0000 7ff13d638700 1 -- 172.21.15.156:0/2330817682 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff13812feb0 msgr2=0x7ff1380989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.799+0000 7ff13d638700 1 --2- 172.21.15.156:0/2330817682 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff13812feb0 0x7ff1380989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.799+0000 7ff13d638700 1 -- 172.21.15.156:0/2330817682 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff130009a70 con 0x7ff138099af0 2023-09-30T22:19:45.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.799+0000 7ff13ce37700 1 --2- 172.21.15.156:0/2330817682 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff13812feb0 0x7ff1380989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:45.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.799+0000 7ff13d638700 1 --2- 172.21.15.156:0/2330817682 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff138099af0 0x7ff1380984a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff13400d6d0 tx=0x7ff13400d9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:45.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.799+0000 7ff12dffb700 1 -- 172.21.15.156:0/2330817682 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134012bb0 con 0x7ff138099af0 2023-09-30T22:19:45.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.799+0000 7ff12dffb700 1 -- 172.21.15.156:0/2330817682 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff134012d10 con 0x7ff138099af0 2023-09-30T22:19:45.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.799+0000 7ff13f89c700 1 -- 172.21.15.156:0/2330817682 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff138098f20 con 0x7ff138099af0 2023-09-30T22:19:45.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.799+0000 7ff12dffb700 1 -- 172.21.15.156:0/2330817682 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13401a670 con 0x7ff138099af0 2023-09-30T22:19:45.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.800+0000 7ff13f89c700 1 -- 172.21.15.156:0/2330817682 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff13806f1c0 con 0x7ff138099af0 2023-09-30T22:19:45.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.801+0000 7ff12dffb700 1 -- 172.21.15.156:0/2330817682 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff13401a7d0 con 0x7ff138099af0 2023-09-30T22:19:45.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.801+0000 7ff12dffb700 1 -- 172.21.15.156:0/2330817682 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff134043400 con 0x7ff138099af0 2023-09-30T22:19:45.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.801+0000 7ff13f89c700 1 -- 172.21.15.156:0/2330817682 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff13804f2a0 con 0x7ff138099af0 2023-09-30T22:19:45.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.805+0000 7ff12dffb700 1 -- 172.21.15.156:0/2330817682 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff1340176b0 con 0x7ff138099af0 2023-09-30T22:19:45.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.882+0000 7f1b9a150700 1 -- 172.21.15.156:0/2292818909 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1b74005590 con 0x7f1b9409e070 2023-09-30T22:19:45.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.882+0000 7f1b7bfff700 1 -- 172.21.15.156:0/2292818909 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1b88017020 con 0x7f1b9409e070 2023-09-30T22:19:45.883 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:45.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.884+0000 7f1b9a150700 1 -- 172.21.15.156:0/2292818909 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b9409e070 msgr2=0x7f1b9406fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.884+0000 7f1b9a150700 1 --2- 172.21.15.156:0/2292818909 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b9409e070 0x7f1b9406fe90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1b8800c4a0 tx=0x7f1b8800c7b0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.884+0000 7f1b9a150700 1 -- 172.21.15.156:0/2292818909 shutdown_connections 2023-09-30T22:19:45.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.884+0000 7f1b9a150700 1 --2- 172.21.15.156:0/2292818909 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b94134f00 0x7f1b940703d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.884+0000 7f1b9a150700 1 --2- 172.21.15.156:0/2292818909 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b9406a770 0x7f1b9406f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.884+0000 7f1b9a150700 1 --2- 172.21.15.156:0/2292818909 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b9409e070 0x7f1b9406fe90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.884+0000 7f1b9a150700 1 -- 172.21.15.156:0/2292818909 >> 172.21.15.156:0/2292818909 conn(0x7f1b94099c40 msgr2=0x7f1b9409c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:45.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.884+0000 7f1b9a150700 1 -- 172.21.15.156:0/2292818909 shutdown_connections 2023-09-30T22:19:45.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.885+0000 7f1b9a150700 1 -- 172.21.15.156:0/2292818909 wait complete. 2023-09-30T22:19:45.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:45.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.922+0000 7fedf950d700 1 -- 172.21.15.156:0/2683508491 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fedf412f750 con 0x7fedf409d860 2023-09-30T22:19:45.923 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:45.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.922+0000 7fedeb7fe700 1 -- 172.21.15.156:0/2683508491 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fedf412f750 con 0x7fedf409d860 2023-09-30T22:19:45.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.924+0000 7fedf950d700 1 -- 172.21.15.156:0/2683508491 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fedf409d860 msgr2=0x7fedf41c8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.924+0000 7fedf950d700 1 --2- 172.21.15.156:0/2683508491 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fedf409d860 0x7fedf41c8060 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fede400c740 tx=0x7fede400ca50 comp rx=0 tx=0).stop 2023-09-30T22:19:45.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.924+0000 7fedf950d700 1 -- 172.21.15.156:0/2683508491 shutdown_connections 2023-09-30T22:19:45.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.924+0000 7fedf950d700 1 --2- 172.21.15.156:0/2683508491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedf4130ce0 0x7fedf41c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.924+0000 7fedf950d700 1 --2- 172.21.15.156:0/2683508491 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fedf409d860 0x7fedf41c8060 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.924+0000 7fedf950d700 1 --2- 172.21.15.156:0/2683508491 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fedf409e170 0x7fedf41c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:45.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.924+0000 7fedf950d700 1 -- 172.21.15.156:0/2683508491 >> 172.21.15.156:0/2683508491 conn(0x7fedf4099c40 msgr2=0x7fedf40a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:45.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.924+0000 7fedf950d700 1 -- 172.21.15.156:0/2683508491 shutdown_connections 2023-09-30T22:19:45.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:45.924+0000 7fedf950d700 1 -- 172.21.15.156:0/2683508491 wait complete. 2023-09-30T22:19:45.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:46.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:46.019+0000 7fbdb721b700 1 -- 172.21.15.156:0/3202431125 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbdb0136dd0 con 0x7fbdb00a08e0 2023-09-30T22:19:46.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:46.019+0000 7fbdad7fa700 1 -- 172.21.15.156:0/3202431125 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbda401c410 con 0x7fbdb00a08e0 2023-09-30T22:19:46.020 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:46.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:46.021+0000 7fbdb721b700 1 -- 172.21.15.156:0/3202431125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbdb00a08e0 msgr2=0x7fbdb0126340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:46.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:46.021+0000 7fbdb721b700 1 --2- 172.21.15.156:0/3202431125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbdb00a08e0 0x7fbdb0126340 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbda4013040 tx=0x7fbda4004750 comp rx=0 tx=0).stop 2023-09-30T22:19:46.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:46.021+0000 7fbdb721b700 1 -- 172.21.15.156:0/3202431125 shutdown_connections 2023-09-30T22:19:46.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:46.021+0000 7fbdb721b700 1 --2- 172.21.15.156:0/3202431125 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbdb0138040 0x7fbdb0126dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:46.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:46.021+0000 7fbdb721b700 1 --2- 172.21.15.156:0/3202431125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbdb00a08e0 0x7fbdb0126340 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:46.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:46.021+0000 7fbdb721b700 1 --2- 172.21.15.156:0/3202431125 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbdb00a1400 0x7fbdb0126880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:46.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:46.021+0000 7fbdb721b700 1 -- 172.21.15.156:0/3202431125 >> 172.21.15.156:0/3202431125 conn(0x7fbdb00a2980 msgr2=0x7fbdb009f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:46.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:46.021+0000 7fbdb721b700 1 -- 172.21.15.156:0/3202431125 shutdown_connections 2023-09-30T22:19:46.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:46.021+0000 7fbdb721b700 1 -- 172.21.15.156:0/3202431125 wait complete. 2023-09-30T22:19:46.034 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:46.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:46.057+0000 7ff13f89c700 1 -- 172.21.15.156:0/2330817682 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff13806fc90 con 0x7ff138099af0 2023-09-30T22:19:46.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:46.058+0000 7ff12dffb700 1 -- 172.21.15.156:0/2330817682 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff134021310 con 0x7ff138099af0 2023-09-30T22:19:46.059 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:46.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:46.060+0000 7ff13f89c700 1 -- 172.21.15.156:0/2330817682 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff138099af0 msgr2=0x7ff1380984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:46.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:46.060+0000 7ff13f89c700 1 --2- 172.21.15.156:0/2330817682 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff138099af0 0x7ff1380984a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff13400d6d0 tx=0x7ff13400d9e0 comp rx=0 tx=0).stop 2023-09-30T22:19:46.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:46.060+0000 7ff13f89c700 1 -- 172.21.15.156:0/2330817682 shutdown_connections 2023-09-30T22:19:46.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:46.060+0000 7ff13f89c700 1 --2- 172.21.15.156:0/2330817682 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1381307c0 0x7ff1381285e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:46.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:46.060+0000 7ff13f89c700 1 --2- 172.21.15.156:0/2330817682 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff138099af0 0x7ff1380984a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:46.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:46.060+0000 7ff13f89c700 1 --2- 172.21.15.156:0/2330817682 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff13812feb0 0x7ff1380989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:46.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:46.060+0000 7ff13f89c700 1 -- 172.21.15.156:0/2330817682 >> 172.21.15.156:0/2330817682 conn(0x7ff1380a2b30 msgr2=0x7ff1381b7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:46.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:46.060+0000 7ff13f89c700 1 -- 172.21.15.156:0/2330817682 shutdown_connections 2023-09-30T22:19:46.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:46.060+0000 7ff13f89c700 1 -- 172.21.15.156:0/2330817682 wait complete. 2023-09-30T22:19:46.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:46.901 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:46.939 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:47.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.034+0000 7f5afbf53700 1 Processor -- start 2023-09-30T22:19:47.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.034+0000 7f5afbf53700 1 -- start start 2023-09-30T22:19:47.035 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:47.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.034+0000 7f5afbf53700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5af40a0a70 0x7f5af40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:47.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.034+0000 7f5afbf53700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5af40a1380 0x7f5af4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:47.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.034+0000 7f5afbf53700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af409dc00 con 0x7f5af4133f50 2023-09-30T22:19:47.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.034+0000 7f5afbf53700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af409ea60 con 0x7f5af40a1380 2023-09-30T22:19:47.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.035+0000 7f5afbf53700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5af409dec0 con 0x7f5af40a0a70 2023-09-30T22:19:47.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.035+0000 7f5af9cef700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5af40a0a70 0x7f5af40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:47.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.035+0000 7f5af94ee700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5af40a1380 0x7f5af4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:47.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.035+0000 7f5af9cef700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5af40a0a70 0x7f5af40a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43932/0 (socket says 172.21.15.156:43932) 2023-09-30T22:19:47.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.035+0000 7f5af9cef700 1 -- 172.21.15.156:0/860032817 learned_addr learned my addr 172.21.15.156:0/860032817 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:47.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.035+0000 7f5af94ee700 1 -- 172.21.15.156:0/860032817 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5af40a0a70 msgr2=0x7f5af40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:47.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.035+0000 7f5af94ee700 1 --2- 172.21.15.156:0/860032817 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5af40a0a70 0x7f5af40a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.035+0000 7f5af94ee700 1 -- 172.21.15.156:0/860032817 >> v1:172.21.15.156:6789/0 conn(0x7f5af4133f50 legacy=0x7f5af413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.035+0000 7f5af94ee700 1 -- 172.21.15.156:0/860032817 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af409e6a0 con 0x7f5af40a1380 2023-09-30T22:19:47.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.035+0000 7f5af8ced700 1 -- 172.21.15.156:0/860032817 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2688431559 0 0) 0x7f5af409dc00 con 0x7f5af4133f50 2023-09-30T22:19:47.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.035+0000 7f5af9cef700 1 --2- 172.21.15.156:0/860032817 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5af40a0a70 0x7f5af40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:47.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.035+0000 7f5af94ee700 1 --2- 172.21.15.156:0/860032817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5af40a1380 0x7f5af4133a10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009840 tx=0x7f5ae4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a879868b62fd00d4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:47.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.035+0000 7f5af8ced700 1 -- 172.21.15.156:0/860032817 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4011830 con 0x7f5af40a1380 2023-09-30T22:19:47.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.035+0000 7f5af8ced700 1 -- 172.21.15.156:0/860032817 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae4011990 con 0x7f5af40a1380 2023-09-30T22:19:47.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.035+0000 7f5af8ced700 1 -- 172.21.15.156:0/860032817 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4011d20 con 0x7f5af40a1380 2023-09-30T22:19:47.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.036+0000 7f5afbf53700 1 -- 172.21.15.156:0/860032817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5af40a1380 msgr2=0x7f5af4133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.036+0000 7f5afbf53700 1 --2- 172.21.15.156:0/860032817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5af40a1380 0x7f5af4133a10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009840 tx=0x7f5ae4009b50 comp rx=0 tx=0).stop 2023-09-30T22:19:47.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.036+0000 7f5afbf53700 1 -- 172.21.15.156:0/860032817 shutdown_connections 2023-09-30T22:19:47.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.036+0000 7f5afbf53700 1 --2- 172.21.15.156:0/860032817 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5af40a0a70 0x7f5af40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.036+0000 7f5afbf53700 1 --2- 172.21.15.156:0/860032817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5af40a1380 0x7f5af4133a10 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.036+0000 7f5afbf53700 1 -- 172.21.15.156:0/860032817 >> 172.21.15.156:0/860032817 conn(0x7f5af40a6610 msgr2=0x7f5af40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:47.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.036+0000 7f5afbf53700 1 -- 172.21.15.156:0/860032817 shutdown_connections 2023-09-30T22:19:47.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.036+0000 7f5afbf53700 1 -- 172.21.15.156:0/860032817 wait complete. 2023-09-30T22:19:47.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.037+0000 7f5afbf53700 1 Processor -- start 2023-09-30T22:19:47.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.037+0000 7f5afbf53700 1 -- start start 2023-09-30T22:19:47.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.037+0000 7f5afbf53700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5af40a0a70 0x7f5af4122920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:47.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.037+0000 7f5afbf53700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5af40a1380 0x7f5af4122e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:47.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.037+0000 7f5afbf53700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5af4133f50 0x7f5af41233a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:47.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.037+0000 7f5afbf53700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af4133aa0 con 0x7f5af40a0a70 2023-09-30T22:19:47.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.037+0000 7f5afbf53700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af41333f0 con 0x7f5af40a1380 2023-09-30T22:19:47.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.037+0000 7f5afbf53700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5af41245f0 con 0x7f5af4133f50 2023-09-30T22:19:47.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.038+0000 7f5afa4f0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5af4133f50 0x7f5af41233a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:47.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.038+0000 7f5afa4f0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5af4133f50 0x7f5af41233a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43942/0 (socket says 172.21.15.156:43942) 2023-09-30T22:19:47.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.038+0000 7f5afa4f0700 1 -- 172.21.15.156:0/1496093345 learned_addr learned my addr 172.21.15.156:0/1496093345 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:47.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.038+0000 7f5af94ee700 1 --2- 172.21.15.156:0/1496093345 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5af40a1380 0x7f5af4122e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:47.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.038+0000 7f5af9cef700 1 --2- 172.21.15.156:0/1496093345 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5af40a0a70 0x7f5af4122920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:47.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.038+0000 7f5afa4f0700 1 -- 172.21.15.156:0/1496093345 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5af40a1380 msgr2=0x7f5af4122e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.038+0000 7f5afa4f0700 1 --2- 172.21.15.156:0/1496093345 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5af40a1380 0x7f5af4122e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.038+0000 7f5afa4f0700 1 -- 172.21.15.156:0/1496093345 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5af40a0a70 msgr2=0x7f5af4122920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.038+0000 7f5afa4f0700 1 --2- 172.21.15.156:0/1496093345 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5af40a0a70 0x7f5af4122920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.038+0000 7f5afa4f0700 1 -- 172.21.15.156:0/1496093345 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af0009550 con 0x7f5af4133f50 2023-09-30T22:19:47.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.038+0000 7f5afa4f0700 1 --2- 172.21.15.156:0/1496093345 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5af4133f50 0x7f5af41233a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5aec001560 tx=0x7f5aec00cb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:47.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.038+0000 7f5aea7fc700 1 -- 172.21.15.156:0/1496093345 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec003e30 con 0x7f5af4133f50 2023-09-30T22:19:47.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.038+0000 7f5aea7fc700 1 -- 172.21.15.156:0/1496093345 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec005070 con 0x7f5af4133f50 2023-09-30T22:19:47.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.038+0000 7f5afbf53700 1 -- 172.21.15.156:0/1496093345 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae40094a0 con 0x7f5af4133f50 2023-09-30T22:19:47.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.038+0000 7f5aea7fc700 1 -- 172.21.15.156:0/1496093345 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec005420 con 0x7f5af4133f50 2023-09-30T22:19:47.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.038+0000 7f5afbf53700 1 -- 172.21.15.156:0/1496093345 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af4126110 con 0x7f5af4133f50 2023-09-30T22:19:47.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.039+0000 7f5aea7fc700 1 -- 172.21.15.156:0/1496093345 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5aec005580 con 0x7f5af4133f50 2023-09-30T22:19:47.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.039+0000 7f5aea7fc700 1 -- 172.21.15.156:0/1496093345 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5aec03ed20 con 0x7f5af4133f50 2023-09-30T22:19:47.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.039+0000 7f5afbf53700 1 -- 172.21.15.156:0/1496093345 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af404f2a0 con 0x7f5af4133f50 2023-09-30T22:19:47.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.044+0000 7f5aea7fc700 1 -- 172.21.15.156:0/1496093345 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5aec017070 con 0x7f5af4133f50 2023-09-30T22:19:47.074 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:47.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.074+0000 7f88458ec700 1 Processor -- start 2023-09-30T22:19:47.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.074+0000 7f88458ec700 1 -- start start 2023-09-30T22:19:47.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.074+0000 7f88458ec700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f884009e340 0x7f88401359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:47.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.074+0000 7f88458ec700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8840135f20 0x7f8840138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:47.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.074+0000 7f88458ec700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f884009aaa0 con 0x7f884009d860 2023-09-30T22:19:47.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.074+0000 7f88458ec700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f884009e730 con 0x7f8840135f20 2023-09-30T22:19:47.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.074+0000 7f88458ec700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f884009f870 con 0x7f884009e340 2023-09-30T22:19:47.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.074+0000 7f883e7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f884009e340 0x7f88401359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:47.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.074+0000 7f883e7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f884009e340 0x7f88401359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43950/0 (socket says 172.21.15.156:43950) 2023-09-30T22:19:47.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.074+0000 7f883e7fc700 1 -- 172.21.15.156:0/1244589541 learned_addr learned my addr 172.21.15.156:0/1244589541 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:47.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.075+0000 7f883f7fe700 1 --2- 172.21.15.156:0/1244589541 >> v2:172.21.15.156:3300/0 conn(0x7f8840135f20 0x7f8840138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:47.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.075+0000 7f883dffb700 1 -- 172.21.15.156:0/1244589541 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 873425536 0 0) 0x7f884009aaa0 con 0x7f884009d860 2023-09-30T22:19:47.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.075+0000 7f883dffb700 1 -- 172.21.15.156:0/1244589541 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88280035b0 con 0x7f884009d860 2023-09-30T22:19:47.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.075+0000 7f883e7fc700 1 -- 172.21.15.156:0/1244589541 >> v2:172.21.15.156:3300/0 conn(0x7f8840135f20 msgr2=0x7f8840138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:47.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.075+0000 7f883e7fc700 1 --2- 172.21.15.156:0/1244589541 >> v2:172.21.15.156:3300/0 conn(0x7f8840135f20 0x7f8840138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.075+0000 7f883e7fc700 1 -- 172.21.15.156:0/1244589541 >> v1:172.21.15.156:6789/0 conn(0x7f884009d860 legacy=0x7f884009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.075+0000 7f883e7fc700 1 -- 172.21.15.156:0/1244589541 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884009b360 con 0x7f884009e340 2023-09-30T22:19:47.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.075+0000 7f883f7fe700 1 --2- 172.21.15.156:0/1244589541 >> v2:172.21.15.156:3300/0 conn(0x7f8840135f20 0x7f8840138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:47.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.075+0000 7f883e7fc700 1 --2- 172.21.15.156:0/1244589541 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f884009e340 0x7f88401359e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f883400bb90 tx=0x7f883400bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f7475aaafe2f389 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:47.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.075+0000 7f883dffb700 1 -- 172.21.15.156:0/1244589541 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883400dd30 con 0x7f884009e340 2023-09-30T22:19:47.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.075+0000 7f883dffb700 1 -- 172.21.15.156:0/1244589541 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883400de90 con 0x7f884009e340 2023-09-30T22:19:47.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.075+0000 7f883dffb700 1 -- 172.21.15.156:0/1244589541 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8834010670 con 0x7f884009e340 2023-09-30T22:19:47.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.076+0000 7f88458ec700 1 -- 172.21.15.156:0/1244589541 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f884009e340 msgr2=0x7f88401359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.076+0000 7f88458ec700 1 --2- 172.21.15.156:0/1244589541 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f884009e340 0x7f88401359e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f883400bb90 tx=0x7f883400bea0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.076+0000 7f88458ec700 1 -- 172.21.15.156:0/1244589541 shutdown_connections 2023-09-30T22:19:47.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.076+0000 7f88458ec700 1 --2- 172.21.15.156:0/1244589541 >> v2:172.21.15.156:3300/0 conn(0x7f8840135f20 0x7f8840138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.076+0000 7f88458ec700 1 --2- 172.21.15.156:0/1244589541 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f884009e340 0x7f88401359e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.076+0000 7f88458ec700 1 -- 172.21.15.156:0/1244589541 >> 172.21.15.156:0/1244589541 conn(0x7f8840099c40 msgr2=0x7f88400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:47.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.076+0000 7f88458ec700 1 -- 172.21.15.156:0/1244589541 shutdown_connections 2023-09-30T22:19:47.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.076+0000 7f88458ec700 1 -- 172.21.15.156:0/1244589541 wait complete. 2023-09-30T22:19:47.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.077+0000 7f88458ec700 1 Processor -- start 2023-09-30T22:19:47.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.077+0000 7f88458ec700 1 -- start start 2023-09-30T22:19:47.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.078+0000 7f88458ec700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f884009d860 0x7f88401c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:47.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.078+0000 7f88458ec700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f884009e340 0x7f88401c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:47.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.078+0000 7f88458ec700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8840135f20 0x7f88401206e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:47.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.078+0000 7f88458ec700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8840133070 con 0x7f884009d860 2023-09-30T22:19:47.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.078+0000 7f88458ec700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8840123cf0 con 0x7f884009e340 2023-09-30T22:19:47.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.078+0000 7f88458ec700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88401bb000 con 0x7f8840135f20 2023-09-30T22:19:47.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.078+0000 7f883effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f884009d860 0x7f88401c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:47.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.078+0000 7f883effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f884009d860 0x7f88401c8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51626/0 (socket says 172.21.15.156:51626) 2023-09-30T22:19:47.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.078+0000 7f883effd700 1 -- 172.21.15.156:0/3948441312 learned_addr learned my addr 172.21.15.156:0/3948441312 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:47.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.078+0000 7f883e7fc700 1 --2- 172.21.15.156:0/3948441312 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f884009e340 0x7f88401c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:47.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.078+0000 7f883f7fe700 1 --2- 172.21.15.156:0/3948441312 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8840135f20 0x7f88401206e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:47.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.079+0000 7f883e7fc700 1 -- 172.21.15.156:0/3948441312 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8840135f20 msgr2=0x7f88401206e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.079+0000 7f883e7fc700 1 --2- 172.21.15.156:0/3948441312 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8840135f20 0x7f88401206e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.079+0000 7f883e7fc700 1 -- 172.21.15.156:0/3948441312 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f884009d860 msgr2=0x7f88401c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.079+0000 7f883e7fc700 1 --2- 172.21.15.156:0/3948441312 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f884009d860 0x7f88401c8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.079+0000 7f883e7fc700 1 -- 172.21.15.156:0/3948441312 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8838009a70 con 0x7f884009e340 2023-09-30T22:19:47.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.079+0000 7f883e7fc700 1 --2- 172.21.15.156:0/3948441312 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f884009e340 0x7f88401c8ad0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8834018000 tx=0x7f8834004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:47.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.079+0000 7f8827fff700 1 -- 172.21.15.156:0/3948441312 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883401d070 con 0x7f884009e340 2023-09-30T22:19:47.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.079+0000 7f8827fff700 1 -- 172.21.15.156:0/3948441312 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8834010820 con 0x7f884009e340 2023-09-30T22:19:47.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.079+0000 7f8827fff700 1 -- 172.21.15.156:0/3948441312 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8834010bb0 con 0x7f884009e340 2023-09-30T22:19:47.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.079+0000 7f88458ec700 1 -- 172.21.15.156:0/3948441312 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f883400b7f0 con 0x7f884009e340 2023-09-30T22:19:47.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.079+0000 7f88458ec700 1 -- 172.21.15.156:0/3948441312 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88401222f0 con 0x7f884009e340 2023-09-30T22:19:47.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.080+0000 7f8827fff700 1 -- 172.21.15.156:0/3948441312 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f88340036a0 con 0x7f884009e340 2023-09-30T22:19:47.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.080+0000 7f88458ec700 1 -- 172.21.15.156:0/3948441312 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8840122900 con 0x7f884009e340 2023-09-30T22:19:47.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.080+0000 7f8827fff700 1 -- 172.21.15.156:0/3948441312 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f88340412f0 con 0x7f884009e340 2023-09-30T22:19:47.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.089+0000 7f8827fff700 1 -- 172.21.15.156:0/3948441312 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8840122900 con 0x7f884009e340 2023-09-30T22:19:47.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.166+0000 7fe4d6ecc700 1 Processor -- start 2023-09-30T22:19:47.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.167+0000 7fe4d6ecc700 1 -- start start 2023-09-30T22:19:47.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.167+0000 7fe4d6ecc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4d01350d0 0x7fe4d013ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:47.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.167+0000 7fe4d6ecc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe4d013d210 0x7fe4d013f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:47.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.167+0000 7fe4d6ecc700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d009eca0 con 0x7fe4d006a770 2023-09-30T22:19:47.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.167+0000 7fe4d6ecc700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4d009f720 con 0x7fe4d013d210 2023-09-30T22:19:47.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.167+0000 7fe4d6ecc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d006b480 con 0x7fe4d01350d0 2023-09-30T22:19:47.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.167+0000 7fe4cffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4d01350d0 0x7fe4d013ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:47.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.167+0000 7fe4cffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4d01350d0 0x7fe4d013ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43960/0 (socket says 172.21.15.156:43960) 2023-09-30T22:19:47.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.167+0000 7fe4cffff700 1 -- 172.21.15.156:0/4098236280 learned_addr learned my addr 172.21.15.156:0/4098236280 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:47.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.167+0000 7fe4d5469700 1 --2- 172.21.15.156:0/4098236280 >> v2:172.21.15.156:3300/0 conn(0x7fe4d013d210 0x7fe4d013f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:47.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.168+0000 7fe4cffff700 1 -- 172.21.15.156:0/4098236280 >> v2:172.21.15.156:3300/0 conn(0x7fe4d013d210 msgr2=0x7fe4d013f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:47.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.168+0000 7fe4cffff700 1 --2- 172.21.15.156:0/4098236280 >> v2:172.21.15.156:3300/0 conn(0x7fe4d013d210 0x7fe4d013f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.168+0000 7fe4cffff700 1 -- 172.21.15.156:0/4098236280 >> v1:172.21.15.156:6789/0 conn(0x7fe4d006a770 legacy=0x7fe4d01349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.168+0000 7fe4cffff700 1 -- 172.21.15.156:0/4098236280 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d009b010 con 0x7fe4d01350d0 2023-09-30T22:19:47.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.168+0000 7fe4cffff700 1 --2- 172.21.15.156:0/4098236280 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4d01350d0 0x7fe4d013ccd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0098f0 tx=0x7fe4bc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4dbe629ce5accd9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:47.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.168+0000 7fe4cf7fe700 1 -- 172.21.15.156:0/4098236280 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc011830 con 0x7fe4d01350d0 2023-09-30T22:19:47.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.168+0000 7fe4cf7fe700 1 -- 172.21.15.156:0/4098236280 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4bc011990 con 0x7fe4d01350d0 2023-09-30T22:19:47.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.168+0000 7fe4cf7fe700 1 -- 172.21.15.156:0/4098236280 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc011d20 con 0x7fe4d01350d0 2023-09-30T22:19:47.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.169+0000 7fe4d6ecc700 1 -- 172.21.15.156:0/4098236280 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4d01350d0 msgr2=0x7fe4d013ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.169+0000 7fe4d6ecc700 1 --2- 172.21.15.156:0/4098236280 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4d01350d0 0x7fe4d013ccd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0098f0 tx=0x7fe4bc009c00 comp rx=0 tx=0).stop 2023-09-30T22:19:47.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.169+0000 7fe4d6ecc700 1 -- 172.21.15.156:0/4098236280 shutdown_connections 2023-09-30T22:19:47.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.169+0000 7fe4d6ecc700 1 --2- 172.21.15.156:0/4098236280 >> v2:172.21.15.156:3300/0 conn(0x7fe4d013d210 0x7fe4d013f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.169+0000 7fe4d6ecc700 1 --2- 172.21.15.156:0/4098236280 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4d01350d0 0x7fe4d013ccd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.169+0000 7fe4d6ecc700 1 -- 172.21.15.156:0/4098236280 >> 172.21.15.156:0/4098236280 conn(0x7fe4d0099c40 msgr2=0x7fe4d00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:47.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.169+0000 7fe4d6ecc700 1 -- 172.21.15.156:0/4098236280 shutdown_connections 2023-09-30T22:19:47.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.169+0000 7fe4d6ecc700 1 -- 172.21.15.156:0/4098236280 wait complete. 2023-09-30T22:19:47.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.170+0000 7fe4d6ecc700 1 Processor -- start 2023-09-30T22:19:47.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.170+0000 7fe4d6ecc700 1 -- start start 2023-09-30T22:19:47.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.170+0000 7fe4d6ecc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4d006a770 0x7fe4d0139c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:47.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.170+0000 7fe4d6ecc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4d01350d0 0x7fe4d013a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:47.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.170+0000 7fe4d6ecc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4d013d210 0x7fe4d013a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:47.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.170+0000 7fe4d6ecc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d013b090 con 0x7fe4d01350d0 2023-09-30T22:19:47.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.170+0000 7fe4d6ecc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d006f270 con 0x7fe4d006a770 2023-09-30T22:19:47.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.170+0000 7fe4d6ecc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d006f9c0 con 0x7fe4d013d210 2023-09-30T22:19:47.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.170+0000 7fe4d5469700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4d013d210 0x7fe4d013a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:47.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.170+0000 7fe4d4c68700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4d006a770 0x7fe4d0139c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:47.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.170+0000 7fe4d5469700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4d013d210 0x7fe4d013a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43972/0 (socket says 172.21.15.156:43972) 2023-09-30T22:19:47.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.170+0000 7fe4d5469700 1 -- 172.21.15.156:0/1642220196 learned_addr learned my addr 172.21.15.156:0/1642220196 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:47.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.171+0000 7fe4cffff700 1 --2- 172.21.15.156:0/1642220196 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4d01350d0 0x7fe4d013a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:47.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.171+0000 7fe4d5469700 1 -- 172.21.15.156:0/1642220196 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4d006a770 msgr2=0x7fe4d0139c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.171+0000 7fe4d5469700 1 --2- 172.21.15.156:0/1642220196 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4d006a770 0x7fe4d0139c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.171+0000 7fe4d5469700 1 -- 172.21.15.156:0/1642220196 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4d01350d0 msgr2=0x7fe4d013a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.171+0000 7fe4d5469700 1 --2- 172.21.15.156:0/1642220196 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4d01350d0 0x7fe4d013a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.171+0000 7fe4d5469700 1 -- 172.21.15.156:0/1642220196 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4bc009550 con 0x7fe4d013d210 2023-09-30T22:19:47.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.171+0000 7fe4cffff700 1 --2- 172.21.15.156:0/1642220196 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4d01350d0 0x7fe4d013a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:19:47.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.171+0000 7fe4d4c68700 1 --2- 172.21.15.156:0/1642220196 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4d006a770 0x7fe4d0139c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:47.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.171+0000 7fe4d5469700 1 --2- 172.21.15.156:0/1642220196 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4d013d210 0x7fe4d013a6b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8009dd0 tx=0x7fe4c800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:47.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.171+0000 7fe4cd7fa700 1 -- 172.21.15.156:0/1642220196 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8009c40 con 0x7fe4d013d210 2023-09-30T22:19:47.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.171+0000 7fe4cd7fa700 1 -- 172.21.15.156:0/1642220196 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c800f040 con 0x7fe4d013d210 2023-09-30T22:19:47.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.171+0000 7fe4d6ecc700 1 -- 172.21.15.156:0/1642220196 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d006f4c0 con 0x7fe4d013d210 2023-09-30T22:19:47.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.171+0000 7fe4cd7fa700 1 -- 172.21.15.156:0/1642220196 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8014480 con 0x7fe4d013d210 2023-09-30T22:19:47.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.171+0000 7fe4d6ecc700 1 -- 172.21.15.156:0/1642220196 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d013bd10 con 0x7fe4d013d210 2023-09-30T22:19:47.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.172+0000 7fe4cd7fa700 1 -- 172.21.15.156:0/1642220196 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe4c80145e0 con 0x7fe4d013d210 2023-09-30T22:19:47.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.172+0000 7fe4d6ecc700 1 -- 172.21.15.156:0/1642220196 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d013f600 con 0x7fe4d013d210 2023-09-30T22:19:47.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.172+0000 7fe4cd7fa700 1 -- 172.21.15.156:0/1642220196 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe4c803ff20 con 0x7fe4d013d210 2023-09-30T22:19:47.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.177+0000 7fe4cd7fa700 1 -- 172.21.15.156:0/1642220196 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4c8011680 con 0x7fe4d013d210 2023-09-30T22:19:47.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.215+0000 7f2866a38700 1 Processor -- start 2023-09-30T22:19:47.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.215+0000 7f2866a38700 1 -- start start 2023-09-30T22:19:47.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.216+0000 7f2866a38700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2860066410 0x7f28601319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:47.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.216+0000 7f2866a38700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f28601314b0 0x7f2860131f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:47.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.216+0000 7f2866a38700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28600a0f20 con 0x7f286009bc70 2023-09-30T22:19:47.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.216+0000 7f2866a38700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28600667e0 con 0x7f2860066410 2023-09-30T22:19:47.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.216+0000 7f2866a38700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28600a23c0 con 0x7f28601314b0 2023-09-30T22:19:47.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.216+0000 7f285f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f28601314b0 0x7f2860131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:47.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.216+0000 7f285f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f28601314b0 0x7f2860131f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53904/0 (socket says 172.21.15.156:53904) 2023-09-30T22:19:47.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.216+0000 7f285f7fe700 1 -- 172.21.15.156:0/3947545151 learned_addr learned my addr 172.21.15.156:0/3947545151 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:47.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.216+0000 7f285ffff700 1 --2- 172.21.15.156:0/3947545151 >> v2:172.21.15.156:3300/0 conn(0x7f2860066410 0x7f28601319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:47.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.217+0000 7f285effd700 1 -- 172.21.15.156:0/3947545151 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161575199 0 0) 0x7f28600a0f20 con 0x7f286009bc70 2023-09-30T22:19:47.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.217+0000 7f285effd700 1 -- 172.21.15.156:0/3947545151 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28480035b0 con 0x7f286009bc70 2023-09-30T22:19:47.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.217+0000 7f285ffff700 1 -- 172.21.15.156:0/3947545151 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f28601314b0 msgr2=0x7f2860131f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:47.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.217+0000 7f285ffff700 1 --2- 172.21.15.156:0/3947545151 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f28601314b0 0x7f2860131f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.217+0000 7f285ffff700 1 -- 172.21.15.156:0/3947545151 >> v1:172.21.15.156:6789/0 conn(0x7f286009bc70 legacy=0x7f286009c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.217+0000 7f285ffff700 1 -- 172.21.15.156:0/3947545151 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28600a16e0 con 0x7f2860066410 2023-09-30T22:19:47.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.217+0000 7f285ffff700 1 --2- 172.21.15.156:0/3947545151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2860066410 0x7f28601319f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2850009850 tx=0x7f2850009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85541903931e59d1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:47.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.217+0000 7f285effd700 1 -- 172.21.15.156:0/3947545151 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2850005e30 con 0x7f2860066410 2023-09-30T22:19:47.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.217+0000 7f285effd700 1 -- 172.21.15.156:0/3947545151 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2850006030 con 0x7f2860066410 2023-09-30T22:19:47.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.217+0000 7f285effd700 1 -- 172.21.15.156:0/3947545151 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28500063c0 con 0x7f2860066410 2023-09-30T22:19:47.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.218+0000 7f2866a38700 1 -- 172.21.15.156:0/3947545151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2860066410 msgr2=0x7f28601319f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.218+0000 7f2866a38700 1 --2- 172.21.15.156:0/3947545151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2860066410 0x7f28601319f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2850009850 tx=0x7f2850009b60 comp rx=0 tx=0).stop 2023-09-30T22:19:47.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.218+0000 7f2866a38700 1 -- 172.21.15.156:0/3947545151 shutdown_connections 2023-09-30T22:19:47.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.218+0000 7f2866a38700 1 --2- 172.21.15.156:0/3947545151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2860066410 0x7f28601319f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.218+0000 7f2866a38700 1 --2- 172.21.15.156:0/3947545151 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f28601314b0 0x7f2860131f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.218+0000 7f2866a38700 1 -- 172.21.15.156:0/3947545151 >> 172.21.15.156:0/3947545151 conn(0x7f28600a2980 msgr2=0x7f28600a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:47.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.218+0000 7f2866a38700 1 -- 172.21.15.156:0/3947545151 shutdown_connections 2023-09-30T22:19:47.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.218+0000 7f2866a38700 1 -- 172.21.15.156:0/3947545151 wait complete. 2023-09-30T22:19:47.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.219+0000 7f2866a38700 1 Processor -- start 2023-09-30T22:19:47.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.220+0000 7f2866a38700 1 -- start start 2023-09-30T22:19:47.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.220+0000 7f2866a38700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2860066410 0x7f28601362a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:47.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.220+0000 7f2866a38700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f286009bc70 0x7f28601367e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:47.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.220+0000 7f2866a38700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f28601314b0 0x7f2860136d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:47.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.220+0000 7f2866a38700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2860137760 con 0x7f2860066410 2023-09-30T22:19:47.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.220+0000 7f2866a38700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28601306e0 con 0x7f286009bc70 2023-09-30T22:19:47.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.220+0000 7f2866a38700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28600a1d50 con 0x7f28601314b0 2023-09-30T22:19:47.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.220+0000 7f285f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f286009bc70 0x7f28601367e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:47.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.220+0000 7f285f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f286009bc70 0x7f28601367e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53912/0 (socket says 172.21.15.156:53912) 2023-09-30T22:19:47.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.220+0000 7f285f7fe700 1 -- 172.21.15.156:0/835666530 learned_addr learned my addr 172.21.15.156:0/835666530 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:47.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.220+0000 7f285ffff700 1 --2- 172.21.15.156:0/835666530 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2860066410 0x7f28601362a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:47.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.220+0000 7f2864fd5700 1 --2- 172.21.15.156:0/835666530 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f28601314b0 0x7f2860136d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:47.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.221+0000 7f285ffff700 1 -- 172.21.15.156:0/835666530 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f28601314b0 msgr2=0x7f2860136d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.221+0000 7f285ffff700 1 --2- 172.21.15.156:0/835666530 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f28601314b0 0x7f2860136d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.221+0000 7f285ffff700 1 -- 172.21.15.156:0/835666530 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f286009bc70 msgr2=0x7f28601367e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.221+0000 7f285ffff700 1 --2- 172.21.15.156:0/835666530 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f286009bc70 0x7f28601367e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.221+0000 7f285ffff700 1 -- 172.21.15.156:0/835666530 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2850009430 con 0x7f2860066410 2023-09-30T22:19:47.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.221+0000 7f285f7fe700 1 --2- 172.21.15.156:0/835666530 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f286009bc70 0x7f28601367e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:47.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.221+0000 7f285ffff700 1 --2- 172.21.15.156:0/835666530 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2860066410 0x7f28601362a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2850009850 tx=0x7f2850004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:47.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.221+0000 7f285cff9700 1 -- 172.21.15.156:0/835666530 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28500067f0 con 0x7f2860066410 2023-09-30T22:19:47.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.221+0000 7f285cff9700 1 -- 172.21.15.156:0/835666530 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2850020070 con 0x7f2860066410 2023-09-30T22:19:47.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.221+0000 7f2866a38700 1 -- 172.21.15.156:0/835666530 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f286012dc50 con 0x7f2860066410 2023-09-30T22:19:47.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.221+0000 7f285cff9700 1 -- 172.21.15.156:0/835666530 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2850006990 con 0x7f2860066410 2023-09-30T22:19:47.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.221+0000 7f2866a38700 1 -- 172.21.15.156:0/835666530 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2860119930 con 0x7f2860066410 2023-09-30T22:19:47.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.222+0000 7f285cff9700 1 -- 172.21.15.156:0/835666530 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2850022030 con 0x7f2860066410 2023-09-30T22:19:47.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.223+0000 7f285cff9700 1 -- 172.21.15.156:0/835666530 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2850044420 con 0x7f2860066410 2023-09-30T22:19:47.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.223+0000 7f2866a38700 1 -- 172.21.15.156:0/835666530 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2860119260 con 0x7f2860066410 2023-09-30T22:19:47.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.227+0000 7f285cff9700 1 -- 172.21.15.156:0/835666530 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f28500197c0 con 0x7f2860066410 2023-09-30T22:19:47.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.252+0000 7f5afbf53700 1 -- 172.21.15.156:0/1496093345 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5af4133820 con 0x7f5af4133f50 2023-09-30T22:19:47.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.253+0000 7f5aea7fc700 1 -- 172.21.15.156:0/1496093345 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5aec00ab40 con 0x7f5af4133f50 2023-09-30T22:19:47.254 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:47.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.255+0000 7f5afbf53700 1 -- 172.21.15.156:0/1496093345 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5af4133f50 msgr2=0x7f5af41233a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.255+0000 7f5afbf53700 1 --2- 172.21.15.156:0/1496093345 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5af4133f50 0x7f5af41233a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5aec001560 tx=0x7f5aec00cb50 comp rx=0 tx=0).stop 2023-09-30T22:19:47.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.255+0000 7f5afbf53700 1 -- 172.21.15.156:0/1496093345 shutdown_connections 2023-09-30T22:19:47.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.255+0000 7f5afbf53700 1 --2- 172.21.15.156:0/1496093345 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5af4133f50 0x7f5af41233a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.255+0000 7f5afbf53700 1 --2- 172.21.15.156:0/1496093345 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5af40a0a70 0x7f5af4122920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.255+0000 7f5afbf53700 1 --2- 172.21.15.156:0/1496093345 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5af40a1380 0x7f5af4122e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.255+0000 7f5afbf53700 1 -- 172.21.15.156:0/1496093345 >> 172.21.15.156:0/1496093345 conn(0x7f5af40a6610 msgr2=0x7f5af409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:47.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.258+0000 7f5afbf53700 1 -- 172.21.15.156:0/1496093345 shutdown_connections 2023-09-30T22:19:47.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.258+0000 7f5afbf53700 1 -- 172.21.15.156:0/1496093345 wait complete. 2023-09-30T22:19:47.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:47.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.291+0000 7f88458ec700 1 -- 172.21.15.156:0/3948441312 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8840122900 con 0x7f884009e340 2023-09-30T22:19:47.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.291+0000 7f8827fff700 1 -- 172.21.15.156:0/3948441312 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8840122900 con 0x7f884009e340 2023-09-30T22:19:47.292 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:47.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.293+0000 7f88458ec700 1 -- 172.21.15.156:0/3948441312 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f884009e340 msgr2=0x7f88401c8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.293+0000 7f88458ec700 1 --2- 172.21.15.156:0/3948441312 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f884009e340 0x7f88401c8ad0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8834018000 tx=0x7f8834004750 comp rx=0 tx=0).stop 2023-09-30T22:19:47.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.294+0000 7f88458ec700 1 -- 172.21.15.156:0/3948441312 shutdown_connections 2023-09-30T22:19:47.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.294+0000 7f88458ec700 1 --2- 172.21.15.156:0/3948441312 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8840135f20 0x7f88401206e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.294+0000 7f88458ec700 1 --2- 172.21.15.156:0/3948441312 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f884009d860 0x7f88401c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.294+0000 7f88458ec700 1 --2- 172.21.15.156:0/3948441312 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f884009e340 0x7f88401c8ad0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.294+0000 7f88458ec700 1 -- 172.21.15.156:0/3948441312 >> 172.21.15.156:0/3948441312 conn(0x7f8840099c40 msgr2=0x7f88400a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:47.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.294+0000 7f88458ec700 1 -- 172.21.15.156:0/3948441312 shutdown_connections 2023-09-30T22:19:47.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.294+0000 7f88458ec700 1 -- 172.21.15.156:0/3948441312 wait complete. 2023-09-30T22:19:47.307 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:47.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.382+0000 7fe4d6ecc700 1 -- 172.21.15.156:0/1642220196 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe4d006f0d0 con 0x7fe4d013d210 2023-09-30T22:19:47.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.382+0000 7fe4cd7fa700 1 -- 172.21.15.156:0/1642220196 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe4d006f0d0 con 0x7fe4d013d210 2023-09-30T22:19:47.383 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:47.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.385+0000 7fe4d6ecc700 1 -- 172.21.15.156:0/1642220196 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4d013d210 msgr2=0x7fe4d013a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.385+0000 7fe4d6ecc700 1 --2- 172.21.15.156:0/1642220196 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4d013d210 0x7fe4d013a6b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8009dd0 tx=0x7fe4c800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.385+0000 7fe4d6ecc700 1 -- 172.21.15.156:0/1642220196 shutdown_connections 2023-09-30T22:19:47.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.385+0000 7fe4d6ecc700 1 --2- 172.21.15.156:0/1642220196 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4d013d210 0x7fe4d013a6b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.385+0000 7fe4d6ecc700 1 --2- 172.21.15.156:0/1642220196 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4d006a770 0x7fe4d0139c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.385+0000 7fe4d6ecc700 1 --2- 172.21.15.156:0/1642220196 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4d01350d0 0x7fe4d013a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.385+0000 7fe4d6ecc700 1 -- 172.21.15.156:0/1642220196 >> 172.21.15.156:0/1642220196 conn(0x7fe4d0099c40 msgr2=0x7fe4d009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:47.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.385+0000 7fe4d6ecc700 1 -- 172.21.15.156:0/1642220196 shutdown_connections 2023-09-30T22:19:47.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.385+0000 7fe4d6ecc700 1 -- 172.21.15.156:0/1642220196 wait complete. 2023-09-30T22:19:47.398 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:47.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.423+0000 7f2866a38700 1 -- 172.21.15.156:0/835666530 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f286004f2a0 con 0x7f2860066410 2023-09-30T22:19:47.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.423+0000 7f285cff9700 1 -- 172.21.15.156:0/835666530 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f285001b410 con 0x7f2860066410 2023-09-30T22:19:47.424 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:47.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.425+0000 7f2866a38700 1 -- 172.21.15.156:0/835666530 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2860066410 msgr2=0x7f28601362a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.425+0000 7f2866a38700 1 --2- 172.21.15.156:0/835666530 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2860066410 0x7f28601362a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2850009850 tx=0x7f2850004750 comp rx=0 tx=0).stop 2023-09-30T22:19:47.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.425+0000 7f2866a38700 1 -- 172.21.15.156:0/835666530 shutdown_connections 2023-09-30T22:19:47.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.425+0000 7f2866a38700 1 --2- 172.21.15.156:0/835666530 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f28601314b0 0x7f2860136d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.425+0000 7f2866a38700 1 --2- 172.21.15.156:0/835666530 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2860066410 0x7f28601362a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.425+0000 7f2866a38700 1 --2- 172.21.15.156:0/835666530 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f286009bc70 0x7f28601367e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:47.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.425+0000 7f2866a38700 1 -- 172.21.15.156:0/835666530 >> 172.21.15.156:0/835666530 conn(0x7f28600a2980 msgr2=0x7f286009dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:47.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.426+0000 7f2866a38700 1 -- 172.21.15.156:0/835666530 shutdown_connections 2023-09-30T22:19:47.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:47.426+0000 7f2866a38700 1 -- 172.21.15.156:0/835666530 wait complete. 2023-09-30T22:19:47.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:48.272 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:48.308 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:48.399 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:48.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.403+0000 7fdf2e08a700 1 Processor -- start 2023-09-30T22:19:48.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.403+0000 7fdf2e08a700 1 -- start start 2023-09-30T22:19:48.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.404+0000 7fdf2e08a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdf2806a770 0x7fdf2806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:48.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.404+0000 7fdf2e08a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdf28136cb0 0x7fdf28139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:48.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.404+0000 7fdf2e08a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf2806e900 con 0x7fdf2809dec0 2023-09-30T22:19:48.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.404+0000 7fdf2e08a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf2809d180 con 0x7fdf28136cb0 2023-09-30T22:19:48.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.404+0000 7fdf2e08a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2809e780 con 0x7fdf2806a770 2023-09-30T22:19:48.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.404+0000 7fdf26ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fdf2809dec0 0x7fdf2806b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:36212/0 (socket says 172.21.15.156:36212) 2023-09-30T22:19:48.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.404+0000 7fdf26ffd700 1 -- 172.21.15.156:0/2826649558 learned_addr learned my addr 172.21.15.156:0/2826649558 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:48.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.404+0000 7fdf27fff700 1 --2- 172.21.15.156:0/2826649558 >> v2:172.21.15.156:3300/0 conn(0x7fdf28136cb0 0x7fdf28139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:48.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.404+0000 7fdf267fc700 1 -- 172.21.15.156:0/2826649558 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3200004762 0 0) 0x7fdf2806e900 con 0x7fdf2809dec0 2023-09-30T22:19:48.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.404+0000 7fdf267fc700 1 -- 172.21.15.156:0/2826649558 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf100035b0 con 0x7fdf2809dec0 2023-09-30T22:19:48.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.404+0000 7fdf27fff700 1 -- 172.21.15.156:0/2826649558 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdf2806a770 msgr2=0x7fdf2806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:48.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.404+0000 7fdf27fff700 1 --2- 172.21.15.156:0/2826649558 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdf2806a770 0x7fdf2806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.404+0000 7fdf27fff700 1 -- 172.21.15.156:0/2826649558 >> v1:172.21.15.156:6789/0 conn(0x7fdf2809dec0 legacy=0x7fdf2806b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.404+0000 7fdf27fff700 1 -- 172.21.15.156:0/2826649558 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2809d3c0 con 0x7fdf28136cb0 2023-09-30T22:19:48.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.405+0000 7fdf27fff700 1 --2- 172.21.15.156:0/2826649558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf28136cb0 0x7fdf28139090 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdf20009d90 tx=0x7fdf2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c1c7923f26bf7d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:48.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.405+0000 7fdf267fc700 1 -- 172.21.15.156:0/2826649558 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2000e070 con 0x7fdf28136cb0 2023-09-30T22:19:48.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.405+0000 7fdf267fc700 1 -- 172.21.15.156:0/2826649558 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2000bb20 con 0x7fdf28136cb0 2023-09-30T22:19:48.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.405+0000 7fdf267fc700 1 -- 172.21.15.156:0/2826649558 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf20012430 con 0x7fdf28136cb0 2023-09-30T22:19:48.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.405+0000 7fdf2e08a700 1 -- 172.21.15.156:0/2826649558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf28136cb0 msgr2=0x7fdf28139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.405+0000 7fdf2e08a700 1 --2- 172.21.15.156:0/2826649558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf28136cb0 0x7fdf28139090 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdf20009d90 tx=0x7fdf2000b330 comp rx=0 tx=0).stop 2023-09-30T22:19:48.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.405+0000 7fdf2e08a700 1 -- 172.21.15.156:0/2826649558 shutdown_connections 2023-09-30T22:19:48.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.405+0000 7fdf2e08a700 1 --2- 172.21.15.156:0/2826649558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf28136cb0 0x7fdf28139090 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.405+0000 7fdf2e08a700 1 --2- 172.21.15.156:0/2826649558 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdf2806a770 0x7fdf2806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.406+0000 7fdf2e08a700 1 -- 172.21.15.156:0/2826649558 >> 172.21.15.156:0/2826649558 conn(0x7fdf28099c40 msgr2=0x7fdf280a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:48.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.406+0000 7fdf2e08a700 1 -- 172.21.15.156:0/2826649558 shutdown_connections 2023-09-30T22:19:48.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.406+0000 7fdf2e08a700 1 -- 172.21.15.156:0/2826649558 wait complete. 2023-09-30T22:19:48.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.406+0000 7fdf2e08a700 1 Processor -- start 2023-09-30T22:19:48.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.407+0000 7fdf2e08a700 1 -- start start 2023-09-30T22:19:48.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.407+0000 7fdf2e08a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdf2806a770 0x7fdf2809a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:48.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.407+0000 7fdf2e08a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf2809dec0 0x7fdf2809a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:48.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.407+0000 7fdf2e08a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdf28136cb0 0x7fdf2809aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:48.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.407+0000 7fdf2e08a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf28135650 con 0x7fdf2809dec0 2023-09-30T22:19:48.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.407+0000 7fdf2e08a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf281344c0 con 0x7fdf28136cb0 2023-09-30T22:19:48.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.407+0000 7fdf2e08a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf28135b00 con 0x7fdf2806a770 2023-09-30T22:19:48.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.407+0000 7fdf277fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdf2806a770 0x7fdf2809a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:48.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.407+0000 7fdf26ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf2809dec0 0x7fdf2809a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:48.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.407+0000 7fdf277fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdf2806a770 0x7fdf2809a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43978/0 (socket says 172.21.15.156:43978) 2023-09-30T22:19:48.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.407+0000 7fdf26ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf2809dec0 0x7fdf2809a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51688/0 (socket says 172.21.15.156:51688) 2023-09-30T22:19:48.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.407+0000 7fdf277fe700 1 -- 172.21.15.156:0/1060486747 learned_addr learned my addr 172.21.15.156:0/1060486747 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:48.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.407+0000 7fdf27fff700 1 --2- 172.21.15.156:0/1060486747 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdf28136cb0 0x7fdf2809aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:48.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.408+0000 7fdf26ffd700 1 -- 172.21.15.156:0/1060486747 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdf2806a770 msgr2=0x7fdf2809a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.408+0000 7fdf26ffd700 1 --2- 172.21.15.156:0/1060486747 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdf2806a770 0x7fdf2809a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.408+0000 7fdf26ffd700 1 -- 172.21.15.156:0/1060486747 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdf28136cb0 msgr2=0x7fdf2809aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.408+0000 7fdf26ffd700 1 --2- 172.21.15.156:0/1060486747 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdf28136cb0 0x7fdf2809aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.408+0000 7fdf26ffd700 1 -- 172.21.15.156:0/1060486747 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf20009a70 con 0x7fdf2809dec0 2023-09-30T22:19:48.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.408+0000 7fdf26ffd700 1 --2- 172.21.15.156:0/1060486747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf2809dec0 0x7fdf2809a9a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00c490 tx=0x7fdf1c00c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:48.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.408+0000 7fdf0ffff700 1 -- 172.21.15.156:0/1060486747 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c005d70 con 0x7fdf2809dec0 2023-09-30T22:19:48.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.408+0000 7fdf0ffff700 1 -- 172.21.15.156:0/1060486747 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1c0070d0 con 0x7fdf2809dec0 2023-09-30T22:19:48.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.408+0000 7fdf0ffff700 1 -- 172.21.15.156:0/1060486747 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c007440 con 0x7fdf2809dec0 2023-09-30T22:19:48.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.408+0000 7fdf2e08a700 1 -- 172.21.15.156:0/1060486747 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf28071d40 con 0x7fdf2809dec0 2023-09-30T22:19:48.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.408+0000 7fdf2e08a700 1 -- 172.21.15.156:0/1060486747 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf28136570 con 0x7fdf2809dec0 2023-09-30T22:19:48.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.409+0000 7fdf0ffff700 1 -- 172.21.15.156:0/1060486747 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdf1c0075a0 con 0x7fdf2809dec0 2023-09-30T22:19:48.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.409+0000 7fdf2e08a700 1 -- 172.21.15.156:0/1060486747 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf2804f2a0 con 0x7fdf2809dec0 2023-09-30T22:19:48.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.409+0000 7fdf0ffff700 1 -- 172.21.15.156:0/1060486747 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdf1c03ea20 con 0x7fdf2809dec0 2023-09-30T22:19:48.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.415+0000 7fdf0ffff700 1 -- 172.21.15.156:0/1060486747 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdf1c017020 con 0x7fdf2809dec0 2023-09-30T22:19:48.439 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:48.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.445+0000 7f66285b2700 1 Processor -- start 2023-09-30T22:19:48.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.445+0000 7f66285b2700 1 -- start start 2023-09-30T22:19:48.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.445+0000 7f66285b2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6620138040 0x7f6620138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:48.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.445+0000 7f66285b2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f66200a08e0 0x7f66200a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:48.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.445+0000 7f66285b2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f66200a1230 0x7f662013ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:48.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.445+0000 7f66285b2700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66200a2100 con 0x7f66200a1230 2023-09-30T22:19:48.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.445+0000 7f66285b2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6620138950 con 0x7f6620138040 2023-09-30T22:19:48.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.445+0000 7f66285b2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66201379e0 con 0x7f66200a08e0 2023-09-30T22:19:48.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.446+0000 7f662634e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6620138040 0x7f6620138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:48.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.446+0000 7f662634e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6620138040 0x7f6620138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53946/0 (socket says 172.21.15.156:53946) 2023-09-30T22:19:48.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.446+0000 7f662634e700 1 -- 172.21.15.156:0/3334882184 learned_addr learned my addr 172.21.15.156:0/3334882184 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:48.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.446+0000 7f6626b4f700 1 --2- 172.21.15.156:0/3334882184 >> v2:172.21.15.156:3300/0 conn(0x7f66200a1230 0x7f662013ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:48.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.446+0000 7f6625b4d700 1 --2- 172.21.15.156:0/3334882184 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f66200a08e0 0x7f66200a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:48.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.446+0000 7f662634e700 1 -- 172.21.15.156:0/3334882184 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f66200a08e0 msgr2=0x7f66200a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:48.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.446+0000 7f662634e700 1 --2- 172.21.15.156:0/3334882184 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f66200a08e0 0x7f66200a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.446+0000 7f662634e700 1 -- 172.21.15.156:0/3334882184 >> v2:172.21.15.156:3300/0 conn(0x7f66200a1230 msgr2=0x7f662013ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:48.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.446+0000 7f662634e700 1 --2- 172.21.15.156:0/3334882184 >> v2:172.21.15.156:3300/0 conn(0x7f66200a1230 0x7f662013ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.446+0000 7f662634e700 1 -- 172.21.15.156:0/3334882184 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662009b9b0 con 0x7f6620138040 2023-09-30T22:19:48.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.446+0000 7f6626b4f700 1 --2- 172.21.15.156:0/3334882184 >> v2:172.21.15.156:3300/0 conn(0x7f66200a1230 0x7f662013ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:48.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.446+0000 7f662634e700 1 --2- 172.21.15.156:0/3334882184 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6620138040 0x7f6620138410 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f661c009920 tx=0x7f661c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73a8a3883a6fddd7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:48.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.446+0000 7f662534c700 1 -- 172.21.15.156:0/3334882184 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c005e30 con 0x7f6620138040 2023-09-30T22:19:48.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.446+0000 7f662534c700 1 -- 172.21.15.156:0/3334882184 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661c004030 con 0x7f6620138040 2023-09-30T22:19:48.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.446+0000 7f662534c700 1 -- 172.21.15.156:0/3334882184 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c0043e0 con 0x7f6620138040 2023-09-30T22:19:48.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.447+0000 7f66285b2700 1 -- 172.21.15.156:0/3334882184 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6620138040 msgr2=0x7f6620138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.447+0000 7f66285b2700 1 --2- 172.21.15.156:0/3334882184 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6620138040 0x7f6620138410 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f661c009920 tx=0x7f661c009c30 comp rx=0 tx=0).stop 2023-09-30T22:19:48.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.447+0000 7f66285b2700 1 -- 172.21.15.156:0/3334882184 shutdown_connections 2023-09-30T22:19:48.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.447+0000 7f66285b2700 1 --2- 172.21.15.156:0/3334882184 >> v2:172.21.15.156:3300/0 conn(0x7f66200a1230 0x7f662013ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.447+0000 7f66285b2700 1 --2- 172.21.15.156:0/3334882184 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6620138040 0x7f6620138410 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.447+0000 7f66285b2700 1 --2- 172.21.15.156:0/3334882184 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f66200a08e0 0x7f66200a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.447+0000 7f66285b2700 1 -- 172.21.15.156:0/3334882184 >> 172.21.15.156:0/3334882184 conn(0x7f66200a2980 msgr2=0x7f66200a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:48.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.447+0000 7f66285b2700 1 -- 172.21.15.156:0/3334882184 shutdown_connections 2023-09-30T22:19:48.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.447+0000 7f66285b2700 1 -- 172.21.15.156:0/3334882184 wait complete. 2023-09-30T22:19:48.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.448+0000 7f66285b2700 1 Processor -- start 2023-09-30T22:19:48.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.448+0000 7f66285b2700 1 -- start start 2023-09-30T22:19:48.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.449+0000 7f66285b2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66200a08e0 0x7f66201345c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:48.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.449+0000 7f66285b2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66200a1230 0x7f6620134b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:48.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.449+0000 7f66285b2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6620138040 0x7f66201d4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:48.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.449+0000 7f66285b2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66201343d0 con 0x7f66200a08e0 2023-09-30T22:19:48.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.449+0000 7f66285b2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662011b450 con 0x7f66200a1230 2023-09-30T22:19:48.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.449+0000 7f66285b2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f662011a690 con 0x7f6620138040 2023-09-30T22:19:48.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.449+0000 7f6625b4d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66200a1230 0x7f6620134b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:48.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.449+0000 7f6625b4d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66200a1230 0x7f6620134b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53962/0 (socket says 172.21.15.156:53962) 2023-09-30T22:19:48.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.449+0000 7f6625b4d700 1 -- 172.21.15.156:0/3414851523 learned_addr learned my addr 172.21.15.156:0/3414851523 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:48.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.449+0000 7f662634e700 1 --2- 172.21.15.156:0/3414851523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66200a08e0 0x7f66201345c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:48.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.449+0000 7f6625b4d700 1 -- 172.21.15.156:0/3414851523 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6620138040 msgr2=0x7f66201d4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.449+0000 7f6625b4d700 1 --2- 172.21.15.156:0/3414851523 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6620138040 0x7f66201d4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.449+0000 7f6625b4d700 1 -- 172.21.15.156:0/3414851523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66200a08e0 msgr2=0x7f66201345c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.449+0000 7f6625b4d700 1 --2- 172.21.15.156:0/3414851523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66200a08e0 0x7f66201345c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.449+0000 7f6625b4d700 1 -- 172.21.15.156:0/3414851523 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6618009a70 con 0x7f66200a1230 2023-09-30T22:19:48.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.449+0000 7f6625b4d700 1 --2- 172.21.15.156:0/3414851523 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66200a1230 0x7f6620134b00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f661000d800 tx=0x7f661000db10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:48.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.450+0000 7f6616ffd700 1 -- 172.21.15.156:0/3414851523 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6610004240 con 0x7f66200a1230 2023-09-30T22:19:48.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.450+0000 7f6616ffd700 1 -- 172.21.15.156:0/3414851523 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66100043a0 con 0x7f66200a1230 2023-09-30T22:19:48.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.450+0000 7f66285b2700 1 -- 172.21.15.156:0/3414851523 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f661c009500 con 0x7f66200a1230 2023-09-30T22:19:48.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.450+0000 7f6616ffd700 1 -- 172.21.15.156:0/3414851523 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66100036a0 con 0x7f66200a1230 2023-09-30T22:19:48.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.450+0000 7f66285b2700 1 -- 172.21.15.156:0/3414851523 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f662013da30 con 0x7f66200a1230 2023-09-30T22:19:48.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.451+0000 7f6616ffd700 1 -- 172.21.15.156:0/3414851523 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6610003800 con 0x7f66200a1230 2023-09-30T22:19:48.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.451+0000 7f6616ffd700 1 -- 172.21.15.156:0/3414851523 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f661003f440 con 0x7f66200a1230 2023-09-30T22:19:48.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.451+0000 7f66285b2700 1 -- 172.21.15.156:0/3414851523 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f662011aea0 con 0x7f66200a1230 2023-09-30T22:19:48.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.460+0000 7f6616ffd700 1 -- 172.21.15.156:0/3414851523 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6610003ab0 con 0x7f66200a1230 2023-09-30T22:19:48.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.542+0000 7f9b4b3a1700 1 Processor -- start 2023-09-30T22:19:48.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.542+0000 7f9b4b3a1700 1 -- start start 2023-09-30T22:19:48.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.543+0000 7f9b4b3a1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b440a0a70 0x7f9b440a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:48.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.543+0000 7f9b4b3a1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b44134120 0x7f9b4413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:48.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.543+0000 7f9b4b3a1700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4409dc00 con 0x7f9b440a1380 2023-09-30T22:19:48.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.543+0000 7f9b4b3a1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4409ea90 con 0x7f9b44134120 2023-09-30T22:19:48.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.543+0000 7f9b4b3a1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4409dec0 con 0x7f9b440a0a70 2023-09-30T22:19:48.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.543+0000 7f9b4913d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b440a0a70 0x7f9b440a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:48.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.543+0000 7f9b4993e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b44134120 0x7f9b4413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:48.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.543+0000 7f9b4913d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b440a0a70 0x7f9b440a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44002/0 (socket says 172.21.15.156:44002) 2023-09-30T22:19:48.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.543+0000 7f9b4913d700 1 -- 172.21.15.156:0/2542352684 learned_addr learned my addr 172.21.15.156:0/2542352684 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:48.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.543+0000 7f9b4993e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b44134120 0x7f9b4413bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53968/0 (socket says 172.21.15.156:53968) 2023-09-30T22:19:48.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.543+0000 7f9b4913d700 1 -- 172.21.15.156:0/2542352684 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b44134120 msgr2=0x7f9b4413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:48.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.543+0000 7f9b4913d700 1 --2- 172.21.15.156:0/2542352684 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b44134120 0x7f9b4413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.543+0000 7f9b4913d700 1 -- 172.21.15.156:0/2542352684 >> v1:172.21.15.156:6789/0 conn(0x7f9b440a1380 legacy=0x7f9b44133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:48.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.543+0000 7f9b4913d700 1 -- 172.21.15.156:0/2542352684 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4409e6a0 con 0x7f9b440a0a70 2023-09-30T22:19:48.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.543+0000 7f9b4993e700 1 --2- 172.21.15.156:0/2542352684 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b44134120 0x7f9b4413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:48.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.543+0000 7f9b4913d700 1 --2- 172.21.15.156:0/2542352684 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b440a0a70 0x7f9b440a0e40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9b40009920 tx=0x7f9b40009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=423d53fe87b6cd9c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:48.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.544+0000 7f9b3bfff700 1 -- 172.21.15.156:0/2542352684 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b40004230 con 0x7f9b440a0a70 2023-09-30T22:19:48.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.544+0000 7f9b3bfff700 1 -- 172.21.15.156:0/2542352684 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b40004390 con 0x7f9b440a0a70 2023-09-30T22:19:48.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.544+0000 7f9b3bfff700 1 -- 172.21.15.156:0/2542352684 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b400036a0 con 0x7f9b440a0a70 2023-09-30T22:19:48.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.544+0000 7f9b4b3a1700 1 -- 172.21.15.156:0/2542352684 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b440a0a70 msgr2=0x7f9b440a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.544+0000 7f9b4b3a1700 1 --2- 172.21.15.156:0/2542352684 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b440a0a70 0x7f9b440a0e40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9b40009920 tx=0x7f9b40009c30 comp rx=0 tx=0).stop 2023-09-30T22:19:48.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.545+0000 7f9b4b3a1700 1 -- 172.21.15.156:0/2542352684 shutdown_connections 2023-09-30T22:19:48.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.545+0000 7f9b4b3a1700 1 --2- 172.21.15.156:0/2542352684 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b44134120 0x7f9b4413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.545+0000 7f9b4b3a1700 1 --2- 172.21.15.156:0/2542352684 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b440a0a70 0x7f9b440a0e40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.545+0000 7f9b4b3a1700 1 -- 172.21.15.156:0/2542352684 >> 172.21.15.156:0/2542352684 conn(0x7f9b440a6610 msgr2=0x7f9b440a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:48.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.545+0000 7f9b4b3a1700 1 -- 172.21.15.156:0/2542352684 shutdown_connections 2023-09-30T22:19:48.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.545+0000 7f9b4b3a1700 1 -- 172.21.15.156:0/2542352684 wait complete. 2023-09-30T22:19:48.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.546+0000 7f9b4b3a1700 1 Processor -- start 2023-09-30T22:19:48.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.546+0000 7f9b4b3a1700 1 -- start start 2023-09-30T22:19:48.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.547+0000 7f9b4b3a1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b440a0a70 0x7f9b44122870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:48.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.547+0000 7f9b4b3a1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b440a1380 0x7f9b44122db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:48.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.547+0000 7f9b4b3a1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b44134120 0x7f9b441232f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:48.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.547+0000 7f9b4b3a1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b44123d40 con 0x7f9b440a1380 2023-09-30T22:19:48.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.547+0000 7f9b4b3a1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b441261b0 con 0x7f9b44134120 2023-09-30T22:19:48.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.547+0000 7f9b4b3a1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b440a03e0 con 0x7f9b440a0a70 2023-09-30T22:19:48.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.547+0000 7f9b4893c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b440a1380 0x7f9b44122db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:48.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.547+0000 7f9b4993e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b44134120 0x7f9b441232f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:48.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.547+0000 7f9b4893c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b440a1380 0x7f9b44122db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51708/0 (socket says 172.21.15.156:51708) 2023-09-30T22:19:48.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.547+0000 7f9b4893c700 1 -- 172.21.15.156:0/1321924261 learned_addr learned my addr 172.21.15.156:0/1321924261 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:48.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.547+0000 7f9b4913d700 1 --2- 172.21.15.156:0/1321924261 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b440a0a70 0x7f9b44122870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:48.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.547+0000 7f9b4893c700 1 -- 172.21.15.156:0/1321924261 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b440a0a70 msgr2=0x7f9b44122870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.547+0000 7f9b4893c700 1 --2- 172.21.15.156:0/1321924261 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b440a0a70 0x7f9b44122870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.547+0000 7f9b4893c700 1 -- 172.21.15.156:0/1321924261 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b44134120 msgr2=0x7f9b441232f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.547+0000 7f9b4893c700 1 --2- 172.21.15.156:0/1321924261 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b44134120 0x7f9b441232f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.547+0000 7f9b4893c700 1 -- 172.21.15.156:0/1321924261 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c009a70 con 0x7f9b440a1380 2023-09-30T22:19:48.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.547+0000 7f9b4993e700 1 --2- 172.21.15.156:0/1321924261 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b44134120 0x7f9b441232f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:48.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.548+0000 7f9b4893c700 1 --2- 172.21.15.156:0/1321924261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b440a1380 0x7f9b44122db0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400c4d0 tx=0x7f9b3400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:48.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.548+0000 7f9b39ffb700 1 -- 172.21.15.156:0/1321924261 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b340054e0 con 0x7f9b440a1380 2023-09-30T22:19:48.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.548+0000 7f9b4b3a1700 1 -- 172.21.15.156:0/1321924261 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b40009550 con 0x7f9b440a1380 2023-09-30T22:19:48.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.548+0000 7f9b39ffb700 1 -- 172.21.15.156:0/1321924261 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3400ce90 con 0x7f9b440a1380 2023-09-30T22:19:48.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.548+0000 7f9b39ffb700 1 -- 172.21.15.156:0/1321924261 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b34003880 con 0x7f9b440a1380 2023-09-30T22:19:48.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.548+0000 7f9b4b3a1700 1 -- 172.21.15.156:0/1321924261 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b44124c70 con 0x7f9b440a1380 2023-09-30T22:19:48.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.550+0000 7f9b39ffb700 1 -- 172.21.15.156:0/1321924261 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9b340039e0 con 0x7f9b440a1380 2023-09-30T22:19:48.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.550+0000 7f9b39ffb700 1 -- 172.21.15.156:0/1321924261 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9b3403eb20 con 0x7f9b440a1380 2023-09-30T22:19:48.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.552+0000 7f9b4b3a1700 1 -- 172.21.15.156:0/1321924261 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b44125ff0 con 0x7f9b440a1380 2023-09-30T22:19:48.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.561+0000 7f9b39ffb700 1 -- 172.21.15.156:0/1321924261 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9b44125ff0 con 0x7f9b440a1380 2023-09-30T22:19:48.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.570+0000 7fea4c40f700 1 Processor -- start 2023-09-30T22:19:48.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.570+0000 7fea4c40f700 1 -- start start 2023-09-30T22:19:48.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.571+0000 7fea4c40f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea44099e20 0x7fea4409a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:48.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.571+0000 7fea4c40f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fea4409a730 0x7fea44130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:48.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.571+0000 7fea4c40f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea44130890 0x7fea44130d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:48.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.571+0000 7fea4c40f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea4409bf50 con 0x7fea4409a730 2023-09-30T22:19:48.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.571+0000 7fea4c40f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea44099a60 con 0x7fea44099e20 2023-09-30T22:19:48.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.571+0000 7fea4c40f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea4409b230 con 0x7fea44130890 2023-09-30T22:19:48.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.571+0000 7fea4a1ab700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea44099e20 0x7fea4409a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:48.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.571+0000 7fea4a1ab700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea44099e20 0x7fea4409a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53990/0 (socket says 172.21.15.156:53990) 2023-09-30T22:19:48.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.571+0000 7fea4a1ab700 1 -- 172.21.15.156:0/2615911789 learned_addr learned my addr 172.21.15.156:0/2615911789 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:48.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.571+0000 7fea499aa700 1 --2- 172.21.15.156:0/2615911789 >> v2:172.21.15.156:3300/0 conn(0x7fea4409a730 0x7fea44130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:48.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.571+0000 7fea4a9ac700 1 --2- 172.21.15.156:0/2615911789 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea44130890 0x7fea44130d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:48.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.571+0000 7fea4a1ab700 1 -- 172.21.15.156:0/2615911789 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea44130890 msgr2=0x7fea44130d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:48.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.571+0000 7fea4a1ab700 1 --2- 172.21.15.156:0/2615911789 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea44130890 0x7fea44130d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.571+0000 7fea4a1ab700 1 -- 172.21.15.156:0/2615911789 >> v2:172.21.15.156:3300/0 conn(0x7fea4409a730 msgr2=0x7fea44130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:48.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.571+0000 7fea4a1ab700 1 --2- 172.21.15.156:0/2615911789 >> v2:172.21.15.156:3300/0 conn(0x7fea4409a730 0x7fea44130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.571+0000 7fea4a1ab700 1 -- 172.21.15.156:0/2615911789 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4409bb90 con 0x7fea44099e20 2023-09-30T22:19:48.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.571+0000 7fea4a1ab700 1 --2- 172.21.15.156:0/2615911789 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea44099e20 0x7fea4409a1f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fea400098f0 tx=0x7fea40009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a01e138facf38f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:48.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.571+0000 7fea491a9700 1 -- 172.21.15.156:0/2615911789 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea40005e30 con 0x7fea44099e20 2023-09-30T22:19:48.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.572+0000 7fea491a9700 1 -- 172.21.15.156:0/2615911789 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea40004030 con 0x7fea44099e20 2023-09-30T22:19:48.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.572+0000 7fea491a9700 1 -- 172.21.15.156:0/2615911789 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea400043e0 con 0x7fea44099e20 2023-09-30T22:19:48.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.572+0000 7fea4c40f700 1 -- 172.21.15.156:0/2615911789 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea44099e20 msgr2=0x7fea4409a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.572+0000 7fea4c40f700 1 --2- 172.21.15.156:0/2615911789 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea44099e20 0x7fea4409a1f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fea400098f0 tx=0x7fea40009c00 comp rx=0 tx=0).stop 2023-09-30T22:19:48.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.572+0000 7fea4c40f700 1 -- 172.21.15.156:0/2615911789 shutdown_connections 2023-09-30T22:19:48.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.572+0000 7fea4c40f700 1 --2- 172.21.15.156:0/2615911789 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea44130890 0x7fea44130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.572+0000 7fea4c40f700 1 --2- 172.21.15.156:0/2615911789 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea44099e20 0x7fea4409a1f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.572+0000 7fea4c40f700 1 --2- 172.21.15.156:0/2615911789 >> v2:172.21.15.156:3300/0 conn(0x7fea4409a730 0x7fea44130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.572+0000 7fea4c40f700 1 -- 172.21.15.156:0/2615911789 >> 172.21.15.156:0/2615911789 conn(0x7fea440a2980 msgr2=0x7fea440a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:48.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.572+0000 7fea4c40f700 1 -- 172.21.15.156:0/2615911789 shutdown_connections 2023-09-30T22:19:48.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.572+0000 7fea4c40f700 1 -- 172.21.15.156:0/2615911789 wait complete. 2023-09-30T22:19:48.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.573+0000 7fea4c40f700 1 Processor -- start 2023-09-30T22:19:48.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.573+0000 7fea4c40f700 1 -- start start 2023-09-30T22:19:48.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.574+0000 7fea4c40f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea44099e20 0x7fea44134070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:48.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.574+0000 7fea4c40f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea4409a730 0x7fea441345b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:48.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.574+0000 7fea4c40f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea44130890 0x7fea44134af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:48.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.574+0000 7fea4c40f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4412de50 con 0x7fea4409a730 2023-09-30T22:19:48.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.574+0000 7fea4c40f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea44136f60 con 0x7fea44099e20 2023-09-30T22:19:48.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.574+0000 7fea4c40f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea440a1390 con 0x7fea44130890 2023-09-30T22:19:48.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.574+0000 7fea499aa700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea4409a730 0x7fea441345b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:48.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.574+0000 7fea499aa700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea4409a730 0x7fea441345b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51736/0 (socket says 172.21.15.156:51736) 2023-09-30T22:19:48.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.574+0000 7fea499aa700 1 -- 172.21.15.156:0/2024759034 learned_addr learned my addr 172.21.15.156:0/2024759034 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:48.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.574+0000 7fea4a1ab700 1 --2- 172.21.15.156:0/2024759034 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea44099e20 0x7fea44134070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:48.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.574+0000 7fea4a9ac700 1 --2- 172.21.15.156:0/2024759034 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea44130890 0x7fea44134af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:48.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.574+0000 7fea499aa700 1 -- 172.21.15.156:0/2024759034 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea44130890 msgr2=0x7fea44134af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.574+0000 7fea499aa700 1 --2- 172.21.15.156:0/2024759034 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea44130890 0x7fea44134af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.574+0000 7fea499aa700 1 -- 172.21.15.156:0/2024759034 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea44099e20 msgr2=0x7fea44134070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.574+0000 7fea499aa700 1 --2- 172.21.15.156:0/2024759034 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea44099e20 0x7fea44134070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.574+0000 7fea499aa700 1 -- 172.21.15.156:0/2024759034 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea40009500 con 0x7fea4409a730 2023-09-30T22:19:48.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.575+0000 7fea499aa700 1 --2- 172.21.15.156:0/2024759034 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea4409a730 0x7fea441345b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fea3400e980 tx=0x7fea3400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:48.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.575+0000 7fea3affd700 1 -- 172.21.15.156:0/2024759034 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea34009710 con 0x7fea4409a730 2023-09-30T22:19:48.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.575+0000 7fea4c40f700 1 -- 172.21.15.156:0/2024759034 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea441364e0 con 0x7fea4409a730 2023-09-30T22:19:48.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.575+0000 7fea3affd700 1 -- 172.21.15.156:0/2024759034 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3400eed0 con 0x7fea4409a730 2023-09-30T22:19:48.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.575+0000 7fea3affd700 1 -- 172.21.15.156:0/2024759034 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3400ca70 con 0x7fea4409a730 2023-09-30T22:19:48.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.575+0000 7fea4c40f700 1 -- 172.21.15.156:0/2024759034 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea441191c0 con 0x7fea4409a730 2023-09-30T22:19:48.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.576+0000 7fea4c40f700 1 -- 172.21.15.156:0/2024759034 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea4404f2a0 con 0x7fea4409a730 2023-09-30T22:19:48.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.576+0000 7fea3affd700 1 -- 172.21.15.156:0/2024759034 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fea3400cbd0 con 0x7fea4409a730 2023-09-30T22:19:48.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.576+0000 7fea3affd700 1 -- 172.21.15.156:0/2024759034 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fea34040000 con 0x7fea4409a730 2023-09-30T22:19:48.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.585+0000 7fea3affd700 1 -- 172.21.15.156:0/2024759034 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea34011350 con 0x7fea4409a730 2023-09-30T22:19:48.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.622+0000 7fdf2e08a700 1 -- 172.21.15.156:0/1060486747 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdf2809e380 con 0x7fdf2809dec0 2023-09-30T22:19:48.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.622+0000 7fdf0ffff700 1 -- 172.21.15.156:0/1060486747 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdf1c019b40 con 0x7fdf2809dec0 2023-09-30T22:19:48.623 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:48.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.624+0000 7fdf2e08a700 1 -- 172.21.15.156:0/1060486747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf2809dec0 msgr2=0x7fdf2809a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.625+0000 7fdf2e08a700 1 --2- 172.21.15.156:0/1060486747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf2809dec0 0x7fdf2809a9a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00c490 tx=0x7fdf1c00c7a0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.625+0000 7fdf2e08a700 1 -- 172.21.15.156:0/1060486747 shutdown_connections 2023-09-30T22:19:48.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.625+0000 7fdf2e08a700 1 --2- 172.21.15.156:0/1060486747 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdf28136cb0 0x7fdf2809aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.625+0000 7fdf2e08a700 1 --2- 172.21.15.156:0/1060486747 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdf2806a770 0x7fdf2809a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.625+0000 7fdf2e08a700 1 --2- 172.21.15.156:0/1060486747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf2809dec0 0x7fdf2809a9a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.625+0000 7fdf2e08a700 1 -- 172.21.15.156:0/1060486747 >> 172.21.15.156:0/1060486747 conn(0x7fdf28099c40 msgr2=0x7fdf280a2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:48.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.625+0000 7fdf2e08a700 1 -- 172.21.15.156:0/1060486747 shutdown_connections 2023-09-30T22:19:48.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.625+0000 7fdf2e08a700 1 -- 172.21.15.156:0/1060486747 wait complete. 2023-09-30T22:19:48.639 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:48.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.699+0000 7f66285b2700 1 -- 172.21.15.156:0/3414851523 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f662004f2a0 con 0x7f66200a1230 2023-09-30T22:19:48.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.699+0000 7f6616ffd700 1 -- 172.21.15.156:0/3414851523 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f661001ab50 con 0x7f66200a1230 2023-09-30T22:19:48.700 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:48.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.702+0000 7f66285b2700 1 -- 172.21.15.156:0/3414851523 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66200a1230 msgr2=0x7f6620134b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.702+0000 7f66285b2700 1 --2- 172.21.15.156:0/3414851523 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66200a1230 0x7f6620134b00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f661000d800 tx=0x7f661000db10 comp rx=0 tx=0).stop 2023-09-30T22:19:48.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.702+0000 7f66285b2700 1 -- 172.21.15.156:0/3414851523 shutdown_connections 2023-09-30T22:19:48.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.702+0000 7f66285b2700 1 --2- 172.21.15.156:0/3414851523 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6620138040 0x7f66201d4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.702+0000 7f66285b2700 1 --2- 172.21.15.156:0/3414851523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66200a08e0 0x7f66201345c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.702+0000 7f66285b2700 1 --2- 172.21.15.156:0/3414851523 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66200a1230 0x7f6620134b00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.702+0000 7f66285b2700 1 -- 172.21.15.156:0/3414851523 >> 172.21.15.156:0/3414851523 conn(0x7f66200a2980 msgr2=0x7f662009e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:48.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.703+0000 7f66285b2700 1 -- 172.21.15.156:0/3414851523 shutdown_connections 2023-09-30T22:19:48.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.703+0000 7f66285b2700 1 -- 172.21.15.156:0/3414851523 wait complete. 2023-09-30T22:19:48.720 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:48.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.778+0000 7fea4c40f700 1 -- 172.21.15.156:0/2024759034 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fea441193b0 con 0x7fea4409a730 2023-09-30T22:19:48.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.778+0000 7fea3affd700 1 -- 172.21.15.156:0/2024759034 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea34017070 con 0x7fea4409a730 2023-09-30T22:19:48.779 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:48.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.780+0000 7fea4c40f700 1 -- 172.21.15.156:0/2024759034 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea4409a730 msgr2=0x7fea441345b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.780+0000 7fea4c40f700 1 --2- 172.21.15.156:0/2024759034 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea4409a730 0x7fea441345b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fea3400e980 tx=0x7fea3400ec90 comp rx=0 tx=0).stop 2023-09-30T22:19:48.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.780+0000 7fea4c40f700 1 -- 172.21.15.156:0/2024759034 shutdown_connections 2023-09-30T22:19:48.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.780+0000 7fea4c40f700 1 --2- 172.21.15.156:0/2024759034 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea44130890 0x7fea44134af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.780+0000 7fea4c40f700 1 --2- 172.21.15.156:0/2024759034 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea44099e20 0x7fea44134070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.780+0000 7fea4c40f700 1 --2- 172.21.15.156:0/2024759034 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea4409a730 0x7fea441345b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.780+0000 7fea4c40f700 1 -- 172.21.15.156:0/2024759034 >> 172.21.15.156:0/2024759034 conn(0x7fea440a2980 msgr2=0x7fea4409e200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:48.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.780+0000 7fea4c40f700 1 -- 172.21.15.156:0/2024759034 shutdown_connections 2023-09-30T22:19:48.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.780+0000 7fea4c40f700 1 -- 172.21.15.156:0/2024759034 wait complete. 2023-09-30T22:19:48.793 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:48.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.793+0000 7f9b4b3a1700 1 -- 172.21.15.156:0/1321924261 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9b44125ff0 con 0x7f9b440a1380 2023-09-30T22:19:48.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.793+0000 7f9b39ffb700 1 -- 172.21.15.156:0/1321924261 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9b34017030 con 0x7f9b440a1380 2023-09-30T22:19:48.794 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:48.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.795+0000 7f9b4b3a1700 1 -- 172.21.15.156:0/1321924261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b440a1380 msgr2=0x7f9b44122db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.795+0000 7f9b4b3a1700 1 --2- 172.21.15.156:0/1321924261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b440a1380 0x7f9b44122db0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400c4d0 tx=0x7f9b3400c7e0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.795+0000 7f9b4b3a1700 1 -- 172.21.15.156:0/1321924261 shutdown_connections 2023-09-30T22:19:48.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.795+0000 7f9b4b3a1700 1 --2- 172.21.15.156:0/1321924261 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b44134120 0x7f9b441232f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.795+0000 7f9b4b3a1700 1 --2- 172.21.15.156:0/1321924261 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b440a0a70 0x7f9b44122870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.795+0000 7f9b4b3a1700 1 --2- 172.21.15.156:0/1321924261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b440a1380 0x7f9b44122db0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:48.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.795+0000 7f9b4b3a1700 1 -- 172.21.15.156:0/1321924261 >> 172.21.15.156:0/1321924261 conn(0x7f9b440a6610 msgr2=0x7f9b440a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:48.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.796+0000 7f9b4b3a1700 1 -- 172.21.15.156:0/1321924261 shutdown_connections 2023-09-30T22:19:48.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:48.796+0000 7f9b4b3a1700 1 -- 172.21.15.156:0/1321924261 wait complete. 2023-09-30T22:19:48.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:49.640 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:49.721 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:49.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.767+0000 7fb0519f2700 1 Processor -- start 2023-09-30T22:19:49.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.767+0000 7fb0519f2700 1 -- start start 2023-09-30T22:19:49.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.767+0000 7fb0519f2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb04c09ad40 0x7fb04c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:49.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.767+0000 7fb0519f2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb04c1343a0 0x7fb04c0a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:49.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.767+0000 7fb0519f2700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04c09b110 con 0x7fb04c133f70 2023-09-30T22:19:49.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.767+0000 7fb0519f2700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb04c0a3b60 con 0x7fb04c1343a0 2023-09-30T22:19:49.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.767+0000 7fb0519f2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c0a2fa0 con 0x7fb04c09ad40 2023-09-30T22:19:49.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.768+0000 7fb04b7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb04c1343a0 0x7fb04c0a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:49.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.768+0000 7fb04affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb04c09ad40 0x7fb04c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:49.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.768+0000 7fb04b7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb04c1343a0 0x7fb04c0a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51744/0 (socket says 172.21.15.156:51744) 2023-09-30T22:19:49.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.768+0000 7fb04affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb04c09ad40 0x7fb04c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54006/0 (socket says 172.21.15.156:54006) 2023-09-30T22:19:49.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.768+0000 7fb04b7fe700 1 -- 172.21.15.156:0/2588328297 learned_addr learned my addr 172.21.15.156:0/2588328297 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:49.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.768+0000 7fb04a7fc700 1 --1- 172.21.15.156:0/2588328297 >> v1:172.21.15.156:6789/0 conn(0x7fb04c133f70 0x7fb04c0a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:36234/0 (socket says 172.21.15.156:36234) 2023-09-30T22:19:49.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.768+0000 7fb04b7fe700 1 -- 172.21.15.156:0/2588328297 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb04c09ad40 msgr2=0x7fb04c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:49.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.768+0000 7fb04b7fe700 1 --2- 172.21.15.156:0/2588328297 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb04c09ad40 0x7fb04c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:49.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.768+0000 7fb04b7fe700 1 -- 172.21.15.156:0/2588328297 >> v1:172.21.15.156:6789/0 conn(0x7fb04c133f70 legacy=0x7fb04c0a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.768+0000 7fb04b7fe700 1 -- 172.21.15.156:0/2588328297 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c09a280 con 0x7fb04c1343a0 2023-09-30T22:19:49.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.768+0000 7fb049ffb700 1 -- 172.21.15.156:0/2588328297 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015115124 0 0) 0x7fb04c09b110 con 0x7fb04c133f70 2023-09-30T22:19:49.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.768+0000 7fb04affd700 1 --2- 172.21.15.156:0/2588328297 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb04c09ad40 0x7fb04c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:49.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.768+0000 7fb04b7fe700 1 --2- 172.21.15.156:0/2588328297 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb04c1343a0 0x7fb04c0a1180 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb044009e50 tx=0x7fb04400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca19a8790ca3fdc5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:49.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.768+0000 7fb049ffb700 1 -- 172.21.15.156:0/2588328297 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04400e070 con 0x7fb04c1343a0 2023-09-30T22:19:49.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.768+0000 7fb049ffb700 1 -- 172.21.15.156:0/2588328297 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04400b910 con 0x7fb04c1343a0 2023-09-30T22:19:49.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.768+0000 7fb049ffb700 1 -- 172.21.15.156:0/2588328297 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04400bcc0 con 0x7fb04c1343a0 2023-09-30T22:19:49.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.769+0000 7fb0519f2700 1 -- 172.21.15.156:0/2588328297 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb04c1343a0 msgr2=0x7fb04c0a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.769+0000 7fb0519f2700 1 --2- 172.21.15.156:0/2588328297 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb04c1343a0 0x7fb04c0a1180 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb044009e50 tx=0x7fb04400b330 comp rx=0 tx=0).stop 2023-09-30T22:19:49.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.769+0000 7fb0519f2700 1 -- 172.21.15.156:0/2588328297 shutdown_connections 2023-09-30T22:19:49.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.769+0000 7fb0519f2700 1 --2- 172.21.15.156:0/2588328297 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb04c1343a0 0x7fb04c0a1180 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:49.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.769+0000 7fb0519f2700 1 --2- 172.21.15.156:0/2588328297 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb04c09ad40 0x7fb04c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:49.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.769+0000 7fb0519f2700 1 -- 172.21.15.156:0/2588328297 >> 172.21.15.156:0/2588328297 conn(0x7fb04c099c40 msgr2=0x7fb04c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:49.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.769+0000 7fb0519f2700 1 -- 172.21.15.156:0/2588328297 shutdown_connections 2023-09-30T22:19:49.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.769+0000 7fb0519f2700 1 -- 172.21.15.156:0/2588328297 wait complete. 2023-09-30T22:19:49.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.770+0000 7fb0519f2700 1 Processor -- start 2023-09-30T22:19:49.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.770+0000 7fb0519f2700 1 -- start start 2023-09-30T22:19:49.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.770+0000 7fb0519f2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb04c09ad40 0x7fb04c1c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:49.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.770+0000 7fb0519f2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb04c133f70 0x7fb04c1c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:49.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.770+0000 7fb0519f2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb04c1343a0 0x7fb04c1c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:49.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.770+0000 7fb0519f2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c11efd0 con 0x7fb04c1343a0 2023-09-30T22:19:49.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.770+0000 7fb0519f2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c120730 con 0x7fb04c133f70 2023-09-30T22:19:49.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.770+0000 7fb0519f2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c122740 con 0x7fb04c09ad40 2023-09-30T22:19:49.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.771+0000 7fb04affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb04c09ad40 0x7fb04c1c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:49.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.771+0000 7fb04b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb04c1343a0 0x7fb04c1c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:49.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.771+0000 7fb04affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb04c09ad40 0x7fb04c1c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44040/0 (socket says 172.21.15.156:44040) 2023-09-30T22:19:49.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.771+0000 7fb04affd700 1 -- 172.21.15.156:0/2673946639 learned_addr learned my addr 172.21.15.156:0/2673946639 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:49.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.771+0000 7fb04a7fc700 1 --2- 172.21.15.156:0/2673946639 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb04c133f70 0x7fb04c1c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:49.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.771+0000 7fb04b7fe700 1 -- 172.21.15.156:0/2673946639 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb04c09ad40 msgr2=0x7fb04c1c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.771+0000 7fb04b7fe700 1 --2- 172.21.15.156:0/2673946639 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb04c09ad40 0x7fb04c1c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:49.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.771+0000 7fb04b7fe700 1 -- 172.21.15.156:0/2673946639 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb04c133f70 msgr2=0x7fb04c1c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.771+0000 7fb04b7fe700 1 --2- 172.21.15.156:0/2673946639 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb04c133f70 0x7fb04c1c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:49.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.771+0000 7fb04b7fe700 1 -- 172.21.15.156:0/2673946639 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03c0094a0 con 0x7fb04c1343a0 2023-09-30T22:19:49.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.771+0000 7fb04affd700 1 --2- 172.21.15.156:0/2673946639 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb04c09ad40 0x7fb04c1c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:49.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.771+0000 7fb04b7fe700 1 --2- 172.21.15.156:0/2673946639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb04c1343a0 0x7fb04c1c8ba0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb044015000 tx=0x7fb044004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:49.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.771+0000 7fb033fff700 1 -- 172.21.15.156:0/2673946639 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04401c640 con 0x7fb04c1343a0 2023-09-30T22:19:49.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.771+0000 7fb033fff700 1 -- 172.21.15.156:0/2673946639 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04401c7a0 con 0x7fb04c1343a0 2023-09-30T22:19:49.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.771+0000 7fb0519f2700 1 -- 172.21.15.156:0/2673946639 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb044009b30 con 0x7fb04c1343a0 2023-09-30T22:19:49.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.771+0000 7fb033fff700 1 -- 172.21.15.156:0/2673946639 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04401cb50 con 0x7fb04c1343a0 2023-09-30T22:19:49.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.771+0000 7fb0519f2700 1 -- 172.21.15.156:0/2673946639 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04c120f20 con 0x7fb04c1343a0 2023-09-30T22:19:49.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.772+0000 7fb033fff700 1 -- 172.21.15.156:0/2673946639 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb04401ccb0 con 0x7fb04c1343a0 2023-09-30T22:19:49.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.772+0000 7fb033fff700 1 -- 172.21.15.156:0/2673946639 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb044040f20 con 0x7fb04c1343a0 2023-09-30T22:19:49.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.772+0000 7fb0519f2700 1 -- 172.21.15.156:0/2673946639 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04c04f2a0 con 0x7fb04c1343a0 2023-09-30T22:19:49.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.777+0000 7fb033fff700 1 -- 172.21.15.156:0/2673946639 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb044026e10 con 0x7fb04c1343a0 2023-09-30T22:19:49.794 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:49.809 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:49.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.849+0000 7fdb8036c700 1 Processor -- start 2023-09-30T22:19:49.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.849+0000 7fdb8036c700 1 -- start start 2023-09-30T22:19:49.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.850+0000 7fdb8036c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb78136960 0x7fdb78138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:49.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.850+0000 7fdb8036c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdb78139280 0x7fdb7813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:49.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.850+0000 7fdb8036c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb7806b2d0 con 0x7fdb78133ad0 2023-09-30T22:19:49.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.850+0000 7fdb8036c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb781345b0 con 0x7fdb78139280 2023-09-30T22:19:49.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.850+0000 7fdb8036c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb78133610 con 0x7fdb78136960 2023-09-30T22:19:49.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.850+0000 7fdb7e909700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdb78139280 0x7fdb7813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:49.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.850+0000 7fdb7e108700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fdb78133ad0 0x7fdb78133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:36250/0 (socket says 172.21.15.156:36250) 2023-09-30T22:19:49.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.850+0000 7fdb7e909700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdb78139280 0x7fdb7813b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51748/0 (socket says 172.21.15.156:51748) 2023-09-30T22:19:49.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.850+0000 7fdb7e108700 1 -- 172.21.15.156:0/3609457964 learned_addr learned my addr 172.21.15.156:0/3609457964 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:49.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.851+0000 7fdb7d106700 1 -- 172.21.15.156:0/3609457964 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3780845479 0 0) 0x7fdb7806b2d0 con 0x7fdb78133ad0 2023-09-30T22:19:49.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.851+0000 7fdb7d106700 1 -- 172.21.15.156:0/3609457964 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb640035b0 con 0x7fdb78133ad0 2023-09-30T22:19:49.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.851+0000 7fdb7e909700 1 -- 172.21.15.156:0/3609457964 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb78136960 msgr2=0x7fdb78138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:49.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.851+0000 7fdb7e909700 1 --2- 172.21.15.156:0/3609457964 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb78136960 0x7fdb78138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:49.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.851+0000 7fdb7e909700 1 -- 172.21.15.156:0/3609457964 >> v1:172.21.15.156:6789/0 conn(0x7fdb78133ad0 legacy=0x7fdb78133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.851+0000 7fdb7e909700 1 -- 172.21.15.156:0/3609457964 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7809a500 con 0x7fdb78139280 2023-09-30T22:19:49.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.851+0000 7fdb7e909700 1 --2- 172.21.15.156:0/3609457964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb78139280 0x7fdb7813b660 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdb70009dc0 tx=0x7fdb7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63617c219cb4b45e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:49.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.851+0000 7fdb7d106700 1 -- 172.21.15.156:0/3609457964 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7000e070 con 0x7fdb78139280 2023-09-30T22:19:49.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.851+0000 7fdb7d106700 1 -- 172.21.15.156:0/3609457964 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7000bae0 con 0x7fdb78139280 2023-09-30T22:19:49.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.851+0000 7fdb7d106700 1 -- 172.21.15.156:0/3609457964 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7000be90 con 0x7fdb78139280 2023-09-30T22:19:49.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.852+0000 7fdb8036c700 1 -- 172.21.15.156:0/3609457964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb78139280 msgr2=0x7fdb7813b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.852+0000 7fdb8036c700 1 --2- 172.21.15.156:0/3609457964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb78139280 0x7fdb7813b660 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdb70009dc0 tx=0x7fdb7000b330 comp rx=0 tx=0).stop 2023-09-30T22:19:49.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.852+0000 7fdb8036c700 1 -- 172.21.15.156:0/3609457964 shutdown_connections 2023-09-30T22:19:49.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.852+0000 7fdb8036c700 1 --2- 172.21.15.156:0/3609457964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb78139280 0x7fdb7813b660 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:49.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.852+0000 7fdb8036c700 1 --2- 172.21.15.156:0/3609457964 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb78136960 0x7fdb78138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:49.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.852+0000 7fdb8036c700 1 -- 172.21.15.156:0/3609457964 >> 172.21.15.156:0/3609457964 conn(0x7fdb78099c40 msgr2=0x7fdb780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:49.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.852+0000 7fdb8036c700 1 -- 172.21.15.156:0/3609457964 shutdown_connections 2023-09-30T22:19:49.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.852+0000 7fdb8036c700 1 -- 172.21.15.156:0/3609457964 wait complete. 2023-09-30T22:19:49.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.853+0000 7fdb8036c700 1 Processor -- start 2023-09-30T22:19:49.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.853+0000 7fdb8036c700 1 -- start start 2023-09-30T22:19:49.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.854+0000 7fdb8036c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb78133ad0 0x7fdb7812cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:49.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.854+0000 7fdb8036c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb78136960 0x7fdb7812d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:49.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.854+0000 7fdb8036c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb78139280 0x7fdb7812d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:49.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.854+0000 7fdb8036c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb78070300 con 0x7fdb78139280 2023-09-30T22:19:49.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.854+0000 7fdb8036c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb78070040 con 0x7fdb78136960 2023-09-30T22:19:49.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.854+0000 7fdb8036c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb78130c00 con 0x7fdb78133ad0 2023-09-30T22:19:49.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.854+0000 7fdb7e909700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb78139280 0x7fdb7812d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:49.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.854+0000 7fdb7e909700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb78139280 0x7fdb7812d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51752/0 (socket says 172.21.15.156:51752) 2023-09-30T22:19:49.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.854+0000 7fdb7e909700 1 -- 172.21.15.156:0/3373337501 learned_addr learned my addr 172.21.15.156:0/3373337501 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:49.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.854+0000 7fdb7e909700 1 -- 172.21.15.156:0/3373337501 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb78133ad0 msgr2=0x7fdb7812cb30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:49.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.854+0000 7fdb7e909700 1 --2- 172.21.15.156:0/3373337501 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb78133ad0 0x7fdb7812cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:49.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.854+0000 7fdb7e909700 1 -- 172.21.15.156:0/3373337501 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb78136960 msgr2=0x7fdb7812d070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:49.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.854+0000 7fdb7e909700 1 --2- 172.21.15.156:0/3373337501 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb78136960 0x7fdb7812d070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:49.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.854+0000 7fdb7e909700 1 -- 172.21.15.156:0/3373337501 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb70009a70 con 0x7fdb78139280 2023-09-30T22:19:49.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.854+0000 7fdb7e909700 1 --2- 172.21.15.156:0/3373337501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb78139280 0x7fdb7812d5b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdb70014040 tx=0x7fdb70004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:49.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.854+0000 7fdb6effd700 1 -- 172.21.15.156:0/3373337501 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70004960 con 0x7fdb78139280 2023-09-30T22:19:49.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.855+0000 7fdb6effd700 1 -- 172.21.15.156:0/3373337501 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb70020070 con 0x7fdb78139280 2023-09-30T22:19:49.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.855+0000 7fdb6effd700 1 -- 172.21.15.156:0/3373337501 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb700276a0 con 0x7fdb78139280 2023-09-30T22:19:49.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.855+0000 7fdb8036c700 1 -- 172.21.15.156:0/3373337501 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb7809f390 con 0x7fdb78139280 2023-09-30T22:19:49.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.855+0000 7fdb8036c700 1 -- 172.21.15.156:0/3373337501 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb78070d70 con 0x7fdb78139280 2023-09-30T22:19:49.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.856+0000 7fdb8036c700 1 -- 172.21.15.156:0/3373337501 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb7804f2a0 con 0x7fdb78139280 2023-09-30T22:19:49.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.856+0000 7fdb6effd700 1 -- 172.21.15.156:0/3373337501 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb70012430 con 0x7fdb78139280 2023-09-30T22:19:49.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.856+0000 7fdb6effd700 1 -- 172.21.15.156:0/3373337501 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdb70022070 con 0x7fdb78139280 2023-09-30T22:19:49.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.861+0000 7fdb6effd700 1 -- 172.21.15.156:0/3373337501 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb7001a790 con 0x7fdb78139280 2023-09-30T22:19:49.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.925+0000 7f8d5aaaa700 1 Processor -- start 2023-09-30T22:19:49.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.926+0000 7f8d5aaaa700 1 -- start start 2023-09-30T22:19:49.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.926+0000 7f8d5aaaa700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d54133900 0x7f8d54133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:49.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.926+0000 7f8d5aaaa700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8d54134210 0x7f8d540a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:49.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.926+0000 7f8d5aaaa700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d540a0ee0 0x7f8d540a1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:49.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.926+0000 7f8d5aaaa700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d5409a760 con 0x7f8d54134210 2023-09-30T22:19:49.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.926+0000 7f8d5aaaa700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d541336e0 con 0x7f8d540a0ee0 2023-09-30T22:19:49.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.926+0000 7f8d5aaaa700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5409a080 con 0x7f8d54133900 2023-09-30T22:19:49.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.926+0000 7f8d58846700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d54133900 0x7f8d54133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:49.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.926+0000 7f8d53fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8d54134210 0x7f8d540a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:49.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.926+0000 7f8d58846700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d54133900 0x7f8d54133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44052/0 (socket says 172.21.15.156:44052) 2023-09-30T22:19:49.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.926+0000 7f8d53fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8d54134210 0x7f8d540a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51766/0 (socket says 172.21.15.156:51766) 2023-09-30T22:19:49.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.926+0000 7f8d58846700 1 -- 172.21.15.156:0/2974541477 learned_addr learned my addr 172.21.15.156:0/2974541477 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:49.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.926+0000 7f8d59047700 1 --2- 172.21.15.156:0/2974541477 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d540a0ee0 0x7f8d540a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:49.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.927+0000 7f8d58846700 1 -- 172.21.15.156:0/2974541477 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d540a0ee0 msgr2=0x7f8d540a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:49.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.927+0000 7f8d58846700 1 --2- 172.21.15.156:0/2974541477 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d540a0ee0 0x7f8d540a1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:49.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.927+0000 7f8d58846700 1 -- 172.21.15.156:0/2974541477 >> v2:172.21.15.156:3300/0 conn(0x7f8d54134210 msgr2=0x7f8d540a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:49.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.927+0000 7f8d58846700 1 --2- 172.21.15.156:0/2974541477 >> v2:172.21.15.156:3300/0 conn(0x7f8d54134210 0x7f8d540a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:49.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.927+0000 7f8d58846700 1 -- 172.21.15.156:0/2974541477 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d540a23e0 con 0x7f8d54133900 2023-09-30T22:19:49.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.927+0000 7f8d58846700 1 --2- 172.21.15.156:0/2974541477 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d54133900 0x7f8d54133cd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8d48006fd0 tx=0x7f8d48009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=681066abf94964b5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:49.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.927+0000 7f8d537fe700 1 -- 172.21.15.156:0/2974541477 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d48005e30 con 0x7f8d54133900 2023-09-30T22:19:49.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.927+0000 7f8d537fe700 1 -- 172.21.15.156:0/2974541477 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d48004030 con 0x7f8d54133900 2023-09-30T22:19:49.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.927+0000 7f8d537fe700 1 -- 172.21.15.156:0/2974541477 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d480043e0 con 0x7f8d54133900 2023-09-30T22:19:49.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.928+0000 7f8d5aaaa700 1 -- 172.21.15.156:0/2974541477 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d54133900 msgr2=0x7f8d54133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.928+0000 7f8d5aaaa700 1 --2- 172.21.15.156:0/2974541477 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d54133900 0x7f8d54133cd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8d48006fd0 tx=0x7f8d48009bd0 comp rx=0 tx=0).stop 2023-09-30T22:19:49.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.928+0000 7f8d5aaaa700 1 -- 172.21.15.156:0/2974541477 shutdown_connections 2023-09-30T22:19:49.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.928+0000 7f8d5aaaa700 1 --2- 172.21.15.156:0/2974541477 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d540a0ee0 0x7f8d540a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:49.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.928+0000 7f8d5aaaa700 1 --2- 172.21.15.156:0/2974541477 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d54133900 0x7f8d54133cd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:49.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.928+0000 7f8d5aaaa700 1 --2- 172.21.15.156:0/2974541477 >> v2:172.21.15.156:3300/0 conn(0x7f8d54134210 0x7f8d540a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:49.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.928+0000 7f8d5aaaa700 1 -- 172.21.15.156:0/2974541477 >> 172.21.15.156:0/2974541477 conn(0x7f8d540a2980 msgr2=0x7f8d540a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:49.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.928+0000 7f8d5aaaa700 1 -- 172.21.15.156:0/2974541477 shutdown_connections 2023-09-30T22:19:49.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.928+0000 7f8d5aaaa700 1 -- 172.21.15.156:0/2974541477 wait complete. 2023-09-30T22:19:49.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.929+0000 7f8d5aaaa700 1 Processor -- start 2023-09-30T22:19:49.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.929+0000 7f8d5aaaa700 1 -- start start 2023-09-30T22:19:49.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.929+0000 7f8d5aaaa700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d540a0ee0 0x7f8d5411a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:49.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.929+0000 7f8d5aaaa700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d54133900 0x7f8d5411ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:49.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.929+0000 7f8d5aaaa700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d54134210 0x7f8d5411b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:49.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.929+0000 7f8d5aaaa700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5411bbf0 con 0x7f8d540a0ee0 2023-09-30T22:19:49.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.929+0000 7f8d5aaaa700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5411c350 con 0x7f8d54133900 2023-09-30T22:19:49.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.929+0000 7f8d5aaaa700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5411c970 con 0x7f8d54134210 2023-09-30T22:19:49.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.929+0000 7f8d59047700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d54134210 0x7f8d5411b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:49.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.929+0000 7f8d59047700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d54134210 0x7f8d5411b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44060/0 (socket says 172.21.15.156:44060) 2023-09-30T22:19:49.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.929+0000 7f8d59047700 1 -- 172.21.15.156:0/3864217458 learned_addr learned my addr 172.21.15.156:0/3864217458 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:49.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.930+0000 7f8d53fff700 1 --2- 172.21.15.156:0/3864217458 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d54133900 0x7f8d5411ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:49.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.930+0000 7f8d58846700 1 --2- 172.21.15.156:0/3864217458 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d540a0ee0 0x7f8d5411a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:49.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.930+0000 7f8d59047700 1 -- 172.21.15.156:0/3864217458 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d54133900 msgr2=0x7f8d5411ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.930+0000 7f8d59047700 1 --2- 172.21.15.156:0/3864217458 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d54133900 0x7f8d5411ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:49.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.930+0000 7f8d59047700 1 -- 172.21.15.156:0/3864217458 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d540a0ee0 msgr2=0x7f8d5411a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.930+0000 7f8d59047700 1 --2- 172.21.15.156:0/3864217458 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d540a0ee0 0x7f8d5411a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:49.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.930+0000 7f8d59047700 1 -- 172.21.15.156:0/3864217458 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d48009500 con 0x7f8d54134210 2023-09-30T22:19:49.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.930+0000 7f8d58846700 1 --2- 172.21.15.156:0/3864217458 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d540a0ee0 0x7f8d5411a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:19:49.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.930+0000 7f8d59047700 1 --2- 172.21.15.156:0/3864217458 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d54134210 0x7f8d5411b1c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c007e70 tx=0x7f8d4c00e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:49.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.930+0000 7f8d517fa700 1 -- 172.21.15.156:0/3864217458 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c00ede0 con 0x7f8d54134210 2023-09-30T22:19:49.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.930+0000 7f8d517fa700 1 -- 172.21.15.156:0/3864217458 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4c014420 con 0x7f8d54134210 2023-09-30T22:19:49.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.930+0000 7f8d517fa700 1 -- 172.21.15.156:0/3864217458 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c014790 con 0x7f8d54134210 2023-09-30T22:19:49.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.931+0000 7f8d5aaaa700 1 -- 172.21.15.156:0/3864217458 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d5411df80 con 0x7f8d54134210 2023-09-30T22:19:49.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.931+0000 7f8d5aaaa700 1 -- 172.21.15.156:0/3864217458 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d5409c310 con 0x7f8d54134210 2023-09-30T22:19:49.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.932+0000 7f8d517fa700 1 -- 172.21.15.156:0/3864217458 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d4c0148f0 con 0x7f8d54134210 2023-09-30T22:19:49.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.932+0000 7f8d5aaaa700 1 -- 172.21.15.156:0/3864217458 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d5411d600 con 0x7f8d54134210 2023-09-30T22:19:49.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.932+0000 7f8d517fa700 1 -- 172.21.15.156:0/3864217458 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8d4c03fde0 con 0x7f8d54134210 2023-09-30T22:19:49.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.941+0000 7f8d517fa700 1 -- 172.21.15.156:0/3864217458 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d4c01bb00 con 0x7f8d54134210 2023-09-30T22:19:49.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.982+0000 7fb0519f2700 1 -- 172.21.15.156:0/2673946639 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb04c0729d0 con 0x7fb04c1343a0 2023-09-30T22:19:49.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.983+0000 7fb033fff700 1 -- 172.21.15.156:0/2673946639 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb044035090 con 0x7fb04c1343a0 2023-09-30T22:19:49.983 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:49.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.985+0000 7f30acb88700 1 Processor -- start 2023-09-30T22:19:49.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.985+0000 7f30acb88700 1 -- start start 2023-09-30T22:19:49.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.985+0000 7fb0519f2700 1 -- 172.21.15.156:0/2673946639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb04c1343a0 msgr2=0x7fb04c1c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.985+0000 7fb0519f2700 1 --2- 172.21.15.156:0/2673946639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb04c1343a0 0x7fb04c1c8ba0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb044015000 tx=0x7fb044004ad0 comp rx=0 tx=0).stop 2023-09-30T22:19:49.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.985+0000 7f30acb88700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f30a8136960 0x7f30a8138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:49.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.985+0000 7f30acb88700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a8139280 0x7f30a813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:49.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.985+0000 7f30acb88700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a806b2d0 con 0x7f30a8133ad0 2023-09-30T22:19:49.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.985+0000 7f30acb88700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a81345b0 con 0x7f30a8136960 2023-09-30T22:19:49.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.985+0000 7f30acb88700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a8133610 con 0x7f30a8139280 2023-09-30T22:19:49.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.985+0000 7fb0519f2700 1 -- 172.21.15.156:0/2673946639 shutdown_connections 2023-09-30T22:19:49.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.985+0000 7fb0519f2700 1 --2- 172.21.15.156:0/2673946639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb04c1343a0 0x7fb04c1c8ba0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:49.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.985+0000 7fb0519f2700 1 --2- 172.21.15.156:0/2673946639 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb04c09ad40 0x7fb04c1c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:49.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.985+0000 7fb0519f2700 1 --2- 172.21.15.156:0/2673946639 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb04c133f70 0x7fb04c1c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:49.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.985+0000 7fb0519f2700 1 -- 172.21.15.156:0/2673946639 >> 172.21.15.156:0/2673946639 conn(0x7fb04c099c40 msgr2=0x7fb04c1bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:49.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.986+0000 7f30a6d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a8139280 0x7f30a813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:49.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.986+0000 7f30a5d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f30a8136960 0x7f30a8138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:49.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.986+0000 7f30a6d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a8139280 0x7f30a813b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54034/0 (socket says 172.21.15.156:54034) 2023-09-30T22:19:49.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.986+0000 7f30a5d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f30a8136960 0x7f30a8138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51796/0 (socket says 172.21.15.156:51796) 2023-09-30T22:19:49.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.986+0000 7f30a6d9d700 1 -- 172.21.15.156:0/792295622 learned_addr learned my addr 172.21.15.156:0/792295622 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:49.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.986+0000 7fb0519f2700 1 -- 172.21.15.156:0/2673946639 shutdown_connections 2023-09-30T22:19:49.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.986+0000 7fb0519f2700 1 -- 172.21.15.156:0/2673946639 wait complete. 2023-09-30T22:19:49.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.986+0000 7f30a6d9d700 1 -- 172.21.15.156:0/792295622 >> v2:172.21.15.156:3300/0 conn(0x7f30a8136960 msgr2=0x7f30a8138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:49.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.986+0000 7f30a6d9d700 1 --2- 172.21.15.156:0/792295622 >> v2:172.21.15.156:3300/0 conn(0x7f30a8136960 0x7f30a8138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:49.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.986+0000 7f30a6d9d700 1 -- 172.21.15.156:0/792295622 >> v1:172.21.15.156:6789/0 conn(0x7f30a8133ad0 legacy=0x7f30a8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:49.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.986+0000 7f30a6d9d700 1 -- 172.21.15.156:0/792295622 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a809a500 con 0x7f30a8139280 2023-09-30T22:19:49.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.986+0000 7f30a6d9d700 1 --2- 172.21.15.156:0/792295622 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a8139280 0x7f30a813b660 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f30a0009e50 tx=0x7f30a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38f7707c9616f738 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:49.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.986+0000 7f30a559a700 1 -- 172.21.15.156:0/792295622 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a000e070 con 0x7f30a8139280 2023-09-30T22:19:49.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.986+0000 7f30a559a700 1 -- 172.21.15.156:0/792295622 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a0003a20 con 0x7f30a8139280 2023-09-30T22:19:49.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.986+0000 7f30a559a700 1 -- 172.21.15.156:0/792295622 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a0003dd0 con 0x7f30a8139280 2023-09-30T22:19:49.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.987+0000 7f30acb88700 1 -- 172.21.15.156:0/792295622 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a8139280 msgr2=0x7f30a813b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.987+0000 7f30acb88700 1 --2- 172.21.15.156:0/792295622 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a8139280 0x7f30a813b660 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f30a0009e50 tx=0x7f30a000b330 comp rx=0 tx=0).stop 2023-09-30T22:19:49.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.987+0000 7f30acb88700 1 -- 172.21.15.156:0/792295622 shutdown_connections 2023-09-30T22:19:49.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.987+0000 7f30acb88700 1 --2- 172.21.15.156:0/792295622 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a8139280 0x7f30a813b660 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:49.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.987+0000 7f30acb88700 1 --2- 172.21.15.156:0/792295622 >> v2:172.21.15.156:3300/0 conn(0x7f30a8136960 0x7f30a8138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:49.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.987+0000 7f30acb88700 1 -- 172.21.15.156:0/792295622 >> 172.21.15.156:0/792295622 conn(0x7f30a8099c40 msgr2=0x7f30a80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:49.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.987+0000 7f30acb88700 1 -- 172.21.15.156:0/792295622 shutdown_connections 2023-09-30T22:19:49.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.987+0000 7f30acb88700 1 -- 172.21.15.156:0/792295622 wait complete. 2023-09-30T22:19:49.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.989+0000 7f30acb88700 1 Processor -- start 2023-09-30T22:19:49.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.989+0000 7f30acb88700 1 -- start start 2023-09-30T22:19:49.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.989+0000 7f30acb88700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f30a8133ad0 0x7f30a812cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:49.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.989+0000 7f30acb88700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a8136960 0x7f30a812d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:49.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.989+0000 7f30acb88700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30a8139280 0x7f30a812d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:49.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.989+0000 7f30acb88700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a8130660 con 0x7f30a8139280 2023-09-30T22:19:49.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.989+0000 7f30acb88700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a8130ce0 con 0x7f30a8136960 2023-09-30T22:19:49.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.989+0000 7f30acb88700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30a8072720 con 0x7f30a8133ad0 2023-09-30T22:19:49.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.990+0000 7f30a659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f30a8133ad0 0x7f30a812cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:49.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.990+0000 7f30a659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f30a8133ad0 0x7f30a812cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44068/0 (socket says 172.21.15.156:44068) 2023-09-30T22:19:49.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.990+0000 7f30a659c700 1 -- 172.21.15.156:0/3008505246 learned_addr learned my addr 172.21.15.156:0/3008505246 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:49.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.990+0000 7f30a5d9b700 1 --2- 172.21.15.156:0/3008505246 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a8136960 0x7f30a812d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:49.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.990+0000 7f30a5d9b700 1 -- 172.21.15.156:0/3008505246 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f30a8133ad0 msgr2=0x7f30a812cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.990+0000 7f30a5d9b700 1 --2- 172.21.15.156:0/3008505246 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f30a8133ad0 0x7f30a812cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:49.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.990+0000 7f30a5d9b700 1 -- 172.21.15.156:0/3008505246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30a8139280 msgr2=0x7f30a812d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.990+0000 7f30a5d9b700 1 --2- 172.21.15.156:0/3008505246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30a8139280 0x7f30a812d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:49.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.990+0000 7f30a5d9b700 1 -- 172.21.15.156:0/3008505246 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a0009b30 con 0x7f30a8136960 2023-09-30T22:19:49.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.990+0000 7f30a5d9b700 1 --2- 172.21.15.156:0/3008505246 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a8136960 0x7f30a812d070 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f309c00e870 tx=0x7f309c00eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:49.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.990+0000 7f3096ffd700 1 -- 172.21.15.156:0/3008505246 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309c013680 con 0x7f30a8136960 2023-09-30T22:19:49.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.990+0000 7f3096ffd700 1 -- 172.21.15.156:0/3008505246 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309c0137e0 con 0x7f30a8136960 2023-09-30T22:19:49.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.990+0000 7f30acb88700 1 -- 172.21.15.156:0/3008505246 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a81317a0 con 0x7f30a8136960 2023-09-30T22:19:49.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.990+0000 7f3096ffd700 1 -- 172.21.15.156:0/3008505246 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309c013b70 con 0x7f30a8136960 2023-09-30T22:19:49.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.990+0000 7f30acb88700 1 -- 172.21.15.156:0/3008505246 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a8070be0 con 0x7f30a8136960 2023-09-30T22:19:49.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.991+0000 7f3096ffd700 1 -- 172.21.15.156:0/3008505246 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f309c013cd0 con 0x7f30a8136960 2023-09-30T22:19:49.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.992+0000 7f3096ffd700 1 -- 172.21.15.156:0/3008505246 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f309c03f950 con 0x7f30a8136960 2023-09-30T22:19:49.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.992+0000 7f30acb88700 1 -- 172.21.15.156:0/3008505246 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a804f2a0 con 0x7f30a8136960 2023-09-30T22:19:49.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:49.997+0000 7f3096ffd700 1 -- 172.21.15.156:0/3008505246 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f309c011bd0 con 0x7f30a8136960 2023-09-30T22:19:50.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:50.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.068+0000 7fdb8036c700 1 -- 172.21.15.156:0/3373337501 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdb7809f0f0 con 0x7fdb78139280 2023-09-30T22:19:50.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.068+0000 7fdb6effd700 1 -- 172.21.15.156:0/3373337501 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb70011390 con 0x7fdb78139280 2023-09-30T22:19:50.069 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:50.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.070+0000 7fdb8036c700 1 -- 172.21.15.156:0/3373337501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb78139280 msgr2=0x7fdb7812d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:50.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.070+0000 7fdb8036c700 1 --2- 172.21.15.156:0/3373337501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb78139280 0x7fdb7812d5b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdb70014040 tx=0x7fdb70004ad0 comp rx=0 tx=0).stop 2023-09-30T22:19:50.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.070+0000 7fdb8036c700 1 -- 172.21.15.156:0/3373337501 shutdown_connections 2023-09-30T22:19:50.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.070+0000 7fdb8036c700 1 --2- 172.21.15.156:0/3373337501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb78139280 0x7fdb7812d5b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:50.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.070+0000 7fdb8036c700 1 --2- 172.21.15.156:0/3373337501 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb78133ad0 0x7fdb7812cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:50.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.070+0000 7fdb8036c700 1 --2- 172.21.15.156:0/3373337501 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb78136960 0x7fdb7812d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:50.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.070+0000 7fdb8036c700 1 -- 172.21.15.156:0/3373337501 >> 172.21.15.156:0/3373337501 conn(0x7fdb78099c40 msgr2=0x7fdb78134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:50.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.070+0000 7fdb8036c700 1 -- 172.21.15.156:0/3373337501 shutdown_connections 2023-09-30T22:19:50.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.070+0000 7fdb8036c700 1 -- 172.21.15.156:0/3373337501 wait complete. 2023-09-30T22:19:50.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:50.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.157+0000 7f8d5aaaa700 1 -- 172.21.15.156:0/3864217458 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8d5409a2c0 con 0x7f8d54134210 2023-09-30T22:19:50.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.157+0000 7f8d517fa700 1 -- 172.21.15.156:0/3864217458 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8d4c013380 con 0x7f8d54134210 2023-09-30T22:19:50.158 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:50.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.160+0000 7f8d5aaaa700 1 -- 172.21.15.156:0/3864217458 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d54134210 msgr2=0x7f8d5411b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:50.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.160+0000 7f8d5aaaa700 1 --2- 172.21.15.156:0/3864217458 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d54134210 0x7f8d5411b1c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c007e70 tx=0x7f8d4c00e3c0 comp rx=0 tx=0).stop 2023-09-30T22:19:50.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.160+0000 7f8d5aaaa700 1 -- 172.21.15.156:0/3864217458 shutdown_connections 2023-09-30T22:19:50.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.160+0000 7f8d5aaaa700 1 --2- 172.21.15.156:0/3864217458 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d54134210 0x7f8d5411b1c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:50.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.160+0000 7f8d5aaaa700 1 --2- 172.21.15.156:0/3864217458 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d540a0ee0 0x7f8d5411a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:50.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.160+0000 7f8d5aaaa700 1 --2- 172.21.15.156:0/3864217458 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d54133900 0x7f8d5411ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:50.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.160+0000 7f8d5aaaa700 1 -- 172.21.15.156:0/3864217458 >> 172.21.15.156:0/3864217458 conn(0x7f8d540a2980 msgr2=0x7f8d5412f740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:50.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.160+0000 7f8d5aaaa700 1 -- 172.21.15.156:0/3864217458 shutdown_connections 2023-09-30T22:19:50.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.160+0000 7f8d5aaaa700 1 -- 172.21.15.156:0/3864217458 wait complete. 2023-09-30T22:19:50.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:50.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.196+0000 7f30acb88700 1 -- 172.21.15.156:0/3008505246 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f30a80704b0 con 0x7f30a8136960 2023-09-30T22:19:50.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.197+0000 7f3096ffd700 1 -- 172.21.15.156:0/3008505246 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f309c017030 con 0x7f30a8136960 2023-09-30T22:19:50.198 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:50.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.199+0000 7f30acb88700 1 -- 172.21.15.156:0/3008505246 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a8136960 msgr2=0x7f30a812d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:50.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.199+0000 7f30acb88700 1 --2- 172.21.15.156:0/3008505246 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a8136960 0x7f30a812d070 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f309c00e870 tx=0x7f309c00eb80 comp rx=0 tx=0).stop 2023-09-30T22:19:50.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.199+0000 7f30acb88700 1 -- 172.21.15.156:0/3008505246 shutdown_connections 2023-09-30T22:19:50.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.199+0000 7f30acb88700 1 --2- 172.21.15.156:0/3008505246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30a8139280 0x7f30a812d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:50.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.199+0000 7f30acb88700 1 --2- 172.21.15.156:0/3008505246 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f30a8133ad0 0x7f30a812cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:50.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.199+0000 7f30acb88700 1 --2- 172.21.15.156:0/3008505246 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a8136960 0x7f30a812d070 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:50.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.199+0000 7f30acb88700 1 -- 172.21.15.156:0/3008505246 >> 172.21.15.156:0/3008505246 conn(0x7f30a8099c40 msgr2=0x7f30a8134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:50.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.199+0000 7f30acb88700 1 -- 172.21.15.156:0/3008505246 shutdown_connections 2023-09-30T22:19:50.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:50.199+0000 7f30acb88700 1 -- 172.21.15.156:0/3008505246 wait complete. 2023-09-30T22:19:50.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:51.007 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:51.084 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:51.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.143+0000 7fa82abf6700 1 Processor -- start 2023-09-30T22:19:51.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.143+0000 7fa82abf6700 1 -- start start 2023-09-30T22:19:51.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.143+0000 7fa82abf6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa8240a0a70 0x7fa8240a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:51.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.143+0000 7fa82abf6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa8240a1380 0x7fa824133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:51.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.143+0000 7fa82abf6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa824133f50 0x7fa824134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:51.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.143+0000 7fa82abf6700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa82409e9d0 con 0x7fa8240a1380 2023-09-30T22:19:51.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.143+0000 7fa82abf6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82409dc00 con 0x7fa824133f50 2023-09-30T22:19:51.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.143+0000 7fa82abf6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa82409dec0 con 0x7fa8240a0a70 2023-09-30T22:19:51.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.144+0000 7fa828992700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa8240a0a70 0x7fa8240a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:51.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.144+0000 7fa823fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa8240a1380 0x7fa824133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:51.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.144+0000 7fa828992700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa8240a0a70 0x7fa8240a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44086/0 (socket says 172.21.15.156:44086) 2023-09-30T22:19:51.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.144+0000 7fa823fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa8240a1380 0x7fa824133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51816/0 (socket says 172.21.15.156:51816) 2023-09-30T22:19:51.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.144+0000 7fa828992700 1 -- 172.21.15.156:0/1837334039 learned_addr learned my addr 172.21.15.156:0/1837334039 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:51.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.144+0000 7fa829193700 1 --2- 172.21.15.156:0/1837334039 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa824133f50 0x7fa824134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:51.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.144+0000 7fa823fff700 1 -- 172.21.15.156:0/1837334039 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa8240a0a70 msgr2=0x7fa8240a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:51.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.144+0000 7fa823fff700 1 --2- 172.21.15.156:0/1837334039 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa8240a0a70 0x7fa8240a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.144+0000 7fa823fff700 1 -- 172.21.15.156:0/1837334039 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa824133f50 msgr2=0x7fa824134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:51.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.144+0000 7fa823fff700 1 --2- 172.21.15.156:0/1837334039 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa824133f50 0x7fa824134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.144+0000 7fa823fff700 1 -- 172.21.15.156:0/1837334039 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82409e6a0 con 0x7fa8240a1380 2023-09-30T22:19:51.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.144+0000 7fa829193700 1 --2- 172.21.15.156:0/1837334039 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa824133f50 0x7fa824134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:51.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.144+0000 7fa823fff700 1 --2- 172.21.15.156:0/1837334039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa8240a1380 0x7fa824133a10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa810009840 tx=0x7fa810009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d5b1c621c16f05 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:51.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.144+0000 7fa8237fe700 1 -- 172.21.15.156:0/1837334039 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa810011830 con 0x7fa8240a1380 2023-09-30T22:19:51.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.144+0000 7fa8237fe700 1 -- 172.21.15.156:0/1837334039 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa810011990 con 0x7fa8240a1380 2023-09-30T22:19:51.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.144+0000 7fa8237fe700 1 -- 172.21.15.156:0/1837334039 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa810011d20 con 0x7fa8240a1380 2023-09-30T22:19:51.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.145+0000 7fa82abf6700 1 -- 172.21.15.156:0/1837334039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa8240a1380 msgr2=0x7fa824133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:51.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.145+0000 7fa82abf6700 1 --2- 172.21.15.156:0/1837334039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa8240a1380 0x7fa824133a10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa810009840 tx=0x7fa810009b50 comp rx=0 tx=0).stop 2023-09-30T22:19:51.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.145+0000 7fa82abf6700 1 -- 172.21.15.156:0/1837334039 shutdown_connections 2023-09-30T22:19:51.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.145+0000 7fa82abf6700 1 --2- 172.21.15.156:0/1837334039 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa824133f50 0x7fa824134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.145+0000 7fa82abf6700 1 --2- 172.21.15.156:0/1837334039 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa8240a0a70 0x7fa8240a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.145+0000 7fa82abf6700 1 --2- 172.21.15.156:0/1837334039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa8240a1380 0x7fa824133a10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.145+0000 7fa82abf6700 1 -- 172.21.15.156:0/1837334039 >> 172.21.15.156:0/1837334039 conn(0x7fa8240a6610 msgr2=0x7fa8240a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:51.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.145+0000 7fa82abf6700 1 -- 172.21.15.156:0/1837334039 shutdown_connections 2023-09-30T22:19:51.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.145+0000 7fa82abf6700 1 -- 172.21.15.156:0/1837334039 wait complete. 2023-09-30T22:19:51.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.146+0000 7fa82abf6700 1 Processor -- start 2023-09-30T22:19:51.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.146+0000 7fa82abf6700 1 -- start start 2023-09-30T22:19:51.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.146+0000 7fa82abf6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa8240a0a70 0x7fa824122390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:51.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.147+0000 7fa82abf6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8240a1380 0x7fa8241228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:51.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.147+0000 7fa82abf6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa824133f50 0x7fa824122e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:51.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.147+0000 7fa82abf6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa824133760 con 0x7fa8240a0a70 2023-09-30T22:19:51.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.147+0000 7fa82abf6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8241237f0 con 0x7fa8240a1380 2023-09-30T22:19:51.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.147+0000 7fa82abf6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa824124e30 con 0x7fa824133f50 2023-09-30T22:19:51.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.147+0000 7fa828992700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa8240a0a70 0x7fa824122390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:51.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.147+0000 7fa829193700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa824133f50 0x7fa824122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:51.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.147+0000 7fa828992700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa8240a0a70 0x7fa824122390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51832/0 (socket says 172.21.15.156:51832) 2023-09-30T22:19:51.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.147+0000 7fa828992700 1 -- 172.21.15.156:0/492331010 learned_addr learned my addr 172.21.15.156:0/492331010 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:51.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.147+0000 7fa823fff700 1 --2- 172.21.15.156:0/492331010 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8240a1380 0x7fa8241228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:51.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.147+0000 7fa828992700 1 -- 172.21.15.156:0/492331010 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa824133f50 msgr2=0x7fa824122e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:51.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.147+0000 7fa828992700 1 --2- 172.21.15.156:0/492331010 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa824133f50 0x7fa824122e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.147+0000 7fa828992700 1 -- 172.21.15.156:0/492331010 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8240a1380 msgr2=0x7fa8241228d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:51.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.147+0000 7fa828992700 1 --2- 172.21.15.156:0/492331010 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8240a1380 0x7fa8241228d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.147+0000 7fa828992700 1 -- 172.21.15.156:0/492331010 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c009a70 con 0x7fa8240a0a70 2023-09-30T22:19:51.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.147+0000 7fa829193700 1 --2- 172.21.15.156:0/492331010 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa824133f50 0x7fa824122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:51.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.147+0000 7fa828992700 1 --2- 172.21.15.156:0/492331010 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa8240a0a70 0x7fa824122390 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa81800e8a0 tx=0x7fa81800ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:51.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.147+0000 7fa8217fa700 1 -- 172.21.15.156:0/492331010 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa818013680 con 0x7fa8240a0a70 2023-09-30T22:19:51.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.147+0000 7fa8217fa700 1 -- 172.21.15.156:0/492331010 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8180137e0 con 0x7fa8240a0a70 2023-09-30T22:19:51.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.147+0000 7fa82abf6700 1 -- 172.21.15.156:0/492331010 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8100094a0 con 0x7fa8240a0a70 2023-09-30T22:19:51.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.147+0000 7fa8217fa700 1 -- 172.21.15.156:0/492331010 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa818013b50 con 0x7fa8240a0a70 2023-09-30T22:19:51.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.147+0000 7fa82abf6700 1 -- 172.21.15.156:0/492331010 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa824125c20 con 0x7fa8240a0a70 2023-09-30T22:19:51.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.148+0000 7fa8217fa700 1 -- 172.21.15.156:0/492331010 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa818013cb0 con 0x7fa8240a0a70 2023-09-30T22:19:51.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.148+0000 7fa8217fa700 1 -- 172.21.15.156:0/492331010 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa81803f330 con 0x7fa8240a0a70 2023-09-30T22:19:51.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.148+0000 7fa82abf6700 1 -- 172.21.15.156:0/492331010 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa824125c20 con 0x7fa8240a0a70 2023-09-30T22:19:51.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.153+0000 7fa8217fa700 1 -- 172.21.15.156:0/492331010 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa824125c20 con 0x7fa8240a0a70 2023-09-30T22:19:51.173 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:51.212 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:51.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.216+0000 7f02940cf700 1 Processor -- start 2023-09-30T22:19:51.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.216+0000 7f02940cf700 1 -- start start 2023-09-30T22:19:51.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.217+0000 7f02940cf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f028c09f350 0x7f028c136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:51.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.217+0000 7f02940cf700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f028c1371c0 0x7f028c1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:51.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.217+0000 7f02940cf700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f028c09c970 con 0x7f028c09e870 2023-09-30T22:19:51.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.217+0000 7f02940cf700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f028c0a0920 con 0x7f028c1371c0 2023-09-30T22:19:51.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.217+0000 7f02940cf700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f028c09f9c0 con 0x7f028c09f350 2023-09-30T22:19:51.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.217+0000 7f0291e6b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f028c09e870 0x7f028c09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:36270/0 (socket says 172.21.15.156:36270) 2023-09-30T22:19:51.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.217+0000 7f029266c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f028c1371c0 0x7f028c1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:51.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.217+0000 7f0291e6b700 1 -- 172.21.15.156:0/2690072399 learned_addr learned my addr 172.21.15.156:0/2690072399 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:51.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.217+0000 7f029166a700 1 --2- 172.21.15.156:0/2690072399 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f028c09f350 0x7f028c136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:51.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.218+0000 7f029266c700 1 -- 172.21.15.156:0/2690072399 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f028c09f350 msgr2=0x7f028c136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:51.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.218+0000 7f029266c700 1 --2- 172.21.15.156:0/2690072399 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f028c09f350 0x7f028c136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.218+0000 7f029266c700 1 -- 172.21.15.156:0/2690072399 >> v1:172.21.15.156:6789/0 conn(0x7f028c09e870 legacy=0x7f028c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:51.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.218+0000 7f0290e69700 1 -- 172.21.15.156:0/2690072399 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2429903118 0 0) 0x7f028c09c970 con 0x7f028c09e870 2023-09-30T22:19:51.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.218+0000 7f029266c700 1 -- 172.21.15.156:0/2690072399 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f028c09bab0 con 0x7f028c1371c0 2023-09-30T22:19:51.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.218+0000 7f029266c700 1 --2- 172.21.15.156:0/2690072399 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f028c1371c0 0x7f028c1395a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0284009d90 tx=0x7f028400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea52bd8413198e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:51.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.218+0000 7f0290e69700 1 -- 172.21.15.156:0/2690072399 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028400e070 con 0x7f028c1371c0 2023-09-30T22:19:51.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.218+0000 7f0290e69700 1 -- 172.21.15.156:0/2690072399 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028400bb20 con 0x7f028c1371c0 2023-09-30T22:19:51.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.218+0000 7f0290e69700 1 -- 172.21.15.156:0/2690072399 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0284012430 con 0x7f028c1371c0 2023-09-30T22:19:51.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.219+0000 7f02940cf700 1 -- 172.21.15.156:0/2690072399 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f028c1371c0 msgr2=0x7f028c1395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:51.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.219+0000 7f02940cf700 1 --2- 172.21.15.156:0/2690072399 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f028c1371c0 0x7f028c1395a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0284009d90 tx=0x7f028400b330 comp rx=0 tx=0).stop 2023-09-30T22:19:51.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.219+0000 7f02940cf700 1 -- 172.21.15.156:0/2690072399 shutdown_connections 2023-09-30T22:19:51.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.219+0000 7f02940cf700 1 --2- 172.21.15.156:0/2690072399 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f028c1371c0 0x7f028c1395a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.219+0000 7f02940cf700 1 --2- 172.21.15.156:0/2690072399 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f028c09f350 0x7f028c136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.219+0000 7f02940cf700 1 -- 172.21.15.156:0/2690072399 >> 172.21.15.156:0/2690072399 conn(0x7f028c0a4430 msgr2=0x7f028c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:51.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.219+0000 7f02940cf700 1 -- 172.21.15.156:0/2690072399 shutdown_connections 2023-09-30T22:19:51.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.219+0000 7f02940cf700 1 -- 172.21.15.156:0/2690072399 wait complete. 2023-09-30T22:19:51.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.221+0000 7f02940cf700 1 Processor -- start 2023-09-30T22:19:51.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.221+0000 7f02940cf700 1 -- start start 2023-09-30T22:19:51.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.221+0000 7f02940cf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f028c09e870 0x7f028c11e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:51.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.221+0000 7f02940cf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f028c09f350 0x7f028c11ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:51.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.221+0000 7f02940cf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f028c1371c0 0x7f028c11f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:51.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.221+0000 7f02940cf700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028c11fb70 con 0x7f028c1371c0 2023-09-30T22:19:51.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.221+0000 7f02940cf700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f028c136b50 con 0x7f028c09f350 2023-09-30T22:19:51.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.221+0000 7f02940cf700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f028c1221c0 con 0x7f028c09e870 2023-09-30T22:19:51.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.222+0000 7f0291e6b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f028c09e870 0x7f028c11e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:51.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.222+0000 7f029266c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f028c1371c0 0x7f028c11f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:51.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.222+0000 7f0291e6b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f028c09e870 0x7f028c11e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44112/0 (socket says 172.21.15.156:44112) 2023-09-30T22:19:51.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.222+0000 7f0291e6b700 1 -- 172.21.15.156:0/945496572 learned_addr learned my addr 172.21.15.156:0/945496572 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:51.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.222+0000 7f029166a700 1 --2- 172.21.15.156:0/945496572 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f028c09f350 0x7f028c11ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:51.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.222+0000 7f0291e6b700 1 -- 172.21.15.156:0/945496572 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f028c09f350 msgr2=0x7f028c11ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:51.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.222+0000 7f0291e6b700 1 --2- 172.21.15.156:0/945496572 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f028c09f350 0x7f028c11ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.222+0000 7f0291e6b700 1 -- 172.21.15.156:0/945496572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f028c1371c0 msgr2=0x7f028c11f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:51.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.222+0000 7f0291e6b700 1 --2- 172.21.15.156:0/945496572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f028c1371c0 0x7f028c11f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.222+0000 7f0291e6b700 1 -- 172.21.15.156:0/945496572 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0284009a70 con 0x7f028c09e870 2023-09-30T22:19:51.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.222+0000 7f0291e6b700 1 --2- 172.21.15.156:0/945496572 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f028c09e870 0x7f028c11e6a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f028800c550 tx=0x7f028800c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:51.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.222+0000 7f02827fc700 1 -- 172.21.15.156:0/945496572 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0288004c80 con 0x7f028c09e870 2023-09-30T22:19:51.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.222+0000 7f02827fc700 1 -- 172.21.15.156:0/945496572 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0288004e00 con 0x7f028c09e870 2023-09-30T22:19:51.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.222+0000 7f02827fc700 1 -- 172.21.15.156:0/945496572 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0288007310 con 0x7f028c09e870 2023-09-30T22:19:51.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.222+0000 7f02940cf700 1 -- 172.21.15.156:0/945496572 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f028c09dba0 con 0x7f028c09e870 2023-09-30T22:19:51.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.223+0000 7f02940cf700 1 -- 172.21.15.156:0/945496572 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f028c121c70 con 0x7f028c09e870 2023-09-30T22:19:51.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.223+0000 7f02940cf700 1 -- 172.21.15.156:0/945496572 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f028c04f2a0 con 0x7f028c09e870 2023-09-30T22:19:51.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.224+0000 7f02827fc700 1 -- 172.21.15.156:0/945496572 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0288007470 con 0x7f028c09e870 2023-09-30T22:19:51.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.224+0000 7f02827fc700 1 -- 172.21.15.156:0/945496572 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f028803f3e0 con 0x7f028c09e870 2023-09-30T22:19:51.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.229+0000 7f02827fc700 1 -- 172.21.15.156:0/945496572 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f02880106d0 con 0x7f028c09e870 2023-09-30T22:19:51.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.304+0000 7f0331dd4700 1 Processor -- start 2023-09-30T22:19:51.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.304+0000 7f0331dd4700 1 -- start start 2023-09-30T22:19:51.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.304+0000 7f0331dd4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f032c09e870 0x7f032c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:51.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.304+0000 7f0331dd4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f032c09f180 0x7f032c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:51.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.304+0000 7f0331dd4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f032c131d70 0x7f032c132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:51.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.304+0000 7f0331dd4700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f032c0a0920 con 0x7f032c09f180 2023-09-30T22:19:51.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.304+0000 7f0331dd4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f032c09c970 con 0x7f032c131d70 2023-09-30T22:19:51.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.304+0000 7f0331dd4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f032c09bab0 con 0x7f032c09e870 2023-09-30T22:19:51.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.304+0000 7f032affd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f032c09f180 0x7f032c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:51.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.304+0000 7f032affd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f032c09f180 0x7f032c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51138/0 (socket says 172.21.15.156:51138) 2023-09-30T22:19:51.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.304+0000 7f032affd700 1 -- 172.21.15.156:0/1748747516 learned_addr learned my addr 172.21.15.156:0/1748747516 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:51.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.304+0000 7f032b7fe700 1 --2- 172.21.15.156:0/1748747516 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f032c09e870 0x7f032c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:51.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.304+0000 7f032bfff700 1 --2- 172.21.15.156:0/1748747516 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f032c131d70 0x7f032c132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:51.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.305+0000 7f032affd700 1 -- 172.21.15.156:0/1748747516 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f032c09e870 msgr2=0x7f032c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:51.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.305+0000 7f032affd700 1 --2- 172.21.15.156:0/1748747516 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f032c09e870 0x7f032c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.305+0000 7f032affd700 1 -- 172.21.15.156:0/1748747516 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f032c131d70 msgr2=0x7f032c132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:51.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.305+0000 7f032affd700 1 --2- 172.21.15.156:0/1748747516 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f032c131d70 0x7f032c132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.305+0000 7f032affd700 1 -- 172.21.15.156:0/1748747516 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f032c09f9c0 con 0x7f032c09f180 2023-09-30T22:19:51.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.305+0000 7f032affd700 1 --2- 172.21.15.156:0/1748747516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f032c09f180 0x7f032c131830 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0320009920 tx=0x7f0320009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47720d66040abee server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:51.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.305+0000 7f032a7fc700 1 -- 172.21.15.156:0/1748747516 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0320011830 con 0x7f032c09f180 2023-09-30T22:19:51.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.305+0000 7f032a7fc700 1 -- 172.21.15.156:0/1748747516 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0320011990 con 0x7f032c09f180 2023-09-30T22:19:51.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.305+0000 7f032a7fc700 1 -- 172.21.15.156:0/1748747516 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0320011d20 con 0x7f032c09f180 2023-09-30T22:19:51.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.306+0000 7f0331dd4700 1 -- 172.21.15.156:0/1748747516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f032c09f180 msgr2=0x7f032c131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:51.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.306+0000 7f0331dd4700 1 --2- 172.21.15.156:0/1748747516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f032c09f180 0x7f032c131830 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0320009920 tx=0x7f0320009c30 comp rx=0 tx=0).stop 2023-09-30T22:19:51.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.306+0000 7f0331dd4700 1 -- 172.21.15.156:0/1748747516 shutdown_connections 2023-09-30T22:19:51.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.306+0000 7f0331dd4700 1 --2- 172.21.15.156:0/1748747516 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f032c131d70 0x7f032c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.306+0000 7f0331dd4700 1 --2- 172.21.15.156:0/1748747516 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f032c09e870 0x7f032c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.306+0000 7f0331dd4700 1 --2- 172.21.15.156:0/1748747516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f032c09f180 0x7f032c131830 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.306+0000 7f0331dd4700 1 -- 172.21.15.156:0/1748747516 >> 172.21.15.156:0/1748747516 conn(0x7f032c0a4430 msgr2=0x7f032c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:51.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.306+0000 7f0331dd4700 1 -- 172.21.15.156:0/1748747516 shutdown_connections 2023-09-30T22:19:51.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.306+0000 7f0331dd4700 1 -- 172.21.15.156:0/1748747516 wait complete. 2023-09-30T22:19:51.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.307+0000 7f0331dd4700 1 Processor -- start 2023-09-30T22:19:51.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.307+0000 7f0331dd4700 1 -- start start 2023-09-30T22:19:51.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.307+0000 7f0331dd4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f032c09e870 0x7f032c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:51.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.307+0000 7f0331dd4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f032c09f180 0x7f032c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:51.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.307+0000 7f0331dd4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f032c131d70 0x7f032c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:51.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.307+0000 7f0331dd4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032c0a2bf0 con 0x7f032c09f180 2023-09-30T22:19:51.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.307+0000 7f0331dd4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f032c0a0210 con 0x7f032c131d70 2023-09-30T22:19:51.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.307+0000 7f0331dd4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f032c125200 con 0x7f032c09e870 2023-09-30T22:19:51.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.307+0000 7f032b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f032c09e870 0x7f032c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:51.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.307+0000 7f032b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f032c09e870 0x7f032c06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48530/0 (socket says 172.21.15.156:48530) 2023-09-30T22:19:51.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.307+0000 7f032b7fe700 1 -- 172.21.15.156:0/1570480765 learned_addr learned my addr 172.21.15.156:0/1570480765 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:51.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.307+0000 7f032affd700 1 --2- 172.21.15.156:0/1570480765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f032c09f180 0x7f032c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:51.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.308+0000 7f032bfff700 1 --2- 172.21.15.156:0/1570480765 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f032c131d70 0x7f032c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:51.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.308+0000 7f032affd700 1 -- 172.21.15.156:0/1570480765 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f032c09e870 msgr2=0x7f032c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:51.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.308+0000 7f032affd700 1 --2- 172.21.15.156:0/1570480765 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f032c09e870 0x7f032c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.308+0000 7f032affd700 1 -- 172.21.15.156:0/1570480765 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f032c131d70 msgr2=0x7f032c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:51.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.308+0000 7f032affd700 1 --2- 172.21.15.156:0/1570480765 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f032c131d70 0x7f032c06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.308+0000 7f032affd700 1 -- 172.21.15.156:0/1570480765 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0320009550 con 0x7f032c09f180 2023-09-30T22:19:51.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.308+0000 7f032affd700 1 --2- 172.21.15.156:0/1570480765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f032c09f180 0x7f032c06bdf0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0320016000 tx=0x7f0320004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:51.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.308+0000 7f0313fff700 1 -- 172.21.15.156:0/1570480765 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0320004450 con 0x7f032c09f180 2023-09-30T22:19:51.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.308+0000 7f0313fff700 1 -- 172.21.15.156:0/1570480765 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032001f070 con 0x7f032c09f180 2023-09-30T22:19:51.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.308+0000 7f0313fff700 1 -- 172.21.15.156:0/1570480765 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03200038e0 con 0x7f032c09f180 2023-09-30T22:19:51.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.309+0000 7f0331dd4700 1 -- 172.21.15.156:0/1570480765 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f032c06cc80 con 0x7f032c09f180 2023-09-30T22:19:51.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.309+0000 7f0331dd4700 1 -- 172.21.15.156:0/1570480765 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f032c124710 con 0x7f032c09f180 2023-09-30T22:19:51.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.310+0000 7f0313fff700 1 -- 172.21.15.156:0/1570480765 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0320003a40 con 0x7f032c09f180 2023-09-30T22:19:51.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.310+0000 7f0313fff700 1 -- 172.21.15.156:0/1570480765 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0320021070 con 0x7f032c09f180 2023-09-30T22:19:51.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.310+0000 7f0331dd4700 1 -- 172.21.15.156:0/1570480765 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f032c04f2a0 con 0x7f032c09f180 2023-09-30T22:19:51.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.315+0000 7f0313fff700 1 -- 172.21.15.156:0/1570480765 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0320015080 con 0x7f032c09f180 2023-09-30T22:19:51.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.353+0000 7fa82abf6700 1 -- 172.21.15.156:0/492331010 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa824125c20 con 0x7fa8240a0a70 2023-09-30T22:19:51.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.353+0000 7fa8217fa700 1 -- 172.21.15.156:0/492331010 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa824125c20 con 0x7fa8240a0a70 2023-09-30T22:19:51.354 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:51.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.357+0000 7fa82abf6700 1 -- 172.21.15.156:0/492331010 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa8240a0a70 msgr2=0x7fa824122390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:51.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.357+0000 7fa82abf6700 1 --2- 172.21.15.156:0/492331010 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa8240a0a70 0x7fa824122390 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa81800e8a0 tx=0x7fa81800ebb0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.357+0000 7fa82abf6700 1 -- 172.21.15.156:0/492331010 shutdown_connections 2023-09-30T22:19:51.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.357+0000 7fa82abf6700 1 --2- 172.21.15.156:0/492331010 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa824133f50 0x7fa824122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.357+0000 7fa82abf6700 1 --2- 172.21.15.156:0/492331010 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa8240a0a70 0x7fa824122390 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.357+0000 7fa82abf6700 1 --2- 172.21.15.156:0/492331010 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8240a1380 0x7fa8241228d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.357+0000 7fa82abf6700 1 -- 172.21.15.156:0/492331010 >> 172.21.15.156:0/492331010 conn(0x7fa8240a6610 msgr2=0x7fa82411c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:51.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.358+0000 7fa82abf6700 1 -- 172.21.15.156:0/492331010 shutdown_connections 2023-09-30T22:19:51.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.358+0000 7fa82abf6700 1 -- 172.21.15.156:0/492331010 wait complete. 2023-09-30T22:19:51.371 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:51.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.381+0000 7fd374c84700 1 Processor -- start 2023-09-30T22:19:51.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.381+0000 7fd374c84700 1 -- start start 2023-09-30T22:19:51.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.382+0000 7fd374c84700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd37009ad40 0x7fd370133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:51.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.382+0000 7fd374c84700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3701343d0 0x7fd3700a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:51.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.382+0000 7fd374c84700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd37009b110 con 0x7fd370133f70 2023-09-30T22:19:51.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.382+0000 7fd374c84700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3700a3b60 con 0x7fd37009ad40 2023-09-30T22:19:51.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.382+0000 7fd374c84700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd370134850 con 0x7fd3701343d0 2023-09-30T22:19:51.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.382+0000 7fd36ed9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3701343d0 0x7fd3700a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:51.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.382+0000 7fd36dd9b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fd370133f70 0x7fd3700a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53152/0 (socket says 172.21.15.156:53152) 2023-09-30T22:19:51.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.382+0000 7fd36dd9b700 1 -- 172.21.15.156:0/1251991239 learned_addr learned my addr 172.21.15.156:0/1251991239 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:51.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.382+0000 7fd36e59c700 1 --2- 172.21.15.156:0/1251991239 >> v2:172.21.15.156:3300/0 conn(0x7fd37009ad40 0x7fd370133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:51.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.382+0000 7fd36e59c700 1 -- 172.21.15.156:0/1251991239 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3701343d0 msgr2=0x7fd3700a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:51.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.382+0000 7fd36e59c700 1 --2- 172.21.15.156:0/1251991239 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3701343d0 0x7fd3700a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.382+0000 7fd36e59c700 1 -- 172.21.15.156:0/1251991239 >> v1:172.21.15.156:6789/0 conn(0x7fd370133f70 legacy=0x7fd3700a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:51.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.382+0000 7fd36d59a700 1 -- 172.21.15.156:0/1251991239 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577024107 0 0) 0x7fd37009b110 con 0x7fd370133f70 2023-09-30T22:19:51.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.382+0000 7fd36e59c700 1 -- 172.21.15.156:0/1251991239 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3700a2fa0 con 0x7fd37009ad40 2023-09-30T22:19:51.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.382+0000 7fd36ed9d700 1 --2- 172.21.15.156:0/1251991239 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3701343d0 0x7fd3700a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:51.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.383+0000 7fd36e59c700 1 --2- 172.21.15.156:0/1251991239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd37009ad40 0x7fd370133a30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd360009840 tx=0x7fd360009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17d123ece814d0e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:51.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.383+0000 7fd36d59a700 1 -- 172.21.15.156:0/1251991239 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd360011830 con 0x7fd37009ad40 2023-09-30T22:19:51.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.383+0000 7fd36d59a700 1 -- 172.21.15.156:0/1251991239 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd360011990 con 0x7fd37009ad40 2023-09-30T22:19:51.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.383+0000 7fd36d59a700 1 -- 172.21.15.156:0/1251991239 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd360011d20 con 0x7fd37009ad40 2023-09-30T22:19:51.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.383+0000 7fd374c84700 1 -- 172.21.15.156:0/1251991239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd37009ad40 msgr2=0x7fd370133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:51.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.383+0000 7fd374c84700 1 --2- 172.21.15.156:0/1251991239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd37009ad40 0x7fd370133a30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd360009840 tx=0x7fd360009b50 comp rx=0 tx=0).stop 2023-09-30T22:19:51.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.383+0000 7fd374c84700 1 -- 172.21.15.156:0/1251991239 shutdown_connections 2023-09-30T22:19:51.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.383+0000 7fd374c84700 1 --2- 172.21.15.156:0/1251991239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd37009ad40 0x7fd370133a30 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.383+0000 7fd374c84700 1 --2- 172.21.15.156:0/1251991239 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3701343d0 0x7fd3700a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.383+0000 7fd374c84700 1 -- 172.21.15.156:0/1251991239 >> 172.21.15.156:0/1251991239 conn(0x7fd370099c40 msgr2=0x7fd37006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:51.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.384+0000 7fd374c84700 1 -- 172.21.15.156:0/1251991239 shutdown_connections 2023-09-30T22:19:51.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.384+0000 7fd374c84700 1 -- 172.21.15.156:0/1251991239 wait complete. 2023-09-30T22:19:51.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.385+0000 7fd374c84700 1 Processor -- start 2023-09-30T22:19:51.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.385+0000 7fd374c84700 1 -- start start 2023-09-30T22:19:51.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.385+0000 7fd374c84700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd37009ad40 0x7fd37011ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:51.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.385+0000 7fd374c84700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd370133f70 0x7fd37011ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:51.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.385+0000 7fd374c84700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3701343d0 0x7fd37011f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:51.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.385+0000 7fd374c84700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd370120780 con 0x7fd370133f70 2023-09-30T22:19:51.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.385+0000 7fd374c84700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd370120590 con 0x7fd37009ad40 2023-09-30T22:19:51.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.385+0000 7fd374c84700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3701224a0 con 0x7fd3701343d0 2023-09-30T22:19:51.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.385+0000 7fd36dd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd370133f70 0x7fd37011ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:51.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.385+0000 7fd36e59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd37009ad40 0x7fd37011ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:51.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.385+0000 7fd36dd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd370133f70 0x7fd37011ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51158/0 (socket says 172.21.15.156:51158) 2023-09-30T22:19:51.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.385+0000 7fd36dd9b700 1 -- 172.21.15.156:0/2616269260 learned_addr learned my addr 172.21.15.156:0/2616269260 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:51.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.385+0000 7fd36ed9d700 1 --2- 172.21.15.156:0/2616269260 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3701343d0 0x7fd37011f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:51.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.385+0000 7fd36dd9b700 1 -- 172.21.15.156:0/2616269260 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3701343d0 msgr2=0x7fd37011f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:51.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.385+0000 7fd36dd9b700 1 --2- 172.21.15.156:0/2616269260 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3701343d0 0x7fd37011f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.385+0000 7fd36dd9b700 1 -- 172.21.15.156:0/2616269260 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd37009ad40 msgr2=0x7fd37011ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:51.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.385+0000 7fd36dd9b700 1 --2- 172.21.15.156:0/2616269260 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd37009ad40 0x7fd37011ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.386+0000 7fd36dd9b700 1 -- 172.21.15.156:0/2616269260 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd368009a70 con 0x7fd370133f70 2023-09-30T22:19:51.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.386+0000 7fd36e59c700 1 --2- 172.21.15.156:0/2616269260 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd37009ad40 0x7fd37011ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:51.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.386+0000 7fd36dd9b700 1 --2- 172.21.15.156:0/2616269260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd370133f70 0x7fd37011ef60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd36400c550 tx=0x7fd36400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:51.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.386+0000 7fd35effd700 1 -- 172.21.15.156:0/2616269260 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd364004c80 con 0x7fd370133f70 2023-09-30T22:19:51.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.386+0000 7fd35effd700 1 -- 172.21.15.156:0/2616269260 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd364004e00 con 0x7fd370133f70 2023-09-30T22:19:51.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.386+0000 7fd374c84700 1 -- 172.21.15.156:0/2616269260 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3600094a0 con 0x7fd370133f70 2023-09-30T22:19:51.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.386+0000 7fd35effd700 1 -- 172.21.15.156:0/2616269260 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd364007310 con 0x7fd370133f70 2023-09-30T22:19:51.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.386+0000 7fd374c84700 1 -- 172.21.15.156:0/2616269260 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3701221c0 con 0x7fd370133f70 2023-09-30T22:19:51.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.387+0000 7fd374c84700 1 -- 172.21.15.156:0/2616269260 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd37004f2a0 con 0x7fd370133f70 2023-09-30T22:19:51.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.387+0000 7fd35effd700 1 -- 172.21.15.156:0/2616269260 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd364007470 con 0x7fd370133f70 2023-09-30T22:19:51.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.387+0000 7fd35effd700 1 -- 172.21.15.156:0/2616269260 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd36403f280 con 0x7fd370133f70 2023-09-30T22:19:51.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.396+0000 7fd35effd700 1 -- 172.21.15.156:0/2616269260 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd3640133c0 con 0x7fd370133f70 2023-09-30T22:19:51.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.473+0000 7f02940cf700 1 -- 172.21.15.156:0/945496572 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f028c06b2a0 con 0x7f028c09e870 2023-09-30T22:19:51.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.474+0000 7f02827fc700 1 -- 172.21.15.156:0/945496572 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0288011360 con 0x7f028c09e870 2023-09-30T22:19:51.474 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:51.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.477+0000 7f02940cf700 1 -- 172.21.15.156:0/945496572 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f028c09e870 msgr2=0x7f028c11e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:51.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.477+0000 7f02940cf700 1 --2- 172.21.15.156:0/945496572 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f028c09e870 0x7f028c11e6a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f028800c550 tx=0x7f028800c860 comp rx=0 tx=0).stop 2023-09-30T22:19:51.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.477+0000 7f02940cf700 1 -- 172.21.15.156:0/945496572 shutdown_connections 2023-09-30T22:19:51.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.477+0000 7f02940cf700 1 --2- 172.21.15.156:0/945496572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f028c1371c0 0x7f028c11f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.477+0000 7f02940cf700 1 --2- 172.21.15.156:0/945496572 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f028c09e870 0x7f028c11e6a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.477+0000 7f02940cf700 1 --2- 172.21.15.156:0/945496572 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f028c09f350 0x7f028c11ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.477+0000 7f02940cf700 1 -- 172.21.15.156:0/945496572 >> 172.21.15.156:0/945496572 conn(0x7f028c0a4430 msgr2=0x7f028c0a2880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:51.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.477+0000 7f02940cf700 1 -- 172.21.15.156:0/945496572 shutdown_connections 2023-09-30T22:19:51.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.477+0000 7f02940cf700 1 -- 172.21.15.156:0/945496572 wait complete. 2023-09-30T22:19:51.494 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:51.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.522+0000 7f0331dd4700 1 -- 172.21.15.156:0/1570480765 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f032c09f660 con 0x7f032c09f180 2023-09-30T22:19:51.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.523+0000 7f0313fff700 1 -- 172.21.15.156:0/1570480765 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f032002a020 con 0x7f032c09f180 2023-09-30T22:19:51.524 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:51.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.525+0000 7f0331dd4700 1 -- 172.21.15.156:0/1570480765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f032c09f180 msgr2=0x7f032c06bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:51.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.525+0000 7f0331dd4700 1 --2- 172.21.15.156:0/1570480765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f032c09f180 0x7f032c06bdf0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0320016000 tx=0x7f0320004750 comp rx=0 tx=0).stop 2023-09-30T22:19:51.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.525+0000 7f0331dd4700 1 -- 172.21.15.156:0/1570480765 shutdown_connections 2023-09-30T22:19:51.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.525+0000 7f0331dd4700 1 --2- 172.21.15.156:0/1570480765 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f032c131d70 0x7f032c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.525+0000 7f0331dd4700 1 --2- 172.21.15.156:0/1570480765 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f032c09e870 0x7f032c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.525+0000 7f0331dd4700 1 --2- 172.21.15.156:0/1570480765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f032c09f180 0x7f032c06bdf0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.525+0000 7f0331dd4700 1 -- 172.21.15.156:0/1570480765 >> 172.21.15.156:0/1570480765 conn(0x7f032c0a4430 msgr2=0x7f032c11a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:51.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.525+0000 7f0331dd4700 1 -- 172.21.15.156:0/1570480765 shutdown_connections 2023-09-30T22:19:51.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.525+0000 7f0331dd4700 1 -- 172.21.15.156:0/1570480765 wait complete. 2023-09-30T22:19:51.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:51.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.590+0000 7fd374c84700 1 -- 172.21.15.156:0/2616269260 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd370120d80 con 0x7fd370133f70 2023-09-30T22:19:51.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.590+0000 7fd35effd700 1 -- 172.21.15.156:0/2616269260 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd364011360 con 0x7fd370133f70 2023-09-30T22:19:51.591 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:51.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.593+0000 7fd374c84700 1 -- 172.21.15.156:0/2616269260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd370133f70 msgr2=0x7fd37011ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:51.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.593+0000 7fd374c84700 1 --2- 172.21.15.156:0/2616269260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd370133f70 0x7fd37011ef60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd36400c550 tx=0x7fd36400c860 comp rx=0 tx=0).stop 2023-09-30T22:19:51.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.593+0000 7fd374c84700 1 -- 172.21.15.156:0/2616269260 shutdown_connections 2023-09-30T22:19:51.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.593+0000 7fd374c84700 1 --2- 172.21.15.156:0/2616269260 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3701343d0 0x7fd37011f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.593+0000 7fd374c84700 1 --2- 172.21.15.156:0/2616269260 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd37009ad40 0x7fd37011ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.593+0000 7fd374c84700 1 --2- 172.21.15.156:0/2616269260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd370133f70 0x7fd37011ef60 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:51.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.593+0000 7fd374c84700 1 -- 172.21.15.156:0/2616269260 >> 172.21.15.156:0/2616269260 conn(0x7fd370099c40 msgr2=0x7fd3701bbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:51.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.593+0000 7fd374c84700 1 -- 172.21.15.156:0/2616269260 shutdown_connections 2023-09-30T22:19:51.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:51.593+0000 7fd374c84700 1 -- 172.21.15.156:0/2616269260 wait complete. 2023-09-30T22:19:51.605 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:52.372 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:52.496 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:52.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.503+0000 7f7639530700 1 Processor -- start 2023-09-30T22:19:52.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.503+0000 7f7639530700 1 -- start start 2023-09-30T22:19:52.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.504+0000 7f7639530700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f76341335f0 0x7f76341359d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:52.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.504+0000 7f7639530700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7634135f10 0x7f76341382f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:52.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.504+0000 7f7639530700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f763409bb90 con 0x7f763412d380 2023-09-30T22:19:52.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.504+0000 7f7639530700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763409c210 con 0x7f7634135f10 2023-09-30T22:19:52.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.504+0000 7f7639530700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f763409ced0 con 0x7f76341335f0 2023-09-30T22:19:52.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.504+0000 7f7632ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f763412d380 0x7f763412d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53162/0 (socket says 172.21.15.156:53162) 2023-09-30T22:19:52.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.504+0000 7f7632ffd700 1 -- 172.21.15.156:0/2157169431 learned_addr learned my addr 172.21.15.156:0/2157169431 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:52.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.504+0000 7f76327fc700 1 --2- 172.21.15.156:0/2157169431 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f76341335f0 0x7f76341359d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:52.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.505+0000 7f76327fc700 1 -- 172.21.15.156:0/2157169431 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7634135f10 msgr2=0x7f76341382f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:52.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.505+0000 7f76337fe700 1 --2- 172.21.15.156:0/2157169431 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7634135f10 0x7f76341382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:52.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.505+0000 7f76327fc700 1 --2- 172.21.15.156:0/2157169431 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7634135f10 0x7f76341382f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.505+0000 7f76327fc700 1 -- 172.21.15.156:0/2157169431 >> v1:172.21.15.156:6789/0 conn(0x7f763412d380 legacy=0x7f763412d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:52.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.505+0000 7f76327fc700 1 -- 172.21.15.156:0/2157169431 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763409ac30 con 0x7f76341335f0 2023-09-30T22:19:52.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.505+0000 7f76337fe700 1 --2- 172.21.15.156:0/2157169431 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7634135f10 0x7f76341382f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:19:52.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.505+0000 7f76327fc700 1 --2- 172.21.15.156:0/2157169431 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f76341335f0 0x7f76341359d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7624009870 tx=0x7f7624009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0b473d9eb75d40e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:52.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.505+0000 7f7631ffb700 1 -- 172.21.15.156:0/2157169431 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7624011830 con 0x7f76341335f0 2023-09-30T22:19:52.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.505+0000 7f7631ffb700 1 -- 172.21.15.156:0/2157169431 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7624011990 con 0x7f76341335f0 2023-09-30T22:19:52.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.505+0000 7f7631ffb700 1 -- 172.21.15.156:0/2157169431 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7624011d20 con 0x7f76341335f0 2023-09-30T22:19:52.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.506+0000 7f7639530700 1 -- 172.21.15.156:0/2157169431 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f76341335f0 msgr2=0x7f76341359d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:52.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.506+0000 7f7639530700 1 --2- 172.21.15.156:0/2157169431 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f76341335f0 0x7f76341359d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7624009870 tx=0x7f7624009b80 comp rx=0 tx=0).stop 2023-09-30T22:19:52.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.506+0000 7f7639530700 1 -- 172.21.15.156:0/2157169431 shutdown_connections 2023-09-30T22:19:52.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.506+0000 7f7639530700 1 --2- 172.21.15.156:0/2157169431 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7634135f10 0x7f76341382f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.506+0000 7f7639530700 1 --2- 172.21.15.156:0/2157169431 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f76341335f0 0x7f76341359d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.506+0000 7f7639530700 1 -- 172.21.15.156:0/2157169431 >> 172.21.15.156:0/2157169431 conn(0x7f76340a2980 msgr2=0x7f76340a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:52.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.506+0000 7f7639530700 1 -- 172.21.15.156:0/2157169431 shutdown_connections 2023-09-30T22:19:52.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.506+0000 7f7639530700 1 -- 172.21.15.156:0/2157169431 wait complete. 2023-09-30T22:19:52.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.507+0000 7f7639530700 1 Processor -- start 2023-09-30T22:19:52.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.507+0000 7f7639530700 1 -- start start 2023-09-30T22:19:52.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.507+0000 7f7639530700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f763412d380 0x7f763412ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:52.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.507+0000 7f7639530700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f76341335f0 0x7f763412b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:52.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.508+0000 7f7639530700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7634135f10 0x7f76340701b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:52.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.508+0000 7f7639530700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7634134f80 con 0x7f763412d380 2023-09-30T22:19:52.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.508+0000 7f7639530700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7634135a40 con 0x7f7634135f10 2023-09-30T22:19:52.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.508+0000 7f7639530700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7634071c40 con 0x7f76341335f0 2023-09-30T22:19:52.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.508+0000 7f76337fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7634135f10 0x7f76340701b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:52.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.508+0000 7f76327fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f76341335f0 0x7f763412b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:52.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.508+0000 7f76337fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7634135f10 0x7f76340701b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:36818/0 (socket says 172.21.15.156:36818) 2023-09-30T22:19:52.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.508+0000 7f76337fe700 1 -- 172.21.15.156:0/4134141539 learned_addr learned my addr 172.21.15.156:0/4134141539 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:52.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.508+0000 7f7632ffd700 1 --2- 172.21.15.156:0/4134141539 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f763412d380 0x7f763412ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:52.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.508+0000 7f76337fe700 1 -- 172.21.15.156:0/4134141539 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f76341335f0 msgr2=0x7f763412b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:52.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.508+0000 7f76337fe700 1 --2- 172.21.15.156:0/4134141539 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f76341335f0 0x7f763412b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.508+0000 7f76337fe700 1 -- 172.21.15.156:0/4134141539 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f763412d380 msgr2=0x7f763412ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:52.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.508+0000 7f76337fe700 1 --2- 172.21.15.156:0/4134141539 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f763412d380 0x7f763412ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.508+0000 7f76337fe700 1 -- 172.21.15.156:0/4134141539 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76240094a0 con 0x7f7634135f10 2023-09-30T22:19:52.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.508+0000 7f76327fc700 1 --2- 172.21.15.156:0/4134141539 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f76341335f0 0x7f763412b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:52.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.508+0000 7f7632ffd700 1 --2- 172.21.15.156:0/4134141539 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f763412d380 0x7f763412ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:52.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.508+0000 7f76337fe700 1 --2- 172.21.15.156:0/4134141539 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7634135f10 0x7f76340701b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f761c00c7f0 tx=0x7f761c00cb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:52.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.508+0000 7f762b7fe700 1 -- 172.21.15.156:0/4134141539 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761c011800 con 0x7f7634135f10 2023-09-30T22:19:52.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.508+0000 7f762b7fe700 1 -- 172.21.15.156:0/4134141539 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761c011960 con 0x7f7634135f10 2023-09-30T22:19:52.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.508+0000 7f7639530700 1 -- 172.21.15.156:0/4134141539 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7634135160 con 0x7f7634135f10 2023-09-30T22:19:52.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.508+0000 7f762b7fe700 1 -- 172.21.15.156:0/4134141539 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761c011d10 con 0x7f7634135f10 2023-09-30T22:19:52.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.508+0000 7f7639530700 1 -- 172.21.15.156:0/4134141539 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f763412b8d0 con 0x7f7634135f10 2023-09-30T22:19:52.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.509+0000 7f7639530700 1 -- 172.21.15.156:0/4134141539 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f763404f2a0 con 0x7f7634135f10 2023-09-30T22:19:52.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.510+0000 7f762b7fe700 1 -- 172.21.15.156:0/4134141539 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f761c024480 con 0x7f7634135f10 2023-09-30T22:19:52.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.510+0000 7f762b7fe700 1 -- 172.21.15.156:0/4134141539 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f761c03f9c0 con 0x7f7634135f10 2023-09-30T22:19:52.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.515+0000 7f762b7fe700 1 -- 172.21.15.156:0/4134141539 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f761c0193b0 con 0x7f7634135f10 2023-09-30T22:19:52.538 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:52.606 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:52.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.627+0000 7f07ba18b700 1 Processor -- start 2023-09-30T22:19:52.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.627+0000 7f07ba18b700 1 -- start start 2023-09-30T22:19:52.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.628+0000 7f07ba18b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07b406a770 0x7f07b41349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:52.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.628+0000 7f07ba18b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f07b4134f00 0x7f07b409d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:52.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.628+0000 7f07ba18b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07b409dea0 0x7f07b409e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:52.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.628+0000 7f07ba18b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b406b2e0 con 0x7f07b4134f00 2023-09-30T22:19:52.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.628+0000 7f07ba18b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b409eca0 con 0x7f07b409dea0 2023-09-30T22:19:52.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.628+0000 7f07ba18b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07b409f720 con 0x7f07b406a770 2023-09-30T22:19:52.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.628+0000 7f07b37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07b406a770 0x7f07b41349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:52.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.628+0000 7f07b37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07b406a770 0x7f07b41349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48570/0 (socket says 172.21.15.156:48570) 2023-09-30T22:19:52.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.628+0000 7f07b37fe700 1 -- 172.21.15.156:0/247136059 learned_addr learned my addr 172.21.15.156:0/247136059 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:52.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.628+0000 7f07b3fff700 1 --2- 172.21.15.156:0/247136059 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07b409dea0 0x7f07b409e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:52.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.628+0000 7f07b37fe700 1 -- 172.21.15.156:0/247136059 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07b409dea0 msgr2=0x7f07b409e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:52.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.628+0000 7f07b37fe700 1 --2- 172.21.15.156:0/247136059 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07b409dea0 0x7f07b409e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.628+0000 7f07b37fe700 1 -- 172.21.15.156:0/247136059 >> v2:172.21.15.156:3300/0 conn(0x7f07b4134f00 msgr2=0x7f07b409d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:52.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.628+0000 7f07b37fe700 1 --2- 172.21.15.156:0/247136059 >> v2:172.21.15.156:3300/0 conn(0x7f07b4134f00 0x7f07b409d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.628+0000 7f07b37fe700 1 -- 172.21.15.156:0/247136059 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b406b480 con 0x7f07b406a770 2023-09-30T22:19:52.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.629+0000 7f07b37fe700 1 --2- 172.21.15.156:0/247136059 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07b406a770 0x7f07b41349c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f07a40098f0 tx=0x7f07a4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7d5d84a518212eb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:52.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.629+0000 7f07b27fc700 1 -- 172.21.15.156:0/247136059 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a4011830 con 0x7f07b406a770 2023-09-30T22:19:52.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.629+0000 7f07b27fc700 1 -- 172.21.15.156:0/247136059 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a4011990 con 0x7f07b406a770 2023-09-30T22:19:52.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.629+0000 7f07b27fc700 1 -- 172.21.15.156:0/247136059 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a4011d20 con 0x7f07b406a770 2023-09-30T22:19:52.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.629+0000 7f07ba18b700 1 -- 172.21.15.156:0/247136059 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07b406a770 msgr2=0x7f07b41349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:52.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.629+0000 7f07ba18b700 1 --2- 172.21.15.156:0/247136059 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07b406a770 0x7f07b41349c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f07a40098f0 tx=0x7f07a4009c00 comp rx=0 tx=0).stop 2023-09-30T22:19:52.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.630+0000 7f07ba18b700 1 -- 172.21.15.156:0/247136059 shutdown_connections 2023-09-30T22:19:52.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.630+0000 7f07ba18b700 1 --2- 172.21.15.156:0/247136059 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07b409dea0 0x7f07b409e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.630+0000 7f07ba18b700 1 --2- 172.21.15.156:0/247136059 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07b406a770 0x7f07b41349c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.630+0000 7f07ba18b700 1 --2- 172.21.15.156:0/247136059 >> v2:172.21.15.156:3300/0 conn(0x7f07b4134f00 0x7f07b409d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.630+0000 7f07ba18b700 1 -- 172.21.15.156:0/247136059 >> 172.21.15.156:0/247136059 conn(0x7f07b4099c40 msgr2=0x7f07b40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:52.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.630+0000 7f07ba18b700 1 -- 172.21.15.156:0/247136059 shutdown_connections 2023-09-30T22:19:52.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.630+0000 7f07ba18b700 1 -- 172.21.15.156:0/247136059 wait complete. 2023-09-30T22:19:52.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.631+0000 7f07ba18b700 1 Processor -- start 2023-09-30T22:19:52.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.631+0000 7f07ba18b700 1 -- start start 2023-09-30T22:19:52.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.632+0000 7f07ba18b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07b406a770 0x7f07b411a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:52.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.632+0000 7f07ba18b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07b409dea0 0x7f07b411abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:52.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.632+0000 7f07ba18b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07b4134f00 0x7f07b411b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:52.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.632+0000 7f07ba18b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b411c120 con 0x7f07b4134f00 2023-09-30T22:19:52.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.632+0000 7f07ba18b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b411c490 con 0x7f07b406a770 2023-09-30T22:19:52.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.632+0000 7f07ba18b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07b4126900 con 0x7f07b409dea0 2023-09-30T22:19:52.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.632+0000 7f07b37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07b406a770 0x7f07b411a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:52.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.632+0000 7f07b37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07b406a770 0x7f07b411a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:36832/0 (socket says 172.21.15.156:36832) 2023-09-30T22:19:52.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.632+0000 7f07b37fe700 1 -- 172.21.15.156:0/2094859778 learned_addr learned my addr 172.21.15.156:0/2094859778 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:52.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.632+0000 7f07b3fff700 1 --2- 172.21.15.156:0/2094859778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07b4134f00 0x7f07b411b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:52.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.632+0000 7f07b2ffd700 1 --2- 172.21.15.156:0/2094859778 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07b409dea0 0x7f07b411abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:52.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.632+0000 7f07b37fe700 1 -- 172.21.15.156:0/2094859778 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07b409dea0 msgr2=0x7f07b411abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:52.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.632+0000 7f07b37fe700 1 --2- 172.21.15.156:0/2094859778 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07b409dea0 0x7f07b411abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.632+0000 7f07b37fe700 1 -- 172.21.15.156:0/2094859778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07b4134f00 msgr2=0x7f07b411b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:52.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.632+0000 7f07b37fe700 1 --2- 172.21.15.156:0/2094859778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07b4134f00 0x7f07b411b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.632+0000 7f07b37fe700 1 -- 172.21.15.156:0/2094859778 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a4009550 con 0x7f07b406a770 2023-09-30T22:19:52.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.633+0000 7f07b37fe700 1 --2- 172.21.15.156:0/2094859778 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07b406a770 0x7f07b411a6a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f07a4014040 tx=0x7f07a4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:52.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.633+0000 7f079bfff700 1 -- 172.21.15.156:0/2094859778 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a4004510 con 0x7f07b406a770 2023-09-30T22:19:52.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.633+0000 7f079bfff700 1 -- 172.21.15.156:0/2094859778 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a401e070 con 0x7f07b406a770 2023-09-30T22:19:52.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.633+0000 7f07ba18b700 1 -- 172.21.15.156:0/2094859778 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b409f220 con 0x7f07b406a770 2023-09-30T22:19:52.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.633+0000 7f079bfff700 1 -- 172.21.15.156:0/2094859778 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a40038e0 con 0x7f07b406a770 2023-09-30T22:19:52.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.633+0000 7f07ba18b700 1 -- 172.21.15.156:0/2094859778 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b41272a0 con 0x7f07b406a770 2023-09-30T22:19:52.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.634+0000 7f079bfff700 1 -- 172.21.15.156:0/2094859778 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f07a4003a40 con 0x7f07b406a770 2023-09-30T22:19:52.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.634+0000 7f079bfff700 1 -- 172.21.15.156:0/2094859778 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f07a4020070 con 0x7f07b406a770 2023-09-30T22:19:52.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.634+0000 7f07ba18b700 1 -- 172.21.15.156:0/2094859778 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b4126a40 con 0x7f07b406a770 2023-09-30T22:19:52.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.639+0000 7f079bfff700 1 -- 172.21.15.156:0/2094859778 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f07a4023380 con 0x7f07b406a770 2023-09-30T22:19:52.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.669+0000 7febfeacd700 1 Processor -- start 2023-09-30T22:19:52.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.669+0000 7febfeacd700 1 -- start start 2023-09-30T22:19:52.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.669+0000 7febfeacd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febf80a1510 0x7febf81351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:52.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.669+0000 7febfeacd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febf81356e0 0x7febf8137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:52.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.669+0000 7febfeacd700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf80a1e70 con 0x7febf80a0a30 2023-09-30T22:19:52.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.669+0000 7febfeacd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf809a720 con 0x7febf80a1510 2023-09-30T22:19:52.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.669+0000 7febfeacd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febf809b300 con 0x7febf81356e0 2023-09-30T22:19:52.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.669+0000 7febfc869700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7febf80a0a30 0x7febf80a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53164/0 (socket says 172.21.15.156:53164) 2023-09-30T22:19:52.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.669+0000 7febfc869700 1 -- 172.21.15.156:0/2910356766 learned_addr learned my addr 172.21.15.156:0/2910356766 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:52.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.669+0000 7febf7fff700 1 --2- 172.21.15.156:0/2910356766 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febf80a1510 0x7febf81351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:52.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.669+0000 7febfd06a700 1 --2- 172.21.15.156:0/2910356766 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febf81356e0 0x7febf8137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:52.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.670+0000 7febf77fe700 1 -- 172.21.15.156:0/2910356766 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073852288 0 0) 0x7febf80a1e70 con 0x7febf80a0a30 2023-09-30T22:19:52.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.670+0000 7febf7fff700 1 -- 172.21.15.156:0/2910356766 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febf81356e0 msgr2=0x7febf8137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:52.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.670+0000 7febf7fff700 1 --2- 172.21.15.156:0/2910356766 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febf81356e0 0x7febf8137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.670+0000 7febf7fff700 1 -- 172.21.15.156:0/2910356766 >> v1:172.21.15.156:6789/0 conn(0x7febf80a0a30 legacy=0x7febf80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:52.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.670+0000 7febf7fff700 1 -- 172.21.15.156:0/2910356766 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf809abc0 con 0x7febf80a1510 2023-09-30T22:19:52.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.670+0000 7febf7fff700 1 --2- 172.21.15.156:0/2910356766 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febf80a1510 0x7febf81351a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7febe400a980 tx=0x7febe400ac90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3abb3804c7f6a22 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:52.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.670+0000 7febf77fe700 1 -- 172.21.15.156:0/2910356766 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe4004230 con 0x7febf80a1510 2023-09-30T22:19:52.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.670+0000 7febf77fe700 1 -- 172.21.15.156:0/2910356766 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe4004390 con 0x7febf80a1510 2023-09-30T22:19:52.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.670+0000 7febf77fe700 1 -- 172.21.15.156:0/2910356766 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe40036a0 con 0x7febf80a1510 2023-09-30T22:19:52.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.671+0000 7febfeacd700 1 -- 172.21.15.156:0/2910356766 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febf80a1510 msgr2=0x7febf81351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:52.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.671+0000 7febfeacd700 1 --2- 172.21.15.156:0/2910356766 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febf80a1510 0x7febf81351a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7febe400a980 tx=0x7febe400ac90 comp rx=0 tx=0).stop 2023-09-30T22:19:52.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.671+0000 7febfeacd700 1 -- 172.21.15.156:0/2910356766 shutdown_connections 2023-09-30T22:19:52.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.671+0000 7febfeacd700 1 --2- 172.21.15.156:0/2910356766 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febf81356e0 0x7febf8137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.671+0000 7febfeacd700 1 --2- 172.21.15.156:0/2910356766 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febf80a1510 0x7febf81351a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.671+0000 7febfeacd700 1 -- 172.21.15.156:0/2910356766 >> 172.21.15.156:0/2910356766 conn(0x7febf80a2980 msgr2=0x7febf80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:52.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.671+0000 7febfeacd700 1 -- 172.21.15.156:0/2910356766 shutdown_connections 2023-09-30T22:19:52.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.671+0000 7febfeacd700 1 -- 172.21.15.156:0/2910356766 wait complete. 2023-09-30T22:19:52.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.672+0000 7febfeacd700 1 Processor -- start 2023-09-30T22:19:52.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.672+0000 7febfeacd700 1 -- start start 2023-09-30T22:19:52.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.673+0000 7febfeacd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febf80a0a30 0x7febf81c4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:52.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.673+0000 7febfeacd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febf80a1510 0x7febf81c4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:52.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.673+0000 7febfeacd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febf81356e0 0x7febf8118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:52.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.673+0000 7febfeacd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf811be20 con 0x7febf81356e0 2023-09-30T22:19:52.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.673+0000 7febfeacd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf811c000 con 0x7febf80a1510 2023-09-30T22:19:52.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.673+0000 7febfeacd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febf81c3e90 con 0x7febf80a0a30 2023-09-30T22:19:52.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.673+0000 7febfd06a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febf81356e0 0x7febf8118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:52.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.673+0000 7febfd06a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febf81356e0 0x7febf8118df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51202/0 (socket says 172.21.15.156:51202) 2023-09-30T22:19:52.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.673+0000 7febfd06a700 1 -- 172.21.15.156:0/1308051528 learned_addr learned my addr 172.21.15.156:0/1308051528 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:52.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.673+0000 7febf7fff700 1 --2- 172.21.15.156:0/1308051528 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febf80a1510 0x7febf81c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:52.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.673+0000 7febfc869700 1 --2- 172.21.15.156:0/1308051528 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febf80a0a30 0x7febf81c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:52.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.673+0000 7febf7fff700 1 -- 172.21.15.156:0/1308051528 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febf80a0a30 msgr2=0x7febf81c4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:52.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.673+0000 7febf7fff700 1 --2- 172.21.15.156:0/1308051528 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febf80a0a30 0x7febf81c4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.673+0000 7febf7fff700 1 -- 172.21.15.156:0/1308051528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febf81356e0 msgr2=0x7febf8118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:52.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.673+0000 7febf7fff700 1 --2- 172.21.15.156:0/1308051528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febf81356e0 0x7febf8118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.674+0000 7febf7fff700 1 -- 172.21.15.156:0/1308051528 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe400a5b0 con 0x7febf80a1510 2023-09-30T22:19:52.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.674+0000 7febfd06a700 1 --2- 172.21.15.156:0/1308051528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febf81356e0 0x7febf8118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:52.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.674+0000 7febf7fff700 1 --2- 172.21.15.156:0/1308051528 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febf80a1510 0x7febf81c4790 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7febf809a230 tx=0x7febe4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:52.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.674+0000 7febf57fa700 1 -- 172.21.15.156:0/1308051528 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe4003ab0 con 0x7febf80a1510 2023-09-30T22:19:52.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.674+0000 7febf57fa700 1 -- 172.21.15.156:0/1308051528 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe4003c30 con 0x7febf80a1510 2023-09-30T22:19:52.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.674+0000 7febfeacd700 1 -- 172.21.15.156:0/1308051528 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf809ae00 con 0x7febf80a1510 2023-09-30T22:19:52.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.674+0000 7febf57fa700 1 -- 172.21.15.156:0/1308051528 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe4006e60 con 0x7febf80a1510 2023-09-30T22:19:52.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.674+0000 7febfeacd700 1 -- 172.21.15.156:0/1308051528 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf811a0f0 con 0x7febf80a1510 2023-09-30T22:19:52.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.675+0000 7febf57fa700 1 -- 172.21.15.156:0/1308051528 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7febe400c6a0 con 0x7febf80a1510 2023-09-30T22:19:52.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.675+0000 7febf57fa700 1 -- 172.21.15.156:0/1308051528 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7febe4040d70 con 0x7febf80a1510 2023-09-30T22:19:52.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.675+0000 7febfeacd700 1 -- 172.21.15.156:0/1308051528 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf8072230 con 0x7febf80a1510 2023-09-30T22:19:52.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.680+0000 7febf57fa700 1 -- 172.21.15.156:0/1308051528 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7febe400c950 con 0x7febf80a1510 2023-09-30T22:19:52.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.749+0000 7f7639530700 1 -- 172.21.15.156:0/4134141539 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7634134130 con 0x7f7634135f10 2023-09-30T22:19:52.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.750+0000 7f762b7fe700 1 -- 172.21.15.156:0/4134141539 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f761c01f020 con 0x7f7634135f10 2023-09-30T22:19:52.750 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:52.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.752+0000 7f7639530700 1 -- 172.21.15.156:0/4134141539 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7634135f10 msgr2=0x7f76340701b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:52.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.752+0000 7f7639530700 1 --2- 172.21.15.156:0/4134141539 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7634135f10 0x7f76340701b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f761c00c7f0 tx=0x7f761c00cb00 comp rx=0 tx=0).stop 2023-09-30T22:19:52.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.752+0000 7f7639530700 1 -- 172.21.15.156:0/4134141539 shutdown_connections 2023-09-30T22:19:52.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.752+0000 7f7639530700 1 --2- 172.21.15.156:0/4134141539 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7634135f10 0x7f76340701b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.752+0000 7f7639530700 1 --2- 172.21.15.156:0/4134141539 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f763412d380 0x7f763412ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.752+0000 7f7639530700 1 --2- 172.21.15.156:0/4134141539 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f76341335f0 0x7f763412b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.752+0000 7f7639530700 1 -- 172.21.15.156:0/4134141539 >> 172.21.15.156:0/4134141539 conn(0x7f76340a2980 msgr2=0x7f76340a09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:52.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.752+0000 7f7639530700 1 -- 172.21.15.156:0/4134141539 shutdown_connections 2023-09-30T22:19:52.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.752+0000 7f7639530700 1 -- 172.21.15.156:0/4134141539 wait complete. 2023-09-30T22:19:52.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.765+0000 7f85c2576700 1 Processor -- start 2023-09-30T22:19:52.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.765+0000 7f85c2576700 1 -- start start 2023-09-30T22:19:52.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.766+0000 7f85c2576700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f85bc09f350 0x7f85bc136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:52.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.766+0000 7f85c2576700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f85bc1371c0 0x7f85bc1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:52.767 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:52.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.766+0000 7f85c2576700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85bc09c970 con 0x7f85bc09e870 2023-09-30T22:19:52.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.766+0000 7f85c2576700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85bc0a0920 con 0x7f85bc1371c0 2023-09-30T22:19:52.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.766+0000 7f85c2576700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc09f9c0 con 0x7f85bc09f350 2023-09-30T22:19:52.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.766+0000 7f85b3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f85bc09f350 0x7f85bc136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:52.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.766+0000 7f85c0b13700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f85bc1371c0 0x7f85bc1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:52.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.766+0000 7f85bbfff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f85bc09e870 0x7f85bc09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53168/0 (socket says 172.21.15.156:53168) 2023-09-30T22:19:52.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.766+0000 7f85b3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f85bc09f350 0x7f85bc136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:36868/0 (socket says 172.21.15.156:36868) 2023-09-30T22:19:52.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.766+0000 7f85bbfff700 1 -- 172.21.15.156:0/3308842474 learned_addr learned my addr 172.21.15.156:0/3308842474 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:52.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.766+0000 7f85c0b13700 1 -- 172.21.15.156:0/3308842474 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f85bc09f350 msgr2=0x7f85bc136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:52.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.766+0000 7f85c0b13700 1 --2- 172.21.15.156:0/3308842474 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f85bc09f350 0x7f85bc136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.766+0000 7f85c0b13700 1 -- 172.21.15.156:0/3308842474 >> v1:172.21.15.156:6789/0 conn(0x7f85bc09e870 legacy=0x7f85bc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:52.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.766+0000 7f85c0b13700 1 -- 172.21.15.156:0/3308842474 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85bc09bab0 con 0x7f85bc1371c0 2023-09-30T22:19:52.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.766+0000 7f85b3fff700 1 --2- 172.21.15.156:0/3308842474 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f85bc09f350 0x7f85bc136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:52.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.766+0000 7f85c0b13700 1 --2- 172.21.15.156:0/3308842474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85bc1371c0 0x7f85bc1395a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009d90 tx=0x7f85b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e595301bb5fc1e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:52.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.767+0000 7f85bb7fe700 1 -- 172.21.15.156:0/3308842474 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b400e070 con 0x7f85bc1371c0 2023-09-30T22:19:52.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.767+0000 7f85bb7fe700 1 -- 172.21.15.156:0/3308842474 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b400bb20 con 0x7f85bc1371c0 2023-09-30T22:19:52.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.767+0000 7f85bb7fe700 1 -- 172.21.15.156:0/3308842474 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b4012430 con 0x7f85bc1371c0 2023-09-30T22:19:52.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.768+0000 7f85c2576700 1 -- 172.21.15.156:0/3308842474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85bc1371c0 msgr2=0x7f85bc1395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:52.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.768+0000 7f85c2576700 1 --2- 172.21.15.156:0/3308842474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85bc1371c0 0x7f85bc1395a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009d90 tx=0x7f85b400b330 comp rx=0 tx=0).stop 2023-09-30T22:19:52.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.768+0000 7f85c2576700 1 -- 172.21.15.156:0/3308842474 shutdown_connections 2023-09-30T22:19:52.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.768+0000 7f85c2576700 1 --2- 172.21.15.156:0/3308842474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85bc1371c0 0x7f85bc1395a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.768+0000 7f85c2576700 1 --2- 172.21.15.156:0/3308842474 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f85bc09f350 0x7f85bc136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.768+0000 7f85c2576700 1 -- 172.21.15.156:0/3308842474 >> 172.21.15.156:0/3308842474 conn(0x7f85bc0a4430 msgr2=0x7f85bc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:52.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.768+0000 7f85c2576700 1 -- 172.21.15.156:0/3308842474 shutdown_connections 2023-09-30T22:19:52.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.768+0000 7f85c2576700 1 -- 172.21.15.156:0/3308842474 wait complete. 2023-09-30T22:19:52.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.769+0000 7f85c2576700 1 Processor -- start 2023-09-30T22:19:52.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.769+0000 7f85c2576700 1 -- start start 2023-09-30T22:19:52.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.770+0000 7f85c2576700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85bc09e870 0x7f85bc11e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:52.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.770+0000 7f85c2576700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f85bc09f350 0x7f85bc11ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:52.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.770+0000 7f85c2576700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f85bc1371c0 0x7f85bc11f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:52.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.770+0000 7f85c2576700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc06d300 con 0x7f85bc09e870 2023-09-30T22:19:52.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.770+0000 7f85c2576700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc09dba0 con 0x7f85bc1371c0 2023-09-30T22:19:52.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.770+0000 7f85c2576700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc1218f0 con 0x7f85bc09f350 2023-09-30T22:19:52.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.770+0000 7f85bbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85bc09e870 0x7f85bc11e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:52.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.770+0000 7f85b3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f85bc09f350 0x7f85bc11ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:52.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.770+0000 7f85bbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85bc09e870 0x7f85bc11e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51218/0 (socket says 172.21.15.156:51218) 2023-09-30T22:19:52.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.770+0000 7f85bbfff700 1 -- 172.21.15.156:0/1967453663 learned_addr learned my addr 172.21.15.156:0/1967453663 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:52.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.770+0000 7f85c0b13700 1 --2- 172.21.15.156:0/1967453663 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f85bc1371c0 0x7f85bc11f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:52.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.770+0000 7f85bbfff700 1 -- 172.21.15.156:0/1967453663 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f85bc09f350 msgr2=0x7f85bc11ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:52.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.770+0000 7f85bbfff700 1 --2- 172.21.15.156:0/1967453663 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f85bc09f350 0x7f85bc11ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.770+0000 7f85bbfff700 1 -- 172.21.15.156:0/1967453663 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f85bc1371c0 msgr2=0x7f85bc11f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:52.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.770+0000 7f85bbfff700 1 --2- 172.21.15.156:0/1967453663 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f85bc1371c0 0x7f85bc11f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.770+0000 7f85bbfff700 1 -- 172.21.15.156:0/1967453663 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a400d940 con 0x7f85bc09e870 2023-09-30T22:19:52.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.770+0000 7f85b3fff700 1 --2- 172.21.15.156:0/1967453663 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f85bc09f350 0x7f85bc11ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:52.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.770+0000 7f85bbfff700 1 --2- 172.21.15.156:0/1967453663 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85bc09e870 0x7f85bc11e690 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00c520 tx=0x7f85ac00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:52.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.771+0000 7f85b97fa700 1 -- 172.21.15.156:0/1967453663 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ac005d70 con 0x7f85bc09e870 2023-09-30T22:19:52.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.771+0000 7f85b97fa700 1 -- 172.21.15.156:0/1967453663 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85ac0070d0 con 0x7f85bc09e870 2023-09-30T22:19:52.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.771+0000 7f85c2576700 1 -- 172.21.15.156:0/1967453663 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b4009a70 con 0x7f85bc09e870 2023-09-30T22:19:52.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.771+0000 7f85b97fa700 1 -- 172.21.15.156:0/1967453663 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ac007440 con 0x7f85bc09e870 2023-09-30T22:19:52.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.771+0000 7f85c2576700 1 -- 172.21.15.156:0/1967453663 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85bc120a00 con 0x7f85bc09e870 2023-09-30T22:19:52.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.771+0000 7f85b97fa700 1 -- 172.21.15.156:0/1967453663 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f85ac0075a0 con 0x7f85bc09e870 2023-09-30T22:19:52.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.771+0000 7f85b97fa700 1 -- 172.21.15.156:0/1967453663 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f85ac03eba0 con 0x7f85bc09e870 2023-09-30T22:19:52.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.772+0000 7f85c2576700 1 -- 172.21.15.156:0/1967453663 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85bc04f2a0 con 0x7f85bc09e870 2023-09-30T22:19:52.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.781+0000 7f85b97fa700 1 -- 172.21.15.156:0/1967453663 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f85ac017080 con 0x7f85bc09e870 2023-09-30T22:19:52.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.845+0000 7f07ba18b700 1 -- 172.21.15.156:0/2094859778 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f07b404f2a0 con 0x7f07b406a770 2023-09-30T22:19:52.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.845+0000 7f079bfff700 1 -- 172.21.15.156:0/2094859778 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f07a4015030 con 0x7f07b406a770 2023-09-30T22:19:52.846 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:52.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.847+0000 7f07ba18b700 1 -- 172.21.15.156:0/2094859778 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07b406a770 msgr2=0x7f07b411a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:52.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.847+0000 7f07ba18b700 1 --2- 172.21.15.156:0/2094859778 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07b406a770 0x7f07b411a6a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f07a4014040 tx=0x7f07a4004750 comp rx=0 tx=0).stop 2023-09-30T22:19:52.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.848+0000 7f07ba18b700 1 -- 172.21.15.156:0/2094859778 shutdown_connections 2023-09-30T22:19:52.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.848+0000 7f07ba18b700 1 --2- 172.21.15.156:0/2094859778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07b4134f00 0x7f07b411b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.848+0000 7f07ba18b700 1 --2- 172.21.15.156:0/2094859778 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07b406a770 0x7f07b411a6a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.848+0000 7f07ba18b700 1 --2- 172.21.15.156:0/2094859778 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07b409dea0 0x7f07b411abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.848+0000 7f07ba18b700 1 -- 172.21.15.156:0/2094859778 >> 172.21.15.156:0/2094859778 conn(0x7f07b4099c40 msgr2=0x7f07b409c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:52.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.848+0000 7f07ba18b700 1 -- 172.21.15.156:0/2094859778 shutdown_connections 2023-09-30T22:19:52.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.848+0000 7f07ba18b700 1 -- 172.21.15.156:0/2094859778 wait complete. 2023-09-30T22:19:52.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:52.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.880+0000 7febfeacd700 1 -- 172.21.15.156:0/1308051528 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7febf804f2a0 con 0x7febf80a1510 2023-09-30T22:19:52.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.880+0000 7febf57fa700 1 -- 172.21.15.156:0/1308051528 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7febe402f3f0 con 0x7febf80a1510 2023-09-30T22:19:52.881 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:52.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.882+0000 7febfeacd700 1 -- 172.21.15.156:0/1308051528 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febf80a1510 msgr2=0x7febf81c4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:52.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.882+0000 7febfeacd700 1 --2- 172.21.15.156:0/1308051528 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febf80a1510 0x7febf81c4790 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7febf809a230 tx=0x7febe4004750 comp rx=0 tx=0).stop 2023-09-30T22:19:52.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.882+0000 7febfeacd700 1 -- 172.21.15.156:0/1308051528 shutdown_connections 2023-09-30T22:19:52.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.882+0000 7febfeacd700 1 --2- 172.21.15.156:0/1308051528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febf81356e0 0x7febf8118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.882+0000 7febfeacd700 1 --2- 172.21.15.156:0/1308051528 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febf80a0a30 0x7febf81c4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.882+0000 7febfeacd700 1 --2- 172.21.15.156:0/1308051528 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febf80a1510 0x7febf81c4790 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.882+0000 7febfeacd700 1 -- 172.21.15.156:0/1308051528 >> 172.21.15.156:0/1308051528 conn(0x7febf80a2980 msgr2=0x7febf8130400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:52.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.882+0000 7febfeacd700 1 -- 172.21.15.156:0/1308051528 shutdown_connections 2023-09-30T22:19:52.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.882+0000 7febfeacd700 1 -- 172.21.15.156:0/1308051528 wait complete. 2023-09-30T22:19:52.895 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:52.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.976+0000 7f85c2576700 1 -- 172.21.15.156:0/1967453663 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f85bc1214a0 con 0x7f85bc09e870 2023-09-30T22:19:52.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.976+0000 7f85b97fa700 1 -- 172.21.15.156:0/1967453663 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f85ac019b40 con 0x7f85bc09e870 2023-09-30T22:19:52.977 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:52.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.978+0000 7f85c2576700 1 -- 172.21.15.156:0/1967453663 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85bc09e870 msgr2=0x7f85bc11e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:52.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.978+0000 7f85c2576700 1 --2- 172.21.15.156:0/1967453663 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85bc09e870 0x7f85bc11e690 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00c520 tx=0x7f85ac00c830 comp rx=0 tx=0).stop 2023-09-30T22:19:52.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.978+0000 7f85c2576700 1 -- 172.21.15.156:0/1967453663 shutdown_connections 2023-09-30T22:19:52.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.978+0000 7f85c2576700 1 --2- 172.21.15.156:0/1967453663 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f85bc1371c0 0x7f85bc11f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.978+0000 7f85c2576700 1 --2- 172.21.15.156:0/1967453663 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85bc09e870 0x7f85bc11e690 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.978+0000 7f85c2576700 1 --2- 172.21.15.156:0/1967453663 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f85bc09f350 0x7f85bc11ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:52.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.978+0000 7f85c2576700 1 -- 172.21.15.156:0/1967453663 >> 172.21.15.156:0/1967453663 conn(0x7f85bc0a4430 msgr2=0x7f85bc0a2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:52.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.978+0000 7f85c2576700 1 -- 172.21.15.156:0/1967453663 shutdown_connections 2023-09-30T22:19:52.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:52.978+0000 7f85c2576700 1 -- 172.21.15.156:0/1967453663 wait complete. 2023-09-30T22:19:52.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:53.768 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:53.862 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:53.896 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:53.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.905+0000 7f47e6332700 1 Processor -- start 2023-09-30T22:19:53.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.905+0000 7f47e6332700 1 -- start start 2023-09-30T22:19:53.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.906+0000 7f47e6332700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47e009e870 0x7f47e009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:53.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.906+0000 7f47e6332700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f47e009f180 0x7f47e0131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:53.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.906+0000 7f47e6332700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e009c970 con 0x7f47e0131d70 2023-09-30T22:19:53.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.906+0000 7f47e6332700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e00a0920 con 0x7f47e009f180 2023-09-30T22:19:53.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.906+0000 7f47e6332700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47e009f9c0 con 0x7f47e009e870 2023-09-30T22:19:53.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.906+0000 7f47dffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47e009e870 0x7f47e009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:53.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.906+0000 7f47df7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f47e009f180 0x7f47e0131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:53.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.906+0000 7f47dffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47e009e870 0x7f47e009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48608/0 (socket says 172.21.15.156:48608) 2023-09-30T22:19:53.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.906+0000 7f47dffff700 1 -- 172.21.15.156:0/825520905 learned_addr learned my addr 172.21.15.156:0/825520905 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:53.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.906+0000 7f47dffff700 1 -- 172.21.15.156:0/825520905 >> v2:172.21.15.156:3300/0 conn(0x7f47e009f180 msgr2=0x7f47e0131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:53.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.906+0000 7f47dffff700 1 --2- 172.21.15.156:0/825520905 >> v2:172.21.15.156:3300/0 conn(0x7f47e009f180 0x7f47e0131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:53.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.906+0000 7f47dffff700 1 -- 172.21.15.156:0/825520905 >> v1:172.21.15.156:6789/0 conn(0x7f47e0131d70 legacy=0x7f47e0138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:53.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.906+0000 7f47dffff700 1 -- 172.21.15.156:0/825520905 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e009bab0 con 0x7f47e009e870 2023-09-30T22:19:53.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.906+0000 7f47dffff700 1 --2- 172.21.15.156:0/825520905 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47e009e870 0x7f47e009ec40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f47d00098f0 tx=0x7f47d0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=270667f08f0ac859 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:53.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.907+0000 7f47deffd700 1 -- 172.21.15.156:0/825520905 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d0011830 con 0x7f47e009e870 2023-09-30T22:19:53.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.907+0000 7f47deffd700 1 -- 172.21.15.156:0/825520905 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d0011990 con 0x7f47e009e870 2023-09-30T22:19:53.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.907+0000 7f47deffd700 1 -- 172.21.15.156:0/825520905 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d0011d20 con 0x7f47e009e870 2023-09-30T22:19:53.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.907+0000 7f47e6332700 1 -- 172.21.15.156:0/825520905 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47e009e870 msgr2=0x7f47e009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:53.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.907+0000 7f47e6332700 1 --2- 172.21.15.156:0/825520905 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47e009e870 0x7f47e009ec40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f47d00098f0 tx=0x7f47d0009c00 comp rx=0 tx=0).stop 2023-09-30T22:19:53.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.907+0000 7f47e6332700 1 -- 172.21.15.156:0/825520905 shutdown_connections 2023-09-30T22:19:53.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.907+0000 7f47e6332700 1 --2- 172.21.15.156:0/825520905 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47e009e870 0x7f47e009ec40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:53.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.907+0000 7f47e6332700 1 --2- 172.21.15.156:0/825520905 >> v2:172.21.15.156:3300/0 conn(0x7f47e009f180 0x7f47e0131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:53.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.907+0000 7f47e6332700 1 -- 172.21.15.156:0/825520905 >> 172.21.15.156:0/825520905 conn(0x7f47e00a4430 msgr2=0x7f47e00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:53.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.907+0000 7f47e6332700 1 -- 172.21.15.156:0/825520905 shutdown_connections 2023-09-30T22:19:53.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.907+0000 7f47e6332700 1 -- 172.21.15.156:0/825520905 wait complete. 2023-09-30T22:19:53.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.909+0000 7f47e6332700 1 Processor -- start 2023-09-30T22:19:53.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.909+0000 7f47e6332700 1 -- start start 2023-09-30T22:19:53.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.910+0000 7f47e6332700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e009e870 0x7f47e006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:53.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.910+0000 7f47e6332700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47e009f180 0x7f47e006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:53.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.910+0000 7f47e6332700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47e0131d70 0x7f47e006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:53.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.910+0000 7f47e6332700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e006d550 con 0x7f47e0131d70 2023-09-30T22:19:53.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.910+0000 7f47e6332700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e006d360 con 0x7f47e009e870 2023-09-30T22:19:53.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.910+0000 7f47e6332700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47e006cca0 con 0x7f47e009f180 2023-09-30T22:19:53.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.910+0000 7f47df7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47e009f180 0x7f47e006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:53.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.910+0000 7f47df7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47e009f180 0x7f47e006bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48612/0 (socket says 172.21.15.156:48612) 2023-09-30T22:19:53.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.910+0000 7f47e48cf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47e0131d70 0x7f47e006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:53.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.910+0000 7f47df7fe700 1 -- 172.21.15.156:0/1815068631 learned_addr learned my addr 172.21.15.156:0/1815068631 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:53.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.910+0000 7f47df7fe700 1 -- 172.21.15.156:0/1815068631 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e009e870 msgr2=0x7f47e006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:53.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.910+0000 7f47df7fe700 1 --2- 172.21.15.156:0/1815068631 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e009e870 0x7f47e006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:53.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.910+0000 7f47df7fe700 1 -- 172.21.15.156:0/1815068631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47e0131d70 msgr2=0x7f47e006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:53.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.910+0000 7f47df7fe700 1 --2- 172.21.15.156:0/1815068631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47e0131d70 0x7f47e006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:53.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.910+0000 7f47df7fe700 1 -- 172.21.15.156:0/1815068631 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d0009550 con 0x7f47e009f180 2023-09-30T22:19:53.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.910+0000 7f47e48cf700 1 --2- 172.21.15.156:0/1815068631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47e0131d70 0x7f47e006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:53.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.910+0000 7f47df7fe700 1 --2- 172.21.15.156:0/1815068631 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47e009f180 0x7f47e006bdf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f47d400e980 tx=0x7f47d400ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:53.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.910+0000 7f47dcff9700 1 -- 172.21.15.156:0/1815068631 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d4009710 con 0x7f47e009f180 2023-09-30T22:19:53.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.910+0000 7f47dcff9700 1 -- 172.21.15.156:0/1815068631 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d400eed0 con 0x7f47e009f180 2023-09-30T22:19:53.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.910+0000 7f47dcff9700 1 -- 172.21.15.156:0/1815068631 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d400ca70 con 0x7f47e009f180 2023-09-30T22:19:53.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.911+0000 7f47e6332700 1 -- 172.21.15.156:0/1815068631 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e0125f00 con 0x7f47e009f180 2023-09-30T22:19:53.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.911+0000 7f47e6332700 1 -- 172.21.15.156:0/1815068631 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e0125c20 con 0x7f47e009f180 2023-09-30T22:19:53.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.911+0000 7f47dcff9700 1 -- 172.21.15.156:0/1815068631 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f47d400cbd0 con 0x7f47e009f180 2023-09-30T22:19:53.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.911+0000 7f47dcff9700 1 -- 172.21.15.156:0/1815068631 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f47d403fae0 con 0x7f47e009f180 2023-09-30T22:19:53.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.912+0000 7f47e6332700 1 -- 172.21.15.156:0/1815068631 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e004f2a0 con 0x7f47e009f180 2023-09-30T22:19:53.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.917+0000 7f47dcff9700 1 -- 172.21.15.156:0/1815068631 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f47d4021080 con 0x7f47e009f180 2023-09-30T22:19:53.992 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:53.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.993+0000 7f61fad9b700 1 Processor -- start 2023-09-30T22:19:53.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.993+0000 7f61fad9b700 1 -- start start 2023-09-30T22:19:53.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.993+0000 7f61fad9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f61f409e870 0x7f61f409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:53.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.993+0000 7f61fad9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61f409f180 0x7f61f4131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:53.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.993+0000 7f61fad9b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f409c970 con 0x7f61f4131d70 2023-09-30T22:19:53.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.993+0000 7f61fad9b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f40a0920 con 0x7f61f409e870 2023-09-30T22:19:53.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.993+0000 7f61fad9b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f409f9c0 con 0x7f61f409f180 2023-09-30T22:19:53.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.993+0000 7f61f8b37700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f61f409e870 0x7f61f409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:53.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.994+0000 7f61f3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61f409f180 0x7f61f4131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:53.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.994+0000 7f61f8b37700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f61f409e870 0x7f61f409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51250/0 (socket says 172.21.15.156:51250) 2023-09-30T22:19:53.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.994+0000 7f61f8b37700 1 -- 172.21.15.156:0/166492318 learned_addr learned my addr 172.21.15.156:0/166492318 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:53.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.994+0000 7f61f37fe700 1 -- 172.21.15.156:0/166492318 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3051605245 0 0) 0x7f61f409c970 con 0x7f61f4131d70 2023-09-30T22:19:53.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.994+0000 7f61f37fe700 1 -- 172.21.15.156:0/166492318 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61e40035b0 con 0x7f61f4131d70 2023-09-30T22:19:53.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.994+0000 7f61f3fff700 1 -- 172.21.15.156:0/166492318 >> v2:172.21.15.156:3300/0 conn(0x7f61f409e870 msgr2=0x7f61f409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:53.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.994+0000 7f61f3fff700 1 --2- 172.21.15.156:0/166492318 >> v2:172.21.15.156:3300/0 conn(0x7f61f409e870 0x7f61f409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:53.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.994+0000 7f61f3fff700 1 -- 172.21.15.156:0/166492318 >> v1:172.21.15.156:6789/0 conn(0x7f61f4131d70 legacy=0x7f61f4138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:53.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.994+0000 7f61f3fff700 1 -- 172.21.15.156:0/166492318 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f409bab0 con 0x7f61f409f180 2023-09-30T22:19:53.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.994+0000 7f61f3fff700 1 --2- 172.21.15.156:0/166492318 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61f409f180 0x7f61f4131830 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009840 tx=0x7f61e0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=361227d1eba0b377 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:53.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.994+0000 7f61f37fe700 1 -- 172.21.15.156:0/166492318 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e0011830 con 0x7f61f409f180 2023-09-30T22:19:53.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.994+0000 7f61f37fe700 1 -- 172.21.15.156:0/166492318 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e0011990 con 0x7f61f409f180 2023-09-30T22:19:53.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.994+0000 7f61f37fe700 1 -- 172.21.15.156:0/166492318 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e0011d00 con 0x7f61f409f180 2023-09-30T22:19:53.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.995+0000 7f61fad9b700 1 -- 172.21.15.156:0/166492318 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61f409f180 msgr2=0x7f61f4131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:53.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.995+0000 7f61fad9b700 1 --2- 172.21.15.156:0/166492318 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61f409f180 0x7f61f4131830 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009840 tx=0x7f61e0009b50 comp rx=0 tx=0).stop 2023-09-30T22:19:53.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.995+0000 7f61fad9b700 1 -- 172.21.15.156:0/166492318 shutdown_connections 2023-09-30T22:19:53.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.995+0000 7f61fad9b700 1 --2- 172.21.15.156:0/166492318 >> v2:172.21.15.156:3300/0 conn(0x7f61f409e870 0x7f61f409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:53.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.995+0000 7f61fad9b700 1 --2- 172.21.15.156:0/166492318 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61f409f180 0x7f61f4131830 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:53.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.995+0000 7f61fad9b700 1 -- 172.21.15.156:0/166492318 >> 172.21.15.156:0/166492318 conn(0x7f61f40a4430 msgr2=0x7f61f40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:53.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.995+0000 7f61fad9b700 1 -- 172.21.15.156:0/166492318 shutdown_connections 2023-09-30T22:19:53.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.995+0000 7f61fad9b700 1 -- 172.21.15.156:0/166492318 wait complete. 2023-09-30T22:19:54.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.996+0000 7f61fad9b700 1 Processor -- start 2023-09-30T22:19:54.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.996+0000 7f61fad9b700 1 -- start start 2023-09-30T22:19:54.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.997+0000 7f61fad9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61f409e870 0x7f61f412ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:54.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.997+0000 7f61fad9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61f409f180 0x7f61f412f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:54.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.997+0000 7f61fad9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61f4131d70 0x7f61f412f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:54.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.997+0000 7f61fad9b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f41301b0 con 0x7f61f409f180 2023-09-30T22:19:54.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.997+0000 7f61fad9b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f4132cc0 con 0x7f61f4131d70 2023-09-30T22:19:54.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.997+0000 7f61fad9b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61f4130e50 con 0x7f61f409e870 2023-09-30T22:19:54.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.997+0000 7f61f9338700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61f4131d70 0x7f61f412f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:54.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.997+0000 7f61f8b37700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61f409e870 0x7f61f412ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:54.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.997+0000 7f61f9338700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61f4131d70 0x7f61f412f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:36922/0 (socket says 172.21.15.156:36922) 2023-09-30T22:19:54.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.997+0000 7f61f9338700 1 -- 172.21.15.156:0/14846469 learned_addr learned my addr 172.21.15.156:0/14846469 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:54.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.997+0000 7f61f8b37700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61f409e870 0x7f61f412ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48618/0 (socket says 172.21.15.156:48618) 2023-09-30T22:19:54.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.997+0000 7f61f9338700 1 -- 172.21.15.156:0/14846469 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61f409e870 msgr2=0x7f61f412ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.997+0000 7f61f9338700 1 --2- 172.21.15.156:0/14846469 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61f409e870 0x7f61f412ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:54.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.997+0000 7f61f9338700 1 -- 172.21.15.156:0/14846469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61f409f180 msgr2=0x7f61f412f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.997+0000 7f61f9338700 1 --2- 172.21.15.156:0/14846469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61f409f180 0x7f61f412f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:54.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.997+0000 7f61f9338700 1 -- 172.21.15.156:0/14846469 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e00094a0 con 0x7f61f4131d70 2023-09-30T22:19:54.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.997+0000 7f61f9338700 1 --2- 172.21.15.156:0/14846469 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61f4131d70 0x7f61f412f760 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f61ec00cc20 tx=0x7f61ec00cf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:54.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.998+0000 7f61f17fa700 1 -- 172.21.15.156:0/14846469 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec003c00 con 0x7f61f4131d70 2023-09-30T22:19:54.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.998+0000 7f61f17fa700 1 -- 172.21.15.156:0/14846469 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ec003d60 con 0x7f61f4131d70 2023-09-30T22:19:54.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.998+0000 7f61f17fa700 1 -- 172.21.15.156:0/14846469 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec00ab90 con 0x7f61f4131d70 2023-09-30T22:19:54.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.998+0000 7f61fad9b700 1 -- 172.21.15.156:0/14846469 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f409dba0 con 0x7f61f4131d70 2023-09-30T22:19:54.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.998+0000 7f61fad9b700 1 -- 172.21.15.156:0/14846469 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f4132910 con 0x7f61f4131d70 2023-09-30T22:19:54.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.999+0000 7f61f17fa700 1 -- 172.21.15.156:0/14846469 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f61ec00acf0 con 0x7f61f4131d70 2023-09-30T22:19:54.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.999+0000 7f61fad9b700 1 -- 172.21.15.156:0/14846469 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f4131090 con 0x7f61f4131d70 2023-09-30T22:19:54.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:53.999+0000 7f61f17fa700 1 -- 172.21.15.156:0/14846469 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f61ec03f750 con 0x7f61f4131d70 2023-09-30T22:19:54.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.004+0000 7f61f17fa700 1 -- 172.21.15.156:0/14846469 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f61ec0198f0 con 0x7f61f4131d70 2023-09-30T22:19:54.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.034+0000 7f1943ac4700 1 Processor -- start 2023-09-30T22:19:54.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.034+0000 7f1943ac4700 1 -- start start 2023-09-30T22:19:54.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.035+0000 7f1943ac4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f193c099e20 0x7f193c09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:54.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.035+0000 7f1943ac4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f193c130a60 0x7f193c138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:54.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.035+0000 7f1943ac4700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f193c099a60 con 0x7f193c09a730 2023-09-30T22:19:54.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.035+0000 7f1943ac4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193c09bf50 con 0x7f193c099e20 2023-09-30T22:19:54.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.035+0000 7f1943ac4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f193c09b230 con 0x7f193c130a60 2023-09-30T22:19:54.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.035+0000 7f1941860700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f193c099e20 0x7f193c09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:54.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.035+0000 7f1941860700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f193c099e20 0x7f193c09a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:36936/0 (socket says 172.21.15.156:36936) 2023-09-30T22:19:54.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.035+0000 7f1941860700 1 -- 172.21.15.156:0/1186387629 learned_addr learned my addr 172.21.15.156:0/1186387629 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:54.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.035+0000 7f1942061700 1 --2- 172.21.15.156:0/1186387629 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f193c130a60 0x7f193c138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:54.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.035+0000 7f194085e700 1 -- 172.21.15.156:0/1186387629 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396623912 0 0) 0x7f193c099a60 con 0x7f193c09a730 2023-09-30T22:19:54.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.035+0000 7f1942061700 1 -- 172.21.15.156:0/1186387629 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f193c099e20 msgr2=0x7f193c09a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:54.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.035+0000 7f1942061700 1 --2- 172.21.15.156:0/1186387629 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f193c099e20 0x7f193c09a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:54.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.035+0000 7f1942061700 1 -- 172.21.15.156:0/1186387629 >> v1:172.21.15.156:6789/0 conn(0x7f193c09a730 legacy=0x7f193c130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.035+0000 7f1942061700 1 -- 172.21.15.156:0/1186387629 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c09bb90 con 0x7f193c130a60 2023-09-30T22:19:54.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.035+0000 7f1941860700 1 --2- 172.21.15.156:0/1186387629 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f193c099e20 0x7f193c09a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:54.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.035+0000 7f1942061700 1 --2- 172.21.15.156:0/1186387629 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f193c130a60 0x7f193c138690 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1934009dc0 tx=0x7f193400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db51f319d51a04f9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:54.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.036+0000 7f194085e700 1 -- 172.21.15.156:0/1186387629 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193400e070 con 0x7f193c130a60 2023-09-30T22:19:54.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.036+0000 7f194085e700 1 -- 172.21.15.156:0/1186387629 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193400bb20 con 0x7f193c130a60 2023-09-30T22:19:54.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.036+0000 7f194085e700 1 -- 172.21.15.156:0/1186387629 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1934012430 con 0x7f193c130a60 2023-09-30T22:19:54.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.036+0000 7f1943ac4700 1 -- 172.21.15.156:0/1186387629 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f193c130a60 msgr2=0x7f193c138690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.036+0000 7f1943ac4700 1 --2- 172.21.15.156:0/1186387629 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f193c130a60 0x7f193c138690 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1934009dc0 tx=0x7f193400b330 comp rx=0 tx=0).stop 2023-09-30T22:19:54.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.036+0000 7f1943ac4700 1 -- 172.21.15.156:0/1186387629 shutdown_connections 2023-09-30T22:19:54.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.036+0000 7f1943ac4700 1 --2- 172.21.15.156:0/1186387629 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f193c099e20 0x7f193c09a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:54.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.036+0000 7f1943ac4700 1 --2- 172.21.15.156:0/1186387629 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f193c130a60 0x7f193c138690 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:54.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.036+0000 7f1943ac4700 1 -- 172.21.15.156:0/1186387629 >> 172.21.15.156:0/1186387629 conn(0x7f193c0a2980 msgr2=0x7f193c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:54.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.037+0000 7f1943ac4700 1 -- 172.21.15.156:0/1186387629 shutdown_connections 2023-09-30T22:19:54.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.037+0000 7f1943ac4700 1 -- 172.21.15.156:0/1186387629 wait complete. 2023-09-30T22:19:54.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.037+0000 7f1943ac4700 1 Processor -- start 2023-09-30T22:19:54.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.037+0000 7f1943ac4700 1 -- start start 2023-09-30T22:19:54.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.038+0000 7f1943ac4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f193c099e20 0x7f193c11a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:54.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.038+0000 7f1943ac4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f193c09a730 0x7f193c11ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:54.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.038+0000 7f1943ac4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f193c130a60 0x7f193c11b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:54.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.038+0000 7f1943ac4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c11c370 con 0x7f193c130a60 2023-09-30T22:19:54.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.038+0000 7f1943ac4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193c11d4b0 con 0x7f193c09a730 2023-09-30T22:19:54.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.038+0000 7f1943ac4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f193c09b470 con 0x7f193c099e20 2023-09-30T22:19:54.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.038+0000 7f1942061700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f193c130a60 0x7f193c11b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:54.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.038+0000 7f1942061700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f193c130a60 0x7f193c11b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51274/0 (socket says 172.21.15.156:51274) 2023-09-30T22:19:54.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.038+0000 7f1942061700 1 -- 172.21.15.156:0/2210393171 learned_addr learned my addr 172.21.15.156:0/2210393171 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:54.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.038+0000 7f194105f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f193c09a730 0x7f193c11ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:54.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.038+0000 7f1941860700 1 --2- 172.21.15.156:0/2210393171 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f193c099e20 0x7f193c11a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:54.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.038+0000 7f1942061700 1 -- 172.21.15.156:0/2210393171 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f193c099e20 msgr2=0x7f193c11a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.038+0000 7f1942061700 1 --2- 172.21.15.156:0/2210393171 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f193c099e20 0x7f193c11a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:54.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.038+0000 7f1942061700 1 -- 172.21.15.156:0/2210393171 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f193c09a730 msgr2=0x7f193c11ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.038+0000 7f1942061700 1 --2- 172.21.15.156:0/2210393171 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f193c09a730 0x7f193c11ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:54.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.038+0000 7f1942061700 1 -- 172.21.15.156:0/2210393171 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1938009500 con 0x7f193c130a60 2023-09-30T22:19:54.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.038+0000 7f1942061700 1 --2- 172.21.15.156:0/2210393171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f193c130a60 0x7f193c11b060 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f193400b370 tx=0x7f1934004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:54.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.039+0000 7f19327fc700 1 -- 172.21.15.156:0/2210393171 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1934012430 con 0x7f193c130a60 2023-09-30T22:19:54.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.039+0000 7f1943ac4700 1 -- 172.21.15.156:0/2210393171 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1934009a70 con 0x7f193c130a60 2023-09-30T22:19:54.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.039+0000 7f19327fc700 1 -- 172.21.15.156:0/2210393171 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1934020070 con 0x7f193c130a60 2023-09-30T22:19:54.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.039+0000 7f19327fc700 1 -- 172.21.15.156:0/2210393171 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1934004040 con 0x7f193c130a60 2023-09-30T22:19:54.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.039+0000 7f1943ac4700 1 -- 172.21.15.156:0/2210393171 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193c11cfd0 con 0x7f193c130a60 2023-09-30T22:19:54.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.040+0000 7f1943ac4700 1 -- 172.21.15.156:0/2210393171 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193c072480 con 0x7f193c130a60 2023-09-30T22:19:54.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.040+0000 7f19327fc700 1 -- 172.21.15.156:0/2210393171 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f19340041a0 con 0x7f193c130a60 2023-09-30T22:19:54.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.044+0000 7f19327fc700 1 -- 172.21.15.156:0/2210393171 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1934022070 con 0x7f193c130a60 2023-09-30T22:19:54.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.045+0000 7f19327fc700 1 -- 172.21.15.156:0/2210393171 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f193c072480 con 0x7f193c130a60 2023-09-30T22:19:54.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.122+0000 7f47e6332700 1 -- 172.21.15.156:0/1815068631 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f47e01266f0 con 0x7f47e009f180 2023-09-30T22:19:54.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.122+0000 7f47dcff9700 1 -- 172.21.15.156:0/1815068631 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f47d401b3b0 con 0x7f47e009f180 2023-09-30T22:19:54.125 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:54.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.123+0000 7fa1debdb700 1 Processor -- start 2023-09-30T22:19:54.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.123+0000 7fa1debdb700 1 -- start start 2023-09-30T22:19:54.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.123+0000 7fa1debdb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1d809e870 0x7fa1d809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:54.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.123+0000 7fa1debdb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa1d8131f40 0x7fa1d8139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:54.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.123+0000 7fa1debdb700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d809c970 con 0x7fa1d809f180 2023-09-30T22:19:54.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.123+0000 7fa1debdb700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d80a0920 con 0x7fa1d8131f40 2023-09-30T22:19:54.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.123+0000 7fa1debdb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d809f9c0 con 0x7fa1d809e870 2023-09-30T22:19:54.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.123+0000 7fa1dd178700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa1d8131f40 0x7fa1d8139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:54.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.123+0000 7fa1dd178700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa1d8131f40 0x7fa1d8139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51282/0 (socket says 172.21.15.156:51282) 2023-09-30T22:19:54.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.123+0000 7fa1d7fff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fa1d809f180 0x7fa1d8131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53200/0 (socket says 172.21.15.156:53200) 2023-09-30T22:19:54.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.123+0000 7fa1dd178700 1 -- 172.21.15.156:0/3182824915 learned_addr learned my addr 172.21.15.156:0/3182824915 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:54.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.124+0000 7fa1dd178700 1 -- 172.21.15.156:0/3182824915 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1d809e870 msgr2=0x7fa1d809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:54.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.124+0000 7fa1dd178700 1 --2- 172.21.15.156:0/3182824915 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1d809e870 0x7fa1d809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:54.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.124+0000 7fa1dd178700 1 -- 172.21.15.156:0/3182824915 >> v1:172.21.15.156:6789/0 conn(0x7fa1d809f180 legacy=0x7fa1d8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.124+0000 7fa1dd178700 1 -- 172.21.15.156:0/3182824915 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d809bab0 con 0x7fa1d8131f40 2023-09-30T22:19:54.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.124+0000 7fa1d77fe700 1 -- 172.21.15.156:0/3182824915 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 299500349 0 0) 0x7fa1d809c970 con 0x7fa1d809f180 2023-09-30T22:19:54.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.124+0000 7fa1dd178700 1 --2- 172.21.15.156:0/3182824915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1d8131f40 0x7fa1d8139ca0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0009e50 tx=0x7fa1d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e669210c6654cc0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:54.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.124+0000 7fa1d77fe700 1 -- 172.21.15.156:0/3182824915 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d000e070 con 0x7fa1d8131f40 2023-09-30T22:19:54.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.124+0000 7fa1d77fe700 1 -- 172.21.15.156:0/3182824915 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d000b9c0 con 0x7fa1d8131f40 2023-09-30T22:19:54.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.124+0000 7fa1d77fe700 1 -- 172.21.15.156:0/3182824915 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d000bd70 con 0x7fa1d8131f40 2023-09-30T22:19:54.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.125+0000 7fa1debdb700 1 -- 172.21.15.156:0/3182824915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1d8131f40 msgr2=0x7fa1d8139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.125+0000 7fa1debdb700 1 --2- 172.21.15.156:0/3182824915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1d8131f40 0x7fa1d8139ca0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0009e50 tx=0x7fa1d000b330 comp rx=0 tx=0).stop 2023-09-30T22:19:54.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.125+0000 7fa1debdb700 1 -- 172.21.15.156:0/3182824915 shutdown_connections 2023-09-30T22:19:54.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.125+0000 7fa1debdb700 1 --2- 172.21.15.156:0/3182824915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1d8131f40 0x7fa1d8139ca0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:54.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.125+0000 7fa1debdb700 1 --2- 172.21.15.156:0/3182824915 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1d809e870 0x7fa1d809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:54.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.125+0000 7fa1debdb700 1 -- 172.21.15.156:0/3182824915 >> 172.21.15.156:0/3182824915 conn(0x7fa1d80a4430 msgr2=0x7fa1d80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:54.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.125+0000 7fa1debdb700 1 -- 172.21.15.156:0/3182824915 shutdown_connections 2023-09-30T22:19:54.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.125+0000 7fa1debdb700 1 -- 172.21.15.156:0/3182824915 wait complete. 2023-09-30T22:19:54.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.126+0000 7fa1debdb700 1 Processor -- start 2023-09-30T22:19:54.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.126+0000 7f47e6332700 1 -- 172.21.15.156:0/1815068631 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47e009f180 msgr2=0x7f47e006bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.126+0000 7f47e6332700 1 --2- 172.21.15.156:0/1815068631 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47e009f180 0x7f47e006bdf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f47d400e980 tx=0x7f47d400ec90 comp rx=0 tx=0).stop 2023-09-30T22:19:54.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.126+0000 7fa1debdb700 1 -- start start 2023-09-30T22:19:54.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.127+0000 7f47e6332700 1 -- 172.21.15.156:0/1815068631 shutdown_connections 2023-09-30T22:19:54.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.127+0000 7f47e6332700 1 --2- 172.21.15.156:0/1815068631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47e0131d70 0x7f47e006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:54.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.127+0000 7f47e6332700 1 --2- 172.21.15.156:0/1815068631 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e009e870 0x7f47e006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:54.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.127+0000 7f47e6332700 1 --2- 172.21.15.156:0/1815068631 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47e009f180 0x7f47e006bdf0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:54.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.127+0000 7f47e6332700 1 -- 172.21.15.156:0/1815068631 >> 172.21.15.156:0/1815068631 conn(0x7f47e00a4430 msgr2=0x7f47e006fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:54.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.127+0000 7f47e6332700 1 -- 172.21.15.156:0/1815068631 shutdown_connections 2023-09-30T22:19:54.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.127+0000 7f47e6332700 1 -- 172.21.15.156:0/1815068631 wait complete. 2023-09-30T22:19:54.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.127+0000 7fa1debdb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1d809e870 0x7fa1d806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:54.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.127+0000 7fa1debdb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1d809f180 0x7fa1d806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:54.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.127+0000 7fa1debdb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1d8131f40 0x7fa1d806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:54.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.127+0000 7fa1debdb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d8125080 con 0x7fa1d809e870 2023-09-30T22:19:54.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.127+0000 7fa1debdb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d809dba0 con 0x7fa1d8131f40 2023-09-30T22:19:54.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.127+0000 7fa1debdb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d8124690 con 0x7fa1d809f180 2023-09-30T22:19:54.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.127+0000 7fa1d7fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1d809f180 0x7fa1d806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:54.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.127+0000 7fa1dd178700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1d8131f40 0x7fa1d806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:54.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.127+0000 7fa1d7fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1d809f180 0x7fa1d806bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48636/0 (socket says 172.21.15.156:48636) 2023-09-30T22:19:54.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.127+0000 7fa1d7fff700 1 -- 172.21.15.156:0/3872986644 learned_addr learned my addr 172.21.15.156:0/3872986644 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:54.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.127+0000 7fa1dd178700 1 -- 172.21.15.156:0/3872986644 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1d809f180 msgr2=0x7fa1d806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.127+0000 7fa1dd178700 1 --2- 172.21.15.156:0/3872986644 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1d809f180 0x7fa1d806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:54.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.127+0000 7fa1dd178700 1 -- 172.21.15.156:0/3872986644 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1d809e870 msgr2=0x7fa1d806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.127+0000 7fa1dd178700 1 --2- 172.21.15.156:0/3872986644 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1d809e870 0x7fa1d806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:54.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.127+0000 7fa1dd178700 1 -- 172.21.15.156:0/3872986644 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d0009b30 con 0x7fa1d8131f40 2023-09-30T22:19:54.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.127+0000 7fa1d7fff700 1 --2- 172.21.15.156:0/3872986644 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1d809f180 0x7fa1d806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:54.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.127+0000 7fa1dd178700 1 --2- 172.21.15.156:0/3872986644 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1d8131f40 0x7fa1d806c330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80673f0 tx=0x7fa1d0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:54.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.128+0000 7fa1d57fa700 1 -- 172.21.15.156:0/3872986644 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d00048f0 con 0x7fa1d8131f40 2023-09-30T22:19:54.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.128+0000 7fa1d57fa700 1 -- 172.21.15.156:0/3872986644 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d00092e0 con 0x7fa1d8131f40 2023-09-30T22:19:54.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.128+0000 7fa1debdb700 1 -- 172.21.15.156:0/3872986644 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d8125d40 con 0x7fa1d8131f40 2023-09-30T22:19:54.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.128+0000 7fa1d57fa700 1 -- 172.21.15.156:0/3872986644 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d001c630 con 0x7fa1d8131f40 2023-09-30T22:19:54.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.128+0000 7fa1debdb700 1 -- 172.21.15.156:0/3872986644 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d806d690 con 0x7fa1d8131f40 2023-09-30T22:19:54.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.129+0000 7fa1d57fa700 1 -- 172.21.15.156:0/3872986644 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa1d001c790 con 0x7fa1d8131f40 2023-09-30T22:19:54.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.129+0000 7fa1debdb700 1 -- 172.21.15.156:0/3872986644 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d804f2a0 con 0x7fa1d8131f40 2023-09-30T22:19:54.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.129+0000 7fa1d57fa700 1 -- 172.21.15.156:0/3872986644 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa1d0041390 con 0x7fa1d8131f40 2023-09-30T22:19:54.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.134+0000 7fa1d57fa700 1 -- 172.21.15.156:0/3872986644 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa1d0024400 con 0x7fa1d8131f40 2023-09-30T22:19:54.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:54.206 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.205+0000 7f61fad9b700 1 -- 172.21.15.156:0/14846469 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f61f404f2a0 con 0x7f61f4131d70 2023-09-30T22:19:54.206 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.206+0000 7f61f17fa700 1 -- 172.21.15.156:0/14846469 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f61ec029090 con 0x7f61f4131d70 2023-09-30T22:19:54.206 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:54.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.209+0000 7f61fad9b700 1 -- 172.21.15.156:0/14846469 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61f4131d70 msgr2=0x7f61f412f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.209+0000 7f61fad9b700 1 --2- 172.21.15.156:0/14846469 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61f4131d70 0x7f61f412f760 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f61ec00cc20 tx=0x7f61ec00cf30 comp rx=0 tx=0).stop 2023-09-30T22:19:54.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.209+0000 7f61fad9b700 1 -- 172.21.15.156:0/14846469 shutdown_connections 2023-09-30T22:19:54.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.209+0000 7f61fad9b700 1 --2- 172.21.15.156:0/14846469 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61f4131d70 0x7f61f412f760 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:54.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.209+0000 7f61fad9b700 1 --2- 172.21.15.156:0/14846469 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61f409e870 0x7f61f412ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:54.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.209+0000 7f61fad9b700 1 --2- 172.21.15.156:0/14846469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61f409f180 0x7f61f412f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:54.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.209+0000 7f61fad9b700 1 -- 172.21.15.156:0/14846469 >> 172.21.15.156:0/14846469 conn(0x7f61f40a4430 msgr2=0x7f61f409c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:54.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.209+0000 7f61fad9b700 1 -- 172.21.15.156:0/14846469 shutdown_connections 2023-09-30T22:19:54.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.209+0000 7f61fad9b700 1 -- 172.21.15.156:0/14846469 wait complete. 2023-09-30T22:19:54.226 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:54.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.244+0000 7f1943ac4700 1 -- 172.21.15.156:0/2210393171 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f193c072480 con 0x7f193c130a60 2023-09-30T22:19:54.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.244+0000 7f19327fc700 1 -- 172.21.15.156:0/2210393171 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f193c072480 con 0x7f193c130a60 2023-09-30T22:19:54.245 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:54.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.246+0000 7f1943ac4700 1 -- 172.21.15.156:0/2210393171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f193c130a60 msgr2=0x7f193c11b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.246+0000 7f1943ac4700 1 --2- 172.21.15.156:0/2210393171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f193c130a60 0x7f193c11b060 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f193400b370 tx=0x7f1934004ad0 comp rx=0 tx=0).stop 2023-09-30T22:19:54.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.246+0000 7f1943ac4700 1 -- 172.21.15.156:0/2210393171 shutdown_connections 2023-09-30T22:19:54.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.246+0000 7f1943ac4700 1 --2- 172.21.15.156:0/2210393171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f193c130a60 0x7f193c11b060 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:54.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.246+0000 7f1943ac4700 1 --2- 172.21.15.156:0/2210393171 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f193c099e20 0x7f193c11a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:54.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.246+0000 7f1943ac4700 1 --2- 172.21.15.156:0/2210393171 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f193c09a730 0x7f193c11ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:54.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.246+0000 7f1943ac4700 1 -- 172.21.15.156:0/2210393171 >> 172.21.15.156:0/2210393171 conn(0x7f193c0a2980 msgr2=0x7f193c12d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:54.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.246+0000 7f1943ac4700 1 -- 172.21.15.156:0/2210393171 shutdown_connections 2023-09-30T22:19:54.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.246+0000 7f1943ac4700 1 -- 172.21.15.156:0/2210393171 wait complete. 2023-09-30T22:19:54.258 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:54.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.335+0000 7fa1debdb700 1 -- 172.21.15.156:0/3872986644 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa1d8125b20 con 0x7fa1d8131f40 2023-09-30T22:19:54.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.335+0000 7fa1d57fa700 1 -- 172.21.15.156:0/3872986644 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa1d0029030 con 0x7fa1d8131f40 2023-09-30T22:19:54.336 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:54.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.337+0000 7fa1debdb700 1 -- 172.21.15.156:0/3872986644 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1d8131f40 msgr2=0x7fa1d806c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.337+0000 7fa1debdb700 1 --2- 172.21.15.156:0/3872986644 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1d8131f40 0x7fa1d806c330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80673f0 tx=0x7fa1d0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:19:54.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.337+0000 7fa1debdb700 1 -- 172.21.15.156:0/3872986644 shutdown_connections 2023-09-30T22:19:54.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.337+0000 7fa1debdb700 1 --2- 172.21.15.156:0/3872986644 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1d8131f40 0x7fa1d806c330 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:54.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.337+0000 7fa1debdb700 1 --2- 172.21.15.156:0/3872986644 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1d809e870 0x7fa1d806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:54.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.337+0000 7fa1debdb700 1 --2- 172.21.15.156:0/3872986644 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1d809f180 0x7fa1d806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:54.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.337+0000 7fa1debdb700 1 -- 172.21.15.156:0/3872986644 >> 172.21.15.156:0/3872986644 conn(0x7fa1d80a4430 msgr2=0x7fa1d80721a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:54.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.337+0000 7fa1debdb700 1 -- 172.21.15.156:0/3872986644 shutdown_connections 2023-09-30T22:19:54.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:54.337+0000 7fa1debdb700 1 -- 172.21.15.156:0/3872986644 wait complete. 2023-09-30T22:19:54.350 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:55.143 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:55.227 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:55.259 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:55.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.279+0000 7fc8c8d4c700 1 Processor -- start 2023-09-30T22:19:55.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.279+0000 7fc8c8d4c700 1 -- start start 2023-09-30T22:19:55.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.280+0000 7fc8c8d4c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc8c40a0a30 0x7fc8c40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:55.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.280+0000 7fc8c8d4c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8c40a1340 0x7fc8c412ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:55.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.280+0000 7fc8c8d4c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c40a1e70 con 0x7fc8c41304a0 2023-09-30T22:19:55.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.280+0000 7fc8c8d4c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c409a720 con 0x7fc8c40a0a30 2023-09-30T22:19:55.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.280+0000 7fc8c8d4c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c409b300 con 0x7fc8c40a1340 2023-09-30T22:19:55.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.280+0000 7fc8c2d9d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc8c41304a0 0x7fc8c41371b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53212/0 (socket says 172.21.15.156:53212) 2023-09-30T22:19:55.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.280+0000 7fc8c259c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc8c40a0a30 0x7fc8c40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:55.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.280+0000 7fc8c2d9d700 1 -- 172.21.15.156:0/873319872 learned_addr learned my addr 172.21.15.156:0/873319872 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:55.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.280+0000 7fc8c1d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8c40a1340 0x7fc8c412ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:55.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.280+0000 7fc8c1d9b700 1 -- 172.21.15.156:0/873319872 >> v2:172.21.15.156:3300/0 conn(0x7fc8c40a0a30 msgr2=0x7fc8c40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:55.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.280+0000 7fc8c1d9b700 1 --2- 172.21.15.156:0/873319872 >> v2:172.21.15.156:3300/0 conn(0x7fc8c40a0a30 0x7fc8c40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.280+0000 7fc8c1d9b700 1 -- 172.21.15.156:0/873319872 >> v1:172.21.15.156:6789/0 conn(0x7fc8c41304a0 legacy=0x7fc8c41371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.280+0000 7fc8c1d9b700 1 -- 172.21.15.156:0/873319872 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c409abc0 con 0x7fc8c40a1340 2023-09-30T22:19:55.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.280+0000 7fc8c259c700 1 --2- 172.21.15.156:0/873319872 >> v2:172.21.15.156:3300/0 conn(0x7fc8c40a0a30 0x7fc8c40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:55.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.280+0000 7fc8c1d9b700 1 --2- 172.21.15.156:0/873319872 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8c40a1340 0x7fc8c412ff60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8009840 tx=0x7fc8b8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f66ecd236f0445ad server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:55.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.280+0000 7fc8c159a700 1 -- 172.21.15.156:0/873319872 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8011830 con 0x7fc8c40a1340 2023-09-30T22:19:55.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.281+0000 7fc8c159a700 1 -- 172.21.15.156:0/873319872 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b8011990 con 0x7fc8c40a1340 2023-09-30T22:19:55.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.281+0000 7fc8c159a700 1 -- 172.21.15.156:0/873319872 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8011d20 con 0x7fc8c40a1340 2023-09-30T22:19:55.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.281+0000 7fc8c8d4c700 1 -- 172.21.15.156:0/873319872 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8c40a1340 msgr2=0x7fc8c412ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.281+0000 7fc8c8d4c700 1 --2- 172.21.15.156:0/873319872 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8c40a1340 0x7fc8c412ff60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8009840 tx=0x7fc8b8009b50 comp rx=0 tx=0).stop 2023-09-30T22:19:55.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.282+0000 7fc8c8d4c700 1 -- 172.21.15.156:0/873319872 shutdown_connections 2023-09-30T22:19:55.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.282+0000 7fc8c8d4c700 1 --2- 172.21.15.156:0/873319872 >> v2:172.21.15.156:3300/0 conn(0x7fc8c40a0a30 0x7fc8c40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.282+0000 7fc8c8d4c700 1 --2- 172.21.15.156:0/873319872 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8c40a1340 0x7fc8c412ff60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.282+0000 7fc8c8d4c700 1 -- 172.21.15.156:0/873319872 >> 172.21.15.156:0/873319872 conn(0x7fc8c40a2980 msgr2=0x7fc8c40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:55.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.282+0000 7fc8c8d4c700 1 -- 172.21.15.156:0/873319872 shutdown_connections 2023-09-30T22:19:55.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.282+0000 7fc8c8d4c700 1 -- 172.21.15.156:0/873319872 wait complete. 2023-09-30T22:19:55.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.284+0000 7fc8c8d4c700 1 Processor -- start 2023-09-30T22:19:55.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.284+0000 7fc8c8d4c700 1 -- start start 2023-09-30T22:19:55.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.284+0000 7fc8c8d4c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8c40a0a30 0x7fc8c411eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:55.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.284+0000 7fc8c8d4c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8c40a1340 0x7fc8c411f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:55.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.284+0000 7fc8c8d4c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8c41304a0 0x7fc8c41c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:55.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.284+0000 7fc8c8d4c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c4120090 con 0x7fc8c41304a0 2023-09-30T22:19:55.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.284+0000 7fc8c8d4c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c4120f00 con 0x7fc8c40a0a30 2023-09-30T22:19:55.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.284+0000 7fc8c8d4c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c411fea0 con 0x7fc8c40a1340 2023-09-30T22:19:55.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.284+0000 7fc8c1d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8c40a1340 0x7fc8c411f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:55.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.285+0000 7fc8c1d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8c40a1340 0x7fc8c411f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48652/0 (socket says 172.21.15.156:48652) 2023-09-30T22:19:55.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.285+0000 7fc8c1d9b700 1 -- 172.21.15.156:0/3234711359 learned_addr learned my addr 172.21.15.156:0/3234711359 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:55.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.285+0000 7fc8c259c700 1 --2- 172.21.15.156:0/3234711359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8c40a0a30 0x7fc8c411eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:55.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.285+0000 7fc8c2d9d700 1 --2- 172.21.15.156:0/3234711359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8c41304a0 0x7fc8c41c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:55.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.285+0000 7fc8c1d9b700 1 -- 172.21.15.156:0/3234711359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8c40a0a30 msgr2=0x7fc8c411eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.285+0000 7fc8c1d9b700 1 --2- 172.21.15.156:0/3234711359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8c40a0a30 0x7fc8c411eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.285+0000 7fc8c1d9b700 1 -- 172.21.15.156:0/3234711359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8c41304a0 msgr2=0x7fc8c41c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.285+0000 7fc8c1d9b700 1 --2- 172.21.15.156:0/3234711359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8c41304a0 0x7fc8c41c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.285+0000 7fc8c1d9b700 1 -- 172.21.15.156:0/3234711359 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b4009430 con 0x7fc8c40a1340 2023-09-30T22:19:55.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.285+0000 7fc8c259c700 1 --2- 172.21.15.156:0/3234711359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8c40a0a30 0x7fc8c411eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:55.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.285+0000 7fc8c1d9b700 1 --2- 172.21.15.156:0/3234711359 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8c40a1340 0x7fc8c411f0b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc8b80090b0 tx=0x7fc8b8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:55.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.285+0000 7fc8b2ffd700 1 -- 172.21.15.156:0/3234711359 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b80036a0 con 0x7fc8c40a1340 2023-09-30T22:19:55.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.285+0000 7fc8b2ffd700 1 -- 172.21.15.156:0/3234711359 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b801f070 con 0x7fc8c40a1340 2023-09-30T22:19:55.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.285+0000 7fc8b2ffd700 1 -- 172.21.15.156:0/3234711359 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8003a20 con 0x7fc8c40a1340 2023-09-30T22:19:55.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.285+0000 7fc8c8d4c700 1 -- 172.21.15.156:0/3234711359 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b80094a0 con 0x7fc8c40a1340 2023-09-30T22:19:55.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.285+0000 7fc8c8d4c700 1 -- 172.21.15.156:0/3234711359 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c409ae00 con 0x7fc8c40a1340 2023-09-30T22:19:55.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.286+0000 7fc8b2ffd700 1 -- 172.21.15.156:0/3234711359 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc8b8003b80 con 0x7fc8c40a1340 2023-09-30T22:19:55.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.286+0000 7fc8c8d4c700 1 -- 172.21.15.156:0/3234711359 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c404f2a0 con 0x7fc8c40a1340 2023-09-30T22:19:55.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.287+0000 7fc8b2ffd700 1 -- 172.21.15.156:0/3234711359 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc8b8021070 con 0x7fc8c40a1340 2023-09-30T22:19:55.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.291+0000 7fc8b2ffd700 1 -- 172.21.15.156:0/3234711359 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc8b80253e0 con 0x7fc8c40a1340 2023-09-30T22:19:55.351 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:55.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.359+0000 7fc8b58e5700 1 Processor -- start 2023-09-30T22:19:55.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.359+0000 7fc8b58e5700 1 -- start start 2023-09-30T22:19:55.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.360+0000 7fc8b58e5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc8b01368e0 0x7fc8b0138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:55.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.360+0000 7fc8b58e5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8b0139200 0x7fc8b013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:55.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.360+0000 7fc8b58e5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b009a760 con 0x7fc8b0133900 2023-09-30T22:19:55.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.360+0000 7fc8b58e5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b01336e0 con 0x7fc8b01368e0 2023-09-30T22:19:55.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.360+0000 7fc8ae7fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc8b01368e0 0x7fc8b0138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:55.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.360+0000 7fc8ae7fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc8b01368e0 0x7fc8b0138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51316/0 (socket says 172.21.15.156:51316) 2023-09-30T22:19:55.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.360+0000 7fc8ae7fc700 1 -- 172.21.15.156:0/3794989112 learned_addr learned my addr 172.21.15.156:0/3794989112 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:55.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.360+0000 7fc8b58e5700 1 -- 172.21.15.156:0/3794989112 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b009a080 con 0x7fc8b0139200 2023-09-30T22:19:55.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.360+0000 7fc8ae7fc700 1 -- 172.21.15.156:0/3794989112 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8b0139200 msgr2=0x7fc8b013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:55.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.360+0000 7fc8ae7fc700 1 --2- 172.21.15.156:0/3794989112 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8b0139200 0x7fc8b013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.360+0000 7fc8ae7fc700 1 -- 172.21.15.156:0/3794989112 >> v1:172.21.15.156:6789/0 conn(0x7fc8b0133900 legacy=0x7fc8b0133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.360+0000 7fc8ae7fc700 1 -- 172.21.15.156:0/3794989112 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b00a23e0 con 0x7fc8b01368e0 2023-09-30T22:19:55.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.361+0000 7fc8ae7fc700 1 --2- 172.21.15.156:0/3794989112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8b01368e0 0x7fc8b0138cc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc8a40098f0 tx=0x7fc8a4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973e9b87c1b1f3ff server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:55.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.361+0000 7fc8adffb700 1 -- 172.21.15.156:0/3794989112 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a400b8a0 con 0x7fc8b01368e0 2023-09-30T22:19:55.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.361+0000 7fc8adffb700 1 -- 172.21.15.156:0/3794989112 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a400ba00 con 0x7fc8b01368e0 2023-09-30T22:19:55.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.361+0000 7fc8adffb700 1 -- 172.21.15.156:0/3794989112 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a400bd90 con 0x7fc8b01368e0 2023-09-30T22:19:55.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.361+0000 7fc8b58e5700 1 -- 172.21.15.156:0/3794989112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8b01368e0 msgr2=0x7fc8b0138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.361+0000 7fc8b58e5700 1 --2- 172.21.15.156:0/3794989112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8b01368e0 0x7fc8b0138cc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc8a40098f0 tx=0x7fc8a4009c00 comp rx=0 tx=0).stop 2023-09-30T22:19:55.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.362+0000 7fc8b58e5700 1 -- 172.21.15.156:0/3794989112 shutdown_connections 2023-09-30T22:19:55.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.362+0000 7fc8b58e5700 1 --2- 172.21.15.156:0/3794989112 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8b0139200 0x7fc8b013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.362+0000 7fc8b58e5700 1 --2- 172.21.15.156:0/3794989112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8b01368e0 0x7fc8b0138cc0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.362+0000 7fc8b58e5700 1 -- 172.21.15.156:0/3794989112 >> 172.21.15.156:0/3794989112 conn(0x7fc8b00a2980 msgr2=0x7fc8b00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:55.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.362+0000 7fc8b58e5700 1 -- 172.21.15.156:0/3794989112 shutdown_connections 2023-09-30T22:19:55.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.362+0000 7fc8b58e5700 1 -- 172.21.15.156:0/3794989112 wait complete. 2023-09-30T22:19:55.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.363+0000 7fc8b58e5700 1 Processor -- start 2023-09-30T22:19:55.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.363+0000 7fc8b58e5700 1 -- start start 2023-09-30T22:19:55.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.364+0000 7fc8b58e5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8b0133900 0x7fc8b0119e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:55.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.364+0000 7fc8b58e5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8b01368e0 0x7fc8b011a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:55.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.364+0000 7fc8b58e5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8b0139200 0x7fc8b011a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:55.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.364+0000 7fc8b58e5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b012fdd0 con 0x7fc8b0133900 2023-09-30T22:19:55.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.364+0000 7fc8b58e5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b011bb20 con 0x7fc8b01368e0 2023-09-30T22:19:55.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.364+0000 7fc8b58e5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b01358e0 con 0x7fc8b0139200 2023-09-30T22:19:55.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.364+0000 7fc8ae7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8b01368e0 0x7fc8b011a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:55.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.364+0000 7fc8ae7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8b01368e0 0x7fc8b011a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:36984/0 (socket says 172.21.15.156:36984) 2023-09-30T22:19:55.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.364+0000 7fc8ae7fc700 1 -- 172.21.15.156:0/2932009269 learned_addr learned my addr 172.21.15.156:0/2932009269 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:55.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.364+0000 7fc8aeffd700 1 --2- 172.21.15.156:0/2932009269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8b0133900 0x7fc8b0119e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:55.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.364+0000 7fc8ae7fc700 1 -- 172.21.15.156:0/2932009269 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8b0139200 msgr2=0x7fc8b011a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.364+0000 7fc8ae7fc700 1 --2- 172.21.15.156:0/2932009269 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8b0139200 0x7fc8b011a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.364+0000 7fc8ae7fc700 1 -- 172.21.15.156:0/2932009269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8b0133900 msgr2=0x7fc8b0119e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.364+0000 7fc8ae7fc700 1 --2- 172.21.15.156:0/2932009269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8b0133900 0x7fc8b0119e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.364+0000 7fc8ae7fc700 1 -- 172.21.15.156:0/2932009269 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a4009550 con 0x7fc8b01368e0 2023-09-30T22:19:55.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.364+0000 7fc8aeffd700 1 --2- 172.21.15.156:0/2932009269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8b0133900 0x7fc8b0119e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:55.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.364+0000 7fc8ae7fc700 1 --2- 172.21.15.156:0/2932009269 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8b01368e0 0x7fc8b011a340 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4000c00 tx=0x7fc8a4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:55.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.365+0000 7fc897fff700 1 -- 172.21.15.156:0/2932009269 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4004550 con 0x7fc8b01368e0 2023-09-30T22:19:55.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.365+0000 7fc897fff700 1 -- 172.21.15.156:0/2932009269 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a401f070 con 0x7fc8b01368e0 2023-09-30T22:19:55.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.365+0000 7fc897fff700 1 -- 172.21.15.156:0/2932009269 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a40038c0 con 0x7fc8b01368e0 2023-09-30T22:19:55.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.365+0000 7fc8b58e5700 1 -- 172.21.15.156:0/2932009269 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b011d3e0 con 0x7fc8b01368e0 2023-09-30T22:19:55.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.365+0000 7fc8b58e5700 1 -- 172.21.15.156:0/2932009269 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b011bf60 con 0x7fc8b01368e0 2023-09-30T22:19:55.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.366+0000 7fc8b58e5700 1 -- 172.21.15.156:0/2932009269 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8b011d570 con 0x7fc8b01368e0 2023-09-30T22:19:55.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.367+0000 7fc897fff700 1 -- 172.21.15.156:0/2932009269 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc8a4003a20 con 0x7fc8b01368e0 2023-09-30T22:19:55.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.367+0000 7fc897fff700 1 -- 172.21.15.156:0/2932009269 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc8a4021070 con 0x7fc8b01368e0 2023-09-30T22:19:55.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.371+0000 7fc897fff700 1 -- 172.21.15.156:0/2932009269 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc8a402fe00 con 0x7fc8b01368e0 2023-09-30T22:19:55.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.408+0000 7f9e2a150700 1 Processor -- start 2023-09-30T22:19:55.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.408+0000 7f9e2a150700 1 -- start start 2023-09-30T22:19:55.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.409+0000 7f9e2a150700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9e24138040 0x7f9e24138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:55.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.409+0000 7f9e2a150700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9e240a08e0 0x7f9e240a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:55.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.409+0000 7f9e2a150700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e241379e0 con 0x7f9e240a1230 2023-09-30T22:19:55.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.409+0000 7f9e2a150700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e240a2100 con 0x7f9e240a08e0 2023-09-30T22:19:55.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.409+0000 7f9e2a150700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e24138950 con 0x7f9e24138040 2023-09-30T22:19:55.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.409+0000 7f9e237fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9e24138040 0x7f9e24138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:55.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.409+0000 7f9e237fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9e24138040 0x7f9e24138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48668/0 (socket says 172.21.15.156:48668) 2023-09-30T22:19:55.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.409+0000 7f9e237fe700 1 -- 172.21.15.156:0/1934682872 learned_addr learned my addr 172.21.15.156:0/1934682872 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:55.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.409+0000 7f9e23fff700 1 --1- 172.21.15.156:0/1934682872 >> v1:172.21.15.156:6789/0 conn(0x7f9e240a1230 0x7f9e2413ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53242/0 (socket says 172.21.15.156:53242) 2023-09-30T22:19:55.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.409+0000 7f9e227fc700 1 -- 172.21.15.156:0/1934682872 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2075692314 0 0) 0x7f9e241379e0 con 0x7f9e240a1230 2023-09-30T22:19:55.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.409+0000 7f9e227fc700 1 -- 172.21.15.156:0/1934682872 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e0c0035b0 con 0x7f9e240a1230 2023-09-30T22:19:55.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.410+0000 7f9e237fe700 1 -- 172.21.15.156:0/1934682872 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9e240a08e0 msgr2=0x7f9e240a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:55.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.410+0000 7f9e22ffd700 1 --2- 172.21.15.156:0/1934682872 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9e240a08e0 0x7f9e240a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:55.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.410+0000 7f9e237fe700 1 --2- 172.21.15.156:0/1934682872 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9e240a08e0 0x7f9e240a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.410+0000 7f9e237fe700 1 -- 172.21.15.156:0/1934682872 >> v1:172.21.15.156:6789/0 conn(0x7f9e240a1230 legacy=0x7f9e2413ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.410+0000 7f9e237fe700 1 -- 172.21.15.156:0/1934682872 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2409b9b0 con 0x7f9e24138040 2023-09-30T22:19:55.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.410+0000 7f9e22ffd700 1 --2- 172.21.15.156:0/1934682872 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9e240a08e0 0x7f9e240a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:19:55.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.410+0000 7f9e237fe700 1 --2- 172.21.15.156:0/1934682872 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9e24138040 0x7f9e24138410 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9e14009920 tx=0x7f9e14009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=948a45b3b1a5a5f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:55.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.410+0000 7f9e227fc700 1 -- 172.21.15.156:0/1934682872 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e14005e30 con 0x7f9e24138040 2023-09-30T22:19:55.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.410+0000 7f9e227fc700 1 -- 172.21.15.156:0/1934682872 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e14004030 con 0x7f9e24138040 2023-09-30T22:19:55.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.410+0000 7f9e227fc700 1 -- 172.21.15.156:0/1934682872 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e140043a0 con 0x7f9e24138040 2023-09-30T22:19:55.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.411+0000 7f9e2a150700 1 -- 172.21.15.156:0/1934682872 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9e24138040 msgr2=0x7f9e24138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.411+0000 7f9e2a150700 1 --2- 172.21.15.156:0/1934682872 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9e24138040 0x7f9e24138410 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9e14009920 tx=0x7f9e14009c30 comp rx=0 tx=0).stop 2023-09-30T22:19:55.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.411+0000 7f9e2a150700 1 -- 172.21.15.156:0/1934682872 shutdown_connections 2023-09-30T22:19:55.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.411+0000 7f9e2a150700 1 --2- 172.21.15.156:0/1934682872 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9e24138040 0x7f9e24138410 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.411+0000 7f9e2a150700 1 --2- 172.21.15.156:0/1934682872 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9e240a08e0 0x7f9e240a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.411+0000 7f9e2a150700 1 -- 172.21.15.156:0/1934682872 >> 172.21.15.156:0/1934682872 conn(0x7f9e240a2980 msgr2=0x7f9e240a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:55.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.411+0000 7f9e2a150700 1 -- 172.21.15.156:0/1934682872 shutdown_connections 2023-09-30T22:19:55.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.411+0000 7f9e2a150700 1 -- 172.21.15.156:0/1934682872 wait complete. 2023-09-30T22:19:55.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.412+0000 7f9e2a150700 1 Processor -- start 2023-09-30T22:19:55.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.412+0000 7f9e2a150700 1 -- start start 2023-09-30T22:19:55.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.412+0000 7f9e2a150700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9e240a08e0 0x7f9e24126180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:55.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.412+0000 7f9e2a150700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e240a1230 0x7f9e241266c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:55.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.412+0000 7f9e2a150700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9e24138040 0x7f9e24126c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:55.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.412+0000 7f9e2a150700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e24128fe0 con 0x7f9e240a1230 2023-09-30T22:19:55.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.412+0000 7f9e2a150700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e241275e0 con 0x7f9e24138040 2023-09-30T22:19:55.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.412+0000 7f9e2a150700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e24127f10 con 0x7f9e240a08e0 2023-09-30T22:19:55.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.412+0000 7f9e237fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9e240a08e0 0x7f9e24126180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:55.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.413+0000 7f9e237fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9e240a08e0 0x7f9e24126180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48678/0 (socket says 172.21.15.156:48678) 2023-09-30T22:19:55.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.413+0000 7f9e237fe700 1 -- 172.21.15.156:0/2715058675 learned_addr learned my addr 172.21.15.156:0/2715058675 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:55.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.413+0000 7f9e23fff700 1 --2- 172.21.15.156:0/2715058675 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9e24138040 0x7f9e24126c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:55.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.413+0000 7f9e22ffd700 1 --2- 172.21.15.156:0/2715058675 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e240a1230 0x7f9e241266c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:55.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.413+0000 7f9e237fe700 1 -- 172.21.15.156:0/2715058675 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9e24138040 msgr2=0x7f9e24126c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.413+0000 7f9e237fe700 1 --2- 172.21.15.156:0/2715058675 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9e24138040 0x7f9e24126c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.413+0000 7f9e237fe700 1 -- 172.21.15.156:0/2715058675 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e240a1230 msgr2=0x7f9e241266c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.413+0000 7f9e237fe700 1 --2- 172.21.15.156:0/2715058675 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e240a1230 0x7f9e241266c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.413+0000 7f9e237fe700 1 -- 172.21.15.156:0/2715058675 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e14009500 con 0x7f9e240a08e0 2023-09-30T22:19:55.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.413+0000 7f9e237fe700 1 --2- 172.21.15.156:0/2715058675 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9e240a08e0 0x7f9e24126180 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9e14000c00 tx=0x7f9e14004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:55.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.413+0000 7f9e0bfff700 1 -- 172.21.15.156:0/2715058675 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e14003b70 con 0x7f9e240a08e0 2023-09-30T22:19:55.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.413+0000 7f9e0bfff700 1 -- 172.21.15.156:0/2715058675 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e14003cd0 con 0x7f9e240a08e0 2023-09-30T22:19:55.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.413+0000 7f9e2a150700 1 -- 172.21.15.156:0/2715058675 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e2409a240 con 0x7f9e240a08e0 2023-09-30T22:19:55.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.413+0000 7f9e0bfff700 1 -- 172.21.15.156:0/2715058675 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1401c660 con 0x7f9e240a08e0 2023-09-30T22:19:55.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.413+0000 7f9e2a150700 1 -- 172.21.15.156:0/2715058675 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e241299c0 con 0x7f9e240a08e0 2023-09-30T22:19:55.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.415+0000 7f9e0bfff700 1 -- 172.21.15.156:0/2715058675 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9e1401c7c0 con 0x7f9e240a08e0 2023-09-30T22:19:55.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.415+0000 7f9e0bfff700 1 -- 172.21.15.156:0/2715058675 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9e140407b0 con 0x7f9e240a08e0 2023-09-30T22:19:55.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.415+0000 7f9e2a150700 1 -- 172.21.15.156:0/2715058675 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e2404f2a0 con 0x7f9e240a08e0 2023-09-30T22:19:55.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.419+0000 7f9e0bfff700 1 -- 172.21.15.156:0/2715058675 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9e14016070 con 0x7f9e240a08e0 2023-09-30T22:19:55.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.490+0000 7f2ebd851700 1 Processor -- start 2023-09-30T22:19:55.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.490+0000 7f2ebd851700 1 -- start start 2023-09-30T22:19:55.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.490+0000 7f2ebd851700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2eb80a0a70 0x7f2eb80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:55.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.490+0000 7f2ebd851700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2eb80a1380 0x7f2eb8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:55.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.490+0000 7f2ebd851700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2eb8133f50 0x7f2eb8134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:55.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.490+0000 7f2ebd851700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb809e9d0 con 0x7f2eb80a1380 2023-09-30T22:19:55.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.490+0000 7f2ebd851700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb809dc00 con 0x7f2eb80a0a70 2023-09-30T22:19:55.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.490+0000 7f2ebd851700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb809dec0 con 0x7f2eb8133f50 2023-09-30T22:19:55.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.491+0000 7f2eb6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2eb80a0a70 0x7f2eb80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:55.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.491+0000 7f2eb67fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2eb80a1380 0x7f2eb8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:55.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.491+0000 7f2eb6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2eb80a0a70 0x7f2eb80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37018/0 (socket says 172.21.15.156:37018) 2023-09-30T22:19:55.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.491+0000 7f2eb6ffd700 1 -- 172.21.15.156:0/755579571 learned_addr learned my addr 172.21.15.156:0/755579571 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:55.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.491+0000 7f2eb77fe700 1 --2- 172.21.15.156:0/755579571 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2eb8133f50 0x7f2eb8134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:55.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.491+0000 7f2eb6ffd700 1 -- 172.21.15.156:0/755579571 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2eb8133f50 msgr2=0x7f2eb8134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:55.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.491+0000 7f2eb6ffd700 1 --2- 172.21.15.156:0/755579571 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2eb8133f50 0x7f2eb8134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.491+0000 7f2eb6ffd700 1 -- 172.21.15.156:0/755579571 >> v2:172.21.15.156:3300/0 conn(0x7f2eb80a1380 msgr2=0x7f2eb8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:55.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.491+0000 7f2eb6ffd700 1 --2- 172.21.15.156:0/755579571 >> v2:172.21.15.156:3300/0 conn(0x7f2eb80a1380 0x7f2eb8133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.491+0000 7f2eb6ffd700 1 -- 172.21.15.156:0/755579571 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb809e6a0 con 0x7f2eb80a0a70 2023-09-30T22:19:55.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.491+0000 7f2eb67fc700 1 --2- 172.21.15.156:0/755579571 >> v2:172.21.15.156:3300/0 conn(0x7f2eb80a1380 0x7f2eb8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:55.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.491+0000 7f2eb6ffd700 1 --2- 172.21.15.156:0/755579571 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2eb80a0a70 0x7f2eb80a0e40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2ea80098f0 tx=0x7f2ea8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa5d98ac2430e1a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:55.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.491+0000 7f2eb5ffb700 1 -- 172.21.15.156:0/755579571 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8011830 con 0x7f2eb80a0a70 2023-09-30T22:19:55.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.491+0000 7f2eb5ffb700 1 -- 172.21.15.156:0/755579571 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea8011990 con 0x7f2eb80a0a70 2023-09-30T22:19:55.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.491+0000 7f2eb5ffb700 1 -- 172.21.15.156:0/755579571 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8011d20 con 0x7f2eb80a0a70 2023-09-30T22:19:55.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.492+0000 7f2ebd851700 1 -- 172.21.15.156:0/755579571 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2eb80a0a70 msgr2=0x7f2eb80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.492+0000 7f2ebd851700 1 --2- 172.21.15.156:0/755579571 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2eb80a0a70 0x7f2eb80a0e40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2ea80098f0 tx=0x7f2ea8009c00 comp rx=0 tx=0).stop 2023-09-30T22:19:55.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.492+0000 7f2ebd851700 1 -- 172.21.15.156:0/755579571 shutdown_connections 2023-09-30T22:19:55.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.492+0000 7f2ebd851700 1 --2- 172.21.15.156:0/755579571 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2eb8133f50 0x7f2eb8134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.492+0000 7f2ebd851700 1 --2- 172.21.15.156:0/755579571 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2eb80a0a70 0x7f2eb80a0e40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.492+0000 7f2ebd851700 1 --2- 172.21.15.156:0/755579571 >> v2:172.21.15.156:3300/0 conn(0x7f2eb80a1380 0x7f2eb8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.492+0000 7f2ebd851700 1 -- 172.21.15.156:0/755579571 >> 172.21.15.156:0/755579571 conn(0x7f2eb80a6610 msgr2=0x7f2eb80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:55.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.492+0000 7f2ebd851700 1 -- 172.21.15.156:0/755579571 shutdown_connections 2023-09-30T22:19:55.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.492+0000 7f2ebd851700 1 -- 172.21.15.156:0/755579571 wait complete. 2023-09-30T22:19:55.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.493+0000 7f2ebd851700 1 Processor -- start 2023-09-30T22:19:55.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.493+0000 7f2ebd851700 1 -- start start 2023-09-30T22:19:55.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.494+0000 7f2ebd851700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2eb80a0a70 0x7f2eb81224e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:55.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.494+0000 7f2ebd851700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2eb80a1380 0x7f2eb8122a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:55.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.494+0000 7f2ebd851700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2eb8133f50 0x7f2eb8122f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:55.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.494+0000 7f2ebd851700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb8124ed0 con 0x7f2eb80a1380 2023-09-30T22:19:55.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.494+0000 7f2ebd851700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb81241c0 con 0x7f2eb8133f50 2023-09-30T22:19:55.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.494+0000 7f2ebd851700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb8123fd0 con 0x7f2eb80a0a70 2023-09-30T22:19:55.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.494+0000 7f2eb77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2eb8133f50 0x7f2eb8122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:55.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.494+0000 7f2eb77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2eb8133f50 0x7f2eb8122f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37020/0 (socket says 172.21.15.156:37020) 2023-09-30T22:19:55.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.494+0000 7f2eb67fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2eb80a1380 0x7f2eb8122a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:55.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.494+0000 7f2eb77fe700 1 -- 172.21.15.156:0/1981320004 learned_addr learned my addr 172.21.15.156:0/1981320004 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:55.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.494+0000 7f2eb6ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2eb80a0a70 0x7f2eb81224e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:55.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.494+0000 7f2eb67fc700 1 -- 172.21.15.156:0/1981320004 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2eb80a0a70 msgr2=0x7f2eb81224e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.494+0000 7f2eb67fc700 1 --2- 172.21.15.156:0/1981320004 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2eb80a0a70 0x7f2eb81224e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.494+0000 7f2eb67fc700 1 -- 172.21.15.156:0/1981320004 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2eb8133f50 msgr2=0x7f2eb8122f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.494+0000 7f2eb67fc700 1 --2- 172.21.15.156:0/1981320004 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2eb8133f50 0x7f2eb8122f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.494+0000 7f2eb67fc700 1 -- 172.21.15.156:0/1981320004 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac0094a0 con 0x7f2eb80a1380 2023-09-30T22:19:55.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.494+0000 7f2eb67fc700 1 --2- 172.21.15.156:0/1981320004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2eb80a1380 0x7f2eb8122a20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2eb80a2b70 tx=0x7f2eac00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:55.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.495+0000 7f2e9ffff700 1 -- 172.21.15.156:0/1981320004 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac004240 con 0x7f2eb80a1380 2023-09-30T22:19:55.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.495+0000 7f2e9ffff700 1 -- 172.21.15.156:0/1981320004 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac0043a0 con 0x7f2eb80a1380 2023-09-30T22:19:55.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.495+0000 7f2ebd851700 1 -- 172.21.15.156:0/1981320004 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea8009550 con 0x7f2eb80a1380 2023-09-30T22:19:55.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.495+0000 7f2e9ffff700 1 -- 172.21.15.156:0/1981320004 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0036a0 con 0x7f2eb80a1380 2023-09-30T22:19:55.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.495+0000 7f2ebd851700 1 -- 172.21.15.156:0/1981320004 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb8125f30 con 0x7f2eb80a1380 2023-09-30T22:19:55.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.496+0000 7f2e9ffff700 1 -- 172.21.15.156:0/1981320004 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2eac003800 con 0x7f2eb80a1380 2023-09-30T22:19:55.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.496+0000 7f2e9ffff700 1 -- 172.21.15.156:0/1981320004 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2eac03f760 con 0x7f2eb80a1380 2023-09-30T22:19:55.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.496+0000 7f2ebd851700 1 -- 172.21.15.156:0/1981320004 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb8125f30 con 0x7f2eb80a1380 2023-09-30T22:19:55.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.501+0000 7f2e9ffff700 1 -- 172.21.15.156:0/1981320004 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2eb8125f30 con 0x7f2eb80a1380 2023-09-30T22:19:55.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.517+0000 7fc8c8d4c700 1 -- 172.21.15.156:0/3234711359 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc8c406bce0 con 0x7fc8c40a1340 2023-09-30T22:19:55.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.517+0000 7fc8b2ffd700 1 -- 172.21.15.156:0/3234711359 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc8b8015030 con 0x7fc8c40a1340 2023-09-30T22:19:55.519 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:55.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.519+0000 7fc8c8d4c700 1 -- 172.21.15.156:0/3234711359 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8c40a1340 msgr2=0x7fc8c411f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.519+0000 7fc8c8d4c700 1 --2- 172.21.15.156:0/3234711359 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8c40a1340 0x7fc8c411f0b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc8b80090b0 tx=0x7fc8b8004750 comp rx=0 tx=0).stop 2023-09-30T22:19:55.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.520+0000 7fc8c8d4c700 1 -- 172.21.15.156:0/3234711359 shutdown_connections 2023-09-30T22:19:55.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.520+0000 7fc8c8d4c700 1 --2- 172.21.15.156:0/3234711359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8c41304a0 0x7fc8c41c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.520+0000 7fc8c8d4c700 1 --2- 172.21.15.156:0/3234711359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8c40a0a30 0x7fc8c411eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.520+0000 7fc8c8d4c700 1 --2- 172.21.15.156:0/3234711359 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8c40a1340 0x7fc8c411f0b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.520+0000 7fc8c8d4c700 1 -- 172.21.15.156:0/3234711359 >> 172.21.15.156:0/3234711359 conn(0x7fc8c40a2980 msgr2=0x7fc8c409e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:55.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.520+0000 7fc8c8d4c700 1 -- 172.21.15.156:0/3234711359 shutdown_connections 2023-09-30T22:19:55.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.520+0000 7fc8c8d4c700 1 -- 172.21.15.156:0/3234711359 wait complete. 2023-09-30T22:19:55.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:55.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.618+0000 7fc8b58e5700 1 -- 172.21.15.156:0/2932009269 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc8b004f2a0 con 0x7fc8b01368e0 2023-09-30T22:19:55.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.619+0000 7fc897fff700 1 -- 172.21.15.156:0/2932009269 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc8a4015020 con 0x7fc8b01368e0 2023-09-30T22:19:55.620 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:55.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.621+0000 7fc8b58e5700 1 -- 172.21.15.156:0/2932009269 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8b01368e0 msgr2=0x7fc8b011a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.621+0000 7fc8b58e5700 1 --2- 172.21.15.156:0/2932009269 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8b01368e0 0x7fc8b011a340 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4000c00 tx=0x7fc8a4004750 comp rx=0 tx=0).stop 2023-09-30T22:19:55.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.621+0000 7fc8b58e5700 1 -- 172.21.15.156:0/2932009269 shutdown_connections 2023-09-30T22:19:55.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.621+0000 7fc8b58e5700 1 --2- 172.21.15.156:0/2932009269 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8b0139200 0x7fc8b011a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.621+0000 7fc8b58e5700 1 --2- 172.21.15.156:0/2932009269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8b0133900 0x7fc8b0119e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.621+0000 7fc8b58e5700 1 --2- 172.21.15.156:0/2932009269 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8b01368e0 0x7fc8b011a340 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.621+0000 7fc8b58e5700 1 -- 172.21.15.156:0/2932009269 >> 172.21.15.156:0/2932009269 conn(0x7fc8b00a2980 msgr2=0x7fc8b0131c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:55.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.621+0000 7fc8b58e5700 1 -- 172.21.15.156:0/2932009269 shutdown_connections 2023-09-30T22:19:55.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.621+0000 7fc8b58e5700 1 -- 172.21.15.156:0/2932009269 wait complete. 2023-09-30T22:19:55.634 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:55.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.633+0000 7f9e2a150700 1 -- 172.21.15.156:0/2715058675 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9e24128c20 con 0x7f9e240a08e0 2023-09-30T22:19:55.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.634+0000 7f9e0bfff700 1 -- 172.21.15.156:0/2715058675 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9e14033090 con 0x7f9e240a08e0 2023-09-30T22:19:55.635 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:55.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.636+0000 7f9e2a150700 1 -- 172.21.15.156:0/2715058675 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9e240a08e0 msgr2=0x7f9e24126180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.636+0000 7f9e2a150700 1 --2- 172.21.15.156:0/2715058675 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9e240a08e0 0x7f9e24126180 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9e14000c00 tx=0x7f9e14004750 comp rx=0 tx=0).stop 2023-09-30T22:19:55.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.636+0000 7f9e2a150700 1 -- 172.21.15.156:0/2715058675 shutdown_connections 2023-09-30T22:19:55.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.636+0000 7f9e2a150700 1 --2- 172.21.15.156:0/2715058675 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9e24138040 0x7f9e24126c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.636+0000 7f9e2a150700 1 --2- 172.21.15.156:0/2715058675 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9e240a08e0 0x7f9e24126180 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.636+0000 7f9e2a150700 1 --2- 172.21.15.156:0/2715058675 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e240a1230 0x7f9e241266c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.636+0000 7f9e2a150700 1 -- 172.21.15.156:0/2715058675 >> 172.21.15.156:0/2715058675 conn(0x7f9e240a2980 msgr2=0x7f9e2409e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:55.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.636+0000 7f9e2a150700 1 -- 172.21.15.156:0/2715058675 shutdown_connections 2023-09-30T22:19:55.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.636+0000 7f9e2a150700 1 -- 172.21.15.156:0/2715058675 wait complete. 2023-09-30T22:19:55.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:55.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.722+0000 7f2ebd851700 1 -- 172.21.15.156:0/1981320004 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2eb8125f30 con 0x7f2eb80a1380 2023-09-30T22:19:55.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.722+0000 7f2e9ffff700 1 -- 172.21.15.156:0/1981320004 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2eb8125f30 con 0x7f2eb80a1380 2023-09-30T22:19:55.723 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:55.725 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.724+0000 7f2ebd851700 1 -- 172.21.15.156:0/1981320004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2eb80a1380 msgr2=0x7f2eb8122a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.724+0000 7f2ebd851700 1 --2- 172.21.15.156:0/1981320004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2eb80a1380 0x7f2eb8122a20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2eb80a2b70 tx=0x7f2eac00ec60 comp rx=0 tx=0).stop 2023-09-30T22:19:55.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.724+0000 7f2ebd851700 1 -- 172.21.15.156:0/1981320004 shutdown_connections 2023-09-30T22:19:55.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.724+0000 7f2ebd851700 1 --2- 172.21.15.156:0/1981320004 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2eb8133f50 0x7f2eb8122f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.724+0000 7f2ebd851700 1 --2- 172.21.15.156:0/1981320004 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2eb80a0a70 0x7f2eb81224e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.724+0000 7f2ebd851700 1 --2- 172.21.15.156:0/1981320004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2eb80a1380 0x7f2eb8122a20 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:55.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.724+0000 7f2ebd851700 1 -- 172.21.15.156:0/1981320004 >> 172.21.15.156:0/1981320004 conn(0x7f2eb80a6610 msgr2=0x7f2eb809c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:55.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.725+0000 7f2ebd851700 1 -- 172.21.15.156:0/1981320004 shutdown_connections 2023-09-30T22:19:55.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:55.725+0000 7f2ebd851700 1 -- 172.21.15.156:0/1981320004 wait complete. 2023-09-30T22:19:55.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:56.534 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:56.634 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:56.649 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:56.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.667+0000 7f4d197dc700 1 Processor -- start 2023-09-30T22:19:56.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.667+0000 7f4d197dc700 1 -- start start 2023-09-30T22:19:56.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.667+0000 7f4d197dc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d14136960 0x7f4d14138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:56.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.667+0000 7f4d197dc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d14139280 0x7f4d1413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:56.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.667+0000 7f4d197dc700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d1406b2d0 con 0x7f4d14133ad0 2023-09-30T22:19:56.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.667+0000 7f4d197dc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d141345b0 con 0x7f4d14139280 2023-09-30T22:19:56.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.667+0000 7f4d197dc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d14133610 con 0x7f4d14136960 2023-09-30T22:19:56.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.667+0000 7f4d137fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d14139280 0x7f4d1413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:56.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.667+0000 7f4d127fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d14136960 0x7f4d14138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:56.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.667+0000 7f4d12ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4d14133ad0 0x7f4d14133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53250/0 (socket says 172.21.15.156:53250) 2023-09-30T22:19:56.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.667+0000 7f4d12ffd700 1 -- 172.21.15.156:0/4155927938 learned_addr learned my addr 172.21.15.156:0/4155927938 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:56.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.667+0000 7f4d127fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d14136960 0x7f4d14138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48714/0 (socket says 172.21.15.156:48714) 2023-09-30T22:19:56.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.667+0000 7f4d137fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d14139280 0x7f4d1413b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37036/0 (socket says 172.21.15.156:37036) 2023-09-30T22:19:56.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.668+0000 7f4d127fc700 1 -- 172.21.15.156:0/4155927938 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d14139280 msgr2=0x7f4d1413b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:56.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.668+0000 7f4d11ffb700 1 -- 172.21.15.156:0/4155927938 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 306217085 0 0) 0x7f4d1406b2d0 con 0x7f4d14133ad0 2023-09-30T22:19:56.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.668+0000 7f4d127fc700 1 --2- 172.21.15.156:0/4155927938 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d14139280 0x7f4d1413b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:56.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.668+0000 7f4d127fc700 1 -- 172.21.15.156:0/4155927938 >> v1:172.21.15.156:6789/0 conn(0x7f4d14133ad0 legacy=0x7f4d14133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:56.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.668+0000 7f4d127fc700 1 -- 172.21.15.156:0/4155927938 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1409a500 con 0x7f4d14136960 2023-09-30T22:19:56.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.668+0000 7f4d137fe700 1 --2- 172.21.15.156:0/4155927938 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d14139280 0x7f4d1413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:56.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.668+0000 7f4d127fc700 1 --2- 172.21.15.156:0/4155927938 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d14136960 0x7f4d14138d40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4d08009870 tx=0x7f4d08009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=254672add30d5d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:56.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.668+0000 7f4d11ffb700 1 -- 172.21.15.156:0/4155927938 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d08011830 con 0x7f4d14136960 2023-09-30T22:19:56.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.668+0000 7f4d11ffb700 1 -- 172.21.15.156:0/4155927938 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d08011990 con 0x7f4d14136960 2023-09-30T22:19:56.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.668+0000 7f4d11ffb700 1 -- 172.21.15.156:0/4155927938 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d08011d20 con 0x7f4d14136960 2023-09-30T22:19:56.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.669+0000 7f4d197dc700 1 -- 172.21.15.156:0/4155927938 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d14136960 msgr2=0x7f4d14138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:56.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.669+0000 7f4d197dc700 1 --2- 172.21.15.156:0/4155927938 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d14136960 0x7f4d14138d40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4d08009870 tx=0x7f4d08009b80 comp rx=0 tx=0).stop 2023-09-30T22:19:56.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.669+0000 7f4d197dc700 1 -- 172.21.15.156:0/4155927938 shutdown_connections 2023-09-30T22:19:56.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.669+0000 7f4d197dc700 1 --2- 172.21.15.156:0/4155927938 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d14139280 0x7f4d1413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:56.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.669+0000 7f4d197dc700 1 --2- 172.21.15.156:0/4155927938 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d14136960 0x7f4d14138d40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:56.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.669+0000 7f4d197dc700 1 -- 172.21.15.156:0/4155927938 >> 172.21.15.156:0/4155927938 conn(0x7f4d14099c40 msgr2=0x7f4d140a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:56.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.670+0000 7f4d197dc700 1 -- 172.21.15.156:0/4155927938 shutdown_connections 2023-09-30T22:19:56.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.670+0000 7f4d197dc700 1 -- 172.21.15.156:0/4155927938 wait complete. 2023-09-30T22:19:56.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.671+0000 7f4d197dc700 1 Processor -- start 2023-09-30T22:19:56.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.671+0000 7f4d197dc700 1 -- start start 2023-09-30T22:19:56.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.672+0000 7f4d197dc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d14133ad0 0x7f4d1412cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:56.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.672+0000 7f4d197dc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d14136960 0x7f4d1412d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:56.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.672+0000 7f4d197dc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d14139280 0x7f4d1412d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:56.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.672+0000 7f4d197dc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d141316a0 con 0x7f4d14136960 2023-09-30T22:19:56.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.672+0000 7f4d197dc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1406ede0 con 0x7f4d14139280 2023-09-30T22:19:56.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.672+0000 7f4d197dc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1409f390 con 0x7f4d14133ad0 2023-09-30T22:19:56.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.672+0000 7f4d127fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d14136960 0x7f4d1412d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:56.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.672+0000 7f4d127fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d14136960 0x7f4d1412d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51352/0 (socket says 172.21.15.156:51352) 2023-09-30T22:19:56.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.672+0000 7f4d127fc700 1 -- 172.21.15.156:0/2888395810 learned_addr learned my addr 172.21.15.156:0/2888395810 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:56.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.672+0000 7f4d137fe700 1 --2- 172.21.15.156:0/2888395810 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d14139280 0x7f4d1412d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:56.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.672+0000 7f4d12ffd700 1 --2- 172.21.15.156:0/2888395810 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d14133ad0 0x7f4d1412cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:56.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.672+0000 7f4d137fe700 1 -- 172.21.15.156:0/2888395810 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d14133ad0 msgr2=0x7f4d1412cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:56.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.672+0000 7f4d137fe700 1 --2- 172.21.15.156:0/2888395810 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d14133ad0 0x7f4d1412cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:56.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.672+0000 7f4d137fe700 1 -- 172.21.15.156:0/2888395810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d14136960 msgr2=0x7f4d1412d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:56.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.672+0000 7f4d137fe700 1 --2- 172.21.15.156:0/2888395810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d14136960 0x7f4d1412d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:56.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.672+0000 7f4d137fe700 1 -- 172.21.15.156:0/2888395810 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c009a70 con 0x7f4d14139280 2023-09-30T22:19:56.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.672+0000 7f4d127fc700 1 --2- 172.21.15.156:0/2888395810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d14136960 0x7f4d1412d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:56.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.673+0000 7f4d137fe700 1 --2- 172.21.15.156:0/2888395810 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d14139280 0x7f4d1412d5b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00efc0 tx=0x7f4d0c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:56.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.673+0000 7f4cfb7fe700 1 -- 172.21.15.156:0/2888395810 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c00ca90 con 0x7f4d14139280 2023-09-30T22:19:56.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.673+0000 7f4cfb7fe700 1 -- 172.21.15.156:0/2888395810 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0c00f040 con 0x7f4d14139280 2023-09-30T22:19:56.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.673+0000 7f4d197dc700 1 -- 172.21.15.156:0/2888395810 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d080094a0 con 0x7f4d14139280 2023-09-30T22:19:56.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.673+0000 7f4cfb7fe700 1 -- 172.21.15.156:0/2888395810 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c00ce10 con 0x7f4d14139280 2023-09-30T22:19:56.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.673+0000 7f4d197dc700 1 -- 172.21.15.156:0/2888395810 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d14070c20 con 0x7f4d14139280 2023-09-30T22:19:56.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.674+0000 7f4cfb7fe700 1 -- 172.21.15.156:0/2888395810 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d0c014480 con 0x7f4d14139280 2023-09-30T22:19:56.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.674+0000 7f4cfb7fe700 1 -- 172.21.15.156:0/2888395810 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4d0c03fe10 con 0x7f4d14139280 2023-09-30T22:19:56.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.674+0000 7f4d197dc700 1 -- 172.21.15.156:0/2888395810 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d1406ffb0 con 0x7f4d14139280 2023-09-30T22:19:56.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.679+0000 7f4cfb7fe700 1 -- 172.21.15.156:0/2888395810 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d0c012910 con 0x7f4d14139280 2023-09-30T22:19:56.738 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:56.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.766+0000 7f759406f700 1 Processor -- start 2023-09-30T22:19:56.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.766+0000 7f759406f700 1 -- start start 2023-09-30T22:19:56.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.767+0000 7f759406f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f758c133ad0 0x7f758c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:56.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.767+0000 7f759406f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f758c1300a0 0x7f758c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:56.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.767+0000 7f759406f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f758c06b2d0 con 0x7f758c1309f0 2023-09-30T22:19:56.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.767+0000 7f759406f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f758c133610 con 0x7f758c1300a0 2023-09-30T22:19:56.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.767+0000 7f759406f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758c09a500 con 0x7f758c133ad0 2023-09-30T22:19:56.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.767+0000 7f7591e0b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f758c133ad0 0x7f758c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:56.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.767+0000 7f7591e0b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f758c133ad0 0x7f758c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37056/0 (socket says 172.21.15.156:37056) 2023-09-30T22:19:56.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.767+0000 7f7591e0b700 1 -- 172.21.15.156:0/2648803700 learned_addr learned my addr 172.21.15.156:0/2648803700 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:56.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.767+0000 7f759260c700 1 --1- 172.21.15.156:0/2648803700 >> v1:172.21.15.156:6789/0 conn(0x7f758c1309f0 0x7f758c13a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53262/0 (socket says 172.21.15.156:53262) 2023-09-30T22:19:56.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.767+0000 7f759160a700 1 --2- 172.21.15.156:0/2648803700 >> v2:172.21.15.156:3300/0 conn(0x7f758c1300a0 0x7f758c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:56.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.768+0000 7f7590e09700 1 -- 172.21.15.156:0/2648803700 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2708729724 0 0) 0x7f758c06b2d0 con 0x7f758c1309f0 2023-09-30T22:19:56.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.768+0000 7f7591e0b700 1 -- 172.21.15.156:0/2648803700 >> v2:172.21.15.156:3300/0 conn(0x7f758c1300a0 msgr2=0x7f758c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:56.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.768+0000 7f7591e0b700 1 --2- 172.21.15.156:0/2648803700 >> v2:172.21.15.156:3300/0 conn(0x7f758c1300a0 0x7f758c1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:56.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.768+0000 7f7591e0b700 1 -- 172.21.15.156:0/2648803700 >> v1:172.21.15.156:6789/0 conn(0x7f758c1309f0 legacy=0x7f758c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:56.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.768+0000 7f7591e0b700 1 -- 172.21.15.156:0/2648803700 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758c1338b0 con 0x7f758c133ad0 2023-09-30T22:19:56.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.768+0000 7f7591e0b700 1 --2- 172.21.15.156:0/2648803700 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f758c133ad0 0x7f758c133ea0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f75880098f0 tx=0x7f7588009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b20471fd3ba06f92 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:56.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.768+0000 7f7590e09700 1 -- 172.21.15.156:0/2648803700 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7588011830 con 0x7f758c133ad0 2023-09-30T22:19:56.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.768+0000 7f7590e09700 1 -- 172.21.15.156:0/2648803700 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7588011990 con 0x7f758c133ad0 2023-09-30T22:19:56.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.768+0000 7f7590e09700 1 -- 172.21.15.156:0/2648803700 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7588011d20 con 0x7f758c133ad0 2023-09-30T22:19:56.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.769+0000 7f759406f700 1 -- 172.21.15.156:0/2648803700 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f758c133ad0 msgr2=0x7f758c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:56.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.769+0000 7f759406f700 1 --2- 172.21.15.156:0/2648803700 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f758c133ad0 0x7f758c133ea0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f75880098f0 tx=0x7f7588009c00 comp rx=0 tx=0).stop 2023-09-30T22:19:56.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.769+0000 7f759406f700 1 -- 172.21.15.156:0/2648803700 shutdown_connections 2023-09-30T22:19:56.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.769+0000 7f759406f700 1 --2- 172.21.15.156:0/2648803700 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f758c133ad0 0x7f758c133ea0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:56.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.769+0000 7f759406f700 1 --2- 172.21.15.156:0/2648803700 >> v2:172.21.15.156:3300/0 conn(0x7f758c1300a0 0x7f758c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:56.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.769+0000 7f759406f700 1 -- 172.21.15.156:0/2648803700 >> 172.21.15.156:0/2648803700 conn(0x7f758c099c40 msgr2=0x7f758c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:56.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.769+0000 7f759406f700 1 -- 172.21.15.156:0/2648803700 shutdown_connections 2023-09-30T22:19:56.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.769+0000 7f759406f700 1 -- 172.21.15.156:0/2648803700 wait complete. 2023-09-30T22:19:56.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.771+0000 7f759406f700 1 Processor -- start 2023-09-30T22:19:56.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.771+0000 7f759406f700 1 -- start start 2023-09-30T22:19:56.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.771+0000 7f759406f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f758c1300a0 0x7f758c071470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:56.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.771+0000 7f759406f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f758c1309f0 0x7f758c0719b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:56.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.771+0000 7f759406f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f758c133ad0 0x7f758c071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:56.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.771+0000 7f759406f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758c11dfb0 con 0x7f758c133ad0 2023-09-30T22:19:56.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.771+0000 7f759406f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758c11f920 con 0x7f758c1309f0 2023-09-30T22:19:56.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.771+0000 7f759406f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f758c11fc80 con 0x7f758c1300a0 2023-09-30T22:19:56.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.771+0000 7f759160a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f758c1309f0 0x7f758c0719b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:56.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.771+0000 7f7591e0b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f758c1300a0 0x7f758c071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:56.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.771+0000 7f759160a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f758c1309f0 0x7f758c0719b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37068/0 (socket says 172.21.15.156:37068) 2023-09-30T22:19:56.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.771+0000 7f759160a700 1 -- 172.21.15.156:0/4038684202 learned_addr learned my addr 172.21.15.156:0/4038684202 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:56.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.772+0000 7f759160a700 1 -- 172.21.15.156:0/4038684202 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f758c1300a0 msgr2=0x7f758c071470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:56.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.772+0000 7f759160a700 1 --2- 172.21.15.156:0/4038684202 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f758c1300a0 0x7f758c071470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:56.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.772+0000 7f759160a700 1 -- 172.21.15.156:0/4038684202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f758c133ad0 msgr2=0x7f758c071ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:56.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.772+0000 7f759160a700 1 --2- 172.21.15.156:0/4038684202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f758c133ad0 0x7f758c071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:56.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.772+0000 7f759160a700 1 -- 172.21.15.156:0/4038684202 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7588009550 con 0x7f758c1309f0 2023-09-30T22:19:56.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.772+0000 7f7591e0b700 1 --2- 172.21.15.156:0/4038684202 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f758c1300a0 0x7f758c071470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:56.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.772+0000 7f759160a700 1 --2- 172.21.15.156:0/4038684202 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f758c1309f0 0x7f758c0719b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f757c00e9b0 tx=0x7f757c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:56.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.772+0000 7f75827fc700 1 -- 172.21.15.156:0/4038684202 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c009710 con 0x7f758c1309f0 2023-09-30T22:19:56.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.772+0000 7f75827fc700 1 -- 172.21.15.156:0/4038684202 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757c00c7f0 con 0x7f758c1309f0 2023-09-30T22:19:56.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.772+0000 7f759406f700 1 -- 172.21.15.156:0/4038684202 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f758c11ee40 con 0x7f758c1309f0 2023-09-30T22:19:56.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.772+0000 7f75827fc700 1 -- 172.21.15.156:0/4038684202 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c00cb80 con 0x7f758c1309f0 2023-09-30T22:19:56.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.772+0000 7f759406f700 1 -- 172.21.15.156:0/4038684202 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f758c12dd00 con 0x7f758c1309f0 2023-09-30T22:19:56.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.773+0000 7f759406f700 1 -- 172.21.15.156:0/4038684202 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f758c04f2a0 con 0x7f758c1309f0 2023-09-30T22:19:56.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.773+0000 7f75827fc700 1 -- 172.21.15.156:0/4038684202 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f757c00cce0 con 0x7f758c1309f0 2023-09-30T22:19:56.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.773+0000 7f75827fc700 1 -- 172.21.15.156:0/4038684202 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f757c03fb30 con 0x7f758c1309f0 2023-09-30T22:19:56.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.782+0000 7f75827fc700 1 -- 172.21.15.156:0/4038684202 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f757c01b3b0 con 0x7f758c1309f0 2023-09-30T22:19:56.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.804+0000 7fa0fc9fd700 1 Processor -- start 2023-09-30T22:19:56.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.804+0000 7fa0fc9fd700 1 -- start start 2023-09-30T22:19:56.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.805+0000 7fa0fc9fd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa0f8133660 0x7fa0f8135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:56.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.805+0000 7fa0fc9fd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa0f8135f80 0x7fa0f8138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:56.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.805+0000 7fa0fc9fd700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f8099a60 con 0x7fa0f8099e20 2023-09-30T22:19:56.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.805+0000 7fa0fc9fd700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f809bf50 con 0x7fa0f8135f80 2023-09-30T22:19:56.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.805+0000 7fa0fc9fd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f809b230 con 0x7fa0f8133660 2023-09-30T22:19:56.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.805+0000 7fa0f659c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fa0f8099e20 0x7fa0f809a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53266/0 (socket says 172.21.15.156:53266) 2023-09-30T22:19:56.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.805+0000 7fa0f659c700 1 -- 172.21.15.156:0/2737237453 learned_addr learned my addr 172.21.15.156:0/2737237453 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:56.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.805+0000 7fa0effff700 1 --2- 172.21.15.156:0/2737237453 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa0f8133660 0x7fa0f8135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:56.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.805+0000 7fa0f6d9d700 1 --2- 172.21.15.156:0/2737237453 >> v2:172.21.15.156:3300/0 conn(0x7fa0f8135f80 0x7fa0f8138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:56.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.806+0000 7fa0effff700 1 -- 172.21.15.156:0/2737237453 >> v2:172.21.15.156:3300/0 conn(0x7fa0f8135f80 msgr2=0x7fa0f8138360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:56.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.806+0000 7fa0effff700 1 --2- 172.21.15.156:0/2737237453 >> v2:172.21.15.156:3300/0 conn(0x7fa0f8135f80 0x7fa0f8138360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:56.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.806+0000 7fa0effff700 1 -- 172.21.15.156:0/2737237453 >> v1:172.21.15.156:6789/0 conn(0x7fa0f8099e20 legacy=0x7fa0f809a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:56.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.806+0000 7fa0effff700 1 -- 172.21.15.156:0/2737237453 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f809bb90 con 0x7fa0f8133660 2023-09-30T22:19:56.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.806+0000 7fa0f6d9d700 1 --2- 172.21.15.156:0/2737237453 >> v2:172.21.15.156:3300/0 conn(0x7fa0f8135f80 0x7fa0f8138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:56.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.806+0000 7fa0effff700 1 --2- 172.21.15.156:0/2737237453 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa0f8133660 0x7fa0f8135a40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0009870 tx=0x7fa0e0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c16f335dd195b43 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:56.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.806+0000 7fa0f5d9b700 1 -- 172.21.15.156:0/2737237453 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0011830 con 0x7fa0f8133660 2023-09-30T22:19:56.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.806+0000 7fa0f5d9b700 1 -- 172.21.15.156:0/2737237453 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e0011990 con 0x7fa0f8133660 2023-09-30T22:19:56.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.806+0000 7fa0f5d9b700 1 -- 172.21.15.156:0/2737237453 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0011d20 con 0x7fa0f8133660 2023-09-30T22:19:56.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.807+0000 7fa0fc9fd700 1 -- 172.21.15.156:0/2737237453 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa0f8133660 msgr2=0x7fa0f8135a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:56.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.807+0000 7fa0fc9fd700 1 --2- 172.21.15.156:0/2737237453 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa0f8133660 0x7fa0f8135a40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0009870 tx=0x7fa0e0009b80 comp rx=0 tx=0).stop 2023-09-30T22:19:56.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.807+0000 7fa0fc9fd700 1 -- 172.21.15.156:0/2737237453 shutdown_connections 2023-09-30T22:19:56.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.807+0000 7fa0fc9fd700 1 --2- 172.21.15.156:0/2737237453 >> v2:172.21.15.156:3300/0 conn(0x7fa0f8135f80 0x7fa0f8138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:56.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.807+0000 7fa0fc9fd700 1 --2- 172.21.15.156:0/2737237453 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa0f8133660 0x7fa0f8135a40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:56.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.807+0000 7fa0fc9fd700 1 -- 172.21.15.156:0/2737237453 >> 172.21.15.156:0/2737237453 conn(0x7fa0f80a2980 msgr2=0x7fa0f80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:56.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.807+0000 7fa0fc9fd700 1 -- 172.21.15.156:0/2737237453 shutdown_connections 2023-09-30T22:19:56.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.807+0000 7fa0fc9fd700 1 -- 172.21.15.156:0/2737237453 wait complete. 2023-09-30T22:19:56.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.809+0000 7fa0fc9fd700 1 Processor -- start 2023-09-30T22:19:56.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.809+0000 7fa0fc9fd700 1 -- start start 2023-09-30T22:19:56.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.809+0000 7fa0fc9fd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0f8099e20 0x7fa0f80a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:56.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.809+0000 7fa0fc9fd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa0f8133660 0x7fa0f80a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:56.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.809+0000 7fa0fc9fd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa0f8135f80 0x7fa0f80a13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:56.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.809+0000 7fa0fc9fd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f809fd30 con 0x7fa0f8099e20 2023-09-30T22:19:56.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.809+0000 7fa0fc9fd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f809b470 con 0x7fa0f8133660 2023-09-30T22:19:56.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.809+0000 7fa0fc9fd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f811a790 con 0x7fa0f8135f80 2023-09-30T22:19:56.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.810+0000 7fa0f6d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa0f8135f80 0x7fa0f80a13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:56.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.810+0000 7fa0f6d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa0f8135f80 0x7fa0f80a13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48740/0 (socket says 172.21.15.156:48740) 2023-09-30T22:19:56.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.810+0000 7fa0f6d9d700 1 -- 172.21.15.156:0/712022168 learned_addr learned my addr 172.21.15.156:0/712022168 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:56.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.810+0000 7fa0f659c700 1 --2- 172.21.15.156:0/712022168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0f8099e20 0x7fa0f80a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:56.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.810+0000 7fa0effff700 1 --2- 172.21.15.156:0/712022168 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa0f8133660 0x7fa0f80a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:56.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.810+0000 7fa0f659c700 1 -- 172.21.15.156:0/712022168 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa0f8135f80 msgr2=0x7fa0f80a13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:56.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.810+0000 7fa0f659c700 1 --2- 172.21.15.156:0/712022168 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa0f8135f80 0x7fa0f80a13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:56.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.810+0000 7fa0f659c700 1 -- 172.21.15.156:0/712022168 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa0f8133660 msgr2=0x7fa0f80a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:56.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.810+0000 7fa0f659c700 1 --2- 172.21.15.156:0/712022168 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa0f8133660 0x7fa0f80a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:56.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.810+0000 7fa0f659c700 1 -- 172.21.15.156:0/712022168 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f0009a70 con 0x7fa0f8099e20 2023-09-30T22:19:56.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.810+0000 7fa0f659c700 1 --2- 172.21.15.156:0/712022168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0f8099e20 0x7fa0f80a0920 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa0e800c500 tx=0x7fa0e800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:56.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.810+0000 7fa0eeffd700 1 -- 172.21.15.156:0/712022168 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e80074e0 con 0x7fa0f8099e20 2023-09-30T22:19:56.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.810+0000 7fa0eeffd700 1 -- 172.21.15.156:0/712022168 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e8007640 con 0x7fa0f8099e20 2023-09-30T22:19:56.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.810+0000 7fa0eeffd700 1 -- 172.21.15.156:0/712022168 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8005a50 con 0x7fa0f8099e20 2023-09-30T22:19:56.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.811+0000 7fa0fc9fd700 1 -- 172.21.15.156:0/712022168 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e00094a0 con 0x7fa0f8099e20 2023-09-30T22:19:56.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.811+0000 7fa0fc9fd700 1 -- 172.21.15.156:0/712022168 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f811adc0 con 0x7fa0f8099e20 2023-09-30T22:19:56.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.811+0000 7fa0eeffd700 1 -- 172.21.15.156:0/712022168 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa0e8005bb0 con 0x7fa0f8099e20 2023-09-30T22:19:56.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.812+0000 7fa0eeffd700 1 -- 172.21.15.156:0/712022168 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa0e803e780 con 0x7fa0f8099e20 2023-09-30T22:19:56.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.812+0000 7fa0fc9fd700 1 -- 172.21.15.156:0/712022168 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f8072480 con 0x7fa0f8099e20 2023-09-30T22:19:56.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.817+0000 7fa0eeffd700 1 -- 172.21.15.156:0/712022168 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa0f8072480 con 0x7fa0f8099e20 2023-09-30T22:19:56.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.882+0000 7fab69c3f700 1 Processor -- start 2023-09-30T22:19:56.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.882+0000 7fab69c3f700 1 -- start start 2023-09-30T22:19:56.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.882+0000 7fab69c3f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab6409e950 0x7fab6409ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:56.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.882+0000 7fab69c3f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab6409f260 0x7fab64137ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:56.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.883+0000 7fab69c3f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab6409ac20 con 0x7fab641381e0 2023-09-30T22:19:56.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.883+0000 7fab69c3f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab640a06c0 con 0x7fab6409f260 2023-09-30T22:19:56.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.883+0000 7fab69c3f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab6409ae90 con 0x7fab6409e950 2023-09-30T22:19:56.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.883+0000 7fab637fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab6409e950 0x7fab6409ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:56.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.883+0000 7fab63fff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fab641381e0 0x7fab6413a5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53278/0 (socket says 172.21.15.156:53278) 2023-09-30T22:19:56.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.883+0000 7fab63fff700 1 -- 172.21.15.156:0/1548105706 learned_addr learned my addr 172.21.15.156:0/1548105706 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:56.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.883+0000 7fab62ffd700 1 --2- 172.21.15.156:0/1548105706 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab6409f260 0x7fab64137ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:56.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.883+0000 7fab627fc700 1 -- 172.21.15.156:0/1548105706 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1744579575 0 0) 0x7fab6409ac20 con 0x7fab641381e0 2023-09-30T22:19:56.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.883+0000 7fab627fc700 1 -- 172.21.15.156:0/1548105706 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab4c0035b0 con 0x7fab641381e0 2023-09-30T22:19:56.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.883+0000 7fab637fe700 1 -- 172.21.15.156:0/1548105706 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab6409f260 msgr2=0x7fab64137ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:56.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.883+0000 7fab637fe700 1 --2- 172.21.15.156:0/1548105706 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab6409f260 0x7fab64137ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:56.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.883+0000 7fab637fe700 1 -- 172.21.15.156:0/1548105706 >> v1:172.21.15.156:6789/0 conn(0x7fab641381e0 legacy=0x7fab6413a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:56.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.883+0000 7fab637fe700 1 -- 172.21.15.156:0/1548105706 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6406ba00 con 0x7fab6409e950 2023-09-30T22:19:56.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.883+0000 7fab637fe700 1 --2- 172.21.15.156:0/1548105706 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab6409e950 0x7fab6409ed20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fab54009880 tx=0x7fab54009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67c34e99efaf3932 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:56.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.883+0000 7fab627fc700 1 -- 172.21.15.156:0/1548105706 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab54005e30 con 0x7fab6409e950 2023-09-30T22:19:56.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.884+0000 7fab627fc700 1 -- 172.21.15.156:0/1548105706 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab54006030 con 0x7fab6409e950 2023-09-30T22:19:56.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.884+0000 7fab627fc700 1 -- 172.21.15.156:0/1548105706 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab540063a0 con 0x7fab6409e950 2023-09-30T22:19:56.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.884+0000 7fab69c3f700 1 -- 172.21.15.156:0/1548105706 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab6409e950 msgr2=0x7fab6409ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:56.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.884+0000 7fab69c3f700 1 --2- 172.21.15.156:0/1548105706 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab6409e950 0x7fab6409ed20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fab54009880 tx=0x7fab54009b90 comp rx=0 tx=0).stop 2023-09-30T22:19:56.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.884+0000 7fab69c3f700 1 -- 172.21.15.156:0/1548105706 shutdown_connections 2023-09-30T22:19:56.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.884+0000 7fab69c3f700 1 --2- 172.21.15.156:0/1548105706 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab6409e950 0x7fab6409ed20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:56.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.884+0000 7fab69c3f700 1 --2- 172.21.15.156:0/1548105706 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab6409f260 0x7fab64137ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:56.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.884+0000 7fab69c3f700 1 -- 172.21.15.156:0/1548105706 >> 172.21.15.156:0/1548105706 conn(0x7fab640a0f70 msgr2=0x7fab640a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:56.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.884+0000 7fab69c3f700 1 -- 172.21.15.156:0/1548105706 shutdown_connections 2023-09-30T22:19:56.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.884+0000 7fab69c3f700 1 -- 172.21.15.156:0/1548105706 wait complete. 2023-09-30T22:19:56.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.885+0000 7fab69c3f700 1 Processor -- start 2023-09-30T22:19:56.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.886+0000 7fab69c3f700 1 -- start start 2023-09-30T22:19:56.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.886+0000 7fab69c3f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab6409e950 0x7fab64122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:56.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.886+0000 7fab69c3f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab6409f260 0x7fab64122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:56.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.886+0000 7fab69c3f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab641381e0 0x7fab64123310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:56.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.886+0000 7fab69c3f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab641260d0 con 0x7fab641381e0 2023-09-30T22:19:56.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.886+0000 7fab69c3f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab64123cf0 con 0x7fab6409f260 2023-09-30T22:19:56.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.886+0000 7fab69c3f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab6409e080 con 0x7fab6409e950 2023-09-30T22:19:56.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.886+0000 7fab62ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab6409f260 0x7fab64122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:56.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.886+0000 7fab62ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab6409f260 0x7fab64122dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37096/0 (socket says 172.21.15.156:37096) 2023-09-30T22:19:56.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.886+0000 7fab62ffd700 1 -- 172.21.15.156:0/1089382854 learned_addr learned my addr 172.21.15.156:0/1089382854 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:56.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.887+0000 7fab63fff700 1 --2- 172.21.15.156:0/1089382854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab641381e0 0x7fab64123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:56.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.887+0000 7fab637fe700 1 --2- 172.21.15.156:0/1089382854 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab6409e950 0x7fab64122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:56.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.887+0000 7fab62ffd700 1 -- 172.21.15.156:0/1089382854 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab6409e950 msgr2=0x7fab64122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:56.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.887+0000 7fab62ffd700 1 --2- 172.21.15.156:0/1089382854 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab6409e950 0x7fab64122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:56.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.887+0000 7fab62ffd700 1 -- 172.21.15.156:0/1089382854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab641381e0 msgr2=0x7fab64123310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:56.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.887+0000 7fab62ffd700 1 --2- 172.21.15.156:0/1089382854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab641381e0 0x7fab64123310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:56.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.887+0000 7fab62ffd700 1 -- 172.21.15.156:0/1089382854 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab54009430 con 0x7fab6409f260 2023-09-30T22:19:56.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.887+0000 7fab62ffd700 1 --2- 172.21.15.156:0/1089382854 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab6409f260 0x7fab64122dd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fab5800e9b0 tx=0x7fab5800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:56.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.887+0000 7fab4bfff700 1 -- 172.21.15.156:0/1089382854 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab58009710 con 0x7fab6409f260 2023-09-30T22:19:56.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.887+0000 7fab4bfff700 1 -- 172.21.15.156:0/1089382854 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5800ee50 con 0x7fab6409f260 2023-09-30T22:19:56.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.887+0000 7fab69c3f700 1 -- 172.21.15.156:0/1089382854 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab640a0820 con 0x7fab6409f260 2023-09-30T22:19:56.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.887+0000 7fab69c3f700 1 -- 172.21.15.156:0/1089382854 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab64126b40 con 0x7fab6409f260 2023-09-30T22:19:56.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.887+0000 7fab4bfff700 1 -- 172.21.15.156:0/1089382854 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5800ca50 con 0x7fab6409f260 2023-09-30T22:19:56.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.888+0000 7fab69c3f700 1 -- 172.21.15.156:0/1089382854 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab440052e0 con 0x7fab6409f260 2023-09-30T22:19:56.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.889+0000 7fab4bfff700 1 -- 172.21.15.156:0/1089382854 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab5800cbb0 con 0x7fab6409f260 2023-09-30T22:19:56.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.889+0000 7fab4bfff700 1 -- 172.21.15.156:0/1089382854 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fab5803feb0 con 0x7fab6409f260 2023-09-30T22:19:56.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.893+0000 7fab4bfff700 1 -- 172.21.15.156:0/1089382854 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab58024350 con 0x7fab6409f260 2023-09-30T22:19:56.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.907+0000 7f4d197dc700 1 -- 172.21.15.156:0/2888395810 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4d1404f2a0 con 0x7f4d14139280 2023-09-30T22:19:56.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.907+0000 7f4cfb7fe700 1 -- 172.21.15.156:0/2888395810 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4d0c02b090 con 0x7f4d14139280 2023-09-30T22:19:56.908 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:56.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.910+0000 7f4d197dc700 1 -- 172.21.15.156:0/2888395810 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d14139280 msgr2=0x7f4d1412d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:56.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.910+0000 7f4d197dc700 1 --2- 172.21.15.156:0/2888395810 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d14139280 0x7f4d1412d5b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00efc0 tx=0x7f4d0c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:19:56.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.910+0000 7f4d197dc700 1 -- 172.21.15.156:0/2888395810 shutdown_connections 2023-09-30T22:19:56.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.910+0000 7f4d197dc700 1 --2- 172.21.15.156:0/2888395810 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d14139280 0x7f4d1412d5b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:56.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.910+0000 7f4d197dc700 1 --2- 172.21.15.156:0/2888395810 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d14133ad0 0x7f4d1412cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:56.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.910+0000 7f4d197dc700 1 --2- 172.21.15.156:0/2888395810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d14136960 0x7f4d1412d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:56.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.910+0000 7f4d197dc700 1 -- 172.21.15.156:0/2888395810 >> 172.21.15.156:0/2888395810 conn(0x7f4d14099c40 msgr2=0x7f4d140a30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:56.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.910+0000 7f4d197dc700 1 -- 172.21.15.156:0/2888395810 shutdown_connections 2023-09-30T22:19:56.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:56.910+0000 7f4d197dc700 1 -- 172.21.15.156:0/2888395810 wait complete. 2023-09-30T22:19:56.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:57.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.035+0000 7f759406f700 1 -- 172.21.15.156:0/4038684202 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f758c06c3b0 con 0x7f758c1309f0 2023-09-30T22:19:57.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.036+0000 7f75827fc700 1 -- 172.21.15.156:0/4038684202 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f757c021070 con 0x7f758c1309f0 2023-09-30T22:19:57.037 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:57.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.038+0000 7f759406f700 1 -- 172.21.15.156:0/4038684202 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f758c1309f0 msgr2=0x7f758c0719b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:57.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.038+0000 7f759406f700 1 --2- 172.21.15.156:0/4038684202 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f758c1309f0 0x7f758c0719b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f757c00e9b0 tx=0x7f757c00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:19:57.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.038+0000 7f759406f700 1 -- 172.21.15.156:0/4038684202 shutdown_connections 2023-09-30T22:19:57.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.038+0000 7f759406f700 1 --2- 172.21.15.156:0/4038684202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f758c133ad0 0x7f758c071ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:57.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.038+0000 7f759406f700 1 --2- 172.21.15.156:0/4038684202 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f758c1300a0 0x7f758c071470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:57.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.038+0000 7f759406f700 1 --2- 172.21.15.156:0/4038684202 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f758c1309f0 0x7f758c0719b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:57.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.038+0000 7f759406f700 1 -- 172.21.15.156:0/4038684202 >> 172.21.15.156:0/4038684202 conn(0x7f758c099c40 msgr2=0x7f758c12e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:57.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.038+0000 7f759406f700 1 -- 172.21.15.156:0/4038684202 shutdown_connections 2023-09-30T22:19:57.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.038+0000 7f759406f700 1 -- 172.21.15.156:0/4038684202 wait complete. 2023-09-30T22:19:57.051 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:57.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.065+0000 7fa0fc9fd700 1 -- 172.21.15.156:0/712022168 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa0f8072480 con 0x7fa0f8099e20 2023-09-30T22:19:57.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.066+0000 7fa0eeffd700 1 -- 172.21.15.156:0/712022168 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa0f8072480 con 0x7fa0f8099e20 2023-09-30T22:19:57.066 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:57.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.069+0000 7fa0fc9fd700 1 -- 172.21.15.156:0/712022168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0f8099e20 msgr2=0x7fa0f80a0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:57.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.069+0000 7fa0fc9fd700 1 --2- 172.21.15.156:0/712022168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0f8099e20 0x7fa0f80a0920 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa0e800c500 tx=0x7fa0e800c810 comp rx=0 tx=0).stop 2023-09-30T22:19:57.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.069+0000 7fa0fc9fd700 1 -- 172.21.15.156:0/712022168 shutdown_connections 2023-09-30T22:19:57.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.069+0000 7fa0fc9fd700 1 --2- 172.21.15.156:0/712022168 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa0f8135f80 0x7fa0f80a13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:57.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.069+0000 7fa0fc9fd700 1 --2- 172.21.15.156:0/712022168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0f8099e20 0x7fa0f80a0920 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:57.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.069+0000 7fa0fc9fd700 1 --2- 172.21.15.156:0/712022168 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa0f8133660 0x7fa0f80a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:57.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.069+0000 7fa0fc9fd700 1 -- 172.21.15.156:0/712022168 >> 172.21.15.156:0/712022168 conn(0x7fa0f80a2980 msgr2=0x7fa0f81354e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:57.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.069+0000 7fa0fc9fd700 1 -- 172.21.15.156:0/712022168 shutdown_connections 2023-09-30T22:19:57.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.069+0000 7fa0fc9fd700 1 -- 172.21.15.156:0/712022168 wait complete. 2023-09-30T22:19:57.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:57.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.099+0000 7fab69c3f700 1 -- 172.21.15.156:0/1089382854 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fab44005860 con 0x7fab6409f260 2023-09-30T22:19:57.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.099+0000 7fab4bfff700 1 -- 172.21.15.156:0/1089382854 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab5802a090 con 0x7fab6409f260 2023-09-30T22:19:57.100 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:57.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.101+0000 7fab69c3f700 1 -- 172.21.15.156:0/1089382854 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab6409f260 msgr2=0x7fab64122dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:57.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.101+0000 7fab69c3f700 1 --2- 172.21.15.156:0/1089382854 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab6409f260 0x7fab64122dd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fab5800e9b0 tx=0x7fab5800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:19:57.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.101+0000 7fab69c3f700 1 -- 172.21.15.156:0/1089382854 shutdown_connections 2023-09-30T22:19:57.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.101+0000 7fab69c3f700 1 --2- 172.21.15.156:0/1089382854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab641381e0 0x7fab64123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:57.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.101+0000 7fab69c3f700 1 --2- 172.21.15.156:0/1089382854 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab6409e950 0x7fab64122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:57.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.101+0000 7fab69c3f700 1 --2- 172.21.15.156:0/1089382854 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab6409f260 0x7fab64122dd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:57.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.101+0000 7fab69c3f700 1 -- 172.21.15.156:0/1089382854 >> 172.21.15.156:0/1089382854 conn(0x7fab640a0f70 msgr2=0x7fab6406fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:57.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.101+0000 7fab69c3f700 1 -- 172.21.15.156:0/1089382854 shutdown_connections 2023-09-30T22:19:57.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:57.101+0000 7fab69c3f700 1 -- 172.21.15.156:0/1089382854 wait complete. 2023-09-30T22:19:57.114 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:57.925 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:58.051 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:58.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.060+0000 7fad82ed3700 1 Processor -- start 2023-09-30T22:19:58.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.060+0000 7fad82ed3700 1 -- start start 2023-09-30T22:19:58.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.061+0000 7fad82ed3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fad7c09d860 0x7fad7c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:58.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.061+0000 7fad82ed3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad7c09e170 0x7fad7c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:58.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.061+0000 7fad82ed3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad7c130ce0 0x7fad7c131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:58.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.061+0000 7fad82ed3700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad7c131670 con 0x7fad7c09d860 2023-09-30T22:19:58.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.061+0000 7fad82ed3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c09aaa0 con 0x7fad7c130ce0 2023-09-30T22:19:58.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.061+0000 7fad82ed3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c09f870 con 0x7fad7c09e170 2023-09-30T22:19:58.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.061+0000 7fad81470700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad7c130ce0 0x7fad7c131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:58.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.061+0000 7fad7bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad7c09e170 0x7fad7c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:58.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.061+0000 7fad80c6f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fad7c09d860 0x7fad7c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:58.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.061+0000 7fad80c6f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fad7c09d860 0x7fad7c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51418/0 (socket says 172.21.15.156:51418) 2023-09-30T22:19:58.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.061+0000 7fad7bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad7c09e170 0x7fad7c1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48766/0 (socket says 172.21.15.156:48766) 2023-09-30T22:19:58.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.061+0000 7fad81470700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad7c130ce0 0x7fad7c131130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37104/0 (socket says 172.21.15.156:37104) 2023-09-30T22:19:58.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.061+0000 7fad7bfff700 1 -- 172.21.15.156:0/3637573926 learned_addr learned my addr 172.21.15.156:0/3637573926 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:58.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.061+0000 7fad80c6f700 1 -- 172.21.15.156:0/3637573926 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad7c09e170 msgr2=0x7fad7c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:58.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.061+0000 7fad80c6f700 1 --2- 172.21.15.156:0/3637573926 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad7c09e170 0x7fad7c1307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.061+0000 7fad80c6f700 1 -- 172.21.15.156:0/3637573926 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad7c130ce0 msgr2=0x7fad7c131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:58.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.061+0000 7fad80c6f700 1 --2- 172.21.15.156:0/3637573926 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad7c130ce0 0x7fad7c131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.061+0000 7fad80c6f700 1 -- 172.21.15.156:0/3637573926 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7c09b360 con 0x7fad7c09d860 2023-09-30T22:19:58.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.062+0000 7fad7bfff700 1 --2- 172.21.15.156:0/3637573926 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad7c09e170 0x7fad7c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:58.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.062+0000 7fad81470700 1 --2- 172.21.15.156:0/3637573926 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad7c130ce0 0x7fad7c131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:58.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.062+0000 7fad80c6f700 1 --2- 172.21.15.156:0/3637573926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad7c09d860 0x7fad7c09dc30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fad70009870 tx=0x7fad70009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94ff3661aaf7d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:58.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.062+0000 7fad7b7fe700 1 -- 172.21.15.156:0/3637573926 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad70011830 con 0x7fad7c09d860 2023-09-30T22:19:58.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.062+0000 7fad7b7fe700 1 -- 172.21.15.156:0/3637573926 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad70011990 con 0x7fad7c09d860 2023-09-30T22:19:58.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.062+0000 7fad7b7fe700 1 -- 172.21.15.156:0/3637573926 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad70011d20 con 0x7fad7c09d860 2023-09-30T22:19:58.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.063+0000 7fad82ed3700 1 -- 172.21.15.156:0/3637573926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad7c09d860 msgr2=0x7fad7c09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:58.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.063+0000 7fad82ed3700 1 --2- 172.21.15.156:0/3637573926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad7c09d860 0x7fad7c09dc30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fad70009870 tx=0x7fad70009b80 comp rx=0 tx=0).stop 2023-09-30T22:19:58.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.063+0000 7fad82ed3700 1 -- 172.21.15.156:0/3637573926 shutdown_connections 2023-09-30T22:19:58.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.063+0000 7fad82ed3700 1 --2- 172.21.15.156:0/3637573926 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad7c130ce0 0x7fad7c131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.063+0000 7fad82ed3700 1 --2- 172.21.15.156:0/3637573926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad7c09d860 0x7fad7c09dc30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.063+0000 7fad82ed3700 1 --2- 172.21.15.156:0/3637573926 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad7c09e170 0x7fad7c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.063+0000 7fad82ed3700 1 -- 172.21.15.156:0/3637573926 >> 172.21.15.156:0/3637573926 conn(0x7fad7c099c40 msgr2=0x7fad7c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:58.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.063+0000 7fad82ed3700 1 -- 172.21.15.156:0/3637573926 shutdown_connections 2023-09-30T22:19:58.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.063+0000 7fad82ed3700 1 -- 172.21.15.156:0/3637573926 wait complete. 2023-09-30T22:19:58.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.064+0000 7fad82ed3700 1 Processor -- start 2023-09-30T22:19:58.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.064+0000 7fad82ed3700 1 -- start start 2023-09-30T22:19:58.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.064+0000 7fad82ed3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad7c09d860 0x7fad7c11c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:58.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.064+0000 7fad82ed3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad7c09e170 0x7fad7c11c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:58.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.064+0000 7fad82ed3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad7c130ce0 0x7fad7c11ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:58.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.064+0000 7fad82ed3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c11fa80 con 0x7fad7c09e170 2023-09-30T22:19:58.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.064+0000 7fad82ed3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c09c8b0 con 0x7fad7c130ce0 2023-09-30T22:19:58.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.064+0000 7fad82ed3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c11f0a0 con 0x7fad7c09d860 2023-09-30T22:19:58.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.065+0000 7fad7bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad7c09e170 0x7fad7c11c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:58.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.065+0000 7fad81470700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad7c130ce0 0x7fad7c11ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:58.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.065+0000 7fad7bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad7c09e170 0x7fad7c11c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51426/0 (socket says 172.21.15.156:51426) 2023-09-30T22:19:58.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.065+0000 7fad7bfff700 1 -- 172.21.15.156:0/2783607157 learned_addr learned my addr 172.21.15.156:0/2783607157 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:58.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.065+0000 7fad80c6f700 1 --2- 172.21.15.156:0/2783607157 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad7c09d860 0x7fad7c11c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:58.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.065+0000 7fad7bfff700 1 -- 172.21.15.156:0/2783607157 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad7c09d860 msgr2=0x7fad7c11c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:58.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.065+0000 7fad7bfff700 1 --2- 172.21.15.156:0/2783607157 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad7c09d860 0x7fad7c11c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.065+0000 7fad7bfff700 1 -- 172.21.15.156:0/2783607157 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad7c130ce0 msgr2=0x7fad7c11ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:58.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.065+0000 7fad7bfff700 1 --2- 172.21.15.156:0/2783607157 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad7c130ce0 0x7fad7c11ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.065+0000 7fad7bfff700 1 -- 172.21.15.156:0/2783607157 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6800b7f0 con 0x7fad7c09e170 2023-09-30T22:19:58.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.065+0000 7fad81470700 1 --2- 172.21.15.156:0/2783607157 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad7c130ce0 0x7fad7c11ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:58.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.065+0000 7fad7bfff700 1 --2- 172.21.15.156:0/2783607157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad7c09e170 0x7fad7c11c780 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fad68010ee0 tx=0x7fad6800e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:58.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.065+0000 7fad797fa700 1 -- 172.21.15.156:0/2783607157 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad68004030 con 0x7fad7c09e170 2023-09-30T22:19:58.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.065+0000 7fad797fa700 1 -- 172.21.15.156:0/2783607157 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad68004190 con 0x7fad7c09e170 2023-09-30T22:19:58.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.065+0000 7fad82ed3700 1 -- 172.21.15.156:0/2783607157 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad74009a70 con 0x7fad7c09e170 2023-09-30T22:19:58.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.065+0000 7fad797fa700 1 -- 172.21.15.156:0/2783607157 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad68004520 con 0x7fad7c09e170 2023-09-30T22:19:58.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.065+0000 7fad82ed3700 1 -- 172.21.15.156:0/2783607157 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad700094a0 con 0x7fad7c09e170 2023-09-30T22:19:58.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.066+0000 7fad797fa700 1 -- 172.21.15.156:0/2783607157 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad680036a0 con 0x7fad7c09e170 2023-09-30T22:19:58.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.066+0000 7fad797fa700 1 -- 172.21.15.156:0/2783607157 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fad680422b0 con 0x7fad7c09e170 2023-09-30T22:19:58.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.067+0000 7fad82ed3700 1 -- 172.21.15.156:0/2783607157 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad7c0720b0 con 0x7fad7c09e170 2023-09-30T22:19:58.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.072+0000 7fad797fa700 1 -- 172.21.15.156:0/2783607157 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad68011450 con 0x7fad7c09e170 2023-09-30T22:19:58.083 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:58.115 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:58.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.195+0000 7ff523074700 1 Processor -- start 2023-09-30T22:19:58.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.195+0000 7ff523074700 1 -- start start 2023-09-30T22:19:58.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.195+0000 7ff523074700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff51c09d860 0x7ff51c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:58.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.195+0000 7ff523074700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff51c130eb0 0x7ff51c138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:58.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.195+0000 7ff523074700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff51c09aaa0 con 0x7ff51c09e170 2023-09-30T22:19:58.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.195+0000 7ff523074700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff51c09f870 con 0x7ff51c130eb0 2023-09-30T22:19:58.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.195+0000 7ff523074700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c09b360 con 0x7ff51c09d860 2023-09-30T22:19:58.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.196+0000 7ff521611700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff51c130eb0 0x7ff51c138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:58.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.196+0000 7ff521611700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff51c130eb0 0x7ff51c138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51430/0 (socket says 172.21.15.156:51430) 2023-09-30T22:19:58.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.196+0000 7ff51bfff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff51c09e170 0x7ff51c1307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53290/0 (socket says 172.21.15.156:53290) 2023-09-30T22:19:58.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.196+0000 7ff521611700 1 -- 172.21.15.156:0/1871117241 learned_addr learned my addr 172.21.15.156:0/1871117241 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:58.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.196+0000 7ff520e10700 1 --2- 172.21.15.156:0/1871117241 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff51c09d860 0x7ff51c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:58.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.196+0000 7ff521611700 1 -- 172.21.15.156:0/1871117241 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff51c09d860 msgr2=0x7ff51c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:58.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.196+0000 7ff521611700 1 --2- 172.21.15.156:0/1871117241 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff51c09d860 0x7ff51c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.196+0000 7ff521611700 1 -- 172.21.15.156:0/1871117241 >> v1:172.21.15.156:6789/0 conn(0x7ff51c09e170 legacy=0x7ff51c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:58.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.196+0000 7ff521611700 1 -- 172.21.15.156:0/1871117241 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51c09b620 con 0x7ff51c130eb0 2023-09-30T22:19:58.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.196+0000 7ff521611700 1 --2- 172.21.15.156:0/1871117241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff51c130eb0 0x7ff51c138a00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff51400b9a0 tx=0x7ff51400bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a1ffe8e6c9f542 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:58.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.196+0000 7ff51b7fe700 1 -- 172.21.15.156:0/1871117241 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51400caa0 con 0x7ff51c130eb0 2023-09-30T22:19:58.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.196+0000 7ff51b7fe700 1 -- 172.21.15.156:0/1871117241 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51400cc00 con 0x7ff51c130eb0 2023-09-30T22:19:58.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.196+0000 7ff51b7fe700 1 -- 172.21.15.156:0/1871117241 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51400f460 con 0x7ff51c130eb0 2023-09-30T22:19:58.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.197+0000 7ff523074700 1 -- 172.21.15.156:0/1871117241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff51c130eb0 msgr2=0x7ff51c138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:58.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.197+0000 7ff523074700 1 --2- 172.21.15.156:0/1871117241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff51c130eb0 0x7ff51c138a00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff51400b9a0 tx=0x7ff51400bcb0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.197+0000 7ff523074700 1 -- 172.21.15.156:0/1871117241 shutdown_connections 2023-09-30T22:19:58.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.197+0000 7ff523074700 1 --2- 172.21.15.156:0/1871117241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff51c130eb0 0x7ff51c138a00 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.197+0000 7ff523074700 1 --2- 172.21.15.156:0/1871117241 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff51c09d860 0x7ff51c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.197+0000 7ff523074700 1 -- 172.21.15.156:0/1871117241 >> 172.21.15.156:0/1871117241 conn(0x7ff51c099c40 msgr2=0x7ff51c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:58.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.197+0000 7ff523074700 1 -- 172.21.15.156:0/1871117241 shutdown_connections 2023-09-30T22:19:58.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.197+0000 7ff523074700 1 -- 172.21.15.156:0/1871117241 wait complete. 2023-09-30T22:19:58.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.199+0000 7ff523074700 1 Processor -- start 2023-09-30T22:19:58.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.199+0000 7ff523074700 1 -- start start 2023-09-30T22:19:58.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.200+0000 7ff523074700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff51c09d860 0x7ff51c1c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:58.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.200+0000 7ff523074700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff51c09e170 0x7ff51c1c4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:58.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.200+0000 7ff523074700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff51c130eb0 0x7ff51c11e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:58.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.200+0000 7ff523074700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c121fd0 con 0x7ff51c09d860 2023-09-30T22:19:58.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.200+0000 7ff523074700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c072100 con 0x7ff51c09e170 2023-09-30T22:19:58.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.200+0000 7ff523074700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c120310 con 0x7ff51c130eb0 2023-09-30T22:19:58.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.200+0000 7ff520e10700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff51c09d860 0x7ff51c1c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:58.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.200+0000 7ff520e10700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff51c09d860 0x7ff51c1c4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51444/0 (socket says 172.21.15.156:51444) 2023-09-30T22:19:58.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.200+0000 7ff520e10700 1 -- 172.21.15.156:0/990525504 learned_addr learned my addr 172.21.15.156:0/990525504 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:58.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.200+0000 7ff51bfff700 1 --2- 172.21.15.156:0/990525504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff51c09e170 0x7ff51c1c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:58.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.200+0000 7ff521611700 1 --2- 172.21.15.156:0/990525504 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff51c130eb0 0x7ff51c11e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:58.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.200+0000 7ff520e10700 1 -- 172.21.15.156:0/990525504 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff51c130eb0 msgr2=0x7ff51c11e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:58.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.200+0000 7ff520e10700 1 --2- 172.21.15.156:0/990525504 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff51c130eb0 0x7ff51c11e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.200+0000 7ff520e10700 1 -- 172.21.15.156:0/990525504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff51c09e170 msgr2=0x7ff51c1c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:58.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.200+0000 7ff520e10700 1 --2- 172.21.15.156:0/990525504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff51c09e170 0x7ff51c1c4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.200+0000 7ff520e10700 1 -- 172.21.15.156:0/990525504 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51400b600 con 0x7ff51c09d860 2023-09-30T22:19:58.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.200+0000 7ff520e10700 1 --2- 172.21.15.156:0/990525504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff51c09d860 0x7ff51c1c4430 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff50c0123f0 tx=0x7ff50c012700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:58.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.201+0000 7ff5197fa700 1 -- 172.21.15.156:0/990525504 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c00d2d0 con 0x7ff51c09d860 2023-09-30T22:19:58.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.201+0000 7ff5197fa700 1 -- 172.21.15.156:0/990525504 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50c013040 con 0x7ff51c09d860 2023-09-30T22:19:58.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.201+0000 7ff523074700 1 -- 172.21.15.156:0/990525504 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff51c09c8b0 con 0x7ff51c09d860 2023-09-30T22:19:58.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.201+0000 7ff5197fa700 1 -- 172.21.15.156:0/990525504 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c00b740 con 0x7ff51c09d860 2023-09-30T22:19:58.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.201+0000 7ff523074700 1 -- 172.21.15.156:0/990525504 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51c1229b0 con 0x7ff51c09d860 2023-09-30T22:19:58.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.202+0000 7ff523074700 1 -- 172.21.15.156:0/990525504 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff51c04f2a0 con 0x7ff51c09d860 2023-09-30T22:19:58.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.203+0000 7ff5197fa700 1 -- 172.21.15.156:0/990525504 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff50c00b8a0 con 0x7ff51c09d860 2023-09-30T22:19:58.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.203+0000 7ff5197fa700 1 -- 172.21.15.156:0/990525504 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff50c044370 con 0x7ff51c09d860 2023-09-30T22:19:58.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.207+0000 7ff5197fa700 1 -- 172.21.15.156:0/990525504 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff50c020d30 con 0x7ff51c09d860 2023-09-30T22:19:58.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.224+0000 7fa64ae63700 1 Processor -- start 2023-09-30T22:19:58.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.225+0000 7fa64ae63700 1 -- start start 2023-09-30T22:19:58.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.225+0000 7fa64ae63700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa644138040 0x7fa644138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:58.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.225+0000 7fa64ae63700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa6440a08e0 0x7fa6440a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:58.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.225+0000 7fa64ae63700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa6440a1230 0x7fa64413ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:58.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.225+0000 7fa64ae63700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6440a2100 con 0x7fa6440a1230 2023-09-30T22:19:58.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.225+0000 7fa64ae63700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa644138950 con 0x7fa644138040 2023-09-30T22:19:58.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.225+0000 7fa64ae63700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6441379e0 con 0x7fa6440a08e0 2023-09-30T22:19:58.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.226+0000 7fa648bff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa644138040 0x7fa644138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:58.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.226+0000 7fa649400700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa6440a1230 0x7fa64413ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:58.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.226+0000 7fa648bff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa644138040 0x7fa644138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37124/0 (socket says 172.21.15.156:37124) 2023-09-30T22:19:58.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.226+0000 7fa648bff700 1 -- 172.21.15.156:0/3837328720 learned_addr learned my addr 172.21.15.156:0/3837328720 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:58.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.226+0000 7fa643fff700 1 --2- 172.21.15.156:0/3837328720 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa6440a08e0 0x7fa6440a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:58.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.226+0000 7fa649400700 1 -- 172.21.15.156:0/3837328720 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa6440a08e0 msgr2=0x7fa6440a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:58.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.226+0000 7fa649400700 1 --2- 172.21.15.156:0/3837328720 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa6440a08e0 0x7fa6440a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.226+0000 7fa649400700 1 -- 172.21.15.156:0/3837328720 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa644138040 msgr2=0x7fa644138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:58.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.226+0000 7fa649400700 1 --2- 172.21.15.156:0/3837328720 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa644138040 0x7fa644138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.226+0000 7fa649400700 1 -- 172.21.15.156:0/3837328720 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64409b9b0 con 0x7fa6440a1230 2023-09-30T22:19:58.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.226+0000 7fa648bff700 1 --2- 172.21.15.156:0/3837328720 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa644138040 0x7fa644138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:58.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.226+0000 7fa649400700 1 --2- 172.21.15.156:0/3837328720 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6440a1230 0x7fa64413ed10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009df0 tx=0x7fa63c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba2aa9b6a530800d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:58.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.227+0000 7fa6437fe700 1 -- 172.21.15.156:0/3837328720 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c00e070 con 0x7fa6440a1230 2023-09-30T22:19:58.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.227+0000 7fa6437fe700 1 -- 172.21.15.156:0/3837328720 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63c00baa0 con 0x7fa6440a1230 2023-09-30T22:19:58.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.227+0000 7fa6437fe700 1 -- 172.21.15.156:0/3837328720 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c00be50 con 0x7fa6440a1230 2023-09-30T22:19:58.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.227+0000 7fa64ae63700 1 -- 172.21.15.156:0/3837328720 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6440a1230 msgr2=0x7fa64413ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:58.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.227+0000 7fa64ae63700 1 --2- 172.21.15.156:0/3837328720 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6440a1230 0x7fa64413ed10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009df0 tx=0x7fa63c00b330 comp rx=0 tx=0).stop 2023-09-30T22:19:58.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.227+0000 7fa64ae63700 1 -- 172.21.15.156:0/3837328720 shutdown_connections 2023-09-30T22:19:58.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.227+0000 7fa64ae63700 1 --2- 172.21.15.156:0/3837328720 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6440a1230 0x7fa64413ed10 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.227+0000 7fa64ae63700 1 --2- 172.21.15.156:0/3837328720 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa644138040 0x7fa644138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.227+0000 7fa64ae63700 1 --2- 172.21.15.156:0/3837328720 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa6440a08e0 0x7fa6440a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.227+0000 7fa64ae63700 1 -- 172.21.15.156:0/3837328720 >> 172.21.15.156:0/3837328720 conn(0x7fa6440a2980 msgr2=0x7fa6440a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:58.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.227+0000 7fa64ae63700 1 -- 172.21.15.156:0/3837328720 shutdown_connections 2023-09-30T22:19:58.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.227+0000 7fa64ae63700 1 -- 172.21.15.156:0/3837328720 wait complete. 2023-09-30T22:19:58.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.228+0000 7fa64ae63700 1 Processor -- start 2023-09-30T22:19:58.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.228+0000 7fa64ae63700 1 -- start start 2023-09-30T22:19:58.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.229+0000 7fa64ae63700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6440a08e0 0x7fa644134860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:58.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.229+0000 7fa64ae63700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa6440a1230 0x7fa644134da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:58.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.229+0000 7fa64ae63700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa644138040 0x7fa6441d4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:58.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.229+0000 7fa64ae63700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64409c690 con 0x7fa6440a08e0 2023-09-30T22:19:58.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.229+0000 7fa64ae63700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64411acf0 con 0x7fa644138040 2023-09-30T22:19:58.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.229+0000 7fa64ae63700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa644119520 con 0x7fa6440a1230 2023-09-30T22:19:58.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.229+0000 7fa643fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa6440a1230 0x7fa644134da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:58.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.229+0000 7fa643fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa6440a1230 0x7fa644134da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48810/0 (socket says 172.21.15.156:48810) 2023-09-30T22:19:58.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.229+0000 7fa643fff700 1 -- 172.21.15.156:0/3338514998 learned_addr learned my addr 172.21.15.156:0/3338514998 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:58.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.229+0000 7fa649400700 1 --2- 172.21.15.156:0/3338514998 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa644138040 0x7fa6441d4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:58.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.229+0000 7fa648bff700 1 --2- 172.21.15.156:0/3338514998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6440a08e0 0x7fa644134860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:58.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.230+0000 7fa643fff700 1 -- 172.21.15.156:0/3338514998 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa644138040 msgr2=0x7fa6441d4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:58.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.230+0000 7fa643fff700 1 --2- 172.21.15.156:0/3338514998 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa644138040 0x7fa6441d4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.230+0000 7fa643fff700 1 -- 172.21.15.156:0/3338514998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6440a08e0 msgr2=0x7fa644134860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:58.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.230+0000 7fa643fff700 1 --2- 172.21.15.156:0/3338514998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6440a08e0 0x7fa644134860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.230+0000 7fa643fff700 1 -- 172.21.15.156:0/3338514998 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa638009500 con 0x7fa6440a1230 2023-09-30T22:19:58.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.230+0000 7fa643fff700 1 --2- 172.21.15.156:0/3338514998 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa6440a1230 0x7fa644134da0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa63000e840 tx=0x7fa63000eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:58.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.230+0000 7fa6417fa700 1 -- 172.21.15.156:0/3338514998 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa630013680 con 0x7fa6440a1230 2023-09-30T22:19:58.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.230+0000 7fa6417fa700 1 -- 172.21.15.156:0/3338514998 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6300137e0 con 0x7fa6440a1230 2023-09-30T22:19:58.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.230+0000 7fa6417fa700 1 -- 172.21.15.156:0/3338514998 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa630013b50 con 0x7fa6440a1230 2023-09-30T22:19:58.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.230+0000 7fa64ae63700 1 -- 172.21.15.156:0/3338514998 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa63c009a70 con 0x7fa6440a1230 2023-09-30T22:19:58.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.230+0000 7fa64ae63700 1 -- 172.21.15.156:0/3338514998 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa64409a240 con 0x7fa6440a1230 2023-09-30T22:19:58.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.231+0000 7fa6417fa700 1 -- 172.21.15.156:0/3338514998 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa630013cb0 con 0x7fa6440a1230 2023-09-30T22:19:58.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.231+0000 7fa64ae63700 1 -- 172.21.15.156:0/3338514998 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa64411a630 con 0x7fa6440a1230 2023-09-30T22:19:58.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.232+0000 7fa6417fa700 1 -- 172.21.15.156:0/3338514998 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa63003f560 con 0x7fa6440a1230 2023-09-30T22:19:58.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.240+0000 7fa6417fa700 1 -- 172.21.15.156:0/3338514998 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa63001bc30 con 0x7fa6440a1230 2023-09-30T22:19:58.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.262+0000 7fe9a0578700 1 Processor -- start 2023-09-30T22:19:58.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.262+0000 7fe9a0578700 1 -- start start 2023-09-30T22:19:58.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.263+0000 7fe9a0578700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe9980a1510 0x7fe9981351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:58.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.263+0000 7fe9a0578700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9981356e0 0x7fe998137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:58.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.263+0000 7fe9a0578700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9980a1e70 con 0x7fe9980a0a30 2023-09-30T22:19:58.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.263+0000 7fe9a0578700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe99809a720 con 0x7fe9980a1510 2023-09-30T22:19:58.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.263+0000 7fe9a0578700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe99809b300 con 0x7fe9981356e0 2023-09-30T22:19:58.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.263+0000 7fe99db13700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe9980a1510 0x7fe9981351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:58.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.263+0000 7fe99eb15700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9981356e0 0x7fe998137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:58.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.263+0000 7fe99db13700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe9980a1510 0x7fe9981351a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51468/0 (socket says 172.21.15.156:51468) 2023-09-30T22:19:58.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.263+0000 7fe99eb15700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9981356e0 0x7fe998137ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48824/0 (socket says 172.21.15.156:48824) 2023-09-30T22:19:58.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.263+0000 7fe99db13700 1 -- 172.21.15.156:0/1673963662 learned_addr learned my addr 172.21.15.156:0/1673963662 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:58.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.263+0000 7fe99db13700 1 -- 172.21.15.156:0/1673963662 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9981356e0 msgr2=0x7fe998137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:58.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.263+0000 7fe99db13700 1 --2- 172.21.15.156:0/1673963662 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9981356e0 0x7fe998137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.263+0000 7fe99db13700 1 -- 172.21.15.156:0/1673963662 >> v1:172.21.15.156:6789/0 conn(0x7fe9980a0a30 legacy=0x7fe9980a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:58.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.263+0000 7fe99d312700 1 -- 172.21.15.156:0/1673963662 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545444810 0 0) 0x7fe9980a1e70 con 0x7fe9980a0a30 2023-09-30T22:19:58.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.263+0000 7fe99db13700 1 -- 172.21.15.156:0/1673963662 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99809abc0 con 0x7fe9980a1510 2023-09-30T22:19:58.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.264+0000 7fe99db13700 1 --2- 172.21.15.156:0/1673963662 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9980a1510 0x7fe9981351a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe9880098f0 tx=0x7fe988009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd86679d0fe36238 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:58.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.264+0000 7fe99d312700 1 -- 172.21.15.156:0/1673963662 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe988011830 con 0x7fe9980a1510 2023-09-30T22:19:58.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.264+0000 7fe99d312700 1 -- 172.21.15.156:0/1673963662 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe988011990 con 0x7fe9980a1510 2023-09-30T22:19:58.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.264+0000 7fe99d312700 1 -- 172.21.15.156:0/1673963662 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe988011d20 con 0x7fe9980a1510 2023-09-30T22:19:58.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.264+0000 7fe9a0578700 1 -- 172.21.15.156:0/1673963662 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9980a1510 msgr2=0x7fe9981351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:58.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.264+0000 7fe9a0578700 1 --2- 172.21.15.156:0/1673963662 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9980a1510 0x7fe9981351a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe9880098f0 tx=0x7fe988009c00 comp rx=0 tx=0).stop 2023-09-30T22:19:58.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.265+0000 7fe9a0578700 1 -- 172.21.15.156:0/1673963662 shutdown_connections 2023-09-30T22:19:58.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.265+0000 7fe9a0578700 1 --2- 172.21.15.156:0/1673963662 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9981356e0 0x7fe998137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.265+0000 7fe9a0578700 1 --2- 172.21.15.156:0/1673963662 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9980a1510 0x7fe9981351a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.265+0000 7fe9a0578700 1 -- 172.21.15.156:0/1673963662 >> 172.21.15.156:0/1673963662 conn(0x7fe9980a2980 msgr2=0x7fe9980a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:58.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.265+0000 7fe9a0578700 1 -- 172.21.15.156:0/1673963662 shutdown_connections 2023-09-30T22:19:58.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.265+0000 7fe9a0578700 1 -- 172.21.15.156:0/1673963662 wait complete. 2023-09-30T22:19:58.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.266+0000 7fe9a0578700 1 Processor -- start 2023-09-30T22:19:58.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.266+0000 7fe9a0578700 1 -- start start 2023-09-30T22:19:58.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.266+0000 7fe9a0578700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9980a0a30 0x7fe9981387b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:58.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.266+0000 7fe9a0578700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9980a1510 0x7fe998138cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:58.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.266+0000 7fe9a0578700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9981356e0 0x7fe9981c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:58.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.266+0000 7fe9a0578700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9981311c0 con 0x7fe9980a0a30 2023-09-30T22:19:58.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.266+0000 7fe9a0578700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe99809f7f0 con 0x7fe9981356e0 2023-09-30T22:19:58.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.266+0000 7fe9a0578700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9981313c0 con 0x7fe9980a1510 2023-09-30T22:19:58.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.267+0000 7fe99e314700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9980a0a30 0x7fe9981387b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:58.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.267+0000 7fe99e314700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9980a0a30 0x7fe9981387b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51470/0 (socket says 172.21.15.156:51470) 2023-09-30T22:19:58.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.267+0000 7fe99db13700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9980a1510 0x7fe998138cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:58.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.267+0000 7fe99e314700 1 -- 172.21.15.156:0/1887746466 learned_addr learned my addr 172.21.15.156:0/1887746466 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:58.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.267+0000 7fe99eb15700 1 --2- 172.21.15.156:0/1887746466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9981356e0 0x7fe9981c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:58.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.267+0000 7fe99e314700 1 -- 172.21.15.156:0/1887746466 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9980a1510 msgr2=0x7fe998138cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:58.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.267+0000 7fe99e314700 1 --2- 172.21.15.156:0/1887746466 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9980a1510 0x7fe998138cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.267+0000 7fe99e314700 1 -- 172.21.15.156:0/1887746466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9981356e0 msgr2=0x7fe9981c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:58.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.267+0000 7fe99e314700 1 --2- 172.21.15.156:0/1887746466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9981356e0 0x7fe9981c6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.267+0000 7fe99e314700 1 -- 172.21.15.156:0/1887746466 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe988009550 con 0x7fe9980a0a30 2023-09-30T22:19:58.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.267+0000 7fe99eb15700 1 --2- 172.21.15.156:0/1887746466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9981356e0 0x7fe9981c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:19:58.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.267+0000 7fe99e314700 1 --2- 172.21.15.156:0/1887746466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9980a0a30 0x7fe9981387b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe99400c480 tx=0x7fe99400c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:58.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.267+0000 7fe98effd700 1 -- 172.21.15.156:0/1887746466 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9940054e0 con 0x7fe9980a0a30 2023-09-30T22:19:58.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.267+0000 7fe98effd700 1 -- 172.21.15.156:0/1887746466 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe994003680 con 0x7fe9980a0a30 2023-09-30T22:19:58.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.267+0000 7fe98effd700 1 -- 172.21.15.156:0/1887746466 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe994003a30 con 0x7fe9980a0a30 2023-09-30T22:19:58.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.267+0000 7fe9a0578700 1 -- 172.21.15.156:0/1887746466 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99812f520 con 0x7fe9980a0a30 2023-09-30T22:19:58.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.268+0000 7fe9a0578700 1 -- 172.21.15.156:0/1887746466 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe998131b50 con 0x7fe9980a0a30 2023-09-30T22:19:58.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.268+0000 7fe98effd700 1 -- 172.21.15.156:0/1887746466 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe994003b90 con 0x7fe9980a0a30 2023-09-30T22:19:58.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.268+0000 7fe98effd700 1 -- 172.21.15.156:0/1887746466 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe99403ebe0 con 0x7fe9980a0a30 2023-09-30T22:19:58.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.269+0000 7fe9a0578700 1 -- 172.21.15.156:0/1887746466 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99804f2a0 con 0x7fe9980a0a30 2023-09-30T22:19:58.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.274+0000 7fe98effd700 1 -- 172.21.15.156:0/1887746466 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe994017020 con 0x7fe9980a0a30 2023-09-30T22:19:58.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.287+0000 7fad82ed3700 1 -- 172.21.15.156:0/2783607157 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fad7c0a03f0 con 0x7fad7c09e170 2023-09-30T22:19:58.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.287+0000 7fad797fa700 1 -- 172.21.15.156:0/2783607157 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad6800db40 con 0x7fad7c09e170 2023-09-30T22:19:58.288 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:58.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.289+0000 7fad82ed3700 1 -- 172.21.15.156:0/2783607157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad7c09e170 msgr2=0x7fad7c11c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:58.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.289+0000 7fad82ed3700 1 --2- 172.21.15.156:0/2783607157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad7c09e170 0x7fad7c11c780 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fad68010ee0 tx=0x7fad6800e640 comp rx=0 tx=0).stop 2023-09-30T22:19:58.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.289+0000 7fad82ed3700 1 -- 172.21.15.156:0/2783607157 shutdown_connections 2023-09-30T22:19:58.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.289+0000 7fad82ed3700 1 --2- 172.21.15.156:0/2783607157 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad7c130ce0 0x7fad7c11ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.289+0000 7fad82ed3700 1 --2- 172.21.15.156:0/2783607157 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad7c09d860 0x7fad7c11c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.289+0000 7fad82ed3700 1 --2- 172.21.15.156:0/2783607157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad7c09e170 0x7fad7c11c780 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.289+0000 7fad82ed3700 1 -- 172.21.15.156:0/2783607157 >> 172.21.15.156:0/2783607157 conn(0x7fad7c099c40 msgr2=0x7fad7c130040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:58.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.289+0000 7fad82ed3700 1 -- 172.21.15.156:0/2783607157 shutdown_connections 2023-09-30T22:19:58.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.289+0000 7fad82ed3700 1 -- 172.21.15.156:0/2783607157 wait complete. 2023-09-30T22:19:58.303 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:58.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.443+0000 7ff523074700 1 -- 172.21.15.156:0/990525504 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff51c121be0 con 0x7ff51c09d860 2023-09-30T22:19:58.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.443+0000 7ff5197fa700 1 -- 172.21.15.156:0/990525504 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff50c020b50 con 0x7ff51c09d860 2023-09-30T22:19:58.444 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:58.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.445+0000 7ff523074700 1 -- 172.21.15.156:0/990525504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff51c09d860 msgr2=0x7ff51c1c4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:58.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.445+0000 7ff523074700 1 --2- 172.21.15.156:0/990525504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff51c09d860 0x7ff51c1c4430 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff50c0123f0 tx=0x7ff50c012700 comp rx=0 tx=0).stop 2023-09-30T22:19:58.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.445+0000 7ff523074700 1 -- 172.21.15.156:0/990525504 shutdown_connections 2023-09-30T22:19:58.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.445+0000 7ff523074700 1 --2- 172.21.15.156:0/990525504 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff51c130eb0 0x7ff51c11e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.445+0000 7ff523074700 1 --2- 172.21.15.156:0/990525504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff51c09d860 0x7ff51c1c4430 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.445+0000 7ff523074700 1 --2- 172.21.15.156:0/990525504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff51c09e170 0x7ff51c1c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.445+0000 7ff523074700 1 -- 172.21.15.156:0/990525504 >> 172.21.15.156:0/990525504 conn(0x7ff51c099c40 msgr2=0x7ff51c070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:58.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.445+0000 7ff523074700 1 -- 172.21.15.156:0/990525504 shutdown_connections 2023-09-30T22:19:58.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.445+0000 7ff523074700 1 -- 172.21.15.156:0/990525504 wait complete. 2023-09-30T22:19:58.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:58.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.468+0000 7fe9a0578700 1 -- 172.21.15.156:0/1887746466 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe99809ae00 con 0x7fe9980a0a30 2023-09-30T22:19:58.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.469+0000 7fe98effd700 1 -- 172.21.15.156:0/1887746466 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe994003e40 con 0x7fe9980a0a30 2023-09-30T22:19:58.470 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:58.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.471+0000 7fe9a0578700 1 -- 172.21.15.156:0/1887746466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9980a0a30 msgr2=0x7fe9981387b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:58.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.471+0000 7fe9a0578700 1 --2- 172.21.15.156:0/1887746466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9980a0a30 0x7fe9981387b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe99400c480 tx=0x7fe99400c790 comp rx=0 tx=0).stop 2023-09-30T22:19:58.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.471+0000 7fe9a0578700 1 -- 172.21.15.156:0/1887746466 shutdown_connections 2023-09-30T22:19:58.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.471+0000 7fe9a0578700 1 --2- 172.21.15.156:0/1887746466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9981356e0 0x7fe9981c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.471+0000 7fe9a0578700 1 --2- 172.21.15.156:0/1887746466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9980a0a30 0x7fe9981387b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.471+0000 7fe9a0578700 1 --2- 172.21.15.156:0/1887746466 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9980a1510 0x7fe998138cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.471+0000 7fe9a0578700 1 -- 172.21.15.156:0/1887746466 >> 172.21.15.156:0/1887746466 conn(0x7fe9980a2980 msgr2=0x7fe99812e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:58.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.471+0000 7fe9a0578700 1 -- 172.21.15.156:0/1887746466 shutdown_connections 2023-09-30T22:19:58.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.471+0000 7fe9a0578700 1 -- 172.21.15.156:0/1887746466 wait complete. 2023-09-30T22:19:58.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.472+0000 7fa64ae63700 1 -- 172.21.15.156:0/3338514998 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa64404f2a0 con 0x7fa6440a1230 2023-09-30T22:19:58.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.473+0000 7fa6417fa700 1 -- 172.21.15.156:0/3338514998 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa630021070 con 0x7fa6440a1230 2023-09-30T22:19:58.474 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:58.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.475+0000 7fa64ae63700 1 -- 172.21.15.156:0/3338514998 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa6440a1230 msgr2=0x7fa644134da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:58.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.475+0000 7fa64ae63700 1 --2- 172.21.15.156:0/3338514998 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa6440a1230 0x7fa644134da0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa63000e840 tx=0x7fa63000eb50 comp rx=0 tx=0).stop 2023-09-30T22:19:58.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.475+0000 7fa64ae63700 1 -- 172.21.15.156:0/3338514998 shutdown_connections 2023-09-30T22:19:58.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.475+0000 7fa64ae63700 1 --2- 172.21.15.156:0/3338514998 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa644138040 0x7fa6441d4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.475+0000 7fa64ae63700 1 --2- 172.21.15.156:0/3338514998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6440a08e0 0x7fa644134860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.475+0000 7fa64ae63700 1 --2- 172.21.15.156:0/3338514998 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa6440a1230 0x7fa644134da0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:58.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.475+0000 7fa64ae63700 1 -- 172.21.15.156:0/3338514998 >> 172.21.15.156:0/3338514998 conn(0x7fa6440a2980 msgr2=0x7fa644070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:58.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.475+0000 7fa64ae63700 1 -- 172.21.15.156:0/3338514998 shutdown_connections 2023-09-30T22:19:58.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:58.475+0000 7fa64ae63700 1 -- 172.21.15.156:0/3338514998 wait complete. 2023-09-30T22:19:58.485 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:19:58.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:59.304 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:59.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.437+0000 7fb377cd1700 1 Processor -- start 2023-09-30T22:19:59.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.438+0000 7fb377cd1700 1 -- start start 2023-09-30T22:19:59.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.438+0000 7fb377cd1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb370133ad0 0x7fb370133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:59.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.438+0000 7fb377cd1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb3701300a0 0x7fb3701304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:59.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.438+0000 7fb377cd1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb3701309f0 0x7fb37013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:59.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.438+0000 7fb377cd1700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb37006b2d0 con 0x7fb3701300a0 2023-09-30T22:19:59.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.438+0000 7fb377cd1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb370133610 con 0x7fb370133ad0 2023-09-30T22:19:59.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.438+0000 7fb377cd1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb37009a500 con 0x7fb3701309f0 2023-09-30T22:19:59.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.438+0000 7fb375a6d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb370133ad0 0x7fb370133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:59.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.438+0000 7fb37526c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb3701300a0 0x7fb3701304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:59.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.438+0000 7fb37626e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb3701309f0 0x7fb37013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:59.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.438+0000 7fb37526c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb3701300a0 0x7fb3701304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51476/0 (socket says 172.21.15.156:51476) 2023-09-30T22:19:59.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.438+0000 7fb37626e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb3701309f0 0x7fb37013a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48844/0 (socket says 172.21.15.156:48844) 2023-09-30T22:19:59.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.438+0000 7fb37526c700 1 -- 172.21.15.156:0/2793350822 learned_addr learned my addr 172.21.15.156:0/2793350822 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:59.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.438+0000 7fb375a6d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb370133ad0 0x7fb370133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37144/0 (socket says 172.21.15.156:37144) 2023-09-30T22:19:59.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.439+0000 7fb375a6d700 1 -- 172.21.15.156:0/2793350822 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb3701309f0 msgr2=0x7fb37013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:59.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.439+0000 7fb375a6d700 1 --2- 172.21.15.156:0/2793350822 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb3701309f0 0x7fb37013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.439+0000 7fb375a6d700 1 -- 172.21.15.156:0/2793350822 >> v2:172.21.15.156:3300/0 conn(0x7fb3701300a0 msgr2=0x7fb3701304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:59.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.439+0000 7fb375a6d700 1 --2- 172.21.15.156:0/2793350822 >> v2:172.21.15.156:3300/0 conn(0x7fb3701300a0 0x7fb3701304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.439+0000 7fb375a6d700 1 -- 172.21.15.156:0/2793350822 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3701338b0 con 0x7fb370133ad0 2023-09-30T22:19:59.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.439+0000 7fb37526c700 1 --2- 172.21.15.156:0/2793350822 >> v2:172.21.15.156:3300/0 conn(0x7fb3701300a0 0x7fb3701304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:59.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.439+0000 7fb37626e700 1 --2- 172.21.15.156:0/2793350822 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb3701309f0 0x7fb37013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:59.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.439+0000 7fb375a6d700 1 --2- 172.21.15.156:0/2793350822 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb370133ad0 0x7fb370133ea0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb360009840 tx=0x7fb360009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dab6e2394ea441f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:59.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.439+0000 7fb374a6b700 1 -- 172.21.15.156:0/2793350822 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb360011830 con 0x7fb370133ad0 2023-09-30T22:19:59.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.439+0000 7fb374a6b700 1 -- 172.21.15.156:0/2793350822 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb360011990 con 0x7fb370133ad0 2023-09-30T22:19:59.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.439+0000 7fb374a6b700 1 -- 172.21.15.156:0/2793350822 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb360011d20 con 0x7fb370133ad0 2023-09-30T22:19:59.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.440+0000 7fb377cd1700 1 -- 172.21.15.156:0/2793350822 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb370133ad0 msgr2=0x7fb370133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:59.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.440+0000 7fb377cd1700 1 --2- 172.21.15.156:0/2793350822 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb370133ad0 0x7fb370133ea0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb360009840 tx=0x7fb360009b50 comp rx=0 tx=0).stop 2023-09-30T22:19:59.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.440+0000 7fb377cd1700 1 -- 172.21.15.156:0/2793350822 shutdown_connections 2023-09-30T22:19:59.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.440+0000 7fb377cd1700 1 --2- 172.21.15.156:0/2793350822 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb3701309f0 0x7fb37013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.440+0000 7fb377cd1700 1 --2- 172.21.15.156:0/2793350822 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb370133ad0 0x7fb370133ea0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.440+0000 7fb377cd1700 1 --2- 172.21.15.156:0/2793350822 >> v2:172.21.15.156:3300/0 conn(0x7fb3701300a0 0x7fb3701304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.440+0000 7fb377cd1700 1 -- 172.21.15.156:0/2793350822 >> 172.21.15.156:0/2793350822 conn(0x7fb370099c40 msgr2=0x7fb3700a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:59.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.440+0000 7fb377cd1700 1 -- 172.21.15.156:0/2793350822 shutdown_connections 2023-09-30T22:19:59.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.440+0000 7fb377cd1700 1 -- 172.21.15.156:0/2793350822 wait complete. 2023-09-30T22:19:59.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.441+0000 7fb377cd1700 1 Processor -- start 2023-09-30T22:19:59.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.441+0000 7fb377cd1700 1 -- start start 2023-09-30T22:19:59.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.441+0000 7fb377cd1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3701300a0 0x7fb37011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:59.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.441+0000 7fb377cd1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb3701309f0 0x7fb37011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:59.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.441+0000 7fb377cd1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb370133ad0 0x7fb37011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:59.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.441+0000 7fb377cd1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37012d6c0 con 0x7fb3701300a0 2023-09-30T22:19:59.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.441+0000 7fb377cd1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb370072310 con 0x7fb3701309f0 2023-09-30T22:19:59.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.441+0000 7fb377cd1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb37011ff20 con 0x7fb370133ad0 2023-09-30T22:19:59.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.441+0000 7fb37526c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb3701309f0 0x7fb37011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:59.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.441+0000 7fb375a6d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3701300a0 0x7fb37011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:59.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.441+0000 7fb37526c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb3701309f0 0x7fb37011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37146/0 (socket says 172.21.15.156:37146) 2023-09-30T22:19:59.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.441+0000 7fb37526c700 1 -- 172.21.15.156:0/3423636429 learned_addr learned my addr 172.21.15.156:0/3423636429 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:59.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.441+0000 7fb37626e700 1 --2- 172.21.15.156:0/3423636429 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb370133ad0 0x7fb37011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:59.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.441+0000 7fb375a6d700 1 -- 172.21.15.156:0/3423636429 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb370133ad0 msgr2=0x7fb37011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:59.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.441+0000 7fb375a6d700 1 --2- 172.21.15.156:0/3423636429 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb370133ad0 0x7fb37011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.441+0000 7fb375a6d700 1 -- 172.21.15.156:0/3423636429 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb3701309f0 msgr2=0x7fb37011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:59.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.441+0000 7fb375a6d700 1 --2- 172.21.15.156:0/3423636429 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb3701309f0 0x7fb37011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.441+0000 7fb375a6d700 1 -- 172.21.15.156:0/3423636429 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36c009550 con 0x7fb3701300a0 2023-09-30T22:19:59.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.441+0000 7fb37526c700 1 --2- 172.21.15.156:0/3423636429 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb3701309f0 0x7fb37011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:59.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.442+0000 7fb375a6d700 1 --2- 172.21.15.156:0/3423636429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3701300a0 0x7fb37011da40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb360016000 tx=0x7fb360004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:59.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.442+0000 7fb3667fc700 1 -- 172.21.15.156:0/3423636429 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb360004450 con 0x7fb3701300a0 2023-09-30T22:19:59.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.442+0000 7fb3667fc700 1 -- 172.21.15.156:0/3423636429 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3600036a0 con 0x7fb3701300a0 2023-09-30T22:19:59.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.442+0000 7fb377cd1700 1 -- 172.21.15.156:0/3423636429 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb368009a70 con 0x7fb3701300a0 2023-09-30T22:19:59.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.442+0000 7fb3667fc700 1 -- 172.21.15.156:0/3423636429 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3600045f0 con 0x7fb3701300a0 2023-09-30T22:19:59.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.442+0000 7fb377cd1700 1 -- 172.21.15.156:0/3423636429 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3600094a0 con 0x7fb3701300a0 2023-09-30T22:19:59.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.442+0000 7fb3667fc700 1 -- 172.21.15.156:0/3423636429 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb360003a50 con 0x7fb3701300a0 2023-09-30T22:19:59.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.443+0000 7fb3667fc700 1 -- 172.21.15.156:0/3423636429 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb360040680 con 0x7fb3701300a0 2023-09-30T22:19:59.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.443+0000 7fb377cd1700 1 -- 172.21.15.156:0/3423636429 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb37009cb20 con 0x7fb3701300a0 2023-09-30T22:19:59.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.448+0000 7fb3667fc700 1 -- 172.21.15.156:0/3423636429 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb36002e970 con 0x7fb3701300a0 2023-09-30T22:19:59.460 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:59.486 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:59.489 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:59.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.588+0000 7f2bf29a6700 1 Processor -- start 2023-09-30T22:19:59.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.588+0000 7f2bf29a6700 1 -- start start 2023-09-30T22:19:59.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.588+0000 7f2bf29a6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2bec138410 0x7f2bec0a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:59.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.588+0000 7f2bf29a6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2bec13dd10 0x7f2bec1400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:59.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.588+0000 7f2bf29a6700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bec1379e0 con 0x7f2bec138040 2023-09-30T22:19:59.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.588+0000 7f2bf29a6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec0a2100 con 0x7f2bec13dd10 2023-09-30T22:19:59.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.588+0000 7f2bf29a6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec09b9b0 con 0x7f2bec138410 2023-09-30T22:19:59.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.588+0000 7f2bebfff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f2bec138040 0x7f2bec0a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53306/0 (socket says 172.21.15.156:53306) 2023-09-30T22:19:59.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.588+0000 7f2bebfff700 1 -- 172.21.15.156:0/1352819570 learned_addr learned my addr 172.21.15.156:0/1352819570 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:59.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.589+0000 7f2bf0f43700 1 --2- 172.21.15.156:0/1352819570 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2bec13dd10 0x7f2bec1400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:59.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.589+0000 7f2beb7fe700 1 --2- 172.21.15.156:0/1352819570 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2bec138410 0x7f2bec0a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:59.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.589+0000 7f2beaffd700 1 -- 172.21.15.156:0/1352819570 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477037647 0 0) 0x7f2bec1379e0 con 0x7f2bec138040 2023-09-30T22:19:59.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.589+0000 7f2beaffd700 1 -- 172.21.15.156:0/1352819570 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bd40035b0 con 0x7f2bec138040 2023-09-30T22:19:59.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.589+0000 7f2bf0f43700 1 -- 172.21.15.156:0/1352819570 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2bec138410 msgr2=0x7f2bec0a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:59.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.589+0000 7f2bf0f43700 1 --2- 172.21.15.156:0/1352819570 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2bec138410 0x7f2bec0a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.589+0000 7f2bf0f43700 1 -- 172.21.15.156:0/1352819570 >> v1:172.21.15.156:6789/0 conn(0x7f2bec138040 legacy=0x7f2bec0a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:59.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.589+0000 7f2bf0f43700 1 -- 172.21.15.156:0/1352819570 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bec137c10 con 0x7f2bec13dd10 2023-09-30T22:19:59.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.589+0000 7f2bf0f43700 1 --2- 172.21.15.156:0/1352819570 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2bec13dd10 0x7f2bec1400f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2be4009dc0 tx=0x7f2be400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e0cb46f3003a465 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:59.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.589+0000 7f2beaffd700 1 -- 172.21.15.156:0/1352819570 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be400e070 con 0x7f2bec13dd10 2023-09-30T22:19:59.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.589+0000 7f2beaffd700 1 -- 172.21.15.156:0/1352819570 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be400bb20 con 0x7f2bec13dd10 2023-09-30T22:19:59.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.589+0000 7f2beaffd700 1 -- 172.21.15.156:0/1352819570 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be4012430 con 0x7f2bec13dd10 2023-09-30T22:19:59.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.590+0000 7f2bf29a6700 1 -- 172.21.15.156:0/1352819570 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2bec13dd10 msgr2=0x7f2bec1400f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:59.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.590+0000 7f2bf29a6700 1 --2- 172.21.15.156:0/1352819570 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2bec13dd10 0x7f2bec1400f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2be4009dc0 tx=0x7f2be400b330 comp rx=0 tx=0).stop 2023-09-30T22:19:59.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.590+0000 7f2bf29a6700 1 -- 172.21.15.156:0/1352819570 shutdown_connections 2023-09-30T22:19:59.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.590+0000 7f2bf29a6700 1 --2- 172.21.15.156:0/1352819570 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2bec13dd10 0x7f2bec1400f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.590+0000 7f2bf29a6700 1 --2- 172.21.15.156:0/1352819570 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2bec138410 0x7f2bec0a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.590+0000 7f2bf29a6700 1 -- 172.21.15.156:0/1352819570 >> 172.21.15.156:0/1352819570 conn(0x7f2bec0a2980 msgr2=0x7f2bec0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:59.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.590+0000 7f2bf29a6700 1 -- 172.21.15.156:0/1352819570 shutdown_connections 2023-09-30T22:19:59.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.590+0000 7f2bf29a6700 1 -- 172.21.15.156:0/1352819570 wait complete. 2023-09-30T22:19:59.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.591+0000 7f2bf29a6700 1 Processor -- start 2023-09-30T22:19:59.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.591+0000 7f2bf29a6700 1 -- start start 2023-09-30T22:19:59.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.592+0000 7f2bf29a6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2bec138040 0x7f2bec0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:59.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.592+0000 7f2bf29a6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2bec138410 0x7f2bec070820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:59.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.592+0000 7f2bf29a6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2bec13dd10 0x7f2bec070d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:59.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.592+0000 7f2bf29a6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec09a2b0 con 0x7f2bec138040 2023-09-30T22:19:59.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.592+0000 7f2bf29a6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec071df0 con 0x7f2bec138410 2023-09-30T22:19:59.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.592+0000 7f2bf29a6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec138e80 con 0x7f2bec13dd10 2023-09-30T22:19:59.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.592+0000 7f2beb7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2bec138410 0x7f2bec070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:59.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.592+0000 7f2beb7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2bec138410 0x7f2bec070820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37166/0 (socket says 172.21.15.156:37166) 2023-09-30T22:19:59.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.592+0000 7f2beb7fe700 1 -- 172.21.15.156:0/2784530417 learned_addr learned my addr 172.21.15.156:0/2784530417 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:59.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.592+0000 7f2bebfff700 1 --2- 172.21.15.156:0/2784530417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2bec138040 0x7f2bec0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:59.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.592+0000 7f2bf0f43700 1 --2- 172.21.15.156:0/2784530417 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2bec13dd10 0x7f2bec070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:59.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.592+0000 7f2bebfff700 1 -- 172.21.15.156:0/2784530417 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2bec13dd10 msgr2=0x7f2bec070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:59.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.592+0000 7f2bebfff700 1 --2- 172.21.15.156:0/2784530417 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2bec13dd10 0x7f2bec070d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.592+0000 7f2bebfff700 1 -- 172.21.15.156:0/2784530417 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2bec138410 msgr2=0x7f2bec070820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:59.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.592+0000 7f2bebfff700 1 --2- 172.21.15.156:0/2784530417 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2bec138410 0x7f2bec070820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.592+0000 7f2bebfff700 1 -- 172.21.15.156:0/2784530417 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be4009a70 con 0x7f2bec138040 2023-09-30T22:19:59.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.592+0000 7f2beb7fe700 1 --2- 172.21.15.156:0/2784530417 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2bec138410 0x7f2bec070820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:59.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.592+0000 7f2bebfff700 1 --2- 172.21.15.156:0/2784530417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2bec138040 0x7f2bec0702e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc001360 tx=0x7f2bdc00c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:59.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.592+0000 7f2be8ff9700 1 -- 172.21.15.156:0/2784530417 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc0072d0 con 0x7f2bec138040 2023-09-30T22:19:59.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.593+0000 7f2be8ff9700 1 -- 172.21.15.156:0/2784530417 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bdc007430 con 0x7f2bec138040 2023-09-30T22:19:59.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.593+0000 7f2be8ff9700 1 -- 172.21.15.156:0/2784530417 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc005830 con 0x7f2bec138040 2023-09-30T22:19:59.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.593+0000 7f2bf29a6700 1 -- 172.21.15.156:0/2784530417 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bec13a0f0 con 0x7f2bec138040 2023-09-30T22:19:59.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.593+0000 7f2bf29a6700 1 -- 172.21.15.156:0/2784530417 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bec13ae20 con 0x7f2bec138040 2023-09-30T22:19:59.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.594+0000 7f2bf29a6700 1 -- 172.21.15.156:0/2784530417 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bec04f2a0 con 0x7f2bec138040 2023-09-30T22:19:59.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.595+0000 7f2be8ff9700 1 -- 172.21.15.156:0/2784530417 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2bdc005ba0 con 0x7f2bec138040 2023-09-30T22:19:59.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.595+0000 7f2be8ff9700 1 -- 172.21.15.156:0/2784530417 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2bdc03f050 con 0x7f2bec138040 2023-09-30T22:19:59.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.599+0000 7f2be8ff9700 1 -- 172.21.15.156:0/2784530417 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2bdc01b3b0 con 0x7f2bec138040 2023-09-30T22:19:59.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.632+0000 7fa1325c5700 1 Processor -- start 2023-09-30T22:19:59.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.632+0000 7fa1325c5700 1 -- start start 2023-09-30T22:19:59.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.632+0000 7f455e085700 1 Processor -- start 2023-09-30T22:19:59.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.632+0000 7f455e085700 1 -- start start 2023-09-30T22:19:59.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.633+0000 7f455e085700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f45581346e0 0x7f4558136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:59.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.633+0000 7f455e085700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4558137000 0x7f45581393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:59.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.633+0000 7fa1325c5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa12c134750 0x7fa12c136b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:59.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.633+0000 7fa1325c5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa12c137070 0x7fa12c139450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:59.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.633+0000 7fa1325c5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa12c0a2590 con 0x7fa12c1317c0 2023-09-30T22:19:59.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.633+0000 7fa12bfff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fa12c1317c0 0x7fa12c131b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53324/0 (socket says 172.21.15.156:53324) 2023-09-30T22:19:59.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.633+0000 7fa12bfff700 1 -- 172.21.15.156:0/3536457162 learned_addr learned my addr 172.21.15.156:0/3536457162 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:19:59.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.633+0000 7f455e085700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45580a1640 con 0x7f4558131980 2023-09-30T22:19:59.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.633+0000 7f455e085700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f455806eb30 con 0x7f4558137000 2023-09-30T22:19:59.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.633+0000 7f455e085700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45580a22d0 con 0x7f45581346e0 2023-09-30T22:19:59.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.633+0000 7f4557fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4558137000 0x7f45581393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:59.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.633+0000 7f4557fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4558137000 0x7f45581393e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51500/0 (socket says 172.21.15.156:51500) 2023-09-30T22:19:59.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.633+0000 7f4557fff700 1 -- 172.21.15.156:0/3991335476 learned_addr learned my addr 172.21.15.156:0/3991335476 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:59.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.633+0000 7fa12b7fe700 1 --2- 172.21.15.156:0/3536457162 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa12c134750 0x7fa12c136b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:59.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.633+0000 7fa1325c5700 1 -- 172.21.15.156:0/3536457162 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c1315c0 con 0x7fa12c134750 2023-09-30T22:19:59.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.633+0000 7fa1325c5700 1 -- 172.21.15.156:0/3536457162 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c0a1640 con 0x7fa12c137070 2023-09-30T22:19:59.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.633+0000 7f4557fff700 1 -- 172.21.15.156:0/3991335476 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f45581346e0 msgr2=0x7f4558136ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:59.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.633+0000 7f4557fff700 1 --2- 172.21.15.156:0/3991335476 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f45581346e0 0x7f4558136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.633+0000 7f4557fff700 1 -- 172.21.15.156:0/3991335476 >> v1:172.21.15.156:6789/0 conn(0x7f4558131980 legacy=0x7f4558131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:59.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.633+0000 7f4557fff700 1 -- 172.21.15.156:0/3991335476 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4558131550 con 0x7f4558137000 2023-09-30T22:19:59.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.633+0000 7f45567fc700 1 -- 172.21.15.156:0/3991335476 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4180166812 0 0) 0x7f45580a1640 con 0x7f4558131980 2023-09-30T22:19:59.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.634+0000 7fa12affd700 1 -- 172.21.15.156:0/3536457162 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1074912205 0 0) 0x7fa12c0a2590 con 0x7fa12c1317c0 2023-09-30T22:19:59.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.634+0000 7fa12affd700 1 -- 172.21.15.156:0/3536457162 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1140035b0 con 0x7fa12c1317c0 2023-09-30T22:19:59.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.634+0000 7fa12b7fe700 1 -- 172.21.15.156:0/3536457162 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa12c137070 msgr2=0x7fa12c139450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:59.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.634+0000 7fa130b62700 1 --2- 172.21.15.156:0/3536457162 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa12c137070 0x7fa12c139450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:59.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.634+0000 7fa12b7fe700 1 --2- 172.21.15.156:0/3536457162 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa12c137070 0x7fa12c139450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.634+0000 7fa12b7fe700 1 -- 172.21.15.156:0/3536457162 >> v1:172.21.15.156:6789/0 conn(0x7fa12c1317c0 legacy=0x7fa12c131b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:59.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.634+0000 7fa12b7fe700 1 -- 172.21.15.156:0/3536457162 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa12c0a22d0 con 0x7fa12c134750 2023-09-30T22:19:59.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.634+0000 7fa130b62700 1 --2- 172.21.15.156:0/3536457162 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa12c137070 0x7fa12c139450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:19:59.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.634+0000 7f4557fff700 1 --2- 172.21.15.156:0/3991335476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4558137000 0x7f45581393e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4550009e50 tx=0x7f455000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4b6bad43e79c77 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:59.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.634+0000 7fa12b7fe700 1 --2- 172.21.15.156:0/3536457162 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa12c134750 0x7fa12c136b30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa120009870 tx=0x7fa120009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f550ec09d23126a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:59.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.634+0000 7f45567fc700 1 -- 172.21.15.156:0/3991335476 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455000e070 con 0x7f4558137000 2023-09-30T22:19:59.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.634+0000 7f45567fc700 1 -- 172.21.15.156:0/3991335476 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455000b9c0 con 0x7f4558137000 2023-09-30T22:19:59.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.634+0000 7f45567fc700 1 -- 172.21.15.156:0/3991335476 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455000bd70 con 0x7f4558137000 2023-09-30T22:19:59.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.634+0000 7fa12affd700 1 -- 172.21.15.156:0/3536457162 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa120011830 con 0x7fa12c134750 2023-09-30T22:19:59.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.634+0000 7fa12affd700 1 -- 172.21.15.156:0/3536457162 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa120011990 con 0x7fa12c134750 2023-09-30T22:19:59.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.634+0000 7fa12affd700 1 -- 172.21.15.156:0/3536457162 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa120011d20 con 0x7fa12c134750 2023-09-30T22:19:59.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.635+0000 7f455e085700 1 -- 172.21.15.156:0/3991335476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4558137000 msgr2=0x7f45581393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:59.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.635+0000 7f455e085700 1 --2- 172.21.15.156:0/3991335476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4558137000 0x7f45581393e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4550009e50 tx=0x7f455000b330 comp rx=0 tx=0).stop 2023-09-30T22:19:59.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.635+0000 7fa1325c5700 1 -- 172.21.15.156:0/3536457162 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa12c134750 msgr2=0x7fa12c136b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:59.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.635+0000 7fa1325c5700 1 --2- 172.21.15.156:0/3536457162 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa12c134750 0x7fa12c136b30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa120009870 tx=0x7fa120009b80 comp rx=0 tx=0).stop 2023-09-30T22:19:59.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.635+0000 7fa1325c5700 1 -- 172.21.15.156:0/3536457162 shutdown_connections 2023-09-30T22:19:59.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.635+0000 7fa1325c5700 1 --2- 172.21.15.156:0/3536457162 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa12c137070 0x7fa12c139450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.635+0000 7fa1325c5700 1 --2- 172.21.15.156:0/3536457162 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa12c134750 0x7fa12c136b30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.635+0000 7fa1325c5700 1 -- 172.21.15.156:0/3536457162 >> 172.21.15.156:0/3536457162 conn(0x7fa12c0a2980 msgr2=0x7fa12c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:59.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.635+0000 7fa1325c5700 1 -- 172.21.15.156:0/3536457162 shutdown_connections 2023-09-30T22:19:59.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.635+0000 7fa1325c5700 1 -- 172.21.15.156:0/3536457162 wait complete. 2023-09-30T22:19:59.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.635+0000 7f455e085700 1 -- 172.21.15.156:0/3991335476 shutdown_connections 2023-09-30T22:19:59.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.635+0000 7f455e085700 1 --2- 172.21.15.156:0/3991335476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4558137000 0x7f45581393e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.635+0000 7f455e085700 1 --2- 172.21.15.156:0/3991335476 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f45581346e0 0x7f4558136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.635+0000 7f455e085700 1 -- 172.21.15.156:0/3991335476 >> 172.21.15.156:0/3991335476 conn(0x7f45580a2980 msgr2=0x7f45580a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:59.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.635+0000 7f455e085700 1 -- 172.21.15.156:0/3991335476 shutdown_connections 2023-09-30T22:19:59.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.635+0000 7f455e085700 1 -- 172.21.15.156:0/3991335476 wait complete. 2023-09-30T22:19:59.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.636+0000 7f455e085700 1 Processor -- start 2023-09-30T22:19:59.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.636+0000 7f455e085700 1 -- start start 2023-09-30T22:19:59.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.636+0000 7fa1325c5700 1 Processor -- start 2023-09-30T22:19:59.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.637+0000 7fa1325c5700 1 -- start start 2023-09-30T22:19:59.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.637+0000 7f455e085700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4558131980 0x7f455809a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:59.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.637+0000 7f455e085700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45581346e0 0x7f455809ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:59.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.637+0000 7f455e085700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4558137000 0x7f455809b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:59.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.637+0000 7f455e085700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4558136780 con 0x7f45581346e0 2023-09-30T22:19:59.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.637+0000 7f455e085700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45580a1c40 con 0x7f4558137000 2023-09-30T22:19:59.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.637+0000 7f455e085700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4558119d50 con 0x7f4558131980 2023-09-30T22:19:59.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.637+0000 7f45577fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4558131980 0x7f455809a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:59.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.637+0000 7f45577fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4558131980 0x7f455809a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48902/0 (socket says 172.21.15.156:48902) 2023-09-30T22:19:59.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.637+0000 7f45577fe700 1 -- 172.21.15.156:0/2762960484 learned_addr learned my addr 172.21.15.156:0/2762960484 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:59.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.637+0000 7f4557fff700 1 --2- 172.21.15.156:0/2762960484 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4558137000 0x7f455809b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:59.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.637+0000 7fa1325c5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa12c1317c0 0x7fa12c09e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:59.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.637+0000 7f4557fff700 1 -- 172.21.15.156:0/2762960484 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4558131980 msgr2=0x7f455809a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:59.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.637+0000 7f4557fff700 1 --2- 172.21.15.156:0/2762960484 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4558131980 0x7f455809a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.637+0000 7f4557fff700 1 -- 172.21.15.156:0/2762960484 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45581346e0 msgr2=0x7f455809ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:59.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.637+0000 7f4557fff700 1 --2- 172.21.15.156:0/2762960484 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45581346e0 0x7f455809ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.637+0000 7f4557fff700 1 -- 172.21.15.156:0/2762960484 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4550009b30 con 0x7f4558137000 2023-09-30T22:19:59.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.637+0000 7f45577fe700 1 --2- 172.21.15.156:0/2762960484 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4558131980 0x7f455809a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:59.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.637+0000 7fa1325c5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa12c134750 0x7fa12c09e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:59.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.637+0000 7fa1325c5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa12c137070 0x7fa12c09ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:19:59.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.637+0000 7fa1325c5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c134080 con 0x7fa12c134750 2023-09-30T22:19:59.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.637+0000 7fa1325c5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c1195c0 con 0x7fa12c1317c0 2023-09-30T22:19:59.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.637+0000 7fa1325c5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c11a090 con 0x7fa12c137070 2023-09-30T22:19:59.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.638+0000 7fa130b62700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa12c137070 0x7fa12c09ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:59.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.638+0000 7fa12bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa12c1317c0 0x7fa12c09e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:19:59.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.638+0000 7fa130b62700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa12c137070 0x7fa12c09ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48908/0 (socket says 172.21.15.156:48908) 2023-09-30T22:19:59.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.638+0000 7fa130b62700 1 -- 172.21.15.156:0/2497700199 learned_addr learned my addr 172.21.15.156:0/2497700199 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:19:59.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.638+0000 7f4557fff700 1 --2- 172.21.15.156:0/2762960484 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4558137000 0x7f455809b3a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f455806c040 tx=0x7f4550004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:59.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.638+0000 7fa12bfff700 1 -- 172.21.15.156:0/2497700199 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa12c137070 msgr2=0x7fa12c09ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:59.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.638+0000 7fa12bfff700 1 --2- 172.21.15.156:0/2497700199 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa12c137070 0x7fa12c09ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.638+0000 7fa12bfff700 1 -- 172.21.15.156:0/2497700199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa12c134750 msgr2=0x7fa12c09e540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:59.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.638+0000 7fa12bfff700 1 --2- 172.21.15.156:0/2497700199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa12c134750 0x7fa12c09e540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.638+0000 7fa12bfff700 1 -- 172.21.15.156:0/2497700199 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1200094a0 con 0x7fa12c1317c0 2023-09-30T22:19:59.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.638+0000 7f453ffff700 1 -- 172.21.15.156:0/2762960484 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455001c640 con 0x7f4558137000 2023-09-30T22:19:59.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.638+0000 7f453ffff700 1 -- 172.21.15.156:0/2762960484 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455001c7a0 con 0x7f4558137000 2023-09-30T22:19:59.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.638+0000 7f453ffff700 1 -- 172.21.15.156:0/2762960484 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455001cb50 con 0x7f4558137000 2023-09-30T22:19:59.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.638+0000 7fa12bfff700 1 --2- 172.21.15.156:0/2497700199 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa12c1317c0 0x7fa12c09e000 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00c700 tx=0x7fa11c00ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:59.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.638+0000 7fa128ff9700 1 -- 172.21.15.156:0/2497700199 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c0074e0 con 0x7fa12c1317c0 2023-09-30T22:19:59.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.638+0000 7fa128ff9700 1 -- 172.21.15.156:0/2497700199 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11c007640 con 0x7fa12c1317c0 2023-09-30T22:19:59.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.638+0000 7fa1325c5700 1 -- 172.21.15.156:0/2497700199 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa12c0a1cb0 con 0x7fa12c1317c0 2023-09-30T22:19:59.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.638+0000 7fa128ff9700 1 -- 172.21.15.156:0/2497700199 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c005a30 con 0x7fa12c1317c0 2023-09-30T22:19:59.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.638+0000 7fa1325c5700 1 -- 172.21.15.156:0/2497700199 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa12c12ef50 con 0x7fa12c1317c0 2023-09-30T22:19:59.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.639+0000 7f455e085700 1 -- 172.21.15.156:0/2762960484 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f455811a2e0 con 0x7f4558137000 2023-09-30T22:19:59.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.639+0000 7f455e085700 1 -- 172.21.15.156:0/2762960484 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f455811ad50 con 0x7f4558137000 2023-09-30T22:19:59.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.639+0000 7fa128ff9700 1 -- 172.21.15.156:0/2497700199 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa11c005b90 con 0x7fa12c1317c0 2023-09-30T22:19:59.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.640+0000 7f455e085700 1 -- 172.21.15.156:0/2762960484 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4558119900 con 0x7f4558137000 2023-09-30T22:19:59.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.640+0000 7fa1325c5700 1 -- 172.21.15.156:0/2497700199 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa12c04f2a0 con 0x7fa12c1317c0 2023-09-30T22:19:59.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.640+0000 7fa128ff9700 1 -- 172.21.15.156:0/2497700199 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa11c03eb20 con 0x7fa12c1317c0 2023-09-30T22:19:59.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.640+0000 7f453ffff700 1 -- 172.21.15.156:0/2762960484 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f455001ccb0 con 0x7f4558137000 2023-09-30T22:19:59.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.640+0000 7f453ffff700 1 -- 172.21.15.156:0/2762960484 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4550041530 con 0x7f4558137000 2023-09-30T22:19:59.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.644+0000 7fa128ff9700 1 -- 172.21.15.156:0/2497700199 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa11c017070 con 0x7fa12c1317c0 2023-09-30T22:19:59.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.649+0000 7f453ffff700 1 -- 172.21.15.156:0/2762960484 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4550026df0 con 0x7f4558137000 2023-09-30T22:19:59.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.698+0000 7fb377cd1700 1 -- 172.21.15.156:0/3423636429 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb37004f2a0 con 0x7fb3701300a0 2023-09-30T22:19:59.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.698+0000 7fb3667fc700 1 -- 172.21.15.156:0/3423636429 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb360015030 con 0x7fb3701300a0 2023-09-30T22:19:59.699 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:19:59.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.700+0000 7fb377cd1700 1 -- 172.21.15.156:0/3423636429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3701300a0 msgr2=0x7fb37011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:59.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.700+0000 7fb377cd1700 1 --2- 172.21.15.156:0/3423636429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3701300a0 0x7fb37011da40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb360016000 tx=0x7fb360004750 comp rx=0 tx=0).stop 2023-09-30T22:19:59.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.701+0000 7fb377cd1700 1 -- 172.21.15.156:0/3423636429 shutdown_connections 2023-09-30T22:19:59.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.701+0000 7fb377cd1700 1 --2- 172.21.15.156:0/3423636429 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb370133ad0 0x7fb37011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.701+0000 7fb377cd1700 1 --2- 172.21.15.156:0/3423636429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3701300a0 0x7fb37011da40 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.701+0000 7fb377cd1700 1 --2- 172.21.15.156:0/3423636429 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb3701309f0 0x7fb37011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.701+0000 7fb377cd1700 1 -- 172.21.15.156:0/3423636429 >> 172.21.15.156:0/3423636429 conn(0x7fb370099c40 msgr2=0x7fb370132c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:59.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.701+0000 7fb377cd1700 1 -- 172.21.15.156:0/3423636429 shutdown_connections 2023-09-30T22:19:59.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.701+0000 7fb377cd1700 1 -- 172.21.15.156:0/3423636429 wait complete. 2023-09-30T22:19:59.720 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:19:59.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.843+0000 7f455e085700 1 -- 172.21.15.156:0/2762960484 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f455804f2a0 con 0x7f4558137000 2023-09-30T22:19:59.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.844+0000 7f453ffff700 1 -- 172.21.15.156:0/2762960484 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f45500263b0 con 0x7f4558137000 2023-09-30T22:19:59.844 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:19:59.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.846+0000 7f2bf29a6700 1 -- 172.21.15.156:0/2784530417 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2bec06bce0 con 0x7f2bec138040 2023-09-30T22:19:59.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.846+0000 7f2be8ff9700 1 -- 172.21.15.156:0/2784530417 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2bdc017020 con 0x7f2bec138040 2023-09-30T22:19:59.850 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:19:59.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.847+0000 7f455e085700 1 -- 172.21.15.156:0/2762960484 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4558137000 msgr2=0x7f455809b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:59.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.847+0000 7f455e085700 1 --2- 172.21.15.156:0/2762960484 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4558137000 0x7f455809b3a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f455806c040 tx=0x7f4550004ad0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.847+0000 7f455e085700 1 -- 172.21.15.156:0/2762960484 shutdown_connections 2023-09-30T22:19:59.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.847+0000 7f455e085700 1 --2- 172.21.15.156:0/2762960484 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4558137000 0x7f455809b3a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.847+0000 7f455e085700 1 --2- 172.21.15.156:0/2762960484 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4558131980 0x7f455809a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.847+0000 7f455e085700 1 --2- 172.21.15.156:0/2762960484 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45581346e0 0x7f455809ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.847+0000 7f455e085700 1 -- 172.21.15.156:0/2762960484 >> 172.21.15.156:0/2762960484 conn(0x7f45580a2980 msgr2=0x7f4558070d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:59.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.848+0000 7f455e085700 1 -- 172.21.15.156:0/2762960484 shutdown_connections 2023-09-30T22:19:59.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.848+0000 7f455e085700 1 -- 172.21.15.156:0/2762960484 wait complete. 2023-09-30T22:19:59.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.848+0000 7f2bf29a6700 1 -- 172.21.15.156:0/2784530417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2bec138040 msgr2=0x7f2bec0702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:59.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.849+0000 7f2bf29a6700 1 --2- 172.21.15.156:0/2784530417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2bec138040 0x7f2bec0702e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc001360 tx=0x7f2bdc00c6e0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.850+0000 7f2bf29a6700 1 -- 172.21.15.156:0/2784530417 shutdown_connections 2023-09-30T22:19:59.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.850+0000 7f2bf29a6700 1 --2- 172.21.15.156:0/2784530417 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2bec13dd10 0x7f2bec070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.850+0000 7f2bf29a6700 1 --2- 172.21.15.156:0/2784530417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2bec138040 0x7f2bec0702e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.850+0000 7f2bf29a6700 1 --2- 172.21.15.156:0/2784530417 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2bec138410 0x7f2bec070820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.850+0000 7f2bf29a6700 1 -- 172.21.15.156:0/2784530417 >> 172.21.15.156:0/2784530417 conn(0x7f2bec0a2980 msgr2=0x7f2bec09d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:59.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.850+0000 7f2bf29a6700 1 -- 172.21.15.156:0/2784530417 shutdown_connections 2023-09-30T22:19:59.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.850+0000 7f2bf29a6700 1 -- 172.21.15.156:0/2784530417 wait complete. 2023-09-30T22:19:59.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.854+0000 7fa1325c5700 1 -- 172.21.15.156:0/2497700199 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa12c11a290 con 0x7fa12c1317c0 2023-09-30T22:19:59.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.854+0000 7fa128ff9700 1 -- 172.21.15.156:0/2497700199 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa11c012400 con 0x7fa12c1317c0 2023-09-30T22:19:59.855 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:19:59.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.858+0000 7fa1325c5700 1 -- 172.21.15.156:0/2497700199 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa12c1317c0 msgr2=0x7fa12c09e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:59.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.858+0000 7fa1325c5700 1 --2- 172.21.15.156:0/2497700199 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa12c1317c0 0x7fa12c09e000 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00c700 tx=0x7fa11c00ca10 comp rx=0 tx=0).stop 2023-09-30T22:19:59.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.858+0000 7fa1325c5700 1 -- 172.21.15.156:0/2497700199 shutdown_connections 2023-09-30T22:19:59.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.858+0000 7fa1325c5700 1 --2- 172.21.15.156:0/2497700199 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa12c137070 0x7fa12c09ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.858+0000 7fa1325c5700 1 --2- 172.21.15.156:0/2497700199 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa12c1317c0 0x7fa12c09e000 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.858+0000 7fa1325c5700 1 --2- 172.21.15.156:0/2497700199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa12c134750 0x7fa12c09e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:19:59.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.858+0000 7fa1325c5700 1 -- 172.21.15.156:0/2497700199 >> 172.21.15.156:0/2497700199 conn(0x7fa12c0a2980 msgr2=0x7fa12c130820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:59.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.858+0000 7fa1325c5700 1 -- 172.21.15.156:0/2497700199 shutdown_connections 2023-09-30T22:19:59.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:19:59.858+0000 7fa1325c5700 1 -- 172.21.15.156:0/2497700199 wait complete. 2023-09-30T22:19:59.864 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:19:59.865 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:19:59.872 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:00.721 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:00.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.861+0000 7f054ca33700 1 Processor -- start 2023-09-30T22:20:00.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.861+0000 7f054ca33700 1 -- start start 2023-09-30T22:20:00.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.862+0000 7f054ca33700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0548133ad0 0x7f0548133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:00.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.862+0000 7f054ca33700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f05481300a0 0x7f05481304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:00.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.862+0000 7f054ca33700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05481309f0 0x7f054813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:00.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.862+0000 7f054ca33700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f054806b2d0 con 0x7f05481300a0 2023-09-30T22:20:00.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.862+0000 7f054ca33700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0548133610 con 0x7f05481309f0 2023-09-30T22:20:00.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.862+0000 7f054ca33700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f054809a500 con 0x7f0548133ad0 2023-09-30T22:20:00.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.862+0000 7f0545d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f05481300a0 0x7f05481304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:00.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.862+0000 7f0546d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05481309f0 0x7f054813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:00.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.862+0000 7f0545d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f05481300a0 0x7f05481304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51518/0 (socket says 172.21.15.156:51518) 2023-09-30T22:20:00.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.862+0000 7f0546d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05481309f0 0x7f054813a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37190/0 (socket says 172.21.15.156:37190) 2023-09-30T22:20:00.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.862+0000 7f0545d9b700 1 -- 172.21.15.156:0/3523488925 learned_addr learned my addr 172.21.15.156:0/3523488925 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:00.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.862+0000 7f054659c700 1 --2- 172.21.15.156:0/3523488925 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0548133ad0 0x7f0548133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:00.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.862+0000 7f0546d9d700 1 -- 172.21.15.156:0/3523488925 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0548133ad0 msgr2=0x7f0548133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:00.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.862+0000 7f0546d9d700 1 --2- 172.21.15.156:0/3523488925 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0548133ad0 0x7f0548133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:00.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.862+0000 7f0546d9d700 1 -- 172.21.15.156:0/3523488925 >> v2:172.21.15.156:3300/0 conn(0x7f05481300a0 msgr2=0x7f05481304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:00.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.862+0000 7f0546d9d700 1 --2- 172.21.15.156:0/3523488925 >> v2:172.21.15.156:3300/0 conn(0x7f05481300a0 0x7f05481304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:00.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.862+0000 7f0546d9d700 1 -- 172.21.15.156:0/3523488925 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05481338b0 con 0x7f05481309f0 2023-09-30T22:20:00.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.862+0000 7f0545d9b700 1 --2- 172.21.15.156:0/3523488925 >> v2:172.21.15.156:3300/0 conn(0x7f05481300a0 0x7f05481304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:00.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.863+0000 7f0546d9d700 1 --2- 172.21.15.156:0/3523488925 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05481309f0 0x7f054813a980 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0540009d90 tx=0x7f054000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0fe7fbf04f300aa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:00.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.863+0000 7f054559a700 1 -- 172.21.15.156:0/3523488925 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054000e070 con 0x7f05481309f0 2023-09-30T22:20:00.866 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:00.866 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:00.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.863+0000 7f054559a700 1 -- 172.21.15.156:0/3523488925 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054000bb20 con 0x7f05481309f0 2023-09-30T22:20:00.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.863+0000 7f054559a700 1 -- 172.21.15.156:0/3523488925 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0540012430 con 0x7f05481309f0 2023-09-30T22:20:00.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.863+0000 7f054ca33700 1 -- 172.21.15.156:0/3523488925 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05481309f0 msgr2=0x7f054813a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:00.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.863+0000 7f054ca33700 1 --2- 172.21.15.156:0/3523488925 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05481309f0 0x7f054813a980 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0540009d90 tx=0x7f054000b330 comp rx=0 tx=0).stop 2023-09-30T22:20:00.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.863+0000 7f054ca33700 1 -- 172.21.15.156:0/3523488925 shutdown_connections 2023-09-30T22:20:00.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.863+0000 7f054ca33700 1 --2- 172.21.15.156:0/3523488925 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05481309f0 0x7f054813a980 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:00.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.863+0000 7f054ca33700 1 --2- 172.21.15.156:0/3523488925 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0548133ad0 0x7f0548133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:00.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.863+0000 7f054ca33700 1 --2- 172.21.15.156:0/3523488925 >> v2:172.21.15.156:3300/0 conn(0x7f05481300a0 0x7f05481304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:00.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.863+0000 7f054ca33700 1 -- 172.21.15.156:0/3523488925 >> 172.21.15.156:0/3523488925 conn(0x7f0548099c40 msgr2=0x7f05480a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:00.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.863+0000 7f054ca33700 1 -- 172.21.15.156:0/3523488925 shutdown_connections 2023-09-30T22:20:00.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.863+0000 7f054ca33700 1 -- 172.21.15.156:0/3523488925 wait complete. 2023-09-30T22:20:00.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.865+0000 7f054ca33700 1 Processor -- start 2023-09-30T22:20:00.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.865+0000 7f054ca33700 1 -- start start 2023-09-30T22:20:00.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.865+0000 7f054ca33700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05481300a0 0x7f054811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:00.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.865+0000 7f054ca33700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05481309f0 0x7f054811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:00.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.865+0000 7f054ca33700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0548133ad0 0x7f054811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:00.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.865+0000 7f054ca33700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054811f020 con 0x7f05481300a0 2023-09-30T22:20:00.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.865+0000 7f054ca33700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054812de80 con 0x7f0548133ad0 2023-09-30T22:20:00.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.865+0000 7f054ca33700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05480a33e0 con 0x7f05481309f0 2023-09-30T22:20:00.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.865+0000 7f0545d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05481309f0 0x7f054811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:00.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.865+0000 7f0546d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0548133ad0 0x7f054811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:00.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.865+0000 7f0545d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05481309f0 0x7f054811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48930/0 (socket says 172.21.15.156:48930) 2023-09-30T22:20:00.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.865+0000 7f0545d9b700 1 -- 172.21.15.156:0/292098606 learned_addr learned my addr 172.21.15.156:0/292098606 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:00.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.865+0000 7f054659c700 1 --2- 172.21.15.156:0/292098606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05481300a0 0x7f054811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:00.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.865+0000 7f0545d9b700 1 -- 172.21.15.156:0/292098606 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0548133ad0 msgr2=0x7f054811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:00.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.865+0000 7f0545d9b700 1 --2- 172.21.15.156:0/292098606 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0548133ad0 0x7f054811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:00.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.865+0000 7f0545d9b700 1 -- 172.21.15.156:0/292098606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05481300a0 msgr2=0x7f054811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:00.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.865+0000 7f0545d9b700 1 --2- 172.21.15.156:0/292098606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05481300a0 0x7f054811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:00.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.865+0000 7f0545d9b700 1 -- 172.21.15.156:0/292098606 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0538009550 con 0x7f05481309f0 2023-09-30T22:20:00.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.865+0000 7f0546d9d700 1 --2- 172.21.15.156:0/292098606 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0548133ad0 0x7f054811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:00.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.866+0000 7f0545d9b700 1 --2- 172.21.15.156:0/292098606 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05481309f0 0x7f054811df80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f053800ebe0 tx=0x7f053800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:00.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.866+0000 7f0536ffd700 1 -- 172.21.15.156:0/292098606 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053800c850 con 0x7f05481309f0 2023-09-30T22:20:00.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.866+0000 7f0536ffd700 1 -- 172.21.15.156:0/292098606 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053800c9b0 con 0x7f05481309f0 2023-09-30T22:20:00.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.866+0000 7f054ca33700 1 -- 172.21.15.156:0/292098606 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0540009a70 con 0x7f05481309f0 2023-09-30T22:20:00.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.866+0000 7f0536ffd700 1 -- 172.21.15.156:0/292098606 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053800cd60 con 0x7f05481309f0 2023-09-30T22:20:00.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.866+0000 7f054ca33700 1 -- 172.21.15.156:0/292098606 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05480717d0 con 0x7f05481309f0 2023-09-30T22:20:00.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.866+0000 7f0536ffd700 1 -- 172.21.15.156:0/292098606 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0538013470 con 0x7f05481309f0 2023-09-30T22:20:00.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.867+0000 7f0536ffd700 1 -- 172.21.15.156:0/292098606 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f053803fc50 con 0x7f05481309f0 2023-09-30T22:20:00.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.867+0000 7f054ca33700 1 -- 172.21.15.156:0/292098606 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f054804f2a0 con 0x7f05481309f0 2023-09-30T22:20:00.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:00.871+0000 7f0536ffd700 1 -- 172.21.15.156:0/292098606 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0538021070 con 0x7f05481309f0 2023-09-30T22:20:00.882 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:01.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.004+0000 7fe52e566700 1 Processor -- start 2023-09-30T22:20:01.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.004+0000 7fe52e566700 1 -- start start 2023-09-30T22:20:01.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.005+0000 7fe52e566700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe52809d860 0x7fe52809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:01.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.005+0000 7fe52e566700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe528130eb0 0x7fe528138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:01.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.005+0000 7fe527fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe52809d860 0x7fe52809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:01.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.005+0000 7fe527fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe52809d860 0x7fe52809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48944/0 (socket says 172.21.15.156:48944) 2023-09-30T22:20:01.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.005+0000 7fe527fff700 1 -- 172.21.15.156:0/597943855 learned_addr learned my addr 172.21.15.156:0/597943855 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:01.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.005+0000 7fe52e566700 1 -- 172.21.15.156:0/597943855 --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe52809aaa0 con 0x7fe52809e170 2023-09-30T22:20:01.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.005+0000 7fe52e566700 1 -- 172.21.15.156:0/597943855 --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52809f870 con 0x7fe528130eb0 2023-09-30T22:20:01.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.005+0000 7fe52cb03700 1 --2- 172.21.15.156:0/597943855 >> v2:172.21.15.156:3300/0 conn(0x7fe528130eb0 0x7fe528138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.005+0000 7fe52e566700 1 -- 172.21.15.156:0/597943855 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe52809b360 con 0x7fe52809d860 2023-09-30T22:20:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.005+0000 7fe526ffd700 1 -- 172.21.15.156:0/597943855 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2479787582 0 0) 0x7fe52809aaa0 con 0x7fe52809e170 2023-09-30T22:20:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.006+0000 7fe526ffd700 1 -- 172.21.15.156:0/597943855 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5100035b0 con 0x7fe52809e170 2023-09-30T22:20:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.006+0000 7fe527fff700 1 -- 172.21.15.156:0/597943855 >> v2:172.21.15.156:3300/0 conn(0x7fe528130eb0 msgr2=0x7fe528138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.006+0000 7fe527fff700 1 --2- 172.21.15.156:0/597943855 >> v2:172.21.15.156:3300/0 conn(0x7fe528130eb0 0x7fe528138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.006+0000 7fe527fff700 1 -- 172.21.15.156:0/597943855 >> v1:172.21.15.156:6789/0 conn(0x7fe52809e170 legacy=0x7fe5281307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.006+0000 7fe527fff700 1 -- 172.21.15.156:0/597943855 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52809b620 con 0x7fe52809d860 2023-09-30T22:20:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.006+0000 7fe527fff700 1 --2- 172.21.15.156:0/597943855 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe52809d860 0x7fe52809dc30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe5180098f0 tx=0x7fe518009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2118078b5ccef46c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.006+0000 7fe526ffd700 1 -- 172.21.15.156:0/597943855 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51800f8a0 con 0x7fe52809d860 2023-09-30T22:20:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.006+0000 7fe526ffd700 1 -- 172.21.15.156:0/597943855 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51800fa00 con 0x7fe52809d860 2023-09-30T22:20:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.006+0000 7fe526ffd700 1 -- 172.21.15.156:0/597943855 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51800fd90 con 0x7fe52809d860 2023-09-30T22:20:01.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.007+0000 7fe52e566700 1 -- 172.21.15.156:0/597943855 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe52809d860 msgr2=0x7fe52809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:01.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.007+0000 7fe52e566700 1 --2- 172.21.15.156:0/597943855 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe52809d860 0x7fe52809dc30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe5180098f0 tx=0x7fe518009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:01.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.007+0000 7fe52e566700 1 -- 172.21.15.156:0/597943855 shutdown_connections 2023-09-30T22:20:01.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.007+0000 7fe52e566700 1 --2- 172.21.15.156:0/597943855 >> v2:172.21.15.156:3300/0 conn(0x7fe528130eb0 0x7fe528138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.007+0000 7fe52e566700 1 --2- 172.21.15.156:0/597943855 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe52809d860 0x7fe52809dc30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.007+0000 7fe52e566700 1 -- 172.21.15.156:0/597943855 >> 172.21.15.156:0/597943855 conn(0x7fe528099c40 msgr2=0x7fe5280a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:01.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.007+0000 7fe52e566700 1 -- 172.21.15.156:0/597943855 shutdown_connections 2023-09-30T22:20:01.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.007+0000 7fe52e566700 1 -- 172.21.15.156:0/597943855 wait complete. 2023-09-30T22:20:01.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.008+0000 7fe52e566700 1 Processor -- start 2023-09-30T22:20:01.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.008+0000 7fe52e566700 1 -- start start 2023-09-30T22:20:01.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.008+0000 7fe52e566700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe52809d860 0x7fe5281233a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:01.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.008+0000 7fe52e566700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe52809e170 0x7fe5281238e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:01.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.008+0000 7fe52e566700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe528130eb0 0x7fe5281c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:01.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.008+0000 7fe52e566700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe528126120 con 0x7fe52809d860 2023-09-30T22:20:01.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.008+0000 7fe52e566700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5281251f0 con 0x7fe52809e170 2023-09-30T22:20:01.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.008+0000 7fe52e566700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe528122cf0 con 0x7fe528130eb0 2023-09-30T22:20:01.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.009+0000 7fe5277fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe52809e170 0x7fe5281238e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:01.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.009+0000 7fe5277fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe52809e170 0x7fe5281238e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37218/0 (socket says 172.21.15.156:37218) 2023-09-30T22:20:01.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.009+0000 7fe5277fe700 1 -- 172.21.15.156:0/1456387554 learned_addr learned my addr 172.21.15.156:0/1456387554 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:01.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.009+0000 7fe527fff700 1 --2- 172.21.15.156:0/1456387554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe52809d860 0x7fe5281233a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:01.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.009+0000 7fe52cb03700 1 --2- 172.21.15.156:0/1456387554 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe528130eb0 0x7fe5281c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:01.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.009+0000 7fe527fff700 1 -- 172.21.15.156:0/1456387554 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe528130eb0 msgr2=0x7fe5281c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:01.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.009+0000 7fe527fff700 1 --2- 172.21.15.156:0/1456387554 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe528130eb0 0x7fe5281c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.009+0000 7fe527fff700 1 -- 172.21.15.156:0/1456387554 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe52809e170 msgr2=0x7fe5281238e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:01.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.009+0000 7fe527fff700 1 --2- 172.21.15.156:0/1456387554 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe52809e170 0x7fe5281238e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.009+0000 7fe527fff700 1 -- 172.21.15.156:0/1456387554 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe518009550 con 0x7fe52809d860 2023-09-30T22:20:01.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.009+0000 7fe527fff700 1 --2- 172.21.15.156:0/1456387554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe52809d860 0x7fe5281233a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe518018000 tx=0x7fe518004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:01.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.009+0000 7fe524ff9700 1 -- 172.21.15.156:0/1456387554 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5180038a0 con 0x7fe52809d860 2023-09-30T22:20:01.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.009+0000 7fe524ff9700 1 -- 172.21.15.156:0/1456387554 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe518003a00 con 0x7fe52809d860 2023-09-30T22:20:01.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.009+0000 7fe52e566700 1 -- 172.21.15.156:0/1456387554 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe528125e60 con 0x7fe52809d860 2023-09-30T22:20:01.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.009+0000 7fe524ff9700 1 -- 172.21.15.156:0/1456387554 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518003d90 con 0x7fe52809d860 2023-09-30T22:20:01.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.009+0000 7fe52e566700 1 -- 172.21.15.156:0/1456387554 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe528126b90 con 0x7fe52809d860 2023-09-30T22:20:01.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.010+0000 7fe524ff9700 1 -- 172.21.15.156:0/1456387554 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe518019400 con 0x7fe52809d860 2023-09-30T22:20:01.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.010+0000 7fe524ff9700 1 -- 172.21.15.156:0/1456387554 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe5180407c0 con 0x7fe52809d860 2023-09-30T22:20:01.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.010+0000 7fe52e566700 1 -- 172.21.15.156:0/1456387554 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe52804f2a0 con 0x7fe52809d860 2023-09-30T22:20:01.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.019+0000 7fbd9e99e700 1 Processor -- start 2023-09-30T22:20:01.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.019+0000 7fbd9e99e700 1 -- start start 2023-09-30T22:20:01.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.019+0000 7fe524ff9700 1 -- 172.21.15.156:0/1456387554 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe518020930 con 0x7fe52809d860 2023-09-30T22:20:01.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.019+0000 7fbd9e99e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd980a0970 0x7fbd980a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:01.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.019+0000 7fbd9e99e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbd980a1280 0x7fbd981338a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:01.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.019+0000 7fbd9e99e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd98133de0 0x7fbd98134280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:01.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.019+0000 7fbd9e99e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd980a2640 con 0x7fbd980a1280 2023-09-30T22:20:01.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.019+0000 7fbd9e99e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9809dde0 con 0x7fbd98133de0 2023-09-30T22:20:01.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.019+0000 7fbd9e99e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd980a2820 con 0x7fbd980a0970 2023-09-30T22:20:01.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.020+0000 7fbd9d99c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd980a0970 0x7fbd980a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:01.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.020+0000 7fbd9d99c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd980a0970 0x7fbd980a0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:48966/0 (socket says 172.21.15.156:48966) 2023-09-30T22:20:01.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.020+0000 7fbd9d99c700 1 -- 172.21.15.156:0/454590488 learned_addr learned my addr 172.21.15.156:0/454590488 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:01.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.020+0000 7fbd9d19b700 1 --2- 172.21.15.156:0/454590488 >> v2:172.21.15.156:3300/0 conn(0x7fbd980a1280 0x7fbd981338a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:01.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.020+0000 7fbd9e19d700 1 --2- 172.21.15.156:0/454590488 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd98133de0 0x7fbd98134280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:01.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.020+0000 7fbd9e19d700 1 -- 172.21.15.156:0/454590488 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd980a0970 msgr2=0x7fbd980a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:01.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.020+0000 7fbd9e19d700 1 --2- 172.21.15.156:0/454590488 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd980a0970 0x7fbd980a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.020+0000 7fbd9e19d700 1 -- 172.21.15.156:0/454590488 >> v2:172.21.15.156:3300/0 conn(0x7fbd980a1280 msgr2=0x7fbd981338a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:01.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.020+0000 7fbd9e19d700 1 --2- 172.21.15.156:0/454590488 >> v2:172.21.15.156:3300/0 conn(0x7fbd980a1280 0x7fbd981338a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.020+0000 7fbd9e19d700 1 -- 172.21.15.156:0/454590488 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd980a2330 con 0x7fbd98133de0 2023-09-30T22:20:01.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.020+0000 7fbd9e19d700 1 --2- 172.21.15.156:0/454590488 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd98133de0 0x7fbd98134280 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbd90009d90 tx=0x7fbd9000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b244882b9980631f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:01.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.020+0000 7fbd9c99a700 1 -- 172.21.15.156:0/454590488 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9000e070 con 0x7fbd98133de0 2023-09-30T22:20:01.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.020+0000 7fbd9c99a700 1 -- 172.21.15.156:0/454590488 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9000bb20 con 0x7fbd98133de0 2023-09-30T22:20:01.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.020+0000 7fbd9c99a700 1 -- 172.21.15.156:0/454590488 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd90012430 con 0x7fbd98133de0 2023-09-30T22:20:01.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.021+0000 7fbd9e99e700 1 -- 172.21.15.156:0/454590488 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd98133de0 msgr2=0x7fbd98134280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:01.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.021+0000 7fbd9e99e700 1 --2- 172.21.15.156:0/454590488 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd98133de0 0x7fbd98134280 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbd90009d90 tx=0x7fbd9000b330 comp rx=0 tx=0).stop 2023-09-30T22:20:01.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.021+0000 7fbd9e99e700 1 -- 172.21.15.156:0/454590488 shutdown_connections 2023-09-30T22:20:01.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.021+0000 7fbd9e99e700 1 --2- 172.21.15.156:0/454590488 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd98133de0 0x7fbd98134280 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.021+0000 7fbd9e99e700 1 --2- 172.21.15.156:0/454590488 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd980a0970 0x7fbd980a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.021+0000 7fbd9e99e700 1 --2- 172.21.15.156:0/454590488 >> v2:172.21.15.156:3300/0 conn(0x7fbd980a1280 0x7fbd981338a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.021+0000 7fbd9e99e700 1 -- 172.21.15.156:0/454590488 >> 172.21.15.156:0/454590488 conn(0x7fbd980a6070 msgr2=0x7fbd980a6470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:01.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.022+0000 7fbd9e99e700 1 -- 172.21.15.156:0/454590488 shutdown_connections 2023-09-30T22:20:01.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.022+0000 7fbd9e99e700 1 -- 172.21.15.156:0/454590488 wait complete. 2023-09-30T22:20:01.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.023+0000 7fbd9e99e700 1 Processor -- start 2023-09-30T22:20:01.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.023+0000 7fbd9e99e700 1 -- start start 2023-09-30T22:20:01.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.024+0000 7fbd9e99e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd980a0970 0x7fbd9811f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:01.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.024+0000 7fbd9e99e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd980a1280 0x7fbd981c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:01.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.024+0000 7fbd9e99e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd98133de0 0x7fbd981c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:01.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.024+0000 7fbd9e99e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd98121210 con 0x7fbd980a1280 2023-09-30T22:20:01.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.024+0000 7fbd9e99e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd98133220 con 0x7fbd980a0970 2023-09-30T22:20:01.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.024+0000 7fbd9e99e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd98121e10 con 0x7fbd98133de0 2023-09-30T22:20:01.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.024+0000 7fbd9d99c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd980a0970 0x7fbd9811f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:01.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.024+0000 7fbd9d99c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd980a0970 0x7fbd9811f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37228/0 (socket says 172.21.15.156:37228) 2023-09-30T22:20:01.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.024+0000 7fbd9d99c700 1 -- 172.21.15.156:0/3826329835 learned_addr learned my addr 172.21.15.156:0/3826329835 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:01.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.024+0000 7fbd9d19b700 1 --2- 172.21.15.156:0/3826329835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd980a1280 0x7fbd981c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:01.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.024+0000 7fbd9e19d700 1 --2- 172.21.15.156:0/3826329835 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd98133de0 0x7fbd981c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:01.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.024+0000 7fbd9d19b700 1 -- 172.21.15.156:0/3826329835 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd98133de0 msgr2=0x7fbd981c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:01.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.024+0000 7fbd9d19b700 1 --2- 172.21.15.156:0/3826329835 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd98133de0 0x7fbd981c8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.024+0000 7fbd9d19b700 1 -- 172.21.15.156:0/3826329835 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd980a0970 msgr2=0x7fbd9811f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:01.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.024+0000 7fbd9d19b700 1 --2- 172.21.15.156:0/3826329835 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd980a0970 0x7fbd9811f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.024+0000 7fbd9d19b700 1 -- 172.21.15.156:0/3826329835 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd90009a70 con 0x7fbd980a1280 2023-09-30T22:20:01.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.025+0000 7fbd9d99c700 1 --2- 172.21.15.156:0/3826329835 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd980a0970 0x7fbd9811f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:01.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.025+0000 7fbd9d19b700 1 --2- 172.21.15.156:0/3826329835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd980a1280 0x7fbd981c7e00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbd8800e8d0 tx=0x7fbd8800ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:01.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.025+0000 7fbd8e7fc700 1 -- 172.21.15.156:0/3826329835 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8800c690 con 0x7fbd980a1280 2023-09-30T22:20:01.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.025+0000 7fbd9e99e700 1 -- 172.21.15.156:0/3826329835 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd9811eeb0 con 0x7fbd980a1280 2023-09-30T22:20:01.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.025+0000 7fbd8e7fc700 1 -- 172.21.15.156:0/3826329835 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8800c7f0 con 0x7fbd980a1280 2023-09-30T22:20:01.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.025+0000 7fbd8e7fc700 1 -- 172.21.15.156:0/3826329835 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8800cb60 con 0x7fbd980a1280 2023-09-30T22:20:01.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.025+0000 7fbd9e99e700 1 -- 172.21.15.156:0/3826329835 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd981220d0 con 0x7fbd980a1280 2023-09-30T22:20:01.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.026+0000 7fbd8e7fc700 1 -- 172.21.15.156:0/3826329835 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbd8800ccc0 con 0x7fbd980a1280 2023-09-30T22:20:01.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.026+0000 7fbd8e7fc700 1 -- 172.21.15.156:0/3826329835 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbd8803f9f0 con 0x7fbd980a1280 2023-09-30T22:20:01.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.026+0000 7fbd9e99e700 1 -- 172.21.15.156:0/3826329835 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd98122c00 con 0x7fbd980a1280 2023-09-30T22:20:01.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.034+0000 7fbd8e7fc700 1 -- 172.21.15.156:0/3826329835 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd8801b3b0 con 0x7fbd980a1280 2023-09-30T22:20:01.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.072+0000 7f96e633f700 1 Processor -- start 2023-09-30T22:20:01.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.072+0000 7f96e633f700 1 -- start start 2023-09-30T22:20:01.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.072+0000 7f96e633f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f96e009d860 0x7f96e009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:01.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.072+0000 7f96e633f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96e0130eb0 0x7f96e0138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:01.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.072+0000 7f96e633f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e009aaa0 con 0x7f96e009e170 2023-09-30T22:20:01.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.072+0000 7f96e633f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e009f870 con 0x7f96e009d860 2023-09-30T22:20:01.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.072+0000 7f96e633f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e009b360 con 0x7f96e0130eb0 2023-09-30T22:20:01.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.072+0000 7f96e48dc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96e0130eb0 0x7f96e0138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:01.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.072+0000 7f96df7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f96e009e170 0x7f96e01307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53348/0 (socket says 172.21.15.156:53348) 2023-09-30T22:20:01.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.072+0000 7f96df7fe700 1 -- 172.21.15.156:0/3693521544 learned_addr learned my addr 172.21.15.156:0/3693521544 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:01.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.073+0000 7f96dffff700 1 --2- 172.21.15.156:0/3693521544 >> v2:172.21.15.156:3300/0 conn(0x7f96e009d860 0x7f96e009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:01.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.073+0000 7f96deffd700 1 -- 172.21.15.156:0/3693521544 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2252768134 0 0) 0x7f96e009aaa0 con 0x7f96e009e170 2023-09-30T22:20:01.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.073+0000 7f96e48dc700 1 -- 172.21.15.156:0/3693521544 >> v2:172.21.15.156:3300/0 conn(0x7f96e009d860 msgr2=0x7f96e009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:01.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.073+0000 7f96e48dc700 1 --2- 172.21.15.156:0/3693521544 >> v2:172.21.15.156:3300/0 conn(0x7f96e009d860 0x7f96e009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.073+0000 7f96e48dc700 1 -- 172.21.15.156:0/3693521544 >> v1:172.21.15.156:6789/0 conn(0x7f96e009e170 legacy=0x7f96e01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:01.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.073+0000 7f96e48dc700 1 -- 172.21.15.156:0/3693521544 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e009b620 con 0x7f96e0130eb0 2023-09-30T22:20:01.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.073+0000 7f96e48dc700 1 --2- 172.21.15.156:0/3693521544 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96e0130eb0 0x7f96e0138a00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f96d8009d90 tx=0x7f96d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32fa1f8eba7403ed server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:01.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.073+0000 7f96deffd700 1 -- 172.21.15.156:0/3693521544 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d800e070 con 0x7f96e0130eb0 2023-09-30T22:20:01.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.073+0000 7f96deffd700 1 -- 172.21.15.156:0/3693521544 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d800bb20 con 0x7f96e0130eb0 2023-09-30T22:20:01.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.073+0000 7f96deffd700 1 -- 172.21.15.156:0/3693521544 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d8012430 con 0x7f96e0130eb0 2023-09-30T22:20:01.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.074+0000 7f96e633f700 1 -- 172.21.15.156:0/3693521544 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96e0130eb0 msgr2=0x7f96e0138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:01.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.074+0000 7f96e633f700 1 --2- 172.21.15.156:0/3693521544 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96e0130eb0 0x7f96e0138a00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f96d8009d90 tx=0x7f96d800b330 comp rx=0 tx=0).stop 2023-09-30T22:20:01.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.074+0000 7f96e633f700 1 -- 172.21.15.156:0/3693521544 shutdown_connections 2023-09-30T22:20:01.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.074+0000 7f96e633f700 1 --2- 172.21.15.156:0/3693521544 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96e0130eb0 0x7f96e0138a00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.074+0000 7f96e633f700 1 --2- 172.21.15.156:0/3693521544 >> v2:172.21.15.156:3300/0 conn(0x7f96e009d860 0x7f96e009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.074+0000 7f96e633f700 1 -- 172.21.15.156:0/3693521544 >> 172.21.15.156:0/3693521544 conn(0x7f96e0099c40 msgr2=0x7f96e00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:01.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.074+0000 7f96e633f700 1 -- 172.21.15.156:0/3693521544 shutdown_connections 2023-09-30T22:20:01.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.074+0000 7f96e633f700 1 -- 172.21.15.156:0/3693521544 wait complete. 2023-09-30T22:20:01.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.076+0000 7f96e633f700 1 Processor -- start 2023-09-30T22:20:01.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.076+0000 7f96e633f700 1 -- start start 2023-09-30T22:20:01.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.077+0000 7f96e633f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96e009d860 0x7f96e011a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:01.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.077+0000 7f96e633f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96e009e170 0x7f96e011aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:01.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.077+0000 7f96e633f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96e0130eb0 0x7f96e011afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:01.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.077+0000 7f96e633f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e011c200 con 0x7f96e009d860 2023-09-30T22:20:01.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.077+0000 7f96e633f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e011df90 con 0x7f96e009e170 2023-09-30T22:20:01.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.077+0000 7f96e633f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96e011d9f0 con 0x7f96e0130eb0 2023-09-30T22:20:01.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.077+0000 7f96dffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96e009d860 0x7f96e011a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:01.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.077+0000 7f96dffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96e009d860 0x7f96e011a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51582/0 (socket says 172.21.15.156:51582) 2023-09-30T22:20:01.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.077+0000 7f96dffff700 1 -- 172.21.15.156:0/571220575 learned_addr learned my addr 172.21.15.156:0/571220575 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:01.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.077+0000 7f96df7fe700 1 --2- 172.21.15.156:0/571220575 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96e009e170 0x7f96e011aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:01.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.077+0000 7f96e48dc700 1 --2- 172.21.15.156:0/571220575 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96e0130eb0 0x7f96e011afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:01.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.077+0000 7f96df7fe700 1 -- 172.21.15.156:0/571220575 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96e0130eb0 msgr2=0x7f96e011afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:01.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.077+0000 7f96df7fe700 1 --2- 172.21.15.156:0/571220575 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96e0130eb0 0x7f96e011afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.077+0000 7f96df7fe700 1 -- 172.21.15.156:0/571220575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96e009d860 msgr2=0x7f96e011a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:01.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.077+0000 7f96df7fe700 1 --2- 172.21.15.156:0/571220575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96e009d860 0x7f96e011a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.077+0000 7f96df7fe700 1 -- 172.21.15.156:0/571220575 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d8009a70 con 0x7f96e009e170 2023-09-30T22:20:01.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.077+0000 7f96e48dc700 1 --2- 172.21.15.156:0/571220575 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96e0130eb0 0x7f96e011afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:01.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.077+0000 7f96df7fe700 1 --2- 172.21.15.156:0/571220575 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96e009e170 0x7f96e011aa80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f96d400c470 tx=0x7f96d400c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:01.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.078+0000 7f96dcff9700 1 -- 172.21.15.156:0/571220575 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d4004c80 con 0x7f96e009e170 2023-09-30T22:20:01.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.078+0000 7f96dcff9700 1 -- 172.21.15.156:0/571220575 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d4004de0 con 0x7f96e009e170 2023-09-30T22:20:01.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.078+0000 7f96dcff9700 1 -- 172.21.15.156:0/571220575 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d4007310 con 0x7f96e009e170 2023-09-30T22:20:01.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.078+0000 7f96e633f700 1 -- 172.21.15.156:0/571220575 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e00a06e0 con 0x7f96e009e170 2023-09-30T22:20:01.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.078+0000 7f96e633f700 1 -- 172.21.15.156:0/571220575 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e011dcb0 con 0x7f96e009e170 2023-09-30T22:20:01.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.079+0000 7f96dcff9700 1 -- 172.21.15.156:0/571220575 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f96d4007470 con 0x7f96e009e170 2023-09-30T22:20:01.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.079+0000 7f96dcff9700 1 -- 172.21.15.156:0/571220575 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f96d403f1e0 con 0x7f96e009e170 2023-09-30T22:20:01.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.079+0000 7f96e633f700 1 -- 172.21.15.156:0/571220575 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e004f2a0 con 0x7f96e009e170 2023-09-30T22:20:01.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.088+0000 7f054ca33700 1 -- 172.21.15.156:0/292098606 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f054809d3a0 con 0x7f05481309f0 2023-09-30T22:20:01.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.088+0000 7f96dcff9700 1 -- 172.21.15.156:0/571220575 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f96d400ce40 con 0x7f96e009e170 2023-09-30T22:20:01.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.088+0000 7f0536ffd700 1 -- 172.21.15.156:0/292098606 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f053802a090 con 0x7f05481309f0 2023-09-30T22:20:01.089 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:01.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.090+0000 7f054ca33700 1 -- 172.21.15.156:0/292098606 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05481309f0 msgr2=0x7f054811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:01.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.090+0000 7f054ca33700 1 --2- 172.21.15.156:0/292098606 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05481309f0 0x7f054811df80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f053800ebe0 tx=0x7f053800eef0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.091+0000 7f054ca33700 1 -- 172.21.15.156:0/292098606 shutdown_connections 2023-09-30T22:20:01.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.091+0000 7f054ca33700 1 --2- 172.21.15.156:0/292098606 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0548133ad0 0x7f054811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.091+0000 7f054ca33700 1 --2- 172.21.15.156:0/292098606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05481300a0 0x7f054811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.091+0000 7f054ca33700 1 --2- 172.21.15.156:0/292098606 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05481309f0 0x7f054811df80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.091+0000 7f054ca33700 1 -- 172.21.15.156:0/292098606 >> 172.21.15.156:0/292098606 conn(0x7f0548099c40 msgr2=0x7f0548132b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:01.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.091+0000 7f054ca33700 1 -- 172.21.15.156:0/292098606 shutdown_connections 2023-09-30T22:20:01.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.091+0000 7f054ca33700 1 -- 172.21.15.156:0/292098606 wait complete. 2023-09-30T22:20:01.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:01.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.229+0000 7fbd9e99e700 1 -- 172.21.15.156:0/3826329835 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbd9804f2a0 con 0x7fbd980a1280 2023-09-30T22:20:01.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.230+0000 7fbd8e7fc700 1 -- 172.21.15.156:0/3826329835 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbd88017020 con 0x7fbd980a1280 2023-09-30T22:20:01.231 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:01.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.232+0000 7fbd9e99e700 1 -- 172.21.15.156:0/3826329835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd980a1280 msgr2=0x7fbd981c7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:01.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.232+0000 7fbd9e99e700 1 --2- 172.21.15.156:0/3826329835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd980a1280 0x7fbd981c7e00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbd8800e8d0 tx=0x7fbd8800ebe0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.232+0000 7fbd9e99e700 1 -- 172.21.15.156:0/3826329835 shutdown_connections 2023-09-30T22:20:01.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.232+0000 7fbd9e99e700 1 --2- 172.21.15.156:0/3826329835 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd98133de0 0x7fbd981c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.232+0000 7fbd9e99e700 1 --2- 172.21.15.156:0/3826329835 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd980a0970 0x7fbd9811f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.232+0000 7fbd9e99e700 1 --2- 172.21.15.156:0/3826329835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd980a1280 0x7fbd981c7e00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.232+0000 7fbd9e99e700 1 -- 172.21.15.156:0/3826329835 >> 172.21.15.156:0/3826329835 conn(0x7fbd980a6070 msgr2=0x7fbd980a3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:01.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.232+0000 7fbd9e99e700 1 -- 172.21.15.156:0/3826329835 shutdown_connections 2023-09-30T22:20:01.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.232+0000 7fbd9e99e700 1 -- 172.21.15.156:0/3826329835 wait complete. 2023-09-30T22:20:01.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:01.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.247+0000 7fe52e566700 1 -- 172.21.15.156:0/1456387554 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe5281305f0 con 0x7fe52809d860 2023-09-30T22:20:01.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.248+0000 7fe524ff9700 1 -- 172.21.15.156:0/1456387554 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe518029340 con 0x7fe52809d860 2023-09-30T22:20:01.249 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:01.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.250+0000 7fe52e566700 1 -- 172.21.15.156:0/1456387554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe52809d860 msgr2=0x7fe5281233a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:01.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.250+0000 7fe52e566700 1 --2- 172.21.15.156:0/1456387554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe52809d860 0x7fe5281233a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe518018000 tx=0x7fe518004750 comp rx=0 tx=0).stop 2023-09-30T22:20:01.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.250+0000 7fe52e566700 1 -- 172.21.15.156:0/1456387554 shutdown_connections 2023-09-30T22:20:01.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.250+0000 7fe52e566700 1 --2- 172.21.15.156:0/1456387554 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe528130eb0 0x7fe5281c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.250+0000 7fe52e566700 1 --2- 172.21.15.156:0/1456387554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe52809d860 0x7fe5281233a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.250+0000 7fe52e566700 1 --2- 172.21.15.156:0/1456387554 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe52809e170 0x7fe5281238e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.250+0000 7fe52e566700 1 -- 172.21.15.156:0/1456387554 >> 172.21.15.156:0/1456387554 conn(0x7fe528099c40 msgr2=0x7fe5280a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:01.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.250+0000 7fe52e566700 1 -- 172.21.15.156:0/1456387554 shutdown_connections 2023-09-30T22:20:01.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.250+0000 7fe52e566700 1 -- 172.21.15.156:0/1456387554 wait complete. 2023-09-30T22:20:01.262 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:01.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.309+0000 7f96e633f700 1 -- 172.21.15.156:0/571220575 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f96e0071d80 con 0x7f96e009e170 2023-09-30T22:20:01.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.309+0000 7f96dcff9700 1 -- 172.21.15.156:0/571220575 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f96d401ce30 con 0x7f96e009e170 2023-09-30T22:20:01.310 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:01.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.311+0000 7f96e633f700 1 -- 172.21.15.156:0/571220575 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96e009e170 msgr2=0x7f96e011aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:01.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.311+0000 7f96e633f700 1 --2- 172.21.15.156:0/571220575 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96e009e170 0x7f96e011aa80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f96d400c470 tx=0x7f96d400c780 comp rx=0 tx=0).stop 2023-09-30T22:20:01.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.311+0000 7f96e633f700 1 -- 172.21.15.156:0/571220575 shutdown_connections 2023-09-30T22:20:01.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.311+0000 7f96e633f700 1 --2- 172.21.15.156:0/571220575 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96e0130eb0 0x7f96e011afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.311+0000 7f96e633f700 1 --2- 172.21.15.156:0/571220575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96e009d860 0x7f96e011a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.311+0000 7f96e633f700 1 --2- 172.21.15.156:0/571220575 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96e009e170 0x7f96e011aa80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:01.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.311+0000 7f96e633f700 1 -- 172.21.15.156:0/571220575 >> 172.21.15.156:0/571220575 conn(0x7f96e0099c40 msgr2=0x7f96e0070d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:01.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.312+0000 7f96e633f700 1 -- 172.21.15.156:0/571220575 shutdown_connections 2023-09-30T22:20:01.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:01.312+0000 7f96e633f700 1 -- 172.21.15.156:0/571220575 wait complete. 2023-09-30T22:20:01.324 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:02.106 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:02.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.237+0000 7fdba8edf700 1 Processor -- start 2023-09-30T22:20:02.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.237+0000 7fdba8edf700 1 -- start start 2023-09-30T22:20:02.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.237+0000 7fdba8edf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdba4133ad0 0x7fdba4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:02.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.237+0000 7fdba8edf700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdba41300a0 0x7fdba41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:02.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.237+0000 7fdba8edf700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba406b2d0 con 0x7fdba41309f0 2023-09-30T22:20:02.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.237+0000 7fdba8edf700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba4133610 con 0x7fdba41300a0 2023-09-30T22:20:02.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.237+0000 7fdba8edf700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba409a500 con 0x7fdba4133ad0 2023-09-30T22:20:02.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.238+0000 7fdba1d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdba41300a0 0x7fdba41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:02.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.238+0000 7fdba259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdba4133ad0 0x7fdba4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:02.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.238+0000 7fdba1d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdba41300a0 0x7fdba41304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:57002/0 (socket says 172.21.15.156:57002) 2023-09-30T22:20:02.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.238+0000 7fdba1d9b700 1 -- 172.21.15.156:0/3212082004 learned_addr learned my addr 172.21.15.156:0/3212082004 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:02.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.238+0000 7fdba2d9d700 1 --1- 172.21.15.156:0/3212082004 >> v1:172.21.15.156:6789/0 conn(0x7fdba41309f0 0x7fdba413a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58234/0 (socket says 172.21.15.156:58234) 2023-09-30T22:20:02.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.238+0000 7fdba259c700 1 -- 172.21.15.156:0/3212082004 >> v2:172.21.15.156:3300/0 conn(0x7fdba41300a0 msgr2=0x7fdba41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:02.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.238+0000 7fdba259c700 1 --2- 172.21.15.156:0/3212082004 >> v2:172.21.15.156:3300/0 conn(0x7fdba41300a0 0x7fdba41304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.238+0000 7fdba259c700 1 -- 172.21.15.156:0/3212082004 >> v1:172.21.15.156:6789/0 conn(0x7fdba41309f0 legacy=0x7fdba413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:02.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.238+0000 7fdba259c700 1 -- 172.21.15.156:0/3212082004 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba41338b0 con 0x7fdba4133ad0 2023-09-30T22:20:02.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.238+0000 7fdba159a700 1 -- 172.21.15.156:0/3212082004 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2021170497 0 0) 0x7fdba406b2d0 con 0x7fdba41309f0 2023-09-30T22:20:02.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.238+0000 7fdba1d9b700 1 --2- 172.21.15.156:0/3212082004 >> v2:172.21.15.156:3300/0 conn(0x7fdba41300a0 0x7fdba41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:02.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.238+0000 7fdba259c700 1 --2- 172.21.15.156:0/3212082004 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdba4133ad0 0x7fdba4133ea0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdb94009840 tx=0x7fdb94009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=144d90ba8f7b9be3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:02.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.238+0000 7fdba159a700 1 -- 172.21.15.156:0/3212082004 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb94011830 con 0x7fdba4133ad0 2023-09-30T22:20:02.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.238+0000 7fdba159a700 1 -- 172.21.15.156:0/3212082004 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb94011990 con 0x7fdba4133ad0 2023-09-30T22:20:02.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.238+0000 7fdba159a700 1 -- 172.21.15.156:0/3212082004 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb94011d20 con 0x7fdba4133ad0 2023-09-30T22:20:02.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.239+0000 7fdba8edf700 1 -- 172.21.15.156:0/3212082004 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdba4133ad0 msgr2=0x7fdba4133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:02.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.239+0000 7fdba8edf700 1 --2- 172.21.15.156:0/3212082004 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdba4133ad0 0x7fdba4133ea0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdb94009840 tx=0x7fdb94009b50 comp rx=0 tx=0).stop 2023-09-30T22:20:02.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.239+0000 7fdba8edf700 1 -- 172.21.15.156:0/3212082004 shutdown_connections 2023-09-30T22:20:02.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.239+0000 7fdba8edf700 1 --2- 172.21.15.156:0/3212082004 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdba4133ad0 0x7fdba4133ea0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.239+0000 7fdba8edf700 1 --2- 172.21.15.156:0/3212082004 >> v2:172.21.15.156:3300/0 conn(0x7fdba41300a0 0x7fdba41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.239+0000 7fdba8edf700 1 -- 172.21.15.156:0/3212082004 >> 172.21.15.156:0/3212082004 conn(0x7fdba4099c40 msgr2=0x7fdba40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:02.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.239+0000 7fdba8edf700 1 -- 172.21.15.156:0/3212082004 shutdown_connections 2023-09-30T22:20:02.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.239+0000 7fdba8edf700 1 -- 172.21.15.156:0/3212082004 wait complete. 2023-09-30T22:20:02.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.240+0000 7fdba8edf700 1 Processor -- start 2023-09-30T22:20:02.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.240+0000 7fdba8edf700 1 -- start start 2023-09-30T22:20:02.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.240+0000 7fdba8edf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdba41300a0 0x7fdba412d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:02.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.240+0000 7fdba8edf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdba41309f0 0x7fdba4071370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:02.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.240+0000 7fdba8edf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdba4133ad0 0x7fdba40718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:02.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.240+0000 7fdba8edf700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba411e180 con 0x7fdba41300a0 2023-09-30T22:20:02.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.240+0000 7fdba8edf700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba411df90 con 0x7fdba4133ad0 2023-09-30T22:20:02.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.240+0000 7fdba8edf700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdba411ff20 con 0x7fdba41309f0 2023-09-30T22:20:02.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.240+0000 7fdba259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdba41300a0 0x7fdba412d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:02.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.241+0000 7fdba259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdba41300a0 0x7fdba412d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:57004/0 (socket says 172.21.15.156:57004) 2023-09-30T22:20:02.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.241+0000 7fdba259c700 1 -- 172.21.15.156:0/558454739 learned_addr learned my addr 172.21.15.156:0/558454739 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:02.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.241+0000 7fdba2d9d700 1 --2- 172.21.15.156:0/558454739 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdba4133ad0 0x7fdba40718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:02.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.241+0000 7fdba1d9b700 1 --2- 172.21.15.156:0/558454739 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdba41309f0 0x7fdba4071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:02.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.241+0000 7fdba259c700 1 -- 172.21.15.156:0/558454739 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdba41309f0 msgr2=0x7fdba4071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:02.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.241+0000 7fdba259c700 1 --2- 172.21.15.156:0/558454739 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdba41309f0 0x7fdba4071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.241+0000 7fdba259c700 1 -- 172.21.15.156:0/558454739 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdba4133ad0 msgr2=0x7fdba40718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:02.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.241+0000 7fdba259c700 1 --2- 172.21.15.156:0/558454739 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdba4133ad0 0x7fdba40718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.241+0000 7fdba259c700 1 -- 172.21.15.156:0/558454739 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb98009550 con 0x7fdba41300a0 2023-09-30T22:20:02.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.241+0000 7fdba1d9b700 1 --2- 172.21.15.156:0/558454739 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdba41309f0 0x7fdba4071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:02.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.241+0000 7fdba2d9d700 1 --2- 172.21.15.156:0/558454739 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdba4133ad0 0x7fdba40718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:02.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.241+0000 7fdba259c700 1 --2- 172.21.15.156:0/558454739 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdba41300a0 0x7fdba412d670 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdb94009fd0 tx=0x7fdb94004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:02.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.241+0000 7fdb92ffd700 1 -- 172.21.15.156:0/558454739 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb94004550 con 0x7fdba41300a0 2023-09-30T22:20:02.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.241+0000 7fdb92ffd700 1 -- 172.21.15.156:0/558454739 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9401f070 con 0x7fdba41300a0 2023-09-30T22:20:02.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.241+0000 7fdba8edf700 1 -- 172.21.15.156:0/558454739 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb940094a0 con 0x7fdba41300a0 2023-09-30T22:20:02.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.241+0000 7fdb92ffd700 1 -- 172.21.15.156:0/558454739 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb940038e0 con 0x7fdba41300a0 2023-09-30T22:20:02.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.241+0000 7fdba8edf700 1 -- 172.21.15.156:0/558454739 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba411fbc0 con 0x7fdba41300a0 2023-09-30T22:20:02.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.242+0000 7fdb92ffd700 1 -- 172.21.15.156:0/558454739 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb94003a40 con 0x7fdba41300a0 2023-09-30T22:20:02.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.242+0000 7fdb92ffd700 1 -- 172.21.15.156:0/558454739 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdb94021070 con 0x7fdba41300a0 2023-09-30T22:20:02.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.242+0000 7fdba8edf700 1 -- 172.21.15.156:0/558454739 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba40a2620 con 0x7fdba41300a0 2023-09-30T22:20:02.248 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:02.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.247+0000 7fdb92ffd700 1 -- 172.21.15.156:0/558454739 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb94015080 con 0x7fdba41300a0 2023-09-30T22:20:02.264 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:02.325 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:02.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.377+0000 7fd60f5f9700 1 Processor -- start 2023-09-30T22:20:02.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.377+0000 7fd60f5f9700 1 -- start start 2023-09-30T22:20:02.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.378+0000 7fd60f5f9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd60809d860 0x7fd60809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:02.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.378+0000 7fd60f5f9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd60809e170 0x7fd6081307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:02.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.378+0000 7fd60f5f9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd608130ce0 0x7fd608131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:02.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.378+0000 7fd60f5f9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd60809aaa0 con 0x7fd60809e170 2023-09-30T22:20:02.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.378+0000 7fd60f5f9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60809f870 con 0x7fd60809d860 2023-09-30T22:20:02.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.378+0000 7fd60f5f9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd60809b360 con 0x7fd608130ce0 2023-09-30T22:20:02.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.378+0000 7fd60d395700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd60809d860 0x7fd60809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:02.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.378+0000 7fd60cb94700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd60809e170 0x7fd6081307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:02.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.378+0000 7fd60d395700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd60809d860 0x7fd60809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48402/0 (socket says 172.21.15.156:48402) 2023-09-30T22:20:02.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.378+0000 7fd60d395700 1 -- 172.21.15.156:0/2110241849 learned_addr learned my addr 172.21.15.156:0/2110241849 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:02.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.378+0000 7fd60db96700 1 --2- 172.21.15.156:0/2110241849 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd608130ce0 0x7fd608131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:02.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.378+0000 7fd60cb94700 1 -- 172.21.15.156:0/2110241849 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd608130ce0 msgr2=0x7fd608131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:02.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.378+0000 7fd60cb94700 1 --2- 172.21.15.156:0/2110241849 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd608130ce0 0x7fd608131180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.378+0000 7fd60cb94700 1 -- 172.21.15.156:0/2110241849 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd60809d860 msgr2=0x7fd60809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:02.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.378+0000 7fd60cb94700 1 --2- 172.21.15.156:0/2110241849 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd60809d860 0x7fd60809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.378+0000 7fd60cb94700 1 -- 172.21.15.156:0/2110241849 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60809b620 con 0x7fd60809e170 2023-09-30T22:20:02.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.379+0000 7fd60cb94700 1 --2- 172.21.15.156:0/2110241849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd60809e170 0x7fd6081307a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8009840 tx=0x7fd5f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477c13c2a7fb8da5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:02.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.379+0000 7fd5fffff700 1 -- 172.21.15.156:0/2110241849 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8011830 con 0x7fd60809e170 2023-09-30T22:20:02.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.379+0000 7fd5fffff700 1 -- 172.21.15.156:0/2110241849 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f8011990 con 0x7fd60809e170 2023-09-30T22:20:02.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.379+0000 7fd5fffff700 1 -- 172.21.15.156:0/2110241849 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8011d20 con 0x7fd60809e170 2023-09-30T22:20:02.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.379+0000 7fd60f5f9700 1 -- 172.21.15.156:0/2110241849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd60809e170 msgr2=0x7fd6081307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:02.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.379+0000 7fd60f5f9700 1 --2- 172.21.15.156:0/2110241849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd60809e170 0x7fd6081307a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8009840 tx=0x7fd5f8009b50 comp rx=0 tx=0).stop 2023-09-30T22:20:02.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.380+0000 7fd60f5f9700 1 -- 172.21.15.156:0/2110241849 shutdown_connections 2023-09-30T22:20:02.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.380+0000 7fd60f5f9700 1 --2- 172.21.15.156:0/2110241849 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd608130ce0 0x7fd608131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.380+0000 7fd60f5f9700 1 --2- 172.21.15.156:0/2110241849 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd60809d860 0x7fd60809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.380+0000 7fd60f5f9700 1 --2- 172.21.15.156:0/2110241849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd60809e170 0x7fd6081307a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.380+0000 7fd60f5f9700 1 -- 172.21.15.156:0/2110241849 >> 172.21.15.156:0/2110241849 conn(0x7fd608099c40 msgr2=0x7fd6080a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:02.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.380+0000 7fd60f5f9700 1 -- 172.21.15.156:0/2110241849 shutdown_connections 2023-09-30T22:20:02.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.380+0000 7fd60f5f9700 1 -- 172.21.15.156:0/2110241849 wait complete. 2023-09-30T22:20:02.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.381+0000 7fd60f5f9700 1 Processor -- start 2023-09-30T22:20:02.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.381+0000 7fd60f5f9700 1 -- start start 2023-09-30T22:20:02.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.382+0000 7fd60f5f9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd60809d860 0x7fd60811d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:02.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.382+0000 7fd60f5f9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd60809e170 0x7fd60811d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:02.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.382+0000 7fd60f5f9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd608130ce0 0x7fd60811daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:02.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.382+0000 7fd60f5f9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd608120b40 con 0x7fd60809e170 2023-09-30T22:20:02.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.382+0000 7fd60f5f9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd608071af0 con 0x7fd60809d860 2023-09-30T22:20:02.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.382+0000 7fd60f5f9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd60809c8b0 con 0x7fd608130ce0 2023-09-30T22:20:02.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.382+0000 7fd60d395700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd60809d860 0x7fd60811d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:02.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.382+0000 7fd60cb94700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd60809e170 0x7fd60811d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:02.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.382+0000 7fd60d395700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd60809d860 0x7fd60811d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48410/0 (socket says 172.21.15.156:48410) 2023-09-30T22:20:02.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.382+0000 7fd60d395700 1 -- 172.21.15.156:0/3579929193 learned_addr learned my addr 172.21.15.156:0/3579929193 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:02.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.382+0000 7fd60db96700 1 --2- 172.21.15.156:0/3579929193 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd608130ce0 0x7fd60811daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:02.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.382+0000 7fd60cb94700 1 -- 172.21.15.156:0/3579929193 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd608130ce0 msgr2=0x7fd60811daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:02.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.382+0000 7fd60cb94700 1 --2- 172.21.15.156:0/3579929193 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd608130ce0 0x7fd60811daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.382+0000 7fd60cb94700 1 -- 172.21.15.156:0/3579929193 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd60809d860 msgr2=0x7fd60811d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:02.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.382+0000 7fd60cb94700 1 --2- 172.21.15.156:0/3579929193 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd60809d860 0x7fd60811d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.382+0000 7fd60cb94700 1 -- 172.21.15.156:0/3579929193 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f80094a0 con 0x7fd60809e170 2023-09-30T22:20:02.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.382+0000 7fd60d395700 1 --2- 172.21.15.156:0/3579929193 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd60809d860 0x7fd60811d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:02.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.383+0000 7fd60cb94700 1 --2- 172.21.15.156:0/3579929193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd60809e170 0x7fd60811d5b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd60809a100 tx=0x7fd5f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:02.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.383+0000 7fd5fdffb700 1 -- 172.21.15.156:0/3579929193 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8004450 con 0x7fd60809e170 2023-09-30T22:20:02.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.383+0000 7fd5fdffb700 1 -- 172.21.15.156:0/3579929193 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f80045b0 con 0x7fd60809e170 2023-09-30T22:20:02.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.383+0000 7fd60f5f9700 1 -- 172.21.15.156:0/3579929193 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6081202d0 con 0x7fd60809e170 2023-09-30T22:20:02.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.383+0000 7fd5fdffb700 1 -- 172.21.15.156:0/3579929193 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f801d9e0 con 0x7fd60809e170 2023-09-30T22:20:02.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.383+0000 7fd60f5f9700 1 -- 172.21.15.156:0/3579929193 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd60811fe80 con 0x7fd60809e170 2023-09-30T22:20:02.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.384+0000 7fd5fdffb700 1 -- 172.21.15.156:0/3579929193 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd5f801db40 con 0x7fd60809e170 2023-09-30T22:20:02.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.384+0000 7fd60f5f9700 1 -- 172.21.15.156:0/3579929193 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6081206e0 con 0x7fd60809e170 2023-09-30T22:20:02.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.384+0000 7fd5fdffb700 1 -- 172.21.15.156:0/3579929193 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd5f8044910 con 0x7fd60809e170 2023-09-30T22:20:02.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.393+0000 7fd5fdffb700 1 -- 172.21.15.156:0/3579929193 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd6081206e0 con 0x7fd60809e170 2023-09-30T22:20:02.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.425+0000 7fdb267b6700 1 Processor -- start 2023-09-30T22:20:02.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.425+0000 7fdb267b6700 1 -- start start 2023-09-30T22:20:02.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.426+0000 7fdb267b6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb2009f350 0x7fdb20136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:02.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.426+0000 7fdb267b6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdb201371c0 0x7fdb201395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:02.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.426+0000 7fdb267b6700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb2009c970 con 0x7fdb2009e870 2023-09-30T22:20:02.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.426+0000 7fdb267b6700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb200a0920 con 0x7fdb201371c0 2023-09-30T22:20:02.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.426+0000 7fdb267b6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2009f9c0 con 0x7fdb2009f350 2023-09-30T22:20:02.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.426+0000 7fdb1f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb2009f350 0x7fdb20136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:02.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.426+0000 7fdb1f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb2009f350 0x7fdb20136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51996/0 (socket says 172.21.15.156:51996) 2023-09-30T22:20:02.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.426+0000 7fdb1f7fe700 1 -- 172.21.15.156:0/1103634482 learned_addr learned my addr 172.21.15.156:0/1103634482 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:02.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.426+0000 7fdb24d53700 1 --2- 172.21.15.156:0/1103634482 >> v2:172.21.15.156:3300/0 conn(0x7fdb201371c0 0x7fdb201395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:02.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.426+0000 7fdb1f7fe700 1 -- 172.21.15.156:0/1103634482 >> v2:172.21.15.156:3300/0 conn(0x7fdb201371c0 msgr2=0x7fdb201395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:02.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.426+0000 7fdb1f7fe700 1 --2- 172.21.15.156:0/1103634482 >> v2:172.21.15.156:3300/0 conn(0x7fdb201371c0 0x7fdb201395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.426+0000 7fdb1f7fe700 1 -- 172.21.15.156:0/1103634482 >> v1:172.21.15.156:6789/0 conn(0x7fdb2009e870 legacy=0x7fdb2009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:02.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.426+0000 7fdb1f7fe700 1 -- 172.21.15.156:0/1103634482 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb2009bab0 con 0x7fdb2009f350 2023-09-30T22:20:02.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.426+0000 7fdb1effd700 1 -- 172.21.15.156:0/1103634482 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3299494987 0 0) 0x7fdb2009c970 con 0x7fdb2009e870 2023-09-30T22:20:02.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.426+0000 7fdb24d53700 1 --2- 172.21.15.156:0/1103634482 >> v2:172.21.15.156:3300/0 conn(0x7fdb201371c0 0x7fdb201395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:20:02.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.426+0000 7fdb1f7fe700 1 --2- 172.21.15.156:0/1103634482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb2009f350 0x7fdb20136c80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdb140098f0 tx=0x7fdb14009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51cd9fffde519a82 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:02.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.427+0000 7fdb1effd700 1 -- 172.21.15.156:0/1103634482 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1400b8a0 con 0x7fdb2009f350 2023-09-30T22:20:02.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.427+0000 7fdb1effd700 1 -- 172.21.15.156:0/1103634482 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1400ba00 con 0x7fdb2009f350 2023-09-30T22:20:02.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.427+0000 7fdb1effd700 1 -- 172.21.15.156:0/1103634482 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1400bd90 con 0x7fdb2009f350 2023-09-30T22:20:02.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.427+0000 7fdb267b6700 1 -- 172.21.15.156:0/1103634482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb2009f350 msgr2=0x7fdb20136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:02.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.427+0000 7fdb267b6700 1 --2- 172.21.15.156:0/1103634482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb2009f350 0x7fdb20136c80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdb140098f0 tx=0x7fdb14009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:02.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.427+0000 7fdb267b6700 1 -- 172.21.15.156:0/1103634482 shutdown_connections 2023-09-30T22:20:02.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.427+0000 7fdb267b6700 1 --2- 172.21.15.156:0/1103634482 >> v2:172.21.15.156:3300/0 conn(0x7fdb201371c0 0x7fdb201395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.427+0000 7fdb267b6700 1 --2- 172.21.15.156:0/1103634482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb2009f350 0x7fdb20136c80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.427+0000 7fdb267b6700 1 -- 172.21.15.156:0/1103634482 >> 172.21.15.156:0/1103634482 conn(0x7fdb200a4430 msgr2=0x7fdb200a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:02.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.427+0000 7fdb267b6700 1 -- 172.21.15.156:0/1103634482 shutdown_connections 2023-09-30T22:20:02.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.427+0000 7fdb267b6700 1 -- 172.21.15.156:0/1103634482 wait complete. 2023-09-30T22:20:02.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.428+0000 7fdb267b6700 1 Processor -- start 2023-09-30T22:20:02.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.428+0000 7fdb267b6700 1 -- start start 2023-09-30T22:20:02.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.429+0000 7fdb267b6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb2009e870 0x7fdb2006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:02.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.429+0000 7fdb267b6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb2009f350 0x7fdb2006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:02.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.429+0000 7fdb267b6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb201371c0 0x7fdb2006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:02.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.429+0000 7fdb267b6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb201262a0 con 0x7fdb201371c0 2023-09-30T22:20:02.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.429+0000 7fdb267b6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb201264a0 con 0x7fdb2009e870 2023-09-30T22:20:02.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.429+0000 7fdb267b6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2009db60 con 0x7fdb2009f350 2023-09-30T22:20:02.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.429+0000 7fdb1f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb2009f350 0x7fdb2006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:02.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.429+0000 7fdb1f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb2009f350 0x7fdb2006bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52002/0 (socket says 172.21.15.156:52002) 2023-09-30T22:20:02.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.429+0000 7fdb1f7fe700 1 -- 172.21.15.156:0/1195527127 learned_addr learned my addr 172.21.15.156:0/1195527127 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:02.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.429+0000 7fdb1ffff700 1 --2- 172.21.15.156:0/1195527127 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb2009e870 0x7fdb2006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:02.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.429+0000 7fdb24d53700 1 --2- 172.21.15.156:0/1195527127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb201371c0 0x7fdb2006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:02.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.429+0000 7fdb1f7fe700 1 -- 172.21.15.156:0/1195527127 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb2009e870 msgr2=0x7fdb2006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:02.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.429+0000 7fdb1f7fe700 1 --2- 172.21.15.156:0/1195527127 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb2009e870 0x7fdb2006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.429+0000 7fdb1f7fe700 1 -- 172.21.15.156:0/1195527127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb201371c0 msgr2=0x7fdb2006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:02.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.429+0000 7fdb1f7fe700 1 --2- 172.21.15.156:0/1195527127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb201371c0 0x7fdb2006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.429+0000 7fdb1f7fe700 1 -- 172.21.15.156:0/1195527127 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb14009550 con 0x7fdb2009f350 2023-09-30T22:20:02.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.429+0000 7fdb24d53700 1 --2- 172.21.15.156:0/1195527127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb201371c0 0x7fdb2006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:20:02.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.430+0000 7fdb1f7fe700 1 --2- 172.21.15.156:0/1195527127 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb2009f350 0x7fdb2006bdf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdb14000c00 tx=0x7fdb14004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:02.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.430+0000 7fdb1cff9700 1 -- 172.21.15.156:0/1195527127 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb140036a0 con 0x7fdb2009f350 2023-09-30T22:20:02.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.430+0000 7fdb1cff9700 1 -- 172.21.15.156:0/1195527127 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1401f070 con 0x7fdb2009f350 2023-09-30T22:20:02.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.430+0000 7fdb1cff9700 1 -- 172.21.15.156:0/1195527127 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14003a20 con 0x7fdb2009f350 2023-09-30T22:20:02.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.430+0000 7fdb267b6700 1 -- 172.21.15.156:0/1195527127 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb200722e0 con 0x7fdb2009f350 2023-09-30T22:20:02.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.430+0000 7fdb267b6700 1 -- 172.21.15.156:0/1195527127 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb20136900 con 0x7fdb2009f350 2023-09-30T22:20:02.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.431+0000 7fdb267b6700 1 -- 172.21.15.156:0/1195527127 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb20125f60 con 0x7fdb2009f350 2023-09-30T22:20:02.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.431+0000 7fdb1cff9700 1 -- 172.21.15.156:0/1195527127 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb14003b80 con 0x7fdb2009f350 2023-09-30T22:20:02.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.432+0000 7fdb1cff9700 1 -- 172.21.15.156:0/1195527127 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdb14021070 con 0x7fdb2009f350 2023-09-30T22:20:02.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.440+0000 7fdb1cff9700 1 -- 172.21.15.156:0/1195527127 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb140199a0 con 0x7fdb2009f350 2023-09-30T22:20:02.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.464+0000 7fdba8edf700 1 -- 172.21.15.156:0/558454739 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdba404f2a0 con 0x7fdba41300a0 2023-09-30T22:20:02.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.464+0000 7fdb92ffd700 1 -- 172.21.15.156:0/558454739 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb94035090 con 0x7fdba41300a0 2023-09-30T22:20:02.465 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:02.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.467+0000 7fdba8edf700 1 -- 172.21.15.156:0/558454739 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdba41300a0 msgr2=0x7fdba412d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:02.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.467+0000 7fdba8edf700 1 --2- 172.21.15.156:0/558454739 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdba41300a0 0x7fdba412d670 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdb94009fd0 tx=0x7fdb94004750 comp rx=0 tx=0).stop 2023-09-30T22:20:02.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.467+0000 7fdba8edf700 1 -- 172.21.15.156:0/558454739 shutdown_connections 2023-09-30T22:20:02.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.467+0000 7fdba8edf700 1 --2- 172.21.15.156:0/558454739 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdba4133ad0 0x7fdba40718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.467+0000 7fdba8edf700 1 --2- 172.21.15.156:0/558454739 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdba41300a0 0x7fdba412d670 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.467+0000 7fdba8edf700 1 --2- 172.21.15.156:0/558454739 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdba41309f0 0x7fdba4071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.467+0000 7fdba8edf700 1 -- 172.21.15.156:0/558454739 >> 172.21.15.156:0/558454739 conn(0x7fdba4099c40 msgr2=0x7fdba4132930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:02.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.467+0000 7fdba8edf700 1 -- 172.21.15.156:0/558454739 shutdown_connections 2023-09-30T22:20:02.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.467+0000 7fdba8edf700 1 -- 172.21.15.156:0/558454739 wait complete. 2023-09-30T22:20:02.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.475+0000 7f2a960f9700 1 Processor -- start 2023-09-30T22:20:02.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.475+0000 7f2a960f9700 1 -- start start 2023-09-30T22:20:02.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.475+0000 7f2a960f9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a900a0a30 0x7f2a900a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:02.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.475+0000 7f2a960f9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a90130670 0x7f2a901381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:02.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.475+0000 7f2a960f9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a900a1e70 con 0x7f2a900a1340 2023-09-30T22:20:02.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.475+0000 7f2a960f9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9009a720 con 0x7f2a90130670 2023-09-30T22:20:02.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.475+0000 7f2a960f9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9009b300 con 0x7f2a900a0a30 2023-09-30T22:20:02.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.476+0000 7f2a8ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a90130670 0x7f2a901381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:02.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.476+0000 7f2a8f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a900a0a30 0x7f2a900a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:02.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.476+0000 7f2a8ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a90130670 0x7f2a901381c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48418/0 (socket says 172.21.15.156:48418) 2023-09-30T22:20:02.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.476+0000 7f2a8ffff700 1 -- 172.21.15.156:0/2786130406 learned_addr learned my addr 172.21.15.156:0/2786130406 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:02.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.476+0000 7f2a8ffff700 1 -- 172.21.15.156:0/2786130406 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a900a0a30 msgr2=0x7f2a900a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:02.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.476+0000 7f2a8ffff700 1 --2- 172.21.15.156:0/2786130406 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a900a0a30 0x7f2a900a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.476+0000 7f2a8ffff700 1 -- 172.21.15.156:0/2786130406 >> v1:172.21.15.156:6789/0 conn(0x7f2a900a1340 legacy=0x7f2a9012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:02.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.476+0000 7f2a8ffff700 1 -- 172.21.15.156:0/2786130406 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a9009abc0 con 0x7f2a90130670 2023-09-30T22:20:02.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.476+0000 7f2a8f7fe700 1 --2- 172.21.15.156:0/2786130406 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a900a0a30 0x7f2a900a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:02.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.476+0000 7f2a8ffff700 1 --2- 172.21.15.156:0/2786130406 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a90130670 0x7f2a901381c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2a8800d180 tx=0x7f2a8800d490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3706f62877fa9cf3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:02.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.476+0000 7f2a8e7fc700 1 -- 172.21.15.156:0/2786130406 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a88010070 con 0x7f2a90130670 2023-09-30T22:20:02.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.477+0000 7f2a8e7fc700 1 -- 172.21.15.156:0/2786130406 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8800db30 con 0x7f2a90130670 2023-09-30T22:20:02.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.477+0000 7f2a8e7fc700 1 -- 172.21.15.156:0/2786130406 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a88016400 con 0x7f2a90130670 2023-09-30T22:20:02.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.477+0000 7f2a960f9700 1 -- 172.21.15.156:0/2786130406 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a90130670 msgr2=0x7f2a901381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:02.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.477+0000 7f2a960f9700 1 --2- 172.21.15.156:0/2786130406 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a90130670 0x7f2a901381c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2a8800d180 tx=0x7f2a8800d490 comp rx=0 tx=0).stop 2023-09-30T22:20:02.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.477+0000 7f2a960f9700 1 -- 172.21.15.156:0/2786130406 shutdown_connections 2023-09-30T22:20:02.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.477+0000 7f2a960f9700 1 --2- 172.21.15.156:0/2786130406 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a90130670 0x7f2a901381c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.477+0000 7f2a960f9700 1 --2- 172.21.15.156:0/2786130406 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a900a0a30 0x7f2a900a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.477+0000 7f2a960f9700 1 -- 172.21.15.156:0/2786130406 >> 172.21.15.156:0/2786130406 conn(0x7f2a900a2980 msgr2=0x7f2a900a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:02.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.477+0000 7f2a960f9700 1 -- 172.21.15.156:0/2786130406 shutdown_connections 2023-09-30T22:20:02.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.477+0000 7f2a960f9700 1 -- 172.21.15.156:0/2786130406 wait complete. 2023-09-30T22:20:02.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.479+0000 7f2a960f9700 1 Processor -- start 2023-09-30T22:20:02.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.479+0000 7f2a960f9700 1 -- start start 2023-09-30T22:20:02.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.479+0000 7f2a960f9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a900a0a30 0x7f2a9011ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:02.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.479+0000 7f2a960f9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a900a1340 0x7f2a9011f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:02.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.479+0000 7f2a960f9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a90130670 0x7f2a901c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:02.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.479+0000 7f2a960f9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a901210d0 con 0x7f2a900a0a30 2023-09-30T22:20:02.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.479+0000 7f2a960f9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9011e700 con 0x7f2a90130670 2023-09-30T22:20:02.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.479+0000 7f2a960f9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9011f7f0 con 0x7f2a900a1340 2023-09-30T22:20:02.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.480+0000 7f2a8ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a90130670 0x7f2a901c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:02.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.480+0000 7f2a8ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a90130670 0x7f2a901c81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48426/0 (socket says 172.21.15.156:48426) 2023-09-30T22:20:02.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.480+0000 7f2a8ffff700 1 -- 172.21.15.156:0/1174578033 learned_addr learned my addr 172.21.15.156:0/1174578033 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:02.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.480+0000 7f2a8effd700 1 --2- 172.21.15.156:0/1174578033 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a900a1340 0x7f2a9011f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:02.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.480+0000 7f2a8f7fe700 1 --2- 172.21.15.156:0/1174578033 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a900a0a30 0x7f2a9011ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:02.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.480+0000 7f2a8ffff700 1 -- 172.21.15.156:0/1174578033 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a900a1340 msgr2=0x7f2a9011f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:02.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.480+0000 7f2a8ffff700 1 --2- 172.21.15.156:0/1174578033 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a900a1340 0x7f2a9011f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.480+0000 7f2a8ffff700 1 -- 172.21.15.156:0/1174578033 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a900a0a30 msgr2=0x7f2a9011ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:02.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.480+0000 7f2a8ffff700 1 --2- 172.21.15.156:0/1174578033 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a900a0a30 0x7f2a9011ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.480+0000 7f2a8ffff700 1 -- 172.21.15.156:0/1174578033 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a80009430 con 0x7f2a90130670 2023-09-30T22:20:02.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.480+0000 7f2a8ffff700 1 --2- 172.21.15.156:0/1174578033 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a90130670 0x7f2a901c81d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2a8800d7e0 tx=0x7f2a88004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:02.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.480+0000 7f2a77fff700 1 -- 172.21.15.156:0/1174578033 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a88004490 con 0x7f2a90130670 2023-09-30T22:20:02.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.480+0000 7f2a77fff700 1 -- 172.21.15.156:0/1174578033 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a880045f0 con 0x7f2a90130670 2023-09-30T22:20:02.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.480+0000 7f2a960f9700 1 -- 172.21.15.156:0/1174578033 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a8800bd40 con 0x7f2a90130670 2023-09-30T22:20:02.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.480+0000 7f2a77fff700 1 -- 172.21.15.156:0/1174578033 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8801f450 con 0x7f2a90130670 2023-09-30T22:20:02.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.480+0000 7f2a960f9700 1 -- 172.21.15.156:0/1174578033 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a9009ae00 con 0x7f2a90130670 2023-09-30T22:20:02.484 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:02.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.481+0000 7f2a960f9700 1 -- 172.21.15.156:0/1174578033 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a9004f2a0 con 0x7f2a90130670 2023-09-30T22:20:02.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.482+0000 7f2a77fff700 1 -- 172.21.15.156:0/1174578033 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a8801f5b0 con 0x7f2a90130670 2023-09-30T22:20:02.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.482+0000 7f2a77fff700 1 -- 172.21.15.156:0/1174578033 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2a88041260 con 0x7f2a90130670 2023-09-30T22:20:02.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.486+0000 7f2a77fff700 1 -- 172.21.15.156:0/1174578033 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a880279a0 con 0x7f2a90130670 2023-09-30T22:20:02.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.593+0000 7fd60f5f9700 1 -- 172.21.15.156:0/3579929193 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd6081206e0 con 0x7fd60809e170 2023-09-30T22:20:02.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.594+0000 7fd5fdffb700 1 -- 172.21.15.156:0/3579929193 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd6081206e0 con 0x7fd60809e170 2023-09-30T22:20:02.594 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:02.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.597+0000 7fd60f5f9700 1 -- 172.21.15.156:0/3579929193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd60809e170 msgr2=0x7fd60811d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:02.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.597+0000 7fd60f5f9700 1 --2- 172.21.15.156:0/3579929193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd60809e170 0x7fd60811d5b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd60809a100 tx=0x7fd5f8004750 comp rx=0 tx=0).stop 2023-09-30T22:20:02.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.597+0000 7fd60f5f9700 1 -- 172.21.15.156:0/3579929193 shutdown_connections 2023-09-30T22:20:02.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.597+0000 7fd60f5f9700 1 --2- 172.21.15.156:0/3579929193 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd608130ce0 0x7fd60811daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.597+0000 7fd60f5f9700 1 --2- 172.21.15.156:0/3579929193 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd60809d860 0x7fd60811d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.597+0000 7fd60f5f9700 1 --2- 172.21.15.156:0/3579929193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd60809e170 0x7fd60811d5b0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.597+0000 7fd60f5f9700 1 -- 172.21.15.156:0/3579929193 >> 172.21.15.156:0/3579929193 conn(0x7fd608099c40 msgr2=0x7fd608130010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:02.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.597+0000 7fd60f5f9700 1 -- 172.21.15.156:0/3579929193 shutdown_connections 2023-09-30T22:20:02.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.597+0000 7fd60f5f9700 1 -- 172.21.15.156:0/3579929193 wait complete. 2023-09-30T22:20:02.614 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:02.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.686+0000 7fdb267b6700 1 -- 172.21.15.156:0/1195527127 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdb20125f60 con 0x7fdb2009f350 2023-09-30T22:20:02.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.686+0000 7fdb1cff9700 1 -- 172.21.15.156:0/1195527127 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb20125f60 con 0x7fdb2009f350 2023-09-30T22:20:02.687 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:02.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.688+0000 7fdb267b6700 1 -- 172.21.15.156:0/1195527127 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb2009f350 msgr2=0x7fdb2006bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:02.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.688+0000 7fdb267b6700 1 --2- 172.21.15.156:0/1195527127 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb2009f350 0x7fdb2006bdf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdb14000c00 tx=0x7fdb14004750 comp rx=0 tx=0).stop 2023-09-30T22:20:02.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.688+0000 7fdb267b6700 1 -- 172.21.15.156:0/1195527127 shutdown_connections 2023-09-30T22:20:02.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.688+0000 7fdb267b6700 1 --2- 172.21.15.156:0/1195527127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb201371c0 0x7fdb2006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.688+0000 7fdb267b6700 1 --2- 172.21.15.156:0/1195527127 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb2009e870 0x7fdb2006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.688+0000 7fdb267b6700 1 --2- 172.21.15.156:0/1195527127 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb2009f350 0x7fdb2006bdf0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.688+0000 7fdb267b6700 1 -- 172.21.15.156:0/1195527127 >> 172.21.15.156:0/1195527127 conn(0x7fdb200a4430 msgr2=0x7fdb200a2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:02.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.689+0000 7fdb267b6700 1 -- 172.21.15.156:0/1195527127 shutdown_connections 2023-09-30T22:20:02.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.689+0000 7fdb267b6700 1 -- 172.21.15.156:0/1195527127 wait complete. 2023-09-30T22:20:02.701 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:02.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.713+0000 7f2a960f9700 1 -- 172.21.15.156:0/1174578033 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2a90121c50 con 0x7f2a90130670 2023-09-30T22:20:02.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.714+0000 7f2a77fff700 1 -- 172.21.15.156:0/1174578033 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2a88023020 con 0x7f2a90130670 2023-09-30T22:20:02.717 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:02.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.716+0000 7f2a960f9700 1 -- 172.21.15.156:0/1174578033 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a90130670 msgr2=0x7f2a901c81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:02.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.716+0000 7f2a960f9700 1 --2- 172.21.15.156:0/1174578033 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a90130670 0x7f2a901c81d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2a8800d7e0 tx=0x7f2a88004ad0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.716+0000 7f2a960f9700 1 -- 172.21.15.156:0/1174578033 shutdown_connections 2023-09-30T22:20:02.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.716+0000 7f2a960f9700 1 --2- 172.21.15.156:0/1174578033 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a90130670 0x7f2a901c81d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.716+0000 7f2a960f9700 1 --2- 172.21.15.156:0/1174578033 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a900a0a30 0x7f2a9011ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.716+0000 7f2a960f9700 1 --2- 172.21.15.156:0/1174578033 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a900a1340 0x7f2a9011f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:02.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.716+0000 7f2a960f9700 1 -- 172.21.15.156:0/1174578033 >> 172.21.15.156:0/1174578033 conn(0x7f2a900a2980 msgr2=0x7f2a9012f050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:02.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.716+0000 7f2a960f9700 1 -- 172.21.15.156:0/1174578033 shutdown_connections 2023-09-30T22:20:02.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:02.716+0000 7f2a960f9700 1 -- 172.21.15.156:0/1174578033 wait complete. 2023-09-30T22:20:02.729 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:03.485 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:03.616 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:03.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.618+0000 7ff04bca1700 1 Processor -- start 2023-09-30T22:20:03.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.618+0000 7ff04bca1700 1 -- start start 2023-09-30T22:20:03.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.619+0000 7ff04bca1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0440724f0 0x7ff0441358e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:03.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.619+0000 7ff04bca1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff044130e90 0x7ff044137e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:03.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.619+0000 7ff04bca1700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff04406d970 con 0x7ff0441303b0 2023-09-30T22:20:03.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.619+0000 7ff04bca1700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff04409a8a0 con 0x7ff044130e90 2023-09-30T22:20:03.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.619+0000 7ff04bca1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04409b940 con 0x7ff0440724f0 2023-09-30T22:20:03.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.619+0000 7ff04923c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0440724f0 0x7ff0441358e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:03.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.619+0000 7ff04a23e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff044130e90 0x7ff044137e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:03.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.619+0000 7ff04923c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0440724f0 0x7ff0441358e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48430/0 (socket says 172.21.15.156:48430) 2023-09-30T22:20:03.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.619+0000 7ff04923c700 1 -- 172.21.15.156:0/3797294971 learned_addr learned my addr 172.21.15.156:0/3797294971 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:03.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.619+0000 7ff04a23e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff044130e90 0x7ff044137e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:57052/0 (socket says 172.21.15.156:57052) 2023-09-30T22:20:03.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.619+0000 7ff049a3d700 1 --1- 172.21.15.156:0/3797294971 >> v1:172.21.15.156:6789/0 conn(0x7ff0441303b0 0x7ff044130780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58252/0 (socket says 172.21.15.156:58252) 2023-09-30T22:20:03.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.620+0000 7ff04a23e700 1 -- 172.21.15.156:0/3797294971 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0440724f0 msgr2=0x7ff0441358e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:03.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.620+0000 7ff04a23e700 1 --2- 172.21.15.156:0/3797294971 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0440724f0 0x7ff0441358e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:03.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.620+0000 7ff04a23e700 1 -- 172.21.15.156:0/3797294971 >> v1:172.21.15.156:6789/0 conn(0x7ff0441303b0 legacy=0x7ff044130780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:03.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.620+0000 7ff04a23e700 1 -- 172.21.15.156:0/3797294971 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04409af50 con 0x7ff044130e90 2023-09-30T22:20:03.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.620+0000 7ff04923c700 1 --2- 172.21.15.156:0/3797294971 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0440724f0 0x7ff0441358e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:03.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.620+0000 7ff04a23e700 1 --2- 172.21.15.156:0/3797294971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff044130e90 0x7ff044137e30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff03c009d90 tx=0x7ff03c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfacab9e43be891e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:03.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.620+0000 7ff048a3b700 1 -- 172.21.15.156:0/3797294971 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c00e070 con 0x7ff044130e90 2023-09-30T22:20:03.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.620+0000 7ff048a3b700 1 -- 172.21.15.156:0/3797294971 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03c00bb20 con 0x7ff044130e90 2023-09-30T22:20:03.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.620+0000 7ff048a3b700 1 -- 172.21.15.156:0/3797294971 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c012430 con 0x7ff044130e90 2023-09-30T22:20:03.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.621+0000 7ff04bca1700 1 -- 172.21.15.156:0/3797294971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff044130e90 msgr2=0x7ff044137e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:03.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.621+0000 7ff04bca1700 1 --2- 172.21.15.156:0/3797294971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff044130e90 0x7ff044137e30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff03c009d90 tx=0x7ff03c00b330 comp rx=0 tx=0).stop 2023-09-30T22:20:03.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.621+0000 7ff04bca1700 1 -- 172.21.15.156:0/3797294971 shutdown_connections 2023-09-30T22:20:03.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.621+0000 7ff04bca1700 1 --2- 172.21.15.156:0/3797294971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff044130e90 0x7ff044137e30 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:03.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.621+0000 7ff04bca1700 1 --2- 172.21.15.156:0/3797294971 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0440724f0 0x7ff0441358e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:03.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.621+0000 7ff04bca1700 1 -- 172.21.15.156:0/3797294971 >> 172.21.15.156:0/3797294971 conn(0x7ff0440a1ee0 msgr2=0x7ff0440a22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:03.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.621+0000 7ff04bca1700 1 -- 172.21.15.156:0/3797294971 shutdown_connections 2023-09-30T22:20:03.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.621+0000 7ff04bca1700 1 -- 172.21.15.156:0/3797294971 wait complete. 2023-09-30T22:20:03.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.622+0000 7ff04bca1700 1 Processor -- start 2023-09-30T22:20:03.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.622+0000 7ff04bca1700 1 -- start start 2023-09-30T22:20:03.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.622+0000 7ff04bca1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0440724f0 0x7ff044126fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:03.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.622+0000 7ff04bca1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0441303b0 0x7ff0441274e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:03.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.622+0000 7ff04bca1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff044130e90 0x7ff044127a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:03.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.622+0000 7ff04bca1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff044128520 con 0x7ff0441303b0 2023-09-30T22:20:03.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.622+0000 7ff04bca1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04412a1f0 con 0x7ff0440724f0 2023-09-30T22:20:03.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.622+0000 7ff04bca1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff04409b190 con 0x7ff044130e90 2023-09-30T22:20:03.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.622+0000 7ff049a3d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0440724f0 0x7ff044126fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:03.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.622+0000 7ff04a23e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff044130e90 0x7ff044127a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:03.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.622+0000 7ff049a3d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0440724f0 0x7ff044126fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48446/0 (socket says 172.21.15.156:48446) 2023-09-30T22:20:03.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.622+0000 7ff049a3d700 1 -- 172.21.15.156:0/3646329575 learned_addr learned my addr 172.21.15.156:0/3646329575 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:03.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.622+0000 7ff04923c700 1 --2- 172.21.15.156:0/3646329575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0441303b0 0x7ff0441274e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:03.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.623+0000 7ff04a23e700 1 -- 172.21.15.156:0/3646329575 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0440724f0 msgr2=0x7ff044126fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:03.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.623+0000 7ff04a23e700 1 --2- 172.21.15.156:0/3646329575 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0440724f0 0x7ff044126fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:03.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.623+0000 7ff04a23e700 1 -- 172.21.15.156:0/3646329575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0441303b0 msgr2=0x7ff0441274e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:03.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.623+0000 7ff04a23e700 1 --2- 172.21.15.156:0/3646329575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0441303b0 0x7ff0441274e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:03.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.623+0000 7ff04a23e700 1 -- 172.21.15.156:0/3646329575 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff03400b7f0 con 0x7ff044130e90 2023-09-30T22:20:03.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.623+0000 7ff04923c700 1 --2- 172.21.15.156:0/3646329575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0441303b0 0x7ff0441274e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:03.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.623+0000 7ff04a23e700 1 --2- 172.21.15.156:0/3646329575 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff044130e90 0x7ff044127a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff03c016000 tx=0x7ff03c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:03.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.623+0000 7ff03a7fc700 1 -- 172.21.15.156:0/3646329575 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c012430 con 0x7ff044130e90 2023-09-30T22:20:03.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.623+0000 7ff03a7fc700 1 -- 172.21.15.156:0/3646329575 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03c020070 con 0x7ff044130e90 2023-09-30T22:20:03.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.623+0000 7ff03a7fc700 1 -- 172.21.15.156:0/3646329575 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c004280 con 0x7ff044130e90 2023-09-30T22:20:03.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.623+0000 7ff04bca1700 1 -- 172.21.15.156:0/3646329575 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff03c009a70 con 0x7ff044130e90 2023-09-30T22:20:03.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.623+0000 7ff04bca1700 1 -- 172.21.15.156:0/3646329575 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff044129770 con 0x7ff044130e90 2023-09-30T22:20:03.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.624+0000 7ff03a7fc700 1 -- 172.21.15.156:0/3646329575 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff03c0043e0 con 0x7ff044130e90 2023-09-30T22:20:03.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.624+0000 7ff03a7fc700 1 -- 172.21.15.156:0/3646329575 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff03c022070 con 0x7ff044130e90 2023-09-30T22:20:03.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.624+0000 7ff04bca1700 1 -- 172.21.15.156:0/3646329575 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff04412a330 con 0x7ff044130e90 2023-09-30T22:20:03.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.630+0000 7ff03a7fc700 1 -- 172.21.15.156:0/3646329575 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff03c004690 con 0x7ff044130e90 2023-09-30T22:20:03.702 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:03.729 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:03.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.742+0000 7f8200d69700 1 Processor -- start 2023-09-30T22:20:03.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.742+0000 7f8200d69700 1 -- start start 2023-09-30T22:20:03.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.743+0000 7f8200d69700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f81fc099e20 0x7f81fc09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:03.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.743+0000 7f8200d69700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81fc130a60 0x7f81fc138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:03.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.743+0000 7f8200d69700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81fc099a60 con 0x7f81fc09a730 2023-09-30T22:20:03.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.743+0000 7f8200d69700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81fc09bf50 con 0x7f81fc099e20 2023-09-30T22:20:03.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.743+0000 7f8200d69700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc09b230 con 0x7f81fc130a60 2023-09-30T22:20:03.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.743+0000 7f81fad9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81fc130a60 0x7f81fc138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:03.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.743+0000 7f81f9d9b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f81fc09a730 0x7f81fc130350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58260/0 (socket says 172.21.15.156:58260) 2023-09-30T22:20:03.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.743+0000 7f81f9d9b700 1 -- 172.21.15.156:0/1983420479 learned_addr learned my addr 172.21.15.156:0/1983420479 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:03.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.743+0000 7f81fa59c700 1 --2- 172.21.15.156:0/1983420479 >> v2:172.21.15.156:3300/0 conn(0x7f81fc099e20 0x7f81fc09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:03.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.743+0000 7f81f959a700 1 -- 172.21.15.156:0/1983420479 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2249568275 0 0) 0x7f81fc099a60 con 0x7f81fc09a730 2023-09-30T22:20:03.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.743+0000 7f81f959a700 1 -- 172.21.15.156:0/1983420479 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81e40035b0 con 0x7f81fc09a730 2023-09-30T22:20:03.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.743+0000 7f81fa59c700 1 -- 172.21.15.156:0/1983420479 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81fc130a60 msgr2=0x7f81fc138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:03.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.743+0000 7f81fa59c700 1 --2- 172.21.15.156:0/1983420479 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81fc130a60 0x7f81fc138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:03.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.743+0000 7f81fa59c700 1 -- 172.21.15.156:0/1983420479 >> v1:172.21.15.156:6789/0 conn(0x7f81fc09a730 legacy=0x7f81fc130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:03.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.743+0000 7f81fa59c700 1 -- 172.21.15.156:0/1983420479 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81fc09bb90 con 0x7f81fc099e20 2023-09-30T22:20:03.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.744+0000 7f81fad9d700 1 --2- 172.21.15.156:0/1983420479 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81fc130a60 0x7f81fc138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:03.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.744+0000 7f81fa59c700 1 --2- 172.21.15.156:0/1983420479 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81fc099e20 0x7f81fc09a1f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009820 tx=0x7f81ec009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e1c8c91103914f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:03.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.744+0000 7f81f959a700 1 -- 172.21.15.156:0/1983420479 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec005e30 con 0x7f81fc099e20 2023-09-30T22:20:03.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.744+0000 7f81f959a700 1 -- 172.21.15.156:0/1983420479 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ec006030 con 0x7f81fc099e20 2023-09-30T22:20:03.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.744+0000 7f81f959a700 1 -- 172.21.15.156:0/1983420479 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec0063c0 con 0x7f81fc099e20 2023-09-30T22:20:03.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.745+0000 7f8200d69700 1 -- 172.21.15.156:0/1983420479 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81fc099e20 msgr2=0x7f81fc09a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:03.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.745+0000 7f8200d69700 1 --2- 172.21.15.156:0/1983420479 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81fc099e20 0x7f81fc09a1f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009820 tx=0x7f81ec009b30 comp rx=0 tx=0).stop 2023-09-30T22:20:03.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.745+0000 7f8200d69700 1 -- 172.21.15.156:0/1983420479 shutdown_connections 2023-09-30T22:20:03.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.745+0000 7f8200d69700 1 --2- 172.21.15.156:0/1983420479 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81fc099e20 0x7f81fc09a1f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:03.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.745+0000 7f8200d69700 1 --2- 172.21.15.156:0/1983420479 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81fc130a60 0x7f81fc138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:03.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.745+0000 7f8200d69700 1 -- 172.21.15.156:0/1983420479 >> 172.21.15.156:0/1983420479 conn(0x7f81fc0a2980 msgr2=0x7f81fc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:03.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.745+0000 7f8200d69700 1 -- 172.21.15.156:0/1983420479 shutdown_connections 2023-09-30T22:20:03.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.745+0000 7f8200d69700 1 -- 172.21.15.156:0/1983420479 wait complete. 2023-09-30T22:20:03.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.746+0000 7f8200d69700 1 Processor -- start 2023-09-30T22:20:03.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.746+0000 7f8200d69700 1 -- start start 2023-09-30T22:20:03.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.746+0000 7f8200d69700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81fc099e20 0x7f81fc11f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:03.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.746+0000 7f8200d69700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81fc09a730 0x7f81fc11f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:03.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.746+0000 7f8200d69700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81fc130a60 0x7f81fc11fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:03.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.746+0000 7f8200d69700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc12cf80 con 0x7f81fc099e20 2023-09-30T22:20:03.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.746+0000 7f8200d69700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc09b470 con 0x7f81fc130a60 2023-09-30T22:20:03.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.746+0000 7f8200d69700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc122570 con 0x7f81fc09a730 2023-09-30T22:20:03.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.747+0000 7f81fa59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81fc099e20 0x7f81fc11f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:03.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.747+0000 7f81f9d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81fc09a730 0x7f81fc11f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:03.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.747+0000 7f81fa59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81fc099e20 0x7f81fc11f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:57082/0 (socket says 172.21.15.156:57082) 2023-09-30T22:20:03.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.747+0000 7f81f9d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81fc09a730 0x7f81fc11f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52052/0 (socket says 172.21.15.156:52052) 2023-09-30T22:20:03.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.747+0000 7f81fa59c700 1 -- 172.21.15.156:0/1227955832 learned_addr learned my addr 172.21.15.156:0/1227955832 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:03.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.747+0000 7f81fad9d700 1 --2- 172.21.15.156:0/1227955832 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81fc130a60 0x7f81fc11fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:03.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.747+0000 7f81f9d9b700 1 -- 172.21.15.156:0/1227955832 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81fc130a60 msgr2=0x7f81fc11fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:03.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.747+0000 7f81f9d9b700 1 --2- 172.21.15.156:0/1227955832 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81fc130a60 0x7f81fc11fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:03.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.747+0000 7f81f9d9b700 1 -- 172.21.15.156:0/1227955832 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81fc099e20 msgr2=0x7f81fc11f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:03.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.747+0000 7f81f9d9b700 1 --2- 172.21.15.156:0/1227955832 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81fc099e20 0x7f81fc11f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:03.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.747+0000 7f81f9d9b700 1 -- 172.21.15.156:0/1227955832 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f4009a70 con 0x7f81fc09a730 2023-09-30T22:20:03.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.747+0000 7f81fa59c700 1 --2- 172.21.15.156:0/1227955832 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81fc099e20 0x7f81fc11f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:03.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.747+0000 7f81f9d9b700 1 --2- 172.21.15.156:0/1227955832 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81fc09a730 0x7f81fc11f5c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f81f000c490 tx=0x7f81f000c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:03.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.747+0000 7f81eaffd700 1 -- 172.21.15.156:0/1227955832 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f0005e30 con 0x7f81fc09a730 2023-09-30T22:20:03.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.747+0000 7f8200d69700 1 -- 172.21.15.156:0/1227955832 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81ec009430 con 0x7f81fc09a730 2023-09-30T22:20:03.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.747+0000 7f81eaffd700 1 -- 172.21.15.156:0/1227955832 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f00070d0 con 0x7f81fc09a730 2023-09-30T22:20:03.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.747+0000 7f81eaffd700 1 -- 172.21.15.156:0/1227955832 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f0007440 con 0x7f81fc09a730 2023-09-30T22:20:03.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.747+0000 7f8200d69700 1 -- 172.21.15.156:0/1227955832 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81fc122b10 con 0x7f81fc09a730 2023-09-30T22:20:03.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.748+0000 7f81eaffd700 1 -- 172.21.15.156:0/1227955832 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81f00075a0 con 0x7f81fc09a730 2023-09-30T22:20:03.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.748+0000 7f81eaffd700 1 -- 172.21.15.156:0/1227955832 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f81f003e7a0 con 0x7f81fc09a730 2023-09-30T22:20:03.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.749+0000 7f8200d69700 1 -- 172.21.15.156:0/1227955832 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81fc122770 con 0x7f81fc09a730 2023-09-30T22:20:03.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.754+0000 7f81eaffd700 1 -- 172.21.15.156:0/1227955832 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81fc122770 con 0x7f81fc09a730 2023-09-30T22:20:03.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.833+0000 7ff04bca1700 1 -- 172.21.15.156:0/3646329575 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff04404f2a0 con 0x7ff044130e90 2023-09-30T22:20:03.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.833+0000 7ff03a7fc700 1 -- 172.21.15.156:0/3646329575 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff03c0263e0 con 0x7ff044130e90 2023-09-30T22:20:03.834 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:03.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.834+0000 7f227c878700 1 Processor -- start 2023-09-30T22:20:03.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.834+0000 7f227c878700 1 -- start start 2023-09-30T22:20:03.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.834+0000 7f227c878700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f227809e340 0x7f22781359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:03.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.834+0000 7f227c878700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2278135f20 0x7f2278138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:03.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.834+0000 7f227c878700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f227809aaa0 con 0x7f227809d860 2023-09-30T22:20:03.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.835+0000 7f227c878700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227809e730 con 0x7f2278135f20 2023-09-30T22:20:03.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.835+0000 7f227c878700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f227809f870 con 0x7f227809e340 2023-09-30T22:20:03.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.835+0000 7f227659c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f227809d860 0x7f227809dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58272/0 (socket says 172.21.15.156:58272) 2023-09-30T22:20:03.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.835+0000 7f227659c700 1 -- 172.21.15.156:0/1417340574 learned_addr learned my addr 172.21.15.156:0/1417340574 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:03.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.835+0000 7f2275d9b700 1 --2- 172.21.15.156:0/1417340574 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f227809e340 0x7f22781359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:03.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.835+0000 7f2276d9d700 1 --2- 172.21.15.156:0/1417340574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2278135f20 0x7f2278138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:03.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.835+0000 7f227559a700 1 -- 172.21.15.156:0/1417340574 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3512377160 0 0) 0x7f227809aaa0 con 0x7f227809d860 2023-09-30T22:20:03.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.835+0000 7f227559a700 1 -- 172.21.15.156:0/1417340574 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22640057c0 con 0x7f227809d860 2023-09-30T22:20:03.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.835+0000 7f2276d9d700 1 -- 172.21.15.156:0/1417340574 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f227809e340 msgr2=0x7f22781359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:03.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.835+0000 7f2276d9d700 1 --2- 172.21.15.156:0/1417340574 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f227809e340 0x7f22781359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:03.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.835+0000 7f2276d9d700 1 -- 172.21.15.156:0/1417340574 >> v1:172.21.15.156:6789/0 conn(0x7f227809d860 legacy=0x7f227809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:03.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.835+0000 7f2276d9d700 1 -- 172.21.15.156:0/1417340574 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227809b360 con 0x7f2278135f20 2023-09-30T22:20:03.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.835+0000 7f2275d9b700 1 --2- 172.21.15.156:0/1417340574 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f227809e340 0x7f22781359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:03.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.835+0000 7f2276d9d700 1 --2- 172.21.15.156:0/1417340574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2278135f20 0x7f2278138300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2270009dc0 tx=0x7f227000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5af88e117cc1fb7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:03.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.836+0000 7f227559a700 1 -- 172.21.15.156:0/1417340574 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227000e070 con 0x7f2278135f20 2023-09-30T22:20:03.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.836+0000 7f227559a700 1 -- 172.21.15.156:0/1417340574 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227000bb20 con 0x7f2278135f20 2023-09-30T22:20:03.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.836+0000 7f227559a700 1 -- 172.21.15.156:0/1417340574 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2270012430 con 0x7f2278135f20 2023-09-30T22:20:03.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.836+0000 7f227c878700 1 -- 172.21.15.156:0/1417340574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2278135f20 msgr2=0x7f2278138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:03.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.836+0000 7f227c878700 1 --2- 172.21.15.156:0/1417340574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2278135f20 0x7f2278138300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2270009dc0 tx=0x7f227000b330 comp rx=0 tx=0).stop 2023-09-30T22:20:03.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.836+0000 7f227c878700 1 -- 172.21.15.156:0/1417340574 shutdown_connections 2023-09-30T22:20:03.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.836+0000 7f227c878700 1 --2- 172.21.15.156:0/1417340574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2278135f20 0x7f2278138300 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:03.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.836+0000 7f227c878700 1 --2- 172.21.15.156:0/1417340574 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f227809e340 0x7f22781359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:03.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.836+0000 7f227c878700 1 -- 172.21.15.156:0/1417340574 >> 172.21.15.156:0/1417340574 conn(0x7f2278099c40 msgr2=0x7f22780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:03.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.837+0000 7f227c878700 1 -- 172.21.15.156:0/1417340574 shutdown_connections 2023-09-30T22:20:03.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.837+0000 7f227c878700 1 -- 172.21.15.156:0/1417340574 wait complete. 2023-09-30T22:20:03.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.837+0000 7ff04bca1700 1 -- 172.21.15.156:0/3646329575 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff044130e90 msgr2=0x7ff044127a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:03.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.837+0000 7ff04bca1700 1 --2- 172.21.15.156:0/3646329575 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff044130e90 0x7ff044127a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff03c016000 tx=0x7ff03c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:20:03.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.837+0000 7ff04bca1700 1 -- 172.21.15.156:0/3646329575 shutdown_connections 2023-09-30T22:20:03.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.837+0000 7ff04bca1700 1 --2- 172.21.15.156:0/3646329575 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff044130e90 0x7ff044127a20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:03.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.837+0000 7ff04bca1700 1 --2- 172.21.15.156:0/3646329575 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0440724f0 0x7ff044126fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:03.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.837+0000 7ff04bca1700 1 --2- 172.21.15.156:0/3646329575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0441303b0 0x7ff0441274e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:03.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.837+0000 7ff04bca1700 1 -- 172.21.15.156:0/3646329575 >> 172.21.15.156:0/3646329575 conn(0x7ff0440a1ee0 msgr2=0x7ff044098540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:03.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.837+0000 7ff04bca1700 1 -- 172.21.15.156:0/3646329575 shutdown_connections 2023-09-30T22:20:03.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.837+0000 7ff04bca1700 1 -- 172.21.15.156:0/3646329575 wait complete. 2023-09-30T22:20:03.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.838+0000 7f227c878700 1 Processor -- start 2023-09-30T22:20:03.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.838+0000 7f227c878700 1 -- start start 2023-09-30T22:20:03.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.839+0000 7f227c878700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f227809d860 0x7f227811c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:03.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.839+0000 7f227c878700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f227809e340 0x7f227811c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:03.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.839+0000 7f227c878700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2278135f20 0x7f227811cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:03.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.839+0000 7f227c878700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227811fd70 con 0x7f227809e340 2023-09-30T22:20:03.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.839+0000 7f227c878700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227809c920 con 0x7f227809d860 2023-09-30T22:20:03.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.839+0000 7f227c878700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2278072730 con 0x7f2278135f20 2023-09-30T22:20:03.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.839+0000 7f2276d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2278135f20 0x7f227811cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:03.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.839+0000 7f2276d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2278135f20 0x7f227811cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52078/0 (socket says 172.21.15.156:52078) 2023-09-30T22:20:03.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.839+0000 7f2276d9d700 1 -- 172.21.15.156:0/3486261196 learned_addr learned my addr 172.21.15.156:0/3486261196 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:03.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.839+0000 7f2275d9b700 1 --2- 172.21.15.156:0/3486261196 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f227809e340 0x7f227811c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:03.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.839+0000 7f227659c700 1 --2- 172.21.15.156:0/3486261196 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f227809d860 0x7f227811c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:03.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.839+0000 7f2276d9d700 1 -- 172.21.15.156:0/3486261196 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f227809d860 msgr2=0x7f227811c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:03.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.839+0000 7f2276d9d700 1 --2- 172.21.15.156:0/3486261196 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f227809d860 0x7f227811c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:03.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.839+0000 7f2276d9d700 1 -- 172.21.15.156:0/3486261196 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f227809e340 msgr2=0x7f227811c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:03.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.839+0000 7f2276d9d700 1 --2- 172.21.15.156:0/3486261196 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f227809e340 0x7f227811c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:03.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.839+0000 7f2276d9d700 1 -- 172.21.15.156:0/3486261196 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22600094a0 con 0x7f2278135f20 2023-09-30T22:20:03.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.840+0000 7f2276d9d700 1 --2- 172.21.15.156:0/3486261196 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2278135f20 0x7f227811cd60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2270014040 tx=0x7f2270004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:03.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.840+0000 7f226effd700 1 -- 172.21.15.156:0/3486261196 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2270012430 con 0x7f2278135f20 2023-09-30T22:20:03.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.840+0000 7f226effd700 1 -- 172.21.15.156:0/3486261196 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2270020070 con 0x7f2278135f20 2023-09-30T22:20:03.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.840+0000 7f226effd700 1 -- 172.21.15.156:0/3486261196 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2270004280 con 0x7f2278135f20 2023-09-30T22:20:03.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.840+0000 7f227c878700 1 -- 172.21.15.156:0/3486261196 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2270009a70 con 0x7f2278135f20 2023-09-30T22:20:03.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.840+0000 7f227c878700 1 -- 172.21.15.156:0/3486261196 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227811f500 con 0x7f2278135f20 2023-09-30T22:20:03.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.841+0000 7f226effd700 1 -- 172.21.15.156:0/3486261196 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f22700043e0 con 0x7f2278135f20 2023-09-30T22:20:03.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.841+0000 7f226cff9700 1 -- 172.21.15.156:0/3486261196 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22500052e0 con 0x7f2278135f20 2023-09-30T22:20:03.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.841+0000 7f226effd700 1 -- 172.21.15.156:0/3486261196 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2270022070 con 0x7f2278135f20 2023-09-30T22:20:03.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.849+0000 7f226effd700 1 -- 172.21.15.156:0/3486261196 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f227001a970 con 0x7f2278135f20 2023-09-30T22:20:03.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:03.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.874+0000 7fc48a756700 1 Processor -- start 2023-09-30T22:20:03.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.875+0000 7fc48a756700 1 -- start start 2023-09-30T22:20:03.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.875+0000 7fc48a756700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc484133ad0 0x7fc484133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:03.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.875+0000 7fc48a756700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc484130bc0 0x7fc48413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:03.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.875+0000 7fc48a756700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc48406b2d0 con 0x7fc4841300a0 2023-09-30T22:20:03.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.875+0000 7fc48a756700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc484133610 con 0x7fc484130bc0 2023-09-30T22:20:03.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.875+0000 7fc48a756700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc48409a500 con 0x7fc484133ad0 2023-09-30T22:20:03.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.875+0000 7fc483fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc484133ad0 0x7fc484133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:03.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.876+0000 7fc483fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc484133ad0 0x7fc484133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52092/0 (socket says 172.21.15.156:52092) 2023-09-30T22:20:03.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.876+0000 7fc488cf3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc484130bc0 0x7fc48413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:03.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.876+0000 7fc483fff700 1 -- 172.21.15.156:0/3798383013 learned_addr learned my addr 172.21.15.156:0/3798383013 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:03.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.876+0000 7fc483fff700 1 -- 172.21.15.156:0/3798383013 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc484130bc0 msgr2=0x7fc48413b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:03.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.876+0000 7fc483fff700 1 --2- 172.21.15.156:0/3798383013 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc484130bc0 0x7fc48413b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:03.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.876+0000 7fc483fff700 1 -- 172.21.15.156:0/3798383013 >> v1:172.21.15.156:6789/0 conn(0x7fc4841300a0 legacy=0x7fc4841304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:03.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.876+0000 7fc483fff700 1 -- 172.21.15.156:0/3798383013 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4841338b0 con 0x7fc484133ad0 2023-09-30T22:20:03.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.876+0000 7fc482ffd700 1 -- 172.21.15.156:0/3798383013 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4060504682 0 0) 0x7fc48406b2d0 con 0x7fc4841300a0 2023-09-30T22:20:03.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.876+0000 7fc488cf3700 1 --2- 172.21.15.156:0/3798383013 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc484130bc0 0x7fc48413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:03.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.876+0000 7fc483fff700 1 --2- 172.21.15.156:0/3798383013 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc484133ad0 0x7fc484133ea0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc474009920 tx=0x7fc474009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71d92fc20c39d11a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:03.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.876+0000 7fc482ffd700 1 -- 172.21.15.156:0/3798383013 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc474011830 con 0x7fc484133ad0 2023-09-30T22:20:03.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.876+0000 7fc482ffd700 1 -- 172.21.15.156:0/3798383013 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc474011990 con 0x7fc484133ad0 2023-09-30T22:20:03.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.876+0000 7fc482ffd700 1 -- 172.21.15.156:0/3798383013 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc474011d20 con 0x7fc484133ad0 2023-09-30T22:20:03.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.877+0000 7fc48a756700 1 -- 172.21.15.156:0/3798383013 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc484133ad0 msgr2=0x7fc484133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:03.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.877+0000 7fc48a756700 1 --2- 172.21.15.156:0/3798383013 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc484133ad0 0x7fc484133ea0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc474009920 tx=0x7fc474009c30 comp rx=0 tx=0).stop 2023-09-30T22:20:03.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.877+0000 7fc48a756700 1 -- 172.21.15.156:0/3798383013 shutdown_connections 2023-09-30T22:20:03.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.877+0000 7fc48a756700 1 --2- 172.21.15.156:0/3798383013 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc484130bc0 0x7fc48413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:03.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.877+0000 7fc48a756700 1 --2- 172.21.15.156:0/3798383013 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc484133ad0 0x7fc484133ea0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:03.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.877+0000 7fc48a756700 1 -- 172.21.15.156:0/3798383013 >> 172.21.15.156:0/3798383013 conn(0x7fc484099c40 msgr2=0x7fc4840a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:03.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.877+0000 7fc48a756700 1 -- 172.21.15.156:0/3798383013 shutdown_connections 2023-09-30T22:20:03.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.877+0000 7fc48a756700 1 -- 172.21.15.156:0/3798383013 wait complete. 2023-09-30T22:20:03.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.878+0000 7fc48a756700 1 Processor -- start 2023-09-30T22:20:03.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.878+0000 7fc48a756700 1 -- start start 2023-09-30T22:20:03.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.879+0000 7fc48a756700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4841300a0 0x7fc48411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:03.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.879+0000 7fc48a756700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc484130bc0 0x7fc48411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:03.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.879+0000 7fc48a756700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc484133ad0 0x7fc48411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:03.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.879+0000 7fc48a756700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc484120080 con 0x7fc484130bc0 2023-09-30T22:20:03.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.879+0000 7fc48a756700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48412dd00 con 0x7fc4841300a0 2023-09-30T22:20:03.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.879+0000 7fc48a756700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4841209f0 con 0x7fc484133ad0 2023-09-30T22:20:03.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.879+0000 7fc483fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4841300a0 0x7fc48411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:03.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.879+0000 7fc483fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4841300a0 0x7fc48411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48468/0 (socket says 172.21.15.156:48468) 2023-09-30T22:20:03.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.879+0000 7fc483fff700 1 -- 172.21.15.156:0/51381237 learned_addr learned my addr 172.21.15.156:0/51381237 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:03.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.879+0000 7fc4837fe700 1 --2- 172.21.15.156:0/51381237 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc484130bc0 0x7fc48411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:03.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.879+0000 7fc488cf3700 1 --2- 172.21.15.156:0/51381237 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc484133ad0 0x7fc48411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:03.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.879+0000 7fc483fff700 1 -- 172.21.15.156:0/51381237 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc484133ad0 msgr2=0x7fc48411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:03.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.879+0000 7fc483fff700 1 --2- 172.21.15.156:0/51381237 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc484133ad0 0x7fc48411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:03.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.879+0000 7fc483fff700 1 -- 172.21.15.156:0/51381237 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc484130bc0 msgr2=0x7fc48411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:03.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.879+0000 7fc483fff700 1 --2- 172.21.15.156:0/51381237 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc484130bc0 0x7fc48411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:03.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.879+0000 7fc483fff700 1 -- 172.21.15.156:0/51381237 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c009a70 con 0x7fc4841300a0 2023-09-30T22:20:03.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.879+0000 7fc4837fe700 1 --2- 172.21.15.156:0/51381237 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc484130bc0 0x7fc48411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:03.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.879+0000 7fc483fff700 1 --2- 172.21.15.156:0/51381237 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4841300a0 0x7fc48411da40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc4740098f0 tx=0x7fc474004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:03.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.880+0000 7fc480ff9700 1 -- 172.21.15.156:0/51381237 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc474004450 con 0x7fc4841300a0 2023-09-30T22:20:03.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.880+0000 7fc480ff9700 1 -- 172.21.15.156:0/51381237 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4740045b0 con 0x7fc4841300a0 2023-09-30T22:20:03.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.880+0000 7fc48a756700 1 -- 172.21.15.156:0/51381237 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc474009550 con 0x7fc4841300a0 2023-09-30T22:20:03.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.880+0000 7fc480ff9700 1 -- 172.21.15.156:0/51381237 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4740038e0 con 0x7fc4841300a0 2023-09-30T22:20:03.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.880+0000 7fc48a756700 1 -- 172.21.15.156:0/51381237 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc48411eb00 con 0x7fc4841300a0 2023-09-30T22:20:03.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.881+0000 7fc48a756700 1 -- 172.21.15.156:0/51381237 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc48404f2a0 con 0x7fc4841300a0 2023-09-30T22:20:03.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.881+0000 7fc480ff9700 1 -- 172.21.15.156:0/51381237 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc474003a40 con 0x7fc4841300a0 2023-09-30T22:20:03.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.881+0000 7fc480ff9700 1 -- 172.21.15.156:0/51381237 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc474040c80 con 0x7fc4841300a0 2023-09-30T22:20:03.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.890+0000 7fc480ff9700 1 -- 172.21.15.156:0/51381237 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc47402a350 con 0x7fc4841300a0 2023-09-30T22:20:03.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.953+0000 7f8200d69700 1 -- 172.21.15.156:0/1227955832 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f81fc122770 con 0x7f81fc09a730 2023-09-30T22:20:03.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.953+0000 7f81eaffd700 1 -- 172.21.15.156:0/1227955832 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f81fc122770 con 0x7f81fc09a730 2023-09-30T22:20:03.954 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:03.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.955+0000 7f8200d69700 1 -- 172.21.15.156:0/1227955832 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81fc09a730 msgr2=0x7f81fc11f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:03.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.955+0000 7f8200d69700 1 --2- 172.21.15.156:0/1227955832 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81fc09a730 0x7f81fc11f5c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f81f000c490 tx=0x7f81f000c7a0 comp rx=0 tx=0).stop 2023-09-30T22:20:03.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.955+0000 7f8200d69700 1 -- 172.21.15.156:0/1227955832 shutdown_connections 2023-09-30T22:20:03.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.955+0000 7f8200d69700 1 --2- 172.21.15.156:0/1227955832 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81fc130a60 0x7f81fc11fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:03.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.955+0000 7f8200d69700 1 --2- 172.21.15.156:0/1227955832 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81fc099e20 0x7f81fc11f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:03.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.955+0000 7f8200d69700 1 --2- 172.21.15.156:0/1227955832 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81fc09a730 0x7f81fc11f5c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:03.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.955+0000 7f8200d69700 1 -- 172.21.15.156:0/1227955832 >> 172.21.15.156:0/1227955832 conn(0x7f81fc0a2980 msgr2=0x7f81fc0a0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:03.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.955+0000 7f8200d69700 1 -- 172.21.15.156:0/1227955832 shutdown_connections 2023-09-30T22:20:03.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:03.955+0000 7f8200d69700 1 -- 172.21.15.156:0/1227955832 wait complete. 2023-09-30T22:20:03.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:04.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.060+0000 7f226cff9700 1 -- 172.21.15.156:0/3486261196 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2250005590 con 0x7f2278135f20 2023-09-30T22:20:04.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.061+0000 7f226effd700 1 -- 172.21.15.156:0/3486261196 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f227002c020 con 0x7f2278135f20 2023-09-30T22:20:04.061 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:04.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.063+0000 7f226cff9700 1 -- 172.21.15.156:0/3486261196 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2278135f20 msgr2=0x7f227811cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:04.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.063+0000 7f226cff9700 1 --2- 172.21.15.156:0/3486261196 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2278135f20 0x7f227811cd60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2270014040 tx=0x7f2270004ad0 comp rx=0 tx=0).stop 2023-09-30T22:20:04.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.063+0000 7f226cff9700 1 -- 172.21.15.156:0/3486261196 shutdown_connections 2023-09-30T22:20:04.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.063+0000 7f226cff9700 1 --2- 172.21.15.156:0/3486261196 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2278135f20 0x7f227811cd60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:04.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.063+0000 7f226cff9700 1 --2- 172.21.15.156:0/3486261196 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f227809d860 0x7f227811c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:04.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.063+0000 7f226cff9700 1 --2- 172.21.15.156:0/3486261196 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f227809e340 0x7f227811c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:04.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.063+0000 7f226cff9700 1 -- 172.21.15.156:0/3486261196 >> 172.21.15.156:0/3486261196 conn(0x7f2278099c40 msgr2=0x7f227806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:04.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.063+0000 7f226cff9700 1 -- 172.21.15.156:0/3486261196 shutdown_connections 2023-09-30T22:20:04.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.063+0000 7f226cff9700 1 -- 172.21.15.156:0/3486261196 wait complete. 2023-09-30T22:20:04.075 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:04.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.094+0000 7fc48a756700 1 -- 172.21.15.156:0/51381237 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc48412d930 con 0x7fc4841300a0 2023-09-30T22:20:04.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.094+0000 7fc480ff9700 1 -- 172.21.15.156:0/51381237 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc474015070 con 0x7fc4841300a0 2023-09-30T22:20:04.095 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:04.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.096+0000 7fc48a756700 1 -- 172.21.15.156:0/51381237 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4841300a0 msgr2=0x7fc48411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:04.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.096+0000 7fc48a756700 1 --2- 172.21.15.156:0/51381237 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4841300a0 0x7fc48411da40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc4740098f0 tx=0x7fc474004750 comp rx=0 tx=0).stop 2023-09-30T22:20:04.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.096+0000 7fc48a756700 1 -- 172.21.15.156:0/51381237 shutdown_connections 2023-09-30T22:20:04.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.096+0000 7fc48a756700 1 --2- 172.21.15.156:0/51381237 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc484133ad0 0x7fc48411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:04.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.096+0000 7fc48a756700 1 --2- 172.21.15.156:0/51381237 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4841300a0 0x7fc48411da40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:04.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.096+0000 7fc48a756700 1 --2- 172.21.15.156:0/51381237 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc484130bc0 0x7fc48411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:04.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.096+0000 7fc48a756700 1 -- 172.21.15.156:0/51381237 >> 172.21.15.156:0/51381237 conn(0x7fc484099c40 msgr2=0x7fc484132070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:04.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.096+0000 7fc48a756700 1 -- 172.21.15.156:0/51381237 shutdown_connections 2023-09-30T22:20:04.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.096+0000 7fc48a756700 1 -- 172.21.15.156:0/51381237 wait complete. 2023-09-30T22:20:04.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:04.855 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:04.969 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:04.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.987+0000 7f54414e7700 1 Processor -- start 2023-09-30T22:20:04.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.987+0000 7f54414e7700 1 -- start start 2023-09-30T22:20:04.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.987+0000 7f54414e7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f543c09e340 0x7f543c1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:04.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.987+0000 7f54414e7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f543c135f20 0x7f543c138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:04.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.987+0000 7f54414e7700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f543c09aaa0 con 0x7f543c09d860 2023-09-30T22:20:04.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.987+0000 7f54414e7700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f543c09e730 con 0x7f543c135f20 2023-09-30T22:20:04.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.987+0000 7f54414e7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f543c09f870 con 0x7f543c09e340 2023-09-30T22:20:04.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.987+0000 7f543a7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f543c09e340 0x7f543c1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:04.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.987+0000 7f543b7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f543c135f20 0x7f543c138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:04.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.987+0000 7f543affd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f543c09d860 0x7f543c09dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58300/0 (socket says 172.21.15.156:58300) 2023-09-30T22:20:04.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.987+0000 7f543affd700 1 -- 172.21.15.156:0/1778604352 learned_addr learned my addr 172.21.15.156:0/1778604352 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:04.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.988+0000 7f543b7fe700 1 -- 172.21.15.156:0/1778604352 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f543c09e340 msgr2=0x7f543c1359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:04.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.988+0000 7f543b7fe700 1 --2- 172.21.15.156:0/1778604352 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f543c09e340 0x7f543c1359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:04.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.988+0000 7f543b7fe700 1 -- 172.21.15.156:0/1778604352 >> v1:172.21.15.156:6789/0 conn(0x7f543c09d860 legacy=0x7f543c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:04.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.988+0000 7f543b7fe700 1 -- 172.21.15.156:0/1778604352 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543c09b360 con 0x7f543c135f20 2023-09-30T22:20:04.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.988+0000 7f5439ffb700 1 -- 172.21.15.156:0/1778604352 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1454377753 0 0) 0x7f543c09aaa0 con 0x7f543c09d860 2023-09-30T22:20:04.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.988+0000 7f543a7fc700 1 --2- 172.21.15.156:0/1778604352 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f543c09e340 0x7f543c1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:04.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.988+0000 7f543b7fe700 1 --2- 172.21.15.156:0/1778604352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f543c135f20 0x7f543c138300 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f543400bfa0 tx=0x7f543400d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1baaff2683a1b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:04.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.988+0000 7f5439ffb700 1 -- 172.21.15.156:0/1778604352 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5434010070 con 0x7f543c135f20 2023-09-30T22:20:04.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.988+0000 7f5439ffb700 1 -- 172.21.15.156:0/1778604352 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543400b2e0 con 0x7f543c135f20 2023-09-30T22:20:04.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.988+0000 7f5439ffb700 1 -- 172.21.15.156:0/1778604352 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543400dc40 con 0x7f543c135f20 2023-09-30T22:20:04.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.989+0000 7f54414e7700 1 -- 172.21.15.156:0/1778604352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f543c135f20 msgr2=0x7f543c138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:04.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.989+0000 7f54414e7700 1 --2- 172.21.15.156:0/1778604352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f543c135f20 0x7f543c138300 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f543400bfa0 tx=0x7f543400d330 comp rx=0 tx=0).stop 2023-09-30T22:20:04.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.989+0000 7f54414e7700 1 -- 172.21.15.156:0/1778604352 shutdown_connections 2023-09-30T22:20:04.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.989+0000 7f54414e7700 1 --2- 172.21.15.156:0/1778604352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f543c135f20 0x7f543c138300 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:04.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.989+0000 7f54414e7700 1 --2- 172.21.15.156:0/1778604352 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f543c09e340 0x7f543c1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:04.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.989+0000 7f54414e7700 1 -- 172.21.15.156:0/1778604352 >> 172.21.15.156:0/1778604352 conn(0x7f543c099c40 msgr2=0x7f543c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:04.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.989+0000 7f54414e7700 1 -- 172.21.15.156:0/1778604352 shutdown_connections 2023-09-30T22:20:04.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.989+0000 7f54414e7700 1 -- 172.21.15.156:0/1778604352 wait complete. 2023-09-30T22:20:04.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.990+0000 7f54414e7700 1 Processor -- start 2023-09-30T22:20:04.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.990+0000 7f54414e7700 1 -- start start 2023-09-30T22:20:04.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.990+0000 7f54414e7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f543c09d860 0x7f543c11c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:04.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.990+0000 7f54414e7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f543c09e340 0x7f543c11c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:04.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.990+0000 7f54414e7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f543c135f20 0x7f543c11ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:04.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.990+0000 7f54414e7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c11fdf0 con 0x7f543c09e340 2023-09-30T22:20:04.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.990+0000 7f54414e7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f543c11d6f0 con 0x7f543c135f20 2023-09-30T22:20:04.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.990+0000 7f54414e7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f543c0a0650 con 0x7f543c09d860 2023-09-30T22:20:04.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.991+0000 7f543a7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f543c09e340 0x7f543c11c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:04.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.991+0000 7f543affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f543c09d860 0x7f543c11c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:04.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.991+0000 7f543b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f543c135f20 0x7f543c11ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:04.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.991+0000 7f543a7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f543c09e340 0x7f543c11c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:57122/0 (socket says 172.21.15.156:57122) 2023-09-30T22:20:04.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.991+0000 7f543a7fc700 1 -- 172.21.15.156:0/2541831067 learned_addr learned my addr 172.21.15.156:0/2541831067 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:04.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.991+0000 7f543a7fc700 1 -- 172.21.15.156:0/2541831067 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f543c09d860 msgr2=0x7f543c11c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:04.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.991+0000 7f543a7fc700 1 --2- 172.21.15.156:0/2541831067 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f543c09d860 0x7f543c11c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:04.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.991+0000 7f543a7fc700 1 -- 172.21.15.156:0/2541831067 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f543c135f20 msgr2=0x7f543c11ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:04.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.991+0000 7f543a7fc700 1 --2- 172.21.15.156:0/2541831067 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f543c135f20 0x7f543c11ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:04.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.991+0000 7f543a7fc700 1 -- 172.21.15.156:0/2541831067 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54300094a0 con 0x7f543c09e340 2023-09-30T22:20:04.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.991+0000 7f543b7fe700 1 --2- 172.21.15.156:0/2541831067 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f543c135f20 0x7f543c11ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:04.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.991+0000 7f543a7fc700 1 --2- 172.21.15.156:0/2541831067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f543c09e340 0x7f543c11c770 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f543000ec10 tx=0x7f543000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:04.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.991+0000 7f54237fe700 1 -- 172.21.15.156:0/2541831067 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543000c850 con 0x7f543c09e340 2023-09-30T22:20:04.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.991+0000 7f54237fe700 1 -- 172.21.15.156:0/2541831067 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543000c9b0 con 0x7f543c09e340 2023-09-30T22:20:04.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.991+0000 7f54414e7700 1 -- 172.21.15.156:0/2541831067 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543400bc80 con 0x7f543c09e340 2023-09-30T22:20:04.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.991+0000 7f54237fe700 1 -- 172.21.15.156:0/2541831067 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543000cd20 con 0x7f543c09e340 2023-09-30T22:20:04.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.991+0000 7f54414e7700 1 -- 172.21.15.156:0/2541831067 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f543c11fa70 con 0x7f543c09e340 2023-09-30T22:20:04.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.992+0000 7f54237fe700 1 -- 172.21.15.156:0/2541831067 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5430013470 con 0x7f543c09e340 2023-09-30T22:20:04.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.992+0000 7f54237fe700 1 -- 172.21.15.156:0/2541831067 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f543003f7a0 con 0x7f543c09e340 2023-09-30T22:20:04.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.992+0000 7f54414e7700 1 -- 172.21.15.156:0/2541831067 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f543c04f2a0 con 0x7f543c09e340 2023-09-30T22:20:04.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:04.997+0000 7f54237fe700 1 -- 172.21.15.156:0/2541831067 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5430013720 con 0x7f543c09e340 2023-09-30T22:20:05.076 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:05.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.094+0000 7ff4b9c57700 1 Processor -- start 2023-09-30T22:20:05.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.094+0000 7ff4b9c57700 1 -- start start 2023-09-30T22:20:05.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.095+0000 7ff4b9c57700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff4b409ad40 0x7ff4b4133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:05.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.095+0000 7ff4b9c57700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4b41343d0 0x7ff4b40a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:05.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.095+0000 7ff4b9c57700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b409b110 con 0x7ff4b4133f70 2023-09-30T22:20:05.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.095+0000 7ff4b9c57700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b40a3b60 con 0x7ff4b409ad40 2023-09-30T22:20:05.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.095+0000 7ff4b9c57700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b4134850 con 0x7ff4b41343d0 2023-09-30T22:20:05.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.095+0000 7ff4b3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4b41343d0 0x7ff4b40a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:05.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.095+0000 7ff4b3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4b41343d0 0x7ff4b40a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52110/0 (socket says 172.21.15.156:52110) 2023-09-30T22:20:05.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.095+0000 7ff4b3fff700 1 -- 172.21.15.156:0/1142687682 learned_addr learned my addr 172.21.15.156:0/1142687682 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:05.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.095+0000 7ff4b3fff700 1 -- 172.21.15.156:0/1142687682 >> v2:172.21.15.156:3300/0 conn(0x7ff4b409ad40 msgr2=0x7ff4b4133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:05.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.095+0000 7ff4b3fff700 1 --2- 172.21.15.156:0/1142687682 >> v2:172.21.15.156:3300/0 conn(0x7ff4b409ad40 0x7ff4b4133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.095+0000 7ff4b3fff700 1 -- 172.21.15.156:0/1142687682 >> v1:172.21.15.156:6789/0 conn(0x7ff4b4133f70 legacy=0x7ff4b40a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:05.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.095+0000 7ff4b3fff700 1 -- 172.21.15.156:0/1142687682 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b40a2fa0 con 0x7ff4b41343d0 2023-09-30T22:20:05.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.095+0000 7ff4b3fff700 1 --2- 172.21.15.156:0/1142687682 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4b41343d0 0x7ff4b40a1180 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac009e50 tx=0x7ff4ac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62931b1c4566d773 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:05.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.095+0000 7ff4b27fc700 1 -- 172.21.15.156:0/1142687682 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac00e070 con 0x7ff4b41343d0 2023-09-30T22:20:05.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.095+0000 7ff4b27fc700 1 -- 172.21.15.156:0/1142687682 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac003a20 con 0x7ff4b41343d0 2023-09-30T22:20:05.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.095+0000 7ff4b27fc700 1 -- 172.21.15.156:0/1142687682 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac003dd0 con 0x7ff4b41343d0 2023-09-30T22:20:05.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.096+0000 7ff4b9c57700 1 -- 172.21.15.156:0/1142687682 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4b41343d0 msgr2=0x7ff4b40a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:05.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.096+0000 7ff4b9c57700 1 --2- 172.21.15.156:0/1142687682 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4b41343d0 0x7ff4b40a1180 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac009e50 tx=0x7ff4ac00b330 comp rx=0 tx=0).stop 2023-09-30T22:20:05.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.096+0000 7ff4b9c57700 1 -- 172.21.15.156:0/1142687682 shutdown_connections 2023-09-30T22:20:05.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.096+0000 7ff4b9c57700 1 --2- 172.21.15.156:0/1142687682 >> v2:172.21.15.156:3300/0 conn(0x7ff4b409ad40 0x7ff4b4133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.096+0000 7ff4b9c57700 1 --2- 172.21.15.156:0/1142687682 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4b41343d0 0x7ff4b40a1180 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.096+0000 7ff4b9c57700 1 -- 172.21.15.156:0/1142687682 >> 172.21.15.156:0/1142687682 conn(0x7ff4b4099c40 msgr2=0x7ff4b406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:05.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.096+0000 7ff4b9c57700 1 -- 172.21.15.156:0/1142687682 shutdown_connections 2023-09-30T22:20:05.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.096+0000 7ff4b9c57700 1 -- 172.21.15.156:0/1142687682 wait complete. 2023-09-30T22:20:05.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.098+0000 7ff4b9c57700 1 Processor -- start 2023-09-30T22:20:05.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.098+0000 7ff4b9c57700 1 -- start start 2023-09-30T22:20:05.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.098+0000 7ff4b9c57700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4b409ad40 0x7ff4b411e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:05.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.098+0000 7ff4b9c57700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4b4133f70 0x7ff4b411e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:05.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.098+0000 7ff4b9c57700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4b41343d0 0x7ff4b411ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:05.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.099+0000 7ff4b9c57700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b411f6a0 con 0x7ff4b409ad40 2023-09-30T22:20:05.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.099+0000 7ff4b9c57700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b411fe00 con 0x7ff4b4133f70 2023-09-30T22:20:05.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.099+0000 7ff4b9c57700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b4120420 con 0x7ff4b41343d0 2023-09-30T22:20:05.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.099+0000 7ff4b37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4b409ad40 0x7ff4b411e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:05.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.099+0000 7ff4b37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4b409ad40 0x7ff4b411e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:57154/0 (socket says 172.21.15.156:57154) 2023-09-30T22:20:05.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.099+0000 7ff4b37fe700 1 -- 172.21.15.156:0/1844881097 learned_addr learned my addr 172.21.15.156:0/1844881097 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:05.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.099+0000 7ff4b3fff700 1 --2- 172.21.15.156:0/1844881097 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4b41343d0 0x7ff4b411ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:05.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.099+0000 7ff4b2ffd700 1 --2- 172.21.15.156:0/1844881097 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4b4133f70 0x7ff4b411e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:05.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.099+0000 7ff4b3fff700 1 -- 172.21.15.156:0/1844881097 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4b4133f70 msgr2=0x7ff4b411e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:05.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.099+0000 7ff4b3fff700 1 --2- 172.21.15.156:0/1844881097 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4b4133f70 0x7ff4b411e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.099+0000 7ff4b3fff700 1 -- 172.21.15.156:0/1844881097 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4b409ad40 msgr2=0x7ff4b411e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:05.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.099+0000 7ff4b3fff700 1 --2- 172.21.15.156:0/1844881097 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4b409ad40 0x7ff4b411e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.099+0000 7ff4b3fff700 1 -- 172.21.15.156:0/1844881097 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ac009b30 con 0x7ff4b41343d0 2023-09-30T22:20:05.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.099+0000 7ff4b37fe700 1 --2- 172.21.15.156:0/1844881097 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4b409ad40 0x7ff4b411e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:05.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.099+0000 7ff4b3fff700 1 --2- 172.21.15.156:0/1844881097 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4b41343d0 0x7ff4b411ec70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac014000 tx=0x7ff4ac004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:05.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.099+0000 7ff49bfff700 1 -- 172.21.15.156:0/1844881097 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac004440 con 0x7ff4b41343d0 2023-09-30T22:20:05.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.099+0000 7ff49bfff700 1 -- 172.21.15.156:0/1844881097 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac0045a0 con 0x7ff4b41343d0 2023-09-30T22:20:05.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.099+0000 7ff49bfff700 1 -- 172.21.15.156:0/1844881097 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac004950 con 0x7ff4b41343d0 2023-09-30T22:20:05.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.099+0000 7ff4b9c57700 1 -- 172.21.15.156:0/1844881097 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b4121a30 con 0x7ff4b41343d0 2023-09-30T22:20:05.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.099+0000 7ff4b9c57700 1 -- 172.21.15.156:0/1844881097 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b41214f0 con 0x7ff4b41343d0 2023-09-30T22:20:05.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.100+0000 7ff49bfff700 1 -- 172.21.15.156:0/1844881097 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff4ac01c440 con 0x7ff4b41343d0 2023-09-30T22:20:05.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.100+0000 7ff49bfff700 1 -- 172.21.15.156:0/1844881097 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff4ac040a50 con 0x7ff4b41343d0 2023-09-30T22:20:05.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.101+0000 7ff4b9c57700 1 -- 172.21.15.156:0/1844881097 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b409c840 con 0x7ff4b41343d0 2023-09-30T22:20:05.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.105+0000 7ff49bfff700 1 -- 172.21.15.156:0/1844881097 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff4ac020080 con 0x7ff4b41343d0 2023-09-30T22:20:05.109 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:05.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.200+0000 7f54414e7700 1 -- 172.21.15.156:0/2541831067 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f543c11f710 con 0x7f543c09e340 2023-09-30T22:20:05.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.200+0000 7f54237fe700 1 -- 172.21.15.156:0/2541831067 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f543c11f710 con 0x7f543c09e340 2023-09-30T22:20:05.201 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:05.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.203+0000 7f54414e7700 1 -- 172.21.15.156:0/2541831067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f543c09e340 msgr2=0x7f543c11c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:05.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.203+0000 7f54414e7700 1 --2- 172.21.15.156:0/2541831067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f543c09e340 0x7f543c11c770 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f543000ec10 tx=0x7f543000ef20 comp rx=0 tx=0).stop 2023-09-30T22:20:05.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.203+0000 7f54414e7700 1 -- 172.21.15.156:0/2541831067 shutdown_connections 2023-09-30T22:20:05.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.203+0000 7f54414e7700 1 --2- 172.21.15.156:0/2541831067 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f543c135f20 0x7f543c11ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.203+0000 7f54414e7700 1 --2- 172.21.15.156:0/2541831067 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f543c09d860 0x7f543c11c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.203+0000 7f54414e7700 1 --2- 172.21.15.156:0/2541831067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f543c09e340 0x7f543c11c770 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.203+0000 7f54414e7700 1 -- 172.21.15.156:0/2541831067 >> 172.21.15.156:0/2541831067 conn(0x7f543c099c40 msgr2=0x7f543c0a1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:05.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.203+0000 7f54414e7700 1 -- 172.21.15.156:0/2541831067 shutdown_connections 2023-09-30T22:20:05.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.203+0000 7f54414e7700 1 -- 172.21.15.156:0/2541831067 wait complete. 2023-09-30T22:20:05.206 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.206+0000 7f6de0765700 1 Processor -- start 2023-09-30T22:20:05.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.206+0000 7f6de0765700 1 -- start start 2023-09-30T22:20:05.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.207+0000 7f6de0765700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6dd8131980 0x7f6dd8131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:05.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.207+0000 7f6de0765700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6dd809bc70 0x7f6dd809c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:05.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.207+0000 7f6de0765700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6dd809c5c0 0x7f6dd8138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:05.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.207+0000 7f6de0765700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd806eb30 con 0x7f6dd809c5c0 2023-09-30T22:20:05.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.207+0000 7f6de0765700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd80a1640 con 0x7f6dd809bc70 2023-09-30T22:20:05.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.207+0000 7f6de0765700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd80a22d0 con 0x7f6dd8131980 2023-09-30T22:20:05.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.207+0000 7f6dde501700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6dd8131980 0x7f6dd8131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:05.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.207+0000 7f6dde501700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6dd8131980 0x7f6dd8131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52128/0 (socket says 172.21.15.156:52128) 2023-09-30T22:20:05.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.207+0000 7f6dde501700 1 -- 172.21.15.156:0/402123873 learned_addr learned my addr 172.21.15.156:0/402123873 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:05.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.207+0000 7f6dded02700 1 --2- 172.21.15.156:0/402123873 >> v2:172.21.15.156:3300/0 conn(0x7f6dd809c5c0 0x7f6dd8138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:05.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.207+0000 7f6dddd00700 1 --2- 172.21.15.156:0/402123873 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6dd809bc70 0x7f6dd809c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:05.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.207+0000 7f6dde501700 1 -- 172.21.15.156:0/402123873 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6dd809bc70 msgr2=0x7f6dd809c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:05.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.207+0000 7f6dde501700 1 --2- 172.21.15.156:0/402123873 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6dd809bc70 0x7f6dd809c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.207+0000 7f6dde501700 1 -- 172.21.15.156:0/402123873 >> v2:172.21.15.156:3300/0 conn(0x7f6dd809c5c0 msgr2=0x7f6dd8138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:05.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.207+0000 7f6dde501700 1 --2- 172.21.15.156:0/402123873 >> v2:172.21.15.156:3300/0 conn(0x7f6dd809c5c0 0x7f6dd8138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.207+0000 7f6dde501700 1 -- 172.21.15.156:0/402123873 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd8131550 con 0x7f6dd8131980 2023-09-30T22:20:05.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.207+0000 7f6dde501700 1 --2- 172.21.15.156:0/402123873 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6dd8131980 0x7f6dd8131d50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4006fd0 tx=0x7f6dd4009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7915c6c5253bae2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:05.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.208+0000 7f6ddd4ff700 1 -- 172.21.15.156:0/402123873 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4005e30 con 0x7f6dd8131980 2023-09-30T22:20:05.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.208+0000 7f6ddd4ff700 1 -- 172.21.15.156:0/402123873 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd4004030 con 0x7f6dd8131980 2023-09-30T22:20:05.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.208+0000 7f6ddd4ff700 1 -- 172.21.15.156:0/402123873 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd40043e0 con 0x7f6dd8131980 2023-09-30T22:20:05.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.209+0000 7f6de0765700 1 -- 172.21.15.156:0/402123873 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6dd8131980 msgr2=0x7f6dd8131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:05.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.209+0000 7f6de0765700 1 --2- 172.21.15.156:0/402123873 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6dd8131980 0x7f6dd8131d50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4006fd0 tx=0x7f6dd4009bd0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.209+0000 7f6de0765700 1 -- 172.21.15.156:0/402123873 shutdown_connections 2023-09-30T22:20:05.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.209+0000 7f6de0765700 1 --2- 172.21.15.156:0/402123873 >> v2:172.21.15.156:3300/0 conn(0x7f6dd809c5c0 0x7f6dd8138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.209+0000 7f6de0765700 1 --2- 172.21.15.156:0/402123873 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6dd8131980 0x7f6dd8131d50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.209+0000 7f6de0765700 1 --2- 172.21.15.156:0/402123873 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6dd809bc70 0x7f6dd809c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.209+0000 7f6de0765700 1 -- 172.21.15.156:0/402123873 >> 172.21.15.156:0/402123873 conn(0x7f6dd80a2980 msgr2=0x7f6dd80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:05.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.209+0000 7f6de0765700 1 -- 172.21.15.156:0/402123873 shutdown_connections 2023-09-30T22:20:05.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.209+0000 7f6de0765700 1 -- 172.21.15.156:0/402123873 wait complete. 2023-09-30T22:20:05.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.210+0000 7f6de0765700 1 Processor -- start 2023-09-30T22:20:05.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.210+0000 7f6de0765700 1 -- start start 2023-09-30T22:20:05.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.210+0000 7f6de0765700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6dd809bc70 0x7f6dd811b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:05.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.210+0000 7f6de0765700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dd809c5c0 0x7f6dd811bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:05.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.210+0000 7f6de0765700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6dd8131980 0x7f6dd811c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:05.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.210+0000 7f6de0765700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd811d830 con 0x7f6dd809c5c0 2023-09-30T22:20:05.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.210+0000 7f6de0765700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd811f110 con 0x7f6dd809bc70 2023-09-30T22:20:05.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.210+0000 7f6de0765700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd8130b40 con 0x7f6dd8131980 2023-09-30T22:20:05.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.210+0000 7f6dde501700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6dd809bc70 0x7f6dd811b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:05.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.210+0000 7f6dded02700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6dd8131980 0x7f6dd811c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:05.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.210+0000 7f6dde501700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6dd809bc70 0x7f6dd811b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48504/0 (socket says 172.21.15.156:48504) 2023-09-30T22:20:05.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.210+0000 7f6dde501700 1 -- 172.21.15.156:0/2333987647 learned_addr learned my addr 172.21.15.156:0/2333987647 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:05.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.210+0000 7f6dddd00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dd809c5c0 0x7f6dd811bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:05.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.211+0000 7f6dddd00700 1 -- 172.21.15.156:0/2333987647 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6dd8131980 msgr2=0x7f6dd811c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:05.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.211+0000 7f6dddd00700 1 --2- 172.21.15.156:0/2333987647 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6dd8131980 0x7f6dd811c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.211+0000 7f6dddd00700 1 -- 172.21.15.156:0/2333987647 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6dd809bc70 msgr2=0x7f6dd811b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:05.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.211+0000 7f6dddd00700 1 --2- 172.21.15.156:0/2333987647 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6dd809bc70 0x7f6dd811b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.211+0000 7f6dddd00700 1 -- 172.21.15.156:0/2333987647 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd4009500 con 0x7f6dd809c5c0 2023-09-30T22:20:05.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.211+0000 7f6dded02700 1 --2- 172.21.15.156:0/2333987647 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6dd8131980 0x7f6dd811c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:05.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.211+0000 7f6dddd00700 1 --2- 172.21.15.156:0/2333987647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dd809c5c0 0x7f6dd811bbc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800e840 tx=0x7f6dc800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:05.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.211+0000 7f6dceffd700 1 -- 172.21.15.156:0/2333987647 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8013680 con 0x7f6dd809c5c0 2023-09-30T22:20:05.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.211+0000 7f6dceffd700 1 -- 172.21.15.156:0/2333987647 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc80137e0 con 0x7f6dd809c5c0 2023-09-30T22:20:05.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.211+0000 7f6dceffd700 1 -- 172.21.15.156:0/2333987647 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8013b70 con 0x7f6dd809c5c0 2023-09-30T22:20:05.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.211+0000 7f6de0765700 1 -- 172.21.15.156:0/2333987647 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd812ee60 con 0x7f6dd809c5c0 2023-09-30T22:20:05.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.211+0000 7f6de0765700 1 -- 172.21.15.156:0/2333987647 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd811d200 con 0x7f6dd809c5c0 2023-09-30T22:20:05.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.212+0000 7f6de0765700 1 -- 172.21.15.156:0/2333987647 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd804f2a0 con 0x7f6dd809c5c0 2023-09-30T22:20:05.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.213+0000 7f6dceffd700 1 -- 172.21.15.156:0/2333987647 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6dc8013cd0 con 0x7f6dd809c5c0 2023-09-30T22:20:05.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.213+0000 7f6dceffd700 1 -- 172.21.15.156:0/2333987647 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6dc803fd40 con 0x7f6dd809c5c0 2023-09-30T22:20:05.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:05.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.222+0000 7f6dceffd700 1 -- 172.21.15.156:0/2333987647 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6dc801adc0 con 0x7f6dd809c5c0 2023-09-30T22:20:05.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.238+0000 7fa3467e7700 1 Processor -- start 2023-09-30T22:20:05.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.239+0000 7fa3467e7700 1 -- start start 2023-09-30T22:20:05.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.239+0000 7fa3467e7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa34009e870 0x7fa34009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:05.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.239+0000 7fa3467e7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa340131f40 0x7fa340139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:05.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.239+0000 7fa3467e7700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa34009c970 con 0x7fa34009f180 2023-09-30T22:20:05.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.239+0000 7fa3467e7700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3400a0920 con 0x7fa34009e870 2023-09-30T22:20:05.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.239+0000 7fa3467e7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa34009f9c0 con 0x7fa340131f40 2023-09-30T22:20:05.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.240+0000 7fa33ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa34009e870 0x7fa34009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:05.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.240+0000 7fa344d84700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa340131f40 0x7fa340139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:05.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.240+0000 7fa33ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa34009e870 0x7fa34009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:57186/0 (socket says 172.21.15.156:57186) 2023-09-30T22:20:05.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.240+0000 7fa344d84700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa340131f40 0x7fa340139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48514/0 (socket says 172.21.15.156:48514) 2023-09-30T22:20:05.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.240+0000 7fa33ffff700 1 -- 172.21.15.156:0/2856074242 learned_addr learned my addr 172.21.15.156:0/2856074242 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:05.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.240+0000 7fa33ffff700 1 -- 172.21.15.156:0/2856074242 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa340131f40 msgr2=0x7fa340139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:05.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.240+0000 7fa33ffff700 1 --2- 172.21.15.156:0/2856074242 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa340131f40 0x7fa340139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.240+0000 7fa33ffff700 1 -- 172.21.15.156:0/2856074242 >> v1:172.21.15.156:6789/0 conn(0x7fa34009f180 legacy=0x7fa340131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:05.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.240+0000 7fa33ffff700 1 -- 172.21.15.156:0/2856074242 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34009bab0 con 0x7fa34009e870 2023-09-30T22:20:05.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.240+0000 7fa344d84700 1 --2- 172.21.15.156:0/2856074242 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa340131f40 0x7fa340139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:05.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.240+0000 7fa33ffff700 1 --2- 172.21.15.156:0/2856074242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa34009e870 0x7fa34009ec40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa3300098f0 tx=0x7fa330009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c75d5c2ae72a026b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:05.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.240+0000 7fa33effd700 1 -- 172.21.15.156:0/2856074242 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa330011830 con 0x7fa34009e870 2023-09-30T22:20:05.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.240+0000 7fa33effd700 1 -- 172.21.15.156:0/2856074242 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa330011990 con 0x7fa34009e870 2023-09-30T22:20:05.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.240+0000 7fa33effd700 1 -- 172.21.15.156:0/2856074242 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa330011d20 con 0x7fa34009e870 2023-09-30T22:20:05.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.241+0000 7fa3467e7700 1 -- 172.21.15.156:0/2856074242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa34009e870 msgr2=0x7fa34009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:05.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.241+0000 7fa3467e7700 1 --2- 172.21.15.156:0/2856074242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa34009e870 0x7fa34009ec40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa3300098f0 tx=0x7fa330009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:05.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.241+0000 7fa3467e7700 1 -- 172.21.15.156:0/2856074242 shutdown_connections 2023-09-30T22:20:05.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.241+0000 7fa3467e7700 1 --2- 172.21.15.156:0/2856074242 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa340131f40 0x7fa340139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.241+0000 7fa3467e7700 1 --2- 172.21.15.156:0/2856074242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa34009e870 0x7fa34009ec40 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.241+0000 7fa3467e7700 1 -- 172.21.15.156:0/2856074242 >> 172.21.15.156:0/2856074242 conn(0x7fa3400a4430 msgr2=0x7fa3400a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:05.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.241+0000 7fa3467e7700 1 -- 172.21.15.156:0/2856074242 shutdown_connections 2023-09-30T22:20:05.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.241+0000 7fa3467e7700 1 -- 172.21.15.156:0/2856074242 wait complete. 2023-09-30T22:20:05.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.242+0000 7fa3467e7700 1 Processor -- start 2023-09-30T22:20:05.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.242+0000 7fa3467e7700 1 -- start start 2023-09-30T22:20:05.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.242+0000 7fa3467e7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa34009e870 0x7fa34011e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:05.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.242+0000 7fa3467e7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa34009f180 0x7fa34011e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:05.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.242+0000 7fa3467e7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa340131f40 0x7fa34011ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:05.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.242+0000 7fa3467e7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3401212c0 con 0x7fa34009e870 2023-09-30T22:20:05.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.242+0000 7fa3467e7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa34009dba0 con 0x7fa340131f40 2023-09-30T22:20:05.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.242+0000 7fa3467e7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3400a2e80 con 0x7fa34009f180 2023-09-30T22:20:05.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.243+0000 7fa33ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa34009e870 0x7fa34011e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:05.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.243+0000 7fa33ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa34009e870 0x7fa34011e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:57190/0 (socket says 172.21.15.156:57190) 2023-09-30T22:20:05.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.243+0000 7fa33ffff700 1 -- 172.21.15.156:0/3328831689 learned_addr learned my addr 172.21.15.156:0/3328831689 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:05.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.243+0000 7fa33f7fe700 1 --2- 172.21.15.156:0/3328831689 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa34009f180 0x7fa34011e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:05.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.243+0000 7fa344d84700 1 --2- 172.21.15.156:0/3328831689 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa340131f40 0x7fa34011ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:05.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.243+0000 7fa33ffff700 1 -- 172.21.15.156:0/3328831689 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa34009f180 msgr2=0x7fa34011e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:05.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.243+0000 7fa33ffff700 1 --2- 172.21.15.156:0/3328831689 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa34009f180 0x7fa34011e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.243+0000 7fa33ffff700 1 -- 172.21.15.156:0/3328831689 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa340131f40 msgr2=0x7fa34011ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:05.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.243+0000 7fa33ffff700 1 --2- 172.21.15.156:0/3328831689 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa340131f40 0x7fa34011ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.243+0000 7fa33ffff700 1 -- 172.21.15.156:0/3328831689 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa338009a70 con 0x7fa34009e870 2023-09-30T22:20:05.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.243+0000 7fa33ffff700 1 --2- 172.21.15.156:0/3328831689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa34009e870 0x7fa34011e010 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa330009c40 tx=0x7fa330004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:05.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.243+0000 7fa33cff9700 1 -- 172.21.15.156:0/3328831689 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3300044d0 con 0x7fa34009e870 2023-09-30T22:20:05.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.243+0000 7fa33cff9700 1 -- 172.21.15.156:0/3328831689 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33001e070 con 0x7fa34009e870 2023-09-30T22:20:05.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.243+0000 7fa3467e7700 1 -- 172.21.15.156:0/3328831689 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa330009550 con 0x7fa34009e870 2023-09-30T22:20:05.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.243+0000 7fa33cff9700 1 -- 172.21.15.156:0/3328831689 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3300038e0 con 0x7fa34009e870 2023-09-30T22:20:05.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.243+0000 7fa3467e7700 1 -- 172.21.15.156:0/3328831689 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa340120e70 con 0x7fa34009e870 2023-09-30T22:20:05.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.244+0000 7fa33cff9700 1 -- 172.21.15.156:0/3328831689 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa330003a40 con 0x7fa34009e870 2023-09-30T22:20:05.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.244+0000 7fa3467e7700 1 -- 172.21.15.156:0/3328831689 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa34006ad00 con 0x7fa34009e870 2023-09-30T22:20:05.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.244+0000 7fa33cff9700 1 -- 172.21.15.156:0/3328831689 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa330040410 con 0x7fa34009e870 2023-09-30T22:20:05.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.249+0000 7fa33cff9700 1 -- 172.21.15.156:0/3328831689 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa33002d7d0 con 0x7fa34009e870 2023-09-30T22:20:05.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.313+0000 7ff4b9c57700 1 -- 172.21.15.156:0/1844881097 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff4b409ed10 con 0x7ff4b41343d0 2023-09-30T22:20:05.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.313+0000 7ff49bfff700 1 -- 172.21.15.156:0/1844881097 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff4ac01c6f0 con 0x7ff4b41343d0 2023-09-30T22:20:05.314 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:05.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.315+0000 7ff4b9c57700 1 -- 172.21.15.156:0/1844881097 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4b41343d0 msgr2=0x7ff4b411ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:05.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.315+0000 7ff4b9c57700 1 --2- 172.21.15.156:0/1844881097 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4b41343d0 0x7ff4b411ec70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac014000 tx=0x7ff4ac004ad0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.315+0000 7ff4b9c57700 1 -- 172.21.15.156:0/1844881097 shutdown_connections 2023-09-30T22:20:05.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.315+0000 7ff4b9c57700 1 --2- 172.21.15.156:0/1844881097 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4b41343d0 0x7ff4b411ec70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.315+0000 7ff4b9c57700 1 --2- 172.21.15.156:0/1844881097 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4b409ad40 0x7ff4b411e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.315+0000 7ff4b9c57700 1 --2- 172.21.15.156:0/1844881097 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4b4133f70 0x7ff4b411e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.315+0000 7ff4b9c57700 1 -- 172.21.15.156:0/1844881097 >> 172.21.15.156:0/1844881097 conn(0x7ff4b4099c40 msgr2=0x7ff4b41331d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:05.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.315+0000 7ff4b9c57700 1 -- 172.21.15.156:0/1844881097 shutdown_connections 2023-09-30T22:20:05.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.315+0000 7ff4b9c57700 1 -- 172.21.15.156:0/1844881097 wait complete. 2023-09-30T22:20:05.328 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:05.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.418+0000 7f6de0765700 1 -- 172.21.15.156:0/2333987647 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6dd811e450 con 0x7f6dd809c5c0 2023-09-30T22:20:05.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.419+0000 7f6dceffd700 1 -- 172.21.15.156:0/2333987647 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6dc802a090 con 0x7f6dd809c5c0 2023-09-30T22:20:05.420 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:05.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.421+0000 7f6de0765700 1 -- 172.21.15.156:0/2333987647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dd809c5c0 msgr2=0x7f6dd811bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:05.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.421+0000 7f6de0765700 1 --2- 172.21.15.156:0/2333987647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dd809c5c0 0x7f6dd811bbc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800e840 tx=0x7f6dc800eb50 comp rx=0 tx=0).stop 2023-09-30T22:20:05.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.421+0000 7f6de0765700 1 -- 172.21.15.156:0/2333987647 shutdown_connections 2023-09-30T22:20:05.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.421+0000 7f6de0765700 1 --2- 172.21.15.156:0/2333987647 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6dd8131980 0x7f6dd811c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.421+0000 7f6de0765700 1 --2- 172.21.15.156:0/2333987647 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6dd809bc70 0x7f6dd811b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.421+0000 7f6de0765700 1 --2- 172.21.15.156:0/2333987647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dd809c5c0 0x7f6dd811bbc0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.421+0000 7f6de0765700 1 -- 172.21.15.156:0/2333987647 >> 172.21.15.156:0/2333987647 conn(0x7f6dd80a2980 msgr2=0x7f6dd809f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:05.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.421+0000 7f6de0765700 1 -- 172.21.15.156:0/2333987647 shutdown_connections 2023-09-30T22:20:05.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.421+0000 7f6de0765700 1 -- 172.21.15.156:0/2333987647 wait complete. 2023-09-30T22:20:05.433 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:05.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.444+0000 7fa3467e7700 1 -- 172.21.15.156:0/3328831689 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa3401216d0 con 0x7fa34009e870 2023-09-30T22:20:05.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.445+0000 7fa33cff9700 1 -- 172.21.15.156:0/3328831689 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa330023ba0 con 0x7fa34009e870 2023-09-30T22:20:05.445 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:05.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.447+0000 7fa3467e7700 1 -- 172.21.15.156:0/3328831689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa34009e870 msgr2=0x7fa34011e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:05.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.447+0000 7fa3467e7700 1 --2- 172.21.15.156:0/3328831689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa34009e870 0x7fa34011e010 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa330009c40 tx=0x7fa330004750 comp rx=0 tx=0).stop 2023-09-30T22:20:05.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.447+0000 7fa3467e7700 1 -- 172.21.15.156:0/3328831689 shutdown_connections 2023-09-30T22:20:05.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.447+0000 7fa3467e7700 1 --2- 172.21.15.156:0/3328831689 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa340131f40 0x7fa34011ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.447+0000 7fa3467e7700 1 --2- 172.21.15.156:0/3328831689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa34009e870 0x7fa34011e010 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.447+0000 7fa3467e7700 1 --2- 172.21.15.156:0/3328831689 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa34009f180 0x7fa34011e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:05.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.447+0000 7fa3467e7700 1 -- 172.21.15.156:0/3328831689 >> 172.21.15.156:0/3328831689 conn(0x7fa3400a4430 msgr2=0x7fa34006d240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:05.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.447+0000 7fa3467e7700 1 -- 172.21.15.156:0/3328831689 shutdown_connections 2023-09-30T22:20:05.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:05.447+0000 7fa3467e7700 1 -- 172.21.15.156:0/3328831689 wait complete. 2023-09-30T22:20:05.459 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:06.219 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:06.329 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:06.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.349+0000 7f75f5917700 1 Processor -- start 2023-09-30T22:20:06.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.349+0000 7f75f5917700 1 -- start start 2023-09-30T22:20:06.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.349+0000 7f75f5917700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75f009e950 0x7f75f009ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:06.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.349+0000 7f75f5917700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f75f0131fa0 0x7f75f0139af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:06.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.349+0000 7f75f5917700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f009afb0 con 0x7f75f009f260 2023-09-30T22:20:06.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.349+0000 7f75f5917700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f00a0970 con 0x7f75f0131fa0 2023-09-30T22:20:06.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.349+0000 7f75f5917700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f00a0320 con 0x7f75f009e950 2023-09-30T22:20:06.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.350+0000 7f75ef7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f75f0131fa0 0x7f75f0139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:06.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.350+0000 7f75ef7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f75f0131fa0 0x7f75f0139af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:57204/0 (socket says 172.21.15.156:57204) 2023-09-30T22:20:06.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.350+0000 7f75ee7fc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f75f009f260 0x7f75f0131890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58334/0 (socket says 172.21.15.156:58334) 2023-09-30T22:20:06.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.350+0000 7f75ef7fe700 1 -- 172.21.15.156:0/3033585861 learned_addr learned my addr 172.21.15.156:0/3033585861 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:06.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.350+0000 7f75eeffd700 1 --2- 172.21.15.156:0/3033585861 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75f009e950 0x7f75f009ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:06.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.350+0000 7f75eeffd700 1 -- 172.21.15.156:0/3033585861 >> v2:172.21.15.156:3300/0 conn(0x7f75f0131fa0 msgr2=0x7f75f0139af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:06.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.350+0000 7f75eeffd700 1 --2- 172.21.15.156:0/3033585861 >> v2:172.21.15.156:3300/0 conn(0x7f75f0131fa0 0x7f75f0139af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.350+0000 7f75eeffd700 1 -- 172.21.15.156:0/3033585861 >> v1:172.21.15.156:6789/0 conn(0x7f75f009f260 legacy=0x7f75f0131890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:06.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.350+0000 7f75eeffd700 1 -- 172.21.15.156:0/3033585861 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f00a0750 con 0x7f75f009e950 2023-09-30T22:20:06.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.350+0000 7f75edffb700 1 -- 172.21.15.156:0/3033585861 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160047993 0 0) 0x7f75f009afb0 con 0x7f75f009f260 2023-09-30T22:20:06.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.350+0000 7f75ef7fe700 1 --2- 172.21.15.156:0/3033585861 >> v2:172.21.15.156:3300/0 conn(0x7f75f0131fa0 0x7f75f0139af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:06.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.350+0000 7f75eeffd700 1 --2- 172.21.15.156:0/3033585861 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75f009e950 0x7f75f009ed20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f75e0009820 tx=0x7f75e0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa3195a411eae92c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:06.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.350+0000 7f75edffb700 1 -- 172.21.15.156:0/3033585861 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e0005e30 con 0x7f75f009e950 2023-09-30T22:20:06.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.350+0000 7f75edffb700 1 -- 172.21.15.156:0/3033585861 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e0006030 con 0x7f75f009e950 2023-09-30T22:20:06.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.350+0000 7f75edffb700 1 -- 172.21.15.156:0/3033585861 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e00063c0 con 0x7f75f009e950 2023-09-30T22:20:06.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.351+0000 7f75f5917700 1 -- 172.21.15.156:0/3033585861 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75f009e950 msgr2=0x7f75f009ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:06.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.351+0000 7f75f5917700 1 --2- 172.21.15.156:0/3033585861 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75f009e950 0x7f75f009ed20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f75e0009820 tx=0x7f75e0009b30 comp rx=0 tx=0).stop 2023-09-30T22:20:06.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.351+0000 7f75f5917700 1 -- 172.21.15.156:0/3033585861 shutdown_connections 2023-09-30T22:20:06.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.351+0000 7f75f5917700 1 --2- 172.21.15.156:0/3033585861 >> v2:172.21.15.156:3300/0 conn(0x7f75f0131fa0 0x7f75f0139af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.351+0000 7f75f5917700 1 --2- 172.21.15.156:0/3033585861 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75f009e950 0x7f75f009ed20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.351+0000 7f75f5917700 1 -- 172.21.15.156:0/3033585861 >> 172.21.15.156:0/3033585861 conn(0x7f75f00a0f70 msgr2=0x7f75f00a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:06.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.351+0000 7f75f5917700 1 -- 172.21.15.156:0/3033585861 shutdown_connections 2023-09-30T22:20:06.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.351+0000 7f75f5917700 1 -- 172.21.15.156:0/3033585861 wait complete. 2023-09-30T22:20:06.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.352+0000 7f75f5917700 1 Processor -- start 2023-09-30T22:20:06.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.352+0000 7f75f5917700 1 -- start start 2023-09-30T22:20:06.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.353+0000 7f75f5917700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75f009e950 0x7f75f0120670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:06.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.353+0000 7f75f5917700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75f009f260 0x7f75f0120bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:06.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.353+0000 7f75f5917700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75f0131fa0 0x7f75f01210f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:06.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.353+0000 7f75f5917700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f0123f10 con 0x7f75f0131fa0 2023-09-30T22:20:06.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.353+0000 7f75f5917700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f0122aa0 con 0x7f75f009f260 2023-09-30T22:20:06.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.353+0000 7f75f5917700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75f0123b70 con 0x7f75f009e950 2023-09-30T22:20:06.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.353+0000 7f75eeffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75f009e950 0x7f75f0120670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:06.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.353+0000 7f75eeffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75f009e950 0x7f75f0120670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52154/0 (socket says 172.21.15.156:52154) 2023-09-30T22:20:06.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.353+0000 7f75eeffd700 1 -- 172.21.15.156:0/1851903366 learned_addr learned my addr 172.21.15.156:0/1851903366 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:06.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.353+0000 7f75ee7fc700 1 --2- 172.21.15.156:0/1851903366 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75f009f260 0x7f75f0120bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:06.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.353+0000 7f75ef7fe700 1 --2- 172.21.15.156:0/1851903366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75f0131fa0 0x7f75f01210f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:06.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.353+0000 7f75eeffd700 1 -- 172.21.15.156:0/1851903366 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75f009f260 msgr2=0x7f75f0120bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:06.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.353+0000 7f75eeffd700 1 --2- 172.21.15.156:0/1851903366 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75f009f260 0x7f75f0120bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.353+0000 7f75eeffd700 1 -- 172.21.15.156:0/1851903366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75f0131fa0 msgr2=0x7f75f01210f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:06.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.353+0000 7f75eeffd700 1 --2- 172.21.15.156:0/1851903366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75f0131fa0 0x7f75f01210f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.354+0000 7f75eeffd700 1 -- 172.21.15.156:0/1851903366 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e8009b30 con 0x7f75f009e950 2023-09-30T22:20:06.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.354+0000 7f75ef7fe700 1 --2- 172.21.15.156:0/1851903366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75f0131fa0 0x7f75f01210f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:06.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.354+0000 7f75eeffd700 1 --2- 172.21.15.156:0/1851903366 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75f009e950 0x7f75f0120670 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f75f00a0460 tx=0x7f75e0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:06.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.354+0000 7f75d7fff700 1 -- 172.21.15.156:0/1851903366 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e0006900 con 0x7f75f009e950 2023-09-30T22:20:06.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.354+0000 7f75d7fff700 1 -- 172.21.15.156:0/1851903366 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e0020070 con 0x7f75f009e950 2023-09-30T22:20:06.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.354+0000 7f75f5917700 1 -- 172.21.15.156:0/1851903366 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e0009430 con 0x7f75f009e950 2023-09-30T22:20:06.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.354+0000 7f75d7fff700 1 -- 172.21.15.156:0/1851903366 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e0004280 con 0x7f75f009e950 2023-09-30T22:20:06.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.354+0000 7f75f5917700 1 -- 172.21.15.156:0/1851903366 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f009ba00 con 0x7f75f009e950 2023-09-30T22:20:06.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.355+0000 7f75d7fff700 1 -- 172.21.15.156:0/1851903366 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f75e0022030 con 0x7f75f009e950 2023-09-30T22:20:06.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.355+0000 7f75d7fff700 1 -- 172.21.15.156:0/1851903366 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f75e0040b30 con 0x7f75f009e950 2023-09-30T22:20:06.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.355+0000 7f75f5917700 1 -- 172.21.15.156:0/1851903366 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f00a4dc0 con 0x7f75f009e950 2023-09-30T22:20:06.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.360+0000 7f75d7fff700 1 -- 172.21.15.156:0/1851903366 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f75e002e440 con 0x7f75f009e950 2023-09-30T22:20:06.434 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:06.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.456+0000 7f0ee13a1700 1 Processor -- start 2023-09-30T22:20:06.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.456+0000 7f0ee13a1700 1 -- start start 2023-09-30T22:20:06.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.457+0000 7f0ee13a1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0edc09bb60 0x7f0edc09e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:06.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.457+0000 7f0ee13a1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0edc12cf70 0x7f0edc130010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:06.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.457+0000 7f0ee13a1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0edc130550 0x7f0edc1309d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:06.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.457+0000 7f0ee13a1700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0edc09bf30 con 0x7f0edc09bb60 2023-09-30T22:20:06.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.457+0000 7f0ee13a1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc09a8e0 con 0x7f0edc130550 2023-09-30T22:20:06.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.457+0000 7f0ee13a1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc09b0a0 con 0x7f0edc12cf70 2023-09-30T22:20:06.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.457+0000 7f0edbfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0edc09bb60 0x7f0edc09e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:06.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.457+0000 7f0edbfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0edc09bb60 0x7f0edc09e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:57224/0 (socket says 172.21.15.156:57224) 2023-09-30T22:20:06.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.457+0000 7f0edbfff700 1 -- 172.21.15.156:0/1560981064 learned_addr learned my addr 172.21.15.156:0/1560981064 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:06.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.457+0000 7f0edb7fe700 1 --2- 172.21.15.156:0/1560981064 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0edc12cf70 0x7f0edc130010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:06.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.457+0000 7f0ee0ba0700 1 --2- 172.21.15.156:0/1560981064 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0edc130550 0x7f0edc1309d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:06.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.457+0000 7f0edbfff700 1 -- 172.21.15.156:0/1560981064 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0edc12cf70 msgr2=0x7f0edc130010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:06.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.457+0000 7f0edbfff700 1 --2- 172.21.15.156:0/1560981064 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0edc12cf70 0x7f0edc130010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.457+0000 7f0edbfff700 1 -- 172.21.15.156:0/1560981064 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0edc130550 msgr2=0x7f0edc1309d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:06.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.457+0000 7f0edbfff700 1 --2- 172.21.15.156:0/1560981064 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0edc130550 0x7f0edc1309d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.457+0000 7f0edbfff700 1 -- 172.21.15.156:0/1560981064 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0edc09aaa0 con 0x7f0edc09bb60 2023-09-30T22:20:06.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.457+0000 7f0edbfff700 1 --2- 172.21.15.156:0/1560981064 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0edc09bb60 0x7f0edc09e690 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00bb90 tx=0x7f0ecc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6feb235dad44092 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:06.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.457+0000 7f0edaffd700 1 -- 172.21.15.156:0/1560981064 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc00dd30 con 0x7f0edc09bb60 2023-09-30T22:20:06.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.457+0000 7f0edaffd700 1 -- 172.21.15.156:0/1560981064 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc00de90 con 0x7f0edc09bb60 2023-09-30T22:20:06.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.458+0000 7f0edaffd700 1 -- 172.21.15.156:0/1560981064 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc010690 con 0x7f0edc09bb60 2023-09-30T22:20:06.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.458+0000 7f0ee13a1700 1 -- 172.21.15.156:0/1560981064 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0edc09bb60 msgr2=0x7f0edc09e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:06.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.458+0000 7f0ee13a1700 1 --2- 172.21.15.156:0/1560981064 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0edc09bb60 0x7f0edc09e690 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00bb90 tx=0x7f0ecc00bea0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.458+0000 7f0ee13a1700 1 -- 172.21.15.156:0/1560981064 shutdown_connections 2023-09-30T22:20:06.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.458+0000 7f0ee13a1700 1 --2- 172.21.15.156:0/1560981064 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0edc130550 0x7f0edc1309d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.458+0000 7f0ee13a1700 1 --2- 172.21.15.156:0/1560981064 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0edc09bb60 0x7f0edc09e690 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.458+0000 7f0ee13a1700 1 --2- 172.21.15.156:0/1560981064 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0edc12cf70 0x7f0edc130010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.458+0000 7f0ee13a1700 1 -- 172.21.15.156:0/1560981064 >> 172.21.15.156:0/1560981064 conn(0x7f0edc0a2d80 msgr2=0x7f0edc0a3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:06.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.458+0000 7f0ee13a1700 1 -- 172.21.15.156:0/1560981064 shutdown_connections 2023-09-30T22:20:06.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.458+0000 7f0ee13a1700 1 -- 172.21.15.156:0/1560981064 wait complete. 2023-09-30T22:20:06.463 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:06.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.460+0000 7f0ee13a1700 1 Processor -- start 2023-09-30T22:20:06.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.460+0000 7f0ee13a1700 1 -- start start 2023-09-30T22:20:06.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.460+0000 7f0ee13a1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0edc09bb60 0x7f0edc1193d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:06.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.460+0000 7f0ee13a1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0edc12cf70 0x7f0edc119910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:06.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.460+0000 7f0ee13a1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0edc130550 0x7f0edc119e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:06.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.460+0000 7f0ee13a1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc11a820 con 0x7f0edc09bb60 2023-09-30T22:20:06.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.460+0000 7f0ee13a1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc12a0d0 con 0x7f0edc12cf70 2023-09-30T22:20:06.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.460+0000 7f0ee13a1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc0722f0 con 0x7f0edc130550 2023-09-30T22:20:06.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.460+0000 7f0edbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0edc09bb60 0x7f0edc1193d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:06.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.460+0000 7f0edbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0edc09bb60 0x7f0edc1193d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:57226/0 (socket says 172.21.15.156:57226) 2023-09-30T22:20:06.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.460+0000 7f0edbfff700 1 -- 172.21.15.156:0/580752282 learned_addr learned my addr 172.21.15.156:0/580752282 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:06.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.460+0000 7f0ee0ba0700 1 --2- 172.21.15.156:0/580752282 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0edc130550 0x7f0edc119e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:06.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.460+0000 7f0edb7fe700 1 --2- 172.21.15.156:0/580752282 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0edc12cf70 0x7f0edc119910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:06.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.461+0000 7f0edbfff700 1 -- 172.21.15.156:0/580752282 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0edc130550 msgr2=0x7f0edc119e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:06.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.461+0000 7f0edbfff700 1 --2- 172.21.15.156:0/580752282 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0edc130550 0x7f0edc119e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.461+0000 7f0edbfff700 1 -- 172.21.15.156:0/580752282 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0edc12cf70 msgr2=0x7f0edc119910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:06.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.461+0000 7f0edbfff700 1 --2- 172.21.15.156:0/580752282 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0edc12cf70 0x7f0edc119910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.461+0000 7f0edbfff700 1 -- 172.21.15.156:0/580752282 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ecc00b7f0 con 0x7f0edc09bb60 2023-09-30T22:20:06.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.461+0000 7f0edbfff700 1 --2- 172.21.15.156:0/580752282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0edc09bb60 0x7f0edc1193d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00d5d0 tx=0x7f0ecc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:06.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.461+0000 7f0ed8ff9700 1 -- 172.21.15.156:0/580752282 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc01f070 con 0x7f0edc09bb60 2023-09-30T22:20:06.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.461+0000 7f0ed8ff9700 1 -- 172.21.15.156:0/580752282 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc0038b0 con 0x7f0edc09bb60 2023-09-30T22:20:06.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.461+0000 7f0ee13a1700 1 -- 172.21.15.156:0/580752282 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0edc09d680 con 0x7f0edc09bb60 2023-09-30T22:20:06.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.461+0000 7f0ed8ff9700 1 -- 172.21.15.156:0/580752282 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc003c80 con 0x7f0edc09bb60 2023-09-30T22:20:06.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.461+0000 7f0ee13a1700 1 -- 172.21.15.156:0/580752282 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0edc11b9b0 con 0x7f0edc09bb60 2023-09-30T22:20:06.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.462+0000 7f0ed8ff9700 1 -- 172.21.15.156:0/580752282 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ecc019400 con 0x7f0edc09bb60 2023-09-30T22:20:06.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.462+0000 7f0ee13a1700 1 -- 172.21.15.156:0/580752282 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0edc04f2a0 con 0x7f0edc09bb60 2023-09-30T22:20:06.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.462+0000 7f0ed8ff9700 1 -- 172.21.15.156:0/580752282 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0ecc042510 con 0x7f0edc09bb60 2023-09-30T22:20:06.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.467+0000 7f0ed8ff9700 1 -- 172.21.15.156:0/580752282 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ecc003de0 con 0x7f0edc09bb60 2023-09-30T22:20:06.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.556+0000 7f75f5917700 1 -- 172.21.15.156:0/1851903366 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f75f009da40 con 0x7f75f009e950 2023-09-30T22:20:06.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.557+0000 7f75d7fff700 1 -- 172.21.15.156:0/1851903366 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f75e001b410 con 0x7f75f009e950 2023-09-30T22:20:06.558 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:06.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.559+0000 7f75f5917700 1 -- 172.21.15.156:0/1851903366 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75f009e950 msgr2=0x7f75f0120670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:06.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.559+0000 7f75f5917700 1 --2- 172.21.15.156:0/1851903366 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75f009e950 0x7f75f0120670 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f75f00a0460 tx=0x7f75e0004750 comp rx=0 tx=0).stop 2023-09-30T22:20:06.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.559+0000 7f75f5917700 1 -- 172.21.15.156:0/1851903366 shutdown_connections 2023-09-30T22:20:06.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.559+0000 7f75f5917700 1 --2- 172.21.15.156:0/1851903366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75f0131fa0 0x7f75f01210f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.559+0000 7f75f5917700 1 --2- 172.21.15.156:0/1851903366 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75f009e950 0x7f75f0120670 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.559+0000 7f75f5917700 1 --2- 172.21.15.156:0/1851903366 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75f009f260 0x7f75f0120bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.559+0000 7f75f5917700 1 -- 172.21.15.156:0/1851903366 >> 172.21.15.156:0/1851903366 conn(0x7f75f00a0f70 msgr2=0x7f75f011a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:06.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.559+0000 7f75f5917700 1 -- 172.21.15.156:0/1851903366 shutdown_connections 2023-09-30T22:20:06.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.559+0000 7f75f5917700 1 -- 172.21.15.156:0/1851903366 wait complete. 2023-09-30T22:20:06.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.563+0000 7f627fe55700 1 Processor -- start 2023-09-30T22:20:06.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.563+0000 7f627fe55700 1 -- start start 2023-09-30T22:20:06.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.564+0000 7f627fe55700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f627812cb80 0x7f627812cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:06.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.564+0000 7f627fe55700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6278130630 0x7f6278137df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:06.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.564+0000 7f627fe55700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627809b700 con 0x7f627812fab0 2023-09-30T22:20:06.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.564+0000 7f627fe55700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627809c350 con 0x7f627812cb80 2023-09-30T22:20:06.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.564+0000 7f627fe55700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f627809abf0 con 0x7f6278130630 2023-09-30T22:20:06.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.564+0000 7f627e3f2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6278130630 0x7f6278137df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:06.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.564+0000 7f627e3f2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6278130630 0x7f6278137df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52190/0 (socket says 172.21.15.156:52190) 2023-09-30T22:20:06.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.564+0000 7f627e3f2700 1 -- 172.21.15.156:0/1975918398 learned_addr learned my addr 172.21.15.156:0/1975918398 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:06.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.564+0000 7f627dbf1700 1 --2- 172.21.15.156:0/1975918398 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f627812cb80 0x7f627812cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:06.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.564+0000 7f627e3f2700 1 -- 172.21.15.156:0/1975918398 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f627812cb80 msgr2=0x7f627812cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:06.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.564+0000 7f627e3f2700 1 --2- 172.21.15.156:0/1975918398 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f627812cb80 0x7f627812cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.564+0000 7f627e3f2700 1 -- 172.21.15.156:0/1975918398 >> v1:172.21.15.156:6789/0 conn(0x7f627812fab0 legacy=0x7f627812ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:06.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.564+0000 7f627e3f2700 1 -- 172.21.15.156:0/1975918398 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627812d490 con 0x7f6278130630 2023-09-30T22:20:06.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.565+0000 7f627e3f2700 1 --2- 172.21.15.156:0/1975918398 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6278130630 0x7f6278137df0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6270009e80 tx=0x7f627000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ba425a69cb7c5b1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:06.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.565+0000 7f627cbef700 1 -- 172.21.15.156:0/1975918398 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627000e070 con 0x7f6278130630 2023-09-30T22:20:06.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.565+0000 7f627cbef700 1 -- 172.21.15.156:0/1975918398 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6270003a20 con 0x7f6278130630 2023-09-30T22:20:06.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.565+0000 7f627cbef700 1 -- 172.21.15.156:0/1975918398 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6270003dd0 con 0x7f6278130630 2023-09-30T22:20:06.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.565+0000 7f627fe55700 1 -- 172.21.15.156:0/1975918398 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6278130630 msgr2=0x7f6278137df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:06.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.565+0000 7f627fe55700 1 --2- 172.21.15.156:0/1975918398 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6278130630 0x7f6278137df0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6270009e80 tx=0x7f627000b330 comp rx=0 tx=0).stop 2023-09-30T22:20:06.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.566+0000 7f627fe55700 1 -- 172.21.15.156:0/1975918398 shutdown_connections 2023-09-30T22:20:06.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.566+0000 7f627fe55700 1 --2- 172.21.15.156:0/1975918398 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f627812cb80 0x7f627812cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.566+0000 7f627fe55700 1 --2- 172.21.15.156:0/1975918398 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6278130630 0x7f6278137df0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.566+0000 7f627fe55700 1 -- 172.21.15.156:0/1975918398 >> 172.21.15.156:0/1975918398 conn(0x7f62780a2eb0 msgr2=0x7f627809eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:06.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.566+0000 7f627fe55700 1 -- 172.21.15.156:0/1975918398 shutdown_connections 2023-09-30T22:20:06.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.566+0000 7f627fe55700 1 -- 172.21.15.156:0/1975918398 wait complete. 2023-09-30T22:20:06.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.567+0000 7f627fe55700 1 Processor -- start 2023-09-30T22:20:06.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.567+0000 7f627fe55700 1 -- start start 2023-09-30T22:20:06.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.568+0000 7f627fe55700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f627812cb80 0x7f6278071a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:06.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.568+0000 7f627fe55700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f627812fab0 0x7f6278071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:06.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.568+0000 7f627fe55700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6278130630 0x7f62781c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:06.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.568+0000 7f627fe55700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6278127640 con 0x7f627812fab0 2023-09-30T22:20:06.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.568+0000 7f627fe55700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6278127450 con 0x7f6278130630 2023-09-30T22:20:06.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.568+0000 7f627fe55700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6278128b60 con 0x7f627812cb80 2023-09-30T22:20:06.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.568+0000 7f627d3f0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f627812fab0 0x7f6278071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:06.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.568+0000 7f627d3f0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f627812fab0 0x7f6278071fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:57232/0 (socket says 172.21.15.156:57232) 2023-09-30T22:20:06.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.568+0000 7f627d3f0700 1 -- 172.21.15.156:0/3274844730 learned_addr learned my addr 172.21.15.156:0/3274844730 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:06.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.568+0000 7f627dbf1700 1 --2- 172.21.15.156:0/3274844730 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f627812cb80 0x7f6278071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:06.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.568+0000 7f627e3f2700 1 --2- 172.21.15.156:0/3274844730 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6278130630 0x7f62781c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:06.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.568+0000 7f627dbf1700 1 -- 172.21.15.156:0/3274844730 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6278130630 msgr2=0x7f62781c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:06.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.568+0000 7f627dbf1700 1 --2- 172.21.15.156:0/3274844730 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6278130630 0x7f62781c4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.568+0000 7f627dbf1700 1 -- 172.21.15.156:0/3274844730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f627812fab0 msgr2=0x7f6278071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:06.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.568+0000 7f627dbf1700 1 --2- 172.21.15.156:0/3274844730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f627812fab0 0x7f6278071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.568+0000 7f627dbf1700 1 -- 172.21.15.156:0/3274844730 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6270009b30 con 0x7f627812cb80 2023-09-30T22:20:06.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.568+0000 7f627dbf1700 1 --2- 172.21.15.156:0/3274844730 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f627812cb80 0x7f6278071a80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f627400a500 tx=0x7f627400a810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:06.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.569+0000 7f626e7fc700 1 -- 172.21.15.156:0/3274844730 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627401b5f0 con 0x7f627812cb80 2023-09-30T22:20:06.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.569+0000 7f626e7fc700 1 -- 172.21.15.156:0/3274844730 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627401b750 con 0x7f627812cb80 2023-09-30T22:20:06.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.569+0000 7f626e7fc700 1 -- 172.21.15.156:0/3274844730 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627401bac0 con 0x7f627812cb80 2023-09-30T22:20:06.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.569+0000 7f627fe55700 1 -- 172.21.15.156:0/3274844730 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f627812f5b0 con 0x7f627812cb80 2023-09-30T22:20:06.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.569+0000 7f627fe55700 1 -- 172.21.15.156:0/3274844730 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f627809b0a0 con 0x7f627812cb80 2023-09-30T22:20:06.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.569+0000 7f626e7fc700 1 -- 172.21.15.156:0/3274844730 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f627401bc20 con 0x7f627812cb80 2023-09-30T22:20:06.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.570+0000 7f626e7fc700 1 -- 172.21.15.156:0/3274844730 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6274043ae0 con 0x7f627812cb80 2023-09-30T22:20:06.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.570+0000 7f627fe55700 1 -- 172.21.15.156:0/3274844730 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f627812e700 con 0x7f627812cb80 2023-09-30T22:20:06.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.575+0000 7f626e7fc700 1 -- 172.21.15.156:0/3274844730 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f627400be30 con 0x7f627812cb80 2023-09-30T22:20:06.579 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:06.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.596+0000 7f6895e53700 1 Processor -- start 2023-09-30T22:20:06.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.596+0000 7f6895e53700 1 -- start start 2023-09-30T22:20:06.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.597+0000 7f6895e53700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f689009e870 0x7f689009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:06.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.597+0000 7f6895e53700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f689009f180 0x7f6890131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:06.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.597+0000 7f6895e53700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f689009c970 con 0x7f6890131d70 2023-09-30T22:20:06.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.597+0000 7f6895e53700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68900a0920 con 0x7f689009f180 2023-09-30T22:20:06.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.597+0000 7f6895e53700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f689009f9c0 con 0x7f689009e870 2023-09-30T22:20:06.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.597+0000 7f688f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f689009e870 0x7f689009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:06.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.597+0000 7f688ffff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6890131d70 0x7f6890138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58358/0 (socket says 172.21.15.156:58358) 2023-09-30T22:20:06.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.597+0000 7f688ffff700 1 -- 172.21.15.156:0/3718678845 learned_addr learned my addr 172.21.15.156:0/3718678845 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:06.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.597+0000 7f688effd700 1 --2- 172.21.15.156:0/3718678845 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f689009f180 0x7f6890131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:06.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.597+0000 7f688f7fe700 1 -- 172.21.15.156:0/3718678845 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f689009f180 msgr2=0x7f6890131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:06.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.597+0000 7f688f7fe700 1 --2- 172.21.15.156:0/3718678845 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f689009f180 0x7f6890131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.597+0000 7f688f7fe700 1 -- 172.21.15.156:0/3718678845 >> v1:172.21.15.156:6789/0 conn(0x7f6890131d70 legacy=0x7f6890138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:06.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.597+0000 7f688f7fe700 1 -- 172.21.15.156:0/3718678845 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689009bab0 con 0x7f689009e870 2023-09-30T22:20:06.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.597+0000 7f688effd700 1 --2- 172.21.15.156:0/3718678845 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f689009f180 0x7f6890131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:06.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.598+0000 7f688f7fe700 1 --2- 172.21.15.156:0/3718678845 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f689009e870 0x7f689009ec40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6880009870 tx=0x7f6880009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdf66db003609b83 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:06.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.598+0000 7f688e7fc700 1 -- 172.21.15.156:0/3718678845 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6880011830 con 0x7f689009e870 2023-09-30T22:20:06.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.598+0000 7f688e7fc700 1 -- 172.21.15.156:0/3718678845 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6880011990 con 0x7f689009e870 2023-09-30T22:20:06.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.598+0000 7f688e7fc700 1 -- 172.21.15.156:0/3718678845 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6880011d20 con 0x7f689009e870 2023-09-30T22:20:06.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.599+0000 7f6895e53700 1 -- 172.21.15.156:0/3718678845 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f689009e870 msgr2=0x7f689009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:06.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.599+0000 7f6895e53700 1 --2- 172.21.15.156:0/3718678845 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f689009e870 0x7f689009ec40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6880009870 tx=0x7f6880009b80 comp rx=0 tx=0).stop 2023-09-30T22:20:06.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.599+0000 7f6895e53700 1 -- 172.21.15.156:0/3718678845 shutdown_connections 2023-09-30T22:20:06.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.599+0000 7f6895e53700 1 --2- 172.21.15.156:0/3718678845 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f689009e870 0x7f689009ec40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.599+0000 7f6895e53700 1 --2- 172.21.15.156:0/3718678845 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f689009f180 0x7f6890131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.599+0000 7f6895e53700 1 -- 172.21.15.156:0/3718678845 >> 172.21.15.156:0/3718678845 conn(0x7f68900a4430 msgr2=0x7f68900a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:06.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.599+0000 7f6895e53700 1 -- 172.21.15.156:0/3718678845 shutdown_connections 2023-09-30T22:20:06.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.599+0000 7f6895e53700 1 -- 172.21.15.156:0/3718678845 wait complete. 2023-09-30T22:20:06.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.600+0000 7f6895e53700 1 Processor -- start 2023-09-30T22:20:06.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.600+0000 7f6895e53700 1 -- start start 2023-09-30T22:20:06.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.601+0000 7f6895e53700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f689009e870 0x7f6890120390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:06.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.601+0000 7f6895e53700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f689009f180 0x7f68901208d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:06.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.601+0000 7f6895e53700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6890131d70 0x7f6890120e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:06.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.601+0000 7f6895e53700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6890123eb0 con 0x7f6890131d70 2023-09-30T22:20:06.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.601+0000 7f6895e53700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689009dba0 con 0x7f689009f180 2023-09-30T22:20:06.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.601+0000 7f6895e53700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f689009b160 con 0x7f689009e870 2023-09-30T22:20:06.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.601+0000 7f688f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f689009e870 0x7f6890120390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:06.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.601+0000 7f688f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f689009e870 0x7f6890120390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52210/0 (socket says 172.21.15.156:52210) 2023-09-30T22:20:06.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.601+0000 7f688f7fe700 1 -- 172.21.15.156:0/3890356323 learned_addr learned my addr 172.21.15.156:0/3890356323 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:06.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.601+0000 7f688effd700 1 --2- 172.21.15.156:0/3890356323 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f689009f180 0x7f68901208d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:06.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.601+0000 7f688ffff700 1 --2- 172.21.15.156:0/3890356323 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6890131d70 0x7f6890120e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:06.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.601+0000 7f688effd700 1 -- 172.21.15.156:0/3890356323 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f689009e870 msgr2=0x7f6890120390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:06.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.601+0000 7f688effd700 1 --2- 172.21.15.156:0/3890356323 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f689009e870 0x7f6890120390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.601+0000 7f688effd700 1 -- 172.21.15.156:0/3890356323 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6890131d70 msgr2=0x7f6890120e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:06.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.601+0000 7f688effd700 1 --2- 172.21.15.156:0/3890356323 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6890131d70 0x7f6890120e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.601+0000 7f688effd700 1 -- 172.21.15.156:0/3890356323 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68840094a0 con 0x7f689009f180 2023-09-30T22:20:06.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.601+0000 7f688f7fe700 1 --2- 172.21.15.156:0/3890356323 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f689009e870 0x7f6890120390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:06.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.602+0000 7f688effd700 1 --2- 172.21.15.156:0/3890356323 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f689009f180 0x7f68901208d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f688400e980 tx=0x7f688400ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:06.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.602+0000 7f6877fff700 1 -- 172.21.15.156:0/3890356323 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688400c690 con 0x7f689009f180 2023-09-30T22:20:06.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.602+0000 7f6877fff700 1 -- 172.21.15.156:0/3890356323 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688400c7f0 con 0x7f689009f180 2023-09-30T22:20:06.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.602+0000 7f6877fff700 1 -- 172.21.15.156:0/3890356323 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688400cb80 con 0x7f689009f180 2023-09-30T22:20:06.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.602+0000 7f6895e53700 1 -- 172.21.15.156:0/3890356323 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68800094a0 con 0x7f689009f180 2023-09-30T22:20:06.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.602+0000 7f6895e53700 1 -- 172.21.15.156:0/3890356323 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6890130eb0 con 0x7f689009f180 2023-09-30T22:20:06.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.603+0000 7f6877fff700 1 -- 172.21.15.156:0/3890356323 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f688400cce0 con 0x7f689009f180 2023-09-30T22:20:06.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.603+0000 7f6895e53700 1 -- 172.21.15.156:0/3890356323 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f689004f2a0 con 0x7f689009f180 2023-09-30T22:20:06.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.603+0000 7f6877fff700 1 -- 172.21.15.156:0/3890356323 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f688403f6e0 con 0x7f689009f180 2023-09-30T22:20:06.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.607+0000 7f6877fff700 1 -- 172.21.15.156:0/3890356323 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f688401bba0 con 0x7f689009f180 2023-09-30T22:20:06.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.676+0000 7f0ee13a1700 1 -- 172.21.15.156:0/580752282 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0edc09acc0 con 0x7f0edc09bb60 2023-09-30T22:20:06.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.676+0000 7f0ed8ff9700 1 -- 172.21.15.156:0/580752282 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0ecc028090 con 0x7f0edc09bb60 2023-09-30T22:20:06.677 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:06.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.678+0000 7f0ee13a1700 1 -- 172.21.15.156:0/580752282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0edc09bb60 msgr2=0x7f0edc1193d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:06.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.678+0000 7f0ee13a1700 1 --2- 172.21.15.156:0/580752282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0edc09bb60 0x7f0edc1193d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00d5d0 tx=0x7f0ecc004750 comp rx=0 tx=0).stop 2023-09-30T22:20:06.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.678+0000 7f0ee13a1700 1 -- 172.21.15.156:0/580752282 shutdown_connections 2023-09-30T22:20:06.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.678+0000 7f0ee13a1700 1 --2- 172.21.15.156:0/580752282 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0edc130550 0x7f0edc119e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.678+0000 7f0ee13a1700 1 --2- 172.21.15.156:0/580752282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0edc09bb60 0x7f0edc1193d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.678+0000 7f0ee13a1700 1 --2- 172.21.15.156:0/580752282 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0edc12cf70 0x7f0edc119910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.678+0000 7f0ee13a1700 1 -- 172.21.15.156:0/580752282 >> 172.21.15.156:0/580752282 conn(0x7f0edc0a2d80 msgr2=0x7f0edc09c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:06.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.679+0000 7f0ee13a1700 1 -- 172.21.15.156:0/580752282 shutdown_connections 2023-09-30T22:20:06.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.679+0000 7f0ee13a1700 1 -- 172.21.15.156:0/580752282 wait complete. 2023-09-30T22:20:06.691 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:06.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.770+0000 7f627fe55700 1 -- 172.21.15.156:0/3274844730 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f627804f2a0 con 0x7f627812cb80 2023-09-30T22:20:06.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.770+0000 7f626e7fc700 1 -- 172.21.15.156:0/3274844730 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6274022e60 con 0x7f627812cb80 2023-09-30T22:20:06.771 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:06.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.773+0000 7f627fe55700 1 -- 172.21.15.156:0/3274844730 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f627812cb80 msgr2=0x7f6278071a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:06.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.773+0000 7f627fe55700 1 --2- 172.21.15.156:0/3274844730 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f627812cb80 0x7f6278071a80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f627400a500 tx=0x7f627400a810 comp rx=0 tx=0).stop 2023-09-30T22:20:06.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.773+0000 7f627fe55700 1 -- 172.21.15.156:0/3274844730 shutdown_connections 2023-09-30T22:20:06.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.773+0000 7f627fe55700 1 --2- 172.21.15.156:0/3274844730 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6278130630 0x7f62781c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.773+0000 7f627fe55700 1 --2- 172.21.15.156:0/3274844730 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f627812cb80 0x7f6278071a80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.773+0000 7f627fe55700 1 --2- 172.21.15.156:0/3274844730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f627812fab0 0x7f6278071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.773+0000 7f627fe55700 1 -- 172.21.15.156:0/3274844730 >> 172.21.15.156:0/3274844730 conn(0x7f62780a2eb0 msgr2=0x7f627809cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:06.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.773+0000 7f627fe55700 1 -- 172.21.15.156:0/3274844730 shutdown_connections 2023-09-30T22:20:06.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.773+0000 7f627fe55700 1 -- 172.21.15.156:0/3274844730 wait complete. 2023-09-30T22:20:06.785 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:06.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.801+0000 7f6895e53700 1 -- 172.21.15.156:0/3890356323 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6890131b50 con 0x7f689009f180 2023-09-30T22:20:06.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.801+0000 7f6877fff700 1 -- 172.21.15.156:0/3890356323 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6884021070 con 0x7f689009f180 2023-09-30T22:20:06.802 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:06.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.803+0000 7f6895e53700 1 -- 172.21.15.156:0/3890356323 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f689009f180 msgr2=0x7f68901208d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:06.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.803+0000 7f6895e53700 1 --2- 172.21.15.156:0/3890356323 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f689009f180 0x7f68901208d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f688400e980 tx=0x7f688400ec90 comp rx=0 tx=0).stop 2023-09-30T22:20:06.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.803+0000 7f6895e53700 1 -- 172.21.15.156:0/3890356323 shutdown_connections 2023-09-30T22:20:06.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.803+0000 7f6895e53700 1 --2- 172.21.15.156:0/3890356323 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6890131d70 0x7f6890120e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.803+0000 7f6895e53700 1 --2- 172.21.15.156:0/3890356323 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f689009e870 0x7f6890120390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.803+0000 7f6895e53700 1 --2- 172.21.15.156:0/3890356323 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f689009f180 0x7f68901208d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:06.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.803+0000 7f6895e53700 1 -- 172.21.15.156:0/3890356323 >> 172.21.15.156:0/3890356323 conn(0x7f68900a4430 msgr2=0x7f689006fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:06.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.803+0000 7f6895e53700 1 -- 172.21.15.156:0/3890356323 shutdown_connections 2023-09-30T22:20:06.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:06.803+0000 7f6895e53700 1 -- 172.21.15.156:0/3890356323 wait complete. 2023-09-30T22:20:06.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:07.581 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:07.692 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:07.787 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:07.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.804+0000 7f7638f6f700 1 Processor -- start 2023-09-30T22:20:07.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.804+0000 7f7638f6f700 1 -- start start 2023-09-30T22:20:07.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.805+0000 7f7638f6f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7634133b80 0x7f7634133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:07.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.805+0000 7f7638f6f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7634099a60 0x7f76340a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:07.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.805+0000 7f7638f6f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f763409aa00 con 0x7f76340a0e20 2023-09-30T22:20:07.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.805+0000 7f7638f6f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f763409a080 con 0x7f7634099a60 2023-09-30T22:20:07.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.805+0000 7f7638f6f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7634133750 con 0x7f7634133b80 2023-09-30T22:20:07.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.805+0000 7f7631d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7634099a60 0x7f76340a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:07.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.805+0000 7f7631d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7634099a60 0x7f76340a08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:57250/0 (socket says 172.21.15.156:57250) 2023-09-30T22:20:07.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.805+0000 7f7631d9b700 1 -- 172.21.15.156:0/2211509798 learned_addr learned my addr 172.21.15.156:0/2211509798 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:07.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.805+0000 7f7632d9d700 1 --1- 172.21.15.156:0/2211509798 >> v1:172.21.15.156:6789/0 conn(0x7f76340a0e20 0x7f763413a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58368/0 (socket says 172.21.15.156:58368) 2023-09-30T22:20:07.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.805+0000 7f763259c700 1 --2- 172.21.15.156:0/2211509798 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7634133b80 0x7f7634133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:07.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.806+0000 7f7631d9b700 1 -- 172.21.15.156:0/2211509798 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7634133b80 msgr2=0x7f7634133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:07.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.806+0000 7f7631d9b700 1 --2- 172.21.15.156:0/2211509798 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7634133b80 0x7f7634133f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:07.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.806+0000 7f7631d9b700 1 -- 172.21.15.156:0/2211509798 >> v1:172.21.15.156:6789/0 conn(0x7f76340a0e20 legacy=0x7f763413a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:07.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.806+0000 7f7631d9b700 1 -- 172.21.15.156:0/2211509798 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763409a760 con 0x7f7634099a60 2023-09-30T22:20:07.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.806+0000 7f7631d9b700 1 --2- 172.21.15.156:0/2211509798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7634099a60 0x7f76340a08e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f76280098f0 tx=0x7f7628009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d1d957f0e4a9b9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:07.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.806+0000 7f763159a700 1 -- 172.21.15.156:0/2211509798 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7628011830 con 0x7f7634099a60 2023-09-30T22:20:07.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.806+0000 7f763159a700 1 -- 172.21.15.156:0/2211509798 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7628011990 con 0x7f7634099a60 2023-09-30T22:20:07.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.806+0000 7f763159a700 1 -- 172.21.15.156:0/2211509798 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7628011d20 con 0x7f7634099a60 2023-09-30T22:20:07.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.807+0000 7f7638f6f700 1 -- 172.21.15.156:0/2211509798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7634099a60 msgr2=0x7f76340a08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:07.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.807+0000 7f7638f6f700 1 --2- 172.21.15.156:0/2211509798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7634099a60 0x7f76340a08e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f76280098f0 tx=0x7f7628009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:07.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.807+0000 7f7638f6f700 1 -- 172.21.15.156:0/2211509798 shutdown_connections 2023-09-30T22:20:07.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.807+0000 7f7638f6f700 1 --2- 172.21.15.156:0/2211509798 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7634133b80 0x7f7634133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:07.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.807+0000 7f7638f6f700 1 --2- 172.21.15.156:0/2211509798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7634099a60 0x7f76340a08e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:07.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.807+0000 7f7638f6f700 1 -- 172.21.15.156:0/2211509798 >> 172.21.15.156:0/2211509798 conn(0x7f76340a2980 msgr2=0x7f76340a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:07.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.807+0000 7f7638f6f700 1 -- 172.21.15.156:0/2211509798 shutdown_connections 2023-09-30T22:20:07.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.807+0000 7f7638f6f700 1 -- 172.21.15.156:0/2211509798 wait complete. 2023-09-30T22:20:07.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.808+0000 7f7638f6f700 1 Processor -- start 2023-09-30T22:20:07.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.808+0000 7f7638f6f700 1 -- start start 2023-09-30T22:20:07.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.808+0000 7f7638f6f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7634099a60 0x7f763411fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:07.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.808+0000 7f7638f6f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76340a0e20 0x7f7634120370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:07.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.808+0000 7f7638f6f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7634133b80 0x7f76341208b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:07.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.808+0000 7f7638f6f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7634123750 con 0x7f76340a0e20 2023-09-30T22:20:07.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.808+0000 7f7638f6f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7634130e90 con 0x7f7634099a60 2023-09-30T22:20:07.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.808+0000 7f7638f6f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7634130950 con 0x7f7634133b80 2023-09-30T22:20:07.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.809+0000 7f763259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7634099a60 0x7f763411fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:07.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.809+0000 7f7631d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76340a0e20 0x7f7634120370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:07.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.809+0000 7f7631d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76340a0e20 0x7f7634120370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:57254/0 (socket says 172.21.15.156:57254) 2023-09-30T22:20:07.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.809+0000 7f763259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7634099a60 0x7f763411fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48610/0 (socket says 172.21.15.156:48610) 2023-09-30T22:20:07.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.809+0000 7f7631d9b700 1 -- 172.21.15.156:0/2504020901 learned_addr learned my addr 172.21.15.156:0/2504020901 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:07.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.809+0000 7f7632d9d700 1 --2- 172.21.15.156:0/2504020901 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7634133b80 0x7f76341208b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:07.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.809+0000 7f763259c700 1 -- 172.21.15.156:0/2504020901 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7634133b80 msgr2=0x7f76341208b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:07.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.809+0000 7f763259c700 1 --2- 172.21.15.156:0/2504020901 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7634133b80 0x7f76341208b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:07.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.809+0000 7f763259c700 1 -- 172.21.15.156:0/2504020901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76340a0e20 msgr2=0x7f7634120370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:07.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.809+0000 7f763259c700 1 --2- 172.21.15.156:0/2504020901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76340a0e20 0x7f7634120370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:07.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.809+0000 7f763259c700 1 -- 172.21.15.156:0/2504020901 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7628009550 con 0x7f7634099a60 2023-09-30T22:20:07.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.809+0000 7f7631d9b700 1 --2- 172.21.15.156:0/2504020901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76340a0e20 0x7f7634120370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:07.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.809+0000 7f763259c700 1 --2- 172.21.15.156:0/2504020901 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7634099a60 0x7f763411fe30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f762400e900 tx=0x7f762400ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:07.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.809+0000 7f7622ffd700 1 -- 172.21.15.156:0/2504020901 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7624013680 con 0x7f7634099a60 2023-09-30T22:20:07.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.809+0000 7f7622ffd700 1 -- 172.21.15.156:0/2504020901 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76240137e0 con 0x7f7634099a60 2023-09-30T22:20:07.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.809+0000 7f7638f6f700 1 -- 172.21.15.156:0/2504020901 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f763409a2c0 con 0x7f7634099a60 2023-09-30T22:20:07.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.810+0000 7f7622ffd700 1 -- 172.21.15.156:0/2504020901 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7624013b50 con 0x7f7634099a60 2023-09-30T22:20:07.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.810+0000 7f7638f6f700 1 -- 172.21.15.156:0/2504020901 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76341240e0 con 0x7f7634099a60 2023-09-30T22:20:07.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.810+0000 7f7622ffd700 1 -- 172.21.15.156:0/2504020901 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7624013cb0 con 0x7f7634099a60 2023-09-30T22:20:07.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.811+0000 7f7622ffd700 1 -- 172.21.15.156:0/2504020901 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f762403f730 con 0x7f7634099a60 2023-09-30T22:20:07.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.811+0000 7f7638f6f700 1 -- 172.21.15.156:0/2504020901 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f763409ce20 con 0x7f7634099a60 2023-09-30T22:20:07.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.816+0000 7f7622ffd700 1 -- 172.21.15.156:0/2504020901 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f762401bc30 con 0x7f7634099a60 2023-09-30T22:20:07.817 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:07.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.869+0000 7fe3fb87a700 1 Processor -- start 2023-09-30T22:20:08.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.869+0000 7fe3fb87a700 1 -- start start 2023-09-30T22:20:08.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.870+0000 7fe3fb87a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3f409d860 0x7fe3f409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:08.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.870+0000 7fe3fb87a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe3f409e170 0x7fe3f41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:08.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.870+0000 7fe3fb87a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe3f4130ce0 0x7fe3f4131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:08.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.870+0000 7fe3fb87a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f409aaa0 con 0x7fe3f4130ce0 2023-09-30T22:20:08.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.870+0000 7fe3fb87a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f409f870 con 0x7fe3f409d860 2023-09-30T22:20:08.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.870+0000 7fe3fb87a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f409b360 con 0x7fe3f409e170 2023-09-30T22:20:08.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.870+0000 7fe3f9616700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3f409d860 0x7fe3f409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:08.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.870+0000 7fe3f8e15700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe3f409e170 0x7fe3f41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:08.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.870+0000 7fe3f9e17700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe3f4130ce0 0x7fe3f4131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:08.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.870+0000 7fe3f9616700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3f409d860 0x7fe3f409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48618/0 (socket says 172.21.15.156:48618) 2023-09-30T22:20:08.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.870+0000 7fe3f9616700 1 -- 172.21.15.156:0/1246538223 learned_addr learned my addr 172.21.15.156:0/1246538223 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:08.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.870+0000 7fe3f9e17700 1 -- 172.21.15.156:0/1246538223 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe3f409e170 msgr2=0x7fe3f41307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:08.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.870+0000 7fe3f9e17700 1 --2- 172.21.15.156:0/1246538223 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe3f409e170 0x7fe3f41307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.870+0000 7fe3f9e17700 1 -- 172.21.15.156:0/1246538223 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3f409d860 msgr2=0x7fe3f409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:08.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.870+0000 7fe3f9e17700 1 --2- 172.21.15.156:0/1246538223 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3f409d860 0x7fe3f409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.870+0000 7fe3f9e17700 1 -- 172.21.15.156:0/1246538223 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f409b620 con 0x7fe3f4130ce0 2023-09-30T22:20:08.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.870+0000 7fe3f9616700 1 --2- 172.21.15.156:0/1246538223 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3f409d860 0x7fe3f409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:08.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.871+0000 7fe3f9e17700 1 --2- 172.21.15.156:0/1246538223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3f4130ce0 0x7fe3f4131150 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009d90 tx=0x7fe3ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17aa1b9ae38c81 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:08.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.871+0000 7fe3ebfff700 1 -- 172.21.15.156:0/1246538223 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec00e070 con 0x7fe3f4130ce0 2023-09-30T22:20:08.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.871+0000 7fe3ebfff700 1 -- 172.21.15.156:0/1246538223 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ec00bb20 con 0x7fe3f4130ce0 2023-09-30T22:20:08.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.871+0000 7fe3ebfff700 1 -- 172.21.15.156:0/1246538223 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec012430 con 0x7fe3f4130ce0 2023-09-30T22:20:08.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.872+0000 7fe3fb87a700 1 -- 172.21.15.156:0/1246538223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3f4130ce0 msgr2=0x7fe3f4131150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:08.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.872+0000 7fe3fb87a700 1 --2- 172.21.15.156:0/1246538223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3f4130ce0 0x7fe3f4131150 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009d90 tx=0x7fe3ec00b330 comp rx=0 tx=0).stop 2023-09-30T22:20:08.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.872+0000 7fe3fb87a700 1 -- 172.21.15.156:0/1246538223 shutdown_connections 2023-09-30T22:20:08.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.872+0000 7fe3fb87a700 1 --2- 172.21.15.156:0/1246538223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3f4130ce0 0x7fe3f4131150 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.872+0000 7fe3fb87a700 1 --2- 172.21.15.156:0/1246538223 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3f409d860 0x7fe3f409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.872+0000 7fe3fb87a700 1 --2- 172.21.15.156:0/1246538223 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe3f409e170 0x7fe3f41307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.872+0000 7fe3fb87a700 1 -- 172.21.15.156:0/1246538223 >> 172.21.15.156:0/1246538223 conn(0x7fe3f4099c40 msgr2=0x7fe3f40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:08.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.872+0000 7fe3fb87a700 1 -- 172.21.15.156:0/1246538223 shutdown_connections 2023-09-30T22:20:08.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.872+0000 7fe3fb87a700 1 -- 172.21.15.156:0/1246538223 wait complete. 2023-09-30T22:20:08.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.873+0000 7fe3fb87a700 1 Processor -- start 2023-09-30T22:20:08.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.874+0000 7fe3fb87a700 1 -- start start 2023-09-30T22:20:08.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.874+0000 7fe3fb87a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3f409d860 0x7fe3f4131760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:08.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.874+0000 7fe3fb87a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3f409e170 0x7fe3f4131ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:08.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.874+0000 7fe3fb87a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe3f4130ce0 0x7fe3f41321e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:08.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.874+0000 7fe3fb87a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f41344d0 con 0x7fe3f409d860 2023-09-30T22:20:08.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.874+0000 7fe3fb87a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f4134190 con 0x7fe3f409e170 2023-09-30T22:20:08.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.874+0000 7fe3fb87a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f4132b90 con 0x7fe3f4130ce0 2023-09-30T22:20:08.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.874+0000 7fe3f9616700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3f409d860 0x7fe3f4131760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:08.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.874+0000 7fe3f8e15700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3f409e170 0x7fe3f4131ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:08.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.874+0000 7fe3f9616700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3f409d860 0x7fe3f4131760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:57264/0 (socket says 172.21.15.156:57264) 2023-09-30T22:20:08.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.874+0000 7fe3f9616700 1 -- 172.21.15.156:0/1291667182 learned_addr learned my addr 172.21.15.156:0/1291667182 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:08.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.874+0000 7fe3f9e17700 1 --2- 172.21.15.156:0/1291667182 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe3f4130ce0 0x7fe3f41321e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:08.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.875+0000 7fe3f9616700 1 -- 172.21.15.156:0/1291667182 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe3f4130ce0 msgr2=0x7fe3f41321e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:08.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.875+0000 7fe3f9616700 1 --2- 172.21.15.156:0/1291667182 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe3f4130ce0 0x7fe3f41321e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.875+0000 7fe3f9616700 1 -- 172.21.15.156:0/1291667182 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3f409e170 msgr2=0x7fe3f4131ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:08.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.875+0000 7fe3f9616700 1 --2- 172.21.15.156:0/1291667182 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3f409e170 0x7fe3f4131ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.875+0000 7fe3f9616700 1 -- 172.21.15.156:0/1291667182 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f0009550 con 0x7fe3f409d860 2023-09-30T22:20:08.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.875+0000 7fe3f8e15700 1 --2- 172.21.15.156:0/1291667182 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3f409e170 0x7fe3f4131ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:08.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.875+0000 7fe3f9616700 1 --2- 172.21.15.156:0/1291667182 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3f409d860 0x7fe3f4131760 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009e20 tx=0x7fe3f000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:08.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.875+0000 7fe3e9ffb700 1 -- 172.21.15.156:0/1291667182 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0004030 con 0x7fe3f409d860 2023-09-30T22:20:08.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.875+0000 7fe3e9ffb700 1 -- 172.21.15.156:0/1291667182 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f0004190 con 0x7fe3f409d860 2023-09-30T22:20:08.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.875+0000 7fe3fb87a700 1 -- 172.21.15.156:0/1291667182 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3ec009a70 con 0x7fe3f409d860 2023-09-30T22:20:08.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.875+0000 7fe3e9ffb700 1 -- 172.21.15.156:0/1291667182 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0004520 con 0x7fe3f409d860 2023-09-30T22:20:08.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.875+0000 7fe3fb87a700 1 -- 172.21.15.156:0/1291667182 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f4137580 con 0x7fe3f409d860 2023-09-30T22:20:08.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.876+0000 7fe3e9ffb700 1 -- 172.21.15.156:0/1291667182 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe3f0013860 con 0x7fe3f409d860 2023-09-30T22:20:08.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.877+0000 7fe3e9ffb700 1 -- 172.21.15.156:0/1291667182 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe3f0043510 con 0x7fe3f409d860 2023-09-30T22:20:08.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.877+0000 7fe3fb87a700 1 -- 172.21.15.156:0/1291667182 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f412d220 con 0x7fe3f409d860 2023-09-30T22:20:08.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.886+0000 7fe3e9ffb700 1 -- 172.21.15.156:0/1291667182 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe3f0013b10 con 0x7fe3f409d860 2023-09-30T22:20:08.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.928+0000 7f04c8a6f700 1 Processor -- start 2023-09-30T22:20:08.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.928+0000 7f04c8a6f700 1 -- start start 2023-09-30T22:20:08.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.929+0000 7f04c8a6f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04c40a0a30 0x7f04c40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:08.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.929+0000 7f04c8a6f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04c4130670 0x7f04c41381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:08.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.929+0000 7f04c8a6f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c40a1e70 con 0x7f04c40a1340 2023-09-30T22:20:08.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.929+0000 7f04c8a6f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c409a720 con 0x7f04c40a0a30 2023-09-30T22:20:08.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.929+0000 7f04c8a6f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04c409b300 con 0x7f04c4130670 2023-09-30T22:20:08.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.929+0000 7f04c1d9b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f04c40a1340 0x7f04c412ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58382/0 (socket says 172.21.15.156:58382) 2023-09-30T22:20:08.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.929+0000 7f04c1d9b700 1 -- 172.21.15.156:0/651355287 learned_addr learned my addr 172.21.15.156:0/651355287 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:08.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.929+0000 7f04c259c700 1 --2- 172.21.15.156:0/651355287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04c40a0a30 0x7f04c40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:08.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.929+0000 7f04c2d9d700 1 --2- 172.21.15.156:0/651355287 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04c4130670 0x7f04c41381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:08.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.929+0000 7f04c159a700 1 -- 172.21.15.156:0/651355287 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2869481213 0 0) 0x7f04c40a1e70 con 0x7f04c40a1340 2023-09-30T22:20:08.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.929+0000 7f04c159a700 1 -- 172.21.15.156:0/651355287 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04ac0035b0 con 0x7f04c40a1340 2023-09-30T22:20:08.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.929+0000 7f04c2d9d700 1 -- 172.21.15.156:0/651355287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04c40a0a30 msgr2=0x7f04c40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:08.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.929+0000 7f04c2d9d700 1 --2- 172.21.15.156:0/651355287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04c40a0a30 0x7f04c40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.929+0000 7f04c2d9d700 1 -- 172.21.15.156:0/651355287 >> v1:172.21.15.156:6789/0 conn(0x7f04c40a1340 legacy=0x7f04c412ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:08.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.929+0000 7f04c2d9d700 1 -- 172.21.15.156:0/651355287 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c409abc0 con 0x7f04c4130670 2023-09-30T22:20:08.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.929+0000 7f04c259c700 1 --2- 172.21.15.156:0/651355287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04c40a0a30 0x7f04c40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:08.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.930+0000 7f04c2d9d700 1 --2- 172.21.15.156:0/651355287 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04c4130670 0x7f04c41381c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f04bc009dc0 tx=0x7f04bc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fef485bad336799 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:08.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.930+0000 7f04c159a700 1 -- 172.21.15.156:0/651355287 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc00e070 con 0x7f04c4130670 2023-09-30T22:20:08.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.930+0000 7f04c159a700 1 -- 172.21.15.156:0/651355287 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04bc00bb20 con 0x7f04c4130670 2023-09-30T22:20:08.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.930+0000 7f04c159a700 1 -- 172.21.15.156:0/651355287 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc012430 con 0x7f04c4130670 2023-09-30T22:20:08.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.931+0000 7f04c8a6f700 1 -- 172.21.15.156:0/651355287 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04c4130670 msgr2=0x7f04c41381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:08.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.931+0000 7f04c8a6f700 1 --2- 172.21.15.156:0/651355287 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04c4130670 0x7f04c41381c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f04bc009dc0 tx=0x7f04bc00b330 comp rx=0 tx=0).stop 2023-09-30T22:20:08.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.931+0000 7f04c8a6f700 1 -- 172.21.15.156:0/651355287 shutdown_connections 2023-09-30T22:20:08.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.931+0000 7f04c8a6f700 1 --2- 172.21.15.156:0/651355287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04c40a0a30 0x7f04c40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.931+0000 7f04c8a6f700 1 --2- 172.21.15.156:0/651355287 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04c4130670 0x7f04c41381c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.931+0000 7f04c8a6f700 1 -- 172.21.15.156:0/651355287 >> 172.21.15.156:0/651355287 conn(0x7f04c40a2980 msgr2=0x7f04c40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:08.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.931+0000 7f04c8a6f700 1 -- 172.21.15.156:0/651355287 shutdown_connections 2023-09-30T22:20:08.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.931+0000 7f04c8a6f700 1 -- 172.21.15.156:0/651355287 wait complete. 2023-09-30T22:20:08.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.932+0000 7f04c8a6f700 1 Processor -- start 2023-09-30T22:20:08.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.932+0000 7f04c8a6f700 1 -- start start 2023-09-30T22:20:08.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.933+0000 7f04c8a6f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04c40a0a30 0x7f04c41c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:08.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.933+0000 7f04c8a6f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04c40a1340 0x7f04c41c4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:08.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.933+0000 7f04c8a6f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04c4130670 0x7f04c41c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:08.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.933+0000 7f04c8a6f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c411ce60 con 0x7f04c4130670 2023-09-30T22:20:08.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.933+0000 7f04c8a6f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c411cc70 con 0x7f04c40a0a30 2023-09-30T22:20:08.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.933+0000 7f04c8a6f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04c411eb80 con 0x7f04c40a1340 2023-09-30T22:20:08.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.933+0000 7f04c259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04c40a0a30 0x7f04c41c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:08.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.933+0000 7f04c259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04c40a0a30 0x7f04c41c3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48648/0 (socket says 172.21.15.156:48648) 2023-09-30T22:20:08.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.933+0000 7f04c259c700 1 -- 172.21.15.156:0/4086288875 learned_addr learned my addr 172.21.15.156:0/4086288875 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:08.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.933+0000 7f04c1d9b700 1 --2- 172.21.15.156:0/4086288875 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04c40a1340 0x7f04c41c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:08.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.933+0000 7f04c2d9d700 1 --2- 172.21.15.156:0/4086288875 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04c4130670 0x7f04c41c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:08.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.934+0000 7f04c259c700 1 -- 172.21.15.156:0/4086288875 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04c40a1340 msgr2=0x7f04c41c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:08.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.934+0000 7f04c259c700 1 --2- 172.21.15.156:0/4086288875 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04c40a1340 0x7f04c41c4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.934+0000 7f04c259c700 1 -- 172.21.15.156:0/4086288875 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04c4130670 msgr2=0x7f04c41c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:08.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.934+0000 7f04c259c700 1 --2- 172.21.15.156:0/4086288875 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04c4130670 0x7f04c41c4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.934+0000 7f04c259c700 1 -- 172.21.15.156:0/4086288875 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b400a550 con 0x7f04c40a0a30 2023-09-30T22:20:08.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.934+0000 7f04c259c700 1 --2- 172.21.15.156:0/4086288875 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04c40a0a30 0x7f04c41c3cc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f04b400fbb0 tx=0x7f04b400fec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:08.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.934+0000 7f04b2ffd700 1 -- 172.21.15.156:0/4086288875 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b4005c30 con 0x7f04c40a0a30 2023-09-30T22:20:08.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.934+0000 7f04b2ffd700 1 -- 172.21.15.156:0/4086288875 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b4005d90 con 0x7f04c40a0a30 2023-09-30T22:20:08.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.934+0000 7f04c8a6f700 1 -- 172.21.15.156:0/4086288875 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04bc009a70 con 0x7f04c40a0a30 2023-09-30T22:20:08.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.934+0000 7f04b2ffd700 1 -- 172.21.15.156:0/4086288875 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b4004250 con 0x7f04c40a0a30 2023-09-30T22:20:08.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.934+0000 7f04c8a6f700 1 -- 172.21.15.156:0/4086288875 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c411e8a0 con 0x7f04c40a0a30 2023-09-30T22:20:08.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.935+0000 7f04b2ffd700 1 -- 172.21.15.156:0/4086288875 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f04b40043b0 con 0x7f04c40a0a30 2023-09-30T22:20:08.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.935+0000 7f04c8a6f700 1 -- 172.21.15.156:0/4086288875 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c404f2a0 con 0x7f04c40a0a30 2023-09-30T22:20:08.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.935+0000 7f04b2ffd700 1 -- 172.21.15.156:0/4086288875 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f04b403f820 con 0x7f04c40a0a30 2023-09-30T22:20:08.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.944+0000 7f04b2ffd700 1 -- 172.21.15.156:0/4086288875 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f04b401bd70 con 0x7f04c40a0a30 2023-09-30T22:20:08.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.957+0000 7f754d9aa700 1 Processor -- start 2023-09-30T22:20:08.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.957+0000 7f754d9aa700 1 -- start start 2023-09-30T22:20:08.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.958+0000 7f754d9aa700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7548066410 0x7f75481319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:08.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.958+0000 7f754d9aa700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75481314b0 0x7f7548131f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:08.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.958+0000 7f754d9aa700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75480a0f20 con 0x7f754809bc70 2023-09-30T22:20:08.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.958+0000 7f754d9aa700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75480667e0 con 0x7f7548066410 2023-09-30T22:20:08.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.958+0000 7f754d9aa700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75480a23c0 con 0x7f75481314b0 2023-09-30T22:20:08.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.958+0000 7f7546ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7548066410 0x7f75481319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:08.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.958+0000 7f7546ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7548066410 0x7f75481319f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:57290/0 (socket says 172.21.15.156:57290) 2023-09-30T22:20:08.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.958+0000 7f7546ffd700 1 -- 172.21.15.156:0/1659797880 learned_addr learned my addr 172.21.15.156:0/1659797880 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:08.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.958+0000 7f75467fc700 1 --2- 172.21.15.156:0/1659797880 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75481314b0 0x7f7548131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:08.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.958+0000 7f7546ffd700 1 -- 172.21.15.156:0/1659797880 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75481314b0 msgr2=0x7f7548131f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:08.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.958+0000 7f7546ffd700 1 --2- 172.21.15.156:0/1659797880 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75481314b0 0x7f7548131f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.958+0000 7f7546ffd700 1 -- 172.21.15.156:0/1659797880 >> v1:172.21.15.156:6789/0 conn(0x7f754809bc70 legacy=0x7f754809c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:08.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.958+0000 7f7546ffd700 1 -- 172.21.15.156:0/1659797880 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75480a16e0 con 0x7f7548066410 2023-09-30T22:20:08.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.958+0000 7f7545ffb700 1 -- 172.21.15.156:0/1659797880 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3825404668 0 0) 0x7f75480a0f20 con 0x7f754809bc70 2023-09-30T22:20:08.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.958+0000 7f75467fc700 1 --2- 172.21.15.156:0/1659797880 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75481314b0 0x7f7548131f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:08.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.958+0000 7f7546ffd700 1 --2- 172.21.15.156:0/1659797880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7548066410 0x7f75481319f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f75380098f0 tx=0x7f7538009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b1fc8787ac6effd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:08.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.959+0000 7f7545ffb700 1 -- 172.21.15.156:0/1659797880 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7538005e30 con 0x7f7548066410 2023-09-30T22:20:08.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.959+0000 7f7545ffb700 1 -- 172.21.15.156:0/1659797880 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7538004030 con 0x7f7548066410 2023-09-30T22:20:08.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.959+0000 7f7545ffb700 1 -- 172.21.15.156:0/1659797880 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75380043e0 con 0x7f7548066410 2023-09-30T22:20:08.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.959+0000 7f754d9aa700 1 -- 172.21.15.156:0/1659797880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7548066410 msgr2=0x7f75481319f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:08.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.959+0000 7f754d9aa700 1 --2- 172.21.15.156:0/1659797880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7548066410 0x7f75481319f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f75380098f0 tx=0x7f7538009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:08.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.959+0000 7f754d9aa700 1 -- 172.21.15.156:0/1659797880 shutdown_connections 2023-09-30T22:20:08.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.959+0000 7f754d9aa700 1 --2- 172.21.15.156:0/1659797880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7548066410 0x7f75481319f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.959+0000 7f754d9aa700 1 --2- 172.21.15.156:0/1659797880 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75481314b0 0x7f7548131f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.959+0000 7f754d9aa700 1 -- 172.21.15.156:0/1659797880 >> 172.21.15.156:0/1659797880 conn(0x7f75480a2980 msgr2=0x7f75480a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:08.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.959+0000 7f754d9aa700 1 -- 172.21.15.156:0/1659797880 shutdown_connections 2023-09-30T22:20:08.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.960+0000 7f754d9aa700 1 -- 172.21.15.156:0/1659797880 wait complete. 2023-09-30T22:20:08.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.961+0000 7f754d9aa700 1 Processor -- start 2023-09-30T22:20:08.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.961+0000 7f754d9aa700 1 -- start start 2023-09-30T22:20:08.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.962+0000 7f754d9aa700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7548066410 0x7f7548137570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:08.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.962+0000 7f754d9aa700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f754809bc70 0x7f7548137ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:08.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.962+0000 7f754d9aa700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75481314b0 0x7f7548137ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:08.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.962+0000 7f754d9aa700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7548136740 con 0x7f75481314b0 2023-09-30T22:20:08.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.962+0000 7f754d9aa700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7548135050 con 0x7f754809bc70 2023-09-30T22:20:08.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.962+0000 7f754d9aa700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7548136990 con 0x7f7548066410 2023-09-30T22:20:08.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.962+0000 7f7546ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7548066410 0x7f7548137570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:08.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.962+0000 7f7546ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7548066410 0x7f7548137570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52274/0 (socket says 172.21.15.156:52274) 2023-09-30T22:20:08.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.962+0000 7f7546ffd700 1 -- 172.21.15.156:0/708101705 learned_addr learned my addr 172.21.15.156:0/708101705 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:08.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.962+0000 7f75467fc700 1 --2- 172.21.15.156:0/708101705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f754809bc70 0x7f7548137ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:08.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.962+0000 7f7546ffd700 1 -- 172.21.15.156:0/708101705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f754809bc70 msgr2=0x7f7548137ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:08.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.962+0000 7f7546ffd700 1 --2- 172.21.15.156:0/708101705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f754809bc70 0x7f7548137ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.962+0000 7f7546ffd700 1 -- 172.21.15.156:0/708101705 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75481314b0 msgr2=0x7f7548137ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:08.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.962+0000 7f7546ffd700 1 --2- 172.21.15.156:0/708101705 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75481314b0 0x7f7548137ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.962+0000 7f7546ffd700 1 -- 172.21.15.156:0/708101705 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753c0094a0 con 0x7f7548066410 2023-09-30T22:20:08.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.962+0000 7f75467fc700 1 --2- 172.21.15.156:0/708101705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f754809bc70 0x7f7548137ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:08.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.962+0000 7f7546ffd700 1 --2- 172.21.15.156:0/708101705 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7548066410 0x7f7548137570 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7538006c40 tx=0x7f7538004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:08.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.962+0000 7f752ffff700 1 -- 172.21.15.156:0/708101705 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7538003aa0 con 0x7f7548066410 2023-09-30T22:20:08.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.963+0000 7f752ffff700 1 -- 172.21.15.156:0/708101705 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7538003c00 con 0x7f7548066410 2023-09-30T22:20:08.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.963+0000 7f754d9aa700 1 -- 172.21.15.156:0/708101705 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7538009500 con 0x7f7548066410 2023-09-30T22:20:08.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.963+0000 7f752ffff700 1 -- 172.21.15.156:0/708101705 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7538011420 con 0x7f7548066410 2023-09-30T22:20:08.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.963+0000 7f754d9aa700 1 -- 172.21.15.156:0/708101705 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f754812dd40 con 0x7f7548066410 2023-09-30T22:20:08.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.964+0000 7f752ffff700 1 -- 172.21.15.156:0/708101705 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7538018070 con 0x7f7548066410 2023-09-30T22:20:08.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.964+0000 7f754d9aa700 1 -- 172.21.15.156:0/708101705 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f754804f2a0 con 0x7f7548066410 2023-09-30T22:20:08.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.964+0000 7f752ffff700 1 -- 172.21.15.156:0/708101705 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7538040060 con 0x7f7548066410 2023-09-30T22:20:08.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:07.969+0000 7f752ffff700 1 -- 172.21.15.156:0/708101705 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7538011580 con 0x7f7548066410 2023-09-30T22:20:08.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.027+0000 7f7638f6f700 1 -- 172.21.15.156:0/2504020901 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7634074f10 con 0x7f7634099a60 2023-09-30T22:20:08.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.027+0000 7f7622ffd700 1 -- 172.21.15.156:0/2504020901 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7624017020 con 0x7f7634099a60 2023-09-30T22:20:08.663 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:08.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.030+0000 7f7638f6f700 1 -- 172.21.15.156:0/2504020901 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7634099a60 msgr2=0x7f763411fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:08.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.030+0000 7f7638f6f700 1 --2- 172.21.15.156:0/2504020901 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7634099a60 0x7f763411fe30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f762400e900 tx=0x7f762400ec10 comp rx=0 tx=0).stop 2023-09-30T22:20:08.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.030+0000 7f7638f6f700 1 -- 172.21.15.156:0/2504020901 shutdown_connections 2023-09-30T22:20:08.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.030+0000 7f7638f6f700 1 --2- 172.21.15.156:0/2504020901 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7634133b80 0x7f76341208b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.030+0000 7f7638f6f700 1 --2- 172.21.15.156:0/2504020901 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7634099a60 0x7f763411fe30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.030+0000 7f7638f6f700 1 --2- 172.21.15.156:0/2504020901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76340a0e20 0x7f7634120370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.030+0000 7f7638f6f700 1 -- 172.21.15.156:0/2504020901 >> 172.21.15.156:0/2504020901 conn(0x7f76340a2980 msgr2=0x7f7634132360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:08.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.031+0000 7f7638f6f700 1 -- 172.21.15.156:0/2504020901 shutdown_connections 2023-09-30T22:20:08.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.031+0000 7f7638f6f700 1 -- 172.21.15.156:0/2504020901 wait complete. 2023-09-30T22:20:08.665 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:08.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.088+0000 7fe3fb87a700 1 -- 172.21.15.156:0/1291667182 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe3f4133320 con 0x7fe3f409d860 2023-09-30T22:20:08.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.088+0000 7fe3e9ffb700 1 -- 172.21.15.156:0/1291667182 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe3f00233a0 con 0x7fe3f409d860 2023-09-30T22:20:08.665 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:08.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.091+0000 7fe3fb87a700 1 -- 172.21.15.156:0/1291667182 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3f409d860 msgr2=0x7fe3f4131760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:08.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.091+0000 7fe3fb87a700 1 --2- 172.21.15.156:0/1291667182 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3f409d860 0x7fe3f4131760 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009e20 tx=0x7fe3f000ee90 comp rx=0 tx=0).stop 2023-09-30T22:20:08.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.091+0000 7fe3fb87a700 1 -- 172.21.15.156:0/1291667182 shutdown_connections 2023-09-30T22:20:08.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.091+0000 7fe3fb87a700 1 --2- 172.21.15.156:0/1291667182 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe3f4130ce0 0x7fe3f41321e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.091+0000 7fe3fb87a700 1 --2- 172.21.15.156:0/1291667182 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3f409d860 0x7fe3f4131760 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.091+0000 7fe3fb87a700 1 --2- 172.21.15.156:0/1291667182 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3f409e170 0x7fe3f4131ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.091+0000 7fe3fb87a700 1 -- 172.21.15.156:0/1291667182 >> 172.21.15.156:0/1291667182 conn(0x7fe3f4099c40 msgr2=0x7fe3f4071ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:08.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.091+0000 7fe3fb87a700 1 -- 172.21.15.156:0/1291667182 shutdown_connections 2023-09-30T22:20:08.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.091+0000 7fe3fb87a700 1 -- 172.21.15.156:0/1291667182 wait complete. 2023-09-30T22:20:08.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:08.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.151+0000 7f04c8a6f700 1 -- 172.21.15.156:0/4086288875 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f04c411d460 con 0x7f04c40a0a30 2023-09-30T22:20:08.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.151+0000 7f04b2ffd700 1 -- 172.21.15.156:0/4086288875 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f04b401bb90 con 0x7f04c40a0a30 2023-09-30T22:20:08.668 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:08.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.153+0000 7f04c8a6f700 1 -- 172.21.15.156:0/4086288875 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04c40a0a30 msgr2=0x7f04c41c3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:08.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.153+0000 7f04c8a6f700 1 --2- 172.21.15.156:0/4086288875 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04c40a0a30 0x7f04c41c3cc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f04b400fbb0 tx=0x7f04b400fec0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.153+0000 7f04c8a6f700 1 -- 172.21.15.156:0/4086288875 shutdown_connections 2023-09-30T22:20:08.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.153+0000 7f04c8a6f700 1 --2- 172.21.15.156:0/4086288875 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04c4130670 0x7f04c41c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.153+0000 7f04c8a6f700 1 --2- 172.21.15.156:0/4086288875 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04c40a0a30 0x7f04c41c3cc0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.153+0000 7f04c8a6f700 1 --2- 172.21.15.156:0/4086288875 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04c40a1340 0x7f04c41c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.153+0000 7f04c8a6f700 1 -- 172.21.15.156:0/4086288875 >> 172.21.15.156:0/4086288875 conn(0x7f04c40a2980 msgr2=0x7f04c4070c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:08.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.153+0000 7f04c8a6f700 1 -- 172.21.15.156:0/4086288875 shutdown_connections 2023-09-30T22:20:08.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.153+0000 7f04c8a6f700 1 -- 172.21.15.156:0/4086288875 wait complete. 2023-09-30T22:20:08.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.164+0000 7f754d9aa700 1 -- 172.21.15.156:0/708101705 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7548135cd0 con 0x7f7548066410 2023-09-30T22:20:08.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.164+0000 7f752ffff700 1 -- 172.21.15.156:0/708101705 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7538029070 con 0x7f7548066410 2023-09-30T22:20:08.689 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:08.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:08.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.167+0000 7f754d9aa700 1 -- 172.21.15.156:0/708101705 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7548066410 msgr2=0x7f7548137570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:08.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.167+0000 7f754d9aa700 1 --2- 172.21.15.156:0/708101705 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7548066410 0x7f7548137570 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7538006c40 tx=0x7f7538004750 comp rx=0 tx=0).stop 2023-09-30T22:20:08.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.167+0000 7f754d9aa700 1 -- 172.21.15.156:0/708101705 shutdown_connections 2023-09-30T22:20:08.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.167+0000 7f754d9aa700 1 --2- 172.21.15.156:0/708101705 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75481314b0 0x7f7548137ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.167+0000 7f754d9aa700 1 --2- 172.21.15.156:0/708101705 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7548066410 0x7f7548137570 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.167+0000 7f754d9aa700 1 --2- 172.21.15.156:0/708101705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f754809bc70 0x7f7548137ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:08.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.167+0000 7f754d9aa700 1 -- 172.21.15.156:0/708101705 >> 172.21.15.156:0/708101705 conn(0x7f75480a2980 msgr2=0x7f7548071260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:08.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.167+0000 7f754d9aa700 1 -- 172.21.15.156:0/708101705 shutdown_connections 2023-09-30T22:20:08.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:08.167+0000 7f754d9aa700 1 -- 172.21.15.156:0/708101705 wait complete. 2023-09-30T22:20:08.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:09.665 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:09.668 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:09.691 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:09.693 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:09.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.811+0000 7f1fbd4c6700 1 Processor -- start 2023-09-30T22:20:09.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.811+0000 7f1fbd4c6700 1 -- start start 2023-09-30T22:20:09.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.811+0000 7f1fbd4c6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1fb80a1510 0x7f1fb81351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:09.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.811+0000 7f1fbd4c6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1fb81356e0 0x7f1fb8137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:09.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.811+0000 7f1fbd4c6700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb80a1e70 con 0x7f1fb80a0a30 2023-09-30T22:20:09.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.811+0000 7f1fbd4c6700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb809a720 con 0x7f1fb80a1510 2023-09-30T22:20:09.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.811+0000 7f1fbd4c6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb809b300 con 0x7f1fb81356e0 2023-09-30T22:20:09.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.812+0000 7f1fb77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1fb81356e0 0x7f1fb8137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:09.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.812+0000 7f1fb77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1fb81356e0 0x7f1fb8137ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52288/0 (socket says 172.21.15.156:52288) 2023-09-30T22:20:09.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.812+0000 7f1fb77fe700 1 -- 172.21.15.156:0/391834593 learned_addr learned my addr 172.21.15.156:0/391834593 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:09.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.812+0000 7f1fb77fe700 1 -- 172.21.15.156:0/391834593 >> v2:172.21.15.156:3300/0 conn(0x7f1fb80a1510 msgr2=0x7f1fb81351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:09.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.812+0000 7f1fb77fe700 1 --2- 172.21.15.156:0/391834593 >> v2:172.21.15.156:3300/0 conn(0x7f1fb80a1510 0x7f1fb81351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:09.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.812+0000 7f1fb77fe700 1 -- 172.21.15.156:0/391834593 >> v1:172.21.15.156:6789/0 conn(0x7f1fb80a0a30 legacy=0x7f1fb80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:09.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.812+0000 7f1fb77fe700 1 -- 172.21.15.156:0/391834593 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb809abc0 con 0x7f1fb81356e0 2023-09-30T22:20:09.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.812+0000 7f1fb77fe700 1 --2- 172.21.15.156:0/391834593 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1fb81356e0 0x7f1fb8137ac0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1fb000d150 tx=0x7f1fb000d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=593cbdb260a28f3b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:09.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.812+0000 7f1fb5ffb700 1 -- 172.21.15.156:0/391834593 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0010070 con 0x7f1fb81356e0 2023-09-30T22:20:09.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.812+0000 7f1fb5ffb700 1 -- 172.21.15.156:0/391834593 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb000db70 con 0x7f1fb81356e0 2023-09-30T22:20:09.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.812+0000 7f1fb5ffb700 1 -- 172.21.15.156:0/391834593 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0003a20 con 0x7f1fb81356e0 2023-09-30T22:20:09.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.813+0000 7f1fbd4c6700 1 -- 172.21.15.156:0/391834593 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1fb81356e0 msgr2=0x7f1fb8137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:09.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.813+0000 7f1fbd4c6700 1 --2- 172.21.15.156:0/391834593 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1fb81356e0 0x7f1fb8137ac0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1fb000d150 tx=0x7f1fb000d460 comp rx=0 tx=0).stop 2023-09-30T22:20:09.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.813+0000 7f1fbd4c6700 1 -- 172.21.15.156:0/391834593 shutdown_connections 2023-09-30T22:20:09.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.813+0000 7f1fbd4c6700 1 --2- 172.21.15.156:0/391834593 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1fb81356e0 0x7f1fb8137ac0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:09.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.813+0000 7f1fbd4c6700 1 --2- 172.21.15.156:0/391834593 >> v2:172.21.15.156:3300/0 conn(0x7f1fb80a1510 0x7f1fb81351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:09.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.813+0000 7f1fbd4c6700 1 -- 172.21.15.156:0/391834593 >> 172.21.15.156:0/391834593 conn(0x7f1fb80a2980 msgr2=0x7f1fb80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:09.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.813+0000 7f1fbd4c6700 1 -- 172.21.15.156:0/391834593 shutdown_connections 2023-09-30T22:20:09.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.813+0000 7f1fbd4c6700 1 -- 172.21.15.156:0/391834593 wait complete. 2023-09-30T22:20:09.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.815+0000 7f1fbd4c6700 1 Processor -- start 2023-09-30T22:20:09.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.815+0000 7f1fbd4c6700 1 -- start start 2023-09-30T22:20:09.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.815+0000 7f1fbd4c6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1fb80a0a30 0x7f1fb811edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:09.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.815+0000 7f1fbd4c6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fb80a1510 0x7f1fb811f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:09.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.815+0000 7f1fbd4c6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fb81356e0 0x7f1fb811f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:09.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.815+0000 7f1fbd4c6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb8135510 con 0x7f1fb81356e0 2023-09-30T22:20:09.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.815+0000 7f1fbd4c6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb8120990 con 0x7f1fb80a1510 2023-09-30T22:20:09.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.815+0000 7f1fbd4c6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb8122590 con 0x7f1fb80a0a30 2023-09-30T22:20:09.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.816+0000 7f1fb6ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1fb80a0a30 0x7f1fb811edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:09.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.816+0000 7f1fb6ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1fb80a0a30 0x7f1fb811edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52294/0 (socket says 172.21.15.156:52294) 2023-09-30T22:20:09.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.816+0000 7f1fb6ffd700 1 -- 172.21.15.156:0/194297482 learned_addr learned my addr 172.21.15.156:0/194297482 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:09.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.816+0000 7f1fb77fe700 1 --2- 172.21.15.156:0/194297482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fb81356e0 0x7f1fb811f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:09.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.816+0000 7f1fb6ffd700 1 -- 172.21.15.156:0/194297482 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fb80a1510 msgr2=0x7f1fb811f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:09.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.816+0000 7f1fb6ffd700 1 --2- 172.21.15.156:0/194297482 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fb80a1510 0x7f1fb811f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:09.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.816+0000 7f1fb6ffd700 1 -- 172.21.15.156:0/194297482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fb81356e0 msgr2=0x7f1fb811f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:09.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.816+0000 7f1fb6ffd700 1 --2- 172.21.15.156:0/194297482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fb81356e0 0x7f1fb811f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:09.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.816+0000 7f1fb6ffd700 1 -- 172.21.15.156:0/194297482 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb000bd40 con 0x7f1fb80a0a30 2023-09-30T22:20:09.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.816+0000 7f1fb6ffd700 1 --2- 172.21.15.156:0/194297482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1fb80a0a30 0x7f1fb811edd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800c520 tx=0x7f1fa800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:09.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.816+0000 7f1f9f7fe700 1 -- 172.21.15.156:0/194297482 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa80054e0 con 0x7f1fb80a0a30 2023-09-30T22:20:09.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.816+0000 7f1f9f7fe700 1 -- 172.21.15.156:0/194297482 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa8003680 con 0x7f1fb80a0a30 2023-09-30T22:20:09.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.816+0000 7f1f9f7fe700 1 -- 172.21.15.156:0/194297482 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8003a30 con 0x7f1fb80a0a30 2023-09-30T22:20:09.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.816+0000 7f1fbd4c6700 1 -- 172.21.15.156:0/194297482 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb8070fe0 con 0x7f1fb80a0a30 2023-09-30T22:20:09.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.817+0000 7f1fbd4c6700 1 -- 172.21.15.156:0/194297482 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb81210e0 con 0x7f1fb80a0a30 2023-09-30T22:20:09.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.817+0000 7f1f9f7fe700 1 -- 172.21.15.156:0/194297482 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1fa8003b90 con 0x7f1fb80a0a30 2023-09-30T22:20:09.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.818+0000 7f1f9f7fe700 1 -- 172.21.15.156:0/194297482 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1fa803e8b0 con 0x7f1fb80a0a30 2023-09-30T22:20:09.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.818+0000 7f1fbd4c6700 1 -- 172.21.15.156:0/194297482 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb804f2a0 con 0x7f1fb80a0a30 2023-09-30T22:20:09.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.822+0000 7f2a3204c700 1 Processor -- start 2023-09-30T22:20:09.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.822+0000 7f2a3204c700 1 -- start start 2023-09-30T22:20:09.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.823+0000 7f2a3204c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2a2c09d860 0x7f2a2c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:09.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.823+0000 7f2a3204c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a2c09e170 0x7f2a2c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:09.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.823+0000 7f2a3204c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a2c09aaa0 con 0x7f2a2c130ce0 2023-09-30T22:20:09.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.823+0000 7f2a3204c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2c09f870 con 0x7f2a2c09d860 2023-09-30T22:20:09.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.823+0000 7f2a3204c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c09b360 con 0x7f2a2c09e170 2023-09-30T22:20:09.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.823+0000 7f2a2affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a2c09e170 0x7f2a2c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:09.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.823+0000 7f2a2bfff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f2a2c130ce0 0x7f2a2c1379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58406/0 (socket says 172.21.15.156:58406) 2023-09-30T22:20:09.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.823+0000 7f2a2b7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2a2c09d860 0x7f2a2c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:09.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.823+0000 7f2a2bfff700 1 -- 172.21.15.156:0/1592722309 learned_addr learned my addr 172.21.15.156:0/1592722309 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:09.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.823+0000 7f2a2b7fe700 1 -- 172.21.15.156:0/1592722309 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a2c09e170 msgr2=0x7f2a2c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:09.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.823+0000 7f1f9f7fe700 1 -- 172.21.15.156:0/194297482 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1fa8017080 con 0x7f1fb80a0a30 2023-09-30T22:20:09.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.823+0000 7f2a2b7fe700 1 --2- 172.21.15.156:0/1592722309 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a2c09e170 0x7f2a2c1307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:09.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.823+0000 7f2a2b7fe700 1 -- 172.21.15.156:0/1592722309 >> v1:172.21.15.156:6789/0 conn(0x7f2a2c130ce0 legacy=0x7f2a2c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:09.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.823+0000 7f2a2a7fc700 1 -- 172.21.15.156:0/1592722309 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1056516501 0 0) 0x7f2a2c09aaa0 con 0x7f2a2c130ce0 2023-09-30T22:20:09.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.823+0000 7f2a2b7fe700 1 -- 172.21.15.156:0/1592722309 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c09b620 con 0x7f2a2c09d860 2023-09-30T22:20:09.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.823+0000 7f2a2b7fe700 1 --2- 172.21.15.156:0/1592722309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a2c09d860 0x7f2a2c09dc30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00dc60 tx=0x7f2a1c00df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b849e71516a3f30 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:09.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.827+0000 7f2a2a7fc700 1 -- 172.21.15.156:0/1592722309 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c012070 con 0x7f2a2c09d860 2023-09-30T22:20:09.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.827+0000 7f2a2a7fc700 1 -- 172.21.15.156:0/1592722309 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c00d2e0 con 0x7f2a2c09d860 2023-09-30T22:20:09.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.827+0000 7f2a2a7fc700 1 -- 172.21.15.156:0/1592722309 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c00f900 con 0x7f2a2c09d860 2023-09-30T22:20:09.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.828+0000 7f2a3204c700 1 -- 172.21.15.156:0/1592722309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a2c09d860 msgr2=0x7f2a2c09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:09.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.828+0000 7f2a3204c700 1 --2- 172.21.15.156:0/1592722309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a2c09d860 0x7f2a2c09dc30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00dc60 tx=0x7f2a1c00df70 comp rx=0 tx=0).stop 2023-09-30T22:20:09.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.828+0000 7f2a3204c700 1 -- 172.21.15.156:0/1592722309 shutdown_connections 2023-09-30T22:20:09.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.828+0000 7f2a3204c700 1 --2- 172.21.15.156:0/1592722309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a2c09d860 0x7f2a2c09dc30 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:09.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.828+0000 7f2a3204c700 1 --2- 172.21.15.156:0/1592722309 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a2c09e170 0x7f2a2c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:09.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.828+0000 7f2a3204c700 1 -- 172.21.15.156:0/1592722309 >> 172.21.15.156:0/1592722309 conn(0x7f2a2c099c40 msgr2=0x7f2a2c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:09.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.828+0000 7f2a3204c700 1 -- 172.21.15.156:0/1592722309 shutdown_connections 2023-09-30T22:20:09.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.828+0000 7f2a3204c700 1 -- 172.21.15.156:0/1592722309 wait complete. 2023-09-30T22:20:09.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.829+0000 7f2a3204c700 1 Processor -- start 2023-09-30T22:20:09.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.829+0000 7f2a3204c700 1 -- start start 2023-09-30T22:20:09.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.830+0000 7f2a3204c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a2c09d860 0x7f2a2c11e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:09.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.830+0000 7f2a3204c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a2c09e170 0x7f2a2c11e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:09.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.830+0000 7f2a3204c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a2c130ce0 0x7f2a2c11ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:09.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.830+0000 7f2a3204c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c130340 con 0x7f2a2c09d860 2023-09-30T22:20:09.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.830+0000 7f2a3204c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c121d00 con 0x7f2a2c09e170 2023-09-30T22:20:09.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.830+0000 7f2a3204c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c11fff0 con 0x7f2a2c130ce0 2023-09-30T22:20:09.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.830+0000 7f2a2b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a2c09d860 0x7f2a2c11e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:09.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.830+0000 7f2a2b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a2c09d860 0x7f2a2c11e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:57344/0 (socket says 172.21.15.156:57344) 2023-09-30T22:20:09.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.830+0000 7f2a2b7fe700 1 -- 172.21.15.156:0/2035710616 learned_addr learned my addr 172.21.15.156:0/2035710616 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:09.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.830+0000 7f2a2bfff700 1 --2- 172.21.15.156:0/2035710616 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a2c130ce0 0x7f2a2c11ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:09.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.830+0000 7f2a2b7fe700 1 -- 172.21.15.156:0/2035710616 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a2c130ce0 msgr2=0x7f2a2c11ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:09.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.830+0000 7f2a2b7fe700 1 --2- 172.21.15.156:0/2035710616 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a2c130ce0 0x7f2a2c11ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:09.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.830+0000 7f2a2b7fe700 1 -- 172.21.15.156:0/2035710616 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a2c09e170 msgr2=0x7f2a2c11e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:09.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.830+0000 7f2a2b7fe700 1 --2- 172.21.15.156:0/2035710616 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a2c09e170 0x7f2a2c11e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:09.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.830+0000 7f2a2b7fe700 1 -- 172.21.15.156:0/2035710616 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1c00d940 con 0x7f2a2c09d860 2023-09-30T22:20:09.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.830+0000 7f2a2bfff700 1 --2- 172.21.15.156:0/2035710616 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a2c130ce0 0x7f2a2c11ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:20:09.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.830+0000 7f2a2b7fe700 1 --2- 172.21.15.156:0/2035710616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a2c09d860 0x7f2a2c11e3e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00f330 tx=0x7f2a1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:09.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.830+0000 7f2a13fff700 1 -- 172.21.15.156:0/2035710616 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c00cdb0 con 0x7f2a2c09d860 2023-09-30T22:20:09.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.831+0000 7f2a3204c700 1 -- 172.21.15.156:0/2035710616 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a2c1205a0 con 0x7f2a2c09d860 2023-09-30T22:20:09.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.831+0000 7f2a13fff700 1 -- 172.21.15.156:0/2035710616 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c020440 con 0x7f2a2c09d860 2023-09-30T22:20:09.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.831+0000 7f2a13fff700 1 -- 172.21.15.156:0/2035710616 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c0207f0 con 0x7f2a2c09d860 2023-09-30T22:20:09.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.831+0000 7f2a3204c700 1 -- 172.21.15.156:0/2035710616 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2c121f00 con 0x7f2a2c09d860 2023-09-30T22:20:09.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.831+0000 7f2a13fff700 1 -- 172.21.15.156:0/2035710616 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a1c020950 con 0x7f2a2c09d860 2023-09-30T22:20:09.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.832+0000 7f2a13fff700 1 -- 172.21.15.156:0/2035710616 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2a1c044d80 con 0x7f2a2c09d860 2023-09-30T22:20:09.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.836+0000 7f2a3204c700 1 -- 172.21.15.156:0/2035710616 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2c04f2a0 con 0x7f2a2c09d860 2023-09-30T22:20:09.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.843+0000 7f2a13fff700 1 -- 172.21.15.156:0/2035710616 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a1c02ade0 con 0x7f2a2c09d860 2023-09-30T22:20:09.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.851+0000 7ffaa97f5700 1 Processor -- start 2023-09-30T22:20:09.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.851+0000 7ffaa97f5700 1 -- start start 2023-09-30T22:20:09.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.851+0000 7ffaa97f5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffaa406a770 0x7ffaa41349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:09.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.851+0000 7ffaa97f5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffaa4134f00 0x7ffaa409d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:09.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.851+0000 7ffaa97f5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ffaa409dea0 0x7ffaa409e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:09.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.851+0000 7ffaa97f5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa406b2e0 con 0x7ffaa409dea0 2023-09-30T22:20:09.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.851+0000 7ffaa97f5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa409eca0 con 0x7ffaa4134f00 2023-09-30T22:20:09.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.851+0000 7ffaa97f5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa409f720 con 0x7ffaa406a770 2023-09-30T22:20:09.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.852+0000 7ffaa27fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffaa4134f00 0x7ffaa409d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:09.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.852+0000 7ffaa2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffaa406a770 0x7ffaa41349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:09.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.852+0000 7ffaa27fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffaa4134f00 0x7ffaa409d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48680/0 (socket says 172.21.15.156:48680) 2023-09-30T22:20:09.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.852+0000 7ffaa27fc700 1 -- 172.21.15.156:0/2110960027 learned_addr learned my addr 172.21.15.156:0/2110960027 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:09.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.852+0000 7ffaa37fe700 1 --2- 172.21.15.156:0/2110960027 >> v2:172.21.15.156:3300/0 conn(0x7ffaa409dea0 0x7ffaa409e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:09.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.852+0000 7ffaa2ffd700 1 -- 172.21.15.156:0/2110960027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffaa4134f00 msgr2=0x7ffaa409d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:09.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.852+0000 7ffaa2ffd700 1 --2- 172.21.15.156:0/2110960027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffaa4134f00 0x7ffaa409d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:09.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.852+0000 7ffaa2ffd700 1 -- 172.21.15.156:0/2110960027 >> v2:172.21.15.156:3300/0 conn(0x7ffaa409dea0 msgr2=0x7ffaa409e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:09.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.852+0000 7ffaa2ffd700 1 --2- 172.21.15.156:0/2110960027 >> v2:172.21.15.156:3300/0 conn(0x7ffaa409dea0 0x7ffaa409e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:09.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.852+0000 7ffaa2ffd700 1 -- 172.21.15.156:0/2110960027 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa406b480 con 0x7ffaa406a770 2023-09-30T22:20:09.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.852+0000 7ffaa27fc700 1 --2- 172.21.15.156:0/2110960027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffaa4134f00 0x7ffaa409d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:09.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.852+0000 7ffaa2ffd700 1 --2- 172.21.15.156:0/2110960027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffaa406a770 0x7ffaa41349c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009840 tx=0x7ffa94009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=283ccef3bf7b1975 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:09.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.852+0000 7ffaa1ffb700 1 -- 172.21.15.156:0/2110960027 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa94011830 con 0x7ffaa406a770 2023-09-30T22:20:09.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.852+0000 7ffaa1ffb700 1 -- 172.21.15.156:0/2110960027 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa94011990 con 0x7ffaa406a770 2023-09-30T22:20:09.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.852+0000 7ffaa1ffb700 1 -- 172.21.15.156:0/2110960027 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa94011d20 con 0x7ffaa406a770 2023-09-30T22:20:09.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.853+0000 7ffaa97f5700 1 -- 172.21.15.156:0/2110960027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffaa406a770 msgr2=0x7ffaa41349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:09.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.853+0000 7ffaa97f5700 1 --2- 172.21.15.156:0/2110960027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffaa406a770 0x7ffaa41349c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009840 tx=0x7ffa94009b50 comp rx=0 tx=0).stop 2023-09-30T22:20:09.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.853+0000 7ffaa97f5700 1 -- 172.21.15.156:0/2110960027 shutdown_connections 2023-09-30T22:20:09.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.853+0000 7ffaa97f5700 1 --2- 172.21.15.156:0/2110960027 >> v2:172.21.15.156:3300/0 conn(0x7ffaa409dea0 0x7ffaa409e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:09.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.853+0000 7ffaa97f5700 1 --2- 172.21.15.156:0/2110960027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffaa406a770 0x7ffaa41349c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:09.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.853+0000 7ffaa97f5700 1 --2- 172.21.15.156:0/2110960027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffaa4134f00 0x7ffaa409d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:09.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.853+0000 7ffaa97f5700 1 -- 172.21.15.156:0/2110960027 >> 172.21.15.156:0/2110960027 conn(0x7ffaa4099c40 msgr2=0x7ffaa40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:09.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.853+0000 7ffaa97f5700 1 -- 172.21.15.156:0/2110960027 shutdown_connections 2023-09-30T22:20:09.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.853+0000 7ffaa97f5700 1 -- 172.21.15.156:0/2110960027 wait complete. 2023-09-30T22:20:09.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.854+0000 7ffaa97f5700 1 Processor -- start 2023-09-30T22:20:09.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.854+0000 7ffaa97f5700 1 -- start start 2023-09-30T22:20:09.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.855+0000 7ffaa97f5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffaa406a770 0x7ffaa411acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:09.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.855+0000 7ffaa97f5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffaa409dea0 0x7ffaa411b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:09.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.855+0000 7ffaa97f5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffaa4134f00 0x7ffaa411b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:09.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.855+0000 7ffaa97f5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa409f220 con 0x7ffaa409dea0 2023-09-30T22:20:09.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.855+0000 7ffaa97f5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa4134460 con 0x7ffaa4134f00 2023-09-30T22:20:09.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.855+0000 7ffaa97f5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa411cbc0 con 0x7ffaa406a770 2023-09-30T22:20:09.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.855+0000 7ffaa2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffaa406a770 0x7ffaa411acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:09.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.855+0000 7ffaa2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffaa406a770 0x7ffaa411acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52320/0 (socket says 172.21.15.156:52320) 2023-09-30T22:20:09.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.855+0000 7ffaa2ffd700 1 -- 172.21.15.156:0/888128007 learned_addr learned my addr 172.21.15.156:0/888128007 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:09.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.855+0000 7ffaa37fe700 1 --2- 172.21.15.156:0/888128007 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffaa4134f00 0x7ffaa411b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:09.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.855+0000 7ffaa27fc700 1 --2- 172.21.15.156:0/888128007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffaa409dea0 0x7ffaa411b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:09.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.855+0000 7ffaa2ffd700 1 -- 172.21.15.156:0/888128007 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffaa4134f00 msgr2=0x7ffaa411b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:09.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.855+0000 7ffaa2ffd700 1 --2- 172.21.15.156:0/888128007 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffaa4134f00 0x7ffaa411b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:09.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.855+0000 7ffaa2ffd700 1 -- 172.21.15.156:0/888128007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffaa409dea0 msgr2=0x7ffaa411b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:09.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.855+0000 7ffaa2ffd700 1 --2- 172.21.15.156:0/888128007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffaa409dea0 0x7ffaa411b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:09.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.855+0000 7ffaa2ffd700 1 -- 172.21.15.156:0/888128007 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa98009550 con 0x7ffaa406a770 2023-09-30T22:20:09.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.855+0000 7ffaa2ffd700 1 --2- 172.21.15.156:0/888128007 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffaa406a770 0x7ffaa411acf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009fd0 tx=0x7ffa94004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:09.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.855+0000 7ffa8b7fe700 1 -- 172.21.15.156:0/888128007 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa94004510 con 0x7ffaa406a770 2023-09-30T22:20:09.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.855+0000 7ffa8b7fe700 1 -- 172.21.15.156:0/888128007 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9401e070 con 0x7ffaa406a770 2023-09-30T22:20:09.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.855+0000 7ffaa97f5700 1 -- 172.21.15.156:0/888128007 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa940094a0 con 0x7ffaa406a770 2023-09-30T22:20:09.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.856+0000 7ffa8b7fe700 1 -- 172.21.15.156:0/888128007 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa940038e0 con 0x7ffaa406a770 2023-09-30T22:20:09.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.856+0000 7ffaa97f5700 1 -- 172.21.15.156:0/888128007 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa411d510 con 0x7ffaa406a770 2023-09-30T22:20:09.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.857+0000 7ffaa97f5700 1 -- 172.21.15.156:0/888128007 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa404f2a0 con 0x7ffaa406a770 2023-09-30T22:20:09.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.857+0000 7ffa8b7fe700 1 -- 172.21.15.156:0/888128007 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa94003a40 con 0x7ffaa406a770 2023-09-30T22:20:09.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.857+0000 7ffa8b7fe700 1 -- 172.21.15.156:0/888128007 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffa94020070 con 0x7ffaa406a770 2023-09-30T22:20:09.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.866+0000 7ffa8b7fe700 1 -- 172.21.15.156:0/888128007 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa94010380 con 0x7ffaa406a770 2023-09-30T22:20:09.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.868+0000 7f6bdc85e700 1 Processor -- start 2023-09-30T22:20:09.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.869+0000 7f6bdc85e700 1 -- start start 2023-09-30T22:20:09.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.869+0000 7f6bdc85e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6bd8133ad0 0x7f6bd8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:09.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.869+0000 7f6bdc85e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6bd81300a0 0x7f6bd81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:09.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.869+0000 7f6bdc85e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd806b2d0 con 0x7f6bd81309f0 2023-09-30T22:20:09.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.869+0000 7f6bdc85e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd8133610 con 0x7f6bd81300a0 2023-09-30T22:20:09.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.869+0000 7f6bdc85e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd809a500 con 0x7f6bd8133ad0 2023-09-30T22:20:09.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.869+0000 7f6bd5d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6bd81300a0 0x7f6bd81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:09.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.869+0000 7f6bd5d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6bd81300a0 0x7f6bd81304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:57386/0 (socket says 172.21.15.156:57386) 2023-09-30T22:20:09.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.869+0000 7f6bd5d9b700 1 -- 172.21.15.156:0/3618974904 learned_addr learned my addr 172.21.15.156:0/3618974904 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:09.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.869+0000 7f6bd6d9d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6bd81309f0 0x7f6bd813a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58410/0 (socket says 172.21.15.156:58410) 2023-09-30T22:20:09.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.870+0000 7f6bd659c700 1 --2- 172.21.15.156:0/3618974904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6bd8133ad0 0x7f6bd8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:09.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.870+0000 7f6bd5d9b700 1 -- 172.21.15.156:0/3618974904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6bd8133ad0 msgr2=0x7f6bd8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:09.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.870+0000 7f6bd559a700 1 -- 172.21.15.156:0/3618974904 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999496396 0 0) 0x7f6bd806b2d0 con 0x7f6bd81309f0 2023-09-30T22:20:09.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.870+0000 7f6bd5d9b700 1 --2- 172.21.15.156:0/3618974904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6bd8133ad0 0x7f6bd8133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:09.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.870+0000 7f6bd5d9b700 1 -- 172.21.15.156:0/3618974904 >> v1:172.21.15.156:6789/0 conn(0x7f6bd81309f0 legacy=0x7f6bd813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:09.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.870+0000 7f6bd5d9b700 1 -- 172.21.15.156:0/3618974904 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd81338b0 con 0x7f6bd81300a0 2023-09-30T22:20:09.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.870+0000 7f6bd659c700 1 --2- 172.21.15.156:0/3618974904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6bd8133ad0 0x7f6bd8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:20:09.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.870+0000 7f6bd5d9b700 1 --2- 172.21.15.156:0/3618974904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bd81300a0 0x7f6bd81304b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc0098f0 tx=0x7f6bcc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61200027f355edc9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:09.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.870+0000 7f6bd559a700 1 -- 172.21.15.156:0/3618974904 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc00b8a0 con 0x7f6bd81300a0 2023-09-30T22:20:09.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.870+0000 7f6bd559a700 1 -- 172.21.15.156:0/3618974904 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bcc00ba00 con 0x7f6bd81300a0 2023-09-30T22:20:09.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.870+0000 7f6bd559a700 1 -- 172.21.15.156:0/3618974904 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc00bd90 con 0x7f6bd81300a0 2023-09-30T22:20:09.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.871+0000 7f6bdc85e700 1 -- 172.21.15.156:0/3618974904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bd81300a0 msgr2=0x7f6bd81304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:09.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.871+0000 7f6bdc85e700 1 --2- 172.21.15.156:0/3618974904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bd81300a0 0x7f6bd81304b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc0098f0 tx=0x7f6bcc009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:09.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.871+0000 7f6bdc85e700 1 -- 172.21.15.156:0/3618974904 shutdown_connections 2023-09-30T22:20:09.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.871+0000 7f6bdc85e700 1 --2- 172.21.15.156:0/3618974904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6bd8133ad0 0x7f6bd8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:09.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.871+0000 7f6bdc85e700 1 --2- 172.21.15.156:0/3618974904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bd81300a0 0x7f6bd81304b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:09.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.871+0000 7f6bdc85e700 1 -- 172.21.15.156:0/3618974904 >> 172.21.15.156:0/3618974904 conn(0x7f6bd8099c40 msgr2=0x7f6bd80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:09.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.871+0000 7f6bdc85e700 1 -- 172.21.15.156:0/3618974904 shutdown_connections 2023-09-30T22:20:09.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.871+0000 7f6bdc85e700 1 -- 172.21.15.156:0/3618974904 wait complete. 2023-09-30T22:20:09.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.873+0000 7f6bdc85e700 1 Processor -- start 2023-09-30T22:20:09.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.873+0000 7f6bdc85e700 1 -- start start 2023-09-30T22:20:09.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.874+0000 7f6bdc85e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bd81300a0 0x7f6bd81cc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:09.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.874+0000 7f6bdc85e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6bd81309f0 0x7f6bd81cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:09.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.874+0000 7f6bdc85e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6bd8133ad0 0x7f6bd81cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:09.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.874+0000 7f6bdc85e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd80a3470 con 0x7f6bd81300a0 2023-09-30T22:20:09.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.874+0000 7f6bdc85e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd811b480 con 0x7f6bd8133ad0 2023-09-30T22:20:09.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.874+0000 7f6bdc85e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd812dd00 con 0x7f6bd81309f0 2023-09-30T22:20:09.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.874+0000 7f6bd659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bd81300a0 0x7f6bd81cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:09.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.874+0000 7f6bd659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bd81300a0 0x7f6bd81cc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:57390/0 (socket says 172.21.15.156:57390) 2023-09-30T22:20:09.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.874+0000 7f6bd659c700 1 -- 172.21.15.156:0/1494268338 learned_addr learned my addr 172.21.15.156:0/1494268338 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:09.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.874+0000 7f6bd6d9d700 1 --2- 172.21.15.156:0/1494268338 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6bd8133ad0 0x7f6bd81cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:09.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.874+0000 7f6bd659c700 1 -- 172.21.15.156:0/1494268338 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6bd81309f0 msgr2=0x7f6bd81cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:09.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.874+0000 7f6bd659c700 1 --2- 172.21.15.156:0/1494268338 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6bd81309f0 0x7f6bd81cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:09.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.874+0000 7f6bd659c700 1 -- 172.21.15.156:0/1494268338 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6bd8133ad0 msgr2=0x7f6bd81cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:09.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.874+0000 7f6bd659c700 1 --2- 172.21.15.156:0/1494268338 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6bd8133ad0 0x7f6bd81cd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:09.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.874+0000 7f6bd659c700 1 -- 172.21.15.156:0/1494268338 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bcc009550 con 0x7f6bd81300a0 2023-09-30T22:20:09.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.875+0000 7f6bd659c700 1 --2- 172.21.15.156:0/1494268338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bd81300a0 0x7f6bd81cc790 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800e810 tx=0x7f6bc800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:09.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.875+0000 7f6bc6ffd700 1 -- 172.21.15.156:0/1494268338 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8013610 con 0x7f6bd81300a0 2023-09-30T22:20:09.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.875+0000 7f6bc6ffd700 1 -- 172.21.15.156:0/1494268338 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc8013770 con 0x7f6bd81300a0 2023-09-30T22:20:09.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.875+0000 7f6bc6ffd700 1 -- 172.21.15.156:0/1494268338 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8013b20 con 0x7f6bd81300a0 2023-09-30T22:20:09.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.875+0000 7f6bdc85e700 1 -- 172.21.15.156:0/1494268338 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd8119bb0 con 0x7f6bd81300a0 2023-09-30T22:20:09.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.875+0000 7f6bdc85e700 1 -- 172.21.15.156:0/1494268338 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd811c120 con 0x7f6bd81300a0 2023-09-30T22:20:09.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.876+0000 7f6bdc85e700 1 -- 172.21.15.156:0/1494268338 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd811b610 con 0x7f6bd81300a0 2023-09-30T22:20:09.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.877+0000 7f6bc6ffd700 1 -- 172.21.15.156:0/1494268338 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6bc8013c80 con 0x7f6bd81300a0 2023-09-30T22:20:09.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.877+0000 7f6bc6ffd700 1 -- 172.21.15.156:0/1494268338 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6bc803f6d0 con 0x7f6bd81300a0 2023-09-30T22:20:09.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:09.885+0000 7f6bc6ffd700 1 -- 172.21.15.156:0/1494268338 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6bc801a540 con 0x7f6bd81300a0 2023-09-30T22:20:10.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.044+0000 7f1fbd4c6700 1 -- 172.21.15.156:0/194297482 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1fb8121710 con 0x7f1fb80a0a30 2023-09-30T22:20:10.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.044+0000 7f1f9f7fe700 1 -- 172.21.15.156:0/194297482 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1fa8011950 con 0x7f1fb80a0a30 2023-09-30T22:20:10.045 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:10.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.047+0000 7f2a3204c700 1 -- 172.21.15.156:0/2035710616 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2a2c130580 con 0x7f2a2c09d860 2023-09-30T22:20:10.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.047+0000 7f2a13fff700 1 -- 172.21.15.156:0/2035710616 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2a1c03a090 con 0x7f2a2c09d860 2023-09-30T22:20:10.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.047+0000 7f1fbd4c6700 1 -- 172.21.15.156:0/194297482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1fb80a0a30 msgr2=0x7f1fb811edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:10.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.047+0000 7f1fbd4c6700 1 --2- 172.21.15.156:0/194297482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1fb80a0a30 0x7f1fb811edd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800c520 tx=0x7f1fa800c830 comp rx=0 tx=0).stop 2023-09-30T22:20:10.048 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:10.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.047+0000 7f1fbd4c6700 1 -- 172.21.15.156:0/194297482 shutdown_connections 2023-09-30T22:20:10.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.047+0000 7f1fbd4c6700 1 --2- 172.21.15.156:0/194297482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fb81356e0 0x7f1fb811f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:10.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.047+0000 7f1fbd4c6700 1 --2- 172.21.15.156:0/194297482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1fb80a0a30 0x7f1fb811edd0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:10.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.047+0000 7f1fbd4c6700 1 --2- 172.21.15.156:0/194297482 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fb80a1510 0x7f1fb811f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:10.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.047+0000 7f1fbd4c6700 1 -- 172.21.15.156:0/194297482 >> 172.21.15.156:0/194297482 conn(0x7f1fb80a2980 msgr2=0x7f1fb809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:10.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.047+0000 7f1fbd4c6700 1 -- 172.21.15.156:0/194297482 shutdown_connections 2023-09-30T22:20:10.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.047+0000 7f1fbd4c6700 1 -- 172.21.15.156:0/194297482 wait complete. 2023-09-30T22:20:10.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.050+0000 7f2a3204c700 1 -- 172.21.15.156:0/2035710616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a2c09d860 msgr2=0x7f2a2c11e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:10.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.050+0000 7f2a3204c700 1 --2- 172.21.15.156:0/2035710616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a2c09d860 0x7f2a2c11e3e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00f330 tx=0x7f2a1c004750 comp rx=0 tx=0).stop 2023-09-30T22:20:10.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.052+0000 7f2a3204c700 1 -- 172.21.15.156:0/2035710616 shutdown_connections 2023-09-30T22:20:10.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.052+0000 7f2a3204c700 1 --2- 172.21.15.156:0/2035710616 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a2c130ce0 0x7f2a2c11ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:10.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.052+0000 7f2a3204c700 1 --2- 172.21.15.156:0/2035710616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a2c09d860 0x7f2a2c11e3e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:10.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.052+0000 7f2a3204c700 1 --2- 172.21.15.156:0/2035710616 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a2c09e170 0x7f2a2c11e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:10.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.052+0000 7f2a3204c700 1 -- 172.21.15.156:0/2035710616 >> 172.21.15.156:0/2035710616 conn(0x7f2a2c099c40 msgr2=0x7f2a2c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:10.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.052+0000 7f2a3204c700 1 -- 172.21.15.156:0/2035710616 shutdown_connections 2023-09-30T22:20:10.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.052+0000 7f2a3204c700 1 -- 172.21.15.156:0/2035710616 wait complete. 2023-09-30T22:20:10.066 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:10.071 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:10.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.073+0000 7ffaa97f5700 1 -- 172.21.15.156:0/888128007 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffaa4139530 con 0x7ffaa406a770 2023-09-30T22:20:10.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.074+0000 7ffa8b7fe700 1 -- 172.21.15.156:0/888128007 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa94015070 con 0x7ffaa406a770 2023-09-30T22:20:10.074 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:10.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.076+0000 7ffaa97f5700 1 -- 172.21.15.156:0/888128007 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffaa406a770 msgr2=0x7ffaa411acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:10.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.076+0000 7ffaa97f5700 1 --2- 172.21.15.156:0/888128007 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffaa406a770 0x7ffaa411acf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009fd0 tx=0x7ffa94004750 comp rx=0 tx=0).stop 2023-09-30T22:20:10.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.076+0000 7ffaa97f5700 1 -- 172.21.15.156:0/888128007 shutdown_connections 2023-09-30T22:20:10.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.076+0000 7ffaa97f5700 1 --2- 172.21.15.156:0/888128007 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffaa4134f00 0x7ffaa411b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:10.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.076+0000 7ffaa97f5700 1 --2- 172.21.15.156:0/888128007 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffaa406a770 0x7ffaa411acf0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:10.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.076+0000 7ffaa97f5700 1 --2- 172.21.15.156:0/888128007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffaa409dea0 0x7ffaa411b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:10.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.076+0000 7ffaa97f5700 1 -- 172.21.15.156:0/888128007 >> 172.21.15.156:0/888128007 conn(0x7ffaa4099c40 msgr2=0x7ffaa409c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:10.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.076+0000 7ffaa97f5700 1 -- 172.21.15.156:0/888128007 shutdown_connections 2023-09-30T22:20:10.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.076+0000 7ffaa97f5700 1 -- 172.21.15.156:0/888128007 wait complete. 2023-09-30T22:20:10.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:10.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.092+0000 7f6bdc85e700 1 -- 172.21.15.156:0/1494268338 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6bd811b5c0 con 0x7f6bd81300a0 2023-09-30T22:20:10.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.092+0000 7f6bc6ffd700 1 -- 172.21.15.156:0/1494268338 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6bc8021070 con 0x7f6bd81300a0 2023-09-30T22:20:10.093 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:10.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.094+0000 7f6bdc85e700 1 -- 172.21.15.156:0/1494268338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bd81300a0 msgr2=0x7f6bd81cc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:10.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.094+0000 7f6bdc85e700 1 --2- 172.21.15.156:0/1494268338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bd81300a0 0x7f6bd81cc790 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800e810 tx=0x7f6bc800eb20 comp rx=0 tx=0).stop 2023-09-30T22:20:10.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.094+0000 7f6bdc85e700 1 -- 172.21.15.156:0/1494268338 shutdown_connections 2023-09-30T22:20:10.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.094+0000 7f6bdc85e700 1 --2- 172.21.15.156:0/1494268338 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6bd8133ad0 0x7f6bd81cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:10.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.094+0000 7f6bdc85e700 1 --2- 172.21.15.156:0/1494268338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bd81300a0 0x7f6bd81cc790 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:10.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.094+0000 7f6bdc85e700 1 --2- 172.21.15.156:0/1494268338 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6bd81309f0 0x7f6bd81cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:10.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.094+0000 7f6bdc85e700 1 -- 172.21.15.156:0/1494268338 >> 172.21.15.156:0/1494268338 conn(0x7f6bd8099c40 msgr2=0x7f6bd8132920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:10.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.094+0000 7f6bdc85e700 1 -- 172.21.15.156:0/1494268338 shutdown_connections 2023-09-30T22:20:10.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:10.094+0000 7f6bdc85e700 1 -- 172.21.15.156:0/1494268338 wait complete. 2023-09-30T22:20:10.108 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:11.067 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:11.071 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:11.091 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:11.109 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:11.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.220+0000 7f57ea70e700 1 Processor -- start 2023-09-30T22:20:11.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.220+0000 7f57ea70e700 1 -- start start 2023-09-30T22:20:11.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.221+0000 7f57ea70e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f57e40a0a70 0x7f57e40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:11.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.221+0000 7f57ea70e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f57e40a1380 0x7f57e4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:11.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.221+0000 7f57ea70e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e409dc00 con 0x7f57e4133f50 2023-09-30T22:20:11.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.221+0000 7f57ea70e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57e409ea60 con 0x7f57e40a0a70 2023-09-30T22:20:11.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.221+0000 7f57ea70e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57e409dec0 con 0x7f57e40a1380 2023-09-30T22:20:11.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.221+0000 7f57e3fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f57e40a0a70 0x7f57e40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:11.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.221+0000 7f57e3fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f57e40a0a70 0x7f57e40a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:57406/0 (socket says 172.21.15.156:57406) 2023-09-30T22:20:11.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.221+0000 7f57e3fff700 1 -- 172.21.15.156:0/244729334 learned_addr learned my addr 172.21.15.156:0/244729334 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:11.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.221+0000 7f57e37fe700 1 --2- 172.21.15.156:0/244729334 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f57e40a1380 0x7f57e4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:11.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.221+0000 7f57e3fff700 1 -- 172.21.15.156:0/244729334 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f57e40a1380 msgr2=0x7f57e4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:11.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.221+0000 7f57e3fff700 1 --2- 172.21.15.156:0/244729334 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f57e40a1380 0x7f57e4133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.221+0000 7f57e3fff700 1 -- 172.21.15.156:0/244729334 >> v1:172.21.15.156:6789/0 conn(0x7f57e4133f50 legacy=0x7f57e413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:11.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.221+0000 7f57e3fff700 1 -- 172.21.15.156:0/244729334 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e409e6a0 con 0x7f57e40a0a70 2023-09-30T22:20:11.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.222+0000 7f57e3fff700 1 --2- 172.21.15.156:0/244729334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57e40a0a70 0x7f57e40a0e40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f57d40098f0 tx=0x7f57d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b27b20889c8f0b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:11.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.222+0000 7f57e2ffd700 1 -- 172.21.15.156:0/244729334 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d4011830 con 0x7f57e40a0a70 2023-09-30T22:20:11.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.222+0000 7f57e2ffd700 1 -- 172.21.15.156:0/244729334 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d4011990 con 0x7f57e40a0a70 2023-09-30T22:20:11.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.222+0000 7f57e2ffd700 1 -- 172.21.15.156:0/244729334 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d4011d20 con 0x7f57e40a0a70 2023-09-30T22:20:11.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.222+0000 7f57ea70e700 1 -- 172.21.15.156:0/244729334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57e40a0a70 msgr2=0x7f57e40a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:11.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.222+0000 7f57ea70e700 1 --2- 172.21.15.156:0/244729334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57e40a0a70 0x7f57e40a0e40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f57d40098f0 tx=0x7f57d4009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:11.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.223+0000 7f57ea70e700 1 -- 172.21.15.156:0/244729334 shutdown_connections 2023-09-30T22:20:11.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.223+0000 7f57ea70e700 1 --2- 172.21.15.156:0/244729334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57e40a0a70 0x7f57e40a0e40 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.223+0000 7f57ea70e700 1 --2- 172.21.15.156:0/244729334 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f57e40a1380 0x7f57e4133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.223+0000 7f57ea70e700 1 -- 172.21.15.156:0/244729334 >> 172.21.15.156:0/244729334 conn(0x7f57e40a6610 msgr2=0x7f57e40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:11.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.223+0000 7f57ea70e700 1 -- 172.21.15.156:0/244729334 shutdown_connections 2023-09-30T22:20:11.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.223+0000 7f57ea70e700 1 -- 172.21.15.156:0/244729334 wait complete. 2023-09-30T22:20:11.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.224+0000 7f57ea70e700 1 Processor -- start 2023-09-30T22:20:11.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.224+0000 7f57ea70e700 1 -- start start 2023-09-30T22:20:11.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.224+0000 7f57ea70e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57e40a0a70 0x7f57e411e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:11.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.224+0000 7f57ea70e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f57e40a1380 0x7f57e411ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:11.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.224+0000 7f57ea70e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f57e4133f50 0x7f57e411f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:11.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.224+0000 7f57ea70e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e4133790 con 0x7f57e40a0a70 2023-09-30T22:20:11.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.224+0000 7f57ea70e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e4122320 con 0x7f57e4133f50 2023-09-30T22:20:11.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.224+0000 7f57ea70e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57e41339d0 con 0x7f57e40a1380 2023-09-30T22:20:11.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.225+0000 7f57e3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57e40a0a70 0x7f57e411e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:11.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.225+0000 7f57e3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57e40a0a70 0x7f57e411e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:57418/0 (socket says 172.21.15.156:57418) 2023-09-30T22:20:11.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.225+0000 7f57e3fff700 1 -- 172.21.15.156:0/3198933079 learned_addr learned my addr 172.21.15.156:0/3198933079 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:11.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.225+0000 7f57e37fe700 1 --2- 172.21.15.156:0/3198933079 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f57e40a1380 0x7f57e411ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:11.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.225+0000 7f57e3fff700 1 -- 172.21.15.156:0/3198933079 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f57e40a1380 msgr2=0x7f57e411ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:11.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.225+0000 7f57e3fff700 1 --2- 172.21.15.156:0/3198933079 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f57e40a1380 0x7f57e411ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.225+0000 7f57e3fff700 1 -- 172.21.15.156:0/3198933079 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f57e4133f50 msgr2=0x7f57e411f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:11.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.225+0000 7f57e3fff700 1 --2- 172.21.15.156:0/3198933079 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f57e4133f50 0x7f57e411f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.225+0000 7f57e3fff700 1 -- 172.21.15.156:0/3198933079 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d4009550 con 0x7f57e40a0a70 2023-09-30T22:20:11.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.225+0000 7f57e3fff700 1 --2- 172.21.15.156:0/3198933079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57e40a0a70 0x7f57e411e840 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f57d4000c00 tx=0x7f57d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:11.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.225+0000 7f57e0ff9700 1 -- 172.21.15.156:0/3198933079 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d4004480 con 0x7f57e40a0a70 2023-09-30T22:20:11.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.225+0000 7f57e0ff9700 1 -- 172.21.15.156:0/3198933079 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d401f070 con 0x7f57e40a0a70 2023-09-30T22:20:11.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.225+0000 7f57e0ff9700 1 -- 172.21.15.156:0/3198933079 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d40038c0 con 0x7f57e40a0a70 2023-09-30T22:20:11.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.225+0000 7f57ea70e700 1 -- 172.21.15.156:0/3198933079 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e41204b0 con 0x7f57e40a0a70 2023-09-30T22:20:11.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.226+0000 7f57ea70e700 1 -- 172.21.15.156:0/3198933079 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e4120c00 con 0x7f57e40a0a70 2023-09-30T22:20:11.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.226+0000 7f57e0ff9700 1 -- 172.21.15.156:0/3198933079 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f57d4021030 con 0x7f57e40a0a70 2023-09-30T22:20:11.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.226+0000 7f57e0ff9700 1 -- 172.21.15.156:0/3198933079 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f57d4040a50 con 0x7f57e40a0a70 2023-09-30T22:20:11.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.227+0000 7f57ea70e700 1 -- 172.21.15.156:0/3198933079 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57e4122b70 con 0x7f57e40a0a70 2023-09-30T22:20:11.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.232+0000 7f57e0ff9700 1 -- 172.21.15.156:0/3198933079 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f57d4015080 con 0x7f57e40a0a70 2023-09-30T22:20:11.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.250+0000 7f02a3b9a700 1 Processor -- start 2023-09-30T22:20:11.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.250+0000 7f02a3b9a700 1 -- start start 2023-09-30T22:20:11.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.251+0000 7f02a3b9a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f029c09e870 0x7f029c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:11.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.251+0000 7f02a3b9a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f029c09f180 0x7f029c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:11.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.251+0000 7f02a3b9a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f029c131d70 0x7f029c132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:11.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.251+0000 7f02a3b9a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029c0a0920 con 0x7f029c09f180 2023-09-30T22:20:11.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.251+0000 7f02a3b9a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029c09c970 con 0x7f029c131d70 2023-09-30T22:20:11.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.251+0000 7f02a3b9a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f029c09bab0 con 0x7f029c09e870 2023-09-30T22:20:11.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.251+0000 7f366d372700 1 Processor -- start 2023-09-30T22:20:11.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.251+0000 7f02a2137700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f029c131d70 0x7f029c132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:11.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.251+0000 7f366d372700 1 -- start start 2023-09-30T22:20:11.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.251+0000 7f02a2137700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f029c131d70 0x7f029c132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48714/0 (socket says 172.21.15.156:48714) 2023-09-30T22:20:11.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.251+0000 7f02a2137700 1 -- 172.21.15.156:0/1841963160 learned_addr learned my addr 172.21.15.156:0/1841963160 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:11.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.251+0000 7f02a1936700 1 --2- 172.21.15.156:0/1841963160 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f029c09e870 0x7f029c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:11.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.252+0000 7f02a1936700 1 -- 172.21.15.156:0/1841963160 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f029c131d70 msgr2=0x7f029c132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:11.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.252+0000 7f02a1936700 1 --2- 172.21.15.156:0/1841963160 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f029c131d70 0x7f029c132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.252+0000 7f02a1936700 1 -- 172.21.15.156:0/1841963160 >> v2:172.21.15.156:3300/0 conn(0x7f029c09f180 msgr2=0x7f029c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:11.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.252+0000 7f02a1936700 1 --2- 172.21.15.156:0/1841963160 >> v2:172.21.15.156:3300/0 conn(0x7f029c09f180 0x7f029c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.252+0000 7f02a1936700 1 -- 172.21.15.156:0/1841963160 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029c09f9c0 con 0x7f029c09e870 2023-09-30T22:20:11.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.252+0000 7f02a1936700 1 --2- 172.21.15.156:0/1841963160 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f029c09e870 0x7f029c09ec40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0298009840 tx=0x7f0298009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=630e432b6e801947 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:11.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.252+0000 7f366d372700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f366812e490 0x7f366812e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:11.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.252+0000 7f366d372700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f366809da10 0x7f366806a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:11.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.252+0000 7f366d372700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f366806acb0 0x7f366806b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:11.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.252+0000 7f366d372700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f366812de50 con 0x7f366806acb0 2023-09-30T22:20:11.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.252+0000 7f366d372700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366809f6e0 con 0x7f366812e490 2023-09-30T22:20:11.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.252+0000 7f366d372700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f366809eb00 con 0x7f366809da10 2023-09-30T22:20:11.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.252+0000 7f36667fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f366809da10 0x7f366806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:11.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.252+0000 7f36667fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f366809da10 0x7f366806a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52382/0 (socket says 172.21.15.156:52382) 2023-09-30T22:20:11.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.252+0000 7f36667fc700 1 -- 172.21.15.156:0/1567173964 learned_addr learned my addr 172.21.15.156:0/1567173964 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:11.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.252+0000 7f3666ffd700 1 --2- 172.21.15.156:0/1567173964 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f366812e490 0x7f366812e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:11.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.252+0000 7f02a0934700 1 -- 172.21.15.156:0/1841963160 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0298010a90 con 0x7f029c09e870 2023-09-30T22:20:11.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.252+0000 7f02a0934700 1 -- 172.21.15.156:0/1841963160 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0298010bf0 con 0x7f029c09e870 2023-09-30T22:20:11.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.252+0000 7f02a0934700 1 -- 172.21.15.156:0/1841963160 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0298018440 con 0x7f029c09e870 2023-09-30T22:20:11.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.252+0000 7f36667fc700 1 -- 172.21.15.156:0/1567173964 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f366812e490 msgr2=0x7f366812e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:11.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.252+0000 7f36667fc700 1 --2- 172.21.15.156:0/1567173964 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f366812e490 0x7f366812e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.252+0000 7f36667fc700 1 -- 172.21.15.156:0/1567173964 >> v2:172.21.15.156:3300/0 conn(0x7f366806acb0 msgr2=0x7f366806b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:11.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.252+0000 7f36667fc700 1 --2- 172.21.15.156:0/1567173964 >> v2:172.21.15.156:3300/0 conn(0x7f366806acb0 0x7f366806b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.252+0000 7f36667fc700 1 -- 172.21.15.156:0/1567173964 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366809e780 con 0x7f366809da10 2023-09-30T22:20:11.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.252+0000 7f36667fc700 1 --2- 172.21.15.156:0/1567173964 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f366809da10 0x7f366806a770 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3650009920 tx=0x7f3650009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c11b1e59b261e8f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:11.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.253+0000 7f3665ffb700 1 -- 172.21.15.156:0/1567173964 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3650011830 con 0x7f366809da10 2023-09-30T22:20:11.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.253+0000 7f3665ffb700 1 -- 172.21.15.156:0/1567173964 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3650011990 con 0x7f366809da10 2023-09-30T22:20:11.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.253+0000 7f3665ffb700 1 -- 172.21.15.156:0/1567173964 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3650011d20 con 0x7f366809da10 2023-09-30T22:20:11.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.253+0000 7f02a3b9a700 1 -- 172.21.15.156:0/1841963160 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f029c09e870 msgr2=0x7f029c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:11.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.253+0000 7f02a3b9a700 1 --2- 172.21.15.156:0/1841963160 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f029c09e870 0x7f029c09ec40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0298009840 tx=0x7f0298009b50 comp rx=0 tx=0).stop 2023-09-30T22:20:11.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.253+0000 7f02a3b9a700 1 -- 172.21.15.156:0/1841963160 shutdown_connections 2023-09-30T22:20:11.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.253+0000 7f02a3b9a700 1 --2- 172.21.15.156:0/1841963160 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f029c131d70 0x7f029c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.253+0000 7f02a3b9a700 1 --2- 172.21.15.156:0/1841963160 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f029c09e870 0x7f029c09ec40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.253+0000 7f02a3b9a700 1 --2- 172.21.15.156:0/1841963160 >> v2:172.21.15.156:3300/0 conn(0x7f029c09f180 0x7f029c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.253+0000 7f02a3b9a700 1 -- 172.21.15.156:0/1841963160 >> 172.21.15.156:0/1841963160 conn(0x7f029c0a4430 msgr2=0x7f029c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:11.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.253+0000 7f02a3b9a700 1 -- 172.21.15.156:0/1841963160 shutdown_connections 2023-09-30T22:20:11.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.253+0000 7f02a3b9a700 1 -- 172.21.15.156:0/1841963160 wait complete. 2023-09-30T22:20:11.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.253+0000 7f366d372700 1 -- 172.21.15.156:0/1567173964 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f366809da10 msgr2=0x7f366806a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:11.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.253+0000 7f366d372700 1 --2- 172.21.15.156:0/1567173964 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f366809da10 0x7f366806a770 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3650009920 tx=0x7f3650009c30 comp rx=0 tx=0).stop 2023-09-30T22:20:11.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.254+0000 7f366d372700 1 -- 172.21.15.156:0/1567173964 shutdown_connections 2023-09-30T22:20:11.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.254+0000 7f366d372700 1 --2- 172.21.15.156:0/1567173964 >> v2:172.21.15.156:3300/0 conn(0x7f366806acb0 0x7f366806b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.254+0000 7f366d372700 1 --2- 172.21.15.156:0/1567173964 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f366812e490 0x7f366812e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.254+0000 7f366d372700 1 --2- 172.21.15.156:0/1567173964 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f366809da10 0x7f366806a770 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.254+0000 7f366d372700 1 -- 172.21.15.156:0/1567173964 >> 172.21.15.156:0/1567173964 conn(0x7f3668099c40 msgr2=0x7f36680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:11.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.254+0000 7f02a3b9a700 1 Processor -- start 2023-09-30T22:20:11.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.254+0000 7f366d372700 1 -- 172.21.15.156:0/1567173964 shutdown_connections 2023-09-30T22:20:11.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.254+0000 7f366d372700 1 -- 172.21.15.156:0/1567173964 wait complete. 2023-09-30T22:20:11.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.254+0000 7f02a3b9a700 1 -- start start 2023-09-30T22:20:11.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.255+0000 7f02a3b9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f029c09e870 0x7f029c11bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:11.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.255+0000 7f02a3b9a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f029c09f180 0x7f029c11c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:11.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.255+0000 7f02a3b9a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f029c131d70 0x7f029c11c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:11.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.255+0000 7f02a3b9a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c11f730 con 0x7f029c09e870 2023-09-30T22:20:11.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.255+0000 7f02a3b9a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029c11dc10 con 0x7f029c09f180 2023-09-30T22:20:11.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.255+0000 7f02a3b9a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f029c0a2c60 con 0x7f029c131d70 2023-09-30T22:20:11.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.255+0000 7f366d372700 1 Processor -- start 2023-09-30T22:20:11.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.255+0000 7f02a2137700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f029c131d70 0x7f029c11c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:11.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.255+0000 7f02a2137700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f029c131d70 0x7f029c11c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44556/0 (socket says 172.21.15.156:44556) 2023-09-30T22:20:11.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.255+0000 7f02a2137700 1 -- 172.21.15.156:0/965400442 learned_addr learned my addr 172.21.15.156:0/965400442 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:11.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.255+0000 7f366d372700 1 -- start start 2023-09-30T22:20:11.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.256+0000 7f366d372700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f366806acb0 0x7f366813bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:11.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.256+0000 7f3666ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f366806acb0 0x7f366813bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:11.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.256+0000 7f3666ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f366806acb0 0x7f366813bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44570/0 (socket says 172.21.15.156:44570) 2023-09-30T22:20:11.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.256+0000 7f02a1936700 1 --2- 172.21.15.156:0/965400442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f029c09e870 0x7f029c11bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:11.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.256+0000 7f02a1135700 1 --2- 172.21.15.156:0/965400442 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f029c09f180 0x7f029c11c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:11.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.256+0000 7f02a1936700 1 -- 172.21.15.156:0/965400442 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f029c131d70 msgr2=0x7f029c11c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:11.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.256+0000 7f02a1936700 1 --2- 172.21.15.156:0/965400442 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f029c131d70 0x7f029c11c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.256+0000 7f02a1936700 1 -- 172.21.15.156:0/965400442 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f029c09f180 msgr2=0x7f029c11c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:11.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.256+0000 7f02a1936700 1 --2- 172.21.15.156:0/965400442 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f029c09f180 0x7f029c11c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.256+0000 7f02a1936700 1 -- 172.21.15.156:0/965400442 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02980094a0 con 0x7f029c09e870 2023-09-30T22:20:11.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.256+0000 7f366d372700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f366809da10 0x7f366813c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:11.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.256+0000 7f366d372700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f366812e490 0x7f3668138770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:11.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.256+0000 7f366d372700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366813a080 con 0x7f366812e490 2023-09-30T22:20:11.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.256+0000 7f366d372700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366809c0f0 con 0x7f366809da10 2023-09-30T22:20:11.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.256+0000 7f366d372700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f366813b0c0 con 0x7f366806acb0 2023-09-30T22:20:11.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.256+0000 7f3666ffd700 1 -- 172.21.15.156:0/2746682844 learned_addr learned my addr 172.21.15.156:0/2746682844 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:11.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.257+0000 7f36677fe700 1 --2- 172.21.15.156:0/2746682844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f366812e490 0x7f3668138770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:11.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.257+0000 7f3666ffd700 1 -- 172.21.15.156:0/2746682844 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f366809da10 msgr2=0x7f366813c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:11.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.257+0000 7f3666ffd700 1 --2- 172.21.15.156:0/2746682844 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f366809da10 0x7f366813c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.257+0000 7f3666ffd700 1 -- 172.21.15.156:0/2746682844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f366812e490 msgr2=0x7f3668138770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:11.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.257+0000 7f3666ffd700 1 --2- 172.21.15.156:0/2746682844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f366812e490 0x7f3668138770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.257+0000 7f3666ffd700 1 -- 172.21.15.156:0/2746682844 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3650009550 con 0x7f366806acb0 2023-09-30T22:20:11.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.257+0000 7f36677fe700 1 --2- 172.21.15.156:0/2746682844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f366812e490 0x7f3668138770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:20:11.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.257+0000 7f3666ffd700 1 --2- 172.21.15.156:0/2746682844 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f366806acb0 0x7f366813bed0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f365800efc0 tx=0x7f365800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:11.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.257+0000 7f02a1936700 1 --2- 172.21.15.156:0/965400442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f029c09e870 0x7f029c11bef0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0298009840 tx=0x7f0298004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:11.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.257+0000 7f02927fc700 1 -- 172.21.15.156:0/965400442 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0298003bf0 con 0x7f029c09e870 2023-09-30T22:20:11.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.257+0000 7f02927fc700 1 -- 172.21.15.156:0/965400442 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0298003d50 con 0x7f029c09e870 2023-09-30T22:20:11.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.257+0000 7f02927fc700 1 -- 172.21.15.156:0/965400442 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0298023650 con 0x7f029c09e870 2023-09-30T22:20:11.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.257+0000 7f02a3b9a700 1 -- 172.21.15.156:0/965400442 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f029c09dba0 con 0x7f029c09e870 2023-09-30T22:20:11.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.257+0000 7f02a3b9a700 1 -- 172.21.15.156:0/965400442 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f029c11fa10 con 0x7f029c09e870 2023-09-30T22:20:11.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.258+0000 7f02927fc700 1 -- 172.21.15.156:0/965400442 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f029801f070 con 0x7f029c09e870 2023-09-30T22:20:11.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.258+0000 7f02a3b9a700 1 -- 172.21.15.156:0/965400442 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f029c04f2a0 con 0x7f029c09e870 2023-09-30T22:20:11.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.259+0000 7f365f7fe700 1 -- 172.21.15.156:0/2746682844 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365800cdc0 con 0x7f366806acb0 2023-09-30T22:20:11.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.259+0000 7f365f7fe700 1 -- 172.21.15.156:0/2746682844 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365800f040 con 0x7f366806acb0 2023-09-30T22:20:11.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.259+0000 7f366d372700 1 -- 172.21.15.156:0/2746682844 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f366813a400 con 0x7f366806acb0 2023-09-30T22:20:11.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.259+0000 7f365f7fe700 1 -- 172.21.15.156:0/2746682844 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36580146a0 con 0x7f366806acb0 2023-09-30T22:20:11.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.259+0000 7f366d372700 1 -- 172.21.15.156:0/2746682844 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f366813a850 con 0x7f366806acb0 2023-09-30T22:20:11.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.260+0000 7f366d372700 1 -- 172.21.15.156:0/2746682844 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f366804f2a0 con 0x7f366806acb0 2023-09-30T22:20:11.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.260+0000 7f365f7fe700 1 -- 172.21.15.156:0/2746682844 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3658014800 con 0x7f366806acb0 2023-09-30T22:20:11.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.261+0000 7f365f7fe700 1 -- 172.21.15.156:0/2746682844 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3658040c00 con 0x7f366806acb0 2023-09-30T22:20:11.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.259+0000 7f02927fc700 1 -- 172.21.15.156:0/965400442 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0298045090 con 0x7f029c09e870 2023-09-30T22:20:11.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.263+0000 7f02927fc700 1 -- 172.21.15.156:0/965400442 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0298027020 con 0x7f029c09e870 2023-09-30T22:20:11.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.265+0000 7f365f7fe700 1 -- 172.21.15.156:0/2746682844 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3658014d40 con 0x7f366806acb0 2023-09-30T22:20:11.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.265+0000 7f71d0ce3700 1 Processor -- start 2023-09-30T22:20:11.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.265+0000 7f71d0ce3700 1 -- start start 2023-09-30T22:20:11.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.266+0000 7f71d0ce3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f71cc09d860 0x7f71cc09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:11.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.266+0000 7f71d0ce3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f71cc09e170 0x7f71cc1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:11.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.266+0000 7f71d0ce3700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71cc09aaa0 con 0x7f71cc130ce0 2023-09-30T22:20:11.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.266+0000 7f71d0ce3700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71cc09f870 con 0x7f71cc09e170 2023-09-30T22:20:11.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.266+0000 7f71d0ce3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc09b360 con 0x7f71cc09d860 2023-09-30T22:20:11.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.266+0000 7f71cad9d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f71cc130ce0 0x7f71cc1379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:43288/0 (socket says 172.21.15.156:43288) 2023-09-30T22:20:11.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.266+0000 7f71cad9d700 1 -- 172.21.15.156:0/1022053984 learned_addr learned my addr 172.21.15.156:0/1022053984 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:11.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.266+0000 7f71c9d9b700 1 --2- 172.21.15.156:0/1022053984 >> v2:172.21.15.156:3300/0 conn(0x7f71cc09e170 0x7f71cc1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:11.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.266+0000 7f71ca59c700 1 --2- 172.21.15.156:0/1022053984 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f71cc09d860 0x7f71cc09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:11.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.267+0000 7f71ca59c700 1 -- 172.21.15.156:0/1022053984 >> v2:172.21.15.156:3300/0 conn(0x7f71cc09e170 msgr2=0x7f71cc1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:11.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.267+0000 7f71ca59c700 1 --2- 172.21.15.156:0/1022053984 >> v2:172.21.15.156:3300/0 conn(0x7f71cc09e170 0x7f71cc1307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.267+0000 7f71ca59c700 1 -- 172.21.15.156:0/1022053984 >> v1:172.21.15.156:6789/0 conn(0x7f71cc130ce0 legacy=0x7f71cc1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:11.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.267+0000 7f71ca59c700 1 -- 172.21.15.156:0/1022053984 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71cc09b620 con 0x7f71cc09d860 2023-09-30T22:20:11.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.267+0000 7f71c9d9b700 1 --2- 172.21.15.156:0/1022053984 >> v2:172.21.15.156:3300/0 conn(0x7f71cc09e170 0x7f71cc1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:11.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.267+0000 7f71ca59c700 1 --2- 172.21.15.156:0/1022053984 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f71cc09d860 0x7f71cc09dc30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f71bc009840 tx=0x7f71bc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b33b8ab14731b0d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:11.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.267+0000 7f71c959a700 1 -- 172.21.15.156:0/1022053984 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc011830 con 0x7f71cc09d860 2023-09-30T22:20:11.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.267+0000 7f71c959a700 1 -- 172.21.15.156:0/1022053984 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71bc011990 con 0x7f71cc09d860 2023-09-30T22:20:11.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.267+0000 7f71c959a700 1 -- 172.21.15.156:0/1022053984 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc011d20 con 0x7f71cc09d860 2023-09-30T22:20:11.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.268+0000 7f71d0ce3700 1 -- 172.21.15.156:0/1022053984 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f71cc09d860 msgr2=0x7f71cc09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:11.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.268+0000 7f71d0ce3700 1 --2- 172.21.15.156:0/1022053984 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f71cc09d860 0x7f71cc09dc30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f71bc009840 tx=0x7f71bc009b50 comp rx=0 tx=0).stop 2023-09-30T22:20:11.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.268+0000 7f71d0ce3700 1 -- 172.21.15.156:0/1022053984 shutdown_connections 2023-09-30T22:20:11.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.268+0000 7f71d0ce3700 1 --2- 172.21.15.156:0/1022053984 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f71cc09d860 0x7f71cc09dc30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.268+0000 7f71d0ce3700 1 --2- 172.21.15.156:0/1022053984 >> v2:172.21.15.156:3300/0 conn(0x7f71cc09e170 0x7f71cc1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.268+0000 7f71d0ce3700 1 -- 172.21.15.156:0/1022053984 >> 172.21.15.156:0/1022053984 conn(0x7f71cc099c40 msgr2=0x7f71cc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:11.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.268+0000 7f71d0ce3700 1 -- 172.21.15.156:0/1022053984 shutdown_connections 2023-09-30T22:20:11.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.268+0000 7f71d0ce3700 1 -- 172.21.15.156:0/1022053984 wait complete. 2023-09-30T22:20:11.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.269+0000 7f71d0ce3700 1 Processor -- start 2023-09-30T22:20:11.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.270+0000 7f71d0ce3700 1 -- start start 2023-09-30T22:20:11.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.270+0000 7f71d0ce3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f71cc09d860 0x7f71cc135690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:11.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.270+0000 7f71d0ce3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f71cc09e170 0x7f71cc135bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:11.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.270+0000 7f71d0ce3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71cc130ce0 0x7f71cc136110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:11.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.270+0000 7f71d0ce3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc137b30 con 0x7f71cc130ce0 2023-09-30T22:20:11.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.270+0000 7f71d0ce3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc1372a0 con 0x7f71cc09e170 2023-09-30T22:20:11.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.270+0000 7f71d0ce3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc072130 con 0x7f71cc09d860 2023-09-30T22:20:11.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.270+0000 7f71c9d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f71cc09e170 0x7f71cc135bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.270+0000 7f71c9d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f71cc09e170 0x7f71cc135bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33432/0 (socket says 172.21.15.156:33432) 2023-09-30T22:20:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.270+0000 7f71c9d9b700 1 -- 172.21.15.156:0/3170216141 learned_addr learned my addr 172.21.15.156:0/3170216141 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.270+0000 7f71cad9d700 1 --2- 172.21.15.156:0/3170216141 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71cc130ce0 0x7f71cc136110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.271+0000 7f71c9d9b700 1 -- 172.21.15.156:0/3170216141 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f71cc09d860 msgr2=0x7f71cc135690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.271+0000 7f71c9d9b700 1 --2- 172.21.15.156:0/3170216141 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f71cc09d860 0x7f71cc135690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.271+0000 7f71c9d9b700 1 -- 172.21.15.156:0/3170216141 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71cc130ce0 msgr2=0x7f71cc136110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.271+0000 7f71c9d9b700 1 --2- 172.21.15.156:0/3170216141 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71cc130ce0 0x7f71cc136110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.271+0000 7f71c9d9b700 1 -- 172.21.15.156:0/3170216141 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c00094a0 con 0x7f71cc09e170 2023-09-30T22:20:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.271+0000 7f71cad9d700 1 --2- 172.21.15.156:0/3170216141 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71cc130ce0 0x7f71cc136110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.271+0000 7f71c9d9b700 1 --2- 172.21.15.156:0/3170216141 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f71cc09e170 0x7f71cc135bd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f71c000ebb0 tx=0x7f71c000eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:11.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.271+0000 7f71baffd700 1 -- 172.21.15.156:0/3170216141 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c000c850 con 0x7f71cc09e170 2023-09-30T22:20:11.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.271+0000 7f71baffd700 1 -- 172.21.15.156:0/3170216141 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c000c9b0 con 0x7f71cc09e170 2023-09-30T22:20:11.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.271+0000 7f71d0ce3700 1 -- 172.21.15.156:0/3170216141 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71bc0094a0 con 0x7f71cc09e170 2023-09-30T22:20:11.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.271+0000 7f71baffd700 1 -- 172.21.15.156:0/3170216141 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c000cd40 con 0x7f71cc09e170 2023-09-30T22:20:11.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.271+0000 7f71d0ce3700 1 -- 172.21.15.156:0/3170216141 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71cc138940 con 0x7f71cc09e170 2023-09-30T22:20:11.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.272+0000 7f71d0ce3700 1 -- 172.21.15.156:0/3170216141 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71cc138b70 con 0x7f71cc09e170 2023-09-30T22:20:11.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.273+0000 7f71baffd700 1 -- 172.21.15.156:0/3170216141 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f71c0013470 con 0x7f71cc09e170 2023-09-30T22:20:11.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.273+0000 7f71baffd700 1 -- 172.21.15.156:0/3170216141 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f71c003f9b0 con 0x7f71cc09e170 2023-09-30T22:20:11.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.282+0000 7f71baffd700 1 -- 172.21.15.156:0/3170216141 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f71cc138b70 con 0x7f71cc09e170 2023-09-30T22:20:11.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.454+0000 7f57ea70e700 1 -- 172.21.15.156:0/3198933079 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f57e404f2a0 con 0x7f57e40a0a70 2023-09-30T22:20:11.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.455+0000 7f57e0ff9700 1 -- 172.21.15.156:0/3198933079 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f57d4003a20 con 0x7f57e40a0a70 2023-09-30T22:20:11.456 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:11.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.458+0000 7f57ea70e700 1 -- 172.21.15.156:0/3198933079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57e40a0a70 msgr2=0x7f57e411e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:11.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.458+0000 7f57ea70e700 1 --2- 172.21.15.156:0/3198933079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57e40a0a70 0x7f57e411e840 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f57d4000c00 tx=0x7f57d4004750 comp rx=0 tx=0).stop 2023-09-30T22:20:11.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.458+0000 7f57ea70e700 1 -- 172.21.15.156:0/3198933079 shutdown_connections 2023-09-30T22:20:11.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.458+0000 7f57ea70e700 1 --2- 172.21.15.156:0/3198933079 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f57e4133f50 0x7f57e411f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.458+0000 7f57ea70e700 1 --2- 172.21.15.156:0/3198933079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57e40a0a70 0x7f57e411e840 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.458+0000 7f57ea70e700 1 --2- 172.21.15.156:0/3198933079 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f57e40a1380 0x7f57e411ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.458+0000 7f57ea70e700 1 -- 172.21.15.156:0/3198933079 >> 172.21.15.156:0/3198933079 conn(0x7f57e40a6610 msgr2=0x7f57e40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:11.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.458+0000 7f57ea70e700 1 -- 172.21.15.156:0/3198933079 shutdown_connections 2023-09-30T22:20:11.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.458+0000 7f57ea70e700 1 -- 172.21.15.156:0/3198933079 wait complete. 2023-09-30T22:20:11.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.461+0000 7f366d372700 1 -- 172.21.15.156:0/2746682844 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f366813c950 con 0x7f366806acb0 2023-09-30T22:20:11.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.462+0000 7f365f7fe700 1 -- 172.21.15.156:0/2746682844 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3658012b30 con 0x7f366806acb0 2023-09-30T22:20:11.462 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:11.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.464+0000 7f366d372700 1 -- 172.21.15.156:0/2746682844 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f366806acb0 msgr2=0x7f366813bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:11.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.464+0000 7f366d372700 1 --2- 172.21.15.156:0/2746682844 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f366806acb0 0x7f366813bed0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f365800efc0 tx=0x7f365800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.464+0000 7f366d372700 1 -- 172.21.15.156:0/2746682844 shutdown_connections 2023-09-30T22:20:11.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.464+0000 7f366d372700 1 --2- 172.21.15.156:0/2746682844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f366812e490 0x7f3668138770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.464+0000 7f366d372700 1 --2- 172.21.15.156:0/2746682844 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f366806acb0 0x7f366813bed0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.464+0000 7f366d372700 1 --2- 172.21.15.156:0/2746682844 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f366809da10 0x7f366813c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.464+0000 7f366d372700 1 -- 172.21.15.156:0/2746682844 >> 172.21.15.156:0/2746682844 conn(0x7f3668099c40 msgr2=0x7f366812cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:11.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.464+0000 7f366d372700 1 -- 172.21.15.156:0/2746682844 shutdown_connections 2023-09-30T22:20:11.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.464+0000 7f366d372700 1 -- 172.21.15.156:0/2746682844 wait complete. 2023-09-30T22:20:11.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.466+0000 7f02a3b9a700 1 -- 172.21.15.156:0/965400442 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f029c09b650 con 0x7f029c09e870 2023-09-30T22:20:11.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.466+0000 7f02927fc700 1 -- 172.21.15.156:0/965400442 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0298043e60 con 0x7f029c09e870 2023-09-30T22:20:11.467 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:11.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.469+0000 7f02a3b9a700 1 -- 172.21.15.156:0/965400442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f029c09e870 msgr2=0x7f029c11bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:11.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.469+0000 7f02a3b9a700 1 --2- 172.21.15.156:0/965400442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f029c09e870 0x7f029c11bef0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0298009840 tx=0x7f0298004750 comp rx=0 tx=0).stop 2023-09-30T22:20:11.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.469+0000 7f02a3b9a700 1 -- 172.21.15.156:0/965400442 shutdown_connections 2023-09-30T22:20:11.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.469+0000 7f02a3b9a700 1 --2- 172.21.15.156:0/965400442 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f029c131d70 0x7f029c11c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.469+0000 7f02a3b9a700 1 --2- 172.21.15.156:0/965400442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f029c09e870 0x7f029c11bef0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.469+0000 7f02a3b9a700 1 --2- 172.21.15.156:0/965400442 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f029c09f180 0x7f029c11c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.469+0000 7f02a3b9a700 1 -- 172.21.15.156:0/965400442 >> 172.21.15.156:0/965400442 conn(0x7f029c0a4430 msgr2=0x7f029c130f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:11.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.469+0000 7f02a3b9a700 1 -- 172.21.15.156:0/965400442 shutdown_connections 2023-09-30T22:20:11.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.469+0000 7f02a3b9a700 1 -- 172.21.15.156:0/965400442 wait complete. 2023-09-30T22:20:11.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:11.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:11.483 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:11.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.505+0000 7f71d0ce3700 1 -- 172.21.15.156:0/3170216141 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f71cc138b70 con 0x7f71cc09e170 2023-09-30T22:20:11.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.505+0000 7f71baffd700 1 -- 172.21.15.156:0/3170216141 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f71cc138b70 con 0x7f71cc09e170 2023-09-30T22:20:11.506 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:11.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.508+0000 7f71d0ce3700 1 -- 172.21.15.156:0/3170216141 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f71cc09e170 msgr2=0x7f71cc135bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:11.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.508+0000 7f71d0ce3700 1 --2- 172.21.15.156:0/3170216141 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f71cc09e170 0x7f71cc135bd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f71c000ebb0 tx=0x7f71c000eec0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.508+0000 7f71d0ce3700 1 -- 172.21.15.156:0/3170216141 shutdown_connections 2023-09-30T22:20:11.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.508+0000 7f71d0ce3700 1 --2- 172.21.15.156:0/3170216141 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71cc130ce0 0x7f71cc136110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.508+0000 7f71d0ce3700 1 --2- 172.21.15.156:0/3170216141 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f71cc09d860 0x7f71cc135690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.508+0000 7f71d0ce3700 1 --2- 172.21.15.156:0/3170216141 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f71cc09e170 0x7f71cc135bd0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:11.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.508+0000 7f71d0ce3700 1 -- 172.21.15.156:0/3170216141 >> 172.21.15.156:0/3170216141 conn(0x7f71cc099c40 msgr2=0x7f71cc139670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:11.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.508+0000 7f71d0ce3700 1 -- 172.21.15.156:0/3170216141 shutdown_connections 2023-09-30T22:20:11.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:11.508+0000 7f71d0ce3700 1 -- 172.21.15.156:0/3170216141 wait complete. 2023-09-30T22:20:11.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:12.481 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:12.482 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:12.483 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:12.522 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:12.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.625+0000 7fdc900f0700 1 Processor -- start 2023-09-30T22:20:12.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.626+0000 7fdc900f0700 1 -- start start 2023-09-30T22:20:12.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.626+0000 7fdc900f0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc88133ad0 0x7fdc88133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:12.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.626+0000 7fdc900f0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdc88130bc0 0x7fdc8813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:12.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.626+0000 7fdc900f0700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc8806b2d0 con 0x7fdc881300a0 2023-09-30T22:20:12.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.626+0000 7fdc900f0700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc88133610 con 0x7fdc88130bc0 2023-09-30T22:20:12.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.626+0000 7fdc900f0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8809a500 con 0x7fdc88133ad0 2023-09-30T22:20:12.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.627+0000 7fdc8de8c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc88133ad0 0x7fdc88133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:12.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.627+0000 7fdc8de8c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc88133ad0 0x7fdc88133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33444/0 (socket says 172.21.15.156:33444) 2023-09-30T22:20:12.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.627+0000 7fdc8de8c700 1 -- 172.21.15.156:0/1104811487 learned_addr learned my addr 172.21.15.156:0/1104811487 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:12.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.627+0000 7fdc8e68d700 1 --2- 172.21.15.156:0/1104811487 >> v2:172.21.15.156:3300/0 conn(0x7fdc88130bc0 0x7fdc8813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:12.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.627+0000 7fdc8de8c700 1 -- 172.21.15.156:0/1104811487 >> v2:172.21.15.156:3300/0 conn(0x7fdc88130bc0 msgr2=0x7fdc8813b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:12.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.627+0000 7fdc8de8c700 1 --2- 172.21.15.156:0/1104811487 >> v2:172.21.15.156:3300/0 conn(0x7fdc88130bc0 0x7fdc8813b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.627+0000 7fdc8de8c700 1 -- 172.21.15.156:0/1104811487 >> v1:172.21.15.156:6789/0 conn(0x7fdc881300a0 legacy=0x7fdc881304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:12.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.627+0000 7fdc8de8c700 1 -- 172.21.15.156:0/1104811487 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc881338b0 con 0x7fdc88133ad0 2023-09-30T22:20:12.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.627+0000 7fdc8de8c700 1 --2- 172.21.15.156:0/1104811487 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc88133ad0 0x7fdc88133ea0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdc840098f0 tx=0x7fdc84009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e24b3317e508e91 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:12.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.627+0000 7fdc8ce8a700 1 -- 172.21.15.156:0/1104811487 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc84011830 con 0x7fdc88133ad0 2023-09-30T22:20:12.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.627+0000 7fdc8ce8a700 1 -- 172.21.15.156:0/1104811487 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc84011990 con 0x7fdc88133ad0 2023-09-30T22:20:12.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.627+0000 7fdc8ce8a700 1 -- 172.21.15.156:0/1104811487 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc84011d20 con 0x7fdc88133ad0 2023-09-30T22:20:12.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.628+0000 7fdc900f0700 1 -- 172.21.15.156:0/1104811487 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc88133ad0 msgr2=0x7fdc88133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:12.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.628+0000 7fdc900f0700 1 --2- 172.21.15.156:0/1104811487 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc88133ad0 0x7fdc88133ea0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdc840098f0 tx=0x7fdc84009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:12.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.628+0000 7fdc900f0700 1 -- 172.21.15.156:0/1104811487 shutdown_connections 2023-09-30T22:20:12.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.628+0000 7fdc900f0700 1 --2- 172.21.15.156:0/1104811487 >> v2:172.21.15.156:3300/0 conn(0x7fdc88130bc0 0x7fdc8813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.628+0000 7fdc900f0700 1 --2- 172.21.15.156:0/1104811487 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc88133ad0 0x7fdc88133ea0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.628+0000 7fdc900f0700 1 -- 172.21.15.156:0/1104811487 >> 172.21.15.156:0/1104811487 conn(0x7fdc88099c40 msgr2=0x7fdc880a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:12.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.629+0000 7fdc900f0700 1 -- 172.21.15.156:0/1104811487 shutdown_connections 2023-09-30T22:20:12.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.629+0000 7fdc900f0700 1 -- 172.21.15.156:0/1104811487 wait complete. 2023-09-30T22:20:12.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.630+0000 7fdc900f0700 1 Processor -- start 2023-09-30T22:20:12.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.630+0000 7fdc900f0700 1 -- start start 2023-09-30T22:20:12.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.631+0000 7fdc900f0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc881300a0 0x7fdc881c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:12.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.631+0000 7fdc900f0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc88130bc0 0x7fdc881c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:12.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.631+0000 7fdc900f0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc88133ad0 0x7fdc881c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:12.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.631+0000 7fdc900f0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8812d630 con 0x7fdc88133ad0 2023-09-30T22:20:12.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.631+0000 7fdc900f0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8812fbb0 con 0x7fdc881300a0 2023-09-30T22:20:12.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.631+0000 7fdc900f0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc88072400 con 0x7fdc88130bc0 2023-09-30T22:20:12.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.631+0000 7fdc8de8c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc881300a0 0x7fdc881c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:12.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.631+0000 7fdc8de8c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc881300a0 0x7fdc881c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33458/0 (socket says 172.21.15.156:33458) 2023-09-30T22:20:12.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.631+0000 7fdc8e68d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc88133ad0 0x7fdc881c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:12.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.631+0000 7fdc8de8c700 1 -- 172.21.15.156:0/2813571904 learned_addr learned my addr 172.21.15.156:0/2813571904 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:12.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.631+0000 7fdc8e68d700 1 -- 172.21.15.156:0/2813571904 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc88130bc0 msgr2=0x7fdc881c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:12.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.631+0000 7fdc8e68d700 1 --2- 172.21.15.156:0/2813571904 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc88130bc0 0x7fdc881c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.631+0000 7fdc8e68d700 1 -- 172.21.15.156:0/2813571904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc881300a0 msgr2=0x7fdc881c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:12.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.631+0000 7fdc8e68d700 1 --2- 172.21.15.156:0/2813571904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc881300a0 0x7fdc881c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.631+0000 7fdc8e68d700 1 -- 172.21.15.156:0/2813571904 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc84009550 con 0x7fdc88133ad0 2023-09-30T22:20:12.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.631+0000 7fdc8de8c700 1 --2- 172.21.15.156:0/2813571904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc881300a0 0x7fdc881c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:12.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.631+0000 7fdc8e68d700 1 --2- 172.21.15.156:0/2813571904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc88133ad0 0x7fdc881c91d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fdc8000efc0 tx=0x7fdc8000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:12.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.631+0000 7fdc7e7fc700 1 -- 172.21.15.156:0/2813571904 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8000cce0 con 0x7fdc88133ad0 2023-09-30T22:20:12.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.632+0000 7fdc7e7fc700 1 -- 172.21.15.156:0/2813571904 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8000f040 con 0x7fdc88133ad0 2023-09-30T22:20:12.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.632+0000 7fdc7e7fc700 1 -- 172.21.15.156:0/2813571904 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc800146c0 con 0x7fdc88133ad0 2023-09-30T22:20:12.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.632+0000 7fdc900f0700 1 -- 172.21.15.156:0/2813571904 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc8812dd00 con 0x7fdc88133ad0 2023-09-30T22:20:12.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.632+0000 7fdc900f0700 1 -- 172.21.15.156:0/2813571904 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc88071a40 con 0x7fdc88133ad0 2023-09-30T22:20:12.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.633+0000 7fdc900f0700 1 -- 172.21.15.156:0/2813571904 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc8804f2a0 con 0x7fdc88133ad0 2023-09-30T22:20:12.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.633+0000 7fdc7e7fc700 1 -- 172.21.15.156:0/2813571904 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc80014820 con 0x7fdc88133ad0 2023-09-30T22:20:12.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.633+0000 7fdc7e7fc700 1 -- 172.21.15.156:0/2813571904 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdc80040300 con 0x7fdc88133ad0 2023-09-30T22:20:12.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.641+0000 7f95a85b5700 1 Processor -- start 2023-09-30T22:20:12.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.641+0000 7f95a85b5700 1 -- start start 2023-09-30T22:20:12.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.641+0000 7fdc7e7fc700 1 -- 172.21.15.156:0/2813571904 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc8000ce60 con 0x7fdc88133ad0 2023-09-30T22:20:12.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.641+0000 7f95a85b5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f95a0133a70 0x7f95a0133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:12.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.641+0000 7f95a85b5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95a00a1470 0x7f95a013b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:12.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.641+0000 7f95a85b5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a0133640 con 0x7f95a00a08e0 2023-09-30T22:20:12.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.641+0000 7f95a85b5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a00a1d50 con 0x7f95a0133a70 2023-09-30T22:20:12.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.641+0000 7f95a85b5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95a009b620 con 0x7f95a00a1470 2023-09-30T22:20:12.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.642+0000 7f95a6351700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f95a0133a70 0x7f95a0133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:12.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.642+0000 7f95a6351700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f95a0133a70 0x7f95a0133e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38022/0 (socket says 172.21.15.156:38022) 2023-09-30T22:20:12.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.642+0000 7f95a6351700 1 -- 172.21.15.156:0/805630951 learned_addr learned my addr 172.21.15.156:0/805630951 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:12.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.642+0000 7f95a6b52700 1 --2- 172.21.15.156:0/805630951 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95a00a1470 0x7f95a013b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:12.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.642+0000 7f95a6b52700 1 -- 172.21.15.156:0/805630951 >> v2:172.21.15.156:3300/0 conn(0x7f95a0133a70 msgr2=0x7f95a0133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:12.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.642+0000 7f95a6b52700 1 --2- 172.21.15.156:0/805630951 >> v2:172.21.15.156:3300/0 conn(0x7f95a0133a70 0x7f95a0133e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.642+0000 7f95a6b52700 1 -- 172.21.15.156:0/805630951 >> v1:172.21.15.156:6789/0 conn(0x7f95a00a08e0 legacy=0x7f95a00a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:12.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.642+0000 7f95a6b52700 1 -- 172.21.15.156:0/805630951 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a0133870 con 0x7f95a00a1470 2023-09-30T22:20:12.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.642+0000 7f95a534f700 1 -- 172.21.15.156:0/805630951 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103283169 0 0) 0x7f95a0133640 con 0x7f95a00a08e0 2023-09-30T22:20:12.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.642+0000 7f95a6351700 1 --2- 172.21.15.156:0/805630951 >> v2:172.21.15.156:3300/0 conn(0x7f95a0133a70 0x7f95a0133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:12.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.642+0000 7f95a6b52700 1 --2- 172.21.15.156:0/805630951 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95a00a1470 0x7f95a013b980 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9598009d90 tx=0x7f959800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c981da5fb24b5d4a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:12.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.642+0000 7f95a534f700 1 -- 172.21.15.156:0/805630951 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959800e070 con 0x7f95a00a1470 2023-09-30T22:20:12.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.642+0000 7f95a534f700 1 -- 172.21.15.156:0/805630951 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959800bb20 con 0x7f95a00a1470 2023-09-30T22:20:12.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.642+0000 7f95a534f700 1 -- 172.21.15.156:0/805630951 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9598012430 con 0x7f95a00a1470 2023-09-30T22:20:12.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.643+0000 7f95a85b5700 1 -- 172.21.15.156:0/805630951 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95a00a1470 msgr2=0x7f95a013b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:12.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.643+0000 7f95a85b5700 1 --2- 172.21.15.156:0/805630951 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95a00a1470 0x7f95a013b980 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9598009d90 tx=0x7f959800b330 comp rx=0 tx=0).stop 2023-09-30T22:20:12.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.644+0000 7f95a85b5700 1 -- 172.21.15.156:0/805630951 shutdown_connections 2023-09-30T22:20:12.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.644+0000 7f95a85b5700 1 --2- 172.21.15.156:0/805630951 >> v2:172.21.15.156:3300/0 conn(0x7f95a0133a70 0x7f95a0133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.644+0000 7f95a85b5700 1 --2- 172.21.15.156:0/805630951 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95a00a1470 0x7f95a013b980 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.644+0000 7f95a85b5700 1 -- 172.21.15.156:0/805630951 >> 172.21.15.156:0/805630951 conn(0x7f95a00a2980 msgr2=0x7f95a00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:12.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.644+0000 7f95a85b5700 1 -- 172.21.15.156:0/805630951 shutdown_connections 2023-09-30T22:20:12.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.644+0000 7f95a85b5700 1 -- 172.21.15.156:0/805630951 wait complete. 2023-09-30T22:20:12.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.645+0000 7f95a85b5700 1 Processor -- start 2023-09-30T22:20:12.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.645+0000 7f95a85b5700 1 -- start start 2023-09-30T22:20:12.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.646+0000 7f95a85b5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95a00a08e0 0x7f95a01197a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:12.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.646+0000 7f95a85b5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f95a00a1470 0x7f95a0119ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:12.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.646+0000 7f95a85b5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95a0133a70 0x7f95a011a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:12.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.646+0000 7f95a85b5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a011ce80 con 0x7f95a0133a70 2023-09-30T22:20:12.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.646+0000 7f95a85b5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a0131bc0 con 0x7f95a00a1470 2023-09-30T22:20:12.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.646+0000 7f95a85b5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95a011b360 con 0x7f95a00a08e0 2023-09-30T22:20:12.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.646+0000 7f95a6351700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95a00a08e0 0x7f95a01197a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:12.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.646+0000 7f95a6351700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95a00a08e0 0x7f95a01197a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44610/0 (socket says 172.21.15.156:44610) 2023-09-30T22:20:12.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.646+0000 7f95a6351700 1 -- 172.21.15.156:0/4169136016 learned_addr learned my addr 172.21.15.156:0/4169136016 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:12.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.646+0000 7f95a6b52700 1 --2- 172.21.15.156:0/4169136016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95a0133a70 0x7f95a011a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:12.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.646+0000 7f95a5b50700 1 --2- 172.21.15.156:0/4169136016 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f95a00a1470 0x7f95a0119ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:12.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.646+0000 7f95a6b52700 1 -- 172.21.15.156:0/4169136016 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95a00a08e0 msgr2=0x7f95a01197a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:12.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.646+0000 7f95a6b52700 1 --2- 172.21.15.156:0/4169136016 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95a00a08e0 0x7f95a01197a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.646+0000 7f95a6b52700 1 -- 172.21.15.156:0/4169136016 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f95a00a1470 msgr2=0x7f95a0119ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:12.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.646+0000 7f95a6b52700 1 --2- 172.21.15.156:0/4169136016 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f95a00a1470 0x7f95a0119ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.646+0000 7f95a6b52700 1 -- 172.21.15.156:0/4169136016 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c009500 con 0x7f95a0133a70 2023-09-30T22:20:12.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.646+0000 7f95a6351700 1 --2- 172.21.15.156:0/4169136016 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95a00a08e0 0x7f95a01197a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:12.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.646+0000 7f95a6b52700 1 --2- 172.21.15.156:0/4169136016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95a0133a70 0x7f95a011a220 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9598016000 tx=0x7f9598004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:12.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.647+0000 7f9596ffd700 1 -- 172.21.15.156:0/4169136016 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9598012430 con 0x7f95a0133a70 2023-09-30T22:20:12.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.647+0000 7f9596ffd700 1 -- 172.21.15.156:0/4169136016 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9598020070 con 0x7f95a0133a70 2023-09-30T22:20:12.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.647+0000 7f95a85b5700 1 -- 172.21.15.156:0/4169136016 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9598009a70 con 0x7f95a0133a70 2023-09-30T22:20:12.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.647+0000 7f9596ffd700 1 -- 172.21.15.156:0/4169136016 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9598004280 con 0x7f95a0133a70 2023-09-30T22:20:12.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.647+0000 7f95a85b5700 1 -- 172.21.15.156:0/4169136016 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a011c4a0 con 0x7f95a0133a70 2023-09-30T22:20:12.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.648+0000 7f9596ffd700 1 -- 172.21.15.156:0/4169136016 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f95980043e0 con 0x7f95a0133a70 2023-09-30T22:20:12.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.648+0000 7f9596ffd700 1 -- 172.21.15.156:0/4169136016 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9598022070 con 0x7f95a0133a70 2023-09-30T22:20:12.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.649+0000 7f95a85b5700 1 -- 172.21.15.156:0/4169136016 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a004f2a0 con 0x7f95a0133a70 2023-09-30T22:20:12.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.653+0000 7f9596ffd700 1 -- 172.21.15.156:0/4169136016 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f959801a380 con 0x7f95a0133a70 2023-09-30T22:20:12.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.666+0000 7fc7cd533700 1 Processor -- start 2023-09-30T22:20:12.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.667+0000 7fc7cd533700 1 -- start start 2023-09-30T22:20:12.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.667+0000 7fc7cd533700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7c809e870 0x7fc7c809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:12.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.667+0000 7fc7cd533700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc7c8131f40 0x7fc7c8139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:12.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.667+0000 7fc7cd533700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c809c970 con 0x7fc7c809f180 2023-09-30T22:20:12.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.667+0000 7fc7cd533700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c80a0920 con 0x7fc7c8131f40 2023-09-30T22:20:12.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.667+0000 7fc7cd533700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c809f9c0 con 0x7fc7c809e870 2023-09-30T22:20:12.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.668+0000 7fc7c67fc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc7c809f180 0x7fc7c8131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:43324/0 (socket says 172.21.15.156:43324) 2023-09-30T22:20:12.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.668+0000 7fc7c67fc700 1 -- 172.21.15.156:0/3812050111 learned_addr learned my addr 172.21.15.156:0/3812050111 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:12.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.668+0000 7fc7c77fe700 1 --2- 172.21.15.156:0/3812050111 >> v2:172.21.15.156:3300/0 conn(0x7fc7c8131f40 0x7fc7c8139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:12.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.668+0000 7fc7c6ffd700 1 --2- 172.21.15.156:0/3812050111 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7c809e870 0x7fc7c809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:12.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.668+0000 7fc7c5ffb700 1 -- 172.21.15.156:0/3812050111 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1491858647 0 0) 0x7fc7c809c970 con 0x7fc7c809f180 2023-09-30T22:20:12.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.668+0000 7fc7c5ffb700 1 -- 172.21.15.156:0/3812050111 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7b00035b0 con 0x7fc7c809f180 2023-09-30T22:20:12.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.668+0000 7fc7c5ffb700 1 -- 172.21.15.156:0/3812050111 <== mon.0 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 165962982 0 0) 0x7fc7b00035b0 con 0x7fc7c809f180 2023-09-30T22:20:12.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.668+0000 7fc7c77fe700 1 -- 172.21.15.156:0/3812050111 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7c809e870 msgr2=0x7fc7c809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:12.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.668+0000 7fc7c77fe700 1 --2- 172.21.15.156:0/3812050111 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7c809e870 0x7fc7c809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.668+0000 7fc7c77fe700 1 -- 172.21.15.156:0/3812050111 >> v1:172.21.15.156:6789/0 conn(0x7fc7c809f180 legacy=0x7fc7c8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:12.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.668+0000 7fc7c77fe700 1 -- 172.21.15.156:0/3812050111 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c809bab0 con 0x7fc7c8131f40 2023-09-30T22:20:12.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.668+0000 7fc7c77fe700 1 --2- 172.21.15.156:0/3812050111 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7c8131f40 0x7fc7c8139ca0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0009d90 tx=0x7fc7c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a3c4081ca92238 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:12.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.669+0000 7fc7c5ffb700 1 -- 172.21.15.156:0/3812050111 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c000e070 con 0x7fc7c8131f40 2023-09-30T22:20:12.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.669+0000 7fc7c5ffb700 1 -- 172.21.15.156:0/3812050111 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c0003a20 con 0x7fc7c8131f40 2023-09-30T22:20:12.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.669+0000 7fc7c5ffb700 1 -- 172.21.15.156:0/3812050111 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc001670 con 0x7fc7c8131f40 2023-09-30T22:20:12.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.670+0000 7fc7cd533700 1 -- 172.21.15.156:0/3812050111 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7c8131f40 msgr2=0x7fc7c8139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:12.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.670+0000 7fc7cd533700 1 --2- 172.21.15.156:0/3812050111 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7c8131f40 0x7fc7c8139ca0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0009d90 tx=0x7fc7c000b330 comp rx=0 tx=0).stop 2023-09-30T22:20:12.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.670+0000 7fc7cd533700 1 -- 172.21.15.156:0/3812050111 shutdown_connections 2023-09-30T22:20:12.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.670+0000 7fc7cd533700 1 --2- 172.21.15.156:0/3812050111 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7c8131f40 0x7fc7c8139ca0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.670+0000 7fc7cd533700 1 --2- 172.21.15.156:0/3812050111 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7c809e870 0x7fc7c809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.670+0000 7fc7cd533700 1 -- 172.21.15.156:0/3812050111 >> 172.21.15.156:0/3812050111 conn(0x7fc7c80a4430 msgr2=0x7fc7c80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:12.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.670+0000 7fc7cd533700 1 -- 172.21.15.156:0/3812050111 shutdown_connections 2023-09-30T22:20:12.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.670+0000 7fc7cd533700 1 -- 172.21.15.156:0/3812050111 wait complete. 2023-09-30T22:20:12.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.671+0000 7fc7cd533700 1 Processor -- start 2023-09-30T22:20:12.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.671+0000 7fc7cd533700 1 -- start start 2023-09-30T22:20:12.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.672+0000 7fc7cd533700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7c809e870 0x7fc7c812b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:12.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.672+0000 7fc7cd533700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7c809f180 0x7fc7c812b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:12.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.672+0000 7fc7cd533700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7c8131f40 0x7fc7c812bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:12.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.672+0000 7fc7cd533700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c812e3b0 con 0x7fc7c809f180 2023-09-30T22:20:12.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.672+0000 7fc7cd533700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c809dba0 con 0x7fc7c8131f40 2023-09-30T22:20:12.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.672+0000 7fc7cd533700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c812d000 con 0x7fc7c809e870 2023-09-30T22:20:12.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.672+0000 7fc7c77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7c8131f40 0x7fc7c812bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:12.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.672+0000 7fc7c6ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7c809e870 0x7fc7c812b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:12.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.672+0000 7fc7c77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7c8131f40 0x7fc7c812bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33480/0 (socket says 172.21.15.156:33480) 2023-09-30T22:20:12.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.672+0000 7fc7c77fe700 1 -- 172.21.15.156:0/2125895498 learned_addr learned my addr 172.21.15.156:0/2125895498 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:12.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.672+0000 7fc7c67fc700 1 --2- 172.21.15.156:0/2125895498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7c809f180 0x7fc7c812b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:12.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.673+0000 7fc7c77fe700 1 -- 172.21.15.156:0/2125895498 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7c809e870 msgr2=0x7fc7c812b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:12.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.673+0000 7fc7c77fe700 1 --2- 172.21.15.156:0/2125895498 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7c809e870 0x7fc7c812b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.673+0000 7fc7c77fe700 1 -- 172.21.15.156:0/2125895498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7c809f180 msgr2=0x7fc7c812b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:12.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.673+0000 7fc7c77fe700 1 --2- 172.21.15.156:0/2125895498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7c809f180 0x7fc7c812b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.673+0000 7fc7c77fe700 1 -- 172.21.15.156:0/2125895498 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c0009a70 con 0x7fc7c8131f40 2023-09-30T22:20:12.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.673+0000 7fc7c77fe700 1 --2- 172.21.15.156:0/2125895498 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7c8131f40 0x7fc7c812bab0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc7c809c8a0 tx=0x7fc7c0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:12.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.673+0000 7fc7af7fe700 1 -- 172.21.15.156:0/2125895498 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c00045f0 con 0x7fc7c8131f40 2023-09-30T22:20:12.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.673+0000 7fc7af7fe700 1 -- 172.21.15.156:0/2125895498 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c0004750 con 0x7fc7c8131f40 2023-09-30T22:20:12.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.673+0000 7fc7af7fe700 1 -- 172.21.15.156:0/2125895498 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0012430 con 0x7fc7c8131f40 2023-09-30T22:20:12.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.673+0000 7fc7cd533700 1 -- 172.21.15.156:0/2125895498 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c812cae0 con 0x7fc7c8131f40 2023-09-30T22:20:12.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.673+0000 7fc7cd533700 1 -- 172.21.15.156:0/2125895498 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c812f0e0 con 0x7fc7c8131f40 2023-09-30T22:20:12.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.674+0000 7fc7af7fe700 1 -- 172.21.15.156:0/2125895498 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc7c0012590 con 0x7fc7c8131f40 2023-09-30T22:20:12.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.675+0000 7fc7cd533700 1 -- 172.21.15.156:0/2125895498 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c809f5b0 con 0x7fc7c8131f40 2023-09-30T22:20:12.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.675+0000 7f55db24a700 1 Processor -- start 2023-09-30T22:20:12.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.675+0000 7f55db24a700 1 -- start start 2023-09-30T22:20:12.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.675+0000 7f55db24a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55d409e340 0x7f55d41359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:12.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.675+0000 7f55db24a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f55d4135f20 0x7f55d4138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:12.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.675+0000 7f55db24a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d409aaa0 con 0x7f55d409d860 2023-09-30T22:20:12.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.675+0000 7f55db24a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d409e730 con 0x7f55d4135f20 2023-09-30T22:20:12.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.675+0000 7f55db24a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55d409f870 con 0x7f55d409e340 2023-09-30T22:20:12.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.675+0000 7f55d97e7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f55d4135f20 0x7f55d4138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:12.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.676+0000 7f55d97e7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f55d4135f20 0x7f55d4138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38048/0 (socket says 172.21.15.156:38048) 2023-09-30T22:20:12.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.676+0000 7f55d97e7700 1 -- 172.21.15.156:0/1924308042 learned_addr learned my addr 172.21.15.156:0/1924308042 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:12.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.675+0000 7fc7af7fe700 1 -- 172.21.15.156:0/2125895498 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc7c0041480 con 0x7fc7c8131f40 2023-09-30T22:20:12.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.676+0000 7f55d3fff700 1 --2- 172.21.15.156:0/1924308042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55d409e340 0x7f55d41359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:12.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.676+0000 7f55d97e7700 1 -- 172.21.15.156:0/1924308042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55d409e340 msgr2=0x7f55d41359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:12.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.676+0000 7f55d97e7700 1 --2- 172.21.15.156:0/1924308042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55d409e340 0x7f55d41359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.676+0000 7f55d97e7700 1 -- 172.21.15.156:0/1924308042 >> v1:172.21.15.156:6789/0 conn(0x7f55d409d860 legacy=0x7f55d409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:12.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.676+0000 7f55d97e7700 1 -- 172.21.15.156:0/1924308042 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d409b360 con 0x7f55d4135f20 2023-09-30T22:20:12.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.676+0000 7f55d97e7700 1 --2- 172.21.15.156:0/1924308042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55d4135f20 0x7f55d4138300 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f55cc00d150 tx=0x7f55cc00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4342eef831a34747 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:12.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.676+0000 7f55d37fe700 1 -- 172.21.15.156:0/1924308042 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc010070 con 0x7f55d4135f20 2023-09-30T22:20:12.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.676+0000 7f55d37fe700 1 -- 172.21.15.156:0/1924308042 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55cc00dcd0 con 0x7f55d4135f20 2023-09-30T22:20:12.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.676+0000 7f55d37fe700 1 -- 172.21.15.156:0/1924308042 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc00b310 con 0x7f55d4135f20 2023-09-30T22:20:12.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.677+0000 7f55db24a700 1 -- 172.21.15.156:0/1924308042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55d4135f20 msgr2=0x7f55d4138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:12.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.677+0000 7f55db24a700 1 --2- 172.21.15.156:0/1924308042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55d4135f20 0x7f55d4138300 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f55cc00d150 tx=0x7f55cc00d460 comp rx=0 tx=0).stop 2023-09-30T22:20:12.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.677+0000 7f55db24a700 1 -- 172.21.15.156:0/1924308042 shutdown_connections 2023-09-30T22:20:12.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.677+0000 7f55db24a700 1 --2- 172.21.15.156:0/1924308042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55d4135f20 0x7f55d4138300 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.677+0000 7f55db24a700 1 --2- 172.21.15.156:0/1924308042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55d409e340 0x7f55d41359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.677+0000 7f55db24a700 1 -- 172.21.15.156:0/1924308042 >> 172.21.15.156:0/1924308042 conn(0x7f55d4099c40 msgr2=0x7f55d40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:12.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.677+0000 7f55db24a700 1 -- 172.21.15.156:0/1924308042 shutdown_connections 2023-09-30T22:20:12.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.677+0000 7f55db24a700 1 -- 172.21.15.156:0/1924308042 wait complete. 2023-09-30T22:20:12.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.678+0000 7f55db24a700 1 Processor -- start 2023-09-30T22:20:12.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.678+0000 7f55db24a700 1 -- start start 2023-09-30T22:20:12.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.679+0000 7f55db24a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55d409d860 0x7f55d4123ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:12.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.679+0000 7f55db24a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55d409e340 0x7f55d41243e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:12.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.679+0000 7f55db24a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55d4135f20 0x7f55d4124920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:12.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.679+0000 7f55db24a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d4127970 con 0x7f55d4135f20 2023-09-30T22:20:12.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.679+0000 7f55db24a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d4127460 con 0x7f55d409d860 2023-09-30T22:20:12.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.679+0000 7f55db24a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55d41262d0 con 0x7f55d409e340 2023-09-30T22:20:12.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.679+0000 7f55d8fe6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55d409d860 0x7f55d4123ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:12.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.679+0000 7f55d8fe6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55d409d860 0x7f55d4123ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33496/0 (socket says 172.21.15.156:33496) 2023-09-30T22:20:12.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.679+0000 7f55d8fe6700 1 -- 172.21.15.156:0/3744832884 learned_addr learned my addr 172.21.15.156:0/3744832884 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:12.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.679+0000 7f55d3fff700 1 --2- 172.21.15.156:0/3744832884 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55d409e340 0x7f55d41243e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:12.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.679+0000 7f55d97e7700 1 --2- 172.21.15.156:0/3744832884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55d4135f20 0x7f55d4124920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:12.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.679+0000 7f55d8fe6700 1 -- 172.21.15.156:0/3744832884 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55d409e340 msgr2=0x7f55d41243e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:12.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.679+0000 7f55d8fe6700 1 --2- 172.21.15.156:0/3744832884 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55d409e340 0x7f55d41243e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.679+0000 7f55d8fe6700 1 -- 172.21.15.156:0/3744832884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55d4135f20 msgr2=0x7f55d4124920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:12.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.679+0000 7f55d8fe6700 1 --2- 172.21.15.156:0/3744832884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55d4135f20 0x7f55d4124920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.679+0000 7f55d8fe6700 1 -- 172.21.15.156:0/3744832884 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55cc00bd40 con 0x7f55d409d860 2023-09-30T22:20:12.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.680+0000 7f55d8fe6700 1 --2- 172.21.15.156:0/3744832884 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55d409d860 0x7f55d4123ea0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f55c400b4a0 tx=0x7f55c400b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:12.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.684+0000 7f55d17fa700 1 -- 172.21.15.156:0/3744832884 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c4011830 con 0x7f55d409d860 2023-09-30T22:20:12.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.684+0000 7f55d17fa700 1 -- 172.21.15.156:0/3744832884 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c4011990 con 0x7f55d409d860 2023-09-30T22:20:12.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.684+0000 7f55d17fa700 1 -- 172.21.15.156:0/3744832884 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c4011d40 con 0x7f55d409d860 2023-09-30T22:20:12.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.684+0000 7f55db24a700 1 -- 172.21.15.156:0/3744832884 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d4127100 con 0x7f55d409d860 2023-09-30T22:20:12.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.684+0000 7fc7af7fe700 1 -- 172.21.15.156:0/2125895498 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc7c809f5b0 con 0x7fc7c8131f40 2023-09-30T22:20:12.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.684+0000 7f55db24a700 1 -- 172.21.15.156:0/3744832884 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d409c8b0 con 0x7f55d409d860 2023-09-30T22:20:12.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.685+0000 7f55db24a700 1 -- 172.21.15.156:0/3744832884 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55d404f2a0 con 0x7f55d409d860 2023-09-30T22:20:12.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.685+0000 7f55d17fa700 1 -- 172.21.15.156:0/3744832884 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f55c4004020 con 0x7f55d409d860 2023-09-30T22:20:12.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.686+0000 7f55d17fa700 1 -- 172.21.15.156:0/3744832884 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f55c403fbb0 con 0x7f55d409d860 2023-09-30T22:20:12.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.692+0000 7f55d17fa700 1 -- 172.21.15.156:0/3744832884 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f55c4022760 con 0x7f55d409d860 2023-09-30T22:20:12.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.843+0000 7fdc900f0700 1 -- 172.21.15.156:0/2813571904 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdc8806c3b0 con 0x7fdc88133ad0 2023-09-30T22:20:12.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.843+0000 7fdc7e7fc700 1 -- 172.21.15.156:0/2813571904 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdc80018030 con 0x7fdc88133ad0 2023-09-30T22:20:12.844 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:12.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.846+0000 7fdc900f0700 1 -- 172.21.15.156:0/2813571904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc88133ad0 msgr2=0x7fdc881c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:12.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.846+0000 7fdc900f0700 1 --2- 172.21.15.156:0/2813571904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc88133ad0 0x7fdc881c91d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fdc8000efc0 tx=0x7fdc8000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.846+0000 7fdc900f0700 1 -- 172.21.15.156:0/2813571904 shutdown_connections 2023-09-30T22:20:12.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.846+0000 7fdc900f0700 1 --2- 172.21.15.156:0/2813571904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc88133ad0 0x7fdc881c91d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.846+0000 7fdc900f0700 1 --2- 172.21.15.156:0/2813571904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc881300a0 0x7fdc881c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.846+0000 7fdc900f0700 1 --2- 172.21.15.156:0/2813571904 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc88130bc0 0x7fdc881c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.846+0000 7fdc900f0700 1 -- 172.21.15.156:0/2813571904 >> 172.21.15.156:0/2813571904 conn(0x7fdc88099c40 msgr2=0x7fdc8812e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:12.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.846+0000 7fdc900f0700 1 -- 172.21.15.156:0/2813571904 shutdown_connections 2023-09-30T22:20:12.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.846+0000 7fdc900f0700 1 -- 172.21.15.156:0/2813571904 wait complete. 2023-09-30T22:20:12.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:12.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.894+0000 7f55db24a700 1 -- 172.21.15.156:0/3744832884 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f55d4125a60 con 0x7f55d409d860 2023-09-30T22:20:12.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.895+0000 7f55d17fa700 1 -- 172.21.15.156:0/3744832884 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f55c4015030 con 0x7f55d409d860 2023-09-30T22:20:12.895 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:12.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.897+0000 7f55db24a700 1 -- 172.21.15.156:0/3744832884 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55d409d860 msgr2=0x7f55d4123ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:12.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.897+0000 7f55db24a700 1 --2- 172.21.15.156:0/3744832884 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55d409d860 0x7f55d4123ea0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f55c400b4a0 tx=0x7f55c400b7b0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.897+0000 7f55db24a700 1 -- 172.21.15.156:0/3744832884 shutdown_connections 2023-09-30T22:20:12.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.897+0000 7f55db24a700 1 --2- 172.21.15.156:0/3744832884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55d4135f20 0x7f55d4124920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.897+0000 7f55db24a700 1 --2- 172.21.15.156:0/3744832884 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55d409d860 0x7f55d4123ea0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.897+0000 7f55db24a700 1 --2- 172.21.15.156:0/3744832884 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55d409e340 0x7f55d41243e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.897+0000 7f55db24a700 1 -- 172.21.15.156:0/3744832884 >> 172.21.15.156:0/3744832884 conn(0x7f55d4099c40 msgr2=0x7f55d4132830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:12.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.897+0000 7f55db24a700 1 -- 172.21.15.156:0/3744832884 shutdown_connections 2023-09-30T22:20:12.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.897+0000 7f55db24a700 1 -- 172.21.15.156:0/3744832884 wait complete. 2023-09-30T22:20:12.910 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:12.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.951+0000 7f95a85b5700 1 -- 172.21.15.156:0/4169136016 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f95a006bce0 con 0x7f95a0133a70 2023-09-30T22:20:12.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.951+0000 7f9596ffd700 1 -- 172.21.15.156:0/4169136016 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9598025b70 con 0x7f95a0133a70 2023-09-30T22:20:12.952 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:12.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.953+0000 7f95a85b5700 1 -- 172.21.15.156:0/4169136016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95a0133a70 msgr2=0x7f95a011a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:12.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.953+0000 7f95a85b5700 1 --2- 172.21.15.156:0/4169136016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95a0133a70 0x7f95a011a220 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9598016000 tx=0x7f9598004ad0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.953+0000 7f95a85b5700 1 -- 172.21.15.156:0/4169136016 shutdown_connections 2023-09-30T22:20:12.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.953+0000 7f95a85b5700 1 --2- 172.21.15.156:0/4169136016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95a0133a70 0x7f95a011a220 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.953+0000 7f95a85b5700 1 --2- 172.21.15.156:0/4169136016 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95a00a08e0 0x7f95a01197a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.953+0000 7f95a85b5700 1 --2- 172.21.15.156:0/4169136016 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f95a00a1470 0x7f95a0119ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.953+0000 7f95a85b5700 1 -- 172.21.15.156:0/4169136016 >> 172.21.15.156:0/4169136016 conn(0x7f95a00a2980 msgr2=0x7f95a012f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:12.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.953+0000 7f95a85b5700 1 -- 172.21.15.156:0/4169136016 shutdown_connections 2023-09-30T22:20:12.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.953+0000 7f95a85b5700 1 -- 172.21.15.156:0/4169136016 wait complete. 2023-09-30T22:20:12.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:12.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.974+0000 7fc7cd533700 1 -- 172.21.15.156:0/2125895498 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc7c809f5b0 con 0x7fc7c8131f40 2023-09-30T22:20:12.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.974+0000 7fc7af7fe700 1 -- 172.21.15.156:0/2125895498 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc7c809f5b0 con 0x7fc7c8131f40 2023-09-30T22:20:12.975 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:12.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.976+0000 7fc7cd533700 1 -- 172.21.15.156:0/2125895498 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7c8131f40 msgr2=0x7fc7c812bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:12.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.976+0000 7fc7cd533700 1 --2- 172.21.15.156:0/2125895498 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7c8131f40 0x7fc7c812bab0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc7c809c8a0 tx=0x7fc7c0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.976+0000 7fc7cd533700 1 -- 172.21.15.156:0/2125895498 shutdown_connections 2023-09-30T22:20:12.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.976+0000 7fc7cd533700 1 --2- 172.21.15.156:0/2125895498 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7c8131f40 0x7fc7c812bab0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.976+0000 7fc7cd533700 1 --2- 172.21.15.156:0/2125895498 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7c809e870 0x7fc7c812b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.976+0000 7fc7cd533700 1 --2- 172.21.15.156:0/2125895498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7c809f180 0x7fc7c812b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:12.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.976+0000 7fc7cd533700 1 -- 172.21.15.156:0/2125895498 >> 172.21.15.156:0/2125895498 conn(0x7fc7c80a4430 msgr2=0x7fc7c806f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:12.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.976+0000 7fc7cd533700 1 -- 172.21.15.156:0/2125895498 shutdown_connections 2023-09-30T22:20:12.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:12.976+0000 7fc7cd533700 1 -- 172.21.15.156:0/2125895498 wait complete. 2023-09-30T22:20:12.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:13.864 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:13.911 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:13.967 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:13.990 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:14.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:13.999+0000 7f2a7d784700 1 Processor -- start 2023-09-30T22:20:14.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:13.999+0000 7f2a7d784700 1 -- start start 2023-09-30T22:20:14.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.000+0000 7f2a7d784700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a78133ad0 0x7f2a78133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:14.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.000+0000 7f2a7d784700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a78130bc0 0x7f2a7813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:14.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.000+0000 7f2a7d784700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7806b2d0 con 0x7f2a781300a0 2023-09-30T22:20:14.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.000+0000 7f2a7d784700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a78133610 con 0x7f2a78130bc0 2023-09-30T22:20:14.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.000+0000 7f2a7d784700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7809a500 con 0x7f2a78133ad0 2023-09-30T22:20:14.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.000+0000 7f2a767fc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f2a781300a0 0x7f2a781304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:43344/0 (socket says 172.21.15.156:43344) 2023-09-30T22:20:14.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.000+0000 7f2a777fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a78130bc0 0x7f2a7813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:14.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.000+0000 7f2a767fc700 1 -- 172.21.15.156:0/171638998 learned_addr learned my addr 172.21.15.156:0/171638998 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:14.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.000+0000 7f2a76ffd700 1 --2- 172.21.15.156:0/171638998 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a78133ad0 0x7f2a78133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:14.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.000+0000 7f2a76ffd700 1 -- 172.21.15.156:0/171638998 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a78130bc0 msgr2=0x7f2a7813b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:14.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.000+0000 7f2a76ffd700 1 --2- 172.21.15.156:0/171638998 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a78130bc0 0x7f2a7813b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.000+0000 7f2a75ffb700 1 -- 172.21.15.156:0/171638998 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 36589503 0 0) 0x7f2a7806b2d0 con 0x7f2a781300a0 2023-09-30T22:20:14.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.000+0000 7f2a76ffd700 1 -- 172.21.15.156:0/171638998 >> v1:172.21.15.156:6789/0 conn(0x7f2a781300a0 legacy=0x7f2a781304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:14.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.000+0000 7f2a76ffd700 1 -- 172.21.15.156:0/171638998 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a781338b0 con 0x7f2a78133ad0 2023-09-30T22:20:14.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.001+0000 7f2a76ffd700 1 --2- 172.21.15.156:0/171638998 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a78133ad0 0x7f2a78133ea0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2a68009870 tx=0x7f2a68009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85a0d9d8effb5857 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:14.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.001+0000 7f2a75ffb700 1 -- 172.21.15.156:0/171638998 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a68011830 con 0x7f2a78133ad0 2023-09-30T22:20:14.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.001+0000 7f2a75ffb700 1 -- 172.21.15.156:0/171638998 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a68011990 con 0x7f2a78133ad0 2023-09-30T22:20:14.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.001+0000 7f2a75ffb700 1 -- 172.21.15.156:0/171638998 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a68011d20 con 0x7f2a78133ad0 2023-09-30T22:20:14.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.002+0000 7f2a7d784700 1 -- 172.21.15.156:0/171638998 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a78133ad0 msgr2=0x7f2a78133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:14.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.002+0000 7f2a7d784700 1 --2- 172.21.15.156:0/171638998 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a78133ad0 0x7f2a78133ea0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2a68009870 tx=0x7f2a68009b80 comp rx=0 tx=0).stop 2023-09-30T22:20:14.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.002+0000 7f2a7d784700 1 -- 172.21.15.156:0/171638998 shutdown_connections 2023-09-30T22:20:14.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.002+0000 7f2a7d784700 1 --2- 172.21.15.156:0/171638998 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a78130bc0 0x7f2a7813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.002+0000 7f2a7d784700 1 --2- 172.21.15.156:0/171638998 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a78133ad0 0x7f2a78133ea0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.002+0000 7f2a7d784700 1 -- 172.21.15.156:0/171638998 >> 172.21.15.156:0/171638998 conn(0x7f2a78099c40 msgr2=0x7f2a780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:14.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.002+0000 7f2a7d784700 1 -- 172.21.15.156:0/171638998 shutdown_connections 2023-09-30T22:20:14.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.002+0000 7f2a7d784700 1 -- 172.21.15.156:0/171638998 wait complete. 2023-09-30T22:20:14.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.003+0000 7f2a7d784700 1 Processor -- start 2023-09-30T22:20:14.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.003+0000 7f2a7d784700 1 -- start start 2023-09-30T22:20:14.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.004+0000 7f2a7d784700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a781300a0 0x7f2a7811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:14.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.004+0000 7f2a7d784700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a78130bc0 0x7f2a7811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:14.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.004+0000 7f2a7d784700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a78133ad0 0x7f2a7811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:14.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.004+0000 7f2a7d784700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7812d890 con 0x7f2a78130bc0 2023-09-30T22:20:14.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.004+0000 7f2a7d784700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7811fab0 con 0x7f2a781300a0 2023-09-30T22:20:14.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.004+0000 7f2a7d784700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a78120950 con 0x7f2a78133ad0 2023-09-30T22:20:14.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.004+0000 7f2a76ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a781300a0 0x7f2a7811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:14.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.004+0000 7f2a76ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a781300a0 0x7f2a7811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33510/0 (socket says 172.21.15.156:33510) 2023-09-30T22:20:14.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.004+0000 7f2a76ffd700 1 -- 172.21.15.156:0/1869768388 learned_addr learned my addr 172.21.15.156:0/1869768388 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:14.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.004+0000 7f2a777fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a78133ad0 0x7f2a7811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:14.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.004+0000 7f2a767fc700 1 --2- 172.21.15.156:0/1869768388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a78130bc0 0x7f2a7811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:14.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.004+0000 7f2a76ffd700 1 -- 172.21.15.156:0/1869768388 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a78133ad0 msgr2=0x7f2a7811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:14.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.004+0000 7f2a76ffd700 1 --2- 172.21.15.156:0/1869768388 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a78133ad0 0x7f2a7811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.004+0000 7f2a76ffd700 1 -- 172.21.15.156:0/1869768388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a78130bc0 msgr2=0x7f2a7811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:14.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.004+0000 7f2a76ffd700 1 --2- 172.21.15.156:0/1869768388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a78130bc0 0x7f2a7811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.004+0000 7f2a76ffd700 1 -- 172.21.15.156:0/1869768388 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a680094a0 con 0x7f2a781300a0 2023-09-30T22:20:14.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.005+0000 7f2a767fc700 1 --2- 172.21.15.156:0/1869768388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a78130bc0 0x7f2a7811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:14.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.005+0000 7f2a76ffd700 1 --2- 172.21.15.156:0/1869768388 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a781300a0 0x7f2a7811da40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2a680090b0 tx=0x7f2a68004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:14.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.005+0000 7f2a5f7fe700 1 -- 172.21.15.156:0/1869768388 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a68004510 con 0x7f2a781300a0 2023-09-30T22:20:14.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.005+0000 7f2a5f7fe700 1 -- 172.21.15.156:0/1869768388 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a680036a0 con 0x7f2a781300a0 2023-09-30T22:20:14.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.005+0000 7f2a7d784700 1 -- 172.21.15.156:0/1869768388 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a780a33e0 con 0x7f2a781300a0 2023-09-30T22:20:14.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.005+0000 7f2a5f7fe700 1 -- 172.21.15.156:0/1869768388 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a68003a10 con 0x7f2a781300a0 2023-09-30T22:20:14.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.005+0000 7f2a7d784700 1 -- 172.21.15.156:0/1869768388 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a7811fd70 con 0x7f2a781300a0 2023-09-30T22:20:14.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.006+0000 7f2a5f7fe700 1 -- 172.21.15.156:0/1869768388 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a68003b70 con 0x7f2a781300a0 2023-09-30T22:20:14.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.006+0000 7f2a7d784700 1 -- 172.21.15.156:0/1869768388 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a7804f2a0 con 0x7f2a781300a0 2023-09-30T22:20:14.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.006+0000 7f2a5f7fe700 1 -- 172.21.15.156:0/1869768388 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2a68040540 con 0x7f2a781300a0 2023-09-30T22:20:14.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.011+0000 7f2a5f7fe700 1 -- 172.21.15.156:0/1869768388 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a68010790 con 0x7f2a781300a0 2023-09-30T22:20:14.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.052+0000 7f3528bc9700 1 Processor -- start 2023-09-30T22:20:14.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.052+0000 7f3528bc9700 1 -- start start 2023-09-30T22:20:14.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.053+0000 7f3528bc9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3524099e20 0x7f352409a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:14.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.053+0000 7f3528bc9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f352409a730 0x7f3524130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:14.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.053+0000 7f3528bc9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3524130890 0x7f3524130d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:14.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.053+0000 7f3528bc9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f352409bf50 con 0x7f352409a730 2023-09-30T22:20:14.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.053+0000 7f3528bc9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3524099a60 con 0x7f3524099e20 2023-09-30T22:20:14.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.053+0000 7f3528bc9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f352409b230 con 0x7f3524130890 2023-09-30T22:20:14.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.053+0000 7f352259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3524099e20 0x7f352409a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:14.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.053+0000 7f352259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3524099e20 0x7f352409a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33524/0 (socket says 172.21.15.156:33524) 2023-09-30T22:20:14.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.053+0000 7f352259c700 1 -- 172.21.15.156:0/2516723310 learned_addr learned my addr 172.21.15.156:0/2516723310 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:14.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.053+0000 7f3521d9b700 1 --2- 172.21.15.156:0/2516723310 >> v2:172.21.15.156:3300/0 conn(0x7f352409a730 0x7f3524130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:14.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.053+0000 7f3522d9d700 1 --2- 172.21.15.156:0/2516723310 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3524130890 0x7f3524130d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:14.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.053+0000 7f3521d9b700 1 -- 172.21.15.156:0/2516723310 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3524130890 msgr2=0x7f3524130d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:14.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.053+0000 7f3521d9b700 1 --2- 172.21.15.156:0/2516723310 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3524130890 0x7f3524130d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.053+0000 7f3521d9b700 1 -- 172.21.15.156:0/2516723310 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3524099e20 msgr2=0x7f352409a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:14.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.053+0000 7f3521d9b700 1 --2- 172.21.15.156:0/2516723310 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3524099e20 0x7f352409a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.053+0000 7f3521d9b700 1 -- 172.21.15.156:0/2516723310 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352409bb90 con 0x7f352409a730 2023-09-30T22:20:14.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.054+0000 7f3521d9b700 1 --2- 172.21.15.156:0/2516723310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f352409a730 0x7f3524130350 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3518009870 tx=0x7f3518009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dbea68308528136 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:14.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.054+0000 7f352159a700 1 -- 172.21.15.156:0/2516723310 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351800f8a0 con 0x7f352409a730 2023-09-30T22:20:14.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.054+0000 7f352159a700 1 -- 172.21.15.156:0/2516723310 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351800fa00 con 0x7f352409a730 2023-09-30T22:20:14.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.054+0000 7f352159a700 1 -- 172.21.15.156:0/2516723310 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351800fd90 con 0x7f352409a730 2023-09-30T22:20:14.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.055+0000 7f3528bc9700 1 -- 172.21.15.156:0/2516723310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f352409a730 msgr2=0x7f3524130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:14.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.055+0000 7f3528bc9700 1 --2- 172.21.15.156:0/2516723310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f352409a730 0x7f3524130350 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3518009870 tx=0x7f3518009b80 comp rx=0 tx=0).stop 2023-09-30T22:20:14.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.055+0000 7f3528bc9700 1 -- 172.21.15.156:0/2516723310 shutdown_connections 2023-09-30T22:20:14.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.055+0000 7f3528bc9700 1 --2- 172.21.15.156:0/2516723310 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3524130890 0x7f3524130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.055+0000 7f3528bc9700 1 --2- 172.21.15.156:0/2516723310 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3524099e20 0x7f352409a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.055+0000 7f3528bc9700 1 --2- 172.21.15.156:0/2516723310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f352409a730 0x7f3524130350 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.055+0000 7f3528bc9700 1 -- 172.21.15.156:0/2516723310 >> 172.21.15.156:0/2516723310 conn(0x7f35240a2980 msgr2=0x7f35240a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:14.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.055+0000 7f3528bc9700 1 -- 172.21.15.156:0/2516723310 shutdown_connections 2023-09-30T22:20:14.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.055+0000 7f3528bc9700 1 -- 172.21.15.156:0/2516723310 wait complete. 2023-09-30T22:20:14.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.056+0000 7f3528bc9700 1 Processor -- start 2023-09-30T22:20:14.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.056+0000 7f3528bc9700 1 -- start start 2023-09-30T22:20:14.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.056+0000 7f3528bc9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3524099e20 0x7f35241cc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:14.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.056+0000 7f3528bc9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f352409a730 0x7f35241ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:14.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.056+0000 7f3528bc9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3524130890 0x7f35241cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:14.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.056+0000 7f3528bc9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3524127360 con 0x7f3524130890 2023-09-30T22:20:14.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.056+0000 7f3528bc9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35240a1300 con 0x7f352409a730 2023-09-30T22:20:14.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.056+0000 7f3528bc9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3524127590 con 0x7f3524099e20 2023-09-30T22:20:14.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.057+0000 7f3521d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f352409a730 0x7f35241ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:14.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.057+0000 7f3521d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f352409a730 0x7f35241ccc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33526/0 (socket says 172.21.15.156:33526) 2023-09-30T22:20:14.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.057+0000 7f3521d9b700 1 -- 172.21.15.156:0/4235368762 learned_addr learned my addr 172.21.15.156:0/4235368762 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:14.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.057+0000 7f3522d9d700 1 --2- 172.21.15.156:0/4235368762 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3524130890 0x7f35241cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:14.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.057+0000 7f352259c700 1 --2- 172.21.15.156:0/4235368762 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3524099e20 0x7f35241cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:14.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.057+0000 7f3522d9d700 1 -- 172.21.15.156:0/4235368762 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3524099e20 msgr2=0x7f35241cc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:14.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.057+0000 7f3522d9d700 1 --2- 172.21.15.156:0/4235368762 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3524099e20 0x7f35241cc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.057+0000 7f3522d9d700 1 -- 172.21.15.156:0/4235368762 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f352409a730 msgr2=0x7f35241ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:14.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.057+0000 7f3522d9d700 1 --2- 172.21.15.156:0/4235368762 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f352409a730 0x7f35241ccc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.057+0000 7f3522d9d700 1 -- 172.21.15.156:0/4235368762 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35180094a0 con 0x7f3524130890 2023-09-30T22:20:14.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.057+0000 7f3522d9d700 1 --2- 172.21.15.156:0/4235368762 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3524130890 0x7f35241cd1c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f351c00efc0 tx=0x7f351c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:14.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.057+0000 7f3512ffd700 1 -- 172.21.15.156:0/4235368762 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c00cd40 con 0x7f3524130890 2023-09-30T22:20:14.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.057+0000 7f3512ffd700 1 -- 172.21.15.156:0/4235368762 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351c00f040 con 0x7f3524130890 2023-09-30T22:20:14.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.057+0000 7f3528bc9700 1 -- 172.21.15.156:0/4235368762 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3524125a10 con 0x7f3524130890 2023-09-30T22:20:14.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.058+0000 7f3512ffd700 1 -- 172.21.15.156:0/4235368762 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c0146c0 con 0x7f3524130890 2023-09-30T22:20:14.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.058+0000 7f3528bc9700 1 -- 172.21.15.156:0/4235368762 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3524125f60 con 0x7f3524130890 2023-09-30T22:20:14.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.058+0000 7f3512ffd700 1 -- 172.21.15.156:0/4235368762 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f351c014820 con 0x7f3524130890 2023-09-30T22:20:14.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.059+0000 7f3528bc9700 1 -- 172.21.15.156:0/4235368762 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f352404f2a0 con 0x7f3524130890 2023-09-30T22:20:14.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.059+0000 7f3512ffd700 1 -- 172.21.15.156:0/4235368762 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f351c040250 con 0x7f3524130890 2023-09-30T22:20:14.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.067+0000 7f3512ffd700 1 -- 172.21.15.156:0/4235368762 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f351c007900 con 0x7f3524130890 2023-09-30T22:20:14.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.102+0000 7f0d73009700 1 Processor -- start 2023-09-30T22:20:14.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.102+0000 7f0d73009700 1 -- start start 2023-09-30T22:20:14.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.103+0000 7f0d73009700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d6c09f350 0x7f0d6c136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:14.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.103+0000 7f0d73009700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0d6c1371c0 0x7f0d6c1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:14.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.103+0000 7f0d73009700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d6c09c970 con 0x7f0d6c09e870 2023-09-30T22:20:14.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.103+0000 7f0d73009700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d6c0a0920 con 0x7f0d6c1371c0 2023-09-30T22:20:14.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.103+0000 7f0d73009700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c09f9c0 con 0x7f0d6c09f350 2023-09-30T22:20:14.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.103+0000 7f0d70da5700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f0d6c09e870 0x7f0d6c09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:43346/0 (socket says 172.21.15.156:43346) 2023-09-30T22:20:14.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.103+0000 7f0d70da5700 1 -- 172.21.15.156:0/599278910 learned_addr learned my addr 172.21.15.156:0/599278910 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:14.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.103+0000 7f0d715a6700 1 --2- 172.21.15.156:0/599278910 >> v2:172.21.15.156:3300/0 conn(0x7f0d6c1371c0 0x7f0d6c1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:14.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.103+0000 7f0d6bfff700 1 --2- 172.21.15.156:0/599278910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d6c09f350 0x7f0d6c136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:14.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.103+0000 7f0d6b7fe700 1 -- 172.21.15.156:0/599278910 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1177851947 0 0) 0x7f0d6c09c970 con 0x7f0d6c09e870 2023-09-30T22:20:14.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.103+0000 7f0d6b7fe700 1 -- 172.21.15.156:0/599278910 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d5c0035b0 con 0x7f0d6c09e870 2023-09-30T22:20:14.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.103+0000 7f0d6bfff700 1 -- 172.21.15.156:0/599278910 >> v2:172.21.15.156:3300/0 conn(0x7f0d6c1371c0 msgr2=0x7f0d6c1395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:14.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.103+0000 7f0d6bfff700 1 --2- 172.21.15.156:0/599278910 >> v2:172.21.15.156:3300/0 conn(0x7f0d6c1371c0 0x7f0d6c1395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.103+0000 7f0d6bfff700 1 -- 172.21.15.156:0/599278910 >> v1:172.21.15.156:6789/0 conn(0x7f0d6c09e870 legacy=0x7f0d6c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:14.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.103+0000 7f0d6bfff700 1 -- 172.21.15.156:0/599278910 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6c09bab0 con 0x7f0d6c09f350 2023-09-30T22:20:14.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.103+0000 7f0d6bfff700 1 --2- 172.21.15.156:0/599278910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d6c09f350 0x7f0d6c136c80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009840 tx=0x7f0d58009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9949a75e7ff22598 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:14.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.104+0000 7f0d6b7fe700 1 -- 172.21.15.156:0/599278910 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58011830 con 0x7f0d6c09f350 2023-09-30T22:20:14.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.104+0000 7f0d6b7fe700 1 -- 172.21.15.156:0/599278910 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d58011990 con 0x7f0d6c09f350 2023-09-30T22:20:14.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.104+0000 7f0d6b7fe700 1 -- 172.21.15.156:0/599278910 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58011d00 con 0x7f0d6c09f350 2023-09-30T22:20:14.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.105+0000 7f0d73009700 1 -- 172.21.15.156:0/599278910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d6c09f350 msgr2=0x7f0d6c136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:14.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.105+0000 7f0d73009700 1 --2- 172.21.15.156:0/599278910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d6c09f350 0x7f0d6c136c80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009840 tx=0x7f0d58009b50 comp rx=0 tx=0).stop 2023-09-30T22:20:14.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.105+0000 7f0d73009700 1 -- 172.21.15.156:0/599278910 shutdown_connections 2023-09-30T22:20:14.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.105+0000 7f0d73009700 1 --2- 172.21.15.156:0/599278910 >> v2:172.21.15.156:3300/0 conn(0x7f0d6c1371c0 0x7f0d6c1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.105+0000 7f0d73009700 1 --2- 172.21.15.156:0/599278910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d6c09f350 0x7f0d6c136c80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.105+0000 7f0d73009700 1 -- 172.21.15.156:0/599278910 >> 172.21.15.156:0/599278910 conn(0x7f0d6c0a4430 msgr2=0x7f0d6c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:14.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.105+0000 7f0d73009700 1 -- 172.21.15.156:0/599278910 shutdown_connections 2023-09-30T22:20:14.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.105+0000 7f0d73009700 1 -- 172.21.15.156:0/599278910 wait complete. 2023-09-30T22:20:14.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.106+0000 7f0d73009700 1 Processor -- start 2023-09-30T22:20:14.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.106+0000 7f0d73009700 1 -- start start 2023-09-30T22:20:14.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.107+0000 7f0d73009700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d6c09e870 0x7f0d6c1c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:14.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.107+0000 7f0d73009700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d6c09f350 0x7f0d6c1c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:14.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.107+0000 7f0d73009700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d6c1371c0 0x7f0d6c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:14.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.107+0000 7f0d73009700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c1365d0 con 0x7f0d6c09f350 2023-09-30T22:20:14.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.107+0000 7f0d73009700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c06d640 con 0x7f0d6c1371c0 2023-09-30T22:20:14.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.107+0000 7f0d73009700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c072230 con 0x7f0d6c09e870 2023-09-30T22:20:14.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.107+0000 7f0d6bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d6c09f350 0x7f0d6c1c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:14.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.107+0000 7f0d6bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d6c09f350 0x7f0d6c1c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38096/0 (socket says 172.21.15.156:38096) 2023-09-30T22:20:14.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.107+0000 7f0d6bfff700 1 -- 172.21.15.156:0/2881077782 learned_addr learned my addr 172.21.15.156:0/2881077782 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:14.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.107+0000 7f0d715a6700 1 --2- 172.21.15.156:0/2881077782 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d6c1371c0 0x7f0d6c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:14.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.108+0000 7f0d70da5700 1 --2- 172.21.15.156:0/2881077782 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d6c09e870 0x7f0d6c1c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:14.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.108+0000 7f0d6bfff700 1 -- 172.21.15.156:0/2881077782 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d6c09e870 msgr2=0x7f0d6c1c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:14.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.108+0000 7f0d6bfff700 1 --2- 172.21.15.156:0/2881077782 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d6c09e870 0x7f0d6c1c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.108+0000 7f0d6bfff700 1 -- 172.21.15.156:0/2881077782 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d6c1371c0 msgr2=0x7f0d6c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:14.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.108+0000 7f0d6bfff700 1 --2- 172.21.15.156:0/2881077782 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d6c1371c0 0x7f0d6c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.108+0000 7f0d6bfff700 1 -- 172.21.15.156:0/2881077782 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d580094a0 con 0x7f0d6c09f350 2023-09-30T22:20:14.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.108+0000 7f0d70da5700 1 --2- 172.21.15.156:0/2881077782 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d6c09e870 0x7f0d6c1c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:20:14.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.108+0000 7f0d6bfff700 1 --2- 172.21.15.156:0/2881077782 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d6c09f350 0x7f0d6c1c8c40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0d580090b0 tx=0x7f0d58004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:14.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.108+0000 7f0d697fa700 1 -- 172.21.15.156:0/2881077782 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58004550 con 0x7f0d6c09f350 2023-09-30T22:20:14.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.108+0000 7f0d697fa700 1 -- 172.21.15.156:0/2881077782 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5801f070 con 0x7f0d6c09f350 2023-09-30T22:20:14.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.108+0000 7f0d73009700 1 -- 172.21.15.156:0/2881077782 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d6c126520 con 0x7f0d6c09f350 2023-09-30T22:20:14.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.108+0000 7f0d697fa700 1 -- 172.21.15.156:0/2881077782 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d580038e0 con 0x7f0d6c09f350 2023-09-30T22:20:14.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.108+0000 7f0d73009700 1 -- 172.21.15.156:0/2881077782 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d6c09dba0 con 0x7f0d6c09f350 2023-09-30T22:20:14.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.109+0000 7f0d697fa700 1 -- 172.21.15.156:0/2881077782 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d58003a40 con 0x7f0d6c09f350 2023-09-30T22:20:14.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.109+0000 7f0d73009700 1 -- 172.21.15.156:0/2881077782 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d6c06ad00 con 0x7f0d6c09f350 2023-09-30T22:20:14.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.110+0000 7f0d697fa700 1 -- 172.21.15.156:0/2881077782 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0d58021070 con 0x7f0d6c09f350 2023-09-30T22:20:14.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.118+0000 7f0d697fa700 1 -- 172.21.15.156:0/2881077782 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d5802f3a0 con 0x7f0d6c09f350 2023-09-30T22:20:14.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.142+0000 7f3b7ead8700 1 Processor -- start 2023-09-30T22:20:14.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.142+0000 7f3b7ead8700 1 -- start start 2023-09-30T22:20:14.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.143+0000 7f3b7ead8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3b780a0a30 0x7f3b780a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:14.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.143+0000 7f3b7ead8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3b780a1340 0x7f3b7812ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:14.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.143+0000 7f3b7ead8700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b780a1e70 con 0x7f3b781304a0 2023-09-30T22:20:14.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.143+0000 7f3b7ead8700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b7809a720 con 0x7f3b780a1340 2023-09-30T22:20:14.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.143+0000 7f3b7ead8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7809b300 con 0x7f3b780a0a30 2023-09-30T22:20:14.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.143+0000 7f3b77fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3b780a1340 0x7f3b7812ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:14.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.143+0000 7f3b77fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3b780a1340 0x7f3b7812ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38102/0 (socket says 172.21.15.156:38102) 2023-09-30T22:20:14.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.143+0000 7f3b77fff700 1 -- 172.21.15.156:0/770320069 learned_addr learned my addr 172.21.15.156:0/770320069 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:14.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.143+0000 7f3b7c874700 1 --2- 172.21.15.156:0/770320069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3b780a0a30 0x7f3b780a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:14.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.143+0000 7f3b7c874700 1 -- 172.21.15.156:0/770320069 >> v2:172.21.15.156:3300/0 conn(0x7f3b780a1340 msgr2=0x7f3b7812ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:14.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.143+0000 7f3b7c874700 1 --2- 172.21.15.156:0/770320069 >> v2:172.21.15.156:3300/0 conn(0x7f3b780a1340 0x7f3b7812ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.143+0000 7f3b7c874700 1 -- 172.21.15.156:0/770320069 >> v1:172.21.15.156:6789/0 conn(0x7f3b781304a0 legacy=0x7f3b781371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:14.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.143+0000 7f3b7c874700 1 -- 172.21.15.156:0/770320069 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7809abc0 con 0x7f3b780a0a30 2023-09-30T22:20:14.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.144+0000 7f3b7c874700 1 --2- 172.21.15.156:0/770320069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3b780a0a30 0x7f3b780a0e00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c009820 tx=0x7f3b6c009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5031ca3ca90a836 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:14.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.144+0000 7f3b777fe700 1 -- 172.21.15.156:0/770320069 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c005e30 con 0x7f3b780a0a30 2023-09-30T22:20:14.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.144+0000 7f3b777fe700 1 -- 172.21.15.156:0/770320069 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6c006030 con 0x7f3b780a0a30 2023-09-30T22:20:14.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.144+0000 7f3b777fe700 1 -- 172.21.15.156:0/770320069 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c0063c0 con 0x7f3b780a0a30 2023-09-30T22:20:14.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.145+0000 7f3b7ead8700 1 -- 172.21.15.156:0/770320069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3b780a0a30 msgr2=0x7f3b780a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:14.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.145+0000 7f3b7ead8700 1 --2- 172.21.15.156:0/770320069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3b780a0a30 0x7f3b780a0e00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c009820 tx=0x7f3b6c009b30 comp rx=0 tx=0).stop 2023-09-30T22:20:14.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.145+0000 7f3b7ead8700 1 -- 172.21.15.156:0/770320069 shutdown_connections 2023-09-30T22:20:14.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.145+0000 7f3b7ead8700 1 --2- 172.21.15.156:0/770320069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3b780a0a30 0x7f3b780a0e00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.145+0000 7f3b7ead8700 1 --2- 172.21.15.156:0/770320069 >> v2:172.21.15.156:3300/0 conn(0x7f3b780a1340 0x7f3b7812ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.145+0000 7f3b7ead8700 1 -- 172.21.15.156:0/770320069 >> 172.21.15.156:0/770320069 conn(0x7f3b780a2980 msgr2=0x7f3b780a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:14.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.145+0000 7f3b7ead8700 1 -- 172.21.15.156:0/770320069 shutdown_connections 2023-09-30T22:20:14.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.145+0000 7f3b7ead8700 1 -- 172.21.15.156:0/770320069 wait complete. 2023-09-30T22:20:14.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.146+0000 7f3b7ead8700 1 Processor -- start 2023-09-30T22:20:14.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.146+0000 7f3b7ead8700 1 -- start start 2023-09-30T22:20:14.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.146+0000 7f3b7ead8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b780a0a30 0x7f3b781b9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:14.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.146+0000 7f3b7ead8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3b780a1340 0x7f3b781b9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:14.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.146+0000 7f3b7ead8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3b781304a0 0x7f3b781b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:14.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.146+0000 7f3b7ead8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b781bac50 con 0x7f3b780a0a30 2023-09-30T22:20:14.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.146+0000 7f3b7ead8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7811d930 con 0x7f3b780a1340 2023-09-30T22:20:14.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.146+0000 7f3b7ead8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b781bb4b0 con 0x7f3b781304a0 2023-09-30T22:20:14.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.146+0000 7f3b7c874700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b780a0a30 0x7f3b781b9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:14.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.146+0000 7f3b7c874700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b780a0a30 0x7f3b781b9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38112/0 (socket says 172.21.15.156:38112) 2023-09-30T22:20:14.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.146+0000 7f3b7c874700 1 -- 172.21.15.156:0/2425791799 learned_addr learned my addr 172.21.15.156:0/2425791799 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:14.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.146+0000 7f3b77fff700 1 --2- 172.21.15.156:0/2425791799 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3b780a1340 0x7f3b781b9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:14.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.147+0000 7f3b7d075700 1 --2- 172.21.15.156:0/2425791799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3b781304a0 0x7f3b781b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:14.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.147+0000 7f3b7c874700 1 -- 172.21.15.156:0/2425791799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3b781304a0 msgr2=0x7f3b781b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:14.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.147+0000 7f3b7c874700 1 --2- 172.21.15.156:0/2425791799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3b781304a0 0x7f3b781b9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.147+0000 7f3b7c874700 1 -- 172.21.15.156:0/2425791799 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3b780a1340 msgr2=0x7f3b781b9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:14.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.147+0000 7f3b7c874700 1 --2- 172.21.15.156:0/2425791799 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3b780a1340 0x7f3b781b9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.147+0000 7f3b7c874700 1 -- 172.21.15.156:0/2425791799 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c009430 con 0x7f3b780a0a30 2023-09-30T22:20:14.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.147+0000 7f3b77fff700 1 --2- 172.21.15.156:0/2425791799 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3b780a1340 0x7f3b781b9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:20:14.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.147+0000 7f3b7d075700 1 --2- 172.21.15.156:0/2425791799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3b781304a0 0x7f3b781b9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:20:14.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.147+0000 7f3b7c874700 1 --2- 172.21.15.156:0/2425791799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b780a0a30 0x7f3b781b9040 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3b7809b440 tx=0x7f3b6c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:14.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.147+0000 7f3b757fa700 1 -- 172.21.15.156:0/2425791799 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c0063a0 con 0x7f3b780a0a30 2023-09-30T22:20:14.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.147+0000 7f3b757fa700 1 -- 172.21.15.156:0/2425791799 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6c020070 con 0x7f3b780a0a30 2023-09-30T22:20:14.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.147+0000 7f3b757fa700 1 -- 172.21.15.156:0/2425791799 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c006740 con 0x7f3b780a0a30 2023-09-30T22:20:14.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.147+0000 7f3b7ead8700 1 -- 172.21.15.156:0/2425791799 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b7811e310 con 0x7f3b780a0a30 2023-09-30T22:20:14.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.147+0000 7f3b7ead8700 1 -- 172.21.15.156:0/2425791799 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7809fba0 con 0x7f3b780a0a30 2023-09-30T22:20:14.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.148+0000 7f3b757fa700 1 -- 172.21.15.156:0/2425791799 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b6c022030 con 0x7f3b780a0a30 2023-09-30T22:20:14.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.148+0000 7f3b7ead8700 1 -- 172.21.15.156:0/2425791799 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b7809ae00 con 0x7f3b780a0a30 2023-09-30T22:20:14.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.148+0000 7f3b757fa700 1 -- 172.21.15.156:0/2425791799 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3b6c040c80 con 0x7f3b780a0a30 2023-09-30T22:20:14.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.157+0000 7f3b757fa700 1 -- 172.21.15.156:0/2425791799 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b6c0249c0 con 0x7f3b780a0a30 2023-09-30T22:20:14.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.222+0000 7f2a7d784700 1 -- 172.21.15.156:0/1869768388 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2a780717b0 con 0x7f2a781300a0 2023-09-30T22:20:14.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.222+0000 7f2a5f7fe700 1 -- 172.21.15.156:0/1869768388 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2a68028070 con 0x7f2a781300a0 2023-09-30T22:20:14.223 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:14.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.224+0000 7f2a7d784700 1 -- 172.21.15.156:0/1869768388 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a781300a0 msgr2=0x7f2a7811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:14.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.224+0000 7f2a7d784700 1 --2- 172.21.15.156:0/1869768388 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a781300a0 0x7f2a7811da40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2a680090b0 tx=0x7f2a68004750 comp rx=0 tx=0).stop 2023-09-30T22:20:14.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.224+0000 7f2a7d784700 1 -- 172.21.15.156:0/1869768388 shutdown_connections 2023-09-30T22:20:14.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.224+0000 7f2a7d784700 1 --2- 172.21.15.156:0/1869768388 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a78133ad0 0x7f2a7811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.224+0000 7f2a7d784700 1 --2- 172.21.15.156:0/1869768388 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a781300a0 0x7f2a7811da40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.224+0000 7f2a7d784700 1 --2- 172.21.15.156:0/1869768388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a78130bc0 0x7f2a7811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.224+0000 7f2a7d784700 1 -- 172.21.15.156:0/1869768388 >> 172.21.15.156:0/1869768388 conn(0x7f2a78099c40 msgr2=0x7f2a78132c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:14.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.224+0000 7f2a7d784700 1 -- 172.21.15.156:0/1869768388 shutdown_connections 2023-09-30T22:20:14.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.224+0000 7f2a7d784700 1 -- 172.21.15.156:0/1869768388 wait complete. 2023-09-30T22:20:14.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:14.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.271+0000 7f3528bc9700 1 -- 172.21.15.156:0/4235368762 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f352406bce0 con 0x7f3524130890 2023-09-30T22:20:14.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.271+0000 7f3512ffd700 1 -- 172.21.15.156:0/4235368762 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f351c018020 con 0x7f3524130890 2023-09-30T22:20:14.272 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:14.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.273+0000 7f3528bc9700 1 -- 172.21.15.156:0/4235368762 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3524130890 msgr2=0x7f35241cd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:14.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.273+0000 7f3528bc9700 1 --2- 172.21.15.156:0/4235368762 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3524130890 0x7f35241cd1c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f351c00efc0 tx=0x7f351c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.273+0000 7f3528bc9700 1 -- 172.21.15.156:0/4235368762 shutdown_connections 2023-09-30T22:20:14.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.273+0000 7f3528bc9700 1 --2- 172.21.15.156:0/4235368762 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3524130890 0x7f35241cd1c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.273+0000 7f3528bc9700 1 --2- 172.21.15.156:0/4235368762 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3524099e20 0x7f35241cc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.273+0000 7f3528bc9700 1 --2- 172.21.15.156:0/4235368762 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f352409a730 0x7f35241ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.273+0000 7f3528bc9700 1 -- 172.21.15.156:0/4235368762 >> 172.21.15.156:0/4235368762 conn(0x7f35240a2980 msgr2=0x7f352409f520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:14.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.273+0000 7f3528bc9700 1 -- 172.21.15.156:0/4235368762 shutdown_connections 2023-09-30T22:20:14.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.273+0000 7f3528bc9700 1 -- 172.21.15.156:0/4235368762 wait complete. 2023-09-30T22:20:14.286 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:14.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.322+0000 7f0d73009700 1 -- 172.21.15.156:0/2881077782 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0d6c136980 con 0x7f0d6c09f350 2023-09-30T22:20:14.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.322+0000 7f0d697fa700 1 -- 172.21.15.156:0/2881077782 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d5802b070 con 0x7f0d6c09f350 2023-09-30T22:20:14.323 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:14.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.324+0000 7f0d73009700 1 -- 172.21.15.156:0/2881077782 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d6c09f350 msgr2=0x7f0d6c1c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:14.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.324+0000 7f0d73009700 1 --2- 172.21.15.156:0/2881077782 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d6c09f350 0x7f0d6c1c8c40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0d580090b0 tx=0x7f0d58004750 comp rx=0 tx=0).stop 2023-09-30T22:20:14.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.324+0000 7f0d73009700 1 -- 172.21.15.156:0/2881077782 shutdown_connections 2023-09-30T22:20:14.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.324+0000 7f0d73009700 1 --2- 172.21.15.156:0/2881077782 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d6c1371c0 0x7f0d6c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.324+0000 7f0d73009700 1 --2- 172.21.15.156:0/2881077782 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d6c09e870 0x7f0d6c1c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.324+0000 7f0d73009700 1 --2- 172.21.15.156:0/2881077782 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d6c09f350 0x7f0d6c1c8c40 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.324+0000 7f0d73009700 1 -- 172.21.15.156:0/2881077782 >> 172.21.15.156:0/2881077782 conn(0x7f0d6c0a4430 msgr2=0x7f0d6c070410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:14.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.324+0000 7f0d73009700 1 -- 172.21.15.156:0/2881077782 shutdown_connections 2023-09-30T22:20:14.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.324+0000 7f0d73009700 1 -- 172.21.15.156:0/2881077782 wait complete. 2023-09-30T22:20:14.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:14.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.351+0000 7f3b7ead8700 1 -- 172.21.15.156:0/2425791799 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3b7804f2a0 con 0x7f3b780a0a30 2023-09-30T22:20:14.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.352+0000 7f3b757fa700 1 -- 172.21.15.156:0/2425791799 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3b6c0243d0 con 0x7f3b780a0a30 2023-09-30T22:20:14.352 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:14.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.354+0000 7f3b7ead8700 1 -- 172.21.15.156:0/2425791799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b780a0a30 msgr2=0x7f3b781b9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:14.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.354+0000 7f3b7ead8700 1 --2- 172.21.15.156:0/2425791799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b780a0a30 0x7f3b781b9040 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3b7809b440 tx=0x7f3b6c004750 comp rx=0 tx=0).stop 2023-09-30T22:20:14.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.354+0000 7f3b7ead8700 1 -- 172.21.15.156:0/2425791799 shutdown_connections 2023-09-30T22:20:14.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.354+0000 7f3b7ead8700 1 --2- 172.21.15.156:0/2425791799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3b781304a0 0x7f3b781b9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.354+0000 7f3b7ead8700 1 --2- 172.21.15.156:0/2425791799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b780a0a30 0x7f3b781b9040 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.354+0000 7f3b7ead8700 1 --2- 172.21.15.156:0/2425791799 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3b780a1340 0x7f3b781b9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:14.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.354+0000 7f3b7ead8700 1 -- 172.21.15.156:0/2425791799 >> 172.21.15.156:0/2425791799 conn(0x7f3b780a2980 msgr2=0x7f3b7812fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:14.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.354+0000 7f3b7ead8700 1 -- 172.21.15.156:0/2425791799 shutdown_connections 2023-09-30T22:20:14.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:14.354+0000 7f3b7ead8700 1 -- 172.21.15.156:0/2425791799 wait complete. 2023-09-30T22:20:14.366 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:15.238 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:15.288 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:15.338 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:15.368 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:15.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.381+0000 7f5f906c2700 1 Processor -- start 2023-09-30T22:20:15.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.381+0000 7f5f906c2700 1 -- start start 2023-09-30T22:20:15.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.382+0000 7f5f906c2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5f88133900 0x7f5f88133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:15.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.382+0000 7f5f906c2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f880a10b0 0x7f5f8813b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:15.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.382+0000 7f5f906c2700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f8809a760 con 0x7f5f88134210 2023-09-30T22:20:15.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.382+0000 7f5f906c2700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f881336e0 con 0x7f5f88133900 2023-09-30T22:20:15.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.382+0000 7f5f906c2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8809a080 con 0x7f5f880a10b0 2023-09-30T22:20:15.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.382+0000 7f5f8e45e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5f88133900 0x7f5f88133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:15.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.382+0000 7f5f8e45e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5f88133900 0x7f5f88133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38124/0 (socket says 172.21.15.156:38124) 2023-09-30T22:20:15.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.382+0000 7f5f8e45e700 1 -- 172.21.15.156:0/1010560056 learned_addr learned my addr 172.21.15.156:0/1010560056 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:15.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.383+0000 7f5f8ec5f700 1 --2- 172.21.15.156:0/1010560056 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f880a10b0 0x7f5f8813b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:15.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.383+0000 7f5f8e45e700 1 -- 172.21.15.156:0/1010560056 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f880a10b0 msgr2=0x7f5f8813b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:15.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.383+0000 7f5f8e45e700 1 --2- 172.21.15.156:0/1010560056 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f880a10b0 0x7f5f8813b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.383+0000 7f5f8e45e700 1 -- 172.21.15.156:0/1010560056 >> v1:172.21.15.156:6789/0 conn(0x7f5f88134210 legacy=0x7f5f880a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:15.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.383+0000 7f5f8e45e700 1 -- 172.21.15.156:0/1010560056 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f880a23e0 con 0x7f5f88133900 2023-09-30T22:20:15.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.383+0000 7f5f8d45c700 1 -- 172.21.15.156:0/1010560056 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 904686062 0 0) 0x7f5f8809a760 con 0x7f5f88134210 2023-09-30T22:20:15.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.383+0000 7f5f8e45e700 1 --2- 172.21.15.156:0/1010560056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f88133900 0x7f5f88133cd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5f84006fd0 tx=0x7f5f84009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca57f4eaffc46cf9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:15.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.383+0000 7f5f8d45c700 1 -- 172.21.15.156:0/1010560056 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f84005e30 con 0x7f5f88133900 2023-09-30T22:20:15.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.383+0000 7f5f8d45c700 1 -- 172.21.15.156:0/1010560056 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f84004030 con 0x7f5f88133900 2023-09-30T22:20:15.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.383+0000 7f5f8d45c700 1 -- 172.21.15.156:0/1010560056 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f840043e0 con 0x7f5f88133900 2023-09-30T22:20:15.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.384+0000 7f5f906c2700 1 -- 172.21.15.156:0/1010560056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f88133900 msgr2=0x7f5f88133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:15.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.384+0000 7f5f906c2700 1 --2- 172.21.15.156:0/1010560056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f88133900 0x7f5f88133cd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5f84006fd0 tx=0x7f5f84009bd0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.384+0000 7f5f906c2700 1 -- 172.21.15.156:0/1010560056 shutdown_connections 2023-09-30T22:20:15.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.384+0000 7f5f906c2700 1 --2- 172.21.15.156:0/1010560056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f88133900 0x7f5f88133cd0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.384+0000 7f5f906c2700 1 --2- 172.21.15.156:0/1010560056 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f880a10b0 0x7f5f8813b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.384+0000 7f5f906c2700 1 -- 172.21.15.156:0/1010560056 >> 172.21.15.156:0/1010560056 conn(0x7f5f880a2980 msgr2=0x7f5f880a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:15.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.384+0000 7f5f906c2700 1 -- 172.21.15.156:0/1010560056 shutdown_connections 2023-09-30T22:20:15.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.384+0000 7f5f906c2700 1 -- 172.21.15.156:0/1010560056 wait complete. 2023-09-30T22:20:15.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.385+0000 7f5f906c2700 1 Processor -- start 2023-09-30T22:20:15.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.385+0000 7f5f906c2700 1 -- start start 2023-09-30T22:20:15.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.386+0000 7f5f906c2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f880a10b0 0x7f5f88121600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:15.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.386+0000 7f5f906c2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f88133900 0x7f5f88121b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:15.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.386+0000 7f5f906c2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f88134210 0x7f5f88122080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:15.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.386+0000 7f5f906c2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8809a2c0 con 0x7f5f88133900 2023-09-30T22:20:15.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.386+0000 7f5f906c2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f88124780 con 0x7f5f88134210 2023-09-30T22:20:15.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.386+0000 7f5f906c2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f88124a40 con 0x7f5f880a10b0 2023-09-30T22:20:15.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.386+0000 7f5f8e45e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f880a10b0 0x7f5f88121600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:15.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.386+0000 7f5f8dc5d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f88133900 0x7f5f88121b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:15.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.386+0000 7f5f8ec5f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f88134210 0x7f5f88122080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:15.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.386+0000 7f5f8e45e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f880a10b0 0x7f5f88121600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44726/0 (socket says 172.21.15.156:44726) 2023-09-30T22:20:15.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.386+0000 7f5f8e45e700 1 -- 172.21.15.156:0/333413169 learned_addr learned my addr 172.21.15.156:0/333413169 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:15.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.386+0000 7f5f8dc5d700 1 -- 172.21.15.156:0/333413169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f880a10b0 msgr2=0x7f5f88121600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:15.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.386+0000 7f5f8dc5d700 1 --2- 172.21.15.156:0/333413169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f880a10b0 0x7f5f88121600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.386+0000 7f5f8dc5d700 1 -- 172.21.15.156:0/333413169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f88134210 msgr2=0x7f5f88122080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:15.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.386+0000 7f5f8dc5d700 1 --2- 172.21.15.156:0/333413169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f88134210 0x7f5f88122080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.386+0000 7f5f8dc5d700 1 -- 172.21.15.156:0/333413169 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f84009500 con 0x7f5f88133900 2023-09-30T22:20:15.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.386+0000 7f5f8e45e700 1 --2- 172.21.15.156:0/333413169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f880a10b0 0x7f5f88121600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:15.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.387+0000 7f5f8dc5d700 1 --2- 172.21.15.156:0/333413169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f88133900 0x7f5f88121b40 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5f7800c430 tx=0x7f5f7800c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:15.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.387+0000 7f5f7effd700 1 -- 172.21.15.156:0/333413169 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f780054e0 con 0x7f5f88133900 2023-09-30T22:20:15.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.387+0000 7f5f7effd700 1 -- 172.21.15.156:0/333413169 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7800ce40 con 0x7f5f88133900 2023-09-30T22:20:15.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.387+0000 7f5f7effd700 1 -- 172.21.15.156:0/333413169 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f780038c0 con 0x7f5f88133900 2023-09-30T22:20:15.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.387+0000 7f5f906c2700 1 -- 172.21.15.156:0/333413169 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f88122da0 con 0x7f5f88133900 2023-09-30T22:20:15.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.387+0000 7f5f906c2700 1 -- 172.21.15.156:0/333413169 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f88124370 con 0x7f5f88133900 2023-09-30T22:20:15.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.388+0000 7f5f7effd700 1 -- 172.21.15.156:0/333413169 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f78003a20 con 0x7f5f88133900 2023-09-30T22:20:15.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.388+0000 7f5f7effd700 1 -- 172.21.15.156:0/333413169 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5f7803ea10 con 0x7f5f88133900 2023-09-30T22:20:15.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.388+0000 7f5f906c2700 1 -- 172.21.15.156:0/333413169 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f881245f0 con 0x7f5f88133900 2023-09-30T22:20:15.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.397+0000 7f5f7effd700 1 -- 172.21.15.156:0/333413169 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f78017070 con 0x7f5f88133900 2023-09-30T22:20:15.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.424+0000 7f1a79b66700 1 Processor -- start 2023-09-30T22:20:15.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.424+0000 7f1a79b66700 1 -- start start 2023-09-30T22:20:15.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.424+0000 7f1a79b66700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1a740a0a30 0x7f1a740a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:15.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.424+0000 7f1a79b66700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a740a1340 0x7f1a7412ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:15.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.424+0000 7f1a79b66700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a740a1e70 con 0x7f1a741304a0 2023-09-30T22:20:15.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.424+0000 7f1a79b66700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7409a720 con 0x7f1a740a1340 2023-09-30T22:20:15.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.424+0000 7f1a79b66700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7409b300 con 0x7f1a740a0a30 2023-09-30T22:20:15.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.425+0000 7f1a72ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a740a1340 0x7f1a7412ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:15.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.425+0000 7f1a72ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a740a1340 0x7f1a7412ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33580/0 (socket says 172.21.15.156:33580) 2023-09-30T22:20:15.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.425+0000 7f1a72ffd700 1 -- 172.21.15.156:0/3013831898 learned_addr learned my addr 172.21.15.156:0/3013831898 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:15.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.425+0000 7f1a737fe700 1 --2- 172.21.15.156:0/3013831898 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1a740a0a30 0x7f1a740a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:15.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.425+0000 7f1a72ffd700 1 -- 172.21.15.156:0/3013831898 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1a740a0a30 msgr2=0x7f1a740a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:15.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.425+0000 7f1a72ffd700 1 --2- 172.21.15.156:0/3013831898 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1a740a0a30 0x7f1a740a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.425+0000 7f1a72ffd700 1 -- 172.21.15.156:0/3013831898 >> v1:172.21.15.156:6789/0 conn(0x7f1a741304a0 legacy=0x7f1a741371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:15.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.425+0000 7f1a72ffd700 1 -- 172.21.15.156:0/3013831898 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7409abc0 con 0x7f1a740a1340 2023-09-30T22:20:15.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.425+0000 7f1a72ffd700 1 --2- 172.21.15.156:0/3013831898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a740a1340 0x7f1a7412ff60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1a68009920 tx=0x7f1a68009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da958942347a256d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:15.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.425+0000 7f1a727fc700 1 -- 172.21.15.156:0/3013831898 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6800ba60 con 0x7f1a740a1340 2023-09-30T22:20:15.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.425+0000 7f1a727fc700 1 -- 172.21.15.156:0/3013831898 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6800bbc0 con 0x7f1a740a1340 2023-09-30T22:20:15.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.425+0000 7f1a727fc700 1 -- 172.21.15.156:0/3013831898 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a68009e70 con 0x7f1a740a1340 2023-09-30T22:20:15.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.426+0000 7f1a79b66700 1 -- 172.21.15.156:0/3013831898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a740a1340 msgr2=0x7f1a7412ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:15.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.426+0000 7f1a79b66700 1 --2- 172.21.15.156:0/3013831898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a740a1340 0x7f1a7412ff60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1a68009920 tx=0x7f1a68009c30 comp rx=0 tx=0).stop 2023-09-30T22:20:15.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.426+0000 7f1a79b66700 1 -- 172.21.15.156:0/3013831898 shutdown_connections 2023-09-30T22:20:15.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.426+0000 7f1a79b66700 1 --2- 172.21.15.156:0/3013831898 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1a740a0a30 0x7f1a740a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.426+0000 7f1a79b66700 1 --2- 172.21.15.156:0/3013831898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a740a1340 0x7f1a7412ff60 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.426+0000 7f1a79b66700 1 -- 172.21.15.156:0/3013831898 >> 172.21.15.156:0/3013831898 conn(0x7f1a740a2980 msgr2=0x7f1a740a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:15.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.426+0000 7f1a79b66700 1 -- 172.21.15.156:0/3013831898 shutdown_connections 2023-09-30T22:20:15.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.426+0000 7f1a79b66700 1 -- 172.21.15.156:0/3013831898 wait complete. 2023-09-30T22:20:15.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.428+0000 7f1a79b66700 1 Processor -- start 2023-09-30T22:20:15.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.428+0000 7f1a79b66700 1 -- start start 2023-09-30T22:20:15.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.429+0000 7f1a79b66700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a740a0a30 0x7f1a74136760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:15.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.429+0000 7f1a79b66700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1a740a1340 0x7f1a74136ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:15.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.429+0000 7f1a79b66700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a741304a0 0x7f1a741371e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:15.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.429+0000 7f1a79b66700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a74138970 con 0x7f1a740a0a30 2023-09-30T22:20:15.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.429+0000 7f1a79b66700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7413a7f0 con 0x7f1a741304a0 2023-09-30T22:20:15.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.429+0000 7f1a79b66700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a74139f50 con 0x7f1a740a1340 2023-09-30T22:20:15.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.429+0000 7f1a737fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a740a0a30 0x7f1a74136760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:15.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.429+0000 7f1a737fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a740a0a30 0x7f1a74136760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38134/0 (socket says 172.21.15.156:38134) 2023-09-30T22:20:15.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.429+0000 7f1a737fe700 1 -- 172.21.15.156:0/2807914819 learned_addr learned my addr 172.21.15.156:0/2807914819 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:15.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.429+0000 7f1a72ffd700 1 --2- 172.21.15.156:0/2807914819 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1a740a1340 0x7f1a74136ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:15.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.429+0000 7f1a737fe700 1 -- 172.21.15.156:0/2807914819 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1a740a1340 msgr2=0x7f1a74136ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:15.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.429+0000 7f1a737fe700 1 --2- 172.21.15.156:0/2807914819 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1a740a1340 0x7f1a74136ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.429+0000 7f1a73fff700 1 --2- 172.21.15.156:0/2807914819 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a741304a0 0x7f1a741371e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:15.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.429+0000 7f1a737fe700 1 -- 172.21.15.156:0/2807914819 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a741304a0 msgr2=0x7f1a741371e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:15.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.429+0000 7f1a737fe700 1 --2- 172.21.15.156:0/2807914819 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a741304a0 0x7f1a741371e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.429+0000 7f1a737fe700 1 -- 172.21.15.156:0/2807914819 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a68009550 con 0x7f1a740a0a30 2023-09-30T22:20:15.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.429+0000 7f1a73fff700 1 --2- 172.21.15.156:0/2807914819 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a741304a0 0x7f1a741371e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:20:15.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.430+0000 7f1a737fe700 1 --2- 172.21.15.156:0/2807914819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a740a0a30 0x7f1a74136760 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1a6400e760 tx=0x7f1a6400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:15.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.430+0000 7f1a5bfff700 1 -- 172.21.15.156:0/2807914819 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a64013610 con 0x7f1a740a0a30 2023-09-30T22:20:15.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.430+0000 7f1a5bfff700 1 -- 172.21.15.156:0/2807914819 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a64013770 con 0x7f1a740a0a30 2023-09-30T22:20:15.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.430+0000 7f1a79b66700 1 -- 172.21.15.156:0/2807914819 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a7409fe80 con 0x7f1a740a0a30 2023-09-30T22:20:15.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.430+0000 7f1a5bfff700 1 -- 172.21.15.156:0/2807914819 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a64013b20 con 0x7f1a740a0a30 2023-09-30T22:20:15.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.430+0000 7f1a79b66700 1 -- 172.21.15.156:0/2807914819 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a7413a230 con 0x7f1a740a0a30 2023-09-30T22:20:15.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.431+0000 7f1a5bfff700 1 -- 172.21.15.156:0/2807914819 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a64013c80 con 0x7f1a740a0a30 2023-09-30T22:20:15.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.431+0000 7f1a5bfff700 1 -- 172.21.15.156:0/2807914819 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1a6403f400 con 0x7f1a740a0a30 2023-09-30T22:20:15.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.431+0000 7f1a79b66700 1 -- 172.21.15.156:0/2807914819 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a7404f2a0 con 0x7f1a740a0a30 2023-09-30T22:20:15.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.436+0000 7f1a5bfff700 1 -- 172.21.15.156:0/2807914819 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a64012370 con 0x7f1a740a0a30 2023-09-30T22:20:15.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.478+0000 7f01130db700 1 Processor -- start 2023-09-30T22:20:15.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.478+0000 7f01130db700 1 -- start start 2023-09-30T22:20:15.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.479+0000 7f01130db700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f010c09e340 0x7f010c1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:15.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.479+0000 7f01130db700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f010c135f20 0x7f010c138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:15.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.479+0000 7f01130db700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f010c09aaa0 con 0x7f010c09d860 2023-09-30T22:20:15.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.479+0000 7f01130db700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f010c09e730 con 0x7f010c09e340 2023-09-30T22:20:15.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.479+0000 7f01130db700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f010c09f870 con 0x7f010c135f20 2023-09-30T22:20:15.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.479+0000 7f0110e77700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f010c09d860 0x7f010c09dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:43386/0 (socket says 172.21.15.156:43386) 2023-09-30T22:20:15.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.479+0000 7f010bfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f010c09e340 0x7f010c1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:15.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.479+0000 7f0110e77700 1 -- 172.21.15.156:0/2853880639 learned_addr learned my addr 172.21.15.156:0/2853880639 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:15.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.479+0000 7f0111678700 1 --2- 172.21.15.156:0/2853880639 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f010c135f20 0x7f010c138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:15.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.480+0000 7f010bfff700 1 -- 172.21.15.156:0/2853880639 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f010c135f20 msgr2=0x7f010c138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:15.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.480+0000 7f010bfff700 1 --2- 172.21.15.156:0/2853880639 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f010c135f20 0x7f010c138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.480+0000 7f010bfff700 1 -- 172.21.15.156:0/2853880639 >> v1:172.21.15.156:6789/0 conn(0x7f010c09d860 legacy=0x7f010c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:15.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.480+0000 7f010bfff700 1 -- 172.21.15.156:0/2853880639 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010c09b360 con 0x7f010c09e340 2023-09-30T22:20:15.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.480+0000 7f010bfff700 1 --2- 172.21.15.156:0/2853880639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f010c09e340 0x7f010c1359e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f00f8009840 tx=0x7f00f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73bd55fe57bdd608 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:15.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.480+0000 7f010b7fe700 1 -- 172.21.15.156:0/2853880639 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8011830 con 0x7f010c09e340 2023-09-30T22:20:15.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.480+0000 7f010b7fe700 1 -- 172.21.15.156:0/2853880639 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f8011990 con 0x7f010c09e340 2023-09-30T22:20:15.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.480+0000 7f010b7fe700 1 -- 172.21.15.156:0/2853880639 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8011d20 con 0x7f010c09e340 2023-09-30T22:20:15.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.481+0000 7f01130db700 1 -- 172.21.15.156:0/2853880639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f010c09e340 msgr2=0x7f010c1359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:15.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.481+0000 7f01130db700 1 --2- 172.21.15.156:0/2853880639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f010c09e340 0x7f010c1359e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f00f8009840 tx=0x7f00f8009b50 comp rx=0 tx=0).stop 2023-09-30T22:20:15.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.481+0000 7f01130db700 1 -- 172.21.15.156:0/2853880639 shutdown_connections 2023-09-30T22:20:15.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.481+0000 7f01130db700 1 --2- 172.21.15.156:0/2853880639 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f010c135f20 0x7f010c138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.481+0000 7f01130db700 1 --2- 172.21.15.156:0/2853880639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f010c09e340 0x7f010c1359e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.481+0000 7f01130db700 1 -- 172.21.15.156:0/2853880639 >> 172.21.15.156:0/2853880639 conn(0x7f010c099c40 msgr2=0x7f010c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:15.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.481+0000 7f01130db700 1 -- 172.21.15.156:0/2853880639 shutdown_connections 2023-09-30T22:20:15.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.481+0000 7f01130db700 1 -- 172.21.15.156:0/2853880639 wait complete. 2023-09-30T22:20:15.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.482+0000 7f01130db700 1 Processor -- start 2023-09-30T22:20:15.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.482+0000 7f01130db700 1 -- start start 2023-09-30T22:20:15.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.482+0000 7f01130db700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f010c09d860 0x7f010c1c1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:15.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.482+0000 7f01130db700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f010c09e340 0x7f010c1c15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:15.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.482+0000 7f01130db700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f010c135f20 0x7f010c128a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:15.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.482+0000 7f01130db700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010c1c40e0 con 0x7f010c09e340 2023-09-30T22:20:15.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.482+0000 7f01130db700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010c1c42c0 con 0x7f010c135f20 2023-09-30T22:20:15.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.482+0000 7f01130db700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f010c1d1320 con 0x7f010c09d860 2023-09-30T22:20:15.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.482+0000 7f0111678700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f010c135f20 0x7f010c128a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:15.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.482+0000 7f0111678700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f010c135f20 0x7f010c128a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33612/0 (socket says 172.21.15.156:33612) 2023-09-30T22:20:15.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.482+0000 7f0111678700 1 -- 172.21.15.156:0/461141065 learned_addr learned my addr 172.21.15.156:0/461141065 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:15.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.483+0000 7f0110e77700 1 --2- 172.21.15.156:0/461141065 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f010c09d860 0x7f010c1c1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:15.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.483+0000 7f0111678700 1 -- 172.21.15.156:0/461141065 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f010c09d860 msgr2=0x7f010c1c1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:15.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.483+0000 7f0111678700 1 --2- 172.21.15.156:0/461141065 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f010c09d860 0x7f010c1c1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.483+0000 7f0111678700 1 -- 172.21.15.156:0/461141065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f010c09e340 msgr2=0x7f010c1c15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:15.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.483+0000 7f010bfff700 1 --2- 172.21.15.156:0/461141065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f010c09e340 0x7f010c1c15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:15.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.483+0000 7f0111678700 1 --2- 172.21.15.156:0/461141065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f010c09e340 0x7f010c1c15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.483+0000 7f0111678700 1 -- 172.21.15.156:0/461141065 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f80094a0 con 0x7f010c135f20 2023-09-30T22:20:15.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.483+0000 7f010bfff700 1 --2- 172.21.15.156:0/461141065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f010c09e340 0x7f010c1c15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:20:15.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.483+0000 7f0111678700 1 --2- 172.21.15.156:0/461141065 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f010c135f20 0x7f010c128a00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f010400efc0 tx=0x7f010400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:15.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.483+0000 7f01097fa700 1 -- 172.21.15.156:0/461141065 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010400cd40 con 0x7f010c135f20 2023-09-30T22:20:15.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.483+0000 7f01097fa700 1 -- 172.21.15.156:0/461141065 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010400f040 con 0x7f010c135f20 2023-09-30T22:20:15.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.483+0000 7f01130db700 1 -- 172.21.15.156:0/461141065 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f010c1c2960 con 0x7f010c135f20 2023-09-30T22:20:15.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.483+0000 7f01097fa700 1 -- 172.21.15.156:0/461141065 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01040146c0 con 0x7f010c135f20 2023-09-30T22:20:15.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.483+0000 7f01130db700 1 -- 172.21.15.156:0/461141065 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f010c072510 con 0x7f010c135f20 2023-09-30T22:20:15.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.484+0000 7f01097fa700 1 -- 172.21.15.156:0/461141065 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0104014820 con 0x7f010c135f20 2023-09-30T22:20:15.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.485+0000 7f01130db700 1 -- 172.21.15.156:0/461141065 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f010c09ee80 con 0x7f010c135f20 2023-09-30T22:20:15.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.485+0000 7f01097fa700 1 -- 172.21.15.156:0/461141065 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f01040402e0 con 0x7f010c135f20 2023-09-30T22:20:15.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.489+0000 7f01097fa700 1 -- 172.21.15.156:0/461141065 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0104007510 con 0x7f010c135f20 2023-09-30T22:20:15.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.520+0000 7f20df2cb700 1 Processor -- start 2023-09-30T22:20:15.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.521+0000 7f20df2cb700 1 -- start start 2023-09-30T22:20:15.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.521+0000 7f20df2cb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f20d80a0a70 0x7f20d80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:15.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.521+0000 7f20df2cb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f20d80a1380 0x7f20d8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:15.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.521+0000 7f20df2cb700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d809dc00 con 0x7f20d8133f50 2023-09-30T22:20:15.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.521+0000 7f20df2cb700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d809ea60 con 0x7f20d80a1380 2023-09-30T22:20:15.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.521+0000 7f20df2cb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d809dec0 con 0x7f20d80a0a70 2023-09-30T22:20:15.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.521+0000 7f20dd067700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f20d80a0a70 0x7f20d80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:15.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.522+0000 7f20dd067700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f20d80a0a70 0x7f20d80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33614/0 (socket says 172.21.15.156:33614) 2023-09-30T22:20:15.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.522+0000 7f20dd067700 1 -- 172.21.15.156:0/13495947 learned_addr learned my addr 172.21.15.156:0/13495947 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:15.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.522+0000 7f20dc866700 1 --2- 172.21.15.156:0/13495947 >> v2:172.21.15.156:3300/0 conn(0x7f20d80a1380 0x7f20d8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:15.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.522+0000 7f20dd067700 1 -- 172.21.15.156:0/13495947 >> v2:172.21.15.156:3300/0 conn(0x7f20d80a1380 msgr2=0x7f20d8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:15.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.522+0000 7f20dd067700 1 --2- 172.21.15.156:0/13495947 >> v2:172.21.15.156:3300/0 conn(0x7f20d80a1380 0x7f20d8133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.522+0000 7f20dd067700 1 -- 172.21.15.156:0/13495947 >> v1:172.21.15.156:6789/0 conn(0x7f20d8133f50 legacy=0x7f20d813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:15.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.522+0000 7f20dd067700 1 -- 172.21.15.156:0/13495947 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d809e6a0 con 0x7f20d80a0a70 2023-09-30T22:20:15.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.522+0000 7f20dd067700 1 --2- 172.21.15.156:0/13495947 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f20d80a0a70 0x7f20d80a0e40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f20d40098f0 tx=0x7f20d4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbf0ea75dba19a34 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:15.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.522+0000 7f20cffff700 1 -- 172.21.15.156:0/13495947 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d4011830 con 0x7f20d80a0a70 2023-09-30T22:20:15.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.522+0000 7f20cffff700 1 -- 172.21.15.156:0/13495947 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d4011990 con 0x7f20d80a0a70 2023-09-30T22:20:15.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.522+0000 7f20cffff700 1 -- 172.21.15.156:0/13495947 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d4011d20 con 0x7f20d80a0a70 2023-09-30T22:20:15.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.523+0000 7f20df2cb700 1 -- 172.21.15.156:0/13495947 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f20d80a0a70 msgr2=0x7f20d80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:15.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.523+0000 7f20df2cb700 1 --2- 172.21.15.156:0/13495947 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f20d80a0a70 0x7f20d80a0e40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f20d40098f0 tx=0x7f20d4009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:15.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.523+0000 7f20df2cb700 1 -- 172.21.15.156:0/13495947 shutdown_connections 2023-09-30T22:20:15.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.523+0000 7f20df2cb700 1 --2- 172.21.15.156:0/13495947 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f20d80a0a70 0x7f20d80a0e40 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.523+0000 7f20df2cb700 1 --2- 172.21.15.156:0/13495947 >> v2:172.21.15.156:3300/0 conn(0x7f20d80a1380 0x7f20d8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.523+0000 7f20df2cb700 1 -- 172.21.15.156:0/13495947 >> 172.21.15.156:0/13495947 conn(0x7f20d80a6610 msgr2=0x7f20d80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:15.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.523+0000 7f20df2cb700 1 -- 172.21.15.156:0/13495947 shutdown_connections 2023-09-30T22:20:15.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.523+0000 7f20df2cb700 1 -- 172.21.15.156:0/13495947 wait complete. 2023-09-30T22:20:15.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.524+0000 7f20df2cb700 1 Processor -- start 2023-09-30T22:20:15.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.524+0000 7f20df2cb700 1 -- start start 2023-09-30T22:20:15.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.525+0000 7f20df2cb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f20d80a0a70 0x7f20d81c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:15.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.525+0000 7f20df2cb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f20d80a1380 0x7f20d81c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:15.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.525+0000 7f20df2cb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f20d8133f50 0x7f20d81c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:15.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.525+0000 7f20df2cb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d8133ad0 con 0x7f20d80a1380 2023-09-30T22:20:15.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.525+0000 7f20df2cb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d8125300 con 0x7f20d8133f50 2023-09-30T22:20:15.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.525+0000 7f20df2cb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20d8124690 con 0x7f20d80a0a70 2023-09-30T22:20:15.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.525+0000 7f20dd067700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f20d80a0a70 0x7f20d81c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:15.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.525+0000 7f20dd868700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f20d8133f50 0x7f20d81c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:15.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.525+0000 7f20dc866700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f20d80a1380 0x7f20d81c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:15.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.525+0000 7f20dd067700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f20d80a0a70 0x7f20d81c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44778/0 (socket says 172.21.15.156:44778) 2023-09-30T22:20:15.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.525+0000 7f20dd067700 1 -- 172.21.15.156:0/2020158766 learned_addr learned my addr 172.21.15.156:0/2020158766 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:15.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.525+0000 7f20dd067700 1 -- 172.21.15.156:0/2020158766 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f20d8133f50 msgr2=0x7f20d81c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:15.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.525+0000 7f20dd067700 1 --2- 172.21.15.156:0/2020158766 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f20d8133f50 0x7f20d81c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.525+0000 7f20dd067700 1 -- 172.21.15.156:0/2020158766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f20d80a1380 msgr2=0x7f20d81c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:15.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.525+0000 7f20dd067700 1 --2- 172.21.15.156:0/2020158766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f20d80a1380 0x7f20d81c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.525+0000 7f20dd067700 1 -- 172.21.15.156:0/2020158766 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d4009550 con 0x7f20d80a0a70 2023-09-30T22:20:15.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.525+0000 7f20dc866700 1 --2- 172.21.15.156:0/2020158766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f20d80a1380 0x7f20d81c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:15.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.525+0000 7f20dd067700 1 --2- 172.21.15.156:0/2020158766 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f20d80a0a70 0x7f20d81c8250 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f20d4000c00 tx=0x7f20d4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:15.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.526+0000 7f20cdffb700 1 -- 172.21.15.156:0/2020158766 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d4004480 con 0x7f20d80a0a70 2023-09-30T22:20:15.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.526+0000 7f20cdffb700 1 -- 172.21.15.156:0/2020158766 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d401f070 con 0x7f20d80a0a70 2023-09-30T22:20:15.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.526+0000 7f20df2cb700 1 -- 172.21.15.156:0/2020158766 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d80a03e0 con 0x7f20d80a0a70 2023-09-30T22:20:15.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.526+0000 7f20cdffb700 1 -- 172.21.15.156:0/2020158766 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d40038c0 con 0x7f20d80a0a70 2023-09-30T22:20:15.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.526+0000 7f20df2cb700 1 -- 172.21.15.156:0/2020158766 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d81262c0 con 0x7f20d80a0a70 2023-09-30T22:20:15.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.527+0000 7f20df2cb700 1 -- 172.21.15.156:0/2020158766 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d804f2a0 con 0x7f20d80a0a70 2023-09-30T22:20:15.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.528+0000 7f20cdffb700 1 -- 172.21.15.156:0/2020158766 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f20d4021030 con 0x7f20d80a0a70 2023-09-30T22:20:15.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.528+0000 7f20cdffb700 1 -- 172.21.15.156:0/2020158766 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f20d4041080 con 0x7f20d80a0a70 2023-09-30T22:20:15.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.536+0000 7f20cdffb700 1 -- 172.21.15.156:0/2020158766 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f20d4019980 con 0x7f20d80a0a70 2023-09-30T22:20:15.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.601+0000 7f5f906c2700 1 -- 172.21.15.156:0/333413169 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5f8804f2a0 con 0x7f5f88133900 2023-09-30T22:20:15.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.601+0000 7f5f7effd700 1 -- 172.21.15.156:0/333413169 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f78019b20 con 0x7f5f88133900 2023-09-30T22:20:15.602 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:15.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.604+0000 7f5f906c2700 1 -- 172.21.15.156:0/333413169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f88133900 msgr2=0x7f5f88121b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:15.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.604+0000 7f5f906c2700 1 --2- 172.21.15.156:0/333413169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f88133900 0x7f5f88121b40 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5f7800c430 tx=0x7f5f7800c740 comp rx=0 tx=0).stop 2023-09-30T22:20:15.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.605+0000 7f5f906c2700 1 -- 172.21.15.156:0/333413169 shutdown_connections 2023-09-30T22:20:15.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.605+0000 7f5f906c2700 1 --2- 172.21.15.156:0/333413169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f88134210 0x7f5f88122080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.605+0000 7f5f906c2700 1 --2- 172.21.15.156:0/333413169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f880a10b0 0x7f5f88121600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.605+0000 7f5f906c2700 1 --2- 172.21.15.156:0/333413169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f88133900 0x7f5f88121b40 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.605+0000 7f5f906c2700 1 -- 172.21.15.156:0/333413169 >> 172.21.15.156:0/333413169 conn(0x7f5f880a2980 msgr2=0x7f5f881ba730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:15.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.605+0000 7f5f906c2700 1 -- 172.21.15.156:0/333413169 shutdown_connections 2023-09-30T22:20:15.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.605+0000 7f5f906c2700 1 -- 172.21.15.156:0/333413169 wait complete. 2023-09-30T22:20:15.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:15.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.650+0000 7f1a79b66700 1 -- 172.21.15.156:0/2807914819 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1a74139bf0 con 0x7f1a740a0a30 2023-09-30T22:20:15.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.651+0000 7f1a5bfff700 1 -- 172.21.15.156:0/2807914819 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a64021020 con 0x7f1a740a0a30 2023-09-30T22:20:15.651 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:15.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.654+0000 7f1a79b66700 1 -- 172.21.15.156:0/2807914819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a740a0a30 msgr2=0x7f1a74136760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:15.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.654+0000 7f1a79b66700 1 --2- 172.21.15.156:0/2807914819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a740a0a30 0x7f1a74136760 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1a6400e760 tx=0x7f1a6400ea70 comp rx=0 tx=0).stop 2023-09-30T22:20:15.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.655+0000 7f1a79b66700 1 -- 172.21.15.156:0/2807914819 shutdown_connections 2023-09-30T22:20:15.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.655+0000 7f1a79b66700 1 --2- 172.21.15.156:0/2807914819 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a741304a0 0x7f1a741371e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.655+0000 7f1a79b66700 1 --2- 172.21.15.156:0/2807914819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a740a0a30 0x7f1a74136760 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.655+0000 7f1a79b66700 1 --2- 172.21.15.156:0/2807914819 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1a740a1340 0x7f1a74136ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.655+0000 7f1a79b66700 1 -- 172.21.15.156:0/2807914819 >> 172.21.15.156:0/2807914819 conn(0x7f1a740a2980 msgr2=0x7f1a7409dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:15.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.655+0000 7f1a79b66700 1 -- 172.21.15.156:0/2807914819 shutdown_connections 2023-09-30T22:20:15.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.655+0000 7f1a79b66700 1 -- 172.21.15.156:0/2807914819 wait complete. 2023-09-30T22:20:15.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:15.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.696+0000 7f01130db700 1 -- 172.21.15.156:0/461141065 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f010c1c3f40 con 0x7f010c135f20 2023-09-30T22:20:15.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.696+0000 7f01097fa700 1 -- 172.21.15.156:0/461141065 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f010c1c3f40 con 0x7f010c135f20 2023-09-30T22:20:15.697 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:15.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.698+0000 7f01130db700 1 -- 172.21.15.156:0/461141065 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f010c135f20 msgr2=0x7f010c128a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:15.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.698+0000 7f01130db700 1 --2- 172.21.15.156:0/461141065 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f010c135f20 0x7f010c128a00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f010400efc0 tx=0x7f010400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.698+0000 7f01130db700 1 -- 172.21.15.156:0/461141065 shutdown_connections 2023-09-30T22:20:15.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.698+0000 7f01130db700 1 --2- 172.21.15.156:0/461141065 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f010c135f20 0x7f010c128a00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.698+0000 7f01130db700 1 --2- 172.21.15.156:0/461141065 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f010c09d860 0x7f010c1c1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.698+0000 7f01130db700 1 --2- 172.21.15.156:0/461141065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f010c09e340 0x7f010c1c15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.698+0000 7f01130db700 1 -- 172.21.15.156:0/461141065 >> 172.21.15.156:0/461141065 conn(0x7f010c099c40 msgr2=0x7f010c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:15.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.698+0000 7f01130db700 1 -- 172.21.15.156:0/461141065 shutdown_connections 2023-09-30T22:20:15.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.699+0000 7f01130db700 1 -- 172.21.15.156:0/461141065 wait complete. 2023-09-30T22:20:15.711 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:15.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.731+0000 7f20df2cb700 1 -- 172.21.15.156:0/2020158766 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f20d8072980 con 0x7f20d80a0a70 2023-09-30T22:20:15.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.731+0000 7f20cdffb700 1 -- 172.21.15.156:0/2020158766 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f20d4015030 con 0x7f20d80a0a70 2023-09-30T22:20:15.732 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:15.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.734+0000 7f20df2cb700 1 -- 172.21.15.156:0/2020158766 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f20d80a0a70 msgr2=0x7f20d81c8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:15.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.734+0000 7f20df2cb700 1 --2- 172.21.15.156:0/2020158766 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f20d80a0a70 0x7f20d81c8250 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f20d4000c00 tx=0x7f20d4004750 comp rx=0 tx=0).stop 2023-09-30T22:20:15.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.734+0000 7f20df2cb700 1 -- 172.21.15.156:0/2020158766 shutdown_connections 2023-09-30T22:20:15.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.734+0000 7f20df2cb700 1 --2- 172.21.15.156:0/2020158766 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f20d8133f50 0x7f20d81c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.734+0000 7f20df2cb700 1 --2- 172.21.15.156:0/2020158766 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f20d80a0a70 0x7f20d81c8250 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.734+0000 7f20df2cb700 1 --2- 172.21.15.156:0/2020158766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f20d80a1380 0x7f20d81c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:15.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.734+0000 7f20df2cb700 1 -- 172.21.15.156:0/2020158766 >> 172.21.15.156:0/2020158766 conn(0x7f20d80a6610 msgr2=0x7f20d80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:15.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.734+0000 7f20df2cb700 1 -- 172.21.15.156:0/2020158766 shutdown_connections 2023-09-30T22:20:15.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:15.734+0000 7f20df2cb700 1 -- 172.21.15.156:0/2020158766 wait complete. 2023-09-30T22:20:15.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:16.623 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:16.668 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:16.712 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:16.747 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:16.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.760+0000 7f75eb6b8700 1 Processor -- start 2023-09-30T22:20:16.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.760+0000 7f75eb6b8700 1 -- start start 2023-09-30T22:20:16.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.760+0000 7f75eb6b8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75e4136960 0x7f75e4138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:16.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.760+0000 7f75eb6b8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f75e4139280 0x7f75e413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:16.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.760+0000 7f75eb6b8700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e406b2d0 con 0x7f75e4133ad0 2023-09-30T22:20:16.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.761+0000 7f75eb6b8700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e41345b0 con 0x7f75e4139280 2023-09-30T22:20:16.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.761+0000 7f75eb6b8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e4133610 con 0x7f75e4136960 2023-09-30T22:20:16.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.761+0000 7f75e9c55700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f75e4139280 0x7f75e413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:16.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.761+0000 7f75e9454700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f75e4133ad0 0x7f75e4133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:43410/0 (socket says 172.21.15.156:43410) 2023-09-30T22:20:16.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.761+0000 7f75e9454700 1 -- 172.21.15.156:0/3358349964 learned_addr learned my addr 172.21.15.156:0/3358349964 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:16.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.761+0000 7f75e8c53700 1 --2- 172.21.15.156:0/3358349964 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75e4136960 0x7f75e4138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:16.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.761+0000 7f75e9c55700 1 -- 172.21.15.156:0/3358349964 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75e4136960 msgr2=0x7f75e4138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:16.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.761+0000 7f75e9c55700 1 --2- 172.21.15.156:0/3358349964 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75e4136960 0x7f75e4138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:16.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.761+0000 7f75e9c55700 1 -- 172.21.15.156:0/3358349964 >> v1:172.21.15.156:6789/0 conn(0x7f75e4133ad0 legacy=0x7f75e4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:16.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.761+0000 7f75dbfff700 1 -- 172.21.15.156:0/3358349964 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1595552227 0 0) 0x7f75e406b2d0 con 0x7f75e4133ad0 2023-09-30T22:20:16.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.761+0000 7f75e9c55700 1 -- 172.21.15.156:0/3358349964 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e409a500 con 0x7f75e4139280 2023-09-30T22:20:16.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.761+0000 7f75e9c55700 1 --2- 172.21.15.156:0/3358349964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e4139280 0x7f75e413b660 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f75dc009dc0 tx=0x7f75dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da1ccc77c8ffa46 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:16.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.762+0000 7f75dbfff700 1 -- 172.21.15.156:0/3358349964 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc00e070 con 0x7f75e4139280 2023-09-30T22:20:16.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.762+0000 7f75dbfff700 1 -- 172.21.15.156:0/3358349964 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75dc00bae0 con 0x7f75e4139280 2023-09-30T22:20:16.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.762+0000 7f75dbfff700 1 -- 172.21.15.156:0/3358349964 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc00be90 con 0x7f75e4139280 2023-09-30T22:20:16.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.762+0000 7f75eb6b8700 1 -- 172.21.15.156:0/3358349964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e4139280 msgr2=0x7f75e413b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:16.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.762+0000 7f75eb6b8700 1 --2- 172.21.15.156:0/3358349964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e4139280 0x7f75e413b660 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f75dc009dc0 tx=0x7f75dc00b330 comp rx=0 tx=0).stop 2023-09-30T22:20:16.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.762+0000 7f75eb6b8700 1 -- 172.21.15.156:0/3358349964 shutdown_connections 2023-09-30T22:20:16.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.762+0000 7f75eb6b8700 1 --2- 172.21.15.156:0/3358349964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e4139280 0x7f75e413b660 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:16.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.762+0000 7f75eb6b8700 1 --2- 172.21.15.156:0/3358349964 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75e4136960 0x7f75e4138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:16.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.762+0000 7f75eb6b8700 1 -- 172.21.15.156:0/3358349964 >> 172.21.15.156:0/3358349964 conn(0x7f75e4099c40 msgr2=0x7f75e40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:16.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.763+0000 7f75eb6b8700 1 -- 172.21.15.156:0/3358349964 shutdown_connections 2023-09-30T22:20:16.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.763+0000 7f75eb6b8700 1 -- 172.21.15.156:0/3358349964 wait complete. 2023-09-30T22:20:16.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.763+0000 7f75eb6b8700 1 Processor -- start 2023-09-30T22:20:16.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.764+0000 7f75eb6b8700 1 -- start start 2023-09-30T22:20:16.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.764+0000 7f75eb6b8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e4133ad0 0x7f75e40710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:16.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.764+0000 7f75eb6b8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75e4136960 0x7f75e4071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:16.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.764+0000 7f75eb6b8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75e4139280 0x7f75e4071b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:16.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.764+0000 7f75eb6b8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e406f720 con 0x7f75e4133ad0 2023-09-30T22:20:16.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.764+0000 7f75eb6b8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e4070300 con 0x7f75e4139280 2023-09-30T22:20:16.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.764+0000 7f75eb6b8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75e409f390 con 0x7f75e4136960 2023-09-30T22:20:16.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.764+0000 7f75e9454700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e4133ad0 0x7f75e40710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:16.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.764+0000 7f75e9454700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e4133ad0 0x7f75e40710e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38184/0 (socket says 172.21.15.156:38184) 2023-09-30T22:20:16.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.764+0000 7f75e9454700 1 -- 172.21.15.156:0/1834310301 learned_addr learned my addr 172.21.15.156:0/1834310301 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:16.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.764+0000 7f75e9c55700 1 --2- 172.21.15.156:0/1834310301 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75e4139280 0x7f75e4071b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:16.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.764+0000 7f75e8c53700 1 --2- 172.21.15.156:0/1834310301 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75e4136960 0x7f75e4071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:16.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.765+0000 7f75e8c53700 1 -- 172.21.15.156:0/1834310301 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75e4139280 msgr2=0x7f75e4071b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:16.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.765+0000 7f75e8c53700 1 --2- 172.21.15.156:0/1834310301 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75e4139280 0x7f75e4071b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:16.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.765+0000 7f75e8c53700 1 -- 172.21.15.156:0/1834310301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e4133ad0 msgr2=0x7f75e40710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:16.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.765+0000 7f75e8c53700 1 --2- 172.21.15.156:0/1834310301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e4133ad0 0x7f75e40710e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:16.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.765+0000 7f75e8c53700 1 -- 172.21.15.156:0/1834310301 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75dc009a70 con 0x7f75e4136960 2023-09-30T22:20:16.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.765+0000 7f75e8c53700 1 --2- 172.21.15.156:0/1834310301 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75e4136960 0x7f75e4071620 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f75d400e870 tx=0x7f75d400eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:16.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.765+0000 7f75d9ffb700 1 -- 172.21.15.156:0/1834310301 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d4013680 con 0x7f75e4136960 2023-09-30T22:20:16.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.765+0000 7f75d9ffb700 1 -- 172.21.15.156:0/1834310301 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d40137e0 con 0x7f75e4136960 2023-09-30T22:20:16.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.765+0000 7f75eb6b8700 1 -- 172.21.15.156:0/1834310301 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e4070700 con 0x7f75e4136960 2023-09-30T22:20:16.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.765+0000 7f75d9ffb700 1 -- 172.21.15.156:0/1834310301 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d4013b90 con 0x7f75e4136960 2023-09-30T22:20:16.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.765+0000 7f75eb6b8700 1 -- 172.21.15.156:0/1834310301 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e4070c90 con 0x7f75e4136960 2023-09-30T22:20:16.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.766+0000 7f75d9ffb700 1 -- 172.21.15.156:0/1834310301 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f75d4013cf0 con 0x7f75e4136960 2023-09-30T22:20:16.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.766+0000 7f75eb6b8700 1 -- 172.21.15.156:0/1834310301 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e404f2a0 con 0x7f75e4136960 2023-09-30T22:20:16.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.766+0000 7f75d9ffb700 1 -- 172.21.15.156:0/1834310301 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f75d403f4d0 con 0x7f75e4136960 2023-09-30T22:20:16.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.771+0000 7f75d9ffb700 1 -- 172.21.15.156:0/1834310301 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f75d40128a0 con 0x7f75e4136960 2023-09-30T22:20:16.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.803+0000 7f3ed66f7700 1 Processor -- start 2023-09-30T22:20:16.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.803+0000 7f3ed66f7700 1 -- start start 2023-09-30T22:20:16.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.803+0000 7f3ed66f7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3ed0138040 0x7f3ed0138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:16.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.803+0000 7f3ed66f7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ed00a08e0 0x7f3ed00a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:16.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.803+0000 7f3ed66f7700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed01379e0 con 0x7f3ed00a1230 2023-09-30T22:20:16.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.803+0000 7f3ed66f7700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed00a2100 con 0x7f3ed0138040 2023-09-30T22:20:16.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.803+0000 7f3ed66f7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed0138950 con 0x7f3ed00a08e0 2023-09-30T22:20:16.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.803+0000 7f3ecffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3ed0138040 0x7f3ed0138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:16.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.803+0000 7f3ecf7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ed00a08e0 0x7f3ed00a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:16.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.803+0000 7f3ed4c94700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f3ed00a1230 0x7f3ed013ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:43414/0 (socket says 172.21.15.156:43414) 2023-09-30T22:20:16.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.803+0000 7f3ecf7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ed00a08e0 0x7f3ed00a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44792/0 (socket says 172.21.15.156:44792) 2023-09-30T22:20:16.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.803+0000 7f3ecffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3ed0138040 0x7f3ed0138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38188/0 (socket says 172.21.15.156:38188) 2023-09-30T22:20:16.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.804+0000 7f3ecf7fe700 1 -- 172.21.15.156:0/3823533461 learned_addr learned my addr 172.21.15.156:0/3823533461 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:16.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.804+0000 7f3ecf7fe700 1 -- 172.21.15.156:0/3823533461 >> v2:172.21.15.156:3300/0 conn(0x7f3ed0138040 msgr2=0x7f3ed0138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:16.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.804+0000 7f3ecf7fe700 1 --2- 172.21.15.156:0/3823533461 >> v2:172.21.15.156:3300/0 conn(0x7f3ed0138040 0x7f3ed0138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:16.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.804+0000 7f3ecf7fe700 1 -- 172.21.15.156:0/3823533461 >> v1:172.21.15.156:6789/0 conn(0x7f3ed00a1230 legacy=0x7f3ed013ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:16.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.804+0000 7f3ecf7fe700 1 -- 172.21.15.156:0/3823533461 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed009b9b0 con 0x7f3ed00a08e0 2023-09-30T22:20:16.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.804+0000 7f3ecf7fe700 1 --2- 172.21.15.156:0/3823533461 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ed00a08e0 0x7f3ed00a0cf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4009920 tx=0x7f3ec4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=922a083dc2607d65 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:16.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.804+0000 7f3eceffd700 1 -- 172.21.15.156:0/3823533461 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4011830 con 0x7f3ed00a08e0 2023-09-30T22:20:16.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.804+0000 7f3eceffd700 1 -- 172.21.15.156:0/3823533461 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec4011990 con 0x7f3ed00a08e0 2023-09-30T22:20:16.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.804+0000 7f3eceffd700 1 -- 172.21.15.156:0/3823533461 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4011d20 con 0x7f3ed00a08e0 2023-09-30T22:20:16.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.805+0000 7f3ed66f7700 1 -- 172.21.15.156:0/3823533461 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ed00a08e0 msgr2=0x7f3ed00a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:16.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.805+0000 7f3ed66f7700 1 --2- 172.21.15.156:0/3823533461 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ed00a08e0 0x7f3ed00a0cf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4009920 tx=0x7f3ec4009c30 comp rx=0 tx=0).stop 2023-09-30T22:20:16.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.805+0000 7f3ed66f7700 1 -- 172.21.15.156:0/3823533461 shutdown_connections 2023-09-30T22:20:16.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.805+0000 7f3ed66f7700 1 --2- 172.21.15.156:0/3823533461 >> v2:172.21.15.156:3300/0 conn(0x7f3ed0138040 0x7f3ed0138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:16.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.805+0000 7f3ed66f7700 1 --2- 172.21.15.156:0/3823533461 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ed00a08e0 0x7f3ed00a0cf0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:16.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.805+0000 7f3ed66f7700 1 -- 172.21.15.156:0/3823533461 >> 172.21.15.156:0/3823533461 conn(0x7f3ed00a2980 msgr2=0x7f3ed00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:16.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.805+0000 7f3ed66f7700 1 -- 172.21.15.156:0/3823533461 shutdown_connections 2023-09-30T22:20:16.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.805+0000 7f3ed66f7700 1 -- 172.21.15.156:0/3823533461 wait complete. 2023-09-30T22:20:16.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.806+0000 7f3ed66f7700 1 Processor -- start 2023-09-30T22:20:16.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.806+0000 7f3ed66f7700 1 -- start start 2023-09-30T22:20:16.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.807+0000 7f3ed66f7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ed00a08e0 0x7f3ed01370e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:16.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.807+0000 7f3ed66f7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ed00a1230 0x7f3ed01358e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:16.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.807+0000 7f3ed66f7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ed0138040 0x7f3ed0135e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:16.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.807+0000 7f3ed66f7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed013f080 con 0x7f3ed00a1230 2023-09-30T22:20:16.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.807+0000 7f3ed66f7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed013f950 con 0x7f3ed0138040 2023-09-30T22:20:16.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.807+0000 7f3ed66f7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed0130070 con 0x7f3ed00a08e0 2023-09-30T22:20:16.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.807+0000 7f3ecffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ed00a08e0 0x7f3ed01370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:16.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.807+0000 7f3ecffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ed00a08e0 0x7f3ed01370e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44804/0 (socket says 172.21.15.156:44804) 2023-09-30T22:20:16.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.807+0000 7f3ecffff700 1 -- 172.21.15.156:0/833901586 learned_addr learned my addr 172.21.15.156:0/833901586 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:16.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.807+0000 7f3ecf7fe700 1 --2- 172.21.15.156:0/833901586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ed00a1230 0x7f3ed01358e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:16.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.807+0000 7f3ecf7fe700 1 -- 172.21.15.156:0/833901586 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ed00a08e0 msgr2=0x7f3ed01370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:16.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.807+0000 7f3ecf7fe700 1 --2- 172.21.15.156:0/833901586 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ed00a08e0 0x7f3ed01370e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:16.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.807+0000 7f3ecf7fe700 1 -- 172.21.15.156:0/833901586 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ed0138040 msgr2=0x7f3ed0135e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:16.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.807+0000 7f3ecf7fe700 1 --2- 172.21.15.156:0/833901586 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ed0138040 0x7f3ed0135e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:16.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.807+0000 7f3ecf7fe700 1 -- 172.21.15.156:0/833901586 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec4009550 con 0x7f3ed00a1230 2023-09-30T22:20:16.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.807+0000 7f3ecffff700 1 --2- 172.21.15.156:0/833901586 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ed00a08e0 0x7f3ed01370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:16.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.807+0000 7f3ecf7fe700 1 --2- 172.21.15.156:0/833901586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ed00a1230 0x7f3ed01358e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4009920 tx=0x7f3ec4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:16.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.807+0000 7f3eccff9700 1 -- 172.21.15.156:0/833901586 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4004590 con 0x7f3ed00a1230 2023-09-30T22:20:16.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.808+0000 7f3ed66f7700 1 -- 172.21.15.156:0/833901586 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed009a240 con 0x7f3ed00a1230 2023-09-30T22:20:16.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.808+0000 7f3eccff9700 1 -- 172.21.15.156:0/833901586 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec401e070 con 0x7f3ed00a1230 2023-09-30T22:20:16.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.808+0000 7f3eccff9700 1 -- 172.21.15.156:0/833901586 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec40038c0 con 0x7f3ed00a1230 2023-09-30T22:20:16.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.808+0000 7f3ed66f7700 1 -- 172.21.15.156:0/833901586 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed0119270 con 0x7f3ed00a1230 2023-09-30T22:20:16.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.809+0000 7f3ed66f7700 1 -- 172.21.15.156:0/833901586 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed0140720 con 0x7f3ed00a1230 2023-09-30T22:20:16.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.809+0000 7f3eccff9700 1 -- 172.21.15.156:0/833901586 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ec4003a20 con 0x7f3ed00a1230 2023-09-30T22:20:16.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.810+0000 7f3eccff9700 1 -- 172.21.15.156:0/833901586 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3ec4020070 con 0x7f3ed00a1230 2023-09-30T22:20:16.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.818+0000 7f3eccff9700 1 -- 172.21.15.156:0/833901586 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ec400b3e0 con 0x7f3ed00a1230 2023-09-30T22:20:16.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.852+0000 7fc039cfe700 1 Processor -- start 2023-09-30T22:20:16.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.852+0000 7fc039cfe700 1 -- start start 2023-09-30T22:20:16.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.853+0000 7fc039cfe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc0340a0a70 0x7fc0340a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:16.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.853+0000 7fc039cfe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc0340a1380 0x7fc034133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:16.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.853+0000 7fc039cfe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc034133f50 0x7fc034134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:16.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.853+0000 7fc039cfe700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc03409e9d0 con 0x7fc0340a1380 2023-09-30T22:20:16.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.853+0000 7fc039cfe700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc03409dc00 con 0x7fc0340a0a70 2023-09-30T22:20:16.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.853+0000 7fc039cfe700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc03409dec0 con 0x7fc034133f50 2023-09-30T22:20:16.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.853+0000 7fc0337fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc0340a0a70 0x7fc0340a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:16.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.853+0000 7fc0337fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc0340a0a70 0x7fc0340a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33668/0 (socket says 172.21.15.156:33668) 2023-09-30T22:20:16.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.853+0000 7fc0337fe700 1 -- 172.21.15.156:0/1741317957 learned_addr learned my addr 172.21.15.156:0/1741317957 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:16.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.853+0000 7fc032ffd700 1 --2- 172.21.15.156:0/1741317957 >> v2:172.21.15.156:3300/0 conn(0x7fc0340a1380 0x7fc034133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:16.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.853+0000 7fc033fff700 1 --2- 172.21.15.156:0/1741317957 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc034133f50 0x7fc034134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:16.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.854+0000 7fc032ffd700 1 -- 172.21.15.156:0/1741317957 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc034133f50 msgr2=0x7fc034134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:16.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.854+0000 7fc032ffd700 1 --2- 172.21.15.156:0/1741317957 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc034133f50 0x7fc034134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:16.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.854+0000 7fc032ffd700 1 -- 172.21.15.156:0/1741317957 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc0340a0a70 msgr2=0x7fc0340a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:16.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.854+0000 7fc032ffd700 1 --2- 172.21.15.156:0/1741317957 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc0340a0a70 0x7fc0340a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:16.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.854+0000 7fc032ffd700 1 -- 172.21.15.156:0/1741317957 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03409e6a0 con 0x7fc0340a1380 2023-09-30T22:20:16.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.854+0000 7fc0337fe700 1 --2- 172.21.15.156:0/1741317957 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc0340a0a70 0x7fc0340a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:16.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.854+0000 7fc032ffd700 1 --2- 172.21.15.156:0/1741317957 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0340a1380 0x7fc034133a10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc028009840 tx=0x7fc028009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43604307bc218260 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:16.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.854+0000 7fc0327fc700 1 -- 172.21.15.156:0/1741317957 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc028011830 con 0x7fc0340a1380 2023-09-30T22:20:16.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.854+0000 7fc0327fc700 1 -- 172.21.15.156:0/1741317957 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc028011990 con 0x7fc0340a1380 2023-09-30T22:20:16.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.854+0000 7fc0327fc700 1 -- 172.21.15.156:0/1741317957 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc028011d20 con 0x7fc0340a1380 2023-09-30T22:20:16.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.855+0000 7fc039cfe700 1 -- 172.21.15.156:0/1741317957 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0340a1380 msgr2=0x7fc034133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:16.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.855+0000 7fc039cfe700 1 --2- 172.21.15.156:0/1741317957 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0340a1380 0x7fc034133a10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc028009840 tx=0x7fc028009b50 comp rx=0 tx=0).stop 2023-09-30T22:20:16.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.855+0000 7fc039cfe700 1 -- 172.21.15.156:0/1741317957 shutdown_connections 2023-09-30T22:20:16.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.855+0000 7fc039cfe700 1 --2- 172.21.15.156:0/1741317957 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc034133f50 0x7fc034134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:16.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.855+0000 7fc039cfe700 1 --2- 172.21.15.156:0/1741317957 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc0340a0a70 0x7fc0340a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:16.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.855+0000 7fc039cfe700 1 --2- 172.21.15.156:0/1741317957 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0340a1380 0x7fc034133a10 secure :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc028009840 tx=0x7fc028009b50 comp rx=0 tx=0).stop 2023-09-30T22:20:16.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.855+0000 7fc039cfe700 1 -- 172.21.15.156:0/1741317957 >> 172.21.15.156:0/1741317957 conn(0x7fc0340a6610 msgr2=0x7fc0340a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:16.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.855+0000 7fc039cfe700 1 -- 172.21.15.156:0/1741317957 shutdown_connections 2023-09-30T22:20:16.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.855+0000 7fc039cfe700 1 -- 172.21.15.156:0/1741317957 wait complete. 2023-09-30T22:20:16.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.857+0000 7fc039cfe700 1 Processor -- start 2023-09-30T22:20:16.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.857+0000 7fc039cfe700 1 -- start start 2023-09-30T22:20:16.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.858+0000 7fc039cfe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc0340a0a70 0x7fc034122540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:16.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.858+0000 7fc039cfe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc034133f50 0x7fc034122a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:16.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.858+0000 7fc039cfe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc034122fc0 0x7fc0341ce850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:16.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.858+0000 7fc039cfe700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0340a03e0 con 0x7fc034133f50 2023-09-30T22:20:16.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.858+0000 7fc039cfe700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0340a51f0 con 0x7fc034122fc0 2023-09-30T22:20:16.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.858+0000 7fc039cfe700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc034124f70 con 0x7fc0340a0a70 2023-09-30T22:20:16.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.858+0000 7fc032ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc034133f50 0x7fc034122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:16.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.858+0000 7fc032ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc034133f50 0x7fc034122a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38210/0 (socket says 172.21.15.156:38210) 2023-09-30T22:20:16.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.858+0000 7fc032ffd700 1 -- 172.21.15.156:0/1307607489 learned_addr learned my addr 172.21.15.156:0/1307607489 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:16.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.858+0000 7fc0337fe700 1 --2- 172.21.15.156:0/1307607489 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc0340a0a70 0x7fc034122540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:16.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.858+0000 7fc033fff700 1 --2- 172.21.15.156:0/1307607489 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc034122fc0 0x7fc0341ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:16.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.858+0000 7fc0337fe700 1 -- 172.21.15.156:0/1307607489 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc034122fc0 msgr2=0x7fc0341ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:16.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.858+0000 7fc0337fe700 1 --2- 172.21.15.156:0/1307607489 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc034122fc0 0x7fc0341ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:16.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.858+0000 7fc0337fe700 1 -- 172.21.15.156:0/1307607489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc034133f50 msgr2=0x7fc034122a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:16.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.858+0000 7fc0337fe700 1 --2- 172.21.15.156:0/1307607489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc034133f50 0x7fc034122a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:16.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.858+0000 7fc0337fe700 1 -- 172.21.15.156:0/1307607489 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc024009550 con 0x7fc0340a0a70 2023-09-30T22:20:16.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.859+0000 7fc0337fe700 1 --2- 172.21.15.156:0/1307607489 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc0340a0a70 0x7fc034122540 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc02400e9b0 tx=0x7fc02400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:16.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.859+0000 7fc01bfff700 1 -- 172.21.15.156:0/1307607489 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02400eea0 con 0x7fc0340a0a70 2023-09-30T22:20:16.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.859+0000 7fc039cfe700 1 -- 172.21.15.156:0/1307607489 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0280094a0 con 0x7fc0340a0a70 2023-09-30T22:20:16.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.859+0000 7fc01bfff700 1 -- 172.21.15.156:0/1307607489 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02400c850 con 0x7fc0340a0a70 2023-09-30T22:20:16.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.859+0000 7fc01bfff700 1 -- 172.21.15.156:0/1307607489 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02400cbe0 con 0x7fc0340a0a70 2023-09-30T22:20:16.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.859+0000 7fc039cfe700 1 -- 172.21.15.156:0/1307607489 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc034125d80 con 0x7fc0340a0a70 2023-09-30T22:20:16.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.860+0000 7fc01bfff700 1 -- 172.21.15.156:0/1307607489 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc02400cd40 con 0x7fc0340a0a70 2023-09-30T22:20:16.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.860+0000 7fc01bfff700 1 -- 172.21.15.156:0/1307607489 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc02403fc10 con 0x7fc0340a0a70 2023-09-30T22:20:16.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.860+0000 7fc039cfe700 1 -- 172.21.15.156:0/1307607489 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc03411f050 con 0x7fc0340a0a70 2023-09-30T22:20:16.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.869+0000 7fc01bfff700 1 -- 172.21.15.156:0/1307607489 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc024017080 con 0x7fc0340a0a70 2023-09-30T22:20:16.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.903+0000 7f7e6fdba700 1 Processor -- start 2023-09-30T22:20:16.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.903+0000 7f7e6fdba700 1 -- start start 2023-09-30T22:20:16.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.904+0000 7f7e6fdba700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e680a0a70 0x7f7e680a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:16.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.904+0000 7f7e6fdba700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e680a1380 0x7f7e68133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:16.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.904+0000 7f7e6fdba700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7e68133f50 0x7f7e681343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:16.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.904+0000 7f7e6fdba700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e6809e9d0 con 0x7f7e68133f50 2023-09-30T22:20:16.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.904+0000 7f7e6fdba700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6809dc00 con 0x7f7e680a0a70 2023-09-30T22:20:16.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.904+0000 7f7e6fdba700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6809dec0 con 0x7f7e680a1380 2023-09-30T22:20:16.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.904+0000 7f7e6db56700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e680a0a70 0x7f7e680a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:16.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.904+0000 7f7e6db56700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e680a0a70 0x7f7e680a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33696/0 (socket says 172.21.15.156:33696) 2023-09-30T22:20:16.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.904+0000 7f7e6db56700 1 -- 172.21.15.156:0/2544059705 learned_addr learned my addr 172.21.15.156:0/2544059705 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:16.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.904+0000 7f7e6e357700 1 --2- 172.21.15.156:0/2544059705 >> v2:172.21.15.156:3300/0 conn(0x7f7e68133f50 0x7f7e681343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:16.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.904+0000 7f7e6d355700 1 --2- 172.21.15.156:0/2544059705 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e680a1380 0x7f7e68133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:16.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.905+0000 7f7e6db56700 1 -- 172.21.15.156:0/2544059705 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e680a1380 msgr2=0x7f7e68133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:16.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.905+0000 7f7e6db56700 1 --2- 172.21.15.156:0/2544059705 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e680a1380 0x7f7e68133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:16.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.905+0000 7f7e6db56700 1 -- 172.21.15.156:0/2544059705 >> v2:172.21.15.156:3300/0 conn(0x7f7e68133f50 msgr2=0x7f7e681343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:16.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.905+0000 7f7e6db56700 1 --2- 172.21.15.156:0/2544059705 >> v2:172.21.15.156:3300/0 conn(0x7f7e68133f50 0x7f7e681343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:16.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.905+0000 7f7e6db56700 1 -- 172.21.15.156:0/2544059705 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6809e6a0 con 0x7f7e680a0a70 2023-09-30T22:20:16.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.905+0000 7f7e6d355700 1 --2- 172.21.15.156:0/2544059705 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e680a1380 0x7f7e68133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:20:16.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.905+0000 7f7e6e357700 1 --2- 172.21.15.156:0/2544059705 >> v2:172.21.15.156:3300/0 conn(0x7f7e68133f50 0x7f7e681343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:16.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.905+0000 7f7e6db56700 1 --2- 172.21.15.156:0/2544059705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e680a0a70 0x7f7e680a0e40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7e640098f0 tx=0x7f7e64009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b5d685af5688217 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:16.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.905+0000 7f7e6cb54700 1 -- 172.21.15.156:0/2544059705 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e64011830 con 0x7f7e680a0a70 2023-09-30T22:20:16.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.905+0000 7f7e6cb54700 1 -- 172.21.15.156:0/2544059705 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e64011990 con 0x7f7e680a0a70 2023-09-30T22:20:16.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.905+0000 7f7e6cb54700 1 -- 172.21.15.156:0/2544059705 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e64011d20 con 0x7f7e680a0a70 2023-09-30T22:20:16.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.906+0000 7f7e6fdba700 1 -- 172.21.15.156:0/2544059705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e680a0a70 msgr2=0x7f7e680a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:16.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.906+0000 7f7e6fdba700 1 --2- 172.21.15.156:0/2544059705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e680a0a70 0x7f7e680a0e40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7e640098f0 tx=0x7f7e64009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:16.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.906+0000 7f7e6fdba700 1 -- 172.21.15.156:0/2544059705 shutdown_connections 2023-09-30T22:20:16.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.906+0000 7f7e6fdba700 1 --2- 172.21.15.156:0/2544059705 >> v2:172.21.15.156:3300/0 conn(0x7f7e68133f50 0x7f7e681343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:16.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.906+0000 7f7e6fdba700 1 --2- 172.21.15.156:0/2544059705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e680a0a70 0x7f7e680a0e40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:16.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.906+0000 7f7e6fdba700 1 --2- 172.21.15.156:0/2544059705 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e680a1380 0x7f7e68133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:16.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.906+0000 7f7e6fdba700 1 -- 172.21.15.156:0/2544059705 >> 172.21.15.156:0/2544059705 conn(0x7f7e680a6610 msgr2=0x7f7e680a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:16.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.906+0000 7f7e6fdba700 1 -- 172.21.15.156:0/2544059705 shutdown_connections 2023-09-30T22:20:16.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.906+0000 7f7e6fdba700 1 -- 172.21.15.156:0/2544059705 wait complete. 2023-09-30T22:20:16.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.907+0000 7f7e6fdba700 1 Processor -- start 2023-09-30T22:20:16.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.907+0000 7f7e6fdba700 1 -- start start 2023-09-30T22:20:16.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.908+0000 7f7e6fdba700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e680a0a70 0x7f7e681223d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:16.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.908+0000 7f7e6fdba700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e680a1380 0x7f7e68122910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:16.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.908+0000 7f7e6fdba700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e68133f50 0x7f7e68122e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:16.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.908+0000 7f7e6fdba700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e68125c00 con 0x7f7e680a0a70 2023-09-30T22:20:16.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.908+0000 7f7e6fdba700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e68126350 con 0x7f7e68133f50 2023-09-30T22:20:16.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.908+0000 7f7e6fdba700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e68125e50 con 0x7f7e680a1380 2023-09-30T22:20:16.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.908+0000 7f7e6db56700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e680a0a70 0x7f7e681223d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:16.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.908+0000 7f7e6db56700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e680a0a70 0x7f7e681223d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38238/0 (socket says 172.21.15.156:38238) 2023-09-30T22:20:16.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.908+0000 7f7e6db56700 1 -- 172.21.15.156:0/3893624558 learned_addr learned my addr 172.21.15.156:0/3893624558 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:16.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.908+0000 7f7e6e357700 1 --2- 172.21.15.156:0/3893624558 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e68133f50 0x7f7e68122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:16.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.908+0000 7f7e6d355700 1 --2- 172.21.15.156:0/3893624558 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e680a1380 0x7f7e68122910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:16.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.908+0000 7f7e6db56700 1 -- 172.21.15.156:0/3893624558 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e680a1380 msgr2=0x7f7e68122910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:16.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.908+0000 7f7e6db56700 1 --2- 172.21.15.156:0/3893624558 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e680a1380 0x7f7e68122910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:16.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.908+0000 7f7e6db56700 1 -- 172.21.15.156:0/3893624558 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e68133f50 msgr2=0x7f7e68122e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:16.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.908+0000 7f7e6db56700 1 --2- 172.21.15.156:0/3893624558 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e68133f50 0x7f7e68122e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:16.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.908+0000 7f7e6db56700 1 -- 172.21.15.156:0/3893624558 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e60009a70 con 0x7f7e680a0a70 2023-09-30T22:20:16.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.909+0000 7f7e6db56700 1 --2- 172.21.15.156:0/3893624558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e680a0a70 0x7f7e681223d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7e6809dd40 tx=0x7f7e64004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:16.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.909+0000 7f7e5e7fc700 1 -- 172.21.15.156:0/3893624558 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e64004450 con 0x7f7e680a0a70 2023-09-30T22:20:16.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.909+0000 7f7e6fdba700 1 -- 172.21.15.156:0/3893624558 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e64009550 con 0x7f7e680a0a70 2023-09-30T22:20:16.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.909+0000 7f7e5e7fc700 1 -- 172.21.15.156:0/3893624558 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e640045d0 con 0x7f7e680a0a70 2023-09-30T22:20:16.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.909+0000 7f7e5e7fc700 1 -- 172.21.15.156:0/3893624558 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e640038e0 con 0x7f7e680a0a70 2023-09-30T22:20:16.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.909+0000 7f7e6fdba700 1 -- 172.21.15.156:0/3893624558 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e680a03e0 con 0x7f7e680a0a70 2023-09-30T22:20:16.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.910+0000 7f7e5e7fc700 1 -- 172.21.15.156:0/3893624558 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e64003a40 con 0x7f7e680a0a70 2023-09-30T22:20:16.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.910+0000 7f7e5e7fc700 1 -- 172.21.15.156:0/3893624558 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7e64040ab0 con 0x7f7e680a0a70 2023-09-30T22:20:16.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.910+0000 7f7e6fdba700 1 -- 172.21.15.156:0/3893624558 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e6804f2a0 con 0x7f7e680a0a70 2023-09-30T22:20:16.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.919+0000 7f7e5e7fc700 1 -- 172.21.15.156:0/3893624558 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e6401a420 con 0x7f7e680a0a70 2023-09-30T22:20:16.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.983+0000 7f75eb6b8700 1 -- 172.21.15.156:0/1834310301 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f75e40700f0 con 0x7f75e4136960 2023-09-30T22:20:16.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.984+0000 7f75d9ffb700 1 -- 172.21.15.156:0/1834310301 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f75d4021020 con 0x7f75e4136960 2023-09-30T22:20:16.985 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:16.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.986+0000 7f75eb6b8700 1 -- 172.21.15.156:0/1834310301 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75e4136960 msgr2=0x7f75e4071620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:16.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.986+0000 7f75eb6b8700 1 --2- 172.21.15.156:0/1834310301 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75e4136960 0x7f75e4071620 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f75d400e870 tx=0x7f75d400eb80 comp rx=0 tx=0).stop 2023-09-30T22:20:16.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.986+0000 7f75eb6b8700 1 -- 172.21.15.156:0/1834310301 shutdown_connections 2023-09-30T22:20:16.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.986+0000 7f75eb6b8700 1 --2- 172.21.15.156:0/1834310301 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75e4139280 0x7f75e4071b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:16.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.986+0000 7f75eb6b8700 1 --2- 172.21.15.156:0/1834310301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e4133ad0 0x7f75e40710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:16.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.986+0000 7f75eb6b8700 1 --2- 172.21.15.156:0/1834310301 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75e4136960 0x7f75e4071620 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:16.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.986+0000 7f75eb6b8700 1 -- 172.21.15.156:0/1834310301 >> 172.21.15.156:0/1834310301 conn(0x7f75e4099c40 msgr2=0x7f75e4134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:16.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.986+0000 7f75eb6b8700 1 -- 172.21.15.156:0/1834310301 shutdown_connections 2023-09-30T22:20:16.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:16.986+0000 7f75eb6b8700 1 -- 172.21.15.156:0/1834310301 wait complete. 2023-09-30T22:20:16.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:17.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.027+0000 7f3ed66f7700 1 -- 172.21.15.156:0/833901586 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3ed004f2a0 con 0x7f3ed00a1230 2023-09-30T22:20:17.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.027+0000 7f3eccff9700 1 -- 172.21.15.156:0/833901586 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ec4015020 con 0x7f3ed00a1230 2023-09-30T22:20:17.028 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:17.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.030+0000 7f3ed66f7700 1 -- 172.21.15.156:0/833901586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ed00a1230 msgr2=0x7f3ed01358e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:17.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.030+0000 7f3ed66f7700 1 --2- 172.21.15.156:0/833901586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ed00a1230 0x7f3ed01358e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4009920 tx=0x7f3ec4004750 comp rx=0 tx=0).stop 2023-09-30T22:20:17.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.030+0000 7f3ed66f7700 1 -- 172.21.15.156:0/833901586 shutdown_connections 2023-09-30T22:20:17.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.030+0000 7f3ed66f7700 1 --2- 172.21.15.156:0/833901586 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ed0138040 0x7f3ed0135e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:17.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.030+0000 7f3ed66f7700 1 --2- 172.21.15.156:0/833901586 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ed00a08e0 0x7f3ed01370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:17.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.030+0000 7f3ed66f7700 1 --2- 172.21.15.156:0/833901586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ed00a1230 0x7f3ed01358e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:17.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.030+0000 7f3ed66f7700 1 -- 172.21.15.156:0/833901586 >> 172.21.15.156:0/833901586 conn(0x7f3ed00a2980 msgr2=0x7f3ed0070350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:17.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.030+0000 7f3ed66f7700 1 -- 172.21.15.156:0/833901586 shutdown_connections 2023-09-30T22:20:17.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.030+0000 7f3ed66f7700 1 -- 172.21.15.156:0/833901586 wait complete. 2023-09-30T22:20:17.049 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:17.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.078+0000 7fc039cfe700 1 -- 172.21.15.156:0/1307607489 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc03404f2a0 con 0x7fc0340a0a70 2023-09-30T22:20:17.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.078+0000 7fc01bfff700 1 -- 172.21.15.156:0/1307607489 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc024011d90 con 0x7fc0340a0a70 2023-09-30T22:20:17.079 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:17.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.080+0000 7fc039cfe700 1 -- 172.21.15.156:0/1307607489 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc0340a0a70 msgr2=0x7fc034122540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:17.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.080+0000 7fc039cfe700 1 --2- 172.21.15.156:0/1307607489 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc0340a0a70 0x7fc034122540 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc02400e9b0 tx=0x7fc02400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:20:17.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.080+0000 7fc039cfe700 1 -- 172.21.15.156:0/1307607489 shutdown_connections 2023-09-30T22:20:17.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.080+0000 7fc039cfe700 1 --2- 172.21.15.156:0/1307607489 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc034122fc0 0x7fc0341ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:17.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.080+0000 7fc039cfe700 1 --2- 172.21.15.156:0/1307607489 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc0340a0a70 0x7fc034122540 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:17.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.080+0000 7fc039cfe700 1 --2- 172.21.15.156:0/1307607489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc034133f50 0x7fc034122a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:17.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.080+0000 7fc039cfe700 1 -- 172.21.15.156:0/1307607489 >> 172.21.15.156:0/1307607489 conn(0x7fc0340a6610 msgr2=0x7fc03409f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:17.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.080+0000 7fc039cfe700 1 -- 172.21.15.156:0/1307607489 shutdown_connections 2023-09-30T22:20:17.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.080+0000 7fc039cfe700 1 -- 172.21.15.156:0/1307607489 wait complete. 2023-09-30T22:20:17.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:17.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.120+0000 7f7e6fdba700 1 -- 172.21.15.156:0/3893624558 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7e68072980 con 0x7f7e680a0a70 2023-09-30T22:20:17.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.121+0000 7f7e5e7fc700 1 -- 172.21.15.156:0/3893624558 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e64034020 con 0x7f7e680a0a70 2023-09-30T22:20:17.121 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:17.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.123+0000 7f7e6fdba700 1 -- 172.21.15.156:0/3893624558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e680a0a70 msgr2=0x7f7e681223d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:17.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.123+0000 7f7e6fdba700 1 --2- 172.21.15.156:0/3893624558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e680a0a70 0x7f7e681223d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7e6809dd40 tx=0x7f7e64004750 comp rx=0 tx=0).stop 2023-09-30T22:20:17.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.123+0000 7f7e6fdba700 1 -- 172.21.15.156:0/3893624558 shutdown_connections 2023-09-30T22:20:17.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.123+0000 7f7e6fdba700 1 --2- 172.21.15.156:0/3893624558 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e68133f50 0x7f7e68122e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:17.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.123+0000 7f7e6fdba700 1 --2- 172.21.15.156:0/3893624558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e680a0a70 0x7f7e681223d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:17.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.123+0000 7f7e6fdba700 1 --2- 172.21.15.156:0/3893624558 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e680a1380 0x7f7e68122910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:17.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.123+0000 7f7e6fdba700 1 -- 172.21.15.156:0/3893624558 >> 172.21.15.156:0/3893624558 conn(0x7f7e680a6610 msgr2=0x7f7e6809b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:17.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.123+0000 7f7e6fdba700 1 -- 172.21.15.156:0/3893624558 shutdown_connections 2023-09-30T22:20:17.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:17.123+0000 7f7e6fdba700 1 -- 172.21.15.156:0/3893624558 wait complete. 2023-09-30T22:20:17.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:18.001 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:18.051 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:18.093 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:18.136 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:18.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.156+0000 7fba3e044700 1 Processor -- start 2023-09-30T22:20:18.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.156+0000 7fba3e044700 1 -- start start 2023-09-30T22:20:18.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.156+0000 7fba3e044700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba38131980 0x7fba38131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:18.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.156+0000 7fba3e044700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fba3809c790 0x7fba38139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:18.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.156+0000 7fba3e044700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba380a1640 con 0x7fba3809bc70 2023-09-30T22:20:18.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.156+0000 7fba3e044700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba3806eb30 con 0x7fba3809c790 2023-09-30T22:20:18.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.156+0000 7fba3e044700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba380a22d0 con 0x7fba38131980 2023-09-30T22:20:18.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.157+0000 7fba37fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fba3809c790 0x7fba38139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:18.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.157+0000 7fba36ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fba3809bc70 0x7fba3809c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:43428/0 (socket says 172.21.15.156:43428) 2023-09-30T22:20:18.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.157+0000 7fba36ffd700 1 -- 172.21.15.156:0/83104734 learned_addr learned my addr 172.21.15.156:0/83104734 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:18.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.157+0000 7fba367fc700 1 -- 172.21.15.156:0/83104734 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3672371088 0 0) 0x7fba380a1640 con 0x7fba3809bc70 2023-09-30T22:20:18.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.157+0000 7fba367fc700 1 -- 172.21.15.156:0/83104734 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba200035b0 con 0x7fba3809bc70 2023-09-30T22:20:18.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.157+0000 7fba37fff700 1 -- 172.21.15.156:0/83104734 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba38131980 msgr2=0x7fba38131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:18.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.157+0000 7fba37fff700 1 --2- 172.21.15.156:0/83104734 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba38131980 0x7fba38131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.157+0000 7fba37fff700 1 -- 172.21.15.156:0/83104734 >> v1:172.21.15.156:6789/0 conn(0x7fba3809bc70 legacy=0x7fba3809c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:18.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.157+0000 7fba37fff700 1 -- 172.21.15.156:0/83104734 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba38131550 con 0x7fba3809c790 2023-09-30T22:20:18.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.157+0000 7fba37fff700 1 --2- 172.21.15.156:0/83104734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba3809c790 0x7fba38139710 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fba30009d90 tx=0x7fba3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1ac3a08fd905a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:18.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.157+0000 7fba367fc700 1 -- 172.21.15.156:0/83104734 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3000bd20 con 0x7fba3809c790 2023-09-30T22:20:18.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.158+0000 7fba367fc700 1 -- 172.21.15.156:0/83104734 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3000be80 con 0x7fba3809c790 2023-09-30T22:20:18.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.158+0000 7fba367fc700 1 -- 172.21.15.156:0/83104734 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba300106d0 con 0x7fba3809c790 2023-09-30T22:20:18.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.159+0000 7fba3e044700 1 -- 172.21.15.156:0/83104734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba3809c790 msgr2=0x7fba38139710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:18.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.159+0000 7fba3e044700 1 --2- 172.21.15.156:0/83104734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba3809c790 0x7fba38139710 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fba30009d90 tx=0x7fba3000b330 comp rx=0 tx=0).stop 2023-09-30T22:20:18.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.159+0000 7fba3e044700 1 -- 172.21.15.156:0/83104734 shutdown_connections 2023-09-30T22:20:18.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.159+0000 7fba3e044700 1 --2- 172.21.15.156:0/83104734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba3809c790 0x7fba38139710 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.159+0000 7fba3e044700 1 --2- 172.21.15.156:0/83104734 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba38131980 0x7fba38131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.159+0000 7fba3e044700 1 -- 172.21.15.156:0/83104734 >> 172.21.15.156:0/83104734 conn(0x7fba380a2980 msgr2=0x7fba380a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:18.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.159+0000 7fba3e044700 1 -- 172.21.15.156:0/83104734 shutdown_connections 2023-09-30T22:20:18.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.159+0000 7fba3e044700 1 -- 172.21.15.156:0/83104734 wait complete. 2023-09-30T22:20:18.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.160+0000 7fba3e044700 1 Processor -- start 2023-09-30T22:20:18.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.160+0000 7fba3e044700 1 -- start start 2023-09-30T22:20:18.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.161+0000 7fba3e044700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba3809bc70 0x7fba381195d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:18.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.161+0000 7fba3e044700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fba3809c790 0x7fba38119b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:18.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.161+0000 7fba3e044700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba38131980 0x7fba3811a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:18.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.161+0000 7fba3e044700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3811da90 con 0x7fba38131980 2023-09-30T22:20:18.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.161+0000 7fba3e044700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba380a1c40 con 0x7fba3809bc70 2023-09-30T22:20:18.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.161+0000 7fba3e044700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba3811b280 con 0x7fba3809c790 2023-09-30T22:20:18.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.161+0000 7fba377fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba3809bc70 0x7fba381195d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:18.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.161+0000 7fba37fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba38131980 0x7fba3811a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:18.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.161+0000 7fba37fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba38131980 0x7fba3811a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38260/0 (socket says 172.21.15.156:38260) 2023-09-30T22:20:18.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.161+0000 7fba377fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba3809bc70 0x7fba381195d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33712/0 (socket says 172.21.15.156:33712) 2023-09-30T22:20:18.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.161+0000 7fba37fff700 1 -- 172.21.15.156:0/3814726828 learned_addr learned my addr 172.21.15.156:0/3814726828 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:18.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.162+0000 7fba37fff700 1 -- 172.21.15.156:0/3814726828 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fba3809c790 msgr2=0x7fba38119b10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:20:18.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.162+0000 7fba37fff700 1 --2- 172.21.15.156:0/3814726828 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fba3809c790 0x7fba38119b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.162+0000 7fba37fff700 1 -- 172.21.15.156:0/3814726828 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba3809bc70 msgr2=0x7fba381195d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:18.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.162+0000 7fba37fff700 1 --2- 172.21.15.156:0/3814726828 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba3809bc70 0x7fba381195d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.162+0000 7fba37fff700 1 -- 172.21.15.156:0/3814726828 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba30009a70 con 0x7fba38131980 2023-09-30T22:20:18.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.162+0000 7fba37fff700 1 --2- 172.21.15.156:0/3814726828 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba38131980 0x7fba3811a050 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fba3809cc30 tx=0x7fba30004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:18.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.162+0000 7fba1ffff700 1 -- 172.21.15.156:0/3814726828 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba30010d30 con 0x7fba38131980 2023-09-30T22:20:18.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.162+0000 7fba1ffff700 1 -- 172.21.15.156:0/3814726828 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba30010e90 con 0x7fba38131980 2023-09-30T22:20:18.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.162+0000 7fba3e044700 1 -- 172.21.15.156:0/3814726828 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba3811ce10 con 0x7fba38131980 2023-09-30T22:20:18.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.162+0000 7fba1ffff700 1 -- 172.21.15.156:0/3814726828 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba30004260 con 0x7fba38131980 2023-09-30T22:20:18.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.162+0000 7fba3e044700 1 -- 172.21.15.156:0/3814726828 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba38130900 con 0x7fba38131980 2023-09-30T22:20:18.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.163+0000 7fba1ffff700 1 -- 172.21.15.156:0/3814726828 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fba300043c0 con 0x7fba38131980 2023-09-30T22:20:18.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.164+0000 7fba1ffff700 1 -- 172.21.15.156:0/3814726828 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fba30045660 con 0x7fba38131980 2023-09-30T22:20:18.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.164+0000 7fba3e044700 1 -- 172.21.15.156:0/3814726828 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba3804f2a0 con 0x7fba38131980 2023-09-30T22:20:18.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.169+0000 7fba1ffff700 1 -- 172.21.15.156:0/3814726828 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fba30030080 con 0x7fba38131980 2023-09-30T22:20:18.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.208+0000 7faeee6c9700 1 Processor -- start 2023-09-30T22:20:18.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.208+0000 7faeee6c9700 1 -- start start 2023-09-30T22:20:18.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.208+0000 7faeee6c9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7faee806a770 0x7faee81349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:18.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.208+0000 7faeee6c9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faee8134f00 0x7faee809d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:18.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.208+0000 7faeee6c9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faee809dea0 0x7faee809e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:18.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.208+0000 7faeee6c9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee806b2e0 con 0x7faee806a770 2023-09-30T22:20:18.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.208+0000 7faeee6c9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee809eca0 con 0x7faee8134f00 2023-09-30T22:20:18.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.208+0000 7faeee6c9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faee809f720 con 0x7faee809dea0 2023-09-30T22:20:18.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.208+0000 7faeecc66700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faee809dea0 0x7faee809e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:18.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.208+0000 7faeecc66700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faee809dea0 0x7faee809e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44842/0 (socket says 172.21.15.156:44842) 2023-09-30T22:20:18.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.208+0000 7faeecc66700 1 -- 172.21.15.156:0/1509273986 learned_addr learned my addr 172.21.15.156:0/1509273986 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:18.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.208+0000 7faee77fe700 1 --2- 172.21.15.156:0/1509273986 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faee8134f00 0x7faee809d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:18.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.208+0000 7faee7fff700 1 --2- 172.21.15.156:0/1509273986 >> v2:172.21.15.156:3300/0 conn(0x7faee806a770 0x7faee81349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:18.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.209+0000 7faeecc66700 1 -- 172.21.15.156:0/1509273986 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faee8134f00 msgr2=0x7faee809d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:18.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.209+0000 7faeecc66700 1 --2- 172.21.15.156:0/1509273986 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faee8134f00 0x7faee809d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.209+0000 7faeecc66700 1 -- 172.21.15.156:0/1509273986 >> v2:172.21.15.156:3300/0 conn(0x7faee806a770 msgr2=0x7faee81349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:18.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.209+0000 7faeecc66700 1 --2- 172.21.15.156:0/1509273986 >> v2:172.21.15.156:3300/0 conn(0x7faee806a770 0x7faee81349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.209+0000 7faeecc66700 1 -- 172.21.15.156:0/1509273986 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee806b480 con 0x7faee809dea0 2023-09-30T22:20:18.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.209+0000 7faeecc66700 1 --2- 172.21.15.156:0/1509273986 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faee809dea0 0x7faee809e320 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7faee0009e50 tx=0x7faee000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab9ec2a35980aafe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:18.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.209+0000 7faee6ffd700 1 -- 172.21.15.156:0/1509273986 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee000e070 con 0x7faee809dea0 2023-09-30T22:20:18.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.209+0000 7faee6ffd700 1 -- 172.21.15.156:0/1509273986 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee000b910 con 0x7faee809dea0 2023-09-30T22:20:18.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.209+0000 7faee6ffd700 1 -- 172.21.15.156:0/1509273986 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee000bcc0 con 0x7faee809dea0 2023-09-30T22:20:18.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.210+0000 7faeee6c9700 1 -- 172.21.15.156:0/1509273986 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faee809dea0 msgr2=0x7faee809e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:18.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.210+0000 7faeee6c9700 1 --2- 172.21.15.156:0/1509273986 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faee809dea0 0x7faee809e320 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7faee0009e50 tx=0x7faee000b330 comp rx=0 tx=0).stop 2023-09-30T22:20:18.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.210+0000 7faeee6c9700 1 -- 172.21.15.156:0/1509273986 shutdown_connections 2023-09-30T22:20:18.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.210+0000 7faeee6c9700 1 --2- 172.21.15.156:0/1509273986 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faee809dea0 0x7faee809e320 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.210+0000 7faeee6c9700 1 --2- 172.21.15.156:0/1509273986 >> v2:172.21.15.156:3300/0 conn(0x7faee806a770 0x7faee81349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.210+0000 7faeee6c9700 1 --2- 172.21.15.156:0/1509273986 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faee8134f00 0x7faee809d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.210+0000 7faeee6c9700 1 -- 172.21.15.156:0/1509273986 >> 172.21.15.156:0/1509273986 conn(0x7faee8099c40 msgr2=0x7faee80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:18.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.210+0000 7faeee6c9700 1 -- 172.21.15.156:0/1509273986 shutdown_connections 2023-09-30T22:20:18.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.211+0000 7faeee6c9700 1 -- 172.21.15.156:0/1509273986 wait complete. 2023-09-30T22:20:18.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.212+0000 7faeee6c9700 1 Processor -- start 2023-09-30T22:20:18.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.212+0000 7faeee6c9700 1 -- start start 2023-09-30T22:20:18.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.213+0000 7faeee6c9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faee806a770 0x7faee811a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:18.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.213+0000 7faeee6c9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faee809dea0 0x7faee811abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:18.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.213+0000 7faeee6c9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faee8134f00 0x7faee811b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:18.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.213+0000 7faeee6c9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee8139670 con 0x7faee806a770 2023-09-30T22:20:18.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.213+0000 7faeee6c9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee811bae0 con 0x7faee809dea0 2023-09-30T22:20:18.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.213+0000 7faeee6c9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faee8138c50 con 0x7faee8134f00 2023-09-30T22:20:18.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.213+0000 7faee77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faee809dea0 0x7faee811abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:18.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.213+0000 7faee77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faee809dea0 0x7faee811abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33720/0 (socket says 172.21.15.156:33720) 2023-09-30T22:20:18.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.213+0000 7faee77fe700 1 -- 172.21.15.156:0/1919072043 learned_addr learned my addr 172.21.15.156:0/1919072043 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:18.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.213+0000 7faeecc66700 1 --2- 172.21.15.156:0/1919072043 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faee8134f00 0x7faee811b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:18.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.213+0000 7faee77fe700 1 -- 172.21.15.156:0/1919072043 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faee8134f00 msgr2=0x7faee811b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:18.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.213+0000 7faee77fe700 1 --2- 172.21.15.156:0/1919072043 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faee8134f00 0x7faee811b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.213+0000 7faee77fe700 1 -- 172.21.15.156:0/1919072043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faee806a770 msgr2=0x7faee811a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:18.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.213+0000 7faee77fe700 1 --2- 172.21.15.156:0/1919072043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faee806a770 0x7faee811a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.213+0000 7faee77fe700 1 -- 172.21.15.156:0/1919072043 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee0009b30 con 0x7faee809dea0 2023-09-30T22:20:18.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.213+0000 7faeecc66700 1 --2- 172.21.15.156:0/1919072043 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faee8134f00 0x7faee811b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:18.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.213+0000 7faee77fe700 1 --2- 172.21.15.156:0/1919072043 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faee809dea0 0x7faee811abc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faedc00e9b0 tx=0x7faedc00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:18.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.214+0000 7faee4ff9700 1 -- 172.21.15.156:0/1919072043 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc009710 con 0x7faee809dea0 2023-09-30T22:20:18.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.214+0000 7faee4ff9700 1 -- 172.21.15.156:0/1919072043 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faedc00c850 con 0x7faee809dea0 2023-09-30T22:20:18.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.214+0000 7faeee6c9700 1 -- 172.21.15.156:0/1919072043 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee813e930 con 0x7faee809dea0 2023-09-30T22:20:18.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.214+0000 7faee4ff9700 1 -- 172.21.15.156:0/1919072043 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc00cbc0 con 0x7faee809dea0 2023-09-30T22:20:18.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.214+0000 7faeee6c9700 1 -- 172.21.15.156:0/1919072043 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee811c840 con 0x7faee809dea0 2023-09-30T22:20:18.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.215+0000 7faee4ff9700 1 -- 172.21.15.156:0/1919072043 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faedc00cd20 con 0x7faee809dea0 2023-09-30T22:20:18.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.215+0000 7faee4ff9700 1 -- 172.21.15.156:0/1919072043 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faedc03fab0 con 0x7faee809dea0 2023-09-30T22:20:18.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.215+0000 7faeee6c9700 1 -- 172.21.15.156:0/1919072043 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee804f2a0 con 0x7faee809dea0 2023-09-30T22:20:18.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.220+0000 7faee4ff9700 1 -- 172.21.15.156:0/1919072043 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faedc017080 con 0x7faee809dea0 2023-09-30T22:20:18.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.238+0000 7faf9d18e700 1 Processor -- start 2023-09-30T22:20:18.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.238+0000 7faf9d18e700 1 -- start start 2023-09-30T22:20:18.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.239+0000 7faf9d18e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf9809e950 0x7faf9809ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:18.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.239+0000 7faf9d18e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7faf98131fa0 0x7faf98139af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:18.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.239+0000 7faf9d18e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf9809afb0 con 0x7faf9809f260 2023-09-30T22:20:18.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.239+0000 7faf9d18e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf980a0970 con 0x7faf98131fa0 2023-09-30T22:20:18.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.239+0000 7faf9d18e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf980a0320 con 0x7faf9809e950 2023-09-30T22:20:18.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.239+0000 7faf96d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf9809e950 0x7faf9809ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:18.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.239+0000 7faf96d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf9809e950 0x7faf9809ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33726/0 (socket says 172.21.15.156:33726) 2023-09-30T22:20:18.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.239+0000 7faf96d9d700 1 -- 172.21.15.156:0/3019069504 learned_addr learned my addr 172.21.15.156:0/3019069504 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:18.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.239+0000 7faf9659c700 1 --1- 172.21.15.156:0/3019069504 >> v1:172.21.15.156:6789/0 conn(0x7faf9809f260 0x7faf98131890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:43440/0 (socket says 172.21.15.156:43440) 2023-09-30T22:20:18.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.239+0000 7faf9759e700 1 --2- 172.21.15.156:0/3019069504 >> v2:172.21.15.156:3300/0 conn(0x7faf98131fa0 0x7faf98139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:18.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.239+0000 7faf95d9b700 1 -- 172.21.15.156:0/3019069504 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3034338726 0 0) 0x7faf9809afb0 con 0x7faf9809f260 2023-09-30T22:20:18.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.239+0000 7faf96d9d700 1 -- 172.21.15.156:0/3019069504 >> v2:172.21.15.156:3300/0 conn(0x7faf98131fa0 msgr2=0x7faf98139af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:18.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.239+0000 7faf96d9d700 1 --2- 172.21.15.156:0/3019069504 >> v2:172.21.15.156:3300/0 conn(0x7faf98131fa0 0x7faf98139af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.239+0000 7faf96d9d700 1 -- 172.21.15.156:0/3019069504 >> v1:172.21.15.156:6789/0 conn(0x7faf9809f260 legacy=0x7faf98131890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:18.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.239+0000 7faf96d9d700 1 -- 172.21.15.156:0/3019069504 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf980a0750 con 0x7faf9809e950 2023-09-30T22:20:18.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.240+0000 7faf96d9d700 1 --2- 172.21.15.156:0/3019069504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf9809e950 0x7faf9809ed20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faf88006fd0 tx=0x7faf88009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eba021e18da3f383 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:18.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.240+0000 7faf95d9b700 1 -- 172.21.15.156:0/3019069504 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf88005e30 con 0x7faf9809e950 2023-09-30T22:20:18.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.240+0000 7faf95d9b700 1 -- 172.21.15.156:0/3019069504 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf88004030 con 0x7faf9809e950 2023-09-30T22:20:18.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.240+0000 7faf95d9b700 1 -- 172.21.15.156:0/3019069504 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf880043e0 con 0x7faf9809e950 2023-09-30T22:20:18.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.241+0000 7faf9d18e700 1 -- 172.21.15.156:0/3019069504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf9809e950 msgr2=0x7faf9809ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:18.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.241+0000 7faf9d18e700 1 --2- 172.21.15.156:0/3019069504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf9809e950 0x7faf9809ed20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faf88006fd0 tx=0x7faf88009bd0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.241+0000 7faf9d18e700 1 -- 172.21.15.156:0/3019069504 shutdown_connections 2023-09-30T22:20:18.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.241+0000 7faf9d18e700 1 --2- 172.21.15.156:0/3019069504 >> v2:172.21.15.156:3300/0 conn(0x7faf98131fa0 0x7faf98139af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.241+0000 7faf9d18e700 1 --2- 172.21.15.156:0/3019069504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf9809e950 0x7faf9809ed20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.241+0000 7faf9d18e700 1 -- 172.21.15.156:0/3019069504 >> 172.21.15.156:0/3019069504 conn(0x7faf980a0f70 msgr2=0x7faf980a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:18.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.241+0000 7faf9d18e700 1 -- 172.21.15.156:0/3019069504 shutdown_connections 2023-09-30T22:20:18.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.241+0000 7faf9d18e700 1 -- 172.21.15.156:0/3019069504 wait complete. 2023-09-30T22:20:18.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.242+0000 7faf9d18e700 1 Processor -- start 2023-09-30T22:20:18.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.242+0000 7faf9d18e700 1 -- start start 2023-09-30T22:20:18.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.243+0000 7faf9d18e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faf9809e950 0x7faf9811a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:18.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.243+0000 7faf9d18e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf9809f260 0x7faf9811ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:18.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.243+0000 7faf9d18e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf98131fa0 0x7faf9811b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:18.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.243+0000 7faf9d18e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9812f320 con 0x7faf98131fa0 2023-09-30T22:20:18.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.243+0000 7faf9d18e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9811c9e0 con 0x7faf9809f260 2023-09-30T22:20:18.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.243+0000 7faf9d18e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf980a4c50 con 0x7faf9809e950 2023-09-30T22:20:18.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.243+0000 7faf96d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faf9809e950 0x7faf9811a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:18.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.243+0000 7faf9759e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf98131fa0 0x7faf9811b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:18.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.243+0000 7faf9659c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf9809f260 0x7faf9811ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:18.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.243+0000 7faf96d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faf9809e950 0x7faf9811a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44864/0 (socket says 172.21.15.156:44864) 2023-09-30T22:20:18.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.243+0000 7faf96d9d700 1 -- 172.21.15.156:0/1643871300 learned_addr learned my addr 172.21.15.156:0/1643871300 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:18.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.243+0000 7faf9659c700 1 -- 172.21.15.156:0/1643871300 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faf9809e950 msgr2=0x7faf9811a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:18.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.243+0000 7faf9659c700 1 --2- 172.21.15.156:0/1643871300 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faf9809e950 0x7faf9811a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.243+0000 7faf9659c700 1 -- 172.21.15.156:0/1643871300 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf98131fa0 msgr2=0x7faf9811b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:18.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.243+0000 7faf9659c700 1 --2- 172.21.15.156:0/1643871300 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf98131fa0 0x7faf9811b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.243+0000 7faf9659c700 1 -- 172.21.15.156:0/1643871300 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf88009500 con 0x7faf9809f260 2023-09-30T22:20:18.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.243+0000 7faf9759e700 1 --2- 172.21.15.156:0/1643871300 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf98131fa0 0x7faf9811b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:18.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.244+0000 7faf9659c700 1 --2- 172.21.15.156:0/1643871300 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf9809f260 0x7faf9811ac60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7faf8c00c470 tx=0x7faf8c00c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:18.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.244+0000 7faf7f7fe700 1 -- 172.21.15.156:0/1643871300 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c004c80 con 0x7faf9809f260 2023-09-30T22:20:18.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.244+0000 7faf7f7fe700 1 -- 172.21.15.156:0/1643871300 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c004de0 con 0x7faf9809f260 2023-09-30T22:20:18.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.244+0000 7faf9d18e700 1 -- 172.21.15.156:0/1643871300 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf9809da40 con 0x7faf9809f260 2023-09-30T22:20:18.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.244+0000 7faf7f7fe700 1 -- 172.21.15.156:0/1643871300 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c007310 con 0x7faf9809f260 2023-09-30T22:20:18.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.244+0000 7faf9d18e700 1 -- 172.21.15.156:0/1643871300 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf9812e880 con 0x7faf9809f260 2023-09-30T22:20:18.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.245+0000 7faf9d18e700 1 -- 172.21.15.156:0/1643871300 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf9811c820 con 0x7faf9809f260 2023-09-30T22:20:18.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.246+0000 7faf7f7fe700 1 -- 172.21.15.156:0/1643871300 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faf8c007470 con 0x7faf9809f260 2023-09-30T22:20:18.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.246+0000 7faf7f7fe700 1 -- 172.21.15.156:0/1643871300 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faf8c03f9e0 con 0x7faf9809f260 2023-09-30T22:20:18.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.250+0000 7faf7f7fe700 1 -- 172.21.15.156:0/1643871300 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faf8c007720 con 0x7faf9809f260 2023-09-30T22:20:18.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.278+0000 7f7a37f22700 1 Processor -- start 2023-09-30T22:20:18.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.278+0000 7f7a37f22700 1 -- start start 2023-09-30T22:20:18.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.278+0000 7f7a37f22700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7a30133ad0 0x7f7a30133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:18.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.278+0000 7f7a37f22700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a301300a0 0x7f7a301304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:18.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.278+0000 7f7a37f22700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a3006b2d0 con 0x7f7a301309f0 2023-09-30T22:20:18.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.278+0000 7f7a37f22700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a30133610 con 0x7f7a30133ad0 2023-09-30T22:20:18.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.278+0000 7f7a37f22700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3009a500 con 0x7f7a301300a0 2023-09-30T22:20:18.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.278+0000 7f7a35cbe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7a30133ad0 0x7f7a30133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:18.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.279+0000 7f7a35cbe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7a30133ad0 0x7f7a30133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38308/0 (socket says 172.21.15.156:38308) 2023-09-30T22:20:18.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.279+0000 7f7a35cbe700 1 -- 172.21.15.156:0/1836224585 learned_addr learned my addr 172.21.15.156:0/1836224585 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:18.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.279+0000 7f7a354bd700 1 --2- 172.21.15.156:0/1836224585 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a301300a0 0x7f7a301304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:18.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.279+0000 7f7a34cbc700 1 -- 172.21.15.156:0/1836224585 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1845149634 0 0) 0x7f7a3006b2d0 con 0x7f7a301309f0 2023-09-30T22:20:18.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.279+0000 7f7a34cbc700 1 -- 172.21.15.156:0/1836224585 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a1c0035b0 con 0x7f7a301309f0 2023-09-30T22:20:18.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.279+0000 7f7a354bd700 1 -- 172.21.15.156:0/1836224585 >> v2:172.21.15.156:3300/0 conn(0x7f7a30133ad0 msgr2=0x7f7a30133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:18.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.279+0000 7f7a354bd700 1 --2- 172.21.15.156:0/1836224585 >> v2:172.21.15.156:3300/0 conn(0x7f7a30133ad0 0x7f7a30133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.279+0000 7f7a354bd700 1 -- 172.21.15.156:0/1836224585 >> v1:172.21.15.156:6789/0 conn(0x7f7a301309f0 legacy=0x7f7a3013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:18.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.279+0000 7f7a354bd700 1 -- 172.21.15.156:0/1836224585 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a301338b0 con 0x7f7a301300a0 2023-09-30T22:20:18.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.279+0000 7f7a354bd700 1 --2- 172.21.15.156:0/1836224585 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a301300a0 0x7f7a301304b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7a20009840 tx=0x7f7a20009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bde3195f99a445b8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:18.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.279+0000 7f7a34cbc700 1 -- 172.21.15.156:0/1836224585 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20011830 con 0x7f7a301300a0 2023-09-30T22:20:18.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.279+0000 7f7a34cbc700 1 -- 172.21.15.156:0/1836224585 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a20011990 con 0x7f7a301300a0 2023-09-30T22:20:18.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.279+0000 7f7a34cbc700 1 -- 172.21.15.156:0/1836224585 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20011d20 con 0x7f7a301300a0 2023-09-30T22:20:18.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.280+0000 7f7a37f22700 1 -- 172.21.15.156:0/1836224585 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a301300a0 msgr2=0x7f7a301304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:18.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.280+0000 7f7a37f22700 1 --2- 172.21.15.156:0/1836224585 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a301300a0 0x7f7a301304b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7a20009840 tx=0x7f7a20009b50 comp rx=0 tx=0).stop 2023-09-30T22:20:18.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.280+0000 7f7a37f22700 1 -- 172.21.15.156:0/1836224585 shutdown_connections 2023-09-30T22:20:18.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.280+0000 7f7a37f22700 1 --2- 172.21.15.156:0/1836224585 >> v2:172.21.15.156:3300/0 conn(0x7f7a30133ad0 0x7f7a30133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.280+0000 7f7a37f22700 1 --2- 172.21.15.156:0/1836224585 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a301300a0 0x7f7a301304b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.280+0000 7f7a37f22700 1 -- 172.21.15.156:0/1836224585 >> 172.21.15.156:0/1836224585 conn(0x7f7a30099c40 msgr2=0x7f7a300a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:18.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.280+0000 7f7a37f22700 1 -- 172.21.15.156:0/1836224585 shutdown_connections 2023-09-30T22:20:18.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.280+0000 7f7a37f22700 1 -- 172.21.15.156:0/1836224585 wait complete. 2023-09-30T22:20:18.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.281+0000 7f7a37f22700 1 Processor -- start 2023-09-30T22:20:18.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.282+0000 7f7a37f22700 1 -- start start 2023-09-30T22:20:18.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.282+0000 7f7a37f22700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a301300a0 0x7f7a3011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:18.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.282+0000 7f7a37f22700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a301309f0 0x7f7a3011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:18.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.282+0000 7f7a37f22700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a30133ad0 0x7f7a3011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:18.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.282+0000 7f7a37f22700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3012dd00 con 0x7f7a301309f0 2023-09-30T22:20:18.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.282+0000 7f7a37f22700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a300a3350 con 0x7f7a30133ad0 2023-09-30T22:20:18.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.282+0000 7f7a37f22700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3011ed40 con 0x7f7a301300a0 2023-09-30T22:20:18.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.282+0000 7f7a364bf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a30133ad0 0x7f7a3011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:18.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.282+0000 7f7a35cbe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a301300a0 0x7f7a3011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:18.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.282+0000 7f7a364bf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a30133ad0 0x7f7a3011e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33756/0 (socket says 172.21.15.156:33756) 2023-09-30T22:20:18.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.282+0000 7f7a364bf700 1 -- 172.21.15.156:0/2624554615 learned_addr learned my addr 172.21.15.156:0/2624554615 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:18.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.283+0000 7f7a364bf700 1 -- 172.21.15.156:0/2624554615 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a301300a0 msgr2=0x7f7a3011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:18.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.283+0000 7f7a364bf700 1 --2- 172.21.15.156:0/2624554615 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a301300a0 0x7f7a3011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.283+0000 7f7a364bf700 1 -- 172.21.15.156:0/2624554615 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a301309f0 msgr2=0x7f7a3011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:18.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.283+0000 7f7a364bf700 1 --2- 172.21.15.156:0/2624554615 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a301309f0 0x7f7a3011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.283+0000 7f7a364bf700 1 -- 172.21.15.156:0/2624554615 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a200094a0 con 0x7f7a30133ad0 2023-09-30T22:20:18.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.283+0000 7f7a364bf700 1 --2- 172.21.15.156:0/2624554615 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a30133ad0 0x7f7a3011e4c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7a2800cbf0 tx=0x7f7a2800cf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:18.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.283+0000 7f7a267fc700 1 -- 172.21.15.156:0/2624554615 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a28003c00 con 0x7f7a30133ad0 2023-09-30T22:20:18.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.283+0000 7f7a267fc700 1 -- 172.21.15.156:0/2624554615 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a28003d60 con 0x7f7a30133ad0 2023-09-30T22:20:18.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.283+0000 7f7a37f22700 1 -- 172.21.15.156:0/2624554615 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a30072410 con 0x7f7a30133ad0 2023-09-30T22:20:18.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.283+0000 7f7a267fc700 1 -- 172.21.15.156:0/2624554615 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2800ab10 con 0x7f7a30133ad0 2023-09-30T22:20:18.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.283+0000 7f7a37f22700 1 -- 172.21.15.156:0/2624554615 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a3012d3f0 con 0x7f7a30133ad0 2023-09-30T22:20:18.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.284+0000 7f7a267fc700 1 -- 172.21.15.156:0/2624554615 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7a2800ac70 con 0x7f7a30133ad0 2023-09-30T22:20:18.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.284+0000 7f7a267fc700 1 -- 172.21.15.156:0/2624554615 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7a2803f8d0 con 0x7f7a30133ad0 2023-09-30T22:20:18.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.284+0000 7f7a37f22700 1 -- 172.21.15.156:0/2624554615 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a3004f2a0 con 0x7f7a30133ad0 2023-09-30T22:20:18.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.289+0000 7f7a267fc700 1 -- 172.21.15.156:0/2624554615 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7a280108d0 con 0x7f7a30133ad0 2023-09-30T22:20:18.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.437+0000 7fba3e044700 1 -- 172.21.15.156:0/3814726828 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fba3811d1b0 con 0x7fba38131980 2023-09-30T22:20:18.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.437+0000 7fba1ffff700 1 -- 172.21.15.156:0/3814726828 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fba3001d020 con 0x7fba38131980 2023-09-30T22:20:18.438 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:18.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.439+0000 7fba3e044700 1 -- 172.21.15.156:0/3814726828 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba38131980 msgr2=0x7fba3811a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:18.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.439+0000 7fba3e044700 1 --2- 172.21.15.156:0/3814726828 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba38131980 0x7fba3811a050 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fba3809cc30 tx=0x7fba30004ad0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.439+0000 7fba3e044700 1 -- 172.21.15.156:0/3814726828 shutdown_connections 2023-09-30T22:20:18.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.439+0000 7fba3e044700 1 --2- 172.21.15.156:0/3814726828 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba38131980 0x7fba3811a050 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.439+0000 7fba3e044700 1 --2- 172.21.15.156:0/3814726828 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba3809bc70 0x7fba381195d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.439+0000 7fba3e044700 1 --2- 172.21.15.156:0/3814726828 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fba3809c790 0x7fba38119b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.439+0000 7fba3e044700 1 -- 172.21.15.156:0/3814726828 >> 172.21.15.156:0/3814726828 conn(0x7fba380a2980 msgr2=0x7fba3812e580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:18.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.439+0000 7fba3e044700 1 -- 172.21.15.156:0/3814726828 shutdown_connections 2023-09-30T22:20:18.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.439+0000 7fba3e044700 1 -- 172.21.15.156:0/3814726828 wait complete. 2023-09-30T22:20:18.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:18.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.454+0000 7faf9d18e700 1 -- 172.21.15.156:0/1643871300 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faf9804f2a0 con 0x7faf9809f260 2023-09-30T22:20:18.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.454+0000 7faf7f7fe700 1 -- 172.21.15.156:0/1643871300 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faf8c01bb30 con 0x7faf9809f260 2023-09-30T22:20:18.455 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:18.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.456+0000 7faf9d18e700 1 -- 172.21.15.156:0/1643871300 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf9809f260 msgr2=0x7faf9811ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:18.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.456+0000 7faf9d18e700 1 --2- 172.21.15.156:0/1643871300 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf9809f260 0x7faf9811ac60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7faf8c00c470 tx=0x7faf8c00c780 comp rx=0 tx=0).stop 2023-09-30T22:20:18.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.456+0000 7faf9d18e700 1 -- 172.21.15.156:0/1643871300 shutdown_connections 2023-09-30T22:20:18.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.456+0000 7faf9d18e700 1 --2- 172.21.15.156:0/1643871300 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf98131fa0 0x7faf9811b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.456+0000 7faf9d18e700 1 --2- 172.21.15.156:0/1643871300 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faf9809e950 0x7faf9811a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.456+0000 7faf9d18e700 1 --2- 172.21.15.156:0/1643871300 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf9809f260 0x7faf9811ac60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.456+0000 7faf9d18e700 1 -- 172.21.15.156:0/1643871300 >> 172.21.15.156:0/1643871300 conn(0x7faf980a0f70 msgr2=0x7faf98071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:18.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.456+0000 7faf9d18e700 1 -- 172.21.15.156:0/1643871300 shutdown_connections 2023-09-30T22:20:18.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.456+0000 7faf9d18e700 1 -- 172.21.15.156:0/1643871300 wait complete. 2023-09-30T22:20:18.469 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:18.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.471+0000 7faeee6c9700 1 -- 172.21.15.156:0/1919072043 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faee811ca80 con 0x7faee809dea0 2023-09-30T22:20:18.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.471+0000 7faee4ff9700 1 -- 172.21.15.156:0/1919072043 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faedc01b3b0 con 0x7faee809dea0 2023-09-30T22:20:18.472 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:18.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.473+0000 7faeee6c9700 1 -- 172.21.15.156:0/1919072043 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faee809dea0 msgr2=0x7faee811abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:18.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.473+0000 7faeee6c9700 1 --2- 172.21.15.156:0/1919072043 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faee809dea0 0x7faee811abc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faedc00e9b0 tx=0x7faedc00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.473+0000 7faeee6c9700 1 -- 172.21.15.156:0/1919072043 shutdown_connections 2023-09-30T22:20:18.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.473+0000 7faeee6c9700 1 --2- 172.21.15.156:0/1919072043 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faee8134f00 0x7faee811b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.473+0000 7faeee6c9700 1 --2- 172.21.15.156:0/1919072043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faee806a770 0x7faee811a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.473+0000 7faeee6c9700 1 --2- 172.21.15.156:0/1919072043 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faee809dea0 0x7faee811abc0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.473+0000 7faeee6c9700 1 -- 172.21.15.156:0/1919072043 >> 172.21.15.156:0/1919072043 conn(0x7faee8099c40 msgr2=0x7faee809c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:18.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.473+0000 7faeee6c9700 1 -- 172.21.15.156:0/1919072043 shutdown_connections 2023-09-30T22:20:18.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.473+0000 7faeee6c9700 1 -- 172.21.15.156:0/1919072043 wait complete. 2023-09-30T22:20:18.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:18.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.491+0000 7f7a37f22700 1 -- 172.21.15.156:0/2624554615 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7a3009d3a0 con 0x7f7a30133ad0 2023-09-30T22:20:18.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.492+0000 7f7a267fc700 1 -- 172.21.15.156:0/2624554615 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7a28011380 con 0x7f7a30133ad0 2023-09-30T22:20:18.492 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:18.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.494+0000 7f7a37f22700 1 -- 172.21.15.156:0/2624554615 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a30133ad0 msgr2=0x7f7a3011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:18.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.494+0000 7f7a37f22700 1 --2- 172.21.15.156:0/2624554615 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a30133ad0 0x7f7a3011e4c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7a2800cbf0 tx=0x7f7a2800cf00 comp rx=0 tx=0).stop 2023-09-30T22:20:18.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.494+0000 7f7a37f22700 1 -- 172.21.15.156:0/2624554615 shutdown_connections 2023-09-30T22:20:18.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.494+0000 7f7a37f22700 1 --2- 172.21.15.156:0/2624554615 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a30133ad0 0x7f7a3011e4c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.494+0000 7f7a37f22700 1 --2- 172.21.15.156:0/2624554615 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a301300a0 0x7f7a3011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.494+0000 7f7a37f22700 1 --2- 172.21.15.156:0/2624554615 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a301309f0 0x7f7a3011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:18.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.494+0000 7f7a37f22700 1 -- 172.21.15.156:0/2624554615 >> 172.21.15.156:0/2624554615 conn(0x7f7a30099c40 msgr2=0x7f7a3009e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:18.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.494+0000 7f7a37f22700 1 -- 172.21.15.156:0/2624554615 shutdown_connections 2023-09-30T22:20:18.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:18.494+0000 7f7a37f22700 1 -- 172.21.15.156:0/2624554615 wait complete. 2023-09-30T22:20:18.506 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:19.453 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:19.469 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:19.486 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:19.507 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:19.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.599+0000 7f056794f700 1 Processor -- start 2023-09-30T22:20:19.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.599+0000 7f056794f700 1 -- start start 2023-09-30T22:20:19.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.599+0000 7f056794f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0560133a70 0x7f0560133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:19.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.599+0000 7f056794f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f05600a08e0 0x7f05600a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:19.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.600+0000 7f056794f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0560133640 con 0x7f05600a1290 2023-09-30T22:20:19.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.600+0000 7f056794f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05600a1d50 con 0x7f05600a08e0 2023-09-30T22:20:19.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.600+0000 7f056794f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056009b620 con 0x7f0560133a70 2023-09-30T22:20:19.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.600+0000 7f0564eea700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f05600a08e0 0x7f05600a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:19.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.600+0000 7f0564eea700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f05600a08e0 0x7f05600a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38324/0 (socket says 172.21.15.156:38324) 2023-09-30T22:20:19.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.600+0000 7f0564eea700 1 -- 172.21.15.156:0/1609285002 learned_addr learned my addr 172.21.15.156:0/1609285002 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:19.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.600+0000 7f05656eb700 1 --2- 172.21.15.156:0/1609285002 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0560133a70 0x7f0560133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:19.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.600+0000 7f0564eea700 1 -- 172.21.15.156:0/1609285002 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0560133a70 msgr2=0x7f0560133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:19.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.600+0000 7f0564eea700 1 --2- 172.21.15.156:0/1609285002 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0560133a70 0x7f0560133e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.600+0000 7f0564eea700 1 -- 172.21.15.156:0/1609285002 >> v1:172.21.15.156:6789/0 conn(0x7f05600a1290 legacy=0x7f056013a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:19.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.600+0000 7f0564eea700 1 -- 172.21.15.156:0/1609285002 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0560133870 con 0x7f05600a08e0 2023-09-30T22:20:19.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.600+0000 7f0564eea700 1 --2- 172.21.15.156:0/1609285002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05600a08e0 0x7f05600a0d50 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f05500098f0 tx=0x7f0550009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85b163466b51990 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:19.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.600+0000 7f0557fff700 1 -- 172.21.15.156:0/1609285002 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055000b8a0 con 0x7f05600a08e0 2023-09-30T22:20:19.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.601+0000 7f0557fff700 1 -- 172.21.15.156:0/1609285002 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055000ba00 con 0x7f05600a08e0 2023-09-30T22:20:19.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.601+0000 7f0557fff700 1 -- 172.21.15.156:0/1609285002 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055000bd90 con 0x7f05600a08e0 2023-09-30T22:20:19.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.601+0000 7f056794f700 1 -- 172.21.15.156:0/1609285002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05600a08e0 msgr2=0x7f05600a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:19.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.601+0000 7f056794f700 1 --2- 172.21.15.156:0/1609285002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05600a08e0 0x7f05600a0d50 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f05500098f0 tx=0x7f0550009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:19.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.601+0000 7f056794f700 1 -- 172.21.15.156:0/1609285002 shutdown_connections 2023-09-30T22:20:19.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.601+0000 7f056794f700 1 --2- 172.21.15.156:0/1609285002 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0560133a70 0x7f0560133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.601+0000 7f056794f700 1 --2- 172.21.15.156:0/1609285002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05600a08e0 0x7f05600a0d50 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.601+0000 7f056794f700 1 -- 172.21.15.156:0/1609285002 >> 172.21.15.156:0/1609285002 conn(0x7f05600a2980 msgr2=0x7f05600a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:19.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.601+0000 7f056794f700 1 -- 172.21.15.156:0/1609285002 shutdown_connections 2023-09-30T22:20:19.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.601+0000 7f056794f700 1 -- 172.21.15.156:0/1609285002 wait complete. 2023-09-30T22:20:19.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.603+0000 7f056794f700 1 Processor -- start 2023-09-30T22:20:19.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.603+0000 7f056794f700 1 -- start start 2023-09-30T22:20:19.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.604+0000 7f056794f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05600a08e0 0x7f056011fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:19.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.604+0000 7f056794f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05600a1290 0x7f0560120070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:19.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.604+0000 7f056794f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0560133a70 0x7f05601205b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:19.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.604+0000 7f056794f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0560123340 con 0x7f0560133a70 2023-09-30T22:20:19.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.604+0000 7f056794f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056009a350 con 0x7f05600a1290 2023-09-30T22:20:19.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.604+0000 7f056794f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0560130d90 con 0x7f05600a08e0 2023-09-30T22:20:19.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.604+0000 7f0565eec700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0560133a70 0x7f05601205b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:19.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.604+0000 7f0565eec700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0560133a70 0x7f05601205b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38330/0 (socket says 172.21.15.156:38330) 2023-09-30T22:20:19.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.604+0000 7f0565eec700 1 -- 172.21.15.156:0/2422761312 learned_addr learned my addr 172.21.15.156:0/2422761312 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:19.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.604+0000 7f0564eea700 1 --2- 172.21.15.156:0/2422761312 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05600a1290 0x7f0560120070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:19.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.604+0000 7f0565eec700 1 -- 172.21.15.156:0/2422761312 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05600a08e0 msgr2=0x7f056011fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:19.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.604+0000 7f0565eec700 1 --2- 172.21.15.156:0/2422761312 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05600a08e0 0x7f056011fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.604+0000 7f0565eec700 1 -- 172.21.15.156:0/2422761312 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05600a1290 msgr2=0x7f0560120070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:19.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.604+0000 7f0565eec700 1 --2- 172.21.15.156:0/2422761312 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05600a1290 0x7f0560120070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.604+0000 7f0565eec700 1 -- 172.21.15.156:0/2422761312 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0550009550 con 0x7f0560133a70 2023-09-30T22:20:19.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.604+0000 7f0564eea700 1 --2- 172.21.15.156:0/2422761312 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05600a1290 0x7f0560120070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:19.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.604+0000 7f0565eec700 1 --2- 172.21.15.156:0/2422761312 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0560133a70 0x7f05601205b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f055800cc50 tx=0x7f055800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:19.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.605+0000 7f0555ffb700 1 -- 172.21.15.156:0/2422761312 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0558003c00 con 0x7f0560133a70 2023-09-30T22:20:19.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.605+0000 7f0555ffb700 1 -- 172.21.15.156:0/2422761312 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0558003d60 con 0x7f0560133a70 2023-09-30T22:20:19.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.605+0000 7f056794f700 1 -- 172.21.15.156:0/2422761312 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0560123540 con 0x7f0560133a70 2023-09-30T22:20:19.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.605+0000 7f0555ffb700 1 -- 172.21.15.156:0/2422761312 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055800ab60 con 0x7f0560133a70 2023-09-30T22:20:19.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.605+0000 7f056794f700 1 -- 172.21.15.156:0/2422761312 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0560123cd0 con 0x7f0560133a70 2023-09-30T22:20:19.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.606+0000 7f0555ffb700 1 -- 172.21.15.156:0/2422761312 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f055800acc0 con 0x7f0560133a70 2023-09-30T22:20:19.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.606+0000 7f056794f700 1 -- 172.21.15.156:0/2422761312 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056004f2a0 con 0x7f0560133a70 2023-09-30T22:20:19.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.606+0000 7f0555ffb700 1 -- 172.21.15.156:0/2422761312 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f055803f6c0 con 0x7f0560133a70 2023-09-30T22:20:19.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.611+0000 7f0555ffb700 1 -- 172.21.15.156:0/2422761312 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f05580196c0 con 0x7f0560133a70 2023-09-30T22:20:19.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.638+0000 7f75d595d700 1 Processor -- start 2023-09-30T22:20:19.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.638+0000 7f75d595d700 1 -- start start 2023-09-30T22:20:19.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.638+0000 7f75d595d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f75d0133900 0x7f75d0133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:19.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.638+0000 7f75d595d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75d0134210 0x7f75d00a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:19.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.638+0000 7f75d595d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d009a760 con 0x7f75d00a0ee0 2023-09-30T22:20:19.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.638+0000 7f75d595d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d01336e0 con 0x7f75d0133900 2023-09-30T22:20:19.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.638+0000 7f75d595d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d009a080 con 0x7f75d0134210 2023-09-30T22:20:19.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.639+0000 7f75ceffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f75d0133900 0x7f75d0133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:19.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.639+0000 7f75ceffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f75d0133900 0x7f75d0133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38332/0 (socket says 172.21.15.156:38332) 2023-09-30T22:20:19.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.639+0000 7f75ceffd700 1 -- 172.21.15.156:0/2292702934 learned_addr learned my addr 172.21.15.156:0/2292702934 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:19.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.639+0000 7f75ce7fc700 1 --2- 172.21.15.156:0/2292702934 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75d0134210 0x7f75d00a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:19.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.639+0000 7f75ceffd700 1 -- 172.21.15.156:0/2292702934 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75d0134210 msgr2=0x7f75d00a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:19.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.639+0000 7f75ceffd700 1 --2- 172.21.15.156:0/2292702934 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75d0134210 0x7f75d00a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.639+0000 7f75ceffd700 1 -- 172.21.15.156:0/2292702934 >> v1:172.21.15.156:6789/0 conn(0x7f75d00a0ee0 legacy=0x7f75d013a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:19.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.639+0000 7f75ceffd700 1 -- 172.21.15.156:0/2292702934 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d00a23e0 con 0x7f75d0133900 2023-09-30T22:20:19.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.639+0000 7f75ceffd700 1 --2- 172.21.15.156:0/2292702934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75d0133900 0x7f75d0133cd0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f75c0006fd0 tx=0x7f75c0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=615b3aa4d362cd28 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:19.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.639+0000 7f75cdffb700 1 -- 172.21.15.156:0/2292702934 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c0005e30 con 0x7f75d0133900 2023-09-30T22:20:19.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.639+0000 7f75cdffb700 1 -- 172.21.15.156:0/2292702934 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c0004030 con 0x7f75d0133900 2023-09-30T22:20:19.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.639+0000 7f75cdffb700 1 -- 172.21.15.156:0/2292702934 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c00043e0 con 0x7f75d0133900 2023-09-30T22:20:19.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.640+0000 7f75d595d700 1 -- 172.21.15.156:0/2292702934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75d0133900 msgr2=0x7f75d0133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:19.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.640+0000 7f75d595d700 1 --2- 172.21.15.156:0/2292702934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75d0133900 0x7f75d0133cd0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f75c0006fd0 tx=0x7f75c0009bd0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.640+0000 7f75d595d700 1 -- 172.21.15.156:0/2292702934 shutdown_connections 2023-09-30T22:20:19.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.640+0000 7f75d595d700 1 --2- 172.21.15.156:0/2292702934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75d0133900 0x7f75d0133cd0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.640+0000 7f75d595d700 1 --2- 172.21.15.156:0/2292702934 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75d0134210 0x7f75d00a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.640+0000 7f75d595d700 1 -- 172.21.15.156:0/2292702934 >> 172.21.15.156:0/2292702934 conn(0x7f75d00a2980 msgr2=0x7f75d00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:19.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.640+0000 7f75d595d700 1 -- 172.21.15.156:0/2292702934 shutdown_connections 2023-09-30T22:20:19.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.640+0000 7f75d595d700 1 -- 172.21.15.156:0/2292702934 wait complete. 2023-09-30T22:20:19.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.641+0000 7f75d595d700 1 Processor -- start 2023-09-30T22:20:19.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.642+0000 7f75d595d700 1 -- start start 2023-09-30T22:20:19.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.642+0000 7f75d595d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75d00a0ee0 0x7f75d011da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:19.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.642+0000 7f75d595d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75d0133900 0x7f75d011df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:19.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.642+0000 7f75d595d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75d0134210 0x7f75d011e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:19.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.642+0000 7f75d595d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d0121530 con 0x7f75d00a0ee0 2023-09-30T22:20:19.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.642+0000 7f75d595d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d011fbd0 con 0x7f75d0134210 2023-09-30T22:20:19.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.642+0000 7f75d595d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75d0132ef0 con 0x7f75d0133900 2023-09-30T22:20:19.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.642+0000 7f75cf7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75d0134210 0x7f75d011e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:19.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.642+0000 7f75cf7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75d0134210 0x7f75d011e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33796/0 (socket says 172.21.15.156:33796) 2023-09-30T22:20:19.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.643+0000 7f75cf7fe700 1 -- 172.21.15.156:0/1211381545 learned_addr learned my addr 172.21.15.156:0/1211381545 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:19.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.643+0000 7f75ce7fc700 1 --2- 172.21.15.156:0/1211381545 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75d0133900 0x7f75d011df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:19.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.643+0000 7f75cf7fe700 1 -- 172.21.15.156:0/1211381545 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75d0133900 msgr2=0x7f75d011df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:19.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.643+0000 7f75cf7fe700 1 --2- 172.21.15.156:0/1211381545 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75d0133900 0x7f75d011df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.643+0000 7f75cf7fe700 1 -- 172.21.15.156:0/1211381545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75d00a0ee0 msgr2=0x7f75d011da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:19.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.643+0000 7f75cf7fe700 1 --2- 172.21.15.156:0/1211381545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75d00a0ee0 0x7f75d011da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.643+0000 7f75cf7fe700 1 -- 172.21.15.156:0/1211381545 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c0009500 con 0x7f75d0134210 2023-09-30T22:20:19.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.643+0000 7f75ce7fc700 1 --2- 172.21.15.156:0/1211381545 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75d0133900 0x7f75d011df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:19.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.643+0000 7f75cf7fe700 1 --2- 172.21.15.156:0/1211381545 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75d0134210 0x7f75d011e490 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f75c800cc50 tx=0x7f75c800cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:19.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.643+0000 7f75b7fff700 1 -- 172.21.15.156:0/1211381545 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c8003c00 con 0x7f75d0134210 2023-09-30T22:20:19.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.643+0000 7f75b7fff700 1 -- 172.21.15.156:0/1211381545 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c8003d60 con 0x7f75d0134210 2023-09-30T22:20:19.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.643+0000 7f75b7fff700 1 -- 172.21.15.156:0/1211381545 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c800ab60 con 0x7f75d0134210 2023-09-30T22:20:19.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.643+0000 7f75d595d700 1 -- 172.21.15.156:0/1211381545 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d009a2c0 con 0x7f75d0134210 2023-09-30T22:20:19.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.643+0000 7f75d595d700 1 -- 172.21.15.156:0/1211381545 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d0120cc0 con 0x7f75d0134210 2023-09-30T22:20:19.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.644+0000 7f75b7fff700 1 -- 172.21.15.156:0/1211381545 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f75c800acc0 con 0x7f75d0134210 2023-09-30T22:20:19.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.644+0000 7f75d595d700 1 -- 172.21.15.156:0/1211381545 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d011a590 con 0x7f75d0134210 2023-09-30T22:20:19.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.645+0000 7f75b7fff700 1 -- 172.21.15.156:0/1211381545 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f75c8042220 con 0x7f75d0134210 2023-09-30T22:20:19.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.650+0000 7f87afb49700 1 Processor -- start 2023-09-30T22:20:19.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.651+0000 7f87afb49700 1 -- start start 2023-09-30T22:20:19.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.651+0000 7f87afb49700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87a80a0a70 0x7f87a80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:19.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.651+0000 7f87afb49700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87a8134120 0x7f87a813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:19.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.651+0000 7f87afb49700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a809dc00 con 0x7f87a80a1380 2023-09-30T22:20:19.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.651+0000 7f87afb49700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a809ea90 con 0x7f87a80a0a70 2023-09-30T22:20:19.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.651+0000 7f87afb49700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87a809dec0 con 0x7f87a8134120 2023-09-30T22:20:19.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.651+0000 7f87ad8e5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87a80a0a70 0x7f87a80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:19.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.651+0000 7f87ad8e5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87a80a0a70 0x7f87a80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33808/0 (socket says 172.21.15.156:33808) 2023-09-30T22:20:19.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.651+0000 7f87ad8e5700 1 -- 172.21.15.156:0/1924475235 learned_addr learned my addr 172.21.15.156:0/1924475235 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:19.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.652+0000 7f87ad8e5700 1 -- 172.21.15.156:0/1924475235 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87a8134120 msgr2=0x7f87a813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:19.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.652+0000 7f87ad8e5700 1 --2- 172.21.15.156:0/1924475235 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87a8134120 0x7f87a813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.652+0000 7f87ad8e5700 1 -- 172.21.15.156:0/1924475235 >> v1:172.21.15.156:6789/0 conn(0x7f87a80a1380 legacy=0x7f87a8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:19.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.652+0000 7f87ad8e5700 1 -- 172.21.15.156:0/1924475235 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a809e6a0 con 0x7f87a80a0a70 2023-09-30T22:20:19.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.652+0000 7f87ad8e5700 1 --2- 172.21.15.156:0/1924475235 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87a80a0a70 0x7f87a80a0e40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f87a4009920 tx=0x7f87a4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10d79db3340681ab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:19.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.653+0000 7f87ac8e3700 1 -- 172.21.15.156:0/1924475235 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a400ba60 con 0x7f87a80a0a70 2023-09-30T22:20:19.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.653+0000 7f87ac8e3700 1 -- 172.21.15.156:0/1924475235 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a400bbc0 con 0x7f87a80a0a70 2023-09-30T22:20:19.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.653+0000 7f87ac8e3700 1 -- 172.21.15.156:0/1924475235 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a4009e70 con 0x7f87a80a0a70 2023-09-30T22:20:19.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.654+0000 7f75b7fff700 1 -- 172.21.15.156:0/1211381545 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f75c80198f0 con 0x7f75d0134210 2023-09-30T22:20:19.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.654+0000 7f87afb49700 1 -- 172.21.15.156:0/1924475235 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87a80a0a70 msgr2=0x7f87a80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:19.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.654+0000 7f87afb49700 1 --2- 172.21.15.156:0/1924475235 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87a80a0a70 0x7f87a80a0e40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f87a4009920 tx=0x7f87a4009c30 comp rx=0 tx=0).stop 2023-09-30T22:20:19.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.655+0000 7f87afb49700 1 -- 172.21.15.156:0/1924475235 shutdown_connections 2023-09-30T22:20:19.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.655+0000 7f87afb49700 1 --2- 172.21.15.156:0/1924475235 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87a80a0a70 0x7f87a80a0e40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.655+0000 7f87afb49700 1 --2- 172.21.15.156:0/1924475235 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87a8134120 0x7f87a813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.655+0000 7f87afb49700 1 -- 172.21.15.156:0/1924475235 >> 172.21.15.156:0/1924475235 conn(0x7f87a80a6610 msgr2=0x7f87a80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:19.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.655+0000 7f87afb49700 1 -- 172.21.15.156:0/1924475235 shutdown_connections 2023-09-30T22:20:19.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.655+0000 7f87afb49700 1 -- 172.21.15.156:0/1924475235 wait complete. 2023-09-30T22:20:19.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.656+0000 7f87afb49700 1 Processor -- start 2023-09-30T22:20:19.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.656+0000 7f87afb49700 1 -- start start 2023-09-30T22:20:19.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.656+0000 7f87afb49700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87a80a0a70 0x7f87a811e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:19.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.656+0000 7f87afb49700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87a80a1380 0x7f87a811ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:19.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.656+0000 7f87afb49700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87a8134120 0x7f87a811f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:19.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.656+0000 7f87afb49700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a81204e0 con 0x7f87a80a0a70 2023-09-30T22:20:19.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.656+0000 7f87afb49700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a8122000 con 0x7f87a80a1380 2023-09-30T22:20:19.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.656+0000 7f87afb49700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87a8133aa0 con 0x7f87a8134120 2023-09-30T22:20:19.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.656+0000 7f87ad0e4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87a80a1380 0x7f87a811ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:19.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.656+0000 7f87ad0e4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87a80a1380 0x7f87a811ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33814/0 (socket says 172.21.15.156:33814) 2023-09-30T22:20:19.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.656+0000 7f87ad0e4700 1 -- 172.21.15.156:0/1046526008 learned_addr learned my addr 172.21.15.156:0/1046526008 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:19.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.656+0000 7f87ad8e5700 1 --2- 172.21.15.156:0/1046526008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87a80a0a70 0x7f87a811e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:19.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.656+0000 7f87ae0e6700 1 --2- 172.21.15.156:0/1046526008 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87a8134120 0x7f87a811f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:19.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.657+0000 7f87ad0e4700 1 -- 172.21.15.156:0/1046526008 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87a8134120 msgr2=0x7f87a811f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:19.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.657+0000 7f87ad0e4700 1 --2- 172.21.15.156:0/1046526008 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87a8134120 0x7f87a811f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.657+0000 7f87ad0e4700 1 -- 172.21.15.156:0/1046526008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87a80a0a70 msgr2=0x7f87a811e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:19.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.657+0000 7f87ad0e4700 1 --2- 172.21.15.156:0/1046526008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87a80a0a70 0x7f87a811e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.657+0000 7f87ad0e4700 1 -- 172.21.15.156:0/1046526008 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a4009550 con 0x7f87a80a1380 2023-09-30T22:20:19.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.657+0000 7f87ad0e4700 1 --2- 172.21.15.156:0/1046526008 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87a80a1380 0x7f87a811ed90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f879800c4b0 tx=0x7f879800c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:19.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.657+0000 7f87ae0e6700 1 --2- 172.21.15.156:0/1046526008 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87a8134120 0x7f87a811f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:20:19.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.657+0000 7f879e7fc700 1 -- 172.21.15.156:0/1046526008 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87980052d0 con 0x7f87a80a1380 2023-09-30T22:20:19.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.657+0000 7f879e7fc700 1 -- 172.21.15.156:0/1046526008 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8798005430 con 0x7f87a80a1380 2023-09-30T22:20:19.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.657+0000 7f87afb49700 1 -- 172.21.15.156:0/1046526008 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a8120bc0 con 0x7f87a80a1380 2023-09-30T22:20:19.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.657+0000 7f879e7fc700 1 -- 172.21.15.156:0/1046526008 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8798003880 con 0x7f87a80a1380 2023-09-30T22:20:19.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.657+0000 7f87afb49700 1 -- 172.21.15.156:0/1046526008 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a81229e0 con 0x7f87a80a1380 2023-09-30T22:20:19.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.658+0000 7f879e7fc700 1 -- 172.21.15.156:0/1046526008 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f87980039e0 con 0x7f87a80a1380 2023-09-30T22:20:19.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.659+0000 7f879e7fc700 1 -- 172.21.15.156:0/1046526008 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f879801b7b0 con 0x7f87a80a1380 2023-09-30T22:20:19.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.659+0000 7f87afb49700 1 -- 172.21.15.156:0/1046526008 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87a8121ca0 con 0x7f87a80a1380 2023-09-30T22:20:19.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.663+0000 7f879e7fc700 1 -- 172.21.15.156:0/1046526008 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f87a8121ca0 con 0x7f87a80a1380 2023-09-30T22:20:19.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.683+0000 7fd053ef0700 1 Processor -- start 2023-09-30T22:20:19.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.683+0000 7fd053ef0700 1 -- start start 2023-09-30T22:20:19.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.683+0000 7fd053ef0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd04c09e340 0x7fd04c1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:19.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.683+0000 7fd053ef0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd04c135f20 0x7fd04c138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:19.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.683+0000 7fd053ef0700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd04c09aaa0 con 0x7fd04c09d860 2023-09-30T22:20:19.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.683+0000 7fd053ef0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c09e730 con 0x7fd04c135f20 2023-09-30T22:20:19.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.683+0000 7fd053ef0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c09f870 con 0x7fd04c09e340 2023-09-30T22:20:19.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.684+0000 7fd05248d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd04c135f20 0x7fd04c138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:19.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.684+0000 7fd051c8c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fd04c09d860 0x7fd04c09dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:43498/0 (socket says 172.21.15.156:43498) 2023-09-30T22:20:19.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.684+0000 7fd051c8c700 1 -- 172.21.15.156:0/4240794272 learned_addr learned my addr 172.21.15.156:0/4240794272 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:19.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.684+0000 7fd05148b700 1 --2- 172.21.15.156:0/4240794272 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd04c09e340 0x7fd04c1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:19.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.684+0000 7fd050c8a700 1 -- 172.21.15.156:0/4240794272 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246031688 0 0) 0x7fd04c09aaa0 con 0x7fd04c09d860 2023-09-30T22:20:19.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.684+0000 7fd050c8a700 1 -- 172.21.15.156:0/4240794272 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0380035b0 con 0x7fd04c09d860 2023-09-30T22:20:19.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.684+0000 7fd050c8a700 1 -- 172.21.15.156:0/4240794272 <== mon.0 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1089985879 0 0) 0x7fd0380035b0 con 0x7fd04c09d860 2023-09-30T22:20:19.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.684+0000 7fd050c8a700 1 -- 172.21.15.156:0/4240794272 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd04c09e340 msgr2=0x7fd04c1359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:19.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.684+0000 7fd050c8a700 1 --2- 172.21.15.156:0/4240794272 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd04c09e340 0x7fd04c1359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.684+0000 7fd050c8a700 1 -- 172.21.15.156:0/4240794272 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd04c135f20 msgr2=0x7fd04c138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:19.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.684+0000 7fd050c8a700 1 --2- 172.21.15.156:0/4240794272 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd04c135f20 0x7fd04c138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.684+0000 7fd050c8a700 1 -- 172.21.15.156:0/4240794272 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04c09b360 con 0x7fd04c09d860 2023-09-30T22:20:19.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.684+0000 7fd050c8a700 1 -- 172.21.15.156:0/4240794272 <== mon.0 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2864602571 0 0) 0x7fd048001670 con 0x7fd04c09d860 2023-09-30T22:20:19.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.684+0000 7fd050c8a700 1 -- 172.21.15.156:0/4240794272 >> v1:172.21.15.156:6789/0 conn(0x7fd04c09d860 legacy=0x7fd04c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:19.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.684+0000 7fd050c8a700 1 --2- 172.21.15.156:0/4240794272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd038003aa0 0x7fd038003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:19.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.684+0000 7fd050c8a700 1 --2- 172.21.15.156:0/4240794272 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd04c135f20 0x7fd038004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:19.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.684+0000 7fd050c8a700 1 --2- 172.21.15.156:0/4240794272 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd038004d90 0x7fd038005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:19.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.684+0000 7fd050c8a700 1 -- 172.21.15.156:0/4240794272 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c09e730 con 0x7fd038003aa0 2023-09-30T22:20:19.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.684+0000 7fd050c8a700 1 -- 172.21.15.156:0/4240794272 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c09f870 con 0x7fd04c135f20 2023-09-30T22:20:19.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.684+0000 7fd050c8a700 1 -- 172.21.15.156:0/4240794272 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd038007a40 con 0x7fd038004d90 2023-09-30T22:20:19.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.684+0000 7fd05148b700 1 --2- 172.21.15.156:0/4240794272 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd04c09e340 0x7fd04c1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:19.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.685+0000 7fd051c8c700 1 --2- 172.21.15.156:0/4240794272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd038003aa0 0x7fd038003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:19.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.685+0000 7fd05248d700 1 --2- 172.21.15.156:0/4240794272 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd038004d90 0x7fd038005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:19.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.685+0000 7fd051c8c700 1 -- 172.21.15.156:0/4240794272 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd038004d90 msgr2=0x7fd038005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:19.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.685+0000 7fd051c8c700 1 --2- 172.21.15.156:0/4240794272 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd038004d90 0x7fd038005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.685+0000 7fd051c8c700 1 -- 172.21.15.156:0/4240794272 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd04c135f20 msgr2=0x7fd038004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:19.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.685+0000 7fd051c8c700 1 --2- 172.21.15.156:0/4240794272 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd04c135f20 0x7fd038004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.685+0000 7fd051c8c700 1 -- 172.21.15.156:0/4240794272 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0380035b0 con 0x7fd038003aa0 2023-09-30T22:20:19.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.685+0000 7fd051c8c700 1 --2- 172.21.15.156:0/4240794272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd038003aa0 0x7fd038003eb0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd04800c210 tx=0x7fd038005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dfef8b464fa0b29 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:19.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.685+0000 7fd050c8a700 1 -- 172.21.15.156:0/4240794272 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd048007c10 con 0x7fd038003aa0 2023-09-30T22:20:19.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.685+0000 7fd050c8a700 1 -- 172.21.15.156:0/4240794272 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04800cdb0 con 0x7fd038003aa0 2023-09-30T22:20:19.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.685+0000 7fd050c8a700 1 -- 172.21.15.156:0/4240794272 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd048005ba0 con 0x7fd038003aa0 2023-09-30T22:20:19.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.686+0000 7fd053ef0700 1 -- 172.21.15.156:0/4240794272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd038003aa0 msgr2=0x7fd038003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:19.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.686+0000 7fd053ef0700 1 --2- 172.21.15.156:0/4240794272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd038003aa0 0x7fd038003eb0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd04800c210 tx=0x7fd038005880 comp rx=0 tx=0).stop 2023-09-30T22:20:19.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.686+0000 7fd053ef0700 1 -- 172.21.15.156:0/4240794272 shutdown_connections 2023-09-30T22:20:19.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.686+0000 7fd053ef0700 1 --2- 172.21.15.156:0/4240794272 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd04c135f20 0x7fd038004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.686+0000 7fd053ef0700 1 --2- 172.21.15.156:0/4240794272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd038003aa0 0x7fd038003eb0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.686+0000 7fd053ef0700 1 --2- 172.21.15.156:0/4240794272 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd038004d90 0x7fd038005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.686+0000 7fd053ef0700 1 -- 172.21.15.156:0/4240794272 >> 172.21.15.156:0/4240794272 conn(0x7fd04c099c40 msgr2=0x7fd04c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:19.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.686+0000 7fd053ef0700 1 -- 172.21.15.156:0/4240794272 shutdown_connections 2023-09-30T22:20:19.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.686+0000 7fd053ef0700 1 -- 172.21.15.156:0/4240794272 wait complete. 2023-09-30T22:20:19.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.687+0000 7fd053ef0700 1 Processor -- start 2023-09-30T22:20:19.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.687+0000 7fd053ef0700 1 -- start start 2023-09-30T22:20:19.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.687+0000 7fd053ef0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd038003aa0 0x7fd04c1cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:19.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.687+0000 7fd053ef0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd038004d90 0x7fd04c1cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:19.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.687+0000 7fd053ef0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd04c09d860 0x7fd04c1ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:19.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.687+0000 7fd053ef0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c129ff0 con 0x7fd038004d90 2023-09-30T22:20:19.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.687+0000 7fd053ef0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c128f60 con 0x7fd04c09d860 2023-09-30T22:20:19.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.687+0000 7fd053ef0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c129c60 con 0x7fd038003aa0 2023-09-30T22:20:19.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.687+0000 7fd05148b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd038004d90 0x7fd04c1cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:19.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.687+0000 7fd051c8c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd038003aa0 0x7fd04c1cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:19.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.687+0000 7fd05148b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd038004d90 0x7fd04c1cca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38356/0 (socket says 172.21.15.156:38356) 2023-09-30T22:20:19.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.687+0000 7fd051c8c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd038003aa0 0x7fd04c1cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44928/0 (socket says 172.21.15.156:44928) 2023-09-30T22:20:19.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.687+0000 7fd05148b700 1 -- 172.21.15.156:0/4226621744 learned_addr learned my addr 172.21.15.156:0/4226621744 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:19.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.688+0000 7fd05248d700 1 --2- 172.21.15.156:0/4226621744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd04c09d860 0x7fd04c1ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:19.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.688+0000 7fd05148b700 1 -- 172.21.15.156:0/4226621744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd038003aa0 msgr2=0x7fd04c1cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:19.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.688+0000 7fd05148b700 1 --2- 172.21.15.156:0/4226621744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd038003aa0 0x7fd04c1cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.688+0000 7fd05148b700 1 -- 172.21.15.156:0/4226621744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd04c09d860 msgr2=0x7fd04c1ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:19.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.688+0000 7fd05148b700 1 --2- 172.21.15.156:0/4226621744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd04c09d860 0x7fd04c1ccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.688+0000 7fd05148b700 1 -- 172.21.15.156:0/4226621744 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04c127f50 con 0x7fd038004d90 2023-09-30T22:20:19.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.688+0000 7fd051c8c700 1 --2- 172.21.15.156:0/4226621744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd038003aa0 0x7fd04c1cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:19.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.688+0000 7fd05248d700 1 --2- 172.21.15.156:0/4226621744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd04c09d860 0x7fd04c1ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:19.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.688+0000 7fd05148b700 1 --2- 172.21.15.156:0/4226621744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd038004d90 0x7fd04c1cca40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd03c00eb40 tx=0x7fd03c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:19.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.688+0000 7fd0427fc700 1 -- 172.21.15.156:0/4226621744 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c009e00 con 0x7fd038004d90 2023-09-30T22:20:19.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.688+0000 7fd0427fc700 1 -- 172.21.15.156:0/4226621744 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03c00c7d0 con 0x7fd038004d90 2023-09-30T22:20:19.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.688+0000 7fd0427fc700 1 -- 172.21.15.156:0/4226621744 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c00cb60 con 0x7fd038004d90 2023-09-30T22:20:19.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.688+0000 7fd053ef0700 1 -- 172.21.15.156:0/4226621744 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd04c0a2640 con 0x7fd038004d90 2023-09-30T22:20:19.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.688+0000 7fd053ef0700 1 -- 172.21.15.156:0/4226621744 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd04c09c910 con 0x7fd038004d90 2023-09-30T22:20:19.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.690+0000 7fd0427fc700 1 -- 172.21.15.156:0/4226621744 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd03c00ccc0 con 0x7fd038004d90 2023-09-30T22:20:19.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.690+0000 7fd053ef0700 1 -- 172.21.15.156:0/4226621744 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd04c04f2a0 con 0x7fd038004d90 2023-09-30T22:20:19.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.690+0000 7fd0427fc700 1 -- 172.21.15.156:0/4226621744 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd03c03f6f0 con 0x7fd038004d90 2023-09-30T22:20:19.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.699+0000 7fd0427fc700 1 -- 172.21.15.156:0/4226621744 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd03c01bdc0 con 0x7fd038004d90 2023-09-30T22:20:19.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.832+0000 7f056794f700 1 -- 172.21.15.156:0/2422761312 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f056006bce0 con 0x7f0560133a70 2023-09-30T22:20:19.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.832+0000 7f0555ffb700 1 -- 172.21.15.156:0/2422761312 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0558019300 con 0x7f0560133a70 2023-09-30T22:20:19.833 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:19.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.834+0000 7f056794f700 1 -- 172.21.15.156:0/2422761312 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0560133a70 msgr2=0x7f05601205b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:19.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.834+0000 7f056794f700 1 --2- 172.21.15.156:0/2422761312 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0560133a70 0x7f05601205b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f055800cc50 tx=0x7f055800cf60 comp rx=0 tx=0).stop 2023-09-30T22:20:19.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.834+0000 7f056794f700 1 -- 172.21.15.156:0/2422761312 shutdown_connections 2023-09-30T22:20:19.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.834+0000 7f056794f700 1 --2- 172.21.15.156:0/2422761312 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0560133a70 0x7f05601205b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.834+0000 7f056794f700 1 --2- 172.21.15.156:0/2422761312 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05600a08e0 0x7f056011fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.834+0000 7f056794f700 1 --2- 172.21.15.156:0/2422761312 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05600a1290 0x7f0560120070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.834+0000 7f056794f700 1 -- 172.21.15.156:0/2422761312 >> 172.21.15.156:0/2422761312 conn(0x7f05600a2980 msgr2=0x7f0560131540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:19.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.834+0000 7f056794f700 1 -- 172.21.15.156:0/2422761312 shutdown_connections 2023-09-30T22:20:19.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.834+0000 7f056794f700 1 -- 172.21.15.156:0/2422761312 wait complete. 2023-09-30T22:20:19.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:19.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.893+0000 7fd053ef0700 1 -- 172.21.15.156:0/4226621744 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd04c071ce0 con 0x7fd038004d90 2023-09-30T22:20:19.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.893+0000 7fd0427fc700 1 -- 172.21.15.156:0/4226621744 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd03c01b3b0 con 0x7fd038004d90 2023-09-30T22:20:19.894 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:19.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.895+0000 7fd053ef0700 1 -- 172.21.15.156:0/4226621744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd038004d90 msgr2=0x7fd04c1cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:19.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.895+0000 7fd053ef0700 1 --2- 172.21.15.156:0/4226621744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd038004d90 0x7fd04c1cca40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd03c00eb40 tx=0x7fd03c00ee50 comp rx=0 tx=0).stop 2023-09-30T22:20:19.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.895+0000 7fd053ef0700 1 -- 172.21.15.156:0/4226621744 shutdown_connections 2023-09-30T22:20:19.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.895+0000 7fd053ef0700 1 --2- 172.21.15.156:0/4226621744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd04c09d860 0x7fd04c1ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.895+0000 7fd053ef0700 1 --2- 172.21.15.156:0/4226621744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd038003aa0 0x7fd04c1cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.895+0000 7fd053ef0700 1 --2- 172.21.15.156:0/4226621744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd038004d90 0x7fd04c1cca40 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.895+0000 7fd053ef0700 1 -- 172.21.15.156:0/4226621744 >> 172.21.15.156:0/4226621744 conn(0x7fd04c099c40 msgr2=0x7fd04c135180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:19.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.895+0000 7fd053ef0700 1 -- 172.21.15.156:0/4226621744 shutdown_connections 2023-09-30T22:20:19.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.895+0000 7fd053ef0700 1 -- 172.21.15.156:0/4226621744 wait complete. 2023-09-30T22:20:19.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:19.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.918+0000 7f75d595d700 1 -- 172.21.15.156:0/1211381545 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f75d004f2a0 con 0x7f75d0134210 2023-09-30T22:20:19.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.918+0000 7f75b7fff700 1 -- 172.21.15.156:0/1211381545 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f75c8011380 con 0x7f75d0134210 2023-09-30T22:20:19.919 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:19.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.920+0000 7f75d595d700 1 -- 172.21.15.156:0/1211381545 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75d0134210 msgr2=0x7f75d011e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:19.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.920+0000 7f75d595d700 1 --2- 172.21.15.156:0/1211381545 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75d0134210 0x7f75d011e490 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f75c800cc50 tx=0x7f75c800cf60 comp rx=0 tx=0).stop 2023-09-30T22:20:19.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.921+0000 7f75d595d700 1 -- 172.21.15.156:0/1211381545 shutdown_connections 2023-09-30T22:20:19.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.921+0000 7f75d595d700 1 --2- 172.21.15.156:0/1211381545 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75d0134210 0x7f75d011e490 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.921+0000 7f75d595d700 1 --2- 172.21.15.156:0/1211381545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75d00a0ee0 0x7f75d011da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.921+0000 7f75d595d700 1 --2- 172.21.15.156:0/1211381545 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75d0133900 0x7f75d011df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.921+0000 7f75d595d700 1 -- 172.21.15.156:0/1211381545 >> 172.21.15.156:0/1211381545 conn(0x7f75d00a2980 msgr2=0x7f75d01bad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:19.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.921+0000 7f75d595d700 1 -- 172.21.15.156:0/1211381545 shutdown_connections 2023-09-30T22:20:19.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.921+0000 7f75d595d700 1 -- 172.21.15.156:0/1211381545 wait complete. 2023-09-30T22:20:19.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.926+0000 7f87afb49700 1 -- 172.21.15.156:0/1046526008 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f87a8121ca0 con 0x7f87a80a1380 2023-09-30T22:20:19.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.926+0000 7f879e7fc700 1 -- 172.21.15.156:0/1046526008 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8798017020 con 0x7f87a80a1380 2023-09-30T22:20:19.927 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:19.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.929+0000 7f87afb49700 1 -- 172.21.15.156:0/1046526008 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87a80a1380 msgr2=0x7f87a811ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:19.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.929+0000 7f87afb49700 1 --2- 172.21.15.156:0/1046526008 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87a80a1380 0x7f87a811ed90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f879800c4b0 tx=0x7f879800c7c0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.929+0000 7f87afb49700 1 -- 172.21.15.156:0/1046526008 shutdown_connections 2023-09-30T22:20:19.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.929+0000 7f87afb49700 1 --2- 172.21.15.156:0/1046526008 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87a8134120 0x7f87a811f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.929+0000 7f87afb49700 1 --2- 172.21.15.156:0/1046526008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87a80a0a70 0x7f87a811e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.929+0000 7f87afb49700 1 --2- 172.21.15.156:0/1046526008 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87a80a1380 0x7f87a811ed90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:19.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.929+0000 7f87afb49700 1 -- 172.21.15.156:0/1046526008 >> 172.21.15.156:0/1046526008 conn(0x7f87a80a6610 msgr2=0x7f87a80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:19.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.929+0000 7f87afb49700 1 -- 172.21.15.156:0/1046526008 shutdown_connections 2023-09-30T22:20:19.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:19.929+0000 7f87afb49700 1 -- 172.21.15.156:0/1046526008 wait complete. 2023-09-30T22:20:19.934 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:19.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:20.848 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:20.909 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:20.935 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:20.943 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:21.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:20.999+0000 7f8a56595700 1 Processor -- start 2023-09-30T22:20:21.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:20.999+0000 7f8a56595700 1 -- start start 2023-09-30T22:20:21.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.000+0000 7f8a56595700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a5009d8f0 0x7f8a5009dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:21.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.000+0000 7f8a56595700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8a5009e200 0x7f8a501380b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:21.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.000+0000 7f8a56595700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a501385f0 0x7f8a50138a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:21.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.000+0000 7f8a56595700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a50098680 con 0x7f8a5009e200 2023-09-30T22:20:21.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.000+0000 7f8a56595700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a50099560 con 0x7f8a501385f0 2023-09-30T22:20:21.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.000+0000 7f8a56595700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a50098bb0 con 0x7f8a5009d8f0 2023-09-30T22:20:21.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.000+0000 7f8a4ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a5009d8f0 0x7f8a5009dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:21.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.000+0000 7f8a4ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a5009d8f0 0x7f8a5009dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44934/0 (socket says 172.21.15.156:44934) 2023-09-30T22:20:21.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.000+0000 7f8a4ffff700 1 -- 172.21.15.156:0/89592141 learned_addr learned my addr 172.21.15.156:0/89592141 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:21.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.000+0000 7f8a4f7fe700 1 --2- 172.21.15.156:0/89592141 >> v2:172.21.15.156:3300/0 conn(0x7f8a5009e200 0x7f8a501380b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:21.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.000+0000 7f8a54b32700 1 --2- 172.21.15.156:0/89592141 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a501385f0 0x7f8a50138a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:21.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.000+0000 7f8a4ffff700 1 -- 172.21.15.156:0/89592141 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a501385f0 msgr2=0x7f8a50138a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:21.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.000+0000 7f8a4ffff700 1 --2- 172.21.15.156:0/89592141 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a501385f0 0x7f8a50138a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.000+0000 7f8a4ffff700 1 -- 172.21.15.156:0/89592141 >> v2:172.21.15.156:3300/0 conn(0x7f8a5009e200 msgr2=0x7f8a501380b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:21.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.000+0000 7f8a4ffff700 1 --2- 172.21.15.156:0/89592141 >> v2:172.21.15.156:3300/0 conn(0x7f8a5009e200 0x7f8a501380b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.001+0000 7f8a4ffff700 1 -- 172.21.15.156:0/89592141 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a500980f0 con 0x7f8a5009d8f0 2023-09-30T22:20:21.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.001+0000 7f8a4ffff700 1 --2- 172.21.15.156:0/89592141 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a5009d8f0 0x7f8a5009dcc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8a40006fd0 tx=0x7f8a40009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cc384833d54ac34 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:21.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.001+0000 7f8a4effd700 1 -- 172.21.15.156:0/89592141 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40005e30 con 0x7f8a5009d8f0 2023-09-30T22:20:21.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.001+0000 7f8a4effd700 1 -- 172.21.15.156:0/89592141 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a40004030 con 0x7f8a5009d8f0 2023-09-30T22:20:21.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.001+0000 7f8a4effd700 1 -- 172.21.15.156:0/89592141 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a400043e0 con 0x7f8a5009d8f0 2023-09-30T22:20:21.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.002+0000 7f8a56595700 1 -- 172.21.15.156:0/89592141 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a5009d8f0 msgr2=0x7f8a5009dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:21.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.002+0000 7f8a56595700 1 --2- 172.21.15.156:0/89592141 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a5009d8f0 0x7f8a5009dcc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8a40006fd0 tx=0x7f8a40009bd0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.002+0000 7f8a56595700 1 -- 172.21.15.156:0/89592141 shutdown_connections 2023-09-30T22:20:21.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.002+0000 7f8a56595700 1 --2- 172.21.15.156:0/89592141 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a501385f0 0x7f8a50138a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.002+0000 7f8a56595700 1 --2- 172.21.15.156:0/89592141 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a5009d8f0 0x7f8a5009dcc0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.002+0000 7f8a56595700 1 --2- 172.21.15.156:0/89592141 >> v2:172.21.15.156:3300/0 conn(0x7f8a5009e200 0x7f8a501380b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.002+0000 7f8a56595700 1 -- 172.21.15.156:0/89592141 >> 172.21.15.156:0/89592141 conn(0x7f8a500a2b30 msgr2=0x7f8a5009e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:21.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.002+0000 7f8a56595700 1 -- 172.21.15.156:0/89592141 shutdown_connections 2023-09-30T22:20:21.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.002+0000 7f8a56595700 1 -- 172.21.15.156:0/89592141 wait complete. 2023-09-30T22:20:21.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.004+0000 7f8a56595700 1 Processor -- start 2023-09-30T22:20:21.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.004+0000 7f8a56595700 1 -- start start 2023-09-30T22:20:21.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.005+0000 7f8a56595700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a5009d8f0 0x7f8a50126fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:21.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.005+0000 7f8a56595700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a5009e200 0x7f8a501274e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:21.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.005+0000 7f8a56595700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a501385f0 0x7f8a50127a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:21.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.005+0000 7f8a56595700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a50129570 con 0x7f8a501385f0 2023-09-30T22:20:21.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.005+0000 7f8a56595700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a50137ea0 con 0x7f8a5009e200 2023-09-30T22:20:21.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.005+0000 7f8a56595700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5012a5f0 con 0x7f8a5009d8f0 2023-09-30T22:20:21.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.005+0000 7f8a4ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a5009d8f0 0x7f8a50126fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:21.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.005+0000 7f8a4ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a5009d8f0 0x7f8a50126fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44938/0 (socket says 172.21.15.156:44938) 2023-09-30T22:20:21.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.005+0000 7f8a4ffff700 1 -- 172.21.15.156:0/2266104646 learned_addr learned my addr 172.21.15.156:0/2266104646 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:21.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.005+0000 7f8a4f7fe700 1 --2- 172.21.15.156:0/2266104646 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a5009e200 0x7f8a501274e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:21.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.005+0000 7f8a54b32700 1 --2- 172.21.15.156:0/2266104646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a501385f0 0x7f8a50127a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:21.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.005+0000 7f8a4f7fe700 1 -- 172.21.15.156:0/2266104646 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a5009d8f0 msgr2=0x7f8a50126fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:21.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.005+0000 7f8a4f7fe700 1 --2- 172.21.15.156:0/2266104646 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a5009d8f0 0x7f8a50126fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.005+0000 7f8a4f7fe700 1 -- 172.21.15.156:0/2266104646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a501385f0 msgr2=0x7f8a50127a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:21.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.005+0000 7f8a4f7fe700 1 --2- 172.21.15.156:0/2266104646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a501385f0 0x7f8a50127a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.005+0000 7f8a4f7fe700 1 -- 172.21.15.156:0/2266104646 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a40009500 con 0x7f8a5009e200 2023-09-30T22:20:21.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.005+0000 7f8a54b32700 1 --2- 172.21.15.156:0/2266104646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a501385f0 0x7f8a50127a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:21.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.006+0000 7f8a4f7fe700 1 --2- 172.21.15.156:0/2266104646 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a5009e200 0x7f8a501274e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8a4400e840 tx=0x7f8a4400eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:21.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.006+0000 7f8a4cff9700 1 -- 172.21.15.156:0/2266104646 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a44013680 con 0x7f8a5009e200 2023-09-30T22:20:21.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.006+0000 7f8a56595700 1 -- 172.21.15.156:0/2266104646 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a50098df0 con 0x7f8a5009e200 2023-09-30T22:20:21.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.006+0000 7f8a4cff9700 1 -- 172.21.15.156:0/2266104646 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a440137e0 con 0x7f8a5009e200 2023-09-30T22:20:21.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.006+0000 7f8a4cff9700 1 -- 172.21.15.156:0/2266104646 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a44013b70 con 0x7f8a5009e200 2023-09-30T22:20:21.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.007+0000 7f8a4cff9700 1 -- 172.21.15.156:0/2266104646 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8a44013cd0 con 0x7f8a5009e200 2023-09-30T22:20:21.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.007+0000 7f8a56595700 1 -- 172.21.15.156:0/2266104646 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a50129d80 con 0x7f8a5009e200 2023-09-30T22:20:21.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.007+0000 7f8a4cff9700 1 -- 172.21.15.156:0/2266104646 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8a44012990 con 0x7f8a5009e200 2023-09-30T22:20:21.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.008+0000 7f8a56595700 1 -- 172.21.15.156:0/2266104646 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a50097f20 con 0x7f8a5009e200 2023-09-30T22:20:21.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.017+0000 7f8a4cff9700 1 -- 172.21.15.156:0/2266104646 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a44017020 con 0x7f8a5009e200 2023-09-30T22:20:21.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.068+0000 7faeb50c3700 1 Processor -- start 2023-09-30T22:20:21.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.068+0000 7faeb50c3700 1 -- start start 2023-09-30T22:20:21.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.069+0000 7faeb50c3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7faeb009f350 0x7faeb0138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:21.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.069+0000 7faeb50c3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faeb01393a0 0x7faeb013b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:21.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.069+0000 7faeb50c3700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb009fa00 con 0x7faeb009e870 2023-09-30T22:20:21.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.069+0000 7faeb50c3700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb00a0370 con 0x7faeb009f350 2023-09-30T22:20:21.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.069+0000 7faeb50c3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb006bec0 con 0x7faeb01393a0 2023-09-30T22:20:21.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.069+0000 7faeaf59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faeb01393a0 0x7faeb013b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:21.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.069+0000 7faeaed9d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7faeb009e870 0x7faeb009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:43500/0 (socket says 172.21.15.156:43500) 2023-09-30T22:20:21.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.069+0000 7faeaed9d700 1 -- 172.21.15.156:0/711404292 learned_addr learned my addr 172.21.15.156:0/711404292 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:21.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.069+0000 7faeae59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7faeb009f350 0x7faeb0138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:21.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.070+0000 7faeae59c700 1 -- 172.21.15.156:0/711404292 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faeb01393a0 msgr2=0x7faeb013b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:21.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.070+0000 7faeae59c700 1 --2- 172.21.15.156:0/711404292 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faeb01393a0 0x7faeb013b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.070+0000 7faeae59c700 1 -- 172.21.15.156:0/711404292 >> v1:172.21.15.156:6789/0 conn(0x7faeb009e870 legacy=0x7faeb009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:21.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.070+0000 7faeadd9b700 1 -- 172.21.15.156:0/711404292 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582953213 0 0) 0x7faeb009fa00 con 0x7faeb009e870 2023-09-30T22:20:21.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.070+0000 7faeae59c700 1 -- 172.21.15.156:0/711404292 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb009ada0 con 0x7faeb009f350 2023-09-30T22:20:21.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.070+0000 7faeaf59e700 1 --2- 172.21.15.156:0/711404292 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faeb01393a0 0x7faeb013b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:21.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.070+0000 7faeae59c700 1 --2- 172.21.15.156:0/711404292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faeb009f350 0x7faeb0138e60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7faea4009840 tx=0x7faea4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2be63e3382960dd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:21.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.070+0000 7faeadd9b700 1 -- 172.21.15.156:0/711404292 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea4011830 con 0x7faeb009f350 2023-09-30T22:20:21.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.070+0000 7faeadd9b700 1 -- 172.21.15.156:0/711404292 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea4011990 con 0x7faeb009f350 2023-09-30T22:20:21.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.070+0000 7faeadd9b700 1 -- 172.21.15.156:0/711404292 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea4011d20 con 0x7faeb009f350 2023-09-30T22:20:21.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.071+0000 7faeb50c3700 1 -- 172.21.15.156:0/711404292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faeb009f350 msgr2=0x7faeb0138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:21.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.071+0000 7faeb50c3700 1 --2- 172.21.15.156:0/711404292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faeb009f350 0x7faeb0138e60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7faea4009840 tx=0x7faea4009b50 comp rx=0 tx=0).stop 2023-09-30T22:20:21.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.071+0000 7faeb50c3700 1 -- 172.21.15.156:0/711404292 shutdown_connections 2023-09-30T22:20:21.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.071+0000 7faeb50c3700 1 --2- 172.21.15.156:0/711404292 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faeb01393a0 0x7faeb013b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.071+0000 7faeb50c3700 1 --2- 172.21.15.156:0/711404292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faeb009f350 0x7faeb0138e60 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.071+0000 7faeb50c3700 1 -- 172.21.15.156:0/711404292 >> 172.21.15.156:0/711404292 conn(0x7faeb00a4430 msgr2=0x7faeb00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:21.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.071+0000 7faeb50c3700 1 -- 172.21.15.156:0/711404292 shutdown_connections 2023-09-30T22:20:21.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.071+0000 7faeb50c3700 1 -- 172.21.15.156:0/711404292 wait complete. 2023-09-30T22:20:21.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.073+0000 7faeb50c3700 1 Processor -- start 2023-09-30T22:20:21.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.073+0000 7faeb50c3700 1 -- start start 2023-09-30T22:20:21.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.073+0000 7faeb50c3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faeb009e870 0x7faeb011a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:21.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.073+0000 7faeb50c3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faeb009f350 0x7faeb011ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:21.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.073+0000 7faeb50c3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faeb01393a0 0x7faeb01cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:21.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.073+0000 7faeb50c3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb011dea0 con 0x7faeb009e870 2023-09-30T22:20:21.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.073+0000 7faeb50c3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb0136930 con 0x7faeb009f350 2023-09-30T22:20:21.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.073+0000 7faeb50c3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faeb011e5f0 con 0x7faeb01393a0 2023-09-30T22:20:21.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.073+0000 7faeaed9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faeb009e870 0x7faeb011a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:21.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.073+0000 7faeaed9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faeb009e870 0x7faeb011a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38388/0 (socket says 172.21.15.156:38388) 2023-09-30T22:20:21.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.073+0000 7faeaed9d700 1 -- 172.21.15.156:0/3675496178 learned_addr learned my addr 172.21.15.156:0/3675496178 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:21.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.073+0000 7faeae59c700 1 --2- 172.21.15.156:0/3675496178 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faeb009f350 0x7faeb011ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:21.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.074+0000 7faeaed9d700 1 -- 172.21.15.156:0/3675496178 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faeb01393a0 msgr2=0x7faeb01cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:21.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.074+0000 7faeaed9d700 1 --2- 172.21.15.156:0/3675496178 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faeb01393a0 0x7faeb01cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.074+0000 7faeaed9d700 1 -- 172.21.15.156:0/3675496178 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faeb009f350 msgr2=0x7faeb011ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:21.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.074+0000 7faeaed9d700 1 --2- 172.21.15.156:0/3675496178 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faeb009f350 0x7faeb011ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.074+0000 7faeaed9d700 1 -- 172.21.15.156:0/3675496178 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea8009a70 con 0x7faeb009e870 2023-09-30T22:20:21.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.074+0000 7faeaed9d700 1 --2- 172.21.15.156:0/3675496178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faeb009e870 0x7faeb011a930 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7faea000c4a0 tx=0x7faea000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:21.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.074+0000 7fae977fe700 1 -- 172.21.15.156:0/3675496178 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea0004c80 con 0x7faeb009e870 2023-09-30T22:20:21.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.074+0000 7fae977fe700 1 -- 172.21.15.156:0/3675496178 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea0004de0 con 0x7faeb009e870 2023-09-30T22:20:21.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.074+0000 7faeb50c3700 1 -- 172.21.15.156:0/3675496178 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea40094a0 con 0x7faeb009e870 2023-09-30T22:20:21.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.074+0000 7fae977fe700 1 -- 172.21.15.156:0/3675496178 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea0007310 con 0x7faeb009e870 2023-09-30T22:20:21.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.074+0000 7faeb50c3700 1 -- 172.21.15.156:0/3675496178 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb006fcc0 con 0x7faeb009e870 2023-09-30T22:20:21.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.075+0000 7fae977fe700 1 -- 172.21.15.156:0/3675496178 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faea0007470 con 0x7faeb009e870 2023-09-30T22:20:21.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.075+0000 7fae977fe700 1 -- 172.21.15.156:0/3675496178 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faea0040d20 con 0x7faeb009e870 2023-09-30T22:20:21.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.075+0000 7faeb50c3700 1 -- 172.21.15.156:0/3675496178 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb011dce0 con 0x7faeb009e870 2023-09-30T22:20:21.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.084+0000 7fae977fe700 1 -- 172.21.15.156:0/3675496178 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faeb011dce0 con 0x7faeb009e870 2023-09-30T22:20:21.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.092+0000 7f91c15d2700 1 Processor -- start 2023-09-30T22:20:21.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.093+0000 7f91c15d2700 1 -- start start 2023-09-30T22:20:21.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.093+0000 7f91c15d2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91bc09e870 0x7f91bc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:21.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.093+0000 7f91c15d2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f91bc09f180 0x7f91bc131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:21.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.093+0000 7f91c15d2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f91bc131d70 0x7f91bc132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:21.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.093+0000 7f91c15d2700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91bc0a0920 con 0x7f91bc09f180 2023-09-30T22:20:21.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.093+0000 7f91c15d2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc09c970 con 0x7f91bc09e870 2023-09-30T22:20:21.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.093+0000 7f91c15d2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc09bab0 con 0x7f91bc131d70 2023-09-30T22:20:21.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.093+0000 7f91ba7fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f91bc09f180 0x7f91bc131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:21.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.093+0000 7f91ba7fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f91bc09f180 0x7f91bc131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38396/0 (socket says 172.21.15.156:38396) 2023-09-30T22:20:21.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.093+0000 7f91ba7fc700 1 -- 172.21.15.156:0/3796341476 learned_addr learned my addr 172.21.15.156:0/3796341476 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:21.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.093+0000 7f91bb7fe700 1 --2- 172.21.15.156:0/3796341476 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f91bc131d70 0x7f91bc132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:21.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.094+0000 7f91ba7fc700 1 -- 172.21.15.156:0/3796341476 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f91bc131d70 msgr2=0x7f91bc132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:21.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.094+0000 7f91ba7fc700 1 --2- 172.21.15.156:0/3796341476 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f91bc131d70 0x7f91bc132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.094+0000 7f91ba7fc700 1 -- 172.21.15.156:0/3796341476 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91bc09e870 msgr2=0x7f91bc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:21.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.094+0000 7f91ba7fc700 1 --2- 172.21.15.156:0/3796341476 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91bc09e870 0x7f91bc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.094+0000 7f91ba7fc700 1 -- 172.21.15.156:0/3796341476 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91bc09f9c0 con 0x7f91bc09f180 2023-09-30T22:20:21.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.094+0000 7f91ba7fc700 1 --2- 172.21.15.156:0/3796341476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91bc09f180 0x7f91bc131830 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f91b0009920 tx=0x7f91b0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2646268675fea0f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:21.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.094+0000 7f91b9ffb700 1 -- 172.21.15.156:0/3796341476 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b0010a90 con 0x7f91bc09f180 2023-09-30T22:20:21.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.094+0000 7f91b9ffb700 1 -- 172.21.15.156:0/3796341476 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b0010bf0 con 0x7f91bc09f180 2023-09-30T22:20:21.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.094+0000 7f91b9ffb700 1 -- 172.21.15.156:0/3796341476 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b0018440 con 0x7f91bc09f180 2023-09-30T22:20:21.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.094+0000 7f91c15d2700 1 -- 172.21.15.156:0/3796341476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91bc09f180 msgr2=0x7f91bc131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:21.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.094+0000 7f91c15d2700 1 --2- 172.21.15.156:0/3796341476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91bc09f180 0x7f91bc131830 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f91b0009920 tx=0x7f91b0009c30 comp rx=0 tx=0).stop 2023-09-30T22:20:21.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.095+0000 7f91c15d2700 1 -- 172.21.15.156:0/3796341476 shutdown_connections 2023-09-30T22:20:21.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.095+0000 7f91c15d2700 1 --2- 172.21.15.156:0/3796341476 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f91bc131d70 0x7f91bc132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.095+0000 7f91c15d2700 1 --2- 172.21.15.156:0/3796341476 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91bc09e870 0x7f91bc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.095+0000 7f91c15d2700 1 --2- 172.21.15.156:0/3796341476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91bc09f180 0x7f91bc131830 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.095+0000 7f91c15d2700 1 -- 172.21.15.156:0/3796341476 >> 172.21.15.156:0/3796341476 conn(0x7f91bc0a4430 msgr2=0x7f91bc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:21.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.095+0000 7f91c15d2700 1 -- 172.21.15.156:0/3796341476 shutdown_connections 2023-09-30T22:20:21.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.095+0000 7f91c15d2700 1 -- 172.21.15.156:0/3796341476 wait complete. 2023-09-30T22:20:21.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.096+0000 7f91c15d2700 1 Processor -- start 2023-09-30T22:20:21.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.096+0000 7f91c15d2700 1 -- start start 2023-09-30T22:20:21.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.096+0000 7f91c15d2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91bc09e870 0x7f91bc1ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:21.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.096+0000 7f91c15d2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91bc09f180 0x7f91bc1cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:21.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.096+0000 7f91c15d2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f91bc131d70 0x7f91bc1248c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:21.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.096+0000 7f91c15d2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc128200 con 0x7f91bc09e870 2023-09-30T22:20:21.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.096+0000 7f91c15d2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc1283e0 con 0x7f91bc09f180 2023-09-30T22:20:21.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.096+0000 7f91c15d2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc128fc0 con 0x7f91bc131d70 2023-09-30T22:20:21.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.096+0000 7f91bb7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f91bc131d70 0x7f91bc1248c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:21.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.096+0000 7f91bb7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f91bc131d70 0x7f91bc1248c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44964/0 (socket says 172.21.15.156:44964) 2023-09-30T22:20:21.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.096+0000 7f91bb7fe700 1 -- 172.21.15.156:0/3964492645 learned_addr learned my addr 172.21.15.156:0/3964492645 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:21.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.096+0000 7f91baffd700 1 --2- 172.21.15.156:0/3964492645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91bc09e870 0x7f91bc1ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:21.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.097+0000 7f91bb7fe700 1 -- 172.21.15.156:0/3964492645 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91bc09f180 msgr2=0x7f91bc1cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:21.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.097+0000 7f91bb7fe700 1 --2- 172.21.15.156:0/3964492645 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91bc09f180 0x7f91bc1cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.097+0000 7f91bb7fe700 1 -- 172.21.15.156:0/3964492645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91bc09e870 msgr2=0x7f91bc1ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:21.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.097+0000 7f91bb7fe700 1 --2- 172.21.15.156:0/3964492645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91bc09e870 0x7f91bc1ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.097+0000 7f91bb7fe700 1 -- 172.21.15.156:0/3964492645 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b0009550 con 0x7f91bc131d70 2023-09-30T22:20:21.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.097+0000 7f91baffd700 1 --2- 172.21.15.156:0/3964492645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91bc09e870 0x7f91bc1ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:21.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.097+0000 7f91bb7fe700 1 --2- 172.21.15.156:0/3964492645 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f91bc131d70 0x7f91bc1248c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f91b4009dd0 tx=0x7f91b400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:21.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.097+0000 7f91a37fe700 1 -- 172.21.15.156:0/3964492645 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b400cd40 con 0x7f91bc131d70 2023-09-30T22:20:21.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.097+0000 7f91a37fe700 1 -- 172.21.15.156:0/3964492645 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b400f040 con 0x7f91bc131d70 2023-09-30T22:20:21.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.097+0000 7f91c15d2700 1 -- 172.21.15.156:0/3964492645 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91bc0a2cb0 con 0x7f91bc131d70 2023-09-30T22:20:21.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.097+0000 7f91a37fe700 1 -- 172.21.15.156:0/3964492645 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b40146a0 con 0x7f91bc131d70 2023-09-30T22:20:21.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.097+0000 7f91c15d2700 1 -- 172.21.15.156:0/3964492645 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91bc09dbf0 con 0x7f91bc131d70 2023-09-30T22:20:21.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.098+0000 7f91a37fe700 1 -- 172.21.15.156:0/3964492645 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f91b4014800 con 0x7f91bc131d70 2023-09-30T22:20:21.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.098+0000 7f91a37fe700 1 -- 172.21.15.156:0/3964492645 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f91b4040290 con 0x7f91bc131d70 2023-09-30T22:20:21.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.098+0000 7f91c15d2700 1 -- 172.21.15.156:0/3964492645 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91bc126590 con 0x7f91bc131d70 2023-09-30T22:20:21.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.100+0000 7fab41415700 1 Processor -- start 2023-09-30T22:20:21.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.100+0000 7fab41415700 1 -- start start 2023-09-30T22:20:21.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.100+0000 7fab41415700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fab3c06a770 0x7fab3c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:21.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.100+0000 7fab41415700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab3c06b080 0x7fab3c1316c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:21.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.100+0000 7fab41415700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab3c09cd20 con 0x7fab3c131c00 2023-09-30T22:20:21.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.100+0000 7fab41415700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab3c09e370 con 0x7fab3c06a770 2023-09-30T22:20:21.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.100+0000 7fab41415700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c09ea60 con 0x7fab3c06b080 2023-09-30T22:20:21.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.101+0000 7fab3b7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fab3c131c00 0x7fab3c138910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:43508/0 (socket says 172.21.15.156:43508) 2023-09-30T22:20:21.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.101+0000 7fab3b7fe700 1 -- 172.21.15.156:0/3487685173 learned_addr learned my addr 172.21.15.156:0/3487685173 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:21.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.101+0000 7fab3a7fc700 1 --2- 172.21.15.156:0/3487685173 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab3c06b080 0x7fab3c1316c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:21.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.101+0000 7fab3affd700 1 --2- 172.21.15.156:0/3487685173 >> v2:172.21.15.156:3300/0 conn(0x7fab3c06a770 0x7fab3c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:21.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.101+0000 7fab3affd700 1 -- 172.21.15.156:0/3487685173 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab3c06b080 msgr2=0x7fab3c1316c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:21.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.101+0000 7fab3affd700 1 --2- 172.21.15.156:0/3487685173 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab3c06b080 0x7fab3c1316c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.101+0000 7fab3affd700 1 -- 172.21.15.156:0/3487685173 >> v1:172.21.15.156:6789/0 conn(0x7fab3c131c00 legacy=0x7fab3c138910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:21.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.101+0000 7fab3affd700 1 -- 172.21.15.156:0/3487685173 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3c09d130 con 0x7fab3c06a770 2023-09-30T22:20:21.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.101+0000 7fab39ffb700 1 -- 172.21.15.156:0/3487685173 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 427765192 0 0) 0x7fab3c09cd20 con 0x7fab3c131c00 2023-09-30T22:20:21.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.101+0000 7fab3a7fc700 1 --2- 172.21.15.156:0/3487685173 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab3c06b080 0x7fab3c1316c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:21.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.101+0000 7fab3affd700 1 --2- 172.21.15.156:0/3487685173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab3c06a770 0x7fab3c06ab40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fab2c00dc60 tx=0x7fab2c00df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f55e4ad630b773 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:21.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.101+0000 7fab39ffb700 1 -- 172.21.15.156:0/3487685173 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c012070 con 0x7fab3c06a770 2023-09-30T22:20:21.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.101+0000 7fab39ffb700 1 -- 172.21.15.156:0/3487685173 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2c00d2e0 con 0x7fab3c06a770 2023-09-30T22:20:21.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.101+0000 7fab39ffb700 1 -- 172.21.15.156:0/3487685173 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c00f900 con 0x7fab3c06a770 2023-09-30T22:20:21.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.102+0000 7fab41415700 1 -- 172.21.15.156:0/3487685173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab3c06a770 msgr2=0x7fab3c06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:21.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.102+0000 7fab41415700 1 --2- 172.21.15.156:0/3487685173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab3c06a770 0x7fab3c06ab40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fab2c00dc60 tx=0x7fab2c00df70 comp rx=0 tx=0).stop 2023-09-30T22:20:21.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.102+0000 7fab41415700 1 -- 172.21.15.156:0/3487685173 shutdown_connections 2023-09-30T22:20:21.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.102+0000 7fab41415700 1 --2- 172.21.15.156:0/3487685173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab3c06a770 0x7fab3c06ab40 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.102+0000 7fab41415700 1 --2- 172.21.15.156:0/3487685173 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab3c06b080 0x7fab3c1316c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.102+0000 7fab41415700 1 -- 172.21.15.156:0/3487685173 >> 172.21.15.156:0/3487685173 conn(0x7fab3c0a2ef0 msgr2=0x7fab3c0a32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:21.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.102+0000 7fab41415700 1 -- 172.21.15.156:0/3487685173 shutdown_connections 2023-09-30T22:20:21.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.102+0000 7fab41415700 1 -- 172.21.15.156:0/3487685173 wait complete. 2023-09-30T22:20:21.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.104+0000 7fab41415700 1 Processor -- start 2023-09-30T22:20:21.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.104+0000 7fab41415700 1 -- start start 2023-09-30T22:20:21.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.104+0000 7fab41415700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab3c06a770 0x7fab3c11e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:21.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.104+0000 7fab41415700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab3c06b080 0x7fab3c11e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:21.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.104+0000 7fab41415700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab3c131c00 0x7fab3c11ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:21.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.104+0000 7fab41415700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c121cf0 con 0x7fab3c06a770 2023-09-30T22:20:21.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.104+0000 7fab41415700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c1201d0 con 0x7fab3c06b080 2023-09-30T22:20:21.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.104+0000 7fab41415700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c120670 con 0x7fab3c131c00 2023-09-30T22:20:21.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.105+0000 7fab3affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab3c06a770 0x7fab3c11e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:21.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.105+0000 7fab3affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab3c06a770 0x7fab3c11e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38442/0 (socket says 172.21.15.156:38442) 2023-09-30T22:20:21.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.105+0000 7fab3affd700 1 -- 172.21.15.156:0/2895440526 learned_addr learned my addr 172.21.15.156:0/2895440526 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:21.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.105+0000 7fab3b7fe700 1 --2- 172.21.15.156:0/2895440526 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab3c131c00 0x7fab3c11ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:21.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.105+0000 7fab3affd700 1 -- 172.21.15.156:0/2895440526 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab3c131c00 msgr2=0x7fab3c11ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:21.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.105+0000 7fab3affd700 1 --2- 172.21.15.156:0/2895440526 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab3c131c00 0x7fab3c11ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.105+0000 7fab3affd700 1 -- 172.21.15.156:0/2895440526 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab3c06b080 msgr2=0x7fab3c11e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:21.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.105+0000 7fab3affd700 1 --2- 172.21.15.156:0/2895440526 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab3c06b080 0x7fab3c11e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.105+0000 7fab3affd700 1 -- 172.21.15.156:0/2895440526 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab300094a0 con 0x7fab3c06a770 2023-09-30T22:20:21.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.105+0000 7fab3b7fe700 1 --2- 172.21.15.156:0/2895440526 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab3c131c00 0x7fab3c11ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:20:21.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.105+0000 7fab3affd700 1 --2- 172.21.15.156:0/2895440526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab3c06a770 0x7fab3c11e4b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fab3c06c620 tx=0x7fab2c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:21.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.105+0000 7fab237fe700 1 -- 172.21.15.156:0/2895440526 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c006ab0 con 0x7fab3c06a770 2023-09-30T22:20:21.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.105+0000 7fab41415700 1 -- 172.21.15.156:0/2895440526 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab2c00d940 con 0x7fab3c06a770 2023-09-30T22:20:21.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.105+0000 7fab237fe700 1 -- 172.21.15.156:0/2895440526 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2c004550 con 0x7fab3c06a770 2023-09-30T22:20:21.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.105+0000 7fab237fe700 1 -- 172.21.15.156:0/2895440526 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c003ab0 con 0x7fab3c06a770 2023-09-30T22:20:21.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.105+0000 7fab41415700 1 -- 172.21.15.156:0/2895440526 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab3c122760 con 0x7fab3c06a770 2023-09-30T22:20:21.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.106+0000 7f91a37fe700 1 -- 172.21.15.156:0/3964492645 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f91b4018020 con 0x7f91bc131d70 2023-09-30T22:20:21.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.106+0000 7fab41415700 1 -- 172.21.15.156:0/2895440526 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab3c09d3e0 con 0x7fab3c06a770 2023-09-30T22:20:21.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.107+0000 7fab237fe700 1 -- 172.21.15.156:0/2895440526 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab2c003c10 con 0x7fab3c06a770 2023-09-30T22:20:21.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.107+0000 7fab237fe700 1 -- 172.21.15.156:0/2895440526 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fab2c0453f0 con 0x7fab3c06a770 2023-09-30T22:20:21.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.111+0000 7fab237fe700 1 -- 172.21.15.156:0/2895440526 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab2c0327f0 con 0x7fab3c06a770 2023-09-30T22:20:21.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.248+0000 7f8a56595700 1 -- 172.21.15.156:0/2266104646 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8a50129f70 con 0x7f8a5009e200 2023-09-30T22:20:21.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.248+0000 7f8a4cff9700 1 -- 172.21.15.156:0/2266104646 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8a4401be10 con 0x7f8a5009e200 2023-09-30T22:20:21.249 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:21.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.250+0000 7f8a56595700 1 -- 172.21.15.156:0/2266104646 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a5009e200 msgr2=0x7f8a501274e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:21.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.250+0000 7f8a56595700 1 --2- 172.21.15.156:0/2266104646 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a5009e200 0x7f8a501274e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8a4400e840 tx=0x7f8a4400eb50 comp rx=0 tx=0).stop 2023-09-30T22:20:21.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.250+0000 7f8a56595700 1 -- 172.21.15.156:0/2266104646 shutdown_connections 2023-09-30T22:20:21.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.250+0000 7f8a56595700 1 --2- 172.21.15.156:0/2266104646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a501385f0 0x7f8a50127a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.250+0000 7f8a56595700 1 --2- 172.21.15.156:0/2266104646 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a5009d8f0 0x7f8a50126fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.250+0000 7f8a56595700 1 --2- 172.21.15.156:0/2266104646 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a5009e200 0x7f8a501274e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.250+0000 7f8a56595700 1 -- 172.21.15.156:0/2266104646 >> 172.21.15.156:0/2266104646 conn(0x7f8a500a2b30 msgr2=0x7f8a5008d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:21.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.251+0000 7f8a56595700 1 -- 172.21.15.156:0/2266104646 shutdown_connections 2023-09-30T22:20:21.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.251+0000 7f8a56595700 1 -- 172.21.15.156:0/2266104646 wait complete. 2023-09-30T22:20:21.264 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:21.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.292+0000 7faeb50c3700 1 -- 172.21.15.156:0/3675496178 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faeb011dce0 con 0x7faeb009e870 2023-09-30T22:20:21.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.293+0000 7fae977fe700 1 -- 172.21.15.156:0/3675496178 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faeb011dce0 con 0x7faeb009e870 2023-09-30T22:20:21.293 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:21.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.294+0000 7faeb50c3700 1 -- 172.21.15.156:0/3675496178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faeb009e870 msgr2=0x7faeb011a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:21.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.294+0000 7faeb50c3700 1 --2- 172.21.15.156:0/3675496178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faeb009e870 0x7faeb011a930 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7faea000c4a0 tx=0x7faea000c7b0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.295+0000 7faeb50c3700 1 -- 172.21.15.156:0/3675496178 shutdown_connections 2023-09-30T22:20:21.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.295+0000 7faeb50c3700 1 --2- 172.21.15.156:0/3675496178 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faeb01393a0 0x7faeb01cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.295+0000 7faeb50c3700 1 --2- 172.21.15.156:0/3675496178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faeb009e870 0x7faeb011a930 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.295+0000 7faeb50c3700 1 --2- 172.21.15.156:0/3675496178 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faeb009f350 0x7faeb011ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.295+0000 7faeb50c3700 1 -- 172.21.15.156:0/3675496178 >> 172.21.15.156:0/3675496178 conn(0x7faeb00a4430 msgr2=0x7faeb0071030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:21.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.295+0000 7faeb50c3700 1 -- 172.21.15.156:0/3675496178 shutdown_connections 2023-09-30T22:20:21.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.295+0000 7faeb50c3700 1 -- 172.21.15.156:0/3675496178 wait complete. 2023-09-30T22:20:21.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.300+0000 7f91c15d2700 1 -- 172.21.15.156:0/3964492645 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f91bc04f2a0 con 0x7f91bc131d70 2023-09-30T22:20:21.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.300+0000 7f91a37fe700 1 -- 172.21.15.156:0/3964492645 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f91b402b090 con 0x7f91bc131d70 2023-09-30T22:20:21.301 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:21.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.304+0000 7f91c15d2700 1 -- 172.21.15.156:0/3964492645 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f91bc131d70 msgr2=0x7f91bc1248c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:21.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.304+0000 7f91c15d2700 1 --2- 172.21.15.156:0/3964492645 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f91bc131d70 0x7f91bc1248c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f91b4009dd0 tx=0x7f91b400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.304+0000 7f91c15d2700 1 -- 172.21.15.156:0/3964492645 shutdown_connections 2023-09-30T22:20:21.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.304+0000 7f91c15d2700 1 --2- 172.21.15.156:0/3964492645 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f91bc131d70 0x7f91bc1248c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.304+0000 7f91c15d2700 1 --2- 172.21.15.156:0/3964492645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91bc09e870 0x7f91bc1ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.304+0000 7f91c15d2700 1 --2- 172.21.15.156:0/3964492645 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91bc09f180 0x7f91bc1cd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.304+0000 7f91c15d2700 1 -- 172.21.15.156:0/3964492645 >> 172.21.15.156:0/3964492645 conn(0x7f91bc0a4430 msgr2=0x7f91bc131080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:21.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.304+0000 7f91c15d2700 1 -- 172.21.15.156:0/3964492645 shutdown_connections 2023-09-30T22:20:21.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.304+0000 7f91c15d2700 1 -- 172.21.15.156:0/3964492645 wait complete. 2023-09-30T22:20:21.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.307+0000 7fab41415700 1 -- 172.21.15.156:0/2895440526 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fab3c04f2a0 con 0x7fab3c06a770 2023-09-30T22:20:21.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.307+0000 7fab237fe700 1 -- 172.21.15.156:0/2895440526 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab2c037030 con 0x7fab3c06a770 2023-09-30T22:20:21.308 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:21.311 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:21.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.310+0000 7fab41415700 1 -- 172.21.15.156:0/2895440526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab3c06a770 msgr2=0x7fab3c11e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:21.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.310+0000 7fab41415700 1 --2- 172.21.15.156:0/2895440526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab3c06a770 0x7fab3c11e4b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fab3c06c620 tx=0x7fab2c004750 comp rx=0 tx=0).stop 2023-09-30T22:20:21.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.310+0000 7fab41415700 1 -- 172.21.15.156:0/2895440526 shutdown_connections 2023-09-30T22:20:21.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.310+0000 7fab41415700 1 --2- 172.21.15.156:0/2895440526 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab3c131c00 0x7fab3c11ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.310+0000 7fab41415700 1 --2- 172.21.15.156:0/2895440526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab3c06a770 0x7fab3c11e4b0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.310+0000 7fab41415700 1 --2- 172.21.15.156:0/2895440526 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab3c06b080 0x7fab3c11e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:21.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.310+0000 7fab41415700 1 -- 172.21.15.156:0/2895440526 >> 172.21.15.156:0/2895440526 conn(0x7fab3c0a2ef0 msgr2=0x7fab3c0a1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:21.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.310+0000 7fab41415700 1 -- 172.21.15.156:0/2895440526 shutdown_connections 2023-09-30T22:20:21.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:21.310+0000 7fab41415700 1 -- 172.21.15.156:0/2895440526 wait complete. 2023-09-30T22:20:21.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:21.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:22.265 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:22.311 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:22.321 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:22.323 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:22.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.418+0000 7f3d40d93700 1 Processor -- start 2023-09-30T22:20:22.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.418+0000 7f3d40d93700 1 -- start start 2023-09-30T22:20:22.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.419+0000 7f3d40d93700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d3c138040 0x7f3d3c138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:22.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.419+0000 7f3d40d93700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d3c0a1400 0x7f3d3c13fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:22.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.419+0000 7f3d40d93700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d3c1379e0 con 0x7f3d3c0a08e0 2023-09-30T22:20:22.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.419+0000 7f3d40d93700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c0a2100 con 0x7f3d3c0a1400 2023-09-30T22:20:22.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.419+0000 7f3d40d93700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c138950 con 0x7f3d3c138040 2023-09-30T22:20:22.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.419+0000 7f3d3a59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d3c138040 0x7f3d3c138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:22.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.419+0000 7f3d3ad9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d3c0a1400 0x7f3d3c13fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:22.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.419+0000 7f3d3a59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d3c138040 0x7f3d3c138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33486/0 (socket says 172.21.15.156:33486) 2023-09-30T22:20:22.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.419+0000 7f3d3a59c700 1 -- 172.21.15.156:0/3570968036 learned_addr learned my addr 172.21.15.156:0/3570968036 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:22.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.420+0000 7f3d3ad9d700 1 -- 172.21.15.156:0/3570968036 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d3c138040 msgr2=0x7f3d3c138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:22.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.420+0000 7f3d3ad9d700 1 --2- 172.21.15.156:0/3570968036 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d3c138040 0x7f3d3c138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.420+0000 7f3d3ad9d700 1 -- 172.21.15.156:0/3570968036 >> v1:172.21.15.156:6789/0 conn(0x7f3d3c0a08e0 legacy=0x7f3d3c0a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:22.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.420+0000 7f3d3ad9d700 1 -- 172.21.15.156:0/3570968036 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3c09b9b0 con 0x7f3d3c0a1400 2023-09-30T22:20:22.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.420+0000 7f3d3ad9d700 1 --2- 172.21.15.156:0/3570968036 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d3c0a1400 0x7f3d3c13fd20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3d340098a0 tx=0x7f3d34009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3b3ac27e30b0115 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:22.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.420+0000 7f3d3959a700 1 -- 172.21.15.156:0/3570968036 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d34011830 con 0x7f3d3c0a1400 2023-09-30T22:20:22.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.420+0000 7f3d3959a700 1 -- 172.21.15.156:0/3570968036 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d34011990 con 0x7f3d3c0a1400 2023-09-30T22:20:22.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.420+0000 7f3d3959a700 1 -- 172.21.15.156:0/3570968036 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d34011d20 con 0x7f3d3c0a1400 2023-09-30T22:20:22.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.421+0000 7f3d40d93700 1 -- 172.21.15.156:0/3570968036 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d3c0a1400 msgr2=0x7f3d3c13fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:22.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.421+0000 7f3d40d93700 1 --2- 172.21.15.156:0/3570968036 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d3c0a1400 0x7f3d3c13fd20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3d340098a0 tx=0x7f3d34009bb0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.421+0000 7f3d40d93700 1 -- 172.21.15.156:0/3570968036 shutdown_connections 2023-09-30T22:20:22.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.421+0000 7f3d40d93700 1 --2- 172.21.15.156:0/3570968036 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d3c0a1400 0x7f3d3c13fd20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.421+0000 7f3d40d93700 1 --2- 172.21.15.156:0/3570968036 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d3c138040 0x7f3d3c138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.421+0000 7f3d40d93700 1 -- 172.21.15.156:0/3570968036 >> 172.21.15.156:0/3570968036 conn(0x7f3d3c0a2980 msgr2=0x7f3d3c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:22.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.421+0000 7f3d40d93700 1 -- 172.21.15.156:0/3570968036 shutdown_connections 2023-09-30T22:20:22.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.421+0000 7f3d40d93700 1 -- 172.21.15.156:0/3570968036 wait complete. 2023-09-30T22:20:22.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.422+0000 7f3d40d93700 1 Processor -- start 2023-09-30T22:20:22.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.423+0000 7f3d40d93700 1 -- start start 2023-09-30T22:20:22.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.423+0000 7f3d40d93700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d3c0a08e0 0x7f3d3c1263f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:22.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.423+0000 7f3d40d93700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d3c0a1400 0x7f3d3c126930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:22.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.423+0000 7f3d40d93700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d3c138040 0x7f3d3c126e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:22.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.423+0000 7f3d40d93700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c129c90 con 0x7f3d3c138040 2023-09-30T22:20:22.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.423+0000 7f3d40d93700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c129e90 con 0x7f3d3c0a1400 2023-09-30T22:20:22.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.423+0000 7f3d40d93700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c128020 con 0x7f3d3c0a08e0 2023-09-30T22:20:22.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.423+0000 7f3d39d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d3c0a1400 0x7f3d3c126930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:22.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.423+0000 7f3d3a59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d3c0a08e0 0x7f3d3c1263f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:22.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.423+0000 7f3d39d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d3c0a1400 0x7f3d3c126930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49062/0 (socket says 172.21.15.156:49062) 2023-09-30T22:20:22.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.423+0000 7f3d39d9b700 1 -- 172.21.15.156:0/216268275 learned_addr learned my addr 172.21.15.156:0/216268275 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:22.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.423+0000 7f3d3ad9d700 1 --2- 172.21.15.156:0/216268275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d3c138040 0x7f3d3c126e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:22.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.424+0000 7f3d39d9b700 1 -- 172.21.15.156:0/216268275 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d3c0a08e0 msgr2=0x7f3d3c1263f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:22.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.424+0000 7f3d39d9b700 1 --2- 172.21.15.156:0/216268275 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d3c0a08e0 0x7f3d3c1263f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.424+0000 7f3d39d9b700 1 -- 172.21.15.156:0/216268275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d3c138040 msgr2=0x7f3d3c126e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:22.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.424+0000 7f3d39d9b700 1 --2- 172.21.15.156:0/216268275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d3c138040 0x7f3d3c126e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.424+0000 7f3d39d9b700 1 -- 172.21.15.156:0/216268275 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d340094a0 con 0x7f3d3c0a1400 2023-09-30T22:20:22.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.424+0000 7f3d3ad9d700 1 --2- 172.21.15.156:0/216268275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d3c138040 0x7f3d3c126e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:22.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.424+0000 7f3d3a59c700 1 --2- 172.21.15.156:0/216268275 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d3c0a08e0 0x7f3d3c1263f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:20:22.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.424+0000 7f3d39d9b700 1 --2- 172.21.15.156:0/216268275 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d3c0a1400 0x7f3d3c126930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3d3000c420 tx=0x7f3d3000c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:22.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.424+0000 7f3d2affd700 1 -- 172.21.15.156:0/216268275 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d300052d0 con 0x7f3d3c0a1400 2023-09-30T22:20:22.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.424+0000 7f3d2affd700 1 -- 172.21.15.156:0/216268275 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d30005430 con 0x7f3d3c0a1400 2023-09-30T22:20:22.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.424+0000 7f3d2affd700 1 -- 172.21.15.156:0/216268275 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d300038c0 con 0x7f3d3c0a1400 2023-09-30T22:20:22.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.424+0000 7f3d40d93700 1 -- 172.21.15.156:0/216268275 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d3c09a240 con 0x7f3d3c0a1400 2023-09-30T22:20:22.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.425+0000 7f3d40d93700 1 -- 172.21.15.156:0/216268275 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d3c1298f0 con 0x7f3d3c0a1400 2023-09-30T22:20:22.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.426+0000 7f3d40d93700 1 -- 172.21.15.156:0/216268275 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d3c137770 con 0x7f3d3c0a1400 2023-09-30T22:20:22.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.426+0000 7f3d2affd700 1 -- 172.21.15.156:0/216268275 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3d30003a20 con 0x7f3d3c0a1400 2023-09-30T22:20:22.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.427+0000 7f3d2affd700 1 -- 172.21.15.156:0/216268275 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3d3003ef00 con 0x7f3d3c0a1400 2023-09-30T22:20:22.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.431+0000 7f3d2affd700 1 -- 172.21.15.156:0/216268275 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d30018260 con 0x7f3d3c0a1400 2023-09-30T22:20:22.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.455+0000 7f0f787b4700 1 Processor -- start 2023-09-30T22:20:22.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.455+0000 7f0f787b4700 1 -- start start 2023-09-30T22:20:22.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.455+0000 7f0f787b4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0f70133ad0 0x7f0f70133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:22.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.455+0000 7f0f787b4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f701300a0 0x7f0f701304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:22.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.455+0000 7f0f787b4700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f7006b2d0 con 0x7f0f701309f0 2023-09-30T22:20:22.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.455+0000 7f0f787b4700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f70133610 con 0x7f0f70133ad0 2023-09-30T22:20:22.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.455+0000 7f0f787b4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7009a500 con 0x7f0f701300a0 2023-09-30T22:20:22.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.456+0000 7f0f76550700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0f70133ad0 0x7f0f70133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:22.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.456+0000 7f0f76550700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0f70133ad0 0x7f0f70133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:56806/0 (socket says 172.21.15.156:56806) 2023-09-30T22:20:22.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.456+0000 7f0f76550700 1 -- 172.21.15.156:0/2621662596 learned_addr learned my addr 172.21.15.156:0/2621662596 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:22.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.456+0000 7f0f76d51700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f0f701309f0 0x7f0f7013a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:34450/0 (socket says 172.21.15.156:34450) 2023-09-30T22:20:22.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.456+0000 7f0f75d4f700 1 --2- 172.21.15.156:0/2621662596 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f701300a0 0x7f0f701304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:22.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.456+0000 7f0f76550700 1 -- 172.21.15.156:0/2621662596 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f701300a0 msgr2=0x7f0f701304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:22.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.456+0000 7f0f76550700 1 --2- 172.21.15.156:0/2621662596 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f701300a0 0x7f0f701304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.456+0000 7f0f76550700 1 -- 172.21.15.156:0/2621662596 >> v1:172.21.15.156:6789/0 conn(0x7f0f701309f0 legacy=0x7f0f7013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:22.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.456+0000 7f0f76550700 1 -- 172.21.15.156:0/2621662596 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f701338b0 con 0x7f0f70133ad0 2023-09-30T22:20:22.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.456+0000 7f0f76550700 1 --2- 172.21.15.156:0/2621662596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f70133ad0 0x7f0f70133ea0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c0098f0 tx=0x7f0f6c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978effce7c3f0432 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:22.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.456+0000 7f0f7554e700 1 -- 172.21.15.156:0/2621662596 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c011830 con 0x7f0f70133ad0 2023-09-30T22:20:22.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.456+0000 7f0f7554e700 1 -- 172.21.15.156:0/2621662596 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6c011990 con 0x7f0f70133ad0 2023-09-30T22:20:22.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.456+0000 7f0f7554e700 1 -- 172.21.15.156:0/2621662596 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c011d20 con 0x7f0f70133ad0 2023-09-30T22:20:22.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.457+0000 7f0f787b4700 1 -- 172.21.15.156:0/2621662596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f70133ad0 msgr2=0x7f0f70133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:22.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.457+0000 7f0f787b4700 1 --2- 172.21.15.156:0/2621662596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f70133ad0 0x7f0f70133ea0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c0098f0 tx=0x7f0f6c009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:22.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.457+0000 7f0f787b4700 1 -- 172.21.15.156:0/2621662596 shutdown_connections 2023-09-30T22:20:22.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.457+0000 7f0f787b4700 1 --2- 172.21.15.156:0/2621662596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f70133ad0 0x7f0f70133ea0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.457+0000 7f0f787b4700 1 --2- 172.21.15.156:0/2621662596 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f701300a0 0x7f0f701304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.457+0000 7f0f787b4700 1 -- 172.21.15.156:0/2621662596 >> 172.21.15.156:0/2621662596 conn(0x7f0f70099c40 msgr2=0x7f0f700a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:22.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.457+0000 7f0f787b4700 1 -- 172.21.15.156:0/2621662596 shutdown_connections 2023-09-30T22:20:22.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.457+0000 7f0f787b4700 1 -- 172.21.15.156:0/2621662596 wait complete. 2023-09-30T22:20:22.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.458+0000 7f0f787b4700 1 Processor -- start 2023-09-30T22:20:22.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.458+0000 7f0f787b4700 1 -- start start 2023-09-30T22:20:22.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.459+0000 7f0f787b4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f701300a0 0x7f0f7011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:22.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.459+0000 7f0f787b4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f701309f0 0x7f0f7011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:22.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.459+0000 7f0f787b4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f70133ad0 0x7f0f7011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:22.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.459+0000 7f0f787b4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f70120c20 con 0x7f0f70133ad0 2023-09-30T22:20:22.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.459+0000 7f0f787b4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7011ebe0 con 0x7f0f701309f0 2023-09-30T22:20:22.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.459+0000 7f0f787b4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f70120220 con 0x7f0f701300a0 2023-09-30T22:20:22.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.459+0000 7f0f76d51700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f70133ad0 0x7f0f7011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:22.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.459+0000 7f0f76d51700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f70133ad0 0x7f0f7011e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:56820/0 (socket says 172.21.15.156:56820) 2023-09-30T22:20:22.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.459+0000 7f0f76d51700 1 -- 172.21.15.156:0/2155247450 learned_addr learned my addr 172.21.15.156:0/2155247450 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:22.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.459+0000 7f0f76550700 1 --2- 172.21.15.156:0/2155247450 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f701300a0 0x7f0f7011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:22.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.459+0000 7f0f75d4f700 1 --2- 172.21.15.156:0/2155247450 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f701309f0 0x7f0f7011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:22.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.459+0000 7f0f76d51700 1 -- 172.21.15.156:0/2155247450 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f701300a0 msgr2=0x7f0f7011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:22.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.459+0000 7f0f76d51700 1 --2- 172.21.15.156:0/2155247450 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f701300a0 0x7f0f7011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.459+0000 7f0f76d51700 1 -- 172.21.15.156:0/2155247450 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f701309f0 msgr2=0x7f0f7011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:22.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.459+0000 7f0f76d51700 1 --2- 172.21.15.156:0/2155247450 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f701309f0 0x7f0f7011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.459+0000 7f0f76d51700 1 -- 172.21.15.156:0/2155247450 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6c009550 con 0x7f0f70133ad0 2023-09-30T22:20:22.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.460+0000 7f0f76d51700 1 --2- 172.21.15.156:0/2155247450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f70133ad0 0x7f0f7011e4c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0f6800cbf0 tx=0x7f0f6800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:22.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.460+0000 7f0f66ffd700 1 -- 172.21.15.156:0/2155247450 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6800aa60 con 0x7f0f70133ad0 2023-09-30T22:20:22.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.460+0000 7f0f66ffd700 1 -- 172.21.15.156:0/2155247450 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6800abc0 con 0x7f0f70133ad0 2023-09-30T22:20:22.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.460+0000 7f0f787b4700 1 -- 172.21.15.156:0/2155247450 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f70072200 con 0x7f0f70133ad0 2023-09-30T22:20:22.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.460+0000 7f0f66ffd700 1 -- 172.21.15.156:0/2155247450 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f68007070 con 0x7f0f70133ad0 2023-09-30T22:20:22.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.460+0000 7f0f787b4700 1 -- 172.21.15.156:0/2155247450 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f7012d220 con 0x7f0f70133ad0 2023-09-30T22:20:22.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.461+0000 7f0f66ffd700 1 -- 172.21.15.156:0/2155247450 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f680071d0 con 0x7f0f70133ad0 2023-09-30T22:20:22.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.461+0000 7f0f66ffd700 1 -- 172.21.15.156:0/2155247450 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0f6803f350 con 0x7f0f70133ad0 2023-09-30T22:20:22.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.461+0000 7f0f787b4700 1 -- 172.21.15.156:0/2155247450 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f7011fbe0 con 0x7f0f70133ad0 2023-09-30T22:20:22.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.466+0000 7f0f66ffd700 1 -- 172.21.15.156:0/2155247450 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f68017020 con 0x7f0f70133ad0 2023-09-30T22:20:22.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.494+0000 7f7ab6d7f700 1 Processor -- start 2023-09-30T22:20:22.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.494+0000 7f7ab6d7f700 1 -- start start 2023-09-30T22:20:22.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.494+0000 7f7ab6d7f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7ab0099e20 0x7f7ab009a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:22.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.494+0000 7f7ab6d7f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ab009a730 0x7f7ab0130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:22.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.494+0000 7f7ab6d7f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7ab0130890 0x7f7ab0130d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:22.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.494+0000 7f7ab6d7f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab009bf50 con 0x7f7ab0130890 2023-09-30T22:20:22.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.494+0000 7f7ab6d7f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab0099a60 con 0x7f7ab009a730 2023-09-30T22:20:22.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.494+0000 7f7ab6d7f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab009b230 con 0x7f7ab0099e20 2023-09-30T22:20:22.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.495+0000 7f7ab4b1b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7ab0099e20 0x7f7ab009a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:22.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.495+0000 7f7ab4b1b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7ab0099e20 0x7f7ab009a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33520/0 (socket says 172.21.15.156:33520) 2023-09-30T22:20:22.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.495+0000 7f7ab4b1b700 1 -- 172.21.15.156:0/2510008037 learned_addr learned my addr 172.21.15.156:0/2510008037 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:22.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.495+0000 7f7aaffff700 1 --2- 172.21.15.156:0/2510008037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ab009a730 0x7f7ab0130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:22.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.495+0000 7f7ab531c700 1 --2- 172.21.15.156:0/2510008037 >> v2:172.21.15.156:3300/0 conn(0x7f7ab0130890 0x7f7ab0130d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:22.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.495+0000 7f7aaffff700 1 -- 172.21.15.156:0/2510008037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7ab0099e20 msgr2=0x7f7ab009a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:22.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.495+0000 7f7aaffff700 1 --2- 172.21.15.156:0/2510008037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7ab0099e20 0x7f7ab009a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.495+0000 7f7aaffff700 1 -- 172.21.15.156:0/2510008037 >> v2:172.21.15.156:3300/0 conn(0x7f7ab0130890 msgr2=0x7f7ab0130d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:22.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.495+0000 7f7aaffff700 1 --2- 172.21.15.156:0/2510008037 >> v2:172.21.15.156:3300/0 conn(0x7f7ab0130890 0x7f7ab0130d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.495+0000 7f7aaffff700 1 -- 172.21.15.156:0/2510008037 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab009bb90 con 0x7f7ab009a730 2023-09-30T22:20:22.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.495+0000 7f7ab4b1b700 1 --2- 172.21.15.156:0/2510008037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7ab0099e20 0x7f7ab009a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:22.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.495+0000 7f7ab531c700 1 --2- 172.21.15.156:0/2510008037 >> v2:172.21.15.156:3300/0 conn(0x7f7ab0130890 0x7f7ab0130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:22.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.495+0000 7f7aaffff700 1 --2- 172.21.15.156:0/2510008037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ab009a730 0x7f7ab0130350 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c009840 tx=0x7f7a9c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58d053f4c7300585 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:22.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.495+0000 7f7aaf7fe700 1 -- 172.21.15.156:0/2510008037 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c00f8a0 con 0x7f7ab009a730 2023-09-30T22:20:22.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.495+0000 7f7aaf7fe700 1 -- 172.21.15.156:0/2510008037 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9c00fa00 con 0x7f7ab009a730 2023-09-30T22:20:22.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.495+0000 7f7aaf7fe700 1 -- 172.21.15.156:0/2510008037 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c00fd90 con 0x7f7ab009a730 2023-09-30T22:20:22.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.496+0000 7f7ab6d7f700 1 -- 172.21.15.156:0/2510008037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ab009a730 msgr2=0x7f7ab0130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:22.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.496+0000 7f7ab6d7f700 1 --2- 172.21.15.156:0/2510008037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ab009a730 0x7f7ab0130350 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c009840 tx=0x7f7a9c009b50 comp rx=0 tx=0).stop 2023-09-30T22:20:22.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.496+0000 7f7ab6d7f700 1 -- 172.21.15.156:0/2510008037 shutdown_connections 2023-09-30T22:20:22.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.496+0000 7f7ab6d7f700 1 --2- 172.21.15.156:0/2510008037 >> v2:172.21.15.156:3300/0 conn(0x7f7ab0130890 0x7f7ab0130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.496+0000 7f7ab6d7f700 1 --2- 172.21.15.156:0/2510008037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7ab0099e20 0x7f7ab009a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.496+0000 7f7ab6d7f700 1 --2- 172.21.15.156:0/2510008037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ab009a730 0x7f7ab0130350 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.496+0000 7f7ab6d7f700 1 -- 172.21.15.156:0/2510008037 >> 172.21.15.156:0/2510008037 conn(0x7f7ab00a2980 msgr2=0x7f7ab00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:22.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.496+0000 7f7ab6d7f700 1 -- 172.21.15.156:0/2510008037 shutdown_connections 2023-09-30T22:20:22.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.496+0000 7f7ab6d7f700 1 -- 172.21.15.156:0/2510008037 wait complete. 2023-09-30T22:20:22.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.497+0000 7f7ab6d7f700 1 Processor -- start 2023-09-30T22:20:22.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.497+0000 7f7ab6d7f700 1 -- start start 2023-09-30T22:20:22.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.498+0000 7f7ab6d7f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ab0099e20 0x7f7ab011eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:22.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.498+0000 7f7ab6d7f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ab009a730 0x7f7ab011f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:22.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.498+0000 7f7ab6d7f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7ab0130890 0x7f7ab011f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:22.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.498+0000 7f7ab6d7f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab011ff80 con 0x7f7ab0099e20 2023-09-30T22:20:22.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.498+0000 7f7ab6d7f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab0120710 con 0x7f7ab009a730 2023-09-30T22:20:22.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.498+0000 7f7ab6d7f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab0122080 con 0x7f7ab0130890 2023-09-30T22:20:22.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.498+0000 7f7ab531c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7ab0130890 0x7f7ab011f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:22.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.498+0000 7f7aaffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ab009a730 0x7f7ab011f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:22.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.498+0000 7f7ab531c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7ab0130890 0x7f7ab011f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33526/0 (socket says 172.21.15.156:33526) 2023-09-30T22:20:22.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.498+0000 7f7aaffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ab009a730 0x7f7ab011f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49090/0 (socket says 172.21.15.156:49090) 2023-09-30T22:20:22.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.499+0000 7f7ab531c700 1 -- 172.21.15.156:0/54677442 learned_addr learned my addr 172.21.15.156:0/54677442 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:22.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.499+0000 7f7ab4b1b700 1 --2- 172.21.15.156:0/54677442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ab0099e20 0x7f7ab011eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:22.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.499+0000 7f7aaffff700 1 -- 172.21.15.156:0/54677442 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7ab0130890 msgr2=0x7f7ab011f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:22.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.499+0000 7f7aaffff700 1 --2- 172.21.15.156:0/54677442 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7ab0130890 0x7f7ab011f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.499+0000 7f7aaffff700 1 -- 172.21.15.156:0/54677442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ab0099e20 msgr2=0x7f7ab011eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:22.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.499+0000 7f7aaffff700 1 --2- 172.21.15.156:0/54677442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ab0099e20 0x7f7ab011eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.499+0000 7f7aaffff700 1 -- 172.21.15.156:0/54677442 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa4009500 con 0x7f7ab009a730 2023-09-30T22:20:22.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.499+0000 7f7aaffff700 1 --2- 172.21.15.156:0/54677442 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ab009a730 0x7f7ab011f060 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00721d0 tx=0x7f7a9c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:22.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.499+0000 7f7aad7fa700 1 -- 172.21.15.156:0/54677442 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c0038a0 con 0x7f7ab009a730 2023-09-30T22:20:22.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.499+0000 7f7aad7fa700 1 -- 172.21.15.156:0/54677442 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9c003a20 con 0x7f7ab009a730 2023-09-30T22:20:22.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.499+0000 7f7ab6d7f700 1 -- 172.21.15.156:0/54677442 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa8009a70 con 0x7f7ab009a730 2023-09-30T22:20:22.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.499+0000 7f7aad7fa700 1 -- 172.21.15.156:0/54677442 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c003dd0 con 0x7f7ab009a730 2023-09-30T22:20:22.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.499+0000 7f7ab6d7f700 1 -- 172.21.15.156:0/54677442 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a9c0094a0 con 0x7f7ab009a730 2023-09-30T22:20:22.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.500+0000 7f7aad7fa700 1 -- 172.21.15.156:0/54677442 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7a9c02c430 con 0x7f7ab009a730 2023-09-30T22:20:22.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.500+0000 7f7aad7fa700 1 -- 172.21.15.156:0/54677442 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7a9c0407f0 con 0x7f7ab009a730 2023-09-30T22:20:22.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.500+0000 7f7ab6d7f700 1 -- 172.21.15.156:0/54677442 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab00a1290 con 0x7f7ab009a730 2023-09-30T22:20:22.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.505+0000 7f7aad7fa700 1 -- 172.21.15.156:0/54677442 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7a9c0178f0 con 0x7f7ab009a730 2023-09-30T22:20:22.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.521+0000 7f7860bc8700 1 Processor -- start 2023-09-30T22:20:22.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.521+0000 7f7860bc8700 1 -- start start 2023-09-30T22:20:22.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.522+0000 7f7860bc8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f785c09e870 0x7f785c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:22.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.522+0000 7f7860bc8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f785c131f20 0x7f785c139ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:22.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.522+0000 7f7860bc8700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f785c09b6a0 con 0x7f785c09f180 2023-09-30T22:20:22.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.522+0000 7f7860bc8700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f785c09ad60 con 0x7f785c131f20 2023-09-30T22:20:22.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.522+0000 7f7860bc8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785c0a0650 con 0x7f785c09e870 2023-09-30T22:20:22.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.523+0000 7f785ad9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f785c131f20 0x7f785c139ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:22.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.523+0000 7f785ad9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f785c131f20 0x7f785c139ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:56842/0 (socket says 172.21.15.156:56842) 2023-09-30T22:20:22.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.523+0000 7f785ad9d700 1 -- 172.21.15.156:0/263449114 learned_addr learned my addr 172.21.15.156:0/263449114 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:22.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.523+0000 7f785a59c700 1 --2- 172.21.15.156:0/263449114 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f785c09e870 0x7f785c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:22.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.523+0000 7f785959a700 1 -- 172.21.15.156:0/263449114 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944224726 0 0) 0x7f785c09b6a0 con 0x7f785c09f180 2023-09-30T22:20:22.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.523+0000 7f785ad9d700 1 -- 172.21.15.156:0/263449114 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f785c09e870 msgr2=0x7f785c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:22.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.523+0000 7f785ad9d700 1 --2- 172.21.15.156:0/263449114 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f785c09e870 0x7f785c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.523+0000 7f785ad9d700 1 -- 172.21.15.156:0/263449114 >> v1:172.21.15.156:6789/0 conn(0x7f785c09f180 legacy=0x7f785c131810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:22.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.523+0000 7f785ad9d700 1 -- 172.21.15.156:0/263449114 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785c09f9f0 con 0x7f785c131f20 2023-09-30T22:20:22.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.524+0000 7f785ad9d700 1 --2- 172.21.15.156:0/263449114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f785c131f20 0x7f785c139ae0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7854009e50 tx=0x7f785400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=535184aecc7743a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:22.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.524+0000 7f785959a700 1 -- 172.21.15.156:0/263449114 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785400e070 con 0x7f785c131f20 2023-09-30T22:20:22.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.524+0000 7f785959a700 1 -- 172.21.15.156:0/263449114 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785400b9c0 con 0x7f785c131f20 2023-09-30T22:20:22.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.524+0000 7f785959a700 1 -- 172.21.15.156:0/263449114 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785400bd50 con 0x7f785c131f20 2023-09-30T22:20:22.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.525+0000 7f7860bc8700 1 -- 172.21.15.156:0/263449114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f785c131f20 msgr2=0x7f785c139ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:22.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.525+0000 7f7860bc8700 1 --2- 172.21.15.156:0/263449114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f785c131f20 0x7f785c139ae0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7854009e50 tx=0x7f785400b330 comp rx=0 tx=0).stop 2023-09-30T22:20:22.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.525+0000 7f7860bc8700 1 -- 172.21.15.156:0/263449114 shutdown_connections 2023-09-30T22:20:22.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.525+0000 7f7860bc8700 1 --2- 172.21.15.156:0/263449114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f785c131f20 0x7f785c139ae0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.525+0000 7f7860bc8700 1 --2- 172.21.15.156:0/263449114 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f785c09e870 0x7f785c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.525+0000 7f7860bc8700 1 -- 172.21.15.156:0/263449114 >> 172.21.15.156:0/263449114 conn(0x7f785c0a4150 msgr2=0x7f785c0a4550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:22.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.525+0000 7f7860bc8700 1 -- 172.21.15.156:0/263449114 shutdown_connections 2023-09-30T22:20:22.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.525+0000 7f7860bc8700 1 -- 172.21.15.156:0/263449114 wait complete. 2023-09-30T22:20:22.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.526+0000 7f7860bc8700 1 Processor -- start 2023-09-30T22:20:22.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.526+0000 7f7860bc8700 1 -- start start 2023-09-30T22:20:22.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.527+0000 7f7860bc8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f785c09e870 0x7f785c1271e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:22.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.527+0000 7f7860bc8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f785c09f180 0x7f785c127720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:22.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.527+0000 7f7860bc8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f785c131f20 0x7f785c127c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:22.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.527+0000 7f7860bc8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785c129c60 con 0x7f785c131f20 2023-09-30T22:20:22.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.527+0000 7f7860bc8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785c12a2e0 con 0x7f785c09e870 2023-09-30T22:20:22.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.527+0000 7f7860bc8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f785c09d820 con 0x7f785c09f180 2023-09-30T22:20:22.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.527+0000 7f785a59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f785c09e870 0x7f785c1271e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:22.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.527+0000 7f785a59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f785c09e870 0x7f785c1271e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49106/0 (socket says 172.21.15.156:49106) 2023-09-30T22:20:22.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.527+0000 7f785a59c700 1 -- 172.21.15.156:0/2383519635 learned_addr learned my addr 172.21.15.156:0/2383519635 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:22.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.527+0000 7f785ad9d700 1 --2- 172.21.15.156:0/2383519635 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f785c131f20 0x7f785c127c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:22.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.528+0000 7f785ad9d700 1 -- 172.21.15.156:0/2383519635 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f785c09f180 msgr2=0x7f785c127720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:22.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.528+0000 7f7859d9b700 1 --2- 172.21.15.156:0/2383519635 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f785c09f180 0x7f785c127720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:22.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.528+0000 7f785ad9d700 1 --2- 172.21.15.156:0/2383519635 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f785c09f180 0x7f785c127720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.528+0000 7f785ad9d700 1 -- 172.21.15.156:0/2383519635 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f785c09e870 msgr2=0x7f785c1271e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:22.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.528+0000 7f785ad9d700 1 --2- 172.21.15.156:0/2383519635 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f785c09e870 0x7f785c1271e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.528+0000 7f785ad9d700 1 -- 172.21.15.156:0/2383519635 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7854009b30 con 0x7f785c131f20 2023-09-30T22:20:22.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.528+0000 7f7859d9b700 1 --2- 172.21.15.156:0/2383519635 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f785c09f180 0x7f785c127720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:20:22.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.528+0000 7f785a59c700 1 --2- 172.21.15.156:0/2383519635 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f785c09e870 0x7f785c1271e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:22.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.528+0000 7f785ad9d700 1 --2- 172.21.15.156:0/2383519635 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f785c131f20 0x7f785c127c60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7854015000 tx=0x7f7854004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:22.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.528+0000 7f784affd700 1 -- 172.21.15.156:0/2383519635 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78540092e0 con 0x7f785c131f20 2023-09-30T22:20:22.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.528+0000 7f7860bc8700 1 -- 172.21.15.156:0/2383519635 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f785c0a0070 con 0x7f785c131f20 2023-09-30T22:20:22.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.528+0000 7f784affd700 1 -- 172.21.15.156:0/2383519635 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7854004250 con 0x7f785c131f20 2023-09-30T22:20:22.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.528+0000 7f784affd700 1 -- 172.21.15.156:0/2383519635 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7854004600 con 0x7f785c131f20 2023-09-30T22:20:22.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.529+0000 7f7860bc8700 1 -- 172.21.15.156:0/2383519635 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f785c11ded0 con 0x7f785c131f20 2023-09-30T22:20:22.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.529+0000 7f784affd700 1 -- 172.21.15.156:0/2383519635 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7854004760 con 0x7f785c131f20 2023-09-30T22:20:22.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.529+0000 7f784affd700 1 -- 172.21.15.156:0/2383519635 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7854040aa0 con 0x7f785c131f20 2023-09-30T22:20:22.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.530+0000 7f7860bc8700 1 -- 172.21.15.156:0/2383519635 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f785c04f2a0 con 0x7f785c131f20 2023-09-30T22:20:22.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.539+0000 7f784affd700 1 -- 172.21.15.156:0/2383519635 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f785403ee60 con 0x7f785c131f20 2023-09-30T22:20:22.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.668+0000 7f0f787b4700 1 -- 172.21.15.156:0/2155247450 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0f7004f2a0 con 0x7f0f70133ad0 2023-09-30T22:20:22.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.668+0000 7f0f66ffd700 1 -- 172.21.15.156:0/2155247450 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f6801b3b0 con 0x7f0f70133ad0 2023-09-30T22:20:22.669 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:22.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.669+0000 7f3d40d93700 1 -- 172.21.15.156:0/216268275 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3d3c04f2a0 con 0x7f3d3c0a1400 2023-09-30T22:20:22.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.669+0000 7f3d2affd700 1 -- 172.21.15.156:0/216268275 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3d30017030 con 0x7f3d3c0a1400 2023-09-30T22:20:22.670 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:22.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.671+0000 7f0f787b4700 1 -- 172.21.15.156:0/2155247450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f70133ad0 msgr2=0x7f0f7011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:22.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.671+0000 7f0f787b4700 1 --2- 172.21.15.156:0/2155247450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f70133ad0 0x7f0f7011e4c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0f6800cbf0 tx=0x7f0f6800cf00 comp rx=0 tx=0).stop 2023-09-30T22:20:22.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.671+0000 7f0f787b4700 1 -- 172.21.15.156:0/2155247450 shutdown_connections 2023-09-30T22:20:22.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.671+0000 7f0f787b4700 1 --2- 172.21.15.156:0/2155247450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f70133ad0 0x7f0f7011e4c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.671+0000 7f0f787b4700 1 --2- 172.21.15.156:0/2155247450 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f701300a0 0x7f0f7011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.671+0000 7f0f787b4700 1 --2- 172.21.15.156:0/2155247450 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f701309f0 0x7f0f7011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.671+0000 7f0f787b4700 1 -- 172.21.15.156:0/2155247450 >> 172.21.15.156:0/2155247450 conn(0x7f0f70099c40 msgr2=0x7f0f70131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:22.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.671+0000 7f0f787b4700 1 -- 172.21.15.156:0/2155247450 shutdown_connections 2023-09-30T22:20:22.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.671+0000 7f0f787b4700 1 -- 172.21.15.156:0/2155247450 wait complete. 2023-09-30T22:20:22.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.672+0000 7f3d40d93700 1 -- 172.21.15.156:0/216268275 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d3c0a1400 msgr2=0x7f3d3c126930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:22.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.673+0000 7f3d40d93700 1 --2- 172.21.15.156:0/216268275 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d3c0a1400 0x7f3d3c126930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3d3000c420 tx=0x7f3d3000c730 comp rx=0 tx=0).stop 2023-09-30T22:20:22.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.673+0000 7f3d40d93700 1 -- 172.21.15.156:0/216268275 shutdown_connections 2023-09-30T22:20:22.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.673+0000 7f3d40d93700 1 --2- 172.21.15.156:0/216268275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d3c138040 0x7f3d3c126e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.673+0000 7f3d40d93700 1 --2- 172.21.15.156:0/216268275 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d3c0a08e0 0x7f3d3c1263f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.673+0000 7f3d40d93700 1 --2- 172.21.15.156:0/216268275 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d3c0a1400 0x7f3d3c126930 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.673+0000 7f3d40d93700 1 -- 172.21.15.156:0/216268275 >> 172.21.15.156:0/216268275 conn(0x7f3d3c0a2980 msgr2=0x7f3d3c09e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:22.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.673+0000 7f3d40d93700 1 -- 172.21.15.156:0/216268275 shutdown_connections 2023-09-30T22:20:22.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.673+0000 7f3d40d93700 1 -- 172.21.15.156:0/216268275 wait complete. 2023-09-30T22:20:22.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:22.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:22.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.732+0000 7f7ab6d7f700 1 -- 172.21.15.156:0/54677442 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7ab009b470 con 0x7f7ab009a730 2023-09-30T22:20:22.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.732+0000 7f7aad7fa700 1 -- 172.21.15.156:0/54677442 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7a9c0223a0 con 0x7f7ab009a730 2023-09-30T22:20:22.733 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:22.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.734+0000 7f7ab6d7f700 1 -- 172.21.15.156:0/54677442 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ab009a730 msgr2=0x7f7ab011f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:22.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.734+0000 7f7ab6d7f700 1 --2- 172.21.15.156:0/54677442 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ab009a730 0x7f7ab011f060 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00721d0 tx=0x7f7a9c004750 comp rx=0 tx=0).stop 2023-09-30T22:20:22.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.734+0000 7f7ab6d7f700 1 -- 172.21.15.156:0/54677442 shutdown_connections 2023-09-30T22:20:22.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.734+0000 7f7ab6d7f700 1 --2- 172.21.15.156:0/54677442 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7ab0130890 0x7f7ab011f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.734+0000 7f7ab6d7f700 1 --2- 172.21.15.156:0/54677442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ab0099e20 0x7f7ab011eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.734+0000 7f7ab6d7f700 1 --2- 172.21.15.156:0/54677442 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ab009a730 0x7f7ab011f060 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.734+0000 7f7ab6d7f700 1 -- 172.21.15.156:0/54677442 >> 172.21.15.156:0/54677442 conn(0x7f7ab00a2980 msgr2=0x7f7ab009fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:22.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.735+0000 7f7ab6d7f700 1 -- 172.21.15.156:0/54677442 shutdown_connections 2023-09-30T22:20:22.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.735+0000 7f7ab6d7f700 1 -- 172.21.15.156:0/54677442 wait complete. 2023-09-30T22:20:22.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:22.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.751+0000 7f7860bc8700 1 -- 172.21.15.156:0/2383519635 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f785c072840 con 0x7f785c131f20 2023-09-30T22:20:22.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.751+0000 7f784affd700 1 -- 172.21.15.156:0/2383519635 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7854020020 con 0x7f785c131f20 2023-09-30T22:20:22.752 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:22.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.753+0000 7f7860bc8700 1 -- 172.21.15.156:0/2383519635 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f785c131f20 msgr2=0x7f785c127c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:22.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.753+0000 7f7860bc8700 1 --2- 172.21.15.156:0/2383519635 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f785c131f20 0x7f785c127c60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7854015000 tx=0x7f7854004ad0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.753+0000 7f7860bc8700 1 -- 172.21.15.156:0/2383519635 shutdown_connections 2023-09-30T22:20:22.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.753+0000 7f7860bc8700 1 --2- 172.21.15.156:0/2383519635 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f785c131f20 0x7f785c127c60 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.753+0000 7f7860bc8700 1 --2- 172.21.15.156:0/2383519635 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f785c09e870 0x7f785c1271e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.753+0000 7f7860bc8700 1 --2- 172.21.15.156:0/2383519635 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f785c09f180 0x7f785c127720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:22.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.753+0000 7f7860bc8700 1 -- 172.21.15.156:0/2383519635 >> 172.21.15.156:0/2383519635 conn(0x7f785c0a4150 msgr2=0x7f785c09c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:22.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.753+0000 7f7860bc8700 1 -- 172.21.15.156:0/2383519635 shutdown_connections 2023-09-30T22:20:22.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:22.753+0000 7f7860bc8700 1 -- 172.21.15.156:0/2383519635 wait complete. 2023-09-30T22:20:22.766 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:23.686 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:23.693 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:23.748 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:23.767 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:23.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.832+0000 7f8bd7396700 1 Processor -- start 2023-09-30T22:20:23.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.832+0000 7f8bd7396700 1 -- start start 2023-09-30T22:20:23.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.833+0000 7f8bd7396700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd006a770 0x7f8bd006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:23.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.833+0000 7f8bd7396700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bd009dec0 0x7f8bd006b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:23.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.833+0000 7f8bd7396700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8bd0131a00 0x7f8bd0131e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:23.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.833+0000 7f8bd7396700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd006b5c0 con 0x7f8bd0131a00 2023-09-30T22:20:23.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.833+0000 7f8bd7396700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd006e900 con 0x7f8bd006a770 2023-09-30T22:20:23.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.833+0000 7f8bd7396700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd009d180 con 0x7f8bd009dec0 2023-09-30T22:20:23.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.833+0000 7f8bd5132700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd006a770 0x7f8bd006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:23.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.833+0000 7f8bd5933700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8bd0131a00 0x7f8bd0131e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:23.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.833+0000 7f8bd4931700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bd009dec0 0x7f8bd006b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:23.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.833+0000 7f8bd5132700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd006a770 0x7f8bd006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49116/0 (socket says 172.21.15.156:49116) 2023-09-30T22:20:23.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.833+0000 7f8bd5132700 1 -- 172.21.15.156:0/3038688026 learned_addr learned my addr 172.21.15.156:0/3038688026 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:23.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.834+0000 7f8bd5933700 1 -- 172.21.15.156:0/3038688026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bd009dec0 msgr2=0x7f8bd006b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:23.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.834+0000 7f8bd5933700 1 --2- 172.21.15.156:0/3038688026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bd009dec0 0x7f8bd006b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:23.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.834+0000 7f8bd5933700 1 -- 172.21.15.156:0/3038688026 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd006a770 msgr2=0x7f8bd006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:23.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.834+0000 7f8bd5933700 1 --2- 172.21.15.156:0/3038688026 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd006a770 0x7f8bd006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:23.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.834+0000 7f8bd5933700 1 -- 172.21.15.156:0/3038688026 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd009e780 con 0x7f8bd0131a00 2023-09-30T22:20:23.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.834+0000 7f8bd4931700 1 --2- 172.21.15.156:0/3038688026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bd009dec0 0x7f8bd006b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:23.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.834+0000 7f8bd5132700 1 --2- 172.21.15.156:0/3038688026 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd006a770 0x7f8bd006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:23.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.834+0000 7f8bd5933700 1 --2- 172.21.15.156:0/3038688026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bd0131a00 0x7f8bd0131e80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8009d90 tx=0x7f8bc800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39b7114d5cee26f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:23.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.834+0000 7f8bc7fff700 1 -- 172.21.15.156:0/3038688026 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc800bd20 con 0x7f8bd0131a00 2023-09-30T22:20:23.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.834+0000 7f8bc7fff700 1 -- 172.21.15.156:0/3038688026 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc800be80 con 0x7f8bd0131a00 2023-09-30T22:20:23.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.834+0000 7f8bc7fff700 1 -- 172.21.15.156:0/3038688026 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8010710 con 0x7f8bd0131a00 2023-09-30T22:20:23.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.835+0000 7f8bd7396700 1 -- 172.21.15.156:0/3038688026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bd0131a00 msgr2=0x7f8bd0131e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:23.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.835+0000 7f8bd7396700 1 --2- 172.21.15.156:0/3038688026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bd0131a00 0x7f8bd0131e80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8009d90 tx=0x7f8bc800b330 comp rx=0 tx=0).stop 2023-09-30T22:20:23.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.835+0000 7f8bd7396700 1 -- 172.21.15.156:0/3038688026 shutdown_connections 2023-09-30T22:20:23.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.835+0000 7f8bd7396700 1 --2- 172.21.15.156:0/3038688026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bd0131a00 0x7f8bd0131e80 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:23.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.835+0000 7f8bd7396700 1 --2- 172.21.15.156:0/3038688026 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd006a770 0x7f8bd006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:23.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.835+0000 7f8bd7396700 1 --2- 172.21.15.156:0/3038688026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bd009dec0 0x7f8bd006b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:23.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.835+0000 7f8bd7396700 1 -- 172.21.15.156:0/3038688026 >> 172.21.15.156:0/3038688026 conn(0x7f8bd0099c40 msgr2=0x7f8bd00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:23.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.835+0000 7f8bd7396700 1 -- 172.21.15.156:0/3038688026 shutdown_connections 2023-09-30T22:20:23.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.835+0000 7f8bd7396700 1 -- 172.21.15.156:0/3038688026 wait complete. 2023-09-30T22:20:23.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.836+0000 7f8bd7396700 1 Processor -- start 2023-09-30T22:20:23.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.836+0000 7f8bd7396700 1 -- start start 2023-09-30T22:20:23.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.837+0000 7f8bd7396700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bd006a770 0x7f8bd011a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:23.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.837+0000 7f8bd7396700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bd009dec0 0x7f8bd011a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:23.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.837+0000 7f8bd7396700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd0131a00 0x7f8bd011abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:23.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.837+0000 7f8bd7396700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd011da00 con 0x7f8bd009dec0 2023-09-30T22:20:23.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.837+0000 7f8bd7396700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd0071ce0 con 0x7f8bd0131a00 2023-09-30T22:20:23.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.837+0000 7f8bd7396700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd011bd20 con 0x7f8bd006a770 2023-09-30T22:20:23.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.837+0000 7f8bd5132700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bd006a770 0x7f8bd011a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:23.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.837+0000 7f8bd5132700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bd006a770 0x7f8bd011a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33544/0 (socket says 172.21.15.156:33544) 2023-09-30T22:20:23.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.837+0000 7f8bd5132700 1 -- 172.21.15.156:0/4247613741 learned_addr learned my addr 172.21.15.156:0/4247613741 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:23.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.837+0000 7f8bd5933700 1 --2- 172.21.15.156:0/4247613741 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd0131a00 0x7f8bd011abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:23.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.837+0000 7f8bd4931700 1 --2- 172.21.15.156:0/4247613741 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bd009dec0 0x7f8bd011a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:23.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.838+0000 7f8bd5933700 1 -- 172.21.15.156:0/4247613741 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bd006a770 msgr2=0x7f8bd011a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:23.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.838+0000 7f8bd5933700 1 --2- 172.21.15.156:0/4247613741 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bd006a770 0x7f8bd011a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:23.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.838+0000 7f8bd5933700 1 -- 172.21.15.156:0/4247613741 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bd009dec0 msgr2=0x7f8bd011a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:23.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.838+0000 7f8bd5933700 1 --2- 172.21.15.156:0/4247613741 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bd009dec0 0x7f8bd011a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:23.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.838+0000 7f8bd5933700 1 -- 172.21.15.156:0/4247613741 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bcc009550 con 0x7f8bd0131a00 2023-09-30T22:20:23.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.838+0000 7f8bd4931700 1 --2- 172.21.15.156:0/4247613741 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bd009dec0 0x7f8bd011a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:23.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.838+0000 7f8bd5933700 1 --2- 172.21.15.156:0/4247613741 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd0131a00 0x7f8bd011abe0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8bd009f140 tx=0x7f8bc8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:23.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.838+0000 7f8bc5ffb700 1 -- 172.21.15.156:0/4247613741 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8004800 con 0x7f8bd0131a00 2023-09-30T22:20:23.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.838+0000 7f8bd7396700 1 -- 172.21.15.156:0/4247613741 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc00094a0 con 0x7f8bd0131a00 2023-09-30T22:20:23.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.838+0000 7f8bc5ffb700 1 -- 172.21.15.156:0/4247613741 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc8003e30 con 0x7f8bd0131a00 2023-09-30T22:20:23.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.838+0000 7f8bc5ffb700 1 -- 172.21.15.156:0/4247613741 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8010710 con 0x7f8bd0131a00 2023-09-30T22:20:23.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.839+0000 7f8bd7396700 1 -- 172.21.15.156:0/4247613741 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc8009a70 con 0x7f8bd0131a00 2023-09-30T22:20:23.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.840+0000 7f8bc5ffb700 1 -- 172.21.15.156:0/4247613741 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8bc8010870 con 0x7f8bd0131a00 2023-09-30T22:20:23.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.840+0000 7f8bc5ffb700 1 -- 172.21.15.156:0/4247613741 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8bc80451b0 con 0x7f8bd0131a00 2023-09-30T22:20:23.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.840+0000 7f8bd7396700 1 -- 172.21.15.156:0/4247613741 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd011d690 con 0x7f8bd0131a00 2023-09-30T22:20:23.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.849+0000 7f8bc5ffb700 1 -- 172.21.15.156:0/4247613741 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8bc801d070 con 0x7f8bd0131a00 2023-09-30T22:20:23.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.873+0000 7fc3c50a1700 1 Processor -- start 2023-09-30T22:20:23.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.873+0000 7fc3c50a1700 1 -- start start 2023-09-30T22:20:23.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.874+0000 7fc3c50a1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3c009f350 0x7fc3c0136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:23.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.874+0000 7fc3c50a1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3c01371c0 0x7fc3c01395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:23.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.874+0000 7fc3c50a1700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c009c970 con 0x7fc3c009e870 2023-09-30T22:20:23.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.874+0000 7fc3c50a1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c00a0920 con 0x7fc3c009f350 2023-09-30T22:20:23.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.874+0000 7fc3c50a1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c009f9c0 con 0x7fc3c01371c0 2023-09-30T22:20:23.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.874+0000 7fc3be59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3c009f350 0x7fc3c0136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:23.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.874+0000 7fc3be59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3c009f350 0x7fc3c0136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49142/0 (socket says 172.21.15.156:49142) 2023-09-30T22:20:23.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.874+0000 7fc3bed9d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc3c009e870 0x7fc3c009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:34458/0 (socket says 172.21.15.156:34458) 2023-09-30T22:20:23.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.874+0000 7fc3be59c700 1 -- 172.21.15.156:0/3624066007 learned_addr learned my addr 172.21.15.156:0/3624066007 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:23.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.874+0000 7fc3bf59e700 1 --2- 172.21.15.156:0/3624066007 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3c01371c0 0x7fc3c01395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:23.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.874+0000 7fc3bf59e700 1 -- 172.21.15.156:0/3624066007 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3c009f350 msgr2=0x7fc3c0136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:23.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.874+0000 7fc3bf59e700 1 --2- 172.21.15.156:0/3624066007 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3c009f350 0x7fc3c0136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:23.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.874+0000 7fc3bf59e700 1 -- 172.21.15.156:0/3624066007 >> v1:172.21.15.156:6789/0 conn(0x7fc3c009e870 legacy=0x7fc3c009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:23.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.874+0000 7fc3bf59e700 1 -- 172.21.15.156:0/3624066007 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c009bab0 con 0x7fc3c01371c0 2023-09-30T22:20:23.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.874+0000 7fc3bf59e700 1 --2- 172.21.15.156:0/3624066007 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3c01371c0 0x7fc3c01395a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009dc0 tx=0x7fc3b800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf2794c302939aa2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:23.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.875+0000 7fc3bdd9b700 1 -- 172.21.15.156:0/3624066007 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b800e070 con 0x7fc3c01371c0 2023-09-30T22:20:23.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.875+0000 7fc3bdd9b700 1 -- 172.21.15.156:0/3624066007 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b800bb20 con 0x7fc3c01371c0 2023-09-30T22:20:23.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.875+0000 7fc3bdd9b700 1 -- 172.21.15.156:0/3624066007 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8012430 con 0x7fc3c01371c0 2023-09-30T22:20:23.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.875+0000 7fc3c50a1700 1 -- 172.21.15.156:0/3624066007 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3c01371c0 msgr2=0x7fc3c01395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:23.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.875+0000 7fc3c50a1700 1 --2- 172.21.15.156:0/3624066007 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3c01371c0 0x7fc3c01395a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009dc0 tx=0x7fc3b800b330 comp rx=0 tx=0).stop 2023-09-30T22:20:23.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.875+0000 7fc3c50a1700 1 -- 172.21.15.156:0/3624066007 shutdown_connections 2023-09-30T22:20:23.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.875+0000 7fc3c50a1700 1 --2- 172.21.15.156:0/3624066007 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3c01371c0 0x7fc3c01395a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:23.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.875+0000 7fc3c50a1700 1 --2- 172.21.15.156:0/3624066007 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3c009f350 0x7fc3c0136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:23.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.875+0000 7fc3c50a1700 1 -- 172.21.15.156:0/3624066007 >> 172.21.15.156:0/3624066007 conn(0x7fc3c00a4430 msgr2=0x7fc3c00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:23.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.875+0000 7fc3c50a1700 1 -- 172.21.15.156:0/3624066007 shutdown_connections 2023-09-30T22:20:23.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.875+0000 7fc3c50a1700 1 -- 172.21.15.156:0/3624066007 wait complete. 2023-09-30T22:20:23.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.877+0000 7fc3c50a1700 1 Processor -- start 2023-09-30T22:20:23.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.877+0000 7fc3c50a1700 1 -- start start 2023-09-30T22:20:23.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.877+0000 7fc3c50a1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3c009e870 0x7fc3c01c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:23.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.877+0000 7fc3c50a1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3c009f350 0x7fc3c01c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:23.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.877+0000 7fc3c50a1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3c01371c0 0x7fc3c01c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:23.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.877+0000 7fc3c50a1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c01323b0 con 0x7fc3c01371c0 2023-09-30T22:20:23.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.877+0000 7fc3c50a1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c006d6b0 con 0x7fc3c009f350 2023-09-30T22:20:23.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.877+0000 7fc3c50a1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c01222f0 con 0x7fc3c009e870 2023-09-30T22:20:23.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.877+0000 7fc3be59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3c009f350 0x7fc3c01c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:23.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.877+0000 7fc3be59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3c009f350 0x7fc3c01c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49152/0 (socket says 172.21.15.156:49152) 2023-09-30T22:20:23.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.877+0000 7fc3be59c700 1 -- 172.21.15.156:0/1831548560 learned_addr learned my addr 172.21.15.156:0/1831548560 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:23.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.877+0000 7fc3bed9d700 1 --2- 172.21.15.156:0/1831548560 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3c009e870 0x7fc3c01c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:23.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.877+0000 7fc3bf59e700 1 --2- 172.21.15.156:0/1831548560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3c01371c0 0x7fc3c01c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:23.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.878+0000 7fc3be59c700 1 -- 172.21.15.156:0/1831548560 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3c009e870 msgr2=0x7fc3c01c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:23.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.878+0000 7fc3be59c700 1 --2- 172.21.15.156:0/1831548560 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3c009e870 0x7fc3c01c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:23.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.878+0000 7fc3be59c700 1 -- 172.21.15.156:0/1831548560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3c01371c0 msgr2=0x7fc3c01c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:23.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.878+0000 7fc3be59c700 1 --2- 172.21.15.156:0/1831548560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3c01371c0 0x7fc3c01c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:23.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.878+0000 7fc3be59c700 1 -- 172.21.15.156:0/1831548560 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b8009a70 con 0x7fc3c009f350 2023-09-30T22:20:23.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.878+0000 7fc3bed9d700 1 --2- 172.21.15.156:0/1831548560 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3c009e870 0x7fc3c01c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:23.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.878+0000 7fc3be59c700 1 --2- 172.21.15.156:0/1831548560 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3c009f350 0x7fc3c01c8910 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc3b400e910 tx=0x7fc3b400ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:23.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.878+0000 7fc3a77fe700 1 -- 172.21.15.156:0/1831548560 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b40096a0 con 0x7fc3c009f350 2023-09-30T22:20:23.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.878+0000 7fc3c50a1700 1 -- 172.21.15.156:0/1831548560 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c0072410 con 0x7fc3c009f350 2023-09-30T22:20:23.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.878+0000 7fc3a77fe700 1 -- 172.21.15.156:0/1831548560 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b4013680 con 0x7fc3c009f350 2023-09-30T22:20:23.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.878+0000 7fc3a77fe700 1 -- 172.21.15.156:0/1831548560 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4013a30 con 0x7fc3c009f350 2023-09-30T22:20:23.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.878+0000 7fc3c50a1700 1 -- 172.21.15.156:0/1831548560 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c0120b80 con 0x7fc3c009f350 2023-09-30T22:20:23.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.879+0000 7fc3c50a1700 1 -- 172.21.15.156:0/1831548560 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c004f2a0 con 0x7fc3c009f350 2023-09-30T22:20:23.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.879+0000 7fc3a77fe700 1 -- 172.21.15.156:0/1831548560 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc3b4013b90 con 0x7fc3c009f350 2023-09-30T22:20:23.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.879+0000 7fc3a77fe700 1 -- 172.21.15.156:0/1831548560 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc3b403fa30 con 0x7fc3c009f350 2023-09-30T22:20:23.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.888+0000 7fc3a77fe700 1 -- 172.21.15.156:0/1831548560 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc3b4011d90 con 0x7fc3c009f350 2023-09-30T22:20:23.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.921+0000 7f803566f700 1 Processor -- start 2023-09-30T22:20:23.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.921+0000 7f803566f700 1 -- start start 2023-09-30T22:20:23.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.921+0000 7f803566f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f803009e870 0x7f803009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:23.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.921+0000 7f803566f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f803009f180 0x7f8030131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:23.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.921+0000 7f803566f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8030131d70 0x7f8030132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:23.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.921+0000 7f803566f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80300a0920 con 0x7f803009f180 2023-09-30T22:20:23.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.921+0000 7f803566f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803009c970 con 0x7f8030131d70 2023-09-30T22:20:23.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.921+0000 7f803566f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f803009bab0 con 0x7f803009e870 2023-09-30T22:20:23.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.922+0000 7f802e7fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f803009f180 0x7f8030131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:23.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.922+0000 7f802effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f803009e870 0x7f803009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:23.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.922+0000 7f802effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f803009e870 0x7f803009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33560/0 (socket says 172.21.15.156:33560) 2023-09-30T22:20:23.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.922+0000 7f802e7fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f803009f180 0x7f8030131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:56876/0 (socket says 172.21.15.156:56876) 2023-09-30T22:20:23.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.922+0000 7f802effd700 1 -- 172.21.15.156:0/3605976013 learned_addr learned my addr 172.21.15.156:0/3605976013 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:23.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.922+0000 7f802f7fe700 1 --2- 172.21.15.156:0/3605976013 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8030131d70 0x7f8030132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:23.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.922+0000 7f802effd700 1 -- 172.21.15.156:0/3605976013 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8030131d70 msgr2=0x7f8030132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:23.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.922+0000 7f802effd700 1 --2- 172.21.15.156:0/3605976013 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8030131d70 0x7f8030132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:23.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.922+0000 7f802effd700 1 -- 172.21.15.156:0/3605976013 >> v2:172.21.15.156:3300/0 conn(0x7f803009f180 msgr2=0x7f8030131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:23.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.922+0000 7f802effd700 1 --2- 172.21.15.156:0/3605976013 >> v2:172.21.15.156:3300/0 conn(0x7f803009f180 0x7f8030131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:23.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.922+0000 7f802effd700 1 -- 172.21.15.156:0/3605976013 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803009f9c0 con 0x7f803009e870 2023-09-30T22:20:23.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.922+0000 7f802e7fc700 1 --2- 172.21.15.156:0/3605976013 >> v2:172.21.15.156:3300/0 conn(0x7f803009f180 0x7f8030131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:23.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.922+0000 7f802effd700 1 --2- 172.21.15.156:0/3605976013 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f803009e870 0x7f803009ec40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f802000dd10 tx=0x7f802000f330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f262361ad2173f91 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:23.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.923+0000 7f802dffb700 1 -- 172.21.15.156:0/3605976013 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8020012070 con 0x7f803009e870 2023-09-30T22:20:23.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.923+0000 7f802dffb700 1 -- 172.21.15.156:0/3605976013 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802000d2e0 con 0x7f803009e870 2023-09-30T22:20:23.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.923+0000 7f802dffb700 1 -- 172.21.15.156:0/3605976013 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802000fb10 con 0x7f803009e870 2023-09-30T22:20:23.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.923+0000 7f803566f700 1 -- 172.21.15.156:0/3605976013 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f803009e870 msgr2=0x7f803009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:23.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.923+0000 7f803566f700 1 --2- 172.21.15.156:0/3605976013 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f803009e870 0x7f803009ec40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f802000dd10 tx=0x7f802000f330 comp rx=0 tx=0).stop 2023-09-30T22:20:23.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.923+0000 7f50bdc8c700 1 Processor -- start 2023-09-30T22:20:23.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.923+0000 7f803566f700 1 -- 172.21.15.156:0/3605976013 shutdown_connections 2023-09-30T22:20:23.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.923+0000 7f803566f700 1 --2- 172.21.15.156:0/3605976013 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8030131d70 0x7f8030132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:23.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.923+0000 7f803566f700 1 --2- 172.21.15.156:0/3605976013 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f803009e870 0x7f803009ec40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:23.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.923+0000 7f803566f700 1 --2- 172.21.15.156:0/3605976013 >> v2:172.21.15.156:3300/0 conn(0x7f803009f180 0x7f8030131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:23.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.923+0000 7f803566f700 1 -- 172.21.15.156:0/3605976013 >> 172.21.15.156:0/3605976013 conn(0x7f80300a4430 msgr2=0x7f80300a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:23.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.923+0000 7f50bdc8c700 1 -- start start 2023-09-30T22:20:23.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.923+0000 7f803566f700 1 -- 172.21.15.156:0/3605976013 shutdown_connections 2023-09-30T22:20:23.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.923+0000 7f803566f700 1 -- 172.21.15.156:0/3605976013 wait complete. 2023-09-30T22:20:23.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.924+0000 7f50bdc8c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50b8131980 0x7f50b8131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:23.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.924+0000 7f50bdc8c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f50b809bc70 0x7f50b809c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:23.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.924+0000 7f50bdc8c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50b809c5c0 0x7f50b8138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:23.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.924+0000 7f50bdc8c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b806eb30 con 0x7f50b809bc70 2023-09-30T22:20:23.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.924+0000 7f50bdc8c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b80a1640 con 0x7f50b8131980 2023-09-30T22:20:23.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.924+0000 7f50bdc8c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50b80a22d0 con 0x7f50b809c5c0 2023-09-30T22:20:23.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.924+0000 7f50b7fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50b809c5c0 0x7f50b8138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:23.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.924+0000 7f50b7fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50b809c5c0 0x7f50b8138700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33562/0 (socket says 172.21.15.156:33562) 2023-09-30T22:20:23.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.924+0000 7f50b7fff700 1 -- 172.21.15.156:0/3222111549 learned_addr learned my addr 172.21.15.156:0/3222111549 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:23.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.925+0000 7f50b7fff700 1 -- 172.21.15.156:0/3222111549 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50b8131980 msgr2=0x7f50b8131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:23.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.925+0000 7f50b7fff700 1 --2- 172.21.15.156:0/3222111549 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50b8131980 0x7f50b8131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:23.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.925+0000 7f50b7fff700 1 -- 172.21.15.156:0/3222111549 >> v2:172.21.15.156:3300/0 conn(0x7f50b809bc70 msgr2=0x7f50b809c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:23.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.925+0000 7f50b7fff700 1 --2- 172.21.15.156:0/3222111549 >> v2:172.21.15.156:3300/0 conn(0x7f50b809bc70 0x7f50b809c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:23.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.925+0000 7f50b7fff700 1 -- 172.21.15.156:0/3222111549 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b8131550 con 0x7f50b809c5c0 2023-09-30T22:20:23.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.925+0000 7f50b7fff700 1 --2- 172.21.15.156:0/3222111549 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50b809c5c0 0x7f50b8138700 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f50b0009e80 tx=0x7f50b000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5770809bd87e629 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:23.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.925+0000 7f803566f700 1 Processor -- start 2023-09-30T22:20:23.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.925+0000 7f803566f700 1 -- start start 2023-09-30T22:20:23.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.925+0000 7f50b67fc700 1 -- 172.21.15.156:0/3222111549 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b000e070 con 0x7f50b809c5c0 2023-09-30T22:20:23.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.925+0000 7f50b67fc700 1 -- 172.21.15.156:0/3222111549 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b000b980 con 0x7f50b809c5c0 2023-09-30T22:20:23.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.925+0000 7f50b67fc700 1 -- 172.21.15.156:0/3222111549 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b000bd30 con 0x7f50b809c5c0 2023-09-30T22:20:23.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.925+0000 7f803566f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f803009e870 0x7f80301c1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:23.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.925+0000 7f803566f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f803009f180 0x7f80301c1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:23.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.925+0000 7f803566f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8030131d70 0x7f80301c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:23.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.925+0000 7f803566f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803011d2a0 con 0x7f803009e870 2023-09-30T22:20:23.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.925+0000 7f803566f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803011f710 con 0x7f803009f180 2023-09-30T22:20:23.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.925+0000 7f803566f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f803011ec50 con 0x7f8030131d70 2023-09-30T22:20:23.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.926+0000 7f802f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8030131d70 0x7f80301c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:23.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.926+0000 7f802f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8030131d70 0x7f80301c4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33574/0 (socket says 172.21.15.156:33574) 2023-09-30T22:20:23.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.926+0000 7f802f7fe700 1 -- 172.21.15.156:0/87491010 learned_addr learned my addr 172.21.15.156:0/87491010 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:23.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.926+0000 7f802e7fc700 1 --2- 172.21.15.156:0/87491010 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f803009f180 0x7f80301c1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:23.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.926+0000 7f802f7fe700 1 -- 172.21.15.156:0/87491010 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f803009f180 msgr2=0x7f80301c1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:23.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.926+0000 7f802f7fe700 1 --2- 172.21.15.156:0/87491010 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f803009f180 0x7f80301c1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:23.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.926+0000 7f802f7fe700 1 -- 172.21.15.156:0/87491010 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f803009e870 msgr2=0x7f80301c1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:23.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.926+0000 7f802f7fe700 1 --2- 172.21.15.156:0/87491010 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f803009e870 0x7f80301c1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:23.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.926+0000 7f802f7fe700 1 -- 172.21.15.156:0/87491010 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80240094a0 con 0x7f8030131d70 2023-09-30T22:20:23.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.926+0000 7f50bdc8c700 1 -- 172.21.15.156:0/3222111549 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50b809c5c0 msgr2=0x7f50b8138700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:23.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.926+0000 7f50bdc8c700 1 --2- 172.21.15.156:0/3222111549 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50b809c5c0 0x7f50b8138700 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f50b0009e80 tx=0x7f50b000b330 comp rx=0 tx=0).stop 2023-09-30T22:20:23.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.926+0000 7f50bdc8c700 1 -- 172.21.15.156:0/3222111549 shutdown_connections 2023-09-30T22:20:23.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.926+0000 7f50bdc8c700 1 --2- 172.21.15.156:0/3222111549 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50b809c5c0 0x7f50b8138700 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:23.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.926+0000 7f50bdc8c700 1 --2- 172.21.15.156:0/3222111549 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50b8131980 0x7f50b8131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:23.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.926+0000 7f50bdc8c700 1 --2- 172.21.15.156:0/3222111549 >> v2:172.21.15.156:3300/0 conn(0x7f50b809bc70 0x7f50b809c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:23.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.926+0000 7f50bdc8c700 1 -- 172.21.15.156:0/3222111549 >> 172.21.15.156:0/3222111549 conn(0x7f50b80a2980 msgr2=0x7f50b80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:23.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.926+0000 7f50bdc8c700 1 -- 172.21.15.156:0/3222111549 shutdown_connections 2023-09-30T22:20:23.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.926+0000 7f802f7fe700 1 --2- 172.21.15.156:0/87491010 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8030131d70 0x7f80301c4070 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f802800efc0 tx=0x7f802800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:23.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.926+0000 7f50bdc8c700 1 -- 172.21.15.156:0/3222111549 wait complete. 2023-09-30T22:20:23.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.926+0000 7f80177fe700 1 -- 172.21.15.156:0/87491010 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8028009ea0 con 0x7f8030131d70 2023-09-30T22:20:23.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.926+0000 7f80177fe700 1 -- 172.21.15.156:0/87491010 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802800f040 con 0x7f8030131d70 2023-09-30T22:20:23.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.926+0000 7f80177fe700 1 -- 172.21.15.156:0/87491010 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8028014480 con 0x7f8030131d70 2023-09-30T22:20:23.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.926+0000 7f803566f700 1 -- 172.21.15.156:0/87491010 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f802000d9f0 con 0x7f8030131d70 2023-09-30T22:20:23.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.927+0000 7f803566f700 1 -- 172.21.15.156:0/87491010 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80300a2bd0 con 0x7f8030131d70 2023-09-30T22:20:23.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.927+0000 7f80177fe700 1 -- 172.21.15.156:0/87491010 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f80280145e0 con 0x7f8030131d70 2023-09-30T22:20:23.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.927+0000 7f80177fe700 1 -- 172.21.15.156:0/87491010 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8028040060 con 0x7f8030131d70 2023-09-30T22:20:23.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.927+0000 7f50bdc8c700 1 Processor -- start 2023-09-30T22:20:23.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.928+0000 7f803566f700 1 -- 172.21.15.156:0/87491010 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80100052e0 con 0x7f8030131d70 2023-09-30T22:20:23.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.929+0000 7f50bdc8c700 1 -- start start 2023-09-30T22:20:23.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.929+0000 7f50bdc8c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50b809bc70 0x7f50b811b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:23.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.929+0000 7f50bdc8c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50b809c5c0 0x7f50b811bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:23.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.929+0000 7f50bdc8c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50b8131980 0x7f50b811c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:23.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.929+0000 7f50bdc8c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b811d960 con 0x7f50b809c5c0 2023-09-30T22:20:23.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.929+0000 7f50bdc8c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b811f240 con 0x7f50b8131980 2023-09-30T22:20:23.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.929+0000 7f50bdc8c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50b8130dd0 con 0x7f50b809bc70 2023-09-30T22:20:23.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.929+0000 7f50b6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50b809c5c0 0x7f50b811bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:23.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.929+0000 7f50b7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50b8131980 0x7f50b811c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:23.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.929+0000 7f50b6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50b809c5c0 0x7f50b811bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:56898/0 (socket says 172.21.15.156:56898) 2023-09-30T22:20:23.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.929+0000 7f50b7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50b8131980 0x7f50b811c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49174/0 (socket says 172.21.15.156:49174) 2023-09-30T22:20:23.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.929+0000 7f50b6ffd700 1 -- 172.21.15.156:0/3477360037 learned_addr learned my addr 172.21.15.156:0/3477360037 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:23.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.930+0000 7f50b77fe700 1 --2- 172.21.15.156:0/3477360037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50b809bc70 0x7f50b811b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:23.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.930+0000 7f50b6ffd700 1 -- 172.21.15.156:0/3477360037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50b809bc70 msgr2=0x7f50b811b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:23.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.930+0000 7f50b6ffd700 1 --2- 172.21.15.156:0/3477360037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50b809bc70 0x7f50b811b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:23.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.930+0000 7f50b6ffd700 1 -- 172.21.15.156:0/3477360037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50b8131980 msgr2=0x7f50b811c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:23.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.930+0000 7f50b6ffd700 1 --2- 172.21.15.156:0/3477360037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50b8131980 0x7f50b811c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:23.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.930+0000 7f50b6ffd700 1 -- 172.21.15.156:0/3477360037 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b0009b30 con 0x7f50b809c5c0 2023-09-30T22:20:23.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.930+0000 7f50b7fff700 1 --2- 172.21.15.156:0/3477360037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50b8131980 0x7f50b811c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:23.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.930+0000 7f50b6ffd700 1 --2- 172.21.15.156:0/3477360037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50b809c5c0 0x7f50b811bcb0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00b500 tx=0x7f50ac00b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:23.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.930+0000 7f509ffff700 1 -- 172.21.15.156:0/3477360037 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac011830 con 0x7f50b809c5c0 2023-09-30T22:20:23.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.930+0000 7f509ffff700 1 -- 172.21.15.156:0/3477360037 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ac0119b0 con 0x7f50b809c5c0 2023-09-30T22:20:23.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.930+0000 7f509ffff700 1 -- 172.21.15.156:0/3477360037 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac011d60 con 0x7f50b809c5c0 2023-09-30T22:20:23.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.930+0000 7f50bdc8c700 1 -- 172.21.15.156:0/3477360037 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b811e9d0 con 0x7f50b809c5c0 2023-09-30T22:20:23.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.930+0000 7f50bdc8c700 1 -- 172.21.15.156:0/3477360037 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b811d330 con 0x7f50b809c5c0 2023-09-30T22:20:23.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.931+0000 7f509ffff700 1 -- 172.21.15.156:0/3477360037 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f50ac01a400 con 0x7f50b809c5c0 2023-09-30T22:20:23.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.931+0000 7f509ffff700 1 -- 172.21.15.156:0/3477360037 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f50ac03f7b0 con 0x7f50b809c5c0 2023-09-30T22:20:23.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.931+0000 7f50bdc8c700 1 -- 172.21.15.156:0/3477360037 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50b811ec00 con 0x7f50b809c5c0 2023-09-30T22:20:23.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.934+0000 7f80177fe700 1 -- 172.21.15.156:0/87491010 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8028018070 con 0x7f8030131d70 2023-09-30T22:20:23.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:23.936+0000 7f509ffff700 1 -- 172.21.15.156:0/3477360037 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f50b811ec00 con 0x7f50b809c5c0 2023-09-30T22:20:24.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.082+0000 7f8bd7396700 1 -- 172.21.15.156:0/4247613741 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8bd011db40 con 0x7f8bd0131a00 2023-09-30T22:20:24.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.083+0000 7f8bc5ffb700 1 -- 172.21.15.156:0/4247613741 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8bc8021970 con 0x7f8bd0131a00 2023-09-30T22:20:24.083 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:24.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.085+0000 7f8bd7396700 1 -- 172.21.15.156:0/4247613741 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd0131a00 msgr2=0x7f8bd011abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:24.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.085+0000 7f8bd7396700 1 --2- 172.21.15.156:0/4247613741 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd0131a00 0x7f8bd011abe0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8bd009f140 tx=0x7f8bc8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:20:24.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.085+0000 7f8bd7396700 1 -- 172.21.15.156:0/4247613741 shutdown_connections 2023-09-30T22:20:24.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.085+0000 7f8bd7396700 1 --2- 172.21.15.156:0/4247613741 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bd0131a00 0x7f8bd011abe0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:24.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.085+0000 7f8bd7396700 1 --2- 172.21.15.156:0/4247613741 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bd006a770 0x7f8bd011a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:24.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.085+0000 7f8bd7396700 1 --2- 172.21.15.156:0/4247613741 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bd009dec0 0x7f8bd011a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:24.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.085+0000 7f8bd7396700 1 -- 172.21.15.156:0/4247613741 >> 172.21.15.156:0/4247613741 conn(0x7f8bd0099c40 msgr2=0x7f8bd012ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:24.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.085+0000 7f8bd7396700 1 -- 172.21.15.156:0/4247613741 shutdown_connections 2023-09-30T22:20:24.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.085+0000 7f8bd7396700 1 -- 172.21.15.156:0/4247613741 wait complete. 2023-09-30T22:20:24.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.089+0000 7fc3c50a1700 1 -- 172.21.15.156:0/1831548560 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc3c006b2a0 con 0x7fc3c009f350 2023-09-30T22:20:24.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.090+0000 7fc3a77fe700 1 -- 172.21.15.156:0/1831548560 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc3b4021030 con 0x7fc3c009f350 2023-09-30T22:20:24.089 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:24.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.093+0000 7fc3c50a1700 1 -- 172.21.15.156:0/1831548560 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3c009f350 msgr2=0x7fc3c01c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:24.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.093+0000 7fc3c50a1700 1 --2- 172.21.15.156:0/1831548560 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3c009f350 0x7fc3c01c8910 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc3b400e910 tx=0x7fc3b400ec20 comp rx=0 tx=0).stop 2023-09-30T22:20:24.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.093+0000 7fc3c50a1700 1 -- 172.21.15.156:0/1831548560 shutdown_connections 2023-09-30T22:20:24.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.093+0000 7fc3c50a1700 1 --2- 172.21.15.156:0/1831548560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3c01371c0 0x7fc3c01c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:24.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.093+0000 7fc3c50a1700 1 --2- 172.21.15.156:0/1831548560 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3c009e870 0x7fc3c01c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:24.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.093+0000 7fc3c50a1700 1 --2- 172.21.15.156:0/1831548560 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3c009f350 0x7fc3c01c8910 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:24.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.093+0000 7fc3c50a1700 1 -- 172.21.15.156:0/1831548560 >> 172.21.15.156:0/1831548560 conn(0x7fc3c00a4430 msgr2=0x7fc3c009cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:24.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.093+0000 7fc3c50a1700 1 -- 172.21.15.156:0/1831548560 shutdown_connections 2023-09-30T22:20:24.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.093+0000 7fc3c50a1700 1 -- 172.21.15.156:0/1831548560 wait complete. 2023-09-30T22:20:24.098 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:24.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:24.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.132+0000 7f50bdc8c700 1 -- 172.21.15.156:0/3477360037 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f50b811edc0 con 0x7f50b809c5c0 2023-09-30T22:20:24.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.133+0000 7f509ffff700 1 -- 172.21.15.156:0/3477360037 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f50b811edc0 con 0x7f50b809c5c0 2023-09-30T22:20:24.132 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:24.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.134+0000 7f50bdc8c700 1 -- 172.21.15.156:0/3477360037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50b809c5c0 msgr2=0x7f50b811bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:24.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.134+0000 7f50bdc8c700 1 --2- 172.21.15.156:0/3477360037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50b809c5c0 0x7f50b811bcb0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00b500 tx=0x7f50ac00b810 comp rx=0 tx=0).stop 2023-09-30T22:20:24.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.134+0000 7f50bdc8c700 1 -- 172.21.15.156:0/3477360037 shutdown_connections 2023-09-30T22:20:24.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.134+0000 7f50bdc8c700 1 --2- 172.21.15.156:0/3477360037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50b8131980 0x7f50b811c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:24.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.134+0000 7f50bdc8c700 1 --2- 172.21.15.156:0/3477360037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50b809bc70 0x7f50b811b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:24.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.134+0000 7f50bdc8c700 1 --2- 172.21.15.156:0/3477360037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50b809c5c0 0x7f50b811bcb0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:24.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.135+0000 7f50bdc8c700 1 -- 172.21.15.156:0/3477360037 >> 172.21.15.156:0/3477360037 conn(0x7f50b80a2980 msgr2=0x7f50b809d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:24.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.135+0000 7f50bdc8c700 1 -- 172.21.15.156:0/3477360037 shutdown_connections 2023-09-30T22:20:24.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.135+0000 7f50bdc8c700 1 -- 172.21.15.156:0/3477360037 wait complete. 2023-09-30T22:20:24.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:24.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.155+0000 7f803566f700 1 -- 172.21.15.156:0/87491010 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8010005590 con 0x7f8030131d70 2023-09-30T22:20:24.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.155+0000 7f80177fe700 1 -- 172.21.15.156:0/87491010 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f802802b090 con 0x7f8030131d70 2023-09-30T22:20:24.155 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:24.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.157+0000 7f803566f700 1 -- 172.21.15.156:0/87491010 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8030131d70 msgr2=0x7f80301c4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:24.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.157+0000 7f803566f700 1 --2- 172.21.15.156:0/87491010 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8030131d70 0x7f80301c4070 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f802800efc0 tx=0x7f802800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:20:24.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.158+0000 7f803566f700 1 -- 172.21.15.156:0/87491010 shutdown_connections 2023-09-30T22:20:24.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.158+0000 7f803566f700 1 --2- 172.21.15.156:0/87491010 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8030131d70 0x7f80301c4070 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:24.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.158+0000 7f803566f700 1 --2- 172.21.15.156:0/87491010 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f803009e870 0x7f80301c1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:24.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.158+0000 7f803566f700 1 --2- 172.21.15.156:0/87491010 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f803009f180 0x7f80301c1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:24.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.158+0000 7f803566f700 1 -- 172.21.15.156:0/87491010 >> 172.21.15.156:0/87491010 conn(0x7f80300a4430 msgr2=0x7f8030130f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:24.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.158+0000 7f803566f700 1 -- 172.21.15.156:0/87491010 shutdown_connections 2023-09-30T22:20:24.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:24.158+0000 7f803566f700 1 -- 172.21.15.156:0/87491010 wait complete. 2023-09-30T22:20:24.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:25.100 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:25.111 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:25.147 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:25.170 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:25.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.244+0000 7fe622190700 1 Processor -- start 2023-09-30T22:20:25.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.244+0000 7fe622190700 1 -- start start 2023-09-30T22:20:25.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.245+0000 7fe622190700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe61c09d860 0x7fe61c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:25.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.245+0000 7fe622190700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe61c09e170 0x7fe61c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:25.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.245+0000 7fe622190700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe61c130ce0 0x7fe61c131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:25.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.245+0000 7fe622190700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe61c09aaa0 con 0x7fe61c130ce0 2023-09-30T22:20:25.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.245+0000 7fe622190700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c09f870 con 0x7fe61c09d860 2023-09-30T22:20:25.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.245+0000 7fe622190700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c09b360 con 0x7fe61c09e170 2023-09-30T22:20:25.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.245+0000 7fe61affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe61c09e170 0x7fe61c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:25.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.245+0000 7fe61b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe61c09d860 0x7fe61c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:25.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.245+0000 7fe61affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe61c09e170 0x7fe61c1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33590/0 (socket says 172.21.15.156:33590) 2023-09-30T22:20:25.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.245+0000 7fe61affd700 1 -- 172.21.15.156:0/3116784057 learned_addr learned my addr 172.21.15.156:0/3116784057 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:25.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.245+0000 7fe61affd700 1 -- 172.21.15.156:0/3116784057 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe61c09d860 msgr2=0x7fe61c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:25.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.245+0000 7fe61affd700 1 --2- 172.21.15.156:0/3116784057 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe61c09d860 0x7fe61c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.245+0000 7fe61affd700 1 -- 172.21.15.156:0/3116784057 >> v2:172.21.15.156:3300/0 conn(0x7fe61c130ce0 msgr2=0x7fe61c131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:25.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.245+0000 7fe61affd700 1 --2- 172.21.15.156:0/3116784057 >> v2:172.21.15.156:3300/0 conn(0x7fe61c130ce0 0x7fe61c131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.245+0000 7fe61affd700 1 -- 172.21.15.156:0/3116784057 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61c09b620 con 0x7fe61c09e170 2023-09-30T22:20:25.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.245+0000 7fe61b7fe700 1 --2- 172.21.15.156:0/3116784057 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe61c09d860 0x7fe61c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:25.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.245+0000 7fe61affd700 1 --2- 172.21.15.156:0/3116784057 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe61c09e170 0x7fe61c1307a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe61000b9a0 tx=0x7fe61000bcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6fff7ee81e261f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:25.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.246+0000 7fe61a7fc700 1 -- 172.21.15.156:0/3116784057 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61000caa0 con 0x7fe61c09e170 2023-09-30T22:20:25.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.246+0000 7fe61a7fc700 1 -- 172.21.15.156:0/3116784057 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61000cc00 con 0x7fe61c09e170 2023-09-30T22:20:25.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.246+0000 7fe61a7fc700 1 -- 172.21.15.156:0/3116784057 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61000f460 con 0x7fe61c09e170 2023-09-30T22:20:25.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.246+0000 7fe622190700 1 -- 172.21.15.156:0/3116784057 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe61c09e170 msgr2=0x7fe61c1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:25.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.246+0000 7fe622190700 1 --2- 172.21.15.156:0/3116784057 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe61c09e170 0x7fe61c1307a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe61000b9a0 tx=0x7fe61000bcb0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.246+0000 7fe622190700 1 -- 172.21.15.156:0/3116784057 shutdown_connections 2023-09-30T22:20:25.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.246+0000 7fe622190700 1 --2- 172.21.15.156:0/3116784057 >> v2:172.21.15.156:3300/0 conn(0x7fe61c130ce0 0x7fe61c131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.246+0000 7fe622190700 1 --2- 172.21.15.156:0/3116784057 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe61c09d860 0x7fe61c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.246+0000 7fe622190700 1 --2- 172.21.15.156:0/3116784057 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe61c09e170 0x7fe61c1307a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.246+0000 7fe622190700 1 -- 172.21.15.156:0/3116784057 >> 172.21.15.156:0/3116784057 conn(0x7fe61c099c40 msgr2=0x7fe61c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:25.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.246+0000 7fe622190700 1 -- 172.21.15.156:0/3116784057 shutdown_connections 2023-09-30T22:20:25.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.247+0000 7fe622190700 1 -- 172.21.15.156:0/3116784057 wait complete. 2023-09-30T22:20:25.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.247+0000 7fe622190700 1 Processor -- start 2023-09-30T22:20:25.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.248+0000 7fe622190700 1 -- start start 2023-09-30T22:20:25.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.248+0000 7fe622190700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe61c09d860 0x7fe61c119ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:25.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.248+0000 7fe622190700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe61c09e170 0x7fe61c11a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:25.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.248+0000 7fe622190700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe61c130ce0 0x7fe61c11a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:25.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.248+0000 7fe622190700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c11d250 con 0x7fe61c09d860 2023-09-30T22:20:25.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.248+0000 7fe622190700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c11e3a0 con 0x7fe61c09e170 2023-09-30T22:20:25.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.248+0000 7fe622190700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c11bbf0 con 0x7fe61c130ce0 2023-09-30T22:20:25.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.248+0000 7fe61b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe61c09d860 0x7fe61c119ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:25.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.248+0000 7fe61b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe61c09d860 0x7fe61c119ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:56918/0 (socket says 172.21.15.156:56918) 2023-09-30T22:20:25.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.248+0000 7fe61b7fe700 1 -- 172.21.15.156:0/2722468053 learned_addr learned my addr 172.21.15.156:0/2722468053 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:25.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.248+0000 7fe61affd700 1 --2- 172.21.15.156:0/2722468053 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe61c09e170 0x7fe61c11a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:25.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.248+0000 7fe61bfff700 1 --2- 172.21.15.156:0/2722468053 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe61c130ce0 0x7fe61c11a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:25.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.249+0000 7fe61b7fe700 1 -- 172.21.15.156:0/2722468053 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe61c130ce0 msgr2=0x7fe61c11a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:25.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.249+0000 7fe61b7fe700 1 --2- 172.21.15.156:0/2722468053 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe61c130ce0 0x7fe61c11a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.249+0000 7fe61b7fe700 1 -- 172.21.15.156:0/2722468053 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe61c09e170 msgr2=0x7fe61c11a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:25.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.249+0000 7fe61b7fe700 1 --2- 172.21.15.156:0/2722468053 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe61c09e170 0x7fe61c11a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.249+0000 7fe61b7fe700 1 -- 172.21.15.156:0/2722468053 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60c00d940 con 0x7fe61c09d860 2023-09-30T22:20:25.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.249+0000 7fe61b7fe700 1 --2- 172.21.15.156:0/2722468053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe61c09d860 0x7fe61c119ec0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe60c012fc0 tx=0x7fe60c0103a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:25.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.249+0000 7fe603fff700 1 -- 172.21.15.156:0/2722468053 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c010b00 con 0x7fe61c09d860 2023-09-30T22:20:25.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.249+0000 7fe603fff700 1 -- 172.21.15.156:0/2722468053 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60c013040 con 0x7fe61c09d860 2023-09-30T22:20:25.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.249+0000 7fe603fff700 1 -- 172.21.15.156:0/2722468053 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c010e60 con 0x7fe61c09d860 2023-09-30T22:20:25.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.249+0000 7fe622190700 1 -- 172.21.15.156:0/2722468053 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe61000b600 con 0x7fe61c09d860 2023-09-30T22:20:25.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.249+0000 7fe622190700 1 -- 172.21.15.156:0/2722468053 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe61c0a2250 con 0x7fe61c09d860 2023-09-30T22:20:25.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.250+0000 7fe603fff700 1 -- 172.21.15.156:0/2722468053 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe60c018480 con 0x7fe61c09d860 2023-09-30T22:20:25.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.250+0000 7fe622190700 1 -- 172.21.15.156:0/2722468053 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe61c04f2a0 con 0x7fe61c09d860 2023-09-30T22:20:25.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.251+0000 7fe603fff700 1 -- 172.21.15.156:0/2722468053 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe60c043770 con 0x7fe61c09d860 2023-09-30T22:20:25.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.255+0000 7fe603fff700 1 -- 172.21.15.156:0/2722468053 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe60c016930 con 0x7fe61c09d860 2023-09-30T22:20:25.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.281+0000 7fdfa5d57700 1 Processor -- start 2023-09-30T22:20:25.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.281+0000 7fdfa5d57700 1 -- start start 2023-09-30T22:20:25.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.282+0000 7fdfa5d57700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdfa0133a70 0x7fdfa0133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:25.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.282+0000 7fdfa5d57700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdfa00a08e0 0x7fdfa00a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:25.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.282+0000 7fdfa5d57700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfa0133640 con 0x7fdfa00a1290 2023-09-30T22:20:25.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.282+0000 7fdfa5d57700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfa00a1d50 con 0x7fdfa0133a70 2023-09-30T22:20:25.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.282+0000 7fdfa5d57700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa00a1710 con 0x7fdfa00a08e0 2023-09-30T22:20:25.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.282+0000 7fdf9effd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdfa00a08e0 0x7fdfa00a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:25.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.282+0000 7fdf9effd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdfa00a08e0 0x7fdfa00a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49188/0 (socket says 172.21.15.156:49188) 2023-09-30T22:20:25.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.282+0000 7fdf9effd700 1 -- 172.21.15.156:0/1181648832 learned_addr learned my addr 172.21.15.156:0/1181648832 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:25.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.282+0000 7fdf9f7fe700 1 --2- 172.21.15.156:0/1181648832 >> v2:172.21.15.156:3300/0 conn(0x7fdfa0133a70 0x7fdfa0133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:25.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.283+0000 7fdf9effd700 1 -- 172.21.15.156:0/1181648832 >> v2:172.21.15.156:3300/0 conn(0x7fdfa0133a70 msgr2=0x7fdfa0133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:25.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.283+0000 7fdf9effd700 1 --2- 172.21.15.156:0/1181648832 >> v2:172.21.15.156:3300/0 conn(0x7fdfa0133a70 0x7fdfa0133e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.283+0000 7fdf9effd700 1 -- 172.21.15.156:0/1181648832 >> v1:172.21.15.156:6789/0 conn(0x7fdfa00a1290 legacy=0x7fdfa013a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:25.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.283+0000 7fdf9effd700 1 -- 172.21.15.156:0/1181648832 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa009b620 con 0x7fdfa00a08e0 2023-09-30T22:20:25.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.283+0000 7fdf9effd700 1 --2- 172.21.15.156:0/1181648832 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdfa00a08e0 0x7fdfa00a0d50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdf940098f0 tx=0x7fdf94009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce4685df36e73389 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:25.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.283+0000 7fdf9e7fc700 1 -- 172.21.15.156:0/1181648832 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf94011830 con 0x7fdfa00a08e0 2023-09-30T22:20:25.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.283+0000 7fdf9e7fc700 1 -- 172.21.15.156:0/1181648832 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf94011990 con 0x7fdfa00a08e0 2023-09-30T22:20:25.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.283+0000 7fdf9e7fc700 1 -- 172.21.15.156:0/1181648832 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf94011d00 con 0x7fdfa00a08e0 2023-09-30T22:20:25.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.284+0000 7fdfa5d57700 1 -- 172.21.15.156:0/1181648832 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdfa00a08e0 msgr2=0x7fdfa00a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:25.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.284+0000 7fdfa5d57700 1 --2- 172.21.15.156:0/1181648832 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdfa00a08e0 0x7fdfa00a0d50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdf940098f0 tx=0x7fdf94009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:25.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.284+0000 7fdfa5d57700 1 -- 172.21.15.156:0/1181648832 shutdown_connections 2023-09-30T22:20:25.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.284+0000 7fdfa5d57700 1 --2- 172.21.15.156:0/1181648832 >> v2:172.21.15.156:3300/0 conn(0x7fdfa0133a70 0x7fdfa0133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.284+0000 7fdfa5d57700 1 --2- 172.21.15.156:0/1181648832 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdfa00a08e0 0x7fdfa00a0d50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.284+0000 7fdfa5d57700 1 -- 172.21.15.156:0/1181648832 >> 172.21.15.156:0/1181648832 conn(0x7fdfa00a2980 msgr2=0x7fdfa00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:25.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.284+0000 7fdfa5d57700 1 -- 172.21.15.156:0/1181648832 shutdown_connections 2023-09-30T22:20:25.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.284+0000 7fdfa5d57700 1 -- 172.21.15.156:0/1181648832 wait complete. 2023-09-30T22:20:25.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.285+0000 7fdfa5d57700 1 Processor -- start 2023-09-30T22:20:25.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.286+0000 7fdfa5d57700 1 -- start start 2023-09-30T22:20:25.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.286+0000 7fdfa5d57700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdfa00a08e0 0x7fdfa0119960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:25.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.286+0000 7fdfa5d57700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdfa00a1290 0x7fdfa0119ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:25.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.286+0000 7fdfa5d57700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdfa0133a70 0x7fdfa011a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:25.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.286+0000 7fdfa5d57700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa011d1f0 con 0x7fdfa00a1290 2023-09-30T22:20:25.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.286+0000 7fdfa5d57700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa011c7a0 con 0x7fdfa00a08e0 2023-09-30T22:20:25.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.286+0000 7fdfa5d57700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa011c2e0 con 0x7fdfa0133a70 2023-09-30T22:20:25.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.286+0000 7fdf9f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdfa00a08e0 0x7fdfa0119960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:25.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.287+0000 7fdf9f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdfa00a08e0 0x7fdfa0119960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49204/0 (socket says 172.21.15.156:49204) 2023-09-30T22:20:25.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.287+0000 7fdf9f7fe700 1 -- 172.21.15.156:0/1865500735 learned_addr learned my addr 172.21.15.156:0/1865500735 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:25.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.287+0000 7fdf9ffff700 1 --2- 172.21.15.156:0/1865500735 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdfa0133a70 0x7fdfa011a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:25.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.287+0000 7fdf9effd700 1 --2- 172.21.15.156:0/1865500735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdfa00a1290 0x7fdfa0119ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:25.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.287+0000 7fdf9ffff700 1 -- 172.21.15.156:0/1865500735 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdfa00a08e0 msgr2=0x7fdfa0119960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:25.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.287+0000 7fdf9ffff700 1 --2- 172.21.15.156:0/1865500735 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdfa00a08e0 0x7fdfa0119960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.287+0000 7fdf9ffff700 1 -- 172.21.15.156:0/1865500735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdfa00a1290 msgr2=0x7fdfa0119ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:25.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.287+0000 7fdf9ffff700 1 --2- 172.21.15.156:0/1865500735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdfa00a1290 0x7fdfa0119ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.287+0000 7fdf9ffff700 1 -- 172.21.15.156:0/1865500735 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf94009550 con 0x7fdfa0133a70 2023-09-30T22:20:25.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.287+0000 7fdf9effd700 1 --2- 172.21.15.156:0/1865500735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdfa00a1290 0x7fdfa0119ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:20:25.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.287+0000 7fdf9ffff700 1 --2- 172.21.15.156:0/1865500735 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdfa0133a70 0x7fdfa011a3e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdf9800cb90 tx=0x7fdf9800cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:25.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.287+0000 7fdf87fff700 1 -- 172.21.15.156:0/1865500735 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf98003c00 con 0x7fdfa0133a70 2023-09-30T22:20:25.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.287+0000 7fdf87fff700 1 -- 172.21.15.156:0/1865500735 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf98003d60 con 0x7fdfa0133a70 2023-09-30T22:20:25.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.287+0000 7fdf87fff700 1 -- 172.21.15.156:0/1865500735 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9800aaa0 con 0x7fdfa0133a70 2023-09-30T22:20:25.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.287+0000 7fdfa5d57700 1 -- 172.21.15.156:0/1865500735 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa0131c70 con 0x7fdfa0133a70 2023-09-30T22:20:25.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.287+0000 7fdfa5d57700 1 -- 172.21.15.156:0/1865500735 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa011db80 con 0x7fdfa0133a70 2023-09-30T22:20:25.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.289+0000 7fdfa5d57700 1 -- 172.21.15.156:0/1865500735 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa004f2a0 con 0x7fdfa0133a70 2023-09-30T22:20:25.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.289+0000 7fdf87fff700 1 -- 172.21.15.156:0/1865500735 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdf9800ac00 con 0x7fdfa0133a70 2023-09-30T22:20:25.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.289+0000 7fdf87fff700 1 -- 172.21.15.156:0/1865500735 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdf98040110 con 0x7fdfa0133a70 2023-09-30T22:20:25.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.298+0000 7fdf87fff700 1 -- 172.21.15.156:0/1865500735 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdf980050d0 con 0x7fdfa0133a70 2023-09-30T22:20:25.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.323+0000 7f8b058b0700 1 Processor -- start 2023-09-30T22:20:25.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.323+0000 7f8b058b0700 1 -- start start 2023-09-30T22:20:25.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.324+0000 7f8b058b0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8b0009da10 0x7f8b00136760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:25.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.324+0000 7f8b058b0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8b00136ca0 0x7f8b00139080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:25.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.324+0000 7f8b058b0700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b0009e780 con 0x7f8b0012e490 2023-09-30T22:20:25.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.324+0000 7f8b058b0700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b0009f6e0 con 0x7f8b00136ca0 2023-09-30T22:20:25.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.324+0000 7f8b058b0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0009eb00 con 0x7f8b0009da10 2023-09-30T22:20:25.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.324+0000 7f8afe7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8b0009da10 0x7f8b00136760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:25.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.324+0000 7f8aff7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8b00136ca0 0x7f8b00139080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:25.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.324+0000 7f8afe7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8b0009da10 0x7f8b00136760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33602/0 (socket says 172.21.15.156:33602) 2023-09-30T22:20:25.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.324+0000 7f8afe7fc700 1 -- 172.21.15.156:0/3166461939 learned_addr learned my addr 172.21.15.156:0/3166461939 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:25.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.324+0000 7f8aff7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8b00136ca0 0x7f8b00139080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:56940/0 (socket says 172.21.15.156:56940) 2023-09-30T22:20:25.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.324+0000 7f8afeffd700 1 --1- 172.21.15.156:0/3166461939 >> v1:172.21.15.156:6789/0 conn(0x7f8b0012e490 0x7f8b0012e860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:34486/0 (socket says 172.21.15.156:34486) 2023-09-30T22:20:25.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.324+0000 7f8aff7fe700 1 -- 172.21.15.156:0/3166461939 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8b0009da10 msgr2=0x7f8b00136760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:25.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.324+0000 7f8aff7fe700 1 --2- 172.21.15.156:0/3166461939 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8b0009da10 0x7f8b00136760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.324+0000 7f8aff7fe700 1 -- 172.21.15.156:0/3166461939 >> v1:172.21.15.156:6789/0 conn(0x7f8b0012e490 legacy=0x7f8b0012e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:25.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.324+0000 7f8aff7fe700 1 -- 172.21.15.156:0/3166461939 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0012e040 con 0x7f8b00136ca0 2023-09-30T22:20:25.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.324+0000 7f8afdffb700 1 -- 172.21.15.156:0/3166461939 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3979158483 0 0) 0x7f8b0009e780 con 0x7f8b0012e490 2023-09-30T22:20:25.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.325+0000 7f8aff7fe700 1 --2- 172.21.15.156:0/3166461939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b00136ca0 0x7f8b00139080 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8af800f370 tx=0x7f8af800f680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=532482b237707afb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:25.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.325+0000 7f8afdffb700 1 -- 172.21.15.156:0/3166461939 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af8012070 con 0x7f8b00136ca0 2023-09-30T22:20:25.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.325+0000 7f8afdffb700 1 -- 172.21.15.156:0/3166461939 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af800fe70 con 0x7f8b00136ca0 2023-09-30T22:20:25.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.325+0000 7f8afdffb700 1 -- 172.21.15.156:0/3166461939 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af800d2f0 con 0x7f8b00136ca0 2023-09-30T22:20:25.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.325+0000 7f8b058b0700 1 -- 172.21.15.156:0/3166461939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b00136ca0 msgr2=0x7f8b00139080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:25.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.325+0000 7f8b058b0700 1 --2- 172.21.15.156:0/3166461939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b00136ca0 0x7f8b00139080 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8af800f370 tx=0x7f8af800f680 comp rx=0 tx=0).stop 2023-09-30T22:20:25.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.325+0000 7f8b058b0700 1 -- 172.21.15.156:0/3166461939 shutdown_connections 2023-09-30T22:20:25.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.325+0000 7f8b058b0700 1 --2- 172.21.15.156:0/3166461939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b00136ca0 0x7f8b00139080 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.325+0000 7f8b058b0700 1 --2- 172.21.15.156:0/3166461939 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8b0009da10 0x7f8b00136760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.325+0000 7f8b058b0700 1 -- 172.21.15.156:0/3166461939 >> 172.21.15.156:0/3166461939 conn(0x7f8b00099c40 msgr2=0x7f8b000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:25.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.326+0000 7f8b058b0700 1 -- 172.21.15.156:0/3166461939 shutdown_connections 2023-09-30T22:20:25.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.326+0000 7f8b058b0700 1 -- 172.21.15.156:0/3166461939 wait complete. 2023-09-30T22:20:25.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.326+0000 7f8b058b0700 1 Processor -- start 2023-09-30T22:20:25.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.327+0000 7f8b058b0700 1 -- start start 2023-09-30T22:20:25.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.327+0000 7f8b058b0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b0009da10 0x7f8b00127ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:25.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.327+0000 7f8b058b0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8b0012e490 0x7f8b00128010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:25.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.327+0000 7f8b058b0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8b00136ca0 0x7f8b0006e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:25.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.327+0000 7f8b058b0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b000700e0 con 0x7f8b0009da10 2023-09-30T22:20:25.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.327+0000 7f8b058b0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b00071410 con 0x7f8b00136ca0 2023-09-30T22:20:25.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.327+0000 7f8b058b0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b000716d0 con 0x7f8b0012e490 2023-09-30T22:20:25.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.327+0000 7f8afe7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8b0012e490 0x7f8b00128010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:25.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.327+0000 7f8afe7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8b0012e490 0x7f8b00128010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33610/0 (socket says 172.21.15.156:33610) 2023-09-30T22:20:25.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.327+0000 7f8afe7fc700 1 -- 172.21.15.156:0/2893019961 learned_addr learned my addr 172.21.15.156:0/2893019961 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:25.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.327+0000 7f8afeffd700 1 --2- 172.21.15.156:0/2893019961 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b0009da10 0x7f8b00127ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:25.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.327+0000 7f8aff7fe700 1 --2- 172.21.15.156:0/2893019961 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8b00136ca0 0x7f8b0006e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:25.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.328+0000 7f8afe7fc700 1 -- 172.21.15.156:0/2893019961 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8b00136ca0 msgr2=0x7f8b0006e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:25.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.328+0000 7f8afe7fc700 1 --2- 172.21.15.156:0/2893019961 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8b00136ca0 0x7f8b0006e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.328+0000 7f8afe7fc700 1 -- 172.21.15.156:0/2893019961 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b0009da10 msgr2=0x7f8b00127ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:25.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.328+0000 7f8afe7fc700 1 --2- 172.21.15.156:0/2893019961 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b0009da10 0x7f8b00127ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.328+0000 7f8afe7fc700 1 -- 172.21.15.156:0/2893019961 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af800f050 con 0x7f8b0012e490 2023-09-30T22:20:25.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.328+0000 7f8afeffd700 1 --2- 172.21.15.156:0/2893019961 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b0009da10 0x7f8b00127ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:20:25.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.328+0000 7f8afe7fc700 1 --2- 172.21.15.156:0/2893019961 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8b0012e490 0x7f8b00128010 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8af4014fd0 tx=0x7f8af400b470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:25.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.328+0000 7f8ae7fff700 1 -- 172.21.15.156:0/2893019961 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af4019070 con 0x7f8b0012e490 2023-09-30T22:20:25.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.328+0000 7f8b058b0700 1 -- 172.21.15.156:0/2893019961 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b0012b510 con 0x7f8b0012e490 2023-09-30T22:20:25.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.328+0000 7f8ae7fff700 1 -- 172.21.15.156:0/2893019961 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af400bdb0 con 0x7f8b0012e490 2023-09-30T22:20:25.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.328+0000 7f8ae7fff700 1 -- 172.21.15.156:0/2893019961 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af4014a10 con 0x7f8b0012e490 2023-09-30T22:20:25.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.328+0000 7f8b058b0700 1 -- 172.21.15.156:0/2893019961 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b0006fba0 con 0x7f8b0012e490 2023-09-30T22:20:25.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.328+0000 7f5535ff4700 1 Processor -- start 2023-09-30T22:20:25.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.328+0000 7f5535ff4700 1 -- start start 2023-09-30T22:20:25.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.329+0000 7f5535ff4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5530133ad0 0x7f5530133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:25.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.329+0000 7f5535ff4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55301300a0 0x7f55301304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:25.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.329+0000 7f5535ff4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55301309f0 0x7f553013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:25.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.329+0000 7f5535ff4700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f553006b2d0 con 0x7f5530133ad0 2023-09-30T22:20:25.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.329+0000 7f5535ff4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5530133610 con 0x7f55301309f0 2023-09-30T22:20:25.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.329+0000 7f5535ff4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f553009a500 con 0x7f55301300a0 2023-09-30T22:20:25.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.329+0000 7f8ae7fff700 1 -- 172.21.15.156:0/2893019961 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8af401d650 con 0x7f8b0012e490 2023-09-30T22:20:25.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.329+0000 7f8ae7fff700 1 -- 172.21.15.156:0/2893019961 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8af40473c0 con 0x7f8b0012e490 2023-09-30T22:20:25.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.329+0000 7f552f7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5530133ad0 0x7f5530133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:25.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.329+0000 7f552f7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5530133ad0 0x7f5530133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:56948/0 (socket says 172.21.15.156:56948) 2023-09-30T22:20:25.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.329+0000 7f552f7fe700 1 -- 172.21.15.156:0/3400010787 learned_addr learned my addr 172.21.15.156:0/3400010787 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:25.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.329+0000 7f552effd700 1 --2- 172.21.15.156:0/3400010787 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55301300a0 0x7f55301304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:25.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.330+0000 7f552f7fe700 1 -- 172.21.15.156:0/3400010787 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55301300a0 msgr2=0x7f55301304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:25.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.330+0000 7f552f7fe700 1 --2- 172.21.15.156:0/3400010787 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55301300a0 0x7f55301304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.330+0000 7f552f7fe700 1 -- 172.21.15.156:0/3400010787 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55301309f0 msgr2=0x7f553013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:25.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.330+0000 7f552f7fe700 1 --2- 172.21.15.156:0/3400010787 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55301309f0 0x7f553013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.330+0000 7f552f7fe700 1 -- 172.21.15.156:0/3400010787 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55301338b0 con 0x7f5530133ad0 2023-09-30T22:20:25.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.330+0000 7f552f7fe700 1 --2- 172.21.15.156:0/3400010787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5530133ad0 0x7f5530133ea0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f55280098f0 tx=0x7f5528009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba6c6abd5e1dcec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:25.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.330+0000 7f8b058b0700 1 -- 172.21.15.156:0/2893019961 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b0004f2a0 con 0x7f8b0012e490 2023-09-30T22:20:25.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.330+0000 7f552e7fc700 1 -- 172.21.15.156:0/3400010787 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5528011830 con 0x7f5530133ad0 2023-09-30T22:20:25.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.330+0000 7f552e7fc700 1 -- 172.21.15.156:0/3400010787 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5528011990 con 0x7f5530133ad0 2023-09-30T22:20:25.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.330+0000 7f552e7fc700 1 -- 172.21.15.156:0/3400010787 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5528011d20 con 0x7f5530133ad0 2023-09-30T22:20:25.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.331+0000 7f5535ff4700 1 -- 172.21.15.156:0/3400010787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5530133ad0 msgr2=0x7f5530133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:25.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.331+0000 7f5535ff4700 1 --2- 172.21.15.156:0/3400010787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5530133ad0 0x7f5530133ea0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f55280098f0 tx=0x7f5528009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:25.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.331+0000 7f5535ff4700 1 -- 172.21.15.156:0/3400010787 shutdown_connections 2023-09-30T22:20:25.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.331+0000 7f5535ff4700 1 --2- 172.21.15.156:0/3400010787 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55301309f0 0x7f553013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.331+0000 7f5535ff4700 1 --2- 172.21.15.156:0/3400010787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5530133ad0 0x7f5530133ea0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.331+0000 7f5535ff4700 1 --2- 172.21.15.156:0/3400010787 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55301300a0 0x7f55301304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.331+0000 7f5535ff4700 1 -- 172.21.15.156:0/3400010787 >> 172.21.15.156:0/3400010787 conn(0x7f5530099c40 msgr2=0x7f55300a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:25.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.331+0000 7f5535ff4700 1 -- 172.21.15.156:0/3400010787 shutdown_connections 2023-09-30T22:20:25.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.331+0000 7f5535ff4700 1 -- 172.21.15.156:0/3400010787 wait complete. 2023-09-30T22:20:25.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.332+0000 7f5535ff4700 1 Processor -- start 2023-09-30T22:20:25.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.332+0000 7f5535ff4700 1 -- start start 2023-09-30T22:20:25.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.332+0000 7f5535ff4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55301300a0 0x7f553011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:25.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.332+0000 7f5535ff4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55301309f0 0x7f553011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:25.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.333+0000 7f5535ff4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5530133ad0 0x7f553011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:25.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.333+0000 7f5535ff4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553011f080 con 0x7f55301309f0 2023-09-30T22:20:25.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.333+0000 7f5535ff4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55301200c0 con 0x7f5530133ad0 2023-09-30T22:20:25.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.333+0000 7f5535ff4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f553011fb20 con 0x7f55301300a0 2023-09-30T22:20:25.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.333+0000 7f552effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55301309f0 0x7f553011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:25.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.333+0000 7f552effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55301309f0 0x7f553011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:56964/0 (socket says 172.21.15.156:56964) 2023-09-30T22:20:25.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.333+0000 7f552effd700 1 -- 172.21.15.156:0/4103642669 learned_addr learned my addr 172.21.15.156:0/4103642669 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:25.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.333+0000 7f552ffff700 1 --2- 172.21.15.156:0/4103642669 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5530133ad0 0x7f553011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:25.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.333+0000 7f552effd700 1 -- 172.21.15.156:0/4103642669 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55301300a0 msgr2=0x7f553011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:25.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.333+0000 7f552effd700 1 --2- 172.21.15.156:0/4103642669 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55301300a0 0x7f553011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.333+0000 7f552effd700 1 -- 172.21.15.156:0/4103642669 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5530133ad0 msgr2=0x7f553011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:25.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.333+0000 7f552effd700 1 --2- 172.21.15.156:0/4103642669 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5530133ad0 0x7f553011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.333+0000 7f552effd700 1 -- 172.21.15.156:0/4103642669 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5528009550 con 0x7f55301309f0 2023-09-30T22:20:25.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.333+0000 7f552ffff700 1 --2- 172.21.15.156:0/4103642669 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5530133ad0 0x7f553011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:20:25.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.333+0000 7f552effd700 1 --2- 172.21.15.156:0/4103642669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55301309f0 0x7f553011df80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f552400e9e0 tx=0x7f552400eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:25.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.333+0000 7f5517fff700 1 -- 172.21.15.156:0/4103642669 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5524009710 con 0x7f55301309f0 2023-09-30T22:20:25.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.333+0000 7f5517fff700 1 -- 172.21.15.156:0/4103642669 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552400c850 con 0x7f55301309f0 2023-09-30T22:20:25.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.333+0000 7f5535ff4700 1 -- 172.21.15.156:0/4103642669 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f553011f850 con 0x7f55301309f0 2023-09-30T22:20:25.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.333+0000 7f5517fff700 1 -- 172.21.15.156:0/4103642669 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552400cbc0 con 0x7f55301309f0 2023-09-30T22:20:25.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.333+0000 7f5535ff4700 1 -- 172.21.15.156:0/4103642669 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f553012fe90 con 0x7f55301309f0 2023-09-30T22:20:25.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.334+0000 7f5517fff700 1 -- 172.21.15.156:0/4103642669 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f552400cd20 con 0x7f55301309f0 2023-09-30T22:20:25.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.334+0000 7f5517fff700 1 -- 172.21.15.156:0/4103642669 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f552403f860 con 0x7f55301309f0 2023-09-30T22:20:25.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.335+0000 7f5535ff4700 1 -- 172.21.15.156:0/4103642669 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f553004f2a0 con 0x7f55301309f0 2023-09-30T22:20:25.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.336+0000 7f8ae7fff700 1 -- 172.21.15.156:0/2893019961 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8af4022080 con 0x7f8b0012e490 2023-09-30T22:20:25.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.342+0000 7f5517fff700 1 -- 172.21.15.156:0/4103642669 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f55240232f0 con 0x7f55301309f0 2023-09-30T22:20:25.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.486+0000 7fe622190700 1 -- 172.21.15.156:0/2722468053 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe61c06c3b0 con 0x7fe61c09d860 2023-09-30T22:20:25.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.486+0000 7fe603fff700 1 -- 172.21.15.156:0/2722468053 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe60c00dca0 con 0x7fe61c09d860 2023-09-30T22:20:25.486 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:25.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.489+0000 7fe622190700 1 -- 172.21.15.156:0/2722468053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe61c09d860 msgr2=0x7fe61c119ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:25.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.489+0000 7fe622190700 1 --2- 172.21.15.156:0/2722468053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe61c09d860 0x7fe61c119ec0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe60c012fc0 tx=0x7fe60c0103a0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.489+0000 7fe622190700 1 -- 172.21.15.156:0/2722468053 shutdown_connections 2023-09-30T22:20:25.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.489+0000 7fe622190700 1 --2- 172.21.15.156:0/2722468053 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe61c130ce0 0x7fe61c11a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.489+0000 7fe622190700 1 --2- 172.21.15.156:0/2722468053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe61c09d860 0x7fe61c119ec0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.489+0000 7fe622190700 1 --2- 172.21.15.156:0/2722468053 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe61c09e170 0x7fe61c11a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.489+0000 7fe622190700 1 -- 172.21.15.156:0/2722468053 >> 172.21.15.156:0/2722468053 conn(0x7fe61c099c40 msgr2=0x7fe61c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:25.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.489+0000 7fe622190700 1 -- 172.21.15.156:0/2722468053 shutdown_connections 2023-09-30T22:20:25.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.489+0000 7fe622190700 1 -- 172.21.15.156:0/2722468053 wait complete. 2023-09-30T22:20:25.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.501+0000 7fdfa5d57700 1 -- 172.21.15.156:0/1865500735 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdfa011cff0 con 0x7fdfa0133a70 2023-09-30T22:20:25.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.501+0000 7fdf87fff700 1 -- 172.21.15.156:0/1865500735 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdf98011380 con 0x7fdfa0133a70 2023-09-30T22:20:25.501 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:25.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.504+0000 7fdfa5d57700 1 -- 172.21.15.156:0/1865500735 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdfa0133a70 msgr2=0x7fdfa011a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:25.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.504+0000 7fdfa5d57700 1 --2- 172.21.15.156:0/1865500735 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdfa0133a70 0x7fdfa011a3e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdf9800cb90 tx=0x7fdf9800cea0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.504+0000 7fdfa5d57700 1 -- 172.21.15.156:0/1865500735 shutdown_connections 2023-09-30T22:20:25.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.504+0000 7fdfa5d57700 1 --2- 172.21.15.156:0/1865500735 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdfa0133a70 0x7fdfa011a3e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.504+0000 7fdfa5d57700 1 --2- 172.21.15.156:0/1865500735 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdfa00a08e0 0x7fdfa0119960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.504+0000 7fdfa5d57700 1 --2- 172.21.15.156:0/1865500735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdfa00a1290 0x7fdfa0119ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.504+0000 7fdfa5d57700 1 -- 172.21.15.156:0/1865500735 >> 172.21.15.156:0/1865500735 conn(0x7fdfa00a2980 msgr2=0x7fdfa012f840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:25.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.505+0000 7fdfa5d57700 1 -- 172.21.15.156:0/1865500735 shutdown_connections 2023-09-30T22:20:25.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.505+0000 7fdfa5d57700 1 -- 172.21.15.156:0/1865500735 wait complete. 2023-09-30T22:20:25.506 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:25.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:25.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.535+0000 7f8b058b0700 1 -- 172.21.15.156:0/2893019961 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8b0012ed30 con 0x7f8b0012e490 2023-09-30T22:20:25.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.535+0000 7f8ae7fff700 1 -- 172.21.15.156:0/2893019961 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8af4024680 con 0x7f8b0012e490 2023-09-30T22:20:25.535 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:25.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.537+0000 7f8b058b0700 1 -- 172.21.15.156:0/2893019961 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8b0012e490 msgr2=0x7f8b00128010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:25.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.537+0000 7f8b058b0700 1 --2- 172.21.15.156:0/2893019961 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8b0012e490 0x7f8b00128010 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8af4014fd0 tx=0x7f8af400b470 comp rx=0 tx=0).stop 2023-09-30T22:20:25.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.537+0000 7f8b058b0700 1 -- 172.21.15.156:0/2893019961 shutdown_connections 2023-09-30T22:20:25.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.537+0000 7f8b058b0700 1 --2- 172.21.15.156:0/2893019961 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8b00136ca0 0x7f8b0006e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.537+0000 7f8b058b0700 1 --2- 172.21.15.156:0/2893019961 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b0009da10 0x7f8b00127ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.537+0000 7f8b058b0700 1 --2- 172.21.15.156:0/2893019961 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8b0012e490 0x7f8b00128010 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.537+0000 7f8b058b0700 1 -- 172.21.15.156:0/2893019961 >> 172.21.15.156:0/2893019961 conn(0x7f8b00099c40 msgr2=0x7f8b0009a870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:25.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.538+0000 7f8b058b0700 1 -- 172.21.15.156:0/2893019961 shutdown_connections 2023-09-30T22:20:25.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.538+0000 7f8b058b0700 1 -- 172.21.15.156:0/2893019961 wait complete. 2023-09-30T22:20:25.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:25.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.569+0000 7f5535ff4700 1 -- 172.21.15.156:0/4103642669 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f553006c3b0 con 0x7f55301309f0 2023-09-30T22:20:25.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.570+0000 7f5517fff700 1 -- 172.21.15.156:0/4103642669 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5524021030 con 0x7f55301309f0 2023-09-30T22:20:25.570 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:25.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.572+0000 7f5535ff4700 1 -- 172.21.15.156:0/4103642669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55301309f0 msgr2=0x7f553011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:25.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.572+0000 7f5535ff4700 1 --2- 172.21.15.156:0/4103642669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55301309f0 0x7f553011df80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f552400e9e0 tx=0x7f552400eda0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.572+0000 7f5535ff4700 1 -- 172.21.15.156:0/4103642669 shutdown_connections 2023-09-30T22:20:25.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.572+0000 7f5535ff4700 1 --2- 172.21.15.156:0/4103642669 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5530133ad0 0x7f553011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.572+0000 7f5535ff4700 1 --2- 172.21.15.156:0/4103642669 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55301300a0 0x7f553011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.572+0000 7f5535ff4700 1 --2- 172.21.15.156:0/4103642669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55301309f0 0x7f553011df80 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:25.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.572+0000 7f5535ff4700 1 -- 172.21.15.156:0/4103642669 >> 172.21.15.156:0/4103642669 conn(0x7f5530099c40 msgr2=0x7f55301320d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:25.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.572+0000 7f5535ff4700 1 -- 172.21.15.156:0/4103642669 shutdown_connections 2023-09-30T22:20:25.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:25.572+0000 7f5535ff4700 1 -- 172.21.15.156:0/4103642669 wait complete. 2023-09-30T22:20:25.584 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:26.507 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:26.518 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:26.550 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:26.585 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:26.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.652+0000 7eff593a4700 1 Processor -- start 2023-09-30T22:20:26.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.652+0000 7eff593a4700 1 -- start start 2023-09-30T22:20:26.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.652+0000 7eff593a4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff54133ad0 0x7eff54133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:26.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.652+0000 7eff593a4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7eff541300a0 0x7eff541304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:26.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.652+0000 7eff593a4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7eff541309f0 0x7eff5413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:26.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.652+0000 7eff593a4700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff5406b2d0 con 0x7eff541309f0 2023-09-30T22:20:26.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.652+0000 7eff593a4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff54133610 con 0x7eff54133ad0 2023-09-30T22:20:26.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.652+0000 7eff593a4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff5409a500 con 0x7eff541300a0 2023-09-30T22:20:26.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.653+0000 7eff52ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff54133ad0 0x7eff54133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:26.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.653+0000 7eff527fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7eff541300a0 0x7eff541304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:26.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.653+0000 7eff52ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff54133ad0 0x7eff54133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49234/0 (socket says 172.21.15.156:49234) 2023-09-30T22:20:26.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.653+0000 7eff52ffd700 1 -- 172.21.15.156:0/3577266374 learned_addr learned my addr 172.21.15.156:0/3577266374 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:26.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.653+0000 7eff537fe700 1 --2- 172.21.15.156:0/3577266374 >> v2:172.21.15.156:3300/0 conn(0x7eff541309f0 0x7eff5413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:26.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.653+0000 7eff52ffd700 1 -- 172.21.15.156:0/3577266374 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7eff541300a0 msgr2=0x7eff541304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:26.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.653+0000 7eff52ffd700 1 --2- 172.21.15.156:0/3577266374 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7eff541300a0 0x7eff541304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.653+0000 7eff52ffd700 1 -- 172.21.15.156:0/3577266374 >> v2:172.21.15.156:3300/0 conn(0x7eff541309f0 msgr2=0x7eff5413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:26.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.653+0000 7eff52ffd700 1 --2- 172.21.15.156:0/3577266374 >> v2:172.21.15.156:3300/0 conn(0x7eff541309f0 0x7eff5413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.653+0000 7eff52ffd700 1 -- 172.21.15.156:0/3577266374 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff541338b0 con 0x7eff54133ad0 2023-09-30T22:20:26.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.653+0000 7eff52ffd700 1 --2- 172.21.15.156:0/3577266374 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff54133ad0 0x7eff54133ea0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7eff440098f0 tx=0x7eff44009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d50cc2ff1d7c45bc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:26.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.653+0000 7eff51ffb700 1 -- 172.21.15.156:0/3577266374 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44011830 con 0x7eff54133ad0 2023-09-30T22:20:26.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.653+0000 7eff51ffb700 1 -- 172.21.15.156:0/3577266374 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff44011990 con 0x7eff54133ad0 2023-09-30T22:20:26.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.653+0000 7eff51ffb700 1 -- 172.21.15.156:0/3577266374 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44011d20 con 0x7eff54133ad0 2023-09-30T22:20:26.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.654+0000 7eff593a4700 1 -- 172.21.15.156:0/3577266374 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff54133ad0 msgr2=0x7eff54133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:26.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.654+0000 7eff593a4700 1 --2- 172.21.15.156:0/3577266374 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff54133ad0 0x7eff54133ea0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7eff440098f0 tx=0x7eff44009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:26.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.654+0000 7eff593a4700 1 -- 172.21.15.156:0/3577266374 shutdown_connections 2023-09-30T22:20:26.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.654+0000 7eff593a4700 1 --2- 172.21.15.156:0/3577266374 >> v2:172.21.15.156:3300/0 conn(0x7eff541309f0 0x7eff5413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.654+0000 7eff593a4700 1 --2- 172.21.15.156:0/3577266374 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff54133ad0 0x7eff54133ea0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.654+0000 7eff593a4700 1 --2- 172.21.15.156:0/3577266374 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7eff541300a0 0x7eff541304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.654+0000 7eff593a4700 1 -- 172.21.15.156:0/3577266374 >> 172.21.15.156:0/3577266374 conn(0x7eff54099c40 msgr2=0x7eff540a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:26.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.654+0000 7eff593a4700 1 -- 172.21.15.156:0/3577266374 shutdown_connections 2023-09-30T22:20:26.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.654+0000 7eff593a4700 1 -- 172.21.15.156:0/3577266374 wait complete. 2023-09-30T22:20:26.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.655+0000 7eff593a4700 1 Processor -- start 2023-09-30T22:20:26.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.655+0000 7eff593a4700 1 -- start start 2023-09-30T22:20:26.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.656+0000 7eff593a4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7eff541300a0 0x7eff5411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:26.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.656+0000 7eff593a4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff541309f0 0x7eff5411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:26.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.656+0000 7eff593a4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff54133ad0 0x7eff5411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:26.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.656+0000 7eff593a4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5411fde0 con 0x7eff541309f0 2023-09-30T22:20:26.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.656+0000 7eff593a4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5411f850 con 0x7eff54133ad0 2023-09-30T22:20:26.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.656+0000 7eff593a4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff541200c0 con 0x7eff541300a0 2023-09-30T22:20:26.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.656+0000 7eff537fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff54133ad0 0x7eff5411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:26.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.656+0000 7eff537fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff54133ad0 0x7eff5411e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49246/0 (socket says 172.21.15.156:49246) 2023-09-30T22:20:26.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.656+0000 7eff537fe700 1 -- 172.21.15.156:0/1652807364 learned_addr learned my addr 172.21.15.156:0/1652807364 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:26.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.656+0000 7eff527fc700 1 --2- 172.21.15.156:0/1652807364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff541309f0 0x7eff5411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:26.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.656+0000 7eff52ffd700 1 --2- 172.21.15.156:0/1652807364 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7eff541300a0 0x7eff5411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:26.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.656+0000 7eff537fe700 1 -- 172.21.15.156:0/1652807364 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7eff541300a0 msgr2=0x7eff5411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:26.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.656+0000 7eff537fe700 1 --2- 172.21.15.156:0/1652807364 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7eff541300a0 0x7eff5411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.656+0000 7eff537fe700 1 -- 172.21.15.156:0/1652807364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff541309f0 msgr2=0x7eff5411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:26.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.656+0000 7eff537fe700 1 --2- 172.21.15.156:0/1652807364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff541309f0 0x7eff5411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.656+0000 7eff537fe700 1 -- 172.21.15.156:0/1652807364 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff44009550 con 0x7eff54133ad0 2023-09-30T22:20:26.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.657+0000 7eff537fe700 1 --2- 172.21.15.156:0/1652807364 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff54133ad0 0x7eff5411e4c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00efc0 tx=0x7eff4c00c0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:26.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.657+0000 7eff3b7fe700 1 -- 172.21.15.156:0/1652807364 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c00cad0 con 0x7eff54133ad0 2023-09-30T22:20:26.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.657+0000 7eff593a4700 1 -- 172.21.15.156:0/1652807364 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff5411fb20 con 0x7eff54133ad0 2023-09-30T22:20:26.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.657+0000 7eff3b7fe700 1 -- 172.21.15.156:0/1652807364 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4c00f040 con 0x7eff54133ad0 2023-09-30T22:20:26.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.657+0000 7eff3b7fe700 1 -- 172.21.15.156:0/1652807364 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c00ce70 con 0x7eff54133ad0 2023-09-30T22:20:26.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.657+0000 7eff593a4700 1 -- 172.21.15.156:0/1652807364 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff5412fe10 con 0x7eff54133ad0 2023-09-30T22:20:26.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.658+0000 7eff593a4700 1 -- 172.21.15.156:0/1652807364 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff5412dd00 con 0x7eff54133ad0 2023-09-30T22:20:26.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.658+0000 7eff3b7fe700 1 -- 172.21.15.156:0/1652807364 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7eff4c014480 con 0x7eff54133ad0 2023-09-30T22:20:26.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.658+0000 7eff3b7fe700 1 -- 172.21.15.156:0/1652807364 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7eff4c040270 con 0x7eff54133ad0 2023-09-30T22:20:26.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.667+0000 7eff3b7fe700 1 -- 172.21.15.156:0/1652807364 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7eff4c012930 con 0x7eff54133ad0 2023-09-30T22:20:26.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.687+0000 7f609f26b700 1 Processor -- start 2023-09-30T22:20:26.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.687+0000 7f609f26b700 1 -- start start 2023-09-30T22:20:26.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.688+0000 7f609f26b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60980a1510 0x7f60981351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:26.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.688+0000 7f609f26b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f60981356e0 0x7f6098137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:26.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.688+0000 7f609f26b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60980a1e70 con 0x7f60980a0a30 2023-09-30T22:20:26.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.688+0000 7f609f26b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f609809a720 con 0x7f60981356e0 2023-09-30T22:20:26.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.688+0000 7f609f26b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f609809b300 con 0x7f60980a1510 2023-09-30T22:20:26.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.688+0000 7f609c806700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60980a1510 0x7f60981351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:26.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.688+0000 7f609c806700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60980a1510 0x7f60981351a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33656/0 (socket says 172.21.15.156:33656) 2023-09-30T22:20:26.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.688+0000 7f609c806700 1 -- 172.21.15.156:0/438205971 learned_addr learned my addr 172.21.15.156:0/438205971 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:26.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.688+0000 7f609c806700 1 -- 172.21.15.156:0/438205971 >> v2:172.21.15.156:3300/0 conn(0x7f60981356e0 msgr2=0x7f6098137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:26.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.688+0000 7f609c806700 1 --2- 172.21.15.156:0/438205971 >> v2:172.21.15.156:3300/0 conn(0x7f60981356e0 0x7f6098137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.688+0000 7f609c806700 1 -- 172.21.15.156:0/438205971 >> v1:172.21.15.156:6789/0 conn(0x7f60980a0a30 legacy=0x7f60980a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:26.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.688+0000 7f609c806700 1 -- 172.21.15.156:0/438205971 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609809abc0 con 0x7f60980a1510 2023-09-30T22:20:26.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.688+0000 7f608ffff700 1 -- 172.21.15.156:0/438205971 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2191924308 0 0) 0x7f60980a1e70 con 0x7f60980a0a30 2023-09-30T22:20:26.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.689+0000 7f609c806700 1 --2- 172.21.15.156:0/438205971 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60980a1510 0x7f60981351a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f608800bb90 tx=0x7f608800bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f71ddab3b58f23a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:26.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.689+0000 7f608ffff700 1 -- 172.21.15.156:0/438205971 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608800dc40 con 0x7f60980a1510 2023-09-30T22:20:26.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.689+0000 7f608ffff700 1 -- 172.21.15.156:0/438205971 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608800dda0 con 0x7f60980a1510 2023-09-30T22:20:26.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.689+0000 7f608ffff700 1 -- 172.21.15.156:0/438205971 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6088017630 con 0x7f60980a1510 2023-09-30T22:20:26.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.690+0000 7f609f26b700 1 -- 172.21.15.156:0/438205971 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60980a1510 msgr2=0x7f60981351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:26.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.690+0000 7f609f26b700 1 --2- 172.21.15.156:0/438205971 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60980a1510 0x7f60981351a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f608800bb90 tx=0x7f608800bea0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.690+0000 7f609f26b700 1 -- 172.21.15.156:0/438205971 shutdown_connections 2023-09-30T22:20:26.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.690+0000 7f609f26b700 1 --2- 172.21.15.156:0/438205971 >> v2:172.21.15.156:3300/0 conn(0x7f60981356e0 0x7f6098137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.690+0000 7f609f26b700 1 --2- 172.21.15.156:0/438205971 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60980a1510 0x7f60981351a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.690+0000 7f609f26b700 1 -- 172.21.15.156:0/438205971 >> 172.21.15.156:0/438205971 conn(0x7f60980a2980 msgr2=0x7f60980a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:26.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.690+0000 7f609f26b700 1 -- 172.21.15.156:0/438205971 shutdown_connections 2023-09-30T22:20:26.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.690+0000 7f609f26b700 1 -- 172.21.15.156:0/438205971 wait complete. 2023-09-30T22:20:26.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.690+0000 7fb028cfc700 1 Processor -- start 2023-09-30T22:20:26.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.690+0000 7fb028cfc700 1 -- start start 2023-09-30T22:20:26.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.691+0000 7f609f26b700 1 Processor -- start 2023-09-30T22:20:26.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.691+0000 7f609f26b700 1 -- start start 2023-09-30T22:20:26.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.691+0000 7fb028cfc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb02409d860 0x7fb02409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:26.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.691+0000 7fb028cfc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb02409e170 0x7fb0241307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:26.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.691+0000 7fb028cfc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb024130ce0 0x7fb024131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:26.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.691+0000 7fb028cfc700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb02409aaa0 con 0x7fb024130ce0 2023-09-30T22:20:26.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.691+0000 7fb028cfc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02409f870 con 0x7fb02409e170 2023-09-30T22:20:26.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.691+0000 7fb028cfc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb02409b360 con 0x7fb02409d860 2023-09-30T22:20:26.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.691+0000 7fb021d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb02409e170 0x7fb0241307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:26.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.691+0000 7fb021d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb02409e170 0x7fb0241307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49260/0 (socket says 172.21.15.156:49260) 2023-09-30T22:20:26.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.691+0000 7fb021d9b700 1 -- 172.21.15.156:0/2627862602 learned_addr learned my addr 172.21.15.156:0/2627862602 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:26.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.691+0000 7f609f26b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60980a0a30 0x7f60981c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:26.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.691+0000 7f609f26b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60980a1510 0x7f60981c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:26.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.691+0000 7f609f26b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60981356e0 0x7f6098118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:26.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.691+0000 7f609f26b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609809ae70 con 0x7f60980a1510 2023-09-30T22:20:26.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.691+0000 7f609f26b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609811bca0 con 0x7f60981356e0 2023-09-30T22:20:26.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.691+0000 7f609f26b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60981c3e00 con 0x7f60980a0a30 2023-09-30T22:20:26.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.691+0000 7f609d007700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60980a0a30 0x7f60981c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:26.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.691+0000 7f609d007700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60980a0a30 0x7f60981c4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33672/0 (socket says 172.21.15.156:33672) 2023-09-30T22:20:26.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.691+0000 7f609d007700 1 -- 172.21.15.156:0/2945511034 learned_addr learned my addr 172.21.15.156:0/2945511034 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:26.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.691+0000 7fb02259c700 1 --2- 172.21.15.156:0/2627862602 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb02409d860 0x7fb02409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:26.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.691+0000 7fb021d9b700 1 -- 172.21.15.156:0/2627862602 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb02409d860 msgr2=0x7fb02409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:26.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.692+0000 7f609d808700 1 --2- 172.21.15.156:0/2945511034 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60981356e0 0x7f6098118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:26.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.692+0000 7fb021d9b700 1 --2- 172.21.15.156:0/2627862602 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb02409d860 0x7fb02409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.692+0000 7fb021d9b700 1 -- 172.21.15.156:0/2627862602 >> v2:172.21.15.156:3300/0 conn(0x7fb024130ce0 msgr2=0x7fb024131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:26.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.692+0000 7fb021d9b700 1 --2- 172.21.15.156:0/2627862602 >> v2:172.21.15.156:3300/0 conn(0x7fb024130ce0 0x7fb024131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.692+0000 7fb021d9b700 1 -- 172.21.15.156:0/2627862602 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02409b620 con 0x7fb02409e170 2023-09-30T22:20:26.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.692+0000 7fb02259c700 1 --2- 172.21.15.156:0/2627862602 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb02409d860 0x7fb02409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:20:26.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.692+0000 7f609d007700 1 -- 172.21.15.156:0/2945511034 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60981356e0 msgr2=0x7f6098118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:26.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.692+0000 7f609d007700 1 --2- 172.21.15.156:0/2945511034 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60981356e0 0x7f6098118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.692+0000 7f609d007700 1 -- 172.21.15.156:0/2945511034 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60980a1510 msgr2=0x7f60981c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:26.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.692+0000 7f609d007700 1 --2- 172.21.15.156:0/2945511034 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60980a1510 0x7f60981c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.692+0000 7f609d007700 1 -- 172.21.15.156:0/2945511034 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608800b7f0 con 0x7f60980a0a30 2023-09-30T22:20:26.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.692+0000 7f609d808700 1 --2- 172.21.15.156:0/2945511034 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60981356e0 0x7f6098118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:26.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.692+0000 7fb021d9b700 1 --2- 172.21.15.156:0/2627862602 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb02409e170 0x7fb0241307a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb0180098f0 tx=0x7fb018009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ee98d73d2e69713 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:26.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.692+0000 7f609d007700 1 --2- 172.21.15.156:0/2945511034 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60980a0a30 0x7f60981c4030 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f609400c550 tx=0x7f609400c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:26.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.692+0000 7fb02159a700 1 -- 172.21.15.156:0/2627862602 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01800b8a0 con 0x7fb02409e170 2023-09-30T22:20:26.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.692+0000 7fb02159a700 1 -- 172.21.15.156:0/2627862602 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01800ba00 con 0x7fb02409e170 2023-09-30T22:20:26.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.692+0000 7fb02159a700 1 -- 172.21.15.156:0/2627862602 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01800bd90 con 0x7fb02409e170 2023-09-30T22:20:26.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.692+0000 7f608dffb700 1 -- 172.21.15.156:0/2945511034 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60940054e0 con 0x7f60980a0a30 2023-09-30T22:20:26.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.692+0000 7f608dffb700 1 -- 172.21.15.156:0/2945511034 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6094003680 con 0x7f60980a0a30 2023-09-30T22:20:26.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.692+0000 7f609f26b700 1 -- 172.21.15.156:0/2945511034 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609811b250 con 0x7f60980a0a30 2023-09-30T22:20:26.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.692+0000 7f608dffb700 1 -- 172.21.15.156:0/2945511034 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094003a30 con 0x7f60980a0a30 2023-09-30T22:20:26.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.693+0000 7f609f26b700 1 -- 172.21.15.156:0/2945511034 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609811a090 con 0x7f60980a0a30 2023-09-30T22:20:26.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.693+0000 7fb028cfc700 1 -- 172.21.15.156:0/2627862602 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb02409e170 msgr2=0x7fb0241307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:26.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.693+0000 7fb028cfc700 1 --2- 172.21.15.156:0/2627862602 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb02409e170 0x7fb0241307a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb0180098f0 tx=0x7fb018009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:26.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.693+0000 7f608dffb700 1 -- 172.21.15.156:0/2945511034 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6094003b90 con 0x7f60980a0a30 2023-09-30T22:20:26.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.693+0000 7fb028cfc700 1 -- 172.21.15.156:0/2627862602 shutdown_connections 2023-09-30T22:20:26.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.693+0000 7fb028cfc700 1 --2- 172.21.15.156:0/2627862602 >> v2:172.21.15.156:3300/0 conn(0x7fb024130ce0 0x7fb024131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.693+0000 7fb028cfc700 1 --2- 172.21.15.156:0/2627862602 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb02409d860 0x7fb02409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.693+0000 7fb028cfc700 1 --2- 172.21.15.156:0/2627862602 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb02409e170 0x7fb0241307a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.693+0000 7fb028cfc700 1 -- 172.21.15.156:0/2627862602 >> 172.21.15.156:0/2627862602 conn(0x7fb024099c40 msgr2=0x7fb0240a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:26.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.694+0000 7fb028cfc700 1 -- 172.21.15.156:0/2627862602 shutdown_connections 2023-09-30T22:20:26.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.694+0000 7fb028cfc700 1 -- 172.21.15.156:0/2627862602 wait complete. 2023-09-30T22:20:26.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.694+0000 7f609f26b700 1 -- 172.21.15.156:0/2945511034 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60780052e0 con 0x7f60980a0a30 2023-09-30T22:20:26.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.694+0000 7f608dffb700 1 -- 172.21.15.156:0/2945511034 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6094019d70 con 0x7f60980a0a30 2023-09-30T22:20:26.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.695+0000 7fb028cfc700 1 Processor -- start 2023-09-30T22:20:26.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.695+0000 7fb028cfc700 1 -- start start 2023-09-30T22:20:26.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.696+0000 7fb028cfc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb02409d860 0x7fb0241cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:26.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.696+0000 7fb028cfc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb02409e170 0x7fb0241ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:26.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.696+0000 7fb028cfc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb024130ce0 0x7fb0241cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:26.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.696+0000 7fb028cfc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0240a33c0 con 0x7fb02409e170 2023-09-30T22:20:26.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.696+0000 7fb028cfc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02411f160 con 0x7fb02409d860 2023-09-30T22:20:26.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.696+0000 7fb028cfc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb02412ef90 con 0x7fb024130ce0 2023-09-30T22:20:26.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.696+0000 7fb02259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb02409d860 0x7fb0241cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:26.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.696+0000 7fb02259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb02409d860 0x7fb0241cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49288/0 (socket says 172.21.15.156:49288) 2023-09-30T22:20:26.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.696+0000 7fb02259c700 1 -- 172.21.15.156:0/3296079110 learned_addr learned my addr 172.21.15.156:0/3296079110 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:26.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.696+0000 7fb021d9b700 1 --2- 172.21.15.156:0/3296079110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb02409e170 0x7fb0241ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:26.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.696+0000 7fb022d9d700 1 --2- 172.21.15.156:0/3296079110 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb024130ce0 0x7fb0241cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:26.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.697+0000 7fb02259c700 1 -- 172.21.15.156:0/3296079110 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb024130ce0 msgr2=0x7fb0241cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:26.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.697+0000 7fb02259c700 1 --2- 172.21.15.156:0/3296079110 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb024130ce0 0x7fb0241cd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.697+0000 7fb02259c700 1 -- 172.21.15.156:0/3296079110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb02409e170 msgr2=0x7fb0241ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:26.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.697+0000 7fb02259c700 1 --2- 172.21.15.156:0/3296079110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb02409e170 0x7fb0241ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.697+0000 7fb02259c700 1 -- 172.21.15.156:0/3296079110 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb018009550 con 0x7fb02409d860 2023-09-30T22:20:26.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.697+0000 7fb021d9b700 1 --2- 172.21.15.156:0/3296079110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb02409e170 0x7fb0241ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:26.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.697+0000 7fb02259c700 1 --2- 172.21.15.156:0/3296079110 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb02409d860 0x7fb0241cc650 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb01400c750 tx=0x7fb01400ca60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:26.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.697+0000 7fb012ffd700 1 -- 172.21.15.156:0/3296079110 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb014011800 con 0x7fb02409d860 2023-09-30T22:20:26.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.697+0000 7fb012ffd700 1 -- 172.21.15.156:0/3296079110 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb014011960 con 0x7fb02409d860 2023-09-30T22:20:26.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.697+0000 7fb012ffd700 1 -- 172.21.15.156:0/3296079110 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb014011cd0 con 0x7fb02409d860 2023-09-30T22:20:26.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.697+0000 7fb028cfc700 1 -- 172.21.15.156:0/3296079110 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02412f1d0 con 0x7fb02409d860 2023-09-30T22:20:26.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.697+0000 7fb028cfc700 1 -- 172.21.15.156:0/3296079110 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02406aa70 con 0x7fb02409d860 2023-09-30T22:20:26.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.699+0000 7fb012ffd700 1 -- 172.21.15.156:0/3296079110 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb014021350 con 0x7fb02409d860 2023-09-30T22:20:26.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.699+0000 7fb028cfc700 1 -- 172.21.15.156:0/3296079110 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb024130450 con 0x7fb02409d860 2023-09-30T22:20:26.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.699+0000 7fb012ffd700 1 -- 172.21.15.156:0/3296079110 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb01403f6b0 con 0x7fb02409d860 2023-09-30T22:20:26.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.702+0000 7f608dffb700 1 -- 172.21.15.156:0/2945511034 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6094017030 con 0x7f60980a0a30 2023-09-30T22:20:26.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.708+0000 7fb012ffd700 1 -- 172.21.15.156:0/3296079110 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb014011e30 con 0x7fb02409d860 2023-09-30T22:20:26.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.744+0000 7fb720087700 1 Processor -- start 2023-09-30T22:20:26.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.745+0000 7fb720087700 1 -- start start 2023-09-30T22:20:26.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.745+0000 7fb720087700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7180a0a70 0x7fb7180a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:26.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.745+0000 7fb720087700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb718134120 0x7fb71813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:26.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.745+0000 7fb720087700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb71809dc00 con 0x7fb7180a1380 2023-09-30T22:20:26.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.745+0000 7fb720087700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb71809ea60 con 0x7fb718134120 2023-09-30T22:20:26.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.745+0000 7fb720087700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb71809dec0 con 0x7fb7180a0a70 2023-09-30T22:20:26.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.746+0000 7fb71e624700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb718134120 0x7fb71813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:26.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.746+0000 7fb71de23700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7180a0a70 0x7fb7180a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:26.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.746+0000 7fb71e624700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb718134120 0x7fb71813bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:57034/0 (socket says 172.21.15.156:57034) 2023-09-30T22:20:26.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.746+0000 7fb71e624700 1 -- 172.21.15.156:0/424209709 learned_addr learned my addr 172.21.15.156:0/424209709 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:26.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.746+0000 7fb71de23700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7180a0a70 0x7fb7180a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33684/0 (socket says 172.21.15.156:33684) 2023-09-30T22:20:26.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.746+0000 7fb71de23700 1 -- 172.21.15.156:0/424209709 >> v2:172.21.15.156:3300/0 conn(0x7fb718134120 msgr2=0x7fb71813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:26.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.746+0000 7fb71de23700 1 --2- 172.21.15.156:0/424209709 >> v2:172.21.15.156:3300/0 conn(0x7fb718134120 0x7fb71813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.746+0000 7fb71de23700 1 -- 172.21.15.156:0/424209709 >> v1:172.21.15.156:6789/0 conn(0x7fb7180a1380 legacy=0x7fb718133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:26.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.746+0000 7fb71de23700 1 -- 172.21.15.156:0/424209709 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71809e6a0 con 0x7fb7180a0a70 2023-09-30T22:20:26.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.746+0000 7fb71e624700 1 --2- 172.21.15.156:0/424209709 >> v2:172.21.15.156:3300/0 conn(0x7fb718134120 0x7fb71813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:26.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.746+0000 7fb71de23700 1 --2- 172.21.15.156:0/424209709 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7180a0a70 0x7fb7180a0e40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb714009840 tx=0x7fb714009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cf21ea943b00607 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:26.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.746+0000 7fb71ce21700 1 -- 172.21.15.156:0/424209709 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb714011830 con 0x7fb7180a0a70 2023-09-30T22:20:26.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.746+0000 7fb71ce21700 1 -- 172.21.15.156:0/424209709 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb714011990 con 0x7fb7180a0a70 2023-09-30T22:20:26.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.746+0000 7fb71ce21700 1 -- 172.21.15.156:0/424209709 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb714011d20 con 0x7fb7180a0a70 2023-09-30T22:20:26.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.747+0000 7fb720087700 1 -- 172.21.15.156:0/424209709 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7180a0a70 msgr2=0x7fb7180a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:26.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.747+0000 7fb720087700 1 --2- 172.21.15.156:0/424209709 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7180a0a70 0x7fb7180a0e40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb714009840 tx=0x7fb714009b50 comp rx=0 tx=0).stop 2023-09-30T22:20:26.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.747+0000 7fb720087700 1 -- 172.21.15.156:0/424209709 shutdown_connections 2023-09-30T22:20:26.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.747+0000 7fb720087700 1 --2- 172.21.15.156:0/424209709 >> v2:172.21.15.156:3300/0 conn(0x7fb718134120 0x7fb71813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.747+0000 7fb720087700 1 --2- 172.21.15.156:0/424209709 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7180a0a70 0x7fb7180a0e40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.747+0000 7fb720087700 1 -- 172.21.15.156:0/424209709 >> 172.21.15.156:0/424209709 conn(0x7fb7180a6610 msgr2=0x7fb7180a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:26.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.747+0000 7fb720087700 1 -- 172.21.15.156:0/424209709 shutdown_connections 2023-09-30T22:20:26.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.747+0000 7fb720087700 1 -- 172.21.15.156:0/424209709 wait complete. 2023-09-30T22:20:26.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.748+0000 7fb720087700 1 Processor -- start 2023-09-30T22:20:26.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.749+0000 7fb720087700 1 -- start start 2023-09-30T22:20:26.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.749+0000 7fb720087700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7180a0a70 0x7fb718122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:26.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.749+0000 7fb720087700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7180a1380 0x7fb718122eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:26.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.749+0000 7fb720087700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb718134120 0x7fb7181233f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:26.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.749+0000 7fb720087700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb718133a90 con 0x7fb7180a0a70 2023-09-30T22:20:26.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.749+0000 7fb720087700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7180a03e0 con 0x7fb7180a1380 2023-09-30T22:20:26.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.749+0000 7fb720087700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7181337f0 con 0x7fb718134120 2023-09-30T22:20:26.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.749+0000 7fb71d622700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7180a1380 0x7fb718122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:26.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.749+0000 7fb71d622700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7180a1380 0x7fb718122eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49290/0 (socket says 172.21.15.156:49290) 2023-09-30T22:20:26.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.749+0000 7fb71d622700 1 -- 172.21.15.156:0/2724580756 learned_addr learned my addr 172.21.15.156:0/2724580756 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:26.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.749+0000 7fb71e624700 1 --2- 172.21.15.156:0/2724580756 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb718134120 0x7fb7181233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:26.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.749+0000 7fb71de23700 1 --2- 172.21.15.156:0/2724580756 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7180a0a70 0x7fb718122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:26.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.750+0000 7fb71d622700 1 -- 172.21.15.156:0/2724580756 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb718134120 msgr2=0x7fb7181233f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:26.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.750+0000 7fb71d622700 1 --2- 172.21.15.156:0/2724580756 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb718134120 0x7fb7181233f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.750+0000 7fb71d622700 1 -- 172.21.15.156:0/2724580756 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7180a0a70 msgr2=0x7fb718122970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:26.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.750+0000 7fb71d622700 1 --2- 172.21.15.156:0/2724580756 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7180a0a70 0x7fb718122970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.750+0000 7fb71d622700 1 -- 172.21.15.156:0/2724580756 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb710009b30 con 0x7fb7180a1380 2023-09-30T22:20:26.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.750+0000 7fb71e624700 1 --2- 172.21.15.156:0/2724580756 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb718134120 0x7fb7181233f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:26.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.750+0000 7fb71d622700 1 --2- 172.21.15.156:0/2724580756 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7180a1380 0x7fb718122eb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb70800c4b0 tx=0x7fb70800c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:26.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.750+0000 7fb70e7fc700 1 -- 172.21.15.156:0/2724580756 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7080052d0 con 0x7fb7180a1380 2023-09-30T22:20:26.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.750+0000 7fb70e7fc700 1 -- 172.21.15.156:0/2724580756 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb708005430 con 0x7fb7180a1380 2023-09-30T22:20:26.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.750+0000 7fb720087700 1 -- 172.21.15.156:0/2724580756 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7140094a0 con 0x7fb7180a1380 2023-09-30T22:20:26.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.750+0000 7fb70e7fc700 1 -- 172.21.15.156:0/2724580756 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7080038c0 con 0x7fb7180a1380 2023-09-30T22:20:26.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.750+0000 7fb720087700 1 -- 172.21.15.156:0/2724580756 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb718126b50 con 0x7fb7180a1380 2023-09-30T22:20:26.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.751+0000 7fb70e7fc700 1 -- 172.21.15.156:0/2724580756 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb708003a20 con 0x7fb7180a1380 2023-09-30T22:20:26.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.751+0000 7fb70e7fc700 1 -- 172.21.15.156:0/2724580756 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb70803ea30 con 0x7fb7180a1380 2023-09-30T22:20:26.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.754+0000 7fb720087700 1 -- 172.21.15.156:0/2724580756 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb718125f30 con 0x7fb7180a1380 2023-09-30T22:20:26.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.763+0000 7fb70e7fc700 1 -- 172.21.15.156:0/2724580756 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb708017080 con 0x7fb7180a1380 2023-09-30T22:20:26.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.875+0000 7eff593a4700 1 -- 172.21.15.156:0/1652807364 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7eff5404f2a0 con 0x7eff54133ad0 2023-09-30T22:20:26.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.875+0000 7eff3b7fe700 1 -- 172.21.15.156:0/1652807364 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7eff4c012340 con 0x7eff54133ad0 2023-09-30T22:20:26.875 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:26.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.877+0000 7eff593a4700 1 -- 172.21.15.156:0/1652807364 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff54133ad0 msgr2=0x7eff5411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:26.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.877+0000 7eff593a4700 1 --2- 172.21.15.156:0/1652807364 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff54133ad0 0x7eff5411e4c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00efc0 tx=0x7eff4c00c0c0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.877+0000 7eff593a4700 1 -- 172.21.15.156:0/1652807364 shutdown_connections 2023-09-30T22:20:26.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.877+0000 7eff593a4700 1 --2- 172.21.15.156:0/1652807364 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff54133ad0 0x7eff5411e4c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.877+0000 7eff593a4700 1 --2- 172.21.15.156:0/1652807364 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7eff541300a0 0x7eff5411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.877+0000 7eff593a4700 1 --2- 172.21.15.156:0/1652807364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff541309f0 0x7eff5411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.877+0000 7eff593a4700 1 -- 172.21.15.156:0/1652807364 >> 172.21.15.156:0/1652807364 conn(0x7eff54099c40 msgr2=0x7eff5412e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:26.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.877+0000 7eff593a4700 1 -- 172.21.15.156:0/1652807364 shutdown_connections 2023-09-30T22:20:26.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.877+0000 7eff593a4700 1 -- 172.21.15.156:0/1652807364 wait complete. 2023-09-30T22:20:26.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:26.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.903+0000 7f609f26b700 1 -- 172.21.15.156:0/2945511034 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6078005590 con 0x7f60980a0a30 2023-09-30T22:20:26.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.903+0000 7f608dffb700 1 -- 172.21.15.156:0/2945511034 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6094019b40 con 0x7f60980a0a30 2023-09-30T22:20:26.903 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:26.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.905+0000 7f609f26b700 1 -- 172.21.15.156:0/2945511034 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60980a0a30 msgr2=0x7f60981c4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:26.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.906+0000 7f609f26b700 1 --2- 172.21.15.156:0/2945511034 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60980a0a30 0x7f60981c4030 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f609400c550 tx=0x7f609400c860 comp rx=0 tx=0).stop 2023-09-30T22:20:26.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.906+0000 7f609f26b700 1 -- 172.21.15.156:0/2945511034 shutdown_connections 2023-09-30T22:20:26.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.906+0000 7f609f26b700 1 --2- 172.21.15.156:0/2945511034 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60981356e0 0x7f6098118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.906+0000 7f609f26b700 1 --2- 172.21.15.156:0/2945511034 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60980a0a30 0x7f60981c4030 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.906+0000 7f609f26b700 1 --2- 172.21.15.156:0/2945511034 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60980a1510 0x7f60981c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.906+0000 7f609f26b700 1 -- 172.21.15.156:0/2945511034 >> 172.21.15.156:0/2945511034 conn(0x7f60980a2980 msgr2=0x7f6098130a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:26.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.906+0000 7f609f26b700 1 -- 172.21.15.156:0/2945511034 shutdown_connections 2023-09-30T22:20:26.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.906+0000 7f609f26b700 1 -- 172.21.15.156:0/2945511034 wait complete. 2023-09-30T22:20:26.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:26.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.920+0000 7fb028cfc700 1 -- 172.21.15.156:0/3296079110 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb02404f2a0 con 0x7fb02409d860 2023-09-30T22:20:26.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.920+0000 7fb012ffd700 1 -- 172.21.15.156:0/3296079110 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb014017af0 con 0x7fb02409d860 2023-09-30T22:20:26.920 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:26.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.922+0000 7fb028cfc700 1 -- 172.21.15.156:0/3296079110 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb02409d860 msgr2=0x7fb0241cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:26.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.922+0000 7fb028cfc700 1 --2- 172.21.15.156:0/3296079110 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb02409d860 0x7fb0241cc650 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb01400c750 tx=0x7fb01400ca60 comp rx=0 tx=0).stop 2023-09-30T22:20:26.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.922+0000 7fb028cfc700 1 -- 172.21.15.156:0/3296079110 shutdown_connections 2023-09-30T22:20:26.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.922+0000 7fb028cfc700 1 --2- 172.21.15.156:0/3296079110 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb024130ce0 0x7fb0241cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.922+0000 7fb028cfc700 1 --2- 172.21.15.156:0/3296079110 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb02409d860 0x7fb0241cc650 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.922+0000 7fb028cfc700 1 --2- 172.21.15.156:0/3296079110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb02409e170 0x7fb0241ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.922+0000 7fb028cfc700 1 -- 172.21.15.156:0/3296079110 >> 172.21.15.156:0/3296079110 conn(0x7fb024099c40 msgr2=0x7fb024119630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:26.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.922+0000 7fb028cfc700 1 -- 172.21.15.156:0/3296079110 shutdown_connections 2023-09-30T22:20:26.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.923+0000 7fb028cfc700 1 -- 172.21.15.156:0/3296079110 wait complete. 2023-09-30T22:20:26.934 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:26.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.959+0000 7fb720087700 1 -- 172.21.15.156:0/2724580756 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb71804f2a0 con 0x7fb7180a1380 2023-09-30T22:20:26.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.959+0000 7fb70e7fc700 1 -- 172.21.15.156:0/2724580756 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb708018260 con 0x7fb7180a1380 2023-09-30T22:20:26.959 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:26.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.961+0000 7fb720087700 1 -- 172.21.15.156:0/2724580756 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7180a1380 msgr2=0x7fb718122eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:26.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.961+0000 7fb720087700 1 --2- 172.21.15.156:0/2724580756 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7180a1380 0x7fb718122eb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb70800c4b0 tx=0x7fb70800c7c0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.961+0000 7fb720087700 1 -- 172.21.15.156:0/2724580756 shutdown_connections 2023-09-30T22:20:26.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.961+0000 7fb720087700 1 --2- 172.21.15.156:0/2724580756 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb718134120 0x7fb7181233f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.961+0000 7fb720087700 1 --2- 172.21.15.156:0/2724580756 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7180a0a70 0x7fb718122970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.961+0000 7fb720087700 1 --2- 172.21.15.156:0/2724580756 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7180a1380 0x7fb718122eb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:26.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.961+0000 7fb720087700 1 -- 172.21.15.156:0/2724580756 >> 172.21.15.156:0/2724580756 conn(0x7fb7180a6610 msgr2=0x7fb7180a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:26.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.961+0000 7fb720087700 1 -- 172.21.15.156:0/2724580756 shutdown_connections 2023-09-30T22:20:26.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:26.961+0000 7fb720087700 1 -- 172.21.15.156:0/2724580756 wait complete. 2023-09-30T22:20:26.973 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:27.895 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:27.918 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:27.935 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:27.975 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:28.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.040+0000 7f02bc8f5700 1 Processor -- start 2023-09-30T22:20:28.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.041+0000 7f02bc8f5700 1 -- start start 2023-09-30T22:20:28.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.041+0000 7f02bc8f5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f02b809d860 0x7f02b809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:28.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.041+0000 7f02bc8f5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02b809e170 0x7f02b81307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:28.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.042+0000 7f02bc8f5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02b8130ce0 0x7f02b8131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:28.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.042+0000 7f02bc8f5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b8131670 con 0x7f02b809d860 2023-09-30T22:20:28.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.042+0000 7f02bc8f5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b809aaa0 con 0x7f02b809e170 2023-09-30T22:20:28.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.042+0000 7f02bc8f5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02b809f870 con 0x7f02b8130ce0 2023-09-30T22:20:28.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.042+0000 7f02b659c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f02b809d860 0x7f02b809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:28.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.042+0000 7f02b659c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f02b809d860 0x7f02b809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:57056/0 (socket says 172.21.15.156:57056) 2023-09-30T22:20:28.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.042+0000 7f02b659c700 1 -- 172.21.15.156:0/2997306734 learned_addr learned my addr 172.21.15.156:0/2997306734 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:28.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.042+0000 7f02b5d9b700 1 --2- 172.21.15.156:0/2997306734 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02b809e170 0x7f02b81307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:28.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.042+0000 7f02b659c700 1 -- 172.21.15.156:0/2997306734 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02b8130ce0 msgr2=0x7f02b8131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:28.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.042+0000 7f02b659c700 1 --2- 172.21.15.156:0/2997306734 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02b8130ce0 0x7f02b8131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.042+0000 7f02b659c700 1 -- 172.21.15.156:0/2997306734 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02b809e170 msgr2=0x7f02b81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:28.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.042+0000 7f02b659c700 1 --2- 172.21.15.156:0/2997306734 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02b809e170 0x7f02b81307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.042+0000 7f02b659c700 1 -- 172.21.15.156:0/2997306734 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b809b360 con 0x7f02b809d860 2023-09-30T22:20:28.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.042+0000 7f02b659c700 1 --2- 172.21.15.156:0/2997306734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02b809d860 0x7f02b809dc30 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f02a800bbc0 tx=0x7f02a800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db03c9febf7951db server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:28.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.042+0000 7f02b559a700 1 -- 172.21.15.156:0/2997306734 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a800dd50 con 0x7f02b809d860 2023-09-30T22:20:28.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.042+0000 7f02b559a700 1 -- 172.21.15.156:0/2997306734 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a8010470 con 0x7f02b809d860 2023-09-30T22:20:28.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.042+0000 7f02b559a700 1 -- 172.21.15.156:0/2997306734 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a8010800 con 0x7f02b809d860 2023-09-30T22:20:28.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.043+0000 7f02bc8f5700 1 -- 172.21.15.156:0/2997306734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02b809d860 msgr2=0x7f02b809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:28.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.043+0000 7f02bc8f5700 1 --2- 172.21.15.156:0/2997306734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02b809d860 0x7f02b809dc30 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f02a800bbc0 tx=0x7f02a800bed0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.044+0000 7f02bc8f5700 1 -- 172.21.15.156:0/2997306734 shutdown_connections 2023-09-30T22:20:28.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.044+0000 7f02bc8f5700 1 --2- 172.21.15.156:0/2997306734 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02b8130ce0 0x7f02b8131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.044+0000 7f02bc8f5700 1 --2- 172.21.15.156:0/2997306734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02b809d860 0x7f02b809dc30 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.044+0000 7f02bc8f5700 1 --2- 172.21.15.156:0/2997306734 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02b809e170 0x7f02b81307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.044+0000 7f02bc8f5700 1 -- 172.21.15.156:0/2997306734 >> 172.21.15.156:0/2997306734 conn(0x7f02b8099c40 msgr2=0x7f02b80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:28.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.044+0000 7f02bc8f5700 1 -- 172.21.15.156:0/2997306734 shutdown_connections 2023-09-30T22:20:28.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.044+0000 7f02bc8f5700 1 -- 172.21.15.156:0/2997306734 wait complete. 2023-09-30T22:20:28.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.045+0000 7f02bc8f5700 1 Processor -- start 2023-09-30T22:20:28.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.045+0000 7f02bc8f5700 1 -- start start 2023-09-30T22:20:28.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.045+0000 7f02bc8f5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02b809d860 0x7f02b811e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:28.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.045+0000 7f02bc8f5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02b809e170 0x7f02b811e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:28.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.045+0000 7f02bc8f5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02b8130ce0 0x7f02b811eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:28.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.045+0000 7f02bc8f5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b8121880 con 0x7f02b809d860 2023-09-30T22:20:28.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.045+0000 7f02bc8f5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b80a0660 con 0x7f02b8130ce0 2023-09-30T22:20:28.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.045+0000 7f02bc8f5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02b809c8b0 con 0x7f02b809e170 2023-09-30T22:20:28.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.045+0000 7f02b6d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02b8130ce0 0x7f02b811eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:28.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.045+0000 7f02b5d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02b809e170 0x7f02b811e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:28.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.045+0000 7f02b6d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02b8130ce0 0x7f02b811eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49312/0 (socket says 172.21.15.156:49312) 2023-09-30T22:20:28.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.045+0000 7f02b6d9d700 1 -- 172.21.15.156:0/2758522353 learned_addr learned my addr 172.21.15.156:0/2758522353 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:28.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.046+0000 7f02b659c700 1 --2- 172.21.15.156:0/2758522353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02b809d860 0x7f02b811e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:28.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.046+0000 7f02b6d9d700 1 -- 172.21.15.156:0/2758522353 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02b809e170 msgr2=0x7f02b811e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:28.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.046+0000 7f02b6d9d700 1 --2- 172.21.15.156:0/2758522353 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02b809e170 0x7f02b811e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.046+0000 7f02b6d9d700 1 -- 172.21.15.156:0/2758522353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02b809d860 msgr2=0x7f02b811e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:28.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.046+0000 7f02b6d9d700 1 --2- 172.21.15.156:0/2758522353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02b809d860 0x7f02b811e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.046+0000 7f02b6d9d700 1 -- 172.21.15.156:0/2758522353 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a800b7f0 con 0x7f02b8130ce0 2023-09-30T22:20:28.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.046+0000 7f02b5d9b700 1 --2- 172.21.15.156:0/2758522353 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02b809e170 0x7f02b811e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:20:28.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.046+0000 7f02b6d9d700 1 --2- 172.21.15.156:0/2758522353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02b8130ce0 0x7f02b811eb40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f02b000b970 tx=0x7f02b000bc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:28.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.046+0000 7f02a6ffd700 1 -- 172.21.15.156:0/2758522353 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b000c930 con 0x7f02b8130ce0 2023-09-30T22:20:28.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.046+0000 7f02a6ffd700 1 -- 172.21.15.156:0/2758522353 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b000cab0 con 0x7f02b8130ce0 2023-09-30T22:20:28.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.046+0000 7f02bc8f5700 1 -- 172.21.15.156:0/2758522353 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b8120390 con 0x7f02b8130ce0 2023-09-30T22:20:28.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.046+0000 7f02a6ffd700 1 -- 172.21.15.156:0/2758522353 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b000ce60 con 0x7f02b8130ce0 2023-09-30T22:20:28.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.046+0000 7f02bc8f5700 1 -- 172.21.15.156:0/2758522353 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b8122060 con 0x7f02b8130ce0 2023-09-30T22:20:28.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.047+0000 7f02a6ffd700 1 -- 172.21.15.156:0/2758522353 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f02b001d3b0 con 0x7f02b8130ce0 2023-09-30T22:20:28.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.048+0000 7f02a6ffd700 1 -- 172.21.15.156:0/2758522353 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f02b0006e40 con 0x7f02b8130ce0 2023-09-30T22:20:28.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.048+0000 7f02bc8f5700 1 -- 172.21.15.156:0/2758522353 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b804f2a0 con 0x7f02b8130ce0 2023-09-30T22:20:28.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.052+0000 7f02a6ffd700 1 -- 172.21.15.156:0/2758522353 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f02b0019070 con 0x7f02b8130ce0 2023-09-30T22:20:28.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.076+0000 7f1afb4ba700 1 Processor -- start 2023-09-30T22:20:28.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.076+0000 7f67ee9ca700 1 Processor -- start 2023-09-30T22:20:28.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.076+0000 7f1afb4ba700 1 -- start start 2023-09-30T22:20:28.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.076+0000 7f67ee9ca700 1 -- start start 2023-09-30T22:20:28.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.077+0000 7f67ee9ca700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67e809f350 0x7f67e8138ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:28.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.077+0000 7f67ee9ca700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f67e8139410 0x7f67e813b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:28.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.077+0000 7f67ee9ca700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67e806bec0 con 0x7f67e809e870 2023-09-30T22:20:28.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.077+0000 7f67ee9ca700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e809fdd0 con 0x7f67e8139410 2023-09-30T22:20:28.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.077+0000 7f67ee9ca700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e806b990 con 0x7f67e809f350 2023-09-30T22:20:28.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.077+0000 7f67e77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67e809f350 0x7f67e8138ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:28.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.077+0000 7f67e77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67e809f350 0x7f67e8138ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49318/0 (socket says 172.21.15.156:49318) 2023-09-30T22:20:28.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.077+0000 7f67e77fe700 1 -- 172.21.15.156:0/3990173153 learned_addr learned my addr 172.21.15.156:0/3990173153 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:28.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.077+0000 7f67ecf67700 1 --2- 172.21.15.156:0/3990173153 >> v2:172.21.15.156:3300/0 conn(0x7f67e8139410 0x7f67e813b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:28.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.077+0000 7f1afb4ba700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1af40a1570 0x7f1af4138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:28.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.077+0000 7f1afb4ba700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1af41393c0 0x7f1af413b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:28.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.077+0000 7f1afb4ba700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1af40a1fe0 con 0x7f1af40a0a90 2023-09-30T22:20:28.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.077+0000 7f1afb4ba700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af40a3aa0 con 0x7f1af40a1570 2023-09-30T22:20:28.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.077+0000 7f1afb4ba700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1af409a540 con 0x7f1af41393c0 2023-09-30T22:20:28.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.077+0000 7f67e77fe700 1 -- 172.21.15.156:0/3990173153 >> v2:172.21.15.156:3300/0 conn(0x7f67e8139410 msgr2=0x7f67e813b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:28.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.077+0000 7f67e77fe700 1 --2- 172.21.15.156:0/3990173153 >> v2:172.21.15.156:3300/0 conn(0x7f67e8139410 0x7f67e813b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.078+0000 7f67e77fe700 1 -- 172.21.15.156:0/3990173153 >> v1:172.21.15.156:6789/0 conn(0x7f67e809e870 legacy=0x7f67e809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:28.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.078+0000 7f67e77fe700 1 -- 172.21.15.156:0/3990173153 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e80a0870 con 0x7f67e809f350 2023-09-30T22:20:28.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.078+0000 7f1af9a57700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1af41393c0 0x7f1af413b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:28.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.078+0000 7f1af9a57700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1af41393c0 0x7f1af413b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33728/0 (socket says 172.21.15.156:33728) 2023-09-30T22:20:28.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.078+0000 7f1af9a57700 1 -- 172.21.15.156:0/1297261877 learned_addr learned my addr 172.21.15.156:0/1297261877 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:28.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.078+0000 7f67e77fe700 1 --2- 172.21.15.156:0/3990173153 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67e809f350 0x7f67e8138ed0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f67dc009920 tx=0x7f67dc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4598586493464889 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:28.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.078+0000 7f1af9a57700 1 -- 172.21.15.156:0/1297261877 >> v2:172.21.15.156:3300/0 conn(0x7f1af40a1570 msgr2=0x7f1af4138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:28.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.078+0000 7f1af9a57700 1 --2- 172.21.15.156:0/1297261877 >> v2:172.21.15.156:3300/0 conn(0x7f1af40a1570 0x7f1af4138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.078+0000 7f1af9a57700 1 -- 172.21.15.156:0/1297261877 >> v1:172.21.15.156:6789/0 conn(0x7f1af40a0a90 legacy=0x7f1af40a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:28.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.078+0000 7f1af9a57700 1 -- 172.21.15.156:0/1297261877 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af409a280 con 0x7f1af41393c0 2023-09-30T22:20:28.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.078+0000 7f67e6ffd700 1 -- 172.21.15.156:0/3990173153 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67dc004230 con 0x7f67e809f350 2023-09-30T22:20:28.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.078+0000 7f67e6ffd700 1 -- 172.21.15.156:0/3990173153 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67dc004390 con 0x7f67e809f350 2023-09-30T22:20:28.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.078+0000 7f67e6ffd700 1 -- 172.21.15.156:0/3990173153 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67dc0036a0 con 0x7f67e809f350 2023-09-30T22:20:28.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.078+0000 7f1af9a57700 1 --2- 172.21.15.156:0/1297261877 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1af41393c0 0x7f1af413b7a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1aec009e50 tx=0x7f1aec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86bc455149e89dc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:28.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.078+0000 7f1aebfff700 1 -- 172.21.15.156:0/1297261877 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec00e070 con 0x7f1af41393c0 2023-09-30T22:20:28.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.078+0000 7f1aebfff700 1 -- 172.21.15.156:0/1297261877 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aec00b9c0 con 0x7f1af41393c0 2023-09-30T22:20:28.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.078+0000 7f1aebfff700 1 -- 172.21.15.156:0/1297261877 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec00bd70 con 0x7f1af41393c0 2023-09-30T22:20:28.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.079+0000 7f67ee9ca700 1 -- 172.21.15.156:0/3990173153 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67e809f350 msgr2=0x7f67e8138ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:28.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.079+0000 7f67ee9ca700 1 --2- 172.21.15.156:0/3990173153 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67e809f350 0x7f67e8138ed0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f67dc009920 tx=0x7f67dc009c30 comp rx=0 tx=0).stop 2023-09-30T22:20:28.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.079+0000 7f67ee9ca700 1 -- 172.21.15.156:0/3990173153 shutdown_connections 2023-09-30T22:20:28.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.079+0000 7f67ee9ca700 1 --2- 172.21.15.156:0/3990173153 >> v2:172.21.15.156:3300/0 conn(0x7f67e8139410 0x7f67e813b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.079+0000 7f67ee9ca700 1 --2- 172.21.15.156:0/3990173153 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67e809f350 0x7f67e8138ed0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.079+0000 7f67ee9ca700 1 -- 172.21.15.156:0/3990173153 >> 172.21.15.156:0/3990173153 conn(0x7f67e80a4430 msgr2=0x7f67e80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:28.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.079+0000 7f67ee9ca700 1 -- 172.21.15.156:0/3990173153 shutdown_connections 2023-09-30T22:20:28.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.079+0000 7f67ee9ca700 1 -- 172.21.15.156:0/3990173153 wait complete. 2023-09-30T22:20:28.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.079+0000 7f1afb4ba700 1 -- 172.21.15.156:0/1297261877 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1af41393c0 msgr2=0x7f1af413b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:28.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.079+0000 7f1afb4ba700 1 --2- 172.21.15.156:0/1297261877 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1af41393c0 0x7f1af413b7a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1aec009e50 tx=0x7f1aec00b330 comp rx=0 tx=0).stop 2023-09-30T22:20:28.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.080+0000 7f1afb4ba700 1 -- 172.21.15.156:0/1297261877 shutdown_connections 2023-09-30T22:20:28.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.080+0000 7f1afb4ba700 1 --2- 172.21.15.156:0/1297261877 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1af41393c0 0x7f1af413b7a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.080+0000 7f1afb4ba700 1 --2- 172.21.15.156:0/1297261877 >> v2:172.21.15.156:3300/0 conn(0x7f1af40a1570 0x7f1af4138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.080+0000 7f1afb4ba700 1 -- 172.21.15.156:0/1297261877 >> 172.21.15.156:0/1297261877 conn(0x7f1af4099c40 msgr2=0x7f1af406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:28.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.080+0000 7f1afb4ba700 1 -- 172.21.15.156:0/1297261877 shutdown_connections 2023-09-30T22:20:28.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.080+0000 7f1afb4ba700 1 -- 172.21.15.156:0/1297261877 wait complete. 2023-09-30T22:20:28.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.080+0000 7f67ee9ca700 1 Processor -- start 2023-09-30T22:20:28.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.081+0000 7f1afb4ba700 1 Processor -- start 2023-09-30T22:20:28.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.081+0000 7f1afb4ba700 1 -- start start 2023-09-30T22:20:28.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.082+0000 7f1afb4ba700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1af40a0a90 0x7f1af4121980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:28.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.082+0000 7f1afb4ba700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1af40a1570 0x7f1af4121ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:28.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.082+0000 7f1afb4ba700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1af41393c0 0x7f1af4122400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:28.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.082+0000 7f1afb4ba700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af41254b0 con 0x7f1af40a1570 2023-09-30T22:20:28.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.082+0000 7f1afb4ba700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af409c7e0 con 0x7f1af40a0a90 2023-09-30T22:20:28.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.082+0000 7f1afb4ba700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1af4124b00 con 0x7f1af41393c0 2023-09-30T22:20:28.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.082+0000 7f1af9256700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1af40a0a90 0x7f1af4121980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:28.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.082+0000 7f1af9256700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1af40a0a90 0x7f1af4121980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49320/0 (socket says 172.21.15.156:49320) 2023-09-30T22:20:28.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.082+0000 7f1af9256700 1 -- 172.21.15.156:0/4264613363 learned_addr learned my addr 172.21.15.156:0/4264613363 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:28.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.082+0000 7f1af9a57700 1 --2- 172.21.15.156:0/4264613363 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1af41393c0 0x7f1af4122400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:28.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.082+0000 7f1af9a57700 1 -- 172.21.15.156:0/4264613363 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1af40a0a90 msgr2=0x7f1af4121980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:28.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.082+0000 7f1af9a57700 1 --2- 172.21.15.156:0/4264613363 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1af40a0a90 0x7f1af4121980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.082+0000 7f1af9a57700 1 -- 172.21.15.156:0/4264613363 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1af40a1570 msgr2=0x7f1af4121ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:28.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.082+0000 7f1af9a57700 1 --2- 172.21.15.156:0/4264613363 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1af40a1570 0x7f1af4121ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.082+0000 7f1af9a57700 1 -- 172.21.15.156:0/4264613363 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec009b30 con 0x7f1af41393c0 2023-09-30T22:20:28.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.082+0000 7f67ee9ca700 1 -- start start 2023-09-30T22:20:28.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.082+0000 7f67ee9ca700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67e809e870 0x7f67e811edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:28.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.082+0000 7f67ee9ca700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67e809f350 0x7f67e811f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:28.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.082+0000 7f67ee9ca700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67e8139410 0x7f67e811f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:28.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.082+0000 7f67ee9ca700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e80a0440 con 0x7f67e809e870 2023-09-30T22:20:28.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.082+0000 7f67ee9ca700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e8120da0 con 0x7f67e8139410 2023-09-30T22:20:28.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.082+0000 7f67ee9ca700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67e81223d0 con 0x7f67e809f350 2023-09-30T22:20:28.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.082+0000 7f1af9a57700 1 --2- 172.21.15.156:0/4264613363 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1af41393c0 0x7f1af4122400 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1aec015000 tx=0x7f1aec004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:28.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.083+0000 7f67e77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67e809f350 0x7f67e811f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:28.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.083+0000 7f67e77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67e809f350 0x7f67e811f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33750/0 (socket says 172.21.15.156:33750) 2023-09-30T22:20:28.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.083+0000 7f67e77fe700 1 -- 172.21.15.156:0/3858709137 learned_addr learned my addr 172.21.15.156:0/3858709137 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:28.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.083+0000 7f67e7fff700 1 --2- 172.21.15.156:0/3858709137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67e809e870 0x7f67e811edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:28.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.083+0000 7f67e7fff700 1 -- 172.21.15.156:0/3858709137 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67e809f350 msgr2=0x7f67e811f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:28.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.083+0000 7f67e7fff700 1 --2- 172.21.15.156:0/3858709137 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67e809f350 0x7f67e811f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.083+0000 7f67e7fff700 1 -- 172.21.15.156:0/3858709137 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67e8139410 msgr2=0x7f67e811f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:28.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.083+0000 7f67e7fff700 1 --2- 172.21.15.156:0/3858709137 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67e8139410 0x7f67e811f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.083+0000 7f67e7fff700 1 -- 172.21.15.156:0/3858709137 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67dc009550 con 0x7f67e809e870 2023-09-30T22:20:28.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.082+0000 7f1ae9ffb700 1 -- 172.21.15.156:0/4264613363 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec004250 con 0x7f1af41393c0 2023-09-30T22:20:28.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.083+0000 7f1ae9ffb700 1 -- 172.21.15.156:0/4264613363 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aec0043b0 con 0x7f1af41393c0 2023-09-30T22:20:28.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.083+0000 7f1ae9ffb700 1 -- 172.21.15.156:0/4264613363 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec004760 con 0x7f1af41393c0 2023-09-30T22:20:28.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.083+0000 7f1afb4ba700 1 -- 172.21.15.156:0/4264613363 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af409b130 con 0x7f1af41393c0 2023-09-30T22:20:28.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.083+0000 7f1afb4ba700 1 -- 172.21.15.156:0/4264613363 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af4123590 con 0x7f1af41393c0 2023-09-30T22:20:28.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.083+0000 7f67e7fff700 1 --2- 172.21.15.156:0/3858709137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67e809e870 0x7f67e811edb0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f67e000be50 tx=0x7f67e0009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:28.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.084+0000 7f1ae9ffb700 1 -- 172.21.15.156:0/4264613363 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1aec01c440 con 0x7f1af41393c0 2023-09-30T22:20:28.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.084+0000 7f1ae9ffb700 1 -- 172.21.15.156:0/4264613363 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1aec040fd0 con 0x7f1af41393c0 2023-09-30T22:20:28.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.085+0000 7f67e4ff9700 1 -- 172.21.15.156:0/3858709137 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e000ccb0 con 0x7f67e809e870 2023-09-30T22:20:28.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.085+0000 7f67e4ff9700 1 -- 172.21.15.156:0/3858709137 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e000ce10 con 0x7f67e809e870 2023-09-30T22:20:28.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.085+0000 7f67e4ff9700 1 -- 172.21.15.156:0/3858709137 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e0014680 con 0x7f67e809e870 2023-09-30T22:20:28.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.085+0000 7f1afb4ba700 1 -- 172.21.15.156:0/4264613363 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af404f2a0 con 0x7f1af41393c0 2023-09-30T22:20:28.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.085+0000 7f67ee9ca700 1 -- 172.21.15.156:0/3858709137 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e8120920 con 0x7f67e809e870 2023-09-30T22:20:28.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.085+0000 7f67ee9ca700 1 -- 172.21.15.156:0/3858709137 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e806fa70 con 0x7f67e809e870 2023-09-30T22:20:28.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.086+0000 7f67e4ff9700 1 -- 172.21.15.156:0/3858709137 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f67e0006d50 con 0x7f67e809e870 2023-09-30T22:20:28.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.086+0000 7f67e4ff9700 1 -- 172.21.15.156:0/3858709137 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f67e00433e0 con 0x7f67e809e870 2023-09-30T22:20:28.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.087+0000 7f67ee9ca700 1 -- 172.21.15.156:0/3858709137 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e804f2a0 con 0x7f67e809e870 2023-09-30T22:20:28.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.090+0000 7f1ae9ffb700 1 -- 172.21.15.156:0/4264613363 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1aec020080 con 0x7f1af41393c0 2023-09-30T22:20:28.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.096+0000 7f67e4ff9700 1 -- 172.21.15.156:0/3858709137 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f67e0019080 con 0x7f67e809e870 2023-09-30T22:20:28.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.125+0000 7f1170108700 1 Processor -- start 2023-09-30T22:20:28.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.126+0000 7f1170108700 1 -- start start 2023-09-30T22:20:28.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.126+0000 7f1170108700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f11680a0a70 0x7f11680a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:28.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.126+0000 7f1170108700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f11680a1380 0x7f1168133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:28.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.126+0000 7f1170108700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f116809dc00 con 0x7f1168133f50 2023-09-30T22:20:28.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.126+0000 7f1170108700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f116809ea60 con 0x7f11680a0a70 2023-09-30T22:20:28.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.126+0000 7f1170108700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f116809dec0 con 0x7f11680a1380 2023-09-30T22:20:28.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.126+0000 7f116dea4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f11680a0a70 0x7f11680a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:28.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.126+0000 7f116dea4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f11680a0a70 0x7f11680a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49334/0 (socket says 172.21.15.156:49334) 2023-09-30T22:20:28.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.126+0000 7f116dea4700 1 -- 172.21.15.156:0/2988983260 learned_addr learned my addr 172.21.15.156:0/2988983260 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:28.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.127+0000 7f116d6a3700 1 --2- 172.21.15.156:0/2988983260 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f11680a1380 0x7f1168133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:28.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.127+0000 7f116dea4700 1 -- 172.21.15.156:0/2988983260 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f11680a1380 msgr2=0x7f1168133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:28.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.127+0000 7f116dea4700 1 --2- 172.21.15.156:0/2988983260 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f11680a1380 0x7f1168133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.127+0000 7f116dea4700 1 -- 172.21.15.156:0/2988983260 >> v1:172.21.15.156:6789/0 conn(0x7f1168133f50 legacy=0x7f116813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:28.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.127+0000 7f116dea4700 1 -- 172.21.15.156:0/2988983260 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116809e6a0 con 0x7f11680a0a70 2023-09-30T22:20:28.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.127+0000 7f116d6a3700 1 --2- 172.21.15.156:0/2988983260 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f11680a1380 0x7f1168133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:20:28.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.127+0000 7f116dea4700 1 --2- 172.21.15.156:0/2988983260 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f11680a0a70 0x7f11680a0e40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1164009920 tx=0x7f1164009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d676f954e0117b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:28.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.127+0000 7f116cea2700 1 -- 172.21.15.156:0/2988983260 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116400ba60 con 0x7f11680a0a70 2023-09-30T22:20:28.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.127+0000 7f116cea2700 1 -- 172.21.15.156:0/2988983260 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116400bbc0 con 0x7f11680a0a70 2023-09-30T22:20:28.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.127+0000 7f116cea2700 1 -- 172.21.15.156:0/2988983260 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1164009e70 con 0x7f11680a0a70 2023-09-30T22:20:28.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.128+0000 7f1170108700 1 -- 172.21.15.156:0/2988983260 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f11680a0a70 msgr2=0x7f11680a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:28.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.128+0000 7f1170108700 1 --2- 172.21.15.156:0/2988983260 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f11680a0a70 0x7f11680a0e40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1164009920 tx=0x7f1164009c30 comp rx=0 tx=0).stop 2023-09-30T22:20:28.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.128+0000 7f1170108700 1 -- 172.21.15.156:0/2988983260 shutdown_connections 2023-09-30T22:20:28.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.128+0000 7f1170108700 1 --2- 172.21.15.156:0/2988983260 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f11680a0a70 0x7f11680a0e40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.128+0000 7f1170108700 1 --2- 172.21.15.156:0/2988983260 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f11680a1380 0x7f1168133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.128+0000 7f1170108700 1 -- 172.21.15.156:0/2988983260 >> 172.21.15.156:0/2988983260 conn(0x7f11680a6610 msgr2=0x7f11680a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:28.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.128+0000 7f1170108700 1 -- 172.21.15.156:0/2988983260 shutdown_connections 2023-09-30T22:20:28.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.128+0000 7f1170108700 1 -- 172.21.15.156:0/2988983260 wait complete. 2023-09-30T22:20:28.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.129+0000 7f1170108700 1 Processor -- start 2023-09-30T22:20:28.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.129+0000 7f1170108700 1 -- start start 2023-09-30T22:20:28.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.129+0000 7f1170108700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f11680a0a70 0x7f11681c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:28.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.129+0000 7f1170108700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f11680a1380 0x7f11681c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:28.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.129+0000 7f1170108700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1168133f50 0x7f1168122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:28.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.129+0000 7f1170108700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1168133ab0 con 0x7f1168133f50 2023-09-30T22:20:28.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.129+0000 7f1170108700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11681265c0 con 0x7f11680a0a70 2023-09-30T22:20:28.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.129+0000 7f1170108700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1168133880 con 0x7f11680a1380 2023-09-30T22:20:28.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.129+0000 7f116e6a5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1168133f50 0x7f1168122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:28.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.129+0000 7f116e6a5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1168133f50 0x7f1168122930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:57118/0 (socket says 172.21.15.156:57118) 2023-09-30T22:20:28.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.129+0000 7f116e6a5700 1 -- 172.21.15.156:0/4023913938 learned_addr learned my addr 172.21.15.156:0/4023913938 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:28.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.129+0000 7f116dea4700 1 --2- 172.21.15.156:0/4023913938 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f11680a0a70 0x7f11681c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:28.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.130+0000 7f116d6a3700 1 --2- 172.21.15.156:0/4023913938 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f11680a1380 0x7f11681c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:28.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.130+0000 7f116dea4700 1 -- 172.21.15.156:0/4023913938 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f11680a1380 msgr2=0x7f11681c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:28.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.130+0000 7f116dea4700 1 --2- 172.21.15.156:0/4023913938 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f11680a1380 0x7f11681c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.130+0000 7f116dea4700 1 -- 172.21.15.156:0/4023913938 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1168133f50 msgr2=0x7f1168122930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:28.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.130+0000 7f116dea4700 1 --2- 172.21.15.156:0/4023913938 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1168133f50 0x7f1168122930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.130+0000 7f116dea4700 1 -- 172.21.15.156:0/4023913938 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1164009550 con 0x7f11680a0a70 2023-09-30T22:20:28.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.130+0000 7f116e6a5700 1 --2- 172.21.15.156:0/4023913938 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1168133f50 0x7f1168122930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:28.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.130+0000 7f116dea4700 1 --2- 172.21.15.156:0/4023913938 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f11680a0a70 0x7f11681c8520 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1164016000 tx=0x7f1164004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:28.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.130+0000 7f115e7fc700 1 -- 172.21.15.156:0/4023913938 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1164004510 con 0x7f11680a0a70 2023-09-30T22:20:28.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.130+0000 7f115e7fc700 1 -- 172.21.15.156:0/4023913938 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11640036a0 con 0x7f11680a0a70 2023-09-30T22:20:28.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.130+0000 7f115e7fc700 1 -- 172.21.15.156:0/4023913938 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1164003a50 con 0x7f11680a0a70 2023-09-30T22:20:28.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.130+0000 7f1170108700 1 -- 172.21.15.156:0/4023913938 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11681334c0 con 0x7f11680a0a70 2023-09-30T22:20:28.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.130+0000 7f1170108700 1 -- 172.21.15.156:0/4023913938 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1168125f10 con 0x7f11680a0a70 2023-09-30T22:20:28.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.131+0000 7f115e7fc700 1 -- 172.21.15.156:0/4023913938 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1164003bb0 con 0x7f11680a0a70 2023-09-30T22:20:28.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.131+0000 7f115e7fc700 1 -- 172.21.15.156:0/4023913938 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1164021030 con 0x7f11680a0a70 2023-09-30T22:20:28.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.131+0000 7f1170108700 1 -- 172.21.15.156:0/4023913938 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11681263b0 con 0x7f11680a0a70 2023-09-30T22:20:28.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.136+0000 7f115e7fc700 1 -- 172.21.15.156:0/4023913938 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1164015020 con 0x7f11680a0a70 2023-09-30T22:20:28.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.280+0000 7f02bc8f5700 1 -- 172.21.15.156:0/2758522353 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f02b8122340 con 0x7f02b8130ce0 2023-09-30T22:20:28.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.280+0000 7f02a6ffd700 1 -- 172.21.15.156:0/2758522353 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f02b0007370 con 0x7f02b8130ce0 2023-09-30T22:20:28.280 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:28.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.283+0000 7f02bc8f5700 1 -- 172.21.15.156:0/2758522353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02b8130ce0 msgr2=0x7f02b811eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:28.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.283+0000 7f02bc8f5700 1 --2- 172.21.15.156:0/2758522353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02b8130ce0 0x7f02b811eb40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f02b000b970 tx=0x7f02b000bc80 comp rx=0 tx=0).stop 2023-09-30T22:20:28.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.283+0000 7f02bc8f5700 1 -- 172.21.15.156:0/2758522353 shutdown_connections 2023-09-30T22:20:28.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.283+0000 7f02bc8f5700 1 --2- 172.21.15.156:0/2758522353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02b8130ce0 0x7f02b811eb40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.283+0000 7f02bc8f5700 1 --2- 172.21.15.156:0/2758522353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02b809d860 0x7f02b811e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.283+0000 7f02bc8f5700 1 --2- 172.21.15.156:0/2758522353 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02b809e170 0x7f02b811e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.283+0000 7f02bc8f5700 1 -- 172.21.15.156:0/2758522353 >> 172.21.15.156:0/2758522353 conn(0x7f02b8099c40 msgr2=0x7f02b80709b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:28.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.283+0000 7f02bc8f5700 1 -- 172.21.15.156:0/2758522353 shutdown_connections 2023-09-30T22:20:28.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.283+0000 7f02bc8f5700 1 -- 172.21.15.156:0/2758522353 wait complete. 2023-09-30T22:20:28.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.285+0000 7f1afb4ba700 1 -- 172.21.15.156:0/4264613363 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1af4125170 con 0x7f1af41393c0 2023-09-30T22:20:28.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.285+0000 7f1ae9ffb700 1 -- 172.21.15.156:0/4264613363 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1aec011d60 con 0x7f1af41393c0 2023-09-30T22:20:28.285 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:28.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.288+0000 7f1afb4ba700 1 -- 172.21.15.156:0/4264613363 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1af41393c0 msgr2=0x7f1af4122400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:28.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.288+0000 7f1afb4ba700 1 --2- 172.21.15.156:0/4264613363 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1af41393c0 0x7f1af4122400 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1aec015000 tx=0x7f1aec004ad0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.288+0000 7f1afb4ba700 1 -- 172.21.15.156:0/4264613363 shutdown_connections 2023-09-30T22:20:28.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.288+0000 7f1afb4ba700 1 --2- 172.21.15.156:0/4264613363 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1af41393c0 0x7f1af4122400 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.288+0000 7f1afb4ba700 1 --2- 172.21.15.156:0/4264613363 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1af40a0a90 0x7f1af4121980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.288+0000 7f1afb4ba700 1 --2- 172.21.15.156:0/4264613363 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1af40a1570 0x7f1af4121ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.288+0000 7f1afb4ba700 1 -- 172.21.15.156:0/4264613363 >> 172.21.15.156:0/4264613363 conn(0x7f1af4099c40 msgr2=0x7f1af4137c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:28.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.288+0000 7f1afb4ba700 1 -- 172.21.15.156:0/4264613363 shutdown_connections 2023-09-30T22:20:28.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.288+0000 7f1afb4ba700 1 -- 172.21.15.156:0/4264613363 wait complete. 2023-09-30T22:20:28.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:28.300 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:28.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.319+0000 7f67ee9ca700 1 -- 172.21.15.156:0/3858709137 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f67e8072d60 con 0x7f67e809e870 2023-09-30T22:20:28.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.319+0000 7f67e4ff9700 1 -- 172.21.15.156:0/3858709137 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f67e00072b0 con 0x7f67e809e870 2023-09-30T22:20:28.319 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:28.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.321+0000 7f67ee9ca700 1 -- 172.21.15.156:0/3858709137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67e809e870 msgr2=0x7f67e811edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:28.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.321+0000 7f67ee9ca700 1 --2- 172.21.15.156:0/3858709137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67e809e870 0x7f67e811edb0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f67e000be50 tx=0x7f67e0009f70 comp rx=0 tx=0).stop 2023-09-30T22:20:28.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.321+0000 7f67ee9ca700 1 -- 172.21.15.156:0/3858709137 shutdown_connections 2023-09-30T22:20:28.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.321+0000 7f67ee9ca700 1 --2- 172.21.15.156:0/3858709137 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67e8139410 0x7f67e811f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.321+0000 7f67ee9ca700 1 --2- 172.21.15.156:0/3858709137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67e809e870 0x7f67e811edb0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.321+0000 7f67ee9ca700 1 --2- 172.21.15.156:0/3858709137 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67e809f350 0x7f67e811f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.321+0000 7f67ee9ca700 1 -- 172.21.15.156:0/3858709137 >> 172.21.15.156:0/3858709137 conn(0x7f67e80a4430 msgr2=0x7f67e81383f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:28.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.322+0000 7f67ee9ca700 1 -- 172.21.15.156:0/3858709137 shutdown_connections 2023-09-30T22:20:28.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.322+0000 7f67ee9ca700 1 -- 172.21.15.156:0/3858709137 wait complete. 2023-09-30T22:20:28.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.331+0000 7f1170108700 1 -- 172.21.15.156:0/4023913938 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f116804f2a0 con 0x7f11680a0a70 2023-09-30T22:20:28.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.331+0000 7f115e7fc700 1 -- 172.21.15.156:0/4023913938 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f116402b070 con 0x7f11680a0a70 2023-09-30T22:20:28.331 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:28.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.333+0000 7f1170108700 1 -- 172.21.15.156:0/4023913938 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f11680a0a70 msgr2=0x7f11681c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:28.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.333+0000 7f1170108700 1 --2- 172.21.15.156:0/4023913938 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f11680a0a70 0x7f11681c8520 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1164016000 tx=0x7f1164004750 comp rx=0 tx=0).stop 2023-09-30T22:20:28.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.333+0000 7f1170108700 1 -- 172.21.15.156:0/4023913938 shutdown_connections 2023-09-30T22:20:28.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.333+0000 7f1170108700 1 --2- 172.21.15.156:0/4023913938 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1168133f50 0x7f1168122930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.333+0000 7f1170108700 1 --2- 172.21.15.156:0/4023913938 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f11680a0a70 0x7f11681c8520 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.333+0000 7f1170108700 1 --2- 172.21.15.156:0/4023913938 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f11680a1380 0x7f11681c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:28.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.333+0000 7f1170108700 1 -- 172.21.15.156:0/4023913938 >> 172.21.15.156:0/4023913938 conn(0x7f11680a6610 msgr2=0x7f11680a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:28.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.333+0000 7f1170108700 1 -- 172.21.15.156:0/4023913938 shutdown_connections 2023-09-30T22:20:28.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:28.333+0000 7f1170108700 1 -- 172.21.15.156:0/4023913938 wait complete. 2023-09-30T22:20:28.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:28.344 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:29.299 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:29.301 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:29.335 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:29.345 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:29.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.434+0000 7fa4689b8700 1 Processor -- start 2023-09-30T22:20:29.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.434+0000 7fa4689b8700 1 -- start start 2023-09-30T22:20:29.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.435+0000 7fa4689b8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa464138040 0x7fa464138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:29.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.435+0000 7fa4689b8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4640a08e0 0x7fa4640a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:29.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.435+0000 7fa4689b8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa4640a1230 0x7fa46413ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:29.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.435+0000 7fa4689b8700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4640a2100 con 0x7fa4640a1230 2023-09-30T22:20:29.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.435+0000 7fa4689b8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa464138950 con 0x7fa4640a08e0 2023-09-30T22:20:29.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.435+0000 7fa4689b8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4641379e0 con 0x7fa464138040 2023-09-30T22:20:29.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.435+0000 7fa46259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa464138040 0x7fa464138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:29.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.435+0000 7fa46259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa464138040 0x7fa464138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33770/0 (socket says 172.21.15.156:33770) 2023-09-30T22:20:29.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.435+0000 7fa46259c700 1 -- 172.21.15.156:0/2097206107 learned_addr learned my addr 172.21.15.156:0/2097206107 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:29.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.435+0000 7fa462d9d700 1 --2- 172.21.15.156:0/2097206107 >> v2:172.21.15.156:3300/0 conn(0x7fa4640a1230 0x7fa46413ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:29.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.435+0000 7fa461d9b700 1 --2- 172.21.15.156:0/2097206107 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4640a08e0 0x7fa4640a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:29.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.435+0000 7fa46259c700 1 -- 172.21.15.156:0/2097206107 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4640a08e0 msgr2=0x7fa4640a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:29.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.435+0000 7fa46259c700 1 --2- 172.21.15.156:0/2097206107 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4640a08e0 0x7fa4640a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.435+0000 7fa46259c700 1 -- 172.21.15.156:0/2097206107 >> v2:172.21.15.156:3300/0 conn(0x7fa4640a1230 msgr2=0x7fa46413ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:29.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.435+0000 7fa46259c700 1 --2- 172.21.15.156:0/2097206107 >> v2:172.21.15.156:3300/0 conn(0x7fa4640a1230 0x7fa46413ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.435+0000 7fa46259c700 1 -- 172.21.15.156:0/2097206107 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46409b9b0 con 0x7fa464138040 2023-09-30T22:20:29.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.435+0000 7fa46259c700 1 --2- 172.21.15.156:0/2097206107 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa464138040 0x7fa464138410 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa454009920 tx=0x7fa454009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24c73d5e95ffc1d7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:29.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.436+0000 7fa46159a700 1 -- 172.21.15.156:0/2097206107 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa454005e30 con 0x7fa464138040 2023-09-30T22:20:29.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.436+0000 7fa46159a700 1 -- 172.21.15.156:0/2097206107 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa454004030 con 0x7fa464138040 2023-09-30T22:20:29.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.436+0000 7fa46159a700 1 -- 172.21.15.156:0/2097206107 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4540043e0 con 0x7fa464138040 2023-09-30T22:20:29.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.436+0000 7fa4689b8700 1 -- 172.21.15.156:0/2097206107 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa464138040 msgr2=0x7fa464138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:29.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.436+0000 7fa4689b8700 1 --2- 172.21.15.156:0/2097206107 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa464138040 0x7fa464138410 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa454009920 tx=0x7fa454009c30 comp rx=0 tx=0).stop 2023-09-30T22:20:29.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.436+0000 7fa4689b8700 1 -- 172.21.15.156:0/2097206107 shutdown_connections 2023-09-30T22:20:29.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.436+0000 7fa4689b8700 1 --2- 172.21.15.156:0/2097206107 >> v2:172.21.15.156:3300/0 conn(0x7fa4640a1230 0x7fa46413ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.436+0000 7fa4689b8700 1 --2- 172.21.15.156:0/2097206107 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa464138040 0x7fa464138410 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.436+0000 7fa4689b8700 1 --2- 172.21.15.156:0/2097206107 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4640a08e0 0x7fa4640a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.436+0000 7fa4689b8700 1 -- 172.21.15.156:0/2097206107 >> 172.21.15.156:0/2097206107 conn(0x7fa4640a2980 msgr2=0x7fa4640a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:29.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.437+0000 7fa4689b8700 1 -- 172.21.15.156:0/2097206107 shutdown_connections 2023-09-30T22:20:29.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.437+0000 7fa4689b8700 1 -- 172.21.15.156:0/2097206107 wait complete. 2023-09-30T22:20:29.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.438+0000 7fa4689b8700 1 Processor -- start 2023-09-30T22:20:29.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.438+0000 7fa4689b8700 1 -- start start 2023-09-30T22:20:29.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.438+0000 7fa4689b8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4640a08e0 0x7fa4641263f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:29.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.438+0000 7fa4689b8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4640a1230 0x7fa464126930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:29.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.438+0000 7fa4689b8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa464138040 0x7fa464126e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:29.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.438+0000 7fa4689b8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa464129c80 con 0x7fa4640a08e0 2023-09-30T22:20:29.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.438+0000 7fa4689b8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa464128010 con 0x7fa4640a1230 2023-09-30T22:20:29.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.438+0000 7fa4689b8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa464129e80 con 0x7fa464138040 2023-09-30T22:20:29.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.438+0000 7fa46259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4640a08e0 0x7fa4641263f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:29.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.438+0000 7fa46259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4640a08e0 0x7fa4641263f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:57146/0 (socket says 172.21.15.156:57146) 2023-09-30T22:20:29.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.438+0000 7fa46259c700 1 -- 172.21.15.156:0/3458848453 learned_addr learned my addr 172.21.15.156:0/3458848453 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:29.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.438+0000 7fa462d9d700 1 --2- 172.21.15.156:0/3458848453 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa464138040 0x7fa464126e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:29.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.438+0000 7fa461d9b700 1 --2- 172.21.15.156:0/3458848453 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4640a1230 0x7fa464126930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:29.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.439+0000 7fa46259c700 1 -- 172.21.15.156:0/3458848453 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa464138040 msgr2=0x7fa464126e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:29.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.439+0000 7fa46259c700 1 --2- 172.21.15.156:0/3458848453 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa464138040 0x7fa464126e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.439+0000 7fa46259c700 1 -- 172.21.15.156:0/3458848453 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4640a1230 msgr2=0x7fa464126930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:29.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.439+0000 7fa46259c700 1 --2- 172.21.15.156:0/3458848453 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4640a1230 0x7fa464126930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.439+0000 7fa46259c700 1 -- 172.21.15.156:0/3458848453 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa454009500 con 0x7fa4640a08e0 2023-09-30T22:20:29.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.439+0000 7fa46259c700 1 --2- 172.21.15.156:0/3458848453 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4640a08e0 0x7fa4641263f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa454009c70 tx=0x7fa454004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:29.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.439+0000 7fa452ffd700 1 -- 172.21.15.156:0/3458848453 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa454003ab0 con 0x7fa4640a08e0 2023-09-30T22:20:29.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.439+0000 7fa452ffd700 1 -- 172.21.15.156:0/3458848453 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa454003c10 con 0x7fa4640a08e0 2023-09-30T22:20:29.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.439+0000 7fa452ffd700 1 -- 172.21.15.156:0/3458848453 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa454005e80 con 0x7fa4640a08e0 2023-09-30T22:20:29.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.439+0000 7fa4689b8700 1 -- 172.21.15.156:0/3458848453 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa46409a240 con 0x7fa4640a08e0 2023-09-30T22:20:29.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.439+0000 7fa4689b8700 1 -- 172.21.15.156:0/3458848453 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa464136ee0 con 0x7fa4640a08e0 2023-09-30T22:20:29.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.440+0000 7fa452ffd700 1 -- 172.21.15.156:0/3458848453 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa454018030 con 0x7fa4640a08e0 2023-09-30T22:20:29.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.440+0000 7fa452ffd700 1 -- 172.21.15.156:0/3458848453 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa4540400c0 con 0x7fa4640a08e0 2023-09-30T22:20:29.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.440+0000 7fa4689b8700 1 -- 172.21.15.156:0/3458848453 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4641377c0 con 0x7fa4640a08e0 2023-09-30T22:20:29.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.442+0000 7feea8f99700 1 Processor -- start 2023-09-30T22:20:29.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.442+0000 7feea8f99700 1 -- start start 2023-09-30T22:20:29.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.443+0000 7feea8f99700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feea4133900 0x7feea4133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:29.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.443+0000 7feea8f99700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feea40a10b0 0x7feea413b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:29.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.443+0000 7feea8f99700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea409a760 con 0x7feea4134210 2023-09-30T22:20:29.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.443+0000 7feea8f99700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea41336e0 con 0x7feea40a10b0 2023-09-30T22:20:29.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.443+0000 7feea8f99700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feea409a080 con 0x7feea4133900 2023-09-30T22:20:29.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.443+0000 7feea259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feea4133900 0x7feea4133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:29.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.443+0000 7feea259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feea4133900 0x7feea4133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33784/0 (socket says 172.21.15.156:33784) 2023-09-30T22:20:29.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.443+0000 7feea259c700 1 -- 172.21.15.156:0/316033083 learned_addr learned my addr 172.21.15.156:0/316033083 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:29.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.443+0000 7feea2d9d700 1 --2- 172.21.15.156:0/316033083 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feea40a10b0 0x7feea413b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:29.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.443+0000 7feea2d9d700 1 -- 172.21.15.156:0/316033083 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feea4133900 msgr2=0x7feea4133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:29.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.443+0000 7feea2d9d700 1 --2- 172.21.15.156:0/316033083 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feea4133900 0x7feea4133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.443+0000 7feea2d9d700 1 -- 172.21.15.156:0/316033083 >> v1:172.21.15.156:6789/0 conn(0x7feea4134210 legacy=0x7feea40a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:29.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.443+0000 7feea2d9d700 1 -- 172.21.15.156:0/316033083 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea40a23e0 con 0x7feea40a10b0 2023-09-30T22:20:29.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.443+0000 7feea259c700 1 --2- 172.21.15.156:0/316033083 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feea4133900 0x7feea4133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:29.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.444+0000 7feea2d9d700 1 --2- 172.21.15.156:0/316033083 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feea40a10b0 0x7feea413b910 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fee9c009dc0 tx=0x7fee9c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1185fc8820f4eaf0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:29.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.444+0000 7feea159a700 1 -- 172.21.15.156:0/316033083 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c00e070 con 0x7feea40a10b0 2023-09-30T22:20:29.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.444+0000 7feea159a700 1 -- 172.21.15.156:0/316033083 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9c00bb20 con 0x7feea40a10b0 2023-09-30T22:20:29.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.444+0000 7feea159a700 1 -- 172.21.15.156:0/316033083 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c012430 con 0x7feea40a10b0 2023-09-30T22:20:29.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.445+0000 7feea8f99700 1 -- 172.21.15.156:0/316033083 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feea40a10b0 msgr2=0x7feea413b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:29.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.445+0000 7feea8f99700 1 --2- 172.21.15.156:0/316033083 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feea40a10b0 0x7feea413b910 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fee9c009dc0 tx=0x7fee9c00b330 comp rx=0 tx=0).stop 2023-09-30T22:20:29.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.445+0000 7feea8f99700 1 -- 172.21.15.156:0/316033083 shutdown_connections 2023-09-30T22:20:29.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.445+0000 7feea8f99700 1 --2- 172.21.15.156:0/316033083 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feea40a10b0 0x7feea413b910 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.445+0000 7feea8f99700 1 --2- 172.21.15.156:0/316033083 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feea4133900 0x7feea4133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.445+0000 7feea8f99700 1 -- 172.21.15.156:0/316033083 >> 172.21.15.156:0/316033083 conn(0x7feea40a2980 msgr2=0x7feea40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:29.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.445+0000 7feea8f99700 1 -- 172.21.15.156:0/316033083 shutdown_connections 2023-09-30T22:20:29.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.445+0000 7feea8f99700 1 -- 172.21.15.156:0/316033083 wait complete. 2023-09-30T22:20:29.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.446+0000 7feea8f99700 1 Processor -- start 2023-09-30T22:20:29.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.446+0000 7feea8f99700 1 -- start start 2023-09-30T22:20:29.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.447+0000 7feea8f99700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feea40a10b0 0x7feea411c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:29.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.447+0000 7feea8f99700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feea4133900 0x7feea411cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:29.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.447+0000 7feea8f99700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feea4134210 0x7feea411d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:29.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.447+0000 7feea8f99700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea411dc60 con 0x7feea4134210 2023-09-30T22:20:29.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.447+0000 7feea8f99700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea411e950 con 0x7feea40a10b0 2023-09-30T22:20:29.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.447+0000 7feea8f99700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feea411fa10 con 0x7feea4133900 2023-09-30T22:20:29.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.447+0000 7feea259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feea40a10b0 0x7feea411c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:29.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.447+0000 7feea1d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feea4133900 0x7feea411cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:29.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.447+0000 7feea1d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feea4133900 0x7feea411cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33788/0 (socket says 172.21.15.156:33788) 2023-09-30T22:20:29.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.447+0000 7feea259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feea40a10b0 0x7feea411c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49370/0 (socket says 172.21.15.156:49370) 2023-09-30T22:20:29.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.447+0000 7feea1d9b700 1 -- 172.21.15.156:0/2133082697 learned_addr learned my addr 172.21.15.156:0/2133082697 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:29.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.447+0000 7feea2d9d700 1 --2- 172.21.15.156:0/2133082697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feea4134210 0x7feea411d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:29.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.448+0000 7fa452ffd700 1 -- 172.21.15.156:0/3458848453 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa454016080 con 0x7fa4640a08e0 2023-09-30T22:20:29.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.448+0000 7feea1d9b700 1 -- 172.21.15.156:0/2133082697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feea40a10b0 msgr2=0x7feea411c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:29.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.448+0000 7feea1d9b700 1 --2- 172.21.15.156:0/2133082697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feea40a10b0 0x7feea411c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.448+0000 7feea1d9b700 1 -- 172.21.15.156:0/2133082697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feea4134210 msgr2=0x7feea411d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:29.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.448+0000 7feea1d9b700 1 --2- 172.21.15.156:0/2133082697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feea4134210 0x7feea411d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.448+0000 7feea1d9b700 1 -- 172.21.15.156:0/2133082697 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee94009500 con 0x7feea4133900 2023-09-30T22:20:29.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.448+0000 7feea1d9b700 1 --2- 172.21.15.156:0/2133082697 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feea4133900 0x7feea411cd40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fee9800c4e0 tx=0x7fee9800c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:29.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.448+0000 7fee92ffd700 1 -- 172.21.15.156:0/2133082697 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee980052d0 con 0x7feea4133900 2023-09-30T22:20:29.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.448+0000 7fee92ffd700 1 -- 172.21.15.156:0/2133082697 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee98005430 con 0x7feea4133900 2023-09-30T22:20:29.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.448+0000 7fee92ffd700 1 -- 172.21.15.156:0/2133082697 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee980038c0 con 0x7feea4133900 2023-09-30T22:20:29.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.449+0000 7feea8f99700 1 -- 172.21.15.156:0/2133082697 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee9c009a70 con 0x7feea4133900 2023-09-30T22:20:29.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.449+0000 7feea8f99700 1 -- 172.21.15.156:0/2133082697 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea4132f80 con 0x7feea4133900 2023-09-30T22:20:29.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.449+0000 7fee92ffd700 1 -- 172.21.15.156:0/2133082697 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee98003a20 con 0x7feea4133900 2023-09-30T22:20:29.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.449+0000 7fee92ffd700 1 -- 172.21.15.156:0/2133082697 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fee9803ea30 con 0x7feea4133900 2023-09-30T22:20:29.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.450+0000 7feea8f99700 1 -- 172.21.15.156:0/2133082697 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea411e3d0 con 0x7feea4133900 2023-09-30T22:20:29.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.454+0000 7fee92ffd700 1 -- 172.21.15.156:0/2133082697 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee98018260 con 0x7feea4133900 2023-09-30T22:20:29.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.480+0000 7f8c1fd50700 1 Processor -- start 2023-09-30T22:20:29.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.480+0000 7f8c1fd50700 1 -- start start 2023-09-30T22:20:29.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.480+0000 7f8c1fd50700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c1809d860 0x7f8c1809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:29.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.480+0000 7f8c1fd50700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c1809e170 0x7f8c181307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:29.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.481+0000 7f8c1fd50700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c1809aaa0 con 0x7f8c18130ce0 2023-09-30T22:20:29.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.481+0000 7f8c1fd50700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1809f870 con 0x7f8c1809d860 2023-09-30T22:20:29.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.481+0000 7f8c1fd50700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1809b360 con 0x7f8c1809e170 2023-09-30T22:20:29.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.481+0000 7f8c1d2eb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c1809e170 0x7f8c181307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:29.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.481+0000 7f8c1d2eb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c1809e170 0x7f8c181307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33798/0 (socket says 172.21.15.156:33798) 2023-09-30T22:20:29.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.481+0000 7f8c1daec700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c1809d860 0x7f8c1809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:29.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.481+0000 7f8c1d2eb700 1 -- 172.21.15.156:0/760327923 learned_addr learned my addr 172.21.15.156:0/760327923 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:29.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.481+0000 7f8c1caea700 1 -- 172.21.15.156:0/760327923 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 453285474 0 0) 0x7f8c1809aaa0 con 0x7f8c18130ce0 2023-09-30T22:20:29.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.481+0000 7f8c1caea700 1 -- 172.21.15.156:0/760327923 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c040035b0 con 0x7f8c18130ce0 2023-09-30T22:20:29.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.481+0000 7f8c1daec700 1 -- 172.21.15.156:0/760327923 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c1809e170 msgr2=0x7f8c181307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:29.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.481+0000 7f8c1daec700 1 --2- 172.21.15.156:0/760327923 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c1809e170 0x7f8c181307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.481+0000 7f8c1daec700 1 -- 172.21.15.156:0/760327923 >> v1:172.21.15.156:6789/0 conn(0x7f8c18130ce0 legacy=0x7f8c181379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:29.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.481+0000 7f8c1daec700 1 -- 172.21.15.156:0/760327923 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1809b620 con 0x7f8c1809d860 2023-09-30T22:20:29.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.481+0000 7f8c1d2eb700 1 --2- 172.21.15.156:0/760327923 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c1809e170 0x7f8c181307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:29.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.481+0000 7f8c1daec700 1 --2- 172.21.15.156:0/760327923 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c1809d860 0x7f8c1809dc30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8c14009870 tx=0x7f8c14009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=439bdafacc1cc7db server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:29.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.481+0000 7f8c1caea700 1 -- 172.21.15.156:0/760327923 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c14004230 con 0x7f8c1809d860 2023-09-30T22:20:29.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.482+0000 7f8c1caea700 1 -- 172.21.15.156:0/760327923 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c14004390 con 0x7f8c1809d860 2023-09-30T22:20:29.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.482+0000 7f8c1caea700 1 -- 172.21.15.156:0/760327923 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c140036a0 con 0x7f8c1809d860 2023-09-30T22:20:29.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.482+0000 7f8c1fd50700 1 -- 172.21.15.156:0/760327923 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c1809d860 msgr2=0x7f8c1809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:29.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.482+0000 7f8c1fd50700 1 --2- 172.21.15.156:0/760327923 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c1809d860 0x7f8c1809dc30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8c14009870 tx=0x7f8c14009b80 comp rx=0 tx=0).stop 2023-09-30T22:20:29.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.482+0000 7f8c1fd50700 1 -- 172.21.15.156:0/760327923 shutdown_connections 2023-09-30T22:20:29.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.482+0000 7f8c1fd50700 1 --2- 172.21.15.156:0/760327923 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c1809d860 0x7f8c1809dc30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.482+0000 7f8c1fd50700 1 --2- 172.21.15.156:0/760327923 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c1809e170 0x7f8c181307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.482+0000 7f8c1fd50700 1 -- 172.21.15.156:0/760327923 >> 172.21.15.156:0/760327923 conn(0x7f8c18099c40 msgr2=0x7f8c180a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:29.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.482+0000 7f8c1fd50700 1 -- 172.21.15.156:0/760327923 shutdown_connections 2023-09-30T22:20:29.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.482+0000 7f8c1fd50700 1 -- 172.21.15.156:0/760327923 wait complete. 2023-09-30T22:20:29.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.483+0000 7f8c1fd50700 1 Processor -- start 2023-09-30T22:20:29.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.483+0000 7f8c1fd50700 1 -- start start 2023-09-30T22:20:29.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.484+0000 7f8c1fd50700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c1809d860 0x7f8c1811e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:29.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.484+0000 7f8c1fd50700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c1809e170 0x7f8c1811eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:29.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.484+0000 7f8c1fd50700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c18130ce0 0x7f8c1811eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:29.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.484+0000 7f8c1fd50700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c18121e30 con 0x7f8c1809e170 2023-09-30T22:20:29.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.484+0000 7f8c1fd50700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c18122010 con 0x7f8c1809d860 2023-09-30T22:20:29.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.484+0000 7f8c1fd50700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c180a07a0 con 0x7f8c18130ce0 2023-09-30T22:20:29.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.484+0000 7f8c1daec700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c1809d860 0x7f8c1811e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:29.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.484+0000 7f8c1daec700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c1809d860 0x7f8c1811e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49386/0 (socket says 172.21.15.156:49386) 2023-09-30T22:20:29.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.484+0000 7f8c1daec700 1 -- 172.21.15.156:0/927385485 learned_addr learned my addr 172.21.15.156:0/927385485 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:29.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.484+0000 7f8c1d2eb700 1 --2- 172.21.15.156:0/927385485 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c1809e170 0x7f8c1811eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:29.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.484+0000 7f8c1daec700 1 -- 172.21.15.156:0/927385485 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c18130ce0 msgr2=0x7f8c1811eff0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:20:29.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.484+0000 7f8c1daec700 1 --2- 172.21.15.156:0/927385485 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c18130ce0 0x7f8c1811eff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.484+0000 7f8c1daec700 1 -- 172.21.15.156:0/927385485 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c1809e170 msgr2=0x7f8c1811eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:29.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.484+0000 7f8c1daec700 1 --2- 172.21.15.156:0/927385485 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c1809e170 0x7f8c1811eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.484+0000 7f8c1daec700 1 -- 172.21.15.156:0/927385485 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0800db30 con 0x7f8c1809d860 2023-09-30T22:20:29.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.484+0000 7f8c1d2eb700 1 --2- 172.21.15.156:0/927385485 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c1809e170 0x7f8c1811eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:29.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.484+0000 7f8c1daec700 1 --2- 172.21.15.156:0/927385485 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c1809d860 0x7f8c1811e570 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8c14000c00 tx=0x7f8c14004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:29.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.484+0000 7f8c0e7fc700 1 -- 172.21.15.156:0/927385485 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c14003da0 con 0x7f8c1809d860 2023-09-30T22:20:29.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.485+0000 7f8c0e7fc700 1 -- 172.21.15.156:0/927385485 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1401e070 con 0x7f8c1809d860 2023-09-30T22:20:29.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.485+0000 7f8c0e7fc700 1 -- 172.21.15.156:0/927385485 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c14011870 con 0x7f8c1809d860 2023-09-30T22:20:29.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.485+0000 7f8c1fd50700 1 -- 172.21.15.156:0/927385485 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c140094a0 con 0x7f8c1809d860 2023-09-30T22:20:29.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.485+0000 7f8c1fd50700 1 -- 172.21.15.156:0/927385485 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1809c8b0 con 0x7f8c1809d860 2023-09-30T22:20:29.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.486+0000 7f8c1fd50700 1 -- 172.21.15.156:0/927385485 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c181217d0 con 0x7f8c1809d860 2023-09-30T22:20:29.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.486+0000 7f8c0e7fc700 1 -- 172.21.15.156:0/927385485 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c140119d0 con 0x7f8c1809d860 2023-09-30T22:20:29.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.486+0000 7f8c0e7fc700 1 -- 172.21.15.156:0/927385485 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8c14040790 con 0x7f8c1809d860 2023-09-30T22:20:29.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.494+0000 7f8c0e7fc700 1 -- 172.21.15.156:0/927385485 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c14010950 con 0x7f8c1809d860 2023-09-30T22:20:29.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.497+0000 7fb5e9d0f700 1 Processor -- start 2023-09-30T22:20:29.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.497+0000 7fb5e9d0f700 1 -- start start 2023-09-30T22:20:29.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.497+0000 7fb5e9d0f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb5e406a770 0x7fb5e41349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:29.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.497+0000 7fb5e9d0f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb5e4134f00 0x7fb5e409d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:29.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.497+0000 7fb5e37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb5e406a770 0x7fb5e41349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:29.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.497+0000 7fb5e37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb5e406a770 0x7fb5e41349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49388/0 (socket says 172.21.15.156:49388) 2023-09-30T22:20:29.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.497+0000 7fb5e37fe700 1 -- 172.21.15.156:0/3354499015 learned_addr learned my addr 172.21.15.156:0/3354499015 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:29.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.497+0000 7fb5e9d0f700 1 -- 172.21.15.156:0/3354499015 --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e409eca0 con 0x7fb5e409dea0 2023-09-30T22:20:29.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.498+0000 7fb5e9d0f700 1 -- 172.21.15.156:0/3354499015 --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5e409f720 con 0x7fb5e4134f00 2023-09-30T22:20:29.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.498+0000 7fb5e9d0f700 1 -- 172.21.15.156:0/3354499015 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e406b480 con 0x7fb5e406a770 2023-09-30T22:20:29.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.498+0000 7fb5e2ffd700 1 --2- 172.21.15.156:0/3354499015 >> v2:172.21.15.156:3300/0 conn(0x7fb5e4134f00 0x7fb5e409d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:29.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.498+0000 7fb5e2ffd700 1 -- 172.21.15.156:0/3354499015 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb5e406a770 msgr2=0x7fb5e41349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:29.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.498+0000 7fb5e2ffd700 1 --2- 172.21.15.156:0/3354499015 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb5e406a770 0x7fb5e41349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.498+0000 7fb5e2ffd700 1 -- 172.21.15.156:0/3354499015 >> v1:172.21.15.156:6789/0 conn(0x7fb5e409dea0 legacy=0x7fb5e413ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:29.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.498+0000 7fb5e2ffd700 1 -- 172.21.15.156:0/3354499015 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e41352d0 con 0x7fb5e4134f00 2023-09-30T22:20:29.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.498+0000 7fb5e2ffd700 1 --2- 172.21.15.156:0/3354499015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5e4134f00 0x7fb5e409d960 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8009840 tx=0x7fb5d8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea97d37c811f9a42 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:29.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.498+0000 7fb5e27fc700 1 -- 172.21.15.156:0/3354499015 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8004230 con 0x7fb5e4134f00 2023-09-30T22:20:29.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.498+0000 7fb5e27fc700 1 -- 172.21.15.156:0/3354499015 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d8004390 con 0x7fb5e4134f00 2023-09-30T22:20:29.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.498+0000 7fb5e27fc700 1 -- 172.21.15.156:0/3354499015 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d80036a0 con 0x7fb5e4134f00 2023-09-30T22:20:29.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.499+0000 7fb5e9d0f700 1 -- 172.21.15.156:0/3354499015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5e4134f00 msgr2=0x7fb5e409d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:29.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.499+0000 7fb5e9d0f700 1 --2- 172.21.15.156:0/3354499015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5e4134f00 0x7fb5e409d960 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8009840 tx=0x7fb5d8009b50 comp rx=0 tx=0).stop 2023-09-30T22:20:29.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.499+0000 7fb5e9d0f700 1 -- 172.21.15.156:0/3354499015 shutdown_connections 2023-09-30T22:20:29.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.499+0000 7fb5e9d0f700 1 --2- 172.21.15.156:0/3354499015 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb5e406a770 0x7fb5e41349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.499+0000 7fb5e9d0f700 1 --2- 172.21.15.156:0/3354499015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5e4134f00 0x7fb5e409d960 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.499+0000 7fb5e9d0f700 1 -- 172.21.15.156:0/3354499015 >> 172.21.15.156:0/3354499015 conn(0x7fb5e4099c40 msgr2=0x7fb5e40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:29.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.499+0000 7fb5e9d0f700 1 -- 172.21.15.156:0/3354499015 shutdown_connections 2023-09-30T22:20:29.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.499+0000 7fb5e9d0f700 1 -- 172.21.15.156:0/3354499015 wait complete. 2023-09-30T22:20:29.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.501+0000 7fb5e9d0f700 1 Processor -- start 2023-09-30T22:20:29.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.501+0000 7fb5e9d0f700 1 -- start start 2023-09-30T22:20:29.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.501+0000 7fb5e9d0f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5e406a770 0x7fb5e41d5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:29.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.501+0000 7fb5e9d0f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb5e409dea0 0x7fb5e41d5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:29.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.501+0000 7fb5e9d0f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb5e4134f00 0x7fb5e41ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:29.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.501+0000 7fb5e9d0f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e4070d80 con 0x7fb5e406a770 2023-09-30T22:20:29.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.501+0000 7fb5e9d0f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e409f220 con 0x7fb5e409dea0 2023-09-30T22:20:29.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.501+0000 7fb5e9d0f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e411e110 con 0x7fb5e4134f00 2023-09-30T22:20:29.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.502+0000 7fb5e3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb5e4134f00 0x7fb5e41ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:29.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.502+0000 7fb5e2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb5e409dea0 0x7fb5e41d5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:29.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.502+0000 7fb5e3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb5e4134f00 0x7fb5e41ce9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33812/0 (socket says 172.21.15.156:33812) 2023-09-30T22:20:29.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.502+0000 7fb5e3fff700 1 -- 172.21.15.156:0/4219231424 learned_addr learned my addr 172.21.15.156:0/4219231424 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:29.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.502+0000 7fb5e37fe700 1 --2- 172.21.15.156:0/4219231424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5e406a770 0x7fb5e41d5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:29.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.502+0000 7fb5e3fff700 1 -- 172.21.15.156:0/4219231424 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb5e409dea0 msgr2=0x7fb5e41d5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:29.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.502+0000 7fb5e3fff700 1 --2- 172.21.15.156:0/4219231424 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb5e409dea0 0x7fb5e41d5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.502+0000 7fb5e3fff700 1 -- 172.21.15.156:0/4219231424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5e406a770 msgr2=0x7fb5e41d5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:29.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.502+0000 7fb5e3fff700 1 --2- 172.21.15.156:0/4219231424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5e406a770 0x7fb5e41d5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.502+0000 7fb5e3fff700 1 -- 172.21.15.156:0/4219231424 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d80094a0 con 0x7fb5e4134f00 2023-09-30T22:20:29.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.502+0000 7fb5e3fff700 1 --2- 172.21.15.156:0/4219231424 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb5e4134f00 0x7fb5e41ce9d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00c7d0 tx=0x7fb5dc00cae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:29.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.502+0000 7fb5cbfff700 1 -- 172.21.15.156:0/4219231424 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc003e10 con 0x7fb5e4134f00 2023-09-30T22:20:29.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.502+0000 7fb5cbfff700 1 -- 172.21.15.156:0/4219231424 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5dc005070 con 0x7fb5e4134f00 2023-09-30T22:20:29.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.502+0000 7fb5cbfff700 1 -- 172.21.15.156:0/4219231424 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc005400 con 0x7fb5e4134f00 2023-09-30T22:20:29.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.502+0000 7fb5e9d0f700 1 -- 172.21.15.156:0/4219231424 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e411dbd0 con 0x7fb5e4134f00 2023-09-30T22:20:29.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.502+0000 7fb5e9d0f700 1 -- 172.21.15.156:0/4219231424 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e40714e0 con 0x7fb5e4134f00 2023-09-30T22:20:29.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.503+0000 7fb5cbfff700 1 -- 172.21.15.156:0/4219231424 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb5dc005560 con 0x7fb5e4134f00 2023-09-30T22:20:29.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.504+0000 7fb5cbfff700 1 -- 172.21.15.156:0/4219231424 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb5dc03eae0 con 0x7fb5e4134f00 2023-09-30T22:20:29.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.504+0000 7fb5e9d0f700 1 -- 172.21.15.156:0/4219231424 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5e411dea0 con 0x7fb5e4134f00 2023-09-30T22:20:29.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.508+0000 7fb5cbfff700 1 -- 172.21.15.156:0/4219231424 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb5dc010b30 con 0x7fb5e4134f00 2023-09-30T22:20:29.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.652+0000 7feea8f99700 1 -- 172.21.15.156:0/2133082697 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feea404f2a0 con 0x7feea4133900 2023-09-30T22:20:29.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.652+0000 7fee92ffd700 1 -- 172.21.15.156:0/2133082697 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fee98017030 con 0x7feea4133900 2023-09-30T22:20:29.652 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:29.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.654+0000 7feea8f99700 1 -- 172.21.15.156:0/2133082697 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feea4133900 msgr2=0x7feea411cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:29.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.654+0000 7feea8f99700 1 --2- 172.21.15.156:0/2133082697 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feea4133900 0x7feea411cd40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fee9800c4e0 tx=0x7fee9800c7f0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.654+0000 7feea8f99700 1 -- 172.21.15.156:0/2133082697 shutdown_connections 2023-09-30T22:20:29.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.654+0000 7feea8f99700 1 --2- 172.21.15.156:0/2133082697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feea4134210 0x7feea411d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.654+0000 7feea8f99700 1 --2- 172.21.15.156:0/2133082697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feea40a10b0 0x7feea411c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.654+0000 7feea8f99700 1 --2- 172.21.15.156:0/2133082697 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feea4133900 0x7feea411cd40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.654+0000 7feea8f99700 1 -- 172.21.15.156:0/2133082697 >> 172.21.15.156:0/2133082697 conn(0x7feea40a2980 msgr2=0x7feea41bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:29.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.654+0000 7feea8f99700 1 -- 172.21.15.156:0/2133082697 shutdown_connections 2023-09-30T22:20:29.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.654+0000 7feea8f99700 1 -- 172.21.15.156:0/2133082697 wait complete. 2023-09-30T22:20:29.666 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:29.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.692+0000 7f8c1fd50700 1 -- 172.21.15.156:0/927385485 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8c1804f2a0 con 0x7f8c1809d860 2023-09-30T22:20:29.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.692+0000 7f8c0e7fc700 1 -- 172.21.15.156:0/927385485 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c14010380 con 0x7f8c1809d860 2023-09-30T22:20:29.692 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:29.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.694+0000 7f8c1fd50700 1 -- 172.21.15.156:0/927385485 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c1809d860 msgr2=0x7f8c1811e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:29.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.694+0000 7f8c1fd50700 1 --2- 172.21.15.156:0/927385485 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c1809d860 0x7f8c1811e570 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8c14000c00 tx=0x7f8c14004750 comp rx=0 tx=0).stop 2023-09-30T22:20:29.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.694+0000 7f8c1fd50700 1 -- 172.21.15.156:0/927385485 shutdown_connections 2023-09-30T22:20:29.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.694+0000 7f8c1fd50700 1 --2- 172.21.15.156:0/927385485 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c18130ce0 0x7f8c1811eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.695+0000 7f8c1fd50700 1 --2- 172.21.15.156:0/927385485 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c1809d860 0x7f8c1811e570 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.695+0000 7f8c1fd50700 1 --2- 172.21.15.156:0/927385485 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c1809e170 0x7f8c1811eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.695+0000 7f8c1fd50700 1 -- 172.21.15.156:0/927385485 >> 172.21.15.156:0/927385485 conn(0x7f8c18099c40 msgr2=0x7f8c180a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:29.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.695+0000 7f8c1fd50700 1 -- 172.21.15.156:0/927385485 shutdown_connections 2023-09-30T22:20:29.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.695+0000 7f8c1fd50700 1 -- 172.21.15.156:0/927385485 wait complete. 2023-09-30T22:20:29.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:29.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.776+0000 7fa4689b8700 1 -- 172.21.15.156:0/3458848453 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa464129ac0 con 0x7fa4640a08e0 2023-09-30T22:20:29.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.776+0000 7fa452ffd700 1 -- 172.21.15.156:0/3458848453 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa45401f020 con 0x7fa4640a08e0 2023-09-30T22:20:29.776 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:29.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.779+0000 7fa4689b8700 1 -- 172.21.15.156:0/3458848453 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4640a08e0 msgr2=0x7fa4641263f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:29.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.779+0000 7fa4689b8700 1 --2- 172.21.15.156:0/3458848453 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4640a08e0 0x7fa4641263f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa454009c70 tx=0x7fa454004750 comp rx=0 tx=0).stop 2023-09-30T22:20:29.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.779+0000 7fa4689b8700 1 -- 172.21.15.156:0/3458848453 shutdown_connections 2023-09-30T22:20:29.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.779+0000 7fa4689b8700 1 --2- 172.21.15.156:0/3458848453 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa464138040 0x7fa464126e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.779+0000 7fa4689b8700 1 --2- 172.21.15.156:0/3458848453 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4640a08e0 0x7fa4641263f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.779+0000 7fa4689b8700 1 --2- 172.21.15.156:0/3458848453 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4640a1230 0x7fa464126930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.779+0000 7fa4689b8700 1 -- 172.21.15.156:0/3458848453 >> 172.21.15.156:0/3458848453 conn(0x7fa4640a2980 msgr2=0x7fa46409e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:29.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.779+0000 7fa4689b8700 1 -- 172.21.15.156:0/3458848453 shutdown_connections 2023-09-30T22:20:29.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.779+0000 7fa4689b8700 1 -- 172.21.15.156:0/3458848453 wait complete. 2023-09-30T22:20:29.790 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:29.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.815+0000 7fb5e9d0f700 1 -- 172.21.15.156:0/4219231424 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb5e404f2a0 con 0x7fb5e4134f00 2023-09-30T22:20:29.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.815+0000 7fb5cbfff700 1 -- 172.21.15.156:0/4219231424 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb5dc017020 con 0x7fb5e4134f00 2023-09-30T22:20:29.815 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:29.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.817+0000 7fb5e9d0f700 1 -- 172.21.15.156:0/4219231424 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb5e4134f00 msgr2=0x7fb5e41ce9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:29.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.817+0000 7fb5e9d0f700 1 --2- 172.21.15.156:0/4219231424 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb5e4134f00 0x7fb5e41ce9d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00c7d0 tx=0x7fb5dc00cae0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.817+0000 7fb5e9d0f700 1 -- 172.21.15.156:0/4219231424 shutdown_connections 2023-09-30T22:20:29.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.817+0000 7fb5e9d0f700 1 --2- 172.21.15.156:0/4219231424 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb5e4134f00 0x7fb5e41ce9d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.817+0000 7fb5e9d0f700 1 --2- 172.21.15.156:0/4219231424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5e406a770 0x7fb5e41d5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.817+0000 7fb5e9d0f700 1 --2- 172.21.15.156:0/4219231424 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb5e409dea0 0x7fb5e41d5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:29.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.817+0000 7fb5e9d0f700 1 -- 172.21.15.156:0/4219231424 >> 172.21.15.156:0/4219231424 conn(0x7fb5e4099c40 msgr2=0x7fb5e40a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:29.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.817+0000 7fb5e9d0f700 1 -- 172.21.15.156:0/4219231424 shutdown_connections 2023-09-30T22:20:29.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:29.817+0000 7fb5e9d0f700 1 -- 172.21.15.156:0/4219231424 wait complete. 2023-09-30T22:20:29.829 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:30.668 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:30.708 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:30.791 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:30.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.809+0000 7f9ef254b700 1 Processor -- start 2023-09-30T22:20:30.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.809+0000 7f9ef254b700 1 -- start start 2023-09-30T22:20:30.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.809+0000 7f9ef254b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9eec099e20 0x7f9eec09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:30.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.809+0000 7f9ef254b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9eec09a730 0x7f9eec130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:30.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.809+0000 7f9ef254b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eec099a60 con 0x7f9eec130890 2023-09-30T22:20:30.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.809+0000 7f9ef254b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eec09bf50 con 0x7f9eec099e20 2023-09-30T22:20:30.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.809+0000 7f9ef254b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec09b230 con 0x7f9eec09a730 2023-09-30T22:20:30.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.809+0000 7f9eeb7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9eec09a730 0x7f9eec130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:30.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.809+0000 7f9eeb7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9eec09a730 0x7f9eec130350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33828/0 (socket says 172.21.15.156:33828) 2023-09-30T22:20:30.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.809+0000 7f9eeb7fe700 1 -- 172.21.15.156:0/2211343491 learned_addr learned my addr 172.21.15.156:0/2211343491 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:30.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.809+0000 7f9eebfff700 1 --2- 172.21.15.156:0/2211343491 >> v2:172.21.15.156:3300/0 conn(0x7f9eec099e20 0x7f9eec09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:30.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.810+0000 7f9eeb7fe700 1 -- 172.21.15.156:0/2211343491 >> v2:172.21.15.156:3300/0 conn(0x7f9eec099e20 msgr2=0x7f9eec09a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:30.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.810+0000 7f9eeb7fe700 1 --2- 172.21.15.156:0/2211343491 >> v2:172.21.15.156:3300/0 conn(0x7f9eec099e20 0x7f9eec09a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:30.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.810+0000 7f9eeb7fe700 1 -- 172.21.15.156:0/2211343491 >> v1:172.21.15.156:6789/0 conn(0x7f9eec130890 legacy=0x7f9eec137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:30.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.810+0000 7f9eeb7fe700 1 -- 172.21.15.156:0/2211343491 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eec09bb90 con 0x7f9eec09a730 2023-09-30T22:20:30.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.810+0000 7f9eebfff700 1 --2- 172.21.15.156:0/2211343491 >> v2:172.21.15.156:3300/0 conn(0x7f9eec099e20 0x7f9eec09a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:30.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.810+0000 7f9eeb7fe700 1 --2- 172.21.15.156:0/2211343491 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9eec09a730 0x7f9eec130350 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9ee000bb90 tx=0x7f9ee000bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e336767c8c7e5c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:30.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.810+0000 7f9eeaffd700 1 -- 172.21.15.156:0/2211343491 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee000dd30 con 0x7f9eec09a730 2023-09-30T22:20:30.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.810+0000 7f9eeaffd700 1 -- 172.21.15.156:0/2211343491 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee000de90 con 0x7f9eec09a730 2023-09-30T22:20:30.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.810+0000 7f9eeaffd700 1 -- 172.21.15.156:0/2211343491 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0010690 con 0x7f9eec09a730 2023-09-30T22:20:30.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.811+0000 7f9ef254b700 1 -- 172.21.15.156:0/2211343491 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9eec09a730 msgr2=0x7f9eec130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:30.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.811+0000 7f9ef254b700 1 --2- 172.21.15.156:0/2211343491 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9eec09a730 0x7f9eec130350 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9ee000bb90 tx=0x7f9ee000bea0 comp rx=0 tx=0).stop 2023-09-30T22:20:30.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.811+0000 7f9ef254b700 1 -- 172.21.15.156:0/2211343491 shutdown_connections 2023-09-30T22:20:30.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.811+0000 7f9ef254b700 1 --2- 172.21.15.156:0/2211343491 >> v2:172.21.15.156:3300/0 conn(0x7f9eec099e20 0x7f9eec09a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:30.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.811+0000 7f9ef254b700 1 --2- 172.21.15.156:0/2211343491 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9eec09a730 0x7f9eec130350 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:30.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.811+0000 7f9ef254b700 1 -- 172.21.15.156:0/2211343491 >> 172.21.15.156:0/2211343491 conn(0x7f9eec0a2980 msgr2=0x7f9eec0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:30.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.811+0000 7f9ef254b700 1 -- 172.21.15.156:0/2211343491 shutdown_connections 2023-09-30T22:20:30.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.811+0000 7f9ef254b700 1 -- 172.21.15.156:0/2211343491 wait complete. 2023-09-30T22:20:30.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.812+0000 7f9ef254b700 1 Processor -- start 2023-09-30T22:20:30.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.812+0000 7f9ef254b700 1 -- start start 2023-09-30T22:20:30.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.812+0000 7f9ef254b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9eec099e20 0x7f9eec11bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:30.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.812+0000 7f9ef254b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9eec09a730 0x7f9eec11bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:30.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.812+0000 7f9ef254b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9eec130890 0x7f9eec11c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:30.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.812+0000 7f9ef254b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec11cf10 con 0x7f9eec130890 2023-09-30T22:20:30.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.812+0000 7f9ef254b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec09b470 con 0x7f9eec099e20 2023-09-30T22:20:30.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.812+0000 7f9ef254b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec11f500 con 0x7f9eec09a730 2023-09-30T22:20:30.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.813+0000 7f9eebfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9eec099e20 0x7f9eec11bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:30.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.813+0000 7f9eebfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9eec099e20 0x7f9eec11bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49414/0 (socket says 172.21.15.156:49414) 2023-09-30T22:20:30.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.813+0000 7f9eebfff700 1 -- 172.21.15.156:0/3153789184 learned_addr learned my addr 172.21.15.156:0/3153789184 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:30.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.813+0000 7f9ef0ae8700 1 --2- 172.21.15.156:0/3153789184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9eec130890 0x7f9eec11c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:30.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.813+0000 7f9eeb7fe700 1 --2- 172.21.15.156:0/3153789184 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9eec09a730 0x7f9eec11bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:30.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.813+0000 7f9eebfff700 1 -- 172.21.15.156:0/3153789184 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9eec09a730 msgr2=0x7f9eec11bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:30.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.813+0000 7f9eebfff700 1 --2- 172.21.15.156:0/3153789184 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9eec09a730 0x7f9eec11bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:30.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.813+0000 7f9eebfff700 1 -- 172.21.15.156:0/3153789184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9eec130890 msgr2=0x7f9eec11c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:30.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.813+0000 7f9eebfff700 1 --2- 172.21.15.156:0/3153789184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9eec130890 0x7f9eec11c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:30.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.813+0000 7f9eebfff700 1 -- 172.21.15.156:0/3153789184 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc009430 con 0x7f9eec099e20 2023-09-30T22:20:30.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.813+0000 7f9ef0ae8700 1 --2- 172.21.15.156:0/3153789184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9eec130890 0x7f9eec11c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:30.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.813+0000 7f9eebfff700 1 --2- 172.21.15.156:0/3153789184 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9eec099e20 0x7f9eec11bab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00ebe0 tx=0x7f9edc00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:30.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.813+0000 7f9ee8ff9700 1 -- 172.21.15.156:0/3153789184 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc009740 con 0x7f9eec099e20 2023-09-30T22:20:30.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.813+0000 7f9ee8ff9700 1 -- 172.21.15.156:0/3153789184 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc005a20 con 0x7f9eec099e20 2023-09-30T22:20:30.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.813+0000 7f9ef254b700 1 -- 172.21.15.156:0/3153789184 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee000b7f0 con 0x7f9eec099e20 2023-09-30T22:20:30.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.814+0000 7f9ee8ff9700 1 -- 172.21.15.156:0/3153789184 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc005db0 con 0x7f9eec099e20 2023-09-30T22:20:30.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.814+0000 7f9ef254b700 1 -- 172.21.15.156:0/3153789184 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eec11ef60 con 0x7f9eec099e20 2023-09-30T22:20:30.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.814+0000 7f9ee8ff9700 1 -- 172.21.15.156:0/3153789184 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9edc00c850 con 0x7f9eec099e20 2023-09-30T22:20:30.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.814+0000 7f9ee8ff9700 1 -- 172.21.15.156:0/3153789184 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9edc03f8b0 con 0x7f9eec099e20 2023-09-30T22:20:30.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.815+0000 7f9ef254b700 1 -- 172.21.15.156:0/3153789184 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eec072480 con 0x7f9eec099e20 2023-09-30T22:20:30.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.819+0000 7f9ee8ff9700 1 -- 172.21.15.156:0/3153789184 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9eec072480 con 0x7f9eec099e20 2023-09-30T22:20:30.829 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:30.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.848+0000 7f3d1b9ee700 1 Processor -- start 2023-09-30T22:20:30.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.848+0000 7f3d1b9ee700 1 -- start start 2023-09-30T22:20:30.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.849+0000 7f3d1b9ee700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3d140a0a30 0x7f3d140a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:30.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.849+0000 7f3d1b9ee700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d140a1340 0x7f3d1412ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:30.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.849+0000 7f3d1b9ee700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d141304a0 0x7f3d141308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:30.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.849+0000 7f3d1b9ee700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d14130e30 con 0x7f3d140a0a30 2023-09-30T22:20:30.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.849+0000 7f3d1b9ee700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d140a1e70 con 0x7f3d141304a0 2023-09-30T22:20:30.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.849+0000 7f3d1b9ee700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1409a720 con 0x7f3d140a1340 2023-09-30T22:20:30.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.849+0000 7f3d19f8b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d141304a0 0x7f3d141308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:30.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.849+0000 7f3d19f8b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d141304a0 0x7f3d141308f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49426/0 (socket says 172.21.15.156:49426) 2023-09-30T22:20:30.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.849+0000 7f3d19f8b700 1 -- 172.21.15.156:0/2561377744 learned_addr learned my addr 172.21.15.156:0/2561377744 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:30.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.849+0000 7f3d19f8b700 1 -- 172.21.15.156:0/2561377744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d140a1340 msgr2=0x7f3d1412ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:30.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.849+0000 7f3d19f8b700 1 --2- 172.21.15.156:0/2561377744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d140a1340 0x7f3d1412ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:30.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.849+0000 7f3d19f8b700 1 -- 172.21.15.156:0/2561377744 >> v2:172.21.15.156:3300/0 conn(0x7f3d140a0a30 msgr2=0x7f3d140a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:30.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.849+0000 7f3d19f8b700 1 --2- 172.21.15.156:0/2561377744 >> v2:172.21.15.156:3300/0 conn(0x7f3d140a0a30 0x7f3d140a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:30.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.849+0000 7f3d19f8b700 1 -- 172.21.15.156:0/2561377744 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1409b300 con 0x7f3d141304a0 2023-09-30T22:20:30.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.849+0000 7f3d19f8b700 1 --2- 172.21.15.156:0/2561377744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d141304a0 0x7f3d141308f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c009e80 tx=0x7f3d0c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af145f9808d12ab7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:30.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.850+0000 7f3d0bfff700 1 -- 172.21.15.156:0/2561377744 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c00e070 con 0x7f3d141304a0 2023-09-30T22:20:30.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.850+0000 7f3d0bfff700 1 -- 172.21.15.156:0/2561377744 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0c00b980 con 0x7f3d141304a0 2023-09-30T22:20:30.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.850+0000 7f3d0bfff700 1 -- 172.21.15.156:0/2561377744 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c00bd30 con 0x7f3d141304a0 2023-09-30T22:20:30.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.851+0000 7f3d1b9ee700 1 -- 172.21.15.156:0/2561377744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d141304a0 msgr2=0x7f3d141308f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:30.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.851+0000 7f3d1b9ee700 1 --2- 172.21.15.156:0/2561377744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d141304a0 0x7f3d141308f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c009e80 tx=0x7f3d0c00b330 comp rx=0 tx=0).stop 2023-09-30T22:20:30.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.851+0000 7f3d1b9ee700 1 -- 172.21.15.156:0/2561377744 shutdown_connections 2023-09-30T22:20:30.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.851+0000 7f3d1b9ee700 1 --2- 172.21.15.156:0/2561377744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d141304a0 0x7f3d141308f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:30.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.851+0000 7f3d1b9ee700 1 --2- 172.21.15.156:0/2561377744 >> v2:172.21.15.156:3300/0 conn(0x7f3d140a0a30 0x7f3d140a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:30.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.851+0000 7f3d1b9ee700 1 --2- 172.21.15.156:0/2561377744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d140a1340 0x7f3d1412ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:30.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.851+0000 7f3d1b9ee700 1 -- 172.21.15.156:0/2561377744 >> 172.21.15.156:0/2561377744 conn(0x7f3d140a2980 msgr2=0x7f3d140a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:30.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.851+0000 7f3d1b9ee700 1 -- 172.21.15.156:0/2561377744 shutdown_connections 2023-09-30T22:20:30.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.851+0000 7f3d1b9ee700 1 -- 172.21.15.156:0/2561377744 wait complete. 2023-09-30T22:20:30.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.852+0000 7f3d1b9ee700 1 Processor -- start 2023-09-30T22:20:30.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.852+0000 7f3d1b9ee700 1 -- start start 2023-09-30T22:20:30.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.853+0000 7f3d1b9ee700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d140a0a30 0x7f3d14128ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:30.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.853+0000 7f3d1b9ee700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d140a1340 0x7f3d14129430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:30.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.853+0000 7f3d1b9ee700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d141304a0 0x7f3d14129970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:30.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.853+0000 7f3d1b9ee700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d141337d0 con 0x7f3d141304a0 2023-09-30T22:20:30.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.853+0000 7f3d1b9ee700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d141301d0 con 0x7f3d140a1340 2023-09-30T22:20:30.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.853+0000 7f3d1b9ee700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1409ae00 con 0x7f3d140a0a30 2023-09-30T22:20:30.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.853+0000 7f3d1978a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d140a0a30 0x7f3d14128ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:30.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.853+0000 7f3d1978a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d140a0a30 0x7f3d14128ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33862/0 (socket says 172.21.15.156:33862) 2023-09-30T22:20:30.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.853+0000 7f3d1978a700 1 -- 172.21.15.156:0/4102818480 learned_addr learned my addr 172.21.15.156:0/4102818480 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:30.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.853+0000 7f3d19f8b700 1 --2- 172.21.15.156:0/4102818480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d141304a0 0x7f3d14129970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:30.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.853+0000 7f3d18f89700 1 --2- 172.21.15.156:0/4102818480 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d140a1340 0x7f3d14129430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:30.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.853+0000 7f3d1978a700 1 -- 172.21.15.156:0/4102818480 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d140a1340 msgr2=0x7f3d14129430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:30.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.853+0000 7f3d1978a700 1 --2- 172.21.15.156:0/4102818480 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d140a1340 0x7f3d14129430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:30.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.853+0000 7f3d1978a700 1 -- 172.21.15.156:0/4102818480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d141304a0 msgr2=0x7f3d14129970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:30.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.853+0000 7f3d1978a700 1 --2- 172.21.15.156:0/4102818480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d141304a0 0x7f3d14129970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:30.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.854+0000 7f3d1978a700 1 -- 172.21.15.156:0/4102818480 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c009b30 con 0x7f3d140a0a30 2023-09-30T22:20:30.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.854+0000 7f3d19f8b700 1 --2- 172.21.15.156:0/4102818480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d141304a0 0x7f3d14129970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:30.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.854+0000 7f3d18f89700 1 --2- 172.21.15.156:0/4102818480 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d140a1340 0x7f3d14129430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:30.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.854+0000 7f3d1978a700 1 --2- 172.21.15.156:0/4102818480 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d140a0a30 0x7f3d14128ef0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3d1000b520 tx=0x7f3d1000b830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:30.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.854+0000 7f3d09ffb700 1 -- 172.21.15.156:0/4102818480 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d10005aa0 con 0x7f3d140a0a30 2023-09-30T22:20:30.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.854+0000 7f3d09ffb700 1 -- 172.21.15.156:0/4102818480 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d10005c00 con 0x7f3d140a0a30 2023-09-30T22:20:30.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.854+0000 7f3d1b9ee700 1 -- 172.21.15.156:0/4102818480 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d1409f0b0 con 0x7f3d140a0a30 2023-09-30T22:20:30.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.854+0000 7f3d09ffb700 1 -- 172.21.15.156:0/4102818480 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d10011630 con 0x7f3d140a0a30 2023-09-30T22:20:30.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.854+0000 7f3d1b9ee700 1 -- 172.21.15.156:0/4102818480 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d14132440 con 0x7f3d140a0a30 2023-09-30T22:20:30.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.855+0000 7f3d09ffb700 1 -- 172.21.15.156:0/4102818480 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3d10011790 con 0x7f3d140a0a30 2023-09-30T22:20:30.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.855+0000 7f3d09ffb700 1 -- 172.21.15.156:0/4102818480 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3d1003f210 con 0x7f3d140a0a30 2023-09-30T22:20:30.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.856+0000 7f3d1b9ee700 1 -- 172.21.15.156:0/4102818480 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d1404f2a0 con 0x7f3d140a0a30 2023-09-30T22:20:30.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.865+0000 7f3d09ffb700 1 -- 172.21.15.156:0/4102818480 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d10005fd0 con 0x7f3d140a0a30 2023-09-30T22:20:30.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.927+0000 7f3166605700 1 Processor -- start 2023-09-30T22:20:30.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.927+0000 7f3166605700 1 -- start start 2023-09-30T22:20:30.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.927+0000 7f3166605700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f316006a770 0x7f316006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:30.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.927+0000 7f3166605700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f316006b080 0x7f31601317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:30.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.927+0000 7f3166605700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3160131cf0 0x7f3160132170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:30.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.927+0000 7f3166605700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f316009f770 con 0x7f316006a770 2023-09-30T22:20:30.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.927+0000 7f3166605700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f316009dce0 con 0x7f3160131cf0 2023-09-30T22:20:30.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.928+0000 7f3166605700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f316009da80 con 0x7f316006b080 2023-09-30T22:20:30.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.928+0000 7f315f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f316006b080 0x7f31601317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:30.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.928+0000 7f315f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f316006b080 0x7f31601317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33864/0 (socket says 172.21.15.156:33864) 2023-09-30T22:20:30.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.928+0000 7f315f7fe700 1 -- 172.21.15.156:0/3407534002 learned_addr learned my addr 172.21.15.156:0/3407534002 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:30.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.928+0000 7f315ffff700 1 --2- 172.21.15.156:0/3407534002 >> v2:172.21.15.156:3300/0 conn(0x7f316006a770 0x7f316006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:30.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.928+0000 7f3164ba2700 1 --2- 172.21.15.156:0/3407534002 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3160131cf0 0x7f3160132170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:30.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.928+0000 7f315f7fe700 1 -- 172.21.15.156:0/3407534002 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3160131cf0 msgr2=0x7f3160132170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:30.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.928+0000 7f315f7fe700 1 --2- 172.21.15.156:0/3407534002 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3160131cf0 0x7f3160132170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:30.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.928+0000 7f315f7fe700 1 -- 172.21.15.156:0/3407534002 >> v2:172.21.15.156:3300/0 conn(0x7f316006a770 msgr2=0x7f316006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:30.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.928+0000 7f315f7fe700 1 --2- 172.21.15.156:0/3407534002 >> v2:172.21.15.156:3300/0 conn(0x7f316006a770 0x7f316006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:30.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.928+0000 7f315f7fe700 1 -- 172.21.15.156:0/3407534002 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316009eb20 con 0x7f316006b080 2023-09-30T22:20:30.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.928+0000 7f315f7fe700 1 --2- 172.21.15.156:0/3407534002 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f316006b080 0x7f31601317b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f31540098f0 tx=0x7f3154009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d027e4161542965d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:30.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.928+0000 7f315effd700 1 -- 172.21.15.156:0/3407534002 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3154011830 con 0x7f316006b080 2023-09-30T22:20:30.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.929+0000 7f315effd700 1 -- 172.21.15.156:0/3407534002 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3154011990 con 0x7f316006b080 2023-09-30T22:20:30.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.929+0000 7f315effd700 1 -- 172.21.15.156:0/3407534002 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3154011d20 con 0x7f316006b080 2023-09-30T22:20:30.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.929+0000 7f3166605700 1 -- 172.21.15.156:0/3407534002 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f316006b080 msgr2=0x7f31601317b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:30.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.929+0000 7f3166605700 1 --2- 172.21.15.156:0/3407534002 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f316006b080 0x7f31601317b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f31540098f0 tx=0x7f3154009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:30.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.929+0000 7f3166605700 1 -- 172.21.15.156:0/3407534002 shutdown_connections 2023-09-30T22:20:30.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.929+0000 7f3166605700 1 --2- 172.21.15.156:0/3407534002 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3160131cf0 0x7f3160132170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:30.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.929+0000 7f3166605700 1 --2- 172.21.15.156:0/3407534002 >> v2:172.21.15.156:3300/0 conn(0x7f316006a770 0x7f316006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:30.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.929+0000 7f3166605700 1 --2- 172.21.15.156:0/3407534002 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f316006b080 0x7f31601317b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:30.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.929+0000 7f3166605700 1 -- 172.21.15.156:0/3407534002 >> 172.21.15.156:0/3407534002 conn(0x7f3160099c40 msgr2=0x7f31600a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:30.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.929+0000 7f3166605700 1 -- 172.21.15.156:0/3407534002 shutdown_connections 2023-09-30T22:20:30.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.929+0000 7f3166605700 1 -- 172.21.15.156:0/3407534002 wait complete. 2023-09-30T22:20:30.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.931+0000 7f3166605700 1 Processor -- start 2023-09-30T22:20:30.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.931+0000 7f3166605700 1 -- start start 2023-09-30T22:20:30.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.931+0000 7f3166605700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f316006a770 0x7f31601327c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:30.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.931+0000 7f3166605700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f316006b080 0x7f3160132d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:30.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.931+0000 7f3166605700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3160131cf0 0x7f3160133240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:30.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.931+0000 7f3166605700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3160071e10 con 0x7f3160131cf0 2023-09-30T22:20:30.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.931+0000 7f3166605700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3160135320 con 0x7f316006b080 2023-09-30T22:20:30.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.931+0000 7f3166605700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f316012aff0 con 0x7f316006a770 2023-09-30T22:20:30.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.932+0000 7f315ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f316006a770 0x7f31601327c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:30.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.932+0000 7f315ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f316006a770 0x7f31601327c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33874/0 (socket says 172.21.15.156:33874) 2023-09-30T22:20:30.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.932+0000 7f315ffff700 1 -- 172.21.15.156:0/2491258107 learned_addr learned my addr 172.21.15.156:0/2491258107 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:30.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.932+0000 7f315f7fe700 1 --2- 172.21.15.156:0/2491258107 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f316006b080 0x7f3160132d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:30.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.932+0000 7f315ffff700 1 -- 172.21.15.156:0/2491258107 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f316006b080 msgr2=0x7f3160132d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:30.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.932+0000 7f315ffff700 1 --2- 172.21.15.156:0/2491258107 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f316006b080 0x7f3160132d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:30.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.932+0000 7f315ffff700 1 -- 172.21.15.156:0/2491258107 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3160131cf0 msgr2=0x7f3160133240 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:20:30.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.932+0000 7f315ffff700 1 --2- 172.21.15.156:0/2491258107 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3160131cf0 0x7f3160133240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:30.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.932+0000 7f315ffff700 1 -- 172.21.15.156:0/2491258107 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3154009550 con 0x7f316006a770 2023-09-30T22:20:30.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.932+0000 7f315ffff700 1 --2- 172.21.15.156:0/2491258107 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f316006a770 0x7f31601327c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f315000e9b0 tx=0x7f315000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:30.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.932+0000 7f315cff9700 1 -- 172.21.15.156:0/2491258107 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315000c850 con 0x7f316006a770 2023-09-30T22:20:30.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.932+0000 7f315cff9700 1 -- 172.21.15.156:0/2491258107 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315000c9b0 con 0x7f316006a770 2023-09-30T22:20:30.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.932+0000 7f3166605700 1 -- 172.21.15.156:0/2491258107 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31601358c0 con 0x7f316006a770 2023-09-30T22:20:30.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.932+0000 7f315cff9700 1 -- 172.21.15.156:0/2491258107 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315000cd20 con 0x7f316006a770 2023-09-30T22:20:30.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.932+0000 7f3166605700 1 -- 172.21.15.156:0/2491258107 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3160133b20 con 0x7f316006a770 2023-09-30T22:20:30.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.933+0000 7f3166605700 1 -- 172.21.15.156:0/2491258107 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f316004f2a0 con 0x7f316006a770 2023-09-30T22:20:30.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.934+0000 7f315cff9700 1 -- 172.21.15.156:0/2491258107 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3150013470 con 0x7f316006a770 2023-09-30T22:20:30.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.934+0000 7f315cff9700 1 -- 172.21.15.156:0/2491258107 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f315003f6b0 con 0x7f316006a770 2023-09-30T22:20:30.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.938+0000 7f315cff9700 1 -- 172.21.15.156:0/2491258107 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3150013720 con 0x7f316006a770 2023-09-30T22:20:30.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.989+0000 7f25c610e700 1 Processor -- start 2023-09-30T22:20:30.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.989+0000 7f25c610e700 1 -- start start 2023-09-30T22:20:30.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.989+0000 7f25c610e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25c006a770 0x7f25c01349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:30.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.989+0000 7f25c610e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25c0134f00 0x7f25c009d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:30.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.989+0000 7f25c610e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c009eca0 con 0x7f25c009dea0 2023-09-30T22:20:30.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.989+0000 7f25c610e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c006b2e0 con 0x7f25c0134f00 2023-09-30T22:20:30.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.989+0000 7f25c610e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25c009f720 con 0x7f25c006a770 2023-09-30T22:20:30.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.989+0000 7f25beffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25c0134f00 0x7f25c009d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:30.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.990+0000 7f25beffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25c0134f00 0x7f25c009d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49468/0 (socket says 172.21.15.156:49468) 2023-09-30T22:20:30.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.990+0000 7f25beffd700 1 -- 172.21.15.156:0/1206835244 learned_addr learned my addr 172.21.15.156:0/1206835244 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:30.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.990+0000 7f25beffd700 1 -- 172.21.15.156:0/1206835244 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25c006a770 msgr2=0x7f25c01349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:30.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.990+0000 7f25beffd700 1 --2- 172.21.15.156:0/1206835244 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25c006a770 0x7f25c01349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:30.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.990+0000 7f25beffd700 1 -- 172.21.15.156:0/1206835244 >> v1:172.21.15.156:6789/0 conn(0x7f25c009dea0 legacy=0x7f25c013ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:30.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.990+0000 7f25beffd700 1 -- 172.21.15.156:0/1206835244 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c006b480 con 0x7f25c0134f00 2023-09-30T22:20:30.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.990+0000 7f25beffd700 1 --2- 172.21.15.156:0/1206835244 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25c0134f00 0x7f25c009d960 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009920 tx=0x7f25b4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abb11a004182414d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:30.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.990+0000 7f25be7fc700 1 -- 172.21.15.156:0/1206835244 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b400ba60 con 0x7f25c0134f00 2023-09-30T22:20:30.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.990+0000 7f25be7fc700 1 -- 172.21.15.156:0/1206835244 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b400bbc0 con 0x7f25c0134f00 2023-09-30T22:20:30.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.990+0000 7f25be7fc700 1 -- 172.21.15.156:0/1206835244 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4009e70 con 0x7f25c0134f00 2023-09-30T22:20:30.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.991+0000 7f25c610e700 1 -- 172.21.15.156:0/1206835244 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25c0134f00 msgr2=0x7f25c009d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:30.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.991+0000 7f25c610e700 1 --2- 172.21.15.156:0/1206835244 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25c0134f00 0x7f25c009d960 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009920 tx=0x7f25b4009c30 comp rx=0 tx=0).stop 2023-09-30T22:20:30.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.991+0000 7f25c610e700 1 -- 172.21.15.156:0/1206835244 shutdown_connections 2023-09-30T22:20:30.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.991+0000 7f25c610e700 1 --2- 172.21.15.156:0/1206835244 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25c006a770 0x7f25c01349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:30.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.991+0000 7f25c610e700 1 --2- 172.21.15.156:0/1206835244 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25c0134f00 0x7f25c009d960 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:30.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.991+0000 7f25c610e700 1 -- 172.21.15.156:0/1206835244 >> 172.21.15.156:0/1206835244 conn(0x7f25c0099c40 msgr2=0x7f25c00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:30.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.991+0000 7f25c610e700 1 -- 172.21.15.156:0/1206835244 shutdown_connections 2023-09-30T22:20:30.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.991+0000 7f25c610e700 1 -- 172.21.15.156:0/1206835244 wait complete. 2023-09-30T22:20:30.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.992+0000 7f25c610e700 1 Processor -- start 2023-09-30T22:20:30.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.992+0000 7f25c610e700 1 -- start start 2023-09-30T22:20:30.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.992+0000 7f25c610e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25c006a770 0x7f25c011aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:30.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.992+0000 7f25c610e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25c009dea0 0x7f25c011b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:30.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.992+0000 7f25c610e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25c0134f00 0x7f25c011b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:30.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.992+0000 7f25c610e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c0126390 con 0x7f25c009dea0 2023-09-30T22:20:30.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.992+0000 7f25c610e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c0126f20 con 0x7f25c0134f00 2023-09-30T22:20:30.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.992+0000 7f25c610e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25c011be90 con 0x7f25c006a770 2023-09-30T22:20:30.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.993+0000 7f25beffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25c009dea0 0x7f25c011b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:30.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.993+0000 7f25bf7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25c006a770 0x7f25c011aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:30.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.993+0000 7f25beffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25c009dea0 0x7f25c011b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:57268/0 (socket says 172.21.15.156:57268) 2023-09-30T22:20:30.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.993+0000 7f25beffd700 1 -- 172.21.15.156:0/3866473510 learned_addr learned my addr 172.21.15.156:0/3866473510 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:30.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.993+0000 7f25bffff700 1 --2- 172.21.15.156:0/3866473510 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25c0134f00 0x7f25c011b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:30.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.993+0000 7f25beffd700 1 -- 172.21.15.156:0/3866473510 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25c006a770 msgr2=0x7f25c011aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:30.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.993+0000 7f25beffd700 1 --2- 172.21.15.156:0/3866473510 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25c006a770 0x7f25c011aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:30.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.993+0000 7f25beffd700 1 -- 172.21.15.156:0/3866473510 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25c0134f00 msgr2=0x7f25c011b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:30.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.993+0000 7f25beffd700 1 --2- 172.21.15.156:0/3866473510 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25c0134f00 0x7f25c011b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:30.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.993+0000 7f25beffd700 1 -- 172.21.15.156:0/3866473510 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b4009550 con 0x7f25c009dea0 2023-09-30T22:20:30.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.993+0000 7f25bf7fe700 1 --2- 172.21.15.156:0/3866473510 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25c006a770 0x7f25c011aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:30.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.993+0000 7f25beffd700 1 --2- 172.21.15.156:0/3866473510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25c009dea0 0x7f25c011b000 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f25b4000c00 tx=0x7f25b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:30.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.993+0000 7f25a7fff700 1 -- 172.21.15.156:0/3866473510 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4004590 con 0x7f25c009dea0 2023-09-30T22:20:30.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.993+0000 7f25a7fff700 1 -- 172.21.15.156:0/3866473510 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b40036a0 con 0x7f25c009dea0 2023-09-30T22:20:30.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.993+0000 7f25c610e700 1 -- 172.21.15.156:0/3866473510 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c011ca00 con 0x7f25c009dea0 2023-09-30T22:20:30.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.993+0000 7f25a7fff700 1 -- 172.21.15.156:0/3866473510 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4003a50 con 0x7f25c009dea0 2023-09-30T22:20:30.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.994+0000 7f25c610e700 1 -- 172.21.15.156:0/3866473510 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c00a3020 con 0x7f25c009dea0 2023-09-30T22:20:30.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.994+0000 7f25a7fff700 1 -- 172.21.15.156:0/3866473510 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25b4003bb0 con 0x7f25c009dea0 2023-09-30T22:20:30.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.995+0000 7f25c610e700 1 -- 172.21.15.156:0/3866473510 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c011c510 con 0x7f25c009dea0 2023-09-30T22:20:30.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:30.995+0000 7f25a7fff700 1 -- 172.21.15.156:0/3866473510 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f25b4040de0 con 0x7f25c009dea0 2023-09-30T22:20:31.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.004+0000 7f25a7fff700 1 -- 172.21.15.156:0/3866473510 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25b4015080 con 0x7f25c009dea0 2023-09-30T22:20:31.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.027+0000 7f9ef254b700 1 -- 172.21.15.156:0/3153789184 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9eec072480 con 0x7f9eec099e20 2023-09-30T22:20:31.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.027+0000 7f9ee8ff9700 1 -- 172.21.15.156:0/3153789184 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9eec072480 con 0x7f9eec099e20 2023-09-30T22:20:31.027 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:31.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.029+0000 7f9ef254b700 1 -- 172.21.15.156:0/3153789184 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9eec099e20 msgr2=0x7f9eec11bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:31.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.029+0000 7f9ef254b700 1 --2- 172.21.15.156:0/3153789184 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9eec099e20 0x7f9eec11bab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00ebe0 tx=0x7f9edc00eef0 comp rx=0 tx=0).stop 2023-09-30T22:20:31.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.029+0000 7f9ef254b700 1 -- 172.21.15.156:0/3153789184 shutdown_connections 2023-09-30T22:20:31.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.029+0000 7f9ef254b700 1 --2- 172.21.15.156:0/3153789184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9eec130890 0x7f9eec11c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:31.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.029+0000 7f9ef254b700 1 --2- 172.21.15.156:0/3153789184 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9eec099e20 0x7f9eec11bab0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:31.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.029+0000 7f9ef254b700 1 --2- 172.21.15.156:0/3153789184 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9eec09a730 0x7f9eec11bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:31.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.029+0000 7f9ef254b700 1 -- 172.21.15.156:0/3153789184 >> 172.21.15.156:0/3153789184 conn(0x7f9eec0a2980 msgr2=0x7f9eec09fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:31.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.029+0000 7f9ef254b700 1 -- 172.21.15.156:0/3153789184 shutdown_connections 2023-09-30T22:20:31.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.029+0000 7f9ef254b700 1 -- 172.21.15.156:0/3153789184 wait complete. 2023-09-30T22:20:31.041 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:31.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.087+0000 7f3d1b9ee700 1 -- 172.21.15.156:0/4102818480 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3d14133b70 con 0x7f3d140a0a30 2023-09-30T22:20:31.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.088+0000 7f3d09ffb700 1 -- 172.21.15.156:0/4102818480 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3d10029090 con 0x7f3d140a0a30 2023-09-30T22:20:31.087 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:31.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.090+0000 7f3d1b9ee700 1 -- 172.21.15.156:0/4102818480 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d140a0a30 msgr2=0x7f3d14128ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:31.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.090+0000 7f3d1b9ee700 1 --2- 172.21.15.156:0/4102818480 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d140a0a30 0x7f3d14128ef0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3d1000b520 tx=0x7f3d1000b830 comp rx=0 tx=0).stop 2023-09-30T22:20:31.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.090+0000 7f3d1b9ee700 1 -- 172.21.15.156:0/4102818480 shutdown_connections 2023-09-30T22:20:31.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.090+0000 7f3d1b9ee700 1 --2- 172.21.15.156:0/4102818480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d141304a0 0x7f3d14129970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:31.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.090+0000 7f3d1b9ee700 1 --2- 172.21.15.156:0/4102818480 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d140a0a30 0x7f3d14128ef0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:31.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.090+0000 7f3d1b9ee700 1 --2- 172.21.15.156:0/4102818480 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d140a1340 0x7f3d14129430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:31.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.090+0000 7f3d1b9ee700 1 -- 172.21.15.156:0/4102818480 >> 172.21.15.156:0/4102818480 conn(0x7f3d140a2980 msgr2=0x7f3d1409e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:31.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.090+0000 7f3d1b9ee700 1 -- 172.21.15.156:0/4102818480 shutdown_connections 2023-09-30T22:20:31.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.090+0000 7f3d1b9ee700 1 -- 172.21.15.156:0/4102818480 wait complete. 2023-09-30T22:20:31.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:31.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.150+0000 7f3166605700 1 -- 172.21.15.156:0/2491258107 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3160133b20 con 0x7f316006a770 2023-09-30T22:20:31.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.150+0000 7f315cff9700 1 -- 172.21.15.156:0/2491258107 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3160133b20 con 0x7f316006a770 2023-09-30T22:20:31.150 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:31.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.152+0000 7f3166605700 1 -- 172.21.15.156:0/2491258107 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f316006a770 msgr2=0x7f31601327c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:31.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.152+0000 7f3166605700 1 --2- 172.21.15.156:0/2491258107 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f316006a770 0x7f31601327c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f315000e9b0 tx=0x7f315000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:20:31.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.152+0000 7f3166605700 1 -- 172.21.15.156:0/2491258107 shutdown_connections 2023-09-30T22:20:31.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.152+0000 7f3166605700 1 --2- 172.21.15.156:0/2491258107 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3160131cf0 0x7f3160133240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:31.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.152+0000 7f3166605700 1 --2- 172.21.15.156:0/2491258107 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f316006a770 0x7f31601327c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:31.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.152+0000 7f3166605700 1 --2- 172.21.15.156:0/2491258107 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f316006b080 0x7f3160132d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:31.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.152+0000 7f3166605700 1 -- 172.21.15.156:0/2491258107 >> 172.21.15.156:0/2491258107 conn(0x7f3160099c40 msgr2=0x7f316009b260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:31.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.152+0000 7f3166605700 1 -- 172.21.15.156:0/2491258107 shutdown_connections 2023-09-30T22:20:31.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.152+0000 7f3166605700 1 -- 172.21.15.156:0/2491258107 wait complete. 2023-09-30T22:20:31.164 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:31.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.197+0000 7f25c610e700 1 -- 172.21.15.156:0/3866473510 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f25c004f2a0 con 0x7f25c009dea0 2023-09-30T22:20:31.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.197+0000 7f25a7fff700 1 -- 172.21.15.156:0/3866473510 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25b4010990 con 0x7f25c009dea0 2023-09-30T22:20:31.197 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:31.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.199+0000 7f25c610e700 1 -- 172.21.15.156:0/3866473510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25c009dea0 msgr2=0x7f25c011b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:31.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.199+0000 7f25c610e700 1 --2- 172.21.15.156:0/3866473510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25c009dea0 0x7f25c011b000 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f25b4000c00 tx=0x7f25b4004750 comp rx=0 tx=0).stop 2023-09-30T22:20:31.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.199+0000 7f25c610e700 1 -- 172.21.15.156:0/3866473510 shutdown_connections 2023-09-30T22:20:31.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.199+0000 7f25c610e700 1 --2- 172.21.15.156:0/3866473510 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25c0134f00 0x7f25c011b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:31.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.199+0000 7f25c610e700 1 --2- 172.21.15.156:0/3866473510 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25c006a770 0x7f25c011aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:31.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.199+0000 7f25c610e700 1 --2- 172.21.15.156:0/3866473510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25c009dea0 0x7f25c011b000 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:31.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.199+0000 7f25c610e700 1 -- 172.21.15.156:0/3866473510 >> 172.21.15.156:0/3866473510 conn(0x7f25c0099c40 msgr2=0x7f25c009c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:31.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.200+0000 7f25c610e700 1 -- 172.21.15.156:0/3866473510 shutdown_connections 2023-09-30T22:20:31.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:31.200+0000 7f25c610e700 1 -- 172.21.15.156:0/3866473510 wait complete. 2023-09-30T22:20:31.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:32.043 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:32.103 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:32.165 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:32.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.186+0000 7f542ee22700 1 Processor -- start 2023-09-30T22:20:32.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.186+0000 7f542ee22700 1 -- start start 2023-09-30T22:20:32.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.187+0000 7f542ee22700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54280a1510 0x7f54281351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:32.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.187+0000 7f542ee22700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54281356e0 0x7f5428137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:32.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.187+0000 7f542ee22700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54280a1e70 con 0x7f54280a0a30 2023-09-30T22:20:32.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.187+0000 7f542ee22700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542809a720 con 0x7f54281356e0 2023-09-30T22:20:32.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.187+0000 7f542ee22700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f542809b300 con 0x7f54280a1510 2023-09-30T22:20:32.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.187+0000 7f5427fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54280a1510 0x7f54281351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:32.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.187+0000 7f5427fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54280a1510 0x7f54281351a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54634/0 (socket says 172.21.15.156:54634) 2023-09-30T22:20:32.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.187+0000 7f5427fff700 1 -- 172.21.15.156:0/816255042 learned_addr learned my addr 172.21.15.156:0/816255042 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:32.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.188+0000 7f542d3bf700 1 --2- 172.21.15.156:0/816255042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54281356e0 0x7f5428137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:32.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.188+0000 7f54277fe700 1 -- 172.21.15.156:0/816255042 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2577101136 0 0) 0x7f54280a1e70 con 0x7f54280a0a30 2023-09-30T22:20:32.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.188+0000 7f54277fe700 1 -- 172.21.15.156:0/816255042 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54180035b0 con 0x7f54280a0a30 2023-09-30T22:20:32.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.188+0000 7f5427fff700 1 -- 172.21.15.156:0/816255042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54281356e0 msgr2=0x7f5428137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:32.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.188+0000 7f5427fff700 1 --2- 172.21.15.156:0/816255042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54281356e0 0x7f5428137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.188+0000 7f5427fff700 1 -- 172.21.15.156:0/816255042 >> v1:172.21.15.156:6789/0 conn(0x7f54280a0a30 legacy=0x7f54280a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:32.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.188+0000 7f5427fff700 1 -- 172.21.15.156:0/816255042 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542809abc0 con 0x7f54280a1510 2023-09-30T22:20:32.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.188+0000 7f5427fff700 1 --2- 172.21.15.156:0/816255042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54280a1510 0x7f54281351a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5414009920 tx=0x7f5414009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb472e238f328fc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:32.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.188+0000 7f54277fe700 1 -- 172.21.15.156:0/816255042 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541400f8a0 con 0x7f54280a1510 2023-09-30T22:20:32.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.188+0000 7f54277fe700 1 -- 172.21.15.156:0/816255042 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541400fa00 con 0x7f54280a1510 2023-09-30T22:20:32.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.188+0000 7f54277fe700 1 -- 172.21.15.156:0/816255042 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541400fd90 con 0x7f54280a1510 2023-09-30T22:20:32.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.189+0000 7f542ee22700 1 -- 172.21.15.156:0/816255042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54280a1510 msgr2=0x7f54281351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:32.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.189+0000 7f542ee22700 1 --2- 172.21.15.156:0/816255042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54280a1510 0x7f54281351a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5414009920 tx=0x7f5414009c30 comp rx=0 tx=0).stop 2023-09-30T22:20:32.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.189+0000 7f542ee22700 1 -- 172.21.15.156:0/816255042 shutdown_connections 2023-09-30T22:20:32.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.189+0000 7f542ee22700 1 --2- 172.21.15.156:0/816255042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54281356e0 0x7f5428137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.189+0000 7f542ee22700 1 --2- 172.21.15.156:0/816255042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54280a1510 0x7f54281351a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.189+0000 7f542ee22700 1 -- 172.21.15.156:0/816255042 >> 172.21.15.156:0/816255042 conn(0x7f54280a2980 msgr2=0x7f54280a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:32.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.189+0000 7f542ee22700 1 -- 172.21.15.156:0/816255042 shutdown_connections 2023-09-30T22:20:32.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.189+0000 7f542ee22700 1 -- 172.21.15.156:0/816255042 wait complete. 2023-09-30T22:20:32.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.190+0000 7f542ee22700 1 Processor -- start 2023-09-30T22:20:32.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.191+0000 7f542ee22700 1 -- start start 2023-09-30T22:20:32.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.191+0000 7f542ee22700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54280a0a30 0x7f542811d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:32.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.191+0000 7f542ee22700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54280a1510 0x7f542811d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:32.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.191+0000 7f542ee22700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54281356e0 0x7f542811dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:32.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.191+0000 7f542ee22700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5428120370 con 0x7f54280a1510 2023-09-30T22:20:32.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.191+0000 7f542ee22700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542812e580 con 0x7f54281356e0 2023-09-30T22:20:32.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.191+0000 7f542ee22700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f542811fc30 con 0x7f54280a0a30 2023-09-30T22:20:32.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.191+0000 7f5427fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54280a1510 0x7f542811d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:32.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.192+0000 7f5427fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54280a1510 0x7f542811d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48950/0 (socket says 172.21.15.156:48950) 2023-09-30T22:20:32.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.192+0000 7f5427fff700 1 -- 172.21.15.156:0/3108863027 learned_addr learned my addr 172.21.15.156:0/3108863027 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:32.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.192+0000 7f542cbbe700 1 --2- 172.21.15.156:0/3108863027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54280a0a30 0x7f542811d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:32.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.192+0000 7f542d3bf700 1 --2- 172.21.15.156:0/3108863027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54281356e0 0x7f542811dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:32.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.192+0000 7f542d3bf700 1 -- 172.21.15.156:0/3108863027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54280a0a30 msgr2=0x7f542811d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:32.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.192+0000 7f542d3bf700 1 --2- 172.21.15.156:0/3108863027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54280a0a30 0x7f542811d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.192+0000 7f542d3bf700 1 -- 172.21.15.156:0/3108863027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54280a1510 msgr2=0x7f542811d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:32.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.192+0000 7f542d3bf700 1 --2- 172.21.15.156:0/3108863027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54280a1510 0x7f542811d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.192+0000 7f542d3bf700 1 -- 172.21.15.156:0/3108863027 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5414009550 con 0x7f54281356e0 2023-09-30T22:20:32.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.192+0000 7f542cbbe700 1 --2- 172.21.15.156:0/3108863027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54280a0a30 0x7f542811d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:32.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.192+0000 7f5427fff700 1 --2- 172.21.15.156:0/3108863027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54280a1510 0x7f542811d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:32.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.192+0000 7f542d3bf700 1 --2- 172.21.15.156:0/3108863027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54281356e0 0x7f542811dc80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5420009dc0 tx=0x7f542000e4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:32.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.192+0000 7f54257fa700 1 -- 172.21.15.156:0/3108863027 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5420009c60 con 0x7f54281356e0 2023-09-30T22:20:32.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.192+0000 7f54257fa700 1 -- 172.21.15.156:0/3108863027 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542000edb0 con 0x7f54281356e0 2023-09-30T22:20:32.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.192+0000 7f542ee22700 1 -- 172.21.15.156:0/3108863027 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f542809fd60 con 0x7f54281356e0 2023-09-30T22:20:32.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.192+0000 7f54257fa700 1 -- 172.21.15.156:0/3108863027 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54200136a0 con 0x7f54281356e0 2023-09-30T22:20:32.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.192+0000 7f542ee22700 1 -- 172.21.15.156:0/3108863027 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542811e5f0 con 0x7f54281356e0 2023-09-30T22:20:32.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.193+0000 7f54257fa700 1 -- 172.21.15.156:0/3108863027 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5420013800 con 0x7f54281356e0 2023-09-30T22:20:32.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.193+0000 7f54257fa700 1 -- 172.21.15.156:0/3108863027 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f54200405b0 con 0x7f54281356e0 2023-09-30T22:20:32.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.194+0000 7f542ee22700 1 -- 172.21.15.156:0/3108863027 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5428099a60 con 0x7f54281356e0 2023-09-30T22:20:32.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.199+0000 7f54257fa700 1 -- 172.21.15.156:0/3108863027 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5420014410 con 0x7f54281356e0 2023-09-30T22:20:32.212 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:32.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.261+0000 7f125871a700 1 Processor -- start 2023-09-30T22:20:32.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.261+0000 7f125871a700 1 -- start start 2023-09-30T22:20:32.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.262+0000 7f125871a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12500a1570 0x7f1250138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:32.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.262+0000 7f125871a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f12501393c0 0x7f125013b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:32.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.262+0000 7f125871a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12500a1fe0 con 0x7f12500a0a90 2023-09-30T22:20:32.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.262+0000 7f125871a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12500a3aa0 con 0x7f12501393c0 2023-09-30T22:20:32.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.262+0000 7f125871a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125009a540 con 0x7f12500a1570 2023-09-30T22:20:32.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.263+0000 7f1256cb7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f12501393c0 0x7f125013b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:32.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.263+0000 7f1256cb7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f12501393c0 0x7f125013b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48960/0 (socket says 172.21.15.156:48960) 2023-09-30T22:20:32.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.263+0000 7f1256cb7700 1 -- 172.21.15.156:0/1371357662 learned_addr learned my addr 172.21.15.156:0/1371357662 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:32.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.263+0000 7f1255cb5700 1 --2- 172.21.15.156:0/1371357662 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12500a1570 0x7f1250138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:32.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.263+0000 7f1256cb7700 1 -- 172.21.15.156:0/1371357662 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12500a1570 msgr2=0x7f1250138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:32.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.263+0000 7f1256cb7700 1 --2- 172.21.15.156:0/1371357662 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12500a1570 0x7f1250138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.263+0000 7f1256cb7700 1 -- 172.21.15.156:0/1371357662 >> v1:172.21.15.156:6789/0 conn(0x7f12500a0a90 legacy=0x7f12500a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:32.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.263+0000 7f1256cb7700 1 -- 172.21.15.156:0/1371357662 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125009a280 con 0x7f12501393c0 2023-09-30T22:20:32.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.263+0000 7f1256cb7700 1 --2- 172.21.15.156:0/1371357662 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12501393c0 0x7f125013b7a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f12480098f0 tx=0x7f1248009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28993c612631c3fb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:32.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.263+0000 7f12554b4700 1 -- 172.21.15.156:0/1371357662 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1248011830 con 0x7f12501393c0 2023-09-30T22:20:32.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.263+0000 7f12554b4700 1 -- 172.21.15.156:0/1371357662 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1248011990 con 0x7f12501393c0 2023-09-30T22:20:32.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.263+0000 7f12554b4700 1 -- 172.21.15.156:0/1371357662 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1248011d20 con 0x7f12501393c0 2023-09-30T22:20:32.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.264+0000 7f125871a700 1 -- 172.21.15.156:0/1371357662 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12501393c0 msgr2=0x7f125013b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:32.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.264+0000 7f125871a700 1 --2- 172.21.15.156:0/1371357662 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12501393c0 0x7f125013b7a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f12480098f0 tx=0x7f1248009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:32.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.265+0000 7f125871a700 1 -- 172.21.15.156:0/1371357662 shutdown_connections 2023-09-30T22:20:32.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.265+0000 7f125871a700 1 --2- 172.21.15.156:0/1371357662 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12501393c0 0x7f125013b7a0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.265+0000 7f125871a700 1 --2- 172.21.15.156:0/1371357662 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12500a1570 0x7f1250138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.265+0000 7f125871a700 1 -- 172.21.15.156:0/1371357662 >> 172.21.15.156:0/1371357662 conn(0x7f1250099c40 msgr2=0x7f125006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:32.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.265+0000 7f125871a700 1 -- 172.21.15.156:0/1371357662 shutdown_connections 2023-09-30T22:20:32.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.265+0000 7f125871a700 1 -- 172.21.15.156:0/1371357662 wait complete. 2023-09-30T22:20:32.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.266+0000 7f125871a700 1 Processor -- start 2023-09-30T22:20:32.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.266+0000 7f125871a700 1 -- start start 2023-09-30T22:20:32.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.267+0000 7f125871a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12500a0a90 0x7f1250122ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:32.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.267+0000 7f125871a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12500a1570 0x7f12501230e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:32.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.267+0000 7f125871a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12501393c0 0x7f1250123620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:32.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.267+0000 7f125871a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1250126170 con 0x7f12501393c0 2023-09-30T22:20:32.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.267+0000 7f125871a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1250126350 con 0x7f12500a1570 2023-09-30T22:20:32.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.267+0000 7f125871a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12500a55b0 con 0x7f12500a0a90 2023-09-30T22:20:32.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.267+0000 7f1256cb7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12501393c0 0x7f1250123620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:32.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.267+0000 7f1256cb7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12501393c0 0x7f1250123620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48976/0 (socket says 172.21.15.156:48976) 2023-09-30T22:20:32.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.267+0000 7f1256cb7700 1 -- 172.21.15.156:0/562878799 learned_addr learned my addr 172.21.15.156:0/562878799 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:32.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.267+0000 7f12564b6700 1 --2- 172.21.15.156:0/562878799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12500a0a90 0x7f1250122ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:32.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.267+0000 7f1255cb5700 1 --2- 172.21.15.156:0/562878799 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12500a1570 0x7f12501230e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:32.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.267+0000 7f1256cb7700 1 -- 172.21.15.156:0/562878799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12500a0a90 msgr2=0x7f1250122ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:32.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.267+0000 7f1256cb7700 1 --2- 172.21.15.156:0/562878799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12500a0a90 0x7f1250122ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.267+0000 7f1256cb7700 1 -- 172.21.15.156:0/562878799 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12500a1570 msgr2=0x7f12501230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:32.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.267+0000 7f1256cb7700 1 --2- 172.21.15.156:0/562878799 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12500a1570 0x7f12501230e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.267+0000 7f1256cb7700 1 -- 172.21.15.156:0/562878799 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1248009550 con 0x7f12501393c0 2023-09-30T22:20:32.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.267+0000 7f1256cb7700 1 --2- 172.21.15.156:0/562878799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12501393c0 0x7f1250123620 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f12500a1ee0 tx=0x7f1248004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:32.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.267+0000 7f1246ffd700 1 -- 172.21.15.156:0/562878799 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1248004590 con 0x7f12501393c0 2023-09-30T22:20:32.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.268+0000 7f1246ffd700 1 -- 172.21.15.156:0/562878799 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12480036a0 con 0x7f12501393c0 2023-09-30T22:20:32.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.268+0000 7f125871a700 1 -- 172.21.15.156:0/562878799 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f125009b130 con 0x7f12501393c0 2023-09-30T22:20:32.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.268+0000 7f1246ffd700 1 -- 172.21.15.156:0/562878799 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1248003a50 con 0x7f12501393c0 2023-09-30T22:20:32.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.268+0000 7f125871a700 1 -- 172.21.15.156:0/562878799 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1250124880 con 0x7f12501393c0 2023-09-30T22:20:32.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.269+0000 7f1246ffd700 1 -- 172.21.15.156:0/562878799 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1248021070 con 0x7f12501393c0 2023-09-30T22:20:32.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.269+0000 7f125871a700 1 -- 172.21.15.156:0/562878799 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12500746f0 con 0x7f12501393c0 2023-09-30T22:20:32.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.269+0000 7f1246ffd700 1 -- 172.21.15.156:0/562878799 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1248040c40 con 0x7f12501393c0 2023-09-30T22:20:32.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.274+0000 7f1246ffd700 1 -- 172.21.15.156:0/562878799 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f124800b7a0 con 0x7f12501393c0 2023-09-30T22:20:32.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.309+0000 7f152d5af700 1 Processor -- start 2023-09-30T22:20:32.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.309+0000 7f152d5af700 1 -- start start 2023-09-30T22:20:32.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.310+0000 7f152d5af700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1528138040 0x7f1528138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:32.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.310+0000 7f152d5af700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15280a1400 0x7f152813fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:32.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.310+0000 7f152d5af700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15281379e0 con 0x7f15280a08e0 2023-09-30T22:20:32.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.310+0000 7f152d5af700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15280a2100 con 0x7f1528138040 2023-09-30T22:20:32.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.310+0000 7f152d5af700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1528138950 con 0x7f15280a1400 2023-09-30T22:20:32.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.310+0000 7f1526ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1528138040 0x7f1528138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:32.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.310+0000 7f1526ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1528138040 0x7f1528138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48980/0 (socket says 172.21.15.156:48980) 2023-09-30T22:20:32.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.310+0000 7f1526ffd700 1 -- 172.21.15.156:0/897110087 learned_addr learned my addr 172.21.15.156:0/897110087 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:32.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.310+0000 7f15277fe700 1 --2- 172.21.15.156:0/897110087 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15280a1400 0x7f152813fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:32.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.310+0000 7f1526ffd700 1 -- 172.21.15.156:0/897110087 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15280a1400 msgr2=0x7f152813fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:32.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.310+0000 7f1526ffd700 1 --2- 172.21.15.156:0/897110087 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15280a1400 0x7f152813fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.310+0000 7f1526ffd700 1 -- 172.21.15.156:0/897110087 >> v1:172.21.15.156:6789/0 conn(0x7f15280a08e0 legacy=0x7f15280a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:32.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.310+0000 7f1526ffd700 1 -- 172.21.15.156:0/897110087 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152809b9b0 con 0x7f1528138040 2023-09-30T22:20:32.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.310+0000 7f1526ffd700 1 --2- 172.21.15.156:0/897110087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1528138040 0x7f1528138410 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f15180098f0 tx=0x7f1518009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e3e5047a13d9c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:32.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.311+0000 7f1525ffb700 1 -- 172.21.15.156:0/897110087 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1518005e30 con 0x7f1528138040 2023-09-30T22:20:32.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.311+0000 7f1525ffb700 1 -- 172.21.15.156:0/897110087 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1518004030 con 0x7f1528138040 2023-09-30T22:20:32.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.311+0000 7f1525ffb700 1 -- 172.21.15.156:0/897110087 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15180043e0 con 0x7f1528138040 2023-09-30T22:20:32.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.312+0000 7f152d5af700 1 -- 172.21.15.156:0/897110087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1528138040 msgr2=0x7f1528138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:32.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.312+0000 7f152d5af700 1 --2- 172.21.15.156:0/897110087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1528138040 0x7f1528138410 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f15180098f0 tx=0x7f1518009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:32.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.312+0000 7f152d5af700 1 -- 172.21.15.156:0/897110087 shutdown_connections 2023-09-30T22:20:32.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.312+0000 7f152d5af700 1 --2- 172.21.15.156:0/897110087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1528138040 0x7f1528138410 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.312+0000 7f152d5af700 1 --2- 172.21.15.156:0/897110087 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15280a1400 0x7f152813fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.312+0000 7f152d5af700 1 -- 172.21.15.156:0/897110087 >> 172.21.15.156:0/897110087 conn(0x7f15280a2980 msgr2=0x7f15280a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:32.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.312+0000 7f152d5af700 1 -- 172.21.15.156:0/897110087 shutdown_connections 2023-09-30T22:20:32.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.312+0000 7f152d5af700 1 -- 172.21.15.156:0/897110087 wait complete. 2023-09-30T22:20:32.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.313+0000 7f152d5af700 1 Processor -- start 2023-09-30T22:20:32.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.313+0000 7f152d5af700 1 -- start start 2023-09-30T22:20:32.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.314+0000 7f152d5af700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15280a08e0 0x7f1528137330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:32.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.314+0000 7f152d5af700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15280a1400 0x7f1528135b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:32.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.314+0000 7f152d5af700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1528138040 0x7f1528136070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:32.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.314+0000 7f152d5af700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152809c890 con 0x7f1528138040 2023-09-30T22:20:32.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.314+0000 7f152d5af700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1528137870 con 0x7f15280a1400 2023-09-30T22:20:32.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.314+0000 7f152d5af700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1528130200 con 0x7f15280a08e0 2023-09-30T22:20:32.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.314+0000 7f15267fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15280a1400 0x7f1528135b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:32.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.314+0000 7f1526ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15280a08e0 0x7f1528137330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:32.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.314+0000 7f15267fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15280a1400 0x7f1528135b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59502/0 (socket says 172.21.15.156:59502) 2023-09-30T22:20:32.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.314+0000 7f15267fc700 1 -- 172.21.15.156:0/1714588227 learned_addr learned my addr 172.21.15.156:0/1714588227 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:32.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.314+0000 7f15277fe700 1 --2- 172.21.15.156:0/1714588227 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1528138040 0x7f1528136070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:32.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.314+0000 7f1526ffd700 1 -- 172.21.15.156:0/1714588227 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15280a1400 msgr2=0x7f1528135b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:32.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.314+0000 7f1526ffd700 1 --2- 172.21.15.156:0/1714588227 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15280a1400 0x7f1528135b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.314+0000 7f1526ffd700 1 -- 172.21.15.156:0/1714588227 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1528138040 msgr2=0x7f1528136070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:32.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.314+0000 7f1526ffd700 1 --2- 172.21.15.156:0/1714588227 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1528138040 0x7f1528136070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.315+0000 7f1526ffd700 1 -- 172.21.15.156:0/1714588227 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1518009500 con 0x7f15280a08e0 2023-09-30T22:20:32.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.315+0000 7f1526ffd700 1 --2- 172.21.15.156:0/1714588227 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15280a08e0 0x7f1528137330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f15180098f0 tx=0x7f1518004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:32.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.315+0000 7f150f7fe700 1 -- 172.21.15.156:0/1714588227 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15180045e0 con 0x7f15280a08e0 2023-09-30T22:20:32.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.315+0000 7f150f7fe700 1 -- 172.21.15.156:0/1714588227 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1518003ce0 con 0x7f15280a08e0 2023-09-30T22:20:32.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.315+0000 7f152d5af700 1 -- 172.21.15.156:0/1714588227 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f152813f440 con 0x7f15280a08e0 2023-09-30T22:20:32.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.315+0000 7f150f7fe700 1 -- 172.21.15.156:0/1714588227 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1518011680 con 0x7f15280a08e0 2023-09-30T22:20:32.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.315+0000 7f152d5af700 1 -- 172.21.15.156:0/1714588227 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1528119480 con 0x7f15280a08e0 2023-09-30T22:20:32.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.316+0000 7f150f7fe700 1 -- 172.21.15.156:0/1714588227 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1518018070 con 0x7f15280a08e0 2023-09-30T22:20:32.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.316+0000 7f150f7fe700 1 -- 172.21.15.156:0/1714588227 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f151803fbd0 con 0x7f15280a08e0 2023-09-30T22:20:32.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.316+0000 7f152d5af700 1 -- 172.21.15.156:0/1714588227 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1528119480 con 0x7f15280a08e0 2023-09-30T22:20:32.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.321+0000 7f150f7fe700 1 -- 172.21.15.156:0/1714588227 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1528119480 con 0x7f15280a08e0 2023-09-30T22:20:32.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.389+0000 7f33f4b04700 1 Processor -- start 2023-09-30T22:20:32.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.389+0000 7f33f4b04700 1 -- start start 2023-09-30T22:20:32.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.390+0000 7f33f4b04700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f00a0a70 0x7f33f00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:32.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.390+0000 7f33f4b04700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f33f0134120 0x7f33f013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:32.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.390+0000 7f33f4b04700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f009dc00 con 0x7f33f00a1380 2023-09-30T22:20:32.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.390+0000 7f33f4b04700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f009ea60 con 0x7f33f0134120 2023-09-30T22:20:32.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.390+0000 7f33f4b04700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33f009dec0 con 0x7f33f00a0a70 2023-09-30T22:20:32.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.390+0000 7f33eed9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f33f0134120 0x7f33f013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:32.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.390+0000 7f33eed9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f33f0134120 0x7f33f013bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49002/0 (socket says 172.21.15.156:49002) 2023-09-30T22:20:32.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.390+0000 7f33eed9d700 1 -- 172.21.15.156:0/2406098614 learned_addr learned my addr 172.21.15.156:0/2406098614 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:32.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.390+0000 7f33ee59c700 1 --2- 172.21.15.156:0/2406098614 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f00a0a70 0x7f33f00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:32.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.390+0000 7f33eed9d700 1 -- 172.21.15.156:0/2406098614 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f00a0a70 msgr2=0x7f33f00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:32.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.390+0000 7f33eed9d700 1 --2- 172.21.15.156:0/2406098614 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f00a0a70 0x7f33f00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.390+0000 7f33eed9d700 1 -- 172.21.15.156:0/2406098614 >> v1:172.21.15.156:6789/0 conn(0x7f33f00a1380 legacy=0x7f33f0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:32.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.390+0000 7f33eed9d700 1 -- 172.21.15.156:0/2406098614 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f009e6a0 con 0x7f33f0134120 2023-09-30T22:20:32.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.390+0000 7f33ee59c700 1 --2- 172.21.15.156:0/2406098614 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f00a0a70 0x7f33f00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:32.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.391+0000 7f33eed9d700 1 --2- 172.21.15.156:0/2406098614 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33f0134120 0x7f33f013bce0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f33e8009e50 tx=0x7f33e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f87c900c11bb987d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:32.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.391+0000 7f33ed59a700 1 -- 172.21.15.156:0/2406098614 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e800e070 con 0x7f33f0134120 2023-09-30T22:20:32.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.391+0000 7f33ed59a700 1 -- 172.21.15.156:0/2406098614 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e800b910 con 0x7f33f0134120 2023-09-30T22:20:32.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.391+0000 7f33ed59a700 1 -- 172.21.15.156:0/2406098614 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e800bcc0 con 0x7f33f0134120 2023-09-30T22:20:32.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.392+0000 7f33f4b04700 1 -- 172.21.15.156:0/2406098614 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33f0134120 msgr2=0x7f33f013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:32.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.392+0000 7f33f4b04700 1 --2- 172.21.15.156:0/2406098614 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33f0134120 0x7f33f013bce0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f33e8009e50 tx=0x7f33e800b330 comp rx=0 tx=0).stop 2023-09-30T22:20:32.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.392+0000 7f33f4b04700 1 -- 172.21.15.156:0/2406098614 shutdown_connections 2023-09-30T22:20:32.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.392+0000 7f33f4b04700 1 --2- 172.21.15.156:0/2406098614 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33f0134120 0x7f33f013bce0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.392+0000 7f33f4b04700 1 --2- 172.21.15.156:0/2406098614 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f00a0a70 0x7f33f00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.392+0000 7f33f4b04700 1 -- 172.21.15.156:0/2406098614 >> 172.21.15.156:0/2406098614 conn(0x7f33f00a6610 msgr2=0x7f33f00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:32.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.392+0000 7f33f4b04700 1 -- 172.21.15.156:0/2406098614 shutdown_connections 2023-09-30T22:20:32.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.392+0000 7f33f4b04700 1 -- 172.21.15.156:0/2406098614 wait complete. 2023-09-30T22:20:32.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.394+0000 7f33f4b04700 1 Processor -- start 2023-09-30T22:20:32.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.394+0000 7f33f4b04700 1 -- start start 2023-09-30T22:20:32.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.394+0000 7f33f4b04700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33f00a0a70 0x7f33f0122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:32.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.394+0000 7f33f4b04700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f00a1380 0x7f33f0122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:32.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.394+0000 7f33f4b04700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33f0134120 0x7f33f01232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:32.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.394+0000 7f33f4b04700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f0133ad0 con 0x7f33f0134120 2023-09-30T22:20:32.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.394+0000 7f33f4b04700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f0125de0 con 0x7f33f00a0a70 2023-09-30T22:20:32.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.394+0000 7f33f4b04700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33f0124510 con 0x7f33f00a1380 2023-09-30T22:20:32.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.394+0000 7f33ee59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33f00a0a70 0x7f33f0122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:32.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.394+0000 7f33ee59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33f00a0a70 0x7f33f0122860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59518/0 (socket says 172.21.15.156:59518) 2023-09-30T22:20:32.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.394+0000 7f33ee59c700 1 -- 172.21.15.156:0/2564862000 learned_addr learned my addr 172.21.15.156:0/2564862000 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:32.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.394+0000 7f33edd9b700 1 --2- 172.21.15.156:0/2564862000 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f00a1380 0x7f33f0122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:32.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.395+0000 7f33eed9d700 1 --2- 172.21.15.156:0/2564862000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33f0134120 0x7f33f01232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:32.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.395+0000 7f33ee59c700 1 -- 172.21.15.156:0/2564862000 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f00a1380 msgr2=0x7f33f0122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:32.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.395+0000 7f33ee59c700 1 --2- 172.21.15.156:0/2564862000 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f00a1380 0x7f33f0122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.395+0000 7f33ee59c700 1 -- 172.21.15.156:0/2564862000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33f0134120 msgr2=0x7f33f01232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:32.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.395+0000 7f33ee59c700 1 --2- 172.21.15.156:0/2564862000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33f0134120 0x7f33f01232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.395+0000 7f33ee59c700 1 -- 172.21.15.156:0/2564862000 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e00094a0 con 0x7f33f00a0a70 2023-09-30T22:20:32.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.395+0000 7f33ee59c700 1 --2- 172.21.15.156:0/2564862000 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33f00a0a70 0x7f33f0122860 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f33e000ec10 tx=0x7f33e000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:32.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.395+0000 7f33deffd700 1 -- 172.21.15.156:0/2564862000 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e000c850 con 0x7f33f00a0a70 2023-09-30T22:20:32.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.395+0000 7f33deffd700 1 -- 172.21.15.156:0/2564862000 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e000c9b0 con 0x7f33f00a0a70 2023-09-30T22:20:32.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.395+0000 7f33deffd700 1 -- 172.21.15.156:0/2564862000 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e000cd20 con 0x7f33f00a0a70 2023-09-30T22:20:32.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.395+0000 7f33f4b04700 1 -- 172.21.15.156:0/2564862000 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e8009b30 con 0x7f33f00a0a70 2023-09-30T22:20:32.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.395+0000 7f33f4b04700 1 -- 172.21.15.156:0/2564862000 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f0133380 con 0x7f33f00a0a70 2023-09-30T22:20:32.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.397+0000 7f33deffd700 1 -- 172.21.15.156:0/2564862000 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f33e0013470 con 0x7f33f00a0a70 2023-09-30T22:20:32.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.397+0000 7f33f4b04700 1 -- 172.21.15.156:0/2564862000 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f004f2a0 con 0x7f33f00a0a70 2023-09-30T22:20:32.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.397+0000 7f33deffd700 1 -- 172.21.15.156:0/2564862000 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f33e003f8b0 con 0x7f33f00a0a70 2023-09-30T22:20:32.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.401+0000 7f33deffd700 1 -- 172.21.15.156:0/2564862000 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f33e0013720 con 0x7f33f00a0a70 2023-09-30T22:20:32.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.421+0000 7f542ee22700 1 -- 172.21.15.156:0/3108863027 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f542804f2a0 con 0x7f54281356e0 2023-09-30T22:20:32.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.421+0000 7f54257fa700 1 -- 172.21.15.156:0/3108863027 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5420018020 con 0x7f54281356e0 2023-09-30T22:20:32.421 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:32.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.423+0000 7f542ee22700 1 -- 172.21.15.156:0/3108863027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54281356e0 msgr2=0x7f542811dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:32.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.424+0000 7f542ee22700 1 --2- 172.21.15.156:0/3108863027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54281356e0 0x7f542811dc80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5420009dc0 tx=0x7f542000e4c0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.424+0000 7f542ee22700 1 -- 172.21.15.156:0/3108863027 shutdown_connections 2023-09-30T22:20:32.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.424+0000 7f542ee22700 1 --2- 172.21.15.156:0/3108863027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54281356e0 0x7f542811dc80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.424+0000 7f542ee22700 1 --2- 172.21.15.156:0/3108863027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54280a0a30 0x7f542811d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.424+0000 7f542ee22700 1 --2- 172.21.15.156:0/3108863027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54280a1510 0x7f542811d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.424+0000 7f542ee22700 1 -- 172.21.15.156:0/3108863027 >> 172.21.15.156:0/3108863027 conn(0x7f54280a2980 msgr2=0x7f54281306a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:32.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.425+0000 7f542ee22700 1 -- 172.21.15.156:0/3108863027 shutdown_connections 2023-09-30T22:20:32.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.426+0000 7f542ee22700 1 -- 172.21.15.156:0/3108863027 wait complete. 2023-09-30T22:20:32.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:32.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.524+0000 7f125871a700 1 -- 172.21.15.156:0/562878799 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f125004f2a0 con 0x7f12501393c0 2023-09-30T22:20:32.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.524+0000 7f1246ffd700 1 -- 172.21.15.156:0/562878799 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1248029070 con 0x7f12501393c0 2023-09-30T22:20:32.524 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:32.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.526+0000 7f125871a700 1 -- 172.21.15.156:0/562878799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12501393c0 msgr2=0x7f1250123620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:32.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.526+0000 7f125871a700 1 --2- 172.21.15.156:0/562878799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12501393c0 0x7f1250123620 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f12500a1ee0 tx=0x7f1248004750 comp rx=0 tx=0).stop 2023-09-30T22:20:32.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.526+0000 7f125871a700 1 -- 172.21.15.156:0/562878799 shutdown_connections 2023-09-30T22:20:32.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.526+0000 7f125871a700 1 --2- 172.21.15.156:0/562878799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12501393c0 0x7f1250123620 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.526+0000 7f125871a700 1 --2- 172.21.15.156:0/562878799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12500a0a90 0x7f1250122ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.526+0000 7f125871a700 1 --2- 172.21.15.156:0/562878799 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12500a1570 0x7f12501230e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.526+0000 7f125871a700 1 -- 172.21.15.156:0/562878799 >> 172.21.15.156:0/562878799 conn(0x7f1250099c40 msgr2=0x7f12500a57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:32.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.526+0000 7f125871a700 1 -- 172.21.15.156:0/562878799 shutdown_connections 2023-09-30T22:20:32.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.526+0000 7f125871a700 1 -- 172.21.15.156:0/562878799 wait complete. 2023-09-30T22:20:32.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.530+0000 7f152d5af700 1 -- 172.21.15.156:0/1714588227 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1528119480 con 0x7f15280a08e0 2023-09-30T22:20:32.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.530+0000 7f150f7fe700 1 -- 172.21.15.156:0/1714588227 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1528119480 con 0x7f15280a08e0 2023-09-30T22:20:32.530 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:32.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.532+0000 7f152d5af700 1 -- 172.21.15.156:0/1714588227 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15280a08e0 msgr2=0x7f1528137330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:32.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.532+0000 7f152d5af700 1 --2- 172.21.15.156:0/1714588227 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15280a08e0 0x7f1528137330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f15180098f0 tx=0x7f1518004750 comp rx=0 tx=0).stop 2023-09-30T22:20:32.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.532+0000 7f152d5af700 1 -- 172.21.15.156:0/1714588227 shutdown_connections 2023-09-30T22:20:32.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.532+0000 7f152d5af700 1 --2- 172.21.15.156:0/1714588227 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1528138040 0x7f1528136070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.532+0000 7f152d5af700 1 --2- 172.21.15.156:0/1714588227 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15280a08e0 0x7f1528137330 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.532+0000 7f152d5af700 1 --2- 172.21.15.156:0/1714588227 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15280a1400 0x7f1528135b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.532+0000 7f152d5af700 1 -- 172.21.15.156:0/1714588227 >> 172.21.15.156:0/1714588227 conn(0x7f15280a2980 msgr2=0x7f15280a2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:32.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.532+0000 7f152d5af700 1 -- 172.21.15.156:0/1714588227 shutdown_connections 2023-09-30T22:20:32.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.532+0000 7f152d5af700 1 -- 172.21.15.156:0/1714588227 wait complete. 2023-09-30T22:20:32.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:32.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:32.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.595+0000 7f33f4b04700 1 -- 172.21.15.156:0/2564862000 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f33f01263e0 con 0x7f33f00a0a70 2023-09-30T22:20:32.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.596+0000 7f33deffd700 1 -- 172.21.15.156:0/2564862000 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f33e0021020 con 0x7f33f00a0a70 2023-09-30T22:20:32.595 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:32.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.598+0000 7f33f4b04700 1 -- 172.21.15.156:0/2564862000 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33f00a0a70 msgr2=0x7f33f0122860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:32.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.598+0000 7f33f4b04700 1 --2- 172.21.15.156:0/2564862000 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33f00a0a70 0x7f33f0122860 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f33e000ec10 tx=0x7f33e000ef20 comp rx=0 tx=0).stop 2023-09-30T22:20:32.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.598+0000 7f33f4b04700 1 -- 172.21.15.156:0/2564862000 shutdown_connections 2023-09-30T22:20:32.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.598+0000 7f33f4b04700 1 --2- 172.21.15.156:0/2564862000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33f0134120 0x7f33f01232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.598+0000 7f33f4b04700 1 --2- 172.21.15.156:0/2564862000 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33f00a0a70 0x7f33f0122860 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.598+0000 7f33f4b04700 1 --2- 172.21.15.156:0/2564862000 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f00a1380 0x7f33f0122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:32.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.598+0000 7f33f4b04700 1 -- 172.21.15.156:0/2564862000 >> 172.21.15.156:0/2564862000 conn(0x7f33f00a6610 msgr2=0x7f33f00a4980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:32.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.598+0000 7f33f4b04700 1 -- 172.21.15.156:0/2564862000 shutdown_connections 2023-09-30T22:20:32.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:32.598+0000 7f33f4b04700 1 -- 172.21.15.156:0/2564862000 wait complete. 2023-09-30T22:20:32.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:33.440 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:33.540 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:33.545 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:33.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.572+0000 7f06cd9d8700 1 Processor -- start 2023-09-30T22:20:33.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.572+0000 7f06cd9d8700 1 -- start start 2023-09-30T22:20:33.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.572+0000 7f06cd9d8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06c806a770 0x7f06c806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:33.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.572+0000 7f06cd9d8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06c8136cb0 0x7f06c8139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:33.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.572+0000 7f06cd9d8700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c806e900 con 0x7f06c809dec0 2023-09-30T22:20:33.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.572+0000 7f06cd9d8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c809d180 con 0x7f06c806a770 2023-09-30T22:20:33.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.572+0000 7f06cd9d8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06c809e780 con 0x7f06c8136cb0 2023-09-30T22:20:33.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.573+0000 7f06c6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06c806a770 0x7f06c806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:33.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.573+0000 7f06c77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06c8136cb0 0x7f06c8139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:33.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.573+0000 7f06c6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06c806a770 0x7f06c806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59526/0 (socket says 172.21.15.156:59526) 2023-09-30T22:20:33.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.573+0000 7f06c77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06c8136cb0 0x7f06c8139090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54690/0 (socket says 172.21.15.156:54690) 2023-09-30T22:20:33.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.573+0000 7f06c6ffd700 1 -- 172.21.15.156:0/2017218642 learned_addr learned my addr 172.21.15.156:0/2017218642 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:33.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.573+0000 7f06c67fc700 1 --1- 172.21.15.156:0/2017218642 >> v1:172.21.15.156:6789/0 conn(0x7f06c809dec0 0x7f06c806b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:60614/0 (socket says 172.21.15.156:60614) 2023-09-30T22:20:33.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.573+0000 7f06c6ffd700 1 -- 172.21.15.156:0/2017218642 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06c8136cb0 msgr2=0x7f06c8139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:33.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.573+0000 7f06c6ffd700 1 --2- 172.21.15.156:0/2017218642 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06c8136cb0 0x7f06c8139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.573+0000 7f06c6ffd700 1 -- 172.21.15.156:0/2017218642 >> v1:172.21.15.156:6789/0 conn(0x7f06c809dec0 legacy=0x7f06c806b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:33.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.573+0000 7f06c6ffd700 1 -- 172.21.15.156:0/2017218642 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c809d3c0 con 0x7f06c806a770 2023-09-30T22:20:33.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.573+0000 7f06c77fe700 1 --2- 172.21.15.156:0/2017218642 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06c8136cb0 0x7f06c8139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:33.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.573+0000 7f06c6ffd700 1 --2- 172.21.15.156:0/2017218642 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06c806a770 0x7f06c806ab40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f06b8009920 tx=0x7f06b8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f52ae125cfb3139 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:33.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.573+0000 7f06c5ffb700 1 -- 172.21.15.156:0/2017218642 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b8011830 con 0x7f06c806a770 2023-09-30T22:20:33.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.573+0000 7f06c5ffb700 1 -- 172.21.15.156:0/2017218642 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b8011990 con 0x7f06c806a770 2023-09-30T22:20:33.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.573+0000 7f06c5ffb700 1 -- 172.21.15.156:0/2017218642 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b8011d20 con 0x7f06c806a770 2023-09-30T22:20:33.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.574+0000 7f06cd9d8700 1 -- 172.21.15.156:0/2017218642 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06c806a770 msgr2=0x7f06c806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:33.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.574+0000 7f06cd9d8700 1 --2- 172.21.15.156:0/2017218642 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06c806a770 0x7f06c806ab40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f06b8009920 tx=0x7f06b8009c30 comp rx=0 tx=0).stop 2023-09-30T22:20:33.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.574+0000 7f06cd9d8700 1 -- 172.21.15.156:0/2017218642 shutdown_connections 2023-09-30T22:20:33.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.574+0000 7f06cd9d8700 1 --2- 172.21.15.156:0/2017218642 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06c806a770 0x7f06c806ab40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.574+0000 7f06cd9d8700 1 --2- 172.21.15.156:0/2017218642 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06c8136cb0 0x7f06c8139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.574+0000 7f06cd9d8700 1 -- 172.21.15.156:0/2017218642 >> 172.21.15.156:0/2017218642 conn(0x7f06c8099c40 msgr2=0x7f06c80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:33.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.574+0000 7f06cd9d8700 1 -- 172.21.15.156:0/2017218642 shutdown_connections 2023-09-30T22:20:33.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.574+0000 7f06cd9d8700 1 -- 172.21.15.156:0/2017218642 wait complete. 2023-09-30T22:20:33.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.575+0000 7f06cd9d8700 1 Processor -- start 2023-09-30T22:20:33.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.575+0000 7f06cd9d8700 1 -- start start 2023-09-30T22:20:33.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.576+0000 7f06cd9d8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06c806a770 0x7f06c809a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:33.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.576+0000 7f06cd9d8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06c809dec0 0x7f06c809a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:33.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.576+0000 7f06cd9d8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06c8136cb0 0x7f06c809af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:33.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.576+0000 7f06cd9d8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c8135800 con 0x7f06c8136cb0 2023-09-30T22:20:33.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.576+0000 7f06cd9d8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c8134130 con 0x7f06c809dec0 2023-09-30T22:20:33.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.576+0000 7f06cd9d8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06c812ed60 con 0x7f06c806a770 2023-09-30T22:20:33.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.576+0000 7f06c6ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06c806a770 0x7f06c809a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:33.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.576+0000 7f06c6ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06c806a770 0x7f06c809a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54692/0 (socket says 172.21.15.156:54692) 2023-09-30T22:20:33.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.576+0000 7f06c6ffd700 1 -- 172.21.15.156:0/1319798018 learned_addr learned my addr 172.21.15.156:0/1319798018 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:33.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.576+0000 7f06c77fe700 1 --2- 172.21.15.156:0/1319798018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06c8136cb0 0x7f06c809af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:33.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.576+0000 7f06c67fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06c809dec0 0x7f06c809a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:33.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.576+0000 7f06c6ffd700 1 -- 172.21.15.156:0/1319798018 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06c809dec0 msgr2=0x7f06c809a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:33.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.576+0000 7f06c6ffd700 1 --2- 172.21.15.156:0/1319798018 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06c809dec0 0x7f06c809a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.576+0000 7f06c6ffd700 1 -- 172.21.15.156:0/1319798018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06c8136cb0 msgr2=0x7f06c809af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:33.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.576+0000 7f06c6ffd700 1 --2- 172.21.15.156:0/1319798018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06c8136cb0 0x7f06c809af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.576+0000 7f06c6ffd700 1 -- 172.21.15.156:0/1319798018 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c0009a70 con 0x7f06c806a770 2023-09-30T22:20:33.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.576+0000 7f06c67fc700 1 --2- 172.21.15.156:0/1319798018 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06c809dec0 0x7f06c809a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:33.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.576+0000 7f06c6ffd700 1 --2- 172.21.15.156:0/1319798018 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06c806a770 0x7f06c809a490 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f06b80098f0 tx=0x7f06b8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:33.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.577+0000 7f06affff700 1 -- 172.21.15.156:0/1319798018 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b8004450 con 0x7f06c806a770 2023-09-30T22:20:33.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.577+0000 7f06affff700 1 -- 172.21.15.156:0/1319798018 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b80045b0 con 0x7f06c806a770 2023-09-30T22:20:33.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.577+0000 7f06affff700 1 -- 172.21.15.156:0/1319798018 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b80038c0 con 0x7f06c806a770 2023-09-30T22:20:33.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.577+0000 7f06cd9d8700 1 -- 172.21.15.156:0/1319798018 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b8009550 con 0x7f06c806a770 2023-09-30T22:20:33.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.577+0000 7f06cd9d8700 1 -- 172.21.15.156:0/1319798018 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c8071ce0 con 0x7f06c806a770 2023-09-30T22:20:33.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.577+0000 7f06affff700 1 -- 172.21.15.156:0/1319798018 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f06b8003a20 con 0x7f06c806a770 2023-09-30T22:20:33.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.578+0000 7f06affff700 1 -- 172.21.15.156:0/1319798018 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f06b8021030 con 0x7f06c806a770 2023-09-30T22:20:33.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.578+0000 7f06cd9d8700 1 -- 172.21.15.156:0/1319798018 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c804f2a0 con 0x7f06c806a770 2023-09-30T22:20:33.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.583+0000 7f06affff700 1 -- 172.21.15.156:0/1319798018 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f06b801a430 con 0x7f06c806a770 2023-09-30T22:20:33.611 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:33.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.683+0000 7f0c5cd92700 1 Processor -- start 2023-09-30T22:20:33.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.683+0000 7f0c5cd92700 1 -- start start 2023-09-30T22:20:33.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.684+0000 7f0c5cd92700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0c58133ad0 0x7f0c58133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:33.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.684+0000 7f0c5cd92700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c581300a0 0x7f0c581304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:33.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.684+0000 7f0c5cd92700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c5806b2d0 con 0x7f0c581309f0 2023-09-30T22:20:33.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.684+0000 7f0c5cd92700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c58133610 con 0x7f0c58133ad0 2023-09-30T22:20:33.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.684+0000 7f0c5cd92700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5809a500 con 0x7f0c581300a0 2023-09-30T22:20:33.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.684+0000 7f0c5659c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0c58133ad0 0x7f0c58133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:33.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.684+0000 7f0c5659c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0c58133ad0 0x7f0c58133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49038/0 (socket says 172.21.15.156:49038) 2023-09-30T22:20:33.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.684+0000 7f0c5659c700 1 -- 172.21.15.156:0/4239803759 learned_addr learned my addr 172.21.15.156:0/4239803759 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:33.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.684+0000 7f0c55d9b700 1 --2- 172.21.15.156:0/4239803759 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c581300a0 0x7f0c581304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:33.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.684+0000 7f0c5659c700 1 -- 172.21.15.156:0/4239803759 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c581300a0 msgr2=0x7f0c581304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:33.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.684+0000 7f0c5659c700 1 --2- 172.21.15.156:0/4239803759 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c581300a0 0x7f0c581304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.684+0000 7f0c5659c700 1 -- 172.21.15.156:0/4239803759 >> v1:172.21.15.156:6789/0 conn(0x7f0c581309f0 legacy=0x7f0c5813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:33.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.684+0000 7f0c5659c700 1 -- 172.21.15.156:0/4239803759 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c581338b0 con 0x7f0c58133ad0 2023-09-30T22:20:33.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.684+0000 7f0c5559a700 1 -- 172.21.15.156:0/4239803759 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2390493179 0 0) 0x7f0c5806b2d0 con 0x7f0c581309f0 2023-09-30T22:20:33.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.685+0000 7f0c5659c700 1 --2- 172.21.15.156:0/4239803759 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c58133ad0 0x7f0c58133ea0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0c480098f0 tx=0x7f0c48009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16015eb30fdb50f7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:33.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.685+0000 7f0c5559a700 1 -- 172.21.15.156:0/4239803759 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c48011830 con 0x7f0c58133ad0 2023-09-30T22:20:33.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.685+0000 7f0c5559a700 1 -- 172.21.15.156:0/4239803759 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c48011990 con 0x7f0c58133ad0 2023-09-30T22:20:33.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.685+0000 7f0c5559a700 1 -- 172.21.15.156:0/4239803759 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c48011d20 con 0x7f0c58133ad0 2023-09-30T22:20:33.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.685+0000 7f0c5cd92700 1 -- 172.21.15.156:0/4239803759 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c58133ad0 msgr2=0x7f0c58133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:33.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.685+0000 7f0c5cd92700 1 --2- 172.21.15.156:0/4239803759 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c58133ad0 0x7f0c58133ea0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0c480098f0 tx=0x7f0c48009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:33.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.686+0000 7f0c5cd92700 1 -- 172.21.15.156:0/4239803759 shutdown_connections 2023-09-30T22:20:33.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.686+0000 7f0c5cd92700 1 --2- 172.21.15.156:0/4239803759 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c58133ad0 0x7f0c58133ea0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.686+0000 7f0c5cd92700 1 --2- 172.21.15.156:0/4239803759 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c581300a0 0x7f0c581304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.686+0000 7f0c5cd92700 1 -- 172.21.15.156:0/4239803759 >> 172.21.15.156:0/4239803759 conn(0x7f0c58099c40 msgr2=0x7f0c580a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:33.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.686+0000 7f0c5cd92700 1 -- 172.21.15.156:0/4239803759 shutdown_connections 2023-09-30T22:20:33.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.686+0000 7f0c5cd92700 1 -- 172.21.15.156:0/4239803759 wait complete. 2023-09-30T22:20:33.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.687+0000 7f0c5cd92700 1 Processor -- start 2023-09-30T22:20:33.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.687+0000 7f0c5cd92700 1 -- start start 2023-09-30T22:20:33.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.688+0000 7f0c5cd92700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c581300a0 0x7f0c5811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:33.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.688+0000 7f0c5cd92700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c581309f0 0x7f0c5811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:33.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.688+0000 7f0c5cd92700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c58133ad0 0x7f0c5811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:33.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.688+0000 7f0c5cd92700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5811f9d0 con 0x7f0c58133ad0 2023-09-30T22:20:33.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.688+0000 7f0c5cd92700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c580a3390 con 0x7f0c581300a0 2023-09-30T22:20:33.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.688+0000 7f0c5cd92700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5812dd00 con 0x7f0c581309f0 2023-09-30T22:20:33.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.688+0000 7f0c56d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c58133ad0 0x7f0c5811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:33.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.688+0000 7f0c5659c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c581300a0 0x7f0c5811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:33.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.688+0000 7f0c56d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c58133ad0 0x7f0c5811e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49046/0 (socket says 172.21.15.156:49046) 2023-09-30T22:20:33.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.688+0000 7f0c56d9d700 1 -- 172.21.15.156:0/2353839749 learned_addr learned my addr 172.21.15.156:0/2353839749 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:33.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.688+0000 7f0c5659c700 1 --2- 172.21.15.156:0/2353839749 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c581300a0 0x7f0c5811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59550/0 (socket says 172.21.15.156:59550) 2023-09-30T22:20:33.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.688+0000 7f0c56d9d700 1 -- 172.21.15.156:0/2353839749 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c581309f0 msgr2=0x7f0c5811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:33.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.688+0000 7f0c56d9d700 1 --2- 172.21.15.156:0/2353839749 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c581309f0 0x7f0c5811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.688+0000 7f0c56d9d700 1 -- 172.21.15.156:0/2353839749 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c581300a0 msgr2=0x7f0c5811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:33.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.688+0000 7f0c56d9d700 1 --2- 172.21.15.156:0/2353839749 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c581300a0 0x7f0c5811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.688+0000 7f0c56d9d700 1 -- 172.21.15.156:0/2353839749 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c48009550 con 0x7f0c58133ad0 2023-09-30T22:20:33.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.689+0000 7f0c56d9d700 1 --2- 172.21.15.156:0/2353839749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c58133ad0 0x7f0c5811e4c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0c50001560 tx=0x7f0c5000cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:33.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.689+0000 7f0c46ffd700 1 -- 172.21.15.156:0/2353839749 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c50003e30 con 0x7f0c58133ad0 2023-09-30T22:20:33.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.689+0000 7f0c46ffd700 1 -- 172.21.15.156:0/2353839749 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c50005070 con 0x7f0c58133ad0 2023-09-30T22:20:33.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.689+0000 7f0c5cd92700 1 -- 172.21.15.156:0/2353839749 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c58120000 con 0x7f0c58133ad0 2023-09-30T22:20:33.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.689+0000 7f0c46ffd700 1 -- 172.21.15.156:0/2353839749 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c50005420 con 0x7f0c58133ad0 2023-09-30T22:20:33.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.689+0000 7f0c5cd92700 1 -- 172.21.15.156:0/2353839749 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c58071650 con 0x7f0c58133ad0 2023-09-30T22:20:33.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.690+0000 7f0c46ffd700 1 -- 172.21.15.156:0/2353839749 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c50005580 con 0x7f0c58133ad0 2023-09-30T22:20:33.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.690+0000 7f0c46ffd700 1 -- 172.21.15.156:0/2353839749 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0c5003eef0 con 0x7f0c58133ad0 2023-09-30T22:20:33.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.690+0000 7f0c5cd92700 1 -- 172.21.15.156:0/2353839749 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c580a2620 con 0x7f0c58133ad0 2023-09-30T22:20:33.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.699+0000 7f0c46ffd700 1 -- 172.21.15.156:0/2353839749 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c50017070 con 0x7f0c58133ad0 2023-09-30T22:20:33.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.703+0000 7f3febc91700 1 Processor -- start 2023-09-30T22:20:33.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.704+0000 7f3febc91700 1 -- start start 2023-09-30T22:20:33.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.704+0000 7f3febc91700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3fe40a0a30 0x7f3fe40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:33.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.704+0000 7f3febc91700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fe40a1340 0x7f3fe412ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:33.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.704+0000 7f3febc91700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fe41304a0 0x7f3fe41308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:33.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.704+0000 7f3febc91700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe4130e30 con 0x7f3fe40a0a30 2023-09-30T22:20:33.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.704+0000 7f3febc91700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40a1e70 con 0x7f3fe40a1340 2023-09-30T22:20:33.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.704+0000 7f3febc91700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe409a720 con 0x7f3fe41304a0 2023-09-30T22:20:33.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.704+0000 7f3fe9a2d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3fe40a0a30 0x7f3fe40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:33.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.704+0000 7f3fe9a2d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3fe40a0a30 0x7f3fe40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49052/0 (socket says 172.21.15.156:49052) 2023-09-30T22:20:33.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.704+0000 7f3fe9a2d700 1 -- 172.21.15.156:0/4101524486 learned_addr learned my addr 172.21.15.156:0/4101524486 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:33.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.704+0000 7f3fe922c700 1 --2- 172.21.15.156:0/4101524486 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fe40a1340 0x7f3fe412ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:33.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.704+0000 7f3fea22e700 1 --2- 172.21.15.156:0/4101524486 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fe41304a0 0x7f3fe41308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:33.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.705+0000 7f3fe922c700 1 -- 172.21.15.156:0/4101524486 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fe41304a0 msgr2=0x7f3fe41308f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:33.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.705+0000 7f3fe922c700 1 --2- 172.21.15.156:0/4101524486 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fe41304a0 0x7f3fe41308f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.705+0000 7f3fe922c700 1 -- 172.21.15.156:0/4101524486 >> v2:172.21.15.156:3300/0 conn(0x7f3fe40a0a30 msgr2=0x7f3fe40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:33.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.705+0000 7f3fe922c700 1 --2- 172.21.15.156:0/4101524486 >> v2:172.21.15.156:3300/0 conn(0x7f3fe40a0a30 0x7f3fe40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.705+0000 7f3fe922c700 1 -- 172.21.15.156:0/4101524486 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe409b300 con 0x7f3fe40a1340 2023-09-30T22:20:33.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.705+0000 7f3fea22e700 1 --2- 172.21.15.156:0/4101524486 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fe41304a0 0x7f3fe41308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:33.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.705+0000 7f3fe9a2d700 1 --2- 172.21.15.156:0/4101524486 >> v2:172.21.15.156:3300/0 conn(0x7f3fe40a0a30 0x7f3fe40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:33.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.705+0000 7f3fe922c700 1 --2- 172.21.15.156:0/4101524486 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fe40a1340 0x7f3fe412ff60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4009870 tx=0x7f3fd4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da114e25e40409b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:33.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.705+0000 7f3fe8a2b700 1 -- 172.21.15.156:0/4101524486 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd4011830 con 0x7f3fe40a1340 2023-09-30T22:20:33.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.705+0000 7f3fe8a2b700 1 -- 172.21.15.156:0/4101524486 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd4011990 con 0x7f3fe40a1340 2023-09-30T22:20:33.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.705+0000 7f3fe8a2b700 1 -- 172.21.15.156:0/4101524486 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd4011d20 con 0x7f3fe40a1340 2023-09-30T22:20:33.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.706+0000 7f3febc91700 1 -- 172.21.15.156:0/4101524486 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fe40a1340 msgr2=0x7f3fe412ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:33.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.706+0000 7f3febc91700 1 --2- 172.21.15.156:0/4101524486 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fe40a1340 0x7f3fe412ff60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4009870 tx=0x7f3fd4009b80 comp rx=0 tx=0).stop 2023-09-30T22:20:33.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.706+0000 7f3febc91700 1 -- 172.21.15.156:0/4101524486 shutdown_connections 2023-09-30T22:20:33.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.706+0000 7f3febc91700 1 --2- 172.21.15.156:0/4101524486 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fe41304a0 0x7f3fe41308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.706+0000 7f3febc91700 1 --2- 172.21.15.156:0/4101524486 >> v2:172.21.15.156:3300/0 conn(0x7f3fe40a0a30 0x7f3fe40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.706+0000 7f3febc91700 1 --2- 172.21.15.156:0/4101524486 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fe40a1340 0x7f3fe412ff60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.706+0000 7f3febc91700 1 -- 172.21.15.156:0/4101524486 >> 172.21.15.156:0/4101524486 conn(0x7f3fe40a2980 msgr2=0x7f3fe40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:33.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.706+0000 7f3febc91700 1 -- 172.21.15.156:0/4101524486 shutdown_connections 2023-09-30T22:20:33.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.706+0000 7f3febc91700 1 -- 172.21.15.156:0/4101524486 wait complete. 2023-09-30T22:20:33.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.708+0000 7f3febc91700 1 Processor -- start 2023-09-30T22:20:33.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.708+0000 7f3febc91700 1 -- start start 2023-09-30T22:20:33.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.708+0000 7f3febc91700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fe40a0a30 0x7f3fe411fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:33.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.708+0000 7f3febc91700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fe40a1340 0x7f3fe41200a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:33.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.708+0000 7f3febc91700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fe41304a0 0x7f3fe41c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:33.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.708+0000 7f3febc91700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe409ae70 con 0x7f3fe40a0a30 2023-09-30T22:20:33.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.708+0000 7f3febc91700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe4121600 con 0x7f3fe40a1340 2023-09-30T22:20:33.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.708+0000 7f3febc91700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe4121350 con 0x7f3fe41304a0 2023-09-30T22:20:33.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.708+0000 7f3fea22e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fe41304a0 0x7f3fe41c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:33.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.709+0000 7f3fea22e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fe41304a0 0x7f3fe41c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54722/0 (socket says 172.21.15.156:54722) 2023-09-30T22:20:33.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.709+0000 7f3fea22e700 1 -- 172.21.15.156:0/3152574906 learned_addr learned my addr 172.21.15.156:0/3152574906 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:33.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.709+0000 7f3fe922c700 1 --2- 172.21.15.156:0/3152574906 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fe40a1340 0x7f3fe41200a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:33.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.709+0000 7f3fe9a2d700 1 --2- 172.21.15.156:0/3152574906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fe40a0a30 0x7f3fe411fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:33.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.709+0000 7f3fea22e700 1 -- 172.21.15.156:0/3152574906 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fe40a1340 msgr2=0x7f3fe41200a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:33.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.709+0000 7f3fea22e700 1 --2- 172.21.15.156:0/3152574906 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fe40a1340 0x7f3fe41200a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.709+0000 7f3fea22e700 1 -- 172.21.15.156:0/3152574906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fe40a0a30 msgr2=0x7f3fe411fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:33.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.709+0000 7f3fea22e700 1 --2- 172.21.15.156:0/3152574906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fe40a0a30 0x7f3fe411fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.709+0000 7f3fea22e700 1 -- 172.21.15.156:0/3152574906 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe000b7a0 con 0x7f3fe41304a0 2023-09-30T22:20:33.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.709+0000 7f3fea22e700 1 --2- 172.21.15.156:0/3152574906 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fe41304a0 0x7f3fe41c8190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00efc0 tx=0x7f3fdc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:33.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.709+0000 7f3fda7fc700 1 -- 172.21.15.156:0/3152574906 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc00cb40 con 0x7f3fe41304a0 2023-09-30T22:20:33.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.709+0000 7f3fda7fc700 1 -- 172.21.15.156:0/3152574906 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc00f040 con 0x7f3fe41304a0 2023-09-30T22:20:33.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.709+0000 7f3febc91700 1 -- 172.21.15.156:0/3152574906 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fdc009a70 con 0x7f3fe41304a0 2023-09-30T22:20:33.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.709+0000 7f3fda7fc700 1 -- 172.21.15.156:0/3152574906 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc003a20 con 0x7f3fe41304a0 2023-09-30T22:20:33.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.709+0000 7f3febc91700 1 -- 172.21.15.156:0/3152574906 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd40094a0 con 0x7f3fe41304a0 2023-09-30T22:20:33.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.710+0000 7f3fda7fc700 1 -- 172.21.15.156:0/3152574906 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3fdc014480 con 0x7f3fe41304a0 2023-09-30T22:20:33.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.710+0000 7f3fda7fc700 1 -- 172.21.15.156:0/3152574906 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3fdc040010 con 0x7f3fe41304a0 2023-09-30T22:20:33.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.711+0000 7f3febc91700 1 -- 172.21.15.156:0/3152574906 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe404f2a0 con 0x7f3fe41304a0 2023-09-30T22:20:33.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.718+0000 7f3fda7fc700 1 -- 172.21.15.156:0/3152574906 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3fdc012930 con 0x7f3fe41304a0 2023-09-30T22:20:33.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.765+0000 7f88c8beb700 1 Processor -- start 2023-09-30T22:20:33.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.765+0000 7f88c8beb700 1 -- start start 2023-09-30T22:20:33.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.766+0000 7f88c8beb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f88c409d860 0x7f88c409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:33.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.766+0000 7f88c8beb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88c4130eb0 0x7f88c4138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:33.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.766+0000 7f88c8beb700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c409aaa0 con 0x7f88c409e170 2023-09-30T22:20:33.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.766+0000 7f88c8beb700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c409f870 con 0x7f88c409d860 2023-09-30T22:20:33.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.766+0000 7f88c8beb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c409b360 con 0x7f88c4130eb0 2023-09-30T22:20:33.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.766+0000 7f88c259c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f88c409d860 0x7f88c409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:33.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.766+0000 7f88c259c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f88c409d860 0x7f88c409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49072/0 (socket says 172.21.15.156:49072) 2023-09-30T22:20:33.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.766+0000 7f88c2d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88c4130eb0 0x7f88c4138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:33.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.766+0000 7f88c259c700 1 -- 172.21.15.156:0/182714019 learned_addr learned my addr 172.21.15.156:0/182714019 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:33.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.766+0000 7f88c259c700 1 -- 172.21.15.156:0/182714019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88c4130eb0 msgr2=0x7f88c4138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:33.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.766+0000 7f88c259c700 1 --2- 172.21.15.156:0/182714019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88c4130eb0 0x7f88c4138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.766+0000 7f88c259c700 1 -- 172.21.15.156:0/182714019 >> v1:172.21.15.156:6789/0 conn(0x7f88c409e170 legacy=0x7f88c41307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:33.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.766+0000 7f88c259c700 1 -- 172.21.15.156:0/182714019 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c409b620 con 0x7f88c409d860 2023-09-30T22:20:33.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.766+0000 7f88c259c700 1 --2- 172.21.15.156:0/182714019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88c409d860 0x7f88c409dc30 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f88b400b9a0 tx=0x7f88b400bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c568128754e419 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:33.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.767+0000 7f88c159a700 1 -- 172.21.15.156:0/182714019 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b4004230 con 0x7f88c409d860 2023-09-30T22:20:33.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.767+0000 7f88c159a700 1 -- 172.21.15.156:0/182714019 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b4004390 con 0x7f88c409d860 2023-09-30T22:20:33.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.767+0000 7f88c159a700 1 -- 172.21.15.156:0/182714019 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b400c860 con 0x7f88c409d860 2023-09-30T22:20:33.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.767+0000 7f88c8beb700 1 -- 172.21.15.156:0/182714019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88c409d860 msgr2=0x7f88c409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:33.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.767+0000 7f88c8beb700 1 --2- 172.21.15.156:0/182714019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88c409d860 0x7f88c409dc30 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f88b400b9a0 tx=0x7f88b400bcb0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.767+0000 7f88c8beb700 1 -- 172.21.15.156:0/182714019 shutdown_connections 2023-09-30T22:20:33.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.767+0000 7f88c8beb700 1 --2- 172.21.15.156:0/182714019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88c4130eb0 0x7f88c4138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.767+0000 7f88c8beb700 1 --2- 172.21.15.156:0/182714019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88c409d860 0x7f88c409dc30 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.767+0000 7f88c8beb700 1 -- 172.21.15.156:0/182714019 >> 172.21.15.156:0/182714019 conn(0x7f88c4099c40 msgr2=0x7f88c40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:33.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.767+0000 7f88c8beb700 1 -- 172.21.15.156:0/182714019 shutdown_connections 2023-09-30T22:20:33.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.767+0000 7f88c8beb700 1 -- 172.21.15.156:0/182714019 wait complete. 2023-09-30T22:20:33.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.768+0000 7f88c8beb700 1 Processor -- start 2023-09-30T22:20:33.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.769+0000 7f88c8beb700 1 -- start start 2023-09-30T22:20:33.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.769+0000 7f88c8beb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88c409d860 0x7f88c411e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:33.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.769+0000 7f88c8beb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88c409e170 0x7f88c411e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:33.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.769+0000 7f88c8beb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88c4130eb0 0x7f88c411ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:33.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.769+0000 7f88c8beb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c4072110 con 0x7f88c4130eb0 2023-09-30T22:20:33.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.769+0000 7f88c8beb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c41200b0 con 0x7f88c409e170 2023-09-30T22:20:33.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.769+0000 7f88c8beb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88c4120550 con 0x7f88c409d860 2023-09-30T22:20:33.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.769+0000 7f88c1d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88c409e170 0x7f88c411e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:33.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.769+0000 7f88c1d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88c409e170 0x7f88c411e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59576/0 (socket says 172.21.15.156:59576) 2023-09-30T22:20:33.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.769+0000 7f88c1d9b700 1 -- 172.21.15.156:0/1326221301 learned_addr learned my addr 172.21.15.156:0/1326221301 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:33.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.769+0000 7f88c2d9d700 1 --2- 172.21.15.156:0/1326221301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88c4130eb0 0x7f88c411ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:33.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.770+0000 7f88c1d9b700 1 -- 172.21.15.156:0/1326221301 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88c409d860 msgr2=0x7f88c411e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:33.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.770+0000 7f88c1d9b700 1 --2- 172.21.15.156:0/1326221301 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88c409d860 0x7f88c411e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.770+0000 7f88c1d9b700 1 -- 172.21.15.156:0/1326221301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88c4130eb0 msgr2=0x7f88c411ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:33.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.770+0000 7f88c1d9b700 1 --2- 172.21.15.156:0/1326221301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88c4130eb0 0x7f88c411ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.770+0000 7f88c1d9b700 1 -- 172.21.15.156:0/1326221301 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b400b600 con 0x7f88c409e170 2023-09-30T22:20:33.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.770+0000 7f88c1d9b700 1 --2- 172.21.15.156:0/1326221301 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88c409e170 0x7f88c411e8d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f88b800c550 tx=0x7f88b800c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:33.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.770+0000 7f88b2ffd700 1 -- 172.21.15.156:0/1326221301 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8011790 con 0x7f88c409e170 2023-09-30T22:20:33.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.770+0000 7f88b2ffd700 1 -- 172.21.15.156:0/1326221301 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b8011910 con 0x7f88c409e170 2023-09-30T22:20:33.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.770+0000 7f88b2ffd700 1 -- 172.21.15.156:0/1326221301 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8011cc0 con 0x7f88c409e170 2023-09-30T22:20:33.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.770+0000 7f88c8beb700 1 -- 172.21.15.156:0/1326221301 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c409c8b0 con 0x7f88c409e170 2023-09-30T22:20:33.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.770+0000 7f88c8beb700 1 -- 172.21.15.156:0/1326221301 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c4122640 con 0x7f88c409e170 2023-09-30T22:20:33.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.771+0000 7f88b2ffd700 1 -- 172.21.15.156:0/1326221301 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f88b801c460 con 0x7f88c409e170 2023-09-30T22:20:33.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.771+0000 7f88b2ffd700 1 -- 172.21.15.156:0/1326221301 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f88b803f400 con 0x7f88c409e170 2023-09-30T22:20:33.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.771+0000 7f88c8beb700 1 -- 172.21.15.156:0/1326221301 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c404f2a0 con 0x7f88c409e170 2023-09-30T22:20:33.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.780+0000 7f88b2ffd700 1 -- 172.21.15.156:0/1326221301 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f88b80106d0 con 0x7f88c409e170 2023-09-30T22:20:33.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.802+0000 7f06cd9d8700 1 -- 172.21.15.156:0/1319798018 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f06c812f340 con 0x7f06c806a770 2023-09-30T22:20:33.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.803+0000 7f06affff700 1 -- 172.21.15.156:0/1319798018 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f06b802b030 con 0x7f06c806a770 2023-09-30T22:20:33.802 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:33.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.806+0000 7f06cd9d8700 1 -- 172.21.15.156:0/1319798018 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06c806a770 msgr2=0x7f06c809a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:33.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.806+0000 7f06cd9d8700 1 --2- 172.21.15.156:0/1319798018 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06c806a770 0x7f06c809a490 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f06b80098f0 tx=0x7f06b8004750 comp rx=0 tx=0).stop 2023-09-30T22:20:33.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.806+0000 7f06cd9d8700 1 -- 172.21.15.156:0/1319798018 shutdown_connections 2023-09-30T22:20:33.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.806+0000 7f06cd9d8700 1 --2- 172.21.15.156:0/1319798018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06c8136cb0 0x7f06c809af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.806+0000 7f06cd9d8700 1 --2- 172.21.15.156:0/1319798018 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06c806a770 0x7f06c809a490 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.806+0000 7f06cd9d8700 1 --2- 172.21.15.156:0/1319798018 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06c809dec0 0x7f06c809a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.806+0000 7f06cd9d8700 1 -- 172.21.15.156:0/1319798018 >> 172.21.15.156:0/1319798018 conn(0x7f06c8099c40 msgr2=0x7f06c812f890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:33.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.806+0000 7f06cd9d8700 1 -- 172.21.15.156:0/1319798018 shutdown_connections 2023-09-30T22:20:33.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.806+0000 7f06cd9d8700 1 -- 172.21.15.156:0/1319798018 wait complete. 2023-09-30T22:20:33.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:33.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.897+0000 7f0c5cd92700 1 -- 172.21.15.156:0/2353839749 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0c5804f2a0 con 0x7f0c58133ad0 2023-09-30T22:20:33.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.897+0000 7f0c46ffd700 1 -- 172.21.15.156:0/2353839749 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c5001ae40 con 0x7f0c58133ad0 2023-09-30T22:20:33.897 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:33.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.899+0000 7f0c5cd92700 1 -- 172.21.15.156:0/2353839749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c58133ad0 msgr2=0x7f0c5811e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:33.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.899+0000 7f0c5cd92700 1 --2- 172.21.15.156:0/2353839749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c58133ad0 0x7f0c5811e4c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0c50001560 tx=0x7f0c5000cb50 comp rx=0 tx=0).stop 2023-09-30T22:20:33.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.899+0000 7f0c5cd92700 1 -- 172.21.15.156:0/2353839749 shutdown_connections 2023-09-30T22:20:33.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.899+0000 7f0c5cd92700 1 --2- 172.21.15.156:0/2353839749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c58133ad0 0x7f0c5811e4c0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.899+0000 7f0c5cd92700 1 --2- 172.21.15.156:0/2353839749 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c581300a0 0x7f0c5811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.899+0000 7f0c5cd92700 1 --2- 172.21.15.156:0/2353839749 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c581309f0 0x7f0c5811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.899+0000 7f0c5cd92700 1 -- 172.21.15.156:0/2353839749 >> 172.21.15.156:0/2353839749 conn(0x7f0c58099c40 msgr2=0x7f0c58132be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:33.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.899+0000 7f0c5cd92700 1 -- 172.21.15.156:0/2353839749 shutdown_connections 2023-09-30T22:20:33.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.899+0000 7f0c5cd92700 1 -- 172.21.15.156:0/2353839749 wait complete. 2023-09-30T22:20:33.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:33.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.933+0000 7f3febc91700 1 -- 172.21.15.156:0/3152574906 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3fe411f6b0 con 0x7f3fe41304a0 2023-09-30T22:20:33.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.934+0000 7f3fda7fc700 1 -- 172.21.15.156:0/3152574906 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3fdc012340 con 0x7f3fe41304a0 2023-09-30T22:20:33.934 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:33.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.936+0000 7f3febc91700 1 -- 172.21.15.156:0/3152574906 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fe41304a0 msgr2=0x7f3fe41c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:33.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.936+0000 7f3febc91700 1 --2- 172.21.15.156:0/3152574906 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fe41304a0 0x7f3fe41c8190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00efc0 tx=0x7f3fdc00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.936+0000 7f3febc91700 1 -- 172.21.15.156:0/3152574906 shutdown_connections 2023-09-30T22:20:33.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.936+0000 7f3febc91700 1 --2- 172.21.15.156:0/3152574906 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fe41304a0 0x7f3fe41c8190 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.936+0000 7f3febc91700 1 --2- 172.21.15.156:0/3152574906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fe40a0a30 0x7f3fe411fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.936+0000 7f3febc91700 1 --2- 172.21.15.156:0/3152574906 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fe40a1340 0x7f3fe41200a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.936+0000 7f3febc91700 1 -- 172.21.15.156:0/3152574906 >> 172.21.15.156:0/3152574906 conn(0x7f3fe40a2980 msgr2=0x7f3fe409deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:33.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.936+0000 7f3febc91700 1 -- 172.21.15.156:0/3152574906 shutdown_connections 2023-09-30T22:20:33.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.936+0000 7f3febc91700 1 -- 172.21.15.156:0/3152574906 wait complete. 2023-09-30T22:20:33.949 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:33.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.995+0000 7f88c8beb700 1 -- 172.21.15.156:0/1326221301 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f88c406c3b0 con 0x7f88c409e170 2023-09-30T22:20:33.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.995+0000 7f88b2ffd700 1 -- 172.21.15.156:0/1326221301 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f88b801a360 con 0x7f88c409e170 2023-09-30T22:20:33.995 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:33.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.997+0000 7f88c8beb700 1 -- 172.21.15.156:0/1326221301 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88c409e170 msgr2=0x7f88c411e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:33.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.997+0000 7f88c8beb700 1 --2- 172.21.15.156:0/1326221301 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88c409e170 0x7f88c411e8d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f88b800c550 tx=0x7f88b800c860 comp rx=0 tx=0).stop 2023-09-30T22:20:33.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.997+0000 7f88c8beb700 1 -- 172.21.15.156:0/1326221301 shutdown_connections 2023-09-30T22:20:33.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.997+0000 7f88c8beb700 1 --2- 172.21.15.156:0/1326221301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88c4130eb0 0x7f88c411ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.997+0000 7f88c8beb700 1 --2- 172.21.15.156:0/1326221301 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88c409d860 0x7f88c411e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.997+0000 7f88c8beb700 1 --2- 172.21.15.156:0/1326221301 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88c409e170 0x7f88c411e8d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:33.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.997+0000 7f88c8beb700 1 -- 172.21.15.156:0/1326221301 >> 172.21.15.156:0/1326221301 conn(0x7f88c4099c40 msgr2=0x7f88c4070ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:33.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.997+0000 7f88c8beb700 1 -- 172.21.15.156:0/1326221301 shutdown_connections 2023-09-30T22:20:33.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:33.997+0000 7f88c8beb700 1 -- 172.21.15.156:0/1326221301 wait complete. 2023-09-30T22:20:34.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:34.823 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:34.912 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:34.950 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:34.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.960+0000 7fb4f1060700 1 Processor -- start 2023-09-30T22:20:34.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.960+0000 7fb4f1060700 1 -- start start 2023-09-30T22:20:34.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.961+0000 7fb4f1060700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4ec09ad40 0x7fb4ec133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:34.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.961+0000 7fb4f1060700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4ec1343a0 0x7fb4ec0a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:34.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.961+0000 7fb4f1060700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4ec09b110 con 0x7fb4ec133f70 2023-09-30T22:20:34.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.961+0000 7fb4f1060700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec0a3b60 con 0x7fb4ec09ad40 2023-09-30T22:20:34.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.961+0000 7fb4f1060700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec0a2fa0 con 0x7fb4ec1343a0 2023-09-30T22:20:34.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.961+0000 7fb4eb59e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4ec1343a0 0x7fb4ec0a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:34.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.961+0000 7fb4ead9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4ec09ad40 0x7fb4ec133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:34.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.961+0000 7fb4ea59c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb4ec133f70 0x7fb4ec0a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:60646/0 (socket says 172.21.15.156:60646) 2023-09-30T22:20:34.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.961+0000 7fb4ead9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4ec09ad40 0x7fb4ec133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59586/0 (socket says 172.21.15.156:59586) 2023-09-30T22:20:34.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.961+0000 7fb4ea59c700 1 -- 172.21.15.156:0/352214550 learned_addr learned my addr 172.21.15.156:0/352214550 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:34.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.961+0000 7fb4eb59e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4ec1343a0 0x7fb4ec0a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54736/0 (socket says 172.21.15.156:54736) 2023-09-30T22:20:34.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.961+0000 7fb4eb59e700 1 -- 172.21.15.156:0/352214550 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4ec09ad40 msgr2=0x7fb4ec133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:34.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.961+0000 7fb4eb59e700 1 --2- 172.21.15.156:0/352214550 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4ec09ad40 0x7fb4ec133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:34.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.961+0000 7fb4eb59e700 1 -- 172.21.15.156:0/352214550 >> v1:172.21.15.156:6789/0 conn(0x7fb4ec133f70 legacy=0x7fb4ec0a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:34.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.961+0000 7fb4eb59e700 1 -- 172.21.15.156:0/352214550 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ec09a280 con 0x7fb4ec1343a0 2023-09-30T22:20:34.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.961+0000 7fb4e9d9b700 1 -- 172.21.15.156:0/352214550 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1453237400 0 0) 0x7fb4ec09b110 con 0x7fb4ec133f70 2023-09-30T22:20:34.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.961+0000 7fb4eb59e700 1 --2- 172.21.15.156:0/352214550 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4ec1343a0 0x7fb4ec0a1180 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009dc0 tx=0x7fb4e400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cdcc52b10b80966 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:34.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.961+0000 7fb4e9d9b700 1 -- 172.21.15.156:0/352214550 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e400e070 con 0x7fb4ec1343a0 2023-09-30T22:20:34.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.962+0000 7fb4e9d9b700 1 -- 172.21.15.156:0/352214550 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e400bb20 con 0x7fb4ec1343a0 2023-09-30T22:20:34.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.962+0000 7fb4e9d9b700 1 -- 172.21.15.156:0/352214550 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4012430 con 0x7fb4ec1343a0 2023-09-30T22:20:34.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.962+0000 7fb4f1060700 1 -- 172.21.15.156:0/352214550 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4ec1343a0 msgr2=0x7fb4ec0a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:34.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.962+0000 7fb4f1060700 1 --2- 172.21.15.156:0/352214550 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4ec1343a0 0x7fb4ec0a1180 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009dc0 tx=0x7fb4e400b330 comp rx=0 tx=0).stop 2023-09-30T22:20:34.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.962+0000 7fb4f1060700 1 -- 172.21.15.156:0/352214550 shutdown_connections 2023-09-30T22:20:34.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.962+0000 7fb4f1060700 1 --2- 172.21.15.156:0/352214550 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4ec09ad40 0x7fb4ec133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:34.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.962+0000 7fb4f1060700 1 --2- 172.21.15.156:0/352214550 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4ec1343a0 0x7fb4ec0a1180 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:34.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.962+0000 7fb4f1060700 1 -- 172.21.15.156:0/352214550 >> 172.21.15.156:0/352214550 conn(0x7fb4ec099c40 msgr2=0x7fb4ec06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:34.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.962+0000 7fb4f1060700 1 -- 172.21.15.156:0/352214550 shutdown_connections 2023-09-30T22:20:34.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.962+0000 7fb4f1060700 1 -- 172.21.15.156:0/352214550 wait complete. 2023-09-30T22:20:34.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.963+0000 7fb4f1060700 1 Processor -- start 2023-09-30T22:20:34.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.964+0000 7fb4f1060700 1 -- start start 2023-09-30T22:20:34.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.964+0000 7fb4f1060700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4ec09ad40 0x7fb4ec1c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:34.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.964+0000 7fb4f1060700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4ec133f70 0x7fb4ec1c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:34.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.964+0000 7fb4f1060700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4ec1343a0 0x7fb4ec1c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:34.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.964+0000 7fb4f1060700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec1208a0 con 0x7fb4ec133f70 2023-09-30T22:20:34.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.964+0000 7fb4f1060700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec120670 con 0x7fb4ec1343a0 2023-09-30T22:20:34.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.964+0000 7fb4f1060700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec1212e0 con 0x7fb4ec09ad40 2023-09-30T22:20:34.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.964+0000 7fb4ead9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4ec09ad40 0x7fb4ec1c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:34.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.964+0000 7fb4ead9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4ec09ad40 0x7fb4ec1c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54748/0 (socket says 172.21.15.156:54748) 2023-09-30T22:20:34.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.964+0000 7fb4ea59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4ec133f70 0x7fb4ec1c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:34.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.964+0000 7fb4ead9d700 1 -- 172.21.15.156:0/4200594259 learned_addr learned my addr 172.21.15.156:0/4200594259 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:34.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.964+0000 7fb4eb59e700 1 --2- 172.21.15.156:0/4200594259 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4ec1343a0 0x7fb4ec1c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:34.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.964+0000 7fb4ea59c700 1 -- 172.21.15.156:0/4200594259 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4ec09ad40 msgr2=0x7fb4ec1c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:34.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.964+0000 7fb4ea59c700 1 --2- 172.21.15.156:0/4200594259 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4ec09ad40 0x7fb4ec1c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:34.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.964+0000 7fb4ea59c700 1 -- 172.21.15.156:0/4200594259 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4ec1343a0 msgr2=0x7fb4ec1c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:34.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.964+0000 7fb4ea59c700 1 --2- 172.21.15.156:0/4200594259 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4ec1343a0 0x7fb4ec1c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:34.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.965+0000 7fb4ea59c700 1 -- 172.21.15.156:0/4200594259 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e4009a70 con 0x7fb4ec133f70 2023-09-30T22:20:34.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.965+0000 7fb4ead9d700 1 --2- 172.21.15.156:0/4200594259 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4ec09ad40 0x7fb4ec1c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:34.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.965+0000 7fb4ea59c700 1 --2- 172.21.15.156:0/4200594259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4ec133f70 0x7fb4ec1c86d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb4e000c470 tx=0x7fb4e000c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:34.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.965+0000 7fb4d37fe700 1 -- 172.21.15.156:0/4200594259 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e0004c80 con 0x7fb4ec133f70 2023-09-30T22:20:34.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.965+0000 7fb4d37fe700 1 -- 172.21.15.156:0/4200594259 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e0004de0 con 0x7fb4ec133f70 2023-09-30T22:20:34.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.965+0000 7fb4f1060700 1 -- 172.21.15.156:0/4200594259 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4ec121fe0 con 0x7fb4ec133f70 2023-09-30T22:20:34.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.965+0000 7fb4d37fe700 1 -- 172.21.15.156:0/4200594259 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e0007310 con 0x7fb4ec133f70 2023-09-30T22:20:34.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.965+0000 7fb4f1060700 1 -- 172.21.15.156:0/4200594259 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ec1225f0 con 0x7fb4ec133f70 2023-09-30T22:20:34.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.966+0000 7fb4d37fe700 1 -- 172.21.15.156:0/4200594259 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb4e0007470 con 0x7fb4ec133f70 2023-09-30T22:20:34.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.966+0000 7fb4d37fe700 1 -- 172.21.15.156:0/4200594259 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb4e003f2f0 con 0x7fb4ec133f70 2023-09-30T22:20:34.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.966+0000 7fb4f1060700 1 -- 172.21.15.156:0/4200594259 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4ec04f2a0 con 0x7fb4ec133f70 2023-09-30T22:20:34.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:34.971+0000 7fb4d37fe700 1 -- 172.21.15.156:0/4200594259 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4e0007720 con 0x7fb4ec133f70 2023-09-30T22:20:35.009 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:35.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.057+0000 7f24014fc700 1 Processor -- start 2023-09-30T22:20:35.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.057+0000 7f24014fc700 1 -- start start 2023-09-30T22:20:35.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.057+0000 7f24014fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23fc138040 0x7f23fc138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:35.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.057+0000 7f24014fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f23fc0a08e0 0x7f23fc0a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:35.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.057+0000 7f24014fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23fc0a1230 0x7f23fc13ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:35.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.057+0000 7f24014fc700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23fc0a2100 con 0x7f23fc0a08e0 2023-09-30T22:20:35.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.057+0000 7f24014fc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc138950 con 0x7f23fc138040 2023-09-30T22:20:35.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.057+0000 7f24014fc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc1379e0 con 0x7f23fc0a1230 2023-09-30T22:20:35.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.058+0000 7f23fa7fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f23fc0a08e0 0x7f23fc0a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:35.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.058+0000 7f23fa7fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f23fc0a08e0 0x7f23fc0a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49086/0 (socket says 172.21.15.156:49086) 2023-09-30T22:20:35.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.058+0000 7f23fa7fc700 1 -- 172.21.15.156:0/2339914616 learned_addr learned my addr 172.21.15.156:0/2339914616 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:35.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.058+0000 7f23fb7fe700 1 --2- 172.21.15.156:0/2339914616 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23fc0a1230 0x7f23fc13ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:35.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.058+0000 7f23faffd700 1 --2- 172.21.15.156:0/2339914616 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23fc138040 0x7f23fc138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:35.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.058+0000 7f23faffd700 1 -- 172.21.15.156:0/2339914616 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23fc0a1230 msgr2=0x7f23fc13ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:35.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.058+0000 7f23faffd700 1 --2- 172.21.15.156:0/2339914616 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23fc0a1230 0x7f23fc13ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.058+0000 7f23faffd700 1 -- 172.21.15.156:0/2339914616 >> v2:172.21.15.156:3300/0 conn(0x7f23fc0a08e0 msgr2=0x7f23fc0a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:35.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.058+0000 7f23faffd700 1 --2- 172.21.15.156:0/2339914616 >> v2:172.21.15.156:3300/0 conn(0x7f23fc0a08e0 0x7f23fc0a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.058+0000 7f23faffd700 1 -- 172.21.15.156:0/2339914616 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23fc09b9b0 con 0x7f23fc138040 2023-09-30T22:20:35.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.058+0000 7f23fb7fe700 1 --2- 172.21.15.156:0/2339914616 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23fc0a1230 0x7f23fc13ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:35.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.058+0000 7f23fa7fc700 1 --2- 172.21.15.156:0/2339914616 >> v2:172.21.15.156:3300/0 conn(0x7f23fc0a08e0 0x7f23fc0a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:35.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.058+0000 7f23faffd700 1 --2- 172.21.15.156:0/2339914616 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23fc138040 0x7f23fc138410 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f23ec009850 tx=0x7f23ec009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3f3cd73869ee7c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:35.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.058+0000 7f23f9ffb700 1 -- 172.21.15.156:0/2339914616 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec005e30 con 0x7f23fc138040 2023-09-30T22:20:35.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.058+0000 7f23f9ffb700 1 -- 172.21.15.156:0/2339914616 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ec006030 con 0x7f23fc138040 2023-09-30T22:20:35.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.058+0000 7f23f9ffb700 1 -- 172.21.15.156:0/2339914616 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec0063c0 con 0x7f23fc138040 2023-09-30T22:20:35.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.059+0000 7f24014fc700 1 -- 172.21.15.156:0/2339914616 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23fc138040 msgr2=0x7f23fc138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:35.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.059+0000 7f24014fc700 1 --2- 172.21.15.156:0/2339914616 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23fc138040 0x7f23fc138410 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f23ec009850 tx=0x7f23ec009b60 comp rx=0 tx=0).stop 2023-09-30T22:20:35.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.059+0000 7f24014fc700 1 -- 172.21.15.156:0/2339914616 shutdown_connections 2023-09-30T22:20:35.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.059+0000 7f24014fc700 1 --2- 172.21.15.156:0/2339914616 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23fc0a1230 0x7f23fc13ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.059+0000 7f24014fc700 1 --2- 172.21.15.156:0/2339914616 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23fc138040 0x7f23fc138410 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.059+0000 7f24014fc700 1 --2- 172.21.15.156:0/2339914616 >> v2:172.21.15.156:3300/0 conn(0x7f23fc0a08e0 0x7f23fc0a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.059+0000 7f24014fc700 1 -- 172.21.15.156:0/2339914616 >> 172.21.15.156:0/2339914616 conn(0x7f23fc0a2980 msgr2=0x7f23fc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:35.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.059+0000 7f24014fc700 1 -- 172.21.15.156:0/2339914616 shutdown_connections 2023-09-30T22:20:35.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.059+0000 7f24014fc700 1 -- 172.21.15.156:0/2339914616 wait complete. 2023-09-30T22:20:35.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.061+0000 7f24014fc700 1 Processor -- start 2023-09-30T22:20:35.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.061+0000 7f24014fc700 1 -- start start 2023-09-30T22:20:35.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.061+0000 7f24014fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23fc0a08e0 0x7f23fc1266d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:35.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.061+0000 7f24014fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23fc0a1230 0x7f23fc126c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:35.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.061+0000 7f24014fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23fc138040 0x7f23fc127150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:35.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.061+0000 7f24014fc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc12a280 con 0x7f23fc0a1230 2023-09-30T22:20:35.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.061+0000 7f24014fc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc09a240 con 0x7f23fc138040 2023-09-30T22:20:35.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.061+0000 7f24014fc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc1376e0 con 0x7f23fc0a08e0 2023-09-30T22:20:35.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.062+0000 7f23faffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23fc0a08e0 0x7f23fc1266d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:35.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.062+0000 7f23faffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23fc0a08e0 0x7f23fc1266d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54778/0 (socket says 172.21.15.156:54778) 2023-09-30T22:20:35.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.062+0000 7f23faffd700 1 -- 172.21.15.156:0/2184648245 learned_addr learned my addr 172.21.15.156:0/2184648245 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:35.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.062+0000 7f23fa7fc700 1 --2- 172.21.15.156:0/2184648245 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23fc0a1230 0x7f23fc126c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:35.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.062+0000 7f23fb7fe700 1 --2- 172.21.15.156:0/2184648245 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23fc138040 0x7f23fc127150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:35.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.062+0000 7f23faffd700 1 -- 172.21.15.156:0/2184648245 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23fc138040 msgr2=0x7f23fc127150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:35.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.062+0000 7f23faffd700 1 --2- 172.21.15.156:0/2184648245 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23fc138040 0x7f23fc127150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.062+0000 7f23faffd700 1 -- 172.21.15.156:0/2184648245 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23fc0a1230 msgr2=0x7f23fc126c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:35.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.062+0000 7f23faffd700 1 --2- 172.21.15.156:0/2184648245 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23fc0a1230 0x7f23fc126c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.062+0000 7f23faffd700 1 -- 172.21.15.156:0/2184648245 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f0009550 con 0x7f23fc0a08e0 2023-09-30T22:20:35.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.062+0000 7f23faffd700 1 --2- 172.21.15.156:0/2184648245 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23fc0a08e0 0x7f23fc1266d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f23ec000c00 tx=0x7f23ec004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:35.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.062+0000 7f23e37fe700 1 -- 172.21.15.156:0/2184648245 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec004240 con 0x7f23fc0a08e0 2023-09-30T22:20:35.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.062+0000 7f23e37fe700 1 -- 172.21.15.156:0/2184648245 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ec0043a0 con 0x7f23fc0a08e0 2023-09-30T22:20:35.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.062+0000 7f23e37fe700 1 -- 172.21.15.156:0/2184648245 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec006950 con 0x7f23fc0a08e0 2023-09-30T22:20:35.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.062+0000 7f24014fc700 1 -- 172.21.15.156:0/2184648245 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f4009a70 con 0x7f23fc0a08e0 2023-09-30T22:20:35.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.063+0000 7f24014fc700 1 -- 172.21.15.156:0/2184648245 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ec009430 con 0x7f23fc0a08e0 2023-09-30T22:20:35.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.064+0000 7f23e37fe700 1 -- 172.21.15.156:0/2184648245 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f23ec022070 con 0x7f23fc0a08e0 2023-09-30T22:20:35.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.064+0000 7f24014fc700 1 -- 172.21.15.156:0/2184648245 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23fc04f2a0 con 0x7f23fc0a08e0 2023-09-30T22:20:35.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.064+0000 7f23e37fe700 1 -- 172.21.15.156:0/2184648245 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f23ec040e30 con 0x7f23fc0a08e0 2023-09-30T22:20:35.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.068+0000 7f23e37fe700 1 -- 172.21.15.156:0/2184648245 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23ec02f7e0 con 0x7f23fc0a08e0 2023-09-30T22:20:35.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.094+0000 7f67260d2700 1 Processor -- start 2023-09-30T22:20:35.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.094+0000 7f67260d2700 1 -- start start 2023-09-30T22:20:35.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.095+0000 7f67260d2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67201346e0 0x7f6720136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:35.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.095+0000 7f67260d2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6720137000 0x7f67201393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:35.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.095+0000 7f67260d2700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67200a1640 con 0x7f6720131980 2023-09-30T22:20:35.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.095+0000 7f67260d2700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f672006eb30 con 0x7f6720137000 2023-09-30T22:20:35.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.095+0000 7f67260d2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67200a22d0 con 0x7f67201346e0 2023-09-30T22:20:35.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.095+0000 7f671effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67201346e0 0x7f6720136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:35.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.095+0000 7f671effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67201346e0 0x7f6720136ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54780/0 (socket says 172.21.15.156:54780) 2023-09-30T22:20:35.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.095+0000 7f671effd700 1 -- 172.21.15.156:0/1189189843 learned_addr learned my addr 172.21.15.156:0/1189189843 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:35.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.095+0000 7f671ffff700 1 --2- 172.21.15.156:0/1189189843 >> v2:172.21.15.156:3300/0 conn(0x7f6720137000 0x7f67201393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:35.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.095+0000 7f671effd700 1 -- 172.21.15.156:0/1189189843 >> v2:172.21.15.156:3300/0 conn(0x7f6720137000 msgr2=0x7f67201393e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:35.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.095+0000 7f671effd700 1 --2- 172.21.15.156:0/1189189843 >> v2:172.21.15.156:3300/0 conn(0x7f6720137000 0x7f67201393e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.095+0000 7f671effd700 1 -- 172.21.15.156:0/1189189843 >> v1:172.21.15.156:6789/0 conn(0x7f6720131980 legacy=0x7f6720131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:35.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.095+0000 7f671effd700 1 -- 172.21.15.156:0/1189189843 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6720131550 con 0x7f67201346e0 2023-09-30T22:20:35.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.095+0000 7f671effd700 1 --2- 172.21.15.156:0/1189189843 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67201346e0 0x7f6720136ac0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6714009920 tx=0x7f6714009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f40c0d7ab67aebe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:35.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.096+0000 7f671e7fc700 1 -- 172.21.15.156:0/1189189843 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6714011830 con 0x7f67201346e0 2023-09-30T22:20:35.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.096+0000 7f671e7fc700 1 -- 172.21.15.156:0/1189189843 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6714011990 con 0x7f67201346e0 2023-09-30T22:20:35.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.096+0000 7f671e7fc700 1 -- 172.21.15.156:0/1189189843 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6714011d20 con 0x7f67201346e0 2023-09-30T22:20:35.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.096+0000 7f67260d2700 1 -- 172.21.15.156:0/1189189843 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67201346e0 msgr2=0x7f6720136ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:35.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.096+0000 7f67260d2700 1 --2- 172.21.15.156:0/1189189843 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67201346e0 0x7f6720136ac0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6714009920 tx=0x7f6714009c30 comp rx=0 tx=0).stop 2023-09-30T22:20:35.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.096+0000 7f67260d2700 1 -- 172.21.15.156:0/1189189843 shutdown_connections 2023-09-30T22:20:35.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.096+0000 7f67260d2700 1 --2- 172.21.15.156:0/1189189843 >> v2:172.21.15.156:3300/0 conn(0x7f6720137000 0x7f67201393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.096+0000 7f67260d2700 1 --2- 172.21.15.156:0/1189189843 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67201346e0 0x7f6720136ac0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.096+0000 7f67260d2700 1 -- 172.21.15.156:0/1189189843 >> 172.21.15.156:0/1189189843 conn(0x7f67200a2980 msgr2=0x7f67200a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:35.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.097+0000 7f67260d2700 1 -- 172.21.15.156:0/1189189843 shutdown_connections 2023-09-30T22:20:35.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.097+0000 7f67260d2700 1 -- 172.21.15.156:0/1189189843 wait complete. 2023-09-30T22:20:35.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.098+0000 7f67260d2700 1 Processor -- start 2023-09-30T22:20:35.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.098+0000 7f67260d2700 1 -- start start 2023-09-30T22:20:35.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.099+0000 7f67260d2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6720131980 0x7f672009f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:35.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.099+0000 7f67260d2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67201346e0 0x7f672011b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:35.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.099+0000 7f67260d2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6720137000 0x7f672011b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:35.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.099+0000 7f67260d2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672009fc30 con 0x7f6720131980 2023-09-30T22:20:35.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.099+0000 7f67260d2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f672011a090 con 0x7f6720137000 2023-09-30T22:20:35.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.099+0000 7f67260d2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67200a1c40 con 0x7f67201346e0 2023-09-30T22:20:35.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.099+0000 7f671effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67201346e0 0x7f672011b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:35.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.099+0000 7f671f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6720131980 0x7f672009f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:35.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.099+0000 7f671effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67201346e0 0x7f672011b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54782/0 (socket says 172.21.15.156:54782) 2023-09-30T22:20:35.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.099+0000 7f671effd700 1 -- 172.21.15.156:0/4160629413 learned_addr learned my addr 172.21.15.156:0/4160629413 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:35.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.099+0000 7f671ffff700 1 --2- 172.21.15.156:0/4160629413 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6720137000 0x7f672011b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:35.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.099+0000 7f671f7fe700 1 -- 172.21.15.156:0/4160629413 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67201346e0 msgr2=0x7f672011b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:35.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.099+0000 7f671f7fe700 1 --2- 172.21.15.156:0/4160629413 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67201346e0 0x7f672011b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.099+0000 7f671f7fe700 1 -- 172.21.15.156:0/4160629413 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6720137000 msgr2=0x7f672011b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:35.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.099+0000 7f671f7fe700 1 --2- 172.21.15.156:0/4160629413 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6720137000 0x7f672011b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.099+0000 7f671f7fe700 1 -- 172.21.15.156:0/4160629413 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6714009550 con 0x7f6720131980 2023-09-30T22:20:35.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.099+0000 7f671ffff700 1 --2- 172.21.15.156:0/4160629413 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6720137000 0x7f672011b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:35.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.100+0000 7f671f7fe700 1 --2- 172.21.15.156:0/4160629413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6720131980 0x7f672009f270 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6710000fd0 tx=0x7f671000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:35.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.100+0000 7f6707fff700 1 -- 172.21.15.156:0/4160629413 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67100054e0 con 0x7f6720131980 2023-09-30T22:20:35.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.100+0000 7f6707fff700 1 -- 172.21.15.156:0/4160629413 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671000ce50 con 0x7f6720131980 2023-09-30T22:20:35.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.100+0000 7f67260d2700 1 -- 172.21.15.156:0/4160629413 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67200a0020 con 0x7f6720131980 2023-09-30T22:20:35.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.100+0000 7f6707fff700 1 -- 172.21.15.156:0/4160629413 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67100038a0 con 0x7f6720131980 2023-09-30T22:20:35.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.100+0000 7f67260d2700 1 -- 172.21.15.156:0/4160629413 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f672011bc90 con 0x7f6720131980 2023-09-30T22:20:35.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.101+0000 7f67260d2700 1 -- 172.21.15.156:0/4160629413 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f672004f2a0 con 0x7f6720131980 2023-09-30T22:20:35.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.102+0000 7f6707fff700 1 -- 172.21.15.156:0/4160629413 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6710003a00 con 0x7f6720131980 2023-09-30T22:20:35.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.102+0000 7f6707fff700 1 -- 172.21.15.156:0/4160629413 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f671003eb90 con 0x7f6720131980 2023-09-30T22:20:35.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.106+0000 7f6707fff700 1 -- 172.21.15.156:0/4160629413 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6710019b40 con 0x7f6720131980 2023-09-30T22:20:35.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.147+0000 7fd4a88d3700 1 Processor -- start 2023-09-30T22:20:35.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.147+0000 7fd4a88d3700 1 -- start start 2023-09-30T22:20:35.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.147+0000 7fd4a88d3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4a409e950 0x7fd4a409ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:35.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.147+0000 7fd4a88d3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4a409f260 0x7fd4a4133c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:35.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.147+0000 7fd4a88d3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd4a41341c0 0x7fd4a4134640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:35.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.147+0000 7fd4a88d3700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a406c9a0 con 0x7fd4a41341c0 2023-09-30T22:20:35.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.147+0000 7fd4a88d3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a409afe0 con 0x7fd4a409e950 2023-09-30T22:20:35.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.147+0000 7fd4a88d3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a406bcc0 con 0x7fd4a409f260 2023-09-30T22:20:35.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.148+0000 7fd4a1d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4a409f260 0x7fd4a4133c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:35.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.148+0000 7fd4a1d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4a409f260 0x7fd4a4133c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54798/0 (socket says 172.21.15.156:54798) 2023-09-30T22:20:35.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.148+0000 7fd4a1d9b700 1 -- 172.21.15.156:0/4064272874 learned_addr learned my addr 172.21.15.156:0/4064272874 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:35.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.148+0000 7fd4a259c700 1 --2- 172.21.15.156:0/4064272874 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4a409e950 0x7fd4a409ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:35.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.148+0000 7fd4a2d9d700 1 --2- 172.21.15.156:0/4064272874 >> v2:172.21.15.156:3300/0 conn(0x7fd4a41341c0 0x7fd4a4134640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:35.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.148+0000 7fd4a1d9b700 1 -- 172.21.15.156:0/4064272874 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4a409e950 msgr2=0x7fd4a409ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:35.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.148+0000 7fd4a1d9b700 1 --2- 172.21.15.156:0/4064272874 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4a409e950 0x7fd4a409ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.148+0000 7fd4a1d9b700 1 -- 172.21.15.156:0/4064272874 >> v2:172.21.15.156:3300/0 conn(0x7fd4a41341c0 msgr2=0x7fd4a4134640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:35.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.148+0000 7fd4a1d9b700 1 --2- 172.21.15.156:0/4064272874 >> v2:172.21.15.156:3300/0 conn(0x7fd4a41341c0 0x7fd4a4134640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.148+0000 7fd4a1d9b700 1 -- 172.21.15.156:0/4064272874 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a406cb80 con 0x7fd4a409f260 2023-09-30T22:20:35.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.148+0000 7fd4a1d9b700 1 --2- 172.21.15.156:0/4064272874 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4a409f260 0x7fd4a4133c80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd498009920 tx=0x7fd498009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=439eb8e9c4823bf4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:35.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.148+0000 7fd4a159a700 1 -- 172.21.15.156:0/4064272874 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd498011830 con 0x7fd4a409f260 2023-09-30T22:20:35.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.148+0000 7fd4a159a700 1 -- 172.21.15.156:0/4064272874 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd498011990 con 0x7fd4a409f260 2023-09-30T22:20:35.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.148+0000 7fd4a159a700 1 -- 172.21.15.156:0/4064272874 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd498011d20 con 0x7fd4a409f260 2023-09-30T22:20:35.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.149+0000 7fd4a88d3700 1 -- 172.21.15.156:0/4064272874 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4a409f260 msgr2=0x7fd4a4133c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:35.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.149+0000 7fd4a88d3700 1 --2- 172.21.15.156:0/4064272874 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4a409f260 0x7fd4a4133c80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd498009920 tx=0x7fd498009c30 comp rx=0 tx=0).stop 2023-09-30T22:20:35.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.149+0000 7fd4a88d3700 1 -- 172.21.15.156:0/4064272874 shutdown_connections 2023-09-30T22:20:35.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.149+0000 7fd4a88d3700 1 --2- 172.21.15.156:0/4064272874 >> v2:172.21.15.156:3300/0 conn(0x7fd4a41341c0 0x7fd4a4134640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.149+0000 7fd4a88d3700 1 --2- 172.21.15.156:0/4064272874 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4a409e950 0x7fd4a409ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.149+0000 7fd4a88d3700 1 --2- 172.21.15.156:0/4064272874 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4a409f260 0x7fd4a4133c80 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.149+0000 7fd4a88d3700 1 -- 172.21.15.156:0/4064272874 >> 172.21.15.156:0/4064272874 conn(0x7fd4a40a0f70 msgr2=0x7fd4a40a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:35.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.149+0000 7fd4a88d3700 1 -- 172.21.15.156:0/4064272874 shutdown_connections 2023-09-30T22:20:35.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.149+0000 7fd4a88d3700 1 -- 172.21.15.156:0/4064272874 wait complete. 2023-09-30T22:20:35.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.150+0000 7fd4a88d3700 1 Processor -- start 2023-09-30T22:20:35.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.150+0000 7fd4a88d3700 1 -- start start 2023-09-30T22:20:35.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.151+0000 7fd4a88d3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4a409e950 0x7fd4a4122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:35.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.151+0000 7fd4a88d3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4a409f260 0x7fd4a4122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:35.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.151+0000 7fd4a88d3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4a41341c0 0x7fd4a41231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:35.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.151+0000 7fd4a88d3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a4124c30 con 0x7fd4a409e950 2023-09-30T22:20:35.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.151+0000 7fd4a88d3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a40a0400 con 0x7fd4a41341c0 2023-09-30T22:20:35.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.151+0000 7fd4a88d3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a4072540 con 0x7fd4a409f260 2023-09-30T22:20:35.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.151+0000 7fd4a1d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4a409f260 0x7fd4a4122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:35.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.151+0000 7fd4a2d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4a41341c0 0x7fd4a41231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:35.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.151+0000 7fd4a1d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4a409f260 0x7fd4a4122c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54800/0 (socket says 172.21.15.156:54800) 2023-09-30T22:20:35.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.151+0000 7fd4a1d9b700 1 -- 172.21.15.156:0/1387105921 learned_addr learned my addr 172.21.15.156:0/1387105921 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:35.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.151+0000 7fd4a259c700 1 --2- 172.21.15.156:0/1387105921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4a409e950 0x7fd4a4122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:35.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.151+0000 7fd4a2d9d700 1 -- 172.21.15.156:0/1387105921 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4a409f260 msgr2=0x7fd4a4122c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:35.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.151+0000 7fd4a2d9d700 1 --2- 172.21.15.156:0/1387105921 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4a409f260 0x7fd4a4122c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.151+0000 7fd4a2d9d700 1 -- 172.21.15.156:0/1387105921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4a409e950 msgr2=0x7fd4a4122750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:35.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.151+0000 7fd4a2d9d700 1 --2- 172.21.15.156:0/1387105921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4a409e950 0x7fd4a4122750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.151+0000 7fd4a2d9d700 1 -- 172.21.15.156:0/1387105921 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd498009550 con 0x7fd4a41341c0 2023-09-30T22:20:35.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.151+0000 7fd4a259c700 1 --2- 172.21.15.156:0/1387105921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4a409e950 0x7fd4a4122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:35.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.151+0000 7fd4a2d9d700 1 --2- 172.21.15.156:0/1387105921 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4a41341c0 0x7fd4a41231d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd49c00efc0 tx=0x7fd49c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:35.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.152+0000 7fd492ffd700 1 -- 172.21.15.156:0/1387105921 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c00cc90 con 0x7fd4a41341c0 2023-09-30T22:20:35.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.152+0000 7fd492ffd700 1 -- 172.21.15.156:0/1387105921 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49c00f040 con 0x7fd4a41341c0 2023-09-30T22:20:35.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.152+0000 7fd492ffd700 1 -- 172.21.15.156:0/1387105921 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c0146c0 con 0x7fd4a41341c0 2023-09-30T22:20:35.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.152+0000 7fd4a88d3700 1 -- 172.21.15.156:0/1387105921 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a4125180 con 0x7fd4a41341c0 2023-09-30T22:20:35.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.152+0000 7fd4a88d3700 1 -- 172.21.15.156:0/1387105921 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a4125f90 con 0x7fd4a41341c0 2023-09-30T22:20:35.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.153+0000 7fd4a88d3700 1 -- 172.21.15.156:0/1387105921 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a404f2a0 con 0x7fd4a41341c0 2023-09-30T22:20:35.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.153+0000 7fd492ffd700 1 -- 172.21.15.156:0/1387105921 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd49c014820 con 0x7fd4a41341c0 2023-09-30T22:20:35.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.153+0000 7fd492ffd700 1 -- 172.21.15.156:0/1387105921 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd49c0401d0 con 0x7fd4a41341c0 2023-09-30T22:20:35.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.162+0000 7fd492ffd700 1 -- 172.21.15.156:0/1387105921 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd49c007900 con 0x7fd4a41341c0 2023-09-30T22:20:35.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.178+0000 7fb4f1060700 1 -- 172.21.15.156:0/4200594259 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb4ec0729d0 con 0x7fb4ec133f70 2023-09-30T22:20:35.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.179+0000 7fb4d37fe700 1 -- 172.21.15.156:0/4200594259 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb4e0011360 con 0x7fb4ec133f70 2023-09-30T22:20:35.178 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:35.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.181+0000 7fb4f1060700 1 -- 172.21.15.156:0/4200594259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4ec133f70 msgr2=0x7fb4ec1c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:35.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.181+0000 7fb4f1060700 1 --2- 172.21.15.156:0/4200594259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4ec133f70 0x7fb4ec1c86d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb4e000c470 tx=0x7fb4e000c780 comp rx=0 tx=0).stop 2023-09-30T22:20:35.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.181+0000 7fb4f1060700 1 -- 172.21.15.156:0/4200594259 shutdown_connections 2023-09-30T22:20:35.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.181+0000 7fb4f1060700 1 --2- 172.21.15.156:0/4200594259 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4ec1343a0 0x7fb4ec1c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.181+0000 7fb4f1060700 1 --2- 172.21.15.156:0/4200594259 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4ec09ad40 0x7fb4ec1c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.181+0000 7fb4f1060700 1 --2- 172.21.15.156:0/4200594259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4ec133f70 0x7fb4ec1c86d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.181+0000 7fb4f1060700 1 -- 172.21.15.156:0/4200594259 >> 172.21.15.156:0/4200594259 conn(0x7fb4ec099c40 msgr2=0x7fb4ec1bbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:35.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.182+0000 7fb4f1060700 1 -- 172.21.15.156:0/4200594259 shutdown_connections 2023-09-30T22:20:35.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.182+0000 7fb4f1060700 1 -- 172.21.15.156:0/4200594259 wait complete. 2023-09-30T22:20:35.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:35.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.275+0000 7f24014fc700 1 -- 172.21.15.156:0/2184648245 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f23fc06bce0 con 0x7f23fc0a08e0 2023-09-30T22:20:35.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.275+0000 7f23e37fe700 1 -- 172.21.15.156:0/2184648245 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f23ec033020 con 0x7f23fc0a08e0 2023-09-30T22:20:35.275 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:35.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.277+0000 7f24014fc700 1 -- 172.21.15.156:0/2184648245 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23fc0a08e0 msgr2=0x7f23fc1266d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:35.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.277+0000 7f24014fc700 1 --2- 172.21.15.156:0/2184648245 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23fc0a08e0 0x7f23fc1266d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f23ec000c00 tx=0x7f23ec004750 comp rx=0 tx=0).stop 2023-09-30T22:20:35.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.277+0000 7f24014fc700 1 -- 172.21.15.156:0/2184648245 shutdown_connections 2023-09-30T22:20:35.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.277+0000 7f24014fc700 1 --2- 172.21.15.156:0/2184648245 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23fc138040 0x7f23fc127150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.277+0000 7f24014fc700 1 --2- 172.21.15.156:0/2184648245 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23fc0a08e0 0x7f23fc1266d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.277+0000 7f24014fc700 1 --2- 172.21.15.156:0/2184648245 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23fc0a1230 0x7f23fc126c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.277+0000 7f24014fc700 1 -- 172.21.15.156:0/2184648245 >> 172.21.15.156:0/2184648245 conn(0x7f23fc0a2980 msgr2=0x7f23fc09e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:35.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.277+0000 7f24014fc700 1 -- 172.21.15.156:0/2184648245 shutdown_connections 2023-09-30T22:20:35.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.277+0000 7f24014fc700 1 -- 172.21.15.156:0/2184648245 wait complete. 2023-09-30T22:20:35.289 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:35.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.303+0000 7f67260d2700 1 -- 172.21.15.156:0/4160629413 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f67200a1020 con 0x7f6720131980 2023-09-30T22:20:35.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.303+0000 7f6707fff700 1 -- 172.21.15.156:0/4160629413 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6710017070 con 0x7f6720131980 2023-09-30T22:20:35.303 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:35.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.305+0000 7f67260d2700 1 -- 172.21.15.156:0/4160629413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6720131980 msgr2=0x7f672009f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:35.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.305+0000 7f67260d2700 1 --2- 172.21.15.156:0/4160629413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6720131980 0x7f672009f270 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6710000fd0 tx=0x7f671000c7b0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.305+0000 7f67260d2700 1 -- 172.21.15.156:0/4160629413 shutdown_connections 2023-09-30T22:20:35.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.305+0000 7f67260d2700 1 --2- 172.21.15.156:0/4160629413 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6720137000 0x7f672011b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.305+0000 7f67260d2700 1 --2- 172.21.15.156:0/4160629413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6720131980 0x7f672009f270 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.305+0000 7f67260d2700 1 --2- 172.21.15.156:0/4160629413 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67201346e0 0x7f672011b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.305+0000 7f67260d2700 1 -- 172.21.15.156:0/4160629413 >> 172.21.15.156:0/4160629413 conn(0x7f67200a2980 msgr2=0x7f6720133560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:35.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.305+0000 7f67260d2700 1 -- 172.21.15.156:0/4160629413 shutdown_connections 2023-09-30T22:20:35.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.305+0000 7f67260d2700 1 -- 172.21.15.156:0/4160629413 wait complete. 2023-09-30T22:20:35.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:35.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.355+0000 7fd4a88d3700 1 -- 172.21.15.156:0/1387105921 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd4a40a0850 con 0x7fd4a41341c0 2023-09-30T22:20:35.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.355+0000 7fd492ffd700 1 -- 172.21.15.156:0/1387105921 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd49c018020 con 0x7fd4a41341c0 2023-09-30T22:20:35.355 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:35.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.357+0000 7fd4a88d3700 1 -- 172.21.15.156:0/1387105921 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4a41341c0 msgr2=0x7fd4a41231d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:35.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.357+0000 7fd4a88d3700 1 --2- 172.21.15.156:0/1387105921 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4a41341c0 0x7fd4a41231d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd49c00efc0 tx=0x7fd49c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.357+0000 7fd4a88d3700 1 -- 172.21.15.156:0/1387105921 shutdown_connections 2023-09-30T22:20:35.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.357+0000 7fd4a88d3700 1 --2- 172.21.15.156:0/1387105921 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4a41341c0 0x7fd4a41231d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.357+0000 7fd4a88d3700 1 --2- 172.21.15.156:0/1387105921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4a409e950 0x7fd4a4122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.357+0000 7fd4a88d3700 1 --2- 172.21.15.156:0/1387105921 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4a409f260 0x7fd4a4122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:35.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.357+0000 7fd4a88d3700 1 -- 172.21.15.156:0/1387105921 >> 172.21.15.156:0/1387105921 conn(0x7fd4a40a0f70 msgr2=0x7fd4a40a3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:35.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.358+0000 7fd4a88d3700 1 -- 172.21.15.156:0/1387105921 shutdown_connections 2023-09-30T22:20:35.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:35.358+0000 7fd4a88d3700 1 -- 172.21.15.156:0/1387105921 wait complete. 2023-09-30T22:20:35.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:36.194 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:36.290 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:36.318 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:36.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.326+0000 7f8d5009a700 1 Processor -- start 2023-09-30T22:20:36.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.326+0000 7f8d5009a700 1 -- start start 2023-09-30T22:20:36.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.327+0000 7f8d5009a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d4809d860 0x7f8d4809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:36.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.327+0000 7f8d5009a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d48130eb0 0x7f8d48138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:36.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.327+0000 7f8d5009a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d4809aaa0 con 0x7f8d4809e170 2023-09-30T22:20:36.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.327+0000 7f8d5009a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4809f870 con 0x7f8d48130eb0 2023-09-30T22:20:36.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.327+0000 7f8d5009a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4809b360 con 0x7f8d4809d860 2023-09-30T22:20:36.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.327+0000 7f8d4de36700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d4809d860 0x7f8d4809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:36.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.327+0000 7f8d4e637700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d48130eb0 0x7f8d48138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:36.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.327+0000 7f8d4d635700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f8d4809e170 0x7f8d481307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:60658/0 (socket says 172.21.15.156:60658) 2023-09-30T22:20:36.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.327+0000 7f8d4d635700 1 -- 172.21.15.156:0/1673483782 learned_addr learned my addr 172.21.15.156:0/1673483782 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:36.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.327+0000 7f8d4de36700 1 -- 172.21.15.156:0/1673483782 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d48130eb0 msgr2=0x7f8d48138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:36.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.327+0000 7f8d4de36700 1 --2- 172.21.15.156:0/1673483782 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d48130eb0 0x7f8d48138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.327+0000 7f8d4de36700 1 -- 172.21.15.156:0/1673483782 >> v1:172.21.15.156:6789/0 conn(0x7f8d4809e170 legacy=0x7f8d481307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:36.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.327+0000 7f8d4de36700 1 -- 172.21.15.156:0/1673483782 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4809b620 con 0x7f8d4809d860 2023-09-30T22:20:36.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.327+0000 7f8d4e637700 1 --2- 172.21.15.156:0/1673483782 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d48130eb0 0x7f8d48138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:36.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.328+0000 7f8d4de36700 1 --2- 172.21.15.156:0/1673483782 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d4809d860 0x7f8d4809dc30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8d4400bb10 tx=0x7f8d4400be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff9caeba90b80b63 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:36.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.328+0000 7f8d4ce34700 1 -- 172.21.15.156:0/1673483782 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4400dc70 con 0x7f8d4809d860 2023-09-30T22:20:36.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.328+0000 7f8d4ce34700 1 -- 172.21.15.156:0/1673483782 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4400ddd0 con 0x7f8d4809d860 2023-09-30T22:20:36.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.328+0000 7f8d4ce34700 1 -- 172.21.15.156:0/1673483782 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d44010670 con 0x7f8d4809d860 2023-09-30T22:20:36.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.328+0000 7f8d5009a700 1 -- 172.21.15.156:0/1673483782 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d4809d860 msgr2=0x7f8d4809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:36.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.328+0000 7f8d5009a700 1 --2- 172.21.15.156:0/1673483782 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d4809d860 0x7f8d4809dc30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8d4400bb10 tx=0x7f8d4400be20 comp rx=0 tx=0).stop 2023-09-30T22:20:36.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.328+0000 7f8d5009a700 1 -- 172.21.15.156:0/1673483782 shutdown_connections 2023-09-30T22:20:36.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.328+0000 7f8d5009a700 1 --2- 172.21.15.156:0/1673483782 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d48130eb0 0x7f8d48138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.328+0000 7f8d5009a700 1 --2- 172.21.15.156:0/1673483782 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d4809d860 0x7f8d4809dc30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.328+0000 7f8d5009a700 1 -- 172.21.15.156:0/1673483782 >> 172.21.15.156:0/1673483782 conn(0x7f8d48099c40 msgr2=0x7f8d480a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.329+0000 7f8d5009a700 1 -- 172.21.15.156:0/1673483782 shutdown_connections 2023-09-30T22:20:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.329+0000 7f8d5009a700 1 -- 172.21.15.156:0/1673483782 wait complete. 2023-09-30T22:20:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.329+0000 7f8d5009a700 1 Processor -- start 2023-09-30T22:20:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.330+0000 7f8d5009a700 1 -- start start 2023-09-30T22:20:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.330+0000 7f8d5009a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d4809d860 0x7f8d4811e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.330+0000 7f8d5009a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d4809e170 0x7f8d4811eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.330+0000 7f8d5009a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d48130eb0 0x7f8d4811f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.330+0000 7f8d5009a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d481216e0 con 0x7f8d48130eb0 2023-09-30T22:20:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.330+0000 7f8d5009a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d480a22f0 con 0x7f8d4809d860 2023-09-30T22:20:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.330+0000 7f8d5009a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4809c8b0 con 0x7f8d4809e170 2023-09-30T22:20:36.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.330+0000 7f8d4de36700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d4809d860 0x7f8d4811e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:36.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.330+0000 7f8d4d635700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d4809e170 0x7f8d4811eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:36.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.330+0000 7f8d4de36700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d4809d860 0x7f8d4811e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59662/0 (socket says 172.21.15.156:59662) 2023-09-30T22:20:36.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.330+0000 7f8d4de36700 1 -- 172.21.15.156:0/4192302366 learned_addr learned my addr 172.21.15.156:0/4192302366 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:36.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.330+0000 7f8d4e637700 1 --2- 172.21.15.156:0/4192302366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d48130eb0 0x7f8d4811f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:36.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.330+0000 7f8d4d635700 1 -- 172.21.15.156:0/4192302366 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d4809d860 msgr2=0x7f8d4811e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:36.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.330+0000 7f8d4d635700 1 --2- 172.21.15.156:0/4192302366 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d4809d860 0x7f8d4811e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.330+0000 7f8d4d635700 1 -- 172.21.15.156:0/4192302366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d48130eb0 msgr2=0x7f8d4811f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:36.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.330+0000 7f8d4d635700 1 --2- 172.21.15.156:0/4192302366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d48130eb0 0x7f8d4811f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.330+0000 7f8d4d635700 1 -- 172.21.15.156:0/4192302366 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d40009a70 con 0x7f8d4809e170 2023-09-30T22:20:36.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.331+0000 7f8d4d635700 1 --2- 172.21.15.156:0/4192302366 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d4809e170 0x7f8d4811eae0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8d3800c4d0 tx=0x7f8d3800c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:36.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.331+0000 7f8d3e7fc700 1 -- 172.21.15.156:0/4192302366 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d38005d70 con 0x7f8d4809e170 2023-09-30T22:20:36.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.331+0000 7f8d3e7fc700 1 -- 172.21.15.156:0/4192302366 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3800ce70 con 0x7f8d4809e170 2023-09-30T22:20:36.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.331+0000 7f8d5009a700 1 -- 172.21.15.156:0/4192302366 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d4400b740 con 0x7f8d4809e170 2023-09-30T22:20:36.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.331+0000 7f8d3e7fc700 1 -- 172.21.15.156:0/4192302366 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d380072d0 con 0x7f8d4809e170 2023-09-30T22:20:36.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.331+0000 7f8d5009a700 1 -- 172.21.15.156:0/4192302366 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d481200d0 con 0x7f8d4809e170 2023-09-30T22:20:36.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.332+0000 7f8d3e7fc700 1 -- 172.21.15.156:0/4192302366 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d38007430 con 0x7f8d4809e170 2023-09-30T22:20:36.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.332+0000 7f8d3e7fc700 1 -- 172.21.15.156:0/4192302366 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8d3803e930 con 0x7f8d4809e170 2023-09-30T22:20:36.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.333+0000 7f8d5009a700 1 -- 172.21.15.156:0/4192302366 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d4804f2a0 con 0x7f8d4809e170 2023-09-30T22:20:36.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.337+0000 7f8d3e7fc700 1 -- 172.21.15.156:0/4192302366 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d3801b3b0 con 0x7f8d4809e170 2023-09-30T22:20:36.370 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:36.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.433+0000 7f3511a1c700 1 Processor -- start 2023-09-30T22:20:36.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.433+0000 7f3511a1c700 1 -- start start 2023-09-30T22:20:36.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.433+0000 7f3511a1c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350c133ad0 0x7f350c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:36.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.433+0000 7f3511a1c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f350c1300a0 0x7f350c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:36.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.433+0000 7f3511a1c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f350c1309f0 0x7f350c13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:36.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.433+0000 7f3511a1c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f350c06b2d0 con 0x7f350c1309f0 2023-09-30T22:20:36.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.433+0000 7f3511a1c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350c133610 con 0x7f350c133ad0 2023-09-30T22:20:36.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.433+0000 7f3511a1c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f350c09a500 con 0x7f350c1300a0 2023-09-30T22:20:36.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.434+0000 7f350affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350c133ad0 0x7f350c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:36.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.434+0000 7f350affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350c133ad0 0x7f350c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59664/0 (socket says 172.21.15.156:59664) 2023-09-30T22:20:36.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.434+0000 7f350affd700 1 -- 172.21.15.156:0/3142191106 learned_addr learned my addr 172.21.15.156:0/3142191106 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:36.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.434+0000 7f350a7fc700 1 --2- 172.21.15.156:0/3142191106 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f350c1300a0 0x7f350c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:36.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.434+0000 7f350b7fe700 1 --2- 172.21.15.156:0/3142191106 >> v2:172.21.15.156:3300/0 conn(0x7f350c1309f0 0x7f350c13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:36.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.434+0000 7f350a7fc700 1 -- 172.21.15.156:0/3142191106 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350c133ad0 msgr2=0x7f350c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:36.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.434+0000 7f350a7fc700 1 --2- 172.21.15.156:0/3142191106 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350c133ad0 0x7f350c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.434+0000 7f350a7fc700 1 -- 172.21.15.156:0/3142191106 >> v2:172.21.15.156:3300/0 conn(0x7f350c1309f0 msgr2=0x7f350c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:36.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.434+0000 7f350a7fc700 1 --2- 172.21.15.156:0/3142191106 >> v2:172.21.15.156:3300/0 conn(0x7f350c1309f0 0x7f350c13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.434+0000 7f350a7fc700 1 -- 172.21.15.156:0/3142191106 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c1338b0 con 0x7f350c1300a0 2023-09-30T22:20:36.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.434+0000 7f350a7fc700 1 --2- 172.21.15.156:0/3142191106 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f350c1300a0 0x7f350c1304b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3500009840 tx=0x7f3500009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66e89369c2ab4acc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:36.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.434+0000 7f3509ffb700 1 -- 172.21.15.156:0/3142191106 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3500011830 con 0x7f350c1300a0 2023-09-30T22:20:36.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.435+0000 7f3509ffb700 1 -- 172.21.15.156:0/3142191106 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3500011990 con 0x7f350c1300a0 2023-09-30T22:20:36.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.435+0000 7f3509ffb700 1 -- 172.21.15.156:0/3142191106 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3500011d20 con 0x7f350c1300a0 2023-09-30T22:20:36.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.435+0000 7f3511a1c700 1 -- 172.21.15.156:0/3142191106 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f350c1300a0 msgr2=0x7f350c1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:36.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.435+0000 7f3511a1c700 1 --2- 172.21.15.156:0/3142191106 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f350c1300a0 0x7f350c1304b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3500009840 tx=0x7f3500009b50 comp rx=0 tx=0).stop 2023-09-30T22:20:36.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.435+0000 7f3511a1c700 1 -- 172.21.15.156:0/3142191106 shutdown_connections 2023-09-30T22:20:36.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.435+0000 7f3511a1c700 1 --2- 172.21.15.156:0/3142191106 >> v2:172.21.15.156:3300/0 conn(0x7f350c1309f0 0x7f350c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.435+0000 7f3511a1c700 1 --2- 172.21.15.156:0/3142191106 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350c133ad0 0x7f350c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.435+0000 7f3511a1c700 1 --2- 172.21.15.156:0/3142191106 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f350c1300a0 0x7f350c1304b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.435+0000 7f3511a1c700 1 -- 172.21.15.156:0/3142191106 >> 172.21.15.156:0/3142191106 conn(0x7f350c099c40 msgr2=0x7f350c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:36.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.435+0000 7f3511a1c700 1 -- 172.21.15.156:0/3142191106 shutdown_connections 2023-09-30T22:20:36.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.435+0000 7f3511a1c700 1 -- 172.21.15.156:0/3142191106 wait complete. 2023-09-30T22:20:36.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.437+0000 7f3511a1c700 1 Processor -- start 2023-09-30T22:20:36.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.437+0000 7f3511a1c700 1 -- start start 2023-09-30T22:20:36.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.438+0000 7f3511a1c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350c1300a0 0x7f350c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:36.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.438+0000 7f3511a1c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f350c1309f0 0x7f350c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:36.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.438+0000 7f3511a1c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f350c133ad0 0x7f350c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:36.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.438+0000 7f3511a1c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350c120b30 con 0x7f350c1309f0 2023-09-30T22:20:36.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.438+0000 7f3511a1c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350c11f550 con 0x7f350c1300a0 2023-09-30T22:20:36.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.438+0000 7f3511a1c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f350c12dd00 con 0x7f350c133ad0 2023-09-30T22:20:36.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.438+0000 7f350a7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f350c1309f0 0x7f350c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:36.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.438+0000 7f350a7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f350c1309f0 0x7f350c11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49164/0 (socket says 172.21.15.156:49164) 2023-09-30T22:20:36.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.438+0000 7f350a7fc700 1 -- 172.21.15.156:0/1368024838 learned_addr learned my addr 172.21.15.156:0/1368024838 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:36.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.438+0000 7f350b7fe700 1 --2- 172.21.15.156:0/1368024838 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f350c133ad0 0x7f350c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:36.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.438+0000 7f350affd700 1 --2- 172.21.15.156:0/1368024838 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350c1300a0 0x7f350c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:36.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.438+0000 7f350a7fc700 1 -- 172.21.15.156:0/1368024838 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f350c133ad0 msgr2=0x7f350c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:36.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.438+0000 7f350a7fc700 1 --2- 172.21.15.156:0/1368024838 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f350c133ad0 0x7f350c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.438+0000 7f350a7fc700 1 -- 172.21.15.156:0/1368024838 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350c1300a0 msgr2=0x7f350c11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:36.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.438+0000 7f350a7fc700 1 --2- 172.21.15.156:0/1368024838 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350c1300a0 0x7f350c11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.438+0000 7f350a7fc700 1 -- 172.21.15.156:0/1368024838 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35000094a0 con 0x7f350c1309f0 2023-09-30T22:20:36.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.438+0000 7f350b7fe700 1 --2- 172.21.15.156:0/1368024838 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f350c133ad0 0x7f350c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:36.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.439+0000 7f350a7fc700 1 --2- 172.21.15.156:0/1368024838 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f350c1309f0 0x7f350c11df80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3500000c00 tx=0x7f3500004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:36.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.439+0000 7f34f3fff700 1 -- 172.21.15.156:0/1368024838 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3500004450 con 0x7f350c1309f0 2023-09-30T22:20:36.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.439+0000 7f34f3fff700 1 -- 172.21.15.156:0/1368024838 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350001e070 con 0x7f350c1309f0 2023-09-30T22:20:36.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.439+0000 7f34f3fff700 1 -- 172.21.15.156:0/1368024838 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35000038e0 con 0x7f350c1309f0 2023-09-30T22:20:36.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.439+0000 7f3511a1c700 1 -- 172.21.15.156:0/1368024838 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f350c12fcd0 con 0x7f350c1309f0 2023-09-30T22:20:36.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.439+0000 7f3511a1c700 1 -- 172.21.15.156:0/1368024838 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f350c11f8c0 con 0x7f350c1309f0 2023-09-30T22:20:36.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.440+0000 7f34f3fff700 1 -- 172.21.15.156:0/1368024838 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3500003a40 con 0x7f350c1309f0 2023-09-30T22:20:36.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.440+0000 7f3511a1c700 1 -- 172.21.15.156:0/1368024838 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f350c04f2a0 con 0x7f350c1309f0 2023-09-30T22:20:36.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.440+0000 7f34f3fff700 1 -- 172.21.15.156:0/1368024838 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f35000403c0 con 0x7f350c1309f0 2023-09-30T22:20:36.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.445+0000 7f34f3fff700 1 -- 172.21.15.156:0/1368024838 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f35000045b0 con 0x7f350c1309f0 2023-09-30T22:20:36.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.457+0000 7feecf926700 1 Processor -- start 2023-09-30T22:20:36.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.457+0000 7feecf926700 1 -- start start 2023-09-30T22:20:36.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.458+0000 7feecf926700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feec809d860 0x7feec809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:36.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.458+0000 7feecf926700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7feec809e170 0x7feec81307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:36.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.458+0000 7feecf926700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feec8130ce0 0x7feec8131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:36.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.458+0000 7feecf926700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec809aaa0 con 0x7feec809e170 2023-09-30T22:20:36.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.458+0000 7feecf926700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec809f870 con 0x7feec809d860 2023-09-30T22:20:36.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.458+0000 7feecf926700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feec809b360 con 0x7feec8130ce0 2023-09-30T22:20:36.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.458+0000 7feecdec3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feec8130ce0 0x7feec8131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:36.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.458+0000 7feecdec3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feec8130ce0 0x7feec8131180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54842/0 (socket says 172.21.15.156:54842) 2023-09-30T22:20:36.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.458+0000 7feecdec3700 1 -- 172.21.15.156:0/4216335217 learned_addr learned my addr 172.21.15.156:0/4216335217 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:36.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.458+0000 7feecd6c2700 1 --2- 172.21.15.156:0/4216335217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feec809d860 0x7feec809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:36.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.459+0000 7feecd6c2700 1 -- 172.21.15.156:0/4216335217 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feec8130ce0 msgr2=0x7feec8131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:36.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.459+0000 7feecd6c2700 1 --2- 172.21.15.156:0/4216335217 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feec8130ce0 0x7feec8131180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.459+0000 7feecd6c2700 1 -- 172.21.15.156:0/4216335217 >> v2:172.21.15.156:3300/0 conn(0x7feec809e170 msgr2=0x7feec81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:36.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.459+0000 7feecd6c2700 1 --2- 172.21.15.156:0/4216335217 >> v2:172.21.15.156:3300/0 conn(0x7feec809e170 0x7feec81307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.459+0000 7feecd6c2700 1 -- 172.21.15.156:0/4216335217 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec809b620 con 0x7feec809d860 2023-09-30T22:20:36.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.459+0000 7feecd6c2700 1 --2- 172.21.15.156:0/4216335217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feec809d860 0x7feec809dc30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7feec4009870 tx=0x7feec4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10729196619e6b87 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:36.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.459+0000 7feebffff700 1 -- 172.21.15.156:0/4216335217 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec4011830 con 0x7feec809d860 2023-09-30T22:20:36.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.459+0000 7feebffff700 1 -- 172.21.15.156:0/4216335217 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec4011990 con 0x7feec809d860 2023-09-30T22:20:36.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.459+0000 7feebffff700 1 -- 172.21.15.156:0/4216335217 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec4011d20 con 0x7feec809d860 2023-09-30T22:20:36.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.460+0000 7feecf926700 1 -- 172.21.15.156:0/4216335217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feec809d860 msgr2=0x7feec809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:36.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.460+0000 7feecf926700 1 --2- 172.21.15.156:0/4216335217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feec809d860 0x7feec809dc30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7feec4009870 tx=0x7feec4009b80 comp rx=0 tx=0).stop 2023-09-30T22:20:36.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.460+0000 7feecf926700 1 -- 172.21.15.156:0/4216335217 shutdown_connections 2023-09-30T22:20:36.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.460+0000 7feecf926700 1 --2- 172.21.15.156:0/4216335217 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feec8130ce0 0x7feec8131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.460+0000 7feecf926700 1 --2- 172.21.15.156:0/4216335217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feec809d860 0x7feec809dc30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.460+0000 7feecf926700 1 --2- 172.21.15.156:0/4216335217 >> v2:172.21.15.156:3300/0 conn(0x7feec809e170 0x7feec81307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.460+0000 7feecf926700 1 -- 172.21.15.156:0/4216335217 >> 172.21.15.156:0/4216335217 conn(0x7feec8099c40 msgr2=0x7feec80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:36.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.460+0000 7feecf926700 1 -- 172.21.15.156:0/4216335217 shutdown_connections 2023-09-30T22:20:36.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.460+0000 7feecf926700 1 -- 172.21.15.156:0/4216335217 wait complete. 2023-09-30T22:20:36.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.461+0000 7feecf926700 1 Processor -- start 2023-09-30T22:20:36.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.461+0000 7feecf926700 1 -- start start 2023-09-30T22:20:36.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.461+0000 7feecf926700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feec809d860 0x7feec81379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:36.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.461+0000 7feecf926700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feec809e170 0x7feec8137f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:36.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.461+0000 7feecd6c2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feec809d860 0x7feec81379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:36.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.462+0000 7feecd6c2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feec809d860 0x7feec81379f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59682/0 (socket says 172.21.15.156:59682) 2023-09-30T22:20:36.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.462+0000 7feeccec1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feec809e170 0x7feec8137f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:36.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.462+0000 7feeccec1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feec809e170 0x7feec8137f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54846/0 (socket says 172.21.15.156:54846) 2023-09-30T22:20:36.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.462+0000 7feecf926700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feec8130ce0 0x7feec8138470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:36.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.462+0000 7feecd6c2700 1 -- 172.21.15.156:0/3842858658 learned_addr learned my addr 172.21.15.156:0/3842858658 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:36.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.462+0000 7feecf926700 1 -- 172.21.15.156:0/3842858658 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec8139920 con 0x7feec8130ce0 2023-09-30T22:20:36.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.462+0000 7feecf926700 1 -- 172.21.15.156:0/3842858658 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec809c920 con 0x7feec809d860 2023-09-30T22:20:36.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.462+0000 7feecf926700 1 -- 172.21.15.156:0/3842858658 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feec811e950 con 0x7feec809e170 2023-09-30T22:20:36.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.462+0000 7feecdec3700 1 --2- 172.21.15.156:0/3842858658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feec8130ce0 0x7feec8138470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:36.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.462+0000 7feecd6c2700 1 -- 172.21.15.156:0/3842858658 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feec809e170 msgr2=0x7feec8137f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:36.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.462+0000 7feecd6c2700 1 --2- 172.21.15.156:0/3842858658 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feec809e170 0x7feec8137f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.462+0000 7feecd6c2700 1 -- 172.21.15.156:0/3842858658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feec8130ce0 msgr2=0x7feec8138470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:36.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.462+0000 7feecd6c2700 1 --2- 172.21.15.156:0/3842858658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feec8130ce0 0x7feec8138470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.462+0000 7feecd6c2700 1 -- 172.21.15.156:0/3842858658 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec40094a0 con 0x7feec809d860 2023-09-30T22:20:36.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.462+0000 7feecd6c2700 1 --2- 172.21.15.156:0/3842858658 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feec809d860 0x7feec81379f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7feec4009840 tx=0x7feec4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:36.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.462+0000 7feebdffb700 1 -- 172.21.15.156:0/3842858658 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec4004590 con 0x7feec809d860 2023-09-30T22:20:36.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.462+0000 7feebdffb700 1 -- 172.21.15.156:0/3842858658 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec401e070 con 0x7feec809d860 2023-09-30T22:20:36.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.462+0000 7feebdffb700 1 -- 172.21.15.156:0/3842858658 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec40038a0 con 0x7feec809d860 2023-09-30T22:20:36.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.462+0000 7feecf926700 1 -- 172.21.15.156:0/3842858658 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec811da40 con 0x7feec809d860 2023-09-30T22:20:36.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.463+0000 7feecf926700 1 -- 172.21.15.156:0/3842858658 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec811dfe0 con 0x7feec809d860 2023-09-30T22:20:36.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.464+0000 7feebdffb700 1 -- 172.21.15.156:0/3842858658 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feec4003a00 con 0x7feec809d860 2023-09-30T22:20:36.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.464+0000 7feebdffb700 1 -- 172.21.15.156:0/3842858658 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feec4020070 con 0x7feec809d860 2023-09-30T22:20:36.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.464+0000 7feecf926700 1 -- 172.21.15.156:0/3842858658 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec804f2a0 con 0x7feec809d860 2023-09-30T22:20:36.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.469+0000 7feebdffb700 1 -- 172.21.15.156:0/3842858658 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feec4015030 con 0x7feec809d860 2023-09-30T22:20:36.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.500+0000 7f5146682700 1 Processor -- start 2023-09-30T22:20:36.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.500+0000 7f5146682700 1 -- start start 2023-09-30T22:20:36.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.501+0000 7f5146682700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51400a0a70 0x7f51400a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:36.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.501+0000 7f5146682700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f51400a1380 0x7f5140133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:36.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.501+0000 7f5146682700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514009dc00 con 0x7f5140133f50 2023-09-30T22:20:36.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.501+0000 7f5146682700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514009ea60 con 0x7f51400a0a70 2023-09-30T22:20:36.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.501+0000 7f5146682700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f514009dec0 con 0x7f51400a1380 2023-09-30T22:20:36.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.501+0000 7f513ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51400a0a70 0x7f51400a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:36.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.501+0000 7f513ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51400a0a70 0x7f51400a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59696/0 (socket says 172.21.15.156:59696) 2023-09-30T22:20:36.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.501+0000 7f513ffff700 1 -- 172.21.15.156:0/4064144248 learned_addr learned my addr 172.21.15.156:0/4064144248 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:36.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.501+0000 7f513f7fe700 1 --2- 172.21.15.156:0/4064144248 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f51400a1380 0x7f5140133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:36.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.501+0000 7f513ffff700 1 -- 172.21.15.156:0/4064144248 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f51400a1380 msgr2=0x7f5140133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:36.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.501+0000 7f513effd700 1 -- 172.21.15.156:0/4064144248 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1004340423 0 0) 0x7f514009dc00 con 0x7f5140133f50 2023-09-30T22:20:36.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.501+0000 7f513ffff700 1 --2- 172.21.15.156:0/4064144248 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f51400a1380 0x7f5140133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.501+0000 7f513ffff700 1 -- 172.21.15.156:0/4064144248 >> v1:172.21.15.156:6789/0 conn(0x7f5140133f50 legacy=0x7f514013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:36.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.501+0000 7f513ffff700 1 -- 172.21.15.156:0/4064144248 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514009e6a0 con 0x7f51400a0a70 2023-09-30T22:20:36.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.501+0000 7f513f7fe700 1 --2- 172.21.15.156:0/4064144248 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f51400a1380 0x7f5140133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:36.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.502+0000 7f513ffff700 1 --2- 172.21.15.156:0/4064144248 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51400a0a70 0x7f51400a0e40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5130009920 tx=0x7f5130009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b062d74190bb7f8d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:36.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.502+0000 7f513effd700 1 -- 172.21.15.156:0/4064144248 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5130011830 con 0x7f51400a0a70 2023-09-30T22:20:36.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.502+0000 7f513effd700 1 -- 172.21.15.156:0/4064144248 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5130011990 con 0x7f51400a0a70 2023-09-30T22:20:36.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.502+0000 7f513effd700 1 -- 172.21.15.156:0/4064144248 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5130011d20 con 0x7f51400a0a70 2023-09-30T22:20:36.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.502+0000 7f5146682700 1 -- 172.21.15.156:0/4064144248 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51400a0a70 msgr2=0x7f51400a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:36.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.502+0000 7f5146682700 1 --2- 172.21.15.156:0/4064144248 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51400a0a70 0x7f51400a0e40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5130009920 tx=0x7f5130009c30 comp rx=0 tx=0).stop 2023-09-30T22:20:36.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.503+0000 7f5146682700 1 -- 172.21.15.156:0/4064144248 shutdown_connections 2023-09-30T22:20:36.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.503+0000 7f5146682700 1 --2- 172.21.15.156:0/4064144248 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51400a0a70 0x7f51400a0e40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.503+0000 7f5146682700 1 --2- 172.21.15.156:0/4064144248 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f51400a1380 0x7f5140133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.503+0000 7f5146682700 1 -- 172.21.15.156:0/4064144248 >> 172.21.15.156:0/4064144248 conn(0x7f51400a6610 msgr2=0x7f51400a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:36.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.503+0000 7f5146682700 1 -- 172.21.15.156:0/4064144248 shutdown_connections 2023-09-30T22:20:36.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.503+0000 7f5146682700 1 -- 172.21.15.156:0/4064144248 wait complete. 2023-09-30T22:20:36.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.504+0000 7f5146682700 1 Processor -- start 2023-09-30T22:20:36.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.504+0000 7f5146682700 1 -- start start 2023-09-30T22:20:36.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.505+0000 7f5146682700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f51400a0a70 0x7f5140122870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:36.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.505+0000 7f5146682700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51400a1380 0x7f5140122db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:36.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.505+0000 7f5146682700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5140133f50 0x7f51401232f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:36.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.505+0000 7f5146682700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51401260b0 con 0x7f5140133f50 2023-09-30T22:20:36.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.505+0000 7f5146682700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5140133390 con 0x7f51400a1380 2023-09-30T22:20:36.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.505+0000 7f5146682700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5140133aa0 con 0x7f51400a0a70 2023-09-30T22:20:36.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.505+0000 7f513ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f51400a0a70 0x7f5140122870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:36.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.505+0000 7f513ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f51400a0a70 0x7f5140122870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54864/0 (socket says 172.21.15.156:54864) 2023-09-30T22:20:36.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.505+0000 7f513ffff700 1 -- 172.21.15.156:0/2007273887 learned_addr learned my addr 172.21.15.156:0/2007273887 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:36.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.505+0000 7f5144c1f700 1 --2- 172.21.15.156:0/2007273887 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5140133f50 0x7f51401232f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:36.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.505+0000 7f513f7fe700 1 --2- 172.21.15.156:0/2007273887 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51400a1380 0x7f5140122db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:36.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.505+0000 7f5144c1f700 1 -- 172.21.15.156:0/2007273887 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f51400a0a70 msgr2=0x7f5140122870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:36.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.505+0000 7f5144c1f700 1 --2- 172.21.15.156:0/2007273887 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f51400a0a70 0x7f5140122870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.505+0000 7f5144c1f700 1 -- 172.21.15.156:0/2007273887 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51400a1380 msgr2=0x7f5140122db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:36.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.505+0000 7f5144c1f700 1 --2- 172.21.15.156:0/2007273887 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51400a1380 0x7f5140122db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.505+0000 7f5144c1f700 1 -- 172.21.15.156:0/2007273887 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51340094a0 con 0x7f5140133f50 2023-09-30T22:20:36.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.505+0000 7f513f7fe700 1 --2- 172.21.15.156:0/2007273887 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51400a1380 0x7f5140122db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:36.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.505+0000 7f5144c1f700 1 --2- 172.21.15.156:0/2007273887 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5140133f50 0x7f51401232f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f513800c730 tx=0x7f513800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:36.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.505+0000 7f513cff9700 1 -- 172.21.15.156:0/2007273887 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5138003e30 con 0x7f5140133f50 2023-09-30T22:20:36.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.505+0000 7f513cff9700 1 -- 172.21.15.156:0/2007273887 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5138005070 con 0x7f5140133f50 2023-09-30T22:20:36.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.505+0000 7f513cff9700 1 -- 172.21.15.156:0/2007273887 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5138005420 con 0x7f5140133f50 2023-09-30T22:20:36.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.506+0000 7f5146682700 1 -- 172.21.15.156:0/2007273887 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5130009550 con 0x7f5140133f50 2023-09-30T22:20:36.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.506+0000 7f5146682700 1 -- 172.21.15.156:0/2007273887 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51401337c0 con 0x7f5140133f50 2023-09-30T22:20:36.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.506+0000 7f513cff9700 1 -- 172.21.15.156:0/2007273887 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5138005580 con 0x7f5140133f50 2023-09-30T22:20:36.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.506+0000 7f513cff9700 1 -- 172.21.15.156:0/2007273887 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f513803f1c0 con 0x7f5140133f50 2023-09-30T22:20:36.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.507+0000 7f5146682700 1 -- 172.21.15.156:0/2007273887 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514004f2a0 con 0x7f5140133f50 2023-09-30T22:20:36.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.512+0000 7f513cff9700 1 -- 172.21.15.156:0/2007273887 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5138010300 con 0x7f5140133f50 2023-09-30T22:20:36.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.580+0000 7f8d5009a700 1 -- 172.21.15.156:0/4192302366 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8d48130420 con 0x7f8d4809e170 2023-09-30T22:20:36.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.580+0000 7f8d3e7fc700 1 -- 172.21.15.156:0/4192302366 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8d38017020 con 0x7f8d4809e170 2023-09-30T22:20:36.580 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:36.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.583+0000 7f8d5009a700 1 -- 172.21.15.156:0/4192302366 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d4809e170 msgr2=0x7f8d4811eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:36.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.583+0000 7f8d5009a700 1 --2- 172.21.15.156:0/4192302366 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d4809e170 0x7f8d4811eae0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8d3800c4d0 tx=0x7f8d3800c7e0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.583+0000 7f8d5009a700 1 -- 172.21.15.156:0/4192302366 shutdown_connections 2023-09-30T22:20:36.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.583+0000 7f8d5009a700 1 --2- 172.21.15.156:0/4192302366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d48130eb0 0x7f8d4811f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.583+0000 7f8d5009a700 1 --2- 172.21.15.156:0/4192302366 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d4809d860 0x7f8d4811e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.583+0000 7f8d5009a700 1 --2- 172.21.15.156:0/4192302366 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d4809e170 0x7f8d4811eae0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.583+0000 7f8d5009a700 1 -- 172.21.15.156:0/4192302366 >> 172.21.15.156:0/4192302366 conn(0x7f8d48099c40 msgr2=0x7f8d48070f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:36.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.583+0000 7f8d5009a700 1 -- 172.21.15.156:0/4192302366 shutdown_connections 2023-09-30T22:20:36.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.583+0000 7f8d5009a700 1 -- 172.21.15.156:0/4192302366 wait complete. 2023-09-30T22:20:36.597 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:36.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.674+0000 7f3511a1c700 1 -- 172.21.15.156:0/1368024838 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f350c11fab0 con 0x7f350c1309f0 2023-09-30T22:20:36.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.674+0000 7f34f3fff700 1 -- 172.21.15.156:0/1368024838 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3500015030 con 0x7f350c1309f0 2023-09-30T22:20:36.674 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:36.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.676+0000 7f3511a1c700 1 -- 172.21.15.156:0/1368024838 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f350c1309f0 msgr2=0x7f350c11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:36.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.676+0000 7f3511a1c700 1 --2- 172.21.15.156:0/1368024838 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f350c1309f0 0x7f350c11df80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3500000c00 tx=0x7f3500004750 comp rx=0 tx=0).stop 2023-09-30T22:20:36.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.676+0000 7f3511a1c700 1 -- 172.21.15.156:0/1368024838 shutdown_connections 2023-09-30T22:20:36.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.676+0000 7f3511a1c700 1 --2- 172.21.15.156:0/1368024838 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f350c133ad0 0x7f350c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.676+0000 7f3511a1c700 1 --2- 172.21.15.156:0/1368024838 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350c1300a0 0x7f350c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.676+0000 7f3511a1c700 1 --2- 172.21.15.156:0/1368024838 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f350c1309f0 0x7f350c11df80 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.677+0000 7f3511a1c700 1 -- 172.21.15.156:0/1368024838 >> 172.21.15.156:0/1368024838 conn(0x7f350c099c40 msgr2=0x7f350c131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:36.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.677+0000 7f3511a1c700 1 -- 172.21.15.156:0/1368024838 shutdown_connections 2023-09-30T22:20:36.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.677+0000 7f3511a1c700 1 -- 172.21.15.156:0/1368024838 wait complete. 2023-09-30T22:20:36.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.683+0000 7feecf926700 1 -- 172.21.15.156:0/3842858658 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7feec811dc60 con 0x7feec809d860 2023-09-30T22:20:36.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.684+0000 7feebdffb700 1 -- 172.21.15.156:0/3842858658 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feec402a020 con 0x7feec809d860 2023-09-30T22:20:36.683 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:36.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.686+0000 7feecf926700 1 -- 172.21.15.156:0/3842858658 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feec809d860 msgr2=0x7feec81379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:36.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.686+0000 7feecf926700 1 --2- 172.21.15.156:0/3842858658 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feec809d860 0x7feec81379f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7feec4009840 tx=0x7feec4004750 comp rx=0 tx=0).stop 2023-09-30T22:20:36.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.686+0000 7feecf926700 1 -- 172.21.15.156:0/3842858658 shutdown_connections 2023-09-30T22:20:36.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.686+0000 7feecf926700 1 --2- 172.21.15.156:0/3842858658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feec8130ce0 0x7feec8138470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.686+0000 7feecf926700 1 --2- 172.21.15.156:0/3842858658 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feec809d860 0x7feec81379f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.686+0000 7feecf926700 1 --2- 172.21.15.156:0/3842858658 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feec809e170 0x7feec8137f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.686+0000 7feecf926700 1 -- 172.21.15.156:0/3842858658 >> 172.21.15.156:0/3842858658 conn(0x7feec8099c40 msgr2=0x7feec80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:36.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.686+0000 7feecf926700 1 -- 172.21.15.156:0/3842858658 shutdown_connections 2023-09-30T22:20:36.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.686+0000 7feecf926700 1 -- 172.21.15.156:0/3842858658 wait complete. 2023-09-30T22:20:36.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:36.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:36.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.734+0000 7f5146682700 1 -- 172.21.15.156:0/2007273887 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5140124c30 con 0x7f5140133f50 2023-09-30T22:20:36.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.734+0000 7f513cff9700 1 -- 172.21.15.156:0/2007273887 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5138019ab0 con 0x7f5140133f50 2023-09-30T22:20:36.734 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:36.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.736+0000 7f5146682700 1 -- 172.21.15.156:0/2007273887 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5140133f50 msgr2=0x7f51401232f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:36.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.736+0000 7f5146682700 1 --2- 172.21.15.156:0/2007273887 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5140133f50 0x7f51401232f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f513800c730 tx=0x7f513800ca40 comp rx=0 tx=0).stop 2023-09-30T22:20:36.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.736+0000 7f5146682700 1 -- 172.21.15.156:0/2007273887 shutdown_connections 2023-09-30T22:20:36.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.736+0000 7f5146682700 1 --2- 172.21.15.156:0/2007273887 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5140133f50 0x7f51401232f0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.736+0000 7f5146682700 1 --2- 172.21.15.156:0/2007273887 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f51400a0a70 0x7f5140122870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.736+0000 7f5146682700 1 --2- 172.21.15.156:0/2007273887 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51400a1380 0x7f5140122db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:36.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.736+0000 7f5146682700 1 -- 172.21.15.156:0/2007273887 >> 172.21.15.156:0/2007273887 conn(0x7f51400a6610 msgr2=0x7f514009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:36.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.736+0000 7f5146682700 1 -- 172.21.15.156:0/2007273887 shutdown_connections 2023-09-30T22:20:36.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:36.736+0000 7f5146682700 1 -- 172.21.15.156:0/2007273887 wait complete. 2023-09-30T22:20:36.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:37.597 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:37.690 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:37.704 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:37.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.739+0000 7fb36dc0f700 1 Processor -- start 2023-09-30T22:20:37.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.739+0000 7fb36dc0f700 1 -- start start 2023-09-30T22:20:37.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.739+0000 7fb36dc0f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb368136950 0x7fb368138d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:37.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.739+0000 7fb36dc0f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb368139270 0x7fb36813b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:37.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.739+0000 7fb36dc0f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb368133640 con 0x7fb368133a70 2023-09-30T22:20:37.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.739+0000 7fb36dc0f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680a1d50 con 0x7fb368139270 2023-09-30T22:20:37.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.739+0000 7fb36dc0f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb368134550 con 0x7fb368136950 2023-09-30T22:20:37.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.739+0000 7fb3677fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb368133a70 0x7fb368133e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:60682/0 (socket says 172.21.15.156:60682) 2023-09-30T22:20:37.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.740+0000 7fb3677fe700 1 -- 172.21.15.156:0/2078295313 learned_addr learned my addr 172.21.15.156:0/2078295313 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:37.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.740+0000 7fb366ffd700 1 --2- 172.21.15.156:0/2078295313 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb368136950 0x7fb368138d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:37.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.740+0000 7fb367fff700 1 --2- 172.21.15.156:0/2078295313 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb368139270 0x7fb36813b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:37.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.740+0000 7fb3667fc700 1 -- 172.21.15.156:0/2078295313 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1844510233 0 0) 0x7fb368133640 con 0x7fb368133a70 2023-09-30T22:20:37.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.740+0000 7fb3667fc700 1 -- 172.21.15.156:0/2078295313 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3500035b0 con 0x7fb368133a70 2023-09-30T22:20:37.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.740+0000 7fb367fff700 1 -- 172.21.15.156:0/2078295313 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb368136950 msgr2=0x7fb368138d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:37.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.740+0000 7fb367fff700 1 --2- 172.21.15.156:0/2078295313 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb368136950 0x7fb368138d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:37.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.740+0000 7fb367fff700 1 -- 172.21.15.156:0/2078295313 >> v1:172.21.15.156:6789/0 conn(0x7fb368133a70 legacy=0x7fb368133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:37.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.740+0000 7fb367fff700 1 -- 172.21.15.156:0/2078295313 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36809b620 con 0x7fb368139270 2023-09-30T22:20:37.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.740+0000 7fb366ffd700 1 --2- 172.21.15.156:0/2078295313 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb368136950 0x7fb368138d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:37.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.740+0000 7fb367fff700 1 --2- 172.21.15.156:0/2078295313 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb368139270 0x7fb36813b650 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb360009dc0 tx=0x7fb36000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d0cf3a2666bea1b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:37.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.740+0000 7fb3667fc700 1 -- 172.21.15.156:0/2078295313 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36000e070 con 0x7fb368139270 2023-09-30T22:20:37.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.740+0000 7fb3667fc700 1 -- 172.21.15.156:0/2078295313 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36000bb20 con 0x7fb368139270 2023-09-30T22:20:37.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.740+0000 7fb3667fc700 1 -- 172.21.15.156:0/2078295313 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb360012430 con 0x7fb368139270 2023-09-30T22:20:37.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.741+0000 7fb36dc0f700 1 -- 172.21.15.156:0/2078295313 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb368139270 msgr2=0x7fb36813b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:37.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.741+0000 7fb36dc0f700 1 --2- 172.21.15.156:0/2078295313 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb368139270 0x7fb36813b650 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb360009dc0 tx=0x7fb36000b330 comp rx=0 tx=0).stop 2023-09-30T22:20:37.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.741+0000 7fb36dc0f700 1 -- 172.21.15.156:0/2078295313 shutdown_connections 2023-09-30T22:20:37.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.741+0000 7fb36dc0f700 1 --2- 172.21.15.156:0/2078295313 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb368139270 0x7fb36813b650 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:37.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.741+0000 7fb36dc0f700 1 --2- 172.21.15.156:0/2078295313 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb368136950 0x7fb368138d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:37.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.741+0000 7fb36dc0f700 1 -- 172.21.15.156:0/2078295313 >> 172.21.15.156:0/2078295313 conn(0x7fb3680a2980 msgr2=0x7fb3680a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:37.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.741+0000 7fb36dc0f700 1 -- 172.21.15.156:0/2078295313 shutdown_connections 2023-09-30T22:20:37.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.741+0000 7fb36dc0f700 1 -- 172.21.15.156:0/2078295313 wait complete. 2023-09-30T22:20:37.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.742+0000 7fb36dc0f700 1 Processor -- start 2023-09-30T22:20:37.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.742+0000 7fb36dc0f700 1 -- start start 2023-09-30T22:20:37.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.743+0000 7fb36dc0f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb368133a70 0x7fb368119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:37.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.743+0000 7fb36dc0f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb368136950 0x7fb36811a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:37.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.743+0000 7fb36dc0f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb368139270 0x7fb36811a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:37.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.743+0000 7fb36dc0f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36812f810 con 0x7fb368139270 2023-09-30T22:20:37.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.743+0000 7fb36dc0f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb368138dd0 con 0x7fb368133a70 2023-09-30T22:20:37.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.743+0000 7fb36dc0f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb36809a350 con 0x7fb368136950 2023-09-30T22:20:37.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.743+0000 7fb3677fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb368133a70 0x7fb368119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:37.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.743+0000 7fb367fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb368139270 0x7fb36811a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:37.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.743+0000 7fb3677fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb368133a70 0x7fb368119f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59738/0 (socket says 172.21.15.156:59738) 2023-09-30T22:20:37.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.743+0000 7fb367fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb368139270 0x7fb36811a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49206/0 (socket says 172.21.15.156:49206) 2023-09-30T22:20:37.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.743+0000 7fb3677fe700 1 -- 172.21.15.156:0/658322233 learned_addr learned my addr 172.21.15.156:0/658322233 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:37.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.743+0000 7fb366ffd700 1 --2- 172.21.15.156:0/658322233 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb368136950 0x7fb36811a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:37.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.743+0000 7fb367fff700 1 -- 172.21.15.156:0/658322233 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb368136950 msgr2=0x7fb36811a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:37.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.743+0000 7fb367fff700 1 --2- 172.21.15.156:0/658322233 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb368136950 0x7fb36811a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:37.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.743+0000 7fb367fff700 1 -- 172.21.15.156:0/658322233 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb368133a70 msgr2=0x7fb368119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:37.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.743+0000 7fb367fff700 1 --2- 172.21.15.156:0/658322233 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb368133a70 0x7fb368119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:37.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.743+0000 7fb367fff700 1 -- 172.21.15.156:0/658322233 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35c0094a0 con 0x7fb368139270 2023-09-30T22:20:37.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.743+0000 7fb366ffd700 1 --2- 172.21.15.156:0/658322233 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb368136950 0x7fb36811a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:37.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.743+0000 7fb3677fe700 1 --2- 172.21.15.156:0/658322233 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb368133a70 0x7fb368119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:37.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.744+0000 7fb367fff700 1 --2- 172.21.15.156:0/658322233 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb368139270 0x7fb36811a980 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb360016000 tx=0x7fb360004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:37.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.744+0000 7fb34ffff700 1 -- 172.21.15.156:0/658322233 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb360012430 con 0x7fb368139270 2023-09-30T22:20:37.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.744+0000 7fb34ffff700 1 -- 172.21.15.156:0/658322233 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb360020070 con 0x7fb368139270 2023-09-30T22:20:37.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.744+0000 7fb36dc0f700 1 -- 172.21.15.156:0/658322233 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb360009a70 con 0x7fb368139270 2023-09-30T22:20:37.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.744+0000 7fb34ffff700 1 -- 172.21.15.156:0/658322233 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb360012e60 con 0x7fb368139270 2023-09-30T22:20:37.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.744+0000 7fb36dc0f700 1 -- 172.21.15.156:0/658322233 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb36811d590 con 0x7fb368139270 2023-09-30T22:20:37.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.745+0000 7fb34ffff700 1 -- 172.21.15.156:0/658322233 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb360004040 con 0x7fb368139270 2023-09-30T22:20:37.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.745+0000 7fb34ffff700 1 -- 172.21.15.156:0/658322233 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb360022070 con 0x7fb368139270 2023-09-30T22:20:37.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.745+0000 7fb36dc0f700 1 -- 172.21.15.156:0/658322233 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb36804f2a0 con 0x7fb368139270 2023-09-30T22:20:37.749 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:37.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.750+0000 7fb34ffff700 1 -- 172.21.15.156:0/658322233 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb360003e30 con 0x7fb368139270 2023-09-30T22:20:37.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.833+0000 7f0cf73d3700 1 Processor -- start 2023-09-30T22:20:37.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.834+0000 7f0cf73d3700 1 -- start start 2023-09-30T22:20:37.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.834+0000 7f0cf73d3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0cf009d860 0x7f0cf009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:37.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.834+0000 7f0cf73d3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0cf009e170 0x7f0cf01307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:37.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.834+0000 7f0cf73d3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0cf0130ce0 0x7f0cf0131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:37.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.834+0000 7f0cf73d3700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf009aaa0 con 0x7f0cf0130ce0 2023-09-30T22:20:37.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.834+0000 7f0cf73d3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf009f870 con 0x7f0cf009d860 2023-09-30T22:20:37.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.834+0000 7f0cf73d3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf009b360 con 0x7f0cf009e170 2023-09-30T22:20:37.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.834+0000 7f0cf516f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0cf009d860 0x7f0cf009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:37.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.834+0000 7f0cf516f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0cf009d860 0x7f0cf009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59746/0 (socket says 172.21.15.156:59746) 2023-09-30T22:20:37.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.834+0000 7f0cf516f700 1 -- 172.21.15.156:0/3464767763 learned_addr learned my addr 172.21.15.156:0/3464767763 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:37.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.834+0000 7f0cf496e700 1 --2- 172.21.15.156:0/3464767763 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0cf009e170 0x7f0cf01307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:37.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.835+0000 7f0cf516f700 1 -- 172.21.15.156:0/3464767763 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0cf009e170 msgr2=0x7f0cf01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:37.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.835+0000 7f0cf516f700 1 --2- 172.21.15.156:0/3464767763 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0cf009e170 0x7f0cf01307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:37.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.835+0000 7f0cf5970700 1 --2- 172.21.15.156:0/3464767763 >> v2:172.21.15.156:3300/0 conn(0x7f0cf0130ce0 0x7f0cf0131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:37.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.835+0000 7f0cf516f700 1 -- 172.21.15.156:0/3464767763 >> v2:172.21.15.156:3300/0 conn(0x7f0cf0130ce0 msgr2=0x7f0cf0131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:37.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.835+0000 7f0cf516f700 1 --2- 172.21.15.156:0/3464767763 >> v2:172.21.15.156:3300/0 conn(0x7f0cf0130ce0 0x7f0cf0131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:37.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.835+0000 7f0cf516f700 1 -- 172.21.15.156:0/3464767763 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf009b620 con 0x7f0cf009d860 2023-09-30T22:20:37.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.835+0000 7f0cf5970700 1 --2- 172.21.15.156:0/3464767763 >> v2:172.21.15.156:3300/0 conn(0x7f0cf0130ce0 0x7f0cf0131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:20:37.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.835+0000 7f0cf516f700 1 --2- 172.21.15.156:0/3464767763 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0cf009d860 0x7f0cf009dc30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0cec00bb90 tx=0x7f0cec00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb7fcaac37a9faf2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:37.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.835+0000 7f0ce7fff700 1 -- 172.21.15.156:0/3464767763 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec00dd30 con 0x7f0cf009d860 2023-09-30T22:20:37.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.835+0000 7f0ce7fff700 1 -- 172.21.15.156:0/3464767763 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec00de90 con 0x7f0cf009d860 2023-09-30T22:20:37.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.835+0000 7f0ce7fff700 1 -- 172.21.15.156:0/3464767763 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec010690 con 0x7f0cf009d860 2023-09-30T22:20:37.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.836+0000 7f0cf73d3700 1 -- 172.21.15.156:0/3464767763 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0cf009d860 msgr2=0x7f0cf009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:37.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.836+0000 7f0cf73d3700 1 --2- 172.21.15.156:0/3464767763 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0cf009d860 0x7f0cf009dc30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0cec00bb90 tx=0x7f0cec00bea0 comp rx=0 tx=0).stop 2023-09-30T22:20:37.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.836+0000 7f0cf73d3700 1 -- 172.21.15.156:0/3464767763 shutdown_connections 2023-09-30T22:20:37.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.836+0000 7f0cf73d3700 1 --2- 172.21.15.156:0/3464767763 >> v2:172.21.15.156:3300/0 conn(0x7f0cf0130ce0 0x7f0cf0131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:37.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.836+0000 7f0cf73d3700 1 --2- 172.21.15.156:0/3464767763 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0cf009d860 0x7f0cf009dc30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:37.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.836+0000 7f0cf73d3700 1 --2- 172.21.15.156:0/3464767763 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0cf009e170 0x7f0cf01307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:37.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.836+0000 7f0cf73d3700 1 -- 172.21.15.156:0/3464767763 >> 172.21.15.156:0/3464767763 conn(0x7f0cf0099c40 msgr2=0x7f0cf00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:37.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.836+0000 7f0cf73d3700 1 -- 172.21.15.156:0/3464767763 shutdown_connections 2023-09-30T22:20:37.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.836+0000 7f0cf73d3700 1 -- 172.21.15.156:0/3464767763 wait complete. 2023-09-30T22:20:37.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.837+0000 7f0cf73d3700 1 Processor -- start 2023-09-30T22:20:37.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.837+0000 7f0cf73d3700 1 -- start start 2023-09-30T22:20:37.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.838+0000 7f0cf73d3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0cf009d860 0x7f0cf011be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:37.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.838+0000 7f0cf73d3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0cf009e170 0x7f0cf011c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:37.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.838+0000 7f0cf73d3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0cf0130ce0 0x7f0cf011c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:37.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.838+0000 7f0cf73d3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf011f210 con 0x7f0cf0130ce0 2023-09-30T22:20:37.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.838+0000 7f0cf73d3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf011db30 con 0x7f0cf009d860 2023-09-30T22:20:37.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.838+0000 7f0cf73d3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf011f6c0 con 0x7f0cf009e170 2023-09-30T22:20:37.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.838+0000 7f0cf5970700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0cf0130ce0 0x7f0cf011c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:37.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.838+0000 7f0cf5970700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0cf0130ce0 0x7f0cf011c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49228/0 (socket says 172.21.15.156:49228) 2023-09-30T22:20:37.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.838+0000 7f0cf5970700 1 -- 172.21.15.156:0/3443151306 learned_addr learned my addr 172.21.15.156:0/3443151306 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:37.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.838+0000 7f0cf516f700 1 --2- 172.21.15.156:0/3443151306 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0cf009d860 0x7f0cf011be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:37.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.838+0000 7f0cf496e700 1 --2- 172.21.15.156:0/3443151306 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0cf009e170 0x7f0cf011c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:37.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.839+0000 7f0cf516f700 1 -- 172.21.15.156:0/3443151306 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0cf009e170 msgr2=0x7f0cf011c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:37.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.839+0000 7f0cf516f700 1 --2- 172.21.15.156:0/3443151306 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0cf009e170 0x7f0cf011c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:37.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.839+0000 7f0cf516f700 1 -- 172.21.15.156:0/3443151306 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0cf0130ce0 msgr2=0x7f0cf011c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:37.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.839+0000 7f0cf516f700 1 --2- 172.21.15.156:0/3443151306 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0cf0130ce0 0x7f0cf011c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:37.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.839+0000 7f0cf516f700 1 -- 172.21.15.156:0/3443151306 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec00b7f0 con 0x7f0cf009d860 2023-09-30T22:20:37.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.839+0000 7f0cf496e700 1 --2- 172.21.15.156:0/3443151306 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0cf009e170 0x7f0cf011c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:20:37.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.839+0000 7f0cf5970700 1 --2- 172.21.15.156:0/3443151306 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0cf0130ce0 0x7f0cf011c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:37.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.839+0000 7f0cf516f700 1 --2- 172.21.15.156:0/3443151306 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0cf009d860 0x7f0cf011be80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0cec018000 tx=0x7f0cec004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:37.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.839+0000 7f0ce5ffb700 1 -- 172.21.15.156:0/3443151306 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec01f070 con 0x7f0cf009d860 2023-09-30T22:20:37.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.839+0000 7f0ce5ffb700 1 -- 172.21.15.156:0/3443151306 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec003970 con 0x7f0cf009d860 2023-09-30T22:20:37.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.839+0000 7f0cf73d3700 1 -- 172.21.15.156:0/3443151306 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf00a2240 con 0x7f0cf009d860 2023-09-30T22:20:37.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.839+0000 7f0ce5ffb700 1 -- 172.21.15.156:0/3443151306 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec003d20 con 0x7f0cf009d860 2023-09-30T22:20:37.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.839+0000 7f0cf73d3700 1 -- 172.21.15.156:0/3443151306 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf011f9a0 con 0x7f0cf009d860 2023-09-30T22:20:37.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.841+0000 7f0cdb7fe700 1 -- 172.21.15.156:0/3443151306 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf009a5b0 con 0x7f0cf009d860 2023-09-30T22:20:37.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.841+0000 7f0ce5ffb700 1 -- 172.21.15.156:0/3443151306 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0cec010470 con 0x7f0cf009d860 2023-09-30T22:20:37.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.841+0000 7f0ce5ffb700 1 -- 172.21.15.156:0/3443151306 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0cec042a30 con 0x7f0cf009d860 2023-09-30T22:20:37.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.849+0000 7f0ce5ffb700 1 -- 172.21.15.156:0/3443151306 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0cec010720 con 0x7f0cf009d860 2023-09-30T22:20:37.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.870+0000 7fe4a9953700 1 Processor -- start 2023-09-30T22:20:37.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.870+0000 7fe4a9953700 1 -- start start 2023-09-30T22:20:37.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.870+0000 7fe4a9953700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe4a4132100 0x7fe4a41367d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:37.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.870+0000 7fe4a9953700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4a41314b0 0x7fe4a4138d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:37.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.870+0000 7fe4a9953700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a40a0f20 con 0x7fe4a4066410 2023-09-30T22:20:37.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.870+0000 7fe4a9953700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a40667e0 con 0x7fe4a4132100 2023-09-30T22:20:37.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.870+0000 7fe4a9953700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a40a23c0 con 0x7fe4a41314b0 2023-09-30T22:20:37.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.871+0000 7fe4a37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4a41314b0 0x7fe4a4138d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:37.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.871+0000 7fe4a37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4a41314b0 0x7fe4a4138d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59776/0 (socket says 172.21.15.156:59776) 2023-09-30T22:20:37.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.871+0000 7fe4a37fe700 1 -- 172.21.15.156:0/2681353710 learned_addr learned my addr 172.21.15.156:0/2681353710 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:37.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.871+0000 7fe4a27fc700 1 --2- 172.21.15.156:0/2681353710 >> v2:172.21.15.156:3300/0 conn(0x7fe4a4132100 0x7fe4a41367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:37.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.871+0000 7fe4a27fc700 1 -- 172.21.15.156:0/2681353710 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4a41314b0 msgr2=0x7fe4a4138d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:37.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.871+0000 7fe4a27fc700 1 --2- 172.21.15.156:0/2681353710 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4a41314b0 0x7fe4a4138d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:37.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.871+0000 7fe4a27fc700 1 -- 172.21.15.156:0/2681353710 >> v1:172.21.15.156:6789/0 conn(0x7fe4a4066410 legacy=0x7fe4a41319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:37.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.871+0000 7fe4a27fc700 1 -- 172.21.15.156:0/2681353710 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a40a16e0 con 0x7fe4a4132100 2023-09-30T22:20:37.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.871+0000 7fe4a1ffb700 1 -- 172.21.15.156:0/2681353710 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2596092695 0 0) 0x7fe4a40a0f20 con 0x7fe4a4066410 2023-09-30T22:20:37.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.871+0000 7fe4a37fe700 1 --2- 172.21.15.156:0/2681353710 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4a41314b0 0x7fe4a4138d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:37.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.871+0000 7fe4a27fc700 1 --2- 172.21.15.156:0/2681353710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4a4132100 0x7fe4a41367d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe498009870 tx=0x7fe498009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dedda885d95654f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:37.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.871+0000 7fe4a1ffb700 1 -- 172.21.15.156:0/2681353710 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe498011830 con 0x7fe4a4132100 2023-09-30T22:20:37.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.871+0000 7fe4a1ffb700 1 -- 172.21.15.156:0/2681353710 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe498011990 con 0x7fe4a4132100 2023-09-30T22:20:37.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.871+0000 7fe4a1ffb700 1 -- 172.21.15.156:0/2681353710 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe498011d20 con 0x7fe4a4132100 2023-09-30T22:20:37.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.872+0000 7fe4a9953700 1 -- 172.21.15.156:0/2681353710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4a4132100 msgr2=0x7fe4a41367d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:37.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.872+0000 7fe4a9953700 1 --2- 172.21.15.156:0/2681353710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4a4132100 0x7fe4a41367d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe498009870 tx=0x7fe498009b80 comp rx=0 tx=0).stop 2023-09-30T22:20:37.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.872+0000 7fe4a9953700 1 -- 172.21.15.156:0/2681353710 shutdown_connections 2023-09-30T22:20:37.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.872+0000 7fe4a9953700 1 --2- 172.21.15.156:0/2681353710 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4a41314b0 0x7fe4a4138d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:37.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.872+0000 7fe4a9953700 1 --2- 172.21.15.156:0/2681353710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4a4132100 0x7fe4a41367d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:37.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.872+0000 7fe4a9953700 1 -- 172.21.15.156:0/2681353710 >> 172.21.15.156:0/2681353710 conn(0x7fe4a40a2980 msgr2=0x7fe4a40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:37.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.872+0000 7fe4a9953700 1 -- 172.21.15.156:0/2681353710 shutdown_connections 2023-09-30T22:20:37.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.872+0000 7fe4a9953700 1 -- 172.21.15.156:0/2681353710 wait complete. 2023-09-30T22:20:37.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.873+0000 7fe4a9953700 1 Processor -- start 2023-09-30T22:20:37.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.874+0000 7fe4a9953700 1 -- start start 2023-09-30T22:20:37.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.874+0000 7fe4a9953700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4a4066410 0x7fe4a41c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:37.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.874+0000 7fe4a9953700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4a41314b0 0x7fe4a41c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:37.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.874+0000 7fe4a9953700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4a4132100 0x7fe4a4099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:37.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.874+0000 7fe4a9953700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a41385c0 con 0x7fe4a41314b0 2023-09-30T22:20:37.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.874+0000 7fe4a9953700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a4137090 con 0x7fe4a4066410 2023-09-30T22:20:37.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.874+0000 7fe4a9953700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a4136630 con 0x7fe4a4132100 2023-09-30T22:20:37.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.874+0000 7fe4a2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4a4066410 0x7fe4a41c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:37.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.874+0000 7fe4a2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4a4066410 0x7fe4a41c8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59784/0 (socket says 172.21.15.156:59784) 2023-09-30T22:20:37.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.874+0000 7fe4a2ffd700 1 -- 172.21.15.156:0/1972582084 learned_addr learned my addr 172.21.15.156:0/1972582084 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:37.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.875+0000 7fe4a27fc700 1 --2- 172.21.15.156:0/1972582084 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4a41314b0 0x7fe4a41c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:37.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.875+0000 7fe4a2ffd700 1 -- 172.21.15.156:0/1972582084 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4a4132100 msgr2=0x7fe4a4099a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:37.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.875+0000 7fe4a2ffd700 1 --2- 172.21.15.156:0/1972582084 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4a4132100 0x7fe4a4099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:37.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.875+0000 7fe4a2ffd700 1 -- 172.21.15.156:0/1972582084 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4a41314b0 msgr2=0x7fe4a41c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:37.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.875+0000 7fe4a2ffd700 1 --2- 172.21.15.156:0/1972582084 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4a41314b0 0x7fe4a41c8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:37.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.875+0000 7fe4a2ffd700 1 -- 172.21.15.156:0/1972582084 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c009b30 con 0x7fe4a4066410 2023-09-30T22:20:37.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.875+0000 7fe4a27fc700 1 --2- 172.21.15.156:0/1972582084 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4a41314b0 0x7fe4a41c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:37.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.875+0000 7fe4a2ffd700 1 --2- 172.21.15.156:0/1972582084 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4a4066410 0x7fe4a41c8900 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe49400c580 tx=0x7fe49400c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:37.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.875+0000 7fe48bfff700 1 -- 172.21.15.156:0/1972582084 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4940054e0 con 0x7fe4a4066410 2023-09-30T22:20:37.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.875+0000 7fe48bfff700 1 -- 172.21.15.156:0/1972582084 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe494003680 con 0x7fe4a4066410 2023-09-30T22:20:37.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.875+0000 7fe4a9953700 1 -- 172.21.15.156:0/1972582084 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4980094a0 con 0x7fe4a4066410 2023-09-30T22:20:37.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.875+0000 7fe4a9953700 1 -- 172.21.15.156:0/1972582084 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a4137a00 con 0x7fe4a4066410 2023-09-30T22:20:37.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.875+0000 7fe48bfff700 1 -- 172.21.15.156:0/1972582084 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494003a30 con 0x7fe4a4066410 2023-09-30T22:20:37.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.876+0000 7fe48bfff700 1 -- 172.21.15.156:0/1972582084 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe494003b90 con 0x7fe4a4066410 2023-09-30T22:20:37.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.876+0000 7fe4a9953700 1 -- 172.21.15.156:0/1972582084 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4840052e0 con 0x7fe4a4066410 2023-09-30T22:20:37.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.876+0000 7fe48bfff700 1 -- 172.21.15.156:0/1972582084 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe49403ec20 con 0x7fe4a4066410 2023-09-30T22:20:37.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.881+0000 7fe48bfff700 1 -- 172.21.15.156:0/1972582084 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe494003e40 con 0x7fe4a4066410 2023-09-30T22:20:37.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.902+0000 7fd3b2cfd700 1 Processor -- start 2023-09-30T22:20:37.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.902+0000 7fd3b2cfd700 1 -- start start 2023-09-30T22:20:37.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.903+0000 7fd3b2cfd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd3ac09d860 0x7fd3ac09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:37.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.903+0000 7fd3b2cfd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3ac09e170 0x7fd3ac1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:37.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.903+0000 7fd3b2cfd700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3ac09aaa0 con 0x7fd3ac130ce0 2023-09-30T22:20:37.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.903+0000 7fd3b2cfd700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3ac09f870 con 0x7fd3ac09d860 2023-09-30T22:20:37.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.903+0000 7fd3b2cfd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac09b360 con 0x7fd3ac09e170 2023-09-30T22:20:37.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.903+0000 7fd3b0a99700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd3ac09d860 0x7fd3ac09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:37.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.903+0000 7fd3b0a99700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd3ac09d860 0x7fd3ac09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49252/0 (socket says 172.21.15.156:49252) 2023-09-30T22:20:37.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.903+0000 7fd3b0a99700 1 -- 172.21.15.156:0/3965098863 learned_addr learned my addr 172.21.15.156:0/3965098863 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:37.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.903+0000 7fd3abfff700 1 --2- 172.21.15.156:0/3965098863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3ac09e170 0x7fd3ac1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:37.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.904+0000 7fd3b0a99700 1 -- 172.21.15.156:0/3965098863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3ac09e170 msgr2=0x7fd3ac1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:37.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.904+0000 7fd3b0a99700 1 --2- 172.21.15.156:0/3965098863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3ac09e170 0x7fd3ac1307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:37.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.904+0000 7fd3b0a99700 1 -- 172.21.15.156:0/3965098863 >> v1:172.21.15.156:6789/0 conn(0x7fd3ac130ce0 legacy=0x7fd3ac1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:37.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.904+0000 7fd3b0a99700 1 -- 172.21.15.156:0/3965098863 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ac09b620 con 0x7fd3ac09d860 2023-09-30T22:20:37.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.904+0000 7fd3b0a99700 1 --2- 172.21.15.156:0/3965098863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3ac09d860 0x7fd3ac09dc30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fd3a00098f0 tx=0x7fd3a0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a0523ba26e989e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:37.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.904+0000 7fd3ab7fe700 1 -- 172.21.15.156:0/3965098863 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0011830 con 0x7fd3ac09d860 2023-09-30T22:20:37.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.904+0000 7fd3ab7fe700 1 -- 172.21.15.156:0/3965098863 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a0011990 con 0x7fd3ac09d860 2023-09-30T22:20:37.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.904+0000 7fd3ab7fe700 1 -- 172.21.15.156:0/3965098863 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0011d20 con 0x7fd3ac09d860 2023-09-30T22:20:37.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.905+0000 7fd3b2cfd700 1 -- 172.21.15.156:0/3965098863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3ac09d860 msgr2=0x7fd3ac09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:37.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.905+0000 7fd3b2cfd700 1 --2- 172.21.15.156:0/3965098863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3ac09d860 0x7fd3ac09dc30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fd3a00098f0 tx=0x7fd3a0009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:37.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.905+0000 7fd3b2cfd700 1 -- 172.21.15.156:0/3965098863 shutdown_connections 2023-09-30T22:20:37.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.905+0000 7fd3b2cfd700 1 --2- 172.21.15.156:0/3965098863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3ac09d860 0x7fd3ac09dc30 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:37.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.905+0000 7fd3b2cfd700 1 --2- 172.21.15.156:0/3965098863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3ac09e170 0x7fd3ac1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:37.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.905+0000 7fd3b2cfd700 1 -- 172.21.15.156:0/3965098863 >> 172.21.15.156:0/3965098863 conn(0x7fd3ac099c40 msgr2=0x7fd3ac0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:37.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.905+0000 7fd3b2cfd700 1 -- 172.21.15.156:0/3965098863 shutdown_connections 2023-09-30T22:20:37.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.905+0000 7fd3b2cfd700 1 -- 172.21.15.156:0/3965098863 wait complete. 2023-09-30T22:20:37.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.906+0000 7fd3b2cfd700 1 Processor -- start 2023-09-30T22:20:37.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.906+0000 7fd3b2cfd700 1 -- start start 2023-09-30T22:20:37.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.907+0000 7fd3b2cfd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3ac09d860 0x7fd3ac12dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:37.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.907+0000 7fd3b2cfd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3ac09e170 0x7fd3ac12e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:37.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.907+0000 7fd3b2cfd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3ac130ce0 0x7fd3ac12e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:37.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.907+0000 7fd3b2cfd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac12f290 con 0x7fd3ac09d860 2023-09-30T22:20:37.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.907+0000 7fd3b2cfd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac12fab0 con 0x7fd3ac09e170 2023-09-30T22:20:37.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.907+0000 7fd3b2cfd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac1317d0 con 0x7fd3ac130ce0 2023-09-30T22:20:37.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.907+0000 7fd3b129a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3ac130ce0 0x7fd3ac12e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:37.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.908+0000 7fd3abfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3ac09e170 0x7fd3ac12e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:37.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.908+0000 7fd3b129a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3ac130ce0 0x7fd3ac12e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54934/0 (socket says 172.21.15.156:54934) 2023-09-30T22:20:37.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.908+0000 7fd3b129a700 1 -- 172.21.15.156:0/676746573 learned_addr learned my addr 172.21.15.156:0/676746573 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:37.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.908+0000 7fd3b0a99700 1 --2- 172.21.15.156:0/676746573 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3ac09d860 0x7fd3ac12dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:37.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.908+0000 7fd3b129a700 1 -- 172.21.15.156:0/676746573 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3ac09e170 msgr2=0x7fd3ac12e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:37.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.908+0000 7fd3b129a700 1 --2- 172.21.15.156:0/676746573 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3ac09e170 0x7fd3ac12e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:37.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.908+0000 7fd3b129a700 1 -- 172.21.15.156:0/676746573 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3ac09d860 msgr2=0x7fd3ac12dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:37.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.908+0000 7fd3b129a700 1 --2- 172.21.15.156:0/676746573 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3ac09d860 0x7fd3ac12dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:37.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.908+0000 7fd3b129a700 1 -- 172.21.15.156:0/676746573 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a0009550 con 0x7fd3ac130ce0 2023-09-30T22:20:37.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.908+0000 7fd3abfff700 1 --2- 172.21.15.156:0/676746573 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3ac09e170 0x7fd3ac12e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:37.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.908+0000 7fd3b129a700 1 --2- 172.21.15.156:0/676746573 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3ac130ce0 0x7fd3ac12e940 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd3a400cc50 tx=0x7fd3a400cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:37.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.908+0000 7fd3a97fa700 1 -- 172.21.15.156:0/676746573 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4003c00 con 0x7fd3ac130ce0 2023-09-30T22:20:37.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.908+0000 7fd3a97fa700 1 -- 172.21.15.156:0/676746573 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a4003d60 con 0x7fd3ac130ce0 2023-09-30T22:20:37.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.908+0000 7fd3a97fa700 1 -- 172.21.15.156:0/676746573 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a400aab0 con 0x7fd3ac130ce0 2023-09-30T22:20:37.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.908+0000 7fd3b2cfd700 1 -- 172.21.15.156:0/676746573 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3ac131280 con 0x7fd3ac130ce0 2023-09-30T22:20:37.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.908+0000 7fd3b2cfd700 1 -- 172.21.15.156:0/676746573 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ac131a90 con 0x7fd3ac130ce0 2023-09-30T22:20:37.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.910+0000 7fd3b2cfd700 1 -- 172.21.15.156:0/676746573 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3ac0a2120 con 0x7fd3ac130ce0 2023-09-30T22:20:37.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.911+0000 7fd3a97fa700 1 -- 172.21.15.156:0/676746573 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd3a400ac10 con 0x7fd3ac130ce0 2023-09-30T22:20:37.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.911+0000 7fd3a97fa700 1 -- 172.21.15.156:0/676746573 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd3a40402f0 con 0x7fd3ac130ce0 2023-09-30T22:20:37.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:37.920+0000 7fd3a97fa700 1 -- 172.21.15.156:0/676746573 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd3a4011740 con 0x7fd3ac130ce0 2023-09-30T22:20:38.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.016+0000 7fb36dc0f700 1 -- 172.21.15.156:0/658322233 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb36806bce0 con 0x7fb368139270 2023-09-30T22:20:38.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.016+0000 7fb34ffff700 1 -- 172.21.15.156:0/658322233 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb3600263e0 con 0x7fb368139270 2023-09-30T22:20:38.016 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:38.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.020+0000 7fb36dc0f700 1 -- 172.21.15.156:0/658322233 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb368139270 msgr2=0x7fb36811a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:38.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.020+0000 7fb36dc0f700 1 --2- 172.21.15.156:0/658322233 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb368139270 0x7fb36811a980 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb360016000 tx=0x7fb360004ad0 comp rx=0 tx=0).stop 2023-09-30T22:20:38.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.020+0000 7fb36dc0f700 1 -- 172.21.15.156:0/658322233 shutdown_connections 2023-09-30T22:20:38.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.020+0000 7fb36dc0f700 1 --2- 172.21.15.156:0/658322233 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb368139270 0x7fb36811a980 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:38.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.020+0000 7fb36dc0f700 1 --2- 172.21.15.156:0/658322233 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb368133a70 0x7fb368119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:38.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.020+0000 7fb36dc0f700 1 --2- 172.21.15.156:0/658322233 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb368136950 0x7fb36811a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:38.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.020+0000 7fb36dc0f700 1 -- 172.21.15.156:0/658322233 >> 172.21.15.156:0/658322233 conn(0x7fb3680a2980 msgr2=0x7fb3680a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:38.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.020+0000 7fb36dc0f700 1 -- 172.21.15.156:0/658322233 shutdown_connections 2023-09-30T22:20:38.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.020+0000 7fb36dc0f700 1 -- 172.21.15.156:0/658322233 wait complete. 2023-09-30T22:20:38.037 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:38.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.065+0000 7f0cdb7fe700 1 -- 172.21.15.156:0/3443151306 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0cf004f2a0 con 0x7f0cf009d860 2023-09-30T22:20:38.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.065+0000 7f0ce5ffb700 1 -- 172.21.15.156:0/3443151306 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0cec030020 con 0x7f0cf009d860 2023-09-30T22:20:38.065 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:38.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.067+0000 7f0cdb7fe700 1 -- 172.21.15.156:0/3443151306 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0cf009d860 msgr2=0x7f0cf011be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:38.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.067+0000 7f0cdb7fe700 1 --2- 172.21.15.156:0/3443151306 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0cf009d860 0x7f0cf011be80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0cec018000 tx=0x7f0cec004750 comp rx=0 tx=0).stop 2023-09-30T22:20:38.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.067+0000 7f0cdb7fe700 1 -- 172.21.15.156:0/3443151306 shutdown_connections 2023-09-30T22:20:38.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.067+0000 7f0cdb7fe700 1 --2- 172.21.15.156:0/3443151306 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0cf0130ce0 0x7f0cf011c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:38.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.067+0000 7f0cdb7fe700 1 --2- 172.21.15.156:0/3443151306 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0cf009d860 0x7f0cf011be80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:38.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.067+0000 7f0cdb7fe700 1 --2- 172.21.15.156:0/3443151306 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0cf009e170 0x7f0cf011c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:38.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.067+0000 7f0cdb7fe700 1 -- 172.21.15.156:0/3443151306 >> 172.21.15.156:0/3443151306 conn(0x7f0cf0099c40 msgr2=0x7f0cf0130080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:38.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.067+0000 7f0cdb7fe700 1 -- 172.21.15.156:0/3443151306 shutdown_connections 2023-09-30T22:20:38.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.067+0000 7f0cdb7fe700 1 -- 172.21.15.156:0/3443151306 wait complete. 2023-09-30T22:20:38.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:38.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.085+0000 7fe4a9953700 1 -- 172.21.15.156:0/1972582084 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe484005590 con 0x7fe4a4066410 2023-09-30T22:20:38.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.086+0000 7fe48bfff700 1 -- 172.21.15.156:0/1972582084 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe4940192c0 con 0x7fe4a4066410 2023-09-30T22:20:38.086 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:38.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.088+0000 7fe4a9953700 1 -- 172.21.15.156:0/1972582084 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4a4066410 msgr2=0x7fe4a41c8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:38.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.088+0000 7fe4a9953700 1 --2- 172.21.15.156:0/1972582084 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4a4066410 0x7fe4a41c8900 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe49400c580 tx=0x7fe49400c890 comp rx=0 tx=0).stop 2023-09-30T22:20:38.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.088+0000 7fe4a9953700 1 -- 172.21.15.156:0/1972582084 shutdown_connections 2023-09-30T22:20:38.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.088+0000 7fe4a9953700 1 --2- 172.21.15.156:0/1972582084 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4a4132100 0x7fe4a4099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:38.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.088+0000 7fe4a9953700 1 --2- 172.21.15.156:0/1972582084 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4a4066410 0x7fe4a41c8900 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:38.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.088+0000 7fe4a9953700 1 --2- 172.21.15.156:0/1972582084 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4a41314b0 0x7fe4a41c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:38.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.088+0000 7fe4a9953700 1 -- 172.21.15.156:0/1972582084 >> 172.21.15.156:0/1972582084 conn(0x7fe4a40a2980 msgr2=0x7fe4a4130240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:38.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.088+0000 7fe4a9953700 1 -- 172.21.15.156:0/1972582084 shutdown_connections 2023-09-30T22:20:38.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.088+0000 7fe4a9953700 1 -- 172.21.15.156:0/1972582084 wait complete. 2023-09-30T22:20:38.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:38.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.162+0000 7fd3b2cfd700 1 -- 172.21.15.156:0/676746573 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd3ac04f2a0 con 0x7fd3ac130ce0 2023-09-30T22:20:38.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.162+0000 7fd3a97fa700 1 -- 172.21.15.156:0/676746573 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd3a4011380 con 0x7fd3ac130ce0 2023-09-30T22:20:38.162 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:38.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.164+0000 7fd3b2cfd700 1 -- 172.21.15.156:0/676746573 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3ac130ce0 msgr2=0x7fd3ac12e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:38.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.164+0000 7fd3b2cfd700 1 --2- 172.21.15.156:0/676746573 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3ac130ce0 0x7fd3ac12e940 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd3a400cc50 tx=0x7fd3a400cf60 comp rx=0 tx=0).stop 2023-09-30T22:20:38.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.164+0000 7fd3b2cfd700 1 -- 172.21.15.156:0/676746573 shutdown_connections 2023-09-30T22:20:38.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.164+0000 7fd3b2cfd700 1 --2- 172.21.15.156:0/676746573 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3ac130ce0 0x7fd3ac12e940 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:38.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.164+0000 7fd3b2cfd700 1 --2- 172.21.15.156:0/676746573 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3ac09d860 0x7fd3ac12dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:38.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.164+0000 7fd3b2cfd700 1 --2- 172.21.15.156:0/676746573 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3ac09e170 0x7fd3ac12e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:38.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.164+0000 7fd3b2cfd700 1 -- 172.21.15.156:0/676746573 >> 172.21.15.156:0/676746573 conn(0x7fd3ac099c40 msgr2=0x7fd3ac070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:38.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.164+0000 7fd3b2cfd700 1 -- 172.21.15.156:0/676746573 shutdown_connections 2023-09-30T22:20:38.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:38.165+0000 7fd3b2cfd700 1 -- 172.21.15.156:0/676746573 wait complete. 2023-09-30T22:20:38.176 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:39.038 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:39.080 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:39.101 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:39.177 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:39.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.181+0000 7fec49246700 1 Processor -- start 2023-09-30T22:20:39.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.181+0000 7fec49246700 1 -- start start 2023-09-30T22:20:39.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.182+0000 7fec49246700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fec44136950 0x7fec44138d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:39.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.182+0000 7fec49246700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fec44139270 0x7fec4413b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:39.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.182+0000 7fec49246700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec44133640 con 0x7fec44133a70 2023-09-30T22:20:39.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.182+0000 7fec49246700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec440a1d50 con 0x7fec44136950 2023-09-30T22:20:39.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.182+0000 7fec49246700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec44134550 con 0x7fec44139270 2023-09-30T22:20:39.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.182+0000 7fec4359e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fec44139270 0x7fec4413b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:39.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.182+0000 7fec4259c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fec44136950 0x7fec44138d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:39.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.182+0000 7fec4259c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fec44136950 0x7fec44138d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49270/0 (socket says 172.21.15.156:49270) 2023-09-30T22:20:39.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.182+0000 7fec4359e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fec44139270 0x7fec4413b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59820/0 (socket says 172.21.15.156:59820) 2023-09-30T22:20:39.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.182+0000 7fec4259c700 1 -- 172.21.15.156:0/2484076452 learned_addr learned my addr 172.21.15.156:0/2484076452 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:39.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.182+0000 7fec4259c700 1 -- 172.21.15.156:0/2484076452 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fec44139270 msgr2=0x7fec4413b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:39.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.182+0000 7fec4259c700 1 --2- 172.21.15.156:0/2484076452 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fec44139270 0x7fec4413b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.182+0000 7fec4259c700 1 -- 172.21.15.156:0/2484076452 >> v1:172.21.15.156:6789/0 conn(0x7fec44133a70 legacy=0x7fec44133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:39.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.182+0000 7fec41d9b700 1 -- 172.21.15.156:0/2484076452 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 610812275 0 0) 0x7fec44133640 con 0x7fec44133a70 2023-09-30T22:20:39.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.183+0000 7fec4259c700 1 -- 172.21.15.156:0/2484076452 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4409b620 con 0x7fec44136950 2023-09-30T22:20:39.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.183+0000 7fec4259c700 1 --2- 172.21.15.156:0/2484076452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec44136950 0x7fec44138d30 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fec380098f0 tx=0x7fec38009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc57785033dcc727 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:39.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.183+0000 7fec41d9b700 1 -- 172.21.15.156:0/2484076452 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec38011830 con 0x7fec44136950 2023-09-30T22:20:39.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.183+0000 7fec41d9b700 1 -- 172.21.15.156:0/2484076452 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec38011990 con 0x7fec44136950 2023-09-30T22:20:39.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.183+0000 7fec41d9b700 1 -- 172.21.15.156:0/2484076452 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec38011d20 con 0x7fec44136950 2023-09-30T22:20:39.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.184+0000 7fec49246700 1 -- 172.21.15.156:0/2484076452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec44136950 msgr2=0x7fec44138d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:39.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.184+0000 7fec49246700 1 --2- 172.21.15.156:0/2484076452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec44136950 0x7fec44138d30 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fec380098f0 tx=0x7fec38009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:39.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.184+0000 7fec49246700 1 -- 172.21.15.156:0/2484076452 shutdown_connections 2023-09-30T22:20:39.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.184+0000 7fec49246700 1 --2- 172.21.15.156:0/2484076452 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fec44139270 0x7fec4413b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.184+0000 7fec49246700 1 --2- 172.21.15.156:0/2484076452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec44136950 0x7fec44138d30 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.184+0000 7fec49246700 1 -- 172.21.15.156:0/2484076452 >> 172.21.15.156:0/2484076452 conn(0x7fec440a2980 msgr2=0x7fec440a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:39.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.184+0000 7fec49246700 1 -- 172.21.15.156:0/2484076452 shutdown_connections 2023-09-30T22:20:39.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.184+0000 7fec49246700 1 -- 172.21.15.156:0/2484076452 wait complete. 2023-09-30T22:20:39.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.185+0000 7fec49246700 1 Processor -- start 2023-09-30T22:20:39.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.185+0000 7fec49246700 1 -- start start 2023-09-30T22:20:39.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.186+0000 7fec49246700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec44133a70 0x7fec44070970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:39.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.186+0000 7fec49246700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec44136950 0x7fec44070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:39.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.186+0000 7fec49246700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fec44139270 0x7fec441cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:39.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.186+0000 7fec49246700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec44122a50 con 0x7fec44133a70 2023-09-30T22:20:39.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.186+0000 7fec49246700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec44122c80 con 0x7fec44139270 2023-09-30T22:20:39.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.186+0000 7fec49246700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec44071c20 con 0x7fec44136950 2023-09-30T22:20:39.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.186+0000 7fec42d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec44133a70 0x7fec44070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:39.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.186+0000 7fec42d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec44133a70 0x7fec44070970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49284/0 (socket says 172.21.15.156:49284) 2023-09-30T22:20:39.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.186+0000 7fec42d9d700 1 -- 172.21.15.156:0/2822871067 learned_addr learned my addr 172.21.15.156:0/2822871067 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:39.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.186+0000 7fec4359e700 1 --2- 172.21.15.156:0/2822871067 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fec44139270 0x7fec441cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:39.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.186+0000 7fec42d9d700 1 -- 172.21.15.156:0/2822871067 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec44136950 msgr2=0x7fec44070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:39.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.186+0000 7fec42d9d700 1 --2- 172.21.15.156:0/2822871067 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec44136950 0x7fec44070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.186+0000 7fec42d9d700 1 -- 172.21.15.156:0/2822871067 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fec44139270 msgr2=0x7fec441cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:39.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.186+0000 7fec42d9d700 1 --2- 172.21.15.156:0/2822871067 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fec44139270 0x7fec441cc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.186+0000 7fec42d9d700 1 -- 172.21.15.156:0/2822871067 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec38009550 con 0x7fec44133a70 2023-09-30T22:20:39.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.187+0000 7fec42d9d700 1 --2- 172.21.15.156:0/2822871067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec44133a70 0x7fec44070970 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fec3400c550 tx=0x7fec3400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:39.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.187+0000 7fec2b7fe700 1 -- 172.21.15.156:0/2822871067 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec340054e0 con 0x7fec44133a70 2023-09-30T22:20:39.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.187+0000 7fec2b7fe700 1 -- 172.21.15.156:0/2822871067 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec34003680 con 0x7fec44133a70 2023-09-30T22:20:39.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.187+0000 7fec49246700 1 -- 172.21.15.156:0/2822871067 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec44121cc0 con 0x7fec44133a70 2023-09-30T22:20:39.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.187+0000 7fec2b7fe700 1 -- 172.21.15.156:0/2822871067 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec34003a30 con 0x7fec44133a70 2023-09-30T22:20:39.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.187+0000 7fec49246700 1 -- 172.21.15.156:0/2822871067 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec440704d0 con 0x7fec44133a70 2023-09-30T22:20:39.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.188+0000 7fec49246700 1 -- 172.21.15.156:0/2822871067 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec4404f2a0 con 0x7fec44133a70 2023-09-30T22:20:39.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.188+0000 7fec2b7fe700 1 -- 172.21.15.156:0/2822871067 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fec34003b90 con 0x7fec44133a70 2023-09-30T22:20:39.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.188+0000 7fec2b7fe700 1 -- 172.21.15.156:0/2822871067 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fec3403f010 con 0x7fec44133a70 2023-09-30T22:20:39.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.194+0000 7fec2b7fe700 1 -- 172.21.15.156:0/2822871067 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fec34003e40 con 0x7fec44133a70 2023-09-30T22:20:39.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.225+0000 7fad6fbb6700 1 Processor -- start 2023-09-30T22:20:39.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.225+0000 7fad6fbb6700 1 -- start start 2023-09-30T22:20:39.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.226+0000 7fad6fbb6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad681346e0 0x7fad68136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:39.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.226+0000 7fad6fbb6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fad68137000 0x7fad681393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:39.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.226+0000 7fad6fbb6700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad680a1640 con 0x7fad68131980 2023-09-30T22:20:39.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.226+0000 7fad6fbb6700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad6806eb30 con 0x7fad68137000 2023-09-30T22:20:39.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.226+0000 7fad6fbb6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad680a22d0 con 0x7fad681346e0 2023-09-30T22:20:39.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.226+0000 7fad6e153700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fad68137000 0x7fad681393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:39.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.226+0000 7fad6e153700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fad68137000 0x7fad681393e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49296/0 (socket says 172.21.15.156:49296) 2023-09-30T22:20:39.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.226+0000 7fad6e153700 1 -- 172.21.15.156:0/2410991276 learned_addr learned my addr 172.21.15.156:0/2410991276 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:39.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.226+0000 7fad6d151700 1 --2- 172.21.15.156:0/2410991276 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad681346e0 0x7fad68136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:39.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.226+0000 7fad6e153700 1 -- 172.21.15.156:0/2410991276 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad681346e0 msgr2=0x7fad68136ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:39.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.226+0000 7fad6e153700 1 --2- 172.21.15.156:0/2410991276 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad681346e0 0x7fad68136ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.226+0000 7fad6e153700 1 -- 172.21.15.156:0/2410991276 >> v1:172.21.15.156:6789/0 conn(0x7fad68131980 legacy=0x7fad68131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:39.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.226+0000 7fad6e153700 1 -- 172.21.15.156:0/2410991276 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad68131550 con 0x7fad68137000 2023-09-30T22:20:39.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.226+0000 7fad6e153700 1 --2- 172.21.15.156:0/2410991276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad68137000 0x7fad681393e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fad60009e50 tx=0x7fad6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07ee4089362e23 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:39.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.227+0000 7fad6c950700 1 -- 172.21.15.156:0/2410991276 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6000e070 con 0x7fad68137000 2023-09-30T22:20:39.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.227+0000 7fad6c950700 1 -- 172.21.15.156:0/2410991276 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6000b910 con 0x7fad68137000 2023-09-30T22:20:39.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.227+0000 7fad6c950700 1 -- 172.21.15.156:0/2410991276 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6000bca0 con 0x7fad68137000 2023-09-30T22:20:39.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.228+0000 7fad6fbb6700 1 -- 172.21.15.156:0/2410991276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad68137000 msgr2=0x7fad681393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:39.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.228+0000 7fad6fbb6700 1 --2- 172.21.15.156:0/2410991276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad68137000 0x7fad681393e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fad60009e50 tx=0x7fad6000b330 comp rx=0 tx=0).stop 2023-09-30T22:20:39.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.228+0000 7fad6fbb6700 1 -- 172.21.15.156:0/2410991276 shutdown_connections 2023-09-30T22:20:39.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.228+0000 7fad6fbb6700 1 --2- 172.21.15.156:0/2410991276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad68137000 0x7fad681393e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.228+0000 7fad6fbb6700 1 --2- 172.21.15.156:0/2410991276 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad681346e0 0x7fad68136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.228+0000 7fad6fbb6700 1 -- 172.21.15.156:0/2410991276 >> 172.21.15.156:0/2410991276 conn(0x7fad680a2980 msgr2=0x7fad680a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:39.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.228+0000 7fad6fbb6700 1 -- 172.21.15.156:0/2410991276 shutdown_connections 2023-09-30T22:20:39.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.228+0000 7fad6fbb6700 1 -- 172.21.15.156:0/2410991276 wait complete. 2023-09-30T22:20:39.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.229+0000 7fad6fbb6700 1 Processor -- start 2023-09-30T22:20:39.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.229+0000 7fad6fbb6700 1 -- start start 2023-09-30T22:20:39.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.230+0000 7fad6fbb6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad68131980 0x7fad68119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:39.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.230+0000 7fad6fbb6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad681346e0 0x7fad68119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:39.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.230+0000 7fad6fbb6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad68137000 0x7fad68119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:39.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.230+0000 7fad6fbb6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6811ca90 con 0x7fad68137000 2023-09-30T22:20:39.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.230+0000 7fad6fbb6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6811ab20 con 0x7fad68131980 2023-09-30T22:20:39.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.230+0000 7fad6fbb6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad6812edc0 con 0x7fad681346e0 2023-09-30T22:20:39.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.230+0000 7fad6e153700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad68137000 0x7fad68119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:39.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.230+0000 7fad6d151700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad681346e0 0x7fad68119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:39.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.230+0000 7fad6e153700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad68137000 0x7fad68119ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49310/0 (socket says 172.21.15.156:49310) 2023-09-30T22:20:39.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.230+0000 7fad6e153700 1 -- 172.21.15.156:0/3006871466 learned_addr learned my addr 172.21.15.156:0/3006871466 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:39.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.230+0000 7fad6d952700 1 --2- 172.21.15.156:0/3006871466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad68131980 0x7fad68119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:39.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.231+0000 7fad6e153700 1 -- 172.21.15.156:0/3006871466 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad681346e0 msgr2=0x7fad68119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:39.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.231+0000 7fad6e153700 1 --2- 172.21.15.156:0/3006871466 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad681346e0 0x7fad68119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.231+0000 7fad6e153700 1 -- 172.21.15.156:0/3006871466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad68131980 msgr2=0x7fad68119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:39.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.231+0000 7fad6e153700 1 --2- 172.21.15.156:0/3006871466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad68131980 0x7fad68119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.231+0000 7fad6e153700 1 -- 172.21.15.156:0/3006871466 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad60009b30 con 0x7fad68137000 2023-09-30T22:20:39.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.231+0000 7fad6e153700 1 --2- 172.21.15.156:0/3006871466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad68137000 0x7fad68119ad0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fad6000b680 tx=0x7fad60004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:39.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.231+0000 7fad5e7fc700 1 -- 172.21.15.156:0/3006871466 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad60004860 con 0x7fad68137000 2023-09-30T22:20:39.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.231+0000 7fad5e7fc700 1 -- 172.21.15.156:0/3006871466 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad60007160 con 0x7fad68137000 2023-09-30T22:20:39.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.231+0000 7fad5e7fc700 1 -- 172.21.15.156:0/3006871466 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6001c680 con 0x7fad68137000 2023-09-30T22:20:39.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.231+0000 7fad6fbb6700 1 -- 172.21.15.156:0/3006871466 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad6809ce80 con 0x7fad68137000 2023-09-30T22:20:39.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.231+0000 7fad6fbb6700 1 -- 172.21.15.156:0/3006871466 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad6811c710 con 0x7fad68137000 2023-09-30T22:20:39.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.232+0000 7fad5e7fc700 1 -- 172.21.15.156:0/3006871466 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad600092e0 con 0x7fad68137000 2023-09-30T22:20:39.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.233+0000 7fad5e7fc700 1 -- 172.21.15.156:0/3006871466 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fad60040f70 con 0x7fad68137000 2023-09-30T22:20:39.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.233+0000 7fad6fbb6700 1 -- 172.21.15.156:0/3006871466 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad6804f2a0 con 0x7fad68137000 2023-09-30T22:20:39.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.242+0000 7fad5e7fc700 1 -- 172.21.15.156:0/3006871466 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad600249a0 con 0x7fad68137000 2023-09-30T22:20:39.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.263+0000 7fbc14d15700 1 Processor -- start 2023-09-30T22:20:39.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.263+0000 7fbc14d15700 1 -- start start 2023-09-30T22:20:39.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.264+0000 7fbc14d15700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbc100a0a70 0x7fbc100a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:39.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.264+0000 7fbc14d15700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc100a1380 0x7fbc10133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:39.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.264+0000 7fbc14d15700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbc10133f50 0x7fbc101343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:39.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.264+0000 7fbc14d15700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc1009e9d0 con 0x7fbc10133f50 2023-09-30T22:20:39.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.264+0000 7fbc14d15700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1009dc00 con 0x7fbc100a1380 2023-09-30T22:20:39.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.264+0000 7fbc14d15700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1009dec0 con 0x7fbc100a0a70 2023-09-30T22:20:39.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.264+0000 7fbc0ed9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbc10133f50 0x7fbc101343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:39.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.264+0000 7fbc0ed9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbc10133f50 0x7fbc101343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49318/0 (socket says 172.21.15.156:49318) 2023-09-30T22:20:39.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.264+0000 7fbc0ed9d700 1 -- 172.21.15.156:0/1879772313 learned_addr learned my addr 172.21.15.156:0/1879772313 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:39.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.264+0000 7fbc0e59c700 1 --2- 172.21.15.156:0/1879772313 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbc100a0a70 0x7fbc100a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:39.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.265+0000 7fbc0dd9b700 1 --2- 172.21.15.156:0/1879772313 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc100a1380 0x7fbc10133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:39.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.265+0000 7fbc0ed9d700 1 -- 172.21.15.156:0/1879772313 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbc100a0a70 msgr2=0x7fbc100a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:39.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.265+0000 7fbc0ed9d700 1 --2- 172.21.15.156:0/1879772313 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbc100a0a70 0x7fbc100a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.265+0000 7fbc0ed9d700 1 -- 172.21.15.156:0/1879772313 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc100a1380 msgr2=0x7fbc10133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:39.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.265+0000 7fbc0ed9d700 1 --2- 172.21.15.156:0/1879772313 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc100a1380 0x7fbc10133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.265+0000 7fbc0ed9d700 1 -- 172.21.15.156:0/1879772313 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc1009e6a0 con 0x7fbc10133f50 2023-09-30T22:20:39.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.265+0000 7fbc0e59c700 1 --2- 172.21.15.156:0/1879772313 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbc100a0a70 0x7fbc100a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:20:39.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.265+0000 7fbc0ed9d700 1 --2- 172.21.15.156:0/1879772313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc10133f50 0x7fbc101343f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fbc08009e50 tx=0x7fbc0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67bd47c75873472d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:39.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.265+0000 7fbc0d59a700 1 -- 172.21.15.156:0/1879772313 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0800e070 con 0x7fbc10133f50 2023-09-30T22:20:39.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.265+0000 7fbc0d59a700 1 -- 172.21.15.156:0/1879772313 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0800b910 con 0x7fbc10133f50 2023-09-30T22:20:39.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.265+0000 7fbc0d59a700 1 -- 172.21.15.156:0/1879772313 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0800bcc0 con 0x7fbc10133f50 2023-09-30T22:20:39.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.266+0000 7fbc14d15700 1 -- 172.21.15.156:0/1879772313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc10133f50 msgr2=0x7fbc101343f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:39.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.266+0000 7fbc14d15700 1 --2- 172.21.15.156:0/1879772313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc10133f50 0x7fbc101343f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fbc08009e50 tx=0x7fbc0800b330 comp rx=0 tx=0).stop 2023-09-30T22:20:39.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.266+0000 7fbc14d15700 1 -- 172.21.15.156:0/1879772313 shutdown_connections 2023-09-30T22:20:39.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.266+0000 7fbc14d15700 1 --2- 172.21.15.156:0/1879772313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc10133f50 0x7fbc101343f0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.266+0000 7fbc14d15700 1 --2- 172.21.15.156:0/1879772313 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbc100a0a70 0x7fbc100a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.266+0000 7fbc14d15700 1 --2- 172.21.15.156:0/1879772313 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc100a1380 0x7fbc10133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.266+0000 7fbc14d15700 1 -- 172.21.15.156:0/1879772313 >> 172.21.15.156:0/1879772313 conn(0x7fbc100a6610 msgr2=0x7fbc100a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:39.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.266+0000 7fbc14d15700 1 -- 172.21.15.156:0/1879772313 shutdown_connections 2023-09-30T22:20:39.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.266+0000 7fbc14d15700 1 -- 172.21.15.156:0/1879772313 wait complete. 2023-09-30T22:20:39.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.267+0000 7fbc14d15700 1 Processor -- start 2023-09-30T22:20:39.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.267+0000 7fbc14d15700 1 -- start start 2023-09-30T22:20:39.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.267+0000 7fbc14d15700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc100a0a70 0x7fbc10122410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:39.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.267+0000 7fbc14d15700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc100a1380 0x7fbc10122950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:39.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.267+0000 7fbc14d15700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbc10133f50 0x7fbc10122e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:39.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.267+0000 7fbc14d15700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc10125f30 con 0x7fbc100a1380 2023-09-30T22:20:39.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.267+0000 7fbc14d15700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc10124eb0 con 0x7fbc100a0a70 2023-09-30T22:20:39.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.267+0000 7fbc14d15700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc10125990 con 0x7fbc10133f50 2023-09-30T22:20:39.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.268+0000 7fbc0dd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc100a1380 0x7fbc10122950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:39.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.268+0000 7fbc0dd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc100a1380 0x7fbc10122950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49334/0 (socket says 172.21.15.156:49334) 2023-09-30T22:20:39.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.268+0000 7fbc0dd9b700 1 -- 172.21.15.156:0/3664588943 learned_addr learned my addr 172.21.15.156:0/3664588943 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:39.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.268+0000 7fbc0e59c700 1 --2- 172.21.15.156:0/3664588943 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc100a0a70 0x7fbc10122410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:39.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.268+0000 7fbc0ed9d700 1 --2- 172.21.15.156:0/3664588943 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbc10133f50 0x7fbc10122e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:39.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.268+0000 7fbc0dd9b700 1 -- 172.21.15.156:0/3664588943 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbc10133f50 msgr2=0x7fbc10122e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:39.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.268+0000 7fbc0dd9b700 1 --2- 172.21.15.156:0/3664588943 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbc10133f50 0x7fbc10122e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.268+0000 7fbc0dd9b700 1 -- 172.21.15.156:0/3664588943 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc100a0a70 msgr2=0x7fbc10122410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:39.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.268+0000 7fbc0dd9b700 1 --2- 172.21.15.156:0/3664588943 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc100a0a70 0x7fbc10122410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.268+0000 7fbc0dd9b700 1 -- 172.21.15.156:0/3664588943 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc08009b30 con 0x7fbc100a1380 2023-09-30T22:20:39.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.268+0000 7fbc0dd9b700 1 --2- 172.21.15.156:0/3664588943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc100a1380 0x7fbc10122950 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fbc0400e9b0 tx=0x7fbc0400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:39.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.268+0000 7fbbfeffd700 1 -- 172.21.15.156:0/3664588943 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc04009710 con 0x7fbc100a1380 2023-09-30T22:20:39.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.268+0000 7fbc14d15700 1 -- 172.21.15.156:0/3664588943 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc1009d340 con 0x7fbc100a1380 2023-09-30T22:20:39.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.268+0000 7fbbfeffd700 1 -- 172.21.15.156:0/3664588943 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0400c850 con 0x7fbc100a1380 2023-09-30T22:20:39.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.268+0000 7fbbfeffd700 1 -- 172.21.15.156:0/3664588943 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0400cbe0 con 0x7fbc100a1380 2023-09-30T22:20:39.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.268+0000 7fbc14d15700 1 -- 172.21.15.156:0/3664588943 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc100a0430 con 0x7fbc100a1380 2023-09-30T22:20:39.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.269+0000 7fbbfeffd700 1 -- 172.21.15.156:0/3664588943 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbc0400cd40 con 0x7fbc100a1380 2023-09-30T22:20:39.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.269+0000 7fbbfeffd700 1 -- 172.21.15.156:0/3664588943 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbc0403fb60 con 0x7fbc100a1380 2023-09-30T22:20:39.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.270+0000 7fbc14d15700 1 -- 172.21.15.156:0/3664588943 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc101257e0 con 0x7fbc100a1380 2023-09-30T22:20:39.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.276+0000 7fbbfeffd700 1 -- 172.21.15.156:0/3664588943 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbc04017080 con 0x7fbc100a1380 2023-09-30T22:20:39.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.314+0000 7f8414828700 1 Processor -- start 2023-09-30T22:20:39.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.314+0000 7f8414828700 1 -- start start 2023-09-30T22:20:39.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.315+0000 7f8414828700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f841009f350 0x7f8410136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:39.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.315+0000 7f8414828700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f84101371c0 0x7f84101395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:39.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.315+0000 7f8414828700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f841009c970 con 0x7f841009e870 2023-09-30T22:20:39.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.315+0000 7f8414828700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84100a0920 con 0x7f84101371c0 2023-09-30T22:20:39.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.315+0000 7f8414828700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f841009f9c0 con 0x7f841009f350 2023-09-30T22:20:39.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.315+0000 7f840e59c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f841009e870 0x7f841009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:60740/0 (socket says 172.21.15.156:60740) 2023-09-30T22:20:39.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.315+0000 7f840e59c700 1 -- 172.21.15.156:0/1062441311 learned_addr learned my addr 172.21.15.156:0/1062441311 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:39.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.315+0000 7f840ed9d700 1 --2- 172.21.15.156:0/1062441311 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f84101371c0 0x7f84101395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:39.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.315+0000 7f840dd9b700 1 --2- 172.21.15.156:0/1062441311 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f841009f350 0x7f8410136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:39.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.316+0000 7f840d59a700 1 -- 172.21.15.156:0/1062441311 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3993680673 0 0) 0x7f841009c970 con 0x7f841009e870 2023-09-30T22:20:39.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.316+0000 7f840dd9b700 1 -- 172.21.15.156:0/1062441311 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f84101371c0 msgr2=0x7f84101395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:39.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.316+0000 7f840dd9b700 1 --2- 172.21.15.156:0/1062441311 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f84101371c0 0x7f84101395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.316+0000 7f840dd9b700 1 -- 172.21.15.156:0/1062441311 >> v1:172.21.15.156:6789/0 conn(0x7f841009e870 legacy=0x7f841009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:39.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.316+0000 7f840dd9b700 1 -- 172.21.15.156:0/1062441311 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f841009bab0 con 0x7f841009f350 2023-09-30T22:20:39.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.316+0000 7f840dd9b700 1 --2- 172.21.15.156:0/1062441311 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f841009f350 0x7f8410136c80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8404009870 tx=0x7f8404009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1ac5fcf30ddf5fc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:39.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.316+0000 7f840d59a700 1 -- 172.21.15.156:0/1062441311 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8404011830 con 0x7f841009f350 2023-09-30T22:20:39.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.316+0000 7f840d59a700 1 -- 172.21.15.156:0/1062441311 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8404011990 con 0x7f841009f350 2023-09-30T22:20:39.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.316+0000 7f840d59a700 1 -- 172.21.15.156:0/1062441311 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8404011d20 con 0x7f841009f350 2023-09-30T22:20:39.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.317+0000 7f8414828700 1 -- 172.21.15.156:0/1062441311 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f841009f350 msgr2=0x7f8410136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:39.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.317+0000 7f8414828700 1 --2- 172.21.15.156:0/1062441311 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f841009f350 0x7f8410136c80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8404009870 tx=0x7f8404009b80 comp rx=0 tx=0).stop 2023-09-30T22:20:39.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.317+0000 7f8414828700 1 -- 172.21.15.156:0/1062441311 shutdown_connections 2023-09-30T22:20:39.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.317+0000 7f8414828700 1 --2- 172.21.15.156:0/1062441311 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f84101371c0 0x7f84101395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.317+0000 7f8414828700 1 --2- 172.21.15.156:0/1062441311 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f841009f350 0x7f8410136c80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.317+0000 7f8414828700 1 -- 172.21.15.156:0/1062441311 >> 172.21.15.156:0/1062441311 conn(0x7f84100a4430 msgr2=0x7f84100a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:39.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.317+0000 7f8414828700 1 -- 172.21.15.156:0/1062441311 shutdown_connections 2023-09-30T22:20:39.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.317+0000 7f8414828700 1 -- 172.21.15.156:0/1062441311 wait complete. 2023-09-30T22:20:39.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.318+0000 7f8414828700 1 Processor -- start 2023-09-30T22:20:39.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.318+0000 7f8414828700 1 -- start start 2023-09-30T22:20:39.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.319+0000 7f8414828700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f841009e870 0x7f84101c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:39.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.319+0000 7f8414828700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f841009f350 0x7f84101c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:39.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.319+0000 7f8414828700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84101371c0 0x7f84101c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:39.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.319+0000 7f8414828700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841006d4c0 con 0x7f84101371c0 2023-09-30T22:20:39.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.319+0000 7f8414828700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8410125090 con 0x7f841009f350 2023-09-30T22:20:39.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.319+0000 7f8414828700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8410125300 con 0x7f841009e870 2023-09-30T22:20:39.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.319+0000 7f840dd9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f841009f350 0x7f84101c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:39.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.319+0000 7f840dd9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f841009f350 0x7f84101c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59882/0 (socket says 172.21.15.156:59882) 2023-09-30T22:20:39.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.319+0000 7f840e59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f841009e870 0x7f84101c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:39.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.319+0000 7f840dd9b700 1 -- 172.21.15.156:0/1817546292 learned_addr learned my addr 172.21.15.156:0/1817546292 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:39.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.319+0000 7f840ed9d700 1 --2- 172.21.15.156:0/1817546292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84101371c0 0x7f84101c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:39.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.319+0000 7f840dd9b700 1 -- 172.21.15.156:0/1817546292 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f841009e870 msgr2=0x7f84101c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:39.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.319+0000 7f840dd9b700 1 --2- 172.21.15.156:0/1817546292 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f841009e870 0x7f84101c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.319+0000 7f840dd9b700 1 -- 172.21.15.156:0/1817546292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84101371c0 msgr2=0x7f84101c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:39.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.320+0000 7f840dd9b700 1 --2- 172.21.15.156:0/1817546292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84101371c0 0x7f84101c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.320+0000 7f840dd9b700 1 -- 172.21.15.156:0/1817546292 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84040094a0 con 0x7f841009f350 2023-09-30T22:20:39.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.320+0000 7f840e59c700 1 --2- 172.21.15.156:0/1817546292 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f841009e870 0x7f84101c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:39.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.320+0000 7f840dd9b700 1 --2- 172.21.15.156:0/1817546292 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f841009f350 0x7f84101c8910 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f84040090b0 tx=0x7f8404004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:39.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.320+0000 7f83feffd700 1 -- 172.21.15.156:0/1817546292 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8404004590 con 0x7f841009f350 2023-09-30T22:20:39.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.320+0000 7f83feffd700 1 -- 172.21.15.156:0/1817546292 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840401f070 con 0x7f841009f350 2023-09-30T22:20:39.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.320+0000 7f83feffd700 1 -- 172.21.15.156:0/1817546292 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84040038a0 con 0x7f841009f350 2023-09-30T22:20:39.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.320+0000 7f8414828700 1 -- 172.21.15.156:0/1817546292 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8410072300 con 0x7f841009f350 2023-09-30T22:20:39.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.320+0000 7f8414828700 1 -- 172.21.15.156:0/1817546292 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8410125a90 con 0x7f841009f350 2023-09-30T22:20:39.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.321+0000 7f8414828700 1 -- 172.21.15.156:0/1817546292 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8410124ef0 con 0x7f841009f350 2023-09-30T22:20:39.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.322+0000 7f83feffd700 1 -- 172.21.15.156:0/1817546292 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8404003a00 con 0x7f841009f350 2023-09-30T22:20:39.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.322+0000 7f83feffd700 1 -- 172.21.15.156:0/1817546292 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8404021070 con 0x7f841009f350 2023-09-30T22:20:39.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.326+0000 7f83feffd700 1 -- 172.21.15.156:0/1817546292 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f840402f990 con 0x7f841009f350 2023-09-30T22:20:39.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.459+0000 7fec49246700 1 -- 172.21.15.156:0/2822871067 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fec4406bce0 con 0x7fec44133a70 2023-09-30T22:20:39.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.459+0000 7fec2b7fe700 1 -- 172.21.15.156:0/2822871067 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fec34017020 con 0x7fec44133a70 2023-09-30T22:20:39.459 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:39.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.462+0000 7fec49246700 1 -- 172.21.15.156:0/2822871067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec44133a70 msgr2=0x7fec44070970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:39.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.462+0000 7fec49246700 1 --2- 172.21.15.156:0/2822871067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec44133a70 0x7fec44070970 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fec3400c550 tx=0x7fec3400c860 comp rx=0 tx=0).stop 2023-09-30T22:20:39.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.462+0000 7fec49246700 1 -- 172.21.15.156:0/2822871067 shutdown_connections 2023-09-30T22:20:39.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.462+0000 7fec49246700 1 --2- 172.21.15.156:0/2822871067 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fec44139270 0x7fec441cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.462+0000 7fec49246700 1 --2- 172.21.15.156:0/2822871067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec44133a70 0x7fec44070970 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.462+0000 7fec49246700 1 --2- 172.21.15.156:0/2822871067 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec44136950 0x7fec44070eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.462+0000 7fec49246700 1 -- 172.21.15.156:0/2822871067 >> 172.21.15.156:0/2822871067 conn(0x7fec440a2980 msgr2=0x7fec44134710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:39.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.462+0000 7fec49246700 1 -- 172.21.15.156:0/2822871067 shutdown_connections 2023-09-30T22:20:39.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.462+0000 7fec49246700 1 -- 172.21.15.156:0/2822871067 wait complete. 2023-09-30T22:20:39.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.472+0000 7fbc14d15700 1 -- 172.21.15.156:0/3664588943 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbc1004f2a0 con 0x7fbc100a1380 2023-09-30T22:20:39.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.472+0000 7fbbfeffd700 1 -- 172.21.15.156:0/3664588943 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbc04021020 con 0x7fbc100a1380 2023-09-30T22:20:39.472 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:39.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.474+0000 7fbc14d15700 1 -- 172.21.15.156:0/3664588943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc100a1380 msgr2=0x7fbc10122950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:39.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.474+0000 7fbc14d15700 1 --2- 172.21.15.156:0/3664588943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc100a1380 0x7fbc10122950 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fbc0400e9b0 tx=0x7fbc0400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.474+0000 7fbc14d15700 1 -- 172.21.15.156:0/3664588943 shutdown_connections 2023-09-30T22:20:39.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.474+0000 7fbc14d15700 1 --2- 172.21.15.156:0/3664588943 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbc10133f50 0x7fbc10122e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.474+0000 7fbc14d15700 1 --2- 172.21.15.156:0/3664588943 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc100a0a70 0x7fbc10122410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.474+0000 7fbc14d15700 1 --2- 172.21.15.156:0/3664588943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc100a1380 0x7fbc10122950 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.474+0000 7fbc14d15700 1 -- 172.21.15.156:0/3664588943 >> 172.21.15.156:0/3664588943 conn(0x7fbc100a6610 msgr2=0x7fbc10099c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:39.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.474+0000 7fbc14d15700 1 -- 172.21.15.156:0/3664588943 shutdown_connections 2023-09-30T22:20:39.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.474+0000 7fbc14d15700 1 -- 172.21.15.156:0/3664588943 wait complete. 2023-09-30T22:20:39.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:39.487 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:39.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.502+0000 7fad6fbb6700 1 -- 172.21.15.156:0/3006871466 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fad6806bce0 con 0x7fad68137000 2023-09-30T22:20:39.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.502+0000 7fad5e7fc700 1 -- 172.21.15.156:0/3006871466 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad60033090 con 0x7fad68137000 2023-09-30T22:20:39.502 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:39.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.504+0000 7fad6fbb6700 1 -- 172.21.15.156:0/3006871466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad68137000 msgr2=0x7fad68119ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:39.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.504+0000 7fad6fbb6700 1 --2- 172.21.15.156:0/3006871466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad68137000 0x7fad68119ad0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fad6000b680 tx=0x7fad60004ad0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.504+0000 7fad6fbb6700 1 -- 172.21.15.156:0/3006871466 shutdown_connections 2023-09-30T22:20:39.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.504+0000 7fad6fbb6700 1 --2- 172.21.15.156:0/3006871466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad68137000 0x7fad68119ad0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.504+0000 7fad6fbb6700 1 --2- 172.21.15.156:0/3006871466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad68131980 0x7fad68119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.504+0000 7fad6fbb6700 1 --2- 172.21.15.156:0/3006871466 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad681346e0 0x7fad68119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.504+0000 7fad6fbb6700 1 -- 172.21.15.156:0/3006871466 >> 172.21.15.156:0/3006871466 conn(0x7fad680a2980 msgr2=0x7fad68133560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:39.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.504+0000 7fad6fbb6700 1 -- 172.21.15.156:0/3006871466 shutdown_connections 2023-09-30T22:20:39.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.504+0000 7fad6fbb6700 1 -- 172.21.15.156:0/3006871466 wait complete. 2023-09-30T22:20:39.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:39.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.530+0000 7f8414828700 1 -- 172.21.15.156:0/1817546292 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8410124ef0 con 0x7f841009f350 2023-09-30T22:20:39.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.530+0000 7f83feffd700 1 -- 172.21.15.156:0/1817546292 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8410124ef0 con 0x7f841009f350 2023-09-30T22:20:39.530 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:39.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.532+0000 7f8414828700 1 -- 172.21.15.156:0/1817546292 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f841009f350 msgr2=0x7f84101c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:39.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.532+0000 7f8414828700 1 --2- 172.21.15.156:0/1817546292 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f841009f350 0x7f84101c8910 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f84040090b0 tx=0x7f8404004750 comp rx=0 tx=0).stop 2023-09-30T22:20:39.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.532+0000 7f8414828700 1 -- 172.21.15.156:0/1817546292 shutdown_connections 2023-09-30T22:20:39.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.532+0000 7f8414828700 1 --2- 172.21.15.156:0/1817546292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84101371c0 0x7f84101c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.532+0000 7f8414828700 1 --2- 172.21.15.156:0/1817546292 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f841009e870 0x7f84101c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.532+0000 7f8414828700 1 --2- 172.21.15.156:0/1817546292 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f841009f350 0x7f84101c8910 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:39.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.532+0000 7f8414828700 1 -- 172.21.15.156:0/1817546292 >> 172.21.15.156:0/1817546292 conn(0x7f84100a4430 msgr2=0x7f841009c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:39.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.532+0000 7f8414828700 1 -- 172.21.15.156:0/1817546292 shutdown_connections 2023-09-30T22:20:39.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:39.532+0000 7f8414828700 1 -- 172.21.15.156:0/1817546292 wait complete. 2023-09-30T22:20:39.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:40.480 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:40.488 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:40.518 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:40.545 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:40.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.625+0000 7f1abb49e700 1 Processor -- start 2023-09-30T22:20:40.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.626+0000 7f1abb49e700 1 -- start start 2023-09-30T22:20:40.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.626+0000 7f1abb49e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ab40a0a30 0x7f1ab40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:40.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.626+0000 7f1abb49e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1ab4130670 0x7f1ab41381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:40.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.626+0000 7f1abb49e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab40a1e70 con 0x7f1ab40a1340 2023-09-30T22:20:40.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.626+0000 7f1abb49e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab409a720 con 0x7f1ab40a0a30 2023-09-30T22:20:40.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.626+0000 7f1abb49e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab409b300 con 0x7f1ab4130670 2023-09-30T22:20:40.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.626+0000 7f1ab8a39700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f1ab40a1340 0x7f1ab412ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:60744/0 (socket says 172.21.15.156:60744) 2023-09-30T22:20:40.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.626+0000 7f1ab8a39700 1 -- 172.21.15.156:0/4029028099 learned_addr learned my addr 172.21.15.156:0/4029028099 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:40.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.626+0000 7f1ab9a3b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1ab4130670 0x7f1ab41381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:40.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.626+0000 7f1ab923a700 1 --2- 172.21.15.156:0/4029028099 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ab40a0a30 0x7f1ab40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:40.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.627+0000 7f1aabfff700 1 -- 172.21.15.156:0/4029028099 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3841003636 0 0) 0x7f1ab40a1e70 con 0x7f1ab40a1340 2023-09-30T22:20:40.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.627+0000 7f1aabfff700 1 -- 172.21.15.156:0/4029028099 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aa00035b0 con 0x7f1ab40a1340 2023-09-30T22:20:40.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.627+0000 7f1ab9a3b700 1 -- 172.21.15.156:0/4029028099 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ab40a0a30 msgr2=0x7f1ab40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:40.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.627+0000 7f1ab9a3b700 1 --2- 172.21.15.156:0/4029028099 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ab40a0a30 0x7f1ab40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.627+0000 7f1ab9a3b700 1 -- 172.21.15.156:0/4029028099 >> v1:172.21.15.156:6789/0 conn(0x7f1ab40a1340 legacy=0x7f1ab412ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:40.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.627+0000 7f1ab9a3b700 1 -- 172.21.15.156:0/4029028099 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab409abc0 con 0x7f1ab4130670 2023-09-30T22:20:40.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.627+0000 7f1ab9a3b700 1 --2- 172.21.15.156:0/4029028099 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1ab4130670 0x7f1ab41381c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1aac00aed0 tx=0x7f1aac00c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2883015cbfbecae server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:40.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.627+0000 7f1aabfff700 1 -- 172.21.15.156:0/4029028099 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac00f070 con 0x7f1ab4130670 2023-09-30T22:20:40.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.627+0000 7f1aabfff700 1 -- 172.21.15.156:0/4029028099 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aac00a2e0 con 0x7f1ab4130670 2023-09-30T22:20:40.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.627+0000 7f1aabfff700 1 -- 172.21.15.156:0/4029028099 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac00cc10 con 0x7f1ab4130670 2023-09-30T22:20:40.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.628+0000 7f1abb49e700 1 -- 172.21.15.156:0/4029028099 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1ab4130670 msgr2=0x7f1ab41381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:40.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.628+0000 7f1abb49e700 1 --2- 172.21.15.156:0/4029028099 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1ab4130670 0x7f1ab41381c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1aac00aed0 tx=0x7f1aac00c330 comp rx=0 tx=0).stop 2023-09-30T22:20:40.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.628+0000 7f1abb49e700 1 -- 172.21.15.156:0/4029028099 shutdown_connections 2023-09-30T22:20:40.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.628+0000 7f1abb49e700 1 --2- 172.21.15.156:0/4029028099 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ab40a0a30 0x7f1ab40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.628+0000 7f1abb49e700 1 --2- 172.21.15.156:0/4029028099 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1ab4130670 0x7f1ab41381c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.628+0000 7f1abb49e700 1 -- 172.21.15.156:0/4029028099 >> 172.21.15.156:0/4029028099 conn(0x7f1ab40a2980 msgr2=0x7f1ab40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:40.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.628+0000 7f1abb49e700 1 -- 172.21.15.156:0/4029028099 shutdown_connections 2023-09-30T22:20:40.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.628+0000 7f1abb49e700 1 -- 172.21.15.156:0/4029028099 wait complete. 2023-09-30T22:20:40.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.629+0000 7f1abb49e700 1 Processor -- start 2023-09-30T22:20:40.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.629+0000 7f1abb49e700 1 -- start start 2023-09-30T22:20:40.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.630+0000 7f1abb49e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ab40a0a30 0x7f1ab41266e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:40.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.630+0000 7f1abb49e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ab40a1340 0x7f1ab4126c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:40.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.630+0000 7f1abb49e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1ab4130670 0x7f1ab4127160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:40.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.630+0000 7f1abb49e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab4128880 con 0x7f1ab40a0a30 2023-09-30T22:20:40.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.630+0000 7f1abb49e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab409fa30 con 0x7f1ab40a1340 2023-09-30T22:20:40.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.630+0000 7f1abb49e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab409ae00 con 0x7f1ab4130670 2023-09-30T22:20:40.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.630+0000 7f1ab923a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ab40a0a30 0x7f1ab41266e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:40.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.630+0000 7f1ab9a3b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1ab4130670 0x7f1ab4127160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:40.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.630+0000 7f1ab923a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ab40a0a30 0x7f1ab41266e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49350/0 (socket says 172.21.15.156:49350) 2023-09-30T22:20:40.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.630+0000 7f1ab923a700 1 -- 172.21.15.156:0/1215644736 learned_addr learned my addr 172.21.15.156:0/1215644736 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:40.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.630+0000 7f1ab923a700 1 -- 172.21.15.156:0/1215644736 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1ab4130670 msgr2=0x7f1ab4127160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:40.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.630+0000 7f1ab923a700 1 --2- 172.21.15.156:0/1215644736 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1ab4130670 0x7f1ab4127160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.630+0000 7f1ab923a700 1 -- 172.21.15.156:0/1215644736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ab40a1340 msgr2=0x7f1ab4126c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:40.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.630+0000 7f1ab923a700 1 --2- 172.21.15.156:0/1215644736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ab40a1340 0x7f1ab4126c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.630+0000 7f1ab923a700 1 -- 172.21.15.156:0/1215644736 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aac00ab80 con 0x7f1ab40a0a30 2023-09-30T22:20:40.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.630+0000 7f1ab9a3b700 1 --2- 172.21.15.156:0/1215644736 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1ab4130670 0x7f1ab4127160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:40.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.631+0000 7f1ab923a700 1 --2- 172.21.15.156:0/1215644736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ab40a0a30 0x7f1ab41266e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1ab000e990 tx=0x7f1ab000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:40.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.631+0000 7f1aa9ffb700 1 -- 172.21.15.156:0/1215644736 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab00096f0 con 0x7f1ab40a0a30 2023-09-30T22:20:40.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.631+0000 7f1abb49e700 1 -- 172.21.15.156:0/1215644736 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab4129910 con 0x7f1ab40a0a30 2023-09-30T22:20:40.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.631+0000 7f1aa9ffb700 1 -- 172.21.15.156:0/1215644736 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab000c850 con 0x7f1ab40a0a30 2023-09-30T22:20:40.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.631+0000 7f1aa9ffb700 1 -- 172.21.15.156:0/1215644736 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab000eee0 con 0x7f1ab40a0a30 2023-09-30T22:20:40.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.631+0000 7f1abb49e700 1 -- 172.21.15.156:0/1215644736 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab4128a60 con 0x7f1ab40a0a30 2023-09-30T22:20:40.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.632+0000 7f1aa9ffb700 1 -- 172.21.15.156:0/1215644736 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1ab000cbc0 con 0x7f1ab40a0a30 2023-09-30T22:20:40.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.633+0000 7f1aa9ffb700 1 -- 172.21.15.156:0/1215644736 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1ab003fbc0 con 0x7f1ab40a0a30 2023-09-30T22:20:40.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.633+0000 7f1abb49e700 1 -- 172.21.15.156:0/1215644736 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab404f2a0 con 0x7f1ab40a0a30 2023-09-30T22:20:40.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.641+0000 7f1aa9ffb700 1 -- 172.21.15.156:0/1215644736 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1ab0021020 con 0x7f1ab40a0a30 2023-09-30T22:20:40.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.662+0000 7f47e97c4700 1 Processor -- start 2023-09-30T22:20:40.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.662+0000 7f47e97c4700 1 -- start start 2023-09-30T22:20:40.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.663+0000 7f47e97c4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e409d860 0x7f47e409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:40.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.663+0000 7f47e97c4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f47e4130eb0 0x7f47e4138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:40.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.663+0000 7f47e97c4700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e409aaa0 con 0x7f47e409e170 2023-09-30T22:20:40.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.663+0000 7f47e97c4700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e409f870 con 0x7f47e4130eb0 2023-09-30T22:20:40.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.663+0000 7f47e97c4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e409b360 con 0x7f47e409d860 2023-09-30T22:20:40.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.663+0000 7f47e2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e409d860 0x7f47e409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:40.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.663+0000 7f47e2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e409d860 0x7f47e409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59900/0 (socket says 172.21.15.156:59900) 2023-09-30T22:20:40.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.663+0000 7f47e2ffd700 1 -- 172.21.15.156:0/154845431 learned_addr learned my addr 172.21.15.156:0/154845431 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:40.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.663+0000 7f47e37fe700 1 --2- 172.21.15.156:0/154845431 >> v2:172.21.15.156:3300/0 conn(0x7f47e4130eb0 0x7f47e4138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:40.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.663+0000 7f47e37fe700 1 -- 172.21.15.156:0/154845431 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e409d860 msgr2=0x7f47e409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:40.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.663+0000 7f47e37fe700 1 --2- 172.21.15.156:0/154845431 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e409d860 0x7f47e409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.663+0000 7f47e37fe700 1 -- 172.21.15.156:0/154845431 >> v1:172.21.15.156:6789/0 conn(0x7f47e409e170 legacy=0x7f47e41307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:40.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.664+0000 7f47e37fe700 1 -- 172.21.15.156:0/154845431 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e409b620 con 0x7f47e4130eb0 2023-09-30T22:20:40.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.663+0000 7f47e1ffb700 1 -- 172.21.15.156:0/154845431 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543310734 0 0) 0x7f47e409aaa0 con 0x7f47e409e170 2023-09-30T22:20:40.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.664+0000 7f47e37fe700 1 --2- 172.21.15.156:0/154845431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47e4130eb0 0x7f47e4138a00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009d90 tx=0x7f47dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa4822fa22cf154 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:40.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.664+0000 7f47e1ffb700 1 -- 172.21.15.156:0/154845431 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc00e070 con 0x7f47e4130eb0 2023-09-30T22:20:40.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.664+0000 7f47e1ffb700 1 -- 172.21.15.156:0/154845431 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47dc00bb20 con 0x7f47e4130eb0 2023-09-30T22:20:40.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.664+0000 7f47e1ffb700 1 -- 172.21.15.156:0/154845431 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc012430 con 0x7f47e4130eb0 2023-09-30T22:20:40.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.665+0000 7f47e97c4700 1 -- 172.21.15.156:0/154845431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47e4130eb0 msgr2=0x7f47e4138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:40.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.665+0000 7f47e97c4700 1 --2- 172.21.15.156:0/154845431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47e4130eb0 0x7f47e4138a00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009d90 tx=0x7f47dc00b330 comp rx=0 tx=0).stop 2023-09-30T22:20:40.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.665+0000 7f47e97c4700 1 -- 172.21.15.156:0/154845431 shutdown_connections 2023-09-30T22:20:40.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.665+0000 7f47e97c4700 1 --2- 172.21.15.156:0/154845431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47e4130eb0 0x7f47e4138a00 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.665+0000 7f47e97c4700 1 --2- 172.21.15.156:0/154845431 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e409d860 0x7f47e409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.665+0000 7f47e97c4700 1 -- 172.21.15.156:0/154845431 >> 172.21.15.156:0/154845431 conn(0x7f47e4099c40 msgr2=0x7f47e40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:40.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.665+0000 7f47e97c4700 1 -- 172.21.15.156:0/154845431 shutdown_connections 2023-09-30T22:20:40.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.665+0000 7f47e97c4700 1 -- 172.21.15.156:0/154845431 wait complete. 2023-09-30T22:20:40.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.666+0000 7f47e97c4700 1 Processor -- start 2023-09-30T22:20:40.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.665+0000 7f1273c57700 1 Processor -- start 2023-09-30T22:20:40.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.665+0000 7f1273c57700 1 -- start start 2023-09-30T22:20:40.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.666+0000 7f1273c57700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f126c09b400 0x7f126c09b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:40.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.666+0000 7f1273c57700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f126c13d940 0x7f126c13fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:40.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.666+0000 7f1273c57700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f126c0a0a70 con 0x7f126c09bd10 2023-09-30T22:20:40.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.666+0000 7f1273c57700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126c09b190 con 0x7f126c09b400 2023-09-30T22:20:40.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.666+0000 7f1273c57700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f126c09a820 con 0x7f126c13d940 2023-09-30T22:20:40.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.666+0000 7f12719f3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f126c09b400 0x7f126c09b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:40.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.666+0000 7f12719f3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f126c09b400 0x7f126c09b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59902/0 (socket says 172.21.15.156:59902) 2023-09-30T22:20:40.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.666+0000 7f12719f3700 1 -- 172.21.15.156:0/2157520851 learned_addr learned my addr 172.21.15.156:0/2157520851 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:40.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.667+0000 7f47e97c4700 1 -- start start 2023-09-30T22:20:40.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.667+0000 7f12719f3700 1 -- 172.21.15.156:0/2157520851 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f126c13d940 msgr2=0x7f126c13fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:40.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.667+0000 7f12709f1700 1 -- 172.21.15.156:0/2157520851 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1385663718 0 0) 0x7f126c0a0a70 con 0x7f126c09bd10 2023-09-30T22:20:40.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.667+0000 7f12719f3700 1 --2- 172.21.15.156:0/2157520851 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f126c13d940 0x7f126c13fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.667+0000 7f12719f3700 1 -- 172.21.15.156:0/2157520851 >> v1:172.21.15.156:6789/0 conn(0x7f126c09bd10 legacy=0x7f126c13c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:40.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.667+0000 7f12719f3700 1 -- 172.21.15.156:0/2157520851 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c09a280 con 0x7f126c09b400 2023-09-30T22:20:40.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.667+0000 7f12719f3700 1 --2- 172.21.15.156:0/2157520851 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f126c09b400 0x7f126c09b7d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1268009950 tx=0x7f1268009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9339568ae5de87bd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:40.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.667+0000 7f12709f1700 1 -- 172.21.15.156:0/2157520851 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268009ea0 con 0x7f126c09b400 2023-09-30T22:20:40.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.667+0000 7f12709f1700 1 -- 172.21.15.156:0/2157520851 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126800ba20 con 0x7f126c09b400 2023-09-30T22:20:40.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.667+0000 7f12709f1700 1 -- 172.21.15.156:0/2157520851 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126800bdb0 con 0x7f126c09b400 2023-09-30T22:20:40.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.667+0000 7f47e97c4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e409d860 0x7f47e411e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:40.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.667+0000 7f47e97c4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47e409e170 0x7f47e411e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:40.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.667+0000 7f47e97c4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47e4130eb0 0x7f47e411ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:40.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.667+0000 7f47e97c4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e409c960 con 0x7f47e409e170 2023-09-30T22:20:40.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.667+0000 7f47e97c4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e4120dc0 con 0x7f47e409d860 2023-09-30T22:20:40.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.667+0000 7f47e97c4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47e411ff70 con 0x7f47e4130eb0 2023-09-30T22:20:40.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.667+0000 7f47e37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47e4130eb0 0x7f47e411ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:40.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.667+0000 7f47e2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e409d860 0x7f47e411e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:40.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.667+0000 7f47e2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e409d860 0x7f47e411e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59918/0 (socket says 172.21.15.156:59918) 2023-09-30T22:20:40.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.667+0000 7f47e37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47e4130eb0 0x7f47e411ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55040/0 (socket says 172.21.15.156:55040) 2023-09-30T22:20:40.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.667+0000 7f47e2ffd700 1 -- 172.21.15.156:0/4253597936 learned_addr learned my addr 172.21.15.156:0/4253597936 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:40.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.668+0000 7f47e2ffd700 1 -- 172.21.15.156:0/4253597936 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47e4130eb0 msgr2=0x7f47e411ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:40.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.668+0000 7f47e2ffd700 1 --2- 172.21.15.156:0/4253597936 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47e4130eb0 0x7f47e411ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.668+0000 7f47e2ffd700 1 -- 172.21.15.156:0/4253597936 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47e409e170 msgr2=0x7f47e411e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:40.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.668+0000 7f47e2ffd700 1 --2- 172.21.15.156:0/4253597936 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47e409e170 0x7f47e411e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.668+0000 7f47e2ffd700 1 -- 172.21.15.156:0/4253597936 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47dc009a70 con 0x7f47e409d860 2023-09-30T22:20:40.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.668+0000 7f1273c57700 1 -- 172.21.15.156:0/2157520851 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f126c09b400 msgr2=0x7f126c09b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:40.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.668+0000 7f1273c57700 1 --2- 172.21.15.156:0/2157520851 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f126c09b400 0x7f126c09b7d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1268009950 tx=0x7f1268009c60 comp rx=0 tx=0).stop 2023-09-30T22:20:40.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.668+0000 7f47e2ffd700 1 --2- 172.21.15.156:0/4253597936 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e409d860 0x7f47e411e2c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f47d400e940 tx=0x7f47d400ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:40.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.668+0000 7f1273c57700 1 -- 172.21.15.156:0/2157520851 shutdown_connections 2023-09-30T22:20:40.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.668+0000 7f1273c57700 1 --2- 172.21.15.156:0/2157520851 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f126c09b400 0x7f126c09b7d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.668+0000 7f1273c57700 1 --2- 172.21.15.156:0/2157520851 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f126c13d940 0x7f126c13fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.668+0000 7f1273c57700 1 -- 172.21.15.156:0/2157520851 >> 172.21.15.156:0/2157520851 conn(0x7f126c099c40 msgr2=0x7f126c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:40.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.668+0000 7f47cb7fe700 1 -- 172.21.15.156:0/4253597936 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d40096a0 con 0x7f47e409d860 2023-09-30T22:20:40.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.668+0000 7f47cb7fe700 1 -- 172.21.15.156:0/4253597936 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d400ee90 con 0x7f47e409d860 2023-09-30T22:20:40.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.668+0000 7f47cb7fe700 1 -- 172.21.15.156:0/4253597936 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d400ca90 con 0x7f47e409d860 2023-09-30T22:20:40.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.668+0000 7f1273c57700 1 -- 172.21.15.156:0/2157520851 shutdown_connections 2023-09-30T22:20:40.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.668+0000 7f47e97c4700 1 -- 172.21.15.156:0/4253597936 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e4130560 con 0x7f47e409d860 2023-09-30T22:20:40.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.668+0000 7f47e97c4700 1 -- 172.21.15.156:0/4253597936 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e4121de0 con 0x7f47e409d860 2023-09-30T22:20:40.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.668+0000 7f1273c57700 1 -- 172.21.15.156:0/2157520851 wait complete. 2023-09-30T22:20:40.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.669+0000 7f1273c57700 1 Processor -- start 2023-09-30T22:20:40.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.669+0000 7f1273c57700 1 -- start start 2023-09-30T22:20:40.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.670+0000 7f47e97c4700 1 -- 172.21.15.156:0/4253597936 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e404f2a0 con 0x7f47e409d860 2023-09-30T22:20:40.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.670+0000 7f1273c57700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f126c09b400 0x7f126c13ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:40.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.670+0000 7f1273c57700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f126c09bd10 0x7f126c13d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:40.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.670+0000 7f1273c57700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f126c13d940 0x7f126c11c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:40.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.670+0000 7f1273c57700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c11f1a0 con 0x7f126c09b400 2023-09-30T22:20:40.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.670+0000 7f1273c57700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126c09c630 con 0x7f126c13d940 2023-09-30T22:20:40.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.670+0000 7f1273c57700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f126c13cb40 con 0x7f126c09bd10 2023-09-30T22:20:40.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.670+0000 7f12711f2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f126c09bd10 0x7f126c13d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:40.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.670+0000 7f12711f2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f126c09bd10 0x7f126c13d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55042/0 (socket says 172.21.15.156:55042) 2023-09-30T22:20:40.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.670+0000 7f12711f2700 1 -- 172.21.15.156:0/394885242 learned_addr learned my addr 172.21.15.156:0/394885242 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:40.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.670+0000 7f12721f4700 1 --2- 172.21.15.156:0/394885242 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f126c13d940 0x7f126c11c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:40.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.670+0000 7f12719f3700 1 --2- 172.21.15.156:0/394885242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f126c09b400 0x7f126c13ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:40.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.670+0000 7f12711f2700 1 -- 172.21.15.156:0/394885242 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f126c13d940 msgr2=0x7f126c11c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:40.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.670+0000 7f12711f2700 1 --2- 172.21.15.156:0/394885242 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f126c13d940 0x7f126c11c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.670+0000 7f12711f2700 1 -- 172.21.15.156:0/394885242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f126c09b400 msgr2=0x7f126c13ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:40.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.670+0000 7f12711f2700 1 --2- 172.21.15.156:0/394885242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f126c09b400 0x7f126c13ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.670+0000 7f12711f2700 1 -- 172.21.15.156:0/394885242 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1268009550 con 0x7f126c09bd10 2023-09-30T22:20:40.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.671+0000 7f12711f2700 1 --2- 172.21.15.156:0/394885242 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f126c09bd10 0x7f126c13d3a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f125c00c550 tx=0x7f125c00c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:40.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.671+0000 7f12627fc700 1 -- 172.21.15.156:0/394885242 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c0054e0 con 0x7f126c09bd10 2023-09-30T22:20:40.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.671+0000 7f12627fc700 1 -- 172.21.15.156:0/394885242 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125c003680 con 0x7f126c09bd10 2023-09-30T22:20:40.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.671+0000 7f1273c57700 1 -- 172.21.15.156:0/394885242 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f126c11e020 con 0x7f126c09bd10 2023-09-30T22:20:40.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.671+0000 7f1273c57700 1 -- 172.21.15.156:0/394885242 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126c070a70 con 0x7f126c09bd10 2023-09-30T22:20:40.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.672+0000 7f12627fc700 1 -- 172.21.15.156:0/394885242 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c003a30 con 0x7f126c09bd10 2023-09-30T22:20:40.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.672+0000 7f12627fc700 1 -- 172.21.15.156:0/394885242 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f125c003bd0 con 0x7f126c09bd10 2023-09-30T22:20:40.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.672+0000 7f1273c57700 1 -- 172.21.15.156:0/394885242 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12540052e0 con 0x7f126c09bd10 2023-09-30T22:20:40.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.673+0000 7f12627fc700 1 -- 172.21.15.156:0/394885242 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f125c03ec60 con 0x7f126c09bd10 2023-09-30T22:20:40.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.673+0000 7f47cb7fe700 1 -- 172.21.15.156:0/4253597936 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f47d400cbf0 con 0x7f47e409d860 2023-09-30T22:20:40.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.673+0000 7f47cb7fe700 1 -- 172.21.15.156:0/4253597936 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f47d401bd80 con 0x7f47e409d860 2023-09-30T22:20:40.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.676+0000 7f47cb7fe700 1 -- 172.21.15.156:0/4253597936 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f47d40102b0 con 0x7f47e409d860 2023-09-30T22:20:40.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.680+0000 7f12627fc700 1 -- 172.21.15.156:0/394885242 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f125c01bb10 con 0x7f126c09bd10 2023-09-30T22:20:40.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.734+0000 7fb54510f700 1 Processor -- start 2023-09-30T22:20:40.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.734+0000 7fb54510f700 1 -- start start 2023-09-30T22:20:40.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.735+0000 7fb54510f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb54009d860 0x7fb54009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:40.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.735+0000 7fb54510f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb540130eb0 0x7fb540138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:40.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.735+0000 7fb54510f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54009aaa0 con 0x7fb54009e170 2023-09-30T22:20:40.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.735+0000 7fb54510f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54009f870 con 0x7fb54009d860 2023-09-30T22:20:40.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.735+0000 7fb54510f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54009b360 con 0x7fb540130eb0 2023-09-30T22:20:40.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.735+0000 7fb53f59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb540130eb0 0x7fb540138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:40.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.735+0000 7fb53f59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb540130eb0 0x7fb540138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59930/0 (socket says 172.21.15.156:59930) 2023-09-30T22:20:40.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.735+0000 7fb53f59e700 1 -- 172.21.15.156:0/71473183 learned_addr learned my addr 172.21.15.156:0/71473183 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:40.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.735+0000 7fb53ed9d700 1 --2- 172.21.15.156:0/71473183 >> v2:172.21.15.156:3300/0 conn(0x7fb54009d860 0x7fb54009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:40.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.735+0000 7fb53f59e700 1 -- 172.21.15.156:0/71473183 >> v2:172.21.15.156:3300/0 conn(0x7fb54009d860 msgr2=0x7fb54009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:40.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.735+0000 7fb53f59e700 1 --2- 172.21.15.156:0/71473183 >> v2:172.21.15.156:3300/0 conn(0x7fb54009d860 0x7fb54009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.735+0000 7fb53f59e700 1 -- 172.21.15.156:0/71473183 >> v1:172.21.15.156:6789/0 conn(0x7fb54009e170 legacy=0x7fb5401307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:40.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.735+0000 7fb53f59e700 1 -- 172.21.15.156:0/71473183 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54009b620 con 0x7fb540130eb0 2023-09-30T22:20:40.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.735+0000 7fb53dd9b700 1 -- 172.21.15.156:0/71473183 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906054319 0 0) 0x7fb54009aaa0 con 0x7fb54009e170 2023-09-30T22:20:40.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.736+0000 7fb53f59e700 1 --2- 172.21.15.156:0/71473183 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb540130eb0 0x7fb540138a00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb538009e50 tx=0x7fb53800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f2378d4871702b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:40.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.736+0000 7fb53dd9b700 1 -- 172.21.15.156:0/71473183 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53800e070 con 0x7fb540130eb0 2023-09-30T22:20:40.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.736+0000 7fb53dd9b700 1 -- 172.21.15.156:0/71473183 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53800b910 con 0x7fb540130eb0 2023-09-30T22:20:40.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.736+0000 7fb53dd9b700 1 -- 172.21.15.156:0/71473183 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53800bc80 con 0x7fb540130eb0 2023-09-30T22:20:40.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.737+0000 7fb54510f700 1 -- 172.21.15.156:0/71473183 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb540130eb0 msgr2=0x7fb540138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:40.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.737+0000 7fb54510f700 1 --2- 172.21.15.156:0/71473183 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb540130eb0 0x7fb540138a00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb538009e50 tx=0x7fb53800b330 comp rx=0 tx=0).stop 2023-09-30T22:20:40.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.737+0000 7fb54510f700 1 -- 172.21.15.156:0/71473183 shutdown_connections 2023-09-30T22:20:40.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.737+0000 7fb54510f700 1 --2- 172.21.15.156:0/71473183 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb540130eb0 0x7fb540138a00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.737+0000 7fb54510f700 1 --2- 172.21.15.156:0/71473183 >> v2:172.21.15.156:3300/0 conn(0x7fb54009d860 0x7fb54009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.737+0000 7fb54510f700 1 -- 172.21.15.156:0/71473183 >> 172.21.15.156:0/71473183 conn(0x7fb540099c40 msgr2=0x7fb5400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:40.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.737+0000 7fb54510f700 1 -- 172.21.15.156:0/71473183 shutdown_connections 2023-09-30T22:20:40.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.737+0000 7fb54510f700 1 -- 172.21.15.156:0/71473183 wait complete. 2023-09-30T22:20:40.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.738+0000 7fb54510f700 1 Processor -- start 2023-09-30T22:20:40.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.738+0000 7fb54510f700 1 -- start start 2023-09-30T22:20:40.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.738+0000 7fb54510f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb54009d860 0x7fb540138400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:40.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.738+0000 7fb54510f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb54009e170 0x7fb540138940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:40.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.738+0000 7fb54510f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb540130eb0 0x7fb5401c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:40.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.738+0000 7fb54510f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5400a07c0 con 0x7fb54009e170 2023-09-30T22:20:40.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.738+0000 7fb54510f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54009c8b0 con 0x7fb540130eb0 2023-09-30T22:20:40.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.738+0000 7fb54510f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb540137270 con 0x7fb54009d860 2023-09-30T22:20:40.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.739+0000 7fb53f59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb540130eb0 0x7fb5401c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:40.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.739+0000 7fb53f59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb540130eb0 0x7fb5401c8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59932/0 (socket says 172.21.15.156:59932) 2023-09-30T22:20:40.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.739+0000 7fb53f59e700 1 -- 172.21.15.156:0/1912430962 learned_addr learned my addr 172.21.15.156:0/1912430962 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:40.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.739+0000 7fb53e59c700 1 --2- 172.21.15.156:0/1912430962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb54009e170 0x7fb540138940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:40.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.739+0000 7fb53f59e700 1 -- 172.21.15.156:0/1912430962 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb54009d860 msgr2=0x7fb540138400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:40.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.739+0000 7fb53f59e700 1 --2- 172.21.15.156:0/1912430962 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb54009d860 0x7fb540138400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.739+0000 7fb53f59e700 1 -- 172.21.15.156:0/1912430962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb54009e170 msgr2=0x7fb540138940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:40.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.739+0000 7fb53f59e700 1 --2- 172.21.15.156:0/1912430962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb54009e170 0x7fb540138940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.739+0000 7fb53f59e700 1 -- 172.21.15.156:0/1912430962 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb538009b30 con 0x7fb540130eb0 2023-09-30T22:20:40.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.739+0000 7fb53f59e700 1 --2- 172.21.15.156:0/1912430962 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb540130eb0 0x7fb5401c8050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb5380042a0 tx=0x7fb538004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:40.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.739+0000 7fb5277fe700 1 -- 172.21.15.156:0/1912430962 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb538004940 con 0x7fb540130eb0 2023-09-30T22:20:40.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.739+0000 7fb5277fe700 1 -- 172.21.15.156:0/1912430962 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb538007160 con 0x7fb540130eb0 2023-09-30T22:20:40.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.739+0000 7fb5277fe700 1 -- 172.21.15.156:0/1912430962 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53801c670 con 0x7fb540130eb0 2023-09-30T22:20:40.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.739+0000 7fb54510f700 1 -- 172.21.15.156:0/1912430962 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54013bb40 con 0x7fb540130eb0 2023-09-30T22:20:40.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.739+0000 7fb54510f700 1 -- 172.21.15.156:0/1912430962 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb540139060 con 0x7fb540130eb0 2023-09-30T22:20:40.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.741+0000 7fb54510f700 1 -- 172.21.15.156:0/1912430962 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb540136ed0 con 0x7fb540130eb0 2023-09-30T22:20:40.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.741+0000 7fb5277fe700 1 -- 172.21.15.156:0/1912430962 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb53801c7d0 con 0x7fb540130eb0 2023-09-30T22:20:40.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.742+0000 7fb5277fe700 1 -- 172.21.15.156:0/1912430962 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb5380410b0 con 0x7fb540130eb0 2023-09-30T22:20:40.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.750+0000 7fb5277fe700 1 -- 172.21.15.156:0/1912430962 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb540136ed0 con 0x7fb540130eb0 2023-09-30T22:20:40.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.891+0000 7f1abb49e700 1 -- 172.21.15.156:0/1215644736 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1ab4129f00 con 0x7f1ab40a0a30 2023-09-30T22:20:40.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.892+0000 7f1aa9ffb700 1 -- 172.21.15.156:0/1215644736 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1ab0017070 con 0x7f1ab40a0a30 2023-09-30T22:20:40.891 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:40.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.894+0000 7f1abb49e700 1 -- 172.21.15.156:0/1215644736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ab40a0a30 msgr2=0x7f1ab41266e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:40.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.894+0000 7f1abb49e700 1 --2- 172.21.15.156:0/1215644736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ab40a0a30 0x7f1ab41266e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1ab000e990 tx=0x7f1ab000eca0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.894+0000 7f1abb49e700 1 -- 172.21.15.156:0/1215644736 shutdown_connections 2023-09-30T22:20:40.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.894+0000 7f1abb49e700 1 --2- 172.21.15.156:0/1215644736 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1ab4130670 0x7f1ab4127160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.894+0000 7f1abb49e700 1 --2- 172.21.15.156:0/1215644736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ab40a0a30 0x7f1ab41266e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.894+0000 7f1abb49e700 1 --2- 172.21.15.156:0/1215644736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ab40a1340 0x7f1ab4126c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.894+0000 7f1abb49e700 1 -- 172.21.15.156:0/1215644736 >> 172.21.15.156:0/1215644736 conn(0x7f1ab40a2980 msgr2=0x7f1ab4070c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:40.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.894+0000 7f1abb49e700 1 -- 172.21.15.156:0/1215644736 shutdown_connections 2023-09-30T22:20:40.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.894+0000 7f1abb49e700 1 -- 172.21.15.156:0/1215644736 wait complete. 2023-09-30T22:20:40.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.904+0000 7f47e97c4700 1 -- 172.21.15.156:0/4253597936 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f47e41218a0 con 0x7f47e409d860 2023-09-30T22:20:40.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.904+0000 7f47cb7fe700 1 -- 172.21.15.156:0/4253597936 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f47e41218a0 con 0x7f47e409d860 2023-09-30T22:20:40.904 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:40.907 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:40.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.907+0000 7f47e97c4700 1 -- 172.21.15.156:0/4253597936 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e409d860 msgr2=0x7f47e411e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:40.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.907+0000 7f47e97c4700 1 --2- 172.21.15.156:0/4253597936 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e409d860 0x7f47e411e2c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f47d400e940 tx=0x7f47d400ec50 comp rx=0 tx=0).stop 2023-09-30T22:20:40.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.907+0000 7f47e97c4700 1 -- 172.21.15.156:0/4253597936 shutdown_connections 2023-09-30T22:20:40.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.907+0000 7f47e97c4700 1 --2- 172.21.15.156:0/4253597936 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47e4130eb0 0x7f47e411ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.907+0000 7f47e97c4700 1 --2- 172.21.15.156:0/4253597936 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e409d860 0x7f47e411e2c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.907+0000 7f47e97c4700 1 --2- 172.21.15.156:0/4253597936 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47e409e170 0x7f47e411e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.907+0000 7f47e97c4700 1 -- 172.21.15.156:0/4253597936 >> 172.21.15.156:0/4253597936 conn(0x7f47e4099c40 msgr2=0x7f47e40721f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:40.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.909+0000 7f47e97c4700 1 -- 172.21.15.156:0/4253597936 shutdown_connections 2023-09-30T22:20:40.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.909+0000 7f47e97c4700 1 -- 172.21.15.156:0/4253597936 wait complete. 2023-09-30T22:20:40.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.909+0000 7f1273c57700 1 -- 172.21.15.156:0/394885242 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1254005590 con 0x7f126c09bd10 2023-09-30T22:20:40.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.909+0000 7f12627fc700 1 -- 172.21.15.156:0/394885242 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f125c0192c0 con 0x7f126c09bd10 2023-09-30T22:20:40.909 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:40.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.911+0000 7f1273c57700 1 -- 172.21.15.156:0/394885242 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f126c09bd10 msgr2=0x7f126c13d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:40.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.911+0000 7f1273c57700 1 --2- 172.21.15.156:0/394885242 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f126c09bd10 0x7f126c13d3a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f125c00c550 tx=0x7f125c00c860 comp rx=0 tx=0).stop 2023-09-30T22:20:40.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.911+0000 7f1273c57700 1 -- 172.21.15.156:0/394885242 shutdown_connections 2023-09-30T22:20:40.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.911+0000 7f1273c57700 1 --2- 172.21.15.156:0/394885242 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f126c13d940 0x7f126c11c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.911+0000 7f1273c57700 1 --2- 172.21.15.156:0/394885242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f126c09b400 0x7f126c13ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.911+0000 7f1273c57700 1 --2- 172.21.15.156:0/394885242 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f126c09bd10 0x7f126c13d3a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.911+0000 7f1273c57700 1 -- 172.21.15.156:0/394885242 >> 172.21.15.156:0/394885242 conn(0x7f126c099c40 msgr2=0x7f126c13dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:40.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.911+0000 7f1273c57700 1 -- 172.21.15.156:0/394885242 shutdown_connections 2023-09-30T22:20:40.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.911+0000 7f1273c57700 1 -- 172.21.15.156:0/394885242 wait complete. 2023-09-30T22:20:40.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:40.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:40.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.950+0000 7fb54510f700 1 -- 172.21.15.156:0/1912430962 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb540136ed0 con 0x7fb540130eb0 2023-09-30T22:20:40.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.950+0000 7fb5277fe700 1 -- 172.21.15.156:0/1912430962 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb540136ed0 con 0x7fb540130eb0 2023-09-30T22:20:40.950 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:40.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.952+0000 7fb54510f700 1 -- 172.21.15.156:0/1912430962 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb540130eb0 msgr2=0x7fb5401c8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:40.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.952+0000 7fb54510f700 1 --2- 172.21.15.156:0/1912430962 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb540130eb0 0x7fb5401c8050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb5380042a0 tx=0x7fb538004ad0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.952+0000 7fb54510f700 1 -- 172.21.15.156:0/1912430962 shutdown_connections 2023-09-30T22:20:40.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.952+0000 7fb54510f700 1 --2- 172.21.15.156:0/1912430962 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb540130eb0 0x7fb5401c8050 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.952+0000 7fb54510f700 1 --2- 172.21.15.156:0/1912430962 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb54009d860 0x7fb540138400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.952+0000 7fb54510f700 1 --2- 172.21.15.156:0/1912430962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb54009e170 0x7fb540138940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:40.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.952+0000 7fb54510f700 1 -- 172.21.15.156:0/1912430962 >> 172.21.15.156:0/1912430962 conn(0x7fb540099c40 msgr2=0x7fb540139540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:40.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.952+0000 7fb54510f700 1 -- 172.21.15.156:0/1912430962 shutdown_connections 2023-09-30T22:20:40.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:40.952+0000 7fb54510f700 1 -- 172.21.15.156:0/1912430962 wait complete. 2023-09-30T22:20:40.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:41.907 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:41.925 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:41.925 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:41.964 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:42.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.059+0000 7f6059f67700 1 Processor -- start 2023-09-30T22:20:42.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.059+0000 7f6059f67700 1 -- start start 2023-09-30T22:20:42.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.060+0000 7f6059f67700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f60540a0a30 0x7f60540a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:42.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.060+0000 7f6059f67700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6054130670 0x7f60541381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:42.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.060+0000 7f6059f67700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60540a1e70 con 0x7f60540a1340 2023-09-30T22:20:42.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.060+0000 7f6059f67700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f605409a720 con 0x7f60540a0a30 2023-09-30T22:20:42.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.060+0000 7f6059f67700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605409b300 con 0x7f6054130670 2023-09-30T22:20:42.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.060+0000 7f6053fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6054130670 0x7f60541381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:42.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.060+0000 7f6053fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6054130670 0x7f60541381c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40478/0 (socket says 172.21.15.156:40478) 2023-09-30T22:20:42.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.060+0000 7f6053fff700 1 -- 172.21.15.156:0/2411661979 learned_addr learned my addr 172.21.15.156:0/2411661979 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:42.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.060+0000 7f60537fe700 1 --2- 172.21.15.156:0/2411661979 >> v2:172.21.15.156:3300/0 conn(0x7f60540a0a30 0x7f60540a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:42.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.061+0000 7f6053fff700 1 -- 172.21.15.156:0/2411661979 >> v2:172.21.15.156:3300/0 conn(0x7f60540a0a30 msgr2=0x7f60540a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:42.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.061+0000 7f6053fff700 1 --2- 172.21.15.156:0/2411661979 >> v2:172.21.15.156:3300/0 conn(0x7f60540a0a30 0x7f60540a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.061+0000 7f6053fff700 1 -- 172.21.15.156:0/2411661979 >> v1:172.21.15.156:6789/0 conn(0x7f60540a1340 legacy=0x7f605412ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:42.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.061+0000 7f6053fff700 1 -- 172.21.15.156:0/2411661979 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605409abc0 con 0x7f6054130670 2023-09-30T22:20:42.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.061+0000 7f60537fe700 1 --2- 172.21.15.156:0/2411661979 >> v2:172.21.15.156:3300/0 conn(0x7f60540a0a30 0x7f60540a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:42.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.061+0000 7f6053fff700 1 --2- 172.21.15.156:0/2411661979 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6054130670 0x7f60541381c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f604c009d40 tx=0x7f604c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22b7f9002d99a0e9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:42.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.061+0000 7f60527fc700 1 -- 172.21.15.156:0/2411661979 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c009e90 con 0x7f6054130670 2023-09-30T22:20:42.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.061+0000 7f60527fc700 1 -- 172.21.15.156:0/2411661979 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604c003a20 con 0x7f6054130670 2023-09-30T22:20:42.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.061+0000 7f60527fc700 1 -- 172.21.15.156:0/2411661979 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c003dd0 con 0x7f6054130670 2023-09-30T22:20:42.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.062+0000 7f6059f67700 1 -- 172.21.15.156:0/2411661979 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6054130670 msgr2=0x7f60541381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:42.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.062+0000 7f6059f67700 1 --2- 172.21.15.156:0/2411661979 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6054130670 0x7f60541381c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f604c009d40 tx=0x7f604c00b330 comp rx=0 tx=0).stop 2023-09-30T22:20:42.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.062+0000 7f6059f67700 1 -- 172.21.15.156:0/2411661979 shutdown_connections 2023-09-30T22:20:42.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.062+0000 7f6059f67700 1 --2- 172.21.15.156:0/2411661979 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6054130670 0x7f60541381c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.062+0000 7f6059f67700 1 --2- 172.21.15.156:0/2411661979 >> v2:172.21.15.156:3300/0 conn(0x7f60540a0a30 0x7f60540a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.062+0000 7f6059f67700 1 -- 172.21.15.156:0/2411661979 >> 172.21.15.156:0/2411661979 conn(0x7f60540a2980 msgr2=0x7f60540a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:42.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.062+0000 7f6059f67700 1 -- 172.21.15.156:0/2411661979 shutdown_connections 2023-09-30T22:20:42.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.062+0000 7f6059f67700 1 -- 172.21.15.156:0/2411661979 wait complete. 2023-09-30T22:20:42.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.064+0000 7f6059f67700 1 Processor -- start 2023-09-30T22:20:42.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.064+0000 7f6059f67700 1 -- start start 2023-09-30T22:20:42.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.064+0000 7f6059f67700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60540a0a30 0x7f60541c3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:42.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.064+0000 7f6059f67700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60540a1340 0x7f60541c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:42.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.064+0000 7f6059f67700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6054130670 0x7f60541c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:42.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.064+0000 7f6059f67700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605411bd10 con 0x7f60540a0a30 2023-09-30T22:20:42.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.065+0000 7f6059f67700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605411bb20 con 0x7f6054130670 2023-09-30T22:20:42.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.065+0000 7f6059f67700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f605411da30 con 0x7f60540a1340 2023-09-30T22:20:42.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.065+0000 7f60537fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60540a0a30 0x7f60541c3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:42.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.065+0000 7f60537fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60540a0a30 0x7f60541c3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54270/0 (socket says 172.21.15.156:54270) 2023-09-30T22:20:42.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.065+0000 7f6052ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60540a1340 0x7f60541c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:42.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.065+0000 7f60537fe700 1 -- 172.21.15.156:0/2435621253 learned_addr learned my addr 172.21.15.156:0/2435621253 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:42.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.065+0000 7f6053fff700 1 --2- 172.21.15.156:0/2435621253 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6054130670 0x7f60541c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:42.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.065+0000 7f6052ffd700 1 -- 172.21.15.156:0/2435621253 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6054130670 msgr2=0x7f60541c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:42.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.065+0000 7f6052ffd700 1 --2- 172.21.15.156:0/2435621253 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6054130670 0x7f60541c4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.065+0000 7f6052ffd700 1 -- 172.21.15.156:0/2435621253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60540a0a30 msgr2=0x7f60541c3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:42.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.065+0000 7f6052ffd700 1 --2- 172.21.15.156:0/2435621253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60540a0a30 0x7f60541c3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.065+0000 7f6052ffd700 1 -- 172.21.15.156:0/2435621253 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6044009430 con 0x7f60540a1340 2023-09-30T22:20:42.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.065+0000 7f6052ffd700 1 --2- 172.21.15.156:0/2435621253 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60540a1340 0x7f60541c42e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f604800c750 tx=0x7f604800ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:42.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.065+0000 7f603bfff700 1 -- 172.21.15.156:0/2435621253 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60480054e0 con 0x7f60540a1340 2023-09-30T22:20:42.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.066+0000 7f603bfff700 1 -- 172.21.15.156:0/2435621253 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6048003680 con 0x7f60540a1340 2023-09-30T22:20:42.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.066+0000 7f6059f67700 1 -- 172.21.15.156:0/2435621253 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f604c00d040 con 0x7f60540a1340 2023-09-30T22:20:42.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.066+0000 7f603bfff700 1 -- 172.21.15.156:0/2435621253 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60480039f0 con 0x7f60540a1340 2023-09-30T22:20:42.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.066+0000 7f6059f67700 1 -- 172.21.15.156:0/2435621253 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f605411d750 con 0x7f60540a1340 2023-09-30T22:20:42.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.067+0000 7f603bfff700 1 -- 172.21.15.156:0/2435621253 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6048003b50 con 0x7f60540a1340 2023-09-30T22:20:42.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.067+0000 7f603bfff700 1 -- 172.21.15.156:0/2435621253 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6048040ca0 con 0x7f60540a1340 2023-09-30T22:20:42.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.067+0000 7f6059f67700 1 -- 172.21.15.156:0/2435621253 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f605404f2a0 con 0x7f60540a1340 2023-09-30T22:20:42.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.072+0000 7f603bfff700 1 -- 172.21.15.156:0/2435621253 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6048044060 con 0x7f60540a1340 2023-09-30T22:20:42.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.091+0000 7fdb882df700 1 Processor -- start 2023-09-30T22:20:42.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.091+0000 7fdb882df700 1 -- start start 2023-09-30T22:20:42.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.091+0000 7f54b6673700 1 Processor -- start 2023-09-30T22:20:42.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.092+0000 7f54b6673700 1 -- start start 2023-09-30T22:20:42.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.092+0000 7f54b6673700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f54b0133900 0x7f54b0133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:42.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.092+0000 7f54b6673700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54b0134210 0x7f54b00a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:42.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.092+0000 7fdb882df700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdb80133ad0 0x7fdb80133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:42.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.092+0000 7fdb882df700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb801300a0 0x7fdb801304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:42.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.092+0000 7f54b6673700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54b00a0ee0 0x7f54b00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:42.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.092+0000 7f54b6673700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b009a760 con 0x7f54b0133900 2023-09-30T22:20:42.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.092+0000 7f54b6673700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b01336e0 con 0x7f54b00a0ee0 2023-09-30T22:20:42.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.092+0000 7f54b6673700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54b009a080 con 0x7f54b0134210 2023-09-30T22:20:42.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.092+0000 7fdb882df700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb8006b2d0 con 0x7fdb801309f0 2023-09-30T22:20:42.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.092+0000 7fdb882df700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb80133610 con 0x7fdb80133ad0 2023-09-30T22:20:42.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.092+0000 7fdb882df700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8009a500 con 0x7fdb801300a0 2023-09-30T22:20:42.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.092+0000 7f54b4c10700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54b00a0ee0 0x7f54b00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:42.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.092+0000 7f54b4c10700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54b00a0ee0 0x7f54b00a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40502/0 (socket says 172.21.15.156:40502) 2023-09-30T22:20:42.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.092+0000 7f54b4c10700 1 -- 172.21.15.156:0/341434692 learned_addr learned my addr 172.21.15.156:0/341434692 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:42.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.092+0000 7fdb8607b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdb80133ad0 0x7fdb80133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:42.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.092+0000 7f54affff700 1 --2- 172.21.15.156:0/341434692 >> v2:172.21.15.156:3300/0 conn(0x7f54b0133900 0x7f54b0133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:42.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.092+0000 7fdb8607b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdb80133ad0 0x7fdb80133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54286/0 (socket says 172.21.15.156:54286) 2023-09-30T22:20:42.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.092+0000 7fdb8607b700 1 -- 172.21.15.156:0/4103446239 learned_addr learned my addr 172.21.15.156:0/4103446239 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:42.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.093+0000 7fdb8607b700 1 -- 172.21.15.156:0/4103446239 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb801300a0 msgr2=0x7fdb801304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:42.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.093+0000 7fdb8607b700 1 --2- 172.21.15.156:0/4103446239 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb801300a0 0x7fdb801304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.093+0000 7fdb8607b700 1 -- 172.21.15.156:0/4103446239 >> v1:172.21.15.156:6789/0 conn(0x7fdb801309f0 legacy=0x7fdb8013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:42.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.093+0000 7fdb8607b700 1 -- 172.21.15.156:0/4103446239 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb801338b0 con 0x7fdb80133ad0 2023-09-30T22:20:42.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.093+0000 7f54b4c10700 1 -- 172.21.15.156:0/341434692 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54b0134210 msgr2=0x7f54b00a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:42.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.093+0000 7f54b4c10700 1 --2- 172.21.15.156:0/341434692 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54b0134210 0x7f54b00a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.093+0000 7f54b4c10700 1 -- 172.21.15.156:0/341434692 >> v2:172.21.15.156:3300/0 conn(0x7f54b0133900 msgr2=0x7f54b0133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:42.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.093+0000 7f54b4c10700 1 --2- 172.21.15.156:0/341434692 >> v2:172.21.15.156:3300/0 conn(0x7f54b0133900 0x7f54b0133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.093+0000 7f54b4c10700 1 -- 172.21.15.156:0/341434692 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b00a23e0 con 0x7f54b00a0ee0 2023-09-30T22:20:42.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.093+0000 7f54b4c10700 1 --2- 172.21.15.156:0/341434692 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54b00a0ee0 0x7f54b00a1340 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f54a8009e50 tx=0x7f54a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa32ab88407041bc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:42.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.093+0000 7fdb8607b700 1 --2- 172.21.15.156:0/4103446239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb80133ad0 0x7fdb80133ea0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c0098f0 tx=0x7fdb7c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18fb2f0fc1e63b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:42.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.093+0000 7f54aeffd700 1 -- 172.21.15.156:0/341434692 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a800e070 con 0x7f54b00a0ee0 2023-09-30T22:20:42.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.093+0000 7f54aeffd700 1 -- 172.21.15.156:0/341434692 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a800b910 con 0x7f54b00a0ee0 2023-09-30T22:20:42.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.093+0000 7f54aeffd700 1 -- 172.21.15.156:0/341434692 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a800bcc0 con 0x7f54b00a0ee0 2023-09-30T22:20:42.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.093+0000 7fdb85079700 1 -- 172.21.15.156:0/4103446239 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c00b8a0 con 0x7fdb80133ad0 2023-09-30T22:20:42.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.093+0000 7fdb85079700 1 -- 172.21.15.156:0/4103446239 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7c00ba00 con 0x7fdb80133ad0 2023-09-30T22:20:42.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.093+0000 7fdb85079700 1 -- 172.21.15.156:0/4103446239 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c00bd90 con 0x7fdb80133ad0 2023-09-30T22:20:42.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.094+0000 7f54b6673700 1 -- 172.21.15.156:0/341434692 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54b00a0ee0 msgr2=0x7f54b00a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:42.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.094+0000 7f54b6673700 1 --2- 172.21.15.156:0/341434692 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54b00a0ee0 0x7f54b00a1340 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f54a8009e50 tx=0x7f54a800b330 comp rx=0 tx=0).stop 2023-09-30T22:20:42.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.094+0000 7fdb882df700 1 -- 172.21.15.156:0/4103446239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb80133ad0 msgr2=0x7fdb80133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:42.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.094+0000 7fdb882df700 1 --2- 172.21.15.156:0/4103446239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb80133ad0 0x7fdb80133ea0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c0098f0 tx=0x7fdb7c009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:42.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.094+0000 7f54b6673700 1 -- 172.21.15.156:0/341434692 shutdown_connections 2023-09-30T22:20:42.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.094+0000 7f54b6673700 1 --2- 172.21.15.156:0/341434692 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54b00a0ee0 0x7f54b00a1340 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.094+0000 7f54b6673700 1 --2- 172.21.15.156:0/341434692 >> v2:172.21.15.156:3300/0 conn(0x7f54b0133900 0x7f54b0133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.094+0000 7f54b6673700 1 --2- 172.21.15.156:0/341434692 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54b0134210 0x7f54b00a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.094+0000 7f54b6673700 1 -- 172.21.15.156:0/341434692 >> 172.21.15.156:0/341434692 conn(0x7f54b00a2980 msgr2=0x7f54b00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:42.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.094+0000 7fdb882df700 1 -- 172.21.15.156:0/4103446239 shutdown_connections 2023-09-30T22:20:42.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.094+0000 7fdb882df700 1 --2- 172.21.15.156:0/4103446239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb80133ad0 0x7fdb80133ea0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.094+0000 7fdb882df700 1 --2- 172.21.15.156:0/4103446239 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb801300a0 0x7fdb801304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.094+0000 7fdb882df700 1 -- 172.21.15.156:0/4103446239 >> 172.21.15.156:0/4103446239 conn(0x7fdb80099c40 msgr2=0x7fdb800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:42.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.094+0000 7f54b6673700 1 -- 172.21.15.156:0/341434692 shutdown_connections 2023-09-30T22:20:42.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.094+0000 7f54b6673700 1 -- 172.21.15.156:0/341434692 wait complete. 2023-09-30T22:20:42.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.094+0000 7fdb882df700 1 -- 172.21.15.156:0/4103446239 shutdown_connections 2023-09-30T22:20:42.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.094+0000 7fdb882df700 1 -- 172.21.15.156:0/4103446239 wait complete. 2023-09-30T22:20:42.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.095+0000 7f54b6673700 1 Processor -- start 2023-09-30T22:20:42.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.095+0000 7fdb882df700 1 Processor -- start 2023-09-30T22:20:42.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.096+0000 7f54b6673700 1 -- start start 2023-09-30T22:20:42.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.095+0000 7fdb882df700 1 -- start start 2023-09-30T22:20:42.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.096+0000 7fdb882df700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb801300a0 0x7fdb80071760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:42.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.096+0000 7fdb882df700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb801309f0 0x7fdb80071ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:42.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.096+0000 7fdb882df700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb80133ad0 0x7fdb801cc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:42.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.096+0000 7fdb882df700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8006e900 con 0x7fdb801300a0 2023-09-30T22:20:42.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.096+0000 7fdb882df700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8006fef0 con 0x7fdb80133ad0 2023-09-30T22:20:42.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.096+0000 7fdb882df700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8006f530 con 0x7fdb801309f0 2023-09-30T22:20:42.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.096+0000 7f54b6673700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54b00a0ee0 0x7f54b011c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:42.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.096+0000 7f54b6673700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54b0133900 0x7f54b011cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:42.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.096+0000 7f54b6673700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54b0134210 0x7f54b011d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:42.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.096+0000 7f54b6673700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b011db80 con 0x7f54b00a0ee0 2023-09-30T22:20:42.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.096+0000 7f54b6673700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b011e2e0 con 0x7f54b0134210 2023-09-30T22:20:42.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.096+0000 7f54b6673700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54b011f530 con 0x7f54b0133900 2023-09-30T22:20:42.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.096+0000 7fdb8587a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb801309f0 0x7fdb80071ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:42.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.096+0000 7fdb8587a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb801309f0 0x7fdb80071ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43326/0 (socket says 172.21.15.156:43326) 2023-09-30T22:20:42.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.096+0000 7fdb8587a700 1 -- 172.21.15.156:0/3188475805 learned_addr learned my addr 172.21.15.156:0/3188475805 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:42.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.096+0000 7f54af7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54b0133900 0x7f54b011cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:42.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.096+0000 7f54af7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54b0133900 0x7f54b011cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43342/0 (socket says 172.21.15.156:43342) 2023-09-30T22:20:42.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.096+0000 7f54af7fe700 1 -- 172.21.15.156:0/312595009 learned_addr learned my addr 172.21.15.156:0/312595009 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:42.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.096+0000 7f54b4c10700 1 --2- 172.21.15.156:0/312595009 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54b0134210 0x7f54b011d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:42.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.097+0000 7fdb8687c700 1 --2- 172.21.15.156:0/3188475805 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb80133ad0 0x7fdb801cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:42.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.097+0000 7f54af7fe700 1 -- 172.21.15.156:0/312595009 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54b0134210 msgr2=0x7f54b011d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:42.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.097+0000 7f54af7fe700 1 --2- 172.21.15.156:0/312595009 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54b0134210 0x7f54b011d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.097+0000 7f54af7fe700 1 -- 172.21.15.156:0/312595009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54b00a0ee0 msgr2=0x7f54b011c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:42.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.097+0000 7f54af7fe700 1 --2- 172.21.15.156:0/312595009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54b00a0ee0 0x7f54b011c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.097+0000 7f54af7fe700 1 -- 172.21.15.156:0/312595009 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a8009b30 con 0x7f54b0133900 2023-09-30T22:20:42.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.097+0000 7f54af7fe700 1 --2- 172.21.15.156:0/312595009 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54b0133900 0x7f54b011cc10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f54a400b560 tx=0x7f54a400b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:42.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.097+0000 7fdb8587a700 1 -- 172.21.15.156:0/3188475805 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb80133ad0 msgr2=0x7fdb801cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:42.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.097+0000 7fdb8587a700 1 --2- 172.21.15.156:0/3188475805 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb80133ad0 0x7fdb801cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.097+0000 7fdb8587a700 1 -- 172.21.15.156:0/3188475805 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb801300a0 msgr2=0x7fdb80071760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:42.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.097+0000 7fdb8587a700 1 --2- 172.21.15.156:0/3188475805 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb801300a0 0x7fdb80071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.097+0000 7fdb8587a700 1 -- 172.21.15.156:0/3188475805 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7c009550 con 0x7fdb801309f0 2023-09-30T22:20:42.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.097+0000 7f54acff9700 1 -- 172.21.15.156:0/312595009 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a4011830 con 0x7f54b0133900 2023-09-30T22:20:42.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.097+0000 7f54acff9700 1 -- 172.21.15.156:0/312595009 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a40119b0 con 0x7f54b0133900 2023-09-30T22:20:42.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.097+0000 7f54acff9700 1 -- 172.21.15.156:0/312595009 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a4011d60 con 0x7f54b0133900 2023-09-30T22:20:42.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.097+0000 7fdb8587a700 1 --2- 172.21.15.156:0/3188475805 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb801309f0 0x7fdb80071ca0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000b4a0 tx=0x7fdb7000b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:42.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.097+0000 7f54b6673700 1 -- 172.21.15.156:0/312595009 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b011ff10 con 0x7f54b0133900 2023-09-30T22:20:42.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.097+0000 7f54b6673700 1 -- 172.21.15.156:0/312595009 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b009c2f0 con 0x7f54b0133900 2023-09-30T22:20:42.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.098+0000 7f54b6673700 1 -- 172.21.15.156:0/312595009 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b004f2a0 con 0x7f54b0133900 2023-09-30T22:20:42.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.098+0000 7f54acff9700 1 -- 172.21.15.156:0/312595009 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f54a401a400 con 0x7f54b0133900 2023-09-30T22:20:42.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.098+0000 7f54acff9700 1 -- 172.21.15.156:0/312595009 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f54a403f600 con 0x7f54b0133900 2023-09-30T22:20:42.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.098+0000 7fdb76ffd700 1 -- 172.21.15.156:0/3188475805 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70011830 con 0x7fdb801309f0 2023-09-30T22:20:42.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.098+0000 7fdb76ffd700 1 -- 172.21.15.156:0/3188475805 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb70011990 con 0x7fdb801309f0 2023-09-30T22:20:42.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.098+0000 7fdb76ffd700 1 -- 172.21.15.156:0/3188475805 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70011d40 con 0x7fdb801309f0 2023-09-30T22:20:42.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.099+0000 7fdb882df700 1 -- 172.21.15.156:0/3188475805 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb8012dd00 con 0x7fdb801309f0 2023-09-30T22:20:42.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.099+0000 7fdb882df700 1 -- 172.21.15.156:0/3188475805 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb800721e0 con 0x7fdb801309f0 2023-09-30T22:20:42.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.100+0000 7fdb882df700 1 -- 172.21.15.156:0/3188475805 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb8004f2a0 con 0x7fdb801309f0 2023-09-30T22:20:42.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.103+0000 7f54acff9700 1 -- 172.21.15.156:0/312595009 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f54a400f8d0 con 0x7f54b0133900 2023-09-30T22:20:42.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.104+0000 7fdb76ffd700 1 -- 172.21.15.156:0/3188475805 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb7001a400 con 0x7fdb801309f0 2023-09-30T22:20:42.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.104+0000 7fdb76ffd700 1 -- 172.21.15.156:0/3188475805 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdb7003fd20 con 0x7fdb801309f0 2023-09-30T22:20:42.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.108+0000 7fdb76ffd700 1 -- 172.21.15.156:0/3188475805 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb700216f0 con 0x7fdb801309f0 2023-09-30T22:20:42.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.158+0000 7fbefb358700 1 Processor -- start 2023-09-30T22:20:42.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.158+0000 7fbefb358700 1 -- start start 2023-09-30T22:20:42.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.159+0000 7fbefb358700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbef409e870 0x7fbef409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:42.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.159+0000 7fbefb358700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbef409f180 0x7fbef4131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:42.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.159+0000 7fbefb358700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbef4131d70 0x7fbef41321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:42.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.159+0000 7fbefb358700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef40a0920 con 0x7fbef409e870 2023-09-30T22:20:42.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.159+0000 7fbefb358700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef409c970 con 0x7fbef4131d70 2023-09-30T22:20:42.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.159+0000 7fbefb358700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbef409bab0 con 0x7fbef409f180 2023-09-30T22:20:42.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.159+0000 7fbef90f4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbef409e870 0x7fbef409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:42.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.159+0000 7fbef90f4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbef409e870 0x7fbef409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54310/0 (socket says 172.21.15.156:54310) 2023-09-30T22:20:42.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.159+0000 7fbef90f4700 1 -- 172.21.15.156:0/18013937 learned_addr learned my addr 172.21.15.156:0/18013937 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:42.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.159+0000 7fbef88f3700 1 --2- 172.21.15.156:0/18013937 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbef409f180 0x7fbef4131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:42.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.159+0000 7fbef98f5700 1 --2- 172.21.15.156:0/18013937 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbef4131d70 0x7fbef41321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:42.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.160+0000 7fbef90f4700 1 -- 172.21.15.156:0/18013937 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbef409f180 msgr2=0x7fbef4131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:42.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.160+0000 7fbef90f4700 1 --2- 172.21.15.156:0/18013937 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbef409f180 0x7fbef4131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.160+0000 7fbef90f4700 1 -- 172.21.15.156:0/18013937 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbef4131d70 msgr2=0x7fbef41321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:42.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.160+0000 7fbef90f4700 1 --2- 172.21.15.156:0/18013937 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbef4131d70 0x7fbef41321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.160+0000 7fbef90f4700 1 -- 172.21.15.156:0/18013937 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef409f9c0 con 0x7fbef409e870 2023-09-30T22:20:42.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.160+0000 7fbef90f4700 1 --2- 172.21.15.156:0/18013937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbef409e870 0x7fbef409ec40 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbef0009920 tx=0x7fbef0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4c82b7eb044b9e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:42.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.160+0000 7fbeebfff700 1 -- 172.21.15.156:0/18013937 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef0011830 con 0x7fbef409e870 2023-09-30T22:20:42.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.160+0000 7fbeebfff700 1 -- 172.21.15.156:0/18013937 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef0011990 con 0x7fbef409e870 2023-09-30T22:20:42.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.160+0000 7fbeebfff700 1 -- 172.21.15.156:0/18013937 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef0011d20 con 0x7fbef409e870 2023-09-30T22:20:42.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.161+0000 7fbefb358700 1 -- 172.21.15.156:0/18013937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbef409e870 msgr2=0x7fbef409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:42.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.161+0000 7fbefb358700 1 --2- 172.21.15.156:0/18013937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbef409e870 0x7fbef409ec40 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbef0009920 tx=0x7fbef0009c30 comp rx=0 tx=0).stop 2023-09-30T22:20:42.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.161+0000 7fbefb358700 1 -- 172.21.15.156:0/18013937 shutdown_connections 2023-09-30T22:20:42.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.161+0000 7fbefb358700 1 --2- 172.21.15.156:0/18013937 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbef4131d70 0x7fbef41321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.161+0000 7fbefb358700 1 --2- 172.21.15.156:0/18013937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbef409e870 0x7fbef409ec40 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.161+0000 7fbefb358700 1 --2- 172.21.15.156:0/18013937 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbef409f180 0x7fbef4131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.161+0000 7fbefb358700 1 -- 172.21.15.156:0/18013937 >> 172.21.15.156:0/18013937 conn(0x7fbef40a4430 msgr2=0x7fbef40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:42.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.161+0000 7fbefb358700 1 -- 172.21.15.156:0/18013937 shutdown_connections 2023-09-30T22:20:42.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.161+0000 7fbefb358700 1 -- 172.21.15.156:0/18013937 wait complete. 2023-09-30T22:20:42.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.162+0000 7fbefb358700 1 Processor -- start 2023-09-30T22:20:42.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.162+0000 7fbefb358700 1 -- start start 2023-09-30T22:20:42.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.162+0000 7fbefb358700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbef409e870 0x7fbef41c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:42.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.162+0000 7fbefb358700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbef409f180 0x7fbef41c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:42.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.162+0000 7fbefb358700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbef4131d70 0x7fbef41c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:42.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.162+0000 7fbefb358700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef409dba0 con 0x7fbef409e870 2023-09-30T22:20:42.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.162+0000 7fbefb358700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef411aa20 con 0x7fbef4131d70 2023-09-30T22:20:42.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.162+0000 7fbefb358700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbef411b720 con 0x7fbef409f180 2023-09-30T22:20:42.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.163+0000 7fbef90f4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbef409e870 0x7fbef41c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:42.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.163+0000 7fbef90f4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbef409e870 0x7fbef41c5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54312/0 (socket says 172.21.15.156:54312) 2023-09-30T22:20:42.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.163+0000 7fbef90f4700 1 -- 172.21.15.156:0/2442234579 learned_addr learned my addr 172.21.15.156:0/2442234579 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:42.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.163+0000 7fbef98f5700 1 --2- 172.21.15.156:0/2442234579 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbef4131d70 0x7fbef41c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:42.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.163+0000 7fbef88f3700 1 --2- 172.21.15.156:0/2442234579 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbef409f180 0x7fbef41c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:42.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.163+0000 7fbef98f5700 1 -- 172.21.15.156:0/2442234579 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbef409f180 msgr2=0x7fbef41c59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:42.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.163+0000 7fbef98f5700 1 --2- 172.21.15.156:0/2442234579 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbef409f180 0x7fbef41c59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.163+0000 7fbef98f5700 1 -- 172.21.15.156:0/2442234579 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbef409e870 msgr2=0x7fbef41c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:42.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.163+0000 7fbef98f5700 1 --2- 172.21.15.156:0/2442234579 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbef409e870 0x7fbef41c5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.163+0000 7fbef98f5700 1 -- 172.21.15.156:0/2442234579 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef0009550 con 0x7fbef4131d70 2023-09-30T22:20:42.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.163+0000 7fbef88f3700 1 --2- 172.21.15.156:0/2442234579 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbef409f180 0x7fbef41c59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:20:42.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.163+0000 7fbef98f5700 1 --2- 172.21.15.156:0/2442234579 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbef4131d70 0x7fbef41c83c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbeec00efc0 tx=0x7fbeec00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:42.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.163+0000 7fbee9ffb700 1 -- 172.21.15.156:0/2442234579 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec00cd40 con 0x7fbef4131d70 2023-09-30T22:20:42.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.163+0000 7fbee9ffb700 1 -- 172.21.15.156:0/2442234579 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeec00f040 con 0x7fbef4131d70 2023-09-30T22:20:42.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.163+0000 7fbefb358700 1 -- 172.21.15.156:0/2442234579 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef4138090 con 0x7fbef4131d70 2023-09-30T22:20:42.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.163+0000 7fbee9ffb700 1 -- 172.21.15.156:0/2442234579 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec0146c0 con 0x7fbef4131d70 2023-09-30T22:20:42.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.164+0000 7fbefb358700 1 -- 172.21.15.156:0/2442234579 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef4137640 con 0x7fbef4131d70 2023-09-30T22:20:42.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.164+0000 7fbee9ffb700 1 -- 172.21.15.156:0/2442234579 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbeec014820 con 0x7fbef4131d70 2023-09-30T22:20:42.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.165+0000 7fbee9ffb700 1 -- 172.21.15.156:0/2442234579 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbeec040250 con 0x7fbef4131d70 2023-09-30T22:20:42.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.165+0000 7fbefb358700 1 -- 172.21.15.156:0/2442234579 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef404f2a0 con 0x7fbef4131d70 2023-09-30T22:20:42.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.174+0000 7fbee9ffb700 1 -- 172.21.15.156:0/2442234579 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbeec018020 con 0x7fbef4131d70 2023-09-30T22:20:42.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.304+0000 7f6059f67700 1 -- 172.21.15.156:0/2435621253 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f605411c310 con 0x7f60540a1340 2023-09-30T22:20:42.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.304+0000 7f603bfff700 1 -- 172.21.15.156:0/2435621253 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6048003e00 con 0x7f60540a1340 2023-09-30T22:20:42.305 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:42.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.306+0000 7f6059f67700 1 -- 172.21.15.156:0/2435621253 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60540a1340 msgr2=0x7f60541c42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:42.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.306+0000 7f6059f67700 1 --2- 172.21.15.156:0/2435621253 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60540a1340 0x7f60541c42e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f604800c750 tx=0x7f604800ca60 comp rx=0 tx=0).stop 2023-09-30T22:20:42.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.306+0000 7f6059f67700 1 -- 172.21.15.156:0/2435621253 shutdown_connections 2023-09-30T22:20:42.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.306+0000 7f6059f67700 1 --2- 172.21.15.156:0/2435621253 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6054130670 0x7f60541c4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.306+0000 7f6059f67700 1 --2- 172.21.15.156:0/2435621253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60540a0a30 0x7f60541c3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.306+0000 7f6059f67700 1 --2- 172.21.15.156:0/2435621253 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60540a1340 0x7f60541c42e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.306+0000 7f6059f67700 1 -- 172.21.15.156:0/2435621253 >> 172.21.15.156:0/2435621253 conn(0x7f60540a2980 msgr2=0x7f605409e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:42.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.307+0000 7f6059f67700 1 -- 172.21.15.156:0/2435621253 shutdown_connections 2023-09-30T22:20:42.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.307+0000 7f6059f67700 1 -- 172.21.15.156:0/2435621253 wait complete. 2023-09-30T22:20:42.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.309+0000 7f54b6673700 1 -- 172.21.15.156:0/312595009 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f54b011fbb0 con 0x7f54b0133900 2023-09-30T22:20:42.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.310+0000 7f54acff9700 1 -- 172.21.15.156:0/312595009 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f54a4015030 con 0x7f54b0133900 2023-09-30T22:20:42.310 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:42.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.312+0000 7f54b6673700 1 -- 172.21.15.156:0/312595009 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54b0133900 msgr2=0x7f54b011cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:42.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.312+0000 7f54b6673700 1 --2- 172.21.15.156:0/312595009 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54b0133900 0x7f54b011cc10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f54a400b560 tx=0x7f54a400b870 comp rx=0 tx=0).stop 2023-09-30T22:20:42.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.312+0000 7f54b6673700 1 -- 172.21.15.156:0/312595009 shutdown_connections 2023-09-30T22:20:42.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.312+0000 7f54b6673700 1 --2- 172.21.15.156:0/312595009 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54b0134210 0x7f54b011d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.312+0000 7f54b6673700 1 --2- 172.21.15.156:0/312595009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54b00a0ee0 0x7f54b011c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.312+0000 7f54b6673700 1 --2- 172.21.15.156:0/312595009 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54b0133900 0x7f54b011cc10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.312+0000 7f54b6673700 1 -- 172.21.15.156:0/312595009 >> 172.21.15.156:0/312595009 conn(0x7f54b00a2980 msgr2=0x7f54b01baf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:42.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.312+0000 7f54b6673700 1 -- 172.21.15.156:0/312595009 shutdown_connections 2023-09-30T22:20:42.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.312+0000 7f54b6673700 1 -- 172.21.15.156:0/312595009 wait complete. 2023-09-30T22:20:42.321 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:42.326 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:42.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.339+0000 7fdb882df700 1 -- 172.21.15.156:0/3188475805 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdb8006c3b0 con 0x7fdb801309f0 2023-09-30T22:20:42.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.339+0000 7fdb76ffd700 1 -- 172.21.15.156:0/3188475805 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb70028070 con 0x7fdb801309f0 2023-09-30T22:20:42.340 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:42.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.341+0000 7fdb882df700 1 -- 172.21.15.156:0/3188475805 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb801309f0 msgr2=0x7fdb80071ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:42.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.341+0000 7fdb882df700 1 --2- 172.21.15.156:0/3188475805 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb801309f0 0x7fdb80071ca0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000b4a0 tx=0x7fdb7000b860 comp rx=0 tx=0).stop 2023-09-30T22:20:42.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.342+0000 7fdb882df700 1 -- 172.21.15.156:0/3188475805 shutdown_connections 2023-09-30T22:20:42.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.342+0000 7fdb882df700 1 --2- 172.21.15.156:0/3188475805 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb80133ad0 0x7fdb801cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.342+0000 7fdb882df700 1 --2- 172.21.15.156:0/3188475805 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb801300a0 0x7fdb80071760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.342+0000 7fdb882df700 1 --2- 172.21.15.156:0/3188475805 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb801309f0 0x7fdb80071ca0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.342+0000 7fdb882df700 1 -- 172.21.15.156:0/3188475805 >> 172.21.15.156:0/3188475805 conn(0x7fdb80099c40 msgr2=0x7fdb800a23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:42.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.342+0000 7fdb882df700 1 -- 172.21.15.156:0/3188475805 shutdown_connections 2023-09-30T22:20:42.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.342+0000 7fdb882df700 1 -- 172.21.15.156:0/3188475805 wait complete. 2023-09-30T22:20:42.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:42.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.389+0000 7fbefb358700 1 -- 172.21.15.156:0/2442234579 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbef411b940 con 0x7fbef4131d70 2023-09-30T22:20:42.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.389+0000 7fbee9ffb700 1 -- 172.21.15.156:0/2442234579 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbef411b940 con 0x7fbef4131d70 2023-09-30T22:20:42.390 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:42.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.391+0000 7fbefb358700 1 -- 172.21.15.156:0/2442234579 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbef4131d70 msgr2=0x7fbef41c83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:42.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.391+0000 7fbefb358700 1 --2- 172.21.15.156:0/2442234579 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbef4131d70 0x7fbef41c83c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbeec00efc0 tx=0x7fbeec00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.391+0000 7fbefb358700 1 -- 172.21.15.156:0/2442234579 shutdown_connections 2023-09-30T22:20:42.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.391+0000 7fbefb358700 1 --2- 172.21.15.156:0/2442234579 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbef4131d70 0x7fbef41c83c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.391+0000 7fbefb358700 1 --2- 172.21.15.156:0/2442234579 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbef409e870 0x7fbef41c5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.391+0000 7fbefb358700 1 --2- 172.21.15.156:0/2442234579 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbef409f180 0x7fbef41c59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:42.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.391+0000 7fbefb358700 1 -- 172.21.15.156:0/2442234579 >> 172.21.15.156:0/2442234579 conn(0x7fbef40a4430 msgr2=0x7fbef409cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:42.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.391+0000 7fbefb358700 1 -- 172.21.15.156:0/2442234579 shutdown_connections 2023-09-30T22:20:42.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:42.391+0000 7fbefb358700 1 -- 172.21.15.156:0/2442234579 wait complete. 2023-09-30T22:20:42.404 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:43.322 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:43.326 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:43.355 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:43.404 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:43.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.467+0000 7f8c67b25700 1 Processor -- start 2023-09-30T22:20:43.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.467+0000 7f8c67b25700 1 -- start start 2023-09-30T22:20:43.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.468+0000 7f8c67b25700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c6009d860 0x7f8c6009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:43.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.468+0000 7f8c67b25700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8c6009e170 0x7f8c601307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:43.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.468+0000 7f8c67b25700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c60130ce0 0x7f8c60131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:43.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.468+0000 7f8c67b25700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6009aaa0 con 0x7f8c6009e170 2023-09-30T22:20:43.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.468+0000 7f8c67b25700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6009f870 con 0x7f8c6009d860 2023-09-30T22:20:43.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.468+0000 7f8c67b25700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6009b360 con 0x7f8c60130ce0 2023-09-30T22:20:43.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.468+0000 7f8c658c1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c6009d860 0x7f8c6009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:43.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.468+0000 7f8c658c1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c6009d860 0x7f8c6009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40542/0 (socket says 172.21.15.156:40542) 2023-09-30T22:20:43.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.468+0000 7f8c658c1700 1 -- 172.21.15.156:0/784112281 learned_addr learned my addr 172.21.15.156:0/784112281 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:43.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.468+0000 7f8c660c2700 1 --2- 172.21.15.156:0/784112281 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c60130ce0 0x7f8c60131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:43.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.468+0000 7f8c650c0700 1 --2- 172.21.15.156:0/784112281 >> v2:172.21.15.156:3300/0 conn(0x7f8c6009e170 0x7f8c601307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:43.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.468+0000 7f8c658c1700 1 -- 172.21.15.156:0/784112281 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c60130ce0 msgr2=0x7f8c60131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:43.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.468+0000 7f8c658c1700 1 --2- 172.21.15.156:0/784112281 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c60130ce0 0x7f8c60131180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.468+0000 7f8c658c1700 1 -- 172.21.15.156:0/784112281 >> v2:172.21.15.156:3300/0 conn(0x7f8c6009e170 msgr2=0x7f8c601307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:43.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.468+0000 7f8c658c1700 1 --2- 172.21.15.156:0/784112281 >> v2:172.21.15.156:3300/0 conn(0x7f8c6009e170 0x7f8c601307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.468+0000 7f8c658c1700 1 -- 172.21.15.156:0/784112281 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6009b620 con 0x7f8c6009d860 2023-09-30T22:20:43.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.468+0000 7f8c650c0700 1 --2- 172.21.15.156:0/784112281 >> v2:172.21.15.156:3300/0 conn(0x7f8c6009e170 0x7f8c601307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:20:43.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.468+0000 7f8c658c1700 1 --2- 172.21.15.156:0/784112281 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c6009d860 0x7f8c6009dc30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c009920 tx=0x7f8c5c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=747aad7cf23edcdb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:43.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.468+0000 7f8c648bf700 1 -- 172.21.15.156:0/784112281 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c011830 con 0x7f8c6009d860 2023-09-30T22:20:43.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.469+0000 7f8c648bf700 1 -- 172.21.15.156:0/784112281 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5c011990 con 0x7f8c6009d860 2023-09-30T22:20:43.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.469+0000 7f8c648bf700 1 -- 172.21.15.156:0/784112281 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c011d20 con 0x7f8c6009d860 2023-09-30T22:20:43.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.469+0000 7f8c67b25700 1 -- 172.21.15.156:0/784112281 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c6009d860 msgr2=0x7f8c6009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:43.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.470+0000 7f8c67b25700 1 --2- 172.21.15.156:0/784112281 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c6009d860 0x7f8c6009dc30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c009920 tx=0x7f8c5c009c30 comp rx=0 tx=0).stop 2023-09-30T22:20:43.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.470+0000 7f8c67b25700 1 -- 172.21.15.156:0/784112281 shutdown_connections 2023-09-30T22:20:43.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.470+0000 7f8c67b25700 1 --2- 172.21.15.156:0/784112281 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c60130ce0 0x7f8c60131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.470+0000 7f8c67b25700 1 --2- 172.21.15.156:0/784112281 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c6009d860 0x7f8c6009dc30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.470+0000 7f8c67b25700 1 --2- 172.21.15.156:0/784112281 >> v2:172.21.15.156:3300/0 conn(0x7f8c6009e170 0x7f8c601307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.470+0000 7f8c67b25700 1 -- 172.21.15.156:0/784112281 >> 172.21.15.156:0/784112281 conn(0x7f8c60099c40 msgr2=0x7f8c600a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:43.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.470+0000 7f8c67b25700 1 -- 172.21.15.156:0/784112281 shutdown_connections 2023-09-30T22:20:43.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.470+0000 7f8c67b25700 1 -- 172.21.15.156:0/784112281 wait complete. 2023-09-30T22:20:43.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.471+0000 7f8c67b25700 1 Processor -- start 2023-09-30T22:20:43.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.471+0000 7f8c67b25700 1 -- start start 2023-09-30T22:20:43.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.472+0000 7f8c67b25700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c6009d860 0x7f8c601c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:43.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.472+0000 7f8c67b25700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c6009e170 0x7f8c601c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:43.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.472+0000 7f8c67b25700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c60130ce0 0x7f8c6011f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:43.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.472+0000 7f8c67b25700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c60121230 con 0x7f8c6009e170 2023-09-30T22:20:43.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.472+0000 7f8c67b25700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c60125f20 con 0x7f8c60130ce0 2023-09-30T22:20:43.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.472+0000 7f8c67b25700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6006b280 con 0x7f8c6009d860 2023-09-30T22:20:43.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.472+0000 7f8c658c1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c6009d860 0x7f8c601c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:43.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.472+0000 7f8c658c1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c6009d860 0x7f8c601c8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43368/0 (socket says 172.21.15.156:43368) 2023-09-30T22:20:43.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.472+0000 7f8c658c1700 1 -- 172.21.15.156:0/2455890059 learned_addr learned my addr 172.21.15.156:0/2455890059 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:43.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.472+0000 7f8c650c0700 1 --2- 172.21.15.156:0/2455890059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c6009e170 0x7f8c601c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:43.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.472+0000 7f8c660c2700 1 --2- 172.21.15.156:0/2455890059 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c60130ce0 0x7f8c6011f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:43.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.472+0000 7f8c658c1700 1 -- 172.21.15.156:0/2455890059 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c60130ce0 msgr2=0x7f8c6011f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:43.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.472+0000 7f8c658c1700 1 --2- 172.21.15.156:0/2455890059 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c60130ce0 0x7f8c6011f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.472+0000 7f8c658c1700 1 -- 172.21.15.156:0/2455890059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c6009e170 msgr2=0x7f8c601c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:43.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.472+0000 7f8c658c1700 1 --2- 172.21.15.156:0/2455890059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c6009e170 0x7f8c601c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.472+0000 7f8c658c1700 1 -- 172.21.15.156:0/2455890059 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c009550 con 0x7f8c6009d860 2023-09-30T22:20:43.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.472+0000 7f8c658c1700 1 --2- 172.21.15.156:0/2455890059 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c6009d860 0x7f8c601c8930 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c009130 tx=0x7f8c5c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:43.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.473+0000 7f8c567fc700 1 -- 172.21.15.156:0/2455890059 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c004510 con 0x7f8c6009d860 2023-09-30T22:20:43.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.473+0000 7f8c567fc700 1 -- 172.21.15.156:0/2455890059 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5c01e070 con 0x7f8c6009d860 2023-09-30T22:20:43.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.473+0000 7f8c567fc700 1 -- 172.21.15.156:0/2455890059 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c0038e0 con 0x7f8c6009d860 2023-09-30T22:20:43.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.473+0000 7f8c67b25700 1 -- 172.21.15.156:0/2455890059 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c601204e0 con 0x7f8c6009d860 2023-09-30T22:20:43.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.474+0000 7f8c67b25700 1 -- 172.21.15.156:0/2455890059 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6006a9e0 con 0x7f8c6009d860 2023-09-30T22:20:43.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.474+0000 7f8c567fc700 1 -- 172.21.15.156:0/2455890059 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c5c003a40 con 0x7f8c6009d860 2023-09-30T22:20:43.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.475+0000 7f8c567fc700 1 -- 172.21.15.156:0/2455890059 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8c5c0403c0 con 0x7f8c6009d860 2023-09-30T22:20:43.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.475+0000 7f8c67b25700 1 -- 172.21.15.156:0/2455890059 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c6004f2a0 con 0x7f8c6009d860 2023-09-30T22:20:43.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.484+0000 7f8c567fc700 1 -- 172.21.15.156:0/2455890059 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c5c003cf0 con 0x7f8c6009d860 2023-09-30T22:20:43.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.502+0000 7fbff685e700 1 Processor -- start 2023-09-30T22:20:43.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.502+0000 7fbff685e700 1 -- start start 2023-09-30T22:20:43.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.503+0000 7fbff685e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbff009ad40 0x7fbff0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:43.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.503+0000 7fbff685e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbff0133f70 0x7fbff01343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:43.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.503+0000 7fbff685e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff009b110 con 0x7fbff00a0a70 2023-09-30T22:20:43.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.503+0000 7fbff685e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff00a3b60 con 0x7fbff009ad40 2023-09-30T22:20:43.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.503+0000 7fbff685e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbff01348e0 con 0x7fbff0133f70 2023-09-30T22:20:43.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.503+0000 7fbfeffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbff009ad40 0x7fbff0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:43.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.503+0000 7fbfef7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbff0133f70 0x7fbff01343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:43.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.503+0000 7fbfeffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbff009ad40 0x7fbff0133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40560/0 (socket says 172.21.15.156:40560) 2023-09-30T22:20:43.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.503+0000 7fbfef7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbff0133f70 0x7fbff01343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43374/0 (socket says 172.21.15.156:43374) 2023-09-30T22:20:43.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.503+0000 7fbfeffff700 1 -- 172.21.15.156:0/190599234 learned_addr learned my addr 172.21.15.156:0/190599234 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:43.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.503+0000 7fbfef7fe700 1 -- 172.21.15.156:0/190599234 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbff009ad40 msgr2=0x7fbff0133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:43.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.503+0000 7fbfef7fe700 1 --2- 172.21.15.156:0/190599234 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbff009ad40 0x7fbff0133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.503+0000 7fbfef7fe700 1 -- 172.21.15.156:0/190599234 >> v1:172.21.15.156:6789/0 conn(0x7fbff00a0a70 legacy=0x7fbff00a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:43.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.503+0000 7fbfeeffd700 1 -- 172.21.15.156:0/190599234 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416626281 0 0) 0x7fbff009b110 con 0x7fbff00a0a70 2023-09-30T22:20:43.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.503+0000 7fbfef7fe700 1 -- 172.21.15.156:0/190599234 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff00a2fa0 con 0x7fbff0133f70 2023-09-30T22:20:43.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.504+0000 7fbfef7fe700 1 --2- 172.21.15.156:0/190599234 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbff0133f70 0x7fbff01343a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4009870 tx=0x7fbfe4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc99e2f0c3a0c1e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:43.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.504+0000 7fbfeeffd700 1 -- 172.21.15.156:0/190599234 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4011830 con 0x7fbff0133f70 2023-09-30T22:20:43.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.504+0000 7fbfeeffd700 1 -- 172.21.15.156:0/190599234 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe4011990 con 0x7fbff0133f70 2023-09-30T22:20:43.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.504+0000 7fbfeeffd700 1 -- 172.21.15.156:0/190599234 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4011d20 con 0x7fbff0133f70 2023-09-30T22:20:43.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.505+0000 7fbff685e700 1 -- 172.21.15.156:0/190599234 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbff0133f70 msgr2=0x7fbff01343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:43.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.505+0000 7fbff685e700 1 --2- 172.21.15.156:0/190599234 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbff0133f70 0x7fbff01343a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4009870 tx=0x7fbfe4009b80 comp rx=0 tx=0).stop 2023-09-30T22:20:43.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.505+0000 7fbff685e700 1 -- 172.21.15.156:0/190599234 shutdown_connections 2023-09-30T22:20:43.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.505+0000 7fbff685e700 1 --2- 172.21.15.156:0/190599234 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbff009ad40 0x7fbff0133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.505+0000 7fbff685e700 1 --2- 172.21.15.156:0/190599234 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbff0133f70 0x7fbff01343a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.505+0000 7fbff685e700 1 -- 172.21.15.156:0/190599234 >> 172.21.15.156:0/190599234 conn(0x7fbff0099c40 msgr2=0x7fbff006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:43.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.505+0000 7fbff685e700 1 -- 172.21.15.156:0/190599234 shutdown_connections 2023-09-30T22:20:43.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.505+0000 7fbff685e700 1 -- 172.21.15.156:0/190599234 wait complete. 2023-09-30T22:20:43.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.506+0000 7fbff685e700 1 Processor -- start 2023-09-30T22:20:43.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.506+0000 7fbff685e700 1 -- start start 2023-09-30T22:20:43.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.507+0000 7fbff685e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbff009ad40 0x7fbff011f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:43.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.507+0000 7fbff685e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbff00a0a70 0x7fbff01c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:43.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.507+0000 7fbff685e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbff0133f70 0x7fbff01c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:43.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.507+0000 7fbff685e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff011f2e0 con 0x7fbff0133f70 2023-09-30T22:20:43.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.507+0000 7fbff685e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff0122010 con 0x7fbff00a0a70 2023-09-30T22:20:43.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.507+0000 7fbff685e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbff01222d0 con 0x7fbff009ad40 2023-09-30T22:20:43.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.507+0000 7fbfeffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbff009ad40 0x7fbff011f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:43.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.507+0000 7fbfeffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbff009ad40 0x7fbff011f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43386/0 (socket says 172.21.15.156:43386) 2023-09-30T22:20:43.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.507+0000 7fbfeffff700 1 -- 172.21.15.156:0/130230521 learned_addr learned my addr 172.21.15.156:0/130230521 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:43.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.507+0000 7fbfef7fe700 1 --2- 172.21.15.156:0/130230521 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbff00a0a70 0x7fbff01c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:43.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.507+0000 7fbff4dfb700 1 --2- 172.21.15.156:0/130230521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbff0133f70 0x7fbff01c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:43.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.508+0000 7fbfeffff700 1 -- 172.21.15.156:0/130230521 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbff00a0a70 msgr2=0x7fbff01c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:43.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.508+0000 7fbfeffff700 1 --2- 172.21.15.156:0/130230521 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbff00a0a70 0x7fbff01c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.508+0000 7fbfeffff700 1 -- 172.21.15.156:0/130230521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbff0133f70 msgr2=0x7fbff01c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:43.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.508+0000 7fbfeffff700 1 --2- 172.21.15.156:0/130230521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbff0133f70 0x7fbff01c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.508+0000 7fbfeffff700 1 -- 172.21.15.156:0/130230521 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe40094a0 con 0x7fbff009ad40 2023-09-30T22:20:43.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.508+0000 7f6b3c41b700 1 Processor -- start 2023-09-30T22:20:43.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.508+0000 7f6b3c41b700 1 -- start start 2023-09-30T22:20:43.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.508+0000 7fbfeffff700 1 --2- 172.21.15.156:0/130230521 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbff009ad40 0x7fbff011f730 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbfe000e8b0 tx=0x7fbfe000ebc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:43.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.508+0000 7fbfecff9700 1 -- 172.21.15.156:0/130230521 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0009600 con 0x7fbff009ad40 2023-09-30T22:20:43.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.508+0000 7fbfecff9700 1 -- 172.21.15.156:0/130230521 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe0013680 con 0x7fbff009ad40 2023-09-30T22:20:43.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.508+0000 7fbff685e700 1 -- 172.21.15.156:0/130230521 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff0122d40 con 0x7fbff009ad40 2023-09-30T22:20:43.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.508+0000 7fbfecff9700 1 -- 172.21.15.156:0/130230521 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0013a30 con 0x7fbff009ad40 2023-09-30T22:20:43.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.508+0000 7fbff685e700 1 -- 172.21.15.156:0/130230521 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff0120630 con 0x7fbff009ad40 2023-09-30T22:20:43.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.509+0000 7f6b3c41b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6b3406a770 0x7f6b3406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:43.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.509+0000 7f6b3c41b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b3406b080 0x7f6b341317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:43.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.509+0000 7f6b3c41b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6b34131cf0 0x7f6b34132190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:43.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.509+0000 7f6b3c41b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b3409f770 con 0x7f6b34131cf0 2023-09-30T22:20:43.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.509+0000 7f6b3c41b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3409dce0 con 0x7f6b3406b080 2023-09-30T22:20:43.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.509+0000 7f6b3c41b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3409da80 con 0x7f6b3406a770 2023-09-30T22:20:43.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.509+0000 7f6b3a9b8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6b34131cf0 0x7f6b34132190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:43.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.509+0000 7f6b3a9b8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6b34131cf0 0x7f6b34132190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54330/0 (socket says 172.21.15.156:54330) 2023-09-30T22:20:43.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.509+0000 7f6b3a9b8700 1 -- 172.21.15.156:0/2355263070 learned_addr learned my addr 172.21.15.156:0/2355263070 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:43.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.510+0000 7f6b3a9b8700 1 -- 172.21.15.156:0/2355263070 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6b3406a770 msgr2=0x7f6b3406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:43.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.510+0000 7f6b3a1b7700 1 --2- 172.21.15.156:0/2355263070 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6b3406a770 0x7f6b3406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:43.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.509+0000 7fbfecff9700 1 -- 172.21.15.156:0/130230521 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbfe0013b90 con 0x7fbff009ad40 2023-09-30T22:20:43.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.510+0000 7fbfecff9700 1 -- 172.21.15.156:0/130230521 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbfe003f7d0 con 0x7fbff009ad40 2023-09-30T22:20:43.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.510+0000 7f6b3a9b8700 1 --2- 172.21.15.156:0/2355263070 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6b3406a770 0x7f6b3406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.510+0000 7f6b3a9b8700 1 -- 172.21.15.156:0/2355263070 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b3406b080 msgr2=0x7f6b341317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:43.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.510+0000 7f6b3a9b8700 1 --2- 172.21.15.156:0/2355263070 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b3406b080 0x7f6b341317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.510+0000 7f6b3a9b8700 1 -- 172.21.15.156:0/2355263070 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b3409eb20 con 0x7f6b34131cf0 2023-09-30T22:20:43.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.510+0000 7f6b3a1b7700 1 --2- 172.21.15.156:0/2355263070 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6b3406a770 0x7f6b3406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:20:43.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.510+0000 7fbff685e700 1 -- 172.21.15.156:0/130230521 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff004f2a0 con 0x7fbff009ad40 2023-09-30T22:20:43.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.510+0000 7f6b3a9b8700 1 --2- 172.21.15.156:0/2355263070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b34131cf0 0x7f6b34132190 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009e80 tx=0x7f6b2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a8190a6f67baf4d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:43.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.510+0000 7f6b391b5700 1 -- 172.21.15.156:0/2355263070 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c00e070 con 0x7f6b34131cf0 2023-09-30T22:20:43.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.510+0000 7f6b391b5700 1 -- 172.21.15.156:0/2355263070 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2c00b980 con 0x7f6b34131cf0 2023-09-30T22:20:43.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.510+0000 7f6b391b5700 1 -- 172.21.15.156:0/2355263070 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c00bd30 con 0x7f6b34131cf0 2023-09-30T22:20:43.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.511+0000 7f6b3c41b700 1 -- 172.21.15.156:0/2355263070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b34131cf0 msgr2=0x7f6b34132190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:43.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.511+0000 7f6b3c41b700 1 --2- 172.21.15.156:0/2355263070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b34131cf0 0x7f6b34132190 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009e80 tx=0x7f6b2c00b330 comp rx=0 tx=0).stop 2023-09-30T22:20:43.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.511+0000 7f6b3c41b700 1 -- 172.21.15.156:0/2355263070 shutdown_connections 2023-09-30T22:20:43.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.511+0000 7f6b3c41b700 1 --2- 172.21.15.156:0/2355263070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b34131cf0 0x7f6b34132190 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.511+0000 7f6b3c41b700 1 --2- 172.21.15.156:0/2355263070 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6b3406a770 0x7f6b3406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.511+0000 7f6b3c41b700 1 --2- 172.21.15.156:0/2355263070 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b3406b080 0x7f6b341317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.511+0000 7f6b3c41b700 1 -- 172.21.15.156:0/2355263070 >> 172.21.15.156:0/2355263070 conn(0x7f6b34099c40 msgr2=0x7f6b340a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:43.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.511+0000 7f6b3c41b700 1 -- 172.21.15.156:0/2355263070 shutdown_connections 2023-09-30T22:20:43.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.511+0000 7f6b3c41b700 1 -- 172.21.15.156:0/2355263070 wait complete. 2023-09-30T22:20:43.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.512+0000 7f6b3c41b700 1 Processor -- start 2023-09-30T22:20:43.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.513+0000 7f6b3c41b700 1 -- start start 2023-09-30T22:20:43.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.513+0000 7f6b3c41b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6b3406a770 0x7f6b34126700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:43.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.513+0000 7f6b3c41b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b3406b080 0x7f6b34126c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:43.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.513+0000 7f6b3c41b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b34131cf0 0x7f6b34127180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:43.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.513+0000 7f6b3c41b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3413cb80 con 0x7f6b34131cf0 2023-09-30T22:20:43.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.513+0000 7f6b3c41b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3412db70 con 0x7f6b3406b080 2023-09-30T22:20:43.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.513+0000 7f6b3c41b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3412f440 con 0x7f6b3406a770 2023-09-30T22:20:43.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.513+0000 7f6b3a1b7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6b3406a770 0x7f6b34126700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:43.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.513+0000 7f6b3a1b7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6b3406a770 0x7f6b34126700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43408/0 (socket says 172.21.15.156:43408) 2023-09-30T22:20:43.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.513+0000 7f6b3a1b7700 1 -- 172.21.15.156:0/3702397566 learned_addr learned my addr 172.21.15.156:0/3702397566 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:43.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.513+0000 7f6b3a9b8700 1 --2- 172.21.15.156:0/3702397566 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b34131cf0 0x7f6b34127180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:43.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.514+0000 7f6b399b6700 1 --2- 172.21.15.156:0/3702397566 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b3406b080 0x7f6b34126c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:43.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.514+0000 7f6b3a1b7700 1 -- 172.21.15.156:0/3702397566 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b3406b080 msgr2=0x7f6b34126c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:43.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.514+0000 7f6b3a1b7700 1 --2- 172.21.15.156:0/3702397566 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b3406b080 0x7f6b34126c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.514+0000 7f6b3a1b7700 1 -- 172.21.15.156:0/3702397566 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b34131cf0 msgr2=0x7f6b34127180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:43.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.514+0000 7f6b3a1b7700 1 --2- 172.21.15.156:0/3702397566 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b34131cf0 0x7f6b34127180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.514+0000 7f6b3a1b7700 1 -- 172.21.15.156:0/3702397566 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2c009b30 con 0x7f6b3406a770 2023-09-30T22:20:43.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.514+0000 7f6b3a9b8700 1 --2- 172.21.15.156:0/3702397566 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b34131cf0 0x7f6b34127180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:43.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.514+0000 7f6b3a1b7700 1 --2- 172.21.15.156:0/3702397566 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6b3406a770 0x7f6b34126700 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000c750 tx=0x7f6b3000ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:43.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.515+0000 7f6b2affd700 1 -- 172.21.15.156:0/3702397566 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b30011800 con 0x7f6b3406a770 2023-09-30T22:20:43.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.515+0000 7f6b2affd700 1 -- 172.21.15.156:0/3702397566 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b30011960 con 0x7f6b3406a770 2023-09-30T22:20:43.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.515+0000 7f6b3c41b700 1 -- 172.21.15.156:0/3702397566 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b3412f140 con 0x7f6b3406a770 2023-09-30T22:20:43.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.515+0000 7f6b2affd700 1 -- 172.21.15.156:0/3702397566 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b30011cd0 con 0x7f6b3406a770 2023-09-30T22:20:43.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.515+0000 7f6b3c41b700 1 -- 172.21.15.156:0/3702397566 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b34130170 con 0x7f6b3406a770 2023-09-30T22:20:43.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.515+0000 7fbfecff9700 1 -- 172.21.15.156:0/130230521 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbfe0017020 con 0x7fbff009ad40 2023-09-30T22:20:43.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.516+0000 7f6b3c41b700 1 -- 172.21.15.156:0/3702397566 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b3404f2a0 con 0x7f6b3406a770 2023-09-30T22:20:43.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.520+0000 7f6b2affd700 1 -- 172.21.15.156:0/3702397566 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6b30023480 con 0x7f6b3406a770 2023-09-30T22:20:43.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.520+0000 7f6b2affd700 1 -- 172.21.15.156:0/3702397566 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6b3003fc10 con 0x7f6b3406a770 2023-09-30T22:20:43.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.521+0000 7f6b2affd700 1 -- 172.21.15.156:0/3702397566 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b3000e2f0 con 0x7f6b3406a770 2023-09-30T22:20:43.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.567+0000 7fd7a2c58700 1 Processor -- start 2023-09-30T22:20:43.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.567+0000 7fd7a2c58700 1 -- start start 2023-09-30T22:20:43.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.567+0000 7fd7a2c58700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd79c0a0a70 0x7fd79c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:43.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.567+0000 7fd7a2c58700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd79c0a1380 0x7fd79c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:43.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.567+0000 7fd7a2c58700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd79c133f50 0x7fd79c1343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:43.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.567+0000 7fd7a2c58700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd79c09e9d0 con 0x7fd79c133f50 2023-09-30T22:20:43.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.567+0000 7fd7a2c58700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c09dc00 con 0x7fd79c0a0a70 2023-09-30T22:20:43.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.567+0000 7fd7a2c58700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c09dec0 con 0x7fd79c0a1380 2023-09-30T22:20:43.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.568+0000 7fd79bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd79c0a1380 0x7fd79c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:43.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.568+0000 7fd79bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd79c0a1380 0x7fd79c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43416/0 (socket says 172.21.15.156:43416) 2023-09-30T22:20:43.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.568+0000 7fd79bfff700 1 -- 172.21.15.156:0/1965610845 learned_addr learned my addr 172.21.15.156:0/1965610845 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:43.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.568+0000 7fd7a11f5700 1 --2- 172.21.15.156:0/1965610845 >> v2:172.21.15.156:3300/0 conn(0x7fd79c133f50 0x7fd79c1343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:43.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.568+0000 7fd7a09f4700 1 --2- 172.21.15.156:0/1965610845 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd79c0a0a70 0x7fd79c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:43.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.568+0000 7fd79bfff700 1 -- 172.21.15.156:0/1965610845 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd79c0a0a70 msgr2=0x7fd79c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:43.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.568+0000 7fd79bfff700 1 --2- 172.21.15.156:0/1965610845 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd79c0a0a70 0x7fd79c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.568+0000 7fd79bfff700 1 -- 172.21.15.156:0/1965610845 >> v2:172.21.15.156:3300/0 conn(0x7fd79c133f50 msgr2=0x7fd79c1343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:43.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.568+0000 7fd79bfff700 1 --2- 172.21.15.156:0/1965610845 >> v2:172.21.15.156:3300/0 conn(0x7fd79c133f50 0x7fd79c1343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.568+0000 7fd79bfff700 1 -- 172.21.15.156:0/1965610845 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79c09e6a0 con 0x7fd79c0a1380 2023-09-30T22:20:43.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.568+0000 7fd7a09f4700 1 --2- 172.21.15.156:0/1965610845 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd79c0a0a70 0x7fd79c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:43.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.568+0000 7fd7a11f5700 1 --2- 172.21.15.156:0/1965610845 >> v2:172.21.15.156:3300/0 conn(0x7fd79c133f50 0x7fd79c1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:43.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.568+0000 7fd79bfff700 1 --2- 172.21.15.156:0/1965610845 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd79c0a1380 0x7fd79c133a10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd7880098f0 tx=0x7fd788009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0a597228c37bdfb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:43.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.568+0000 7fd79b7fe700 1 -- 172.21.15.156:0/1965610845 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd788011830 con 0x7fd79c0a1380 2023-09-30T22:20:43.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.568+0000 7fd79b7fe700 1 -- 172.21.15.156:0/1965610845 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd788011990 con 0x7fd79c0a1380 2023-09-30T22:20:43.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.568+0000 7fd79b7fe700 1 -- 172.21.15.156:0/1965610845 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd788011d20 con 0x7fd79c0a1380 2023-09-30T22:20:43.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.569+0000 7fd7a2c58700 1 -- 172.21.15.156:0/1965610845 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd79c0a1380 msgr2=0x7fd79c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:43.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.569+0000 7fd7a2c58700 1 --2- 172.21.15.156:0/1965610845 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd79c0a1380 0x7fd79c133a10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd7880098f0 tx=0x7fd788009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:43.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.569+0000 7fd7a2c58700 1 -- 172.21.15.156:0/1965610845 shutdown_connections 2023-09-30T22:20:43.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.569+0000 7fd7a2c58700 1 --2- 172.21.15.156:0/1965610845 >> v2:172.21.15.156:3300/0 conn(0x7fd79c133f50 0x7fd79c1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.569+0000 7fd7a2c58700 1 --2- 172.21.15.156:0/1965610845 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd79c0a0a70 0x7fd79c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.569+0000 7fd7a2c58700 1 --2- 172.21.15.156:0/1965610845 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd79c0a1380 0x7fd79c133a10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.569+0000 7fd7a2c58700 1 -- 172.21.15.156:0/1965610845 >> 172.21.15.156:0/1965610845 conn(0x7fd79c0a6610 msgr2=0x7fd79c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:43.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.569+0000 7fd7a2c58700 1 -- 172.21.15.156:0/1965610845 shutdown_connections 2023-09-30T22:20:43.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.569+0000 7fd7a2c58700 1 -- 172.21.15.156:0/1965610845 wait complete. 2023-09-30T22:20:43.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.571+0000 7fd7a2c58700 1 Processor -- start 2023-09-30T22:20:43.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.571+0000 7fd7a2c58700 1 -- start start 2023-09-30T22:20:43.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.572+0000 7fd7a2c58700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd79c0a0a70 0x7fd79c122570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:43.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.572+0000 7fd7a2c58700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd79c133f50 0x7fd79c122ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:43.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.572+0000 7fd7a2c58700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd79c122ff0 0x7fd79c1ce850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:43.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.572+0000 7fd7a2c58700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c125e40 con 0x7fd79c133f50 2023-09-30T22:20:43.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.572+0000 7fd7a2c58700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c124180 con 0x7fd79c0a0a70 2023-09-30T22:20:43.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.572+0000 7fd7a2c58700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c126090 con 0x7fd79c122ff0 2023-09-30T22:20:43.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.572+0000 7fd7a11f5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd79c122ff0 0x7fd79c1ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:43.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.572+0000 7fd79bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd79c133f50 0x7fd79c122ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:43.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.572+0000 7fd7a11f5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd79c122ff0 0x7fd79c1ce850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43428/0 (socket says 172.21.15.156:43428) 2023-09-30T22:20:43.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.572+0000 7fd79bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd79c133f50 0x7fd79c122ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54366/0 (socket says 172.21.15.156:54366) 2023-09-30T22:20:43.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.572+0000 7fd7a11f5700 1 -- 172.21.15.156:0/3323851736 learned_addr learned my addr 172.21.15.156:0/3323851736 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:43.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.572+0000 7fd7a09f4700 1 --2- 172.21.15.156:0/3323851736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd79c0a0a70 0x7fd79c122570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:43.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.572+0000 7fd7a11f5700 1 -- 172.21.15.156:0/3323851736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd79c0a0a70 msgr2=0x7fd79c122570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:43.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.572+0000 7fd7a11f5700 1 --2- 172.21.15.156:0/3323851736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd79c0a0a70 0x7fd79c122570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.572+0000 7fd7a11f5700 1 -- 172.21.15.156:0/3323851736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd79c133f50 msgr2=0x7fd79c122ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:43.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.572+0000 7fd7a11f5700 1 --2- 172.21.15.156:0/3323851736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd79c133f50 0x7fd79c122ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.572+0000 7fd7a11f5700 1 -- 172.21.15.156:0/3323851736 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7900094a0 con 0x7fd79c122ff0 2023-09-30T22:20:43.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.572+0000 7fd79bfff700 1 --2- 172.21.15.156:0/3323851736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd79c133f50 0x7fd79c122ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:43.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.572+0000 7fd7a11f5700 1 --2- 172.21.15.156:0/3323851736 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd79c122ff0 0x7fd79c1ce850 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd794009f00 tx=0x7fd79400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:43.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.573+0000 7fd7997fa700 1 -- 172.21.15.156:0/3323851736 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd794009d70 con 0x7fd79c122ff0 2023-09-30T22:20:43.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.573+0000 7fd7997fa700 1 -- 172.21.15.156:0/3323851736 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79400f040 con 0x7fd79c122ff0 2023-09-30T22:20:43.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.573+0000 7fd7a2c58700 1 -- 172.21.15.156:0/3323851736 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd794009a70 con 0x7fd79c122ff0 2023-09-30T22:20:43.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.573+0000 7fd7997fa700 1 -- 172.21.15.156:0/3323851736 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79400cd70 con 0x7fd79c122ff0 2023-09-30T22:20:43.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.573+0000 7fd7a2c58700 1 -- 172.21.15.156:0/3323851736 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd788009550 con 0x7fd79c122ff0 2023-09-30T22:20:43.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.574+0000 7fd7a2c58700 1 -- 172.21.15.156:0/3323851736 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd79c04f2a0 con 0x7fd79c122ff0 2023-09-30T22:20:43.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.574+0000 7fd7997fa700 1 -- 172.21.15.156:0/3323851736 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd794014480 con 0x7fd79c122ff0 2023-09-30T22:20:43.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.575+0000 7fd7997fa700 1 -- 172.21.15.156:0/3323851736 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd79403fd20 con 0x7fd79c122ff0 2023-09-30T22:20:43.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.583+0000 7fd7997fa700 1 -- 172.21.15.156:0/3323851736 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd794044070 con 0x7fd79c122ff0 2023-09-30T22:20:43.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.690+0000 7f8c67b25700 1 -- 172.21.15.156:0/2455890059 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8c6009a150 con 0x7f8c6009d860 2023-09-30T22:20:43.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.691+0000 7f8c567fc700 1 -- 172.21.15.156:0/2455890059 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c5c015020 con 0x7f8c6009d860 2023-09-30T22:20:43.692 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:43.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.694+0000 7f8c67b25700 1 -- 172.21.15.156:0/2455890059 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c6009d860 msgr2=0x7f8c601c8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:43.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.694+0000 7f8c67b25700 1 --2- 172.21.15.156:0/2455890059 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c6009d860 0x7f8c601c8930 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c009130 tx=0x7f8c5c004750 comp rx=0 tx=0).stop 2023-09-30T22:20:43.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.694+0000 7f8c67b25700 1 -- 172.21.15.156:0/2455890059 shutdown_connections 2023-09-30T22:20:43.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.694+0000 7f8c67b25700 1 --2- 172.21.15.156:0/2455890059 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c60130ce0 0x7f8c6011f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.694+0000 7f8c67b25700 1 --2- 172.21.15.156:0/2455890059 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c6009d860 0x7f8c601c8930 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.694+0000 7f8c67b25700 1 --2- 172.21.15.156:0/2455890059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c6009e170 0x7f8c601c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.694+0000 7f8c67b25700 1 -- 172.21.15.156:0/2455890059 >> 172.21.15.156:0/2455890059 conn(0x7f8c60099c40 msgr2=0x7f8c6006fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:43.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.694+0000 7f8c67b25700 1 -- 172.21.15.156:0/2455890059 shutdown_connections 2023-09-30T22:20:43.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.694+0000 7f8c67b25700 1 -- 172.21.15.156:0/2455890059 wait complete. 2023-09-30T22:20:43.711 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:43.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.720+0000 7f6b3c41b700 1 -- 172.21.15.156:0/3702397566 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6b3406c3b0 con 0x7f6b3406a770 2023-09-30T22:20:43.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.720+0000 7f6b2affd700 1 -- 172.21.15.156:0/3702397566 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b3001e070 con 0x7f6b3406a770 2023-09-30T22:20:43.721 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:43.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.723+0000 7f6b3c41b700 1 -- 172.21.15.156:0/3702397566 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6b3406a770 msgr2=0x7f6b34126700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:43.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.723+0000 7f6b3c41b700 1 --2- 172.21.15.156:0/3702397566 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6b3406a770 0x7f6b34126700 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000c750 tx=0x7f6b3000ca60 comp rx=0 tx=0).stop 2023-09-30T22:20:43.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.723+0000 7f6b3c41b700 1 -- 172.21.15.156:0/3702397566 shutdown_connections 2023-09-30T22:20:43.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.723+0000 7f6b3c41b700 1 --2- 172.21.15.156:0/3702397566 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b34131cf0 0x7f6b34127180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.723+0000 7f6b3c41b700 1 --2- 172.21.15.156:0/3702397566 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6b3406a770 0x7f6b34126700 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.723+0000 7f6b3c41b700 1 --2- 172.21.15.156:0/3702397566 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b3406b080 0x7f6b34126c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.723+0000 7f6b3c41b700 1 -- 172.21.15.156:0/3702397566 >> 172.21.15.156:0/3702397566 conn(0x7f6b34099c40 msgr2=0x7f6b34070910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:43.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.723+0000 7f6b3c41b700 1 -- 172.21.15.156:0/3702397566 shutdown_connections 2023-09-30T22:20:43.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.723+0000 7f6b3c41b700 1 -- 172.21.15.156:0/3702397566 wait complete. 2023-09-30T22:20:43.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:43.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.776+0000 7fbff685e700 1 -- 172.21.15.156:0/130230521 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbff01337b0 con 0x7fbff009ad40 2023-09-30T22:20:43.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.776+0000 7fbfecff9700 1 -- 172.21.15.156:0/130230521 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbfe001bc30 con 0x7fbff009ad40 2023-09-30T22:20:43.777 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:43.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.778+0000 7fbff685e700 1 -- 172.21.15.156:0/130230521 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbff009ad40 msgr2=0x7fbff011f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:43.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.778+0000 7fbff685e700 1 --2- 172.21.15.156:0/130230521 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbff009ad40 0x7fbff011f730 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbfe000e8b0 tx=0x7fbfe000ebc0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.778+0000 7fbff685e700 1 -- 172.21.15.156:0/130230521 shutdown_connections 2023-09-30T22:20:43.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.778+0000 7fbff685e700 1 --2- 172.21.15.156:0/130230521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbff0133f70 0x7fbff01c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.778+0000 7fbff685e700 1 --2- 172.21.15.156:0/130230521 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbff009ad40 0x7fbff011f730 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.778+0000 7fbff685e700 1 --2- 172.21.15.156:0/130230521 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbff00a0a70 0x7fbff01c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.778+0000 7fbff685e700 1 -- 172.21.15.156:0/130230521 >> 172.21.15.156:0/130230521 conn(0x7fbff0099c40 msgr2=0x7fbff00a4110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:43.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.778+0000 7fbff685e700 1 -- 172.21.15.156:0/130230521 shutdown_connections 2023-09-30T22:20:43.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.778+0000 7fbff685e700 1 -- 172.21.15.156:0/130230521 wait complete. 2023-09-30T22:20:43.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:43.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.808+0000 7fd7a2c58700 1 -- 172.21.15.156:0/3323851736 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd79c133090 con 0x7fd79c122ff0 2023-09-30T22:20:43.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.809+0000 7fd7997fa700 1 -- 172.21.15.156:0/3323851736 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd794012930 con 0x7fd79c122ff0 2023-09-30T22:20:43.809 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:43.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.811+0000 7fd7a2c58700 1 -- 172.21.15.156:0/3323851736 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd79c122ff0 msgr2=0x7fd79c1ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:43.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.811+0000 7fd7a2c58700 1 --2- 172.21.15.156:0/3323851736 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd79c122ff0 0x7fd79c1ce850 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd794009f00 tx=0x7fd79400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.811+0000 7fd7a2c58700 1 -- 172.21.15.156:0/3323851736 shutdown_connections 2023-09-30T22:20:43.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.811+0000 7fd7a2c58700 1 --2- 172.21.15.156:0/3323851736 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd79c122ff0 0x7fd79c1ce850 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.811+0000 7fd7a2c58700 1 --2- 172.21.15.156:0/3323851736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd79c0a0a70 0x7fd79c122570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.811+0000 7fd7a2c58700 1 --2- 172.21.15.156:0/3323851736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd79c133f50 0x7fd79c122ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:43.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.811+0000 7fd7a2c58700 1 -- 172.21.15.156:0/3323851736 >> 172.21.15.156:0/3323851736 conn(0x7fd79c0a6610 msgr2=0x7fd79c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:43.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.811+0000 7fd7a2c58700 1 -- 172.21.15.156:0/3323851736 shutdown_connections 2023-09-30T22:20:43.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:43.811+0000 7fd7a2c58700 1 -- 172.21.15.156:0/3323851736 wait complete. 2023-09-30T22:20:43.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:44.712 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:44.735 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:44.792 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:44.824 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:44.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.856+0000 7f310e1c3700 1 Processor -- start 2023-09-30T22:20:44.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.856+0000 7f310e1c3700 1 -- start start 2023-09-30T22:20:44.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.856+0000 7f310e1c3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f310806a770 0x7f31081349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:44.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.856+0000 7f310e1c3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f310809e070 0x7f310813fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:44.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.856+0000 7f310e1c3700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f310809eca0 con 0x7f3108134f00 2023-09-30T22:20:44.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.856+0000 7f310e1c3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f310806b2e0 con 0x7f310809e070 2023-09-30T22:20:44.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.856+0000 7f310e1c3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f310809f720 con 0x7f310806a770 2023-09-30T22:20:44.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.857+0000 7f3106ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f3108134f00 0x7f310809d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:35370/0 (socket says 172.21.15.156:35370) 2023-09-30T22:20:44.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.857+0000 7f3106ffd700 1 -- 172.21.15.156:0/3421509447 learned_addr learned my addr 172.21.15.156:0/3421509447 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:44.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.857+0000 7f3107fff700 1 --2- 172.21.15.156:0/3421509447 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f310809e070 0x7f310813fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:44.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.857+0000 7f31077fe700 1 --2- 172.21.15.156:0/3421509447 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f310806a770 0x7f31081349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:44.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.857+0000 7f31067fc700 1 -- 172.21.15.156:0/3421509447 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 966165473 0 0) 0x7f310809eca0 con 0x7f3108134f00 2023-09-30T22:20:44.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.857+0000 7f3107fff700 1 -- 172.21.15.156:0/3421509447 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f310806a770 msgr2=0x7f31081349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:44.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.857+0000 7f3107fff700 1 --2- 172.21.15.156:0/3421509447 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f310806a770 0x7f31081349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:44.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.857+0000 7f3107fff700 1 -- 172.21.15.156:0/3421509447 >> v1:172.21.15.156:6789/0 conn(0x7f3108134f00 legacy=0x7f310809d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:44.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.857+0000 7f3107fff700 1 -- 172.21.15.156:0/3421509447 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310806b480 con 0x7f310809e070 2023-09-30T22:20:44.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.857+0000 7f3107fff700 1 --2- 172.21.15.156:0/3421509447 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f310809e070 0x7f310813fcf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3100009dc0 tx=0x7f310000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f07d3ed59b722d1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:44.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.858+0000 7f31067fc700 1 -- 172.21.15.156:0/3421509447 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310000e070 con 0x7f310809e070 2023-09-30T22:20:44.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.858+0000 7f31067fc700 1 -- 172.21.15.156:0/3421509447 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310000bb20 con 0x7f310809e070 2023-09-30T22:20:44.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.858+0000 7f31067fc700 1 -- 172.21.15.156:0/3421509447 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3100012430 con 0x7f310809e070 2023-09-30T22:20:44.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.858+0000 7f310e1c3700 1 -- 172.21.15.156:0/3421509447 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f310809e070 msgr2=0x7f310813fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:44.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.858+0000 7f310e1c3700 1 --2- 172.21.15.156:0/3421509447 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f310809e070 0x7f310813fcf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3100009dc0 tx=0x7f310000b330 comp rx=0 tx=0).stop 2023-09-30T22:20:44.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.859+0000 7f310e1c3700 1 -- 172.21.15.156:0/3421509447 shutdown_connections 2023-09-30T22:20:44.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.859+0000 7f310e1c3700 1 --2- 172.21.15.156:0/3421509447 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f310809e070 0x7f310813fcf0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:44.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.859+0000 7f310e1c3700 1 --2- 172.21.15.156:0/3421509447 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f310806a770 0x7f31081349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:44.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.859+0000 7f310e1c3700 1 -- 172.21.15.156:0/3421509447 >> 172.21.15.156:0/3421509447 conn(0x7f3108099c40 msgr2=0x7f31080a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:44.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.859+0000 7f310e1c3700 1 -- 172.21.15.156:0/3421509447 shutdown_connections 2023-09-30T22:20:44.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.859+0000 7f310e1c3700 1 -- 172.21.15.156:0/3421509447 wait complete. 2023-09-30T22:20:44.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.859+0000 7f310e1c3700 1 Processor -- start 2023-09-30T22:20:44.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.860+0000 7f310e1c3700 1 -- start start 2023-09-30T22:20:44.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.860+0000 7f310e1c3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f310806a770 0x7f310813ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:44.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.860+0000 7f310e1c3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f310809e070 0x7f3108135850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:44.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.860+0000 7f310e1c3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3108134f00 0x7f3108135d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:44.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.860+0000 7f310e1c3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3108136e10 con 0x7f3108134f00 2023-09-30T22:20:44.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.860+0000 7f310e1c3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31081386e0 con 0x7f310806a770 2023-09-30T22:20:44.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.860+0000 7f310e1c3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3108136c20 con 0x7f310809e070 2023-09-30T22:20:44.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.860+0000 7f3106ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f310809e070 0x7f3108135850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:44.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.860+0000 7f3106ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f310809e070 0x7f3108135850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43460/0 (socket says 172.21.15.156:43460) 2023-09-30T22:20:44.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.860+0000 7f3106ffd700 1 -- 172.21.15.156:0/2252586634 learned_addr learned my addr 172.21.15.156:0/2252586634 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:44.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.861+0000 7f3107fff700 1 --2- 172.21.15.156:0/2252586634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3108134f00 0x7f3108135d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:44.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.861+0000 7f3106ffd700 1 -- 172.21.15.156:0/2252586634 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f310806a770 msgr2=0x7f310813ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:44.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.861+0000 7f3106ffd700 1 --2- 172.21.15.156:0/2252586634 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f310806a770 0x7f310813ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:44.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.861+0000 7f3106ffd700 1 -- 172.21.15.156:0/2252586634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3108134f00 msgr2=0x7f3108135d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:44.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.861+0000 7f3106ffd700 1 --2- 172.21.15.156:0/2252586634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3108134f00 0x7f3108135d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:44.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.861+0000 7f3106ffd700 1 -- 172.21.15.156:0/2252586634 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3100009a70 con 0x7f310809e070 2023-09-30T22:20:44.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.861+0000 7f3107fff700 1 --2- 172.21.15.156:0/2252586634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3108134f00 0x7f3108135d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:20:44.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.861+0000 7f3106ffd700 1 --2- 172.21.15.156:0/2252586634 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f310809e070 0x7f3108135850 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f30fc00c550 tx=0x7f30fc00c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:44.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.861+0000 7f30effff700 1 -- 172.21.15.156:0/2252586634 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30fc004c80 con 0x7f310809e070 2023-09-30T22:20:44.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.861+0000 7f30effff700 1 -- 172.21.15.156:0/2252586634 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30fc004de0 con 0x7f310809e070 2023-09-30T22:20:44.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.861+0000 7f310e1c3700 1 -- 172.21.15.156:0/2252586634 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3108140fc0 con 0x7f310809e070 2023-09-30T22:20:44.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.861+0000 7f30effff700 1 -- 172.21.15.156:0/2252586634 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30fc007310 con 0x7f310809e070 2023-09-30T22:20:44.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.861+0000 7f310e1c3700 1 -- 172.21.15.156:0/2252586634 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3108138ba0 con 0x7f310809e070 2023-09-30T22:20:44.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.862+0000 7f30effff700 1 -- 172.21.15.156:0/2252586634 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f30fc007470 con 0x7f310809e070 2023-09-30T22:20:44.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.862+0000 7f310e1c3700 1 -- 172.21.15.156:0/2252586634 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3108138820 con 0x7f310809e070 2023-09-30T22:20:44.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.863+0000 7f30effff700 1 -- 172.21.15.156:0/2252586634 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f30fc03f430 con 0x7f310809e070 2023-09-30T22:20:44.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.867+0000 7f30effff700 1 -- 172.21.15.156:0/2252586634 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3108138820 con 0x7f310809e070 2023-09-30T22:20:44.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.902+0000 7f8524ec9700 1 Processor -- start 2023-09-30T22:20:44.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.902+0000 7f8524ec9700 1 -- start start 2023-09-30T22:20:44.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.903+0000 7f8524ec9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f85200a0a30 0x7f85200a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:44.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.903+0000 7f8524ec9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f85200a1340 0x7f852012ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:44.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.903+0000 7f8524ec9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f85201304a0 0x7f85201308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:44.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.903+0000 7f8524ec9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8520130e30 con 0x7f85201304a0 2023-09-30T22:20:44.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.903+0000 7f8524ec9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85200a1e70 con 0x7f85200a0a30 2023-09-30T22:20:44.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.903+0000 7f8524ec9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f852009a720 con 0x7f85200a1340 2023-09-30T22:20:44.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.903+0000 7f851dd9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f85200a1340 0x7f852012ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:44.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.903+0000 7f851ed9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f85201304a0 0x7f85201308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:44.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.903+0000 7f851dd9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f85200a1340 0x7f852012ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43476/0 (socket says 172.21.15.156:43476) 2023-09-30T22:20:44.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.903+0000 7f851dd9b700 1 -- 172.21.15.156:0/1236992850 learned_addr learned my addr 172.21.15.156:0/1236992850 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:44.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.903+0000 7f851e59c700 1 --2- 172.21.15.156:0/1236992850 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f85200a0a30 0x7f85200a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:44.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.904+0000 7f851dd9b700 1 -- 172.21.15.156:0/1236992850 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f85200a0a30 msgr2=0x7f85200a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:44.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.904+0000 7f851dd9b700 1 --2- 172.21.15.156:0/1236992850 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f85200a0a30 0x7f85200a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:44.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.904+0000 7f851dd9b700 1 -- 172.21.15.156:0/1236992850 >> v2:172.21.15.156:3300/0 conn(0x7f85201304a0 msgr2=0x7f85201308f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:44.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.904+0000 7f851dd9b700 1 --2- 172.21.15.156:0/1236992850 >> v2:172.21.15.156:3300/0 conn(0x7f85201304a0 0x7f85201308f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:44.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.904+0000 7f851dd9b700 1 -- 172.21.15.156:0/1236992850 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852009b300 con 0x7f85200a1340 2023-09-30T22:20:44.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.904+0000 7f851ed9d700 1 --2- 172.21.15.156:0/1236992850 >> v2:172.21.15.156:3300/0 conn(0x7f85201304a0 0x7f85201308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:44.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.904+0000 7f851dd9b700 1 --2- 172.21.15.156:0/1236992850 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f85200a1340 0x7f852012ff60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f85140098f0 tx=0x7f8514009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d550b10df41426e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:44.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.904+0000 7f851d59a700 1 -- 172.21.15.156:0/1236992850 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8514011830 con 0x7f85200a1340 2023-09-30T22:20:44.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.904+0000 7f851d59a700 1 -- 172.21.15.156:0/1236992850 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8514011990 con 0x7f85200a1340 2023-09-30T22:20:44.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.904+0000 7f851d59a700 1 -- 172.21.15.156:0/1236992850 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8514011d20 con 0x7f85200a1340 2023-09-30T22:20:44.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.905+0000 7f8524ec9700 1 -- 172.21.15.156:0/1236992850 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f85200a1340 msgr2=0x7f852012ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:44.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.905+0000 7f8524ec9700 1 --2- 172.21.15.156:0/1236992850 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f85200a1340 0x7f852012ff60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f85140098f0 tx=0x7f8514009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:44.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.905+0000 7f8524ec9700 1 -- 172.21.15.156:0/1236992850 shutdown_connections 2023-09-30T22:20:44.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.905+0000 7f8524ec9700 1 --2- 172.21.15.156:0/1236992850 >> v2:172.21.15.156:3300/0 conn(0x7f85201304a0 0x7f85201308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:44.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.905+0000 7f8524ec9700 1 --2- 172.21.15.156:0/1236992850 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f85200a0a30 0x7f85200a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:44.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.905+0000 7f8524ec9700 1 --2- 172.21.15.156:0/1236992850 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f85200a1340 0x7f852012ff60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:44.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.905+0000 7f8524ec9700 1 -- 172.21.15.156:0/1236992850 >> 172.21.15.156:0/1236992850 conn(0x7f85200a2980 msgr2=0x7f85200a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:44.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.905+0000 7f8524ec9700 1 -- 172.21.15.156:0/1236992850 shutdown_connections 2023-09-30T22:20:44.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.905+0000 7f8524ec9700 1 -- 172.21.15.156:0/1236992850 wait complete. 2023-09-30T22:20:44.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.906+0000 7f8524ec9700 1 Processor -- start 2023-09-30T22:20:44.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.906+0000 7f8524ec9700 1 -- start start 2023-09-30T22:20:44.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.907+0000 7f8524ec9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f85200a0a30 0x7f852011ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:44.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.907+0000 7f8524ec9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85200a1340 0x7f852011b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:44.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.907+0000 7f8524ec9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f85201304a0 0x7f852011b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:44.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.907+0000 7f8524ec9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852011c2e0 con 0x7f85200a1340 2023-09-30T22:20:44.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.907+0000 7f8524ec9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852011e890 con 0x7f85201304a0 2023-09-30T22:20:44.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.907+0000 7f8524ec9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f852011c980 con 0x7f85200a0a30 2023-09-30T22:20:44.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.907+0000 7f851dd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85200a1340 0x7f852011b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:44.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.907+0000 7f851dd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85200a1340 0x7f852011b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54386/0 (socket says 172.21.15.156:54386) 2023-09-30T22:20:44.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.907+0000 7f851dd9b700 1 -- 172.21.15.156:0/2623359779 learned_addr learned my addr 172.21.15.156:0/2623359779 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:44.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.907+0000 7f851e59c700 1 --2- 172.21.15.156:0/2623359779 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f85200a0a30 0x7f852011ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:44.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.907+0000 7f851dd9b700 1 -- 172.21.15.156:0/2623359779 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f85200a0a30 msgr2=0x7f852011ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:44.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.907+0000 7f851dd9b700 1 --2- 172.21.15.156:0/2623359779 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f85200a0a30 0x7f852011ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:44.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.907+0000 7f851ed9d700 1 --2- 172.21.15.156:0/2623359779 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f85201304a0 0x7f852011b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:44.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.907+0000 7f851dd9b700 1 -- 172.21.15.156:0/2623359779 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f85201304a0 msgr2=0x7f852011b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:44.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.907+0000 7f851dd9b700 1 --2- 172.21.15.156:0/2623359779 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f85201304a0 0x7f852011b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:44.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.907+0000 7f851dd9b700 1 -- 172.21.15.156:0/2623359779 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8518009a70 con 0x7f85200a1340 2023-09-30T22:20:44.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.907+0000 7f851ed9d700 1 --2- 172.21.15.156:0/2623359779 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f85201304a0 0x7f852011b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:20:44.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.907+0000 7f851dd9b700 1 --2- 172.21.15.156:0/2623359779 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85200a1340 0x7f852011b350 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8514009c40 tx=0x7f8514004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:44.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.908+0000 7f850effd700 1 -- 172.21.15.156:0/2623359779 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8514004300 con 0x7f85200a1340 2023-09-30T22:20:44.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.908+0000 7f850effd700 1 -- 172.21.15.156:0/2623359779 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851401f070 con 0x7f85200a1340 2023-09-30T22:20:44.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.908+0000 7f8524ec9700 1 -- 172.21.15.156:0/2623359779 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8514009550 con 0x7f85200a1340 2023-09-30T22:20:44.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.908+0000 7f8524ec9700 1 -- 172.21.15.156:0/2623359779 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f852011d150 con 0x7f85200a1340 2023-09-30T22:20:44.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.908+0000 7f850effd700 1 -- 172.21.15.156:0/2623359779 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85140036a0 con 0x7f85200a1340 2023-09-30T22:20:44.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.909+0000 7f8524ec9700 1 -- 172.21.15.156:0/2623359779 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85040052e0 con 0x7f85200a1340 2023-09-30T22:20:44.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.910+0000 7f850effd700 1 -- 172.21.15.156:0/2623359779 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8514021030 con 0x7f85200a1340 2023-09-30T22:20:44.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.914+0000 7f850effd700 1 -- 172.21.15.156:0/2623359779 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8514003800 con 0x7f85200a1340 2023-09-30T22:20:44.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.919+0000 7f850effd700 1 -- 172.21.15.156:0/2623359779 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f85140199a0 con 0x7f85200a1340 2023-09-30T22:20:44.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.943+0000 7f399206c700 1 Processor -- start 2023-09-30T22:20:44.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.943+0000 7f399206c700 1 -- start start 2023-09-30T22:20:44.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.944+0000 7f399206c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f398c0a1510 0x7f398c1351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:44.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.944+0000 7f399206c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f398c1356e0 0x7f398c137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:44.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.944+0000 7f399206c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398c0a1e70 con 0x7f398c0a0a30 2023-09-30T22:20:44.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.944+0000 7f399206c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398c09a720 con 0x7f398c1356e0 2023-09-30T22:20:44.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.944+0000 7f399206c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f398c09b300 con 0x7f398c0a1510 2023-09-30T22:20:44.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.944+0000 7f398affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f398c0a1510 0x7f398c1351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:44.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.944+0000 7f398bfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f398c1356e0 0x7f398c137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:44.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.944+0000 7f398affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f398c0a1510 0x7f398c1351a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43502/0 (socket says 172.21.15.156:43502) 2023-09-30T22:20:44.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.944+0000 7f398affd700 1 -- 172.21.15.156:0/1085657399 learned_addr learned my addr 172.21.15.156:0/1085657399 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:44.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.944+0000 7f398affd700 1 -- 172.21.15.156:0/1085657399 >> v2:172.21.15.156:3300/0 conn(0x7f398c1356e0 msgr2=0x7f398c137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:44.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.944+0000 7f398affd700 1 --2- 172.21.15.156:0/1085657399 >> v2:172.21.15.156:3300/0 conn(0x7f398c1356e0 0x7f398c137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:44.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.944+0000 7f398affd700 1 -- 172.21.15.156:0/1085657399 >> v1:172.21.15.156:6789/0 conn(0x7f398c0a0a30 legacy=0x7f398c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:44.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.944+0000 7f398affd700 1 -- 172.21.15.156:0/1085657399 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c09abc0 con 0x7f398c0a1510 2023-09-30T22:20:44.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.945+0000 7f398affd700 1 --2- 172.21.15.156:0/1085657399 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f398c0a1510 0x7f398c1351a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f39800098f0 tx=0x7f3980009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f9e93ed698b05e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:44.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.945+0000 7f398a7fc700 1 -- 172.21.15.156:0/1085657399 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3980011830 con 0x7f398c0a1510 2023-09-30T22:20:44.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.945+0000 7f398a7fc700 1 -- 172.21.15.156:0/1085657399 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3980011990 con 0x7f398c0a1510 2023-09-30T22:20:44.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.945+0000 7f398a7fc700 1 -- 172.21.15.156:0/1085657399 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3980011d00 con 0x7f398c0a1510 2023-09-30T22:20:44.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.946+0000 7f399206c700 1 -- 172.21.15.156:0/1085657399 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f398c0a1510 msgr2=0x7f398c1351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:44.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.946+0000 7f399206c700 1 --2- 172.21.15.156:0/1085657399 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f398c0a1510 0x7f398c1351a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f39800098f0 tx=0x7f3980009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:44.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.946+0000 7f399206c700 1 -- 172.21.15.156:0/1085657399 shutdown_connections 2023-09-30T22:20:44.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.946+0000 7f399206c700 1 --2- 172.21.15.156:0/1085657399 >> v2:172.21.15.156:3300/0 conn(0x7f398c1356e0 0x7f398c137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:44.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.946+0000 7f399206c700 1 --2- 172.21.15.156:0/1085657399 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f398c0a1510 0x7f398c1351a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:44.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.946+0000 7f399206c700 1 -- 172.21.15.156:0/1085657399 >> 172.21.15.156:0/1085657399 conn(0x7f398c0a2980 msgr2=0x7f398c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:44.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.946+0000 7f399206c700 1 -- 172.21.15.156:0/1085657399 shutdown_connections 2023-09-30T22:20:44.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.946+0000 7f399206c700 1 -- 172.21.15.156:0/1085657399 wait complete. 2023-09-30T22:20:44.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.947+0000 7f399206c700 1 Processor -- start 2023-09-30T22:20:44.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.948+0000 7f399206c700 1 -- start start 2023-09-30T22:20:44.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.948+0000 7f399206c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f398c0a0a30 0x7f398c1c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:44.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.948+0000 7f399206c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f398c0a1510 0x7f398c1c6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:44.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.948+0000 7f399206c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f398c1356e0 0x7f398c1c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:44.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.948+0000 7f399206c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c131310 con 0x7f398c1356e0 2023-09-30T22:20:44.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.948+0000 7f399206c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398c130040 con 0x7f398c0a1510 2023-09-30T22:20:44.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.948+0000 7f399206c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f398c130cd0 con 0x7f398c0a0a30 2023-09-30T22:20:44.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.948+0000 7f398b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f398c0a0a30 0x7f398c1c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:44.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.948+0000 7f398bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f398c1356e0 0x7f398c1c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:44.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.948+0000 7f398bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f398c1356e0 0x7f398c1c6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54398/0 (socket says 172.21.15.156:54398) 2023-09-30T22:20:44.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.948+0000 7f398bfff700 1 -- 172.21.15.156:0/846333057 learned_addr learned my addr 172.21.15.156:0/846333057 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:44.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.948+0000 7f398b7fe700 1 --2- 172.21.15.156:0/846333057 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f398c0a0a30 0x7f398c1c6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43508/0 (socket says 172.21.15.156:43508) 2023-09-30T22:20:44.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.949+0000 7f398affd700 1 --2- 172.21.15.156:0/846333057 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f398c0a1510 0x7f398c1c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:44.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.949+0000 7f398bfff700 1 -- 172.21.15.156:0/846333057 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f398c0a0a30 msgr2=0x7f398c1c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:44.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.949+0000 7f398bfff700 1 --2- 172.21.15.156:0/846333057 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f398c0a0a30 0x7f398c1c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:44.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.949+0000 7f398bfff700 1 -- 172.21.15.156:0/846333057 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f398c0a1510 msgr2=0x7f398c1c6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:44.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.949+0000 7f398bfff700 1 --2- 172.21.15.156:0/846333057 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f398c0a1510 0x7f398c1c6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:44.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.949+0000 7f398bfff700 1 -- 172.21.15.156:0/846333057 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3980009550 con 0x7f398c1356e0 2023-09-30T22:20:44.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.949+0000 7f398b7fe700 1 --2- 172.21.15.156:0/846333057 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f398c0a0a30 0x7f398c1c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:44.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.949+0000 7f398affd700 1 --2- 172.21.15.156:0/846333057 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f398c0a1510 0x7f398c1c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:44.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.949+0000 7f398bfff700 1 --2- 172.21.15.156:0/846333057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f398c1356e0 0x7f398c1c6b80 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3984009e30 tx=0x7f398400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:44.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.949+0000 7f3973fff700 1 -- 172.21.15.156:0/846333057 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3984009ca0 con 0x7f398c1356e0 2023-09-30T22:20:44.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.949+0000 7f3973fff700 1 -- 172.21.15.156:0/846333057 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398400f040 con 0x7f398c1356e0 2023-09-30T22:20:44.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.949+0000 7f399206c700 1 -- 172.21.15.156:0/846333057 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398c12f910 con 0x7f398c1356e0 2023-09-30T22:20:44.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.949+0000 7f3973fff700 1 -- 172.21.15.156:0/846333057 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3984014480 con 0x7f398c1356e0 2023-09-30T22:20:44.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.949+0000 7f399206c700 1 -- 172.21.15.156:0/846333057 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f398c139a30 con 0x7f398c1356e0 2023-09-30T22:20:44.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.950+0000 7f3973fff700 1 -- 172.21.15.156:0/846333057 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f39840145e0 con 0x7f398c1356e0 2023-09-30T22:20:44.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.950+0000 7f3973fff700 1 -- 172.21.15.156:0/846333057 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f39840403c0 con 0x7f398c1356e0 2023-09-30T22:20:44.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.950+0000 7f399206c700 1 -- 172.21.15.156:0/846333057 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f398c04f2a0 con 0x7f398c1356e0 2023-09-30T22:20:44.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.959+0000 7f3973fff700 1 -- 172.21.15.156:0/846333057 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3984018070 con 0x7f398c1356e0 2023-09-30T22:20:44.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.977+0000 7f6aa8688700 1 Processor -- start 2023-09-30T22:20:44.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.977+0000 7f6aa8688700 1 -- start start 2023-09-30T22:20:44.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.978+0000 7f6aa8688700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6aa00a0a70 0x7f6aa00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:44.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.978+0000 7f6aa8688700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aa0134120 0x7f6aa013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:44.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.978+0000 7f6aa8688700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aa009dc00 con 0x7f6aa00a1380 2023-09-30T22:20:44.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.978+0000 7f6aa8688700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa009ea90 con 0x7f6aa00a0a70 2023-09-30T22:20:44.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.978+0000 7f6aa8688700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa009dec0 con 0x7f6aa0134120 2023-09-30T22:20:44.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.978+0000 7f6aa6c25700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aa0134120 0x7f6aa013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:44.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.978+0000 7f6aa6c25700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aa0134120 0x7f6aa013bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40652/0 (socket says 172.21.15.156:40652) 2023-09-30T22:20:44.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.978+0000 7f6aa6c25700 1 -- 172.21.15.156:0/1010320294 learned_addr learned my addr 172.21.15.156:0/1010320294 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:44.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.978+0000 7f6aa6424700 1 --2- 172.21.15.156:0/1010320294 >> v2:172.21.15.156:3300/0 conn(0x7f6aa00a0a70 0x7f6aa00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:44.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.978+0000 7f6aa6424700 1 -- 172.21.15.156:0/1010320294 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aa0134120 msgr2=0x7f6aa013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:44.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.978+0000 7f6aa6424700 1 --2- 172.21.15.156:0/1010320294 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aa0134120 0x7f6aa013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:44.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.978+0000 7f6aa6424700 1 -- 172.21.15.156:0/1010320294 >> v1:172.21.15.156:6789/0 conn(0x7f6aa00a1380 legacy=0x7f6aa0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:44.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.978+0000 7f6aa6424700 1 -- 172.21.15.156:0/1010320294 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa009e6a0 con 0x7f6aa00a0a70 2023-09-30T22:20:44.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.979+0000 7f6aa6424700 1 --2- 172.21.15.156:0/1010320294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6aa00a0a70 0x7f6aa00a0e40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c009840 tx=0x7f6a9c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a68733c7546cd4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:44.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.979+0000 7f6aa5422700 1 -- 172.21.15.156:0/1010320294 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c011830 con 0x7f6aa00a0a70 2023-09-30T22:20:44.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.979+0000 7f6aa5422700 1 -- 172.21.15.156:0/1010320294 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9c011990 con 0x7f6aa00a0a70 2023-09-30T22:20:44.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.979+0000 7f6aa5422700 1 -- 172.21.15.156:0/1010320294 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c011d20 con 0x7f6aa00a0a70 2023-09-30T22:20:44.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.979+0000 7f6aa8688700 1 -- 172.21.15.156:0/1010320294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6aa00a0a70 msgr2=0x7f6aa00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:44.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.979+0000 7f6aa8688700 1 --2- 172.21.15.156:0/1010320294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6aa00a0a70 0x7f6aa00a0e40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c009840 tx=0x7f6a9c009b50 comp rx=0 tx=0).stop 2023-09-30T22:20:44.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.979+0000 7f6aa8688700 1 -- 172.21.15.156:0/1010320294 shutdown_connections 2023-09-30T22:20:44.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.979+0000 7f6aa8688700 1 --2- 172.21.15.156:0/1010320294 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aa0134120 0x7f6aa013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:44.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.979+0000 7f6aa8688700 1 --2- 172.21.15.156:0/1010320294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6aa00a0a70 0x7f6aa00a0e40 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:44.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.979+0000 7f6aa8688700 1 -- 172.21.15.156:0/1010320294 >> 172.21.15.156:0/1010320294 conn(0x7f6aa00a6610 msgr2=0x7f6aa00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:44.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.980+0000 7f6aa8688700 1 -- 172.21.15.156:0/1010320294 shutdown_connections 2023-09-30T22:20:44.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.980+0000 7f6aa8688700 1 -- 172.21.15.156:0/1010320294 wait complete. 2023-09-30T22:20:44.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.980+0000 7f6aa8688700 1 Processor -- start 2023-09-30T22:20:44.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.981+0000 7f6aa8688700 1 -- start start 2023-09-30T22:20:44.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.981+0000 7f6aa8688700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aa00a0a70 0x7f6aa01229b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:44.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.981+0000 7f6aa8688700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aa00a1380 0x7f6aa0122ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:44.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.981+0000 7f6aa8688700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6aa0134120 0x7f6aa0123430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:44.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.981+0000 7f6aa8688700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa0126160 con 0x7f6aa0134120 2023-09-30T22:20:44.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.981+0000 7f6aa8688700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa0133aa0 con 0x7f6aa00a1380 2023-09-30T22:20:44.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.981+0000 7f6aa8688700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa01334b0 con 0x7f6aa00a0a70 2023-09-30T22:20:44.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.981+0000 7f6aa6424700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aa00a0a70 0x7f6aa01229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:44.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.981+0000 7f6aa6424700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aa00a0a70 0x7f6aa01229b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43512/0 (socket says 172.21.15.156:43512) 2023-09-30T22:20:44.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.981+0000 7f6aa6424700 1 -- 172.21.15.156:0/1004169372 learned_addr learned my addr 172.21.15.156:0/1004169372 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:44.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.981+0000 7f6aa5c23700 1 --2- 172.21.15.156:0/1004169372 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aa00a1380 0x7f6aa0122ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:44.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.981+0000 7f6aa6c25700 1 --2- 172.21.15.156:0/1004169372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6aa0134120 0x7f6aa0123430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:44.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.981+0000 7f6aa6424700 1 -- 172.21.15.156:0/1004169372 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aa00a1380 msgr2=0x7f6aa0122ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:44.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.981+0000 7f6aa6424700 1 --2- 172.21.15.156:0/1004169372 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aa00a1380 0x7f6aa0122ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:44.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.981+0000 7f6aa6424700 1 -- 172.21.15.156:0/1004169372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6aa0134120 msgr2=0x7f6aa0123430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:44.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.981+0000 7f6aa6424700 1 --2- 172.21.15.156:0/1004169372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6aa0134120 0x7f6aa0123430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:44.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.981+0000 7f6aa6424700 1 -- 172.21.15.156:0/1004169372 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c0094a0 con 0x7f6aa00a0a70 2023-09-30T22:20:44.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.981+0000 7f6aa5c23700 1 --2- 172.21.15.156:0/1004169372 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aa00a1380 0x7f6aa0122ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:44.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.982+0000 7f6aa6424700 1 --2- 172.21.15.156:0/1004169372 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aa00a0a70 0x7f6aa01229b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c009fd0 tx=0x7f6a9c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:44.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.982+0000 7f6a96ffd700 1 -- 172.21.15.156:0/1004169372 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c0036a0 con 0x7f6aa00a0a70 2023-09-30T22:20:44.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.982+0000 7f6a96ffd700 1 -- 172.21.15.156:0/1004169372 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9c01f070 con 0x7f6aa00a0a70 2023-09-30T22:20:44.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.982+0000 7f6aa8688700 1 -- 172.21.15.156:0/1004169372 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa0125ea0 con 0x7f6aa00a0a70 2023-09-30T22:20:44.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.982+0000 7f6a96ffd700 1 -- 172.21.15.156:0/1004169372 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c003a60 con 0x7f6aa00a0a70 2023-09-30T22:20:44.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.982+0000 7f6aa8688700 1 -- 172.21.15.156:0/1004169372 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa0126b40 con 0x7f6aa00a0a70 2023-09-30T22:20:44.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.983+0000 7f6aa8688700 1 -- 172.21.15.156:0/1004169372 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aa004f2a0 con 0x7f6aa00a0a70 2023-09-30T22:20:44.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.983+0000 7f6a96ffd700 1 -- 172.21.15.156:0/1004169372 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a9c003bc0 con 0x7f6aa00a0a70 2023-09-30T22:20:44.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.983+0000 7f6a96ffd700 1 -- 172.21.15.156:0/1004169372 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6a9c021070 con 0x7f6aa00a0a70 2023-09-30T22:20:44.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:44.988+0000 7f6a96ffd700 1 -- 172.21.15.156:0/1004169372 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a9c0257f0 con 0x7f6aa00a0a70 2023-09-30T22:20:45.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.123+0000 7f310e1c3700 1 -- 172.21.15.156:0/2252586634 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3108138820 con 0x7f310809e070 2023-09-30T22:20:45.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.124+0000 7f30effff700 1 -- 172.21.15.156:0/2252586634 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3108138820 con 0x7f310809e070 2023-09-30T22:20:45.124 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:45.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.126+0000 7f310e1c3700 1 -- 172.21.15.156:0/2252586634 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f310809e070 msgr2=0x7f3108135850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:45.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.126+0000 7f310e1c3700 1 --2- 172.21.15.156:0/2252586634 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f310809e070 0x7f3108135850 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f30fc00c550 tx=0x7f30fc00c910 comp rx=0 tx=0).stop 2023-09-30T22:20:45.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.127+0000 7f310e1c3700 1 -- 172.21.15.156:0/2252586634 shutdown_connections 2023-09-30T22:20:45.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.127+0000 7f310e1c3700 1 --2- 172.21.15.156:0/2252586634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3108134f00 0x7f3108135d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:45.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.127+0000 7f310e1c3700 1 --2- 172.21.15.156:0/2252586634 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f310806a770 0x7f310813ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:45.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.127+0000 7f310e1c3700 1 --2- 172.21.15.156:0/2252586634 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f310809e070 0x7f3108135850 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:45.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.127+0000 7f310e1c3700 1 -- 172.21.15.156:0/2252586634 >> 172.21.15.156:0/2252586634 conn(0x7f3108099c40 msgr2=0x7f310811cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:45.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.127+0000 7f310e1c3700 1 -- 172.21.15.156:0/2252586634 shutdown_connections 2023-09-30T22:20:45.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.127+0000 7f310e1c3700 1 -- 172.21.15.156:0/2252586634 wait complete. 2023-09-30T22:20:45.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.128+0000 7f8524ec9700 1 -- 172.21.15.156:0/2623359779 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8504005590 con 0x7f85200a1340 2023-09-30T22:20:45.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.128+0000 7f850effd700 1 -- 172.21.15.156:0/2623359779 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f85140193b0 con 0x7f85200a1340 2023-09-30T22:20:45.129 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:45.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.130+0000 7f8524ec9700 1 -- 172.21.15.156:0/2623359779 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85200a1340 msgr2=0x7f852011b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:45.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.130+0000 7f8524ec9700 1 --2- 172.21.15.156:0/2623359779 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85200a1340 0x7f852011b350 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8514009c40 tx=0x7f8514004750 comp rx=0 tx=0).stop 2023-09-30T22:20:45.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.130+0000 7f8524ec9700 1 -- 172.21.15.156:0/2623359779 shutdown_connections 2023-09-30T22:20:45.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.130+0000 7f8524ec9700 1 --2- 172.21.15.156:0/2623359779 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f85201304a0 0x7f852011b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:45.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.130+0000 7f8524ec9700 1 --2- 172.21.15.156:0/2623359779 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f85200a0a30 0x7f852011ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:45.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.130+0000 7f8524ec9700 1 --2- 172.21.15.156:0/2623359779 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85200a1340 0x7f852011b350 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:45.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.130+0000 7f8524ec9700 1 -- 172.21.15.156:0/2623359779 >> 172.21.15.156:0/2623359779 conn(0x7f85200a2980 msgr2=0x7f852009deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:45.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.131+0000 7f8524ec9700 1 -- 172.21.15.156:0/2623359779 shutdown_connections 2023-09-30T22:20:45.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.131+0000 7f8524ec9700 1 -- 172.21.15.156:0/2623359779 wait complete. 2023-09-30T22:20:45.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:45.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:45.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.181+0000 7f6aa8688700 1 -- 172.21.15.156:0/1004169372 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6aa0072980 con 0x7f6aa00a0a70 2023-09-30T22:20:45.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.182+0000 7f6a96ffd700 1 -- 172.21.15.156:0/1004169372 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6a9c034020 con 0x7f6aa00a0a70 2023-09-30T22:20:45.182 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:45.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.183+0000 7f6aa8688700 1 -- 172.21.15.156:0/1004169372 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aa00a0a70 msgr2=0x7f6aa01229b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:45.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.183+0000 7f6aa8688700 1 --2- 172.21.15.156:0/1004169372 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aa00a0a70 0x7f6aa01229b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c009fd0 tx=0x7f6a9c004750 comp rx=0 tx=0).stop 2023-09-30T22:20:45.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.184+0000 7f6aa8688700 1 -- 172.21.15.156:0/1004169372 shutdown_connections 2023-09-30T22:20:45.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.184+0000 7f6aa8688700 1 --2- 172.21.15.156:0/1004169372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6aa0134120 0x7f6aa0123430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:45.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.184+0000 7f6aa8688700 1 --2- 172.21.15.156:0/1004169372 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aa00a0a70 0x7f6aa01229b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:45.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.184+0000 7f6aa8688700 1 --2- 172.21.15.156:0/1004169372 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aa00a1380 0x7f6aa0122ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:45.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.184+0000 7f6aa8688700 1 -- 172.21.15.156:0/1004169372 >> 172.21.15.156:0/1004169372 conn(0x7f6aa00a6610 msgr2=0x7f6aa00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:45.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.184+0000 7f6aa8688700 1 -- 172.21.15.156:0/1004169372 shutdown_connections 2023-09-30T22:20:45.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.184+0000 7f6aa8688700 1 -- 172.21.15.156:0/1004169372 wait complete. 2023-09-30T22:20:45.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:45.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.204+0000 7f399206c700 1 -- 172.21.15.156:0/846333057 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f398c09f920 con 0x7f398c1356e0 2023-09-30T22:20:45.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.204+0000 7f3973fff700 1 -- 172.21.15.156:0/846333057 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f398402c090 con 0x7f398c1356e0 2023-09-30T22:20:45.205 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:45.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.206+0000 7f399206c700 1 -- 172.21.15.156:0/846333057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f398c1356e0 msgr2=0x7f398c1c6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:45.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.206+0000 7f399206c700 1 --2- 172.21.15.156:0/846333057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f398c1356e0 0x7f398c1c6b80 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3984009e30 tx=0x7f398400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:20:45.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.206+0000 7f399206c700 1 -- 172.21.15.156:0/846333057 shutdown_connections 2023-09-30T22:20:45.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.206+0000 7f399206c700 1 --2- 172.21.15.156:0/846333057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f398c1356e0 0x7f398c1c6b80 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:45.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.206+0000 7f399206c700 1 --2- 172.21.15.156:0/846333057 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f398c0a0a30 0x7f398c1c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:45.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.206+0000 7f399206c700 1 --2- 172.21.15.156:0/846333057 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f398c0a1510 0x7f398c1c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:45.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.206+0000 7f399206c700 1 -- 172.21.15.156:0/846333057 >> 172.21.15.156:0/846333057 conn(0x7f398c0a2980 msgr2=0x7f398c12e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:45.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.206+0000 7f399206c700 1 -- 172.21.15.156:0/846333057 shutdown_connections 2023-09-30T22:20:45.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:45.206+0000 7f399206c700 1 -- 172.21.15.156:0/846333057 wait complete. 2023-09-30T22:20:45.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:46.145 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:46.147 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:46.197 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:46.220 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:46.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.290+0000 7f949a20c700 1 Processor -- start 2023-09-30T22:20:46.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.290+0000 7f949a20c700 1 -- start start 2023-09-30T22:20:46.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.290+0000 7f949a20c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f949409e870 0x7f949409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:46.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.290+0000 7f949a20c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f949409f180 0x7f9494131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:46.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.291+0000 7f949a20c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f949409c970 con 0x7f9494131d70 2023-09-30T22:20:46.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.291+0000 7f949a20c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94940a0920 con 0x7f949409f180 2023-09-30T22:20:46.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.291+0000 7f949a20c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f949409f9c0 con 0x7f949409e870 2023-09-30T22:20:46.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.291+0000 7f9492ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f949409f180 0x7f9494131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:46.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.291+0000 7f9492ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f949409f180 0x7f9494131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54418/0 (socket says 172.21.15.156:54418) 2023-09-30T22:20:46.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.291+0000 7f9492ffd700 1 -- 172.21.15.156:0/2388095573 learned_addr learned my addr 172.21.15.156:0/2388095573 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:46.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.291+0000 7f94937fe700 1 --2- 172.21.15.156:0/2388095573 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f949409e870 0x7f949409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:46.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.291+0000 7f9492ffd700 1 -- 172.21.15.156:0/2388095573 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f949409e870 msgr2=0x7f949409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:46.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.291+0000 7f9492ffd700 1 --2- 172.21.15.156:0/2388095573 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f949409e870 0x7f949409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.291+0000 7f9492ffd700 1 -- 172.21.15.156:0/2388095573 >> v1:172.21.15.156:6789/0 conn(0x7f9494131d70 legacy=0x7f9494138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:46.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.291+0000 7f94927fc700 1 -- 172.21.15.156:0/2388095573 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 299172037 0 0) 0x7f949409c970 con 0x7f9494131d70 2023-09-30T22:20:46.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.291+0000 7f9492ffd700 1 -- 172.21.15.156:0/2388095573 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949409bab0 con 0x7f949409f180 2023-09-30T22:20:46.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.291+0000 7f9492ffd700 1 --2- 172.21.15.156:0/2388095573 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f949409f180 0x7f9494131830 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f94880098f0 tx=0x7f9488009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d3a042bc30fe85 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:46.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.292+0000 7f94927fc700 1 -- 172.21.15.156:0/2388095573 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9488011830 con 0x7f949409f180 2023-09-30T22:20:46.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.292+0000 7f94927fc700 1 -- 172.21.15.156:0/2388095573 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9488011990 con 0x7f949409f180 2023-09-30T22:20:46.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.292+0000 7f94927fc700 1 -- 172.21.15.156:0/2388095573 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9488011d20 con 0x7f949409f180 2023-09-30T22:20:46.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.292+0000 7f949a20c700 1 -- 172.21.15.156:0/2388095573 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f949409f180 msgr2=0x7f9494131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:46.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.292+0000 7f949a20c700 1 --2- 172.21.15.156:0/2388095573 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f949409f180 0x7f9494131830 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f94880098f0 tx=0x7f9488009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:46.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.292+0000 7f949a20c700 1 -- 172.21.15.156:0/2388095573 shutdown_connections 2023-09-30T22:20:46.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.292+0000 7f949a20c700 1 --2- 172.21.15.156:0/2388095573 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f949409e870 0x7f949409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.292+0000 7f949a20c700 1 --2- 172.21.15.156:0/2388095573 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f949409f180 0x7f9494131830 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.292+0000 7f949a20c700 1 -- 172.21.15.156:0/2388095573 >> 172.21.15.156:0/2388095573 conn(0x7f94940a4430 msgr2=0x7f94940a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:46.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.292+0000 7f949a20c700 1 -- 172.21.15.156:0/2388095573 shutdown_connections 2023-09-30T22:20:46.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.292+0000 7f949a20c700 1 -- 172.21.15.156:0/2388095573 wait complete. 2023-09-30T22:20:46.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.293+0000 7f949a20c700 1 Processor -- start 2023-09-30T22:20:46.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.294+0000 7f949a20c700 1 -- start start 2023-09-30T22:20:46.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.294+0000 7f949a20c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f949409e870 0x7f9494120070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:46.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.294+0000 7f949a20c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f949409f180 0x7f94941205b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:46.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.294+0000 7f949a20c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9494131d70 0x7f9494120af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:46.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.294+0000 7f949a20c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9494122ed0 con 0x7f9494131d70 2023-09-30T22:20:46.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.294+0000 7f949a20c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9494121e00 con 0x7f949409f180 2023-09-30T22:20:46.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.294+0000 7f949a20c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9494122b10 con 0x7f949409e870 2023-09-30T22:20:46.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.294+0000 7f94937fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f949409e870 0x7f9494120070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:46.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.294+0000 7f94937fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f949409e870 0x7f9494120070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43518/0 (socket says 172.21.15.156:43518) 2023-09-30T22:20:46.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.294+0000 7f94937fe700 1 -- 172.21.15.156:0/1149156429 learned_addr learned my addr 172.21.15.156:0/1149156429 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:46.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.294+0000 7f9493fff700 1 --2- 172.21.15.156:0/1149156429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9494131d70 0x7f9494120af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:46.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.294+0000 7f9492ffd700 1 --2- 172.21.15.156:0/1149156429 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f949409f180 0x7f94941205b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:46.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.294+0000 7f94937fe700 1 -- 172.21.15.156:0/1149156429 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f949409f180 msgr2=0x7f94941205b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:46.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.295+0000 7f94937fe700 1 --2- 172.21.15.156:0/1149156429 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f949409f180 0x7f94941205b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.295+0000 7f94937fe700 1 -- 172.21.15.156:0/1149156429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9494131d70 msgr2=0x7f9494120af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:46.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.295+0000 7f94937fe700 1 --2- 172.21.15.156:0/1149156429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9494131d70 0x7f9494120af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.295+0000 7f94937fe700 1 -- 172.21.15.156:0/1149156429 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9488009550 con 0x7f949409e870 2023-09-30T22:20:46.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.295+0000 7f94937fe700 1 --2- 172.21.15.156:0/1149156429 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f949409e870 0x7f9494120070 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f948400e870 tx=0x7f948400eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:46.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.295+0000 7f947bfff700 1 -- 172.21.15.156:0/1149156429 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9484009590 con 0x7f949409e870 2023-09-30T22:20:46.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.295+0000 7f947bfff700 1 -- 172.21.15.156:0/1149156429 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9484013680 con 0x7f949409e870 2023-09-30T22:20:46.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.295+0000 7f949a20c700 1 -- 172.21.15.156:0/1149156429 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f949409dba0 con 0x7f949409e870 2023-09-30T22:20:46.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.295+0000 7f947bfff700 1 -- 172.21.15.156:0/1149156429 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94840139f0 con 0x7f949409e870 2023-09-30T22:20:46.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.295+0000 7f949a20c700 1 -- 172.21.15.156:0/1149156429 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94941238b0 con 0x7f949409e870 2023-09-30T22:20:46.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.296+0000 7f949a20c700 1 -- 172.21.15.156:0/1149156429 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9494123aa0 con 0x7f949409e870 2023-09-30T22:20:46.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.296+0000 7f947bfff700 1 -- 172.21.15.156:0/1149156429 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9484013b50 con 0x7f949409e870 2023-09-30T22:20:46.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.297+0000 7f947bfff700 1 -- 172.21.15.156:0/1149156429 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9484011e60 con 0x7f949409e870 2023-09-30T22:20:46.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.297+0000 7f95994ef700 1 Processor -- start 2023-09-30T22:20:46.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.297+0000 7f95994ef700 1 -- start start 2023-09-30T22:20:46.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.298+0000 7f95994ef700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f959409e340 0x7f95941359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:46.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.298+0000 7f95994ef700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9594135f20 0x7f9594138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:46.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.298+0000 7f95994ef700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f959409aaa0 con 0x7f959409d860 2023-09-30T22:20:46.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.298+0000 7f95994ef700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f959409e730 con 0x7f959409e340 2023-09-30T22:20:46.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.298+0000 7f95994ef700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959409f870 con 0x7f9594135f20 2023-09-30T22:20:46.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.298+0000 7f95937fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9594135f20 0x7f9594138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:46.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.298+0000 7f95937fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9594135f20 0x7f9594138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40676/0 (socket says 172.21.15.156:40676) 2023-09-30T22:20:46.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.298+0000 7f95937fe700 1 -- 172.21.15.156:0/3232299679 learned_addr learned my addr 172.21.15.156:0/3232299679 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:46.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.298+0000 7f95937fe700 1 -- 172.21.15.156:0/3232299679 >> v2:172.21.15.156:3300/0 conn(0x7f959409e340 msgr2=0x7f95941359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:46.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.298+0000 7f95937fe700 1 --2- 172.21.15.156:0/3232299679 >> v2:172.21.15.156:3300/0 conn(0x7f959409e340 0x7f95941359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.298+0000 7f95937fe700 1 -- 172.21.15.156:0/3232299679 >> v1:172.21.15.156:6789/0 conn(0x7f959409d860 legacy=0x7f959409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:46.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.298+0000 7f95937fe700 1 -- 172.21.15.156:0/3232299679 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959409b360 con 0x7f9594135f20 2023-09-30T22:20:46.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.298+0000 7f95937fe700 1 --2- 172.21.15.156:0/3232299679 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9594135f20 0x7f9594138300 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f958c009e80 tx=0x7f958c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9775cc360f8f1083 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:46.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.299+0000 7f9591ffb700 1 -- 172.21.15.156:0/3232299679 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c00e070 con 0x7f9594135f20 2023-09-30T22:20:46.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.299+0000 7f9591ffb700 1 -- 172.21.15.156:0/3232299679 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958c003a20 con 0x7f9594135f20 2023-09-30T22:20:46.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.299+0000 7f9591ffb700 1 -- 172.21.15.156:0/3232299679 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c003dd0 con 0x7f9594135f20 2023-09-30T22:20:46.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.299+0000 7f95994ef700 1 -- 172.21.15.156:0/3232299679 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9594135f20 msgr2=0x7f9594138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:46.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.299+0000 7f95994ef700 1 --2- 172.21.15.156:0/3232299679 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9594135f20 0x7f9594138300 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f958c009e80 tx=0x7f958c00b330 comp rx=0 tx=0).stop 2023-09-30T22:20:46.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.299+0000 7f95994ef700 1 -- 172.21.15.156:0/3232299679 shutdown_connections 2023-09-30T22:20:46.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.299+0000 7f95994ef700 1 --2- 172.21.15.156:0/3232299679 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9594135f20 0x7f9594138300 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.299+0000 7f95994ef700 1 --2- 172.21.15.156:0/3232299679 >> v2:172.21.15.156:3300/0 conn(0x7f959409e340 0x7f95941359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.299+0000 7f95994ef700 1 -- 172.21.15.156:0/3232299679 >> 172.21.15.156:0/3232299679 conn(0x7f9594099c40 msgr2=0x7f95940a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:46.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.300+0000 7f95994ef700 1 -- 172.21.15.156:0/3232299679 shutdown_connections 2023-09-30T22:20:46.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.300+0000 7f95994ef700 1 -- 172.21.15.156:0/3232299679 wait complete. 2023-09-30T22:20:46.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.301+0000 7f95994ef700 1 Processor -- start 2023-09-30T22:20:46.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.301+0000 7f95994ef700 1 -- start start 2023-09-30T22:20:46.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.301+0000 7f95994ef700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f959409d860 0x7f959411b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:46.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.302+0000 7f95994ef700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f959409e340 0x7f959411bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:46.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.302+0000 7f95994ef700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9594135f20 0x7f959411c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:46.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.302+0000 7f95994ef700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959411e830 con 0x7f959409d860 2023-09-30T22:20:46.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.302+0000 7f95994ef700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959411d1b0 con 0x7f959409e340 2023-09-30T22:20:46.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.302+0000 7f95994ef700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9594072780 con 0x7f9594135f20 2023-09-30T22:20:46.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.302+0000 7f95927fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f959409e340 0x7f959411bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:46.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.302+0000 7f95927fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f959409e340 0x7f959411bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40680/0 (socket says 172.21.15.156:40680) 2023-09-30T22:20:46.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.302+0000 7f95927fc700 1 -- 172.21.15.156:0/3014072524 learned_addr learned my addr 172.21.15.156:0/3014072524 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:46.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.302+0000 7f9592ffd700 1 --2- 172.21.15.156:0/3014072524 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f959409d860 0x7f959411b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:46.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.302+0000 7f95927fc700 1 -- 172.21.15.156:0/3014072524 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9594135f20 msgr2=0x7f959411c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:46.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.302+0000 7f95927fc700 1 --2- 172.21.15.156:0/3014072524 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9594135f20 0x7f959411c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.302+0000 7f95927fc700 1 -- 172.21.15.156:0/3014072524 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f959409d860 msgr2=0x7f959411b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:46.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.302+0000 7f95927fc700 1 --2- 172.21.15.156:0/3014072524 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f959409d860 0x7f959411b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.302+0000 7f95927fc700 1 -- 172.21.15.156:0/3014072524 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958c009b30 con 0x7f959409e340 2023-09-30T22:20:46.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.302+0000 7f95927fc700 1 --2- 172.21.15.156:0/3014072524 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f959409e340 0x7f959411bae0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f958800b500 tx=0x7f958800b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:46.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.302+0000 7f957b7fe700 1 -- 172.21.15.156:0/3014072524 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9588011830 con 0x7f959409e340 2023-09-30T22:20:46.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.302+0000 7f957b7fe700 1 -- 172.21.15.156:0/3014072524 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95880119b0 con 0x7f959409e340 2023-09-30T22:20:46.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.302+0000 7f95994ef700 1 -- 172.21.15.156:0/3014072524 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f959409c8b0 con 0x7f959409e340 2023-09-30T22:20:46.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.302+0000 7f957b7fe700 1 -- 172.21.15.156:0/3014072524 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9588011d60 con 0x7f959409e340 2023-09-30T22:20:46.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.302+0000 7f95994ef700 1 -- 172.21.15.156:0/3014072524 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f959411f5c0 con 0x7f959409e340 2023-09-30T22:20:46.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.303+0000 7f957b7fe700 1 -- 172.21.15.156:0/3014072524 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f958801a400 con 0x7f959409e340 2023-09-30T22:20:46.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.304+0000 7f95994ef700 1 -- 172.21.15.156:0/3014072524 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f959411ec30 con 0x7f959409e340 2023-09-30T22:20:46.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.304+0000 7f957b7fe700 1 -- 172.21.15.156:0/3014072524 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f958803f710 con 0x7f959409e340 2023-09-30T22:20:46.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.305+0000 7f947bfff700 1 -- 172.21.15.156:0/1149156429 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f948401bc30 con 0x7f949409e870 2023-09-30T22:20:46.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.308+0000 7f957b7fe700 1 -- 172.21.15.156:0/3014072524 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f958800f8d0 con 0x7f959409e340 2023-09-30T22:20:46.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.334+0000 7f83a1e1f700 1 Processor -- start 2023-09-30T22:20:46.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.335+0000 7f83a1e1f700 1 -- start start 2023-09-30T22:20:46.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.335+0000 7f83a1e1f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f839c09f350 0x7f839c136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:46.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.335+0000 7f83a1e1f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f839c1371c0 0x7f839c1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:46.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.335+0000 7f83a1e1f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f839c09c970 con 0x7f839c09e870 2023-09-30T22:20:46.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.335+0000 7f83a1e1f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f839c0a0920 con 0x7f839c1371c0 2023-09-30T22:20:46.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.335+0000 7f83a1e1f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839c09f9c0 con 0x7f839c09f350 2023-09-30T22:20:46.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.335+0000 7f839affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f839c09f350 0x7f839c136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:46.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.335+0000 7f839affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f839c09f350 0x7f839c136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40696/0 (socket says 172.21.15.156:40696) 2023-09-30T22:20:46.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.335+0000 7f839affd700 1 -- 172.21.15.156:0/1562891964 learned_addr learned my addr 172.21.15.156:0/1562891964 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:46.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.335+0000 7f839bfff700 1 --2- 172.21.15.156:0/1562891964 >> v2:172.21.15.156:3300/0 conn(0x7f839c1371c0 0x7f839c1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:46.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.336+0000 7f839affd700 1 -- 172.21.15.156:0/1562891964 >> v2:172.21.15.156:3300/0 conn(0x7f839c1371c0 msgr2=0x7f839c1395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:46.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.336+0000 7f839affd700 1 --2- 172.21.15.156:0/1562891964 >> v2:172.21.15.156:3300/0 conn(0x7f839c1371c0 0x7f839c1395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.336+0000 7f839affd700 1 -- 172.21.15.156:0/1562891964 >> v1:172.21.15.156:6789/0 conn(0x7f839c09e870 legacy=0x7f839c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:46.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.336+0000 7f839affd700 1 -- 172.21.15.156:0/1562891964 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839c09bab0 con 0x7f839c09f350 2023-09-30T22:20:46.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.336+0000 7f839affd700 1 --2- 172.21.15.156:0/1562891964 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f839c09f350 0x7f839c136c80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f83900098f0 tx=0x7f8390009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e9dec8e29b472c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:46.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.336+0000 7f839a7fc700 1 -- 172.21.15.156:0/1562891964 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8390011830 con 0x7f839c09f350 2023-09-30T22:20:46.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.336+0000 7f839a7fc700 1 -- 172.21.15.156:0/1562891964 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8390011990 con 0x7f839c09f350 2023-09-30T22:20:46.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.336+0000 7f839a7fc700 1 -- 172.21.15.156:0/1562891964 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8390011d20 con 0x7f839c09f350 2023-09-30T22:20:46.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.337+0000 7f83a1e1f700 1 -- 172.21.15.156:0/1562891964 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f839c09f350 msgr2=0x7f839c136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:46.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.337+0000 7f83a1e1f700 1 --2- 172.21.15.156:0/1562891964 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f839c09f350 0x7f839c136c80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f83900098f0 tx=0x7f8390009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:46.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.337+0000 7f83a1e1f700 1 -- 172.21.15.156:0/1562891964 shutdown_connections 2023-09-30T22:20:46.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.337+0000 7f83a1e1f700 1 --2- 172.21.15.156:0/1562891964 >> v2:172.21.15.156:3300/0 conn(0x7f839c1371c0 0x7f839c1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.337+0000 7f83a1e1f700 1 --2- 172.21.15.156:0/1562891964 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f839c09f350 0x7f839c136c80 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.337+0000 7f83a1e1f700 1 -- 172.21.15.156:0/1562891964 >> 172.21.15.156:0/1562891964 conn(0x7f839c0a4430 msgr2=0x7f839c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:46.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.337+0000 7f83a1e1f700 1 -- 172.21.15.156:0/1562891964 shutdown_connections 2023-09-30T22:20:46.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.337+0000 7f83a1e1f700 1 -- 172.21.15.156:0/1562891964 wait complete. 2023-09-30T22:20:46.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.338+0000 7f83a1e1f700 1 Processor -- start 2023-09-30T22:20:46.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.338+0000 7f83a1e1f700 1 -- start start 2023-09-30T22:20:46.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.339+0000 7f83a1e1f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f839c09e870 0x7f839c11f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:46.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.339+0000 7f83a1e1f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f839c09f350 0x7f839c11fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:46.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.339+0000 7f83a1e1f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f839c1371c0 0x7f839c120250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:46.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.339+0000 7f83a1e1f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839c1213e0 con 0x7f839c1371c0 2023-09-30T22:20:46.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.339+0000 7f83a1e1f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839c123530 con 0x7f839c09e870 2023-09-30T22:20:46.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.339+0000 7f83a1e1f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f839c123010 con 0x7f839c09f350 2023-09-30T22:20:46.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.339+0000 7f839b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f839c09e870 0x7f839c11f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:46.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.339+0000 7f839b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f839c09e870 0x7f839c11f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40712/0 (socket says 172.21.15.156:40712) 2023-09-30T22:20:46.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.339+0000 7f839b7fe700 1 -- 172.21.15.156:0/3179599377 learned_addr learned my addr 172.21.15.156:0/3179599377 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:46.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.339+0000 7f839affd700 1 --2- 172.21.15.156:0/3179599377 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f839c09f350 0x7f839c11fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:46.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.339+0000 7f839bfff700 1 --2- 172.21.15.156:0/3179599377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f839c1371c0 0x7f839c120250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:46.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.339+0000 7f839b7fe700 1 -- 172.21.15.156:0/3179599377 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f839c09f350 msgr2=0x7f839c11fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:46.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.339+0000 7f839b7fe700 1 --2- 172.21.15.156:0/3179599377 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f839c09f350 0x7f839c11fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.339+0000 7f839b7fe700 1 -- 172.21.15.156:0/3179599377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f839c1371c0 msgr2=0x7f839c120250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:46.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.339+0000 7f839b7fe700 1 --2- 172.21.15.156:0/3179599377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f839c1371c0 0x7f839c120250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.339+0000 7f839b7fe700 1 -- 172.21.15.156:0/3179599377 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8390009550 con 0x7f839c09e870 2023-09-30T22:20:46.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.340+0000 7f839b7fe700 1 --2- 172.21.15.156:0/3179599377 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f839c09e870 0x7f839c11f7d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f838c00c4e0 tx=0x7f838c00c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:46.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.340+0000 7f8383fff700 1 -- 172.21.15.156:0/3179599377 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c0052d0 con 0x7f839c09e870 2023-09-30T22:20:46.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.340+0000 7f8383fff700 1 -- 172.21.15.156:0/3179599377 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838c005430 con 0x7f839c09e870 2023-09-30T22:20:46.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.340+0000 7f8383fff700 1 -- 172.21.15.156:0/3179599377 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c011990 con 0x7f839c09e870 2023-09-30T22:20:46.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.340+0000 7f83a1e1f700 1 -- 172.21.15.156:0/3179599377 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f839c122a80 con 0x7f839c09e870 2023-09-30T22:20:46.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.340+0000 7f83a1e1f700 1 -- 172.21.15.156:0/3179599377 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f839c09dba0 con 0x7f839c09e870 2023-09-30T22:20:46.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.341+0000 7f8383fff700 1 -- 172.21.15.156:0/3179599377 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f838c011af0 con 0x7f839c09e870 2023-09-30T22:20:46.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.341+0000 7f83a1e1f700 1 -- 172.21.15.156:0/3179599377 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f839c122cb0 con 0x7f839c09e870 2023-09-30T22:20:46.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.341+0000 7f8383fff700 1 -- 172.21.15.156:0/3179599377 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f838c042cb0 con 0x7f839c09e870 2023-09-30T22:20:46.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.349+0000 7f8383fff700 1 -- 172.21.15.156:0/3179599377 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f839c122cb0 con 0x7f839c09e870 2023-09-30T22:20:46.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.385+0000 7fc970c40700 1 Processor -- start 2023-09-30T22:20:46.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.385+0000 7fc970c40700 1 -- start start 2023-09-30T22:20:46.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.385+0000 7fc970c40700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc96c0a09e0 0x7fc96c0a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:46.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.385+0000 7fc970c40700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc96c0a12f0 0x7fc96c133a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:46.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.385+0000 7fc970c40700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc96c133f40 0x7fc96c1343c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:46.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.385+0000 7fc970c40700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96c09de10 con 0x7fc96c0a09e0 2023-09-30T22:20:46.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.385+0000 7fc970c40700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c09db90 con 0x7fc96c133f40 2023-09-30T22:20:46.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.385+0000 7fc970c40700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c0a2560 con 0x7fc96c0a12f0 2023-09-30T22:20:46.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.385+0000 7fc96a59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc96c0a09e0 0x7fc96c0a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:46.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.385+0000 7fc96a59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc96c0a09e0 0x7fc96c0a0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54466/0 (socket says 172.21.15.156:54466) 2023-09-30T22:20:46.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.385+0000 7fc96a59c700 1 -- 172.21.15.156:0/3532060920 learned_addr learned my addr 172.21.15.156:0/3532060920 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:46.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.386+0000 7fc969d9b700 1 --2- 172.21.15.156:0/3532060920 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc96c0a12f0 0x7fc96c133a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:46.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.386+0000 7fc96a59c700 1 -- 172.21.15.156:0/3532060920 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc96c0a12f0 msgr2=0x7fc96c133a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:46.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.386+0000 7fc96a59c700 1 --2- 172.21.15.156:0/3532060920 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc96c0a12f0 0x7fc96c133a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.386+0000 7fc96a59c700 1 -- 172.21.15.156:0/3532060920 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc96c133f40 msgr2=0x7fc96c1343c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:46.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.386+0000 7fc96a59c700 1 --2- 172.21.15.156:0/3532060920 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc96c133f40 0x7fc96c1343c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.386+0000 7fc96a59c700 1 -- 172.21.15.156:0/3532060920 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c0a1f60 con 0x7fc96c0a09e0 2023-09-30T22:20:46.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.386+0000 7fc969d9b700 1 --2- 172.21.15.156:0/3532060920 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc96c0a12f0 0x7fc96c133a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:20:46.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.386+0000 7fc96a59c700 1 --2- 172.21.15.156:0/3532060920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc96c0a09e0 0x7fc96c0a0db0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0098f0 tx=0x7fc95c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9dc87be133842c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:46.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.386+0000 7fc96959a700 1 -- 172.21.15.156:0/3532060920 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c00b8a0 con 0x7fc96c0a09e0 2023-09-30T22:20:46.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.386+0000 7fc96959a700 1 -- 172.21.15.156:0/3532060920 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c00ba00 con 0x7fc96c0a09e0 2023-09-30T22:20:46.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.386+0000 7fc96959a700 1 -- 172.21.15.156:0/3532060920 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c00bd90 con 0x7fc96c0a09e0 2023-09-30T22:20:46.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.387+0000 7fc970c40700 1 -- 172.21.15.156:0/3532060920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc96c0a09e0 msgr2=0x7fc96c0a0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:46.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.387+0000 7fc970c40700 1 --2- 172.21.15.156:0/3532060920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc96c0a09e0 0x7fc96c0a0db0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0098f0 tx=0x7fc95c009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:46.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.387+0000 7fc970c40700 1 -- 172.21.15.156:0/3532060920 shutdown_connections 2023-09-30T22:20:46.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.387+0000 7fc970c40700 1 --2- 172.21.15.156:0/3532060920 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc96c133f40 0x7fc96c1343c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.387+0000 7fc970c40700 1 --2- 172.21.15.156:0/3532060920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc96c0a09e0 0x7fc96c0a0db0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.387+0000 7fc970c40700 1 --2- 172.21.15.156:0/3532060920 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc96c0a12f0 0x7fc96c133a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.387+0000 7fc970c40700 1 -- 172.21.15.156:0/3532060920 >> 172.21.15.156:0/3532060920 conn(0x7fc96c0a3000 msgr2=0x7fc96c0a3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:46.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.387+0000 7fc970c40700 1 -- 172.21.15.156:0/3532060920 shutdown_connections 2023-09-30T22:20:46.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.387+0000 7fc970c40700 1 -- 172.21.15.156:0/3532060920 wait complete. 2023-09-30T22:20:46.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.388+0000 7fc970c40700 1 Processor -- start 2023-09-30T22:20:46.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.388+0000 7fc970c40700 1 -- start start 2023-09-30T22:20:46.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.388+0000 7fc970c40700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc96c0a09e0 0x7fc96c1229a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:46.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.388+0000 7fc970c40700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc96c0a12f0 0x7fc96c122ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:46.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.388+0000 7fc970c40700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc96c133f40 0x7fc96c123420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:46.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.388+0000 7fc970c40700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c126f10 con 0x7fc96c0a09e0 2023-09-30T22:20:46.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.388+0000 7fc970c40700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c125d90 con 0x7fc96c133f40 2023-09-30T22:20:46.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.388+0000 7fc970c40700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c124c80 con 0x7fc96c0a12f0 2023-09-30T22:20:46.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.388+0000 7fc96ad9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc96c133f40 0x7fc96c123420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:46.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.389+0000 7fc96ad9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc96c133f40 0x7fc96c123420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40720/0 (socket says 172.21.15.156:40720) 2023-09-30T22:20:46.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.389+0000 7fc96ad9d700 1 -- 172.21.15.156:0/862905354 learned_addr learned my addr 172.21.15.156:0/862905354 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:46.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.389+0000 7fc96a59c700 1 --2- 172.21.15.156:0/862905354 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc96c0a09e0 0x7fc96c1229a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:46.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.389+0000 7fc969d9b700 1 --2- 172.21.15.156:0/862905354 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc96c0a12f0 0x7fc96c122ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:46.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.389+0000 7fc96ad9d700 1 -- 172.21.15.156:0/862905354 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc96c0a12f0 msgr2=0x7fc96c122ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:46.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.389+0000 7fc96ad9d700 1 --2- 172.21.15.156:0/862905354 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc96c0a12f0 0x7fc96c122ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.389+0000 7fc96ad9d700 1 -- 172.21.15.156:0/862905354 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc96c0a09e0 msgr2=0x7fc96c1229a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:46.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.389+0000 7fc96ad9d700 1 --2- 172.21.15.156:0/862905354 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc96c0a09e0 0x7fc96c1229a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.389+0000 7fc96ad9d700 1 -- 172.21.15.156:0/862905354 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95c009550 con 0x7fc96c133f40 2023-09-30T22:20:46.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.389+0000 7fc96ad9d700 1 --2- 172.21.15.156:0/862905354 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc96c133f40 0x7fc96c123420 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc96400b9a0 tx=0x7fc96400bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:46.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.389+0000 7fc95affd700 1 -- 172.21.15.156:0/862905354 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96400d850 con 0x7fc96c133f40 2023-09-30T22:20:46.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.389+0000 7fc95affd700 1 -- 172.21.15.156:0/862905354 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96400d9d0 con 0x7fc96c133f40 2023-09-30T22:20:46.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.389+0000 7fc970c40700 1 -- 172.21.15.156:0/862905354 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc96c09b700 con 0x7fc96c133f40 2023-09-30T22:20:46.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.389+0000 7fc95affd700 1 -- 172.21.15.156:0/862905354 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96400dd80 con 0x7fc96c133f40 2023-09-30T22:20:46.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.389+0000 7fc970c40700 1 -- 172.21.15.156:0/862905354 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96c126830 con 0x7fc96c133f40 2023-09-30T22:20:46.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.390+0000 7fc95affd700 1 -- 172.21.15.156:0/862905354 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc9640203f0 con 0x7fc96c133f40 2023-09-30T22:20:46.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.390+0000 7fc95affd700 1 -- 172.21.15.156:0/862905354 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc96403f710 con 0x7fc96c133f40 2023-09-30T22:20:46.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.390+0000 7fc970c40700 1 -- 172.21.15.156:0/862905354 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc96c125ed0 con 0x7fc96c133f40 2023-09-30T22:20:46.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.395+0000 7fc95affd700 1 -- 172.21.15.156:0/862905354 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc964016950 con 0x7fc96c133f40 2023-09-30T22:20:46.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.545+0000 7f83a1e1f700 1 -- 172.21.15.156:0/3179599377 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f839c122cb0 con 0x7f839c09e870 2023-09-30T22:20:46.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.546+0000 7f8383fff700 1 -- 172.21.15.156:0/3179599377 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f839c122cb0 con 0x7f839c09e870 2023-09-30T22:20:46.547 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:46.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.548+0000 7f83a1e1f700 1 -- 172.21.15.156:0/3179599377 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f839c09e870 msgr2=0x7f839c11f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:46.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.548+0000 7f83a1e1f700 1 --2- 172.21.15.156:0/3179599377 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f839c09e870 0x7f839c11f7d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f838c00c4e0 tx=0x7f838c00c7f0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.548+0000 7f83a1e1f700 1 -- 172.21.15.156:0/3179599377 shutdown_connections 2023-09-30T22:20:46.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.548+0000 7f83a1e1f700 1 --2- 172.21.15.156:0/3179599377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f839c1371c0 0x7f839c120250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.548+0000 7f83a1e1f700 1 --2- 172.21.15.156:0/3179599377 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f839c09e870 0x7f839c11f7d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.548+0000 7f83a1e1f700 1 --2- 172.21.15.156:0/3179599377 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f839c09f350 0x7f839c11fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.548+0000 7f83a1e1f700 1 -- 172.21.15.156:0/3179599377 >> 172.21.15.156:0/3179599377 conn(0x7f839c0a4430 msgr2=0x7f839c0a2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:46.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.548+0000 7f83a1e1f700 1 -- 172.21.15.156:0/3179599377 shutdown_connections 2023-09-30T22:20:46.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.548+0000 7f83a1e1f700 1 -- 172.21.15.156:0/3179599377 wait complete. 2023-09-30T22:20:46.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.559+0000 7f949a20c700 1 -- 172.21.15.156:0/1149156429 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f949404f2a0 con 0x7f949409e870 2023-09-30T22:20:46.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.559+0000 7f947bfff700 1 -- 172.21.15.156:0/1149156429 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9484017030 con 0x7f949409e870 2023-09-30T22:20:46.560 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:46.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:46.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.561+0000 7f95994ef700 1 -- 172.21.15.156:0/3014072524 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f959404f2a0 con 0x7f959409e340 2023-09-30T22:20:46.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.561+0000 7f949a20c700 1 -- 172.21.15.156:0/1149156429 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f949409e870 msgr2=0x7f9494120070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:46.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.561+0000 7f949a20c700 1 --2- 172.21.15.156:0/1149156429 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f949409e870 0x7f9494120070 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f948400e870 tx=0x7f948400eb80 comp rx=0 tx=0).stop 2023-09-30T22:20:46.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.561+0000 7f949a20c700 1 -- 172.21.15.156:0/1149156429 shutdown_connections 2023-09-30T22:20:46.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.561+0000 7f949a20c700 1 --2- 172.21.15.156:0/1149156429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9494131d70 0x7f9494120af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.561+0000 7f949a20c700 1 --2- 172.21.15.156:0/1149156429 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f949409e870 0x7f9494120070 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.561+0000 7f949a20c700 1 --2- 172.21.15.156:0/1149156429 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f949409f180 0x7f94941205b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.561+0000 7f949a20c700 1 -- 172.21.15.156:0/1149156429 >> 172.21.15.156:0/1149156429 conn(0x7f94940a4430 msgr2=0x7f9494071260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:46.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.562+0000 7f949a20c700 1 -- 172.21.15.156:0/1149156429 shutdown_connections 2023-09-30T22:20:46.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.562+0000 7f949a20c700 1 -- 172.21.15.156:0/1149156429 wait complete. 2023-09-30T22:20:46.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.562+0000 7f957b7fe700 1 -- 172.21.15.156:0/3014072524 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9588015030 con 0x7f959409e340 2023-09-30T22:20:46.564 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:46.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.564+0000 7f95994ef700 1 -- 172.21.15.156:0/3014072524 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f959409e340 msgr2=0x7f959411bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:46.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.564+0000 7f95994ef700 1 --2- 172.21.15.156:0/3014072524 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f959409e340 0x7f959411bae0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f958800b500 tx=0x7f958800b810 comp rx=0 tx=0).stop 2023-09-30T22:20:46.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.564+0000 7f95994ef700 1 -- 172.21.15.156:0/3014072524 shutdown_connections 2023-09-30T22:20:46.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.564+0000 7f95994ef700 1 --2- 172.21.15.156:0/3014072524 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9594135f20 0x7f959411c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.564+0000 7f95994ef700 1 --2- 172.21.15.156:0/3014072524 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f959409d860 0x7f959411b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.564+0000 7f95994ef700 1 --2- 172.21.15.156:0/3014072524 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f959409e340 0x7f959411bae0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.564+0000 7f95994ef700 1 -- 172.21.15.156:0/3014072524 >> 172.21.15.156:0/3014072524 conn(0x7f9594099c40 msgr2=0x7f95940a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:46.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.564+0000 7f95994ef700 1 -- 172.21.15.156:0/3014072524 shutdown_connections 2023-09-30T22:20:46.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.564+0000 7f95994ef700 1 -- 172.21.15.156:0/3014072524 wait complete. 2023-09-30T22:20:46.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:46.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:46.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.592+0000 7fc970c40700 1 -- 172.21.15.156:0/862905354 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc96c04f2a0 con 0x7fc96c133f40 2023-09-30T22:20:46.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.592+0000 7fc95affd700 1 -- 172.21.15.156:0/862905354 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc96400c370 con 0x7fc96c133f40 2023-09-30T22:20:46.593 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:46.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.594+0000 7fc970c40700 1 -- 172.21.15.156:0/862905354 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc96c133f40 msgr2=0x7fc96c123420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:46.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.594+0000 7fc970c40700 1 --2- 172.21.15.156:0/862905354 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc96c133f40 0x7fc96c123420 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc96400b9a0 tx=0x7fc96400bcb0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.594+0000 7fc970c40700 1 -- 172.21.15.156:0/862905354 shutdown_connections 2023-09-30T22:20:46.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.594+0000 7fc970c40700 1 --2- 172.21.15.156:0/862905354 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc96c133f40 0x7fc96c123420 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.594+0000 7fc970c40700 1 --2- 172.21.15.156:0/862905354 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc96c0a09e0 0x7fc96c1229a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.594+0000 7fc970c40700 1 --2- 172.21.15.156:0/862905354 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc96c0a12f0 0x7fc96c122ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:46.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.594+0000 7fc970c40700 1 -- 172.21.15.156:0/862905354 >> 172.21.15.156:0/862905354 conn(0x7fc96c0a3000 msgr2=0x7fc96c09b910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:46.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.594+0000 7fc970c40700 1 -- 172.21.15.156:0/862905354 shutdown_connections 2023-09-30T22:20:46.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:46.594+0000 7fc970c40700 1 -- 172.21.15.156:0/862905354 wait complete. 2023-09-30T22:20:46.607 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:47.563 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:47.577 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:47.579 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:47.607 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:47.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.713+0000 7f43c7890700 1 Processor -- start 2023-09-30T22:20:47.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.713+0000 7f43c7890700 1 -- start start 2023-09-30T22:20:47.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.714+0000 7f43c7890700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f43c009e870 0x7f43c009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:47.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.714+0000 7f43c7890700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f43c0131f40 0x7f43c0139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:47.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.714+0000 7f43c7890700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c009c970 con 0x7f43c009f180 2023-09-30T22:20:47.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.714+0000 7f43c7890700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c00a0920 con 0x7f43c0131f40 2023-09-30T22:20:47.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.714+0000 7f43c7890700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43c009f9c0 con 0x7f43c009e870 2023-09-30T22:20:47.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.714+0000 7f43c562c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f43c009e870 0x7f43c009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:47.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.714+0000 7f43c562c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f43c009e870 0x7f43c009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43570/0 (socket says 172.21.15.156:43570) 2023-09-30T22:20:47.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.714+0000 7f43c562c700 1 -- 172.21.15.156:0/1959698662 learned_addr learned my addr 172.21.15.156:0/1959698662 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:47.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.714+0000 7f43c5e2d700 1 --2- 172.21.15.156:0/1959698662 >> v2:172.21.15.156:3300/0 conn(0x7f43c0131f40 0x7f43c0139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:47.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.715+0000 7f43c5e2d700 1 -- 172.21.15.156:0/1959698662 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f43c009e870 msgr2=0x7f43c009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:47.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.715+0000 7f43c5e2d700 1 --2- 172.21.15.156:0/1959698662 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f43c009e870 0x7f43c009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.715+0000 7f43c5e2d700 1 -- 172.21.15.156:0/1959698662 >> v1:172.21.15.156:6789/0 conn(0x7f43c009f180 legacy=0x7f43c0131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:47.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.715+0000 7f43c5e2d700 1 -- 172.21.15.156:0/1959698662 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c009bab0 con 0x7f43c0131f40 2023-09-30T22:20:47.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.715+0000 7f43c5e2d700 1 --2- 172.21.15.156:0/1959698662 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43c0131f40 0x7f43c0139ca0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f43b800f370 tx=0x7f43b800f680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55dd8db731913c38 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:47.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.715+0000 7f43b7fff700 1 -- 172.21.15.156:0/1959698662 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b8012070 con 0x7f43c0131f40 2023-09-30T22:20:47.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.715+0000 7f43b7fff700 1 -- 172.21.15.156:0/1959698662 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b800fe70 con 0x7f43c0131f40 2023-09-30T22:20:47.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.715+0000 7f43b7fff700 1 -- 172.21.15.156:0/1959698662 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b800d2f0 con 0x7f43c0131f40 2023-09-30T22:20:47.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.716+0000 7f43c7890700 1 -- 172.21.15.156:0/1959698662 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43c0131f40 msgr2=0x7f43c0139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:47.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.716+0000 7f43c7890700 1 --2- 172.21.15.156:0/1959698662 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43c0131f40 0x7f43c0139ca0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f43b800f370 tx=0x7f43b800f680 comp rx=0 tx=0).stop 2023-09-30T22:20:47.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.716+0000 7f43c7890700 1 -- 172.21.15.156:0/1959698662 shutdown_connections 2023-09-30T22:20:47.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.716+0000 7f43c7890700 1 --2- 172.21.15.156:0/1959698662 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43c0131f40 0x7f43c0139ca0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.716+0000 7f43c7890700 1 --2- 172.21.15.156:0/1959698662 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f43c009e870 0x7f43c009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.716+0000 7f43c7890700 1 -- 172.21.15.156:0/1959698662 >> 172.21.15.156:0/1959698662 conn(0x7f43c00a4430 msgr2=0x7f43c00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:47.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.716+0000 7f43c7890700 1 -- 172.21.15.156:0/1959698662 shutdown_connections 2023-09-30T22:20:47.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.716+0000 7f43c7890700 1 -- 172.21.15.156:0/1959698662 wait complete. 2023-09-30T22:20:47.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.718+0000 7f43c7890700 1 Processor -- start 2023-09-30T22:20:47.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.718+0000 7f43c7890700 1 -- start start 2023-09-30T22:20:47.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.718+0000 7f43c7890700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f43c009e870 0x7f43c011df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:47.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.718+0000 7f43c7890700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43c009f180 0x7f43c011e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:47.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.718+0000 7f43c7890700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43c0131f40 0x7f43c011e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:47.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.718+0000 7f43c7890700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c01223a0 con 0x7f43c0131f40 2023-09-30T22:20:47.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.718+0000 7f43c7890700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c01219e0 con 0x7f43c009f180 2023-09-30T22:20:47.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.718+0000 7f43c7890700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43c0120db0 con 0x7f43c009e870 2023-09-30T22:20:47.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.718+0000 7f43c4e2b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43c009f180 0x7f43c011e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:47.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.719+0000 7f43c5e2d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43c0131f40 0x7f43c011e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:47.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.719+0000 7f43c4e2b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43c009f180 0x7f43c011e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40732/0 (socket says 172.21.15.156:40732) 2023-09-30T22:20:47.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.719+0000 7f43c4e2b700 1 -- 172.21.15.156:0/2850163941 learned_addr learned my addr 172.21.15.156:0/2850163941 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:47.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.719+0000 7f43c562c700 1 --2- 172.21.15.156:0/2850163941 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f43c009e870 0x7f43c011df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:47.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.719+0000 7f43c4e2b700 1 -- 172.21.15.156:0/2850163941 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f43c009e870 msgr2=0x7f43c011df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:47.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.719+0000 7f43c4e2b700 1 --2- 172.21.15.156:0/2850163941 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f43c009e870 0x7f43c011df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.719+0000 7f43c4e2b700 1 -- 172.21.15.156:0/2850163941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43c0131f40 msgr2=0x7f43c011e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:47.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.719+0000 7f43c4e2b700 1 --2- 172.21.15.156:0/2850163941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43c0131f40 0x7f43c011e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.719+0000 7f43c4e2b700 1 -- 172.21.15.156:0/2850163941 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b800f050 con 0x7f43c009f180 2023-09-30T22:20:47.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.719+0000 7f43c4e2b700 1 --2- 172.21.15.156:0/2850163941 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43c009f180 0x7f43c011e470 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f43b000c510 tx=0x7f43b000c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:47.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.719+0000 7f43b5ffb700 1 -- 172.21.15.156:0/2850163941 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b000cea0 con 0x7f43c009f180 2023-09-30T22:20:47.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.719+0000 7f43b5ffb700 1 -- 172.21.15.156:0/2850163941 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b00052d0 con 0x7f43c009f180 2023-09-30T22:20:47.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.719+0000 7f43c7890700 1 -- 172.21.15.156:0/2850163941 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c009dba0 con 0x7f43c009f180 2023-09-30T22:20:47.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.719+0000 7f43b5ffb700 1 -- 172.21.15.156:0/2850163941 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b0003680 con 0x7f43c009f180 2023-09-30T22:20:47.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.720+0000 7f43c7890700 1 -- 172.21.15.156:0/2850163941 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c01200b0 con 0x7f43c009f180 2023-09-30T22:20:47.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.720+0000 7f43b5ffb700 1 -- 172.21.15.156:0/2850163941 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f43b00037e0 con 0x7f43c009f180 2023-09-30T22:20:47.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.720+0000 7f43b5ffb700 1 -- 172.21.15.156:0/2850163941 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f43b003ea00 con 0x7f43c009f180 2023-09-30T22:20:47.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.721+0000 7f43c7890700 1 -- 172.21.15.156:0/2850163941 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c004f2a0 con 0x7f43c009f180 2023-09-30T22:20:47.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.730+0000 7f43b5ffb700 1 -- 172.21.15.156:0/2850163941 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f43b0019b40 con 0x7f43c009f180 2023-09-30T22:20:47.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.746+0000 7f8944a3e700 1 Processor -- start 2023-09-30T22:20:47.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.746+0000 7f8944a3e700 1 -- start start 2023-09-30T22:20:47.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.747+0000 7f8944a3e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f894009a130 0x7f894009e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:47.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.747+0000 7f8944a3e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f894009edb0 0x7f894009f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:47.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.747+0000 7f8944a3e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8940072b30 con 0x7f894013c410 2023-09-30T22:20:47.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.747+0000 7f8944a3e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f894009a500 con 0x7f894009edb0 2023-09-30T22:20:47.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.747+0000 7f8944a3e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f894009f720 con 0x7f894009a130 2023-09-30T22:20:47.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.747+0000 7f893e59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f894009a130 0x7f894009e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:47.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.747+0000 7f893dd9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f894009edb0 0x7f894009f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:47.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.747+0000 7f893e59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f894009a130 0x7f894009e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43584/0 (socket says 172.21.15.156:43584) 2023-09-30T22:20:47.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.747+0000 7f893dd9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f894009edb0 0x7f894009f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54500/0 (socket says 172.21.15.156:54500) 2023-09-30T22:20:47.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.747+0000 7f893e59c700 1 -- 172.21.15.156:0/263295923 learned_addr learned my addr 172.21.15.156:0/263295923 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:47.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.747+0000 7f893e59c700 1 -- 172.21.15.156:0/263295923 >> v2:172.21.15.156:3300/0 conn(0x7f894009edb0 msgr2=0x7f894009f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:47.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.747+0000 7f893e59c700 1 --2- 172.21.15.156:0/263295923 >> v2:172.21.15.156:3300/0 conn(0x7f894009edb0 0x7f894009f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.747+0000 7f893e59c700 1 -- 172.21.15.156:0/263295923 >> v1:172.21.15.156:6789/0 conn(0x7f894013c410 legacy=0x7f894013e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:47.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.747+0000 7f893e59c700 1 -- 172.21.15.156:0/263295923 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894009fe00 con 0x7f894009a130 2023-09-30T22:20:47.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.747+0000 7f893dd9b700 1 --2- 172.21.15.156:0/263295923 >> v2:172.21.15.156:3300/0 conn(0x7f894009edb0 0x7f894009f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:47.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.748+0000 7f893e59c700 1 --2- 172.21.15.156:0/263295923 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f894009a130 0x7f894009e870 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8930009920 tx=0x7f8930009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b06931c0d30343e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:47.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.748+0000 7f893d59a700 1 -- 172.21.15.156:0/263295923 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8930011830 con 0x7f894009a130 2023-09-30T22:20:47.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.748+0000 7f893d59a700 1 -- 172.21.15.156:0/263295923 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8930011990 con 0x7f894009a130 2023-09-30T22:20:47.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.748+0000 7f893d59a700 1 -- 172.21.15.156:0/263295923 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8930011d20 con 0x7f894009a130 2023-09-30T22:20:47.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.748+0000 7f8944a3e700 1 -- 172.21.15.156:0/263295923 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f894009a130 msgr2=0x7f894009e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:47.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.748+0000 7f8944a3e700 1 --2- 172.21.15.156:0/263295923 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f894009a130 0x7f894009e870 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8930009920 tx=0x7f8930009c30 comp rx=0 tx=0).stop 2023-09-30T22:20:47.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.749+0000 7f8944a3e700 1 -- 172.21.15.156:0/263295923 shutdown_connections 2023-09-30T22:20:47.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.749+0000 7f8944a3e700 1 --2- 172.21.15.156:0/263295923 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f894009a130 0x7f894009e870 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.749+0000 7f8944a3e700 1 --2- 172.21.15.156:0/263295923 >> v2:172.21.15.156:3300/0 conn(0x7f894009edb0 0x7f894009f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.749+0000 7f8944a3e700 1 -- 172.21.15.156:0/263295923 >> 172.21.15.156:0/263295923 conn(0x7f89400a4430 msgr2=0x7f89400a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:47.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.749+0000 7f8944a3e700 1 -- 172.21.15.156:0/263295923 shutdown_connections 2023-09-30T22:20:47.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.749+0000 7f8944a3e700 1 -- 172.21.15.156:0/263295923 wait complete. 2023-09-30T22:20:47.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.750+0000 7f8944a3e700 1 Processor -- start 2023-09-30T22:20:47.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.750+0000 7f8944a3e700 1 -- start start 2023-09-30T22:20:47.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.750+0000 7f8944a3e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f894009a130 0x7f894011b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:47.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.750+0000 7f8944a3e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f894009edb0 0x7f894011b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:47.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.750+0000 7f8944a3e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f894013c410 0x7f894011bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:47.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.750+0000 7f8944a3e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894011ce70 con 0x7f894009edb0 2023-09-30T22:20:47.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.750+0000 7f8944a3e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894011e150 con 0x7f894013c410 2023-09-30T22:20:47.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.750+0000 7f8944a3e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f894011c6c0 con 0x7f894009a130 2023-09-30T22:20:47.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.750+0000 7f893ed9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f894013c410 0x7f894011bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:47.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.750+0000 7f893dd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f894009edb0 0x7f894011b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:47.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.750+0000 7f893e59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f894009a130 0x7f894011b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:47.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.750+0000 7f893ed9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f894013c410 0x7f894011bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40738/0 (socket says 172.21.15.156:40738) 2023-09-30T22:20:47.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.750+0000 7f893dd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f894009edb0 0x7f894011b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54506/0 (socket says 172.21.15.156:54506) 2023-09-30T22:20:47.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.750+0000 7f893ed9d700 1 -- 172.21.15.156:0/423959942 learned_addr learned my addr 172.21.15.156:0/423959942 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:47.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.750+0000 7f893e59c700 1 --2- 172.21.15.156:0/423959942 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f894009a130 0x7f894011b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43592/0 (socket says 172.21.15.156:43592) 2023-09-30T22:20:47.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.751+0000 7f893ed9d700 1 -- 172.21.15.156:0/423959942 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f894009a130 msgr2=0x7f894011b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:47.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.751+0000 7f893ed9d700 1 --2- 172.21.15.156:0/423959942 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f894009a130 0x7f894011b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.751+0000 7f893ed9d700 1 -- 172.21.15.156:0/423959942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f894009edb0 msgr2=0x7f894011b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:47.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.751+0000 7f893ed9d700 1 --2- 172.21.15.156:0/423959942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f894009edb0 0x7f894011b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.751+0000 7f893ed9d700 1 -- 172.21.15.156:0/423959942 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89340094a0 con 0x7f894013c410 2023-09-30T22:20:47.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.751+0000 7f893ed9d700 1 --2- 172.21.15.156:0/423959942 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f894013c410 0x7f894011bce0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f893800cbf0 tx=0x7f893800cf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:47.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.751+0000 7f892effd700 1 -- 172.21.15.156:0/423959942 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8938003c00 con 0x7f894013c410 2023-09-30T22:20:47.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.751+0000 7f892effd700 1 -- 172.21.15.156:0/423959942 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8938003d60 con 0x7f894013c410 2023-09-30T22:20:47.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.751+0000 7f892effd700 1 -- 172.21.15.156:0/423959942 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893800aa40 con 0x7f894013c410 2023-09-30T22:20:47.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.751+0000 7f8944a3e700 1 -- 172.21.15.156:0/423959942 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8930009550 con 0x7f894013c410 2023-09-30T22:20:47.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.751+0000 7f8944a3e700 1 -- 172.21.15.156:0/423959942 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f894011d6d0 con 0x7f894013c410 2023-09-30T22:20:47.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.752+0000 7f8944a3e700 1 -- 172.21.15.156:0/423959942 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f894004f2a0 con 0x7f894013c410 2023-09-30T22:20:47.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.758+0000 7f892effd700 1 -- 172.21.15.156:0/423959942 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f893800aba0 con 0x7f894013c410 2023-09-30T22:20:47.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.758+0000 7f892effd700 1 -- 172.21.15.156:0/423959942 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f89380401b0 con 0x7f894013c410 2023-09-30T22:20:47.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.759+0000 7f248193c700 1 Processor -- start 2023-09-30T22:20:47.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.759+0000 7f248193c700 1 -- start start 2023-09-30T22:20:47.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.760+0000 7f248193c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f247c06a770 0x7f247c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:47.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.760+0000 7f248193c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f247c09dec0 0x7f247c06b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:47.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.760+0000 7f248193c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f247c131a00 0x7f247c131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:47.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.760+0000 7f248193c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f247c06b5c0 con 0x7f247c06a770 2023-09-30T22:20:47.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.760+0000 7f248193c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247c06e900 con 0x7f247c131a00 2023-09-30T22:20:47.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.760+0000 7f248193c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f247c09d180 con 0x7f247c09dec0 2023-09-30T22:20:47.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.760+0000 7f247b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f247c131a00 0x7f247c131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:47.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.760+0000 7f247affd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f247c06a770 0x7f247c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:47.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.760+0000 7f247b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f247c131a00 0x7f247c131e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40754/0 (socket says 172.21.15.156:40754) 2023-09-30T22:20:47.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.760+0000 7f247b7fe700 1 -- 172.21.15.156:0/1890203036 learned_addr learned my addr 172.21.15.156:0/1890203036 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:47.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.760+0000 7f247b7fe700 1 -- 172.21.15.156:0/1890203036 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f247c09dec0 msgr2=0x7f247c06b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:47.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.760+0000 7f247b7fe700 1 --2- 172.21.15.156:0/1890203036 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f247c09dec0 0x7f247c06b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.760+0000 7f247b7fe700 1 -- 172.21.15.156:0/1890203036 >> v2:172.21.15.156:3300/0 conn(0x7f247c06a770 msgr2=0x7f247c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:47.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.760+0000 7f247b7fe700 1 --2- 172.21.15.156:0/1890203036 >> v2:172.21.15.156:3300/0 conn(0x7f247c06a770 0x7f247c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.760+0000 7f247b7fe700 1 -- 172.21.15.156:0/1890203036 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247c09e780 con 0x7f247c131a00 2023-09-30T22:20:47.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.760+0000 7f247affd700 1 --2- 172.21.15.156:0/1890203036 >> v2:172.21.15.156:3300/0 conn(0x7f247c06a770 0x7f247c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:47.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.761+0000 7f247b7fe700 1 --2- 172.21.15.156:0/1890203036 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f247c131a00 0x7f247c131e60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2474009e50 tx=0x7f247400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebf9fd0722c17d36 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:47.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.761+0000 7f892effd700 1 -- 172.21.15.156:0/423959942 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8938011790 con 0x7f894013c410 2023-09-30T22:20:47.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.762+0000 7f2479ffb700 1 -- 172.21.15.156:0/1890203036 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247400e070 con 0x7f247c131a00 2023-09-30T22:20:47.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.762+0000 7f2479ffb700 1 -- 172.21.15.156:0/1890203036 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247400b910 con 0x7f247c131a00 2023-09-30T22:20:47.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.762+0000 7f2479ffb700 1 -- 172.21.15.156:0/1890203036 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247400bcc0 con 0x7f247c131a00 2023-09-30T22:20:47.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.762+0000 7f248193c700 1 -- 172.21.15.156:0/1890203036 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f247c131a00 msgr2=0x7f247c131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:47.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.762+0000 7f248193c700 1 --2- 172.21.15.156:0/1890203036 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f247c131a00 0x7f247c131e60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2474009e50 tx=0x7f247400b330 comp rx=0 tx=0).stop 2023-09-30T22:20:47.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.762+0000 7f248193c700 1 -- 172.21.15.156:0/1890203036 shutdown_connections 2023-09-30T22:20:47.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.762+0000 7f248193c700 1 --2- 172.21.15.156:0/1890203036 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f247c131a00 0x7f247c131e60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.762+0000 7f248193c700 1 --2- 172.21.15.156:0/1890203036 >> v2:172.21.15.156:3300/0 conn(0x7f247c06a770 0x7f247c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.762+0000 7f248193c700 1 --2- 172.21.15.156:0/1890203036 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f247c09dec0 0x7f247c06b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.762+0000 7f248193c700 1 -- 172.21.15.156:0/1890203036 >> 172.21.15.156:0/1890203036 conn(0x7f247c099c40 msgr2=0x7f247c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:47.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.763+0000 7f248193c700 1 -- 172.21.15.156:0/1890203036 shutdown_connections 2023-09-30T22:20:47.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.763+0000 7f248193c700 1 -- 172.21.15.156:0/1890203036 wait complete. 2023-09-30T22:20:47.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.763+0000 7f248193c700 1 Processor -- start 2023-09-30T22:20:47.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.764+0000 7f248193c700 1 -- start start 2023-09-30T22:20:47.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.764+0000 7f248193c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f247c06a770 0x7f247c119fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:47.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.764+0000 7f248193c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f247c09dec0 0x7f247c11a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:47.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.764+0000 7f248193c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f247c131a00 0x7f247c11aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:47.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.764+0000 7f248193c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247c11b470 con 0x7f247c09dec0 2023-09-30T22:20:47.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.764+0000 7f248193c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247c11bb40 con 0x7f247c06a770 2023-09-30T22:20:47.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.764+0000 7f248193c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f247c11cd90 con 0x7f247c131a00 2023-09-30T22:20:47.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.764+0000 7f247a7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f247c09dec0 0x7f247c11a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:47.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.764+0000 7f247a7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f247c09dec0 0x7f247c11a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54522/0 (socket says 172.21.15.156:54522) 2023-09-30T22:20:47.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.764+0000 7f247affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f247c06a770 0x7f247c119fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:47.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.764+0000 7f247a7fc700 1 -- 172.21.15.156:0/1067681753 learned_addr learned my addr 172.21.15.156:0/1067681753 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:47.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.764+0000 7f247b7fe700 1 --2- 172.21.15.156:0/1067681753 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f247c131a00 0x7f247c11aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:47.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.765+0000 7f247a7fc700 1 -- 172.21.15.156:0/1067681753 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f247c131a00 msgr2=0x7f247c11aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:47.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.765+0000 7f247a7fc700 1 --2- 172.21.15.156:0/1067681753 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f247c131a00 0x7f247c11aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.765+0000 7f247a7fc700 1 -- 172.21.15.156:0/1067681753 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f247c06a770 msgr2=0x7f247c119fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:47.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.765+0000 7f247a7fc700 1 --2- 172.21.15.156:0/1067681753 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f247c06a770 0x7f247c119fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.765+0000 7f247a7fc700 1 -- 172.21.15.156:0/1067681753 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246c00d940 con 0x7f247c09dec0 2023-09-30T22:20:47.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.765+0000 7f247affd700 1 --2- 172.21.15.156:0/1067681753 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f247c06a770 0x7f247c119fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:47.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.765+0000 7f247a7fc700 1 --2- 172.21.15.156:0/1067681753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f247c09dec0 0x7f247c11a500 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f247000b560 tx=0x7f247000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:47.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.765+0000 7f2463fff700 1 -- 172.21.15.156:0/1067681753 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2470011830 con 0x7f247c09dec0 2023-09-30T22:20:47.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.765+0000 7f2463fff700 1 -- 172.21.15.156:0/1067681753 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2470011990 con 0x7f247c09dec0 2023-09-30T22:20:47.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.765+0000 7f248193c700 1 -- 172.21.15.156:0/1067681753 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2474009b30 con 0x7f247c09dec0 2023-09-30T22:20:47.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.765+0000 7f2463fff700 1 -- 172.21.15.156:0/1067681753 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2470011d40 con 0x7f247c09dec0 2023-09-30T22:20:47.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.765+0000 7f248193c700 1 -- 172.21.15.156:0/1067681753 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f247c130cc0 con 0x7f247c09dec0 2023-09-30T22:20:47.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.766+0000 7f248193c700 1 -- 172.21.15.156:0/1067681753 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f247c09d380 con 0x7f247c09dec0 2023-09-30T22:20:47.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.766+0000 7f2463fff700 1 -- 172.21.15.156:0/1067681753 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f247001a400 con 0x7f247c09dec0 2023-09-30T22:20:47.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.767+0000 7f2463fff700 1 -- 172.21.15.156:0/1067681753 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f247003f740 con 0x7f247c09dec0 2023-09-30T22:20:47.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.771+0000 7f2463fff700 1 -- 172.21.15.156:0/1067681753 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f247000f8d0 con 0x7f247c09dec0 2023-09-30T22:20:47.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.793+0000 7f4dcc1b5700 1 Processor -- start 2023-09-30T22:20:47.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.793+0000 7f4dcc1b5700 1 -- start start 2023-09-30T22:20:47.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.794+0000 7f4dcc1b5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4dc4133ad0 0x7f4dc4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:47.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.794+0000 7f4dcc1b5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4dc41300a0 0x7f4dc41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:47.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.794+0000 7f4dcc1b5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4dc41309f0 0x7f4dc413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:47.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.794+0000 7f4dcc1b5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc406b2d0 con 0x7f4dc41309f0 2023-09-30T22:20:47.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.794+0000 7f4dcc1b5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc4133610 con 0x7f4dc41300a0 2023-09-30T22:20:47.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.794+0000 7f4dcc1b5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc409a500 con 0x7f4dc4133ad0 2023-09-30T22:20:47.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.794+0000 7f4dc9750700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4dc41300a0 0x7f4dc41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:47.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.794+0000 7f4dca752700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4dc41309f0 0x7f4dc413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:47.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.794+0000 7f4dc9750700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4dc41300a0 0x7f4dc41304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40774/0 (socket says 172.21.15.156:40774) 2023-09-30T22:20:47.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.794+0000 7f4dc9750700 1 -- 172.21.15.156:0/2946601064 learned_addr learned my addr 172.21.15.156:0/2946601064 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:47.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.794+0000 7f4dc9f51700 1 --2- 172.21.15.156:0/2946601064 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4dc4133ad0 0x7f4dc4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:47.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.794+0000 7f4dca752700 1 -- 172.21.15.156:0/2946601064 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4dc4133ad0 msgr2=0x7f4dc4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:47.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.794+0000 7f4dca752700 1 --2- 172.21.15.156:0/2946601064 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4dc4133ad0 0x7f4dc4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.794+0000 7f4dca752700 1 -- 172.21.15.156:0/2946601064 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4dc41300a0 msgr2=0x7f4dc41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:47.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.794+0000 7f4dca752700 1 --2- 172.21.15.156:0/2946601064 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4dc41300a0 0x7f4dc41304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.794+0000 7f4dca752700 1 -- 172.21.15.156:0/2946601064 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc41338b0 con 0x7f4dc41309f0 2023-09-30T22:20:47.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.795+0000 7f4dc9750700 1 --2- 172.21.15.156:0/2946601064 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4dc41300a0 0x7f4dc41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:47.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.795+0000 7f4dca752700 1 --2- 172.21.15.156:0/2946601064 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dc41309f0 0x7f4dc413a980 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc009d90 tx=0x7f4dbc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d40a31e0827bb662 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:47.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.795+0000 7f4dc8f4f700 1 -- 172.21.15.156:0/2946601064 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc00e070 con 0x7f4dc41309f0 2023-09-30T22:20:47.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.795+0000 7f4dc8f4f700 1 -- 172.21.15.156:0/2946601064 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dbc00bb20 con 0x7f4dc41309f0 2023-09-30T22:20:47.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.795+0000 7f4dc8f4f700 1 -- 172.21.15.156:0/2946601064 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc012430 con 0x7f4dc41309f0 2023-09-30T22:20:47.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.795+0000 7f4dcc1b5700 1 -- 172.21.15.156:0/2946601064 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dc41309f0 msgr2=0x7f4dc413a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:47.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.795+0000 7f4dcc1b5700 1 --2- 172.21.15.156:0/2946601064 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dc41309f0 0x7f4dc413a980 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc009d90 tx=0x7f4dbc00b330 comp rx=0 tx=0).stop 2023-09-30T22:20:47.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.796+0000 7f4dcc1b5700 1 -- 172.21.15.156:0/2946601064 shutdown_connections 2023-09-30T22:20:47.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.796+0000 7f4dcc1b5700 1 --2- 172.21.15.156:0/2946601064 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dc41309f0 0x7f4dc413a980 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.796+0000 7f4dcc1b5700 1 --2- 172.21.15.156:0/2946601064 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4dc4133ad0 0x7f4dc4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.796+0000 7f4dcc1b5700 1 --2- 172.21.15.156:0/2946601064 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4dc41300a0 0x7f4dc41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.796+0000 7f4dcc1b5700 1 -- 172.21.15.156:0/2946601064 >> 172.21.15.156:0/2946601064 conn(0x7f4dc4099c40 msgr2=0x7f4dc40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:47.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.796+0000 7f4dcc1b5700 1 -- 172.21.15.156:0/2946601064 shutdown_connections 2023-09-30T22:20:47.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.796+0000 7f4dcc1b5700 1 -- 172.21.15.156:0/2946601064 wait complete. 2023-09-30T22:20:47.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.797+0000 7f4dcc1b5700 1 Processor -- start 2023-09-30T22:20:47.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.797+0000 7f4dcc1b5700 1 -- start start 2023-09-30T22:20:47.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.797+0000 7f4dcc1b5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4dc41300a0 0x7f4dc411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:47.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.797+0000 7f4dcc1b5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dc41309f0 0x7f4dc411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:47.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.797+0000 7f4dcc1b5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4dc4133ad0 0x7f4dc411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:47.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.797+0000 7f4dcc1b5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc412fbd0 con 0x7f4dc41309f0 2023-09-30T22:20:47.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.797+0000 7f4dcc1b5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc412dd00 con 0x7f4dc41300a0 2023-09-30T22:20:47.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.797+0000 7f4dcc1b5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc411fbf0 con 0x7f4dc4133ad0 2023-09-30T22:20:47.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.797+0000 7f4dc9f51700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4dc41300a0 0x7f4dc411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:47.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.797+0000 7f4dc9f51700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4dc41300a0 0x7f4dc411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40786/0 (socket says 172.21.15.156:40786) 2023-09-30T22:20:47.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.797+0000 7f4dc9f51700 1 -- 172.21.15.156:0/1691990566 learned_addr learned my addr 172.21.15.156:0/1691990566 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:47.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.797+0000 7f4dca752700 1 --2- 172.21.15.156:0/1691990566 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4dc4133ad0 0x7f4dc411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:47.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.798+0000 7f4dc9750700 1 --2- 172.21.15.156:0/1691990566 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dc41309f0 0x7f4dc411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:47.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.798+0000 7f4dc9f51700 1 -- 172.21.15.156:0/1691990566 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4dc4133ad0 msgr2=0x7f4dc411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:47.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.798+0000 7f4dc9f51700 1 --2- 172.21.15.156:0/1691990566 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4dc4133ad0 0x7f4dc411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.798+0000 7f4dc9f51700 1 -- 172.21.15.156:0/1691990566 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dc41309f0 msgr2=0x7f4dc411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:47.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.798+0000 7f4dc9f51700 1 --2- 172.21.15.156:0/1691990566 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dc41309f0 0x7f4dc411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.798+0000 7f4dc9f51700 1 -- 172.21.15.156:0/1691990566 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db4009550 con 0x7f4dc41300a0 2023-09-30T22:20:47.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.798+0000 7f4dc9750700 1 --2- 172.21.15.156:0/1691990566 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dc41309f0 0x7f4dc411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:20:47.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.798+0000 7f4dc9f51700 1 --2- 172.21.15.156:0/1691990566 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4dc41300a0 0x7f4dc411da40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000e9b0 tx=0x7f4dc000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:47.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.798+0000 7f4dba7fc700 1 -- 172.21.15.156:0/1691990566 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0009710 con 0x7f4dc41300a0 2023-09-30T22:20:47.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.798+0000 7f4dba7fc700 1 -- 172.21.15.156:0/1691990566 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc000c850 con 0x7f4dc41300a0 2023-09-30T22:20:47.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.798+0000 7f4dcc1b5700 1 -- 172.21.15.156:0/1691990566 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dbc009a70 con 0x7f4dc41300a0 2023-09-30T22:20:47.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.798+0000 7f4dba7fc700 1 -- 172.21.15.156:0/1691990566 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc000cbc0 con 0x7f4dc41300a0 2023-09-30T22:20:47.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.798+0000 7f4dcc1b5700 1 -- 172.21.15.156:0/1691990566 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc411feb0 con 0x7f4dc41300a0 2023-09-30T22:20:47.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.799+0000 7f4dba7fc700 1 -- 172.21.15.156:0/1691990566 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4dc000cd20 con 0x7f4dc41300a0 2023-09-30T22:20:47.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.799+0000 7f4dcc1b5700 1 -- 172.21.15.156:0/1691990566 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc404f2a0 con 0x7f4dc41300a0 2023-09-30T22:20:47.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.799+0000 7f4dba7fc700 1 -- 172.21.15.156:0/1691990566 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4dc003f740 con 0x7f4dc41300a0 2023-09-30T22:20:47.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.808+0000 7f4dba7fc700 1 -- 172.21.15.156:0/1691990566 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4dc001be10 con 0x7f4dc41300a0 2023-09-30T22:20:47.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.946+0000 7f43c7890700 1 -- 172.21.15.156:0/2850163941 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f43c006b2a0 con 0x7f43c009f180 2023-09-30T22:20:47.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.947+0000 7f43b5ffb700 1 -- 172.21.15.156:0/2850163941 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f43b0017030 con 0x7f43c009f180 2023-09-30T22:20:47.956 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:47.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.949+0000 7f43c7890700 1 -- 172.21.15.156:0/2850163941 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43c009f180 msgr2=0x7f43c011e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:47.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.949+0000 7f43c7890700 1 --2- 172.21.15.156:0/2850163941 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43c009f180 0x7f43c011e470 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f43b000c510 tx=0x7f43b000c820 comp rx=0 tx=0).stop 2023-09-30T22:20:47.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.949+0000 7f43c7890700 1 -- 172.21.15.156:0/2850163941 shutdown_connections 2023-09-30T22:20:47.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.949+0000 7f43c7890700 1 --2- 172.21.15.156:0/2850163941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43c0131f40 0x7f43c011e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.949+0000 7f43c7890700 1 --2- 172.21.15.156:0/2850163941 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f43c009e870 0x7f43c011df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.949+0000 7f43c7890700 1 --2- 172.21.15.156:0/2850163941 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43c009f180 0x7f43c011e470 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.949+0000 7f43c7890700 1 -- 172.21.15.156:0/2850163941 >> 172.21.15.156:0/2850163941 conn(0x7f43c00a4430 msgr2=0x7f43c006d220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:47.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.949+0000 7f43c7890700 1 -- 172.21.15.156:0/2850163941 shutdown_connections 2023-09-30T22:20:47.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.949+0000 7f43c7890700 1 -- 172.21.15.156:0/2850163941 wait complete. 2023-09-30T22:20:47.962 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:47.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.968+0000 7f8944a3e700 1 -- 172.21.15.156:0/423959942 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f894006be20 con 0x7f894013c410 2023-09-30T22:20:47.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.969+0000 7f892effd700 1 -- 172.21.15.156:0/423959942 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f89380243e0 con 0x7f894013c410 2023-09-30T22:20:47.969 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:47.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.970+0000 7f248193c700 1 -- 172.21.15.156:0/1067681753 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f247c071ce0 con 0x7f247c09dec0 2023-09-30T22:20:47.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.970+0000 7f2463fff700 1 -- 172.21.15.156:0/1067681753 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2470015030 con 0x7f247c09dec0 2023-09-30T22:20:47.972 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:47.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.971+0000 7f8944a3e700 1 -- 172.21.15.156:0/423959942 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f894013c410 msgr2=0x7f894011bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:47.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.971+0000 7f8944a3e700 1 --2- 172.21.15.156:0/423959942 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f894013c410 0x7f894011bce0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f893800cbf0 tx=0x7f893800cf00 comp rx=0 tx=0).stop 2023-09-30T22:20:47.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.971+0000 7f8944a3e700 1 -- 172.21.15.156:0/423959942 shutdown_connections 2023-09-30T22:20:47.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.971+0000 7f8944a3e700 1 --2- 172.21.15.156:0/423959942 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f894013c410 0x7f894011bce0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.971+0000 7f8944a3e700 1 --2- 172.21.15.156:0/423959942 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f894009a130 0x7f894011b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.971+0000 7f8944a3e700 1 --2- 172.21.15.156:0/423959942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f894009edb0 0x7f894011b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.971+0000 7f8944a3e700 1 -- 172.21.15.156:0/423959942 >> 172.21.15.156:0/423959942 conn(0x7f89400a4430 msgr2=0x7f894013e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:47.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.971+0000 7f8944a3e700 1 -- 172.21.15.156:0/423959942 shutdown_connections 2023-09-30T22:20:47.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.971+0000 7f8944a3e700 1 -- 172.21.15.156:0/423959942 wait complete. 2023-09-30T22:20:47.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.973+0000 7f248193c700 1 -- 172.21.15.156:0/1067681753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f247c09dec0 msgr2=0x7f247c11a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:47.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.973+0000 7f248193c700 1 --2- 172.21.15.156:0/1067681753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f247c09dec0 0x7f247c11a500 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f247000b560 tx=0x7f247000b870 comp rx=0 tx=0).stop 2023-09-30T22:20:47.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.973+0000 7f248193c700 1 -- 172.21.15.156:0/1067681753 shutdown_connections 2023-09-30T22:20:47.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.973+0000 7f248193c700 1 --2- 172.21.15.156:0/1067681753 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f247c131a00 0x7f247c11aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.973+0000 7f248193c700 1 --2- 172.21.15.156:0/1067681753 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f247c06a770 0x7f247c119fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.973+0000 7f248193c700 1 --2- 172.21.15.156:0/1067681753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f247c09dec0 0x7f247c11a500 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:47.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.973+0000 7f248193c700 1 -- 172.21.15.156:0/1067681753 >> 172.21.15.156:0/1067681753 conn(0x7f247c099c40 msgr2=0x7f247c12ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:47.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.974+0000 7f248193c700 1 -- 172.21.15.156:0/1067681753 shutdown_connections 2023-09-30T22:20:47.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:47.974+0000 7f248193c700 1 -- 172.21.15.156:0/1067681753 wait complete. 2023-09-30T22:20:47.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:47.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:48.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:48.008+0000 7f4dcc1b5700 1 -- 172.21.15.156:0/1691990566 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4dc40727b0 con 0x7f4dc41300a0 2023-09-30T22:20:48.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:48.008+0000 7f4dba7fc700 1 -- 172.21.15.156:0/1691990566 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4dc0017020 con 0x7f4dc41300a0 2023-09-30T22:20:48.009 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:48.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:48.010+0000 7f4dcc1b5700 1 -- 172.21.15.156:0/1691990566 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4dc41300a0 msgr2=0x7f4dc411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:48.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:48.010+0000 7f4dcc1b5700 1 --2- 172.21.15.156:0/1691990566 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4dc41300a0 0x7f4dc411da40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000e9b0 tx=0x7f4dc000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:20:48.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:48.010+0000 7f4dcc1b5700 1 -- 172.21.15.156:0/1691990566 shutdown_connections 2023-09-30T22:20:48.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:48.010+0000 7f4dcc1b5700 1 --2- 172.21.15.156:0/1691990566 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4dc4133ad0 0x7f4dc411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:48.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:48.010+0000 7f4dcc1b5700 1 --2- 172.21.15.156:0/1691990566 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4dc41300a0 0x7f4dc411da40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:48.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:48.010+0000 7f4dcc1b5700 1 --2- 172.21.15.156:0/1691990566 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dc41309f0 0x7f4dc411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:48.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:48.010+0000 7f4dcc1b5700 1 -- 172.21.15.156:0/1691990566 >> 172.21.15.156:0/1691990566 conn(0x7f4dc4099c40 msgr2=0x7f4dc412e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:48.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:48.010+0000 7f4dcc1b5700 1 -- 172.21.15.156:0/1691990566 shutdown_connections 2023-09-30T22:20:48.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:48.010+0000 7f4dcc1b5700 1 -- 172.21.15.156:0/1691990566 wait complete. 2023-09-30T22:20:48.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:48.964 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:48.986 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:48.989 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:49.024 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:49.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.114+0000 7f8c35419700 1 Processor -- start 2023-09-30T22:20:49.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.114+0000 7f8c35419700 1 -- start start 2023-09-30T22:20:49.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.115+0000 7f8c35419700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c30133ad0 0x7f8c30133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:49.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.115+0000 7f8c35419700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8c30130bc0 0x7f8c3013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:49.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.115+0000 7f8c35419700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3006b2d0 con 0x7f8c301300a0 2023-09-30T22:20:49.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.115+0000 7f8c35419700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c30133610 con 0x7f8c30130bc0 2023-09-30T22:20:49.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.115+0000 7f8c35419700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3009a500 con 0x7f8c30133ad0 2023-09-30T22:20:49.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.115+0000 7f8c2effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c30133ad0 0x7f8c30133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:49.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.115+0000 7f8c2effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c30133ad0 0x7f8c30133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43636/0 (socket says 172.21.15.156:43636) 2023-09-30T22:20:49.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.115+0000 7f8c2effd700 1 -- 172.21.15.156:0/3347080075 learned_addr learned my addr 172.21.15.156:0/3347080075 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:49.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.115+0000 7f8c2f7fe700 1 --2- 172.21.15.156:0/3347080075 >> v2:172.21.15.156:3300/0 conn(0x7f8c30130bc0 0x7f8c3013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:49.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.116+0000 7f8c2e7fc700 1 -- 172.21.15.156:0/3347080075 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2284874302 0 0) 0x7f8c3006b2d0 con 0x7f8c301300a0 2023-09-30T22:20:49.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.116+0000 7f8c2effd700 1 -- 172.21.15.156:0/3347080075 >> v2:172.21.15.156:3300/0 conn(0x7f8c30130bc0 msgr2=0x7f8c3013b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:49.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.116+0000 7f8c2effd700 1 --2- 172.21.15.156:0/3347080075 >> v2:172.21.15.156:3300/0 conn(0x7f8c30130bc0 0x7f8c3013b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.116+0000 7f8c2effd700 1 -- 172.21.15.156:0/3347080075 >> v1:172.21.15.156:6789/0 conn(0x7f8c301300a0 legacy=0x7f8c301304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:49.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.116+0000 7f8c2effd700 1 -- 172.21.15.156:0/3347080075 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c301338b0 con 0x7f8c30133ad0 2023-09-30T22:20:49.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.116+0000 7f8c2f7fe700 1 --2- 172.21.15.156:0/3347080075 >> v2:172.21.15.156:3300/0 conn(0x7f8c30130bc0 0x7f8c3013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:49.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.116+0000 7f8c2effd700 1 --2- 172.21.15.156:0/3347080075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c30133ad0 0x7f8c30133ea0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8c200098f0 tx=0x7f8c20009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=273d382bab712a9f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:49.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.116+0000 7f8c2e7fc700 1 -- 172.21.15.156:0/3347080075 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c20011830 con 0x7f8c30133ad0 2023-09-30T22:20:49.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.116+0000 7f8c2e7fc700 1 -- 172.21.15.156:0/3347080075 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c20011990 con 0x7f8c30133ad0 2023-09-30T22:20:49.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.116+0000 7f8c2e7fc700 1 -- 172.21.15.156:0/3347080075 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c20011d20 con 0x7f8c30133ad0 2023-09-30T22:20:49.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.117+0000 7f8c35419700 1 -- 172.21.15.156:0/3347080075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c30133ad0 msgr2=0x7f8c30133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:49.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.117+0000 7f8c35419700 1 --2- 172.21.15.156:0/3347080075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c30133ad0 0x7f8c30133ea0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8c200098f0 tx=0x7f8c20009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:49.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.117+0000 7f8c35419700 1 -- 172.21.15.156:0/3347080075 shutdown_connections 2023-09-30T22:20:49.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.117+0000 7f8c35419700 1 --2- 172.21.15.156:0/3347080075 >> v2:172.21.15.156:3300/0 conn(0x7f8c30130bc0 0x7f8c3013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.117+0000 7f8c35419700 1 --2- 172.21.15.156:0/3347080075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c30133ad0 0x7f8c30133ea0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.117+0000 7f8c35419700 1 -- 172.21.15.156:0/3347080075 >> 172.21.15.156:0/3347080075 conn(0x7f8c30099c40 msgr2=0x7f8c300a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:49.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.117+0000 7f8c35419700 1 -- 172.21.15.156:0/3347080075 shutdown_connections 2023-09-30T22:20:49.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.117+0000 7f8c35419700 1 -- 172.21.15.156:0/3347080075 wait complete. 2023-09-30T22:20:49.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.118+0000 7f8c35419700 1 Processor -- start 2023-09-30T22:20:49.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.119+0000 7f8c35419700 1 -- start start 2023-09-30T22:20:49.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.119+0000 7f8c35419700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c301300a0 0x7f8c3011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:49.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.119+0000 7f8c35419700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c30130bc0 0x7f8c3011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:49.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.119+0000 7f8c35419700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c30133ad0 0x7f8c3011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:49.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.119+0000 7f8c35419700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3012dd00 con 0x7f8c30130bc0 2023-09-30T22:20:49.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.119+0000 7f8c35419700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c30120a30 con 0x7f8c301300a0 2023-09-30T22:20:49.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.119+0000 7f8c35419700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c300720e0 con 0x7f8c30133ad0 2023-09-30T22:20:49.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.120+0000 7f8c2effd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c301300a0 0x7f8c3011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:49.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.120+0000 7f8c2effd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c301300a0 0x7f8c3011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40790/0 (socket says 172.21.15.156:40790) 2023-09-30T22:20:49.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.120+0000 7f8c2effd700 1 -- 172.21.15.156:0/2563480714 learned_addr learned my addr 172.21.15.156:0/2563480714 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:49.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.120+0000 7f8c267fc700 1 --2- 172.21.15.156:0/2563480714 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c30130bc0 0x7f8c3011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:49.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.120+0000 7f8c2f7fe700 1 --2- 172.21.15.156:0/2563480714 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c30133ad0 0x7f8c3011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:49.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.120+0000 7f8c2effd700 1 -- 172.21.15.156:0/2563480714 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c30133ad0 msgr2=0x7f8c3011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:49.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.120+0000 7f8c2effd700 1 --2- 172.21.15.156:0/2563480714 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c30133ad0 0x7f8c3011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.120+0000 7f8c2effd700 1 -- 172.21.15.156:0/2563480714 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c30130bc0 msgr2=0x7f8c3011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:49.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.120+0000 7f8c2effd700 1 --2- 172.21.15.156:0/2563480714 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c30130bc0 0x7f8c3011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.120+0000 7f8c2effd700 1 -- 172.21.15.156:0/2563480714 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c28009a70 con 0x7f8c301300a0 2023-09-30T22:20:49.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.120+0000 7f8c2effd700 1 --2- 172.21.15.156:0/2563480714 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c301300a0 0x7f8c3011da40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8c20009c40 tx=0x7f8c20004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:49.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.120+0000 7f8c27fff700 1 -- 172.21.15.156:0/2563480714 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c200045d0 con 0x7f8c301300a0 2023-09-30T22:20:49.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.120+0000 7f8c35419700 1 -- 172.21.15.156:0/2563480714 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c20009550 con 0x7f8c301300a0 2023-09-30T22:20:49.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.121+0000 7f8c27fff700 1 -- 172.21.15.156:0/2563480714 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c200036a0 con 0x7f8c301300a0 2023-09-30T22:20:49.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.121+0000 7f8c27fff700 1 -- 172.21.15.156:0/2563480714 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c20003a30 con 0x7f8c301300a0 2023-09-30T22:20:49.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.121+0000 7f8c35419700 1 -- 172.21.15.156:0/2563480714 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3011eeb0 con 0x7f8c301300a0 2023-09-30T22:20:49.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.121+0000 7f8c27fff700 1 -- 172.21.15.156:0/2563480714 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c20021070 con 0x7f8c301300a0 2023-09-30T22:20:49.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.122+0000 7f8c257fa700 1 -- 172.21.15.156:0/2563480714 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c080052e0 con 0x7f8c301300a0 2023-09-30T22:20:49.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.122+0000 7f8c27fff700 1 -- 172.21.15.156:0/2563480714 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8c20040cb0 con 0x7f8c301300a0 2023-09-30T22:20:49.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.130+0000 7f8c27fff700 1 -- 172.21.15.156:0/2563480714 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c20019770 con 0x7f8c301300a0 2023-09-30T22:20:49.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.148+0000 7f3917f9f700 1 Processor -- start 2023-09-30T22:20:49.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.148+0000 7f3917f9f700 1 -- start start 2023-09-30T22:20:49.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.149+0000 7f3917f9f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f391009d860 0x7f391009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:49.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.149+0000 7f3917f9f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f391009e170 0x7f39101307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:49.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.149+0000 7f3917f9f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f391009aaa0 con 0x7f3910130ce0 2023-09-30T22:20:49.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.149+0000 7f3917f9f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391009f870 con 0x7f391009d860 2023-09-30T22:20:49.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.149+0000 7f3917f9f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f391009b360 con 0x7f391009e170 2023-09-30T22:20:49.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.149+0000 7f3915d3b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f391009d860 0x7f391009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:49.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.149+0000 7f3915d3b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f391009d860 0x7f391009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40794/0 (socket says 172.21.15.156:40794) 2023-09-30T22:20:49.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.149+0000 7f3915d3b700 1 -- 172.21.15.156:0/1318108918 learned_addr learned my addr 172.21.15.156:0/1318108918 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:49.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.149+0000 7f391553a700 1 --2- 172.21.15.156:0/1318108918 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f391009e170 0x7f39101307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:49.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.149+0000 7f3914d39700 1 -- 172.21.15.156:0/1318108918 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 905857771 0 0) 0x7f391009aaa0 con 0x7f3910130ce0 2023-09-30T22:20:49.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.149+0000 7f3914d39700 1 -- 172.21.15.156:0/1318108918 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38fc0035b0 con 0x7f3910130ce0 2023-09-30T22:20:49.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.149+0000 7f3915d3b700 1 -- 172.21.15.156:0/1318108918 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f391009e170 msgr2=0x7f39101307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:49.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.149+0000 7f3915d3b700 1 --2- 172.21.15.156:0/1318108918 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f391009e170 0x7f39101307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.149+0000 7f3915d3b700 1 -- 172.21.15.156:0/1318108918 >> v1:172.21.15.156:6789/0 conn(0x7f3910130ce0 legacy=0x7f39101379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:49.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.149+0000 7f3915d3b700 1 -- 172.21.15.156:0/1318108918 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391009b620 con 0x7f391009d860 2023-09-30T22:20:49.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.150+0000 7f53944c3700 1 Processor -- start 2023-09-30T22:20:49.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.150+0000 7f3915d3b700 1 --2- 172.21.15.156:0/1318108918 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f391009d860 0x7f391009dc30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f390c009920 tx=0x7f390c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d520a007cd55c56b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:49.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.150+0000 7f3914d39700 1 -- 172.21.15.156:0/1318108918 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c011830 con 0x7f391009d860 2023-09-30T22:20:49.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.150+0000 7f3914d39700 1 -- 172.21.15.156:0/1318108918 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390c011990 con 0x7f391009d860 2023-09-30T22:20:49.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.150+0000 7f3914d39700 1 -- 172.21.15.156:0/1318108918 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c011d20 con 0x7f391009d860 2023-09-30T22:20:49.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.150+0000 7f53944c3700 1 -- start start 2023-09-30T22:20:49.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.150+0000 7f53944c3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f538c06a770 0x7f538c1349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:49.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.150+0000 7f53944c3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f538c134f00 0x7f538c09d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:49.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.150+0000 7f53944c3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f538c09dea0 0x7f538c09e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:49.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.150+0000 7f53944c3700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f538c06b2e0 con 0x7f538c134f00 2023-09-30T22:20:49.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.150+0000 7f53944c3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538c09eca0 con 0x7f538c09dea0 2023-09-30T22:20:49.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.150+0000 7f53944c3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f538c09f720 con 0x7f538c06a770 2023-09-30T22:20:49.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.150+0000 7f5392a60700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f538c09dea0 0x7f538c09e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:49.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.151+0000 7f5391a5e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f538c134f00 0x7f538c09d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:49.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.151+0000 7f5391a5e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f538c134f00 0x7f538c09d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54556/0 (socket says 172.21.15.156:54556) 2023-09-30T22:20:49.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.151+0000 7f5392a60700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f538c09dea0 0x7f538c09e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40804/0 (socket says 172.21.15.156:40804) 2023-09-30T22:20:49.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.151+0000 7f5391a5e700 1 -- 172.21.15.156:0/1063024913 learned_addr learned my addr 172.21.15.156:0/1063024913 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:49.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.151+0000 7f539225f700 1 --2- 172.21.15.156:0/1063024913 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f538c06a770 0x7f538c1349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:49.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.151+0000 7f5391a5e700 1 -- 172.21.15.156:0/1063024913 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f538c06a770 msgr2=0x7f538c1349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:49.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.151+0000 7f5391a5e700 1 --2- 172.21.15.156:0/1063024913 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f538c06a770 0x7f538c1349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.151+0000 7f5391a5e700 1 -- 172.21.15.156:0/1063024913 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f538c09dea0 msgr2=0x7f538c09e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:49.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.151+0000 7f3917f9f700 1 -- 172.21.15.156:0/1318108918 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f391009d860 msgr2=0x7f391009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:49.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.151+0000 7f3917f9f700 1 --2- 172.21.15.156:0/1318108918 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f391009d860 0x7f391009dc30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f390c009920 tx=0x7f390c009c30 comp rx=0 tx=0).stop 2023-09-30T22:20:49.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.151+0000 7f5391a5e700 1 --2- 172.21.15.156:0/1063024913 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f538c09dea0 0x7f538c09e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.151+0000 7f5391a5e700 1 -- 172.21.15.156:0/1063024913 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538c06b480 con 0x7f538c134f00 2023-09-30T22:20:49.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.151+0000 7f539225f700 1 --2- 172.21.15.156:0/1063024913 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f538c06a770 0x7f538c1349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:20:49.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.151+0000 7f5392a60700 1 --2- 172.21.15.156:0/1063024913 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f538c09dea0 0x7f538c09e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:49.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.151+0000 7f3917f9f700 1 -- 172.21.15.156:0/1318108918 shutdown_connections 2023-09-30T22:20:49.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.151+0000 7f3917f9f700 1 --2- 172.21.15.156:0/1318108918 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f391009d860 0x7f391009dc30 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.151+0000 7f3917f9f700 1 --2- 172.21.15.156:0/1318108918 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f391009e170 0x7f39101307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.151+0000 7f3917f9f700 1 -- 172.21.15.156:0/1318108918 >> 172.21.15.156:0/1318108918 conn(0x7f3910099c40 msgr2=0x7f39100a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:49.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.151+0000 7f5391a5e700 1 --2- 172.21.15.156:0/1063024913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f538c134f00 0x7f538c09d960 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f53880098f0 tx=0x7f5388009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d30645ad35844f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:49.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.151+0000 7f3917f9f700 1 -- 172.21.15.156:0/1318108918 shutdown_connections 2023-09-30T22:20:49.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.151+0000 7f3917f9f700 1 -- 172.21.15.156:0/1318108918 wait complete. 2023-09-30T22:20:49.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.151+0000 7f539125d700 1 -- 172.21.15.156:0/1063024913 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5388011830 con 0x7f538c134f00 2023-09-30T22:20:49.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.151+0000 7f539125d700 1 -- 172.21.15.156:0/1063024913 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5388011990 con 0x7f538c134f00 2023-09-30T22:20:49.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.151+0000 7f539125d700 1 -- 172.21.15.156:0/1063024913 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5388011d20 con 0x7f538c134f00 2023-09-30T22:20:49.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.152+0000 7f53944c3700 1 -- 172.21.15.156:0/1063024913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f538c134f00 msgr2=0x7f538c09d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:49.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.152+0000 7f53944c3700 1 --2- 172.21.15.156:0/1063024913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f538c134f00 0x7f538c09d960 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f53880098f0 tx=0x7f5388009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:49.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.152+0000 7f53944c3700 1 -- 172.21.15.156:0/1063024913 shutdown_connections 2023-09-30T22:20:49.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.152+0000 7f53944c3700 1 --2- 172.21.15.156:0/1063024913 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f538c09dea0 0x7f538c09e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.152+0000 7f53944c3700 1 --2- 172.21.15.156:0/1063024913 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f538c06a770 0x7f538c1349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.152+0000 7f53944c3700 1 --2- 172.21.15.156:0/1063024913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f538c134f00 0x7f538c09d960 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.152+0000 7f53944c3700 1 -- 172.21.15.156:0/1063024913 >> 172.21.15.156:0/1063024913 conn(0x7f538c099c40 msgr2=0x7f538c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:49.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.152+0000 7f53944c3700 1 -- 172.21.15.156:0/1063024913 shutdown_connections 2023-09-30T22:20:49.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.152+0000 7f3917f9f700 1 Processor -- start 2023-09-30T22:20:49.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.153+0000 7f3917f9f700 1 -- start start 2023-09-30T22:20:49.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.153+0000 7f3917f9f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f391009d860 0x7f391012dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:49.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.153+0000 7f3917f9f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f391009e170 0x7f391012e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:49.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.153+0000 7f3917f9f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3910130ce0 0x7f391012e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:49.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.153+0000 7f3917f9f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39100a07c0 con 0x7f3910130ce0 2023-09-30T22:20:49.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.153+0000 7f3917f9f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3910131a80 con 0x7f391009d860 2023-09-30T22:20:49.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.153+0000 7f3917f9f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3910131130 con 0x7f391009e170 2023-09-30T22:20:49.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.153+0000 7f53944c3700 1 -- 172.21.15.156:0/1063024913 wait complete. 2023-09-30T22:20:49.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.153+0000 7f391653c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3910130ce0 0x7f391012e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:49.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.153+0000 7f391653c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3910130ce0 0x7f391012e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54572/0 (socket says 172.21.15.156:54572) 2023-09-30T22:20:49.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.153+0000 7f391653c700 1 -- 172.21.15.156:0/873425987 learned_addr learned my addr 172.21.15.156:0/873425987 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:49.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.153+0000 7f391653c700 1 -- 172.21.15.156:0/873425987 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f391009e170 msgr2=0x7f391012e000 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:20:49.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.153+0000 7f391653c700 1 --2- 172.21.15.156:0/873425987 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f391009e170 0x7f391012e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.153+0000 7f391653c700 1 -- 172.21.15.156:0/873425987 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f391009d860 msgr2=0x7f391012dac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:20:49.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.153+0000 7f391653c700 1 --2- 172.21.15.156:0/873425987 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f391009d860 0x7f391012dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.153+0000 7f391653c700 1 -- 172.21.15.156:0/873425987 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c009550 con 0x7f3910130ce0 2023-09-30T22:20:49.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.154+0000 7f391653c700 1 --2- 172.21.15.156:0/873425987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3910130ce0 0x7f391012e540 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f390800cc50 tx=0x7f390800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:49.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.154+0000 7f39067fc700 1 -- 172.21.15.156:0/873425987 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390800ada0 con 0x7f3910130ce0 2023-09-30T22:20:49.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.154+0000 7f3917f9f700 1 -- 172.21.15.156:0/873425987 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39101313d0 con 0x7f3910130ce0 2023-09-30T22:20:49.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.154+0000 7f39067fc700 1 -- 172.21.15.156:0/873425987 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390800ce50 con 0x7f3910130ce0 2023-09-30T22:20:49.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.154+0000 7f39067fc700 1 -- 172.21.15.156:0/873425987 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3908003c20 con 0x7f3910130ce0 2023-09-30T22:20:49.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.154+0000 7f53944c3700 1 Processor -- start 2023-09-30T22:20:49.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.154+0000 7f3917f9f700 1 -- 172.21.15.156:0/873425987 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3910130000 con 0x7f3910130ce0 2023-09-30T22:20:49.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.154+0000 7f53944c3700 1 -- start start 2023-09-30T22:20:49.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.155+0000 7f53944c3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f538c06a770 0x7f538c135850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:49.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.155+0000 7f53944c3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f538c09dea0 0x7f538c135d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:49.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.155+0000 7f53944c3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f538c134f00 0x7f538c1362d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:49.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.155+0000 7f53944c3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c137e60 con 0x7f538c134f00 2023-09-30T22:20:49.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.155+0000 7f53944c3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538c13e680 con 0x7f538c09dea0 2023-09-30T22:20:49.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.155+0000 7f53944c3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f538c137540 con 0x7f538c06a770 2023-09-30T22:20:49.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.155+0000 7f5391a5e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f538c09dea0 0x7f538c135d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:49.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.155+0000 7f5391a5e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f538c09dea0 0x7f538c135d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40814/0 (socket says 172.21.15.156:40814) 2023-09-30T22:20:49.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.155+0000 7f5391a5e700 1 -- 172.21.15.156:0/2385179075 learned_addr learned my addr 172.21.15.156:0/2385179075 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:49.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.155+0000 7f39067fc700 1 -- 172.21.15.156:0/873425987 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f39080050d0 con 0x7f3910130ce0 2023-09-30T22:20:49.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.155+0000 7f539225f700 1 --2- 172.21.15.156:0/2385179075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f538c06a770 0x7f538c135850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:49.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.155+0000 7f39067fc700 1 -- 172.21.15.156:0/873425987 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f390803f930 con 0x7f3910130ce0 2023-09-30T22:20:49.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.155+0000 7f5391a5e700 1 -- 172.21.15.156:0/2385179075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f538c06a770 msgr2=0x7f538c135850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:49.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.155+0000 7f5391a5e700 1 --2- 172.21.15.156:0/2385179075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f538c06a770 0x7f538c135850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.155+0000 7f5391a5e700 1 -- 172.21.15.156:0/2385179075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f538c134f00 msgr2=0x7f538c1362d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:49.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.155+0000 7f5391a5e700 1 --2- 172.21.15.156:0/2385179075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f538c134f00 0x7f538c1362d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.155+0000 7f5391a5e700 1 -- 172.21.15.156:0/2385179075 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5384009a70 con 0x7f538c09dea0 2023-09-30T22:20:49.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.155+0000 7f539225f700 1 --2- 172.21.15.156:0/2385179075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f538c06a770 0x7f538c135850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:49.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.155+0000 7f3917f9f700 1 -- 172.21.15.156:0/873425987 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f391004f2a0 con 0x7f3910130ce0 2023-09-30T22:20:49.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.156+0000 7f5391a5e700 1 --2- 172.21.15.156:0/2385179075 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f538c09dea0 0x7f538c135d90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5388013000 tx=0x7f5388004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:49.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.160+0000 7f5382ffd700 1 -- 172.21.15.156:0/2385179075 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5388004510 con 0x7f538c09dea0 2023-09-30T22:20:49.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.160+0000 7f5382ffd700 1 -- 172.21.15.156:0/2385179075 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53880036a0 con 0x7f538c09dea0 2023-09-30T22:20:49.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.160+0000 7f5382ffd700 1 -- 172.21.15.156:0/2385179075 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5388003a50 con 0x7f538c09dea0 2023-09-30T22:20:49.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.160+0000 7f53944c3700 1 -- 172.21.15.156:0/2385179075 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5388009550 con 0x7f538c09dea0 2023-09-30T22:20:49.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.160+0000 7f53944c3700 1 -- 172.21.15.156:0/2385179075 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f538c0a0440 con 0x7f538c09dea0 2023-09-30T22:20:49.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.161+0000 7f53944c3700 1 -- 172.21.15.156:0/2385179075 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f538c09f280 con 0x7f538c09dea0 2023-09-30T22:20:49.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.161+0000 7f5382ffd700 1 -- 172.21.15.156:0/2385179075 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5388003bb0 con 0x7f538c09dea0 2023-09-30T22:20:49.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.161+0000 7f5382ffd700 1 -- 172.21.15.156:0/2385179075 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5388041150 con 0x7f538c09dea0 2023-09-30T22:20:49.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.164+0000 7f39067fc700 1 -- 172.21.15.156:0/873425987 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f39080106a0 con 0x7f3910130ce0 2023-09-30T22:20:49.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.170+0000 7f5382ffd700 1 -- 172.21.15.156:0/2385179075 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5388010380 con 0x7f538c09dea0 2023-09-30T22:20:49.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.191+0000 7f7001885700 1 Processor -- start 2023-09-30T22:20:49.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.191+0000 7f7001885700 1 -- start start 2023-09-30T22:20:49.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.191+0000 7f7001885700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ffc133ad0 0x7f6ffc133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:49.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.191+0000 7f7001885700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6ffc1300a0 0x7f6ffc1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:49.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.191+0000 7f7001885700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ffc1309f0 0x7f6ffc13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:49.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.191+0000 7f7001885700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ffc06b2d0 con 0x7f6ffc1300a0 2023-09-30T22:20:49.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.191+0000 7f7001885700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc133610 con 0x7f6ffc1309f0 2023-09-30T22:20:49.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.191+0000 7f7001885700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc09a500 con 0x7f6ffc133ad0 2023-09-30T22:20:49.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.192+0000 7f6ffaffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ffc133ad0 0x7f6ffc133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:49.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.192+0000 7f6ffb7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ffc1309f0 0x7f6ffc13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:49.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.192+0000 7f6ffaffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ffc133ad0 0x7f6ffc133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43668/0 (socket says 172.21.15.156:43668) 2023-09-30T22:20:49.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.192+0000 7f6ffaffd700 1 -- 172.21.15.156:0/359289071 learned_addr learned my addr 172.21.15.156:0/359289071 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:49.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.192+0000 7f6ffaffd700 1 -- 172.21.15.156:0/359289071 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ffc1309f0 msgr2=0x7f6ffc13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:49.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.192+0000 7f6ffaffd700 1 --2- 172.21.15.156:0/359289071 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ffc1309f0 0x7f6ffc13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.192+0000 7f6ffaffd700 1 -- 172.21.15.156:0/359289071 >> v2:172.21.15.156:3300/0 conn(0x7f6ffc1300a0 msgr2=0x7f6ffc1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:49.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.192+0000 7f6ffaffd700 1 --2- 172.21.15.156:0/359289071 >> v2:172.21.15.156:3300/0 conn(0x7f6ffc1300a0 0x7f6ffc1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.192+0000 7f6ffaffd700 1 -- 172.21.15.156:0/359289071 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ffc1338b0 con 0x7f6ffc133ad0 2023-09-30T22:20:49.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.192+0000 7f6ffaffd700 1 --2- 172.21.15.156:0/359289071 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ffc133ad0 0x7f6ffc133ea0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6fec0098f0 tx=0x7f6fec009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ad731ea60c0d110 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:49.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.192+0000 7f6ff9ffb700 1 -- 172.21.15.156:0/359289071 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec011830 con 0x7f6ffc133ad0 2023-09-30T22:20:49.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.192+0000 7f6ff9ffb700 1 -- 172.21.15.156:0/359289071 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fec011990 con 0x7f6ffc133ad0 2023-09-30T22:20:49.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.192+0000 7f6ff9ffb700 1 -- 172.21.15.156:0/359289071 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec011d20 con 0x7f6ffc133ad0 2023-09-30T22:20:49.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.193+0000 7f7001885700 1 -- 172.21.15.156:0/359289071 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ffc133ad0 msgr2=0x7f6ffc133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:49.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.193+0000 7f7001885700 1 --2- 172.21.15.156:0/359289071 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ffc133ad0 0x7f6ffc133ea0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6fec0098f0 tx=0x7f6fec009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:49.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.193+0000 7f7001885700 1 -- 172.21.15.156:0/359289071 shutdown_connections 2023-09-30T22:20:49.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.193+0000 7f7001885700 1 --2- 172.21.15.156:0/359289071 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ffc1309f0 0x7f6ffc13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.193+0000 7f7001885700 1 --2- 172.21.15.156:0/359289071 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ffc133ad0 0x7f6ffc133ea0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.193+0000 7f7001885700 1 --2- 172.21.15.156:0/359289071 >> v2:172.21.15.156:3300/0 conn(0x7f6ffc1300a0 0x7f6ffc1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.193+0000 7f7001885700 1 -- 172.21.15.156:0/359289071 >> 172.21.15.156:0/359289071 conn(0x7f6ffc099c40 msgr2=0x7f6ffc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:49.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.193+0000 7f7001885700 1 -- 172.21.15.156:0/359289071 shutdown_connections 2023-09-30T22:20:49.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.193+0000 7f7001885700 1 -- 172.21.15.156:0/359289071 wait complete. 2023-09-30T22:20:49.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.194+0000 7f7001885700 1 Processor -- start 2023-09-30T22:20:49.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.194+0000 7f7001885700 1 -- start start 2023-09-30T22:20:49.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.194+0000 7f7001885700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ffc1300a0 0x7f6ffc11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:49.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.194+0000 7f7001885700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ffc1309f0 0x7f6ffc11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:49.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.195+0000 7f7001885700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ffc133ad0 0x7f6ffc11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:49.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.195+0000 7f7001885700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc12da10 con 0x7f6ffc1300a0 2023-09-30T22:20:49.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.195+0000 7f7001885700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc120a30 con 0x7f6ffc133ad0 2023-09-30T22:20:49.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.195+0000 7f7001885700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc12dd00 con 0x7f6ffc1309f0 2023-09-30T22:20:49.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.195+0000 7f6ffb7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ffc133ad0 0x7f6ffc11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:49.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.195+0000 7f6ffb7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ffc133ad0 0x7f6ffc11e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40834/0 (socket says 172.21.15.156:40834) 2023-09-30T22:20:49.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.195+0000 7f6ffb7fe700 1 -- 172.21.15.156:0/3694696744 learned_addr learned my addr 172.21.15.156:0/3694696744 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:49.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.195+0000 7f6ffa7fc700 1 --2- 172.21.15.156:0/3694696744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ffc1309f0 0x7f6ffc11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:49.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.195+0000 7f6ffa7fc700 1 -- 172.21.15.156:0/3694696744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ffc133ad0 msgr2=0x7f6ffc11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:49.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.195+0000 7f6ffa7fc700 1 --2- 172.21.15.156:0/3694696744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ffc133ad0 0x7f6ffc11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.195+0000 7f6ffa7fc700 1 -- 172.21.15.156:0/3694696744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ffc1300a0 msgr2=0x7f6ffc11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:49.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.195+0000 7f6ffa7fc700 1 --2- 172.21.15.156:0/3694696744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ffc1300a0 0x7f6ffc11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.195+0000 7f6ffa7fc700 1 -- 172.21.15.156:0/3694696744 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fec009550 con 0x7f6ffc1309f0 2023-09-30T22:20:49.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.195+0000 7f6ffb7fe700 1 --2- 172.21.15.156:0/3694696744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ffc133ad0 0x7f6ffc11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:49.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.195+0000 7f6ffa7fc700 1 --2- 172.21.15.156:0/3694696744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ffc1309f0 0x7f6ffc11df80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc09ea20 tx=0x7f6ff000b730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:49.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.195+0000 7f6fe3fff700 1 -- 172.21.15.156:0/3694696744 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0011830 con 0x7f6ffc1309f0 2023-09-30T22:20:49.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.196+0000 7f6fe3fff700 1 -- 172.21.15.156:0/3694696744 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff0011990 con 0x7f6ffc1309f0 2023-09-30T22:20:49.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.196+0000 7f6fe3fff700 1 -- 172.21.15.156:0/3694696744 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0011d40 con 0x7f6ffc1309f0 2023-09-30T22:20:49.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.196+0000 7f7001885700 1 -- 172.21.15.156:0/3694696744 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ffc0a33e0 con 0x7f6ffc1309f0 2023-09-30T22:20:49.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.196+0000 7f7001885700 1 -- 172.21.15.156:0/3694696744 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ffc0717b0 con 0x7f6ffc1309f0 2023-09-30T22:20:49.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.196+0000 7f6fe3fff700 1 -- 172.21.15.156:0/3694696744 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6ff001a400 con 0x7f6ffc1309f0 2023-09-30T22:20:49.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.197+0000 7f6fe3fff700 1 -- 172.21.15.156:0/3694696744 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6ff003f630 con 0x7f6ffc1309f0 2023-09-30T22:20:49.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.197+0000 7f7001885700 1 -- 172.21.15.156:0/3694696744 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ffc04f2a0 con 0x7f6ffc1309f0 2023-09-30T22:20:49.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.202+0000 7f6fe3fff700 1 -- 172.21.15.156:0/3694696744 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ff0015080 con 0x7f6ffc1309f0 2023-09-30T22:20:49.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.335+0000 7f8c257fa700 1 -- 172.21.15.156:0/2563480714 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8c08005590 con 0x7f8c301300a0 2023-09-30T22:20:49.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.336+0000 7f8c27fff700 1 -- 172.21.15.156:0/2563480714 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c20029020 con 0x7f8c301300a0 2023-09-30T22:20:49.337 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:49.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.338+0000 7f8c257fa700 1 -- 172.21.15.156:0/2563480714 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c301300a0 msgr2=0x7f8c3011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:49.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.338+0000 7f8c257fa700 1 --2- 172.21.15.156:0/2563480714 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c301300a0 0x7f8c3011da40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8c20009c40 tx=0x7f8c20004750 comp rx=0 tx=0).stop 2023-09-30T22:20:49.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.338+0000 7f8c257fa700 1 -- 172.21.15.156:0/2563480714 shutdown_connections 2023-09-30T22:20:49.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.338+0000 7f8c257fa700 1 --2- 172.21.15.156:0/2563480714 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c30133ad0 0x7f8c3011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.338+0000 7f8c257fa700 1 --2- 172.21.15.156:0/2563480714 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c301300a0 0x7f8c3011da40 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.338+0000 7f8c257fa700 1 --2- 172.21.15.156:0/2563480714 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c30130bc0 0x7f8c3011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.338+0000 7f8c257fa700 1 -- 172.21.15.156:0/2563480714 >> 172.21.15.156:0/2563480714 conn(0x7f8c30099c40 msgr2=0x7f8c30132b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:49.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.338+0000 7f8c257fa700 1 -- 172.21.15.156:0/2563480714 shutdown_connections 2023-09-30T22:20:49.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.338+0000 7f8c257fa700 1 -- 172.21.15.156:0/2563480714 wait complete. 2023-09-30T22:20:49.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:49.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.391+0000 7f3917f9f700 1 -- 172.21.15.156:0/873425987 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f39101321c0 con 0x7f3910130ce0 2023-09-30T22:20:49.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.392+0000 7f39067fc700 1 -- 172.21.15.156:0/873425987 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f39080102e0 con 0x7f3910130ce0 2023-09-30T22:20:49.393 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:49.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.394+0000 7f3917f9f700 1 -- 172.21.15.156:0/873425987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3910130ce0 msgr2=0x7f391012e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:49.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.394+0000 7f3917f9f700 1 --2- 172.21.15.156:0/873425987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3910130ce0 0x7f391012e540 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f390800cc50 tx=0x7f390800a340 comp rx=0 tx=0).stop 2023-09-30T22:20:49.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.394+0000 7f3917f9f700 1 -- 172.21.15.156:0/873425987 shutdown_connections 2023-09-30T22:20:49.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.394+0000 7f3917f9f700 1 --2- 172.21.15.156:0/873425987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3910130ce0 0x7f391012e540 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.394+0000 7f3917f9f700 1 --2- 172.21.15.156:0/873425987 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f391009d860 0x7f391012dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.394+0000 7f3917f9f700 1 --2- 172.21.15.156:0/873425987 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f391009e170 0x7f391012e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.394+0000 7f3917f9f700 1 -- 172.21.15.156:0/873425987 >> 172.21.15.156:0/873425987 conn(0x7f3910099c40 msgr2=0x7f3910070de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:49.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.394+0000 7f3917f9f700 1 -- 172.21.15.156:0/873425987 shutdown_connections 2023-09-30T22:20:49.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.394+0000 7f3917f9f700 1 -- 172.21.15.156:0/873425987 wait complete. 2023-09-30T22:20:49.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.397+0000 7f7001885700 1 -- 172.21.15.156:0/3694696744 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6ffc06c3b0 con 0x7f6ffc1309f0 2023-09-30T22:20:49.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.397+0000 7f6fe3fff700 1 -- 172.21.15.156:0/3694696744 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ff000f8d0 con 0x7f6ffc1309f0 2023-09-30T22:20:49.398 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:49.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.398+0000 7f53944c3700 1 -- 172.21.15.156:0/2385179075 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f538c0a3130 con 0x7f538c09dea0 2023-09-30T22:20:49.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.398+0000 7f5382ffd700 1 -- 172.21.15.156:0/2385179075 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f538800bbd0 con 0x7f538c09dea0 2023-09-30T22:20:49.399 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:49.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.400+0000 7f7001885700 1 -- 172.21.15.156:0/3694696744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ffc1309f0 msgr2=0x7f6ffc11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:49.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.400+0000 7f7001885700 1 --2- 172.21.15.156:0/3694696744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ffc1309f0 0x7f6ffc11df80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc09ea20 tx=0x7f6ff000b730 comp rx=0 tx=0).stop 2023-09-30T22:20:49.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.400+0000 7f7001885700 1 -- 172.21.15.156:0/3694696744 shutdown_connections 2023-09-30T22:20:49.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.400+0000 7f7001885700 1 --2- 172.21.15.156:0/3694696744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ffc133ad0 0x7f6ffc11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.400+0000 7f7001885700 1 --2- 172.21.15.156:0/3694696744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ffc1300a0 0x7f6ffc11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.400+0000 7f7001885700 1 --2- 172.21.15.156:0/3694696744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ffc1309f0 0x7f6ffc11df80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.400+0000 7f7001885700 1 -- 172.21.15.156:0/3694696744 >> 172.21.15.156:0/3694696744 conn(0x7f6ffc099c40 msgr2=0x7f6ffc132ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:49.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.400+0000 7f7001885700 1 -- 172.21.15.156:0/3694696744 shutdown_connections 2023-09-30T22:20:49.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.400+0000 7f7001885700 1 -- 172.21.15.156:0/3694696744 wait complete. 2023-09-30T22:20:49.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.401+0000 7f53944c3700 1 -- 172.21.15.156:0/2385179075 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f538c09dea0 msgr2=0x7f538c135d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:49.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.401+0000 7f53944c3700 1 --2- 172.21.15.156:0/2385179075 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f538c09dea0 0x7f538c135d90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5388013000 tx=0x7f5388004750 comp rx=0 tx=0).stop 2023-09-30T22:20:49.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.401+0000 7f53944c3700 1 -- 172.21.15.156:0/2385179075 shutdown_connections 2023-09-30T22:20:49.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.401+0000 7f53944c3700 1 --2- 172.21.15.156:0/2385179075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f538c134f00 0x7f538c1362d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.401+0000 7f53944c3700 1 --2- 172.21.15.156:0/2385179075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f538c06a770 0x7f538c135850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.401+0000 7f53944c3700 1 --2- 172.21.15.156:0/2385179075 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f538c09dea0 0x7f538c135d90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:49.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.401+0000 7f53944c3700 1 -- 172.21.15.156:0/2385179075 >> 172.21.15.156:0/2385179075 conn(0x7f538c099c40 msgr2=0x7f538c09c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:49.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.401+0000 7f53944c3700 1 -- 172.21.15.156:0/2385179075 shutdown_connections 2023-09-30T22:20:49.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:49.401+0000 7f53944c3700 1 -- 172.21.15.156:0/2385179075 wait complete. 2023-09-30T22:20:49.410 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:49.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:49.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:50.355 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:50.410 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:50.416 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:50.417 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:50.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.498+0000 7fbaaab9c700 1 Processor -- start 2023-09-30T22:20:50.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.498+0000 7fbaaab9c700 1 -- start start 2023-09-30T22:20:50.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.498+0000 7fbaaab9c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbaa4099e20 0x7fbaa409a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:50.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.498+0000 7fbaaab9c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbaa409a730 0x7fbaa4130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:50.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.498+0000 7fbaaab9c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa4099a60 con 0x7fbaa4130890 2023-09-30T22:20:50.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.498+0000 7fbaaab9c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa409bf50 con 0x7fbaa4099e20 2023-09-30T22:20:50.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.498+0000 7fbaaab9c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa409b230 con 0x7fbaa409a730 2023-09-30T22:20:50.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.498+0000 7fbaa3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbaa409a730 0x7fbaa4130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:50.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.499+0000 7fbaa3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbaa409a730 0x7fbaa4130350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40840/0 (socket says 172.21.15.156:40840) 2023-09-30T22:20:50.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.499+0000 7fbaa3fff700 1 -- 172.21.15.156:0/460973999 learned_addr learned my addr 172.21.15.156:0/460973999 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:50.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.499+0000 7fbaa8938700 1 --2- 172.21.15.156:0/460973999 >> v2:172.21.15.156:3300/0 conn(0x7fbaa4099e20 0x7fbaa409a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:50.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.499+0000 7fbaa3fff700 1 -- 172.21.15.156:0/460973999 >> v2:172.21.15.156:3300/0 conn(0x7fbaa4099e20 msgr2=0x7fbaa409a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:50.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.499+0000 7fbaa3fff700 1 --2- 172.21.15.156:0/460973999 >> v2:172.21.15.156:3300/0 conn(0x7fbaa4099e20 0x7fbaa409a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.499+0000 7fbaa3fff700 1 -- 172.21.15.156:0/460973999 >> v1:172.21.15.156:6789/0 conn(0x7fbaa4130890 legacy=0x7fbaa4137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:50.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.499+0000 7fbaa3fff700 1 -- 172.21.15.156:0/460973999 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa409bb90 con 0x7fbaa409a730 2023-09-30T22:20:50.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.499+0000 7fbaa3fff700 1 --2- 172.21.15.156:0/460973999 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbaa409a730 0x7fbaa4130350 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fba900098f0 tx=0x7fba90009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d41a78ecdb95e78 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:50.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.499+0000 7fbaa37fe700 1 -- 172.21.15.156:0/460973999 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba90011830 con 0x7fbaa409a730 2023-09-30T22:20:50.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.499+0000 7fbaa37fe700 1 -- 172.21.15.156:0/460973999 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba90011990 con 0x7fbaa409a730 2023-09-30T22:20:50.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.499+0000 7fbaa37fe700 1 -- 172.21.15.156:0/460973999 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba90011d20 con 0x7fbaa409a730 2023-09-30T22:20:50.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.500+0000 7fbaaab9c700 1 -- 172.21.15.156:0/460973999 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbaa409a730 msgr2=0x7fbaa4130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:50.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.500+0000 7fbaaab9c700 1 --2- 172.21.15.156:0/460973999 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbaa409a730 0x7fbaa4130350 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fba900098f0 tx=0x7fba90009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:50.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.500+0000 7fbaaab9c700 1 -- 172.21.15.156:0/460973999 shutdown_connections 2023-09-30T22:20:50.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.500+0000 7fbaaab9c700 1 --2- 172.21.15.156:0/460973999 >> v2:172.21.15.156:3300/0 conn(0x7fbaa4099e20 0x7fbaa409a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.500+0000 7fbaaab9c700 1 --2- 172.21.15.156:0/460973999 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbaa409a730 0x7fbaa4130350 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.500+0000 7fbaaab9c700 1 -- 172.21.15.156:0/460973999 >> 172.21.15.156:0/460973999 conn(0x7fbaa40a2980 msgr2=0x7fbaa40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:50.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.500+0000 7fbaaab9c700 1 -- 172.21.15.156:0/460973999 shutdown_connections 2023-09-30T22:20:50.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.500+0000 7fbaaab9c700 1 -- 172.21.15.156:0/460973999 wait complete. 2023-09-30T22:20:50.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.501+0000 7fbaaab9c700 1 Processor -- start 2023-09-30T22:20:50.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.502+0000 7fbaaab9c700 1 -- start start 2023-09-30T22:20:50.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.502+0000 7fbaaab9c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbaa4099e20 0x7fbaa41c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:50.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.502+0000 7fbaaab9c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbaa409a730 0x7fbaa41c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:50.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.502+0000 7fbaaab9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbaa4130890 0x7fbaa41c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:50.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.502+0000 7fbaaab9c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa4139960 con 0x7fbaa4130890 2023-09-30T22:20:50.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.503+0000 7fbaaab9c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa409b470 con 0x7fbaa409a730 2023-09-30T22:20:50.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.503+0000 7fbaaab9c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa412dd20 con 0x7fbaa4099e20 2023-09-30T22:20:50.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.503+0000 7fbaa9139700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbaa4130890 0x7fbaa41c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:50.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.503+0000 7fbaa3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbaa409a730 0x7fbaa41c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:50.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.503+0000 7fbaa9139700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbaa4130890 0x7fbaa41c6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54622/0 (socket says 172.21.15.156:54622) 2023-09-30T22:20:50.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.503+0000 7fbaa3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbaa409a730 0x7fbaa41c6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40856/0 (socket says 172.21.15.156:40856) 2023-09-30T22:20:50.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.503+0000 7fbaa9139700 1 -- 172.21.15.156:0/3755284632 learned_addr learned my addr 172.21.15.156:0/3755284632 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:50.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.503+0000 7fbaa8938700 1 --2- 172.21.15.156:0/3755284632 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbaa4099e20 0x7fbaa41c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:50.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.503+0000 7fbaa9139700 1 -- 172.21.15.156:0/3755284632 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbaa4099e20 msgr2=0x7fbaa41c6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:50.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.503+0000 7fbaa9139700 1 --2- 172.21.15.156:0/3755284632 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbaa4099e20 0x7fbaa41c6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.503+0000 7fbaa9139700 1 -- 172.21.15.156:0/3755284632 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbaa409a730 msgr2=0x7fbaa41c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:50.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.503+0000 7fbaa9139700 1 --2- 172.21.15.156:0/3755284632 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbaa409a730 0x7fbaa41c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.503+0000 7fbaa9139700 1 -- 172.21.15.156:0/3755284632 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba90009550 con 0x7fbaa4130890 2023-09-30T22:20:50.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.503+0000 7fbaa9139700 1 --2- 172.21.15.156:0/3755284632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbaa4130890 0x7fbaa41c6a90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fba9c00cc50 tx=0x7fba9c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:50.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.503+0000 7fbaa17fa700 1 -- 172.21.15.156:0/3755284632 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c003c00 con 0x7fbaa4130890 2023-09-30T22:20:50.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.503+0000 7fbaa17fa700 1 -- 172.21.15.156:0/3755284632 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9c003d60 con 0x7fbaa4130890 2023-09-30T22:20:50.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.503+0000 7fbaa17fa700 1 -- 172.21.15.156:0/3755284632 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c00aab0 con 0x7fbaa4130890 2023-09-30T22:20:50.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.504+0000 7fbaaab9c700 1 -- 172.21.15.156:0/3755284632 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa4131a70 con 0x7fbaa4130890 2023-09-30T22:20:50.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.504+0000 7fbaaab9c700 1 -- 172.21.15.156:0/3755284632 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa412c2d0 con 0x7fbaa4130890 2023-09-30T22:20:50.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.505+0000 7fbaa17fa700 1 -- 172.21.15.156:0/3755284632 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fba9c00ac10 con 0x7fbaa4130890 2023-09-30T22:20:50.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.505+0000 7fbaaab9c700 1 -- 172.21.15.156:0/3755284632 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa4072480 con 0x7fbaa4130890 2023-09-30T22:20:50.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.505+0000 7fbaa17fa700 1 -- 172.21.15.156:0/3755284632 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fba9c03f4d0 con 0x7fbaa4130890 2023-09-30T22:20:50.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.514+0000 7fbaa17fa700 1 -- 172.21.15.156:0/3755284632 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbaa4072480 con 0x7fbaa4130890 2023-09-30T22:20:50.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.549+0000 7fede797b700 1 Processor -- start 2023-09-30T22:20:50.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.549+0000 7fede797b700 1 -- start start 2023-09-30T22:20:50.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.549+0000 7fede797b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fede006a770 0x7fede006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:50.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.549+0000 7fede797b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fede006b080 0x7fede01317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:50.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.549+0000 7fede797b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fede0131cf0 0x7fede0132190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:50.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.549+0000 7fede797b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fede009f770 con 0x7fede006b080 2023-09-30T22:20:50.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.549+0000 7fede797b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede009dce0 con 0x7fede0131cf0 2023-09-30T22:20:50.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.549+0000 7fede797b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fede009da80 con 0x7fede006a770 2023-09-30T22:20:50.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.550+0000 7fede5717700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fede006a770 0x7fede006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:50.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.550+0000 7fede5717700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fede006a770 0x7fede006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43696/0 (socket says 172.21.15.156:43696) 2023-09-30T22:20:50.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.550+0000 7fede5717700 1 -- 172.21.15.156:0/2386822927 learned_addr learned my addr 172.21.15.156:0/2386822927 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:50.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.550+0000 7fede4f16700 1 --2- 172.21.15.156:0/2386822927 >> v2:172.21.15.156:3300/0 conn(0x7fede006b080 0x7fede01317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:50.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.550+0000 7fede5f18700 1 --2- 172.21.15.156:0/2386822927 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fede0131cf0 0x7fede0132190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:50.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.550+0000 7fede4f16700 1 -- 172.21.15.156:0/2386822927 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fede006a770 msgr2=0x7fede006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:50.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.550+0000 7fede4f16700 1 --2- 172.21.15.156:0/2386822927 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fede006a770 0x7fede006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.550+0000 7fede4f16700 1 -- 172.21.15.156:0/2386822927 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fede0131cf0 msgr2=0x7fede0132190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:50.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.550+0000 7fede4f16700 1 --2- 172.21.15.156:0/2386822927 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fede0131cf0 0x7fede0132190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.550+0000 7fede4f16700 1 -- 172.21.15.156:0/2386822927 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede009eb20 con 0x7fede006b080 2023-09-30T22:20:50.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.550+0000 7fede4f16700 1 --2- 172.21.15.156:0/2386822927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fede006b080 0x7fede01317b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fedd0009840 tx=0x7fedd0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f08300da8f56f88 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:50.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.550+0000 7fedd7fff700 1 -- 172.21.15.156:0/2386822927 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0011830 con 0x7fede006b080 2023-09-30T22:20:50.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.550+0000 7fedd7fff700 1 -- 172.21.15.156:0/2386822927 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd0011990 con 0x7fede006b080 2023-09-30T22:20:50.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.550+0000 7fedd7fff700 1 -- 172.21.15.156:0/2386822927 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0011d20 con 0x7fede006b080 2023-09-30T22:20:50.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.551+0000 7fede797b700 1 -- 172.21.15.156:0/2386822927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fede006b080 msgr2=0x7fede01317b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:50.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.551+0000 7fede797b700 1 --2- 172.21.15.156:0/2386822927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fede006b080 0x7fede01317b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fedd0009840 tx=0x7fedd0009b50 comp rx=0 tx=0).stop 2023-09-30T22:20:50.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.551+0000 7fede797b700 1 -- 172.21.15.156:0/2386822927 shutdown_connections 2023-09-30T22:20:50.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.551+0000 7fede797b700 1 --2- 172.21.15.156:0/2386822927 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fede0131cf0 0x7fede0132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.551+0000 7fede797b700 1 --2- 172.21.15.156:0/2386822927 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fede006a770 0x7fede006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.551+0000 7fede797b700 1 --2- 172.21.15.156:0/2386822927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fede006b080 0x7fede01317b0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.551+0000 7fede797b700 1 -- 172.21.15.156:0/2386822927 >> 172.21.15.156:0/2386822927 conn(0x7fede0099c40 msgr2=0x7fede00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:50.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.551+0000 7fede797b700 1 -- 172.21.15.156:0/2386822927 shutdown_connections 2023-09-30T22:20:50.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.551+0000 7fede797b700 1 -- 172.21.15.156:0/2386822927 wait complete. 2023-09-30T22:20:50.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.553+0000 7fede797b700 1 Processor -- start 2023-09-30T22:20:50.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.553+0000 7fede797b700 1 -- start start 2023-09-30T22:20:50.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.553+0000 7fede797b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fede006a770 0x7fede011d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:50.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.553+0000 7fede797b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fede006b080 0x7fede011d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:50.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.553+0000 7fede797b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fede0131cf0 0x7fede01c5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:50.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.553+0000 7fede797b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede0120230 con 0x7fede006b080 2023-09-30T22:20:50.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.553+0000 7fede797b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede011ce60 con 0x7fede0131cf0 2023-09-30T22:20:50.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.553+0000 7fede797b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fede01312a0 con 0x7fede006a770 2023-09-30T22:20:50.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.553+0000 7fede5717700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fede006a770 0x7fede011d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:50.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.553+0000 7fede5717700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fede006a770 0x7fede011d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43702/0 (socket says 172.21.15.156:43702) 2023-09-30T22:20:50.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.553+0000 7fede5717700 1 -- 172.21.15.156:0/3031207396 learned_addr learned my addr 172.21.15.156:0/3031207396 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:50.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.554+0000 7fede5f18700 1 --2- 172.21.15.156:0/3031207396 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fede0131cf0 0x7fede01c5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:50.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.554+0000 7fede4f16700 1 --2- 172.21.15.156:0/3031207396 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fede006b080 0x7fede011d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:50.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.554+0000 7fede5717700 1 -- 172.21.15.156:0/3031207396 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fede0131cf0 msgr2=0x7fede01c5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:50.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.554+0000 7fede5717700 1 --2- 172.21.15.156:0/3031207396 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fede0131cf0 0x7fede01c5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.554+0000 7fede5717700 1 -- 172.21.15.156:0/3031207396 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fede006b080 msgr2=0x7fede011d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:50.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.554+0000 7fede5717700 1 --2- 172.21.15.156:0/3031207396 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fede006b080 0x7fede011d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.554+0000 7fede5717700 1 -- 172.21.15.156:0/3031207396 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd00094a0 con 0x7fede006a770 2023-09-30T22:20:50.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.554+0000 7fede5f18700 1 --2- 172.21.15.156:0/3031207396 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fede0131cf0 0x7fede01c5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:20:50.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.554+0000 7fede4f16700 1 --2- 172.21.15.156:0/3031207396 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fede006b080 0x7fede011d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:20:50.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.554+0000 7fede5717700 1 --2- 172.21.15.156:0/3031207396 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fede006a770 0x7fede011d440 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7feddc00e940 tx=0x7feddc00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:50.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.554+0000 7fedd5ffb700 1 -- 172.21.15.156:0/3031207396 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc0096a0 con 0x7fede006a770 2023-09-30T22:20:50.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.554+0000 7fedd5ffb700 1 -- 172.21.15.156:0/3031207396 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feddc00c850 con 0x7fede006a770 2023-09-30T22:20:50.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.554+0000 7fede797b700 1 -- 172.21.15.156:0/3031207396 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede0071e10 con 0x7fede006a770 2023-09-30T22:20:50.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.554+0000 7fedd5ffb700 1 -- 172.21.15.156:0/3031207396 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc00cbc0 con 0x7fede006a770 2023-09-30T22:20:50.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.554+0000 7fede797b700 1 -- 172.21.15.156:0/3031207396 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede011ed10 con 0x7fede006a770 2023-09-30T22:20:50.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.555+0000 7fedd5ffb700 1 -- 172.21.15.156:0/3031207396 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feddc00cd20 con 0x7fede006a770 2023-09-30T22:20:50.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.555+0000 7fede797b700 1 -- 172.21.15.156:0/3031207396 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede009d2f0 con 0x7fede006a770 2023-09-30T22:20:50.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.556+0000 7fedd5ffb700 1 -- 172.21.15.156:0/3031207396 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feddc03fad0 con 0x7fede006a770 2023-09-30T22:20:50.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.565+0000 7fedd5ffb700 1 -- 172.21.15.156:0/3031207396 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feddc01b3b0 con 0x7fede006a770 2023-09-30T22:20:50.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.589+0000 7f4ea2e19700 1 Processor -- start 2023-09-30T22:20:50.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.589+0000 7f4ea2e19700 1 -- start start 2023-09-30T22:20:50.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.590+0000 7f4ea2e19700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e9c133ad0 0x7f4e9c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:50.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.590+0000 7f4ea2e19700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4e9c1300a0 0x7f4e9c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:50.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.590+0000 7f4ea2e19700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e9c1309f0 0x7f4e9c13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:50.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.590+0000 7f4ea2e19700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e9c06b2d0 con 0x7f4e9c1300a0 2023-09-30T22:20:50.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.590+0000 7f4ea2e19700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c133610 con 0x7f4e9c1309f0 2023-09-30T22:20:50.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.590+0000 7f4ea2e19700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c09a500 con 0x7f4e9c133ad0 2023-09-30T22:20:50.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.590+0000 7f4ea0bb5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e9c133ad0 0x7f4e9c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:50.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.590+0000 7f4ea0bb5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e9c133ad0 0x7f4e9c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43714/0 (socket says 172.21.15.156:43714) 2023-09-30T22:20:50.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.590+0000 7f4ea0bb5700 1 -- 172.21.15.156:0/2059496047 learned_addr learned my addr 172.21.15.156:0/2059496047 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:50.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.590+0000 7f4ea13b6700 1 --2- 172.21.15.156:0/2059496047 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e9c1309f0 0x7f4e9c13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:50.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.590+0000 7f4e9bfff700 1 --2- 172.21.15.156:0/2059496047 >> v2:172.21.15.156:3300/0 conn(0x7f4e9c1300a0 0x7f4e9c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:50.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.590+0000 7f4ea0bb5700 1 -- 172.21.15.156:0/2059496047 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e9c1309f0 msgr2=0x7f4e9c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:50.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.590+0000 7f4ea0bb5700 1 --2- 172.21.15.156:0/2059496047 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e9c1309f0 0x7f4e9c13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.590+0000 7f4ea0bb5700 1 -- 172.21.15.156:0/2059496047 >> v2:172.21.15.156:3300/0 conn(0x7f4e9c1300a0 msgr2=0x7f4e9c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:50.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.590+0000 7f4ea0bb5700 1 --2- 172.21.15.156:0/2059496047 >> v2:172.21.15.156:3300/0 conn(0x7f4e9c1300a0 0x7f4e9c1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.590+0000 7f4ea0bb5700 1 -- 172.21.15.156:0/2059496047 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9c1338b0 con 0x7f4e9c133ad0 2023-09-30T22:20:50.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.590+0000 7f4e9bfff700 1 --2- 172.21.15.156:0/2059496047 >> v2:172.21.15.156:3300/0 conn(0x7f4e9c1300a0 0x7f4e9c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:50.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.591+0000 7f4ea0bb5700 1 --2- 172.21.15.156:0/2059496047 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e9c133ad0 0x7f4e9c133ea0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4e900098f0 tx=0x7f4e90009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba63c0ddec8a268d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:50.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.591+0000 7f4e9b7fe700 1 -- 172.21.15.156:0/2059496047 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e90011830 con 0x7f4e9c133ad0 2023-09-30T22:20:50.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.591+0000 7f4e9b7fe700 1 -- 172.21.15.156:0/2059496047 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e90011990 con 0x7f4e9c133ad0 2023-09-30T22:20:50.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.591+0000 7f4e9b7fe700 1 -- 172.21.15.156:0/2059496047 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e90011d20 con 0x7f4e9c133ad0 2023-09-30T22:20:50.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.592+0000 7f4ea2e19700 1 -- 172.21.15.156:0/2059496047 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e9c133ad0 msgr2=0x7f4e9c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:50.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.592+0000 7f4ea2e19700 1 --2- 172.21.15.156:0/2059496047 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e9c133ad0 0x7f4e9c133ea0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4e900098f0 tx=0x7f4e90009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:50.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.592+0000 7f4ea2e19700 1 -- 172.21.15.156:0/2059496047 shutdown_connections 2023-09-30T22:20:50.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.592+0000 7f4ea2e19700 1 --2- 172.21.15.156:0/2059496047 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e9c1309f0 0x7f4e9c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.592+0000 7f4ea2e19700 1 --2- 172.21.15.156:0/2059496047 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e9c133ad0 0x7f4e9c133ea0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.592+0000 7f4ea2e19700 1 --2- 172.21.15.156:0/2059496047 >> v2:172.21.15.156:3300/0 conn(0x7f4e9c1300a0 0x7f4e9c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.592+0000 7f4ea2e19700 1 -- 172.21.15.156:0/2059496047 >> 172.21.15.156:0/2059496047 conn(0x7f4e9c099c40 msgr2=0x7f4e9c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:50.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.592+0000 7f4ea2e19700 1 -- 172.21.15.156:0/2059496047 shutdown_connections 2023-09-30T22:20:50.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.592+0000 7f4ea2e19700 1 -- 172.21.15.156:0/2059496047 wait complete. 2023-09-30T22:20:50.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.593+0000 7f4ea2e19700 1 Processor -- start 2023-09-30T22:20:50.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.593+0000 7f4ea2e19700 1 -- start start 2023-09-30T22:20:50.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.594+0000 7f4ea2e19700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e9c1300a0 0x7f4e9c0713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:50.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.594+0000 7f4ea2e19700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e9c1309f0 0x7f4e9c071900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:50.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.594+0000 7f4ea2e19700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e9c133ad0 0x7f4e9c071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:50.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.594+0000 7f4ea2e19700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c11e040 con 0x7f4e9c1309f0 2023-09-30T22:20:50.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.594+0000 7f4ea2e19700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c072820 con 0x7f4e9c1300a0 2023-09-30T22:20:50.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.594+0000 7f4ea2e19700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c11eed0 con 0x7f4e9c133ad0 2023-09-30T22:20:50.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.594+0000 7f4ea0bb5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e9c1300a0 0x7f4e9c0713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:50.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.594+0000 7f4ea0bb5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e9c1300a0 0x7f4e9c0713c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40882/0 (socket says 172.21.15.156:40882) 2023-09-30T22:20:50.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.594+0000 7f4ea0bb5700 1 -- 172.21.15.156:0/3380907597 learned_addr learned my addr 172.21.15.156:0/3380907597 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:50.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.594+0000 7f4ea13b6700 1 --2- 172.21.15.156:0/3380907597 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e9c133ad0 0x7f4e9c071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:50.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.594+0000 7f4e9bfff700 1 --2- 172.21.15.156:0/3380907597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e9c1309f0 0x7f4e9c071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:50.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.595+0000 7f4ea0bb5700 1 -- 172.21.15.156:0/3380907597 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e9c133ad0 msgr2=0x7f4e9c071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:50.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.595+0000 7f4ea0bb5700 1 --2- 172.21.15.156:0/3380907597 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e9c133ad0 0x7f4e9c071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.595+0000 7f4ea0bb5700 1 -- 172.21.15.156:0/3380907597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e9c1309f0 msgr2=0x7f4e9c071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:50.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.595+0000 7f4ea0bb5700 1 --2- 172.21.15.156:0/3380907597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e9c1309f0 0x7f4e9c071900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.595+0000 7f4ea0bb5700 1 -- 172.21.15.156:0/3380907597 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e880094a0 con 0x7f4e9c1300a0 2023-09-30T22:20:50.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.595+0000 7f4ea0bb5700 1 --2- 172.21.15.156:0/3380907597 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e9c1300a0 0x7f4e9c0713c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c09a640 tx=0x7f4e90004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:50.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.595+0000 7f4e997fa700 1 -- 172.21.15.156:0/3380907597 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e90004450 con 0x7f4e9c1300a0 2023-09-30T22:20:50.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.595+0000 7f4e997fa700 1 -- 172.21.15.156:0/3380907597 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e900045b0 con 0x7f4e9c1300a0 2023-09-30T22:20:50.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.595+0000 7f4ea2e19700 1 -- 172.21.15.156:0/3380907597 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e90009550 con 0x7f4e9c1300a0 2023-09-30T22:20:50.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.595+0000 7f4e997fa700 1 -- 172.21.15.156:0/3380907597 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e900038e0 con 0x7f4e9c1300a0 2023-09-30T22:20:50.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.595+0000 7f4ea2e19700 1 -- 172.21.15.156:0/3380907597 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9c0a33e0 con 0x7f4e9c1300a0 2023-09-30T22:20:50.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.596+0000 7f4e997fa700 1 -- 172.21.15.156:0/3380907597 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4e90003a40 con 0x7f4e9c1300a0 2023-09-30T22:20:50.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.596+0000 7f4e997fa700 1 -- 172.21.15.156:0/3380907597 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4e90040650 con 0x7f4e9c1300a0 2023-09-30T22:20:50.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.597+0000 7f4ea2e19700 1 -- 172.21.15.156:0/3380907597 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e9c09cb20 con 0x7f4e9c1300a0 2023-09-30T22:20:50.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.598+0000 7f686b165700 1 Processor -- start 2023-09-30T22:20:50.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.599+0000 7f686b165700 1 -- start start 2023-09-30T22:20:50.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.599+0000 7f686b165700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6864138410 0x7f68640a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:50.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.599+0000 7f686b165700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f686413dd10 0x7f68641400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:50.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.599+0000 7f686b165700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68641379e0 con 0x7f6864138040 2023-09-30T22:20:50.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.599+0000 7f686b165700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68640a2100 con 0x7f686413dd10 2023-09-30T22:20:50.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.599+0000 7f686b165700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f686409b9b0 con 0x7f6864138410 2023-09-30T22:20:50.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.599+0000 7f6863fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6864138410 0x7f68640a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:50.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.599+0000 7f6863fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6864138410 0x7f68640a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40888/0 (socket says 172.21.15.156:40888) 2023-09-30T22:20:50.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.599+0000 7f6863fff700 1 -- 172.21.15.156:0/146367854 learned_addr learned my addr 172.21.15.156:0/146367854 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:50.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.599+0000 7f6863fff700 1 -- 172.21.15.156:0/146367854 >> v2:172.21.15.156:3300/0 conn(0x7f686413dd10 msgr2=0x7f68641400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:50.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.600+0000 7f6863fff700 1 --2- 172.21.15.156:0/146367854 >> v2:172.21.15.156:3300/0 conn(0x7f686413dd10 0x7f68641400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.600+0000 7f6863fff700 1 -- 172.21.15.156:0/146367854 >> v1:172.21.15.156:6789/0 conn(0x7f6864138040 legacy=0x7f68640a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:50.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.600+0000 7f6863fff700 1 -- 172.21.15.156:0/146367854 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6864137c10 con 0x7f6864138410 2023-09-30T22:20:50.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.600+0000 7f6863fff700 1 --2- 172.21.15.156:0/146367854 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6864138410 0x7f68640a0ff0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6850009920 tx=0x7f6850009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39dd681e06483153 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:50.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.602+0000 7f68637fe700 1 -- 172.21.15.156:0/146367854 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685000ba20 con 0x7f6864138410 2023-09-30T22:20:50.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.602+0000 7f68637fe700 1 -- 172.21.15.156:0/146367854 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685000bb80 con 0x7f6864138410 2023-09-30T22:20:50.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.602+0000 7f68637fe700 1 -- 172.21.15.156:0/146367854 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6850009e70 con 0x7f6864138410 2023-09-30T22:20:50.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.602+0000 7f4e997fa700 1 -- 172.21.15.156:0/3380907597 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e90015080 con 0x7f4e9c1300a0 2023-09-30T22:20:50.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.603+0000 7f686b165700 1 -- 172.21.15.156:0/146367854 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6864138410 msgr2=0x7f68640a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:50.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.603+0000 7f686b165700 1 --2- 172.21.15.156:0/146367854 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6864138410 0x7f68640a0ff0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6850009920 tx=0x7f6850009c30 comp rx=0 tx=0).stop 2023-09-30T22:20:50.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.603+0000 7f686b165700 1 -- 172.21.15.156:0/146367854 shutdown_connections 2023-09-30T22:20:50.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.603+0000 7f686b165700 1 --2- 172.21.15.156:0/146367854 >> v2:172.21.15.156:3300/0 conn(0x7f686413dd10 0x7f68641400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.603+0000 7f686b165700 1 --2- 172.21.15.156:0/146367854 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6864138410 0x7f68640a0ff0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.603+0000 7f686b165700 1 -- 172.21.15.156:0/146367854 >> 172.21.15.156:0/146367854 conn(0x7f68640a2980 msgr2=0x7f68640a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:50.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.603+0000 7f686b165700 1 -- 172.21.15.156:0/146367854 shutdown_connections 2023-09-30T22:20:50.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.603+0000 7f686b165700 1 -- 172.21.15.156:0/146367854 wait complete. 2023-09-30T22:20:50.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.604+0000 7f686b165700 1 Processor -- start 2023-09-30T22:20:50.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.604+0000 7f686b165700 1 -- start start 2023-09-30T22:20:50.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.605+0000 7f686b165700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6864138040 0x7f68641370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:50.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.605+0000 7f686b165700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6864138410 0x7f6864135870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:50.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.605+0000 7f686b165700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f686413dd10 0x7f6864135db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:50.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.605+0000 7f686b165700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686413b360 con 0x7f6864138410 2023-09-30T22:20:50.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.605+0000 7f686b165700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f686413b170 con 0x7f6864138040 2023-09-30T22:20:50.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.605+0000 7f686b165700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f686412ffd0 con 0x7f686413dd10 2023-09-30T22:20:50.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.605+0000 7f6863fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6864138410 0x7f6864135870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:50.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.605+0000 7f6863fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6864138410 0x7f6864135870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54684/0 (socket says 172.21.15.156:54684) 2023-09-30T22:20:50.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.605+0000 7f6863fff700 1 -- 172.21.15.156:0/1638071327 learned_addr learned my addr 172.21.15.156:0/1638071327 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:50.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.606+0000 7f6869702700 1 --2- 172.21.15.156:0/1638071327 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f686413dd10 0x7f6864135db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:50.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.606+0000 7f6863fff700 1 -- 172.21.15.156:0/1638071327 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f686413dd10 msgr2=0x7f6864135db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:50.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.606+0000 7f6863fff700 1 --2- 172.21.15.156:0/1638071327 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f686413dd10 0x7f6864135db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.606+0000 7f6863fff700 1 -- 172.21.15.156:0/1638071327 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6864138040 msgr2=0x7f68641370c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:50.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.606+0000 7f6863fff700 1 --2- 172.21.15.156:0/1638071327 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6864138040 0x7f68641370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.606+0000 7f6863fff700 1 -- 172.21.15.156:0/1638071327 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6850009550 con 0x7f6864138410 2023-09-30T22:20:50.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.606+0000 7f6863fff700 1 --2- 172.21.15.156:0/1638071327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6864138410 0x7f6864135870 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f6850014040 tx=0x7f6850004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:50.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.606+0000 7f68617fa700 1 -- 172.21.15.156:0/1638071327 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68500045d0 con 0x7f6864138410 2023-09-30T22:20:50.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.606+0000 7f686b165700 1 -- 172.21.15.156:0/1638071327 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686413b9d0 con 0x7f6864138410 2023-09-30T22:20:50.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.606+0000 7f68617fa700 1 -- 172.21.15.156:0/1638071327 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685001e070 con 0x7f6864138410 2023-09-30T22:20:50.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.606+0000 7f68617fa700 1 -- 172.21.15.156:0/1638071327 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68500038e0 con 0x7f6864138410 2023-09-30T22:20:50.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.606+0000 7f686b165700 1 -- 172.21.15.156:0/1638071327 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6864118f20 con 0x7f6864138410 2023-09-30T22:20:50.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.607+0000 7f686b165700 1 -- 172.21.15.156:0/1638071327 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f686404f2a0 con 0x7f6864138410 2023-09-30T22:20:50.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.608+0000 7f68617fa700 1 -- 172.21.15.156:0/1638071327 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6850003a40 con 0x7f6864138410 2023-09-30T22:20:50.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.610+0000 7f68617fa700 1 -- 172.21.15.156:0/1638071327 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6850020070 con 0x7f6864138410 2023-09-30T22:20:50.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.617+0000 7f68617fa700 1 -- 172.21.15.156:0/1638071327 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6850010380 con 0x7f6864138410 2023-09-30T22:20:50.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.719+0000 7fbaaab9c700 1 -- 172.21.15.156:0/3755284632 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbaa412c2d0 con 0x7fbaa4130890 2023-09-30T22:20:50.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.719+0000 7fbaa17fa700 1 -- 172.21.15.156:0/3755284632 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbaa412c2d0 con 0x7fbaa4130890 2023-09-30T22:20:50.720 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:50.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.721+0000 7fbaaab9c700 1 -- 172.21.15.156:0/3755284632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbaa4130890 msgr2=0x7fbaa41c6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:50.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.721+0000 7fbaaab9c700 1 --2- 172.21.15.156:0/3755284632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbaa4130890 0x7fbaa41c6a90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fba9c00cc50 tx=0x7fba9c00cf60 comp rx=0 tx=0).stop 2023-09-30T22:20:50.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.721+0000 7fbaaab9c700 1 -- 172.21.15.156:0/3755284632 shutdown_connections 2023-09-30T22:20:50.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.721+0000 7fbaaab9c700 1 --2- 172.21.15.156:0/3755284632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbaa4130890 0x7fbaa41c6a90 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.721+0000 7fbaaab9c700 1 --2- 172.21.15.156:0/3755284632 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbaa4099e20 0x7fbaa41c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.721+0000 7fbaaab9c700 1 --2- 172.21.15.156:0/3755284632 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbaa409a730 0x7fbaa41c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.721+0000 7fbaaab9c700 1 -- 172.21.15.156:0/3755284632 >> 172.21.15.156:0/3755284632 conn(0x7fbaa40a2980 msgr2=0x7fbaa406df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:50.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.721+0000 7fbaaab9c700 1 -- 172.21.15.156:0/3755284632 shutdown_connections 2023-09-30T22:20:50.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.721+0000 7fbaaab9c700 1 -- 172.21.15.156:0/3755284632 wait complete. 2023-09-30T22:20:50.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:50.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.770+0000 7fede797b700 1 -- 172.21.15.156:0/3031207396 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fede004f2a0 con 0x7fede006a770 2023-09-30T22:20:50.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.770+0000 7fedd5ffb700 1 -- 172.21.15.156:0/3031207396 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feddc021070 con 0x7fede006a770 2023-09-30T22:20:50.771 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:50.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.773+0000 7fede797b700 1 -- 172.21.15.156:0/3031207396 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fede006a770 msgr2=0x7fede011d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:50.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.773+0000 7fede797b700 1 --2- 172.21.15.156:0/3031207396 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fede006a770 0x7fede011d440 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7feddc00e940 tx=0x7feddc00ed00 comp rx=0 tx=0).stop 2023-09-30T22:20:50.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.773+0000 7fede797b700 1 -- 172.21.15.156:0/3031207396 shutdown_connections 2023-09-30T22:20:50.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.773+0000 7fede797b700 1 --2- 172.21.15.156:0/3031207396 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fede0131cf0 0x7fede01c5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.773+0000 7fede797b700 1 --2- 172.21.15.156:0/3031207396 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fede006a770 0x7fede011d440 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.773+0000 7fede797b700 1 --2- 172.21.15.156:0/3031207396 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fede006b080 0x7fede011d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.773+0000 7fede797b700 1 -- 172.21.15.156:0/3031207396 >> 172.21.15.156:0/3031207396 conn(0x7fede0099c40 msgr2=0x7fede01b98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:50.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.773+0000 7fede797b700 1 -- 172.21.15.156:0/3031207396 shutdown_connections 2023-09-30T22:20:50.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.773+0000 7fede797b700 1 -- 172.21.15.156:0/3031207396 wait complete. 2023-09-30T22:20:50.786 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:50.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.803+0000 7f4ea2e19700 1 -- 172.21.15.156:0/3380907597 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4e9c04f2a0 con 0x7f4e9c1300a0 2023-09-30T22:20:50.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.804+0000 7f4e997fa700 1 -- 172.21.15.156:0/3380907597 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e90028020 con 0x7f4e9c1300a0 2023-09-30T22:20:50.805 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:50.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.806+0000 7f4ea2e19700 1 -- 172.21.15.156:0/3380907597 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e9c1300a0 msgr2=0x7f4e9c0713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:50.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.806+0000 7f4ea2e19700 1 --2- 172.21.15.156:0/3380907597 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e9c1300a0 0x7f4e9c0713c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c09a640 tx=0x7f4e90004750 comp rx=0 tx=0).stop 2023-09-30T22:20:50.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.806+0000 7f4ea2e19700 1 -- 172.21.15.156:0/3380907597 shutdown_connections 2023-09-30T22:20:50.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.806+0000 7f4ea2e19700 1 --2- 172.21.15.156:0/3380907597 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e9c133ad0 0x7f4e9c071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.806+0000 7f4ea2e19700 1 --2- 172.21.15.156:0/3380907597 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e9c1300a0 0x7f4e9c0713c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.806+0000 7f4ea2e19700 1 --2- 172.21.15.156:0/3380907597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e9c1309f0 0x7f4e9c071900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.806+0000 7f4ea2e19700 1 -- 172.21.15.156:0/3380907597 >> 172.21.15.156:0/3380907597 conn(0x7f4e9c099c40 msgr2=0x7f4e9c132be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:50.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.806+0000 7f4ea2e19700 1 -- 172.21.15.156:0/3380907597 shutdown_connections 2023-09-30T22:20:50.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.806+0000 7f4ea2e19700 1 -- 172.21.15.156:0/3380907597 wait complete. 2023-09-30T22:20:50.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.821+0000 7f686b165700 1 -- 172.21.15.156:0/1638071327 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f686406bce0 con 0x7f6864138410 2023-09-30T22:20:50.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.821+0000 7f68617fa700 1 -- 172.21.15.156:0/1638071327 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f685002a070 con 0x7f6864138410 2023-09-30T22:20:50.822 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:50.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:50.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.823+0000 7f686b165700 1 -- 172.21.15.156:0/1638071327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6864138410 msgr2=0x7f6864135870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:50.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.823+0000 7f686b165700 1 --2- 172.21.15.156:0/1638071327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6864138410 0x7f6864135870 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f6850014040 tx=0x7f6850004750 comp rx=0 tx=0).stop 2023-09-30T22:20:50.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.823+0000 7f686b165700 1 -- 172.21.15.156:0/1638071327 shutdown_connections 2023-09-30T22:20:50.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.823+0000 7f686b165700 1 --2- 172.21.15.156:0/1638071327 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f686413dd10 0x7f6864135db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.823+0000 7f686b165700 1 --2- 172.21.15.156:0/1638071327 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6864138040 0x7f68641370c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.823+0000 7f686b165700 1 --2- 172.21.15.156:0/1638071327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6864138410 0x7f6864135870 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:50.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.823+0000 7f686b165700 1 -- 172.21.15.156:0/1638071327 >> 172.21.15.156:0/1638071327 conn(0x7f68640a2980 msgr2=0x7f686409d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:50.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.823+0000 7f686b165700 1 -- 172.21.15.156:0/1638071327 shutdown_connections 2023-09-30T22:20:50.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:50.823+0000 7f686b165700 1 -- 172.21.15.156:0/1638071327 wait complete. 2023-09-30T22:20:50.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:51.736 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:51.787 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:51.824 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:51.838 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:51.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.873+0000 7f14dd502700 1 Processor -- start 2023-09-30T22:20:51.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.874+0000 7f14dd502700 1 -- start start 2023-09-30T22:20:51.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.874+0000 7f14dd502700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f14d81346e0 0x7f14d8136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:51.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.874+0000 7f14dd502700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14d8137000 0x7f14d81393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:51.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.874+0000 7f14dd502700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d80a1640 con 0x7f14d8131980 2023-09-30T22:20:51.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.874+0000 7f14dd502700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d806eb30 con 0x7f14d8137000 2023-09-30T22:20:51.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.874+0000 7f14dd502700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80a22d0 con 0x7f14d81346e0 2023-09-30T22:20:51.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.874+0000 7f14d67fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f14d81346e0 0x7f14d8136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:51.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.874+0000 7f14d77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14d8137000 0x7f14d81393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:51.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.874+0000 7f14d67fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f14d81346e0 0x7f14d8136ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54518/0 (socket says 172.21.15.156:54518) 2023-09-30T22:20:51.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.875+0000 7f14d67fc700 1 -- 172.21.15.156:0/1168179543 learned_addr learned my addr 172.21.15.156:0/1168179543 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:51.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.875+0000 7f14d67fc700 1 -- 172.21.15.156:0/1168179543 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14d8137000 msgr2=0x7f14d81393e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:51.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.875+0000 7f14d67fc700 1 --2- 172.21.15.156:0/1168179543 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14d8137000 0x7f14d81393e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:51.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.875+0000 7f14d5ffb700 1 -- 172.21.15.156:0/1168179543 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393248285 0 0) 0x7f14d80a1640 con 0x7f14d8131980 2023-09-30T22:20:51.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.875+0000 7f14d67fc700 1 -- 172.21.15.156:0/1168179543 >> v1:172.21.15.156:6789/0 conn(0x7f14d8131980 legacy=0x7f14d8131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:51.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.875+0000 7f14d67fc700 1 -- 172.21.15.156:0/1168179543 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d8131550 con 0x7f14d81346e0 2023-09-30T22:20:51.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.875+0000 7f14d67fc700 1 --2- 172.21.15.156:0/1168179543 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f14d81346e0 0x7f14d8136ac0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f14cc009920 tx=0x7f14cc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e6451e37ee973dd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:51.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.875+0000 7f14d5ffb700 1 -- 172.21.15.156:0/1168179543 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc011830 con 0x7f14d81346e0 2023-09-30T22:20:51.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.875+0000 7f14d5ffb700 1 -- 172.21.15.156:0/1168179543 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14cc011990 con 0x7f14d81346e0 2023-09-30T22:20:51.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.875+0000 7f14d5ffb700 1 -- 172.21.15.156:0/1168179543 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc011d20 con 0x7f14d81346e0 2023-09-30T22:20:51.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.876+0000 7f14dd502700 1 -- 172.21.15.156:0/1168179543 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f14d81346e0 msgr2=0x7f14d8136ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:51.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.876+0000 7f14dd502700 1 --2- 172.21.15.156:0/1168179543 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f14d81346e0 0x7f14d8136ac0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f14cc009920 tx=0x7f14cc009c30 comp rx=0 tx=0).stop 2023-09-30T22:20:51.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.876+0000 7f14dd502700 1 -- 172.21.15.156:0/1168179543 shutdown_connections 2023-09-30T22:20:51.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.876+0000 7f14dd502700 1 --2- 172.21.15.156:0/1168179543 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14d8137000 0x7f14d81393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:51.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.876+0000 7f14dd502700 1 --2- 172.21.15.156:0/1168179543 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f14d81346e0 0x7f14d8136ac0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:51.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.876+0000 7f14dd502700 1 -- 172.21.15.156:0/1168179543 >> 172.21.15.156:0/1168179543 conn(0x7f14d80a2980 msgr2=0x7f14d80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:51.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.876+0000 7f14dd502700 1 -- 172.21.15.156:0/1168179543 shutdown_connections 2023-09-30T22:20:51.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.876+0000 7f14dd502700 1 -- 172.21.15.156:0/1168179543 wait complete. 2023-09-30T22:20:51.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.878+0000 7f14dd502700 1 Processor -- start 2023-09-30T22:20:51.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.878+0000 7f14dd502700 1 -- start start 2023-09-30T22:20:51.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.879+0000 7f14dd502700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14d8131980 0x7f14d812c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:51.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.879+0000 7f14dd502700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14d81346e0 0x7f14d812cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:51.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.879+0000 7f14dd502700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f14d8137000 0x7f14d812d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:51.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.879+0000 7f14dd502700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d8136d60 con 0x7f14d81346e0 2023-09-30T22:20:51.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.879+0000 7f14dd502700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d809fd40 con 0x7f14d8131980 2023-09-30T22:20:51.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.879+0000 7f14dd502700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14d811d680 con 0x7f14d8137000 2023-09-30T22:20:51.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.879+0000 7f14d6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14d8131980 0x7f14d812c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:51.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.879+0000 7f14d6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14d8131980 0x7f14d812c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:36124/0 (socket says 172.21.15.156:36124) 2023-09-30T22:20:51.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.879+0000 7f14d6ffd700 1 -- 172.21.15.156:0/2608239910 learned_addr learned my addr 172.21.15.156:0/2608239910 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:51.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.879+0000 7f14d77fe700 1 --2- 172.21.15.156:0/2608239910 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f14d8137000 0x7f14d812d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:51.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.879+0000 7f14d67fc700 1 --2- 172.21.15.156:0/2608239910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14d81346e0 0x7f14d812cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:51.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.880+0000 7f14d6ffd700 1 -- 172.21.15.156:0/2608239910 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f14d8137000 msgr2=0x7f14d812d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:51.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.880+0000 7f14d6ffd700 1 --2- 172.21.15.156:0/2608239910 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f14d8137000 0x7f14d812d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:51.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.880+0000 7f14d6ffd700 1 -- 172.21.15.156:0/2608239910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14d81346e0 msgr2=0x7f14d812cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:51.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.880+0000 7f14d6ffd700 1 --2- 172.21.15.156:0/2608239910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14d81346e0 0x7f14d812cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:51.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.880+0000 7f14d6ffd700 1 -- 172.21.15.156:0/2608239910 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14cc009550 con 0x7f14d8131980 2023-09-30T22:20:51.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.880+0000 7f14d6ffd700 1 --2- 172.21.15.156:0/2608239910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14d8131980 0x7f14d812c890 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f14c800c550 tx=0x7f14c800c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:51.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.880+0000 7f14bf7fe700 1 -- 172.21.15.156:0/2608239910 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c80054e0 con 0x7f14d8131980 2023-09-30T22:20:51.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.880+0000 7f14dd502700 1 -- 172.21.15.156:0/2608239910 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d811d3c0 con 0x7f14d8131980 2023-09-30T22:20:51.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.880+0000 7f14dd502700 1 -- 172.21.15.156:0/2608239910 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d809ad60 con 0x7f14d8131980 2023-09-30T22:20:51.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.880+0000 7f14bf7fe700 1 -- 172.21.15.156:0/2608239910 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c8003680 con 0x7f14d8131980 2023-09-30T22:20:51.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.880+0000 7f14bf7fe700 1 -- 172.21.15.156:0/2608239910 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8003a30 con 0x7f14d8131980 2023-09-30T22:20:51.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.881+0000 7f14dd502700 1 -- 172.21.15.156:0/2608239910 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b80052e0 con 0x7f14d8131980 2023-09-30T22:20:51.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.881+0000 7f14bf7fe700 1 -- 172.21.15.156:0/2608239910 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f14c8003b90 con 0x7f14d8131980 2023-09-30T22:20:51.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.882+0000 7f14bf7fe700 1 -- 172.21.15.156:0/2608239910 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f14c8040a90 con 0x7f14d8131980 2023-09-30T22:20:51.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.887+0000 7f14bf7fe700 1 -- 172.21.15.156:0/2608239910 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f14c8044060 con 0x7f14d8131980 2023-09-30T22:20:51.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.930+0000 7fa4e6415700 1 Processor -- start 2023-09-30T22:20:51.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.930+0000 7fa4e6415700 1 -- start start 2023-09-30T22:20:51.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.931+0000 7fa4e6415700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4e01347b0 0x7fa4e0136b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:51.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.931+0000 7fa4e6415700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4e01370d0 0x7fa4e01394b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:51.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.931+0000 7fa4e6415700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e006f970 con 0x7fa4e0098410 2023-09-30T22:20:51.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.931+0000 7fa4e6415700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e00720a0 con 0x7fa4e01370d0 2023-09-30T22:20:51.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.931+0000 7fa4e6415700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e0098ef0 con 0x7fa4e01347b0 2023-09-30T22:20:51.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.931+0000 7fa4dffff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fa4e0098410 0x7fa4e00987e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:46038/0 (socket says 172.21.15.156:46038) 2023-09-30T22:20:51.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.931+0000 7fa4e49b2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4e01370d0 0x7fa4e01394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:51.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.931+0000 7fa4dffff700 1 -- 172.21.15.156:0/105515078 learned_addr learned my addr 172.21.15.156:0/105515078 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:51.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.931+0000 7fa4df7fe700 1 --2- 172.21.15.156:0/105515078 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4e01347b0 0x7fa4e0136b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:51.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.932+0000 7fa4e49b2700 1 -- 172.21.15.156:0/105515078 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4e01347b0 msgr2=0x7fa4e0136b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:51.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.932+0000 7fa4e49b2700 1 --2- 172.21.15.156:0/105515078 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4e01347b0 0x7fa4e0136b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:51.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.932+0000 7fa4e49b2700 1 -- 172.21.15.156:0/105515078 >> v1:172.21.15.156:6789/0 conn(0x7fa4e0098410 legacy=0x7fa4e00987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:51.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.932+0000 7fa4e49b2700 1 -- 172.21.15.156:0/105515078 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e0072290 con 0x7fa4e01370d0 2023-09-30T22:20:51.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.932+0000 7fa4deffd700 1 -- 172.21.15.156:0/105515078 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2909684627 0 0) 0x7fa4e006f970 con 0x7fa4e0098410 2023-09-30T22:20:51.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.932+0000 7fa4e49b2700 1 --2- 172.21.15.156:0/105515078 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4e01370d0 0x7fa4e01394b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009df0 tx=0x7fa4d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a016fe760adea183 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:51.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.932+0000 7fa4deffd700 1 -- 172.21.15.156:0/105515078 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d800e070 con 0x7fa4e01370d0 2023-09-30T22:20:51.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.932+0000 7fa4deffd700 1 -- 172.21.15.156:0/105515078 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d800bae0 con 0x7fa4e01370d0 2023-09-30T22:20:51.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.932+0000 7fa4deffd700 1 -- 172.21.15.156:0/105515078 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d800be90 con 0x7fa4e01370d0 2023-09-30T22:20:51.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.933+0000 7fa4e6415700 1 -- 172.21.15.156:0/105515078 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4e01370d0 msgr2=0x7fa4e01394b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:51.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.933+0000 7fa4e6415700 1 --2- 172.21.15.156:0/105515078 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4e01370d0 0x7fa4e01394b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009df0 tx=0x7fa4d800b330 comp rx=0 tx=0).stop 2023-09-30T22:20:51.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.933+0000 7fa4e6415700 1 -- 172.21.15.156:0/105515078 shutdown_connections 2023-09-30T22:20:51.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.933+0000 7fa4e6415700 1 --2- 172.21.15.156:0/105515078 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4e01370d0 0x7fa4e01394b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:51.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.933+0000 7fa4e6415700 1 --2- 172.21.15.156:0/105515078 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4e01347b0 0x7fa4e0136b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:51.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.933+0000 7fa4e6415700 1 -- 172.21.15.156:0/105515078 >> 172.21.15.156:0/105515078 conn(0x7fa4e00a2b30 msgr2=0x7fa4e009e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:51.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.933+0000 7fa4e6415700 1 -- 172.21.15.156:0/105515078 shutdown_connections 2023-09-30T22:20:51.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.933+0000 7fa4e6415700 1 -- 172.21.15.156:0/105515078 wait complete. 2023-09-30T22:20:51.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.934+0000 7fa4e6415700 1 Processor -- start 2023-09-30T22:20:51.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.935+0000 7fa4e6415700 1 -- start start 2023-09-30T22:20:51.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.935+0000 7fa4e6415700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4e0098410 0x7fa4e0099540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:51.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.935+0000 7fa4e6415700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4e01347b0 0x7fa4e0099a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:51.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.935+0000 7fa4e6415700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4e01370d0 0x7fa4e0099fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:51.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.935+0000 7fa4e6415700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e009b6a0 con 0x7fa4e01370d0 2023-09-30T22:20:51.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.935+0000 7fa4e6415700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e0127490 con 0x7fa4e0098410 2023-09-30T22:20:51.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.935+0000 7fa4e6415700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e009a910 con 0x7fa4e01347b0 2023-09-30T22:20:51.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.935+0000 7fa4dffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4e0098410 0x7fa4e0099540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:51.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.935+0000 7fa4dffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4e0098410 0x7fa4e0099540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:36138/0 (socket says 172.21.15.156:36138) 2023-09-30T22:20:51.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.935+0000 7fa4dffff700 1 -- 172.21.15.156:0/1568946081 learned_addr learned my addr 172.21.15.156:0/1568946081 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:51.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.935+0000 7fa4df7fe700 1 --2- 172.21.15.156:0/1568946081 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4e01347b0 0x7fa4e0099a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:51.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.935+0000 7fa4e49b2700 1 --2- 172.21.15.156:0/1568946081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4e01370d0 0x7fa4e0099fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:51.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.936+0000 7fa4dffff700 1 -- 172.21.15.156:0/1568946081 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4e01347b0 msgr2=0x7fa4e0099a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:51.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.936+0000 7fa4dffff700 1 --2- 172.21.15.156:0/1568946081 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4e01347b0 0x7fa4e0099a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:51.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.936+0000 7fa4dffff700 1 -- 172.21.15.156:0/1568946081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4e01370d0 msgr2=0x7fa4e0099fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:51.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.936+0000 7fa4dffff700 1 --2- 172.21.15.156:0/1568946081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4e01370d0 0x7fa4e0099fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:51.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.936+0000 7fa4dffff700 1 -- 172.21.15.156:0/1568946081 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d8009a70 con 0x7fa4e0098410 2023-09-30T22:20:51.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.936+0000 7fa4df7fe700 1 --2- 172.21.15.156:0/1568946081 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4e01347b0 0x7fa4e0099a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:51.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.936+0000 7fa4dffff700 1 --2- 172.21.15.156:0/1568946081 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4e0098410 0x7fa4e0099540 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000c6d0 tx=0x7fa4d000c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:51.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.936+0000 7fa4dcff9700 1 -- 172.21.15.156:0/1568946081 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d00074e0 con 0x7fa4e0098410 2023-09-30T22:20:51.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.936+0000 7fa4dcff9700 1 -- 172.21.15.156:0/1568946081 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d0007640 con 0x7fa4e0098410 2023-09-30T22:20:51.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.936+0000 7fa4e6415700 1 -- 172.21.15.156:0/1568946081 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e0070880 con 0x7fa4e0098410 2023-09-30T22:20:51.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.936+0000 7fa4dcff9700 1 -- 172.21.15.156:0/1568946081 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0005a70 con 0x7fa4e0098410 2023-09-30T22:20:51.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.936+0000 7fa4e6415700 1 -- 172.21.15.156:0/1568946081 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e01271d0 con 0x7fa4e0098410 2023-09-30T22:20:51.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.937+0000 7fa4dcff9700 1 -- 172.21.15.156:0/1568946081 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa4d0005bd0 con 0x7fa4e0098410 2023-09-30T22:20:51.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.937+0000 7fa4dcff9700 1 -- 172.21.15.156:0/1568946081 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa4d003eb00 con 0x7fa4e0098410 2023-09-30T22:20:51.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.938+0000 7fa4e6415700 1 -- 172.21.15.156:0/1568946081 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e004f2a0 con 0x7fa4e0098410 2023-09-30T22:20:51.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.942+0000 7fa4dcff9700 1 -- 172.21.15.156:0/1568946081 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4d0017020 con 0x7fa4e0098410 2023-09-30T22:20:51.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.966+0000 7f25b9c87700 1 Processor -- start 2023-09-30T22:20:51.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.966+0000 7f25b9c87700 1 -- start start 2023-09-30T22:20:51.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.966+0000 7f25b9c87700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25b40a0a30 0x7f25b40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:51.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.966+0000 7f25b9c87700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25b4130670 0x7f25b41381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:51.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.966+0000 7f25b9c87700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b40a1e70 con 0x7f25b40a1340 2023-09-30T22:20:51.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.966+0000 7f25b9c87700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b409a720 con 0x7f25b4130670 2023-09-30T22:20:51.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.966+0000 7f25b9c87700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25b409b300 con 0x7f25b40a0a30 2023-09-30T22:20:51.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.966+0000 7f25b2ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f25b40a1340 0x7f25b412ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:46048/0 (socket says 172.21.15.156:46048) 2023-09-30T22:20:51.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.966+0000 7f25b2ffd700 1 -- 172.21.15.156:0/3999038769 learned_addr learned my addr 172.21.15.156:0/3999038769 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:51.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.967+0000 7f25b3fff700 1 --2- 172.21.15.156:0/3999038769 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25b4130670 0x7f25b41381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:51.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.967+0000 7f25b37fe700 1 --2- 172.21.15.156:0/3999038769 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25b40a0a30 0x7f25b40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:51.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.967+0000 7f25b27fc700 1 -- 172.21.15.156:0/3999038769 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 444979250 0 0) 0x7f25b40a1e70 con 0x7f25b40a1340 2023-09-30T22:20:51.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.967+0000 7f25b27fc700 1 -- 172.21.15.156:0/3999038769 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f259c0035b0 con 0x7f25b40a1340 2023-09-30T22:20:51.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.967+0000 7f25b3fff700 1 -- 172.21.15.156:0/3999038769 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25b40a0a30 msgr2=0x7f25b40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:51.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.967+0000 7f25b3fff700 1 --2- 172.21.15.156:0/3999038769 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25b40a0a30 0x7f25b40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:51.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.967+0000 7f25b3fff700 1 -- 172.21.15.156:0/3999038769 >> v1:172.21.15.156:6789/0 conn(0x7f25b40a1340 legacy=0x7f25b412ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:51.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.967+0000 7f25b3fff700 1 -- 172.21.15.156:0/3999038769 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b409abc0 con 0x7f25b4130670 2023-09-30T22:20:51.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.967+0000 7f25b37fe700 1 --2- 172.21.15.156:0/3999038769 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25b40a0a30 0x7f25b40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:51.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.967+0000 7f25b3fff700 1 --2- 172.21.15.156:0/3999038769 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25b4130670 0x7f25b41381c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f25ac009dc0 tx=0x7f25ac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f38071351d12a43a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:51.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.967+0000 7f25b27fc700 1 -- 172.21.15.156:0/3999038769 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac00e070 con 0x7f25b4130670 2023-09-30T22:20:51.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.967+0000 7f25b27fc700 1 -- 172.21.15.156:0/3999038769 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ac00bb20 con 0x7f25b4130670 2023-09-30T22:20:51.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.967+0000 7f25b27fc700 1 -- 172.21.15.156:0/3999038769 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac012430 con 0x7f25b4130670 2023-09-30T22:20:51.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.968+0000 7f25b9c87700 1 -- 172.21.15.156:0/3999038769 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25b4130670 msgr2=0x7f25b41381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:51.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.968+0000 7f25b9c87700 1 --2- 172.21.15.156:0/3999038769 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25b4130670 0x7f25b41381c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f25ac009dc0 tx=0x7f25ac00b330 comp rx=0 tx=0).stop 2023-09-30T22:20:51.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.968+0000 7f25b9c87700 1 -- 172.21.15.156:0/3999038769 shutdown_connections 2023-09-30T22:20:51.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.968+0000 7f25b9c87700 1 --2- 172.21.15.156:0/3999038769 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25b4130670 0x7f25b41381c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:51.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.968+0000 7f25b9c87700 1 --2- 172.21.15.156:0/3999038769 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25b40a0a30 0x7f25b40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:51.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.968+0000 7f25b9c87700 1 -- 172.21.15.156:0/3999038769 >> 172.21.15.156:0/3999038769 conn(0x7f25b40a2980 msgr2=0x7f25b40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:51.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.968+0000 7f25b9c87700 1 -- 172.21.15.156:0/3999038769 shutdown_connections 2023-09-30T22:20:51.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.968+0000 7f25b9c87700 1 -- 172.21.15.156:0/3999038769 wait complete. 2023-09-30T22:20:51.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.969+0000 7f25b9c87700 1 Processor -- start 2023-09-30T22:20:51.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.969+0000 7f25b9c87700 1 -- start start 2023-09-30T22:20:51.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.970+0000 7f25b9c87700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25b40a0a30 0x7f25b409eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:51.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.970+0000 7f25b9c87700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25b40a1340 0x7f25b409f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:51.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.970+0000 7f25b9c87700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25b4130670 0x7f25b41c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:51.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.970+0000 7f25b9c87700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b406fb80 con 0x7f25b40a0a30 2023-09-30T22:20:51.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.970+0000 7f25b9c87700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b412fc80 con 0x7f25b4130670 2023-09-30T22:20:51.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.970+0000 7f25b9c87700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25b409e580 con 0x7f25b40a1340 2023-09-30T22:20:51.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.970+0000 7f25b2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25b40a1340 0x7f25b409f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:51.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.970+0000 7f25b2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25b40a1340 0x7f25b409f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54562/0 (socket says 172.21.15.156:54562) 2023-09-30T22:20:51.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.970+0000 7f25b2ffd700 1 -- 172.21.15.156:0/1148734712 learned_addr learned my addr 172.21.15.156:0/1148734712 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:51.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.970+0000 7f25b3fff700 1 --2- 172.21.15.156:0/1148734712 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25b4130670 0x7f25b41c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:51.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.970+0000 7f25b37fe700 1 --2- 172.21.15.156:0/1148734712 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25b40a0a30 0x7f25b409eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:51.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.970+0000 7f25b2ffd700 1 -- 172.21.15.156:0/1148734712 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25b4130670 msgr2=0x7f25b41c8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:51.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.970+0000 7f25b2ffd700 1 --2- 172.21.15.156:0/1148734712 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25b4130670 0x7f25b41c8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:51.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.970+0000 7f25b2ffd700 1 -- 172.21.15.156:0/1148734712 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25b40a0a30 msgr2=0x7f25b409eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:51.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.970+0000 7f25b2ffd700 1 --2- 172.21.15.156:0/1148734712 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25b40a0a30 0x7f25b409eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:51.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.971+0000 7f25b2ffd700 1 -- 172.21.15.156:0/1148734712 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a4009430 con 0x7f25b40a1340 2023-09-30T22:20:51.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.971+0000 7f25b2ffd700 1 --2- 172.21.15.156:0/1148734712 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25b40a1340 0x7f25b409f0d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f25a8005910 tx=0x7f25a800c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:51.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.971+0000 7f259bfff700 1 -- 172.21.15.156:0/1148734712 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a8005d70 con 0x7f25b40a1340 2023-09-30T22:20:51.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.971+0000 7f259bfff700 1 -- 172.21.15.156:0/1148734712 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a80070d0 con 0x7f25b40a1340 2023-09-30T22:20:51.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.971+0000 7f25b9c87700 1 -- 172.21.15.156:0/1148734712 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25ac009a70 con 0x7f25b40a1340 2023-09-30T22:20:51.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.971+0000 7f259bfff700 1 -- 172.21.15.156:0/1148734712 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a8007440 con 0x7f25b40a1340 2023-09-30T22:20:51.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.971+0000 7f25b9c87700 1 -- 172.21.15.156:0/1148734712 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b4120890 con 0x7f25b40a1340 2023-09-30T22:20:51.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.972+0000 7f259bfff700 1 -- 172.21.15.156:0/1148734712 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25a80075a0 con 0x7f25b40a1340 2023-09-30T22:20:51.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.972+0000 7f259bfff700 1 -- 172.21.15.156:0/1148734712 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f25a803eb30 con 0x7f25b40a1340 2023-09-30T22:20:51.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.972+0000 7f25b9c87700 1 -- 172.21.15.156:0/1148734712 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b4120ab0 con 0x7f25b40a1340 2023-09-30T22:20:51.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:51.977+0000 7f259bfff700 1 -- 172.21.15.156:0/1148734712 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25b4120ab0 con 0x7f25b40a1340 2023-09-30T22:20:52.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.015+0000 7f2c03594700 1 Processor -- start 2023-09-30T22:20:52.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.015+0000 7f2c03594700 1 -- start start 2023-09-30T22:20:52.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.016+0000 7f2c03594700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2bfc136960 0x7f2bfc138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:52.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.016+0000 7f2c03594700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2bfc139280 0x7f2bfc13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:52.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.016+0000 7f2c03594700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bfc06b2d0 con 0x7f2bfc133ad0 2023-09-30T22:20:52.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.016+0000 7f2c03594700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc1345b0 con 0x7f2bfc136960 2023-09-30T22:20:52.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.016+0000 7f2c03594700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc133610 con 0x7f2bfc139280 2023-09-30T22:20:52.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.016+0000 7f2c01b31700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2bfc139280 0x7f2bfc13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:52.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.016+0000 7f2c01b31700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2bfc139280 0x7f2bfc13b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54578/0 (socket says 172.21.15.156:54578) 2023-09-30T22:20:52.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.016+0000 7f2c01330700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f2bfc133ad0 0x7f2bfc133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:46058/0 (socket says 172.21.15.156:46058) 2023-09-30T22:20:52.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.016+0000 7f2c01b31700 1 -- 172.21.15.156:0/1512663464 learned_addr learned my addr 172.21.15.156:0/1512663464 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:52.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.016+0000 7f2c00b2f700 1 --2- 172.21.15.156:0/1512663464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2bfc136960 0x7f2bfc138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:52.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.016+0000 7f2c00b2f700 1 -- 172.21.15.156:0/1512663464 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2bfc139280 msgr2=0x7f2bfc13b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:52.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.016+0000 7f2c00b2f700 1 --2- 172.21.15.156:0/1512663464 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2bfc139280 0x7f2bfc13b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:52.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.016+0000 7f2c00b2f700 1 -- 172.21.15.156:0/1512663464 >> v1:172.21.15.156:6789/0 conn(0x7f2bfc133ad0 legacy=0x7f2bfc133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:52.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.016+0000 7f2c00b2f700 1 -- 172.21.15.156:0/1512663464 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bfc09a500 con 0x7f2bfc136960 2023-09-30T22:20:52.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.017+0000 7f2c00b2f700 1 --2- 172.21.15.156:0/1512663464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2bfc136960 0x7f2bfc138d40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2bec009870 tx=0x7f2bec009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64d21876274123c5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:52.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.017+0000 7f2bf3fff700 1 -- 172.21.15.156:0/1512663464 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec011830 con 0x7f2bfc136960 2023-09-30T22:20:52.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.017+0000 7f2bf3fff700 1 -- 172.21.15.156:0/1512663464 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bec011990 con 0x7f2bfc136960 2023-09-30T22:20:52.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.017+0000 7f2bf3fff700 1 -- 172.21.15.156:0/1512663464 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec011d20 con 0x7f2bfc136960 2023-09-30T22:20:52.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.017+0000 7f2c03594700 1 -- 172.21.15.156:0/1512663464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2bfc136960 msgr2=0x7f2bfc138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:52.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.017+0000 7f2c03594700 1 --2- 172.21.15.156:0/1512663464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2bfc136960 0x7f2bfc138d40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2bec009870 tx=0x7f2bec009b80 comp rx=0 tx=0).stop 2023-09-30T22:20:52.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.017+0000 7f2c03594700 1 -- 172.21.15.156:0/1512663464 shutdown_connections 2023-09-30T22:20:52.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.017+0000 7f2c03594700 1 --2- 172.21.15.156:0/1512663464 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2bfc139280 0x7f2bfc13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:52.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.017+0000 7f2c03594700 1 --2- 172.21.15.156:0/1512663464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2bfc136960 0x7f2bfc138d40 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:52.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.017+0000 7f2c03594700 1 -- 172.21.15.156:0/1512663464 >> 172.21.15.156:0/1512663464 conn(0x7f2bfc099c40 msgr2=0x7f2bfc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:52.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.018+0000 7f2c03594700 1 -- 172.21.15.156:0/1512663464 shutdown_connections 2023-09-30T22:20:52.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.018+0000 7f2c03594700 1 -- 172.21.15.156:0/1512663464 wait complete. 2023-09-30T22:20:52.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.018+0000 7f2c03594700 1 Processor -- start 2023-09-30T22:20:52.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.019+0000 7f2c03594700 1 -- start start 2023-09-30T22:20:52.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.019+0000 7f2c03594700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2bfc133ad0 0x7f2bfc071770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:52.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.019+0000 7f2c03594700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2bfc136960 0x7f2bfc071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:52.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.019+0000 7f2c03594700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2bfc139280 0x7f2bfc1c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:52.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.019+0000 7f2c03594700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc138fc0 con 0x7f2bfc133ad0 2023-09-30T22:20:52.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.019+0000 7f2c03594700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc130b00 con 0x7f2bfc136960 2023-09-30T22:20:52.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.019+0000 7f2c03594700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc06eec0 con 0x7f2bfc139280 2023-09-30T22:20:52.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.019+0000 7f2c01330700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2bfc133ad0 0x7f2bfc071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:52.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.019+0000 7f2c01330700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2bfc133ad0 0x7f2bfc071770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60360/0 (socket says 172.21.15.156:60360) 2023-09-30T22:20:52.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.019+0000 7f2c01330700 1 -- 172.21.15.156:0/4261512305 learned_addr learned my addr 172.21.15.156:0/4261512305 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:52.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.019+0000 7f2c01b31700 1 --2- 172.21.15.156:0/4261512305 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2bfc139280 0x7f2bfc1c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:52.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.019+0000 7f2c00b2f700 1 --2- 172.21.15.156:0/4261512305 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2bfc136960 0x7f2bfc071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:52.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.019+0000 7f2c01330700 1 -- 172.21.15.156:0/4261512305 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2bfc139280 msgr2=0x7f2bfc1c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:52.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.020+0000 7f2c01330700 1 --2- 172.21.15.156:0/4261512305 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2bfc139280 0x7f2bfc1c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:52.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.020+0000 7f2c01330700 1 -- 172.21.15.156:0/4261512305 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2bfc136960 msgr2=0x7f2bfc071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:52.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.020+0000 7f2c01330700 1 --2- 172.21.15.156:0/4261512305 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2bfc136960 0x7f2bfc071cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:52.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.020+0000 7f2c01330700 1 -- 172.21.15.156:0/4261512305 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bec0094a0 con 0x7f2bfc133ad0 2023-09-30T22:20:52.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.020+0000 7f2c01330700 1 --2- 172.21.15.156:0/4261512305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2bfc133ad0 0x7f2bfc071770 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2bf800c500 tx=0x7f2bf800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:52.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.020+0000 7f2bf1ffb700 1 -- 172.21.15.156:0/4261512305 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf8005cb0 con 0x7f2bfc133ad0 2023-09-30T22:20:52.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.020+0000 7f2bf1ffb700 1 -- 172.21.15.156:0/4261512305 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf8005e10 con 0x7f2bfc133ad0 2023-09-30T22:20:52.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.020+0000 7f2c03594700 1 -- 172.21.15.156:0/4261512305 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bfc070300 con 0x7f2bfc133ad0 2023-09-30T22:20:52.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.020+0000 7f2bf1ffb700 1 -- 172.21.15.156:0/4261512305 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf80072d0 con 0x7f2bfc133ad0 2023-09-30T22:20:52.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.020+0000 7f2c03594700 1 -- 172.21.15.156:0/4261512305 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bfc070d70 con 0x7f2bfc133ad0 2023-09-30T22:20:52.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.021+0000 7f2bf1ffb700 1 -- 172.21.15.156:0/4261512305 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2bf8007430 con 0x7f2bfc133ad0 2023-09-30T22:20:52.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.021+0000 7f2bf1ffb700 1 -- 172.21.15.156:0/4261512305 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2bf803ea20 con 0x7f2bfc133ad0 2023-09-30T22:20:52.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.021+0000 7f2c03594700 1 -- 172.21.15.156:0/4261512305 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bfc070140 con 0x7f2bfc133ad0 2023-09-30T22:20:52.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.030+0000 7f2bf1ffb700 1 -- 172.21.15.156:0/4261512305 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2bf8017020 con 0x7f2bfc133ad0 2023-09-30T22:20:52.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.113+0000 7f14dd502700 1 -- 172.21.15.156:0/2608239910 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f14b8005590 con 0x7f14d8131980 2023-09-30T22:20:52.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.113+0000 7f14bf7fe700 1 -- 172.21.15.156:0/2608239910 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f14c8017070 con 0x7f14d8131980 2023-09-30T22:20:52.114 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:52.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.115+0000 7f14dd502700 1 -- 172.21.15.156:0/2608239910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14d8131980 msgr2=0x7f14d812c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:52.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.115+0000 7f14dd502700 1 --2- 172.21.15.156:0/2608239910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14d8131980 0x7f14d812c890 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f14c800c550 tx=0x7f14c800c860 comp rx=0 tx=0).stop 2023-09-30T22:20:52.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.115+0000 7f14dd502700 1 -- 172.21.15.156:0/2608239910 shutdown_connections 2023-09-30T22:20:52.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.115+0000 7f14dd502700 1 --2- 172.21.15.156:0/2608239910 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f14d8137000 0x7f14d812d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:52.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.115+0000 7f14dd502700 1 --2- 172.21.15.156:0/2608239910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14d8131980 0x7f14d812c890 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:52.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.115+0000 7f14dd502700 1 --2- 172.21.15.156:0/2608239910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14d81346e0 0x7f14d812cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:52.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.115+0000 7f14dd502700 1 -- 172.21.15.156:0/2608239910 >> 172.21.15.156:0/2608239910 conn(0x7f14d80a2980 msgr2=0x7f14d8133560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:52.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.115+0000 7f14dd502700 1 -- 172.21.15.156:0/2608239910 shutdown_connections 2023-09-30T22:20:52.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.115+0000 7f14dd502700 1 -- 172.21.15.156:0/2608239910 wait complete. 2023-09-30T22:20:52.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:52.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.180+0000 7fa4e6415700 1 -- 172.21.15.156:0/1568946081 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa4e01277d0 con 0x7fa4e0098410 2023-09-30T22:20:52.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.180+0000 7fa4dcff9700 1 -- 172.21.15.156:0/1568946081 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa4d001b3b0 con 0x7fa4e0098410 2023-09-30T22:20:52.181 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:52.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.182+0000 7fa4e6415700 1 -- 172.21.15.156:0/1568946081 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4e0098410 msgr2=0x7fa4e0099540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:52.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.182+0000 7fa4e6415700 1 --2- 172.21.15.156:0/1568946081 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4e0098410 0x7fa4e0099540 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000c6d0 tx=0x7fa4d000c9e0 comp rx=0 tx=0).stop 2023-09-30T22:20:52.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.182+0000 7fa4e6415700 1 -- 172.21.15.156:0/1568946081 shutdown_connections 2023-09-30T22:20:52.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.182+0000 7fa4e6415700 1 --2- 172.21.15.156:0/1568946081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4e01370d0 0x7fa4e0099fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:52.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.182+0000 7fa4e6415700 1 --2- 172.21.15.156:0/1568946081 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4e0098410 0x7fa4e0099540 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:52.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.182+0000 7fa4e6415700 1 --2- 172.21.15.156:0/1568946081 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4e01347b0 0x7fa4e0099a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:52.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.182+0000 7fa4e6415700 1 -- 172.21.15.156:0/1568946081 >> 172.21.15.156:0/1568946081 conn(0x7fa4e00a2b30 msgr2=0x7fa4e009c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:52.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.182+0000 7fa4e6415700 1 -- 172.21.15.156:0/1568946081 shutdown_connections 2023-09-30T22:20:52.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.182+0000 7fa4e6415700 1 -- 172.21.15.156:0/1568946081 wait complete. 2023-09-30T22:20:52.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.189+0000 7f25b9c87700 1 -- 172.21.15.156:0/1148734712 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f25b4120ab0 con 0x7f25b40a1340 2023-09-30T22:20:52.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.190+0000 7f259bfff700 1 -- 172.21.15.156:0/1148734712 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25b4120ab0 con 0x7f25b40a1340 2023-09-30T22:20:52.191 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:52.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.192+0000 7f25b9c87700 1 -- 172.21.15.156:0/1148734712 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25b40a1340 msgr2=0x7f25b409f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:52.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.192+0000 7f25b9c87700 1 --2- 172.21.15.156:0/1148734712 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25b40a1340 0x7f25b409f0d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f25a8005910 tx=0x7f25a800c9e0 comp rx=0 tx=0).stop 2023-09-30T22:20:52.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.192+0000 7f25b9c87700 1 -- 172.21.15.156:0/1148734712 shutdown_connections 2023-09-30T22:20:52.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.192+0000 7f25b9c87700 1 --2- 172.21.15.156:0/1148734712 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25b4130670 0x7f25b41c8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:52.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.192+0000 7f25b9c87700 1 --2- 172.21.15.156:0/1148734712 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25b40a0a30 0x7f25b409eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:52.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.192+0000 7f25b9c87700 1 --2- 172.21.15.156:0/1148734712 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25b40a1340 0x7f25b409f0d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:52.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.192+0000 7f25b9c87700 1 -- 172.21.15.156:0/1148734712 >> 172.21.15.156:0/1148734712 conn(0x7f25b40a2980 msgr2=0x7f25b41b98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:52.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.192+0000 7f25b9c87700 1 -- 172.21.15.156:0/1148734712 shutdown_connections 2023-09-30T22:20:52.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.192+0000 7f25b9c87700 1 -- 172.21.15.156:0/1148734712 wait complete. 2023-09-30T22:20:52.195 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:52.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:52.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.256+0000 7f2c03594700 1 -- 172.21.15.156:0/4261512305 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2bfc06ffa0 con 0x7f2bfc133ad0 2023-09-30T22:20:52.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.257+0000 7f2bf1ffb700 1 -- 172.21.15.156:0/4261512305 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2bfc06ffa0 con 0x7f2bfc133ad0 2023-09-30T22:20:52.258 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:52.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.259+0000 7f2c03594700 1 -- 172.21.15.156:0/4261512305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2bfc133ad0 msgr2=0x7f2bfc071770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:52.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.259+0000 7f2c03594700 1 --2- 172.21.15.156:0/4261512305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2bfc133ad0 0x7f2bfc071770 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2bf800c500 tx=0x7f2bf800c810 comp rx=0 tx=0).stop 2023-09-30T22:20:52.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.259+0000 7f2c03594700 1 -- 172.21.15.156:0/4261512305 shutdown_connections 2023-09-30T22:20:52.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.259+0000 7f2c03594700 1 --2- 172.21.15.156:0/4261512305 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2bfc139280 0x7f2bfc1c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:52.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.259+0000 7f2c03594700 1 --2- 172.21.15.156:0/4261512305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2bfc133ad0 0x7f2bfc071770 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:52.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.259+0000 7f2c03594700 1 --2- 172.21.15.156:0/4261512305 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2bfc136960 0x7f2bfc071cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:52.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.259+0000 7f2c03594700 1 -- 172.21.15.156:0/4261512305 >> 172.21.15.156:0/4261512305 conn(0x7f2bfc099c40 msgr2=0x7f2bfc134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:52.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.259+0000 7f2c03594700 1 -- 172.21.15.156:0/4261512305 shutdown_connections 2023-09-30T22:20:52.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:52.259+0000 7f2c03594700 1 -- 172.21.15.156:0/4261512305 wait complete. 2023-09-30T22:20:52.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:53.136 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:53.196 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:53.206 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:53.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.270+0000 7f0a6ad3f700 1 Processor -- start 2023-09-30T22:20:53.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.270+0000 7f0a6ad3f700 1 -- start start 2023-09-30T22:20:53.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.271+0000 7f0a6ad3f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a64133ad0 0x7f0a64133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:53.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.271+0000 7f0a6ad3f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0a641300a0 0x7f0a641304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:53.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.271+0000 7f0a6ad3f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a6406b2d0 con 0x7f0a641309f0 2023-09-30T22:20:53.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.271+0000 7f0a6ad3f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a64133610 con 0x7f0a641300a0 2023-09-30T22:20:53.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.271+0000 7f0a6ad3f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6409a500 con 0x7f0a64133ad0 2023-09-30T22:20:53.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.271+0000 7f0a63fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0a641300a0 0x7f0a641304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:53.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.271+0000 7f0a68adb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a64133ad0 0x7f0a64133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:53.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.271+0000 7f0a692dc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f0a641309f0 0x7f0a6413a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:46060/0 (socket says 172.21.15.156:46060) 2023-09-30T22:20:53.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.271+0000 7f0a692dc700 1 -- 172.21.15.156:0/580375626 learned_addr learned my addr 172.21.15.156:0/580375626 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:53.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.271+0000 7f0a637fe700 1 -- 172.21.15.156:0/580375626 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059132124 0 0) 0x7f0a6406b2d0 con 0x7f0a641309f0 2023-09-30T22:20:53.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.271+0000 7f0a637fe700 1 -- 172.21.15.156:0/580375626 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a540035b0 con 0x7f0a641309f0 2023-09-30T22:20:53.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.271+0000 7f0a63fff700 1 -- 172.21.15.156:0/580375626 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a64133ad0 msgr2=0x7f0a64133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:53.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.271+0000 7f0a63fff700 1 --2- 172.21.15.156:0/580375626 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a64133ad0 0x7f0a64133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.271+0000 7f0a63fff700 1 -- 172.21.15.156:0/580375626 >> v1:172.21.15.156:6789/0 conn(0x7f0a641309f0 legacy=0x7f0a6413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:53.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.271+0000 7f0a63fff700 1 -- 172.21.15.156:0/580375626 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a641338b0 con 0x7f0a641300a0 2023-09-30T22:20:53.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.271+0000 7f0a68adb700 1 --2- 172.21.15.156:0/580375626 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a64133ad0 0x7f0a64133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:53.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.272+0000 7f0a63fff700 1 --2- 172.21.15.156:0/580375626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a641300a0 0x7f0a641304b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009840 tx=0x7f0a50009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fea69db2df05b87 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:53.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.272+0000 7f0a637fe700 1 -- 172.21.15.156:0/580375626 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a50011830 con 0x7f0a641300a0 2023-09-30T22:20:53.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.272+0000 7f0a637fe700 1 -- 172.21.15.156:0/580375626 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a50011990 con 0x7f0a641300a0 2023-09-30T22:20:53.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.272+0000 7f0a637fe700 1 -- 172.21.15.156:0/580375626 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a50011d20 con 0x7f0a641300a0 2023-09-30T22:20:53.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.273+0000 7f0a6ad3f700 1 -- 172.21.15.156:0/580375626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a641300a0 msgr2=0x7f0a641304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:53.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.273+0000 7f0a6ad3f700 1 --2- 172.21.15.156:0/580375626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a641300a0 0x7f0a641304b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009840 tx=0x7f0a50009b50 comp rx=0 tx=0).stop 2023-09-30T22:20:53.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.273+0000 7f0a6ad3f700 1 -- 172.21.15.156:0/580375626 shutdown_connections 2023-09-30T22:20:53.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.273+0000 7f0a6ad3f700 1 --2- 172.21.15.156:0/580375626 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a64133ad0 0x7f0a64133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.273+0000 7f0a6ad3f700 1 --2- 172.21.15.156:0/580375626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a641300a0 0x7f0a641304b0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.273+0000 7f0a6ad3f700 1 -- 172.21.15.156:0/580375626 >> 172.21.15.156:0/580375626 conn(0x7f0a64099c40 msgr2=0x7f0a640a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:53.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.273+0000 7f0a6ad3f700 1 -- 172.21.15.156:0/580375626 shutdown_connections 2023-09-30T22:20:53.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.273+0000 7f0a6ad3f700 1 -- 172.21.15.156:0/580375626 wait complete. 2023-09-30T22:20:53.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.274+0000 7f0a6ad3f700 1 Processor -- start 2023-09-30T22:20:53.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.274+0000 7f0a6ad3f700 1 -- start start 2023-09-30T22:20:53.281 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:53.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.274+0000 7f0a6ad3f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a641300a0 0x7f0a640712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:53.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.274+0000 7f0a6ad3f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a641309f0 0x7f0a64071810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:53.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.274+0000 7f0a6ad3f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a64133ad0 0x7f0a64071d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:53.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.274+0000 7f0a6ad3f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6411fc20 con 0x7f0a641309f0 2023-09-30T22:20:53.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.274+0000 7f0a6ad3f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a64120370 con 0x7f0a64133ad0 2023-09-30T22:20:53.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.274+0000 7f0a6ad3f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6412dd00 con 0x7f0a641300a0 2023-09-30T22:20:53.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.275+0000 7f0a68adb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a641300a0 0x7f0a640712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:53.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.275+0000 7f0a63fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a641309f0 0x7f0a64071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:53.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.275+0000 7f0a68adb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a641300a0 0x7f0a640712d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54610/0 (socket says 172.21.15.156:54610) 2023-09-30T22:20:53.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.275+0000 7f0a68adb700 1 -- 172.21.15.156:0/214420866 learned_addr learned my addr 172.21.15.156:0/214420866 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:53.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.275+0000 7f0a692dc700 1 --2- 172.21.15.156:0/214420866 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a64133ad0 0x7f0a64071d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:53.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.275+0000 7f0a692dc700 1 -- 172.21.15.156:0/214420866 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a641300a0 msgr2=0x7f0a640712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:53.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.275+0000 7f0a692dc700 1 --2- 172.21.15.156:0/214420866 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a641300a0 0x7f0a640712d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.275+0000 7f0a692dc700 1 -- 172.21.15.156:0/214420866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a641309f0 msgr2=0x7f0a64071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:53.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.275+0000 7f0a692dc700 1 --2- 172.21.15.156:0/214420866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a641309f0 0x7f0a64071810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.275+0000 7f0a692dc700 1 -- 172.21.15.156:0/214420866 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a580094a0 con 0x7f0a64133ad0 2023-09-30T22:20:53.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.275+0000 7f0a68adb700 1 --2- 172.21.15.156:0/214420866 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a641300a0 0x7f0a640712d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:53.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.275+0000 7f0a63fff700 1 --2- 172.21.15.156:0/214420866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a641309f0 0x7f0a64071810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:53.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.275+0000 7f0a692dc700 1 --2- 172.21.15.156:0/214420866 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a64133ad0 0x7f0a64071d50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00ca80 tx=0x7f0a5c00cd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:53.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.275+0000 7f0a617fa700 1 -- 172.21.15.156:0/214420866 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c00a9e0 con 0x7f0a64133ad0 2023-09-30T22:20:53.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.275+0000 7f0a617fa700 1 -- 172.21.15.156:0/214420866 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5c00ab40 con 0x7f0a64133ad0 2023-09-30T22:20:53.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.275+0000 7f0a6ad3f700 1 -- 172.21.15.156:0/214420866 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a500094a0 con 0x7f0a64133ad0 2023-09-30T22:20:53.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.275+0000 7f0a617fa700 1 -- 172.21.15.156:0/214420866 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c012400 con 0x7f0a64133ad0 2023-09-30T22:20:53.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.275+0000 7f0a6ad3f700 1 -- 172.21.15.156:0/214420866 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a640a3450 con 0x7f0a64133ad0 2023-09-30T22:20:53.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.276+0000 7f0a617fa700 1 -- 172.21.15.156:0/214420866 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0a5c01b3b0 con 0x7f0a64133ad0 2023-09-30T22:20:53.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.276+0000 7f0a617fa700 1 -- 172.21.15.156:0/214420866 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0a5c03f250 con 0x7f0a64133ad0 2023-09-30T22:20:53.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.277+0000 7f0a6ad3f700 1 -- 172.21.15.156:0/214420866 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a640a2620 con 0x7f0a64133ad0 2023-09-30T22:20:53.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.282+0000 7f0a617fa700 1 -- 172.21.15.156:0/214420866 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0a5c017080 con 0x7f0a64133ad0 2023-09-30T22:20:53.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.334+0000 7f3c4c153700 1 Processor -- start 2023-09-30T22:20:53.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.334+0000 7f3c4c153700 1 -- start start 2023-09-30T22:20:53.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.335+0000 7f3c4c153700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3c4406a770 0x7f3c441349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:53.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.335+0000 7f3c4c153700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3c4409e070 0x7f3c4413fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:53.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.335+0000 7f3c4c153700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4409eca0 con 0x7f3c44134f00 2023-09-30T22:20:53.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.335+0000 7f3c4c153700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c4409f720 con 0x7f3c4409e070 2023-09-30T22:20:53.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.335+0000 7f3c4c153700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4406b480 con 0x7f3c4406a770 2023-09-30T22:20:53.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.335+0000 7f3c4a6f0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3c4409e070 0x7f3c4413fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:53.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.335+0000 7f3c49eef700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3c4406a770 0x7f3c441349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:53.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.335+0000 7f3c4a6f0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3c4409e070 0x7f3c4413fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60382/0 (socket says 172.21.15.156:60382) 2023-09-30T22:20:53.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.335+0000 7f3c4a6f0700 1 -- 172.21.15.156:0/1858131930 learned_addr learned my addr 172.21.15.156:0/1858131930 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:53.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.335+0000 7f3c4a6f0700 1 -- 172.21.15.156:0/1858131930 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3c4406a770 msgr2=0x7f3c441349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:53.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.335+0000 7f3c4a6f0700 1 --2- 172.21.15.156:0/1858131930 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3c4406a770 0x7f3c441349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.335+0000 7f3c4a6f0700 1 -- 172.21.15.156:0/1858131930 >> v1:172.21.15.156:6789/0 conn(0x7f3c44134f00 legacy=0x7f3c4409d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:53.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.335+0000 7f3c4a6f0700 1 -- 172.21.15.156:0/1858131930 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c441352d0 con 0x7f3c4409e070 2023-09-30T22:20:53.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.335+0000 7f3c4a6f0700 1 --2- 172.21.15.156:0/1858131930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c4409e070 0x7f3c4413fcf0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009e50 tx=0x7f3c3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ff8f992c5dd7c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:53.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.336+0000 7f3c48eed700 1 -- 172.21.15.156:0/1858131930 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c00e070 con 0x7f3c4409e070 2023-09-30T22:20:53.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.336+0000 7f3c48eed700 1 -- 172.21.15.156:0/1858131930 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c00b910 con 0x7f3c4409e070 2023-09-30T22:20:53.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.336+0000 7f3c48eed700 1 -- 172.21.15.156:0/1858131930 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c00bcc0 con 0x7f3c4409e070 2023-09-30T22:20:53.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.336+0000 7f3c4c153700 1 -- 172.21.15.156:0/1858131930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c4409e070 msgr2=0x7f3c4413fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:53.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.336+0000 7f3c4c153700 1 --2- 172.21.15.156:0/1858131930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c4409e070 0x7f3c4413fcf0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009e50 tx=0x7f3c3c00b330 comp rx=0 tx=0).stop 2023-09-30T22:20:53.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.336+0000 7f3c4c153700 1 -- 172.21.15.156:0/1858131930 shutdown_connections 2023-09-30T22:20:53.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.336+0000 7f3c4c153700 1 --2- 172.21.15.156:0/1858131930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c4409e070 0x7f3c4413fcf0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.336+0000 7f3c4c153700 1 --2- 172.21.15.156:0/1858131930 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3c4406a770 0x7f3c441349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.336+0000 7f3c4c153700 1 -- 172.21.15.156:0/1858131930 >> 172.21.15.156:0/1858131930 conn(0x7f3c44099c40 msgr2=0x7f3c440a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:53.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.337+0000 7f3c4c153700 1 -- 172.21.15.156:0/1858131930 shutdown_connections 2023-09-30T22:20:53.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.337+0000 7f3c4c153700 1 -- 172.21.15.156:0/1858131930 wait complete. 2023-09-30T22:20:53.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.338+0000 7f3c4c153700 1 Processor -- start 2023-09-30T22:20:53.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.338+0000 7f3c4c153700 1 -- start start 2023-09-30T22:20:53.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.338+0000 7f3c4c153700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3c4406a770 0x7f3c4406fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:53.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.338+0000 7f3c4c153700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3c4409e070 0x7f3c440700f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:53.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.338+0000 7f3c4c153700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c44134f00 0x7f3c44070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:53.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.338+0000 7f3c4c153700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c44126a20 con 0x7f3c44134f00 2023-09-30T22:20:53.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.338+0000 7f3c4c153700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c44126e50 con 0x7f3c4409e070 2023-09-30T22:20:53.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.338+0000 7f3c4c153700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c44071110 con 0x7f3c4406a770 2023-09-30T22:20:53.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.338+0000 7f3c4a6f0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c44134f00 0x7f3c44070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:53.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.338+0000 7f3c4a6f0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c44134f00 0x7f3c44070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60390/0 (socket says 172.21.15.156:60390) 2023-09-30T22:20:53.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.338+0000 7f3c4a6f0700 1 -- 172.21.15.156:0/2346073725 learned_addr learned my addr 172.21.15.156:0/2346073725 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:53.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.338+0000 7f3c496ee700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3c4409e070 0x7f3c440700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:53.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.338+0000 7f3c4a6f0700 1 -- 172.21.15.156:0/2346073725 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3c4406a770 msgr2=0x7f3c4406fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:53.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.338+0000 7f3c4a6f0700 1 --2- 172.21.15.156:0/2346073725 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3c4406a770 0x7f3c4406fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.339+0000 7f3c4a6f0700 1 -- 172.21.15.156:0/2346073725 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3c4409e070 msgr2=0x7f3c440700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:53.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.339+0000 7f3c4a6f0700 1 --2- 172.21.15.156:0/2346073725 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3c4409e070 0x7f3c440700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.339+0000 7f3c4a6f0700 1 -- 172.21.15.156:0/2346073725 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c009b30 con 0x7f3c44134f00 2023-09-30T22:20:53.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.339+0000 7f3c4a6f0700 1 --2- 172.21.15.156:0/2346073725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c44134f00 0x7f3c44070630 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00b680 tx=0x7f3c3c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:53.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.339+0000 7f3c3a7fc700 1 -- 172.21.15.156:0/2346073725 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0046d0 con 0x7f3c44134f00 2023-09-30T22:20:53.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.339+0000 7f3c3a7fc700 1 -- 172.21.15.156:0/2346073725 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c004830 con 0x7f3c44134f00 2023-09-30T22:20:53.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.339+0000 7f3c4c153700 1 -- 172.21.15.156:0/2346073725 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c441273a0 con 0x7f3c44134f00 2023-09-30T22:20:53.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.339+0000 7f3c3a7fc700 1 -- 172.21.15.156:0/2346073725 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c01c680 con 0x7f3c44134f00 2023-09-30T22:20:53.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.339+0000 7f3c4c153700 1 -- 172.21.15.156:0/2346073725 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4409f220 con 0x7f3c44134f00 2023-09-30T22:20:53.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.340+0000 7f3c27fff700 1 -- 172.21.15.156:0/2346073725 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c200052e0 con 0x7f3c44134f00 2023-09-30T22:20:53.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.341+0000 7f3c3a7fc700 1 -- 172.21.15.156:0/2346073725 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3c3c01c7e0 con 0x7f3c44134f00 2023-09-30T22:20:53.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.341+0000 7f3c3a7fc700 1 -- 172.21.15.156:0/2346073725 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3c3c041220 con 0x7f3c44134f00 2023-09-30T22:20:53.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.346+0000 7f3c3a7fc700 1 -- 172.21.15.156:0/2346073725 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3c3c025450 con 0x7f3c44134f00 2023-09-30T22:20:53.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.383+0000 7f97bd01c700 1 Processor -- start 2023-09-30T22:20:53.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.383+0000 7f97bd01c700 1 -- start start 2023-09-30T22:20:53.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.384+0000 7f97bd01c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97b809d860 0x7f97b809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:53.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.384+0000 7f97bd01c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97b809e170 0x7f97b81307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:53.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.384+0000 7f97bd01c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b809aaa0 con 0x7f97b8130ce0 2023-09-30T22:20:53.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.384+0000 7f97bd01c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b809f870 con 0x7f97b809e170 2023-09-30T22:20:53.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.384+0000 7f97bd01c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97b809b360 con 0x7f97b809d860 2023-09-30T22:20:53.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.384+0000 7f97b659c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97b809e170 0x7f97b81307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:53.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.384+0000 7f97b659c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97b809e170 0x7f97b81307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:36196/0 (socket says 172.21.15.156:36196) 2023-09-30T22:20:53.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.384+0000 7f97b659c700 1 -- 172.21.15.156:0/3736589564 learned_addr learned my addr 172.21.15.156:0/3736589564 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:53.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.384+0000 7f97b6d9d700 1 --2- 172.21.15.156:0/3736589564 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97b809d860 0x7f97b809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:53.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.385+0000 7f97b659c700 1 -- 172.21.15.156:0/3736589564 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97b809d860 msgr2=0x7f97b809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:53.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.385+0000 7f97b659c700 1 --2- 172.21.15.156:0/3736589564 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97b809d860 0x7f97b809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.385+0000 7f97b659c700 1 -- 172.21.15.156:0/3736589564 >> v1:172.21.15.156:6789/0 conn(0x7f97b8130ce0 legacy=0x7f97b81379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:53.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.385+0000 7f97b659c700 1 -- 172.21.15.156:0/3736589564 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b809b620 con 0x7f97b809e170 2023-09-30T22:20:53.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.385+0000 7f97b6d9d700 1 --2- 172.21.15.156:0/3736589564 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97b809d860 0x7f97b809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:53.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.385+0000 7f97b659c700 1 --2- 172.21.15.156:0/3736589564 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97b809e170 0x7f97b81307a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f97ac009920 tx=0x7f97ac009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75a9cc7766b801fb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:53.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.385+0000 7f97b5d9b700 1 -- 172.21.15.156:0/3736589564 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac00f8a0 con 0x7f97b809e170 2023-09-30T22:20:53.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.385+0000 7f97b5d9b700 1 -- 172.21.15.156:0/3736589564 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ac00fa00 con 0x7f97b809e170 2023-09-30T22:20:53.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.385+0000 7f97b5d9b700 1 -- 172.21.15.156:0/3736589564 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac00fd90 con 0x7f97b809e170 2023-09-30T22:20:53.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.386+0000 7f97bd01c700 1 -- 172.21.15.156:0/3736589564 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97b809e170 msgr2=0x7f97b81307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:53.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.386+0000 7f97bd01c700 1 --2- 172.21.15.156:0/3736589564 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97b809e170 0x7f97b81307a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f97ac009920 tx=0x7f97ac009c30 comp rx=0 tx=0).stop 2023-09-30T22:20:53.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.386+0000 7f97bd01c700 1 -- 172.21.15.156:0/3736589564 shutdown_connections 2023-09-30T22:20:53.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.386+0000 7f97bd01c700 1 --2- 172.21.15.156:0/3736589564 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97b809d860 0x7f97b809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.386+0000 7f97bd01c700 1 --2- 172.21.15.156:0/3736589564 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97b809e170 0x7f97b81307a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.386+0000 7f97bd01c700 1 -- 172.21.15.156:0/3736589564 >> 172.21.15.156:0/3736589564 conn(0x7f97b8099c40 msgr2=0x7f97b80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:53.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.386+0000 7f97bd01c700 1 -- 172.21.15.156:0/3736589564 shutdown_connections 2023-09-30T22:20:53.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.386+0000 7f97bd01c700 1 -- 172.21.15.156:0/3736589564 wait complete. 2023-09-30T22:20:53.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.387+0000 7f97bd01c700 1 Processor -- start 2023-09-30T22:20:53.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.387+0000 7f97bd01c700 1 -- start start 2023-09-30T22:20:53.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.387+0000 7f97bd01c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97b809d860 0x7f97b81b8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:53.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.387+0000 7f97bd01c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97b809e170 0x7f97b81b8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:53.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.387+0000 7f97bd01c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97b8130ce0 0x7f97b81b8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:53.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.388+0000 7f97bd01c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b811f110 con 0x7f97b809d860 2023-09-30T22:20:53.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.388+0000 7f97bd01c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b811f340 con 0x7f97b809e170 2023-09-30T22:20:53.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.388+0000 7f97bd01c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97b8130a90 con 0x7f97b8130ce0 2023-09-30T22:20:53.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.388+0000 7f97b6d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97b809d860 0x7f97b81b8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:53.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.388+0000 7f97b6d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97b809d860 0x7f97b81b8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60400/0 (socket says 172.21.15.156:60400) 2023-09-30T22:20:53.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.388+0000 7f97b6d9d700 1 -- 172.21.15.156:0/225829791 learned_addr learned my addr 172.21.15.156:0/225829791 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:53.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.388+0000 7f97b759e700 1 --2- 172.21.15.156:0/225829791 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97b8130ce0 0x7f97b81b8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:53.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.388+0000 7f97b659c700 1 --2- 172.21.15.156:0/225829791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97b809e170 0x7f97b81b8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:53.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.388+0000 7f97b6d9d700 1 -- 172.21.15.156:0/225829791 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97b8130ce0 msgr2=0x7f97b81b8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:53.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.388+0000 7f97b6d9d700 1 --2- 172.21.15.156:0/225829791 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97b8130ce0 0x7f97b81b8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.388+0000 7f97b6d9d700 1 -- 172.21.15.156:0/225829791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97b809e170 msgr2=0x7f97b81b8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:53.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.388+0000 7f97b6d9d700 1 --2- 172.21.15.156:0/225829791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97b809e170 0x7f97b81b8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.388+0000 7f97b6d9d700 1 -- 172.21.15.156:0/225829791 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a80094a0 con 0x7f97b809d860 2023-09-30T22:20:53.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.388+0000 7f97b6d9d700 1 --2- 172.21.15.156:0/225829791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97b809d860 0x7f97b81b8000 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f97a800ebe0 tx=0x7f97a800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:53.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.389+0000 7f979f7fe700 1 -- 172.21.15.156:0/225829791 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a8009800 con 0x7f97b809d860 2023-09-30T22:20:53.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.389+0000 7f979f7fe700 1 -- 172.21.15.156:0/225829791 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a800c910 con 0x7f97b809d860 2023-09-30T22:20:53.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.389+0000 7f979f7fe700 1 -- 172.21.15.156:0/225829791 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a800cc80 con 0x7f97b809d860 2023-09-30T22:20:53.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.389+0000 7f97bd01c700 1 -- 172.21.15.156:0/225829791 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97ac009550 con 0x7f97b809d860 2023-09-30T22:20:53.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.389+0000 7f97bd01c700 1 -- 172.21.15.156:0/225829791 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b81b9c10 con 0x7f97b809d860 2023-09-30T22:20:53.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.390+0000 7f979f7fe700 1 -- 172.21.15.156:0/225829791 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f97a8013470 con 0x7f97b809d860 2023-09-30T22:20:53.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.390+0000 7f97bd01c700 1 -- 172.21.15.156:0/225829791 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b804f2a0 con 0x7f97b809d860 2023-09-30T22:20:53.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.390+0000 7f979f7fe700 1 -- 172.21.15.156:0/225829791 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f97a803f970 con 0x7f97b809d860 2023-09-30T22:20:53.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.399+0000 7f979f7fe700 1 -- 172.21.15.156:0/225829791 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f97a8013720 con 0x7f97b809d860 2023-09-30T22:20:53.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.428+0000 7ff2022bb700 1 Processor -- start 2023-09-30T22:20:53.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.428+0000 7ff2022bb700 1 -- start start 2023-09-30T22:20:53.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.429+0000 7ff2022bb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1fc0a1550 0x7ff1fc138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:53.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.429+0000 7ff2022bb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff1fc139200 0x7ff1fc13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:53.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.429+0000 7ff2022bb700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1fc09e9d0 con 0x7ff1fc0a0a70 2023-09-30T22:20:53.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.429+0000 7ff2022bb700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1fc09dc00 con 0x7ff1fc139200 2023-09-30T22:20:53.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.429+0000 7ff2022bb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc09dec0 con 0x7ff1fc0a1550 2023-09-30T22:20:53.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.429+0000 7ff1fb7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1fc0a1550 0x7ff1fc138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:53.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.429+0000 7ff1fbfff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff1fc0a0a70 0x7ff1fc0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:46092/0 (socket says 172.21.15.156:46092) 2023-09-30T22:20:53.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.429+0000 7ff1fbfff700 1 -- 172.21.15.156:0/930814461 learned_addr learned my addr 172.21.15.156:0/930814461 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:53.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.429+0000 7ff200858700 1 --2- 172.21.15.156:0/930814461 >> v2:172.21.15.156:3300/0 conn(0x7ff1fc139200 0x7ff1fc13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:53.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.429+0000 7ff1fb7fe700 1 -- 172.21.15.156:0/930814461 >> v2:172.21.15.156:3300/0 conn(0x7ff1fc139200 msgr2=0x7ff1fc13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:53.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.429+0000 7ff1fb7fe700 1 --2- 172.21.15.156:0/930814461 >> v2:172.21.15.156:3300/0 conn(0x7ff1fc139200 0x7ff1fc13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.429+0000 7ff1fb7fe700 1 -- 172.21.15.156:0/930814461 >> v1:172.21.15.156:6789/0 conn(0x7ff1fc0a0a70 legacy=0x7ff1fc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:53.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.429+0000 7ff1fb7fe700 1 -- 172.21.15.156:0/930814461 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1fc09e6a0 con 0x7ff1fc0a1550 2023-09-30T22:20:53.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.430+0000 7ff1fb7fe700 1 --2- 172.21.15.156:0/930814461 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1fc0a1550 0x7ff1fc138cc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0009840 tx=0x7ff1f0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f0ec93b4b416846 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:53.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.430+0000 7ff1faffd700 1 -- 172.21.15.156:0/930814461 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0011830 con 0x7ff1fc0a1550 2023-09-30T22:20:53.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.430+0000 7ff1faffd700 1 -- 172.21.15.156:0/930814461 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f0011990 con 0x7ff1fc0a1550 2023-09-30T22:20:53.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.430+0000 7ff1faffd700 1 -- 172.21.15.156:0/930814461 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0011d20 con 0x7ff1fc0a1550 2023-09-30T22:20:53.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.431+0000 7ff2022bb700 1 -- 172.21.15.156:0/930814461 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1fc0a1550 msgr2=0x7ff1fc138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:53.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.431+0000 7ff2022bb700 1 --2- 172.21.15.156:0/930814461 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1fc0a1550 0x7ff1fc138cc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0009840 tx=0x7ff1f0009b50 comp rx=0 tx=0).stop 2023-09-30T22:20:53.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.431+0000 7ff2022bb700 1 -- 172.21.15.156:0/930814461 shutdown_connections 2023-09-30T22:20:53.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.431+0000 7ff2022bb700 1 --2- 172.21.15.156:0/930814461 >> v2:172.21.15.156:3300/0 conn(0x7ff1fc139200 0x7ff1fc13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.431+0000 7ff2022bb700 1 --2- 172.21.15.156:0/930814461 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1fc0a1550 0x7ff1fc138cc0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.431+0000 7ff2022bb700 1 -- 172.21.15.156:0/930814461 >> 172.21.15.156:0/930814461 conn(0x7ff1fc0a6610 msgr2=0x7ff1fc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:53.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.431+0000 7ff2022bb700 1 -- 172.21.15.156:0/930814461 shutdown_connections 2023-09-30T22:20:53.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.431+0000 7ff2022bb700 1 -- 172.21.15.156:0/930814461 wait complete. 2023-09-30T22:20:53.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.432+0000 7ff2022bb700 1 Processor -- start 2023-09-30T22:20:53.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.433+0000 7ff2022bb700 1 -- start start 2023-09-30T22:20:53.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.433+0000 7ff2022bb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1fc0a0a70 0x7ff1fc11e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:53.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.433+0000 7ff2022bb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1fc0a1550 0x7ff1fc11eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:53.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.433+0000 7ff2022bb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff1fc139200 0x7ff1fc11f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:53.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.433+0000 7ff2022bb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc1220e0 con 0x7ff1fc0a1550 2023-09-30T22:20:53.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.433+0000 7ff2022bb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc0a5290 con 0x7ff1fc0a0a70 2023-09-30T22:20:53.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.433+0000 7ff2022bb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc0a03e0 con 0x7ff1fc139200 2023-09-30T22:20:53.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.433+0000 7ff1fb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1fc0a1550 0x7ff1fc11eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:53.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.433+0000 7ff1fb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1fc0a1550 0x7ff1fc11eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60420/0 (socket says 172.21.15.156:60420) 2023-09-30T22:20:53.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.433+0000 7ff1fb7fe700 1 -- 172.21.15.156:0/325661533 learned_addr learned my addr 172.21.15.156:0/325661533 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:53.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.433+0000 7ff1fbfff700 1 --2- 172.21.15.156:0/325661533 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1fc0a0a70 0x7ff1fc11e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:53.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.434+0000 7ff200858700 1 --2- 172.21.15.156:0/325661533 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff1fc139200 0x7ff1fc11f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:53.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.434+0000 7ff1fb7fe700 1 -- 172.21.15.156:0/325661533 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff1fc139200 msgr2=0x7ff1fc11f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:53.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.434+0000 7ff1fb7fe700 1 --2- 172.21.15.156:0/325661533 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff1fc139200 0x7ff1fc11f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.434+0000 7ff1fb7fe700 1 -- 172.21.15.156:0/325661533 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1fc0a0a70 msgr2=0x7ff1fc11e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:53.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.434+0000 7ff1fb7fe700 1 --2- 172.21.15.156:0/325661533 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1fc0a0a70 0x7ff1fc11e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.434+0000 7ff1fb7fe700 1 -- 172.21.15.156:0/325661533 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f00094a0 con 0x7ff1fc0a1550 2023-09-30T22:20:53.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.434+0000 7ff1fb7fe700 1 --2- 172.21.15.156:0/325661533 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1fc0a1550 0x7ff1fc11eeb0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0009fd0 tx=0x7ff1f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:53.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.434+0000 7ff1f8ff9700 1 -- 172.21.15.156:0/325661533 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f00036a0 con 0x7ff1fc0a1550 2023-09-30T22:20:53.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.434+0000 7ff1f8ff9700 1 -- 172.21.15.156:0/325661533 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f001f070 con 0x7ff1fc0a1550 2023-09-30T22:20:53.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.434+0000 7ff2022bb700 1 -- 172.21.15.156:0/325661533 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1fc1205c0 con 0x7ff1fc0a1550 2023-09-30T22:20:53.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.434+0000 7ff1f8ff9700 1 -- 172.21.15.156:0/325661533 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0003a60 con 0x7ff1fc0a1550 2023-09-30T22:20:53.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.434+0000 7ff2022bb700 1 -- 172.21.15.156:0/325661533 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1fc122b50 con 0x7ff1fc0a1550 2023-09-30T22:20:53.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.435+0000 7ff1f8ff9700 1 -- 172.21.15.156:0/325661533 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff1f0003bc0 con 0x7ff1fc0a1550 2023-09-30T22:20:53.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.435+0000 7ff1f8ff9700 1 -- 172.21.15.156:0/325661533 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff1f0021070 con 0x7ff1fc0a1550 2023-09-30T22:20:53.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.435+0000 7ff2022bb700 1 -- 172.21.15.156:0/325661533 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1fc04f2a0 con 0x7ff1fc0a1550 2023-09-30T22:20:53.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.444+0000 7ff1f8ff9700 1 -- 172.21.15.156:0/325661533 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff1f0015020 con 0x7ff1fc0a1550 2023-09-30T22:20:53.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.487+0000 7f0a6ad3f700 1 -- 172.21.15.156:0/214420866 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0a6404f2a0 con 0x7f0a64133ad0 2023-09-30T22:20:53.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.487+0000 7f0a617fa700 1 -- 172.21.15.156:0/214420866 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0a5c0192c0 con 0x7f0a64133ad0 2023-09-30T22:20:53.488 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:53.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.489+0000 7f0a6ad3f700 1 -- 172.21.15.156:0/214420866 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a64133ad0 msgr2=0x7f0a64071d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:53.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.489+0000 7f0a6ad3f700 1 --2- 172.21.15.156:0/214420866 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a64133ad0 0x7f0a64071d50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00ca80 tx=0x7f0a5c00cd90 comp rx=0 tx=0).stop 2023-09-30T22:20:53.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.489+0000 7f0a6ad3f700 1 -- 172.21.15.156:0/214420866 shutdown_connections 2023-09-30T22:20:53.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.489+0000 7f0a6ad3f700 1 --2- 172.21.15.156:0/214420866 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a64133ad0 0x7f0a64071d50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.489+0000 7f0a6ad3f700 1 --2- 172.21.15.156:0/214420866 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a641300a0 0x7f0a640712d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.489+0000 7f0a6ad3f700 1 --2- 172.21.15.156:0/214420866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a641309f0 0x7f0a64071810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.489+0000 7f0a6ad3f700 1 -- 172.21.15.156:0/214420866 >> 172.21.15.156:0/214420866 conn(0x7f0a64099c40 msgr2=0x7f0a64132a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:53.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.490+0000 7f0a6ad3f700 1 -- 172.21.15.156:0/214420866 shutdown_connections 2023-09-30T22:20:53.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.490+0000 7f0a6ad3f700 1 -- 172.21.15.156:0/214420866 wait complete. 2023-09-30T22:20:53.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:53.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.552+0000 7f3c27fff700 1 -- 172.21.15.156:0/2346073725 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3c20005590 con 0x7f3c44134f00 2023-09-30T22:20:53.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.553+0000 7f3c3a7fc700 1 -- 172.21.15.156:0/2346073725 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3c3c02db40 con 0x7f3c44134f00 2023-09-30T22:20:53.554 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:53.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.555+0000 7f3c27fff700 1 -- 172.21.15.156:0/2346073725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c44134f00 msgr2=0x7f3c44070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:53.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.555+0000 7f3c27fff700 1 --2- 172.21.15.156:0/2346073725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c44134f00 0x7f3c44070630 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00b680 tx=0x7f3c3c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.555+0000 7f3c27fff700 1 -- 172.21.15.156:0/2346073725 shutdown_connections 2023-09-30T22:20:53.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.555+0000 7f3c27fff700 1 --2- 172.21.15.156:0/2346073725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c44134f00 0x7f3c44070630 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.555+0000 7f3c27fff700 1 --2- 172.21.15.156:0/2346073725 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3c4406a770 0x7f3c4406fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.555+0000 7f3c27fff700 1 --2- 172.21.15.156:0/2346073725 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3c4409e070 0x7f3c440700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.555+0000 7f3c27fff700 1 -- 172.21.15.156:0/2346073725 >> 172.21.15.156:0/2346073725 conn(0x7f3c44099c40 msgr2=0x7f3c440a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:53.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.555+0000 7f3c27fff700 1 -- 172.21.15.156:0/2346073725 shutdown_connections 2023-09-30T22:20:53.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.555+0000 7f3c27fff700 1 -- 172.21.15.156:0/2346073725 wait complete. 2023-09-30T22:20:53.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:53.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.621+0000 7f97bd01c700 1 -- 172.21.15.156:0/225829791 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f97b811df00 con 0x7f97b809d860 2023-09-30T22:20:53.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.621+0000 7f979f7fe700 1 -- 172.21.15.156:0/225829791 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f97a8021020 con 0x7f97b809d860 2023-09-30T22:20:53.622 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:53.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.623+0000 7f97bd01c700 1 -- 172.21.15.156:0/225829791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97b809d860 msgr2=0x7f97b81b8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:53.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.623+0000 7f97bd01c700 1 --2- 172.21.15.156:0/225829791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97b809d860 0x7f97b81b8000 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f97a800ebe0 tx=0x7f97a800eef0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.623+0000 7f97bd01c700 1 -- 172.21.15.156:0/225829791 shutdown_connections 2023-09-30T22:20:53.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.623+0000 7f97bd01c700 1 --2- 172.21.15.156:0/225829791 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97b8130ce0 0x7f97b81b8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.623+0000 7f97bd01c700 1 --2- 172.21.15.156:0/225829791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97b809d860 0x7f97b81b8000 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.623+0000 7f97bd01c700 1 --2- 172.21.15.156:0/225829791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97b809e170 0x7f97b81b8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.623+0000 7f97bd01c700 1 -- 172.21.15.156:0/225829791 >> 172.21.15.156:0/225829791 conn(0x7f97b8099c40 msgr2=0x7f97b80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:53.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.623+0000 7f97bd01c700 1 -- 172.21.15.156:0/225829791 shutdown_connections 2023-09-30T22:20:53.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.623+0000 7f97bd01c700 1 -- 172.21.15.156:0/225829791 wait complete. 2023-09-30T22:20:53.636 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:53.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.653+0000 7ff2022bb700 1 -- 172.21.15.156:0/325661533 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff1fc072980 con 0x7ff1fc0a1550 2023-09-30T22:20:53.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.653+0000 7ff1f8ff9700 1 -- 172.21.15.156:0/325661533 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff1f00257f0 con 0x7ff1fc0a1550 2023-09-30T22:20:53.654 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:53.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.655+0000 7ff2022bb700 1 -- 172.21.15.156:0/325661533 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1fc0a1550 msgr2=0x7ff1fc11eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:53.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.655+0000 7ff2022bb700 1 --2- 172.21.15.156:0/325661533 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1fc0a1550 0x7ff1fc11eeb0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0009fd0 tx=0x7ff1f0004750 comp rx=0 tx=0).stop 2023-09-30T22:20:53.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.655+0000 7ff2022bb700 1 -- 172.21.15.156:0/325661533 shutdown_connections 2023-09-30T22:20:53.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.655+0000 7ff2022bb700 1 --2- 172.21.15.156:0/325661533 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff1fc139200 0x7ff1fc11f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.655+0000 7ff2022bb700 1 --2- 172.21.15.156:0/325661533 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1fc0a0a70 0x7ff1fc11e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.655+0000 7ff2022bb700 1 --2- 172.21.15.156:0/325661533 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1fc0a1550 0x7ff1fc11eeb0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:53.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.655+0000 7ff2022bb700 1 -- 172.21.15.156:0/325661533 >> 172.21.15.156:0/325661533 conn(0x7ff1fc0a6610 msgr2=0x7ff1fc136d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:53.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.655+0000 7ff2022bb700 1 -- 172.21.15.156:0/325661533 shutdown_connections 2023-09-30T22:20:53.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:53.655+0000 7ff2022bb700 1 -- 172.21.15.156:0/325661533 wait complete. 2023-09-30T22:20:53.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:54.505 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:54.569 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:54.637 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:54.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.639+0000 7f5c8c124700 1 Processor -- start 2023-09-30T22:20:54.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.639+0000 7f5c8c124700 1 -- start start 2023-09-30T22:20:54.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.639+0000 7f5c8c124700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c840a0a70 0x7f5c840a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:54.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.639+0000 7f5c8c124700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c84134120 0x7f5c8413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:54.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.639+0000 7f5c8c124700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c8409dc00 con 0x7f5c840a1380 2023-09-30T22:20:54.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.639+0000 7f5c8c124700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8409ea90 con 0x7f5c840a0a70 2023-09-30T22:20:54.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.639+0000 7f5c8c124700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8409dec0 con 0x7f5c84134120 2023-09-30T22:20:54.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.640+0000 7f5c896bf700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f5c840a1380 0x7f5c84133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:46096/0 (socket says 172.21.15.156:46096) 2023-09-30T22:20:54.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.640+0000 7f5c896bf700 1 -- 172.21.15.156:0/1085222562 learned_addr learned my addr 172.21.15.156:0/1085222562 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:54.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.640+0000 7f5c89ec0700 1 --2- 172.21.15.156:0/1085222562 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c840a0a70 0x7f5c840a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:54.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.640+0000 7f5c8a6c1700 1 --2- 172.21.15.156:0/1085222562 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c84134120 0x7f5c8413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:54.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.640+0000 7f5c88ebe700 1 -- 172.21.15.156:0/1085222562 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2569921900 0 0) 0x7f5c8409dc00 con 0x7f5c840a1380 2023-09-30T22:20:54.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.640+0000 7f5c88ebe700 1 -- 172.21.15.156:0/1085222562 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c700035b0 con 0x7f5c840a1380 2023-09-30T22:20:54.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.640+0000 7f5c8a6c1700 1 -- 172.21.15.156:0/1085222562 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c840a0a70 msgr2=0x7f5c840a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:54.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.640+0000 7f5c8a6c1700 1 --2- 172.21.15.156:0/1085222562 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c840a0a70 0x7f5c840a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:54.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.640+0000 7f5c8a6c1700 1 -- 172.21.15.156:0/1085222562 >> v1:172.21.15.156:6789/0 conn(0x7f5c840a1380 legacy=0x7f5c84133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:54.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.640+0000 7f5c8a6c1700 1 -- 172.21.15.156:0/1085222562 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8409e6a0 con 0x7f5c84134120 2023-09-30T22:20:54.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.640+0000 7f5c8a6c1700 1 --2- 172.21.15.156:0/1085222562 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c84134120 0x7f5c8413bce0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c009dc0 tx=0x7f5c7c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb9ab14c4374e7c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:54.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.640+0000 7f5c88ebe700 1 -- 172.21.15.156:0/1085222562 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c00e070 con 0x7f5c84134120 2023-09-30T22:20:54.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.640+0000 7f5c88ebe700 1 -- 172.21.15.156:0/1085222562 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7c00bb20 con 0x7f5c84134120 2023-09-30T22:20:54.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.640+0000 7f5c88ebe700 1 -- 172.21.15.156:0/1085222562 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c012430 con 0x7f5c84134120 2023-09-30T22:20:54.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.641+0000 7f5c8c124700 1 -- 172.21.15.156:0/1085222562 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c84134120 msgr2=0x7f5c8413bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:54.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.641+0000 7f5c8c124700 1 --2- 172.21.15.156:0/1085222562 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c84134120 0x7f5c8413bce0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c009dc0 tx=0x7f5c7c00b330 comp rx=0 tx=0).stop 2023-09-30T22:20:54.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.641+0000 7f5c8c124700 1 -- 172.21.15.156:0/1085222562 shutdown_connections 2023-09-30T22:20:54.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.641+0000 7f5c8c124700 1 --2- 172.21.15.156:0/1085222562 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c840a0a70 0x7f5c840a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:54.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.641+0000 7f5c8c124700 1 --2- 172.21.15.156:0/1085222562 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c84134120 0x7f5c8413bce0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:54.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.641+0000 7f5c8c124700 1 -- 172.21.15.156:0/1085222562 >> 172.21.15.156:0/1085222562 conn(0x7f5c840a6610 msgr2=0x7f5c840a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:54.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.641+0000 7f5c8c124700 1 -- 172.21.15.156:0/1085222562 shutdown_connections 2023-09-30T22:20:54.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.641+0000 7f5c8c124700 1 -- 172.21.15.156:0/1085222562 wait complete. 2023-09-30T22:20:54.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.643+0000 7f5c8c124700 1 Processor -- start 2023-09-30T22:20:54.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.643+0000 7f5c8c124700 1 -- start start 2023-09-30T22:20:54.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.643+0000 7f5c8c124700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c840a0a70 0x7f5c84122a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:54.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.643+0000 7f5c8c124700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c840a1380 0x7f5c84122fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:54.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.643+0000 7f5c8c124700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c84134120 0x7f5c84123500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:54.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.643+0000 7f5c8c124700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c84133a30 con 0x7f5c840a0a70 2023-09-30T22:20:54.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.643+0000 7f5c8c124700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c84125f80 con 0x7f5c84134120 2023-09-30T22:20:54.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.643+0000 7f5c8c124700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c84127210 con 0x7f5c840a1380 2023-09-30T22:20:54.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.643+0000 7f5c89ec0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c840a0a70 0x7f5c84122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:54.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.643+0000 7f5c8a6c1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c84134120 0x7f5c84123500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:54.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.643+0000 7f5c89ec0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c840a0a70 0x7f5c84122a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60428/0 (socket says 172.21.15.156:60428) 2023-09-30T22:20:54.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.643+0000 7f5c89ec0700 1 -- 172.21.15.156:0/2161279435 learned_addr learned my addr 172.21.15.156:0/2161279435 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:54.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.643+0000 7f5c896bf700 1 --2- 172.21.15.156:0/2161279435 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c840a1380 0x7f5c84122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:54.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.644+0000 7f5c8a6c1700 1 -- 172.21.15.156:0/2161279435 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c840a1380 msgr2=0x7f5c84122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:54.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.644+0000 7f5c8a6c1700 1 --2- 172.21.15.156:0/2161279435 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c840a1380 0x7f5c84122fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:54.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.644+0000 7f5c8a6c1700 1 -- 172.21.15.156:0/2161279435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c840a0a70 msgr2=0x7f5c84122a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:54.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.644+0000 7f5c8a6c1700 1 --2- 172.21.15.156:0/2161279435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c840a0a70 0x7f5c84122a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:54.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.644+0000 7f5c8a6c1700 1 -- 172.21.15.156:0/2161279435 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7c009a70 con 0x7f5c84134120 2023-09-30T22:20:54.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.644+0000 7f5c8a6c1700 1 --2- 172.21.15.156:0/2161279435 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c84134120 0x7f5c84123500 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c016000 tx=0x7f5c7c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:54.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.644+0000 7f5c7a7fc700 1 -- 172.21.15.156:0/2161279435 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c004800 con 0x7f5c84134120 2023-09-30T22:20:54.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.644+0000 7f5c7a7fc700 1 -- 172.21.15.156:0/2161279435 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7c020070 con 0x7f5c84134120 2023-09-30T22:20:54.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.644+0000 7f5c7a7fc700 1 -- 172.21.15.156:0/2161279435 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c0276c0 con 0x7f5c84134120 2023-09-30T22:20:54.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.644+0000 7f5c8c124700 1 -- 172.21.15.156:0/2161279435 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c84126240 con 0x7f5c84134120 2023-09-30T22:20:54.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.644+0000 7f5c8c124700 1 -- 172.21.15.156:0/2161279435 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c841245a0 con 0x7f5c84134120 2023-09-30T22:20:54.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.645+0000 7f5c7a7fc700 1 -- 172.21.15.156:0/2161279435 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c7c012430 con 0x7f5c84134120 2023-09-30T22:20:54.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.645+0000 7f5c8c124700 1 -- 172.21.15.156:0/2161279435 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c8404f2a0 con 0x7f5c84134120 2023-09-30T22:20:54.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.645+0000 7f5c7a7fc700 1 -- 172.21.15.156:0/2161279435 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5c7c022070 con 0x7f5c84134120 2023-09-30T22:20:54.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.650+0000 7f5c7a7fc700 1 -- 172.21.15.156:0/2161279435 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c7c072750 con 0x7f5c84134120 2023-09-30T22:20:54.669 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:54.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.703+0000 7fd399aa8700 1 Processor -- start 2023-09-30T22:20:54.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.703+0000 7fd399aa8700 1 -- start start 2023-09-30T22:20:54.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.704+0000 7fd399aa8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd39409f350 0x7fd394136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:54.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.704+0000 7fd399aa8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3941371c0 0x7fd3941395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:54.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.704+0000 7fd399aa8700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd39409c970 con 0x7fd39409e870 2023-09-30T22:20:54.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.704+0000 7fd399aa8700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3940a0920 con 0x7fd39409f350 2023-09-30T22:20:54.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.704+0000 7fd399aa8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39409f9c0 con 0x7fd3941371c0 2023-09-30T22:20:54.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.704+0000 7fd393fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3941371c0 0x7fd3941395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:54.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.704+0000 7fd393fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3941371c0 0x7fd3941395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:36270/0 (socket says 172.21.15.156:36270) 2023-09-30T22:20:54.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.704+0000 7fd392ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd39409f350 0x7fd394136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:54.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.704+0000 7fd393fff700 1 -- 172.21.15.156:0/433689524 learned_addr learned my addr 172.21.15.156:0/433689524 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:54.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.704+0000 7fd393fff700 1 -- 172.21.15.156:0/433689524 >> v2:172.21.15.156:3300/0 conn(0x7fd39409f350 msgr2=0x7fd394136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:54.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.704+0000 7fd393fff700 1 --2- 172.21.15.156:0/433689524 >> v2:172.21.15.156:3300/0 conn(0x7fd39409f350 0x7fd394136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:54.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.704+0000 7fd393fff700 1 -- 172.21.15.156:0/433689524 >> v1:172.21.15.156:6789/0 conn(0x7fd39409e870 legacy=0x7fd39409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:54.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.704+0000 7fd393fff700 1 -- 172.21.15.156:0/433689524 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39409bab0 con 0x7fd3941371c0 2023-09-30T22:20:54.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.705+0000 7fd393fff700 1 --2- 172.21.15.156:0/433689524 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3941371c0 0x7fd3941395a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd38c009e50 tx=0x7fd38c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3ea3567fb0b0183 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:54.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.705+0000 7fd3927fc700 1 -- 172.21.15.156:0/433689524 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c00bb10 con 0x7fd3941371c0 2023-09-30T22:20:54.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.705+0000 7fd3927fc700 1 -- 172.21.15.156:0/433689524 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38c00bc70 con 0x7fd3941371c0 2023-09-30T22:20:54.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.705+0000 7fd3927fc700 1 -- 172.21.15.156:0/433689524 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c0104d0 con 0x7fd3941371c0 2023-09-30T22:20:54.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.706+0000 7fd399aa8700 1 -- 172.21.15.156:0/433689524 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3941371c0 msgr2=0x7fd3941395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:54.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.706+0000 7fd399aa8700 1 --2- 172.21.15.156:0/433689524 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3941371c0 0x7fd3941395a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd38c009e50 tx=0x7fd38c00b330 comp rx=0 tx=0).stop 2023-09-30T22:20:54.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.706+0000 7fd399aa8700 1 -- 172.21.15.156:0/433689524 shutdown_connections 2023-09-30T22:20:54.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.706+0000 7fd399aa8700 1 --2- 172.21.15.156:0/433689524 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3941371c0 0x7fd3941395a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:54.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.706+0000 7fd399aa8700 1 --2- 172.21.15.156:0/433689524 >> v2:172.21.15.156:3300/0 conn(0x7fd39409f350 0x7fd394136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:54.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.706+0000 7fd399aa8700 1 -- 172.21.15.156:0/433689524 >> 172.21.15.156:0/433689524 conn(0x7fd3940a4430 msgr2=0x7fd3940a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:54.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.706+0000 7fd399aa8700 1 -- 172.21.15.156:0/433689524 shutdown_connections 2023-09-30T22:20:54.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.706+0000 7fd399aa8700 1 -- 172.21.15.156:0/433689524 wait complete. 2023-09-30T22:20:54.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.707+0000 7fd399aa8700 1 Processor -- start 2023-09-30T22:20:54.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.708+0000 7fd399aa8700 1 -- start start 2023-09-30T22:20:54.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.708+0000 7fd399aa8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd39409e870 0x7fd39411e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:54.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.708+0000 7fd399aa8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd39409f350 0x7fd39411eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:54.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.708+0000 7fd399aa8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3941371c0 0x7fd39411f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:54.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.708+0000 7fd399aa8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39406d200 con 0x7fd3941371c0 2023-09-30T22:20:54.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.708+0000 7fd399aa8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39409dba0 con 0x7fd39409f350 2023-09-30T22:20:54.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.708+0000 7fd399aa8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3941218d0 con 0x7fd39409e870 2023-09-30T22:20:54.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.708+0000 7fd3937fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd39409e870 0x7fd39411e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:54.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.708+0000 7fd3937fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd39409e870 0x7fd39411e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54676/0 (socket says 172.21.15.156:54676) 2023-09-30T22:20:54.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.708+0000 7fd3937fe700 1 -- 172.21.15.156:0/2154827951 learned_addr learned my addr 172.21.15.156:0/2154827951 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:54.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.708+0000 7fd393fff700 1 --2- 172.21.15.156:0/2154827951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3941371c0 0x7fd39411f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:54.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.709+0000 7fd392ffd700 1 --2- 172.21.15.156:0/2154827951 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd39409f350 0x7fd39411eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:54.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.709+0000 7fd393fff700 1 -- 172.21.15.156:0/2154827951 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd39409e870 msgr2=0x7fd39411e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:54.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.709+0000 7fd393fff700 1 --2- 172.21.15.156:0/2154827951 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd39409e870 0x7fd39411e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:54.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.709+0000 7fd393fff700 1 -- 172.21.15.156:0/2154827951 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd39409f350 msgr2=0x7fd39411eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:54.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.709+0000 7fd393fff700 1 --2- 172.21.15.156:0/2154827951 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd39409f350 0x7fd39411eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:54.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.709+0000 7fd393fff700 1 -- 172.21.15.156:0/2154827951 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38c009b30 con 0x7fd3941371c0 2023-09-30T22:20:54.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.709+0000 7fd393fff700 1 --2- 172.21.15.156:0/2154827951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3941371c0 0x7fd39411f0a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd38c019000 tx=0x7fd38c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:54.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.709+0000 7fd37bfff700 1 -- 172.21.15.156:0/2154827951 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c00e070 con 0x7fd3941371c0 2023-09-30T22:20:54.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.709+0000 7fd37bfff700 1 -- 172.21.15.156:0/2154827951 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38c0099b0 con 0x7fd3941371c0 2023-09-30T22:20:54.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.709+0000 7fd37bfff700 1 -- 172.21.15.156:0/2154827951 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c0092e0 con 0x7fd3941371c0 2023-09-30T22:20:54.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.709+0000 7fd399aa8700 1 -- 172.21.15.156:0/2154827951 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd394121e60 con 0x7fd3941371c0 2023-09-30T22:20:54.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.709+0000 7fd399aa8700 1 -- 172.21.15.156:0/2154827951 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3941228d0 con 0x7fd3941371c0 2023-09-30T22:20:54.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.710+0000 7fd37bfff700 1 -- 172.21.15.156:0/2154827951 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd38c026a50 con 0x7fd3941371c0 2023-09-30T22:20:54.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.710+0000 7fd399aa8700 1 -- 172.21.15.156:0/2154827951 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd394121480 con 0x7fd3941371c0 2023-09-30T22:20:54.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.711+0000 7fd37bfff700 1 -- 172.21.15.156:0/2154827951 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd38c048d80 con 0x7fd3941371c0 2023-09-30T22:20:54.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.719+0000 7fd37bfff700 1 -- 172.21.15.156:0/2154827951 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd38c007310 con 0x7fd3941371c0 2023-09-30T22:20:54.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.771+0000 7f60ca76a700 1 Processor -- start 2023-09-30T22:20:54.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.771+0000 7f60ca76a700 1 -- start start 2023-09-30T22:20:54.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.771+0000 7f60ca76a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60c4133ad0 0x7f60c4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:54.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.771+0000 7f60ca76a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f60c41300a0 0x7f60c41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:54.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.771+0000 7f60ca76a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c406b2d0 con 0x7f60c41309f0 2023-09-30T22:20:54.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.771+0000 7f60ca76a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c4133610 con 0x7f60c41300a0 2023-09-30T22:20:54.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.771+0000 7f60ca76a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60c409a500 con 0x7f60c4133ad0 2023-09-30T22:20:54.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.772+0000 7f60c3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60c4133ad0 0x7f60c4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:54.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.772+0000 7f60c8d07700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f60c41309f0 0x7f60c413a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:46124/0 (socket says 172.21.15.156:46124) 2023-09-30T22:20:54.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.772+0000 7f60c8d07700 1 -- 172.21.15.156:0/4224266952 learned_addr learned my addr 172.21.15.156:0/4224266952 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:54.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.772+0000 7f60c37fe700 1 --2- 172.21.15.156:0/4224266952 >> v2:172.21.15.156:3300/0 conn(0x7f60c41300a0 0x7f60c41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:54.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.772+0000 7f60c2ffd700 1 -- 172.21.15.156:0/4224266952 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2164309273 0 0) 0x7f60c406b2d0 con 0x7f60c41309f0 2023-09-30T22:20:54.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.772+0000 7f60c2ffd700 1 -- 172.21.15.156:0/4224266952 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60ac0035b0 con 0x7f60c41309f0 2023-09-30T22:20:54.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.772+0000 7f60c37fe700 1 -- 172.21.15.156:0/4224266952 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60c4133ad0 msgr2=0x7f60c4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:54.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.772+0000 7f60c37fe700 1 --2- 172.21.15.156:0/4224266952 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60c4133ad0 0x7f60c4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:54.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.772+0000 7f60c37fe700 1 -- 172.21.15.156:0/4224266952 >> v1:172.21.15.156:6789/0 conn(0x7f60c41309f0 legacy=0x7f60c413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:54.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.772+0000 7f60c37fe700 1 -- 172.21.15.156:0/4224266952 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c41338b0 con 0x7f60c41300a0 2023-09-30T22:20:54.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.772+0000 7f60c3fff700 1 --2- 172.21.15.156:0/4224266952 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60c4133ad0 0x7f60c4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:54.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.772+0000 7f60c37fe700 1 --2- 172.21.15.156:0/4224266952 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60c41300a0 0x7f60c41304b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f60b8009840 tx=0x7f60b8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99dd270324e67ae2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:54.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.772+0000 7f60c2ffd700 1 -- 172.21.15.156:0/4224266952 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b8011830 con 0x7f60c41300a0 2023-09-30T22:20:54.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.773+0000 7f60c2ffd700 1 -- 172.21.15.156:0/4224266952 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b8011990 con 0x7f60c41300a0 2023-09-30T22:20:54.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.773+0000 7f60c2ffd700 1 -- 172.21.15.156:0/4224266952 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b8011d00 con 0x7f60c41300a0 2023-09-30T22:20:54.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.774+0000 7f60ca76a700 1 -- 172.21.15.156:0/4224266952 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60c41300a0 msgr2=0x7f60c41304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:54.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.774+0000 7f60ca76a700 1 --2- 172.21.15.156:0/4224266952 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60c41300a0 0x7f60c41304b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f60b8009840 tx=0x7f60b8009b50 comp rx=0 tx=0).stop 2023-09-30T22:20:54.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.774+0000 7f60ca76a700 1 -- 172.21.15.156:0/4224266952 shutdown_connections 2023-09-30T22:20:54.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.774+0000 7f60ca76a700 1 --2- 172.21.15.156:0/4224266952 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60c4133ad0 0x7f60c4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:54.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.774+0000 7f60ca76a700 1 --2- 172.21.15.156:0/4224266952 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60c41300a0 0x7f60c41304b0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:54.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.774+0000 7f60ca76a700 1 -- 172.21.15.156:0/4224266952 >> 172.21.15.156:0/4224266952 conn(0x7f60c4099c40 msgr2=0x7f60c40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:54.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.774+0000 7f60ca76a700 1 -- 172.21.15.156:0/4224266952 shutdown_connections 2023-09-30T22:20:54.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.774+0000 7f60ca76a700 1 -- 172.21.15.156:0/4224266952 wait complete. 2023-09-30T22:20:54.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.775+0000 7f60ca76a700 1 Processor -- start 2023-09-30T22:20:54.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.775+0000 7f60ca76a700 1 -- start start 2023-09-30T22:20:54.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.775+0000 7f60ca76a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60c41300a0 0x7f60c40711c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:54.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.775+0000 7f60ca76a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60c41309f0 0x7f60c4071700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:54.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.775+0000 7f60ca76a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60c4133ad0 0x7f60c4071c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:54.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.775+0000 7f60ca76a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c4072670 con 0x7f60c4133ad0 2023-09-30T22:20:54.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.775+0000 7f60ca76a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c411fde0 con 0x7f60c41300a0 2023-09-30T22:20:54.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.775+0000 7f60ca76a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60c411f840 con 0x7f60c41309f0 2023-09-30T22:20:54.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.775+0000 7f60c37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60c41309f0 0x7f60c4071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:54.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.776+0000 7f60c37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60c41309f0 0x7f60c4071700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54684/0 (socket says 172.21.15.156:54684) 2023-09-30T22:20:54.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.776+0000 7f60c37fe700 1 -- 172.21.15.156:0/2082438803 learned_addr learned my addr 172.21.15.156:0/2082438803 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:54.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.776+0000 7f60c8d07700 1 --2- 172.21.15.156:0/2082438803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60c4133ad0 0x7f60c4071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:54.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.776+0000 7f60c3fff700 1 --2- 172.21.15.156:0/2082438803 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60c41300a0 0x7f60c40711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:54.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.776+0000 7f60c37fe700 1 -- 172.21.15.156:0/2082438803 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60c41300a0 msgr2=0x7f60c40711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:54.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.776+0000 7f60c37fe700 1 --2- 172.21.15.156:0/2082438803 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60c41300a0 0x7f60c40711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:54.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.776+0000 7f60c37fe700 1 -- 172.21.15.156:0/2082438803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60c4133ad0 msgr2=0x7f60c4071c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:54.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.776+0000 7f60c37fe700 1 --2- 172.21.15.156:0/2082438803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60c4133ad0 0x7f60c4071c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:54.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.776+0000 7f60c37fe700 1 -- 172.21.15.156:0/2082438803 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b40094a0 con 0x7f60c41309f0 2023-09-30T22:20:54.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.776+0000 7f60c8d07700 1 --2- 172.21.15.156:0/2082438803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60c4133ad0 0x7f60c4071c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:20:54.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.776+0000 7f60c37fe700 1 --2- 172.21.15.156:0/2082438803 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60c41309f0 0x7f60c4071700 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f60b8009fd0 tx=0x7f60b8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:54.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.776+0000 7f60c0ff9700 1 -- 172.21.15.156:0/2082438803 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b80045d0 con 0x7f60c41309f0 2023-09-30T22:20:54.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.776+0000 7f60c0ff9700 1 -- 172.21.15.156:0/2082438803 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b801f070 con 0x7f60c41309f0 2023-09-30T22:20:54.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.776+0000 7f60ca76a700 1 -- 172.21.15.156:0/2082438803 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b80094a0 con 0x7f60c41309f0 2023-09-30T22:20:54.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.776+0000 7f60c0ff9700 1 -- 172.21.15.156:0/2082438803 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b80038c0 con 0x7f60c41309f0 2023-09-30T22:20:54.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.776+0000 7f60ca76a700 1 -- 172.21.15.156:0/2082438803 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c412dd00 con 0x7f60c41309f0 2023-09-30T22:20:54.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.777+0000 7f60c0ff9700 1 -- 172.21.15.156:0/2082438803 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f60b8003a20 con 0x7f60c41309f0 2023-09-30T22:20:54.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.777+0000 7f60c0ff9700 1 -- 172.21.15.156:0/2082438803 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f60b8021070 con 0x7f60c41309f0 2023-09-30T22:20:54.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.778+0000 7f60ca76a700 1 -- 172.21.15.156:0/2082438803 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c40a2620 con 0x7f60c41309f0 2023-09-30T22:20:54.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.787+0000 7f60c0ff9700 1 -- 172.21.15.156:0/2082438803 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f60b802b020 con 0x7f60c41309f0 2023-09-30T22:20:54.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.805+0000 7f46f038c700 1 Processor -- start 2023-09-30T22:20:54.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.805+0000 7f46f038c700 1 -- start start 2023-09-30T22:20:54.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.806+0000 7f46f038c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46e806a770 0x7f46e81349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:54.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.806+0000 7f46f038c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46e8134f00 0x7f46e809d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:54.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.806+0000 7f46f038c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e809eca0 con 0x7f46e809dea0 2023-09-30T22:20:54.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.806+0000 7f46f038c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e806b2e0 con 0x7f46e806a770 2023-09-30T22:20:54.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.806+0000 7f46f038c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46e809f720 con 0x7f46e8134f00 2023-09-30T22:20:54.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.806+0000 7f46ee128700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46e806a770 0x7f46e81349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:54.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.806+0000 7f46ee128700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46e806a770 0x7f46e81349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:36296/0 (socket says 172.21.15.156:36296) 2023-09-30T22:20:54.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.806+0000 7f46ee128700 1 -- 172.21.15.156:0/559245436 learned_addr learned my addr 172.21.15.156:0/559245436 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:54.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.806+0000 7f46ed927700 1 --2- 172.21.15.156:0/559245436 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46e8134f00 0x7f46e809d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:54.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.807+0000 7f46ee128700 1 -- 172.21.15.156:0/559245436 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46e8134f00 msgr2=0x7f46e809d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:54.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.807+0000 7f46ee128700 1 --2- 172.21.15.156:0/559245436 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46e8134f00 0x7f46e809d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:54.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.807+0000 7f46ee128700 1 -- 172.21.15.156:0/559245436 >> v1:172.21.15.156:6789/0 conn(0x7f46e809dea0 legacy=0x7f46e813ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:54.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.807+0000 7f46ee128700 1 -- 172.21.15.156:0/559245436 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e806b480 con 0x7f46e806a770 2023-09-30T22:20:54.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.807+0000 7f46ee128700 1 --2- 172.21.15.156:0/559245436 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46e806a770 0x7f46e81349c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f46e4009920 tx=0x7f46e4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=309d212675633f8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:54.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.807+0000 7f46ed126700 1 -- 172.21.15.156:0/559245436 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4011830 con 0x7f46e806a770 2023-09-30T22:20:54.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.807+0000 7f46ed126700 1 -- 172.21.15.156:0/559245436 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e4011990 con 0x7f46e806a770 2023-09-30T22:20:54.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.807+0000 7f46ed126700 1 -- 172.21.15.156:0/559245436 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4011d20 con 0x7f46e806a770 2023-09-30T22:20:54.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.808+0000 7f46f038c700 1 -- 172.21.15.156:0/559245436 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46e806a770 msgr2=0x7f46e81349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:54.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.808+0000 7f46f038c700 1 --2- 172.21.15.156:0/559245436 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46e806a770 0x7f46e81349c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f46e4009920 tx=0x7f46e4009c30 comp rx=0 tx=0).stop 2023-09-30T22:20:54.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.808+0000 7f46f038c700 1 -- 172.21.15.156:0/559245436 shutdown_connections 2023-09-30T22:20:54.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.808+0000 7f46f038c700 1 --2- 172.21.15.156:0/559245436 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46e806a770 0x7f46e81349c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:54.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.808+0000 7f46f038c700 1 --2- 172.21.15.156:0/559245436 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46e8134f00 0x7f46e809d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:54.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.808+0000 7f46f038c700 1 -- 172.21.15.156:0/559245436 >> 172.21.15.156:0/559245436 conn(0x7f46e8099c40 msgr2=0x7f46e80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:54.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.808+0000 7f46f038c700 1 -- 172.21.15.156:0/559245436 shutdown_connections 2023-09-30T22:20:54.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.808+0000 7f46f038c700 1 -- 172.21.15.156:0/559245436 wait complete. 2023-09-30T22:20:54.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.809+0000 7f46f038c700 1 Processor -- start 2023-09-30T22:20:54.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.809+0000 7f46f038c700 1 -- start start 2023-09-30T22:20:54.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.809+0000 7f46f038c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46e806a770 0x7f46e806fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:54.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.809+0000 7f46f038c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46e809dea0 0x7f46e8070170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:54.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.809+0000 7f46f038c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46e8134f00 0x7f46e80706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:54.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.809+0000 7f46f038c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e8126430 con 0x7f46e806a770 2023-09-30T22:20:54.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.809+0000 7f46f038c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e80a01f0 con 0x7f46e809dea0 2023-09-30T22:20:54.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.809+0000 7f46f038c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46e809f220 con 0x7f46e8134f00 2023-09-30T22:20:54.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.810+0000 7f46ee128700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46e806a770 0x7f46e806fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:54.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.810+0000 7f46ee128700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46e806a770 0x7f46e806fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60466/0 (socket says 172.21.15.156:60466) 2023-09-30T22:20:54.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.810+0000 7f46ee128700 1 -- 172.21.15.156:0/2837362563 learned_addr learned my addr 172.21.15.156:0/2837362563 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:54.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.810+0000 7f46ee929700 1 --2- 172.21.15.156:0/2837362563 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46e8134f00 0x7f46e80706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:54.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.810+0000 7f46ed927700 1 --2- 172.21.15.156:0/2837362563 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46e809dea0 0x7f46e8070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:54.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.810+0000 7f46ee128700 1 -- 172.21.15.156:0/2837362563 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46e8134f00 msgr2=0x7f46e80706b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:54.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.810+0000 7f46ee128700 1 --2- 172.21.15.156:0/2837362563 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46e8134f00 0x7f46e80706b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:54.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.810+0000 7f46ee128700 1 -- 172.21.15.156:0/2837362563 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46e809dea0 msgr2=0x7f46e8070170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:54.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.810+0000 7f46ee128700 1 --2- 172.21.15.156:0/2837362563 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46e809dea0 0x7f46e8070170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:54.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.810+0000 7f46ee128700 1 -- 172.21.15.156:0/2837362563 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e4009550 con 0x7f46e806a770 2023-09-30T22:20:54.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.811+0000 7f46ee128700 1 --2- 172.21.15.156:0/2837362563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46e806a770 0x7f46e806fc30 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f46e4000c00 tx=0x7f46e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:54.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.811+0000 7f46deffd700 1 -- 172.21.15.156:0/2837362563 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4004510 con 0x7f46e806a770 2023-09-30T22:20:54.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.811+0000 7f46deffd700 1 -- 172.21.15.156:0/2837362563 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e401e070 con 0x7f46e806a770 2023-09-30T22:20:54.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.811+0000 7f46deffd700 1 -- 172.21.15.156:0/2837362563 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e40038c0 con 0x7f46e806a770 2023-09-30T22:20:54.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.811+0000 7f46f038c700 1 -- 172.21.15.156:0/2837362563 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e8126720 con 0x7f46e806a770 2023-09-30T22:20:54.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.811+0000 7f46f038c700 1 -- 172.21.15.156:0/2837362563 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e8126d00 con 0x7f46e806a770 2023-09-30T22:20:54.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.812+0000 7f46deffd700 1 -- 172.21.15.156:0/2837362563 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f46e4003a20 con 0x7f46e806a770 2023-09-30T22:20:54.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.812+0000 7f46f038c700 1 -- 172.21.15.156:0/2837362563 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e804f2a0 con 0x7f46e806a770 2023-09-30T22:20:54.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.812+0000 7f46deffd700 1 -- 172.21.15.156:0/2837362563 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f46e4020070 con 0x7f46e806a770 2023-09-30T22:20:54.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.817+0000 7f46deffd700 1 -- 172.21.15.156:0/2837362563 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f46e401a420 con 0x7f46e806a770 2023-09-30T22:20:54.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.858+0000 7f5c8c124700 1 -- 172.21.15.156:0/2161279435 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5c841263d0 con 0x7f5c84134120 2023-09-30T22:20:54.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.858+0000 7f5c7a7fc700 1 -- 172.21.15.156:0/2161279435 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c7c003e30 con 0x7f5c84134120 2023-09-30T22:20:54.859 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:54.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.860+0000 7f5c8c124700 1 -- 172.21.15.156:0/2161279435 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c84134120 msgr2=0x7f5c84123500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:54.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.860+0000 7f5c8c124700 1 --2- 172.21.15.156:0/2161279435 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c84134120 0x7f5c84123500 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c016000 tx=0x7f5c7c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:20:54.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.860+0000 7f5c8c124700 1 -- 172.21.15.156:0/2161279435 shutdown_connections 2023-09-30T22:20:54.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.860+0000 7f5c8c124700 1 --2- 172.21.15.156:0/2161279435 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c84134120 0x7f5c84123500 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:54.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.860+0000 7f5c8c124700 1 --2- 172.21.15.156:0/2161279435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c840a0a70 0x7f5c84122a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:54.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.860+0000 7f5c8c124700 1 --2- 172.21.15.156:0/2161279435 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c840a1380 0x7f5c84122fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:54.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.860+0000 7f5c8c124700 1 -- 172.21.15.156:0/2161279435 >> 172.21.15.156:0/2161279435 conn(0x7f5c840a6610 msgr2=0x7f5c840a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:54.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.861+0000 7f5c8c124700 1 -- 172.21.15.156:0/2161279435 shutdown_connections 2023-09-30T22:20:54.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.861+0000 7f5c8c124700 1 -- 172.21.15.156:0/2161279435 wait complete. 2023-09-30T22:20:54.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:54.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.974+0000 7fd399aa8700 1 -- 172.21.15.156:0/2154827951 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd39404f2a0 con 0x7fd3941371c0 2023-09-30T22:20:54.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.974+0000 7fd37bfff700 1 -- 172.21.15.156:0/2154827951 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd38c02a090 con 0x7fd3941371c0 2023-09-30T22:20:54.975 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:54.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.978+0000 7fd399aa8700 1 -- 172.21.15.156:0/2154827951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3941371c0 msgr2=0x7fd39411f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:54.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.978+0000 7fd399aa8700 1 --2- 172.21.15.156:0/2154827951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3941371c0 0x7fd39411f0a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd38c019000 tx=0x7fd38c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:20:54.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.978+0000 7fd399aa8700 1 -- 172.21.15.156:0/2154827951 shutdown_connections 2023-09-30T22:20:54.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.978+0000 7fd399aa8700 1 --2- 172.21.15.156:0/2154827951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3941371c0 0x7fd39411f0a0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:54.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.978+0000 7fd399aa8700 1 --2- 172.21.15.156:0/2154827951 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd39409e870 0x7fd39411e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:54.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.978+0000 7fd399aa8700 1 --2- 172.21.15.156:0/2154827951 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd39409f350 0x7fd39411eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:54.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.978+0000 7fd399aa8700 1 -- 172.21.15.156:0/2154827951 >> 172.21.15.156:0/2154827951 conn(0x7fd3940a4430 msgr2=0x7fd394071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:54.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.978+0000 7fd399aa8700 1 -- 172.21.15.156:0/2154827951 shutdown_connections 2023-09-30T22:20:54.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:54.978+0000 7fd399aa8700 1 -- 172.21.15.156:0/2154827951 wait complete. 2023-09-30T22:20:54.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:55.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:55.015+0000 7f46f038c700 1 -- 172.21.15.156:0/2837362563 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f46e806c3b0 con 0x7f46e806a770 2023-09-30T22:20:55.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:55.016+0000 7f46deffd700 1 -- 172.21.15.156:0/2837362563 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f46e4015070 con 0x7f46e806a770 2023-09-30T22:20:55.016 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:55.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:55.018+0000 7f46f038c700 1 -- 172.21.15.156:0/2837362563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46e806a770 msgr2=0x7f46e806fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:55.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:55.018+0000 7f46f038c700 1 --2- 172.21.15.156:0/2837362563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46e806a770 0x7f46e806fc30 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f46e4000c00 tx=0x7f46e4004750 comp rx=0 tx=0).stop 2023-09-30T22:20:55.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:55.018+0000 7f46f038c700 1 -- 172.21.15.156:0/2837362563 shutdown_connections 2023-09-30T22:20:55.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:55.018+0000 7f46f038c700 1 --2- 172.21.15.156:0/2837362563 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46e8134f00 0x7f46e80706b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:55.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:55.018+0000 7f46f038c700 1 --2- 172.21.15.156:0/2837362563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46e806a770 0x7f46e806fc30 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:55.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:55.018+0000 7f46f038c700 1 --2- 172.21.15.156:0/2837362563 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46e809dea0 0x7f46e8070170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:55.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:55.018+0000 7f46f038c700 1 -- 172.21.15.156:0/2837362563 >> 172.21.15.156:0/2837362563 conn(0x7f46e8099c40 msgr2=0x7f46e809c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:55.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:55.018+0000 7f46f038c700 1 -- 172.21.15.156:0/2837362563 shutdown_connections 2023-09-30T22:20:55.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:55.018+0000 7f46f038c700 1 -- 172.21.15.156:0/2837362563 wait complete. 2023-09-30T22:20:55.030 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:55.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:55.038+0000 7f60ca76a700 1 -- 172.21.15.156:0/2082438803 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f60c411fa60 con 0x7f60c41309f0 2023-09-30T22:20:55.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:55.038+0000 7f60c0ff9700 1 -- 172.21.15.156:0/2082438803 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f60c411fa60 con 0x7f60c41309f0 2023-09-30T22:20:55.039 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:55.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:55.040+0000 7f60ca76a700 1 -- 172.21.15.156:0/2082438803 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60c41309f0 msgr2=0x7f60c4071700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:55.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:55.040+0000 7f60ca76a700 1 --2- 172.21.15.156:0/2082438803 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60c41309f0 0x7f60c4071700 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f60b8009fd0 tx=0x7f60b8004750 comp rx=0 tx=0).stop 2023-09-30T22:20:55.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:55.040+0000 7f60ca76a700 1 -- 172.21.15.156:0/2082438803 shutdown_connections 2023-09-30T22:20:55.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:55.040+0000 7f60ca76a700 1 --2- 172.21.15.156:0/2082438803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60c4133ad0 0x7f60c4071c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:55.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:55.040+0000 7f60ca76a700 1 --2- 172.21.15.156:0/2082438803 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60c41300a0 0x7f60c40711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:55.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:55.040+0000 7f60ca76a700 1 --2- 172.21.15.156:0/2082438803 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60c41309f0 0x7f60c4071700 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:55.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:55.040+0000 7f60ca76a700 1 -- 172.21.15.156:0/2082438803 >> 172.21.15.156:0/2082438803 conn(0x7f60c4099c40 msgr2=0x7f60c41328f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:55.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:55.041+0000 7f60ca76a700 1 -- 172.21.15.156:0/2082438803 shutdown_connections 2023-09-30T22:20:55.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:55.041+0000 7f60ca76a700 1 -- 172.21.15.156:0/2082438803 wait complete. 2023-09-30T22:20:55.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:55.874 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:55.991 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:56.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.000+0000 7f432ae80700 1 Processor -- start 2023-09-30T22:20:56.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.000+0000 7f432ae80700 1 -- start start 2023-09-30T22:20:56.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.001+0000 7f432ae80700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4324133c80 0x7f4324134050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:56.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.001+0000 7f432ae80700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f43240a08e0 0x7f43240a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:56.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.001+0000 7f432ae80700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4324133a60 con 0x7f43240a1290 2023-09-30T22:20:56.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.001+0000 7f432ae80700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f432409a360 con 0x7f43240a08e0 2023-09-30T22:20:56.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.001+0000 7f432ae80700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f432409a880 con 0x7f4324133c80 2023-09-30T22:20:56.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.001+0000 7f4323fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f43240a08e0 0x7f43240a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:56.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.001+0000 7f4328c1c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4324133c80 0x7f4324134050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:56.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.001+0000 7f432941d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f43240a1290 0x7f432413aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:46144/0 (socket says 172.21.15.156:46144) 2023-09-30T22:20:56.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.001+0000 7f432941d700 1 -- 172.21.15.156:0/2077073245 learned_addr learned my addr 172.21.15.156:0/2077073245 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:56.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.001+0000 7f4323fff700 1 -- 172.21.15.156:0/2077073245 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4324133c80 msgr2=0x7f4324134050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:56.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.001+0000 7f4323fff700 1 --2- 172.21.15.156:0/2077073245 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4324133c80 0x7f4324134050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.001+0000 7f4323fff700 1 -- 172.21.15.156:0/2077073245 >> v1:172.21.15.156:6789/0 conn(0x7f43240a1290 legacy=0x7f432413aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:56.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.001+0000 7f4323fff700 1 -- 172.21.15.156:0/2077073245 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432409ab40 con 0x7f43240a08e0 2023-09-30T22:20:56.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.001+0000 7f43237fe700 1 -- 172.21.15.156:0/2077073245 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 721943061 0 0) 0x7f4324133a60 con 0x7f43240a1290 2023-09-30T22:20:56.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.001+0000 7f4328c1c700 1 --2- 172.21.15.156:0/2077073245 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4324133c80 0x7f4324134050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:56.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.001+0000 7f4323fff700 1 --2- 172.21.15.156:0/2077073245 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43240a08e0 0x7f43240a0d50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f4310009840 tx=0x7f4310009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=752da1c2b8f94bcf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:56.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.002+0000 7f43237fe700 1 -- 172.21.15.156:0/2077073245 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4310011830 con 0x7f43240a08e0 2023-09-30T22:20:56.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.002+0000 7f43237fe700 1 -- 172.21.15.156:0/2077073245 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4310011990 con 0x7f43240a08e0 2023-09-30T22:20:56.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.002+0000 7f43237fe700 1 -- 172.21.15.156:0/2077073245 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4310011d20 con 0x7f43240a08e0 2023-09-30T22:20:56.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.002+0000 7f432ae80700 1 -- 172.21.15.156:0/2077073245 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43240a08e0 msgr2=0x7f43240a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:56.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.002+0000 7f432ae80700 1 --2- 172.21.15.156:0/2077073245 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43240a08e0 0x7f43240a0d50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f4310009840 tx=0x7f4310009b50 comp rx=0 tx=0).stop 2023-09-30T22:20:56.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.002+0000 7f432ae80700 1 -- 172.21.15.156:0/2077073245 shutdown_connections 2023-09-30T22:20:56.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.002+0000 7f432ae80700 1 --2- 172.21.15.156:0/2077073245 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4324133c80 0x7f4324134050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.002+0000 7f432ae80700 1 --2- 172.21.15.156:0/2077073245 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43240a08e0 0x7f43240a0d50 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.002+0000 7f432ae80700 1 -- 172.21.15.156:0/2077073245 >> 172.21.15.156:0/2077073245 conn(0x7f43240a2980 msgr2=0x7f43240a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:56.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.002+0000 7f432ae80700 1 -- 172.21.15.156:0/2077073245 shutdown_connections 2023-09-30T22:20:56.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.002+0000 7f432ae80700 1 -- 172.21.15.156:0/2077073245 wait complete. 2023-09-30T22:20:56.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.003+0000 7f432ae80700 1 Processor -- start 2023-09-30T22:20:56.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.003+0000 7f432ae80700 1 -- start start 2023-09-30T22:20:56.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.004+0000 7f432ae80700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43240a08e0 0x7f432411b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:56.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.004+0000 7f432ae80700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43240a1290 0x7f43241c5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:56.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.004+0000 7f432ae80700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4324133c80 0x7f43241c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:56.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.004+0000 7f432ae80700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432411da20 con 0x7f43240a08e0 2023-09-30T22:20:56.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.004+0000 7f432ae80700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432411dfc0 con 0x7f43240a1290 2023-09-30T22:20:56.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.004+0000 7f432ae80700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f432411dce0 con 0x7f4324133c80 2023-09-30T22:20:56.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.004+0000 7f4328c1c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43240a08e0 0x7f432411b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:56.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.004+0000 7f4323fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43240a1290 0x7f43241c5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:56.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.004+0000 7f4328c1c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43240a08e0 0x7f432411b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60480/0 (socket says 172.21.15.156:60480) 2023-09-30T22:20:56.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.004+0000 7f432941d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4324133c80 0x7f43241c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:56.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.004+0000 7f4328c1c700 1 -- 172.21.15.156:0/4294317790 learned_addr learned my addr 172.21.15.156:0/4294317790 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:56.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.004+0000 7f4328c1c700 1 -- 172.21.15.156:0/4294317790 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4324133c80 msgr2=0x7f43241c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:56.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.004+0000 7f4328c1c700 1 --2- 172.21.15.156:0/4294317790 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4324133c80 0x7f43241c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.004+0000 7f4328c1c700 1 -- 172.21.15.156:0/4294317790 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43240a1290 msgr2=0x7f43241c5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:56.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.004+0000 7f4328c1c700 1 --2- 172.21.15.156:0/4294317790 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43240a1290 0x7f43241c5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.004+0000 7f4328c1c700 1 -- 172.21.15.156:0/4294317790 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43180094a0 con 0x7f43240a08e0 2023-09-30T22:20:56.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.004+0000 7f432941d700 1 --2- 172.21.15.156:0/4294317790 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4324133c80 0x7f43241c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:56.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.004+0000 7f4323fff700 1 --2- 172.21.15.156:0/4294317790 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43240a1290 0x7f43241c5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:56.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.004+0000 7f4328c1c700 1 --2- 172.21.15.156:0/4294317790 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43240a08e0 0x7f432411b4b0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f431800ebe0 tx=0x7f431800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:56.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.005+0000 7f43217fa700 1 -- 172.21.15.156:0/4294317790 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431800c850 con 0x7f43240a08e0 2023-09-30T22:20:56.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.005+0000 7f43217fa700 1 -- 172.21.15.156:0/4294317790 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431800c9b0 con 0x7f43240a08e0 2023-09-30T22:20:56.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.005+0000 7f432ae80700 1 -- 172.21.15.156:0/4294317790 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43100094a0 con 0x7f43240a08e0 2023-09-30T22:20:56.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.005+0000 7f43217fa700 1 -- 172.21.15.156:0/4294317790 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431800cd40 con 0x7f43240a08e0 2023-09-30T22:20:56.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.005+0000 7f432ae80700 1 -- 172.21.15.156:0/4294317790 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43241c5060 con 0x7f43240a08e0 2023-09-30T22:20:56.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.006+0000 7f43217fa700 1 -- 172.21.15.156:0/4294317790 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4318013470 con 0x7f43240a08e0 2023-09-30T22:20:56.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.006+0000 7f432ae80700 1 -- 172.21.15.156:0/4294317790 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f432404f2a0 con 0x7f43240a08e0 2023-09-30T22:20:56.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.006+0000 7f43217fa700 1 -- 172.21.15.156:0/4294317790 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f431803fb30 con 0x7f43240a08e0 2023-09-30T22:20:56.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.011+0000 7f43217fa700 1 -- 172.21.15.156:0/4294317790 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4318013720 con 0x7f43240a08e0 2023-09-30T22:20:56.031 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:56.054 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:56.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.128+0000 7ff08451a700 1 Processor -- start 2023-09-30T22:20:56.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.128+0000 7ff08451a700 1 -- start start 2023-09-30T22:20:56.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.129+0000 7ff08451a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff07c09d860 0x7ff07c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:56.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.129+0000 7ff08451a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff07c130eb0 0x7ff07c138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:56.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.129+0000 7ff08451a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff07c09aaa0 con 0x7ff07c09e170 2023-09-30T22:20:56.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.129+0000 7ff08451a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07c09f870 con 0x7ff07c130eb0 2023-09-30T22:20:56.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.129+0000 7ff08451a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c09b360 con 0x7ff07c09d860 2023-09-30T22:20:56.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.129+0000 7ff081ab5700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff07c09e170 0x7ff07c1307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:46150/0 (socket says 172.21.15.156:46150) 2023-09-30T22:20:56.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.129+0000 7ff081ab5700 1 -- 172.21.15.156:0/1381206433 learned_addr learned my addr 172.21.15.156:0/1381206433 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:56.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.129+0000 7ff082ab7700 1 --2- 172.21.15.156:0/1381206433 >> v2:172.21.15.156:3300/0 conn(0x7ff07c130eb0 0x7ff07c138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:56.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.129+0000 7ff0822b6700 1 --2- 172.21.15.156:0/1381206433 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff07c09d860 0x7ff07c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:56.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.130+0000 7ff082ab7700 1 -- 172.21.15.156:0/1381206433 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff07c09d860 msgr2=0x7ff07c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:56.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.130+0000 7ff082ab7700 1 --2- 172.21.15.156:0/1381206433 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff07c09d860 0x7ff07c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.130+0000 7ff082ab7700 1 -- 172.21.15.156:0/1381206433 >> v1:172.21.15.156:6789/0 conn(0x7ff07c09e170 legacy=0x7ff07c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:56.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.130+0000 7ff082ab7700 1 -- 172.21.15.156:0/1381206433 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07c09b620 con 0x7ff07c130eb0 2023-09-30T22:20:56.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.130+0000 7ff0812b4700 1 -- 172.21.15.156:0/1381206433 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674618788 0 0) 0x7ff07c09aaa0 con 0x7ff07c09e170 2023-09-30T22:20:56.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.130+0000 7ff0822b6700 1 --2- 172.21.15.156:0/1381206433 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff07c09d860 0x7ff07c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:56.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.130+0000 7ff082ab7700 1 --2- 172.21.15.156:0/1381206433 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff07c130eb0 0x7ff07c138a00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff074009d90 tx=0x7ff07400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95182444738bedc7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:56.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.130+0000 7ff0812b4700 1 -- 172.21.15.156:0/1381206433 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07400e070 con 0x7ff07c130eb0 2023-09-30T22:20:56.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.130+0000 7ff0812b4700 1 -- 172.21.15.156:0/1381206433 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07400bb20 con 0x7ff07c130eb0 2023-09-30T22:20:56.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.130+0000 7ff0812b4700 1 -- 172.21.15.156:0/1381206433 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff074012430 con 0x7ff07c130eb0 2023-09-30T22:20:56.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.131+0000 7ff08451a700 1 -- 172.21.15.156:0/1381206433 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff07c130eb0 msgr2=0x7ff07c138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:56.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.131+0000 7ff08451a700 1 --2- 172.21.15.156:0/1381206433 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff07c130eb0 0x7ff07c138a00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff074009d90 tx=0x7ff07400b330 comp rx=0 tx=0).stop 2023-09-30T22:20:56.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.131+0000 7ff08451a700 1 -- 172.21.15.156:0/1381206433 shutdown_connections 2023-09-30T22:20:56.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.131+0000 7ff08451a700 1 --2- 172.21.15.156:0/1381206433 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff07c130eb0 0x7ff07c138a00 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.131+0000 7ff08451a700 1 --2- 172.21.15.156:0/1381206433 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff07c09d860 0x7ff07c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.131+0000 7ff08451a700 1 -- 172.21.15.156:0/1381206433 >> 172.21.15.156:0/1381206433 conn(0x7ff07c099c40 msgr2=0x7ff07c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:56.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.131+0000 7ff08451a700 1 -- 172.21.15.156:0/1381206433 shutdown_connections 2023-09-30T22:20:56.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.131+0000 7ff08451a700 1 -- 172.21.15.156:0/1381206433 wait complete. 2023-09-30T22:20:56.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.133+0000 7ff08451a700 1 Processor -- start 2023-09-30T22:20:56.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.133+0000 7ff08451a700 1 -- start start 2023-09-30T22:20:56.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.133+0000 7ff08451a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff07c09d860 0x7ff07c139ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:56.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.133+0000 7ff08451a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff07c09e170 0x7ff07c13a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:56.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.133+0000 7ff08451a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff07c130eb0 0x7ff07c13a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:56.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.133+0000 7ff08451a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c13af70 con 0x7ff07c09d860 2023-09-30T22:20:56.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.133+0000 7ff08451a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c0a07b0 con 0x7ff07c09e170 2023-09-30T22:20:56.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.133+0000 7ff08451a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c09c8b0 con 0x7ff07c130eb0 2023-09-30T22:20:56.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.134+0000 7ff0822b6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff07c09d860 0x7ff07c139ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:56.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.134+0000 7ff0822b6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff07c09d860 0x7ff07c139ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60496/0 (socket says 172.21.15.156:60496) 2023-09-30T22:20:56.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.134+0000 7ff0822b6700 1 -- 172.21.15.156:0/100482833 learned_addr learned my addr 172.21.15.156:0/100482833 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:56.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.134+0000 7ff082ab7700 1 --2- 172.21.15.156:0/100482833 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff07c130eb0 0x7ff07c13a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:56.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.134+0000 7ff081ab5700 1 --2- 172.21.15.156:0/100482833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff07c09e170 0x7ff07c13a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:56.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.134+0000 7ff0822b6700 1 -- 172.21.15.156:0/100482833 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff07c130eb0 msgr2=0x7ff07c13a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:56.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.134+0000 7ff0822b6700 1 --2- 172.21.15.156:0/100482833 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff07c130eb0 0x7ff07c13a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.134+0000 7ff0822b6700 1 -- 172.21.15.156:0/100482833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff07c09e170 msgr2=0x7ff07c13a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:56.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.134+0000 7ff0822b6700 1 --2- 172.21.15.156:0/100482833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff07c09e170 0x7ff07c13a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.134+0000 7ff0822b6700 1 -- 172.21.15.156:0/100482833 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0780094a0 con 0x7ff07c09d860 2023-09-30T22:20:56.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.134+0000 7ff0822b6700 1 --2- 172.21.15.156:0/100482833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff07c09d860 0x7ff07c139ec0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff07800ebe0 tx=0x7ff07800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:56.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.134+0000 7ff072ffd700 1 -- 172.21.15.156:0/100482833 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07800c850 con 0x7ff07c09d860 2023-09-30T22:20:56.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.134+0000 7ff08451a700 1 -- 172.21.15.156:0/100482833 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff074009a70 con 0x7ff07c09d860 2023-09-30T22:20:56.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.134+0000 7ff072ffd700 1 -- 172.21.15.156:0/100482833 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07800c9b0 con 0x7ff07c09d860 2023-09-30T22:20:56.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.134+0000 7ff072ffd700 1 -- 172.21.15.156:0/100482833 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07800cd20 con 0x7ff07c09d860 2023-09-30T22:20:56.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.135+0000 7ff08451a700 1 -- 172.21.15.156:0/100482833 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff07c1392e0 con 0x7ff07c09d860 2023-09-30T22:20:56.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.136+0000 7ff072ffd700 1 -- 172.21.15.156:0/100482833 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff078013470 con 0x7ff07c09d860 2023-09-30T22:20:56.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.136+0000 7ff072ffd700 1 -- 172.21.15.156:0/100482833 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff07803fb60 con 0x7ff07c09d860 2023-09-30T22:20:56.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.136+0000 7ff08451a700 1 -- 172.21.15.156:0/100482833 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff07c04f2a0 con 0x7ff07c09d860 2023-09-30T22:20:56.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.141+0000 7ff072ffd700 1 -- 172.21.15.156:0/100482833 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff078013720 con 0x7ff07c09d860 2023-09-30T22:20:56.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.164+0000 7faaa6d98700 1 Processor -- start 2023-09-30T22:20:56.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.164+0000 7faaa6d98700 1 -- start start 2023-09-30T22:20:56.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.165+0000 7faaa6d98700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faaa0131980 0x7faaa0131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:56.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.165+0000 7faaa6d98700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7faaa009bc70 0x7faaa009c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:56.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.165+0000 7faaa6d98700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa00a1640 con 0x7faaa009c5c0 2023-09-30T22:20:56.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.165+0000 7faaa6d98700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa006eb30 con 0x7faaa009bc70 2023-09-30T22:20:56.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.165+0000 7faaa6d98700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faaa00a22d0 con 0x7faaa0131980 2023-09-30T22:20:56.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.165+0000 7faaa4b34700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faaa0131980 0x7faaa0131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:56.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.165+0000 7faaa4b34700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faaa0131980 0x7faaa0131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54734/0 (socket says 172.21.15.156:54734) 2023-09-30T22:20:56.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.165+0000 7faaa4b34700 1 -- 172.21.15.156:0/3984691068 learned_addr learned my addr 172.21.15.156:0/3984691068 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:56.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.165+0000 7faa9ffff700 1 --2- 172.21.15.156:0/3984691068 >> v2:172.21.15.156:3300/0 conn(0x7faaa009bc70 0x7faaa009c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:56.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.165+0000 7faa9f7fe700 1 -- 172.21.15.156:0/3984691068 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2237360163 0 0) 0x7faaa00a1640 con 0x7faaa009c5c0 2023-09-30T22:20:56.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.165+0000 7faa9f7fe700 1 -- 172.21.15.156:0/3984691068 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa900035b0 con 0x7faaa009c5c0 2023-09-30T22:20:56.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.165+0000 7faaa4b34700 1 -- 172.21.15.156:0/3984691068 >> v2:172.21.15.156:3300/0 conn(0x7faaa009bc70 msgr2=0x7faaa009c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:56.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.165+0000 7faaa4b34700 1 --2- 172.21.15.156:0/3984691068 >> v2:172.21.15.156:3300/0 conn(0x7faaa009bc70 0x7faaa009c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.165+0000 7faaa4b34700 1 -- 172.21.15.156:0/3984691068 >> v1:172.21.15.156:6789/0 conn(0x7faaa009c5c0 legacy=0x7faaa0138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:56.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.165+0000 7faaa4b34700 1 -- 172.21.15.156:0/3984691068 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa0131550 con 0x7faaa0131980 2023-09-30T22:20:56.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.166+0000 7faaa4b34700 1 --2- 172.21.15.156:0/3984691068 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faaa0131980 0x7faaa0131d50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7faa94006fd0 tx=0x7faa94009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ce6e9f4847a2aa9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:56.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.166+0000 7faa9f7fe700 1 -- 172.21.15.156:0/3984691068 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa94005e30 con 0x7faaa0131980 2023-09-30T22:20:56.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.166+0000 7faa9f7fe700 1 -- 172.21.15.156:0/3984691068 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa94004030 con 0x7faaa0131980 2023-09-30T22:20:56.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.166+0000 7faa9f7fe700 1 -- 172.21.15.156:0/3984691068 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa940043e0 con 0x7faaa0131980 2023-09-30T22:20:56.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.166+0000 7faaa6d98700 1 -- 172.21.15.156:0/3984691068 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faaa0131980 msgr2=0x7faaa0131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:56.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.166+0000 7faaa6d98700 1 --2- 172.21.15.156:0/3984691068 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faaa0131980 0x7faaa0131d50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7faa94006fd0 tx=0x7faa94009bd0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.166+0000 7faaa6d98700 1 -- 172.21.15.156:0/3984691068 shutdown_connections 2023-09-30T22:20:56.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.166+0000 7faaa6d98700 1 --2- 172.21.15.156:0/3984691068 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faaa0131980 0x7faaa0131d50 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.166+0000 7faaa6d98700 1 --2- 172.21.15.156:0/3984691068 >> v2:172.21.15.156:3300/0 conn(0x7faaa009bc70 0x7faaa009c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.166+0000 7faaa6d98700 1 -- 172.21.15.156:0/3984691068 >> 172.21.15.156:0/3984691068 conn(0x7faaa00a2980 msgr2=0x7faaa00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:56.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.167+0000 7faaa6d98700 1 -- 172.21.15.156:0/3984691068 shutdown_connections 2023-09-30T22:20:56.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.167+0000 7faaa6d98700 1 -- 172.21.15.156:0/3984691068 wait complete. 2023-09-30T22:20:56.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.167+0000 7faaa6d98700 1 Processor -- start 2023-09-30T22:20:56.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.168+0000 7faaa6d98700 1 -- start start 2023-09-30T22:20:56.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.168+0000 7faaa6d98700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faaa009bc70 0x7faaa011b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:56.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.168+0000 7faaa6d98700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faaa009c5c0 0x7faaa011be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:56.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.168+0000 7faaa6d98700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faaa0131980 0x7faaa011c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:56.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.168+0000 7faaa6d98700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa011d5e0 con 0x7faaa009bc70 2023-09-30T22:20:56.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.168+0000 7faaa6d98700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa011d3f0 con 0x7faaa009c5c0 2023-09-30T22:20:56.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.168+0000 7faaa6d98700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faaa011dcc0 con 0x7faaa0131980 2023-09-30T22:20:56.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.168+0000 7faaa5335700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faaa0131980 0x7faaa011c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:56.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.168+0000 7faaa4b34700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faaa009bc70 0x7faaa011b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:56.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.168+0000 7faaa5335700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faaa0131980 0x7faaa011c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54750/0 (socket says 172.21.15.156:54750) 2023-09-30T22:20:56.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.168+0000 7faaa5335700 1 -- 172.21.15.156:0/2961093302 learned_addr learned my addr 172.21.15.156:0/2961093302 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:56.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.169+0000 7faaa5335700 1 -- 172.21.15.156:0/2961093302 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faaa009c5c0 msgr2=0x7faaa011be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:56.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.169+0000 7faaa5335700 1 --2- 172.21.15.156:0/2961093302 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faaa009c5c0 0x7faaa011be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.169+0000 7faaa5335700 1 -- 172.21.15.156:0/2961093302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faaa009bc70 msgr2=0x7faaa011b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:56.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.169+0000 7faaa5335700 1 --2- 172.21.15.156:0/2961093302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faaa009bc70 0x7faaa011b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.169+0000 7faaa5335700 1 -- 172.21.15.156:0/2961093302 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa94009500 con 0x7faaa0131980 2023-09-30T22:20:56.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.169+0000 7faaa4b34700 1 --2- 172.21.15.156:0/2961093302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faaa009bc70 0x7faaa011b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:56.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.169+0000 7faaa5335700 1 --2- 172.21.15.156:0/2961093302 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faaa0131980 0x7faaa011c3a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faa9800cc50 tx=0x7faa9800cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:56.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.169+0000 7faa9d7fa700 1 -- 172.21.15.156:0/2961093302 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa98003c00 con 0x7faaa0131980 2023-09-30T22:20:56.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.169+0000 7faaa6d98700 1 -- 172.21.15.156:0/2961093302 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa0130ad0 con 0x7faaa0131980 2023-09-30T22:20:56.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.169+0000 7faa9d7fa700 1 -- 172.21.15.156:0/2961093302 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa98003d60 con 0x7faaa0131980 2023-09-30T22:20:56.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.169+0000 7faa9d7fa700 1 -- 172.21.15.156:0/2961093302 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9800ab80 con 0x7faaa0131980 2023-09-30T22:20:56.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.169+0000 7faaa6d98700 1 -- 172.21.15.156:0/2961093302 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa011f370 con 0x7faaa0131980 2023-09-30T22:20:56.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.170+0000 7faaa6d98700 1 -- 172.21.15.156:0/2961093302 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa004f2a0 con 0x7faaa0131980 2023-09-30T22:20:56.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.170+0000 7faa9d7fa700 1 -- 172.21.15.156:0/2961093302 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faa9800ace0 con 0x7faaa0131980 2023-09-30T22:20:56.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.171+0000 7faa9d7fa700 1 -- 172.21.15.156:0/2961093302 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faa9803f870 con 0x7faaa0131980 2023-09-30T22:20:56.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.175+0000 7faa9d7fa700 1 -- 172.21.15.156:0/2961093302 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa980198f0 con 0x7faaa0131980 2023-09-30T22:20:56.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.216+0000 7f432ae80700 1 -- 172.21.15.156:0/4294317790 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f43240008d0 con 0x7f43240a08e0 2023-09-30T22:20:56.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.217+0000 7f43217fa700 1 -- 172.21.15.156:0/4294317790 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4318017030 con 0x7f43240a08e0 2023-09-30T22:20:56.218 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:56.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.219+0000 7f432ae80700 1 -- 172.21.15.156:0/4294317790 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43240a08e0 msgr2=0x7f432411b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:56.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.219+0000 7f432ae80700 1 --2- 172.21.15.156:0/4294317790 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43240a08e0 0x7f432411b4b0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f431800ebe0 tx=0x7f431800eef0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.219+0000 7f432ae80700 1 -- 172.21.15.156:0/4294317790 shutdown_connections 2023-09-30T22:20:56.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.219+0000 7f432ae80700 1 --2- 172.21.15.156:0/4294317790 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4324133c80 0x7f43241c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.219+0000 7f432ae80700 1 --2- 172.21.15.156:0/4294317790 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43240a08e0 0x7f432411b4b0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.219+0000 7f432ae80700 1 --2- 172.21.15.156:0/4294317790 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43240a1290 0x7f43241c5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.219+0000 7f432ae80700 1 -- 172.21.15.156:0/4294317790 >> 172.21.15.156:0/4294317790 conn(0x7f43240a2980 msgr2=0x7f43241bae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:56.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.219+0000 7f432ae80700 1 -- 172.21.15.156:0/4294317790 shutdown_connections 2023-09-30T22:20:56.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.219+0000 7f432ae80700 1 -- 172.21.15.156:0/4294317790 wait complete. 2023-09-30T22:20:56.235 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:56.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.239+0000 7f2da8ac7700 1 Processor -- start 2023-09-30T22:20:56.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.239+0000 7f2da8ac7700 1 -- start start 2023-09-30T22:20:56.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.240+0000 7f2da8ac7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2da409e870 0x7f2da409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:56.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.240+0000 7f2da8ac7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2da4134330 0x7f2da413be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:56.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.240+0000 7f2da8ac7700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da409fa00 con 0x7f2da409f180 2023-09-30T22:20:56.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.240+0000 7f2da8ac7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da40a0370 con 0x7f2da409e870 2023-09-30T22:20:56.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.240+0000 7f2da8ac7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2da406bec0 con 0x7f2da4134330 2023-09-30T22:20:56.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.240+0000 7f2da1d9b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f2da409f180 0x7f2da4133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:46172/0 (socket says 172.21.15.156:46172) 2023-09-30T22:20:56.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.240+0000 7f2da1d9b700 1 -- 172.21.15.156:0/3958154766 learned_addr learned my addr 172.21.15.156:0/3958154766 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:56.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.240+0000 7f2da259c700 1 --2- 172.21.15.156:0/3958154766 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2da409e870 0x7f2da409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:56.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.240+0000 7f2da2d9d700 1 --2- 172.21.15.156:0/3958154766 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2da4134330 0x7f2da413be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:56.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.240+0000 7f2da159a700 1 -- 172.21.15.156:0/3958154766 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1707655025 0 0) 0x7f2da409fa00 con 0x7f2da409f180 2023-09-30T22:20:56.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.240+0000 7f2da159a700 1 -- 172.21.15.156:0/3958154766 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d8c0035b0 con 0x7f2da409f180 2023-09-30T22:20:56.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.240+0000 7f2da2d9d700 1 -- 172.21.15.156:0/3958154766 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2da409e870 msgr2=0x7f2da409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:56.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.241+0000 7f2da2d9d700 1 --2- 172.21.15.156:0/3958154766 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2da409e870 0x7f2da409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.241+0000 7f2da2d9d700 1 -- 172.21.15.156:0/3958154766 >> v1:172.21.15.156:6789/0 conn(0x7f2da409f180 legacy=0x7f2da4133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:56.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.241+0000 7f2da2d9d700 1 -- 172.21.15.156:0/3958154766 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da409ada0 con 0x7f2da4134330 2023-09-30T22:20:56.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.241+0000 7f2da259c700 1 --2- 172.21.15.156:0/3958154766 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2da409e870 0x7f2da409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:56.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.241+0000 7f2da2d9d700 1 --2- 172.21.15.156:0/3958154766 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2da4134330 0x7f2da413be80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c009dc0 tx=0x7f2d9c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f9f50ffea823527 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:56.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.241+0000 7f2da159a700 1 -- 172.21.15.156:0/3958154766 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c00e070 con 0x7f2da4134330 2023-09-30T22:20:56.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.241+0000 7f2da159a700 1 -- 172.21.15.156:0/3958154766 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9c00bb20 con 0x7f2da4134330 2023-09-30T22:20:56.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.241+0000 7f2da159a700 1 -- 172.21.15.156:0/3958154766 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c012430 con 0x7f2da4134330 2023-09-30T22:20:56.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.242+0000 7f2da8ac7700 1 -- 172.21.15.156:0/3958154766 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2da4134330 msgr2=0x7f2da413be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:56.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.242+0000 7f2da8ac7700 1 --2- 172.21.15.156:0/3958154766 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2da4134330 0x7f2da413be80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c009dc0 tx=0x7f2d9c00b330 comp rx=0 tx=0).stop 2023-09-30T22:20:56.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.242+0000 7f2da8ac7700 1 -- 172.21.15.156:0/3958154766 shutdown_connections 2023-09-30T22:20:56.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.242+0000 7f2da8ac7700 1 --2- 172.21.15.156:0/3958154766 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2da409e870 0x7f2da409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.242+0000 7f2da8ac7700 1 --2- 172.21.15.156:0/3958154766 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2da4134330 0x7f2da413be80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.242+0000 7f2da8ac7700 1 -- 172.21.15.156:0/3958154766 >> 172.21.15.156:0/3958154766 conn(0x7f2da40a4430 msgr2=0x7f2da40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:56.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.242+0000 7f2da8ac7700 1 -- 172.21.15.156:0/3958154766 shutdown_connections 2023-09-30T22:20:56.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.242+0000 7f2da8ac7700 1 -- 172.21.15.156:0/3958154766 wait complete. 2023-09-30T22:20:56.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.243+0000 7f2da8ac7700 1 Processor -- start 2023-09-30T22:20:56.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.243+0000 7f2da8ac7700 1 -- start start 2023-09-30T22:20:56.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.243+0000 7f2da8ac7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2da409e870 0x7f2da4122870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:56.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.243+0000 7f2da8ac7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2da409f180 0x7f2da4122db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:56.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.243+0000 7f2da8ac7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2da4134330 0x7f2da41232f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:56.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.243+0000 7f2da8ac7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da4125a40 con 0x7f2da409f180 2023-09-30T22:20:56.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.243+0000 7f2da8ac7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da41260a0 con 0x7f2da4134330 2023-09-30T22:20:56.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.243+0000 7f2da8ac7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2da4126310 con 0x7f2da409e870 2023-09-30T22:20:56.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.243+0000 7f2da2d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2da4134330 0x7f2da41232f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:56.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.243+0000 7f2da2d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2da4134330 0x7f2da41232f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:36360/0 (socket says 172.21.15.156:36360) 2023-09-30T22:20:56.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.243+0000 7f2da259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2da409e870 0x7f2da4122870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:56.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.243+0000 7f2da2d9d700 1 -- 172.21.15.156:0/2039202823 learned_addr learned my addr 172.21.15.156:0/2039202823 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:56.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.243+0000 7f2da1d9b700 1 --2- 172.21.15.156:0/2039202823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2da409f180 0x7f2da4122db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:56.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.244+0000 7f2da2d9d700 1 -- 172.21.15.156:0/2039202823 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2da409e870 msgr2=0x7f2da4122870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:56.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.244+0000 7f2da2d9d700 1 --2- 172.21.15.156:0/2039202823 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2da409e870 0x7f2da4122870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.244+0000 7f2da2d9d700 1 -- 172.21.15.156:0/2039202823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2da409f180 msgr2=0x7f2da4122db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:56.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.244+0000 7f2da2d9d700 1 --2- 172.21.15.156:0/2039202823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2da409f180 0x7f2da4122db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.244+0000 7f2da2d9d700 1 -- 172.21.15.156:0/2039202823 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d940094a0 con 0x7f2da4134330 2023-09-30T22:20:56.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.244+0000 7f2da259c700 1 --2- 172.21.15.156:0/2039202823 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2da409e870 0x7f2da4122870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:56.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.244+0000 7f2da1d9b700 1 --2- 172.21.15.156:0/2039202823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2da409f180 0x7f2da4122db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:20:56.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.244+0000 7f2da2d9d700 1 --2- 172.21.15.156:0/2039202823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2da4134330 0x7f2da41232f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c014040 tx=0x7f2d9c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:56.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.244+0000 7f2d92ffd700 1 -- 172.21.15.156:0/2039202823 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c0048b0 con 0x7f2da4134330 2023-09-30T22:20:56.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.244+0000 7f2d92ffd700 1 -- 172.21.15.156:0/2039202823 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9c020070 con 0x7f2da4134330 2023-09-30T22:20:56.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.244+0000 7f2da8ac7700 1 -- 172.21.15.156:0/2039202823 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d9c009a70 con 0x7f2da4134330 2023-09-30T22:20:56.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.244+0000 7f2d92ffd700 1 -- 172.21.15.156:0/2039202823 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c0276c0 con 0x7f2da4134330 2023-09-30T22:20:56.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.244+0000 7f2da8ac7700 1 -- 172.21.15.156:0/2039202823 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da406cfa0 con 0x7f2da4134330 2023-09-30T22:20:56.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.245+0000 7f2d92ffd700 1 -- 172.21.15.156:0/2039202823 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d9c012430 con 0x7f2da4134330 2023-09-30T22:20:56.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.245+0000 7f2d92ffd700 1 -- 172.21.15.156:0/2039202823 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2d9c022070 con 0x7f2da4134330 2023-09-30T22:20:56.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.245+0000 7f2da8ac7700 1 -- 172.21.15.156:0/2039202823 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da404f2a0 con 0x7f2da4134330 2023-09-30T22:20:56.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.250+0000 7f2d92ffd700 1 -- 172.21.15.156:0/2039202823 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d9c01c400 con 0x7f2da4134330 2023-09-30T22:20:56.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.371+0000 7ff08451a700 1 -- 172.21.15.156:0/100482833 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff07c06c3b0 con 0x7ff07c09d860 2023-09-30T22:20:56.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.372+0000 7ff072ffd700 1 -- 172.21.15.156:0/100482833 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff07802a090 con 0x7ff07c09d860 2023-09-30T22:20:56.373 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:56.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.374+0000 7ff08451a700 1 -- 172.21.15.156:0/100482833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff07c09d860 msgr2=0x7ff07c139ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:56.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.374+0000 7ff08451a700 1 --2- 172.21.15.156:0/100482833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff07c09d860 0x7ff07c139ec0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff07800ebe0 tx=0x7ff07800eef0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.374+0000 7ff08451a700 1 -- 172.21.15.156:0/100482833 shutdown_connections 2023-09-30T22:20:56.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.374+0000 7ff08451a700 1 --2- 172.21.15.156:0/100482833 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff07c130eb0 0x7ff07c13a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.374+0000 7ff08451a700 1 --2- 172.21.15.156:0/100482833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff07c09d860 0x7ff07c139ec0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.374+0000 7ff08451a700 1 --2- 172.21.15.156:0/100482833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff07c09e170 0x7ff07c13a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.374+0000 7ff08451a700 1 -- 172.21.15.156:0/100482833 >> 172.21.15.156:0/100482833 conn(0x7ff07c099c40 msgr2=0x7ff07c13b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:56.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.374+0000 7ff08451a700 1 -- 172.21.15.156:0/100482833 shutdown_connections 2023-09-30T22:20:56.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.374+0000 7ff08451a700 1 -- 172.21.15.156:0/100482833 wait complete. 2023-09-30T22:20:56.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.376+0000 7faaa6d98700 1 -- 172.21.15.156:0/2961093302 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faaa006bce0 con 0x7faaa0131980 2023-09-30T22:20:56.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.376+0000 7faa9d7fa700 1 -- 172.21.15.156:0/2961093302 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa98011380 con 0x7faaa0131980 2023-09-30T22:20:56.377 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:56.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.379+0000 7faaa6d98700 1 -- 172.21.15.156:0/2961093302 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faaa0131980 msgr2=0x7faaa011c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:56.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.379+0000 7faaa6d98700 1 --2- 172.21.15.156:0/2961093302 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faaa0131980 0x7faaa011c3a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faa9800cc50 tx=0x7faa9800cf60 comp rx=0 tx=0).stop 2023-09-30T22:20:56.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.379+0000 7faaa6d98700 1 -- 172.21.15.156:0/2961093302 shutdown_connections 2023-09-30T22:20:56.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.379+0000 7faaa6d98700 1 --2- 172.21.15.156:0/2961093302 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faaa0131980 0x7faaa011c3a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.379+0000 7faaa6d98700 1 --2- 172.21.15.156:0/2961093302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faaa009bc70 0x7faaa011b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.379+0000 7faaa6d98700 1 --2- 172.21.15.156:0/2961093302 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faaa009c5c0 0x7faaa011be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.379+0000 7faaa6d98700 1 -- 172.21.15.156:0/2961093302 >> 172.21.15.156:0/2961093302 conn(0x7faaa00a2980 msgr2=0x7faaa009f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:56.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.379+0000 7faaa6d98700 1 -- 172.21.15.156:0/2961093302 shutdown_connections 2023-09-30T22:20:56.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.379+0000 7faaa6d98700 1 -- 172.21.15.156:0/2961093302 wait complete. 2023-09-30T22:20:56.393 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:56.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:56.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.451+0000 7f2da8ac7700 1 -- 172.21.15.156:0/2039202823 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2da4124390 con 0x7f2da4134330 2023-09-30T22:20:56.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.451+0000 7f2d92ffd700 1 -- 172.21.15.156:0/2039202823 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d9c036090 con 0x7f2da4134330 2023-09-30T22:20:56.452 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:56.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.454+0000 7f2da8ac7700 1 -- 172.21.15.156:0/2039202823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2da4134330 msgr2=0x7f2da41232f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:56.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.454+0000 7f2da8ac7700 1 --2- 172.21.15.156:0/2039202823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2da4134330 0x7f2da41232f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c014040 tx=0x7f2d9c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.454+0000 7f2da8ac7700 1 -- 172.21.15.156:0/2039202823 shutdown_connections 2023-09-30T22:20:56.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.454+0000 7f2da8ac7700 1 --2- 172.21.15.156:0/2039202823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2da4134330 0x7f2da41232f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.454+0000 7f2da8ac7700 1 --2- 172.21.15.156:0/2039202823 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2da409e870 0x7f2da4122870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.454+0000 7f2da8ac7700 1 --2- 172.21.15.156:0/2039202823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2da409f180 0x7f2da4122db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:56.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.454+0000 7f2da8ac7700 1 -- 172.21.15.156:0/2039202823 >> 172.21.15.156:0/2039202823 conn(0x7f2da40a4430 msgr2=0x7f2da40a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:56.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.454+0000 7f2da8ac7700 1 -- 172.21.15.156:0/2039202823 shutdown_connections 2023-09-30T22:20:56.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:56.454+0000 7f2da8ac7700 1 -- 172.21.15.156:0/2039202823 wait complete. 2023-09-30T22:20:56.466 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:57.236 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:57.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.360+0000 7f974681f700 1 Processor -- start 2023-09-30T22:20:57.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.360+0000 7f974681f700 1 -- start start 2023-09-30T22:20:57.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.360+0000 7f974681f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9740133ad0 0x7f9740133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:57.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.360+0000 7f974681f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f97401300a0 0x7f97401304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:57.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.360+0000 7f974681f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f974006b2d0 con 0x7f97401309f0 2023-09-30T22:20:57.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.361+0000 7f974681f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9740133610 con 0x7f97401300a0 2023-09-30T22:20:57.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.361+0000 7f974681f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f974009a500 con 0x7f9740133ad0 2023-09-30T22:20:57.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.361+0000 7f973ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9740133ad0 0x7f9740133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:57.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.361+0000 7f973f7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f97401300a0 0x7f97401304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:57.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.361+0000 7f973ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9740133ad0 0x7f9740133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:36362/0 (socket says 172.21.15.156:36362) 2023-09-30T22:20:57.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.361+0000 7f973f7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f97401300a0 0x7f97401304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60512/0 (socket says 172.21.15.156:60512) 2023-09-30T22:20:57.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.361+0000 7f973ffff700 1 -- 172.21.15.156:0/848447157 learned_addr learned my addr 172.21.15.156:0/848447157 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:57.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.361+0000 7f973f7fe700 1 -- 172.21.15.156:0/848447157 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9740133ad0 msgr2=0x7f9740133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:57.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.361+0000 7f973f7fe700 1 --2- 172.21.15.156:0/848447157 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9740133ad0 0x7f9740133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.361+0000 7f973f7fe700 1 -- 172.21.15.156:0/848447157 >> v1:172.21.15.156:6789/0 conn(0x7f97401309f0 legacy=0x7f974013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:57.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.361+0000 7f973f7fe700 1 -- 172.21.15.156:0/848447157 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97401338b0 con 0x7f97401300a0 2023-09-30T22:20:57.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.361+0000 7f973effd700 1 -- 172.21.15.156:0/848447157 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 201390489 0 0) 0x7f974006b2d0 con 0x7f97401309f0 2023-09-30T22:20:57.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.361+0000 7f973ffff700 1 --2- 172.21.15.156:0/848447157 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9740133ad0 0x7f9740133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:57.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.361+0000 7f973f7fe700 1 --2- 172.21.15.156:0/848447157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97401300a0 0x7f97401304b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9730009840 tx=0x7f9730009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e5537a3201c8998 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:57.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.361+0000 7f973effd700 1 -- 172.21.15.156:0/848447157 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9730011830 con 0x7f97401300a0 2023-09-30T22:20:57.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.361+0000 7f973effd700 1 -- 172.21.15.156:0/848447157 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9730011990 con 0x7f97401300a0 2023-09-30T22:20:57.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.361+0000 7f973effd700 1 -- 172.21.15.156:0/848447157 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9730011d20 con 0x7f97401300a0 2023-09-30T22:20:57.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.362+0000 7f974681f700 1 -- 172.21.15.156:0/848447157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97401300a0 msgr2=0x7f97401304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:57.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.362+0000 7f974681f700 1 --2- 172.21.15.156:0/848447157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97401300a0 0x7f97401304b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9730009840 tx=0x7f9730009b50 comp rx=0 tx=0).stop 2023-09-30T22:20:57.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.362+0000 7f974681f700 1 -- 172.21.15.156:0/848447157 shutdown_connections 2023-09-30T22:20:57.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.362+0000 7f974681f700 1 --2- 172.21.15.156:0/848447157 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9740133ad0 0x7f9740133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.362+0000 7f974681f700 1 --2- 172.21.15.156:0/848447157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97401300a0 0x7f97401304b0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.362+0000 7f974681f700 1 -- 172.21.15.156:0/848447157 >> 172.21.15.156:0/848447157 conn(0x7f9740099c40 msgr2=0x7f97400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:57.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.362+0000 7f974681f700 1 -- 172.21.15.156:0/848447157 shutdown_connections 2023-09-30T22:20:57.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.362+0000 7f974681f700 1 -- 172.21.15.156:0/848447157 wait complete. 2023-09-30T22:20:57.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.363+0000 7f974681f700 1 Processor -- start 2023-09-30T22:20:57.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.363+0000 7f974681f700 1 -- start start 2023-09-30T22:20:57.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.364+0000 7f974681f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97401300a0 0x7f97400712a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:57.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.364+0000 7f974681f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97401309f0 0x7f97400717e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:57.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.364+0000 7f974681f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9740133ad0 0x7f9740071d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:57.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.364+0000 7f974681f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97400a3470 con 0x7f97401309f0 2023-09-30T22:20:57.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.364+0000 7f974681f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f974011e100 con 0x7f97401300a0 2023-09-30T22:20:57.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.364+0000 7f974681f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f974011f1b0 con 0x7f9740133ad0 2023-09-30T22:20:57.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.364+0000 7f973ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97401300a0 0x7f97400712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:57.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.364+0000 7f973ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97401300a0 0x7f97400712a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:36366/0 (socket says 172.21.15.156:36366) 2023-09-30T22:20:57.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.364+0000 7f973ffff700 1 -- 172.21.15.156:0/1401057708 learned_addr learned my addr 172.21.15.156:0/1401057708 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:57.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.364+0000 7f973f7fe700 1 --2- 172.21.15.156:0/1401057708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97401309f0 0x7f97400717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:57.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.364+0000 7f9744dbc700 1 --2- 172.21.15.156:0/1401057708 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9740133ad0 0x7f9740071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:57.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.364+0000 7f973ffff700 1 -- 172.21.15.156:0/1401057708 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9740133ad0 msgr2=0x7f9740071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:57.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.364+0000 7f973ffff700 1 --2- 172.21.15.156:0/1401057708 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9740133ad0 0x7f9740071d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.364+0000 7f973ffff700 1 -- 172.21.15.156:0/1401057708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97401309f0 msgr2=0x7f97400717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:57.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.364+0000 7f973ffff700 1 --2- 172.21.15.156:0/1401057708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97401309f0 0x7f97400717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.364+0000 7f973ffff700 1 -- 172.21.15.156:0/1401057708 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9734009550 con 0x7f97401300a0 2023-09-30T22:20:57.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.364+0000 7f973ffff700 1 --2- 172.21.15.156:0/1401057708 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97401300a0 0x7f97400712a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f973400ebe0 tx=0x7f973400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:57.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.365+0000 7f973cff9700 1 -- 172.21.15.156:0/1401057708 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973400c850 con 0x7f97401300a0 2023-09-30T22:20:57.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.365+0000 7f973cff9700 1 -- 172.21.15.156:0/1401057708 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973400c9b0 con 0x7f97401300a0 2023-09-30T22:20:57.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.365+0000 7f974681f700 1 -- 172.21.15.156:0/1401057708 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97300094a0 con 0x7f97401300a0 2023-09-30T22:20:57.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.365+0000 7f973cff9700 1 -- 172.21.15.156:0/1401057708 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973400cd20 con 0x7f97401300a0 2023-09-30T22:20:57.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.365+0000 7f974681f700 1 -- 172.21.15.156:0/1401057708 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f974011f8f0 con 0x7f97401300a0 2023-09-30T22:20:57.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.365+0000 7f974681f700 1 -- 172.21.15.156:0/1401057708 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97400a2620 con 0x7f97401300a0 2023-09-30T22:20:57.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.366+0000 7f973cff9700 1 -- 172.21.15.156:0/1401057708 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9734004020 con 0x7f97401300a0 2023-09-30T22:20:57.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.366+0000 7f973cff9700 1 -- 172.21.15.156:0/1401057708 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f973403fc20 con 0x7f97401300a0 2023-09-30T22:20:57.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.370+0000 7f973cff9700 1 -- 172.21.15.156:0/1401057708 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9734011350 con 0x7f97401300a0 2023-09-30T22:20:57.394 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:57.394 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:57.467 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:57.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.523+0000 7fcf2e5a1700 1 Processor -- start 2023-09-30T22:20:57.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.523+0000 7fcf2e5a1700 1 -- start start 2023-09-30T22:20:57.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.524+0000 7fcf2e5a1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf28131980 0x7fcf28131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:57.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.524+0000 7fcf2e5a1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcf2809bc70 0x7fcf2809c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:57.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.524+0000 7fcf2e5a1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf2809c5c0 0x7fcf28138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:57.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.524+0000 7fcf2e5a1700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2806eb30 con 0x7fcf2809bc70 2023-09-30T22:20:57.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.524+0000 7fcf2e5a1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf280a1640 con 0x7fcf28131980 2023-09-30T22:20:57.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.524+0000 7fcf2e5a1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf280a22d0 con 0x7fcf2809c5c0 2023-09-30T22:20:57.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.524+0000 7fcf277fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcf2809bc70 0x7fcf2809c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:57.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.524+0000 7fcf2cb3e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf2809c5c0 0x7fcf28138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:57.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.524+0000 7fcf2cb3e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf2809c5c0 0x7fcf28138700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54774/0 (socket says 172.21.15.156:54774) 2023-09-30T22:20:57.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.524+0000 7fcf277fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcf2809bc70 0x7fcf2809c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60530/0 (socket says 172.21.15.156:60530) 2023-09-30T22:20:57.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.524+0000 7fcf2cb3e700 1 -- 172.21.15.156:0/3182739280 learned_addr learned my addr 172.21.15.156:0/3182739280 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:57.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.524+0000 7fcf27fff700 1 --2- 172.21.15.156:0/3182739280 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf28131980 0x7fcf28131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:57.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.524+0000 7fecd882f700 1 Processor -- start 2023-09-30T22:20:57.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.524+0000 7fcf277fe700 1 -- 172.21.15.156:0/3182739280 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf2809c5c0 msgr2=0x7fcf28138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:57.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.524+0000 7fcf277fe700 1 --2- 172.21.15.156:0/3182739280 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf2809c5c0 0x7fcf28138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.524+0000 7fcf277fe700 1 -- 172.21.15.156:0/3182739280 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf28131980 msgr2=0x7fcf28131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:57.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.524+0000 7fcf277fe700 1 --2- 172.21.15.156:0/3182739280 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf28131980 0x7fcf28131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.524+0000 7fcf277fe700 1 -- 172.21.15.156:0/3182739280 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf28131550 con 0x7fcf2809bc70 2023-09-30T22:20:57.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.525+0000 7fecd882f700 1 -- start start 2023-09-30T22:20:57.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.525+0000 7fcf277fe700 1 --2- 172.21.15.156:0/3182739280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf2809bc70 0x7fcf2809c080 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c009870 tx=0x7fcf1c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd2c2c57897bdd5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:57.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.525+0000 7fcf26ffd700 1 -- 172.21.15.156:0/3182739280 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c011830 con 0x7fcf2809bc70 2023-09-30T22:20:57.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.525+0000 7fcf26ffd700 1 -- 172.21.15.156:0/3182739280 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1c011990 con 0x7fcf2809bc70 2023-09-30T22:20:57.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.525+0000 7fcf26ffd700 1 -- 172.21.15.156:0/3182739280 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c011d20 con 0x7fcf2809bc70 2023-09-30T22:20:57.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.525+0000 7fecd882f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fecd4134140 0x7fecd4138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:57.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.525+0000 7fecd882f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecd4134570 0x7fecd413b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:57.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.525+0000 7fecd882f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd409b110 con 0x7fecd409ad40 2023-09-30T22:20:57.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.525+0000 7fecd882f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd40a3b60 con 0x7fecd4134570 2023-09-30T22:20:57.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.525+0000 7fecd882f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecd40a1a80 con 0x7fecd4134140 2023-09-30T22:20:57.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.526+0000 7fecd2d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecd4134570 0x7fecd413b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:57.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.526+0000 7fecd2d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecd4134570 0x7fecd413b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:36386/0 (socket says 172.21.15.156:36386) 2023-09-30T22:20:57.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.526+0000 7fecd2d9d700 1 -- 172.21.15.156:0/919980108 learned_addr learned my addr 172.21.15.156:0/919980108 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:57.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.526+0000 7fecd1d9b700 1 --2- 172.21.15.156:0/919980108 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fecd4134140 0x7fecd4138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:57.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.526+0000 7fcf2e5a1700 1 -- 172.21.15.156:0/3182739280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf2809bc70 msgr2=0x7fcf2809c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:57.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.526+0000 7fcf2e5a1700 1 --2- 172.21.15.156:0/3182739280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf2809bc70 0x7fcf2809c080 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c009870 tx=0x7fcf1c009b80 comp rx=0 tx=0).stop 2023-09-30T22:20:57.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.526+0000 7fcf2e5a1700 1 -- 172.21.15.156:0/3182739280 shutdown_connections 2023-09-30T22:20:57.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.526+0000 7fcf2e5a1700 1 --2- 172.21.15.156:0/3182739280 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf2809c5c0 0x7fcf28138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.526+0000 7fcf2e5a1700 1 --2- 172.21.15.156:0/3182739280 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf28131980 0x7fcf28131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.526+0000 7fcf2e5a1700 1 --2- 172.21.15.156:0/3182739280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf2809bc70 0x7fcf2809c080 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.526+0000 7fcf2e5a1700 1 -- 172.21.15.156:0/3182739280 >> 172.21.15.156:0/3182739280 conn(0x7fcf280a2980 msgr2=0x7fcf280a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:57.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.526+0000 7fecd2d9d700 1 -- 172.21.15.156:0/919980108 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fecd4134140 msgr2=0x7fecd4138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:57.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.526+0000 7fecd2d9d700 1 --2- 172.21.15.156:0/919980108 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fecd4134140 0x7fecd4138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.526+0000 7fecd2d9d700 1 -- 172.21.15.156:0/919980108 >> v1:172.21.15.156:6789/0 conn(0x7fecd409ad40 legacy=0x7fecd4133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:57.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.526+0000 7fecd2d9d700 1 -- 172.21.15.156:0/919980108 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd40a2fa0 con 0x7fecd4134570 2023-09-30T22:20:57.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.526+0000 7fcf2e5a1700 1 -- 172.21.15.156:0/3182739280 shutdown_connections 2023-09-30T22:20:57.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.526+0000 7fecd2d9d700 1 --2- 172.21.15.156:0/919980108 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecd4134570 0x7fecd413b3d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7feccc009eb0 tx=0x7feccc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6da7f16aa3170102 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:57.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.526+0000 7fcf2e5a1700 1 -- 172.21.15.156:0/3182739280 wait complete. 2023-09-30T22:20:57.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.526+0000 7fecd159a700 1 -- 172.21.15.156:0/919980108 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc00e070 con 0x7fecd4134570 2023-09-30T22:20:57.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.526+0000 7fecd159a700 1 -- 172.21.15.156:0/919980108 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feccc00b980 con 0x7fecd4134570 2023-09-30T22:20:57.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.526+0000 7fecd159a700 1 -- 172.21.15.156:0/919980108 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc00bd30 con 0x7fecd4134570 2023-09-30T22:20:57.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.527+0000 7fcf2e5a1700 1 Processor -- start 2023-09-30T22:20:57.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.527+0000 7fecd882f700 1 -- 172.21.15.156:0/919980108 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecd4134570 msgr2=0x7fecd413b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:57.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.527+0000 7fecd882f700 1 --2- 172.21.15.156:0/919980108 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecd4134570 0x7fecd413b3d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7feccc009eb0 tx=0x7feccc00b330 comp rx=0 tx=0).stop 2023-09-30T22:20:57.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.527+0000 7fcf2e5a1700 1 -- start start 2023-09-30T22:20:57.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.527+0000 7fecd882f700 1 -- 172.21.15.156:0/919980108 shutdown_connections 2023-09-30T22:20:57.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.527+0000 7fecd882f700 1 --2- 172.21.15.156:0/919980108 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecd4134570 0x7fecd413b3d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.527+0000 7fecd882f700 1 --2- 172.21.15.156:0/919980108 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fecd4134140 0x7fecd4138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.527+0000 7fecd882f700 1 -- 172.21.15.156:0/919980108 >> 172.21.15.156:0/919980108 conn(0x7fecd4099c40 msgr2=0x7fecd406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:57.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.528+0000 7fecd882f700 1 -- 172.21.15.156:0/919980108 shutdown_connections 2023-09-30T22:20:57.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.528+0000 7fecd882f700 1 -- 172.21.15.156:0/919980108 wait complete. 2023-09-30T22:20:57.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.528+0000 7fcf2e5a1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf2809bc70 0x7fcf28135870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:57.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.528+0000 7fcf2e5a1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf2809c5c0 0x7fcf28135db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:57.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.528+0000 7fcf2e5a1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf28131980 0x7fcf281c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:57.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.528+0000 7fcf2e5a1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf28118f00 con 0x7fcf2809bc70 2023-09-30T22:20:57.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.528+0000 7fcf2e5a1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf28135550 con 0x7fcf2809c5c0 2023-09-30T22:20:57.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.528+0000 7fcf2e5a1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf28137a70 con 0x7fcf28131980 2023-09-30T22:20:57.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.528+0000 7fcf2cb3e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf28131980 0x7fcf281c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:57.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.528+0000 7fcf2cb3e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf28131980 0x7fcf281c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54792/0 (socket says 172.21.15.156:54792) 2023-09-30T22:20:57.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.528+0000 7fcf2cb3e700 1 -- 172.21.15.156:0/3373986412 learned_addr learned my addr 172.21.15.156:0/3373986412 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:57.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.528+0000 7fcf2cb3e700 1 -- 172.21.15.156:0/3373986412 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf2809c5c0 msgr2=0x7fcf28135db0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:20:57.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.528+0000 7fcf2cb3e700 1 --2- 172.21.15.156:0/3373986412 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf2809c5c0 0x7fcf28135db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.528+0000 7fcf2cb3e700 1 -- 172.21.15.156:0/3373986412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf2809bc70 msgr2=0x7fcf28135870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:20:57.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.528+0000 7fcf2cb3e700 1 --2- 172.21.15.156:0/3373986412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf2809bc70 0x7fcf28135870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.528+0000 7fcf2cb3e700 1 -- 172.21.15.156:0/3373986412 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c0094a0 con 0x7fcf28131980 2023-09-30T22:20:57.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.529+0000 7fcf2cb3e700 1 --2- 172.21.15.156:0/3373986412 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf28131980 0x7fcf281c8220 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcf2000ef00 tx=0x7fcf2000b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:57.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.529+0000 7fcf24ff9700 1 -- 172.21.15.156:0/3373986412 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20010040 con 0x7fcf28131980 2023-09-30T22:20:57.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.529+0000 7fcf2e5a1700 1 -- 172.21.15.156:0/3373986412 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf28137200 con 0x7fcf28131980 2023-09-30T22:20:57.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.529+0000 7fcf2e5a1700 1 -- 172.21.15.156:0/3373986412 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf28136c50 con 0x7fcf28131980 2023-09-30T22:20:57.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.529+0000 7fecd882f700 1 Processor -- start 2023-09-30T22:20:57.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.529+0000 7fcf24ff9700 1 -- 172.21.15.156:0/3373986412 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf20003c20 con 0x7fcf28131980 2023-09-30T22:20:57.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.529+0000 7fcf24ff9700 1 -- 172.21.15.156:0/3373986412 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20009e60 con 0x7fcf28131980 2023-09-30T22:20:57.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.529+0000 7fecd882f700 1 -- start start 2023-09-30T22:20:57.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.530+0000 7fecd882f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecd409ad40 0x7fecd4071350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:57.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.530+0000 7fecd882f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecd4134140 0x7fecd4071890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:57.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.530+0000 7fecd882f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fecd4134570 0x7fecd406da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:57.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.530+0000 7fecd882f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd4070af0 con 0x7fecd409ad40 2023-09-30T22:20:57.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.530+0000 7fecd882f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd406fe30 con 0x7fecd4134140 2023-09-30T22:20:57.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.530+0000 7fecd882f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecd4070110 con 0x7fecd4134570 2023-09-30T22:20:57.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.530+0000 7fecd1d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecd4134140 0x7fecd4071890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:57.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.530+0000 7fcf24ff9700 1 -- 172.21.15.156:0/3373986412 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf2000b920 con 0x7fcf28131980 2023-09-30T22:20:57.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.530+0000 7fcf24ff9700 1 -- 172.21.15.156:0/3373986412 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcf2003f700 con 0x7fcf28131980 2023-09-30T22:20:57.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.530+0000 7fecd1d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecd4134140 0x7fecd4071890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:36412/0 (socket says 172.21.15.156:36412) 2023-09-30T22:20:57.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.530+0000 7fecd1d9b700 1 -- 172.21.15.156:0/2877385331 learned_addr learned my addr 172.21.15.156:0/2877385331 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:57.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.530+0000 7fecd2d9d700 1 --2- 172.21.15.156:0/2877385331 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fecd4134570 0x7fecd406da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:57.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.530+0000 7fecd259c700 1 --2- 172.21.15.156:0/2877385331 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecd409ad40 0x7fecd4071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:57.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.531+0000 7fcf2e5a1700 1 -- 172.21.15.156:0/3373986412 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf080052e0 con 0x7fcf28131980 2023-09-30T22:20:57.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.531+0000 7fecd259c700 1 -- 172.21.15.156:0/2877385331 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fecd4134570 msgr2=0x7fecd406da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:57.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.531+0000 7fecd259c700 1 --2- 172.21.15.156:0/2877385331 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fecd4134570 0x7fecd406da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.531+0000 7fecd259c700 1 -- 172.21.15.156:0/2877385331 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecd4134140 msgr2=0x7fecd4071890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:57.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.531+0000 7fecd259c700 1 --2- 172.21.15.156:0/2877385331 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecd4134140 0x7fecd4071890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.531+0000 7fecd259c700 1 -- 172.21.15.156:0/2877385331 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feccc009b30 con 0x7fecd409ad40 2023-09-30T22:20:57.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.531+0000 7fecd259c700 1 --2- 172.21.15.156:0/2877385331 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecd409ad40 0x7fecd4071350 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fecc4000f60 tx=0x7fecc400c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:57.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.531+0000 7fecc2ffd700 1 -- 172.21.15.156:0/2877385331 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc40052d0 con 0x7fecd409ad40 2023-09-30T22:20:57.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.531+0000 7fecc2ffd700 1 -- 172.21.15.156:0/2877385331 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc4005430 con 0x7fecd409ad40 2023-09-30T22:20:57.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.531+0000 7fecd882f700 1 -- 172.21.15.156:0/2877385331 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd409e880 con 0x7fecd409ad40 2023-09-30T22:20:57.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.531+0000 7fecc2ffd700 1 -- 172.21.15.156:0/2877385331 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4003880 con 0x7fecd409ad40 2023-09-30T22:20:57.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.531+0000 7fecd882f700 1 -- 172.21.15.156:0/2877385331 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd4139920 con 0x7fecd409ad40 2023-09-30T22:20:57.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.532+0000 7fecc2ffd700 1 -- 172.21.15.156:0/2877385331 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fecc4003bf0 con 0x7fecd409ad40 2023-09-30T22:20:57.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.532+0000 7fecc2ffd700 1 -- 172.21.15.156:0/2877385331 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fecc403eba0 con 0x7fecd409ad40 2023-09-30T22:20:57.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.533+0000 7fecd882f700 1 -- 172.21.15.156:0/2877385331 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd406ff70 con 0x7fecd409ad40 2023-09-30T22:20:57.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.540+0000 7fecc2ffd700 1 -- 172.21.15.156:0/2877385331 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fecd406ff70 con 0x7fecd409ad40 2023-09-30T22:20:57.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.540+0000 7fcf24ff9700 1 -- 172.21.15.156:0/3373986412 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf20013360 con 0x7fcf28131980 2023-09-30T22:20:57.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.576+0000 7f974681f700 1 -- 172.21.15.156:0/1401057708 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f974004f2a0 con 0x7f97401300a0 2023-09-30T22:20:57.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.577+0000 7f973cff9700 1 -- 172.21.15.156:0/1401057708 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9734017020 con 0x7f97401300a0 2023-09-30T22:20:57.578 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:57.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.579+0000 7f974681f700 1 -- 172.21.15.156:0/1401057708 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97401300a0 msgr2=0x7f97400712a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:57.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.579+0000 7f974681f700 1 --2- 172.21.15.156:0/1401057708 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97401300a0 0x7f97400712a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f973400ebe0 tx=0x7f973400eef0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.579+0000 7f974681f700 1 -- 172.21.15.156:0/1401057708 shutdown_connections 2023-09-30T22:20:57.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.579+0000 7f974681f700 1 --2- 172.21.15.156:0/1401057708 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9740133ad0 0x7f9740071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.579+0000 7f974681f700 1 --2- 172.21.15.156:0/1401057708 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97401300a0 0x7f97400712a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.579+0000 7f974681f700 1 --2- 172.21.15.156:0/1401057708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97401309f0 0x7f97400717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.579+0000 7f974681f700 1 -- 172.21.15.156:0/1401057708 >> 172.21.15.156:0/1401057708 conn(0x7f9740099c40 msgr2=0x7f97401329b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:57.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.579+0000 7f974681f700 1 -- 172.21.15.156:0/1401057708 shutdown_connections 2023-09-30T22:20:57.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.579+0000 7f974681f700 1 -- 172.21.15.156:0/1401057708 wait complete. 2023-09-30T22:20:57.593 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:57.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.599+0000 7fe29bd92700 1 Processor -- start 2023-09-30T22:20:57.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.600+0000 7fe29bd92700 1 -- start start 2023-09-30T22:20:57.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.600+0000 7fe29bd92700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2941335f0 0x7fe2941359d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:57.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.600+0000 7fe29bd92700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe294135f10 0x7fe2941382f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:57.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.600+0000 7fe29bd92700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29409bb90 con 0x7fe29412d380 2023-09-30T22:20:57.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.600+0000 7fe29bd92700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe29409c210 con 0x7fe294135f10 2023-09-30T22:20:57.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.600+0000 7fe29bd92700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29409ced0 con 0x7fe2941335f0 2023-09-30T22:20:57.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.600+0000 7fe299b2e700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe29412d380 0x7fe29412d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:46202/0 (socket says 172.21.15.156:46202) 2023-09-30T22:20:57.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.600+0000 7fe29932d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2941335f0 0x7fe2941359d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:57.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.600+0000 7fe299b2e700 1 -- 172.21.15.156:0/3550176382 learned_addr learned my addr 172.21.15.156:0/3550176382 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:57.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.601+0000 7fe29a32f700 1 --2- 172.21.15.156:0/3550176382 >> v2:172.21.15.156:3300/0 conn(0x7fe294135f10 0x7fe2941382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:57.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.601+0000 7fe298b2c700 1 -- 172.21.15.156:0/3550176382 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1658459098 0 0) 0x7fe29409bb90 con 0x7fe29412d380 2023-09-30T22:20:57.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.601+0000 7fe298b2c700 1 -- 172.21.15.156:0/3550176382 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2800035b0 con 0x7fe29412d380 2023-09-30T22:20:57.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.601+0000 7fe29a32f700 1 -- 172.21.15.156:0/3550176382 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2941335f0 msgr2=0x7fe2941359d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:57.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.601+0000 7fe29a32f700 1 --2- 172.21.15.156:0/3550176382 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2941335f0 0x7fe2941359d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.601+0000 7fe29a32f700 1 -- 172.21.15.156:0/3550176382 >> v1:172.21.15.156:6789/0 conn(0x7fe29412d380 legacy=0x7fe29412d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:57.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.601+0000 7fe29a32f700 1 -- 172.21.15.156:0/3550176382 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29409ac30 con 0x7fe294135f10 2023-09-30T22:20:57.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.601+0000 7fe29932d700 1 --2- 172.21.15.156:0/3550176382 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2941335f0 0x7fe2941359d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:57.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.601+0000 7fe29a32f700 1 --2- 172.21.15.156:0/3550176382 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe294135f10 0x7fe2941382f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe28c009d90 tx=0x7fe28c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34b8629b97faf5e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:57.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.601+0000 7fe298b2c700 1 -- 172.21.15.156:0/3550176382 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c00e070 con 0x7fe294135f10 2023-09-30T22:20:57.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.601+0000 7fe298b2c700 1 -- 172.21.15.156:0/3550176382 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28c00bb20 con 0x7fe294135f10 2023-09-30T22:20:57.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.601+0000 7fe298b2c700 1 -- 172.21.15.156:0/3550176382 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c012430 con 0x7fe294135f10 2023-09-30T22:20:57.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.602+0000 7fe29bd92700 1 -- 172.21.15.156:0/3550176382 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe294135f10 msgr2=0x7fe2941382f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:57.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.602+0000 7fe29bd92700 1 --2- 172.21.15.156:0/3550176382 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe294135f10 0x7fe2941382f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe28c009d90 tx=0x7fe28c00b330 comp rx=0 tx=0).stop 2023-09-30T22:20:57.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.602+0000 7fe29bd92700 1 -- 172.21.15.156:0/3550176382 shutdown_connections 2023-09-30T22:20:57.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.602+0000 7fe29bd92700 1 --2- 172.21.15.156:0/3550176382 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe294135f10 0x7fe2941382f0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.602+0000 7fe29bd92700 1 --2- 172.21.15.156:0/3550176382 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2941335f0 0x7fe2941359d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.602+0000 7fe29bd92700 1 -- 172.21.15.156:0/3550176382 >> 172.21.15.156:0/3550176382 conn(0x7fe2940a2980 msgr2=0x7fe2940a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:57.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.602+0000 7fe29bd92700 1 -- 172.21.15.156:0/3550176382 shutdown_connections 2023-09-30T22:20:57.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.602+0000 7fe29bd92700 1 -- 172.21.15.156:0/3550176382 wait complete. 2023-09-30T22:20:57.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.603+0000 7fe29bd92700 1 Processor -- start 2023-09-30T22:20:57.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.603+0000 7fe29bd92700 1 -- start start 2023-09-30T22:20:57.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.603+0000 7fe29bd92700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe29412d380 0x7fe294139870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:57.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.603+0000 7fe29bd92700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2941335f0 0x7fe294139db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:57.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.603+0000 7fe29bd92700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe294135f10 0x7fe29413a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:57.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.603+0000 7fe29bd92700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2941307f0 con 0x7fe294135f10 2023-09-30T22:20:57.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.603+0000 7fe29bd92700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe294131380 con 0x7fe2941335f0 2023-09-30T22:20:57.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.603+0000 7fe29bd92700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe29413b430 con 0x7fe29412d380 2023-09-30T22:20:57.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.603+0000 7fe29932d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2941335f0 0x7fe294139db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:57.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.603+0000 7fe29932d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2941335f0 0x7fe294139db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:36424/0 (socket says 172.21.15.156:36424) 2023-09-30T22:20:57.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.603+0000 7fe299b2e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe29412d380 0x7fe294139870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:57.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.603+0000 7fe29932d700 1 -- 172.21.15.156:0/3561921221 learned_addr learned my addr 172.21.15.156:0/3561921221 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:57.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.604+0000 7fe29a32f700 1 --2- 172.21.15.156:0/3561921221 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe294135f10 0x7fe29413a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:57.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.604+0000 7fe29932d700 1 -- 172.21.15.156:0/3561921221 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe29412d380 msgr2=0x7fe294139870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:57.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.604+0000 7fe29932d700 1 --2- 172.21.15.156:0/3561921221 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe29412d380 0x7fe294139870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.604+0000 7fe29932d700 1 -- 172.21.15.156:0/3561921221 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe294135f10 msgr2=0x7fe29413a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:57.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.604+0000 7fe29932d700 1 --2- 172.21.15.156:0/3561921221 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe294135f10 0x7fe29413a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.604+0000 7fe29932d700 1 -- 172.21.15.156:0/3561921221 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2840094a0 con 0x7fe2941335f0 2023-09-30T22:20:57.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.604+0000 7fe299b2e700 1 --2- 172.21.15.156:0/3561921221 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe29412d380 0x7fe294139870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:57.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.604+0000 7fe29932d700 1 --2- 172.21.15.156:0/3561921221 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2941335f0 0x7fe294139db0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe28400ebe0 tx=0x7fe28400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:57.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.604+0000 7fe28a7fc700 1 -- 172.21.15.156:0/3561921221 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe284009800 con 0x7fe2941335f0 2023-09-30T22:20:57.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.604+0000 7fe28a7fc700 1 -- 172.21.15.156:0/3561921221 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28400c910 con 0x7fe2941335f0 2023-09-30T22:20:57.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.604+0000 7fe29bd92700 1 -- 172.21.15.156:0/3561921221 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe28c009a70 con 0x7fe2941335f0 2023-09-30T22:20:57.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.604+0000 7fe28a7fc700 1 -- 172.21.15.156:0/3561921221 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28400cc80 con 0x7fe2941335f0 2023-09-30T22:20:57.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.604+0000 7fe29bd92700 1 -- 172.21.15.156:0/3561921221 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe294139310 con 0x7fe2941335f0 2023-09-30T22:20:57.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.605+0000 7fe28a7fc700 1 -- 172.21.15.156:0/3561921221 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe284013470 con 0x7fe2941335f0 2023-09-30T22:20:57.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.605+0000 7fe29bd92700 1 -- 172.21.15.156:0/3561921221 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe29409b440 con 0x7fe2941335f0 2023-09-30T22:20:57.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.605+0000 7fe28a7fc700 1 -- 172.21.15.156:0/3561921221 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe28403fbc0 con 0x7fe2941335f0 2023-09-30T22:20:57.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.610+0000 7fe28a7fc700 1 -- 172.21.15.156:0/3561921221 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe284013720 con 0x7fe2941335f0 2023-09-30T22:20:57.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.735+0000 7fecd882f700 1 -- 172.21.15.156:0/2877385331 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fecd406ff70 con 0x7fecd409ad40 2023-09-30T22:20:57.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.736+0000 7fecc2ffd700 1 -- 172.21.15.156:0/2877385331 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fecd406ff70 con 0x7fecd409ad40 2023-09-30T22:20:57.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.736+0000 7fcf2e5a1700 1 -- 172.21.15.156:0/3373986412 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcf08005590 con 0x7fcf28131980 2023-09-30T22:20:57.737 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:57.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.736+0000 7fcf24ff9700 1 -- 172.21.15.156:0/3373986412 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcf2001a020 con 0x7fcf28131980 2023-09-30T22:20:57.738 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:57.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.738+0000 7fecd882f700 1 -- 172.21.15.156:0/2877385331 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecd409ad40 msgr2=0x7fecd4071350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:57.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.738+0000 7fecd882f700 1 --2- 172.21.15.156:0/2877385331 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecd409ad40 0x7fecd4071350 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fecc4000f60 tx=0x7fecc400c6e0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.738+0000 7fecd882f700 1 -- 172.21.15.156:0/2877385331 shutdown_connections 2023-09-30T22:20:57.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.738+0000 7fecd882f700 1 --2- 172.21.15.156:0/2877385331 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fecd4134570 0x7fecd406da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.738+0000 7fecd882f700 1 --2- 172.21.15.156:0/2877385331 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecd409ad40 0x7fecd4071350 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.738+0000 7fecd882f700 1 --2- 172.21.15.156:0/2877385331 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecd4134140 0x7fecd4071890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.738+0000 7fecd882f700 1 -- 172.21.15.156:0/2877385331 >> 172.21.15.156:0/2877385331 conn(0x7fecd4099c40 msgr2=0x7fecd40a6120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:57.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.738+0000 7fecd882f700 1 -- 172.21.15.156:0/2877385331 shutdown_connections 2023-09-30T22:20:57.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.738+0000 7fecd882f700 1 -- 172.21.15.156:0/2877385331 wait complete. 2023-09-30T22:20:57.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.738+0000 7fcf2e5a1700 1 -- 172.21.15.156:0/3373986412 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf28131980 msgr2=0x7fcf281c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:57.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.738+0000 7fcf2e5a1700 1 --2- 172.21.15.156:0/3373986412 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf28131980 0x7fcf281c8220 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcf2000ef00 tx=0x7fcf2000b390 comp rx=0 tx=0).stop 2023-09-30T22:20:57.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.738+0000 7fcf2e5a1700 1 -- 172.21.15.156:0/3373986412 shutdown_connections 2023-09-30T22:20:57.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.738+0000 7fcf2e5a1700 1 --2- 172.21.15.156:0/3373986412 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf28131980 0x7fcf281c8220 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.738+0000 7fcf2e5a1700 1 --2- 172.21.15.156:0/3373986412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf2809bc70 0x7fcf28135870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.738+0000 7fcf2e5a1700 1 --2- 172.21.15.156:0/3373986412 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf2809c5c0 0x7fcf28135db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.738+0000 7fcf2e5a1700 1 -- 172.21.15.156:0/3373986412 >> 172.21.15.156:0/3373986412 conn(0x7fcf280a2980 msgr2=0x7fcf2809f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:57.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.738+0000 7fcf2e5a1700 1 -- 172.21.15.156:0/3373986412 shutdown_connections 2023-09-30T22:20:57.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.738+0000 7fcf2e5a1700 1 -- 172.21.15.156:0/3373986412 wait complete. 2023-09-30T22:20:57.752 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:57.754 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:57.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.802+0000 7fe29bd92700 1 -- 172.21.15.156:0/3561921221 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe29409e9b0 con 0x7fe2941335f0 2023-09-30T22:20:57.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.802+0000 7fe28a7fc700 1 -- 172.21.15.156:0/3561921221 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe284021020 con 0x7fe2941335f0 2023-09-30T22:20:57.803 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:57.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.804+0000 7fe29bd92700 1 -- 172.21.15.156:0/3561921221 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2941335f0 msgr2=0x7fe294139db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:57.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.804+0000 7fe29bd92700 1 --2- 172.21.15.156:0/3561921221 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2941335f0 0x7fe294139db0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe28400ebe0 tx=0x7fe28400eef0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.804+0000 7fe29bd92700 1 -- 172.21.15.156:0/3561921221 shutdown_connections 2023-09-30T22:20:57.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.804+0000 7fe29bd92700 1 --2- 172.21.15.156:0/3561921221 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe294135f10 0x7fe29413a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.804+0000 7fe29bd92700 1 --2- 172.21.15.156:0/3561921221 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe29412d380 0x7fe294139870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.804+0000 7fe29bd92700 1 --2- 172.21.15.156:0/3561921221 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe2941335f0 0x7fe294139db0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:57.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.804+0000 7fe29bd92700 1 -- 172.21.15.156:0/3561921221 >> 172.21.15.156:0/3561921221 conn(0x7fe2940a2980 msgr2=0x7fe294138ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:57.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.804+0000 7fe29bd92700 1 -- 172.21.15.156:0/3561921221 shutdown_connections 2023-09-30T22:20:57.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:57.804+0000 7fe29bd92700 1 -- 172.21.15.156:0/3561921221 wait complete. 2023-09-30T22:20:57.817 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:58.594 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:20:58.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.722+0000 7f520a650700 1 Processor -- start 2023-09-30T22:20:58.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.723+0000 7f520a650700 1 -- start start 2023-09-30T22:20:58.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.723+0000 7f520a650700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f520409e340 0x7f52041359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:58.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.723+0000 7f520a650700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5204135f20 0x7f5204138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:58.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.723+0000 7f520a650700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520409aaa0 con 0x7f520409d860 2023-09-30T22:20:58.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.723+0000 7f520a650700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520409e730 con 0x7f5204135f20 2023-09-30T22:20:58.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.723+0000 7f520a650700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f520409f870 con 0x7f520409e340 2023-09-30T22:20:58.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.723+0000 7f5208bed700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5204135f20 0x7f5204138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:58.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.723+0000 7f5208bed700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5204135f20 0x7f5204138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:36438/0 (socket says 172.21.15.156:36438) 2023-09-30T22:20:58.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.723+0000 7f5208bed700 1 -- 172.21.15.156:0/3580667344 learned_addr learned my addr 172.21.15.156:0/3580667344 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:58.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.723+0000 7f5203fff700 1 --1- 172.21.15.156:0/3580667344 >> v1:172.21.15.156:6789/0 conn(0x7f520409d860 0x7f520409dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:46214/0 (socket says 172.21.15.156:46214) 2023-09-30T22:20:58.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.723+0000 7f52037fe700 1 --2- 172.21.15.156:0/3580667344 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f520409e340 0x7f52041359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:58.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.723+0000 7f5202ffd700 1 -- 172.21.15.156:0/3580667344 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541237370 0 0) 0x7f520409aaa0 con 0x7f520409d860 2023-09-30T22:20:58.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.724+0000 7f5208bed700 1 -- 172.21.15.156:0/3580667344 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f520409e340 msgr2=0x7f52041359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:58.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.724+0000 7f5208bed700 1 --2- 172.21.15.156:0/3580667344 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f520409e340 0x7f52041359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:58.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.724+0000 7f5208bed700 1 -- 172.21.15.156:0/3580667344 >> v1:172.21.15.156:6789/0 conn(0x7f520409d860 legacy=0x7f520409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:58.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.724+0000 7f5208bed700 1 -- 172.21.15.156:0/3580667344 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520409b360 con 0x7f5204135f20 2023-09-30T22:20:58.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.724+0000 7f5208bed700 1 --2- 172.21.15.156:0/3580667344 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5204135f20 0x7f5204138300 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f51fc009e80 tx=0x7f51fc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=740d66d7e78201b9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:58.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.724+0000 7f5202ffd700 1 -- 172.21.15.156:0/3580667344 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc00e070 con 0x7f5204135f20 2023-09-30T22:20:58.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.724+0000 7f5202ffd700 1 -- 172.21.15.156:0/3580667344 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51fc00b910 con 0x7f5204135f20 2023-09-30T22:20:58.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.724+0000 7f5202ffd700 1 -- 172.21.15.156:0/3580667344 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc00bcc0 con 0x7f5204135f20 2023-09-30T22:20:58.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.724+0000 7f520a650700 1 -- 172.21.15.156:0/3580667344 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5204135f20 msgr2=0x7f5204138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:58.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.724+0000 7f520a650700 1 --2- 172.21.15.156:0/3580667344 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5204135f20 0x7f5204138300 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f51fc009e80 tx=0x7f51fc00b330 comp rx=0 tx=0).stop 2023-09-30T22:20:58.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.724+0000 7f520a650700 1 -- 172.21.15.156:0/3580667344 shutdown_connections 2023-09-30T22:20:58.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.724+0000 7f520a650700 1 --2- 172.21.15.156:0/3580667344 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5204135f20 0x7f5204138300 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:58.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.724+0000 7f520a650700 1 --2- 172.21.15.156:0/3580667344 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f520409e340 0x7f52041359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:58.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.724+0000 7f520a650700 1 -- 172.21.15.156:0/3580667344 >> 172.21.15.156:0/3580667344 conn(0x7f5204099c40 msgr2=0x7f52040a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:58.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.725+0000 7f520a650700 1 -- 172.21.15.156:0/3580667344 shutdown_connections 2023-09-30T22:20:58.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.725+0000 7f520a650700 1 -- 172.21.15.156:0/3580667344 wait complete. 2023-09-30T22:20:58.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.725+0000 7f520a650700 1 Processor -- start 2023-09-30T22:20:58.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.726+0000 7f520a650700 1 -- start start 2023-09-30T22:20:58.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.726+0000 7f520a650700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f520409d860 0x7f52041c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:58.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.726+0000 7f520a650700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f520409e340 0x7f52041c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:58.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.726+0000 7f520a650700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5204135f20 0x7f52041c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:58.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.726+0000 7f520a650700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520411e490 con 0x7f520409d860 2023-09-30T22:20:58.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.726+0000 7f520a650700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52040a0810 con 0x7f5204135f20 2023-09-30T22:20:58.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.726+0000 7f520a650700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f520409c8b0 con 0x7f520409e340 2023-09-30T22:20:58.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.726+0000 7f5203fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f520409d860 0x7f52041c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:58.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.726+0000 7f52037fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f520409e340 0x7f52041c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:58.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.726+0000 7f52037fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f520409e340 0x7f52041c8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54832/0 (socket says 172.21.15.156:54832) 2023-09-30T22:20:58.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.726+0000 7f5208bed700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5204135f20 0x7f52041c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:58.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.726+0000 7f5203fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f520409d860 0x7f52041c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60556/0 (socket says 172.21.15.156:60556) 2023-09-30T22:20:58.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.726+0000 7f52037fe700 1 -- 172.21.15.156:0/1206118192 learned_addr learned my addr 172.21.15.156:0/1206118192 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:58.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.726+0000 7f5208bed700 1 -- 172.21.15.156:0/1206118192 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f520409e340 msgr2=0x7f52041c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:58.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.726+0000 7f5208bed700 1 --2- 172.21.15.156:0/1206118192 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f520409e340 0x7f52041c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:58.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.726+0000 7f5208bed700 1 -- 172.21.15.156:0/1206118192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f520409d860 msgr2=0x7f52041c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:58.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.726+0000 7f5208bed700 1 --2- 172.21.15.156:0/1206118192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f520409d860 0x7f52041c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:58.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.726+0000 7f5208bed700 1 -- 172.21.15.156:0/1206118192 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51fc009b30 con 0x7f5204135f20 2023-09-30T22:20:58.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.726+0000 7f52037fe700 1 --2- 172.21.15.156:0/1206118192 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f520409e340 0x7f52041c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:58.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.726+0000 7f5203fff700 1 --2- 172.21.15.156:0/1206118192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f520409d860 0x7f52041c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:58.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.726+0000 7f5208bed700 1 --2- 172.21.15.156:0/1206118192 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5204135f20 0x7f52041c8bc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f51fc015000 tx=0x7f51fc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:58.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.727+0000 7f5200ff9700 1 -- 172.21.15.156:0/1206118192 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc0092e0 con 0x7f5204135f20 2023-09-30T22:20:58.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.727+0000 7f5200ff9700 1 -- 172.21.15.156:0/1206118192 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51fc025460 con 0x7f5204135f20 2023-09-30T22:20:58.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.727+0000 7f520a650700 1 -- 172.21.15.156:0/1206118192 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5204125030 con 0x7f5204135f20 2023-09-30T22:20:58.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.727+0000 7f5200ff9700 1 -- 172.21.15.156:0/1206118192 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc025830 con 0x7f5204135f20 2023-09-30T22:20:58.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.727+0000 7f520a650700 1 -- 172.21.15.156:0/1206118192 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520406b280 con 0x7f5204135f20 2023-09-30T22:20:58.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.727+0000 7f5200ff9700 1 -- 172.21.15.156:0/1206118192 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f51fc025990 con 0x7f5204135f20 2023-09-30T22:20:58.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.728+0000 7f5200ff9700 1 -- 172.21.15.156:0/1206118192 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f51fc041470 con 0x7f5204135f20 2023-09-30T22:20:58.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.728+0000 7f520a650700 1 -- 172.21.15.156:0/1206118192 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520404f2a0 con 0x7f5204135f20 2023-09-30T22:20:58.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.732+0000 7f5200ff9700 1 -- 172.21.15.156:0/1206118192 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f51fc009920 con 0x7f5204135f20 2023-09-30T22:20:58.754 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:20:58.754 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:20:58.818 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:20:58.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.887+0000 7f58ea082700 1 Processor -- start 2023-09-30T22:20:58.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.887+0000 7f58ea082700 1 -- start start 2023-09-30T22:20:58.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.888+0000 7f58ea082700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58e409d860 0x7f58e409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:58.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.888+0000 7f58ea082700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f58e409e170 0x7f58e41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:58.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.888+0000 7f58ea082700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58e409aaa0 con 0x7f58e4130ce0 2023-09-30T22:20:58.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.888+0000 7f58ea082700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58e409f870 con 0x7f58e409e170 2023-09-30T22:20:58.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.888+0000 7f58ea082700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e409b360 con 0x7f58e409d860 2023-09-30T22:20:58.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.888+0000 7f58e37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58e409d860 0x7f58e409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:58.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.888+0000 7f58e2ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f58e409e170 0x7f58e41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:58.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.888+0000 7f58e37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58e409d860 0x7f58e409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:36450/0 (socket says 172.21.15.156:36450) 2023-09-30T22:20:58.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.888+0000 7f58e2ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f58e409e170 0x7f58e41307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60566/0 (socket says 172.21.15.156:60566) 2023-09-30T22:20:58.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.888+0000 7f58e37fe700 1 -- 172.21.15.156:0/2208803228 learned_addr learned my addr 172.21.15.156:0/2208803228 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:58.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.888+0000 7f58e37fe700 1 -- 172.21.15.156:0/2208803228 >> v2:172.21.15.156:3300/0 conn(0x7f58e409e170 msgr2=0x7f58e41307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:58.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.888+0000 7f58e37fe700 1 --2- 172.21.15.156:0/2208803228 >> v2:172.21.15.156:3300/0 conn(0x7f58e409e170 0x7f58e41307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:58.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.888+0000 7f58e37fe700 1 -- 172.21.15.156:0/2208803228 >> v1:172.21.15.156:6789/0 conn(0x7f58e4130ce0 legacy=0x7f58e41379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:58.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.888+0000 7f58e37fe700 1 -- 172.21.15.156:0/2208803228 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e409b620 con 0x7f58e409d860 2023-09-30T22:20:58.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.889+0000 7f58e37fe700 1 --2- 172.21.15.156:0/2208803228 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58e409d860 0x7f58e409dc30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f58d40098f0 tx=0x7f58d4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=160e42572c124c12 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:58.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.889+0000 7f58e27fc700 1 -- 172.21.15.156:0/2208803228 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4011830 con 0x7f58e409d860 2023-09-30T22:20:58.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.889+0000 7f58e27fc700 1 -- 172.21.15.156:0/2208803228 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d4011990 con 0x7f58e409d860 2023-09-30T22:20:58.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.889+0000 7f58e27fc700 1 -- 172.21.15.156:0/2208803228 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4011d20 con 0x7f58e409d860 2023-09-30T22:20:58.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.889+0000 7f58ea082700 1 -- 172.21.15.156:0/2208803228 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58e409d860 msgr2=0x7f58e409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:58.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.889+0000 7f58ea082700 1 --2- 172.21.15.156:0/2208803228 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58e409d860 0x7f58e409dc30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f58d40098f0 tx=0x7f58d4009c00 comp rx=0 tx=0).stop 2023-09-30T22:20:58.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.889+0000 7f58ea082700 1 -- 172.21.15.156:0/2208803228 shutdown_connections 2023-09-30T22:20:58.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.889+0000 7f58ea082700 1 --2- 172.21.15.156:0/2208803228 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58e409d860 0x7f58e409dc30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:58.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.889+0000 7f58ea082700 1 --2- 172.21.15.156:0/2208803228 >> v2:172.21.15.156:3300/0 conn(0x7f58e409e170 0x7f58e41307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:58.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.889+0000 7f58ea082700 1 -- 172.21.15.156:0/2208803228 >> 172.21.15.156:0/2208803228 conn(0x7f58e4099c40 msgr2=0x7f58e40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:58.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.890+0000 7f58ea082700 1 -- 172.21.15.156:0/2208803228 shutdown_connections 2023-09-30T22:20:58.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.890+0000 7f58ea082700 1 -- 172.21.15.156:0/2208803228 wait complete. 2023-09-30T22:20:58.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.890+0000 7fa2e4456700 1 Processor -- start 2023-09-30T22:20:58.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.890+0000 7f58ea082700 1 Processor -- start 2023-09-30T22:20:58.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.891+0000 7f58ea082700 1 -- start start 2023-09-30T22:20:58.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.891+0000 7f58ea082700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58e409d860 0x7f58e4135690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:58.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.891+0000 7f58ea082700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58e409e170 0x7f58e4135bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:58.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.891+0000 7f58ea082700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f58e4130ce0 0x7f58e4136110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:58.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.891+0000 7f58ea082700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e4137b30 con 0x7f58e409e170 2023-09-30T22:20:58.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.891+0000 7f58ea082700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e41372a0 con 0x7f58e409d860 2023-09-30T22:20:58.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.891+0000 7f58ea082700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58e4072130 con 0x7f58e4130ce0 2023-09-30T22:20:58.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.891+0000 7fa2e4456700 1 -- start start 2023-09-30T22:20:58.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.891+0000 7fa2e4456700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa2dc09ad40 0x7fa2dc133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:58.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.891+0000 7fa2e4456700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2dc133f70 0x7fa2dc1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:58.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.891+0000 7fa2e4456700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2dc0a0a70 0x7fa2dc0a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:58.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.891+0000 7fa2e4456700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2dc0a3b60 con 0x7fa2dc09ad40 2023-09-30T22:20:58.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.891+0000 7fa2e4456700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc1348e0 con 0x7fa2dc133f70 2023-09-30T22:20:58.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.891+0000 7fa2e4456700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc09b110 con 0x7fa2dc0a0a70 2023-09-30T22:20:58.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.891+0000 7f58e2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58e409e170 0x7f58e4135bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:58.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.891+0000 7f58e2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58e409e170 0x7f58e4135bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60582/0 (socket says 172.21.15.156:60582) 2023-09-30T22:20:58.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.891+0000 7f58e2ffd700 1 -- 172.21.15.156:0/3657395013 learned_addr learned my addr 172.21.15.156:0/3657395013 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:58.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.891+0000 7f58e3fff700 1 --2- 172.21.15.156:0/3657395013 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f58e4130ce0 0x7f58e4136110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:58.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.891+0000 7fa2e29f3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2dc0a0a70 0x7fa2dc0a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:58.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.891+0000 7fa2e19f1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2dc133f70 0x7fa2dc1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:58.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.891+0000 7fa2e21f2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa2dc09ad40 0x7fa2dc133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:58.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.891+0000 7fa2e29f3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2dc0a0a70 0x7fa2dc0a0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54852/0 (socket says 172.21.15.156:54852) 2023-09-30T22:20:58.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.891+0000 7fa2e29f3700 1 -- 172.21.15.156:0/2782200632 learned_addr learned my addr 172.21.15.156:0/2782200632 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:58.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.892+0000 7fa2e19f1700 1 -- 172.21.15.156:0/2782200632 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2dc0a0a70 msgr2=0x7fa2dc0a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:58.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.892+0000 7fa2e19f1700 1 --2- 172.21.15.156:0/2782200632 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2dc0a0a70 0x7fa2dc0a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:58.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.892+0000 7fa2e19f1700 1 -- 172.21.15.156:0/2782200632 >> v2:172.21.15.156:3300/0 conn(0x7fa2dc09ad40 msgr2=0x7fa2dc133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:58.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.892+0000 7fa2e19f1700 1 --2- 172.21.15.156:0/2782200632 >> v2:172.21.15.156:3300/0 conn(0x7fa2dc09ad40 0x7fa2dc133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:58.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.892+0000 7fa2e19f1700 1 -- 172.21.15.156:0/2782200632 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc0a2fa0 con 0x7fa2dc133f70 2023-09-30T22:20:58.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.892+0000 7fa2e29f3700 1 --2- 172.21.15.156:0/2782200632 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2dc0a0a70 0x7fa2dc0a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:20:58.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.892+0000 7f58e3fff700 1 -- 172.21.15.156:0/3657395013 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58e409d860 msgr2=0x7f58e4135690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:20:58.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.892+0000 7f58e3fff700 1 --2- 172.21.15.156:0/3657395013 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58e409d860 0x7f58e4135690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:58.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.892+0000 7f58e3fff700 1 -- 172.21.15.156:0/3657395013 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58e409e170 msgr2=0x7f58e4135bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:58.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.892+0000 7f58e3fff700 1 --2- 172.21.15.156:0/3657395013 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58e409e170 0x7f58e4135bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:58.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.892+0000 7f58e3fff700 1 -- 172.21.15.156:0/3657395013 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d4009550 con 0x7f58e4130ce0 2023-09-30T22:20:58.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.892+0000 7f58e2ffd700 1 --2- 172.21.15.156:0/3657395013 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58e409e170 0x7f58e4135bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:58.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.892+0000 7fa2e19f1700 1 --2- 172.21.15.156:0/2782200632 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2dc133f70 0x7fa2dc1343a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009840 tx=0x7fa2cc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82218e2349715024 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:58.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.892+0000 7f58e3fff700 1 --2- 172.21.15.156:0/3657395013 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f58e4130ce0 0x7f58e4136110 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f58dc00cb90 tx=0x7f58dc00cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:58.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.892+0000 7fa2e11f0700 1 -- 172.21.15.156:0/2782200632 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc011830 con 0x7fa2dc133f70 2023-09-30T22:20:58.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.892+0000 7fa2e11f0700 1 -- 172.21.15.156:0/2782200632 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2cc011990 con 0x7fa2dc133f70 2023-09-30T22:20:58.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.892+0000 7fa2e11f0700 1 -- 172.21.15.156:0/2782200632 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc011d20 con 0x7fa2dc133f70 2023-09-30T22:20:58.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.892+0000 7f58cbfff700 1 -- 172.21.15.156:0/3657395013 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc003c00 con 0x7f58e4130ce0 2023-09-30T22:20:58.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.892+0000 7f58cbfff700 1 -- 172.21.15.156:0/3657395013 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58dc003d60 con 0x7f58e4130ce0 2023-09-30T22:20:58.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.892+0000 7f58ea082700 1 -- 172.21.15.156:0/3657395013 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e409c8b0 con 0x7f58e4130ce0 2023-09-30T22:20:58.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.892+0000 7f58cbfff700 1 -- 172.21.15.156:0/3657395013 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc00aaa0 con 0x7f58e4130ce0 2023-09-30T22:20:58.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.892+0000 7f58ea082700 1 -- 172.21.15.156:0/3657395013 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e4119d80 con 0x7f58e4130ce0 2023-09-30T22:20:58.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.893+0000 7fa2e4456700 1 -- 172.21.15.156:0/2782200632 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2dc133f70 msgr2=0x7fa2dc1343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:58.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.893+0000 7fa2e4456700 1 --2- 172.21.15.156:0/2782200632 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2dc133f70 0x7fa2dc1343a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009840 tx=0x7fa2cc009b50 comp rx=0 tx=0).stop 2023-09-30T22:20:58.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.894+0000 7f58ea082700 1 -- 172.21.15.156:0/3657395013 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58e404f2a0 con 0x7f58e4130ce0 2023-09-30T22:20:58.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.894+0000 7f58cbfff700 1 -- 172.21.15.156:0/3657395013 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f58dc00ac00 con 0x7f58e4130ce0 2023-09-30T22:20:58.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.894+0000 7fa2e4456700 1 -- 172.21.15.156:0/2782200632 shutdown_connections 2023-09-30T22:20:58.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.894+0000 7fa2e4456700 1 --2- 172.21.15.156:0/2782200632 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2dc0a0a70 0x7fa2dc0a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:58.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.894+0000 7fa2e4456700 1 --2- 172.21.15.156:0/2782200632 >> v2:172.21.15.156:3300/0 conn(0x7fa2dc09ad40 0x7fa2dc133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:58.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.894+0000 7fa2e4456700 1 --2- 172.21.15.156:0/2782200632 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2dc133f70 0x7fa2dc1343a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:58.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.894+0000 7fa2e4456700 1 -- 172.21.15.156:0/2782200632 >> 172.21.15.156:0/2782200632 conn(0x7fa2dc099c40 msgr2=0x7fa2dc06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:58.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.894+0000 7f58cbfff700 1 -- 172.21.15.156:0/3657395013 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f58dc03f720 con 0x7f58e4130ce0 2023-09-30T22:20:58.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.895+0000 7fa2e4456700 1 -- 172.21.15.156:0/2782200632 shutdown_connections 2023-09-30T22:20:58.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.897+0000 7fa2e4456700 1 -- 172.21.15.156:0/2782200632 wait complete. 2023-09-30T22:20:58.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.897+0000 7fa2e4456700 1 Processor -- start 2023-09-30T22:20:58.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.897+0000 7fa2e4456700 1 -- start start 2023-09-30T22:20:58.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.898+0000 7fa2e4456700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2dc09ad40 0x7fa2dc1c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:58.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.898+0000 7fa2e4456700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2dc0a0a70 0x7fa2dc1c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:58.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.898+0000 7fa2e4456700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2dc133f70 0x7fa2dc1c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:58.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.898+0000 7fa2e4456700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc121f30 con 0x7fa2dc09ad40 2023-09-30T22:20:58.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.898+0000 7fa2e4456700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc120740 con 0x7fa2dc0a0a70 2023-09-30T22:20:58.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.898+0000 7fa2e4456700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc120ba0 con 0x7fa2dc133f70 2023-09-30T22:20:58.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.898+0000 7fa2e19f1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2dc0a0a70 0x7fa2dc1c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:58.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.898+0000 7fa2e19f1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2dc0a0a70 0x7fa2dc1c8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:36474/0 (socket says 172.21.15.156:36474) 2023-09-30T22:20:58.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.898+0000 7fa2e19f1700 1 -- 172.21.15.156:0/805543809 learned_addr learned my addr 172.21.15.156:0/805543809 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:58.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.898+0000 7fa2e21f2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2dc09ad40 0x7fa2dc1c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:58.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.898+0000 7fa2e19f1700 1 -- 172.21.15.156:0/805543809 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2dc133f70 msgr2=0x7fa2dc1c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:58.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.898+0000 7fa2e19f1700 1 --2- 172.21.15.156:0/805543809 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2dc133f70 0x7fa2dc1c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:58.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.898+0000 7fa2e19f1700 1 -- 172.21.15.156:0/805543809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2dc09ad40 msgr2=0x7fa2dc1c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:58.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.898+0000 7fa2e19f1700 1 --2- 172.21.15.156:0/805543809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2dc09ad40 0x7fa2dc1c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:58.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.898+0000 7fa2e19f1700 1 -- 172.21.15.156:0/805543809 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2cc0094a0 con 0x7fa2dc0a0a70 2023-09-30T22:20:58.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.898+0000 7fa2e21f2700 1 --2- 172.21.15.156:0/805543809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2dc09ad40 0x7fa2dc1c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:58.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.899+0000 7fa2e19f1700 1 --2- 172.21.15.156:0/805543809 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2dc0a0a70 0x7fa2dc1c8740 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009fd0 tx=0x7fa2cc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:58.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.899+0000 7fa2d2ffd700 1 -- 172.21.15.156:0/805543809 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc004590 con 0x7fa2dc0a0a70 2023-09-30T22:20:58.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.899+0000 7fa2d2ffd700 1 -- 172.21.15.156:0/805543809 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2cc0036a0 con 0x7fa2dc0a0a70 2023-09-30T22:20:58.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.899+0000 7fa2e4456700 1 -- 172.21.15.156:0/805543809 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2dc1224d0 con 0x7fa2dc0a0a70 2023-09-30T22:20:58.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.899+0000 7f58cbfff700 1 -- 172.21.15.156:0/3657395013 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f58dc0198f0 con 0x7f58e4130ce0 2023-09-30T22:20:58.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.899+0000 7fa2e4456700 1 -- 172.21.15.156:0/805543809 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2dc120db0 con 0x7fa2dc0a0a70 2023-09-30T22:20:58.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.899+0000 7fa2d2ffd700 1 -- 172.21.15.156:0/805543809 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc003a50 con 0x7fa2dc0a0a70 2023-09-30T22:20:58.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.900+0000 7fa2e4456700 1 -- 172.21.15.156:0/805543809 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2dc04f2a0 con 0x7fa2dc0a0a70 2023-09-30T22:20:58.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.900+0000 7fa2d2ffd700 1 -- 172.21.15.156:0/805543809 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa2cc003bb0 con 0x7fa2dc0a0a70 2023-09-30T22:20:58.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.901+0000 7fa2d2ffd700 1 -- 172.21.15.156:0/805543809 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa2cc024960 con 0x7fa2dc0a0a70 2023-09-30T22:20:58.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.905+0000 7fa2d2ffd700 1 -- 172.21.15.156:0/805543809 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa2cc075750 con 0x7fa2dc0a0a70 2023-09-30T22:20:58.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.933+0000 7f520a650700 1 -- 172.21.15.156:0/1206118192 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f520406c3b0 con 0x7f5204135f20 2023-09-30T22:20:58.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.933+0000 7f5200ff9700 1 -- 172.21.15.156:0/1206118192 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f51fc01b3a0 con 0x7f5204135f20 2023-09-30T22:20:58.934 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:20:58.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.936+0000 7f520a650700 1 -- 172.21.15.156:0/1206118192 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5204135f20 msgr2=0x7f52041c8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:58.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.936+0000 7f520a650700 1 --2- 172.21.15.156:0/1206118192 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5204135f20 0x7f52041c8bc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f51fc015000 tx=0x7f51fc004ad0 comp rx=0 tx=0).stop 2023-09-30T22:20:58.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.936+0000 7f520a650700 1 -- 172.21.15.156:0/1206118192 shutdown_connections 2023-09-30T22:20:58.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.936+0000 7f520a650700 1 --2- 172.21.15.156:0/1206118192 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5204135f20 0x7f52041c8bc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:58.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.936+0000 7f520a650700 1 --2- 172.21.15.156:0/1206118192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f520409d860 0x7f52041c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:58.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.936+0000 7f520a650700 1 --2- 172.21.15.156:0/1206118192 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f520409e340 0x7f52041c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:58.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.936+0000 7f520a650700 1 -- 172.21.15.156:0/1206118192 >> 172.21.15.156:0/1206118192 conn(0x7f5204099c40 msgr2=0x7f52040a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:58.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.936+0000 7f520a650700 1 -- 172.21.15.156:0/1206118192 shutdown_connections 2023-09-30T22:20:58.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.936+0000 7f520a650700 1 -- 172.21.15.156:0/1206118192 wait complete. 2023-09-30T22:20:58.949 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:20:58.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.954+0000 7fb247d00700 1 Processor -- start 2023-09-30T22:20:58.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.954+0000 7fb247d00700 1 -- start start 2023-09-30T22:20:58.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.955+0000 7fb247d00700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb240138410 0x7fb2400a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:58.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.955+0000 7fb247d00700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb24013dd10 0x7fb2401400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:58.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.955+0000 7fb247d00700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2401379e0 con 0x7fb240138040 2023-09-30T22:20:58.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.955+0000 7fb247d00700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2400a2100 con 0x7fb240138410 2023-09-30T22:20:58.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.955+0000 7fb247d00700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb24009b9b0 con 0x7fb24013dd10 2023-09-30T22:20:58.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.955+0000 7fb24629d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb24013dd10 0x7fb2401400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:58.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.955+0000 7fb245a9c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb240138040 0x7fb2400a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:46242/0 (socket says 172.21.15.156:46242) 2023-09-30T22:20:58.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.955+0000 7fb245a9c700 1 -- 172.21.15.156:0/4152538905 learned_addr learned my addr 172.21.15.156:0/4152538905 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:20:58.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.955+0000 7fb24529b700 1 --2- 172.21.15.156:0/4152538905 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb240138410 0x7fb2400a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:58.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.955+0000 7fb244a9a700 1 -- 172.21.15.156:0/4152538905 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782839125 0 0) 0x7fb2401379e0 con 0x7fb240138040 2023-09-30T22:20:58.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.955+0000 7fb24529b700 1 -- 172.21.15.156:0/4152538905 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb24013dd10 msgr2=0x7fb2401400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:20:58.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.955+0000 7fb24529b700 1 --2- 172.21.15.156:0/4152538905 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb24013dd10 0x7fb2401400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:58.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.955+0000 7fb24529b700 1 -- 172.21.15.156:0/4152538905 >> v1:172.21.15.156:6789/0 conn(0x7fb240138040 legacy=0x7fb2400a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:58.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.955+0000 7fb24529b700 1 -- 172.21.15.156:0/4152538905 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb240137c10 con 0x7fb240138410 2023-09-30T22:20:58.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.955+0000 7fb24629d700 1 --2- 172.21.15.156:0/4152538905 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb24013dd10 0x7fb2401400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:58.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.955+0000 7fb24529b700 1 --2- 172.21.15.156:0/4152538905 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb240138410 0x7fb2400a0ff0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb230009870 tx=0x7fb230009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a01d54714ab2ed17 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:58.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.955+0000 7fb244a9a700 1 -- 172.21.15.156:0/4152538905 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb230011830 con 0x7fb240138410 2023-09-30T22:20:58.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.956+0000 7fb244a9a700 1 -- 172.21.15.156:0/4152538905 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb230011990 con 0x7fb240138410 2023-09-30T22:20:58.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.956+0000 7fb244a9a700 1 -- 172.21.15.156:0/4152538905 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb230011d20 con 0x7fb240138410 2023-09-30T22:20:58.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.956+0000 7fb247d00700 1 -- 172.21.15.156:0/4152538905 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb240138410 msgr2=0x7fb2400a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:58.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.956+0000 7fb247d00700 1 --2- 172.21.15.156:0/4152538905 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb240138410 0x7fb2400a0ff0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb230009870 tx=0x7fb230009b80 comp rx=0 tx=0).stop 2023-09-30T22:20:58.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.956+0000 7fb247d00700 1 -- 172.21.15.156:0/4152538905 shutdown_connections 2023-09-30T22:20:58.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.956+0000 7fb247d00700 1 --2- 172.21.15.156:0/4152538905 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb24013dd10 0x7fb2401400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:58.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.956+0000 7fb247d00700 1 --2- 172.21.15.156:0/4152538905 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb240138410 0x7fb2400a0ff0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:58.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.956+0000 7fb247d00700 1 -- 172.21.15.156:0/4152538905 >> 172.21.15.156:0/4152538905 conn(0x7fb2400a2980 msgr2=0x7fb2400a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:58.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.956+0000 7fb247d00700 1 -- 172.21.15.156:0/4152538905 shutdown_connections 2023-09-30T22:20:58.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.956+0000 7fb247d00700 1 -- 172.21.15.156:0/4152538905 wait complete. 2023-09-30T22:20:58.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.957+0000 7fb247d00700 1 Processor -- start 2023-09-30T22:20:58.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.957+0000 7fb247d00700 1 -- start start 2023-09-30T22:20:58.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.958+0000 7fb247d00700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb240138040 0x7fb240121600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:58.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.958+0000 7fb247d00700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb240138410 0x7fb240121b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:58.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.958+0000 7fb247d00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb24013dd10 0x7fb240122080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:20:58.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.958+0000 7fb247d00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb240124eb0 con 0x7fb24013dd10 2023-09-30T22:20:58.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.958+0000 7fb247d00700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24009ef30 con 0x7fb240138040 2023-09-30T22:20:58.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.958+0000 7fb247d00700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb24009a240 con 0x7fb240138410 2023-09-30T22:20:58.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.958+0000 7fb245a9c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb240138040 0x7fb240121600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:58.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.958+0000 7fb24529b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb240138410 0x7fb240121b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:58.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.958+0000 7fb245a9c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb240138040 0x7fb240121600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:36498/0 (socket says 172.21.15.156:36498) 2023-09-30T22:20:58.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.958+0000 7fb245a9c700 1 -- 172.21.15.156:0/2005821775 learned_addr learned my addr 172.21.15.156:0/2005821775 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:20:58.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.958+0000 7fb24629d700 1 --2- 172.21.15.156:0/2005821775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb24013dd10 0x7fb240122080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:20:58.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.958+0000 7fb24529b700 1 -- 172.21.15.156:0/2005821775 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb240138040 msgr2=0x7fb240121600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:58.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.958+0000 7fb24529b700 1 --2- 172.21.15.156:0/2005821775 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb240138040 0x7fb240121600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:58.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.958+0000 7fb24529b700 1 -- 172.21.15.156:0/2005821775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb24013dd10 msgr2=0x7fb240122080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:58.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.958+0000 7fb24529b700 1 --2- 172.21.15.156:0/2005821775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb24013dd10 0x7fb240122080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:58.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.958+0000 7fb24529b700 1 -- 172.21.15.156:0/2005821775 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb238009a70 con 0x7fb240138410 2023-09-30T22:20:58.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.958+0000 7fb24629d700 1 --2- 172.21.15.156:0/2005821775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb24013dd10 0x7fb240122080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:20:58.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.958+0000 7fb245a9c700 1 --2- 172.21.15.156:0/2005821775 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb240138040 0x7fb240121600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:20:58.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.958+0000 7fb24529b700 1 --2- 172.21.15.156:0/2005821775 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb240138410 0x7fb240121b40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb230009870 tx=0x7fb230004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:20:58.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.959+0000 7fb2367fc700 1 -- 172.21.15.156:0/2005821775 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23001a6e0 con 0x7fb240138410 2023-09-30T22:20:58.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.959+0000 7fb2367fc700 1 -- 172.21.15.156:0/2005821775 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23001a840 con 0x7fb240138410 2023-09-30T22:20:58.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.959+0000 7fb247d00700 1 -- 172.21.15.156:0/2005821775 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2300094a0 con 0x7fb240138410 2023-09-30T22:20:58.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.959+0000 7fb2367fc700 1 -- 172.21.15.156:0/2005821775 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23001abb0 con 0x7fb240138410 2023-09-30T22:20:58.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.959+0000 7fb247d00700 1 -- 172.21.15.156:0/2005821775 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb240122960 con 0x7fb240138410 2023-09-30T22:20:58.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.959+0000 7fb247d00700 1 -- 172.21.15.156:0/2005821775 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb24004f2a0 con 0x7fb240138410 2023-09-30T22:20:58.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.960+0000 7fb2367fc700 1 -- 172.21.15.156:0/2005821775 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb230022070 con 0x7fb240138410 2023-09-30T22:20:58.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.960+0000 7fb2367fc700 1 -- 172.21.15.156:0/2005821775 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb230040d90 con 0x7fb240138410 2023-09-30T22:20:58.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:58.964+0000 7fb2367fc700 1 -- 172.21.15.156:0/2005821775 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb23002d3b0 con 0x7fb240138410 2023-09-30T22:20:59.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.095+0000 7f58ea082700 1 -- 172.21.15.156:0/3657395013 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f58e406c3b0 con 0x7f58e4130ce0 2023-09-30T22:20:59.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.095+0000 7f58cbfff700 1 -- 172.21.15.156:0/3657395013 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f58dc019300 con 0x7f58e4130ce0 2023-09-30T22:20:59.096 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:20:59.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.097+0000 7f58ea082700 1 -- 172.21.15.156:0/3657395013 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f58e4130ce0 msgr2=0x7f58e4136110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:59.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.097+0000 7f58ea082700 1 --2- 172.21.15.156:0/3657395013 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f58e4130ce0 0x7f58e4136110 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f58dc00cb90 tx=0x7f58dc00cea0 comp rx=0 tx=0).stop 2023-09-30T22:20:59.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.097+0000 7f58ea082700 1 -- 172.21.15.156:0/3657395013 shutdown_connections 2023-09-30T22:20:59.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.097+0000 7f58ea082700 1 --2- 172.21.15.156:0/3657395013 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f58e4130ce0 0x7f58e4136110 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:59.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.097+0000 7f58ea082700 1 --2- 172.21.15.156:0/3657395013 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58e409d860 0x7f58e4135690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:59.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.097+0000 7f58ea082700 1 --2- 172.21.15.156:0/3657395013 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58e409e170 0x7f58e4135bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:59.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.097+0000 7f58ea082700 1 -- 172.21.15.156:0/3657395013 >> 172.21.15.156:0/3657395013 conn(0x7f58e4099c40 msgr2=0x7f58e4139670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:59.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.097+0000 7f58ea082700 1 -- 172.21.15.156:0/3657395013 shutdown_connections 2023-09-30T22:20:59.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.097+0000 7f58ea082700 1 -- 172.21.15.156:0/3657395013 wait complete. 2023-09-30T22:20:59.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.102+0000 7fa2e4456700 1 -- 172.21.15.156:0/805543809 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa2dc0729d0 con 0x7fa2dc0a0a70 2023-09-30T22:20:59.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.103+0000 7fa2d2ffd700 1 -- 172.21.15.156:0/805543809 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa2cc003e60 con 0x7fa2dc0a0a70 2023-09-30T22:20:59.103 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:20:59.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.105+0000 7fa2e4456700 1 -- 172.21.15.156:0/805543809 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2dc0a0a70 msgr2=0x7fa2dc1c8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:59.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.105+0000 7fa2e4456700 1 --2- 172.21.15.156:0/805543809 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2dc0a0a70 0x7fa2dc1c8740 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009fd0 tx=0x7fa2cc004750 comp rx=0 tx=0).stop 2023-09-30T22:20:59.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.105+0000 7fa2e4456700 1 -- 172.21.15.156:0/805543809 shutdown_connections 2023-09-30T22:20:59.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.105+0000 7fa2e4456700 1 --2- 172.21.15.156:0/805543809 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2dc133f70 0x7fa2dc1c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:59.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.105+0000 7fa2e4456700 1 --2- 172.21.15.156:0/805543809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2dc09ad40 0x7fa2dc1c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:59.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.105+0000 7fa2e4456700 1 --2- 172.21.15.156:0/805543809 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2dc0a0a70 0x7fa2dc1c8740 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:59.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.105+0000 7fa2e4456700 1 -- 172.21.15.156:0/805543809 >> 172.21.15.156:0/805543809 conn(0x7fa2dc099c40 msgr2=0x7fa2dc09e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:59.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.105+0000 7fa2e4456700 1 -- 172.21.15.156:0/805543809 shutdown_connections 2023-09-30T22:20:59.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.105+0000 7fa2e4456700 1 -- 172.21.15.156:0/805543809 wait complete. 2023-09-30T22:20:59.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:20:59.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:20:59.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.158+0000 7fb247d00700 1 -- 172.21.15.156:0/2005821775 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb24006bce0 con 0x7fb240138410 2023-09-30T22:20:59.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.158+0000 7fb2367fc700 1 -- 172.21.15.156:0/2005821775 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb230029030 con 0x7fb240138410 2023-09-30T22:20:59.159 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:20:59.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.160+0000 7fb247d00700 1 -- 172.21.15.156:0/2005821775 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb240138410 msgr2=0x7fb240121b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:20:59.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.160+0000 7fb247d00700 1 --2- 172.21.15.156:0/2005821775 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb240138410 0x7fb240121b40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb230009870 tx=0x7fb230004750 comp rx=0 tx=0).stop 2023-09-30T22:20:59.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.160+0000 7fb247d00700 1 -- 172.21.15.156:0/2005821775 shutdown_connections 2023-09-30T22:20:59.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.160+0000 7fb247d00700 1 --2- 172.21.15.156:0/2005821775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb24013dd10 0x7fb240122080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:59.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.160+0000 7fb247d00700 1 --2- 172.21.15.156:0/2005821775 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb240138040 0x7fb240121600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:59.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.160+0000 7fb247d00700 1 --2- 172.21.15.156:0/2005821775 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb240138410 0x7fb240121b40 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:20:59.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.160+0000 7fb247d00700 1 -- 172.21.15.156:0/2005821775 >> 172.21.15.156:0/2005821775 conn(0x7fb2400a2980 msgr2=0x7fb24009d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:20:59.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.160+0000 7fb247d00700 1 -- 172.21.15.156:0/2005821775 shutdown_connections 2023-09-30T22:20:59.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:20:59.161+0000 7fb247d00700 1 -- 172.21.15.156:0/2005821775 wait complete. 2023-09-30T22:20:59.173 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:20:59.950 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:00.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.086+0000 7f0847a1f700 1 Processor -- start 2023-09-30T22:21:00.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.086+0000 7f0847a1f700 1 -- start start 2023-09-30T22:21:00.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.086+0000 7f0847a1f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f084006a770 0x7f084006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:00.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.086+0000 7f0847a1f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f084006b080 0x7f08401317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:00.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.086+0000 7f0847a1f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0840131cf0 0x7f0840132190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:00.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.086+0000 7f0847a1f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f084009f770 con 0x7f084006b080 2023-09-30T22:21:00.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.086+0000 7f0847a1f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f084009dce0 con 0x7f0840131cf0 2023-09-30T22:21:00.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.086+0000 7f0847a1f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f084009da80 con 0x7f084006a770 2023-09-30T22:21:00.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.087+0000 7f08457bb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f084006a770 0x7f084006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:00.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.087+0000 7f0844fba700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f084006b080 0x7f08401317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:00.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.087+0000 7f08457bb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f084006a770 0x7f084006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54882/0 (socket says 172.21.15.156:54882) 2023-09-30T22:21:00.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.087+0000 7f0845fbc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0840131cf0 0x7f0840132190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:00.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.087+0000 7f08457bb700 1 -- 172.21.15.156:0/3404638599 learned_addr learned my addr 172.21.15.156:0/3404638599 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:00.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.087+0000 7f0845fbc700 1 -- 172.21.15.156:0/3404638599 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f084006a770 msgr2=0x7f084006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:00.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.087+0000 7f0845fbc700 1 --2- 172.21.15.156:0/3404638599 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f084006a770 0x7f084006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.087+0000 7f0845fbc700 1 -- 172.21.15.156:0/3404638599 >> v2:172.21.15.156:3300/0 conn(0x7f084006b080 msgr2=0x7f08401317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:00.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.087+0000 7f0845fbc700 1 --2- 172.21.15.156:0/3404638599 >> v2:172.21.15.156:3300/0 conn(0x7f084006b080 0x7f08401317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.087+0000 7f0845fbc700 1 -- 172.21.15.156:0/3404638599 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f084009eb20 con 0x7f0840131cf0 2023-09-30T22:21:00.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.087+0000 7f0844fba700 1 --2- 172.21.15.156:0/3404638599 >> v2:172.21.15.156:3300/0 conn(0x7f084006b080 0x7f08401317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:00.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.087+0000 7f08457bb700 1 --2- 172.21.15.156:0/3404638599 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f084006a770 0x7f084006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:00.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.087+0000 7f0845fbc700 1 --2- 172.21.15.156:0/3404638599 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0840131cf0 0x7f0840132190 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0838009d90 tx=0x7f083800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b3389e25c76792e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:00.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.087+0000 7f0837fff700 1 -- 172.21.15.156:0/3404638599 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083800e070 con 0x7f0840131cf0 2023-09-30T22:21:00.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.087+0000 7f0837fff700 1 -- 172.21.15.156:0/3404638599 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083800bb20 con 0x7f0840131cf0 2023-09-30T22:21:00.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.087+0000 7f0837fff700 1 -- 172.21.15.156:0/3404638599 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0838012430 con 0x7f0840131cf0 2023-09-30T22:21:00.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.088+0000 7f0847a1f700 1 -- 172.21.15.156:0/3404638599 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0840131cf0 msgr2=0x7f0840132190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:00.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.088+0000 7f0847a1f700 1 --2- 172.21.15.156:0/3404638599 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0840131cf0 0x7f0840132190 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0838009d90 tx=0x7f083800b330 comp rx=0 tx=0).stop 2023-09-30T22:21:00.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.088+0000 7f0847a1f700 1 -- 172.21.15.156:0/3404638599 shutdown_connections 2023-09-30T22:21:00.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.088+0000 7f0847a1f700 1 --2- 172.21.15.156:0/3404638599 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0840131cf0 0x7f0840132190 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.088+0000 7f0847a1f700 1 --2- 172.21.15.156:0/3404638599 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f084006a770 0x7f084006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.088+0000 7f0847a1f700 1 --2- 172.21.15.156:0/3404638599 >> v2:172.21.15.156:3300/0 conn(0x7f084006b080 0x7f08401317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.088+0000 7f0847a1f700 1 -- 172.21.15.156:0/3404638599 >> 172.21.15.156:0/3404638599 conn(0x7f0840099c40 msgr2=0x7f08400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:00.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.088+0000 7f0847a1f700 1 -- 172.21.15.156:0/3404638599 shutdown_connections 2023-09-30T22:21:00.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.088+0000 7f0847a1f700 1 -- 172.21.15.156:0/3404638599 wait complete. 2023-09-30T22:21:00.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.089+0000 7f0847a1f700 1 Processor -- start 2023-09-30T22:21:00.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.089+0000 7f0847a1f700 1 -- start start 2023-09-30T22:21:00.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.089+0000 7f0847a1f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f084006a770 0x7f084009aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:00.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.089+0000 7f0847a1f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f084006b080 0x7f084009b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:00.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.089+0000 7f0847a1f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0840131cf0 0x7f08401c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:00.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.089+0000 7f0847a1f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08401221d0 con 0x7f084006a770 2023-09-30T22:21:00.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.089+0000 7f0847a1f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0840131220 con 0x7f0840131cf0 2023-09-30T22:21:00.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.089+0000 7f0847a1f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0840071e10 con 0x7f084006b080 2023-09-30T22:21:00.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.089+0000 7f08457bb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f084006a770 0x7f084009aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:00.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.089+0000 7f08457bb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f084006a770 0x7f084009aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60640/0 (socket says 172.21.15.156:60640) 2023-09-30T22:21:00.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.089+0000 7f0844fba700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f084006b080 0x7f084009b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:00.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.089+0000 7f08457bb700 1 -- 172.21.15.156:0/618959692 learned_addr learned my addr 172.21.15.156:0/618959692 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:00.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.089+0000 7f0845fbc700 1 --2- 172.21.15.156:0/618959692 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0840131cf0 0x7f08401c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:00.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.090+0000 7f08457bb700 1 -- 172.21.15.156:0/618959692 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f084006b080 msgr2=0x7f084009b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:00.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.090+0000 7f08457bb700 1 --2- 172.21.15.156:0/618959692 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f084006b080 0x7f084009b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.090+0000 7f08457bb700 1 -- 172.21.15.156:0/618959692 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0840131cf0 msgr2=0x7f08401c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:00.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.090+0000 7f08457bb700 1 --2- 172.21.15.156:0/618959692 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0840131cf0 0x7f08401c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.090+0000 7f08457bb700 1 -- 172.21.15.156:0/618959692 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f083c009550 con 0x7f084006a770 2023-09-30T22:21:00.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.090+0000 7f08457bb700 1 --2- 172.21.15.156:0/618959692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f084006a770 0x7f084009aef0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f083c00ebe0 tx=0x7f083c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:00.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.090+0000 7f0835ffb700 1 -- 172.21.15.156:0/618959692 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c00c850 con 0x7f084006a770 2023-09-30T22:21:00.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.090+0000 7f0835ffb700 1 -- 172.21.15.156:0/618959692 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083c00c9b0 con 0x7f084006a770 2023-09-30T22:21:00.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.090+0000 7f0835ffb700 1 -- 172.21.15.156:0/618959692 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c00cd40 con 0x7f084006a770 2023-09-30T22:21:00.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.090+0000 7f0847a1f700 1 -- 172.21.15.156:0/618959692 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08300094a0 con 0x7f084006a770 2023-09-30T22:21:00.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.090+0000 7f0847a1f700 1 -- 172.21.15.156:0/618959692 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0838009a70 con 0x7f084006a770 2023-09-30T22:21:00.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.091+0000 7f0835ffb700 1 -- 172.21.15.156:0/618959692 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f083c013470 con 0x7f084006a770 2023-09-30T22:21:00.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.091+0000 7f0835ffb700 1 -- 172.21.15.156:0/618959692 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f083c03f7e0 con 0x7f084006a770 2023-09-30T22:21:00.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.091+0000 7f0847a1f700 1 -- 172.21.15.156:0/618959692 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08400a28d0 con 0x7f084006a770 2023-09-30T22:21:00.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.096+0000 7f0835ffb700 1 -- 172.21.15.156:0/618959692 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f083c021080 con 0x7f084006a770 2023-09-30T22:21:00.111 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:00.119 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:00.174 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:00.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.240+0000 7fb2bfd58700 1 Processor -- start 2023-09-30T22:21:00.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.240+0000 7fb2bfd58700 1 -- start start 2023-09-30T22:21:00.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.240+0000 7fb2bfd58700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb2b809e340 0x7fb2b81359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:00.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.240+0000 7fb2bfd58700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2b8135f20 0x7fb2b8138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:00.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.240+0000 7fb2bfd58700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b809aaa0 con 0x7fb2b809d860 2023-09-30T22:21:00.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.240+0000 7fb2bfd58700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b809e730 con 0x7fb2b809e340 2023-09-30T22:21:00.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.240+0000 7fb2bfd58700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b809f870 con 0x7fb2b8135f20 2023-09-30T22:21:00.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.241+0000 7fb2bdaf4700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb2b809d860 0x7fb2b809dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:46258/0 (socket says 172.21.15.156:46258) 2023-09-30T22:21:00.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.241+0000 7fb2bdaf4700 1 -- 172.21.15.156:0/353971686 learned_addr learned my addr 172.21.15.156:0/353971686 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:00.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.241+0000 7fb2be2f5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2b8135f20 0x7fb2b8138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:00.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.241+0000 7fb2bd2f3700 1 --2- 172.21.15.156:0/353971686 >> v2:172.21.15.156:3300/0 conn(0x7fb2b809e340 0x7fb2b81359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:00.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.241+0000 7fb2be2f5700 1 -- 172.21.15.156:0/353971686 >> v2:172.21.15.156:3300/0 conn(0x7fb2b809e340 msgr2=0x7fb2b81359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:00.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.241+0000 7fb2be2f5700 1 --2- 172.21.15.156:0/353971686 >> v2:172.21.15.156:3300/0 conn(0x7fb2b809e340 0x7fb2b81359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.241+0000 7fb2be2f5700 1 -- 172.21.15.156:0/353971686 >> v1:172.21.15.156:6789/0 conn(0x7fb2b809d860 legacy=0x7fb2b809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:00.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.241+0000 7fb2be2f5700 1 -- 172.21.15.156:0/353971686 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b809b360 con 0x7fb2b8135f20 2023-09-30T22:21:00.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.241+0000 7fb2bd2f3700 1 --2- 172.21.15.156:0/353971686 >> v2:172.21.15.156:3300/0 conn(0x7fb2b809e340 0x7fb2b81359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:00.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.241+0000 7fb2be2f5700 1 --2- 172.21.15.156:0/353971686 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2b8135f20 0x7fb2b8138300 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0009dc0 tx=0x7fb2b000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d251ef8439437207 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:00.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.241+0000 7fb2bcaf2700 1 -- 172.21.15.156:0/353971686 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b000bce0 con 0x7fb2b8135f20 2023-09-30T22:21:00.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.241+0000 7fb2bcaf2700 1 -- 172.21.15.156:0/353971686 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b000e070 con 0x7fb2b8135f20 2023-09-30T22:21:00.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.242+0000 7fb2bcaf2700 1 -- 172.21.15.156:0/353971686 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b00116c0 con 0x7fb2b8135f20 2023-09-30T22:21:00.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.242+0000 7fb2bfd58700 1 -- 172.21.15.156:0/353971686 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2b8135f20 msgr2=0x7fb2b8138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:00.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.242+0000 7fb2bfd58700 1 --2- 172.21.15.156:0/353971686 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2b8135f20 0x7fb2b8138300 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0009dc0 tx=0x7fb2b000b330 comp rx=0 tx=0).stop 2023-09-30T22:21:00.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.242+0000 7fb2bfd58700 1 -- 172.21.15.156:0/353971686 shutdown_connections 2023-09-30T22:21:00.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.242+0000 7fb2bfd58700 1 --2- 172.21.15.156:0/353971686 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2b8135f20 0x7fb2b8138300 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.242+0000 7fb2bfd58700 1 --2- 172.21.15.156:0/353971686 >> v2:172.21.15.156:3300/0 conn(0x7fb2b809e340 0x7fb2b81359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.242+0000 7fb2bfd58700 1 -- 172.21.15.156:0/353971686 >> 172.21.15.156:0/353971686 conn(0x7fb2b8099c40 msgr2=0x7fb2b80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:00.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.242+0000 7fb2bfd58700 1 -- 172.21.15.156:0/353971686 shutdown_connections 2023-09-30T22:21:00.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.242+0000 7fb2bfd58700 1 -- 172.21.15.156:0/353971686 wait complete. 2023-09-30T22:21:00.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.243+0000 7fb2bfd58700 1 Processor -- start 2023-09-30T22:21:00.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.243+0000 7fb2bfd58700 1 -- start start 2023-09-30T22:21:00.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.244+0000 7fb2bfd58700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2b809d860 0x7fb2b811b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:00.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.244+0000 7fb2bfd58700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2b809e340 0x7fb2b811b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:00.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.244+0000 7fb2bfd58700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2b8135f20 0x7fb2b811be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:00.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.244+0000 7fb2bfd58700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b811cf80 con 0x7fb2b809d860 2023-09-30T22:21:00.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.244+0000 7fb2bfd58700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b811ebb0 con 0x7fb2b8135f20 2023-09-30T22:21:00.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.244+0000 7fb2bfd58700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b811e620 con 0x7fb2b809e340 2023-09-30T22:21:00.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.244+0000 7fb2bd2f3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2b809e340 0x7fb2b811b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:00.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.244+0000 7fb2bd2f3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2b809e340 0x7fb2b811b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54896/0 (socket says 172.21.15.156:54896) 2023-09-30T22:21:00.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.244+0000 7fb2bd2f3700 1 -- 172.21.15.156:0/2201342422 learned_addr learned my addr 172.21.15.156:0/2201342422 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:00.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.244+0000 7fb2bdaf4700 1 --2- 172.21.15.156:0/2201342422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2b809d860 0x7fb2b811b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:00.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.244+0000 7fb2be2f5700 1 --2- 172.21.15.156:0/2201342422 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2b8135f20 0x7fb2b811be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:00.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.244+0000 7fb2bd2f3700 1 -- 172.21.15.156:0/2201342422 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2b8135f20 msgr2=0x7fb2b811be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:00.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.244+0000 7fb2bd2f3700 1 --2- 172.21.15.156:0/2201342422 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2b8135f20 0x7fb2b811be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.244+0000 7fb2bd2f3700 1 -- 172.21.15.156:0/2201342422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2b809d860 msgr2=0x7fb2b811b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:00.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.244+0000 7fb2bd2f3700 1 --2- 172.21.15.156:0/2201342422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2b809d860 0x7fb2b811b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.244+0000 7fb2bd2f3700 1 -- 172.21.15.156:0/2201342422 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a80094a0 con 0x7fb2b809e340 2023-09-30T22:21:00.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.244+0000 7fb2bdaf4700 1 --2- 172.21.15.156:0/2201342422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2b809d860 0x7fb2b811b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:21:00.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.245+0000 7fb2bd2f3700 1 --2- 172.21.15.156:0/2201342422 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2b809e340 0x7fb2b811b950 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8010ec0 tx=0x7fb2a800b420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:00.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.245+0000 7fb2ae7fc700 1 -- 172.21.15.156:0/2201342422 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8015070 con 0x7fb2b809e340 2023-09-30T22:21:00.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.245+0000 7fb2ae7fc700 1 -- 172.21.15.156:0/2201342422 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a800bc40 con 0x7fb2b809e340 2023-09-30T22:21:00.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.245+0000 7fb2bfd58700 1 -- 172.21.15.156:0/2201342422 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b0009a70 con 0x7fb2b809e340 2023-09-30T22:21:00.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.245+0000 7fb2ae7fc700 1 -- 172.21.15.156:0/2201342422 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8019410 con 0x7fb2b809e340 2023-09-30T22:21:00.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.245+0000 7fb2bfd58700 1 -- 172.21.15.156:0/2201342422 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b809c8b0 con 0x7fb2b809e340 2023-09-30T22:21:00.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.246+0000 7fb2ae7fc700 1 -- 172.21.15.156:0/2201342422 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb2a8019570 con 0x7fb2b809e340 2023-09-30T22:21:00.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.246+0000 7fb2ae7fc700 1 -- 172.21.15.156:0/2201342422 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb2a8043070 con 0x7fb2b809e340 2023-09-30T22:21:00.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.246+0000 7fb2bfd58700 1 -- 172.21.15.156:0/2201342422 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b804f2a0 con 0x7fb2b809e340 2023-09-30T22:21:00.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.251+0000 7fb2ae7fc700 1 -- 172.21.15.156:0/2201342422 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2a801e020 con 0x7fb2b809e340 2023-09-30T22:21:00.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.287+0000 7f8501001700 1 Processor -- start 2023-09-30T22:21:00.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.287+0000 7f8501001700 1 -- start start 2023-09-30T22:21:00.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.287+0000 7f8501001700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f84fc09de70 0x7f84fc09e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:00.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.287+0000 7f8501001700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f84fc09e780 0x7f84fc12cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:00.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.288+0000 7f8501001700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84fc09fdf0 con 0x7f84fc12d290 2023-09-30T22:21:00.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.288+0000 7f8501001700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84fc0a0050 con 0x7f84fc09de70 2023-09-30T22:21:00.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.288+0000 7f8501001700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc06ffb0 con 0x7f84fc09e780 2023-09-30T22:21:00.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.288+0000 7f84fad9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f84fc09de70 0x7f84fc09e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:00.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.288+0000 7f84fad9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f84fc09de70 0x7f84fc09e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60652/0 (socket says 172.21.15.156:60652) 2023-09-30T22:21:00.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.288+0000 7f84fad9d700 1 -- 172.21.15.156:0/4079391003 learned_addr learned my addr 172.21.15.156:0/4079391003 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:00.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.288+0000 7f84fa59c700 1 --2- 172.21.15.156:0/4079391003 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f84fc09e780 0x7f84fc12cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:00.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.288+0000 7f84fad9d700 1 -- 172.21.15.156:0/4079391003 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f84fc09e780 msgr2=0x7f84fc12cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:00.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.288+0000 7f84fad9d700 1 --2- 172.21.15.156:0/4079391003 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f84fc09e780 0x7f84fc12cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.288+0000 7f84fad9d700 1 -- 172.21.15.156:0/4079391003 >> v1:172.21.15.156:6789/0 conn(0x7f84fc12d290 legacy=0x7f84fc13a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:00.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.288+0000 7f84f9d9b700 1 -- 172.21.15.156:0/4079391003 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2762958410 0 0) 0x7f84fc09fdf0 con 0x7f84fc12d290 2023-09-30T22:21:00.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.288+0000 7f84fad9d700 1 -- 172.21.15.156:0/4079391003 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84fc06b670 con 0x7f84fc09de70 2023-09-30T22:21:00.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.288+0000 7f84fa59c700 1 --2- 172.21.15.156:0/4079391003 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f84fc09e780 0x7f84fc12cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:00.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.288+0000 7f84fad9d700 1 --2- 172.21.15.156:0/4079391003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84fc09de70 0x7f84fc09e240 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f84ec0098f0 tx=0x7f84ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b3f8782a2e93eb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:00.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.288+0000 7f84f9d9b700 1 -- 172.21.15.156:0/4079391003 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec011830 con 0x7f84fc09de70 2023-09-30T22:21:00.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.289+0000 7f84f9d9b700 1 -- 172.21.15.156:0/4079391003 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ec011990 con 0x7f84fc09de70 2023-09-30T22:21:00.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.289+0000 7f84f9d9b700 1 -- 172.21.15.156:0/4079391003 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec011d20 con 0x7f84fc09de70 2023-09-30T22:21:00.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.289+0000 7f8501001700 1 -- 172.21.15.156:0/4079391003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84fc09de70 msgr2=0x7f84fc09e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:00.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.289+0000 7f8501001700 1 --2- 172.21.15.156:0/4079391003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84fc09de70 0x7f84fc09e240 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f84ec0098f0 tx=0x7f84ec009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:00.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.289+0000 7f8501001700 1 -- 172.21.15.156:0/4079391003 shutdown_connections 2023-09-30T22:21:00.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.289+0000 7f8501001700 1 --2- 172.21.15.156:0/4079391003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84fc09de70 0x7f84fc09e240 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.289+0000 7f8501001700 1 --2- 172.21.15.156:0/4079391003 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f84fc09e780 0x7f84fc12cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.289+0000 7f8501001700 1 -- 172.21.15.156:0/4079391003 >> 172.21.15.156:0/4079391003 conn(0x7f84fc0a27a0 msgr2=0x7f84fc0a2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:00.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.290+0000 7f8501001700 1 -- 172.21.15.156:0/4079391003 shutdown_connections 2023-09-30T22:21:00.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.290+0000 7f8501001700 1 -- 172.21.15.156:0/4079391003 wait complete. 2023-09-30T22:21:00.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.291+0000 7f8501001700 1 Processor -- start 2023-09-30T22:21:00.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.291+0000 7f8501001700 1 -- start start 2023-09-30T22:21:00.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.292+0000 7f8501001700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84fc09de70 0x7f84fc11b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:00.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.292+0000 7f8501001700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f84fc09e780 0x7f84fc11bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:00.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.292+0000 7f8501001700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f84fc12d290 0x7f84fc11c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:00.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.292+0000 7f8501001700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc12ca60 con 0x7f84fc09de70 2023-09-30T22:21:00.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.292+0000 7f8501001700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc11cbd0 con 0x7f84fc12d290 2023-09-30T22:21:00.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.292+0000 7f8501001700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc11e130 con 0x7f84fc09e780 2023-09-30T22:21:00.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.292+0000 7f84fad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84fc09de70 0x7f84fc11b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:00.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.292+0000 7f84fad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84fc09de70 0x7f84fc11b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60658/0 (socket says 172.21.15.156:60658) 2023-09-30T22:21:00.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.292+0000 7f84fad9d700 1 -- 172.21.15.156:0/2149329552 learned_addr learned my addr 172.21.15.156:0/2149329552 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:00.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.292+0000 7f84fa59c700 1 --2- 172.21.15.156:0/2149329552 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f84fc09e780 0x7f84fc11bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:00.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.292+0000 7f84fb59e700 1 --2- 172.21.15.156:0/2149329552 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f84fc12d290 0x7f84fc11c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:00.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.293+0000 7f84fad9d700 1 -- 172.21.15.156:0/2149329552 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f84fc09e780 msgr2=0x7f84fc11bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:00.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.293+0000 7f84fad9d700 1 --2- 172.21.15.156:0/2149329552 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f84fc09e780 0x7f84fc11bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.293+0000 7f84fad9d700 1 -- 172.21.15.156:0/2149329552 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f84fc12d290 msgr2=0x7f84fc11c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:00.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.293+0000 7f84fad9d700 1 --2- 172.21.15.156:0/2149329552 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f84fc12d290 0x7f84fc11c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.293+0000 7f84fad9d700 1 -- 172.21.15.156:0/2149329552 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f00094a0 con 0x7f84fc09de70 2023-09-30T22:21:00.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.293+0000 7f84fa59c700 1 --2- 172.21.15.156:0/2149329552 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f84fc09e780 0x7f84fc11bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:00.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.293+0000 7f84fad9d700 1 --2- 172.21.15.156:0/2149329552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84fc09de70 0x7f84fc11b770 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f84fc09ff80 tx=0x7f84ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:00.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.293+0000 7f84e37fe700 1 -- 172.21.15.156:0/2149329552 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec004300 con 0x7f84fc09de70 2023-09-30T22:21:00.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.293+0000 7f84e37fe700 1 -- 172.21.15.156:0/2149329552 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ec01f070 con 0x7f84fc09de70 2023-09-30T22:21:00.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.293+0000 7f8501001700 1 -- 172.21.15.156:0/2149329552 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84ec009550 con 0x7f84fc09de70 2023-09-30T22:21:00.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.293+0000 7f84e37fe700 1 -- 172.21.15.156:0/2149329552 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec0036a0 con 0x7f84fc09de70 2023-09-30T22:21:00.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.293+0000 7f8501001700 1 -- 172.21.15.156:0/2149329552 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84fc11e990 con 0x7f84fc09de70 2023-09-30T22:21:00.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.294+0000 7f84e37fe700 1 -- 172.21.15.156:0/2149329552 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f84ec021030 con 0x7f84fc09de70 2023-09-30T22:21:00.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.294+0000 7f84e37fe700 1 -- 172.21.15.156:0/2149329552 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f84ec040b60 con 0x7f84fc09de70 2023-09-30T22:21:00.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.294+0000 7f8501001700 1 -- 172.21.15.156:0/2149329552 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84fc11e4f0 con 0x7f84fc09de70 2023-09-30T22:21:00.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.299+0000 7f84e37fe700 1 -- 172.21.15.156:0/2149329552 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f84ec0199a0 con 0x7f84fc09de70 2023-09-30T22:21:00.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.310+0000 7f0847a1f700 1 -- 172.21.15.156:0/618959692 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0840122030 con 0x7f084006a770 2023-09-30T22:21:00.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.310+0000 7f0835ffb700 1 -- 172.21.15.156:0/618959692 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0840122030 con 0x7f084006a770 2023-09-30T22:21:00.311 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:00.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.313+0000 7f0847a1f700 1 -- 172.21.15.156:0/618959692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f084006a770 msgr2=0x7f084009aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:00.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.313+0000 7f0847a1f700 1 --2- 172.21.15.156:0/618959692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f084006a770 0x7f084009aef0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f083c00ebe0 tx=0x7f083c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.314+0000 7f0847a1f700 1 -- 172.21.15.156:0/618959692 shutdown_connections 2023-09-30T22:21:00.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.314+0000 7f0847a1f700 1 --2- 172.21.15.156:0/618959692 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0840131cf0 0x7f08401c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.314+0000 7f0847a1f700 1 --2- 172.21.15.156:0/618959692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f084006a770 0x7f084009aef0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.314+0000 7f0847a1f700 1 --2- 172.21.15.156:0/618959692 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f084006b080 0x7f084009b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.314+0000 7f0847a1f700 1 -- 172.21.15.156:0/618959692 >> 172.21.15.156:0/618959692 conn(0x7f0840099c40 msgr2=0x7f08401b9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:00.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.314+0000 7f0847a1f700 1 -- 172.21.15.156:0/618959692 shutdown_connections 2023-09-30T22:21:00.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.314+0000 7f0847a1f700 1 -- 172.21.15.156:0/618959692 wait complete. 2023-09-30T22:21:00.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:00.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.333+0000 7f9c15117700 1 Processor -- start 2023-09-30T22:21:00.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.333+0000 7f9c15117700 1 -- start start 2023-09-30T22:21:00.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.333+0000 7f9c15117700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9c10133900 0x7f9c10133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:00.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.333+0000 7f9c15117700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c100a10b0 0x7f9c1013b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:00.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.333+0000 7f9c15117700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c1009a760 con 0x7f9c10134210 2023-09-30T22:21:00.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.334+0000 7f9c15117700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c101336e0 con 0x7f9c10133900 2023-09-30T22:21:00.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.334+0000 7f9c15117700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1009a080 con 0x7f9c100a10b0 2023-09-30T22:21:00.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.334+0000 7f9c0ed9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9c10133900 0x7f9c10133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:00.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.334+0000 7f9c0ed9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9c10133900 0x7f9c10133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60674/0 (socket says 172.21.15.156:60674) 2023-09-30T22:21:00.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.334+0000 7f9c0ed9d700 1 -- 172.21.15.156:0/616798886 learned_addr learned my addr 172.21.15.156:0/616798886 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:00.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.334+0000 7f9c0ed9d700 1 -- 172.21.15.156:0/616798886 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c100a10b0 msgr2=0x7f9c1013b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:00.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.334+0000 7f9c0ed9d700 1 --2- 172.21.15.156:0/616798886 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c100a10b0 0x7f9c1013b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.334+0000 7f9c0ed9d700 1 -- 172.21.15.156:0/616798886 >> v1:172.21.15.156:6789/0 conn(0x7f9c10134210 legacy=0x7f9c100a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:00.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.334+0000 7f9c0ed9d700 1 -- 172.21.15.156:0/616798886 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c100a23e0 con 0x7f9c10133900 2023-09-30T22:21:00.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.334+0000 7f9c0dd9b700 1 -- 172.21.15.156:0/616798886 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2292712141 0 0) 0x7f9c1009a760 con 0x7f9c10134210 2023-09-30T22:21:00.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.334+0000 7f9c0ed9d700 1 --2- 172.21.15.156:0/616798886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c10133900 0x7f9c10133cd0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9c00006fd0 tx=0x7f9c00009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed06d060809d62a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:00.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.334+0000 7f9c0dd9b700 1 -- 172.21.15.156:0/616798886 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c00005e30 con 0x7f9c10133900 2023-09-30T22:21:00.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.334+0000 7f9c0dd9b700 1 -- 172.21.15.156:0/616798886 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c00004030 con 0x7f9c10133900 2023-09-30T22:21:00.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.334+0000 7f9c0dd9b700 1 -- 172.21.15.156:0/616798886 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c000043e0 con 0x7f9c10133900 2023-09-30T22:21:00.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.335+0000 7f9c15117700 1 -- 172.21.15.156:0/616798886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c10133900 msgr2=0x7f9c10133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:00.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.335+0000 7f9c15117700 1 --2- 172.21.15.156:0/616798886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c10133900 0x7f9c10133cd0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9c00006fd0 tx=0x7f9c00009bd0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.335+0000 7f9c15117700 1 -- 172.21.15.156:0/616798886 shutdown_connections 2023-09-30T22:21:00.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.335+0000 7f9c15117700 1 --2- 172.21.15.156:0/616798886 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c100a10b0 0x7f9c1013b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.335+0000 7f9c15117700 1 --2- 172.21.15.156:0/616798886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c10133900 0x7f9c10133cd0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.335+0000 7f9c15117700 1 -- 172.21.15.156:0/616798886 >> 172.21.15.156:0/616798886 conn(0x7f9c100a2980 msgr2=0x7f9c100a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:00.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.335+0000 7f9c15117700 1 -- 172.21.15.156:0/616798886 shutdown_connections 2023-09-30T22:21:00.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.335+0000 7f9c15117700 1 -- 172.21.15.156:0/616798886 wait complete. 2023-09-30T22:21:00.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.336+0000 7f9c15117700 1 Processor -- start 2023-09-30T22:21:00.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.336+0000 7f9c15117700 1 -- start start 2023-09-30T22:21:00.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.337+0000 7f9c15117700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9c100a10b0 0x7f9c1011d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:00.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.337+0000 7f9c15117700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c10133900 0x7f9c1011dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:00.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.337+0000 7f9c15117700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c10134210 0x7f9c1011e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:00.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.337+0000 7f9c15117700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1011f250 con 0x7f9c10133900 2023-09-30T22:21:00.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.337+0000 7f9c15117700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1009a2c0 con 0x7f9c10134210 2023-09-30T22:21:00.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.337+0000 7f9c15117700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c10120510 con 0x7f9c100a10b0 2023-09-30T22:21:00.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.337+0000 7f9c0ed9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9c100a10b0 0x7f9c1011d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:00.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.337+0000 7f9c0ed9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9c100a10b0 0x7f9c1011d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54916/0 (socket says 172.21.15.156:54916) 2023-09-30T22:21:00.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.337+0000 7f9c0ed9d700 1 -- 172.21.15.156:0/1543507319 learned_addr learned my addr 172.21.15.156:0/1543507319 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:00.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.337+0000 7f9c0f59e700 1 --2- 172.21.15.156:0/1543507319 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c10134210 0x7f9c1011e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:00.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.337+0000 7f9c0ed9d700 1 -- 172.21.15.156:0/1543507319 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c10134210 msgr2=0x7f9c1011e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:00.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.337+0000 7f9c0ed9d700 1 --2- 172.21.15.156:0/1543507319 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c10134210 0x7f9c1011e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.337+0000 7f9c0ed9d700 1 -- 172.21.15.156:0/1543507319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c10133900 msgr2=0x7f9c1011dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:00.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.337+0000 7f9c0ed9d700 1 --2- 172.21.15.156:0/1543507319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c10133900 0x7f9c1011dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.337+0000 7f9c0ed9d700 1 -- 172.21.15.156:0/1543507319 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c00009500 con 0x7f9c100a10b0 2023-09-30T22:21:00.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.337+0000 7f9c0ed9d700 1 --2- 172.21.15.156:0/1543507319 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9c100a10b0 0x7f9c1011d680 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9c00009130 tx=0x7f9c00004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:00.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.337+0000 7f9bf77fe700 1 -- 172.21.15.156:0/1543507319 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c000045a0 con 0x7f9c100a10b0 2023-09-30T22:21:00.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.337+0000 7f9bf77fe700 1 -- 172.21.15.156:0/1543507319 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0001d430 con 0x7f9c100a10b0 2023-09-30T22:21:00.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.337+0000 7f9bf77fe700 1 -- 172.21.15.156:0/1543507319 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0001d7e0 con 0x7f9c100a10b0 2023-09-30T22:21:00.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.337+0000 7f9c15117700 1 -- 172.21.15.156:0/1543507319 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c10120bc0 con 0x7f9c100a10b0 2023-09-30T22:21:00.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.338+0000 7f9c15117700 1 -- 172.21.15.156:0/1543507319 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c101211d0 con 0x7f9c100a10b0 2023-09-30T22:21:00.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.338+0000 7f9bf77fe700 1 -- 172.21.15.156:0/1543507319 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c0001d940 con 0x7f9c100a10b0 2023-09-30T22:21:00.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.338+0000 7f9c15117700 1 -- 172.21.15.156:0/1543507319 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c1011a590 con 0x7f9c100a10b0 2023-09-30T22:21:00.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.339+0000 7f9bf77fe700 1 -- 172.21.15.156:0/1543507319 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9c00040dc0 con 0x7f9c100a10b0 2023-09-30T22:21:00.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.347+0000 7f9bf77fe700 1 -- 172.21.15.156:0/1543507319 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c00044030 con 0x7f9c100a10b0 2023-09-30T22:21:00.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.453+0000 7fb2bfd58700 1 -- 172.21.15.156:0/2201342422 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb2b811e9a0 con 0x7fb2b809e340 2023-09-30T22:21:00.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.453+0000 7fb2ae7fc700 1 -- 172.21.15.156:0/2201342422 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb2a802b070 con 0x7fb2b809e340 2023-09-30T22:21:00.454 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:00.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.455+0000 7fb2bfd58700 1 -- 172.21.15.156:0/2201342422 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2b809e340 msgr2=0x7fb2b811b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:00.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.455+0000 7fb2bfd58700 1 --2- 172.21.15.156:0/2201342422 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2b809e340 0x7fb2b811b950 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8010ec0 tx=0x7fb2a800b420 comp rx=0 tx=0).stop 2023-09-30T22:21:00.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.455+0000 7fb2bfd58700 1 -- 172.21.15.156:0/2201342422 shutdown_connections 2023-09-30T22:21:00.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.455+0000 7fb2bfd58700 1 --2- 172.21.15.156:0/2201342422 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2b8135f20 0x7fb2b811be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.455+0000 7fb2bfd58700 1 --2- 172.21.15.156:0/2201342422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2b809d860 0x7fb2b811b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.455+0000 7fb2bfd58700 1 --2- 172.21.15.156:0/2201342422 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2b809e340 0x7fb2b811b950 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.455+0000 7fb2bfd58700 1 -- 172.21.15.156:0/2201342422 >> 172.21.15.156:0/2201342422 conn(0x7fb2b8099c40 msgr2=0x7fb2b8132830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:00.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.455+0000 7fb2bfd58700 1 -- 172.21.15.156:0/2201342422 shutdown_connections 2023-09-30T22:21:00.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.455+0000 7fb2bfd58700 1 -- 172.21.15.156:0/2201342422 wait complete. 2023-09-30T22:21:00.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:00.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.535+0000 7f8501001700 1 -- 172.21.15.156:0/2149329552 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f84fc04f2a0 con 0x7f84fc09de70 2023-09-30T22:21:00.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.535+0000 7f84e37fe700 1 -- 172.21.15.156:0/2149329552 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f84ec01b430 con 0x7f84fc09de70 2023-09-30T22:21:00.536 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:00.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.538+0000 7f8501001700 1 -- 172.21.15.156:0/2149329552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84fc09de70 msgr2=0x7f84fc11b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:00.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.538+0000 7f8501001700 1 --2- 172.21.15.156:0/2149329552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84fc09de70 0x7f84fc11b770 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f84fc09ff80 tx=0x7f84ec004750 comp rx=0 tx=0).stop 2023-09-30T22:21:00.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.538+0000 7f8501001700 1 -- 172.21.15.156:0/2149329552 shutdown_connections 2023-09-30T22:21:00.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.538+0000 7f8501001700 1 --2- 172.21.15.156:0/2149329552 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f84fc12d290 0x7f84fc11c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.538+0000 7f8501001700 1 --2- 172.21.15.156:0/2149329552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84fc09de70 0x7f84fc11b770 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.538+0000 7f8501001700 1 --2- 172.21.15.156:0/2149329552 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f84fc09e780 0x7f84fc11bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.538+0000 7f8501001700 1 -- 172.21.15.156:0/2149329552 >> 172.21.15.156:0/2149329552 conn(0x7f84fc0a27a0 msgr2=0x7f84fc070a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:00.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.538+0000 7f8501001700 1 -- 172.21.15.156:0/2149329552 shutdown_connections 2023-09-30T22:21:00.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.538+0000 7f8501001700 1 -- 172.21.15.156:0/2149329552 wait complete. 2023-09-30T22:21:00.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:00.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.566+0000 7f9c15117700 1 -- 172.21.15.156:0/1543507319 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9c1004f2a0 con 0x7f9c100a10b0 2023-09-30T22:21:00.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.566+0000 7f9bf77fe700 1 -- 172.21.15.156:0/1543507319 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9c00016030 con 0x7f9c100a10b0 2023-09-30T22:21:00.567 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:00.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.568+0000 7f9c15117700 1 -- 172.21.15.156:0/1543507319 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9c100a10b0 msgr2=0x7f9c1011d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:00.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.568+0000 7f9c15117700 1 --2- 172.21.15.156:0/1543507319 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9c100a10b0 0x7f9c1011d680 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9c00009130 tx=0x7f9c00004750 comp rx=0 tx=0).stop 2023-09-30T22:21:00.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.568+0000 7f9c15117700 1 -- 172.21.15.156:0/1543507319 shutdown_connections 2023-09-30T22:21:00.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.568+0000 7f9c15117700 1 --2- 172.21.15.156:0/1543507319 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c10134210 0x7f9c1011e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.568+0000 7f9c15117700 1 --2- 172.21.15.156:0/1543507319 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9c100a10b0 0x7f9c1011d680 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.568+0000 7f9c15117700 1 --2- 172.21.15.156:0/1543507319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c10133900 0x7f9c1011dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:00.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.568+0000 7f9c15117700 1 -- 172.21.15.156:0/1543507319 >> 172.21.15.156:0/1543507319 conn(0x7f9c100a2980 msgr2=0x7f9c101bace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:00.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.568+0000 7f9c15117700 1 -- 172.21.15.156:0/1543507319 shutdown_connections 2023-09-30T22:21:00.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:00.568+0000 7f9c15117700 1 -- 172.21.15.156:0/1543507319 wait complete. 2023-09-30T22:21:00.581 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:01.334 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:01.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.460+0000 7f4d6add1700 1 Processor -- start 2023-09-30T22:21:01.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.460+0000 7f4d6add1700 1 -- start start 2023-09-30T22:21:01.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.460+0000 7f4d6add1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4d6409dec0 0x7f4d6406b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:01.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.460+0000 7f4d6add1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d64136cb0 0x7f4d64139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:01.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.460+0000 7f4d6add1700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d6406e900 con 0x7f4d6406a770 2023-09-30T22:21:01.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.460+0000 7f4d6add1700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d6409d180 con 0x7f4d6409dec0 2023-09-30T22:21:01.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.460+0000 7f4d6add1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6409e780 con 0x7f4d64136cb0 2023-09-30T22:21:01.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.460+0000 7f4d6936e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d64136cb0 0x7f4d64139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:01.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.460+0000 7f4d63fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4d6409dec0 0x7f4d6406b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:01.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.460+0000 7f4d6936e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d64136cb0 0x7f4d64139090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:41006/0 (socket says 172.21.15.156:41006) 2023-09-30T22:21:01.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.460+0000 7f4d6936e700 1 -- 172.21.15.156:0/3566880630 learned_addr learned my addr 172.21.15.156:0/3566880630 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:01.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.460+0000 7f4d68b6d700 1 --1- 172.21.15.156:0/3566880630 >> v1:172.21.15.156:6789/0 conn(0x7f4d6406a770 0x7f4d6406ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53002/0 (socket says 172.21.15.156:53002) 2023-09-30T22:21:01.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.461+0000 7f4d63fff700 1 -- 172.21.15.156:0/3566880630 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d64136cb0 msgr2=0x7f4d64139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:01.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.461+0000 7f4d63fff700 1 --2- 172.21.15.156:0/3566880630 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d64136cb0 0x7f4d64139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.461+0000 7f4d63fff700 1 -- 172.21.15.156:0/3566880630 >> v1:172.21.15.156:6789/0 conn(0x7f4d6406a770 legacy=0x7f4d6406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:01.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.461+0000 7f4d63fff700 1 -- 172.21.15.156:0/3566880630 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6409d3c0 con 0x7f4d6409dec0 2023-09-30T22:21:01.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.461+0000 7f4d637fe700 1 -- 172.21.15.156:0/3566880630 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 358389165 0 0) 0x7f4d6406e900 con 0x7f4d6406a770 2023-09-30T22:21:01.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.461+0000 7f4d6936e700 1 --2- 172.21.15.156:0/3566880630 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d64136cb0 0x7f4d64139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:01.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.461+0000 7f4d63fff700 1 --2- 172.21.15.156:0/3566880630 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d6409dec0 0x7f4d6406b250 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f4d50009840 tx=0x7f4d50009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd6d5b3bb76a94e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:01.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.461+0000 7f4d637fe700 1 -- 172.21.15.156:0/3566880630 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d50011830 con 0x7f4d6409dec0 2023-09-30T22:21:01.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.461+0000 7f4d637fe700 1 -- 172.21.15.156:0/3566880630 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d50011990 con 0x7f4d6409dec0 2023-09-30T22:21:01.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.461+0000 7f4d637fe700 1 -- 172.21.15.156:0/3566880630 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d50011d20 con 0x7f4d6409dec0 2023-09-30T22:21:01.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.461+0000 7f4d6add1700 1 -- 172.21.15.156:0/3566880630 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d6409dec0 msgr2=0x7f4d6406b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:01.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.461+0000 7f4d6add1700 1 --2- 172.21.15.156:0/3566880630 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d6409dec0 0x7f4d6406b250 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f4d50009840 tx=0x7f4d50009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:01.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.461+0000 7f4d6add1700 1 -- 172.21.15.156:0/3566880630 shutdown_connections 2023-09-30T22:21:01.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.461+0000 7f4d6add1700 1 --2- 172.21.15.156:0/3566880630 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d64136cb0 0x7f4d64139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.462+0000 7f4d6add1700 1 --2- 172.21.15.156:0/3566880630 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d6409dec0 0x7f4d6406b250 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.462+0000 7f4d6add1700 1 -- 172.21.15.156:0/3566880630 >> 172.21.15.156:0/3566880630 conn(0x7f4d64099c40 msgr2=0x7f4d640a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:01.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.462+0000 7f4d6add1700 1 -- 172.21.15.156:0/3566880630 shutdown_connections 2023-09-30T22:21:01.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.462+0000 7f4d6add1700 1 -- 172.21.15.156:0/3566880630 wait complete. 2023-09-30T22:21:01.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.462+0000 7f4d6add1700 1 Processor -- start 2023-09-30T22:21:01.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.462+0000 7f4d6add1700 1 -- start start 2023-09-30T22:21:01.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.463+0000 7f4d6add1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d6406a770 0x7f4d64134200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:01.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.463+0000 7f4d6add1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d6409dec0 0x7f4d64134740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:01.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.463+0000 7f4d6add1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d64136cb0 0x7f4d64134c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:01.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.463+0000 7f4d6add1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6411aba0 con 0x7f4d64136cb0 2023-09-30T22:21:01.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.463+0000 7f4d6add1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6411a330 con 0x7f4d6406a770 2023-09-30T22:21:01.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.463+0000 7f4d6add1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6412f4c0 con 0x7f4d6409dec0 2023-09-30T22:21:01.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.463+0000 7f4d63fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d6409dec0 0x7f4d64134740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:01.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.463+0000 7f4d6936e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d64136cb0 0x7f4d64134c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:01.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.463+0000 7f4d63fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d6409dec0 0x7f4d64134740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:41010/0 (socket says 172.21.15.156:41010) 2023-09-30T22:21:01.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.463+0000 7f4d63fff700 1 -- 172.21.15.156:0/753153780 learned_addr learned my addr 172.21.15.156:0/753153780 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:01.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.463+0000 7f4d68b6d700 1 --2- 172.21.15.156:0/753153780 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d6406a770 0x7f4d64134200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:01.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.463+0000 7f4d63fff700 1 -- 172.21.15.156:0/753153780 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d6406a770 msgr2=0x7f4d64134200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:01.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.463+0000 7f4d63fff700 1 --2- 172.21.15.156:0/753153780 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d6406a770 0x7f4d64134200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.463+0000 7f4d63fff700 1 -- 172.21.15.156:0/753153780 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d64136cb0 msgr2=0x7f4d64134c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:01.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.463+0000 7f4d63fff700 1 --2- 172.21.15.156:0/753153780 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d64136cb0 0x7f4d64134c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.463+0000 7f4d63fff700 1 -- 172.21.15.156:0/753153780 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c009b30 con 0x7f4d6409dec0 2023-09-30T22:21:01.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.463+0000 7f4d6936e700 1 --2- 172.21.15.156:0/753153780 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d64136cb0 0x7f4d64134c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:01.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.464+0000 7f4d63fff700 1 --2- 172.21.15.156:0/753153780 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d6409dec0 0x7f4d64134740 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4d50009fd0 tx=0x7f4d50004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:01.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.464+0000 7f4d617fa700 1 -- 172.21.15.156:0/753153780 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5001d7c0 con 0x7f4d6409dec0 2023-09-30T22:21:01.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.464+0000 7f4d617fa700 1 -- 172.21.15.156:0/753153780 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5001d940 con 0x7f4d6409dec0 2023-09-30T22:21:01.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.464+0000 7f4d6add1700 1 -- 172.21.15.156:0/753153780 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d500094a0 con 0x7f4d6409dec0 2023-09-30T22:21:01.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.464+0000 7f4d617fa700 1 -- 172.21.15.156:0/753153780 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5001dcf0 con 0x7f4d6409dec0 2023-09-30T22:21:01.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.464+0000 7f4d6add1700 1 -- 172.21.15.156:0/753153780 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d64071ce0 con 0x7f4d6409dec0 2023-09-30T22:21:01.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.464+0000 7f4d617fa700 1 -- 172.21.15.156:0/753153780 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d500036a0 con 0x7f4d6409dec0 2023-09-30T22:21:01.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.465+0000 7f4d617fa700 1 -- 172.21.15.156:0/753153780 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4d50044960 con 0x7f4d6409dec0 2023-09-30T22:21:01.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.465+0000 7f4d6add1700 1 -- 172.21.15.156:0/753153780 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6404f2a0 con 0x7f4d6409dec0 2023-09-30T22:21:01.469 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:01.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.469+0000 7f4d617fa700 1 -- 172.21.15.156:0/753153780 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d50015020 con 0x7f4d6409dec0 2023-09-30T22:21:01.551 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:01.582 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:01.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.602+0000 7fe1a69fd700 1 Processor -- start 2023-09-30T22:21:01.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.603+0000 7fe1a69fd700 1 -- start start 2023-09-30T22:21:01.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.603+0000 7fe1a69fd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1a009d860 0x7fe1a009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:01.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.603+0000 7fe1a69fd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1a0130eb0 0x7fe1a0138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:01.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.603+0000 7fe1a69fd700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a009aaa0 con 0x7fe1a009e170 2023-09-30T22:21:01.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.603+0000 7fe1a69fd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a009f870 con 0x7fe1a009d860 2023-09-30T22:21:01.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.603+0000 7fe1a69fd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a009b360 con 0x7fe1a0130eb0 2023-09-30T22:21:01.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.603+0000 7fe19ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1a009d860 0x7fe1a009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:01.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.603+0000 7fe19ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1a009d860 0x7fe1a009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:43960/0 (socket says 172.21.15.156:43960) 2023-09-30T22:21:01.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.604+0000 7fe19ffff700 1 -- 172.21.15.156:0/298541755 learned_addr learned my addr 172.21.15.156:0/298541755 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:01.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.604+0000 7fe1a4f9a700 1 --2- 172.21.15.156:0/298541755 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1a0130eb0 0x7fe1a0138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:01.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.604+0000 7fe19ffff700 1 -- 172.21.15.156:0/298541755 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1a0130eb0 msgr2=0x7fe1a0138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:01.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.604+0000 7fe19ffff700 1 --2- 172.21.15.156:0/298541755 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1a0130eb0 0x7fe1a0138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.604+0000 7fe19ffff700 1 -- 172.21.15.156:0/298541755 >> v1:172.21.15.156:6789/0 conn(0x7fe1a009e170 legacy=0x7fe1a01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:01.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.604+0000 7fe19ffff700 1 -- 172.21.15.156:0/298541755 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a009b620 con 0x7fe1a009d860 2023-09-30T22:21:01.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.604+0000 7fe19ffff700 1 --2- 172.21.15.156:0/298541755 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1a009d860 0x7fe1a009dc30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe19000bbc0 tx=0x7fe19000bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ac3acaa3dee895 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:01.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.604+0000 7fe19effd700 1 -- 172.21.15.156:0/298541755 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19000dd50 con 0x7fe1a009d860 2023-09-30T22:21:01.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.604+0000 7fe19effd700 1 -- 172.21.15.156:0/298541755 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe190004030 con 0x7fe1a009d860 2023-09-30T22:21:01.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.604+0000 7fe19effd700 1 -- 172.21.15.156:0/298541755 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1900043c0 con 0x7fe1a009d860 2023-09-30T22:21:01.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.605+0000 7fe1a69fd700 1 -- 172.21.15.156:0/298541755 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1a009d860 msgr2=0x7fe1a009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:01.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.605+0000 7fe1a69fd700 1 --2- 172.21.15.156:0/298541755 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1a009d860 0x7fe1a009dc30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe19000bbc0 tx=0x7fe19000bed0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.605+0000 7fe1a69fd700 1 -- 172.21.15.156:0/298541755 shutdown_connections 2023-09-30T22:21:01.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.605+0000 7fe1a69fd700 1 --2- 172.21.15.156:0/298541755 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1a009d860 0x7fe1a009dc30 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.605+0000 7fe1a69fd700 1 --2- 172.21.15.156:0/298541755 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1a0130eb0 0x7fe1a0138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.605+0000 7fe1a69fd700 1 -- 172.21.15.156:0/298541755 >> 172.21.15.156:0/298541755 conn(0x7fe1a0099c40 msgr2=0x7fe1a00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:01.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.605+0000 7fe1a69fd700 1 -- 172.21.15.156:0/298541755 shutdown_connections 2023-09-30T22:21:01.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.605+0000 7fe1a69fd700 1 -- 172.21.15.156:0/298541755 wait complete. 2023-09-30T22:21:01.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.606+0000 7fe1a69fd700 1 Processor -- start 2023-09-30T22:21:01.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.607+0000 7fe1a69fd700 1 -- start start 2023-09-30T22:21:01.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.607+0000 7fe1a69fd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1a009d860 0x7fe1a01c4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:01.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.607+0000 7fe1a69fd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1a009e170 0x7fe1a01c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:01.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.607+0000 7fe1a69fd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1a0130eb0 0x7fe1a011e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:01.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.607+0000 7fe1a69fd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a0120470 con 0x7fe1a009e170 2023-09-30T22:21:01.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.607+0000 7fe1a69fd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a0120280 con 0x7fe1a0130eb0 2023-09-30T22:21:01.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.607+0000 7fe1a69fd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a0072210 con 0x7fe1a009d860 2023-09-30T22:21:01.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.607+0000 7fe19ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1a009d860 0x7fe1a01c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:01.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.607+0000 7fe19ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1a009d860 0x7fe1a01c4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:41042/0 (socket says 172.21.15.156:41042) 2023-09-30T22:21:01.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.607+0000 7fe19ffff700 1 -- 172.21.15.156:0/2999972727 learned_addr learned my addr 172.21.15.156:0/2999972727 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:01.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.607+0000 7fe19f7fe700 1 --2- 172.21.15.156:0/2999972727 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1a009e170 0x7fe1a01c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:01.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.608+0000 7fe1a4f9a700 1 --2- 172.21.15.156:0/2999972727 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1a0130eb0 0x7fe1a011e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:01.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.608+0000 7fe19ffff700 1 -- 172.21.15.156:0/2999972727 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1a0130eb0 msgr2=0x7fe1a011e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:01.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.608+0000 7fe19ffff700 1 --2- 172.21.15.156:0/2999972727 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1a0130eb0 0x7fe1a011e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.608+0000 7fe19ffff700 1 -- 172.21.15.156:0/2999972727 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1a009e170 msgr2=0x7fe1a01c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:01.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.608+0000 7fe19ffff700 1 --2- 172.21.15.156:0/2999972727 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1a009e170 0x7fe1a01c49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.608+0000 7fe19ffff700 1 -- 172.21.15.156:0/2999972727 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19000b7f0 con 0x7fe1a009d860 2023-09-30T22:21:01.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.608+0000 7fe19ffff700 1 --2- 172.21.15.156:0/2999972727 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1a009d860 0x7fe1a01c4490 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe1a009fa00 tx=0x7fe190004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:01.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.608+0000 7fe19cff9700 1 -- 172.21.15.156:0/2999972727 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe190020070 con 0x7fe1a009d860 2023-09-30T22:21:01.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.608+0000 7fe19cff9700 1 -- 172.21.15.156:0/2999972727 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe190006bd0 con 0x7fe1a009d860 2023-09-30T22:21:01.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.608+0000 7fe1a69fd700 1 -- 172.21.15.156:0/2999972727 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a0122190 con 0x7fe1a009d860 2023-09-30T22:21:01.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.608+0000 7fe1a69fd700 1 -- 172.21.15.156:0/2999972727 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a009c900 con 0x7fe1a009d860 2023-09-30T22:21:01.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.610+0000 7fe19cff9700 1 -- 172.21.15.156:0/2999972727 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe190003cc0 con 0x7fe1a009d860 2023-09-30T22:21:01.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.610+0000 7fe19cff9700 1 -- 172.21.15.156:0/2999972727 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe1900193f0 con 0x7fe1a009d860 2023-09-30T22:21:01.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.610+0000 7fe1a69fd700 1 -- 172.21.15.156:0/2999972727 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a0120850 con 0x7fe1a009d860 2023-09-30T22:21:01.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.610+0000 7fe19cff9700 1 -- 172.21.15.156:0/2999972727 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe190042b20 con 0x7fe1a009d860 2023-09-30T22:21:01.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.619+0000 7fe19cff9700 1 -- 172.21.15.156:0/2999972727 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe19002b310 con 0x7fe1a009d860 2023-09-30T22:21:01.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.677+0000 7f4d6add1700 1 -- 172.21.15.156:0/753153780 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4d6409e380 con 0x7f4d6409dec0 2023-09-30T22:21:01.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.677+0000 7f4d617fa700 1 -- 172.21.15.156:0/753153780 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4d5002f940 con 0x7f4d6409dec0 2023-09-30T22:21:01.678 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:01.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.680+0000 7f4d6add1700 1 -- 172.21.15.156:0/753153780 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d6409dec0 msgr2=0x7f4d64134740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:01.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.680+0000 7f4d6add1700 1 --2- 172.21.15.156:0/753153780 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d6409dec0 0x7f4d64134740 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4d50009fd0 tx=0x7f4d50004750 comp rx=0 tx=0).stop 2023-09-30T22:21:01.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.680+0000 7f4d6add1700 1 -- 172.21.15.156:0/753153780 shutdown_connections 2023-09-30T22:21:01.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.680+0000 7f4d6add1700 1 --2- 172.21.15.156:0/753153780 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d64136cb0 0x7f4d64134c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.680+0000 7f4d6add1700 1 --2- 172.21.15.156:0/753153780 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d6406a770 0x7f4d64134200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.680+0000 7f4d6add1700 1 --2- 172.21.15.156:0/753153780 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d6409dec0 0x7f4d64134740 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.680+0000 7f4d6add1700 1 -- 172.21.15.156:0/753153780 >> 172.21.15.156:0/753153780 conn(0x7f4d64099c40 msgr2=0x7f4d64138a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:01.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.680+0000 7f4d6add1700 1 -- 172.21.15.156:0/753153780 shutdown_connections 2023-09-30T22:21:01.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.680+0000 7f4d6add1700 1 -- 172.21.15.156:0/753153780 wait complete. 2023-09-30T22:21:01.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.691+0000 7f929997c700 1 Processor -- start 2023-09-30T22:21:01.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.691+0000 7f929997c700 1 -- start start 2023-09-30T22:21:01.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.692+0000 7f929997c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9294138040 0x7f9294138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:01.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.692+0000 7f929997c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f92940a08e0 0x7f92940a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:01.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.692+0000 7f929997c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92940a1230 0x7f929413ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:01.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.692+0000 7f929997c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92940a2100 con 0x7f92940a08e0 2023-09-30T22:21:01.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.692+0000 7f929997c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9294138950 con 0x7f92940a1230 2023-09-30T22:21:01.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.692+0000 7f929997c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92941379e0 con 0x7f9294138040 2023-09-30T22:21:01.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.692+0000 7f92937fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92940a1230 0x7f929413ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:01.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.692+0000 7f92937fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92940a1230 0x7f929413ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:43982/0 (socket says 172.21.15.156:43982) 2023-09-30T22:21:01.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.692+0000 7f92937fe700 1 -- 172.21.15.156:0/3244239530 learned_addr learned my addr 172.21.15.156:0/3244239530 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:01.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.692+0000 7f92927fc700 1 --2- 172.21.15.156:0/3244239530 >> v2:172.21.15.156:3300/0 conn(0x7f92940a08e0 0x7f92940a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:01.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.692+0000 7f9292ffd700 1 --2- 172.21.15.156:0/3244239530 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9294138040 0x7f9294138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:01.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.693+0000 7f92937fe700 1 -- 172.21.15.156:0/3244239530 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9294138040 msgr2=0x7f9294138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:01.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.693+0000 7f92937fe700 1 --2- 172.21.15.156:0/3244239530 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9294138040 0x7f9294138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.693+0000 7f92937fe700 1 -- 172.21.15.156:0/3244239530 >> v2:172.21.15.156:3300/0 conn(0x7f92940a08e0 msgr2=0x7f92940a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:01.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.693+0000 7f92937fe700 1 --2- 172.21.15.156:0/3244239530 >> v2:172.21.15.156:3300/0 conn(0x7f92940a08e0 0x7f92940a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.693+0000 7f92937fe700 1 -- 172.21.15.156:0/3244239530 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929409b9b0 con 0x7f92940a1230 2023-09-30T22:21:01.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.693+0000 7f92937fe700 1 --2- 172.21.15.156:0/3244239530 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92940a1230 0x7f929413ed10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f928c009e80 tx=0x7f928c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55d53a90ec9c7f8e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:01.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.693+0000 7f9291ffb700 1 -- 172.21.15.156:0/3244239530 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c00e070 con 0x7f92940a1230 2023-09-30T22:21:01.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.693+0000 7f9291ffb700 1 -- 172.21.15.156:0/3244239530 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928c00b8d0 con 0x7f92940a1230 2023-09-30T22:21:01.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.693+0000 7f9291ffb700 1 -- 172.21.15.156:0/3244239530 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c00bc80 con 0x7f92940a1230 2023-09-30T22:21:01.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.694+0000 7f929997c700 1 -- 172.21.15.156:0/3244239530 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92940a1230 msgr2=0x7f929413ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:01.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.694+0000 7f929997c700 1 --2- 172.21.15.156:0/3244239530 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92940a1230 0x7f929413ed10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f928c009e80 tx=0x7f928c00b330 comp rx=0 tx=0).stop 2023-09-30T22:21:01.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.694+0000 7f929997c700 1 -- 172.21.15.156:0/3244239530 shutdown_connections 2023-09-30T22:21:01.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.694+0000 7f929997c700 1 --2- 172.21.15.156:0/3244239530 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92940a1230 0x7f929413ed10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.694+0000 7f929997c700 1 --2- 172.21.15.156:0/3244239530 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9294138040 0x7f9294138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.694+0000 7f929997c700 1 --2- 172.21.15.156:0/3244239530 >> v2:172.21.15.156:3300/0 conn(0x7f92940a08e0 0x7f92940a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.694+0000 7f929997c700 1 -- 172.21.15.156:0/3244239530 >> 172.21.15.156:0/3244239530 conn(0x7f92940a2980 msgr2=0x7f92940a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:01.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:01.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.694+0000 7f929997c700 1 -- 172.21.15.156:0/3244239530 shutdown_connections 2023-09-30T22:21:01.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.694+0000 7f929997c700 1 -- 172.21.15.156:0/3244239530 wait complete. 2023-09-30T22:21:01.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.695+0000 7f929997c700 1 Processor -- start 2023-09-30T22:21:01.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.695+0000 7f929997c700 1 -- start start 2023-09-30T22:21:01.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.696+0000 7f929997c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92940a08e0 0x7f9294134900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:01.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.696+0000 7f929997c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92940a1230 0x7f9294134e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:01.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.696+0000 7f929997c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9294138040 0x7f92941d4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:01.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.696+0000 7f929997c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929411b120 con 0x7f9294138040 2023-09-30T22:21:01.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.696+0000 7f929997c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9294135380 con 0x7f92940a08e0 2023-09-30T22:21:01.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.696+0000 7f929997c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f929411b300 con 0x7f92940a1230 2023-09-30T22:21:01.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.696+0000 7f92927fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92940a1230 0x7f9294134e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:01.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.696+0000 7f92927fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92940a1230 0x7f9294134e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:41052/0 (socket says 172.21.15.156:41052) 2023-09-30T22:21:01.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.696+0000 7f92927fc700 1 -- 172.21.15.156:0/2167741581 learned_addr learned my addr 172.21.15.156:0/2167741581 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:01.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.696+0000 7f92937fe700 1 --2- 172.21.15.156:0/2167741581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9294138040 0x7f92941d4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:01.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.696+0000 7f9292ffd700 1 --2- 172.21.15.156:0/2167741581 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92940a08e0 0x7f9294134900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:01.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.696+0000 7f92927fc700 1 -- 172.21.15.156:0/2167741581 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92940a08e0 msgr2=0x7f9294134900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:01.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.696+0000 7f92927fc700 1 --2- 172.21.15.156:0/2167741581 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92940a08e0 0x7f9294134900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.696+0000 7f92927fc700 1 -- 172.21.15.156:0/2167741581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9294138040 msgr2=0x7f92941d4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:01.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.696+0000 7f92927fc700 1 --2- 172.21.15.156:0/2167741581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9294138040 0x7f92941d4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.696+0000 7f92927fc700 1 -- 172.21.15.156:0/2167741581 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928c009b30 con 0x7f92940a1230 2023-09-30T22:21:01.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.696+0000 7f92937fe700 1 --2- 172.21.15.156:0/2167741581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9294138040 0x7f92941d4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:01.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.696+0000 7f92927fc700 1 --2- 172.21.15.156:0/2167741581 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92940a1230 0x7f9294134e40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f928800e840 tx=0x7f928800eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:01.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.697+0000 7f927bfff700 1 -- 172.21.15.156:0/2167741581 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9288013680 con 0x7f92940a1230 2023-09-30T22:21:01.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.697+0000 7f927bfff700 1 -- 172.21.15.156:0/2167741581 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92880137e0 con 0x7f92940a1230 2023-09-30T22:21:01.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.697+0000 7f929997c700 1 -- 172.21.15.156:0/2167741581 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929411a640 con 0x7f92940a1230 2023-09-30T22:21:01.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.697+0000 7f927bfff700 1 -- 172.21.15.156:0/2167741581 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9288013b70 con 0x7f92940a1230 2023-09-30T22:21:01.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.697+0000 7f929997c700 1 -- 172.21.15.156:0/2167741581 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92941193f0 con 0x7f92940a1230 2023-09-30T22:21:01.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.698+0000 7f927bfff700 1 -- 172.21.15.156:0/2167741581 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9288013cd0 con 0x7f92940a1230 2023-09-30T22:21:01.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.698+0000 7f929997c700 1 -- 172.21.15.156:0/2167741581 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f929411af40 con 0x7f92940a1230 2023-09-30T22:21:01.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.698+0000 7f927bfff700 1 -- 172.21.15.156:0/2167741581 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f928803f130 con 0x7f92940a1230 2023-09-30T22:21:01.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.702+0000 7f927bfff700 1 -- 172.21.15.156:0/2167741581 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f928801be10 con 0x7f92940a1230 2023-09-30T22:21:01.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.726+0000 7fb78e689700 1 Processor -- start 2023-09-30T22:21:01.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.726+0000 7fb78e689700 1 -- start start 2023-09-30T22:21:01.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.727+0000 7fb78e689700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb78809e870 0x7fb78809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:01.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.727+0000 7fb78e689700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb78809f180 0x7fb788131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:01.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.727+0000 7fb78e689700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb78809c970 con 0x7fb788131d70 2023-09-30T22:21:01.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.727+0000 7fb78e689700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880a0920 con 0x7fb78809f180 2023-09-30T22:21:01.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.727+0000 7fb78e689700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb78809f9c0 con 0x7fb78809e870 2023-09-30T22:21:01.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.727+0000 7fb787fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb78809e870 0x7fb78809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:01.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.727+0000 7fb7877fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb78809f180 0x7fb788131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:01.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.727+0000 7fb78cc26700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb788131d70 0x7fb788138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53032/0 (socket says 172.21.15.156:53032) 2023-09-30T22:21:01.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.727+0000 7fb787fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb78809e870 0x7fb78809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:41056/0 (socket says 172.21.15.156:41056) 2023-09-30T22:21:01.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.727+0000 7fb78cc26700 1 -- 172.21.15.156:0/3350035349 learned_addr learned my addr 172.21.15.156:0/3350035349 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:01.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.728+0000 7fb7877fe700 1 -- 172.21.15.156:0/3350035349 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb78809e870 msgr2=0x7fb78809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:01.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.728+0000 7fb7877fe700 1 --2- 172.21.15.156:0/3350035349 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb78809e870 0x7fb78809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.728+0000 7fb7877fe700 1 -- 172.21.15.156:0/3350035349 >> v1:172.21.15.156:6789/0 conn(0x7fb788131d70 legacy=0x7fb788138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:01.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.728+0000 7fb7877fe700 1 -- 172.21.15.156:0/3350035349 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78809bab0 con 0x7fb78809f180 2023-09-30T22:21:01.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.728+0000 7fb7877fe700 1 --2- 172.21.15.156:0/3350035349 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb78809f180 0x7fb788131830 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb77c009870 tx=0x7fb77c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1824533491144517 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:01.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.728+0000 7fb786ffd700 1 -- 172.21.15.156:0/3350035349 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c004230 con 0x7fb78809f180 2023-09-30T22:21:01.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.728+0000 7fb786ffd700 1 -- 172.21.15.156:0/3350035349 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77c004390 con 0x7fb78809f180 2023-09-30T22:21:01.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.728+0000 7fb786ffd700 1 -- 172.21.15.156:0/3350035349 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c0036a0 con 0x7fb78809f180 2023-09-30T22:21:01.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.729+0000 7fb78e689700 1 -- 172.21.15.156:0/3350035349 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb78809f180 msgr2=0x7fb788131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:01.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.729+0000 7fb78e689700 1 --2- 172.21.15.156:0/3350035349 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb78809f180 0x7fb788131830 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb77c009870 tx=0x7fb77c009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:01.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.729+0000 7fb78e689700 1 -- 172.21.15.156:0/3350035349 shutdown_connections 2023-09-30T22:21:01.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.729+0000 7fb78e689700 1 --2- 172.21.15.156:0/3350035349 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb78809e870 0x7fb78809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.729+0000 7fb78e689700 1 --2- 172.21.15.156:0/3350035349 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb78809f180 0x7fb788131830 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.729+0000 7fb78e689700 1 -- 172.21.15.156:0/3350035349 >> 172.21.15.156:0/3350035349 conn(0x7fb7880a4430 msgr2=0x7fb7880a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:01.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.729+0000 7fb78e689700 1 -- 172.21.15.156:0/3350035349 shutdown_connections 2023-09-30T22:21:01.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.729+0000 7fb78e689700 1 -- 172.21.15.156:0/3350035349 wait complete. 2023-09-30T22:21:01.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.730+0000 7fb78e689700 1 Processor -- start 2023-09-30T22:21:01.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.730+0000 7fb78e689700 1 -- start start 2023-09-30T22:21:01.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.730+0000 7fb78e689700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb78809e870 0x7fb7881202c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:01.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.730+0000 7fb78e689700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb78809f180 0x7fb788120800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:01.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.730+0000 7fb78e689700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb788131d70 0x7fb788120d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:01.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.730+0000 7fb78e689700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb788122000 con 0x7fb78809e870 2023-09-30T22:21:01.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.730+0000 7fb78e689700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb788122d10 con 0x7fb78809f180 2023-09-30T22:21:01.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.730+0000 7fb78e689700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb78809dba0 con 0x7fb788131d70 2023-09-30T22:21:01.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.730+0000 7fb7877fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb78809f180 0x7fb788120800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:01.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.730+0000 7fb787fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb78809e870 0x7fb7881202c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:01.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.730+0000 7fb7877fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb78809f180 0x7fb788120800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44018/0 (socket says 172.21.15.156:44018) 2023-09-30T22:21:01.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.730+0000 7fb7877fe700 1 -- 172.21.15.156:0/3677058196 learned_addr learned my addr 172.21.15.156:0/3677058196 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:01.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.730+0000 7fb787fff700 1 --2- 172.21.15.156:0/3677058196 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb78809e870 0x7fb7881202c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33944/0 (socket says 172.21.15.156:33944) 2023-09-30T22:21:01.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.730+0000 7fb78cc26700 1 --2- 172.21.15.156:0/3677058196 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb788131d70 0x7fb788120d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:01.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.731+0000 7fb7877fe700 1 -- 172.21.15.156:0/3677058196 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb788131d70 msgr2=0x7fb788120d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:01.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.731+0000 7fb7877fe700 1 --2- 172.21.15.156:0/3677058196 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb788131d70 0x7fb788120d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.731+0000 7fb7877fe700 1 -- 172.21.15.156:0/3677058196 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb78809e870 msgr2=0x7fb7881202c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:01.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.731+0000 7fb7877fe700 1 --2- 172.21.15.156:0/3677058196 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb78809e870 0x7fb7881202c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.731+0000 7fb7877fe700 1 -- 172.21.15.156:0/3677058196 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77c0094a0 con 0x7fb78809f180 2023-09-30T22:21:01.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.731+0000 7fb787fff700 1 --2- 172.21.15.156:0/3677058196 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb78809e870 0x7fb7881202c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:01.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.731+0000 7fb7877fe700 1 --2- 172.21.15.156:0/3677058196 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb78809f180 0x7fb788120800 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb77c0090b0 tx=0x7fb77c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:01.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.731+0000 7fb784ff9700 1 -- 172.21.15.156:0/3677058196 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c0045d0 con 0x7fb78809f180 2023-09-30T22:21:01.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.731+0000 7fb784ff9700 1 -- 172.21.15.156:0/3677058196 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77c01f070 con 0x7fb78809f180 2023-09-30T22:21:01.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.731+0000 7fb78e689700 1 -- 172.21.15.156:0/3677058196 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb788123d90 con 0x7fb78809f180 2023-09-30T22:21:01.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.731+0000 7fb784ff9700 1 -- 172.21.15.156:0/3677058196 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c011850 con 0x7fb78809f180 2023-09-30T22:21:01.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.731+0000 7fb78e689700 1 -- 172.21.15.156:0/3677058196 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb788123ab0 con 0x7fb78809f180 2023-09-30T22:21:01.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.732+0000 7fb784ff9700 1 -- 172.21.15.156:0/3677058196 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb77c0119b0 con 0x7fb78809f180 2023-09-30T22:21:01.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.732+0000 7fb78e689700 1 -- 172.21.15.156:0/3677058196 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb78804f2a0 con 0x7fb78809f180 2023-09-30T22:21:01.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.732+0000 7fb784ff9700 1 -- 172.21.15.156:0/3677058196 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb77c021070 con 0x7fb78809f180 2023-09-30T22:21:01.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.737+0000 7fb784ff9700 1 -- 172.21.15.156:0/3677058196 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb77c02ece0 con 0x7fb78809f180 2023-09-30T22:21:01.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.825+0000 7fe1a69fd700 1 -- 172.21.15.156:0/2999972727 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe1a004f2a0 con 0x7fe1a009d860 2023-09-30T22:21:01.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.825+0000 7fe19cff9700 1 -- 172.21.15.156:0/2999972727 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe19000ecb0 con 0x7fe1a009d860 2023-09-30T22:21:01.826 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:01.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.827+0000 7fe1a69fd700 1 -- 172.21.15.156:0/2999972727 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1a009d860 msgr2=0x7fe1a01c4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:01.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.827+0000 7fe1a69fd700 1 --2- 172.21.15.156:0/2999972727 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1a009d860 0x7fe1a01c4490 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe1a009fa00 tx=0x7fe190004750 comp rx=0 tx=0).stop 2023-09-30T22:21:01.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.827+0000 7fe1a69fd700 1 -- 172.21.15.156:0/2999972727 shutdown_connections 2023-09-30T22:21:01.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.827+0000 7fe1a69fd700 1 --2- 172.21.15.156:0/2999972727 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1a0130eb0 0x7fe1a011e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.827+0000 7fe1a69fd700 1 --2- 172.21.15.156:0/2999972727 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1a009d860 0x7fe1a01c4490 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.827+0000 7fe1a69fd700 1 --2- 172.21.15.156:0/2999972727 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1a009e170 0x7fe1a01c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.827+0000 7fe1a69fd700 1 -- 172.21.15.156:0/2999972727 >> 172.21.15.156:0/2999972727 conn(0x7fe1a0099c40 msgr2=0x7fe1a0070fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:01.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.827+0000 7fe1a69fd700 1 -- 172.21.15.156:0/2999972727 shutdown_connections 2023-09-30T22:21:01.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.827+0000 7fe1a69fd700 1 -- 172.21.15.156:0/2999972727 wait complete. 2023-09-30T22:21:01.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:01.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.898+0000 7f929997c700 1 -- 172.21.15.156:0/2167741581 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f929404f2a0 con 0x7f92940a1230 2023-09-30T22:21:01.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.898+0000 7f927bfff700 1 -- 172.21.15.156:0/2167741581 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9288017090 con 0x7f92940a1230 2023-09-30T22:21:01.899 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:01.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.900+0000 7f929997c700 1 -- 172.21.15.156:0/2167741581 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92940a1230 msgr2=0x7f9294134e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:01.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.900+0000 7f929997c700 1 --2- 172.21.15.156:0/2167741581 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92940a1230 0x7f9294134e40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f928800e840 tx=0x7f928800eb50 comp rx=0 tx=0).stop 2023-09-30T22:21:01.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.900+0000 7f929997c700 1 -- 172.21.15.156:0/2167741581 shutdown_connections 2023-09-30T22:21:01.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.900+0000 7f929997c700 1 --2- 172.21.15.156:0/2167741581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9294138040 0x7f92941d4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.900+0000 7f929997c700 1 --2- 172.21.15.156:0/2167741581 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92940a08e0 0x7f9294134900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.900+0000 7f929997c700 1 --2- 172.21.15.156:0/2167741581 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92940a1230 0x7f9294134e40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.900+0000 7f929997c700 1 -- 172.21.15.156:0/2167741581 >> 172.21.15.156:0/2167741581 conn(0x7f92940a2980 msgr2=0x7f9294070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:01.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.900+0000 7f929997c700 1 -- 172.21.15.156:0/2167741581 shutdown_connections 2023-09-30T22:21:01.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.900+0000 7f929997c700 1 -- 172.21.15.156:0/2167741581 wait complete. 2023-09-30T22:21:01.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:01.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.929+0000 7fb78e689700 1 -- 172.21.15.156:0/3677058196 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb78806b2a0 con 0x7fb78809f180 2023-09-30T22:21:01.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.930+0000 7fb784ff9700 1 -- 172.21.15.156:0/3677058196 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb77c02eb00 con 0x7fb78809f180 2023-09-30T22:21:01.930 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:01.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.932+0000 7fb78e689700 1 -- 172.21.15.156:0/3677058196 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb78809f180 msgr2=0x7fb788120800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:01.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.932+0000 7fb78e689700 1 --2- 172.21.15.156:0/3677058196 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb78809f180 0x7fb788120800 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb77c0090b0 tx=0x7fb77c004750 comp rx=0 tx=0).stop 2023-09-30T22:21:01.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.932+0000 7fb78e689700 1 -- 172.21.15.156:0/3677058196 shutdown_connections 2023-09-30T22:21:01.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.932+0000 7fb78e689700 1 --2- 172.21.15.156:0/3677058196 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb788131d70 0x7fb788120d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.932+0000 7fb78e689700 1 --2- 172.21.15.156:0/3677058196 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb78809e870 0x7fb7881202c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.932+0000 7fb78e689700 1 --2- 172.21.15.156:0/3677058196 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb78809f180 0x7fb788120800 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:01.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.932+0000 7fb78e689700 1 -- 172.21.15.156:0/3677058196 >> 172.21.15.156:0/3677058196 conn(0x7fb7880a4430 msgr2=0x7fb788071480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:01.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.932+0000 7fb78e689700 1 -- 172.21.15.156:0/3677058196 shutdown_connections 2023-09-30T22:21:01.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:01.932+0000 7fb78e689700 1 -- 172.21.15.156:0/3677058196 wait complete. 2023-09-30T22:21:01.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:02.697 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:02.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.823+0000 7fb0ac08a700 1 Processor -- start 2023-09-30T22:21:02.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.823+0000 7fb0ac08a700 1 -- start start 2023-09-30T22:21:02.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.824+0000 7fb0ac08a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0a409ad40 0x7fb0a4133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:02.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.824+0000 7fb0ac08a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0a4133f70 0x7fb0a41343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:02.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.824+0000 7fb0ac08a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb0a40a0a70 0x7fb0a40a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:02.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.824+0000 7fb0ac08a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a40a3b60 con 0x7fb0a40a0a70 2023-09-30T22:21:02.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.824+0000 7fb0ac08a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a41348e0 con 0x7fb0a4133f70 2023-09-30T22:21:02.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.824+0000 7fb0ac08a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a409b110 con 0x7fb0a409ad40 2023-09-30T22:21:02.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.824+0000 7fb0aa627700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb0a40a0a70 0x7fb0a40a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:02.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.824+0000 7fb0a9e26700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0a409ad40 0x7fb0a4133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:02.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.824+0000 7fb0a9625700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0a4133f70 0x7fb0a41343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:02.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.824+0000 7fb0a9e26700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0a409ad40 0x7fb0a4133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:41084/0 (socket says 172.21.15.156:41084) 2023-09-30T22:21:02.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.824+0000 7fb0aa627700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb0a40a0a70 0x7fb0a40a0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33952/0 (socket says 172.21.15.156:33952) 2023-09-30T22:21:02.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.824+0000 7fb0a9625700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0a4133f70 0x7fb0a41343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44032/0 (socket says 172.21.15.156:44032) 2023-09-30T22:21:02.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.824+0000 7fb0a9e26700 1 -- 172.21.15.156:0/850440605 learned_addr learned my addr 172.21.15.156:0/850440605 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:02.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.824+0000 7fb0a9e26700 1 -- 172.21.15.156:0/850440605 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0a4133f70 msgr2=0x7fb0a41343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:02.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.824+0000 7fb0a9e26700 1 --2- 172.21.15.156:0/850440605 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0a4133f70 0x7fb0a41343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:02.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.824+0000 7fb0a9e26700 1 -- 172.21.15.156:0/850440605 >> v2:172.21.15.156:3300/0 conn(0x7fb0a40a0a70 msgr2=0x7fb0a40a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:02.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.824+0000 7fb0a9e26700 1 --2- 172.21.15.156:0/850440605 >> v2:172.21.15.156:3300/0 conn(0x7fb0a40a0a70 0x7fb0a40a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:02.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.824+0000 7fb0a9e26700 1 -- 172.21.15.156:0/850440605 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a40a2fa0 con 0x7fb0a409ad40 2023-09-30T22:21:02.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.824+0000 7fb0a9625700 1 --2- 172.21.15.156:0/850440605 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0a4133f70 0x7fb0a41343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:02.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.824+0000 7fb0aa627700 1 --2- 172.21.15.156:0/850440605 >> v2:172.21.15.156:3300/0 conn(0x7fb0a40a0a70 0x7fb0a40a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:02.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.824+0000 7fb0a9e26700 1 --2- 172.21.15.156:0/850440605 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0a409ad40 0x7fb0a4133a30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb0940098f0 tx=0x7fb094009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf81e0eb71a6ebea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:02.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.825+0000 7fb0a8e24700 1 -- 172.21.15.156:0/850440605 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb094011830 con 0x7fb0a409ad40 2023-09-30T22:21:02.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.825+0000 7fb0a8e24700 1 -- 172.21.15.156:0/850440605 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb094011990 con 0x7fb0a409ad40 2023-09-30T22:21:02.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.825+0000 7fb0a8e24700 1 -- 172.21.15.156:0/850440605 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb094011d20 con 0x7fb0a409ad40 2023-09-30T22:21:02.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.825+0000 7fb0ac08a700 1 -- 172.21.15.156:0/850440605 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0a409ad40 msgr2=0x7fb0a4133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:02.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.825+0000 7fb0ac08a700 1 --2- 172.21.15.156:0/850440605 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0a409ad40 0x7fb0a4133a30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb0940098f0 tx=0x7fb094009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:02.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.825+0000 7fb0ac08a700 1 -- 172.21.15.156:0/850440605 shutdown_connections 2023-09-30T22:21:02.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.825+0000 7fb0ac08a700 1 --2- 172.21.15.156:0/850440605 >> v2:172.21.15.156:3300/0 conn(0x7fb0a40a0a70 0x7fb0a40a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:02.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.825+0000 7fb0ac08a700 1 --2- 172.21.15.156:0/850440605 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0a409ad40 0x7fb0a4133a30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:02.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.825+0000 7fb0ac08a700 1 --2- 172.21.15.156:0/850440605 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0a4133f70 0x7fb0a41343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:02.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.825+0000 7fb0ac08a700 1 -- 172.21.15.156:0/850440605 >> 172.21.15.156:0/850440605 conn(0x7fb0a4099c40 msgr2=0x7fb0a406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:02.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.825+0000 7fb0ac08a700 1 -- 172.21.15.156:0/850440605 shutdown_connections 2023-09-30T22:21:02.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.825+0000 7fb0ac08a700 1 -- 172.21.15.156:0/850440605 wait complete. 2023-09-30T22:21:02.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.826+0000 7fb0ac08a700 1 Processor -- start 2023-09-30T22:21:02.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.826+0000 7fb0ac08a700 1 -- start start 2023-09-30T22:21:02.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.826+0000 7fb0ac08a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0a409ad40 0x7fb0a41214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:02.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.826+0000 7fb0ac08a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0a40a0a70 0x7fb0a4121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:02.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.827+0000 7fb0ac08a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0a4133f70 0x7fb0a4121f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:02.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.827+0000 7fb0ac08a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a41327d0 con 0x7fb0a4133f70 2023-09-30T22:21:02.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.827+0000 7fb0ac08a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a4124ca0 con 0x7fb0a409ad40 2023-09-30T22:21:02.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.827+0000 7fb0ac08a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a409d360 con 0x7fb0a40a0a70 2023-09-30T22:21:02.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.827+0000 7fb0a9e26700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0a409ad40 0x7fb0a41214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:02.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.827+0000 7fb0a9e26700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0a409ad40 0x7fb0a41214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44038/0 (socket says 172.21.15.156:44038) 2023-09-30T22:21:02.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.827+0000 7fb0a9e26700 1 -- 172.21.15.156:0/3801667704 learned_addr learned my addr 172.21.15.156:0/3801667704 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:02.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.827+0000 7fb0a9625700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0a40a0a70 0x7fb0a4121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:02.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.827+0000 7fb0aa627700 1 --2- 172.21.15.156:0/3801667704 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0a4133f70 0x7fb0a4121f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:02.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.827+0000 7fb0a9e26700 1 -- 172.21.15.156:0/3801667704 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0a40a0a70 msgr2=0x7fb0a4121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:02.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.827+0000 7fb0a9e26700 1 --2- 172.21.15.156:0/3801667704 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0a40a0a70 0x7fb0a4121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:02.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.827+0000 7fb0a9e26700 1 -- 172.21.15.156:0/3801667704 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0a4133f70 msgr2=0x7fb0a4121f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:02.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.827+0000 7fb0a9e26700 1 --2- 172.21.15.156:0/3801667704 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0a4133f70 0x7fb0a4121f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:02.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.827+0000 7fb0a9e26700 1 -- 172.21.15.156:0/3801667704 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09c009a70 con 0x7fb0a409ad40 2023-09-30T22:21:02.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.827+0000 7fb0a9e26700 1 --2- 172.21.15.156:0/3801667704 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0a409ad40 0x7fb0a41214e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb094009c40 tx=0x7fb094004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:02.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.827+0000 7fb09a7fc700 1 -- 172.21.15.156:0/3801667704 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb094004450 con 0x7fb0a409ad40 2023-09-30T22:21:02.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.827+0000 7fb09a7fc700 1 -- 172.21.15.156:0/3801667704 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09401e070 con 0x7fb0a409ad40 2023-09-30T22:21:02.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.827+0000 7fb09a7fc700 1 -- 172.21.15.156:0/3801667704 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0940038e0 con 0x7fb0a409ad40 2023-09-30T22:21:02.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.827+0000 7fb0ac08a700 1 -- 172.21.15.156:0/3801667704 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a00094a0 con 0x7fb0a409ad40 2023-09-30T22:21:02.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.827+0000 7fb0ac08a700 1 -- 172.21.15.156:0/3801667704 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb094009550 con 0x7fb0a409ad40 2023-09-30T22:21:02.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.828+0000 7fb09a7fc700 1 -- 172.21.15.156:0/3801667704 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb094003a40 con 0x7fb0a409ad40 2023-09-30T22:21:02.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.828+0000 7fb09a7fc700 1 -- 172.21.15.156:0/3801667704 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb094020070 con 0x7fb0a409ad40 2023-09-30T22:21:02.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.828+0000 7fb0ac08a700 1 -- 172.21.15.156:0/3801667704 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a404f2a0 con 0x7fb0a409ad40 2023-09-30T22:21:02.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.833+0000 7fb09a7fc700 1 -- 172.21.15.156:0/3801667704 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb094015080 con 0x7fb0a409ad40 2023-09-30T22:21:02.841 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:02.914 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:02.945 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:02.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.970+0000 7efef25b3700 1 Processor -- start 2023-09-30T22:21:02.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.970+0000 7efef25b3700 1 -- start start 2023-09-30T22:21:02.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.971+0000 7efef25b3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efeec099e20 0x7efeec09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:02.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.971+0000 7efef25b3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efeec09a730 0x7efeec130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:02.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.971+0000 7efef25b3700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeec099a60 con 0x7efeec130890 2023-09-30T22:21:02.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.971+0000 7efef25b3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeec09bf50 con 0x7efeec099e20 2023-09-30T22:21:02.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.971+0000 7efef25b3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efeec09b230 con 0x7efeec09a730 2023-09-30T22:21:02.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.971+0000 7efeebfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efeec099e20 0x7efeec09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:02.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.971+0000 7efeeb7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efeec09a730 0x7efeec130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:02.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.971+0000 7efeebfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efeec099e20 0x7efeec09a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44054/0 (socket says 172.21.15.156:44054) 2023-09-30T22:21:02.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.971+0000 7efeebfff700 1 -- 172.21.15.156:0/3385349765 learned_addr learned my addr 172.21.15.156:0/3385349765 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:02.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.971+0000 7efeeaffd700 1 -- 172.21.15.156:0/3385349765 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1063024825 0 0) 0x7efeec099a60 con 0x7efeec130890 2023-09-30T22:21:02.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.971+0000 7efeebfff700 1 -- 172.21.15.156:0/3385349765 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efeec09a730 msgr2=0x7efeec130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:02.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.971+0000 7efeebfff700 1 --2- 172.21.15.156:0/3385349765 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efeec09a730 0x7efeec130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:02.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.971+0000 7efeebfff700 1 -- 172.21.15.156:0/3385349765 >> v1:172.21.15.156:6789/0 conn(0x7efeec130890 legacy=0x7efeec137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:02.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.971+0000 7efeebfff700 1 -- 172.21.15.156:0/3385349765 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeec09bb90 con 0x7efeec099e20 2023-09-30T22:21:02.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.972+0000 7efeeb7fe700 1 --2- 172.21.15.156:0/3385349765 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efeec09a730 0x7efeec130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:02.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.972+0000 7efeebfff700 1 --2- 172.21.15.156:0/3385349765 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efeec099e20 0x7efeec09a1f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7efedc00bb90 tx=0x7efedc00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=851b6b8e81f956c5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:02.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.972+0000 7efeeaffd700 1 -- 172.21.15.156:0/3385349765 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc005e30 con 0x7efeec099e20 2023-09-30T22:21:02.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.972+0000 7efeeaffd700 1 -- 172.21.15.156:0/3385349765 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efedc004030 con 0x7efeec099e20 2023-09-30T22:21:02.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.972+0000 7efeeaffd700 1 -- 172.21.15.156:0/3385349765 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc0043e0 con 0x7efeec099e20 2023-09-30T22:21:02.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.973+0000 7efef25b3700 1 -- 172.21.15.156:0/3385349765 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efeec099e20 msgr2=0x7efeec09a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:02.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.973+0000 7efef25b3700 1 --2- 172.21.15.156:0/3385349765 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efeec099e20 0x7efeec09a1f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7efedc00bb90 tx=0x7efedc00bea0 comp rx=0 tx=0).stop 2023-09-30T22:21:02.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.973+0000 7efef25b3700 1 -- 172.21.15.156:0/3385349765 shutdown_connections 2023-09-30T22:21:02.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.973+0000 7efef25b3700 1 --2- 172.21.15.156:0/3385349765 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efeec099e20 0x7efeec09a1f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:02.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.973+0000 7efef25b3700 1 --2- 172.21.15.156:0/3385349765 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efeec09a730 0x7efeec130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:02.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.973+0000 7efef25b3700 1 -- 172.21.15.156:0/3385349765 >> 172.21.15.156:0/3385349765 conn(0x7efeec0a2980 msgr2=0x7efeec0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:02.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.973+0000 7efef25b3700 1 -- 172.21.15.156:0/3385349765 shutdown_connections 2023-09-30T22:21:02.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.973+0000 7efef25b3700 1 -- 172.21.15.156:0/3385349765 wait complete. 2023-09-30T22:21:02.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.974+0000 7efef25b3700 1 Processor -- start 2023-09-30T22:21:02.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.974+0000 7efef25b3700 1 -- start start 2023-09-30T22:21:02.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.975+0000 7efef25b3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efeec099e20 0x7efeec11a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:02.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.975+0000 7efef25b3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efeec09a730 0x7efeec11af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:02.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.975+0000 7efef25b3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efeec130890 0x7efeec11b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:02.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.975+0000 7efef25b3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec11d4c0 con 0x7efeec130890 2023-09-30T22:21:02.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.975+0000 7efef25b3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeec130310 con 0x7efeec09a730 2023-09-30T22:21:02.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.975+0000 7efef25b3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efeec09b470 con 0x7efeec099e20 2023-09-30T22:21:02.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.975+0000 7efef0b50700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efeec130890 0x7efeec11b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:02.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.975+0000 7efeebfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efeec099e20 0x7efeec11a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:02.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.975+0000 7efef0b50700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efeec130890 0x7efeec11b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33966/0 (socket says 172.21.15.156:33966) 2023-09-30T22:21:02.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.975+0000 7efef0b50700 1 -- 172.21.15.156:0/3814753147 learned_addr learned my addr 172.21.15.156:0/3814753147 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:02.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.975+0000 7efeeb7fe700 1 --2- 172.21.15.156:0/3814753147 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efeec09a730 0x7efeec11af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:02.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.976+0000 7efef0b50700 1 -- 172.21.15.156:0/3814753147 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efeec099e20 msgr2=0x7efeec11a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:02.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.976+0000 7efef0b50700 1 --2- 172.21.15.156:0/3814753147 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efeec099e20 0x7efeec11a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:02.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.976+0000 7efef0b50700 1 -- 172.21.15.156:0/3814753147 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efeec09a730 msgr2=0x7efeec11af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:02.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.976+0000 7efef0b50700 1 --2- 172.21.15.156:0/3814753147 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efeec09a730 0x7efeec11af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:02.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.976+0000 7efef0b50700 1 -- 172.21.15.156:0/3814753147 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee00094a0 con 0x7efeec130890 2023-09-30T22:21:02.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.976+0000 7efef0b50700 1 --2- 172.21.15.156:0/3814753147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efeec130890 0x7efeec11b470 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7efee400c810 tx=0x7efee400cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:02.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.976+0000 7efee8ff9700 1 -- 172.21.15.156:0/3814753147 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee4003e30 con 0x7efeec130890 2023-09-30T22:21:02.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.976+0000 7efee8ff9700 1 -- 172.21.15.156:0/3814753147 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee4005070 con 0x7efeec130890 2023-09-30T22:21:02.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.976+0000 7efee8ff9700 1 -- 172.21.15.156:0/3814753147 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee4005400 con 0x7efeec130890 2023-09-30T22:21:02.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.976+0000 7efef25b3700 1 -- 172.21.15.156:0/3814753147 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efedc00b7a0 con 0x7efeec130890 2023-09-30T22:21:02.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.976+0000 7efef25b3700 1 -- 172.21.15.156:0/3814753147 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeec11ec50 con 0x7efeec130890 2023-09-30T22:21:02.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.977+0000 7efee8ff9700 1 -- 172.21.15.156:0/3814753147 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efee4005560 con 0x7efeec130890 2023-09-30T22:21:02.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.977+0000 7efee8ff9700 1 -- 172.21.15.156:0/3814753147 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efee403f340 con 0x7efeec130890 2023-09-30T22:21:02.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.977+0000 7efef25b3700 1 -- 172.21.15.156:0/3814753147 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeec072480 con 0x7efeec130890 2023-09-30T22:21:02.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:02.983+0000 7efee8ff9700 1 -- 172.21.15.156:0/3814753147 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efeec072480 con 0x7efeec130890 2023-09-30T22:21:03.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.037+0000 7fb0ac08a700 1 -- 172.21.15.156:0/3801667704 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb0a4133d50 con 0x7fb0a409ad40 2023-09-30T22:21:03.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.038+0000 7fb09a7fc700 1 -- 172.21.15.156:0/3801667704 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb09402a020 con 0x7fb0a409ad40 2023-09-30T22:21:03.038 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:03.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.040+0000 7fb0ac08a700 1 -- 172.21.15.156:0/3801667704 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0a409ad40 msgr2=0x7fb0a41214e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:03.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.040+0000 7fb0ac08a700 1 --2- 172.21.15.156:0/3801667704 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0a409ad40 0x7fb0a41214e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb094009c40 tx=0x7fb094004750 comp rx=0 tx=0).stop 2023-09-30T22:21:03.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.040+0000 7fb0ac08a700 1 -- 172.21.15.156:0/3801667704 shutdown_connections 2023-09-30T22:21:03.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.040+0000 7fb0ac08a700 1 --2- 172.21.15.156:0/3801667704 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0a4133f70 0x7fb0a4121f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:03.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.040+0000 7fb0ac08a700 1 --2- 172.21.15.156:0/3801667704 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0a409ad40 0x7fb0a41214e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:03.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.040+0000 7fb0ac08a700 1 --2- 172.21.15.156:0/3801667704 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0a40a0a70 0x7fb0a4121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:03.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.040+0000 7fb0ac08a700 1 -- 172.21.15.156:0/3801667704 >> 172.21.15.156:0/3801667704 conn(0x7fb0a4099c40 msgr2=0x7fb0a409e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:03.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.040+0000 7fb0ac08a700 1 -- 172.21.15.156:0/3801667704 shutdown_connections 2023-09-30T22:21:03.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.040+0000 7fb0ac08a700 1 -- 172.21.15.156:0/3801667704 wait complete. 2023-09-30T22:21:03.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:03.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.076+0000 7fbfa8393700 1 Processor -- start 2023-09-30T22:21:03.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.076+0000 7fbfa8393700 1 -- start start 2023-09-30T22:21:03.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.077+0000 7fbfa8393700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfa0136960 0x7fbfa0138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:03.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.077+0000 7fbfa8393700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbfa0139280 0x7fbfa013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:03.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.077+0000 7fbfa8393700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa006b2d0 con 0x7fbfa0133ad0 2023-09-30T22:21:03.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.077+0000 7fbfa8393700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa01345b0 con 0x7fbfa0136960 2023-09-30T22:21:03.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.077+0000 7fbfa8393700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa0133610 con 0x7fbfa0139280 2023-09-30T22:21:03.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.077+0000 7fbfa592e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfa0136960 0x7fbfa0138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:03.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.077+0000 7fbfa612f700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fbfa0133ad0 0x7fbfa0133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53046/0 (socket says 172.21.15.156:53046) 2023-09-30T22:21:03.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.077+0000 7fbfa612f700 1 -- 172.21.15.156:0/666554722 learned_addr learned my addr 172.21.15.156:0/666554722 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:03.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.077+0000 7fbfa6930700 1 --2- 172.21.15.156:0/666554722 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbfa0139280 0x7fbfa013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:03.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.077+0000 7fbfa592e700 1 -- 172.21.15.156:0/666554722 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbfa0139280 msgr2=0x7fbfa013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:03.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.077+0000 7fbfa592e700 1 --2- 172.21.15.156:0/666554722 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbfa0139280 0x7fbfa013b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:03.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.077+0000 7fbfa512d700 1 -- 172.21.15.156:0/666554722 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037824721 0 0) 0x7fbfa006b2d0 con 0x7fbfa0133ad0 2023-09-30T22:21:03.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.077+0000 7fbfa592e700 1 -- 172.21.15.156:0/666554722 >> v1:172.21.15.156:6789/0 conn(0x7fbfa0133ad0 legacy=0x7fbfa0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:03.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.077+0000 7fbfa592e700 1 -- 172.21.15.156:0/666554722 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa009a500 con 0x7fbfa0136960 2023-09-30T22:21:03.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.078+0000 7fbfa6930700 1 --2- 172.21.15.156:0/666554722 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbfa0139280 0x7fbfa013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:03.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.078+0000 7fbfa592e700 1 --2- 172.21.15.156:0/666554722 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfa0136960 0x7fbfa0138d40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbf90009870 tx=0x7fbf90009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=345ff3903d60124b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:03.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.078+0000 7fbfa512d700 1 -- 172.21.15.156:0/666554722 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf90011830 con 0x7fbfa0136960 2023-09-30T22:21:03.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.078+0000 7fbfa512d700 1 -- 172.21.15.156:0/666554722 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf90011990 con 0x7fbfa0136960 2023-09-30T22:21:03.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.078+0000 7fbfa512d700 1 -- 172.21.15.156:0/666554722 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf90011d20 con 0x7fbfa0136960 2023-09-30T22:21:03.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.079+0000 7fbfa8393700 1 -- 172.21.15.156:0/666554722 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfa0136960 msgr2=0x7fbfa0138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:03.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.079+0000 7fbfa8393700 1 --2- 172.21.15.156:0/666554722 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfa0136960 0x7fbfa0138d40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbf90009870 tx=0x7fbf90009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:03.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.079+0000 7fbfa8393700 1 -- 172.21.15.156:0/666554722 shutdown_connections 2023-09-30T22:21:03.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.079+0000 7fbfa8393700 1 --2- 172.21.15.156:0/666554722 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbfa0139280 0x7fbfa013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:03.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.079+0000 7fbfa8393700 1 --2- 172.21.15.156:0/666554722 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfa0136960 0x7fbfa0138d40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:03.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.079+0000 7fbfa8393700 1 -- 172.21.15.156:0/666554722 >> 172.21.15.156:0/666554722 conn(0x7fbfa0099c40 msgr2=0x7fbfa00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:03.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.079+0000 7fbfa8393700 1 -- 172.21.15.156:0/666554722 shutdown_connections 2023-09-30T22:21:03.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.079+0000 7fbfa8393700 1 -- 172.21.15.156:0/666554722 wait complete. 2023-09-30T22:21:03.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.080+0000 7fbfa8393700 1 Processor -- start 2023-09-30T22:21:03.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.080+0000 7fbfa8393700 1 -- start start 2023-09-30T22:21:03.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.081+0000 7fbfa8393700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfa0133ad0 0x7fbfa012cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:03.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.081+0000 7fbfa8393700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfa0136960 0x7fbfa012d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:03.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.081+0000 7fbfa8393700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbfa0139280 0x7fbfa012d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:03.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.081+0000 7fbfa8393700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa01317a0 con 0x7fbfa0133ad0 2023-09-30T22:21:03.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.081+0000 7fbfa8393700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa006edc0 con 0x7fbfa0136960 2023-09-30T22:21:03.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.081+0000 7fbfa8393700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa009f390 con 0x7fbfa0139280 2023-09-30T22:21:03.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.081+0000 7fbfa592e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfa0136960 0x7fbfa012d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:03.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.081+0000 7fbfa592e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfa0136960 0x7fbfa012d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44086/0 (socket says 172.21.15.156:44086) 2023-09-30T22:21:03.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.081+0000 7fbfa592e700 1 -- 172.21.15.156:0/2455327524 learned_addr learned my addr 172.21.15.156:0/2455327524 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:03.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.081+0000 7fbfa6930700 1 --2- 172.21.15.156:0/2455327524 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbfa0139280 0x7fbfa012d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:03.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.081+0000 7fbfa612f700 1 --2- 172.21.15.156:0/2455327524 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfa0133ad0 0x7fbfa012cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:03.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.081+0000 7fbfa592e700 1 -- 172.21.15.156:0/2455327524 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbfa0139280 msgr2=0x7fbfa012d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:03.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.081+0000 7fbfa592e700 1 --2- 172.21.15.156:0/2455327524 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbfa0139280 0x7fbfa012d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:03.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.081+0000 7fbfa592e700 1 -- 172.21.15.156:0/2455327524 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfa0133ad0 msgr2=0x7fbfa012cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:03.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.081+0000 7fbfa592e700 1 --2- 172.21.15.156:0/2455327524 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfa0133ad0 0x7fbfa012cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:03.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.081+0000 7fbfa592e700 1 -- 172.21.15.156:0/2455327524 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf98009a70 con 0x7fbfa0136960 2023-09-30T22:21:03.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.081+0000 7fbfa592e700 1 --2- 172.21.15.156:0/2455327524 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfa0136960 0x7fbfa012d070 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbf90009840 tx=0x7fbf90004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:03.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.082+0000 7fbf96ffd700 1 -- 172.21.15.156:0/2455327524 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf900042c0 con 0x7fbfa0136960 2023-09-30T22:21:03.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.082+0000 7fbf96ffd700 1 -- 172.21.15.156:0/2455327524 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9001f070 con 0x7fbfa0136960 2023-09-30T22:21:03.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.082+0000 7fbfa8393700 1 -- 172.21.15.156:0/2455327524 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf900094a0 con 0x7fbfa0136960 2023-09-30T22:21:03.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.082+0000 7fbf96ffd700 1 -- 172.21.15.156:0/2455327524 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf900036a0 con 0x7fbfa0136960 2023-09-30T22:21:03.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.082+0000 7fbfa8393700 1 -- 172.21.15.156:0/2455327524 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa00701b0 con 0x7fbfa0136960 2023-09-30T22:21:03.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.083+0000 7fbf96ffd700 1 -- 172.21.15.156:0/2455327524 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbf90021030 con 0x7fbfa0136960 2023-09-30T22:21:03.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.083+0000 7fbf96ffd700 1 -- 172.21.15.156:0/2455327524 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbf900406d0 con 0x7fbfa0136960 2023-09-30T22:21:03.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.083+0000 7fbfa8393700 1 -- 172.21.15.156:0/2455327524 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa0070ce0 con 0x7fbfa0136960 2023-09-30T22:21:03.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.087+0000 7f6da1a0b700 1 Processor -- start 2023-09-30T22:21:03.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.087+0000 7f6da1a0b700 1 -- start start 2023-09-30T22:21:03.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.087+0000 7f6da1a0b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d9c1368e0 0x7f6d9c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:03.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.087+0000 7f6da1a0b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6d9c139200 0x7f6d9c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:03.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.087+0000 7f6da1a0b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d9c09a760 con 0x7f6d9c133900 2023-09-30T22:21:03.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.087+0000 7f6da1a0b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d9c1336e0 con 0x7f6d9c139200 2023-09-30T22:21:03.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.087+0000 7f6da1a0b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c09a080 con 0x7f6d9c1368e0 2023-09-30T22:21:03.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.088+0000 7fbf96ffd700 1 -- 172.21.15.156:0/2455327524 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf900239c0 con 0x7fbfa0136960 2023-09-30T22:21:03.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.088+0000 7f6d9a7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d9c1368e0 0x7f6d9c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:03.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.088+0000 7f6d9a7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d9c1368e0 0x7f6d9c138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44098/0 (socket says 172.21.15.156:44098) 2023-09-30T22:21:03.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.088+0000 7f6d9a7fc700 1 -- 172.21.15.156:0/3505753377 learned_addr learned my addr 172.21.15.156:0/3505753377 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:03.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.088+0000 7f6d9b7fe700 1 --2- 172.21.15.156:0/3505753377 >> v2:172.21.15.156:3300/0 conn(0x7f6d9c139200 0x7f6d9c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:03.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.088+0000 7f6d99ffb700 1 -- 172.21.15.156:0/3505753377 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3480422505 0 0) 0x7f6d9c09a760 con 0x7f6d9c133900 2023-09-30T22:21:03.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.088+0000 7f6d99ffb700 1 -- 172.21.15.156:0/3505753377 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d840035b0 con 0x7f6d9c133900 2023-09-30T22:21:03.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.088+0000 7f6d9a7fc700 1 -- 172.21.15.156:0/3505753377 >> v2:172.21.15.156:3300/0 conn(0x7f6d9c139200 msgr2=0x7f6d9c13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:03.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.088+0000 7f6d9a7fc700 1 --2- 172.21.15.156:0/3505753377 >> v2:172.21.15.156:3300/0 conn(0x7f6d9c139200 0x7f6d9c13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:03.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.088+0000 7f6d9a7fc700 1 -- 172.21.15.156:0/3505753377 >> v1:172.21.15.156:6789/0 conn(0x7f6d9c133900 legacy=0x7f6d9c133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:03.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.088+0000 7f6d9a7fc700 1 -- 172.21.15.156:0/3505753377 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9c0a23e0 con 0x7f6d9c1368e0 2023-09-30T22:21:03.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.088+0000 7f6d9a7fc700 1 --2- 172.21.15.156:0/3505753377 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d9c1368e0 0x7f6d9c138cc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6d900098f0 tx=0x7f6d90009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=163560033b8fe3f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:03.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.088+0000 7f6d99ffb700 1 -- 172.21.15.156:0/3505753377 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d90011830 con 0x7f6d9c1368e0 2023-09-30T22:21:03.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.088+0000 7f6d99ffb700 1 -- 172.21.15.156:0/3505753377 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d90011990 con 0x7f6d9c1368e0 2023-09-30T22:21:03.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.088+0000 7f6d99ffb700 1 -- 172.21.15.156:0/3505753377 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d90011d20 con 0x7f6d9c1368e0 2023-09-30T22:21:03.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.089+0000 7f6da1a0b700 1 -- 172.21.15.156:0/3505753377 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d9c1368e0 msgr2=0x7f6d9c138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:03.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.089+0000 7f6da1a0b700 1 --2- 172.21.15.156:0/3505753377 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d9c1368e0 0x7f6d9c138cc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6d900098f0 tx=0x7f6d90009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:03.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.089+0000 7f6da1a0b700 1 -- 172.21.15.156:0/3505753377 shutdown_connections 2023-09-30T22:21:03.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.089+0000 7f6da1a0b700 1 --2- 172.21.15.156:0/3505753377 >> v2:172.21.15.156:3300/0 conn(0x7f6d9c139200 0x7f6d9c13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:03.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.089+0000 7f6da1a0b700 1 --2- 172.21.15.156:0/3505753377 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d9c1368e0 0x7f6d9c138cc0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:03.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.089+0000 7f6da1a0b700 1 -- 172.21.15.156:0/3505753377 >> 172.21.15.156:0/3505753377 conn(0x7f6d9c0a2980 msgr2=0x7f6d9c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:03.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.089+0000 7f6da1a0b700 1 -- 172.21.15.156:0/3505753377 shutdown_connections 2023-09-30T22:21:03.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.089+0000 7f6da1a0b700 1 -- 172.21.15.156:0/3505753377 wait complete. 2023-09-30T22:21:03.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.090+0000 7f6da1a0b700 1 Processor -- start 2023-09-30T22:21:03.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.091+0000 7f6da1a0b700 1 -- start start 2023-09-30T22:21:03.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.091+0000 7f6da1a0b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d9c133900 0x7f6d9c11afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:03.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.091+0000 7f6da1a0b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d9c1368e0 0x7f6d9c11b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:03.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.091+0000 7f6da1a0b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d9c139200 0x7f6d9c11ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:03.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.091+0000 7f6da1a0b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c11ea70 con 0x7f6d9c139200 2023-09-30T22:21:03.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.091+0000 7f6da1a0b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c11c3c0 con 0x7f6d9c1368e0 2023-09-30T22:21:03.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.091+0000 7f6da1a0b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c11e4d0 con 0x7f6d9c133900 2023-09-30T22:21:03.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.092+0000 7f6d9affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d9c133900 0x7f6d9c11afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:03.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.092+0000 7f6d9affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d9c133900 0x7f6d9c11afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:41142/0 (socket says 172.21.15.156:41142) 2023-09-30T22:21:03.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.092+0000 7f6d9affd700 1 -- 172.21.15.156:0/3597407784 learned_addr learned my addr 172.21.15.156:0/3597407784 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:03.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.092+0000 7f6d9a7fc700 1 --2- 172.21.15.156:0/3597407784 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d9c1368e0 0x7f6d9c11b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:03.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.092+0000 7f6d9b7fe700 1 --2- 172.21.15.156:0/3597407784 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d9c139200 0x7f6d9c11ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:03.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.092+0000 7f6d9affd700 1 -- 172.21.15.156:0/3597407784 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d9c1368e0 msgr2=0x7f6d9c11b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:03.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.092+0000 7f6d9affd700 1 --2- 172.21.15.156:0/3597407784 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d9c1368e0 0x7f6d9c11b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:03.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.092+0000 7f6d9affd700 1 -- 172.21.15.156:0/3597407784 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d9c139200 msgr2=0x7f6d9c11ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:03.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.092+0000 7f6d9affd700 1 --2- 172.21.15.156:0/3597407784 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d9c139200 0x7f6d9c11ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:03.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.092+0000 7f6d9affd700 1 -- 172.21.15.156:0/3597407784 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d90009550 con 0x7f6d9c133900 2023-09-30T22:21:03.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.092+0000 7f6d9affd700 1 --2- 172.21.15.156:0/3597407784 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d9c133900 0x7f6d9c11afd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00c730 tx=0x7f6d8c00ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:03.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.092+0000 7f6d83fff700 1 -- 172.21.15.156:0/3597407784 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c0054e0 con 0x7f6d9c133900 2023-09-30T22:21:03.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.092+0000 7f6d83fff700 1 -- 172.21.15.156:0/3597407784 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8c0036a0 con 0x7f6d9c133900 2023-09-30T22:21:03.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.092+0000 7f6d83fff700 1 -- 172.21.15.156:0/3597407784 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c003a10 con 0x7f6d9c133900 2023-09-30T22:21:03.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.092+0000 7f6da1a0b700 1 -- 172.21.15.156:0/3597407784 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d9c11caf0 con 0x7f6d9c133900 2023-09-30T22:21:03.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.092+0000 7f6da1a0b700 1 -- 172.21.15.156:0/3597407784 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d9c11f200 con 0x7f6d9c133900 2023-09-30T22:21:03.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.093+0000 7f6da1a0b700 1 -- 172.21.15.156:0/3597407784 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d9c04f2a0 con 0x7f6d9c133900 2023-09-30T22:21:03.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.093+0000 7f6d83fff700 1 -- 172.21.15.156:0/3597407784 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6d8c003b70 con 0x7f6d9c133900 2023-09-30T22:21:03.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.094+0000 7f6d83fff700 1 -- 172.21.15.156:0/3597407784 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6d8c03ea70 con 0x7f6d9c133900 2023-09-30T22:21:03.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.098+0000 7f6d83fff700 1 -- 172.21.15.156:0/3597407784 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6d8c040e60 con 0x7f6d9c133900 2023-09-30T22:21:03.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.221+0000 7efef25b3700 1 -- 172.21.15.156:0/3814753147 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efeec072480 con 0x7efeec130890 2023-09-30T22:21:03.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.221+0000 7efee8ff9700 1 -- 172.21.15.156:0/3814753147 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efeec072480 con 0x7efeec130890 2023-09-30T22:21:03.222 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:03.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.223+0000 7efef25b3700 1 -- 172.21.15.156:0/3814753147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efeec130890 msgr2=0x7efeec11b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:03.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.223+0000 7efef25b3700 1 --2- 172.21.15.156:0/3814753147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efeec130890 0x7efeec11b470 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7efee400c810 tx=0x7efee400cb20 comp rx=0 tx=0).stop 2023-09-30T22:21:03.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.223+0000 7efef25b3700 1 -- 172.21.15.156:0/3814753147 shutdown_connections 2023-09-30T22:21:03.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.223+0000 7efef25b3700 1 --2- 172.21.15.156:0/3814753147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efeec130890 0x7efeec11b470 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:03.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.223+0000 7efef25b3700 1 --2- 172.21.15.156:0/3814753147 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efeec099e20 0x7efeec11a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:03.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.223+0000 7efef25b3700 1 --2- 172.21.15.156:0/3814753147 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efeec09a730 0x7efeec11af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:03.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.223+0000 7efef25b3700 1 -- 172.21.15.156:0/3814753147 >> 172.21.15.156:0/3814753147 conn(0x7efeec0a2980 msgr2=0x7efeec12d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:03.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.223+0000 7efef25b3700 1 -- 172.21.15.156:0/3814753147 shutdown_connections 2023-09-30T22:21:03.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.223+0000 7efef25b3700 1 -- 172.21.15.156:0/3814753147 wait complete. 2023-09-30T22:21:03.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:03.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.283+0000 7fbfa8393700 1 -- 172.21.15.156:0/2455327524 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbfa004f2a0 con 0x7fbfa0136960 2023-09-30T22:21:03.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.283+0000 7fbf96ffd700 1 -- 172.21.15.156:0/2455327524 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbf90015020 con 0x7fbfa0136960 2023-09-30T22:21:03.284 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:03.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.285+0000 7fbfa8393700 1 -- 172.21.15.156:0/2455327524 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfa0136960 msgr2=0x7fbfa012d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:03.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.285+0000 7fbfa8393700 1 --2- 172.21.15.156:0/2455327524 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfa0136960 0x7fbfa012d070 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbf90009840 tx=0x7fbf90004750 comp rx=0 tx=0).stop 2023-09-30T22:21:03.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.285+0000 7fbfa8393700 1 -- 172.21.15.156:0/2455327524 shutdown_connections 2023-09-30T22:21:03.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.285+0000 7fbfa8393700 1 --2- 172.21.15.156:0/2455327524 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbfa0139280 0x7fbfa012d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:03.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.285+0000 7fbfa8393700 1 --2- 172.21.15.156:0/2455327524 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfa0133ad0 0x7fbfa012cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:03.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.285+0000 7fbfa8393700 1 --2- 172.21.15.156:0/2455327524 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfa0136960 0x7fbfa012d070 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:03.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.285+0000 7fbfa8393700 1 -- 172.21.15.156:0/2455327524 >> 172.21.15.156:0/2455327524 conn(0x7fbfa0099c40 msgr2=0x7fbfa0134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:03.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.285+0000 7fbfa8393700 1 -- 172.21.15.156:0/2455327524 shutdown_connections 2023-09-30T22:21:03.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.285+0000 7fbfa8393700 1 -- 172.21.15.156:0/2455327524 wait complete. 2023-09-30T22:21:03.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.291+0000 7f6da1a0b700 1 -- 172.21.15.156:0/3597407784 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6d9c06bce0 con 0x7f6d9c133900 2023-09-30T22:21:03.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.291+0000 7f6d83fff700 1 -- 172.21.15.156:0/3597407784 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6d8c017030 con 0x7f6d9c133900 2023-09-30T22:21:03.292 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:03.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.293+0000 7f6da1a0b700 1 -- 172.21.15.156:0/3597407784 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d9c133900 msgr2=0x7f6d9c11afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:03.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.293+0000 7f6da1a0b700 1 --2- 172.21.15.156:0/3597407784 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d9c133900 0x7f6d9c11afd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00c730 tx=0x7f6d8c00ca40 comp rx=0 tx=0).stop 2023-09-30T22:21:03.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.293+0000 7f6da1a0b700 1 -- 172.21.15.156:0/3597407784 shutdown_connections 2023-09-30T22:21:03.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.293+0000 7f6da1a0b700 1 --2- 172.21.15.156:0/3597407784 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d9c139200 0x7f6d9c11ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:03.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.293+0000 7f6da1a0b700 1 --2- 172.21.15.156:0/3597407784 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d9c133900 0x7f6d9c11afd0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:03.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.293+0000 7f6da1a0b700 1 --2- 172.21.15.156:0/3597407784 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d9c1368e0 0x7f6d9c11b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:03.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.293+0000 7f6da1a0b700 1 -- 172.21.15.156:0/3597407784 >> 172.21.15.156:0/3597407784 conn(0x7f6d9c0a2980 msgr2=0x7f6d9c131af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:03.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.293+0000 7f6da1a0b700 1 -- 172.21.15.156:0/3597407784 shutdown_connections 2023-09-30T22:21:03.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:03.293+0000 7f6da1a0b700 1 -- 172.21.15.156:0/3597407784 wait complete. 2023-09-30T22:21:03.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:03.307 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:04.055 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:04.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.183+0000 7f192c699700 1 Processor -- start 2023-09-30T22:21:04.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.183+0000 7f192c699700 1 -- start start 2023-09-30T22:21:04.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.183+0000 7f192c699700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f192409d860 0x7f192409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:04.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.183+0000 7f192c699700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f192409e170 0x7f19241307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:04.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.183+0000 7f192c699700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f192409aaa0 con 0x7f1924130ce0 2023-09-30T22:21:04.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.183+0000 7f192c699700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f192409f870 con 0x7f192409d860 2023-09-30T22:21:04.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.183+0000 7f192c699700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192409b360 con 0x7f192409e170 2023-09-30T22:21:04.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.183+0000 7f1929c34700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f192409e170 0x7f19241307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:04.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.184+0000 7f192a435700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f192409d860 0x7f192409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:04.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.184+0000 7f192a435700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f192409d860 0x7f192409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34014/0 (socket says 172.21.15.156:34014) 2023-09-30T22:21:04.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.184+0000 7f1929c34700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f192409e170 0x7f19241307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44116/0 (socket says 172.21.15.156:44116) 2023-09-30T22:21:04.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.184+0000 7f192a435700 1 -- 172.21.15.156:0/3457439030 learned_addr learned my addr 172.21.15.156:0/3457439030 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:04.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.184+0000 7f192ac36700 1 --1- 172.21.15.156:0/3457439030 >> v1:172.21.15.156:6789/0 conn(0x7f1924130ce0 0x7f19241379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53066/0 (socket says 172.21.15.156:53066) 2023-09-30T22:21:04.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.184+0000 7f192a435700 1 -- 172.21.15.156:0/3457439030 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f192409e170 msgr2=0x7f19241307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:04.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.184+0000 7f192a435700 1 --2- 172.21.15.156:0/3457439030 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f192409e170 0x7f19241307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.184+0000 7f192a435700 1 -- 172.21.15.156:0/3457439030 >> v1:172.21.15.156:6789/0 conn(0x7f1924130ce0 legacy=0x7f19241379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:04.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.184+0000 7f192a435700 1 -- 172.21.15.156:0/3457439030 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192409b620 con 0x7f192409d860 2023-09-30T22:21:04.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.184+0000 7f1929433700 1 -- 172.21.15.156:0/3457439030 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 257417183 0 0) 0x7f192409aaa0 con 0x7f1924130ce0 2023-09-30T22:21:04.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.184+0000 7f1929c34700 1 --2- 172.21.15.156:0/3457439030 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f192409e170 0x7f19241307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:04.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.184+0000 7f192a435700 1 --2- 172.21.15.156:0/3457439030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f192409d860 0x7f192409dc30 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f19200098f0 tx=0x7f1920009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aacb6e1e782a2cb3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:04.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.184+0000 7f1929433700 1 -- 172.21.15.156:0/3457439030 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1920011830 con 0x7f192409d860 2023-09-30T22:21:04.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.184+0000 7f1929433700 1 -- 172.21.15.156:0/3457439030 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1920011990 con 0x7f192409d860 2023-09-30T22:21:04.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.184+0000 7f1929433700 1 -- 172.21.15.156:0/3457439030 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1920011d20 con 0x7f192409d860 2023-09-30T22:21:04.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.185+0000 7f192c699700 1 -- 172.21.15.156:0/3457439030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f192409d860 msgr2=0x7f192409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:04.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.185+0000 7f192c699700 1 --2- 172.21.15.156:0/3457439030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f192409d860 0x7f192409dc30 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f19200098f0 tx=0x7f1920009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:04.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.185+0000 7f192c699700 1 -- 172.21.15.156:0/3457439030 shutdown_connections 2023-09-30T22:21:04.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.185+0000 7f192c699700 1 --2- 172.21.15.156:0/3457439030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f192409d860 0x7f192409dc30 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.185+0000 7f192c699700 1 --2- 172.21.15.156:0/3457439030 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f192409e170 0x7f19241307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.185+0000 7f192c699700 1 -- 172.21.15.156:0/3457439030 >> 172.21.15.156:0/3457439030 conn(0x7f1924099c40 msgr2=0x7f19240a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:04.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.185+0000 7f192c699700 1 -- 172.21.15.156:0/3457439030 shutdown_connections 2023-09-30T22:21:04.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.185+0000 7f192c699700 1 -- 172.21.15.156:0/3457439030 wait complete. 2023-09-30T22:21:04.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.186+0000 7f192c699700 1 Processor -- start 2023-09-30T22:21:04.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.186+0000 7f192c699700 1 -- start start 2023-09-30T22:21:04.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.186+0000 7f192c699700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f192409d860 0x7f19241c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:04.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.186+0000 7f192c699700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f192409e170 0x7f19241c6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:04.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.186+0000 7f192c699700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1924130ce0 0x7f19241c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:04.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.186+0000 7f192c699700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1924122420 con 0x7f192409d860 2023-09-30T22:21:04.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.186+0000 7f192c699700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1924123d90 con 0x7f1924130ce0 2023-09-30T22:21:04.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.186+0000 7f192c699700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f192409a150 con 0x7f192409e170 2023-09-30T22:21:04.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.186+0000 7f192a435700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f192409d860 0x7f19241c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:04.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.186+0000 7f192a435700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f192409d860 0x7f19241c6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34026/0 (socket says 172.21.15.156:34026) 2023-09-30T22:21:04.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.186+0000 7f192a435700 1 -- 172.21.15.156:0/1930058061 learned_addr learned my addr 172.21.15.156:0/1930058061 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:04.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.186+0000 7f1929c34700 1 --2- 172.21.15.156:0/1930058061 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f192409e170 0x7f19241c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:04.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.186+0000 7f192ac36700 1 --2- 172.21.15.156:0/1930058061 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1924130ce0 0x7f19241c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:04.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.186+0000 7f192a435700 1 -- 172.21.15.156:0/1930058061 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f192409e170 msgr2=0x7f19241c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:04.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.186+0000 7f192a435700 1 --2- 172.21.15.156:0/1930058061 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f192409e170 0x7f19241c6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.186+0000 7f192a435700 1 -- 172.21.15.156:0/1930058061 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1924130ce0 msgr2=0x7f19241c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:04.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.186+0000 7f192a435700 1 --2- 172.21.15.156:0/1930058061 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1924130ce0 0x7f19241c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.186+0000 7f192a435700 1 -- 172.21.15.156:0/1930058061 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19140094a0 con 0x7f192409d860 2023-09-30T22:21:04.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.187+0000 7f192a435700 1 --2- 172.21.15.156:0/1930058061 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f192409d860 0x7f19241c6050 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1920009c40 tx=0x7f1920004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:04.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.187+0000 7f191affd700 1 -- 172.21.15.156:0/1930058061 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1920004510 con 0x7f192409d860 2023-09-30T22:21:04.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.187+0000 7f191affd700 1 -- 172.21.15.156:0/1930058061 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19200036a0 con 0x7f192409d860 2023-09-30T22:21:04.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.187+0000 7f192c699700 1 -- 172.21.15.156:0/1930058061 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1920009550 con 0x7f192409d860 2023-09-30T22:21:04.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.187+0000 7f191affd700 1 -- 172.21.15.156:0/1930058061 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1920003a50 con 0x7f192409d860 2023-09-30T22:21:04.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.187+0000 7f192c699700 1 -- 172.21.15.156:0/1930058061 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19241243a0 con 0x7f192409d860 2023-09-30T22:21:04.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.187+0000 7f191affd700 1 -- 172.21.15.156:0/1930058061 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1920021070 con 0x7f192409d860 2023-09-30T22:21:04.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.188+0000 7f191affd700 1 -- 172.21.15.156:0/1930058061 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1920040a50 con 0x7f192409d860 2023-09-30T22:21:04.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.188+0000 7f192c699700 1 -- 172.21.15.156:0/1930058061 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f192404f2a0 con 0x7f192409d860 2023-09-30T22:21:04.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.192+0000 7f191affd700 1 -- 172.21.15.156:0/1930058061 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1920029080 con 0x7f192409d860 2023-09-30T22:21:04.237 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:04.300 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:04.308 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:04.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.362+0000 7fef70ef4700 1 Processor -- start 2023-09-30T22:21:04.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.362+0000 7fef70ef4700 1 -- start start 2023-09-30T22:21:04.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.362+0000 7fef70ef4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef6c131980 0x7fef6c131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:04.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.362+0000 7fef70ef4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fef6c09bc70 0x7fef6c09c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:04.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.363+0000 7fef70ef4700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef6c0a1640 con 0x7fef6c09c5c0 2023-09-30T22:21:04.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.363+0000 7fef70ef4700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef6c06eb30 con 0x7fef6c09bc70 2023-09-30T22:21:04.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.363+0000 7fef70ef4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c0a22d0 con 0x7fef6c131980 2023-09-30T22:21:04.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.363+0000 7fef69d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fef6c09bc70 0x7fef6c09c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:04.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.363+0000 7fef69d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fef6c09bc70 0x7fef6c09c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34030/0 (socket says 172.21.15.156:34030) 2023-09-30T22:21:04.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.363+0000 7fef69d9b700 1 -- 172.21.15.156:0/2020671519 learned_addr learned my addr 172.21.15.156:0/2020671519 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:04.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.363+0000 7fef6ad9d700 1 --1- 172.21.15.156:0/2020671519 >> v1:172.21.15.156:6789/0 conn(0x7fef6c09c5c0 0x7fef6c138700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53080/0 (socket says 172.21.15.156:53080) 2023-09-30T22:21:04.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.363+0000 7fef6a59c700 1 --2- 172.21.15.156:0/2020671519 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef6c131980 0x7fef6c131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:04.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.363+0000 7fef69d9b700 1 -- 172.21.15.156:0/2020671519 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef6c131980 msgr2=0x7fef6c131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:04.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.363+0000 7fef69d9b700 1 --2- 172.21.15.156:0/2020671519 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef6c131980 0x7fef6c131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.363+0000 7fef69d9b700 1 -- 172.21.15.156:0/2020671519 >> v1:172.21.15.156:6789/0 conn(0x7fef6c09c5c0 legacy=0x7fef6c138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:04.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.363+0000 7fef69d9b700 1 -- 172.21.15.156:0/2020671519 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c131550 con 0x7fef6c09bc70 2023-09-30T22:21:04.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.363+0000 7fef6a59c700 1 --2- 172.21.15.156:0/2020671519 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef6c131980 0x7fef6c131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:04.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.363+0000 7fef69d9b700 1 --2- 172.21.15.156:0/2020671519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef6c09bc70 0x7fef6c09c080 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fef600098f0 tx=0x7fef60009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=655d8757294c545e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:04.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.365+0000 7fef6959a700 1 -- 172.21.15.156:0/2020671519 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60004230 con 0x7fef6c09bc70 2023-09-30T22:21:04.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.365+0000 7fef6959a700 1 -- 172.21.15.156:0/2020671519 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef60004390 con 0x7fef6c09bc70 2023-09-30T22:21:04.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.365+0000 7fef6959a700 1 -- 172.21.15.156:0/2020671519 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef600036a0 con 0x7fef6c09bc70 2023-09-30T22:21:04.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.366+0000 7fef70ef4700 1 -- 172.21.15.156:0/2020671519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef6c09bc70 msgr2=0x7fef6c09c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:04.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.366+0000 7fef70ef4700 1 --2- 172.21.15.156:0/2020671519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef6c09bc70 0x7fef6c09c080 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fef600098f0 tx=0x7fef60009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:04.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.366+0000 7fef70ef4700 1 -- 172.21.15.156:0/2020671519 shutdown_connections 2023-09-30T22:21:04.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.366+0000 7fef70ef4700 1 --2- 172.21.15.156:0/2020671519 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef6c131980 0x7fef6c131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.366+0000 7fef70ef4700 1 --2- 172.21.15.156:0/2020671519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef6c09bc70 0x7fef6c09c080 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.366+0000 7fef70ef4700 1 -- 172.21.15.156:0/2020671519 >> 172.21.15.156:0/2020671519 conn(0x7fef6c0a2980 msgr2=0x7fef6c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:04.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.366+0000 7fef70ef4700 1 -- 172.21.15.156:0/2020671519 shutdown_connections 2023-09-30T22:21:04.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.366+0000 7fef70ef4700 1 -- 172.21.15.156:0/2020671519 wait complete. 2023-09-30T22:21:04.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.367+0000 7fef70ef4700 1 Processor -- start 2023-09-30T22:21:04.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.367+0000 7fef70ef4700 1 -- start start 2023-09-30T22:21:04.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.368+0000 7fef70ef4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef6c09bc70 0x7fef6c1cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:04.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.368+0000 7fef70ef4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef6c09c5c0 0x7fef6c1cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:04.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.368+0000 7fef70ef4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef6c131980 0x7fef6c1cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:04.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.368+0000 7fef70ef4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c0a1c40 con 0x7fef6c131980 2023-09-30T22:21:04.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.368+0000 7fef70ef4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c130e10 con 0x7fef6c09bc70 2023-09-30T22:21:04.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.368+0000 7fef70ef4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c11c280 con 0x7fef6c09c5c0 2023-09-30T22:21:04.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.368+0000 7fef6ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef6c131980 0x7fef6c1cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:04.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.368+0000 7fef6ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef6c131980 0x7fef6c1cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34040/0 (socket says 172.21.15.156:34040) 2023-09-30T22:21:04.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.368+0000 7fef6ad9d700 1 -- 172.21.15.156:0/3025196482 learned_addr learned my addr 172.21.15.156:0/3025196482 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:04.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.368+0000 7fef69d9b700 1 --2- 172.21.15.156:0/3025196482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef6c09c5c0 0x7fef6c1cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:04.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.368+0000 7fef6a59c700 1 --2- 172.21.15.156:0/3025196482 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef6c09bc70 0x7fef6c1cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:04.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.369+0000 7fef6ad9d700 1 -- 172.21.15.156:0/3025196482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef6c09c5c0 msgr2=0x7fef6c1cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:04.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.369+0000 7fef6ad9d700 1 --2- 172.21.15.156:0/3025196482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef6c09c5c0 0x7fef6c1cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.369+0000 7fef6ad9d700 1 -- 172.21.15.156:0/3025196482 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef6c09bc70 msgr2=0x7fef6c1cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:04.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.369+0000 7fef6ad9d700 1 --2- 172.21.15.156:0/3025196482 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef6c09bc70 0x7fef6c1cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.369+0000 7fef6ad9d700 1 -- 172.21.15.156:0/3025196482 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c009430 con 0x7fef6c131980 2023-09-30T22:21:04.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.369+0000 7fef69d9b700 1 --2- 172.21.15.156:0/3025196482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef6c09c5c0 0x7fef6c1cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:04.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.369+0000 7fef6ad9d700 1 --2- 172.21.15.156:0/3025196482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef6c131980 0x7fef6c1cd230 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fef64002060 tx=0x7fef6400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:04.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.369+0000 7fef5affd700 1 -- 172.21.15.156:0/3025196482 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6400ac90 con 0x7fef6c131980 2023-09-30T22:21:04.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.369+0000 7fef5affd700 1 -- 172.21.15.156:0/3025196482 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6400adf0 con 0x7fef6c131980 2023-09-30T22:21:04.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.369+0000 7fef70ef4700 1 -- 172.21.15.156:0/3025196482 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef60009550 con 0x7fef6c131980 2023-09-30T22:21:04.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.369+0000 7fef5affd700 1 -- 172.21.15.156:0/3025196482 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef640072f0 con 0x7fef6c131980 2023-09-30T22:21:04.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.369+0000 7fef70ef4700 1 -- 172.21.15.156:0/3025196482 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef6c1264c0 con 0x7fef6c131980 2023-09-30T22:21:04.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.370+0000 7fef5affd700 1 -- 172.21.15.156:0/3025196482 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef64007450 con 0x7fef6c131980 2023-09-30T22:21:04.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.370+0000 7fef5affd700 1 -- 172.21.15.156:0/3025196482 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fef6403f250 con 0x7fef6c131980 2023-09-30T22:21:04.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.371+0000 7fef70ef4700 1 -- 172.21.15.156:0/3025196482 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6c04f2a0 con 0x7fef6c131980 2023-09-30T22:21:04.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.380+0000 7fef5affd700 1 -- 172.21.15.156:0/3025196482 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef64018020 con 0x7fef6c131980 2023-09-30T22:21:04.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.394+0000 7f192c699700 1 -- 172.21.15.156:0/1930058061 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1924130ac0 con 0x7f192409d860 2023-09-30T22:21:04.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.394+0000 7f191affd700 1 -- 172.21.15.156:0/1930058061 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1920015020 con 0x7f192409d860 2023-09-30T22:21:04.395 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:04.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.396+0000 7f192c699700 1 -- 172.21.15.156:0/1930058061 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f192409d860 msgr2=0x7f19241c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:04.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.396+0000 7f192c699700 1 --2- 172.21.15.156:0/1930058061 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f192409d860 0x7f19241c6050 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1920009c40 tx=0x7f1920004750 comp rx=0 tx=0).stop 2023-09-30T22:21:04.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.396+0000 7f192c699700 1 -- 172.21.15.156:0/1930058061 shutdown_connections 2023-09-30T22:21:04.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.396+0000 7f192c699700 1 --2- 172.21.15.156:0/1930058061 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1924130ce0 0x7f19241c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.396+0000 7f192c699700 1 --2- 172.21.15.156:0/1930058061 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f192409d860 0x7f19241c6050 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.396+0000 7f192c699700 1 --2- 172.21.15.156:0/1930058061 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f192409e170 0x7f19241c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.396+0000 7f192c699700 1 -- 172.21.15.156:0/1930058061 >> 172.21.15.156:0/1930058061 conn(0x7f1924099c40 msgr2=0x7f1924070ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:04.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.397+0000 7f192c699700 1 -- 172.21.15.156:0/1930058061 shutdown_connections 2023-09-30T22:21:04.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.397+0000 7f192c699700 1 -- 172.21.15.156:0/1930058061 wait complete. 2023-09-30T22:21:04.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:04.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.429+0000 7f019f5c8700 1 Processor -- start 2023-09-30T22:21:04.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.430+0000 7f019f5c8700 1 -- start start 2023-09-30T22:21:04.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.430+0000 7f019f5c8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0198133730 0x7f0198135b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:04.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.430+0000 7f019f5c8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0198136050 0x7f0198138430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:04.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.430+0000 7f019f5c8700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f019809be40 con 0x7f01981308e0 2023-09-30T22:21:04.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.430+0000 7f019f5c8700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f019806dc00 con 0x7f0198133730 2023-09-30T22:21:04.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.430+0000 7f019f5c8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01981313c0 con 0x7f0198136050 2023-09-30T22:21:04.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.431+0000 7f019cb63700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0198133730 0x7f0198135b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:04.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.431+0000 7f019cb63700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0198133730 0x7f0198135b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34042/0 (socket says 172.21.15.156:34042) 2023-09-30T22:21:04.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.431+0000 7f019cb63700 1 -- 172.21.15.156:0/2626364687 learned_addr learned my addr 172.21.15.156:0/2626364687 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:04.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.431+0000 7f019db65700 1 --2- 172.21.15.156:0/2626364687 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0198136050 0x7f0198138430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:04.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.431+0000 7f019cb63700 1 -- 172.21.15.156:0/2626364687 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0198136050 msgr2=0x7f0198138430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:04.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.431+0000 7f019cb63700 1 --2- 172.21.15.156:0/2626364687 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0198136050 0x7f0198138430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.431+0000 7f019cb63700 1 -- 172.21.15.156:0/2626364687 >> v1:172.21.15.156:6789/0 conn(0x7f01981308e0 legacy=0x7f0198130cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:04.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.431+0000 7f019cb63700 1 -- 172.21.15.156:0/2626364687 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019809b290 con 0x7f0198133730 2023-09-30T22:21:04.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.431+0000 7f019cb63700 1 --2- 172.21.15.156:0/2626364687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0198133730 0x7f0198135b10 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f0188009920 tx=0x7f0188009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1096a8d3e3f19bf3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:04.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.431+0000 7f018ffff700 1 -- 172.21.15.156:0/2626364687 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0188011830 con 0x7f0198133730 2023-09-30T22:21:04.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.431+0000 7f018ffff700 1 -- 172.21.15.156:0/2626364687 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0188011990 con 0x7f0198133730 2023-09-30T22:21:04.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.431+0000 7f018ffff700 1 -- 172.21.15.156:0/2626364687 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0188011d20 con 0x7f0198133730 2023-09-30T22:21:04.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.432+0000 7f019f5c8700 1 -- 172.21.15.156:0/2626364687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0198133730 msgr2=0x7f0198135b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:04.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.432+0000 7f019f5c8700 1 --2- 172.21.15.156:0/2626364687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0198133730 0x7f0198135b10 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f0188009920 tx=0x7f0188009c30 comp rx=0 tx=0).stop 2023-09-30T22:21:04.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.432+0000 7f019f5c8700 1 -- 172.21.15.156:0/2626364687 shutdown_connections 2023-09-30T22:21:04.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.432+0000 7f019f5c8700 1 --2- 172.21.15.156:0/2626364687 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0198136050 0x7f0198138430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.432+0000 7f019f5c8700 1 --2- 172.21.15.156:0/2626364687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0198133730 0x7f0198135b10 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.432+0000 7f019f5c8700 1 -- 172.21.15.156:0/2626364687 >> 172.21.15.156:0/2626364687 conn(0x7f01980a2b30 msgr2=0x7f019809e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:04.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.432+0000 7f019f5c8700 1 -- 172.21.15.156:0/2626364687 shutdown_connections 2023-09-30T22:21:04.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.432+0000 7f019f5c8700 1 -- 172.21.15.156:0/2626364687 wait complete. 2023-09-30T22:21:04.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.433+0000 7f019f5c8700 1 Processor -- start 2023-09-30T22:21:04.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.433+0000 7f019f5c8700 1 -- start start 2023-09-30T22:21:04.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.434+0000 7f019f5c8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01981308e0 0x7f0198126fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:04.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.434+0000 7f019f5c8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0198133730 0x7f01981274e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:04.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.434+0000 7f019f5c8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0198136050 0x7f0198127a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:04.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.434+0000 7f019f5c8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019812a540 con 0x7f0198133730 2023-09-30T22:21:04.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.434+0000 7f019f5c8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0198071c40 con 0x7f01981308e0 2023-09-30T22:21:04.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.434+0000 7f019f5c8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0198129860 con 0x7f0198136050 2023-09-30T22:21:04.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.434+0000 7f019d364700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01981308e0 0x7f0198126fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:04.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.434+0000 7f019d364700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01981308e0 0x7f0198126fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44152/0 (socket says 172.21.15.156:44152) 2023-09-30T22:21:04.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.434+0000 7f019d364700 1 -- 172.21.15.156:0/2696115535 learned_addr learned my addr 172.21.15.156:0/2696115535 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:04.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.434+0000 7f019cb63700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0198133730 0x7f01981274e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:04.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.434+0000 7f019db65700 1 --2- 172.21.15.156:0/2696115535 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0198136050 0x7f0198127a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:04.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.434+0000 7f019cb63700 1 -- 172.21.15.156:0/2696115535 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0198136050 msgr2=0x7f0198127a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:04.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.434+0000 7f019cb63700 1 --2- 172.21.15.156:0/2696115535 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0198136050 0x7f0198127a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.434+0000 7f019cb63700 1 -- 172.21.15.156:0/2696115535 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01981308e0 msgr2=0x7f0198126fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:04.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.434+0000 7f019cb63700 1 --2- 172.21.15.156:0/2696115535 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01981308e0 0x7f0198126fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.434+0000 7f019cb63700 1 -- 172.21.15.156:0/2696115535 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0188009550 con 0x7f0198133730 2023-09-30T22:21:04.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.434+0000 7f019cb63700 1 --2- 172.21.15.156:0/2696115535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0198133730 0x7f01981274e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f019806b7a0 tx=0x7f0188004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:04.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.435+0000 7f018dffb700 1 -- 172.21.15.156:0/2696115535 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0188004450 con 0x7f0198133730 2023-09-30T22:21:04.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.435+0000 7f018dffb700 1 -- 172.21.15.156:0/2696115535 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01880036a0 con 0x7f0198133730 2023-09-30T22:21:04.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.435+0000 7f019f5c8700 1 -- 172.21.15.156:0/2696115535 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f019809e900 con 0x7f0198133730 2023-09-30T22:21:04.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.435+0000 7f018dffb700 1 -- 172.21.15.156:0/2696115535 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01880045f0 con 0x7f0198133730 2023-09-30T22:21:04.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.435+0000 7f019f5c8700 1 -- 172.21.15.156:0/2696115535 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0198128180 con 0x7f0198133730 2023-09-30T22:21:04.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.436+0000 7f019f5c8700 1 -- 172.21.15.156:0/2696115535 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f019806acc0 con 0x7f0198133730 2023-09-30T22:21:04.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.436+0000 7f018dffb700 1 -- 172.21.15.156:0/2696115535 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0188003a50 con 0x7f0198133730 2023-09-30T22:21:04.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.436+0000 7f018dffb700 1 -- 172.21.15.156:0/2696115535 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0188021030 con 0x7f0198133730 2023-09-30T22:21:04.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.441+0000 7f018dffb700 1 -- 172.21.15.156:0/2696115535 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f018801a430 con 0x7f0198133730 2023-09-30T22:21:04.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.477+0000 7f781eda4700 1 Processor -- start 2023-09-30T22:21:04.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.478+0000 7f781eda4700 1 -- start start 2023-09-30T22:21:04.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.478+0000 7f781eda4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f78180a0a70 0x7f78180a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:04.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.478+0000 7f781eda4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7818134120 0x7f781813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:04.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.478+0000 7f781eda4700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f781809dc00 con 0x7f78180a1380 2023-09-30T22:21:04.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.478+0000 7f781eda4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781809ea90 con 0x7f7818134120 2023-09-30T22:21:04.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.478+0000 7f781eda4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f781809dec0 con 0x7f78180a0a70 2023-09-30T22:21:04.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.478+0000 7f7817fff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f78180a1380 0x7f7818133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53098/0 (socket says 172.21.15.156:53098) 2023-09-30T22:21:04.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.478+0000 7f7817fff700 1 -- 172.21.15.156:0/2925397888 learned_addr learned my addr 172.21.15.156:0/2925397888 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:04.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.478+0000 7f781cb40700 1 --2- 172.21.15.156:0/2925397888 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f78180a0a70 0x7f78180a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:04.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.478+0000 7f781d341700 1 --2- 172.21.15.156:0/2925397888 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7818134120 0x7f781813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:04.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.479+0000 7f78177fe700 1 -- 172.21.15.156:0/2925397888 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2341140238 0 0) 0x7f781809dc00 con 0x7f78180a1380 2023-09-30T22:21:04.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.479+0000 7f781cb40700 1 -- 172.21.15.156:0/2925397888 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7818134120 msgr2=0x7f781813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:04.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.479+0000 7f781cb40700 1 --2- 172.21.15.156:0/2925397888 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7818134120 0x7f781813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.479+0000 7f781cb40700 1 -- 172.21.15.156:0/2925397888 >> v1:172.21.15.156:6789/0 conn(0x7f78180a1380 legacy=0x7f7818133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:04.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.479+0000 7f781cb40700 1 -- 172.21.15.156:0/2925397888 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781809e6a0 con 0x7f78180a0a70 2023-09-30T22:21:04.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.479+0000 7f781d341700 1 --2- 172.21.15.156:0/2925397888 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7818134120 0x7f781813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:04.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.479+0000 7f781cb40700 1 --2- 172.21.15.156:0/2925397888 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f78180a0a70 0x7f78180a0e40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f780c009870 tx=0x7f780c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abddf7d243fcd62f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:04.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.479+0000 7f78177fe700 1 -- 172.21.15.156:0/2925397888 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c011830 con 0x7f78180a0a70 2023-09-30T22:21:04.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.479+0000 7f78177fe700 1 -- 172.21.15.156:0/2925397888 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780c011990 con 0x7f78180a0a70 2023-09-30T22:21:04.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.479+0000 7f78177fe700 1 -- 172.21.15.156:0/2925397888 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c011d20 con 0x7f78180a0a70 2023-09-30T22:21:04.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.479+0000 7f781eda4700 1 -- 172.21.15.156:0/2925397888 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f78180a0a70 msgr2=0x7f78180a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:04.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.479+0000 7f781eda4700 1 --2- 172.21.15.156:0/2925397888 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f78180a0a70 0x7f78180a0e40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f780c009870 tx=0x7f780c009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:04.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.480+0000 7f781eda4700 1 -- 172.21.15.156:0/2925397888 shutdown_connections 2023-09-30T22:21:04.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.480+0000 7f781eda4700 1 --2- 172.21.15.156:0/2925397888 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7818134120 0x7f781813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.480+0000 7f781eda4700 1 --2- 172.21.15.156:0/2925397888 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f78180a0a70 0x7f78180a0e40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.480+0000 7f781eda4700 1 -- 172.21.15.156:0/2925397888 >> 172.21.15.156:0/2925397888 conn(0x7f78180a6610 msgr2=0x7f78180a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:04.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.480+0000 7f781eda4700 1 -- 172.21.15.156:0/2925397888 shutdown_connections 2023-09-30T22:21:04.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.480+0000 7f781eda4700 1 -- 172.21.15.156:0/2925397888 wait complete. 2023-09-30T22:21:04.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.481+0000 7f781eda4700 1 Processor -- start 2023-09-30T22:21:04.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.481+0000 7f781eda4700 1 -- start start 2023-09-30T22:21:04.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.482+0000 7f781eda4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78180a0a70 0x7f7818122780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:04.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.482+0000 7f781eda4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78180a1380 0x7f7818122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:04.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.482+0000 7f781eda4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7818134120 0x7f7818123200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:04.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.482+0000 7f781eda4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7818124390 con 0x7f78180a1380 2023-09-30T22:21:04.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.482+0000 7f781eda4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7818133310 con 0x7f78180a0a70 2023-09-30T22:21:04.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.482+0000 7f781eda4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7818125d00 con 0x7f7818134120 2023-09-30T22:21:04.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.482+0000 7f7817fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78180a1380 0x7f7818122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:04.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.482+0000 7f7817fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78180a1380 0x7f7818122cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34052/0 (socket says 172.21.15.156:34052) 2023-09-30T22:21:04.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.482+0000 7f7817fff700 1 -- 172.21.15.156:0/905534750 learned_addr learned my addr 172.21.15.156:0/905534750 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:04.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.482+0000 7f781cb40700 1 --2- 172.21.15.156:0/905534750 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78180a0a70 0x7f7818122780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:04.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.482+0000 7f781d341700 1 --2- 172.21.15.156:0/905534750 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7818134120 0x7f7818123200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:04.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.482+0000 7f7817fff700 1 -- 172.21.15.156:0/905534750 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7818134120 msgr2=0x7f7818123200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:04.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.482+0000 7f7817fff700 1 --2- 172.21.15.156:0/905534750 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7818134120 0x7f7818123200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.482+0000 7f7817fff700 1 -- 172.21.15.156:0/905534750 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78180a0a70 msgr2=0x7f7818122780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:04.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.482+0000 7f7817fff700 1 --2- 172.21.15.156:0/905534750 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78180a0a70 0x7f7818122780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.482+0000 7f7817fff700 1 -- 172.21.15.156:0/905534750 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7810009a70 con 0x7f78180a1380 2023-09-30T22:21:04.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.482+0000 7f7817fff700 1 --2- 172.21.15.156:0/905534750 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78180a1380 0x7f7818122cc0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f780400c520 tx=0x7f780400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:04.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.483+0000 7f78157fa700 1 -- 172.21.15.156:0/905534750 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7804004c80 con 0x7f78180a1380 2023-09-30T22:21:04.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.483+0000 7f78157fa700 1 -- 172.21.15.156:0/905534750 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7804004de0 con 0x7f78180a1380 2023-09-30T22:21:04.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.483+0000 7f78157fa700 1 -- 172.21.15.156:0/905534750 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7804007310 con 0x7f78180a1380 2023-09-30T22:21:04.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.483+0000 7f781eda4700 1 -- 172.21.15.156:0/905534750 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780c0094a0 con 0x7f78180a1380 2023-09-30T22:21:04.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.483+0000 7f781eda4700 1 -- 172.21.15.156:0/905534750 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7818133a60 con 0x7f78180a1380 2023-09-30T22:21:04.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.483+0000 7f78157fa700 1 -- 172.21.15.156:0/905534750 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7804007470 con 0x7f78180a1380 2023-09-30T22:21:04.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.484+0000 7f781eda4700 1 -- 172.21.15.156:0/905534750 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f781804f2a0 con 0x7f78180a1380 2023-09-30T22:21:04.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.484+0000 7f78157fa700 1 -- 172.21.15.156:0/905534750 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f780403f260 con 0x7f78180a1380 2023-09-30T22:21:04.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.488+0000 7f78157fa700 1 -- 172.21.15.156:0/905534750 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f78040133c0 con 0x7f78180a1380 2023-09-30T22:21:04.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.578+0000 7fef70ef4700 1 -- 172.21.15.156:0/3025196482 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fef6c126160 con 0x7fef6c131980 2023-09-30T22:21:04.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.578+0000 7fef5affd700 1 -- 172.21.15.156:0/3025196482 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef6401b360 con 0x7fef6c131980 2023-09-30T22:21:04.579 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:04.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.580+0000 7fef70ef4700 1 -- 172.21.15.156:0/3025196482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef6c131980 msgr2=0x7fef6c1cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:04.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.580+0000 7fef70ef4700 1 --2- 172.21.15.156:0/3025196482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef6c131980 0x7fef6c1cd230 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fef64002060 tx=0x7fef6400a340 comp rx=0 tx=0).stop 2023-09-30T22:21:04.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.580+0000 7fef70ef4700 1 -- 172.21.15.156:0/3025196482 shutdown_connections 2023-09-30T22:21:04.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.580+0000 7fef70ef4700 1 --2- 172.21.15.156:0/3025196482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef6c131980 0x7fef6c1cd230 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.581+0000 7fef70ef4700 1 --2- 172.21.15.156:0/3025196482 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef6c09bc70 0x7fef6c1cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.581+0000 7fef70ef4700 1 --2- 172.21.15.156:0/3025196482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef6c09c5c0 0x7fef6c1cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.581+0000 7fef70ef4700 1 -- 172.21.15.156:0/3025196482 >> 172.21.15.156:0/3025196482 conn(0x7fef6c0a2980 msgr2=0x7fef6c09da50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:04.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.581+0000 7fef70ef4700 1 -- 172.21.15.156:0/3025196482 shutdown_connections 2023-09-30T22:21:04.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.581+0000 7fef70ef4700 1 -- 172.21.15.156:0/3025196482 wait complete. 2023-09-30T22:21:04.593 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:04.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.638+0000 7f019f5c8700 1 -- 172.21.15.156:0/2696115535 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f019804f2a0 con 0x7f0198133730 2023-09-30T22:21:04.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.638+0000 7f018dffb700 1 -- 172.21.15.156:0/2696115535 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0188015070 con 0x7f0198133730 2023-09-30T22:21:04.639 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:04.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.640+0000 7f019f5c8700 1 -- 172.21.15.156:0/2696115535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0198133730 msgr2=0x7f01981274e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:04.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.640+0000 7f019f5c8700 1 --2- 172.21.15.156:0/2696115535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0198133730 0x7f01981274e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f019806b7a0 tx=0x7f0188004750 comp rx=0 tx=0).stop 2023-09-30T22:21:04.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.640+0000 7f019f5c8700 1 -- 172.21.15.156:0/2696115535 shutdown_connections 2023-09-30T22:21:04.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.640+0000 7f019f5c8700 1 --2- 172.21.15.156:0/2696115535 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0198136050 0x7f0198127a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.640+0000 7f019f5c8700 1 --2- 172.21.15.156:0/2696115535 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01981308e0 0x7f0198126fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.640+0000 7f019f5c8700 1 --2- 172.21.15.156:0/2696115535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0198133730 0x7f01981274e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.640+0000 7f019f5c8700 1 -- 172.21.15.156:0/2696115535 >> 172.21.15.156:0/2696115535 conn(0x7f01980a2b30 msgr2=0x7f019809fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:04.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.640+0000 7f019f5c8700 1 -- 172.21.15.156:0/2696115535 shutdown_connections 2023-09-30T22:21:04.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.641+0000 7f019f5c8700 1 -- 172.21.15.156:0/2696115535 wait complete. 2023-09-30T22:21:04.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:04.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.685+0000 7f781eda4700 1 -- 172.21.15.156:0/905534750 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7818126080 con 0x7f78180a1380 2023-09-30T22:21:04.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.686+0000 7f78157fa700 1 -- 172.21.15.156:0/905534750 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7804011360 con 0x7f78180a1380 2023-09-30T22:21:04.686 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:04.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.688+0000 7f781eda4700 1 -- 172.21.15.156:0/905534750 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78180a1380 msgr2=0x7f7818122cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:04.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.688+0000 7f781eda4700 1 --2- 172.21.15.156:0/905534750 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78180a1380 0x7f7818122cc0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f780400c520 tx=0x7f780400c830 comp rx=0 tx=0).stop 2023-09-30T22:21:04.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.688+0000 7f781eda4700 1 -- 172.21.15.156:0/905534750 shutdown_connections 2023-09-30T22:21:04.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.688+0000 7f781eda4700 1 --2- 172.21.15.156:0/905534750 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7818134120 0x7f7818123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.688+0000 7f781eda4700 1 --2- 172.21.15.156:0/905534750 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78180a0a70 0x7f7818122780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.688+0000 7f781eda4700 1 --2- 172.21.15.156:0/905534750 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78180a1380 0x7f7818122cc0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:04.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.688+0000 7f781eda4700 1 -- 172.21.15.156:0/905534750 >> 172.21.15.156:0/905534750 conn(0x7f78180a6610 msgr2=0x7f78180a4980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:04.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.688+0000 7f781eda4700 1 -- 172.21.15.156:0/905534750 shutdown_connections 2023-09-30T22:21:04.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:04.688+0000 7f781eda4700 1 -- 172.21.15.156:0/905534750 wait complete. 2023-09-30T22:21:04.701 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:05.416 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:05.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.546+0000 7fe0c6032700 1 Processor -- start 2023-09-30T22:21:05.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.546+0000 7fe0c6032700 1 -- start start 2023-09-30T22:21:05.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.547+0000 7fe0c6032700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0c009a150 0x7fe0c009e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:05.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.547+0000 7fe0c6032700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe0c009edb0 0x7fe0c009f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:05.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.547+0000 7fe0c6032700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c009af80 con 0x7fe0c0133c20 2023-09-30T22:21:05.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.547+0000 7fe0c6032700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c009fe00 con 0x7fe0c009edb0 2023-09-30T22:21:05.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.547+0000 7fe0c6032700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c006bec0 con 0x7fe0c009a150 2023-09-30T22:21:05.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.547+0000 7fe0beffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe0c009edb0 0x7fe0c009f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:05.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.547+0000 7fe0bf7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0c009a150 0x7fe0c009e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:05.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.547+0000 7fe0bffff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe0c0133c20 0x7fe0c0134070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53100/0 (socket says 172.21.15.156:53100) 2023-09-30T22:21:05.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.547+0000 7fe0beffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe0c009edb0 0x7fe0c009f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34066/0 (socket says 172.21.15.156:34066) 2023-09-30T22:21:05.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.547+0000 7fe0bffff700 1 -- 172.21.15.156:0/444545202 learned_addr learned my addr 172.21.15.156:0/444545202 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:05.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.547+0000 7fe0bf7fe700 1 -- 172.21.15.156:0/444545202 >> v2:172.21.15.156:3300/0 conn(0x7fe0c009edb0 msgr2=0x7fe0c009f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:05.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.547+0000 7fe0bf7fe700 1 --2- 172.21.15.156:0/444545202 >> v2:172.21.15.156:3300/0 conn(0x7fe0c009edb0 0x7fe0c009f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:05.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.547+0000 7fe0bf7fe700 1 -- 172.21.15.156:0/444545202 >> v1:172.21.15.156:6789/0 conn(0x7fe0c0133c20 legacy=0x7fe0c0134070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:05.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.547+0000 7fe0bf7fe700 1 -- 172.21.15.156:0/444545202 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c009f6e0 con 0x7fe0c009a150 2023-09-30T22:21:05.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.547+0000 7fe0be7fc700 1 -- 172.21.15.156:0/444545202 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2979820261 0 0) 0x7fe0c009af80 con 0x7fe0c0133c20 2023-09-30T22:21:05.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.547+0000 7fe0beffd700 1 --2- 172.21.15.156:0/444545202 >> v2:172.21.15.156:3300/0 conn(0x7fe0c009edb0 0x7fe0c009f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:05.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.547+0000 7fe0bf7fe700 1 --2- 172.21.15.156:0/444545202 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0c009a150 0x7fe0c009e870 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0009870 tx=0x7fe0b0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ba6e4d7c559c0fd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:05.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.547+0000 7fe0be7fc700 1 -- 172.21.15.156:0/444545202 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0011830 con 0x7fe0c009a150 2023-09-30T22:21:05.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.548+0000 7fe0be7fc700 1 -- 172.21.15.156:0/444545202 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b0011990 con 0x7fe0c009a150 2023-09-30T22:21:05.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.548+0000 7fe0be7fc700 1 -- 172.21.15.156:0/444545202 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0011d20 con 0x7fe0c009a150 2023-09-30T22:21:05.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.548+0000 7fe0c6032700 1 -- 172.21.15.156:0/444545202 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0c009a150 msgr2=0x7fe0c009e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:05.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.548+0000 7fe0c6032700 1 --2- 172.21.15.156:0/444545202 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0c009a150 0x7fe0c009e870 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0009870 tx=0x7fe0b0009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:05.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.548+0000 7fe0c6032700 1 -- 172.21.15.156:0/444545202 shutdown_connections 2023-09-30T22:21:05.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.548+0000 7fe0c6032700 1 --2- 172.21.15.156:0/444545202 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0c009a150 0x7fe0c009e870 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:05.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.548+0000 7fe0c6032700 1 --2- 172.21.15.156:0/444545202 >> v2:172.21.15.156:3300/0 conn(0x7fe0c009edb0 0x7fe0c009f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:05.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.548+0000 7fe0c6032700 1 -- 172.21.15.156:0/444545202 >> 172.21.15.156:0/444545202 conn(0x7fe0c00a4430 msgr2=0x7fe0c00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:05.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.548+0000 7fe0c6032700 1 -- 172.21.15.156:0/444545202 shutdown_connections 2023-09-30T22:21:05.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.548+0000 7fe0c6032700 1 -- 172.21.15.156:0/444545202 wait complete. 2023-09-30T22:21:05.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.549+0000 7fe0c6032700 1 Processor -- start 2023-09-30T22:21:05.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.549+0000 7fe0c6032700 1 -- start start 2023-09-30T22:21:05.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.550+0000 7fe0c6032700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe0c009a150 0x7fe0c0122950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:05.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.550+0000 7fe0c6032700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0c009edb0 0x7fe0c0122e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:05.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.550+0000 7fe0c6032700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0c0133c20 0x7fe0c01233d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:05.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.550+0000 7fe0c6032700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c0133910 con 0x7fe0c009edb0 2023-09-30T22:21:05.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.550+0000 7fe0c6032700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c0124670 con 0x7fe0c0133c20 2023-09-30T22:21:05.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.550+0000 7fe0c6032700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c0125ed0 con 0x7fe0c009a150 2023-09-30T22:21:05.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.550+0000 7fe0bf7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe0c009a150 0x7fe0c0122950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:05.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.550+0000 7fe0bffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0c0133c20 0x7fe0c01233d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:05.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.550+0000 7fe0beffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0c009edb0 0x7fe0c0122e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:05.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.550+0000 7fe0bf7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe0c009a150 0x7fe0c0122950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:41198/0 (socket says 172.21.15.156:41198) 2023-09-30T22:21:05.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.550+0000 7fe0beffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0c009edb0 0x7fe0c0122e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34076/0 (socket says 172.21.15.156:34076) 2023-09-30T22:21:05.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.550+0000 7fe0bf7fe700 1 -- 172.21.15.156:0/1738258130 learned_addr learned my addr 172.21.15.156:0/1738258130 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:05.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.550+0000 7fe0bffff700 1 --2- 172.21.15.156:0/1738258130 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0c0133c20 0x7fe0c01233d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44190/0 (socket says 172.21.15.156:44190) 2023-09-30T22:21:05.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.550+0000 7fe0bffff700 1 -- 172.21.15.156:0/1738258130 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe0c009a150 msgr2=0x7fe0c0122950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:05.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.550+0000 7fe0bffff700 1 --2- 172.21.15.156:0/1738258130 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe0c009a150 0x7fe0c0122950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:05.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.550+0000 7fe0bffff700 1 -- 172.21.15.156:0/1738258130 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0c009edb0 msgr2=0x7fe0c0122e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:05.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.550+0000 7fe0bffff700 1 --2- 172.21.15.156:0/1738258130 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0c009edb0 0x7fe0c0122e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:05.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.550+0000 7fe0bffff700 1 -- 172.21.15.156:0/1738258130 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a80094a0 con 0x7fe0c0133c20 2023-09-30T22:21:05.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.550+0000 7fe0bf7fe700 1 --2- 172.21.15.156:0/1738258130 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe0c009a150 0x7fe0c0122950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:05.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.550+0000 7fe0bffff700 1 --2- 172.21.15.156:0/1738258130 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0c0133c20 0x7fe0c01233d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe0b800cbe0 tx=0x7fe0b800cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:05.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.550+0000 7fe0b7fff700 1 -- 172.21.15.156:0/1738258130 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b800aa40 con 0x7fe0c0133c20 2023-09-30T22:21:05.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.550+0000 7fe0b7fff700 1 -- 172.21.15.156:0/1738258130 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b800abc0 con 0x7fe0c0133c20 2023-09-30T22:21:05.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.550+0000 7fe0c6032700 1 -- 172.21.15.156:0/1738258130 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b00094a0 con 0x7fe0c0133c20 2023-09-30T22:21:05.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.550+0000 7fe0b7fff700 1 -- 172.21.15.156:0/1738258130 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b80070d0 con 0x7fe0c0133c20 2023-09-30T22:21:05.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.550+0000 7fe0c6032700 1 -- 172.21.15.156:0/1738258130 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c0133450 con 0x7fe0c0133c20 2023-09-30T22:21:05.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.551+0000 7fe0b7fff700 1 -- 172.21.15.156:0/1738258130 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe0b8007230 con 0x7fe0c0133c20 2023-09-30T22:21:05.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.551+0000 7fe0b7fff700 1 -- 172.21.15.156:0/1738258130 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe0b803f050 con 0x7fe0c0133c20 2023-09-30T22:21:05.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.551+0000 7fe0c6032700 1 -- 172.21.15.156:0/1738258130 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c009fa30 con 0x7fe0c0133c20 2023-09-30T22:21:05.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.556+0000 7fe0b7fff700 1 -- 172.21.15.156:0/1738258130 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe0b8018070 con 0x7fe0c0133c20 2023-09-30T22:21:05.594 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:05.654 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:05.701 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:05.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.730+0000 7f9d27f12700 1 Processor -- start 2023-09-30T22:21:05.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.730+0000 7f9d27f12700 1 -- start start 2023-09-30T22:21:05.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.731+0000 7f9d27f12700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d20133900 0x7f9d20133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:05.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.731+0000 7f9d27f12700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9d200a10b0 0x7f9d2013b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:05.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.731+0000 7f9d27f12700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d2009a760 con 0x7f9d20134210 2023-09-30T22:21:05.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.731+0000 7f9d27f12700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d201336e0 con 0x7f9d200a10b0 2023-09-30T22:21:05.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.731+0000 7f9d27f12700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2009a080 con 0x7f9d20133900 2023-09-30T22:21:05.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.731+0000 7f9d25cae700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d20133900 0x7f9d20133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:05.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.731+0000 7f9d254ad700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f9d20134210 0x7f9d200a09a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53114/0 (socket says 172.21.15.156:53114) 2023-09-30T22:21:05.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.731+0000 7f9d254ad700 1 -- 172.21.15.156:0/3122994875 learned_addr learned my addr 172.21.15.156:0/3122994875 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:05.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.731+0000 7f9d264af700 1 --2- 172.21.15.156:0/3122994875 >> v2:172.21.15.156:3300/0 conn(0x7f9d200a10b0 0x7f9d2013b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:05.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.732+0000 7f9d25cae700 1 -- 172.21.15.156:0/3122994875 >> v2:172.21.15.156:3300/0 conn(0x7f9d200a10b0 msgr2=0x7f9d2013b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:05.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.732+0000 7f9d25cae700 1 --2- 172.21.15.156:0/3122994875 >> v2:172.21.15.156:3300/0 conn(0x7f9d200a10b0 0x7f9d2013b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:05.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.732+0000 7f9d25cae700 1 -- 172.21.15.156:0/3122994875 >> v1:172.21.15.156:6789/0 conn(0x7f9d20134210 legacy=0x7f9d200a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:05.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.732+0000 7f9d25cae700 1 -- 172.21.15.156:0/3122994875 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d200a23e0 con 0x7f9d20133900 2023-09-30T22:21:05.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.732+0000 7f9d25cae700 1 --2- 172.21.15.156:0/3122994875 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d20133900 0x7f9d20133cd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009820 tx=0x7f9d1c009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bcf25738a0d5940 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:05.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.732+0000 7f9d24cac700 1 -- 172.21.15.156:0/3122994875 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c005e30 con 0x7f9d20133900 2023-09-30T22:21:05.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.732+0000 7f9d24cac700 1 -- 172.21.15.156:0/3122994875 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c006030 con 0x7f9d20133900 2023-09-30T22:21:05.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.732+0000 7f9d24cac700 1 -- 172.21.15.156:0/3122994875 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c0063c0 con 0x7f9d20133900 2023-09-30T22:21:05.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.733+0000 7f9d27f12700 1 -- 172.21.15.156:0/3122994875 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d20133900 msgr2=0x7f9d20133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:05.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.733+0000 7f9d27f12700 1 --2- 172.21.15.156:0/3122994875 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d20133900 0x7f9d20133cd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009820 tx=0x7f9d1c009b30 comp rx=0 tx=0).stop 2023-09-30T22:21:05.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.733+0000 7f9d27f12700 1 -- 172.21.15.156:0/3122994875 shutdown_connections 2023-09-30T22:21:05.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.733+0000 7f9d27f12700 1 --2- 172.21.15.156:0/3122994875 >> v2:172.21.15.156:3300/0 conn(0x7f9d200a10b0 0x7f9d2013b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:05.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.733+0000 7f9d27f12700 1 --2- 172.21.15.156:0/3122994875 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d20133900 0x7f9d20133cd0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:05.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.733+0000 7f9d27f12700 1 -- 172.21.15.156:0/3122994875 >> 172.21.15.156:0/3122994875 conn(0x7f9d200a2980 msgr2=0x7f9d200a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:05.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.733+0000 7f9d27f12700 1 -- 172.21.15.156:0/3122994875 shutdown_connections 2023-09-30T22:21:05.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.733+0000 7f9d27f12700 1 -- 172.21.15.156:0/3122994875 wait complete. 2023-09-30T22:21:05.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.734+0000 7f9d27f12700 1 Processor -- start 2023-09-30T22:21:05.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.734+0000 7f9d27f12700 1 -- start start 2023-09-30T22:21:05.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.735+0000 7f9d27f12700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d200a10b0 0x7f9d2011a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:05.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.735+0000 7f9d27f12700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d20133900 0x7f9d2011ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:05.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.735+0000 7f9d27f12700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d20134210 0x7f9d2011b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:05.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.735+0000 7f9d27f12700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2011d590 con 0x7f9d20133900 2023-09-30T22:21:05.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.735+0000 7f9d27f12700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2011dfe0 con 0x7f9d200a10b0 2023-09-30T22:21:05.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.735+0000 7f9d27f12700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2011bb10 con 0x7f9d20134210 2023-09-30T22:21:05.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.735+0000 7f9d264af700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d20134210 0x7f9d2011b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:05.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.735+0000 7f9d25cae700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d200a10b0 0x7f9d2011a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:05.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.735+0000 7f9d25cae700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d200a10b0 0x7f9d2011a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44196/0 (socket says 172.21.15.156:44196) 2023-09-30T22:21:05.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.735+0000 7f9d264af700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d20134210 0x7f9d2011b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:41214/0 (socket says 172.21.15.156:41214) 2023-09-30T22:21:05.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.735+0000 7f9d25cae700 1 -- 172.21.15.156:0/486623831 learned_addr learned my addr 172.21.15.156:0/486623831 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:05.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.735+0000 7f9d254ad700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d20133900 0x7f9d2011ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:05.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.735+0000 7f9d25cae700 1 -- 172.21.15.156:0/486623831 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d20134210 msgr2=0x7f9d2011b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:05.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.735+0000 7f9d25cae700 1 --2- 172.21.15.156:0/486623831 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d20134210 0x7f9d2011b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:05.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.735+0000 7f9d25cae700 1 -- 172.21.15.156:0/486623831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d20133900 msgr2=0x7f9d2011ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:05.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.735+0000 7f9d25cae700 1 --2- 172.21.15.156:0/486623831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d20133900 0x7f9d2011ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:05.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.736+0000 7f9d25cae700 1 -- 172.21.15.156:0/486623831 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c009430 con 0x7f9d200a10b0 2023-09-30T22:21:05.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.736+0000 7f9d25cae700 1 --2- 172.21.15.156:0/486623831 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d200a10b0 0x7f9d2011a6c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9d2009a1c0 tx=0x7f9d1c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:05.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.736+0000 7f9d167fc700 1 -- 172.21.15.156:0/486623831 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c0061a0 con 0x7f9d200a10b0 2023-09-30T22:21:05.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.736+0000 7f9d27f12700 1 -- 172.21.15.156:0/486623831 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d2011d0d0 con 0x7f9d200a10b0 2023-09-30T22:21:05.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.736+0000 7f9d167fc700 1 -- 172.21.15.156:0/486623831 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c020070 con 0x7f9d200a10b0 2023-09-30T22:21:05.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.736+0000 7f9d167fc700 1 -- 172.21.15.156:0/486623831 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c006500 con 0x7f9d200a10b0 2023-09-30T22:21:05.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.736+0000 7f9d27f12700 1 -- 172.21.15.156:0/486623831 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2011c3c0 con 0x7f9d200a10b0 2023-09-30T22:21:05.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.737+0000 7f9d167fc700 1 -- 172.21.15.156:0/486623831 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d1c022030 con 0x7f9d200a10b0 2023-09-30T22:21:05.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.737+0000 7f9d167fc700 1 -- 172.21.15.156:0/486623831 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9d1c040cf0 con 0x7f9d200a10b0 2023-09-30T22:21:05.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.737+0000 7f9d27f12700 1 -- 172.21.15.156:0/486623831 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d2004f2a0 con 0x7f9d200a10b0 2023-09-30T22:21:05.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.743+0000 7f9d167fc700 1 -- 172.21.15.156:0/486623831 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d1c0247e0 con 0x7f9d200a10b0 2023-09-30T22:21:05.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.753+0000 7fe0c6032700 1 -- 172.21.15.156:0/1738258130 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe0c00a3e30 con 0x7fe0c0133c20 2023-09-30T22:21:05.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.753+0000 7fe0b7fff700 1 -- 172.21.15.156:0/1738258130 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe0b80074e0 con 0x7fe0c0133c20 2023-09-30T22:21:05.755 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:05.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.755+0000 7fe0c6032700 1 -- 172.21.15.156:0/1738258130 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0c0133c20 msgr2=0x7fe0c01233d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:05.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.755+0000 7fe0c6032700 1 --2- 172.21.15.156:0/1738258130 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0c0133c20 0x7fe0c01233d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe0b800cbe0 tx=0x7fe0b800cef0 comp rx=0 tx=0).stop 2023-09-30T22:21:05.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.755+0000 7fe0c6032700 1 -- 172.21.15.156:0/1738258130 shutdown_connections 2023-09-30T22:21:05.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.755+0000 7fe0c6032700 1 --2- 172.21.15.156:0/1738258130 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0c0133c20 0x7fe0c01233d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:05.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.755+0000 7fe0c6032700 1 --2- 172.21.15.156:0/1738258130 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe0c009a150 0x7fe0c0122950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:05.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.755+0000 7fe0c6032700 1 --2- 172.21.15.156:0/1738258130 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0c009edb0 0x7fe0c0122e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:05.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.755+0000 7fe0c6032700 1 -- 172.21.15.156:0/1738258130 >> 172.21.15.156:0/1738258130 conn(0x7fe0c00a4430 msgr2=0x7fe0c00a2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:05.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.755+0000 7fe0c6032700 1 -- 172.21.15.156:0/1738258130 shutdown_connections 2023-09-30T22:21:05.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.755+0000 7fe0c6032700 1 -- 172.21.15.156:0/1738258130 wait complete. 2023-09-30T22:21:05.770 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:05.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.808+0000 7f41f450a700 1 Processor -- start 2023-09-30T22:21:05.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.808+0000 7f41f450a700 1 -- start start 2023-09-30T22:21:05.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.809+0000 7f41f450a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f41ec09e870 0x7f41ec09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:05.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.809+0000 7f41f450a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41ec09f180 0x7f41ec133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:05.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.809+0000 7f41f450a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41ec09fa00 con 0x7f41ec134160 2023-09-30T22:21:05.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.809+0000 7f41f450a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41ec0a0370 con 0x7f41ec09e870 2023-09-30T22:21:05.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.809+0000 7f41f450a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec06bec0 con 0x7f41ec09f180 2023-09-30T22:21:05.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.809+0000 7f41f22a6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f41ec09e870 0x7f41ec09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:05.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.809+0000 7f41f2aa7700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f41ec134160 0x7f41ec13ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53124/0 (socket says 172.21.15.156:53124) 2023-09-30T22:21:05.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.809+0000 7f41f22a6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f41ec09e870 0x7f41ec09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34116/0 (socket says 172.21.15.156:34116) 2023-09-30T22:21:05.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.809+0000 7f41f2aa7700 1 -- 172.21.15.156:0/3369569715 learned_addr learned my addr 172.21.15.156:0/3369569715 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:05.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.809+0000 7f41f1aa5700 1 --2- 172.21.15.156:0/3369569715 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41ec09f180 0x7f41ec133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:05.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.809+0000 7f41f22a6700 1 -- 172.21.15.156:0/3369569715 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41ec09f180 msgr2=0x7f41ec133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:05.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.809+0000 7f41f22a6700 1 --2- 172.21.15.156:0/3369569715 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41ec09f180 0x7f41ec133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:05.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.809+0000 7f41f22a6700 1 -- 172.21.15.156:0/3369569715 >> v1:172.21.15.156:6789/0 conn(0x7f41ec134160 legacy=0x7f41ec13ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:05.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.809+0000 7f41f12a4700 1 -- 172.21.15.156:0/3369569715 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1564588820 0 0) 0x7f41ec09fa00 con 0x7f41ec134160 2023-09-30T22:21:05.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.809+0000 7f41f22a6700 1 -- 172.21.15.156:0/3369569715 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ec09ada0 con 0x7f41ec09e870 2023-09-30T22:21:05.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.809+0000 7f41f22a6700 1 --2- 172.21.15.156:0/3369569715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41ec09e870 0x7f41ec09ec40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f41e8009840 tx=0x7f41e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c411d2e5cc1892a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:05.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.810+0000 7f41f12a4700 1 -- 172.21.15.156:0/3369569715 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e8011830 con 0x7f41ec09e870 2023-09-30T22:21:05.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.810+0000 7f41f12a4700 1 -- 172.21.15.156:0/3369569715 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e8011990 con 0x7f41ec09e870 2023-09-30T22:21:05.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.810+0000 7f41f12a4700 1 -- 172.21.15.156:0/3369569715 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e8011d20 con 0x7f41ec09e870 2023-09-30T22:21:05.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.810+0000 7f41f450a700 1 -- 172.21.15.156:0/3369569715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41ec09e870 msgr2=0x7f41ec09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:05.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.810+0000 7f41f450a700 1 --2- 172.21.15.156:0/3369569715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41ec09e870 0x7f41ec09ec40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f41e8009840 tx=0x7f41e8009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:05.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.810+0000 7f41f450a700 1 -- 172.21.15.156:0/3369569715 shutdown_connections 2023-09-30T22:21:05.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.810+0000 7f41f450a700 1 --2- 172.21.15.156:0/3369569715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41ec09e870 0x7f41ec09ec40 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:05.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.810+0000 7f41f450a700 1 --2- 172.21.15.156:0/3369569715 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41ec09f180 0x7f41ec133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:05.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.810+0000 7f41f450a700 1 -- 172.21.15.156:0/3369569715 >> 172.21.15.156:0/3369569715 conn(0x7f41ec0a4430 msgr2=0x7f41ec0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:05.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.810+0000 7f41f450a700 1 -- 172.21.15.156:0/3369569715 shutdown_connections 2023-09-30T22:21:05.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.810+0000 7f41f450a700 1 -- 172.21.15.156:0/3369569715 wait complete. 2023-09-30T22:21:05.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.811+0000 7f41f450a700 1 Processor -- start 2023-09-30T22:21:05.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.811+0000 7f41f450a700 1 -- start start 2023-09-30T22:21:05.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.812+0000 7f41f450a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41ec09e870 0x7f41ec1228c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:05.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.812+0000 7f41f450a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41ec09f180 0x7f41ec122e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:05.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.812+0000 7f41f450a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41ec134160 0x7f41ec123340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:05.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.812+0000 7f41f450a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec1334c0 con 0x7f41ec09f180 2023-09-30T22:21:05.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.812+0000 7f41f450a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec125ac0 con 0x7f41ec134160 2023-09-30T22:21:05.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.812+0000 7f41f450a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec124500 con 0x7f41ec09e870 2023-09-30T22:21:05.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.812+0000 7f41f1aa5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41ec09f180 0x7f41ec122e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:05.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.812+0000 7f41f1aa5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41ec09f180 0x7f41ec122e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34132/0 (socket says 172.21.15.156:34132) 2023-09-30T22:21:05.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.812+0000 7f41f1aa5700 1 -- 172.21.15.156:0/201729074 learned_addr learned my addr 172.21.15.156:0/201729074 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:05.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.812+0000 7f41f2aa7700 1 --2- 172.21.15.156:0/201729074 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41ec134160 0x7f41ec123340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:05.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.812+0000 7f41f22a6700 1 --2- 172.21.15.156:0/201729074 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41ec09e870 0x7f41ec1228c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:05.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.812+0000 7f41f1aa5700 1 -- 172.21.15.156:0/201729074 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41ec09e870 msgr2=0x7f41ec1228c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:05.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.812+0000 7f41f1aa5700 1 --2- 172.21.15.156:0/201729074 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41ec09e870 0x7f41ec1228c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:05.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.812+0000 7f41f1aa5700 1 -- 172.21.15.156:0/201729074 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41ec134160 msgr2=0x7f41ec123340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:05.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.812+0000 7f41f1aa5700 1 --2- 172.21.15.156:0/201729074 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41ec134160 0x7f41ec123340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:05.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.812+0000 7f41f1aa5700 1 -- 172.21.15.156:0/201729074 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e80094a0 con 0x7f41ec09f180 2023-09-30T22:21:05.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.812+0000 7f41f1aa5700 1 --2- 172.21.15.156:0/201729074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41ec09f180 0x7f41ec122e00 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00e9b0 tx=0x7f41dc00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:05.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.813+0000 7f41e2ffd700 1 -- 172.21.15.156:0/201729074 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc00ee50 con 0x7f41ec09f180 2023-09-30T22:21:05.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.813+0000 7f41e2ffd700 1 -- 172.21.15.156:0/201729074 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41dc00c850 con 0x7f41ec09f180 2023-09-30T22:21:05.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.813+0000 7f41f450a700 1 -- 172.21.15.156:0/201729074 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41ec1263e0 con 0x7f41ec09f180 2023-09-30T22:21:05.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.813+0000 7f41e2ffd700 1 -- 172.21.15.156:0/201729074 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc00cbc0 con 0x7f41ec09f180 2023-09-30T22:21:05.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.813+0000 7f41f450a700 1 -- 172.21.15.156:0/201729074 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41ec125e40 con 0x7f41ec09f180 2023-09-30T22:21:05.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.814+0000 7f41e2ffd700 1 -- 172.21.15.156:0/201729074 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f41dc00cd20 con 0x7f41ec09f180 2023-09-30T22:21:05.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.814+0000 7f41f450a700 1 -- 172.21.15.156:0/201729074 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41ec04f2a0 con 0x7f41ec09f180 2023-09-30T22:21:05.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.814+0000 7f41e2ffd700 1 -- 172.21.15.156:0/201729074 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f41dc03f760 con 0x7f41ec09f180 2023-09-30T22:21:05.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.823+0000 7f41e2ffd700 1 -- 172.21.15.156:0/201729074 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f41dc01be10 con 0x7f41ec09f180 2023-09-30T22:21:05.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.832+0000 7fc4a5a0c700 1 Processor -- start 2023-09-30T22:21:05.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.832+0000 7fc4a5a0c700 1 -- start start 2023-09-30T22:21:05.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.832+0000 7fc4a5a0c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a009f350 0x7fc4a0136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:05.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.832+0000 7fc4a5a0c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc4a01371c0 0x7fc4a01395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:05.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.833+0000 7fc4a5a0c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a009c970 con 0x7fc4a009e870 2023-09-30T22:21:05.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.833+0000 7fc4a5a0c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a00a0920 con 0x7fc4a01371c0 2023-09-30T22:21:05.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.833+0000 7fc4a5a0c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a009f9c0 con 0x7fc4a009f350 2023-09-30T22:21:05.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.833+0000 7fc49e7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a009f350 0x7fc4a0136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:05.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.833+0000 7fc49effd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc4a009e870 0x7fc4a009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53126/0 (socket says 172.21.15.156:53126) 2023-09-30T22:21:05.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.833+0000 7fc49e7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a009f350 0x7fc4a0136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:41246/0 (socket says 172.21.15.156:41246) 2023-09-30T22:21:05.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.833+0000 7fc49effd700 1 -- 172.21.15.156:0/1324670897 learned_addr learned my addr 172.21.15.156:0/1324670897 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:05.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.833+0000 7fc49f7fe700 1 --2- 172.21.15.156:0/1324670897 >> v2:172.21.15.156:3300/0 conn(0x7fc4a01371c0 0x7fc4a01395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:05.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.833+0000 7fc49e7fc700 1 -- 172.21.15.156:0/1324670897 >> v2:172.21.15.156:3300/0 conn(0x7fc4a01371c0 msgr2=0x7fc4a01395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:05.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.833+0000 7fc49e7fc700 1 --2- 172.21.15.156:0/1324670897 >> v2:172.21.15.156:3300/0 conn(0x7fc4a01371c0 0x7fc4a01395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:05.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.833+0000 7fc49e7fc700 1 -- 172.21.15.156:0/1324670897 >> v1:172.21.15.156:6789/0 conn(0x7fc4a009e870 legacy=0x7fc4a009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:05.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.833+0000 7fc49e7fc700 1 -- 172.21.15.156:0/1324670897 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a009bab0 con 0x7fc4a009f350 2023-09-30T22:21:05.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.833+0000 7fc49e7fc700 1 --2- 172.21.15.156:0/1324670897 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a009f350 0x7fc4a0136c80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc494009840 tx=0x7fc494009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0ce8287a87fc3ce server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:05.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.833+0000 7fc49dffb700 1 -- 172.21.15.156:0/1324670897 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc494011830 con 0x7fc4a009f350 2023-09-30T22:21:05.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.833+0000 7fc49dffb700 1 -- 172.21.15.156:0/1324670897 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc494011990 con 0x7fc4a009f350 2023-09-30T22:21:05.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.833+0000 7fc49dffb700 1 -- 172.21.15.156:0/1324670897 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc494011d20 con 0x7fc4a009f350 2023-09-30T22:21:05.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.834+0000 7fc4a5a0c700 1 -- 172.21.15.156:0/1324670897 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a009f350 msgr2=0x7fc4a0136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:05.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.834+0000 7fc4a5a0c700 1 --2- 172.21.15.156:0/1324670897 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a009f350 0x7fc4a0136c80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc494009840 tx=0x7fc494009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:05.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.834+0000 7fc4a5a0c700 1 -- 172.21.15.156:0/1324670897 shutdown_connections 2023-09-30T22:21:05.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.834+0000 7fc4a5a0c700 1 --2- 172.21.15.156:0/1324670897 >> v2:172.21.15.156:3300/0 conn(0x7fc4a01371c0 0x7fc4a01395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:05.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.834+0000 7fc4a5a0c700 1 --2- 172.21.15.156:0/1324670897 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a009f350 0x7fc4a0136c80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:05.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.834+0000 7fc4a5a0c700 1 -- 172.21.15.156:0/1324670897 >> 172.21.15.156:0/1324670897 conn(0x7fc4a00a4430 msgr2=0x7fc4a00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:05.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.834+0000 7fc4a5a0c700 1 -- 172.21.15.156:0/1324670897 shutdown_connections 2023-09-30T22:21:05.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.834+0000 7fc4a5a0c700 1 -- 172.21.15.156:0/1324670897 wait complete. 2023-09-30T22:21:05.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.835+0000 7fc4a5a0c700 1 Processor -- start 2023-09-30T22:21:05.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.835+0000 7fc4a5a0c700 1 -- start start 2023-09-30T22:21:05.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.835+0000 7fc4a5a0c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a009e870 0x7fc4a01c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:05.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.835+0000 7fc4a5a0c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a009f350 0x7fc4a01c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:05.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.836+0000 7fc4a5a0c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4a01371c0 0x7fc4a01c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:05.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.836+0000 7fc4a5a0c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a0125400 con 0x7fc4a01371c0 2023-09-30T22:21:05.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.836+0000 7fc4a5a0c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a0123df0 con 0x7fc4a009e870 2023-09-30T22:21:05.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.836+0000 7fc4a5a0c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a0124d80 con 0x7fc4a009f350 2023-09-30T22:21:05.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.836+0000 7fc49effd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a009e870 0x7fc4a01c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:05.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.836+0000 7fc49effd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a009e870 0x7fc4a01c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44210/0 (socket says 172.21.15.156:44210) 2023-09-30T22:21:05.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.836+0000 7fc49effd700 1 -- 172.21.15.156:0/899490771 learned_addr learned my addr 172.21.15.156:0/899490771 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:05.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.836+0000 7fc49e7fc700 1 --2- 172.21.15.156:0/899490771 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a009f350 0x7fc4a01c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:05.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.836+0000 7fc49f7fe700 1 --2- 172.21.15.156:0/899490771 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4a01371c0 0x7fc4a01c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:05.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.836+0000 7fc49effd700 1 -- 172.21.15.156:0/899490771 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a009f350 msgr2=0x7fc4a01c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:05.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.836+0000 7fc49effd700 1 --2- 172.21.15.156:0/899490771 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a009f350 0x7fc4a01c8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:05.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.836+0000 7fc49effd700 1 -- 172.21.15.156:0/899490771 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4a01371c0 msgr2=0x7fc4a01c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:05.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.836+0000 7fc49effd700 1 --2- 172.21.15.156:0/899490771 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4a01371c0 0x7fc4a01c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:05.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.836+0000 7fc49effd700 1 -- 172.21.15.156:0/899490771 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4940094a0 con 0x7fc4a009e870 2023-09-30T22:21:05.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.836+0000 7fc49effd700 1 --2- 172.21.15.156:0/899490771 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a009e870 0x7fc4a01c83d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc49000c520 tx=0x7fc49000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:05.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.836+0000 7fc487fff700 1 -- 172.21.15.156:0/899490771 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc490005d70 con 0x7fc4a009e870 2023-09-30T22:21:05.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.836+0000 7fc487fff700 1 -- 172.21.15.156:0/899490771 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4900070d0 con 0x7fc4a009e870 2023-09-30T22:21:05.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.836+0000 7fc4a5a0c700 1 -- 172.21.15.156:0/899490771 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a0125040 con 0x7fc4a009e870 2023-09-30T22:21:05.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.836+0000 7fc487fff700 1 -- 172.21.15.156:0/899490771 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc490007440 con 0x7fc4a009e870 2023-09-30T22:21:05.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.836+0000 7fc4a5a0c700 1 -- 172.21.15.156:0/899490771 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a006d3f0 con 0x7fc4a009e870 2023-09-30T22:21:05.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.837+0000 7fc4a5a0c700 1 -- 172.21.15.156:0/899490771 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a006d5e0 con 0x7fc4a009e870 2023-09-30T22:21:05.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.837+0000 7fc487fff700 1 -- 172.21.15.156:0/899490771 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc4900075a0 con 0x7fc4a009e870 2023-09-30T22:21:05.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.838+0000 7fc487fff700 1 -- 172.21.15.156:0/899490771 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc49003ea50 con 0x7fc4a009e870 2023-09-30T22:21:05.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.846+0000 7fc487fff700 1 -- 172.21.15.156:0/899490771 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc490011be0 con 0x7fc4a009e870 2023-09-30T22:21:05.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.966+0000 7f9d27f12700 1 -- 172.21.15.156:0/486623831 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9d2011ddd0 con 0x7f9d200a10b0 2023-09-30T22:21:05.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.966+0000 7f9d167fc700 1 -- 172.21.15.156:0/486623831 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d1c01b410 con 0x7f9d200a10b0 2023-09-30T22:21:05.970 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:05.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.969+0000 7f9d27f12700 1 -- 172.21.15.156:0/486623831 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d200a10b0 msgr2=0x7f9d2011a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:05.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.969+0000 7f9d27f12700 1 --2- 172.21.15.156:0/486623831 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d200a10b0 0x7f9d2011a6c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9d2009a1c0 tx=0x7f9d1c004750 comp rx=0 tx=0).stop 2023-09-30T22:21:05.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.969+0000 7f9d27f12700 1 -- 172.21.15.156:0/486623831 shutdown_connections 2023-09-30T22:21:05.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.969+0000 7f9d27f12700 1 --2- 172.21.15.156:0/486623831 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d20134210 0x7f9d2011b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:05.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.969+0000 7f9d27f12700 1 --2- 172.21.15.156:0/486623831 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d200a10b0 0x7f9d2011a6c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:05.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.969+0000 7f9d27f12700 1 --2- 172.21.15.156:0/486623831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d20133900 0x7f9d2011ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:05.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.969+0000 7f9d27f12700 1 -- 172.21.15.156:0/486623831 >> 172.21.15.156:0/486623831 conn(0x7f9d200a2980 msgr2=0x7f9d2012f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:05.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.969+0000 7f9d27f12700 1 -- 172.21.15.156:0/486623831 shutdown_connections 2023-09-30T22:21:05.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:05.969+0000 7f9d27f12700 1 -- 172.21.15.156:0/486623831 wait complete. 2023-09-30T22:21:05.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:06.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.019+0000 7f41f450a700 1 -- 172.21.15.156:0/201729074 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f41ec06c9d0 con 0x7f41ec09f180 2023-09-30T22:21:06.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.019+0000 7f41e2ffd700 1 -- 172.21.15.156:0/201729074 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f41dc021020 con 0x7f41ec09f180 2023-09-30T22:21:06.020 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:06.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.021+0000 7f41f450a700 1 -- 172.21.15.156:0/201729074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41ec09f180 msgr2=0x7f41ec122e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:06.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.021+0000 7f41f450a700 1 --2- 172.21.15.156:0/201729074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41ec09f180 0x7f41ec122e00 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00e9b0 tx=0x7f41dc00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:21:06.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.021+0000 7f41f450a700 1 -- 172.21.15.156:0/201729074 shutdown_connections 2023-09-30T22:21:06.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.021+0000 7f41f450a700 1 --2- 172.21.15.156:0/201729074 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41ec134160 0x7f41ec123340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:06.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.021+0000 7f41f450a700 1 --2- 172.21.15.156:0/201729074 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41ec09e870 0x7f41ec1228c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:06.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.021+0000 7f41f450a700 1 --2- 172.21.15.156:0/201729074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41ec09f180 0x7f41ec122e00 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:06.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.021+0000 7f41f450a700 1 -- 172.21.15.156:0/201729074 >> 172.21.15.156:0/201729074 conn(0x7f41ec0a4430 msgr2=0x7f41ec070ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:06.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.021+0000 7f41f450a700 1 -- 172.21.15.156:0/201729074 shutdown_connections 2023-09-30T22:21:06.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.021+0000 7f41f450a700 1 -- 172.21.15.156:0/201729074 wait complete. 2023-09-30T22:21:06.034 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:06.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.048+0000 7fc4a5a0c700 1 -- 172.21.15.156:0/899490771 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc4a009dc50 con 0x7fc4a009e870 2023-09-30T22:21:06.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.049+0000 7fc487fff700 1 -- 172.21.15.156:0/899490771 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc490017020 con 0x7fc4a009e870 2023-09-30T22:21:06.049 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:06.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.051+0000 7fc4a5a0c700 1 -- 172.21.15.156:0/899490771 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a009e870 msgr2=0x7fc4a01c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:06.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.051+0000 7fc4a5a0c700 1 --2- 172.21.15.156:0/899490771 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a009e870 0x7fc4a01c83d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc49000c520 tx=0x7fc49000c830 comp rx=0 tx=0).stop 2023-09-30T22:21:06.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.051+0000 7fc4a5a0c700 1 -- 172.21.15.156:0/899490771 shutdown_connections 2023-09-30T22:21:06.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.051+0000 7fc4a5a0c700 1 --2- 172.21.15.156:0/899490771 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4a01371c0 0x7fc4a01c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:06.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.051+0000 7fc4a5a0c700 1 --2- 172.21.15.156:0/899490771 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a009e870 0x7fc4a01c83d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:06.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.051+0000 7fc4a5a0c700 1 --2- 172.21.15.156:0/899490771 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a009f350 0x7fc4a01c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:06.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.051+0000 7fc4a5a0c700 1 -- 172.21.15.156:0/899490771 >> 172.21.15.156:0/899490771 conn(0x7fc4a00a4430 msgr2=0x7fc4a00a36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:06.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.051+0000 7fc4a5a0c700 1 -- 172.21.15.156:0/899490771 shutdown_connections 2023-09-30T22:21:06.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.051+0000 7fc4a5a0c700 1 -- 172.21.15.156:0/899490771 wait complete. 2023-09-30T22:21:06.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:06.771 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:06.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.899+0000 7fc5f79bf700 1 Processor -- start 2023-09-30T22:21:06.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.899+0000 7fc5f79bf700 1 -- start start 2023-09-30T22:21:06.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.900+0000 7fc5f79bf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc5f009d860 0x7fc5f009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:06.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.900+0000 7fc5f79bf700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc5f009e170 0x7fc5f01307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:06.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.900+0000 7fc5f79bf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc5f0130ce0 0x7fc5f0131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:06.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.900+0000 7fc5f79bf700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f009aaa0 con 0x7fc5f009e170 2023-09-30T22:21:06.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.900+0000 7fc5f79bf700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f009f870 con 0x7fc5f0130ce0 2023-09-30T22:21:06.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.900+0000 7fc5f79bf700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f009b360 con 0x7fc5f009d860 2023-09-30T22:21:06.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.900+0000 7fc5f5f5c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc5f0130ce0 0x7fc5f0131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:06.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.900+0000 7fc5f575b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc5f009d860 0x7fc5f009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:06.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.900+0000 7fc5f4f5a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc5f009e170 0x7fc5f01307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:06.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.900+0000 7fc5f5f5c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc5f0130ce0 0x7fc5f0131180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44214/0 (socket says 172.21.15.156:44214) 2023-09-30T22:21:06.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.900+0000 7fc5f575b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc5f009d860 0x7fc5f009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:41266/0 (socket says 172.21.15.156:41266) 2023-09-30T22:21:06.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.900+0000 7fc5f5f5c700 1 -- 172.21.15.156:0/3099885453 learned_addr learned my addr 172.21.15.156:0/3099885453 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:06.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.900+0000 7fc5f4f5a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc5f009e170 0x7fc5f01307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34162/0 (socket says 172.21.15.156:34162) 2023-09-30T22:21:06.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.900+0000 7fc5f4f5a700 1 -- 172.21.15.156:0/3099885453 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc5f009d860 msgr2=0x7fc5f009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:06.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.900+0000 7fc5f4f5a700 1 --2- 172.21.15.156:0/3099885453 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc5f009d860 0x7fc5f009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:06.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.900+0000 7fc5f4f5a700 1 -- 172.21.15.156:0/3099885453 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc5f0130ce0 msgr2=0x7fc5f0131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:06.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.900+0000 7fc5f4f5a700 1 --2- 172.21.15.156:0/3099885453 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc5f0130ce0 0x7fc5f0131180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:06.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.900+0000 7fc5f4f5a700 1 -- 172.21.15.156:0/3099885453 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f009b620 con 0x7fc5f009e170 2023-09-30T22:21:06.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.900+0000 7fc5f5f5c700 1 --2- 172.21.15.156:0/3099885453 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc5f0130ce0 0x7fc5f0131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:06.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.900+0000 7fc5f575b700 1 --2- 172.21.15.156:0/3099885453 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc5f009d860 0x7fc5f009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:06.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.900+0000 7fc5f4f5a700 1 --2- 172.21.15.156:0/3099885453 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5f009e170 0x7fc5f01307a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec00dc60 tx=0x7fc5ec00df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c743ab4f3a55f39 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:06.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.900+0000 7fc5e7fff700 1 -- 172.21.15.156:0/3099885453 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec012070 con 0x7fc5f009e170 2023-09-30T22:21:06.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.900+0000 7fc5e7fff700 1 -- 172.21.15.156:0/3099885453 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ec00d2e0 con 0x7fc5f009e170 2023-09-30T22:21:06.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.900+0000 7fc5e7fff700 1 -- 172.21.15.156:0/3099885453 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec00f900 con 0x7fc5f009e170 2023-09-30T22:21:06.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.901+0000 7fc5f79bf700 1 -- 172.21.15.156:0/3099885453 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5f009e170 msgr2=0x7fc5f01307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:06.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.901+0000 7fc5f79bf700 1 --2- 172.21.15.156:0/3099885453 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5f009e170 0x7fc5f01307a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec00dc60 tx=0x7fc5ec00df70 comp rx=0 tx=0).stop 2023-09-30T22:21:06.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.901+0000 7fc5f79bf700 1 -- 172.21.15.156:0/3099885453 shutdown_connections 2023-09-30T22:21:06.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.901+0000 7fc5f79bf700 1 --2- 172.21.15.156:0/3099885453 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc5f0130ce0 0x7fc5f0131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:06.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.901+0000 7fc5f79bf700 1 --2- 172.21.15.156:0/3099885453 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc5f009d860 0x7fc5f009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:06.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.901+0000 7fc5f79bf700 1 --2- 172.21.15.156:0/3099885453 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5f009e170 0x7fc5f01307a0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:06.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.901+0000 7fc5f79bf700 1 -- 172.21.15.156:0/3099885453 >> 172.21.15.156:0/3099885453 conn(0x7fc5f0099c40 msgr2=0x7fc5f00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:06.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.901+0000 7fc5f79bf700 1 -- 172.21.15.156:0/3099885453 shutdown_connections 2023-09-30T22:21:06.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.901+0000 7fc5f79bf700 1 -- 172.21.15.156:0/3099885453 wait complete. 2023-09-30T22:21:06.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.902+0000 7fc5f79bf700 1 Processor -- start 2023-09-30T22:21:06.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.902+0000 7fc5f79bf700 1 -- start start 2023-09-30T22:21:06.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.902+0000 7fc5f79bf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5f009d860 0x7fc5f011e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:06.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.902+0000 7fc5f79bf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc5f009e170 0x7fc5f011e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:06.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.902+0000 7fc5f79bf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc5f0130ce0 0x7fc5f011eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:06.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.902+0000 7fc5f79bf700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f01212d0 con 0x7fc5f009d860 2023-09-30T22:21:06.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.902+0000 7fc5f79bf700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f009c8b0 con 0x7fc5f0130ce0 2023-09-30T22:21:06.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.902+0000 7fc5f79bf700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f00a2360 con 0x7fc5f009e170 2023-09-30T22:21:06.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.902+0000 7fc5f4f5a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc5f009e170 0x7fc5f011e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:06.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.902+0000 7fc5f5f5c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc5f0130ce0 0x7fc5f011eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:06.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.902+0000 7fc5f575b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5f009d860 0x7fc5f011e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:06.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.903+0000 7fc5f4f5a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc5f009e170 0x7fc5f011e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:41274/0 (socket says 172.21.15.156:41274) 2023-09-30T22:21:06.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.903+0000 7fc5f5f5c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc5f0130ce0 0x7fc5f011eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44226/0 (socket says 172.21.15.156:44226) 2023-09-30T22:21:06.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.903+0000 7fc5f4f5a700 1 -- 172.21.15.156:0/4183576462 learned_addr learned my addr 172.21.15.156:0/4183576462 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:06.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.903+0000 7fc5f575b700 1 -- 172.21.15.156:0/4183576462 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc5f009e170 msgr2=0x7fc5f011e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:06.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.903+0000 7fc5f575b700 1 --2- 172.21.15.156:0/4183576462 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc5f009e170 0x7fc5f011e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:06.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.903+0000 7fc5f575b700 1 -- 172.21.15.156:0/4183576462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc5f0130ce0 msgr2=0x7fc5f011eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:06.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.903+0000 7fc5f575b700 1 --2- 172.21.15.156:0/4183576462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc5f0130ce0 0x7fc5f011eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:06.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.903+0000 7fc5f575b700 1 -- 172.21.15.156:0/4183576462 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e00094a0 con 0x7fc5f009d860 2023-09-30T22:21:06.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.903+0000 7fc5f5f5c700 1 --2- 172.21.15.156:0/4183576462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc5f0130ce0 0x7fc5f011eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:06.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.903+0000 7fc5f4f5a700 1 --2- 172.21.15.156:0/4183576462 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc5f009e170 0x7fc5f011e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:06.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.903+0000 7fc5f575b700 1 --2- 172.21.15.156:0/4183576462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5f009d860 0x7fc5f011e0c0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0009fd0 tx=0x7fc5e000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:06.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.903+0000 7fc5e5ffb700 1 -- 172.21.15.156:0/4183576462 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0004030 con 0x7fc5f009d860 2023-09-30T22:21:06.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.903+0000 7fc5e5ffb700 1 -- 172.21.15.156:0/4183576462 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e0004190 con 0x7fc5f009d860 2023-09-30T22:21:06.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.903+0000 7fc5e5ffb700 1 -- 172.21.15.156:0/4183576462 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0004520 con 0x7fc5f009d860 2023-09-30T22:21:06.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.903+0000 7fc5f79bf700 1 -- 172.21.15.156:0/4183576462 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e800bb50 con 0x7fc5f009d860 2023-09-30T22:21:06.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.903+0000 7fc5f79bf700 1 -- 172.21.15.156:0/4183576462 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5ec00d940 con 0x7fc5f009d860 2023-09-30T22:21:06.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.904+0000 7fc5e5ffb700 1 -- 172.21.15.156:0/4183576462 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc5e00036a0 con 0x7fc5f009d860 2023-09-30T22:21:06.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.904+0000 7fc5e5ffb700 1 -- 172.21.15.156:0/4183576462 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc5e003f3a0 con 0x7fc5f009d860 2023-09-30T22:21:06.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.904+0000 7fc5f79bf700 1 -- 172.21.15.156:0/4183576462 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f011add0 con 0x7fc5f009d860 2023-09-30T22:21:06.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:06.909+0000 7fc5e5ffb700 1 -- 172.21.15.156:0/4183576462 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc5e0019b80 con 0x7fc5f009d860 2023-09-30T22:21:06.987 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:07.035 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:07.065 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:07.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.103+0000 7fc5f79bf700 1 -- 172.21.15.156:0/4183576462 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc5f01216e0 con 0x7fc5f009d860 2023-09-30T22:21:07.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.103+0000 7fc5e5ffb700 1 -- 172.21.15.156:0/4183576462 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc5e0020020 con 0x7fc5f009d860 2023-09-30T22:21:07.104 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:07.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.107+0000 7fc5f79bf700 1 -- 172.21.15.156:0/4183576462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5f009d860 msgr2=0x7fc5f011e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:07.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.107+0000 7fc5f79bf700 1 --2- 172.21.15.156:0/4183576462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5f009d860 0x7fc5f011e0c0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0009fd0 tx=0x7fc5e000eb90 comp rx=0 tx=0).stop 2023-09-30T22:21:07.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.107+0000 7fc5f79bf700 1 -- 172.21.15.156:0/4183576462 shutdown_connections 2023-09-30T22:21:07.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.107+0000 7fc5f79bf700 1 --2- 172.21.15.156:0/4183576462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc5f0130ce0 0x7fc5f011eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.107+0000 7fc5f79bf700 1 --2- 172.21.15.156:0/4183576462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5f009d860 0x7fc5f011e0c0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.107+0000 7fc5f79bf700 1 --2- 172.21.15.156:0/4183576462 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc5f009e170 0x7fc5f011e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.107+0000 7fc5f79bf700 1 -- 172.21.15.156:0/4183576462 >> 172.21.15.156:0/4183576462 conn(0x7fc5f0099c40 msgr2=0x7fc5f0071360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:07.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.107+0000 7fc5f79bf700 1 -- 172.21.15.156:0/4183576462 shutdown_connections 2023-09-30T22:21:07.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.107+0000 7fc5f79bf700 1 -- 172.21.15.156:0/4183576462 wait complete. 2023-09-30T22:21:07.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.117+0000 7f99d6845700 1 Processor -- start 2023-09-30T22:21:07.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.117+0000 7f99d6845700 1 -- start start 2023-09-30T22:21:07.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.118+0000 7f99d6845700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99d0136960 0x7f99d0138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:07.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.118+0000 7f99d6845700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f99d0139280 0x7f99d013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:07.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.118+0000 7f99d6845700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d006b2d0 con 0x7f99d0133ad0 2023-09-30T22:21:07.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.118+0000 7f99d6845700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d01345b0 con 0x7f99d0139280 2023-09-30T22:21:07.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.118+0000 7f99d6845700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99d0133610 con 0x7f99d0136960 2023-09-30T22:21:07.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.118+0000 7f99cf7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99d0136960 0x7f99d0138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:07.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.118+0000 7f99cf7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99d0136960 0x7f99d0138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:41280/0 (socket says 172.21.15.156:41280) 2023-09-30T22:21:07.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.118+0000 7f99cffff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f99d0133ad0 0x7f99d0133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53134/0 (socket says 172.21.15.156:53134) 2023-09-30T22:21:07.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.118+0000 7f99cf7fe700 1 -- 172.21.15.156:0/2728090759 learned_addr learned my addr 172.21.15.156:0/2728090759 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:07.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.118+0000 7f99cf7fe700 1 -- 172.21.15.156:0/2728090759 >> v2:172.21.15.156:3300/0 conn(0x7f99d0139280 msgr2=0x7f99d013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:07.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.118+0000 7f99cf7fe700 1 --2- 172.21.15.156:0/2728090759 >> v2:172.21.15.156:3300/0 conn(0x7f99d0139280 0x7f99d013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.118+0000 7f99cf7fe700 1 -- 172.21.15.156:0/2728090759 >> v1:172.21.15.156:6789/0 conn(0x7f99d0133ad0 legacy=0x7f99d0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:07.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.118+0000 7f99cf7fe700 1 -- 172.21.15.156:0/2728090759 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d009a500 con 0x7f99d0136960 2023-09-30T22:21:07.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.119+0000 7f99cf7fe700 1 --2- 172.21.15.156:0/2728090759 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99d0136960 0x7f99d0138d40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f99c4009920 tx=0x7f99c4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea655cbe9fc60d22 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:07.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.119+0000 7f99ceffd700 1 -- 172.21.15.156:0/2728090759 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c400ba20 con 0x7f99d0136960 2023-09-30T22:21:07.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.119+0000 7f99ceffd700 1 -- 172.21.15.156:0/2728090759 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c400bb80 con 0x7f99d0136960 2023-09-30T22:21:07.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.119+0000 7f99ceffd700 1 -- 172.21.15.156:0/2728090759 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c4009e70 con 0x7f99d0136960 2023-09-30T22:21:07.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.119+0000 7f99d6845700 1 -- 172.21.15.156:0/2728090759 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99d0136960 msgr2=0x7f99d0138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:07.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.119+0000 7f99d6845700 1 --2- 172.21.15.156:0/2728090759 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99d0136960 0x7f99d0138d40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f99c4009920 tx=0x7f99c4009c30 comp rx=0 tx=0).stop 2023-09-30T22:21:07.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.119+0000 7f99d6845700 1 -- 172.21.15.156:0/2728090759 shutdown_connections 2023-09-30T22:21:07.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.120+0000 7f99d6845700 1 --2- 172.21.15.156:0/2728090759 >> v2:172.21.15.156:3300/0 conn(0x7f99d0139280 0x7f99d013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.120+0000 7f99d6845700 1 --2- 172.21.15.156:0/2728090759 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99d0136960 0x7f99d0138d40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.120+0000 7f99d6845700 1 -- 172.21.15.156:0/2728090759 >> 172.21.15.156:0/2728090759 conn(0x7f99d0099c40 msgr2=0x7f99d00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:07.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.120+0000 7f99d6845700 1 -- 172.21.15.156:0/2728090759 shutdown_connections 2023-09-30T22:21:07.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.120+0000 7f99d6845700 1 -- 172.21.15.156:0/2728090759 wait complete. 2023-09-30T22:21:07.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.121+0000 7f99d6845700 1 Processor -- start 2023-09-30T22:21:07.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.121+0000 7f99d6845700 1 -- start start 2023-09-30T22:21:07.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.121+0000 7f99d6845700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99d0133ad0 0x7f99d0071850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:07.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.121+0000 7f99d6845700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99d0136960 0x7f99d0071d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:07.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.122+0000 7f99d6845700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99d0139280 0x7f99d01c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:07.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.122+0000 7f99d6845700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d009f390 con 0x7f99d0136960 2023-09-30T22:21:07.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.122+0000 7f99d6845700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d00725f0 con 0x7f99d0139280 2023-09-30T22:21:07.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.122+0000 7f99d6845700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99d0138f50 con 0x7f99d0133ad0 2023-09-30T22:21:07.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.122+0000 7f99cffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99d0133ad0 0x7f99d0071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:07.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.122+0000 7f99cf7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99d0136960 0x7f99d0071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:07.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.122+0000 7f99cf7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99d0136960 0x7f99d0071d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34202/0 (socket says 172.21.15.156:34202) 2023-09-30T22:21:07.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.122+0000 7f99cf7fe700 1 -- 172.21.15.156:0/3186428112 learned_addr learned my addr 172.21.15.156:0/3186428112 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:07.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.122+0000 7f99d4de2700 1 --2- 172.21.15.156:0/3186428112 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99d0139280 0x7f99d01c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:07.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.122+0000 7f99cf7fe700 1 -- 172.21.15.156:0/3186428112 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99d0133ad0 msgr2=0x7f99d0071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:07.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.122+0000 7f99cf7fe700 1 --2- 172.21.15.156:0/3186428112 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99d0133ad0 0x7f99d0071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.122+0000 7f99cf7fe700 1 -- 172.21.15.156:0/3186428112 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99d0139280 msgr2=0x7f99d01c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:07.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.122+0000 7f99cf7fe700 1 --2- 172.21.15.156:0/3186428112 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99d0139280 0x7f99d01c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.122+0000 7f99cf7fe700 1 -- 172.21.15.156:0/3186428112 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c4009550 con 0x7f99d0136960 2023-09-30T22:21:07.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:07.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.122+0000 7f99cf7fe700 1 --2- 172.21.15.156:0/3186428112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99d0136960 0x7f99d0071d90 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f99c4014040 tx=0x7f99c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:07.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.122+0000 7f99ccff9700 1 -- 172.21.15.156:0/3186428112 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c4004340 con 0x7f99d0136960 2023-09-30T22:21:07.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.122+0000 7f99ccff9700 1 -- 172.21.15.156:0/3186428112 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c401e070 con 0x7f99d0136960 2023-09-30T22:21:07.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.123+0000 7f99d6845700 1 -- 172.21.15.156:0/3186428112 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d00703e0 con 0x7f99d0136960 2023-09-30T22:21:07.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.123+0000 7f99ccff9700 1 -- 172.21.15.156:0/3186428112 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c40036a0 con 0x7f99d0136960 2023-09-30T22:21:07.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.123+0000 7f99d6845700 1 -- 172.21.15.156:0/3186428112 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d00706c0 con 0x7f99d0136960 2023-09-30T22:21:07.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.123+0000 7f99ccff9700 1 -- 172.21.15.156:0/3186428112 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f99c4020030 con 0x7f99d0136960 2023-09-30T22:21:07.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.123+0000 7f99ccff9700 1 -- 172.21.15.156:0/3186428112 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f99c4040440 con 0x7f99d0136960 2023-09-30T22:21:07.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.124+0000 7f99d6845700 1 -- 172.21.15.156:0/3186428112 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d0070080 con 0x7f99d0136960 2023-09-30T22:21:07.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.132+0000 7f99ccff9700 1 -- 172.21.15.156:0/3186428112 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f99c40229c0 con 0x7f99d0136960 2023-09-30T22:21:07.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.186+0000 7f6ec04a6700 1 Processor -- start 2023-09-30T22:21:07.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.186+0000 7f6ec04a6700 1 -- start start 2023-09-30T22:21:07.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.187+0000 7f6ec04a6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6eb8133ad0 0x7f6eb8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:07.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.187+0000 7f6ec04a6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6eb81300a0 0x7f6eb81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:07.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.187+0000 7f6ec04a6700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb806b2d0 con 0x7f6eb81309f0 2023-09-30T22:21:07.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.187+0000 7f6ec04a6700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb8133610 con 0x7f6eb81300a0 2023-09-30T22:21:07.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.187+0000 7f6ec04a6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb809a500 con 0x7f6eb8133ad0 2023-09-30T22:21:07.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.187+0000 7f6ebe242700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6eb8133ad0 0x7f6eb8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:07.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.187+0000 7f6ebe242700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6eb8133ad0 0x7f6eb8133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44244/0 (socket says 172.21.15.156:44244) 2023-09-30T22:21:07.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.187+0000 7f6ebe242700 1 -- 172.21.15.156:0/2131228475 learned_addr learned my addr 172.21.15.156:0/2131228475 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:07.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.187+0000 7f6ebda41700 1 --2- 172.21.15.156:0/2131228475 >> v2:172.21.15.156:3300/0 conn(0x7f6eb81300a0 0x7f6eb81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:07.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.187+0000 7f6ebe242700 1 -- 172.21.15.156:0/2131228475 >> v2:172.21.15.156:3300/0 conn(0x7f6eb81300a0 msgr2=0x7f6eb81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:07.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.187+0000 7f6ebe242700 1 --2- 172.21.15.156:0/2131228475 >> v2:172.21.15.156:3300/0 conn(0x7f6eb81300a0 0x7f6eb81304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.187+0000 7f6ebe242700 1 -- 172.21.15.156:0/2131228475 >> v1:172.21.15.156:6789/0 conn(0x7f6eb81309f0 legacy=0x7f6eb813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:07.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.187+0000 7f6ebe242700 1 -- 172.21.15.156:0/2131228475 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb81338b0 con 0x7f6eb8133ad0 2023-09-30T22:21:07.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.188+0000 7f6ebe242700 1 --2- 172.21.15.156:0/2131228475 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6eb8133ad0 0x7f6eb8133ea0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6eb40098f0 tx=0x7f6eb4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=800db811892a7874 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:07.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.188+0000 7f6ebd240700 1 -- 172.21.15.156:0/2131228475 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4011830 con 0x7f6eb8133ad0 2023-09-30T22:21:07.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.188+0000 7f6ebd240700 1 -- 172.21.15.156:0/2131228475 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb4011990 con 0x7f6eb8133ad0 2023-09-30T22:21:07.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.188+0000 7f6ebd240700 1 -- 172.21.15.156:0/2131228475 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4011d20 con 0x7f6eb8133ad0 2023-09-30T22:21:07.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.188+0000 7f6ec04a6700 1 -- 172.21.15.156:0/2131228475 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6eb8133ad0 msgr2=0x7f6eb8133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:07.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.188+0000 7f6ec04a6700 1 --2- 172.21.15.156:0/2131228475 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6eb8133ad0 0x7f6eb8133ea0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6eb40098f0 tx=0x7f6eb4009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:07.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.189+0000 7f6ec04a6700 1 -- 172.21.15.156:0/2131228475 shutdown_connections 2023-09-30T22:21:07.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.189+0000 7f6ec04a6700 1 --2- 172.21.15.156:0/2131228475 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6eb8133ad0 0x7f6eb8133ea0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.189+0000 7f6ec04a6700 1 --2- 172.21.15.156:0/2131228475 >> v2:172.21.15.156:3300/0 conn(0x7f6eb81300a0 0x7f6eb81304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.189+0000 7f6ec04a6700 1 -- 172.21.15.156:0/2131228475 >> 172.21.15.156:0/2131228475 conn(0x7f6eb8099c40 msgr2=0x7f6eb80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:07.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.189+0000 7f6ec04a6700 1 -- 172.21.15.156:0/2131228475 shutdown_connections 2023-09-30T22:21:07.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.189+0000 7f6ec04a6700 1 -- 172.21.15.156:0/2131228475 wait complete. 2023-09-30T22:21:07.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.189+0000 7f6ec04a6700 1 Processor -- start 2023-09-30T22:21:07.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.190+0000 7f6ec04a6700 1 -- start start 2023-09-30T22:21:07.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.190+0000 7f6ec04a6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6eb81300a0 0x7f6eb811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:07.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.190+0000 7f6ec04a6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6eb81309f0 0x7f6eb811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:07.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.190+0000 7f6ec04a6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6eb8133ad0 0x7f6eb811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:07.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.190+0000 7f6ec04a6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb811f0b0 con 0x7f6eb8133ad0 2023-09-30T22:21:07.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.190+0000 7f6ec04a6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb811fde0 con 0x7f6eb81309f0 2023-09-30T22:21:07.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.190+0000 7f6ec04a6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb811fbb0 con 0x7f6eb81300a0 2023-09-30T22:21:07.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.190+0000 7f6ebe242700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6eb81300a0 0x7f6eb811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:07.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.190+0000 7f6ebe242700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6eb81300a0 0x7f6eb811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:41308/0 (socket says 172.21.15.156:41308) 2023-09-30T22:21:07.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.190+0000 7f6ebe242700 1 -- 172.21.15.156:0/2125949508 learned_addr learned my addr 172.21.15.156:0/2125949508 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:07.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.190+0000 7f6ebda41700 1 --2- 172.21.15.156:0/2125949508 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6eb81309f0 0x7f6eb811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:07.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.190+0000 7f6ebea43700 1 --2- 172.21.15.156:0/2125949508 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6eb8133ad0 0x7f6eb811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:07.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.190+0000 7f6ebe242700 1 -- 172.21.15.156:0/2125949508 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6eb81309f0 msgr2=0x7f6eb811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:07.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.190+0000 7f6ebe242700 1 --2- 172.21.15.156:0/2125949508 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6eb81309f0 0x7f6eb811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.190+0000 7f6ebe242700 1 -- 172.21.15.156:0/2125949508 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6eb8133ad0 msgr2=0x7f6eb811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:07.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.190+0000 7f6ebe242700 1 --2- 172.21.15.156:0/2125949508 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6eb8133ad0 0x7f6eb811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.190+0000 7f6ebe242700 1 -- 172.21.15.156:0/2125949508 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb4009550 con 0x7f6eb81300a0 2023-09-30T22:21:07.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.191+0000 7f6ebea43700 1 --2- 172.21.15.156:0/2125949508 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6eb8133ad0 0x7f6eb811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:21:07.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.191+0000 7f6ebe242700 1 --2- 172.21.15.156:0/2125949508 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6eb81300a0 0x7f6eb811da40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4009c40 tx=0x7f6eb4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:07.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.191+0000 7f6eaeffd700 1 -- 172.21.15.156:0/2125949508 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4004480 con 0x7f6eb81300a0 2023-09-30T22:21:07.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.191+0000 7f6eaeffd700 1 -- 172.21.15.156:0/2125949508 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb401f070 con 0x7f6eb81300a0 2023-09-30T22:21:07.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.191+0000 7f6ec04a6700 1 -- 172.21.15.156:0/2125949508 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb811f850 con 0x7f6eb81300a0 2023-09-30T22:21:07.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.191+0000 7f6eaeffd700 1 -- 172.21.15.156:0/2125949508 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb40038c0 con 0x7f6eb81300a0 2023-09-30T22:21:07.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.191+0000 7f6ec04a6700 1 -- 172.21.15.156:0/2125949508 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb81200c0 con 0x7f6eb81300a0 2023-09-30T22:21:07.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.192+0000 7f6eaeffd700 1 -- 172.21.15.156:0/2125949508 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6eb4021030 con 0x7f6eb81300a0 2023-09-30T22:21:07.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.192+0000 7f6eaeffd700 1 -- 172.21.15.156:0/2125949508 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6eb4040ae0 con 0x7f6eb81300a0 2023-09-30T22:21:07.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.192+0000 7f6ec04a6700 1 -- 172.21.15.156:0/2125949508 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb811ff20 con 0x7f6eb81300a0 2023-09-30T22:21:07.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.197+0000 7f6eaeffd700 1 -- 172.21.15.156:0/2125949508 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6eb811ff20 con 0x7f6eb81300a0 2023-09-30T22:21:07.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.210+0000 7f4b60381700 1 Processor -- start 2023-09-30T22:21:07.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.210+0000 7f4b60381700 1 -- start start 2023-09-30T22:21:07.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.211+0000 7f4b60381700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b5809e870 0x7f4b5809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:07.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.211+0000 7f4b60381700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4b5809f180 0x7f4b58131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:07.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.211+0000 7f4b60381700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b58131d70 0x7f4b58132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:07.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.211+0000 7f4b60381700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b580a0920 con 0x7f4b5809f180 2023-09-30T22:21:07.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.211+0000 7f4b60381700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5809c970 con 0x7f4b5809e870 2023-09-30T22:21:07.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.211+0000 7f4b60381700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5809bab0 con 0x7f4b58131d70 2023-09-30T22:21:07.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.211+0000 7f4b5e11d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b5809e870 0x7f4b5809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:07.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.211+0000 7f4b5d91c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4b5809f180 0x7f4b58131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:07.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.211+0000 7f4b5d91c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4b5809f180 0x7f4b58131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34232/0 (socket says 172.21.15.156:34232) 2023-09-30T22:21:07.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.211+0000 7f4b5d91c700 1 -- 172.21.15.156:0/2288802037 learned_addr learned my addr 172.21.15.156:0/2288802037 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:07.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.211+0000 7f4b5e11d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b5809e870 0x7f4b5809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44270/0 (socket says 172.21.15.156:44270) 2023-09-30T22:21:07.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.211+0000 7f4b5e91e700 1 --2- 172.21.15.156:0/2288802037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b58131d70 0x7f4b58132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:07.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.212+0000 7f4b5d91c700 1 -- 172.21.15.156:0/2288802037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b58131d70 msgr2=0x7f4b58132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:07.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.212+0000 7f4b5d91c700 1 --2- 172.21.15.156:0/2288802037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b58131d70 0x7f4b58132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.212+0000 7f4b5d91c700 1 -- 172.21.15.156:0/2288802037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b5809e870 msgr2=0x7f4b5809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:07.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.212+0000 7f4b5d91c700 1 --2- 172.21.15.156:0/2288802037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b5809e870 0x7f4b5809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.212+0000 7f4b5d91c700 1 -- 172.21.15.156:0/2288802037 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5809f9c0 con 0x7f4b5809f180 2023-09-30T22:21:07.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.212+0000 7f4b5e11d700 1 --2- 172.21.15.156:0/2288802037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b5809e870 0x7f4b5809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:07.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.212+0000 7f4b5d91c700 1 --2- 172.21.15.156:0/2288802037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b5809f180 0x7f4b58131830 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4b4800dd40 tx=0x7f4b4800f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51e9b456450ee19 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:07.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.212+0000 7f4b5d11b700 1 -- 172.21.15.156:0/2288802037 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b48012070 con 0x7f4b5809f180 2023-09-30T22:21:07.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.212+0000 7f4b5d11b700 1 -- 172.21.15.156:0/2288802037 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4800de90 con 0x7f4b5809f180 2023-09-30T22:21:07.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.212+0000 7f4b5d11b700 1 -- 172.21.15.156:0/2288802037 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4800faf0 con 0x7f4b5809f180 2023-09-30T22:21:07.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.212+0000 7f4b60381700 1 -- 172.21.15.156:0/2288802037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b5809f180 msgr2=0x7f4b58131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:07.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.212+0000 7f4b60381700 1 --2- 172.21.15.156:0/2288802037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b5809f180 0x7f4b58131830 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4b4800dd40 tx=0x7f4b4800f330 comp rx=0 tx=0).stop 2023-09-30T22:21:07.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.213+0000 7f4b60381700 1 -- 172.21.15.156:0/2288802037 shutdown_connections 2023-09-30T22:21:07.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.213+0000 7f4b60381700 1 --2- 172.21.15.156:0/2288802037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b58131d70 0x7f4b58132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.213+0000 7f4b60381700 1 --2- 172.21.15.156:0/2288802037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b5809e870 0x7f4b5809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.213+0000 7f4b60381700 1 --2- 172.21.15.156:0/2288802037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b5809f180 0x7f4b58131830 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.213+0000 7f4b60381700 1 -- 172.21.15.156:0/2288802037 >> 172.21.15.156:0/2288802037 conn(0x7f4b580a4430 msgr2=0x7f4b580a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:07.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.213+0000 7f4b60381700 1 -- 172.21.15.156:0/2288802037 shutdown_connections 2023-09-30T22:21:07.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.213+0000 7f4b60381700 1 -- 172.21.15.156:0/2288802037 wait complete. 2023-09-30T22:21:07.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.214+0000 7f4b60381700 1 Processor -- start 2023-09-30T22:21:07.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.214+0000 7f4b60381700 1 -- start start 2023-09-30T22:21:07.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.214+0000 7f4b60381700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b5809e870 0x7f4b58071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:07.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.214+0000 7f4b60381700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b5809f180 0x7f4b58071640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:07.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.214+0000 7f4b60381700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b58131d70 0x7f4b58071b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:07.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.214+0000 7f4b60381700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5811d310 con 0x7f4b5809f180 2023-09-30T22:21:07.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.214+0000 7f4b60381700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5811aa40 con 0x7f4b5809e870 2023-09-30T22:21:07.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.214+0000 7f4b60381700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5811b060 con 0x7f4b58131d70 2023-09-30T22:21:07.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.214+0000 7f4b5e11d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b5809e870 0x7f4b58071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:07.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.214+0000 7f4b5d91c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b5809f180 0x7f4b58071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:07.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.214+0000 7f4b5e11d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b5809e870 0x7f4b58071100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44282/0 (socket says 172.21.15.156:44282) 2023-09-30T22:21:07.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.214+0000 7f4b5e11d700 1 -- 172.21.15.156:0/207925208 learned_addr learned my addr 172.21.15.156:0/207925208 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:07.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.215+0000 7f4b5e91e700 1 --2- 172.21.15.156:0/207925208 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b58131d70 0x7f4b58071b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:07.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.215+0000 7f4b5d91c700 1 -- 172.21.15.156:0/207925208 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b58131d70 msgr2=0x7f4b58071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:07.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.215+0000 7f4b5d91c700 1 --2- 172.21.15.156:0/207925208 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b58131d70 0x7f4b58071b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.215+0000 7f4b5d91c700 1 -- 172.21.15.156:0/207925208 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b5809e870 msgr2=0x7f4b58071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:07.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.215+0000 7f4b5d91c700 1 --2- 172.21.15.156:0/207925208 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b5809e870 0x7f4b58071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.215+0000 7f4b5d91c700 1 -- 172.21.15.156:0/207925208 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b540094a0 con 0x7f4b5809f180 2023-09-30T22:21:07.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.215+0000 7f4b5e11d700 1 --2- 172.21.15.156:0/207925208 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b5809e870 0x7f4b58071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:07.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.215+0000 7f4b5d91c700 1 --2- 172.21.15.156:0/207925208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b5809f180 0x7f4b58071640 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4b580673f0 tx=0x7f4b48004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:07.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.215+0000 7f4b4effd700 1 -- 172.21.15.156:0/207925208 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b48010e70 con 0x7f4b5809f180 2023-09-30T22:21:07.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.215+0000 7f4b4effd700 1 -- 172.21.15.156:0/207925208 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b480036a0 con 0x7f4b5809f180 2023-09-30T22:21:07.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.215+0000 7f4b60381700 1 -- 172.21.15.156:0/207925208 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b4800d9f0 con 0x7f4b5809f180 2023-09-30T22:21:07.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.215+0000 7f4b4effd700 1 -- 172.21.15.156:0/207925208 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b48003a50 con 0x7f4b5809f180 2023-09-30T22:21:07.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.215+0000 7f4b60381700 1 -- 172.21.15.156:0/207925208 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5811c0e0 con 0x7f4b5809f180 2023-09-30T22:21:07.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.216+0000 7f4b4effd700 1 -- 172.21.15.156:0/207925208 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b48003bb0 con 0x7f4b5809f180 2023-09-30T22:21:07.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.216+0000 7f4b4effd700 1 -- 172.21.15.156:0/207925208 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4b48044b00 con 0x7f4b5809f180 2023-09-30T22:21:07.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.217+0000 7f4b60381700 1 -- 172.21.15.156:0/207925208 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b580a2c10 con 0x7f4b5809f180 2023-09-30T22:21:07.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.221+0000 7f4b4effd700 1 -- 172.21.15.156:0/207925208 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b4800b450 con 0x7f4b5809f180 2023-09-30T22:21:07.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.354+0000 7f99d6845700 1 -- 172.21.15.156:0/3186428112 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f99d004f2a0 con 0x7f99d0136960 2023-09-30T22:21:07.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.355+0000 7f99ccff9700 1 -- 172.21.15.156:0/3186428112 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f99c40223d0 con 0x7f99d0136960 2023-09-30T22:21:07.356 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:07.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.357+0000 7f99d6845700 1 -- 172.21.15.156:0/3186428112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99d0136960 msgr2=0x7f99d0071d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:07.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.357+0000 7f99d6845700 1 --2- 172.21.15.156:0/3186428112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99d0136960 0x7f99d0071d90 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f99c4014040 tx=0x7f99c4004750 comp rx=0 tx=0).stop 2023-09-30T22:21:07.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.357+0000 7f99d6845700 1 -- 172.21.15.156:0/3186428112 shutdown_connections 2023-09-30T22:21:07.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.357+0000 7f99d6845700 1 --2- 172.21.15.156:0/3186428112 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99d0139280 0x7f99d01c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.357+0000 7f99d6845700 1 --2- 172.21.15.156:0/3186428112 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99d0133ad0 0x7f99d0071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.357+0000 7f99d6845700 1 --2- 172.21.15.156:0/3186428112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99d0136960 0x7f99d0071d90 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.357+0000 7f99d6845700 1 -- 172.21.15.156:0/3186428112 >> 172.21.15.156:0/3186428112 conn(0x7f99d0099c40 msgr2=0x7f99d0134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:07.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.357+0000 7f99d6845700 1 -- 172.21.15.156:0/3186428112 shutdown_connections 2023-09-30T22:21:07.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.357+0000 7f99d6845700 1 -- 172.21.15.156:0/3186428112 wait complete. 2023-09-30T22:21:07.375 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:07.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.401+0000 7f6ec04a6700 1 -- 172.21.15.156:0/2125949508 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6eb811ff20 con 0x7f6eb81300a0 2023-09-30T22:21:07.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.401+0000 7f6eaeffd700 1 -- 172.21.15.156:0/2125949508 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6eb811ff20 con 0x7f6eb81300a0 2023-09-30T22:21:07.402 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:07.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.404+0000 7f6ec04a6700 1 -- 172.21.15.156:0/2125949508 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6eb81300a0 msgr2=0x7f6eb811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:07.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.404+0000 7f6ec04a6700 1 --2- 172.21.15.156:0/2125949508 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6eb81300a0 0x7f6eb811da40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4009c40 tx=0x7f6eb4004750 comp rx=0 tx=0).stop 2023-09-30T22:21:07.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.405+0000 7f6ec04a6700 1 -- 172.21.15.156:0/2125949508 shutdown_connections 2023-09-30T22:21:07.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.405+0000 7f6ec04a6700 1 --2- 172.21.15.156:0/2125949508 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6eb8133ad0 0x7f6eb811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.405+0000 7f6ec04a6700 1 --2- 172.21.15.156:0/2125949508 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6eb81300a0 0x7f6eb811da40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.405+0000 7f6ec04a6700 1 --2- 172.21.15.156:0/2125949508 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6eb81309f0 0x7f6eb811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.405+0000 7f6ec04a6700 1 -- 172.21.15.156:0/2125949508 >> 172.21.15.156:0/2125949508 conn(0x7f6eb8099c40 msgr2=0x7f6eb812f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:07.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.405+0000 7f6ec04a6700 1 -- 172.21.15.156:0/2125949508 shutdown_connections 2023-09-30T22:21:07.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.405+0000 7f6ec04a6700 1 -- 172.21.15.156:0/2125949508 wait complete. 2023-09-30T22:21:07.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:07.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.422+0000 7f4b60381700 1 -- 172.21.15.156:0/207925208 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4b580a0210 con 0x7f4b5809f180 2023-09-30T22:21:07.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.423+0000 7f4b4effd700 1 -- 172.21.15.156:0/207925208 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b48015b80 con 0x7f4b5809f180 2023-09-30T22:21:07.423 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:07.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.425+0000 7f4b60381700 1 -- 172.21.15.156:0/207925208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b5809f180 msgr2=0x7f4b58071640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:07.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.425+0000 7f4b60381700 1 --2- 172.21.15.156:0/207925208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b5809f180 0x7f4b58071640 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4b580673f0 tx=0x7f4b48004750 comp rx=0 tx=0).stop 2023-09-30T22:21:07.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.425+0000 7f4b60381700 1 -- 172.21.15.156:0/207925208 shutdown_connections 2023-09-30T22:21:07.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.425+0000 7f4b60381700 1 --2- 172.21.15.156:0/207925208 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b58131d70 0x7f4b58071b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.425+0000 7f4b60381700 1 --2- 172.21.15.156:0/207925208 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b5809e870 0x7f4b58071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.425+0000 7f4b60381700 1 --2- 172.21.15.156:0/207925208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b5809f180 0x7f4b58071640 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:07.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.425+0000 7f4b60381700 1 -- 172.21.15.156:0/207925208 >> 172.21.15.156:0/207925208 conn(0x7f4b580a4430 msgr2=0x7f4b5812de50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:07.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.425+0000 7f4b60381700 1 -- 172.21.15.156:0/207925208 shutdown_connections 2023-09-30T22:21:07.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:07.425+0000 7f4b60381700 1 -- 172.21.15.156:0/207925208 wait complete. 2023-09-30T22:21:07.437 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:08.126 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:08.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.258+0000 7ffbce113700 1 Processor -- start 2023-09-30T22:21:08.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.258+0000 7ffbce113700 1 -- start start 2023-09-30T22:21:08.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.259+0000 7ffbce113700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ffbc809f350 0x7ffbc8138f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:08.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.259+0000 7ffbce113700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffbc8139480 0x7ffbc813b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:08.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.259+0000 7ffbce113700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc806bec0 con 0x7ffbc809e870 2023-09-30T22:21:08.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.259+0000 7ffbce113700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc806ce60 con 0x7ffbc809f350 2023-09-30T22:21:08.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.259+0000 7ffbce113700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc809fa00 con 0x7ffbc8139480 2023-09-30T22:21:08.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.259+0000 7ffbc6ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ffbc809f350 0x7ffbc8138f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:08.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.259+0000 7ffbc7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffbc8139480 0x7ffbc813b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:08.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.259+0000 7ffbc7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffbc8139480 0x7ffbc813b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44290/0 (socket says 172.21.15.156:44290) 2023-09-30T22:21:08.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.259+0000 7ffbc77fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ffbc809e870 0x7ffbc809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53154/0 (socket says 172.21.15.156:53154) 2023-09-30T22:21:08.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.259+0000 7ffbc6ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ffbc809f350 0x7ffbc8138f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34244/0 (socket says 172.21.15.156:34244) 2023-09-30T22:21:08.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.259+0000 7ffbc7fff700 1 -- 172.21.15.156:0/465235774 learned_addr learned my addr 172.21.15.156:0/465235774 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:08.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.259+0000 7ffbc6ffd700 1 -- 172.21.15.156:0/465235774 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffbc8139480 msgr2=0x7ffbc813b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:08.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.259+0000 7ffbc6ffd700 1 --2- 172.21.15.156:0/465235774 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffbc8139480 0x7ffbc813b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.259+0000 7ffbc6ffd700 1 -- 172.21.15.156:0/465235774 >> v1:172.21.15.156:6789/0 conn(0x7ffbc809e870 legacy=0x7ffbc809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:08.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.259+0000 7ffbc6ffd700 1 -- 172.21.15.156:0/465235774 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc809ad80 con 0x7ffbc809f350 2023-09-30T22:21:08.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.259+0000 7ffbc67fc700 1 -- 172.21.15.156:0/465235774 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1102529091 0 0) 0x7ffbc806bec0 con 0x7ffbc809e870 2023-09-30T22:21:08.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.259+0000 7ffbc7fff700 1 --2- 172.21.15.156:0/465235774 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffbc8139480 0x7ffbc813b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:08.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.259+0000 7ffbc6ffd700 1 --2- 172.21.15.156:0/465235774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc809f350 0x7ffbc8138f40 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009840 tx=0x7ffbb8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50dd28e08bdcde2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:08.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.259+0000 7ffbc67fc700 1 -- 172.21.15.156:0/465235774 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8011830 con 0x7ffbc809f350 2023-09-30T22:21:08.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.259+0000 7ffbc67fc700 1 -- 172.21.15.156:0/465235774 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb8011990 con 0x7ffbc809f350 2023-09-30T22:21:08.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.259+0000 7ffbc67fc700 1 -- 172.21.15.156:0/465235774 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8011d20 con 0x7ffbc809f350 2023-09-30T22:21:08.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.260+0000 7ffbce113700 1 -- 172.21.15.156:0/465235774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc809f350 msgr2=0x7ffbc8138f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:08.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.260+0000 7ffbce113700 1 --2- 172.21.15.156:0/465235774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc809f350 0x7ffbc8138f40 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009840 tx=0x7ffbb8009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:08.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.260+0000 7ffbce113700 1 -- 172.21.15.156:0/465235774 shutdown_connections 2023-09-30T22:21:08.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.260+0000 7ffbce113700 1 --2- 172.21.15.156:0/465235774 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffbc8139480 0x7ffbc813b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.260+0000 7ffbce113700 1 --2- 172.21.15.156:0/465235774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc809f350 0x7ffbc8138f40 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.260+0000 7ffbce113700 1 -- 172.21.15.156:0/465235774 >> 172.21.15.156:0/465235774 conn(0x7ffbc80a4430 msgr2=0x7ffbc80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:08.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.260+0000 7ffbce113700 1 -- 172.21.15.156:0/465235774 shutdown_connections 2023-09-30T22:21:08.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.260+0000 7ffbce113700 1 -- 172.21.15.156:0/465235774 wait complete. 2023-09-30T22:21:08.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.261+0000 7ffbce113700 1 Processor -- start 2023-09-30T22:21:08.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.261+0000 7ffbce113700 1 -- start start 2023-09-30T22:21:08.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.262+0000 7ffbce113700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc809e870 0x7ffbc8120800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:08.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.262+0000 7ffbce113700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffbc809f350 0x7ffbc8120d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:08.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.262+0000 7ffbce113700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffbc8139480 0x7ffbc8121280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:08.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.262+0000 7ffbce113700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc81236d0 con 0x7ffbc809e870 2023-09-30T22:21:08.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.262+0000 7ffbce113700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc8123d80 con 0x7ffbc8139480 2023-09-30T22:21:08.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.262+0000 7ffbce113700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc806cfa0 con 0x7ffbc809f350 2023-09-30T22:21:08.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.262+0000 7ffbc77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc809e870 0x7ffbc8120800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:08.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.262+0000 7ffbc77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc809e870 0x7ffbc8120800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34252/0 (socket says 172.21.15.156:34252) 2023-09-30T22:21:08.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.262+0000 7ffbc77fe700 1 -- 172.21.15.156:0/283251057 learned_addr learned my addr 172.21.15.156:0/283251057 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:08.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.262+0000 7ffbc6ffd700 1 --2- 172.21.15.156:0/283251057 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffbc809f350 0x7ffbc8120d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:08.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.262+0000 7ffbc7fff700 1 --2- 172.21.15.156:0/283251057 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffbc8139480 0x7ffbc8121280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:08.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.262+0000 7ffbc77fe700 1 -- 172.21.15.156:0/283251057 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffbc809f350 msgr2=0x7ffbc8120d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:08.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.262+0000 7ffbc77fe700 1 --2- 172.21.15.156:0/283251057 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffbc809f350 0x7ffbc8120d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.262+0000 7ffbc77fe700 1 -- 172.21.15.156:0/283251057 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffbc8139480 msgr2=0x7ffbc8121280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:08.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.262+0000 7ffbc77fe700 1 --2- 172.21.15.156:0/283251057 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffbc8139480 0x7ffbc8121280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.262+0000 7ffbc77fe700 1 -- 172.21.15.156:0/283251057 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc0009b30 con 0x7ffbc809e870 2023-09-30T22:21:08.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.262+0000 7ffbc7fff700 1 --2- 172.21.15.156:0/283251057 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffbc8139480 0x7ffbc8121280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:08.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.262+0000 7ffbc6ffd700 1 --2- 172.21.15.156:0/283251057 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffbc809f350 0x7ffbc8120d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:08.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.262+0000 7ffbc77fe700 1 --2- 172.21.15.156:0/283251057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc809e870 0x7ffbc8120800 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000c520 tx=0x7ffbb000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:08.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.262+0000 7ffbbffff700 1 -- 172.21.15.156:0/283251057 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0004c80 con 0x7ffbc809e870 2023-09-30T22:21:08.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.262+0000 7ffbbffff700 1 -- 172.21.15.156:0/283251057 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb0004e00 con 0x7ffbc809e870 2023-09-30T22:21:08.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.262+0000 7ffbce113700 1 -- 172.21.15.156:0/283251057 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb80094a0 con 0x7ffbc809e870 2023-09-30T22:21:08.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.262+0000 7ffbbffff700 1 -- 172.21.15.156:0/283251057 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0007310 con 0x7ffbc809e870 2023-09-30T22:21:08.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.262+0000 7ffbce113700 1 -- 172.21.15.156:0/283251057 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc8124ab0 con 0x7ffbc809e870 2023-09-30T22:21:08.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.263+0000 7ffbbffff700 1 -- 172.21.15.156:0/283251057 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffbb0007470 con 0x7ffbc809e870 2023-09-30T22:21:08.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.263+0000 7ffbbffff700 1 -- 172.21.15.156:0/283251057 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffbb003f3f0 con 0x7ffbc809e870 2023-09-30T22:21:08.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.263+0000 7ffbce113700 1 -- 172.21.15.156:0/283251057 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc804f2a0 con 0x7ffbc809e870 2023-09-30T22:21:08.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.268+0000 7ffbbffff700 1 -- 172.21.15.156:0/283251057 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffbb00123b0 con 0x7ffbc809e870 2023-09-30T22:21:08.376 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:08.422 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:08.438 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:08.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.457+0000 7ffbce113700 1 -- 172.21.15.156:0/283251057 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffbc8136a30 con 0x7ffbc809e870 2023-09-30T22:21:08.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.457+0000 7ffbbffff700 1 -- 172.21.15.156:0/283251057 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffbb0011360 con 0x7ffbc809e870 2023-09-30T22:21:08.458 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:08.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.459+0000 7ffbce113700 1 -- 172.21.15.156:0/283251057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc809e870 msgr2=0x7ffbc8120800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:08.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.459+0000 7ffbce113700 1 --2- 172.21.15.156:0/283251057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc809e870 0x7ffbc8120800 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000c520 tx=0x7ffbb000c830 comp rx=0 tx=0).stop 2023-09-30T22:21:08.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.460+0000 7ffbce113700 1 -- 172.21.15.156:0/283251057 shutdown_connections 2023-09-30T22:21:08.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.460+0000 7ffbce113700 1 --2- 172.21.15.156:0/283251057 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffbc8139480 0x7ffbc8121280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.460+0000 7ffbce113700 1 --2- 172.21.15.156:0/283251057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc809e870 0x7ffbc8120800 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.460+0000 7ffbce113700 1 --2- 172.21.15.156:0/283251057 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffbc809f350 0x7ffbc8120d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.460+0000 7ffbce113700 1 -- 172.21.15.156:0/283251057 >> 172.21.15.156:0/283251057 conn(0x7ffbc80a4430 msgr2=0x7ffbc80a1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:08.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.460+0000 7ffbce113700 1 -- 172.21.15.156:0/283251057 shutdown_connections 2023-09-30T22:21:08.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.460+0000 7ffbce113700 1 -- 172.21.15.156:0/283251057 wait complete. 2023-09-30T22:21:08.475 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:08.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.504+0000 7ff7d5764700 1 Processor -- start 2023-09-30T22:21:08.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.504+0000 7ff7d5764700 1 -- start start 2023-09-30T22:21:08.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.505+0000 7ff7d5764700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff7d0099a60 0x7ff7d01388f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:08.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.505+0000 7ff7d5764700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7d0138e30 0x7ff7d013b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:08.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.505+0000 7ff7d5764700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d009aa00 con 0x7ff7d0133b80 2023-09-30T22:21:08.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.505+0000 7ff7d5764700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7d009a080 con 0x7ff7d0099a60 2023-09-30T22:21:08.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.505+0000 7ff7d5764700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d0133750 con 0x7ff7d0138e30 2023-09-30T22:21:08.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.505+0000 7ff7ceffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff7d0133b80 0x7ff7d0133f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53168/0 (socket says 172.21.15.156:53168) 2023-09-30T22:21:08.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.505+0000 7ff7ceffd700 1 -- 172.21.15.156:0/1489504346 learned_addr learned my addr 172.21.15.156:0/1489504346 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:08.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.505+0000 7ff7ce7fc700 1 --2- 172.21.15.156:0/1489504346 >> v2:172.21.15.156:3300/0 conn(0x7ff7d0099a60 0x7ff7d01388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:08.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.505+0000 7ff7cf7fe700 1 --2- 172.21.15.156:0/1489504346 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7d0138e30 0x7ff7d013b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:08.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.505+0000 7ff7ce7fc700 1 -- 172.21.15.156:0/1489504346 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7d0138e30 msgr2=0x7ff7d013b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:08.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.505+0000 7ff7ce7fc700 1 --2- 172.21.15.156:0/1489504346 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7d0138e30 0x7ff7d013b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.505+0000 7ff7ce7fc700 1 -- 172.21.15.156:0/1489504346 >> v1:172.21.15.156:6789/0 conn(0x7ff7d0133b80 legacy=0x7ff7d0133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:08.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.506+0000 7ff7ce7fc700 1 -- 172.21.15.156:0/1489504346 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d009a760 con 0x7ff7d0099a60 2023-09-30T22:21:08.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.506+0000 7ff7cdffb700 1 -- 172.21.15.156:0/1489504346 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184496761 0 0) 0x7ff7d009aa00 con 0x7ff7d0133b80 2023-09-30T22:21:08.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.506+0000 7ff7ce7fc700 1 --2- 172.21.15.156:0/1489504346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7d0099a60 0x7ff7d01388f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4009840 tx=0x7ff7c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78115655143236f9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:08.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.506+0000 7ff7cdffb700 1 -- 172.21.15.156:0/1489504346 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c4011830 con 0x7ff7d0099a60 2023-09-30T22:21:08.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.506+0000 7ff7cdffb700 1 -- 172.21.15.156:0/1489504346 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c4011990 con 0x7ff7d0099a60 2023-09-30T22:21:08.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.506+0000 7ff7cdffb700 1 -- 172.21.15.156:0/1489504346 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c4011d20 con 0x7ff7d0099a60 2023-09-30T22:21:08.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.506+0000 7ff7d5764700 1 -- 172.21.15.156:0/1489504346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7d0099a60 msgr2=0x7ff7d01388f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:08.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.506+0000 7ff7d5764700 1 --2- 172.21.15.156:0/1489504346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7d0099a60 0x7ff7d01388f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4009840 tx=0x7ff7c4009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:08.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.507+0000 7ff7d5764700 1 -- 172.21.15.156:0/1489504346 shutdown_connections 2023-09-30T22:21:08.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.507+0000 7ff7d5764700 1 --2- 172.21.15.156:0/1489504346 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7d0138e30 0x7ff7d013b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.507+0000 7ff7d5764700 1 --2- 172.21.15.156:0/1489504346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7d0099a60 0x7ff7d01388f0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.507+0000 7ff7d5764700 1 -- 172.21.15.156:0/1489504346 >> 172.21.15.156:0/1489504346 conn(0x7ff7d00a2980 msgr2=0x7ff7d00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:08.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.507+0000 7ff7d5764700 1 -- 172.21.15.156:0/1489504346 shutdown_connections 2023-09-30T22:21:08.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.507+0000 7ff7d5764700 1 -- 172.21.15.156:0/1489504346 wait complete. 2023-09-30T22:21:08.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.508+0000 7ff7d5764700 1 Processor -- start 2023-09-30T22:21:08.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.508+0000 7ff7d5764700 1 -- start start 2023-09-30T22:21:08.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.508+0000 7ff7d5764700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7d0099a60 0x7ff7d0118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:08.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.508+0000 7ff7d5764700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7d0133b80 0x7ff7d0119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:08.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.508+0000 7ff7d5764700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7d0138e30 0x7ff7d0119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:08.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.508+0000 7ff7d5764700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d011c020 con 0x7ff7d0133b80 2023-09-30T22:21:08.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.508+0000 7ff7d5764700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d011b110 con 0x7ff7d0099a60 2023-09-30T22:21:08.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.508+0000 7ff7d5764700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d011b3d0 con 0x7ff7d0138e30 2023-09-30T22:21:08.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.508+0000 7ff7ceffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7d0099a60 0x7ff7d0118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:08.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.508+0000 7ff7ceffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7d0099a60 0x7ff7d0118df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44300/0 (socket says 172.21.15.156:44300) 2023-09-30T22:21:08.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.508+0000 7ff7ceffd700 1 -- 172.21.15.156:0/1533687790 learned_addr learned my addr 172.21.15.156:0/1533687790 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:08.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.508+0000 7ff7cf7fe700 1 --2- 172.21.15.156:0/1533687790 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7d0138e30 0x7ff7d0119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:08.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.508+0000 7ff7ce7fc700 1 --2- 172.21.15.156:0/1533687790 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7d0133b80 0x7ff7d0119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:08.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.509+0000 7ff7ceffd700 1 -- 172.21.15.156:0/1533687790 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7d0138e30 msgr2=0x7ff7d0119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:08.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.509+0000 7ff7ceffd700 1 --2- 172.21.15.156:0/1533687790 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7d0138e30 0x7ff7d0119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.509+0000 7ff7ceffd700 1 -- 172.21.15.156:0/1533687790 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7d0133b80 msgr2=0x7ff7d0119330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:08.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.509+0000 7ff7ceffd700 1 --2- 172.21.15.156:0/1533687790 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7d0133b80 0x7ff7d0119330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.509+0000 7ff7ceffd700 1 -- 172.21.15.156:0/1533687790 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c40094a0 con 0x7ff7d0099a60 2023-09-30T22:21:08.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.509+0000 7ff7ce7fc700 1 --2- 172.21.15.156:0/1533687790 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7d0133b80 0x7ff7d0119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:08.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.509+0000 7ff7ceffd700 1 --2- 172.21.15.156:0/1533687790 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7d0099a60 0x7ff7d0118df0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000c6d0 tx=0x7ff7c000c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:08.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.509+0000 7ff7b77fe700 1 -- 172.21.15.156:0/1533687790 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c00074e0 con 0x7ff7d0099a60 2023-09-30T22:21:08.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.509+0000 7ff7b77fe700 1 -- 172.21.15.156:0/1533687790 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c0007640 con 0x7ff7d0099a60 2023-09-30T22:21:08.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.509+0000 7ff7b77fe700 1 -- 172.21.15.156:0/1533687790 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0005a70 con 0x7ff7d0099a60 2023-09-30T22:21:08.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.509+0000 7ff7d5764700 1 -- 172.21.15.156:0/1533687790 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d0137730 con 0x7ff7d0099a60 2023-09-30T22:21:08.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.509+0000 7ff7d5764700 1 -- 172.21.15.156:0/1533687790 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d011a0c0 con 0x7ff7d0099a60 2023-09-30T22:21:08.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.510+0000 7ff7b77fe700 1 -- 172.21.15.156:0/1533687790 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff7c0005bd0 con 0x7ff7d0099a60 2023-09-30T22:21:08.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.510+0000 7ff7b77fe700 1 -- 172.21.15.156:0/1533687790 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff7c003eb40 con 0x7ff7d0099a60 2023-09-30T22:21:08.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.510+0000 7ff7d5764700 1 -- 172.21.15.156:0/1533687790 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7d004f2a0 con 0x7ff7d0099a60 2023-09-30T22:21:08.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.515+0000 7ff7b77fe700 1 -- 172.21.15.156:0/1533687790 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff7c0018260 con 0x7ff7d0099a60 2023-09-30T22:21:08.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.554+0000 7f5f3617b700 1 Processor -- start 2023-09-30T22:21:08.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.554+0000 7f5f3617b700 1 -- start start 2023-09-30T22:21:08.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.554+0000 7f5f3617b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f3009ef80 0x7f5f30138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:08.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.554+0000 7f5f3617b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f3009f370 0x7f5f3013b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:08.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.554+0000 7f5f3617b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3009af80 con 0x7f5f3009a150 2023-09-30T22:21:08.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.554+0000 7f5f3617b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3009a520 con 0x7f5f3009ef80 2023-09-30T22:21:08.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.554+0000 7f5f3617b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3009fe00 con 0x7f5f3009f370 2023-09-30T22:21:08.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.554+0000 7f5f26ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f3009ef80 0x7f5f30138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:08.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.554+0000 7f5f26ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f3009ef80 0x7f5f30138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44304/0 (socket says 172.21.15.156:44304) 2023-09-30T22:21:08.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.554+0000 7f5f26ffd700 1 -- 172.21.15.156:0/2490495185 learned_addr learned my addr 172.21.15.156:0/2490495185 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:08.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.554+0000 7f5f2ffff700 1 --2- 172.21.15.156:0/2490495185 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f3009f370 0x7f5f3013b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:08.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.555+0000 7f5f26ffd700 1 -- 172.21.15.156:0/2490495185 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f3009f370 msgr2=0x7f5f3013b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:08.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.555+0000 7f5f26ffd700 1 --2- 172.21.15.156:0/2490495185 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f3009f370 0x7f5f3013b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.555+0000 7f5f26ffd700 1 -- 172.21.15.156:0/2490495185 >> v1:172.21.15.156:6789/0 conn(0x7f5f3009a150 legacy=0x7f5f3009e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:08.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.555+0000 7f5f26ffd700 1 -- 172.21.15.156:0/2490495185 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3006bc20 con 0x7f5f3009ef80 2023-09-30T22:21:08.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.555+0000 7f5f26ffd700 1 --2- 172.21.15.156:0/2490495185 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f3009ef80 0x7f5f30138e60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5f18009920 tx=0x7f5f18009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95b57724226e4183 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:08.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.555+0000 7f5f2effd700 1 -- 172.21.15.156:0/2490495185 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f18011830 con 0x7f5f3009ef80 2023-09-30T22:21:08.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.555+0000 7f5f2effd700 1 -- 172.21.15.156:0/2490495185 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f18011990 con 0x7f5f3009ef80 2023-09-30T22:21:08.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.555+0000 7f5f2effd700 1 -- 172.21.15.156:0/2490495185 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f18011d20 con 0x7f5f3009ef80 2023-09-30T22:21:08.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.556+0000 7f5f3617b700 1 -- 172.21.15.156:0/2490495185 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f3009ef80 msgr2=0x7f5f30138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:08.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.556+0000 7f5f3617b700 1 --2- 172.21.15.156:0/2490495185 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f3009ef80 0x7f5f30138e60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5f18009920 tx=0x7f5f18009c30 comp rx=0 tx=0).stop 2023-09-30T22:21:08.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.556+0000 7f5f3617b700 1 -- 172.21.15.156:0/2490495185 shutdown_connections 2023-09-30T22:21:08.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.556+0000 7f5f3617b700 1 --2- 172.21.15.156:0/2490495185 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f3009f370 0x7f5f3013b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.556+0000 7f5f3617b700 1 --2- 172.21.15.156:0/2490495185 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f3009ef80 0x7f5f30138e60 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.556+0000 7f5f3617b700 1 -- 172.21.15.156:0/2490495185 >> 172.21.15.156:0/2490495185 conn(0x7f5f300a4430 msgr2=0x7f5f300a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:08.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.556+0000 7f5f3617b700 1 -- 172.21.15.156:0/2490495185 shutdown_connections 2023-09-30T22:21:08.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.556+0000 7f5f3617b700 1 -- 172.21.15.156:0/2490495185 wait complete. 2023-09-30T22:21:08.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.557+0000 7f5f3617b700 1 Processor -- start 2023-09-30T22:21:08.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.557+0000 7f5f3617b700 1 -- start start 2023-09-30T22:21:08.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.557+0000 7f5f3617b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f3009a150 0x7f5f30123640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:08.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.557+0000 7f5f3617b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f3009ef80 0x7f5f30123b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:08.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.557+0000 7f5f3617b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f3009f370 0x7f5f301240c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:08.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.557+0000 7f5f3617b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3009bcf0 con 0x7f5f3009f370 2023-09-30T22:21:08.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.557+0000 7f5f3617b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f300a0440 con 0x7f5f3009a150 2023-09-30T22:21:08.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.557+0000 7f5f3617b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f30126870 con 0x7f5f3009ef80 2023-09-30T22:21:08.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.558+0000 7f5f2ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f3009f370 0x7f5f301240c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:08.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.558+0000 7f5f2f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f3009a150 0x7f5f30123640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:08.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.558+0000 7f5f2ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f3009f370 0x7f5f301240c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34264/0 (socket says 172.21.15.156:34264) 2023-09-30T22:21:08.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.558+0000 7f5f2f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f3009a150 0x7f5f30123640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44314/0 (socket says 172.21.15.156:44314) 2023-09-30T22:21:08.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.558+0000 7f5f2ffff700 1 -- 172.21.15.156:0/758113377 learned_addr learned my addr 172.21.15.156:0/758113377 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:08.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.558+0000 7f5f26ffd700 1 --2- 172.21.15.156:0/758113377 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f3009ef80 0x7f5f30123b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:08.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.558+0000 7f5f26ffd700 1 -- 172.21.15.156:0/758113377 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f3009a150 msgr2=0x7f5f30123640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:08.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.558+0000 7f5f26ffd700 1 --2- 172.21.15.156:0/758113377 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f3009a150 0x7f5f30123640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.558+0000 7f5f26ffd700 1 -- 172.21.15.156:0/758113377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f3009f370 msgr2=0x7f5f301240c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:08.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.558+0000 7f5f26ffd700 1 --2- 172.21.15.156:0/758113377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f3009f370 0x7f5f301240c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.558+0000 7f5f26ffd700 1 -- 172.21.15.156:0/758113377 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f18009550 con 0x7f5f3009ef80 2023-09-30T22:21:08.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.558+0000 7f5f2ffff700 1 --2- 172.21.15.156:0/758113377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f3009f370 0x7f5f301240c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:08.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.558+0000 7f5f2f7fe700 1 --2- 172.21.15.156:0/758113377 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f3009a150 0x7f5f30123640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:08.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.558+0000 7f5f26ffd700 1 --2- 172.21.15.156:0/758113377 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f3009ef80 0x7f5f30123b80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5f18009920 tx=0x7f5f18004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:08.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.558+0000 7f5f2cff9700 1 -- 172.21.15.156:0/758113377 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f18004450 con 0x7f5f3009ef80 2023-09-30T22:21:08.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.558+0000 7f5f2cff9700 1 -- 172.21.15.156:0/758113377 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f180045b0 con 0x7f5f3009ef80 2023-09-30T22:21:08.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.558+0000 7f5f2cff9700 1 -- 172.21.15.156:0/758113377 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f180038c0 con 0x7f5f3009ef80 2023-09-30T22:21:08.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.558+0000 7f5f3617b700 1 -- 172.21.15.156:0/758113377 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f30127180 con 0x7f5f3009ef80 2023-09-30T22:21:08.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.558+0000 7f5f3617b700 1 -- 172.21.15.156:0/758113377 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f30126e00 con 0x7f5f3009ef80 2023-09-30T22:21:08.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.559+0000 7f5f2cff9700 1 -- 172.21.15.156:0/758113377 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f18021070 con 0x7f5f3009ef80 2023-09-30T22:21:08.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.559+0000 7f5f3617b700 1 -- 172.21.15.156:0/758113377 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f3009fa30 con 0x7f5f3009ef80 2023-09-30T22:21:08.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.559+0000 7f5f2cff9700 1 -- 172.21.15.156:0/758113377 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5f180404e0 con 0x7f5f3009ef80 2023-09-30T22:21:08.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.564+0000 7f5f2cff9700 1 -- 172.21.15.156:0/758113377 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f1800b7e0 con 0x7f5f3009ef80 2023-09-30T22:21:08.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.592+0000 7f47e5c81700 1 Processor -- start 2023-09-30T22:21:08.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.592+0000 7f47e5c81700 1 -- start start 2023-09-30T22:21:08.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.593+0000 7f47e5c81700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f47e00a0a70 0x7f47e00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:08.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.593+0000 7f47e5c81700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e00a1380 0x7f47e0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:08.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.593+0000 7f47e5c81700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e009dc00 con 0x7f47e0133f50 2023-09-30T22:21:08.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.593+0000 7f47e5c81700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e009ea60 con 0x7f47e00a0a70 2023-09-30T22:21:08.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.593+0000 7f47e5c81700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e009dec0 con 0x7f47e00a1380 2023-09-30T22:21:08.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.593+0000 7f47df7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f47e00a0a70 0x7f47e00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:08.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.593+0000 7f47deffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e00a1380 0x7f47e0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:08.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.593+0000 7f47df7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f47e00a0a70 0x7f47e00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34272/0 (socket says 172.21.15.156:34272) 2023-09-30T22:21:08.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.593+0000 7f47df7fe700 1 -- 172.21.15.156:0/2790052337 learned_addr learned my addr 172.21.15.156:0/2790052337 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:08.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.593+0000 7f47deffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e00a1380 0x7f47e0133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44324/0 (socket says 172.21.15.156:44324) 2023-09-30T22:21:08.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.593+0000 7f47deffd700 1 -- 172.21.15.156:0/2790052337 >> v2:172.21.15.156:3300/0 conn(0x7f47e00a0a70 msgr2=0x7f47e00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:08.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.593+0000 7f47deffd700 1 --2- 172.21.15.156:0/2790052337 >> v2:172.21.15.156:3300/0 conn(0x7f47e00a0a70 0x7f47e00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.593+0000 7f47deffd700 1 -- 172.21.15.156:0/2790052337 >> v1:172.21.15.156:6789/0 conn(0x7f47e0133f50 legacy=0x7f47e013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:08.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.593+0000 7f47deffd700 1 -- 172.21.15.156:0/2790052337 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e009e6a0 con 0x7f47e00a1380 2023-09-30T22:21:08.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.593+0000 7f47deffd700 1 --2- 172.21.15.156:0/2790052337 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e00a1380 0x7f47e0133a10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f47c8009840 tx=0x7f47c8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab9755458a63f3ca server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:08.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.594+0000 7f47de7fc700 1 -- 172.21.15.156:0/2790052337 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c8011830 con 0x7f47e00a1380 2023-09-30T22:21:08.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.594+0000 7f47de7fc700 1 -- 172.21.15.156:0/2790052337 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c8011990 con 0x7f47e00a1380 2023-09-30T22:21:08.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.594+0000 7f47de7fc700 1 -- 172.21.15.156:0/2790052337 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c8011d20 con 0x7f47e00a1380 2023-09-30T22:21:08.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.594+0000 7f47e5c81700 1 -- 172.21.15.156:0/2790052337 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e00a1380 msgr2=0x7f47e0133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:08.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.594+0000 7f47e5c81700 1 --2- 172.21.15.156:0/2790052337 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e00a1380 0x7f47e0133a10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f47c8009840 tx=0x7f47c8009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:08.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.594+0000 7f47e5c81700 1 -- 172.21.15.156:0/2790052337 shutdown_connections 2023-09-30T22:21:08.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.594+0000 7f47e5c81700 1 --2- 172.21.15.156:0/2790052337 >> v2:172.21.15.156:3300/0 conn(0x7f47e00a0a70 0x7f47e00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.594+0000 7f47e5c81700 1 --2- 172.21.15.156:0/2790052337 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e00a1380 0x7f47e0133a10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.594+0000 7f47e5c81700 1 -- 172.21.15.156:0/2790052337 >> 172.21.15.156:0/2790052337 conn(0x7f47e00a6610 msgr2=0x7f47e00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:08.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.594+0000 7f47e5c81700 1 -- 172.21.15.156:0/2790052337 shutdown_connections 2023-09-30T22:21:08.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.594+0000 7f47e5c81700 1 -- 172.21.15.156:0/2790052337 wait complete. 2023-09-30T22:21:08.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.596+0000 7f47e5c81700 1 Processor -- start 2023-09-30T22:21:08.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.596+0000 7f47e5c81700 1 -- start start 2023-09-30T22:21:08.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.597+0000 7f47e5c81700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e00a0a70 0x7f47e01c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:08.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.597+0000 7f47e5c81700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47e00a1380 0x7f47e01c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:08.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.597+0000 7f47e5c81700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47e0133f50 0x7f47e01c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:08.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.597+0000 7f47e5c81700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e01267b0 con 0x7f47e0133f50 2023-09-30T22:21:08.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.597+0000 7f47e5c81700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e0124990 con 0x7f47e00a0a70 2023-09-30T22:21:08.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.597+0000 7f47e5c81700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47e0124dc0 con 0x7f47e00a1380 2023-09-30T22:21:08.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.597+0000 7f47df7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e00a0a70 0x7f47e01c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:08.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.597+0000 7f47df7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e00a0a70 0x7f47e01c83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44328/0 (socket says 172.21.15.156:44328) 2023-09-30T22:21:08.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.597+0000 7f47df7fe700 1 -- 172.21.15.156:0/1563866062 learned_addr learned my addr 172.21.15.156:0/1563866062 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:08.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.597+0000 7f47deffd700 1 --2- 172.21.15.156:0/1563866062 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47e00a1380 0x7f47e01c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:08.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.597+0000 7f47dffff700 1 --2- 172.21.15.156:0/1563866062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47e0133f50 0x7f47e01c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:08.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.597+0000 7f47df7fe700 1 -- 172.21.15.156:0/1563866062 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47e00a1380 msgr2=0x7f47e01c8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:08.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.597+0000 7f47df7fe700 1 --2- 172.21.15.156:0/1563866062 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47e00a1380 0x7f47e01c8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.597+0000 7f47df7fe700 1 -- 172.21.15.156:0/1563866062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47e0133f50 msgr2=0x7f47e01c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:08.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.597+0000 7f47df7fe700 1 --2- 172.21.15.156:0/1563866062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47e0133f50 0x7f47e01c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.597+0000 7f47df7fe700 1 -- 172.21.15.156:0/1563866062 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c80094a0 con 0x7f47e00a0a70 2023-09-30T22:21:08.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.597+0000 7f47dffff700 1 --2- 172.21.15.156:0/1563866062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47e0133f50 0x7f47e01c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:08.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.598+0000 7f47df7fe700 1 --2- 172.21.15.156:0/1563866062 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e00a0a70 0x7f47e01c83f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f47d800e940 tx=0x7f47d800ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:08.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.598+0000 7f47d7fff700 1 -- 172.21.15.156:0/1563866062 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d80096a0 con 0x7f47e00a0a70 2023-09-30T22:21:08.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.598+0000 7f47d7fff700 1 -- 172.21.15.156:0/1563866062 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d8013680 con 0x7f47e00a0a70 2023-09-30T22:21:08.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.598+0000 7f47e5c81700 1 -- 172.21.15.156:0/1563866062 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e00a03e0 con 0x7f47e00a0a70 2023-09-30T22:21:08.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.598+0000 7f47d7fff700 1 -- 172.21.15.156:0/1563866062 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d8013a30 con 0x7f47e00a0a70 2023-09-30T22:21:08.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.598+0000 7f47e5c81700 1 -- 172.21.15.156:0/1563866062 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e01338f0 con 0x7f47e00a0a70 2023-09-30T22:21:08.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.599+0000 7f47d7fff700 1 -- 172.21.15.156:0/1563866062 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f47d8013b90 con 0x7f47e00a0a70 2023-09-30T22:21:08.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.599+0000 7f47d7fff700 1 -- 172.21.15.156:0/1563866062 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f47d803f6b0 con 0x7f47e00a0a70 2023-09-30T22:21:08.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.599+0000 7f47e5c81700 1 -- 172.21.15.156:0/1563866062 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e01260e0 con 0x7f47e00a0a70 2023-09-30T22:21:08.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.608+0000 7f47d7fff700 1 -- 172.21.15.156:0/1563866062 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f47d8017020 con 0x7f47e00a0a70 2023-09-30T22:21:08.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.720+0000 7ff7d5764700 1 -- 172.21.15.156:0/1533687790 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff7d006bce0 con 0x7ff7d0099a60 2023-09-30T22:21:08.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.720+0000 7ff7b77fe700 1 -- 172.21.15.156:0/1533687790 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff7c0017020 con 0x7ff7d0099a60 2023-09-30T22:21:08.721 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:08.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.723+0000 7ff7d5764700 1 -- 172.21.15.156:0/1533687790 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7d0099a60 msgr2=0x7ff7d0118df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:08.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.723+0000 7ff7d5764700 1 --2- 172.21.15.156:0/1533687790 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7d0099a60 0x7ff7d0118df0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000c6d0 tx=0x7ff7c000c9e0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.723+0000 7ff7d5764700 1 -- 172.21.15.156:0/1533687790 shutdown_connections 2023-09-30T22:21:08.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.723+0000 7ff7d5764700 1 --2- 172.21.15.156:0/1533687790 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7d0138e30 0x7ff7d0119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.725 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.723+0000 7ff7d5764700 1 --2- 172.21.15.156:0/1533687790 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7d0099a60 0x7ff7d0118df0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.725 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.723+0000 7ff7d5764700 1 --2- 172.21.15.156:0/1533687790 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7d0133b80 0x7ff7d0119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.725 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.723+0000 7ff7d5764700 1 -- 172.21.15.156:0/1533687790 >> 172.21.15.156:0/1533687790 conn(0x7ff7d00a2980 msgr2=0x7ff7d009b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:08.725 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.723+0000 7ff7d5764700 1 -- 172.21.15.156:0/1533687790 shutdown_connections 2023-09-30T22:21:08.725 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.723+0000 7ff7d5764700 1 -- 172.21.15.156:0/1533687790 wait complete. 2023-09-30T22:21:08.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:08.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.766+0000 7f5f3617b700 1 -- 172.21.15.156:0/758113377 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5f30126a40 con 0x7f5f3009ef80 2023-09-30T22:21:08.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.767+0000 7f5f2cff9700 1 -- 172.21.15.156:0/758113377 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f18028070 con 0x7f5f3009ef80 2023-09-30T22:21:08.768 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:08.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.769+0000 7f5f3617b700 1 -- 172.21.15.156:0/758113377 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f3009ef80 msgr2=0x7f5f30123b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:08.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.769+0000 7f5f3617b700 1 --2- 172.21.15.156:0/758113377 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f3009ef80 0x7f5f30123b80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5f18009920 tx=0x7f5f18004750 comp rx=0 tx=0).stop 2023-09-30T22:21:08.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.769+0000 7f5f3617b700 1 -- 172.21.15.156:0/758113377 shutdown_connections 2023-09-30T22:21:08.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.769+0000 7f5f3617b700 1 --2- 172.21.15.156:0/758113377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f3009f370 0x7f5f301240c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.769+0000 7f5f3617b700 1 --2- 172.21.15.156:0/758113377 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f3009a150 0x7f5f30123640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.769+0000 7f5f3617b700 1 --2- 172.21.15.156:0/758113377 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f3009ef80 0x7f5f30123b80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.769+0000 7f5f3617b700 1 -- 172.21.15.156:0/758113377 >> 172.21.15.156:0/758113377 conn(0x7f5f300a4430 msgr2=0x7f5f300a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:08.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.769+0000 7f5f3617b700 1 -- 172.21.15.156:0/758113377 shutdown_connections 2023-09-30T22:21:08.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.769+0000 7f5f3617b700 1 -- 172.21.15.156:0/758113377 wait complete. 2023-09-30T22:21:08.782 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:08.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.801+0000 7f47e5c81700 1 -- 172.21.15.156:0/1563866062 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f47e01263a0 con 0x7f47e00a0a70 2023-09-30T22:21:08.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.801+0000 7f47d7fff700 1 -- 172.21.15.156:0/1563866062 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f47d801ba00 con 0x7f47e00a0a70 2023-09-30T22:21:08.802 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:08.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.803+0000 7f47e5c81700 1 -- 172.21.15.156:0/1563866062 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e00a0a70 msgr2=0x7f47e01c83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:08.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.803+0000 7f47e5c81700 1 --2- 172.21.15.156:0/1563866062 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e00a0a70 0x7f47e01c83f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f47d800e940 tx=0x7f47d800ec50 comp rx=0 tx=0).stop 2023-09-30T22:21:08.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.803+0000 7f47e5c81700 1 -- 172.21.15.156:0/1563866062 shutdown_connections 2023-09-30T22:21:08.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.803+0000 7f47e5c81700 1 --2- 172.21.15.156:0/1563866062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47e0133f50 0x7f47e01c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.803+0000 7f47e5c81700 1 --2- 172.21.15.156:0/1563866062 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47e00a0a70 0x7f47e01c83f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.803+0000 7f47e5c81700 1 --2- 172.21.15.156:0/1563866062 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47e00a1380 0x7f47e01c8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:08.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.803+0000 7f47e5c81700 1 -- 172.21.15.156:0/1563866062 >> 172.21.15.156:0/1563866062 conn(0x7f47e00a6610 msgr2=0x7f47e00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:08.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.803+0000 7f47e5c81700 1 -- 172.21.15.156:0/1563866062 shutdown_connections 2023-09-30T22:21:08.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:08.803+0000 7f47e5c81700 1 -- 172.21.15.156:0/1563866062 wait complete. 2023-09-30T22:21:08.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:09.476 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:09.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.609+0000 7fafeaf6a700 1 Processor -- start 2023-09-30T22:21:09.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.610+0000 7fafeaf6a700 1 -- start start 2023-09-30T22:21:09.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.610+0000 7fafeaf6a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafe409e870 0x7fafe409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:09.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.610+0000 7fafeaf6a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fafe409f180 0x7fafe4133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:09.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.610+0000 7fafeaf6a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe409fa00 con 0x7fafe4134160 2023-09-30T22:21:09.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.610+0000 7fafeaf6a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe40a0370 con 0x7fafe409e870 2023-09-30T22:21:09.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.610+0000 7fafeaf6a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafe406bec0 con 0x7fafe409f180 2023-09-30T22:21:09.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.610+0000 7fafe3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fafe409f180 0x7fafe4133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:09.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.610+0000 7fafe9507700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fafe4134160 0x7fafe413ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53198/0 (socket says 172.21.15.156:53198) 2023-09-30T22:21:09.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.610+0000 7fafe9507700 1 -- 172.21.15.156:0/31711033 learned_addr learned my addr 172.21.15.156:0/31711033 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:09.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.610+0000 7fafe8d06700 1 --2- 172.21.15.156:0/31711033 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafe409e870 0x7fafe409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:09.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.610+0000 7fafe37fe700 1 -- 172.21.15.156:0/31711033 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48915433 0 0) 0x7fafe409fa00 con 0x7fafe4134160 2023-09-30T22:21:09.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.610+0000 7fafe8d06700 1 -- 172.21.15.156:0/31711033 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fafe409f180 msgr2=0x7fafe4133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:09.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.610+0000 7fafe8d06700 1 --2- 172.21.15.156:0/31711033 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fafe409f180 0x7fafe4133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:09.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.610+0000 7fafe8d06700 1 -- 172.21.15.156:0/31711033 >> v1:172.21.15.156:6789/0 conn(0x7fafe4134160 legacy=0x7fafe413ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:09.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.610+0000 7fafe8d06700 1 -- 172.21.15.156:0/31711033 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe409ada0 con 0x7fafe409e870 2023-09-30T22:21:09.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.610+0000 7fafe3fff700 1 --2- 172.21.15.156:0/31711033 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fafe409f180 0x7fafe4133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:09.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.611+0000 7fafe8d06700 1 --2- 172.21.15.156:0/31711033 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafe409e870 0x7fafe409ec40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fafd8009870 tx=0x7fafd8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=834a527a7bb2d920 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:09.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.611+0000 7fafe37fe700 1 -- 172.21.15.156:0/31711033 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd8011830 con 0x7fafe409e870 2023-09-30T22:21:09.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.611+0000 7fafe37fe700 1 -- 172.21.15.156:0/31711033 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd8011990 con 0x7fafe409e870 2023-09-30T22:21:09.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.611+0000 7fafe37fe700 1 -- 172.21.15.156:0/31711033 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd8011d20 con 0x7fafe409e870 2023-09-30T22:21:09.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.611+0000 7fafeaf6a700 1 -- 172.21.15.156:0/31711033 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafe409e870 msgr2=0x7fafe409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:09.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.611+0000 7fafeaf6a700 1 --2- 172.21.15.156:0/31711033 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafe409e870 0x7fafe409ec40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fafd8009870 tx=0x7fafd8009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:09.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.611+0000 7fafeaf6a700 1 -- 172.21.15.156:0/31711033 shutdown_connections 2023-09-30T22:21:09.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.611+0000 7fafeaf6a700 1 --2- 172.21.15.156:0/31711033 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafe409e870 0x7fafe409ec40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:09.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.611+0000 7fafeaf6a700 1 --2- 172.21.15.156:0/31711033 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fafe409f180 0x7fafe4133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:09.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.611+0000 7fafeaf6a700 1 -- 172.21.15.156:0/31711033 >> 172.21.15.156:0/31711033 conn(0x7fafe40a4430 msgr2=0x7fafe40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:09.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.611+0000 7fafeaf6a700 1 -- 172.21.15.156:0/31711033 shutdown_connections 2023-09-30T22:21:09.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.611+0000 7fafeaf6a700 1 -- 172.21.15.156:0/31711033 wait complete. 2023-09-30T22:21:09.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.612+0000 7fafeaf6a700 1 Processor -- start 2023-09-30T22:21:09.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.612+0000 7fafeaf6a700 1 -- start start 2023-09-30T22:21:09.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.613+0000 7fafeaf6a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fafe409e870 0x7fafe4122a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:09.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.613+0000 7fafeaf6a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafe409f180 0x7fafe4122fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:09.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.613+0000 7fafeaf6a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafe4134160 0x7fafe4123510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:09.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.613+0000 7fafeaf6a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe406cfa0 con 0x7fafe4134160 2023-09-30T22:21:09.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.613+0000 7fafeaf6a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe4124a90 con 0x7fafe409f180 2023-09-30T22:21:09.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.613+0000 7fafeaf6a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafe4127010 con 0x7fafe409e870 2023-09-30T22:21:09.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.613+0000 7fafe3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafe409f180 0x7fafe4122fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:09.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.613+0000 7fafe9507700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafe4134160 0x7fafe4123510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:09.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.613+0000 7fafe3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafe409f180 0x7fafe4122fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44350/0 (socket says 172.21.15.156:44350) 2023-09-30T22:21:09.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.613+0000 7fafe8d06700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fafe409e870 0x7fafe4122a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:09.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.613+0000 7fafe3fff700 1 -- 172.21.15.156:0/1184330819 learned_addr learned my addr 172.21.15.156:0/1184330819 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:09.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.613+0000 7fafe8d06700 1 -- 172.21.15.156:0/1184330819 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafe409f180 msgr2=0x7fafe4122fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:09.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.613+0000 7fafe8d06700 1 --2- 172.21.15.156:0/1184330819 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafe409f180 0x7fafe4122fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:09.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.613+0000 7fafe8d06700 1 -- 172.21.15.156:0/1184330819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafe4134160 msgr2=0x7fafe4123510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:09.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.613+0000 7fafe8d06700 1 --2- 172.21.15.156:0/1184330819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafe4134160 0x7fafe4123510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:09.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.613+0000 7fafe8d06700 1 -- 172.21.15.156:0/1184330819 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd00094a0 con 0x7fafe409e870 2023-09-30T22:21:09.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.613+0000 7fafe3fff700 1 --2- 172.21.15.156:0/1184330819 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafe409f180 0x7fafe4122fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:09.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.614+0000 7fafe8d06700 1 --2- 172.21.15.156:0/1184330819 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fafe409e870 0x7fafe4122a90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fafd8009870 tx=0x7fafd8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:09.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.614+0000 7fafe17fa700 1 -- 172.21.15.156:0/1184330819 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd8024620 con 0x7fafe409e870 2023-09-30T22:21:09.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.614+0000 7fafe17fa700 1 -- 172.21.15.156:0/1184330819 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd8024780 con 0x7fafe409e870 2023-09-30T22:21:09.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.614+0000 7fafeaf6a700 1 -- 172.21.15.156:0/1184330819 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd80094a0 con 0x7fafe409e870 2023-09-30T22:21:09.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.614+0000 7fafe17fa700 1 -- 172.21.15.156:0/1184330819 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd8024b10 con 0x7fafe409e870 2023-09-30T22:21:09.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.614+0000 7fafeaf6a700 1 -- 172.21.15.156:0/1184330819 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe4126bc0 con 0x7fafe409e870 2023-09-30T22:21:09.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.614+0000 7fafe17fa700 1 -- 172.21.15.156:0/1184330819 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fafd8022070 con 0x7fafe409e870 2023-09-30T22:21:09.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.615+0000 7fafeaf6a700 1 -- 172.21.15.156:0/1184330819 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe404f2a0 con 0x7fafe409e870 2023-09-30T22:21:09.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.615+0000 7fafe17fa700 1 -- 172.21.15.156:0/1184330819 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fafd80409e0 con 0x7fafe409e870 2023-09-30T22:21:09.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.619+0000 7fafe17fa700 1 -- 172.21.15.156:0/1184330819 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fafd8015070 con 0x7fafe409e870 2023-09-30T22:21:09.738 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:09.783 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:09.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.811+0000 7fafeaf6a700 1 -- 172.21.15.156:0/1184330819 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fafe4072d60 con 0x7fafe409e870 2023-09-30T22:21:09.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.811+0000 7fafe17fa700 1 -- 172.21.15.156:0/1184330819 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fafd8015030 con 0x7fafe409e870 2023-09-30T22:21:09.812 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:09.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.813+0000 7fafeaf6a700 1 -- 172.21.15.156:0/1184330819 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fafe409e870 msgr2=0x7fafe4122a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:09.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.813+0000 7fafeaf6a700 1 --2- 172.21.15.156:0/1184330819 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fafe409e870 0x7fafe4122a90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fafd8009870 tx=0x7fafd8004750 comp rx=0 tx=0).stop 2023-09-30T22:21:09.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.813+0000 7fafeaf6a700 1 -- 172.21.15.156:0/1184330819 shutdown_connections 2023-09-30T22:21:09.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.813+0000 7fafeaf6a700 1 --2- 172.21.15.156:0/1184330819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafe4134160 0x7fafe4123510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:09.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.813+0000 7fafeaf6a700 1 --2- 172.21.15.156:0/1184330819 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fafe409e870 0x7fafe4122a90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:09.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.813+0000 7fafeaf6a700 1 --2- 172.21.15.156:0/1184330819 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafe409f180 0x7fafe4122fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:09.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.813+0000 7fafeaf6a700 1 -- 172.21.15.156:0/1184330819 >> 172.21.15.156:0/1184330819 conn(0x7fafe40a4430 msgr2=0x7fafe4070e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:09.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.813+0000 7fafeaf6a700 1 -- 172.21.15.156:0/1184330819 shutdown_connections 2023-09-30T22:21:09.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.813+0000 7fafeaf6a700 1 -- 172.21.15.156:0/1184330819 wait complete. 2023-09-30T22:21:09.816 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:09.829 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:09.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.868+0000 7f70736bf700 1 Processor -- start 2023-09-30T22:21:09.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.868+0000 7f70736bf700 1 -- start start 2023-09-30T22:21:09.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.869+0000 7f70736bf700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f706c09dec0 0x7f706c06b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:09.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.869+0000 7f70736bf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f706c136cb0 0x7f706c139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:09.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.869+0000 7f70736bf700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f706c06e900 con 0x7f706c06a770 2023-09-30T22:21:09.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.869+0000 7f70736bf700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f706c09d180 con 0x7f706c09dec0 2023-09-30T22:21:09.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.869+0000 7f70736bf700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706c09e780 con 0x7f706c136cb0 2023-09-30T22:21:09.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.869+0000 7f7070c5a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f706c09dec0 0x7f706c06b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:09.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.869+0000 7f7071c5c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f706c136cb0 0x7f706c139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:09.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.869+0000 7f7070c5a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f706c09dec0 0x7f706c06b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34296/0 (socket says 172.21.15.156:34296) 2023-09-30T22:21:09.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.869+0000 7f707145b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f706c06a770 0x7f706c06ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53212/0 (socket says 172.21.15.156:53212) 2023-09-30T22:21:09.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.869+0000 7f7070c5a700 1 -- 172.21.15.156:0/1562744129 learned_addr learned my addr 172.21.15.156:0/1562744129 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:09.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.870+0000 7f7063fff700 1 -- 172.21.15.156:0/1562744129 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 444159944 0 0) 0x7f706c06e900 con 0x7f706c06a770 2023-09-30T22:21:09.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.870+0000 7f7063fff700 1 -- 172.21.15.156:0/1562744129 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70580035b0 con 0x7f706c06a770 2023-09-30T22:21:09.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.870+0000 7f7071c5c700 1 -- 172.21.15.156:0/1562744129 >> v2:172.21.15.156:3300/0 conn(0x7f706c09dec0 msgr2=0x7f706c06b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:09.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.870+0000 7f7071c5c700 1 --2- 172.21.15.156:0/1562744129 >> v2:172.21.15.156:3300/0 conn(0x7f706c09dec0 0x7f706c06b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:09.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.870+0000 7f7071c5c700 1 -- 172.21.15.156:0/1562744129 >> v1:172.21.15.156:6789/0 conn(0x7f706c06a770 legacy=0x7f706c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:09.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.870+0000 7f7071c5c700 1 -- 172.21.15.156:0/1562744129 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c09d3c0 con 0x7f706c136cb0 2023-09-30T22:21:09.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.870+0000 7f7070c5a700 1 --2- 172.21.15.156:0/1562744129 >> v2:172.21.15.156:3300/0 conn(0x7f706c09dec0 0x7f706c06b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:09.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.870+0000 7f7071c5c700 1 --2- 172.21.15.156:0/1562744129 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f706c136cb0 0x7f706c139090 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7064009d90 tx=0x7f706400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ebbf1ea8f219d4c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:09.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.870+0000 7f7063fff700 1 -- 172.21.15.156:0/1562744129 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706400e070 con 0x7f706c136cb0 2023-09-30T22:21:09.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.870+0000 7f7063fff700 1 -- 172.21.15.156:0/1562744129 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706400bb20 con 0x7f706c136cb0 2023-09-30T22:21:09.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.870+0000 7f7063fff700 1 -- 172.21.15.156:0/1562744129 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7064012430 con 0x7f706c136cb0 2023-09-30T22:21:09.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.871+0000 7f70736bf700 1 -- 172.21.15.156:0/1562744129 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f706c136cb0 msgr2=0x7f706c139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:09.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.871+0000 7f70736bf700 1 --2- 172.21.15.156:0/1562744129 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f706c136cb0 0x7f706c139090 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7064009d90 tx=0x7f706400b330 comp rx=0 tx=0).stop 2023-09-30T22:21:09.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.871+0000 7f70736bf700 1 -- 172.21.15.156:0/1562744129 shutdown_connections 2023-09-30T22:21:09.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.871+0000 7f70736bf700 1 --2- 172.21.15.156:0/1562744129 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f706c136cb0 0x7f706c139090 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:09.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.871+0000 7f70736bf700 1 --2- 172.21.15.156:0/1562744129 >> v2:172.21.15.156:3300/0 conn(0x7f706c09dec0 0x7f706c06b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:09.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.871+0000 7f70736bf700 1 -- 172.21.15.156:0/1562744129 >> 172.21.15.156:0/1562744129 conn(0x7f706c099c40 msgr2=0x7f706c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:09.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.871+0000 7f70736bf700 1 -- 172.21.15.156:0/1562744129 shutdown_connections 2023-09-30T22:21:09.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.871+0000 7f70736bf700 1 -- 172.21.15.156:0/1562744129 wait complete. 2023-09-30T22:21:09.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.872+0000 7f70736bf700 1 Processor -- start 2023-09-30T22:21:09.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.872+0000 7f70736bf700 1 -- start start 2023-09-30T22:21:09.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.873+0000 7f70736bf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f706c06a770 0x7f706c1342a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:09.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.873+0000 7f70736bf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f706c09dec0 0x7f706c1347e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:09.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.873+0000 7f70736bf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f706c136cb0 0x7f706c134d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:09.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.873+0000 7f70736bf700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c1366c0 con 0x7f706c136cb0 2023-09-30T22:21:09.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.873+0000 7f70736bf700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706c11aa60 con 0x7f706c06a770 2023-09-30T22:21:09.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.873+0000 7f70736bf700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f706c119e30 con 0x7f706c09dec0 2023-09-30T22:21:09.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.873+0000 7f707145b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f706c06a770 0x7f706c1342a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:09.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.873+0000 7f707145b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f706c06a770 0x7f706c1342a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44370/0 (socket says 172.21.15.156:44370) 2023-09-30T22:21:09.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.873+0000 7f707145b700 1 -- 172.21.15.156:0/1267511269 learned_addr learned my addr 172.21.15.156:0/1267511269 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:09.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.873+0000 7f7070c5a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f706c09dec0 0x7f706c1347e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:09.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.873+0000 7f7071c5c700 1 --2- 172.21.15.156:0/1267511269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f706c136cb0 0x7f706c134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:09.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.873+0000 7f707145b700 1 -- 172.21.15.156:0/1267511269 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f706c09dec0 msgr2=0x7f706c1347e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:09.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.873+0000 7f707145b700 1 --2- 172.21.15.156:0/1267511269 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f706c09dec0 0x7f706c1347e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:09.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.873+0000 7f707145b700 1 -- 172.21.15.156:0/1267511269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f706c136cb0 msgr2=0x7f706c134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:09.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.873+0000 7f707145b700 1 --2- 172.21.15.156:0/1267511269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f706c136cb0 0x7f706c134d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:09.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.873+0000 7f707145b700 1 -- 172.21.15.156:0/1267511269 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c009550 con 0x7f706c06a770 2023-09-30T22:21:09.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.873+0000 7f7071c5c700 1 --2- 172.21.15.156:0/1267511269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f706c136cb0 0x7f706c134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:09.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.874+0000 7f707145b700 1 --2- 172.21.15.156:0/1267511269 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f706c06a770 0x7f706c1342a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f706800c760 tx=0x7f706800ca70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:09.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.874+0000 7f7061ffb700 1 -- 172.21.15.156:0/1267511269 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7068005cb0 con 0x7f706c06a770 2023-09-30T22:21:09.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.874+0000 7f7061ffb700 1 -- 172.21.15.156:0/1267511269 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7068005e10 con 0x7f706c06a770 2023-09-30T22:21:09.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.874+0000 7f70736bf700 1 -- 172.21.15.156:0/1267511269 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7064009a70 con 0x7f706c06a770 2023-09-30T22:21:09.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.874+0000 7f7061ffb700 1 -- 172.21.15.156:0/1267511269 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70680072d0 con 0x7f706c06a770 2023-09-30T22:21:09.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.874+0000 7f70736bf700 1 -- 172.21.15.156:0/1267511269 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706c139140 con 0x7f706c06a770 2023-09-30T22:21:09.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.875+0000 7f7061ffb700 1 -- 172.21.15.156:0/1267511269 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7068007430 con 0x7f706c06a770 2023-09-30T22:21:09.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.875+0000 7f7061ffb700 1 -- 172.21.15.156:0/1267511269 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f706803eb10 con 0x7f706c06a770 2023-09-30T22:21:09.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.875+0000 7f70736bf700 1 -- 172.21.15.156:0/1267511269 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f706c071ce0 con 0x7f706c06a770 2023-09-30T22:21:09.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.880+0000 7f7061ffb700 1 -- 172.21.15.156:0/1267511269 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f706801b3b0 con 0x7f706c06a770 2023-09-30T22:21:09.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.912+0000 7f53e9fbb700 1 Processor -- start 2023-09-30T22:21:09.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.912+0000 7f53e9fbb700 1 -- start start 2023-09-30T22:21:09.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.913+0000 7f53e9fbb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53e409e870 0x7f53e409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:09.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.913+0000 7f53e9fbb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f53e4131f40 0x7f53e4139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:09.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.913+0000 7f53e9fbb700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e409c970 con 0x7f53e409f180 2023-09-30T22:21:09.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.913+0000 7f53e9fbb700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e40a0920 con 0x7f53e4131f40 2023-09-30T22:21:09.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.913+0000 7f53e9fbb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e409f9c0 con 0x7f53e409e870 2023-09-30T22:21:09.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.913+0000 7f53e37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53e409e870 0x7f53e409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:09.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.913+0000 7f53e2ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f53e409f180 0x7f53e4131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53224/0 (socket says 172.21.15.156:53224) 2023-09-30T22:21:09.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.913+0000 7f53e2ffd700 1 -- 172.21.15.156:0/2659434450 learned_addr learned my addr 172.21.15.156:0/2659434450 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:09.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.913+0000 7f53e3fff700 1 --2- 172.21.15.156:0/2659434450 >> v2:172.21.15.156:3300/0 conn(0x7f53e4131f40 0x7f53e4139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:09.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.913+0000 7f53e3fff700 1 -- 172.21.15.156:0/2659434450 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53e409e870 msgr2=0x7f53e409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:09.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.913+0000 7f53e3fff700 1 --2- 172.21.15.156:0/2659434450 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53e409e870 0x7f53e409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:09.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.913+0000 7f53e3fff700 1 -- 172.21.15.156:0/2659434450 >> v1:172.21.15.156:6789/0 conn(0x7f53e409f180 legacy=0x7f53e4131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:09.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.913+0000 7f53e3fff700 1 -- 172.21.15.156:0/2659434450 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e409bab0 con 0x7f53e4131f40 2023-09-30T22:21:09.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.913+0000 7f53e3fff700 1 --2- 172.21.15.156:0/2659434450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53e4131f40 0x7f53e4139ca0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f53dc009d90 tx=0x7f53dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716934359e22348a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:09.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.914+0000 7f53e27fc700 1 -- 172.21.15.156:0/2659434450 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc00e070 con 0x7f53e4131f40 2023-09-30T22:21:09.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.914+0000 7f53e27fc700 1 -- 172.21.15.156:0/2659434450 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53dc00bb20 con 0x7f53e4131f40 2023-09-30T22:21:09.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.914+0000 7f53e27fc700 1 -- 172.21.15.156:0/2659434450 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc012430 con 0x7f53e4131f40 2023-09-30T22:21:09.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.914+0000 7f53e9fbb700 1 -- 172.21.15.156:0/2659434450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53e4131f40 msgr2=0x7f53e4139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:09.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.914+0000 7f53e9fbb700 1 --2- 172.21.15.156:0/2659434450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53e4131f40 0x7f53e4139ca0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f53dc009d90 tx=0x7f53dc00b330 comp rx=0 tx=0).stop 2023-09-30T22:21:09.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.914+0000 7f53e9fbb700 1 -- 172.21.15.156:0/2659434450 shutdown_connections 2023-09-30T22:21:09.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.914+0000 7f53e9fbb700 1 --2- 172.21.15.156:0/2659434450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53e4131f40 0x7f53e4139ca0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:09.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.914+0000 7f53e9fbb700 1 --2- 172.21.15.156:0/2659434450 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53e409e870 0x7f53e409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:09.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.914+0000 7f53e9fbb700 1 -- 172.21.15.156:0/2659434450 >> 172.21.15.156:0/2659434450 conn(0x7f53e40a4430 msgr2=0x7f53e40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:09.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.914+0000 7f53e9fbb700 1 -- 172.21.15.156:0/2659434450 shutdown_connections 2023-09-30T22:21:09.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.914+0000 7f53e9fbb700 1 -- 172.21.15.156:0/2659434450 wait complete. 2023-09-30T22:21:09.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.915+0000 7f53e9fbb700 1 Processor -- start 2023-09-30T22:21:09.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.915+0000 7f53e9fbb700 1 -- start start 2023-09-30T22:21:09.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.916+0000 7f53e9fbb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53e409e870 0x7f53e41201a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:09.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.916+0000 7f53e9fbb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53e409f180 0x7f53e41206e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:09.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.916+0000 7f53e9fbb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f53e4131f40 0x7f53e4120c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:09.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.916+0000 7f53e9fbb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e4121670 con 0x7f53e409e870 2023-09-30T22:21:09.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.916+0000 7f53e9fbb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e4131570 con 0x7f53e409f180 2023-09-30T22:21:09.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.916+0000 7f53e9fbb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53e4122c40 con 0x7f53e4131f40 2023-09-30T22:21:09.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.916+0000 7f53e2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53e409f180 0x7f53e41206e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:09.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.916+0000 7f53e37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53e409e870 0x7f53e41201a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:09.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.916+0000 7f53e2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53e409f180 0x7f53e41206e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44390/0 (socket says 172.21.15.156:44390) 2023-09-30T22:21:09.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.916+0000 7f53e2ffd700 1 -- 172.21.15.156:0/2490187096 learned_addr learned my addr 172.21.15.156:0/2490187096 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:09.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.916+0000 7f53e37fe700 1 -- 172.21.15.156:0/2490187096 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f53e4131f40 msgr2=0x7f53e4120c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:09.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.916+0000 7f53e37fe700 1 --2- 172.21.15.156:0/2490187096 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f53e4131f40 0x7f53e4120c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:09.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.916+0000 7f53e37fe700 1 -- 172.21.15.156:0/2490187096 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53e409f180 msgr2=0x7f53e41206e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:09.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.916+0000 7f53e37fe700 1 --2- 172.21.15.156:0/2490187096 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53e409f180 0x7f53e41206e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:09.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.916+0000 7f53e37fe700 1 -- 172.21.15.156:0/2490187096 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53dc009a70 con 0x7f53e409e870 2023-09-30T22:21:09.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.916+0000 7f53e2ffd700 1 --2- 172.21.15.156:0/2490187096 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53e409f180 0x7f53e41206e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:09.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.916+0000 7f53e37fe700 1 --2- 172.21.15.156:0/2490187096 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53e409e870 0x7f53e41201a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f53d4009b50 tx=0x7f53d4009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:09.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.917+0000 7f53cbfff700 1 -- 172.21.15.156:0/2490187096 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d4015070 con 0x7f53e409e870 2023-09-30T22:21:09.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.917+0000 7f53cbfff700 1 -- 172.21.15.156:0/2490187096 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d400b880 con 0x7f53e409e870 2023-09-30T22:21:09.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.917+0000 7f53e9fbb700 1 -- 172.21.15.156:0/2490187096 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e4123720 con 0x7f53e409e870 2023-09-30T22:21:09.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.917+0000 7f53cbfff700 1 -- 172.21.15.156:0/2490187096 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d400bbf0 con 0x7f53e409e870 2023-09-30T22:21:09.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.917+0000 7f53e9fbb700 1 -- 172.21.15.156:0/2490187096 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e409dba0 con 0x7f53e409e870 2023-09-30T22:21:09.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.917+0000 7f53e9fbb700 1 -- 172.21.15.156:0/2490187096 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e411ce70 con 0x7f53e409e870 2023-09-30T22:21:09.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.918+0000 7f53cbfff700 1 -- 172.21.15.156:0/2490187096 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f53d400bd50 con 0x7f53e409e870 2023-09-30T22:21:09.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.918+0000 7f53cbfff700 1 -- 172.21.15.156:0/2490187096 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f53d4042de0 con 0x7f53e409e870 2023-09-30T22:21:09.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.922+0000 7f53cbfff700 1 -- 172.21.15.156:0/2490187096 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f53d4018bf0 con 0x7f53e409e870 2023-09-30T22:21:09.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.945+0000 7f4dea091700 1 Processor -- start 2023-09-30T22:21:09.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.945+0000 7f4dea091700 1 -- start start 2023-09-30T22:21:09.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.945+0000 7f4dea091700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4de409e870 0x7f4de409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:09.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.946+0000 7f4dea091700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4de409f180 0x7f4de4131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:09.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.946+0000 7f4dea091700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de409c970 con 0x7f4de4131d70 2023-09-30T22:21:09.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.946+0000 7f4dea091700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de40a0920 con 0x7f4de409e870 2023-09-30T22:21:09.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.946+0000 7f4dea091700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4de409f9c0 con 0x7f4de409f180 2023-09-30T22:21:09.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.946+0000 7f4de2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4de409f180 0x7f4de4131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:09.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.946+0000 7f4de3fff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4de4131d70 0x7f4de4138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53238/0 (socket says 172.21.15.156:53238) 2023-09-30T22:21:09.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.946+0000 7f4de2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4de409f180 0x7f4de4131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:41422/0 (socket says 172.21.15.156:41422) 2023-09-30T22:21:09.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.946+0000 7f4de37fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4de409e870 0x7f4de409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:09.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.946+0000 7f4de3fff700 1 -- 172.21.15.156:0/3301024724 learned_addr learned my addr 172.21.15.156:0/3301024724 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:09.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.946+0000 7f4de2ffd700 1 -- 172.21.15.156:0/3301024724 >> v2:172.21.15.156:3300/0 conn(0x7f4de409e870 msgr2=0x7f4de409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:09.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.946+0000 7f4de2ffd700 1 --2- 172.21.15.156:0/3301024724 >> v2:172.21.15.156:3300/0 conn(0x7f4de409e870 0x7f4de409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:09.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.946+0000 7f4de2ffd700 1 -- 172.21.15.156:0/3301024724 >> v1:172.21.15.156:6789/0 conn(0x7f4de4131d70 legacy=0x7f4de4138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:09.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.946+0000 7f4de2ffd700 1 -- 172.21.15.156:0/3301024724 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de409bab0 con 0x7f4de409f180 2023-09-30T22:21:09.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.946+0000 7f4de27fc700 1 -- 172.21.15.156:0/3301024724 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4162656959 0 0) 0x7f4de409c970 con 0x7f4de4131d70 2023-09-30T22:21:09.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.946+0000 7f4de37fe700 1 --2- 172.21.15.156:0/3301024724 >> v2:172.21.15.156:3300/0 conn(0x7f4de409e870 0x7f4de409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:09.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.946+0000 7f4de2ffd700 1 --2- 172.21.15.156:0/3301024724 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4de409f180 0x7f4de4131830 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8009840 tx=0x7f4dd8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f9054425ad7baef server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:09.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.946+0000 7f4de27fc700 1 -- 172.21.15.156:0/3301024724 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8011830 con 0x7f4de409f180 2023-09-30T22:21:09.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.947+0000 7f4de27fc700 1 -- 172.21.15.156:0/3301024724 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd8011990 con 0x7f4de409f180 2023-09-30T22:21:09.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.947+0000 7f4de27fc700 1 -- 172.21.15.156:0/3301024724 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8011d20 con 0x7f4de409f180 2023-09-30T22:21:09.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.947+0000 7f4dea091700 1 -- 172.21.15.156:0/3301024724 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4de409f180 msgr2=0x7f4de4131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:09.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.947+0000 7f4dea091700 1 --2- 172.21.15.156:0/3301024724 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4de409f180 0x7f4de4131830 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8009840 tx=0x7f4dd8009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:09.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.947+0000 7f4dea091700 1 -- 172.21.15.156:0/3301024724 shutdown_connections 2023-09-30T22:21:09.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.947+0000 7f4dea091700 1 --2- 172.21.15.156:0/3301024724 >> v2:172.21.15.156:3300/0 conn(0x7f4de409e870 0x7f4de409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:09.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.947+0000 7f4dea091700 1 --2- 172.21.15.156:0/3301024724 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4de409f180 0x7f4de4131830 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:09.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.947+0000 7f4dea091700 1 -- 172.21.15.156:0/3301024724 >> 172.21.15.156:0/3301024724 conn(0x7f4de40a4430 msgr2=0x7f4de40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:09.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.947+0000 7f4dea091700 1 -- 172.21.15.156:0/3301024724 shutdown_connections 2023-09-30T22:21:09.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.947+0000 7f4dea091700 1 -- 172.21.15.156:0/3301024724 wait complete. 2023-09-30T22:21:09.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.948+0000 7f4dea091700 1 Processor -- start 2023-09-30T22:21:09.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.948+0000 7f4dea091700 1 -- start start 2023-09-30T22:21:09.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.949+0000 7f4dea091700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4de409e870 0x7f4de406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:09.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.949+0000 7f4dea091700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4de409f180 0x7f4de406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:09.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.949+0000 7f4dea091700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4de4131d70 0x7f4de406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:09.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.949+0000 7f4dea091700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de41254c0 con 0x7f4de409f180 2023-09-30T22:21:09.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.949+0000 7f4dea091700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de409dba0 con 0x7f4de4131d70 2023-09-30T22:21:09.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.949+0000 7f4dea091700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4de41315d0 con 0x7f4de409e870 2023-09-30T22:21:09.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.949+0000 7f4de2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4de409f180 0x7f4de406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:09.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.949+0000 7f4de37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4de409e870 0x7f4de406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:09.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.949+0000 7f4de37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4de409e870 0x7f4de406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:41426/0 (socket says 172.21.15.156:41426) 2023-09-30T22:21:09.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.949+0000 7f4de2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4de409f180 0x7f4de406bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34344/0 (socket says 172.21.15.156:34344) 2023-09-30T22:21:09.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.949+0000 7f4de37fe700 1 -- 172.21.15.156:0/4047952287 learned_addr learned my addr 172.21.15.156:0/4047952287 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:09.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.949+0000 7f4de3fff700 1 --2- 172.21.15.156:0/4047952287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4de4131d70 0x7f4de406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:09.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.949+0000 7f4de37fe700 1 -- 172.21.15.156:0/4047952287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4de4131d70 msgr2=0x7f4de406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:09.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.949+0000 7f4de37fe700 1 --2- 172.21.15.156:0/4047952287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4de4131d70 0x7f4de406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:09.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.949+0000 7f4de37fe700 1 -- 172.21.15.156:0/4047952287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4de409f180 msgr2=0x7f4de406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:09.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.949+0000 7f4de37fe700 1 --2- 172.21.15.156:0/4047952287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4de409f180 0x7f4de406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:09.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.949+0000 7f4de37fe700 1 -- 172.21.15.156:0/4047952287 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd40094a0 con 0x7f4de409e870 2023-09-30T22:21:09.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.949+0000 7f4de2ffd700 1 --2- 172.21.15.156:0/4047952287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4de409f180 0x7f4de406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:09.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.949+0000 7f4de37fe700 1 --2- 172.21.15.156:0/4047952287 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4de409e870 0x7f4de406b8b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4dd400ebe0 tx=0x7f4dd400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:09.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.949+0000 7f4dcbfff700 1 -- 172.21.15.156:0/4047952287 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4009760 con 0x7f4de409e870 2023-09-30T22:21:09.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.950+0000 7f4dea091700 1 -- 172.21.15.156:0/4047952287 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd80094a0 con 0x7f4de409e870 2023-09-30T22:21:09.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.950+0000 7f4dea091700 1 -- 172.21.15.156:0/4047952287 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de40a2a90 con 0x7f4de409e870 2023-09-30T22:21:09.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.950+0000 7f4dcbfff700 1 -- 172.21.15.156:0/4047952287 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd400c850 con 0x7f4de409e870 2023-09-30T22:21:09.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.950+0000 7f4dcbfff700 1 -- 172.21.15.156:0/4047952287 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd400cbc0 con 0x7f4de409e870 2023-09-30T22:21:09.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.951+0000 7f4dcbfff700 1 -- 172.21.15.156:0/4047952287 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4dd400cd20 con 0x7f4de409e870 2023-09-30T22:21:09.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.951+0000 7f4dcbfff700 1 -- 172.21.15.156:0/4047952287 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4dd403fd70 con 0x7f4de409e870 2023-09-30T22:21:09.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.951+0000 7f4dea091700 1 -- 172.21.15.156:0/4047952287 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc40052e0 con 0x7f4de409e870 2023-09-30T22:21:09.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:09.955+0000 7f4dcbfff700 1 -- 172.21.15.156:0/4047952287 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4dd4017020 con 0x7f4de409e870 2023-09-30T22:21:10.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.077+0000 7f70736bf700 1 -- 172.21.15.156:0/1267511269 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f706c04f2a0 con 0x7f706c06a770 2023-09-30T22:21:10.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.077+0000 7f7061ffb700 1 -- 172.21.15.156:0/1267511269 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7068017020 con 0x7f706c06a770 2023-09-30T22:21:10.078 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:10.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.079+0000 7f70736bf700 1 -- 172.21.15.156:0/1267511269 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f706c06a770 msgr2=0x7f706c1342a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:10.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.079+0000 7f70736bf700 1 --2- 172.21.15.156:0/1267511269 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f706c06a770 0x7f706c1342a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f706800c760 tx=0x7f706800ca70 comp rx=0 tx=0).stop 2023-09-30T22:21:10.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.079+0000 7f70736bf700 1 -- 172.21.15.156:0/1267511269 shutdown_connections 2023-09-30T22:21:10.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.079+0000 7f70736bf700 1 --2- 172.21.15.156:0/1267511269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f706c136cb0 0x7f706c134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:10.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.079+0000 7f70736bf700 1 --2- 172.21.15.156:0/1267511269 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f706c06a770 0x7f706c1342a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:10.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.079+0000 7f70736bf700 1 --2- 172.21.15.156:0/1267511269 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f706c09dec0 0x7f706c1347e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:10.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.079+0000 7f70736bf700 1 -- 172.21.15.156:0/1267511269 >> 172.21.15.156:0/1267511269 conn(0x7f706c099c40 msgr2=0x7f706c0a26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:10.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.079+0000 7f70736bf700 1 -- 172.21.15.156:0/1267511269 shutdown_connections 2023-09-30T22:21:10.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.079+0000 7f70736bf700 1 -- 172.21.15.156:0/1267511269 wait complete. 2023-09-30T22:21:10.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:10.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.119+0000 7f53e9fbb700 1 -- 172.21.15.156:0/2490187096 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f53e4123450 con 0x7f53e409e870 2023-09-30T22:21:10.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.119+0000 7f53cbfff700 1 -- 172.21.15.156:0/2490187096 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f53e4123450 con 0x7f53e409e870 2023-09-30T22:21:10.120 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:10.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.121+0000 7f53e9fbb700 1 -- 172.21.15.156:0/2490187096 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53e409e870 msgr2=0x7f53e41201a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:10.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.121+0000 7f53e9fbb700 1 --2- 172.21.15.156:0/2490187096 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53e409e870 0x7f53e41201a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f53d4009b50 tx=0x7f53d4009e60 comp rx=0 tx=0).stop 2023-09-30T22:21:10.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.121+0000 7f53e9fbb700 1 -- 172.21.15.156:0/2490187096 shutdown_connections 2023-09-30T22:21:10.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.121+0000 7f53e9fbb700 1 --2- 172.21.15.156:0/2490187096 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f53e4131f40 0x7f53e4120c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:10.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.121+0000 7f53e9fbb700 1 --2- 172.21.15.156:0/2490187096 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53e409e870 0x7f53e41201a0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:10.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.121+0000 7f53e9fbb700 1 --2- 172.21.15.156:0/2490187096 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53e409f180 0x7f53e41206e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:10.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.121+0000 7f53e9fbb700 1 -- 172.21.15.156:0/2490187096 >> 172.21.15.156:0/2490187096 conn(0x7f53e40a4430 msgr2=0x7f53e4072280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:10.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.122+0000 7f53e9fbb700 1 -- 172.21.15.156:0/2490187096 shutdown_connections 2023-09-30T22:21:10.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.122+0000 7f53e9fbb700 1 -- 172.21.15.156:0/2490187096 wait complete. 2023-09-30T22:21:10.134 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:10.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.149+0000 7f4dea091700 1 -- 172.21.15.156:0/4047952287 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4dc4005590 con 0x7f4de409e870 2023-09-30T22:21:10.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.150+0000 7f4dcbfff700 1 -- 172.21.15.156:0/4047952287 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4dd4021070 con 0x7f4de409e870 2023-09-30T22:21:10.150 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:10.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.152+0000 7f4dea091700 1 -- 172.21.15.156:0/4047952287 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4de409e870 msgr2=0x7f4de406b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:10.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.152+0000 7f4dea091700 1 --2- 172.21.15.156:0/4047952287 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4de409e870 0x7f4de406b8b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4dd400ebe0 tx=0x7f4dd400eef0 comp rx=0 tx=0).stop 2023-09-30T22:21:10.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.152+0000 7f4dea091700 1 -- 172.21.15.156:0/4047952287 shutdown_connections 2023-09-30T22:21:10.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.152+0000 7f4dea091700 1 --2- 172.21.15.156:0/4047952287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4de4131d70 0x7f4de406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:10.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.152+0000 7f4dea091700 1 --2- 172.21.15.156:0/4047952287 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4de409e870 0x7f4de406b8b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:10.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.152+0000 7f4dea091700 1 --2- 172.21.15.156:0/4047952287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4de409f180 0x7f4de406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:10.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.152+0000 7f4dea091700 1 -- 172.21.15.156:0/4047952287 >> 172.21.15.156:0/4047952287 conn(0x7f4de40a4430 msgr2=0x7f4de4072130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:10.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.152+0000 7f4dea091700 1 -- 172.21.15.156:0/4047952287 shutdown_connections 2023-09-30T22:21:10.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.152+0000 7f4dea091700 1 -- 172.21.15.156:0/4047952287 wait complete. 2023-09-30T22:21:10.164 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:10.830 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:10.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.956+0000 7f0184287700 1 Processor -- start 2023-09-30T22:21:10.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.956+0000 7f0184287700 1 -- start start 2023-09-30T22:21:10.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.956+0000 7f0184287700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f017c12cef0 0x7f017c12d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:10.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.956+0000 7f0184287700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f017c133540 0x7f017c133910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:10.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.956+0000 7f0184287700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f017c133e50 0x7f017c13a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:10.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.956+0000 7f0184287700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f017c09ac40 con 0x7f017c133e50 2023-09-30T22:21:10.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.956+0000 7f0184287700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f017c09a740 con 0x7f017c12cef0 2023-09-30T22:21:10.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.956+0000 7f0184287700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f017c09f3a0 con 0x7f017c133540 2023-09-30T22:21:10.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.956+0000 7f0182824700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f017c133e50 0x7f017c13a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:10.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.956+0000 7f0181822700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f017c133540 0x7f017c133910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:10.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.956+0000 7f0182023700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f017c12cef0 0x7f017c12d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:10.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.956+0000 7f0182824700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f017c133e50 0x7f017c13a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34354/0 (socket says 172.21.15.156:34354) 2023-09-30T22:21:10.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.956+0000 7f0181822700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f017c133540 0x7f017c133910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:41432/0 (socket says 172.21.15.156:41432) 2023-09-30T22:21:10.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.956+0000 7f0182824700 1 -- 172.21.15.156:0/1274717422 learned_addr learned my addr 172.21.15.156:0/1274717422 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:10.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.957+0000 7f0182023700 1 -- 172.21.15.156:0/1274717422 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f017c133540 msgr2=0x7f017c133910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:10.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.957+0000 7f0182023700 1 --2- 172.21.15.156:0/1274717422 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f017c133540 0x7f017c133910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:10.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.957+0000 7f0182023700 1 -- 172.21.15.156:0/1274717422 >> v2:172.21.15.156:3300/0 conn(0x7f017c133e50 msgr2=0x7f017c13a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:10.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.957+0000 7f0182023700 1 --2- 172.21.15.156:0/1274717422 >> v2:172.21.15.156:3300/0 conn(0x7f017c133e50 0x7f017c13a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:10.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.957+0000 7f0182023700 1 -- 172.21.15.156:0/1274717422 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017c09b010 con 0x7f017c12cef0 2023-09-30T22:21:10.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.957+0000 7f0182824700 1 --2- 172.21.15.156:0/1274717422 >> v2:172.21.15.156:3300/0 conn(0x7f017c133e50 0x7f017c13a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:10.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.957+0000 7f0181822700 1 --2- 172.21.15.156:0/1274717422 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f017c133540 0x7f017c133910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:10.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.957+0000 7f0182023700 1 --2- 172.21.15.156:0/1274717422 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f017c12cef0 0x7f017c12d2c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0178009840 tx=0x7f0178009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44fa798c1c9b13d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:10.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.957+0000 7f0181021700 1 -- 172.21.15.156:0/1274717422 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0178011830 con 0x7f017c12cef0 2023-09-30T22:21:10.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.957+0000 7f0181021700 1 -- 172.21.15.156:0/1274717422 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0178011990 con 0x7f017c12cef0 2023-09-30T22:21:10.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.957+0000 7f0181021700 1 -- 172.21.15.156:0/1274717422 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0178011d20 con 0x7f017c12cef0 2023-09-30T22:21:10.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.958+0000 7f0184287700 1 -- 172.21.15.156:0/1274717422 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f017c12cef0 msgr2=0x7f017c12d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:10.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.958+0000 7f0184287700 1 --2- 172.21.15.156:0/1274717422 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f017c12cef0 0x7f017c12d2c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0178009840 tx=0x7f0178009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:10.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.958+0000 7f0184287700 1 -- 172.21.15.156:0/1274717422 shutdown_connections 2023-09-30T22:21:10.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.958+0000 7f0184287700 1 --2- 172.21.15.156:0/1274717422 >> v2:172.21.15.156:3300/0 conn(0x7f017c133e50 0x7f017c13a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:10.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.958+0000 7f0184287700 1 --2- 172.21.15.156:0/1274717422 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f017c12cef0 0x7f017c12d2c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:10.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.958+0000 7f0184287700 1 --2- 172.21.15.156:0/1274717422 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f017c133540 0x7f017c133910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:10.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.958+0000 7f0184287700 1 -- 172.21.15.156:0/1274717422 >> 172.21.15.156:0/1274717422 conn(0x7f017c099c40 msgr2=0x7f017c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:10.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.958+0000 7f0184287700 1 -- 172.21.15.156:0/1274717422 shutdown_connections 2023-09-30T22:21:10.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.958+0000 7f0184287700 1 -- 172.21.15.156:0/1274717422 wait complete. 2023-09-30T22:21:10.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.959+0000 7f0184287700 1 Processor -- start 2023-09-30T22:21:10.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.959+0000 7f0184287700 1 -- start start 2023-09-30T22:21:10.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.959+0000 7f0184287700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f017c12cef0 0x7f017c070730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:10.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.959+0000 7f0184287700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f017c133540 0x7f017c070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:10.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.959+0000 7f0184287700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f017c133e50 0x7f017c0711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:10.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.959+0000 7f0184287700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017c072340 con 0x7f017c133e50 2023-09-30T22:21:10.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.959+0000 7f0184287700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f017c12c7b0 con 0x7f017c12cef0 2023-09-30T22:21:10.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.959+0000 7f0184287700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f017c133030 con 0x7f017c133540 2023-09-30T22:21:10.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.959+0000 7f0182824700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f017c133e50 0x7f017c0711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:10.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.959+0000 7f0182023700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f017c12cef0 0x7f017c070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:10.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.959+0000 7f0182824700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f017c133e50 0x7f017c0711b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34368/0 (socket says 172.21.15.156:34368) 2023-09-30T22:21:10.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.959+0000 7f0182824700 1 -- 172.21.15.156:0/2198706089 learned_addr learned my addr 172.21.15.156:0/2198706089 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:10.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.959+0000 7f0181822700 1 --2- 172.21.15.156:0/2198706089 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f017c133540 0x7f017c070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:10.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.959+0000 7f0182023700 1 -- 172.21.15.156:0/2198706089 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f017c133540 msgr2=0x7f017c070c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:10.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.959+0000 7f0182023700 1 --2- 172.21.15.156:0/2198706089 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f017c133540 0x7f017c070c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:10.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.959+0000 7f0182023700 1 -- 172.21.15.156:0/2198706089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f017c133e50 msgr2=0x7f017c0711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:10.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.959+0000 7f0182023700 1 --2- 172.21.15.156:0/2198706089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f017c133e50 0x7f017c0711b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:10.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.959+0000 7f0182023700 1 -- 172.21.15.156:0/2198706089 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01700094a0 con 0x7f017c12cef0 2023-09-30T22:21:10.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.959+0000 7f0182824700 1 --2- 172.21.15.156:0/2198706089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f017c133e50 0x7f017c0711b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:10.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.960+0000 7f0181822700 1 --2- 172.21.15.156:0/2198706089 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f017c133540 0x7f017c070c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:10.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.960+0000 7f0182023700 1 --2- 172.21.15.156:0/2198706089 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f017c12cef0 0x7f017c070730 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0178016000 tx=0x7f0178004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:10.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.960+0000 7f016effd700 1 -- 172.21.15.156:0/2198706089 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0178004450 con 0x7f017c12cef0 2023-09-30T22:21:10.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.960+0000 7f016effd700 1 -- 172.21.15.156:0/2198706089 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017801f070 con 0x7f017c12cef0 2023-09-30T22:21:10.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.960+0000 7f0184287700 1 -- 172.21.15.156:0/2198706089 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0174009b30 con 0x7f017c12cef0 2023-09-30T22:21:10.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.960+0000 7f016effd700 1 -- 172.21.15.156:0/2198706089 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01780038e0 con 0x7f017c12cef0 2023-09-30T22:21:10.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.960+0000 7f0184287700 1 -- 172.21.15.156:0/2198706089 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01780094a0 con 0x7f017c12cef0 2023-09-30T22:21:10.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.961+0000 7f016effd700 1 -- 172.21.15.156:0/2198706089 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0178003a40 con 0x7f017c12cef0 2023-09-30T22:21:10.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.961+0000 7f016effd700 1 -- 172.21.15.156:0/2198706089 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0178021070 con 0x7f017c12cef0 2023-09-30T22:21:10.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.961+0000 7f0184287700 1 -- 172.21.15.156:0/2198706089 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f017c11dc40 con 0x7f017c12cef0 2023-09-30T22:21:10.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:10.965+0000 7f016effd700 1 -- 172.21.15.156:0/2198706089 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f017802b080 con 0x7f017c12cef0 2023-09-30T22:21:11.092 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:11.135 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:11.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.153+0000 7f0184287700 1 -- 172.21.15.156:0/2198706089 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f017c09e610 con 0x7f017c12cef0 2023-09-30T22:21:11.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.153+0000 7f016effd700 1 -- 172.21.15.156:0/2198706089 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0178015020 con 0x7f017c12cef0 2023-09-30T22:21:11.154 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:11.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.155+0000 7f0184287700 1 -- 172.21.15.156:0/2198706089 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f017c12cef0 msgr2=0x7f017c070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:11.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.155+0000 7f0184287700 1 --2- 172.21.15.156:0/2198706089 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f017c12cef0 0x7f017c070730 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0178016000 tx=0x7f0178004750 comp rx=0 tx=0).stop 2023-09-30T22:21:11.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.155+0000 7f0184287700 1 -- 172.21.15.156:0/2198706089 shutdown_connections 2023-09-30T22:21:11.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.155+0000 7f0184287700 1 --2- 172.21.15.156:0/2198706089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f017c133e50 0x7f017c0711b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.155+0000 7f0184287700 1 --2- 172.21.15.156:0/2198706089 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f017c12cef0 0x7f017c070730 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.155+0000 7f0184287700 1 --2- 172.21.15.156:0/2198706089 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f017c133540 0x7f017c070c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.155+0000 7f0184287700 1 -- 172.21.15.156:0/2198706089 >> 172.21.15.156:0/2198706089 conn(0x7f017c099c40 msgr2=0x7f017c09b320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:11.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.155+0000 7f0184287700 1 -- 172.21.15.156:0/2198706089 shutdown_connections 2023-09-30T22:21:11.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.155+0000 7f0184287700 1 -- 172.21.15.156:0/2198706089 wait complete. 2023-09-30T22:21:11.165 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:11.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:11.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.219+0000 7f864fce7700 1 Processor -- start 2023-09-30T22:21:11.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.219+0000 7f864fce7700 1 -- start start 2023-09-30T22:21:11.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.220+0000 7f864fce7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f864806b250 0x7f8648136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:11.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.220+0000 7f864fce7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8648137140 0x7f8648139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:11.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.220+0000 7f864fce7700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f864809da80 con 0x7f864806a770 2023-09-30T22:21:11.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.220+0000 7f864fce7700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f864809f770 con 0x7f864806b250 2023-09-30T22:21:11.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.220+0000 7f864fce7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864809dce0 con 0x7f8648137140 2023-09-30T22:21:11.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.220+0000 7f864d282700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f864806b250 0x7f8648136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:11.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.220+0000 7f864e284700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8648137140 0x7f8648139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:11.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.220+0000 7f864da83700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f864806a770 0x7f864806ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53244/0 (socket says 172.21.15.156:53244) 2023-09-30T22:21:11.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.220+0000 7f864da83700 1 -- 172.21.15.156:0/1002025673 learned_addr learned my addr 172.21.15.156:0/1002025673 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:11.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.220+0000 7f864d282700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f864806b250 0x7f8648136c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34376/0 (socket says 172.21.15.156:34376) 2023-09-30T22:21:11.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.220+0000 7f864e284700 1 -- 172.21.15.156:0/1002025673 >> v2:172.21.15.156:3300/0 conn(0x7f864806b250 msgr2=0x7f8648136c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:11.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.220+0000 7f864e284700 1 --2- 172.21.15.156:0/1002025673 >> v2:172.21.15.156:3300/0 conn(0x7f864806b250 0x7f8648136c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.220+0000 7f864e284700 1 -- 172.21.15.156:0/1002025673 >> v1:172.21.15.156:6789/0 conn(0x7f864806a770 legacy=0x7f864806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:11.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.220+0000 7f864e284700 1 -- 172.21.15.156:0/1002025673 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864809eb20 con 0x7f8648137140 2023-09-30T22:21:11.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.220+0000 7f864ca81700 1 -- 172.21.15.156:0/1002025673 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1473632879 0 0) 0x7f864809da80 con 0x7f864806a770 2023-09-30T22:21:11.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.221+0000 7f864e284700 1 --2- 172.21.15.156:0/1002025673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8648137140 0x7f8648139520 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8640009d90 tx=0x7f864000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81d530f19fae0b07 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:11.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.221+0000 7f864ca81700 1 -- 172.21.15.156:0/1002025673 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864000e070 con 0x7f8648137140 2023-09-30T22:21:11.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.221+0000 7f864ca81700 1 -- 172.21.15.156:0/1002025673 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864000bb20 con 0x7f8648137140 2023-09-30T22:21:11.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.221+0000 7f864ca81700 1 -- 172.21.15.156:0/1002025673 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640012430 con 0x7f8648137140 2023-09-30T22:21:11.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.222+0000 7f864fce7700 1 -- 172.21.15.156:0/1002025673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8648137140 msgr2=0x7f8648139520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:11.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.222+0000 7f864fce7700 1 --2- 172.21.15.156:0/1002025673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8648137140 0x7f8648139520 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8640009d90 tx=0x7f864000b330 comp rx=0 tx=0).stop 2023-09-30T22:21:11.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.222+0000 7f864fce7700 1 -- 172.21.15.156:0/1002025673 shutdown_connections 2023-09-30T22:21:11.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.222+0000 7f864fce7700 1 --2- 172.21.15.156:0/1002025673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8648137140 0x7f8648139520 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.222+0000 7f864fce7700 1 --2- 172.21.15.156:0/1002025673 >> v2:172.21.15.156:3300/0 conn(0x7f864806b250 0x7f8648136c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.222+0000 7f864fce7700 1 -- 172.21.15.156:0/1002025673 >> 172.21.15.156:0/1002025673 conn(0x7f8648099c40 msgr2=0x7f86480a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:11.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.222+0000 7f864fce7700 1 -- 172.21.15.156:0/1002025673 shutdown_connections 2023-09-30T22:21:11.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.222+0000 7f864fce7700 1 -- 172.21.15.156:0/1002025673 wait complete. 2023-09-30T22:21:11.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.223+0000 7f864fce7700 1 Processor -- start 2023-09-30T22:21:11.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.223+0000 7f864fce7700 1 -- start start 2023-09-30T22:21:11.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.224+0000 7f864fce7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f864806a770 0x7f864811e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:11.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.224+0000 7f864fce7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f864806b250 0x7f864811e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:11.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.224+0000 7f864fce7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8648137140 0x7f864811ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:11.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.224+0000 7f864fce7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8648121ea0 con 0x7f864806a770 2023-09-30T22:21:11.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.224+0000 7f864fce7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86481207f0 con 0x7f864806b250 2023-09-30T22:21:11.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.224+0000 7f864fce7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8648121630 con 0x7f8648137140 2023-09-30T22:21:11.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.224+0000 7f864da83700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f864806a770 0x7f864811e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:11.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.224+0000 7f864d282700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f864806b250 0x7f864811e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:11.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.224+0000 7f864d282700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f864806b250 0x7f864811e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44434/0 (socket says 172.21.15.156:44434) 2023-09-30T22:21:11.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.224+0000 7f864da83700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f864806a770 0x7f864811e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34378/0 (socket says 172.21.15.156:34378) 2023-09-30T22:21:11.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.224+0000 7f864d282700 1 -- 172.21.15.156:0/4115406526 learned_addr learned my addr 172.21.15.156:0/4115406526 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:11.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.224+0000 7f864e284700 1 --2- 172.21.15.156:0/4115406526 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8648137140 0x7f864811ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:11.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.224+0000 7f864d282700 1 -- 172.21.15.156:0/4115406526 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8648137140 msgr2=0x7f864811ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:11.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.224+0000 7f864d282700 1 --2- 172.21.15.156:0/4115406526 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8648137140 0x7f864811ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.224+0000 7f864d282700 1 -- 172.21.15.156:0/4115406526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f864806a770 msgr2=0x7f864811e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:11.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.224+0000 7f864d282700 1 --2- 172.21.15.156:0/4115406526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f864806a770 0x7f864811e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.224+0000 7f864d282700 1 -- 172.21.15.156:0/4115406526 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8640009a70 con 0x7f864806b250 2023-09-30T22:21:11.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.224+0000 7f864d282700 1 --2- 172.21.15.156:0/4115406526 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f864806b250 0x7f864811e8c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f863800e9b0 tx=0x7f863800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:11.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.225+0000 7f863e7fc700 1 -- 172.21.15.156:0/4115406526 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8638009710 con 0x7f864806b250 2023-09-30T22:21:11.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.225+0000 7f863e7fc700 1 -- 172.21.15.156:0/4115406526 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863800ee50 con 0x7f864806b250 2023-09-30T22:21:11.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.225+0000 7f864fce7700 1 -- 172.21.15.156:0/4115406526 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8648071e10 con 0x7f864806b250 2023-09-30T22:21:11.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.225+0000 7f863e7fc700 1 -- 172.21.15.156:0/4115406526 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863800ca50 con 0x7f864806b250 2023-09-30T22:21:11.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.225+0000 7f864fce7700 1 -- 172.21.15.156:0/4115406526 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86481367c0 con 0x7f864806b250 2023-09-30T22:21:11.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.225+0000 7f863e7fc700 1 -- 172.21.15.156:0/4115406526 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f863800cbb0 con 0x7f864806b250 2023-09-30T22:21:11.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.226+0000 7f863e7fc700 1 -- 172.21.15.156:0/4115406526 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f863803fa80 con 0x7f864806b250 2023-09-30T22:21:11.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.226+0000 7f864fce7700 1 -- 172.21.15.156:0/4115406526 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8648121a20 con 0x7f864806b250 2023-09-30T22:21:11.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.235+0000 7f863e7fc700 1 -- 172.21.15.156:0/4115406526 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8638017020 con 0x7f864806b250 2023-09-30T22:21:11.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.269+0000 7fc1f1eeb700 1 Processor -- start 2023-09-30T22:21:11.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.269+0000 7fc1f1eeb700 1 -- start start 2023-09-30T22:21:11.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.270+0000 7fc1f1eeb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1ec09e870 0x7fc1ec09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:11.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.270+0000 7fc1f1eeb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc1ec131f40 0x7fc1ec139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:11.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.270+0000 7fc1f1eeb700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ec09c970 con 0x7fc1ec09f180 2023-09-30T22:21:11.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.270+0000 7fc1f1eeb700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ec0a0920 con 0x7fc1ec131f40 2023-09-30T22:21:11.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.270+0000 7fc1f1eeb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec09f9c0 con 0x7fc1ec09e870 2023-09-30T22:21:11.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.270+0000 7fc1eb7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1ec09e870 0x7fc1ec09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:11.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.270+0000 7fc1eb7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1ec09e870 0x7fc1ec09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:50764/0 (socket says 172.21.15.156:50764) 2023-09-30T22:21:11.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.270+0000 7fc1eb7fe700 1 -- 172.21.15.156:0/3806269265 learned_addr learned my addr 172.21.15.156:0/3806269265 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:11.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.270+0000 7fc1ebfff700 1 --2- 172.21.15.156:0/3806269265 >> v2:172.21.15.156:3300/0 conn(0x7fc1ec131f40 0x7fc1ec139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:11.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.270+0000 7fc1eb7fe700 1 -- 172.21.15.156:0/3806269265 >> v2:172.21.15.156:3300/0 conn(0x7fc1ec131f40 msgr2=0x7fc1ec139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:11.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.270+0000 7fc1eb7fe700 1 --2- 172.21.15.156:0/3806269265 >> v2:172.21.15.156:3300/0 conn(0x7fc1ec131f40 0x7fc1ec139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.270+0000 7fc1eb7fe700 1 -- 172.21.15.156:0/3806269265 >> v1:172.21.15.156:6789/0 conn(0x7fc1ec09f180 legacy=0x7fc1ec131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:11.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.270+0000 7fc1eb7fe700 1 -- 172.21.15.156:0/3806269265 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec09bab0 con 0x7fc1ec09e870 2023-09-30T22:21:11.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.270+0000 7fc1eb7fe700 1 --2- 172.21.15.156:0/3806269265 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1ec09e870 0x7fc1ec09ec40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc0098f0 tx=0x7fc1dc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e4beb31db4d55a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:11.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.270+0000 7fc1ea7fc700 1 -- 172.21.15.156:0/3806269265 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc011830 con 0x7fc1ec09e870 2023-09-30T22:21:11.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.271+0000 7fc1ea7fc700 1 -- 172.21.15.156:0/3806269265 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc011990 con 0x7fc1ec09e870 2023-09-30T22:21:11.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.271+0000 7fc1ea7fc700 1 -- 172.21.15.156:0/3806269265 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc011d20 con 0x7fc1ec09e870 2023-09-30T22:21:11.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.271+0000 7fc1f1eeb700 1 -- 172.21.15.156:0/3806269265 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1ec09e870 msgr2=0x7fc1ec09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:11.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.271+0000 7fc1f1eeb700 1 --2- 172.21.15.156:0/3806269265 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1ec09e870 0x7fc1ec09ec40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc0098f0 tx=0x7fc1dc009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:11.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.271+0000 7fc1f1eeb700 1 -- 172.21.15.156:0/3806269265 shutdown_connections 2023-09-30T22:21:11.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.271+0000 7fc1f1eeb700 1 --2- 172.21.15.156:0/3806269265 >> v2:172.21.15.156:3300/0 conn(0x7fc1ec131f40 0x7fc1ec139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.271+0000 7fc1f1eeb700 1 --2- 172.21.15.156:0/3806269265 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1ec09e870 0x7fc1ec09ec40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.271+0000 7fc1f1eeb700 1 -- 172.21.15.156:0/3806269265 >> 172.21.15.156:0/3806269265 conn(0x7fc1ec0a4430 msgr2=0x7fc1ec0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:11.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.271+0000 7fc1f1eeb700 1 -- 172.21.15.156:0/3806269265 shutdown_connections 2023-09-30T22:21:11.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.271+0000 7fc1f1eeb700 1 -- 172.21.15.156:0/3806269265 wait complete. 2023-09-30T22:21:11.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.272+0000 7fc1f1eeb700 1 Processor -- start 2023-09-30T22:21:11.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.273+0000 7fc1f1eeb700 1 -- start start 2023-09-30T22:21:11.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.273+0000 7fc1f1eeb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1ec09e870 0x7fc1ec120210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:11.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.273+0000 7fc1f1eeb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1ec09f180 0x7fc1ec120750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:11.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.273+0000 7fc1f1eeb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1ec131f40 0x7fc1ec120c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:11.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.273+0000 7fc1f1eeb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec1216e0 con 0x7fc1ec131f40 2023-09-30T22:21:11.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.273+0000 7fc1f1eeb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec1315e0 con 0x7fc1ec09f180 2023-09-30T22:21:11.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.273+0000 7fc1f1eeb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec122cb0 con 0x7fc1ec09e870 2023-09-30T22:21:11.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.273+0000 7fc1eb7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1ec09e870 0x7fc1ec120210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:11.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.273+0000 7fc1eb7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1ec09e870 0x7fc1ec120210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:50776/0 (socket says 172.21.15.156:50776) 2023-09-30T22:21:11.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.274+0000 7fc1eb7fe700 1 -- 172.21.15.156:0/3074181211 learned_addr learned my addr 172.21.15.156:0/3074181211 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:11.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.274+0000 7fc1ebfff700 1 --2- 172.21.15.156:0/3074181211 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1ec131f40 0x7fc1ec120c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:11.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.274+0000 7fc1eaffd700 1 --2- 172.21.15.156:0/3074181211 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1ec09f180 0x7fc1ec120750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:11.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.274+0000 7fc1eb7fe700 1 -- 172.21.15.156:0/3074181211 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1ec09f180 msgr2=0x7fc1ec120750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.274+0000 7fc1eb7fe700 1 --2- 172.21.15.156:0/3074181211 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1ec09f180 0x7fc1ec120750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.274+0000 7fc1eb7fe700 1 -- 172.21.15.156:0/3074181211 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1ec131f40 msgr2=0x7fc1ec120c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.274+0000 7fc1eb7fe700 1 --2- 172.21.15.156:0/3074181211 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1ec131f40 0x7fc1ec120c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.274+0000 7fc1eb7fe700 1 -- 172.21.15.156:0/3074181211 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1dc009550 con 0x7fc1ec09e870 2023-09-30T22:21:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.274+0000 7fc1eb7fe700 1 --2- 172.21.15.156:0/3074181211 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1ec09e870 0x7fc1ec120210 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009c40 tx=0x7fc1dc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.274+0000 7fc1d3fff700 1 -- 172.21.15.156:0/3074181211 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc004510 con 0x7fc1ec09e870 2023-09-30T22:21:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.274+0000 7fc1d3fff700 1 -- 172.21.15.156:0/3074181211 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc01e070 con 0x7fc1ec09e870 2023-09-30T22:21:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.274+0000 7fc1d3fff700 1 -- 172.21.15.156:0/3074181211 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc0038a0 con 0x7fc1ec09e870 2023-09-30T22:21:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.274+0000 7fc1f1eeb700 1 -- 172.21.15.156:0/3074181211 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1ec123790 con 0x7fc1ec09e870 2023-09-30T22:21:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.274+0000 7fc1f1eeb700 1 -- 172.21.15.156:0/3074181211 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ec0a2eb0 con 0x7fc1ec09e870 2023-09-30T22:21:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.275+0000 7fc1d3fff700 1 -- 172.21.15.156:0/3074181211 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc1dc003a00 con 0x7fc1ec09e870 2023-09-30T22:21:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.275+0000 7fc1d3fff700 1 -- 172.21.15.156:0/3074181211 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc1dc040550 con 0x7fc1ec09e870 2023-09-30T22:21:11.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.275+0000 7fc1f1eeb700 1 -- 172.21.15.156:0/3074181211 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ec11d580 con 0x7fc1ec09e870 2023-09-30T22:21:11.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.280+0000 7fc1d3fff700 1 -- 172.21.15.156:0/3074181211 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc1dc015070 con 0x7fc1ec09e870 2023-09-30T22:21:11.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.297+0000 7fc9c3c4a700 1 Processor -- start 2023-09-30T22:21:11.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.297+0000 7fc9c3c4a700 1 -- start start 2023-09-30T22:21:11.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.298+0000 7fc9c3c4a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9bc099a60 0x7fc9bc1388f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:11.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.298+0000 7fc9c3c4a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc9bc138e30 0x7fc9bc13b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:11.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.298+0000 7fc9c3c4a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9bc09aa00 con 0x7fc9bc133b80 2023-09-30T22:21:11.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.298+0000 7fc9c11e5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9bc099a60 0x7fc9bc1388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:11.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.298+0000 7fc9c21e7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc9bc138e30 0x7fc9bc13b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:11.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.298+0000 7fc9c19e6700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc9bc133b80 0x7fc9bc133f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37482/0 (socket says 172.21.15.156:37482) 2023-09-30T22:21:11.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.298+0000 7fc9c19e6700 1 -- 172.21.15.156:0/3271392820 learned_addr learned my addr 172.21.15.156:0/3271392820 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:11.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.298+0000 7fc9c3c4a700 1 -- 172.21.15.156:0/3271392820 --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9bc09a080 con 0x7fc9bc138e30 2023-09-30T22:21:11.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.298+0000 7fc9c3c4a700 1 -- 172.21.15.156:0/3271392820 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc133750 con 0x7fc9bc099a60 2023-09-30T22:21:11.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.298+0000 7fc9c09e4700 1 -- 172.21.15.156:0/3271392820 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896066373 0 0) 0x7fc9bc09aa00 con 0x7fc9bc133b80 2023-09-30T22:21:11.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.298+0000 7fc9c09e4700 1 -- 172.21.15.156:0/3271392820 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9a80035b0 con 0x7fc9bc133b80 2023-09-30T22:21:11.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.298+0000 7fc9c11e5700 1 -- 172.21.15.156:0/3271392820 >> v2:172.21.15.156:3300/0 conn(0x7fc9bc138e30 msgr2=0x7fc9bc13b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:11.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.298+0000 7fc9c11e5700 1 --2- 172.21.15.156:0/3271392820 >> v2:172.21.15.156:3300/0 conn(0x7fc9bc138e30 0x7fc9bc13b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.298+0000 7fc9c11e5700 1 -- 172.21.15.156:0/3271392820 >> v1:172.21.15.156:6789/0 conn(0x7fc9bc133b80 legacy=0x7fc9bc133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:11.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.298+0000 7fc9c11e5700 1 -- 172.21.15.156:0/3271392820 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc09a760 con 0x7fc9bc099a60 2023-09-30T22:21:11.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.298+0000 7fc9c21e7700 1 --2- 172.21.15.156:0/3271392820 >> v2:172.21.15.156:3300/0 conn(0x7fc9bc138e30 0x7fc9bc13b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:11.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.299+0000 7fc9c11e5700 1 --2- 172.21.15.156:0/3271392820 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9bc099a60 0x7fc9bc1388f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009840 tx=0x7fc9ac009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a23d2bd4331edae3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:11.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.299+0000 7fc9c09e4700 1 -- 172.21.15.156:0/3271392820 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac011830 con 0x7fc9bc099a60 2023-09-30T22:21:11.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.299+0000 7fc9c09e4700 1 -- 172.21.15.156:0/3271392820 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ac011990 con 0x7fc9bc099a60 2023-09-30T22:21:11.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.299+0000 7fc9c09e4700 1 -- 172.21.15.156:0/3271392820 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac011d20 con 0x7fc9bc099a60 2023-09-30T22:21:11.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.299+0000 7fc9c3c4a700 1 -- 172.21.15.156:0/3271392820 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9bc099a60 msgr2=0x7fc9bc1388f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:11.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.299+0000 7fc9c3c4a700 1 --2- 172.21.15.156:0/3271392820 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9bc099a60 0x7fc9bc1388f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009840 tx=0x7fc9ac009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:11.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.299+0000 7fc9c3c4a700 1 -- 172.21.15.156:0/3271392820 shutdown_connections 2023-09-30T22:21:11.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.299+0000 7fc9c3c4a700 1 --2- 172.21.15.156:0/3271392820 >> v2:172.21.15.156:3300/0 conn(0x7fc9bc138e30 0x7fc9bc13b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.299+0000 7fc9c3c4a700 1 --2- 172.21.15.156:0/3271392820 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9bc099a60 0x7fc9bc1388f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.299+0000 7fc9c3c4a700 1 -- 172.21.15.156:0/3271392820 >> 172.21.15.156:0/3271392820 conn(0x7fc9bc0a2980 msgr2=0x7fc9bc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:11.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.300+0000 7fc9c3c4a700 1 -- 172.21.15.156:0/3271392820 shutdown_connections 2023-09-30T22:21:11.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.300+0000 7fc9c3c4a700 1 -- 172.21.15.156:0/3271392820 wait complete. 2023-09-30T22:21:11.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.301+0000 7fc9c3c4a700 1 Processor -- start 2023-09-30T22:21:11.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.301+0000 7fc9c3c4a700 1 -- start start 2023-09-30T22:21:11.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.301+0000 7fc9c3c4a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9bc099a60 0x7fc9bc118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:11.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.301+0000 7fc9c3c4a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9bc133b80 0x7fc9bc119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:11.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.301+0000 7fc9c3c4a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9bc138e30 0x7fc9bc119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:11.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.301+0000 7fc9c3c4a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc11c530 con 0x7fc9bc099a60 2023-09-30T22:21:11.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.301+0000 7fc9c3c4a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc1324e0 con 0x7fc9bc138e30 2023-09-30T22:21:11.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.301+0000 7fc9c3c4a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc11bcc0 con 0x7fc9bc133b80 2023-09-30T22:21:11.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.302+0000 7fc9c21e7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9bc138e30 0x7fc9bc119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:11.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.302+0000 7fc9c21e7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9bc138e30 0x7fc9bc119870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51788/0 (socket says 172.21.15.156:51788) 2023-09-30T22:21:11.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.302+0000 7fc9c21e7700 1 -- 172.21.15.156:0/438395546 learned_addr learned my addr 172.21.15.156:0/438395546 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:11.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.302+0000 7fc9c19e6700 1 --2- 172.21.15.156:0/438395546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9bc099a60 0x7fc9bc118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:11.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.302+0000 7fc9c11e5700 1 --2- 172.21.15.156:0/438395546 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9bc133b80 0x7fc9bc119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:11.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.302+0000 7fc9c19e6700 1 -- 172.21.15.156:0/438395546 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9bc133b80 msgr2=0x7fc9bc119330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:11.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.302+0000 7fc9c19e6700 1 --2- 172.21.15.156:0/438395546 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9bc133b80 0x7fc9bc119330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.302+0000 7fc9c19e6700 1 -- 172.21.15.156:0/438395546 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9bc138e30 msgr2=0x7fc9bc119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:11.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.302+0000 7fc9c19e6700 1 --2- 172.21.15.156:0/438395546 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9bc138e30 0x7fc9bc119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.302+0000 7fc9c19e6700 1 -- 172.21.15.156:0/438395546 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b4009a70 con 0x7fc9bc099a60 2023-09-30T22:21:11.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.302+0000 7fc9c21e7700 1 --2- 172.21.15.156:0/438395546 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9bc138e30 0x7fc9bc119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:11.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.302+0000 7fc9c19e6700 1 --2- 172.21.15.156:0/438395546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9bc099a60 0x7fc9bc118df0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800c4d0 tx=0x7fc9b800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:11.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.302+0000 7fc9b27fc700 1 -- 172.21.15.156:0/438395546 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b800cea0 con 0x7fc9bc099a60 2023-09-30T22:21:11.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.302+0000 7fc9b27fc700 1 -- 172.21.15.156:0/438395546 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b8005d70 con 0x7fc9bc099a60 2023-09-30T22:21:11.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.302+0000 7fc9c3c4a700 1 -- 172.21.15.156:0/438395546 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ac0094a0 con 0x7fc9bc099a60 2023-09-30T22:21:11.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.302+0000 7fc9b27fc700 1 -- 172.21.15.156:0/438395546 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b80072f0 con 0x7fc9bc099a60 2023-09-30T22:21:11.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.302+0000 7fc9c3c4a700 1 -- 172.21.15.156:0/438395546 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9bc130e50 con 0x7fc9bc099a60 2023-09-30T22:21:11.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.303+0000 7fc9b27fc700 1 -- 172.21.15.156:0/438395546 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc9b8007450 con 0x7fc9bc099a60 2023-09-30T22:21:11.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.303+0000 7fc9b27fc700 1 -- 172.21.15.156:0/438395546 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc9b803ea00 con 0x7fc9bc099a60 2023-09-30T22:21:11.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.304+0000 7fc9c3c4a700 1 -- 172.21.15.156:0/438395546 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9bc11c0d0 con 0x7fc9bc099a60 2023-09-30T22:21:11.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.308+0000 7fc9b27fc700 1 -- 172.21.15.156:0/438395546 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc9b8017080 con 0x7fc9bc099a60 2023-09-30T22:21:11.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.429+0000 7f864fce7700 1 -- 172.21.15.156:0/4115406526 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f864804f2a0 con 0x7f864806b250 2023-09-30T22:21:11.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.430+0000 7f863e7fc700 1 -- 172.21.15.156:0/4115406526 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f863802b090 con 0x7f864806b250 2023-09-30T22:21:11.431 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:11.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.433+0000 7f864fce7700 1 -- 172.21.15.156:0/4115406526 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f864806b250 msgr2=0x7f864811e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:11.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.433+0000 7f864fce7700 1 --2- 172.21.15.156:0/4115406526 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f864806b250 0x7f864811e8c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f863800e9b0 tx=0x7f863800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.433+0000 7f864fce7700 1 -- 172.21.15.156:0/4115406526 shutdown_connections 2023-09-30T22:21:11.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.433+0000 7f864fce7700 1 --2- 172.21.15.156:0/4115406526 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8648137140 0x7f864811ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.433+0000 7f864fce7700 1 --2- 172.21.15.156:0/4115406526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f864806a770 0x7f864811e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.433+0000 7f864fce7700 1 --2- 172.21.15.156:0/4115406526 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f864806b250 0x7f864811e8c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.433+0000 7f864fce7700 1 -- 172.21.15.156:0/4115406526 >> 172.21.15.156:0/4115406526 conn(0x7f8648099c40 msgr2=0x7f86480a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:11.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.433+0000 7f864fce7700 1 -- 172.21.15.156:0/4115406526 shutdown_connections 2023-09-30T22:21:11.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.433+0000 7f864fce7700 1 -- 172.21.15.156:0/4115406526 wait complete. 2023-09-30T22:21:11.450 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:11.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.482+0000 7fc1f1eeb700 1 -- 172.21.15.156:0/3074181211 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc1ec09dba0 con 0x7fc1ec09e870 2023-09-30T22:21:11.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.483+0000 7fc1d3fff700 1 -- 172.21.15.156:0/3074181211 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc1dc0239a0 con 0x7fc1ec09e870 2023-09-30T22:21:11.483 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:11.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.484+0000 7fc1f1eeb700 1 -- 172.21.15.156:0/3074181211 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1ec09e870 msgr2=0x7fc1ec120210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:11.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.484+0000 7fc1f1eeb700 1 --2- 172.21.15.156:0/3074181211 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1ec09e870 0x7fc1ec120210 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009c40 tx=0x7fc1dc004750 comp rx=0 tx=0).stop 2023-09-30T22:21:11.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.485+0000 7fc1f1eeb700 1 -- 172.21.15.156:0/3074181211 shutdown_connections 2023-09-30T22:21:11.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.485+0000 7fc1f1eeb700 1 --2- 172.21.15.156:0/3074181211 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1ec131f40 0x7fc1ec120c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.485+0000 7fc1f1eeb700 1 --2- 172.21.15.156:0/3074181211 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1ec09e870 0x7fc1ec120210 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.485+0000 7fc1f1eeb700 1 --2- 172.21.15.156:0/3074181211 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1ec09f180 0x7fc1ec120750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.485+0000 7fc1f1eeb700 1 -- 172.21.15.156:0/3074181211 >> 172.21.15.156:0/3074181211 conn(0x7fc1ec0a4430 msgr2=0x7fc1ec11a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:11.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.485+0000 7fc1f1eeb700 1 -- 172.21.15.156:0/3074181211 shutdown_connections 2023-09-30T22:21:11.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.485+0000 7fc1f1eeb700 1 -- 172.21.15.156:0/3074181211 wait complete. 2023-09-30T22:21:11.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:11.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.502+0000 7fc9c3c4a700 1 -- 172.21.15.156:0/438395546 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc9bc04f2a0 con 0x7fc9bc099a60 2023-09-30T22:21:11.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.503+0000 7fc9b27fc700 1 -- 172.21.15.156:0/438395546 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc9b8019d20 con 0x7fc9bc099a60 2023-09-30T22:21:11.503 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:11.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.505+0000 7fc9c3c4a700 1 -- 172.21.15.156:0/438395546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9bc099a60 msgr2=0x7fc9bc118df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:11.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.505+0000 7fc9c3c4a700 1 --2- 172.21.15.156:0/438395546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9bc099a60 0x7fc9bc118df0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800c4d0 tx=0x7fc9b800c7e0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.505+0000 7fc9c3c4a700 1 -- 172.21.15.156:0/438395546 shutdown_connections 2023-09-30T22:21:11.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.505+0000 7fc9c3c4a700 1 --2- 172.21.15.156:0/438395546 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9bc138e30 0x7fc9bc119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.505+0000 7fc9c3c4a700 1 --2- 172.21.15.156:0/438395546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9bc099a60 0x7fc9bc118df0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.505+0000 7fc9c3c4a700 1 --2- 172.21.15.156:0/438395546 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9bc133b80 0x7fc9bc119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:11.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.505+0000 7fc9c3c4a700 1 -- 172.21.15.156:0/438395546 >> 172.21.15.156:0/438395546 conn(0x7fc9bc0a2980 msgr2=0x7fc9bc09f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:11.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.505+0000 7fc9c3c4a700 1 -- 172.21.15.156:0/438395546 shutdown_connections 2023-09-30T22:21:11.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:11.505+0000 7fc9c3c4a700 1 -- 172.21.15.156:0/438395546 wait complete. 2023-09-30T22:21:11.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:12.170 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:12.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.302+0000 7f7763a02700 1 Processor -- start 2023-09-30T22:21:12.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.302+0000 7f7763a02700 1 -- start start 2023-09-30T22:21:12.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.302+0000 7f7763a02700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f775c09d860 0x7f775c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:12.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.302+0000 7f7763a02700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f775c09e170 0x7f775c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:12.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.302+0000 7f7763a02700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f775c130ce0 0x7f775c131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:12.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.302+0000 7f7763a02700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f775c09aaa0 con 0x7f775c130ce0 2023-09-30T22:21:12.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.302+0000 7f7763a02700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f775c09f870 con 0x7f775c09d860 2023-09-30T22:21:12.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.302+0000 7f7763a02700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f775c09b360 con 0x7f775c09e170 2023-09-30T22:21:12.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.302+0000 7f776179e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f775c09d860 0x7f775c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:12.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.302+0000 7f7760f9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f775c09e170 0x7f775c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:12.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.302+0000 7f7761f9f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f775c130ce0 0x7f775c131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:12.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.302+0000 7f776179e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f775c09d860 0x7f775c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51800/0 (socket says 172.21.15.156:51800) 2023-09-30T22:21:12.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.302+0000 7f7760f9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f775c09e170 0x7f775c1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:50794/0 (socket says 172.21.15.156:50794) 2023-09-30T22:21:12.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.302+0000 7f7761f9f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f775c130ce0 0x7f775c131150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59192/0 (socket says 172.21.15.156:59192) 2023-09-30T22:21:12.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.302+0000 7f776179e700 1 -- 172.21.15.156:0/3196792492 learned_addr learned my addr 172.21.15.156:0/3196792492 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:12.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.303+0000 7f776179e700 1 -- 172.21.15.156:0/3196792492 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f775c09e170 msgr2=0x7f775c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:12.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.303+0000 7f776179e700 1 --2- 172.21.15.156:0/3196792492 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f775c09e170 0x7f775c1307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.303+0000 7f776179e700 1 -- 172.21.15.156:0/3196792492 >> v2:172.21.15.156:3300/0 conn(0x7f775c130ce0 msgr2=0x7f775c131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:12.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.303+0000 7f776179e700 1 --2- 172.21.15.156:0/3196792492 >> v2:172.21.15.156:3300/0 conn(0x7f775c130ce0 0x7f775c131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.303+0000 7f776179e700 1 -- 172.21.15.156:0/3196792492 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f775c09b620 con 0x7f775c09d860 2023-09-30T22:21:12.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.303+0000 7f7761f9f700 1 --2- 172.21.15.156:0/3196792492 >> v2:172.21.15.156:3300/0 conn(0x7f775c130ce0 0x7f775c131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:12.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.303+0000 7f7760f9d700 1 --2- 172.21.15.156:0/3196792492 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f775c09e170 0x7f775c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:12.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.303+0000 7f776179e700 1 --2- 172.21.15.156:0/3196792492 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f775c09d860 0x7f775c09dc30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f77580098f0 tx=0x7f7758009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96909c5b05d2294a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:12.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.303+0000 7f7753fff700 1 -- 172.21.15.156:0/3196792492 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7758011830 con 0x7f775c09d860 2023-09-30T22:21:12.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.303+0000 7f7753fff700 1 -- 172.21.15.156:0/3196792492 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7758011990 con 0x7f775c09d860 2023-09-30T22:21:12.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.303+0000 7f7753fff700 1 -- 172.21.15.156:0/3196792492 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7758011d20 con 0x7f775c09d860 2023-09-30T22:21:12.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.304+0000 7f7763a02700 1 -- 172.21.15.156:0/3196792492 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f775c09d860 msgr2=0x7f775c09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:12.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.304+0000 7f7763a02700 1 --2- 172.21.15.156:0/3196792492 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f775c09d860 0x7f775c09dc30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f77580098f0 tx=0x7f7758009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:12.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.304+0000 7f7763a02700 1 -- 172.21.15.156:0/3196792492 shutdown_connections 2023-09-30T22:21:12.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.304+0000 7f7763a02700 1 --2- 172.21.15.156:0/3196792492 >> v2:172.21.15.156:3300/0 conn(0x7f775c130ce0 0x7f775c131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.304+0000 7f7763a02700 1 --2- 172.21.15.156:0/3196792492 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f775c09d860 0x7f775c09dc30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.304+0000 7f7763a02700 1 --2- 172.21.15.156:0/3196792492 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f775c09e170 0x7f775c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.304+0000 7f7763a02700 1 -- 172.21.15.156:0/3196792492 >> 172.21.15.156:0/3196792492 conn(0x7f775c099c40 msgr2=0x7f775c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:12.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.304+0000 7f7763a02700 1 -- 172.21.15.156:0/3196792492 shutdown_connections 2023-09-30T22:21:12.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.304+0000 7f7763a02700 1 -- 172.21.15.156:0/3196792492 wait complete. 2023-09-30T22:21:12.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.305+0000 7f7763a02700 1 Processor -- start 2023-09-30T22:21:12.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.305+0000 7f7763a02700 1 -- start start 2023-09-30T22:21:12.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.305+0000 7f7763a02700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f775c09d860 0x7f775c122490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:12.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.305+0000 7f7763a02700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f775c09e170 0x7f775c1229d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:12.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.305+0000 7f7763a02700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f775c130ce0 0x7f775c122f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:12.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.305+0000 7f7763a02700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775c125f20 con 0x7f775c09d860 2023-09-30T22:21:12.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.305+0000 7f7763a02700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f775c124010 con 0x7f775c130ce0 2023-09-30T22:21:12.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.305+0000 7f7763a02700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f775c0a0770 con 0x7f775c09e170 2023-09-30T22:21:12.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.305+0000 7f776179e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f775c09d860 0x7f775c122490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:12.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.305+0000 7f776179e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f775c09d860 0x7f775c122490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59208/0 (socket says 172.21.15.156:59208) 2023-09-30T22:21:12.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.305+0000 7f776179e700 1 -- 172.21.15.156:0/3953644772 learned_addr learned my addr 172.21.15.156:0/3953644772 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:12.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.305+0000 7f7761f9f700 1 --2- 172.21.15.156:0/3953644772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f775c130ce0 0x7f775c122f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:12.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.305+0000 7f7760f9d700 1 --2- 172.21.15.156:0/3953644772 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f775c09e170 0x7f775c1229d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:12.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.305+0000 7f776179e700 1 -- 172.21.15.156:0/3953644772 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f775c09e170 msgr2=0x7f775c1229d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:12.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.305+0000 7f776179e700 1 --2- 172.21.15.156:0/3953644772 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f775c09e170 0x7f775c1229d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.305+0000 7f776179e700 1 -- 172.21.15.156:0/3953644772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f775c130ce0 msgr2=0x7f775c122f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:12.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.305+0000 7f776179e700 1 --2- 172.21.15.156:0/3953644772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f775c130ce0 0x7f775c122f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.305+0000 7f776179e700 1 -- 172.21.15.156:0/3953644772 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f774c00b740 con 0x7f775c09d860 2023-09-30T22:21:12.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.305+0000 7f7761f9f700 1 --2- 172.21.15.156:0/3953644772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f775c130ce0 0x7f775c122f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:12.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.305+0000 7f776179e700 1 --2- 172.21.15.156:0/3953644772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f775c09d860 0x7f775c122490 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7758000c00 tx=0x7f7758004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:12.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.306+0000 7f7751ffb700 1 -- 172.21.15.156:0/3953644772 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7758004450 con 0x7f775c09d860 2023-09-30T22:21:12.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.306+0000 7f7751ffb700 1 -- 172.21.15.156:0/3953644772 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77580045b0 con 0x7f775c09d860 2023-09-30T22:21:12.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.306+0000 7f7763a02700 1 -- 172.21.15.156:0/3953644772 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7754009a70 con 0x7f775c09d860 2023-09-30T22:21:12.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.306+0000 7f7751ffb700 1 -- 172.21.15.156:0/3953644772 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77580038c0 con 0x7f775c09d860 2023-09-30T22:21:12.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.306+0000 7f7763a02700 1 -- 172.21.15.156:0/3953644772 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7758009550 con 0x7f775c09d860 2023-09-30T22:21:12.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.307+0000 7f7751ffb700 1 -- 172.21.15.156:0/3953644772 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7758021070 con 0x7f775c09d860 2023-09-30T22:21:12.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.307+0000 7f7751ffb700 1 -- 172.21.15.156:0/3953644772 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f77580409a0 con 0x7f775c09d860 2023-09-30T22:21:12.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.307+0000 7f7763a02700 1 -- 172.21.15.156:0/3953644772 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f775c04f2a0 con 0x7f775c09d860 2023-09-30T22:21:12.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.312+0000 7f7751ffb700 1 -- 172.21.15.156:0/3953644772 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7758029080 con 0x7f775c09d860 2023-09-30T22:21:12.451 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:12.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.496+0000 7f7763a02700 1 -- 172.21.15.156:0/3953644772 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f775c125aa0 con 0x7f775c09d860 2023-09-30T22:21:12.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.497+0000 7f7751ffb700 1 -- 172.21.15.156:0/3953644772 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f775c125aa0 con 0x7f775c09d860 2023-09-30T22:21:12.497 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:12.498 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:12.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.499+0000 7f7763a02700 1 -- 172.21.15.156:0/3953644772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f775c09d860 msgr2=0x7f775c122490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:12.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.499+0000 7f7763a02700 1 --2- 172.21.15.156:0/3953644772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f775c09d860 0x7f775c122490 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7758000c00 tx=0x7f7758004750 comp rx=0 tx=0).stop 2023-09-30T22:21:12.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.499+0000 7f7763a02700 1 -- 172.21.15.156:0/3953644772 shutdown_connections 2023-09-30T22:21:12.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.499+0000 7f7763a02700 1 --2- 172.21.15.156:0/3953644772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f775c130ce0 0x7f775c122f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.499+0000 7f7763a02700 1 --2- 172.21.15.156:0/3953644772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f775c09d860 0x7f775c122490 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.499+0000 7f7763a02700 1 --2- 172.21.15.156:0/3953644772 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f775c09e170 0x7f775c1229d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.499+0000 7f7763a02700 1 -- 172.21.15.156:0/3953644772 >> 172.21.15.156:0/3953644772 conn(0x7f775c099c40 msgr2=0x7f775c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:12.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.499+0000 7f7763a02700 1 -- 172.21.15.156:0/3953644772 shutdown_connections 2023-09-30T22:21:12.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.499+0000 7f7763a02700 1 -- 172.21.15.156:0/3953644772 wait complete. 2023-09-30T22:21:12.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:12.518 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:12.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.580+0000 7f9fcbcc2700 1 Processor -- start 2023-09-30T22:21:12.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.580+0000 7f9fcbcc2700 1 -- start start 2023-09-30T22:21:12.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.581+0000 7f9fcbcc2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fc4138410 0x7f9fc40a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:12.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.581+0000 7f9fcbcc2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fc413dd10 0x7f9fc41400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:12.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.581+0000 7f9fcbcc2700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc41379e0 con 0x7f9fc4138040 2023-09-30T22:21:12.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.581+0000 7f9fcbcc2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc40a2100 con 0x7f9fc413dd10 2023-09-30T22:21:12.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.581+0000 7f9fcbcc2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc409b9b0 con 0x7f9fc4138410 2023-09-30T22:21:12.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.581+0000 7f9fc925d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fc4138410 0x7f9fc40a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:12.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.581+0000 7f9fc925d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fc4138410 0x7f9fc40a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:50808/0 (socket says 172.21.15.156:50808) 2023-09-30T22:21:12.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.581+0000 7f9fc925d700 1 -- 172.21.15.156:0/3055453731 learned_addr learned my addr 172.21.15.156:0/3055453731 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:12.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.581+0000 7f9fca25f700 1 --2- 172.21.15.156:0/3055453731 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fc413dd10 0x7f9fc41400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:12.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.581+0000 7f9fc925d700 1 -- 172.21.15.156:0/3055453731 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fc413dd10 msgr2=0x7f9fc41400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:12.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.581+0000 7f9fc8a5c700 1 -- 172.21.15.156:0/3055453731 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 736747077 0 0) 0x7f9fc41379e0 con 0x7f9fc4138040 2023-09-30T22:21:12.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.581+0000 7f9fc925d700 1 --2- 172.21.15.156:0/3055453731 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fc413dd10 0x7f9fc41400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.581+0000 7f9fc925d700 1 -- 172.21.15.156:0/3055453731 >> v1:172.21.15.156:6789/0 conn(0x7f9fc4138040 legacy=0x7f9fc40a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:12.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.581+0000 7f9fc925d700 1 -- 172.21.15.156:0/3055453731 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc4137c10 con 0x7f9fc4138410 2023-09-30T22:21:12.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.581+0000 7f9fca25f700 1 --2- 172.21.15.156:0/3055453731 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fc413dd10 0x7f9fc41400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:12.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.581+0000 7f9fc925d700 1 --2- 172.21.15.156:0/3055453731 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fc4138410 0x7f9fc40a0ff0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4009950 tx=0x7f9fb4009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc269b1e648ce4a0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:12.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.582+0000 7f9fc8a5c700 1 -- 172.21.15.156:0/3055453731 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4011830 con 0x7f9fc4138410 2023-09-30T22:21:12.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.582+0000 7f9fc8a5c700 1 -- 172.21.15.156:0/3055453731 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb4011990 con 0x7f9fc4138410 2023-09-30T22:21:12.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.582+0000 7f9fc8a5c700 1 -- 172.21.15.156:0/3055453731 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4011d40 con 0x7f9fc4138410 2023-09-30T22:21:12.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.582+0000 7f9fcbcc2700 1 -- 172.21.15.156:0/3055453731 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fc4138410 msgr2=0x7f9fc40a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:12.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.582+0000 7f9fcbcc2700 1 --2- 172.21.15.156:0/3055453731 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fc4138410 0x7f9fc40a0ff0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4009950 tx=0x7f9fb4009c60 comp rx=0 tx=0).stop 2023-09-30T22:21:12.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.582+0000 7f9fcbcc2700 1 -- 172.21.15.156:0/3055453731 shutdown_connections 2023-09-30T22:21:12.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.582+0000 7f9fcbcc2700 1 --2- 172.21.15.156:0/3055453731 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fc413dd10 0x7f9fc41400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.582+0000 7f9fcbcc2700 1 --2- 172.21.15.156:0/3055453731 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fc4138410 0x7f9fc40a0ff0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.582+0000 7f9fcbcc2700 1 -- 172.21.15.156:0/3055453731 >> 172.21.15.156:0/3055453731 conn(0x7f9fc40a2980 msgr2=0x7f9fc40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:12.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.583+0000 7f9fcbcc2700 1 -- 172.21.15.156:0/3055453731 shutdown_connections 2023-09-30T22:21:12.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.583+0000 7f9fcbcc2700 1 -- 172.21.15.156:0/3055453731 wait complete. 2023-09-30T22:21:12.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.583+0000 7f9fcbcc2700 1 Processor -- start 2023-09-30T22:21:12.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.584+0000 7f9fcbcc2700 1 -- start start 2023-09-30T22:21:12.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.584+0000 7f9fcbcc2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fc4138040 0x7f9fc4121600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:12.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.584+0000 7f9fcbcc2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fc4138410 0x7f9fc4121b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:12.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.584+0000 7f9fcbcc2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fc413dd10 0x7f9fc4122080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:12.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.584+0000 7f9fcbcc2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc41237d0 con 0x7f9fc413dd10 2023-09-30T22:21:12.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.584+0000 7f9fcbcc2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc4125090 con 0x7f9fc4138040 2023-09-30T22:21:12.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.584+0000 7f9fcbcc2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc409f050 con 0x7f9fc4138410 2023-09-30T22:21:12.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.584+0000 7f9fc925d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fc4138410 0x7f9fc4121b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:12.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.584+0000 7f9fc925d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fc4138410 0x7f9fc4121b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:50812/0 (socket says 172.21.15.156:50812) 2023-09-30T22:21:12.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.584+0000 7f9fc925d700 1 -- 172.21.15.156:0/1283025752 learned_addr learned my addr 172.21.15.156:0/1283025752 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:12.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.584+0000 7f9fc9a5e700 1 --2- 172.21.15.156:0/1283025752 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fc4138040 0x7f9fc4121600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:12.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.584+0000 7f9fca25f700 1 --2- 172.21.15.156:0/1283025752 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fc413dd10 0x7f9fc4122080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:12.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.584+0000 7f9fc925d700 1 -- 172.21.15.156:0/1283025752 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fc4138040 msgr2=0x7f9fc4121600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:12.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.584+0000 7f9fc925d700 1 --2- 172.21.15.156:0/1283025752 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fc4138040 0x7f9fc4121600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.584+0000 7f9fc925d700 1 -- 172.21.15.156:0/1283025752 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fc413dd10 msgr2=0x7f9fc4122080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:12.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.584+0000 7f9fc925d700 1 --2- 172.21.15.156:0/1283025752 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fc413dd10 0x7f9fc4122080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.585+0000 7f9fc925d700 1 -- 172.21.15.156:0/1283025752 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fbc009a70 con 0x7f9fc4138410 2023-09-30T22:21:12.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.585+0000 7f9fc9a5e700 1 --2- 172.21.15.156:0/1283025752 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fc4138040 0x7f9fc4121600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:12.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.585+0000 7f9fca25f700 1 --2- 172.21.15.156:0/1283025752 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fc413dd10 0x7f9fc4122080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:12.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.585+0000 7f9fc925d700 1 --2- 172.21.15.156:0/1283025752 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fc4138410 0x7f9fc4121b40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4000c00 tx=0x7f9fb4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:12.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.585+0000 7f9fba7fc700 1 -- 172.21.15.156:0/1283025752 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb401a830 con 0x7f9fc4138410 2023-09-30T22:21:12.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.585+0000 7f9fba7fc700 1 -- 172.21.15.156:0/1283025752 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb401e070 con 0x7f9fc4138410 2023-09-30T22:21:12.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.585+0000 7f9fcbcc2700 1 -- 172.21.15.156:0/1283025752 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb4009550 con 0x7f9fc4138410 2023-09-30T22:21:12.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.585+0000 7f9fba7fc700 1 -- 172.21.15.156:0/1283025752 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb401abb0 con 0x7f9fc4138410 2023-09-30T22:21:12.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.585+0000 7f9fcbcc2700 1 -- 172.21.15.156:0/1283025752 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc4124820 con 0x7f9fc4138410 2023-09-30T22:21:12.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.586+0000 7f9fba7fc700 1 -- 172.21.15.156:0/1283025752 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9fb401ad10 con 0x7f9fc4138410 2023-09-30T22:21:12.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.586+0000 7f9fba7fc700 1 -- 172.21.15.156:0/1283025752 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9fb4040640 con 0x7f9fc4138410 2023-09-30T22:21:12.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.586+0000 7f9fcbcc2700 1 -- 172.21.15.156:0/1283025752 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc41239d0 con 0x7f9fc4138410 2023-09-30T22:21:12.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.591+0000 7f9fba7fc700 1 -- 172.21.15.156:0/1283025752 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9fb4015080 con 0x7f9fc4138410 2023-09-30T22:21:12.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.629+0000 7f0065c73700 1 Processor -- start 2023-09-30T22:21:12.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.629+0000 7f0065c73700 1 -- start start 2023-09-30T22:21:12.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.630+0000 7f0065c73700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f00600a1550 0x7f0060138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:12.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.630+0000 7f0065c73700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0060139200 0x7f006013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:12.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.630+0000 7f0065c73700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f006009e9d0 con 0x7f00600a0a70 2023-09-30T22:21:12.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.630+0000 7f0065c73700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f006009dc00 con 0x7f0060139200 2023-09-30T22:21:12.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.630+0000 7f0065c73700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f006009dec0 con 0x7f00600a1550 2023-09-30T22:21:12.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.630+0000 7f005effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f00600a1550 0x7f0060138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:12.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.630+0000 7f005f7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f00600a0a70 0x7f00600a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37486/0 (socket says 172.21.15.156:37486) 2023-09-30T22:21:12.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.630+0000 7f005ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0060139200 0x7f006013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:12.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.630+0000 7f005f7fe700 1 -- 172.21.15.156:0/46791252 learned_addr learned my addr 172.21.15.156:0/46791252 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:12.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.630+0000 7f005effd700 1 -- 172.21.15.156:0/46791252 >> v2:172.21.15.156:3300/0 conn(0x7f0060139200 msgr2=0x7f006013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:12.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.630+0000 7f005effd700 1 --2- 172.21.15.156:0/46791252 >> v2:172.21.15.156:3300/0 conn(0x7f0060139200 0x7f006013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.630+0000 7f005effd700 1 -- 172.21.15.156:0/46791252 >> v1:172.21.15.156:6789/0 conn(0x7f00600a0a70 legacy=0x7f00600a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:12.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.630+0000 7f005e7fc700 1 -- 172.21.15.156:0/46791252 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3734753307 0 0) 0x7f006009e9d0 con 0x7f00600a0a70 2023-09-30T22:21:12.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.630+0000 7f005effd700 1 -- 172.21.15.156:0/46791252 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006009e6a0 con 0x7f00600a1550 2023-09-30T22:21:12.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.630+0000 7f005ffff700 1 --2- 172.21.15.156:0/46791252 >> v2:172.21.15.156:3300/0 conn(0x7f0060139200 0x7f006013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:12.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.631+0000 7f005effd700 1 --2- 172.21.15.156:0/46791252 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f00600a1550 0x7f0060138cc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0054009840 tx=0x7f0054009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d9cfb32a3ed7ed6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:12.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.631+0000 7f005e7fc700 1 -- 172.21.15.156:0/46791252 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0054011830 con 0x7f00600a1550 2023-09-30T22:21:12.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.631+0000 7f005e7fc700 1 -- 172.21.15.156:0/46791252 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0054011990 con 0x7f00600a1550 2023-09-30T22:21:12.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.631+0000 7f005e7fc700 1 -- 172.21.15.156:0/46791252 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0054011d20 con 0x7f00600a1550 2023-09-30T22:21:12.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.631+0000 7f0065c73700 1 -- 172.21.15.156:0/46791252 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f00600a1550 msgr2=0x7f0060138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:12.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.631+0000 7f0065c73700 1 --2- 172.21.15.156:0/46791252 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f00600a1550 0x7f0060138cc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0054009840 tx=0x7f0054009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:12.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.631+0000 7f0065c73700 1 -- 172.21.15.156:0/46791252 shutdown_connections 2023-09-30T22:21:12.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.631+0000 7f0065c73700 1 --2- 172.21.15.156:0/46791252 >> v2:172.21.15.156:3300/0 conn(0x7f0060139200 0x7f006013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.631+0000 7f0065c73700 1 --2- 172.21.15.156:0/46791252 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f00600a1550 0x7f0060138cc0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.631+0000 7f0065c73700 1 -- 172.21.15.156:0/46791252 >> 172.21.15.156:0/46791252 conn(0x7f00600a6610 msgr2=0x7f00600a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:12.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.631+0000 7f0065c73700 1 -- 172.21.15.156:0/46791252 shutdown_connections 2023-09-30T22:21:12.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.631+0000 7f0065c73700 1 -- 172.21.15.156:0/46791252 wait complete. 2023-09-30T22:21:12.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.633+0000 7f0065c73700 1 Processor -- start 2023-09-30T22:21:12.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.633+0000 7f0065c73700 1 -- start start 2023-09-30T22:21:12.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.633+0000 7f0065c73700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00600a0a70 0x7f006011e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:12.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.633+0000 7f0065c73700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00600a1550 0x7f006011ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:12.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.633+0000 7f0065c73700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0060139200 0x7f006011f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:12.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.634+0000 7f0065c73700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006009cbb0 con 0x7f00600a1550 2023-09-30T22:21:12.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.634+0000 7f0065c73700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0060122370 con 0x7f00600a0a70 2023-09-30T22:21:12.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.634+0000 7f0065c73700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0060121a10 con 0x7f0060139200 2023-09-30T22:21:12.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.634+0000 7f005effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00600a1550 0x7f006011ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:12.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.634+0000 7f005effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00600a1550 0x7f006011ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59244/0 (socket says 172.21.15.156:59244) 2023-09-30T22:21:12.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.634+0000 7f005effd700 1 -- 172.21.15.156:0/569818432 learned_addr learned my addr 172.21.15.156:0/569818432 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:12.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.634+0000 7f005f7fe700 1 --2- 172.21.15.156:0/569818432 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00600a0a70 0x7f006011e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:12.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.634+0000 7f005ffff700 1 --2- 172.21.15.156:0/569818432 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0060139200 0x7f006011f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:12.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.634+0000 7f005effd700 1 -- 172.21.15.156:0/569818432 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0060139200 msgr2=0x7f006011f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:12.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.634+0000 7f005effd700 1 --2- 172.21.15.156:0/569818432 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0060139200 0x7f006011f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.634+0000 7f005effd700 1 -- 172.21.15.156:0/569818432 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00600a0a70 msgr2=0x7f006011e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:12.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.634+0000 7f005effd700 1 --2- 172.21.15.156:0/569818432 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00600a0a70 0x7f006011e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.634+0000 7f005effd700 1 -- 172.21.15.156:0/569818432 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0058009a70 con 0x7f00600a1550 2023-09-30T22:21:12.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.634+0000 7f005effd700 1 --2- 172.21.15.156:0/569818432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00600a1550 0x7f006011ed10 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f00540090b0 tx=0x7f0054004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:12.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.634+0000 7f0047fff700 1 -- 172.21.15.156:0/569818432 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00540045d0 con 0x7f00600a1550 2023-09-30T22:21:12.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.634+0000 7f0047fff700 1 -- 172.21.15.156:0/569818432 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005401f070 con 0x7f00600a1550 2023-09-30T22:21:12.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.634+0000 7f0065c73700 1 -- 172.21.15.156:0/569818432 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00540094a0 con 0x7f00600a1550 2023-09-30T22:21:12.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.634+0000 7f0047fff700 1 -- 172.21.15.156:0/569818432 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00540038c0 con 0x7f00600a1550 2023-09-30T22:21:12.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.634+0000 7f0065c73700 1 -- 172.21.15.156:0/569818432 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0060121f80 con 0x7f00600a1550 2023-09-30T22:21:12.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.635+0000 7f0047fff700 1 -- 172.21.15.156:0/569818432 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0054003a20 con 0x7f00600a1550 2023-09-30T22:21:12.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.635+0000 7f0047fff700 1 -- 172.21.15.156:0/569818432 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0054021070 con 0x7f00600a1550 2023-09-30T22:21:12.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.635+0000 7f0065c73700 1 -- 172.21.15.156:0/569818432 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00600a03e0 con 0x7f00600a1550 2023-09-30T22:21:12.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.640+0000 7f0047fff700 1 -- 172.21.15.156:0/569818432 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0054015070 con 0x7f00600a1550 2023-09-30T22:21:12.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.684+0000 7f21018cd700 1 Processor -- start 2023-09-30T22:21:12.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.684+0000 7f21018cd700 1 -- start start 2023-09-30T22:21:12.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.684+0000 7f21018cd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f20fc0a0a70 0x7f20fc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:12.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.684+0000 7f21018cd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f20fc0a1380 0x7f20fc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:12.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.684+0000 7f21018cd700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20fc09dc00 con 0x7f20fc133f50 2023-09-30T22:21:12.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.684+0000 7f21018cd700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20fc09ea60 con 0x7f20fc0a1380 2023-09-30T22:21:12.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.684+0000 7f21018cd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc09dec0 con 0x7f20fc0a0a70 2023-09-30T22:21:12.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.684+0000 7f20fa7fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f20fc0a1380 0x7f20fc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:12.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.684+0000 7f20fa7fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f20fc0a1380 0x7f20fc133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59246/0 (socket says 172.21.15.156:59246) 2023-09-30T22:21:12.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.684+0000 7f20fa7fc700 1 -- 172.21.15.156:0/2675854911 learned_addr learned my addr 172.21.15.156:0/2675854911 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:12.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.684+0000 7f20faffd700 1 --2- 172.21.15.156:0/2675854911 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f20fc0a0a70 0x7f20fc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:12.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.684+0000 7f20fb7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f20fc133f50 0x7f20fc13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37496/0 (socket says 172.21.15.156:37496) 2023-09-30T22:21:12.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.685+0000 7f20fa7fc700 1 -- 172.21.15.156:0/2675854911 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f20fc0a0a70 msgr2=0x7f20fc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:12.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.685+0000 7f20fa7fc700 1 --2- 172.21.15.156:0/2675854911 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f20fc0a0a70 0x7f20fc0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.685+0000 7f20fa7fc700 1 -- 172.21.15.156:0/2675854911 >> v1:172.21.15.156:6789/0 conn(0x7f20fc133f50 legacy=0x7f20fc13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:12.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.685+0000 7f20fa7fc700 1 -- 172.21.15.156:0/2675854911 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20fc09e6a0 con 0x7f20fc0a1380 2023-09-30T22:21:12.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.685+0000 7f20fa7fc700 1 --2- 172.21.15.156:0/2675854911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f20fc0a1380 0x7f20fc133a10 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f20f00098f0 tx=0x7f20f0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e919a961031b5a47 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:12.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.685+0000 7f20f9ffb700 1 -- 172.21.15.156:0/2675854911 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f0011830 con 0x7f20fc0a1380 2023-09-30T22:21:12.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.685+0000 7f20f9ffb700 1 -- 172.21.15.156:0/2675854911 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f0011990 con 0x7f20fc0a1380 2023-09-30T22:21:12.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.685+0000 7f20f9ffb700 1 -- 172.21.15.156:0/2675854911 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f0011d20 con 0x7f20fc0a1380 2023-09-30T22:21:12.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.685+0000 7f21018cd700 1 -- 172.21.15.156:0/2675854911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f20fc0a1380 msgr2=0x7f20fc133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:12.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.685+0000 7f21018cd700 1 --2- 172.21.15.156:0/2675854911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f20fc0a1380 0x7f20fc133a10 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f20f00098f0 tx=0x7f20f0009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:12.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.686+0000 7f21018cd700 1 -- 172.21.15.156:0/2675854911 shutdown_connections 2023-09-30T22:21:12.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.686+0000 7f21018cd700 1 --2- 172.21.15.156:0/2675854911 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f20fc0a0a70 0x7f20fc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.686+0000 7f21018cd700 1 --2- 172.21.15.156:0/2675854911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f20fc0a1380 0x7f20fc133a10 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.686+0000 7f21018cd700 1 -- 172.21.15.156:0/2675854911 >> 172.21.15.156:0/2675854911 conn(0x7f20fc0a6610 msgr2=0x7f20fc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:12.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.686+0000 7f21018cd700 1 -- 172.21.15.156:0/2675854911 shutdown_connections 2023-09-30T22:21:12.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.686+0000 7f21018cd700 1 -- 172.21.15.156:0/2675854911 wait complete. 2023-09-30T22:21:12.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.687+0000 7f21018cd700 1 Processor -- start 2023-09-30T22:21:12.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.687+0000 7f21018cd700 1 -- start start 2023-09-30T22:21:12.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.688+0000 7f21018cd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f20fc0a0a70 0x7f20fc11e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:12.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.688+0000 7f21018cd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f20fc0a1380 0x7f20fc11ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:12.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.688+0000 7f21018cd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f20fc133f50 0x7f20fc11f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:12.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.688+0000 7f21018cd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc1222e0 con 0x7f20fc133f50 2023-09-30T22:21:12.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.688+0000 7f21018cd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc1203d0 con 0x7f20fc0a0a70 2023-09-30T22:21:12.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.688+0000 7f21018cd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc133aa0 con 0x7f20fc0a1380 2023-09-30T22:21:12.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.688+0000 7f20faffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f20fc0a0a70 0x7f20fc11e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:12.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.688+0000 7f20fa7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f20fc0a1380 0x7f20fc11ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:12.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.688+0000 7f20faffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f20fc0a0a70 0x7f20fc11e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51844/0 (socket says 172.21.15.156:51844) 2023-09-30T22:21:12.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.688+0000 7f20faffd700 1 -- 172.21.15.156:0/4094179720 learned_addr learned my addr 172.21.15.156:0/4094179720 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:12.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.688+0000 7f20fb7fe700 1 --2- 172.21.15.156:0/4094179720 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f20fc133f50 0x7f20fc11f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:12.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.688+0000 7f20faffd700 1 -- 172.21.15.156:0/4094179720 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f20fc0a1380 msgr2=0x7f20fc11ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:12.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.688+0000 7f20faffd700 1 --2- 172.21.15.156:0/4094179720 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f20fc0a1380 0x7f20fc11ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.688+0000 7f20faffd700 1 -- 172.21.15.156:0/4094179720 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f20fc133f50 msgr2=0x7f20fc11f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:12.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.688+0000 7f20faffd700 1 --2- 172.21.15.156:0/4094179720 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f20fc133f50 0x7f20fc11f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.688+0000 7f20faffd700 1 -- 172.21.15.156:0/4094179720 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f0009550 con 0x7f20fc0a0a70 2023-09-30T22:21:12.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.688+0000 7f20fb7fe700 1 --2- 172.21.15.156:0/4094179720 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f20fc133f50 0x7f20fc11f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:21:12.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.688+0000 7f20faffd700 1 --2- 172.21.15.156:0/4094179720 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f20fc0a0a70 0x7f20fc11e850 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f20ec00e9b0 tx=0x7f20ec00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:12.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.688+0000 7f20e3fff700 1 -- 172.21.15.156:0/4094179720 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec009710 con 0x7f20fc0a0a70 2023-09-30T22:21:12.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.688+0000 7f20e3fff700 1 -- 172.21.15.156:0/4094179720 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ec00c850 con 0x7f20fc0a0a70 2023-09-30T22:21:12.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.688+0000 7f21018cd700 1 -- 172.21.15.156:0/4094179720 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20fc0a03e0 con 0x7f20fc0a0a70 2023-09-30T22:21:12.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.688+0000 7f20e3fff700 1 -- 172.21.15.156:0/4094179720 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec00cbc0 con 0x7f20fc0a0a70 2023-09-30T22:21:12.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.689+0000 7f21018cd700 1 -- 172.21.15.156:0/4094179720 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20fc120b90 con 0x7f20fc0a0a70 2023-09-30T22:21:12.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.689+0000 7f20e3fff700 1 -- 172.21.15.156:0/4094179720 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f20ec00cd20 con 0x7f20fc0a0a70 2023-09-30T22:21:12.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.689+0000 7f20e3fff700 1 -- 172.21.15.156:0/4094179720 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f20ec03f780 con 0x7f20fc0a0a70 2023-09-30T22:21:12.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.690+0000 7f21018cd700 1 -- 172.21.15.156:0/4094179720 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20fc04f2a0 con 0x7f20fc0a0a70 2023-09-30T22:21:12.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.699+0000 7f20e3fff700 1 -- 172.21.15.156:0/4094179720 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f20ec01ba00 con 0x7f20fc0a0a70 2023-09-30T22:21:12.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.788+0000 7f9fcbcc2700 1 -- 172.21.15.156:0/1283025752 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9fc404f2a0 con 0x7f9fc4138410 2023-09-30T22:21:12.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.788+0000 7f9fba7fc700 1 -- 172.21.15.156:0/1283025752 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9fb4010d50 con 0x7f9fc4138410 2023-09-30T22:21:12.789 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:12.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.790+0000 7f9fcbcc2700 1 -- 172.21.15.156:0/1283025752 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fc4138410 msgr2=0x7f9fc4121b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:12.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.790+0000 7f9fcbcc2700 1 --2- 172.21.15.156:0/1283025752 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fc4138410 0x7f9fc4121b40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4000c00 tx=0x7f9fb4004750 comp rx=0 tx=0).stop 2023-09-30T22:21:12.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.790+0000 7f9fcbcc2700 1 -- 172.21.15.156:0/1283025752 shutdown_connections 2023-09-30T22:21:12.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.790+0000 7f9fcbcc2700 1 --2- 172.21.15.156:0/1283025752 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fc413dd10 0x7f9fc4122080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.790+0000 7f9fcbcc2700 1 --2- 172.21.15.156:0/1283025752 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fc4138040 0x7f9fc4121600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.790+0000 7f9fcbcc2700 1 --2- 172.21.15.156:0/1283025752 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fc4138410 0x7f9fc4121b40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.790+0000 7f9fcbcc2700 1 -- 172.21.15.156:0/1283025752 >> 172.21.15.156:0/1283025752 conn(0x7f9fc40a2980 msgr2=0x7f9fc409d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:12.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.790+0000 7f9fcbcc2700 1 -- 172.21.15.156:0/1283025752 shutdown_connections 2023-09-30T22:21:12.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.791+0000 7f9fcbcc2700 1 -- 172.21.15.156:0/1283025752 wait complete. 2023-09-30T22:21:12.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:12.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.841+0000 7f0065c73700 1 -- 172.21.15.156:0/569818432 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f006004f2a0 con 0x7f00600a1550 2023-09-30T22:21:12.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.842+0000 7f0047fff700 1 -- 172.21.15.156:0/569818432 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0054024380 con 0x7f00600a1550 2023-09-30T22:21:12.843 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:12.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.844+0000 7f0065c73700 1 -- 172.21.15.156:0/569818432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00600a1550 msgr2=0x7f006011ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:12.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.844+0000 7f0065c73700 1 --2- 172.21.15.156:0/569818432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00600a1550 0x7f006011ed10 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f00540090b0 tx=0x7f0054004750 comp rx=0 tx=0).stop 2023-09-30T22:21:12.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.844+0000 7f0065c73700 1 -- 172.21.15.156:0/569818432 shutdown_connections 2023-09-30T22:21:12.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.844+0000 7f0065c73700 1 --2- 172.21.15.156:0/569818432 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0060139200 0x7f006011f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.844+0000 7f0065c73700 1 --2- 172.21.15.156:0/569818432 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00600a0a70 0x7f006011e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.844+0000 7f0065c73700 1 --2- 172.21.15.156:0/569818432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00600a1550 0x7f006011ed10 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.844+0000 7f0065c73700 1 -- 172.21.15.156:0/569818432 >> 172.21.15.156:0/569818432 conn(0x7f00600a6610 msgr2=0x7f0060138120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:12.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.845+0000 7f0065c73700 1 -- 172.21.15.156:0/569818432 shutdown_connections 2023-09-30T22:21:12.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.845+0000 7f0065c73700 1 -- 172.21.15.156:0/569818432 wait complete. 2023-09-30T22:21:12.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:12.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.902+0000 7f21018cd700 1 -- 172.21.15.156:0/4094179720 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f20fc072980 con 0x7f20fc0a0a70 2023-09-30T22:21:12.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.902+0000 7f20e3fff700 1 -- 172.21.15.156:0/4094179720 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f20ec017020 con 0x7f20fc0a0a70 2023-09-30T22:21:12.903 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:12.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.904+0000 7f21018cd700 1 -- 172.21.15.156:0/4094179720 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f20fc0a0a70 msgr2=0x7f20fc11e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:12.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.904+0000 7f21018cd700 1 --2- 172.21.15.156:0/4094179720 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f20fc0a0a70 0x7f20fc11e850 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f20ec00e9b0 tx=0x7f20ec00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.904+0000 7f21018cd700 1 -- 172.21.15.156:0/4094179720 shutdown_connections 2023-09-30T22:21:12.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.904+0000 7f21018cd700 1 --2- 172.21.15.156:0/4094179720 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f20fc133f50 0x7f20fc11f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.904+0000 7f21018cd700 1 --2- 172.21.15.156:0/4094179720 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f20fc0a0a70 0x7f20fc11e850 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.904+0000 7f21018cd700 1 --2- 172.21.15.156:0/4094179720 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f20fc0a1380 0x7f20fc11ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:12.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.904+0000 7f21018cd700 1 -- 172.21.15.156:0/4094179720 >> 172.21.15.156:0/4094179720 conn(0x7f20fc0a6610 msgr2=0x7f20fc0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:12.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.904+0000 7f21018cd700 1 -- 172.21.15.156:0/4094179720 shutdown_connections 2023-09-30T22:21:12.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:12.904+0000 7f21018cd700 1 -- 172.21.15.156:0/4094179720 wait complete. 2023-09-30T22:21:12.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:13.515 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:13.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.642+0000 7f6b7498b700 1 Processor -- start 2023-09-30T22:21:13.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.642+0000 7f6b7498b700 1 -- start start 2023-09-30T22:21:13.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.643+0000 7f6b7498b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6b70133ad0 0x7f6b70133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:13.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.643+0000 7f6b7498b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6b701300a0 0x7f6b701304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:13.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.643+0000 7f6b7498b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b7006b2d0 con 0x7f6b701309f0 2023-09-30T22:21:13.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.643+0000 7f6b7498b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b70133610 con 0x7f6b70133ad0 2023-09-30T22:21:13.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.643+0000 7f6b7498b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7009a500 con 0x7f6b701300a0 2023-09-30T22:21:13.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.643+0000 7f6b6e59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6b70133ad0 0x7f6b70133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:13.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.643+0000 7f6b6dd9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6b701300a0 0x7f6b701304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:13.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.643+0000 7f6b6ed9d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6b701309f0 0x7f6b7013a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37502/0 (socket says 172.21.15.156:37502) 2023-09-30T22:21:13.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.643+0000 7f6b6e59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6b70133ad0 0x7f6b70133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59256/0 (socket says 172.21.15.156:59256) 2023-09-30T22:21:13.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.643+0000 7f6b6dd9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6b701300a0 0x7f6b701304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:50846/0 (socket says 172.21.15.156:50846) 2023-09-30T22:21:13.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.643+0000 7f6b6ed9d700 1 -- 172.21.15.156:0/1449035507 learned_addr learned my addr 172.21.15.156:0/1449035507 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:13.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.643+0000 7f6b6e59c700 1 -- 172.21.15.156:0/1449035507 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6b701300a0 msgr2=0x7f6b701304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:13.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.643+0000 7f6b6e59c700 1 --2- 172.21.15.156:0/1449035507 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6b701300a0 0x7f6b701304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:13.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.643+0000 7f6b6e59c700 1 -- 172.21.15.156:0/1449035507 >> v1:172.21.15.156:6789/0 conn(0x7f6b701309f0 legacy=0x7f6b7013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:13.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.643+0000 7f6b6e59c700 1 -- 172.21.15.156:0/1449035507 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b701338b0 con 0x7f6b70133ad0 2023-09-30T22:21:13.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.643+0000 7f6b6dd9b700 1 --2- 172.21.15.156:0/1449035507 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6b701300a0 0x7f6b701304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:13.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.643+0000 7f6b6e59c700 1 --2- 172.21.15.156:0/1449035507 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b70133ad0 0x7f6b70133ea0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f6b64009840 tx=0x7f6b64009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f6b16e161aebfa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:13.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.643+0000 7f6b6d59a700 1 -- 172.21.15.156:0/1449035507 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64011830 con 0x7f6b70133ad0 2023-09-30T22:21:13.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.643+0000 7f6b6d59a700 1 -- 172.21.15.156:0/1449035507 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b64011990 con 0x7f6b70133ad0 2023-09-30T22:21:13.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.643+0000 7f6b6d59a700 1 -- 172.21.15.156:0/1449035507 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64011d20 con 0x7f6b70133ad0 2023-09-30T22:21:13.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.644+0000 7f6b7498b700 1 -- 172.21.15.156:0/1449035507 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b70133ad0 msgr2=0x7f6b70133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:13.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.644+0000 7f6b7498b700 1 --2- 172.21.15.156:0/1449035507 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b70133ad0 0x7f6b70133ea0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f6b64009840 tx=0x7f6b64009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:13.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.644+0000 7f6b7498b700 1 -- 172.21.15.156:0/1449035507 shutdown_connections 2023-09-30T22:21:13.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.644+0000 7f6b7498b700 1 --2- 172.21.15.156:0/1449035507 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b70133ad0 0x7f6b70133ea0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:13.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.644+0000 7f6b7498b700 1 --2- 172.21.15.156:0/1449035507 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6b701300a0 0x7f6b701304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:13.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.644+0000 7f6b7498b700 1 -- 172.21.15.156:0/1449035507 >> 172.21.15.156:0/1449035507 conn(0x7f6b70099c40 msgr2=0x7f6b700a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:13.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.644+0000 7f6b7498b700 1 -- 172.21.15.156:0/1449035507 shutdown_connections 2023-09-30T22:21:13.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.644+0000 7f6b7498b700 1 -- 172.21.15.156:0/1449035507 wait complete. 2023-09-30T22:21:13.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.645+0000 7f6b7498b700 1 Processor -- start 2023-09-30T22:21:13.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.645+0000 7f6b7498b700 1 -- start start 2023-09-30T22:21:13.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.645+0000 7f6b7498b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6b701300a0 0x7f6b7011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:13.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.646+0000 7f6b7498b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b701309f0 0x7f6b7011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:13.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.646+0000 7f6b7498b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b70133ad0 0x7f6b7011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:13.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.646+0000 7f6b7498b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b70120b70 con 0x7f6b701309f0 2023-09-30T22:21:13.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.646+0000 7f6b7498b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b70072290 con 0x7f6b70133ad0 2023-09-30T22:21:13.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.646+0000 7f6b7498b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7011ff90 con 0x7f6b701300a0 2023-09-30T22:21:13.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.646+0000 7f6b6e59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6b701300a0 0x7f6b7011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:13.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.646+0000 7f6b6dd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b701309f0 0x7f6b7011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:13.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.646+0000 7f6b6e59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6b701300a0 0x7f6b7011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:50860/0 (socket says 172.21.15.156:50860) 2023-09-30T22:21:13.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.646+0000 7f6b6ed9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b70133ad0 0x7f6b7011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:13.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.646+0000 7f6b6dd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b701309f0 0x7f6b7011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59270/0 (socket says 172.21.15.156:59270) 2023-09-30T22:21:13.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.646+0000 7f6b6e59c700 1 -- 172.21.15.156:0/2825893364 learned_addr learned my addr 172.21.15.156:0/2825893364 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:13.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.646+0000 7f6b6e59c700 1 -- 172.21.15.156:0/2825893364 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b70133ad0 msgr2=0x7f6b7011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:13.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.646+0000 7f6b6e59c700 1 --2- 172.21.15.156:0/2825893364 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b70133ad0 0x7f6b7011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:13.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.646+0000 7f6b6e59c700 1 -- 172.21.15.156:0/2825893364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b701309f0 msgr2=0x7f6b7011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:13.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.646+0000 7f6b6e59c700 1 --2- 172.21.15.156:0/2825893364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b701309f0 0x7f6b7011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:13.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.646+0000 7f6b6e59c700 1 -- 172.21.15.156:0/2825893364 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b600094a0 con 0x7f6b701300a0 2023-09-30T22:21:13.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.646+0000 7f6b6dd9b700 1 --2- 172.21.15.156:0/2825893364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b701309f0 0x7f6b7011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:13.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.646+0000 7f6b6e59c700 1 --2- 172.21.15.156:0/2825893364 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6b701300a0 0x7f6b7011da40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6b64009fd0 tx=0x7f6b64004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:13.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.646+0000 7f6b5effd700 1 -- 172.21.15.156:0/2825893364 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b640036a0 con 0x7f6b701300a0 2023-09-30T22:21:13.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.646+0000 7f6b5effd700 1 -- 172.21.15.156:0/2825893364 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6401f070 con 0x7f6b701300a0 2023-09-30T22:21:13.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.646+0000 7f6b7498b700 1 -- 172.21.15.156:0/2825893364 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b640094a0 con 0x7f6b701300a0 2023-09-30T22:21:13.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.646+0000 7f6b5effd700 1 -- 172.21.15.156:0/2825893364 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64003a60 con 0x7f6b701300a0 2023-09-30T22:21:13.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.646+0000 7f6b7498b700 1 -- 172.21.15.156:0/2825893364 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b70120250 con 0x7f6b701300a0 2023-09-30T22:21:13.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.647+0000 7f6b5effd700 1 -- 172.21.15.156:0/2825893364 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6b64003bc0 con 0x7f6b701300a0 2023-09-30T22:21:13.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.647+0000 7f6b5effd700 1 -- 172.21.15.156:0/2825893364 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6b64021070 con 0x7f6b701300a0 2023-09-30T22:21:13.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.647+0000 7f6b7498b700 1 -- 172.21.15.156:0/2825893364 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b70120250 con 0x7f6b701300a0 2023-09-30T22:21:13.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.652+0000 7f6b5effd700 1 -- 172.21.15.156:0/2825893364 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b70120250 con 0x7f6b701300a0 2023-09-30T22:21:13.804 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:13.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.845+0000 7f6b7498b700 1 -- 172.21.15.156:0/2825893364 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6b70120250 con 0x7f6b701300a0 2023-09-30T22:21:13.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.845+0000 7f6b5effd700 1 -- 172.21.15.156:0/2825893364 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b70120250 con 0x7f6b701300a0 2023-09-30T22:21:13.846 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:13.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.847+0000 7f6b7498b700 1 -- 172.21.15.156:0/2825893364 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6b701300a0 msgr2=0x7f6b7011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:13.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.847+0000 7f6b7498b700 1 --2- 172.21.15.156:0/2825893364 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6b701300a0 0x7f6b7011da40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6b64009fd0 tx=0x7f6b64004750 comp rx=0 tx=0).stop 2023-09-30T22:21:13.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.847+0000 7f6b7498b700 1 -- 172.21.15.156:0/2825893364 shutdown_connections 2023-09-30T22:21:13.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.847+0000 7f6b7498b700 1 --2- 172.21.15.156:0/2825893364 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6b70133ad0 0x7f6b7011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:13.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.847+0000 7f6b7498b700 1 --2- 172.21.15.156:0/2825893364 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6b701300a0 0x7f6b7011da40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:13.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.847+0000 7f6b7498b700 1 --2- 172.21.15.156:0/2825893364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b701309f0 0x7f6b7011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:13.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.847+0000 7f6b7498b700 1 -- 172.21.15.156:0/2825893364 >> 172.21.15.156:0/2825893364 conn(0x7f6b70099c40 msgr2=0x7f6b700a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:13.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.847+0000 7f6b7498b700 1 -- 172.21.15.156:0/2825893364 shutdown_connections 2023-09-30T22:21:13.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.847+0000 7f6b7498b700 1 -- 172.21.15.156:0/2825893364 wait complete. 2023-09-30T22:21:13.863 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:13.865 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:13.917 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:13.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.936+0000 7f4bcb486700 1 Processor -- start 2023-09-30T22:21:13.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.936+0000 7f4bcb486700 1 -- start start 2023-09-30T22:21:13.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.936+0000 7f4bcb486700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4bc4133ad0 0x7f4bc4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:13.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.937+0000 7f4bcb486700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4bc41300a0 0x7f4bc41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:13.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.937+0000 7f4bcb486700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc406b2d0 con 0x7f4bc41309f0 2023-09-30T22:21:13.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.937+0000 7f4bcb486700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bc4133610 con 0x7f4bc41300a0 2023-09-30T22:21:13.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.937+0000 7f4bcb486700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc409a500 con 0x7f4bc4133ad0 2023-09-30T22:21:13.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.937+0000 7f4bc8a21700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4bc41300a0 0x7f4bc41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:13.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.937+0000 7f4bc9222700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4bc4133ad0 0x7f4bc4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:13.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.937+0000 7f4bc9a23700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4bc41309f0 0x7f4bc413a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37518/0 (socket says 172.21.15.156:37518) 2023-09-30T22:21:13.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.937+0000 7f4bc9a23700 1 -- 172.21.15.156:0/1457548159 learned_addr learned my addr 172.21.15.156:0/1457548159 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:13.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.937+0000 7f4bc8a21700 1 -- 172.21.15.156:0/1457548159 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4bc4133ad0 msgr2=0x7f4bc4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:13.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.937+0000 7f4bc8a21700 1 --2- 172.21.15.156:0/1457548159 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4bc4133ad0 0x7f4bc4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:13.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.937+0000 7f4bc8a21700 1 -- 172.21.15.156:0/1457548159 >> v1:172.21.15.156:6789/0 conn(0x7f4bc41309f0 legacy=0x7f4bc413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:13.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.937+0000 7f4bc8a21700 1 -- 172.21.15.156:0/1457548159 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc41338b0 con 0x7f4bc41300a0 2023-09-30T22:21:13.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.937+0000 7f4bbbfff700 1 -- 172.21.15.156:0/1457548159 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1745395010 0 0) 0x7f4bc406b2d0 con 0x7f4bc41309f0 2023-09-30T22:21:13.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.937+0000 7f4bc9222700 1 --2- 172.21.15.156:0/1457548159 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4bc4133ad0 0x7f4bc4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:13.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.937+0000 7f4bc8a21700 1 --2- 172.21.15.156:0/1457548159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4bc41300a0 0x7f4bc41304b0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4009840 tx=0x7f4bb4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2c3797653d5617 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:13.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.937+0000 7f4bbbfff700 1 -- 172.21.15.156:0/1457548159 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4011830 con 0x7f4bc41300a0 2023-09-30T22:21:13.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.937+0000 7f4bbbfff700 1 -- 172.21.15.156:0/1457548159 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb4011990 con 0x7f4bc41300a0 2023-09-30T22:21:13.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.937+0000 7f4bbbfff700 1 -- 172.21.15.156:0/1457548159 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4011d20 con 0x7f4bc41300a0 2023-09-30T22:21:13.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.938+0000 7f4bcb486700 1 -- 172.21.15.156:0/1457548159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4bc41300a0 msgr2=0x7f4bc41304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:13.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.938+0000 7f4bcb486700 1 --2- 172.21.15.156:0/1457548159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4bc41300a0 0x7f4bc41304b0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4009840 tx=0x7f4bb4009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:13.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.938+0000 7f4bcb486700 1 -- 172.21.15.156:0/1457548159 shutdown_connections 2023-09-30T22:21:13.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.938+0000 7f4bcb486700 1 --2- 172.21.15.156:0/1457548159 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4bc4133ad0 0x7f4bc4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:13.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.938+0000 7f4bcb486700 1 --2- 172.21.15.156:0/1457548159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4bc41300a0 0x7f4bc41304b0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:13.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.938+0000 7f4bcb486700 1 -- 172.21.15.156:0/1457548159 >> 172.21.15.156:0/1457548159 conn(0x7f4bc4099c40 msgr2=0x7f4bc40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:13.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.938+0000 7f4bcb486700 1 -- 172.21.15.156:0/1457548159 shutdown_connections 2023-09-30T22:21:13.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.938+0000 7f4bcb486700 1 -- 172.21.15.156:0/1457548159 wait complete. 2023-09-30T22:21:13.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.940+0000 7f4bcb486700 1 Processor -- start 2023-09-30T22:21:13.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.940+0000 7f4bcb486700 1 -- start start 2023-09-30T22:21:13.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.940+0000 7f4bcb486700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4bc41300a0 0x7f4bc411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:13.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.940+0000 7f4bcb486700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4bc41309f0 0x7f4bc411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:13.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.940+0000 7f4bcb486700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bc4133ad0 0x7f4bc411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:13.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.940+0000 7f4bcb486700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc411ffe0 con 0x7f4bc41309f0 2023-09-30T22:21:13.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.940+0000 7f4bcb486700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc411f770 con 0x7f4bc4133ad0 2023-09-30T22:21:13.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.940+0000 7f4bcb486700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc411fa40 con 0x7f4bc41300a0 2023-09-30T22:21:13.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.941+0000 7f4bc9222700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4bc41300a0 0x7f4bc411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:13.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.941+0000 7f4bc9222700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4bc41300a0 0x7f4bc411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:50876/0 (socket says 172.21.15.156:50876) 2023-09-30T22:21:13.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.941+0000 7f4bc9222700 1 -- 172.21.15.156:0/1685263296 learned_addr learned my addr 172.21.15.156:0/1685263296 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:13.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.941+0000 7f4bc9a23700 1 --2- 172.21.15.156:0/1685263296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bc4133ad0 0x7f4bc411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:13.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.941+0000 7f4bc8a21700 1 --2- 172.21.15.156:0/1685263296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4bc41309f0 0x7f4bc411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:13.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.941+0000 7f4bc9222700 1 -- 172.21.15.156:0/1685263296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bc4133ad0 msgr2=0x7f4bc411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:13.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.941+0000 7f4bc9222700 1 --2- 172.21.15.156:0/1685263296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bc4133ad0 0x7f4bc411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:13.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.941+0000 7f4bc9222700 1 -- 172.21.15.156:0/1685263296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4bc41309f0 msgr2=0x7f4bc411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:13.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.941+0000 7f4bc9222700 1 --2- 172.21.15.156:0/1685263296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4bc41309f0 0x7f4bc411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:13.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.941+0000 7f4bc9222700 1 -- 172.21.15.156:0/1685263296 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc00094a0 con 0x7f4bc41300a0 2023-09-30T22:21:13.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.941+0000 7f4bc9222700 1 --2- 172.21.15.156:0/1685263296 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4bc41300a0 0x7f4bc411da40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4bc000ec10 tx=0x7f4bc000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:13.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.941+0000 7f4bb9ffb700 1 -- 172.21.15.156:0/1685263296 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc000c850 con 0x7f4bc41300a0 2023-09-30T22:21:13.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.941+0000 7f4bb9ffb700 1 -- 172.21.15.156:0/1685263296 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc000c9b0 con 0x7f4bc41300a0 2023-09-30T22:21:13.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.941+0000 7f4bb9ffb700 1 -- 172.21.15.156:0/1685263296 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc000cd20 con 0x7f4bc41300a0 2023-09-30T22:21:13.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.941+0000 7f4bcb486700 1 -- 172.21.15.156:0/1685263296 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb40094a0 con 0x7f4bc41300a0 2023-09-30T22:21:13.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.942+0000 7f4bcb486700 1 -- 172.21.15.156:0/1685263296 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc412d890 con 0x7f4bc41300a0 2023-09-30T22:21:13.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.943+0000 7f4bcb486700 1 -- 172.21.15.156:0/1685263296 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc40a2620 con 0x7f4bc41300a0 2023-09-30T22:21:13.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.943+0000 7f4bb9ffb700 1 -- 172.21.15.156:0/1685263296 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4bc0013470 con 0x7f4bc41300a0 2023-09-30T22:21:13.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.943+0000 7f4bb9ffb700 1 -- 172.21.15.156:0/1685263296 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4bc003f800 con 0x7f4bc41300a0 2023-09-30T22:21:13.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:13.948+0000 7f4bb9ffb700 1 -- 172.21.15.156:0/1685263296 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4bc0013720 con 0x7f4bc41300a0 2023-09-30T22:21:14.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.038+0000 7f57768ba700 1 Processor -- start 2023-09-30T22:21:14.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.038+0000 7f57768ba700 1 -- start start 2023-09-30T22:21:14.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.038+0000 7f57768ba700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5770133ad0 0x7f5770133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:14.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.038+0000 7f57768ba700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f57701300a0 0x7f57701304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:14.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.038+0000 7f57768ba700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f57701309f0 0x7f577013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:14.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.038+0000 7f57768ba700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f577006b2d0 con 0x7f57701300a0 2023-09-30T22:21:14.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.038+0000 7f57768ba700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5770133610 con 0x7f57701309f0 2023-09-30T22:21:14.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.038+0000 7f57768ba700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f577009a500 con 0x7f5770133ad0 2023-09-30T22:21:14.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.038+0000 7f576f7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f57701300a0 0x7f57701304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:14.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.038+0000 7f576ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5770133ad0 0x7f5770133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:14.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.039+0000 7f576f7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f57701300a0 0x7f57701304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59314/0 (socket says 172.21.15.156:59314) 2023-09-30T22:21:14.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.039+0000 7f576ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5770133ad0 0x7f5770133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:50882/0 (socket says 172.21.15.156:50882) 2023-09-30T22:21:14.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.039+0000 7f576f7fe700 1 -- 172.21.15.156:0/2116566529 learned_addr learned my addr 172.21.15.156:0/2116566529 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:14.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.039+0000 7f5774e57700 1 --2- 172.21.15.156:0/2116566529 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f57701309f0 0x7f577013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:14.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.039+0000 7f576ffff700 1 -- 172.21.15.156:0/2116566529 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f57701309f0 msgr2=0x7f577013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:14.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.039+0000 7f576ffff700 1 --2- 172.21.15.156:0/2116566529 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f57701309f0 0x7f577013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:14.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.039+0000 7f576ffff700 1 -- 172.21.15.156:0/2116566529 >> v2:172.21.15.156:3300/0 conn(0x7f57701300a0 msgr2=0x7f57701304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:14.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.039+0000 7f576ffff700 1 --2- 172.21.15.156:0/2116566529 >> v2:172.21.15.156:3300/0 conn(0x7f57701300a0 0x7f57701304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:14.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.039+0000 7f576ffff700 1 -- 172.21.15.156:0/2116566529 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57701338b0 con 0x7f5770133ad0 2023-09-30T22:21:14.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.039+0000 7f576f7fe700 1 --2- 172.21.15.156:0/2116566529 >> v2:172.21.15.156:3300/0 conn(0x7f57701300a0 0x7f57701304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:14.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.039+0000 7f5774e57700 1 --2- 172.21.15.156:0/2116566529 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f57701309f0 0x7f577013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:14.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.039+0000 7f576ffff700 1 --2- 172.21.15.156:0/2116566529 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5770133ad0 0x7f5770133ea0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5760009840 tx=0x7f5760009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99fe0d108421a1c5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:14.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.039+0000 7f576effd700 1 -- 172.21.15.156:0/2116566529 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5760011830 con 0x7f5770133ad0 2023-09-30T22:21:14.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.039+0000 7f576effd700 1 -- 172.21.15.156:0/2116566529 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5760011990 con 0x7f5770133ad0 2023-09-30T22:21:14.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.039+0000 7f576effd700 1 -- 172.21.15.156:0/2116566529 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5760011d20 con 0x7f5770133ad0 2023-09-30T22:21:14.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.040+0000 7f57768ba700 1 -- 172.21.15.156:0/2116566529 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5770133ad0 msgr2=0x7f5770133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:14.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.040+0000 7f57768ba700 1 --2- 172.21.15.156:0/2116566529 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5770133ad0 0x7f5770133ea0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5760009840 tx=0x7f5760009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:14.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.040+0000 7f57768ba700 1 -- 172.21.15.156:0/2116566529 shutdown_connections 2023-09-30T22:21:14.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.040+0000 7f57768ba700 1 --2- 172.21.15.156:0/2116566529 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f57701309f0 0x7f577013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:14.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.040+0000 7f57768ba700 1 --2- 172.21.15.156:0/2116566529 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5770133ad0 0x7f5770133ea0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:14.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.040+0000 7f57768ba700 1 --2- 172.21.15.156:0/2116566529 >> v2:172.21.15.156:3300/0 conn(0x7f57701300a0 0x7f57701304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:14.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.040+0000 7f57768ba700 1 -- 172.21.15.156:0/2116566529 >> 172.21.15.156:0/2116566529 conn(0x7f5770099c40 msgr2=0x7f57700a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:14.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.040+0000 7f57768ba700 1 -- 172.21.15.156:0/2116566529 shutdown_connections 2023-09-30T22:21:14.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.040+0000 7f57768ba700 1 -- 172.21.15.156:0/2116566529 wait complete. 2023-09-30T22:21:14.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.041+0000 7f57768ba700 1 Processor -- start 2023-09-30T22:21:14.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.041+0000 7f57768ba700 1 -- start start 2023-09-30T22:21:14.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.041+0000 7f57768ba700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57701300a0 0x7f577011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:14.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.041+0000 7f57768ba700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f57701309f0 0x7f577011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:14.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.041+0000 7f57768ba700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5770133ad0 0x7f577011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:14.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.041+0000 7f57768ba700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577011fd90 con 0x7f57701300a0 2023-09-30T22:21:14.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.041+0000 7f57768ba700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5770071ff0 con 0x7f5770133ad0 2023-09-30T22:21:14.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.041+0000 7f57768ba700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f577011ffe0 con 0x7f57701309f0 2023-09-30T22:21:14.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.041+0000 7f576f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f57701309f0 0x7f577011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:14.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.042+0000 7f576f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f57701309f0 0x7f577011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:50888/0 (socket says 172.21.15.156:50888) 2023-09-30T22:21:14.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.042+0000 7f576f7fe700 1 -- 172.21.15.156:0/553600938 learned_addr learned my addr 172.21.15.156:0/553600938 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:14.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.042+0000 7f576ffff700 1 --2- 172.21.15.156:0/553600938 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57701300a0 0x7f577011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:14.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.042+0000 7f5774e57700 1 --2- 172.21.15.156:0/553600938 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5770133ad0 0x7f577011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:14.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.042+0000 7f576ffff700 1 -- 172.21.15.156:0/553600938 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f57701309f0 msgr2=0x7f577011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:14.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.042+0000 7f576ffff700 1 --2- 172.21.15.156:0/553600938 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f57701309f0 0x7f577011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:14.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.042+0000 7f576ffff700 1 -- 172.21.15.156:0/553600938 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5770133ad0 msgr2=0x7f577011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:14.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.042+0000 7f576ffff700 1 --2- 172.21.15.156:0/553600938 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5770133ad0 0x7f577011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:14.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.042+0000 7f576ffff700 1 -- 172.21.15.156:0/553600938 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5764009550 con 0x7f57701300a0 2023-09-30T22:21:14.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.042+0000 7f576f7fe700 1 --2- 172.21.15.156:0/553600938 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f57701309f0 0x7f577011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:14.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.042+0000 7f576ffff700 1 --2- 172.21.15.156:0/553600938 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57701300a0 0x7f577011da40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5760016000 tx=0x7f5760004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:14.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.042+0000 7f576cff9700 1 -- 172.21.15.156:0/553600938 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5760004450 con 0x7f57701300a0 2023-09-30T22:21:14.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.042+0000 7f576cff9700 1 -- 172.21.15.156:0/553600938 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57600045b0 con 0x7f57701300a0 2023-09-30T22:21:14.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.042+0000 7f57768ba700 1 -- 172.21.15.156:0/553600938 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5768009a70 con 0x7f57701300a0 2023-09-30T22:21:14.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.042+0000 7f576cff9700 1 -- 172.21.15.156:0/553600938 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57600038e0 con 0x7f57701300a0 2023-09-30T22:21:14.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.042+0000 7f57768ba700 1 -- 172.21.15.156:0/553600938 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57600094a0 con 0x7f57701300a0 2023-09-30T22:21:14.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.043+0000 7f576cff9700 1 -- 172.21.15.156:0/553600938 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5760003a40 con 0x7f57701300a0 2023-09-30T22:21:14.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.043+0000 7f576cff9700 1 -- 172.21.15.156:0/553600938 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5760040830 con 0x7f57701300a0 2023-09-30T22:21:14.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.044+0000 7f57768ba700 1 -- 172.21.15.156:0/553600938 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577012dd00 con 0x7f57701300a0 2023-09-30T22:21:14.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.048+0000 7f576cff9700 1 -- 172.21.15.156:0/553600938 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f576001a420 con 0x7f57701300a0 2023-09-30T22:21:14.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.078+0000 7f0230966700 1 Processor -- start 2023-09-30T22:21:14.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.078+0000 7f0230966700 1 -- start start 2023-09-30T22:21:14.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.079+0000 7f0230966700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f022c133ad0 0x7f022c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:14.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.079+0000 7f0230966700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f022c130bc0 0x7f022c13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:14.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.079+0000 7f0230966700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f022c06b2d0 con 0x7f022c1300a0 2023-09-30T22:21:14.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.079+0000 7f0230966700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f022c133610 con 0x7f022c133ad0 2023-09-30T22:21:14.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.079+0000 7f0230966700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f022c09a500 con 0x7f022c130bc0 2023-09-30T22:21:14.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.079+0000 7f022ad9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f022c130bc0 0x7f022c13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:14.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.079+0000 7f0229d9b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f022c1300a0 0x7f022c1304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37526/0 (socket says 172.21.15.156:37526) 2023-09-30T22:21:14.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.079+0000 7f022a59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f022c133ad0 0x7f022c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:14.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.079+0000 7f0229d9b700 1 -- 172.21.15.156:0/772244042 learned_addr learned my addr 172.21.15.156:0/772244042 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:14.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.079+0000 7f022959a700 1 -- 172.21.15.156:0/772244042 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3111898005 0 0) 0x7f022c06b2d0 con 0x7f022c1300a0 2023-09-30T22:21:14.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.079+0000 7f022ad9d700 1 -- 172.21.15.156:0/772244042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f022c133ad0 msgr2=0x7f022c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:14.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.079+0000 7f022ad9d700 1 --2- 172.21.15.156:0/772244042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f022c133ad0 0x7f022c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:14.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.080+0000 7f022ad9d700 1 -- 172.21.15.156:0/772244042 >> v1:172.21.15.156:6789/0 conn(0x7f022c1300a0 legacy=0x7f022c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:14.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.080+0000 7f022ad9d700 1 -- 172.21.15.156:0/772244042 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022c1338b0 con 0x7f022c130bc0 2023-09-30T22:21:14.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.080+0000 7f022a59c700 1 --2- 172.21.15.156:0/772244042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f022c133ad0 0x7f022c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:14.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.080+0000 7f022ad9d700 1 --2- 172.21.15.156:0/772244042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f022c130bc0 0x7f022c13b990 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0224009dc0 tx=0x7f022400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce2dbb2c000302b2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:14.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.080+0000 7f022959a700 1 -- 172.21.15.156:0/772244042 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022400e070 con 0x7f022c130bc0 2023-09-30T22:21:14.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.080+0000 7f022959a700 1 -- 172.21.15.156:0/772244042 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022400bb20 con 0x7f022c130bc0 2023-09-30T22:21:14.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.080+0000 7f022959a700 1 -- 172.21.15.156:0/772244042 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0224012430 con 0x7f022c130bc0 2023-09-30T22:21:14.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.080+0000 7f0230966700 1 -- 172.21.15.156:0/772244042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f022c130bc0 msgr2=0x7f022c13b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:14.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.080+0000 7f0230966700 1 --2- 172.21.15.156:0/772244042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f022c130bc0 0x7f022c13b990 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0224009dc0 tx=0x7f022400b330 comp rx=0 tx=0).stop 2023-09-30T22:21:14.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.081+0000 7f0230966700 1 -- 172.21.15.156:0/772244042 shutdown_connections 2023-09-30T22:21:14.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.081+0000 7f0230966700 1 --2- 172.21.15.156:0/772244042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f022c133ad0 0x7f022c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:14.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.081+0000 7f0230966700 1 --2- 172.21.15.156:0/772244042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f022c130bc0 0x7f022c13b990 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:14.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.081+0000 7f0230966700 1 -- 172.21.15.156:0/772244042 >> 172.21.15.156:0/772244042 conn(0x7f022c099c40 msgr2=0x7f022c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:14.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.081+0000 7f0230966700 1 -- 172.21.15.156:0/772244042 shutdown_connections 2023-09-30T22:21:14.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.081+0000 7f0230966700 1 -- 172.21.15.156:0/772244042 wait complete. 2023-09-30T22:21:14.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.082+0000 7f0230966700 1 Processor -- start 2023-09-30T22:21:14.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.082+0000 7f0230966700 1 -- start start 2023-09-30T22:21:14.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.082+0000 7f0230966700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f022c1300a0 0x7f022c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:14.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.082+0000 7f0230966700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f022c130bc0 0x7f022c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:14.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.082+0000 7f0230966700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f022c133ad0 0x7f022c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:14.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.082+0000 7f0230966700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022c11fd00 con 0x7f022c133ad0 2023-09-30T22:21:14.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.082+0000 7f0230966700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f022c12dd00 con 0x7f022c130bc0 2023-09-30T22:21:14.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.082+0000 7f0230966700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f022c120950 con 0x7f022c1300a0 2023-09-30T22:21:14.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.083+0000 7f0229d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f022c130bc0 0x7f022c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:14.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.083+0000 7f0229d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f022c130bc0 0x7f022c11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51890/0 (socket says 172.21.15.156:51890) 2023-09-30T22:21:14.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.083+0000 7f0229d9b700 1 -- 172.21.15.156:0/1888427368 learned_addr learned my addr 172.21.15.156:0/1888427368 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:14.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.083+0000 7f022ad9d700 1 --2- 172.21.15.156:0/1888427368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f022c133ad0 0x7f022c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:14.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.083+0000 7f0229d9b700 1 -- 172.21.15.156:0/1888427368 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f022c1300a0 msgr2=0x7f022c11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:14.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.083+0000 7f0229d9b700 1 --2- 172.21.15.156:0/1888427368 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f022c1300a0 0x7f022c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:14.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.083+0000 7f0229d9b700 1 -- 172.21.15.156:0/1888427368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f022c133ad0 msgr2=0x7f022c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:14.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.083+0000 7f0229d9b700 1 --2- 172.21.15.156:0/1888427368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f022c133ad0 0x7f022c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:14.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.083+0000 7f0229d9b700 1 -- 172.21.15.156:0/1888427368 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c0094a0 con 0x7f022c130bc0 2023-09-30T22:21:14.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.083+0000 7f0229d9b700 1 --2- 172.21.15.156:0/1888427368 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f022c130bc0 0x7f022c11df80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f022000c480 tx=0x7f022000c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:14.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.083+0000 7f021affd700 1 -- 172.21.15.156:0/1888427368 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220004c80 con 0x7f022c130bc0 2023-09-30T22:21:14.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.083+0000 7f021affd700 1 -- 172.21.15.156:0/1888427368 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0220004e00 con 0x7f022c130bc0 2023-09-30T22:21:14.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.083+0000 7f0230966700 1 -- 172.21.15.156:0/1888427368 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0224009a70 con 0x7f022c130bc0 2023-09-30T22:21:14.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.083+0000 7f021affd700 1 -- 172.21.15.156:0/1888427368 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220007310 con 0x7f022c130bc0 2023-09-30T22:21:14.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.083+0000 7f0230966700 1 -- 172.21.15.156:0/1888427368 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f022c11ee40 con 0x7f022c130bc0 2023-09-30T22:21:14.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.084+0000 7f021affd700 1 -- 172.21.15.156:0/1888427368 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0220007470 con 0x7f022c130bc0 2023-09-30T22:21:14.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.084+0000 7f021affd700 1 -- 172.21.15.156:0/1888427368 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f022003f2d0 con 0x7f022c130bc0 2023-09-30T22:21:14.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.084+0000 7f0230966700 1 -- 172.21.15.156:0/1888427368 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f022c09cb20 con 0x7f022c130bc0 2023-09-30T22:21:14.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.089+0000 7f021affd700 1 -- 172.21.15.156:0/1888427368 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0220007720 con 0x7f022c130bc0 2023-09-30T22:21:14.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.146+0000 7f4bcb486700 1 -- 172.21.15.156:0/1685263296 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4bc404f2a0 con 0x7f4bc41300a0 2023-09-30T22:21:14.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.146+0000 7f4bb9ffb700 1 -- 172.21.15.156:0/1685263296 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4bc001b3b0 con 0x7f4bc41300a0 2023-09-30T22:21:14.148 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:14.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.149+0000 7f4bcb486700 1 -- 172.21.15.156:0/1685263296 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4bc41300a0 msgr2=0x7f4bc411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:14.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.149+0000 7f4bcb486700 1 --2- 172.21.15.156:0/1685263296 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4bc41300a0 0x7f4bc411da40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4bc000ec10 tx=0x7f4bc000ef20 comp rx=0 tx=0).stop 2023-09-30T22:21:14.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.149+0000 7f4bcb486700 1 -- 172.21.15.156:0/1685263296 shutdown_connections 2023-09-30T22:21:14.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.149+0000 7f4bcb486700 1 --2- 172.21.15.156:0/1685263296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4bc4133ad0 0x7f4bc411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:14.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.149+0000 7f4bcb486700 1 --2- 172.21.15.156:0/1685263296 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4bc41300a0 0x7f4bc411da40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:14.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.149+0000 7f4bcb486700 1 --2- 172.21.15.156:0/1685263296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4bc41309f0 0x7f4bc411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:14.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.149+0000 7f4bcb486700 1 -- 172.21.15.156:0/1685263296 >> 172.21.15.156:0/1685263296 conn(0x7f4bc4099c40 msgr2=0x7f4bc4132870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:14.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.149+0000 7f4bcb486700 1 -- 172.21.15.156:0/1685263296 shutdown_connections 2023-09-30T22:21:14.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.149+0000 7f4bcb486700 1 -- 172.21.15.156:0/1685263296 wait complete. 2023-09-30T22:21:14.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:14.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.253+0000 7f57768ba700 1 -- 172.21.15.156:0/553600938 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f577004f2a0 con 0x7f57701300a0 2023-09-30T22:21:14.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.253+0000 7f576cff9700 1 -- 172.21.15.156:0/553600938 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5760015020 con 0x7f57701300a0 2023-09-30T22:21:14.255 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:14.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.256+0000 7f57768ba700 1 -- 172.21.15.156:0/553600938 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57701300a0 msgr2=0x7f577011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:14.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.256+0000 7f57768ba700 1 --2- 172.21.15.156:0/553600938 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57701300a0 0x7f577011da40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5760016000 tx=0x7f5760004750 comp rx=0 tx=0).stop 2023-09-30T22:21:14.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.256+0000 7f57768ba700 1 -- 172.21.15.156:0/553600938 shutdown_connections 2023-09-30T22:21:14.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.256+0000 7f57768ba700 1 --2- 172.21.15.156:0/553600938 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5770133ad0 0x7f577011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:14.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.256+0000 7f57768ba700 1 --2- 172.21.15.156:0/553600938 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57701300a0 0x7f577011da40 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:14.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.256+0000 7f57768ba700 1 --2- 172.21.15.156:0/553600938 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f57701309f0 0x7f577011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:14.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.256+0000 7f57768ba700 1 -- 172.21.15.156:0/553600938 >> 172.21.15.156:0/553600938 conn(0x7f5770099c40 msgr2=0x7f577012e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:14.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.256+0000 7f57768ba700 1 -- 172.21.15.156:0/553600938 shutdown_connections 2023-09-30T22:21:14.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.256+0000 7f57768ba700 1 -- 172.21.15.156:0/553600938 wait complete. 2023-09-30T22:21:14.269 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:14.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.281+0000 7f0230966700 1 -- 172.21.15.156:0/1888427368 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f022c04f2a0 con 0x7f022c130bc0 2023-09-30T22:21:14.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.281+0000 7f021affd700 1 -- 172.21.15.156:0/1888427368 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f022001bb30 con 0x7f022c130bc0 2023-09-30T22:21:14.283 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:14.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.283+0000 7f0230966700 1 -- 172.21.15.156:0/1888427368 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f022c130bc0 msgr2=0x7f022c11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:14.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.283+0000 7f0230966700 1 --2- 172.21.15.156:0/1888427368 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f022c130bc0 0x7f022c11df80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f022000c480 tx=0x7f022000c790 comp rx=0 tx=0).stop 2023-09-30T22:21:14.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.283+0000 7f0230966700 1 -- 172.21.15.156:0/1888427368 shutdown_connections 2023-09-30T22:21:14.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.283+0000 7f0230966700 1 --2- 172.21.15.156:0/1888427368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f022c133ad0 0x7f022c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:14.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.283+0000 7f0230966700 1 --2- 172.21.15.156:0/1888427368 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f022c1300a0 0x7f022c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:14.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.283+0000 7f0230966700 1 --2- 172.21.15.156:0/1888427368 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f022c130bc0 0x7f022c11df80 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:14.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.283+0000 7f0230966700 1 -- 172.21.15.156:0/1888427368 >> 172.21.15.156:0/1888427368 conn(0x7f022c099c40 msgr2=0x7f022c132b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:14.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.284+0000 7f0230966700 1 -- 172.21.15.156:0/1888427368 shutdown_connections 2023-09-30T22:21:14.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.284+0000 7f0230966700 1 -- 172.21.15.156:0/1888427368 wait complete. 2023-09-30T22:21:14.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:14.866 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:14.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.991+0000 7f3418ae5700 1 Processor -- start 2023-09-30T22:21:14.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.991+0000 7f3418ae5700 1 -- start start 2023-09-30T22:21:14.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.992+0000 7f3418ae5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f341409e340 0x7f34141359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:14.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.992+0000 7f3418ae5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3414135f20 0x7f3414138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:14.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.992+0000 7f3418ae5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f341409aaa0 con 0x7f341409d860 2023-09-30T22:21:14.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.992+0000 7f3418ae5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341409e730 con 0x7f3414135f20 2023-09-30T22:21:14.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.992+0000 7f3418ae5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f341409f870 con 0x7f341409e340 2023-09-30T22:21:14.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.992+0000 7f3411d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f341409e340 0x7f34141359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:14.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.992+0000 7f3412d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3414135f20 0x7f3414138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:14.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.992+0000 7f341259c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f341409d860 0x7f341409dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37534/0 (socket says 172.21.15.156:37534) 2023-09-30T22:21:14.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.992+0000 7f341259c700 1 -- 172.21.15.156:0/2950709078 learned_addr learned my addr 172.21.15.156:0/2950709078 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:14.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.993+0000 7f341159a700 1 -- 172.21.15.156:0/2950709078 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624328171 0 0) 0x7f341409aaa0 con 0x7f341409d860 2023-09-30T22:21:14.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.993+0000 7f341159a700 1 -- 172.21.15.156:0/2950709078 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34000035b0 con 0x7f341409d860 2023-09-30T22:21:14.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.993+0000 7f3411d9b700 1 -- 172.21.15.156:0/2950709078 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3414135f20 msgr2=0x7f3414138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:14.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.993+0000 7f3411d9b700 1 --2- 172.21.15.156:0/2950709078 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3414135f20 0x7f3414138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:14.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.993+0000 7f3411d9b700 1 -- 172.21.15.156:0/2950709078 >> v1:172.21.15.156:6789/0 conn(0x7f341409d860 legacy=0x7f341409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:14.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.993+0000 7f3411d9b700 1 -- 172.21.15.156:0/2950709078 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341409b360 con 0x7f341409e340 2023-09-30T22:21:14.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.993+0000 7f3412d9d700 1 --2- 172.21.15.156:0/2950709078 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3414135f20 0x7f3414138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:14.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.993+0000 7f3411d9b700 1 --2- 172.21.15.156:0/2950709078 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f341409e340 0x7f34141359e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f34040098a0 tx=0x7f3404009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26fb8c43fd7e02f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:14.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.993+0000 7f341159a700 1 -- 172.21.15.156:0/2950709078 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3404011830 con 0x7f341409e340 2023-09-30T22:21:14.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.993+0000 7f341159a700 1 -- 172.21.15.156:0/2950709078 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3404011990 con 0x7f341409e340 2023-09-30T22:21:14.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.993+0000 7f341159a700 1 -- 172.21.15.156:0/2950709078 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3404011d20 con 0x7f341409e340 2023-09-30T22:21:14.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.993+0000 7f3418ae5700 1 -- 172.21.15.156:0/2950709078 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f341409e340 msgr2=0x7f34141359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:14.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.993+0000 7f3418ae5700 1 --2- 172.21.15.156:0/2950709078 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f341409e340 0x7f34141359e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f34040098a0 tx=0x7f3404009bb0 comp rx=0 tx=0).stop 2023-09-30T22:21:14.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.993+0000 7f3418ae5700 1 -- 172.21.15.156:0/2950709078 shutdown_connections 2023-09-30T22:21:15.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.993+0000 7f3418ae5700 1 --2- 172.21.15.156:0/2950709078 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3414135f20 0x7f3414138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.993+0000 7f3418ae5700 1 --2- 172.21.15.156:0/2950709078 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f341409e340 0x7f34141359e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.994+0000 7f3418ae5700 1 -- 172.21.15.156:0/2950709078 >> 172.21.15.156:0/2950709078 conn(0x7f3414099c40 msgr2=0x7f34140a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:15.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.994+0000 7f3418ae5700 1 -- 172.21.15.156:0/2950709078 shutdown_connections 2023-09-30T22:21:15.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.994+0000 7f3418ae5700 1 -- 172.21.15.156:0/2950709078 wait complete. 2023-09-30T22:21:15.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.995+0000 7f3418ae5700 1 Processor -- start 2023-09-30T22:21:15.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.995+0000 7f3418ae5700 1 -- start start 2023-09-30T22:21:15.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.995+0000 7f3418ae5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f341409d860 0x7f34141c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:15.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.995+0000 7f3418ae5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f341409e340 0x7f34141c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:15.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.995+0000 7f3418ae5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3414135f20 0x7f34141c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:15.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.995+0000 7f3418ae5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3414121410 con 0x7f341409d860 2023-09-30T22:21:15.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.995+0000 7f3418ae5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34141323b0 con 0x7f3414135f20 2023-09-30T22:21:15.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.995+0000 7f3418ae5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3414123040 con 0x7f341409e340 2023-09-30T22:21:15.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.995+0000 7f341259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f341409d860 0x7f34141c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:15.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.995+0000 7f341259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f341409d860 0x7f34141c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59338/0 (socket says 172.21.15.156:59338) 2023-09-30T22:21:15.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.995+0000 7f3412d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3414135f20 0x7f34141c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:15.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.995+0000 7f341259c700 1 -- 172.21.15.156:0/64309001 learned_addr learned my addr 172.21.15.156:0/64309001 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:15.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.995+0000 7f3411d9b700 1 --2- 172.21.15.156:0/64309001 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f341409e340 0x7f34141c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:15.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.995+0000 7f3412d9d700 1 -- 172.21.15.156:0/64309001 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f341409e340 msgr2=0x7f34141c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:15.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.995+0000 7f3412d9d700 1 --2- 172.21.15.156:0/64309001 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f341409e340 0x7f34141c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.995+0000 7f3412d9d700 1 -- 172.21.15.156:0/64309001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f341409d860 msgr2=0x7f34141c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:15.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.995+0000 7f3412d9d700 1 --2- 172.21.15.156:0/64309001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f341409d860 0x7f34141c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.995+0000 7f3412d9d700 1 -- 172.21.15.156:0/64309001 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340c009a70 con 0x7f3414135f20 2023-09-30T22:21:15.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.995+0000 7f341259c700 1 --2- 172.21.15.156:0/64309001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f341409d860 0x7f34141c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:15.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.995+0000 7f3411d9b700 1 --2- 172.21.15.156:0/64309001 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f341409e340 0x7f34141c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:15.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.996+0000 7f3412d9d700 1 --2- 172.21.15.156:0/64309001 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3414135f20 0x7f34141c8bc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f340c00efc0 tx=0x7f340c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:15.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.996+0000 7f340affd700 1 -- 172.21.15.156:0/64309001 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c00ca90 con 0x7f3414135f20 2023-09-30T22:21:15.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.996+0000 7f340affd700 1 -- 172.21.15.156:0/64309001 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340c00f040 con 0x7f3414135f20 2023-09-30T22:21:15.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.996+0000 7f3418ae5700 1 -- 172.21.15.156:0/64309001 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34040094a0 con 0x7f3414135f20 2023-09-30T22:21:15.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.996+0000 7f340affd700 1 -- 172.21.15.156:0/64309001 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c00ce30 con 0x7f3414135f20 2023-09-30T22:21:15.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.996+0000 7f3418ae5700 1 -- 172.21.15.156:0/64309001 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3414122d80 con 0x7f3414135f20 2023-09-30T22:21:15.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.996+0000 7f340affd700 1 -- 172.21.15.156:0/64309001 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f340c014480 con 0x7f3414135f20 2023-09-30T22:21:15.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.997+0000 7f340affd700 1 -- 172.21.15.156:0/64309001 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f340c03fcd0 con 0x7f3414135f20 2023-09-30T22:21:15.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:14.997+0000 7f3418ae5700 1 -- 172.21.15.156:0/64309001 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f341404f2a0 con 0x7f3414135f20 2023-09-30T22:21:15.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.001+0000 7f340affd700 1 -- 172.21.15.156:0/64309001 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f340c012910 con 0x7f3414135f20 2023-09-30T22:21:15.163 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:15.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.188+0000 7f3418ae5700 1 -- 172.21.15.156:0/64309001 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f341409b670 con 0x7f3414135f20 2023-09-30T22:21:15.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.188+0000 7f340affd700 1 -- 172.21.15.156:0/64309001 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f340c012340 con 0x7f3414135f20 2023-09-30T22:21:15.189 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:15.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.190+0000 7f3418ae5700 1 -- 172.21.15.156:0/64309001 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3414135f20 msgr2=0x7f34141c8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:15.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.190+0000 7f3418ae5700 1 --2- 172.21.15.156:0/64309001 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3414135f20 0x7f34141c8bc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f340c00efc0 tx=0x7f340c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.191+0000 7f3418ae5700 1 -- 172.21.15.156:0/64309001 shutdown_connections 2023-09-30T22:21:15.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.191+0000 7f3418ae5700 1 --2- 172.21.15.156:0/64309001 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3414135f20 0x7f34141c8bc0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.191+0000 7f3418ae5700 1 --2- 172.21.15.156:0/64309001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f341409d860 0x7f34141c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.191+0000 7f3418ae5700 1 --2- 172.21.15.156:0/64309001 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f341409e340 0x7f34141c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.191+0000 7f3418ae5700 1 -- 172.21.15.156:0/64309001 >> 172.21.15.156:0/64309001 conn(0x7f3414099c40 msgr2=0x7f34140a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:15.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.191+0000 7f3418ae5700 1 -- 172.21.15.156:0/64309001 shutdown_connections 2023-09-30T22:21:15.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.191+0000 7f3418ae5700 1 -- 172.21.15.156:0/64309001 wait complete. 2023-09-30T22:21:15.204 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:15.270 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:15.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.288+0000 7f0bd1f3e700 1 Processor -- start 2023-09-30T22:21:15.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.288+0000 7f0bd1f3e700 1 -- start start 2023-09-30T22:21:15.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.289+0000 7f0bd1f3e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bcc06a770 0x7f0bcc06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:15.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.289+0000 7f0bd1f3e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0bcc136cb0 0x7f0bcc139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:15.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.289+0000 7f0bd1f3e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bcc06e900 con 0x7f0bcc09dec0 2023-09-30T22:21:15.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.289+0000 7f0bd1f3e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bcc09d180 con 0x7f0bcc136cb0 2023-09-30T22:21:15.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.289+0000 7f0bd1f3e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc09e780 con 0x7f0bcc06a770 2023-09-30T22:21:15.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.289+0000 7f0bcbfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0bcc136cb0 0x7f0bcc139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:15.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.289+0000 7f0bcb7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bcc06a770 0x7f0bcc06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:15.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.289+0000 7f0bcaffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f0bcc09dec0 0x7f0bcc06b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37538/0 (socket says 172.21.15.156:37538) 2023-09-30T22:21:15.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.289+0000 7f0bcb7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bcc06a770 0x7f0bcc06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51916/0 (socket says 172.21.15.156:51916) 2023-09-30T22:21:15.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.289+0000 7f0bcbfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0bcc136cb0 0x7f0bcc139090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59340/0 (socket says 172.21.15.156:59340) 2023-09-30T22:21:15.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.289+0000 7f0bcaffd700 1 -- 172.21.15.156:0/3680685740 learned_addr learned my addr 172.21.15.156:0/3680685740 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:15.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.289+0000 7f0bcbfff700 1 -- 172.21.15.156:0/3680685740 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bcc06a770 msgr2=0x7f0bcc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:15.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.289+0000 7f0bcbfff700 1 --2- 172.21.15.156:0/3680685740 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bcc06a770 0x7f0bcc06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.289+0000 7f0bcbfff700 1 -- 172.21.15.156:0/3680685740 >> v1:172.21.15.156:6789/0 conn(0x7f0bcc09dec0 legacy=0x7f0bcc06b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:15.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.289+0000 7f0bcbfff700 1 -- 172.21.15.156:0/3680685740 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc09d3c0 con 0x7f0bcc136cb0 2023-09-30T22:21:15.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.289+0000 7f0bca7fc700 1 -- 172.21.15.156:0/3680685740 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321299766 0 0) 0x7f0bcc06e900 con 0x7f0bcc09dec0 2023-09-30T22:21:15.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.289+0000 7f0bcb7fe700 1 --2- 172.21.15.156:0/3680685740 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bcc06a770 0x7f0bcc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:15.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.289+0000 7f0bcbfff700 1 --2- 172.21.15.156:0/3680685740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bcc136cb0 0x7f0bcc139090 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009d90 tx=0x7f0bc400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f8078c2f9107b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:15.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.289+0000 7f0bca7fc700 1 -- 172.21.15.156:0/3680685740 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc400e070 con 0x7f0bcc136cb0 2023-09-30T22:21:15.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.289+0000 7f0bca7fc700 1 -- 172.21.15.156:0/3680685740 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc400bb20 con 0x7f0bcc136cb0 2023-09-30T22:21:15.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.289+0000 7f0bca7fc700 1 -- 172.21.15.156:0/3680685740 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4012430 con 0x7f0bcc136cb0 2023-09-30T22:21:15.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.290+0000 7f0bd1f3e700 1 -- 172.21.15.156:0/3680685740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bcc136cb0 msgr2=0x7f0bcc139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:15.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.290+0000 7f0bd1f3e700 1 --2- 172.21.15.156:0/3680685740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bcc136cb0 0x7f0bcc139090 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009d90 tx=0x7f0bc400b330 comp rx=0 tx=0).stop 2023-09-30T22:21:15.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.290+0000 7f0bd1f3e700 1 -- 172.21.15.156:0/3680685740 shutdown_connections 2023-09-30T22:21:15.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.290+0000 7f0bd1f3e700 1 --2- 172.21.15.156:0/3680685740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bcc136cb0 0x7f0bcc139090 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.290+0000 7f0bd1f3e700 1 --2- 172.21.15.156:0/3680685740 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bcc06a770 0x7f0bcc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.290+0000 7f0bd1f3e700 1 -- 172.21.15.156:0/3680685740 >> 172.21.15.156:0/3680685740 conn(0x7f0bcc099c40 msgr2=0x7f0bcc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:15.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.290+0000 7f0bd1f3e700 1 -- 172.21.15.156:0/3680685740 shutdown_connections 2023-09-30T22:21:15.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.290+0000 7f0bd1f3e700 1 -- 172.21.15.156:0/3680685740 wait complete. 2023-09-30T22:21:15.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.291+0000 7f0bd1f3e700 1 Processor -- start 2023-09-30T22:21:15.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.291+0000 7f0bd1f3e700 1 -- start start 2023-09-30T22:21:15.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.292+0000 7f0bd1f3e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bcc06a770 0x7f0bcc09a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:15.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.292+0000 7f0bd1f3e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bcc09dec0 0x7f0bcc09a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:15.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.292+0000 7f0bd1f3e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bcc136cb0 0x7f0bcc09aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:15.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.292+0000 7f0bd1f3e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc12f520 con 0x7f0bcc136cb0 2023-09-30T22:21:15.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.292+0000 7f0bd1f3e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc135960 con 0x7f0bcc09dec0 2023-09-30T22:21:15.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.292+0000 7f0bd1f3e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc134930 con 0x7f0bcc06a770 2023-09-30T22:21:15.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.292+0000 7f0bcaffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bcc09dec0 0x7f0bcc09a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:15.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.292+0000 7f0bcbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bcc136cb0 0x7f0bcc09aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:15.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.292+0000 7f0bcb7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bcc06a770 0x7f0bcc09a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:15.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.292+0000 7f0bcbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bcc136cb0 0x7f0bcc09aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59344/0 (socket says 172.21.15.156:59344) 2023-09-30T22:21:15.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.292+0000 7f0bcbfff700 1 -- 172.21.15.156:0/439264203 learned_addr learned my addr 172.21.15.156:0/439264203 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:15.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.292+0000 7f0bcaffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bcc09dec0 0x7f0bcc09a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51926/0 (socket says 172.21.15.156:51926) 2023-09-30T22:21:15.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.292+0000 7f0bcaffd700 1 -- 172.21.15.156:0/439264203 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bcc06a770 msgr2=0x7f0bcc09a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:15.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.292+0000 7f0bcaffd700 1 --2- 172.21.15.156:0/439264203 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bcc06a770 0x7f0bcc09a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.292+0000 7f0bcaffd700 1 -- 172.21.15.156:0/439264203 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bcc136cb0 msgr2=0x7f0bcc09aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:15.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.292+0000 7f0bcaffd700 1 --2- 172.21.15.156:0/439264203 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bcc136cb0 0x7f0bcc09aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.292+0000 7f0bcaffd700 1 -- 172.21.15.156:0/439264203 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bbc0094a0 con 0x7f0bcc09dec0 2023-09-30T22:21:15.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.293+0000 7f0bcaffd700 1 --2- 172.21.15.156:0/439264203 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bcc09dec0 0x7f0bcc09a9a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000c470 tx=0x7f0bc000c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:15.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.293+0000 7f0bb3fff700 1 -- 172.21.15.156:0/439264203 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0004c80 con 0x7f0bcc09dec0 2023-09-30T22:21:15.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.293+0000 7f0bb3fff700 1 -- 172.21.15.156:0/439264203 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc0004de0 con 0x7f0bcc09dec0 2023-09-30T22:21:15.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.293+0000 7f0bd1f3e700 1 -- 172.21.15.156:0/439264203 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc4009a70 con 0x7f0bcc09dec0 2023-09-30T22:21:15.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.293+0000 7f0bb3fff700 1 -- 172.21.15.156:0/439264203 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0007310 con 0x7f0bcc09dec0 2023-09-30T22:21:15.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.293+0000 7f0bd1f3e700 1 -- 172.21.15.156:0/439264203 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bcc139130 con 0x7f0bcc09dec0 2023-09-30T22:21:15.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.293+0000 7f0bb3fff700 1 -- 172.21.15.156:0/439264203 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0bc0007470 con 0x7f0bcc09dec0 2023-09-30T22:21:15.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.294+0000 7f0bb3fff700 1 -- 172.21.15.156:0/439264203 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0bc003f340 con 0x7f0bcc09dec0 2023-09-30T22:21:15.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.294+0000 7f0bd1f3e700 1 -- 172.21.15.156:0/439264203 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bcc071ce0 con 0x7f0bcc09dec0 2023-09-30T22:21:15.303 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:15.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.299+0000 7f0bb3fff700 1 -- 172.21.15.156:0/439264203 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0bc0007720 con 0x7f0bcc09dec0 2023-09-30T22:21:15.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.408+0000 7f5ee4487700 1 Processor -- start 2023-09-30T22:21:15.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.408+0000 7f5ee4487700 1 -- start start 2023-09-30T22:21:15.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.408+0000 7f5ee4487700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5edc09e870 0x7f5edc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:15.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.408+0000 7f5ee4487700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5edc134330 0x7f5edc13be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:15.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.408+0000 7f5ee4487700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5edc09fa00 con 0x7f5edc09f180 2023-09-30T22:21:15.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.408+0000 7f5ee4487700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc0a0370 con 0x7f5edc134330 2023-09-30T22:21:15.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.408+0000 7f5ee4487700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc06bec0 con 0x7f5edc09e870 2023-09-30T22:21:15.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.409+0000 7f5ee2a24700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5edc134330 0x7f5edc13be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:15.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.409+0000 7f5ee2223700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5edc09e870 0x7f5edc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:15.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.409+0000 7f5ee1a22700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f5edc09f180 0x7f5edc133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37548/0 (socket says 172.21.15.156:37548) 2023-09-30T22:21:15.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.409+0000 7f5ee1a22700 1 -- 172.21.15.156:0/2275145430 learned_addr learned my addr 172.21.15.156:0/2275145430 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:15.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.409+0000 7f5ee2a24700 1 -- 172.21.15.156:0/2275145430 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5edc09e870 msgr2=0x7f5edc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:15.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.409+0000 7f5ee2a24700 1 --2- 172.21.15.156:0/2275145430 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5edc09e870 0x7f5edc09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.409+0000 7f5ee1221700 1 -- 172.21.15.156:0/2275145430 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819705420 0 0) 0x7f5edc09fa00 con 0x7f5edc09f180 2023-09-30T22:21:15.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.409+0000 7f5ee2a24700 1 -- 172.21.15.156:0/2275145430 >> v1:172.21.15.156:6789/0 conn(0x7f5edc09f180 legacy=0x7f5edc133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:15.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.409+0000 7f5ee2a24700 1 -- 172.21.15.156:0/2275145430 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc09ada0 con 0x7f5edc134330 2023-09-30T22:21:15.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.409+0000 7f5ee2223700 1 --2- 172.21.15.156:0/2275145430 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5edc09e870 0x7f5edc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:15.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.409+0000 7f5ee2a24700 1 --2- 172.21.15.156:0/2275145430 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5edc134330 0x7f5edc13be80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4009dc0 tx=0x7f5ed400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9dce3f3a28340e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:15.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.409+0000 7f5ee1221700 1 -- 172.21.15.156:0/2275145430 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed400e070 con 0x7f5edc134330 2023-09-30T22:21:15.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.409+0000 7f5ee1221700 1 -- 172.21.15.156:0/2275145430 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed400bb20 con 0x7f5edc134330 2023-09-30T22:21:15.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.409+0000 7f5ee1221700 1 -- 172.21.15.156:0/2275145430 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4012430 con 0x7f5edc134330 2023-09-30T22:21:15.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.410+0000 7f5ee4487700 1 -- 172.21.15.156:0/2275145430 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5edc134330 msgr2=0x7f5edc13be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:15.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.410+0000 7f5ee4487700 1 --2- 172.21.15.156:0/2275145430 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5edc134330 0x7f5edc13be80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4009dc0 tx=0x7f5ed400b330 comp rx=0 tx=0).stop 2023-09-30T22:21:15.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.410+0000 7f5ee4487700 1 -- 172.21.15.156:0/2275145430 shutdown_connections 2023-09-30T22:21:15.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.410+0000 7f5ee4487700 1 --2- 172.21.15.156:0/2275145430 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5edc134330 0x7f5edc13be80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.410+0000 7f5ee4487700 1 --2- 172.21.15.156:0/2275145430 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5edc09e870 0x7f5edc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.410+0000 7f5ee4487700 1 -- 172.21.15.156:0/2275145430 >> 172.21.15.156:0/2275145430 conn(0x7f5edc0a4430 msgr2=0x7f5edc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:15.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.410+0000 7f5ee4487700 1 -- 172.21.15.156:0/2275145430 shutdown_connections 2023-09-30T22:21:15.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.410+0000 7f5ee4487700 1 -- 172.21.15.156:0/2275145430 wait complete. 2023-09-30T22:21:15.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.412+0000 7f5ee4487700 1 Processor -- start 2023-09-30T22:21:15.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.412+0000 7f5ee4487700 1 -- start start 2023-09-30T22:21:15.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.412+0000 7f5ee4487700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5edc09e870 0x7f5edc1227b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:15.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.412+0000 7f5ee4487700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5edc09f180 0x7f5edc122cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:15.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.412+0000 7f5ee4487700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5edc134330 0x7f5edc123230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:15.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.412+0000 7f5ee4487700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc125670 con 0x7f5edc09f180 2023-09-30T22:21:15.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.413+0000 7f5ee4487700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc0a1580 con 0x7f5edc134330 2023-09-30T22:21:15.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.413+0000 7f5ee4487700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc1248e0 con 0x7f5edc09e870 2023-09-30T22:21:15.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.413+0000 7f5ee1a22700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5edc09f180 0x7f5edc122cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:15.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.413+0000 7f5ee2a24700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5edc134330 0x7f5edc123230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:15.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.413+0000 7f5ee1a22700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5edc09f180 0x7f5edc122cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59348/0 (socket says 172.21.15.156:59348) 2023-09-30T22:21:15.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.413+0000 7f5ee1a22700 1 -- 172.21.15.156:0/2133053651 learned_addr learned my addr 172.21.15.156:0/2133053651 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:15.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.413+0000 7f5ee2223700 1 --2- 172.21.15.156:0/2133053651 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5edc09e870 0x7f5edc1227b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:15.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.413+0000 7f5ee2a24700 1 -- 172.21.15.156:0/2133053651 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5edc09e870 msgr2=0x7f5edc1227b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:15.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.413+0000 7f5ee2a24700 1 --2- 172.21.15.156:0/2133053651 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5edc09e870 0x7f5edc1227b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.413+0000 7f5ee2a24700 1 -- 172.21.15.156:0/2133053651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5edc09f180 msgr2=0x7f5edc122cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:15.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.413+0000 7f5ee2a24700 1 --2- 172.21.15.156:0/2133053651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5edc09f180 0x7f5edc122cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.413+0000 7f5ee2a24700 1 -- 172.21.15.156:0/2133053651 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed80094a0 con 0x7f5edc134330 2023-09-30T22:21:15.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.413+0000 7f5ee1a22700 1 --2- 172.21.15.156:0/2133053651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5edc09f180 0x7f5edc122cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:15.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.413+0000 7f5ee2a24700 1 --2- 172.21.15.156:0/2133053651 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5edc134330 0x7f5edc123230 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5edc0673f0 tx=0x7f5ed4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:15.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.413+0000 7f5ed2ffd700 1 -- 172.21.15.156:0/2133053651 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4012430 con 0x7f5edc134330 2023-09-30T22:21:15.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.413+0000 7f5ed2ffd700 1 -- 172.21.15.156:0/2133053651 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed4020070 con 0x7f5edc134330 2023-09-30T22:21:15.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.413+0000 7f5ee4487700 1 -- 172.21.15.156:0/2133053651 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed4009a70 con 0x7f5edc134330 2023-09-30T22:21:15.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.413+0000 7f5ed2ffd700 1 -- 172.21.15.156:0/2133053651 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4004280 con 0x7f5edc134330 2023-09-30T22:21:15.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.413+0000 7f5ee4487700 1 -- 172.21.15.156:0/2133053651 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5edc125160 con 0x7f5edc134330 2023-09-30T22:21:15.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.414+0000 7f5ed2ffd700 1 -- 172.21.15.156:0/2133053651 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ed40043e0 con 0x7f5edc134330 2023-09-30T22:21:15.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.414+0000 7f5ed2ffd700 1 -- 172.21.15.156:0/2133053651 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5ed4022070 con 0x7f5edc134330 2023-09-30T22:21:15.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.415+0000 7f5ee4487700 1 -- 172.21.15.156:0/2133053651 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5edc04f2a0 con 0x7f5edc134330 2023-09-30T22:21:15.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.419+0000 7f5ed2ffd700 1 -- 172.21.15.156:0/2133053651 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ed401c400 con 0x7f5edc134330 2023-09-30T22:21:15.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.432+0000 7fcf5f6ec700 1 Processor -- start 2023-09-30T22:21:15.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.433+0000 7fcf5f6ec700 1 -- start start 2023-09-30T22:21:15.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.433+0000 7fcf5f6ec700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcf580a0a70 0x7fcf580a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:15.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.433+0000 7fcf5f6ec700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf58134120 0x7fcf5813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:15.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.433+0000 7fcf5f6ec700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5809dc00 con 0x7fcf580a1380 2023-09-30T22:21:15.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.433+0000 7fcf5f6ec700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5809ea90 con 0x7fcf580a0a70 2023-09-30T22:21:15.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.433+0000 7fcf5f6ec700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5809dec0 con 0x7fcf58134120 2023-09-30T22:21:15.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.433+0000 7fcf5d488700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcf580a0a70 0x7fcf580a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:15.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.433+0000 7fcf5cc87700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fcf580a1380 0x7fcf58133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37564/0 (socket says 172.21.15.156:37564) 2023-09-30T22:21:15.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.433+0000 7fcf5cc87700 1 -- 172.21.15.156:0/1104220669 learned_addr learned my addr 172.21.15.156:0/1104220669 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:15.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.433+0000 7fcf5dc89700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf58134120 0x7fcf5813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:15.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.434+0000 7fcf5d488700 1 -- 172.21.15.156:0/1104220669 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf58134120 msgr2=0x7fcf5813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:15.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.434+0000 7fcf5d488700 1 --2- 172.21.15.156:0/1104220669 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf58134120 0x7fcf5813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.434+0000 7fcf5d488700 1 -- 172.21.15.156:0/1104220669 >> v1:172.21.15.156:6789/0 conn(0x7fcf580a1380 legacy=0x7fcf58133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:15.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.434+0000 7fcf5d488700 1 -- 172.21.15.156:0/1104220669 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5809e6a0 con 0x7fcf580a0a70 2023-09-30T22:21:15.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.434+0000 7fcf5dc89700 1 --2- 172.21.15.156:0/1104220669 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf58134120 0x7fcf5813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:15.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.434+0000 7fcf5d488700 1 --2- 172.21.15.156:0/1104220669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf580a0a70 0x7fcf580a0e40 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009840 tx=0x7fcf54009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9dc378d6a18433d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:15.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.434+0000 7fcf4ffff700 1 -- 172.21.15.156:0/1104220669 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf54011830 con 0x7fcf580a0a70 2023-09-30T22:21:15.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.434+0000 7fcf4ffff700 1 -- 172.21.15.156:0/1104220669 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf54011990 con 0x7fcf580a0a70 2023-09-30T22:21:15.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.434+0000 7fcf4ffff700 1 -- 172.21.15.156:0/1104220669 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf54011d20 con 0x7fcf580a0a70 2023-09-30T22:21:15.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.434+0000 7fcf5f6ec700 1 -- 172.21.15.156:0/1104220669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf580a0a70 msgr2=0x7fcf580a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:15.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.434+0000 7fcf5f6ec700 1 --2- 172.21.15.156:0/1104220669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf580a0a70 0x7fcf580a0e40 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009840 tx=0x7fcf54009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:15.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.434+0000 7fcf5f6ec700 1 -- 172.21.15.156:0/1104220669 shutdown_connections 2023-09-30T22:21:15.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.434+0000 7fcf5f6ec700 1 --2- 172.21.15.156:0/1104220669 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf58134120 0x7fcf5813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.434+0000 7fcf5f6ec700 1 --2- 172.21.15.156:0/1104220669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf580a0a70 0x7fcf580a0e40 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.434+0000 7fcf5f6ec700 1 -- 172.21.15.156:0/1104220669 >> 172.21.15.156:0/1104220669 conn(0x7fcf580a6610 msgr2=0x7fcf580a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:15.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.435+0000 7fcf5f6ec700 1 -- 172.21.15.156:0/1104220669 shutdown_connections 2023-09-30T22:21:15.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.435+0000 7fcf5f6ec700 1 -- 172.21.15.156:0/1104220669 wait complete. 2023-09-30T22:21:15.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.436+0000 7fcf5f6ec700 1 Processor -- start 2023-09-30T22:21:15.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.436+0000 7fcf5f6ec700 1 -- start start 2023-09-30T22:21:15.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.436+0000 7fcf5f6ec700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf580a0a70 0x7fcf58123350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:15.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.436+0000 7fcf5f6ec700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf580a1380 0x7fcf58123890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:15.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.436+0000 7fcf5f6ec700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf58134120 0x7fcf581c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:15.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.436+0000 7fcf5f6ec700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf58133aa0 con 0x7fcf58134120 2023-09-30T22:21:15.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.436+0000 7fcf5f6ec700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580a03e0 con 0x7fcf580a1380 2023-09-30T22:21:15.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.436+0000 7fcf5f6ec700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf58125300 con 0x7fcf580a0a70 2023-09-30T22:21:15.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.437+0000 7fcf5dc89700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf58134120 0x7fcf581c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:15.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.437+0000 7fcf5dc89700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf58134120 0x7fcf581c8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59362/0 (socket says 172.21.15.156:59362) 2023-09-30T22:21:15.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.437+0000 7fcf5dc89700 1 -- 172.21.15.156:0/2123592794 learned_addr learned my addr 172.21.15.156:0/2123592794 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:15.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.437+0000 7fcf5d488700 1 --2- 172.21.15.156:0/2123592794 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf580a0a70 0x7fcf58123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:15.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.437+0000 7fcf5cc87700 1 --2- 172.21.15.156:0/2123592794 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf580a1380 0x7fcf58123890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:15.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.437+0000 7fcf5dc89700 1 -- 172.21.15.156:0/2123592794 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf580a0a70 msgr2=0x7fcf58123350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:15.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.437+0000 7fcf5dc89700 1 --2- 172.21.15.156:0/2123592794 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf580a0a70 0x7fcf58123350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.437+0000 7fcf5dc89700 1 -- 172.21.15.156:0/2123592794 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf580a1380 msgr2=0x7fcf58123890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:15.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.437+0000 7fcf5dc89700 1 --2- 172.21.15.156:0/2123592794 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf580a1380 0x7fcf58123890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.437+0000 7fcf5dc89700 1 -- 172.21.15.156:0/2123592794 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf50009a70 con 0x7fcf58134120 2023-09-30T22:21:15.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.437+0000 7fcf5dc89700 1 --2- 172.21.15.156:0/2123592794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf58134120 0x7fcf581c8410 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000efc0 tx=0x7fcf5000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:15.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.437+0000 7fcf4dffb700 1 -- 172.21.15.156:0/2123592794 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5000ca90 con 0x7fcf58134120 2023-09-30T22:21:15.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.437+0000 7fcf4dffb700 1 -- 172.21.15.156:0/2123592794 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5000f040 con 0x7fcf58134120 2023-09-30T22:21:15.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.437+0000 7fcf5f6ec700 1 -- 172.21.15.156:0/2123592794 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf540094a0 con 0x7fcf58134120 2023-09-30T22:21:15.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.437+0000 7fcf4dffb700 1 -- 172.21.15.156:0/2123592794 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5000ce10 con 0x7fcf58134120 2023-09-30T22:21:15.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.438+0000 7fcf5f6ec700 1 -- 172.21.15.156:0/2123592794 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf58126d30 con 0x7fcf58134120 2023-09-30T22:21:15.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.438+0000 7fcf4dffb700 1 -- 172.21.15.156:0/2123592794 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf50014480 con 0x7fcf58134120 2023-09-30T22:21:15.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.438+0000 7fcf4dffb700 1 -- 172.21.15.156:0/2123592794 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcf5003fd10 con 0x7fcf58134120 2023-09-30T22:21:15.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.439+0000 7fcf5f6ec700 1 -- 172.21.15.156:0/2123592794 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf5809c8f0 con 0x7fcf58134120 2023-09-30T22:21:15.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.443+0000 7fcf4dffb700 1 -- 172.21.15.156:0/2123592794 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf50012930 con 0x7fcf58134120 2023-09-30T22:21:15.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.532+0000 7f0bd1f3e700 1 -- 172.21.15.156:0/439264203 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0bcc04f2a0 con 0x7f0bcc09dec0 2023-09-30T22:21:15.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.533+0000 7f0bb3fff700 1 -- 172.21.15.156:0/439264203 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0bc0011360 con 0x7f0bcc09dec0 2023-09-30T22:21:15.534 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:15.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.536+0000 7f0bd1f3e700 1 -- 172.21.15.156:0/439264203 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bcc09dec0 msgr2=0x7f0bcc09a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:15.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.536+0000 7f0bd1f3e700 1 --2- 172.21.15.156:0/439264203 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bcc09dec0 0x7f0bcc09a9a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000c470 tx=0x7f0bc000c780 comp rx=0 tx=0).stop 2023-09-30T22:21:15.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.536+0000 7f0bd1f3e700 1 -- 172.21.15.156:0/439264203 shutdown_connections 2023-09-30T22:21:15.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.536+0000 7f0bd1f3e700 1 --2- 172.21.15.156:0/439264203 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bcc136cb0 0x7f0bcc09aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.536+0000 7f0bd1f3e700 1 --2- 172.21.15.156:0/439264203 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bcc06a770 0x7f0bcc09a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.536+0000 7f0bd1f3e700 1 --2- 172.21.15.156:0/439264203 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bcc09dec0 0x7f0bcc09a9a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.536+0000 7f0bd1f3e700 1 -- 172.21.15.156:0/439264203 >> 172.21.15.156:0/439264203 conn(0x7f0bcc099c40 msgr2=0x7f0bcc0a25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:15.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.536+0000 7f0bd1f3e700 1 -- 172.21.15.156:0/439264203 shutdown_connections 2023-09-30T22:21:15.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.536+0000 7f0bd1f3e700 1 -- 172.21.15.156:0/439264203 wait complete. 2023-09-30T22:21:15.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:15.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.640+0000 7f5ee4487700 1 -- 172.21.15.156:0/2133053651 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5edc072d60 con 0x7f5edc134330 2023-09-30T22:21:15.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.641+0000 7f5ed2ffd700 1 -- 172.21.15.156:0/2133053651 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ed4026bd0 con 0x7f5edc134330 2023-09-30T22:21:15.642 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:15.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.642+0000 7fcf5f6ec700 1 -- 172.21.15.156:0/2123592794 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcf5804f2a0 con 0x7fcf58134120 2023-09-30T22:21:15.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.643+0000 7f5ee4487700 1 -- 172.21.15.156:0/2133053651 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5edc134330 msgr2=0x7f5edc123230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:15.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.643+0000 7f5ee4487700 1 --2- 172.21.15.156:0/2133053651 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5edc134330 0x7f5edc123230 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5edc0673f0 tx=0x7f5ed4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.643+0000 7fcf4dffb700 1 -- 172.21.15.156:0/2123592794 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcf5002a090 con 0x7fcf58134120 2023-09-30T22:21:15.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.643+0000 7f5ee4487700 1 -- 172.21.15.156:0/2133053651 shutdown_connections 2023-09-30T22:21:15.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.643+0000 7f5ee4487700 1 --2- 172.21.15.156:0/2133053651 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5edc134330 0x7f5edc123230 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.643+0000 7f5ee4487700 1 --2- 172.21.15.156:0/2133053651 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5edc09e870 0x7f5edc1227b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.643+0000 7f5ee4487700 1 --2- 172.21.15.156:0/2133053651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5edc09f180 0x7f5edc122cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.643+0000 7f5ee4487700 1 -- 172.21.15.156:0/2133053651 >> 172.21.15.156:0/2133053651 conn(0x7f5edc0a4430 msgr2=0x7f5edc0a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:15.645 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:15.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.643+0000 7f5ee4487700 1 -- 172.21.15.156:0/2133053651 shutdown_connections 2023-09-30T22:21:15.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.643+0000 7f5ee4487700 1 -- 172.21.15.156:0/2133053651 wait complete. 2023-09-30T22:21:15.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.645+0000 7fcf5f6ec700 1 -- 172.21.15.156:0/2123592794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf58134120 msgr2=0x7fcf581c8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:15.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.645+0000 7fcf5f6ec700 1 --2- 172.21.15.156:0/2123592794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf58134120 0x7fcf581c8410 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000efc0 tx=0x7fcf5000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.645+0000 7fcf5f6ec700 1 -- 172.21.15.156:0/2123592794 shutdown_connections 2023-09-30T22:21:15.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.645+0000 7fcf5f6ec700 1 --2- 172.21.15.156:0/2123592794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf58134120 0x7fcf581c8410 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.645+0000 7fcf5f6ec700 1 --2- 172.21.15.156:0/2123592794 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf580a0a70 0x7fcf58123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.645+0000 7fcf5f6ec700 1 --2- 172.21.15.156:0/2123592794 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf580a1380 0x7fcf58123890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:15.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.645+0000 7fcf5f6ec700 1 -- 172.21.15.156:0/2123592794 >> 172.21.15.156:0/2123592794 conn(0x7fcf580a6610 msgr2=0x7fcf580a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:15.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.645+0000 7fcf5f6ec700 1 -- 172.21.15.156:0/2123592794 shutdown_connections 2023-09-30T22:21:15.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:15.646+0000 7fcf5f6ec700 1 -- 172.21.15.156:0/2123592794 wait complete. 2023-09-30T22:21:15.658 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:15.658 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:16.205 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:16.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.332+0000 7fd9fadda700 1 Processor -- start 2023-09-30T22:21:16.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.332+0000 7fd9fadda700 1 -- start start 2023-09-30T22:21:16.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.332+0000 7fd9fadda700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd9f4133ad0 0x7fd9f4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:16.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.332+0000 7fd9fadda700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd9f41300a0 0x7fd9f41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:16.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.332+0000 7fd9fadda700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9f41309f0 0x7fd9f413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:16.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.332+0000 7fd9fadda700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f406b2d0 con 0x7fd9f4133ad0 2023-09-30T22:21:16.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.332+0000 7fd9fadda700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f4133610 con 0x7fd9f41309f0 2023-09-30T22:21:16.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.333+0000 7fd9fadda700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f409a500 con 0x7fd9f41300a0 2023-09-30T22:21:16.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.333+0000 7fd9f8b76700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd9f4133ad0 0x7fd9f4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:16.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.333+0000 7fd9f3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd9f41300a0 0x7fd9f41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:16.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.333+0000 7fd9f9377700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9f41309f0 0x7fd9f413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:16.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.333+0000 7fd9f8b76700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd9f4133ad0 0x7fd9f4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59374/0 (socket says 172.21.15.156:59374) 2023-09-30T22:21:16.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.333+0000 7fd9f8b76700 1 -- 172.21.15.156:0/1803093635 learned_addr learned my addr 172.21.15.156:0/1803093635 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:16.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.333+0000 7fd9f3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd9f41300a0 0x7fd9f41304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:50956/0 (socket says 172.21.15.156:50956) 2023-09-30T22:21:16.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.333+0000 7fd9f8b76700 1 -- 172.21.15.156:0/1803093635 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd9f41300a0 msgr2=0x7fd9f41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:16.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.333+0000 7fd9f8b76700 1 --2- 172.21.15.156:0/1803093635 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd9f41300a0 0x7fd9f41304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:16.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.333+0000 7fd9f8b76700 1 -- 172.21.15.156:0/1803093635 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9f41309f0 msgr2=0x7fd9f413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:16.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.333+0000 7fd9f8b76700 1 --2- 172.21.15.156:0/1803093635 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9f41309f0 0x7fd9f413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:16.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.333+0000 7fd9f8b76700 1 -- 172.21.15.156:0/1803093635 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f41338b0 con 0x7fd9f4133ad0 2023-09-30T22:21:16.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.333+0000 7fd9f9377700 1 --2- 172.21.15.156:0/1803093635 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9f41309f0 0x7fd9f413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:16.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.333+0000 7fd9f8b76700 1 --2- 172.21.15.156:0/1803093635 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9f4133ad0 0x7fd9f4133ea0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd9e80098f0 tx=0x7fd9e8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d06edf63fc602532 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:16.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.333+0000 7fd9f37fe700 1 -- 172.21.15.156:0/1803093635 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8011830 con 0x7fd9f4133ad0 2023-09-30T22:21:16.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.333+0000 7fd9f37fe700 1 -- 172.21.15.156:0/1803093635 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e8011990 con 0x7fd9f4133ad0 2023-09-30T22:21:16.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.333+0000 7fd9f37fe700 1 -- 172.21.15.156:0/1803093635 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8011d20 con 0x7fd9f4133ad0 2023-09-30T22:21:16.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.334+0000 7fd9fadda700 1 -- 172.21.15.156:0/1803093635 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9f4133ad0 msgr2=0x7fd9f4133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:16.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.334+0000 7fd9fadda700 1 --2- 172.21.15.156:0/1803093635 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9f4133ad0 0x7fd9f4133ea0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd9e80098f0 tx=0x7fd9e8009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:16.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.334+0000 7fd9fadda700 1 -- 172.21.15.156:0/1803093635 shutdown_connections 2023-09-30T22:21:16.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.334+0000 7fd9fadda700 1 --2- 172.21.15.156:0/1803093635 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9f41309f0 0x7fd9f413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:16.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.334+0000 7fd9fadda700 1 --2- 172.21.15.156:0/1803093635 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9f4133ad0 0x7fd9f4133ea0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:16.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.334+0000 7fd9fadda700 1 --2- 172.21.15.156:0/1803093635 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd9f41300a0 0x7fd9f41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:16.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.334+0000 7fd9fadda700 1 -- 172.21.15.156:0/1803093635 >> 172.21.15.156:0/1803093635 conn(0x7fd9f4099c40 msgr2=0x7fd9f40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:16.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.334+0000 7fd9fadda700 1 -- 172.21.15.156:0/1803093635 shutdown_connections 2023-09-30T22:21:16.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.334+0000 7fd9fadda700 1 -- 172.21.15.156:0/1803093635 wait complete. 2023-09-30T22:21:16.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.335+0000 7fd9fadda700 1 Processor -- start 2023-09-30T22:21:16.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.335+0000 7fd9fadda700 1 -- start start 2023-09-30T22:21:16.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.335+0000 7fd9fadda700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd9f41300a0 0x7fd9f411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:16.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.335+0000 7fd9fadda700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9f41309f0 0x7fd9f411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:16.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.335+0000 7fd9fadda700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9f4133ad0 0x7fd9f411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:16.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.335+0000 7fd9fadda700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f40a33e0 con 0x7fd9f41309f0 2023-09-30T22:21:16.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.335+0000 7fd9fadda700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f412dd00 con 0x7fd9f4133ad0 2023-09-30T22:21:16.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.335+0000 7fd9fadda700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f411fbf0 con 0x7fd9f41300a0 2023-09-30T22:21:16.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.335+0000 7fd9f8b76700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd9f41300a0 0x7fd9f411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:16.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.335+0000 7fd9f3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9f41309f0 0x7fd9f411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:16.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.335+0000 7fd9f9377700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9f4133ad0 0x7fd9f411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:16.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.335+0000 7fd9f8b76700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd9f41300a0 0x7fd9f411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:50966/0 (socket says 172.21.15.156:50966) 2023-09-30T22:21:16.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.335+0000 7fd9f8b76700 1 -- 172.21.15.156:0/1048738057 learned_addr learned my addr 172.21.15.156:0/1048738057 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:16.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.335+0000 7fd9f3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9f41309f0 0x7fd9f411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59386/0 (socket says 172.21.15.156:59386) 2023-09-30T22:21:16.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.336+0000 7fd9f8b76700 1 -- 172.21.15.156:0/1048738057 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9f4133ad0 msgr2=0x7fd9f411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:16.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.336+0000 7fd9f8b76700 1 --2- 172.21.15.156:0/1048738057 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9f4133ad0 0x7fd9f411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:16.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.336+0000 7fd9f8b76700 1 -- 172.21.15.156:0/1048738057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9f41309f0 msgr2=0x7fd9f411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:16.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.336+0000 7fd9f8b76700 1 --2- 172.21.15.156:0/1048738057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9f41309f0 0x7fd9f411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:16.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.336+0000 7fd9f8b76700 1 -- 172.21.15.156:0/1048738057 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ec009a70 con 0x7fd9f41300a0 2023-09-30T22:21:16.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.336+0000 7fd9f3fff700 1 --2- 172.21.15.156:0/1048738057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9f41309f0 0x7fd9f411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:16.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.336+0000 7fd9f9377700 1 --2- 172.21.15.156:0/1048738057 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9f4133ad0 0x7fd9f411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:16.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.336+0000 7fd9f8b76700 1 --2- 172.21.15.156:0/1048738057 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd9f41300a0 0x7fd9f411da40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8000c00 tx=0x7fd9e8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:16.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.336+0000 7fd9f17fa700 1 -- 172.21.15.156:0/1048738057 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8004240 con 0x7fd9f41300a0 2023-09-30T22:21:16.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.336+0000 7fd9f17fa700 1 -- 172.21.15.156:0/1048738057 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e801f070 con 0x7fd9f41300a0 2023-09-30T22:21:16.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.336+0000 7fd9fadda700 1 -- 172.21.15.156:0/1048738057 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e8009550 con 0x7fd9f41300a0 2023-09-30T22:21:16.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.336+0000 7fd9f17fa700 1 -- 172.21.15.156:0/1048738057 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e80045c0 con 0x7fd9f41300a0 2023-09-30T22:21:16.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.336+0000 7fd9fadda700 1 -- 172.21.15.156:0/1048738057 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f411feb0 con 0x7fd9f41300a0 2023-09-30T22:21:16.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.337+0000 7fd9fadda700 1 -- 172.21.15.156:0/1048738057 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f409cb20 con 0x7fd9f41300a0 2023-09-30T22:21:16.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.337+0000 7fd9f17fa700 1 -- 172.21.15.156:0/1048738057 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd9e8021030 con 0x7fd9f41300a0 2023-09-30T22:21:16.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.338+0000 7fd9f17fa700 1 -- 172.21.15.156:0/1048738057 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd9e8040ba0 con 0x7fd9f41300a0 2023-09-30T22:21:16.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.342+0000 7fd9f17fa700 1 -- 172.21.15.156:0/1048738057 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd9e80197c0 con 0x7fd9f41300a0 2023-09-30T22:21:16.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.523+0000 7fd9fadda700 1 -- 172.21.15.156:0/1048738057 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd9f406ac50 con 0x7fd9f41300a0 2023-09-30T22:21:16.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.524+0000 7fd9f17fa700 1 -- 172.21.15.156:0/1048738057 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd9e8015070 con 0x7fd9f41300a0 2023-09-30T22:21:16.525 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:16.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.526+0000 7fd9fadda700 1 -- 172.21.15.156:0/1048738057 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd9f41300a0 msgr2=0x7fd9f411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:16.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.526+0000 7fd9fadda700 1 --2- 172.21.15.156:0/1048738057 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd9f41300a0 0x7fd9f411da40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8000c00 tx=0x7fd9e8004750 comp rx=0 tx=0).stop 2023-09-30T22:21:16.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.526+0000 7fd9fadda700 1 -- 172.21.15.156:0/1048738057 shutdown_connections 2023-09-30T22:21:16.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.526+0000 7fd9fadda700 1 --2- 172.21.15.156:0/1048738057 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9f4133ad0 0x7fd9f411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:16.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.526+0000 7fd9fadda700 1 --2- 172.21.15.156:0/1048738057 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd9f41300a0 0x7fd9f411da40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:16.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.526+0000 7fd9fadda700 1 --2- 172.21.15.156:0/1048738057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9f41309f0 0x7fd9f411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:16.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.526+0000 7fd9fadda700 1 -- 172.21.15.156:0/1048738057 >> 172.21.15.156:0/1048738057 conn(0x7fd9f4099c40 msgr2=0x7fd9f412f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:16.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.526+0000 7fd9fadda700 1 -- 172.21.15.156:0/1048738057 shutdown_connections 2023-09-30T22:21:16.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.526+0000 7fd9fadda700 1 -- 172.21.15.156:0/1048738057 wait complete. 2023-09-30T22:21:16.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:16.554 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:16.658 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:16.659 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:16.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.677+0000 7f3f7da27700 1 Processor -- start 2023-09-30T22:21:16.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.677+0000 7f3f7da27700 1 -- start start 2023-09-30T22:21:16.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.677+0000 7f3f7da27700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f78131980 0x7f3f78131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:16.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.677+0000 7f3f7da27700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f7809c790 0x7f3f78139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:16.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.677+0000 7f3f7da27700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f780a1640 con 0x7f3f7809bc70 2023-09-30T22:21:16.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.677+0000 7f3f7da27700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7806eb30 con 0x7f3f7809c790 2023-09-30T22:21:16.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.677+0000 7f3f7da27700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f780a22d0 con 0x7f3f78131980 2023-09-30T22:21:16.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.678+0000 7f3f76ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f78131980 0x7f3f78131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:16.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.678+0000 7f3f767fc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f3f7809bc70 0x7f3f7809c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37574/0 (socket says 172.21.15.156:37574) 2023-09-30T22:21:16.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.678+0000 7f3f767fc700 1 -- 172.21.15.156:0/3978855068 learned_addr learned my addr 172.21.15.156:0/3978855068 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:16.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.678+0000 7f3f777fe700 1 --2- 172.21.15.156:0/3978855068 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f7809c790 0x7f3f78139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:16.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.678+0000 7f3f75ffb700 1 -- 172.21.15.156:0/3978855068 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2439798914 0 0) 0x7f3f780a1640 con 0x7f3f7809bc70 2023-09-30T22:21:16.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.678+0000 7f3f76ffd700 1 -- 172.21.15.156:0/3978855068 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f7809c790 msgr2=0x7f3f78139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:16.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.678+0000 7f3f76ffd700 1 --2- 172.21.15.156:0/3978855068 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f7809c790 0x7f3f78139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:16.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.678+0000 7f3f76ffd700 1 -- 172.21.15.156:0/3978855068 >> v1:172.21.15.156:6789/0 conn(0x7f3f7809bc70 legacy=0x7f3f7809c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:16.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.678+0000 7f3f76ffd700 1 -- 172.21.15.156:0/3978855068 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f78131550 con 0x7f3f78131980 2023-09-30T22:21:16.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.678+0000 7f3f777fe700 1 --2- 172.21.15.156:0/3978855068 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f7809c790 0x7f3f78139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:16.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.678+0000 7f3f76ffd700 1 --2- 172.21.15.156:0/3978855068 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f78131980 0x7f3f78131d50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3f68009850 tx=0x7f3f68009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d85b3ae3398fe59 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:16.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.678+0000 7f3f75ffb700 1 -- 172.21.15.156:0/3978855068 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f68005e30 con 0x7f3f78131980 2023-09-30T22:21:16.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.678+0000 7f3f75ffb700 1 -- 172.21.15.156:0/3978855068 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f68006030 con 0x7f3f78131980 2023-09-30T22:21:16.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.678+0000 7f3f75ffb700 1 -- 172.21.15.156:0/3978855068 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f680063e0 con 0x7f3f78131980 2023-09-30T22:21:16.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.679+0000 7f3f7da27700 1 -- 172.21.15.156:0/3978855068 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f78131980 msgr2=0x7f3f78131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:16.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.679+0000 7f3f7da27700 1 --2- 172.21.15.156:0/3978855068 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f78131980 0x7f3f78131d50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3f68009850 tx=0x7f3f68009b60 comp rx=0 tx=0).stop 2023-09-30T22:21:16.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.679+0000 7f3f7da27700 1 -- 172.21.15.156:0/3978855068 shutdown_connections 2023-09-30T22:21:16.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.679+0000 7f3f7da27700 1 --2- 172.21.15.156:0/3978855068 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f7809c790 0x7f3f78139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:16.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.679+0000 7f3f7da27700 1 --2- 172.21.15.156:0/3978855068 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f78131980 0x7f3f78131d50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:16.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.679+0000 7f3f7da27700 1 -- 172.21.15.156:0/3978855068 >> 172.21.15.156:0/3978855068 conn(0x7f3f780a2980 msgr2=0x7f3f780a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:16.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.679+0000 7f3f7da27700 1 -- 172.21.15.156:0/3978855068 shutdown_connections 2023-09-30T22:21:16.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.679+0000 7f3f7da27700 1 -- 172.21.15.156:0/3978855068 wait complete. 2023-09-30T22:21:16.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.681+0000 7f3f7da27700 1 Processor -- start 2023-09-30T22:21:16.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.681+0000 7f3f7da27700 1 -- start start 2023-09-30T22:21:16.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.681+0000 7f3f7da27700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f7809bc70 0x7f3f781195d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:16.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.681+0000 7f3f7da27700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f7809c790 0x7f3f78119b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:16.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.681+0000 7f3f7da27700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f78131980 0x7f3f7811a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:16.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.681+0000 7f3f7da27700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7811d0f0 con 0x7f3f7809bc70 2023-09-30T22:21:16.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.681+0000 7f3f7da27700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7811c880 con 0x7f3f78131980 2023-09-30T22:21:16.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.681+0000 7f3f7da27700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f78130b40 con 0x7f3f7809c790 2023-09-30T22:21:16.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.682+0000 7f3f777fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f78131980 0x7f3f7811a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:16.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.682+0000 7f3f76ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f7809bc70 0x7f3f781195d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:16.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.682+0000 7f3f777fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f78131980 0x7f3f7811a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52012/0 (socket says 172.21.15.156:52012) 2023-09-30T22:21:16.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.682+0000 7f3f777fe700 1 -- 172.21.15.156:0/3293801159 learned_addr learned my addr 172.21.15.156:0/3293801159 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:16.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.682+0000 7f3f767fc700 1 --2- 172.21.15.156:0/3293801159 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f7809c790 0x7f3f78119b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:16.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.682+0000 7f3f76ffd700 1 -- 172.21.15.156:0/3293801159 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f7809c790 msgr2=0x7f3f78119b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:16.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.682+0000 7f3f76ffd700 1 --2- 172.21.15.156:0/3293801159 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f7809c790 0x7f3f78119b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:16.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.682+0000 7f3f76ffd700 1 -- 172.21.15.156:0/3293801159 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f78131980 msgr2=0x7f3f7811a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:16.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.682+0000 7f3f76ffd700 1 --2- 172.21.15.156:0/3293801159 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f78131980 0x7f3f7811a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:16.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.682+0000 7f3f76ffd700 1 -- 172.21.15.156:0/3293801159 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f70009a70 con 0x7f3f7809bc70 2023-09-30T22:21:16.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.682+0000 7f3f76ffd700 1 --2- 172.21.15.156:0/3293801159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f7809bc70 0x7f3f781195d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3f68015000 tx=0x7f3f68004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:16.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.682+0000 7f3f5ffff700 1 -- 172.21.15.156:0/3293801159 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f68020820 con 0x7f3f7809bc70 2023-09-30T22:21:16.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.682+0000 7f3f5ffff700 1 -- 172.21.15.156:0/3293801159 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f68024070 con 0x7f3f7809bc70 2023-09-30T22:21:16.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.682+0000 7f3f7da27700 1 -- 172.21.15.156:0/3293801159 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f68009430 con 0x7f3f7809bc70 2023-09-30T22:21:16.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.682+0000 7f3f5ffff700 1 -- 172.21.15.156:0/3293801159 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f68020ba0 con 0x7f3f7809bc70 2023-09-30T22:21:16.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.683+0000 7f3f7da27700 1 -- 172.21.15.156:0/3293801159 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f7811b1e0 con 0x7f3f7809bc70 2023-09-30T22:21:16.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.683+0000 7f3f5ffff700 1 -- 172.21.15.156:0/3293801159 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f68026030 con 0x7f3f7809bc70 2023-09-30T22:21:16.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.683+0000 7f3f5ffff700 1 -- 172.21.15.156:0/3293801159 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3f68044ea0 con 0x7f3f7809bc70 2023-09-30T22:21:16.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.685+0000 7f3f7da27700 1 -- 172.21.15.156:0/3293801159 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f7811cab0 con 0x7f3f7809bc70 2023-09-30T22:21:16.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.690+0000 7f3f5ffff700 1 -- 172.21.15.156:0/3293801159 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f7811cab0 con 0x7f3f7809bc70 2023-09-30T22:21:16.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.787+0000 7f693489a700 1 Processor -- start 2023-09-30T22:21:16.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.788+0000 7f693489a700 1 -- start start 2023-09-30T22:21:16.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.788+0000 7f1345976700 1 Processor -- start 2023-09-30T22:21:16.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.788+0000 7f1345976700 1 -- start start 2023-09-30T22:21:16.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.788+0000 7f1345976700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f134009e340 0x7f13401359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:16.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.788+0000 7f1345976700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1340135f20 0x7f1340138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:16.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.788+0000 7f1345976700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f134009aaa0 con 0x7f134009d860 2023-09-30T22:21:16.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.788+0000 7f1345976700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f134009e730 con 0x7f134009e340 2023-09-30T22:21:16.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.788+0000 7f1345976700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f134009f870 con 0x7f1340135f20 2023-09-30T22:21:16.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.788+0000 7f133f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1340135f20 0x7f1340138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:16.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.788+0000 7f133f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1340135f20 0x7f1340138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:50990/0 (socket says 172.21.15.156:50990) 2023-09-30T22:21:16.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.788+0000 7f133f7fe700 1 -- 172.21.15.156:0/3936993308 learned_addr learned my addr 172.21.15.156:0/3936993308 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:16.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.788+0000 7f693489a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f693009ad40 0x7f6930133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:16.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.788+0000 7f693489a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6930133f70 0x7f69301343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:16.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.788+0000 7f693489a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f693009b110 con 0x7f69300a0a70 2023-09-30T22:21:16.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.788+0000 7f693489a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69300a3b60 con 0x7f6930133f70 2023-09-30T22:21:16.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.788+0000 7f693489a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69301348e0 con 0x7f693009ad40 2023-09-30T22:21:16.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.789+0000 7f133f7fe700 1 -- 172.21.15.156:0/3936993308 >> v2:172.21.15.156:3300/0 conn(0x7f134009e340 msgr2=0x7f13401359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:16.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.789+0000 7f133f7fe700 1 --2- 172.21.15.156:0/3936993308 >> v2:172.21.15.156:3300/0 conn(0x7f134009e340 0x7f13401359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:16.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.789+0000 7f692e59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f693009ad40 0x7f6930133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:16.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.789+0000 7f133f7fe700 1 -- 172.21.15.156:0/3936993308 >> v1:172.21.15.156:6789/0 conn(0x7f134009d860 legacy=0x7f134009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:16.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.789+0000 7f133f7fe700 1 -- 172.21.15.156:0/3936993308 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134009b360 con 0x7f1340135f20 2023-09-30T22:21:16.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.789+0000 7f692e59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f693009ad40 0x7f6930133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52022/0 (socket says 172.21.15.156:52022) 2023-09-30T22:21:16.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.789+0000 7f692e59c700 1 -- 172.21.15.156:0/3652075599 learned_addr learned my addr 172.21.15.156:0/3652075599 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:16.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.789+0000 7f692dd9b700 1 --2- 172.21.15.156:0/3652075599 >> v2:172.21.15.156:3300/0 conn(0x7f6930133f70 0x7f69301343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:16.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.789+0000 7f133f7fe700 1 --2- 172.21.15.156:0/3936993308 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1340135f20 0x7f1340138300 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f133800d180 tx=0x7f133800d490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69a24146904fa67a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:16.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.789+0000 7f133dffb700 1 -- 172.21.15.156:0/3936993308 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1338010070 con 0x7f1340135f20 2023-09-30T22:21:16.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.789+0000 7f692dd9b700 1 -- 172.21.15.156:0/3652075599 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f693009ad40 msgr2=0x7f6930133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:16.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.789+0000 7f692dd9b700 1 --2- 172.21.15.156:0/3652075599 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f693009ad40 0x7f6930133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:16.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.789+0000 7f692dd9b700 1 -- 172.21.15.156:0/3652075599 >> v1:172.21.15.156:6789/0 conn(0x7f69300a0a70 legacy=0x7f69300a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:16.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.789+0000 7f692dd9b700 1 -- 172.21.15.156:0/3652075599 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69300a2fa0 con 0x7f6930133f70 2023-09-30T22:21:16.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.789+0000 7f133dffb700 1 -- 172.21.15.156:0/3936993308 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133800dd70 con 0x7f1340135f20 2023-09-30T22:21:16.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.789+0000 7f133dffb700 1 -- 172.21.15.156:0/3936993308 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133800b310 con 0x7f1340135f20 2023-09-30T22:21:16.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.789+0000 7f692dd9b700 1 --2- 172.21.15.156:0/3652075599 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6930133f70 0x7f69301343a0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f6924009840 tx=0x7f6924009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da56d2158aa624e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:16.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.789+0000 7f692d59a700 1 -- 172.21.15.156:0/3652075599 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924004230 con 0x7f6930133f70 2023-09-30T22:21:16.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.790+0000 7f692d59a700 1 -- 172.21.15.156:0/3652075599 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6924004390 con 0x7f6930133f70 2023-09-30T22:21:16.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.790+0000 7f692d59a700 1 -- 172.21.15.156:0/3652075599 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69240036a0 con 0x7f6930133f70 2023-09-30T22:21:16.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.790+0000 7f1345976700 1 -- 172.21.15.156:0/3936993308 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1340135f20 msgr2=0x7f1340138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:16.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.790+0000 7f1345976700 1 --2- 172.21.15.156:0/3936993308 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1340135f20 0x7f1340138300 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f133800d180 tx=0x7f133800d490 comp rx=0 tx=0).stop 2023-09-30T22:21:16.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.790+0000 7f1345976700 1 -- 172.21.15.156:0/3936993308 shutdown_connections 2023-09-30T22:21:16.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.790+0000 7f1345976700 1 --2- 172.21.15.156:0/3936993308 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1340135f20 0x7f1340138300 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:16.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.790+0000 7f1345976700 1 --2- 172.21.15.156:0/3936993308 >> v2:172.21.15.156:3300/0 conn(0x7f134009e340 0x7f13401359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:16.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.790+0000 7f1345976700 1 -- 172.21.15.156:0/3936993308 >> 172.21.15.156:0/3936993308 conn(0x7f1340099c40 msgr2=0x7f13400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:16.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.790+0000 7f1345976700 1 -- 172.21.15.156:0/3936993308 shutdown_connections 2023-09-30T22:21:16.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.790+0000 7f1345976700 1 -- 172.21.15.156:0/3936993308 wait complete. 2023-09-30T22:21:16.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.790+0000 7f693489a700 1 -- 172.21.15.156:0/3652075599 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6930133f70 msgr2=0x7f69301343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:16.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.790+0000 7f693489a700 1 --2- 172.21.15.156:0/3652075599 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6930133f70 0x7f69301343a0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f6924009840 tx=0x7f6924009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:16.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.791+0000 7f693489a700 1 -- 172.21.15.156:0/3652075599 shutdown_connections 2023-09-30T22:21:16.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.791+0000 7f693489a700 1 --2- 172.21.15.156:0/3652075599 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f693009ad40 0x7f6930133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:16.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.791+0000 7f693489a700 1 --2- 172.21.15.156:0/3652075599 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6930133f70 0x7f69301343a0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:16.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.791+0000 7f693489a700 1 -- 172.21.15.156:0/3652075599 >> 172.21.15.156:0/3652075599 conn(0x7f6930099c40 msgr2=0x7f693006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:16.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.791+0000 7f693489a700 1 -- 172.21.15.156:0/3652075599 shutdown_connections 2023-09-30T22:21:16.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.791+0000 7f693489a700 1 -- 172.21.15.156:0/3652075599 wait complete. 2023-09-30T22:21:16.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.791+0000 7f1345976700 1 Processor -- start 2023-09-30T22:21:16.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.791+0000 7f1345976700 1 -- start start 2023-09-30T22:21:16.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.792+0000 7f1345976700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f134009d860 0x7f13401272a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:16.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.792+0000 7f1345976700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f134009e340 0x7f13401277e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:16.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.792+0000 7f1345976700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1340135f20 0x7f1340127d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:16.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.792+0000 7f1345976700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13401287f0 con 0x7f134009e340 2023-09-30T22:21:16.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.792+0000 7f1345976700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1340128600 con 0x7f134009d860 2023-09-30T22:21:16.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.792+0000 7f1345976700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1340072750 con 0x7f1340135f20 2023-09-30T22:21:16.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.792+0000 7f133f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1340135f20 0x7f1340127d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:16.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.792+0000 7f133effd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f134009d860 0x7f13401272a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:16.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.792+0000 7f133f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1340135f20 0x7f1340127d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51002/0 (socket says 172.21.15.156:51002) 2023-09-30T22:21:16.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.792+0000 7f133effd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f134009d860 0x7f13401272a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52026/0 (socket says 172.21.15.156:52026) 2023-09-30T22:21:16.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.792+0000 7f133f7fe700 1 -- 172.21.15.156:0/1464138109 learned_addr learned my addr 172.21.15.156:0/1464138109 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:16.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.792+0000 7f693489a700 1 Processor -- start 2023-09-30T22:21:16.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.792+0000 7f133e7fc700 1 --2- 172.21.15.156:0/1464138109 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f134009e340 0x7f13401277e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:16.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.792+0000 7f693489a700 1 -- start start 2023-09-30T22:21:16.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.792+0000 7f133effd700 1 -- 172.21.15.156:0/1464138109 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1340135f20 msgr2=0x7f1340127d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:16.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.792+0000 7f133effd700 1 --2- 172.21.15.156:0/1464138109 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1340135f20 0x7f1340127d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:16.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.792+0000 7f133effd700 1 -- 172.21.15.156:0/1464138109 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f134009e340 msgr2=0x7f13401277e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:16.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.792+0000 7f133effd700 1 --2- 172.21.15.156:0/1464138109 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f134009e340 0x7f13401277e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:16.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.792+0000 7f133effd700 1 -- 172.21.15.156:0/1464138109 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133800bd40 con 0x7f134009d860 2023-09-30T22:21:16.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.792+0000 7f133f7fe700 1 --2- 172.21.15.156:0/1464138109 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1340135f20 0x7f1340127d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:16.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.792+0000 7f133e7fc700 1 --2- 172.21.15.156:0/1464138109 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f134009e340 0x7f13401277e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:21:16.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.792+0000 7f133effd700 1 --2- 172.21.15.156:0/1464138109 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f134009d860 0x7f13401272a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f133000c3e0 tx=0x7f133000c6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:16.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.793+0000 7f693489a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f693009ad40 0x7f693011e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:16.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.793+0000 7f693489a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f69300a0a70 0x7f693011e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:16.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.793+0000 7f1327fff700 1 -- 172.21.15.156:0/1464138109 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133000cea0 con 0x7f134009d860 2023-09-30T22:21:16.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.793+0000 7f693489a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6930133f70 0x7f693011ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:16.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.793+0000 7f693489a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693011f600 con 0x7f6930133f70 2023-09-30T22:21:16.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.793+0000 7f693489a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f693011fd60 con 0x7f69300a0a70 2023-09-30T22:21:16.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.793+0000 7f693489a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6930120fb0 con 0x7f693009ad40 2023-09-30T22:21:16.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.793+0000 7f1327fff700 1 -- 172.21.15.156:0/1464138109 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1330005500 con 0x7f134009d860 2023-09-30T22:21:16.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.793+0000 7f1327fff700 1 -- 172.21.15.156:0/1464138109 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13300038c0 con 0x7f134009d860 2023-09-30T22:21:16.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.793+0000 7f1345976700 1 -- 172.21.15.156:0/1464138109 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f134009c8b0 con 0x7f134009d860 2023-09-30T22:21:16.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.793+0000 7f1345976700 1 -- 172.21.15.156:0/1464138109 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f134012a2a0 con 0x7f134009d860 2023-09-30T22:21:16.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.793+0000 7f692ed9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6930133f70 0x7f693011ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:16.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.793+0000 7f692dd9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f69300a0a70 0x7f693011e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:16.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.793+0000 7f692ed9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6930133f70 0x7f693011ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59444/0 (socket says 172.21.15.156:59444) 2023-09-30T22:21:16.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.793+0000 7f692ed9d700 1 -- 172.21.15.156:0/376555510 learned_addr learned my addr 172.21.15.156:0/376555510 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:16.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.793+0000 7f692e59c700 1 --2- 172.21.15.156:0/376555510 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f693009ad40 0x7f693011e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:16.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.793+0000 7f692dd9b700 1 -- 172.21.15.156:0/376555510 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f693009ad40 msgr2=0x7f693011e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:16.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.793+0000 7f692dd9b700 1 --2- 172.21.15.156:0/376555510 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f693009ad40 0x7f693011e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:16.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.793+0000 7f692dd9b700 1 -- 172.21.15.156:0/376555510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6930133f70 msgr2=0x7f693011ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:16.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.793+0000 7f692dd9b700 1 --2- 172.21.15.156:0/376555510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6930133f70 0x7f693011ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:16.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.793+0000 7f692dd9b700 1 -- 172.21.15.156:0/376555510 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69240094a0 con 0x7f69300a0a70 2023-09-30T22:21:16.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.793+0000 7f692dd9b700 1 --2- 172.21.15.156:0/376555510 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f69300a0a70 0x7f693011e690 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f693006bec0 tx=0x7f6924004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:16.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.794+0000 7f1345976700 1 -- 172.21.15.156:0/1464138109 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f134011add0 con 0x7f134009d860 2023-09-30T22:21:16.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.794+0000 7f1327fff700 1 -- 172.21.15.156:0/1464138109 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1330003a20 con 0x7f134009d860 2023-09-30T22:21:16.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.794+0000 7f692e59c700 1 --2- 172.21.15.156:0/376555510 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f693009ad40 0x7f693011e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:21:16.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.794+0000 7f692ed9d700 1 --2- 172.21.15.156:0/376555510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6930133f70 0x7f693011ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:16.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.794+0000 7f691effd700 1 -- 172.21.15.156:0/376555510 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924003e70 con 0x7f69300a0a70 2023-09-30T22:21:16.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.794+0000 7f691effd700 1 -- 172.21.15.156:0/376555510 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6924011630 con 0x7f69300a0a70 2023-09-30T22:21:16.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.794+0000 7f691effd700 1 -- 172.21.15.156:0/376555510 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924011a20 con 0x7f69300a0a70 2023-09-30T22:21:16.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.794+0000 7f1327fff700 1 -- 172.21.15.156:0/1464138109 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f133003e7a0 con 0x7f134009d860 2023-09-30T22:21:16.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.795+0000 7f693489a700 1 -- 172.21.15.156:0/376555510 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6930121990 con 0x7f69300a0a70 2023-09-30T22:21:16.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.795+0000 7f693489a700 1 -- 172.21.15.156:0/376555510 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69300a45e0 con 0x7f69300a0a70 2023-09-30T22:21:16.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.796+0000 7f693489a700 1 -- 172.21.15.156:0/376555510 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f693009ed10 con 0x7f69300a0a70 2023-09-30T22:21:16.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.799+0000 7f1327fff700 1 -- 172.21.15.156:0/1464138109 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1330011950 con 0x7f134009d860 2023-09-30T22:21:16.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.799+0000 7f691effd700 1 -- 172.21.15.156:0/376555510 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6924018040 con 0x7f69300a0a70 2023-09-30T22:21:16.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.799+0000 7f691effd700 1 -- 172.21.15.156:0/376555510 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f69240404b0 con 0x7f69300a0a70 2023-09-30T22:21:16.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.803+0000 7f691effd700 1 -- 172.21.15.156:0/376555510 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f692402e350 con 0x7f69300a0a70 2023-09-30T22:21:16.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.887+0000 7f3f7da27700 1 -- 172.21.15.156:0/3293801159 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3f7811cab0 con 0x7f3f7809bc70 2023-09-30T22:21:16.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.887+0000 7f3f5ffff700 1 -- 172.21.15.156:0/3293801159 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f68020d00 con 0x7f3f7809bc70 2023-09-30T22:21:16.888 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:16.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.889+0000 7f3f7da27700 1 -- 172.21.15.156:0/3293801159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f7809bc70 msgr2=0x7f3f781195d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:16.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.889+0000 7f3f7da27700 1 --2- 172.21.15.156:0/3293801159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f7809bc70 0x7f3f781195d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3f68015000 tx=0x7f3f68004750 comp rx=0 tx=0).stop 2023-09-30T22:21:16.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.890+0000 7f3f7da27700 1 -- 172.21.15.156:0/3293801159 shutdown_connections 2023-09-30T22:21:16.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.890+0000 7f3f7da27700 1 --2- 172.21.15.156:0/3293801159 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f78131980 0x7f3f7811a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:16.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.890+0000 7f3f7da27700 1 --2- 172.21.15.156:0/3293801159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f7809bc70 0x7f3f781195d0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:16.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.890+0000 7f3f7da27700 1 --2- 172.21.15.156:0/3293801159 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f7809c790 0x7f3f78119b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:16.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.890+0000 7f3f7da27700 1 -- 172.21.15.156:0/3293801159 >> 172.21.15.156:0/3293801159 conn(0x7f3f780a2980 msgr2=0x7f3f7812e680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:16.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.890+0000 7f3f7da27700 1 -- 172.21.15.156:0/3293801159 shutdown_connections 2023-09-30T22:21:16.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:16.890+0000 7f3f7da27700 1 -- 172.21.15.156:0/3293801159 wait complete. 2023-09-30T22:21:16.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:17.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.004+0000 7f1345976700 1 -- 172.21.15.156:0/1464138109 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f134004f2a0 con 0x7f134009d860 2023-09-30T22:21:17.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.004+0000 7f1327fff700 1 -- 172.21.15.156:0/1464138109 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1330017030 con 0x7f134009d860 2023-09-30T22:21:17.005 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:17.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.006+0000 7f1345976700 1 -- 172.21.15.156:0/1464138109 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f134009d860 msgr2=0x7f13401272a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:17.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.006+0000 7f1345976700 1 --2- 172.21.15.156:0/1464138109 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f134009d860 0x7f13401272a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f133000c3e0 tx=0x7f133000c6f0 comp rx=0 tx=0).stop 2023-09-30T22:21:17.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.006+0000 7f1345976700 1 -- 172.21.15.156:0/1464138109 shutdown_connections 2023-09-30T22:21:17.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.007+0000 7f1345976700 1 --2- 172.21.15.156:0/1464138109 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1340135f20 0x7f1340127d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:17.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.007+0000 7f1345976700 1 --2- 172.21.15.156:0/1464138109 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f134009d860 0x7f13401272a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:17.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.007+0000 7f1345976700 1 --2- 172.21.15.156:0/1464138109 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f134009e340 0x7f13401277e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:17.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.007+0000 7f1345976700 1 -- 172.21.15.156:0/1464138109 >> 172.21.15.156:0/1464138109 conn(0x7f1340099c40 msgr2=0x7f13401356e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:17.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.007+0000 7f1345976700 1 -- 172.21.15.156:0/1464138109 shutdown_connections 2023-09-30T22:21:17.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.007+0000 7f1345976700 1 -- 172.21.15.156:0/1464138109 wait complete. 2023-09-30T22:21:17.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.007+0000 7f693489a700 1 -- 172.21.15.156:0/376555510 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f693009c7e0 con 0x7f69300a0a70 2023-09-30T22:21:17.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.007+0000 7f691effd700 1 -- 172.21.15.156:0/376555510 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6924016030 con 0x7f69300a0a70 2023-09-30T22:21:17.009 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:17.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.009+0000 7f693489a700 1 -- 172.21.15.156:0/376555510 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f69300a0a70 msgr2=0x7f693011e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:17.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.009+0000 7f693489a700 1 --2- 172.21.15.156:0/376555510 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f69300a0a70 0x7f693011e690 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f693006bec0 tx=0x7f6924004750 comp rx=0 tx=0).stop 2023-09-30T22:21:17.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.010+0000 7f693489a700 1 -- 172.21.15.156:0/376555510 shutdown_connections 2023-09-30T22:21:17.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.010+0000 7f693489a700 1 --2- 172.21.15.156:0/376555510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6930133f70 0x7f693011ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:17.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.010+0000 7f693489a700 1 --2- 172.21.15.156:0/376555510 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f693009ad40 0x7f693011e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:17.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.010+0000 7f693489a700 1 --2- 172.21.15.156:0/376555510 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f69300a0a70 0x7f693011e690 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:17.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.010+0000 7f693489a700 1 -- 172.21.15.156:0/376555510 >> 172.21.15.156:0/376555510 conn(0x7f6930099c40 msgr2=0x7f6930132ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:17.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.010+0000 7f693489a700 1 -- 172.21.15.156:0/376555510 shutdown_connections 2023-09-30T22:21:17.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.010+0000 7f693489a700 1 -- 172.21.15.156:0/376555510 wait complete. 2023-09-30T22:21:17.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:17.023 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:17.541 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:17.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.670+0000 7f79250e3700 1 Processor -- start 2023-09-30T22:21:17.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.670+0000 7f79250e3700 1 -- start start 2023-09-30T22:21:17.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.670+0000 7f79250e3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f792009e870 0x7f792009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:17.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.670+0000 7f79250e3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7920134330 0x7f792013be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:17.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.670+0000 7f79250e3700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f792009fa00 con 0x7f792009f180 2023-09-30T22:21:17.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.670+0000 7f79250e3700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79200a0370 con 0x7f7920134330 2023-09-30T22:21:17.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.670+0000 7f79250e3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792006bec0 con 0x7f792009e870 2023-09-30T22:21:17.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.671+0000 7f791f59e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7920134330 0x7f792013be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:17.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.671+0000 7f791ed9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f792009e870 0x7f792009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:17.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.671+0000 7f791f59e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7920134330 0x7f792013be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59450/0 (socket says 172.21.15.156:59450) 2023-09-30T22:21:17.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.671+0000 7f791e59c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f792009f180 0x7f7920133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37608/0 (socket says 172.21.15.156:37608) 2023-09-30T22:21:17.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.671+0000 7f791ed9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f792009e870 0x7f792009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52032/0 (socket says 172.21.15.156:52032) 2023-09-30T22:21:17.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.671+0000 7f791f59e700 1 -- 172.21.15.156:0/3823923913 learned_addr learned my addr 172.21.15.156:0/3823923913 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:17.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.671+0000 7f791ed9d700 1 -- 172.21.15.156:0/3823923913 >> v2:172.21.15.156:3300/0 conn(0x7f7920134330 msgr2=0x7f792013be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:17.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.671+0000 7f791ed9d700 1 --2- 172.21.15.156:0/3823923913 >> v2:172.21.15.156:3300/0 conn(0x7f7920134330 0x7f792013be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:17.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.671+0000 7f791ed9d700 1 -- 172.21.15.156:0/3823923913 >> v1:172.21.15.156:6789/0 conn(0x7f792009f180 legacy=0x7f7920133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:17.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.671+0000 7f791ed9d700 1 -- 172.21.15.156:0/3823923913 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792009ada0 con 0x7f792009e870 2023-09-30T22:21:17.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.671+0000 7f791dd9b700 1 -- 172.21.15.156:0/3823923913 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653955047 0 0) 0x7f792009fa00 con 0x7f792009f180 2023-09-30T22:21:17.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.671+0000 7f791f59e700 1 --2- 172.21.15.156:0/3823923913 >> v2:172.21.15.156:3300/0 conn(0x7f7920134330 0x7f792013be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:17.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.671+0000 7f791ed9d700 1 --2- 172.21.15.156:0/3823923913 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f792009e870 0x7f792009ec40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7910009840 tx=0x7f7910009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=818b4270b5431671 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:17.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.671+0000 7f791dd9b700 1 -- 172.21.15.156:0/3823923913 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910011830 con 0x7f792009e870 2023-09-30T22:21:17.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.671+0000 7f791dd9b700 1 -- 172.21.15.156:0/3823923913 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7910011990 con 0x7f792009e870 2023-09-30T22:21:17.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.671+0000 7f791dd9b700 1 -- 172.21.15.156:0/3823923913 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910011d20 con 0x7f792009e870 2023-09-30T22:21:17.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.672+0000 7f79250e3700 1 -- 172.21.15.156:0/3823923913 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f792009e870 msgr2=0x7f792009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:17.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.672+0000 7f79250e3700 1 --2- 172.21.15.156:0/3823923913 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f792009e870 0x7f792009ec40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7910009840 tx=0x7f7910009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:17.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.672+0000 7f79250e3700 1 -- 172.21.15.156:0/3823923913 shutdown_connections 2023-09-30T22:21:17.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.672+0000 7f79250e3700 1 --2- 172.21.15.156:0/3823923913 >> v2:172.21.15.156:3300/0 conn(0x7f7920134330 0x7f792013be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:17.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.672+0000 7f79250e3700 1 --2- 172.21.15.156:0/3823923913 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f792009e870 0x7f792009ec40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:17.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.672+0000 7f79250e3700 1 -- 172.21.15.156:0/3823923913 >> 172.21.15.156:0/3823923913 conn(0x7f79200a4430 msgr2=0x7f79200a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:17.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.672+0000 7f79250e3700 1 -- 172.21.15.156:0/3823923913 shutdown_connections 2023-09-30T22:21:17.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.672+0000 7f79250e3700 1 -- 172.21.15.156:0/3823923913 wait complete. 2023-09-30T22:21:17.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.673+0000 7f79250e3700 1 Processor -- start 2023-09-30T22:21:17.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.673+0000 7f79250e3700 1 -- start start 2023-09-30T22:21:17.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.673+0000 7f79250e3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f792009e870 0x7f79201228a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:17.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.673+0000 7f79250e3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f792009f180 0x7f7920122de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:17.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.673+0000 7f79250e3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7920134330 0x7f7920123320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:17.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.673+0000 7f79250e3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792006cfa0 con 0x7f792009e870 2023-09-30T22:21:17.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.673+0000 7f79250e3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7920126040 con 0x7f7920134330 2023-09-30T22:21:17.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.673+0000 7f79250e3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79200a16a0 con 0x7f792009f180 2023-09-30T22:21:17.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.674+0000 7f791f59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7920134330 0x7f7920123320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:17.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.674+0000 7f791e59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f792009f180 0x7f7920122de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:17.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.674+0000 7f791ed9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f792009e870 0x7f79201228a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:17.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.674+0000 7f791f59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7920134330 0x7f7920123320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52038/0 (socket says 172.21.15.156:52038) 2023-09-30T22:21:17.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.674+0000 7f791f59e700 1 -- 172.21.15.156:0/1713746229 learned_addr learned my addr 172.21.15.156:0/1713746229 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:17.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.674+0000 7f791ed9d700 1 -- 172.21.15.156:0/1713746229 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f792009f180 msgr2=0x7f7920122de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:17.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.674+0000 7f791ed9d700 1 --2- 172.21.15.156:0/1713746229 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f792009f180 0x7f7920122de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:17.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.674+0000 7f791ed9d700 1 -- 172.21.15.156:0/1713746229 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7920134330 msgr2=0x7f7920123320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:17.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.674+0000 7f791ed9d700 1 --2- 172.21.15.156:0/1713746229 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7920134330 0x7f7920123320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:17.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.674+0000 7f791ed9d700 1 -- 172.21.15.156:0/1713746229 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7918009b30 con 0x7f792009e870 2023-09-30T22:21:17.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.674+0000 7f791e59c700 1 --2- 172.21.15.156:0/1713746229 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f792009f180 0x7f7920122de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:17.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.674+0000 7f791f59e700 1 --2- 172.21.15.156:0/1713746229 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7920134330 0x7f7920123320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:17.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.674+0000 7f791ed9d700 1 --2- 172.21.15.156:0/1713746229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f792009e870 0x7f79201228a0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7910016000 tx=0x7f7910004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:17.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.674+0000 7f79177fe700 1 -- 172.21.15.156:0/1713746229 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79100045d0 con 0x7f792009e870 2023-09-30T22:21:17.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.674+0000 7f79177fe700 1 -- 172.21.15.156:0/1713746229 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791001f070 con 0x7f792009e870 2023-09-30T22:21:17.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.674+0000 7f79250e3700 1 -- 172.21.15.156:0/1713746229 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79100094a0 con 0x7f792009e870 2023-09-30T22:21:17.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.674+0000 7f79177fe700 1 -- 172.21.15.156:0/1713746229 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79100038a0 con 0x7f792009e870 2023-09-30T22:21:17.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.674+0000 7f79250e3700 1 -- 172.21.15.156:0/1713746229 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7920133320 con 0x7f792009e870 2023-09-30T22:21:17.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.675+0000 7f79177fe700 1 -- 172.21.15.156:0/1713746229 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7910003a00 con 0x7f792009e870 2023-09-30T22:21:17.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.675+0000 7f79177fe700 1 -- 172.21.15.156:0/1713746229 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7910021070 con 0x7f792009e870 2023-09-30T22:21:17.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.675+0000 7f79250e3700 1 -- 172.21.15.156:0/1713746229 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f792004f2a0 con 0x7f792009e870 2023-09-30T22:21:17.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.680+0000 7f79177fe700 1 -- 172.21.15.156:0/1713746229 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f791001a950 con 0x7f792009e870 2023-09-30T22:21:17.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.864+0000 7f79250e3700 1 -- 172.21.15.156:0/1713746229 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f792006c9d0 con 0x7f792009e870 2023-09-30T22:21:17.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.864+0000 7f79177fe700 1 -- 172.21.15.156:0/1713746229 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7910010b70 con 0x7f792009e870 2023-09-30T22:21:17.865 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:17.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.866+0000 7f79250e3700 1 -- 172.21.15.156:0/1713746229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f792009e870 msgr2=0x7f79201228a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:17.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.866+0000 7f79250e3700 1 --2- 172.21.15.156:0/1713746229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f792009e870 0x7f79201228a0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7910016000 tx=0x7f7910004750 comp rx=0 tx=0).stop 2023-09-30T22:21:17.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.866+0000 7f79250e3700 1 -- 172.21.15.156:0/1713746229 shutdown_connections 2023-09-30T22:21:17.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.866+0000 7f79250e3700 1 --2- 172.21.15.156:0/1713746229 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7920134330 0x7f7920123320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:17.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.866+0000 7f79250e3700 1 --2- 172.21.15.156:0/1713746229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f792009e870 0x7f79201228a0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:17.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.866+0000 7f79250e3700 1 --2- 172.21.15.156:0/1713746229 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f792009f180 0x7f7920122de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:17.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.866+0000 7f79250e3700 1 -- 172.21.15.156:0/1713746229 >> 172.21.15.156:0/1713746229 conn(0x7f79200a4430 msgr2=0x7f7920070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:17.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.866+0000 7f79250e3700 1 -- 172.21.15.156:0/1713746229 shutdown_connections 2023-09-30T22:21:17.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:17.866+0000 7f79250e3700 1 -- 172.21.15.156:0/1713746229 wait complete. 2023-09-30T22:21:17.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:17.903 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:18.023 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:18.023 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:18.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.026+0000 7f0bfe26f700 1 Processor -- start 2023-09-30T22:21:18.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.026+0000 7f0bfe26f700 1 -- start start 2023-09-30T22:21:18.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.027+0000 7f0bfe26f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bf8099e20 0x7f0bf809a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:18.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.027+0000 7f0bfe26f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0bf809a730 0x7f0bf8130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:18.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.027+0000 7f0bfe26f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf8099a60 con 0x7f0bf8130890 2023-09-30T22:21:18.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.027+0000 7f0bfe26f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf809bf50 con 0x7f0bf809a730 2023-09-30T22:21:18.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.027+0000 7f0bfe26f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf809b230 con 0x7f0bf8099e20 2023-09-30T22:21:18.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.027+0000 7f0bf77fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0bf809a730 0x7f0bf8130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:18.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.027+0000 7f0bf77fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0bf809a730 0x7f0bf8130350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59456/0 (socket says 172.21.15.156:59456) 2023-09-30T22:21:18.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.027+0000 7f0bf77fe700 1 -- 172.21.15.156:0/686310756 learned_addr learned my addr 172.21.15.156:0/686310756 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:18.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.027+0000 7f0bf7fff700 1 --2- 172.21.15.156:0/686310756 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bf8099e20 0x7f0bf809a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:18.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.027+0000 7f0bf77fe700 1 -- 172.21.15.156:0/686310756 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bf8099e20 msgr2=0x7f0bf809a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:18.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.027+0000 7f0bf77fe700 1 --2- 172.21.15.156:0/686310756 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bf8099e20 0x7f0bf809a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:18.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.027+0000 7f0bf77fe700 1 -- 172.21.15.156:0/686310756 >> v1:172.21.15.156:6789/0 conn(0x7f0bf8130890 legacy=0x7f0bf8137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:18.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.027+0000 7f0bf77fe700 1 -- 172.21.15.156:0/686310756 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf809bb90 con 0x7f0bf809a730 2023-09-30T22:21:18.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.027+0000 7f0bf77fe700 1 --2- 172.21.15.156:0/686310756 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bf809a730 0x7f0bf8130350 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00bb90 tx=0x7f0bec00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01215ae4655a3cd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:18.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.027+0000 7f0bf6ffd700 1 -- 172.21.15.156:0/686310756 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec00dd30 con 0x7f0bf809a730 2023-09-30T22:21:18.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.028+0000 7f0bf6ffd700 1 -- 172.21.15.156:0/686310756 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bec00de90 con 0x7f0bf809a730 2023-09-30T22:21:18.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.028+0000 7f0bf6ffd700 1 -- 172.21.15.156:0/686310756 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec010690 con 0x7f0bf809a730 2023-09-30T22:21:18.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.028+0000 7f0bfe26f700 1 -- 172.21.15.156:0/686310756 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bf809a730 msgr2=0x7f0bf8130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:18.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.028+0000 7f0bfe26f700 1 --2- 172.21.15.156:0/686310756 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bf809a730 0x7f0bf8130350 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00bb90 tx=0x7f0bec00bea0 comp rx=0 tx=0).stop 2023-09-30T22:21:18.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.028+0000 7f0bfe26f700 1 -- 172.21.15.156:0/686310756 shutdown_connections 2023-09-30T22:21:18.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.028+0000 7f0bfe26f700 1 --2- 172.21.15.156:0/686310756 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bf8099e20 0x7f0bf809a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:18.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.028+0000 7f0bfe26f700 1 --2- 172.21.15.156:0/686310756 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bf809a730 0x7f0bf8130350 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:18.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.028+0000 7f0bfe26f700 1 -- 172.21.15.156:0/686310756 >> 172.21.15.156:0/686310756 conn(0x7f0bf80a2980 msgr2=0x7f0bf80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:18.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.028+0000 7f0bfe26f700 1 -- 172.21.15.156:0/686310756 shutdown_connections 2023-09-30T22:21:18.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.028+0000 7f0bfe26f700 1 -- 172.21.15.156:0/686310756 wait complete. 2023-09-30T22:21:18.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.029+0000 7f0bfe26f700 1 Processor -- start 2023-09-30T22:21:18.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.030+0000 7f0bfe26f700 1 -- start start 2023-09-30T22:21:18.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.030+0000 7f0bfe26f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bf8099e20 0x7f0bf81c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:18.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.030+0000 7f0bfe26f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bf809a730 0x7f0bf81c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:18.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.030+0000 7f0bfe26f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bf8130890 0x7f0bf81c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:18.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.030+0000 7f0bfe26f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf8122200 con 0x7f0bf809a730 2023-09-30T22:21:18.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.030+0000 7f0bfe26f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf81203f0 con 0x7f0bf8099e20 2023-09-30T22:21:18.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.030+0000 7f0bfe26f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf8123ac0 con 0x7f0bf8130890 2023-09-30T22:21:18.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.030+0000 7f0bfc80c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bf8130890 0x7f0bf81c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:18.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.030+0000 7f0bf7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bf8099e20 0x7f0bf81c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:18.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.030+0000 7f0bfc80c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bf8130890 0x7f0bf81c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51026/0 (socket says 172.21.15.156:51026) 2023-09-30T22:21:18.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.030+0000 7f0bf7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bf8099e20 0x7f0bf81c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52042/0 (socket says 172.21.15.156:52042) 2023-09-30T22:21:18.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.030+0000 7f0bfc80c700 1 -- 172.21.15.156:0/2437974241 learned_addr learned my addr 172.21.15.156:0/2437974241 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:18.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.030+0000 7f0bfc80c700 1 -- 172.21.15.156:0/2437974241 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bf8099e20 msgr2=0x7f0bf81c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:18.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.031+0000 7f0bfc80c700 1 --2- 172.21.15.156:0/2437974241 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bf8099e20 0x7f0bf81c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:18.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.031+0000 7f0bfc80c700 1 -- 172.21.15.156:0/2437974241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bf809a730 msgr2=0x7f0bf81c8a30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:21:18.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.031+0000 7f0bfc80c700 1 --2- 172.21.15.156:0/2437974241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bf809a730 0x7f0bf81c8a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:18.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.031+0000 7f0bfc80c700 1 -- 172.21.15.156:0/2437974241 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bec00b7f0 con 0x7f0bf8130890 2023-09-30T22:21:18.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.031+0000 7f0bf7fff700 1 --2- 172.21.15.156:0/2437974241 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bf8099e20 0x7f0bf81c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:18.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.031+0000 7f0bfc80c700 1 --2- 172.21.15.156:0/2437974241 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bf8130890 0x7f0bf81c8f70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000cc80 tx=0x7f0bf000cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:18.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.031+0000 7f0bf4ff9700 1 -- 172.21.15.156:0/2437974241 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0003c00 con 0x7f0bf8130890 2023-09-30T22:21:18.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.031+0000 7f0bf4ff9700 1 -- 172.21.15.156:0/2437974241 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf0003d60 con 0x7f0bf8130890 2023-09-30T22:21:18.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.031+0000 7f0bfe26f700 1 -- 172.21.15.156:0/2437974241 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf80a1370 con 0x7f0bf8130890 2023-09-30T22:21:18.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.031+0000 7f0bf4ff9700 1 -- 172.21.15.156:0/2437974241 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf000aaf0 con 0x7f0bf8130890 2023-09-30T22:21:18.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.031+0000 7f0bfe26f700 1 -- 172.21.15.156:0/2437974241 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf81223a0 con 0x7f0bf8130890 2023-09-30T22:21:18.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.032+0000 7f0bf4ff9700 1 -- 172.21.15.156:0/2437974241 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0bf000ac50 con 0x7f0bf8130890 2023-09-30T22:21:18.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.032+0000 7f0bf4ff9700 1 -- 172.21.15.156:0/2437974241 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0bf003f820 con 0x7f0bf8130890 2023-09-30T22:21:18.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.032+0000 7f0bfe26f700 1 -- 172.21.15.156:0/2437974241 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf8072480 con 0x7f0bf8130890 2023-09-30T22:21:18.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.037+0000 7f0bf4ff9700 1 -- 172.21.15.156:0/2437974241 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0bf8072480 con 0x7f0bf8130890 2023-09-30T22:21:18.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.151+0000 7fe466c22700 1 Processor -- start 2023-09-30T22:21:18.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.151+0000 7fe466c22700 1 -- start start 2023-09-30T22:21:18.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.151+0000 7fe466c22700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe46009e950 0x7fe46009ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:18.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.151+0000 7fe466c22700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe46009f260 0x7fe460137ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:18.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.151+0000 7fe466c22700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe46009ac20 con 0x7fe4601381e0 2023-09-30T22:21:18.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.151+0000 7fe466c22700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4600a06c0 con 0x7fe46009f260 2023-09-30T22:21:18.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.151+0000 7fe466c22700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe46009ae90 con 0x7fe46009e950 2023-09-30T22:21:18.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.151+0000 7fe4649be700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe46009e950 0x7fe46009ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:18.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.151+0000 7fe4649be700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe46009e950 0x7fe46009ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52052/0 (socket says 172.21.15.156:52052) 2023-09-30T22:21:18.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.151+0000 7fe4649be700 1 -- 172.21.15.156:0/4052326951 learned_addr learned my addr 172.21.15.156:0/4052326951 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:18.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.151+0000 7fe4651bf700 1 --1- 172.21.15.156:0/4052326951 >> v1:172.21.15.156:6789/0 conn(0x7fe4601381e0 0x7fe46013a5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37612/0 (socket says 172.21.15.156:37612) 2023-09-30T22:21:18.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.151+0000 7fe45ffff700 1 --2- 172.21.15.156:0/4052326951 >> v2:172.21.15.156:3300/0 conn(0x7fe46009f260 0x7fe460137ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:18.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.152+0000 7fe4649be700 1 -- 172.21.15.156:0/4052326951 >> v2:172.21.15.156:3300/0 conn(0x7fe46009f260 msgr2=0x7fe460137ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:18.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.152+0000 7fe4649be700 1 --2- 172.21.15.156:0/4052326951 >> v2:172.21.15.156:3300/0 conn(0x7fe46009f260 0x7fe460137ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:18.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.152+0000 7fe4649be700 1 -- 172.21.15.156:0/4052326951 >> v1:172.21.15.156:6789/0 conn(0x7fe4601381e0 legacy=0x7fe46013a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:18.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.152+0000 7fe45f7fe700 1 -- 172.21.15.156:0/4052326951 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279609584 0 0) 0x7fe46009ac20 con 0x7fe4601381e0 2023-09-30T22:21:18.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.152+0000 7fe4649be700 1 -- 172.21.15.156:0/4052326951 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46006ba00 con 0x7fe46009e950 2023-09-30T22:21:18.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.152+0000 7fe4649be700 1 --2- 172.21.15.156:0/4052326951 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe46009e950 0x7fe46009ed20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe454006fd0 tx=0x7fe454009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9e4e1d5dbd014 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:18.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.152+0000 7fe45f7fe700 1 -- 172.21.15.156:0/4052326951 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe454005e30 con 0x7fe46009e950 2023-09-30T22:21:18.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.152+0000 7fe45f7fe700 1 -- 172.21.15.156:0/4052326951 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe454004030 con 0x7fe46009e950 2023-09-30T22:21:18.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.152+0000 7fe45f7fe700 1 -- 172.21.15.156:0/4052326951 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4540043e0 con 0x7fe46009e950 2023-09-30T22:21:18.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.153+0000 7fe466c22700 1 -- 172.21.15.156:0/4052326951 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe46009e950 msgr2=0x7fe46009ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:18.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.153+0000 7fe466c22700 1 --2- 172.21.15.156:0/4052326951 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe46009e950 0x7fe46009ed20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe454006fd0 tx=0x7fe454009bd0 comp rx=0 tx=0).stop 2023-09-30T22:21:18.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.153+0000 7fe466c22700 1 -- 172.21.15.156:0/4052326951 shutdown_connections 2023-09-30T22:21:18.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.153+0000 7fe466c22700 1 --2- 172.21.15.156:0/4052326951 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe46009e950 0x7fe46009ed20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:18.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.153+0000 7fe466c22700 1 --2- 172.21.15.156:0/4052326951 >> v2:172.21.15.156:3300/0 conn(0x7fe46009f260 0x7fe460137ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:18.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.153+0000 7fe466c22700 1 -- 172.21.15.156:0/4052326951 >> 172.21.15.156:0/4052326951 conn(0x7fe4600a0f70 msgr2=0x7fe4600a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:18.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.153+0000 7fe466c22700 1 -- 172.21.15.156:0/4052326951 shutdown_connections 2023-09-30T22:21:18.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.153+0000 7fe466c22700 1 -- 172.21.15.156:0/4052326951 wait complete. 2023-09-30T22:21:18.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.154+0000 7fe466c22700 1 Processor -- start 2023-09-30T22:21:18.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.154+0000 7fe466c22700 1 -- start start 2023-09-30T22:21:18.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.155+0000 7fe466c22700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe46009e950 0x7fe460122850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:18.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.155+0000 7fe466c22700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe46009f260 0x7fe460122d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:18.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.155+0000 7fe466c22700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4601381e0 0x7fe4601232d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:18.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.155+0000 7fe466c22700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe460126170 con 0x7fe46009f260 2023-09-30T22:21:18.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.155+0000 7fe466c22700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe460124d10 con 0x7fe46009e950 2023-09-30T22:21:18.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.155+0000 7fe466c22700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe460126370 con 0x7fe4601381e0 2023-09-30T22:21:18.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.155+0000 7fe45ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe46009f260 0x7fe460122d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:18.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.155+0000 7fe45ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe46009f260 0x7fe460122d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59484/0 (socket says 172.21.15.156:59484) 2023-09-30T22:21:18.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.155+0000 7fe45ffff700 1 -- 172.21.15.156:0/393323794 learned_addr learned my addr 172.21.15.156:0/393323794 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:18.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.155+0000 7fe4651bf700 1 --2- 172.21.15.156:0/393323794 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4601381e0 0x7fe4601232d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:18.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.155+0000 7fe4649be700 1 --2- 172.21.15.156:0/393323794 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe46009e950 0x7fe460122850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:18.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.155+0000 7fe45ffff700 1 -- 172.21.15.156:0/393323794 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4601381e0 msgr2=0x7fe4601232d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:18.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.155+0000 7fe45ffff700 1 --2- 172.21.15.156:0/393323794 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4601381e0 0x7fe4601232d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:18.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.155+0000 7fe45ffff700 1 -- 172.21.15.156:0/393323794 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe46009e950 msgr2=0x7fe460122850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:18.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.155+0000 7fe45ffff700 1 --2- 172.21.15.156:0/393323794 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe46009e950 0x7fe460122850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:18.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.155+0000 7fe45ffff700 1 -- 172.21.15.156:0/393323794 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe454009500 con 0x7fe46009f260 2023-09-30T22:21:18.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.155+0000 7fe45ffff700 1 --2- 172.21.15.156:0/393323794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe46009f260 0x7fe460122d90 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe44c00e980 tx=0x7fe44c00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:18.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.155+0000 7fe45d7fa700 1 -- 172.21.15.156:0/393323794 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c009710 con 0x7fe46009f260 2023-09-30T22:21:18.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.155+0000 7fe45d7fa700 1 -- 172.21.15.156:0/393323794 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44c00c690 con 0x7fe46009f260 2023-09-30T22:21:18.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.155+0000 7fe45d7fa700 1 -- 172.21.15.156:0/393323794 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c00ca20 con 0x7fe46009f260 2023-09-30T22:21:18.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.155+0000 7fe466c22700 1 -- 172.21.15.156:0/393323794 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe460125260 con 0x7fe46009f260 2023-09-30T22:21:18.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.156+0000 7fe466c22700 1 -- 172.21.15.156:0/393323794 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe460124500 con 0x7fe46009f260 2023-09-30T22:21:18.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.157+0000 7fe466c22700 1 -- 172.21.15.156:0/393323794 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe46004f2a0 con 0x7fe46009f260 2023-09-30T22:21:18.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.157+0000 7fe45d7fa700 1 -- 172.21.15.156:0/393323794 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe44c00cb80 con 0x7fe46009f260 2023-09-30T22:21:18.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.158+0000 7fe45d7fa700 1 -- 172.21.15.156:0/393323794 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe44c03fec0 con 0x7fe46009f260 2023-09-30T22:21:18.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.159+0000 7f34d1d04700 1 Processor -- start 2023-09-30T22:21:18.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.160+0000 7f34d1d04700 1 -- start start 2023-09-30T22:21:18.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.160+0000 7f34d1d04700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f34cc099e20 0x7f34cc09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:18.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.160+0000 7f34d1d04700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34cc09a730 0x7f34cc130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:18.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.160+0000 7f34d1d04700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f34cc130890 0x7f34cc130ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:18.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.160+0000 7f34d1d04700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34cc09bf50 con 0x7f34cc099e20 2023-09-30T22:21:18.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.160+0000 7f34d1d04700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34cc131220 con 0x7f34cc09a730 2023-09-30T22:21:18.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.160+0000 7f34d1d04700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34cc099a60 con 0x7f34cc130890 2023-09-30T22:21:18.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.160+0000 7f34cb7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f34cc099e20 0x7f34cc09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:18.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.160+0000 7f34cb7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f34cc099e20 0x7f34cc09a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59494/0 (socket says 172.21.15.156:59494) 2023-09-30T22:21:18.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.160+0000 7f34cb7fe700 1 -- 172.21.15.156:0/3979144840 learned_addr learned my addr 172.21.15.156:0/3979144840 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:18.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.160+0000 7f34cbfff700 1 --2- 172.21.15.156:0/3979144840 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f34cc130890 0x7f34cc130ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:18.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.160+0000 7f34caffd700 1 --2- 172.21.15.156:0/3979144840 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34cc09a730 0x7f34cc130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:18.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.160+0000 7f34cb7fe700 1 -- 172.21.15.156:0/3979144840 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f34cc130890 msgr2=0x7f34cc130ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:18.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.160+0000 7f34cb7fe700 1 --2- 172.21.15.156:0/3979144840 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f34cc130890 0x7f34cc130ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:18.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.160+0000 7f34cb7fe700 1 -- 172.21.15.156:0/3979144840 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34cc09a730 msgr2=0x7f34cc130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:18.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.160+0000 7f34cb7fe700 1 --2- 172.21.15.156:0/3979144840 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34cc09a730 0x7f34cc130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:18.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.160+0000 7f34cb7fe700 1 -- 172.21.15.156:0/3979144840 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34cc09b230 con 0x7f34cc099e20 2023-09-30T22:21:18.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.161+0000 7f34cb7fe700 1 --2- 172.21.15.156:0/3979144840 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34cc099e20 0x7f34cc09a1f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f34bc009920 tx=0x7f34bc009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf5ceaecfd1694b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:18.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.162+0000 7f34ca7fc700 1 -- 172.21.15.156:0/3979144840 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc005e30 con 0x7f34cc099e20 2023-09-30T22:21:18.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.162+0000 7f34ca7fc700 1 -- 172.21.15.156:0/3979144840 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34bc004030 con 0x7f34cc099e20 2023-09-30T22:21:18.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.162+0000 7f34ca7fc700 1 -- 172.21.15.156:0/3979144840 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc0043e0 con 0x7f34cc099e20 2023-09-30T22:21:18.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.162+0000 7fe45d7fa700 1 -- 172.21.15.156:0/393323794 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe44c011350 con 0x7fe46009f260 2023-09-30T22:21:18.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.163+0000 7f34d1d04700 1 -- 172.21.15.156:0/3979144840 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34cc099e20 msgr2=0x7f34cc09a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:18.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.163+0000 7f34d1d04700 1 --2- 172.21.15.156:0/3979144840 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34cc099e20 0x7f34cc09a1f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f34bc009920 tx=0x7f34bc009c30 comp rx=0 tx=0).stop 2023-09-30T22:21:18.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.163+0000 7f34d1d04700 1 -- 172.21.15.156:0/3979144840 shutdown_connections 2023-09-30T22:21:18.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.163+0000 7f34d1d04700 1 --2- 172.21.15.156:0/3979144840 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f34cc130890 0x7f34cc130ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:18.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.163+0000 7f34d1d04700 1 --2- 172.21.15.156:0/3979144840 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34cc099e20 0x7f34cc09a1f0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:18.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.163+0000 7f34d1d04700 1 --2- 172.21.15.156:0/3979144840 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34cc09a730 0x7f34cc130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:18.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.163+0000 7f34d1d04700 1 -- 172.21.15.156:0/3979144840 >> 172.21.15.156:0/3979144840 conn(0x7f34cc0a2980 msgr2=0x7f34cc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:18.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.163+0000 7f34d1d04700 1 -- 172.21.15.156:0/3979144840 shutdown_connections 2023-09-30T22:21:18.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.163+0000 7f34d1d04700 1 -- 172.21.15.156:0/3979144840 wait complete. 2023-09-30T22:21:18.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.164+0000 7f34d1d04700 1 Processor -- start 2023-09-30T22:21:18.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.165+0000 7f34d1d04700 1 -- start start 2023-09-30T22:21:18.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.165+0000 7f34d1d04700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34cc099e20 0x7f34cc11c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:18.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.165+0000 7f34d1d04700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f34cc09a730 0x7f34cc11cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:18.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.165+0000 7f34d1d04700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34cc130890 0x7f34cc11d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:18.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.165+0000 7f34d1d04700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34cc120120 con 0x7f34cc099e20 2023-09-30T22:21:18.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.165+0000 7f34d1d04700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34cc11fd80 con 0x7f34cc130890 2023-09-30T22:21:18.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.165+0000 7f34d1d04700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34cc11f210 con 0x7f34cc09a730 2023-09-30T22:21:18.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.165+0000 7f34cb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34cc099e20 0x7f34cc11c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:18.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.165+0000 7f34cb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34cc099e20 0x7f34cc11c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59506/0 (socket says 172.21.15.156:59506) 2023-09-30T22:21:18.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.165+0000 7f34cb7fe700 1 -- 172.21.15.156:0/1287774409 learned_addr learned my addr 172.21.15.156:0/1287774409 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:18.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.165+0000 7f34cbfff700 1 --2- 172.21.15.156:0/1287774409 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34cc130890 0x7f34cc11d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:18.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.166+0000 7f34cb7fe700 1 -- 172.21.15.156:0/1287774409 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f34cc09a730 msgr2=0x7f34cc11cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:18.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.166+0000 7f34cb7fe700 1 --2- 172.21.15.156:0/1287774409 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f34cc09a730 0x7f34cc11cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:18.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.166+0000 7f34cb7fe700 1 -- 172.21.15.156:0/1287774409 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34cc130890 msgr2=0x7f34cc11d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:18.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.166+0000 7f34cb7fe700 1 --2- 172.21.15.156:0/1287774409 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34cc130890 0x7f34cc11d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:18.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.166+0000 7f34cb7fe700 1 -- 172.21.15.156:0/1287774409 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34bc009500 con 0x7f34cc099e20 2023-09-30T22:21:18.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.166+0000 7f34cbfff700 1 --2- 172.21.15.156:0/1287774409 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34cc130890 0x7f34cc11d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:18.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.166+0000 7f34cb7fe700 1 --2- 172.21.15.156:0/1287774409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34cc099e20 0x7f34cc11c800 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f34bc000c00 tx=0x7f34bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:18.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.166+0000 7f34b3fff700 1 -- 172.21.15.156:0/1287774409 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc01e070 con 0x7f34cc099e20 2023-09-30T22:21:18.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.166+0000 7f34b3fff700 1 -- 172.21.15.156:0/1287774409 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34bc0043f0 con 0x7f34cc099e20 2023-09-30T22:21:18.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.166+0000 7f34b3fff700 1 -- 172.21.15.156:0/1287774409 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc018420 con 0x7f34cc099e20 2023-09-30T22:21:18.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.166+0000 7f34d1d04700 1 -- 172.21.15.156:0/1287774409 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34cc11e4b0 con 0x7f34cc099e20 2023-09-30T22:21:18.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.166+0000 7f34d1d04700 1 -- 172.21.15.156:0/1287774409 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34cc09b470 con 0x7f34cc099e20 2023-09-30T22:21:18.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.167+0000 7f34d1d04700 1 -- 172.21.15.156:0/1287774409 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34cc04f2a0 con 0x7f34cc099e20 2023-09-30T22:21:18.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.167+0000 7f34b3fff700 1 -- 172.21.15.156:0/1287774409 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f34bc018580 con 0x7f34cc099e20 2023-09-30T22:21:18.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.168+0000 7f34b3fff700 1 -- 172.21.15.156:0/1287774409 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f34bc041a60 con 0x7f34cc099e20 2023-09-30T22:21:18.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.172+0000 7f34b3fff700 1 -- 172.21.15.156:0/1287774409 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f34bc021780 con 0x7f34cc099e20 2023-09-30T22:21:18.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.246+0000 7f0bfe26f700 1 -- 172.21.15.156:0/2437974241 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0bf8072480 con 0x7f0bf8130890 2023-09-30T22:21:18.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.247+0000 7f0bf4ff9700 1 -- 172.21.15.156:0/2437974241 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0bf8072480 con 0x7f0bf8130890 2023-09-30T22:21:18.250 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:18.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.249+0000 7f0bfe26f700 1 -- 172.21.15.156:0/2437974241 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bf8130890 msgr2=0x7f0bf81c8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:18.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.249+0000 7f0bfe26f700 1 --2- 172.21.15.156:0/2437974241 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bf8130890 0x7f0bf81c8f70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000cc80 tx=0x7f0bf000cf90 comp rx=0 tx=0).stop 2023-09-30T22:21:18.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.249+0000 7f0bfe26f700 1 -- 172.21.15.156:0/2437974241 shutdown_connections 2023-09-30T22:21:18.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.249+0000 7f0bfe26f700 1 --2- 172.21.15.156:0/2437974241 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bf8130890 0x7f0bf81c8f70 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:18.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.249+0000 7f0bfe26f700 1 --2- 172.21.15.156:0/2437974241 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bf8099e20 0x7f0bf81c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:18.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.249+0000 7f0bfe26f700 1 --2- 172.21.15.156:0/2437974241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bf809a730 0x7f0bf81c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:18.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.249+0000 7f0bfe26f700 1 -- 172.21.15.156:0/2437974241 >> 172.21.15.156:0/2437974241 conn(0x7f0bf80a2980 msgr2=0x7f0bf809e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:18.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.249+0000 7f0bfe26f700 1 -- 172.21.15.156:0/2437974241 shutdown_connections 2023-09-30T22:21:18.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.249+0000 7f0bfe26f700 1 -- 172.21.15.156:0/2437974241 wait complete. 2023-09-30T22:21:18.262 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:18.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.357+0000 7fe466c22700 1 -- 172.21.15.156:0/393323794 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe46006bbe0 con 0x7fe46009f260 2023-09-30T22:21:18.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.357+0000 7fe45d7fa700 1 -- 172.21.15.156:0/393323794 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe44c021020 con 0x7fe46009f260 2023-09-30T22:21:18.358 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:18.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.359+0000 7fe466c22700 1 -- 172.21.15.156:0/393323794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe46009f260 msgr2=0x7fe460122d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:18.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.359+0000 7fe466c22700 1 --2- 172.21.15.156:0/393323794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe46009f260 0x7fe460122d90 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe44c00e980 tx=0x7fe44c00ec90 comp rx=0 tx=0).stop 2023-09-30T22:21:18.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.359+0000 7fe466c22700 1 -- 172.21.15.156:0/393323794 shutdown_connections 2023-09-30T22:21:18.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.359+0000 7fe466c22700 1 --2- 172.21.15.156:0/393323794 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4601381e0 0x7fe4601232d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:18.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.359+0000 7fe466c22700 1 --2- 172.21.15.156:0/393323794 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe46009e950 0x7fe460122850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:18.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.359+0000 7fe466c22700 1 --2- 172.21.15.156:0/393323794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe46009f260 0x7fe460122d90 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:18.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.359+0000 7fe466c22700 1 -- 172.21.15.156:0/393323794 >> 172.21.15.156:0/393323794 conn(0x7fe4600a0f70 msgr2=0x7fe4600a3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:18.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.359+0000 7fe466c22700 1 -- 172.21.15.156:0/393323794 shutdown_connections 2023-09-30T22:21:18.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.359+0000 7fe466c22700 1 -- 172.21.15.156:0/393323794 wait complete. 2023-09-30T22:21:18.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.367+0000 7f34d1d04700 1 -- 172.21.15.156:0/1287774409 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f34cc11fef0 con 0x7f34cc099e20 2023-09-30T22:21:18.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.368+0000 7f34b3fff700 1 -- 172.21.15.156:0/1287774409 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f34bc016020 con 0x7f34cc099e20 2023-09-30T22:21:18.368 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:18.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.370+0000 7f34d1d04700 1 -- 172.21.15.156:0/1287774409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34cc099e20 msgr2=0x7f34cc11c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:18.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.370+0000 7f34d1d04700 1 --2- 172.21.15.156:0/1287774409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34cc099e20 0x7f34cc11c800 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f34bc000c00 tx=0x7f34bc004750 comp rx=0 tx=0).stop 2023-09-30T22:21:18.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.370+0000 7f34d1d04700 1 -- 172.21.15.156:0/1287774409 shutdown_connections 2023-09-30T22:21:18.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.370+0000 7f34d1d04700 1 --2- 172.21.15.156:0/1287774409 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34cc130890 0x7f34cc11d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:18.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.370+0000 7f34d1d04700 1 --2- 172.21.15.156:0/1287774409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34cc099e20 0x7f34cc11c800 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:18.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.370+0000 7f34d1d04700 1 --2- 172.21.15.156:0/1287774409 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f34cc09a730 0x7f34cc11cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:18.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.370+0000 7f34d1d04700 1 -- 172.21.15.156:0/1287774409 >> 172.21.15.156:0/1287774409 conn(0x7f34cc0a2980 msgr2=0x7f34cc071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:18.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.370+0000 7f34d1d04700 1 -- 172.21.15.156:0/1287774409 shutdown_connections 2023-09-30T22:21:18.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:18.370+0000 7f34d1d04700 1 -- 172.21.15.156:0/1287774409 wait complete. 2023-09-30T22:21:18.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:18.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:18.880 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:19.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.003+0000 7fc7e72b3700 1 Processor -- start 2023-09-30T22:21:19.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.003+0000 7fc7e72b3700 1 -- start start 2023-09-30T22:21:19.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.004+0000 7fc7e72b3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc7e009d860 0x7fc7e009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:19.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.004+0000 7fc7e72b3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7e0130eb0 0x7fc7e0138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:19.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.004+0000 7fc7e72b3700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e009aaa0 con 0x7fc7e009e170 2023-09-30T22:21:19.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.004+0000 7fc7e72b3700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e009f870 con 0x7fc7e009d860 2023-09-30T22:21:19.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.004+0000 7fc7e72b3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e009b360 con 0x7fc7e0130eb0 2023-09-30T22:21:19.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.004+0000 7fc7e504f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc7e009d860 0x7fc7e009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:19.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.004+0000 7fc7e5850700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7e0130eb0 0x7fc7e0138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:19.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.004+0000 7fc7e504f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc7e009d860 0x7fc7e009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59514/0 (socket says 172.21.15.156:59514) 2023-09-30T22:21:19.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.004+0000 7fc7e5850700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7e0130eb0 0x7fc7e0138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51054/0 (socket says 172.21.15.156:51054) 2023-09-30T22:21:19.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.004+0000 7fc7e484e700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc7e009e170 0x7fc7e01307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37616/0 (socket says 172.21.15.156:37616) 2023-09-30T22:21:19.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.004+0000 7fc7e504f700 1 -- 172.21.15.156:0/1488385333 learned_addr learned my addr 172.21.15.156:0/1488385333 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:19.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.004+0000 7fc7e5850700 1 -- 172.21.15.156:0/1488385333 >> v2:172.21.15.156:3300/0 conn(0x7fc7e009d860 msgr2=0x7fc7e009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:19.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.004+0000 7fc7e5850700 1 --2- 172.21.15.156:0/1488385333 >> v2:172.21.15.156:3300/0 conn(0x7fc7e009d860 0x7fc7e009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.004+0000 7fc7e5850700 1 -- 172.21.15.156:0/1488385333 >> v1:172.21.15.156:6789/0 conn(0x7fc7e009e170 legacy=0x7fc7e01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:19.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.004+0000 7fc7e5850700 1 -- 172.21.15.156:0/1488385333 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e009b620 con 0x7fc7e0130eb0 2023-09-30T22:21:19.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.004+0000 7fc7e504f700 1 --2- 172.21.15.156:0/1488385333 >> v2:172.21.15.156:3300/0 conn(0x7fc7e009d860 0x7fc7e009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:19.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.004+0000 7fc7e5850700 1 --2- 172.21.15.156:0/1488385333 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7e0130eb0 0x7fc7e0138a00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8009d90 tx=0x7fc7d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffb310360b126bad server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:19.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.005+0000 7fc7d7fff700 1 -- 172.21.15.156:0/1488385333 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d800e070 con 0x7fc7e0130eb0 2023-09-30T22:21:19.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.005+0000 7fc7d7fff700 1 -- 172.21.15.156:0/1488385333 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d800bb20 con 0x7fc7e0130eb0 2023-09-30T22:21:19.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.005+0000 7fc7d7fff700 1 -- 172.21.15.156:0/1488385333 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8012430 con 0x7fc7e0130eb0 2023-09-30T22:21:19.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.005+0000 7fc7e72b3700 1 -- 172.21.15.156:0/1488385333 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7e0130eb0 msgr2=0x7fc7e0138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:19.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.005+0000 7fc7e72b3700 1 --2- 172.21.15.156:0/1488385333 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7e0130eb0 0x7fc7e0138a00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8009d90 tx=0x7fc7d800b330 comp rx=0 tx=0).stop 2023-09-30T22:21:19.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.005+0000 7fc7e72b3700 1 -- 172.21.15.156:0/1488385333 shutdown_connections 2023-09-30T22:21:19.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.005+0000 7fc7e72b3700 1 --2- 172.21.15.156:0/1488385333 >> v2:172.21.15.156:3300/0 conn(0x7fc7e009d860 0x7fc7e009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.005+0000 7fc7e72b3700 1 --2- 172.21.15.156:0/1488385333 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7e0130eb0 0x7fc7e0138a00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.005+0000 7fc7e72b3700 1 -- 172.21.15.156:0/1488385333 >> 172.21.15.156:0/1488385333 conn(0x7fc7e0099c40 msgr2=0x7fc7e00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:19.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.005+0000 7fc7e72b3700 1 -- 172.21.15.156:0/1488385333 shutdown_connections 2023-09-30T22:21:19.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.005+0000 7fc7e72b3700 1 -- 172.21.15.156:0/1488385333 wait complete. 2023-09-30T22:21:19.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.006+0000 7fc7e72b3700 1 Processor -- start 2023-09-30T22:21:19.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.006+0000 7fc7e72b3700 1 -- start start 2023-09-30T22:21:19.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.007+0000 7fc7e72b3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7e009d860 0x7fc7e01c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:19.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.007+0000 7fc7e72b3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7e009e170 0x7fc7e01c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:19.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.007+0000 7fc7e72b3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7e0130eb0 0x7fc7e01c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:19.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.007+0000 7fc7e72b3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0130730 con 0x7fc7e009d860 2023-09-30T22:21:19.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.007+0000 7fc7e72b3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0126100 con 0x7fc7e009e170 2023-09-30T22:21:19.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.007+0000 7fc7e72b3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0120880 con 0x7fc7e0130eb0 2023-09-30T22:21:19.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.007+0000 7fc7e504f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7e009d860 0x7fc7e01c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:19.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.007+0000 7fc7e504f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7e009d860 0x7fc7e01c82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59530/0 (socket says 172.21.15.156:59530) 2023-09-30T22:21:19.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.007+0000 7fc7e504f700 1 -- 172.21.15.156:0/3298048697 learned_addr learned my addr 172.21.15.156:0/3298048697 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:19.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.007+0000 7fc7e484e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7e009e170 0x7fc7e01c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:19.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.007+0000 7fc7e5850700 1 --2- 172.21.15.156:0/3298048697 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7e0130eb0 0x7fc7e01c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:19.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.007+0000 7fc7e504f700 1 -- 172.21.15.156:0/3298048697 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7e0130eb0 msgr2=0x7fc7e01c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:19.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.007+0000 7fc7e504f700 1 --2- 172.21.15.156:0/3298048697 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7e0130eb0 0x7fc7e01c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.007+0000 7fc7e504f700 1 -- 172.21.15.156:0/3298048697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7e009e170 msgr2=0x7fc7e01c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:19.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.007+0000 7fc7e504f700 1 --2- 172.21.15.156:0/3298048697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7e009e170 0x7fc7e01c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.007+0000 7fc7e504f700 1 -- 172.21.15.156:0/3298048697 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d0009550 con 0x7fc7e009d860 2023-09-30T22:21:19.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.007+0000 7fc7e504f700 1 --2- 172.21.15.156:0/3298048697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7e009d860 0x7fc7e01c82c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000ec10 tx=0x7fc7d000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:19.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.007+0000 7fc7d5ffb700 1 -- 172.21.15.156:0/3298048697 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d000c850 con 0x7fc7e009d860 2023-09-30T22:21:19.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.007+0000 7fc7d5ffb700 1 -- 172.21.15.156:0/3298048697 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d000c9b0 con 0x7fc7e009d860 2023-09-30T22:21:19.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.007+0000 7fc7e72b3700 1 -- 172.21.15.156:0/3298048697 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d8009a70 con 0x7fc7e009d860 2023-09-30T22:21:19.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.007+0000 7fc7d5ffb700 1 -- 172.21.15.156:0/3298048697 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d000cd40 con 0x7fc7e009d860 2023-09-30T22:21:19.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.008+0000 7fc7e72b3700 1 -- 172.21.15.156:0/3298048697 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e0125c90 con 0x7fc7e009d860 2023-09-30T22:21:19.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.008+0000 7fc7d5ffb700 1 -- 172.21.15.156:0/3298048697 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc7d0013470 con 0x7fc7e009d860 2023-09-30T22:21:19.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.008+0000 7fc7d5ffb700 1 -- 172.21.15.156:0/3298048697 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc7d003f8b0 con 0x7fc7e009d860 2023-09-30T22:21:19.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.008+0000 7fc7e72b3700 1 -- 172.21.15.156:0/3298048697 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e004f2a0 con 0x7fc7e009d860 2023-09-30T22:21:19.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.013+0000 7fc7d5ffb700 1 -- 172.21.15.156:0/3298048697 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc7d0013720 con 0x7fc7e009d860 2023-09-30T22:21:19.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.198+0000 7fc7e72b3700 1 -- 172.21.15.156:0/3298048697 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc7e006c3b0 con 0x7fc7e009d860 2023-09-30T22:21:19.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.198+0000 7fc7d5ffb700 1 -- 172.21.15.156:0/3298048697 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc7d001bd00 con 0x7fc7e009d860 2023-09-30T22:21:19.199 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:19.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.200+0000 7fc7e72b3700 1 -- 172.21.15.156:0/3298048697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7e009d860 msgr2=0x7fc7e01c82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:19.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.200+0000 7fc7e72b3700 1 --2- 172.21.15.156:0/3298048697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7e009d860 0x7fc7e01c82c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000ec10 tx=0x7fc7d000ef20 comp rx=0 tx=0).stop 2023-09-30T22:21:19.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.200+0000 7fc7e72b3700 1 -- 172.21.15.156:0/3298048697 shutdown_connections 2023-09-30T22:21:19.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.200+0000 7fc7e72b3700 1 --2- 172.21.15.156:0/3298048697 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7e0130eb0 0x7fc7e01c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.200+0000 7fc7e72b3700 1 --2- 172.21.15.156:0/3298048697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7e009d860 0x7fc7e01c82c0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.200+0000 7fc7e72b3700 1 --2- 172.21.15.156:0/3298048697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7e009e170 0x7fc7e01c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.200+0000 7fc7e72b3700 1 -- 172.21.15.156:0/3298048697 >> 172.21.15.156:0/3298048697 conn(0x7fc7e0099c40 msgr2=0x7fc7e0119630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:19.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.200+0000 7fc7e72b3700 1 -- 172.21.15.156:0/3298048697 shutdown_connections 2023-09-30T22:21:19.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.200+0000 7fc7e72b3700 1 -- 172.21.15.156:0/3298048697 wait complete. 2023-09-30T22:21:19.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:19.263 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:19.374 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:19.430 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:19.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.384+0000 7f549d8b5700 1 Processor -- start 2023-09-30T22:21:19.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.384+0000 7f549d8b5700 1 -- start start 2023-09-30T22:21:19.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.385+0000 7f549d8b5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54980a1550 0x7f5498138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:19.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.385+0000 7f549d8b5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5498139200 0x7f549813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:19.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.385+0000 7f549d8b5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f549809e9d0 con 0x7f54980a0a70 2023-09-30T22:21:19.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.385+0000 7f549d8b5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549809dc00 con 0x7f5498139200 2023-09-30T22:21:19.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.385+0000 7f549d8b5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f549809dec0 con 0x7f54980a1550 2023-09-30T22:21:19.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.385+0000 7f5496ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f54980a0a70 0x7f54980a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37632/0 (socket says 172.21.15.156:37632) 2023-09-30T22:21:19.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.385+0000 7f54977fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5498139200 0x7f549813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:19.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.385+0000 7f5496ffd700 1 -- 172.21.15.156:0/2331752198 learned_addr learned my addr 172.21.15.156:0/2331752198 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:19.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.385+0000 7f54967fc700 1 --2- 172.21.15.156:0/2331752198 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54980a1550 0x7f5498138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:19.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.385+0000 7f5495ffb700 1 -- 172.21.15.156:0/2331752198 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 279741121 0 0) 0x7f549809e9d0 con 0x7f54980a0a70 2023-09-30T22:21:19.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.385+0000 7f5495ffb700 1 -- 172.21.15.156:0/2331752198 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54800035b0 con 0x7f54980a0a70 2023-09-30T22:21:19.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.385+0000 7f54977fe700 1 -- 172.21.15.156:0/2331752198 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54980a1550 msgr2=0x7f5498138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:19.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.385+0000 7f54977fe700 1 --2- 172.21.15.156:0/2331752198 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54980a1550 0x7f5498138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.385+0000 7f54977fe700 1 -- 172.21.15.156:0/2331752198 >> v1:172.21.15.156:6789/0 conn(0x7f54980a0a70 legacy=0x7f54980a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:19.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.385+0000 7f54977fe700 1 -- 172.21.15.156:0/2331752198 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549809e6a0 con 0x7f5498139200 2023-09-30T22:21:19.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.385+0000 7f54967fc700 1 --2- 172.21.15.156:0/2331752198 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54980a1550 0x7f5498138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:19.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.385+0000 7f54977fe700 1 --2- 172.21.15.156:0/2331752198 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5498139200 0x7f549813b5e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5490009dc0 tx=0x7f549000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b45e56f7e9c8d1e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:19.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.385+0000 7f5495ffb700 1 -- 172.21.15.156:0/2331752198 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549000e070 con 0x7f5498139200 2023-09-30T22:21:19.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.386+0000 7f5495ffb700 1 -- 172.21.15.156:0/2331752198 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549000bb20 con 0x7f5498139200 2023-09-30T22:21:19.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.386+0000 7f5495ffb700 1 -- 172.21.15.156:0/2331752198 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549000be90 con 0x7f5498139200 2023-09-30T22:21:19.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.386+0000 7f549d8b5700 1 -- 172.21.15.156:0/2331752198 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5498139200 msgr2=0x7f549813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:19.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.386+0000 7f549d8b5700 1 --2- 172.21.15.156:0/2331752198 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5498139200 0x7f549813b5e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5490009dc0 tx=0x7f549000b330 comp rx=0 tx=0).stop 2023-09-30T22:21:19.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.386+0000 7f549d8b5700 1 -- 172.21.15.156:0/2331752198 shutdown_connections 2023-09-30T22:21:19.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.386+0000 7f549d8b5700 1 --2- 172.21.15.156:0/2331752198 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5498139200 0x7f549813b5e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.386+0000 7f549d8b5700 1 --2- 172.21.15.156:0/2331752198 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54980a1550 0x7f5498138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.386+0000 7f549d8b5700 1 -- 172.21.15.156:0/2331752198 >> 172.21.15.156:0/2331752198 conn(0x7f54980a6610 msgr2=0x7f54980a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:19.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.386+0000 7f549d8b5700 1 -- 172.21.15.156:0/2331752198 shutdown_connections 2023-09-30T22:21:19.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.386+0000 7f549d8b5700 1 -- 172.21.15.156:0/2331752198 wait complete. 2023-09-30T22:21:19.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.387+0000 7f549d8b5700 1 Processor -- start 2023-09-30T22:21:19.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.388+0000 7f549d8b5700 1 -- start start 2023-09-30T22:21:19.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.388+0000 7f549d8b5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54980a0a70 0x7f5498120680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:19.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.388+0000 7f549d8b5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54980a1550 0x7f5498120bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:19.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.388+0000 7f549d8b5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5498139200 0x7f5498121100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:19.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.388+0000 7f549d8b5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54980a0470 con 0x7f54980a1550 2023-09-30T22:21:19.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.388+0000 7f549d8b5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54981223a0 con 0x7f5498139200 2023-09-30T22:21:19.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.388+0000 7f549d8b5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f549809c460 con 0x7f54980a0a70 2023-09-30T22:21:19.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.388+0000 7f54967fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54980a1550 0x7f5498120bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:19.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.388+0000 7f5496ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54980a0a70 0x7f5498120680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:19.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.388+0000 7f54977fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5498139200 0x7f5498121100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:19.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.388+0000 7f54967fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54980a1550 0x7f5498120bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59546/0 (socket says 172.21.15.156:59546) 2023-09-30T22:21:19.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.388+0000 7f54977fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5498139200 0x7f5498121100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52138/0 (socket says 172.21.15.156:52138) 2023-09-30T22:21:19.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.388+0000 7f54967fc700 1 -- 172.21.15.156:0/3922047368 learned_addr learned my addr 172.21.15.156:0/3922047368 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:19.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.389+0000 7f5496ffd700 1 -- 172.21.15.156:0/3922047368 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5498139200 msgr2=0x7f5498121100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:19.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.389+0000 7f5496ffd700 1 --2- 172.21.15.156:0/3922047368 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5498139200 0x7f5498121100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.389+0000 7f5496ffd700 1 -- 172.21.15.156:0/3922047368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54980a1550 msgr2=0x7f5498120bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:19.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.389+0000 7f5496ffd700 1 --2- 172.21.15.156:0/3922047368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54980a1550 0x7f5498120bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.389+0000 7f5496ffd700 1 -- 172.21.15.156:0/3922047368 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54880094a0 con 0x7f54980a0a70 2023-09-30T22:21:19.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.389+0000 7f5496ffd700 1 --2- 172.21.15.156:0/3922047368 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54980a0a70 0x7f5498120680 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f548c00c4c0 tx=0x7f548c00c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:19.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.389+0000 7f547ffff700 1 -- 172.21.15.156:0/3922047368 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c005d70 con 0x7f54980a0a70 2023-09-30T22:21:19.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.389+0000 7f547ffff700 1 -- 172.21.15.156:0/3922047368 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548c0070d0 con 0x7f54980a0a70 2023-09-30T22:21:19.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.389+0000 7f547ffff700 1 -- 172.21.15.156:0/3922047368 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c007440 con 0x7f54980a0a70 2023-09-30T22:21:19.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.389+0000 7f549d8b5700 1 -- 172.21.15.156:0/3922047368 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5490009a70 con 0x7f54980a0a70 2023-09-30T22:21:19.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.389+0000 7f549d8b5700 1 -- 172.21.15.156:0/3922047368 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5498122a80 con 0x7f54980a0a70 2023-09-30T22:21:19.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.390+0000 7f547ffff700 1 -- 172.21.15.156:0/3922047368 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f548c0075a0 con 0x7f54980a0a70 2023-09-30T22:21:19.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.390+0000 7f547ffff700 1 -- 172.21.15.156:0/3922047368 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f548c03e6e0 con 0x7f54980a0a70 2023-09-30T22:21:19.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.390+0000 7f549d8b5700 1 -- 172.21.15.156:0/3922047368 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5498123b10 con 0x7f54980a0a70 2023-09-30T22:21:19.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.395+0000 7f547ffff700 1 -- 172.21.15.156:0/3922047368 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f548c018af0 con 0x7f54980a0a70 2023-09-30T22:21:19.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.566+0000 7f46f1206700 1 Processor -- start 2023-09-30T22:21:19.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.566+0000 7f46f1206700 1 -- start start 2023-09-30T22:21:19.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.566+0000 7f3f25861700 1 Processor -- start 2023-09-30T22:21:19.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.566+0000 7f3f25861700 1 -- start start 2023-09-30T22:21:19.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.567+0000 7f46f1206700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f46ec0a0a70 0x7f46ec0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:19.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.567+0000 7f46f1206700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46ec0a1380 0x7f46ec133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:19.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.567+0000 7f46f1206700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46ec133f50 0x7f46ec1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:19.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.567+0000 7f46f1206700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ec09e9d0 con 0x7f46ec0a0a70 2023-09-30T22:21:19.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.567+0000 7f46f1206700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec09dc00 con 0x7f46ec0a1380 2023-09-30T22:21:19.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.567+0000 7f46f1206700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec09dec0 con 0x7f46ec133f50 2023-09-30T22:21:19.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.567+0000 7f3f25861700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3f20131980 0x7f3f20131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:19.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.567+0000 7f3f25861700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f2009bc70 0x7f3f2009c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:19.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.567+0000 7f3f25861700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f200a1640 con 0x7f3f2009c5c0 2023-09-30T22:21:19.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.567+0000 7f3f25861700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f2006eb30 con 0x7f3f20131980 2023-09-30T22:21:19.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.567+0000 7f3f25861700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f200a22d0 con 0x7f3f2009bc70 2023-09-30T22:21:19.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.567+0000 7f3f1e7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f2009bc70 0x7f3f2009c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:19.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.567+0000 7f3f1e7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f2009bc70 0x7f3f2009c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52152/0 (socket says 172.21.15.156:52152) 2023-09-30T22:21:19.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.567+0000 7f3f1e7fc700 1 -- 172.21.15.156:0/3737413327 learned_addr learned my addr 172.21.15.156:0/3737413327 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:19.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.567+0000 7f3f1effd700 1 --2- 172.21.15.156:0/3737413327 >> v2:172.21.15.156:3300/0 conn(0x7f3f20131980 0x7f3f20131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:19.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.567+0000 7f46eb59e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46ec133f50 0x7f46ec1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:19.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.567+0000 7f46eb59e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46ec133f50 0x7f46ec1343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51092/0 (socket says 172.21.15.156:51092) 2023-09-30T22:21:19.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.567+0000 7f46eb59e700 1 -- 172.21.15.156:0/2369150186 learned_addr learned my addr 172.21.15.156:0/2369150186 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:19.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.567+0000 7f46ead9d700 1 --2- 172.21.15.156:0/2369150186 >> v2:172.21.15.156:3300/0 conn(0x7f46ec0a0a70 0x7f46ec0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:19.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.567+0000 7f46eb59e700 1 -- 172.21.15.156:0/2369150186 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46ec0a1380 msgr2=0x7f46ec133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:19.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.567+0000 7f46eb59e700 1 --2- 172.21.15.156:0/2369150186 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46ec0a1380 0x7f46ec133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.567+0000 7f46eb59e700 1 -- 172.21.15.156:0/2369150186 >> v2:172.21.15.156:3300/0 conn(0x7f46ec0a0a70 msgr2=0x7f46ec0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:19.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.567+0000 7f46eb59e700 1 --2- 172.21.15.156:0/2369150186 >> v2:172.21.15.156:3300/0 conn(0x7f46ec0a0a70 0x7f46ec0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.567+0000 7f46eb59e700 1 -- 172.21.15.156:0/2369150186 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec09e6a0 con 0x7f46ec133f50 2023-09-30T22:21:19.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.567+0000 7f3f1e7fc700 1 -- 172.21.15.156:0/3737413327 >> v2:172.21.15.156:3300/0 conn(0x7f3f20131980 msgr2=0x7f3f20131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:19.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.567+0000 7f3f1e7fc700 1 --2- 172.21.15.156:0/3737413327 >> v2:172.21.15.156:3300/0 conn(0x7f3f20131980 0x7f3f20131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.567+0000 7f3f1e7fc700 1 -- 172.21.15.156:0/3737413327 >> v1:172.21.15.156:6789/0 conn(0x7f3f2009c5c0 legacy=0x7f3f20138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:19.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.567+0000 7f3f1e7fc700 1 -- 172.21.15.156:0/3737413327 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f20131550 con 0x7f3f2009bc70 2023-09-30T22:21:19.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.568+0000 7f46eb59e700 1 --2- 172.21.15.156:0/2369150186 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46ec133f50 0x7f46ec1343b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f46e4009e50 tx=0x7f46e400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=375228a6888dafac server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:19.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.568+0000 7f3f1e7fc700 1 --2- 172.21.15.156:0/3737413327 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f2009bc70 0x7f3f2009c080 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3f140098f0 tx=0x7f3f14009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80fab09610d61d34 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:19.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.568+0000 7f46e9d9b700 1 -- 172.21.15.156:0/2369150186 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e400e070 con 0x7f46ec133f50 2023-09-30T22:21:19.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.568+0000 7f3f1dffb700 1 -- 172.21.15.156:0/3737413327 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f14011830 con 0x7f3f2009bc70 2023-09-30T22:21:19.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.568+0000 7f46e9d9b700 1 -- 172.21.15.156:0/2369150186 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e400b910 con 0x7f46ec133f50 2023-09-30T22:21:19.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.568+0000 7f3f1dffb700 1 -- 172.21.15.156:0/3737413327 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f14011990 con 0x7f3f2009bc70 2023-09-30T22:21:19.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.568+0000 7f3f1dffb700 1 -- 172.21.15.156:0/3737413327 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f14011d00 con 0x7f3f2009bc70 2023-09-30T22:21:19.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.568+0000 7f46e9d9b700 1 -- 172.21.15.156:0/2369150186 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e400bc80 con 0x7f46ec133f50 2023-09-30T22:21:19.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.569+0000 7f46f1206700 1 -- 172.21.15.156:0/2369150186 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46ec133f50 msgr2=0x7f46ec1343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:19.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.569+0000 7f46f1206700 1 --2- 172.21.15.156:0/2369150186 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46ec133f50 0x7f46ec1343b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f46e4009e50 tx=0x7f46e400b330 comp rx=0 tx=0).stop 2023-09-30T22:21:19.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.569+0000 7f46f1206700 1 -- 172.21.15.156:0/2369150186 shutdown_connections 2023-09-30T22:21:19.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.569+0000 7f46f1206700 1 --2- 172.21.15.156:0/2369150186 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46ec133f50 0x7f46ec1343b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.569+0000 7f46f1206700 1 --2- 172.21.15.156:0/2369150186 >> v2:172.21.15.156:3300/0 conn(0x7f46ec0a0a70 0x7f46ec0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.569+0000 7f46f1206700 1 --2- 172.21.15.156:0/2369150186 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46ec0a1380 0x7f46ec133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.569+0000 7f46f1206700 1 -- 172.21.15.156:0/2369150186 >> 172.21.15.156:0/2369150186 conn(0x7f46ec0a6610 msgr2=0x7f46ec0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:19.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.569+0000 7f3f25861700 1 -- 172.21.15.156:0/3737413327 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f2009bc70 msgr2=0x7f3f2009c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:19.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.569+0000 7f3f25861700 1 --2- 172.21.15.156:0/3737413327 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f2009bc70 0x7f3f2009c080 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3f140098f0 tx=0x7f3f14009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:19.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.569+0000 7f3f25861700 1 -- 172.21.15.156:0/3737413327 shutdown_connections 2023-09-30T22:21:19.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.569+0000 7f3f25861700 1 --2- 172.21.15.156:0/3737413327 >> v2:172.21.15.156:3300/0 conn(0x7f3f20131980 0x7f3f20131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.569+0000 7f3f25861700 1 --2- 172.21.15.156:0/3737413327 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f2009bc70 0x7f3f2009c080 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.569+0000 7f3f25861700 1 -- 172.21.15.156:0/3737413327 >> 172.21.15.156:0/3737413327 conn(0x7f3f200a2980 msgr2=0x7f3f200a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:19.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.569+0000 7f46f1206700 1 -- 172.21.15.156:0/2369150186 shutdown_connections 2023-09-30T22:21:19.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.569+0000 7f3f25861700 1 -- 172.21.15.156:0/3737413327 shutdown_connections 2023-09-30T22:21:19.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.569+0000 7f46f1206700 1 -- 172.21.15.156:0/2369150186 wait complete. 2023-09-30T22:21:19.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.569+0000 7f3f25861700 1 -- 172.21.15.156:0/3737413327 wait complete. 2023-09-30T22:21:19.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.570+0000 7f3f25861700 1 Processor -- start 2023-09-30T22:21:19.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.570+0000 7f3f25861700 1 -- start start 2023-09-30T22:21:19.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.570+0000 7f46f1206700 1 Processor -- start 2023-09-30T22:21:19.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.570+0000 7f46f1206700 1 -- start start 2023-09-30T22:21:19.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.570+0000 7f3f25861700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f2009bc70 0x7f3f201395f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:19.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.570+0000 7f3f25861700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f2009c5c0 0x7f3f20139b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:19.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.570+0000 7f3f25861700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f20131980 0x7f3f201c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:19.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.570+0000 7f3f25861700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f20135e40 con 0x7f3f2009c5c0 2023-09-30T22:21:19.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.570+0000 7f3f25861700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f20130e80 con 0x7f3f20131980 2023-09-30T22:21:19.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.570+0000 7f3f25861700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f200a1c40 con 0x7f3f2009bc70 2023-09-30T22:21:19.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f3f1f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f20131980 0x7f3f201c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:19.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f3f1effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f2009bc70 0x7f3f201395f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:19.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f3f1f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f20131980 0x7f3f201c8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52168/0 (socket says 172.21.15.156:52168) 2023-09-30T22:21:19.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f3f1effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f2009bc70 0x7f3f201395f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51098/0 (socket says 172.21.15.156:51098) 2023-09-30T22:21:19.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f3f1f7fe700 1 -- 172.21.15.156:0/3987941808 learned_addr learned my addr 172.21.15.156:0/3987941808 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:19.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f46f1206700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46ec0a0a70 0x7f46ec1223b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:19.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f46f1206700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46ec0a1380 0x7f46ec1228f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:19.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f46f1206700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46ec133f50 0x7f46ec122e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:19.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f46f1206700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec124e80 con 0x7f46ec0a1380 2023-09-30T22:21:19.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f46f1206700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec124170 con 0x7f46ec133f50 2023-09-30T22:21:19.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f46f1206700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec123f80 con 0x7f46ec0a0a70 2023-09-30T22:21:19.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f46eb59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46ec133f50 0x7f46ec122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:19.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f46eb59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46ec133f50 0x7f46ec122e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52182/0 (socket says 172.21.15.156:52182) 2023-09-30T22:21:19.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f46eb59e700 1 -- 172.21.15.156:0/2238705293 learned_addr learned my addr 172.21.15.156:0/2238705293 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:19.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f46ead9d700 1 --2- 172.21.15.156:0/2238705293 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46ec0a0a70 0x7f46ec1223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:19.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f46ea59c700 1 --2- 172.21.15.156:0/2238705293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46ec0a1380 0x7f46ec1228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:19.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f3f1f7fe700 1 -- 172.21.15.156:0/3987941808 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f2009bc70 msgr2=0x7f3f201395f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:19.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f3f1f7fe700 1 --2- 172.21.15.156:0/3987941808 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f2009bc70 0x7f3f201395f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f3f1f7fe700 1 -- 172.21.15.156:0/3987941808 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f2009c5c0 msgr2=0x7f3f20139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:19.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f3f1e7fc700 1 --2- 172.21.15.156:0/3987941808 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f2009c5c0 0x7f3f20139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:19.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f3f1f7fe700 1 --2- 172.21.15.156:0/3987941808 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f2009c5c0 0x7f3f20139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f3f1f7fe700 1 -- 172.21.15.156:0/3987941808 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f14009550 con 0x7f3f20131980 2023-09-30T22:21:19.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f3f1effd700 1 --2- 172.21.15.156:0/3987941808 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f2009bc70 0x7f3f201395f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:19.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f3f1e7fc700 1 --2- 172.21.15.156:0/3987941808 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f2009c5c0 0x7f3f20139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:21:19.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f46ead9d700 1 -- 172.21.15.156:0/2238705293 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46ec133f50 msgr2=0x7f46ec122e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:19.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f46ead9d700 1 --2- 172.21.15.156:0/2238705293 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46ec133f50 0x7f46ec122e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f46ead9d700 1 -- 172.21.15.156:0/2238705293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46ec0a1380 msgr2=0x7f46ec1228f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:19.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f46ead9d700 1 --2- 172.21.15.156:0/2238705293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46ec0a1380 0x7f46ec1228f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f46ead9d700 1 -- 172.21.15.156:0/2238705293 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e4009b30 con 0x7f46ec0a0a70 2023-09-30T22:21:19.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f46ead9d700 1 --2- 172.21.15.156:0/2238705293 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46ec0a0a70 0x7f46ec1223b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00e900 tx=0x7f46dc00ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:19.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.571+0000 7f3f1f7fe700 1 --2- 172.21.15.156:0/3987941808 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f20131980 0x7f3f201c8380 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800cc50 tx=0x7f3f1800cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:19.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.572+0000 7f46d37fe700 1 -- 172.21.15.156:0/2238705293 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc013680 con 0x7f46ec0a0a70 2023-09-30T22:21:19.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.572+0000 7f3f07fff700 1 -- 172.21.15.156:0/3987941808 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f18003c00 con 0x7f3f20131980 2023-09-30T22:21:19.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.572+0000 7f3f07fff700 1 -- 172.21.15.156:0/3987941808 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f18003d60 con 0x7f3f20131980 2023-09-30T22:21:19.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.572+0000 7f46f1206700 1 -- 172.21.15.156:0/2238705293 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ec0a03e0 con 0x7f46ec0a0a70 2023-09-30T22:21:19.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.572+0000 7f3f25861700 1 -- 172.21.15.156:0/3987941808 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f20137670 con 0x7f3f20131980 2023-09-30T22:21:19.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.572+0000 7f3f25861700 1 -- 172.21.15.156:0/3987941808 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f20138c90 con 0x7f3f20131980 2023-09-30T22:21:19.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.572+0000 7f46f1206700 1 -- 172.21.15.156:0/2238705293 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ec1251d0 con 0x7f46ec0a0a70 2023-09-30T22:21:19.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.572+0000 7f46d37fe700 1 -- 172.21.15.156:0/2238705293 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46dc005a20 con 0x7f46ec0a0a70 2023-09-30T22:21:19.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.572+0000 7f46d37fe700 1 -- 172.21.15.156:0/2238705293 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc005d90 con 0x7f46ec0a0a70 2023-09-30T22:21:19.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.573+0000 7f46d37fe700 1 -- 172.21.15.156:0/2238705293 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f46dc0137e0 con 0x7f46ec0a0a70 2023-09-30T22:21:19.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.573+0000 7f3f07fff700 1 -- 172.21.15.156:0/3987941808 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1800ab60 con 0x7f3f20131980 2023-09-30T22:21:19.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.573+0000 7f46d37fe700 1 -- 172.21.15.156:0/2238705293 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f46dc03fc20 con 0x7f46ec0a0a70 2023-09-30T22:21:19.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.573+0000 7f46f1206700 1 -- 172.21.15.156:0/2238705293 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46cc0052e0 con 0x7f46ec0a0a70 2023-09-30T22:21:19.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.573+0000 7f3f07fff700 1 -- 172.21.15.156:0/3987941808 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f1800ad00 con 0x7f3f20131980 2023-09-30T22:21:19.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.573+0000 7f3f07fff700 1 -- 172.21.15.156:0/3987941808 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3f1803f850 con 0x7f3f20131980 2023-09-30T22:21:19.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.574+0000 7f3f25861700 1 -- 172.21.15.156:0/3987941808 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f000052e0 con 0x7f3f20131980 2023-09-30T22:21:19.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.578+0000 7f46d37fe700 1 -- 172.21.15.156:0/2238705293 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f46dc006020 con 0x7f46ec0a0a70 2023-09-30T22:21:19.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.583+0000 7f3f07fff700 1 -- 172.21.15.156:0/3987941808 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f180052b0 con 0x7f3f20131980 2023-09-30T22:21:19.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.597+0000 7f549d8b5700 1 -- 172.21.15.156:0/3922047368 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f549804f2a0 con 0x7f54980a0a70 2023-09-30T22:21:19.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.597+0000 7f547ffff700 1 -- 172.21.15.156:0/3922047368 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f548c017020 con 0x7f54980a0a70 2023-09-30T22:21:19.598 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:19.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.600+0000 7f549d8b5700 1 -- 172.21.15.156:0/3922047368 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54980a0a70 msgr2=0x7f5498120680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:19.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.600+0000 7f549d8b5700 1 --2- 172.21.15.156:0/3922047368 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54980a0a70 0x7f5498120680 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f548c00c4c0 tx=0x7f548c00c7d0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.600+0000 7f549d8b5700 1 -- 172.21.15.156:0/3922047368 shutdown_connections 2023-09-30T22:21:19.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.600+0000 7f549d8b5700 1 --2- 172.21.15.156:0/3922047368 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5498139200 0x7f5498121100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.600+0000 7f549d8b5700 1 --2- 172.21.15.156:0/3922047368 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54980a0a70 0x7f5498120680 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.600+0000 7f549d8b5700 1 --2- 172.21.15.156:0/3922047368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54980a1550 0x7f5498120bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.600+0000 7f549d8b5700 1 -- 172.21.15.156:0/3922047368 >> 172.21.15.156:0/3922047368 conn(0x7f54980a6610 msgr2=0x7f5498136b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:19.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.600+0000 7f549d8b5700 1 -- 172.21.15.156:0/3922047368 shutdown_connections 2023-09-30T22:21:19.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.600+0000 7f549d8b5700 1 -- 172.21.15.156:0/3922047368 wait complete. 2023-09-30T22:21:19.613 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:19.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.773+0000 7f46f1206700 1 -- 172.21.15.156:0/2238705293 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f46cc005590 con 0x7f46ec0a0a70 2023-09-30T22:21:19.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.773+0000 7f46d37fe700 1 -- 172.21.15.156:0/2238705293 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f46dc02b090 con 0x7f46ec0a0a70 2023-09-30T22:21:19.774 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:19.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.774+0000 7f3f25861700 1 -- 172.21.15.156:0/3987941808 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3f00005590 con 0x7f3f20131980 2023-09-30T22:21:19.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.774+0000 7f3f07fff700 1 -- 172.21.15.156:0/3987941808 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f18011380 con 0x7f3f20131980 2023-09-30T22:21:19.775 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:19.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.775+0000 7f46f1206700 1 -- 172.21.15.156:0/2238705293 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46ec0a0a70 msgr2=0x7f46ec1223b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:19.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.775+0000 7f46f1206700 1 --2- 172.21.15.156:0/2238705293 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46ec0a0a70 0x7f46ec1223b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00e900 tx=0x7f46dc00ec10 comp rx=0 tx=0).stop 2023-09-30T22:21:19.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.775+0000 7f46f1206700 1 -- 172.21.15.156:0/2238705293 shutdown_connections 2023-09-30T22:21:19.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.775+0000 7f46f1206700 1 --2- 172.21.15.156:0/2238705293 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46ec133f50 0x7f46ec122e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.775+0000 7f46f1206700 1 --2- 172.21.15.156:0/2238705293 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46ec0a0a70 0x7f46ec1223b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.775+0000 7f46f1206700 1 --2- 172.21.15.156:0/2238705293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46ec0a1380 0x7f46ec1228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.775+0000 7f46f1206700 1 -- 172.21.15.156:0/2238705293 >> 172.21.15.156:0/2238705293 conn(0x7f46ec0a6610 msgr2=0x7f46ec09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:19.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.775+0000 7f46f1206700 1 -- 172.21.15.156:0/2238705293 shutdown_connections 2023-09-30T22:21:19.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.775+0000 7f46f1206700 1 -- 172.21.15.156:0/2238705293 wait complete. 2023-09-30T22:21:19.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.777+0000 7f3f25861700 1 -- 172.21.15.156:0/3987941808 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f20131980 msgr2=0x7f3f201c8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:19.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.777+0000 7f3f25861700 1 --2- 172.21.15.156:0/3987941808 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f20131980 0x7f3f201c8380 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800cc50 tx=0x7f3f1800cf60 comp rx=0 tx=0).stop 2023-09-30T22:21:19.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.777+0000 7f3f25861700 1 -- 172.21.15.156:0/3987941808 shutdown_connections 2023-09-30T22:21:19.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.777+0000 7f3f25861700 1 --2- 172.21.15.156:0/3987941808 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f20131980 0x7f3f201c8380 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.777+0000 7f3f25861700 1 --2- 172.21.15.156:0/3987941808 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f2009bc70 0x7f3f201395f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.777+0000 7f3f25861700 1 --2- 172.21.15.156:0/3987941808 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f2009c5c0 0x7f3f20139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:19.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.777+0000 7f3f25861700 1 -- 172.21.15.156:0/3987941808 >> 172.21.15.156:0/3987941808 conn(0x7f3f200a2980 msgr2=0x7f3f20071320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:19.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.777+0000 7f3f25861700 1 -- 172.21.15.156:0/3987941808 shutdown_connections 2023-09-30T22:21:19.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:19.777+0000 7f3f25861700 1 -- 172.21.15.156:0/3987941808 wait complete. 2023-09-30T22:21:19.789 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:19.790 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:20.214 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:20.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.338+0000 7f3539698700 1 Processor -- start 2023-09-30T22:21:20.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.338+0000 7f3539698700 1 -- start start 2023-09-30T22:21:20.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.338+0000 7f3539698700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35340a0b50 0x7f35340a0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:20.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.339+0000 7f3539698700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f35340a2e10 0x7f35340a1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:20.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.339+0000 7f3539698700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35340a1e60 con 0x7f3534133ad0 2023-09-30T22:21:20.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.339+0000 7f3539698700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f353409aa00 con 0x7f35340a2e10 2023-09-30T22:21:20.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.339+0000 7f3539698700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35340a19a0 con 0x7f35340a0b50 2023-09-30T22:21:20.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.339+0000 7f3532ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35340a0b50 0x7f35340a0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:20.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.339+0000 7f35327fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f35340a2e10 0x7f35340a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:20.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.339+0000 7f3532ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35340a0b50 0x7f35340a0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52186/0 (socket says 172.21.15.156:52186) 2023-09-30T22:21:20.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.339+0000 7f3532ffd700 1 -- 172.21.15.156:0/2461580652 learned_addr learned my addr 172.21.15.156:0/2461580652 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:20.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.339+0000 7f3532ffd700 1 -- 172.21.15.156:0/2461580652 >> v2:172.21.15.156:3300/0 conn(0x7f35340a2e10 msgr2=0x7f35340a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:20.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.339+0000 7f3532ffd700 1 --2- 172.21.15.156:0/2461580652 >> v2:172.21.15.156:3300/0 conn(0x7f35340a2e10 0x7f35340a1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.339+0000 7f3532ffd700 1 -- 172.21.15.156:0/2461580652 >> v1:172.21.15.156:6789/0 conn(0x7f3534133ad0 legacy=0x7f3534133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:20.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.339+0000 7f3532ffd700 1 -- 172.21.15.156:0/2461580652 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353409a5b0 con 0x7f35340a0b50 2023-09-30T22:21:20.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.339+0000 7f35327fc700 1 --2- 172.21.15.156:0/2461580652 >> v2:172.21.15.156:3300/0 conn(0x7f35340a2e10 0x7f35340a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:20.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.339+0000 7f3531ffb700 1 -- 172.21.15.156:0/2461580652 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3264356278 0 0) 0x7f35340a1e60 con 0x7f3534133ad0 2023-09-30T22:21:20.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.339+0000 7f3532ffd700 1 --2- 172.21.15.156:0/2461580652 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35340a0b50 0x7f35340a0f20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f35280098f0 tx=0x7f3528009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eaec17fdb8896ae2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:20.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.339+0000 7f3531ffb700 1 -- 172.21.15.156:0/2461580652 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3528011830 con 0x7f35340a0b50 2023-09-30T22:21:20.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.339+0000 7f3531ffb700 1 -- 172.21.15.156:0/2461580652 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3528011990 con 0x7f35340a0b50 2023-09-30T22:21:20.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.339+0000 7f3531ffb700 1 -- 172.21.15.156:0/2461580652 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3528011d20 con 0x7f35340a0b50 2023-09-30T22:21:20.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.340+0000 7f3539698700 1 -- 172.21.15.156:0/2461580652 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35340a0b50 msgr2=0x7f35340a0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:20.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.340+0000 7f3539698700 1 --2- 172.21.15.156:0/2461580652 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35340a0b50 0x7f35340a0f20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f35280098f0 tx=0x7f3528009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:20.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.340+0000 7f3539698700 1 -- 172.21.15.156:0/2461580652 shutdown_connections 2023-09-30T22:21:20.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.340+0000 7f3539698700 1 --2- 172.21.15.156:0/2461580652 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35340a0b50 0x7f35340a0f20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.340+0000 7f3539698700 1 --2- 172.21.15.156:0/2461580652 >> v2:172.21.15.156:3300/0 conn(0x7f35340a2e10 0x7f35340a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.340+0000 7f3539698700 1 -- 172.21.15.156:0/2461580652 >> 172.21.15.156:0/2461580652 conn(0x7f353406c780 msgr2=0x7f353406cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:20.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.340+0000 7f3539698700 1 -- 172.21.15.156:0/2461580652 shutdown_connections 2023-09-30T22:21:20.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.340+0000 7f3539698700 1 -- 172.21.15.156:0/2461580652 wait complete. 2023-09-30T22:21:20.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.341+0000 7f3539698700 1 Processor -- start 2023-09-30T22:21:20.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.341+0000 7f3539698700 1 -- start start 2023-09-30T22:21:20.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.341+0000 7f3539698700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35340a0b50 0x7f353411f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:20.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.341+0000 7f3539698700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35340a2e10 0x7f353411fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:20.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.341+0000 7f3539698700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3534133ad0 0x7f35341c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:20.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.341+0000 7f3539698700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3534122500 con 0x7f3534133ad0 2023-09-30T22:21:20.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.341+0000 7f3539698700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35341226e0 con 0x7f35340a2e10 2023-09-30T22:21:20.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.341+0000 7f3539698700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3534133550 con 0x7f35340a0b50 2023-09-30T22:21:20.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.341+0000 7f35327fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35340a2e10 0x7f353411fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:20.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.341+0000 7f3532ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35340a0b50 0x7f353411f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:20.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.341+0000 7f35337fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3534133ad0 0x7f35341c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:20.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.341+0000 7f35327fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35340a2e10 0x7f353411fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52192/0 (socket says 172.21.15.156:52192) 2023-09-30T22:21:20.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.341+0000 7f35327fc700 1 -- 172.21.15.156:0/374832497 learned_addr learned my addr 172.21.15.156:0/374832497 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:20.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.342+0000 7f35327fc700 1 -- 172.21.15.156:0/374832497 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35340a0b50 msgr2=0x7f353411f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:20.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.342+0000 7f35327fc700 1 --2- 172.21.15.156:0/374832497 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35340a0b50 0x7f353411f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.342+0000 7f35327fc700 1 -- 172.21.15.156:0/374832497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3534133ad0 msgr2=0x7f35341c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:20.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.342+0000 7f35327fc700 1 --2- 172.21.15.156:0/374832497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3534133ad0 0x7f35341c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.342+0000 7f35327fc700 1 -- 172.21.15.156:0/374832497 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35240094a0 con 0x7f35340a2e10 2023-09-30T22:21:20.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.342+0000 7f35337fe700 1 --2- 172.21.15.156:0/374832497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3534133ad0 0x7f35341c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:20.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.342+0000 7f3532ffd700 1 --2- 172.21.15.156:0/374832497 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35340a0b50 0x7f353411f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:20.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.342+0000 7f35327fc700 1 --2- 172.21.15.156:0/374832497 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35340a2e10 0x7f353411fc90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f352400ebb0 tx=0x7f352400eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:20.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.342+0000 7f351b7fe700 1 -- 172.21.15.156:0/374832497 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352400c850 con 0x7f35340a2e10 2023-09-30T22:21:20.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.342+0000 7f351b7fe700 1 -- 172.21.15.156:0/374832497 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352400c9b0 con 0x7f35340a2e10 2023-09-30T22:21:20.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.342+0000 7f3539698700 1 -- 172.21.15.156:0/374832497 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3528009550 con 0x7f35340a2e10 2023-09-30T22:21:20.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.342+0000 7f351b7fe700 1 -- 172.21.15.156:0/374832497 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352400cd40 con 0x7f35340a2e10 2023-09-30T22:21:20.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.342+0000 7f3539698700 1 -- 172.21.15.156:0/374832497 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35340a41b0 con 0x7f35340a2e10 2023-09-30T22:21:20.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.343+0000 7f3539698700 1 -- 172.21.15.156:0/374832497 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35341220a0 con 0x7f35340a2e10 2023-09-30T22:21:20.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.343+0000 7f351b7fe700 1 -- 172.21.15.156:0/374832497 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3524013470 con 0x7f35340a2e10 2023-09-30T22:21:20.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.343+0000 7f351b7fe700 1 -- 172.21.15.156:0/374832497 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f352403ff10 con 0x7f35340a2e10 2023-09-30T22:21:20.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.348+0000 7f351b7fe700 1 -- 172.21.15.156:0/374832497 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3524013720 con 0x7f35340a2e10 2023-09-30T22:21:20.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.531+0000 7f3539698700 1 -- 172.21.15.156:0/374832497 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3534122360 con 0x7f35340a2e10 2023-09-30T22:21:20.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.531+0000 7f351b7fe700 1 -- 172.21.15.156:0/374832497 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3534122360 con 0x7f35340a2e10 2023-09-30T22:21:20.532 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:20.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.534+0000 7f3539698700 1 -- 172.21.15.156:0/374832497 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35340a2e10 msgr2=0x7f353411fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:20.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.534+0000 7f3539698700 1 --2- 172.21.15.156:0/374832497 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35340a2e10 0x7f353411fc90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f352400ebb0 tx=0x7f352400eec0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.534+0000 7f3539698700 1 -- 172.21.15.156:0/374832497 shutdown_connections 2023-09-30T22:21:20.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.534+0000 7f3539698700 1 --2- 172.21.15.156:0/374832497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3534133ad0 0x7f35341c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.534+0000 7f3539698700 1 --2- 172.21.15.156:0/374832497 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35340a0b50 0x7f353411f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.534+0000 7f3539698700 1 --2- 172.21.15.156:0/374832497 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35340a2e10 0x7f353411fc90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.534+0000 7f3539698700 1 -- 172.21.15.156:0/374832497 >> 172.21.15.156:0/374832497 conn(0x7f353406c780 msgr2=0x7f353409b470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:20.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.534+0000 7f3539698700 1 -- 172.21.15.156:0/374832497 shutdown_connections 2023-09-30T22:21:20.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.534+0000 7f3539698700 1 -- 172.21.15.156:0/374832497 wait complete. 2023-09-30T22:21:20.547 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:20.614 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:20.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.736+0000 7f55ef7b3700 1 Processor -- start 2023-09-30T22:21:20.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.737+0000 7f55ef7b3700 1 -- start start 2023-09-30T22:21:20.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.737+0000 7f55ef7b3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f55e8133ad0 0x7f55e8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:20.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.737+0000 7f55ef7b3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55e81300a0 0x7f55e81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:20.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.737+0000 7f55ef7b3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55e81309f0 0x7f55e813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:20.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.737+0000 7f55ef7b3700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55e806b2d0 con 0x7f55e8133ad0 2023-09-30T22:21:20.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.737+0000 7f55ef7b3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e8133610 con 0x7f55e81300a0 2023-09-30T22:21:20.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.737+0000 7f55ef7b3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55e809a500 con 0x7f55e81309f0 2023-09-30T22:21:20.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.737+0000 7f55edd50700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55e81309f0 0x7f55e813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:20.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.737+0000 7f55ecd4e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55e81300a0 0x7f55e81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:20.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.737+0000 7f55ed54f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f55e8133ad0 0x7f55e8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:20.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.737+0000 7f55ecd4e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55e81300a0 0x7f55e81304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52206/0 (socket says 172.21.15.156:52206) 2023-09-30T22:21:20.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.737+0000 7f55edd50700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55e81309f0 0x7f55e813a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51132/0 (socket says 172.21.15.156:51132) 2023-09-30T22:21:20.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.737+0000 7f55ed54f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f55e8133ad0 0x7f55e8133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59614/0 (socket says 172.21.15.156:59614) 2023-09-30T22:21:20.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.737+0000 7f55ecd4e700 1 -- 172.21.15.156:0/2087185278 learned_addr learned my addr 172.21.15.156:0/2087185278 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:20.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.737+0000 7f55ecd4e700 1 -- 172.21.15.156:0/2087185278 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55e81309f0 msgr2=0x7f55e813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:20.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.737+0000 7f55ecd4e700 1 --2- 172.21.15.156:0/2087185278 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55e81309f0 0x7f55e813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.737+0000 7f55ecd4e700 1 -- 172.21.15.156:0/2087185278 >> v2:172.21.15.156:3300/0 conn(0x7f55e8133ad0 msgr2=0x7f55e8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:20.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.737+0000 7f55ecd4e700 1 --2- 172.21.15.156:0/2087185278 >> v2:172.21.15.156:3300/0 conn(0x7f55e8133ad0 0x7f55e8133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.737+0000 7f55ecd4e700 1 -- 172.21.15.156:0/2087185278 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e81338b0 con 0x7f55e81300a0 2023-09-30T22:21:20.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.737+0000 7f55edd50700 1 --2- 172.21.15.156:0/2087185278 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55e81309f0 0x7f55e813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:20.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.737+0000 7f55ed54f700 1 --2- 172.21.15.156:0/2087185278 >> v2:172.21.15.156:3300/0 conn(0x7f55e8133ad0 0x7f55e8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:20.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.738+0000 7f55ecd4e700 1 --2- 172.21.15.156:0/2087185278 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55e81300a0 0x7f55e81304b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f55e40098f0 tx=0x7f55e4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74fbca89296e66d7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:20.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.738+0000 7f55dffff700 1 -- 172.21.15.156:0/2087185278 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e4011830 con 0x7f55e81300a0 2023-09-30T22:21:20.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.738+0000 7f55dffff700 1 -- 172.21.15.156:0/2087185278 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e4011990 con 0x7f55e81300a0 2023-09-30T22:21:20.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.738+0000 7f55dffff700 1 -- 172.21.15.156:0/2087185278 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e4011d20 con 0x7f55e81300a0 2023-09-30T22:21:20.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.738+0000 7f55ef7b3700 1 -- 172.21.15.156:0/2087185278 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55e81300a0 msgr2=0x7f55e81304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:20.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.738+0000 7f55ef7b3700 1 --2- 172.21.15.156:0/2087185278 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55e81300a0 0x7f55e81304b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f55e40098f0 tx=0x7f55e4009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:20.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.738+0000 7f55ef7b3700 1 -- 172.21.15.156:0/2087185278 shutdown_connections 2023-09-30T22:21:20.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.738+0000 7f55ef7b3700 1 --2- 172.21.15.156:0/2087185278 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55e81309f0 0x7f55e813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.738+0000 7f55ef7b3700 1 --2- 172.21.15.156:0/2087185278 >> v2:172.21.15.156:3300/0 conn(0x7f55e8133ad0 0x7f55e8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.738+0000 7f55ef7b3700 1 --2- 172.21.15.156:0/2087185278 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55e81300a0 0x7f55e81304b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.738+0000 7f55ef7b3700 1 -- 172.21.15.156:0/2087185278 >> 172.21.15.156:0/2087185278 conn(0x7f55e8099c40 msgr2=0x7f55e80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:20.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.738+0000 7f55ef7b3700 1 -- 172.21.15.156:0/2087185278 shutdown_connections 2023-09-30T22:21:20.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.738+0000 7f55ef7b3700 1 -- 172.21.15.156:0/2087185278 wait complete. 2023-09-30T22:21:20.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.740+0000 7f55ef7b3700 1 Processor -- start 2023-09-30T22:21:20.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.740+0000 7f55ef7b3700 1 -- start start 2023-09-30T22:21:20.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.740+0000 7f55ef7b3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55e81300a0 0x7f55e811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:20.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.740+0000 7f55ef7b3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55e81309f0 0x7f55e811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:20.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.740+0000 7f55ef7b3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55e8133ad0 0x7f55e811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:20.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.740+0000 7f55ef7b3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e8120a30 con 0x7f55e81309f0 2023-09-30T22:21:20.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.740+0000 7f55ef7b3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e811f010 con 0x7f55e8133ad0 2023-09-30T22:21:20.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.740+0000 7f55ef7b3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55e8120050 con 0x7f55e81300a0 2023-09-30T22:21:20.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.740+0000 7f55ed54f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55e81300a0 0x7f55e811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:20.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.740+0000 7f55ecd4e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55e81309f0 0x7f55e811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:20.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.740+0000 7f55ed54f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55e81300a0 0x7f55e811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51140/0 (socket says 172.21.15.156:51140) 2023-09-30T22:21:20.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.740+0000 7f55ecd4e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55e81309f0 0x7f55e811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59618/0 (socket says 172.21.15.156:59618) 2023-09-30T22:21:20.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.740+0000 7f55ed54f700 1 -- 172.21.15.156:0/1997778418 learned_addr learned my addr 172.21.15.156:0/1997778418 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:20.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.740+0000 7f55edd50700 1 --2- 172.21.15.156:0/1997778418 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55e8133ad0 0x7f55e811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:20.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.741+0000 7f55edd50700 1 -- 172.21.15.156:0/1997778418 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55e81300a0 msgr2=0x7f55e811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:20.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.741+0000 7f55edd50700 1 --2- 172.21.15.156:0/1997778418 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55e81300a0 0x7f55e811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.741+0000 7f55edd50700 1 -- 172.21.15.156:0/1997778418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55e81309f0 msgr2=0x7f55e811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:20.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.741+0000 7f55edd50700 1 --2- 172.21.15.156:0/1997778418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55e81309f0 0x7f55e811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.741+0000 7f55edd50700 1 -- 172.21.15.156:0/1997778418 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e0009a70 con 0x7f55e8133ad0 2023-09-30T22:21:20.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.741+0000 7f55ed54f700 1 --2- 172.21.15.156:0/1997778418 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55e81300a0 0x7f55e811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:20.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.741+0000 7f55edd50700 1 --2- 172.21.15.156:0/1997778418 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55e8133ad0 0x7f55e811e4c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f55e000efc0 tx=0x7f55e000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:20.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.741+0000 7f55ddffb700 1 -- 172.21.15.156:0/1997778418 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e000ca90 con 0x7f55e8133ad0 2023-09-30T22:21:20.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.741+0000 7f55ddffb700 1 -- 172.21.15.156:0/1997778418 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e000f040 con 0x7f55e8133ad0 2023-09-30T22:21:20.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.741+0000 7f55ef7b3700 1 -- 172.21.15.156:0/1997778418 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d80094a0 con 0x7f55e8133ad0 2023-09-30T22:21:20.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.741+0000 7f55ddffb700 1 -- 172.21.15.156:0/1997778418 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e000ce30 con 0x7f55e8133ad0 2023-09-30T22:21:20.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.741+0000 7f55ef7b3700 1 -- 172.21.15.156:0/1997778418 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55e4009550 con 0x7f55e8133ad0 2023-09-30T22:21:20.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.742+0000 7f55ddffb700 1 -- 172.21.15.156:0/1997778418 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f55e0014480 con 0x7f55e8133ad0 2023-09-30T22:21:20.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.742+0000 7f55ddffb700 1 -- 172.21.15.156:0/1997778418 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f55e003fd30 con 0x7f55e8133ad0 2023-09-30T22:21:20.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.742+0000 7f55ef7b3700 1 -- 172.21.15.156:0/1997778418 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55e812dd00 con 0x7f55e8133ad0 2023-09-30T22:21:20.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.747+0000 7f55ddffb700 1 -- 172.21.15.156:0/1997778418 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f55e0012930 con 0x7f55e8133ad0 2023-09-30T22:21:20.790 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:20.791 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:20.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.920+0000 7f04fdf8d700 1 Processor -- start 2023-09-30T22:21:20.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.920+0000 7f04fdf8d700 1 -- start start 2023-09-30T22:21:20.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.920+0000 7f4cee484700 1 Processor -- start 2023-09-30T22:21:20.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.920+0000 7f4cee484700 1 -- start start 2023-09-30T22:21:20.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f04fdf8d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04f809a150 0x7f04f809e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:20.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f04fdf8d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f04f809edb0 0x7f04f809f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:20.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f04fdf8d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04f8133c20 0x7f04f81340a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:20.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f04fdf8d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f809a520 con 0x7f04f809edb0 2023-09-30T22:21:20.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f04fdf8d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f809fe00 con 0x7f04f809a150 2023-09-30T22:21:20.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f04fdf8d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04f806bec0 con 0x7f04f8133c20 2023-09-30T22:21:20.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f4cee484700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ce809d860 0x7f4ce809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:20.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f4cee484700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4ce809e170 0x7f4ce81307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:20.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f4cee484700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ce8130ce0 0x7f4ce8131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:20.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f4cee484700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce809aaa0 con 0x7f4ce809e170 2023-09-30T22:21:20.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f4cee484700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce809f870 con 0x7f4ce809d860 2023-09-30T22:21:20.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f4cee484700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce809b360 con 0x7f4ce8130ce0 2023-09-30T22:21:20.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f04f77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04f809a150 0x7f04f809e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:20.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f04f6ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f04f809edb0 0x7f04f809f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:20.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f04f77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04f809a150 0x7f04f809e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52222/0 (socket says 172.21.15.156:52222) 2023-09-30T22:21:20.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f04f77fe700 1 -- 172.21.15.156:0/1319128670 learned_addr learned my addr 172.21.15.156:0/1319128670 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:20.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f04f7fff700 1 --2- 172.21.15.156:0/1319128670 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04f8133c20 0x7f04f81340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:20.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f04f6ffd700 1 -- 172.21.15.156:0/1319128670 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04f8133c20 msgr2=0x7f04f81340a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:20.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f04f6ffd700 1 --2- 172.21.15.156:0/1319128670 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04f8133c20 0x7f04f81340a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f04f6ffd700 1 -- 172.21.15.156:0/1319128670 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04f809a150 msgr2=0x7f04f809e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:20.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f04f6ffd700 1 --2- 172.21.15.156:0/1319128670 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04f809a150 0x7f04f809e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f04f6ffd700 1 -- 172.21.15.156:0/1319128670 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f809af80 con 0x7f04f809edb0 2023-09-30T22:21:20.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f4ceca21700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ce8130ce0 0x7f4ce8131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:20.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f4ceca21700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ce8130ce0 0x7f4ce8131180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51158/0 (socket says 172.21.15.156:51158) 2023-09-30T22:21:20.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f4ceca21700 1 -- 172.21.15.156:0/2465469451 learned_addr learned my addr 172.21.15.156:0/2465469451 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:20.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f4ce77fe700 1 --2- 172.21.15.156:0/2465469451 >> v2:172.21.15.156:3300/0 conn(0x7f4ce809e170 0x7f4ce81307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:20.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f4ce7fff700 1 --2- 172.21.15.156:0/2465469451 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ce809d860 0x7f4ce809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:20.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f4ce77fe700 1 -- 172.21.15.156:0/2465469451 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ce8130ce0 msgr2=0x7f4ce8131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:20.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f4ce77fe700 1 --2- 172.21.15.156:0/2465469451 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ce8130ce0 0x7f4ce8131180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f4ce77fe700 1 -- 172.21.15.156:0/2465469451 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ce809d860 msgr2=0x7f4ce809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:20.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.921+0000 7f4ce77fe700 1 --2- 172.21.15.156:0/2465469451 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ce809d860 0x7f4ce809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.922+0000 7f4ce77fe700 1 -- 172.21.15.156:0/2465469451 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce809b620 con 0x7f4ce809e170 2023-09-30T22:21:20.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.922+0000 7f04f6ffd700 1 --2- 172.21.15.156:0/1319128670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04f809edb0 0x7f04f809f1a0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f04ec009870 tx=0x7f04ec009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c45fd39dcd96a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:20.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.922+0000 7f4ce77fe700 1 --2- 172.21.15.156:0/2465469451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ce809e170 0x7f4ce81307a0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc009840 tx=0x7f4cdc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43adc4557be54b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:20.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.922+0000 7f4ce6ffd700 1 -- 172.21.15.156:0/2465469451 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc011830 con 0x7f4ce809e170 2023-09-30T22:21:20.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.922+0000 7f4ce6ffd700 1 -- 172.21.15.156:0/2465469451 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cdc011990 con 0x7f4ce809e170 2023-09-30T22:21:20.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.922+0000 7f4ce6ffd700 1 -- 172.21.15.156:0/2465469451 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc011d20 con 0x7f4ce809e170 2023-09-30T22:21:20.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.922+0000 7f04f67fc700 1 -- 172.21.15.156:0/1319128670 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec011830 con 0x7f04f809edb0 2023-09-30T22:21:20.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.922+0000 7f04f67fc700 1 -- 172.21.15.156:0/1319128670 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04ec011990 con 0x7f04f809edb0 2023-09-30T22:21:20.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.922+0000 7f04f67fc700 1 -- 172.21.15.156:0/1319128670 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec011d20 con 0x7f04f809edb0 2023-09-30T22:21:20.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.923+0000 7f4cee484700 1 -- 172.21.15.156:0/2465469451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ce809e170 msgr2=0x7f4ce81307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:20.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.923+0000 7f4cee484700 1 --2- 172.21.15.156:0/2465469451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ce809e170 0x7f4ce81307a0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc009840 tx=0x7f4cdc009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:20.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.923+0000 7f4cee484700 1 -- 172.21.15.156:0/2465469451 shutdown_connections 2023-09-30T22:21:20.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.923+0000 7f4cee484700 1 --2- 172.21.15.156:0/2465469451 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ce8130ce0 0x7f4ce8131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.923+0000 7f4cee484700 1 --2- 172.21.15.156:0/2465469451 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ce809d860 0x7f4ce809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.923+0000 7f4cee484700 1 --2- 172.21.15.156:0/2465469451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ce809e170 0x7f4ce81307a0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.923+0000 7f4cee484700 1 -- 172.21.15.156:0/2465469451 >> 172.21.15.156:0/2465469451 conn(0x7f4ce8099c40 msgr2=0x7f4ce80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:20.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.923+0000 7f4cee484700 1 -- 172.21.15.156:0/2465469451 shutdown_connections 2023-09-30T22:21:20.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.923+0000 7f04fdf8d700 1 -- 172.21.15.156:0/1319128670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04f809edb0 msgr2=0x7f04f809f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:20.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.923+0000 7f04fdf8d700 1 --2- 172.21.15.156:0/1319128670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04f809edb0 0x7f04f809f1a0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f04ec009870 tx=0x7f04ec009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:20.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.923+0000 7f4cee484700 1 -- 172.21.15.156:0/2465469451 wait complete. 2023-09-30T22:21:20.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.923+0000 7f04fdf8d700 1 -- 172.21.15.156:0/1319128670 shutdown_connections 2023-09-30T22:21:20.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.923+0000 7f04fdf8d700 1 --2- 172.21.15.156:0/1319128670 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04f8133c20 0x7f04f81340a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.923+0000 7f04fdf8d700 1 --2- 172.21.15.156:0/1319128670 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04f809a150 0x7f04f809e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.923+0000 7f04fdf8d700 1 --2- 172.21.15.156:0/1319128670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04f809edb0 0x7f04f809f1a0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.923+0000 7f04fdf8d700 1 -- 172.21.15.156:0/1319128670 >> 172.21.15.156:0/1319128670 conn(0x7f04f80a4430 msgr2=0x7f04f80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:20.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.924+0000 7f04fdf8d700 1 -- 172.21.15.156:0/1319128670 shutdown_connections 2023-09-30T22:21:20.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.924+0000 7f04fdf8d700 1 -- 172.21.15.156:0/1319128670 wait complete. 2023-09-30T22:21:20.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.924+0000 7f4cee484700 1 Processor -- start 2023-09-30T22:21:20.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.924+0000 7f4cee484700 1 -- start start 2023-09-30T22:21:20.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.924+0000 7f4cee484700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ce809d860 0x7f4ce81cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:20.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.924+0000 7f4cee484700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ce809e170 0x7f4ce81ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:20.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.924+0000 7f4cee484700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ce8130ce0 0x7f4ce81cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:20.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.924+0000 7f4cee484700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce812bf20 con 0x7f4ce809e170 2023-09-30T22:21:20.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.924+0000 7f4cee484700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce812d3b0 con 0x7f4ce8130ce0 2023-09-30T22:21:20.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.924+0000 7f4cee484700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce81cd4c0 con 0x7f4ce809d860 2023-09-30T22:21:20.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.924+0000 7f4ce7fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ce809d860 0x7f4ce81cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:20.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.924+0000 7f4ce7fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ce809d860 0x7f4ce81cca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51174/0 (socket says 172.21.15.156:51174) 2023-09-30T22:21:20.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.924+0000 7f4ce7fff700 1 -- 172.21.15.156:0/1182805761 learned_addr learned my addr 172.21.15.156:0/1182805761 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:20.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.924+0000 7f4ce77fe700 1 --2- 172.21.15.156:0/1182805761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ce809e170 0x7f4ce81ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:20.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.924+0000 7f4ceca21700 1 --2- 172.21.15.156:0/1182805761 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ce8130ce0 0x7f4ce81cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:20.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.925+0000 7f4ce7fff700 1 -- 172.21.15.156:0/1182805761 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ce8130ce0 msgr2=0x7f4ce81cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:20.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.925+0000 7f04fdf8d700 1 Processor -- start 2023-09-30T22:21:20.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.925+0000 7f4ce7fff700 1 --2- 172.21.15.156:0/1182805761 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ce8130ce0 0x7f4ce81cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.925+0000 7f4ce7fff700 1 -- 172.21.15.156:0/1182805761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ce809e170 msgr2=0x7f4ce81ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:20.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.925+0000 7f4ce7fff700 1 --2- 172.21.15.156:0/1182805761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ce809e170 0x7f4ce81ccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.925+0000 7f4ce7fff700 1 -- 172.21.15.156:0/1182805761 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cdc0094a0 con 0x7f4ce809d860 2023-09-30T22:21:20.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.925+0000 7f4ce77fe700 1 --2- 172.21.15.156:0/1182805761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ce809e170 0x7f4ce81ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:20.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.925+0000 7f04fdf8d700 1 -- start start 2023-09-30T22:21:20.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.925+0000 7f4ce7fff700 1 --2- 172.21.15.156:0/1182805761 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ce809d860 0x7f4ce81cca40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4cd800e870 tx=0x7f4cd800eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:20.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.925+0000 7f4ce4ff9700 1 -- 172.21.15.156:0/1182805761 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8013680 con 0x7f4ce809d860 2023-09-30T22:21:20.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.925+0000 7f4ce4ff9700 1 -- 172.21.15.156:0/1182805761 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd80137e0 con 0x7f4ce809d860 2023-09-30T22:21:20.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.925+0000 7f4cee484700 1 -- 172.21.15.156:0/1182805761 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce812d600 con 0x7f4ce809d860 2023-09-30T22:21:20.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.925+0000 7f4ce4ff9700 1 -- 172.21.15.156:0/1182805761 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8013b90 con 0x7f4ce809d860 2023-09-30T22:21:20.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.925+0000 7f4cee484700 1 -- 172.21.15.156:0/1182805761 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce81cc5b0 con 0x7f4ce809d860 2023-09-30T22:21:20.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.926+0000 7f04fdf8d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04f809a150 0x7f04f8123760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:20.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.926+0000 7f04fdf8d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04f809edb0 0x7f04f8123ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:20.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.926+0000 7f04fdf8d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04f8133c20 0x7f04f81c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:20.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.926+0000 7f04fdf8d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f81266a0 con 0x7f04f809a150 2023-09-30T22:21:20.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.926+0000 7f04fdf8d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f8126880 con 0x7f04f8133c20 2023-09-30T22:21:20.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.926+0000 7f04fdf8d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04f81232c0 con 0x7f04f809edb0 2023-09-30T22:21:20.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.926+0000 7f04f77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04f809a150 0x7f04f8123760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:20.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.926+0000 7f04f77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04f809a150 0x7f04f8123760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59668/0 (socket says 172.21.15.156:59668) 2023-09-30T22:21:20.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.926+0000 7f04f77fe700 1 -- 172.21.15.156:0/2578795047 learned_addr learned my addr 172.21.15.156:0/2578795047 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:20.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.926+0000 7f04f6ffd700 1 --2- 172.21.15.156:0/2578795047 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04f809edb0 0x7f04f8123ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:20.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.926+0000 7f04f7fff700 1 --2- 172.21.15.156:0/2578795047 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04f8133c20 0x7f04f81c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:20.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.926+0000 7f04f77fe700 1 -- 172.21.15.156:0/2578795047 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04f809edb0 msgr2=0x7f04f8123ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:20.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.926+0000 7f04f77fe700 1 --2- 172.21.15.156:0/2578795047 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04f809edb0 0x7f04f8123ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.926+0000 7f04f77fe700 1 -- 172.21.15.156:0/2578795047 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04f8133c20 msgr2=0x7f04f81c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:20.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.926+0000 7f04f77fe700 1 --2- 172.21.15.156:0/2578795047 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04f8133c20 0x7f04f81c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.926+0000 7f04f77fe700 1 -- 172.21.15.156:0/2578795047 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ec0094a0 con 0x7f04f809a150 2023-09-30T22:21:20.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.926+0000 7f04f77fe700 1 --2- 172.21.15.156:0/2578795047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04f809a150 0x7f04f8123760 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f04e800e8e0 tx=0x7f04e800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:20.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.926+0000 7f04dffff700 1 -- 172.21.15.156:0/2578795047 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e8009600 con 0x7f04f809a150 2023-09-30T22:21:20.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.926+0000 7f04dffff700 1 -- 172.21.15.156:0/2578795047 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e8013680 con 0x7f04f809a150 2023-09-30T22:21:20.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.926+0000 7f04dffff700 1 -- 172.21.15.156:0/2578795047 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e8013a30 con 0x7f04f809a150 2023-09-30T22:21:20.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.926+0000 7f04fdf8d700 1 -- 172.21.15.156:0/2578795047 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f8124f20 con 0x7f04f809a150 2023-09-30T22:21:20.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.927+0000 7f4ce4ff9700 1 -- 172.21.15.156:0/1182805761 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4cd8013cf0 con 0x7f4ce809d860 2023-09-30T22:21:20.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.927+0000 7f4ce4ff9700 1 -- 172.21.15.156:0/1182805761 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4cd803f550 con 0x7f4ce809d860 2023-09-30T22:21:20.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.927+0000 7f4cee484700 1 -- 172.21.15.156:0/1182805761 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ce804f2a0 con 0x7f4ce809d860 2023-09-30T22:21:20.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.927+0000 7f04fdf8d700 1 -- 172.21.15.156:0/2578795047 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f80a14e0 con 0x7f04f809a150 2023-09-30T22:21:20.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.927+0000 7f04dffff700 1 -- 172.21.15.156:0/2578795047 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f04e8013b90 con 0x7f04f809a150 2023-09-30T22:21:20.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.928+0000 7f04dffff700 1 -- 172.21.15.156:0/2578795047 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f04e803fa50 con 0x7f04f809a150 2023-09-30T22:21:20.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.928+0000 7f04fdf8d700 1 -- 172.21.15.156:0/2578795047 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f809fa30 con 0x7f04f809a150 2023-09-30T22:21:20.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.936+0000 7f4ce4ff9700 1 -- 172.21.15.156:0/1182805761 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4cd8017080 con 0x7f4ce809d860 2023-09-30T22:21:20.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.936+0000 7f04dffff700 1 -- 172.21.15.156:0/2578795047 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f04e8021020 con 0x7f04f809a150 2023-09-30T22:21:20.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.951+0000 7f55ef7b3700 1 -- 172.21.15.156:0/1997778418 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f55e804f2a0 con 0x7f55e8133ad0 2023-09-30T22:21:20.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.951+0000 7f55ddffb700 1 -- 172.21.15.156:0/1997778418 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f55e0012340 con 0x7f55e8133ad0 2023-09-30T22:21:20.952 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:20.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.953+0000 7f55ef7b3700 1 -- 172.21.15.156:0/1997778418 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55e8133ad0 msgr2=0x7f55e811e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:20.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.953+0000 7f55ef7b3700 1 --2- 172.21.15.156:0/1997778418 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55e8133ad0 0x7f55e811e4c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f55e000efc0 tx=0x7f55e000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.954+0000 7f55ef7b3700 1 -- 172.21.15.156:0/1997778418 shutdown_connections 2023-09-30T22:21:20.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.954+0000 7f55ef7b3700 1 --2- 172.21.15.156:0/1997778418 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55e8133ad0 0x7f55e811e4c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.954+0000 7f55ef7b3700 1 --2- 172.21.15.156:0/1997778418 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55e81300a0 0x7f55e811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.954+0000 7f55ef7b3700 1 --2- 172.21.15.156:0/1997778418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55e81309f0 0x7f55e811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:20.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.954+0000 7f55ef7b3700 1 -- 172.21.15.156:0/1997778418 >> 172.21.15.156:0/1997778418 conn(0x7f55e8099c40 msgr2=0x7f55e8131ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:20.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.954+0000 7f55ef7b3700 1 -- 172.21.15.156:0/1997778418 shutdown_connections 2023-09-30T22:21:20.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:20.954+0000 7f55ef7b3700 1 -- 172.21.15.156:0/1997778418 wait complete. 2023-09-30T22:21:20.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:21.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.129+0000 7f04fdf8d700 1 -- 172.21.15.156:0/2578795047 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f04f8126500 con 0x7f04f809a150 2023-09-30T22:21:21.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.130+0000 7f04dffff700 1 -- 172.21.15.156:0/2578795047 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f04f8126500 con 0x7f04f809a150 2023-09-30T22:21:21.131 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:21.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.131+0000 7f4cee484700 1 -- 172.21.15.156:0/1182805761 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4ce806c3b0 con 0x7f4ce809d860 2023-09-30T22:21:21.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.131+0000 7f4ce4ff9700 1 -- 172.21.15.156:0/1182805761 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4cd801be10 con 0x7f4ce809d860 2023-09-30T22:21:21.132 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:21.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.132+0000 7f04fdf8d700 1 -- 172.21.15.156:0/2578795047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04f809a150 msgr2=0x7f04f8123760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:21.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.132+0000 7f04fdf8d700 1 --2- 172.21.15.156:0/2578795047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04f809a150 0x7f04f8123760 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f04e800e8e0 tx=0x7f04e800ebf0 comp rx=0 tx=0).stop 2023-09-30T22:21:21.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.132+0000 7f04fdf8d700 1 -- 172.21.15.156:0/2578795047 shutdown_connections 2023-09-30T22:21:21.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.132+0000 7f04fdf8d700 1 --2- 172.21.15.156:0/2578795047 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04f8133c20 0x7f04f81c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:21.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.132+0000 7f04fdf8d700 1 --2- 172.21.15.156:0/2578795047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04f809a150 0x7f04f8123760 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:21.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.132+0000 7f04fdf8d700 1 --2- 172.21.15.156:0/2578795047 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f04f809edb0 0x7f04f8123ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:21.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.132+0000 7f04fdf8d700 1 -- 172.21.15.156:0/2578795047 >> 172.21.15.156:0/2578795047 conn(0x7f04f80a4430 msgr2=0x7f04f8071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:21.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.132+0000 7f04fdf8d700 1 -- 172.21.15.156:0/2578795047 shutdown_connections 2023-09-30T22:21:21.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.132+0000 7f04fdf8d700 1 -- 172.21.15.156:0/2578795047 wait complete. 2023-09-30T22:21:21.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.133+0000 7f4cee484700 1 -- 172.21.15.156:0/1182805761 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ce809d860 msgr2=0x7f4ce81cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:21.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.133+0000 7f4cee484700 1 --2- 172.21.15.156:0/1182805761 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ce809d860 0x7f4ce81cca40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4cd800e870 tx=0x7f4cd800eb80 comp rx=0 tx=0).stop 2023-09-30T22:21:21.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.133+0000 7f4cee484700 1 -- 172.21.15.156:0/1182805761 shutdown_connections 2023-09-30T22:21:21.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.133+0000 7f4cee484700 1 --2- 172.21.15.156:0/1182805761 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ce8130ce0 0x7f4ce81cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:21.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.133+0000 7f4cee484700 1 --2- 172.21.15.156:0/1182805761 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ce809d860 0x7f4ce81cca40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:21.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.133+0000 7f4cee484700 1 --2- 172.21.15.156:0/1182805761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ce809e170 0x7f4ce81ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:21.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.133+0000 7f4cee484700 1 -- 172.21.15.156:0/1182805761 >> 172.21.15.156:0/1182805761 conn(0x7f4ce8099c40 msgr2=0x7f4ce81257d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:21.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.133+0000 7f4cee484700 1 -- 172.21.15.156:0/1182805761 shutdown_connections 2023-09-30T22:21:21.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.133+0000 7f4cee484700 1 -- 172.21.15.156:0/1182805761 wait complete. 2023-09-30T22:21:21.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:21.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:21.548 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:21.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.672+0000 7f3cb4bdf700 1 Processor -- start 2023-09-30T22:21:21.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.672+0000 7f3cb4bdf700 1 -- start start 2023-09-30T22:21:21.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.672+0000 7f3cb4bdf700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3cb009d860 0x7f3cb009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:21.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.672+0000 7f3cb4bdf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3cb009e170 0x7f3cb01307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:21.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.672+0000 7f3cb4bdf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cb0130ce0 0x7f3cb0131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:21.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.672+0000 7f3cb4bdf700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cb0131670 con 0x7f3cb009d860 2023-09-30T22:21:21.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.672+0000 7f3cb4bdf700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb009aaa0 con 0x7f3cb0130ce0 2023-09-30T22:21:21.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.672+0000 7f3cb4bdf700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb009f870 con 0x7f3cb009e170 2023-09-30T22:21:21.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.673+0000 7f3cae59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3cb009d860 0x7f3cb009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:21.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.673+0000 7f3caed9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cb0130ce0 0x7f3cb0131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:21.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.673+0000 7f3cadd9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3cb009e170 0x7f3cb01307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:21.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.673+0000 7f3caed9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cb0130ce0 0x7f3cb0131130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38540/0 (socket says 172.21.15.156:38540) 2023-09-30T22:21:21.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.673+0000 7f3cae59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3cb009d860 0x7f3cb009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48716/0 (socket says 172.21.15.156:48716) 2023-09-30T22:21:21.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.673+0000 7f3caed9d700 1 -- 172.21.15.156:0/1920479560 learned_addr learned my addr 172.21.15.156:0/1920479560 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:21.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.673+0000 7f3cadd9b700 1 -- 172.21.15.156:0/1920479560 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cb0130ce0 msgr2=0x7f3cb0131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:21.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.673+0000 7f3cadd9b700 1 --2- 172.21.15.156:0/1920479560 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cb0130ce0 0x7f3cb0131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:21.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.673+0000 7f3cadd9b700 1 -- 172.21.15.156:0/1920479560 >> v2:172.21.15.156:3300/0 conn(0x7f3cb009d860 msgr2=0x7f3cb009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:21.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.673+0000 7f3cadd9b700 1 --2- 172.21.15.156:0/1920479560 >> v2:172.21.15.156:3300/0 conn(0x7f3cb009d860 0x7f3cb009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:21.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.673+0000 7f3cadd9b700 1 -- 172.21.15.156:0/1920479560 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb009b360 con 0x7f3cb009e170 2023-09-30T22:21:21.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.673+0000 7f3caed9d700 1 --2- 172.21.15.156:0/1920479560 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cb0130ce0 0x7f3cb0131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:21.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.673+0000 7f3cae59c700 1 --2- 172.21.15.156:0/1920479560 >> v2:172.21.15.156:3300/0 conn(0x7f3cb009d860 0x7f3cb009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:21.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.673+0000 7f3cadd9b700 1 --2- 172.21.15.156:0/1920479560 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3cb009e170 0x7f3cb01307a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4009870 tx=0x7f3ca4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b17991c702bfbbc2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:21.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.673+0000 7f3cad59a700 1 -- 172.21.15.156:0/1920479560 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4011830 con 0x7f3cb009e170 2023-09-30T22:21:21.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.673+0000 7f3cad59a700 1 -- 172.21.15.156:0/1920479560 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca4011990 con 0x7f3cb009e170 2023-09-30T22:21:21.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.673+0000 7f3cad59a700 1 -- 172.21.15.156:0/1920479560 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4011d20 con 0x7f3cb009e170 2023-09-30T22:21:21.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.674+0000 7f3cb4bdf700 1 -- 172.21.15.156:0/1920479560 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3cb009e170 msgr2=0x7f3cb01307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:21.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.674+0000 7f3cb4bdf700 1 --2- 172.21.15.156:0/1920479560 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3cb009e170 0x7f3cb01307a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4009870 tx=0x7f3ca4009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:21.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.674+0000 7f3cb4bdf700 1 -- 172.21.15.156:0/1920479560 shutdown_connections 2023-09-30T22:21:21.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.674+0000 7f3cb4bdf700 1 --2- 172.21.15.156:0/1920479560 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cb0130ce0 0x7f3cb0131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:21.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.674+0000 7f3cb4bdf700 1 --2- 172.21.15.156:0/1920479560 >> v2:172.21.15.156:3300/0 conn(0x7f3cb009d860 0x7f3cb009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:21.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.674+0000 7f3cb4bdf700 1 --2- 172.21.15.156:0/1920479560 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3cb009e170 0x7f3cb01307a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:21.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.674+0000 7f3cb4bdf700 1 -- 172.21.15.156:0/1920479560 >> 172.21.15.156:0/1920479560 conn(0x7f3cb0099c40 msgr2=0x7f3cb00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:21.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.674+0000 7f3cb4bdf700 1 -- 172.21.15.156:0/1920479560 shutdown_connections 2023-09-30T22:21:21.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.674+0000 7f3cb4bdf700 1 -- 172.21.15.156:0/1920479560 wait complete. 2023-09-30T22:21:21.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.675+0000 7f3cb4bdf700 1 Processor -- start 2023-09-30T22:21:21.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.675+0000 7f3cb4bdf700 1 -- start start 2023-09-30T22:21:21.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.675+0000 7f3cb4bdf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3cb009d860 0x7f3cb01c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:21.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.675+0000 7f3cb4bdf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cb009e170 0x7f3cb01c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:21.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.675+0000 7f3cb4bdf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3cb0130ce0 0x7f3cb0119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:21.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.675+0000 7f3cb4bdf700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb00a21b0 con 0x7f3cb0130ce0 2023-09-30T22:21:21.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.675+0000 7f3cb4bdf700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb0130af0 con 0x7f3cb009e170 2023-09-30T22:21:21.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.675+0000 7f3cb4bdf700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb011bdb0 con 0x7f3cb009d860 2023-09-30T22:21:21.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.675+0000 7f3cae59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3cb009d860 0x7f3cb01c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:21.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.675+0000 7f3cae59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3cb009d860 0x7f3cb01c6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:59914/0 (socket says 172.21.15.156:59914) 2023-09-30T22:21:21.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.675+0000 7f3cae59c700 1 -- 172.21.15.156:0/363233359 learned_addr learned my addr 172.21.15.156:0/363233359 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:21.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.675+0000 7f3caed9d700 1 --2- 172.21.15.156:0/363233359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3cb0130ce0 0x7f3cb0119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:21.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.675+0000 7f3cadd9b700 1 --2- 172.21.15.156:0/363233359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cb009e170 0x7f3cb01c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:21.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.676+0000 7f3caed9d700 1 -- 172.21.15.156:0/363233359 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3cb009d860 msgr2=0x7f3cb01c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:21.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.676+0000 7f3caed9d700 1 --2- 172.21.15.156:0/363233359 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3cb009d860 0x7f3cb01c6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:21.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.676+0000 7f3caed9d700 1 -- 172.21.15.156:0/363233359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cb009e170 msgr2=0x7f3cb01c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:21.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.676+0000 7f3caed9d700 1 --2- 172.21.15.156:0/363233359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cb009e170 0x7f3cb01c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:21.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.676+0000 7f3caed9d700 1 -- 172.21.15.156:0/363233359 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca00094a0 con 0x7f3cb0130ce0 2023-09-30T22:21:21.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.676+0000 7f3cae59c700 1 --2- 172.21.15.156:0/363233359 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3cb009d860 0x7f3cb01c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:21.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.676+0000 7f3caed9d700 1 --2- 172.21.15.156:0/363233359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3cb0130ce0 0x7f3cb0119630 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8009e50 tx=0x7f3ca800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:21.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.676+0000 7f3c9effd700 1 -- 172.21.15.156:0/363233359 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8018070 con 0x7f3cb0130ce0 2023-09-30T22:21:21.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.676+0000 7f3c9effd700 1 -- 172.21.15.156:0/363233359 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca800f040 con 0x7f3cb0130ce0 2023-09-30T22:21:21.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.676+0000 7f3cb4bdf700 1 -- 172.21.15.156:0/363233359 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca8009b30 con 0x7f3cb0130ce0 2023-09-30T22:21:21.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.676+0000 7f3c9effd700 1 -- 172.21.15.156:0/363233359 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8003c40 con 0x7f3cb0130ce0 2023-09-30T22:21:21.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.676+0000 7f3cb4bdf700 1 -- 172.21.15.156:0/363233359 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca40094a0 con 0x7f3cb0130ce0 2023-09-30T22:21:21.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.677+0000 7f3c9effd700 1 -- 172.21.15.156:0/363233359 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ca800c880 con 0x7f3cb0130ce0 2023-09-30T22:21:21.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.677+0000 7f3c9effd700 1 -- 172.21.15.156:0/363233359 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3ca803f710 con 0x7f3cb0130ce0 2023-09-30T22:21:21.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.677+0000 7f3cb4bdf700 1 -- 172.21.15.156:0/363233359 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb011b830 con 0x7f3cb0130ce0 2023-09-30T22:21:21.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.682+0000 7f3c9effd700 1 -- 172.21.15.156:0/363233359 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3cb011b830 con 0x7f3cb0130ce0 2023-09-30T22:21:21.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.864+0000 7f3cb4bdf700 1 -- 172.21.15.156:0/363233359 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3cb011b830 con 0x7f3cb0130ce0 2023-09-30T22:21:21.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.865+0000 7f3c9effd700 1 -- 172.21.15.156:0/363233359 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3cb011b830 con 0x7f3cb0130ce0 2023-09-30T22:21:21.865 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:21.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.867+0000 7f3cb4bdf700 1 -- 172.21.15.156:0/363233359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3cb0130ce0 msgr2=0x7f3cb0119630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:21.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.867+0000 7f3cb4bdf700 1 --2- 172.21.15.156:0/363233359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3cb0130ce0 0x7f3cb0119630 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8009e50 tx=0x7f3ca800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:21:21.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.867+0000 7f3cb4bdf700 1 -- 172.21.15.156:0/363233359 shutdown_connections 2023-09-30T22:21:21.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.867+0000 7f3cb4bdf700 1 --2- 172.21.15.156:0/363233359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3cb0130ce0 0x7f3cb0119630 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:21.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.867+0000 7f3cb4bdf700 1 --2- 172.21.15.156:0/363233359 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3cb009d860 0x7f3cb01c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:21.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.867+0000 7f3cb4bdf700 1 --2- 172.21.15.156:0/363233359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3cb009e170 0x7f3cb01c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:21.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.867+0000 7f3cb4bdf700 1 -- 172.21.15.156:0/363233359 >> 172.21.15.156:0/363233359 conn(0x7f3cb0099c40 msgr2=0x7f3cb0071280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:21.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.867+0000 7f3cb4bdf700 1 -- 172.21.15.156:0/363233359 shutdown_connections 2023-09-30T22:21:21.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:21.867+0000 7f3cb4bdf700 1 -- 172.21.15.156:0/363233359 wait complete. 2023-09-30T22:21:21.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:21.968 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:22.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.090+0000 7f28bef1e700 1 Processor -- start 2023-09-30T22:21:22.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.090+0000 7f28bef1e700 1 -- start start 2023-09-30T22:21:22.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.090+0000 7f28bef1e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f28b8133900 0x7f28b8133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:22.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.090+0000 7f28bef1e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f28b8134210 0x7f28b80a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:22.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.090+0000 7f28bef1e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b809a760 con 0x7f28b80a0ee0 2023-09-30T22:21:22.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.090+0000 7f28bef1e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b81336e0 con 0x7f28b8133900 2023-09-30T22:21:22.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.090+0000 7f28bef1e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28b809a080 con 0x7f28b8134210 2023-09-30T22:21:22.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.090+0000 7f28bccba700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f28b8133900 0x7f28b8133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:22.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.090+0000 7f28b7fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f28b8134210 0x7f28b80a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:22.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.090+0000 7f28bccba700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f28b8133900 0x7f28b8133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38564/0 (socket says 172.21.15.156:38564) 2023-09-30T22:21:22.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.090+0000 7f28bccba700 1 -- 172.21.15.156:0/923919551 learned_addr learned my addr 172.21.15.156:0/923919551 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:22.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.091+0000 7f28b77fe700 1 -- 172.21.15.156:0/923919551 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1596676708 0 0) 0x7f28b809a760 con 0x7f28b80a0ee0 2023-09-30T22:21:22.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.091+0000 7f28b77fe700 1 -- 172.21.15.156:0/923919551 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28a80035b0 con 0x7f28b80a0ee0 2023-09-30T22:21:22.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.091+0000 7f28b7fff700 1 -- 172.21.15.156:0/923919551 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f28b8133900 msgr2=0x7f28b8133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:22.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.091+0000 7f28b7fff700 1 --2- 172.21.15.156:0/923919551 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f28b8133900 0x7f28b8133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:22.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.091+0000 7f28b7fff700 1 -- 172.21.15.156:0/923919551 >> v1:172.21.15.156:6789/0 conn(0x7f28b80a0ee0 legacy=0x7f28b813a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:22.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.091+0000 7f28b7fff700 1 -- 172.21.15.156:0/923919551 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b80a23e0 con 0x7f28b8134210 2023-09-30T22:21:22.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.091+0000 7f28bccba700 1 --2- 172.21.15.156:0/923919551 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f28b8133900 0x7f28b8133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:22.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.091+0000 7f28b7fff700 1 --2- 172.21.15.156:0/923919551 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f28b8134210 0x7f28b80a09a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f28a4009870 tx=0x7f28a4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e559bd6737e0322a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:22.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.091+0000 7f28b77fe700 1 -- 172.21.15.156:0/923919551 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a4011830 con 0x7f28b8134210 2023-09-30T22:21:22.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.091+0000 7f28b77fe700 1 -- 172.21.15.156:0/923919551 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a4011990 con 0x7f28b8134210 2023-09-30T22:21:22.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.091+0000 7f28b77fe700 1 -- 172.21.15.156:0/923919551 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a4011d20 con 0x7f28b8134210 2023-09-30T22:21:22.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.092+0000 7f28bef1e700 1 -- 172.21.15.156:0/923919551 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f28b8134210 msgr2=0x7f28b80a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:22.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.092+0000 7f28bef1e700 1 --2- 172.21.15.156:0/923919551 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f28b8134210 0x7f28b80a09a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f28a4009870 tx=0x7f28a4009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:22.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.092+0000 7f28bef1e700 1 -- 172.21.15.156:0/923919551 shutdown_connections 2023-09-30T22:21:22.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.092+0000 7f28bef1e700 1 --2- 172.21.15.156:0/923919551 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f28b8133900 0x7f28b8133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:22.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.092+0000 7f28bef1e700 1 --2- 172.21.15.156:0/923919551 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f28b8134210 0x7f28b80a09a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:22.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.092+0000 7f28bef1e700 1 -- 172.21.15.156:0/923919551 >> 172.21.15.156:0/923919551 conn(0x7f28b80a2980 msgr2=0x7f28b80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:22.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.092+0000 7f28bef1e700 1 -- 172.21.15.156:0/923919551 shutdown_connections 2023-09-30T22:21:22.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.092+0000 7f28bef1e700 1 -- 172.21.15.156:0/923919551 wait complete. 2023-09-30T22:21:22.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.093+0000 7f28bef1e700 1 Processor -- start 2023-09-30T22:21:22.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.093+0000 7f28bef1e700 1 -- start start 2023-09-30T22:21:22.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.093+0000 7f28bef1e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f28b80a0ee0 0x7f28b811d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:22.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.093+0000 7f28bef1e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f28b8133900 0x7f28b811dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:22.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.093+0000 7f28bef1e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28b8134210 0x7f28b811e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:22.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.093+0000 7f28bef1e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b811ec20 con 0x7f28b8134210 2023-09-30T22:21:22.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.093+0000 7f28bef1e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b811f380 con 0x7f28b80a0ee0 2023-09-30T22:21:22.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.093+0000 7f28bef1e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28b81205d0 con 0x7f28b8133900 2023-09-30T22:21:22.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.093+0000 7f28bccba700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f28b80a0ee0 0x7f28b811d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:22.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.093+0000 7f28b7fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f28b8133900 0x7f28b811dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:22.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.093+0000 7f28bd4bb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28b8134210 0x7f28b811e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:22.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.093+0000 7f28b7fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f28b8133900 0x7f28b811dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:59928/0 (socket says 172.21.15.156:59928) 2023-09-30T22:21:22.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.093+0000 7f28bccba700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f28b80a0ee0 0x7f28b811d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38574/0 (socket says 172.21.15.156:38574) 2023-09-30T22:21:22.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.093+0000 7f28b7fff700 1 -- 172.21.15.156:0/3113184313 learned_addr learned my addr 172.21.15.156:0/3113184313 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:22.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.094+0000 7f28bd4bb700 1 -- 172.21.15.156:0/3113184313 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f28b8133900 msgr2=0x7f28b811dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:22.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.094+0000 7f28bd4bb700 1 --2- 172.21.15.156:0/3113184313 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f28b8133900 0x7f28b811dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:22.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.094+0000 7f28bd4bb700 1 -- 172.21.15.156:0/3113184313 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f28b80a0ee0 msgr2=0x7f28b811d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:22.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.094+0000 7f28bd4bb700 1 --2- 172.21.15.156:0/3113184313 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f28b80a0ee0 0x7f28b811d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:22.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.094+0000 7f28bd4bb700 1 -- 172.21.15.156:0/3113184313 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac009500 con 0x7f28b8134210 2023-09-30T22:21:22.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.094+0000 7f28b7fff700 1 --2- 172.21.15.156:0/3113184313 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f28b8133900 0x7f28b811dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:22.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.094+0000 7f28bd4bb700 1 --2- 172.21.15.156:0/3113184313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28b8134210 0x7f28b811e1f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f28b000cbf0 tx=0x7f28b000cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:22.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.094+0000 7f28b57fa700 1 -- 172.21.15.156:0/3113184313 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b0003c00 con 0x7f28b8134210 2023-09-30T22:21:22.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.094+0000 7f28b57fa700 1 -- 172.21.15.156:0/3113184313 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b0003d60 con 0x7f28b8134210 2023-09-30T22:21:22.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.094+0000 7f28bef1e700 1 -- 172.21.15.156:0/3113184313 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a40094a0 con 0x7f28b8134210 2023-09-30T22:21:22.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.094+0000 7f28b57fa700 1 -- 172.21.15.156:0/3113184313 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b000aa40 con 0x7f28b8134210 2023-09-30T22:21:22.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.094+0000 7f28bef1e700 1 -- 172.21.15.156:0/3113184313 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b8121010 con 0x7f28b8134210 2023-09-30T22:21:22.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.095+0000 7f28b57fa700 1 -- 172.21.15.156:0/3113184313 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f28b000aba0 con 0x7f28b8134210 2023-09-30T22:21:22.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.095+0000 7f28b57fa700 1 -- 172.21.15.156:0/3113184313 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f28b003f630 con 0x7f28b8134210 2023-09-30T22:21:22.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.095+0000 7f28bef1e700 1 -- 172.21.15.156:0/3113184313 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b8132c10 con 0x7f28b8134210 2023-09-30T22:21:22.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.100+0000 7f28b57fa700 1 -- 172.21.15.156:0/3113184313 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f28b00108d0 con 0x7f28b8134210 2023-09-30T22:21:22.147 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:22.147 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:22.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.279+0000 7fee05034700 1 Processor -- start 2023-09-30T22:21:22.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.279+0000 7fee05034700 1 -- start start 2023-09-30T22:21:22.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.280+0000 7fee05034700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee000a14c0 0x7fee00138cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:22.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.280+0000 7fee05034700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fee001391f0 0x7fee0013b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:22.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.280+0000 7fee05034700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee0009db90 con 0x7fee000a09e0 2023-09-30T22:21:22.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.280+0000 7fee05034700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee0009de10 con 0x7fee001391f0 2023-09-30T22:21:22.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.280+0000 7fee05034700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee000a2560 con 0x7fee000a14c0 2023-09-30T22:21:22.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.280+0000 7fedfe59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee000a14c0 0x7fee00138cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:22.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.280+0000 7fedfe59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee000a14c0 0x7fee00138cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38582/0 (socket says 172.21.15.156:38582) 2023-09-30T22:21:22.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.280+0000 7fedfe59c700 1 -- 172.21.15.156:0/2665195494 learned_addr learned my addr 172.21.15.156:0/2665195494 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:22.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.280+0000 7fedfed9d700 1 --1- 172.21.15.156:0/2665195494 >> v1:172.21.15.156:6789/0 conn(0x7fee000a09e0 0x7fee000a0db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:39894/0 (socket says 172.21.15.156:39894) 2023-09-30T22:21:22.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.280+0000 7fedff59e700 1 --2- 172.21.15.156:0/2665195494 >> v2:172.21.15.156:3300/0 conn(0x7fee001391f0 0x7fee0013b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:22.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.280+0000 7f16ff74d700 1 Processor -- start 2023-09-30T22:21:22.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.280+0000 7fedff59e700 1 -- 172.21.15.156:0/2665195494 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee000a14c0 msgr2=0x7fee00138cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:22.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.280+0000 7fedff59e700 1 --2- 172.21.15.156:0/2665195494 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee000a14c0 0x7fee00138cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:22.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.280+0000 7fedff59e700 1 -- 172.21.15.156:0/2665195494 >> v1:172.21.15.156:6789/0 conn(0x7fee000a09e0 legacy=0x7fee000a0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:22.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.280+0000 7fedfdd9b700 1 -- 172.21.15.156:0/2665195494 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 318057866 0 0) 0x7fee0009db90 con 0x7fee000a09e0 2023-09-30T22:21:22.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.280+0000 7fedff59e700 1 -- 172.21.15.156:0/2665195494 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee000a1f60 con 0x7fee001391f0 2023-09-30T22:21:22.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.280+0000 7fedfe59c700 1 --2- 172.21.15.156:0/2665195494 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee000a14c0 0x7fee00138cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:22.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.281+0000 7fedff59e700 1 --2- 172.21.15.156:0/2665195494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee001391f0 0x7fee0013b5d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fedf8009d90 tx=0x7fedf800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8648a80bff4609 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:22.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.281+0000 7f16ff74d700 1 -- start start 2023-09-30T22:21:22.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.281+0000 7fedfdd9b700 1 -- 172.21.15.156:0/2665195494 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf800e070 con 0x7fee001391f0 2023-09-30T22:21:22.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.281+0000 7fedfdd9b700 1 -- 172.21.15.156:0/2665195494 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf800bb20 con 0x7fee001391f0 2023-09-30T22:21:22.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.281+0000 7fedfdd9b700 1 -- 172.21.15.156:0/2665195494 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf8012430 con 0x7fee001391f0 2023-09-30T22:21:22.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.281+0000 7f16ff74d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16f809e870 0x7f16f809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:22.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.281+0000 7f16ff74d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f16f809f180 0x7f16f8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:22.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.281+0000 7f16ff74d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16f8131d70 0x7f16f8132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:22.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.281+0000 7f16ff74d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f80a0920 con 0x7f16f809f180 2023-09-30T22:21:22.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.281+0000 7f16ff74d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f809c970 con 0x7f16f809e870 2023-09-30T22:21:22.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.281+0000 7f16ff74d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16f809bab0 con 0x7f16f8131d70 2023-09-30T22:21:22.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.281+0000 7f16fcce8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f16f809f180 0x7f16f8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:22.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.281+0000 7f16fcce8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f16f809f180 0x7f16f8131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48752/0 (socket says 172.21.15.156:48752) 2023-09-30T22:21:22.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.281+0000 7f16fcce8700 1 -- 172.21.15.156:0/1768316280 learned_addr learned my addr 172.21.15.156:0/1768316280 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:22.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.281+0000 7f16fdcea700 1 --2- 172.21.15.156:0/1768316280 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16f8131d70 0x7f16f8132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:22.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.281+0000 7f16fd4e9700 1 --2- 172.21.15.156:0/1768316280 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16f809e870 0x7f16f809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:22.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.281+0000 7fee05034700 1 -- 172.21.15.156:0/2665195494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee001391f0 msgr2=0x7fee0013b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:22.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.281+0000 7fee05034700 1 --2- 172.21.15.156:0/2665195494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee001391f0 0x7fee0013b5d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fedf8009d90 tx=0x7fedf800b330 comp rx=0 tx=0).stop 2023-09-30T22:21:22.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.282+0000 7f16fd4e9700 1 -- 172.21.15.156:0/1768316280 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16f8131d70 msgr2=0x7f16f8132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:22.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.282+0000 7f16fd4e9700 1 --2- 172.21.15.156:0/1768316280 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16f8131d70 0x7f16f8132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:22.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.282+0000 7f16fd4e9700 1 -- 172.21.15.156:0/1768316280 >> v2:172.21.15.156:3300/0 conn(0x7f16f809f180 msgr2=0x7f16f8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:22.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.282+0000 7f16fd4e9700 1 --2- 172.21.15.156:0/1768316280 >> v2:172.21.15.156:3300/0 conn(0x7f16f809f180 0x7f16f8131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:22.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.282+0000 7fee05034700 1 -- 172.21.15.156:0/2665195494 shutdown_connections 2023-09-30T22:21:22.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.282+0000 7fee05034700 1 --2- 172.21.15.156:0/2665195494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee001391f0 0x7fee0013b5d0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:22.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.282+0000 7fee05034700 1 --2- 172.21.15.156:0/2665195494 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee000a14c0 0x7fee00138cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:22.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.282+0000 7fee05034700 1 -- 172.21.15.156:0/2665195494 >> 172.21.15.156:0/2665195494 conn(0x7fee000a3000 msgr2=0x7fee000a3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:22.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.282+0000 7f16fd4e9700 1 -- 172.21.15.156:0/1768316280 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f809f9c0 con 0x7f16f809e870 2023-09-30T22:21:22.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.282+0000 7f16fdcea700 1 --2- 172.21.15.156:0/1768316280 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16f8131d70 0x7f16f8132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:22.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.282+0000 7fee05034700 1 -- 172.21.15.156:0/2665195494 shutdown_connections 2023-09-30T22:21:22.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.282+0000 7fee05034700 1 -- 172.21.15.156:0/2665195494 wait complete. 2023-09-30T22:21:22.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.282+0000 7f16fd4e9700 1 --2- 172.21.15.156:0/1768316280 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16f809e870 0x7f16f809ec40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f16f4009870 tx=0x7f16f4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76eb3a9fbf00947a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:22.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.282+0000 7f16effff700 1 -- 172.21.15.156:0/1768316280 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f4011830 con 0x7f16f809e870 2023-09-30T22:21:22.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.282+0000 7f16effff700 1 -- 172.21.15.156:0/1768316280 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f4011990 con 0x7f16f809e870 2023-09-30T22:21:22.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.282+0000 7f16effff700 1 -- 172.21.15.156:0/1768316280 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f4011d20 con 0x7f16f809e870 2023-09-30T22:21:22.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.283+0000 7f16ff74d700 1 -- 172.21.15.156:0/1768316280 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16f809e870 msgr2=0x7f16f809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:22.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.283+0000 7f16ff74d700 1 --2- 172.21.15.156:0/1768316280 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16f809e870 0x7f16f809ec40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f16f4009870 tx=0x7f16f4009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:22.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.283+0000 7f16ff74d700 1 -- 172.21.15.156:0/1768316280 shutdown_connections 2023-09-30T22:21:22.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.283+0000 7f16ff74d700 1 --2- 172.21.15.156:0/1768316280 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16f8131d70 0x7f16f8132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:22.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.283+0000 7f16ff74d700 1 --2- 172.21.15.156:0/1768316280 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16f809e870 0x7f16f809ec40 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:22.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.283+0000 7f16ff74d700 1 --2- 172.21.15.156:0/1768316280 >> v2:172.21.15.156:3300/0 conn(0x7f16f809f180 0x7f16f8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:22.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.283+0000 7f16ff74d700 1 -- 172.21.15.156:0/1768316280 >> 172.21.15.156:0/1768316280 conn(0x7f16f80a4430 msgr2=0x7f16f80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:22.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.283+0000 7f16ff74d700 1 -- 172.21.15.156:0/1768316280 shutdown_connections 2023-09-30T22:21:22.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.283+0000 7f16ff74d700 1 -- 172.21.15.156:0/1768316280 wait complete. 2023-09-30T22:21:22.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.283+0000 7fee05034700 1 Processor -- start 2023-09-30T22:21:22.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.283+0000 7fee05034700 1 -- start start 2023-09-30T22:21:22.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.284+0000 7fee05034700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee000a09e0 0x7fee001227e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:22.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.284+0000 7fee05034700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fee000a14c0 0x7fee00122d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:22.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.284+0000 7fee05034700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee001391f0 0x7fee00123260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:22.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.284+0000 7fee05034700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0009cdc0 con 0x7fee000a09e0 2023-09-30T22:21:22.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.284+0000 7fee05034700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee00125a20 con 0x7fee001391f0 2023-09-30T22:21:22.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.284+0000 7fee05034700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee00125f40 con 0x7fee000a14c0 2023-09-30T22:21:22.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.284+0000 7fedfed9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee000a09e0 0x7fee001227e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:22.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.284+0000 7fedff59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee001391f0 0x7fee00123260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:22.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.284+0000 7fedfed9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee000a09e0 0x7fee001227e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48758/0 (socket says 172.21.15.156:48758) 2023-09-30T22:21:22.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.284+0000 7fedfed9d700 1 -- 172.21.15.156:0/1385045788 learned_addr learned my addr 172.21.15.156:0/1385045788 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:22.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.284+0000 7fedfed9d700 1 -- 172.21.15.156:0/1385045788 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fee000a14c0 msgr2=0x7fee00122d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:22.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.284+0000 7fedfed9d700 1 --2- 172.21.15.156:0/1385045788 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fee000a14c0 0x7fee00122d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:22.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.284+0000 7fedfed9d700 1 -- 172.21.15.156:0/1385045788 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee001391f0 msgr2=0x7fee00123260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:22.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.284+0000 7fedfed9d700 1 --2- 172.21.15.156:0/1385045788 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee001391f0 0x7fee00123260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:22.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.284+0000 7fedfed9d700 1 -- 172.21.15.156:0/1385045788 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf4009550 con 0x7fee000a09e0 2023-09-30T22:21:22.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.284+0000 7fedff59e700 1 --2- 172.21.15.156:0/1385045788 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee001391f0 0x7fee00123260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:22.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.284+0000 7f16ff74d700 1 Processor -- start 2023-09-30T22:21:22.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.284+0000 7f16ff74d700 1 -- start start 2023-09-30T22:21:22.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.284+0000 7fedfed9d700 1 --2- 172.21.15.156:0/1385045788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee000a09e0 0x7fee001227e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fedf000c520 tx=0x7fedf000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:22.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.284+0000 7fede77fe700 1 -- 172.21.15.156:0/1385045788 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf0004c80 con 0x7fee000a09e0 2023-09-30T22:21:22.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.284+0000 7fede77fe700 1 -- 172.21.15.156:0/1385045788 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf0004de0 con 0x7fee000a09e0 2023-09-30T22:21:22.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.284+0000 7fede77fe700 1 -- 172.21.15.156:0/1385045788 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf0007310 con 0x7fee000a09e0 2023-09-30T22:21:22.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.285+0000 7fee05034700 1 -- 172.21.15.156:0/1385045788 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf8009a70 con 0x7fee000a09e0 2023-09-30T22:21:22.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.285+0000 7fee05034700 1 -- 172.21.15.156:0/1385045788 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee0009ea00 con 0x7fee000a09e0 2023-09-30T22:21:22.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.285+0000 7f16ff74d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f16f809e870 0x7f16f8070280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:22.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.285+0000 7f16ff74d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16f809f180 0x7f16f80707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:22.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.285+0000 7f16ff74d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16f8131d70 0x7f16f8070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:22.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.285+0000 7f16ff74d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f8120730 con 0x7f16f809e870 2023-09-30T22:21:22.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.285+0000 7f16ff74d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f8071df0 con 0x7f16f8131d70 2023-09-30T22:21:22.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.285+0000 7f16ff74d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16f8072410 con 0x7f16f809f180 2023-09-30T22:21:22.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.285+0000 7f16fd4e9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f16f809e870 0x7f16f8070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:22.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.285+0000 7f16fd4e9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f16f809e870 0x7f16f8070280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48772/0 (socket says 172.21.15.156:48772) 2023-09-30T22:21:22.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.285+0000 7f16fd4e9700 1 -- 172.21.15.156:0/2631325952 learned_addr learned my addr 172.21.15.156:0/2631325952 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:22.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.285+0000 7f16fdcea700 1 --2- 172.21.15.156:0/2631325952 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16f8131d70 0x7f16f8070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:22.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.285+0000 7f16fd4e9700 1 -- 172.21.15.156:0/2631325952 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16f809f180 msgr2=0x7f16f80707c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:21:22.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.285+0000 7f16fd4e9700 1 --2- 172.21.15.156:0/2631325952 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16f809f180 0x7f16f80707c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:22.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.285+0000 7f16fd4e9700 1 -- 172.21.15.156:0/2631325952 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16f8131d70 msgr2=0x7f16f8070d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:22.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.285+0000 7f16fd4e9700 1 --2- 172.21.15.156:0/2631325952 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16f8131d70 0x7f16f8070d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:22.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.285+0000 7f16fd4e9700 1 -- 172.21.15.156:0/2631325952 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f0009a70 con 0x7f16f809e870 2023-09-30T22:21:22.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.285+0000 7f16fdcea700 1 --2- 172.21.15.156:0/2631325952 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16f8131d70 0x7f16f8070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:22.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.285+0000 7f16fd4e9700 1 --2- 172.21.15.156:0/2631325952 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f16f809e870 0x7f16f8070280 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f16f40090b0 tx=0x7f16f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:22.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.286+0000 7f16edffb700 1 -- 172.21.15.156:0/2631325952 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f40044d0 con 0x7f16f809e870 2023-09-30T22:21:22.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.286+0000 7fee05034700 1 -- 172.21.15.156:0/1385045788 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee00124b80 con 0x7fee000a09e0 2023-09-30T22:21:22.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.286+0000 7fede77fe700 1 -- 172.21.15.156:0/1385045788 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fedf0007470 con 0x7fee000a09e0 2023-09-30T22:21:22.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.286+0000 7fede77fe700 1 -- 172.21.15.156:0/1385045788 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fedf003f3b0 con 0x7fee000a09e0 2023-09-30T22:21:22.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.286+0000 7f16edffb700 1 -- 172.21.15.156:0/2631325952 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f401f070 con 0x7f16f809e870 2023-09-30T22:21:22.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.286+0000 7f16edffb700 1 -- 172.21.15.156:0/2631325952 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f40038a0 con 0x7f16f809e870 2023-09-30T22:21:22.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.286+0000 7f16ff74d700 1 -- 172.21.15.156:0/2631325952 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f40094a0 con 0x7f16f809e870 2023-09-30T22:21:22.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.287+0000 7f16ff74d700 1 -- 172.21.15.156:0/2631325952 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f80a2a40 con 0x7f16f809e870 2023-09-30T22:21:22.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.287+0000 7f16ff74d700 1 -- 172.21.15.156:0/2631325952 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f804f2a0 con 0x7f16f809e870 2023-09-30T22:21:22.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.291+0000 7fede77fe700 1 -- 172.21.15.156:0/1385045788 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fedf00133c0 con 0x7fee000a09e0 2023-09-30T22:21:22.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.291+0000 7f16edffb700 1 -- 172.21.15.156:0/2631325952 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f16f4003a00 con 0x7f16f809e870 2023-09-30T22:21:22.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.291+0000 7f16edffb700 1 -- 172.21.15.156:0/2631325952 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f16f4021070 con 0x7f16f809e870 2023-09-30T22:21:22.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.295+0000 7f16edffb700 1 -- 172.21.15.156:0/2631325952 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16f4024970 con 0x7f16f809e870 2023-09-30T22:21:22.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.310+0000 7f28bef1e700 1 -- 172.21.15.156:0/3113184313 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f28b811a590 con 0x7f28b8134210 2023-09-30T22:21:22.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.310+0000 7f28b57fa700 1 -- 172.21.15.156:0/3113184313 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f28b00102e0 con 0x7f28b8134210 2023-09-30T22:21:22.310 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:22.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.312+0000 7f28bef1e700 1 -- 172.21.15.156:0/3113184313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28b8134210 msgr2=0x7f28b811e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:22.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.312+0000 7f28bef1e700 1 --2- 172.21.15.156:0/3113184313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28b8134210 0x7f28b811e1f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f28b000cbf0 tx=0x7f28b000cf00 comp rx=0 tx=0).stop 2023-09-30T22:21:22.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.312+0000 7f28bef1e700 1 -- 172.21.15.156:0/3113184313 shutdown_connections 2023-09-30T22:21:22.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.312+0000 7f28bef1e700 1 --2- 172.21.15.156:0/3113184313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28b8134210 0x7f28b811e1f0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:22.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.312+0000 7f28bef1e700 1 --2- 172.21.15.156:0/3113184313 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f28b80a0ee0 0x7f28b811d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:22.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.312+0000 7f28bef1e700 1 --2- 172.21.15.156:0/3113184313 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f28b8133900 0x7f28b811dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:22.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.312+0000 7f28bef1e700 1 -- 172.21.15.156:0/3113184313 >> 172.21.15.156:0/3113184313 conn(0x7f28b80a2980 msgr2=0x7f28b81bad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:22.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.312+0000 7f28bef1e700 1 -- 172.21.15.156:0/3113184313 shutdown_connections 2023-09-30T22:21:22.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.312+0000 7f28bef1e700 1 -- 172.21.15.156:0/3113184313 wait complete. 2023-09-30T22:21:22.326 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:22.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.490+0000 7f16ff74d700 1 -- 172.21.15.156:0/2631325952 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f16f809f660 con 0x7f16f809e870 2023-09-30T22:21:22.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.490+0000 7f16edffb700 1 -- 172.21.15.156:0/2631325952 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f16f402b030 con 0x7f16f809e870 2023-09-30T22:21:22.491 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:22.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.492+0000 7f16ff74d700 1 -- 172.21.15.156:0/2631325952 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f16f809e870 msgr2=0x7f16f8070280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:22.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.492+0000 7f16ff74d700 1 --2- 172.21.15.156:0/2631325952 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f16f809e870 0x7f16f8070280 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f16f40090b0 tx=0x7f16f4004750 comp rx=0 tx=0).stop 2023-09-30T22:21:22.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.492+0000 7f16ff74d700 1 -- 172.21.15.156:0/2631325952 shutdown_connections 2023-09-30T22:21:22.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.492+0000 7f16ff74d700 1 --2- 172.21.15.156:0/2631325952 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16f8131d70 0x7f16f8070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:22.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.492+0000 7f16ff74d700 1 --2- 172.21.15.156:0/2631325952 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f16f809e870 0x7f16f8070280 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:22.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.492+0000 7f16ff74d700 1 --2- 172.21.15.156:0/2631325952 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16f809f180 0x7f16f80707c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:22.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.492+0000 7f16ff74d700 1 -- 172.21.15.156:0/2631325952 >> 172.21.15.156:0/2631325952 conn(0x7f16f80a4430 msgr2=0x7f16f81312c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:22.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.492+0000 7f16ff74d700 1 -- 172.21.15.156:0/2631325952 shutdown_connections 2023-09-30T22:21:22.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.492+0000 7f16ff74d700 1 -- 172.21.15.156:0/2631325952 wait complete. 2023-09-30T22:21:22.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.493+0000 7fee05034700 1 -- 172.21.15.156:0/1385045788 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fee0004f2a0 con 0x7fee000a09e0 2023-09-30T22:21:22.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.493+0000 7fede77fe700 1 -- 172.21.15.156:0/1385045788 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fedf0011360 con 0x7fee000a09e0 2023-09-30T22:21:22.495 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:22.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.496+0000 7fee05034700 1 -- 172.21.15.156:0/1385045788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee000a09e0 msgr2=0x7fee001227e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:22.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.496+0000 7fee05034700 1 --2- 172.21.15.156:0/1385045788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee000a09e0 0x7fee001227e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fedf000c520 tx=0x7fedf000c830 comp rx=0 tx=0).stop 2023-09-30T22:21:22.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.496+0000 7fee05034700 1 -- 172.21.15.156:0/1385045788 shutdown_connections 2023-09-30T22:21:22.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.496+0000 7fee05034700 1 --2- 172.21.15.156:0/1385045788 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee001391f0 0x7fee00123260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:22.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.496+0000 7fee05034700 1 --2- 172.21.15.156:0/1385045788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee000a09e0 0x7fee001227e0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:22.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.496+0000 7fee05034700 1 --2- 172.21.15.156:0/1385045788 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fee000a14c0 0x7fee00122d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:22.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.496+0000 7fee05034700 1 -- 172.21.15.156:0/1385045788 >> 172.21.15.156:0/1385045788 conn(0x7fee000a3000 msgr2=0x7fee000a4950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:22.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.496+0000 7fee05034700 1 -- 172.21.15.156:0/1385045788 shutdown_connections 2023-09-30T22:21:22.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:22.496+0000 7fee05034700 1 -- 172.21.15.156:0/1385045788 wait complete. 2023-09-30T22:21:22.507 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:22.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:22.880 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:23.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.004+0000 7f727b3ea700 1 Processor -- start 2023-09-30T22:21:23.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.004+0000 7f727b3ea700 1 -- start start 2023-09-30T22:21:23.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.005+0000 7f727b3ea700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7274099e20 0x7f727409a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:23.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.005+0000 7f727b3ea700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7274130a60 0x7f7274138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:23.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.005+0000 7f727b3ea700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7274099a60 con 0x7f727409a730 2023-09-30T22:21:23.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.005+0000 7f727b3ea700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727409bf50 con 0x7f7274130a60 2023-09-30T22:21:23.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.005+0000 7f727b3ea700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f727409b230 con 0x7f7274099e20 2023-09-30T22:21:23.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.005+0000 7f7279186700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7274099e20 0x7f727409a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:23.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.005+0000 7f7279987700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7274130a60 0x7f7274138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:23.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.005+0000 7f7279186700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7274099e20 0x7f727409a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:59960/0 (socket says 172.21.15.156:59960) 2023-09-30T22:21:23.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.005+0000 7f7279186700 1 -- 172.21.15.156:0/4081159694 learned_addr learned my addr 172.21.15.156:0/4081159694 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:23.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.005+0000 7f7278985700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f727409a730 0x7f7274130350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:39908/0 (socket says 172.21.15.156:39908) 2023-09-30T22:21:23.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.005+0000 7f7279186700 1 -- 172.21.15.156:0/4081159694 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7274130a60 msgr2=0x7f7274138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:23.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.005+0000 7f726bfff700 1 -- 172.21.15.156:0/4081159694 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3282718394 0 0) 0x7f7274099a60 con 0x7f727409a730 2023-09-30T22:21:23.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.005+0000 7f7279186700 1 --2- 172.21.15.156:0/4081159694 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7274130a60 0x7f7274138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.005+0000 7f7279186700 1 -- 172.21.15.156:0/4081159694 >> v1:172.21.15.156:6789/0 conn(0x7f727409a730 legacy=0x7f7274130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:23.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.005+0000 7f7279186700 1 -- 172.21.15.156:0/4081159694 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727409bb90 con 0x7f7274099e20 2023-09-30T22:21:23.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.005+0000 7f7279987700 1 --2- 172.21.15.156:0/4081159694 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7274130a60 0x7f7274138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:23.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.005+0000 7f7279186700 1 --2- 172.21.15.156:0/4081159694 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7274099e20 0x7f727409a1f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f72640098f0 tx=0x7f7264009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50839be09ed04994 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:23.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.005+0000 7f726bfff700 1 -- 172.21.15.156:0/4081159694 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7264005e30 con 0x7f7274099e20 2023-09-30T22:21:23.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.005+0000 7f726bfff700 1 -- 172.21.15.156:0/4081159694 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7264004030 con 0x7f7274099e20 2023-09-30T22:21:23.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.005+0000 7f726bfff700 1 -- 172.21.15.156:0/4081159694 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72640043e0 con 0x7f7274099e20 2023-09-30T22:21:23.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.006+0000 7f727b3ea700 1 -- 172.21.15.156:0/4081159694 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7274099e20 msgr2=0x7f727409a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:23.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.006+0000 7f727b3ea700 1 --2- 172.21.15.156:0/4081159694 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7274099e20 0x7f727409a1f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f72640098f0 tx=0x7f7264009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:23.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.006+0000 7f727b3ea700 1 -- 172.21.15.156:0/4081159694 shutdown_connections 2023-09-30T22:21:23.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.006+0000 7f727b3ea700 1 --2- 172.21.15.156:0/4081159694 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7274130a60 0x7f7274138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.006+0000 7f727b3ea700 1 --2- 172.21.15.156:0/4081159694 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7274099e20 0x7f727409a1f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.006+0000 7f727b3ea700 1 -- 172.21.15.156:0/4081159694 >> 172.21.15.156:0/4081159694 conn(0x7f72740a2980 msgr2=0x7f72740a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:23.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.006+0000 7f727b3ea700 1 -- 172.21.15.156:0/4081159694 shutdown_connections 2023-09-30T22:21:23.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.006+0000 7f727b3ea700 1 -- 172.21.15.156:0/4081159694 wait complete. 2023-09-30T22:21:23.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.007+0000 7f727b3ea700 1 Processor -- start 2023-09-30T22:21:23.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.007+0000 7f727b3ea700 1 -- start start 2023-09-30T22:21:23.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.007+0000 7f727b3ea700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7274099e20 0x7f727411fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:23.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.007+0000 7f727b3ea700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f727409a730 0x7f72741200c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:23.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.007+0000 7f727b3ea700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7274130a60 0x7f7274120600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:23.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.007+0000 7f727b3ea700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72741234a0 con 0x7f727409a730 2023-09-30T22:21:23.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.007+0000 7f727b3ea700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727412d650 con 0x7f7274130a60 2023-09-30T22:21:23.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.007+0000 7f727b3ea700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72740a1200 con 0x7f7274099e20 2023-09-30T22:21:23.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.007+0000 7f7278985700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f727409a730 0x7f72741200c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:23.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.007+0000 7f7279186700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7274099e20 0x7f727411fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:23.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.007+0000 7f7278985700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f727409a730 0x7f72741200c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48782/0 (socket says 172.21.15.156:48782) 2023-09-30T22:21:23.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.007+0000 7f7279987700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7274130a60 0x7f7274120600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:23.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.007+0000 7f7278985700 1 -- 172.21.15.156:0/2534403051 learned_addr learned my addr 172.21.15.156:0/2534403051 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:23.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.008+0000 7f7279186700 1 -- 172.21.15.156:0/2534403051 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7274130a60 msgr2=0x7f7274120600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:23.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.008+0000 7f7279186700 1 --2- 172.21.15.156:0/2534403051 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7274130a60 0x7f7274120600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.008+0000 7f7279186700 1 -- 172.21.15.156:0/2534403051 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f727409a730 msgr2=0x7f72741200c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:23.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.008+0000 7f7279186700 1 --2- 172.21.15.156:0/2534403051 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f727409a730 0x7f72741200c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.008+0000 7f7279186700 1 -- 172.21.15.156:0/2534403051 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726c00bc80 con 0x7f7274099e20 2023-09-30T22:21:23.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.008+0000 7f7279186700 1 --2- 172.21.15.156:0/2534403051 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7274099e20 0x7f727411fb80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7274066a90 tx=0x7f7264004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:23.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.008+0000 7f7269ffb700 1 -- 172.21.15.156:0/2534403051 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7264011420 con 0x7f7274099e20 2023-09-30T22:21:23.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.008+0000 7f7269ffb700 1 -- 172.21.15.156:0/2534403051 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72640115a0 con 0x7f7274099e20 2023-09-30T22:21:23.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.008+0000 7f727b3ea700 1 -- 172.21.15.156:0/2534403051 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7264009500 con 0x7f7274099e20 2023-09-30T22:21:23.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.008+0000 7f7269ffb700 1 -- 172.21.15.156:0/2534403051 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7264011950 con 0x7f7274099e20 2023-09-30T22:21:23.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.008+0000 7f727b3ea700 1 -- 172.21.15.156:0/2534403051 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7274123100 con 0x7f7274099e20 2023-09-30T22:21:23.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.009+0000 7f7269ffb700 1 -- 172.21.15.156:0/2534403051 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7264018030 con 0x7f7274099e20 2023-09-30T22:21:23.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.009+0000 7f7269ffb700 1 -- 172.21.15.156:0/2534403051 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7264040090 con 0x7f7274099e20 2023-09-30T22:21:23.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.009+0000 7f727b3ea700 1 -- 172.21.15.156:0/2534403051 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7274072480 con 0x7f7274099e20 2023-09-30T22:21:23.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.014+0000 7f7269ffb700 1 -- 172.21.15.156:0/2534403051 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7274072480 con 0x7f7274099e20 2023-09-30T22:21:23.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.197+0000 7f727b3ea700 1 -- 172.21.15.156:0/2534403051 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7274072480 con 0x7f7274099e20 2023-09-30T22:21:23.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.197+0000 7f7269ffb700 1 -- 172.21.15.156:0/2534403051 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7274072480 con 0x7f7274099e20 2023-09-30T22:21:23.198 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:23.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.199+0000 7f727b3ea700 1 -- 172.21.15.156:0/2534403051 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7274099e20 msgr2=0x7f727411fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:23.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.199+0000 7f727b3ea700 1 --2- 172.21.15.156:0/2534403051 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7274099e20 0x7f727411fb80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7274066a90 tx=0x7f7264004750 comp rx=0 tx=0).stop 2023-09-30T22:21:23.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.199+0000 7f727b3ea700 1 -- 172.21.15.156:0/2534403051 shutdown_connections 2023-09-30T22:21:23.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.199+0000 7f727b3ea700 1 --2- 172.21.15.156:0/2534403051 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7274130a60 0x7f7274120600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.199+0000 7f727b3ea700 1 --2- 172.21.15.156:0/2534403051 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7274099e20 0x7f727411fb80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.199+0000 7f727b3ea700 1 --2- 172.21.15.156:0/2534403051 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f727409a730 0x7f72741200c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.199+0000 7f727b3ea700 1 -- 172.21.15.156:0/2534403051 >> 172.21.15.156:0/2534403051 conn(0x7f72740a2980 msgr2=0x7f727409fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:23.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.200+0000 7f727b3ea700 1 -- 172.21.15.156:0/2534403051 shutdown_connections 2023-09-30T22:21:23.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.200+0000 7f727b3ea700 1 -- 172.21.15.156:0/2534403051 wait complete. 2023-09-30T22:21:23.212 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:23.327 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:23.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.449+0000 7f4b07b29700 1 Processor -- start 2023-09-30T22:21:23.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.449+0000 7f4b07b29700 1 -- start start 2023-09-30T22:21:23.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.449+0000 7f4b07b29700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4b00133ad0 0x7f4b00133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:23.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.449+0000 7f4b07b29700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b001300a0 0x7f4b001304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:23.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.449+0000 7f4b07b29700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b001309f0 0x7f4b0013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:23.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.449+0000 7f4b07b29700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0006b2d0 con 0x7f4b00133ad0 2023-09-30T22:21:23.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.449+0000 7f4b07b29700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b00133610 con 0x7f4b001300a0 2023-09-30T22:21:23.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.449+0000 7f4b07b29700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0009a500 con 0x7f4b001309f0 2023-09-30T22:21:23.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.450+0000 7f4b058c5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4b00133ad0 0x7f4b00133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:23.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.450+0000 7f4b050c4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b001300a0 0x7f4b001304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:23.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.450+0000 7f4b060c6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b001309f0 0x7f4b0013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:23.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.450+0000 7f4b058c5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4b00133ad0 0x7f4b00133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48794/0 (socket says 172.21.15.156:48794) 2023-09-30T22:21:23.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.450+0000 7f4b050c4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b001300a0 0x7f4b001304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38644/0 (socket says 172.21.15.156:38644) 2023-09-30T22:21:23.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.450+0000 7f4b058c5700 1 -- 172.21.15.156:0/1018991217 learned_addr learned my addr 172.21.15.156:0/1018991217 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:23.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.450+0000 7f4b058c5700 1 -- 172.21.15.156:0/1018991217 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b001309f0 msgr2=0x7f4b0013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:23.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.450+0000 7f4b058c5700 1 --2- 172.21.15.156:0/1018991217 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b001309f0 0x7f4b0013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.450+0000 7f4b058c5700 1 -- 172.21.15.156:0/1018991217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b001300a0 msgr2=0x7f4b001304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:23.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.450+0000 7f4b058c5700 1 --2- 172.21.15.156:0/1018991217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b001300a0 0x7f4b001304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.450+0000 7f4b058c5700 1 -- 172.21.15.156:0/1018991217 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b001338b0 con 0x7f4b00133ad0 2023-09-30T22:21:23.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.450+0000 7f4b060c6700 1 --2- 172.21.15.156:0/1018991217 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b001309f0 0x7f4b0013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:23.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.450+0000 7f4b050c4700 1 --2- 172.21.15.156:0/1018991217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b001300a0 0x7f4b001304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:23.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.450+0000 7f4b058c5700 1 --2- 172.21.15.156:0/1018991217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b00133ad0 0x7f4b00133ea0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f4af00098f0 tx=0x7f4af0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a61ec641445b4960 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:23.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.450+0000 7f4b048c3700 1 -- 172.21.15.156:0/1018991217 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af0011830 con 0x7f4b00133ad0 2023-09-30T22:21:23.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.450+0000 7f4b048c3700 1 -- 172.21.15.156:0/1018991217 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af0011990 con 0x7f4b00133ad0 2023-09-30T22:21:23.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.450+0000 7f4b048c3700 1 -- 172.21.15.156:0/1018991217 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af0011d20 con 0x7f4b00133ad0 2023-09-30T22:21:23.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.451+0000 7f4b07b29700 1 -- 172.21.15.156:0/1018991217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b00133ad0 msgr2=0x7f4b00133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:23.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.451+0000 7f4b07b29700 1 --2- 172.21.15.156:0/1018991217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b00133ad0 0x7f4b00133ea0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f4af00098f0 tx=0x7f4af0009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:23.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.451+0000 7f4b07b29700 1 -- 172.21.15.156:0/1018991217 shutdown_connections 2023-09-30T22:21:23.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.451+0000 7f4b07b29700 1 --2- 172.21.15.156:0/1018991217 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b001309f0 0x7f4b0013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.451+0000 7f4b07b29700 1 --2- 172.21.15.156:0/1018991217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b00133ad0 0x7f4b00133ea0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.451+0000 7f4b07b29700 1 --2- 172.21.15.156:0/1018991217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b001300a0 0x7f4b001304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.451+0000 7f4b07b29700 1 -- 172.21.15.156:0/1018991217 >> 172.21.15.156:0/1018991217 conn(0x7f4b00099c40 msgr2=0x7f4b000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:23.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.451+0000 7f4b07b29700 1 -- 172.21.15.156:0/1018991217 shutdown_connections 2023-09-30T22:21:23.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.451+0000 7f4b07b29700 1 -- 172.21.15.156:0/1018991217 wait complete. 2023-09-30T22:21:23.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.452+0000 7f4b07b29700 1 Processor -- start 2023-09-30T22:21:23.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.452+0000 7f4b07b29700 1 -- start start 2023-09-30T22:21:23.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.452+0000 7f4b07b29700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b001300a0 0x7f4b0011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:23.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.452+0000 7f4b07b29700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b001309f0 0x7f4b0011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:23.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.452+0000 7f4b07b29700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b00133ad0 0x7f4b0011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:23.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.452+0000 7f4b07b29700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0011fd00 con 0x7f4b001309f0 2023-09-30T22:21:23.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.452+0000 7f4b07b29700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0012dd00 con 0x7f4b00133ad0 2023-09-30T22:21:23.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.452+0000 7f4b07b29700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b00120950 con 0x7f4b001300a0 2023-09-30T22:21:23.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.452+0000 7f4b050c4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b001309f0 0x7f4b0011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:23.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.452+0000 7f4b060c6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b00133ad0 0x7f4b0011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:23.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.452+0000 7f4b058c5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b001300a0 0x7f4b0011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:23.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.452+0000 7f4b050c4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b001309f0 0x7f4b0011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48808/0 (socket says 172.21.15.156:48808) 2023-09-30T22:21:23.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.452+0000 7f4b050c4700 1 -- 172.21.15.156:0/1172433236 learned_addr learned my addr 172.21.15.156:0/1172433236 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:23.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.453+0000 7f4b058c5700 1 -- 172.21.15.156:0/1172433236 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b00133ad0 msgr2=0x7f4b0011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:23.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.453+0000 7f4b058c5700 1 --2- 172.21.15.156:0/1172433236 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b00133ad0 0x7f4b0011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.453+0000 7f4b058c5700 1 -- 172.21.15.156:0/1172433236 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b001309f0 msgr2=0x7f4b0011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:23.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.453+0000 7f4b058c5700 1 --2- 172.21.15.156:0/1172433236 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b001309f0 0x7f4b0011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.453+0000 7f4b058c5700 1 -- 172.21.15.156:0/1172433236 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4afc0094a0 con 0x7f4b001300a0 2023-09-30T22:21:23.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.453+0000 7f4b058c5700 1 --2- 172.21.15.156:0/1172433236 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b001300a0 0x7f4b0011da40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4b0006e5d0 tx=0x7f4af0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:23.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.453+0000 7f4af67fc700 1 -- 172.21.15.156:0/1172433236 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af0004450 con 0x7f4b001300a0 2023-09-30T22:21:23.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.453+0000 7f4af67fc700 1 -- 172.21.15.156:0/1172433236 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af00045b0 con 0x7f4b001300a0 2023-09-30T22:21:23.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.453+0000 7f4b07b29700 1 -- 172.21.15.156:0/1172433236 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af8009a70 con 0x7f4b001300a0 2023-09-30T22:21:23.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.453+0000 7f4af67fc700 1 -- 172.21.15.156:0/1172433236 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af00038a0 con 0x7f4b001300a0 2023-09-30T22:21:23.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.453+0000 7f4b07b29700 1 -- 172.21.15.156:0/1172433236 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af0009550 con 0x7f4b001300a0 2023-09-30T22:21:23.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.454+0000 7f4af67fc700 1 -- 172.21.15.156:0/1172433236 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4af0021070 con 0x7f4b001300a0 2023-09-30T22:21:23.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.454+0000 7f4af67fc700 1 -- 172.21.15.156:0/1172433236 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4af00407d0 con 0x7f4b001300a0 2023-09-30T22:21:23.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.454+0000 7f4b07b29700 1 -- 172.21.15.156:0/1172433236 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b0004f2a0 con 0x7f4b001300a0 2023-09-30T22:21:23.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.459+0000 7f4af67fc700 1 -- 172.21.15.156:0/1172433236 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4af0015080 con 0x7f4b001300a0 2023-09-30T22:21:23.508 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:23.510 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:23.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.634+0000 7f2acb432700 1 Processor -- start 2023-09-30T22:21:23.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.635+0000 7f92edb40700 1 Processor -- start 2023-09-30T22:21:23.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.635+0000 7f2acb432700 1 -- start start 2023-09-30T22:21:23.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.635+0000 7f92edb40700 1 -- start start 2023-09-30T22:21:23.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.635+0000 7f92edb40700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92e80a0a70 0x7f92e80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:23.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.635+0000 7f2acb432700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2ac406a770 0x7f2ac406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:23.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.635+0000 7f2acb432700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2ac4136cb0 0x7f2ac4139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:23.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.635+0000 7f2acb432700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac406e900 con 0x7f2ac409dec0 2023-09-30T22:21:23.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.635+0000 7f2acb432700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac409d180 con 0x7f2ac406a770 2023-09-30T22:21:23.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.635+0000 7f2acb432700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac409e780 con 0x7f2ac4136cb0 2023-09-30T22:21:23.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.636+0000 7f2ac99cf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2ac4136cb0 0x7f2ac4139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:23.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.636+0000 7f2ac99cf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2ac4136cb0 0x7f2ac4139090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:59994/0 (socket says 172.21.15.156:59994) 2023-09-30T22:21:23.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.635+0000 7f92edb40700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f92e8134120 0x7f92e813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:23.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.635+0000 7f92edb40700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92e809dc00 con 0x7f92e80a1380 2023-09-30T22:21:23.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.635+0000 7f92edb40700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e809ea60 con 0x7f92e8134120 2023-09-30T22:21:23.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.635+0000 7f92edb40700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e809dec0 con 0x7f92e80a0a70 2023-09-30T22:21:23.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.636+0000 7f2ac99cf700 1 -- 172.21.15.156:0/3691626657 learned_addr learned my addr 172.21.15.156:0/3691626657 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:23.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.636+0000 7f92e7fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f92e8134120 0x7f92e813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:23.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.636+0000 7f92e7fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f92e8134120 0x7f92e813bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48818/0 (socket says 172.21.15.156:48818) 2023-09-30T22:21:23.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.636+0000 7f92e7fff700 1 -- 172.21.15.156:0/4262724529 learned_addr learned my addr 172.21.15.156:0/4262724529 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:23.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.636+0000 7f2ac91ce700 1 --2- 172.21.15.156:0/3691626657 >> v2:172.21.15.156:3300/0 conn(0x7f2ac406a770 0x7f2ac406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:23.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.636+0000 7f92e77fe700 1 --2- 172.21.15.156:0/4262724529 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92e80a0a70 0x7f92e80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:23.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.636+0000 7f2ac99cf700 1 -- 172.21.15.156:0/3691626657 >> v2:172.21.15.156:3300/0 conn(0x7f2ac406a770 msgr2=0x7f2ac406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:23.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.636+0000 7f2ac99cf700 1 --2- 172.21.15.156:0/3691626657 >> v2:172.21.15.156:3300/0 conn(0x7f2ac406a770 0x7f2ac406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.636+0000 7f2ac99cf700 1 -- 172.21.15.156:0/3691626657 >> v1:172.21.15.156:6789/0 conn(0x7f2ac409dec0 legacy=0x7f2ac406b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:23.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.636+0000 7f2ac99cf700 1 -- 172.21.15.156:0/3691626657 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac409d3c0 con 0x7f2ac4136cb0 2023-09-30T22:21:23.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.636+0000 7f92e7fff700 1 -- 172.21.15.156:0/4262724529 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92e80a0a70 msgr2=0x7f92e80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:23.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.636+0000 7f92e7fff700 1 --2- 172.21.15.156:0/4262724529 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92e80a0a70 0x7f92e80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.636+0000 7f92e7fff700 1 -- 172.21.15.156:0/4262724529 >> v1:172.21.15.156:6789/0 conn(0x7f92e80a1380 legacy=0x7f92e8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:23.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.636+0000 7f2ac99cf700 1 --2- 172.21.15.156:0/3691626657 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2ac4136cb0 0x7f2ac4139090 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2abc009e50 tx=0x7f2abc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55f4f797b383b8b5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:23.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.636+0000 7f92e7fff700 1 -- 172.21.15.156:0/4262724529 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e809e6a0 con 0x7f92e8134120 2023-09-30T22:21:23.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.636+0000 7f92e77fe700 1 --2- 172.21.15.156:0/4262724529 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92e80a0a70 0x7f92e80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:23.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.636+0000 7f2abbfff700 1 -- 172.21.15.156:0/3691626657 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc00e070 con 0x7f2ac4136cb0 2023-09-30T22:21:23.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.636+0000 7f92e7fff700 1 --2- 172.21.15.156:0/4262724529 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92e8134120 0x7f92e813bce0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f92e0009e50 tx=0x7f92e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6351770565b26b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:23.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.636+0000 7f2abbfff700 1 -- 172.21.15.156:0/3691626657 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2abc00b9c0 con 0x7f2ac4136cb0 2023-09-30T22:21:23.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.636+0000 7f2abbfff700 1 -- 172.21.15.156:0/3691626657 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc00bd70 con 0x7f2ac4136cb0 2023-09-30T22:21:23.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.636+0000 7f92e67fc700 1 -- 172.21.15.156:0/4262724529 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e000e070 con 0x7f92e8134120 2023-09-30T22:21:23.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.637+0000 7f92e67fc700 1 -- 172.21.15.156:0/4262724529 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e000b910 con 0x7f92e8134120 2023-09-30T22:21:23.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.637+0000 7f92e67fc700 1 -- 172.21.15.156:0/4262724529 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e000bcc0 con 0x7f92e8134120 2023-09-30T22:21:23.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.637+0000 7f2acb432700 1 -- 172.21.15.156:0/3691626657 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2ac4136cb0 msgr2=0x7f2ac4139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:23.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.637+0000 7f2acb432700 1 --2- 172.21.15.156:0/3691626657 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2ac4136cb0 0x7f2ac4139090 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2abc009e50 tx=0x7f2abc00b330 comp rx=0 tx=0).stop 2023-09-30T22:21:23.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.637+0000 7f2acb432700 1 -- 172.21.15.156:0/3691626657 shutdown_connections 2023-09-30T22:21:23.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.637+0000 7f2acb432700 1 --2- 172.21.15.156:0/3691626657 >> v2:172.21.15.156:3300/0 conn(0x7f2ac406a770 0x7f2ac406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.637+0000 7f2acb432700 1 --2- 172.21.15.156:0/3691626657 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2ac4136cb0 0x7f2ac4139090 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.637+0000 7f2acb432700 1 -- 172.21.15.156:0/3691626657 >> 172.21.15.156:0/3691626657 conn(0x7f2ac4099c40 msgr2=0x7f2ac40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:23.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.637+0000 7f92edb40700 1 -- 172.21.15.156:0/4262724529 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92e8134120 msgr2=0x7f92e813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:23.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.637+0000 7f92edb40700 1 --2- 172.21.15.156:0/4262724529 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92e8134120 0x7f92e813bce0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f92e0009e50 tx=0x7f92e000b330 comp rx=0 tx=0).stop 2023-09-30T22:21:23.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.637+0000 7f2acb432700 1 -- 172.21.15.156:0/3691626657 shutdown_connections 2023-09-30T22:21:23.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.637+0000 7f2acb432700 1 -- 172.21.15.156:0/3691626657 wait complete. 2023-09-30T22:21:23.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.637+0000 7f92edb40700 1 -- 172.21.15.156:0/4262724529 shutdown_connections 2023-09-30T22:21:23.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.637+0000 7f92edb40700 1 --2- 172.21.15.156:0/4262724529 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92e8134120 0x7f92e813bce0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.637+0000 7f92edb40700 1 --2- 172.21.15.156:0/4262724529 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92e80a0a70 0x7f92e80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.637+0000 7f92edb40700 1 -- 172.21.15.156:0/4262724529 >> 172.21.15.156:0/4262724529 conn(0x7f92e80a6610 msgr2=0x7f92e80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:23.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.637+0000 7f92edb40700 1 -- 172.21.15.156:0/4262724529 shutdown_connections 2023-09-30T22:21:23.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.637+0000 7f92edb40700 1 -- 172.21.15.156:0/4262724529 wait complete. 2023-09-30T22:21:23.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.638+0000 7f2acb432700 1 Processor -- start 2023-09-30T22:21:23.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.638+0000 7f2acb432700 1 -- start start 2023-09-30T22:21:23.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.639+0000 7f2acb432700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2ac406a770 0x7f2ac409a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:23.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.639+0000 7f2acb432700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2ac409dec0 0x7f2ac409a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:23.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.639+0000 7f2acb432700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ac4136cb0 0x7f2ac409af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:23.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.639+0000 7f2acb432700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac409c020 con 0x7f2ac4136cb0 2023-09-30T22:21:23.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.639+0000 7f2acb432700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac4071ce0 con 0x7f2ac409dec0 2023-09-30T22:21:23.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.639+0000 7f2acb432700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac4135ba0 con 0x7f2ac406a770 2023-09-30T22:21:23.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.639+0000 7f92edb40700 1 Processor -- start 2023-09-30T22:21:23.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.639+0000 7f2ac91ce700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2ac406a770 0x7f2ac409a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:23.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.639+0000 7f2ac91ce700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2ac406a770 0x7f2ac409a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:59996/0 (socket says 172.21.15.156:59996) 2023-09-30T22:21:23.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.639+0000 7f2ac91ce700 1 -- 172.21.15.156:0/2689033034 learned_addr learned my addr 172.21.15.156:0/2689033034 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:23.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.639+0000 7f2ac99cf700 1 --2- 172.21.15.156:0/2689033034 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ac4136cb0 0x7f2ac409af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:23.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.639+0000 7f92edb40700 1 -- start start 2023-09-30T22:21:23.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.639+0000 7f2ac91ce700 1 -- 172.21.15.156:0/2689033034 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2ac409dec0 msgr2=0x7f2ac409a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:23.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.639+0000 7f2ac91ce700 1 --2- 172.21.15.156:0/2689033034 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2ac409dec0 0x7f2ac409a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.639+0000 7f2ac91ce700 1 -- 172.21.15.156:0/2689033034 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ac4136cb0 msgr2=0x7f2ac409af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:23.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.639+0000 7f2ac91ce700 1 --2- 172.21.15.156:0/2689033034 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ac4136cb0 0x7f2ac409af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.639+0000 7f2ac91ce700 1 -- 172.21.15.156:0/2689033034 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2abc009b30 con 0x7f2ac406a770 2023-09-30T22:21:23.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.639+0000 7f2ac91ce700 1 --2- 172.21.15.156:0/2689033034 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2ac406a770 0x7f2ac409a490 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000e810 tx=0x7f2ac000eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:23.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.639+0000 7f2ab9ffb700 1 -- 172.21.15.156:0/2689033034 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0013610 con 0x7f2ac406a770 2023-09-30T22:21:23.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.639+0000 7f2ab9ffb700 1 -- 172.21.15.156:0/2689033034 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac0013770 con 0x7f2ac406a770 2023-09-30T22:21:23.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.639+0000 7f2acb432700 1 -- 172.21.15.156:0/2689033034 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac41346f0 con 0x7f2ac406a770 2023-09-30T22:21:23.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.639+0000 7f2ab9ffb700 1 -- 172.21.15.156:0/2689033034 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0013b20 con 0x7f2ac406a770 2023-09-30T22:21:23.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.640+0000 7f92edb40700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92e80a0a70 0x7f92e81232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:23.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.640+0000 7f92edb40700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92e80a1380 0x7f92e8123820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:23.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.640+0000 7f92edb40700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92e8134120 0x7f92e81c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:23.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.640+0000 7f92edb40700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e8125f90 con 0x7f92e8134120 2023-09-30T22:21:23.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.640+0000 7f92edb40700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e8126630 con 0x7f92e80a0a70 2023-09-30T22:21:23.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.640+0000 7f92edb40700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92e8124620 con 0x7f92e80a1380 2023-09-30T22:21:23.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.640+0000 7f92e77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92e80a0a70 0x7f92e81232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:23.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.640+0000 7f2acb432700 1 -- 172.21.15.156:0/2689033034 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac4135e10 con 0x7f2ac406a770 2023-09-30T22:21:23.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.640+0000 7f92e77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92e80a0a70 0x7f92e81232e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38684/0 (socket says 172.21.15.156:38684) 2023-09-30T22:21:23.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.640+0000 7f92e77fe700 1 -- 172.21.15.156:0/3929114318 learned_addr learned my addr 172.21.15.156:0/3929114318 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:23.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.640+0000 7f92e6ffd700 1 --2- 172.21.15.156:0/3929114318 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92e80a1380 0x7f92e8123820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:23.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.640+0000 7f92e7fff700 1 --2- 172.21.15.156:0/3929114318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92e8134120 0x7f92e81c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:23.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.640+0000 7f92e77fe700 1 -- 172.21.15.156:0/3929114318 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92e80a1380 msgr2=0x7f92e8123820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:23.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.640+0000 7f92e77fe700 1 --2- 172.21.15.156:0/3929114318 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92e80a1380 0x7f92e8123820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.640+0000 7f92e77fe700 1 -- 172.21.15.156:0/3929114318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92e8134120 msgr2=0x7f92e81c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:23.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.640+0000 7f92e77fe700 1 --2- 172.21.15.156:0/3929114318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92e8134120 0x7f92e81c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.640+0000 7f92e77fe700 1 -- 172.21.15.156:0/3929114318 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d80094a0 con 0x7f92e80a0a70 2023-09-30T22:21:23.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.640+0000 7f92e77fe700 1 --2- 172.21.15.156:0/3929114318 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92e80a0a70 0x7f92e81232e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f92d800ebe0 tx=0x7f92d800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:23.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.640+0000 7f92cffff700 1 -- 172.21.15.156:0/3929114318 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d800c850 con 0x7f92e80a0a70 2023-09-30T22:21:23.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.640+0000 7f92cffff700 1 -- 172.21.15.156:0/3929114318 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d800c9b0 con 0x7f92e80a0a70 2023-09-30T22:21:23.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.640+0000 7f92edb40700 1 -- 172.21.15.156:0/3929114318 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e0009b30 con 0x7f92e80a0a70 2023-09-30T22:21:23.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.640+0000 7f92cffff700 1 -- 172.21.15.156:0/3929114318 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d800cd20 con 0x7f92e80a0a70 2023-09-30T22:21:23.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.641+0000 7f92edb40700 1 -- 172.21.15.156:0/3929114318 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e80a03e0 con 0x7f92e80a0a70 2023-09-30T22:21:23.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.641+0000 7f92cffff700 1 -- 172.21.15.156:0/3929114318 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f92d8013470 con 0x7f92e80a0a70 2023-09-30T22:21:23.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.641+0000 7f92cffff700 1 -- 172.21.15.156:0/3929114318 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f92d803fb10 con 0x7f92e80a0a70 2023-09-30T22:21:23.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.642+0000 7f92edb40700 1 -- 172.21.15.156:0/3929114318 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e8126d80 con 0x7f92e80a0a70 2023-09-30T22:21:23.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.642+0000 7f2ab9ffb700 1 -- 172.21.15.156:0/2689033034 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2ac0013c80 con 0x7f2ac406a770 2023-09-30T22:21:23.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.642+0000 7f2ab9ffb700 1 -- 172.21.15.156:0/2689033034 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2ac003f500 con 0x7f2ac406a770 2023-09-30T22:21:23.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.642+0000 7f2acb432700 1 -- 172.21.15.156:0/2689033034 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac404f2a0 con 0x7f2ac406a770 2023-09-30T22:21:23.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.647+0000 7f92cffff700 1 -- 172.21.15.156:0/3929114318 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92d8017080 con 0x7f92e80a0a70 2023-09-30T22:21:23.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.647+0000 7f2ab9ffb700 1 -- 172.21.15.156:0/2689033034 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2ac0012370 con 0x7f2ac406a770 2023-09-30T22:21:23.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.661+0000 7f4b07b29700 1 -- 172.21.15.156:0/1172433236 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4b0011ee40 con 0x7f4b001300a0 2023-09-30T22:21:23.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.661+0000 7f4af67fc700 1 -- 172.21.15.156:0/1172433236 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4af0029020 con 0x7f4b001300a0 2023-09-30T22:21:23.662 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:23.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.663+0000 7f4b07b29700 1 -- 172.21.15.156:0/1172433236 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b001300a0 msgr2=0x7f4b0011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:23.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.663+0000 7f4b07b29700 1 --2- 172.21.15.156:0/1172433236 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b001300a0 0x7f4b0011da40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4b0006e5d0 tx=0x7f4af0004750 comp rx=0 tx=0).stop 2023-09-30T22:21:23.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.663+0000 7f4b07b29700 1 -- 172.21.15.156:0/1172433236 shutdown_connections 2023-09-30T22:21:23.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.663+0000 7f4b07b29700 1 --2- 172.21.15.156:0/1172433236 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b00133ad0 0x7f4b0011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.663+0000 7f4b07b29700 1 --2- 172.21.15.156:0/1172433236 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b001300a0 0x7f4b0011da40 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.663+0000 7f4b07b29700 1 --2- 172.21.15.156:0/1172433236 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b001309f0 0x7f4b0011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.663+0000 7f4b07b29700 1 -- 172.21.15.156:0/1172433236 >> 172.21.15.156:0/1172433236 conn(0x7f4b00099c40 msgr2=0x7f4b0012e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:23.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.663+0000 7f4b07b29700 1 -- 172.21.15.156:0/1172433236 shutdown_connections 2023-09-30T22:21:23.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.663+0000 7f4b07b29700 1 -- 172.21.15.156:0/1172433236 wait complete. 2023-09-30T22:21:23.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:23.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.836+0000 7f2acb432700 1 -- 172.21.15.156:0/2689033034 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2ac4135490 con 0x7f2ac406a770 2023-09-30T22:21:23.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.836+0000 7f2ab9ffb700 1 -- 172.21.15.156:0/2689033034 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2ac002b090 con 0x7f2ac406a770 2023-09-30T22:21:23.837 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:23.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.838+0000 7f92edb40700 1 -- 172.21.15.156:0/3929114318 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f92e8099d00 con 0x7f92e80a0a70 2023-09-30T22:21:23.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.839+0000 7f92cffff700 1 -- 172.21.15.156:0/3929114318 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f92d8021020 con 0x7f92e80a0a70 2023-09-30T22:21:23.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.839+0000 7f2acb432700 1 -- 172.21.15.156:0/2689033034 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2ac406a770 msgr2=0x7f2ac409a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:23.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.839+0000 7f2acb432700 1 --2- 172.21.15.156:0/2689033034 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2ac406a770 0x7f2ac409a490 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000e810 tx=0x7f2ac000eb20 comp rx=0 tx=0).stop 2023-09-30T22:21:23.840 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:23.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.839+0000 7f2acb432700 1 -- 172.21.15.156:0/2689033034 shutdown_connections 2023-09-30T22:21:23.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.839+0000 7f2acb432700 1 --2- 172.21.15.156:0/2689033034 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ac4136cb0 0x7f2ac409af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.839+0000 7f2acb432700 1 --2- 172.21.15.156:0/2689033034 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2ac406a770 0x7f2ac409a490 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.839+0000 7f2acb432700 1 --2- 172.21.15.156:0/2689033034 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2ac409dec0 0x7f2ac409a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.839+0000 7f2acb432700 1 -- 172.21.15.156:0/2689033034 >> 172.21.15.156:0/2689033034 conn(0x7f2ac4099c40 msgr2=0x7f2ac4070aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:23.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.839+0000 7f2acb432700 1 -- 172.21.15.156:0/2689033034 shutdown_connections 2023-09-30T22:21:23.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.839+0000 7f2acb432700 1 -- 172.21.15.156:0/2689033034 wait complete. 2023-09-30T22:21:23.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.841+0000 7f92edb40700 1 -- 172.21.15.156:0/3929114318 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92e80a0a70 msgr2=0x7f92e81232e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:23.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.841+0000 7f92edb40700 1 --2- 172.21.15.156:0/3929114318 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92e80a0a70 0x7f92e81232e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f92d800ebe0 tx=0x7f92d800eef0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.841+0000 7f92edb40700 1 -- 172.21.15.156:0/3929114318 shutdown_connections 2023-09-30T22:21:23.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.841+0000 7f92edb40700 1 --2- 172.21.15.156:0/3929114318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92e8134120 0x7f92e81c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.841+0000 7f92edb40700 1 --2- 172.21.15.156:0/3929114318 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92e80a0a70 0x7f92e81232e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.841+0000 7f92edb40700 1 --2- 172.21.15.156:0/3929114318 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92e80a1380 0x7f92e8123820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:23.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.841+0000 7f92edb40700 1 -- 172.21.15.156:0/3929114318 >> 172.21.15.156:0/3929114318 conn(0x7f92e80a6610 msgr2=0x7f92e809aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:23.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.841+0000 7f92edb40700 1 -- 172.21.15.156:0/3929114318 shutdown_connections 2023-09-30T22:21:23.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:23.841+0000 7f92edb40700 1 -- 172.21.15.156:0/3929114318 wait complete. 2023-09-30T22:21:23.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:23.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:24.213 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:24.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.337+0000 7f5f808d1700 1 Processor -- start 2023-09-30T22:21:24.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.337+0000 7f5f808d1700 1 -- start start 2023-09-30T22:21:24.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.337+0000 7f5f808d1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f7c06a770 0x7f5f7c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:24.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.337+0000 7f5f808d1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f7c09dec0 0x7f5f7c06b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:24.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.338+0000 7f5f808d1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5f7c131a00 0x7f5f7c131e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:24.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.338+0000 7f5f808d1700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f7c06b5c0 con 0x7f5f7c131a00 2023-09-30T22:21:24.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.338+0000 7f5f808d1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c06e900 con 0x7f5f7c06a770 2023-09-30T22:21:24.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.338+0000 7f5f808d1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c09d180 con 0x7f5f7c09dec0 2023-09-30T22:21:24.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.338+0000 7f5f7a59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f7c06a770 0x7f5f7c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:24.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.338+0000 7f5f7ad9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5f7c131a00 0x7f5f7c131e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:24.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.338+0000 7f5f7a59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f7c06a770 0x7f5f7c06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38692/0 (socket says 172.21.15.156:38692) 2023-09-30T22:21:24.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.338+0000 7f5f79d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f7c09dec0 0x7f5f7c06b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:24.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.338+0000 7f5f7a59c700 1 -- 172.21.15.156:0/1095648019 learned_addr learned my addr 172.21.15.156:0/1095648019 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:24.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.338+0000 7f5f7ad9d700 1 -- 172.21.15.156:0/1095648019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f7c09dec0 msgr2=0x7f5f7c06b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:24.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.338+0000 7f5f7ad9d700 1 --2- 172.21.15.156:0/1095648019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f7c09dec0 0x7f5f7c06b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:24.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.338+0000 7f5f7ad9d700 1 -- 172.21.15.156:0/1095648019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f7c06a770 msgr2=0x7f5f7c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:24.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.338+0000 7f5f7ad9d700 1 --2- 172.21.15.156:0/1095648019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f7c06a770 0x7f5f7c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:24.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.338+0000 7f5f7ad9d700 1 -- 172.21.15.156:0/1095648019 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c09e780 con 0x7f5f7c131a00 2023-09-30T22:21:24.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.338+0000 7f5f7a59c700 1 --2- 172.21.15.156:0/1095648019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f7c06a770 0x7f5f7c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:24.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.338+0000 7f5f79d9b700 1 --2- 172.21.15.156:0/1095648019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f7c09dec0 0x7f5f7c06b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:24.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.338+0000 7f5f7ad9d700 1 --2- 172.21.15.156:0/1095648019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f7c131a00 0x7f5f7c131e80 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009d90 tx=0x7f5f7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b6b20441e934cf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:24.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.338+0000 7f5f7959a700 1 -- 172.21.15.156:0/1095648019 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7400e070 con 0x7f5f7c131a00 2023-09-30T22:21:24.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.338+0000 7f5f7959a700 1 -- 172.21.15.156:0/1095648019 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7400bb20 con 0x7f5f7c131a00 2023-09-30T22:21:24.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.338+0000 7f5f7959a700 1 -- 172.21.15.156:0/1095648019 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f74012430 con 0x7f5f7c131a00 2023-09-30T22:21:24.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.339+0000 7f5f808d1700 1 -- 172.21.15.156:0/1095648019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f7c131a00 msgr2=0x7f5f7c131e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:24.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.339+0000 7f5f808d1700 1 --2- 172.21.15.156:0/1095648019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f7c131a00 0x7f5f7c131e80 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009d90 tx=0x7f5f7400b330 comp rx=0 tx=0).stop 2023-09-30T22:21:24.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.339+0000 7f5f808d1700 1 -- 172.21.15.156:0/1095648019 shutdown_connections 2023-09-30T22:21:24.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.339+0000 7f5f808d1700 1 --2- 172.21.15.156:0/1095648019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f7c131a00 0x7f5f7c131e80 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:24.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.339+0000 7f5f808d1700 1 --2- 172.21.15.156:0/1095648019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f7c06a770 0x7f5f7c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:24.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.339+0000 7f5f808d1700 1 --2- 172.21.15.156:0/1095648019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f7c09dec0 0x7f5f7c06b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:24.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.339+0000 7f5f808d1700 1 -- 172.21.15.156:0/1095648019 >> 172.21.15.156:0/1095648019 conn(0x7f5f7c099c40 msgr2=0x7f5f7c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:24.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.339+0000 7f5f808d1700 1 -- 172.21.15.156:0/1095648019 shutdown_connections 2023-09-30T22:21:24.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.339+0000 7f5f808d1700 1 -- 172.21.15.156:0/1095648019 wait complete. 2023-09-30T22:21:24.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.340+0000 7f5f808d1700 1 Processor -- start 2023-09-30T22:21:24.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.340+0000 7f5f808d1700 1 -- start start 2023-09-30T22:21:24.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.341+0000 7f5f808d1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f7c06a770 0x7f5f7c119f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:24.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.341+0000 7f5f808d1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f7c09dec0 0x7f5f7c11a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:24.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.341+0000 7f5f808d1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f7c131a00 0x7f5f7c11a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:24.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.341+0000 7f5f808d1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c11b3f0 con 0x7f5f7c131a00 2023-09-30T22:21:24.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.341+0000 7f5f808d1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c11bb20 con 0x7f5f7c09dec0 2023-09-30T22:21:24.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.341+0000 7f5f808d1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c11c140 con 0x7f5f7c06a770 2023-09-30T22:21:24.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.341+0000 7f5f7a59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f7c06a770 0x7f5f7c119f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:24.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.341+0000 7f5f79d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f7c09dec0 0x7f5f7c11a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:24.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.341+0000 7f5f7a59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f7c06a770 0x7f5f7c119f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:60028/0 (socket says 172.21.15.156:60028) 2023-09-30T22:21:24.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.341+0000 7f5f7a59c700 1 -- 172.21.15.156:0/1879505520 learned_addr learned my addr 172.21.15.156:0/1879505520 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:24.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.341+0000 7f5f7ad9d700 1 --2- 172.21.15.156:0/1879505520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f7c131a00 0x7f5f7c11a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:24.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.341+0000 7f5f79d9b700 1 -- 172.21.15.156:0/1879505520 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f7c06a770 msgr2=0x7f5f7c119f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:24.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.341+0000 7f5f79d9b700 1 --2- 172.21.15.156:0/1879505520 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f7c06a770 0x7f5f7c119f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:24.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.341+0000 7f5f79d9b700 1 -- 172.21.15.156:0/1879505520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f7c131a00 msgr2=0x7f5f7c11a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:24.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.341+0000 7f5f79d9b700 1 --2- 172.21.15.156:0/1879505520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f7c131a00 0x7f5f7c11a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:24.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.341+0000 7f5f79d9b700 1 -- 172.21.15.156:0/1879505520 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f70009550 con 0x7f5f7c09dec0 2023-09-30T22:21:24.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.341+0000 7f5f7a59c700 1 --2- 172.21.15.156:0/1879505520 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f7c06a770 0x7f5f7c119f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:24.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.342+0000 7f5f79d9b700 1 --2- 172.21.15.156:0/1879505520 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f7c09dec0 0x7f5f7c11a4a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00ea10 tx=0x7f5f6c00ed20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:24.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.342+0000 7f5f6affd700 1 -- 172.21.15.156:0/1879505520 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c00eeb0 con 0x7f5f7c09dec0 2023-09-30T22:21:24.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.342+0000 7f5f6affd700 1 -- 172.21.15.156:0/1879505520 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6c00c850 con 0x7f5f7c09dec0 2023-09-30T22:21:24.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.342+0000 7f5f808d1700 1 -- 172.21.15.156:0/1879505520 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f6c0094a0 con 0x7f5f7c09dec0 2023-09-30T22:21:24.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.342+0000 7f5f6affd700 1 -- 172.21.15.156:0/1879505520 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c00cc00 con 0x7f5f7c09dec0 2023-09-30T22:21:24.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.342+0000 7f5f808d1700 1 -- 172.21.15.156:0/1879505520 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f74009a70 con 0x7f5f7c09dec0 2023-09-30T22:21:24.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.342+0000 7f5f6affd700 1 -- 172.21.15.156:0/1879505520 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f6c00cd60 con 0x7f5f7c09dec0 2023-09-30T22:21:24.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.343+0000 7f5f6affd700 1 -- 172.21.15.156:0/1879505520 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5f6c03f740 con 0x7f5f7c09dec0 2023-09-30T22:21:24.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.343+0000 7f5f808d1700 1 -- 172.21.15.156:0/1879505520 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f7c071ce0 con 0x7f5f7c09dec0 2023-09-30T22:21:24.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.347+0000 7f5f6affd700 1 -- 172.21.15.156:0/1879505520 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f6c0232f0 con 0x7f5f7c09dec0 2023-09-30T22:21:24.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.531+0000 7f5f808d1700 1 -- 172.21.15.156:0/1879505520 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5f7c04f2a0 con 0x7f5f7c09dec0 2023-09-30T22:21:24.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.531+0000 7f5f6affd700 1 -- 172.21.15.156:0/1879505520 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f6c01bb60 con 0x7f5f7c09dec0 2023-09-30T22:21:24.532 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:24.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.533+0000 7f5f808d1700 1 -- 172.21.15.156:0/1879505520 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f7c09dec0 msgr2=0x7f5f7c11a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:24.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.533+0000 7f5f808d1700 1 --2- 172.21.15.156:0/1879505520 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f7c09dec0 0x7f5f7c11a4a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00ea10 tx=0x7f5f6c00ed20 comp rx=0 tx=0).stop 2023-09-30T22:21:24.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.533+0000 7f5f808d1700 1 -- 172.21.15.156:0/1879505520 shutdown_connections 2023-09-30T22:21:24.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.533+0000 7f5f808d1700 1 --2- 172.21.15.156:0/1879505520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f7c131a00 0x7f5f7c11a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:24.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.533+0000 7f5f808d1700 1 --2- 172.21.15.156:0/1879505520 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f7c06a770 0x7f5f7c119f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:24.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.533+0000 7f5f808d1700 1 --2- 172.21.15.156:0/1879505520 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f7c09dec0 0x7f5f7c11a4a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:24.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.533+0000 7f5f808d1700 1 -- 172.21.15.156:0/1879505520 >> 172.21.15.156:0/1879505520 conn(0x7f5f7c099c40 msgr2=0x7f5f7c12eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:24.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.533+0000 7f5f808d1700 1 -- 172.21.15.156:0/1879505520 shutdown_connections 2023-09-30T22:21:24.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.533+0000 7f5f808d1700 1 -- 172.21.15.156:0/1879505520 wait complete. 2023-09-30T22:21:24.547 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:24.677 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:24.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.800+0000 7f49dd734700 1 Processor -- start 2023-09-30T22:21:24.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.800+0000 7f49dd734700 1 -- start start 2023-09-30T22:21:24.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.801+0000 7f49dd734700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49d809f350 0x7f49d8138f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:24.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.801+0000 7f49dd734700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f49d8139480 0x7f49d813b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:24.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.801+0000 7f49dd734700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d806bec0 con 0x7f49d809e870 2023-09-30T22:21:24.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.801+0000 7f49dd734700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d806ce60 con 0x7f49d8139480 2023-09-30T22:21:24.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.801+0000 7f49dd734700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49d809f740 con 0x7f49d809f350 2023-09-30T22:21:24.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.801+0000 7f49d77fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f49d8139480 0x7f49d813b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:24.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.801+0000 7f49d67fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49d809f350 0x7f49d8138f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:24.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.801+0000 7f49d77fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f49d8139480 0x7f49d813b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48862/0 (socket says 172.21.15.156:48862) 2023-09-30T22:21:24.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.801+0000 7f49d6ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f49d809e870 0x7f49d809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:39940/0 (socket says 172.21.15.156:39940) 2023-09-30T22:21:24.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.801+0000 7f49d67fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49d809f350 0x7f49d8138f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:60040/0 (socket says 172.21.15.156:60040) 2023-09-30T22:21:24.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.801+0000 7f49d77fe700 1 -- 172.21.15.156:0/1033453008 learned_addr learned my addr 172.21.15.156:0/1033453008 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:24.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.801+0000 7f49d67fc700 1 -- 172.21.15.156:0/1033453008 >> v2:172.21.15.156:3300/0 conn(0x7f49d8139480 msgr2=0x7f49d813b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:24.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.801+0000 7f49d67fc700 1 --2- 172.21.15.156:0/1033453008 >> v2:172.21.15.156:3300/0 conn(0x7f49d8139480 0x7f49d813b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:24.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.801+0000 7f49d67fc700 1 -- 172.21.15.156:0/1033453008 >> v1:172.21.15.156:6789/0 conn(0x7f49d809e870 legacy=0x7f49d809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:24.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.801+0000 7f49d67fc700 1 -- 172.21.15.156:0/1033453008 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d809fa00 con 0x7f49d809f350 2023-09-30T22:21:24.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.801+0000 7f49d5ffb700 1 -- 172.21.15.156:0/1033453008 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138075940 0 0) 0x7f49d806bec0 con 0x7f49d809e870 2023-09-30T22:21:24.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.801+0000 7f49d77fe700 1 --2- 172.21.15.156:0/1033453008 >> v2:172.21.15.156:3300/0 conn(0x7f49d8139480 0x7f49d813b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:24.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.801+0000 7f49d67fc700 1 --2- 172.21.15.156:0/1033453008 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49d809f350 0x7f49d8138f40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f49c8009870 tx=0x7f49c8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25f970cb1ed325ee server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:24.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.802+0000 7f49d5ffb700 1 -- 172.21.15.156:0/1033453008 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c8011830 con 0x7f49d809f350 2023-09-30T22:21:24.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.802+0000 7f49d5ffb700 1 -- 172.21.15.156:0/1033453008 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c8011990 con 0x7f49d809f350 2023-09-30T22:21:24.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.802+0000 7f49d5ffb700 1 -- 172.21.15.156:0/1033453008 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c8011d20 con 0x7f49d809f350 2023-09-30T22:21:24.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.802+0000 7f49dd734700 1 -- 172.21.15.156:0/1033453008 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49d809f350 msgr2=0x7f49d8138f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:24.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.802+0000 7f49dd734700 1 --2- 172.21.15.156:0/1033453008 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49d809f350 0x7f49d8138f40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f49c8009870 tx=0x7f49c8009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:24.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.802+0000 7f49dd734700 1 -- 172.21.15.156:0/1033453008 shutdown_connections 2023-09-30T22:21:24.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.802+0000 7f49dd734700 1 --2- 172.21.15.156:0/1033453008 >> v2:172.21.15.156:3300/0 conn(0x7f49d8139480 0x7f49d813b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:24.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.802+0000 7f49dd734700 1 --2- 172.21.15.156:0/1033453008 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49d809f350 0x7f49d8138f40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:24.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.802+0000 7f49dd734700 1 -- 172.21.15.156:0/1033453008 >> 172.21.15.156:0/1033453008 conn(0x7f49d80a4430 msgr2=0x7f49d80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:24.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.802+0000 7f49dd734700 1 -- 172.21.15.156:0/1033453008 shutdown_connections 2023-09-30T22:21:24.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.802+0000 7f49dd734700 1 -- 172.21.15.156:0/1033453008 wait complete. 2023-09-30T22:21:24.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.803+0000 7f49dd734700 1 Processor -- start 2023-09-30T22:21:24.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.803+0000 7f49dd734700 1 -- start start 2023-09-30T22:21:24.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.804+0000 7f49dd734700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49d809e870 0x7f49d8133a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:24.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.804+0000 7f49dd734700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49d809f350 0x7f49d8133fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:24.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.804+0000 7f49dd734700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49d8139480 0x7f49d811edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:24.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.804+0000 7f49dd734700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d8120270 con 0x7f49d8139480 2023-09-30T22:21:24.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.804+0000 7f49dd734700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d809b160 con 0x7f49d809e870 2023-09-30T22:21:24.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.804+0000 7f49dd734700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49d806cfa0 con 0x7f49d809f350 2023-09-30T22:21:24.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.804+0000 7f49d6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49d809e870 0x7f49d8133a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:24.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.804+0000 7f49d77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49d8139480 0x7f49d811edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:24.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.804+0000 7f49d67fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49d809f350 0x7f49d8133fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:24.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.804+0000 7f49d6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49d809e870 0x7f49d8133a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38720/0 (socket says 172.21.15.156:38720) 2023-09-30T22:21:24.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.804+0000 7f49d77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49d8139480 0x7f49d811edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48872/0 (socket says 172.21.15.156:48872) 2023-09-30T22:21:24.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.804+0000 7f49d6ffd700 1 -- 172.21.15.156:0/1132181369 learned_addr learned my addr 172.21.15.156:0/1132181369 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:24.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.804+0000 7f49d67fc700 1 -- 172.21.15.156:0/1132181369 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49d809e870 msgr2=0x7f49d8133a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:24.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.804+0000 7f49d67fc700 1 --2- 172.21.15.156:0/1132181369 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49d809e870 0x7f49d8133a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:24.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.804+0000 7f49d67fc700 1 -- 172.21.15.156:0/1132181369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49d8139480 msgr2=0x7f49d811edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:24.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.804+0000 7f49d67fc700 1 --2- 172.21.15.156:0/1132181369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49d8139480 0x7f49d811edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:24.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.804+0000 7f49d67fc700 1 -- 172.21.15.156:0/1132181369 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d0009b30 con 0x7f49d809f350 2023-09-30T22:21:24.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.804+0000 7f49d77fe700 1 --2- 172.21.15.156:0/1132181369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49d8139480 0x7f49d811edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:24.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.804+0000 7f49d6ffd700 1 --2- 172.21.15.156:0/1132181369 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49d809e870 0x7f49d8133a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:24.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.804+0000 7f49d67fc700 1 --2- 172.21.15.156:0/1132181369 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49d809f350 0x7f49d8133fd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f49c8016000 tx=0x7f49c8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:24.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.804+0000 7f49bf7fe700 1 -- 172.21.15.156:0/1132181369 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c80036a0 con 0x7f49d809f350 2023-09-30T22:21:24.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.805+0000 7f49bf7fe700 1 -- 172.21.15.156:0/1132181369 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c801f070 con 0x7f49d809f350 2023-09-30T22:21:24.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.805+0000 7f49dd734700 1 -- 172.21.15.156:0/1132181369 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c80094a0 con 0x7f49d809f350 2023-09-30T22:21:24.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.805+0000 7f49bf7fe700 1 -- 172.21.15.156:0/1132181369 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c8003a40 con 0x7f49d809f350 2023-09-30T22:21:24.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.805+0000 7f49dd734700 1 -- 172.21.15.156:0/1132181369 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d81224e0 con 0x7f49d809f350 2023-09-30T22:21:24.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.806+0000 7f49dd734700 1 -- 172.21.15.156:0/1132181369 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d8122340 con 0x7f49d809f350 2023-09-30T22:21:24.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.806+0000 7f49bf7fe700 1 -- 172.21.15.156:0/1132181369 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f49c8003ba0 con 0x7f49d809f350 2023-09-30T22:21:24.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.806+0000 7f49bf7fe700 1 -- 172.21.15.156:0/1132181369 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f49c8021070 con 0x7f49d809f350 2023-09-30T22:21:24.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.810+0000 7f49bf7fe700 1 -- 172.21.15.156:0/1132181369 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f49c802f580 con 0x7f49d809f350 2023-09-30T22:21:24.854 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:24.855 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:24.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.979+0000 7ff343a2f700 1 Processor -- start 2023-09-30T22:21:24.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.980+0000 7ff343a2f700 1 -- start start 2023-09-30T22:21:24.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.980+0000 7fdf6056b700 1 Processor -- start 2023-09-30T22:21:24.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.980+0000 7fdf6056b700 1 -- start start 2023-09-30T22:21:24.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.980+0000 7ff343a2f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff33c09bd20 0x7ff33c09c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:24.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.980+0000 7ff343a2f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff33c1337d0 0x7ff33c133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:24.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.980+0000 7ff343a2f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff33c09a8e0 con 0x7ff33c134160 2023-09-30T22:21:24.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.980+0000 7ff343a2f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33c09ad30 con 0x7ff33c1337d0 2023-09-30T22:21:24.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.980+0000 7ff343a2f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c09a620 con 0x7ff33c09bd20 2023-09-30T22:21:24.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.980+0000 7ff341fcc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff33c134160 0x7ff33c13ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:39956/0 (socket says 172.21.15.156:39956) 2023-09-30T22:21:24.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.980+0000 7ff341fcc700 1 -- 172.21.15.156:0/26716741 learned_addr learned my addr 172.21.15.156:0/26716741 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:24.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.980+0000 7ff3417cb700 1 --2- 172.21.15.156:0/26716741 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff33c09bd20 0x7ff33c09c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:24.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.980+0000 7ff340fca700 1 --2- 172.21.15.156:0/26716741 >> v2:172.21.15.156:3300/0 conn(0x7ff33c1337d0 0x7ff33c133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:24.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.981+0000 7fdf6056b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdf580a0a30 0x7fdf580a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:24.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.981+0000 7fdf6056b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdf58130670 0x7fdf581381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:24.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.981+0000 7ff3417cb700 1 -- 172.21.15.156:0/26716741 >> v2:172.21.15.156:3300/0 conn(0x7ff33c1337d0 msgr2=0x7ff33c133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:24.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.981+0000 7ff3417cb700 1 --2- 172.21.15.156:0/26716741 >> v2:172.21.15.156:3300/0 conn(0x7ff33c1337d0 0x7ff33c133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:24.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.981+0000 7ff3417cb700 1 -- 172.21.15.156:0/26716741 >> v1:172.21.15.156:6789/0 conn(0x7ff33c134160 legacy=0x7ff33c13ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:24.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.981+0000 7ff333fff700 1 -- 172.21.15.156:0/26716741 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214483151 0 0) 0x7ff33c09a8e0 con 0x7ff33c134160 2023-09-30T22:21:24.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.981+0000 7ff3417cb700 1 -- 172.21.15.156:0/26716741 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33c09b840 con 0x7ff33c09bd20 2023-09-30T22:21:24.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.981+0000 7fdf6056b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf580a1e70 con 0x7fdf580a1340 2023-09-30T22:21:24.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.981+0000 7fdf6056b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf5809a720 con 0x7fdf58130670 2023-09-30T22:21:24.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.981+0000 7fdf6056b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5809b300 con 0x7fdf580a0a30 2023-09-30T22:21:24.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.981+0000 7fdf5e307700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdf580a0a30 0x7fdf580a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:24.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.981+0000 7fdf5db06700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fdf580a1340 0x7fdf5812ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:39966/0 (socket says 172.21.15.156:39966) 2023-09-30T22:21:24.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.981+0000 7fdf5db06700 1 -- 172.21.15.156:0/4043497088 learned_addr learned my addr 172.21.15.156:0/4043497088 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:24.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.981+0000 7ff340fca700 1 --2- 172.21.15.156:0/26716741 >> v2:172.21.15.156:3300/0 conn(0x7ff33c1337d0 0x7ff33c133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:24.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.981+0000 7ff3417cb700 1 --2- 172.21.15.156:0/26716741 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff33c09bd20 0x7ff33c09c0f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff338009820 tx=0x7ff338009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=928b07b30123349a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:24.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.981+0000 7ff333fff700 1 -- 172.21.15.156:0/26716741 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff338005e30 con 0x7ff33c09bd20 2023-09-30T22:21:24.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.981+0000 7fdf5d305700 1 -- 172.21.15.156:0/4043497088 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2409154588 0 0) 0x7fdf580a1e70 con 0x7fdf580a1340 2023-09-30T22:21:24.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.981+0000 7fdf5eb08700 1 --2- 172.21.15.156:0/4043497088 >> v2:172.21.15.156:3300/0 conn(0x7fdf58130670 0x7fdf581381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:24.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.981+0000 7fdf5d305700 1 -- 172.21.15.156:0/4043497088 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf440035b0 con 0x7fdf580a1340 2023-09-30T22:21:24.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.981+0000 7fdf5e307700 1 -- 172.21.15.156:0/4043497088 >> v2:172.21.15.156:3300/0 conn(0x7fdf58130670 msgr2=0x7fdf581381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:24.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.981+0000 7fdf5e307700 1 --2- 172.21.15.156:0/4043497088 >> v2:172.21.15.156:3300/0 conn(0x7fdf58130670 0x7fdf581381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:24.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.981+0000 7fdf5e307700 1 -- 172.21.15.156:0/4043497088 >> v1:172.21.15.156:6789/0 conn(0x7fdf580a1340 legacy=0x7fdf5812ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:24.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.981+0000 7fdf5e307700 1 -- 172.21.15.156:0/4043497088 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5809abc0 con 0x7fdf580a0a30 2023-09-30T22:21:24.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.982+0000 7ff333fff700 1 -- 172.21.15.156:0/26716741 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff338006030 con 0x7ff33c09bd20 2023-09-30T22:21:24.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.982+0000 7ff333fff700 1 -- 172.21.15.156:0/26716741 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3380063c0 con 0x7ff33c09bd20 2023-09-30T22:21:24.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.982+0000 7ff343a2f700 1 -- 172.21.15.156:0/26716741 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff33c09bd20 msgr2=0x7ff33c09c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:24.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.982+0000 7ff343a2f700 1 --2- 172.21.15.156:0/26716741 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff33c09bd20 0x7ff33c09c0f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff338009820 tx=0x7ff338009b30 comp rx=0 tx=0).stop 2023-09-30T22:21:24.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.982+0000 7fdf5e307700 1 --2- 172.21.15.156:0/4043497088 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdf580a0a30 0x7fdf580a0e00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fdf54009820 tx=0x7fdf54009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ceb6651a1678ec0a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:24.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.982+0000 7ff343a2f700 1 -- 172.21.15.156:0/26716741 shutdown_connections 2023-09-30T22:21:24.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.982+0000 7ff343a2f700 1 --2- 172.21.15.156:0/26716741 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff33c09bd20 0x7ff33c09c0f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:24.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.982+0000 7ff343a2f700 1 --2- 172.21.15.156:0/26716741 >> v2:172.21.15.156:3300/0 conn(0x7ff33c1337d0 0x7ff33c133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:24.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.982+0000 7ff343a2f700 1 -- 172.21.15.156:0/26716741 >> 172.21.15.156:0/26716741 conn(0x7ff33c09f9f0 msgr2=0x7ff33c09fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:24.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.982+0000 7fdf5d305700 1 -- 172.21.15.156:0/4043497088 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf54005e30 con 0x7fdf580a0a30 2023-09-30T22:21:24.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.982+0000 7ff343a2f700 1 -- 172.21.15.156:0/26716741 shutdown_connections 2023-09-30T22:21:24.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.982+0000 7fdf5d305700 1 -- 172.21.15.156:0/4043497088 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf54006030 con 0x7fdf580a0a30 2023-09-30T22:21:24.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.982+0000 7fdf5d305700 1 -- 172.21.15.156:0/4043497088 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf540063c0 con 0x7fdf580a0a30 2023-09-30T22:21:24.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.982+0000 7ff343a2f700 1 -- 172.21.15.156:0/26716741 wait complete. 2023-09-30T22:21:24.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.983+0000 7fdf6056b700 1 -- 172.21.15.156:0/4043497088 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdf580a0a30 msgr2=0x7fdf580a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:24.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.983+0000 7fdf6056b700 1 --2- 172.21.15.156:0/4043497088 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdf580a0a30 0x7fdf580a0e00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fdf54009820 tx=0x7fdf54009b30 comp rx=0 tx=0).stop 2023-09-30T22:21:24.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.983+0000 7fdf6056b700 1 -- 172.21.15.156:0/4043497088 shutdown_connections 2023-09-30T22:21:24.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.983+0000 7fdf6056b700 1 --2- 172.21.15.156:0/4043497088 >> v2:172.21.15.156:3300/0 conn(0x7fdf58130670 0x7fdf581381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:24.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.983+0000 7fdf6056b700 1 --2- 172.21.15.156:0/4043497088 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdf580a0a30 0x7fdf580a0e00 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:24.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.983+0000 7fdf6056b700 1 -- 172.21.15.156:0/4043497088 >> 172.21.15.156:0/4043497088 conn(0x7fdf580a2980 msgr2=0x7fdf580a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:24.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.983+0000 7fdf6056b700 1 -- 172.21.15.156:0/4043497088 shutdown_connections 2023-09-30T22:21:24.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.983+0000 7fdf6056b700 1 -- 172.21.15.156:0/4043497088 wait complete. 2023-09-30T22:21:24.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.984+0000 7ff343a2f700 1 Processor -- start 2023-09-30T22:21:24.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.984+0000 7ff343a2f700 1 -- start start 2023-09-30T22:21:24.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.984+0000 7ff343a2f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff33c09bd20 0x7ff33c11df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:24.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.984+0000 7ff343a2f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff33c1337d0 0x7ff33c11e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:24.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.984+0000 7ff343a2f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff33c134160 0x7ff33c11e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:24.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.984+0000 7ff343a2f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c11f3c0 con 0x7ff33c1337d0 2023-09-30T22:21:24.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.984+0000 7ff343a2f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c11fb20 con 0x7ff33c134160 2023-09-30T22:21:24.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.984+0000 7ff343a2f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c120140 con 0x7ff33c09bd20 2023-09-30T22:21:24.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.984+0000 7ff341fcc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff33c134160 0x7ff33c11e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:24.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.984+0000 7ff3417cb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff33c09bd20 0x7ff33c11df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:24.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.984+0000 7ff3417cb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff33c09bd20 0x7ff33c11df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:60072/0 (socket says 172.21.15.156:60072) 2023-09-30T22:21:24.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.984+0000 7ff3417cb700 1 -- 172.21.15.156:0/386752380 learned_addr learned my addr 172.21.15.156:0/386752380 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:24.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.984+0000 7ff341fcc700 1 --2- 172.21.15.156:0/386752380 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff33c134160 0x7ff33c11e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38748/0 (socket says 172.21.15.156:38748) 2023-09-30T22:21:24.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.984+0000 7ff340fca700 1 --2- 172.21.15.156:0/386752380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff33c1337d0 0x7ff33c11e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:24.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.984+0000 7fdf6056b700 1 Processor -- start 2023-09-30T22:21:24.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.985+0000 7ff3417cb700 1 -- 172.21.15.156:0/386752380 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff33c134160 msgr2=0x7ff33c11e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:24.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.985+0000 7ff3417cb700 1 --2- 172.21.15.156:0/386752380 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff33c134160 0x7ff33c11e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:24.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.985+0000 7ff3417cb700 1 -- 172.21.15.156:0/386752380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff33c1337d0 msgr2=0x7ff33c11e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:24.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.985+0000 7ff3417cb700 1 --2- 172.21.15.156:0/386752380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff33c1337d0 0x7ff33c11e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:24.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.985+0000 7ff3417cb700 1 -- 172.21.15.156:0/386752380 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32c0094a0 con 0x7ff33c09bd20 2023-09-30T22:21:24.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.985+0000 7ff341fcc700 1 --2- 172.21.15.156:0/386752380 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff33c134160 0x7ff33c11e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:24.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.985+0000 7ff3417cb700 1 --2- 172.21.15.156:0/386752380 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff33c09bd20 0x7ff33c11df10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff338009b70 tx=0x7ff338004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:24.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.985+0000 7ff331ffb700 1 -- 172.21.15.156:0/386752380 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff338004040 con 0x7ff33c09bd20 2023-09-30T22:21:24.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.985+0000 7ff331ffb700 1 -- 172.21.15.156:0/386752380 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3380041a0 con 0x7ff33c09bd20 2023-09-30T22:21:24.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.985+0000 7ff343a2f700 1 -- 172.21.15.156:0/386752380 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff338009430 con 0x7ff33c09bd20 2023-09-30T22:21:24.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.985+0000 7ff331ffb700 1 -- 172.21.15.156:0/386752380 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff338004550 con 0x7ff33c09bd20 2023-09-30T22:21:24.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.985+0000 7fdf6056b700 1 -- start start 2023-09-30T22:21:24.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.985+0000 7ff343a2f700 1 -- 172.21.15.156:0/386752380 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff33c0a22d0 con 0x7ff33c09bd20 2023-09-30T22:21:25.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.986+0000 7fdf6056b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf580a0a30 0x7fdf5813a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:25.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.986+0000 7fdf6056b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdf580a1340 0x7fdf5813a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:25.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.986+0000 7fdf6056b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdf58130670 0x7fdf5813ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:25.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.986+0000 7fdf6056b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5813b5c0 con 0x7fdf580a0a30 2023-09-30T22:21:25.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.986+0000 7fdf6056b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5811a9f0 con 0x7fdf580a1340 2023-09-30T22:21:25.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.986+0000 7fdf6056b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf58119580 con 0x7fdf58130670 2023-09-30T22:21:25.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.986+0000 7fdf5e307700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf580a0a30 0x7fdf5813a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:25.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.986+0000 7fdf5e307700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf580a0a30 0x7fdf5813a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48896/0 (socket says 172.21.15.156:48896) 2023-09-30T22:21:25.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.986+0000 7fdf5e307700 1 -- 172.21.15.156:0/1944878784 learned_addr learned my addr 172.21.15.156:0/1944878784 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:25.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.986+0000 7fdf5eb08700 1 --2- 172.21.15.156:0/1944878784 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdf58130670 0x7fdf5813ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:25.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.986+0000 7ff331ffb700 1 -- 172.21.15.156:0/386752380 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff338022070 con 0x7ff33c09bd20 2023-09-30T22:21:25.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.986+0000 7fdf5e307700 1 -- 172.21.15.156:0/1944878784 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdf58130670 msgr2=0x7fdf5813ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:25.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.986+0000 7fdf5e307700 1 --2- 172.21.15.156:0/1944878784 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdf58130670 0x7fdf5813ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:25.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.986+0000 7fdf5e307700 1 -- 172.21.15.156:0/1944878784 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdf580a1340 msgr2=0x7fdf5813a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:25.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.986+0000 7fdf5e307700 1 --2- 172.21.15.156:0/1944878784 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdf580a1340 0x7fdf5813a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:25.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.986+0000 7fdf5e307700 1 -- 172.21.15.156:0/1944878784 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf54009430 con 0x7fdf580a0a30 2023-09-30T22:21:25.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.986+0000 7ff331ffb700 1 -- 172.21.15.156:0/386752380 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff338040d70 con 0x7ff33c09bd20 2023-09-30T22:21:25.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.986+0000 7fdf5e307700 1 --2- 172.21.15.156:0/1944878784 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf580a0a30 0x7fdf5813a0f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fdf54009e80 tx=0x7fdf54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:25.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.986+0000 7fdf4effd700 1 -- 172.21.15.156:0/1944878784 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf540061a0 con 0x7fdf580a0a30 2023-09-30T22:21:25.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.987+0000 7fdf4effd700 1 -- 172.21.15.156:0/1944878784 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf54020070 con 0x7fdf580a0a30 2023-09-30T22:21:25.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.987+0000 7fdf6056b700 1 -- 172.21.15.156:0/1944878784 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf58119dc0 con 0x7fdf580a0a30 2023-09-30T22:21:25.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.987+0000 7fdf4effd700 1 -- 172.21.15.156:0/1944878784 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf54006520 con 0x7fdf580a0a30 2023-09-30T22:21:25.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.987+0000 7fdf6056b700 1 -- 172.21.15.156:0/1944878784 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf5809ae00 con 0x7fdf580a0a30 2023-09-30T22:21:25.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.987+0000 7ff343a2f700 1 -- 172.21.15.156:0/386752380 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff33c11ad60 con 0x7ff33c09bd20 2023-09-30T22:21:25.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.987+0000 7fdf4effd700 1 -- 172.21.15.156:0/1944878784 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdf54022030 con 0x7fdf580a0a30 2023-09-30T22:21:25.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.988+0000 7fdf6056b700 1 -- 172.21.15.156:0/1944878784 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf5811a570 con 0x7fdf580a0a30 2023-09-30T22:21:25.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.988+0000 7fdf4effd700 1 -- 172.21.15.156:0/1944878784 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdf54040c00 con 0x7fdf580a0a30 2023-09-30T22:21:25.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.992+0000 7ff331ffb700 1 -- 172.21.15.156:0/386752380 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff33802e9a0 con 0x7ff33c09bd20 2023-09-30T22:21:25.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:24.997+0000 7fdf4effd700 1 -- 172.21.15.156:0/1944878784 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdf5811a570 con 0x7fdf580a0a30 2023-09-30T22:21:25.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.012+0000 7f49dd734700 1 -- 172.21.15.156:0/1132181369 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f49d8122340 con 0x7f49d809f350 2023-09-30T22:21:25.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.012+0000 7f49bf7fe700 1 -- 172.21.15.156:0/1132181369 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f49d8122340 con 0x7f49d809f350 2023-09-30T22:21:25.012 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:25.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.014+0000 7f49dd734700 1 -- 172.21.15.156:0/1132181369 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49d809f350 msgr2=0x7f49d8133fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:25.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.014+0000 7f49dd734700 1 --2- 172.21.15.156:0/1132181369 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49d809f350 0x7f49d8133fd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f49c8016000 tx=0x7f49c8004750 comp rx=0 tx=0).stop 2023-09-30T22:21:25.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.014+0000 7f49dd734700 1 -- 172.21.15.156:0/1132181369 shutdown_connections 2023-09-30T22:21:25.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.014+0000 7f49dd734700 1 --2- 172.21.15.156:0/1132181369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49d8139480 0x7f49d811edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:25.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.014+0000 7f49dd734700 1 --2- 172.21.15.156:0/1132181369 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49d809e870 0x7f49d8133a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:25.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.014+0000 7f49dd734700 1 --2- 172.21.15.156:0/1132181369 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49d809f350 0x7f49d8133fd0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:25.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.014+0000 7f49dd734700 1 -- 172.21.15.156:0/1132181369 >> 172.21.15.156:0/1132181369 conn(0x7f49d80a4430 msgr2=0x7f49d81384e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:25.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.014+0000 7f49dd734700 1 -- 172.21.15.156:0/1132181369 shutdown_connections 2023-09-30T22:21:25.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.014+0000 7f49dd734700 1 -- 172.21.15.156:0/1132181369 wait complete. 2023-09-30T22:21:25.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:25.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.189+0000 7ff343a2f700 1 -- 172.21.15.156:0/386752380 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff33c120da0 con 0x7ff33c09bd20 2023-09-30T22:21:25.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.189+0000 7ff331ffb700 1 -- 172.21.15.156:0/386752380 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff33802e770 con 0x7ff33c09bd20 2023-09-30T22:21:25.190 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:25.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.190+0000 7fdf6056b700 1 -- 172.21.15.156:0/1944878784 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdf5811a570 con 0x7fdf580a0a30 2023-09-30T22:21:25.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.190+0000 7fdf4effd700 1 -- 172.21.15.156:0/1944878784 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdf5811a570 con 0x7fdf580a0a30 2023-09-30T22:21:25.191 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:25.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.192+0000 7ff343a2f700 1 -- 172.21.15.156:0/386752380 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff33c09bd20 msgr2=0x7ff33c11df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:25.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.192+0000 7ff343a2f700 1 --2- 172.21.15.156:0/386752380 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff33c09bd20 0x7ff33c11df10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff338009b70 tx=0x7ff338004750 comp rx=0 tx=0).stop 2023-09-30T22:21:25.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.192+0000 7ff343a2f700 1 -- 172.21.15.156:0/386752380 shutdown_connections 2023-09-30T22:21:25.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.192+0000 7ff343a2f700 1 --2- 172.21.15.156:0/386752380 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff33c134160 0x7ff33c11e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:25.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.192+0000 7ff343a2f700 1 --2- 172.21.15.156:0/386752380 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff33c09bd20 0x7ff33c11df10 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:25.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.192+0000 7ff343a2f700 1 --2- 172.21.15.156:0/386752380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff33c1337d0 0x7ff33c11e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:25.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.192+0000 7ff343a2f700 1 -- 172.21.15.156:0/386752380 >> 172.21.15.156:0/386752380 conn(0x7ff33c09f9f0 msgr2=0x7ff33c132eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:25.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.192+0000 7ff343a2f700 1 -- 172.21.15.156:0/386752380 shutdown_connections 2023-09-30T22:21:25.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.192+0000 7ff343a2f700 1 -- 172.21.15.156:0/386752380 wait complete. 2023-09-30T22:21:25.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.193+0000 7fdf6056b700 1 -- 172.21.15.156:0/1944878784 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf580a0a30 msgr2=0x7fdf5813a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:25.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.193+0000 7fdf6056b700 1 --2- 172.21.15.156:0/1944878784 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf580a0a30 0x7fdf5813a0f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fdf54009e80 tx=0x7fdf54004750 comp rx=0 tx=0).stop 2023-09-30T22:21:25.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.193+0000 7fdf6056b700 1 -- 172.21.15.156:0/1944878784 shutdown_connections 2023-09-30T22:21:25.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.193+0000 7fdf6056b700 1 --2- 172.21.15.156:0/1944878784 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdf58130670 0x7fdf5813ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:25.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.193+0000 7fdf6056b700 1 --2- 172.21.15.156:0/1944878784 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf580a0a30 0x7fdf5813a0f0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:25.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.193+0000 7fdf6056b700 1 --2- 172.21.15.156:0/1944878784 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdf580a1340 0x7fdf5813a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:25.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.193+0000 7fdf6056b700 1 -- 172.21.15.156:0/1944878784 >> 172.21.15.156:0/1944878784 conn(0x7fdf580a2980 msgr2=0x7fdf5809deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:25.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.193+0000 7fdf6056b700 1 -- 172.21.15.156:0/1944878784 shutdown_connections 2023-09-30T22:21:25.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.193+0000 7fdf6056b700 1 -- 172.21.15.156:0/1944878784 wait complete. 2023-09-30T22:21:25.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:25.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:25.548 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:25.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.670+0000 7f4774763700 1 Processor -- start 2023-09-30T22:21:25.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.670+0000 7f4774763700 1 -- start start 2023-09-30T22:21:25.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.671+0000 7f4774763700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f476c133ad0 0x7f476c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:25.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.671+0000 7f4774763700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f476c130bc0 0x7f476c13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:25.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.671+0000 7f4774763700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f476c06b2d0 con 0x7f476c1300a0 2023-09-30T22:21:25.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.671+0000 7f4774763700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f476c133610 con 0x7f476c133ad0 2023-09-30T22:21:25.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.671+0000 7f4774763700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f476c09a500 con 0x7f476c130bc0 2023-09-30T22:21:25.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.671+0000 7f4772d00700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f476c130bc0 0x7f476c13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:25.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.671+0000 7f47724ff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f476c133ad0 0x7f476c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:25.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.671+0000 7f47724ff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f476c133ad0 0x7f476c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48902/0 (socket says 172.21.15.156:48902) 2023-09-30T22:21:25.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.671+0000 7f4771cfe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f476c1300a0 0x7f476c1304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:39980/0 (socket says 172.21.15.156:39980) 2023-09-30T22:21:25.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.671+0000 7f4772d00700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f476c130bc0 0x7f476c13b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:60088/0 (socket says 172.21.15.156:60088) 2023-09-30T22:21:25.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.671+0000 7f4771cfe700 1 -- 172.21.15.156:0/3334393422 learned_addr learned my addr 172.21.15.156:0/3334393422 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:25.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.671+0000 7f47724ff700 1 -- 172.21.15.156:0/3334393422 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f476c130bc0 msgr2=0x7f476c13b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:25.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.671+0000 7f47724ff700 1 --2- 172.21.15.156:0/3334393422 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f476c130bc0 0x7f476c13b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:25.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.671+0000 7f47724ff700 1 -- 172.21.15.156:0/3334393422 >> v1:172.21.15.156:6789/0 conn(0x7f476c1300a0 legacy=0x7f476c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:25.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.671+0000 7f47724ff700 1 -- 172.21.15.156:0/3334393422 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476c1338b0 con 0x7f476c133ad0 2023-09-30T22:21:25.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.671+0000 7f47714fd700 1 -- 172.21.15.156:0/3334393422 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3944323752 0 0) 0x7f476c06b2d0 con 0x7f476c1300a0 2023-09-30T22:21:25.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.671+0000 7f4772d00700 1 --2- 172.21.15.156:0/3334393422 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f476c130bc0 0x7f476c13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:25.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.671+0000 7f47724ff700 1 --2- 172.21.15.156:0/3334393422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f476c133ad0 0x7f476c133ea0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f475c009840 tx=0x7f475c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1497d847ac376 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:25.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.672+0000 7f47714fd700 1 -- 172.21.15.156:0/3334393422 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c011830 con 0x7f476c133ad0 2023-09-30T22:21:25.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.672+0000 7f47714fd700 1 -- 172.21.15.156:0/3334393422 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475c011990 con 0x7f476c133ad0 2023-09-30T22:21:25.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.672+0000 7f47714fd700 1 -- 172.21.15.156:0/3334393422 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c011d20 con 0x7f476c133ad0 2023-09-30T22:21:25.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.672+0000 7f4774763700 1 -- 172.21.15.156:0/3334393422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f476c133ad0 msgr2=0x7f476c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:25.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.672+0000 7f4774763700 1 --2- 172.21.15.156:0/3334393422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f476c133ad0 0x7f476c133ea0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f475c009840 tx=0x7f475c009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:25.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.672+0000 7f4774763700 1 -- 172.21.15.156:0/3334393422 shutdown_connections 2023-09-30T22:21:25.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.672+0000 7f4774763700 1 --2- 172.21.15.156:0/3334393422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f476c133ad0 0x7f476c133ea0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:25.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.672+0000 7f4774763700 1 --2- 172.21.15.156:0/3334393422 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f476c130bc0 0x7f476c13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:25.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.672+0000 7f4774763700 1 -- 172.21.15.156:0/3334393422 >> 172.21.15.156:0/3334393422 conn(0x7f476c099c40 msgr2=0x7f476c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:25.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.672+0000 7f4774763700 1 -- 172.21.15.156:0/3334393422 shutdown_connections 2023-09-30T22:21:25.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.672+0000 7f4774763700 1 -- 172.21.15.156:0/3334393422 wait complete. 2023-09-30T22:21:25.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.673+0000 7f4774763700 1 Processor -- start 2023-09-30T22:21:25.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.673+0000 7f4774763700 1 -- start start 2023-09-30T22:21:25.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.674+0000 7f4774763700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f476c1300a0 0x7f476c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:25.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.674+0000 7f4774763700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f476c130bc0 0x7f476c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:25.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.674+0000 7f4774763700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f476c133ad0 0x7f476c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:25.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.674+0000 7f4774763700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476c11fd00 con 0x7f476c130bc0 2023-09-30T22:21:25.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.674+0000 7f4774763700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476c12dd00 con 0x7f476c1300a0 2023-09-30T22:21:25.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.674+0000 7f4774763700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f476c0720a0 con 0x7f476c133ad0 2023-09-30T22:21:25.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.674+0000 7f4771cfe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f476c130bc0 0x7f476c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:25.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.674+0000 7f4772d00700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f476c133ad0 0x7f476c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:25.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.674+0000 7f47724ff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f476c1300a0 0x7f476c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:25.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.674+0000 7f4771cfe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f476c130bc0 0x7f476c11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48916/0 (socket says 172.21.15.156:48916) 2023-09-30T22:21:25.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.674+0000 7f4771cfe700 1 -- 172.21.15.156:0/3201989395 learned_addr learned my addr 172.21.15.156:0/3201989395 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:25.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.674+0000 7f4772d00700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f476c133ad0 0x7f476c11e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:60090/0 (socket says 172.21.15.156:60090) 2023-09-30T22:21:25.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.674+0000 7f4771cfe700 1 -- 172.21.15.156:0/3201989395 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f476c133ad0 msgr2=0x7f476c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:25.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.674+0000 7f4771cfe700 1 --2- 172.21.15.156:0/3201989395 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f476c133ad0 0x7f476c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:25.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.674+0000 7f4771cfe700 1 -- 172.21.15.156:0/3201989395 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f476c1300a0 msgr2=0x7f476c11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:25.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.674+0000 7f4771cfe700 1 --2- 172.21.15.156:0/3201989395 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f476c1300a0 0x7f476c11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:25.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.674+0000 7f4771cfe700 1 -- 172.21.15.156:0/3201989395 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4764009a70 con 0x7f476c130bc0 2023-09-30T22:21:25.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.674+0000 7f4772d00700 1 --2- 172.21.15.156:0/3201989395 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f476c133ad0 0x7f476c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:25.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.674+0000 7f4771cfe700 1 --2- 172.21.15.156:0/3201989395 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f476c130bc0 0x7f476c11df80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f476800c550 tx=0x7f476800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:25.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.674+0000 7f4762ffd700 1 -- 172.21.15.156:0/3201989395 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4768004c80 con 0x7f476c130bc0 2023-09-30T22:21:25.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.674+0000 7f4762ffd700 1 -- 172.21.15.156:0/3201989395 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4768004de0 con 0x7f476c130bc0 2023-09-30T22:21:25.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.674+0000 7f4774763700 1 -- 172.21.15.156:0/3201989395 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f475c0094a0 con 0x7f476c130bc0 2023-09-30T22:21:25.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.674+0000 7f4762ffd700 1 -- 172.21.15.156:0/3201989395 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4768007310 con 0x7f476c130bc0 2023-09-30T22:21:25.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.674+0000 7f4774763700 1 -- 172.21.15.156:0/3201989395 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f476c11ffe0 con 0x7f476c130bc0 2023-09-30T22:21:25.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.675+0000 7f4762ffd700 1 -- 172.21.15.156:0/3201989395 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4768007470 con 0x7f476c130bc0 2023-09-30T22:21:25.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.675+0000 7f4762ffd700 1 -- 172.21.15.156:0/3201989395 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f476803f350 con 0x7f476c130bc0 2023-09-30T22:21:25.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.675+0000 7f4774763700 1 -- 172.21.15.156:0/3201989395 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f476c09cb20 con 0x7f476c130bc0 2023-09-30T22:21:25.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.680+0000 7f4762ffd700 1 -- 172.21.15.156:0/3201989395 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f47680123b0 con 0x7f476c130bc0 2023-09-30T22:21:25.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.864+0000 7f4774763700 1 -- 172.21.15.156:0/3201989395 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f476c04f2a0 con 0x7f476c130bc0 2023-09-30T22:21:25.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.864+0000 7f4762ffd700 1 -- 172.21.15.156:0/3201989395 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4768011360 con 0x7f476c130bc0 2023-09-30T22:21:25.865 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:25.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.866+0000 7f4774763700 1 -- 172.21.15.156:0/3201989395 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f476c130bc0 msgr2=0x7f476c11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:25.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.866+0000 7f4774763700 1 --2- 172.21.15.156:0/3201989395 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f476c130bc0 0x7f476c11df80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f476800c550 tx=0x7f476800c860 comp rx=0 tx=0).stop 2023-09-30T22:21:25.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.866+0000 7f4774763700 1 -- 172.21.15.156:0/3201989395 shutdown_connections 2023-09-30T22:21:25.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.866+0000 7f4774763700 1 --2- 172.21.15.156:0/3201989395 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f476c133ad0 0x7f476c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:25.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.866+0000 7f4774763700 1 --2- 172.21.15.156:0/3201989395 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f476c1300a0 0x7f476c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:25.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.866+0000 7f4774763700 1 --2- 172.21.15.156:0/3201989395 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f476c130bc0 0x7f476c11df80 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:25.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.866+0000 7f4774763700 1 -- 172.21.15.156:0/3201989395 >> 172.21.15.156:0/3201989395 conn(0x7f476c099c40 msgr2=0x7f476c132bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:25.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.866+0000 7f4774763700 1 -- 172.21.15.156:0/3201989395 shutdown_connections 2023-09-30T22:21:25.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:25.866+0000 7f4774763700 1 -- 172.21.15.156:0/3201989395 wait complete. 2023-09-30T22:21:25.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:26.029 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:26.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.151+0000 7f3ec50f8700 1 Processor -- start 2023-09-30T22:21:26.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.151+0000 7f3ec50f8700 1 -- start start 2023-09-30T22:21:26.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.151+0000 7f3ec50f8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3ec0133ad0 0x7f3ec0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:26.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.151+0000 7f3ec50f8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ec01300a0 0x7f3ec01304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:26.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.151+0000 7f3ec50f8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ec01309f0 0x7f3ec013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:26.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.151+0000 7f3ec50f8700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec006b2d0 con 0x7f3ec0133ad0 2023-09-30T22:21:26.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.151+0000 7f3ec50f8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec0133610 con 0x7f3ec01309f0 2023-09-30T22:21:26.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.151+0000 7f3ec50f8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec009a500 con 0x7f3ec01300a0 2023-09-30T22:21:26.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.152+0000 7f3ebf59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ec01309f0 0x7f3ec013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:26.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.152+0000 7f3ebe59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ec01300a0 0x7f3ec01304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:26.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.152+0000 7f3ebf59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ec01309f0 0x7f3ec013a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38776/0 (socket says 172.21.15.156:38776) 2023-09-30T22:21:26.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.152+0000 7f3ebed9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3ec0133ad0 0x7f3ec0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:26.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.152+0000 7f3ebf59e700 1 -- 172.21.15.156:0/3714743142 learned_addr learned my addr 172.21.15.156:0/3714743142 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:26.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.152+0000 7f3ebf59e700 1 -- 172.21.15.156:0/3714743142 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ec01300a0 msgr2=0x7f3ec01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:26.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.152+0000 7f3ebf59e700 1 --2- 172.21.15.156:0/3714743142 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ec01300a0 0x7f3ec01304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.152+0000 7f3ebf59e700 1 -- 172.21.15.156:0/3714743142 >> v2:172.21.15.156:3300/0 conn(0x7f3ec0133ad0 msgr2=0x7f3ec0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:26.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.152+0000 7f3ebf59e700 1 --2- 172.21.15.156:0/3714743142 >> v2:172.21.15.156:3300/0 conn(0x7f3ec0133ad0 0x7f3ec0133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.152+0000 7f3ebf59e700 1 -- 172.21.15.156:0/3714743142 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec01338b0 con 0x7f3ec01309f0 2023-09-30T22:21:26.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.152+0000 7f3ebed9d700 1 --2- 172.21.15.156:0/3714743142 >> v2:172.21.15.156:3300/0 conn(0x7f3ec0133ad0 0x7f3ec0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:26.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.152+0000 7f3ebe59c700 1 --2- 172.21.15.156:0/3714743142 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ec01300a0 0x7f3ec01304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:26.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.152+0000 7f3ebf59e700 1 --2- 172.21.15.156:0/3714743142 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ec01309f0 0x7f3ec013a980 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8009e50 tx=0x7f3eb800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8f36bfee6a475cc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:26.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.152+0000 7f3ebdd9b700 1 -- 172.21.15.156:0/3714743142 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb800e070 con 0x7f3ec01309f0 2023-09-30T22:21:26.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.152+0000 7f3ebdd9b700 1 -- 172.21.15.156:0/3714743142 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb800b910 con 0x7f3ec01309f0 2023-09-30T22:21:26.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.152+0000 7f3ebdd9b700 1 -- 172.21.15.156:0/3714743142 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb800bcc0 con 0x7f3ec01309f0 2023-09-30T22:21:26.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.153+0000 7f3ec50f8700 1 -- 172.21.15.156:0/3714743142 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ec01309f0 msgr2=0x7f3ec013a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:26.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.153+0000 7f3ec50f8700 1 --2- 172.21.15.156:0/3714743142 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ec01309f0 0x7f3ec013a980 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8009e50 tx=0x7f3eb800b330 comp rx=0 tx=0).stop 2023-09-30T22:21:26.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.153+0000 7f3ec50f8700 1 -- 172.21.15.156:0/3714743142 shutdown_connections 2023-09-30T22:21:26.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.153+0000 7f3ec50f8700 1 --2- 172.21.15.156:0/3714743142 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ec01309f0 0x7f3ec013a980 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.153+0000 7f3ec50f8700 1 --2- 172.21.15.156:0/3714743142 >> v2:172.21.15.156:3300/0 conn(0x7f3ec0133ad0 0x7f3ec0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.153+0000 7f3ec50f8700 1 --2- 172.21.15.156:0/3714743142 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ec01300a0 0x7f3ec01304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.153+0000 7f3ec50f8700 1 -- 172.21.15.156:0/3714743142 >> 172.21.15.156:0/3714743142 conn(0x7f3ec0099c40 msgr2=0x7f3ec00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:26.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.153+0000 7f3ec50f8700 1 -- 172.21.15.156:0/3714743142 shutdown_connections 2023-09-30T22:21:26.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.153+0000 7f3ec50f8700 1 -- 172.21.15.156:0/3714743142 wait complete. 2023-09-30T22:21:26.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.154+0000 7f3ec50f8700 1 Processor -- start 2023-09-30T22:21:26.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.154+0000 7f3ec50f8700 1 -- start start 2023-09-30T22:21:26.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.154+0000 7f3ec50f8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ec01300a0 0x7f3ec00713e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:26.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.154+0000 7f3ec50f8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ec01309f0 0x7f3ec0071920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:26.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.155+0000 7f3ec50f8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ec0133ad0 0x7f3ec0071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:26.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.155+0000 7f3ec50f8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec011fec0 con 0x7f3ec01300a0 2023-09-30T22:21:26.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.155+0000 7f3ec50f8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec011ee60 con 0x7f3ec01309f0 2023-09-30T22:21:26.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.155+0000 7f3ec50f8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec0072840 con 0x7f3ec0133ad0 2023-09-30T22:21:26.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.155+0000 7f3ebe59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ec01309f0 0x7f3ec0071920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:26.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.155+0000 7f3ebed9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ec01300a0 0x7f3ec00713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:26.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.155+0000 7f3ebe59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ec01309f0 0x7f3ec0071920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38792/0 (socket says 172.21.15.156:38792) 2023-09-30T22:21:26.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.155+0000 7f3ebe59c700 1 -- 172.21.15.156:0/844954969 learned_addr learned my addr 172.21.15.156:0/844954969 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:26.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.155+0000 7f3ebf59e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ec0133ad0 0x7f3ec0071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:26.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.155+0000 7f3ebed9d700 1 -- 172.21.15.156:0/844954969 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ec0133ad0 msgr2=0x7f3ec0071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:26.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.155+0000 7f3ebed9d700 1 --2- 172.21.15.156:0/844954969 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ec0133ad0 0x7f3ec0071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.155+0000 7f3ebed9d700 1 -- 172.21.15.156:0/844954969 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ec01309f0 msgr2=0x7f3ec0071920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:26.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.155+0000 7f3ebed9d700 1 --2- 172.21.15.156:0/844954969 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ec01309f0 0x7f3ec0071920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.155+0000 7f3ebed9d700 1 -- 172.21.15.156:0/844954969 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb00094a0 con 0x7f3ec01300a0 2023-09-30T22:21:26.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.155+0000 7f3ebe59c700 1 --2- 172.21.15.156:0/844954969 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ec01309f0 0x7f3ec0071920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:26.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.155+0000 7f3ebf59e700 1 --2- 172.21.15.156:0/844954969 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ec0133ad0 0x7f3ec0071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:26.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.155+0000 7f3ebed9d700 1 --2- 172.21.15.156:0/844954969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ec01300a0 0x7f3ec00713e0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f3eb400e9e0 tx=0x7f3eb400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:26.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.155+0000 7f3ea77fe700 1 -- 172.21.15.156:0/844954969 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb400ee80 con 0x7f3ec01300a0 2023-09-30T22:21:26.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.155+0000 7f3ea77fe700 1 -- 172.21.15.156:0/844954969 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb400c850 con 0x7f3ec01300a0 2023-09-30T22:21:26.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.155+0000 7f3ec50f8700 1 -- 172.21.15.156:0/844954969 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb40094a0 con 0x7f3ec01300a0 2023-09-30T22:21:26.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.155+0000 7f3ea77fe700 1 -- 172.21.15.156:0/844954969 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb400cc00 con 0x7f3ec01300a0 2023-09-30T22:21:26.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.155+0000 7f3ec50f8700 1 -- 172.21.15.156:0/844954969 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb8009b30 con 0x7f3ec01300a0 2023-09-30T22:21:26.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.156+0000 7f3ea77fe700 1 -- 172.21.15.156:0/844954969 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3eb400cd60 con 0x7f3ec01300a0 2023-09-30T22:21:26.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.156+0000 7f3ea77fe700 1 -- 172.21.15.156:0/844954969 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3eb403f6a0 con 0x7f3ec01300a0 2023-09-30T22:21:26.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.156+0000 7f3ec50f8700 1 -- 172.21.15.156:0/844954969 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec00a2620 con 0x7f3ec01300a0 2023-09-30T22:21:26.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.161+0000 7f3ea77fe700 1 -- 172.21.15.156:0/844954969 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3eb401bdf0 con 0x7f3ec01300a0 2023-09-30T22:21:26.207 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:26.208 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:26.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.333+0000 7f9cc1972700 1 Processor -- start 2023-09-30T22:21:26.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.333+0000 7f9cc1972700 1 -- start start 2023-09-30T22:21:26.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.333+0000 7f9cc1972700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9cbc0a0a70 0x7f9cbc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:26.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.333+0000 7f9cc1972700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9cbc134120 0x7f9cbc13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:26.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.333+0000 7f9cc1972700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cbc09dc00 con 0x7f9cbc0a1380 2023-09-30T22:21:26.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.333+0000 7f9cc1972700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cbc09ea60 con 0x7f9cbc134120 2023-09-30T22:21:26.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.333+0000 7f9cc1972700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc09dec0 con 0x7f9cbc0a0a70 2023-09-30T22:21:26.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.333+0000 7f9cbaffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9cbc0a0a70 0x7f9cbc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:26.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.333+0000 7f9cbaffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9cbc0a0a70 0x7f9cbc0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38804/0 (socket says 172.21.15.156:38804) 2023-09-30T22:21:26.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.333+0000 7f9cbaffd700 1 -- 172.21.15.156:0/1421425909 learned_addr learned my addr 172.21.15.156:0/1421425909 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:26.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.333+0000 7f9cbb7fe700 1 --2- 172.21.15.156:0/1421425909 >> v2:172.21.15.156:3300/0 conn(0x7f9cbc134120 0x7f9cbc13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:26.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.334+0000 7f9cb9ffb700 1 -- 172.21.15.156:0/1421425909 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2151395895 0 0) 0x7f9cbc09dc00 con 0x7f9cbc0a1380 2023-09-30T22:21:26.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.334+0000 7f9cb9ffb700 1 -- 172.21.15.156:0/1421425909 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ca40035b0 con 0x7f9cbc0a1380 2023-09-30T22:21:26.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.334+0000 7f9cbaffd700 1 -- 172.21.15.156:0/1421425909 >> v2:172.21.15.156:3300/0 conn(0x7f9cbc134120 msgr2=0x7f9cbc13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:26.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.334+0000 7f9cbaffd700 1 --2- 172.21.15.156:0/1421425909 >> v2:172.21.15.156:3300/0 conn(0x7f9cbc134120 0x7f9cbc13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.334+0000 7f9cbaffd700 1 -- 172.21.15.156:0/1421425909 >> v1:172.21.15.156:6789/0 conn(0x7f9cbc0a1380 legacy=0x7f9cbc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:26.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.334+0000 7f9cbaffd700 1 -- 172.21.15.156:0/1421425909 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cbc09e6a0 con 0x7f9cbc0a0a70 2023-09-30T22:21:26.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.334+0000 7f9cbaffd700 1 --2- 172.21.15.156:0/1421425909 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9cbc0a0a70 0x7f9cbc0a0e40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0098f0 tx=0x7f9cac009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a804ded90f742f43 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:26.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.334+0000 7f9cb9ffb700 1 -- 172.21.15.156:0/1421425909 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac014e90 con 0x7f9cbc0a0a70 2023-09-30T22:21:26.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.334+0000 7f9cb9ffb700 1 -- 172.21.15.156:0/1421425909 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cac01c440 con 0x7f9cbc0a0a70 2023-09-30T22:21:26.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.334+0000 7f9cb9ffb700 1 -- 172.21.15.156:0/1421425909 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac01c7d0 con 0x7f9cbc0a0a70 2023-09-30T22:21:26.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.334+0000 7f9b1c386700 1 Processor -- start 2023-09-30T22:21:26.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.334+0000 7f9b1c386700 1 -- start start 2023-09-30T22:21:26.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.335+0000 7f9cc1972700 1 -- 172.21.15.156:0/1421425909 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9cbc0a0a70 msgr2=0x7f9cbc0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:26.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.335+0000 7f9cc1972700 1 --2- 172.21.15.156:0/1421425909 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9cbc0a0a70 0x7f9cbc0a0e40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0098f0 tx=0x7f9cac009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:26.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.335+0000 7f9b1c386700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b141307a0 0x7f9b14130b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:26.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.335+0000 7f9b1c386700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9b141310b0 0x7f9b1412f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:26.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.335+0000 7f9b1c386700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b1406d7f0 0x7f9b1412f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:26.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.335+0000 7f9b1c386700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b14130660 con 0x7f9b141310b0 2023-09-30T22:21:26.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.335+0000 7f9b1c386700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1406dcd0 con 0x7f9b141307a0 2023-09-30T22:21:26.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.335+0000 7f9b1c386700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1406eb40 con 0x7f9b1406d7f0 2023-09-30T22:21:26.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.335+0000 7f9cc1972700 1 -- 172.21.15.156:0/1421425909 shutdown_connections 2023-09-30T22:21:26.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.335+0000 7f9cc1972700 1 --2- 172.21.15.156:0/1421425909 >> v2:172.21.15.156:3300/0 conn(0x7f9cbc134120 0x7f9cbc13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.335+0000 7f9cc1972700 1 --2- 172.21.15.156:0/1421425909 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9cbc0a0a70 0x7f9cbc0a0e40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.335+0000 7f9cc1972700 1 -- 172.21.15.156:0/1421425909 >> 172.21.15.156:0/1421425909 conn(0x7f9cbc0a6610 msgr2=0x7f9cbc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:26.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.335+0000 7f9b1a923700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b1406d7f0 0x7f9b1412f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:26.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.335+0000 7f9b19921700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9b141310b0 0x7f9b1412f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:26.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.335+0000 7f9b19921700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9b141310b0 0x7f9b1412f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48952/0 (socket says 172.21.15.156:48952) 2023-09-30T22:21:26.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.335+0000 7f9b1a923700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b1406d7f0 0x7f9b1412f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:60120/0 (socket says 172.21.15.156:60120) 2023-09-30T22:21:26.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.335+0000 7f9b19921700 1 -- 172.21.15.156:0/4173213037 learned_addr learned my addr 172.21.15.156:0/4173213037 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:26.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.335+0000 7f9cc1972700 1 -- 172.21.15.156:0/1421425909 shutdown_connections 2023-09-30T22:21:26.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.335+0000 7f9b1a122700 1 --2- 172.21.15.156:0/4173213037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b141307a0 0x7f9b14130b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:26.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.336+0000 7f9b19921700 1 -- 172.21.15.156:0/4173213037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b1406d7f0 msgr2=0x7f9b1412f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:26.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.336+0000 7f9b19921700 1 --2- 172.21.15.156:0/4173213037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b1406d7f0 0x7f9b1412f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.336+0000 7f9b19921700 1 -- 172.21.15.156:0/4173213037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b141307a0 msgr2=0x7f9b14130b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:26.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.336+0000 7f9b19921700 1 --2- 172.21.15.156:0/4173213037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b141307a0 0x7f9b14130b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.336+0000 7f9b19921700 1 -- 172.21.15.156:0/4173213037 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1406df80 con 0x7f9b141310b0 2023-09-30T22:21:26.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.336+0000 7f9b19921700 1 --2- 172.21.15.156:0/4173213037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b141310b0 0x7f9b1412f410 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f9b040098f0 tx=0x7f9b04009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a40a5106b28edea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:26.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.336+0000 7f9b19120700 1 -- 172.21.15.156:0/4173213037 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b04011830 con 0x7f9b141310b0 2023-09-30T22:21:26.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.336+0000 7f9b19120700 1 -- 172.21.15.156:0/4173213037 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b04011990 con 0x7f9b141310b0 2023-09-30T22:21:26.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.336+0000 7f9b19120700 1 -- 172.21.15.156:0/4173213037 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b04011d20 con 0x7f9b141310b0 2023-09-30T22:21:26.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.336+0000 7f9cc1972700 1 -- 172.21.15.156:0/1421425909 wait complete. 2023-09-30T22:21:26.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.336+0000 7f9cc1972700 1 Processor -- start 2023-09-30T22:21:26.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.337+0000 7f9b1c386700 1 -- 172.21.15.156:0/4173213037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b141310b0 msgr2=0x7f9b1412f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:26.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.337+0000 7f9b1c386700 1 --2- 172.21.15.156:0/4173213037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b141310b0 0x7f9b1412f410 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f9b040098f0 tx=0x7f9b04009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:26.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.337+0000 7f9cc1972700 1 -- start start 2023-09-30T22:21:26.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.337+0000 7f9b1c386700 1 -- 172.21.15.156:0/4173213037 shutdown_connections 2023-09-30T22:21:26.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.337+0000 7f9b1c386700 1 --2- 172.21.15.156:0/4173213037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b1406d7f0 0x7f9b1412f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.337+0000 7f9b1c386700 1 --2- 172.21.15.156:0/4173213037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b141307a0 0x7f9b14130b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.337+0000 7f9b1c386700 1 --2- 172.21.15.156:0/4173213037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b141310b0 0x7f9b1412f410 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.337+0000 7f9b1c386700 1 -- 172.21.15.156:0/4173213037 >> 172.21.15.156:0/4173213037 conn(0x7f9b140a1ee0 msgr2=0x7f9b140a22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:26.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.337+0000 7f9b1c386700 1 -- 172.21.15.156:0/4173213037 shutdown_connections 2023-09-30T22:21:26.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.337+0000 7f9b1c386700 1 -- 172.21.15.156:0/4173213037 wait complete. 2023-09-30T22:21:26.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.337+0000 7f9cc1972700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cbc0a0a70 0x7f9cbc1d1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:26.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.337+0000 7f9cc1972700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9cbc0a1380 0x7f9cbc1d2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:26.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.337+0000 7f9cc1972700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9cbc134120 0x7f9cbc1d4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:26.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.337+0000 7f9cc1972700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc133370 con 0x7f9cbc0a0a70 2023-09-30T22:21:26.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.337+0000 7f9cc1972700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc130ee0 con 0x7f9cbc134120 2023-09-30T22:21:26.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.337+0000 7f9cc1972700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc133550 con 0x7f9cbc0a1380 2023-09-30T22:21:26.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.338+0000 7f9cbaffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cbc0a0a70 0x7f9cbc1d1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:26.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.338+0000 7f9cbaffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cbc0a0a70 0x7f9cbc1d1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48964/0 (socket says 172.21.15.156:48964) 2023-09-30T22:21:26.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.338+0000 7f9cbaffd700 1 -- 172.21.15.156:0/2508875883 learned_addr learned my addr 172.21.15.156:0/2508875883 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:26.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.338+0000 7f9cbb7fe700 1 --2- 172.21.15.156:0/2508875883 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9cbc134120 0x7f9cbc1d4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:26.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.338+0000 7f9cba7fc700 1 --2- 172.21.15.156:0/2508875883 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9cbc0a1380 0x7f9cbc1d2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:26.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.338+0000 7f9b1c386700 1 Processor -- start 2023-09-30T22:21:26.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.338+0000 7f9cbaffd700 1 -- 172.21.15.156:0/2508875883 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9cbc0a1380 msgr2=0x7f9cbc1d2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:26.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.338+0000 7f9cbaffd700 1 --2- 172.21.15.156:0/2508875883 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9cbc0a1380 0x7f9cbc1d2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.338+0000 7f9cbaffd700 1 -- 172.21.15.156:0/2508875883 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9cbc134120 msgr2=0x7f9cbc1d4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:26.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.338+0000 7f9cbaffd700 1 --2- 172.21.15.156:0/2508875883 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9cbc134120 0x7f9cbc1d4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.338+0000 7f9cbaffd700 1 -- 172.21.15.156:0/2508875883 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac009550 con 0x7f9cbc0a0a70 2023-09-30T22:21:26.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.338+0000 7f9b1c386700 1 -- start start 2023-09-30T22:21:26.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.338+0000 7f9cbaffd700 1 --2- 172.21.15.156:0/2508875883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cbc0a0a70 0x7f9cbc1d1c50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f9cac01f040 tx=0x7f9cac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:26.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.338+0000 7f9ca3fff700 1 -- 172.21.15.156:0/2508875883 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac014480 con 0x7f9cbc0a0a70 2023-09-30T22:21:26.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.338+0000 7f9ca3fff700 1 -- 172.21.15.156:0/2508875883 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cac014600 con 0x7f9cbc0a0a70 2023-09-30T22:21:26.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.338+0000 7f9ca3fff700 1 -- 172.21.15.156:0/2508875883 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac0038e0 con 0x7f9cbc0a0a70 2023-09-30T22:21:26.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.338+0000 7f9cc1972700 1 -- 172.21.15.156:0/2508875883 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cbc1d26d0 con 0x7f9cbc0a0a70 2023-09-30T22:21:26.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.338+0000 7f9cc1972700 1 -- 172.21.15.156:0/2508875883 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cbc131640 con 0x7f9cbc0a0a70 2023-09-30T22:21:26.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.339+0000 7f9b1c386700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b1406d7f0 0x7f9b14093800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:26.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.339+0000 7f9b1c386700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b141307a0 0x7f9b14093d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:26.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.339+0000 7f9b1c386700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b141310b0 0x7f9b14094280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:26.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.339+0000 7f9b1c386700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b14095430 con 0x7f9b141307a0 2023-09-30T22:21:26.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.339+0000 7f9b1c386700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b14098340 con 0x7f9b1406d7f0 2023-09-30T22:21:26.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.339+0000 7f9b1c386700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1409cfb0 con 0x7f9b141310b0 2023-09-30T22:21:26.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.339+0000 7f9b1a122700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b1406d7f0 0x7f9b14093800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:26.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.339+0000 7f9b1a923700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b141310b0 0x7f9b14094280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:26.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.339+0000 7f9b1a122700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b1406d7f0 0x7f9b14093800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38832/0 (socket says 172.21.15.156:38832) 2023-09-30T22:21:26.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.339+0000 7f9b1a122700 1 -- 172.21.15.156:0/2933581950 learned_addr learned my addr 172.21.15.156:0/2933581950 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:26.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.339+0000 7f9ca3fff700 1 -- 172.21.15.156:0/2508875883 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9cac003a40 con 0x7f9cbc0a0a70 2023-09-30T22:21:26.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.339+0000 7f9b1a122700 1 -- 172.21.15.156:0/2933581950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b141310b0 msgr2=0x7f9b14094280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:26.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.339+0000 7f9b1a122700 1 --2- 172.21.15.156:0/2933581950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b141310b0 0x7f9b14094280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.339+0000 7f9b1a122700 1 -- 172.21.15.156:0/2933581950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b141307a0 msgr2=0x7f9b14093d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:26.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.339+0000 7f9b1a122700 1 --2- 172.21.15.156:0/2933581950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b141307a0 0x7f9b14093d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.339+0000 7f9b1a122700 1 -- 172.21.15.156:0/2933581950 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b04009550 con 0x7f9b1406d7f0 2023-09-30T22:21:26.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.339+0000 7f9b1a122700 1 --2- 172.21.15.156:0/2933581950 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b1406d7f0 0x7f9b14093800 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000e9e0 tx=0x7f9b1000ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:26.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.339+0000 7f9b0affd700 1 -- 172.21.15.156:0/2933581950 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1000c850 con 0x7f9b1406d7f0 2023-09-30T22:21:26.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.340+0000 7f9ca3fff700 1 -- 172.21.15.156:0/2508875883 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9cac040c20 con 0x7f9cbc0a0a70 2023-09-30T22:21:26.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.339+0000 7f9b0affd700 1 -- 172.21.15.156:0/2933581950 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1000c9b0 con 0x7f9b1406d7f0 2023-09-30T22:21:26.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.339+0000 7f9b0affd700 1 -- 172.21.15.156:0/2933581950 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1000cd20 con 0x7f9b1406d7f0 2023-09-30T22:21:26.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.340+0000 7f9b1c386700 1 -- 172.21.15.156:0/2933581950 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b140724e0 con 0x7f9b1406d7f0 2023-09-30T22:21:26.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.340+0000 7f9b1c386700 1 -- 172.21.15.156:0/2933581950 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b140978a0 con 0x7f9b1406d7f0 2023-09-30T22:21:26.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.340+0000 7f9cc1972700 1 -- 172.21.15.156:0/2508875883 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cbc04f2a0 con 0x7f9cbc0a0a70 2023-09-30T22:21:26.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.340+0000 7f9b1c386700 1 -- 172.21.15.156:0/2933581950 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b14096c90 con 0x7f9b1406d7f0 2023-09-30T22:21:26.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.340+0000 7f9b0affd700 1 -- 172.21.15.156:0/2933581950 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9b10013470 con 0x7f9b1406d7f0 2023-09-30T22:21:26.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.341+0000 7f9b0affd700 1 -- 172.21.15.156:0/2933581950 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9b1003fb90 con 0x7f9b1406d7f0 2023-09-30T22:21:26.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.345+0000 7f9b0affd700 1 -- 172.21.15.156:0/2933581950 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9b14096c90 con 0x7f9b1406d7f0 2023-09-30T22:21:26.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.345+0000 7f9ca3fff700 1 -- 172.21.15.156:0/2508875883 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9cac02a080 con 0x7f9cbc0a0a70 2023-09-30T22:21:26.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.377+0000 7f3ec50f8700 1 -- 172.21.15.156:0/844954969 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3ec012dd00 con 0x7f3ec01300a0 2023-09-30T22:21:26.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.378+0000 7f3ea77fe700 1 -- 172.21.15.156:0/844954969 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3eb401b3b0 con 0x7f3ec01300a0 2023-09-30T22:21:26.378 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:26.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.380+0000 7f3ec50f8700 1 -- 172.21.15.156:0/844954969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ec01300a0 msgr2=0x7f3ec00713e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:26.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.380+0000 7f3ec50f8700 1 --2- 172.21.15.156:0/844954969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ec01300a0 0x7f3ec00713e0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f3eb400e9e0 tx=0x7f3eb400ecf0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.380+0000 7f3ec50f8700 1 -- 172.21.15.156:0/844954969 shutdown_connections 2023-09-30T22:21:26.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.380+0000 7f3ec50f8700 1 --2- 172.21.15.156:0/844954969 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ec0133ad0 0x7f3ec0071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.380+0000 7f3ec50f8700 1 --2- 172.21.15.156:0/844954969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ec01300a0 0x7f3ec00713e0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.380+0000 7f3ec50f8700 1 --2- 172.21.15.156:0/844954969 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ec01309f0 0x7f3ec0071920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.380+0000 7f3ec50f8700 1 -- 172.21.15.156:0/844954969 >> 172.21.15.156:0/844954969 conn(0x7f3ec0099c40 msgr2=0x7f3ec0132c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:26.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.380+0000 7f3ec50f8700 1 -- 172.21.15.156:0/844954969 shutdown_connections 2023-09-30T22:21:26.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.380+0000 7f3ec50f8700 1 -- 172.21.15.156:0/844954969 wait complete. 2023-09-30T22:21:26.393 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:26.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.538+0000 7f9cc1972700 1 -- 172.21.15.156:0/2508875883 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9cbc133120 con 0x7f9cbc0a0a70 2023-09-30T22:21:26.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.538+0000 7f9ca3fff700 1 -- 172.21.15.156:0/2508875883 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9cac014770 con 0x7f9cbc0a0a70 2023-09-30T22:21:26.540 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:26.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.541+0000 7f9cc1972700 1 -- 172.21.15.156:0/2508875883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cbc0a0a70 msgr2=0x7f9cbc1d1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:26.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.541+0000 7f9cc1972700 1 --2- 172.21.15.156:0/2508875883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cbc0a0a70 0x7f9cbc1d1c50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f9cac01f040 tx=0x7f9cac004750 comp rx=0 tx=0).stop 2023-09-30T22:21:26.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.541+0000 7f9cc1972700 1 -- 172.21.15.156:0/2508875883 shutdown_connections 2023-09-30T22:21:26.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.541+0000 7f9cc1972700 1 --2- 172.21.15.156:0/2508875883 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9cbc134120 0x7f9cbc1d4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.541+0000 7f9cc1972700 1 --2- 172.21.15.156:0/2508875883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cbc0a0a70 0x7f9cbc1d1c50 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.541+0000 7f9cc1972700 1 --2- 172.21.15.156:0/2508875883 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9cbc0a1380 0x7f9cbc1d2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.541+0000 7f9cc1972700 1 -- 172.21.15.156:0/2508875883 >> 172.21.15.156:0/2508875883 conn(0x7f9cbc0a6610 msgr2=0x7f9cbc0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:26.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.541+0000 7f9cc1972700 1 -- 172.21.15.156:0/2508875883 shutdown_connections 2023-09-30T22:21:26.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.541+0000 7f9cc1972700 1 -- 172.21.15.156:0/2508875883 wait complete. 2023-09-30T22:21:26.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:26.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.555+0000 7f9b1c386700 1 -- 172.21.15.156:0/2933581950 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9b14096c90 con 0x7f9b1406d7f0 2023-09-30T22:21:26.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.556+0000 7f9b0affd700 1 -- 172.21.15.156:0/2933581950 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9b14096c90 con 0x7f9b1406d7f0 2023-09-30T22:21:26.557 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:26.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.558+0000 7f9b1c386700 1 -- 172.21.15.156:0/2933581950 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b1406d7f0 msgr2=0x7f9b14093800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:26.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.558+0000 7f9b1c386700 1 --2- 172.21.15.156:0/2933581950 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b1406d7f0 0x7f9b14093800 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000e9e0 tx=0x7f9b1000ecf0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.558+0000 7f9b1c386700 1 -- 172.21.15.156:0/2933581950 shutdown_connections 2023-09-30T22:21:26.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.558+0000 7f9b1c386700 1 --2- 172.21.15.156:0/2933581950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b141310b0 0x7f9b14094280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.558+0000 7f9b1c386700 1 --2- 172.21.15.156:0/2933581950 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b1406d7f0 0x7f9b14093800 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.558+0000 7f9b1c386700 1 --2- 172.21.15.156:0/2933581950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b141307a0 0x7f9b14093d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:26.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.558+0000 7f9b1c386700 1 -- 172.21.15.156:0/2933581950 >> 172.21.15.156:0/2933581950 conn(0x7f9b140a1ee0 msgr2=0x7f9b140a0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:26.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.558+0000 7f9b1c386700 1 -- 172.21.15.156:0/2933581950 shutdown_connections 2023-09-30T22:21:26.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:26.558+0000 7f9b1c386700 1 -- 172.21.15.156:0/2933581950 wait complete. 2023-09-30T22:21:26.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:26.879 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:27.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.001+0000 7f2561d2d700 1 Processor -- start 2023-09-30T22:21:27.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.001+0000 7f2561d2d700 1 -- start start 2023-09-30T22:21:27.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.002+0000 7f2561d2d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f255c09e870 0x7f255c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:27.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.002+0000 7f2561d2d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f255c09f180 0x7f255c133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:27.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.002+0000 7f2561d2d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255c06bec0 con 0x7f255c1341d0 2023-09-30T22:21:27.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.002+0000 7f2561d2d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255c06ce60 con 0x7f255c09e870 2023-09-30T22:21:27.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.002+0000 7f2561d2d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f255c09fa00 con 0x7f255c09f180 2023-09-30T22:21:27.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.002+0000 7f255b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f255c09e870 0x7f255c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:27.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.002+0000 7f255b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f255c09e870 0x7f255c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38846/0 (socket says 172.21.15.156:38846) 2023-09-30T22:21:27.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.002+0000 7f255b7fe700 1 -- 172.21.15.156:0/1837384726 learned_addr learned my addr 172.21.15.156:0/1837384726 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:27.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.002+0000 7f255bfff700 1 --1- 172.21.15.156:0/1837384726 >> v1:172.21.15.156:6789/0 conn(0x7f255c1341d0 0x7f255c13af50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:39986/0 (socket says 172.21.15.156:39986) 2023-09-30T22:21:27.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.002+0000 7f255affd700 1 --2- 172.21.15.156:0/1837384726 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f255c09f180 0x7f255c133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:27.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.002+0000 7f255affd700 1 -- 172.21.15.156:0/1837384726 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f255c09e870 msgr2=0x7f255c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:27.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.002+0000 7f255a7fc700 1 -- 172.21.15.156:0/1837384726 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 913743623 0 0) 0x7f255c06bec0 con 0x7f255c1341d0 2023-09-30T22:21:27.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.002+0000 7f255affd700 1 --2- 172.21.15.156:0/1837384726 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f255c09e870 0x7f255c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.002+0000 7f255affd700 1 -- 172.21.15.156:0/1837384726 >> v1:172.21.15.156:6789/0 conn(0x7f255c1341d0 legacy=0x7f255c13af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:27.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.002+0000 7f255affd700 1 -- 172.21.15.156:0/1837384726 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255c09ad80 con 0x7f255c09f180 2023-09-30T22:21:27.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.002+0000 7f255b7fe700 1 --2- 172.21.15.156:0/1837384726 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f255c09e870 0x7f255c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:27.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.002+0000 7f255affd700 1 --2- 172.21.15.156:0/1837384726 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f255c09f180 0x7f255c133c90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f25440098a0 tx=0x7f2544009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca724d7d02b4bd48 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:27.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.003+0000 7f255a7fc700 1 -- 172.21.15.156:0/1837384726 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544011830 con 0x7f255c09f180 2023-09-30T22:21:27.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.003+0000 7f255a7fc700 1 -- 172.21.15.156:0/1837384726 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2544011990 con 0x7f255c09f180 2023-09-30T22:21:27.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.003+0000 7f255a7fc700 1 -- 172.21.15.156:0/1837384726 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544011d20 con 0x7f255c09f180 2023-09-30T22:21:27.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.003+0000 7f2561d2d700 1 -- 172.21.15.156:0/1837384726 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f255c09f180 msgr2=0x7f255c133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:27.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.003+0000 7f2561d2d700 1 --2- 172.21.15.156:0/1837384726 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f255c09f180 0x7f255c133c90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f25440098a0 tx=0x7f2544009bb0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.003+0000 7f2561d2d700 1 -- 172.21.15.156:0/1837384726 shutdown_connections 2023-09-30T22:21:27.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.003+0000 7f2561d2d700 1 --2- 172.21.15.156:0/1837384726 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f255c09e870 0x7f255c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.003+0000 7f2561d2d700 1 --2- 172.21.15.156:0/1837384726 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f255c09f180 0x7f255c133c90 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.003+0000 7f2561d2d700 1 -- 172.21.15.156:0/1837384726 >> 172.21.15.156:0/1837384726 conn(0x7f255c0a4430 msgr2=0x7f255c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:27.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.003+0000 7f2561d2d700 1 -- 172.21.15.156:0/1837384726 shutdown_connections 2023-09-30T22:21:27.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.003+0000 7f2561d2d700 1 -- 172.21.15.156:0/1837384726 wait complete. 2023-09-30T22:21:27.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.004+0000 7f2561d2d700 1 Processor -- start 2023-09-30T22:21:27.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.004+0000 7f2561d2d700 1 -- start start 2023-09-30T22:21:27.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.005+0000 7f2561d2d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f255c09e870 0x7f255c122ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:27.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.005+0000 7f2561d2d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f255c09f180 0x7f255c123020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:27.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.005+0000 7f2561d2d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f255c1341d0 0x7f255c123560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:27.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.005+0000 7f2561d2d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c06d010 con 0x7f255c09e870 2023-09-30T22:21:27.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.005+0000 7f2561d2d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255c126540 con 0x7f255c09f180 2023-09-30T22:21:27.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.005+0000 7f2561d2d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f255c127120 con 0x7f255c1341d0 2023-09-30T22:21:27.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.005+0000 7f255b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f255c09e870 0x7f255c122ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:27.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.005+0000 7f255affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f255c09f180 0x7f255c123020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:27.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.005+0000 7f255bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f255c1341d0 0x7f255c123560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:27.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.005+0000 7f255b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f255c09e870 0x7f255c122ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48984/0 (socket says 172.21.15.156:48984) 2023-09-30T22:21:27.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.005+0000 7f255b7fe700 1 -- 172.21.15.156:0/803700485 learned_addr learned my addr 172.21.15.156:0/803700485 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:27.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.005+0000 7f255b7fe700 1 -- 172.21.15.156:0/803700485 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f255c1341d0 msgr2=0x7f255c123560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:27.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.005+0000 7f255b7fe700 1 --2- 172.21.15.156:0/803700485 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f255c1341d0 0x7f255c123560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.005+0000 7f255b7fe700 1 -- 172.21.15.156:0/803700485 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f255c09f180 msgr2=0x7f255c123020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:27.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.005+0000 7f255b7fe700 1 --2- 172.21.15.156:0/803700485 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f255c09f180 0x7f255c123020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.005+0000 7f255b7fe700 1 -- 172.21.15.156:0/803700485 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254c009550 con 0x7f255c09e870 2023-09-30T22:21:27.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.005+0000 7f255bfff700 1 --2- 172.21.15.156:0/803700485 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f255c1341d0 0x7f255c123560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:27.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.005+0000 7f255affd700 1 --2- 172.21.15.156:0/803700485 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f255c09f180 0x7f255c123020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:27.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.005+0000 7f255b7fe700 1 --2- 172.21.15.156:0/803700485 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f255c09e870 0x7f255c122ae0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f254c00ec10 tx=0x7f254c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:27.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.005+0000 7f2553fff700 1 -- 172.21.15.156:0/803700485 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c00c850 con 0x7f255c09e870 2023-09-30T22:21:27.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.005+0000 7f2553fff700 1 -- 172.21.15.156:0/803700485 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254c00c9b0 con 0x7f255c09e870 2023-09-30T22:21:27.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.005+0000 7f2561d2d700 1 -- 172.21.15.156:0/803700485 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25440094a0 con 0x7f255c09e870 2023-09-30T22:21:27.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.006+0000 7f2553fff700 1 -- 172.21.15.156:0/803700485 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c00cd40 con 0x7f255c09e870 2023-09-30T22:21:27.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.006+0000 7f2561d2d700 1 -- 172.21.15.156:0/803700485 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f255c126260 con 0x7f255c09e870 2023-09-30T22:21:27.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.006+0000 7f2553fff700 1 -- 172.21.15.156:0/803700485 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f254c013470 con 0x7f255c09e870 2023-09-30T22:21:27.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.006+0000 7f2561d2d700 1 -- 172.21.15.156:0/803700485 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255c04f2a0 con 0x7f255c09e870 2023-09-30T22:21:27.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.006+0000 7f2553fff700 1 -- 172.21.15.156:0/803700485 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f254c03f8b0 con 0x7f255c09e870 2023-09-30T22:21:27.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.011+0000 7f2553fff700 1 -- 172.21.15.156:0/803700485 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f254c00cea0 con 0x7f255c09e870 2023-09-30T22:21:27.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.194+0000 7f2561d2d700 1 -- 172.21.15.156:0/803700485 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f255c072d60 con 0x7f255c09e870 2023-09-30T22:21:27.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.194+0000 7f2553fff700 1 -- 172.21.15.156:0/803700485 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f254c01bb60 con 0x7f255c09e870 2023-09-30T22:21:27.195 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:27.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.196+0000 7f2561d2d700 1 -- 172.21.15.156:0/803700485 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f255c09e870 msgr2=0x7f255c122ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:27.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.196+0000 7f2561d2d700 1 --2- 172.21.15.156:0/803700485 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f255c09e870 0x7f255c122ae0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f254c00ec10 tx=0x7f254c00ef20 comp rx=0 tx=0).stop 2023-09-30T22:21:27.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.196+0000 7f2561d2d700 1 -- 172.21.15.156:0/803700485 shutdown_connections 2023-09-30T22:21:27.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.196+0000 7f2561d2d700 1 --2- 172.21.15.156:0/803700485 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f255c1341d0 0x7f255c123560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.196+0000 7f2561d2d700 1 --2- 172.21.15.156:0/803700485 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f255c09e870 0x7f255c122ae0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.196+0000 7f2561d2d700 1 --2- 172.21.15.156:0/803700485 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f255c09f180 0x7f255c123020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.196+0000 7f2561d2d700 1 -- 172.21.15.156:0/803700485 >> 172.21.15.156:0/803700485 conn(0x7f255c0a4430 msgr2=0x7f255c0a1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:27.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.197+0000 7f2561d2d700 1 -- 172.21.15.156:0/803700485 shutdown_connections 2023-09-30T22:21:27.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.197+0000 7f2561d2d700 1 -- 172.21.15.156:0/803700485 wait complete. 2023-09-30T22:21:27.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:27.394 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:27.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.517+0000 7fbd343b2700 1 Processor -- start 2023-09-30T22:21:27.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.517+0000 7fbd343b2700 1 -- start start 2023-09-30T22:21:27.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.518+0000 7fbd343b2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd2c12d380 0x7fbd2c12d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:27.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.518+0000 7fbd343b2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbd2c09a5a0 0x7fbd2c138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:27.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.518+0000 7fbd343b2700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd2c09bb90 con 0x7fbd2c099a60 2023-09-30T22:21:27.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.518+0000 7fbd343b2700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2c09c210 con 0x7fbd2c09a5a0 2023-09-30T22:21:27.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.518+0000 7fbd343b2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c09ced0 con 0x7fbd2c12d380 2023-09-30T22:21:27.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.518+0000 7fbd3294f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbd2c09a5a0 0x7fbd2c138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:27.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.518+0000 7fbd3294f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbd2c09a5a0 0x7fbd2c138620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48990/0 (socket says 172.21.15.156:48990) 2023-09-30T22:21:27.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.518+0000 7fbd3214e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd2c12d380 0x7fbd2c12d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:27.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.518+0000 7fbd3294f700 1 -- 172.21.15.156:0/1761980980 learned_addr learned my addr 172.21.15.156:0/1761980980 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:27.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.519+0000 7fbd3214e700 1 -- 172.21.15.156:0/1761980980 >> v2:172.21.15.156:3300/0 conn(0x7fbd2c09a5a0 msgr2=0x7fbd2c138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:27.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.519+0000 7fbd3214e700 1 --2- 172.21.15.156:0/1761980980 >> v2:172.21.15.156:3300/0 conn(0x7fbd2c09a5a0 0x7fbd2c138620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.519+0000 7fbd3214e700 1 -- 172.21.15.156:0/1761980980 >> v1:172.21.15.156:6789/0 conn(0x7fbd2c099a60 legacy=0x7fbd2c099e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:27.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.519+0000 7fbd3214e700 1 -- 172.21.15.156:0/1761980980 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2c09ac30 con 0x7fbd2c12d380 2023-09-30T22:21:27.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.519+0000 7fbd3114c700 1 -- 172.21.15.156:0/1761980980 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115698047 0 0) 0x7fbd2c09bb90 con 0x7fbd2c099a60 2023-09-30T22:21:27.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.519+0000 7fbd3294f700 1 --2- 172.21.15.156:0/1761980980 >> v2:172.21.15.156:3300/0 conn(0x7fbd2c09a5a0 0x7fbd2c138620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:27.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.519+0000 7fbd3214e700 1 --2- 172.21.15.156:0/1761980980 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd2c12d380 0x7fbd2c12d750 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbd28009820 tx=0x7fbd28009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9df8e756088be70 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:27.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.519+0000 7fbd3114c700 1 -- 172.21.15.156:0/1761980980 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd28005e30 con 0x7fbd2c12d380 2023-09-30T22:21:27.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.519+0000 7fbd3114c700 1 -- 172.21.15.156:0/1761980980 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd28006030 con 0x7fbd2c12d380 2023-09-30T22:21:27.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.519+0000 7fbd3114c700 1 -- 172.21.15.156:0/1761980980 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd280063c0 con 0x7fbd2c12d380 2023-09-30T22:21:27.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.520+0000 7fbd343b2700 1 -- 172.21.15.156:0/1761980980 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd2c12d380 msgr2=0x7fbd2c12d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:27.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.520+0000 7fbd343b2700 1 --2- 172.21.15.156:0/1761980980 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd2c12d380 0x7fbd2c12d750 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbd28009820 tx=0x7fbd28009b30 comp rx=0 tx=0).stop 2023-09-30T22:21:27.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.520+0000 7fbd343b2700 1 -- 172.21.15.156:0/1761980980 shutdown_connections 2023-09-30T22:21:27.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.520+0000 7fbd343b2700 1 --2- 172.21.15.156:0/1761980980 >> v2:172.21.15.156:3300/0 conn(0x7fbd2c09a5a0 0x7fbd2c138620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.520+0000 7fbd343b2700 1 --2- 172.21.15.156:0/1761980980 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd2c12d380 0x7fbd2c12d750 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.520+0000 7fbd343b2700 1 -- 172.21.15.156:0/1761980980 >> 172.21.15.156:0/1761980980 conn(0x7fbd2c0a2980 msgr2=0x7fbd2c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:27.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.520+0000 7fbd343b2700 1 -- 172.21.15.156:0/1761980980 shutdown_connections 2023-09-30T22:21:27.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.520+0000 7fbd343b2700 1 -- 172.21.15.156:0/1761980980 wait complete. 2023-09-30T22:21:27.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.521+0000 7fbd343b2700 1 Processor -- start 2023-09-30T22:21:27.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.521+0000 7fbd343b2700 1 -- start start 2023-09-30T22:21:27.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.521+0000 7fbd343b2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd2c099a60 0x7fbd2c119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:27.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.521+0000 7fbd343b2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd2c09a5a0 0x7fbd2c119b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:27.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.521+0000 7fbd343b2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd2c12d380 0x7fbd2c11a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:27.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.521+0000 7fbd343b2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c11db10 con 0x7fbd2c099a60 2023-09-30T22:21:27.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.521+0000 7fbd343b2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c11d150 con 0x7fbd2c09a5a0 2023-09-30T22:21:27.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.521+0000 7fbd343b2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c11c490 con 0x7fbd2c12d380 2023-09-30T22:21:27.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.521+0000 7fbd3214e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd2c099a60 0x7fbd2c119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:27.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.521+0000 7fbd3294f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd2c12d380 0x7fbd2c11a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:27.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.521+0000 7fbd3194d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd2c09a5a0 0x7fbd2c119b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:27.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.521+0000 7fbd3214e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd2c099a60 0x7fbd2c119630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48998/0 (socket says 172.21.15.156:48998) 2023-09-30T22:21:27.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.521+0000 7fbd3214e700 1 -- 172.21.15.156:0/2941503153 learned_addr learned my addr 172.21.15.156:0/2941503153 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:27.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.521+0000 7fbd3294f700 1 -- 172.21.15.156:0/2941503153 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd2c09a5a0 msgr2=0x7fbd2c119b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:27.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.521+0000 7fbd3294f700 1 --2- 172.21.15.156:0/2941503153 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd2c09a5a0 0x7fbd2c119b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.521+0000 7fbd3294f700 1 -- 172.21.15.156:0/2941503153 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd2c099a60 msgr2=0x7fbd2c119630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:27.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.521+0000 7fbd3294f700 1 --2- 172.21.15.156:0/2941503153 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd2c099a60 0x7fbd2c119630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.521+0000 7fbd3294f700 1 -- 172.21.15.156:0/2941503153 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2400bd40 con 0x7fbd2c12d380 2023-09-30T22:21:27.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.522+0000 7fbd3294f700 1 --2- 172.21.15.156:0/2941503153 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd2c12d380 0x7fbd2c11a0b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbd24010f80 tx=0x7fbd2400e3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:27.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.522+0000 7fbd22ffd700 1 -- 172.21.15.156:0/2941503153 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2401a070 con 0x7fbd2c12d380 2023-09-30T22:21:27.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.522+0000 7fbd22ffd700 1 -- 172.21.15.156:0/2941503153 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd24011040 con 0x7fbd2c12d380 2023-09-30T22:21:27.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.522+0000 7fbd343b2700 1 -- 172.21.15.156:0/2941503153 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd28009430 con 0x7fbd2c12d380 2023-09-30T22:21:27.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.522+0000 7fbd22ffd700 1 -- 172.21.15.156:0/2941503153 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd24003a20 con 0x7fbd2c12d380 2023-09-30T22:21:27.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.522+0000 7fbd343b2700 1 -- 172.21.15.156:0/2941503153 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd2c11b240 con 0x7fbd2c12d380 2023-09-30T22:21:27.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.522+0000 7fbd22ffd700 1 -- 172.21.15.156:0/2941503153 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbd2400e9a0 con 0x7fbd2c12d380 2023-09-30T22:21:27.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.523+0000 7fbd22ffd700 1 -- 172.21.15.156:0/2941503153 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbd240417d0 con 0x7fbd2c12d380 2023-09-30T22:21:27.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.523+0000 7fbd343b2700 1 -- 172.21.15.156:0/2941503153 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd2c06f730 con 0x7fbd2c12d380 2023-09-30T22:21:27.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.527+0000 7fbd22ffd700 1 -- 172.21.15.156:0/2941503153 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd2400ee30 con 0x7fbd2c12d380 2023-09-30T22:21:27.555 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:27.571 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:27.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.680+0000 7fc262dd4700 1 Processor -- start 2023-09-30T22:21:27.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.681+0000 7fc262dd4700 1 -- start start 2023-09-30T22:21:27.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.681+0000 7fc262dd4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc25c0a1550 0x7fc25c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:27.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.681+0000 7fc262dd4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc25c139200 0x7fc25c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:27.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.681+0000 7fc262dd4700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc25c09e9d0 con 0x7fc25c0a0a70 2023-09-30T22:21:27.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.681+0000 7fc262dd4700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc25c09dc00 con 0x7fc25c0a1550 2023-09-30T22:21:27.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.681+0000 7fc262dd4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc25c09dec0 con 0x7fc25c139200 2023-09-30T22:21:27.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.681+0000 7fc261371700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc25c139200 0x7fc25c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:27.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.681+0000 7fc260b70700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc25c0a0a70 0x7fc25c0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40004/0 (socket says 172.21.15.156:40004) 2023-09-30T22:21:27.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.681+0000 7fc260b70700 1 -- 172.21.15.156:0/978502002 learned_addr learned my addr 172.21.15.156:0/978502002 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:27.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.681+0000 7fc25bfff700 1 --2- 172.21.15.156:0/978502002 >> v2:172.21.15.156:3300/0 conn(0x7fc25c0a1550 0x7fc25c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:27.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.682+0000 7fc261371700 1 -- 172.21.15.156:0/978502002 >> v2:172.21.15.156:3300/0 conn(0x7fc25c0a1550 msgr2=0x7fc25c138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:27.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.682+0000 7fc261371700 1 --2- 172.21.15.156:0/978502002 >> v2:172.21.15.156:3300/0 conn(0x7fc25c0a1550 0x7fc25c138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.682+0000 7fc261371700 1 -- 172.21.15.156:0/978502002 >> v1:172.21.15.156:6789/0 conn(0x7fc25c0a0a70 legacy=0x7fc25c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:27.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.682+0000 7fc261371700 1 -- 172.21.15.156:0/978502002 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc25c09e6a0 con 0x7fc25c139200 2023-09-30T22:21:27.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.682+0000 7fc261371700 1 --2- 172.21.15.156:0/978502002 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc25c139200 0x7fc25c13b5e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc254009d90 tx=0x7fc25400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf82dc95d2b756fe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:27.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.682+0000 7fc25b7fe700 1 -- 172.21.15.156:0/978502002 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25400e070 con 0x7fc25c139200 2023-09-30T22:21:27.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.682+0000 7fc25b7fe700 1 -- 172.21.15.156:0/978502002 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25400bb20 con 0x7fc25c139200 2023-09-30T22:21:27.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.682+0000 7fc25b7fe700 1 -- 172.21.15.156:0/978502002 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc254012430 con 0x7fc25c139200 2023-09-30T22:21:27.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.683+0000 7fc262dd4700 1 -- 172.21.15.156:0/978502002 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc25c139200 msgr2=0x7fc25c13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:27.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.683+0000 7fc262dd4700 1 --2- 172.21.15.156:0/978502002 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc25c139200 0x7fc25c13b5e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc254009d90 tx=0x7fc25400b330 comp rx=0 tx=0).stop 2023-09-30T22:21:27.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.683+0000 7fc262dd4700 1 -- 172.21.15.156:0/978502002 shutdown_connections 2023-09-30T22:21:27.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.683+0000 7fc262dd4700 1 --2- 172.21.15.156:0/978502002 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc25c139200 0x7fc25c13b5e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.683+0000 7fc262dd4700 1 --2- 172.21.15.156:0/978502002 >> v2:172.21.15.156:3300/0 conn(0x7fc25c0a1550 0x7fc25c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.683+0000 7fc262dd4700 1 -- 172.21.15.156:0/978502002 >> 172.21.15.156:0/978502002 conn(0x7fc25c0a6610 msgr2=0x7fc25c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:27.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.683+0000 7fc262dd4700 1 -- 172.21.15.156:0/978502002 shutdown_connections 2023-09-30T22:21:27.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.683+0000 7fc262dd4700 1 -- 172.21.15.156:0/978502002 wait complete. 2023-09-30T22:21:27.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.684+0000 7fc262dd4700 1 Processor -- start 2023-09-30T22:21:27.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.684+0000 7fc262dd4700 1 -- start start 2023-09-30T22:21:27.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.684+0000 7fc262dd4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc25c0a0a70 0x7fc25c1c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:27.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.684+0000 7fc262dd4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc25c0a1550 0x7fc25c1c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:27.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.684+0000 7fc262dd4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc25c139200 0x7fc25c11e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:27.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.684+0000 7fc262dd4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25c1c92a0 con 0x7fc25c0a0a70 2023-09-30T22:21:27.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.684+0000 7fc262dd4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc25c120510 con 0x7fc25c0a1550 2023-09-30T22:21:27.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.684+0000 7fc262dd4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc25c122540 con 0x7fc25c139200 2023-09-30T22:21:27.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.684+0000 7fc260b70700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc25c0a0a70 0x7fc25c1c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:27.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.684+0000 7fc260b70700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc25c0a0a70 0x7fc25c1c8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49024/0 (socket says 172.21.15.156:49024) 2023-09-30T22:21:27.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.684+0000 7fc260b70700 1 -- 172.21.15.156:0/3675779982 learned_addr learned my addr 172.21.15.156:0/3675779982 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:27.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.684+0000 7fc25bfff700 1 --2- 172.21.15.156:0/3675779982 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc25c0a1550 0x7fc25c1c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:27.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.684+0000 7fc261371700 1 --2- 172.21.15.156:0/3675779982 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc25c139200 0x7fc25c11e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:27.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.685+0000 7fc260b70700 1 -- 172.21.15.156:0/3675779982 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc25c139200 msgr2=0x7fc25c11e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:27.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.685+0000 7fc260b70700 1 --2- 172.21.15.156:0/3675779982 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc25c139200 0x7fc25c11e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.685+0000 7fc260b70700 1 -- 172.21.15.156:0/3675779982 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc25c0a1550 msgr2=0x7fc25c1c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:27.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.685+0000 7fc260b70700 1 --2- 172.21.15.156:0/3675779982 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc25c0a1550 0x7fc25c1c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.685+0000 7fc260b70700 1 -- 172.21.15.156:0/3675779982 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc254009a70 con 0x7fc25c0a0a70 2023-09-30T22:21:27.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.685+0000 7fc260b70700 1 --2- 172.21.15.156:0/3675779982 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc25c0a0a70 0x7fc25c1c8820 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc25000c520 tx=0x7fc25000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:27.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.685+0000 7fc2597fa700 1 -- 172.21.15.156:0/3675779982 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc250005d70 con 0x7fc25c0a0a70 2023-09-30T22:21:27.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.685+0000 7fc2597fa700 1 -- 172.21.15.156:0/3675779982 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2500070d0 con 0x7fc25c0a0a70 2023-09-30T22:21:27.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.685+0000 7fc262dd4700 1 -- 172.21.15.156:0/3675779982 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc25c120af0 con 0x7fc25c0a0a70 2023-09-30T22:21:27.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.685+0000 7fc2597fa700 1 -- 172.21.15.156:0/3675779982 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc250007440 con 0x7fc25c0a0a70 2023-09-30T22:21:27.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.685+0000 7fc262dd4700 1 -- 172.21.15.156:0/3675779982 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc25c0a03e0 con 0x7fc25c0a0a70 2023-09-30T22:21:27.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.686+0000 7fc2597fa700 1 -- 172.21.15.156:0/3675779982 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc2500075a0 con 0x7fc25c0a0a70 2023-09-30T22:21:27.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.686+0000 7fc2597fa700 1 -- 172.21.15.156:0/3675779982 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc25003ea30 con 0x7fc25c0a0a70 2023-09-30T22:21:27.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.686+0000 7fc262dd4700 1 -- 172.21.15.156:0/3675779982 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc25c0a5220 con 0x7fc25c0a0a70 2023-09-30T22:21:27.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.691+0000 7fc2597fa700 1 -- 172.21.15.156:0/3675779982 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc250017020 con 0x7fc25c0a0a70 2023-09-30T22:21:27.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.730+0000 7fe8771fc700 1 Processor -- start 2023-09-30T22:21:27.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.731+0000 7fe8771fc700 1 -- start start 2023-09-30T22:21:27.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.731+0000 7fe8771fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe87009f350 0x7fe870136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:27.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.731+0000 7fe8771fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe8701371c0 0x7fe8701395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:27.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.731+0000 7fe8771fc700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe87009c970 con 0x7fe87009e870 2023-09-30T22:21:27.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.731+0000 7fe8771fc700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8700a0920 con 0x7fe87009f350 2023-09-30T22:21:27.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.731+0000 7fe8771fc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe87009f9c0 con 0x7fe8701371c0 2023-09-30T22:21:27.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.731+0000 7fe875799700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe8701371c0 0x7fe8701395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:27.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.731+0000 7fe86ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe87009f350 0x7fe870136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:27.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.731+0000 7fe875799700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe8701371c0 0x7fe8701395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:60190/0 (socket says 172.21.15.156:60190) 2023-09-30T22:21:27.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.731+0000 7fe875799700 1 -- 172.21.15.156:0/1420158886 learned_addr learned my addr 172.21.15.156:0/1420158886 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:27.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.732+0000 7fe875799700 1 -- 172.21.15.156:0/1420158886 >> v2:172.21.15.156:3300/0 conn(0x7fe87009f350 msgr2=0x7fe870136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:27.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.732+0000 7fe875799700 1 --2- 172.21.15.156:0/1420158886 >> v2:172.21.15.156:3300/0 conn(0x7fe87009f350 0x7fe870136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.732+0000 7fe875799700 1 -- 172.21.15.156:0/1420158886 >> v1:172.21.15.156:6789/0 conn(0x7fe87009e870 legacy=0x7fe87009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:27.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.732+0000 7fe875799700 1 -- 172.21.15.156:0/1420158886 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87009bab0 con 0x7fe8701371c0 2023-09-30T22:21:27.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.732+0000 7fe86ffff700 1 --2- 172.21.15.156:0/1420158886 >> v2:172.21.15.156:3300/0 conn(0x7fe87009f350 0x7fe870136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:27.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.732+0000 7fe875799700 1 --2- 172.21.15.156:0/1420158886 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe8701371c0 0x7fe8701395a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe868009e50 tx=0x7fe86800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acc1b0118d1897f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:27.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.732+0000 7fe86f7fe700 1 -- 172.21.15.156:0/1420158886 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86800e070 con 0x7fe8701371c0 2023-09-30T22:21:27.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.732+0000 7fe86f7fe700 1 -- 172.21.15.156:0/1420158886 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86800b910 con 0x7fe8701371c0 2023-09-30T22:21:27.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.732+0000 7fe86f7fe700 1 -- 172.21.15.156:0/1420158886 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86800bcc0 con 0x7fe8701371c0 2023-09-30T22:21:27.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.733+0000 7fe8771fc700 1 -- 172.21.15.156:0/1420158886 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe8701371c0 msgr2=0x7fe8701395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:27.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.733+0000 7fe8771fc700 1 --2- 172.21.15.156:0/1420158886 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe8701371c0 0x7fe8701395a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe868009e50 tx=0x7fe86800b330 comp rx=0 tx=0).stop 2023-09-30T22:21:27.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.733+0000 7fe8771fc700 1 -- 172.21.15.156:0/1420158886 shutdown_connections 2023-09-30T22:21:27.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.733+0000 7fe8771fc700 1 --2- 172.21.15.156:0/1420158886 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe8701371c0 0x7fe8701395a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.733+0000 7fe8771fc700 1 --2- 172.21.15.156:0/1420158886 >> v2:172.21.15.156:3300/0 conn(0x7fe87009f350 0x7fe870136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.733+0000 7fe8771fc700 1 -- 172.21.15.156:0/1420158886 >> 172.21.15.156:0/1420158886 conn(0x7fe8700a4430 msgr2=0x7fe8700a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:27.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.733+0000 7fe8771fc700 1 -- 172.21.15.156:0/1420158886 shutdown_connections 2023-09-30T22:21:27.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.733+0000 7fe8771fc700 1 -- 172.21.15.156:0/1420158886 wait complete. 2023-09-30T22:21:27.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.734+0000 7fe8771fc700 1 Processor -- start 2023-09-30T22:21:27.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.734+0000 7fe8771fc700 1 -- start start 2023-09-30T22:21:27.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.735+0000 7fbd343b2700 1 -- 172.21.15.156:0/2941503153 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbd2c11ccf0 con 0x7fbd2c12d380 2023-09-30T22:21:27.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.735+0000 7fe8771fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe87009e870 0x7fe87011e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:27.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.735+0000 7fe8771fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe87009f350 0x7fe87011ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:27.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.735+0000 7fbd22ffd700 1 -- 172.21.15.156:0/2941503153 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbd24014340 con 0x7fbd2c12d380 2023-09-30T22:21:27.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.735+0000 7fe8771fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8701371c0 0x7fe87011f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:27.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.735+0000 7fe8771fc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe870133f80 con 0x7fe8701371c0 2023-09-30T22:21:27.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.735+0000 7fe8771fc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe870122190 con 0x7fe87009e870 2023-09-30T22:21:27.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.735+0000 7fe8771fc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe87009dba0 con 0x7fe87009f350 2023-09-30T22:21:27.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.735+0000 7fe86ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe87009f350 0x7fe87011ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:27.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.735+0000 7fe86ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe87009f350 0x7fe87011ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:60202/0 (socket says 172.21.15.156:60202) 2023-09-30T22:21:27.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.735+0000 7fe86ffff700 1 -- 172.21.15.156:0/1398426543 learned_addr learned my addr 172.21.15.156:0/1398426543 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:27.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.735+0000 7fe874f98700 1 --2- 172.21.15.156:0/1398426543 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe87009e870 0x7fe87011e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:27.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.735+0000 7fe875799700 1 --2- 172.21.15.156:0/1398426543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8701371c0 0x7fe87011f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:27.739 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:27.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.736+0000 7fe86ffff700 1 -- 172.21.15.156:0/1398426543 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe87009e870 msgr2=0x7fe87011e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:27.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.736+0000 7fe86ffff700 1 --2- 172.21.15.156:0/1398426543 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe87009e870 0x7fe87011e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.736+0000 7fe86ffff700 1 -- 172.21.15.156:0/1398426543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8701371c0 msgr2=0x7fe87011f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:27.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.736+0000 7fe86ffff700 1 --2- 172.21.15.156:0/1398426543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8701371c0 0x7fe87011f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.736+0000 7fe86ffff700 1 -- 172.21.15.156:0/1398426543 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85c0094a0 con 0x7fe87009f350 2023-09-30T22:21:27.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.736+0000 7fe875799700 1 --2- 172.21.15.156:0/1398426543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8701371c0 0x7fe87011f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:27.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.736+0000 7fe86ffff700 1 --2- 172.21.15.156:0/1398426543 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe87009f350 0x7fe87011ebb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe85c00ebe0 tx=0x7fe85c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:27.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.736+0000 7fe86d7fa700 1 -- 172.21.15.156:0/1398426543 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c00c850 con 0x7fe87009f350 2023-09-30T22:21:27.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.736+0000 7fe86d7fa700 1 -- 172.21.15.156:0/1398426543 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85c00c9b0 con 0x7fe87009f350 2023-09-30T22:21:27.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.736+0000 7fe8771fc700 1 -- 172.21.15.156:0/1398426543 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe868009b30 con 0x7fe87009f350 2023-09-30T22:21:27.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.736+0000 7fe86d7fa700 1 -- 172.21.15.156:0/1398426543 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c00cd40 con 0x7fe87009f350 2023-09-30T22:21:27.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.736+0000 7fe8771fc700 1 -- 172.21.15.156:0/1398426543 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe870121bf0 con 0x7fe87009f350 2023-09-30T22:21:27.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.737+0000 7fe86d7fa700 1 -- 172.21.15.156:0/1398426543 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe85c013470 con 0x7fe87009f350 2023-09-30T22:21:27.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.737+0000 7fe86d7fa700 1 -- 172.21.15.156:0/1398426543 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe85c03fb10 con 0x7fe87009f350 2023-09-30T22:21:27.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.737+0000 7fe8771fc700 1 -- 172.21.15.156:0/1398426543 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe87004f2a0 con 0x7fe87009f350 2023-09-30T22:21:27.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.738+0000 7fbd343b2700 1 -- 172.21.15.156:0/2941503153 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd2c12d380 msgr2=0x7fbd2c11a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:27.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.738+0000 7fbd343b2700 1 --2- 172.21.15.156:0/2941503153 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd2c12d380 0x7fbd2c11a0b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbd24010f80 tx=0x7fbd2400e3a0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.738+0000 7fbd343b2700 1 -- 172.21.15.156:0/2941503153 shutdown_connections 2023-09-30T22:21:27.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.738+0000 7fbd343b2700 1 --2- 172.21.15.156:0/2941503153 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd2c12d380 0x7fbd2c11a0b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.738+0000 7fbd343b2700 1 --2- 172.21.15.156:0/2941503153 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd2c099a60 0x7fbd2c119630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.738+0000 7fbd343b2700 1 --2- 172.21.15.156:0/2941503153 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd2c09a5a0 0x7fbd2c119b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.738+0000 7fbd343b2700 1 -- 172.21.15.156:0/2941503153 >> 172.21.15.156:0/2941503153 conn(0x7fbd2c0a2980 msgr2=0x7fbd2c130d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:27.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.738+0000 7fbd343b2700 1 -- 172.21.15.156:0/2941503153 shutdown_connections 2023-09-30T22:21:27.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.738+0000 7fbd343b2700 1 -- 172.21.15.156:0/2941503153 wait complete. 2023-09-30T22:21:27.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.742+0000 7fe86d7fa700 1 -- 172.21.15.156:0/1398426543 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe85c021080 con 0x7fe87009f350 2023-09-30T22:21:27.755 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:27.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.889+0000 7fc262dd4700 1 -- 172.21.15.156:0/3675779982 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc25c04f2a0 con 0x7fc25c0a0a70 2023-09-30T22:21:27.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.890+0000 7fc2597fa700 1 -- 172.21.15.156:0/3675779982 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc250019b40 con 0x7fc25c0a0a70 2023-09-30T22:21:27.891 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:27.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.892+0000 7fc262dd4700 1 -- 172.21.15.156:0/3675779982 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc25c0a0a70 msgr2=0x7fc25c1c8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:27.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.892+0000 7fc262dd4700 1 --2- 172.21.15.156:0/3675779982 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc25c0a0a70 0x7fc25c1c8820 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc25000c520 tx=0x7fc25000c830 comp rx=0 tx=0).stop 2023-09-30T22:21:27.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.892+0000 7fc262dd4700 1 -- 172.21.15.156:0/3675779982 shutdown_connections 2023-09-30T22:21:27.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.892+0000 7fc262dd4700 1 --2- 172.21.15.156:0/3675779982 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc25c139200 0x7fc25c11e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.892+0000 7fc262dd4700 1 --2- 172.21.15.156:0/3675779982 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc25c0a0a70 0x7fc25c1c8820 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.892+0000 7fc262dd4700 1 --2- 172.21.15.156:0/3675779982 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc25c0a1550 0x7fc25c1c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.892+0000 7fc262dd4700 1 -- 172.21.15.156:0/3675779982 >> 172.21.15.156:0/3675779982 conn(0x7fc25c0a6610 msgr2=0x7fc25c138120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:27.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.892+0000 7fc262dd4700 1 -- 172.21.15.156:0/3675779982 shutdown_connections 2023-09-30T22:21:27.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.892+0000 7fc262dd4700 1 -- 172.21.15.156:0/3675779982 wait complete. 2023-09-30T22:21:27.904 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:27.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.940+0000 7fe8771fc700 1 -- 172.21.15.156:0/1398426543 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe870120a70 con 0x7fe87009f350 2023-09-30T22:21:27.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.941+0000 7fe86d7fa700 1 -- 172.21.15.156:0/1398426543 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe85c00cea0 con 0x7fe87009f350 2023-09-30T22:21:27.941 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:27.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.943+0000 7fe8771fc700 1 -- 172.21.15.156:0/1398426543 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe87009f350 msgr2=0x7fe87011ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:27.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.943+0000 7fe8771fc700 1 --2- 172.21.15.156:0/1398426543 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe87009f350 0x7fe87011ebb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe85c00ebe0 tx=0x7fe85c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.943+0000 7fe8771fc700 1 -- 172.21.15.156:0/1398426543 shutdown_connections 2023-09-30T22:21:27.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.943+0000 7fe8771fc700 1 --2- 172.21.15.156:0/1398426543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8701371c0 0x7fe87011f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.943+0000 7fe8771fc700 1 --2- 172.21.15.156:0/1398426543 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe87009e870 0x7fe87011e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.943+0000 7fe8771fc700 1 --2- 172.21.15.156:0/1398426543 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe87009f350 0x7fe87011ebb0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:27.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.943+0000 7fe8771fc700 1 -- 172.21.15.156:0/1398426543 >> 172.21.15.156:0/1398426543 conn(0x7fe8700a4430 msgr2=0x7fe870134960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:27.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.943+0000 7fe8771fc700 1 -- 172.21.15.156:0/1398426543 shutdown_connections 2023-09-30T22:21:27.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:27.943+0000 7fe8771fc700 1 -- 172.21.15.156:0/1398426543 wait complete. 2023-09-30T22:21:27.955 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:28.210 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:28.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.333+0000 7f401c5ed700 1 Processor -- start 2023-09-30T22:21:28.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.333+0000 7f401c5ed700 1 -- start start 2023-09-30T22:21:28.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.334+0000 7f401c5ed700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f401409e870 0x7f401409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:28.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.334+0000 7f401c5ed700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f401409f180 0x7f4014131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:28.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.334+0000 7f401c5ed700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f401409c970 con 0x7f4014131d70 2023-09-30T22:21:28.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.334+0000 7f401c5ed700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40140a0920 con 0x7f401409e870 2023-09-30T22:21:28.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.334+0000 7f401c5ed700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f401409f9c0 con 0x7f401409f180 2023-09-30T22:21:28.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.334+0000 7f401a389700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f401409e870 0x7f401409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:28.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.334+0000 7f4019b88700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f401409f180 0x7f4014131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:28.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.334+0000 7f401ab8a700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4014131d70 0x7f4014138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40014/0 (socket says 172.21.15.156:40014) 2023-09-30T22:21:28.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.334+0000 7f401ab8a700 1 -- 172.21.15.156:0/3013770462 learned_addr learned my addr 172.21.15.156:0/3013770462 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:28.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.335+0000 7f4019b88700 1 -- 172.21.15.156:0/3013770462 >> v2:172.21.15.156:3300/0 conn(0x7f401409e870 msgr2=0x7f401409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:28.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.335+0000 7f4019b88700 1 --2- 172.21.15.156:0/3013770462 >> v2:172.21.15.156:3300/0 conn(0x7f401409e870 0x7f401409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:28.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.335+0000 7f4019b88700 1 -- 172.21.15.156:0/3013770462 >> v1:172.21.15.156:6789/0 conn(0x7f4014131d70 legacy=0x7f4014138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:28.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.335+0000 7f4019387700 1 -- 172.21.15.156:0/3013770462 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1271740424 0 0) 0x7f401409c970 con 0x7f4014131d70 2023-09-30T22:21:28.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.335+0000 7f4019b88700 1 -- 172.21.15.156:0/3013770462 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401409bab0 con 0x7f401409f180 2023-09-30T22:21:28.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.335+0000 7f401a389700 1 --2- 172.21.15.156:0/3013770462 >> v2:172.21.15.156:3300/0 conn(0x7f401409e870 0x7f401409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:28.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.335+0000 7f4019b88700 1 --2- 172.21.15.156:0/3013770462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f401409f180 0x7f4014131830 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4010009840 tx=0x7f4010009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=565b4fd3b03fee76 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:28.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.335+0000 7f4019387700 1 -- 172.21.15.156:0/3013770462 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4010011830 con 0x7f401409f180 2023-09-30T22:21:28.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.335+0000 7f4019387700 1 -- 172.21.15.156:0/3013770462 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4010011990 con 0x7f401409f180 2023-09-30T22:21:28.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.335+0000 7f4019387700 1 -- 172.21.15.156:0/3013770462 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4010011d20 con 0x7f401409f180 2023-09-30T22:21:28.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.335+0000 7f401c5ed700 1 -- 172.21.15.156:0/3013770462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f401409f180 msgr2=0x7f4014131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:28.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.335+0000 7f401c5ed700 1 --2- 172.21.15.156:0/3013770462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f401409f180 0x7f4014131830 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4010009840 tx=0x7f4010009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:28.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.336+0000 7f401c5ed700 1 -- 172.21.15.156:0/3013770462 shutdown_connections 2023-09-30T22:21:28.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.336+0000 7f401c5ed700 1 --2- 172.21.15.156:0/3013770462 >> v2:172.21.15.156:3300/0 conn(0x7f401409e870 0x7f401409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:28.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.336+0000 7f401c5ed700 1 --2- 172.21.15.156:0/3013770462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f401409f180 0x7f4014131830 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:28.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.336+0000 7f401c5ed700 1 -- 172.21.15.156:0/3013770462 >> 172.21.15.156:0/3013770462 conn(0x7f40140a4430 msgr2=0x7f40140a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:28.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.336+0000 7f401c5ed700 1 -- 172.21.15.156:0/3013770462 shutdown_connections 2023-09-30T22:21:28.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.336+0000 7f401c5ed700 1 -- 172.21.15.156:0/3013770462 wait complete. 2023-09-30T22:21:28.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.337+0000 7f401c5ed700 1 Processor -- start 2023-09-30T22:21:28.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.337+0000 7f401c5ed700 1 -- start start 2023-09-30T22:21:28.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.337+0000 7f401c5ed700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f401409e870 0x7f401411f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:28.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.338+0000 7f401c5ed700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f401409f180 0x7f401411f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:28.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.338+0000 7f401c5ed700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4014131d70 0x7f401411fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:28.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.338+0000 7f401c5ed700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4014121da0 con 0x7f401409e870 2023-09-30T22:21:28.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.338+0000 7f401c5ed700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4014122db0 con 0x7f4014131d70 2023-09-30T22:21:28.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.338+0000 7f401c5ed700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40141228a0 con 0x7f401409f180 2023-09-30T22:21:28.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.338+0000 7f401a389700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f401409e870 0x7f401411f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:28.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.338+0000 7f401a389700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f401409e870 0x7f401411f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49062/0 (socket says 172.21.15.156:49062) 2023-09-30T22:21:28.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.338+0000 7f401a389700 1 -- 172.21.15.156:0/2969775835 learned_addr learned my addr 172.21.15.156:0/2969775835 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:28.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.338+0000 7f4019b88700 1 --2- 172.21.15.156:0/2969775835 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f401409f180 0x7f401411f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:28.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.338+0000 7f401ab8a700 1 --2- 172.21.15.156:0/2969775835 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4014131d70 0x7f401411fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:28.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.338+0000 7f401a389700 1 -- 172.21.15.156:0/2969775835 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f401409f180 msgr2=0x7f401411f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:28.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.338+0000 7f401a389700 1 --2- 172.21.15.156:0/2969775835 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f401409f180 0x7f401411f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:28.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.338+0000 7f401a389700 1 -- 172.21.15.156:0/2969775835 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4014131d70 msgr2=0x7f401411fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:28.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.338+0000 7f401a389700 1 --2- 172.21.15.156:0/2969775835 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4014131d70 0x7f401411fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:28.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.338+0000 7f401a389700 1 -- 172.21.15.156:0/2969775835 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40040094a0 con 0x7f401409e870 2023-09-30T22:21:28.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.338+0000 7f4019b88700 1 --2- 172.21.15.156:0/2969775835 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f401409f180 0x7f401411f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:28.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.338+0000 7f401a389700 1 --2- 172.21.15.156:0/2969775835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f401409e870 0x7f401411f2e0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f400400ec10 tx=0x7f400400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:28.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.338+0000 7f400affd700 1 -- 172.21.15.156:0/2969775835 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004009760 con 0x7f401409e870 2023-09-30T22:21:28.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.338+0000 7f400affd700 1 -- 172.21.15.156:0/2969775835 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400400c850 con 0x7f401409e870 2023-09-30T22:21:28.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.338+0000 7f401c5ed700 1 -- 172.21.15.156:0/2969775835 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40100094a0 con 0x7f401409e870 2023-09-30T22:21:28.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.338+0000 7f400affd700 1 -- 172.21.15.156:0/2969775835 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400400cbe0 con 0x7f401409e870 2023-09-30T22:21:28.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.338+0000 7f401c5ed700 1 -- 172.21.15.156:0/2969775835 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4014130660 con 0x7f401409e870 2023-09-30T22:21:28.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.339+0000 7f400affd700 1 -- 172.21.15.156:0/2969775835 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f400400cd40 con 0x7f401409e870 2023-09-30T22:21:28.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.339+0000 7f400affd700 1 -- 172.21.15.156:0/2969775835 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f400403f770 con 0x7f401409e870 2023-09-30T22:21:28.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.339+0000 7f401c5ed700 1 -- 172.21.15.156:0/2969775835 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f401409b0e0 con 0x7f401409e870 2023-09-30T22:21:28.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.344+0000 7f400affd700 1 -- 172.21.15.156:0/2969775835 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f40040232f0 con 0x7f401409e870 2023-09-30T22:21:28.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.525+0000 7f401c5ed700 1 -- 172.21.15.156:0/2969775835 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f401411be60 con 0x7f401409e870 2023-09-30T22:21:28.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.526+0000 7f400affd700 1 -- 172.21.15.156:0/2969775835 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f400401bba0 con 0x7f401409e870 2023-09-30T22:21:28.526 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:28.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.527+0000 7f401c5ed700 1 -- 172.21.15.156:0/2969775835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f401409e870 msgr2=0x7f401411f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:28.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.527+0000 7f401c5ed700 1 --2- 172.21.15.156:0/2969775835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f401409e870 0x7f401411f2e0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f400400ec10 tx=0x7f400400ef20 comp rx=0 tx=0).stop 2023-09-30T22:21:28.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.527+0000 7f401c5ed700 1 -- 172.21.15.156:0/2969775835 shutdown_connections 2023-09-30T22:21:28.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.527+0000 7f401c5ed700 1 --2- 172.21.15.156:0/2969775835 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4014131d70 0x7f401411fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:28.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.527+0000 7f401c5ed700 1 --2- 172.21.15.156:0/2969775835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f401409e870 0x7f401411f2e0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:28.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.527+0000 7f401c5ed700 1 --2- 172.21.15.156:0/2969775835 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f401409f180 0x7f401411f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:28.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.527+0000 7f401c5ed700 1 -- 172.21.15.156:0/2969775835 >> 172.21.15.156:0/2969775835 conn(0x7f40140a4430 msgr2=0x7f4014131120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:28.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.528+0000 7f401c5ed700 1 -- 172.21.15.156:0/2969775835 shutdown_connections 2023-09-30T22:21:28.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.528+0000 7f401c5ed700 1 -- 172.21.15.156:0/2969775835 wait complete. 2023-09-30T22:21:28.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:28.756 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:28.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.882+0000 7f70c148c700 1 Processor -- start 2023-09-30T22:21:28.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.882+0000 7f70c148c700 1 -- start start 2023-09-30T22:21:28.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.882+0000 7f70c148c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70bc0a1550 0x7f70bc138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:28.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.882+0000 7f70c148c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70bc139200 0x7f70bc13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:28.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.882+0000 7f70c148c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70bc09e9d0 con 0x7f70bc0a0a70 2023-09-30T22:21:28.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.882+0000 7f70c148c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc09dc00 con 0x7f70bc139200 2023-09-30T22:21:28.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.882+0000 7f70c148c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc09dec0 con 0x7f70bc0a1550 2023-09-30T22:21:28.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.882+0000 7f70ba7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70bc0a1550 0x7f70bc138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:28.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.882+0000 7f70baffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f70bc0a0a70 0x7f70bc0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40022/0 (socket says 172.21.15.156:40022) 2023-09-30T22:21:28.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.882+0000 7f70baffd700 1 -- 172.21.15.156:0/148044770 learned_addr learned my addr 172.21.15.156:0/148044770 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:28.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.882+0000 7f70bb7fe700 1 --2- 172.21.15.156:0/148044770 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70bc139200 0x7f70bc13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:28.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.883+0000 7f70b9ffb700 1 -- 172.21.15.156:0/148044770 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210301846 0 0) 0x7f70bc09e9d0 con 0x7f70bc0a0a70 2023-09-30T22:21:28.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.883+0000 7f70ba7fc700 1 -- 172.21.15.156:0/148044770 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70bc139200 msgr2=0x7f70bc13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:28.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.883+0000 7f70ba7fc700 1 --2- 172.21.15.156:0/148044770 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70bc139200 0x7f70bc13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:28.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.883+0000 7f70ba7fc700 1 -- 172.21.15.156:0/148044770 >> v1:172.21.15.156:6789/0 conn(0x7f70bc0a0a70 legacy=0x7f70bc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:28.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.883+0000 7f70ba7fc700 1 -- 172.21.15.156:0/148044770 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70bc09e6a0 con 0x7f70bc0a1550 2023-09-30T22:21:28.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.883+0000 7f70ba7fc700 1 --2- 172.21.15.156:0/148044770 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70bc0a1550 0x7f70bc138cc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f70b0009870 tx=0x7f70b0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ca4b355ef6334ab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:28.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.883+0000 7f70b9ffb700 1 -- 172.21.15.156:0/148044770 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b0011830 con 0x7f70bc0a1550 2023-09-30T22:21:28.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.883+0000 7f70b9ffb700 1 -- 172.21.15.156:0/148044770 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b0011990 con 0x7f70bc0a1550 2023-09-30T22:21:28.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.883+0000 7f70b9ffb700 1 -- 172.21.15.156:0/148044770 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b0011d20 con 0x7f70bc0a1550 2023-09-30T22:21:28.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.883+0000 7f70c148c700 1 -- 172.21.15.156:0/148044770 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70bc0a1550 msgr2=0x7f70bc138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:28.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.883+0000 7f70c148c700 1 --2- 172.21.15.156:0/148044770 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70bc0a1550 0x7f70bc138cc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f70b0009870 tx=0x7f70b0009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:28.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.884+0000 7f70c148c700 1 -- 172.21.15.156:0/148044770 shutdown_connections 2023-09-30T22:21:28.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.884+0000 7f70c148c700 1 --2- 172.21.15.156:0/148044770 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70bc139200 0x7f70bc13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:28.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.884+0000 7f70c148c700 1 --2- 172.21.15.156:0/148044770 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70bc0a1550 0x7f70bc138cc0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:28.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.884+0000 7f70c148c700 1 -- 172.21.15.156:0/148044770 >> 172.21.15.156:0/148044770 conn(0x7f70bc0a6610 msgr2=0x7f70bc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:28.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.884+0000 7f70c148c700 1 -- 172.21.15.156:0/148044770 shutdown_connections 2023-09-30T22:21:28.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.884+0000 7f70c148c700 1 -- 172.21.15.156:0/148044770 wait complete. 2023-09-30T22:21:28.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.885+0000 7f70c148c700 1 Processor -- start 2023-09-30T22:21:28.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.885+0000 7f70c148c700 1 -- start start 2023-09-30T22:21:28.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.885+0000 7f70c148c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70bc0a0a70 0x7f70bc11e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:28.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.885+0000 7f70c148c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70bc0a1550 0x7f70bc11eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:28.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.885+0000 7f70c148c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70bc139200 0x7f70bc11f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:28.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.885+0000 7f70c148c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc1220a0 con 0x7f70bc0a1550 2023-09-30T22:21:28.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.885+0000 7f70c148c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc1224c0 con 0x7f70bc0a0a70 2023-09-30T22:21:28.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.885+0000 7f70c148c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc121af0 con 0x7f70bc139200 2023-09-30T22:21:28.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.885+0000 7f70ba7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70bc0a1550 0x7f70bc11eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:28.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.885+0000 7f70baffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70bc0a0a70 0x7f70bc11e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:28.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.885+0000 7f70ba7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70bc0a1550 0x7f70bc11eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49068/0 (socket says 172.21.15.156:49068) 2023-09-30T22:21:28.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.885+0000 7f70bb7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70bc139200 0x7f70bc11f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:28.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.885+0000 7f70ba7fc700 1 -- 172.21.15.156:0/2866228583 learned_addr learned my addr 172.21.15.156:0/2866228583 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:28.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.885+0000 7f70baffd700 1 -- 172.21.15.156:0/2866228583 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70bc139200 msgr2=0x7f70bc11f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:28.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.885+0000 7f70baffd700 1 --2- 172.21.15.156:0/2866228583 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70bc139200 0x7f70bc11f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:28.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.885+0000 7f70baffd700 1 -- 172.21.15.156:0/2866228583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70bc0a1550 msgr2=0x7f70bc11eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:28.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.885+0000 7f70baffd700 1 --2- 172.21.15.156:0/2866228583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70bc0a1550 0x7f70bc11eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:28.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.885+0000 7f70baffd700 1 -- 172.21.15.156:0/2866228583 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b00094a0 con 0x7f70bc0a0a70 2023-09-30T22:21:28.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.885+0000 7f70ba7fc700 1 --2- 172.21.15.156:0/2866228583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70bc0a1550 0x7f70bc11eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:28.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.886+0000 7f70baffd700 1 --2- 172.21.15.156:0/2866228583 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70bc0a0a70 0x7f70bc11e860 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f70ac00c470 tx=0x7f70ac00c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:28.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.886+0000 7f70a37fe700 1 -- 172.21.15.156:0/2866228583 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac004c80 con 0x7f70bc0a0a70 2023-09-30T22:21:28.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.886+0000 7f70a37fe700 1 -- 172.21.15.156:0/2866228583 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ac004de0 con 0x7f70bc0a0a70 2023-09-30T22:21:28.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.886+0000 7f70c148c700 1 -- 172.21.15.156:0/2866228583 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70bc09d3a0 con 0x7f70bc0a0a70 2023-09-30T22:21:28.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.886+0000 7f70a37fe700 1 -- 172.21.15.156:0/2866228583 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac007310 con 0x7f70bc0a0a70 2023-09-30T22:21:28.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.886+0000 7f70c148c700 1 -- 172.21.15.156:0/2866228583 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70bc120c20 con 0x7f70bc0a0a70 2023-09-30T22:21:28.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.886+0000 7f70a37fe700 1 -- 172.21.15.156:0/2866228583 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f70ac007470 con 0x7f70bc0a0a70 2023-09-30T22:21:28.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.887+0000 7f70a37fe700 1 -- 172.21.15.156:0/2866228583 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f70ac03f2d0 con 0x7f70bc0a0a70 2023-09-30T22:21:28.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.887+0000 7f70c148c700 1 -- 172.21.15.156:0/2866228583 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70bc04f2a0 con 0x7f70bc0a0a70 2023-09-30T22:21:28.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:28.891+0000 7f70a37fe700 1 -- 172.21.15.156:0/2866228583 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f70ac007720 con 0x7f70bc0a0a70 2023-09-30T22:21:28.905 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:28.957 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:29.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.030+0000 7f6a3b524700 1 Processor -- start 2023-09-30T22:21:29.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.031+0000 7f6a3b524700 1 -- start start 2023-09-30T22:21:29.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.031+0000 7f6a3b524700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a3409f430 0x7f6a34136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:29.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.031+0000 7f6a3b524700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6a34137010 0x7f6a341393f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:29.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.031+0000 7f6a3b524700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3409b6d0 con 0x7f6a3409e950 2023-09-30T22:21:29.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.031+0000 7f6a3b524700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a3409afb0 con 0x7f6a34137010 2023-09-30T22:21:29.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.031+0000 7f6a3b524700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a340a0970 con 0x7f6a3409f430 2023-09-30T22:21:29.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.032+0000 7f6a39ac1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6a34137010 0x7f6a341393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:29.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.032+0000 7f6a38abf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a3409f430 0x7f6a34136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:29.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.032+0000 7f6a392c0700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6a3409e950 0x7f6a3409ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40038/0 (socket says 172.21.15.156:40038) 2023-09-30T22:21:29.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.032+0000 7f6a392c0700 1 -- 172.21.15.156:0/851470912 learned_addr learned my addr 172.21.15.156:0/851470912 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:29.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.032+0000 7f6a39ac1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6a34137010 0x7f6a341393f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49080/0 (socket says 172.21.15.156:49080) 2023-09-30T22:21:29.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.032+0000 7f6a39ac1700 1 -- 172.21.15.156:0/851470912 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a3409f430 msgr2=0x7f6a34136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:29.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.032+0000 7f6a39ac1700 1 --2- 172.21.15.156:0/851470912 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a3409f430 0x7f6a34136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.032+0000 7f6a39ac1700 1 -- 172.21.15.156:0/851470912 >> v1:172.21.15.156:6789/0 conn(0x7f6a3409e950 legacy=0x7f6a3409ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:29.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.032+0000 7f6a2bfff700 1 -- 172.21.15.156:0/851470912 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3594758653 0 0) 0x7f6a3409b6d0 con 0x7f6a3409e950 2023-09-30T22:21:29.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.032+0000 7f6a39ac1700 1 -- 172.21.15.156:0/851470912 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a340a0320 con 0x7f6a34137010 2023-09-30T22:21:29.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.032+0000 7f6a39ac1700 1 --2- 172.21.15.156:0/851470912 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a34137010 0x7f6a341393f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c009d90 tx=0x7f6a2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb60918d34689adc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:29.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.032+0000 7f6a2bfff700 1 -- 172.21.15.156:0/851470912 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c00e070 con 0x7f6a34137010 2023-09-30T22:21:29.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.032+0000 7f6a2bfff700 1 -- 172.21.15.156:0/851470912 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c00bb20 con 0x7f6a34137010 2023-09-30T22:21:29.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.032+0000 7f6a2bfff700 1 -- 172.21.15.156:0/851470912 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c012430 con 0x7f6a34137010 2023-09-30T22:21:29.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.033+0000 7f6a3b524700 1 -- 172.21.15.156:0/851470912 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a34137010 msgr2=0x7f6a341393f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:29.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.033+0000 7f6a3b524700 1 --2- 172.21.15.156:0/851470912 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a34137010 0x7f6a341393f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c009d90 tx=0x7f6a2c00b330 comp rx=0 tx=0).stop 2023-09-30T22:21:29.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.033+0000 7f6a3b524700 1 -- 172.21.15.156:0/851470912 shutdown_connections 2023-09-30T22:21:29.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.033+0000 7f6a3b524700 1 --2- 172.21.15.156:0/851470912 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a34137010 0x7f6a341393f0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.033+0000 7f6a3b524700 1 --2- 172.21.15.156:0/851470912 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a3409f430 0x7f6a34136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.033+0000 7f6a3b524700 1 -- 172.21.15.156:0/851470912 >> 172.21.15.156:0/851470912 conn(0x7f6a340a0f70 msgr2=0x7f6a340a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:29.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.033+0000 7f6a3b524700 1 -- 172.21.15.156:0/851470912 shutdown_connections 2023-09-30T22:21:29.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.033+0000 7f6a3b524700 1 -- 172.21.15.156:0/851470912 wait complete. 2023-09-30T22:21:29.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.034+0000 7f6a3b524700 1 Processor -- start 2023-09-30T22:21:29.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.034+0000 7f6a3b524700 1 -- start start 2023-09-30T22:21:29.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.035+0000 7f6a3b524700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6a3409e950 0x7f6a341c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:29.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.035+0000 7f6a3b524700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a3409f430 0x7f6a341c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:29.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.035+0000 7f6a3b524700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a34137010 0x7f6a341c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:29.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.035+0000 7f6a3b524700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3406d4c0 con 0x7f6a34137010 2023-09-30T22:21:29.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.035+0000 7f6a3b524700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a341250f0 con 0x7f6a3409f430 2023-09-30T22:21:29.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.035+0000 7f6a3b524700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a34125360 con 0x7f6a3409e950 2023-09-30T22:21:29.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.035+0000 7f6a38abf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a3409f430 0x7f6a341c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:29.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.035+0000 7f6a38abf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a3409f430 0x7f6a341c8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38938/0 (socket says 172.21.15.156:38938) 2023-09-30T22:21:29.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.035+0000 7f6a38abf700 1 -- 172.21.15.156:0/2245953209 learned_addr learned my addr 172.21.15.156:0/2245953209 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:29.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.035+0000 7f6a392c0700 1 --2- 172.21.15.156:0/2245953209 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6a3409e950 0x7f6a341c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:29.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.035+0000 7f6a39ac1700 1 --2- 172.21.15.156:0/2245953209 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a34137010 0x7f6a341c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:29.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.035+0000 7f6a38abf700 1 -- 172.21.15.156:0/2245953209 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6a3409e950 msgr2=0x7f6a341c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:29.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.035+0000 7f6a38abf700 1 --2- 172.21.15.156:0/2245953209 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6a3409e950 0x7f6a341c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.035+0000 7f6a38abf700 1 -- 172.21.15.156:0/2245953209 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a34137010 msgr2=0x7f6a341c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:29.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.035+0000 7f6a38abf700 1 --2- 172.21.15.156:0/2245953209 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a34137010 0x7f6a341c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.035+0000 7f6a38abf700 1 -- 172.21.15.156:0/2245953209 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c009a70 con 0x7f6a3409f430 2023-09-30T22:21:29.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.036+0000 7f6a38abf700 1 --2- 172.21.15.156:0/2245953209 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a3409f430 0x7f6a341c8760 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400e9b0 tx=0x7f6a2400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:29.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.036+0000 7f6a29ffb700 1 -- 172.21.15.156:0/2245953209 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a24009710 con 0x7f6a3409f430 2023-09-30T22:21:29.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.036+0000 7f6a29ffb700 1 -- 172.21.15.156:0/2245953209 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2400ee50 con 0x7f6a3409f430 2023-09-30T22:21:29.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.036+0000 7f6a3b524700 1 -- 172.21.15.156:0/2245953209 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a340a4ce0 con 0x7f6a3409f430 2023-09-30T22:21:29.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.036+0000 7f6a29ffb700 1 -- 172.21.15.156:0/2245953209 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2400ca50 con 0x7f6a3409f430 2023-09-30T22:21:29.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.036+0000 7f6a3b524700 1 -- 172.21.15.156:0/2245953209 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a34125af0 con 0x7f6a3409f430 2023-09-30T22:21:29.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.037+0000 7f6a3b524700 1 -- 172.21.15.156:0/2245953209 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a34074f10 con 0x7f6a3409f430 2023-09-30T22:21:29.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.037+0000 7f6a29ffb700 1 -- 172.21.15.156:0/2245953209 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a2400cbb0 con 0x7f6a3409f430 2023-09-30T22:21:29.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.037+0000 7f6a29ffb700 1 -- 172.21.15.156:0/2245953209 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6a2403f770 con 0x7f6a3409f430 2023-09-30T22:21:29.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.045+0000 7f6a29ffb700 1 -- 172.21.15.156:0/2245953209 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a2401be10 con 0x7f6a3409f430 2023-09-30T22:21:29.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.084+0000 7f7f89239700 1 Processor -- start 2023-09-30T22:21:29.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.084+0000 7f7f89239700 1 -- start start 2023-09-30T22:21:29.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.085+0000 7f7f89239700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7f840a0a70 0x7f7f840a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:29.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.085+0000 7f7f89239700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7f84134120 0x7f7f8413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:29.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.085+0000 7f7f89239700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f8409dc00 con 0x7f7f840a1380 2023-09-30T22:21:29.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.085+0000 7f7f89239700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8409ea90 con 0x7f7f84134120 2023-09-30T22:21:29.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.085+0000 7f7f89239700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8409dec0 con 0x7f7f840a0a70 2023-09-30T22:21:29.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.085+0000 7f7f8259c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f7f840a1380 0x7f7f84133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40052/0 (socket says 172.21.15.156:40052) 2023-09-30T22:21:29.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.085+0000 7f7f8259c700 1 -- 172.21.15.156:0/2409751019 learned_addr learned my addr 172.21.15.156:0/2409751019 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:29.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.085+0000 7f7f82d9d700 1 --2- 172.21.15.156:0/2409751019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7f840a0a70 0x7f7f840a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:29.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.085+0000 7f7f8359e700 1 --2- 172.21.15.156:0/2409751019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7f84134120 0x7f7f8413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:29.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.085+0000 7f7f81d9b700 1 -- 172.21.15.156:0/2409751019 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828588609 0 0) 0x7f7f8409dc00 con 0x7f7f840a1380 2023-09-30T22:21:29.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.085+0000 7f7f81d9b700 1 -- 172.21.15.156:0/2409751019 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f6c0035b0 con 0x7f7f840a1380 2023-09-30T22:21:29.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.085+0000 7f7f8359e700 1 -- 172.21.15.156:0/2409751019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7f840a0a70 msgr2=0x7f7f840a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:29.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.085+0000 7f7f8359e700 1 --2- 172.21.15.156:0/2409751019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7f840a0a70 0x7f7f840a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.085+0000 7f7f8359e700 1 -- 172.21.15.156:0/2409751019 >> v1:172.21.15.156:6789/0 conn(0x7f7f840a1380 legacy=0x7f7f84133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:29.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.085+0000 7f7f8359e700 1 -- 172.21.15.156:0/2409751019 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8409e6a0 con 0x7f7f84134120 2023-09-30T22:21:29.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.086+0000 7f7f8359e700 1 --2- 172.21.15.156:0/2409751019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7f84134120 0x7f7f8413bce0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c009dc0 tx=0x7f7f7c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4ed8e46bc7bea3e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:29.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.086+0000 7f7f81d9b700 1 -- 172.21.15.156:0/2409751019 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c00e070 con 0x7f7f84134120 2023-09-30T22:21:29.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.086+0000 7f7f81d9b700 1 -- 172.21.15.156:0/2409751019 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7c00bb20 con 0x7f7f84134120 2023-09-30T22:21:29.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.086+0000 7f7f81d9b700 1 -- 172.21.15.156:0/2409751019 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c012430 con 0x7f7f84134120 2023-09-30T22:21:29.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.086+0000 7f7f89239700 1 -- 172.21.15.156:0/2409751019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7f84134120 msgr2=0x7f7f8413bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:29.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.086+0000 7f7f89239700 1 --2- 172.21.15.156:0/2409751019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7f84134120 0x7f7f8413bce0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c009dc0 tx=0x7f7f7c00b330 comp rx=0 tx=0).stop 2023-09-30T22:21:29.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.086+0000 7f7f89239700 1 -- 172.21.15.156:0/2409751019 shutdown_connections 2023-09-30T22:21:29.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.086+0000 7f7f89239700 1 --2- 172.21.15.156:0/2409751019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7f84134120 0x7f7f8413bce0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.086+0000 7f7f89239700 1 --2- 172.21.15.156:0/2409751019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7f840a0a70 0x7f7f840a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.086+0000 7f7f89239700 1 -- 172.21.15.156:0/2409751019 >> 172.21.15.156:0/2409751019 conn(0x7f7f840a6610 msgr2=0x7f7f840a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:29.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.086+0000 7f7f89239700 1 -- 172.21.15.156:0/2409751019 shutdown_connections 2023-09-30T22:21:29.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.086+0000 7f7f89239700 1 -- 172.21.15.156:0/2409751019 wait complete. 2023-09-30T22:21:29.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.088+0000 7f7f89239700 1 Processor -- start 2023-09-30T22:21:29.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.088+0000 7f7f89239700 1 -- start start 2023-09-30T22:21:29.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.088+0000 7f7f89239700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7f840a0a70 0x7f7f84122690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:29.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.088+0000 7f7f89239700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7f840a1380 0x7f7f84122bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:29.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.088+0000 7f7f89239700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f84134120 0x7f7f84123110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:29.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.088+0000 7f7f89239700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f84125c10 con 0x7f7f84134120 2023-09-30T22:21:29.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.088+0000 7f7f89239700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f841335e0 con 0x7f7f840a0a70 2023-09-30T22:21:29.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.088+0000 7f7f89239700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f840a03e0 con 0x7f7f840a1380 2023-09-30T22:21:29.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.088+0000 7f7f8259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7f840a1380 0x7f7f84122bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:29.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.088+0000 7f7f8259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7f840a1380 0x7f7f84122bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:60254/0 (socket says 172.21.15.156:60254) 2023-09-30T22:21:29.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.088+0000 7f7f8259c700 1 -- 172.21.15.156:0/3361351826 learned_addr learned my addr 172.21.15.156:0/3361351826 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:29.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.088+0000 7f7f8359e700 1 --2- 172.21.15.156:0/3361351826 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f84134120 0x7f7f84123110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:29.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.088+0000 7f7f82d9d700 1 --2- 172.21.15.156:0/3361351826 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7f840a0a70 0x7f7f84122690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:29.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.089+0000 7f7f8259c700 1 -- 172.21.15.156:0/3361351826 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7f840a0a70 msgr2=0x7f7f84122690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:29.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.089+0000 7f7f8259c700 1 --2- 172.21.15.156:0/3361351826 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7f840a0a70 0x7f7f84122690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.089+0000 7f7f8259c700 1 -- 172.21.15.156:0/3361351826 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f84134120 msgr2=0x7f7f84123110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:29.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.089+0000 7f7f8259c700 1 --2- 172.21.15.156:0/3361351826 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f84134120 0x7f7f84123110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.089+0000 7f7f8259c700 1 -- 172.21.15.156:0/3361351826 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7c009a70 con 0x7f7f840a1380 2023-09-30T22:21:29.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.089+0000 7f7f8259c700 1 --2- 172.21.15.156:0/3361351826 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7f840a1380 0x7f7f84122bd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7f78005910 tx=0x7f7f7800c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:29.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.089+0000 7f7f6b7fe700 1 -- 172.21.15.156:0/3361351826 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f78005d70 con 0x7f7f840a1380 2023-09-30T22:21:29.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.089+0000 7f7f6b7fe700 1 -- 172.21.15.156:0/3361351826 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f780070d0 con 0x7f7f840a1380 2023-09-30T22:21:29.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.089+0000 7f7f6b7fe700 1 -- 172.21.15.156:0/3361351826 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f78007460 con 0x7f7f840a1380 2023-09-30T22:21:29.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.089+0000 7f7f89239700 1 -- 172.21.15.156:0/3361351826 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f84123a80 con 0x7f7f840a1380 2023-09-30T22:21:29.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.089+0000 7f7f89239700 1 -- 172.21.15.156:0/3361351826 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f84126940 con 0x7f7f840a1380 2023-09-30T22:21:29.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.089+0000 7f70c148c700 1 -- 172.21.15.156:0/2866228583 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f70bc09cba0 con 0x7f70bc0a0a70 2023-09-30T22:21:29.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.090+0000 7f70a37fe700 1 -- 172.21.15.156:0/2866228583 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f70ac03f0d0 con 0x7f70bc0a0a70 2023-09-30T22:21:29.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.090+0000 7f7f6b7fe700 1 -- 172.21.15.156:0/3361351826 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f780075c0 con 0x7f7f840a1380 2023-09-30T22:21:29.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.090+0000 7f7f6b7fe700 1 -- 172.21.15.156:0/3361351826 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7f7803eba0 con 0x7f7f840a1380 2023-09-30T22:21:29.097 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:29.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.090+0000 7f7f89239700 1 -- 172.21.15.156:0/3361351826 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f8404f2a0 con 0x7f7f840a1380 2023-09-30T22:21:29.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.092+0000 7f70c148c700 1 -- 172.21.15.156:0/2866228583 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70bc0a0a70 msgr2=0x7f70bc11e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:29.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.092+0000 7f70c148c700 1 --2- 172.21.15.156:0/2866228583 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70bc0a0a70 0x7f70bc11e860 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f70ac00c470 tx=0x7f70ac00c780 comp rx=0 tx=0).stop 2023-09-30T22:21:29.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.092+0000 7f70c148c700 1 -- 172.21.15.156:0/2866228583 shutdown_connections 2023-09-30T22:21:29.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.092+0000 7f70c148c700 1 --2- 172.21.15.156:0/2866228583 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70bc139200 0x7f70bc11f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.092+0000 7f70c148c700 1 --2- 172.21.15.156:0/2866228583 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70bc0a0a70 0x7f70bc11e860 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.092+0000 7f70c148c700 1 --2- 172.21.15.156:0/2866228583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70bc0a1550 0x7f70bc11eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.092+0000 7f70c148c700 1 -- 172.21.15.156:0/2866228583 >> 172.21.15.156:0/2866228583 conn(0x7f70bc0a6610 msgr2=0x7f70bc0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:29.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.092+0000 7f70c148c700 1 -- 172.21.15.156:0/2866228583 shutdown_connections 2023-09-30T22:21:29.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.092+0000 7f70c148c700 1 -- 172.21.15.156:0/2866228583 wait complete. 2023-09-30T22:21:29.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.095+0000 7f7f6b7fe700 1 -- 172.21.15.156:0/3361351826 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f78017080 con 0x7f7f840a1380 2023-09-30T22:21:29.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:29.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.241+0000 7f6a3b524700 1 -- 172.21.15.156:0/2245953209 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6a34124f50 con 0x7f6a3409f430 2023-09-30T22:21:29.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.241+0000 7f6a29ffb700 1 -- 172.21.15.156:0/2245953209 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6a34124f50 con 0x7f6a3409f430 2023-09-30T22:21:29.242 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:29.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.243+0000 7f6a3b524700 1 -- 172.21.15.156:0/2245953209 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a3409f430 msgr2=0x7f6a341c8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:29.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.243+0000 7f6a3b524700 1 --2- 172.21.15.156:0/2245953209 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a3409f430 0x7f6a341c8760 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400e9b0 tx=0x7f6a2400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.244+0000 7f6a3b524700 1 -- 172.21.15.156:0/2245953209 shutdown_connections 2023-09-30T22:21:29.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.244+0000 7f6a3b524700 1 --2- 172.21.15.156:0/2245953209 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a34137010 0x7f6a341c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.244+0000 7f6a3b524700 1 --2- 172.21.15.156:0/2245953209 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6a3409e950 0x7f6a341c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.244+0000 7f6a3b524700 1 --2- 172.21.15.156:0/2245953209 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a3409f430 0x7f6a341c8760 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.244+0000 7f6a3b524700 1 -- 172.21.15.156:0/2245953209 >> 172.21.15.156:0/2245953209 conn(0x7f6a340a0f70 msgr2=0x7f6a34135ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:29.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.244+0000 7f6a3b524700 1 -- 172.21.15.156:0/2245953209 shutdown_connections 2023-09-30T22:21:29.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.244+0000 7f6a3b524700 1 -- 172.21.15.156:0/2245953209 wait complete. 2023-09-30T22:21:29.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:29.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.294+0000 7f7f89239700 1 -- 172.21.15.156:0/3361351826 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7f84072980 con 0x7f7f840a1380 2023-09-30T22:21:29.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.294+0000 7f7f6b7fe700 1 -- 172.21.15.156:0/3361351826 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7f7800f260 con 0x7f7f840a1380 2023-09-30T22:21:29.295 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:29.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.296+0000 7f7f89239700 1 -- 172.21.15.156:0/3361351826 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7f840a1380 msgr2=0x7f7f84122bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:29.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.296+0000 7f7f89239700 1 --2- 172.21.15.156:0/3361351826 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7f840a1380 0x7f7f84122bd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7f78005910 tx=0x7f7f7800c9e0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.296+0000 7f7f89239700 1 -- 172.21.15.156:0/3361351826 shutdown_connections 2023-09-30T22:21:29.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.296+0000 7f7f89239700 1 --2- 172.21.15.156:0/3361351826 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f84134120 0x7f7f84123110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.296+0000 7f7f89239700 1 --2- 172.21.15.156:0/3361351826 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7f840a0a70 0x7f7f84122690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.296+0000 7f7f89239700 1 --2- 172.21.15.156:0/3361351826 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7f840a1380 0x7f7f84122bd0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.296+0000 7f7f89239700 1 -- 172.21.15.156:0/3361351826 >> 172.21.15.156:0/3361351826 conn(0x7f7f840a6610 msgr2=0x7f7f8411c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:29.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.296+0000 7f7f89239700 1 -- 172.21.15.156:0/3361351826 shutdown_connections 2023-09-30T22:21:29.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.296+0000 7f7f89239700 1 -- 172.21.15.156:0/3361351826 wait complete. 2023-09-30T22:21:29.309 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:29.541 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:29.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.663+0000 7f8f85f1a700 1 Processor -- start 2023-09-30T22:21:29.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.663+0000 7f8f85f1a700 1 -- start start 2023-09-30T22:21:29.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.664+0000 7f8f85f1a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8f80133ad0 0x7f8f80133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:29.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.664+0000 7f8f85f1a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f80130bc0 0x7f8f8013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:29.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.664+0000 7f8f85f1a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f8006b2d0 con 0x7f8f801300a0 2023-09-30T22:21:29.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.664+0000 7f8f85f1a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f80133610 con 0x7f8f80133ad0 2023-09-30T22:21:29.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.664+0000 7f8f85f1a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8009a500 con 0x7f8f80130bc0 2023-09-30T22:21:29.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.664+0000 7f8f7ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f80130bc0 0x7f8f8013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:29.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.664+0000 7f8f7f7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8f80133ad0 0x7f8f80133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:29.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.664+0000 7f8f7f7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8f80133ad0 0x7f8f80133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49108/0 (socket says 172.21.15.156:49108) 2023-09-30T22:21:29.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.664+0000 7f8f7ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f80130bc0 0x7f8f8013b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38980/0 (socket says 172.21.15.156:38980) 2023-09-30T22:21:29.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.664+0000 7f8f7f7fe700 1 -- 172.21.15.156:0/4286319668 learned_addr learned my addr 172.21.15.156:0/4286319668 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:29.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.664+0000 7f8f7f7fe700 1 -- 172.21.15.156:0/4286319668 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f80130bc0 msgr2=0x7f8f8013b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:29.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.664+0000 7f8f7f7fe700 1 --2- 172.21.15.156:0/4286319668 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f80130bc0 0x7f8f8013b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.664+0000 7f8f7f7fe700 1 -- 172.21.15.156:0/4286319668 >> v1:172.21.15.156:6789/0 conn(0x7f8f801300a0 legacy=0x7f8f801304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:29.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.664+0000 7f8f7f7fe700 1 -- 172.21.15.156:0/4286319668 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f801338b0 con 0x7f8f80133ad0 2023-09-30T22:21:29.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.664+0000 7f8f7ffff700 1 --2- 172.21.15.156:0/4286319668 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f80130bc0 0x7f8f8013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:29.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.664+0000 7f8f7f7fe700 1 --2- 172.21.15.156:0/4286319668 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f80133ad0 0x7f8f80133ea0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f8f740098f0 tx=0x7f8f74009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a52df8da45a433a3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:29.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.665+0000 7f8f7e7fc700 1 -- 172.21.15.156:0/4286319668 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f74011830 con 0x7f8f80133ad0 2023-09-30T22:21:29.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.665+0000 7f8f7e7fc700 1 -- 172.21.15.156:0/4286319668 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f74011990 con 0x7f8f80133ad0 2023-09-30T22:21:29.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.665+0000 7f8f7e7fc700 1 -- 172.21.15.156:0/4286319668 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f74011d20 con 0x7f8f80133ad0 2023-09-30T22:21:29.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.665+0000 7f8f85f1a700 1 -- 172.21.15.156:0/4286319668 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f80133ad0 msgr2=0x7f8f80133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:29.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.665+0000 7f8f85f1a700 1 --2- 172.21.15.156:0/4286319668 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f80133ad0 0x7f8f80133ea0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f8f740098f0 tx=0x7f8f74009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:29.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.665+0000 7f8f85f1a700 1 -- 172.21.15.156:0/4286319668 shutdown_connections 2023-09-30T22:21:29.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.665+0000 7f8f85f1a700 1 --2- 172.21.15.156:0/4286319668 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f80130bc0 0x7f8f8013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.665+0000 7f8f85f1a700 1 --2- 172.21.15.156:0/4286319668 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f80133ad0 0x7f8f80133ea0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.665+0000 7f8f85f1a700 1 -- 172.21.15.156:0/4286319668 >> 172.21.15.156:0/4286319668 conn(0x7f8f80099c40 msgr2=0x7f8f800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:29.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.665+0000 7f8f85f1a700 1 -- 172.21.15.156:0/4286319668 shutdown_connections 2023-09-30T22:21:29.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.665+0000 7f8f85f1a700 1 -- 172.21.15.156:0/4286319668 wait complete. 2023-09-30T22:21:29.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.666+0000 7f8f85f1a700 1 Processor -- start 2023-09-30T22:21:29.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.666+0000 7f8f85f1a700 1 -- start start 2023-09-30T22:21:29.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.667+0000 7f8f85f1a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f801300a0 0x7f8f8011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:29.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.667+0000 7f8f85f1a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f80130bc0 0x7f8f8011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:29.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.667+0000 7f8f85f1a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f80133ad0 0x7f8f8011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:29.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.667+0000 7f8f85f1a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f80120e00 con 0x7f8f801300a0 2023-09-30T22:21:29.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.667+0000 7f8f85f1a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8012d580 con 0x7f8f80130bc0 2023-09-30T22:21:29.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.667+0000 7f8f85f1a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8012dd00 con 0x7f8f80133ad0 2023-09-30T22:21:29.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.667+0000 7f8f7f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f801300a0 0x7f8f8011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:29.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.667+0000 7f8f7f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f801300a0 0x7f8f8011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49122/0 (socket says 172.21.15.156:49122) 2023-09-30T22:21:29.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.667+0000 7f8f7f7fe700 1 -- 172.21.15.156:0/3180016548 learned_addr learned my addr 172.21.15.156:0/3180016548 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:29.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.667+0000 7f8f7ffff700 1 --2- 172.21.15.156:0/3180016548 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f80133ad0 0x7f8f8011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:29.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.667+0000 7f8f7effd700 1 --2- 172.21.15.156:0/3180016548 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f80130bc0 0x7f8f8011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:29.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.667+0000 7f8f7f7fe700 1 -- 172.21.15.156:0/3180016548 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f80133ad0 msgr2=0x7f8f8011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:29.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.667+0000 7f8f7f7fe700 1 --2- 172.21.15.156:0/3180016548 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f80133ad0 0x7f8f8011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.667+0000 7f8f7f7fe700 1 -- 172.21.15.156:0/3180016548 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f80130bc0 msgr2=0x7f8f8011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:29.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.667+0000 7f8f7f7fe700 1 --2- 172.21.15.156:0/3180016548 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f80130bc0 0x7f8f8011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.667+0000 7f8f7f7fe700 1 -- 172.21.15.156:0/3180016548 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f78009a70 con 0x7f8f801300a0 2023-09-30T22:21:29.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.667+0000 7f8f7f7fe700 1 --2- 172.21.15.156:0/3180016548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f801300a0 0x7f8f8011da40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f8f74009c40 tx=0x7f8f74004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:29.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.667+0000 7f8f67fff700 1 -- 172.21.15.156:0/3180016548 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f740045d0 con 0x7f8f801300a0 2023-09-30T22:21:29.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.667+0000 7f8f67fff700 1 -- 172.21.15.156:0/3180016548 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f740036a0 con 0x7f8f801300a0 2023-09-30T22:21:29.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.667+0000 7f8f85f1a700 1 -- 172.21.15.156:0/3180016548 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f74009550 con 0x7f8f801300a0 2023-09-30T22:21:29.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.667+0000 7f8f67fff700 1 -- 172.21.15.156:0/3180016548 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f74003a10 con 0x7f8f801300a0 2023-09-30T22:21:29.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.667+0000 7f8f85f1a700 1 -- 172.21.15.156:0/3180016548 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f800721b0 con 0x7f8f801300a0 2023-09-30T22:21:29.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.668+0000 7f8f67fff700 1 -- 172.21.15.156:0/3180016548 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f74021070 con 0x7f8f801300a0 2023-09-30T22:21:29.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.668+0000 7f8f67fff700 1 -- 172.21.15.156:0/3180016548 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8f74040aa0 con 0x7f8f801300a0 2023-09-30T22:21:29.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.668+0000 7f8f85f1a700 1 -- 172.21.15.156:0/3180016548 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f8004f2a0 con 0x7f8f801300a0 2023-09-30T22:21:29.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.673+0000 7f8f67fff700 1 -- 172.21.15.156:0/3180016548 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f74029080 con 0x7f8f801300a0 2023-09-30T22:21:29.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.858+0000 7f8f85f1a700 1 -- 172.21.15.156:0/3180016548 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8f8006c3b0 con 0x7f8f801300a0 2023-09-30T22:21:29.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.859+0000 7f8f67fff700 1 -- 172.21.15.156:0/3180016548 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f74015020 con 0x7f8f801300a0 2023-09-30T22:21:29.860 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:29.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.861+0000 7f8f85f1a700 1 -- 172.21.15.156:0/3180016548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f801300a0 msgr2=0x7f8f8011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:29.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.861+0000 7f8f85f1a700 1 --2- 172.21.15.156:0/3180016548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f801300a0 0x7f8f8011da40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f8f74009c40 tx=0x7f8f74004750 comp rx=0 tx=0).stop 2023-09-30T22:21:29.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.861+0000 7f8f85f1a700 1 -- 172.21.15.156:0/3180016548 shutdown_connections 2023-09-30T22:21:29.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.861+0000 7f8f85f1a700 1 --2- 172.21.15.156:0/3180016548 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f80133ad0 0x7f8f8011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.861+0000 7f8f85f1a700 1 --2- 172.21.15.156:0/3180016548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f801300a0 0x7f8f8011da40 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.861+0000 7f8f85f1a700 1 --2- 172.21.15.156:0/3180016548 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f80130bc0 0x7f8f8011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:29.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.861+0000 7f8f85f1a700 1 -- 172.21.15.156:0/3180016548 >> 172.21.15.156:0/3180016548 conn(0x7f8f80099c40 msgr2=0x7f8f80132190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:29.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.861+0000 7f8f85f1a700 1 -- 172.21.15.156:0/3180016548 shutdown_connections 2023-09-30T22:21:29.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:29.861+0000 7f8f85f1a700 1 -- 172.21.15.156:0/3180016548 wait complete. 2023-09-30T22:21:29.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:30.110 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:30.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.232+0000 7fbb6a782700 1 Processor -- start 2023-09-30T22:21:30.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.232+0000 7fbb6a782700 1 -- start start 2023-09-30T22:21:30.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.233+0000 7fbb6a782700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbb6409e870 0x7fbb6409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:30.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.233+0000 7fbb6a782700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb6409f180 0x7fbb64131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:30.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.233+0000 7fbb6a782700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb6409c970 con 0x7fbb64131d70 2023-09-30T22:21:30.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.233+0000 7fbb6a782700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb640a0920 con 0x7fbb6409e870 2023-09-30T22:21:30.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.233+0000 7fbb6a782700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6409f9c0 con 0x7fbb6409f180 2023-09-30T22:21:30.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.233+0000 7fbb63fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbb6409e870 0x7fbb6409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:30.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.233+0000 7fbb68d1f700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fbb64131d70 0x7fbb64138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40074/0 (socket says 172.21.15.156:40074) 2023-09-30T22:21:30.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.233+0000 7fbb68d1f700 1 -- 172.21.15.156:0/949327698 learned_addr learned my addr 172.21.15.156:0/949327698 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:30.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.233+0000 7fbb637fe700 1 --2- 172.21.15.156:0/949327698 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb6409f180 0x7fbb64131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:30.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.233+0000 7fbb637fe700 1 -- 172.21.15.156:0/949327698 >> v2:172.21.15.156:3300/0 conn(0x7fbb6409e870 msgr2=0x7fbb6409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:30.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.233+0000 7fbb637fe700 1 --2- 172.21.15.156:0/949327698 >> v2:172.21.15.156:3300/0 conn(0x7fbb6409e870 0x7fbb6409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:30.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.233+0000 7fbb637fe700 1 -- 172.21.15.156:0/949327698 >> v1:172.21.15.156:6789/0 conn(0x7fbb64131d70 legacy=0x7fbb64138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:30.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.233+0000 7fbb637fe700 1 -- 172.21.15.156:0/949327698 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb6409bab0 con 0x7fbb6409f180 2023-09-30T22:21:30.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.233+0000 7fbb62ffd700 1 -- 172.21.15.156:0/949327698 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946961828 0 0) 0x7fbb6409c970 con 0x7fbb64131d70 2023-09-30T22:21:30.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.233+0000 7fbb63fff700 1 --2- 172.21.15.156:0/949327698 >> v2:172.21.15.156:3300/0 conn(0x7fbb6409e870 0x7fbb6409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:30.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.233+0000 7fbb637fe700 1 --2- 172.21.15.156:0/949327698 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb6409f180 0x7fbb64131830 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009840 tx=0x7fbb54009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65ab1799f08a510c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:30.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.233+0000 7fbb62ffd700 1 -- 172.21.15.156:0/949327698 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb54011830 con 0x7fbb6409f180 2023-09-30T22:21:30.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.233+0000 7fbb62ffd700 1 -- 172.21.15.156:0/949327698 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb54011990 con 0x7fbb6409f180 2023-09-30T22:21:30.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.233+0000 7fbb62ffd700 1 -- 172.21.15.156:0/949327698 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb54011d20 con 0x7fbb6409f180 2023-09-30T22:21:30.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.234+0000 7fbb6a782700 1 -- 172.21.15.156:0/949327698 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb6409f180 msgr2=0x7fbb64131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:30.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.234+0000 7fbb6a782700 1 --2- 172.21.15.156:0/949327698 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb6409f180 0x7fbb64131830 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009840 tx=0x7fbb54009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:30.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.234+0000 7fbb6a782700 1 -- 172.21.15.156:0/949327698 shutdown_connections 2023-09-30T22:21:30.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.234+0000 7fbb6a782700 1 --2- 172.21.15.156:0/949327698 >> v2:172.21.15.156:3300/0 conn(0x7fbb6409e870 0x7fbb6409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:30.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.234+0000 7fbb6a782700 1 --2- 172.21.15.156:0/949327698 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb6409f180 0x7fbb64131830 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:30.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.234+0000 7fbb6a782700 1 -- 172.21.15.156:0/949327698 >> 172.21.15.156:0/949327698 conn(0x7fbb640a4430 msgr2=0x7fbb640a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:30.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.234+0000 7fbb6a782700 1 -- 172.21.15.156:0/949327698 shutdown_connections 2023-09-30T22:21:30.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.234+0000 7fbb6a782700 1 -- 172.21.15.156:0/949327698 wait complete. 2023-09-30T22:21:30.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.235+0000 7fbb6a782700 1 Processor -- start 2023-09-30T22:21:30.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.235+0000 7fbb6a782700 1 -- start start 2023-09-30T22:21:30.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.235+0000 7fbb6a782700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb6409e870 0x7fbb6411f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:30.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.235+0000 7fbb6a782700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb6409f180 0x7fbb6411f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:30.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.235+0000 7fbb6a782700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb64131d70 0x7fbb6411fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:30.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.235+0000 7fbb6a782700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb64121da0 con 0x7fbb6409e870 2023-09-30T22:21:30.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.235+0000 7fbb6a782700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb64122db0 con 0x7fbb64131d70 2023-09-30T22:21:30.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.235+0000 7fbb6a782700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb641228a0 con 0x7fbb6409f180 2023-09-30T22:21:30.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.236+0000 7fbb63fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb6409e870 0x7fbb6411f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:30.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.236+0000 7fbb63fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb6409e870 0x7fbb6411f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49130/0 (socket says 172.21.15.156:49130) 2023-09-30T22:21:30.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.236+0000 7fbb63fff700 1 -- 172.21.15.156:0/773854063 learned_addr learned my addr 172.21.15.156:0/773854063 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:30.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.236+0000 7fbb637fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb6409f180 0x7fbb6411f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:30.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.236+0000 7fbb68d1f700 1 --2- 172.21.15.156:0/773854063 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb64131d70 0x7fbb6411fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:30.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.236+0000 7fbb63fff700 1 -- 172.21.15.156:0/773854063 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb6409f180 msgr2=0x7fbb6411f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:30.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.236+0000 7fbb63fff700 1 --2- 172.21.15.156:0/773854063 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb6409f180 0x7fbb6411f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:30.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.236+0000 7fbb63fff700 1 -- 172.21.15.156:0/773854063 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb64131d70 msgr2=0x7fbb6411fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:30.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.236+0000 7fbb63fff700 1 --2- 172.21.15.156:0/773854063 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb64131d70 0x7fbb6411fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:30.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.236+0000 7fbb63fff700 1 -- 172.21.15.156:0/773854063 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb580094a0 con 0x7fbb6409e870 2023-09-30T22:21:30.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.236+0000 7fbb63fff700 1 --2- 172.21.15.156:0/773854063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb6409e870 0x7fbb6411f2e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800ec10 tx=0x7fbb5800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:30.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.236+0000 7fbb60ff9700 1 -- 172.21.15.156:0/773854063 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb58009760 con 0x7fbb6409e870 2023-09-30T22:21:30.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.236+0000 7fbb60ff9700 1 -- 172.21.15.156:0/773854063 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5800c850 con 0x7fbb6409e870 2023-09-30T22:21:30.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.236+0000 7fbb6a782700 1 -- 172.21.15.156:0/773854063 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb540094a0 con 0x7fbb6409e870 2023-09-30T22:21:30.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.236+0000 7fbb60ff9700 1 -- 172.21.15.156:0/773854063 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5800cbe0 con 0x7fbb6409e870 2023-09-30T22:21:30.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.236+0000 7fbb6a782700 1 -- 172.21.15.156:0/773854063 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb64130660 con 0x7fbb6409e870 2023-09-30T22:21:30.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.237+0000 7fbb60ff9700 1 -- 172.21.15.156:0/773854063 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbb5800cd40 con 0x7fbb6409e870 2023-09-30T22:21:30.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.237+0000 7fbb60ff9700 1 -- 172.21.15.156:0/773854063 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbb5803f770 con 0x7fbb6409e870 2023-09-30T22:21:30.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.237+0000 7fbb6a782700 1 -- 172.21.15.156:0/773854063 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb6409b0e0 con 0x7fbb6409e870 2023-09-30T22:21:30.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.242+0000 7fbb60ff9700 1 -- 172.21.15.156:0/773854063 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb580232f0 con 0x7fbb6409e870 2023-09-30T22:21:30.257 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:30.310 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:30.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.382+0000 7f123ef6a700 1 Processor -- start 2023-09-30T22:21:30.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.382+0000 7f123ef6a700 1 -- start start 2023-09-30T22:21:30.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.383+0000 7f123ef6a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12380a1510 0x7f12381351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:30.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.383+0000 7f123ef6a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12381356e0 0x7f1238137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:30.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.383+0000 7f123ef6a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12380a1e70 con 0x7f12380a0a30 2023-09-30T22:21:30.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.383+0000 7f123ef6a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123809a720 con 0x7f12380a1510 2023-09-30T22:21:30.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.383+0000 7f123ef6a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f123809b300 con 0x7f12381356e0 2023-09-30T22:21:30.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.383+0000 7f123cd06700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f12380a0a30 0x7f12380a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40084/0 (socket says 172.21.15.156:40084) 2023-09-30T22:21:30.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.383+0000 7f123cd06700 1 -- 172.21.15.156:0/213795987 learned_addr learned my addr 172.21.15.156:0/213795987 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:30.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.383+0000 7f1237fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12380a1510 0x7f12381351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:30.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.383+0000 7f123d507700 1 --2- 172.21.15.156:0/213795987 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12381356e0 0x7f1238137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:30.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.384+0000 7f12377fe700 1 -- 172.21.15.156:0/213795987 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2021413624 0 0) 0x7f12380a1e70 con 0x7f12380a0a30 2023-09-30T22:21:30.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.384+0000 7f123d507700 1 -- 172.21.15.156:0/213795987 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12380a1510 msgr2=0x7f12381351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:30.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.384+0000 7f123d507700 1 --2- 172.21.15.156:0/213795987 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12380a1510 0x7f12381351a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:30.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.384+0000 7f123d507700 1 -- 172.21.15.156:0/213795987 >> v1:172.21.15.156:6789/0 conn(0x7f12380a0a30 legacy=0x7f12380a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:30.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.384+0000 7f123d507700 1 -- 172.21.15.156:0/213795987 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123809abc0 con 0x7f12381356e0 2023-09-30T22:21:30.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.384+0000 7f1237fff700 1 --2- 172.21.15.156:0/213795987 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12380a1510 0x7f12381351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:30.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.384+0000 7f123d507700 1 --2- 172.21.15.156:0/213795987 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12381356e0 0x7f1238137ac0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f123000aed0 tx=0x7f123000c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d27f60c6077f1dc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:30.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.384+0000 7f12377fe700 1 -- 172.21.15.156:0/213795987 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123000f070 con 0x7f12381356e0 2023-09-30T22:21:30.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.384+0000 7f12377fe700 1 -- 172.21.15.156:0/213795987 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123000a2e0 con 0x7f12381356e0 2023-09-30T22:21:30.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.384+0000 7f12377fe700 1 -- 172.21.15.156:0/213795987 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123000cc10 con 0x7f12381356e0 2023-09-30T22:21:30.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.385+0000 7f123ef6a700 1 -- 172.21.15.156:0/213795987 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12381356e0 msgr2=0x7f1238137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:30.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.385+0000 7f123ef6a700 1 --2- 172.21.15.156:0/213795987 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12381356e0 0x7f1238137ac0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f123000aed0 tx=0x7f123000c330 comp rx=0 tx=0).stop 2023-09-30T22:21:30.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.385+0000 7f123ef6a700 1 -- 172.21.15.156:0/213795987 shutdown_connections 2023-09-30T22:21:30.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.385+0000 7f123ef6a700 1 --2- 172.21.15.156:0/213795987 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12381356e0 0x7f1238137ac0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:30.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.385+0000 7f123ef6a700 1 --2- 172.21.15.156:0/213795987 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12380a1510 0x7f12381351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:30.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.385+0000 7f123ef6a700 1 -- 172.21.15.156:0/213795987 >> 172.21.15.156:0/213795987 conn(0x7f12380a2980 msgr2=0x7f12380a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:30.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.385+0000 7f123ef6a700 1 -- 172.21.15.156:0/213795987 shutdown_connections 2023-09-30T22:21:30.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.385+0000 7f123ef6a700 1 -- 172.21.15.156:0/213795987 wait complete. 2023-09-30T22:21:30.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.386+0000 7f123ef6a700 1 Processor -- start 2023-09-30T22:21:30.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.386+0000 7f123ef6a700 1 -- start start 2023-09-30T22:21:30.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.387+0000 7f123ef6a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12380a0a30 0x7f1238134580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:30.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.387+0000 7f123ef6a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12380a1510 0x7f1238134ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:30.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.387+0000 7f123ef6a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12381356e0 0x7f12381c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:30.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.387+0000 7f123ef6a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123811ab60 con 0x7f12380a0a30 2023-09-30T22:21:30.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.387+0000 7f123ef6a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123809ae00 con 0x7f12380a1510 2023-09-30T22:21:30.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.387+0000 7f123ef6a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12381340e0 con 0x7f12381356e0 2023-09-30T22:21:30.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.387+0000 7f1237fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12380a1510 0x7f1238134ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:30.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.387+0000 7f123cd06700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12380a0a30 0x7f1238134580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:30.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.387+0000 7f1237fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12380a1510 0x7f1238134ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:39024/0 (socket says 172.21.15.156:39024) 2023-09-30T22:21:30.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.387+0000 7f1237fff700 1 -- 172.21.15.156:0/1901671537 learned_addr learned my addr 172.21.15.156:0/1901671537 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:30.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.387+0000 7f123d507700 1 --2- 172.21.15.156:0/1901671537 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12381356e0 0x7f12381c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:30.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.388+0000 7f1237fff700 1 -- 172.21.15.156:0/1901671537 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12381356e0 msgr2=0x7f12381c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:30.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.388+0000 7f1237fff700 1 --2- 172.21.15.156:0/1901671537 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12381356e0 0x7f12381c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:30.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.388+0000 7f1237fff700 1 -- 172.21.15.156:0/1901671537 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12380a0a30 msgr2=0x7f1238134580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:30.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.388+0000 7f1237fff700 1 --2- 172.21.15.156:0/1901671537 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12380a0a30 0x7f1238134580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:30.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.388+0000 7f1237fff700 1 -- 172.21.15.156:0/1901671537 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12240094a0 con 0x7f12380a1510 2023-09-30T22:21:30.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.388+0000 7f123cd06700 1 --2- 172.21.15.156:0/1901671537 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12380a0a30 0x7f1238134580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:30.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.388+0000 7f123d507700 1 --2- 172.21.15.156:0/1901671537 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12381356e0 0x7f12381c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:30.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.388+0000 7f1237fff700 1 --2- 172.21.15.156:0/1901671537 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12380a1510 0x7f1238134ac0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f122400ec10 tx=0x7f122400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:30.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.388+0000 7f12357fa700 1 -- 172.21.15.156:0/1901671537 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122400c850 con 0x7f12380a1510 2023-09-30T22:21:30.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.388+0000 7f12357fa700 1 -- 172.21.15.156:0/1901671537 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122400c9b0 con 0x7f12380a1510 2023-09-30T22:21:30.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.388+0000 7f12357fa700 1 -- 172.21.15.156:0/1901671537 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122400cd20 con 0x7f12380a1510 2023-09-30T22:21:30.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.388+0000 7f123ef6a700 1 -- 172.21.15.156:0/1901671537 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f123000ab80 con 0x7f12380a1510 2023-09-30T22:21:30.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.388+0000 7f123ef6a700 1 -- 172.21.15.156:0/1901671537 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1238135060 con 0x7f12380a1510 2023-09-30T22:21:30.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.389+0000 7f123ef6a700 1 -- 172.21.15.156:0/1901671537 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123804f2a0 con 0x7f12380a1510 2023-09-30T22:21:30.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.390+0000 7f12357fa700 1 -- 172.21.15.156:0/1901671537 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1224013470 con 0x7f12380a1510 2023-09-30T22:21:30.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.390+0000 7f12357fa700 1 -- 172.21.15.156:0/1901671537 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f12240473b0 con 0x7f12380a1510 2023-09-30T22:21:30.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.395+0000 7f12357fa700 1 -- 172.21.15.156:0/1901671537 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1224013720 con 0x7f12380a1510 2023-09-30T22:21:30.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.435+0000 7fc04827f700 1 Processor -- start 2023-09-30T22:21:30.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.435+0000 7fc04827f700 1 -- start start 2023-09-30T22:21:30.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.436+0000 7fc04827f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc04009e950 0x7fc04009ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:30.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.436+0000 7fc04827f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc0401393c0 0x7fc04013b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:30.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.436+0000 7fc04827f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc04009ac20 con 0x7fc04009f260 2023-09-30T22:21:30.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.436+0000 7fc04827f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0400a06c0 con 0x7fc04009e950 2023-09-30T22:21:30.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.436+0000 7fc04827f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc04009ae90 con 0x7fc0401393c0 2023-09-30T22:21:30.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.436+0000 7fc04601b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc04009e950 0x7fc04009ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:30.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.436+0000 7fc04601b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc04009e950 0x7fc04009ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49154/0 (socket says 172.21.15.156:49154) 2023-09-30T22:21:30.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.436+0000 7fc04601b700 1 -- 172.21.15.156:0/932110105 learned_addr learned my addr 172.21.15.156:0/932110105 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:30.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.436+0000 7fc04681c700 1 --2- 172.21.15.156:0/932110105 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc0401393c0 0x7fc04013b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:30.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.437+0000 7fc04601b700 1 -- 172.21.15.156:0/932110105 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc0401393c0 msgr2=0x7fc04013b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:30.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.437+0000 7fc04601b700 1 --2- 172.21.15.156:0/932110105 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc0401393c0 0x7fc04013b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:30.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.437+0000 7fc04601b700 1 -- 172.21.15.156:0/932110105 >> v1:172.21.15.156:6789/0 conn(0x7fc04009f260 legacy=0x7fc040137ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:30.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.437+0000 7fc045019700 1 -- 172.21.15.156:0/932110105 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 425191729 0 0) 0x7fc04009ac20 con 0x7fc04009f260 2023-09-30T22:21:30.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.437+0000 7fc04601b700 1 -- 172.21.15.156:0/932110105 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04006ba00 con 0x7fc04009e950 2023-09-30T22:21:30.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.437+0000 7fc04681c700 1 --2- 172.21.15.156:0/932110105 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc0401393c0 0x7fc04013b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:30.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.437+0000 7fc04601b700 1 --2- 172.21.15.156:0/932110105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc04009e950 0x7fc04009ed20 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fc03c0098f0 tx=0x7fc03c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390859b8425416a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:30.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.437+0000 7fc045019700 1 -- 172.21.15.156:0/932110105 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c005e30 con 0x7fc04009e950 2023-09-30T22:21:30.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.437+0000 7fc045019700 1 -- 172.21.15.156:0/932110105 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03c004030 con 0x7fc04009e950 2023-09-30T22:21:30.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.437+0000 7fc045019700 1 -- 172.21.15.156:0/932110105 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c0043e0 con 0x7fc04009e950 2023-09-30T22:21:30.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.437+0000 7fc04827f700 1 -- 172.21.15.156:0/932110105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc04009e950 msgr2=0x7fc04009ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:30.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.437+0000 7fc04827f700 1 --2- 172.21.15.156:0/932110105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc04009e950 0x7fc04009ed20 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fc03c0098f0 tx=0x7fc03c009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:30.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.438+0000 7fc04827f700 1 -- 172.21.15.156:0/932110105 shutdown_connections 2023-09-30T22:21:30.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.438+0000 7fc04827f700 1 --2- 172.21.15.156:0/932110105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc04009e950 0x7fc04009ed20 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:30.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.438+0000 7fc04827f700 1 --2- 172.21.15.156:0/932110105 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc0401393c0 0x7fc04013b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:30.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.438+0000 7fc04827f700 1 -- 172.21.15.156:0/932110105 >> 172.21.15.156:0/932110105 conn(0x7fc0400a0f70 msgr2=0x7fc0400a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:30.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.438+0000 7fc04827f700 1 -- 172.21.15.156:0/932110105 shutdown_connections 2023-09-30T22:21:30.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.438+0000 7fc04827f700 1 -- 172.21.15.156:0/932110105 wait complete. 2023-09-30T22:21:30.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.439+0000 7fc04827f700 1 Processor -- start 2023-09-30T22:21:30.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.439+0000 7fc04827f700 1 -- start start 2023-09-30T22:21:30.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.439+0000 7fc04827f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc04009e950 0x7fc040121760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:30.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.439+0000 7fc04827f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc04009f260 0x7fc040121ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:30.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.440+0000 7fc04827f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc0401393c0 0x7fc0401221e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:30.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.440+0000 7fc04827f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0400a0820 con 0x7fc04009e950 2023-09-30T22:21:30.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.440+0000 7fc04827f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04009e190 con 0x7fc0401393c0 2023-09-30T22:21:30.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.440+0000 7fc04827f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc040124a10 con 0x7fc04009f260 2023-09-30T22:21:30.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.440+0000 7fc04581a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc04009f260 0x7fc040121ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:30.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.440+0000 7fc04581a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc04009f260 0x7fc040121ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:60312/0 (socket says 172.21.15.156:60312) 2023-09-30T22:21:30.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.440+0000 7fc04581a700 1 -- 172.21.15.156:0/154725647 learned_addr learned my addr 172.21.15.156:0/154725647 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:30.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.440+0000 7fc04601b700 1 --2- 172.21.15.156:0/154725647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc04009e950 0x7fc040121760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:30.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.440+0000 7fc04681c700 1 --2- 172.21.15.156:0/154725647 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc0401393c0 0x7fc0401221e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:30.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.440+0000 7fc04581a700 1 -- 172.21.15.156:0/154725647 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc0401393c0 msgr2=0x7fc0401221e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:30.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.440+0000 7fc04581a700 1 --2- 172.21.15.156:0/154725647 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc0401393c0 0x7fc0401221e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:30.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.440+0000 7fc04581a700 1 -- 172.21.15.156:0/154725647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc04009e950 msgr2=0x7fc040121760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:30.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.440+0000 7fc04581a700 1 --2- 172.21.15.156:0/154725647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc04009e950 0x7fc040121760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:30.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.440+0000 7fc04581a700 1 -- 172.21.15.156:0/154725647 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc038009a70 con 0x7fc04009f260 2023-09-30T22:21:30.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.440+0000 7fc04581a700 1 --2- 172.21.15.156:0/154725647 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc04009f260 0x7fc040121ca0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc030001eb0 tx=0x7fc03000c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:30.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.440+0000 7fc036ffd700 1 -- 172.21.15.156:0/154725647 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0300054e0 con 0x7fc04009f260 2023-09-30T22:21:30.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.440+0000 7fc036ffd700 1 -- 172.21.15.156:0/154725647 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc030003680 con 0x7fc04009f260 2023-09-30T22:21:30.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.440+0000 7fc036ffd700 1 -- 172.21.15.156:0/154725647 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0300039f0 con 0x7fc04009f260 2023-09-30T22:21:30.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.440+0000 7fc04827f700 1 -- 172.21.15.156:0/154725647 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc03c009500 con 0x7fc04009f260 2023-09-30T22:21:30.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.440+0000 7fc04827f700 1 -- 172.21.15.156:0/154725647 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc040123b20 con 0x7fc04009f260 2023-09-30T22:21:30.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.441+0000 7fbb6a782700 1 -- 172.21.15.156:0/773854063 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbb6411be60 con 0x7fbb6409e870 2023-09-30T22:21:30.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.441+0000 7fc036ffd700 1 -- 172.21.15.156:0/154725647 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc030003b50 con 0x7fc04009f260 2023-09-30T22:21:30.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.441+0000 7fc036ffd700 1 -- 172.21.15.156:0/154725647 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc03003ea40 con 0x7fc04009f260 2023-09-30T22:21:30.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.441+0000 7fbb60ff9700 1 -- 172.21.15.156:0/773854063 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbb5801bba0 con 0x7fbb6409e870 2023-09-30T22:21:30.446 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:30.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.442+0000 7fc04827f700 1 -- 172.21.15.156:0/154725647 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0401245c0 con 0x7fc04009f260 2023-09-30T22:21:30.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.444+0000 7fbb6a782700 1 -- 172.21.15.156:0/773854063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb6409e870 msgr2=0x7fbb6411f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:30.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.444+0000 7fbb6a782700 1 --2- 172.21.15.156:0/773854063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb6409e870 0x7fbb6411f2e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800ec10 tx=0x7fbb5800ef20 comp rx=0 tx=0).stop 2023-09-30T22:21:30.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.444+0000 7fbb6a782700 1 -- 172.21.15.156:0/773854063 shutdown_connections 2023-09-30T22:21:30.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.444+0000 7fbb6a782700 1 --2- 172.21.15.156:0/773854063 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb64131d70 0x7fbb6411fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:30.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.444+0000 7fbb6a782700 1 --2- 172.21.15.156:0/773854063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb6409e870 0x7fbb6411f2e0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:30.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.444+0000 7fbb6a782700 1 --2- 172.21.15.156:0/773854063 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb6409f180 0x7fbb6411f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:30.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.444+0000 7fbb6a782700 1 -- 172.21.15.156:0/773854063 >> 172.21.15.156:0/773854063 conn(0x7fbb640a4430 msgr2=0x7fbb64131120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:30.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.445+0000 7fbb6a782700 1 -- 172.21.15.156:0/773854063 shutdown_connections 2023-09-30T22:21:30.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.445+0000 7fbb6a782700 1 -- 172.21.15.156:0/773854063 wait complete. 2023-09-30T22:21:30.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.446+0000 7fc036ffd700 1 -- 172.21.15.156:0/154725647 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc030017080 con 0x7fc04009f260 2023-09-30T22:21:30.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:30.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.600+0000 7f123ef6a700 1 -- 172.21.15.156:0/1901671537 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1238119640 con 0x7f12380a1510 2023-09-30T22:21:30.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.601+0000 7f12357fa700 1 -- 172.21.15.156:0/1901671537 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1224017070 con 0x7f12380a1510 2023-09-30T22:21:30.601 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:30.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.604+0000 7f123ef6a700 1 -- 172.21.15.156:0/1901671537 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12380a1510 msgr2=0x7f1238134ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:30.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.604+0000 7f123ef6a700 1 --2- 172.21.15.156:0/1901671537 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12380a1510 0x7f1238134ac0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f122400ec10 tx=0x7f122400ef20 comp rx=0 tx=0).stop 2023-09-30T22:21:30.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.604+0000 7f123ef6a700 1 -- 172.21.15.156:0/1901671537 shutdown_connections 2023-09-30T22:21:30.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.604+0000 7f123ef6a700 1 --2- 172.21.15.156:0/1901671537 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12381356e0 0x7f12381c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:30.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.604+0000 7f123ef6a700 1 --2- 172.21.15.156:0/1901671537 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12380a0a30 0x7f1238134580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:30.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.604+0000 7f123ef6a700 1 --2- 172.21.15.156:0/1901671537 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12380a1510 0x7f1238134ac0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:30.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.604+0000 7f123ef6a700 1 -- 172.21.15.156:0/1901671537 >> 172.21.15.156:0/1901671537 conn(0x7f12380a2980 msgr2=0x7f1238130fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:30.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.604+0000 7f123ef6a700 1 -- 172.21.15.156:0/1901671537 shutdown_connections 2023-09-30T22:21:30.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.604+0000 7f123ef6a700 1 -- 172.21.15.156:0/1901671537 wait complete. 2023-09-30T22:21:30.620 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:30.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.648+0000 7fc04827f700 1 -- 172.21.15.156:0/154725647 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc04004f2a0 con 0x7fc04009f260 2023-09-30T22:21:30.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.649+0000 7fc036ffd700 1 -- 172.21.15.156:0/154725647 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc030012400 con 0x7fc04009f260 2023-09-30T22:21:30.649 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:30.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.651+0000 7fc04827f700 1 -- 172.21.15.156:0/154725647 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc04009f260 msgr2=0x7fc040121ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:30.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.651+0000 7fc04827f700 1 --2- 172.21.15.156:0/154725647 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc04009f260 0x7fc040121ca0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc030001eb0 tx=0x7fc03000c800 comp rx=0 tx=0).stop 2023-09-30T22:21:30.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.651+0000 7fc04827f700 1 -- 172.21.15.156:0/154725647 shutdown_connections 2023-09-30T22:21:30.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.651+0000 7fc04827f700 1 --2- 172.21.15.156:0/154725647 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc0401393c0 0x7fc0401221e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:30.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.651+0000 7fc04827f700 1 --2- 172.21.15.156:0/154725647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc04009e950 0x7fc040121760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:30.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.651+0000 7fc04827f700 1 --2- 172.21.15.156:0/154725647 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc04009f260 0x7fc040121ca0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:30.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.651+0000 7fc04827f700 1 -- 172.21.15.156:0/154725647 >> 172.21.15.156:0/154725647 conn(0x7fc0400a0f70 msgr2=0x7fc040070ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:30.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.651+0000 7fc04827f700 1 -- 172.21.15.156:0/154725647 shutdown_connections 2023-09-30T22:21:30.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.651+0000 7fc04827f700 1 -- 172.21.15.156:0/154725647 wait complete. 2023-09-30T22:21:30.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:30.875 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:31.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.998+0000 7efea20d9700 1 Processor -- start 2023-09-30T22:21:31.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.999+0000 7efea20d9700 1 -- start start 2023-09-30T22:21:31.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.999+0000 7efea20d9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7efe9c09e340 0x7efe9c1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:31.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.999+0000 7efea20d9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efe9c135f20 0x7efe9c138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:31.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.999+0000 7efea20d9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe9c09aaa0 con 0x7efe9c09d860 2023-09-30T22:21:31.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.999+0000 7efea20d9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe9c09e730 con 0x7efe9c09e340 2023-09-30T22:21:31.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.999+0000 7efea20d9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c09f870 con 0x7efe9c135f20 2023-09-30T22:21:31.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.999+0000 7efe9bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efe9c135f20 0x7efe9c138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:31.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.999+0000 7efe9affd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7efe9c09e340 0x7efe9c1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:31.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.999+0000 7efe9affd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7efe9c09e340 0x7efe9c1359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49166/0 (socket says 172.21.15.156:49166) 2023-09-30T22:21:31.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.999+0000 7efe9affd700 1 -- 172.21.15.156:0/1436041696 learned_addr learned my addr 172.21.15.156:0/1436041696 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:31.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.999+0000 7efe9b7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7efe9c09d860 0x7efe9c09dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40106/0 (socket says 172.21.15.156:40106) 2023-09-30T22:21:31.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.999+0000 7efe9bfff700 1 -- 172.21.15.156:0/1436041696 >> v2:172.21.15.156:3300/0 conn(0x7efe9c09e340 msgr2=0x7efe9c1359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:31.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.999+0000 7efe9bfff700 1 --2- 172.21.15.156:0/1436041696 >> v2:172.21.15.156:3300/0 conn(0x7efe9c09e340 0x7efe9c1359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.999+0000 7efe9bfff700 1 -- 172.21.15.156:0/1436041696 >> v1:172.21.15.156:6789/0 conn(0x7efe9c09d860 legacy=0x7efe9c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:31.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.999+0000 7efe9bfff700 1 -- 172.21.15.156:0/1436041696 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9c09b360 con 0x7efe9c135f20 2023-09-30T22:21:31.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:30.999+0000 7efe9affd700 1 --2- 172.21.15.156:0/1436041696 >> v2:172.21.15.156:3300/0 conn(0x7efe9c09e340 0x7efe9c1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:31.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.000+0000 7efe9bfff700 1 --2- 172.21.15.156:0/1436041696 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efe9c135f20 0x7efe9c138300 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7efe94009dc0 tx=0x7efe9400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67b9a0c978f14963 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:31.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.000+0000 7efe9a7fc700 1 -- 172.21.15.156:0/1436041696 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9400e070 con 0x7efe9c135f20 2023-09-30T22:21:31.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.000+0000 7efe9a7fc700 1 -- 172.21.15.156:0/1436041696 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9400bae0 con 0x7efe9c135f20 2023-09-30T22:21:31.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.000+0000 7efe9a7fc700 1 -- 172.21.15.156:0/1436041696 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9400be90 con 0x7efe9c135f20 2023-09-30T22:21:31.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.000+0000 7efea20d9700 1 -- 172.21.15.156:0/1436041696 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efe9c135f20 msgr2=0x7efe9c138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:31.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.000+0000 7efea20d9700 1 --2- 172.21.15.156:0/1436041696 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efe9c135f20 0x7efe9c138300 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7efe94009dc0 tx=0x7efe9400b330 comp rx=0 tx=0).stop 2023-09-30T22:21:31.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.000+0000 7efea20d9700 1 -- 172.21.15.156:0/1436041696 shutdown_connections 2023-09-30T22:21:31.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.000+0000 7efea20d9700 1 --2- 172.21.15.156:0/1436041696 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efe9c135f20 0x7efe9c138300 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.000+0000 7efea20d9700 1 --2- 172.21.15.156:0/1436041696 >> v2:172.21.15.156:3300/0 conn(0x7efe9c09e340 0x7efe9c1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.000+0000 7efea20d9700 1 -- 172.21.15.156:0/1436041696 >> 172.21.15.156:0/1436041696 conn(0x7efe9c099c40 msgr2=0x7efe9c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:31.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.000+0000 7efea20d9700 1 -- 172.21.15.156:0/1436041696 shutdown_connections 2023-09-30T22:21:31.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.000+0000 7efea20d9700 1 -- 172.21.15.156:0/1436041696 wait complete. 2023-09-30T22:21:31.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.001+0000 7efea20d9700 1 Processor -- start 2023-09-30T22:21:31.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.001+0000 7efea20d9700 1 -- start start 2023-09-30T22:21:31.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.002+0000 7efea20d9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efe9c09d860 0x7efe9c11d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:31.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.002+0000 7efea20d9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efe9c09e340 0x7efe9c11daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:31.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.002+0000 7efea20d9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efe9c135f20 0x7efe9c11dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:31.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.002+0000 7efea20d9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c11ea30 con 0x7efe9c135f20 2023-09-30T22:21:31.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.002+0000 7efea20d9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c121080 con 0x7efe9c09d860 2023-09-30T22:21:31.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.002+0000 7efea20d9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c11f170 con 0x7efe9c09e340 2023-09-30T22:21:31.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.002+0000 7efe9b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efe9c09d860 0x7efe9c11d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:31.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.002+0000 7efe9bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efe9c135f20 0x7efe9c11dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:31.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.002+0000 7efe9b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efe9c09d860 0x7efe9c11d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:39044/0 (socket says 172.21.15.156:39044) 2023-09-30T22:21:31.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.002+0000 7efe9b7fe700 1 -- 172.21.15.156:0/1844546224 learned_addr learned my addr 172.21.15.156:0/1844546224 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:31.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.002+0000 7efe9affd700 1 --2- 172.21.15.156:0/1844546224 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efe9c09e340 0x7efe9c11daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:31.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.002+0000 7efe9bfff700 1 -- 172.21.15.156:0/1844546224 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efe9c09e340 msgr2=0x7efe9c11daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:31.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.002+0000 7efe9bfff700 1 --2- 172.21.15.156:0/1844546224 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efe9c09e340 0x7efe9c11daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.002+0000 7efe9bfff700 1 -- 172.21.15.156:0/1844546224 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efe9c09d860 msgr2=0x7efe9c11d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:31.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.002+0000 7efe9bfff700 1 --2- 172.21.15.156:0/1844546224 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efe9c09d860 0x7efe9c11d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.002+0000 7efe9bfff700 1 -- 172.21.15.156:0/1844546224 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8c009550 con 0x7efe9c135f20 2023-09-30T22:21:31.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.002+0000 7efe9b7fe700 1 --2- 172.21.15.156:0/1844546224 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efe9c09d860 0x7efe9c11d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:31.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.002+0000 7efe9bfff700 1 --2- 172.21.15.156:0/1844546224 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efe9c135f20 0x7efe9c11dfe0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7efe94016000 tx=0x7efe94004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:31.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.003+0000 7efe83fff700 1 -- 172.21.15.156:0/1844546224 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe94004800 con 0x7efe9c135f20 2023-09-30T22:21:31.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.003+0000 7efe83fff700 1 -- 172.21.15.156:0/1844546224 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe94020070 con 0x7efe9c135f20 2023-09-30T22:21:31.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.003+0000 7efe83fff700 1 -- 172.21.15.156:0/1844546224 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe940276c0 con 0x7efe9c135f20 2023-09-30T22:21:31.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.003+0000 7efea20d9700 1 -- 172.21.15.156:0/1844546224 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe94009a70 con 0x7efe9c135f20 2023-09-30T22:21:31.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.003+0000 7efea20d9700 1 -- 172.21.15.156:0/1844546224 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe9c120ae0 con 0x7efe9c135f20 2023-09-30T22:21:31.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.004+0000 7efe83fff700 1 -- 172.21.15.156:0/1844546224 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe94027820 con 0x7efe9c135f20 2023-09-30T22:21:31.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.004+0000 7efea20d9700 1 -- 172.21.15.156:0/1844546224 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe9c04f2a0 con 0x7efe9c135f20 2023-09-30T22:21:31.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.004+0000 7efe83fff700 1 -- 172.21.15.156:0/1844546224 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efe94022070 con 0x7efe9c135f20 2023-09-30T22:21:31.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.008+0000 7efe83fff700 1 -- 172.21.15.156:0/1844546224 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe940127b0 con 0x7efe9c135f20 2023-09-30T22:21:31.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.189+0000 7efea20d9700 1 -- 172.21.15.156:0/1844546224 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efe9c11f940 con 0x7efe9c135f20 2023-09-30T22:21:31.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.190+0000 7efe83fff700 1 -- 172.21.15.156:0/1844546224 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe9401a7f0 con 0x7efe9c135f20 2023-09-30T22:21:31.190 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:31.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.191+0000 7efea20d9700 1 -- 172.21.15.156:0/1844546224 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efe9c135f20 msgr2=0x7efe9c11dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:31.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.191+0000 7efea20d9700 1 --2- 172.21.15.156:0/1844546224 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efe9c135f20 0x7efe9c11dfe0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7efe94016000 tx=0x7efe94004ad0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.191+0000 7efea20d9700 1 -- 172.21.15.156:0/1844546224 shutdown_connections 2023-09-30T22:21:31.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.191+0000 7efea20d9700 1 --2- 172.21.15.156:0/1844546224 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efe9c135f20 0x7efe9c11dfe0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.191+0000 7efea20d9700 1 --2- 172.21.15.156:0/1844546224 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efe9c09d860 0x7efe9c11d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.192+0000 7efea20d9700 1 --2- 172.21.15.156:0/1844546224 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efe9c09e340 0x7efe9c11daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.192+0000 7efea20d9700 1 -- 172.21.15.156:0/1844546224 >> 172.21.15.156:0/1844546224 conn(0x7efe9c099c40 msgr2=0x7efe9c1349e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:31.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.192+0000 7efea20d9700 1 -- 172.21.15.156:0/1844546224 shutdown_connections 2023-09-30T22:21:31.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.192+0000 7efea20d9700 1 -- 172.21.15.156:0/1844546224 wait complete. 2023-09-30T22:21:31.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:31.463 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:31.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.586+0000 7f372c76f700 1 Processor -- start 2023-09-30T22:21:31.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.586+0000 7f372c76f700 1 -- start start 2023-09-30T22:21:31.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.587+0000 7f372c76f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f372409d860 0x7f372409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:31.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.587+0000 7f372c76f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f372409e170 0x7f37241307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:31.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.587+0000 7f372c76f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f372409aaa0 con 0x7f3724130ce0 2023-09-30T22:21:31.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.587+0000 7f372c76f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372409f870 con 0x7f372409e170 2023-09-30T22:21:31.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.587+0000 7f372c76f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f372409b360 con 0x7f372409d860 2023-09-30T22:21:31.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.587+0000 7f3729d0a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f372409e170 0x7f37241307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:31.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.587+0000 7f372ad0c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f3724130ce0 0x7f37241379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47582/0 (socket says 172.21.15.156:47582) 2023-09-30T22:21:31.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.587+0000 7f372ad0c700 1 -- 172.21.15.156:0/1013264086 learned_addr learned my addr 172.21.15.156:0/1013264086 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:31.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.587+0000 7f372a50b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f372409d860 0x7f372409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:31.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.587+0000 7f3729d0a700 1 -- 172.21.15.156:0/1013264086 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f372409d860 msgr2=0x7f372409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:31.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.587+0000 7f3729509700 1 -- 172.21.15.156:0/1013264086 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215666755 0 0) 0x7f372409aaa0 con 0x7f3724130ce0 2023-09-30T22:21:31.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.587+0000 7f3729d0a700 1 --2- 172.21.15.156:0/1013264086 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f372409d860 0x7f372409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.587+0000 7f3729d0a700 1 -- 172.21.15.156:0/1013264086 >> v1:172.21.15.156:6789/0 conn(0x7f3724130ce0 legacy=0x7f37241379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:31.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.587+0000 7f3729d0a700 1 -- 172.21.15.156:0/1013264086 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372409b620 con 0x7f372409e170 2023-09-30T22:21:31.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.587+0000 7f3729d0a700 1 --2- 172.21.15.156:0/1013264086 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f372409e170 0x7f37241307a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3720009870 tx=0x7f3720009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=476c0032695335f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:31.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.588+0000 7f3729509700 1 -- 172.21.15.156:0/1013264086 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3720011830 con 0x7f372409e170 2023-09-30T22:21:31.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.588+0000 7f3729509700 1 -- 172.21.15.156:0/1013264086 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3720011990 con 0x7f372409e170 2023-09-30T22:21:31.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.588+0000 7f3729509700 1 -- 172.21.15.156:0/1013264086 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3720011d20 con 0x7f372409e170 2023-09-30T22:21:31.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.588+0000 7f372c76f700 1 -- 172.21.15.156:0/1013264086 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f372409e170 msgr2=0x7f37241307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:31.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.588+0000 7f372c76f700 1 --2- 172.21.15.156:0/1013264086 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f372409e170 0x7f37241307a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3720009870 tx=0x7f3720009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:31.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.588+0000 7f372c76f700 1 -- 172.21.15.156:0/1013264086 shutdown_connections 2023-09-30T22:21:31.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.588+0000 7f372c76f700 1 --2- 172.21.15.156:0/1013264086 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f372409d860 0x7f372409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.588+0000 7f372c76f700 1 --2- 172.21.15.156:0/1013264086 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f372409e170 0x7f37241307a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.588+0000 7f372c76f700 1 -- 172.21.15.156:0/1013264086 >> 172.21.15.156:0/1013264086 conn(0x7f3724099c40 msgr2=0x7f37240a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:31.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.588+0000 7f372c76f700 1 -- 172.21.15.156:0/1013264086 shutdown_connections 2023-09-30T22:21:31.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.588+0000 7f372c76f700 1 -- 172.21.15.156:0/1013264086 wait complete. 2023-09-30T22:21:31.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.589+0000 7f372c76f700 1 Processor -- start 2023-09-30T22:21:31.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.589+0000 7f372c76f700 1 -- start start 2023-09-30T22:21:31.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.590+0000 7f372c76f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f372409d860 0x7f372411f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:31.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.590+0000 7f372c76f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f372409e170 0x7f372411fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:31.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.590+0000 7f372c76f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3724130ce0 0x7f372411ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:31.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.590+0000 7f372c76f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3724122e70 con 0x7f372409e170 2023-09-30T22:21:31.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.590+0000 7f372c76f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3724123070 con 0x7f372409d860 2023-09-30T22:21:31.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.590+0000 7f372c76f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37241306e0 con 0x7f3724130ce0 2023-09-30T22:21:31.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.590+0000 7f372a50b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f372409d860 0x7f372411f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:31.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.590+0000 7f372a50b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f372409d860 0x7f372411f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:36836/0 (socket says 172.21.15.156:36836) 2023-09-30T22:21:31.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.590+0000 7f372ad0c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3724130ce0 0x7f372411ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:31.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.590+0000 7f372a50b700 1 -- 172.21.15.156:0/1416212249 learned_addr learned my addr 172.21.15.156:0/1416212249 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:31.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.590+0000 7f3729d0a700 1 --2- 172.21.15.156:0/1416212249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f372409e170 0x7f372411fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:31.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.590+0000 7f372a50b700 1 -- 172.21.15.156:0/1416212249 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3724130ce0 msgr2=0x7f372411ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:31.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.590+0000 7f372a50b700 1 --2- 172.21.15.156:0/1416212249 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3724130ce0 0x7f372411ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.590+0000 7f372a50b700 1 -- 172.21.15.156:0/1416212249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f372409e170 msgr2=0x7f372411fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:31.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.590+0000 7f372a50b700 1 --2- 172.21.15.156:0/1416212249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f372409e170 0x7f372411fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.590+0000 7f372a50b700 1 -- 172.21.15.156:0/1416212249 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37200094a0 con 0x7f372409d860 2023-09-30T22:21:31.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.590+0000 7f372ad0c700 1 --2- 172.21.15.156:0/1416212249 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3724130ce0 0x7f372411ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:31.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.590+0000 7f3729d0a700 1 --2- 172.21.15.156:0/1416212249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f372409e170 0x7f372411fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:31.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.590+0000 7f372a50b700 1 --2- 172.21.15.156:0/1416212249 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f372409d860 0x7f372411f550 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f371400e9b0 tx=0x7f371400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:31.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.590+0000 7f371affd700 1 -- 172.21.15.156:0/1416212249 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3714009710 con 0x7f372409d860 2023-09-30T22:21:31.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.590+0000 7f371affd700 1 -- 172.21.15.156:0/1416212249 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371400ee50 con 0x7f372409d860 2023-09-30T22:21:31.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.590+0000 7f372c76f700 1 -- 172.21.15.156:0/1416212249 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37241211c0 con 0x7f372409d860 2023-09-30T22:21:31.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.590+0000 7f371affd700 1 -- 172.21.15.156:0/1416212249 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371400ca50 con 0x7f372409d860 2023-09-30T22:21:31.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.590+0000 7f372c76f700 1 -- 172.21.15.156:0/1416212249 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3724122ad0 con 0x7f372409d860 2023-09-30T22:21:31.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.591+0000 7f371affd700 1 -- 172.21.15.156:0/1416212249 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f371400cbb0 con 0x7f372409d860 2023-09-30T22:21:31.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.591+0000 7f371affd700 1 -- 172.21.15.156:0/1416212249 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f371403f5d0 con 0x7f372409d860 2023-09-30T22:21:31.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.591+0000 7f372c76f700 1 -- 172.21.15.156:0/1416212249 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f372406be10 con 0x7f372409d860 2023-09-30T22:21:31.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.596+0000 7f371affd700 1 -- 172.21.15.156:0/1416212249 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3714013470 con 0x7f372409d860 2023-09-30T22:21:31.621 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:31.664 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:31.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.746+0000 7fb204f5c700 1 Processor -- start 2023-09-30T22:21:31.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.747+0000 7fb204f5c700 1 -- start start 2023-09-30T22:21:31.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.747+0000 7fb204f5c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb20009ad40 0x7fb200133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:31.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.747+0000 7fb204f5c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2001343a0 0x7fb2000a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:31.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.747+0000 7fb204f5c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb20009b110 con 0x7fb200133f70 2023-09-30T22:21:31.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.748+0000 7fb204f5c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2000a3b60 con 0x7fb2001343a0 2023-09-30T22:21:31.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.748+0000 7fb204f5c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2000a2fa0 con 0x7fb20009ad40 2023-09-30T22:21:31.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.748+0000 7fb1fe59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb20009ad40 0x7fb200133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:31.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.748+0000 7fb1fe59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb20009ad40 0x7fb200133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36092/0 (socket says 172.21.15.156:36092) 2023-09-30T22:21:31.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.748+0000 7fb1fe59c700 1 -- 172.21.15.156:0/3692119101 learned_addr learned my addr 172.21.15.156:0/3692119101 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:31.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.748+0000 7fb1fdd9b700 1 --1- 172.21.15.156:0/3692119101 >> v1:172.21.15.156:6789/0 conn(0x7fb200133f70 0x7fb2000a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47594/0 (socket says 172.21.15.156:47594) 2023-09-30T22:21:31.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.748+0000 7fb1fed9d700 1 --2- 172.21.15.156:0/3692119101 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2001343a0 0x7fb2000a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:31.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.748+0000 7fb1fe59c700 1 -- 172.21.15.156:0/3692119101 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2001343a0 msgr2=0x7fb2000a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:31.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.748+0000 7fb1fe59c700 1 --2- 172.21.15.156:0/3692119101 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2001343a0 0x7fb2000a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.748+0000 7fb1fe59c700 1 -- 172.21.15.156:0/3692119101 >> v1:172.21.15.156:6789/0 conn(0x7fb200133f70 legacy=0x7fb2000a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:31.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.748+0000 7fb1fe59c700 1 -- 172.21.15.156:0/3692119101 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20009a280 con 0x7fb20009ad40 2023-09-30T22:21:31.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.748+0000 7fb1fe59c700 1 --2- 172.21.15.156:0/3692119101 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb20009ad40 0x7fb200133a30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0009920 tx=0x7fb1f0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35f0719f21a5ef96 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:31.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.748+0000 7fb1fd59a700 1 -- 172.21.15.156:0/3692119101 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0011830 con 0x7fb20009ad40 2023-09-30T22:21:31.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.748+0000 7fb1fd59a700 1 -- 172.21.15.156:0/3692119101 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f0011990 con 0x7fb20009ad40 2023-09-30T22:21:31.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.748+0000 7fb1fd59a700 1 -- 172.21.15.156:0/3692119101 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0011d20 con 0x7fb20009ad40 2023-09-30T22:21:31.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.749+0000 7fb204f5c700 1 -- 172.21.15.156:0/3692119101 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb20009ad40 msgr2=0x7fb200133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:31.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.749+0000 7fb204f5c700 1 --2- 172.21.15.156:0/3692119101 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb20009ad40 0x7fb200133a30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0009920 tx=0x7fb1f0009c30 comp rx=0 tx=0).stop 2023-09-30T22:21:31.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.749+0000 7fb204f5c700 1 -- 172.21.15.156:0/3692119101 shutdown_connections 2023-09-30T22:21:31.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.749+0000 7fb204f5c700 1 --2- 172.21.15.156:0/3692119101 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2001343a0 0x7fb2000a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.749+0000 7fb204f5c700 1 --2- 172.21.15.156:0/3692119101 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb20009ad40 0x7fb200133a30 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.749+0000 7fb204f5c700 1 -- 172.21.15.156:0/3692119101 >> 172.21.15.156:0/3692119101 conn(0x7fb200099c40 msgr2=0x7fb20006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:31.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.749+0000 7fb204f5c700 1 -- 172.21.15.156:0/3692119101 shutdown_connections 2023-09-30T22:21:31.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.749+0000 7fb204f5c700 1 -- 172.21.15.156:0/3692119101 wait complete. 2023-09-30T22:21:31.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.751+0000 7fb204f5c700 1 Processor -- start 2023-09-30T22:21:31.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.751+0000 7fb204f5c700 1 -- start start 2023-09-30T22:21:31.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.752+0000 7fb204f5c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb20009ad40 0x7fb20011e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:31.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.752+0000 7fb204f5c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb200133f70 0x7fb20011e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:31.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.752+0000 7fb204f5c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2001343a0 0x7fb20011ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:31.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.752+0000 7fb204f5c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20011fe30 con 0x7fb20009ad40 2023-09-30T22:21:31.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.752+0000 7fb204f5c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20009c7e0 con 0x7fb200133f70 2023-09-30T22:21:31.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.752+0000 7fb204f5c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb200121a60 con 0x7fb2001343a0 2023-09-30T22:21:31.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.752+0000 7fb1fdd9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb200133f70 0x7fb20011e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:31.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.752+0000 7fb1fdd9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb200133f70 0x7fb20011e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:36852/0 (socket says 172.21.15.156:36852) 2023-09-30T22:21:31.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.752+0000 7fb1fdd9b700 1 -- 172.21.15.156:0/4018199902 learned_addr learned my addr 172.21.15.156:0/4018199902 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:31.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.752+0000 7fb1fe59c700 1 --2- 172.21.15.156:0/4018199902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb20009ad40 0x7fb20011e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:31.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.752+0000 7fb1fed9d700 1 --2- 172.21.15.156:0/4018199902 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2001343a0 0x7fb20011ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:31.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.752+0000 7fb1fdd9b700 1 -- 172.21.15.156:0/4018199902 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2001343a0 msgr2=0x7fb20011ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:31.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.752+0000 7fb1fdd9b700 1 --2- 172.21.15.156:0/4018199902 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2001343a0 0x7fb20011ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.752+0000 7fb1fdd9b700 1 -- 172.21.15.156:0/4018199902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb20009ad40 msgr2=0x7fb20011e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:31.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.752+0000 7fb1fdd9b700 1 --2- 172.21.15.156:0/4018199902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb20009ad40 0x7fb20011e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.752+0000 7fb1fdd9b700 1 -- 172.21.15.156:0/4018199902 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f0009550 con 0x7fb200133f70 2023-09-30T22:21:31.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.752+0000 7fb1fe59c700 1 --2- 172.21.15.156:0/4018199902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb20009ad40 0x7fb20011e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:31.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.752+0000 7fb1fdd9b700 1 --2- 172.21.15.156:0/4018199902 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb200133f70 0x7fb20011e7a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb1f400c4f0 tx=0x7fb1f400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:31.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.752+0000 7fb1eeffd700 1 -- 172.21.15.156:0/4018199902 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4005cb0 con 0x7fb200133f70 2023-09-30T22:21:31.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.752+0000 7fb1eeffd700 1 -- 172.21.15.156:0/4018199902 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f4005e10 con 0x7fb200133f70 2023-09-30T22:21:31.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.753+0000 7fb1eeffd700 1 -- 172.21.15.156:0/4018199902 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f40072d0 con 0x7fb200133f70 2023-09-30T22:21:31.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.753+0000 7fb204f5c700 1 -- 172.21.15.156:0/4018199902 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb20009ec70 con 0x7fb200133f70 2023-09-30T22:21:31.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.753+0000 7fb204f5c700 1 -- 172.21.15.156:0/4018199902 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2001214d0 con 0x7fb200133f70 2023-09-30T22:21:31.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.753+0000 7fb1eeffd700 1 -- 172.21.15.156:0/4018199902 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb1f4007430 con 0x7fb200133f70 2023-09-30T22:21:31.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.753+0000 7fb1eeffd700 1 -- 172.21.15.156:0/4018199902 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb1f403ea30 con 0x7fb200133f70 2023-09-30T22:21:31.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.753+0000 7fb204f5c700 1 -- 172.21.15.156:0/4018199902 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2000a58b0 con 0x7fb200133f70 2023-09-30T22:21:31.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.758+0000 7fb1eeffd700 1 -- 172.21.15.156:0/4018199902 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb1f4017020 con 0x7fb200133f70 2023-09-30T22:21:31.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.796+0000 7f372c76f700 1 -- 172.21.15.156:0/1416212249 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3724122cc0 con 0x7f372409d860 2023-09-30T22:21:31.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.796+0000 7f371affd700 1 -- 172.21.15.156:0/1416212249 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3714017020 con 0x7f372409d860 2023-09-30T22:21:31.797 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:31.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.798+0000 7f372c76f700 1 -- 172.21.15.156:0/1416212249 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f372409d860 msgr2=0x7f372411f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:31.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.798+0000 7f372c76f700 1 --2- 172.21.15.156:0/1416212249 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f372409d860 0x7f372411f550 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f371400e9b0 tx=0x7f371400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.799+0000 7f372c76f700 1 -- 172.21.15.156:0/1416212249 shutdown_connections 2023-09-30T22:21:31.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.799+0000 7f372c76f700 1 --2- 172.21.15.156:0/1416212249 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3724130ce0 0x7f372411ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.799+0000 7f372c76f700 1 --2- 172.21.15.156:0/1416212249 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f372409d860 0x7f372411f550 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.799+0000 7f372c76f700 1 --2- 172.21.15.156:0/1416212249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f372409e170 0x7f372411fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.799+0000 7f372c76f700 1 -- 172.21.15.156:0/1416212249 >> 172.21.15.156:0/1416212249 conn(0x7f3724099c40 msgr2=0x7f37240a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:31.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.799+0000 7f372c76f700 1 -- 172.21.15.156:0/1416212249 shutdown_connections 2023-09-30T22:21:31.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.799+0000 7f372c76f700 1 -- 172.21.15.156:0/1416212249 wait complete. 2023-09-30T22:21:31.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.806+0000 7f8a31a30700 1 Processor -- start 2023-09-30T22:21:31.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.806+0000 7f8a31a30700 1 -- start start 2023-09-30T22:21:31.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.807+0000 7f8a31a30700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8a2c09d860 0x7f8a2c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:31.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.807+0000 7f8a31a30700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a2c09e170 0x7f8a2c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:31.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.807+0000 7f8a31a30700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a2c09aaa0 con 0x7f8a2c130ce0 2023-09-30T22:21:31.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.807+0000 7f8a31a30700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a2c09f870 con 0x7f8a2c09d860 2023-09-30T22:21:31.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.807+0000 7f8a31a30700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c09b360 con 0x7f8a2c09e170 2023-09-30T22:21:31.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.807+0000 7f8a2affd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8a2c09d860 0x7f8a2c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:31.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.807+0000 7f8a2b7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f8a2c130ce0 0x7f8a2c1379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47596/0 (socket says 172.21.15.156:47596) 2023-09-30T22:21:31.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.807+0000 7f8a2b7fe700 1 -- 172.21.15.156:0/2826290776 learned_addr learned my addr 172.21.15.156:0/2826290776 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:31.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.807+0000 7f8a2a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a2c09e170 0x7f8a2c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:31.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.807+0000 7f8a29ffb700 1 -- 172.21.15.156:0/2826290776 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1452093531 0 0) 0x7f8a2c09aaa0 con 0x7f8a2c130ce0 2023-09-30T22:21:31.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.807+0000 7f8a29ffb700 1 -- 172.21.15.156:0/2826290776 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a140035b0 con 0x7f8a2c130ce0 2023-09-30T22:21:31.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.807+0000 7f8a2a7fc700 1 -- 172.21.15.156:0/2826290776 >> v2:172.21.15.156:3300/0 conn(0x7f8a2c09d860 msgr2=0x7f8a2c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:31.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.807+0000 7f8a2a7fc700 1 --2- 172.21.15.156:0/2826290776 >> v2:172.21.15.156:3300/0 conn(0x7f8a2c09d860 0x7f8a2c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.807+0000 7f8a2a7fc700 1 -- 172.21.15.156:0/2826290776 >> v1:172.21.15.156:6789/0 conn(0x7f8a2c130ce0 legacy=0x7f8a2c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:31.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.807+0000 7f8a2a7fc700 1 -- 172.21.15.156:0/2826290776 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2c09b620 con 0x7f8a2c09e170 2023-09-30T22:21:31.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.807+0000 7f8a2a7fc700 1 --2- 172.21.15.156:0/2826290776 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a2c09e170 0x7f8a2c1307a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8a20009840 tx=0x7f8a20009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f95ac7df0888b55f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:31.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.808+0000 7f8a29ffb700 1 -- 172.21.15.156:0/2826290776 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a20011830 con 0x7f8a2c09e170 2023-09-30T22:21:31.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.808+0000 7f8a29ffb700 1 -- 172.21.15.156:0/2826290776 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a20011990 con 0x7f8a2c09e170 2023-09-30T22:21:31.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.808+0000 7f8a29ffb700 1 -- 172.21.15.156:0/2826290776 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a20011d20 con 0x7f8a2c09e170 2023-09-30T22:21:31.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.808+0000 7f8a31a30700 1 -- 172.21.15.156:0/2826290776 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a2c09e170 msgr2=0x7f8a2c1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:31.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.808+0000 7f8a31a30700 1 --2- 172.21.15.156:0/2826290776 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a2c09e170 0x7f8a2c1307a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8a20009840 tx=0x7f8a20009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:31.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.808+0000 7f8a31a30700 1 -- 172.21.15.156:0/2826290776 shutdown_connections 2023-09-30T22:21:31.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.808+0000 7f8a31a30700 1 --2- 172.21.15.156:0/2826290776 >> v2:172.21.15.156:3300/0 conn(0x7f8a2c09d860 0x7f8a2c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.808+0000 7f8a31a30700 1 --2- 172.21.15.156:0/2826290776 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a2c09e170 0x7f8a2c1307a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.808+0000 7f8a31a30700 1 -- 172.21.15.156:0/2826290776 >> 172.21.15.156:0/2826290776 conn(0x7f8a2c099c40 msgr2=0x7f8a2c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:31.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.808+0000 7f8a31a30700 1 -- 172.21.15.156:0/2826290776 shutdown_connections 2023-09-30T22:21:31.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.808+0000 7f8a31a30700 1 -- 172.21.15.156:0/2826290776 wait complete. 2023-09-30T22:21:31.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.809+0000 7f8a31a30700 1 Processor -- start 2023-09-30T22:21:31.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.810+0000 7f8a31a30700 1 -- start start 2023-09-30T22:21:31.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.810+0000 7f8a31a30700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a2c09d860 0x7f8a2c1c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:31.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.810+0000 7f8a31a30700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a2c09e170 0x7f8a2c1c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:31.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.810+0000 7f8a31a30700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a2c130ce0 0x7f8a2c1c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:31.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.810+0000 7f8a31a30700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c1261b0 con 0x7f8a2c130ce0 2023-09-30T22:21:31.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.810+0000 7f8a31a30700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c1207b0 con 0x7f8a2c09e170 2023-09-30T22:21:31.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.810+0000 7f8a31a30700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c126d20 con 0x7f8a2c09d860 2023-09-30T22:21:31.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.810+0000 7f8a2affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a2c09d860 0x7f8a2c1c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:31.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.810+0000 7f8a2b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a2c130ce0 0x7f8a2c1c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:31.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.810+0000 7f8a2affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a2c09d860 0x7f8a2c1c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36124/0 (socket says 172.21.15.156:36124) 2023-09-30T22:21:31.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.810+0000 7f8a2b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a2c130ce0 0x7f8a2c1c8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50114/0 (socket says 172.21.15.156:50114) 2023-09-30T22:21:31.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.810+0000 7f8a2affd700 1 -- 172.21.15.156:0/1895580715 learned_addr learned my addr 172.21.15.156:0/1895580715 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:31.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.810+0000 7f8a2a7fc700 1 --2- 172.21.15.156:0/1895580715 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a2c09e170 0x7f8a2c1c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:31.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.811+0000 7f8a2affd700 1 -- 172.21.15.156:0/1895580715 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a2c09e170 msgr2=0x7f8a2c1c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:31.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.811+0000 7f8a2affd700 1 --2- 172.21.15.156:0/1895580715 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a2c09e170 0x7f8a2c1c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.811+0000 7f8a2affd700 1 -- 172.21.15.156:0/1895580715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a2c130ce0 msgr2=0x7f8a2c1c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:31.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.811+0000 7f8a2affd700 1 --2- 172.21.15.156:0/1895580715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a2c130ce0 0x7f8a2c1c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.811+0000 7f8a2affd700 1 -- 172.21.15.156:0/1895580715 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a200094a0 con 0x7f8a2c09d860 2023-09-30T22:21:31.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.811+0000 7f8a2a7fc700 1 --2- 172.21.15.156:0/1895580715 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a2c09e170 0x7f8a2c1c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:31.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.811+0000 7f8a2b7fe700 1 --2- 172.21.15.156:0/1895580715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a2c130ce0 0x7f8a2c1c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:31.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.811+0000 7f8a2affd700 1 --2- 172.21.15.156:0/1895580715 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a2c09d860 0x7f8a2c1c8100 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00e9b0 tx=0x7f8a1c00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:31.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.811+0000 7f8a13fff700 1 -- 172.21.15.156:0/1895580715 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c009710 con 0x7f8a2c09d860 2023-09-30T22:21:31.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.811+0000 7f8a13fff700 1 -- 172.21.15.156:0/1895580715 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1c00ee50 con 0x7f8a2c09d860 2023-09-30T22:21:31.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.811+0000 7f8a31a30700 1 -- 172.21.15.156:0/1895580715 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a2c06b280 con 0x7f8a2c09d860 2023-09-30T22:21:31.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.811+0000 7f8a13fff700 1 -- 172.21.15.156:0/1895580715 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c00ca50 con 0x7f8a2c09d860 2023-09-30T22:21:31.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.811+0000 7f8a31a30700 1 -- 172.21.15.156:0/1895580715 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2c06a9e0 con 0x7f8a2c09d860 2023-09-30T22:21:31.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:31.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.812+0000 7f8a31a30700 1 -- 172.21.15.156:0/1895580715 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a2c04f2a0 con 0x7f8a2c09d860 2023-09-30T22:21:31.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.813+0000 7f8a13fff700 1 -- 172.21.15.156:0/1895580715 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8a1c00cbb0 con 0x7f8a2c09d860 2023-09-30T22:21:31.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.813+0000 7f8a13fff700 1 -- 172.21.15.156:0/1895580715 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8a1c03fa80 con 0x7f8a2c09d860 2023-09-30T22:21:31.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.818+0000 7f8a13fff700 1 -- 172.21.15.156:0/1895580715 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a1c01b3b0 con 0x7f8a2c09d860 2023-09-30T22:21:31.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.973+0000 7fb204f5c700 1 -- 172.21.15.156:0/4018199902 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb20004f2a0 con 0x7fb200133f70 2023-09-30T22:21:31.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.974+0000 7fb1eeffd700 1 -- 172.21.15.156:0/4018199902 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb1f401b3b0 con 0x7fb200133f70 2023-09-30T22:21:31.974 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:31.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.976+0000 7fb204f5c700 1 -- 172.21.15.156:0/4018199902 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb200133f70 msgr2=0x7fb20011e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:31.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.976+0000 7fb204f5c700 1 --2- 172.21.15.156:0/4018199902 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb200133f70 0x7fb20011e7a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb1f400c4f0 tx=0x7fb1f400c800 comp rx=0 tx=0).stop 2023-09-30T22:21:31.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.976+0000 7fb204f5c700 1 -- 172.21.15.156:0/4018199902 shutdown_connections 2023-09-30T22:21:31.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.976+0000 7fb204f5c700 1 --2- 172.21.15.156:0/4018199902 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2001343a0 0x7fb20011ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.976+0000 7fb204f5c700 1 --2- 172.21.15.156:0/4018199902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb20009ad40 0x7fb20011e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.976+0000 7fb204f5c700 1 --2- 172.21.15.156:0/4018199902 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb200133f70 0x7fb20011e7a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:31.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.976+0000 7fb204f5c700 1 -- 172.21.15.156:0/4018199902 >> 172.21.15.156:0/4018199902 conn(0x7fb200099c40 msgr2=0x7fb2001332a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:31.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.976+0000 7fb204f5c700 1 -- 172.21.15.156:0/4018199902 shutdown_connections 2023-09-30T22:21:31.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:31.976+0000 7fb204f5c700 1 -- 172.21.15.156:0/4018199902 wait complete. 2023-09-30T22:21:31.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:32.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.012+0000 7f8a31a30700 1 -- 172.21.15.156:0/1895580715 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8a2c06c3b0 con 0x7f8a2c09d860 2023-09-30T22:21:32.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.012+0000 7f8a13fff700 1 -- 172.21.15.156:0/1895580715 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8a1c01ab10 con 0x7f8a2c09d860 2023-09-30T22:21:32.013 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:32.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.014+0000 7f8a31a30700 1 -- 172.21.15.156:0/1895580715 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a2c09d860 msgr2=0x7f8a2c1c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:32.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.014+0000 7f8a31a30700 1 --2- 172.21.15.156:0/1895580715 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a2c09d860 0x7f8a2c1c8100 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00e9b0 tx=0x7f8a1c00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:21:32.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.014+0000 7f8a31a30700 1 -- 172.21.15.156:0/1895580715 shutdown_connections 2023-09-30T22:21:32.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.014+0000 7f8a31a30700 1 --2- 172.21.15.156:0/1895580715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a2c130ce0 0x7f8a2c1c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:32.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.014+0000 7f8a31a30700 1 --2- 172.21.15.156:0/1895580715 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a2c09d860 0x7f8a2c1c8100 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:32.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.014+0000 7f8a31a30700 1 --2- 172.21.15.156:0/1895580715 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a2c09e170 0x7f8a2c1c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:32.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.014+0000 7f8a31a30700 1 -- 172.21.15.156:0/1895580715 >> 172.21.15.156:0/1895580715 conn(0x7f8a2c099c40 msgr2=0x7f8a2c0a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:32.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.014+0000 7f8a31a30700 1 -- 172.21.15.156:0/1895580715 shutdown_connections 2023-09-30T22:21:32.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.014+0000 7f8a31a30700 1 -- 172.21.15.156:0/1895580715 wait complete. 2023-09-30T22:21:32.027 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:32.206 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:32.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.327+0000 7fab511af700 1 Processor -- start 2023-09-30T22:21:32.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.327+0000 7fab511af700 1 -- start start 2023-09-30T22:21:32.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.328+0000 7fab511af700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fab4c09d860 0x7fab4c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:32.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.328+0000 7fab511af700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab4c09e170 0x7fab4c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:32.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.328+0000 7fab511af700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab4c130ce0 0x7fab4c131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:32.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.328+0000 7fab511af700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4c131670 con 0x7fab4c09d860 2023-09-30T22:21:32.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.328+0000 7fab511af700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c09aaa0 con 0x7fab4c09e170 2023-09-30T22:21:32.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.328+0000 7fab511af700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c09f870 con 0x7fab4c130ce0 2023-09-30T22:21:32.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.328+0000 7fab4a59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab4c09e170 0x7fab4c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:32.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.328+0000 7fab4ad9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fab4c09d860 0x7fab4c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:32.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.328+0000 7fab4b59e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab4c130ce0 0x7fab4c131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:32.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.328+0000 7fab4a59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab4c09e170 0x7fab4c1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:36864/0 (socket says 172.21.15.156:36864) 2023-09-30T22:21:32.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.328+0000 7fab4a59c700 1 -- 172.21.15.156:0/1215254093 learned_addr learned my addr 172.21.15.156:0/1215254093 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:32.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.328+0000 7fab4a59c700 1 -- 172.21.15.156:0/1215254093 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab4c130ce0 msgr2=0x7fab4c131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:32.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.328+0000 7fab4a59c700 1 --2- 172.21.15.156:0/1215254093 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab4c130ce0 0x7fab4c131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:32.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.328+0000 7fab4a59c700 1 -- 172.21.15.156:0/1215254093 >> v2:172.21.15.156:3300/0 conn(0x7fab4c09d860 msgr2=0x7fab4c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:32.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.328+0000 7fab4a59c700 1 --2- 172.21.15.156:0/1215254093 >> v2:172.21.15.156:3300/0 conn(0x7fab4c09d860 0x7fab4c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:32.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.328+0000 7fab4a59c700 1 -- 172.21.15.156:0/1215254093 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c09b360 con 0x7fab4c09e170 2023-09-30T22:21:32.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.328+0000 7fab4b59e700 1 --2- 172.21.15.156:0/1215254093 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab4c130ce0 0x7fab4c131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:32.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.328+0000 7fab4ad9d700 1 --2- 172.21.15.156:0/1215254093 >> v2:172.21.15.156:3300/0 conn(0x7fab4c09d860 0x7fab4c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:32.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.329+0000 7fab4a59c700 1 --2- 172.21.15.156:0/1215254093 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab4c09e170 0x7fab4c1307a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fab3c00bb90 tx=0x7fab3c00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa1920d5871379e2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:32.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.329+0000 7fab49d9b700 1 -- 172.21.15.156:0/1215254093 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c00dd30 con 0x7fab4c09e170 2023-09-30T22:21:32.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.329+0000 7fab49d9b700 1 -- 172.21.15.156:0/1215254093 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3c00de90 con 0x7fab4c09e170 2023-09-30T22:21:32.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.329+0000 7fab49d9b700 1 -- 172.21.15.156:0/1215254093 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c010690 con 0x7fab4c09e170 2023-09-30T22:21:32.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.329+0000 7fab511af700 1 -- 172.21.15.156:0/1215254093 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab4c09e170 msgr2=0x7fab4c1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:32.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.329+0000 7fab511af700 1 --2- 172.21.15.156:0/1215254093 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab4c09e170 0x7fab4c1307a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fab3c00bb90 tx=0x7fab3c00bea0 comp rx=0 tx=0).stop 2023-09-30T22:21:32.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.329+0000 7fab511af700 1 -- 172.21.15.156:0/1215254093 shutdown_connections 2023-09-30T22:21:32.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.329+0000 7fab511af700 1 --2- 172.21.15.156:0/1215254093 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab4c130ce0 0x7fab4c131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:32.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.329+0000 7fab511af700 1 --2- 172.21.15.156:0/1215254093 >> v2:172.21.15.156:3300/0 conn(0x7fab4c09d860 0x7fab4c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:32.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.329+0000 7fab511af700 1 --2- 172.21.15.156:0/1215254093 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab4c09e170 0x7fab4c1307a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:32.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.329+0000 7fab511af700 1 -- 172.21.15.156:0/1215254093 >> 172.21.15.156:0/1215254093 conn(0x7fab4c099c40 msgr2=0x7fab4c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:32.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.329+0000 7fab511af700 1 -- 172.21.15.156:0/1215254093 shutdown_connections 2023-09-30T22:21:32.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.329+0000 7fab511af700 1 -- 172.21.15.156:0/1215254093 wait complete. 2023-09-30T22:21:32.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.330+0000 7fab511af700 1 Processor -- start 2023-09-30T22:21:32.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.330+0000 7fab511af700 1 -- start start 2023-09-30T22:21:32.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.331+0000 7fab511af700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab4c09d860 0x7fab4c1213d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:32.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.331+0000 7fab511af700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab4c09e170 0x7fab4c121910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:32.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.331+0000 7fab511af700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab4c130ce0 0x7fab4c121e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:32.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.331+0000 7fab511af700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c124310 con 0x7fab4c09d860 2023-09-30T22:21:32.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.331+0000 7fab511af700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c123580 con 0x7fab4c130ce0 2023-09-30T22:21:32.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.331+0000 7fab511af700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c09c8b0 con 0x7fab4c09e170 2023-09-30T22:21:32.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.331+0000 7fab4ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab4c09d860 0x7fab4c1213d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:32.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.331+0000 7fab4ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab4c09d860 0x7fab4c1213d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50146/0 (socket says 172.21.15.156:50146) 2023-09-30T22:21:32.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.331+0000 7fab4ad9d700 1 -- 172.21.15.156:0/479494258 learned_addr learned my addr 172.21.15.156:0/479494258 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:32.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.331+0000 7fab4b59e700 1 --2- 172.21.15.156:0/479494258 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab4c130ce0 0x7fab4c121e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:32.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.331+0000 7fab4a59c700 1 --2- 172.21.15.156:0/479494258 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab4c09e170 0x7fab4c121910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:32.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.331+0000 7fab4ad9d700 1 -- 172.21.15.156:0/479494258 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab4c09e170 msgr2=0x7fab4c121910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:32.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.331+0000 7fab4ad9d700 1 --2- 172.21.15.156:0/479494258 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab4c09e170 0x7fab4c121910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:32.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.331+0000 7fab4ad9d700 1 -- 172.21.15.156:0/479494258 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab4c130ce0 msgr2=0x7fab4c121e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:32.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.331+0000 7fab4ad9d700 1 --2- 172.21.15.156:0/479494258 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab4c130ce0 0x7fab4c121e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:32.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.331+0000 7fab4ad9d700 1 -- 172.21.15.156:0/479494258 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab400094a0 con 0x7fab4c09d860 2023-09-30T22:21:32.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.331+0000 7fab4ad9d700 1 --2- 172.21.15.156:0/479494258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab4c09d860 0x7fab4c1213d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fab4000ebe0 tx=0x7fab4000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:32.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.332+0000 7fab337fe700 1 -- 172.21.15.156:0/479494258 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab40009780 con 0x7fab4c09d860 2023-09-30T22:21:32.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.332+0000 7fab337fe700 1 -- 172.21.15.156:0/479494258 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4000c850 con 0x7fab4c09d860 2023-09-30T22:21:32.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.332+0000 7fab511af700 1 -- 172.21.15.156:0/479494258 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab44009a70 con 0x7fab4c09d860 2023-09-30T22:21:32.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.332+0000 7fab337fe700 1 -- 172.21.15.156:0/479494258 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4000cbe0 con 0x7fab4c09d860 2023-09-30T22:21:32.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.332+0000 7fab511af700 1 -- 172.21.15.156:0/479494258 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab3c00b7f0 con 0x7fab4c09d860 2023-09-30T22:21:32.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.332+0000 7fab337fe700 1 -- 172.21.15.156:0/479494258 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab4000cd40 con 0x7fab4c09d860 2023-09-30T22:21:32.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.333+0000 7fab337fe700 1 -- 172.21.15.156:0/479494258 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fab4003f740 con 0x7fab4c09d860 2023-09-30T22:21:32.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.333+0000 7fab511af700 1 -- 172.21.15.156:0/479494258 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab4c04f2a0 con 0x7fab4c09d860 2023-09-30T22:21:32.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.338+0000 7fab337fe700 1 -- 172.21.15.156:0/479494258 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab400232f0 con 0x7fab4c09d860 2023-09-30T22:21:32.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.521+0000 7fab511af700 1 -- 172.21.15.156:0/479494258 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fab4c09b670 con 0x7fab4c09d860 2023-09-30T22:21:32.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.521+0000 7fab337fe700 1 -- 172.21.15.156:0/479494258 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab40021020 con 0x7fab4c09d860 2023-09-30T22:21:32.522 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:32.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.523+0000 7fab511af700 1 -- 172.21.15.156:0/479494258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab4c09d860 msgr2=0x7fab4c1213d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:32.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.523+0000 7fab511af700 1 --2- 172.21.15.156:0/479494258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab4c09d860 0x7fab4c1213d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fab4000ebe0 tx=0x7fab4000eef0 comp rx=0 tx=0).stop 2023-09-30T22:21:32.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.523+0000 7fab511af700 1 -- 172.21.15.156:0/479494258 shutdown_connections 2023-09-30T22:21:32.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.523+0000 7fab511af700 1 --2- 172.21.15.156:0/479494258 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab4c130ce0 0x7fab4c121e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:32.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.523+0000 7fab511af700 1 --2- 172.21.15.156:0/479494258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab4c09d860 0x7fab4c1213d0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:32.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.523+0000 7fab511af700 1 --2- 172.21.15.156:0/479494258 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab4c09e170 0x7fab4c121910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:32.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.523+0000 7fab511af700 1 -- 172.21.15.156:0/479494258 >> 172.21.15.156:0/479494258 conn(0x7fab4c099c40 msgr2=0x7fab4c130010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:32.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.523+0000 7fab511af700 1 -- 172.21.15.156:0/479494258 shutdown_connections 2023-09-30T22:21:32.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.523+0000 7fab511af700 1 -- 172.21.15.156:0/479494258 wait complete. 2023-09-30T22:21:32.536 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:32.817 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:32.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.940+0000 7f3ea9adf700 1 Processor -- start 2023-09-30T22:21:32.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.940+0000 7f3ea9adf700 1 -- start start 2023-09-30T22:21:32.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.940+0000 7f3ea9adf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ea409e870 0x7f3ea409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:32.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.940+0000 7f3ea9adf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ea409f180 0x7f3ea4131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:32.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.940+0000 7f3ea9adf700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea409c970 con 0x7f3ea4131d70 2023-09-30T22:21:32.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.940+0000 7f3ea9adf700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea40a0920 con 0x7f3ea409f180 2023-09-30T22:21:32.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.940+0000 7f3ea9adf700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea409f9c0 con 0x7f3ea409e870 2023-09-30T22:21:32.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.940+0000 7f3ea37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ea409e870 0x7f3ea409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:32.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.940+0000 7f3ea3fff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f3ea4131d70 0x7f3ea4138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47600/0 (socket says 172.21.15.156:47600) 2023-09-30T22:21:32.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.940+0000 7f3ea37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ea409e870 0x7f3ea409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36144/0 (socket says 172.21.15.156:36144) 2023-09-30T22:21:32.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.940+0000 7f3ea3fff700 1 -- 172.21.15.156:0/315389584 learned_addr learned my addr 172.21.15.156:0/315389584 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:32.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.940+0000 7f3ea2ffd700 1 --2- 172.21.15.156:0/315389584 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ea409f180 0x7f3ea4131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:32.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.940+0000 7f3ea27fc700 1 -- 172.21.15.156:0/315389584 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057277759 0 0) 0x7f3ea409c970 con 0x7f3ea4131d70 2023-09-30T22:21:32.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.940+0000 7f3ea27fc700 1 -- 172.21.15.156:0/315389584 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e8c0035b0 con 0x7f3ea4131d70 2023-09-30T22:21:32.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.940+0000 7f3ea37fe700 1 -- 172.21.15.156:0/315389584 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ea409f180 msgr2=0x7f3ea4131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:32.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.940+0000 7f3ea37fe700 1 --2- 172.21.15.156:0/315389584 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ea409f180 0x7f3ea4131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:32.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.940+0000 7f3ea37fe700 1 -- 172.21.15.156:0/315389584 >> v1:172.21.15.156:6789/0 conn(0x7f3ea4131d70 legacy=0x7f3ea4138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:32.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.940+0000 7f3ea37fe700 1 -- 172.21.15.156:0/315389584 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea409bab0 con 0x7f3ea409e870 2023-09-30T22:21:32.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.940+0000 7f3ea2ffd700 1 --2- 172.21.15.156:0/315389584 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ea409f180 0x7f3ea4131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:32.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.940+0000 7f3ea37fe700 1 --2- 172.21.15.156:0/315389584 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ea409e870 0x7f3ea409ec40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009870 tx=0x7f3e94009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e293db73282d943 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:32.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.940+0000 7f3ea27fc700 1 -- 172.21.15.156:0/315389584 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e94011830 con 0x7f3ea409e870 2023-09-30T22:21:32.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.940+0000 7f3ea27fc700 1 -- 172.21.15.156:0/315389584 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e94011990 con 0x7f3ea409e870 2023-09-30T22:21:32.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.940+0000 7f3ea27fc700 1 -- 172.21.15.156:0/315389584 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e94011d20 con 0x7f3ea409e870 2023-09-30T22:21:32.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.941+0000 7f3ea9adf700 1 -- 172.21.15.156:0/315389584 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ea409e870 msgr2=0x7f3ea409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:32.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.941+0000 7f3ea9adf700 1 --2- 172.21.15.156:0/315389584 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ea409e870 0x7f3ea409ec40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009870 tx=0x7f3e94009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:32.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.941+0000 7f3ea9adf700 1 -- 172.21.15.156:0/315389584 shutdown_connections 2023-09-30T22:21:32.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.941+0000 7f3ea9adf700 1 --2- 172.21.15.156:0/315389584 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ea409e870 0x7f3ea409ec40 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:32.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.941+0000 7f3ea9adf700 1 --2- 172.21.15.156:0/315389584 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ea409f180 0x7f3ea4131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:32.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.941+0000 7f3ea9adf700 1 -- 172.21.15.156:0/315389584 >> 172.21.15.156:0/315389584 conn(0x7f3ea40a4430 msgr2=0x7f3ea40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:32.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.941+0000 7f3ea9adf700 1 -- 172.21.15.156:0/315389584 shutdown_connections 2023-09-30T22:21:32.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.941+0000 7f3ea9adf700 1 -- 172.21.15.156:0/315389584 wait complete. 2023-09-30T22:21:32.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.942+0000 7f3ea9adf700 1 Processor -- start 2023-09-30T22:21:32.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.942+0000 7f3ea9adf700 1 -- start start 2023-09-30T22:21:32.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.942+0000 7f3ea9adf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ea409e870 0x7f3ea411f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:32.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.942+0000 7f3ea9adf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ea409f180 0x7f3ea411f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:32.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.942+0000 7f3ea9adf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ea4131d70 0x7f3ea411fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:32.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.942+0000 7f3ea9adf700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea41205b0 con 0x7f3ea409e870 2023-09-30T22:21:32.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.942+0000 7f3ea9adf700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea4122c20 con 0x7f3ea4131d70 2023-09-30T22:21:32.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.942+0000 7f3ea9adf700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea4122710 con 0x7f3ea409f180 2023-09-30T22:21:32.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.942+0000 7f3ea37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ea409e870 0x7f3ea411f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:32.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.942+0000 7f3ea37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ea409e870 0x7f3ea411f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50162/0 (socket says 172.21.15.156:50162) 2023-09-30T22:21:32.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.942+0000 7f3ea37fe700 1 -- 172.21.15.156:0/3081273103 learned_addr learned my addr 172.21.15.156:0/3081273103 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:32.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.942+0000 7f3ea3fff700 1 --2- 172.21.15.156:0/3081273103 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ea4131d70 0x7f3ea411fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:32.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.942+0000 7f3ea2ffd700 1 --2- 172.21.15.156:0/3081273103 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ea409f180 0x7f3ea411f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:32.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.943+0000 7f3ea37fe700 1 -- 172.21.15.156:0/3081273103 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ea409f180 msgr2=0x7f3ea411f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:32.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.943+0000 7f3ea37fe700 1 --2- 172.21.15.156:0/3081273103 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ea409f180 0x7f3ea411f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:32.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.943+0000 7f3ea37fe700 1 -- 172.21.15.156:0/3081273103 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ea4131d70 msgr2=0x7f3ea411fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:32.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.943+0000 7f3ea37fe700 1 --2- 172.21.15.156:0/3081273103 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ea4131d70 0x7f3ea411fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:32.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.943+0000 7f3ea37fe700 1 -- 172.21.15.156:0/3081273103 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e980094a0 con 0x7f3ea409e870 2023-09-30T22:21:32.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.943+0000 7f3ea2ffd700 1 --2- 172.21.15.156:0/3081273103 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ea409f180 0x7f3ea411f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:32.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.943+0000 7f3ea3fff700 1 --2- 172.21.15.156:0/3081273103 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ea4131d70 0x7f3ea411fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:32.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.943+0000 7f3ea37fe700 1 --2- 172.21.15.156:0/3081273103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ea409e870 0x7f3ea411f100 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009bc0 tx=0x7f3e94004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:32.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.943+0000 7f3e8bfff700 1 -- 172.21.15.156:0/3081273103 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e94004450 con 0x7f3ea409e870 2023-09-30T22:21:32.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.943+0000 7f3e8bfff700 1 -- 172.21.15.156:0/3081273103 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9401e070 con 0x7f3ea409e870 2023-09-30T22:21:32.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.943+0000 7f3ea9adf700 1 -- 172.21.15.156:0/3081273103 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e940094a0 con 0x7f3ea409e870 2023-09-30T22:21:32.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.943+0000 7f3e8bfff700 1 -- 172.21.15.156:0/3081273103 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e940038e0 con 0x7f3ea409e870 2023-09-30T22:21:32.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.943+0000 7f3ea9adf700 1 -- 172.21.15.156:0/3081273103 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea4131830 con 0x7f3ea409e870 2023-09-30T22:21:32.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.944+0000 7f3e8bfff700 1 -- 172.21.15.156:0/3081273103 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3e94003a40 con 0x7f3ea409e870 2023-09-30T22:21:32.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.944+0000 7f3e8bfff700 1 -- 172.21.15.156:0/3081273103 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3e94040520 con 0x7f3ea409e870 2023-09-30T22:21:32.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.944+0000 7f3ea9adf700 1 -- 172.21.15.156:0/3081273103 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea411be60 con 0x7f3ea409e870 2023-09-30T22:21:32.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:32.950+0000 7f3e8bfff700 1 -- 172.21.15.156:0/3081273103 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3e94015030 con 0x7f3ea409e870 2023-09-30T22:21:32.990 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:33.028 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:33.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.117+0000 7f5f87346700 1 Processor -- start 2023-09-30T22:21:33.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.117+0000 7f5f87346700 1 -- start start 2023-09-30T22:21:33.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.117+0000 7f5f87346700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5f8009f350 0x7f5f80138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:33.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.117+0000 7f5f87346700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f801393a0 0x7f5f8013b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:33.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.117+0000 7f5f87346700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f8009fa00 con 0x7f5f8009e870 2023-09-30T22:21:33.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.117+0000 7f5f87346700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f800a0370 con 0x7f5f8009f350 2023-09-30T22:21:33.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.117+0000 7f5f87346700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8006bec0 con 0x7f5f801393a0 2023-09-30T22:21:33.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.118+0000 7f5f848e1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5f8009f350 0x7f5f80138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:33.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.118+0000 7f5f850e2700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f5f8009e870 0x7f5f8009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47604/0 (socket says 172.21.15.156:47604) 2023-09-30T22:21:33.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.118+0000 7f5f850e2700 1 -- 172.21.15.156:0/3812698957 learned_addr learned my addr 172.21.15.156:0/3812698957 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:33.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.118+0000 7f5f858e3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f801393a0 0x7f5f8013b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:33.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.118+0000 7f5f848e1700 1 -- 172.21.15.156:0/3812698957 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f801393a0 msgr2=0x7f5f8013b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:33.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.118+0000 7f5f848e1700 1 --2- 172.21.15.156:0/3812698957 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f801393a0 0x7f5f8013b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.118+0000 7f5f848e1700 1 -- 172.21.15.156:0/3812698957 >> v1:172.21.15.156:6789/0 conn(0x7f5f8009e870 legacy=0x7f5f8009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:33.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.118+0000 7f5f848e1700 1 -- 172.21.15.156:0/3812698957 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f8009ada0 con 0x7f5f8009f350 2023-09-30T22:21:33.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.118+0000 7f5f77fff700 1 -- 172.21.15.156:0/3812698957 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1940131748 0 0) 0x7f5f8009fa00 con 0x7f5f8009e870 2023-09-30T22:21:33.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.118+0000 7f5f858e3700 1 --2- 172.21.15.156:0/3812698957 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f801393a0 0x7f5f8013b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:33.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.118+0000 7f5f848e1700 1 --2- 172.21.15.156:0/3812698957 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f8009f350 0x7f5f80138e60 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009840 tx=0x7f5f70009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8737e29ab16bb0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:33.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.118+0000 7f5f77fff700 1 -- 172.21.15.156:0/3812698957 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f70011830 con 0x7f5f8009f350 2023-09-30T22:21:33.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.118+0000 7f5f77fff700 1 -- 172.21.15.156:0/3812698957 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f70011990 con 0x7f5f8009f350 2023-09-30T22:21:33.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.118+0000 7f5f77fff700 1 -- 172.21.15.156:0/3812698957 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f70011d20 con 0x7f5f8009f350 2023-09-30T22:21:33.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.119+0000 7f5f87346700 1 -- 172.21.15.156:0/3812698957 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f8009f350 msgr2=0x7f5f80138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:33.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.119+0000 7f5f87346700 1 --2- 172.21.15.156:0/3812698957 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f8009f350 0x7f5f80138e60 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009840 tx=0x7f5f70009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:33.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.119+0000 7f5f87346700 1 -- 172.21.15.156:0/3812698957 shutdown_connections 2023-09-30T22:21:33.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.119+0000 7f5f87346700 1 --2- 172.21.15.156:0/3812698957 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f801393a0 0x7f5f8013b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.119+0000 7f5f87346700 1 --2- 172.21.15.156:0/3812698957 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f8009f350 0x7f5f80138e60 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.119+0000 7f5f87346700 1 -- 172.21.15.156:0/3812698957 >> 172.21.15.156:0/3812698957 conn(0x7f5f800a4430 msgr2=0x7f5f800a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:33.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.119+0000 7f5f87346700 1 -- 172.21.15.156:0/3812698957 shutdown_connections 2023-09-30T22:21:33.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.119+0000 7f5f87346700 1 -- 172.21.15.156:0/3812698957 wait complete. 2023-09-30T22:21:33.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.120+0000 7f5f87346700 1 Processor -- start 2023-09-30T22:21:33.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.120+0000 7f5f87346700 1 -- start start 2023-09-30T22:21:33.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.120+0000 7f5f87346700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f8009e870 0x7f5f80120a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:33.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.120+0000 7f5f87346700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f8009f350 0x7f5f80120fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:33.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.120+0000 7f5f87346700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f801393a0 0x7f5f801214f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:33.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.120+0000 7f5f87346700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8006fcc0 con 0x7f5f8009e870 2023-09-30T22:21:33.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.120+0000 7f5f87346700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f80122590 con 0x7f5f8009f350 2023-09-30T22:21:33.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.120+0000 7f5f87346700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f80122d10 con 0x7f5f801393a0 2023-09-30T22:21:33.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.120+0000 7f5f848e1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f8009f350 0x7f5f80120fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:33.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.120+0000 7f5f848e1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f8009f350 0x7f5f80120fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:36916/0 (socket says 172.21.15.156:36916) 2023-09-30T22:21:33.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.121+0000 7f5f848e1700 1 -- 172.21.15.156:0/698880286 learned_addr learned my addr 172.21.15.156:0/698880286 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:33.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.121+0000 7f5f850e2700 1 --2- 172.21.15.156:0/698880286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f8009e870 0x7f5f80120a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:33.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.121+0000 7f5f858e3700 1 --2- 172.21.15.156:0/698880286 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f801393a0 0x7f5f801214f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:33.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.121+0000 7f5f850e2700 1 -- 172.21.15.156:0/698880286 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f801393a0 msgr2=0x7f5f801214f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:33.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.121+0000 7f5f850e2700 1 --2- 172.21.15.156:0/698880286 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f801393a0 0x7f5f801214f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.121+0000 7f5f850e2700 1 -- 172.21.15.156:0/698880286 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f8009f350 msgr2=0x7f5f80120fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:33.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.121+0000 7f5f850e2700 1 --2- 172.21.15.156:0/698880286 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f8009f350 0x7f5f80120fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.121+0000 7f5f850e2700 1 -- 172.21.15.156:0/698880286 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f78009a70 con 0x7f5f8009e870 2023-09-30T22:21:33.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.121+0000 7f5f848e1700 1 --2- 172.21.15.156:0/698880286 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f8009f350 0x7f5f80120fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:33.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.121+0000 7f5f850e2700 1 --2- 172.21.15.156:0/698880286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f8009e870 0x7f5f80120a70 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c00c3f0 tx=0x7f5f7c00c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:33.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.121+0000 7f5f75ffb700 1 -- 172.21.15.156:0/698880286 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c004a70 con 0x7f5f8009e870 2023-09-30T22:21:33.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.121+0000 7f5f87346700 1 -- 172.21.15.156:0/698880286 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f700094a0 con 0x7f5f8009e870 2023-09-30T22:21:33.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.121+0000 7f5f75ffb700 1 -- 172.21.15.156:0/698880286 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7c004bd0 con 0x7f5f8009e870 2023-09-30T22:21:33.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.121+0000 7f5f75ffb700 1 -- 172.21.15.156:0/698880286 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c0070d0 con 0x7f5f8009e870 2023-09-30T22:21:33.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.122+0000 7f5f87346700 1 -- 172.21.15.156:0/698880286 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f80124c00 con 0x7f5f8009e870 2023-09-30T22:21:33.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.122+0000 7f5f75ffb700 1 -- 172.21.15.156:0/698880286 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f7c007230 con 0x7f5f8009e870 2023-09-30T22:21:33.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.122+0000 7f5f75ffb700 1 -- 172.21.15.156:0/698880286 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5f7c03ef60 con 0x7f5f8009e870 2023-09-30T22:21:33.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.123+0000 7f5f87346700 1 -- 172.21.15.156:0/698880286 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8004f2a0 con 0x7f5f8009e870 2023-09-30T22:21:33.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.127+0000 7f5f75ffb700 1 -- 172.21.15.156:0/698880286 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f7c0010e0 con 0x7f5f8009e870 2023-09-30T22:21:33.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.150+0000 7f3ea9adf700 1 -- 172.21.15.156:0/3081273103 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3ea404f2a0 con 0x7f3ea409e870 2023-09-30T22:21:33.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.150+0000 7f3e8bfff700 1 -- 172.21.15.156:0/3081273103 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3e94003cf0 con 0x7f3ea409e870 2023-09-30T22:21:33.151 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:33.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.152+0000 7f3ea9adf700 1 -- 172.21.15.156:0/3081273103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ea409e870 msgr2=0x7f3ea411f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:33.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.152+0000 7f3ea9adf700 1 --2- 172.21.15.156:0/3081273103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ea409e870 0x7f3ea411f100 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009bc0 tx=0x7f3e94004750 comp rx=0 tx=0).stop 2023-09-30T22:21:33.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.152+0000 7f3ea9adf700 1 -- 172.21.15.156:0/3081273103 shutdown_connections 2023-09-30T22:21:33.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.152+0000 7f3ea9adf700 1 --2- 172.21.15.156:0/3081273103 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ea4131d70 0x7f3ea411fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.152+0000 7f3ea9adf700 1 --2- 172.21.15.156:0/3081273103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ea409e870 0x7f3ea411f100 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.152+0000 7f3ea9adf700 1 --2- 172.21.15.156:0/3081273103 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ea409f180 0x7f3ea411f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.152+0000 7f3ea9adf700 1 -- 172.21.15.156:0/3081273103 >> 172.21.15.156:0/3081273103 conn(0x7f3ea40a4430 msgr2=0x7f3ea4131110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:33.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.153+0000 7f3ea9adf700 1 -- 172.21.15.156:0/3081273103 shutdown_connections 2023-09-30T22:21:33.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.153+0000 7f3ea9adf700 1 -- 172.21.15.156:0/3081273103 wait complete. 2023-09-30T22:21:33.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.161+0000 7fc7511e2700 1 Processor -- start 2023-09-30T22:21:33.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.161+0000 7fc7511e2700 1 -- start start 2023-09-30T22:21:33.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.162+0000 7fc7511e2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc74c09ad40 0x7fc74c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:33.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.162+0000 7fc7511e2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc74c133f70 0x7fc74c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:33.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.162+0000 7fc7511e2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc74c0a0a70 0x7fc74c0a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:33.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.162+0000 7fc7511e2700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74c0a3b60 con 0x7fc74c133f70 2023-09-30T22:21:33.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.162+0000 7fc7511e2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c1348e0 con 0x7fc74c0a0a70 2023-09-30T22:21:33.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.162+0000 7fc7511e2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c09b110 con 0x7fc74c09ad40 2023-09-30T22:21:33.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.162+0000 7fc74ad9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc74c09ad40 0x7fc74c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:33.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.162+0000 7fc74a59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc74c133f70 0x7fc74c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:33.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.162+0000 7fc74ad9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc74c09ad40 0x7fc74c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36166/0 (socket says 172.21.15.156:36166) 2023-09-30T22:21:33.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.162+0000 7fc74ad9d700 1 -- 172.21.15.156:0/711975837 learned_addr learned my addr 172.21.15.156:0/711975837 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:33.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.162+0000 7fc74b59e700 1 --2- 172.21.15.156:0/711975837 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc74c0a0a70 0x7fc74c0a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:33.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.162+0000 7fc74a59c700 1 -- 172.21.15.156:0/711975837 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc74c09ad40 msgr2=0x7fc74c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:33.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.162+0000 7fc74a59c700 1 --2- 172.21.15.156:0/711975837 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc74c09ad40 0x7fc74c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.162+0000 7fc74a59c700 1 -- 172.21.15.156:0/711975837 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc74c0a0a70 msgr2=0x7fc74c0a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:33.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.162+0000 7fc74a59c700 1 --2- 172.21.15.156:0/711975837 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc74c0a0a70 0x7fc74c0a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.162+0000 7fc74a59c700 1 -- 172.21.15.156:0/711975837 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74c0a2fa0 con 0x7fc74c133f70 2023-09-30T22:21:33.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.162+0000 7fc74ad9d700 1 --2- 172.21.15.156:0/711975837 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc74c09ad40 0x7fc74c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:33.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.163+0000 7fc74a59c700 1 --2- 172.21.15.156:0/711975837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc74c133f70 0x7fc74c1343a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fc740009870 tx=0x7fc740009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451cd5ecbbcf295a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:33.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.163+0000 7fc749d9b700 1 -- 172.21.15.156:0/711975837 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc740011830 con 0x7fc74c133f70 2023-09-30T22:21:33.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.163+0000 7fc749d9b700 1 -- 172.21.15.156:0/711975837 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc740011990 con 0x7fc74c133f70 2023-09-30T22:21:33.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.163+0000 7fc749d9b700 1 -- 172.21.15.156:0/711975837 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc740011d20 con 0x7fc74c133f70 2023-09-30T22:21:33.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.163+0000 7fc7511e2700 1 -- 172.21.15.156:0/711975837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc74c133f70 msgr2=0x7fc74c1343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:33.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.163+0000 7fc7511e2700 1 --2- 172.21.15.156:0/711975837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc74c133f70 0x7fc74c1343a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fc740009870 tx=0x7fc740009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:33.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.163+0000 7fc7511e2700 1 -- 172.21.15.156:0/711975837 shutdown_connections 2023-09-30T22:21:33.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.163+0000 7fc7511e2700 1 --2- 172.21.15.156:0/711975837 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc74c0a0a70 0x7fc74c0a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.163+0000 7fc7511e2700 1 --2- 172.21.15.156:0/711975837 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc74c09ad40 0x7fc74c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.163+0000 7fc7511e2700 1 --2- 172.21.15.156:0/711975837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc74c133f70 0x7fc74c1343a0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.164+0000 7fc7511e2700 1 -- 172.21.15.156:0/711975837 >> 172.21.15.156:0/711975837 conn(0x7fc74c099c40 msgr2=0x7fc74c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:33.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.164+0000 7fc7511e2700 1 -- 172.21.15.156:0/711975837 shutdown_connections 2023-09-30T22:21:33.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.164+0000 7fc7511e2700 1 -- 172.21.15.156:0/711975837 wait complete. 2023-09-30T22:21:33.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.165+0000 7fc7511e2700 1 Processor -- start 2023-09-30T22:21:33.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.165+0000 7fc7511e2700 1 -- start start 2023-09-30T22:21:33.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:33.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.166+0000 7fc7511e2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc74c09ad40 0x7fc74c121410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:33.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.166+0000 7fc7511e2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc74c0a0a70 0x7fc74c121950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:33.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.166+0000 7fc7511e2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc74c133f70 0x7fc74c121e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:33.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.166+0000 7fc7511e2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c124c10 con 0x7fc74c09ad40 2023-09-30T22:21:33.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.166+0000 7fc7511e2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c122f40 con 0x7fc74c133f70 2023-09-30T22:21:33.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.166+0000 7fc7511e2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c123dd0 con 0x7fc74c0a0a70 2023-09-30T22:21:33.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.166+0000 7fc74a59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc74c0a0a70 0x7fc74c121950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:33.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.166+0000 7fc74ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc74c09ad40 0x7fc74c121410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:33.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.166+0000 7fc74ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc74c09ad40 0x7fc74c121410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50186/0 (socket says 172.21.15.156:50186) 2023-09-30T22:21:33.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.166+0000 7fc74a59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc74c0a0a70 0x7fc74c121950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36180/0 (socket says 172.21.15.156:36180) 2023-09-30T22:21:33.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.166+0000 7fc74ad9d700 1 -- 172.21.15.156:0/2433075254 learned_addr learned my addr 172.21.15.156:0/2433075254 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:33.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.166+0000 7fc74b59e700 1 --2- 172.21.15.156:0/2433075254 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc74c133f70 0x7fc74c121e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:33.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.166+0000 7fc74a59c700 1 -- 172.21.15.156:0/2433075254 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc74c133f70 msgr2=0x7fc74c121e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:33.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.166+0000 7fc74a59c700 1 --2- 172.21.15.156:0/2433075254 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc74c133f70 0x7fc74c121e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.166+0000 7fc74a59c700 1 -- 172.21.15.156:0/2433075254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc74c09ad40 msgr2=0x7fc74c121410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:33.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.166+0000 7fc74a59c700 1 --2- 172.21.15.156:0/2433075254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc74c09ad40 0x7fc74c121410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.166+0000 7fc74a59c700 1 -- 172.21.15.156:0/2433075254 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc73c009550 con 0x7fc74c0a0a70 2023-09-30T22:21:33.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.166+0000 7fc74ad9d700 1 --2- 172.21.15.156:0/2433075254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc74c09ad40 0x7fc74c121410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:33.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.166+0000 7fc74a59c700 1 --2- 172.21.15.156:0/2433075254 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc74c0a0a70 0x7fc74c121950 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc740016000 tx=0x7fc740004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:33.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.167+0000 7fc7337fe700 1 -- 172.21.15.156:0/2433075254 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc740004510 con 0x7fc74c0a0a70 2023-09-30T22:21:33.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.167+0000 7fc7337fe700 1 -- 172.21.15.156:0/2433075254 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74001f070 con 0x7fc74c0a0a70 2023-09-30T22:21:33.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.167+0000 7fc7337fe700 1 -- 172.21.15.156:0/2433075254 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7400038e0 con 0x7fc74c0a0a70 2023-09-30T22:21:33.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.167+0000 7fc7511e2700 1 -- 172.21.15.156:0/2433075254 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7400094a0 con 0x7fc74c0a0a70 2023-09-30T22:21:33.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.167+0000 7fc7511e2700 1 -- 172.21.15.156:0/2433075254 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc74c09c7e0 con 0x7fc74c0a0a70 2023-09-30T22:21:33.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.168+0000 7fc7337fe700 1 -- 172.21.15.156:0/2433075254 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc740003a40 con 0x7fc74c0a0a70 2023-09-30T22:21:33.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.168+0000 7fc7511e2700 1 -- 172.21.15.156:0/2433075254 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc74c124190 con 0x7fc74c0a0a70 2023-09-30T22:21:33.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.168+0000 7fc7337fe700 1 -- 172.21.15.156:0/2433075254 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc740021070 con 0x7fc74c0a0a70 2023-09-30T22:21:33.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.173+0000 7fc7337fe700 1 -- 172.21.15.156:0/2433075254 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc740026480 con 0x7fc74c0a0a70 2023-09-30T22:21:33.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.324+0000 7f5f87346700 1 -- 172.21.15.156:0/698880286 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5f80072d60 con 0x7f5f8009e870 2023-09-30T22:21:33.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.324+0000 7f5f75ffb700 1 -- 172.21.15.156:0/698880286 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f7c011b50 con 0x7f5f8009e870 2023-09-30T22:21:33.325 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:33.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.326+0000 7f5f87346700 1 -- 172.21.15.156:0/698880286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f8009e870 msgr2=0x7f5f80120a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:33.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.326+0000 7f5f87346700 1 --2- 172.21.15.156:0/698880286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f8009e870 0x7f5f80120a70 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c00c3f0 tx=0x7f5f7c00c700 comp rx=0 tx=0).stop 2023-09-30T22:21:33.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.326+0000 7f5f87346700 1 -- 172.21.15.156:0/698880286 shutdown_connections 2023-09-30T22:21:33.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.326+0000 7f5f87346700 1 --2- 172.21.15.156:0/698880286 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f801393a0 0x7f5f801214f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.326+0000 7f5f87346700 1 --2- 172.21.15.156:0/698880286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f8009e870 0x7f5f80120a70 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.326+0000 7f5f87346700 1 --2- 172.21.15.156:0/698880286 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f8009f350 0x7f5f80120fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.326+0000 7f5f87346700 1 -- 172.21.15.156:0/698880286 >> 172.21.15.156:0/698880286 conn(0x7f5f800a4430 msgr2=0x7f5f80071030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:33.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.326+0000 7f5f87346700 1 -- 172.21.15.156:0/698880286 shutdown_connections 2023-09-30T22:21:33.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.326+0000 7f5f87346700 1 -- 172.21.15.156:0/698880286 wait complete. 2023-09-30T22:21:33.339 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:33.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.367+0000 7fc7511e2700 1 -- 172.21.15.156:0/2433075254 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc74c11e060 con 0x7fc74c0a0a70 2023-09-30T22:21:33.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.368+0000 7fc7337fe700 1 -- 172.21.15.156:0/2433075254 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc74002b070 con 0x7fc74c0a0a70 2023-09-30T22:21:33.368 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:33.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.370+0000 7fc7511e2700 1 -- 172.21.15.156:0/2433075254 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc74c0a0a70 msgr2=0x7fc74c121950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:33.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.370+0000 7fc7511e2700 1 --2- 172.21.15.156:0/2433075254 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc74c0a0a70 0x7fc74c121950 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc740016000 tx=0x7fc740004750 comp rx=0 tx=0).stop 2023-09-30T22:21:33.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.370+0000 7fc7511e2700 1 -- 172.21.15.156:0/2433075254 shutdown_connections 2023-09-30T22:21:33.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.370+0000 7fc7511e2700 1 --2- 172.21.15.156:0/2433075254 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc74c133f70 0x7fc74c121e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.370+0000 7fc7511e2700 1 --2- 172.21.15.156:0/2433075254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc74c09ad40 0x7fc74c121410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.370+0000 7fc7511e2700 1 --2- 172.21.15.156:0/2433075254 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc74c0a0a70 0x7fc74c121950 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.370+0000 7fc7511e2700 1 -- 172.21.15.156:0/2433075254 >> 172.21.15.156:0/2433075254 conn(0x7fc74c099c40 msgr2=0x7fc74c1332a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:33.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.370+0000 7fc7511e2700 1 -- 172.21.15.156:0/2433075254 shutdown_connections 2023-09-30T22:21:33.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.370+0000 7fc7511e2700 1 -- 172.21.15.156:0/2433075254 wait complete. 2023-09-30T22:21:33.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:33.537 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:33.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.661+0000 7f38f06f1700 1 Processor -- start 2023-09-30T22:21:33.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.661+0000 7f38f06f1700 1 -- start start 2023-09-30T22:21:33.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.661+0000 7f38f06f1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f38e809d860 0x7f38e809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:33.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.661+0000 7f38f06f1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38e809e170 0x7f38e81307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:33.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.661+0000 7f38f06f1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38e8130ce0 0x7f38e8131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:33.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.661+0000 7f38f06f1700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38e8131670 con 0x7f38e809d860 2023-09-30T22:21:33.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.661+0000 7f38f06f1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e809aaa0 con 0x7f38e8130ce0 2023-09-30T22:21:33.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.661+0000 7f38f06f1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38e809f870 con 0x7f38e809e170 2023-09-30T22:21:33.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.661+0000 7f38ee48d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f38e809d860 0x7f38e809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:33.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.661+0000 7f38edc8c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38e809e170 0x7f38e81307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:33.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.661+0000 7f38eec8e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38e8130ce0 0x7f38e8131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:33.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.661+0000 7f38ee48d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f38e809d860 0x7f38e809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50194/0 (socket says 172.21.15.156:50194) 2023-09-30T22:21:33.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.661+0000 7f38ee48d700 1 -- 172.21.15.156:0/1883756505 learned_addr learned my addr 172.21.15.156:0/1883756505 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:33.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.661+0000 7f38edc8c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38e809e170 0x7f38e81307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36192/0 (socket says 172.21.15.156:36192) 2023-09-30T22:21:33.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.661+0000 7f38eec8e700 1 --2- 172.21.15.156:0/1883756505 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38e8130ce0 0x7f38e8131130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:36950/0 (socket says 172.21.15.156:36950) 2023-09-30T22:21:33.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.662+0000 7f38ee48d700 1 -- 172.21.15.156:0/1883756505 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38e809e170 msgr2=0x7f38e81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:33.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.662+0000 7f38ee48d700 1 --2- 172.21.15.156:0/1883756505 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38e809e170 0x7f38e81307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.662+0000 7f38ee48d700 1 -- 172.21.15.156:0/1883756505 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38e8130ce0 msgr2=0x7f38e8131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:33.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.662+0000 7f38ee48d700 1 --2- 172.21.15.156:0/1883756505 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38e8130ce0 0x7f38e8131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.662+0000 7f38ee48d700 1 -- 172.21.15.156:0/1883756505 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e809b360 con 0x7f38e809d860 2023-09-30T22:21:33.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.662+0000 7f38eec8e700 1 --2- 172.21.15.156:0/1883756505 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38e8130ce0 0x7f38e8131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:33.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.662+0000 7f38ee48d700 1 --2- 172.21.15.156:0/1883756505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38e809d860 0x7f38e809dc30 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f38d8009920 tx=0x7f38d8009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea26846164faff6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:33.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.662+0000 7f38ed48b700 1 -- 172.21.15.156:0/1883756505 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d800f8a0 con 0x7f38e809d860 2023-09-30T22:21:33.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.662+0000 7f38ed48b700 1 -- 172.21.15.156:0/1883756505 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d800fa00 con 0x7f38e809d860 2023-09-30T22:21:33.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.662+0000 7f38ed48b700 1 -- 172.21.15.156:0/1883756505 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d800fd90 con 0x7f38e809d860 2023-09-30T22:21:33.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.662+0000 7f38f06f1700 1 -- 172.21.15.156:0/1883756505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38e809d860 msgr2=0x7f38e809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:33.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.662+0000 7f38f06f1700 1 --2- 172.21.15.156:0/1883756505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38e809d860 0x7f38e809dc30 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f38d8009920 tx=0x7f38d8009c30 comp rx=0 tx=0).stop 2023-09-30T22:21:33.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.663+0000 7f38f06f1700 1 -- 172.21.15.156:0/1883756505 shutdown_connections 2023-09-30T22:21:33.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.663+0000 7f38f06f1700 1 --2- 172.21.15.156:0/1883756505 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38e8130ce0 0x7f38e8131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.663+0000 7f38f06f1700 1 --2- 172.21.15.156:0/1883756505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38e809d860 0x7f38e809dc30 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.663+0000 7f38f06f1700 1 --2- 172.21.15.156:0/1883756505 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38e809e170 0x7f38e81307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.663+0000 7f38f06f1700 1 -- 172.21.15.156:0/1883756505 >> 172.21.15.156:0/1883756505 conn(0x7f38e8099c40 msgr2=0x7f38e80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:33.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.663+0000 7f38f06f1700 1 -- 172.21.15.156:0/1883756505 shutdown_connections 2023-09-30T22:21:33.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.663+0000 7f38f06f1700 1 -- 172.21.15.156:0/1883756505 wait complete. 2023-09-30T22:21:33.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.663+0000 7f38f06f1700 1 Processor -- start 2023-09-30T22:21:33.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.664+0000 7f38f06f1700 1 -- start start 2023-09-30T22:21:33.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.664+0000 7f38f06f1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38e809d860 0x7f38e81212f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:33.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.664+0000 7f38f06f1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38e809e170 0x7f38e8121830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:33.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.664+0000 7f38f06f1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38e8130ce0 0x7f38e8121d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:33.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.664+0000 7f38f06f1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e8071a10 con 0x7f38e809e170 2023-09-30T22:21:33.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.664+0000 7f38f06f1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e809c8b0 con 0x7f38e8130ce0 2023-09-30T22:21:33.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.664+0000 7f38f06f1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38e81245a0 con 0x7f38e809d860 2023-09-30T22:21:33.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.664+0000 7f38ee48d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38e809d860 0x7f38e81212f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:33.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.664+0000 7f38edc8c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38e809e170 0x7f38e8121830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:33.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.664+0000 7f38ee48d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38e809d860 0x7f38e81212f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36206/0 (socket says 172.21.15.156:36206) 2023-09-30T22:21:33.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.664+0000 7f38ee48d700 1 -- 172.21.15.156:0/2928915993 learned_addr learned my addr 172.21.15.156:0/2928915993 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:33.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.664+0000 7f38eec8e700 1 --2- 172.21.15.156:0/2928915993 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38e8130ce0 0x7f38e8121d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:33.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.664+0000 7f38ee48d700 1 -- 172.21.15.156:0/2928915993 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38e8130ce0 msgr2=0x7f38e8121d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:33.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.664+0000 7f38ee48d700 1 --2- 172.21.15.156:0/2928915993 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38e8130ce0 0x7f38e8121d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.664+0000 7f38ee48d700 1 -- 172.21.15.156:0/2928915993 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38e809e170 msgr2=0x7f38e8121830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:33.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.664+0000 7f38ee48d700 1 --2- 172.21.15.156:0/2928915993 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38e809e170 0x7f38e8121830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.664+0000 7f38ee48d700 1 -- 172.21.15.156:0/2928915993 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e0009a70 con 0x7f38e809d860 2023-09-30T22:21:33.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.664+0000 7f38edc8c700 1 --2- 172.21.15.156:0/2928915993 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38e809e170 0x7f38e8121830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:33.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.664+0000 7f38eec8e700 1 --2- 172.21.15.156:0/2928915993 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38e8130ce0 0x7f38e8121d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:33.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.664+0000 7f38ee48d700 1 --2- 172.21.15.156:0/2928915993 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38e809d860 0x7f38e81212f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f38d8000c00 tx=0x7f38d8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:33.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.665+0000 7f38deffd700 1 -- 172.21.15.156:0/2928915993 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d80038a0 con 0x7f38e809d860 2023-09-30T22:21:33.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.665+0000 7f38deffd700 1 -- 172.21.15.156:0/2928915993 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d8003a00 con 0x7f38e809d860 2023-09-30T22:21:33.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.665+0000 7f38f06f1700 1 -- 172.21.15.156:0/2928915993 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d8009550 con 0x7f38e809d860 2023-09-30T22:21:33.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.665+0000 7f38deffd700 1 -- 172.21.15.156:0/2928915993 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d8003db0 con 0x7f38e809d860 2023-09-30T22:21:33.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.665+0000 7f38f06f1700 1 -- 172.21.15.156:0/2928915993 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38e81236b0 con 0x7f38e809d860 2023-09-30T22:21:33.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.665+0000 7f38deffd700 1 -- 172.21.15.156:0/2928915993 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f38d8019400 con 0x7f38e809d860 2023-09-30T22:21:33.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.666+0000 7f38deffd700 1 -- 172.21.15.156:0/2928915993 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f38d80401f0 con 0x7f38e809d860 2023-09-30T22:21:33.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.666+0000 7f38f06f1700 1 -- 172.21.15.156:0/2928915993 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38e804f2a0 con 0x7f38e809d860 2023-09-30T22:21:33.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.670+0000 7f38deffd700 1 -- 172.21.15.156:0/2928915993 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f38d8026080 con 0x7f38e809d860 2023-09-30T22:21:33.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.855+0000 7f38f06f1700 1 -- 172.21.15.156:0/2928915993 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f38e806c3b0 con 0x7f38e809d860 2023-09-30T22:21:33.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.855+0000 7f38deffd700 1 -- 172.21.15.156:0/2928915993 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f38d802a3f0 con 0x7f38e809d860 2023-09-30T22:21:33.855 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:33.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.857+0000 7f38f06f1700 1 -- 172.21.15.156:0/2928915993 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38e809d860 msgr2=0x7f38e81212f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:33.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.857+0000 7f38f06f1700 1 --2- 172.21.15.156:0/2928915993 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38e809d860 0x7f38e81212f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f38d8000c00 tx=0x7f38d8004750 comp rx=0 tx=0).stop 2023-09-30T22:21:33.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.857+0000 7f38f06f1700 1 -- 172.21.15.156:0/2928915993 shutdown_connections 2023-09-30T22:21:33.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.857+0000 7f38f06f1700 1 --2- 172.21.15.156:0/2928915993 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38e8130ce0 0x7f38e8121d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.857+0000 7f38f06f1700 1 --2- 172.21.15.156:0/2928915993 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38e809d860 0x7f38e81212f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.857+0000 7f38f06f1700 1 --2- 172.21.15.156:0/2928915993 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38e809e170 0x7f38e8121830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:33.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.857+0000 7f38f06f1700 1 -- 172.21.15.156:0/2928915993 >> 172.21.15.156:0/2928915993 conn(0x7f38e8099c40 msgr2=0x7f38e812fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:33.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.857+0000 7f38f06f1700 1 -- 172.21.15.156:0/2928915993 shutdown_connections 2023-09-30T22:21:33.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:33.857+0000 7f38f06f1700 1 -- 172.21.15.156:0/2928915993 wait complete. 2023-09-30T22:21:33.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:34.169 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:34.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.293+0000 7f4c63e19700 1 Processor -- start 2023-09-30T22:21:34.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.293+0000 7f4c63e19700 1 -- start start 2023-09-30T22:21:34.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.293+0000 7f4c63e19700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4c5c09e870 0x7f4c5c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:34.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.293+0000 7f4c63e19700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c5c09f180 0x7f4c5c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:34.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.293+0000 7f4c63e19700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4c5c131d70 0x7f4c5c132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:34.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.293+0000 7f4c63e19700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c5c0a0920 con 0x7f4c5c131d70 2023-09-30T22:21:34.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.293+0000 7f4c63e19700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c09c970 con 0x7f4c5c09f180 2023-09-30T22:21:34.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.293+0000 7f4c63e19700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c09bab0 con 0x7f4c5c09e870 2023-09-30T22:21:34.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.293+0000 7f4c613b4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c5c09f180 0x7f4c5c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:34.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.293+0000 7f4c623b6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4c5c131d70 0x7f4c5c132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:34.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.293+0000 7f4c61bb5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4c5c09e870 0x7f4c5c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:34.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.293+0000 7f4c613b4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c5c09f180 0x7f4c5c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:36958/0 (socket says 172.21.15.156:36958) 2023-09-30T22:21:34.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.294+0000 7f4c623b6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4c5c131d70 0x7f4c5c132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50220/0 (socket says 172.21.15.156:50220) 2023-09-30T22:21:34.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.294+0000 7f4c613b4700 1 -- 172.21.15.156:0/3559023955 learned_addr learned my addr 172.21.15.156:0/3559023955 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:34.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.294+0000 7f4c613b4700 1 -- 172.21.15.156:0/3559023955 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4c5c09e870 msgr2=0x7f4c5c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:34.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.294+0000 7f4c613b4700 1 --2- 172.21.15.156:0/3559023955 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4c5c09e870 0x7f4c5c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.294+0000 7f4c613b4700 1 -- 172.21.15.156:0/3559023955 >> v2:172.21.15.156:3300/0 conn(0x7f4c5c131d70 msgr2=0x7f4c5c132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:34.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.294+0000 7f4c613b4700 1 --2- 172.21.15.156:0/3559023955 >> v2:172.21.15.156:3300/0 conn(0x7f4c5c131d70 0x7f4c5c132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.294+0000 7f4c613b4700 1 -- 172.21.15.156:0/3559023955 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5c09f9c0 con 0x7f4c5c09f180 2023-09-30T22:21:34.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.294+0000 7f4c61bb5700 1 --2- 172.21.15.156:0/3559023955 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4c5c09e870 0x7f4c5c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:34.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.294+0000 7f4c623b6700 1 --2- 172.21.15.156:0/3559023955 >> v2:172.21.15.156:3300/0 conn(0x7f4c5c131d70 0x7f4c5c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:34.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.294+0000 7f4c613b4700 1 --2- 172.21.15.156:0/3559023955 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c5c09f180 0x7f4c5c131830 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0098f0 tx=0x7f4c4c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ad35779c6dbc8f8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:34.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.294+0000 7f4c60bb3700 1 -- 172.21.15.156:0/3559023955 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c011830 con 0x7f4c5c09f180 2023-09-30T22:21:34.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.294+0000 7f4c60bb3700 1 -- 172.21.15.156:0/3559023955 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4c011990 con 0x7f4c5c09f180 2023-09-30T22:21:34.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.294+0000 7f4c60bb3700 1 -- 172.21.15.156:0/3559023955 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c011d20 con 0x7f4c5c09f180 2023-09-30T22:21:34.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.295+0000 7f4c63e19700 1 -- 172.21.15.156:0/3559023955 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c5c09f180 msgr2=0x7f4c5c131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:34.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.295+0000 7f4c63e19700 1 --2- 172.21.15.156:0/3559023955 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c5c09f180 0x7f4c5c131830 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0098f0 tx=0x7f4c4c009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:34.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.295+0000 7f4c63e19700 1 -- 172.21.15.156:0/3559023955 shutdown_connections 2023-09-30T22:21:34.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.295+0000 7f4c63e19700 1 --2- 172.21.15.156:0/3559023955 >> v2:172.21.15.156:3300/0 conn(0x7f4c5c131d70 0x7f4c5c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.295+0000 7f4c63e19700 1 --2- 172.21.15.156:0/3559023955 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4c5c09e870 0x7f4c5c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.295+0000 7f4c63e19700 1 --2- 172.21.15.156:0/3559023955 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c5c09f180 0x7f4c5c131830 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.295+0000 7f4c63e19700 1 -- 172.21.15.156:0/3559023955 >> 172.21.15.156:0/3559023955 conn(0x7f4c5c0a4430 msgr2=0x7f4c5c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:34.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.295+0000 7f4c63e19700 1 -- 172.21.15.156:0/3559023955 shutdown_connections 2023-09-30T22:21:34.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.295+0000 7f4c63e19700 1 -- 172.21.15.156:0/3559023955 wait complete. 2023-09-30T22:21:34.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.296+0000 7f4c63e19700 1 Processor -- start 2023-09-30T22:21:34.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.296+0000 7f4c63e19700 1 -- start start 2023-09-30T22:21:34.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.297+0000 7f4c63e19700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4c5c09e870 0x7f4c5c11c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:34.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.297+0000 7f4c63e19700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c5c09f180 0x7f4c5c11c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:34.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.297+0000 7f4c63e19700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c5c131d70 0x7f4c5c11cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:34.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.297+0000 7f4c63e19700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c11f900 con 0x7f4c5c131d70 2023-09-30T22:21:34.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.297+0000 7f4c63e19700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c11dc20 con 0x7f4c5c09f180 2023-09-30T22:21:34.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.297+0000 7f4c63e19700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c11fb00 con 0x7f4c5c09e870 2023-09-30T22:21:34.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.297+0000 7f4c623b6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c5c131d70 0x7f4c5c11cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:34.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.297+0000 7f4c613b4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c5c09f180 0x7f4c5c11c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:34.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.297+0000 7f4c623b6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c5c131d70 0x7f4c5c11cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50228/0 (socket says 172.21.15.156:50228) 2023-09-30T22:21:34.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.297+0000 7f4c613b4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c5c09f180 0x7f4c5c11c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:36970/0 (socket says 172.21.15.156:36970) 2023-09-30T22:21:34.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.297+0000 7f4c623b6700 1 -- 172.21.15.156:0/322879694 learned_addr learned my addr 172.21.15.156:0/322879694 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:34.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.297+0000 7f4c61bb5700 1 --2- 172.21.15.156:0/322879694 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4c5c09e870 0x7f4c5c11c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:34.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.297+0000 7f4c623b6700 1 -- 172.21.15.156:0/322879694 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4c5c09e870 msgr2=0x7f4c5c11c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:34.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.297+0000 7f4c623b6700 1 --2- 172.21.15.156:0/322879694 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4c5c09e870 0x7f4c5c11c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.297+0000 7f4c623b6700 1 -- 172.21.15.156:0/322879694 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c5c09f180 msgr2=0x7f4c5c11c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:34.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.297+0000 7f4c623b6700 1 --2- 172.21.15.156:0/322879694 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c5c09f180 0x7f4c5c11c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.297+0000 7f4c623b6700 1 -- 172.21.15.156:0/322879694 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c580094a0 con 0x7f4c5c131d70 2023-09-30T22:21:34.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.297+0000 7f4c613b4700 1 --2- 172.21.15.156:0/322879694 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c5c09f180 0x7f4c5c11c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:34.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.297+0000 7f4c623b6700 1 --2- 172.21.15.156:0/322879694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c5c131d70 0x7f4c5c11cae0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f4c5400f500 tx=0x7f4c5400f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:34.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.297+0000 7f4c527fc700 1 -- 172.21.15.156:0/322879694 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c54012050 con 0x7f4c5c131d70 2023-09-30T22:21:34.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.297+0000 7f4c527fc700 1 -- 172.21.15.156:0/322879694 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c54013040 con 0x7f4c5c131d70 2023-09-30T22:21:34.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.297+0000 7f4c527fc700 1 -- 172.21.15.156:0/322879694 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c54003e60 con 0x7f4c5c131d70 2023-09-30T22:21:34.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.297+0000 7f4c63e19700 1 -- 172.21.15.156:0/322879694 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c5400f050 con 0x7f4c5c131d70 2023-09-30T22:21:34.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.297+0000 7f4c63e19700 1 -- 172.21.15.156:0/322879694 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c4c009550 con 0x7f4c5c131d70 2023-09-30T22:21:34.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.298+0000 7f4c527fc700 1 -- 172.21.15.156:0/322879694 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4c54004030 con 0x7f4c5c131d70 2023-09-30T22:21:34.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.298+0000 7f4c527fc700 1 -- 172.21.15.156:0/322879694 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4c540440f0 con 0x7f4c5c131d70 2023-09-30T22:21:34.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.298+0000 7f4c63e19700 1 -- 172.21.15.156:0/322879694 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c5c12f740 con 0x7f4c5c131d70 2023-09-30T22:21:34.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.303+0000 7f4c527fc700 1 -- 172.21.15.156:0/322879694 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4c54021720 con 0x7f4c5c131d70 2023-09-30T22:21:34.340 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:34.384 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:34.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.469+0000 7fe033bb0700 1 Processor -- start 2023-09-30T22:21:34.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.469+0000 7fe033bb0700 1 -- start start 2023-09-30T22:21:34.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.469+0000 7fe033bb0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe02c0a1550 0x7fe02c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:34.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.469+0000 7fe033bb0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe02c139200 0x7fe02c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:34.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.469+0000 7fe033bb0700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe02c09e9d0 con 0x7fe02c0a0a70 2023-09-30T22:21:34.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.469+0000 7fe033bb0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c09dc00 con 0x7fe02c0a1550 2023-09-30T22:21:34.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.469+0000 7fe033bb0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c09dec0 con 0x7fe02c139200 2023-09-30T22:21:34.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.470+0000 7fe03194c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe02c0a0a70 0x7fe02c0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47620/0 (socket says 172.21.15.156:47620) 2023-09-30T22:21:34.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.470+0000 7fe03194c700 1 -- 172.21.15.156:0/1579812676 learned_addr learned my addr 172.21.15.156:0/1579812676 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:34.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.470+0000 7fe03214d700 1 --2- 172.21.15.156:0/1579812676 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe02c139200 0x7fe02c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:34.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.470+0000 7fe03114b700 1 --2- 172.21.15.156:0/1579812676 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe02c0a1550 0x7fe02c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:34.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.470+0000 7fe03094a700 1 -- 172.21.15.156:0/1579812676 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1864931422 0 0) 0x7fe02c09e9d0 con 0x7fe02c0a0a70 2023-09-30T22:21:34.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.470+0000 7fe03094a700 1 -- 172.21.15.156:0/1579812676 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0180035b0 con 0x7fe02c0a0a70 2023-09-30T22:21:34.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.470+0000 7fe03114b700 1 -- 172.21.15.156:0/1579812676 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe02c139200 msgr2=0x7fe02c13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:34.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.470+0000 7fe03114b700 1 --2- 172.21.15.156:0/1579812676 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe02c139200 0x7fe02c13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.470+0000 7fe03114b700 1 -- 172.21.15.156:0/1579812676 >> v1:172.21.15.156:6789/0 conn(0x7fe02c0a0a70 legacy=0x7fe02c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:34.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.470+0000 7fe03114b700 1 -- 172.21.15.156:0/1579812676 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02c09e6a0 con 0x7fe02c0a1550 2023-09-30T22:21:34.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.470+0000 7fe03114b700 1 --2- 172.21.15.156:0/1579812676 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe02c0a1550 0x7fe02c138cc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe01c009870 tx=0x7fe01c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=780946a8f1d8ab39 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:34.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.470+0000 7fe03094a700 1 -- 172.21.15.156:0/1579812676 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c011830 con 0x7fe02c0a1550 2023-09-30T22:21:34.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.470+0000 7fe03094a700 1 -- 172.21.15.156:0/1579812676 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01c011990 con 0x7fe02c0a1550 2023-09-30T22:21:34.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.470+0000 7fe03094a700 1 -- 172.21.15.156:0/1579812676 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c011d20 con 0x7fe02c0a1550 2023-09-30T22:21:34.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.471+0000 7fe033bb0700 1 -- 172.21.15.156:0/1579812676 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe02c0a1550 msgr2=0x7fe02c138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:34.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.471+0000 7fe033bb0700 1 --2- 172.21.15.156:0/1579812676 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe02c0a1550 0x7fe02c138cc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe01c009870 tx=0x7fe01c009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:34.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.471+0000 7fe033bb0700 1 -- 172.21.15.156:0/1579812676 shutdown_connections 2023-09-30T22:21:34.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.471+0000 7fe033bb0700 1 --2- 172.21.15.156:0/1579812676 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe02c139200 0x7fe02c13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.471+0000 7fe033bb0700 1 --2- 172.21.15.156:0/1579812676 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe02c0a1550 0x7fe02c138cc0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.471+0000 7fe033bb0700 1 -- 172.21.15.156:0/1579812676 >> 172.21.15.156:0/1579812676 conn(0x7fe02c0a6610 msgr2=0x7fe02c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:34.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.471+0000 7fe033bb0700 1 -- 172.21.15.156:0/1579812676 shutdown_connections 2023-09-30T22:21:34.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.471+0000 7fe033bb0700 1 -- 172.21.15.156:0/1579812676 wait complete. 2023-09-30T22:21:34.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.472+0000 7fe033bb0700 1 Processor -- start 2023-09-30T22:21:34.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.472+0000 7fe033bb0700 1 -- start start 2023-09-30T22:21:34.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.472+0000 7fe033bb0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe02c0a0a70 0x7fe02c1335d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:34.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.472+0000 7fe033bb0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe02c0a1550 0x7fe02c133b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:34.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.472+0000 7fe033bb0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe02c139200 0x7fe02c11e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:34.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.472+0000 7fe033bb0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c122100 con 0x7fe02c0a1550 2023-09-30T22:21:34.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.472+0000 7fe033bb0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c1222e0 con 0x7fe02c139200 2023-09-30T22:21:34.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.472+0000 7fe033bb0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c120c50 con 0x7fe02c0a0a70 2023-09-30T22:21:34.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.473+0000 7fe03114b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe02c0a1550 0x7fe02c133b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:34.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.473+0000 7fe03194c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe02c0a0a70 0x7fe02c1335d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:34.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.473+0000 7fe03114b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe02c0a1550 0x7fe02c133b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50232/0 (socket says 172.21.15.156:50232) 2023-09-30T22:21:34.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.473+0000 7fe03114b700 1 -- 172.21.15.156:0/1075297505 learned_addr learned my addr 172.21.15.156:0/1075297505 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:34.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.473+0000 7fe03214d700 1 --2- 172.21.15.156:0/1075297505 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe02c139200 0x7fe02c11e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:34.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.473+0000 7fe03194c700 1 -- 172.21.15.156:0/1075297505 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe02c139200 msgr2=0x7fe02c11e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:34.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.473+0000 7fe03194c700 1 --2- 172.21.15.156:0/1075297505 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe02c139200 0x7fe02c11e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.473+0000 7fe03194c700 1 -- 172.21.15.156:0/1075297505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe02c0a1550 msgr2=0x7fe02c133b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:34.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.473+0000 7fe03194c700 1 --2- 172.21.15.156:0/1075297505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe02c0a1550 0x7fe02c133b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.473+0000 7fe03194c700 1 -- 172.21.15.156:0/1075297505 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01c0094a0 con 0x7fe02c0a0a70 2023-09-30T22:21:34.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.473+0000 7fe03114b700 1 --2- 172.21.15.156:0/1075297505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe02c0a1550 0x7fe02c133b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:34.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.473+0000 7fe03194c700 1 --2- 172.21.15.156:0/1075297505 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe02c0a0a70 0x7fe02c1335d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe02800c4c0 tx=0x7fe02800c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:34.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.473+0000 7fe0227fc700 1 -- 172.21.15.156:0/1075297505 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe028005d70 con 0x7fe02c0a0a70 2023-09-30T22:21:34.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.473+0000 7fe0227fc700 1 -- 172.21.15.156:0/1075297505 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0280070d0 con 0x7fe02c0a0a70 2023-09-30T22:21:34.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.473+0000 7fe0227fc700 1 -- 172.21.15.156:0/1075297505 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe028007440 con 0x7fe02c0a0a70 2023-09-30T22:21:34.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.473+0000 7fe033bb0700 1 -- 172.21.15.156:0/1075297505 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe02c0a5100 con 0x7fe02c0a0a70 2023-09-30T22:21:34.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.473+0000 7fe033bb0700 1 -- 172.21.15.156:0/1075297505 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe02c120470 con 0x7fe02c0a0a70 2023-09-30T22:21:34.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.474+0000 7fe0227fc700 1 -- 172.21.15.156:0/1075297505 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe0280075a0 con 0x7fe02c0a0a70 2023-09-30T22:21:34.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.474+0000 7fe0227fc700 1 -- 172.21.15.156:0/1075297505 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe02803ea90 con 0x7fe02c0a0a70 2023-09-30T22:21:34.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.474+0000 7fe033bb0700 1 -- 172.21.15.156:0/1075297505 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe02c04f2a0 con 0x7fe02c0a0a70 2023-09-30T22:21:34.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.483+0000 7fe0227fc700 1 -- 172.21.15.156:0/1075297505 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe028019d20 con 0x7fe02c0a0a70 2023-09-30T22:21:34.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.514+0000 7f13adc42700 1 Processor -- start 2023-09-30T22:21:34.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.515+0000 7f13adc42700 1 -- start start 2023-09-30T22:21:34.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.515+0000 7f4c63e19700 1 -- 172.21.15.156:0/322879694 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4c5c11f760 con 0x7f4c5c131d70 2023-09-30T22:21:34.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.515+0000 7f13adc42700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f13a8133ad0 0x7f13a8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:34.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.515+0000 7f13adc42700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13a81300a0 0x7f13a81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:34.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.515+0000 7f13adc42700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a806b2d0 con 0x7f13a81309f0 2023-09-30T22:21:34.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.515+0000 7f13adc42700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a8133610 con 0x7f13a8133ad0 2023-09-30T22:21:34.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.515+0000 7f13adc42700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a809a500 con 0x7f13a81300a0 2023-09-30T22:21:34.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.515+0000 7f13a6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13a81300a0 0x7f13a81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:34.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.515+0000 7f13a77fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f13a8133ad0 0x7f13a8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:34.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.515+0000 7f13a7fff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f13a81309f0 0x7f13a813a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47630/0 (socket says 172.21.15.156:47630) 2023-09-30T22:21:34.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.515+0000 7f13a7fff700 1 -- 172.21.15.156:0/2490433223 learned_addr learned my addr 172.21.15.156:0/2490433223 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:34.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.516+0000 7f13a77fe700 1 -- 172.21.15.156:0/2490433223 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13a81300a0 msgr2=0x7f13a81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:34.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.516+0000 7f13a77fe700 1 --2- 172.21.15.156:0/2490433223 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13a81300a0 0x7f13a81304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.516+0000 7f4c527fc700 1 -- 172.21.15.156:0/322879694 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4c5c11f760 con 0x7f4c5c131d70 2023-09-30T22:21:34.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.516+0000 7f13a77fe700 1 -- 172.21.15.156:0/2490433223 >> v1:172.21.15.156:6789/0 conn(0x7f13a81309f0 legacy=0x7f13a813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:34.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.516+0000 7f13a77fe700 1 -- 172.21.15.156:0/2490433223 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a81338b0 con 0x7f13a8133ad0 2023-09-30T22:21:34.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.516+0000 7f13a6ffd700 1 --2- 172.21.15.156:0/2490433223 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13a81300a0 0x7f13a81304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:34.520 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:34.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.516+0000 7f13a77fe700 1 --2- 172.21.15.156:0/2490433223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13a8133ad0 0x7f13a8133ea0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f1398009840 tx=0x7f1398009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcac7f0f4f08e1d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:34.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.516+0000 7f13a67fc700 1 -- 172.21.15.156:0/2490433223 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398011830 con 0x7f13a8133ad0 2023-09-30T22:21:34.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.516+0000 7f13a67fc700 1 -- 172.21.15.156:0/2490433223 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1398011990 con 0x7f13a8133ad0 2023-09-30T22:21:34.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.516+0000 7f13a67fc700 1 -- 172.21.15.156:0/2490433223 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398011d20 con 0x7f13a8133ad0 2023-09-30T22:21:34.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.517+0000 7f13adc42700 1 -- 172.21.15.156:0/2490433223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13a8133ad0 msgr2=0x7f13a8133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:34.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.517+0000 7f13adc42700 1 --2- 172.21.15.156:0/2490433223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13a8133ad0 0x7f13a8133ea0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f1398009840 tx=0x7f1398009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:34.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.517+0000 7f13adc42700 1 -- 172.21.15.156:0/2490433223 shutdown_connections 2023-09-30T22:21:34.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.517+0000 7f13adc42700 1 --2- 172.21.15.156:0/2490433223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13a8133ad0 0x7f13a8133ea0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.517+0000 7f13adc42700 1 --2- 172.21.15.156:0/2490433223 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13a81300a0 0x7f13a81304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.517+0000 7f13adc42700 1 -- 172.21.15.156:0/2490433223 >> 172.21.15.156:0/2490433223 conn(0x7f13a8099c40 msgr2=0x7f13a80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:34.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.517+0000 7f13adc42700 1 -- 172.21.15.156:0/2490433223 shutdown_connections 2023-09-30T22:21:34.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.517+0000 7f13adc42700 1 -- 172.21.15.156:0/2490433223 wait complete. 2023-09-30T22:21:34.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.518+0000 7f4c63e19700 1 -- 172.21.15.156:0/322879694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c5c131d70 msgr2=0x7f4c5c11cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:34.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.518+0000 7f4c63e19700 1 --2- 172.21.15.156:0/322879694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c5c131d70 0x7f4c5c11cae0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f4c5400f500 tx=0x7f4c5400f810 comp rx=0 tx=0).stop 2023-09-30T22:21:34.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.518+0000 7f13adc42700 1 Processor -- start 2023-09-30T22:21:34.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.518+0000 7f4c63e19700 1 -- 172.21.15.156:0/322879694 shutdown_connections 2023-09-30T22:21:34.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.518+0000 7f4c63e19700 1 --2- 172.21.15.156:0/322879694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c5c131d70 0x7f4c5c11cae0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.518+0000 7f4c63e19700 1 --2- 172.21.15.156:0/322879694 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4c5c09e870 0x7f4c5c11c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.518+0000 7f4c63e19700 1 --2- 172.21.15.156:0/322879694 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c5c09f180 0x7f4c5c11c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.518+0000 7f4c63e19700 1 -- 172.21.15.156:0/322879694 >> 172.21.15.156:0/322879694 conn(0x7f4c5c0a4430 msgr2=0x7f4c5c1310a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:34.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.519+0000 7f4c63e19700 1 -- 172.21.15.156:0/322879694 shutdown_connections 2023-09-30T22:21:34.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.519+0000 7f4c63e19700 1 -- 172.21.15.156:0/322879694 wait complete. 2023-09-30T22:21:34.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.519+0000 7f13adc42700 1 -- start start 2023-09-30T22:21:34.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.519+0000 7f13adc42700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13a81300a0 0x7f13a811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:34.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.519+0000 7f13adc42700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13a81309f0 0x7f13a811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:34.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.519+0000 7f13adc42700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13a8133ad0 0x7f13a811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:34.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.519+0000 7f13adc42700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a8120b70 con 0x7f13a8133ad0 2023-09-30T22:21:34.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.519+0000 7f13adc42700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a8072290 con 0x7f13a81300a0 2023-09-30T22:21:34.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.519+0000 7f13adc42700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13a811ff90 con 0x7f13a81309f0 2023-09-30T22:21:34.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.519+0000 7f13a77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13a81300a0 0x7f13a811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:34.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.519+0000 7f13a7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13a8133ad0 0x7f13a811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:34.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.519+0000 7f13a77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13a81300a0 0x7f13a811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37006/0 (socket says 172.21.15.156:37006) 2023-09-30T22:21:34.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.519+0000 7f13a77fe700 1 -- 172.21.15.156:0/961694963 learned_addr learned my addr 172.21.15.156:0/961694963 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:34.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.519+0000 7f13a7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13a8133ad0 0x7f13a811e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50250/0 (socket says 172.21.15.156:50250) 2023-09-30T22:21:34.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.519+0000 7f13a6ffd700 1 --2- 172.21.15.156:0/961694963 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13a81309f0 0x7f13a811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:34.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.520+0000 7f13a77fe700 1 -- 172.21.15.156:0/961694963 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13a81309f0 msgr2=0x7f13a811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:34.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.520+0000 7f13a77fe700 1 --2- 172.21.15.156:0/961694963 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13a81309f0 0x7f13a811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.520+0000 7f13a77fe700 1 -- 172.21.15.156:0/961694963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13a8133ad0 msgr2=0x7f13a811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:34.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.520+0000 7f13a77fe700 1 --2- 172.21.15.156:0/961694963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13a8133ad0 0x7f13a811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.520+0000 7f13a77fe700 1 -- 172.21.15.156:0/961694963 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139c0094a0 con 0x7f13a81300a0 2023-09-30T22:21:34.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.520+0000 7f13a6ffd700 1 --2- 172.21.15.156:0/961694963 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13a81309f0 0x7f13a811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:34.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.520+0000 7f13a77fe700 1 --2- 172.21.15.156:0/961694963 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13a81300a0 0x7f13a811da40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1398009fd0 tx=0x7f1398004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:34.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.520+0000 7f138ffff700 1 -- 172.21.15.156:0/961694963 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13980036a0 con 0x7f13a81300a0 2023-09-30T22:21:34.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.520+0000 7f138ffff700 1 -- 172.21.15.156:0/961694963 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139801f070 con 0x7f13a81300a0 2023-09-30T22:21:34.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.520+0000 7f138ffff700 1 -- 172.21.15.156:0/961694963 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398003a40 con 0x7f13a81300a0 2023-09-30T22:21:34.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.520+0000 7f13adc42700 1 -- 172.21.15.156:0/961694963 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13980094a0 con 0x7f13a81300a0 2023-09-30T22:21:34.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.520+0000 7f13adc42700 1 -- 172.21.15.156:0/961694963 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a8120250 con 0x7f13a81300a0 2023-09-30T22:21:34.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.521+0000 7f138ffff700 1 -- 172.21.15.156:0/961694963 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1398003ba0 con 0x7f13a81300a0 2023-09-30T22:21:34.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.521+0000 7f138ffff700 1 -- 172.21.15.156:0/961694963 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1398021070 con 0x7f13a81300a0 2023-09-30T22:21:34.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.521+0000 7f13adc42700 1 -- 172.21.15.156:0/961694963 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a8120250 con 0x7f13a81300a0 2023-09-30T22:21:34.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.526+0000 7f138ffff700 1 -- 172.21.15.156:0/961694963 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f13a8120250 con 0x7f13a81300a0 2023-09-30T22:21:34.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:34.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.690+0000 7fe033bb0700 1 -- 172.21.15.156:0/1075297505 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe02c134280 con 0x7fe02c0a0a70 2023-09-30T22:21:34.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.690+0000 7fe0227fc700 1 -- 172.21.15.156:0/1075297505 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe028017030 con 0x7fe02c0a0a70 2023-09-30T22:21:34.690 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:34.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.692+0000 7fe033bb0700 1 -- 172.21.15.156:0/1075297505 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe02c0a0a70 msgr2=0x7fe02c1335d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:34.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.692+0000 7fe033bb0700 1 --2- 172.21.15.156:0/1075297505 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe02c0a0a70 0x7fe02c1335d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe02800c4c0 tx=0x7fe02800c7d0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.692+0000 7fe033bb0700 1 -- 172.21.15.156:0/1075297505 shutdown_connections 2023-09-30T22:21:34.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.692+0000 7fe033bb0700 1 --2- 172.21.15.156:0/1075297505 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe02c139200 0x7fe02c11e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.692+0000 7fe033bb0700 1 --2- 172.21.15.156:0/1075297505 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe02c0a0a70 0x7fe02c1335d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.692+0000 7fe033bb0700 1 --2- 172.21.15.156:0/1075297505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe02c0a1550 0x7fe02c133b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.692+0000 7fe033bb0700 1 -- 172.21.15.156:0/1075297505 >> 172.21.15.156:0/1075297505 conn(0x7fe02c0a6610 msgr2=0x7fe02c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:34.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.692+0000 7fe033bb0700 1 -- 172.21.15.156:0/1075297505 shutdown_connections 2023-09-30T22:21:34.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.692+0000 7fe033bb0700 1 -- 172.21.15.156:0/1075297505 wait complete. 2023-09-30T22:21:34.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:34.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.719+0000 7f13adc42700 1 -- 172.21.15.156:0/961694963 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f13a8120250 con 0x7f13a81300a0 2023-09-30T22:21:34.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.720+0000 7f138ffff700 1 -- 172.21.15.156:0/961694963 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f13a8120250 con 0x7f13a81300a0 2023-09-30T22:21:34.720 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:34.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.722+0000 7f13adc42700 1 -- 172.21.15.156:0/961694963 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13a81300a0 msgr2=0x7f13a811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:34.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.722+0000 7f13adc42700 1 --2- 172.21.15.156:0/961694963 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13a81300a0 0x7f13a811da40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1398009fd0 tx=0x7f1398004750 comp rx=0 tx=0).stop 2023-09-30T22:21:34.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.722+0000 7f13adc42700 1 -- 172.21.15.156:0/961694963 shutdown_connections 2023-09-30T22:21:34.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.722+0000 7f13adc42700 1 --2- 172.21.15.156:0/961694963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13a8133ad0 0x7f13a811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.722+0000 7f13adc42700 1 --2- 172.21.15.156:0/961694963 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13a81300a0 0x7f13a811da40 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.722+0000 7f13adc42700 1 --2- 172.21.15.156:0/961694963 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13a81309f0 0x7f13a811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.722+0000 7f13adc42700 1 -- 172.21.15.156:0/961694963 >> 172.21.15.156:0/961694963 conn(0x7f13a8099c40 msgr2=0x7f13a80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:34.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.722+0000 7f13adc42700 1 -- 172.21.15.156:0/961694963 shutdown_connections 2023-09-30T22:21:34.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.722+0000 7f13adc42700 1 -- 172.21.15.156:0/961694963 wait complete. 2023-09-30T22:21:34.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:34.870 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:34.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.993+0000 7fab782f8700 1 Processor -- start 2023-09-30T22:21:34.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.993+0000 7fab782f8700 1 -- start start 2023-09-30T22:21:34.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.994+0000 7fab782f8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab7006a770 0x7fab7006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:34.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.994+0000 7fab782f8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab7006b080 0x7fab701317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:34.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.994+0000 7fab782f8700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab7009da80 con 0x7fab70131cf0 2023-09-30T22:21:34.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.994+0000 7fab782f8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7009dce0 con 0x7fab7006a770 2023-09-30T22:21:34.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.994+0000 7fab782f8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab7009eb20 con 0x7fab7006b080 2023-09-30T22:21:34.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.994+0000 7fab76094700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab7006a770 0x7fab7006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:34.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.994+0000 7fab75893700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab7006b080 0x7fab701317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:34.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.994+0000 7fab76895700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fab70131cf0 0x7fab70138c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47640/0 (socket says 172.21.15.156:47640) 2023-09-30T22:21:34.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.994+0000 7fab76895700 1 -- 172.21.15.156:0/1944733298 learned_addr learned my addr 172.21.15.156:0/1944733298 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:34.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.994+0000 7fab76094700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab7006a770 0x7fab7006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37008/0 (socket says 172.21.15.156:37008) 2023-09-30T22:21:34.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.994+0000 7fab76094700 1 -- 172.21.15.156:0/1944733298 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab7006b080 msgr2=0x7fab701317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:34.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.994+0000 7fab75092700 1 -- 172.21.15.156:0/1944733298 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1190395413 0 0) 0x7fab7009da80 con 0x7fab70131cf0 2023-09-30T22:21:34.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.994+0000 7fab76094700 1 --2- 172.21.15.156:0/1944733298 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab7006b080 0x7fab701317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.994+0000 7fab76094700 1 -- 172.21.15.156:0/1944733298 >> v1:172.21.15.156:6789/0 conn(0x7fab70131cf0 legacy=0x7fab70138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:34.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.994+0000 7fab76094700 1 -- 172.21.15.156:0/1944733298 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7009d860 con 0x7fab7006a770 2023-09-30T22:21:34.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.994+0000 7fab75893700 1 --2- 172.21.15.156:0/1944733298 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab7006b080 0x7fab701317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:34.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.994+0000 7fab76094700 1 --2- 172.21.15.156:0/1944733298 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab7006a770 0x7fab7006ab40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fab640098a0 tx=0x7fab64009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cf4727f5545026 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:34.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.995+0000 7fab75092700 1 -- 172.21.15.156:0/1944733298 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab64011830 con 0x7fab7006a770 2023-09-30T22:21:34.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.995+0000 7fab75092700 1 -- 172.21.15.156:0/1944733298 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab64011990 con 0x7fab7006a770 2023-09-30T22:21:34.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.995+0000 7fab75092700 1 -- 172.21.15.156:0/1944733298 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab64011d20 con 0x7fab7006a770 2023-09-30T22:21:34.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.995+0000 7fab782f8700 1 -- 172.21.15.156:0/1944733298 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab7006a770 msgr2=0x7fab7006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:34.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.995+0000 7fab782f8700 1 --2- 172.21.15.156:0/1944733298 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab7006a770 0x7fab7006ab40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fab640098a0 tx=0x7fab64009bb0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.995+0000 7fab782f8700 1 -- 172.21.15.156:0/1944733298 shutdown_connections 2023-09-30T22:21:34.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.995+0000 7fab782f8700 1 --2- 172.21.15.156:0/1944733298 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab7006a770 0x7fab7006ab40 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.995+0000 7fab782f8700 1 --2- 172.21.15.156:0/1944733298 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab7006b080 0x7fab701317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:34.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.995+0000 7fab782f8700 1 -- 172.21.15.156:0/1944733298 >> 172.21.15.156:0/1944733298 conn(0x7fab70099c40 msgr2=0x7fab700a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:34.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.995+0000 7fab782f8700 1 -- 172.21.15.156:0/1944733298 shutdown_connections 2023-09-30T22:21:34.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.995+0000 7fab782f8700 1 -- 172.21.15.156:0/1944733298 wait complete. 2023-09-30T22:21:34.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.996+0000 7fab782f8700 1 Processor -- start 2023-09-30T22:21:34.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.996+0000 7fab782f8700 1 -- start start 2023-09-30T22:21:35.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.997+0000 7fab782f8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab7006a770 0x7fab701c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:35.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.997+0000 7fab782f8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab7006b080 0x7fab701c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:35.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.997+0000 7fab782f8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab70131cf0 0x7fab701c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:35.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.997+0000 7fab782f8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab70131130 con 0x7fab7006b080 2023-09-30T22:21:35.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.997+0000 7fab782f8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7011e530 con 0x7fab70131cf0 2023-09-30T22:21:35.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.997+0000 7fab782f8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab700a0630 con 0x7fab7006a770 2023-09-30T22:21:35.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.997+0000 7fab76094700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab7006a770 0x7fab701c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:35.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.997+0000 7fab76895700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab70131cf0 0x7fab701c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:35.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.997+0000 7fab75893700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab7006b080 0x7fab701c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:35.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.997+0000 7fab76094700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab7006a770 0x7fab701c5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36270/0 (socket says 172.21.15.156:36270) 2023-09-30T22:21:35.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.997+0000 7fab76094700 1 -- 172.21.15.156:0/1471171551 learned_addr learned my addr 172.21.15.156:0/1471171551 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:35.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.997+0000 7fab76094700 1 -- 172.21.15.156:0/1471171551 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab70131cf0 msgr2=0x7fab701c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:35.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.997+0000 7fab76094700 1 --2- 172.21.15.156:0/1471171551 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab70131cf0 0x7fab701c6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:35.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.997+0000 7fab76094700 1 -- 172.21.15.156:0/1471171551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab7006b080 msgr2=0x7fab701c63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:35.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.997+0000 7fab76094700 1 --2- 172.21.15.156:0/1471171551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab7006b080 0x7fab701c63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:35.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.997+0000 7fab76094700 1 -- 172.21.15.156:0/1471171551 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c0094a0 con 0x7fab7006a770 2023-09-30T22:21:35.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.997+0000 7fab76094700 1 --2- 172.21.15.156:0/1471171551 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab7006a770 0x7fab701c5e80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fab7009dc10 tx=0x7fab64004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:35.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.997+0000 7fab62ffd700 1 -- 172.21.15.156:0/1471171551 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6401a930 con 0x7fab7006a770 2023-09-30T22:21:35.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.997+0000 7fab62ffd700 1 -- 172.21.15.156:0/1471171551 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6401aa90 con 0x7fab7006a770 2023-09-30T22:21:35.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.997+0000 7fab62ffd700 1 -- 172.21.15.156:0/1471171551 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6401ae20 con 0x7fab7006a770 2023-09-30T22:21:35.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.997+0000 7fab782f8700 1 -- 172.21.15.156:0/1471171551 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab640094a0 con 0x7fab7006a770 2023-09-30T22:21:35.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.997+0000 7fab782f8700 1 -- 172.21.15.156:0/1471171551 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab7011eba0 con 0x7fab7006a770 2023-09-30T22:21:35.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.998+0000 7fab62ffd700 1 -- 172.21.15.156:0/1471171551 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab6402b3b0 con 0x7fab7006a770 2023-09-30T22:21:35.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.998+0000 7fab62ffd700 1 -- 172.21.15.156:0/1471171551 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fab64040920 con 0x7fab7006a770 2023-09-30T22:21:35.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:34.998+0000 7fab782f8700 1 -- 172.21.15.156:0/1471171551 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab7011fe40 con 0x7fab7006a770 2023-09-30T22:21:35.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.003+0000 7fab62ffd700 1 -- 172.21.15.156:0/1471171551 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab7011fe40 con 0x7fab7006a770 2023-09-30T22:21:35.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.188+0000 7fab782f8700 1 -- 172.21.15.156:0/1471171551 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fab7011fe40 con 0x7fab7006a770 2023-09-30T22:21:35.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.188+0000 7fab62ffd700 1 -- 172.21.15.156:0/1471171551 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab7011fe40 con 0x7fab7006a770 2023-09-30T22:21:35.188 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:35.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.190+0000 7fab782f8700 1 -- 172.21.15.156:0/1471171551 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab7006a770 msgr2=0x7fab701c5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:35.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.190+0000 7fab782f8700 1 --2- 172.21.15.156:0/1471171551 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab7006a770 0x7fab701c5e80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fab7009dc10 tx=0x7fab64004750 comp rx=0 tx=0).stop 2023-09-30T22:21:35.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.190+0000 7fab782f8700 1 -- 172.21.15.156:0/1471171551 shutdown_connections 2023-09-30T22:21:35.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.190+0000 7fab782f8700 1 --2- 172.21.15.156:0/1471171551 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab70131cf0 0x7fab701c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:35.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.190+0000 7fab782f8700 1 --2- 172.21.15.156:0/1471171551 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab7006a770 0x7fab701c5e80 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:35.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.190+0000 7fab782f8700 1 --2- 172.21.15.156:0/1471171551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab7006b080 0x7fab701c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:35.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.190+0000 7fab782f8700 1 -- 172.21.15.156:0/1471171551 >> 172.21.15.156:0/1471171551 conn(0x7fab70099c40 msgr2=0x7fab701b99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:35.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.190+0000 7fab782f8700 1 -- 172.21.15.156:0/1471171551 shutdown_connections 2023-09-30T22:21:35.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.190+0000 7fab782f8700 1 -- 172.21.15.156:0/1471171551 wait complete. 2023-09-30T22:21:35.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:35.534 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:35.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.658+0000 7f4b1e438700 1 Processor -- start 2023-09-30T22:21:35.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.658+0000 7f4b1e438700 1 -- start start 2023-09-30T22:21:35.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.658+0000 7f4b1e438700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b18132100 0x7f4b181367d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:35.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.658+0000 7f4b1e438700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4b181314b0 0x7f4b18138d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:35.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.658+0000 7f4b1e438700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b180a0f20 con 0x7f4b18066410 2023-09-30T22:21:35.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.658+0000 7f4b1e438700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b180667e0 con 0x7f4b181314b0 2023-09-30T22:21:35.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.658+0000 7f4b1e438700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b180a23c0 con 0x7f4b18132100 2023-09-30T22:21:35.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.658+0000 7f4b1c9d5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4b181314b0 0x7f4b18138d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:35.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.658+0000 7f4b177fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b18132100 0x7f4b181367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:35.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.658+0000 7f4b17fff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4b18066410 0x7f4b181319f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47654/0 (socket says 172.21.15.156:47654) 2023-09-30T22:21:35.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.658+0000 7f4b1c9d5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4b181314b0 0x7f4b18138d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50274/0 (socket says 172.21.15.156:50274) 2023-09-30T22:21:35.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.658+0000 7f4b17fff700 1 -- 172.21.15.156:0/3899119038 learned_addr learned my addr 172.21.15.156:0/3899119038 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:35.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.659+0000 7f4b177fe700 1 -- 172.21.15.156:0/3899119038 >> v2:172.21.15.156:3300/0 conn(0x7f4b181314b0 msgr2=0x7f4b18138d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:35.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.659+0000 7f4b177fe700 1 --2- 172.21.15.156:0/3899119038 >> v2:172.21.15.156:3300/0 conn(0x7f4b181314b0 0x7f4b18138d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:35.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.659+0000 7f4b177fe700 1 -- 172.21.15.156:0/3899119038 >> v1:172.21.15.156:6789/0 conn(0x7f4b18066410 legacy=0x7f4b181319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:35.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.659+0000 7f4b177fe700 1 -- 172.21.15.156:0/3899119038 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b180a16e0 con 0x7f4b18132100 2023-09-30T22:21:35.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.659+0000 7f4b1c9d5700 1 --2- 172.21.15.156:0/3899119038 >> v2:172.21.15.156:3300/0 conn(0x7f4b181314b0 0x7f4b18138d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:35.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.659+0000 7f4b177fe700 1 --2- 172.21.15.156:0/3899119038 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b18132100 0x7f4b181367d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009870 tx=0x7f4b0c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f1aa82221bea308 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:35.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.659+0000 7f4b16ffd700 1 -- 172.21.15.156:0/3899119038 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c011830 con 0x7f4b18132100 2023-09-30T22:21:35.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.659+0000 7f4b16ffd700 1 -- 172.21.15.156:0/3899119038 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0c011990 con 0x7f4b18132100 2023-09-30T22:21:35.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.659+0000 7f4b16ffd700 1 -- 172.21.15.156:0/3899119038 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c011d20 con 0x7f4b18132100 2023-09-30T22:21:35.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.659+0000 7f4b1e438700 1 -- 172.21.15.156:0/3899119038 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b18132100 msgr2=0x7f4b181367d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:35.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.659+0000 7f4b1e438700 1 --2- 172.21.15.156:0/3899119038 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b18132100 0x7f4b181367d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009870 tx=0x7f4b0c009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:35.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.659+0000 7f4b1e438700 1 -- 172.21.15.156:0/3899119038 shutdown_connections 2023-09-30T22:21:35.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.659+0000 7f4b1e438700 1 --2- 172.21.15.156:0/3899119038 >> v2:172.21.15.156:3300/0 conn(0x7f4b181314b0 0x7f4b18138d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:35.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.659+0000 7f4b1e438700 1 --2- 172.21.15.156:0/3899119038 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b18132100 0x7f4b181367d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:35.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.659+0000 7f4b1e438700 1 -- 172.21.15.156:0/3899119038 >> 172.21.15.156:0/3899119038 conn(0x7f4b180a2980 msgr2=0x7f4b180a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:35.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.659+0000 7f4b1e438700 1 -- 172.21.15.156:0/3899119038 shutdown_connections 2023-09-30T22:21:35.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.660+0000 7f4b1e438700 1 -- 172.21.15.156:0/3899119038 wait complete. 2023-09-30T22:21:35.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.661+0000 7f4b1e438700 1 Processor -- start 2023-09-30T22:21:35.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.661+0000 7f4b1e438700 1 -- start start 2023-09-30T22:21:35.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.661+0000 7f4b1e438700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b18066410 0x7f4b18136340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:35.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.661+0000 7f4b1e438700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b181314b0 0x7f4b18136880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:35.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.661+0000 7f4b1e438700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b18132100 0x7f4b18136dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:35.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.661+0000 7f4b1e438700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1811a020 con 0x7f4b18132100 2023-09-30T22:21:35.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.661+0000 7f4b1e438700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b18119430 con 0x7f4b18066410 2023-09-30T22:21:35.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.661+0000 7f4b1e438700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1812ede0 con 0x7f4b181314b0 2023-09-30T22:21:35.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.662+0000 7f4b177fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b181314b0 0x7f4b18136880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:35.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.662+0000 7f4b1c9d5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b18132100 0x7f4b18136dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:35.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.662+0000 7f4b177fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b181314b0 0x7f4b18136880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36302/0 (socket says 172.21.15.156:36302) 2023-09-30T22:21:35.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.662+0000 7f4b1c9d5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b18132100 0x7f4b18136dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50290/0 (socket says 172.21.15.156:50290) 2023-09-30T22:21:35.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.662+0000 7f4b177fe700 1 -- 172.21.15.156:0/968828826 learned_addr learned my addr 172.21.15.156:0/968828826 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:35.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.662+0000 7f4b17fff700 1 --2- 172.21.15.156:0/968828826 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b18066410 0x7f4b18136340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:35.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.662+0000 7f4b177fe700 1 -- 172.21.15.156:0/968828826 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b18066410 msgr2=0x7f4b18136340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:35.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.662+0000 7f4b177fe700 1 --2- 172.21.15.156:0/968828826 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b18066410 0x7f4b18136340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:35.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.662+0000 7f4b177fe700 1 -- 172.21.15.156:0/968828826 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b18132100 msgr2=0x7f4b18136dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:35.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.662+0000 7f4b177fe700 1 --2- 172.21.15.156:0/968828826 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b18132100 0x7f4b18136dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:35.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.662+0000 7f4b177fe700 1 -- 172.21.15.156:0/968828826 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b10009a70 con 0x7f4b181314b0 2023-09-30T22:21:35.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.662+0000 7f4b177fe700 1 --2- 172.21.15.156:0/968828826 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b181314b0 0x7f4b18136880 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0090b0 tx=0x7f4b0c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:35.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.662+0000 7f4b14ff9700 1 -- 172.21.15.156:0/968828826 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0045d0 con 0x7f4b181314b0 2023-09-30T22:21:35.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.662+0000 7f4b14ff9700 1 -- 172.21.15.156:0/968828826 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0c01f070 con 0x7f4b181314b0 2023-09-30T22:21:35.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.662+0000 7f4b1e438700 1 -- 172.21.15.156:0/968828826 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b0c0094a0 con 0x7f4b181314b0 2023-09-30T22:21:35.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.662+0000 7f4b14ff9700 1 -- 172.21.15.156:0/968828826 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0038a0 con 0x7f4b181314b0 2023-09-30T22:21:35.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.662+0000 7f4b1e438700 1 -- 172.21.15.156:0/968828826 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b1811ad50 con 0x7f4b181314b0 2023-09-30T22:21:35.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.663+0000 7f4b14ff9700 1 -- 172.21.15.156:0/968828826 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b0c003a00 con 0x7f4b181314b0 2023-09-30T22:21:35.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.663+0000 7f4b14ff9700 1 -- 172.21.15.156:0/968828826 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4b0c021070 con 0x7f4b181314b0 2023-09-30T22:21:35.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.663+0000 7f4b1e438700 1 -- 172.21.15.156:0/968828826 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b1804f2a0 con 0x7f4b181314b0 2023-09-30T22:21:35.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.668+0000 7f4b14ff9700 1 -- 172.21.15.156:0/968828826 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b0c015070 con 0x7f4b181314b0 2023-09-30T22:21:35.705 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:35.734 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:35.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.832+0000 7fdaeee8a700 1 Processor -- start 2023-09-30T22:21:35.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.832+0000 7fdaeee8a700 1 -- start start 2023-09-30T22:21:35.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.833+0000 7fdaeee8a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdae8134140 0x7fdae8138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:35.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.833+0000 7fdaeee8a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdae81345a0 0x7fdae813b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:35.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.833+0000 7fdaeee8a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae809b110 con 0x7fdae809ad40 2023-09-30T22:21:35.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.833+0000 7fdaeee8a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae80a3b60 con 0x7fdae8134140 2023-09-30T22:21:35.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.833+0000 7fdaeee8a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80a1a80 con 0x7fdae81345a0 2023-09-30T22:21:35.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.833+0000 7fdaed427700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdae81345a0 0x7fdae813b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:35.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.833+0000 7fdaed427700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdae81345a0 0x7fdae813b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36304/0 (socket says 172.21.15.156:36304) 2023-09-30T22:21:35.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.833+0000 7fdaed427700 1 -- 172.21.15.156:0/3195878644 learned_addr learned my addr 172.21.15.156:0/3195878644 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:35.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.833+0000 7fdae7fff700 1 --2- 172.21.15.156:0/3195878644 >> v2:172.21.15.156:3300/0 conn(0x7fdae8134140 0x7fdae8138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:35.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.833+0000 7fdae77fe700 1 -- 172.21.15.156:0/3195878644 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 843311763 0 0) 0x7fdae809b110 con 0x7fdae809ad40 2023-09-30T22:21:35.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.833+0000 7fdaed427700 1 -- 172.21.15.156:0/3195878644 >> v2:172.21.15.156:3300/0 conn(0x7fdae8134140 msgr2=0x7fdae8138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:35.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.833+0000 7fdaed427700 1 --2- 172.21.15.156:0/3195878644 >> v2:172.21.15.156:3300/0 conn(0x7fdae8134140 0x7fdae8138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:35.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.833+0000 7fdaed427700 1 -- 172.21.15.156:0/3195878644 >> v1:172.21.15.156:6789/0 conn(0x7fdae809ad40 legacy=0x7fdae8133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:35.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.833+0000 7fdaed427700 1 -- 172.21.15.156:0/3195878644 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae80a2fa0 con 0x7fdae81345a0 2023-09-30T22:21:35.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.833+0000 7fdaed427700 1 --2- 172.21.15.156:0/3195878644 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdae81345a0 0x7fdae813b3d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdae0009e50 tx=0x7fdae000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6230586d1f3b0378 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:35.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.834+0000 7fdae77fe700 1 -- 172.21.15.156:0/3195878644 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae000e070 con 0x7fdae81345a0 2023-09-30T22:21:35.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.834+0000 7fdae77fe700 1 -- 172.21.15.156:0/3195878644 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae000b910 con 0x7fdae81345a0 2023-09-30T22:21:35.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.834+0000 7fdae77fe700 1 -- 172.21.15.156:0/3195878644 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae000bcc0 con 0x7fdae81345a0 2023-09-30T22:21:35.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.834+0000 7fdaeee8a700 1 -- 172.21.15.156:0/3195878644 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdae81345a0 msgr2=0x7fdae813b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:35.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.834+0000 7fdaeee8a700 1 --2- 172.21.15.156:0/3195878644 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdae81345a0 0x7fdae813b3d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdae0009e50 tx=0x7fdae000b330 comp rx=0 tx=0).stop 2023-09-30T22:21:35.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.834+0000 7fdaeee8a700 1 -- 172.21.15.156:0/3195878644 shutdown_connections 2023-09-30T22:21:35.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.834+0000 7fdaeee8a700 1 --2- 172.21.15.156:0/3195878644 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdae81345a0 0x7fdae813b3d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:35.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.834+0000 7fdaeee8a700 1 --2- 172.21.15.156:0/3195878644 >> v2:172.21.15.156:3300/0 conn(0x7fdae8134140 0x7fdae8138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:35.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.834+0000 7fdaeee8a700 1 -- 172.21.15.156:0/3195878644 >> 172.21.15.156:0/3195878644 conn(0x7fdae8099c40 msgr2=0x7fdae806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:35.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.834+0000 7fdaeee8a700 1 -- 172.21.15.156:0/3195878644 shutdown_connections 2023-09-30T22:21:35.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.834+0000 7fdaeee8a700 1 -- 172.21.15.156:0/3195878644 wait complete. 2023-09-30T22:21:35.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.835+0000 7fdaeee8a700 1 Processor -- start 2023-09-30T22:21:35.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.835+0000 7fdaeee8a700 1 -- start start 2023-09-30T22:21:35.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.836+0000 7fdaeee8a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdae809ad40 0x7fdae8139410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:35.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.836+0000 7fdaeee8a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdae8134140 0x7fdae8139950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:35.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.836+0000 7fdaeee8a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdae81345a0 0x7fdae8139e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:35.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.836+0000 7fdaeee8a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae813a8c0 con 0x7fdae81345a0 2023-09-30T22:21:35.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.836+0000 7fdaeee8a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae811cdc0 con 0x7fdae8134140 2023-09-30T22:21:35.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.836+0000 7fdaeee8a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdae811dff0 con 0x7fdae809ad40 2023-09-30T22:21:35.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.836+0000 7fdaecc26700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdae809ad40 0x7fdae8139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:35.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.836+0000 7fdaed427700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdae81345a0 0x7fdae8139e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:35.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.836+0000 7fdaecc26700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdae809ad40 0x7fdae8139410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36308/0 (socket says 172.21.15.156:36308) 2023-09-30T22:21:35.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.836+0000 7fdaed427700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdae81345a0 0x7fdae8139e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50318/0 (socket says 172.21.15.156:50318) 2023-09-30T22:21:35.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.836+0000 7fdaecc26700 1 -- 172.21.15.156:0/872223553 learned_addr learned my addr 172.21.15.156:0/872223553 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:35.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.836+0000 7fdaed427700 1 -- 172.21.15.156:0/872223553 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdae809ad40 msgr2=0x7fdae8139410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:35.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.836+0000 7fdaed427700 1 --2- 172.21.15.156:0/872223553 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdae809ad40 0x7fdae8139410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:35.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.836+0000 7fdaed427700 1 -- 172.21.15.156:0/872223553 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdae8134140 msgr2=0x7fdae8139950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:35.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.836+0000 7fdaed427700 1 --2- 172.21.15.156:0/872223553 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdae8134140 0x7fdae8139950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:35.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.836+0000 7fdaed427700 1 -- 172.21.15.156:0/872223553 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae0009b30 con 0x7fdae81345a0 2023-09-30T22:21:35.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.837+0000 7fdaed427700 1 --2- 172.21.15.156:0/872223553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdae81345a0 0x7fdae8139e90 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fdae80a0830 tx=0x7fdae0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:35.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.837+0000 7fdae57fa700 1 -- 172.21.15.156:0/872223553 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae0003ea0 con 0x7fdae81345a0 2023-09-30T22:21:35.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.837+0000 7fdae57fa700 1 -- 172.21.15.156:0/872223553 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae0004930 con 0x7fdae81345a0 2023-09-30T22:21:35.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.837+0000 7fdaeee8a700 1 -- 172.21.15.156:0/872223553 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae811e9d0 con 0x7fdae81345a0 2023-09-30T22:21:35.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.837+0000 7fdae57fa700 1 -- 172.21.15.156:0/872223553 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae001c650 con 0x7fdae81345a0 2023-09-30T22:21:35.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.837+0000 7fdaeee8a700 1 -- 172.21.15.156:0/872223553 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae80a42a0 con 0x7fdae81345a0 2023-09-30T22:21:35.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.838+0000 7fdae57fa700 1 -- 172.21.15.156:0/872223553 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdae001c7b0 con 0x7fdae81345a0 2023-09-30T22:21:35.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.838+0000 7fdae57fa700 1 -- 172.21.15.156:0/872223553 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdae0041380 con 0x7fdae81345a0 2023-09-30T22:21:35.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.838+0000 7fdaeee8a700 1 -- 172.21.15.156:0/872223553 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae81361e0 con 0x7fdae81345a0 2023-09-30T22:21:35.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.843+0000 7fdae57fa700 1 -- 172.21.15.156:0/872223553 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdae001ca60 con 0x7fdae81345a0 2023-09-30T22:21:35.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.866+0000 7f4b1e438700 1 -- 172.21.15.156:0/968828826 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4b180724c0 con 0x7f4b181314b0 2023-09-30T22:21:35.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.867+0000 7f4b14ff9700 1 -- 172.21.15.156:0/968828826 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b0c02b020 con 0x7f4b181314b0 2023-09-30T22:21:35.866 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:35.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.869+0000 7f4b1e438700 1 -- 172.21.15.156:0/968828826 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b181314b0 msgr2=0x7f4b18136880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:35.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.869+0000 7f4b1e438700 1 --2- 172.21.15.156:0/968828826 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b181314b0 0x7f4b18136880 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0090b0 tx=0x7f4b0c004750 comp rx=0 tx=0).stop 2023-09-30T22:21:35.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.869+0000 7f4b1e438700 1 -- 172.21.15.156:0/968828826 shutdown_connections 2023-09-30T22:21:35.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.869+0000 7f4b1e438700 1 --2- 172.21.15.156:0/968828826 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b18132100 0x7f4b18136dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:35.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.869+0000 7f4b1e438700 1 --2- 172.21.15.156:0/968828826 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b18066410 0x7f4b18136340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:35.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.869+0000 7f4b1e438700 1 --2- 172.21.15.156:0/968828826 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b181314b0 0x7f4b18136880 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:35.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.869+0000 7f4b1e438700 1 -- 172.21.15.156:0/968828826 >> 172.21.15.156:0/968828826 conn(0x7f4b180a2980 msgr2=0x7f4b18070d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:35.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.869+0000 7f4b1e438700 1 -- 172.21.15.156:0/968828826 shutdown_connections 2023-09-30T22:21:35.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.869+0000 7f4b1e438700 1 -- 172.21.15.156:0/968828826 wait complete. 2023-09-30T22:21:35.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.877+0000 7f7927cc3700 1 Processor -- start 2023-09-30T22:21:35.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.878+0000 7f7927cc3700 1 -- start start 2023-09-30T22:21:35.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.878+0000 7f7927cc3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79200a0a70 0x7f79200a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:35.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.878+0000 7f7927cc3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f79200a1380 0x7f7920133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:35.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.878+0000 7f7927cc3700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f792009dc00 con 0x7f7920133f50 2023-09-30T22:21:35.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.878+0000 7f7927cc3700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f792009ea60 con 0x7f79200a1380 2023-09-30T22:21:35.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.878+0000 7f7927cc3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f792009dec0 con 0x7f79200a0a70 2023-09-30T22:21:35.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.878+0000 7f7925a5f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79200a0a70 0x7f79200a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:35.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.878+0000 7f792525e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f79200a1380 0x7f7920133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:35.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.878+0000 7f792525e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f79200a1380 0x7f7920133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50334/0 (socket says 172.21.15.156:50334) 2023-09-30T22:21:35.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.878+0000 7f7925a5f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79200a0a70 0x7f79200a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36320/0 (socket says 172.21.15.156:36320) 2023-09-30T22:21:35.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.878+0000 7f792525e700 1 -- 172.21.15.156:0/3871954768 learned_addr learned my addr 172.21.15.156:0/3871954768 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:35.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.879+0000 7f7925a5f700 1 -- 172.21.15.156:0/3871954768 >> v2:172.21.15.156:3300/0 conn(0x7f79200a1380 msgr2=0x7f7920133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:35.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.879+0000 7f7925a5f700 1 --2- 172.21.15.156:0/3871954768 >> v2:172.21.15.156:3300/0 conn(0x7f79200a1380 0x7f7920133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:35.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.879+0000 7f7925a5f700 1 -- 172.21.15.156:0/3871954768 >> v1:172.21.15.156:6789/0 conn(0x7f7920133f50 legacy=0x7f792013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:35.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.879+0000 7f7925a5f700 1 -- 172.21.15.156:0/3871954768 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792009e6a0 con 0x7f79200a0a70 2023-09-30T22:21:35.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.879+0000 7f792525e700 1 --2- 172.21.15.156:0/3871954768 >> v2:172.21.15.156:3300/0 conn(0x7f79200a1380 0x7f7920133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:35.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.879+0000 7f7925a5f700 1 --2- 172.21.15.156:0/3871954768 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79200a0a70 0x7f79200a0e40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f791c009840 tx=0x7f791c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90e08ed24a016080 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:35.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.879+0000 7f7924a5d700 1 -- 172.21.15.156:0/3871954768 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c011830 con 0x7f79200a0a70 2023-09-30T22:21:35.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.879+0000 7f7924a5d700 1 -- 172.21.15.156:0/3871954768 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791c011990 con 0x7f79200a0a70 2023-09-30T22:21:35.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.879+0000 7f7924a5d700 1 -- 172.21.15.156:0/3871954768 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c011d20 con 0x7f79200a0a70 2023-09-30T22:21:35.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.880+0000 7f7927cc3700 1 -- 172.21.15.156:0/3871954768 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79200a0a70 msgr2=0x7f79200a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:35.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.880+0000 7f7927cc3700 1 --2- 172.21.15.156:0/3871954768 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79200a0a70 0x7f79200a0e40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f791c009840 tx=0x7f791c009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:35.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.880+0000 7f7927cc3700 1 -- 172.21.15.156:0/3871954768 shutdown_connections 2023-09-30T22:21:35.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.880+0000 7f7927cc3700 1 --2- 172.21.15.156:0/3871954768 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79200a0a70 0x7f79200a0e40 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:35.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.880+0000 7f7927cc3700 1 --2- 172.21.15.156:0/3871954768 >> v2:172.21.15.156:3300/0 conn(0x7f79200a1380 0x7f7920133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:35.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.880+0000 7f7927cc3700 1 -- 172.21.15.156:0/3871954768 >> 172.21.15.156:0/3871954768 conn(0x7f79200a6610 msgr2=0x7f79200a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:35.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.880+0000 7f7927cc3700 1 -- 172.21.15.156:0/3871954768 shutdown_connections 2023-09-30T22:21:35.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.880+0000 7f7927cc3700 1 -- 172.21.15.156:0/3871954768 wait complete. 2023-09-30T22:21:35.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.881+0000 7f7927cc3700 1 Processor -- start 2023-09-30T22:21:35.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.881+0000 7f7927cc3700 1 -- start start 2023-09-30T22:21:35.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.881+0000 7f7927cc3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79200a0a70 0x7f79201c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:35.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.881+0000 7f7927cc3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79200a1380 0x7f79201c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:35.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.881+0000 7f7927cc3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7920133f50 0x7f79201c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:35.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.881+0000 7f7927cc3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79201247f0 con 0x7f79200a1380 2023-09-30T22:21:35.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.881+0000 7f7927cc3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7920124600 con 0x7f7920133f50 2023-09-30T22:21:35.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.881+0000 7f7927cc3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79201252e0 con 0x7f79200a0a70 2023-09-30T22:21:35.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.881+0000 7f7925a5f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79200a0a70 0x7f79201c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:35.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.881+0000 7f7925a5f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79200a0a70 0x7f79201c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36326/0 (socket says 172.21.15.156:36326) 2023-09-30T22:21:35.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.881+0000 7f7925a5f700 1 -- 172.21.15.156:0/1428410137 learned_addr learned my addr 172.21.15.156:0/1428410137 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:35.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.881+0000 7f792525e700 1 --2- 172.21.15.156:0/1428410137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79200a1380 0x7f79201c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:35.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.881+0000 7f7926260700 1 --2- 172.21.15.156:0/1428410137 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7920133f50 0x7f79201c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:35.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.882+0000 7f792525e700 1 -- 172.21.15.156:0/1428410137 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79200a0a70 msgr2=0x7f79201c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:35.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.882+0000 7f792525e700 1 --2- 172.21.15.156:0/1428410137 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79200a0a70 0x7f79201c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:35.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.882+0000 7f792525e700 1 -- 172.21.15.156:0/1428410137 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7920133f50 msgr2=0x7f79201c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:35.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.882+0000 7f792525e700 1 --2- 172.21.15.156:0/1428410137 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7920133f50 0x7f79201c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:35.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.882+0000 7f792525e700 1 -- 172.21.15.156:0/1428410137 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7910009550 con 0x7f79200a1380 2023-09-30T22:21:35.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.882+0000 7f792525e700 1 --2- 172.21.15.156:0/1428410137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79200a1380 0x7f79201c8740 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f791000e9a0 tx=0x7f791000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:35.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.882+0000 7f79167fc700 1 -- 172.21.15.156:0/1428410137 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910004240 con 0x7f79200a1380 2023-09-30T22:21:35.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.882+0000 7f79167fc700 1 -- 172.21.15.156:0/1428410137 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79100043a0 con 0x7f79200a1380 2023-09-30T22:21:35.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.882+0000 7f79167fc700 1 -- 172.21.15.156:0/1428410137 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79100036a0 con 0x7f79200a1380 2023-09-30T22:21:35.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.882+0000 7f7927cc3700 1 -- 172.21.15.156:0/1428410137 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f791c0094a0 con 0x7f79200a1380 2023-09-30T22:21:35.886 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:35.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.882+0000 7f7927cc3700 1 -- 172.21.15.156:0/1428410137 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7920133a10 con 0x7f79200a1380 2023-09-30T22:21:35.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.883+0000 7f79167fc700 1 -- 172.21.15.156:0/1428410137 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7910003800 con 0x7f79200a1380 2023-09-30T22:21:35.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.883+0000 7f79167fc700 1 -- 172.21.15.156:0/1428410137 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f791003f900 con 0x7f79200a1380 2023-09-30T22:21:35.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.883+0000 7f7927cc3700 1 -- 172.21.15.156:0/1428410137 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7920125ed0 con 0x7f79200a1380 2023-09-30T22:21:35.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:35.888+0000 7f79167fc700 1 -- 172.21.15.156:0/1428410137 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7920125ed0 con 0x7f79200a1380 2023-09-30T22:21:36.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.038+0000 7fdaeee8a700 1 -- 172.21.15.156:0/872223553 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdae809c7e0 con 0x7fdae81345a0 2023-09-30T22:21:36.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.039+0000 7fdae57fa700 1 -- 172.21.15.156:0/872223553 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdae0011390 con 0x7fdae81345a0 2023-09-30T22:21:36.038 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:36.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.042+0000 7fdaeee8a700 1 -- 172.21.15.156:0/872223553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdae81345a0 msgr2=0x7fdae8139e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:36.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.042+0000 7fdaeee8a700 1 --2- 172.21.15.156:0/872223553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdae81345a0 0x7fdae8139e90 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fdae80a0830 tx=0x7fdae0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:21:36.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.042+0000 7fdaeee8a700 1 -- 172.21.15.156:0/872223553 shutdown_connections 2023-09-30T22:21:36.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.042+0000 7fdaeee8a700 1 --2- 172.21.15.156:0/872223553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdae81345a0 0x7fdae8139e90 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:36.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.042+0000 7fdaeee8a700 1 --2- 172.21.15.156:0/872223553 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdae809ad40 0x7fdae8139410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:36.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.042+0000 7fdaeee8a700 1 --2- 172.21.15.156:0/872223553 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdae8134140 0x7fdae8139950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:36.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.042+0000 7fdaeee8a700 1 -- 172.21.15.156:0/872223553 >> 172.21.15.156:0/872223553 conn(0x7fdae8099c40 msgr2=0x7fdae813b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:36.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.042+0000 7fdaeee8a700 1 -- 172.21.15.156:0/872223553 shutdown_connections 2023-09-30T22:21:36.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.042+0000 7fdaeee8a700 1 -- 172.21.15.156:0/872223553 wait complete. 2023-09-30T22:21:36.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:36.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.083+0000 7f7927cc3700 1 -- 172.21.15.156:0/1428410137 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7920125ed0 con 0x7f79200a1380 2023-09-30T22:21:36.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.083+0000 7f79167fc700 1 -- 172.21.15.156:0/1428410137 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7920125ed0 con 0x7f79200a1380 2023-09-30T22:21:36.083 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:36.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.085+0000 7f7927cc3700 1 -- 172.21.15.156:0/1428410137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79200a1380 msgr2=0x7f79201c8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:36.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.085+0000 7f7927cc3700 1 --2- 172.21.15.156:0/1428410137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79200a1380 0x7f79201c8740 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f791000e9a0 tx=0x7f791000ecb0 comp rx=0 tx=0).stop 2023-09-30T22:21:36.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.085+0000 7f7927cc3700 1 -- 172.21.15.156:0/1428410137 shutdown_connections 2023-09-30T22:21:36.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.085+0000 7f7927cc3700 1 --2- 172.21.15.156:0/1428410137 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7920133f50 0x7f79201c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:36.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.085+0000 7f7927cc3700 1 --2- 172.21.15.156:0/1428410137 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79200a0a70 0x7f79201c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:36.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.085+0000 7f7927cc3700 1 --2- 172.21.15.156:0/1428410137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79200a1380 0x7f79201c8740 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:36.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.085+0000 7f7927cc3700 1 -- 172.21.15.156:0/1428410137 >> 172.21.15.156:0/1428410137 conn(0x7f79200a6610 msgr2=0x7f79200a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:36.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.085+0000 7f7927cc3700 1 -- 172.21.15.156:0/1428410137 shutdown_connections 2023-09-30T22:21:36.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.085+0000 7f7927cc3700 1 -- 172.21.15.156:0/1428410137 wait complete. 2023-09-30T22:21:36.098 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:36.203 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:36.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.326+0000 7fa075b10700 1 Processor -- start 2023-09-30T22:21:36.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.326+0000 7fa075b10700 1 -- start start 2023-09-30T22:21:36.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.327+0000 7fa075b10700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa07009e870 0x7fa07009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:36.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.327+0000 7fa075b10700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa070134330 0x7fa07013be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:36.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.327+0000 7fa075b10700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa07006c6a0 con 0x7fa07009f180 2023-09-30T22:21:36.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.327+0000 7fa075b10700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07006bcd0 con 0x7fa070134330 2023-09-30T22:21:36.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.327+0000 7fa075b10700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa07006bec0 con 0x7fa07009e870 2023-09-30T22:21:36.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.327+0000 7fa06ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa070134330 0x7fa07013be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:36.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.327+0000 7fa06ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa070134330 0x7fa07013be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37068/0 (socket says 172.21.15.156:37068) 2023-09-30T22:21:36.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.327+0000 7fa06ffff700 1 -- 172.21.15.156:0/897348806 learned_addr learned my addr 172.21.15.156:0/897348806 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:36.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.327+0000 7fa06f7fe700 1 --2- 172.21.15.156:0/897348806 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa07009e870 0x7fa07009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:36.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.327+0000 7fa06ffff700 1 -- 172.21.15.156:0/897348806 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa07009e870 msgr2=0x7fa07009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:36.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.327+0000 7fa06ffff700 1 --2- 172.21.15.156:0/897348806 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa07009e870 0x7fa07009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:36.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.327+0000 7fa06ffff700 1 -- 172.21.15.156:0/897348806 >> v1:172.21.15.156:6789/0 conn(0x7fa07009f180 legacy=0x7fa070133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:36.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.327+0000 7fa06ffff700 1 -- 172.21.15.156:0/897348806 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07006c8f0 con 0x7fa070134330 2023-09-30T22:21:36.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.327+0000 7fa06e7fc700 1 -- 172.21.15.156:0/897348806 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 629514338 0 0) 0x7fa07006c6a0 con 0x7fa07009f180 2023-09-30T22:21:36.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.327+0000 7fa06ffff700 1 --2- 172.21.15.156:0/897348806 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa070134330 0x7fa07013be80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa068009e80 tx=0x7fa06800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6844c69d55acafd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:36.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.328+0000 7fa06e7fc700 1 -- 172.21.15.156:0/897348806 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06800e070 con 0x7fa070134330 2023-09-30T22:21:36.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.328+0000 7fa06e7fc700 1 -- 172.21.15.156:0/897348806 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06800b910 con 0x7fa070134330 2023-09-30T22:21:36.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.328+0000 7fa06e7fc700 1 -- 172.21.15.156:0/897348806 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06800bcc0 con 0x7fa070134330 2023-09-30T22:21:36.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.328+0000 7fa075b10700 1 -- 172.21.15.156:0/897348806 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa070134330 msgr2=0x7fa07013be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:36.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.328+0000 7fa075b10700 1 --2- 172.21.15.156:0/897348806 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa070134330 0x7fa07013be80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa068009e80 tx=0x7fa06800b330 comp rx=0 tx=0).stop 2023-09-30T22:21:36.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.328+0000 7fa075b10700 1 -- 172.21.15.156:0/897348806 shutdown_connections 2023-09-30T22:21:36.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.328+0000 7fa075b10700 1 --2- 172.21.15.156:0/897348806 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa070134330 0x7fa07013be80 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:36.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.328+0000 7fa075b10700 1 --2- 172.21.15.156:0/897348806 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa07009e870 0x7fa07009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:36.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.328+0000 7fa075b10700 1 -- 172.21.15.156:0/897348806 >> 172.21.15.156:0/897348806 conn(0x7fa0700a4430 msgr2=0x7fa0700a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:36.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.328+0000 7fa075b10700 1 -- 172.21.15.156:0/897348806 shutdown_connections 2023-09-30T22:21:36.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.328+0000 7fa075b10700 1 -- 172.21.15.156:0/897348806 wait complete. 2023-09-30T22:21:36.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.329+0000 7fa075b10700 1 Processor -- start 2023-09-30T22:21:36.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.329+0000 7fa075b10700 1 -- start start 2023-09-30T22:21:36.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.330+0000 7fa075b10700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa07009e870 0x7fa070122ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:36.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.330+0000 7fa075b10700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa07009f180 0x7fa070123000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:36.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.330+0000 7fa075b10700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa070134330 0x7fa070123540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:36.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.330+0000 7fa075b10700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa070126270 con 0x7fa07009f180 2023-09-30T22:21:36.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.330+0000 7fa075b10700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa070124750 con 0x7fa070134330 2023-09-30T22:21:36.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.330+0000 7fa075b10700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa07006cfa0 con 0x7fa07009e870 2023-09-30T22:21:36.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.330+0000 7fa06effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa07009f180 0x7fa070123000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:36.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.330+0000 7fa06ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa070134330 0x7fa070123540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:36.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.330+0000 7fa06ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa070134330 0x7fa070123540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37076/0 (socket says 172.21.15.156:37076) 2023-09-30T22:21:36.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.330+0000 7fa06ffff700 1 -- 172.21.15.156:0/2363271092 learned_addr learned my addr 172.21.15.156:0/2363271092 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:36.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.330+0000 7fa06effd700 1 --2- 172.21.15.156:0/2363271092 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa07009f180 0x7fa070123000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50364/0 (socket says 172.21.15.156:50364) 2023-09-30T22:21:36.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.330+0000 7fa06f7fe700 1 --2- 172.21.15.156:0/2363271092 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa07009e870 0x7fa070122ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:36.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.330+0000 7fa06ffff700 1 -- 172.21.15.156:0/2363271092 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa07009e870 msgr2=0x7fa070122ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:36.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.330+0000 7fa06ffff700 1 --2- 172.21.15.156:0/2363271092 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa07009e870 0x7fa070122ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:36.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.330+0000 7fa06ffff700 1 -- 172.21.15.156:0/2363271092 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa07009f180 msgr2=0x7fa070123000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:36.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.330+0000 7fa06ffff700 1 --2- 172.21.15.156:0/2363271092 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa07009f180 0x7fa070123000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:36.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.330+0000 7fa06ffff700 1 -- 172.21.15.156:0/2363271092 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa068009b30 con 0x7fa070134330 2023-09-30T22:21:36.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.330+0000 7fa06ffff700 1 --2- 172.21.15.156:0/2363271092 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa070134330 0x7fa070123540 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa06800b680 tx=0x7fa068004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:36.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.330+0000 7fa067fff700 1 -- 172.21.15.156:0/2363271092 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa068004450 con 0x7fa070134330 2023-09-30T22:21:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.330+0000 7fa067fff700 1 -- 172.21.15.156:0/2363271092 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0680045b0 con 0x7fa070134330 2023-09-30T22:21:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.330+0000 7fa067fff700 1 -- 172.21.15.156:0/2363271092 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa068004940 con 0x7fa070134330 2023-09-30T22:21:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.330+0000 7fa075b10700 1 -- 172.21.15.156:0/2363271092 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa07006fc10 con 0x7fa070134330 2023-09-30T22:21:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.330+0000 7fa075b10700 1 -- 172.21.15.156:0/2363271092 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa070126ce0 con 0x7fa070134330 2023-09-30T22:21:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.331+0000 7fa067fff700 1 -- 172.21.15.156:0/2363271092 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa06801c410 con 0x7fa070134330 2023-09-30T22:21:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.331+0000 7fa067fff700 1 -- 172.21.15.156:0/2363271092 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa0680411a0 con 0x7fa070134330 2023-09-30T22:21:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.331+0000 7fa075b10700 1 -- 172.21.15.156:0/2363271092 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa07004f2a0 con 0x7fa070134330 2023-09-30T22:21:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.336+0000 7fa067fff700 1 -- 172.21.15.156:0/2363271092 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa0680117a0 con 0x7fa070134330 2023-09-30T22:21:36.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.519+0000 7fa075b10700 1 -- 172.21.15.156:0/2363271092 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa070072d60 con 0x7fa070134330 2023-09-30T22:21:36.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.519+0000 7fa067fff700 1 -- 172.21.15.156:0/2363271092 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa06802a020 con 0x7fa070134330 2023-09-30T22:21:36.519 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:36.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.521+0000 7fa075b10700 1 -- 172.21.15.156:0/2363271092 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa070134330 msgr2=0x7fa070123540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:36.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.521+0000 7fa075b10700 1 --2- 172.21.15.156:0/2363271092 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa070134330 0x7fa070123540 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa06800b680 tx=0x7fa068004ad0 comp rx=0 tx=0).stop 2023-09-30T22:21:36.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.521+0000 7fa075b10700 1 -- 172.21.15.156:0/2363271092 shutdown_connections 2023-09-30T22:21:36.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.521+0000 7fa075b10700 1 --2- 172.21.15.156:0/2363271092 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa070134330 0x7fa070123540 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:36.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.521+0000 7fa075b10700 1 --2- 172.21.15.156:0/2363271092 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa07009e870 0x7fa070122ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:36.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.521+0000 7fa075b10700 1 --2- 172.21.15.156:0/2363271092 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa07009f180 0x7fa070123000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:36.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.521+0000 7fa075b10700 1 -- 172.21.15.156:0/2363271092 >> 172.21.15.156:0/2363271092 conn(0x7fa0700a4430 msgr2=0x7fa07009d480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:36.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.521+0000 7fa075b10700 1 -- 172.21.15.156:0/2363271092 shutdown_connections 2023-09-30T22:21:36.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:36.521+0000 7fa075b10700 1 -- 172.21.15.156:0/2363271092 wait complete. 2023-09-30T22:21:36.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:36.886 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:37.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.010+0000 7f0e4e860700 1 Processor -- start 2023-09-30T22:21:37.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.010+0000 7f0e4e860700 1 -- start start 2023-09-30T22:21:37.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.010+0000 7f0e4e860700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0e4809ad40 0x7f0e48133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:37.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.010+0000 7f0e4e860700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0e48133f70 0x7f0e481343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:37.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.010+0000 7f0e4e860700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0e480a0a70 0x7f0e480a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:37.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.010+0000 7f0e4e860700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e480a3b60 con 0x7f0e4809ad40 2023-09-30T22:21:37.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.010+0000 7f0e4e860700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e481348e0 con 0x7f0e480a0a70 2023-09-30T22:21:37.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.010+0000 7f0e4e860700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4809b110 con 0x7f0e48133f70 2023-09-30T22:21:37.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.010+0000 7f0e47fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0e4809ad40 0x7f0e48133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:37.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.010+0000 7f0e4cdfd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0e480a0a70 0x7f0e480a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:37.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.010+0000 7f0e477fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0e48133f70 0x7f0e481343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:37.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.010+0000 7f0e47fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0e4809ad40 0x7f0e48133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50366/0 (socket says 172.21.15.156:50366) 2023-09-30T22:21:37.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.010+0000 7f0e4cdfd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0e480a0a70 0x7f0e480a0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37080/0 (socket says 172.21.15.156:37080) 2023-09-30T22:21:37.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.010+0000 7f0e477fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0e48133f70 0x7f0e481343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36360/0 (socket says 172.21.15.156:36360) 2023-09-30T22:21:37.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.010+0000 7f0e47fff700 1 -- 172.21.15.156:0/2167290350 learned_addr learned my addr 172.21.15.156:0/2167290350 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:37.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.011+0000 7f0e47fff700 1 -- 172.21.15.156:0/2167290350 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0e48133f70 msgr2=0x7f0e481343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:37.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.011+0000 7f0e47fff700 1 --2- 172.21.15.156:0/2167290350 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0e48133f70 0x7f0e481343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.011+0000 7f0e47fff700 1 -- 172.21.15.156:0/2167290350 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0e480a0a70 msgr2=0x7f0e480a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:37.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.011+0000 7f0e47fff700 1 --2- 172.21.15.156:0/2167290350 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0e480a0a70 0x7f0e480a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.011+0000 7f0e47fff700 1 -- 172.21.15.156:0/2167290350 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e480a2fa0 con 0x7f0e4809ad40 2023-09-30T22:21:37.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.011+0000 7f0e477fe700 1 --2- 172.21.15.156:0/2167290350 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0e48133f70 0x7f0e481343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:37.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.011+0000 7f0e4cdfd700 1 --2- 172.21.15.156:0/2167290350 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0e480a0a70 0x7f0e480a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:37.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.011+0000 7f0e47fff700 1 --2- 172.21.15.156:0/2167290350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e4809ad40 0x7f0e48133a30 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f0e38009920 tx=0x7f0e38009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93188a8593fcbd84 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:37.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.011+0000 7f0e46ffd700 1 -- 172.21.15.156:0/2167290350 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e38011830 con 0x7f0e4809ad40 2023-09-30T22:21:37.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.011+0000 7f0e46ffd700 1 -- 172.21.15.156:0/2167290350 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e38011990 con 0x7f0e4809ad40 2023-09-30T22:21:37.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.011+0000 7f0e46ffd700 1 -- 172.21.15.156:0/2167290350 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e38011d20 con 0x7f0e4809ad40 2023-09-30T22:21:37.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.011+0000 7f0e4e860700 1 -- 172.21.15.156:0/2167290350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e4809ad40 msgr2=0x7f0e48133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:37.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.011+0000 7f0e4e860700 1 --2- 172.21.15.156:0/2167290350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e4809ad40 0x7f0e48133a30 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f0e38009920 tx=0x7f0e38009c30 comp rx=0 tx=0).stop 2023-09-30T22:21:37.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.011+0000 7f0e4e860700 1 -- 172.21.15.156:0/2167290350 shutdown_connections 2023-09-30T22:21:37.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.011+0000 7f0e4e860700 1 --2- 172.21.15.156:0/2167290350 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0e480a0a70 0x7f0e480a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.011+0000 7f0e4e860700 1 --2- 172.21.15.156:0/2167290350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e4809ad40 0x7f0e48133a30 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.011+0000 7f0e4e860700 1 --2- 172.21.15.156:0/2167290350 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0e48133f70 0x7f0e481343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.011+0000 7f0e4e860700 1 -- 172.21.15.156:0/2167290350 >> 172.21.15.156:0/2167290350 conn(0x7f0e48099c40 msgr2=0x7f0e4806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:37.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.012+0000 7f0e4e860700 1 -- 172.21.15.156:0/2167290350 shutdown_connections 2023-09-30T22:21:37.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.012+0000 7f0e4e860700 1 -- 172.21.15.156:0/2167290350 wait complete. 2023-09-30T22:21:37.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.012+0000 7f0e4e860700 1 Processor -- start 2023-09-30T22:21:37.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.013+0000 7f0e4e860700 1 -- start start 2023-09-30T22:21:37.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.013+0000 7f0e4e860700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0e4809ad40 0x7f0e481213f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:37.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.013+0000 7f0e4e860700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0e480a0a70 0x7f0e48121930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:37.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.013+0000 7f0e4e860700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e48133f70 0x7f0e48121e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:37.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.013+0000 7f0e4e860700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e48124c80 con 0x7f0e48133f70 2023-09-30T22:21:37.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.013+0000 7f0e4e860700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e48122fb0 con 0x7f0e4809ad40 2023-09-30T22:21:37.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.013+0000 7f0e4e860700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e48123e40 con 0x7f0e480a0a70 2023-09-30T22:21:37.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.013+0000 7f0e47fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0e4809ad40 0x7f0e481213f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:37.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.013+0000 7f0e477fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0e480a0a70 0x7f0e48121930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:37.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.013+0000 7f0e47fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0e4809ad40 0x7f0e481213f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37082/0 (socket says 172.21.15.156:37082) 2023-09-30T22:21:37.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.013+0000 7f0e47fff700 1 -- 172.21.15.156:0/4155639350 learned_addr learned my addr 172.21.15.156:0/4155639350 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:37.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.013+0000 7f0e477fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0e480a0a70 0x7f0e48121930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36372/0 (socket says 172.21.15.156:36372) 2023-09-30T22:21:37.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.013+0000 7f0e4cdfd700 1 --2- 172.21.15.156:0/4155639350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e48133f70 0x7f0e48121e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:37.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.013+0000 7f0e477fe700 1 -- 172.21.15.156:0/4155639350 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0e4809ad40 msgr2=0x7f0e481213f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:37.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.013+0000 7f0e477fe700 1 --2- 172.21.15.156:0/4155639350 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0e4809ad40 0x7f0e481213f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.013+0000 7f0e477fe700 1 -- 172.21.15.156:0/4155639350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e48133f70 msgr2=0x7f0e48121e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:37.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.013+0000 7f0e477fe700 1 --2- 172.21.15.156:0/4155639350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e48133f70 0x7f0e48121e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.013+0000 7f0e477fe700 1 -- 172.21.15.156:0/4155639350 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e40009a70 con 0x7f0e480a0a70 2023-09-30T22:21:37.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.013+0000 7f0e47fff700 1 --2- 172.21.15.156:0/4155639350 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0e4809ad40 0x7f0e481213f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:37.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.014+0000 7f0e477fe700 1 --2- 172.21.15.156:0/4155639350 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0e480a0a70 0x7f0e48121930 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0e3000e9e0 tx=0x7f0e3000ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:37.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.014+0000 7f0e44ff9700 1 -- 172.21.15.156:0/4155639350 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3000ee70 con 0x7f0e480a0a70 2023-09-30T22:21:37.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.014+0000 7f0e44ff9700 1 -- 172.21.15.156:0/4155639350 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3000c850 con 0x7f0e480a0a70 2023-09-30T22:21:37.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.014+0000 7f0e44ff9700 1 -- 172.21.15.156:0/4155639350 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3000cc00 con 0x7f0e480a0a70 2023-09-30T22:21:37.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.014+0000 7f0e4e860700 1 -- 172.21.15.156:0/4155639350 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e300094a0 con 0x7f0e480a0a70 2023-09-30T22:21:37.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.014+0000 7f0e4e860700 1 -- 172.21.15.156:0/4155639350 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e38009550 con 0x7f0e480a0a70 2023-09-30T22:21:37.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.014+0000 7f0e44ff9700 1 -- 172.21.15.156:0/4155639350 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0e3000cd60 con 0x7f0e480a0a70 2023-09-30T22:21:37.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.015+0000 7f0e44ff9700 1 -- 172.21.15.156:0/4155639350 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0e3003f700 con 0x7f0e480a0a70 2023-09-30T22:21:37.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.015+0000 7f0e4e860700 1 -- 172.21.15.156:0/4155639350 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e48124200 con 0x7f0e480a0a70 2023-09-30T22:21:37.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.019+0000 7f0e44ff9700 1 -- 172.21.15.156:0/4155639350 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0e300232f0 con 0x7f0e480a0a70 2023-09-30T22:21:37.055 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:37.100 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:37.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.181+0000 7fe838fce700 1 Processor -- start 2023-09-30T22:21:37.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.181+0000 7fe838fce700 1 -- start start 2023-09-30T22:21:37.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.182+0000 7fe838fce700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe83409e950 0x7fe83409ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:37.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.182+0000 7fe838fce700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe8341393c0 0x7fe83413b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:37.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.182+0000 7fe838fce700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe83409ac20 con 0x7fe83409f260 2023-09-30T22:21:37.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.182+0000 7fe838fce700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8340a06c0 con 0x7fe8341393c0 2023-09-30T22:21:37.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.182+0000 7fe838fce700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83409ae90 con 0x7fe83409e950 2023-09-30T22:21:37.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.182+0000 7fe832d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe8341393c0 0x7fe83413b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:37.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.182+0000 7fe832d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe8341393c0 0x7fe83413b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50382/0 (socket says 172.21.15.156:50382) 2023-09-30T22:21:37.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.182+0000 7fe832d9d700 1 -- 172.21.15.156:0/2203359903 learned_addr learned my addr 172.21.15.156:0/2203359903 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:37.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.182+0000 7fe83259c700 1 --2- 172.21.15.156:0/2203359903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe83409e950 0x7fe83409ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:37.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.182+0000 7fe832d9d700 1 -- 172.21.15.156:0/2203359903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe83409e950 msgr2=0x7fe83409ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:37.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.182+0000 7fe832d9d700 1 --2- 172.21.15.156:0/2203359903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe83409e950 0x7fe83409ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.182+0000 7fe832d9d700 1 -- 172.21.15.156:0/2203359903 >> v1:172.21.15.156:6789/0 conn(0x7fe83409f260 legacy=0x7fe834137ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:37.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.182+0000 7fe832d9d700 1 -- 172.21.15.156:0/2203359903 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83406ba00 con 0x7fe8341393c0 2023-09-30T22:21:37.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.182+0000 7fe83159a700 1 -- 172.21.15.156:0/2203359903 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54995753 0 0) 0x7fe83409ac20 con 0x7fe83409f260 2023-09-30T22:21:37.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.183+0000 7fe83259c700 1 --2- 172.21.15.156:0/2203359903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe83409e950 0x7fe83409ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:37.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.183+0000 7fe832d9d700 1 --2- 172.21.15.156:0/2203359903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8341393c0 0x7fe83413b7a0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fe82c009e50 tx=0x7fe82c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9df6137e9547da0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:37.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.183+0000 7fe83159a700 1 -- 172.21.15.156:0/2203359903 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c00e070 con 0x7fe8341393c0 2023-09-30T22:21:37.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.183+0000 7fe83159a700 1 -- 172.21.15.156:0/2203359903 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82c00b910 con 0x7fe8341393c0 2023-09-30T22:21:37.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.183+0000 7fe83159a700 1 -- 172.21.15.156:0/2203359903 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c00bcc0 con 0x7fe8341393c0 2023-09-30T22:21:37.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.183+0000 7fe838fce700 1 -- 172.21.15.156:0/2203359903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8341393c0 msgr2=0x7fe83413b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:37.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.183+0000 7fe838fce700 1 --2- 172.21.15.156:0/2203359903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8341393c0 0x7fe83413b7a0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fe82c009e50 tx=0x7fe82c00b330 comp rx=0 tx=0).stop 2023-09-30T22:21:37.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.183+0000 7fe838fce700 1 -- 172.21.15.156:0/2203359903 shutdown_connections 2023-09-30T22:21:37.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.183+0000 7fe838fce700 1 --2- 172.21.15.156:0/2203359903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8341393c0 0x7fe83413b7a0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.183+0000 7fe838fce700 1 --2- 172.21.15.156:0/2203359903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe83409e950 0x7fe83409ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.183+0000 7fe838fce700 1 -- 172.21.15.156:0/2203359903 >> 172.21.15.156:0/2203359903 conn(0x7fe8340a0f70 msgr2=0x7fe8340a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:37.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.184+0000 7fe838fce700 1 -- 172.21.15.156:0/2203359903 shutdown_connections 2023-09-30T22:21:37.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.184+0000 7fe838fce700 1 -- 172.21.15.156:0/2203359903 wait complete. 2023-09-30T22:21:37.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.185+0000 7fe838fce700 1 Processor -- start 2023-09-30T22:21:37.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.185+0000 7fe838fce700 1 -- start start 2023-09-30T22:21:37.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.185+0000 7fe838fce700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe83409e950 0x7fe834121670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:37.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.185+0000 7fe838fce700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe83409f260 0x7fe834121bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:37.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.185+0000 7fe838fce700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe8341393c0 0x7fe8341220f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:37.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.185+0000 7fe838fce700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe834125190 con 0x7fe83409e950 2023-09-30T22:21:37.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.185+0000 7fe838fce700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8341244d0 con 0x7fe8341393c0 2023-09-30T22:21:37.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.185+0000 7fe838fce700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe83409e080 con 0x7fe83409f260 2023-09-30T22:21:37.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.185+0000 7fe83259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe83409e950 0x7fe834121670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:37.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.185+0000 7fe831d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe83409f260 0x7fe834121bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:37.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.185+0000 7fe83259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe83409e950 0x7fe834121670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50388/0 (socket says 172.21.15.156:50388) 2023-09-30T22:21:37.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.185+0000 7fe83259c700 1 -- 172.21.15.156:0/2375704510 learned_addr learned my addr 172.21.15.156:0/2375704510 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:37.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.185+0000 7fe832d9d700 1 --2- 172.21.15.156:0/2375704510 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe8341393c0 0x7fe8341220f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:37.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.185+0000 7fe83259c700 1 -- 172.21.15.156:0/2375704510 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe83409f260 msgr2=0x7fe834121bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:37.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.185+0000 7fe83259c700 1 --2- 172.21.15.156:0/2375704510 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe83409f260 0x7fe834121bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.185+0000 7fe83259c700 1 -- 172.21.15.156:0/2375704510 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe8341393c0 msgr2=0x7fe8341220f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:37.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.185+0000 7fe83259c700 1 --2- 172.21.15.156:0/2375704510 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe8341393c0 0x7fe8341220f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.185+0000 7fe83259c700 1 -- 172.21.15.156:0/2375704510 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe824009430 con 0x7fe83409e950 2023-09-30T22:21:37.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.186+0000 7fe83259c700 1 --2- 172.21.15.156:0/2375704510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe83409e950 0x7fe834121670 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fe82400ebe0 tx=0x7fe82400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:37.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.186+0000 7fe822ffd700 1 -- 172.21.15.156:0/2375704510 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe824005a20 con 0x7fe83409e950 2023-09-30T22:21:37.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.186+0000 7fe822ffd700 1 -- 172.21.15.156:0/2375704510 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe824005b80 con 0x7fe83409e950 2023-09-30T22:21:37.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.186+0000 7fe838fce700 1 -- 172.21.15.156:0/2375704510 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82c009b30 con 0x7fe83409e950 2023-09-30T22:21:37.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.186+0000 7fe822ffd700 1 -- 172.21.15.156:0/2375704510 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82400c850 con 0x7fe83409e950 2023-09-30T22:21:37.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.186+0000 7fe838fce700 1 -- 172.21.15.156:0/2375704510 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe834124920 con 0x7fe83409e950 2023-09-30T22:21:37.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.187+0000 7fe822ffd700 1 -- 172.21.15.156:0/2375704510 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe82400c9b0 con 0x7fe83409e950 2023-09-30T22:21:37.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.187+0000 7fe822ffd700 1 -- 172.21.15.156:0/2375704510 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe82403faf0 con 0x7fe83409e950 2023-09-30T22:21:37.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.187+0000 7fe838fce700 1 -- 172.21.15.156:0/2375704510 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe83404f2a0 con 0x7fe83409e950 2023-09-30T22:21:37.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.195+0000 7fe822ffd700 1 -- 172.21.15.156:0/2375704510 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe824011ce0 con 0x7fe83409e950 2023-09-30T22:21:37.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.214+0000 7f0e4e860700 1 -- 172.21.15.156:0/4155639350 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0e4811e060 con 0x7f0e480a0a70 2023-09-30T22:21:37.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.215+0000 7f0e44ff9700 1 -- 172.21.15.156:0/4155639350 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0e30011350 con 0x7f0e480a0a70 2023-09-30T22:21:37.215 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:37.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.217+0000 7f0e4e860700 1 -- 172.21.15.156:0/4155639350 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0e480a0a70 msgr2=0x7f0e48121930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:37.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.217+0000 7f0e4e860700 1 --2- 172.21.15.156:0/4155639350 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0e480a0a70 0x7f0e48121930 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0e3000e9e0 tx=0x7f0e3000ecf0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.217+0000 7f0e4e860700 1 -- 172.21.15.156:0/4155639350 shutdown_connections 2023-09-30T22:21:37.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.217+0000 7f0e4e860700 1 --2- 172.21.15.156:0/4155639350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e48133f70 0x7f0e48121e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.217+0000 7f0e4e860700 1 --2- 172.21.15.156:0/4155639350 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0e4809ad40 0x7f0e481213f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.217+0000 7f0e4e860700 1 --2- 172.21.15.156:0/4155639350 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0e480a0a70 0x7f0e48121930 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.217+0000 7f0e4e860700 1 -- 172.21.15.156:0/4155639350 >> 172.21.15.156:0/4155639350 conn(0x7f0e48099c40 msgr2=0x7f0e48133260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:37.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.217+0000 7f0e4e860700 1 -- 172.21.15.156:0/4155639350 shutdown_connections 2023-09-30T22:21:37.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.217+0000 7f0e4e860700 1 -- 172.21.15.156:0/4155639350 wait complete. 2023-09-30T22:21:37.230 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:37.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.230+0000 7f05cab17700 1 Processor -- start 2023-09-30T22:21:37.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.230+0000 7f05cab17700 1 -- start start 2023-09-30T22:21:37.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.230+0000 7f05cab17700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05c412d380 0x7f05c412d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:37.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.230+0000 7f05cab17700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05c4099a60 0x7f05c4099e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:37.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.230+0000 7f05cab17700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f05c409a3d0 0x7f05c4137610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:37.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.230+0000 7f05cab17700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c409bb90 con 0x7f05c409a3d0 2023-09-30T22:21:37.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.230+0000 7f05cab17700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c409c210 con 0x7f05c4099a60 2023-09-30T22:21:37.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.230+0000 7f05cab17700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05c409a870 con 0x7f05c412d380 2023-09-30T22:21:37.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.230+0000 7f05c90b4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f05c409a3d0 0x7f05c4137610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:37.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.230+0000 7f05c3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05c4099a60 0x7f05c4099e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:37.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.230+0000 7f05c88b3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05c412d380 0x7f05c412d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:37.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.231+0000 7f05c90b4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f05c409a3d0 0x7f05c4137610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50394/0 (socket says 172.21.15.156:50394) 2023-09-30T22:21:37.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.231+0000 7f05c88b3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05c412d380 0x7f05c412d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36386/0 (socket says 172.21.15.156:36386) 2023-09-30T22:21:37.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.231+0000 7f05c90b4700 1 -- 172.21.15.156:0/3677344816 learned_addr learned my addr 172.21.15.156:0/3677344816 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:37.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.231+0000 7f05c88b3700 1 -- 172.21.15.156:0/3677344816 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05c4099a60 msgr2=0x7f05c4099e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:37.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.231+0000 7f05c88b3700 1 --2- 172.21.15.156:0/3677344816 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05c4099a60 0x7f05c4099e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.231+0000 7f05c88b3700 1 -- 172.21.15.156:0/3677344816 >> v2:172.21.15.156:3300/0 conn(0x7f05c409a3d0 msgr2=0x7f05c4137610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:37.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.231+0000 7f05c88b3700 1 --2- 172.21.15.156:0/3677344816 >> v2:172.21.15.156:3300/0 conn(0x7f05c409a3d0 0x7f05c4137610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.231+0000 7f05c88b3700 1 -- 172.21.15.156:0/3677344816 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c409ced0 con 0x7f05c412d380 2023-09-30T22:21:37.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.231+0000 7f05c90b4700 1 --2- 172.21.15.156:0/3677344816 >> v2:172.21.15.156:3300/0 conn(0x7f05c409a3d0 0x7f05c4137610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:37.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.231+0000 7f05c88b3700 1 --2- 172.21.15.156:0/3677344816 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05c412d380 0x7f05c412d750 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f05b4009820 tx=0x7f05b4009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f02d2f2f0c387915 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:37.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.231+0000 7f05c37fe700 1 -- 172.21.15.156:0/3677344816 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b4005e30 con 0x7f05c412d380 2023-09-30T22:21:37.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.231+0000 7f05c37fe700 1 -- 172.21.15.156:0/3677344816 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b4006030 con 0x7f05c412d380 2023-09-30T22:21:37.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.231+0000 7f05c37fe700 1 -- 172.21.15.156:0/3677344816 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b40063c0 con 0x7f05c412d380 2023-09-30T22:21:37.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.232+0000 7f05cab17700 1 -- 172.21.15.156:0/3677344816 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05c412d380 msgr2=0x7f05c412d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:37.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.232+0000 7f05cab17700 1 --2- 172.21.15.156:0/3677344816 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05c412d380 0x7f05c412d750 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f05b4009820 tx=0x7f05b4009b30 comp rx=0 tx=0).stop 2023-09-30T22:21:37.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.232+0000 7f05cab17700 1 -- 172.21.15.156:0/3677344816 shutdown_connections 2023-09-30T22:21:37.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.232+0000 7f05cab17700 1 --2- 172.21.15.156:0/3677344816 >> v2:172.21.15.156:3300/0 conn(0x7f05c409a3d0 0x7f05c4137610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.232+0000 7f05cab17700 1 --2- 172.21.15.156:0/3677344816 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05c412d380 0x7f05c412d750 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.232+0000 7f05cab17700 1 --2- 172.21.15.156:0/3677344816 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05c4099a60 0x7f05c4099e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.232+0000 7f05cab17700 1 -- 172.21.15.156:0/3677344816 >> 172.21.15.156:0/3677344816 conn(0x7f05c40a2980 msgr2=0x7f05c40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:37.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.232+0000 7f05cab17700 1 -- 172.21.15.156:0/3677344816 shutdown_connections 2023-09-30T22:21:37.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.232+0000 7f05cab17700 1 -- 172.21.15.156:0/3677344816 wait complete. 2023-09-30T22:21:37.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.233+0000 7f05cab17700 1 Processor -- start 2023-09-30T22:21:37.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.233+0000 7f05cab17700 1 -- start start 2023-09-30T22:21:37.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.234+0000 7f05cab17700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05c4099a60 0x7f05c41196a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:37.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.234+0000 7f05cab17700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05c409a3d0 0x7f05c4119be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:37.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.234+0000 7f05cab17700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05c412d380 0x7f05c411a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:37.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.234+0000 7f05cab17700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c411ab50 con 0x7f05c4099a60 2023-09-30T22:21:37.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.234+0000 7f05cab17700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c411b260 con 0x7f05c409a3d0 2023-09-30T22:21:37.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.234+0000 7f05cab17700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05c411b880 con 0x7f05c412d380 2023-09-30T22:21:37.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.234+0000 7f05c3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05c409a3d0 0x7f05c4119be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:37.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.234+0000 7f05c88b3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05c4099a60 0x7f05c41196a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:37.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.234+0000 7f05c88b3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05c4099a60 0x7f05c41196a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50404/0 (socket says 172.21.15.156:50404) 2023-09-30T22:21:37.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.234+0000 7f05c3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05c409a3d0 0x7f05c4119be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37122/0 (socket says 172.21.15.156:37122) 2023-09-30T22:21:37.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.234+0000 7f05c88b3700 1 -- 172.21.15.156:0/72971564 learned_addr learned my addr 172.21.15.156:0/72971564 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:37.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.234+0000 7f05c90b4700 1 --2- 172.21.15.156:0/72971564 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05c412d380 0x7f05c411a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:37.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.235+0000 7f05c88b3700 1 -- 172.21.15.156:0/72971564 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05c412d380 msgr2=0x7f05c411a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:37.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.235+0000 7f05c88b3700 1 --2- 172.21.15.156:0/72971564 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05c412d380 0x7f05c411a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.235+0000 7f05c88b3700 1 -- 172.21.15.156:0/72971564 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05c409a3d0 msgr2=0x7f05c4119be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:37.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.235+0000 7f05c88b3700 1 --2- 172.21.15.156:0/72971564 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05c409a3d0 0x7f05c4119be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.235+0000 7f05c88b3700 1 -- 172.21.15.156:0/72971564 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc00bd40 con 0x7f05c4099a60 2023-09-30T22:21:37.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.235+0000 7f05c90b4700 1 --2- 172.21.15.156:0/72971564 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05c412d380 0x7f05c411a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:37.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.235+0000 7f05c3fff700 1 --2- 172.21.15.156:0/72971564 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05c409a3d0 0x7f05c4119be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:37.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.235+0000 7f05c88b3700 1 --2- 172.21.15.156:0/72971564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05c4099a60 0x7f05c41196a0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f05b4009b70 tx=0x7f05b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:37.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.235+0000 7f05c17fa700 1 -- 172.21.15.156:0/72971564 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b40063a0 con 0x7f05c4099a60 2023-09-30T22:21:37.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.235+0000 7f05c17fa700 1 -- 172.21.15.156:0/72971564 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b4006500 con 0x7f05c4099a60 2023-09-30T22:21:37.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.235+0000 7f05c17fa700 1 -- 172.21.15.156:0/72971564 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b40068b0 con 0x7f05c4099a60 2023-09-30T22:21:37.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.235+0000 7f05cab17700 1 -- 172.21.15.156:0/72971564 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b4009430 con 0x7f05c4099a60 2023-09-30T22:21:37.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.235+0000 7f05cab17700 1 -- 172.21.15.156:0/72971564 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c411c900 con 0x7f05c4099a60 2023-09-30T22:21:37.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.236+0000 7f05c17fa700 1 -- 172.21.15.156:0/72971564 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f05b4022070 con 0x7f05c4099a60 2023-09-30T22:21:37.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.236+0000 7f05c17fa700 1 -- 172.21.15.156:0/72971564 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f05b4040e20 con 0x7f05c4099a60 2023-09-30T22:21:37.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.236+0000 7f05cab17700 1 -- 172.21.15.156:0/72971564 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c406f730 con 0x7f05c4099a60 2023-09-30T22:21:37.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.241+0000 7f05c17fa700 1 -- 172.21.15.156:0/72971564 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f05b402a030 con 0x7f05c4099a60 2023-09-30T22:21:37.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.391+0000 7fe838fce700 1 -- 172.21.15.156:0/2375704510 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe83406bbe0 con 0x7fe83409e950 2023-09-30T22:21:37.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.391+0000 7fe822ffd700 1 -- 172.21.15.156:0/2375704510 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe824013e60 con 0x7fe83409e950 2023-09-30T22:21:37.391 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:37.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.393+0000 7fe838fce700 1 -- 172.21.15.156:0/2375704510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe83409e950 msgr2=0x7fe834121670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:37.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.393+0000 7fe838fce700 1 --2- 172.21.15.156:0/2375704510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe83409e950 0x7fe834121670 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fe82400ebe0 tx=0x7fe82400eef0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.393+0000 7fe838fce700 1 -- 172.21.15.156:0/2375704510 shutdown_connections 2023-09-30T22:21:37.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.393+0000 7fe838fce700 1 --2- 172.21.15.156:0/2375704510 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe8341393c0 0x7fe8341220f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.393+0000 7fe838fce700 1 --2- 172.21.15.156:0/2375704510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe83409e950 0x7fe834121670 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.393+0000 7fe838fce700 1 --2- 172.21.15.156:0/2375704510 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe83409f260 0x7fe834121bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.393+0000 7fe838fce700 1 -- 172.21.15.156:0/2375704510 >> 172.21.15.156:0/2375704510 conn(0x7fe8340a0f70 msgr2=0x7fe8340a3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:37.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.393+0000 7fe838fce700 1 -- 172.21.15.156:0/2375704510 shutdown_connections 2023-09-30T22:21:37.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.393+0000 7fe838fce700 1 -- 172.21.15.156:0/2375704510 wait complete. 2023-09-30T22:21:37.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:37.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.434+0000 7f05cab17700 1 -- 172.21.15.156:0/72971564 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f05c409eda0 con 0x7f05c4099a60 2023-09-30T22:21:37.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.434+0000 7f05c17fa700 1 -- 172.21.15.156:0/72971564 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f05b4025470 con 0x7f05c4099a60 2023-09-30T22:21:37.434 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:37.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.436+0000 7f05cab17700 1 -- 172.21.15.156:0/72971564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05c4099a60 msgr2=0x7f05c41196a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:37.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.436+0000 7f05cab17700 1 --2- 172.21.15.156:0/72971564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05c4099a60 0x7f05c41196a0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f05b4009b70 tx=0x7f05b4004750 comp rx=0 tx=0).stop 2023-09-30T22:21:37.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.436+0000 7f05cab17700 1 -- 172.21.15.156:0/72971564 shutdown_connections 2023-09-30T22:21:37.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.436+0000 7f05cab17700 1 --2- 172.21.15.156:0/72971564 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05c412d380 0x7f05c411a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.436+0000 7f05cab17700 1 --2- 172.21.15.156:0/72971564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05c4099a60 0x7f05c41196a0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.436+0000 7f05cab17700 1 --2- 172.21.15.156:0/72971564 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05c409a3d0 0x7f05c4119be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.436+0000 7f05cab17700 1 -- 172.21.15.156:0/72971564 >> 172.21.15.156:0/72971564 conn(0x7f05c40a2980 msgr2=0x7f05c4130bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:37.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.436+0000 7f05cab17700 1 -- 172.21.15.156:0/72971564 shutdown_connections 2023-09-30T22:21:37.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.436+0000 7f05cab17700 1 -- 172.21.15.156:0/72971564 wait complete. 2023-09-30T22:21:37.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:37.534 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:37.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.660+0000 7f3e056f5700 1 Processor -- start 2023-09-30T22:21:37.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.660+0000 7f3e056f5700 1 -- start start 2023-09-30T22:21:37.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.661+0000 7f3e056f5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3e000a1570 0x7f3e00138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:37.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.661+0000 7f3e056f5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e001393c0 0x7f3e0013b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:37.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.661+0000 7f3e056f5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e000a1fe0 con 0x7f3e000a0a90 2023-09-30T22:21:37.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.661+0000 7f3e056f5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e000a3aa0 con 0x7f3e000a1570 2023-09-30T22:21:37.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.661+0000 7f3e056f5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0009a540 con 0x7f3e001393c0 2023-09-30T22:21:37.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.661+0000 7f3dfe7fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3e000a1570 0x7f3e00138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:37.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.661+0000 7f3dff7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e001393c0 0x7f3e0013b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:37.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.661+0000 7f3dff7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e001393c0 0x7f3e0013b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36406/0 (socket says 172.21.15.156:36406) 2023-09-30T22:21:37.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.661+0000 7f3dfe7fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3e000a1570 0x7f3e00138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50410/0 (socket says 172.21.15.156:50410) 2023-09-30T22:21:37.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.661+0000 7f3dff7fe700 1 -- 172.21.15.156:0/1456261403 learned_addr learned my addr 172.21.15.156:0/1456261403 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:37.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.661+0000 7f3dfe7fc700 1 -- 172.21.15.156:0/1456261403 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e001393c0 msgr2=0x7f3e0013b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:37.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.661+0000 7f3dfe7fc700 1 --2- 172.21.15.156:0/1456261403 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e001393c0 0x7f3e0013b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.661+0000 7f3dfe7fc700 1 -- 172.21.15.156:0/1456261403 >> v1:172.21.15.156:6789/0 conn(0x7f3e000a0a90 legacy=0x7f3e000a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:37.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.661+0000 7f3dfdffb700 1 -- 172.21.15.156:0/1456261403 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396249884 0 0) 0x7f3e000a1fe0 con 0x7f3e000a0a90 2023-09-30T22:21:37.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.661+0000 7f3dfe7fc700 1 -- 172.21.15.156:0/1456261403 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0009a280 con 0x7f3e000a1570 2023-09-30T22:21:37.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.661+0000 7f3dff7fe700 1 --2- 172.21.15.156:0/1456261403 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e001393c0 0x7f3e0013b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:37.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.662+0000 7f3dfe7fc700 1 --2- 172.21.15.156:0/1456261403 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e000a1570 0x7f3e00138e80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f3df0009840 tx=0x7f3df0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a1493a0317e3ab6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:37.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.662+0000 7f3dfdffb700 1 -- 172.21.15.156:0/1456261403 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df0011830 con 0x7f3e000a1570 2023-09-30T22:21:37.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.662+0000 7f3dfdffb700 1 -- 172.21.15.156:0/1456261403 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df0011990 con 0x7f3e000a1570 2023-09-30T22:21:37.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.662+0000 7f3dfdffb700 1 -- 172.21.15.156:0/1456261403 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df0011d20 con 0x7f3e000a1570 2023-09-30T22:21:37.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.662+0000 7f3e056f5700 1 -- 172.21.15.156:0/1456261403 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e000a1570 msgr2=0x7f3e00138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:37.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.662+0000 7f3e056f5700 1 --2- 172.21.15.156:0/1456261403 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e000a1570 0x7f3e00138e80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f3df0009840 tx=0x7f3df0009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:37.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.662+0000 7f3e056f5700 1 -- 172.21.15.156:0/1456261403 shutdown_connections 2023-09-30T22:21:37.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.662+0000 7f3e056f5700 1 --2- 172.21.15.156:0/1456261403 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e001393c0 0x7f3e0013b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.662+0000 7f3e056f5700 1 --2- 172.21.15.156:0/1456261403 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e000a1570 0x7f3e00138e80 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.662+0000 7f3e056f5700 1 -- 172.21.15.156:0/1456261403 >> 172.21.15.156:0/1456261403 conn(0x7f3e00099c40 msgr2=0x7f3e0006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:37.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.662+0000 7f3e056f5700 1 -- 172.21.15.156:0/1456261403 shutdown_connections 2023-09-30T22:21:37.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.662+0000 7f3e056f5700 1 -- 172.21.15.156:0/1456261403 wait complete. 2023-09-30T22:21:37.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.663+0000 7f3e056f5700 1 Processor -- start 2023-09-30T22:21:37.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.663+0000 7f3e056f5700 1 -- start start 2023-09-30T22:21:37.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.664+0000 7f3e056f5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e000a0a90 0x7f3e001228e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:37.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.664+0000 7f3e056f5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e000a1570 0x7f3e00122e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:37.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.664+0000 7f3e056f5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e001393c0 0x7f3e00123360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:37.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.664+0000 7f3e056f5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e001261b0 con 0x7f3e000a1570 2023-09-30T22:21:37.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.664+0000 7f3e056f5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e00126f90 con 0x7f3e001393c0 2023-09-30T22:21:37.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.664+0000 7f3e056f5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0009c7e0 con 0x7f3e000a0a90 2023-09-30T22:21:37.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.664+0000 7f3dfe7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e000a1570 0x7f3e00122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:37.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.664+0000 7f3dff7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e001393c0 0x7f3e00123360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:37.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.664+0000 7f3dfe7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e000a1570 0x7f3e00122e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50416/0 (socket says 172.21.15.156:50416) 2023-09-30T22:21:37.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.664+0000 7f3dfe7fc700 1 -- 172.21.15.156:0/1137815057 learned_addr learned my addr 172.21.15.156:0/1137815057 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:37.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.664+0000 7f3dfeffd700 1 --2- 172.21.15.156:0/1137815057 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e000a0a90 0x7f3e001228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:37.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.664+0000 7f3dfe7fc700 1 -- 172.21.15.156:0/1137815057 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e000a0a90 msgr2=0x7f3e001228e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:37.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.664+0000 7f3dfe7fc700 1 --2- 172.21.15.156:0/1137815057 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e000a0a90 0x7f3e001228e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.664+0000 7f3dfe7fc700 1 -- 172.21.15.156:0/1137815057 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e001393c0 msgr2=0x7f3e00123360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:37.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.664+0000 7f3dfe7fc700 1 --2- 172.21.15.156:0/1137815057 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e001393c0 0x7f3e00123360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.664+0000 7f3dfe7fc700 1 -- 172.21.15.156:0/1137815057 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df8009b30 con 0x7f3e000a1570 2023-09-30T22:21:37.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.664+0000 7f3dff7fe700 1 --2- 172.21.15.156:0/1137815057 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e001393c0 0x7f3e00123360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:37.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.664+0000 7f3dfe7fc700 1 --2- 172.21.15.156:0/1137815057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e000a1570 0x7f3e00122e20 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f3df0009fd0 tx=0x7f3df0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:37.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.664+0000 7f3de77fe700 1 -- 172.21.15.156:0/1137815057 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df00036a0 con 0x7f3e000a1570 2023-09-30T22:21:37.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.664+0000 7f3de77fe700 1 -- 172.21.15.156:0/1137815057 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df001f070 con 0x7f3e000a1570 2023-09-30T22:21:37.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.664+0000 7f3e056f5700 1 -- 172.21.15.156:0/1137815057 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df00094a0 con 0x7f3e000a1570 2023-09-30T22:21:37.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.665+0000 7f3de77fe700 1 -- 172.21.15.156:0/1137815057 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df0003a60 con 0x7f3e000a1570 2023-09-30T22:21:37.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.665+0000 7f3e056f5700 1 -- 172.21.15.156:0/1137815057 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e0009b130 con 0x7f3e000a1570 2023-09-30T22:21:37.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.665+0000 7f3de77fe700 1 -- 172.21.15.156:0/1137815057 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3df0003bc0 con 0x7f3e000a1570 2023-09-30T22:21:37.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.665+0000 7f3de77fe700 1 -- 172.21.15.156:0/1137815057 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3df0021070 con 0x7f3e000a1570 2023-09-30T22:21:37.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.665+0000 7f3e056f5700 1 -- 172.21.15.156:0/1137815057 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e0004f2a0 con 0x7f3e000a1570 2023-09-30T22:21:37.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.670+0000 7f3de77fe700 1 -- 172.21.15.156:0/1137815057 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3df0015020 con 0x7f3e000a1570 2023-09-30T22:21:37.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.854+0000 7f3e056f5700 1 -- 172.21.15.156:0/1137815057 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3e00125a30 con 0x7f3e000a1570 2023-09-30T22:21:37.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.855+0000 7f3de77fe700 1 -- 172.21.15.156:0/1137815057 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3df00253e0 con 0x7f3e000a1570 2023-09-30T22:21:37.854 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:37.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.856+0000 7f3e056f5700 1 -- 172.21.15.156:0/1137815057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e000a1570 msgr2=0x7f3e00122e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:37.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.856+0000 7f3e056f5700 1 --2- 172.21.15.156:0/1137815057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e000a1570 0x7f3e00122e20 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f3df0009fd0 tx=0x7f3df0004750 comp rx=0 tx=0).stop 2023-09-30T22:21:37.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.857+0000 7f3e056f5700 1 -- 172.21.15.156:0/1137815057 shutdown_connections 2023-09-30T22:21:37.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.857+0000 7f3e056f5700 1 --2- 172.21.15.156:0/1137815057 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e001393c0 0x7f3e00123360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.857+0000 7f3e056f5700 1 --2- 172.21.15.156:0/1137815057 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e000a0a90 0x7f3e001228e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.857+0000 7f3e056f5700 1 --2- 172.21.15.156:0/1137815057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e000a1570 0x7f3e00122e20 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:37.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.857+0000 7f3e056f5700 1 -- 172.21.15.156:0/1137815057 >> 172.21.15.156:0/1137815057 conn(0x7f3e00099c40 msgr2=0x7f3e0011c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:37.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.857+0000 7f3e056f5700 1 -- 172.21.15.156:0/1137815057 shutdown_connections 2023-09-30T22:21:37.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:37.857+0000 7f3e056f5700 1 -- 172.21.15.156:0/1137815057 wait complete. 2023-09-30T22:21:37.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:38.231 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:38.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.356+0000 7f800919b700 1 Processor -- start 2023-09-30T22:21:38.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.356+0000 7f800919b700 1 -- start start 2023-09-30T22:21:38.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.356+0000 7f800919b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f800409d860 0x7f800409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:38.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.356+0000 7f800919b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8004130eb0 0x7f8004138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:38.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.356+0000 7f800919b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f800409aaa0 con 0x7f800409e170 2023-09-30T22:21:38.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.356+0000 7f800919b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800409f870 con 0x7f8004130eb0 2023-09-30T22:21:38.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.356+0000 7f800919b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f800409b360 con 0x7f800409d860 2023-09-30T22:21:38.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.356+0000 7f8002d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f800409d860 0x7f800409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:38.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.356+0000 7f800259c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f800409e170 0x7f80041307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47720/0 (socket says 172.21.15.156:47720) 2023-09-30T22:21:38.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.356+0000 7f800259c700 1 -- 172.21.15.156:0/186137454 learned_addr learned my addr 172.21.15.156:0/186137454 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:38.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.356+0000 7f800359e700 1 --2- 172.21.15.156:0/186137454 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8004130eb0 0x7f8004138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:38.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.357+0000 7f8001d9b700 1 -- 172.21.15.156:0/186137454 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638040283 0 0) 0x7f800409aaa0 con 0x7f800409e170 2023-09-30T22:21:38.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.357+0000 7f8001d9b700 1 -- 172.21.15.156:0/186137454 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fec0035b0 con 0x7f800409e170 2023-09-30T22:21:38.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.357+0000 7f8002d9d700 1 -- 172.21.15.156:0/186137454 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8004130eb0 msgr2=0x7f8004138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:38.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.357+0000 7f8002d9d700 1 --2- 172.21.15.156:0/186137454 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8004130eb0 0x7f8004138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.357+0000 7f8002d9d700 1 -- 172.21.15.156:0/186137454 >> v1:172.21.15.156:6789/0 conn(0x7f800409e170 legacy=0x7f80041307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:38.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.357+0000 7f8002d9d700 1 -- 172.21.15.156:0/186137454 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800409b620 con 0x7f800409d860 2023-09-30T22:21:38.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.357+0000 7f800359e700 1 --2- 172.21.15.156:0/186137454 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8004130eb0 0x7f8004138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:38.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.357+0000 7f8002d9d700 1 --2- 172.21.15.156:0/186137454 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f800409d860 0x7f800409dc30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400bb10 tx=0x7f7ff400be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38b58a96ca66121e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:38.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.357+0000 7f8001d9b700 1 -- 172.21.15.156:0/186137454 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff400dc70 con 0x7f800409d860 2023-09-30T22:21:38.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.357+0000 7f8001d9b700 1 -- 172.21.15.156:0/186137454 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff400ddd0 con 0x7f800409d860 2023-09-30T22:21:38.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.357+0000 7f8001d9b700 1 -- 172.21.15.156:0/186137454 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4010670 con 0x7f800409d860 2023-09-30T22:21:38.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.357+0000 7f800919b700 1 -- 172.21.15.156:0/186137454 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f800409d860 msgr2=0x7f800409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:38.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.357+0000 7f800919b700 1 --2- 172.21.15.156:0/186137454 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f800409d860 0x7f800409dc30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400bb10 tx=0x7f7ff400be20 comp rx=0 tx=0).stop 2023-09-30T22:21:38.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.357+0000 7f800919b700 1 -- 172.21.15.156:0/186137454 shutdown_connections 2023-09-30T22:21:38.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.357+0000 7f800919b700 1 --2- 172.21.15.156:0/186137454 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8004130eb0 0x7f8004138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.357+0000 7f800919b700 1 --2- 172.21.15.156:0/186137454 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f800409d860 0x7f800409dc30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.358+0000 7f800919b700 1 -- 172.21.15.156:0/186137454 >> 172.21.15.156:0/186137454 conn(0x7f8004099c40 msgr2=0x7f80040a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:38.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.358+0000 7f800919b700 1 -- 172.21.15.156:0/186137454 shutdown_connections 2023-09-30T22:21:38.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.358+0000 7f800919b700 1 -- 172.21.15.156:0/186137454 wait complete. 2023-09-30T22:21:38.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.359+0000 7f800919b700 1 Processor -- start 2023-09-30T22:21:38.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.359+0000 7f800919b700 1 -- start start 2023-09-30T22:21:38.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.359+0000 7f800919b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f800409d860 0x7f8004122650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:38.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.359+0000 7f800919b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f800409e170 0x7f8004122b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:38.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.359+0000 7f800919b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8004130eb0 0x7f80041230d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:38.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.359+0000 7f800919b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8004123b20 con 0x7f8004130eb0 2023-09-30T22:21:38.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.359+0000 7f800919b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8004125e90 con 0x7f800409d860 2023-09-30T22:21:38.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.359+0000 7f800919b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8004124370 con 0x7f800409e170 2023-09-30T22:21:38.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.359+0000 7f800259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f800409e170 0x7f8004122b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:38.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.359+0000 7f8002d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f800409d860 0x7f8004122650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:38.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.359+0000 7f8002d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f800409d860 0x7f8004122650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37146/0 (socket says 172.21.15.156:37146) 2023-09-30T22:21:38.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.359+0000 7f800259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f800409e170 0x7f8004122b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36448/0 (socket says 172.21.15.156:36448) 2023-09-30T22:21:38.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.359+0000 7f8002d9d700 1 -- 172.21.15.156:0/2621091069 learned_addr learned my addr 172.21.15.156:0/2621091069 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:38.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.359+0000 7f800359e700 1 --2- 172.21.15.156:0/2621091069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8004130eb0 0x7f80041230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:38.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.360+0000 7f8002d9d700 1 -- 172.21.15.156:0/2621091069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f800409e170 msgr2=0x7f8004122b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:38.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.360+0000 7f8002d9d700 1 --2- 172.21.15.156:0/2621091069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f800409e170 0x7f8004122b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.360+0000 7f8002d9d700 1 -- 172.21.15.156:0/2621091069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8004130eb0 msgr2=0x7f80041230d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:38.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.360+0000 7f8002d9d700 1 --2- 172.21.15.156:0/2621091069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8004130eb0 0x7f80041230d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.360+0000 7f8002d9d700 1 -- 172.21.15.156:0/2621091069 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ffc009a70 con 0x7f800409d860 2023-09-30T22:21:38.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.360+0000 7f800359e700 1 --2- 172.21.15.156:0/2621091069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8004130eb0 0x7f80041230d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:38.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.360+0000 7f8002d9d700 1 --2- 172.21.15.156:0/2621091069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f800409d860 0x7f8004122650 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400b2c0 tx=0x7f7ff4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:38.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.360+0000 7f7feb7fe700 1 -- 172.21.15.156:0/2621091069 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff401d070 con 0x7f800409d860 2023-09-30T22:21:38.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.360+0000 7f7feb7fe700 1 -- 172.21.15.156:0/2621091069 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff4006ab0 con 0x7f800409d860 2023-09-30T22:21:38.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.360+0000 7f800919b700 1 -- 172.21.15.156:0/2621091069 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff400b740 con 0x7f800409d860 2023-09-30T22:21:38.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.360+0000 7f7feb7fe700 1 -- 172.21.15.156:0/2621091069 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff40038e0 con 0x7f800409d860 2023-09-30T22:21:38.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.360+0000 7f800919b700 1 -- 172.21.15.156:0/2621091069 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8004124a20 con 0x7f800409d860 2023-09-30T22:21:38.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.361+0000 7f7feb7fe700 1 -- 172.21.15.156:0/2621091069 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ff4021070 con 0x7f800409d860 2023-09-30T22:21:38.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.361+0000 7f7feb7fe700 1 -- 172.21.15.156:0/2621091069 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7ff40401f0 con 0x7f800409d860 2023-09-30T22:21:38.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.361+0000 7f800919b700 1 -- 172.21.15.156:0/2621091069 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f800404f2a0 con 0x7f800409d860 2023-09-30T22:21:38.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.366+0000 7f7feb7fe700 1 -- 172.21.15.156:0/2621091069 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ff4003a40 con 0x7f800409d860 2023-09-30T22:21:38.406 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:38.448 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:38.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.535+0000 7fb71dc3d700 1 Processor -- start 2023-09-30T22:21:38.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.535+0000 7fb71dc3d700 1 -- start start 2023-09-30T22:21:38.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.536+0000 7fb71dc3d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb718133ad0 0x7fb718133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:38.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.536+0000 7fb71dc3d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb718130bc0 0x7fb71813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:38.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.536+0000 7fb71dc3d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb71806b2d0 con 0x7fb7181300a0 2023-09-30T22:21:38.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.536+0000 7fb71dc3d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb718133610 con 0x7fb718130bc0 2023-09-30T22:21:38.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.536+0000 7fb71dc3d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb71809a500 con 0x7fb718133ad0 2023-09-30T22:21:38.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.536+0000 7fb717fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb718130bc0 0x7fb71813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:38.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.536+0000 7fb717fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb718130bc0 0x7fb71813b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37148/0 (socket says 172.21.15.156:37148) 2023-09-30T22:21:38.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.536+0000 7fb717fff700 1 -- 172.21.15.156:0/3099880504 learned_addr learned my addr 172.21.15.156:0/3099880504 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:38.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.536+0000 7fb716ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb7181300a0 0x7fb7181304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47736/0 (socket says 172.21.15.156:47736) 2023-09-30T22:21:38.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.536+0000 7fb7177fe700 1 --2- 172.21.15.156:0/3099880504 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb718133ad0 0x7fb718133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:38.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.536+0000 7fb7177fe700 1 -- 172.21.15.156:0/3099880504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb718130bc0 msgr2=0x7fb71813b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:38.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.536+0000 7fb7177fe700 1 --2- 172.21.15.156:0/3099880504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb718130bc0 0x7fb71813b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.536+0000 7fb7177fe700 1 -- 172.21.15.156:0/3099880504 >> v1:172.21.15.156:6789/0 conn(0x7fb7181300a0 legacy=0x7fb7181304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:38.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.536+0000 7fb7167fc700 1 -- 172.21.15.156:0/3099880504 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984243195 0 0) 0x7fb71806b2d0 con 0x7fb7181300a0 2023-09-30T22:21:38.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.536+0000 7fb7177fe700 1 -- 172.21.15.156:0/3099880504 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7181338b0 con 0x7fb718133ad0 2023-09-30T22:21:38.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.536+0000 7fb717fff700 1 --2- 172.21.15.156:0/3099880504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb718130bc0 0x7fb71813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:38.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.536+0000 7fb7177fe700 1 --2- 172.21.15.156:0/3099880504 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb718133ad0 0x7fb718133ea0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb708009870 tx=0x7fb708009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e39dbb4f82758f18 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:38.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.537+0000 7fb7167fc700 1 -- 172.21.15.156:0/3099880504 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb708011830 con 0x7fb718133ad0 2023-09-30T22:21:38.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.537+0000 7fb7167fc700 1 -- 172.21.15.156:0/3099880504 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb708011990 con 0x7fb718133ad0 2023-09-30T22:21:38.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.537+0000 7fb7167fc700 1 -- 172.21.15.156:0/3099880504 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb708011d20 con 0x7fb718133ad0 2023-09-30T22:21:38.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.537+0000 7fb71dc3d700 1 -- 172.21.15.156:0/3099880504 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb718133ad0 msgr2=0x7fb718133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:38.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.537+0000 7fb71dc3d700 1 --2- 172.21.15.156:0/3099880504 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb718133ad0 0x7fb718133ea0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb708009870 tx=0x7fb708009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:38.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.537+0000 7fb71dc3d700 1 -- 172.21.15.156:0/3099880504 shutdown_connections 2023-09-30T22:21:38.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.537+0000 7fb71dc3d700 1 --2- 172.21.15.156:0/3099880504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb718130bc0 0x7fb71813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.537+0000 7fb71dc3d700 1 --2- 172.21.15.156:0/3099880504 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb718133ad0 0x7fb718133ea0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.537+0000 7fb71dc3d700 1 -- 172.21.15.156:0/3099880504 >> 172.21.15.156:0/3099880504 conn(0x7fb718099c40 msgr2=0x7fb7180a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:38.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.537+0000 7fb71dc3d700 1 -- 172.21.15.156:0/3099880504 shutdown_connections 2023-09-30T22:21:38.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.537+0000 7fb71dc3d700 1 -- 172.21.15.156:0/3099880504 wait complete. 2023-09-30T22:21:38.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.538+0000 7fb71dc3d700 1 Processor -- start 2023-09-30T22:21:38.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.538+0000 7fb71dc3d700 1 -- start start 2023-09-30T22:21:38.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.539+0000 7fb71dc3d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7181300a0 0x7fb71811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:38.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.539+0000 7fb71dc3d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb718130bc0 0x7fb71811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:38.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.539+0000 7fb71dc3d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb718133ad0 0x7fb71811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:38.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.539+0000 7fb71dc3d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb718120950 con 0x7fb718133ad0 2023-09-30T22:21:38.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.539+0000 7fb71dc3d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71812d930 con 0x7fb7181300a0 2023-09-30T22:21:38.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.539+0000 7fb71dc3d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb71811fd00 con 0x7fb718130bc0 2023-09-30T22:21:38.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.539+0000 7fb7177fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7181300a0 0x7fb71811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:38.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.539+0000 7fb7177fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7181300a0 0x7fb71811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37154/0 (socket says 172.21.15.156:37154) 2023-09-30T22:21:38.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.539+0000 7fb7177fe700 1 -- 172.21.15.156:0/1555220591 learned_addr learned my addr 172.21.15.156:0/1555220591 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:38.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.539+0000 7fb716ffd700 1 --2- 172.21.15.156:0/1555220591 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb718130bc0 0x7fb71811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:38.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.539+0000 7fb717fff700 1 --2- 172.21.15.156:0/1555220591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb718133ad0 0x7fb71811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:38.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.539+0000 7fb716ffd700 1 -- 172.21.15.156:0/1555220591 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7181300a0 msgr2=0x7fb71811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:38.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.539+0000 7fb716ffd700 1 --2- 172.21.15.156:0/1555220591 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7181300a0 0x7fb71811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.539+0000 7fb716ffd700 1 -- 172.21.15.156:0/1555220591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb718133ad0 msgr2=0x7fb71811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:38.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.539+0000 7fb716ffd700 1 --2- 172.21.15.156:0/1555220591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb718133ad0 0x7fb71811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.539+0000 7fb716ffd700 1 -- 172.21.15.156:0/1555220591 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb710009b30 con 0x7fb718130bc0 2023-09-30T22:21:38.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.539+0000 7fb7177fe700 1 --2- 172.21.15.156:0/1555220591 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7181300a0 0x7fb71811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:38.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.539+0000 7fb717fff700 1 --2- 172.21.15.156:0/1555220591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb718133ad0 0x7fb71811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:38.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.540+0000 7fb716ffd700 1 --2- 172.21.15.156:0/1555220591 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb718130bc0 0x7fb71811df80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb71809ea20 tx=0x7fb70c00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:38.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.540+0000 7fb6fffff700 1 -- 172.21.15.156:0/1555220591 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c004a70 con 0x7fb718130bc0 2023-09-30T22:21:38.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.540+0000 7fb6fffff700 1 -- 172.21.15.156:0/1555220591 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70c004bd0 con 0x7fb718130bc0 2023-09-30T22:21:38.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.540+0000 7fb71dc3d700 1 -- 172.21.15.156:0/1555220591 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7080094a0 con 0x7fb718130bc0 2023-09-30T22:21:38.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.540+0000 7fb6fffff700 1 -- 172.21.15.156:0/1555220591 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c0070d0 con 0x7fb718130bc0 2023-09-30T22:21:38.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.540+0000 7fb71dc3d700 1 -- 172.21.15.156:0/1555220591 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb71811fa90 con 0x7fb718130bc0 2023-09-30T22:21:38.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.541+0000 7fb6fffff700 1 -- 172.21.15.156:0/1555220591 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb70c007230 con 0x7fb718130bc0 2023-09-30T22:21:38.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.541+0000 7fb6fffff700 1 -- 172.21.15.156:0/1555220591 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb70c03f170 con 0x7fb718130bc0 2023-09-30T22:21:38.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.541+0000 7fb71dc3d700 1 -- 172.21.15.156:0/1555220591 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71804f2a0 con 0x7fb718130bc0 2023-09-30T22:21:38.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.546+0000 7fb6fffff700 1 -- 172.21.15.156:0/1555220591 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb70c0074e0 con 0x7fb718130bc0 2023-09-30T22:21:38.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.570+0000 7f800919b700 1 -- 172.21.15.156:0/2621091069 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f800406c3b0 con 0x7f800409d860 2023-09-30T22:21:38.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.570+0000 7f7feb7fe700 1 -- 172.21.15.156:0/2621091069 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7ff4028020 con 0x7f800409d860 2023-09-30T22:21:38.570 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:38.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.572+0000 7f800919b700 1 -- 172.21.15.156:0/2621091069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f800409d860 msgr2=0x7f8004122650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:38.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.572+0000 7f800919b700 1 --2- 172.21.15.156:0/2621091069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f800409d860 0x7f8004122650 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400b2c0 tx=0x7f7ff4004750 comp rx=0 tx=0).stop 2023-09-30T22:21:38.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.572+0000 7f800919b700 1 -- 172.21.15.156:0/2621091069 shutdown_connections 2023-09-30T22:21:38.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.572+0000 7f800919b700 1 --2- 172.21.15.156:0/2621091069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8004130eb0 0x7f80041230d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.572+0000 7f800919b700 1 --2- 172.21.15.156:0/2621091069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f800409d860 0x7f8004122650 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.572+0000 7f800919b700 1 --2- 172.21.15.156:0/2621091069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f800409e170 0x7f8004122b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.572+0000 7f800919b700 1 -- 172.21.15.156:0/2621091069 >> 172.21.15.156:0/2621091069 conn(0x7f8004099c40 msgr2=0x7f80040a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:38.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.572+0000 7f800919b700 1 -- 172.21.15.156:0/2621091069 shutdown_connections 2023-09-30T22:21:38.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.572+0000 7f800919b700 1 -- 172.21.15.156:0/2621091069 wait complete. 2023-09-30T22:21:38.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.578+0000 7fe71607f700 1 Processor -- start 2023-09-30T22:21:38.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.578+0000 7fe71607f700 1 -- start start 2023-09-30T22:21:38.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.579+0000 7fe71607f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe71009f350 0x7fe710136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:38.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.579+0000 7fe71607f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe7101371c0 0x7fe7101395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:38.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.579+0000 7fe71607f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe71009c970 con 0x7fe71009e870 2023-09-30T22:21:38.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.579+0000 7fe71607f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7100a0920 con 0x7fe7101371c0 2023-09-30T22:21:38.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.579+0000 7fe71607f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe71009f9c0 con 0x7fe71009f350 2023-09-30T22:21:38.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.579+0000 7fe70ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe7101371c0 0x7fe7101395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:38.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.579+0000 7fe706ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe71009f350 0x7fe710136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:38.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.579+0000 7fe70ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe7101371c0 0x7fe7101395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50442/0 (socket says 172.21.15.156:50442) 2023-09-30T22:21:38.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.579+0000 7fe70ffff700 1 -- 172.21.15.156:0/3591423735 learned_addr learned my addr 172.21.15.156:0/3591423735 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:38.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.579+0000 7fe70ffff700 1 -- 172.21.15.156:0/3591423735 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe71009f350 msgr2=0x7fe710136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:38.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.579+0000 7fe70ffff700 1 --2- 172.21.15.156:0/3591423735 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe71009f350 0x7fe710136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.579+0000 7fe70ffff700 1 -- 172.21.15.156:0/3591423735 >> v1:172.21.15.156:6789/0 conn(0x7fe71009e870 legacy=0x7fe71009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:38.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.579+0000 7fe70ffff700 1 -- 172.21.15.156:0/3591423735 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71009bab0 con 0x7fe7101371c0 2023-09-30T22:21:38.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.580+0000 7fe706ffd700 1 --2- 172.21.15.156:0/3591423735 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe71009f350 0x7fe710136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:38.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.580+0000 7fe70ffff700 1 --2- 172.21.15.156:0/3591423735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7101371c0 0x7fe7101395a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fe708009e50 tx=0x7fe70800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897bad1a0756b015 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:38.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.580+0000 7fe70effd700 1 -- 172.21.15.156:0/3591423735 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70800e070 con 0x7fe7101371c0 2023-09-30T22:21:38.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.580+0000 7fe70effd700 1 -- 172.21.15.156:0/3591423735 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70800b910 con 0x7fe7101371c0 2023-09-30T22:21:38.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.580+0000 7fe70effd700 1 -- 172.21.15.156:0/3591423735 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70800bcc0 con 0x7fe7101371c0 2023-09-30T22:21:38.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.581+0000 7fe71607f700 1 -- 172.21.15.156:0/3591423735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7101371c0 msgr2=0x7fe7101395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:38.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.581+0000 7fe71607f700 1 --2- 172.21.15.156:0/3591423735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7101371c0 0x7fe7101395a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fe708009e50 tx=0x7fe70800b330 comp rx=0 tx=0).stop 2023-09-30T22:21:38.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.581+0000 7fe71607f700 1 -- 172.21.15.156:0/3591423735 shutdown_connections 2023-09-30T22:21:38.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.581+0000 7fe71607f700 1 --2- 172.21.15.156:0/3591423735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7101371c0 0x7fe7101395a0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.581+0000 7fe71607f700 1 --2- 172.21.15.156:0/3591423735 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe71009f350 0x7fe710136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.581+0000 7fe71607f700 1 -- 172.21.15.156:0/3591423735 >> 172.21.15.156:0/3591423735 conn(0x7fe7100a4430 msgr2=0x7fe7100a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:38.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.581+0000 7fe71607f700 1 -- 172.21.15.156:0/3591423735 shutdown_connections 2023-09-30T22:21:38.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.581+0000 7fe71607f700 1 -- 172.21.15.156:0/3591423735 wait complete. 2023-09-30T22:21:38.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.582+0000 7fe71607f700 1 Processor -- start 2023-09-30T22:21:38.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.582+0000 7fe71607f700 1 -- start start 2023-09-30T22:21:38.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.582+0000 7fe71607f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe71009e870 0x7fe71011f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:38.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.582+0000 7fe71607f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe71009f350 0x7fe71011fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:38.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.582+0000 7fe71607f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe7101371c0 0x7fe710120000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:38.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.582+0000 7fe71607f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe710121190 con 0x7fe71009e870 2023-09-30T22:21:38.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.582+0000 7fe71607f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe710135470 con 0x7fe7101371c0 2023-09-30T22:21:38.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.582+0000 7fe71607f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe710072380 con 0x7fe71009f350 2023-09-30T22:21:38.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.582+0000 7fe70f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe71009e870 0x7fe71011f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:38.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.582+0000 7fe70f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe71009e870 0x7fe71011f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50448/0 (socket says 172.21.15.156:50448) 2023-09-30T22:21:38.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.582+0000 7fe70f7fe700 1 -- 172.21.15.156:0/2339650803 learned_addr learned my addr 172.21.15.156:0/2339650803 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:38.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.582+0000 7fe70ffff700 1 --2- 172.21.15.156:0/2339650803 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe7101371c0 0x7fe710120000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:38.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.582+0000 7fe706ffd700 1 --2- 172.21.15.156:0/2339650803 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe71009f350 0x7fe71011fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:38.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.583+0000 7fe70f7fe700 1 -- 172.21.15.156:0/2339650803 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe71009f350 msgr2=0x7fe71011fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:38.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.583+0000 7fe70f7fe700 1 --2- 172.21.15.156:0/2339650803 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe71009f350 0x7fe71011fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.583+0000 7fe70f7fe700 1 -- 172.21.15.156:0/2339650803 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe7101371c0 msgr2=0x7fe710120000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:38.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.583+0000 7fe70f7fe700 1 --2- 172.21.15.156:0/2339650803 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe7101371c0 0x7fe710120000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.583+0000 7fe70f7fe700 1 -- 172.21.15.156:0/2339650803 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f80094a0 con 0x7fe71009e870 2023-09-30T22:21:38.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.583+0000 7fe70ffff700 1 --2- 172.21.15.156:0/2339650803 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe7101371c0 0x7fe710120000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:38.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.583+0000 7fe70f7fe700 1 --2- 172.21.15.156:0/2339650803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe71009e870 0x7fe71011f580 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe70000c4e0 tx=0x7fe70000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:38.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.583+0000 7fe70cff9700 1 -- 172.21.15.156:0/2339650803 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7000052d0 con 0x7fe71009e870 2023-09-30T22:21:38.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.583+0000 7fe70cff9700 1 -- 172.21.15.156:0/2339650803 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe700005430 con 0x7fe71009e870 2023-09-30T22:21:38.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.583+0000 7fe71607f700 1 -- 172.21.15.156:0/2339650803 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe708009b30 con 0x7fe71009e870 2023-09-30T22:21:38.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.583+0000 7fe70cff9700 1 -- 172.21.15.156:0/2339650803 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7000038c0 con 0x7fe71009e870 2023-09-30T22:21:38.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.583+0000 7fe71607f700 1 -- 172.21.15.156:0/2339650803 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7101219f0 con 0x7fe71009e870 2023-09-30T22:21:38.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.584+0000 7fe70cff9700 1 -- 172.21.15.156:0/2339650803 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe700003a20 con 0x7fe71009e870 2023-09-30T22:21:38.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.584+0000 7fe71607f700 1 -- 172.21.15.156:0/2339650803 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe71009dba0 con 0x7fe71009e870 2023-09-30T22:21:38.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.584+0000 7fe70cff9700 1 -- 172.21.15.156:0/2339650803 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe70003ea30 con 0x7fe71009e870 2023-09-30T22:21:38.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:38.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.589+0000 7fe70cff9700 1 -- 172.21.15.156:0/2339650803 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe700019e60 con 0x7fe71009e870 2023-09-30T22:21:38.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.742+0000 7fb71dc3d700 1 -- 172.21.15.156:0/1555220591 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb71806c3b0 con 0x7fb718130bc0 2023-09-30T22:21:38.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.743+0000 7fb6fffff700 1 -- 172.21.15.156:0/1555220591 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb70c01b340 con 0x7fb718130bc0 2023-09-30T22:21:38.742 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:38.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.744+0000 7fb71dc3d700 1 -- 172.21.15.156:0/1555220591 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb718130bc0 msgr2=0x7fb71811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:38.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.744+0000 7fb71dc3d700 1 --2- 172.21.15.156:0/1555220591 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb718130bc0 0x7fb71811df80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb71809ea20 tx=0x7fb70c00c6a0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.745+0000 7fb71dc3d700 1 -- 172.21.15.156:0/1555220591 shutdown_connections 2023-09-30T22:21:38.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.745+0000 7fb71dc3d700 1 --2- 172.21.15.156:0/1555220591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb718133ad0 0x7fb71811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.745+0000 7fb71dc3d700 1 --2- 172.21.15.156:0/1555220591 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7181300a0 0x7fb71811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.745+0000 7fb71dc3d700 1 --2- 172.21.15.156:0/1555220591 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb718130bc0 0x7fb71811df80 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.745+0000 7fb71dc3d700 1 -- 172.21.15.156:0/1555220591 >> 172.21.15.156:0/1555220591 conn(0x7fb718099c40 msgr2=0x7fb71812e620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:38.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.745+0000 7fb71dc3d700 1 -- 172.21.15.156:0/1555220591 shutdown_connections 2023-09-30T22:21:38.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.745+0000 7fb71dc3d700 1 -- 172.21.15.156:0/1555220591 wait complete. 2023-09-30T22:21:38.756 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:38.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.780+0000 7fe71607f700 1 -- 172.21.15.156:0/2339650803 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe71004f2a0 con 0x7fe71009e870 2023-09-30T22:21:38.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.781+0000 7fe70cff9700 1 -- 172.21.15.156:0/2339650803 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe700017030 con 0x7fe71009e870 2023-09-30T22:21:38.780 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:38.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.783+0000 7fe71607f700 1 -- 172.21.15.156:0/2339650803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe71009e870 msgr2=0x7fe71011f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:38.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.783+0000 7fe71607f700 1 --2- 172.21.15.156:0/2339650803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe71009e870 0x7fe71011f580 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe70000c4e0 tx=0x7fe70000c7f0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.783+0000 7fe71607f700 1 -- 172.21.15.156:0/2339650803 shutdown_connections 2023-09-30T22:21:38.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.783+0000 7fe71607f700 1 --2- 172.21.15.156:0/2339650803 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe7101371c0 0x7fe710120000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.783+0000 7fe71607f700 1 --2- 172.21.15.156:0/2339650803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe71009e870 0x7fe71011f580 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.783+0000 7fe71607f700 1 --2- 172.21.15.156:0/2339650803 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe71009f350 0x7fe71011fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.783+0000 7fe71607f700 1 -- 172.21.15.156:0/2339650803 >> 172.21.15.156:0/2339650803 conn(0x7fe7100a4430 msgr2=0x7fe71009cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:38.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.783+0000 7fe71607f700 1 -- 172.21.15.156:0/2339650803 shutdown_connections 2023-09-30T22:21:38.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.783+0000 7fe71607f700 1 -- 172.21.15.156:0/2339650803 wait complete. 2023-09-30T22:21:38.794 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:38.869 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:38.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.991+0000 7fd4514f4700 1 Processor -- start 2023-09-30T22:21:38.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.991+0000 7fd4514f4700 1 -- start start 2023-09-30T22:21:38.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.992+0000 7fd4514f4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd44c132e70 0x7fd44c135250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:38.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.992+0000 7fd4514f4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd44c135790 0x7fd44c137b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:38.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.992+0000 7fd4514f4700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd44c09a540 con 0x7fd44c12feb0 2023-09-30T22:21:38.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.992+0000 7fd4514f4700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd44c09ad40 con 0x7fd44c135790 2023-09-30T22:21:38.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.992+0000 7fd4514f4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c09e640 con 0x7fd44c132e70 2023-09-30T22:21:38.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.992+0000 7fd44a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd44c132e70 0x7fd44c135250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:38.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.992+0000 7fd44a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd44c132e70 0x7fd44c135250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36484/0 (socket says 172.21.15.156:36484) 2023-09-30T22:21:38.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.992+0000 7fd44a7fc700 1 -- 172.21.15.156:0/3826452289 learned_addr learned my addr 172.21.15.156:0/3826452289 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:38.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.992+0000 7fd44b7fe700 1 --2- 172.21.15.156:0/3826452289 >> v2:172.21.15.156:3300/0 conn(0x7fd44c135790 0x7fd44c137b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:38.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.992+0000 7fd44b7fe700 1 -- 172.21.15.156:0/3826452289 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd44c132e70 msgr2=0x7fd44c135250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:38.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.992+0000 7fd44b7fe700 1 --2- 172.21.15.156:0/3826452289 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd44c132e70 0x7fd44c135250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.992+0000 7fd44b7fe700 1 -- 172.21.15.156:0/3826452289 >> v1:172.21.15.156:6789/0 conn(0x7fd44c12feb0 legacy=0x7fd44c130280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:38.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.992+0000 7fd44b7fe700 1 -- 172.21.15.156:0/3826452289 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44c09e3c0 con 0x7fd44c135790 2023-09-30T22:21:38.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.992+0000 7fd44a7fc700 1 --2- 172.21.15.156:0/3826452289 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd44c132e70 0x7fd44c135250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:38.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.992+0000 7fd44b7fe700 1 --2- 172.21.15.156:0/3826452289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd44c135790 0x7fd44c137b70 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fd444009d90 tx=0x7fd44400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521b3c9bac16f8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:38.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.993+0000 7fd449ffb700 1 -- 172.21.15.156:0/3826452289 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44400e070 con 0x7fd44c135790 2023-09-30T22:21:38.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.993+0000 7fd449ffb700 1 -- 172.21.15.156:0/3826452289 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44400bb20 con 0x7fd44c135790 2023-09-30T22:21:38.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.993+0000 7fd449ffb700 1 -- 172.21.15.156:0/3826452289 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd444012430 con 0x7fd44c135790 2023-09-30T22:21:38.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.993+0000 7fd4514f4700 1 -- 172.21.15.156:0/3826452289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd44c135790 msgr2=0x7fd44c137b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:38.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.993+0000 7fd4514f4700 1 --2- 172.21.15.156:0/3826452289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd44c135790 0x7fd44c137b70 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fd444009d90 tx=0x7fd44400b330 comp rx=0 tx=0).stop 2023-09-30T22:21:38.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.993+0000 7fd4514f4700 1 -- 172.21.15.156:0/3826452289 shutdown_connections 2023-09-30T22:21:38.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.993+0000 7fd4514f4700 1 --2- 172.21.15.156:0/3826452289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd44c135790 0x7fd44c137b70 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.993+0000 7fd4514f4700 1 --2- 172.21.15.156:0/3826452289 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd44c132e70 0x7fd44c135250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.993+0000 7fd4514f4700 1 -- 172.21.15.156:0/3826452289 >> 172.21.15.156:0/3826452289 conn(0x7fd44c0a2b30 msgr2=0x7fd44c09e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:38.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.993+0000 7fd4514f4700 1 -- 172.21.15.156:0/3826452289 shutdown_connections 2023-09-30T22:21:38.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.993+0000 7fd4514f4700 1 -- 172.21.15.156:0/3826452289 wait complete. 2023-09-30T22:21:38.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.994+0000 7fd4514f4700 1 Processor -- start 2023-09-30T22:21:38.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.994+0000 7fd4514f4700 1 -- start start 2023-09-30T22:21:38.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.995+0000 7fd4514f4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd44c12feb0 0x7fd44c129e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:38.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.995+0000 7fd4514f4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd44c132e70 0x7fd44c12a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:38.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.995+0000 7fd4514f4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd44c135790 0x7fd44c12a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:38.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.995+0000 7fd4514f4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c12ceb0 con 0x7fd44c12feb0 2023-09-30T22:21:38.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.995+0000 7fd4514f4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c12bed0 con 0x7fd44c135790 2023-09-30T22:21:38.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.995+0000 7fd4514f4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c12c710 con 0x7fd44c132e70 2023-09-30T22:21:38.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.995+0000 7fd44a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd44c132e70 0x7fd44c12a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:38.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.995+0000 7fd44affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd44c12feb0 0x7fd44c129e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:38.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.995+0000 7fd44b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd44c135790 0x7fd44c12a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:38.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.995+0000 7fd44a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd44c132e70 0x7fd44c12a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36492/0 (socket says 172.21.15.156:36492) 2023-09-30T22:21:38.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.995+0000 7fd44a7fc700 1 -- 172.21.15.156:0/1393555439 learned_addr learned my addr 172.21.15.156:0/1393555439 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:38.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.995+0000 7fd44a7fc700 1 -- 172.21.15.156:0/1393555439 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd44c135790 msgr2=0x7fd44c12a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:38.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.995+0000 7fd44a7fc700 1 --2- 172.21.15.156:0/1393555439 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd44c135790 0x7fd44c12a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.995+0000 7fd44a7fc700 1 -- 172.21.15.156:0/1393555439 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd44c12feb0 msgr2=0x7fd44c129e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:38.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.995+0000 7fd44a7fc700 1 --2- 172.21.15.156:0/1393555439 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd44c12feb0 0x7fd44c129e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:38.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.995+0000 7fd44a7fc700 1 -- 172.21.15.156:0/1393555439 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c00b7f0 con 0x7fd44c132e70 2023-09-30T22:21:38.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.995+0000 7fd44a7fc700 1 --2- 172.21.15.156:0/1393555439 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd44c132e70 0x7fd44c12a3a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00ed70 tx=0x7fd43c00d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:38.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.995+0000 7fd4437fe700 1 -- 172.21.15.156:0/1393555439 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c00ee60 con 0x7fd44c132e70 2023-09-30T22:21:38.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.995+0000 7fd4437fe700 1 -- 172.21.15.156:0/1393555439 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43c010440 con 0x7fd44c132e70 2023-09-30T22:21:38.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.995+0000 7fd4514f4700 1 -- 172.21.15.156:0/1393555439 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd444009a70 con 0x7fd44c132e70 2023-09-30T22:21:38.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.995+0000 7fd4437fe700 1 -- 172.21.15.156:0/1393555439 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c0107f0 con 0x7fd44c132e70 2023-09-30T22:21:38.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.996+0000 7fd4514f4700 1 -- 172.21.15.156:0/1393555439 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd44c1355d0 con 0x7fd44c132e70 2023-09-30T22:21:38.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.996+0000 7fd4437fe700 1 -- 172.21.15.156:0/1393555439 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd43c010950 con 0x7fd44c132e70 2023-09-30T22:21:38.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.996+0000 7fd4437fe700 1 -- 172.21.15.156:0/1393555439 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd43c03fd90 con 0x7fd44c132e70 2023-09-30T22:21:38.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:38.996+0000 7fd4514f4700 1 -- 172.21.15.156:0/1393555439 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd44c127170 con 0x7fd44c132e70 2023-09-30T22:21:39.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.001+0000 7fd4437fe700 1 -- 172.21.15.156:0/1393555439 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd43c018400 con 0x7fd44c132e70 2023-09-30T22:21:39.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.183+0000 7fd4514f4700 1 -- 172.21.15.156:0/1393555439 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd44c04f2a0 con 0x7fd44c132e70 2023-09-30T22:21:39.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.184+0000 7fd4437fe700 1 -- 172.21.15.156:0/1393555439 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd43c026030 con 0x7fd44c132e70 2023-09-30T22:21:39.183 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:39.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.186+0000 7fd4514f4700 1 -- 172.21.15.156:0/1393555439 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd44c132e70 msgr2=0x7fd44c12a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:39.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.186+0000 7fd4514f4700 1 --2- 172.21.15.156:0/1393555439 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd44c132e70 0x7fd44c12a3a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00ed70 tx=0x7fd43c00d630 comp rx=0 tx=0).stop 2023-09-30T22:21:39.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.186+0000 7fd4514f4700 1 -- 172.21.15.156:0/1393555439 shutdown_connections 2023-09-30T22:21:39.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.186+0000 7fd4514f4700 1 --2- 172.21.15.156:0/1393555439 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd44c135790 0x7fd44c12a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:39.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.186+0000 7fd4514f4700 1 --2- 172.21.15.156:0/1393555439 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd44c12feb0 0x7fd44c129e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:39.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.186+0000 7fd4514f4700 1 --2- 172.21.15.156:0/1393555439 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd44c132e70 0x7fd44c12a3a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:39.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.186+0000 7fd4514f4700 1 -- 172.21.15.156:0/1393555439 >> 172.21.15.156:0/1393555439 conn(0x7fd44c0a2b30 msgr2=0x7fd44c09c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:39.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.186+0000 7fd4514f4700 1 -- 172.21.15.156:0/1393555439 shutdown_connections 2023-09-30T22:21:39.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.186+0000 7fd4514f4700 1 -- 172.21.15.156:0/1393555439 wait complete. 2023-09-30T22:21:39.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:39.589 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:39.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.711+0000 7fec43ae3700 1 Processor -- start 2023-09-30T22:21:39.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.711+0000 7fec43ae3700 1 -- start start 2023-09-30T22:21:39.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.712+0000 7fec43ae3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec3c09e870 0x7fec3c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:39.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.712+0000 7fec43ae3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fec3c09f180 0x7fec3c133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:39.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.712+0000 7fec43ae3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fec3c134160 0x7fec3c134600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:39.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.712+0000 7fec43ae3700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec3c0a0370 con 0x7fec3c134160 2023-09-30T22:21:39.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.712+0000 7fec43ae3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c09fa00 con 0x7fec3c09f180 2023-09-30T22:21:39.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.712+0000 7fec43ae3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c09ada0 con 0x7fec3c09e870 2023-09-30T22:21:39.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.712+0000 7fec4187f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec3c09e870 0x7fec3c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:39.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.712+0000 7fec42080700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fec3c134160 0x7fec3c134600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:39.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.712+0000 7fec4187f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec3c09e870 0x7fec3c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36496/0 (socket says 172.21.15.156:36496) 2023-09-30T22:21:39.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.712+0000 7fec4107e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fec3c09f180 0x7fec3c133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:39.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.712+0000 7fec4187f700 1 -- 172.21.15.156:0/1496182115 learned_addr learned my addr 172.21.15.156:0/1496182115 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:39.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.712+0000 7fec4187f700 1 -- 172.21.15.156:0/1496182115 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fec3c09f180 msgr2=0x7fec3c133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:39.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.712+0000 7fec4187f700 1 --2- 172.21.15.156:0/1496182115 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fec3c09f180 0x7fec3c133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:39.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.712+0000 7fec4187f700 1 -- 172.21.15.156:0/1496182115 >> v2:172.21.15.156:3300/0 conn(0x7fec3c134160 msgr2=0x7fec3c134600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:39.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.712+0000 7fec4187f700 1 --2- 172.21.15.156:0/1496182115 >> v2:172.21.15.156:3300/0 conn(0x7fec3c134160 0x7fec3c134600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:39.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.712+0000 7fec4187f700 1 -- 172.21.15.156:0/1496182115 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec3c06bec0 con 0x7fec3c09e870 2023-09-30T22:21:39.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.712+0000 7fec4107e700 1 --2- 172.21.15.156:0/1496182115 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fec3c09f180 0x7fec3c133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:39.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.712+0000 7fec42080700 1 --2- 172.21.15.156:0/1496182115 >> v2:172.21.15.156:3300/0 conn(0x7fec3c134160 0x7fec3c134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:39.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.712+0000 7fec4187f700 1 --2- 172.21.15.156:0/1496182115 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec3c09e870 0x7fec3c09ec40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fec2c009920 tx=0x7fec2c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9ec4f564aede10 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:39.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.713+0000 7fec4087d700 1 -- 172.21.15.156:0/1496182115 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c011830 con 0x7fec3c09e870 2023-09-30T22:21:39.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.713+0000 7fec4087d700 1 -- 172.21.15.156:0/1496182115 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec2c011990 con 0x7fec3c09e870 2023-09-30T22:21:39.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.713+0000 7fec4087d700 1 -- 172.21.15.156:0/1496182115 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c011d20 con 0x7fec3c09e870 2023-09-30T22:21:39.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.713+0000 7fec43ae3700 1 -- 172.21.15.156:0/1496182115 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec3c09e870 msgr2=0x7fec3c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:39.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.713+0000 7fec43ae3700 1 --2- 172.21.15.156:0/1496182115 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec3c09e870 0x7fec3c09ec40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fec2c009920 tx=0x7fec2c009c30 comp rx=0 tx=0).stop 2023-09-30T22:21:39.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.713+0000 7fec43ae3700 1 -- 172.21.15.156:0/1496182115 shutdown_connections 2023-09-30T22:21:39.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.713+0000 7fec43ae3700 1 --2- 172.21.15.156:0/1496182115 >> v2:172.21.15.156:3300/0 conn(0x7fec3c134160 0x7fec3c134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:39.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.713+0000 7fec43ae3700 1 --2- 172.21.15.156:0/1496182115 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec3c09e870 0x7fec3c09ec40 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:39.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.713+0000 7fec43ae3700 1 --2- 172.21.15.156:0/1496182115 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fec3c09f180 0x7fec3c133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:39.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.713+0000 7fec43ae3700 1 -- 172.21.15.156:0/1496182115 >> 172.21.15.156:0/1496182115 conn(0x7fec3c0a4430 msgr2=0x7fec3c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:39.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.713+0000 7fec43ae3700 1 -- 172.21.15.156:0/1496182115 shutdown_connections 2023-09-30T22:21:39.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.713+0000 7fec43ae3700 1 -- 172.21.15.156:0/1496182115 wait complete. 2023-09-30T22:21:39.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.714+0000 7fec43ae3700 1 Processor -- start 2023-09-30T22:21:39.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.714+0000 7fec43ae3700 1 -- start start 2023-09-30T22:21:39.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.715+0000 7fec43ae3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec3c09e870 0x7fec3c122530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:39.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.715+0000 7fec43ae3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fec3c09f180 0x7fec3c122a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:39.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.715+0000 7fec43ae3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec3c134160 0x7fec3c122fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:39.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.715+0000 7fec43ae3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c133900 con 0x7fec3c134160 2023-09-30T22:21:39.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.715+0000 7fec43ae3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c123990 con 0x7fec3c09f180 2023-09-30T22:21:39.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.715+0000 7fec43ae3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c124fd0 con 0x7fec3c09e870 2023-09-30T22:21:39.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.715+0000 7fec4107e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fec3c09f180 0x7fec3c122a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:39.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.715+0000 7fec42080700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec3c134160 0x7fec3c122fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:39.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.715+0000 7fec4187f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec3c09e870 0x7fec3c122530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:39.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.715+0000 7fec4107e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fec3c09f180 0x7fec3c122a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37188/0 (socket says 172.21.15.156:37188) 2023-09-30T22:21:39.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.715+0000 7fec4107e700 1 -- 172.21.15.156:0/1573979723 learned_addr learned my addr 172.21.15.156:0/1573979723 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:39.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.715+0000 7fec42080700 1 -- 172.21.15.156:0/1573979723 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec3c09e870 msgr2=0x7fec3c122530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:39.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.715+0000 7fec42080700 1 --2- 172.21.15.156:0/1573979723 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec3c09e870 0x7fec3c122530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:39.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.715+0000 7fec42080700 1 -- 172.21.15.156:0/1573979723 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fec3c09f180 msgr2=0x7fec3c122a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:39.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.715+0000 7fec42080700 1 --2- 172.21.15.156:0/1573979723 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fec3c09f180 0x7fec3c122a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:39.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.715+0000 7fec42080700 1 -- 172.21.15.156:0/1573979723 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec380094a0 con 0x7fec3c134160 2023-09-30T22:21:39.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.715+0000 7fec4187f700 1 --2- 172.21.15.156:0/1573979723 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec3c09e870 0x7fec3c122530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:39.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.715+0000 7fec42080700 1 --2- 172.21.15.156:0/1573979723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec3c134160 0x7fec3c122fb0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fec34009e50 tx=0x7fec3400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:39.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.715+0000 7fec327fc700 1 -- 172.21.15.156:0/1573979723 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3400ca90 con 0x7fec3c134160 2023-09-30T22:21:39.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.715+0000 7fec327fc700 1 -- 172.21.15.156:0/1573979723 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3400f040 con 0x7fec3c134160 2023-09-30T22:21:39.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.715+0000 7fec43ae3700 1 -- 172.21.15.156:0/1573979723 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec34009a70 con 0x7fec3c134160 2023-09-30T22:21:39.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.715+0000 7fec327fc700 1 -- 172.21.15.156:0/1573979723 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3400ce50 con 0x7fec3c134160 2023-09-30T22:21:39.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.715+0000 7fec43ae3700 1 -- 172.21.15.156:0/1573979723 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2c009550 con 0x7fec3c134160 2023-09-30T22:21:39.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.716+0000 7fec327fc700 1 -- 172.21.15.156:0/1573979723 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fec34014480 con 0x7fec3c134160 2023-09-30T22:21:39.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.716+0000 7fec327fc700 1 -- 172.21.15.156:0/1573979723 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fec3403fbe0 con 0x7fec3c134160 2023-09-30T22:21:39.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.716+0000 7fec43ae3700 1 -- 172.21.15.156:0/1573979723 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec3c06cfa0 con 0x7fec3c134160 2023-09-30T22:21:39.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.721+0000 7fec327fc700 1 -- 172.21.15.156:0/1573979723 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fec34012520 con 0x7fec3c134160 2023-09-30T22:21:39.757 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:39.795 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:39.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.883+0000 7fe3dd7f5700 1 Processor -- start 2023-09-30T22:21:39.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.884+0000 7fe3dd7f5700 1 -- start start 2023-09-30T22:21:39.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.884+0000 7fe3dd7f5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe3d809e870 0x7fe3d809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:39.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.884+0000 7fe3dd7f5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3d809f180 0x7fe3d8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:39.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.884+0000 7fe3dd7f5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d809c970 con 0x7fe3d8131d70 2023-09-30T22:21:39.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.884+0000 7fe3dd7f5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d80a0920 con 0x7fe3d809f180 2023-09-30T22:21:39.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.884+0000 7fe3dd7f5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d809f9c0 con 0x7fe3d809e870 2023-09-30T22:21:39.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.884+0000 7fe3d67fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3d809f180 0x7fe3d8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:39.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.884+0000 7fe3d67fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3d809f180 0x7fe3d8131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37202/0 (socket says 172.21.15.156:37202) 2023-09-30T22:21:39.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.884+0000 7fe3d67fc700 1 -- 172.21.15.156:0/3559403979 learned_addr learned my addr 172.21.15.156:0/3559403979 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:39.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.884+0000 7fe3d77fe700 1 --1- 172.21.15.156:0/3559403979 >> v1:172.21.15.156:6789/0 conn(0x7fe3d8131d70 0x7fe3d8138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47776/0 (socket says 172.21.15.156:47776) 2023-09-30T22:21:39.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.884+0000 7fe3d6ffd700 1 --2- 172.21.15.156:0/3559403979 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe3d809e870 0x7fe3d809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:39.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.885+0000 7fe3d67fc700 1 -- 172.21.15.156:0/3559403979 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe3d809e870 msgr2=0x7fe3d809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:39.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.885+0000 7fe3d67fc700 1 --2- 172.21.15.156:0/3559403979 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe3d809e870 0x7fe3d809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:39.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.885+0000 7fe3d67fc700 1 -- 172.21.15.156:0/3559403979 >> v1:172.21.15.156:6789/0 conn(0x7fe3d8131d70 legacy=0x7fe3d8138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:39.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.885+0000 7fe3d5ffb700 1 -- 172.21.15.156:0/3559403979 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4030350000 0 0) 0x7fe3d809c970 con 0x7fe3d8131d70 2023-09-30T22:21:39.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.885+0000 7fe3d67fc700 1 -- 172.21.15.156:0/3559403979 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d809bab0 con 0x7fe3d809f180 2023-09-30T22:21:39.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.885+0000 7fe3d6ffd700 1 --2- 172.21.15.156:0/3559403979 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe3d809e870 0x7fe3d809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:39.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.885+0000 7fe3d67fc700 1 --2- 172.21.15.156:0/3559403979 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3d809f180 0x7fe3d8131830 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc009920 tx=0x7fe3cc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e241596cd7c3bdf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:39.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.885+0000 7fe3d5ffb700 1 -- 172.21.15.156:0/3559403979 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc011830 con 0x7fe3d809f180 2023-09-30T22:21:39.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.885+0000 7fe3d5ffb700 1 -- 172.21.15.156:0/3559403979 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3cc011990 con 0x7fe3d809f180 2023-09-30T22:21:39.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.885+0000 7fe3d5ffb700 1 -- 172.21.15.156:0/3559403979 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc011d20 con 0x7fe3d809f180 2023-09-30T22:21:39.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.885+0000 7fe3dd7f5700 1 -- 172.21.15.156:0/3559403979 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3d809f180 msgr2=0x7fe3d8131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:39.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.885+0000 7fe3dd7f5700 1 --2- 172.21.15.156:0/3559403979 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3d809f180 0x7fe3d8131830 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc009920 tx=0x7fe3cc009c30 comp rx=0 tx=0).stop 2023-09-30T22:21:39.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.885+0000 7fe3dd7f5700 1 -- 172.21.15.156:0/3559403979 shutdown_connections 2023-09-30T22:21:39.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.885+0000 7fe3dd7f5700 1 --2- 172.21.15.156:0/3559403979 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe3d809e870 0x7fe3d809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:39.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.885+0000 7fe3dd7f5700 1 --2- 172.21.15.156:0/3559403979 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3d809f180 0x7fe3d8131830 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:39.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.885+0000 7fe3dd7f5700 1 -- 172.21.15.156:0/3559403979 >> 172.21.15.156:0/3559403979 conn(0x7fe3d80a4430 msgr2=0x7fe3d80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:39.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.886+0000 7fe3dd7f5700 1 -- 172.21.15.156:0/3559403979 shutdown_connections 2023-09-30T22:21:39.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.886+0000 7fe3dd7f5700 1 -- 172.21.15.156:0/3559403979 wait complete. 2023-09-30T22:21:39.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.887+0000 7fe3dd7f5700 1 Processor -- start 2023-09-30T22:21:39.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.887+0000 7fe3dd7f5700 1 -- start start 2023-09-30T22:21:39.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.887+0000 7fe3dd7f5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3d809e870 0x7fe3d811f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:39.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.887+0000 7fe3dd7f5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3d809f180 0x7fe3d811f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:39.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.887+0000 7fe3dd7f5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe3d8131d70 0x7fe3d811fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:39.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.887+0000 7fe3dd7f5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d8120cf0 con 0x7fe3d809e870 2023-09-30T22:21:39.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.887+0000 7fe3dd7f5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d8121b80 con 0x7fe3d809f180 2023-09-30T22:21:39.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.887+0000 7fe3dd7f5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d8122660 con 0x7fe3d8131d70 2023-09-30T22:21:39.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.887+0000 7fe3d67fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3d809f180 0x7fe3d811f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:39.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.887+0000 7fe3d67fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3d809f180 0x7fe3d811f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37212/0 (socket says 172.21.15.156:37212) 2023-09-30T22:21:39.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.887+0000 7fe3d6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3d809e870 0x7fe3d811f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:39.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.887+0000 7fe3d67fc700 1 -- 172.21.15.156:0/659952690 learned_addr learned my addr 172.21.15.156:0/659952690 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:39.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.887+0000 7fe3d77fe700 1 --2- 172.21.15.156:0/659952690 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe3d8131d70 0x7fe3d811fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:39.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.887+0000 7fe3d67fc700 1 -- 172.21.15.156:0/659952690 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe3d8131d70 msgr2=0x7fe3d811fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:39.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.887+0000 7fe3d67fc700 1 --2- 172.21.15.156:0/659952690 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe3d8131d70 0x7fe3d811fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:39.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.887+0000 7fe3d67fc700 1 -- 172.21.15.156:0/659952690 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3d809e870 msgr2=0x7fe3d811f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:39.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.887+0000 7fe3d67fc700 1 --2- 172.21.15.156:0/659952690 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3d809e870 0x7fe3d811f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:39.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.887+0000 7fe3d67fc700 1 -- 172.21.15.156:0/659952690 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c80094a0 con 0x7fe3d809f180 2023-09-30T22:21:39.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.888+0000 7fe3d67fc700 1 --2- 172.21.15.156:0/659952690 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3d809f180 0x7fe3d811f620 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc000c00 tx=0x7fe3cc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:39.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.888+0000 7fe3bf7fe700 1 -- 172.21.15.156:0/659952690 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc004450 con 0x7fe3d809f180 2023-09-30T22:21:39.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.888+0000 7fe3bf7fe700 1 -- 172.21.15.156:0/659952690 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3cc01f070 con 0x7fe3d809f180 2023-09-30T22:21:39.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.888+0000 7fe3dd7f5700 1 -- 172.21.15.156:0/659952690 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3cc009550 con 0x7fe3d809f180 2023-09-30T22:21:39.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.888+0000 7fe3bf7fe700 1 -- 172.21.15.156:0/659952690 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc0038c0 con 0x7fe3d809f180 2023-09-30T22:21:39.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.888+0000 7fe3dd7f5700 1 -- 172.21.15.156:0/659952690 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d809dba0 con 0x7fe3d809f180 2023-09-30T22:21:39.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.889+0000 7fe3bf7fe700 1 -- 172.21.15.156:0/659952690 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe3cc003a20 con 0x7fe3d809f180 2023-09-30T22:21:39.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.889+0000 7fe3dd7f5700 1 -- 172.21.15.156:0/659952690 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d8121f40 con 0x7fe3d809f180 2023-09-30T22:21:39.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.889+0000 7fe3bf7fe700 1 -- 172.21.15.156:0/659952690 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe3cc021070 con 0x7fe3d809f180 2023-09-30T22:21:39.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.894+0000 7fe3bf7fe700 1 -- 172.21.15.156:0/659952690 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe3cc0045b0 con 0x7fe3d809f180 2023-09-30T22:21:39.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.917+0000 7fec43ae3700 1 -- 172.21.15.156:0/1573979723 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fec3c04f2a0 con 0x7fec3c134160 2023-09-30T22:21:39.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.917+0000 7fec327fc700 1 -- 172.21.15.156:0/1573979723 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fec34012340 con 0x7fec3c134160 2023-09-30T22:21:39.917 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:39.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.920+0000 7fec43ae3700 1 -- 172.21.15.156:0/1573979723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec3c134160 msgr2=0x7fec3c122fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:39.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.920+0000 7fec43ae3700 1 --2- 172.21.15.156:0/1573979723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec3c134160 0x7fec3c122fb0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fec34009e50 tx=0x7fec3400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:21:39.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.920+0000 7fec43ae3700 1 -- 172.21.15.156:0/1573979723 shutdown_connections 2023-09-30T22:21:39.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.920+0000 7fec43ae3700 1 --2- 172.21.15.156:0/1573979723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec3c134160 0x7fec3c122fb0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:39.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.920+0000 7fec43ae3700 1 --2- 172.21.15.156:0/1573979723 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec3c09e870 0x7fec3c122530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:39.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.920+0000 7fec43ae3700 1 --2- 172.21.15.156:0/1573979723 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fec3c09f180 0x7fec3c122a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:39.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.920+0000 7fec43ae3700 1 -- 172.21.15.156:0/1573979723 >> 172.21.15.156:0/1573979723 conn(0x7fec3c0a4430 msgr2=0x7fec3c070b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:39.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.920+0000 7fec43ae3700 1 -- 172.21.15.156:0/1573979723 shutdown_connections 2023-09-30T22:21:39.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.920+0000 7fec43ae3700 1 -- 172.21.15.156:0/1573979723 wait complete. 2023-09-30T22:21:39.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.928+0000 7f0d058ae700 1 Processor -- start 2023-09-30T22:21:39.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.928+0000 7f0d058ae700 1 -- start start 2023-09-30T22:21:39.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.928+0000 7f0d058ae700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d000a1550 0x7f0d00138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:39.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.928+0000 7f0d058ae700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d00139200 0x7f0d0013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:39.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.928+0000 7f0d058ae700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d0009e9d0 con 0x7f0d000a0a70 2023-09-30T22:21:39.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.928+0000 7f0d058ae700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0009dc00 con 0x7f0d000a1550 2023-09-30T22:21:39.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.928+0000 7f0d058ae700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0009dec0 con 0x7f0d00139200 2023-09-30T22:21:39.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.929+0000 7f0cff7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d00139200 0x7f0d0013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:39.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.929+0000 7f0cff7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d00139200 0x7f0d0013b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36538/0 (socket says 172.21.15.156:36538) 2023-09-30T22:21:39.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.929+0000 7f0cfe7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d000a1550 0x7f0d00138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:39.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.929+0000 7f0cff7fe700 1 -- 172.21.15.156:0/2664002263 learned_addr learned my addr 172.21.15.156:0/2664002263 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:39.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.929+0000 7f0cfe7fc700 1 -- 172.21.15.156:0/2664002263 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d00139200 msgr2=0x7f0d0013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:39.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.929+0000 7f0cfe7fc700 1 --2- 172.21.15.156:0/2664002263 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d00139200 0x7f0d0013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:39.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.929+0000 7f0cfe7fc700 1 -- 172.21.15.156:0/2664002263 >> v1:172.21.15.156:6789/0 conn(0x7f0d000a0a70 legacy=0x7f0d000a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:39.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.929+0000 7f0cfe7fc700 1 -- 172.21.15.156:0/2664002263 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0009e6a0 con 0x7f0d000a1550 2023-09-30T22:21:39.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.929+0000 7f0cff7fe700 1 --2- 172.21.15.156:0/2664002263 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d00139200 0x7f0d0013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:39.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.929+0000 7f0cfe7fc700 1 --2- 172.21.15.156:0/2664002263 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d000a1550 0x7f0d00138cc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4009870 tx=0x7f0cf4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9e8a883eb7fa1c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:39.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.929+0000 7f0cfdffb700 1 -- 172.21.15.156:0/2664002263 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4011830 con 0x7f0d000a1550 2023-09-30T22:21:39.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.929+0000 7f0cfdffb700 1 -- 172.21.15.156:0/2664002263 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf4011990 con 0x7f0d000a1550 2023-09-30T22:21:39.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.929+0000 7f0cfdffb700 1 -- 172.21.15.156:0/2664002263 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4011d20 con 0x7f0d000a1550 2023-09-30T22:21:39.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.930+0000 7f0d058ae700 1 -- 172.21.15.156:0/2664002263 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d000a1550 msgr2=0x7f0d00138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:39.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.930+0000 7f0d058ae700 1 --2- 172.21.15.156:0/2664002263 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d000a1550 0x7f0d00138cc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4009870 tx=0x7f0cf4009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:39.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.930+0000 7f0d058ae700 1 -- 172.21.15.156:0/2664002263 shutdown_connections 2023-09-30T22:21:39.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.930+0000 7f0d058ae700 1 --2- 172.21.15.156:0/2664002263 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d00139200 0x7f0d0013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:39.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.930+0000 7f0d058ae700 1 --2- 172.21.15.156:0/2664002263 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d000a1550 0x7f0d00138cc0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:39.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.930+0000 7f0d058ae700 1 -- 172.21.15.156:0/2664002263 >> 172.21.15.156:0/2664002263 conn(0x7f0d000a6610 msgr2=0x7f0d000a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:39.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.930+0000 7f0d058ae700 1 -- 172.21.15.156:0/2664002263 shutdown_connections 2023-09-30T22:21:39.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.930+0000 7f0d058ae700 1 -- 172.21.15.156:0/2664002263 wait complete. 2023-09-30T22:21:39.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.931+0000 7f0d058ae700 1 Processor -- start 2023-09-30T22:21:39.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.931+0000 7f0d058ae700 1 -- start start 2023-09-30T22:21:39.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.932+0000 7f0d058ae700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d000a0a70 0x7f0d0011e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:39.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.932+0000 7f0d058ae700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d000a1550 0x7f0d0011edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:39.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.932+0000 7f0d058ae700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d00139200 0x7f0d0011f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:39.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.932+0000 7f0d058ae700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d000a5300 con 0x7f0d00139200 2023-09-30T22:21:39.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.932+0000 7f0d058ae700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d001205b0 con 0x7f0d000a1550 2023-09-30T22:21:39.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.932+0000 7f0d058ae700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d000a03e0 con 0x7f0d000a0a70 2023-09-30T22:21:39.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.932+0000 7f0cfe7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d000a1550 0x7f0d0011edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:39.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.932+0000 7f0cfe7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d000a1550 0x7f0d0011edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37238/0 (socket says 172.21.15.156:37238) 2023-09-30T22:21:39.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.932+0000 7f0cfe7fc700 1 -- 172.21.15.156:0/1993579542 learned_addr learned my addr 172.21.15.156:0/1993579542 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:39.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.932+0000 7f0cff7fe700 1 --2- 172.21.15.156:0/1993579542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d00139200 0x7f0d0011f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:39.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.932+0000 7f0cfeffd700 1 --2- 172.21.15.156:0/1993579542 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d000a0a70 0x7f0d0011e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:39.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.932+0000 7f0cfe7fc700 1 -- 172.21.15.156:0/1993579542 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d000a0a70 msgr2=0x7f0d0011e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:39.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.932+0000 7f0cfe7fc700 1 --2- 172.21.15.156:0/1993579542 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d000a0a70 0x7f0d0011e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:39.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.932+0000 7f0cfe7fc700 1 -- 172.21.15.156:0/1993579542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d00139200 msgr2=0x7f0d0011f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:39.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.932+0000 7f0cfe7fc700 1 --2- 172.21.15.156:0/1993579542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d00139200 0x7f0d0011f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:39.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.932+0000 7f0cfe7fc700 1 -- 172.21.15.156:0/1993579542 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf8009b30 con 0x7f0d000a1550 2023-09-30T22:21:39.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.932+0000 7f0cfe7fc700 1 --2- 172.21.15.156:0/1993579542 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d000a1550 0x7f0d0011edd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4009840 tx=0x7f0cf4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:39.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.932+0000 7f0ce7fff700 1 -- 172.21.15.156:0/1993579542 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4004450 con 0x7f0d000a1550 2023-09-30T22:21:39.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.932+0000 7f0ce7fff700 1 -- 172.21.15.156:0/1993579542 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf401f070 con 0x7f0d000a1550 2023-09-30T22:21:39.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.932+0000 7f0ce7fff700 1 -- 172.21.15.156:0/1993579542 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf40038e0 con 0x7f0d000a1550 2023-09-30T22:21:39.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.932+0000 7f0d058ae700 1 -- 172.21.15.156:0/1993579542 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf40094a0 con 0x7f0d000a1550 2023-09-30T22:21:39.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.933+0000 7f0d058ae700 1 -- 172.21.15.156:0/1993579542 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d00120c50 con 0x7f0d000a1550 2023-09-30T22:21:39.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.933+0000 7f0ce7fff700 1 -- 172.21.15.156:0/1993579542 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0cf4003a40 con 0x7f0d000a1550 2023-09-30T22:21:39.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.934+0000 7f0ce7fff700 1 -- 172.21.15.156:0/1993579542 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0cf4021070 con 0x7f0d000a1550 2023-09-30T22:21:39.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.934+0000 7f0d058ae700 1 -- 172.21.15.156:0/1993579542 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d0004f2a0 con 0x7f0d000a1550 2023-09-30T22:21:39.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:39.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:39.939+0000 7f0ce7fff700 1 -- 172.21.15.156:0/1993579542 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0cf401a430 con 0x7f0d000a1550 2023-09-30T22:21:40.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.094+0000 7fe3dd7f5700 1 -- 172.21.15.156:0/659952690 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe3d811be60 con 0x7fe3d809f180 2023-09-30T22:21:40.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.095+0000 7fe3bf7fe700 1 -- 172.21.15.156:0/659952690 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe3cc02b070 con 0x7fe3d809f180 2023-09-30T22:21:40.097 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:40.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.097+0000 7fe3dd7f5700 1 -- 172.21.15.156:0/659952690 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3d809f180 msgr2=0x7fe3d811f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:40.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.097+0000 7fe3dd7f5700 1 --2- 172.21.15.156:0/659952690 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3d809f180 0x7fe3d811f620 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc000c00 tx=0x7fe3cc004750 comp rx=0 tx=0).stop 2023-09-30T22:21:40.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.097+0000 7fe3dd7f5700 1 -- 172.21.15.156:0/659952690 shutdown_connections 2023-09-30T22:21:40.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.097+0000 7fe3dd7f5700 1 --2- 172.21.15.156:0/659952690 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe3d8131d70 0x7fe3d811fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:40.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.097+0000 7fe3dd7f5700 1 --2- 172.21.15.156:0/659952690 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3d809e870 0x7fe3d811f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:40.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.097+0000 7fe3dd7f5700 1 --2- 172.21.15.156:0/659952690 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3d809f180 0x7fe3d811f620 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:40.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.097+0000 7fe3dd7f5700 1 -- 172.21.15.156:0/659952690 >> 172.21.15.156:0/659952690 conn(0x7fe3d80a4430 msgr2=0x7fe3d8131040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:40.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.097+0000 7fe3dd7f5700 1 -- 172.21.15.156:0/659952690 shutdown_connections 2023-09-30T22:21:40.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.097+0000 7fe3dd7f5700 1 -- 172.21.15.156:0/659952690 wait complete. 2023-09-30T22:21:40.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:40.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.132+0000 7f0d058ae700 1 -- 172.21.15.156:0/1993579542 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0d00072980 con 0x7f0d000a1550 2023-09-30T22:21:40.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.132+0000 7f0ce7fff700 1 -- 172.21.15.156:0/1993579542 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0cf4015020 con 0x7f0d000a1550 2023-09-30T22:21:40.133 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:40.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.134+0000 7f0d058ae700 1 -- 172.21.15.156:0/1993579542 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d000a1550 msgr2=0x7f0d0011edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:40.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.134+0000 7f0d058ae700 1 --2- 172.21.15.156:0/1993579542 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d000a1550 0x7f0d0011edd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4009840 tx=0x7f0cf4004750 comp rx=0 tx=0).stop 2023-09-30T22:21:40.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.134+0000 7f0d058ae700 1 -- 172.21.15.156:0/1993579542 shutdown_connections 2023-09-30T22:21:40.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.134+0000 7f0d058ae700 1 --2- 172.21.15.156:0/1993579542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d00139200 0x7f0d0011f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:40.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.134+0000 7f0d058ae700 1 --2- 172.21.15.156:0/1993579542 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d000a0a70 0x7f0d0011e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:40.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.134+0000 7f0d058ae700 1 --2- 172.21.15.156:0/1993579542 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d000a1550 0x7f0d0011edd0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:40.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.134+0000 7f0d058ae700 1 -- 172.21.15.156:0/1993579542 >> 172.21.15.156:0/1993579542 conn(0x7f0d000a6610 msgr2=0x7f0d00136d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:40.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.134+0000 7f0d058ae700 1 -- 172.21.15.156:0/1993579542 shutdown_connections 2023-09-30T22:21:40.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.134+0000 7f0d058ae700 1 -- 172.21.15.156:0/1993579542 wait complete. 2023-09-30T22:21:40.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:40.198 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:40.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.328+0000 7f3d99637700 1 Processor -- start 2023-09-30T22:21:40.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.328+0000 7f3d99637700 1 -- start start 2023-09-30T22:21:40.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.328+0000 7f3d99637700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3d940a0a70 0x7f3d940a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:40.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.328+0000 7f3d99637700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d94134120 0x7f3d9413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:40.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.328+0000 7f3d99637700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d9409dc00 con 0x7f3d940a1380 2023-09-30T22:21:40.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.328+0000 7f3d99637700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d9409ea90 con 0x7f3d940a0a70 2023-09-30T22:21:40.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.328+0000 7f3d99637700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9409dec0 con 0x7f3d94134120 2023-09-30T22:21:40.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.329+0000 7f3d92ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3d940a0a70 0x7f3d940a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:40.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.329+0000 7f3d937fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d94134120 0x7f3d9413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:40.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.329+0000 7f3d92ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3d940a0a70 0x7f3d940a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50512/0 (socket says 172.21.15.156:50512) 2023-09-30T22:21:40.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.329+0000 7f3d92ffd700 1 -- 172.21.15.156:0/1708554317 learned_addr learned my addr 172.21.15.156:0/1708554317 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:40.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.329+0000 7f3d927fc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f3d940a1380 0x7f3d94133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47796/0 (socket says 172.21.15.156:47796) 2023-09-30T22:21:40.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.329+0000 7f3d937fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d94134120 0x7f3d9413bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36556/0 (socket says 172.21.15.156:36556) 2023-09-30T22:21:40.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.329+0000 7f3d937fe700 1 -- 172.21.15.156:0/1708554317 >> v2:172.21.15.156:3300/0 conn(0x7f3d940a0a70 msgr2=0x7f3d940a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:40.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.329+0000 7f3d937fe700 1 --2- 172.21.15.156:0/1708554317 >> v2:172.21.15.156:3300/0 conn(0x7f3d940a0a70 0x7f3d940a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:40.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.329+0000 7f3d937fe700 1 -- 172.21.15.156:0/1708554317 >> v1:172.21.15.156:6789/0 conn(0x7f3d940a1380 legacy=0x7f3d94133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:40.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.329+0000 7f3d937fe700 1 -- 172.21.15.156:0/1708554317 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9409e6a0 con 0x7f3d94134120 2023-09-30T22:21:40.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.329+0000 7f3d92ffd700 1 --2- 172.21.15.156:0/1708554317 >> v2:172.21.15.156:3300/0 conn(0x7f3d940a0a70 0x7f3d940a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:40.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.329+0000 7f3d91ffb700 1 -- 172.21.15.156:0/1708554317 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2716467 0 0) 0x7f3d9409dc00 con 0x7f3d940a1380 2023-09-30T22:21:40.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.329+0000 7f3d937fe700 1 --2- 172.21.15.156:0/1708554317 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d94134120 0x7f3d9413bce0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c009d90 tx=0x7f3d8c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9d4584ce094bfa8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:40.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.329+0000 7f3d91ffb700 1 -- 172.21.15.156:0/1708554317 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c00e070 con 0x7f3d94134120 2023-09-30T22:21:40.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.329+0000 7f3d91ffb700 1 -- 172.21.15.156:0/1708554317 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8c00bb20 con 0x7f3d94134120 2023-09-30T22:21:40.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.329+0000 7f3d91ffb700 1 -- 172.21.15.156:0/1708554317 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c012430 con 0x7f3d94134120 2023-09-30T22:21:40.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.330+0000 7f3d99637700 1 -- 172.21.15.156:0/1708554317 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d94134120 msgr2=0x7f3d9413bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:40.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.330+0000 7f3d99637700 1 --2- 172.21.15.156:0/1708554317 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d94134120 0x7f3d9413bce0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c009d90 tx=0x7f3d8c00b330 comp rx=0 tx=0).stop 2023-09-30T22:21:40.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.330+0000 7f3d99637700 1 -- 172.21.15.156:0/1708554317 shutdown_connections 2023-09-30T22:21:40.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.330+0000 7f3d99637700 1 --2- 172.21.15.156:0/1708554317 >> v2:172.21.15.156:3300/0 conn(0x7f3d940a0a70 0x7f3d940a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:40.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.330+0000 7f3d99637700 1 --2- 172.21.15.156:0/1708554317 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d94134120 0x7f3d9413bce0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:40.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.330+0000 7f3d99637700 1 -- 172.21.15.156:0/1708554317 >> 172.21.15.156:0/1708554317 conn(0x7f3d940a6610 msgr2=0x7f3d940a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:40.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.330+0000 7f3d99637700 1 -- 172.21.15.156:0/1708554317 shutdown_connections 2023-09-30T22:21:40.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.330+0000 7f3d99637700 1 -- 172.21.15.156:0/1708554317 wait complete. 2023-09-30T22:21:40.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.331+0000 7f3d99637700 1 Processor -- start 2023-09-30T22:21:40.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.331+0000 7f3d99637700 1 -- start start 2023-09-30T22:21:40.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.332+0000 7f3d99637700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d940a0a70 0x7f3d94122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:40.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.332+0000 7f3d99637700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d940a1380 0x7f3d94122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:40.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.332+0000 7f3d99637700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d94134120 0x7f3d941231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:40.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.332+0000 7f3d99637700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d94124360 con 0x7f3d94134120 2023-09-30T22:21:40.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.332+0000 7f3d99637700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d941336a0 con 0x7f3d940a1380 2023-09-30T22:21:40.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.332+0000 7f3d99637700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d941332e0 con 0x7f3d940a0a70 2023-09-30T22:21:40.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.332+0000 7f3d92ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d940a0a70 0x7f3d94122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:40.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.332+0000 7f3d92ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d940a0a70 0x7f3d94122750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36568/0 (socket says 172.21.15.156:36568) 2023-09-30T22:21:40.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.332+0000 7f3d92ffd700 1 -- 172.21.15.156:0/3497062695 learned_addr learned my addr 172.21.15.156:0/3497062695 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:40.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.332+0000 7f3d937fe700 1 --2- 172.21.15.156:0/3497062695 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d94134120 0x7f3d941231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:40.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.332+0000 7f3d927fc700 1 --2- 172.21.15.156:0/3497062695 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d940a1380 0x7f3d94122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:40.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.332+0000 7f3d92ffd700 1 -- 172.21.15.156:0/3497062695 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d940a1380 msgr2=0x7f3d94122c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:40.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.332+0000 7f3d92ffd700 1 --2- 172.21.15.156:0/3497062695 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d940a1380 0x7f3d94122c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:40.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.332+0000 7f3d92ffd700 1 -- 172.21.15.156:0/3497062695 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d94134120 msgr2=0x7f3d941231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:40.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.332+0000 7f3d92ffd700 1 --2- 172.21.15.156:0/3497062695 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d94134120 0x7f3d941231d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:40.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.332+0000 7f3d92ffd700 1 -- 172.21.15.156:0/3497062695 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d88009550 con 0x7f3d940a0a70 2023-09-30T22:21:40.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.332+0000 7f3d937fe700 1 --2- 172.21.15.156:0/3497062695 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d94134120 0x7f3d941231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:40.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.332+0000 7f3d92ffd700 1 --2- 172.21.15.156:0/3497062695 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d940a0a70 0x7f3d94122750 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800ebe0 tx=0x7f3d8800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:40.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.332+0000 7f3d7b7fe700 1 -- 172.21.15.156:0/3497062695 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8800c850 con 0x7f3d940a0a70 2023-09-30T22:21:40.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.333+0000 7f3d7b7fe700 1 -- 172.21.15.156:0/3497062695 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8800c9b0 con 0x7f3d940a0a70 2023-09-30T22:21:40.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.333+0000 7f3d99637700 1 -- 172.21.15.156:0/3497062695 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8c009a70 con 0x7f3d940a0a70 2023-09-30T22:21:40.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.333+0000 7f3d7b7fe700 1 -- 172.21.15.156:0/3497062695 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8800cd40 con 0x7f3d940a0a70 2023-09-30T22:21:40.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.333+0000 7f3d99637700 1 -- 172.21.15.156:0/3497062695 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d940a0430 con 0x7f3d940a0a70 2023-09-30T22:21:40.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.333+0000 7f3d7b7fe700 1 -- 172.21.15.156:0/3497062695 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3d88013470 con 0x7f3d940a0a70 2023-09-30T22:21:40.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.333+0000 7f3d7b7fe700 1 -- 172.21.15.156:0/3497062695 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3d8803f870 con 0x7f3d940a0a70 2023-09-30T22:21:40.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.333+0000 7f3d99637700 1 -- 172.21.15.156:0/3497062695 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d941339e0 con 0x7f3d940a0a70 2023-09-30T22:21:40.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.338+0000 7f3d7b7fe700 1 -- 172.21.15.156:0/3497062695 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d88017020 con 0x7f3d940a0a70 2023-09-30T22:21:40.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.523+0000 7f3d99637700 1 -- 172.21.15.156:0/3497062695 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3d9404f2a0 con 0x7f3d940a0a70 2023-09-30T22:21:40.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.523+0000 7f3d7b7fe700 1 -- 172.21.15.156:0/3497062695 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3d880232f0 con 0x7f3d940a0a70 2023-09-30T22:21:40.524 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:40.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.525+0000 7f3d99637700 1 -- 172.21.15.156:0/3497062695 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d940a0a70 msgr2=0x7f3d94122750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:40.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.525+0000 7f3d99637700 1 --2- 172.21.15.156:0/3497062695 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d940a0a70 0x7f3d94122750 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800ebe0 tx=0x7f3d8800eef0 comp rx=0 tx=0).stop 2023-09-30T22:21:40.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.525+0000 7f3d99637700 1 -- 172.21.15.156:0/3497062695 shutdown_connections 2023-09-30T22:21:40.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.525+0000 7f3d99637700 1 --2- 172.21.15.156:0/3497062695 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d94134120 0x7f3d941231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:40.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.525+0000 7f3d99637700 1 --2- 172.21.15.156:0/3497062695 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3d940a0a70 0x7f3d94122750 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:40.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.525+0000 7f3d99637700 1 --2- 172.21.15.156:0/3497062695 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3d940a1380 0x7f3d94122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:40.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.525+0000 7f3d99637700 1 -- 172.21.15.156:0/3497062695 >> 172.21.15.156:0/3497062695 conn(0x7f3d940a6610 msgr2=0x7f3d940a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:40.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.525+0000 7f3d99637700 1 -- 172.21.15.156:0/3497062695 shutdown_connections 2023-09-30T22:21:40.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:40.525+0000 7f3d99637700 1 -- 172.21.15.156:0/3497062695 wait complete. 2023-09-30T22:21:40.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:40.943 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:41.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.069+0000 7f02be5a1700 1 Processor -- start 2023-09-30T22:21:41.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.069+0000 7f02be5a1700 1 -- start start 2023-09-30T22:21:41.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.069+0000 7f02be5a1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02b8130c30 0x7f02b812ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:41.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.069+0000 7f02be5a1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02b8138790 0x7f02b813ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:41.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.069+0000 7f02be5a1700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02b809f590 con 0x7f02b806a770 2023-09-30T22:21:41.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.069+0000 7f02be5a1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b809af90 con 0x7f02b8138790 2023-09-30T22:21:41.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.069+0000 7f02be5a1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02b809a5d0 con 0x7f02b8130c30 2023-09-30T22:21:41.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.069+0000 7f02bdda0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02b8138790 0x7f02b813ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:41.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.069+0000 7f02bcd9e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02b8130c30 0x7f02b812ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:41.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.069+0000 7f02bdda0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02b8138790 0x7f02b813ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37264/0 (socket says 172.21.15.156:37264) 2023-09-30T22:21:41.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.069+0000 7f02bdda0700 1 -- 172.21.15.156:0/195249999 learned_addr learned my addr 172.21.15.156:0/195249999 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:41.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.070+0000 7f02bdda0700 1 -- 172.21.15.156:0/195249999 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02b8130c30 msgr2=0x7f02b812ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:41.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.070+0000 7f02bdda0700 1 --2- 172.21.15.156:0/195249999 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02b8130c30 0x7f02b812ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.070+0000 7f02bdda0700 1 -- 172.21.15.156:0/195249999 >> v1:172.21.15.156:6789/0 conn(0x7f02b806a770 legacy=0x7f02b8130520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:41.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.070+0000 7f02affff700 1 -- 172.21.15.156:0/195249999 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930533506 0 0) 0x7f02b809f590 con 0x7f02b806a770 2023-09-30T22:21:41.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.070+0000 7f02bdda0700 1 -- 172.21.15.156:0/195249999 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b809ed60 con 0x7f02b8138790 2023-09-30T22:21:41.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.070+0000 7f02bcd9e700 1 --2- 172.21.15.156:0/195249999 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02b8130c30 0x7f02b812ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:41.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.070+0000 7f02bdda0700 1 --2- 172.21.15.156:0/195249999 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02b8138790 0x7f02b813ab70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f02b0009e80 tx=0x7f02b000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d943cae27e89f00 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:41.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.070+0000 7f02affff700 1 -- 172.21.15.156:0/195249999 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b000e070 con 0x7f02b8138790 2023-09-30T22:21:41.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.070+0000 7f02affff700 1 -- 172.21.15.156:0/195249999 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b000b910 con 0x7f02b8138790 2023-09-30T22:21:41.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.070+0000 7f02affff700 1 -- 172.21.15.156:0/195249999 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b000bcc0 con 0x7f02b8138790 2023-09-30T22:21:41.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.071+0000 7f02be5a1700 1 -- 172.21.15.156:0/195249999 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02b8138790 msgr2=0x7f02b813ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:41.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.071+0000 7f02be5a1700 1 --2- 172.21.15.156:0/195249999 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02b8138790 0x7f02b813ab70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f02b0009e80 tx=0x7f02b000b330 comp rx=0 tx=0).stop 2023-09-30T22:21:41.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.071+0000 7f02be5a1700 1 -- 172.21.15.156:0/195249999 shutdown_connections 2023-09-30T22:21:41.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.071+0000 7f02be5a1700 1 --2- 172.21.15.156:0/195249999 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02b8138790 0x7f02b813ab70 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.071+0000 7f02be5a1700 1 --2- 172.21.15.156:0/195249999 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02b8130c30 0x7f02b812ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.071+0000 7f02be5a1700 1 -- 172.21.15.156:0/195249999 >> 172.21.15.156:0/195249999 conn(0x7f02b80a2d80 msgr2=0x7f02b80a3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:41.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.071+0000 7f02be5a1700 1 -- 172.21.15.156:0/195249999 shutdown_connections 2023-09-30T22:21:41.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.071+0000 7f02be5a1700 1 -- 172.21.15.156:0/195249999 wait complete. 2023-09-30T22:21:41.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.072+0000 7f02be5a1700 1 Processor -- start 2023-09-30T22:21:41.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.072+0000 7f02be5a1700 1 -- start start 2023-09-30T22:21:41.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.072+0000 7f02be5a1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02b806a770 0x7f02b8134540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:41.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.072+0000 7f02be5a1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02b8130c30 0x7f02b8134a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:41.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.072+0000 7f02be5a1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02b8138790 0x7f02b8134fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:41.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.072+0000 7f02be5a1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b8138190 con 0x7f02b8130c30 2023-09-30T22:21:41.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.072+0000 7f02be5a1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b812dbd0 con 0x7f02b8138790 2023-09-30T22:21:41.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.072+0000 7f02be5a1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02b812de70 con 0x7f02b806a770 2023-09-30T22:21:41.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.072+0000 7f02bd59f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02b806a770 0x7f02b8134540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:41.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.072+0000 7f02bcd9e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02b8130c30 0x7f02b8134a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:41.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.072+0000 7f02bd59f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02b806a770 0x7f02b8134540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36584/0 (socket says 172.21.15.156:36584) 2023-09-30T22:21:41.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.072+0000 7f02bdda0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02b8138790 0x7f02b8134fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:41.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.072+0000 7f02bd59f700 1 -- 172.21.15.156:0/1815551954 learned_addr learned my addr 172.21.15.156:0/1815551954 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:41.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.072+0000 7f02bd59f700 1 -- 172.21.15.156:0/1815551954 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02b8138790 msgr2=0x7f02b8134fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:41.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.072+0000 7f02bd59f700 1 --2- 172.21.15.156:0/1815551954 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02b8138790 0x7f02b8134fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.072+0000 7f02bd59f700 1 -- 172.21.15.156:0/1815551954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02b8130c30 msgr2=0x7f02b8134a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:41.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.072+0000 7f02bd59f700 1 --2- 172.21.15.156:0/1815551954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02b8130c30 0x7f02b8134a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.072+0000 7f02bd59f700 1 -- 172.21.15.156:0/1815551954 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a80094a0 con 0x7f02b806a770 2023-09-30T22:21:41.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.072+0000 7f02bcd9e700 1 --2- 172.21.15.156:0/1815551954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02b8130c30 0x7f02b8134a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:41.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.072+0000 7f02bdda0700 1 --2- 172.21.15.156:0/1815551954 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02b8138790 0x7f02b8134fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:41.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.073+0000 7f02bd59f700 1 --2- 172.21.15.156:0/1815551954 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02b806a770 0x7f02b8134540 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f02b4001eb0 tx=0x7f02b400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:41.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.073+0000 7f02adffb700 1 -- 172.21.15.156:0/1815551954 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b400cea0 con 0x7f02b806a770 2023-09-30T22:21:41.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.073+0000 7f02adffb700 1 -- 172.21.15.156:0/1815551954 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b40054e0 con 0x7f02b806a770 2023-09-30T22:21:41.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.073+0000 7f02be5a1700 1 -- 172.21.15.156:0/1815551954 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b0009b30 con 0x7f02b806a770 2023-09-30T22:21:41.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.073+0000 7f02adffb700 1 -- 172.21.15.156:0/1815551954 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b4003880 con 0x7f02b806a770 2023-09-30T22:21:41.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.073+0000 7f02be5a1700 1 -- 172.21.15.156:0/1815551954 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b81361c0 con 0x7f02b806a770 2023-09-30T22:21:41.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.074+0000 7f02adffb700 1 -- 172.21.15.156:0/1815551954 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f02b40039e0 con 0x7f02b806a770 2023-09-30T22:21:41.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.074+0000 7f02adffb700 1 -- 172.21.15.156:0/1815551954 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f02b403ea00 con 0x7f02b806a770 2023-09-30T22:21:41.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.074+0000 7f02be5a1700 1 -- 172.21.15.156:0/1815551954 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b804f2a0 con 0x7f02b806a770 2023-09-30T22:21:41.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.078+0000 7f02adffb700 1 -- 172.21.15.156:0/1815551954 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f02b40196d0 con 0x7f02b806a770 2023-09-30T22:21:41.113 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:41.147 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:41.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.239+0000 7f34058e6700 1 Processor -- start 2023-09-30T22:21:41.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.240+0000 7f34058e6700 1 -- start start 2023-09-30T22:21:41.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.240+0000 7f34058e6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f34000a0a70 0x7f34000a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:41.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.240+0000 7f34058e6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3400134120 0x7f340013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:41.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.240+0000 7f34058e6700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f340009dc00 con 0x7f34000a1380 2023-09-30T22:21:41.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.240+0000 7f34058e6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340009ea90 con 0x7f3400134120 2023-09-30T22:21:41.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.240+0000 7f34058e6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f340009dec0 con 0x7f34000a0a70 2023-09-30T22:21:41.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.240+0000 7f33feffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f34000a0a70 0x7f34000a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:41.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.240+0000 7f33fe7fc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f34000a1380 0x7f3400133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47810/0 (socket says 172.21.15.156:47810) 2023-09-30T22:21:41.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.240+0000 7f33fe7fc700 1 -- 172.21.15.156:0/3665410315 learned_addr learned my addr 172.21.15.156:0/3665410315 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:41.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.240+0000 7f33ff7fe700 1 --2- 172.21.15.156:0/3665410315 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3400134120 0x7f340013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:41.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.240+0000 7f33feffd700 1 -- 172.21.15.156:0/3665410315 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3400134120 msgr2=0x7f340013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:41.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.240+0000 7f33feffd700 1 --2- 172.21.15.156:0/3665410315 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3400134120 0x7f340013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.241+0000 7f33feffd700 1 -- 172.21.15.156:0/3665410315 >> v1:172.21.15.156:6789/0 conn(0x7f34000a1380 legacy=0x7f3400133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:41.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.241+0000 7f33feffd700 1 -- 172.21.15.156:0/3665410315 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340009e6a0 con 0x7f34000a0a70 2023-09-30T22:21:41.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.241+0000 7f33ff7fe700 1 --2- 172.21.15.156:0/3665410315 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3400134120 0x7f340013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:41.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.241+0000 7f33feffd700 1 --2- 172.21.15.156:0/3665410315 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f34000a0a70 0x7f34000a0e40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f33f0009870 tx=0x7f33f0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78e78b306f29d1c8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:41.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.241+0000 7f33fdffb700 1 -- 172.21.15.156:0/3665410315 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f0011830 con 0x7f34000a0a70 2023-09-30T22:21:41.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.241+0000 7f33fdffb700 1 -- 172.21.15.156:0/3665410315 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f0011990 con 0x7f34000a0a70 2023-09-30T22:21:41.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.241+0000 7f33fdffb700 1 -- 172.21.15.156:0/3665410315 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f0011d20 con 0x7f34000a0a70 2023-09-30T22:21:41.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.241+0000 7f34058e6700 1 -- 172.21.15.156:0/3665410315 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f34000a0a70 msgr2=0x7f34000a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:41.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.242+0000 7f34058e6700 1 --2- 172.21.15.156:0/3665410315 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f34000a0a70 0x7f34000a0e40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f33f0009870 tx=0x7f33f0009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:41.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.242+0000 7f34058e6700 1 -- 172.21.15.156:0/3665410315 shutdown_connections 2023-09-30T22:21:41.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.242+0000 7f34058e6700 1 --2- 172.21.15.156:0/3665410315 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3400134120 0x7f340013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.242+0000 7f34058e6700 1 --2- 172.21.15.156:0/3665410315 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f34000a0a70 0x7f34000a0e40 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.242+0000 7f34058e6700 1 -- 172.21.15.156:0/3665410315 >> 172.21.15.156:0/3665410315 conn(0x7f34000a6610 msgr2=0x7f34000a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:41.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.242+0000 7f34058e6700 1 -- 172.21.15.156:0/3665410315 shutdown_connections 2023-09-30T22:21:41.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.242+0000 7f34058e6700 1 -- 172.21.15.156:0/3665410315 wait complete. 2023-09-30T22:21:41.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.242+0000 7f34058e6700 1 Processor -- start 2023-09-30T22:21:41.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.243+0000 7f34058e6700 1 -- start start 2023-09-30T22:21:41.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.243+0000 7f34058e6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34000a0a70 0x7f3400122a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:41.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.243+0000 7f34058e6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34000a1380 0x7f3400122f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:41.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.243+0000 7f34058e6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3400134120 0x7f34001234c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:41.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.243+0000 7f34058e6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3400124e50 con 0x7f34000a1380 2023-09-30T22:21:41.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.243+0000 7f34058e6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3400127160 con 0x7f34000a0a70 2023-09-30T22:21:41.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.243+0000 7f34058e6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3400124b10 con 0x7f3400134120 2023-09-30T22:21:41.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.243+0000 7f33feffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34000a0a70 0x7f3400122a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:41.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.243+0000 7f33feffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34000a0a70 0x7f3400122a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37286/0 (socket says 172.21.15.156:37286) 2023-09-30T22:21:41.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.243+0000 7f33feffd700 1 -- 172.21.15.156:0/1383364643 learned_addr learned my addr 172.21.15.156:0/1383364643 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:41.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.243+0000 7f33ff7fe700 1 --2- 172.21.15.156:0/1383364643 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3400134120 0x7f34001234c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:41.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.243+0000 7f33fe7fc700 1 --2- 172.21.15.156:0/1383364643 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34000a1380 0x7f3400122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:41.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.244+0000 7f33feffd700 1 -- 172.21.15.156:0/1383364643 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3400134120 msgr2=0x7f34001234c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:41.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.244+0000 7f33feffd700 1 --2- 172.21.15.156:0/1383364643 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3400134120 0x7f34001234c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.244+0000 7f33feffd700 1 -- 172.21.15.156:0/1383364643 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34000a1380 msgr2=0x7f3400122f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:41.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.244+0000 7f33feffd700 1 --2- 172.21.15.156:0/1383364643 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34000a1380 0x7f3400122f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.244+0000 7f33feffd700 1 -- 172.21.15.156:0/1383364643 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f8009a70 con 0x7f34000a0a70 2023-09-30T22:21:41.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.244+0000 7f33ff7fe700 1 --2- 172.21.15.156:0/1383364643 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3400134120 0x7f34001234c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:41.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.244+0000 7f33fe7fc700 1 --2- 172.21.15.156:0/1383364643 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34000a1380 0x7f3400122f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:41.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.244+0000 7f33feffd700 1 --2- 172.21.15.156:0/1383364643 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34000a0a70 0x7f3400122a40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f33f00090b0 tx=0x7f33f0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:41.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.244+0000 7f33e7fff700 1 -- 172.21.15.156:0/1383364643 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f0004450 con 0x7f34000a0a70 2023-09-30T22:21:41.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.244+0000 7f33e7fff700 1 -- 172.21.15.156:0/1383364643 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f001f070 con 0x7f34000a0a70 2023-09-30T22:21:41.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.244+0000 7f33e7fff700 1 -- 172.21.15.156:0/1383364643 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f00038e0 con 0x7f34000a0a70 2023-09-30T22:21:41.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.244+0000 7f34058e6700 1 -- 172.21.15.156:0/1383364643 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f00094a0 con 0x7f34000a0a70 2023-09-30T22:21:41.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.244+0000 7f34058e6700 1 -- 172.21.15.156:0/1383364643 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3400126200 con 0x7f34000a0a70 2023-09-30T22:21:41.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.245+0000 7f34058e6700 1 -- 172.21.15.156:0/1383364643 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34000a2700 con 0x7f34000a0a70 2023-09-30T22:21:41.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.246+0000 7f33e7fff700 1 -- 172.21.15.156:0/1383364643 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f33f0003a40 con 0x7f34000a0a70 2023-09-30T22:21:41.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.246+0000 7f33e7fff700 1 -- 172.21.15.156:0/1383364643 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f33f0021070 con 0x7f34000a0a70 2023-09-30T22:21:41.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.254+0000 7f33e7fff700 1 -- 172.21.15.156:0/1383364643 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f33f001a430 con 0x7f34000a0a70 2023-09-30T22:21:41.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.284+0000 7f2a476b3700 1 Processor -- start 2023-09-30T22:21:41.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.285+0000 7f2a476b3700 1 -- start start 2023-09-30T22:21:41.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.285+0000 7f2a476b3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2a400a0a70 0x7f2a400a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:41.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.285+0000 7f2a476b3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a400a1380 0x7f2a40133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:41.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.285+0000 7f2a476b3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a40133f50 0x7f2a401343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:41.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.285+0000 7f2a476b3700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4009e9d0 con 0x7f2a400a0a70 2023-09-30T22:21:41.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.285+0000 7f2a476b3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4009dc00 con 0x7f2a40133f50 2023-09-30T22:21:41.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.285+0000 7f2a476b3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4009dec0 con 0x7f2a400a1380 2023-09-30T22:21:41.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.285+0000 7f2a4544f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2a400a0a70 0x7f2a400a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:41.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.285+0000 7f2a45c50700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a40133f50 0x7f2a401343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:41.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.286+0000 7f2a44c4e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a400a1380 0x7f2a40133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:41.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.286+0000 7f2a4544f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2a400a0a70 0x7f2a400a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33002/0 (socket says 172.21.15.156:33002) 2023-09-30T22:21:41.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.286+0000 7f2a45c50700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a40133f50 0x7f2a401343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53094/0 (socket says 172.21.15.156:53094) 2023-09-30T22:21:41.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.286+0000 7f2a4544f700 1 -- 172.21.15.156:0/709838444 learned_addr learned my addr 172.21.15.156:0/709838444 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:41.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.286+0000 7f2a4544f700 1 -- 172.21.15.156:0/709838444 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a400a1380 msgr2=0x7f2a40133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:41.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.286+0000 7f2a4544f700 1 --2- 172.21.15.156:0/709838444 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a400a1380 0x7f2a40133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.286+0000 7f2a4544f700 1 -- 172.21.15.156:0/709838444 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a40133f50 msgr2=0x7f2a401343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:41.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.286+0000 7f2a4544f700 1 --2- 172.21.15.156:0/709838444 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a40133f50 0x7f2a401343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.286+0000 7f2a4544f700 1 -- 172.21.15.156:0/709838444 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4009e6a0 con 0x7f2a400a0a70 2023-09-30T22:21:41.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.286+0000 7f2a44c4e700 1 --2- 172.21.15.156:0/709838444 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a400a1380 0x7f2a40133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:41.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.286+0000 7f2a4544f700 1 --2- 172.21.15.156:0/709838444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a400a0a70 0x7f2a400a0e40 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c0098f0 tx=0x7f2a3c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3638d698c23f0e25 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:41.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.286+0000 7f2a37fff700 1 -- 172.21.15.156:0/709838444 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c011830 con 0x7f2a400a0a70 2023-09-30T22:21:41.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.286+0000 7f2a37fff700 1 -- 172.21.15.156:0/709838444 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3c011990 con 0x7f2a400a0a70 2023-09-30T22:21:41.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.286+0000 7f2a37fff700 1 -- 172.21.15.156:0/709838444 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c011d20 con 0x7f2a400a0a70 2023-09-30T22:21:41.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.287+0000 7f02be5a1700 1 -- 172.21.15.156:0/1815551954 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f02b806c1e0 con 0x7f02b806a770 2023-09-30T22:21:41.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.287+0000 7f2a476b3700 1 -- 172.21.15.156:0/709838444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a400a0a70 msgr2=0x7f2a400a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:41.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.287+0000 7f2a476b3700 1 --2- 172.21.15.156:0/709838444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a400a0a70 0x7f2a400a0e40 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c0098f0 tx=0x7f2a3c009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:41.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.287+0000 7f2a476b3700 1 -- 172.21.15.156:0/709838444 shutdown_connections 2023-09-30T22:21:41.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.287+0000 7f2a476b3700 1 --2- 172.21.15.156:0/709838444 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a40133f50 0x7f2a401343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.287+0000 7f2a476b3700 1 --2- 172.21.15.156:0/709838444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a400a0a70 0x7f2a400a0e40 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.287+0000 7f2a476b3700 1 --2- 172.21.15.156:0/709838444 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a400a1380 0x7f2a40133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.287+0000 7f2a476b3700 1 -- 172.21.15.156:0/709838444 >> 172.21.15.156:0/709838444 conn(0x7f2a400a6610 msgr2=0x7f2a400a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:41.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.287+0000 7f2a476b3700 1 -- 172.21.15.156:0/709838444 shutdown_connections 2023-09-30T22:21:41.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.287+0000 7f2a476b3700 1 -- 172.21.15.156:0/709838444 wait complete. 2023-09-30T22:21:41.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.287+0000 7f02adffb700 1 -- 172.21.15.156:0/1815551954 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f02b4017020 con 0x7f02b806a770 2023-09-30T22:21:41.290 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:41.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.288+0000 7f2a476b3700 1 Processor -- start 2023-09-30T22:21:41.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.288+0000 7f2a476b3700 1 -- start start 2023-09-30T22:21:41.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.289+0000 7f2a476b3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a400a0a70 0x7f2a40122540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:41.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.289+0000 7f2a476b3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a400a1380 0x7f2a40122a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:41.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.289+0000 7f2a476b3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a40133f50 0x7f2a40122fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:41.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.289+0000 7f2a476b3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a400a03e0 con 0x7f2a400a1380 2023-09-30T22:21:41.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.289+0000 7f2a476b3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a400a50e0 con 0x7f2a400a0a70 2023-09-30T22:21:41.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.289+0000 7f2a476b3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a40124f70 con 0x7f2a40133f50 2023-09-30T22:21:41.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.289+0000 7f2a44c4e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a400a1380 0x7f2a40122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:41.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.289+0000 7f2a44c4e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a400a1380 0x7f2a40122a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33008/0 (socket says 172.21.15.156:33008) 2023-09-30T22:21:41.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.289+0000 7f2a44c4e700 1 -- 172.21.15.156:0/3021540503 learned_addr learned my addr 172.21.15.156:0/3021540503 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:41.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.289+0000 7f2a45c50700 1 --2- 172.21.15.156:0/3021540503 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a40133f50 0x7f2a40122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:41.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.289+0000 7f2a4544f700 1 --2- 172.21.15.156:0/3021540503 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a400a0a70 0x7f2a40122540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:41.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.289+0000 7f2a44c4e700 1 -- 172.21.15.156:0/3021540503 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a40133f50 msgr2=0x7f2a40122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:41.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.289+0000 7f2a44c4e700 1 --2- 172.21.15.156:0/3021540503 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a40133f50 0x7f2a40122fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.289+0000 7f2a44c4e700 1 -- 172.21.15.156:0/3021540503 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a400a0a70 msgr2=0x7f2a40122540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:41.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.289+0000 7f2a44c4e700 1 --2- 172.21.15.156:0/3021540503 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a400a0a70 0x7f2a40122540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.290+0000 7f2a44c4e700 1 -- 172.21.15.156:0/3021540503 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a300094a0 con 0x7f2a400a1380 2023-09-30T22:21:41.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.290+0000 7f2a44c4e700 1 --2- 172.21.15.156:0/3021540503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a400a1380 0x7f2a40122a80 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f2a30009e70 tx=0x7f2a3000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:41.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.290+0000 7f2a35ffb700 1 -- 172.21.15.156:0/3021540503 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a30009780 con 0x7f2a400a1380 2023-09-30T22:21:41.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.290+0000 7f2a35ffb700 1 -- 172.21.15.156:0/3021540503 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a30017c60 con 0x7f2a400a1380 2023-09-30T22:21:41.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.290+0000 7f2a476b3700 1 -- 172.21.15.156:0/3021540503 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a3c009550 con 0x7f2a400a1380 2023-09-30T22:21:41.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.290+0000 7f2a35ffb700 1 -- 172.21.15.156:0/3021540503 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3000c640 con 0x7f2a400a1380 2023-09-30T22:21:41.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.290+0000 7f2a476b3700 1 -- 172.21.15.156:0/3021540503 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a40125d80 con 0x7f2a400a1380 2023-09-30T22:21:41.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.290+0000 7f02be5a1700 1 -- 172.21.15.156:0/1815551954 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02b806a770 msgr2=0x7f02b8134540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:41.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.290+0000 7f02be5a1700 1 --2- 172.21.15.156:0/1815551954 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02b806a770 0x7f02b8134540 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f02b4001eb0 tx=0x7f02b400c800 comp rx=0 tx=0).stop 2023-09-30T22:21:41.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.291+0000 7f2a35ffb700 1 -- 172.21.15.156:0/3021540503 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a3000c7c0 con 0x7f2a400a1380 2023-09-30T22:21:41.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.291+0000 7f02be5a1700 1 -- 172.21.15.156:0/1815551954 shutdown_connections 2023-09-30T22:21:41.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.291+0000 7f02be5a1700 1 --2- 172.21.15.156:0/1815551954 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02b8138790 0x7f02b8134fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.291+0000 7f02be5a1700 1 --2- 172.21.15.156:0/1815551954 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02b806a770 0x7f02b8134540 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.291+0000 7f02be5a1700 1 --2- 172.21.15.156:0/1815551954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02b8130c30 0x7f02b8134a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.291+0000 7f02be5a1700 1 -- 172.21.15.156:0/1815551954 >> 172.21.15.156:0/1815551954 conn(0x7f02b80a2d80 msgr2=0x7f02b809f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:41.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.291+0000 7f2a476b3700 1 -- 172.21.15.156:0/3021540503 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a4011f760 con 0x7f2a400a1380 2023-09-30T22:21:41.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.291+0000 7f02be5a1700 1 -- 172.21.15.156:0/1815551954 shutdown_connections 2023-09-30T22:21:41.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.291+0000 7f02be5a1700 1 -- 172.21.15.156:0/1815551954 wait complete. 2023-09-30T22:21:41.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.291+0000 7f2a35ffb700 1 -- 172.21.15.156:0/3021540503 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2a300479a0 con 0x7f2a400a1380 2023-09-30T22:21:41.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.297+0000 7f2a35ffb700 1 -- 172.21.15.156:0/3021540503 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a3001f440 con 0x7f2a400a1380 2023-09-30T22:21:41.303 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:41.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.446+0000 7f34058e6700 1 -- 172.21.15.156:0/1383364643 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3400125e50 con 0x7f34000a0a70 2023-09-30T22:21:41.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.447+0000 7f33e7fff700 1 -- 172.21.15.156:0/1383364643 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f33f0034090 con 0x7f34000a0a70 2023-09-30T22:21:41.447 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:41.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.449+0000 7f34058e6700 1 -- 172.21.15.156:0/1383364643 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34000a0a70 msgr2=0x7f3400122a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:41.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.449+0000 7f34058e6700 1 --2- 172.21.15.156:0/1383364643 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34000a0a70 0x7f3400122a40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f33f00090b0 tx=0x7f33f0004750 comp rx=0 tx=0).stop 2023-09-30T22:21:41.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.449+0000 7f34058e6700 1 -- 172.21.15.156:0/1383364643 shutdown_connections 2023-09-30T22:21:41.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.449+0000 7f34058e6700 1 --2- 172.21.15.156:0/1383364643 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3400134120 0x7f34001234c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.449+0000 7f34058e6700 1 --2- 172.21.15.156:0/1383364643 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34000a0a70 0x7f3400122a40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.449+0000 7f34058e6700 1 --2- 172.21.15.156:0/1383364643 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34000a1380 0x7f3400122f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.449+0000 7f34058e6700 1 -- 172.21.15.156:0/1383364643 >> 172.21.15.156:0/1383364643 conn(0x7f34000a6610 msgr2=0x7f34000a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:41.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.449+0000 7f34058e6700 1 -- 172.21.15.156:0/1383364643 shutdown_connections 2023-09-30T22:21:41.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.449+0000 7f34058e6700 1 -- 172.21.15.156:0/1383364643 wait complete. 2023-09-30T22:21:41.460 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:41.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.487+0000 7f2a476b3700 1 -- 172.21.15.156:0/3021540503 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2a400a5a00 con 0x7f2a400a1380 2023-09-30T22:21:41.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.487+0000 7f2a35ffb700 1 -- 172.21.15.156:0/3021540503 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2a30024020 con 0x7f2a400a1380 2023-09-30T22:21:41.487 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:41.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.489+0000 7f2a476b3700 1 -- 172.21.15.156:0/3021540503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a400a1380 msgr2=0x7f2a40122a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:41.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.489+0000 7f2a476b3700 1 --2- 172.21.15.156:0/3021540503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a400a1380 0x7f2a40122a80 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f2a30009e70 tx=0x7f2a3000ee90 comp rx=0 tx=0).stop 2023-09-30T22:21:41.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.489+0000 7f2a476b3700 1 -- 172.21.15.156:0/3021540503 shutdown_connections 2023-09-30T22:21:41.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.489+0000 7f2a476b3700 1 --2- 172.21.15.156:0/3021540503 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a40133f50 0x7f2a40122fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.489+0000 7f2a476b3700 1 --2- 172.21.15.156:0/3021540503 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a400a0a70 0x7f2a40122540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.489+0000 7f2a476b3700 1 --2- 172.21.15.156:0/3021540503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a400a1380 0x7f2a40122a80 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.489+0000 7f2a476b3700 1 -- 172.21.15.156:0/3021540503 >> 172.21.15.156:0/3021540503 conn(0x7f2a400a6610 msgr2=0x7f2a4011c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:41.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.489+0000 7f2a476b3700 1 -- 172.21.15.156:0/3021540503 shutdown_connections 2023-09-30T22:21:41.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.489+0000 7f2a476b3700 1 -- 172.21.15.156:0/3021540503 wait complete. 2023-09-30T22:21:41.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:41.538 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:41.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.664+0000 7f7b23d1a700 1 Processor -- start 2023-09-30T22:21:41.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.664+0000 7f7b23d1a700 1 -- start start 2023-09-30T22:21:41.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.665+0000 7f7b23d1a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7b1c09e340 0x7f7b1c1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:41.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.665+0000 7f7b23d1a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b1c135f20 0x7f7b1c138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:41.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.665+0000 7f7b23d1a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b1c09aaa0 con 0x7f7b1c09d860 2023-09-30T22:21:41.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.665+0000 7f7b23d1a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1c09e730 con 0x7f7b1c09e340 2023-09-30T22:21:41.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.665+0000 7f7b23d1a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c09f870 con 0x7f7b1c135f20 2023-09-30T22:21:41.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.665+0000 7f7b212b5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7b1c09e340 0x7f7b1c1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:41.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.665+0000 7f7b222b7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b1c135f20 0x7f7b1c138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:41.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.665+0000 7f7b21ab6700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f7b1c09d860 0x7f7b1c09dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45114/0 (socket says 172.21.15.156:45114) 2023-09-30T22:21:41.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.665+0000 7f7b21ab6700 1 -- 172.21.15.156:0/3631771861 learned_addr learned my addr 172.21.15.156:0/3631771861 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:41.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.665+0000 7f7b222b7700 1 -- 172.21.15.156:0/3631771861 >> v2:172.21.15.156:3300/0 conn(0x7f7b1c09e340 msgr2=0x7f7b1c1359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:41.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.665+0000 7f7b222b7700 1 --2- 172.21.15.156:0/3631771861 >> v2:172.21.15.156:3300/0 conn(0x7f7b1c09e340 0x7f7b1c1359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.665+0000 7f7b222b7700 1 -- 172.21.15.156:0/3631771861 >> v1:172.21.15.156:6789/0 conn(0x7f7b1c09d860 legacy=0x7f7b1c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:41.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.665+0000 7f7b222b7700 1 -- 172.21.15.156:0/3631771861 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1c09b360 con 0x7f7b1c135f20 2023-09-30T22:21:41.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.665+0000 7f7b20ab4700 1 -- 172.21.15.156:0/3631771861 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4027257318 0 0) 0x7f7b1c09aaa0 con 0x7f7b1c09d860 2023-09-30T22:21:41.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.665+0000 7f7b212b5700 1 --2- 172.21.15.156:0/3631771861 >> v2:172.21.15.156:3300/0 conn(0x7f7b1c09e340 0x7f7b1c1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:41.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.665+0000 7f7b222b7700 1 --2- 172.21.15.156:0/3631771861 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b1c135f20 0x7f7b1c138300 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009dc0 tx=0x7f7b1400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c961b9c9386b7f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:41.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.666+0000 7f7b20ab4700 1 -- 172.21.15.156:0/3631771861 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1400e070 con 0x7f7b1c135f20 2023-09-30T22:21:41.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.666+0000 7f7b20ab4700 1 -- 172.21.15.156:0/3631771861 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1400bae0 con 0x7f7b1c135f20 2023-09-30T22:21:41.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.666+0000 7f7b20ab4700 1 -- 172.21.15.156:0/3631771861 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1400be90 con 0x7f7b1c135f20 2023-09-30T22:21:41.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.666+0000 7f7b23d1a700 1 -- 172.21.15.156:0/3631771861 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b1c135f20 msgr2=0x7f7b1c138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:41.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.666+0000 7f7b23d1a700 1 --2- 172.21.15.156:0/3631771861 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b1c135f20 0x7f7b1c138300 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009dc0 tx=0x7f7b1400b330 comp rx=0 tx=0).stop 2023-09-30T22:21:41.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.666+0000 7f7b23d1a700 1 -- 172.21.15.156:0/3631771861 shutdown_connections 2023-09-30T22:21:41.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.666+0000 7f7b23d1a700 1 --2- 172.21.15.156:0/3631771861 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b1c135f20 0x7f7b1c138300 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.666+0000 7f7b23d1a700 1 --2- 172.21.15.156:0/3631771861 >> v2:172.21.15.156:3300/0 conn(0x7f7b1c09e340 0x7f7b1c1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.666+0000 7f7b23d1a700 1 -- 172.21.15.156:0/3631771861 >> 172.21.15.156:0/3631771861 conn(0x7f7b1c099c40 msgr2=0x7f7b1c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:41.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.666+0000 7f7b23d1a700 1 -- 172.21.15.156:0/3631771861 shutdown_connections 2023-09-30T22:21:41.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.666+0000 7f7b23d1a700 1 -- 172.21.15.156:0/3631771861 wait complete. 2023-09-30T22:21:41.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.667+0000 7f7b23d1a700 1 Processor -- start 2023-09-30T22:21:41.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.667+0000 7f7b23d1a700 1 -- start start 2023-09-30T22:21:41.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.668+0000 7f7b23d1a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b1c09d860 0x7f7b1c11e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:41.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.668+0000 7f7b23d1a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b1c09e340 0x7f7b1c11e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:41.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.668+0000 7f7b23d1a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b1c135f20 0x7f7b1c11ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:41.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.668+0000 7f7b23d1a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c121940 con 0x7f7b1c135f20 2023-09-30T22:21:41.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.668+0000 7f7b23d1a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c120500 con 0x7f7b1c09d860 2023-09-30T22:21:41.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.668+0000 7f7b23d1a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c09c8b0 con 0x7f7b1c09e340 2023-09-30T22:21:41.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.668+0000 7f7b21ab6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b1c09d860 0x7f7b1c11e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:41.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.668+0000 7f7b212b5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b1c09e340 0x7f7b1c11e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:41.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.668+0000 7f7b21ab6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b1c09d860 0x7f7b1c11e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53114/0 (socket says 172.21.15.156:53114) 2023-09-30T22:21:41.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.668+0000 7f7b212b5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b1c09e340 0x7f7b1c11e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44812/0 (socket says 172.21.15.156:44812) 2023-09-30T22:21:41.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.668+0000 7f7b21ab6700 1 -- 172.21.15.156:0/171960355 learned_addr learned my addr 172.21.15.156:0/171960355 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:41.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.668+0000 7f7b222b7700 1 --2- 172.21.15.156:0/171960355 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b1c135f20 0x7f7b1c11ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:41.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.668+0000 7f7b21ab6700 1 -- 172.21.15.156:0/171960355 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b1c09e340 msgr2=0x7f7b1c11e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:41.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.668+0000 7f7b21ab6700 1 --2- 172.21.15.156:0/171960355 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b1c09e340 0x7f7b1c11e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.668+0000 7f7b21ab6700 1 -- 172.21.15.156:0/171960355 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b1c135f20 msgr2=0x7f7b1c11ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:41.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.668+0000 7f7b21ab6700 1 --2- 172.21.15.156:0/171960355 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b1c135f20 0x7f7b1c11ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.668+0000 7f7b21ab6700 1 -- 172.21.15.156:0/171960355 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b180094a0 con 0x7f7b1c09d860 2023-09-30T22:21:41.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.668+0000 7f7b212b5700 1 --2- 172.21.15.156:0/171960355 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b1c09e340 0x7f7b1c11e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:41.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.668+0000 7f7b21ab6700 1 --2- 172.21.15.156:0/171960355 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b1c09d860 0x7f7b1c11e3a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00c550 tx=0x7f7b0c00c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:41.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.668+0000 7f7b127fc700 1 -- 172.21.15.156:0/171960355 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c004c80 con 0x7f7b1c09d860 2023-09-30T22:21:41.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.668+0000 7f7b127fc700 1 -- 172.21.15.156:0/171960355 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0c004e00 con 0x7f7b1c09d860 2023-09-30T22:21:41.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.668+0000 7f7b23d1a700 1 -- 172.21.15.156:0/171960355 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b14009a70 con 0x7f7b1c09d860 2023-09-30T22:21:41.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.668+0000 7f7b127fc700 1 -- 172.21.15.156:0/171960355 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c007310 con 0x7f7b1c09d860 2023-09-30T22:21:41.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.668+0000 7f7b23d1a700 1 -- 172.21.15.156:0/171960355 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b1c0a0820 con 0x7f7b1c09d860 2023-09-30T22:21:41.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.669+0000 7f7b127fc700 1 -- 172.21.15.156:0/171960355 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7b0c007470 con 0x7f7b1c09d860 2023-09-30T22:21:41.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.669+0000 7f7b127fc700 1 -- 172.21.15.156:0/171960355 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7b0c03f3c0 con 0x7f7b1c09d860 2023-09-30T22:21:41.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.669+0000 7f7b23d1a700 1 -- 172.21.15.156:0/171960355 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b1c121770 con 0x7f7b1c09d860 2023-09-30T22:21:41.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.674+0000 7f7b127fc700 1 -- 172.21.15.156:0/171960355 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7b0c0123b0 con 0x7f7b1c09d860 2023-09-30T22:21:41.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.859+0000 7f7b23d1a700 1 -- 172.21.15.156:0/171960355 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7b1c04f2a0 con 0x7f7b1c09d860 2023-09-30T22:21:41.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.859+0000 7f7b127fc700 1 -- 172.21.15.156:0/171960355 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7b0c011360 con 0x7f7b1c09d860 2023-09-30T22:21:41.859 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:41.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.861+0000 7f7b23d1a700 1 -- 172.21.15.156:0/171960355 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b1c09d860 msgr2=0x7f7b1c11e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:41.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.861+0000 7f7b23d1a700 1 --2- 172.21.15.156:0/171960355 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b1c09d860 0x7f7b1c11e3a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00c550 tx=0x7f7b0c00c860 comp rx=0 tx=0).stop 2023-09-30T22:21:41.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.861+0000 7f7b23d1a700 1 -- 172.21.15.156:0/171960355 shutdown_connections 2023-09-30T22:21:41.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.861+0000 7f7b23d1a700 1 --2- 172.21.15.156:0/171960355 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b1c135f20 0x7f7b1c11ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.861+0000 7f7b23d1a700 1 --2- 172.21.15.156:0/171960355 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7b1c09d860 0x7f7b1c11e3a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.861+0000 7f7b23d1a700 1 --2- 172.21.15.156:0/171960355 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7b1c09e340 0x7f7b1c11e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:41.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.861+0000 7f7b23d1a700 1 -- 172.21.15.156:0/171960355 >> 172.21.15.156:0/171960355 conn(0x7f7b1c099c40 msgr2=0x7f7b1c0a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:41.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.861+0000 7f7b23d1a700 1 -- 172.21.15.156:0/171960355 shutdown_connections 2023-09-30T22:21:41.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:41.861+0000 7f7b23d1a700 1 -- 172.21.15.156:0/171960355 wait complete. 2023-09-30T22:21:41.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:42.305 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:42.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.431+0000 7f2e6d321700 1 Processor -- start 2023-09-30T22:21:42.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.431+0000 7f2e6d321700 1 -- start start 2023-09-30T22:21:42.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.432+0000 7f2e6d321700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2e6809e870 0x7f2e6809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.432+0000 7f2e6d321700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e6809f180 0x7f2e68131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.432+0000 7f2e6d321700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e68131d70 0x7f2e681321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.432+0000 7f2e6d321700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e680a0920 con 0x7f2e6809e870 2023-09-30T22:21:42.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.432+0000 7f2e6d321700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6809c970 con 0x7f2e68131d70 2023-09-30T22:21:42.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.432+0000 7f2e6d321700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6809bab0 con 0x7f2e6809f180 2023-09-30T22:21:42.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.432+0000 7f2e66ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2e6809e870 0x7f2e6809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.432+0000 7f2e667fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e6809f180 0x7f2e68131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.432+0000 7f2e66ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2e6809e870 0x7f2e6809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33022/0 (socket says 172.21.15.156:33022) 2023-09-30T22:21:42.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.432+0000 7f2e66ffd700 1 -- 172.21.15.156:0/904190638 learned_addr learned my addr 172.21.15.156:0/904190638 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:42.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.432+0000 7f2e677fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e68131d70 0x7f2e681321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.432+0000 7f2e66ffd700 1 -- 172.21.15.156:0/904190638 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e6809f180 msgr2=0x7f2e68131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:42.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.432+0000 7f2e66ffd700 1 --2- 172.21.15.156:0/904190638 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e6809f180 0x7f2e68131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.432+0000 7f2e66ffd700 1 -- 172.21.15.156:0/904190638 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e68131d70 msgr2=0x7f2e681321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:42.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.432+0000 7f2e66ffd700 1 --2- 172.21.15.156:0/904190638 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e68131d70 0x7f2e681321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.432+0000 7f2e66ffd700 1 -- 172.21.15.156:0/904190638 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6809f9c0 con 0x7f2e6809e870 2023-09-30T22:21:42.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.432+0000 7f2e667fc700 1 --2- 172.21.15.156:0/904190638 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e6809f180 0x7f2e68131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:42.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.432+0000 7f2e677fe700 1 --2- 172.21.15.156:0/904190638 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e68131d70 0x7f2e681321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:42.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.432+0000 7f2e66ffd700 1 --2- 172.21.15.156:0/904190638 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e6809e870 0x7f2e6809ec40 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c00dd40 tx=0x7f2e5c00f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4251d90f1117c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:42.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.433+0000 7f2e65ffb700 1 -- 172.21.15.156:0/904190638 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c012070 con 0x7f2e6809e870 2023-09-30T22:21:42.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.433+0000 7f2e65ffb700 1 -- 172.21.15.156:0/904190638 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5c00de90 con 0x7f2e6809e870 2023-09-30T22:21:42.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.433+0000 7f2e65ffb700 1 -- 172.21.15.156:0/904190638 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c00faf0 con 0x7f2e6809e870 2023-09-30T22:21:42.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.433+0000 7f2e6d321700 1 -- 172.21.15.156:0/904190638 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e6809e870 msgr2=0x7f2e6809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:42.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.433+0000 7f2e6d321700 1 --2- 172.21.15.156:0/904190638 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e6809e870 0x7f2e6809ec40 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c00dd40 tx=0x7f2e5c00f330 comp rx=0 tx=0).stop 2023-09-30T22:21:42.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.433+0000 7f2e6d321700 1 -- 172.21.15.156:0/904190638 shutdown_connections 2023-09-30T22:21:42.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.433+0000 7f2e6d321700 1 --2- 172.21.15.156:0/904190638 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e68131d70 0x7f2e681321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.433+0000 7f2e6d321700 1 --2- 172.21.15.156:0/904190638 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e6809e870 0x7f2e6809ec40 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.433+0000 7f2e6d321700 1 --2- 172.21.15.156:0/904190638 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e6809f180 0x7f2e68131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.433+0000 7f2e6d321700 1 -- 172.21.15.156:0/904190638 >> 172.21.15.156:0/904190638 conn(0x7f2e680a4430 msgr2=0x7f2e680a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:42.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.433+0000 7f2e6d321700 1 -- 172.21.15.156:0/904190638 shutdown_connections 2023-09-30T22:21:42.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.433+0000 7f2e6d321700 1 -- 172.21.15.156:0/904190638 wait complete. 2023-09-30T22:21:42.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.435+0000 7f2e6d321700 1 Processor -- start 2023-09-30T22:21:42.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.435+0000 7f2e6d321700 1 -- start start 2023-09-30T22:21:42.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.435+0000 7f2e6d321700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e6809e870 0x7f2e681c4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.435+0000 7f2e6d321700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e6809f180 0x7f2e681c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.435+0000 7f2e6d321700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e68131d70 0x7f2e681c07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.435+0000 7f2e6d321700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e680a29b0 con 0x7f2e68131d70 2023-09-30T22:21:42.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.435+0000 7f2e6d321700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6809dba0 con 0x7f2e6809e870 2023-09-30T22:21:42.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.435+0000 7f2e6d321700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6811f2d0 con 0x7f2e6809f180 2023-09-30T22:21:42.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.435+0000 7f2e66ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e6809e870 0x7f2e681c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.435+0000 7f2e66ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e6809e870 0x7f2e681c4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53130/0 (socket says 172.21.15.156:53130) 2023-09-30T22:21:42.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.435+0000 7f2e667fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e6809f180 0x7f2e681c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.435+0000 7f2e66ffd700 1 -- 172.21.15.156:0/2090649180 learned_addr learned my addr 172.21.15.156:0/2090649180 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:42.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.435+0000 7f2e677fe700 1 --2- 172.21.15.156:0/2090649180 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e68131d70 0x7f2e681c07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.436+0000 7f2e667fc700 1 -- 172.21.15.156:0/2090649180 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e6809e870 msgr2=0x7f2e681c4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:42.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.436+0000 7f2e667fc700 1 --2- 172.21.15.156:0/2090649180 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e6809e870 0x7f2e681c4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.436+0000 7f2e667fc700 1 -- 172.21.15.156:0/2090649180 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e68131d70 msgr2=0x7f2e681c07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:42.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.436+0000 7f2e667fc700 1 --2- 172.21.15.156:0/2090649180 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e68131d70 0x7f2e681c07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.436+0000 7f2e667fc700 1 -- 172.21.15.156:0/2090649180 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e580094a0 con 0x7f2e6809f180 2023-09-30T22:21:42.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.436+0000 7f2e66ffd700 1 --2- 172.21.15.156:0/2090649180 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e6809e870 0x7f2e681c4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:42.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.436+0000 7f2e667fc700 1 --2- 172.21.15.156:0/2090649180 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e6809f180 0x7f2e681c4850 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800e9b0 tx=0x7f2e5800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:42.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.436+0000 7f2e4f7fe700 1 -- 172.21.15.156:0/2090649180 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5800ee40 con 0x7f2e6809f180 2023-09-30T22:21:42.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.436+0000 7f2e4f7fe700 1 -- 172.21.15.156:0/2090649180 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e58004030 con 0x7f2e6809f180 2023-09-30T22:21:42.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.436+0000 7f2e6d321700 1 -- 172.21.15.156:0/2090649180 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e60009a70 con 0x7f2e6809f180 2023-09-30T22:21:42.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.436+0000 7f2e4f7fe700 1 -- 172.21.15.156:0/2090649180 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e580043c0 con 0x7f2e6809f180 2023-09-30T22:21:42.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.436+0000 7f2e6d321700 1 -- 172.21.15.156:0/2090649180 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e5c00d9f0 con 0x7f2e6809f180 2023-09-30T22:21:42.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.437+0000 7f2e4f7fe700 1 -- 172.21.15.156:0/2090649180 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e5800c7f0 con 0x7f2e6809f180 2023-09-30T22:21:42.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.437+0000 7f2e4f7fe700 1 -- 172.21.15.156:0/2090649180 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2e5803f810 con 0x7f2e6809f180 2023-09-30T22:21:42.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.437+0000 7f2e6d321700 1 -- 172.21.15.156:0/2090649180 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6811f440 con 0x7f2e6809f180 2023-09-30T22:21:42.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.442+0000 7f2e4f7fe700 1 -- 172.21.15.156:0/2090649180 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e58011db0 con 0x7f2e6809f180 2023-09-30T22:21:42.461 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:42.502 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:42.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.591+0000 7f52ab4a5700 1 Processor -- start 2023-09-30T22:21:42.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.592+0000 7f52ab4a5700 1 -- start start 2023-09-30T22:21:42.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.592+0000 7f52ab4a5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52a4133ad0 0x7f52a4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.592+0000 7f52ab4a5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f52a41300a0 0x7f52a41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.592+0000 7f52ab4a5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f52a41309f0 0x7f52a413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.592+0000 7f52ab4a5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a406b2d0 con 0x7f52a41309f0 2023-09-30T22:21:42.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.592+0000 7f52ab4a5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a4133610 con 0x7f52a4133ad0 2023-09-30T22:21:42.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.592+0000 7f52ab4a5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52a409a500 con 0x7f52a41300a0 2023-09-30T22:21:42.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.592+0000 7f52a9a42700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f52a41309f0 0x7f52a413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.592+0000 7f52a8a40700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f52a41300a0 0x7f52a41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.592+0000 7f52a9241700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52a4133ad0 0x7f52a4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.592+0000 7f52a9a42700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f52a41309f0 0x7f52a413a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33046/0 (socket says 172.21.15.156:33046) 2023-09-30T22:21:42.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.592+0000 7f52a8a40700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f52a41300a0 0x7f52a41304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44846/0 (socket says 172.21.15.156:44846) 2023-09-30T22:21:42.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.592+0000 7f52a9a42700 1 -- 172.21.15.156:0/2884329496 learned_addr learned my addr 172.21.15.156:0/2884329496 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:42.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.593+0000 7f52a9a42700 1 -- 172.21.15.156:0/2884329496 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f52a41300a0 msgr2=0x7f52a41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:42.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.593+0000 7f52a9a42700 1 --2- 172.21.15.156:0/2884329496 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f52a41300a0 0x7f52a41304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.593+0000 7f52a9a42700 1 -- 172.21.15.156:0/2884329496 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52a4133ad0 msgr2=0x7f52a4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:42.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.593+0000 7f52a9a42700 1 --2- 172.21.15.156:0/2884329496 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52a4133ad0 0x7f52a4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.593+0000 7f52a9a42700 1 -- 172.21.15.156:0/2884329496 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a41338b0 con 0x7f52a41309f0 2023-09-30T22:21:42.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.593+0000 7f52a9241700 1 --2- 172.21.15.156:0/2884329496 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52a4133ad0 0x7f52a4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:42.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.593+0000 7f52a9a42700 1 --2- 172.21.15.156:0/2884329496 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52a41309f0 0x7f52a413a980 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f529c009e50 tx=0x7f529c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac230d2531de7974 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:42.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.593+0000 7f529bfff700 1 -- 172.21.15.156:0/2884329496 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c00e070 con 0x7f52a41309f0 2023-09-30T22:21:42.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.593+0000 7f529bfff700 1 -- 172.21.15.156:0/2884329496 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529c00b910 con 0x7f52a41309f0 2023-09-30T22:21:42.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.593+0000 7f529bfff700 1 -- 172.21.15.156:0/2884329496 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c00bcc0 con 0x7f52a41309f0 2023-09-30T22:21:42.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.594+0000 7f52ab4a5700 1 -- 172.21.15.156:0/2884329496 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52a41309f0 msgr2=0x7f52a413a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:42.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.594+0000 7f52ab4a5700 1 --2- 172.21.15.156:0/2884329496 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52a41309f0 0x7f52a413a980 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f529c009e50 tx=0x7f529c00b330 comp rx=0 tx=0).stop 2023-09-30T22:21:42.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.594+0000 7f52ab4a5700 1 -- 172.21.15.156:0/2884329496 shutdown_connections 2023-09-30T22:21:42.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.594+0000 7f52ab4a5700 1 --2- 172.21.15.156:0/2884329496 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52a41309f0 0x7f52a413a980 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.594+0000 7f52ab4a5700 1 --2- 172.21.15.156:0/2884329496 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52a4133ad0 0x7f52a4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.594+0000 7f52ab4a5700 1 --2- 172.21.15.156:0/2884329496 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f52a41300a0 0x7f52a41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.594+0000 7f52ab4a5700 1 -- 172.21.15.156:0/2884329496 >> 172.21.15.156:0/2884329496 conn(0x7f52a4099c40 msgr2=0x7f52a40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:42.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.594+0000 7f52ab4a5700 1 -- 172.21.15.156:0/2884329496 shutdown_connections 2023-09-30T22:21:42.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.594+0000 7f52ab4a5700 1 -- 172.21.15.156:0/2884329496 wait complete. 2023-09-30T22:21:42.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.595+0000 7f52ab4a5700 1 Processor -- start 2023-09-30T22:21:42.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.595+0000 7f52ab4a5700 1 -- start start 2023-09-30T22:21:42.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.595+0000 7f52ab4a5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52a41300a0 0x7f52a411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.595+0000 7f52ab4a5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52a41309f0 0x7f52a411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.595+0000 7f52ab4a5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f52a4133ad0 0x7f52a411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.595+0000 7f52ab4a5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a412da10 con 0x7f52a41300a0 2023-09-30T22:21:42.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.595+0000 7f52ab4a5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a412dd00 con 0x7f52a41309f0 2023-09-30T22:21:42.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.595+0000 7f52ab4a5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52a411fe50 con 0x7f52a4133ad0 2023-09-30T22:21:42.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.596+0000 7f52a9241700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52a41300a0 0x7f52a411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.596+0000 7f52a8a40700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52a41309f0 0x7f52a411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.596+0000 7f52a9241700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52a41300a0 0x7f52a411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33056/0 (socket says 172.21.15.156:33056) 2023-09-30T22:21:42.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.596+0000 7f52a9241700 1 -- 172.21.15.156:0/2259222917 learned_addr learned my addr 172.21.15.156:0/2259222917 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:42.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.596+0000 7f52a9a42700 1 --2- 172.21.15.156:0/2259222917 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f52a4133ad0 0x7f52a411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.596+0000 7f52a9241700 1 -- 172.21.15.156:0/2259222917 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f52a4133ad0 msgr2=0x7f52a411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:42.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.596+0000 7f52a9241700 1 --2- 172.21.15.156:0/2259222917 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f52a4133ad0 0x7f52a411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.596+0000 7f52a9241700 1 -- 172.21.15.156:0/2259222917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52a41309f0 msgr2=0x7f52a411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:42.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.596+0000 7f52a9241700 1 --2- 172.21.15.156:0/2259222917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52a41309f0 0x7f52a411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.596+0000 7f52a9241700 1 -- 172.21.15.156:0/2259222917 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a00094a0 con 0x7f52a41300a0 2023-09-30T22:21:42.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.596+0000 7f52a9a42700 1 --2- 172.21.15.156:0/2259222917 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f52a4133ad0 0x7f52a411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:42.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.596+0000 7f52a8a40700 1 --2- 172.21.15.156:0/2259222917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52a41309f0 0x7f52a411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:42.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.596+0000 7f52a9241700 1 --2- 172.21.15.156:0/2259222917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52a41300a0 0x7f52a411da40 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f52a000ebe0 tx=0x7f52a000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:42.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.596+0000 7f5299ffb700 1 -- 172.21.15.156:0/2259222917 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a000c850 con 0x7f52a41300a0 2023-09-30T22:21:42.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.596+0000 7f5299ffb700 1 -- 172.21.15.156:0/2259222917 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a000c9b0 con 0x7f52a41300a0 2023-09-30T22:21:42.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.596+0000 7f52ab4a5700 1 -- 172.21.15.156:0/2259222917 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f529c009b30 con 0x7f52a41300a0 2023-09-30T22:21:42.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.596+0000 7f5299ffb700 1 -- 172.21.15.156:0/2259222917 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a000cd40 con 0x7f52a41300a0 2023-09-30T22:21:42.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.597+0000 7f52ab4a5700 1 -- 172.21.15.156:0/2259222917 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a411ef90 con 0x7f52a41300a0 2023-09-30T22:21:42.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.597+0000 7f5299ffb700 1 -- 172.21.15.156:0/2259222917 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f52a0013470 con 0x7f52a41300a0 2023-09-30T22:21:42.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.597+0000 7f5299ffb700 1 -- 172.21.15.156:0/2259222917 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f52a003f760 con 0x7f52a41300a0 2023-09-30T22:21:42.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.598+0000 7f52ab4a5700 1 -- 172.21.15.156:0/2259222917 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a404f2a0 con 0x7f52a41300a0 2023-09-30T22:21:42.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.603+0000 7f5299ffb700 1 -- 172.21.15.156:0/2259222917 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f52a0013720 con 0x7f52a41300a0 2023-09-30T22:21:42.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.636+0000 7fb2e92b2700 1 Processor -- start 2023-09-30T22:21:42.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.636+0000 7fb2e92b2700 1 -- start start 2023-09-30T22:21:42.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.636+0000 7fb2e92b2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2e40a0a70 0x7fb2e40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.636+0000 7fb2e92b2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb2e40a1380 0x7fb2e4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.636+0000 7fb2e92b2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2e4133f50 0x7fb2e4134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.636+0000 7fb2e92b2700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e409e9d0 con 0x7fb2e40a1380 2023-09-30T22:21:42.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.636+0000 7fb2e92b2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e409dc00 con 0x7fb2e4133f50 2023-09-30T22:21:42.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.636+0000 7fb2e92b2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e409dec0 con 0x7fb2e40a0a70 2023-09-30T22:21:42.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.636+0000 7fb2e27fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb2e40a1380 0x7fb2e4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.636+0000 7fb2e27fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb2e40a1380 0x7fb2e4133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33066/0 (socket says 172.21.15.156:33066) 2023-09-30T22:21:42.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.636+0000 7fb2e27fc700 1 -- 172.21.15.156:0/486265577 learned_addr learned my addr 172.21.15.156:0/486265577 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:42.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.636+0000 7fb2e2ffd700 1 --2- 172.21.15.156:0/486265577 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2e40a0a70 0x7fb2e40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.636+0000 7fb2e37fe700 1 --2- 172.21.15.156:0/486265577 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2e4133f50 0x7fb2e4134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.637+0000 7fb2e2ffd700 1 -- 172.21.15.156:0/486265577 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2e4133f50 msgr2=0x7fb2e4134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:42.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.637+0000 7fb2e2ffd700 1 --2- 172.21.15.156:0/486265577 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2e4133f50 0x7fb2e4134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.637+0000 7fb2e2ffd700 1 -- 172.21.15.156:0/486265577 >> v2:172.21.15.156:3300/0 conn(0x7fb2e40a1380 msgr2=0x7fb2e4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:42.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.637+0000 7fb2e2ffd700 1 --2- 172.21.15.156:0/486265577 >> v2:172.21.15.156:3300/0 conn(0x7fb2e40a1380 0x7fb2e4133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.637+0000 7fb2e2ffd700 1 -- 172.21.15.156:0/486265577 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e409e6a0 con 0x7fb2e40a0a70 2023-09-30T22:21:42.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.637+0000 7fb2e37fe700 1 --2- 172.21.15.156:0/486265577 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2e4133f50 0x7fb2e4134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:42.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.637+0000 7fb2e2ffd700 1 --2- 172.21.15.156:0/486265577 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2e40a0a70 0x7fb2e40a0e40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009840 tx=0x7fb2d4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c90a2eeed2f8fb25 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:42.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.637+0000 7fb2e1ffb700 1 -- 172.21.15.156:0/486265577 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4011830 con 0x7fb2e40a0a70 2023-09-30T22:21:42.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.637+0000 7fb2e1ffb700 1 -- 172.21.15.156:0/486265577 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d4011990 con 0x7fb2e40a0a70 2023-09-30T22:21:42.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.637+0000 7fb2e1ffb700 1 -- 172.21.15.156:0/486265577 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4011d20 con 0x7fb2e40a0a70 2023-09-30T22:21:42.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.637+0000 7fb2e92b2700 1 -- 172.21.15.156:0/486265577 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2e40a0a70 msgr2=0x7fb2e40a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:42.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.637+0000 7fb2e92b2700 1 --2- 172.21.15.156:0/486265577 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2e40a0a70 0x7fb2e40a0e40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009840 tx=0x7fb2d4009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:42.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.638+0000 7fb2e92b2700 1 -- 172.21.15.156:0/486265577 shutdown_connections 2023-09-30T22:21:42.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.638+0000 7fb2e92b2700 1 --2- 172.21.15.156:0/486265577 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2e4133f50 0x7fb2e4134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.638+0000 7fb2e92b2700 1 --2- 172.21.15.156:0/486265577 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2e40a0a70 0x7fb2e40a0e40 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.638+0000 7fb2e92b2700 1 --2- 172.21.15.156:0/486265577 >> v2:172.21.15.156:3300/0 conn(0x7fb2e40a1380 0x7fb2e4133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.638+0000 7fb2e92b2700 1 -- 172.21.15.156:0/486265577 >> 172.21.15.156:0/486265577 conn(0x7fb2e40a6610 msgr2=0x7fb2e40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:42.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.638+0000 7fb2e92b2700 1 -- 172.21.15.156:0/486265577 shutdown_connections 2023-09-30T22:21:42.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.638+0000 7fb2e92b2700 1 -- 172.21.15.156:0/486265577 wait complete. 2023-09-30T22:21:42.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.639+0000 7fb2e92b2700 1 Processor -- start 2023-09-30T22:21:42.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.639+0000 7fb2e92b2700 1 -- start start 2023-09-30T22:21:42.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.639+0000 7fb2e92b2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2e40a0a70 0x7fb2e41c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.639+0000 7fb2e92b2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2e40a1380 0x7fb2e41c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.639+0000 7fb2e92b2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2e4133f50 0x7fb2e41c07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.639+0000 7fb2e92b2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e41c4ca0 con 0x7fb2e4133f50 2023-09-30T22:21:42.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.639+0000 7fb2e92b2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e40a03e0 con 0x7fb2e40a1380 2023-09-30T22:21:42.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.639+0000 7fb2e92b2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e4120d60 con 0x7fb2e40a0a70 2023-09-30T22:21:42.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.639+0000 7fb2e2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2e40a0a70 0x7fb2e41c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.639+0000 7fb2e27fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2e40a1380 0x7fb2e41c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.639+0000 7fb2e2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2e40a0a70 0x7fb2e41c4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44876/0 (socket says 172.21.15.156:44876) 2023-09-30T22:21:42.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.639+0000 7fb2e27fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2e40a1380 0x7fb2e41c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53156/0 (socket says 172.21.15.156:53156) 2023-09-30T22:21:42.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.639+0000 7fb2e2ffd700 1 -- 172.21.15.156:0/3539446328 learned_addr learned my addr 172.21.15.156:0/3539446328 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:42.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.639+0000 7fb2e37fe700 1 --2- 172.21.15.156:0/3539446328 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2e4133f50 0x7fb2e41c07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.640+0000 7fb2e27fc700 1 -- 172.21.15.156:0/3539446328 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2e40a0a70 msgr2=0x7fb2e41c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:42.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.640+0000 7fb2e27fc700 1 --2- 172.21.15.156:0/3539446328 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2e40a0a70 0x7fb2e41c4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.640+0000 7fb2e27fc700 1 -- 172.21.15.156:0/3539446328 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2e4133f50 msgr2=0x7fb2e41c07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:42.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.640+0000 7fb2e27fc700 1 --2- 172.21.15.156:0/3539446328 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2e4133f50 0x7fb2e41c07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.640+0000 7fb2e27fc700 1 -- 172.21.15.156:0/3539446328 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2dc009a70 con 0x7fb2e40a1380 2023-09-30T22:21:42.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.640+0000 7fb2e2ffd700 1 --2- 172.21.15.156:0/3539446328 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2e40a0a70 0x7fb2e41c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:42.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.640+0000 7fb2e27fc700 1 --2- 172.21.15.156:0/3539446328 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2e40a1380 0x7fb2e41c4760 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8016f10 tx=0x7fb2d8013390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:42.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.640+0000 7fb2cb7fe700 1 -- 172.21.15.156:0/3539446328 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8020070 con 0x7fb2e40a1380 2023-09-30T22:21:42.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.640+0000 7fb2cb7fe700 1 -- 172.21.15.156:0/3539446328 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d8013bb0 con 0x7fb2e40a1380 2023-09-30T22:21:42.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.640+0000 7fb2e92b2700 1 -- 172.21.15.156:0/3539446328 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d40094a0 con 0x7fb2e40a1380 2023-09-30T22:21:42.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.640+0000 7fb2cb7fe700 1 -- 172.21.15.156:0/3539446328 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8018040 con 0x7fb2e40a1380 2023-09-30T22:21:42.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.640+0000 7fb2e92b2700 1 -- 172.21.15.156:0/3539446328 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e4121560 con 0x7fb2e40a1380 2023-09-30T22:21:42.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.641+0000 7fb2cb7fe700 1 -- 172.21.15.156:0/3539446328 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb2d80110d0 con 0x7fb2e40a1380 2023-09-30T22:21:42.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.641+0000 7fb2e92b2700 1 -- 172.21.15.156:0/3539446328 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e411fc00 con 0x7fb2e40a1380 2023-09-30T22:21:42.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.641+0000 7fb2cb7fe700 1 -- 172.21.15.156:0/3539446328 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb2d8047570 con 0x7fb2e40a1380 2023-09-30T22:21:42.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.644+0000 7f2e6d321700 1 -- 172.21.15.156:0/2090649180 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2e6811f700 con 0x7f2e6809f180 2023-09-30T22:21:42.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.644+0000 7f2e4f7fe700 1 -- 172.21.15.156:0/2090649180 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e58011350 con 0x7f2e6809f180 2023-09-30T22:21:42.646 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:42.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.646+0000 7fb2cb7fe700 1 -- 172.21.15.156:0/3539446328 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2d8023720 con 0x7fb2e40a1380 2023-09-30T22:21:42.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.647+0000 7f2e6d321700 1 -- 172.21.15.156:0/2090649180 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e6809f180 msgr2=0x7f2e681c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:42.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.647+0000 7f2e6d321700 1 --2- 172.21.15.156:0/2090649180 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e6809f180 0x7f2e681c4850 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800e9b0 tx=0x7f2e5800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.647+0000 7f2e6d321700 1 -- 172.21.15.156:0/2090649180 shutdown_connections 2023-09-30T22:21:42.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.647+0000 7f2e6d321700 1 --2- 172.21.15.156:0/2090649180 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e68131d70 0x7f2e681c07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.647+0000 7f2e6d321700 1 --2- 172.21.15.156:0/2090649180 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e6809e870 0x7f2e681c4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.647+0000 7f2e6d321700 1 --2- 172.21.15.156:0/2090649180 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e6809f180 0x7f2e681c4850 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.647+0000 7f2e6d321700 1 -- 172.21.15.156:0/2090649180 >> 172.21.15.156:0/2090649180 conn(0x7f2e680a4430 msgr2=0x7f2e68130e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:42.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.647+0000 7f2e6d321700 1 -- 172.21.15.156:0/2090649180 shutdown_connections 2023-09-30T22:21:42.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.647+0000 7f2e6d321700 1 -- 172.21.15.156:0/2090649180 wait complete. 2023-09-30T22:21:42.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:42.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.799+0000 7f52ab4a5700 1 -- 172.21.15.156:0/2259222917 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f52a406c3b0 con 0x7f52a41300a0 2023-09-30T22:21:42.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.799+0000 7f5299ffb700 1 -- 172.21.15.156:0/2259222917 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f52a0021020 con 0x7f52a41300a0 2023-09-30T22:21:42.799 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:42.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.801+0000 7f52ab4a5700 1 -- 172.21.15.156:0/2259222917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52a41300a0 msgr2=0x7f52a411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:42.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.801+0000 7f52ab4a5700 1 --2- 172.21.15.156:0/2259222917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52a41300a0 0x7f52a411da40 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f52a000ebe0 tx=0x7f52a000eef0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.801+0000 7f52ab4a5700 1 -- 172.21.15.156:0/2259222917 shutdown_connections 2023-09-30T22:21:42.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.801+0000 7f52ab4a5700 1 --2- 172.21.15.156:0/2259222917 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f52a4133ad0 0x7f52a411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.801+0000 7f52ab4a5700 1 --2- 172.21.15.156:0/2259222917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52a41300a0 0x7f52a411da40 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.801+0000 7f52ab4a5700 1 --2- 172.21.15.156:0/2259222917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52a41309f0 0x7f52a411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.801+0000 7f52ab4a5700 1 -- 172.21.15.156:0/2259222917 >> 172.21.15.156:0/2259222917 conn(0x7f52a4099c40 msgr2=0x7f52a40a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:42.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.801+0000 7f52ab4a5700 1 -- 172.21.15.156:0/2259222917 shutdown_connections 2023-09-30T22:21:42.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.801+0000 7f52ab4a5700 1 -- 172.21.15.156:0/2259222917 wait complete. 2023-09-30T22:21:42.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:42.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.842+0000 7fb2e92b2700 1 -- 172.21.15.156:0/3539446328 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb2e404f2a0 con 0x7fb2e40a1380 2023-09-30T22:21:42.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.842+0000 7fb2cb7fe700 1 -- 172.21.15.156:0/3539446328 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb2d8024370 con 0x7fb2e40a1380 2023-09-30T22:21:42.842 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:42.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.844+0000 7fb2e92b2700 1 -- 172.21.15.156:0/3539446328 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2e40a1380 msgr2=0x7fb2e41c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:42.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.844+0000 7fb2e92b2700 1 --2- 172.21.15.156:0/3539446328 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2e40a1380 0x7fb2e41c4760 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8016f10 tx=0x7fb2d8013390 comp rx=0 tx=0).stop 2023-09-30T22:21:42.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.844+0000 7fb2e92b2700 1 -- 172.21.15.156:0/3539446328 shutdown_connections 2023-09-30T22:21:42.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.844+0000 7fb2e92b2700 1 --2- 172.21.15.156:0/3539446328 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2e4133f50 0x7fb2e41c07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.844+0000 7fb2e92b2700 1 --2- 172.21.15.156:0/3539446328 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2e40a0a70 0x7fb2e41c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.844+0000 7fb2e92b2700 1 --2- 172.21.15.156:0/3539446328 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2e40a1380 0x7fb2e41c4760 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.844+0000 7fb2e92b2700 1 -- 172.21.15.156:0/3539446328 >> 172.21.15.156:0/3539446328 conn(0x7fb2e40a6610 msgr2=0x7fb2e40a5370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:42.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.844+0000 7fb2e92b2700 1 -- 172.21.15.156:0/3539446328 shutdown_connections 2023-09-30T22:21:42.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:42.845+0000 7fb2e92b2700 1 -- 172.21.15.156:0/3539446328 wait complete. 2023-09-30T22:21:42.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:42.874 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:43.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.018+0000 7fb230559700 1 Processor -- start 2023-09-30T22:21:43.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.018+0000 7fb230559700 1 -- start start 2023-09-30T22:21:43.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.019+0000 7fb230559700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb22809e870 0x7fb22809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.019+0000 7fb230559700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb228131f40 0x7fb228139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.019+0000 7fb230559700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb22809c970 con 0x7fb22809f180 2023-09-30T22:21:43.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.019+0000 7fb230559700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2280a0920 con 0x7fb228131f40 2023-09-30T22:21:43.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.019+0000 7fb230559700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb22809f9c0 con 0x7fb22809e870 2023-09-30T22:21:43.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.019+0000 7fb22e2f5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb22809e870 0x7fb22809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.019+0000 7fb22daf4700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb22809f180 0x7fb228131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45120/0 (socket says 172.21.15.156:45120) 2023-09-30T22:21:43.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.019+0000 7fb22eaf6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb228131f40 0x7fb228139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.019+0000 7fb22daf4700 1 -- 172.21.15.156:0/3466903673 learned_addr learned my addr 172.21.15.156:0/3466903673 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:43.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.019+0000 7fb22e2f5700 1 -- 172.21.15.156:0/3466903673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb228131f40 msgr2=0x7fb228139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:43.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.019+0000 7fb22d2f3700 1 -- 172.21.15.156:0/3466903673 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892036137 0 0) 0x7fb22809c970 con 0x7fb22809f180 2023-09-30T22:21:43.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.019+0000 7fb22e2f5700 1 --2- 172.21.15.156:0/3466903673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb228131f40 0x7fb228139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.019+0000 7fb22e2f5700 1 -- 172.21.15.156:0/3466903673 >> v1:172.21.15.156:6789/0 conn(0x7fb22809f180 legacy=0x7fb228131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.019+0000 7fb22e2f5700 1 -- 172.21.15.156:0/3466903673 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22809bab0 con 0x7fb22809e870 2023-09-30T22:21:43.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.019+0000 7fb22eaf6700 1 --2- 172.21.15.156:0/3466903673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb228131f40 0x7fb228139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:43.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.020+0000 7fb22e2f5700 1 --2- 172.21.15.156:0/3466903673 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb22809e870 0x7fb22809ec40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb218009870 tx=0x7fb218009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5df27991bc4e412b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:43.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.020+0000 7fb22d2f3700 1 -- 172.21.15.156:0/3466903673 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb218011830 con 0x7fb22809e870 2023-09-30T22:21:43.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.020+0000 7fb22d2f3700 1 -- 172.21.15.156:0/3466903673 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb218011990 con 0x7fb22809e870 2023-09-30T22:21:43.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.020+0000 7fb22d2f3700 1 -- 172.21.15.156:0/3466903673 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb218011d20 con 0x7fb22809e870 2023-09-30T22:21:43.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.020+0000 7fb230559700 1 -- 172.21.15.156:0/3466903673 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb22809e870 msgr2=0x7fb22809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.020+0000 7fb230559700 1 --2- 172.21.15.156:0/3466903673 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb22809e870 0x7fb22809ec40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb218009870 tx=0x7fb218009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:43.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.020+0000 7fb230559700 1 -- 172.21.15.156:0/3466903673 shutdown_connections 2023-09-30T22:21:43.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.020+0000 7fb230559700 1 --2- 172.21.15.156:0/3466903673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb228131f40 0x7fb228139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.020+0000 7fb230559700 1 --2- 172.21.15.156:0/3466903673 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb22809e870 0x7fb22809ec40 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.020+0000 7fb230559700 1 -- 172.21.15.156:0/3466903673 >> 172.21.15.156:0/3466903673 conn(0x7fb2280a4430 msgr2=0x7fb2280a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:43.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.020+0000 7fb230559700 1 -- 172.21.15.156:0/3466903673 shutdown_connections 2023-09-30T22:21:43.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.020+0000 7fb230559700 1 -- 172.21.15.156:0/3466903673 wait complete. 2023-09-30T22:21:43.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.021+0000 7fb230559700 1 Processor -- start 2023-09-30T22:21:43.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.021+0000 7fb230559700 1 -- start start 2023-09-30T22:21:43.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.022+0000 7fb230559700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb22809e870 0x7fb22806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.022+0000 7fb230559700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb22809f180 0x7fb22806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.022+0000 7fb230559700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb228131f40 0x7fb22806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.022+0000 7fb230559700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb228124590 con 0x7fb22809e870 2023-09-30T22:21:43.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.022+0000 7fb230559700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22809dba0 con 0x7fb228131f40 2023-09-30T22:21:43.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.022+0000 7fb230559700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2280a2e20 con 0x7fb22809f180 2023-09-30T22:21:43.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.022+0000 7fb22e2f5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb22809e870 0x7fb22806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.022+0000 7fb22e2f5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb22809e870 0x7fb22806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33084/0 (socket says 172.21.15.156:33084) 2023-09-30T22:21:43.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.022+0000 7fb22e2f5700 1 -- 172.21.15.156:0/3793796072 learned_addr learned my addr 172.21.15.156:0/3793796072 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:43.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.022+0000 7fb22eaf6700 1 --2- 172.21.15.156:0/3793796072 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb228131f40 0x7fb22806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.022+0000 7fb22daf4700 1 --2- 172.21.15.156:0/3793796072 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb22809f180 0x7fb22806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.022+0000 7fb22e2f5700 1 -- 172.21.15.156:0/3793796072 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb22809f180 msgr2=0x7fb22806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.022+0000 7fb22e2f5700 1 --2- 172.21.15.156:0/3793796072 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb22809f180 0x7fb22806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.022+0000 7fb22e2f5700 1 -- 172.21.15.156:0/3793796072 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb228131f40 msgr2=0x7fb22806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.022+0000 7fb22e2f5700 1 --2- 172.21.15.156:0/3793796072 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb228131f40 0x7fb22806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.022+0000 7fb22e2f5700 1 -- 172.21.15.156:0/3793796072 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb220009a70 con 0x7fb22809e870 2023-09-30T22:21:43.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.022+0000 7fb22e2f5700 1 --2- 172.21.15.156:0/3793796072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb22809e870 0x7fb22806b8b0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fb218009bc0 tx=0x7fb218004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:43.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.022+0000 7fb21effd700 1 -- 172.21.15.156:0/3793796072 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2180044d0 con 0x7fb22809e870 2023-09-30T22:21:43.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.022+0000 7fb21effd700 1 -- 172.21.15.156:0/3793796072 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21801e070 con 0x7fb22809e870 2023-09-30T22:21:43.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.022+0000 7fb21effd700 1 -- 172.21.15.156:0/3793796072 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2180038e0 con 0x7fb22809e870 2023-09-30T22:21:43.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.022+0000 7fb230559700 1 -- 172.21.15.156:0/3793796072 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2180094a0 con 0x7fb22809e870 2023-09-30T22:21:43.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.023+0000 7fb230559700 1 -- 172.21.15.156:0/3793796072 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb228130650 con 0x7fb22809e870 2023-09-30T22:21:43.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.023+0000 7fb21effd700 1 -- 172.21.15.156:0/3793796072 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb218003a40 con 0x7fb22809e870 2023-09-30T22:21:43.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.023+0000 7fb230559700 1 -- 172.21.15.156:0/3793796072 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb22811be60 con 0x7fb22809e870 2023-09-30T22:21:43.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.023+0000 7fb21effd700 1 -- 172.21.15.156:0/3793796072 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb218040300 con 0x7fb22809e870 2023-09-30T22:21:43.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.028+0000 7fb21effd700 1 -- 172.21.15.156:0/3793796072 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb21802c3b0 con 0x7fb22809e870 2023-09-30T22:21:43.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.209+0000 7fb230559700 1 -- 172.21.15.156:0/3793796072 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb22804f2a0 con 0x7fb22809e870 2023-09-30T22:21:43.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.210+0000 7fb21effd700 1 -- 172.21.15.156:0/3793796072 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb218015030 con 0x7fb22809e870 2023-09-30T22:21:43.209 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:43.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.212+0000 7fb230559700 1 -- 172.21.15.156:0/3793796072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb22809e870 msgr2=0x7fb22806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.212+0000 7fb230559700 1 --2- 172.21.15.156:0/3793796072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb22809e870 0x7fb22806b8b0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fb218009bc0 tx=0x7fb218004750 comp rx=0 tx=0).stop 2023-09-30T22:21:43.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.212+0000 7fb230559700 1 -- 172.21.15.156:0/3793796072 shutdown_connections 2023-09-30T22:21:43.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.212+0000 7fb230559700 1 --2- 172.21.15.156:0/3793796072 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb228131f40 0x7fb22806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.212+0000 7fb230559700 1 --2- 172.21.15.156:0/3793796072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb22809e870 0x7fb22806b8b0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.212+0000 7fb230559700 1 --2- 172.21.15.156:0/3793796072 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb22809f180 0x7fb22806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.212+0000 7fb230559700 1 -- 172.21.15.156:0/3793796072 >> 172.21.15.156:0/3793796072 conn(0x7fb2280a4430 msgr2=0x7fb228131110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:43.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.212+0000 7fb230559700 1 -- 172.21.15.156:0/3793796072 shutdown_connections 2023-09-30T22:21:43.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.212+0000 7fb230559700 1 -- 172.21.15.156:0/3793796072 wait complete. 2023-09-30T22:21:43.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:43.660 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:43.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.785+0000 7f2052099700 1 Processor -- start 2023-09-30T22:21:43.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.785+0000 7f2052099700 1 -- start start 2023-09-30T22:21:43.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.786+0000 7f2052099700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f204c136960 0x7f204c138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.786+0000 7f2052099700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f204c139280 0x7f204c13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.786+0000 7f2052099700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f204c06b2d0 con 0x7f204c133ad0 2023-09-30T22:21:43.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.786+0000 7f2052099700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f204c1345b0 con 0x7f204c136960 2023-09-30T22:21:43.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.786+0000 7f2052099700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204c133610 con 0x7f204c139280 2023-09-30T22:21:43.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.786+0000 7f204affd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f204c136960 0x7f204c138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.786+0000 7f204affd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f204c136960 0x7f204c138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33088/0 (socket says 172.21.15.156:33088) 2023-09-30T22:21:43.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.786+0000 7f204bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f204c139280 0x7f204c13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.786+0000 7f204b7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f204c133ad0 0x7f204c133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45130/0 (socket says 172.21.15.156:45130) 2023-09-30T22:21:43.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.786+0000 7f204affd700 1 -- 172.21.15.156:0/786570077 learned_addr learned my addr 172.21.15.156:0/786570077 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:43.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.786+0000 7f204affd700 1 -- 172.21.15.156:0/786570077 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f204c139280 msgr2=0x7f204c13b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:43.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.786+0000 7f204affd700 1 --2- 172.21.15.156:0/786570077 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f204c139280 0x7f204c13b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.786+0000 7f204affd700 1 -- 172.21.15.156:0/786570077 >> v1:172.21.15.156:6789/0 conn(0x7f204c133ad0 legacy=0x7f204c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.786+0000 7f204a7fc700 1 -- 172.21.15.156:0/786570077 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686674834 0 0) 0x7f204c06b2d0 con 0x7f204c133ad0 2023-09-30T22:21:43.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.786+0000 7f204affd700 1 -- 172.21.15.156:0/786570077 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204c09a500 con 0x7f204c136960 2023-09-30T22:21:43.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.786+0000 7f204bfff700 1 --2- 172.21.15.156:0/786570077 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f204c139280 0x7f204c13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:43.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.787+0000 7f204affd700 1 --2- 172.21.15.156:0/786570077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f204c136960 0x7f204c138d40 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f20400098f0 tx=0x7f2040009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c63b083b825f786 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:43.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.787+0000 7f204a7fc700 1 -- 172.21.15.156:0/786570077 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2040011830 con 0x7f204c136960 2023-09-30T22:21:43.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.787+0000 7f204a7fc700 1 -- 172.21.15.156:0/786570077 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2040011990 con 0x7f204c136960 2023-09-30T22:21:43.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.787+0000 7f204a7fc700 1 -- 172.21.15.156:0/786570077 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2040011d20 con 0x7f204c136960 2023-09-30T22:21:43.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.787+0000 7f2052099700 1 -- 172.21.15.156:0/786570077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f204c136960 msgr2=0x7f204c138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.787+0000 7f2052099700 1 --2- 172.21.15.156:0/786570077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f204c136960 0x7f204c138d40 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f20400098f0 tx=0x7f2040009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:43.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.787+0000 7f2052099700 1 -- 172.21.15.156:0/786570077 shutdown_connections 2023-09-30T22:21:43.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.787+0000 7f2052099700 1 --2- 172.21.15.156:0/786570077 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f204c139280 0x7f204c13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.787+0000 7f2052099700 1 --2- 172.21.15.156:0/786570077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f204c136960 0x7f204c138d40 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.787+0000 7f2052099700 1 -- 172.21.15.156:0/786570077 >> 172.21.15.156:0/786570077 conn(0x7f204c099c40 msgr2=0x7f204c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:43.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.787+0000 7f2052099700 1 -- 172.21.15.156:0/786570077 shutdown_connections 2023-09-30T22:21:43.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.787+0000 7f2052099700 1 -- 172.21.15.156:0/786570077 wait complete. 2023-09-30T22:21:43.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.788+0000 7f2052099700 1 Processor -- start 2023-09-30T22:21:43.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.788+0000 7f2052099700 1 -- start start 2023-09-30T22:21:43.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.789+0000 7f2052099700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f204c133ad0 0x7f204c071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.789+0000 7f2052099700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f204c136960 0x7f204c071690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.789+0000 7f2052099700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f204c139280 0x7f204c071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.789+0000 7f2052099700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c06ec30 con 0x7f204c139280 2023-09-30T22:21:43.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.789+0000 7f2052099700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204c072200 con 0x7f204c133ad0 2023-09-30T22:21:43.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.789+0000 7f2052099700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f204c1317a0 con 0x7f204c136960 2023-09-30T22:21:43.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.789+0000 7f204b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f204c133ad0 0x7f204c071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.789+0000 7f204bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f204c139280 0x7f204c071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.789+0000 7f204affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f204c136960 0x7f204c071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.789+0000 7f204b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f204c133ad0 0x7f204c071150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53180/0 (socket says 172.21.15.156:53180) 2023-09-30T22:21:43.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.789+0000 7f204b7fe700 1 -- 172.21.15.156:0/4186189627 learned_addr learned my addr 172.21.15.156:0/4186189627 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:43.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.789+0000 7f204bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f204c139280 0x7f204c071bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33092/0 (socket says 172.21.15.156:33092) 2023-09-30T22:21:43.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.789+0000 7f204affd700 1 -- 172.21.15.156:0/4186189627 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f204c133ad0 msgr2=0x7f204c071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.789+0000 7f204affd700 1 --2- 172.21.15.156:0/4186189627 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f204c133ad0 0x7f204c071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.789+0000 7f204affd700 1 -- 172.21.15.156:0/4186189627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f204c139280 msgr2=0x7f204c071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.789+0000 7f204affd700 1 --2- 172.21.15.156:0/4186189627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f204c139280 0x7f204c071bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.789+0000 7f204affd700 1 -- 172.21.15.156:0/4186189627 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2044009a70 con 0x7f204c136960 2023-09-30T22:21:43.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.789+0000 7f204affd700 1 --2- 172.21.15.156:0/4186189627 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f204c136960 0x7f204c071690 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2040016000 tx=0x7f2040004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:43.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.789+0000 7f2033fff700 1 -- 172.21.15.156:0/4186189627 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2040004510 con 0x7f204c136960 2023-09-30T22:21:43.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.790+0000 7f2033fff700 1 -- 172.21.15.156:0/4186189627 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20400036a0 con 0x7f204c136960 2023-09-30T22:21:43.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.790+0000 7f2033fff700 1 -- 172.21.15.156:0/4186189627 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2040003a30 con 0x7f204c136960 2023-09-30T22:21:43.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.790+0000 7f2052099700 1 -- 172.21.15.156:0/4186189627 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2040009550 con 0x7f204c136960 2023-09-30T22:21:43.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.790+0000 7f2052099700 1 -- 172.21.15.156:0/4186189627 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f204c06ee50 con 0x7f204c136960 2023-09-30T22:21:43.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.791+0000 7f2052099700 1 -- 172.21.15.156:0/4186189627 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f204c04f2a0 con 0x7f204c136960 2023-09-30T22:21:43.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.791+0000 7f2033fff700 1 -- 172.21.15.156:0/4186189627 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2040021070 con 0x7f204c136960 2023-09-30T22:21:43.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.791+0000 7f2033fff700 1 -- 172.21.15.156:0/4186189627 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2040040ba0 con 0x7f204c136960 2023-09-30T22:21:43.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.795+0000 7f2033fff700 1 -- 172.21.15.156:0/4186189627 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f204002d760 con 0x7f204c136960 2023-09-30T22:21:43.814 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:43.857 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:43.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.942+0000 7f0392acb700 1 Processor -- start 2023-09-30T22:21:43.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.942+0000 7f0392acb700 1 -- start start 2023-09-30T22:21:43.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.942+0000 7f0392acb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f038c09ad40 0x7f038c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.942+0000 7f0392acb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f038c133f70 0x7f038c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.942+0000 7f0392acb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f038c0a0a70 0x7f038c0a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.942+0000 7f0392acb700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f038c0a3b60 con 0x7f038c09ad40 2023-09-30T22:21:43.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.942+0000 7f0392acb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038c1348e0 con 0x7f038c0a0a70 2023-09-30T22:21:43.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.942+0000 7f0392acb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f038c09b110 con 0x7f038c133f70 2023-09-30T22:21:43.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.942+0000 7f0390867700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f038c09ad40 0x7f038c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.943+0000 7f0390867700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f038c09ad40 0x7f038c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33096/0 (socket says 172.21.15.156:33096) 2023-09-30T22:21:43.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.943+0000 7f0390867700 1 -- 172.21.15.156:0/1159129194 learned_addr learned my addr 172.21.15.156:0/1159129194 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:43.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.943+0000 7f038bfff700 1 --2- 172.21.15.156:0/1159129194 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f038c133f70 0x7f038c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.943+0000 7f0391068700 1 --2- 172.21.15.156:0/1159129194 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f038c0a0a70 0x7f038c0a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.943+0000 7f0390867700 1 -- 172.21.15.156:0/1159129194 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f038c133f70 msgr2=0x7f038c1343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:43.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.943+0000 7f0390867700 1 --2- 172.21.15.156:0/1159129194 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f038c133f70 0x7f038c1343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.943+0000 7f0390867700 1 -- 172.21.15.156:0/1159129194 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f038c0a0a70 msgr2=0x7f038c0a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:43.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.943+0000 7f0390867700 1 --2- 172.21.15.156:0/1159129194 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f038c0a0a70 0x7f038c0a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.943+0000 7f0390867700 1 -- 172.21.15.156:0/1159129194 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038c0a2fa0 con 0x7f038c09ad40 2023-09-30T22:21:43.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.943+0000 7f038bfff700 1 --2- 172.21.15.156:0/1159129194 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f038c133f70 0x7f038c1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:43.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.943+0000 7f0390867700 1 --2- 172.21.15.156:0/1159129194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f038c09ad40 0x7f038c133a30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f0380009920 tx=0x7f0380009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=612ef8e720f3d3b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:43.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.943+0000 7f038b7fe700 1 -- 172.21.15.156:0/1159129194 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0380011830 con 0x7f038c09ad40 2023-09-30T22:21:43.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.943+0000 7f038b7fe700 1 -- 172.21.15.156:0/1159129194 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0380011990 con 0x7f038c09ad40 2023-09-30T22:21:43.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.943+0000 7f038b7fe700 1 -- 172.21.15.156:0/1159129194 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0380011d20 con 0x7f038c09ad40 2023-09-30T22:21:43.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.944+0000 7f0392acb700 1 -- 172.21.15.156:0/1159129194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f038c09ad40 msgr2=0x7f038c133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.944+0000 7f0392acb700 1 --2- 172.21.15.156:0/1159129194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f038c09ad40 0x7f038c133a30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f0380009920 tx=0x7f0380009c30 comp rx=0 tx=0).stop 2023-09-30T22:21:43.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.944+0000 7f0392acb700 1 -- 172.21.15.156:0/1159129194 shutdown_connections 2023-09-30T22:21:43.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.944+0000 7f0392acb700 1 --2- 172.21.15.156:0/1159129194 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f038c0a0a70 0x7f038c0a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.944+0000 7f0392acb700 1 --2- 172.21.15.156:0/1159129194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f038c09ad40 0x7f038c133a30 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.944+0000 7f0392acb700 1 --2- 172.21.15.156:0/1159129194 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f038c133f70 0x7f038c1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.944+0000 7f0392acb700 1 -- 172.21.15.156:0/1159129194 >> 172.21.15.156:0/1159129194 conn(0x7f038c099c40 msgr2=0x7f038c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:43.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.944+0000 7f0392acb700 1 -- 172.21.15.156:0/1159129194 shutdown_connections 2023-09-30T22:21:43.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.944+0000 7f0392acb700 1 -- 172.21.15.156:0/1159129194 wait complete. 2023-09-30T22:21:43.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.945+0000 7f0392acb700 1 Processor -- start 2023-09-30T22:21:43.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.945+0000 7f0392acb700 1 -- start start 2023-09-30T22:21:43.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.946+0000 7f0392acb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f038c09ad40 0x7f038c1c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.946+0000 7f0392acb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f038c0a0a70 0x7f038c1c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.946+0000 7f0392acb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f038c133f70 0x7f038c1c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.946+0000 7f0392acb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c09c850 con 0x7f038c133f70 2023-09-30T22:21:43.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.946+0000 7f0392acb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038c120860 con 0x7f038c09ad40 2023-09-30T22:21:43.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.946+0000 7f0392acb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f038c120cc0 con 0x7f038c0a0a70 2023-09-30T22:21:43.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.946+0000 7f0390867700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f038c09ad40 0x7f038c1c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.946+0000 7f0390867700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f038c09ad40 0x7f038c1c8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53198/0 (socket says 172.21.15.156:53198) 2023-09-30T22:21:43.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.946+0000 7f0390867700 1 -- 172.21.15.156:0/3359538986 learned_addr learned my addr 172.21.15.156:0/3359538986 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:43.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.946+0000 7f038bfff700 1 --2- 172.21.15.156:0/3359538986 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f038c0a0a70 0x7f038c1c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.946+0000 7f0391068700 1 --2- 172.21.15.156:0/3359538986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f038c133f70 0x7f038c1c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.947+0000 7f038bfff700 1 -- 172.21.15.156:0/3359538986 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f038c09ad40 msgr2=0x7f038c1c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.947+0000 7f038bfff700 1 --2- 172.21.15.156:0/3359538986 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f038c09ad40 0x7f038c1c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.947+0000 7f038bfff700 1 -- 172.21.15.156:0/3359538986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f038c133f70 msgr2=0x7f038c1c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.947+0000 7f038bfff700 1 --2- 172.21.15.156:0/3359538986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f038c133f70 0x7f038c1c8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.947+0000 7f038bfff700 1 -- 172.21.15.156:0/3359538986 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03780094a0 con 0x7f038c0a0a70 2023-09-30T22:21:43.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.947+0000 7f0391068700 1 --2- 172.21.15.156:0/3359538986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f038c133f70 0x7f038c1c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:43.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.947+0000 7f0390867700 1 --2- 172.21.15.156:0/3359538986 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f038c09ad40 0x7f038c1c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:43.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.947+0000 7f038bfff700 1 --2- 172.21.15.156:0/3359538986 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f038c0a0a70 0x7f038c1c8840 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f037800e9b0 tx=0x7f037800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:43.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.947+0000 7f03897fa700 1 -- 172.21.15.156:0/3359538986 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037800ee50 con 0x7f038c0a0a70 2023-09-30T22:21:43.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.947+0000 7f03897fa700 1 -- 172.21.15.156:0/3359538986 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037800c850 con 0x7f038c0a0a70 2023-09-30T22:21:43.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.947+0000 7f0392acb700 1 -- 172.21.15.156:0/3359538986 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0380009550 con 0x7f038c0a0a70 2023-09-30T22:21:43.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.947+0000 7f03897fa700 1 -- 172.21.15.156:0/3359538986 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037800cc00 con 0x7f038c0a0a70 2023-09-30T22:21:43.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.947+0000 7f0392acb700 1 -- 172.21.15.156:0/3359538986 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f038c122310 con 0x7f038c0a0a70 2023-09-30T22:21:43.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.948+0000 7f0392acb700 1 -- 172.21.15.156:0/3359538986 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f038c122500 con 0x7f038c0a0a70 2023-09-30T22:21:43.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.949+0000 7f03897fa700 1 -- 172.21.15.156:0/3359538986 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0378013470 con 0x7f038c0a0a70 2023-09-30T22:21:43.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.949+0000 7f03897fa700 1 -- 172.21.15.156:0/3359538986 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f037803ff00 con 0x7f038c0a0a70 2023-09-30T22:21:43.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.953+0000 7f03897fa700 1 -- 172.21.15.156:0/3359538986 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0378013720 con 0x7f038c0a0a70 2023-09-30T22:21:43.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.993+0000 7f2052099700 1 -- 172.21.15.156:0/4186189627 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f204c09f0f0 con 0x7f204c136960 2023-09-30T22:21:43.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.994+0000 7f2033fff700 1 -- 172.21.15.156:0/4186189627 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2040029030 con 0x7f204c136960 2023-09-30T22:21:43.993 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:43.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.996+0000 7f2052099700 1 -- 172.21.15.156:0/4186189627 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f204c136960 msgr2=0x7f204c071690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.996+0000 7f2052099700 1 --2- 172.21.15.156:0/4186189627 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f204c136960 0x7f204c071690 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2040016000 tx=0x7f2040004750 comp rx=0 tx=0).stop 2023-09-30T22:21:43.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.996+0000 7f2052099700 1 -- 172.21.15.156:0/4186189627 shutdown_connections 2023-09-30T22:21:43.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.996+0000 7f2052099700 1 --2- 172.21.15.156:0/4186189627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f204c139280 0x7f204c071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.996+0000 7f2052099700 1 --2- 172.21.15.156:0/4186189627 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f204c133ad0 0x7f204c071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.996+0000 7f2052099700 1 --2- 172.21.15.156:0/4186189627 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f204c136960 0x7f204c071690 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.996+0000 7f2052099700 1 -- 172.21.15.156:0/4186189627 >> 172.21.15.156:0/4186189627 conn(0x7f204c099c40 msgr2=0x7f204c0a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:43.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.996+0000 7f2052099700 1 -- 172.21.15.156:0/4186189627 shutdown_connections 2023-09-30T22:21:43.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.996+0000 7f2052099700 1 -- 172.21.15.156:0/4186189627 wait complete. 2023-09-30T22:21:43.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.999+0000 7ff51e986700 1 Processor -- start 2023-09-30T22:21:43.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:43.999+0000 7ff51e986700 1 -- start start 2023-09-30T22:21:44.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.000+0000 7ff51e986700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff518133900 0x7ff518133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:44.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.000+0000 7ff51e986700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff518134210 0x7ff5180a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:44.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.000+0000 7ff51e986700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff51809a760 con 0x7ff5180a0ee0 2023-09-30T22:21:44.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.000+0000 7ff51e986700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5181336e0 con 0x7ff518134210 2023-09-30T22:21:44.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.000+0000 7ff51e986700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51809a080 con 0x7ff518133900 2023-09-30T22:21:44.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.000+0000 7ff5177fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff518134210 0x7ff5180a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:44.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.000+0000 7ff517fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff518133900 0x7ff518133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:44.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.000+0000 7ff51cf23700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff5180a0ee0 0x7ff51813a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45146/0 (socket says 172.21.15.156:45146) 2023-09-30T22:21:44.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.000+0000 7ff51cf23700 1 -- 172.21.15.156:0/1666740560 learned_addr learned my addr 172.21.15.156:0/1666740560 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:44.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.000+0000 7ff516ffd700 1 -- 172.21.15.156:0/1666740560 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810772798 0 0) 0x7ff51809a760 con 0x7ff5180a0ee0 2023-09-30T22:21:44.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.000+0000 7ff516ffd700 1 -- 172.21.15.156:0/1666740560 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5000035b0 con 0x7ff5180a0ee0 2023-09-30T22:21:44.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.000+0000 7ff517fff700 1 -- 172.21.15.156:0/1666740560 >> v2:172.21.15.156:3300/0 conn(0x7ff518134210 msgr2=0x7ff5180a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:44.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.000+0000 7ff517fff700 1 --2- 172.21.15.156:0/1666740560 >> v2:172.21.15.156:3300/0 conn(0x7ff518134210 0x7ff5180a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.000+0000 7ff517fff700 1 -- 172.21.15.156:0/1666740560 >> v1:172.21.15.156:6789/0 conn(0x7ff5180a0ee0 legacy=0x7ff51813a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:44.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.000+0000 7ff517fff700 1 -- 172.21.15.156:0/1666740560 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5180a23e0 con 0x7ff518133900 2023-09-30T22:21:44.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.000+0000 7ff517fff700 1 --2- 172.21.15.156:0/1666740560 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff518133900 0x7ff518133cd0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff508009820 tx=0x7ff508009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d66f36f9e54b3eb6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:44.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.001+0000 7ff516ffd700 1 -- 172.21.15.156:0/1666740560 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff508005e30 con 0x7ff518133900 2023-09-30T22:21:44.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.001+0000 7ff516ffd700 1 -- 172.21.15.156:0/1666740560 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff508006030 con 0x7ff518133900 2023-09-30T22:21:44.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.001+0000 7ff516ffd700 1 -- 172.21.15.156:0/1666740560 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5080063c0 con 0x7ff518133900 2023-09-30T22:21:44.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.002+0000 7ff51e986700 1 -- 172.21.15.156:0/1666740560 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff518133900 msgr2=0x7ff518133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:44.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.002+0000 7ff51e986700 1 --2- 172.21.15.156:0/1666740560 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff518133900 0x7ff518133cd0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff508009820 tx=0x7ff508009b30 comp rx=0 tx=0).stop 2023-09-30T22:21:44.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.002+0000 7ff51e986700 1 -- 172.21.15.156:0/1666740560 shutdown_connections 2023-09-30T22:21:44.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.002+0000 7ff51e986700 1 --2- 172.21.15.156:0/1666740560 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff518133900 0x7ff518133cd0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.002+0000 7ff51e986700 1 --2- 172.21.15.156:0/1666740560 >> v2:172.21.15.156:3300/0 conn(0x7ff518134210 0x7ff5180a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.002+0000 7ff51e986700 1 -- 172.21.15.156:0/1666740560 >> 172.21.15.156:0/1666740560 conn(0x7ff5180a2980 msgr2=0x7ff5180a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:44.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.002+0000 7ff51e986700 1 -- 172.21.15.156:0/1666740560 shutdown_connections 2023-09-30T22:21:44.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.002+0000 7ff51e986700 1 -- 172.21.15.156:0/1666740560 wait complete. 2023-09-30T22:21:44.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.003+0000 7ff51e986700 1 Processor -- start 2023-09-30T22:21:44.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.003+0000 7ff51e986700 1 -- start start 2023-09-30T22:21:44.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.003+0000 7ff51e986700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff5180a0ee0 0x7ff51811d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:44.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.003+0000 7ff51e986700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff518133900 0x7ff51811dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:44.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.003+0000 7ff51e986700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff518134210 0x7ff51811e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:44.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.003+0000 7ff51e986700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff518120f00 con 0x7ff518133900 2023-09-30T22:21:44.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.003+0000 7ff51e986700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51811f3e0 con 0x7ff5180a0ee0 2023-09-30T22:21:44.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.003+0000 7ff51e986700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff518132cb0 con 0x7ff518134210 2023-09-30T22:21:44.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.003+0000 7ff5177fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff518133900 0x7ff51811dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:44.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.003+0000 7ff517fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff5180a0ee0 0x7ff51811d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:44.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.003+0000 7ff5177fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff518133900 0x7ff51811dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33130/0 (socket says 172.21.15.156:33130) 2023-09-30T22:21:44.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.004+0000 7ff5177fe700 1 -- 172.21.15.156:0/2884327104 learned_addr learned my addr 172.21.15.156:0/2884327104 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:44.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.004+0000 7ff517fff700 1 -- 172.21.15.156:0/2884327104 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff518134210 msgr2=0x7ff51811e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:44.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.004+0000 7ff517fff700 1 --2- 172.21.15.156:0/2884327104 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff518134210 0x7ff51811e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.004+0000 7ff517fff700 1 -- 172.21.15.156:0/2884327104 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff518133900 msgr2=0x7ff51811dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:44.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.004+0000 7ff517fff700 1 --2- 172.21.15.156:0/2884327104 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff518133900 0x7ff51811dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.004+0000 7ff517fff700 1 -- 172.21.15.156:0/2884327104 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff508009430 con 0x7ff5180a0ee0 2023-09-30T22:21:44.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.004+0000 7ff5177fe700 1 --2- 172.21.15.156:0/2884327104 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff518133900 0x7ff51811dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:44.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.004+0000 7ff517fff700 1 --2- 172.21.15.156:0/2884327104 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff5180a0ee0 0x7ff51811d6c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff508015000 tx=0x7ff508004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:44.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.004+0000 7ff514ff9700 1 -- 172.21.15.156:0/2884327104 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5080063a0 con 0x7ff5180a0ee0 2023-09-30T22:21:44.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.004+0000 7ff514ff9700 1 -- 172.21.15.156:0/2884327104 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff508006500 con 0x7ff5180a0ee0 2023-09-30T22:21:44.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.004+0000 7ff51e986700 1 -- 172.21.15.156:0/2884327104 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff51809a2c0 con 0x7ff5180a0ee0 2023-09-30T22:21:44.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.004+0000 7ff514ff9700 1 -- 172.21.15.156:0/2884327104 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5080068b0 con 0x7ff5180a0ee0 2023-09-30T22:21:44.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.004+0000 7ff51e986700 1 -- 172.21.15.156:0/2884327104 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5181211e0 con 0x7ff5180a0ee0 2023-09-30T22:21:44.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.005+0000 7ff51e986700 1 -- 172.21.15.156:0/2884327104 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff51811a590 con 0x7ff5180a0ee0 2023-09-30T22:21:44.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.006+0000 7ff514ff9700 1 -- 172.21.15.156:0/2884327104 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff508022070 con 0x7ff5180a0ee0 2023-09-30T22:21:44.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.006+0000 7ff514ff9700 1 -- 172.21.15.156:0/2884327104 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff508040f60 con 0x7ff5180a0ee0 2023-09-30T22:21:44.011 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:44.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.012+0000 7ff514ff9700 1 -- 172.21.15.156:0/2884327104 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff50806c750 con 0x7ff5180a0ee0 2023-09-30T22:21:44.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.165+0000 7f0392acb700 1 -- 172.21.15.156:0/3359538986 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f038c04f2a0 con 0x7f038c0a0a70 2023-09-30T22:21:44.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.166+0000 7f03897fa700 1 -- 172.21.15.156:0/3359538986 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0378021020 con 0x7f038c0a0a70 2023-09-30T22:21:44.165 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:44.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.169+0000 7f0392acb700 1 -- 172.21.15.156:0/3359538986 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f038c0a0a70 msgr2=0x7f038c1c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:44.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.169+0000 7f0392acb700 1 --2- 172.21.15.156:0/3359538986 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f038c0a0a70 0x7f038c1c8840 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f037800e9b0 tx=0x7f037800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.169+0000 7f0392acb700 1 -- 172.21.15.156:0/3359538986 shutdown_connections 2023-09-30T22:21:44.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.169+0000 7f0392acb700 1 --2- 172.21.15.156:0/3359538986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f038c133f70 0x7f038c1c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.169+0000 7f0392acb700 1 --2- 172.21.15.156:0/3359538986 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f038c09ad40 0x7f038c1c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.169+0000 7f0392acb700 1 --2- 172.21.15.156:0/3359538986 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f038c0a0a70 0x7f038c1c8840 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.169+0000 7f0392acb700 1 -- 172.21.15.156:0/3359538986 >> 172.21.15.156:0/3359538986 conn(0x7f038c099c40 msgr2=0x7f038c1bbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:44.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.169+0000 7f0392acb700 1 -- 172.21.15.156:0/3359538986 shutdown_connections 2023-09-30T22:21:44.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.169+0000 7f0392acb700 1 -- 172.21.15.156:0/3359538986 wait complete. 2023-09-30T22:21:44.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:44.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.214+0000 7ff51e986700 1 -- 172.21.15.156:0/2884327104 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff518121040 con 0x7ff5180a0ee0 2023-09-30T22:21:44.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.214+0000 7ff514ff9700 1 -- 172.21.15.156:0/2884327104 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff50802a020 con 0x7ff5180a0ee0 2023-09-30T22:21:44.214 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:44.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.216+0000 7ff51e986700 1 -- 172.21.15.156:0/2884327104 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff5180a0ee0 msgr2=0x7ff51811d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:44.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.216+0000 7ff51e986700 1 --2- 172.21.15.156:0/2884327104 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff5180a0ee0 0x7ff51811d6c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff508015000 tx=0x7ff508004750 comp rx=0 tx=0).stop 2023-09-30T22:21:44.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.216+0000 7ff51e986700 1 -- 172.21.15.156:0/2884327104 shutdown_connections 2023-09-30T22:21:44.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.216+0000 7ff51e986700 1 --2- 172.21.15.156:0/2884327104 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff518134210 0x7ff51811e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.216+0000 7ff51e986700 1 --2- 172.21.15.156:0/2884327104 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff5180a0ee0 0x7ff51811d6c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.216+0000 7ff51e986700 1 --2- 172.21.15.156:0/2884327104 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff518133900 0x7ff51811dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.216+0000 7ff51e986700 1 -- 172.21.15.156:0/2884327104 >> 172.21.15.156:0/2884327104 conn(0x7ff5180a2980 msgr2=0x7ff5181baca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:44.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.216+0000 7ff51e986700 1 -- 172.21.15.156:0/2884327104 shutdown_connections 2023-09-30T22:21:44.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.216+0000 7ff51e986700 1 -- 172.21.15.156:0/2884327104 wait complete. 2023-09-30T22:21:44.224 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:44.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:44.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.347+0000 7f175154d700 1 Processor -- start 2023-09-30T22:21:44.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.347+0000 7f175154d700 1 -- start start 2023-09-30T22:21:44.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.348+0000 7f175154d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f174c0a0a90 0x7f174c0a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:44.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.348+0000 7f175154d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f174c0a13a0 0x7f174c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:44.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.348+0000 7f175154d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f174c133f70 0x7f174c134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:44.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.348+0000 7f175154d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174c0a3aa0 con 0x7f174c133f70 2023-09-30T22:21:44.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.348+0000 7f175154d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174c09a540 con 0x7f174c0a13a0 2023-09-30T22:21:44.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.348+0000 7f175154d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f174c0a1fe0 con 0x7f174c0a0a90 2023-09-30T22:21:44.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.348+0000 7f174affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f174c0a0a90 0x7f174c0a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:44.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.348+0000 7f174a7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f174c0a13a0 0x7f174c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:44.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.348+0000 7f174b7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f174c133f70 0x7f174c134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:44.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.348+0000 7f174a7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f174c0a13a0 0x7f174c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53228/0 (socket says 172.21.15.156:53228) 2023-09-30T22:21:44.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.348+0000 7f174affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f174c0a0a90 0x7f174c0a0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44954/0 (socket says 172.21.15.156:44954) 2023-09-30T22:21:44.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.348+0000 7f174a7fc700 1 -- 172.21.15.156:0/1536204059 learned_addr learned my addr 172.21.15.156:0/1536204059 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:44.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.348+0000 7f174b7fe700 1 -- 172.21.15.156:0/1536204059 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f174c0a0a90 msgr2=0x7f174c0a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:44.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.348+0000 7f174b7fe700 1 --2- 172.21.15.156:0/1536204059 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f174c0a0a90 0x7f174c0a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.348+0000 7f174b7fe700 1 -- 172.21.15.156:0/1536204059 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f174c0a13a0 msgr2=0x7f174c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:44.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.348+0000 7f174b7fe700 1 --2- 172.21.15.156:0/1536204059 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f174c0a13a0 0x7f174c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.348+0000 7f174b7fe700 1 -- 172.21.15.156:0/1536204059 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174c09a280 con 0x7f174c133f70 2023-09-30T22:21:44.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.348+0000 7f174a7fc700 1 --2- 172.21.15.156:0/1536204059 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f174c0a13a0 0x7f174c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:44.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.348+0000 7f174affd700 1 --2- 172.21.15.156:0/1536204059 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f174c0a0a90 0x7f174c0a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:44.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.348+0000 7f174b7fe700 1 --2- 172.21.15.156:0/1536204059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f174c133f70 0x7f174c134410 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f173c009840 tx=0x7f173c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25aa6d7719483355 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:44.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.349+0000 7f1749ffb700 1 -- 172.21.15.156:0/1536204059 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c011830 con 0x7f174c133f70 2023-09-30T22:21:44.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.349+0000 7f1749ffb700 1 -- 172.21.15.156:0/1536204059 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173c011990 con 0x7f174c133f70 2023-09-30T22:21:44.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.349+0000 7f1749ffb700 1 -- 172.21.15.156:0/1536204059 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c011d20 con 0x7f174c133f70 2023-09-30T22:21:44.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.349+0000 7f175154d700 1 -- 172.21.15.156:0/1536204059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f174c133f70 msgr2=0x7f174c134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:44.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.349+0000 7f175154d700 1 --2- 172.21.15.156:0/1536204059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f174c133f70 0x7f174c134410 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f173c009840 tx=0x7f173c009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:44.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.349+0000 7f175154d700 1 -- 172.21.15.156:0/1536204059 shutdown_connections 2023-09-30T22:21:44.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.349+0000 7f175154d700 1 --2- 172.21.15.156:0/1536204059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f174c133f70 0x7f174c134410 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.349+0000 7f175154d700 1 --2- 172.21.15.156:0/1536204059 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f174c0a0a90 0x7f174c0a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.349+0000 7f175154d700 1 --2- 172.21.15.156:0/1536204059 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f174c0a13a0 0x7f174c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.349+0000 7f175154d700 1 -- 172.21.15.156:0/1536204059 >> 172.21.15.156:0/1536204059 conn(0x7f174c099c40 msgr2=0x7f174c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:44.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.349+0000 7f175154d700 1 -- 172.21.15.156:0/1536204059 shutdown_connections 2023-09-30T22:21:44.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.349+0000 7f175154d700 1 -- 172.21.15.156:0/1536204059 wait complete. 2023-09-30T22:21:44.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.350+0000 7f175154d700 1 Processor -- start 2023-09-30T22:21:44.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.350+0000 7f175154d700 1 -- start start 2023-09-30T22:21:44.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.351+0000 7f175154d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f174c0a0a90 0x7f174c11e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:44.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.351+0000 7f175154d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f174c0a13a0 0x7f174c11eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:44.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.351+0000 7f175154d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f174c133f70 0x7f174c1c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:44.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.351+0000 7f175154d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c121560 con 0x7f174c133f70 2023-09-30T22:21:44.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.351+0000 7f175154d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174c121740 con 0x7f174c0a0a90 2023-09-30T22:21:44.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.351+0000 7f175154d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f174c1325e0 con 0x7f174c0a13a0 2023-09-30T22:21:44.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.351+0000 7f174affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f174c0a0a90 0x7f174c11e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:44.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.351+0000 7f174affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f174c0a0a90 0x7f174c11e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53242/0 (socket says 172.21.15.156:53242) 2023-09-30T22:21:44.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.351+0000 7f174a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f174c0a13a0 0x7f174c11eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:44.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.351+0000 7f174affd700 1 -- 172.21.15.156:0/3010685351 learned_addr learned my addr 172.21.15.156:0/3010685351 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:44.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.351+0000 7f174b7fe700 1 --2- 172.21.15.156:0/3010685351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f174c133f70 0x7f174c1c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:44.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.351+0000 7f174a7fc700 1 -- 172.21.15.156:0/3010685351 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f174c0a0a90 msgr2=0x7f174c11e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:44.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.351+0000 7f174a7fc700 1 --2- 172.21.15.156:0/3010685351 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f174c0a0a90 0x7f174c11e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.351+0000 7f174a7fc700 1 -- 172.21.15.156:0/3010685351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f174c133f70 msgr2=0x7f174c1c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:44.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.351+0000 7f174a7fc700 1 --2- 172.21.15.156:0/3010685351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f174c133f70 0x7f174c1c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.351+0000 7f174a7fc700 1 -- 172.21.15.156:0/3010685351 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1744009a70 con 0x7f174c0a13a0 2023-09-30T22:21:44.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.351+0000 7f174affd700 1 --2- 172.21.15.156:0/3010685351 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f174c0a0a90 0x7f174c11e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:44.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.351+0000 7f174b7fe700 1 --2- 172.21.15.156:0/3010685351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f174c133f70 0x7f174c1c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:44.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.351+0000 7f174a7fc700 1 --2- 172.21.15.156:0/3010685351 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f174c0a13a0 0x7f174c11eb30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f174000e9a0 tx=0x7f174000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:44.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.351+0000 7f17337fe700 1 -- 172.21.15.156:0/3010685351 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740004240 con 0x7f174c0a13a0 2023-09-30T22:21:44.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.351+0000 7f17337fe700 1 -- 172.21.15.156:0/3010685351 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17400043a0 con 0x7f174c0a13a0 2023-09-30T22:21:44.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.351+0000 7f175154d700 1 -- 172.21.15.156:0/3010685351 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1740009550 con 0x7f174c0a13a0 2023-09-30T22:21:44.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.352+0000 7f17337fe700 1 -- 172.21.15.156:0/3010685351 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17400036a0 con 0x7f174c0a13a0 2023-09-30T22:21:44.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.352+0000 7f175154d700 1 -- 172.21.15.156:0/3010685351 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f173c0094a0 con 0x7f174c0a13a0 2023-09-30T22:21:44.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.352+0000 7f17337fe700 1 -- 172.21.15.156:0/3010685351 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1740003800 con 0x7f174c0a13a0 2023-09-30T22:21:44.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.352+0000 7f17337fe700 1 -- 172.21.15.156:0/3010685351 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f174003f800 con 0x7f174c0a13a0 2023-09-30T22:21:44.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.352+0000 7f175154d700 1 -- 172.21.15.156:0/3010685351 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f174c09c840 con 0x7f174c0a13a0 2023-09-30T22:21:44.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.357+0000 7f17337fe700 1 -- 172.21.15.156:0/3010685351 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1740013470 con 0x7f174c0a13a0 2023-09-30T22:21:44.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.540+0000 7f175154d700 1 -- 172.21.15.156:0/3010685351 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f174c04f2a0 con 0x7f174c0a13a0 2023-09-30T22:21:44.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.540+0000 7f17337fe700 1 -- 172.21.15.156:0/3010685351 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f174002a090 con 0x7f174c0a13a0 2023-09-30T22:21:44.540 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:44.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.542+0000 7f175154d700 1 -- 172.21.15.156:0/3010685351 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f174c0a13a0 msgr2=0x7f174c11eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:44.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.542+0000 7f175154d700 1 --2- 172.21.15.156:0/3010685351 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f174c0a13a0 0x7f174c11eb30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f174000e9a0 tx=0x7f174000ecb0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.542+0000 7f175154d700 1 -- 172.21.15.156:0/3010685351 shutdown_connections 2023-09-30T22:21:44.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.542+0000 7f175154d700 1 --2- 172.21.15.156:0/3010685351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f174c133f70 0x7f174c1c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.542+0000 7f175154d700 1 --2- 172.21.15.156:0/3010685351 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f174c0a0a90 0x7f174c11e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.542+0000 7f175154d700 1 --2- 172.21.15.156:0/3010685351 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f174c0a13a0 0x7f174c11eb30 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.542+0000 7f175154d700 1 -- 172.21.15.156:0/3010685351 >> 172.21.15.156:0/3010685351 conn(0x7f174c099c40 msgr2=0x7f174c0a4110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:44.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.542+0000 7f175154d700 1 -- 172.21.15.156:0/3010685351 shutdown_connections 2023-09-30T22:21:44.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:44.542+0000 7f175154d700 1 -- 172.21.15.156:0/3010685351 wait complete. 2023-09-30T22:21:44.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:45.012 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:45.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.135+0000 7f623aa39700 1 Processor -- start 2023-09-30T22:21:45.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.136+0000 7f623aa39700 1 -- start start 2023-09-30T22:21:45.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.136+0000 7f623aa39700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f623409e870 0x7f623409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:45.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.136+0000 7f623aa39700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f623409f180 0x7f6234131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:45.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.136+0000 7f623aa39700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f623409c970 con 0x7f6234131d70 2023-09-30T22:21:45.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.136+0000 7f623aa39700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62340a0920 con 0x7f623409f180 2023-09-30T22:21:45.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.136+0000 7f623aa39700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623409f9c0 con 0x7f623409e870 2023-09-30T22:21:45.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.136+0000 7f62337fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f623409f180 0x7f6234131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:45.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.136+0000 7f6233fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f623409e870 0x7f623409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:45.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.136+0000 7f6238fd6700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6234131d70 0x7f6234138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45148/0 (socket says 172.21.15.156:45148) 2023-09-30T22:21:45.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.136+0000 7f62337fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f623409f180 0x7f6234131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33160/0 (socket says 172.21.15.156:33160) 2023-09-30T22:21:45.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.136+0000 7f6233fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f623409e870 0x7f623409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53256/0 (socket says 172.21.15.156:53256) 2023-09-30T22:21:45.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.136+0000 7f6238fd6700 1 -- 172.21.15.156:0/2036460968 learned_addr learned my addr 172.21.15.156:0/2036460968 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:45.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.136+0000 7f62337fe700 1 -- 172.21.15.156:0/2036460968 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f623409e870 msgr2=0x7f623409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:45.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.136+0000 7f62337fe700 1 --2- 172.21.15.156:0/2036460968 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f623409e870 0x7f623409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.136+0000 7f62337fe700 1 -- 172.21.15.156:0/2036460968 >> v1:172.21.15.156:6789/0 conn(0x7f6234131d70 legacy=0x7f6234138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:45.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.137+0000 7f62337fe700 1 -- 172.21.15.156:0/2036460968 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623409bab0 con 0x7f623409f180 2023-09-30T22:21:45.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.137+0000 7f6232ffd700 1 -- 172.21.15.156:0/2036460968 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 878967557 0 0) 0x7f623409c970 con 0x7f6234131d70 2023-09-30T22:21:45.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.137+0000 7f6233fff700 1 --2- 172.21.15.156:0/2036460968 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f623409e870 0x7f623409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:45.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.137+0000 7f62337fe700 1 --2- 172.21.15.156:0/2036460968 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f623409f180 0x7f6234131830 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f621c009840 tx=0x7f621c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b88518c0f226b540 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:45.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.137+0000 7f6232ffd700 1 -- 172.21.15.156:0/2036460968 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c011830 con 0x7f623409f180 2023-09-30T22:21:45.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.137+0000 7f6232ffd700 1 -- 172.21.15.156:0/2036460968 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621c011990 con 0x7f623409f180 2023-09-30T22:21:45.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.137+0000 7f6232ffd700 1 -- 172.21.15.156:0/2036460968 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c011d20 con 0x7f623409f180 2023-09-30T22:21:45.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.137+0000 7f623aa39700 1 -- 172.21.15.156:0/2036460968 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f623409f180 msgr2=0x7f6234131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:45.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.137+0000 7f623aa39700 1 --2- 172.21.15.156:0/2036460968 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f623409f180 0x7f6234131830 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f621c009840 tx=0x7f621c009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:45.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.137+0000 7f623aa39700 1 -- 172.21.15.156:0/2036460968 shutdown_connections 2023-09-30T22:21:45.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.137+0000 7f623aa39700 1 --2- 172.21.15.156:0/2036460968 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f623409e870 0x7f623409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.137+0000 7f623aa39700 1 --2- 172.21.15.156:0/2036460968 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f623409f180 0x7f6234131830 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.137+0000 7f623aa39700 1 -- 172.21.15.156:0/2036460968 >> 172.21.15.156:0/2036460968 conn(0x7f62340a4430 msgr2=0x7f62340a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:45.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.137+0000 7f623aa39700 1 -- 172.21.15.156:0/2036460968 shutdown_connections 2023-09-30T22:21:45.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.137+0000 7f623aa39700 1 -- 172.21.15.156:0/2036460968 wait complete. 2023-09-30T22:21:45.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.139+0000 7f623aa39700 1 Processor -- start 2023-09-30T22:21:45.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.139+0000 7f623aa39700 1 -- start start 2023-09-30T22:21:45.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.139+0000 7f623aa39700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f623409e870 0x7f623411d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:45.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.139+0000 7f623aa39700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f623409f180 0x7f623411d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:45.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.139+0000 7f623aa39700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6234131d70 0x7f62341c6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:45.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.139+0000 7f623aa39700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623411fe20 con 0x7f6234131d70 2023-09-30T22:21:45.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.139+0000 7f623aa39700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62341311a0 con 0x7f623409f180 2023-09-30T22:21:45.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.139+0000 7f623aa39700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f623411cd60 con 0x7f623409e870 2023-09-30T22:21:45.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.140+0000 7f6238fd6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6234131d70 0x7f62341c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:45.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.140+0000 7f62337fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f623409f180 0x7f623411d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:45.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.140+0000 7f62337fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f623409f180 0x7f623411d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53258/0 (socket says 172.21.15.156:53258) 2023-09-30T22:21:45.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.140+0000 7f6238fd6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6234131d70 0x7f62341c6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33174/0 (socket says 172.21.15.156:33174) 2023-09-30T22:21:45.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.140+0000 7f6233fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f623409e870 0x7f623411d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:45.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.140+0000 7f62337fe700 1 -- 172.21.15.156:0/1184532033 learned_addr learned my addr 172.21.15.156:0/1184532033 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:45.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.140+0000 7f62337fe700 1 -- 172.21.15.156:0/1184532033 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f623409e870 msgr2=0x7f623411d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:45.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.140+0000 7f62337fe700 1 --2- 172.21.15.156:0/1184532033 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f623409e870 0x7f623411d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.140+0000 7f62337fe700 1 -- 172.21.15.156:0/1184532033 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6234131d70 msgr2=0x7f62341c6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:45.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.140+0000 7f62337fe700 1 --2- 172.21.15.156:0/1184532033 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6234131d70 0x7f62341c6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.140+0000 7f62337fe700 1 -- 172.21.15.156:0/1184532033 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62240094a0 con 0x7f623409f180 2023-09-30T22:21:45.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.140+0000 7f6238fd6700 1 --2- 172.21.15.156:0/1184532033 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6234131d70 0x7f62341c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:45.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.140+0000 7f62337fe700 1 --2- 172.21.15.156:0/1184532033 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f623409f180 0x7f623411d840 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f621c0090b0 tx=0x7f621c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:45.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.140+0000 7f6230ff9700 1 -- 172.21.15.156:0/1184532033 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c004400 con 0x7f623409f180 2023-09-30T22:21:45.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.140+0000 7f6230ff9700 1 -- 172.21.15.156:0/1184532033 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621c01f070 con 0x7f623409f180 2023-09-30T22:21:45.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.140+0000 7f623aa39700 1 -- 172.21.15.156:0/1184532033 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621c0094a0 con 0x7f623409f180 2023-09-30T22:21:45.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.140+0000 7f6230ff9700 1 -- 172.21.15.156:0/1184532033 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c0038e0 con 0x7f623409f180 2023-09-30T22:21:45.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.140+0000 7f623aa39700 1 -- 172.21.15.156:0/1184532033 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f623411e420 con 0x7f623409f180 2023-09-30T22:21:45.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.141+0000 7f6230ff9700 1 -- 172.21.15.156:0/1184532033 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f621c021030 con 0x7f623409f180 2023-09-30T22:21:45.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.141+0000 7f6230ff9700 1 -- 172.21.15.156:0/1184532033 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f621c0409c0 con 0x7f623409f180 2023-09-30T22:21:45.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.141+0000 7f623aa39700 1 -- 172.21.15.156:0/1184532033 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62340a2b10 con 0x7f623409f180 2023-09-30T22:21:45.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.146+0000 7f6230ff9700 1 -- 172.21.15.156:0/1184532033 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f621c004560 con 0x7f623409f180 2023-09-30T22:21:45.186 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:45.228 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:45.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.312+0000 7f500343a700 1 Processor -- start 2023-09-30T22:21:45.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.312+0000 7f500343a700 1 -- start start 2023-09-30T22:21:45.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.313+0000 7f500343a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ffc09e870 0x7f4ffc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:45.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.313+0000 7f500343a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4ffc131f40 0x7f4ffc139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:45.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.313+0000 7f500343a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ffc09c970 con 0x7f4ffc09f180 2023-09-30T22:21:45.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.313+0000 7f500343a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ffc0a0920 con 0x7f4ffc131f40 2023-09-30T22:21:45.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.313+0000 7f500343a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc09f9c0 con 0x7f4ffc09e870 2023-09-30T22:21:45.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.313+0000 7f50019d7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4ffc131f40 0x7f4ffc139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:45.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.313+0000 7f50009d5700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4ffc09f180 0x7f4ffc131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45152/0 (socket says 172.21.15.156:45152) 2023-09-30T22:21:45.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.313+0000 7f50009d5700 1 -- 172.21.15.156:0/3906224260 learned_addr learned my addr 172.21.15.156:0/3906224260 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:45.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.313+0000 7f50011d6700 1 --2- 172.21.15.156:0/3906224260 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ffc09e870 0x7f4ffc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:45.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.313+0000 7f50019d7700 1 -- 172.21.15.156:0/3906224260 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ffc09e870 msgr2=0x7f4ffc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:45.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.313+0000 7f50019d7700 1 --2- 172.21.15.156:0/3906224260 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ffc09e870 0x7f4ffc09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.313+0000 7f50019d7700 1 -- 172.21.15.156:0/3906224260 >> v1:172.21.15.156:6789/0 conn(0x7f4ffc09f180 legacy=0x7f4ffc131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:45.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.313+0000 7f50019d7700 1 -- 172.21.15.156:0/3906224260 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc09bab0 con 0x7f4ffc131f40 2023-09-30T22:21:45.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.313+0000 7f50019d7700 1 --2- 172.21.15.156:0/3906224260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ffc131f40 0x7f4ffc139ca0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009d90 tx=0x7f4ff400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2d3370da6518dd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:45.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.314+0000 7f4ff3fff700 1 -- 172.21.15.156:0/3906224260 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff400e070 con 0x7f4ffc131f40 2023-09-30T22:21:45.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.314+0000 7f4ff3fff700 1 -- 172.21.15.156:0/3906224260 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff400bb20 con 0x7f4ffc131f40 2023-09-30T22:21:45.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.314+0000 7f4ff3fff700 1 -- 172.21.15.156:0/3906224260 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4012430 con 0x7f4ffc131f40 2023-09-30T22:21:45.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.314+0000 7f500343a700 1 -- 172.21.15.156:0/3906224260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ffc131f40 msgr2=0x7f4ffc139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:45.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.314+0000 7f500343a700 1 --2- 172.21.15.156:0/3906224260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ffc131f40 0x7f4ffc139ca0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009d90 tx=0x7f4ff400b330 comp rx=0 tx=0).stop 2023-09-30T22:21:45.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.314+0000 7f500343a700 1 -- 172.21.15.156:0/3906224260 shutdown_connections 2023-09-30T22:21:45.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.314+0000 7f500343a700 1 --2- 172.21.15.156:0/3906224260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ffc131f40 0x7f4ffc139ca0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.314+0000 7f500343a700 1 --2- 172.21.15.156:0/3906224260 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ffc09e870 0x7f4ffc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.314+0000 7f500343a700 1 -- 172.21.15.156:0/3906224260 >> 172.21.15.156:0/3906224260 conn(0x7f4ffc0a4430 msgr2=0x7f4ffc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:45.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.314+0000 7f500343a700 1 -- 172.21.15.156:0/3906224260 shutdown_connections 2023-09-30T22:21:45.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.314+0000 7f500343a700 1 -- 172.21.15.156:0/3906224260 wait complete. 2023-09-30T22:21:45.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.316+0000 7f500343a700 1 Processor -- start 2023-09-30T22:21:45.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.316+0000 7f500343a700 1 -- start start 2023-09-30T22:21:45.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.316+0000 7f500343a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ffc09e870 0x7f4ffc1201d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:45.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.316+0000 7f500343a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ffc09f180 0x7f4ffc120710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:45.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.316+0000 7f500343a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ffc131f40 0x7f4ffc120c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:45.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.316+0000 7f500343a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc1216a0 con 0x7f4ffc09e870 2023-09-30T22:21:45.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.316+0000 7f500343a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc1315a0 con 0x7f4ffc09f180 2023-09-30T22:21:45.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.316+0000 7f500343a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc122c70 con 0x7f4ffc131f40 2023-09-30T22:21:45.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.317+0000 7f50011d6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ffc09e870 0x7f4ffc1201d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:45.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.317+0000 7f50011d6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ffc09e870 0x7f4ffc1201d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33188/0 (socket says 172.21.15.156:33188) 2023-09-30T22:21:45.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.317+0000 7f50011d6700 1 -- 172.21.15.156:0/2741347225 learned_addr learned my addr 172.21.15.156:0/2741347225 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:45.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.317+0000 7f50009d5700 1 --2- 172.21.15.156:0/2741347225 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ffc09f180 0x7f4ffc120710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:45.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.317+0000 7f50019d7700 1 --2- 172.21.15.156:0/2741347225 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ffc131f40 0x7f4ffc120c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:45.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.317+0000 7f50011d6700 1 -- 172.21.15.156:0/2741347225 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ffc131f40 msgr2=0x7f4ffc120c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:45.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.317+0000 7f50011d6700 1 --2- 172.21.15.156:0/2741347225 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ffc131f40 0x7f4ffc120c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.317+0000 7f50011d6700 1 -- 172.21.15.156:0/2741347225 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ffc09f180 msgr2=0x7f4ffc120710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:45.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.317+0000 7f50011d6700 1 --2- 172.21.15.156:0/2741347225 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ffc09f180 0x7f4ffc120710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.317+0000 7f50011d6700 1 -- 172.21.15.156:0/2741347225 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff4009a70 con 0x7f4ffc09e870 2023-09-30T22:21:45.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.317+0000 7f50011d6700 1 --2- 172.21.15.156:0/2741347225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ffc09e870 0x7f4ffc1201d0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800e8a0 tx=0x7f4ff800ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:45.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.317+0000 7f4ff1ffb700 1 -- 172.21.15.156:0/2741347225 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8009590 con 0x7f4ffc09e870 2023-09-30T22:21:45.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.317+0000 7f4ff1ffb700 1 -- 172.21.15.156:0/2741347225 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff8013680 con 0x7f4ffc09e870 2023-09-30T22:21:45.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.317+0000 7f500343a700 1 -- 172.21.15.156:0/2741347225 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ffc123480 con 0x7f4ffc09e870 2023-09-30T22:21:45.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.317+0000 7f4ff1ffb700 1 -- 172.21.15.156:0/2741347225 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff80139f0 con 0x7f4ffc09e870 2023-09-30T22:21:45.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.318+0000 7f500343a700 1 -- 172.21.15.156:0/2741347225 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ffc0a2e20 con 0x7f4ffc09e870 2023-09-30T22:21:45.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.319+0000 7f500343a700 1 -- 172.21.15.156:0/2741347225 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ffc123030 con 0x7f4ffc09e870 2023-09-30T22:21:45.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.320+0000 7f4ff1ffb700 1 -- 172.21.15.156:0/2741347225 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4ff8013b50 con 0x7f4ffc09e870 2023-09-30T22:21:45.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.320+0000 7f4ff1ffb700 1 -- 172.21.15.156:0/2741347225 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4ff803fd80 con 0x7f4ffc09e870 2023-09-30T22:21:45.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.324+0000 7f4ff1ffb700 1 -- 172.21.15.156:0/2741347225 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ff8026430 con 0x7f4ffc09e870 2023-09-30T22:21:45.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.340+0000 7f623aa39700 1 -- 172.21.15.156:0/1184532033 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f623404f2a0 con 0x7f623409f180 2023-09-30T22:21:45.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.340+0000 7f6230ff9700 1 -- 172.21.15.156:0/1184532033 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f621c01b430 con 0x7f623409f180 2023-09-30T22:21:45.340 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:45.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.342+0000 7f623aa39700 1 -- 172.21.15.156:0/1184532033 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f623409f180 msgr2=0x7f623411d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:45.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.342+0000 7f623aa39700 1 --2- 172.21.15.156:0/1184532033 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f623409f180 0x7f623411d840 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f621c0090b0 tx=0x7f621c004750 comp rx=0 tx=0).stop 2023-09-30T22:21:45.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.342+0000 7f623aa39700 1 -- 172.21.15.156:0/1184532033 shutdown_connections 2023-09-30T22:21:45.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.342+0000 7f623aa39700 1 --2- 172.21.15.156:0/1184532033 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6234131d70 0x7f62341c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.342+0000 7f623aa39700 1 --2- 172.21.15.156:0/1184532033 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f623409e870 0x7f623411d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.342+0000 7f623aa39700 1 --2- 172.21.15.156:0/1184532033 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f623409f180 0x7f623411d840 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.342+0000 7f623aa39700 1 -- 172.21.15.156:0/1184532033 >> 172.21.15.156:0/1184532033 conn(0x7f62340a4430 msgr2=0x7f62341b9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:45.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.342+0000 7f623aa39700 1 -- 172.21.15.156:0/1184532033 shutdown_connections 2023-09-30T22:21:45.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.342+0000 7f623aa39700 1 -- 172.21.15.156:0/1184532033 wait complete. 2023-09-30T22:21:45.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:45.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.357+0000 7feabe1db700 1 Processor -- start 2023-09-30T22:21:45.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.357+0000 7feabe1db700 1 -- start start 2023-09-30T22:21:45.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.357+0000 7feabe1db700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feab809e870 0x7feab809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:45.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.357+0000 7feabe1db700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7feab809f180 0x7feab8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:45.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.357+0000 7feabe1db700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab809c970 con 0x7feab8131d70 2023-09-30T22:21:45.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.357+0000 7feabe1db700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab80a0920 con 0x7feab809f180 2023-09-30T22:21:45.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.357+0000 7feabe1db700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feab809f9c0 con 0x7feab809e870 2023-09-30T22:21:45.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.357+0000 7feab77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feab809e870 0x7feab809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:45.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.357+0000 7feab6ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7feab809f180 0x7feab8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:45.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.357+0000 7feab77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feab809e870 0x7feab809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45000/0 (socket says 172.21.15.156:45000) 2023-09-30T22:21:45.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.357+0000 7feab77fe700 1 -- 172.21.15.156:0/123727481 learned_addr learned my addr 172.21.15.156:0/123727481 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:45.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.357+0000 7feab6ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7feab809f180 0x7feab8131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33196/0 (socket says 172.21.15.156:33196) 2023-09-30T22:21:45.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.358+0000 7feab77fe700 1 -- 172.21.15.156:0/123727481 >> v2:172.21.15.156:3300/0 conn(0x7feab809f180 msgr2=0x7feab8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:45.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.358+0000 7feab77fe700 1 --2- 172.21.15.156:0/123727481 >> v2:172.21.15.156:3300/0 conn(0x7feab809f180 0x7feab8131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.358+0000 7feab77fe700 1 -- 172.21.15.156:0/123727481 >> v1:172.21.15.156:6789/0 conn(0x7feab8131d70 legacy=0x7feab8138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:45.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.358+0000 7feab77fe700 1 -- 172.21.15.156:0/123727481 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab809bab0 con 0x7feab809e870 2023-09-30T22:21:45.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.358+0000 7feab77fe700 1 --2- 172.21.15.156:0/123727481 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feab809e870 0x7feab809ec40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7feaa80098f0 tx=0x7feaa8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=861954d3b9bd14bb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:45.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.358+0000 7feab67fc700 1 -- 172.21.15.156:0/123727481 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8011830 con 0x7feab809e870 2023-09-30T22:21:45.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.358+0000 7feab67fc700 1 -- 172.21.15.156:0/123727481 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa8011990 con 0x7feab809e870 2023-09-30T22:21:45.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.358+0000 7feab67fc700 1 -- 172.21.15.156:0/123727481 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8011d20 con 0x7feab809e870 2023-09-30T22:21:45.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.359+0000 7feabe1db700 1 -- 172.21.15.156:0/123727481 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feab809e870 msgr2=0x7feab809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:45.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.359+0000 7feabe1db700 1 --2- 172.21.15.156:0/123727481 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feab809e870 0x7feab809ec40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7feaa80098f0 tx=0x7feaa8009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:45.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.359+0000 7feabe1db700 1 -- 172.21.15.156:0/123727481 shutdown_connections 2023-09-30T22:21:45.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.359+0000 7feabe1db700 1 --2- 172.21.15.156:0/123727481 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feab809e870 0x7feab809ec40 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.359+0000 7feabe1db700 1 --2- 172.21.15.156:0/123727481 >> v2:172.21.15.156:3300/0 conn(0x7feab809f180 0x7feab8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.359+0000 7feabe1db700 1 -- 172.21.15.156:0/123727481 >> 172.21.15.156:0/123727481 conn(0x7feab80a4430 msgr2=0x7feab80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:45.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.359+0000 7feabe1db700 1 -- 172.21.15.156:0/123727481 shutdown_connections 2023-09-30T22:21:45.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.359+0000 7feabe1db700 1 -- 172.21.15.156:0/123727481 wait complete. 2023-09-30T22:21:45.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.360+0000 7feabe1db700 1 Processor -- start 2023-09-30T22:21:45.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.360+0000 7feabe1db700 1 -- start start 2023-09-30T22:21:45.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.361+0000 7feabe1db700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feab809e870 0x7feab81203e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:45.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.361+0000 7feabe1db700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feab809f180 0x7feab8120920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:45.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.361+0000 7feabe1db700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feab8131d70 0x7feab8120e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:45.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.361+0000 7feabe1db700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab8121840 con 0x7feab8131d70 2023-09-30T22:21:45.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.361+0000 7feabe1db700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab809dba0 con 0x7feab809f180 2023-09-30T22:21:45.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.361+0000 7feabe1db700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feab8122850 con 0x7feab809e870 2023-09-30T22:21:45.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.361+0000 7feab77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feab809e870 0x7feab81203e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:45.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.361+0000 7feab77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feab809e870 0x7feab81203e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45010/0 (socket says 172.21.15.156:45010) 2023-09-30T22:21:45.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.361+0000 7feab7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feab8131d70 0x7feab8120e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:45.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.361+0000 7feab77fe700 1 -- 172.21.15.156:0/3413063689 learned_addr learned my addr 172.21.15.156:0/3413063689 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:45.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.361+0000 7feab6ffd700 1 --2- 172.21.15.156:0/3413063689 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feab809f180 0x7feab8120920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:45.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.361+0000 7feab77fe700 1 -- 172.21.15.156:0/3413063689 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feab809f180 msgr2=0x7feab8120920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:45.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.361+0000 7feab77fe700 1 --2- 172.21.15.156:0/3413063689 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feab809f180 0x7feab8120920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.361+0000 7feab77fe700 1 -- 172.21.15.156:0/3413063689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feab8131d70 msgr2=0x7feab8120e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:45.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.361+0000 7feab77fe700 1 --2- 172.21.15.156:0/3413063689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feab8131d70 0x7feab8120e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.361+0000 7feab77fe700 1 -- 172.21.15.156:0/3413063689 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa8009550 con 0x7feab809e870 2023-09-30T22:21:45.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.361+0000 7feab77fe700 1 --2- 172.21.15.156:0/3413063689 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feab809e870 0x7feab81203e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7feaa8014040 tx=0x7feaa8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:45.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.361+0000 7fea9ffff700 1 -- 172.21.15.156:0/3413063689 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8004510 con 0x7feab809e870 2023-09-30T22:21:45.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.361+0000 7fea9ffff700 1 -- 172.21.15.156:0/3413063689 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa801e070 con 0x7feab809e870 2023-09-30T22:21:45.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.362+0000 7feabe1db700 1 -- 172.21.15.156:0/3413063689 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab8121ff0 con 0x7feab809e870 2023-09-30T22:21:45.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.362+0000 7fea9ffff700 1 -- 172.21.15.156:0/3413063689 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa80038e0 con 0x7feab809e870 2023-09-30T22:21:45.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.362+0000 7feabe1db700 1 -- 172.21.15.156:0/3413063689 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab8130f00 con 0x7feab809e870 2023-09-30T22:21:45.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.362+0000 7fea9ffff700 1 -- 172.21.15.156:0/3413063689 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feaa8003a40 con 0x7feab809e870 2023-09-30T22:21:45.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.362+0000 7fea9ffff700 1 -- 172.21.15.156:0/3413063689 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feaa80406b0 con 0x7feab809e870 2023-09-30T22:21:45.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.363+0000 7fea9dffb700 1 -- 172.21.15.156:0/3413063689 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea900052e0 con 0x7feab809e870 2023-09-30T22:21:45.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.367+0000 7fea9ffff700 1 -- 172.21.15.156:0/3413063689 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feaa8003cf0 con 0x7feab809e870 2023-09-30T22:21:45.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.518+0000 7f500343a700 1 -- 172.21.15.156:0/2741347225 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4ffc11d580 con 0x7f4ffc09e870 2023-09-30T22:21:45.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.518+0000 7f4ff1ffb700 1 -- 172.21.15.156:0/2741347225 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ff802a090 con 0x7f4ffc09e870 2023-09-30T22:21:45.518 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:45.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.520+0000 7f500343a700 1 -- 172.21.15.156:0/2741347225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ffc09e870 msgr2=0x7f4ffc1201d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:45.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.520+0000 7f500343a700 1 --2- 172.21.15.156:0/2741347225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ffc09e870 0x7f4ffc1201d0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800e8a0 tx=0x7f4ff800ebb0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.520+0000 7f500343a700 1 -- 172.21.15.156:0/2741347225 shutdown_connections 2023-09-30T22:21:45.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.520+0000 7f500343a700 1 --2- 172.21.15.156:0/2741347225 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ffc131f40 0x7f4ffc120c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.520+0000 7f500343a700 1 --2- 172.21.15.156:0/2741347225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ffc09e870 0x7f4ffc1201d0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.520+0000 7f500343a700 1 --2- 172.21.15.156:0/2741347225 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ffc09f180 0x7f4ffc120710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.520+0000 7f500343a700 1 -- 172.21.15.156:0/2741347225 >> 172.21.15.156:0/2741347225 conn(0x7f4ffc0a4430 msgr2=0x7f4ffc11a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:45.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.520+0000 7f500343a700 1 -- 172.21.15.156:0/2741347225 shutdown_connections 2023-09-30T22:21:45.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.520+0000 7f500343a700 1 -- 172.21.15.156:0/2741347225 wait complete. 2023-09-30T22:21:45.532 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:45.555 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:45.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.561+0000 7fea9dffb700 1 -- 172.21.15.156:0/3413063689 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fea90005590 con 0x7feab809e870 2023-09-30T22:21:45.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.561+0000 7fea9ffff700 1 -- 172.21.15.156:0/3413063689 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feaa8035020 con 0x7feab809e870 2023-09-30T22:21:45.561 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:45.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.563+0000 7fea9dffb700 1 -- 172.21.15.156:0/3413063689 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feab809e870 msgr2=0x7feab81203e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:45.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.563+0000 7fea9dffb700 1 --2- 172.21.15.156:0/3413063689 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feab809e870 0x7feab81203e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7feaa8014040 tx=0x7feaa8004750 comp rx=0 tx=0).stop 2023-09-30T22:21:45.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.563+0000 7fea9dffb700 1 -- 172.21.15.156:0/3413063689 shutdown_connections 2023-09-30T22:21:45.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.563+0000 7fea9dffb700 1 --2- 172.21.15.156:0/3413063689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feab8131d70 0x7feab8120e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.563+0000 7fea9dffb700 1 --2- 172.21.15.156:0/3413063689 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feab809e870 0x7feab81203e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.563+0000 7fea9dffb700 1 --2- 172.21.15.156:0/3413063689 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feab809f180 0x7feab8120920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.563+0000 7fea9dffb700 1 -- 172.21.15.156:0/3413063689 >> 172.21.15.156:0/3413063689 conn(0x7feab80a4430 msgr2=0x7feab806fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:45.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.563+0000 7fea9dffb700 1 -- 172.21.15.156:0/3413063689 shutdown_connections 2023-09-30T22:21:45.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.563+0000 7fea9dffb700 1 -- 172.21.15.156:0/3413063689 wait complete. 2023-09-30T22:21:45.575 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:45.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.686+0000 7fa463535700 1 Processor -- start 2023-09-30T22:21:45.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.686+0000 7fa463535700 1 -- start start 2023-09-30T22:21:45.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.686+0000 7fa463535700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa45c09d860 0x7fa45c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:45.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.686+0000 7fa463535700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa45c09e170 0x7fa45c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:45.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.686+0000 7fa463535700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa45c130ce0 0x7fa45c131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:45.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.686+0000 7fa463535700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa45c09aaa0 con 0x7fa45c130ce0 2023-09-30T22:21:45.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.686+0000 7fa463535700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c09f870 con 0x7fa45c09e170 2023-09-30T22:21:45.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.686+0000 7fa463535700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c09b360 con 0x7fa45c09d860 2023-09-30T22:21:45.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.686+0000 7fa4612d1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa45c09d860 0x7fa45c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:45.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.686+0000 7fa461ad2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa45c130ce0 0x7fa45c131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:45.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.686+0000 7fa460ad0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa45c09e170 0x7fa45c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:45.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.687+0000 7fa461ad2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa45c130ce0 0x7fa45c131150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33212/0 (socket says 172.21.15.156:33212) 2023-09-30T22:21:45.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.687+0000 7fa4612d1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa45c09d860 0x7fa45c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45012/0 (socket says 172.21.15.156:45012) 2023-09-30T22:21:45.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.687+0000 7fa460ad0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa45c09e170 0x7fa45c1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53280/0 (socket says 172.21.15.156:53280) 2023-09-30T22:21:45.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.687+0000 7fa461ad2700 1 -- 172.21.15.156:0/3548404185 learned_addr learned my addr 172.21.15.156:0/3548404185 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:45.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.687+0000 7fa461ad2700 1 -- 172.21.15.156:0/3548404185 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa45c09d860 msgr2=0x7fa45c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:45.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.687+0000 7fa461ad2700 1 --2- 172.21.15.156:0/3548404185 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa45c09d860 0x7fa45c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.687+0000 7fa461ad2700 1 -- 172.21.15.156:0/3548404185 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa45c09e170 msgr2=0x7fa45c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:45.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.687+0000 7fa461ad2700 1 --2- 172.21.15.156:0/3548404185 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa45c09e170 0x7fa45c1307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.687+0000 7fa461ad2700 1 -- 172.21.15.156:0/3548404185 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45c09b620 con 0x7fa45c130ce0 2023-09-30T22:21:45.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.687+0000 7fa460ad0700 1 --2- 172.21.15.156:0/3548404185 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa45c09e170 0x7fa45c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:45.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.687+0000 7fa4612d1700 1 --2- 172.21.15.156:0/3548404185 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa45c09d860 0x7fa45c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:45.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.687+0000 7fa461ad2700 1 --2- 172.21.15.156:0/3548404185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa45c130ce0 0x7fa45c131150 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fa454009e50 tx=0x7fa45400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37cf36dd2af9f113 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:45.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.687+0000 7fa453fff700 1 -- 172.21.15.156:0/3548404185 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45400e070 con 0x7fa45c130ce0 2023-09-30T22:21:45.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.687+0000 7fa453fff700 1 -- 172.21.15.156:0/3548404185 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45400b910 con 0x7fa45c130ce0 2023-09-30T22:21:45.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.687+0000 7fa453fff700 1 -- 172.21.15.156:0/3548404185 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45400bcc0 con 0x7fa45c130ce0 2023-09-30T22:21:45.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.688+0000 7fa463535700 1 -- 172.21.15.156:0/3548404185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa45c130ce0 msgr2=0x7fa45c131150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:45.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.688+0000 7fa463535700 1 --2- 172.21.15.156:0/3548404185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa45c130ce0 0x7fa45c131150 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fa454009e50 tx=0x7fa45400b330 comp rx=0 tx=0).stop 2023-09-30T22:21:45.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.688+0000 7fa463535700 1 -- 172.21.15.156:0/3548404185 shutdown_connections 2023-09-30T22:21:45.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.688+0000 7fa463535700 1 --2- 172.21.15.156:0/3548404185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa45c130ce0 0x7fa45c131150 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.688+0000 7fa463535700 1 --2- 172.21.15.156:0/3548404185 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa45c09d860 0x7fa45c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.688+0000 7fa463535700 1 --2- 172.21.15.156:0/3548404185 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa45c09e170 0x7fa45c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.688+0000 7fa463535700 1 -- 172.21.15.156:0/3548404185 >> 172.21.15.156:0/3548404185 conn(0x7fa45c099c40 msgr2=0x7fa45c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:45.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.688+0000 7fa463535700 1 -- 172.21.15.156:0/3548404185 shutdown_connections 2023-09-30T22:21:45.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.688+0000 7fa463535700 1 -- 172.21.15.156:0/3548404185 wait complete. 2023-09-30T22:21:45.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.689+0000 7fa463535700 1 Processor -- start 2023-09-30T22:21:45.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.689+0000 7fa463535700 1 -- start start 2023-09-30T22:21:45.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.689+0000 7fa463535700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa45c09d860 0x7fa45c11c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:45.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.689+0000 7fa463535700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa45c09e170 0x7fa45c11c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:45.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.689+0000 7fa463535700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa45c130ce0 0x7fa45c11cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:45.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.689+0000 7fa463535700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c11fe40 con 0x7fa45c09d860 2023-09-30T22:21:45.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.689+0000 7fa463535700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c11f670 con 0x7fa45c09e170 2023-09-30T22:21:45.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.689+0000 7fa463535700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c09c8b0 con 0x7fa45c130ce0 2023-09-30T22:21:45.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.689+0000 7fa4612d1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa45c09d860 0x7fa45c11c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:45.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.689+0000 7fa461ad2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa45c130ce0 0x7fa45c11cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:45.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.689+0000 7fa4612d1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa45c09d860 0x7fa45c11c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33224/0 (socket says 172.21.15.156:33224) 2023-09-30T22:21:45.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.689+0000 7fa4612d1700 1 -- 172.21.15.156:0/468824304 learned_addr learned my addr 172.21.15.156:0/468824304 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:45.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.689+0000 7fa460ad0700 1 --2- 172.21.15.156:0/468824304 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa45c09e170 0x7fa45c11c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:45.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.689+0000 7fa4612d1700 1 -- 172.21.15.156:0/468824304 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa45c130ce0 msgr2=0x7fa45c11cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:45.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.690+0000 7fa4612d1700 1 --2- 172.21.15.156:0/468824304 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa45c130ce0 0x7fa45c11cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.690+0000 7fa4612d1700 1 -- 172.21.15.156:0/468824304 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa45c09e170 msgr2=0x7fa45c11c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:45.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.690+0000 7fa4612d1700 1 --2- 172.21.15.156:0/468824304 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa45c09e170 0x7fa45c11c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.690+0000 7fa4612d1700 1 -- 172.21.15.156:0/468824304 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45800b740 con 0x7fa45c09d860 2023-09-30T22:21:45.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.690+0000 7fa460ad0700 1 --2- 172.21.15.156:0/468824304 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa45c09e170 0x7fa45c11c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:45.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.690+0000 7fa4612d1700 1 --2- 172.21.15.156:0/468824304 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa45c09d860 0x7fa45c11c320 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fa458010f40 tx=0x7fa45800e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:45.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.690+0000 7fa451ffb700 1 -- 172.21.15.156:0/468824304 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45800ba20 con 0x7fa45c09d860 2023-09-30T22:21:45.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.690+0000 7fa451ffb700 1 -- 172.21.15.156:0/468824304 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa458011650 con 0x7fa45c09d860 2023-09-30T22:21:45.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.690+0000 7fa463535700 1 -- 172.21.15.156:0/468824304 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa44c0094a0 con 0x7fa45c09d860 2023-09-30T22:21:45.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.690+0000 7fa451ffb700 1 -- 172.21.15.156:0/468824304 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4580119e0 con 0x7fa45c09d860 2023-09-30T22:21:45.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.690+0000 7fa463535700 1 -- 172.21.15.156:0/468824304 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa454009b30 con 0x7fa45c09d860 2023-09-30T22:21:45.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.691+0000 7fa451ffb700 1 -- 172.21.15.156:0/468824304 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa458011b40 con 0x7fa45c09d860 2023-09-30T22:21:45.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.691+0000 7fa451ffb700 1 -- 172.21.15.156:0/468824304 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa4580422f0 con 0x7fa45c09d860 2023-09-30T22:21:45.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.691+0000 7fa463535700 1 -- 172.21.15.156:0/468824304 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa45c04f2a0 con 0x7fa45c09d860 2023-09-30T22:21:45.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.696+0000 7fa451ffb700 1 -- 172.21.15.156:0/468824304 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa45801e020 con 0x7fa45c09d860 2023-09-30T22:21:45.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.880+0000 7fa463535700 1 -- 172.21.15.156:0/468824304 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa45c0a2260 con 0x7fa45c09d860 2023-09-30T22:21:45.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.880+0000 7fa451ffb700 1 -- 172.21.15.156:0/468824304 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa45800ee70 con 0x7fa45c09d860 2023-09-30T22:21:45.880 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:45.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.882+0000 7fa463535700 1 -- 172.21.15.156:0/468824304 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa45c09d860 msgr2=0x7fa45c11c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:45.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.882+0000 7fa463535700 1 --2- 172.21.15.156:0/468824304 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa45c09d860 0x7fa45c11c320 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fa458010f40 tx=0x7fa45800e640 comp rx=0 tx=0).stop 2023-09-30T22:21:45.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.882+0000 7fa463535700 1 -- 172.21.15.156:0/468824304 shutdown_connections 2023-09-30T22:21:45.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.882+0000 7fa463535700 1 --2- 172.21.15.156:0/468824304 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa45c130ce0 0x7fa45c11cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.882+0000 7fa463535700 1 --2- 172.21.15.156:0/468824304 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa45c09d860 0x7fa45c11c320 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.882+0000 7fa463535700 1 --2- 172.21.15.156:0/468824304 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa45c09e170 0x7fa45c11c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.882+0000 7fa463535700 1 -- 172.21.15.156:0/468824304 >> 172.21.15.156:0/468824304 conn(0x7fa45c099c40 msgr2=0x7fa45c12e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:45.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.882+0000 7fa463535700 1 -- 172.21.15.156:0/468824304 shutdown_connections 2023-09-30T22:21:45.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:45.882+0000 7fa463535700 1 -- 172.21.15.156:0/468824304 wait complete. 2023-09-30T22:21:45.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:46.356 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:46.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.483+0000 7f45abb82700 1 Processor -- start 2023-09-30T22:21:46.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.483+0000 7f45abb82700 1 -- start start 2023-09-30T22:21:46.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.484+0000 7f45abb82700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f45a409d860 0x7f45a409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.484+0000 7f45abb82700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f45a409e170 0x7f45a41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.484+0000 7f45abb82700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a409aaa0 con 0x7f45a4130ce0 2023-09-30T22:21:46.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.484+0000 7f45abb82700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a409f870 con 0x7f45a409d860 2023-09-30T22:21:46.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.484+0000 7f45abb82700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45a409b360 con 0x7f45a409e170 2023-09-30T22:21:46.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.484+0000 7f45a991e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f45a409d860 0x7f45a409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.484+0000 7f45a911d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f45a409e170 0x7f45a41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.484+0000 7f45aa11f700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f45a4130ce0 0x7f45a41379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45162/0 (socket says 172.21.15.156:45162) 2023-09-30T22:21:46.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.484+0000 7f45a991e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f45a409d860 0x7f45a409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53296/0 (socket says 172.21.15.156:53296) 2023-09-30T22:21:46.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.484+0000 7f45aa11f700 1 -- 172.21.15.156:0/3732087249 learned_addr learned my addr 172.21.15.156:0/3732087249 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:46.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.484+0000 7f45a891c700 1 -- 172.21.15.156:0/3732087249 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4029779640 0 0) 0x7f45a409aaa0 con 0x7f45a4130ce0 2023-09-30T22:21:46.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.484+0000 7f45a891c700 1 -- 172.21.15.156:0/3732087249 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45900035b0 con 0x7f45a4130ce0 2023-09-30T22:21:46.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.484+0000 7f45a991e700 1 -- 172.21.15.156:0/3732087249 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f45a409e170 msgr2=0x7f45a41307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:46.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.484+0000 7f45a991e700 1 --2- 172.21.15.156:0/3732087249 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f45a409e170 0x7f45a41307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.484+0000 7f45a991e700 1 -- 172.21.15.156:0/3732087249 >> v1:172.21.15.156:6789/0 conn(0x7f45a4130ce0 legacy=0x7f45a41379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.484+0000 7f45a991e700 1 -- 172.21.15.156:0/3732087249 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a409b620 con 0x7f45a409d860 2023-09-30T22:21:46.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.484+0000 7f45a911d700 1 --2- 172.21.15.156:0/3732087249 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f45a409e170 0x7f45a41307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:46.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.485+0000 7f45a991e700 1 --2- 172.21.15.156:0/3732087249 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f45a409d860 0x7f45a409dc30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f459400bb10 tx=0x7f459400be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebac6bd75b0a36ac server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:46.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.485+0000 7f45a891c700 1 -- 172.21.15.156:0/3732087249 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459400dc70 con 0x7f45a409d860 2023-09-30T22:21:46.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.485+0000 7f45a891c700 1 -- 172.21.15.156:0/3732087249 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459400ddd0 con 0x7f45a409d860 2023-09-30T22:21:46.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.485+0000 7f45a891c700 1 -- 172.21.15.156:0/3732087249 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4594010670 con 0x7f45a409d860 2023-09-30T22:21:46.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.485+0000 7f45abb82700 1 -- 172.21.15.156:0/3732087249 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f45a409d860 msgr2=0x7f45a409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.485+0000 7f45abb82700 1 --2- 172.21.15.156:0/3732087249 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f45a409d860 0x7f45a409dc30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f459400bb10 tx=0x7f459400be20 comp rx=0 tx=0).stop 2023-09-30T22:21:46.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.485+0000 7f45abb82700 1 -- 172.21.15.156:0/3732087249 shutdown_connections 2023-09-30T22:21:46.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.485+0000 7f45abb82700 1 --2- 172.21.15.156:0/3732087249 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f45a409d860 0x7f45a409dc30 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.485+0000 7f45abb82700 1 --2- 172.21.15.156:0/3732087249 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f45a409e170 0x7f45a41307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.485+0000 7f45abb82700 1 -- 172.21.15.156:0/3732087249 >> 172.21.15.156:0/3732087249 conn(0x7f45a4099c40 msgr2=0x7f45a40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:46.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.485+0000 7f45abb82700 1 -- 172.21.15.156:0/3732087249 shutdown_connections 2023-09-30T22:21:46.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.485+0000 7f45abb82700 1 -- 172.21.15.156:0/3732087249 wait complete. 2023-09-30T22:21:46.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.486+0000 7f45abb82700 1 Processor -- start 2023-09-30T22:21:46.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.486+0000 7f45abb82700 1 -- start start 2023-09-30T22:21:46.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.487+0000 7f45abb82700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f45a409d860 0x7f45a411e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.487+0000 7f45abb82700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f45a409e170 0x7f45a411e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.487+0000 7f45abb82700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45a4130ce0 0x7f45a411ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.487+0000 7f45abb82700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a4121c00 con 0x7f45a4130ce0 2023-09-30T22:21:46.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.487+0000 7f45abb82700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a409c8b0 con 0x7f45a409d860 2023-09-30T22:21:46.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.487+0000 7f45abb82700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45a41200e0 con 0x7f45a409e170 2023-09-30T22:21:46.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.487+0000 7f45aa11f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45a4130ce0 0x7f45a411ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.487+0000 7f45a991e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f45a409d860 0x7f45a411e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.487+0000 7f45aa11f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45a4130ce0 0x7f45a411ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33234/0 (socket says 172.21.15.156:33234) 2023-09-30T22:21:46.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.487+0000 7f45a991e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f45a409d860 0x7f45a411e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53298/0 (socket says 172.21.15.156:53298) 2023-09-30T22:21:46.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.487+0000 7f45aa11f700 1 -- 172.21.15.156:0/3654033296 learned_addr learned my addr 172.21.15.156:0/3654033296 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:46.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.487+0000 7f45a911d700 1 --2- 172.21.15.156:0/3654033296 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f45a409e170 0x7f45a411e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.487+0000 7f45a991e700 1 -- 172.21.15.156:0/3654033296 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f45a409e170 msgr2=0x7f45a411e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.487+0000 7f45a991e700 1 --2- 172.21.15.156:0/3654033296 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f45a409e170 0x7f45a411e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.487+0000 7f45a991e700 1 -- 172.21.15.156:0/3654033296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45a4130ce0 msgr2=0x7f45a411ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.487+0000 7f45a991e700 1 --2- 172.21.15.156:0/3654033296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45a4130ce0 0x7f45a411ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.487+0000 7f45a991e700 1 -- 172.21.15.156:0/3654033296 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a00094a0 con 0x7f45a409d860 2023-09-30T22:21:46.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.487+0000 7f45aa11f700 1 --2- 172.21.15.156:0/3654033296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45a4130ce0 0x7f45a411ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:46.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.487+0000 7f45a991e700 1 --2- 172.21.15.156:0/3654033296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f45a409d860 0x7f45a411e400 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f45a409ee50 tx=0x7f4594004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:46.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.487+0000 7f459a7fc700 1 -- 172.21.15.156:0/3654033296 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459401d070 con 0x7f45a409d860 2023-09-30T22:21:46.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.487+0000 7f459a7fc700 1 -- 172.21.15.156:0/3654033296 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459401e040 con 0x7f45a409d860 2023-09-30T22:21:46.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.487+0000 7f45abb82700 1 -- 172.21.15.156:0/3654033296 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f459400b740 con 0x7f45a409d860 2023-09-30T22:21:46.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.487+0000 7f459a7fc700 1 -- 172.21.15.156:0/3654033296 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4594003d70 con 0x7f45a409d860 2023-09-30T22:21:46.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.487+0000 7f45abb82700 1 -- 172.21.15.156:0/3654033296 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a4122670 con 0x7f45a409d860 2023-09-30T22:21:46.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.488+0000 7f459a7fc700 1 -- 172.21.15.156:0/3654033296 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4594023460 con 0x7f45a409d860 2023-09-30T22:21:46.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.488+0000 7f459a7fc700 1 -- 172.21.15.156:0/3654033296 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4594043170 con 0x7f45a409d860 2023-09-30T22:21:46.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.488+0000 7f45abb82700 1 -- 172.21.15.156:0/3654033296 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a404f2a0 con 0x7f45a409d860 2023-09-30T22:21:46.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.493+0000 7f459a7fc700 1 -- 172.21.15.156:0/3654033296 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f459402b960 con 0x7f45a409d860 2023-09-30T22:21:46.533 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:46.576 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:46.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.661+0000 7ff0b175c700 1 Processor -- start 2023-09-30T22:21:46.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.661+0000 7ff0b175c700 1 -- start start 2023-09-30T22:21:46.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.661+0000 7ff0b175c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff0ac131980 0x7ff0ac131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.661+0000 7ff0b175c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0ac09bc70 0x7ff0ac09c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.661+0000 7ff0b175c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0ac0a1640 con 0x7ff0ac09c5c0 2023-09-30T22:21:46.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.661+0000 7ff0b175c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0ac06eb30 con 0x7ff0ac131980 2023-09-30T22:21:46.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.661+0000 7ff0b175c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac0a22d0 con 0x7ff0ac09bc70 2023-09-30T22:21:46.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.662+0000 7ff0aa7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0ac09bc70 0x7ff0ac09c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.662+0000 7ff0aa7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0ac09bc70 0x7ff0ac09c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45054/0 (socket says 172.21.15.156:45054) 2023-09-30T22:21:46.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.662+0000 7ff0aa7fc700 1 -- 172.21.15.156:0/2122678843 learned_addr learned my addr 172.21.15.156:0/2122678843 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:46.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.662+0000 7ff0aaffd700 1 --2- 172.21.15.156:0/2122678843 >> v2:172.21.15.156:3300/0 conn(0x7ff0ac131980 0x7ff0ac131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.662+0000 7ff0a9ffb700 1 -- 172.21.15.156:0/2122678843 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3454272662 0 0) 0x7ff0ac0a1640 con 0x7ff0ac09c5c0 2023-09-30T22:21:46.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.662+0000 7ff0aa7fc700 1 -- 172.21.15.156:0/2122678843 >> v2:172.21.15.156:3300/0 conn(0x7ff0ac131980 msgr2=0x7ff0ac131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:46.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.662+0000 7ff0aa7fc700 1 --2- 172.21.15.156:0/2122678843 >> v2:172.21.15.156:3300/0 conn(0x7ff0ac131980 0x7ff0ac131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.662+0000 7ff0aa7fc700 1 -- 172.21.15.156:0/2122678843 >> v1:172.21.15.156:6789/0 conn(0x7ff0ac09c5c0 legacy=0x7ff0ac138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.662+0000 7ff0aa7fc700 1 -- 172.21.15.156:0/2122678843 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ac131550 con 0x7ff0ac09bc70 2023-09-30T22:21:46.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.662+0000 7ff0aaffd700 1 --2- 172.21.15.156:0/2122678843 >> v2:172.21.15.156:3300/0 conn(0x7ff0ac131980 0x7ff0ac131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:46.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.662+0000 7ff0aa7fc700 1 --2- 172.21.15.156:0/2122678843 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0ac09bc70 0x7ff0ac09c080 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff0a00098f0 tx=0x7ff0a0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38a6c4eab6f9ea57 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:46.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.662+0000 7ff0a9ffb700 1 -- 172.21.15.156:0/2122678843 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0011830 con 0x7ff0ac09bc70 2023-09-30T22:21:46.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.662+0000 7ff0a9ffb700 1 -- 172.21.15.156:0/2122678843 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a0011990 con 0x7ff0ac09bc70 2023-09-30T22:21:46.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.662+0000 7ff0a9ffb700 1 -- 172.21.15.156:0/2122678843 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0011d20 con 0x7ff0ac09bc70 2023-09-30T22:21:46.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.663+0000 7ff0b175c700 1 -- 172.21.15.156:0/2122678843 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0ac09bc70 msgr2=0x7ff0ac09c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.663+0000 7ff0b175c700 1 --2- 172.21.15.156:0/2122678843 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0ac09bc70 0x7ff0ac09c080 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff0a00098f0 tx=0x7ff0a0009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:46.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.663+0000 7ff0b175c700 1 -- 172.21.15.156:0/2122678843 shutdown_connections 2023-09-30T22:21:46.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.663+0000 7ff0b175c700 1 --2- 172.21.15.156:0/2122678843 >> v2:172.21.15.156:3300/0 conn(0x7ff0ac131980 0x7ff0ac131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.663+0000 7ff0b175c700 1 --2- 172.21.15.156:0/2122678843 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0ac09bc70 0x7ff0ac09c080 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.663+0000 7ff0b175c700 1 -- 172.21.15.156:0/2122678843 >> 172.21.15.156:0/2122678843 conn(0x7ff0ac0a2980 msgr2=0x7ff0ac0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:46.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.663+0000 7ff0b175c700 1 -- 172.21.15.156:0/2122678843 shutdown_connections 2023-09-30T22:21:46.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.663+0000 7ff0b175c700 1 -- 172.21.15.156:0/2122678843 wait complete. 2023-09-30T22:21:46.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.664+0000 7ff0b175c700 1 Processor -- start 2023-09-30T22:21:46.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.664+0000 7ff0b175c700 1 -- start start 2023-09-30T22:21:46.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.665+0000 7ff0b175c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0ac09bc70 0x7ff0ac099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.665+0000 7ff0b175c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0ac09c5c0 0x7ff0ac099fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.665+0000 7ff0b175c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0ac131980 0x7ff0ac09a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.665+0000 7ff0b175c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac11f0b0 con 0x7ff0ac131980 2023-09-30T22:21:46.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.665+0000 7ff0b175c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac11f290 con 0x7ff0ac09bc70 2023-09-30T22:21:46.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.665+0000 7ff0b175c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac11ecf0 con 0x7ff0ac09c5c0 2023-09-30T22:21:46.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.665+0000 7ff0aa7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0ac09c5c0 0x7ff0ac099fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.665+0000 7ff0aa7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0ac09c5c0 0x7ff0ac099fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45064/0 (socket says 172.21.15.156:45064) 2023-09-30T22:21:46.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.665+0000 7ff0aa7fc700 1 -- 172.21.15.156:0/3227927431 learned_addr learned my addr 172.21.15.156:0/3227927431 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:46.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.665+0000 7ff0aaffd700 1 --2- 172.21.15.156:0/3227927431 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0ac09bc70 0x7ff0ac099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.665+0000 7ff0ab7fe700 1 --2- 172.21.15.156:0/3227927431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0ac131980 0x7ff0ac09a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.665+0000 7ff0aa7fc700 1 -- 172.21.15.156:0/3227927431 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0ac09bc70 msgr2=0x7ff0ac099a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.665+0000 7ff0aa7fc700 1 --2- 172.21.15.156:0/3227927431 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0ac09bc70 0x7ff0ac099a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.665+0000 7ff0aa7fc700 1 -- 172.21.15.156:0/3227927431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0ac131980 msgr2=0x7ff0ac09a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.665+0000 7ff0aa7fc700 1 --2- 172.21.15.156:0/3227927431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0ac131980 0x7ff0ac09a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.665+0000 7ff0aa7fc700 1 -- 172.21.15.156:0/3227927431 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09c009430 con 0x7ff0ac09c5c0 2023-09-30T22:21:46.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.665+0000 7ff0ab7fe700 1 --2- 172.21.15.156:0/3227927431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0ac131980 0x7ff0ac09a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:46.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.665+0000 7ff0aa7fc700 1 --2- 172.21.15.156:0/3227927431 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0ac09c5c0 0x7ff0ac099fd0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0a2410 tx=0x7ff0a0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:46.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.665+0000 7ff0937fe700 1 -- 172.21.15.156:0/3227927431 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a00045d0 con 0x7ff0ac09c5c0 2023-09-30T22:21:46.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.666+0000 7ff0937fe700 1 -- 172.21.15.156:0/3227927431 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a00036a0 con 0x7ff0ac09c5c0 2023-09-30T22:21:46.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.666+0000 7ff0b175c700 1 -- 172.21.15.156:0/3227927431 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a0009550 con 0x7ff0ac09c5c0 2023-09-30T22:21:46.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.666+0000 7ff0937fe700 1 -- 172.21.15.156:0/3227927431 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0003a30 con 0x7ff0ac09c5c0 2023-09-30T22:21:46.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.666+0000 7ff0b175c700 1 -- 172.21.15.156:0/3227927431 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0ac0a1c90 con 0x7ff0ac09c5c0 2023-09-30T22:21:46.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.666+0000 7ff0937fe700 1 -- 172.21.15.156:0/3227927431 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff0a0021070 con 0x7ff0ac09c5c0 2023-09-30T22:21:46.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.666+0000 7ff0937fe700 1 -- 172.21.15.156:0/3227927431 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff0a0040bb0 con 0x7ff0ac09c5c0 2023-09-30T22:21:46.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.667+0000 7ff0b175c700 1 -- 172.21.15.156:0/3227927431 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0ac04f2a0 con 0x7ff0ac09c5c0 2023-09-30T22:21:46.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.675+0000 7ff0937fe700 1 -- 172.21.15.156:0/3227927431 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0a0029080 con 0x7ff0ac09c5c0 2023-09-30T22:21:46.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.689+0000 7f45abb82700 1 -- 172.21.15.156:0/3654033296 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f45a406c3b0 con 0x7f45a409d860 2023-09-30T22:21:46.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.690+0000 7f459a7fc700 1 -- 172.21.15.156:0/3654033296 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f459400f3d0 con 0x7f45a409d860 2023-09-30T22:21:46.689 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:46.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.692+0000 7f45abb82700 1 -- 172.21.15.156:0/3654033296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f45a409d860 msgr2=0x7f45a411e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.692+0000 7f45abb82700 1 --2- 172.21.15.156:0/3654033296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f45a409d860 0x7f45a411e400 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f45a409ee50 tx=0x7f4594004750 comp rx=0 tx=0).stop 2023-09-30T22:21:46.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.692+0000 7f45abb82700 1 -- 172.21.15.156:0/3654033296 shutdown_connections 2023-09-30T22:21:46.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.692+0000 7f45abb82700 1 --2- 172.21.15.156:0/3654033296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45a4130ce0 0x7f45a411ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.692+0000 7f45abb82700 1 --2- 172.21.15.156:0/3654033296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f45a409d860 0x7f45a411e400 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.692+0000 7f45abb82700 1 --2- 172.21.15.156:0/3654033296 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f45a409e170 0x7f45a411e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.692+0000 7f45abb82700 1 -- 172.21.15.156:0/3654033296 >> 172.21.15.156:0/3654033296 conn(0x7f45a4099c40 msgr2=0x7f45a40a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:46.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.692+0000 7f45abb82700 1 -- 172.21.15.156:0/3654033296 shutdown_connections 2023-09-30T22:21:46.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.692+0000 7f45abb82700 1 -- 172.21.15.156:0/3654033296 wait complete. 2023-09-30T22:21:46.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:46.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.706+0000 7fa93ae87700 1 Processor -- start 2023-09-30T22:21:46.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.706+0000 7fa93ae87700 1 -- start start 2023-09-30T22:21:46.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.707+0000 7fa93ae87700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa934132100 0x7fa9341367d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.707+0000 7fa93ae87700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa9341314b0 0x7fa934138d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.707+0000 7fa93ae87700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9340a0f20 con 0x7fa934066410 2023-09-30T22:21:46.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.707+0000 7fa93ae87700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9340667e0 con 0x7fa9341314b0 2023-09-30T22:21:46.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.707+0000 7fa93ae87700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9340a23c0 con 0x7fa934132100 2023-09-30T22:21:46.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.707+0000 7fa938c23700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fa934066410 0x7fa9341319f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45178/0 (socket says 172.21.15.156:45178) 2023-09-30T22:21:46.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.707+0000 7fa933fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa934132100 0x7fa9341367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.707+0000 7fa938c23700 1 -- 172.21.15.156:0/2712951746 learned_addr learned my addr 172.21.15.156:0/2712951746 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:46.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.707+0000 7fa939424700 1 --2- 172.21.15.156:0/2712951746 >> v2:172.21.15.156:3300/0 conn(0x7fa9341314b0 0x7fa934138d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.707+0000 7fa9337fe700 1 -- 172.21.15.156:0/2712951746 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1531097944 0 0) 0x7fa9340a0f20 con 0x7fa934066410 2023-09-30T22:21:46.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.708+0000 7fa9337fe700 1 -- 172.21.15.156:0/2712951746 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9240035b0 con 0x7fa934066410 2023-09-30T22:21:46.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.708+0000 7fa933fff700 1 -- 172.21.15.156:0/2712951746 >> v2:172.21.15.156:3300/0 conn(0x7fa9341314b0 msgr2=0x7fa934138d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:46.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.708+0000 7fa933fff700 1 --2- 172.21.15.156:0/2712951746 >> v2:172.21.15.156:3300/0 conn(0x7fa9341314b0 0x7fa934138d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.708+0000 7fa933fff700 1 -- 172.21.15.156:0/2712951746 >> v1:172.21.15.156:6789/0 conn(0x7fa934066410 legacy=0x7fa9341319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.708+0000 7fa933fff700 1 -- 172.21.15.156:0/2712951746 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9340a16e0 con 0x7fa934132100 2023-09-30T22:21:46.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.708+0000 7fa939424700 1 --2- 172.21.15.156:0/2712951746 >> v2:172.21.15.156:3300/0 conn(0x7fa9341314b0 0x7fa934138d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:46.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.708+0000 7fa933fff700 1 --2- 172.21.15.156:0/2712951746 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa934132100 0x7fa9341367d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa920009870 tx=0x7fa920009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ab61ef0aa7c0ac8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:46.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.708+0000 7fa9337fe700 1 -- 172.21.15.156:0/2712951746 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa920004230 con 0x7fa934132100 2023-09-30T22:21:46.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.708+0000 7fa9337fe700 1 -- 172.21.15.156:0/2712951746 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa920004390 con 0x7fa934132100 2023-09-30T22:21:46.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.708+0000 7fa9337fe700 1 -- 172.21.15.156:0/2712951746 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9200036a0 con 0x7fa934132100 2023-09-30T22:21:46.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.708+0000 7fa93ae87700 1 -- 172.21.15.156:0/2712951746 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa934132100 msgr2=0x7fa9341367d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.708+0000 7fa93ae87700 1 --2- 172.21.15.156:0/2712951746 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa934132100 0x7fa9341367d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa920009870 tx=0x7fa920009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:46.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.709+0000 7fa93ae87700 1 -- 172.21.15.156:0/2712951746 shutdown_connections 2023-09-30T22:21:46.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.709+0000 7fa93ae87700 1 --2- 172.21.15.156:0/2712951746 >> v2:172.21.15.156:3300/0 conn(0x7fa9341314b0 0x7fa934138d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.709+0000 7fa93ae87700 1 --2- 172.21.15.156:0/2712951746 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa934132100 0x7fa9341367d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.709+0000 7fa93ae87700 1 -- 172.21.15.156:0/2712951746 >> 172.21.15.156:0/2712951746 conn(0x7fa9340a2980 msgr2=0x7fa9340a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:46.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.709+0000 7fa93ae87700 1 -- 172.21.15.156:0/2712951746 shutdown_connections 2023-09-30T22:21:46.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.709+0000 7fa93ae87700 1 -- 172.21.15.156:0/2712951746 wait complete. 2023-09-30T22:21:46.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.709+0000 7fa93ae87700 1 Processor -- start 2023-09-30T22:21:46.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.709+0000 7fa93ae87700 1 -- start start 2023-09-30T22:21:46.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.710+0000 7fa93ae87700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa934066410 0x7fa934099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.710+0000 7fa93ae87700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9341314b0 0x7fa934099fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.710+0000 7fa93ae87700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa934132100 0x7fa93409a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.710+0000 7fa93ae87700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa934136e20 con 0x7fa9341314b0 2023-09-30T22:21:46.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.710+0000 7fa93ae87700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa93409aef0 con 0x7fa934132100 2023-09-30T22:21:46.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.710+0000 7fa93ae87700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa934137a70 con 0x7fa934066410 2023-09-30T22:21:46.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.710+0000 7fa938c23700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa934066410 0x7fa934099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.710+0000 7fa933fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9341314b0 0x7fa934099fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.710+0000 7fa938c23700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa934066410 0x7fa934099a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45072/0 (socket says 172.21.15.156:45072) 2023-09-30T22:21:46.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.710+0000 7fa933fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9341314b0 0x7fa934099fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33282/0 (socket says 172.21.15.156:33282) 2023-09-30T22:21:46.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.710+0000 7fa938c23700 1 -- 172.21.15.156:0/3344562849 learned_addr learned my addr 172.21.15.156:0/3344562849 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:46.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.710+0000 7fa939424700 1 --2- 172.21.15.156:0/3344562849 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa934132100 0x7fa93409a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.710+0000 7fa933fff700 1 -- 172.21.15.156:0/3344562849 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa934066410 msgr2=0x7fa934099a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.710+0000 7fa933fff700 1 --2- 172.21.15.156:0/3344562849 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa934066410 0x7fa934099a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.710+0000 7fa933fff700 1 -- 172.21.15.156:0/3344562849 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa934132100 msgr2=0x7fa93409a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.710+0000 7fa933fff700 1 --2- 172.21.15.156:0/3344562849 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa934132100 0x7fa93409a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.710+0000 7fa933fff700 1 -- 172.21.15.156:0/3344562849 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92c009a70 con 0x7fa9341314b0 2023-09-30T22:21:46.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.711+0000 7fa933fff700 1 --2- 172.21.15.156:0/3344562849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9341314b0 0x7fa934099fd0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fa920015000 tx=0x7fa920004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:46.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.711+0000 7fa9317fa700 1 -- 172.21.15.156:0/3344562849 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa920003c60 con 0x7fa9341314b0 2023-09-30T22:21:46.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.711+0000 7fa9317fa700 1 -- 172.21.15.156:0/3344562849 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92001e070 con 0x7fa9341314b0 2023-09-30T22:21:46.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.711+0000 7fa93ae87700 1 -- 172.21.15.156:0/3344562849 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9200094a0 con 0x7fa9341314b0 2023-09-30T22:21:46.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.711+0000 7fa9317fa700 1 -- 172.21.15.156:0/3344562849 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa920011630 con 0x7fa9341314b0 2023-09-30T22:21:46.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.711+0000 7fa93ae87700 1 -- 172.21.15.156:0/3344562849 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa93409ca90 con 0x7fa9341314b0 2023-09-30T22:21:46.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.712+0000 7fa9317fa700 1 -- 172.21.15.156:0/3344562849 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa9200117b0 con 0x7fa9341314b0 2023-09-30T22:21:46.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.712+0000 7fa9317fa700 1 -- 172.21.15.156:0/3344562849 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa9200406f0 con 0x7fa9341314b0 2023-09-30T22:21:46.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.712+0000 7fa93ae87700 1 -- 172.21.15.156:0/3344562849 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa93404f2a0 con 0x7fa9341314b0 2023-09-30T22:21:46.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.717+0000 7fa9317fa700 1 -- 172.21.15.156:0/3344562849 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa92002d7d0 con 0x7fa9341314b0 2023-09-30T22:21:46.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.870+0000 7ff0b175c700 1 -- 172.21.15.156:0/3227927431 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff0ac06bce0 con 0x7ff0ac09c5c0 2023-09-30T22:21:46.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.870+0000 7ff0937fe700 1 -- 172.21.15.156:0/3227927431 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff0a0015020 con 0x7ff0ac09c5c0 2023-09-30T22:21:46.870 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:46.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.872+0000 7ff0b175c700 1 -- 172.21.15.156:0/3227927431 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0ac09c5c0 msgr2=0x7ff0ac099fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.872+0000 7ff0b175c700 1 --2- 172.21.15.156:0/3227927431 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0ac09c5c0 0x7ff0ac099fd0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0a2410 tx=0x7ff0a0004750 comp rx=0 tx=0).stop 2023-09-30T22:21:46.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.872+0000 7ff0b175c700 1 -- 172.21.15.156:0/3227927431 shutdown_connections 2023-09-30T22:21:46.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.872+0000 7ff0b175c700 1 --2- 172.21.15.156:0/3227927431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0ac131980 0x7ff0ac09a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.872+0000 7ff0b175c700 1 --2- 172.21.15.156:0/3227927431 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0ac09bc70 0x7ff0ac099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.872+0000 7ff0b175c700 1 --2- 172.21.15.156:0/3227927431 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0ac09c5c0 0x7ff0ac099fd0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.872+0000 7ff0b175c700 1 -- 172.21.15.156:0/3227927431 >> 172.21.15.156:0/3227927431 conn(0x7ff0ac0a2980 msgr2=0x7ff0ac12e630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:46.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.872+0000 7ff0b175c700 1 -- 172.21.15.156:0/3227927431 shutdown_connections 2023-09-30T22:21:46.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.872+0000 7ff0b175c700 1 -- 172.21.15.156:0/3227927431 wait complete. 2023-09-30T22:21:46.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:46.895 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:46.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.908+0000 7fa93ae87700 1 -- 172.21.15.156:0/3344562849 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa934136350 con 0x7fa9341314b0 2023-09-30T22:21:46.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.908+0000 7fa9317fa700 1 -- 172.21.15.156:0/3344562849 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa920010b70 con 0x7fa9341314b0 2023-09-30T22:21:46.908 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:46.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.911+0000 7fa93ae87700 1 -- 172.21.15.156:0/3344562849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9341314b0 msgr2=0x7fa934099fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.911+0000 7fa93ae87700 1 --2- 172.21.15.156:0/3344562849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9341314b0 0x7fa934099fd0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fa920015000 tx=0x7fa920004750 comp rx=0 tx=0).stop 2023-09-30T22:21:46.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.911+0000 7fa93ae87700 1 -- 172.21.15.156:0/3344562849 shutdown_connections 2023-09-30T22:21:46.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.911+0000 7fa93ae87700 1 --2- 172.21.15.156:0/3344562849 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa934132100 0x7fa93409a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.911+0000 7fa93ae87700 1 --2- 172.21.15.156:0/3344562849 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa934066410 0x7fa934099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.911+0000 7fa93ae87700 1 --2- 172.21.15.156:0/3344562849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9341314b0 0x7fa934099fd0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.911+0000 7fa93ae87700 1 -- 172.21.15.156:0/3344562849 >> 172.21.15.156:0/3344562849 conn(0x7fa9340a2980 msgr2=0x7fa934130240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:46.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.911+0000 7fa93ae87700 1 -- 172.21.15.156:0/3344562849 shutdown_connections 2023-09-30T22:21:46.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:46.911+0000 7fa93ae87700 1 -- 172.21.15.156:0/3344562849 wait complete. 2023-09-30T22:21:46.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:47.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.029+0000 7febc390d700 1 Processor -- start 2023-09-30T22:21:47.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.029+0000 7febc390d700 1 -- start start 2023-09-30T22:21:47.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.030+0000 7febc390d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febbc133900 0x7febbc133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.030+0000 7febc390d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7febbc134210 0x7febbc0a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.030+0000 7febc390d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febbc0a0ee0 0x7febbc0a1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.030+0000 7febc390d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febbc09a760 con 0x7febbc134210 2023-09-30T22:21:47.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.030+0000 7febc390d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febbc1336e0 con 0x7febbc133900 2023-09-30T22:21:47.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.030+0000 7febc390d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febbc09a080 con 0x7febbc0a0ee0 2023-09-30T22:21:47.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.030+0000 7febc0ea8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7febbc134210 0x7febbc0a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.030+0000 7febc1eaa700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febbc0a0ee0 0x7febbc0a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.030+0000 7febc16a9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febbc133900 0x7febbc133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.030+0000 7febc0ea8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7febbc134210 0x7febbc0a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33290/0 (socket says 172.21.15.156:33290) 2023-09-30T22:21:47.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.030+0000 7febc0ea8700 1 -- 172.21.15.156:0/4249035603 learned_addr learned my addr 172.21.15.156:0/4249035603 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:47.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.030+0000 7febc1eaa700 1 -- 172.21.15.156:0/4249035603 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febbc133900 msgr2=0x7febbc133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:47.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.030+0000 7febc1eaa700 1 --2- 172.21.15.156:0/4249035603 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febbc133900 0x7febbc133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.030+0000 7febc1eaa700 1 -- 172.21.15.156:0/4249035603 >> v2:172.21.15.156:3300/0 conn(0x7febbc134210 msgr2=0x7febbc0a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:47.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.030+0000 7febc1eaa700 1 --2- 172.21.15.156:0/4249035603 >> v2:172.21.15.156:3300/0 conn(0x7febbc134210 0x7febbc0a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.030+0000 7febc1eaa700 1 -- 172.21.15.156:0/4249035603 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febbc0a23e0 con 0x7febbc0a0ee0 2023-09-30T22:21:47.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.030+0000 7febc16a9700 1 --2- 172.21.15.156:0/4249035603 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febbc133900 0x7febbc133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:47.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.030+0000 7febc1eaa700 1 --2- 172.21.15.156:0/4249035603 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febbc0a0ee0 0x7febbc0a1360 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7febb4009d90 tx=0x7febb400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=513cc1d612c1e3c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:47.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.030+0000 7febb3fff700 1 -- 172.21.15.156:0/4249035603 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb400e070 con 0x7febbc0a0ee0 2023-09-30T22:21:47.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.031+0000 7febb3fff700 1 -- 172.21.15.156:0/4249035603 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb400bb20 con 0x7febbc0a0ee0 2023-09-30T22:21:47.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.031+0000 7febb3fff700 1 -- 172.21.15.156:0/4249035603 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb4012430 con 0x7febbc0a0ee0 2023-09-30T22:21:47.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.031+0000 7febc390d700 1 -- 172.21.15.156:0/4249035603 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febbc0a0ee0 msgr2=0x7febbc0a1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.031+0000 7febc390d700 1 --2- 172.21.15.156:0/4249035603 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febbc0a0ee0 0x7febbc0a1360 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7febb4009d90 tx=0x7febb400b330 comp rx=0 tx=0).stop 2023-09-30T22:21:47.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.031+0000 7febc390d700 1 -- 172.21.15.156:0/4249035603 shutdown_connections 2023-09-30T22:21:47.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.031+0000 7febc390d700 1 --2- 172.21.15.156:0/4249035603 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febbc0a0ee0 0x7febbc0a1360 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.031+0000 7febc390d700 1 --2- 172.21.15.156:0/4249035603 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febbc133900 0x7febbc133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.031+0000 7febc390d700 1 --2- 172.21.15.156:0/4249035603 >> v2:172.21.15.156:3300/0 conn(0x7febbc134210 0x7febbc0a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.031+0000 7febc390d700 1 -- 172.21.15.156:0/4249035603 >> 172.21.15.156:0/4249035603 conn(0x7febbc0a2980 msgr2=0x7febbc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:47.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.031+0000 7febc390d700 1 -- 172.21.15.156:0/4249035603 shutdown_connections 2023-09-30T22:21:47.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.031+0000 7febc390d700 1 -- 172.21.15.156:0/4249035603 wait complete. 2023-09-30T22:21:47.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.032+0000 7febc390d700 1 Processor -- start 2023-09-30T22:21:47.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.032+0000 7febc390d700 1 -- start start 2023-09-30T22:21:47.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.032+0000 7febc390d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febbc0a0ee0 0x7febbc11d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.032+0000 7febc390d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febbc133900 0x7febbc11dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.032+0000 7febc390d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febbc134210 0x7febbc11e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.032+0000 7febc390d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febbc120980 con 0x7febbc133900 2023-09-30T22:21:47.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.032+0000 7febc390d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febbc09a2c0 con 0x7febbc134210 2023-09-30T22:21:47.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.032+0000 7febc390d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febbc0a3050 con 0x7febbc0a0ee0 2023-09-30T22:21:47.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.033+0000 7febc16a9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febbc0a0ee0 0x7febbc11d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.033+0000 7febc1eaa700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febbc134210 0x7febbc11e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.033+0000 7febc16a9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febbc0a0ee0 0x7febbc11d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45098/0 (socket says 172.21.15.156:45098) 2023-09-30T22:21:47.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.033+0000 7febc1eaa700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febbc134210 0x7febbc11e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53334/0 (socket says 172.21.15.156:53334) 2023-09-30T22:21:47.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.033+0000 7febc16a9700 1 -- 172.21.15.156:0/1146208747 learned_addr learned my addr 172.21.15.156:0/1146208747 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:47.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.033+0000 7febc0ea8700 1 --2- 172.21.15.156:0/1146208747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febbc133900 0x7febbc11dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.033+0000 7febc16a9700 1 -- 172.21.15.156:0/1146208747 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febbc134210 msgr2=0x7febbc11e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.033+0000 7febc16a9700 1 --2- 172.21.15.156:0/1146208747 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febbc134210 0x7febbc11e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.033+0000 7febc16a9700 1 -- 172.21.15.156:0/1146208747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febbc133900 msgr2=0x7febbc11dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.033+0000 7febc16a9700 1 --2- 172.21.15.156:0/1146208747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febbc133900 0x7febbc11dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.033+0000 7febc16a9700 1 -- 172.21.15.156:0/1146208747 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac009430 con 0x7febbc0a0ee0 2023-09-30T22:21:47.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.033+0000 7febc1eaa700 1 --2- 172.21.15.156:0/1146208747 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febbc134210 0x7febbc11e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:47.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.033+0000 7febc0ea8700 1 --2- 172.21.15.156:0/1146208747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febbc133900 0x7febbc11dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:47.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.033+0000 7febc16a9700 1 --2- 172.21.15.156:0/1146208747 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febbc0a0ee0 0x7febbc11d6d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7febac00ebe0 tx=0x7febac00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:47.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.033+0000 7febb1ffb700 1 -- 172.21.15.156:0/1146208747 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac005a20 con 0x7febbc0a0ee0 2023-09-30T22:21:47.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.033+0000 7febb1ffb700 1 -- 172.21.15.156:0/1146208747 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febac005b80 con 0x7febbc0a0ee0 2023-09-30T22:21:47.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.033+0000 7febc390d700 1 -- 172.21.15.156:0/1146208747 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb4009a70 con 0x7febbc0a0ee0 2023-09-30T22:21:47.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.033+0000 7febb1ffb700 1 -- 172.21.15.156:0/1146208747 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac00c850 con 0x7febbc0a0ee0 2023-09-30T22:21:47.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.033+0000 7febc390d700 1 -- 172.21.15.156:0/1146208747 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febbc120530 con 0x7febbc0a0ee0 2023-09-30T22:21:47.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.034+0000 7febb1ffb700 1 -- 172.21.15.156:0/1146208747 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7febac00c9b0 con 0x7febbc0a0ee0 2023-09-30T22:21:47.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.034+0000 7febb1ffb700 1 -- 172.21.15.156:0/1146208747 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7febac03f950 con 0x7febbc0a0ee0 2023-09-30T22:21:47.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.034+0000 7febc390d700 1 -- 172.21.15.156:0/1146208747 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febbc11a590 con 0x7febbc0a0ee0 2023-09-30T22:21:47.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.039+0000 7febb1ffb700 1 -- 172.21.15.156:0/1146208747 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7febac020080 con 0x7febbc0a0ee0 2023-09-30T22:21:47.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.222+0000 7febc390d700 1 -- 172.21.15.156:0/1146208747 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7febbc120d90 con 0x7febbc0a0ee0 2023-09-30T22:21:47.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.222+0000 7febb1ffb700 1 -- 172.21.15.156:0/1146208747 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7febac022300 con 0x7febbc0a0ee0 2023-09-30T22:21:47.222 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:47.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.224+0000 7febc390d700 1 -- 172.21.15.156:0/1146208747 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febbc0a0ee0 msgr2=0x7febbc11d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.224+0000 7febc390d700 1 --2- 172.21.15.156:0/1146208747 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febbc0a0ee0 0x7febbc11d6d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7febac00ebe0 tx=0x7febac00eef0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.224+0000 7febc390d700 1 -- 172.21.15.156:0/1146208747 shutdown_connections 2023-09-30T22:21:47.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.224+0000 7febc390d700 1 --2- 172.21.15.156:0/1146208747 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febbc134210 0x7febbc11e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.224+0000 7febc390d700 1 --2- 172.21.15.156:0/1146208747 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febbc0a0ee0 0x7febbc11d6d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.224+0000 7febc390d700 1 --2- 172.21.15.156:0/1146208747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febbc133900 0x7febbc11dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.224+0000 7febc390d700 1 -- 172.21.15.156:0/1146208747 >> 172.21.15.156:0/1146208747 conn(0x7febbc0a2980 msgr2=0x7febbc1baf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:47.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.224+0000 7febc390d700 1 -- 172.21.15.156:0/1146208747 shutdown_connections 2023-09-30T22:21:47.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.224+0000 7febc390d700 1 -- 172.21.15.156:0/1146208747 wait complete. 2023-09-30T22:21:47.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:47.706 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:47.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.833+0000 7ff96208a700 1 Processor -- start 2023-09-30T22:21:47.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.833+0000 7ff96208a700 1 -- start start 2023-09-30T22:21:47.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.833+0000 7ff96208a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff95c0a0a30 0x7ff95c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.833+0000 7ff96208a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff95c0a1340 0x7ff95c12ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.833+0000 7ff96208a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff95c1304a0 0x7ff95c1308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.833+0000 7ff96208a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff95c130e30 con 0x7ff95c0a0a30 2023-09-30T22:21:47.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.833+0000 7ff96208a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c0a1e70 con 0x7ff95c1304a0 2023-09-30T22:21:47.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.833+0000 7ff96208a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c09a720 con 0x7ff95c0a1340 2023-09-30T22:21:47.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.833+0000 7ff95affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff95c0a1340 0x7ff95c12ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.833+0000 7ff95bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff95c1304a0 0x7ff95c1308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.834+0000 7ff95b7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff95c0a0a30 0x7ff95c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.834+0000 7ff95bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff95c1304a0 0x7ff95c1308f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53340/0 (socket says 172.21.15.156:53340) 2023-09-30T22:21:47.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.834+0000 7ff95affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff95c0a1340 0x7ff95c12ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45106/0 (socket says 172.21.15.156:45106) 2023-09-30T22:21:47.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.834+0000 7ff95bfff700 1 -- 172.21.15.156:0/3714107496 learned_addr learned my addr 172.21.15.156:0/3714107496 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:47.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.834+0000 7ff95bfff700 1 -- 172.21.15.156:0/3714107496 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff95c0a1340 msgr2=0x7ff95c12ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:47.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.834+0000 7ff95bfff700 1 --2- 172.21.15.156:0/3714107496 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff95c0a1340 0x7ff95c12ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.834+0000 7ff95bfff700 1 -- 172.21.15.156:0/3714107496 >> v2:172.21.15.156:3300/0 conn(0x7ff95c0a0a30 msgr2=0x7ff95c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:47.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.834+0000 7ff95bfff700 1 --2- 172.21.15.156:0/3714107496 >> v2:172.21.15.156:3300/0 conn(0x7ff95c0a0a30 0x7ff95c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.834+0000 7ff95bfff700 1 -- 172.21.15.156:0/3714107496 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95c09b300 con 0x7ff95c1304a0 2023-09-30T22:21:47.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.834+0000 7ff95affd700 1 --2- 172.21.15.156:0/3714107496 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff95c0a1340 0x7ff95c12ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:47.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.834+0000 7ff95b7fe700 1 --2- 172.21.15.156:0/3714107496 >> v2:172.21.15.156:3300/0 conn(0x7ff95c0a0a30 0x7ff95c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:47.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.834+0000 7ff95bfff700 1 --2- 172.21.15.156:0/3714107496 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff95c1304a0 0x7ff95c1308f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff954009e80 tx=0x7ff95400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec031373cbdb7e1c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:47.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.834+0000 7ff95a7fc700 1 -- 172.21.15.156:0/3714107496 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95400e070 con 0x7ff95c1304a0 2023-09-30T22:21:47.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.834+0000 7ff95a7fc700 1 -- 172.21.15.156:0/3714107496 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95400b8d0 con 0x7ff95c1304a0 2023-09-30T22:21:47.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.834+0000 7ff95a7fc700 1 -- 172.21.15.156:0/3714107496 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95400bc80 con 0x7ff95c1304a0 2023-09-30T22:21:47.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.835+0000 7ff96208a700 1 -- 172.21.15.156:0/3714107496 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff95c1304a0 msgr2=0x7ff95c1308f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.835+0000 7ff96208a700 1 --2- 172.21.15.156:0/3714107496 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff95c1304a0 0x7ff95c1308f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff954009e80 tx=0x7ff95400b330 comp rx=0 tx=0).stop 2023-09-30T22:21:47.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.835+0000 7ff96208a700 1 -- 172.21.15.156:0/3714107496 shutdown_connections 2023-09-30T22:21:47.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.835+0000 7ff96208a700 1 --2- 172.21.15.156:0/3714107496 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff95c1304a0 0x7ff95c1308f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.835+0000 7ff96208a700 1 --2- 172.21.15.156:0/3714107496 >> v2:172.21.15.156:3300/0 conn(0x7ff95c0a0a30 0x7ff95c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.835+0000 7ff96208a700 1 --2- 172.21.15.156:0/3714107496 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff95c0a1340 0x7ff95c12ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.835+0000 7ff96208a700 1 -- 172.21.15.156:0/3714107496 >> 172.21.15.156:0/3714107496 conn(0x7ff95c0a2980 msgr2=0x7ff95c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:47.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.835+0000 7ff96208a700 1 -- 172.21.15.156:0/3714107496 shutdown_connections 2023-09-30T22:21:47.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.835+0000 7ff96208a700 1 -- 172.21.15.156:0/3714107496 wait complete. 2023-09-30T22:21:47.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.836+0000 7ff96208a700 1 Processor -- start 2023-09-30T22:21:47.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.836+0000 7ff96208a700 1 -- start start 2023-09-30T22:21:47.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.836+0000 7ff96208a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff95c0a0a30 0x7ff95c1c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.836+0000 7ff96208a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff95c0a1340 0x7ff95c1c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.836+0000 7ff96208a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff95c1304a0 0x7ff95c1c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.836+0000 7ff96208a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c136bf0 con 0x7ff95c0a0a30 2023-09-30T22:21:47.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.836+0000 7ff96208a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c134ee0 con 0x7ff95c0a1340 2023-09-30T22:21:47.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.836+0000 7ff96208a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c136df0 con 0x7ff95c1304a0 2023-09-30T22:21:47.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.836+0000 7ff95b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff95c0a0a30 0x7ff95c1c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.836+0000 7ff95affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff95c0a1340 0x7ff95c1c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.836+0000 7ff95b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff95c0a0a30 0x7ff95c1c61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33312/0 (socket says 172.21.15.156:33312) 2023-09-30T22:21:47.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.836+0000 7ff95b7fe700 1 -- 172.21.15.156:0/342838885 learned_addr learned my addr 172.21.15.156:0/342838885 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:47.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.836+0000 7ff95bfff700 1 --2- 172.21.15.156:0/342838885 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff95c1304a0 0x7ff95c1c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.837+0000 7ff95affd700 1 -- 172.21.15.156:0/342838885 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff95c1304a0 msgr2=0x7ff95c1c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.837+0000 7ff95affd700 1 --2- 172.21.15.156:0/342838885 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff95c1304a0 0x7ff95c1c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.837+0000 7ff95affd700 1 -- 172.21.15.156:0/342838885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff95c0a0a30 msgr2=0x7ff95c1c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.837+0000 7ff95affd700 1 --2- 172.21.15.156:0/342838885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff95c0a0a30 0x7ff95c1c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.837+0000 7ff95affd700 1 -- 172.21.15.156:0/342838885 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c009430 con 0x7ff95c0a1340 2023-09-30T22:21:47.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.837+0000 7ff95b7fe700 1 --2- 172.21.15.156:0/342838885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff95c0a0a30 0x7ff95c1c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:47.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.837+0000 7ff95affd700 1 --2- 172.21.15.156:0/342838885 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff95c0a1340 0x7ff95c1c6710 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff950012dc0 tx=0x7ff95000c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:47.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.837+0000 7ff943fff700 1 -- 172.21.15.156:0/342838885 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95000cda0 con 0x7ff95c0a1340 2023-09-30T22:21:47.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.837+0000 7ff943fff700 1 -- 172.21.15.156:0/342838885 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95001a430 con 0x7ff95c0a1340 2023-09-30T22:21:47.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.837+0000 7ff96208a700 1 -- 172.21.15.156:0/342838885 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9500094a0 con 0x7ff95c0a1340 2023-09-30T22:21:47.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.837+0000 7ff943fff700 1 -- 172.21.15.156:0/342838885 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95001a7e0 con 0x7ff95c0a1340 2023-09-30T22:21:47.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.837+0000 7ff96208a700 1 -- 172.21.15.156:0/342838885 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff954009b30 con 0x7ff95c0a1340 2023-09-30T22:21:47.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.838+0000 7ff943fff700 1 -- 172.21.15.156:0/342838885 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff95001a940 con 0x7ff95c0a1340 2023-09-30T22:21:47.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.838+0000 7ff943fff700 1 -- 172.21.15.156:0/342838885 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff950043560 con 0x7ff95c0a1340 2023-09-30T22:21:47.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.838+0000 7ff96208a700 1 -- 172.21.15.156:0/342838885 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff95c071c40 con 0x7ff95c0a1340 2023-09-30T22:21:47.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:47.843+0000 7ff943fff700 1 -- 172.21.15.156:0/342838885 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff95001f080 con 0x7ff95c0a1340 2023-09-30T22:21:47.885 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:47.924 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:48.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.018+0000 7f6740085700 1 Processor -- start 2023-09-30T22:21:48.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.019+0000 7f6740085700 1 -- start start 2023-09-30T22:21:48.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.019+0000 7f6740085700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f67380a0a70 0x7f67380a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:48.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.019+0000 7f6740085700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67380a1380 0x7f6738133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:48.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.019+0000 7f6740085700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f673809dc00 con 0x7f6738133f50 2023-09-30T22:21:48.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.019+0000 7f6740085700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f673809ea60 con 0x7f67380a0a70 2023-09-30T22:21:48.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.019+0000 7f6740085700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f673809dec0 con 0x7f67380a1380 2023-09-30T22:21:48.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.019+0000 7f673de21700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f67380a0a70 0x7f67380a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:48.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.019+0000 7f673d620700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67380a1380 0x7f6738133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:48.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.019+0000 7f673d620700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67380a1380 0x7f6738133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45124/0 (socket says 172.21.15.156:45124) 2023-09-30T22:21:48.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.019+0000 7f673e622700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6738133f50 0x7f673813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45192/0 (socket says 172.21.15.156:45192) 2023-09-30T22:21:48.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.019+0000 7f673de21700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f67380a0a70 0x7f67380a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33328/0 (socket says 172.21.15.156:33328) 2023-09-30T22:21:48.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.019+0000 7f673d620700 1 -- 172.21.15.156:0/2984773909 learned_addr learned my addr 172.21.15.156:0/2984773909 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:48.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.020+0000 7f673de21700 1 -- 172.21.15.156:0/2984773909 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67380a1380 msgr2=0x7f6738133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:48.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.020+0000 7f673de21700 1 --2- 172.21.15.156:0/2984773909 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67380a1380 0x7f6738133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.020+0000 7f673de21700 1 -- 172.21.15.156:0/2984773909 >> v1:172.21.15.156:6789/0 conn(0x7f6738133f50 legacy=0x7f673813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:48.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.020+0000 7f673de21700 1 -- 172.21.15.156:0/2984773909 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f673809e6a0 con 0x7f67380a0a70 2023-09-30T22:21:48.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.020+0000 7f673d620700 1 --2- 172.21.15.156:0/2984773909 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67380a1380 0x7f6738133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:48.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.020+0000 7f673de21700 1 --2- 172.21.15.156:0/2984773909 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67380a0a70 0x7f67380a0e40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f6734009840 tx=0x7f6734009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe32af5f6a7b610 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:48.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.020+0000 7f673ce1f700 1 -- 172.21.15.156:0/2984773909 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6734011830 con 0x7f67380a0a70 2023-09-30T22:21:48.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.020+0000 7f673ce1f700 1 -- 172.21.15.156:0/2984773909 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6734011990 con 0x7f67380a0a70 2023-09-30T22:21:48.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.020+0000 7f673ce1f700 1 -- 172.21.15.156:0/2984773909 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6734011d20 con 0x7f67380a0a70 2023-09-30T22:21:48.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.021+0000 7f6740085700 1 -- 172.21.15.156:0/2984773909 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67380a0a70 msgr2=0x7f67380a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:48.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.021+0000 7f6740085700 1 --2- 172.21.15.156:0/2984773909 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67380a0a70 0x7f67380a0e40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f6734009840 tx=0x7f6734009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:48.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.021+0000 7f6740085700 1 -- 172.21.15.156:0/2984773909 shutdown_connections 2023-09-30T22:21:48.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.021+0000 7f6740085700 1 --2- 172.21.15.156:0/2984773909 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67380a0a70 0x7f67380a0e40 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.021+0000 7f6740085700 1 --2- 172.21.15.156:0/2984773909 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67380a1380 0x7f6738133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.021+0000 7f6740085700 1 -- 172.21.15.156:0/2984773909 >> 172.21.15.156:0/2984773909 conn(0x7f67380a6610 msgr2=0x7f67380a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:48.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.021+0000 7f6740085700 1 -- 172.21.15.156:0/2984773909 shutdown_connections 2023-09-30T22:21:48.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.021+0000 7f6740085700 1 -- 172.21.15.156:0/2984773909 wait complete. 2023-09-30T22:21:48.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.022+0000 7f6740085700 1 Processor -- start 2023-09-30T22:21:48.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.022+0000 7f6740085700 1 -- start start 2023-09-30T22:21:48.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.023+0000 7f6740085700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67380a0a70 0x7f673811e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:48.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.023+0000 7f6740085700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67380a1380 0x7f673811ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:48.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.023+0000 7f6740085700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6738133f50 0x7f673811f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:48.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.023+0000 7f6740085700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6738133790 con 0x7f6738133f50 2023-09-30T22:21:48.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.023+0000 7f6740085700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6738122320 con 0x7f67380a1380 2023-09-30T22:21:48.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.023+0000 7f6740085700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67381339d0 con 0x7f67380a0a70 2023-09-30T22:21:48.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.023+0000 7f673de21700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67380a0a70 0x7f673811e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:48.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.023+0000 7f673d620700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67380a1380 0x7f673811ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:48.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.023+0000 7f673de21700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67380a0a70 0x7f673811e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45128/0 (socket says 172.21.15.156:45128) 2023-09-30T22:21:48.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.023+0000 7f673de21700 1 -- 172.21.15.156:0/1407980166 learned_addr learned my addr 172.21.15.156:0/1407980166 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:48.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.023+0000 7f673e622700 1 --2- 172.21.15.156:0/1407980166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6738133f50 0x7f673811f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:48.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.023+0000 7f673de21700 1 -- 172.21.15.156:0/1407980166 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67380a1380 msgr2=0x7f673811ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:48.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.023+0000 7f673de21700 1 --2- 172.21.15.156:0/1407980166 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67380a1380 0x7f673811ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.023+0000 7f673de21700 1 -- 172.21.15.156:0/1407980166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6738133f50 msgr2=0x7f673811f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:48.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.023+0000 7f673de21700 1 --2- 172.21.15.156:0/1407980166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6738133f50 0x7f673811f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.023+0000 7f673de21700 1 -- 172.21.15.156:0/1407980166 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6728009550 con 0x7f67380a0a70 2023-09-30T22:21:48.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.024+0000 7f673de21700 1 --2- 172.21.15.156:0/1407980166 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67380a0a70 0x7f673811e840 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6734009fd0 tx=0x7f6734004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:48.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.024+0000 7f672e7fc700 1 -- 172.21.15.156:0/1407980166 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67340036a0 con 0x7f67380a0a70 2023-09-30T22:21:48.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.024+0000 7f672e7fc700 1 -- 172.21.15.156:0/1407980166 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673401f070 con 0x7f67380a0a70 2023-09-30T22:21:48.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.024+0000 7f6740085700 1 -- 172.21.15.156:0/1407980166 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67340094a0 con 0x7f67380a0a70 2023-09-30T22:21:48.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.024+0000 7f672e7fc700 1 -- 172.21.15.156:0/1407980166 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6734003a60 con 0x7f67380a0a70 2023-09-30T22:21:48.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.024+0000 7f6740085700 1 -- 172.21.15.156:0/1407980166 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6738120c00 con 0x7f67380a0a70 2023-09-30T22:21:48.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.024+0000 7f672e7fc700 1 -- 172.21.15.156:0/1407980166 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6734003bc0 con 0x7f67380a0a70 2023-09-30T22:21:48.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.025+0000 7f672e7fc700 1 -- 172.21.15.156:0/1407980166 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6734021070 con 0x7f67380a0a70 2023-09-30T22:21:48.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.025+0000 7f6740085700 1 -- 172.21.15.156:0/1407980166 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f673804f2a0 con 0x7f67380a0a70 2023-09-30T22:21:48.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.030+0000 7f672e7fc700 1 -- 172.21.15.156:0/1407980166 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6734015020 con 0x7f67380a0a70 2023-09-30T22:21:48.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.036+0000 7ff96208a700 1 -- 172.21.15.156:0/342838885 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff95c04f2a0 con 0x7ff95c0a1340 2023-09-30T22:21:48.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.037+0000 7ff943fff700 1 -- 172.21.15.156:0/342838885 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff950021b00 con 0x7ff95c0a1340 2023-09-30T22:21:48.036 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:48.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.039+0000 7ff96208a700 1 -- 172.21.15.156:0/342838885 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff95c0a1340 msgr2=0x7ff95c1c6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:48.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.039+0000 7ff96208a700 1 --2- 172.21.15.156:0/342838885 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff95c0a1340 0x7ff95c1c6710 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff950012dc0 tx=0x7ff95000c430 comp rx=0 tx=0).stop 2023-09-30T22:21:48.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.039+0000 7ff96208a700 1 -- 172.21.15.156:0/342838885 shutdown_connections 2023-09-30T22:21:48.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.039+0000 7ff96208a700 1 --2- 172.21.15.156:0/342838885 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff95c1304a0 0x7ff95c1c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.039+0000 7ff96208a700 1 --2- 172.21.15.156:0/342838885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff95c0a0a30 0x7ff95c1c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.039+0000 7ff96208a700 1 --2- 172.21.15.156:0/342838885 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff95c0a1340 0x7ff95c1c6710 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.039+0000 7ff96208a700 1 -- 172.21.15.156:0/342838885 >> 172.21.15.156:0/342838885 conn(0x7ff95c0a2980 msgr2=0x7ff95c06df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:48.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.039+0000 7ff96208a700 1 -- 172.21.15.156:0/342838885 shutdown_connections 2023-09-30T22:21:48.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.039+0000 7ff96208a700 1 -- 172.21.15.156:0/342838885 wait complete. 2023-09-30T22:21:48.051 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:48.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.077+0000 7f167ca2a700 1 Processor -- start 2023-09-30T22:21:48.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.077+0000 7f167ca2a700 1 -- start start 2023-09-30T22:21:48.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.078+0000 7f167ca2a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1678133ad0 0x7f1678133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:48.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.078+0000 7f167ca2a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16781300a0 0x7f16781304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:48.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.078+0000 7f167ca2a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f16781309f0 0x7f167813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:48.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.078+0000 7f167ca2a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f167806b2d0 con 0x7f16781309f0 2023-09-30T22:21:48.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.078+0000 7f167ca2a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1678133610 con 0x7f1678133ad0 2023-09-30T22:21:48.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.078+0000 7f167ca2a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f167809a500 con 0x7f16781300a0 2023-09-30T22:21:48.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.078+0000 7f1675d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16781300a0 0x7f16781304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:48.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.078+0000 7f167659c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1678133ad0 0x7f1678133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:48.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.078+0000 7f1676d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f16781309f0 0x7f167813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:48.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.078+0000 7f167659c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1678133ad0 0x7f1678133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53374/0 (socket says 172.21.15.156:53374) 2023-09-30T22:21:48.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.078+0000 7f1676d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f16781309f0 0x7f167813a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33354/0 (socket says 172.21.15.156:33354) 2023-09-30T22:21:48.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.078+0000 7f1675d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16781300a0 0x7f16781304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45132/0 (socket says 172.21.15.156:45132) 2023-09-30T22:21:48.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.078+0000 7f167659c700 1 -- 172.21.15.156:0/2398044834 learned_addr learned my addr 172.21.15.156:0/2398044834 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:48.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.078+0000 7f1676d9d700 1 -- 172.21.15.156:0/2398044834 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16781300a0 msgr2=0x7f16781304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:48.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.078+0000 7f1676d9d700 1 --2- 172.21.15.156:0/2398044834 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16781300a0 0x7f16781304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.078+0000 7f1676d9d700 1 -- 172.21.15.156:0/2398044834 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1678133ad0 msgr2=0x7f1678133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:48.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.078+0000 7f1676d9d700 1 --2- 172.21.15.156:0/2398044834 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1678133ad0 0x7f1678133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.078+0000 7f1676d9d700 1 -- 172.21.15.156:0/2398044834 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16781338b0 con 0x7f16781309f0 2023-09-30T22:21:48.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.078+0000 7f167659c700 1 --2- 172.21.15.156:0/2398044834 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1678133ad0 0x7f1678133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:48.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.078+0000 7f1675d9b700 1 --2- 172.21.15.156:0/2398044834 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16781300a0 0x7f16781304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:48.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.078+0000 7f1676d9d700 1 --2- 172.21.15.156:0/2398044834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f16781309f0 0x7f167813a980 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f1670009d90 tx=0x7f167000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76cdc1e9a1b64c1a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:48.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.078+0000 7f167559a700 1 -- 172.21.15.156:0/2398044834 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167000e070 con 0x7f16781309f0 2023-09-30T22:21:48.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.078+0000 7f167559a700 1 -- 172.21.15.156:0/2398044834 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167000bb20 con 0x7f16781309f0 2023-09-30T22:21:48.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.078+0000 7f167559a700 1 -- 172.21.15.156:0/2398044834 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1670012430 con 0x7f16781309f0 2023-09-30T22:21:48.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.079+0000 7f167ca2a700 1 -- 172.21.15.156:0/2398044834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f16781309f0 msgr2=0x7f167813a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:48.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.079+0000 7f167ca2a700 1 --2- 172.21.15.156:0/2398044834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f16781309f0 0x7f167813a980 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f1670009d90 tx=0x7f167000b330 comp rx=0 tx=0).stop 2023-09-30T22:21:48.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.079+0000 7f167ca2a700 1 -- 172.21.15.156:0/2398044834 shutdown_connections 2023-09-30T22:21:48.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.079+0000 7f167ca2a700 1 --2- 172.21.15.156:0/2398044834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f16781309f0 0x7f167813a980 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.079+0000 7f167ca2a700 1 --2- 172.21.15.156:0/2398044834 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1678133ad0 0x7f1678133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.079+0000 7f167ca2a700 1 --2- 172.21.15.156:0/2398044834 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16781300a0 0x7f16781304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.079+0000 7f167ca2a700 1 -- 172.21.15.156:0/2398044834 >> 172.21.15.156:0/2398044834 conn(0x7f1678099c40 msgr2=0x7f16780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:48.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.079+0000 7f167ca2a700 1 -- 172.21.15.156:0/2398044834 shutdown_connections 2023-09-30T22:21:48.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.079+0000 7f167ca2a700 1 -- 172.21.15.156:0/2398044834 wait complete. 2023-09-30T22:21:48.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.080+0000 7f167ca2a700 1 Processor -- start 2023-09-30T22:21:48.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.080+0000 7f167ca2a700 1 -- start start 2023-09-30T22:21:48.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.081+0000 7f167ca2a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16781300a0 0x7f167811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:48.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.081+0000 7f167ca2a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16781309f0 0x7f167811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:48.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.081+0000 7f167ca2a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1678133ad0 0x7f167811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:48.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.081+0000 7f167ca2a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167812dd00 con 0x7f1678133ad0 2023-09-30T22:21:48.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.081+0000 7f167ca2a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1678120dd0 con 0x7f16781309f0 2023-09-30T22:21:48.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.081+0000 7f167ca2a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1678072540 con 0x7f16781300a0 2023-09-30T22:21:48.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.081+0000 7f1675d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16781309f0 0x7f167811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:48.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.081+0000 7f167659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16781300a0 0x7f167811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:48.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.081+0000 7f1675d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16781309f0 0x7f167811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53390/0 (socket says 172.21.15.156:53390) 2023-09-30T22:21:48.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.081+0000 7f1675d9b700 1 -- 172.21.15.156:0/4078228300 learned_addr learned my addr 172.21.15.156:0/4078228300 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:48.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.081+0000 7f1676d9d700 1 --2- 172.21.15.156:0/4078228300 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1678133ad0 0x7f167811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:48.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.081+0000 7f167659c700 1 -- 172.21.15.156:0/4078228300 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16781309f0 msgr2=0x7f167811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:48.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.081+0000 7f167659c700 1 --2- 172.21.15.156:0/4078228300 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16781309f0 0x7f167811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.081+0000 7f167659c700 1 -- 172.21.15.156:0/4078228300 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1678133ad0 msgr2=0x7f167811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:48.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.081+0000 7f167659c700 1 --2- 172.21.15.156:0/4078228300 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1678133ad0 0x7f167811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.081+0000 7f167659c700 1 -- 172.21.15.156:0/4078228300 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166c0094a0 con 0x7f16781300a0 2023-09-30T22:21:48.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.081+0000 7f1675d9b700 1 --2- 172.21.15.156:0/4078228300 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16781309f0 0x7f167811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:48.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.081+0000 7f167659c700 1 --2- 172.21.15.156:0/4078228300 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16781300a0 0x7f167811da40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f166800e9d0 tx=0x7f166800ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:48.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.081+0000 7f1666ffd700 1 -- 172.21.15.156:0/4078228300 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166800ee70 con 0x7f16781300a0 2023-09-30T22:21:48.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.081+0000 7f1666ffd700 1 -- 172.21.15.156:0/4078228300 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1668004030 con 0x7f16781300a0 2023-09-30T22:21:48.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.081+0000 7f167ca2a700 1 -- 172.21.15.156:0/4078228300 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1668009550 con 0x7f16781300a0 2023-09-30T22:21:48.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.081+0000 7f1666ffd700 1 -- 172.21.15.156:0/4078228300 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16680043c0 con 0x7f16781300a0 2023-09-30T22:21:48.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.082+0000 7f167ca2a700 1 -- 172.21.15.156:0/4078228300 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1670009a70 con 0x7f16781300a0 2023-09-30T22:21:48.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.082+0000 7f1666ffd700 1 -- 172.21.15.156:0/4078228300 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f166800c850 con 0x7f16781300a0 2023-09-30T22:21:48.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.082+0000 7f167ca2a700 1 -- 172.21.15.156:0/4078228300 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f167804f2a0 con 0x7f16781300a0 2023-09-30T22:21:48.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.082+0000 7f1666ffd700 1 -- 172.21.15.156:0/4078228300 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f166803f4f0 con 0x7f16781300a0 2023-09-30T22:21:48.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.087+0000 7f1666ffd700 1 -- 172.21.15.156:0/4078228300 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1668019d60 con 0x7f16781300a0 2023-09-30T22:21:48.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.234+0000 7f6740085700 1 -- 172.21.15.156:0/1407980166 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6738072980 con 0x7f67380a0a70 2023-09-30T22:21:48.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.235+0000 7f672e7fc700 1 -- 172.21.15.156:0/1407980166 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f673401a430 con 0x7f67380a0a70 2023-09-30T22:21:48.234 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:48.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.236+0000 7f6740085700 1 -- 172.21.15.156:0/1407980166 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67380a0a70 msgr2=0x7f673811e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:48.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.236+0000 7f6740085700 1 --2- 172.21.15.156:0/1407980166 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67380a0a70 0x7f673811e840 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6734009fd0 tx=0x7f6734004750 comp rx=0 tx=0).stop 2023-09-30T22:21:48.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.236+0000 7f6740085700 1 -- 172.21.15.156:0/1407980166 shutdown_connections 2023-09-30T22:21:48.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.236+0000 7f6740085700 1 --2- 172.21.15.156:0/1407980166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6738133f50 0x7f673811f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.236+0000 7f6740085700 1 --2- 172.21.15.156:0/1407980166 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67380a0a70 0x7f673811e840 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.236+0000 7f6740085700 1 --2- 172.21.15.156:0/1407980166 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67380a1380 0x7f673811ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.237+0000 7f6740085700 1 -- 172.21.15.156:0/1407980166 >> 172.21.15.156:0/1407980166 conn(0x7f67380a6610 msgr2=0x7f67380a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:48.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.237+0000 7f6740085700 1 -- 172.21.15.156:0/1407980166 shutdown_connections 2023-09-30T22:21:48.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.237+0000 7f6740085700 1 -- 172.21.15.156:0/1407980166 wait complete. 2023-09-30T22:21:48.237 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:48.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:48.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.277+0000 7f167ca2a700 1 -- 172.21.15.156:0/4078228300 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f167812d460 con 0x7f16781300a0 2023-09-30T22:21:48.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.278+0000 7f1666ffd700 1 -- 172.21.15.156:0/4078228300 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1668019300 con 0x7f16781300a0 2023-09-30T22:21:48.277 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:48.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.280+0000 7f167ca2a700 1 -- 172.21.15.156:0/4078228300 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16781300a0 msgr2=0x7f167811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:48.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.280+0000 7f167ca2a700 1 --2- 172.21.15.156:0/4078228300 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16781300a0 0x7f167811da40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f166800e9d0 tx=0x7f166800ece0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.280+0000 7f167ca2a700 1 -- 172.21.15.156:0/4078228300 shutdown_connections 2023-09-30T22:21:48.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.280+0000 7f167ca2a700 1 --2- 172.21.15.156:0/4078228300 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1678133ad0 0x7f167811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.280+0000 7f167ca2a700 1 --2- 172.21.15.156:0/4078228300 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16781300a0 0x7f167811da40 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.280+0000 7f167ca2a700 1 --2- 172.21.15.156:0/4078228300 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16781309f0 0x7f167811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.280+0000 7f167ca2a700 1 -- 172.21.15.156:0/4078228300 >> 172.21.15.156:0/4078228300 conn(0x7f1678099c40 msgr2=0x7f1678132c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:48.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.280+0000 7f167ca2a700 1 -- 172.21.15.156:0/4078228300 shutdown_connections 2023-09-30T22:21:48.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.280+0000 7f167ca2a700 1 -- 172.21.15.156:0/4078228300 wait complete. 2023-09-30T22:21:48.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:48.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.362+0000 7f90aec82700 1 Processor -- start 2023-09-30T22:21:48.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.362+0000 7f90aec82700 1 -- start start 2023-09-30T22:21:48.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.363+0000 7f90aec82700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90a8133ad0 0x7f90a8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:48.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.363+0000 7f90aec82700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f90a81300a0 0x7f90a81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:48.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.363+0000 7f90aec82700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a806b2d0 con 0x7f90a81309f0 2023-09-30T22:21:48.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.363+0000 7f90aec82700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8133610 con 0x7f90a8133ad0 2023-09-30T22:21:48.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.363+0000 7f90aec82700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90a809a500 con 0x7f90a81300a0 2023-09-30T22:21:48.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.363+0000 7f90a7fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f90a81300a0 0x7f90a81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:48.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.363+0000 7f90aca1e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90a8133ad0 0x7f90a8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:48.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.363+0000 7f90ad21f700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f90a81309f0 0x7f90a813a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45202/0 (socket says 172.21.15.156:45202) 2023-09-30T22:21:48.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.363+0000 7f90ad21f700 1 -- 172.21.15.156:0/674472177 learned_addr learned my addr 172.21.15.156:0/674472177 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:48.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.363+0000 7f90a7fff700 1 --2- 172.21.15.156:0/674472177 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f90a81300a0 0x7f90a81304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45152/0 (socket says 172.21.15.156:45152) 2023-09-30T22:21:48.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.363+0000 7f90a77fe700 1 -- 172.21.15.156:0/674472177 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 266618106 0 0) 0x7f90a806b2d0 con 0x7f90a81309f0 2023-09-30T22:21:48.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.363+0000 7f90a77fe700 1 -- 172.21.15.156:0/674472177 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90980035b0 con 0x7f90a81309f0 2023-09-30T22:21:48.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.363+0000 7f90aca1e700 1 -- 172.21.15.156:0/674472177 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f90a81300a0 msgr2=0x7f90a81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:48.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.363+0000 7f90aca1e700 1 --2- 172.21.15.156:0/674472177 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f90a81300a0 0x7f90a81304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.363+0000 7f90aca1e700 1 -- 172.21.15.156:0/674472177 >> v1:172.21.15.156:6789/0 conn(0x7f90a81309f0 legacy=0x7f90a813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:48.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.363+0000 7f90aca1e700 1 -- 172.21.15.156:0/674472177 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a81338b0 con 0x7f90a8133ad0 2023-09-30T22:21:48.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.363+0000 7f90a7fff700 1 --2- 172.21.15.156:0/674472177 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f90a81300a0 0x7f90a81304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:48.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.364+0000 7f90aca1e700 1 --2- 172.21.15.156:0/674472177 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90a8133ad0 0x7f90a8133ea0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f909c009870 tx=0x7f909c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98753c850fddf55f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:48.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.364+0000 7f90a77fe700 1 -- 172.21.15.156:0/674472177 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c011830 con 0x7f90a8133ad0 2023-09-30T22:21:48.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.364+0000 7f90a77fe700 1 -- 172.21.15.156:0/674472177 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909c011990 con 0x7f90a8133ad0 2023-09-30T22:21:48.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.364+0000 7f90a77fe700 1 -- 172.21.15.156:0/674472177 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c011d20 con 0x7f90a8133ad0 2023-09-30T22:21:48.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.364+0000 7f90aec82700 1 -- 172.21.15.156:0/674472177 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90a8133ad0 msgr2=0x7f90a8133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:48.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.364+0000 7f90aec82700 1 --2- 172.21.15.156:0/674472177 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90a8133ad0 0x7f90a8133ea0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f909c009870 tx=0x7f909c009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:48.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.364+0000 7f90aec82700 1 -- 172.21.15.156:0/674472177 shutdown_connections 2023-09-30T22:21:48.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.364+0000 7f90aec82700 1 --2- 172.21.15.156:0/674472177 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90a8133ad0 0x7f90a8133ea0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.364+0000 7f90aec82700 1 --2- 172.21.15.156:0/674472177 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f90a81300a0 0x7f90a81304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.364+0000 7f90aec82700 1 -- 172.21.15.156:0/674472177 >> 172.21.15.156:0/674472177 conn(0x7f90a8099c40 msgr2=0x7f90a80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:48.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.364+0000 7f90aec82700 1 -- 172.21.15.156:0/674472177 shutdown_connections 2023-09-30T22:21:48.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.364+0000 7f90aec82700 1 -- 172.21.15.156:0/674472177 wait complete. 2023-09-30T22:21:48.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.365+0000 7f90aec82700 1 Processor -- start 2023-09-30T22:21:48.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.365+0000 7f90aec82700 1 -- start start 2023-09-30T22:21:48.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.366+0000 7f90aec82700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f90a81300a0 0x7f90a8071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:48.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.366+0000 7f90aec82700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90a81309f0 0x7f90a8071840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:48.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.366+0000 7f90aec82700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90a8133ad0 0x7f90a8071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:48.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.366+0000 7f90aec82700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a811fd20 con 0x7f90a81309f0 2023-09-30T22:21:48.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.366+0000 7f90aec82700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a811f980 con 0x7f90a8133ad0 2023-09-30T22:21:48.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.366+0000 7f90aec82700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90a811ee10 con 0x7f90a81300a0 2023-09-30T22:21:48.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.366+0000 7f90aca1e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f90a81300a0 0x7f90a8071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:48.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.366+0000 7f90a7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90a81309f0 0x7f90a8071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:48.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.366+0000 7f90a7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90a81309f0 0x7f90a8071840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33368/0 (socket says 172.21.15.156:33368) 2023-09-30T22:21:48.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.366+0000 7f90aca1e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f90a81300a0 0x7f90a8071300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45162/0 (socket says 172.21.15.156:45162) 2023-09-30T22:21:48.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.366+0000 7f90a7fff700 1 -- 172.21.15.156:0/220030834 learned_addr learned my addr 172.21.15.156:0/220030834 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:48.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.366+0000 7f90ad21f700 1 --2- 172.21.15.156:0/220030834 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90a8133ad0 0x7f90a8071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:48.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.366+0000 7f90a7fff700 1 -- 172.21.15.156:0/220030834 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f90a81300a0 msgr2=0x7f90a8071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:48.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.366+0000 7f90a7fff700 1 --2- 172.21.15.156:0/220030834 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f90a81300a0 0x7f90a8071300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.366+0000 7f90a7fff700 1 -- 172.21.15.156:0/220030834 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90a8133ad0 msgr2=0x7f90a8071d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:48.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.366+0000 7f90a7fff700 1 --2- 172.21.15.156:0/220030834 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90a8133ad0 0x7f90a8071d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.366+0000 7f90a7fff700 1 -- 172.21.15.156:0/220030834 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90940094a0 con 0x7f90a81309f0 2023-09-30T22:21:48.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.366+0000 7f90aca1e700 1 --2- 172.21.15.156:0/220030834 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f90a81300a0 0x7f90a8071300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:48.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.366+0000 7f90a7fff700 1 --2- 172.21.15.156:0/220030834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90a81309f0 0x7f90a8071840 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f909400ebb0 tx=0x7f909400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:48.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.366+0000 7f90a57fa700 1 -- 172.21.15.156:0/220030834 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909400c850 con 0x7f90a81309f0 2023-09-30T22:21:48.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.366+0000 7f90a57fa700 1 -- 172.21.15.156:0/220030834 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909400c9b0 con 0x7f90a81309f0 2023-09-30T22:21:48.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.366+0000 7f90aec82700 1 -- 172.21.15.156:0/220030834 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f909c0094a0 con 0x7f90a81309f0 2023-09-30T22:21:48.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.366+0000 7f90a57fa700 1 -- 172.21.15.156:0/220030834 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909400cd40 con 0x7f90a81309f0 2023-09-30T22:21:48.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.367+0000 7f90aec82700 1 -- 172.21.15.156:0/220030834 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a811e0b0 con 0x7f90a81309f0 2023-09-30T22:21:48.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.367+0000 7f90a57fa700 1 -- 172.21.15.156:0/220030834 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9094013470 con 0x7f90a81309f0 2023-09-30T22:21:48.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.367+0000 7f90a57fa700 1 -- 172.21.15.156:0/220030834 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f909403f730 con 0x7f90a81309f0 2023-09-30T22:21:48.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.368+0000 7f90aec82700 1 -- 172.21.15.156:0/220030834 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a804f2a0 con 0x7f90a81309f0 2023-09-30T22:21:48.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.372+0000 7f90a57fa700 1 -- 172.21.15.156:0/220030834 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f90940232f0 con 0x7f90a81309f0 2023-09-30T22:21:48.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.555+0000 7f90aec82700 1 -- 172.21.15.156:0/220030834 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f90a806c3b0 con 0x7f90a81309f0 2023-09-30T22:21:48.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.555+0000 7f90a57fa700 1 -- 172.21.15.156:0/220030834 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9094017020 con 0x7f90a81309f0 2023-09-30T22:21:48.555 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:48.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.557+0000 7f90aec82700 1 -- 172.21.15.156:0/220030834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90a81309f0 msgr2=0x7f90a8071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:48.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.557+0000 7f90aec82700 1 --2- 172.21.15.156:0/220030834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90a81309f0 0x7f90a8071840 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f909400ebb0 tx=0x7f909400eec0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.558+0000 7f90aec82700 1 -- 172.21.15.156:0/220030834 shutdown_connections 2023-09-30T22:21:48.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.558+0000 7f90aec82700 1 --2- 172.21.15.156:0/220030834 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90a8133ad0 0x7f90a8071d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.558+0000 7f90aec82700 1 --2- 172.21.15.156:0/220030834 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f90a81300a0 0x7f90a8071300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.558+0000 7f90aec82700 1 --2- 172.21.15.156:0/220030834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90a81309f0 0x7f90a8071840 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.558+0000 7f90aec82700 1 -- 172.21.15.156:0/220030834 >> 172.21.15.156:0/220030834 conn(0x7f90a8099c40 msgr2=0x7f90a812e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:48.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.558+0000 7f90aec82700 1 -- 172.21.15.156:0/220030834 shutdown_connections 2023-09-30T22:21:48.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:48.558+0000 7f90aec82700 1 -- 172.21.15.156:0/220030834 wait complete. 2023-09-30T22:21:48.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:49.052 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:49.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.176+0000 7f75304a8700 1 Processor -- start 2023-09-30T22:21:49.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.176+0000 7f75304a8700 1 -- start start 2023-09-30T22:21:49.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.177+0000 7f75304a8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7528131980 0x7f7528131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.177+0000 7f75304a8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f752809bc70 0x7f752809c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.177+0000 7f75304a8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f752809c5c0 0x7f7528138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.177+0000 7f75304a8700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752806eb30 con 0x7f7528131980 2023-09-30T22:21:49.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.177+0000 7f75304a8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75280a1640 con 0x7f752809c5c0 2023-09-30T22:21:49.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.177+0000 7f75304a8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75280a22d0 con 0x7f752809bc70 2023-09-30T22:21:49.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.177+0000 7f752e244700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7528131980 0x7f7528131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.177+0000 7f752da43700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f752809bc70 0x7f752809c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.177+0000 7f752e244700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7528131980 0x7f7528131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33370/0 (socket says 172.21.15.156:33370) 2023-09-30T22:21:49.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.177+0000 7f752e244700 1 -- 172.21.15.156:0/2276689974 learned_addr learned my addr 172.21.15.156:0/2276689974 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:49.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.177+0000 7f752ea45700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f752809c5c0 0x7f7528138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.177+0000 7f752da43700 1 -- 172.21.15.156:0/2276689974 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f752809c5c0 msgr2=0x7f7528138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:49.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.177+0000 7f752da43700 1 --2- 172.21.15.156:0/2276689974 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f752809c5c0 0x7f7528138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.177+0000 7f752da43700 1 -- 172.21.15.156:0/2276689974 >> v2:172.21.15.156:3300/0 conn(0x7f7528131980 msgr2=0x7f7528131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:49.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.177+0000 7f752da43700 1 --2- 172.21.15.156:0/2276689974 >> v2:172.21.15.156:3300/0 conn(0x7f7528131980 0x7f7528131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.177+0000 7f752da43700 1 -- 172.21.15.156:0/2276689974 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7528131550 con 0x7f752809bc70 2023-09-30T22:21:49.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.177+0000 7f752ea45700 1 --2- 172.21.15.156:0/2276689974 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f752809c5c0 0x7f7528138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:49.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.177+0000 7f752e244700 1 --2- 172.21.15.156:0/2276689974 >> v2:172.21.15.156:3300/0 conn(0x7f7528131980 0x7f7528131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:49.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.178+0000 7f752da43700 1 --2- 172.21.15.156:0/2276689974 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f752809bc70 0x7f752809c080 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7524009870 tx=0x7f7524009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff853d258ad1f739 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:49.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.178+0000 7f752d242700 1 -- 172.21.15.156:0/2276689974 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524011830 con 0x7f752809bc70 2023-09-30T22:21:49.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.178+0000 7f752d242700 1 -- 172.21.15.156:0/2276689974 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7524011990 con 0x7f752809bc70 2023-09-30T22:21:49.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.178+0000 7f752d242700 1 -- 172.21.15.156:0/2276689974 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524011d20 con 0x7f752809bc70 2023-09-30T22:21:49.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.178+0000 7f75304a8700 1 -- 172.21.15.156:0/2276689974 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f752809bc70 msgr2=0x7f752809c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.178+0000 7f75304a8700 1 --2- 172.21.15.156:0/2276689974 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f752809bc70 0x7f752809c080 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7524009870 tx=0x7f7524009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:49.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.178+0000 7f75304a8700 1 -- 172.21.15.156:0/2276689974 shutdown_connections 2023-09-30T22:21:49.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.178+0000 7f75304a8700 1 --2- 172.21.15.156:0/2276689974 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f752809c5c0 0x7f7528138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.178+0000 7f75304a8700 1 --2- 172.21.15.156:0/2276689974 >> v2:172.21.15.156:3300/0 conn(0x7f7528131980 0x7f7528131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.178+0000 7f75304a8700 1 --2- 172.21.15.156:0/2276689974 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f752809bc70 0x7f752809c080 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.178+0000 7f75304a8700 1 -- 172.21.15.156:0/2276689974 >> 172.21.15.156:0/2276689974 conn(0x7f75280a2980 msgr2=0x7f75280a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:49.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.178+0000 7f75304a8700 1 -- 172.21.15.156:0/2276689974 shutdown_connections 2023-09-30T22:21:49.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.178+0000 7f75304a8700 1 -- 172.21.15.156:0/2276689974 wait complete. 2023-09-30T22:21:49.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.179+0000 7f75304a8700 1 Processor -- start 2023-09-30T22:21:49.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.179+0000 7f75304a8700 1 -- start start 2023-09-30T22:21:49.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.180+0000 7f75304a8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f752809bc70 0x7f752811da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.180+0000 7f75304a8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f752809c5c0 0x7f752811df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.180+0000 7f75304a8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7528131980 0x7f752811e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.180+0000 7f75304a8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75281204f0 con 0x7f7528131980 2023-09-30T22:21:49.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.180+0000 7f75304a8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7528121220 con 0x7f752809c5c0 2023-09-30T22:21:49.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.180+0000 7f75304a8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f752812edb0 con 0x7f752809bc70 2023-09-30T22:21:49.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.180+0000 7f752e244700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f752809bc70 0x7f752811da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.180+0000 7f752da43700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f752809c5c0 0x7f752811df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.180+0000 7f752e244700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f752809bc70 0x7f752811da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45184/0 (socket says 172.21.15.156:45184) 2023-09-30T22:21:49.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.180+0000 7f752da43700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f752809c5c0 0x7f752811df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53424/0 (socket says 172.21.15.156:53424) 2023-09-30T22:21:49.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.180+0000 7f752e244700 1 -- 172.21.15.156:0/1640671736 learned_addr learned my addr 172.21.15.156:0/1640671736 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:49.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.180+0000 7f752ea45700 1 --2- 172.21.15.156:0/1640671736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7528131980 0x7f752811e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.180+0000 7f752ea45700 1 -- 172.21.15.156:0/1640671736 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f752809bc70 msgr2=0x7f752811da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.180+0000 7f752ea45700 1 --2- 172.21.15.156:0/1640671736 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f752809bc70 0x7f752811da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.180+0000 7f752ea45700 1 -- 172.21.15.156:0/1640671736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f752809c5c0 msgr2=0x7f752811df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.180+0000 7f752ea45700 1 --2- 172.21.15.156:0/1640671736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f752809c5c0 0x7f752811df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.180+0000 7f752ea45700 1 -- 172.21.15.156:0/1640671736 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7520009a70 con 0x7f7528131980 2023-09-30T22:21:49.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.180+0000 7f752da43700 1 --2- 172.21.15.156:0/1640671736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f752809c5c0 0x7f752811df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:49.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.180+0000 7f752e244700 1 --2- 172.21.15.156:0/1640671736 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f752809bc70 0x7f752811da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:49.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.180+0000 7f752ea45700 1 --2- 172.21.15.156:0/1640671736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7528131980 0x7f752811e4a0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f752000eea0 tx=0x7f752000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:49.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.181+0000 7f751effd700 1 -- 172.21.15.156:0/1640671736 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520010040 con 0x7f7528131980 2023-09-30T22:21:49.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.181+0000 7f751effd700 1 -- 172.21.15.156:0/1640671736 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752000bca0 con 0x7f7528131980 2023-09-30T22:21:49.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.181+0000 7f75304a8700 1 -- 172.21.15.156:0/1640671736 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7518009500 con 0x7f7528131980 2023-09-30T22:21:49.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.181+0000 7f751effd700 1 -- 172.21.15.156:0/1640671736 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520014640 con 0x7f7528131980 2023-09-30T22:21:49.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.181+0000 7f75304a8700 1 -- 172.21.15.156:0/1640671736 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75240094a0 con 0x7f7528131980 2023-09-30T22:21:49.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.181+0000 7f751effd700 1 -- 172.21.15.156:0/1640671736 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f75200147a0 con 0x7f7528131980 2023-09-30T22:21:49.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.181+0000 7f751effd700 1 -- 172.21.15.156:0/1640671736 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f752003fe50 con 0x7f7528131980 2023-09-30T22:21:49.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.182+0000 7f75304a8700 1 -- 172.21.15.156:0/1640671736 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752804f2a0 con 0x7f7528131980 2023-09-30T22:21:49.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.186+0000 7f751effd700 1 -- 172.21.15.156:0/1640671736 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7520018070 con 0x7f7528131980 2023-09-30T22:21:49.250 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:49.293 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:49.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.379+0000 7f75304a8700 1 -- 172.21.15.156:0/1640671736 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7528120840 con 0x7f7528131980 2023-09-30T22:21:49.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.379+0000 7f751effd700 1 -- 172.21.15.156:0/1640671736 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7520018020 con 0x7f7528131980 2023-09-30T22:21:49.380 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:49.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.381+0000 7f75304a8700 1 -- 172.21.15.156:0/1640671736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7528131980 msgr2=0x7f752811e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.381+0000 7f75304a8700 1 --2- 172.21.15.156:0/1640671736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7528131980 0x7f752811e4a0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f752000eea0 tx=0x7f752000b390 comp rx=0 tx=0).stop 2023-09-30T22:21:49.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.381+0000 7f75304a8700 1 -- 172.21.15.156:0/1640671736 shutdown_connections 2023-09-30T22:21:49.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.381+0000 7f75304a8700 1 --2- 172.21.15.156:0/1640671736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7528131980 0x7f752811e4a0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.381+0000 7f75304a8700 1 --2- 172.21.15.156:0/1640671736 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f752809bc70 0x7f752811da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.381+0000 7f75304a8700 1 --2- 172.21.15.156:0/1640671736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f752809c5c0 0x7f752811df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.381+0000 7f75304a8700 1 -- 172.21.15.156:0/1640671736 >> 172.21.15.156:0/1640671736 conn(0x7f75280a2980 msgr2=0x7f752806ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:49.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.381+0000 7f75304a8700 1 -- 172.21.15.156:0/1640671736 shutdown_connections 2023-09-30T22:21:49.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.381+0000 7f75304a8700 1 -- 172.21.15.156:0/1640671736 wait complete. 2023-09-30T22:21:49.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.385+0000 7f52b4ecf700 1 Processor -- start 2023-09-30T22:21:49.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.385+0000 7f52b4ecf700 1 -- start start 2023-09-30T22:21:49.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.386+0000 7f52b4ecf700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f52b009f350 0x7f52b0138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.386+0000 7f52b4ecf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52b01393a0 0x7f52b013b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.386+0000 7f52b4ecf700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52b009fa00 con 0x7f52b009e870 2023-09-30T22:21:49.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.386+0000 7f52b4ecf700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52b00a0370 con 0x7f52b009f350 2023-09-30T22:21:49.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.386+0000 7f52b4ecf700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b006bec0 con 0x7f52b01393a0 2023-09-30T22:21:49.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.386+0000 7f52add9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f52b009f350 0x7f52b0138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.386+0000 7f52ae59c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f52b009e870 0x7f52b009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45216/0 (socket says 172.21.15.156:45216) 2023-09-30T22:21:49.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.386+0000 7f52ae59c700 1 -- 172.21.15.156:0/1159429182 learned_addr learned my addr 172.21.15.156:0/1159429182 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:49.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.386+0000 7f52aed9d700 1 --2- 172.21.15.156:0/1159429182 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52b01393a0 0x7f52b013b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.386+0000 7f52ad59a700 1 -- 172.21.15.156:0/1159429182 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260519365 0 0) 0x7f52b009fa00 con 0x7f52b009e870 2023-09-30T22:21:49.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.386+0000 7f52ad59a700 1 -- 172.21.15.156:0/1159429182 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52980035b0 con 0x7f52b009e870 2023-09-30T22:21:49.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.386+0000 7f52aed9d700 1 -- 172.21.15.156:0/1159429182 >> v2:172.21.15.156:3300/0 conn(0x7f52b009f350 msgr2=0x7f52b0138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:49.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.386+0000 7f52aed9d700 1 --2- 172.21.15.156:0/1159429182 >> v2:172.21.15.156:3300/0 conn(0x7f52b009f350 0x7f52b0138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.386+0000 7f52aed9d700 1 -- 172.21.15.156:0/1159429182 >> v1:172.21.15.156:6789/0 conn(0x7f52b009e870 legacy=0x7f52b009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.386+0000 7f52aed9d700 1 -- 172.21.15.156:0/1159429182 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b009ada0 con 0x7f52b01393a0 2023-09-30T22:21:49.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.386+0000 7f52add9b700 1 --2- 172.21.15.156:0/1159429182 >> v2:172.21.15.156:3300/0 conn(0x7f52b009f350 0x7f52b0138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:49.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.387+0000 7f52aed9d700 1 --2- 172.21.15.156:0/1159429182 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52b01393a0 0x7f52b013b780 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f52a8009d90 tx=0x7f52a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3427aa5f5fdbec3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:49.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.387+0000 7f52ad59a700 1 -- 172.21.15.156:0/1159429182 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a800e070 con 0x7f52b01393a0 2023-09-30T22:21:49.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.387+0000 7f52ad59a700 1 -- 172.21.15.156:0/1159429182 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a800bb20 con 0x7f52b01393a0 2023-09-30T22:21:49.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.387+0000 7f52ad59a700 1 -- 172.21.15.156:0/1159429182 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a8012430 con 0x7f52b01393a0 2023-09-30T22:21:49.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.387+0000 7f52b4ecf700 1 -- 172.21.15.156:0/1159429182 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52b01393a0 msgr2=0x7f52b013b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.387+0000 7f52b4ecf700 1 --2- 172.21.15.156:0/1159429182 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52b01393a0 0x7f52b013b780 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f52a8009d90 tx=0x7f52a800b330 comp rx=0 tx=0).stop 2023-09-30T22:21:49.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.388+0000 7f52b4ecf700 1 -- 172.21.15.156:0/1159429182 shutdown_connections 2023-09-30T22:21:49.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.388+0000 7f52b4ecf700 1 --2- 172.21.15.156:0/1159429182 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52b01393a0 0x7f52b013b780 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.388+0000 7f52b4ecf700 1 --2- 172.21.15.156:0/1159429182 >> v2:172.21.15.156:3300/0 conn(0x7f52b009f350 0x7f52b0138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.388+0000 7f52b4ecf700 1 -- 172.21.15.156:0/1159429182 >> 172.21.15.156:0/1159429182 conn(0x7f52b00a4430 msgr2=0x7f52b00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:49.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.388+0000 7f52b4ecf700 1 -- 172.21.15.156:0/1159429182 shutdown_connections 2023-09-30T22:21:49.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.388+0000 7f52b4ecf700 1 -- 172.21.15.156:0/1159429182 wait complete. 2023-09-30T22:21:49.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.389+0000 7f52b4ecf700 1 Processor -- start 2023-09-30T22:21:49.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.389+0000 7f52b4ecf700 1 -- start start 2023-09-30T22:21:49.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.389+0000 7f52b4ecf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f52b009e870 0x7f52b0121830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.389+0000 7f52b4ecf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52b009f350 0x7f52b0121d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.389+0000 7f52b4ecf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52b01393a0 0x7f52b01222b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.389+0000 7f52b4ecf700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b0124e90 con 0x7f52b01393a0 2023-09-30T22:21:49.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.389+0000 7f52b4ecf700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b006fb60 con 0x7f52b009f350 2023-09-30T22:21:49.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.389+0000 7f52b4ecf700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52b006cfa0 con 0x7f52b009e870 2023-09-30T22:21:49.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.390+0000 7f52add9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52b009f350 0x7f52b0121d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.390+0000 7f52add9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52b009f350 0x7f52b0121d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53448/0 (socket says 172.21.15.156:53448) 2023-09-30T22:21:49.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.390+0000 7f52ae59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f52b009e870 0x7f52b0121830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.390+0000 7f52add9b700 1 -- 172.21.15.156:0/4169379839 learned_addr learned my addr 172.21.15.156:0/4169379839 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:49.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.390+0000 7f52aed9d700 1 --2- 172.21.15.156:0/4169379839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52b01393a0 0x7f52b01222b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.390+0000 7f52add9b700 1 -- 172.21.15.156:0/4169379839 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f52b009e870 msgr2=0x7f52b0121830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.390+0000 7f52add9b700 1 --2- 172.21.15.156:0/4169379839 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f52b009e870 0x7f52b0121830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.390+0000 7f52add9b700 1 -- 172.21.15.156:0/4169379839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52b01393a0 msgr2=0x7f52b01222b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.390+0000 7f52add9b700 1 --2- 172.21.15.156:0/4169379839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52b01393a0 0x7f52b01222b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.390+0000 7f52add9b700 1 -- 172.21.15.156:0/4169379839 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a40094a0 con 0x7f52b009f350 2023-09-30T22:21:49.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.390+0000 7f52ae59c700 1 --2- 172.21.15.156:0/4169379839 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f52b009e870 0x7f52b0121830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:49.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.390+0000 7f52aed9d700 1 --2- 172.21.15.156:0/4169379839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52b01393a0 0x7f52b01222b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:49.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.390+0000 7f52add9b700 1 --2- 172.21.15.156:0/4169379839 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52b009f350 0x7f52b0121d70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f52a400ebe0 tx=0x7f52a400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:49.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.390+0000 7f529effd700 1 -- 172.21.15.156:0/4169379839 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a400c850 con 0x7f52b009f350 2023-09-30T22:21:49.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.390+0000 7f529effd700 1 -- 172.21.15.156:0/4169379839 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a400c9b0 con 0x7f52b009f350 2023-09-30T22:21:49.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.390+0000 7f52b4ecf700 1 -- 172.21.15.156:0/4169379839 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a8009a70 con 0x7f52b009f350 2023-09-30T22:21:49.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.390+0000 7f529effd700 1 -- 172.21.15.156:0/4169379839 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a400cd40 con 0x7f52b009f350 2023-09-30T22:21:49.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.390+0000 7f52b4ecf700 1 -- 172.21.15.156:0/4169379839 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b0125070 con 0x7f52b009f350 2023-09-30T22:21:49.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.391+0000 7f529effd700 1 -- 172.21.15.156:0/4169379839 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f52a4013470 con 0x7f52b009f350 2023-09-30T22:21:49.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.391+0000 7f529effd700 1 -- 172.21.15.156:0/4169379839 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f52a403fb90 con 0x7f52b009f350 2023-09-30T22:21:49.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.392+0000 7f52b4ecf700 1 -- 172.21.15.156:0/4169379839 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b0124cc0 con 0x7f52b009f350 2023-09-30T22:21:49.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:49.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.396+0000 7f529effd700 1 -- 172.21.15.156:0/4169379839 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f52a4013720 con 0x7f52b009f350 2023-09-30T22:21:49.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.429+0000 7f74acefa700 1 Processor -- start 2023-09-30T22:21:49.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.429+0000 7f74acefa700 1 -- start start 2023-09-30T22:21:49.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.430+0000 7f74acefa700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f74a80a0a70 0x7f74a80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.430+0000 7f74acefa700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f74a8134120 0x7f74a813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.430+0000 7f74acefa700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a809dc00 con 0x7f74a80a1380 2023-09-30T22:21:49.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.430+0000 7f74acefa700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a809ea60 con 0x7f74a8134120 2023-09-30T22:21:49.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.430+0000 7f74acefa700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a809dec0 con 0x7f74a80a0a70 2023-09-30T22:21:49.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.430+0000 7f74a659c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f74a80a0a70 0x7f74a80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.430+0000 7f74a6d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f74a8134120 0x7f74a813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.430+0000 7f74a5d9b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f74a80a1380 0x7f74a8133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45226/0 (socket says 172.21.15.156:45226) 2023-09-30T22:21:49.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.430+0000 7f74a659c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f74a80a0a70 0x7f74a80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53452/0 (socket says 172.21.15.156:53452) 2023-09-30T22:21:49.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.430+0000 7f74a5d9b700 1 -- 172.21.15.156:0/1632597496 learned_addr learned my addr 172.21.15.156:0/1632597496 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:49.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.430+0000 7f74a6d9d700 1 -- 172.21.15.156:0/1632597496 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f74a80a0a70 msgr2=0x7f74a80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:49.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.430+0000 7f74a6d9d700 1 --2- 172.21.15.156:0/1632597496 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f74a80a0a70 0x7f74a80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.431+0000 7f74a6d9d700 1 -- 172.21.15.156:0/1632597496 >> v1:172.21.15.156:6789/0 conn(0x7f74a80a1380 legacy=0x7f74a8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.431+0000 7f74a6d9d700 1 -- 172.21.15.156:0/1632597496 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a809e6a0 con 0x7f74a8134120 2023-09-30T22:21:49.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.431+0000 7f74a659c700 1 --2- 172.21.15.156:0/1632597496 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f74a80a0a70 0x7f74a80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:49.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.431+0000 7f74a559a700 1 -- 172.21.15.156:0/1632597496 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 460804328 0 0) 0x7f74a809dc00 con 0x7f74a80a1380 2023-09-30T22:21:49.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.431+0000 7f74a6d9d700 1 --2- 172.21.15.156:0/1632597496 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74a8134120 0x7f74a813bce0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f74a0009d90 tx=0x7f74a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b11cd0e8f250c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:49.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.431+0000 7f74a559a700 1 -- 172.21.15.156:0/1632597496 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a000e070 con 0x7f74a8134120 2023-09-30T22:21:49.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.431+0000 7f74a559a700 1 -- 172.21.15.156:0/1632597496 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a000bb20 con 0x7f74a8134120 2023-09-30T22:21:49.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.431+0000 7f74a559a700 1 -- 172.21.15.156:0/1632597496 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a0012430 con 0x7f74a8134120 2023-09-30T22:21:49.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.432+0000 7f74acefa700 1 -- 172.21.15.156:0/1632597496 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74a8134120 msgr2=0x7f74a813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.432+0000 7f74acefa700 1 --2- 172.21.15.156:0/1632597496 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74a8134120 0x7f74a813bce0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f74a0009d90 tx=0x7f74a000b330 comp rx=0 tx=0).stop 2023-09-30T22:21:49.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.432+0000 7f74acefa700 1 -- 172.21.15.156:0/1632597496 shutdown_connections 2023-09-30T22:21:49.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.432+0000 7f74acefa700 1 --2- 172.21.15.156:0/1632597496 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74a8134120 0x7f74a813bce0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.432+0000 7f74acefa700 1 --2- 172.21.15.156:0/1632597496 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f74a80a0a70 0x7f74a80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.432+0000 7f74acefa700 1 -- 172.21.15.156:0/1632597496 >> 172.21.15.156:0/1632597496 conn(0x7f74a80a6610 msgr2=0x7f74a80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:49.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.432+0000 7f74acefa700 1 -- 172.21.15.156:0/1632597496 shutdown_connections 2023-09-30T22:21:49.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.432+0000 7f74acefa700 1 -- 172.21.15.156:0/1632597496 wait complete. 2023-09-30T22:21:49.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.433+0000 7f74acefa700 1 Processor -- start 2023-09-30T22:21:49.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.433+0000 7f74acefa700 1 -- start start 2023-09-30T22:21:49.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.434+0000 7f74acefa700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f74a80a0a70 0x7f74a8122780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.434+0000 7f74acefa700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74a80a1380 0x7f74a8122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.434+0000 7f74acefa700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f74a8134120 0x7f74a8123200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.434+0000 7f74acefa700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a81259a0 con 0x7f74a80a1380 2023-09-30T22:21:49.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.434+0000 7f74acefa700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a8124390 con 0x7f74a8134120 2023-09-30T22:21:49.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.434+0000 7f74acefa700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74a8133350 con 0x7f74a80a0a70 2023-09-30T22:21:49.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.434+0000 7f74a6d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f74a8134120 0x7f74a8123200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.434+0000 7f74a6d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f74a8134120 0x7f74a8123200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53462/0 (socket says 172.21.15.156:53462) 2023-09-30T22:21:49.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.434+0000 7f74a6d9d700 1 -- 172.21.15.156:0/958320037 learned_addr learned my addr 172.21.15.156:0/958320037 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:49.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.434+0000 7f74a659c700 1 --2- 172.21.15.156:0/958320037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f74a80a0a70 0x7f74a8122780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.434+0000 7f74a5d9b700 1 --2- 172.21.15.156:0/958320037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74a80a1380 0x7f74a8122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.434+0000 7f74a659c700 1 -- 172.21.15.156:0/958320037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f74a8134120 msgr2=0x7f74a8123200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.434+0000 7f74a659c700 1 --2- 172.21.15.156:0/958320037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f74a8134120 0x7f74a8123200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.434+0000 7f74a659c700 1 -- 172.21.15.156:0/958320037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74a80a1380 msgr2=0x7f74a8122cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.434+0000 7f74a659c700 1 --2- 172.21.15.156:0/958320037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74a80a1380 0x7f74a8122cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.435+0000 7f74a659c700 1 -- 172.21.15.156:0/958320037 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74980094a0 con 0x7f74a80a0a70 2023-09-30T22:21:49.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.435+0000 7f74a6d9d700 1 --2- 172.21.15.156:0/958320037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f74a8134120 0x7f74a8123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:49.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.435+0000 7f74a659c700 1 --2- 172.21.15.156:0/958320037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f74a80a0a70 0x7f74a8122780 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f749800e9e0 tx=0x7f749800ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:49.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.435+0000 7f7496ffd700 1 -- 172.21.15.156:0/958320037 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749800ee80 con 0x7f74a80a0a70 2023-09-30T22:21:49.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.435+0000 7f7496ffd700 1 -- 172.21.15.156:0/958320037 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749800c850 con 0x7f74a80a0a70 2023-09-30T22:21:49.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.435+0000 7f7496ffd700 1 -- 172.21.15.156:0/958320037 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749800cc00 con 0x7f74a80a0a70 2023-09-30T22:21:49.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.435+0000 7f74acefa700 1 -- 172.21.15.156:0/958320037 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a0009a70 con 0x7f74a80a0a70 2023-09-30T22:21:49.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.435+0000 7f74acefa700 1 -- 172.21.15.156:0/958320037 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a80a03e0 con 0x7f74a80a0a70 2023-09-30T22:21:49.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.436+0000 7f74acefa700 1 -- 172.21.15.156:0/958320037 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a804f2a0 con 0x7f74a80a0a70 2023-09-30T22:21:49.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.436+0000 7f7496ffd700 1 -- 172.21.15.156:0/958320037 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f749800cd60 con 0x7f74a80a0a70 2023-09-30T22:21:49.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.436+0000 7f7496ffd700 1 -- 172.21.15.156:0/958320037 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f749803fec0 con 0x7f74a80a0a70 2023-09-30T22:21:49.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.440+0000 7f7496ffd700 1 -- 172.21.15.156:0/958320037 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7498011350 con 0x7f74a80a0a70 2023-09-30T22:21:49.572 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:49.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.589+0000 7f52b4ecf700 1 -- 172.21.15.156:0/4169379839 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f52b004f2a0 con 0x7f52b009f350 2023-09-30T22:21:49.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.589+0000 7f529effd700 1 -- 172.21.15.156:0/4169379839 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f52a4017020 con 0x7f52b009f350 2023-09-30T22:21:49.589 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:49.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.592+0000 7f52b4ecf700 1 -- 172.21.15.156:0/4169379839 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52b009f350 msgr2=0x7f52b0121d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.592+0000 7f52b4ecf700 1 --2- 172.21.15.156:0/4169379839 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52b009f350 0x7f52b0121d70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f52a400ebe0 tx=0x7f52a400eef0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.592+0000 7f52b4ecf700 1 -- 172.21.15.156:0/4169379839 shutdown_connections 2023-09-30T22:21:49.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.592+0000 7f52b4ecf700 1 --2- 172.21.15.156:0/4169379839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52b01393a0 0x7f52b01222b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.592+0000 7f52b4ecf700 1 --2- 172.21.15.156:0/4169379839 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f52b009e870 0x7f52b0121830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.592+0000 7f52b4ecf700 1 --2- 172.21.15.156:0/4169379839 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f52b009f350 0x7f52b0121d70 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.592+0000 7f52b4ecf700 1 -- 172.21.15.156:0/4169379839 >> 172.21.15.156:0/4169379839 conn(0x7f52b00a4430 msgr2=0x7f52b0071010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:49.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.592+0000 7f52b4ecf700 1 -- 172.21.15.156:0/4169379839 shutdown_connections 2023-09-30T22:21:49.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.592+0000 7f52b4ecf700 1 -- 172.21.15.156:0/4169379839 wait complete. 2023-09-30T22:21:49.605 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:49.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.633+0000 7f74acefa700 1 -- 172.21.15.156:0/958320037 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f74a8072980 con 0x7f74a80a0a70 2023-09-30T22:21:49.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.634+0000 7f7496ffd700 1 -- 172.21.15.156:0/958320037 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7498021020 con 0x7f74a80a0a70 2023-09-30T22:21:49.634 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:49.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.637+0000 7f74acefa700 1 -- 172.21.15.156:0/958320037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f74a80a0a70 msgr2=0x7f74a8122780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.637+0000 7f74acefa700 1 --2- 172.21.15.156:0/958320037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f74a80a0a70 0x7f74a8122780 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f749800e9e0 tx=0x7f749800ecf0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.637+0000 7f74acefa700 1 -- 172.21.15.156:0/958320037 shutdown_connections 2023-09-30T22:21:49.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.637+0000 7f74acefa700 1 --2- 172.21.15.156:0/958320037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f74a8134120 0x7f74a8123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.637+0000 7f74acefa700 1 --2- 172.21.15.156:0/958320037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f74a80a0a70 0x7f74a8122780 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.637+0000 7f74acefa700 1 --2- 172.21.15.156:0/958320037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74a80a1380 0x7f74a8122cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.637+0000 7f74acefa700 1 -- 172.21.15.156:0/958320037 >> 172.21.15.156:0/958320037 conn(0x7f74a80a6610 msgr2=0x7f74a809ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:49.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.637+0000 7f74acefa700 1 -- 172.21.15.156:0/958320037 shutdown_connections 2023-09-30T22:21:49.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.637+0000 7f74acefa700 1 -- 172.21.15.156:0/958320037 wait complete. 2023-09-30T22:21:49.654 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:49.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.706+0000 7f946707e700 1 Processor -- start 2023-09-30T22:21:49.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.706+0000 7f946707e700 1 -- start start 2023-09-30T22:21:49.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.706+0000 7f946707e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f946012cef0 0x7f946012d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.706+0000 7f946707e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9460133540 0x7f9460133910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.706+0000 7f946707e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9460133e50 0x7f946013a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.706+0000 7f946707e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f946009ac40 con 0x7f946012cef0 2023-09-30T22:21:49.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.706+0000 7f946707e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946009a740 con 0x7f9460133540 2023-09-30T22:21:49.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.706+0000 7f946707e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f946009f3a0 con 0x7f9460133e50 2023-09-30T22:21:49.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.706+0000 7f945ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9460133540 0x7f9460133910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.706+0000 7f9464e1a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f946012cef0 0x7f946012d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.706+0000 7f946561b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9460133e50 0x7f946013a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.706+0000 7f9464e1a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f946012cef0 0x7f946012d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33418/0 (socket says 172.21.15.156:33418) 2023-09-30T22:21:49.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.706+0000 7f945ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9460133540 0x7f9460133910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53476/0 (socket says 172.21.15.156:53476) 2023-09-30T22:21:49.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.707+0000 7f9464e1a700 1 -- 172.21.15.156:0/3506735829 learned_addr learned my addr 172.21.15.156:0/3506735829 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:49.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.707+0000 7f9464e1a700 1 -- 172.21.15.156:0/3506735829 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9460133e50 msgr2=0x7f946013a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:49.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.707+0000 7f9464e1a700 1 --2- 172.21.15.156:0/3506735829 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9460133e50 0x7f946013a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.707+0000 7f9464e1a700 1 -- 172.21.15.156:0/3506735829 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9460133540 msgr2=0x7f9460133910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:49.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.707+0000 7f9464e1a700 1 --2- 172.21.15.156:0/3506735829 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9460133540 0x7f9460133910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.707+0000 7f9464e1a700 1 -- 172.21.15.156:0/3506735829 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f946009b010 con 0x7f946012cef0 2023-09-30T22:21:49.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.707+0000 7f945ffff700 1 --2- 172.21.15.156:0/3506735829 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9460133540 0x7f9460133910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:49.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.707+0000 7f946561b700 1 --2- 172.21.15.156:0/3506735829 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9460133e50 0x7f946013a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:49.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.707+0000 7f9464e1a700 1 --2- 172.21.15.156:0/3506735829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f946012cef0 0x7f946012d2c0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f94540098f0 tx=0x7f9454009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=411dd8f418a6dbec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:49.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.707+0000 7f945f7fe700 1 -- 172.21.15.156:0/3506735829 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9454011830 con 0x7f946012cef0 2023-09-30T22:21:49.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.707+0000 7f945f7fe700 1 -- 172.21.15.156:0/3506735829 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9454011990 con 0x7f946012cef0 2023-09-30T22:21:49.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.707+0000 7f945f7fe700 1 -- 172.21.15.156:0/3506735829 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9454011d20 con 0x7f946012cef0 2023-09-30T22:21:49.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.708+0000 7f946707e700 1 -- 172.21.15.156:0/3506735829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f946012cef0 msgr2=0x7f946012d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.708+0000 7f946707e700 1 --2- 172.21.15.156:0/3506735829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f946012cef0 0x7f946012d2c0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f94540098f0 tx=0x7f9454009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:49.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.708+0000 7f946707e700 1 -- 172.21.15.156:0/3506735829 shutdown_connections 2023-09-30T22:21:49.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.708+0000 7f946707e700 1 --2- 172.21.15.156:0/3506735829 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9460133e50 0x7f946013a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.708+0000 7f946707e700 1 --2- 172.21.15.156:0/3506735829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f946012cef0 0x7f946012d2c0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.708+0000 7f946707e700 1 --2- 172.21.15.156:0/3506735829 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9460133540 0x7f9460133910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.708+0000 7f946707e700 1 -- 172.21.15.156:0/3506735829 >> 172.21.15.156:0/3506735829 conn(0x7f9460099c40 msgr2=0x7f94600a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:49.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.708+0000 7f946707e700 1 -- 172.21.15.156:0/3506735829 shutdown_connections 2023-09-30T22:21:49.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.708+0000 7f946707e700 1 -- 172.21.15.156:0/3506735829 wait complete. 2023-09-30T22:21:49.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.709+0000 7f946707e700 1 Processor -- start 2023-09-30T22:21:49.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.709+0000 7f946707e700 1 -- start start 2023-09-30T22:21:49.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.709+0000 7f946707e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f946012cef0 0x7f94600709b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.709+0000 7f946707e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9460133540 0x7f9460070ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.709+0000 7f946707e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9460133e50 0x7f9460071430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.709+0000 7f946707e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946011f0d0 con 0x7f9460133540 2023-09-30T22:21:49.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.709+0000 7f946707e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946011e9d0 con 0x7f9460133e50 2023-09-30T22:21:49.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.709+0000 7f946707e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94600723d0 con 0x7f946012cef0 2023-09-30T22:21:49.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.709+0000 7f9464e1a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f946012cef0 0x7f94600709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.709+0000 7f945ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9460133540 0x7f9460070ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.709+0000 7f9464e1a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f946012cef0 0x7f94600709b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45222/0 (socket says 172.21.15.156:45222) 2023-09-30T22:21:49.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.709+0000 7f9464e1a700 1 -- 172.21.15.156:0/3463361559 learned_addr learned my addr 172.21.15.156:0/3463361559 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:49.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.709+0000 7f946561b700 1 --2- 172.21.15.156:0/3463361559 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9460133e50 0x7f9460071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.710+0000 7f9464e1a700 1 -- 172.21.15.156:0/3463361559 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9460133e50 msgr2=0x7f9460071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.710+0000 7f9464e1a700 1 --2- 172.21.15.156:0/3463361559 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9460133e50 0x7f9460071430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.710+0000 7f9464e1a700 1 -- 172.21.15.156:0/3463361559 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9460133540 msgr2=0x7f9460070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.710+0000 7f9464e1a700 1 --2- 172.21.15.156:0/3463361559 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9460133540 0x7f9460070ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.710+0000 7f9464e1a700 1 -- 172.21.15.156:0/3463361559 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944c0094a0 con 0x7f946012cef0 2023-09-30T22:21:49.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.710+0000 7f946561b700 1 --2- 172.21.15.156:0/3463361559 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9460133e50 0x7f9460071430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:49.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.710+0000 7f945ffff700 1 --2- 172.21.15.156:0/3463361559 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9460133540 0x7f9460070ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:49.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.710+0000 7f9464e1a700 1 --2- 172.21.15.156:0/3463361559 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f946012cef0 0x7f94600709b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9454000c00 tx=0x7f9454004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:49.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.710+0000 7f945d7fa700 1 -- 172.21.15.156:0/3463361559 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9454004240 con 0x7f946012cef0 2023-09-30T22:21:49.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.710+0000 7f945d7fa700 1 -- 172.21.15.156:0/3463361559 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945401f070 con 0x7f946012cef0 2023-09-30T22:21:49.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.710+0000 7f946707e700 1 -- 172.21.15.156:0/3463361559 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9458009a70 con 0x7f946012cef0 2023-09-30T22:21:49.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.710+0000 7f945d7fa700 1 -- 172.21.15.156:0/3463361559 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94540045c0 con 0x7f946012cef0 2023-09-30T22:21:49.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.710+0000 7f946707e700 1 -- 172.21.15.156:0/3463361559 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9454009550 con 0x7f946012cef0 2023-09-30T22:21:49.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.711+0000 7f945d7fa700 1 -- 172.21.15.156:0/3463361559 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9454021030 con 0x7f946012cef0 2023-09-30T22:21:49.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.711+0000 7f945d7fa700 1 -- 172.21.15.156:0/3463361559 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f94540406b0 con 0x7f946012cef0 2023-09-30T22:21:49.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.711+0000 7f946707e700 1 -- 172.21.15.156:0/3463361559 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f946012c7c0 con 0x7f946012cef0 2023-09-30T22:21:49.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.715+0000 7f945d7fa700 1 -- 172.21.15.156:0/3463361559 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f945401a450 con 0x7f946012cef0 2023-09-30T22:21:49.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.899+0000 7f946707e700 1 -- 172.21.15.156:0/3463361559 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f946004f2a0 con 0x7f946012cef0 2023-09-30T22:21:49.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.899+0000 7f945d7fa700 1 -- 172.21.15.156:0/3463361559 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f94540233d0 con 0x7f946012cef0 2023-09-30T22:21:49.899 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:49.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.901+0000 7f946707e700 1 -- 172.21.15.156:0/3463361559 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f946012cef0 msgr2=0x7f94600709b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.901+0000 7f946707e700 1 --2- 172.21.15.156:0/3463361559 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f946012cef0 0x7f94600709b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9454000c00 tx=0x7f9454004750 comp rx=0 tx=0).stop 2023-09-30T22:21:49.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.901+0000 7f946707e700 1 -- 172.21.15.156:0/3463361559 shutdown_connections 2023-09-30T22:21:49.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.901+0000 7f946707e700 1 --2- 172.21.15.156:0/3463361559 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9460133e50 0x7f9460071430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.901+0000 7f946707e700 1 --2- 172.21.15.156:0/3463361559 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f946012cef0 0x7f94600709b0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.901+0000 7f946707e700 1 --2- 172.21.15.156:0/3463361559 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9460133540 0x7f9460070ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.901+0000 7f946707e700 1 -- 172.21.15.156:0/3463361559 >> 172.21.15.156:0/3463361559 conn(0x7f9460099c40 msgr2=0x7f9460131b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:49.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.901+0000 7f946707e700 1 -- 172.21.15.156:0/3463361559 shutdown_connections 2023-09-30T22:21:49.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:49.901+0000 7f946707e700 1 -- 172.21.15.156:0/3463361559 wait complete. 2023-09-30T22:21:49.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:50.398 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:50.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.522+0000 7fc38425b700 1 Processor -- start 2023-09-30T22:21:50.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.522+0000 7fc38425b700 1 -- start start 2023-09-30T22:21:50.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.523+0000 7fc38425b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc37c09ad40 0x7fc37c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.523+0000 7fc38425b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc37c133f70 0x7fc37c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.523+0000 7fc38425b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc37c09b110 con 0x7fc37c0a0a70 2023-09-30T22:21:50.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.523+0000 7fc38425b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc37c0a3b60 con 0x7fc37c09ad40 2023-09-30T22:21:50.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.523+0000 7fc38425b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c1348e0 con 0x7fc37c133f70 2023-09-30T22:21:50.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.523+0000 7fc3817f6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc37c133f70 0x7fc37c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.523+0000 7fc381ff7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc37c09ad40 0x7fc37c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.523+0000 7fc3827f8700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc37c0a0a70 0x7fc37c0a0ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45236/0 (socket says 172.21.15.156:45236) 2023-09-30T22:21:50.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.523+0000 7fc381ff7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc37c09ad40 0x7fc37c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33434/0 (socket says 172.21.15.156:33434) 2023-09-30T22:21:50.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.523+0000 7fc3817f6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc37c133f70 0x7fc37c1343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45228/0 (socket says 172.21.15.156:45228) 2023-09-30T22:21:50.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.523+0000 7fc3827f8700 1 -- 172.21.15.156:0/2009224328 learned_addr learned my addr 172.21.15.156:0/2009224328 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:50.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.523+0000 7fc3817f6700 1 -- 172.21.15.156:0/2009224328 >> v2:172.21.15.156:3300/0 conn(0x7fc37c09ad40 msgr2=0x7fc37c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:50.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.523+0000 7fc3817f6700 1 --2- 172.21.15.156:0/2009224328 >> v2:172.21.15.156:3300/0 conn(0x7fc37c09ad40 0x7fc37c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.523+0000 7fc3817f6700 1 -- 172.21.15.156:0/2009224328 >> v1:172.21.15.156:6789/0 conn(0x7fc37c0a0a70 legacy=0x7fc37c0a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.523+0000 7fc3817f6700 1 -- 172.21.15.156:0/2009224328 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c0a2fa0 con 0x7fc37c133f70 2023-09-30T22:21:50.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.523+0000 7fc380ff5700 1 -- 172.21.15.156:0/2009224328 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2180751623 0 0) 0x7fc37c09b110 con 0x7fc37c0a0a70 2023-09-30T22:21:50.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.523+0000 7fc381ff7700 1 --2- 172.21.15.156:0/2009224328 >> v2:172.21.15.156:3300/0 conn(0x7fc37c09ad40 0x7fc37c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:50.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.523+0000 7fc3817f6700 1 --2- 172.21.15.156:0/2009224328 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc37c133f70 0x7fc37c1343a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc378009840 tx=0x7fc378009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=742ebfa201950a3f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:50.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.524+0000 7fc380ff5700 1 -- 172.21.15.156:0/2009224328 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc378011830 con 0x7fc37c133f70 2023-09-30T22:21:50.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.524+0000 7fc380ff5700 1 -- 172.21.15.156:0/2009224328 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc378011990 con 0x7fc37c133f70 2023-09-30T22:21:50.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.524+0000 7fc380ff5700 1 -- 172.21.15.156:0/2009224328 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc378011d20 con 0x7fc37c133f70 2023-09-30T22:21:50.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.524+0000 7fc38425b700 1 -- 172.21.15.156:0/2009224328 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc37c133f70 msgr2=0x7fc37c1343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.524+0000 7fc38425b700 1 --2- 172.21.15.156:0/2009224328 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc37c133f70 0x7fc37c1343a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc378009840 tx=0x7fc378009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:50.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.524+0000 7fc38425b700 1 -- 172.21.15.156:0/2009224328 shutdown_connections 2023-09-30T22:21:50.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.524+0000 7fc38425b700 1 --2- 172.21.15.156:0/2009224328 >> v2:172.21.15.156:3300/0 conn(0x7fc37c09ad40 0x7fc37c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.524+0000 7fc38425b700 1 --2- 172.21.15.156:0/2009224328 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc37c133f70 0x7fc37c1343a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.524+0000 7fc38425b700 1 -- 172.21.15.156:0/2009224328 >> 172.21.15.156:0/2009224328 conn(0x7fc37c099c40 msgr2=0x7fc37c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:50.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.524+0000 7fc38425b700 1 -- 172.21.15.156:0/2009224328 shutdown_connections 2023-09-30T22:21:50.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.524+0000 7fc38425b700 1 -- 172.21.15.156:0/2009224328 wait complete. 2023-09-30T22:21:50.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.525+0000 7fc38425b700 1 Processor -- start 2023-09-30T22:21:50.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.525+0000 7fc38425b700 1 -- start start 2023-09-30T22:21:50.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.526+0000 7fc38425b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc37c09ad40 0x7fc37c11f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.526+0000 7fc38425b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc37c0a0a70 0x7fc37c11f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.526+0000 7fc38425b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc37c133f70 0x7fc37c1c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.526+0000 7fc38425b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0a0ed0 con 0x7fc37c133f70 2023-09-30T22:21:50.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.526+0000 7fc38425b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c11ff00 con 0x7fc37c09ad40 2023-09-30T22:21:50.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.526+0000 7fc38425b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c120f20 con 0x7fc37c0a0a70 2023-09-30T22:21:50.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.526+0000 7fc3827f8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc37c133f70 0x7fc37c1c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.526+0000 7fc3817f6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc37c0a0a70 0x7fc37c11f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.526+0000 7fc3817f6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc37c0a0a70 0x7fc37c11f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45244/0 (socket says 172.21.15.156:45244) 2023-09-30T22:21:50.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.526+0000 7fc3827f8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc37c133f70 0x7fc37c1c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33450/0 (socket says 172.21.15.156:33450) 2023-09-30T22:21:50.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.526+0000 7fc381ff7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc37c09ad40 0x7fc37c11f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.526+0000 7fc3817f6700 1 -- 172.21.15.156:0/926213709 learned_addr learned my addr 172.21.15.156:0/926213709 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:50.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.526+0000 7fc3817f6700 1 -- 172.21.15.156:0/926213709 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc37c09ad40 msgr2=0x7fc37c11f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.526+0000 7fc3817f6700 1 --2- 172.21.15.156:0/926213709 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc37c09ad40 0x7fc37c11f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.526+0000 7fc3817f6700 1 -- 172.21.15.156:0/926213709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc37c133f70 msgr2=0x7fc37c1c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.526+0000 7fc3817f6700 1 --2- 172.21.15.156:0/926213709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc37c133f70 0x7fc37c1c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.526+0000 7fc3817f6700 1 -- 172.21.15.156:0/926213709 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36c0094a0 con 0x7fc37c0a0a70 2023-09-30T22:21:50.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.526+0000 7fc381ff7700 1 --2- 172.21.15.156:0/926213709 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc37c09ad40 0x7fc37c11f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:50.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.526+0000 7fc3827f8700 1 --2- 172.21.15.156:0/926213709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc37c133f70 0x7fc37c1c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:50.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.526+0000 7fc3817f6700 1 --2- 172.21.15.156:0/926213709 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc37c0a0a70 0x7fc37c11f9c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc378009b90 tx=0x7fc378004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:50.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.526+0000 7fc3727fc700 1 -- 172.21.15.156:0/926213709 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc378004590 con 0x7fc37c0a0a70 2023-09-30T22:21:50.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.526+0000 7fc3727fc700 1 -- 172.21.15.156:0/926213709 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3780036a0 con 0x7fc37c0a0a70 2023-09-30T22:21:50.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.526+0000 7fc3727fc700 1 -- 172.21.15.156:0/926213709 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc378003a30 con 0x7fc37c0a0a70 2023-09-30T22:21:50.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.526+0000 7fc38425b700 1 -- 172.21.15.156:0/926213709 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3780094a0 con 0x7fc37c0a0a70 2023-09-30T22:21:50.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.526+0000 7fc38425b700 1 -- 172.21.15.156:0/926213709 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc37c11ef90 con 0x7fc37c0a0a70 2023-09-30T22:21:50.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.527+0000 7fc3727fc700 1 -- 172.21.15.156:0/926213709 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc378003b90 con 0x7fc37c0a0a70 2023-09-30T22:21:50.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.527+0000 7fc3727fc700 1 -- 172.21.15.156:0/926213709 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc378040240 con 0x7fc37c0a0a70 2023-09-30T22:21:50.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.527+0000 7fc38425b700 1 -- 172.21.15.156:0/926213709 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc37c1334a0 con 0x7fc37c0a0a70 2023-09-30T22:21:50.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.532+0000 7fc3727fc700 1 -- 172.21.15.156:0/926213709 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc37801a420 con 0x7fc37c0a0a70 2023-09-30T22:21:50.605 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:50.660 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:50.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.727+0000 7fc38425b700 1 -- 172.21.15.156:0/926213709 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc37c04f2a0 con 0x7fc37c0a0a70 2023-09-30T22:21:50.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.727+0000 7fc3727fc700 1 -- 172.21.15.156:0/926213709 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc378028030 con 0x7fc37c0a0a70 2023-09-30T22:21:50.727 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:50.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.729+0000 7fc38425b700 1 -- 172.21.15.156:0/926213709 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc37c0a0a70 msgr2=0x7fc37c11f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.729+0000 7fc38425b700 1 --2- 172.21.15.156:0/926213709 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc37c0a0a70 0x7fc37c11f9c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc378009b90 tx=0x7fc378004750 comp rx=0 tx=0).stop 2023-09-30T22:21:50.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.729+0000 7fc38425b700 1 -- 172.21.15.156:0/926213709 shutdown_connections 2023-09-30T22:21:50.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.729+0000 7fc38425b700 1 --2- 172.21.15.156:0/926213709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc37c133f70 0x7fc37c1c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.729+0000 7fc38425b700 1 --2- 172.21.15.156:0/926213709 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc37c09ad40 0x7fc37c11f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.729+0000 7fc38425b700 1 --2- 172.21.15.156:0/926213709 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc37c0a0a70 0x7fc37c11f9c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.729+0000 7fc38425b700 1 -- 172.21.15.156:0/926213709 >> 172.21.15.156:0/926213709 conn(0x7fc37c099c40 msgr2=0x7fc37c0a4110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:50.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.729+0000 7fc38425b700 1 -- 172.21.15.156:0/926213709 shutdown_connections 2023-09-30T22:21:50.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.729+0000 7fc38425b700 1 -- 172.21.15.156:0/926213709 wait complete. 2023-09-30T22:21:50.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:50.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.791+0000 7fb8308af700 1 Processor -- start 2023-09-30T22:21:50.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.791+0000 7faa74b75700 1 Processor -- start 2023-09-30T22:21:50.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.791+0000 7fb8308af700 1 -- start start 2023-09-30T22:21:50.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.791+0000 7faa74b75700 1 -- start start 2023-09-30T22:21:50.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.792+0000 7faa74b75700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7faa70133ad0 0x7faa70133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.792+0000 7faa74b75700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faa70130bc0 0x7faa7013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.792+0000 7faa74b75700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7006b2d0 con 0x7faa701300a0 2023-09-30T22:21:50.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.792+0000 7faa74b75700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa70133610 con 0x7faa70133ad0 2023-09-30T22:21:50.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.792+0000 7faa74b75700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa7009a500 con 0x7faa70130bc0 2023-09-30T22:21:50.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.792+0000 7faa6e59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7faa70133ad0 0x7faa70133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.792+0000 7faa6ed9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faa70130bc0 0x7faa7013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.792+0000 7faa6ed9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faa70130bc0 0x7faa7013b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45256/0 (socket says 172.21.15.156:45256) 2023-09-30T22:21:50.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.792+0000 7faa6e59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7faa70133ad0 0x7faa70133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33456/0 (socket says 172.21.15.156:33456) 2023-09-30T22:21:50.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.792+0000 7fb8308af700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb82c0a0a70 0x7fb82c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.792+0000 7fb8308af700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb82c134120 0x7fb82c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.792+0000 7faa6ed9d700 1 -- 172.21.15.156:0/952756799 learned_addr learned my addr 172.21.15.156:0/952756799 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:50.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.792+0000 7fb8308af700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb82c09dc00 con 0x7fb82c0a1380 2023-09-30T22:21:50.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.792+0000 7fb8308af700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb82c09ea90 con 0x7fb82c0a0a70 2023-09-30T22:21:50.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.792+0000 7fb8308af700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c09dec0 con 0x7fb82c134120 2023-09-30T22:21:50.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.792+0000 7fb829d9b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb82c0a1380 0x7fb82c133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45254/0 (socket says 172.21.15.156:45254) 2023-09-30T22:21:50.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.792+0000 7fb829d9b700 1 -- 172.21.15.156:0/1560802026 learned_addr learned my addr 172.21.15.156:0/1560802026 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:50.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.792+0000 7fb82a59c700 1 --2- 172.21.15.156:0/1560802026 >> v2:172.21.15.156:3300/0 conn(0x7fb82c0a0a70 0x7fb82c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.792+0000 7fb82ad9d700 1 --2- 172.21.15.156:0/1560802026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb82c134120 0x7fb82c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.792+0000 7faa6ed9d700 1 -- 172.21.15.156:0/952756799 >> v2:172.21.15.156:3300/0 conn(0x7faa70133ad0 msgr2=0x7faa70133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:50.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.792+0000 7faa6ed9d700 1 --2- 172.21.15.156:0/952756799 >> v2:172.21.15.156:3300/0 conn(0x7faa70133ad0 0x7faa70133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.792+0000 7faa6ed9d700 1 -- 172.21.15.156:0/952756799 >> v1:172.21.15.156:6789/0 conn(0x7faa701300a0 legacy=0x7faa701304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.792+0000 7faa6ed9d700 1 -- 172.21.15.156:0/952756799 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa701338b0 con 0x7faa70130bc0 2023-09-30T22:21:50.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.792+0000 7faa6e59c700 1 --2- 172.21.15.156:0/952756799 >> v2:172.21.15.156:3300/0 conn(0x7faa70133ad0 0x7faa70133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:50.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.793+0000 7fb82a59c700 1 -- 172.21.15.156:0/1560802026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb82c134120 msgr2=0x7fb82c13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:50.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.793+0000 7fb82a59c700 1 --2- 172.21.15.156:0/1560802026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb82c134120 0x7fb82c13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.793+0000 7fb82a59c700 1 -- 172.21.15.156:0/1560802026 >> v1:172.21.15.156:6789/0 conn(0x7fb82c0a1380 legacy=0x7fb82c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.793+0000 7fb82a59c700 1 -- 172.21.15.156:0/1560802026 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82c09e6a0 con 0x7fb82c0a0a70 2023-09-30T22:21:50.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.793+0000 7fb82959a700 1 -- 172.21.15.156:0/1560802026 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901867111 0 0) 0x7fb82c09dc00 con 0x7fb82c0a1380 2023-09-30T22:21:50.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.793+0000 7fb82ad9d700 1 --2- 172.21.15.156:0/1560802026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb82c134120 0x7fb82c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:50.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.793+0000 7faa6ed9d700 1 --2- 172.21.15.156:0/952756799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faa70130bc0 0x7faa7013b990 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7faa68009e50 tx=0x7faa6800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff9429b0322d36d1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:50.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.793+0000 7fb82a59c700 1 --2- 172.21.15.156:0/1560802026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb82c0a0a70 0x7fb82c0a0e40 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb81c009840 tx=0x7fb81c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4704e122869f0aeb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:50.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.793+0000 7faa6d59a700 1 -- 172.21.15.156:0/952756799 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6800e070 con 0x7faa70130bc0 2023-09-30T22:21:50.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.793+0000 7faa6d59a700 1 -- 172.21.15.156:0/952756799 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6800b910 con 0x7faa70130bc0 2023-09-30T22:21:50.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.793+0000 7faa6d59a700 1 -- 172.21.15.156:0/952756799 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6800bcc0 con 0x7faa70130bc0 2023-09-30T22:21:50.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.793+0000 7fb82959a700 1 -- 172.21.15.156:0/1560802026 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c011830 con 0x7fb82c0a0a70 2023-09-30T22:21:50.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.793+0000 7fb82959a700 1 -- 172.21.15.156:0/1560802026 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81c011990 con 0x7fb82c0a0a70 2023-09-30T22:21:50.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.793+0000 7fb82959a700 1 -- 172.21.15.156:0/1560802026 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c011d20 con 0x7fb82c0a0a70 2023-09-30T22:21:50.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.794+0000 7fb8308af700 1 -- 172.21.15.156:0/1560802026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb82c0a0a70 msgr2=0x7fb82c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.794+0000 7fb8308af700 1 --2- 172.21.15.156:0/1560802026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb82c0a0a70 0x7fb82c0a0e40 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb81c009840 tx=0x7fb81c009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:50.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.794+0000 7faa74b75700 1 -- 172.21.15.156:0/952756799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faa70130bc0 msgr2=0x7faa7013b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.794+0000 7faa74b75700 1 --2- 172.21.15.156:0/952756799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faa70130bc0 0x7faa7013b990 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7faa68009e50 tx=0x7faa6800b330 comp rx=0 tx=0).stop 2023-09-30T22:21:50.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.794+0000 7faa74b75700 1 -- 172.21.15.156:0/952756799 shutdown_connections 2023-09-30T22:21:50.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.794+0000 7faa74b75700 1 --2- 172.21.15.156:0/952756799 >> v2:172.21.15.156:3300/0 conn(0x7faa70133ad0 0x7faa70133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.794+0000 7faa74b75700 1 --2- 172.21.15.156:0/952756799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faa70130bc0 0x7faa7013b990 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.794+0000 7faa74b75700 1 -- 172.21.15.156:0/952756799 >> 172.21.15.156:0/952756799 conn(0x7faa70099c40 msgr2=0x7faa700a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:50.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.794+0000 7fb8308af700 1 -- 172.21.15.156:0/1560802026 shutdown_connections 2023-09-30T22:21:50.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.794+0000 7fb8308af700 1 --2- 172.21.15.156:0/1560802026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb82c0a0a70 0x7fb82c0a0e40 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.794+0000 7fb8308af700 1 --2- 172.21.15.156:0/1560802026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb82c134120 0x7fb82c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.794+0000 7fb8308af700 1 -- 172.21.15.156:0/1560802026 >> 172.21.15.156:0/1560802026 conn(0x7fb82c0a6610 msgr2=0x7fb82c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:50.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.794+0000 7faa74b75700 1 -- 172.21.15.156:0/952756799 shutdown_connections 2023-09-30T22:21:50.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.794+0000 7fb8308af700 1 -- 172.21.15.156:0/1560802026 shutdown_connections 2023-09-30T22:21:50.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.794+0000 7faa74b75700 1 -- 172.21.15.156:0/952756799 wait complete. 2023-09-30T22:21:50.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.794+0000 7fb8308af700 1 -- 172.21.15.156:0/1560802026 wait complete. 2023-09-30T22:21:50.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.795+0000 7faa74b75700 1 Processor -- start 2023-09-30T22:21:50.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.795+0000 7fb8308af700 1 Processor -- start 2023-09-30T22:21:50.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.795+0000 7faa74b75700 1 -- start start 2023-09-30T22:21:50.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.795+0000 7fb8308af700 1 -- start start 2023-09-30T22:21:50.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.795+0000 7faa74b75700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa701300a0 0x7faa7011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.795+0000 7faa74b75700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faa70130bc0 0x7faa7011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.795+0000 7faa74b75700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faa70133ad0 0x7faa7011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.795+0000 7faa74b75700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7011fde0 con 0x7faa701300a0 2023-09-30T22:21:50.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.795+0000 7faa74b75700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7011fbb0 con 0x7faa70133ad0 2023-09-30T22:21:50.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.795+0000 7faa74b75700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa7011f040 con 0x7faa70130bc0 2023-09-30T22:21:50.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.795+0000 7fb8308af700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb82c0a0a70 0x7fb82c122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.795+0000 7fb8308af700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb82c0a1380 0x7fb82c122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.795+0000 7fb8308af700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb82c134120 0x7fb82c123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.795+0000 7fb8308af700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c133300 con 0x7fb82c134120 2023-09-30T22:21:50.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.795+0000 7fb8308af700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c125920 con 0x7fb82c0a0a70 2023-09-30T22:21:50.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.795+0000 7fb8308af700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c124310 con 0x7fb82c0a1380 2023-09-30T22:21:50.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.795+0000 7faa6dd9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faa70130bc0 0x7faa7011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.795+0000 7faa6e59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa701300a0 0x7faa7011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.795+0000 7fb82ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb82c134120 0x7fb82c123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.796+0000 7faa6e59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa701300a0 0x7faa7011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33486/0 (socket says 172.21.15.156:33486) 2023-09-30T22:21:50.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.796+0000 7faa6e59c700 1 -- 172.21.15.156:0/652570688 learned_addr learned my addr 172.21.15.156:0/652570688 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:50.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.796+0000 7fb82ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb82c134120 0x7fb82c123180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33492/0 (socket says 172.21.15.156:33492) 2023-09-30T22:21:50.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.796+0000 7fb82ad9d700 1 -- 172.21.15.156:0/736014145 learned_addr learned my addr 172.21.15.156:0/736014145 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:50.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.795+0000 7faa6dd9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faa70130bc0 0x7faa7011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45276/0 (socket says 172.21.15.156:45276) 2023-09-30T22:21:50.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.796+0000 7faa6dd9b700 1 -- 172.21.15.156:0/652570688 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faa70133ad0 msgr2=0x7faa7011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.796+0000 7faa6dd9b700 1 --2- 172.21.15.156:0/652570688 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faa70133ad0 0x7faa7011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.796+0000 7faa6dd9b700 1 -- 172.21.15.156:0/652570688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa701300a0 msgr2=0x7faa7011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.796+0000 7faa6dd9b700 1 --2- 172.21.15.156:0/652570688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa701300a0 0x7faa7011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.796+0000 7faa6dd9b700 1 -- 172.21.15.156:0/652570688 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa600094a0 con 0x7faa70130bc0 2023-09-30T22:21:50.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.796+0000 7fb82ad9d700 1 -- 172.21.15.156:0/736014145 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb82c0a1380 msgr2=0x7fb82c122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.796+0000 7fb82ad9d700 1 --2- 172.21.15.156:0/736014145 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb82c0a1380 0x7fb82c122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.796+0000 7fb82ad9d700 1 -- 172.21.15.156:0/736014145 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb82c0a0a70 msgr2=0x7fb82c122700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.796+0000 7fb82ad9d700 1 --2- 172.21.15.156:0/736014145 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb82c0a0a70 0x7fb82c122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.796+0000 7fb82ad9d700 1 -- 172.21.15.156:0/736014145 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb824009a70 con 0x7fb82c134120 2023-09-30T22:21:50.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.796+0000 7fb82ad9d700 1 --2- 172.21.15.156:0/736014145 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb82c134120 0x7fb82c123180 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fb82400efc0 tx=0x7fb82400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:50.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.796+0000 7faa6dd9b700 1 --2- 172.21.15.156:0/652570688 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faa70130bc0 0x7faa7011df80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7faa64000f60 tx=0x7faa6400c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:50.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.796+0000 7fb81affd700 1 -- 172.21.15.156:0/736014145 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb824009d70 con 0x7fb82c134120 2023-09-30T22:21:50.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.796+0000 7fb81affd700 1 -- 172.21.15.156:0/736014145 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82400f040 con 0x7fb82c134120 2023-09-30T22:21:50.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.796+0000 7fb8308af700 1 -- 172.21.15.156:0/736014145 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb81c0094a0 con 0x7fb82c134120 2023-09-30T22:21:50.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.796+0000 7faa5effd700 1 -- 172.21.15.156:0/652570688 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa640052d0 con 0x7faa70130bc0 2023-09-30T22:21:50.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.796+0000 7fb8308af700 1 -- 172.21.15.156:0/736014145 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82c125c80 con 0x7fb82c134120 2023-09-30T22:21:50.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.796+0000 7faa5effd700 1 -- 172.21.15.156:0/652570688 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6400ce90 con 0x7faa70130bc0 2023-09-30T22:21:50.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.796+0000 7faa5effd700 1 -- 172.21.15.156:0/652570688 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa64003680 con 0x7faa70130bc0 2023-09-30T22:21:50.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.796+0000 7faa74b75700 1 -- 172.21.15.156:0/652570688 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa68009b30 con 0x7faa70130bc0 2023-09-30T22:21:50.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.796+0000 7fb81affd700 1 -- 172.21.15.156:0/736014145 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82400ce00 con 0x7fb82c134120 2023-09-30T22:21:50.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.797+0000 7fb81affd700 1 -- 172.21.15.156:0/736014145 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb8240144a0 con 0x7fb82c134120 2023-09-30T22:21:50.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.797+0000 7faa74b75700 1 -- 172.21.15.156:0/652570688 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa7012f800 con 0x7faa70130bc0 2023-09-30T22:21:50.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.797+0000 7faa74b75700 1 -- 172.21.15.156:0/652570688 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa7004f2a0 con 0x7faa70130bc0 2023-09-30T22:21:50.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.797+0000 7fb81affd700 1 -- 172.21.15.156:0/736014145 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb824040050 con 0x7fb82c134120 2023-09-30T22:21:50.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.798+0000 7faa5effd700 1 -- 172.21.15.156:0/652570688 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faa640037e0 con 0x7faa70130bc0 2023-09-30T22:21:50.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.798+0000 7fb8308af700 1 -- 172.21.15.156:0/736014145 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8100052e0 con 0x7fb82c134120 2023-09-30T22:21:50.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.798+0000 7faa5effd700 1 -- 172.21.15.156:0/652570688 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faa6403e9c0 con 0x7faa70130bc0 2023-09-30T22:21:50.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.802+0000 7faa5effd700 1 -- 172.21.15.156:0/652570688 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa64003a90 con 0x7faa70130bc0 2023-09-30T22:21:50.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.802+0000 7fb81affd700 1 -- 172.21.15.156:0/736014145 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb824012700 con 0x7fb82c134120 2023-09-30T22:21:50.914 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:50.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.992+0000 7faa74b75700 1 -- 172.21.15.156:0/652570688 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faa7006c3b0 con 0x7faa70130bc0 2023-09-30T22:21:50.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.993+0000 7fb8308af700 1 -- 172.21.15.156:0/736014145 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb810005590 con 0x7fb82c134120 2023-09-30T22:21:50.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.993+0000 7faa5effd700 1 -- 172.21.15.156:0/652570688 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa64017070 con 0x7faa70130bc0 2023-09-30T22:21:50.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.993+0000 7fb81affd700 1 -- 172.21.15.156:0/736014145 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb824012340 con 0x7fb82c134120 2023-09-30T22:21:50.993 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:50.993 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:50.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.995+0000 7fb8308af700 1 -- 172.21.15.156:0/736014145 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb82c134120 msgr2=0x7fb82c123180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.995+0000 7fb8308af700 1 --2- 172.21.15.156:0/736014145 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb82c134120 0x7fb82c123180 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fb82400efc0 tx=0x7fb82400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.995+0000 7faa74b75700 1 -- 172.21.15.156:0/652570688 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faa70130bc0 msgr2=0x7faa7011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.995+0000 7faa74b75700 1 --2- 172.21.15.156:0/652570688 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faa70130bc0 0x7faa7011df80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7faa64000f60 tx=0x7faa6400c6e0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.995+0000 7faa74b75700 1 -- 172.21.15.156:0/652570688 shutdown_connections 2023-09-30T22:21:50.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.995+0000 7faa74b75700 1 --2- 172.21.15.156:0/652570688 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faa70133ad0 0x7faa7011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.995+0000 7faa74b75700 1 --2- 172.21.15.156:0/652570688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa701300a0 0x7faa7011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.995+0000 7faa74b75700 1 --2- 172.21.15.156:0/652570688 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faa70130bc0 0x7faa7011df80 secure :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7faa64000f60 tx=0x7faa6400c6e0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.995+0000 7faa74b75700 1 -- 172.21.15.156:0/652570688 >> 172.21.15.156:0/652570688 conn(0x7faa70099c40 msgr2=0x7faa7012e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:50.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.995+0000 7fb8308af700 1 -- 172.21.15.156:0/736014145 shutdown_connections 2023-09-30T22:21:50.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.995+0000 7fb8308af700 1 --2- 172.21.15.156:0/736014145 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb82c134120 0x7fb82c123180 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.995+0000 7fb8308af700 1 --2- 172.21.15.156:0/736014145 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb82c0a0a70 0x7fb82c122700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.995+0000 7fb8308af700 1 --2- 172.21.15.156:0/736014145 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb82c0a1380 0x7fb82c122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.995+0000 7fb8308af700 1 -- 172.21.15.156:0/736014145 >> 172.21.15.156:0/736014145 conn(0x7fb82c0a6610 msgr2=0x7fb82c0a5050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:50.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.995+0000 7faa74b75700 1 -- 172.21.15.156:0/652570688 shutdown_connections 2023-09-30T22:21:50.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.995+0000 7fb8308af700 1 -- 172.21.15.156:0/736014145 shutdown_connections 2023-09-30T22:21:50.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.995+0000 7fb8308af700 1 -- 172.21.15.156:0/736014145 wait complete. 2023-09-30T22:21:50.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:50.995+0000 7faa74b75700 1 -- 172.21.15.156:0/652570688 wait complete. 2023-09-30T22:21:51.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:51.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:51.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.040+0000 7f9aedbf3700 1 Processor -- start 2023-09-30T22:21:51.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.040+0000 7f9aedbf3700 1 -- start start 2023-09-30T22:21:51.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.041+0000 7f9aedbf3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9ae80a2e10 0x7f9ae8138f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:51.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.041+0000 7f9aedbf3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ae80a1630 0x7f9ae813b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:51.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.041+0000 7f9aedbf3700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae80a1e60 con 0x7f9ae80a0b50 2023-09-30T22:21:51.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.041+0000 7f9aedbf3700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae809aa00 con 0x7f9ae80a2e10 2023-09-30T22:21:51.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.041+0000 7f9aedbf3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae80a2340 con 0x7f9ae80a1630 2023-09-30T22:21:51.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.041+0000 7f9ae6ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9ae80a2e10 0x7f9ae8138f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:51.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.041+0000 7f9ae7fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ae80a1630 0x7f9ae813b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:51.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.041+0000 7f9ae7fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ae80a1630 0x7f9ae813b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45290/0 (socket says 172.21.15.156:45290) 2023-09-30T22:21:51.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.041+0000 7f9ae6ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9ae80a2e10 0x7f9ae8138f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33502/0 (socket says 172.21.15.156:33502) 2023-09-30T22:21:51.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.041+0000 7f9ae7fff700 1 -- 172.21.15.156:0/17421679 learned_addr learned my addr 172.21.15.156:0/17421679 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:51.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.041+0000 7f9ae77fe700 1 --1- 172.21.15.156:0/17421679 >> v1:172.21.15.156:6789/0 conn(0x7f9ae80a0b50 0x7f9ae80a0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45260/0 (socket says 172.21.15.156:45260) 2023-09-30T22:21:51.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.041+0000 7f9ae7fff700 1 -- 172.21.15.156:0/17421679 >> v2:172.21.15.156:3300/0 conn(0x7f9ae80a2e10 msgr2=0x7f9ae8138f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:51.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.041+0000 7f9ae7fff700 1 --2- 172.21.15.156:0/17421679 >> v2:172.21.15.156:3300/0 conn(0x7f9ae80a2e10 0x7f9ae8138f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.041+0000 7f9ae7fff700 1 -- 172.21.15.156:0/17421679 >> v1:172.21.15.156:6789/0 conn(0x7f9ae80a0b50 legacy=0x7f9ae80a0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:51.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.041+0000 7f9ae7fff700 1 -- 172.21.15.156:0/17421679 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae809a5b0 con 0x7f9ae80a1630 2023-09-30T22:21:51.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.041+0000 7f9ae67fc700 1 -- 172.21.15.156:0/17421679 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3643822523 0 0) 0x7f9ae80a1e60 con 0x7f9ae80a0b50 2023-09-30T22:21:51.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.041+0000 7f9ae6ffd700 1 --2- 172.21.15.156:0/17421679 >> v2:172.21.15.156:3300/0 conn(0x7f9ae80a2e10 0x7f9ae8138f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:51.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.041+0000 7f9ae7fff700 1 --2- 172.21.15.156:0/17421679 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ae80a1630 0x7f9ae813b470 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0009e50 tx=0x7f9ae000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49306187e9e61afc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:51.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.041+0000 7f9ae67fc700 1 -- 172.21.15.156:0/17421679 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae000e070 con 0x7f9ae80a1630 2023-09-30T22:21:51.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.042+0000 7f9ae67fc700 1 -- 172.21.15.156:0/17421679 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae000b910 con 0x7f9ae80a1630 2023-09-30T22:21:51.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.042+0000 7f9ae67fc700 1 -- 172.21.15.156:0/17421679 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae000bcc0 con 0x7f9ae80a1630 2023-09-30T22:21:51.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.042+0000 7f9aedbf3700 1 -- 172.21.15.156:0/17421679 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ae80a1630 msgr2=0x7f9ae813b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:51.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.042+0000 7f9aedbf3700 1 --2- 172.21.15.156:0/17421679 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ae80a1630 0x7f9ae813b470 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0009e50 tx=0x7f9ae000b330 comp rx=0 tx=0).stop 2023-09-30T22:21:51.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.042+0000 7f9aedbf3700 1 -- 172.21.15.156:0/17421679 shutdown_connections 2023-09-30T22:21:51.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.042+0000 7f9aedbf3700 1 --2- 172.21.15.156:0/17421679 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ae80a1630 0x7f9ae813b470 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.042+0000 7f9aedbf3700 1 --2- 172.21.15.156:0/17421679 >> v2:172.21.15.156:3300/0 conn(0x7f9ae80a2e10 0x7f9ae8138f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.042+0000 7f9aedbf3700 1 -- 172.21.15.156:0/17421679 >> 172.21.15.156:0/17421679 conn(0x7f9ae806c780 msgr2=0x7f9ae806cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:51.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.042+0000 7f9aedbf3700 1 -- 172.21.15.156:0/17421679 shutdown_connections 2023-09-30T22:21:51.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.042+0000 7f9aedbf3700 1 -- 172.21.15.156:0/17421679 wait complete. 2023-09-30T22:21:51.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.043+0000 7f9aedbf3700 1 Processor -- start 2023-09-30T22:21:51.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.043+0000 7f9aedbf3700 1 -- start start 2023-09-30T22:21:51.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.044+0000 7f9aedbf3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ae80a0b50 0x7f9ae81207f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:51.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.044+0000 7f9aedbf3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ae80a1630 0x7f9ae8120d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:51.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.044+0000 7f9aedbf3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ae80a2e10 0x7f9ae81c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:51.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.044+0000 7f9aedbf3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae8134570 con 0x7f9ae80a2e10 2023-09-30T22:21:51.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.044+0000 7f9aedbf3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae809c730 con 0x7f9ae80a0b50 2023-09-30T22:21:51.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.044+0000 7f9aedbf3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae8123800 con 0x7f9ae80a1630 2023-09-30T22:21:51.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.044+0000 7f9ae77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ae80a0b50 0x7f9ae81207f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:51.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.044+0000 7f9ae6ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ae80a1630 0x7f9ae8120d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:51.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.044+0000 7f9ae77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ae80a0b50 0x7f9ae81207f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53514/0 (socket says 172.21.15.156:53514) 2023-09-30T22:21:51.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.044+0000 7f9ae77fe700 1 -- 172.21.15.156:0/3330971027 learned_addr learned my addr 172.21.15.156:0/3330971027 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:51.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.044+0000 7f9ae7fff700 1 --2- 172.21.15.156:0/3330971027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ae80a2e10 0x7f9ae81c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:51.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.044+0000 7f9ae7fff700 1 -- 172.21.15.156:0/3330971027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ae80a1630 msgr2=0x7f9ae8120d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:51.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.044+0000 7f9ae7fff700 1 --2- 172.21.15.156:0/3330971027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ae80a1630 0x7f9ae8120d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.044+0000 7f9ae7fff700 1 -- 172.21.15.156:0/3330971027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ae80a0b50 msgr2=0x7f9ae81207f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:51.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.044+0000 7f9ae7fff700 1 --2- 172.21.15.156:0/3330971027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ae80a0b50 0x7f9ae81207f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.044+0000 7f9ae7fff700 1 -- 172.21.15.156:0/3330971027 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad80094a0 con 0x7f9ae80a2e10 2023-09-30T22:21:51.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.044+0000 7f9ae77fe700 1 --2- 172.21.15.156:0/3330971027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ae80a0b50 0x7f9ae81207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:51.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.044+0000 7f9ae6ffd700 1 --2- 172.21.15.156:0/3330971027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ae80a1630 0x7f9ae8120d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:51.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.044+0000 7f9ae7fff700 1 --2- 172.21.15.156:0/3330971027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ae80a2e10 0x7f9ae81c8150 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0015000 tx=0x7f9ae0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:51.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.044+0000 7f9acffff700 1 -- 172.21.15.156:0/3330971027 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0003ea0 con 0x7f9ae80a2e10 2023-09-30T22:21:51.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.044+0000 7f9acffff700 1 -- 172.21.15.156:0/3330971027 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae00048e0 con 0x7f9ae80a2e10 2023-09-30T22:21:51.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.044+0000 7f9acffff700 1 -- 172.21.15.156:0/3330971027 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae001c680 con 0x7f9ae80a2e10 2023-09-30T22:21:51.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.044+0000 7f9aedbf3700 1 -- 172.21.15.156:0/3330971027 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae0009b30 con 0x7f9ae80a2e10 2023-09-30T22:21:51.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.044+0000 7f9aedbf3700 1 -- 172.21.15.156:0/3330971027 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae81201f0 con 0x7f9ae80a2e10 2023-09-30T22:21:51.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.045+0000 7f9acffff700 1 -- 172.21.15.156:0/3330971027 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9ae001c7e0 con 0x7f9ae80a2e10 2023-09-30T22:21:51.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.045+0000 7f9aedbf3700 1 -- 172.21.15.156:0/3330971027 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae81201f0 con 0x7f9ae80a2e10 2023-09-30T22:21:51.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.045+0000 7f9acffff700 1 -- 172.21.15.156:0/3330971027 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9ae0040be0 con 0x7f9ae80a2e10 2023-09-30T22:21:51.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.050+0000 7f9acffff700 1 -- 172.21.15.156:0/3330971027 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9ae81201f0 con 0x7f9ae80a2e10 2023-09-30T22:21:51.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.233+0000 7f9aedbf3700 1 -- 172.21.15.156:0/3330971027 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9ae81201f0 con 0x7f9ae80a2e10 2023-09-30T22:21:51.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.234+0000 7f9acffff700 1 -- 172.21.15.156:0/3330971027 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9ae81201f0 con 0x7f9ae80a2e10 2023-09-30T22:21:51.234 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:51.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.236+0000 7f9aedbf3700 1 -- 172.21.15.156:0/3330971027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ae80a2e10 msgr2=0x7f9ae81c8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:51.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.236+0000 7f9aedbf3700 1 --2- 172.21.15.156:0/3330971027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ae80a2e10 0x7f9ae81c8150 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0015000 tx=0x7f9ae0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.236+0000 7f9aedbf3700 1 -- 172.21.15.156:0/3330971027 shutdown_connections 2023-09-30T22:21:51.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.236+0000 7f9aedbf3700 1 --2- 172.21.15.156:0/3330971027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ae80a2e10 0x7f9ae81c8150 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.236+0000 7f9aedbf3700 1 --2- 172.21.15.156:0/3330971027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ae80a0b50 0x7f9ae81207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.236+0000 7f9aedbf3700 1 --2- 172.21.15.156:0/3330971027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ae80a1630 0x7f9ae8120d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.236+0000 7f9aedbf3700 1 -- 172.21.15.156:0/3330971027 >> 172.21.15.156:0/3330971027 conn(0x7f9ae806c780 msgr2=0x7f9ae81b9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:51.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.236+0000 7f9aedbf3700 1 -- 172.21.15.156:0/3330971027 shutdown_connections 2023-09-30T22:21:51.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.236+0000 7f9aedbf3700 1 -- 172.21.15.156:0/3330971027 wait complete. 2023-09-30T22:21:51.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:51.743 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:51.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.869+0000 7f5e0018c700 1 Processor -- start 2023-09-30T22:21:51.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.869+0000 7f5e0018c700 1 -- start start 2023-09-30T22:21:51.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.870+0000 7f5e0018c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5df8133ad0 0x7f5df8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:51.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.870+0000 7f5e0018c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5df81300a0 0x7f5df81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:51.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.870+0000 7f5e0018c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5df81309f0 0x7f5df813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:51.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.870+0000 7f5e0018c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df806b2d0 con 0x7f5df81300a0 2023-09-30T22:21:51.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.870+0000 7f5e0018c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df8133610 con 0x7f5df81309f0 2023-09-30T22:21:51.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.870+0000 7f5e0018c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5df809a500 con 0x7f5df8133ad0 2023-09-30T22:21:51.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.870+0000 7f5dfdf28700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5df8133ad0 0x7f5df8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:51.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.870+0000 7f5dfd727700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5df81300a0 0x7f5df81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:51.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.870+0000 7f5dfe729700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5df81309f0 0x7f5df813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:51.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.870+0000 7f5dfd727700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5df81300a0 0x7f5df81304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54030/0 (socket says 172.21.15.156:54030) 2023-09-30T22:21:51.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.870+0000 7f5dfdf28700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5df8133ad0 0x7f5df8133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33252/0 (socket says 172.21.15.156:33252) 2023-09-30T22:21:51.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.870+0000 7f5dfd727700 1 -- 172.21.15.156:0/1083166576 learned_addr learned my addr 172.21.15.156:0/1083166576 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:51.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.870+0000 7f5dfe729700 1 --2- 172.21.15.156:0/1083166576 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5df81309f0 0x7f5df813a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:55538/0 (socket says 172.21.15.156:55538) 2023-09-30T22:21:51.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.870+0000 7f5dfe729700 1 -- 172.21.15.156:0/1083166576 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5df8133ad0 msgr2=0x7f5df8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:51.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.870+0000 7f5dfe729700 1 --2- 172.21.15.156:0/1083166576 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5df8133ad0 0x7f5df8133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.870+0000 7f5dfe729700 1 -- 172.21.15.156:0/1083166576 >> v2:172.21.15.156:3300/0 conn(0x7f5df81300a0 msgr2=0x7f5df81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:51.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.870+0000 7f5dfe729700 1 --2- 172.21.15.156:0/1083166576 >> v2:172.21.15.156:3300/0 conn(0x7f5df81300a0 0x7f5df81304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.870+0000 7f5dfe729700 1 -- 172.21.15.156:0/1083166576 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df81338b0 con 0x7f5df81309f0 2023-09-30T22:21:51.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.870+0000 7f5dfd727700 1 --2- 172.21.15.156:0/1083166576 >> v2:172.21.15.156:3300/0 conn(0x7f5df81300a0 0x7f5df81304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:51.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.871+0000 7f5dfe729700 1 --2- 172.21.15.156:0/1083166576 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5df81309f0 0x7f5df813a980 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009d90 tx=0x7f5df000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9b57e584e213ee3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:51.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.871+0000 7f5dfcf26700 1 -- 172.21.15.156:0/1083166576 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df000e070 con 0x7f5df81309f0 2023-09-30T22:21:51.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.871+0000 7f5dfcf26700 1 -- 172.21.15.156:0/1083166576 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df000bb20 con 0x7f5df81309f0 2023-09-30T22:21:51.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.871+0000 7f5dfcf26700 1 -- 172.21.15.156:0/1083166576 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df0012430 con 0x7f5df81309f0 2023-09-30T22:21:51.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.871+0000 7f5e0018c700 1 -- 172.21.15.156:0/1083166576 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5df81309f0 msgr2=0x7f5df813a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:51.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.871+0000 7f5e0018c700 1 --2- 172.21.15.156:0/1083166576 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5df81309f0 0x7f5df813a980 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009d90 tx=0x7f5df000b330 comp rx=0 tx=0).stop 2023-09-30T22:21:51.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.871+0000 7f5e0018c700 1 -- 172.21.15.156:0/1083166576 shutdown_connections 2023-09-30T22:21:51.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.871+0000 7f5e0018c700 1 --2- 172.21.15.156:0/1083166576 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5df81309f0 0x7f5df813a980 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.871+0000 7f5e0018c700 1 --2- 172.21.15.156:0/1083166576 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5df8133ad0 0x7f5df8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.871+0000 7f5e0018c700 1 --2- 172.21.15.156:0/1083166576 >> v2:172.21.15.156:3300/0 conn(0x7f5df81300a0 0x7f5df81304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.871+0000 7f5e0018c700 1 -- 172.21.15.156:0/1083166576 >> 172.21.15.156:0/1083166576 conn(0x7f5df8099c40 msgr2=0x7f5df80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:51.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.871+0000 7f5e0018c700 1 -- 172.21.15.156:0/1083166576 shutdown_connections 2023-09-30T22:21:51.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.871+0000 7f5e0018c700 1 -- 172.21.15.156:0/1083166576 wait complete. 2023-09-30T22:21:51.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.872+0000 7f5e0018c700 1 Processor -- start 2023-09-30T22:21:51.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.872+0000 7f5e0018c700 1 -- start start 2023-09-30T22:21:51.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.873+0000 7f5e0018c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5df81300a0 0x7f5df811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:51.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.873+0000 7f5e0018c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5df81309f0 0x7f5df811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:51.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.873+0000 7f5e0018c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5df8133ad0 0x7f5df811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:51.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.873+0000 7f5e0018c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df811f020 con 0x7f5df8133ad0 2023-09-30T22:21:51.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.873+0000 7f5e0018c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df812de80 con 0x7f5df81309f0 2023-09-30T22:21:51.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.873+0000 7f5e0018c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5df80a33e0 con 0x7f5df81300a0 2023-09-30T22:21:51.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.873+0000 7f5dfdf28700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5df81300a0 0x7f5df811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:51.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.873+0000 7f5dfd727700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5df81309f0 0x7f5df811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:51.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.873+0000 7f5dfdf28700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5df81300a0 0x7f5df811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33262/0 (socket says 172.21.15.156:33262) 2023-09-30T22:21:51.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.873+0000 7f5dfdf28700 1 -- 172.21.15.156:0/3486112809 learned_addr learned my addr 172.21.15.156:0/3486112809 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:51.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.873+0000 7f5dfe729700 1 --2- 172.21.15.156:0/3486112809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5df8133ad0 0x7f5df811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:51.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.873+0000 7f5dfe729700 1 -- 172.21.15.156:0/3486112809 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5df81300a0 msgr2=0x7f5df811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:51.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.873+0000 7f5dfe729700 1 --2- 172.21.15.156:0/3486112809 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5df81300a0 0x7f5df811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.873+0000 7f5dfe729700 1 -- 172.21.15.156:0/3486112809 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5df81309f0 msgr2=0x7f5df811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:51.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.873+0000 7f5dfe729700 1 --2- 172.21.15.156:0/3486112809 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5df81309f0 0x7f5df811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.873+0000 7f5dfe729700 1 -- 172.21.15.156:0/3486112809 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de8009550 con 0x7f5df8133ad0 2023-09-30T22:21:51.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.873+0000 7f5dfdf28700 1 --2- 172.21.15.156:0/3486112809 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5df81300a0 0x7f5df811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:51.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.873+0000 7f5dfd727700 1 --2- 172.21.15.156:0/3486112809 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5df81309f0 0x7f5df811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:51.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.873+0000 7f5dfe729700 1 --2- 172.21.15.156:0/3486112809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5df8133ad0 0x7f5df811e4c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f5df0016000 tx=0x7f5df0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:51.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.873+0000 7f5dee7fc700 1 -- 172.21.15.156:0/3486112809 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df0012430 con 0x7f5df8133ad0 2023-09-30T22:21:51.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.873+0000 7f5dee7fc700 1 -- 172.21.15.156:0/3486112809 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df0020070 con 0x7f5df8133ad0 2023-09-30T22:21:51.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.873+0000 7f5e0018c700 1 -- 172.21.15.156:0/3486112809 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df0009a70 con 0x7f5df8133ad0 2023-09-30T22:21:51.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.873+0000 7f5dee7fc700 1 -- 172.21.15.156:0/3486112809 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df0004280 con 0x7f5df8133ad0 2023-09-30T22:21:51.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.873+0000 7f5e0018c700 1 -- 172.21.15.156:0/3486112809 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df80717d0 con 0x7f5df8133ad0 2023-09-30T22:21:51.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.874+0000 7f5dee7fc700 1 -- 172.21.15.156:0/3486112809 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5df00043e0 con 0x7f5df8133ad0 2023-09-30T22:21:51.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.874+0000 7f5dee7fc700 1 -- 172.21.15.156:0/3486112809 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5df0022070 con 0x7f5df8133ad0 2023-09-30T22:21:51.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.874+0000 7f5e0018c700 1 -- 172.21.15.156:0/3486112809 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df804f2a0 con 0x7f5df8133ad0 2023-09-30T22:21:51.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:51.879+0000 7f5dee7fc700 1 -- 172.21.15.156:0/3486112809 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5df002c020 con 0x7f5df8133ad0 2023-09-30T22:21:52.011 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:52.011 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:52.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.069+0000 7f5e0018c700 1 -- 172.21.15.156:0/3486112809 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5df809d3a0 con 0x7f5df8133ad0 2023-09-30T22:21:52.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.069+0000 7f5dee7fc700 1 -- 172.21.15.156:0/3486112809 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5df0004690 con 0x7f5df8133ad0 2023-09-30T22:21:52.070 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:52.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.071+0000 7f5e0018c700 1 -- 172.21.15.156:0/3486112809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5df8133ad0 msgr2=0x7f5df811e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:52.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.071+0000 7f5e0018c700 1 --2- 172.21.15.156:0/3486112809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5df8133ad0 0x7f5df811e4c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f5df0016000 tx=0x7f5df0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.071+0000 7f5e0018c700 1 -- 172.21.15.156:0/3486112809 shutdown_connections 2023-09-30T22:21:52.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.071+0000 7f5e0018c700 1 --2- 172.21.15.156:0/3486112809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5df8133ad0 0x7f5df811e4c0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.071+0000 7f5e0018c700 1 --2- 172.21.15.156:0/3486112809 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5df81300a0 0x7f5df811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.071+0000 7f5e0018c700 1 --2- 172.21.15.156:0/3486112809 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5df81309f0 0x7f5df811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.071+0000 7f5e0018c700 1 -- 172.21.15.156:0/3486112809 >> 172.21.15.156:0/3486112809 conn(0x7f5df8099c40 msgr2=0x7f5df8132b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:52.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.071+0000 7f5e0018c700 1 -- 172.21.15.156:0/3486112809 shutdown_connections 2023-09-30T22:21:52.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.071+0000 7f5e0018c700 1 -- 172.21.15.156:0/3486112809 wait complete. 2023-09-30T22:21:52.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:52.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.146+0000 7fcf3da12700 1 Processor -- start 2023-09-30T22:21:52.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.146+0000 7fcf3da12700 1 -- start start 2023-09-30T22:21:52.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.146+0000 7ff7419c0700 1 Processor -- start 2023-09-30T22:21:52.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.146+0000 7ff7419c0700 1 -- start start 2023-09-30T22:21:52.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.146+0000 7fcf3da12700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf38134140 0x7fcf38138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:52.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.146+0000 7fcf3da12700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcf38134570 0x7fcf3813b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:52.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.146+0000 7fcf3da12700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf3809b110 con 0x7fcf3809ad40 2023-09-30T22:21:52.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.146+0000 7fcf3da12700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf380a3b60 con 0x7fcf38134570 2023-09-30T22:21:52.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.146+0000 7fcf3da12700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf380a1a80 con 0x7fcf38134140 2023-09-30T22:21:52.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.147+0000 7ff7419c0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff73c133ad0 0x7ff73c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:52.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.147+0000 7ff7419c0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff73c1300a0 0x7ff73c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:52.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.147+0000 7ff7419c0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff73c1309f0 0x7ff73c13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:52.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.147+0000 7ff7419c0700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff73c06b2d0 con 0x7ff73c1309f0 2023-09-30T22:21:52.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.147+0000 7ff7419c0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c133610 con 0x7ff73c133ad0 2023-09-30T22:21:52.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.147+0000 7ff7419c0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c09a500 con 0x7ff73c1300a0 2023-09-30T22:21:52.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.147+0000 7ff73a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff73c1300a0 0x7ff73c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:52.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.147+0000 7ff73a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff73c1300a0 0x7ff73c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33280/0 (socket says 172.21.15.156:33280) 2023-09-30T22:21:52.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.147+0000 7ff73a7fc700 1 -- 172.21.15.156:0/564795557 learned_addr learned my addr 172.21.15.156:0/564795557 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:52.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.147+0000 7fcf36ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fcf3809ad40 0x7fcf38133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40534/0 (socket says 172.21.15.156:40534) 2023-09-30T22:21:52.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.147+0000 7fcf36ffd700 1 -- 172.21.15.156:0/2386767241 learned_addr learned my addr 172.21.15.156:0/2386767241 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:52.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.147+0000 7ff73b7fe700 1 --2- 172.21.15.156:0/564795557 >> v2:172.21.15.156:3300/0 conn(0x7ff73c1309f0 0x7ff73c13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:52.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.147+0000 7fcf367fc700 1 --2- 172.21.15.156:0/2386767241 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf38134140 0x7fcf38138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:52.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.147+0000 7ff73affd700 1 --2- 172.21.15.156:0/564795557 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff73c133ad0 0x7ff73c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:52.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.147+0000 7fcf377fe700 1 --2- 172.21.15.156:0/2386767241 >> v2:172.21.15.156:3300/0 conn(0x7fcf38134570 0x7fcf3813b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:52.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.147+0000 7ff73a7fc700 1 -- 172.21.15.156:0/564795557 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff73c133ad0 msgr2=0x7ff73c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:52.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.147+0000 7ff73a7fc700 1 --2- 172.21.15.156:0/564795557 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff73c133ad0 0x7ff73c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.147+0000 7ff73a7fc700 1 -- 172.21.15.156:0/564795557 >> v2:172.21.15.156:3300/0 conn(0x7ff73c1309f0 msgr2=0x7ff73c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:52.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.147+0000 7ff73a7fc700 1 --2- 172.21.15.156:0/564795557 >> v2:172.21.15.156:3300/0 conn(0x7ff73c1309f0 0x7ff73c13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.147+0000 7ff73a7fc700 1 -- 172.21.15.156:0/564795557 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff73c1338b0 con 0x7ff73c1300a0 2023-09-30T22:21:52.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.147+0000 7fcf35ffb700 1 -- 172.21.15.156:0/2386767241 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320551133 0 0) 0x7fcf3809b110 con 0x7fcf3809ad40 2023-09-30T22:21:52.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.147+0000 7fcf35ffb700 1 -- 172.21.15.156:0/2386767241 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf200035b0 con 0x7fcf3809ad40 2023-09-30T22:21:52.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.147+0000 7ff73a7fc700 1 --2- 172.21.15.156:0/564795557 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff73c1300a0 0x7ff73c1304b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff7300098f0 tx=0x7ff730009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b237e1aa1cab2b5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:52.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.147+0000 7fcf377fe700 1 -- 172.21.15.156:0/2386767241 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf38134140 msgr2=0x7fcf38138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:52.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.147+0000 7fcf377fe700 1 --2- 172.21.15.156:0/2386767241 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf38134140 0x7fcf38138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.147+0000 7fcf377fe700 1 -- 172.21.15.156:0/2386767241 >> v1:172.21.15.156:6789/0 conn(0x7fcf3809ad40 legacy=0x7fcf38133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:52.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.147+0000 7fcf377fe700 1 -- 172.21.15.156:0/2386767241 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf380a2fa0 con 0x7fcf38134570 2023-09-30T22:21:52.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.147+0000 7fcf377fe700 1 --2- 172.21.15.156:0/2386767241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf38134570 0x7fcf3813b3d0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fcf30009d90 tx=0x7fcf3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2760fe7f04453967 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:52.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.148+0000 7ff739ffb700 1 -- 172.21.15.156:0/564795557 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff730011830 con 0x7ff73c1300a0 2023-09-30T22:21:52.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.148+0000 7ff739ffb700 1 -- 172.21.15.156:0/564795557 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff730011990 con 0x7ff73c1300a0 2023-09-30T22:21:52.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.148+0000 7ff739ffb700 1 -- 172.21.15.156:0/564795557 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff730011d20 con 0x7ff73c1300a0 2023-09-30T22:21:52.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.148+0000 7fcf35ffb700 1 -- 172.21.15.156:0/2386767241 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3000e070 con 0x7fcf38134570 2023-09-30T22:21:52.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.148+0000 7fcf35ffb700 1 -- 172.21.15.156:0/2386767241 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3000bb20 con 0x7fcf38134570 2023-09-30T22:21:52.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.148+0000 7fcf35ffb700 1 -- 172.21.15.156:0/2386767241 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf30012430 con 0x7fcf38134570 2023-09-30T22:21:52.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.148+0000 7ff7419c0700 1 -- 172.21.15.156:0/564795557 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff73c1300a0 msgr2=0x7ff73c1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:52.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.148+0000 7ff7419c0700 1 --2- 172.21.15.156:0/564795557 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff73c1300a0 0x7ff73c1304b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff7300098f0 tx=0x7ff730009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:52.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.148+0000 7fcf3da12700 1 -- 172.21.15.156:0/2386767241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf38134570 msgr2=0x7fcf3813b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:52.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.148+0000 7fcf3da12700 1 --2- 172.21.15.156:0/2386767241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf38134570 0x7fcf3813b3d0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fcf30009d90 tx=0x7fcf3000b330 comp rx=0 tx=0).stop 2023-09-30T22:21:52.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.148+0000 7ff7419c0700 1 -- 172.21.15.156:0/564795557 shutdown_connections 2023-09-30T22:21:52.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.148+0000 7ff7419c0700 1 --2- 172.21.15.156:0/564795557 >> v2:172.21.15.156:3300/0 conn(0x7ff73c1309f0 0x7ff73c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.148+0000 7ff7419c0700 1 --2- 172.21.15.156:0/564795557 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff73c133ad0 0x7ff73c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.148+0000 7ff7419c0700 1 --2- 172.21.15.156:0/564795557 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff73c1300a0 0x7ff73c1304b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.148+0000 7ff7419c0700 1 -- 172.21.15.156:0/564795557 >> 172.21.15.156:0/564795557 conn(0x7ff73c099c40 msgr2=0x7ff73c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:52.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.148+0000 7fcf3da12700 1 -- 172.21.15.156:0/2386767241 shutdown_connections 2023-09-30T22:21:52.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.148+0000 7fcf3da12700 1 --2- 172.21.15.156:0/2386767241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf38134570 0x7fcf3813b3d0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.148+0000 7fcf3da12700 1 --2- 172.21.15.156:0/2386767241 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf38134140 0x7fcf38138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.148+0000 7fcf3da12700 1 -- 172.21.15.156:0/2386767241 >> 172.21.15.156:0/2386767241 conn(0x7fcf38099c40 msgr2=0x7fcf3806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:52.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.148+0000 7ff7419c0700 1 -- 172.21.15.156:0/564795557 shutdown_connections 2023-09-30T22:21:52.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.148+0000 7ff7419c0700 1 -- 172.21.15.156:0/564795557 wait complete. 2023-09-30T22:21:52.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.148+0000 7fcf3da12700 1 -- 172.21.15.156:0/2386767241 shutdown_connections 2023-09-30T22:21:52.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.148+0000 7fcf3da12700 1 -- 172.21.15.156:0/2386767241 wait complete. 2023-09-30T22:21:52.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.150+0000 7ff7419c0700 1 Processor -- start 2023-09-30T22:21:52.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.150+0000 7fcf3da12700 1 Processor -- start 2023-09-30T22:21:52.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.150+0000 7fcf3da12700 1 -- start start 2023-09-30T22:21:52.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.150+0000 7ff7419c0700 1 -- start start 2023-09-30T22:21:52.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.150+0000 7ff7419c0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff73c1300a0 0x7ff73c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:52.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.150+0000 7fcf3da12700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf3809ad40 0x7fcf381393f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:52.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.150+0000 7ff7419c0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff73c1309f0 0x7ff73c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:52.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.150+0000 7fcf3da12700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf38134140 0x7fcf38139930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:52.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.150+0000 7ff7419c0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff73c133ad0 0x7ff73c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:52.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.150+0000 7ff7419c0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c1202d0 con 0x7ff73c133ad0 2023-09-30T22:21:52.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.150+0000 7ff7419c0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c1210b0 con 0x7ff73c1300a0 2023-09-30T22:21:52.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.150+0000 7fcf3da12700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf38134570 0x7fcf38139e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:52.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.150+0000 7fcf3da12700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3811cf10 con 0x7fcf38134140 2023-09-30T22:21:52.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.150+0000 7fcf3da12700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3811ea10 con 0x7fcf38134570 2023-09-30T22:21:52.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.150+0000 7ff7419c0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c1204d0 con 0x7ff73c1309f0 2023-09-30T22:21:52.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.150+0000 7fcf3da12700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf380a4330 con 0x7fcf3809ad40 2023-09-30T22:21:52.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.150+0000 7fcf36ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf3809ad40 0x7fcf381393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:52.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.150+0000 7fcf36ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf3809ad40 0x7fcf381393f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33294/0 (socket says 172.21.15.156:33294) 2023-09-30T22:21:52.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.151+0000 7fcf36ffd700 1 -- 172.21.15.156:0/1254779639 learned_addr learned my addr 172.21.15.156:0/1254779639 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:52.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.150+0000 7ff73a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff73c1309f0 0x7ff73c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:52.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.150+0000 7ff73affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff73c1300a0 0x7ff73c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:52.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.150+0000 7ff73a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff73c1309f0 0x7ff73c11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33306/0 (socket says 172.21.15.156:33306) 2023-09-30T22:21:52.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.150+0000 7ff73a7fc700 1 -- 172.21.15.156:0/1600128176 learned_addr learned my addr 172.21.15.156:0/1600128176 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:52.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.151+0000 7fcf367fc700 1 --2- 172.21.15.156:0/1254779639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf38134140 0x7fcf38139930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:52.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.151+0000 7fcf377fe700 1 --2- 172.21.15.156:0/1254779639 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf38134570 0x7fcf38139e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:52.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.151+0000 7ff73b7fe700 1 --2- 172.21.15.156:0/1600128176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff73c133ad0 0x7ff73c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:52.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.151+0000 7ff73a7fc700 1 -- 172.21.15.156:0/1600128176 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff73c1300a0 msgr2=0x7ff73c11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:52.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.151+0000 7ff73a7fc700 1 --2- 172.21.15.156:0/1600128176 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff73c1300a0 0x7ff73c11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.151+0000 7ff73a7fc700 1 -- 172.21.15.156:0/1600128176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff73c133ad0 msgr2=0x7ff73c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:52.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.151+0000 7ff73a7fc700 1 --2- 172.21.15.156:0/1600128176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff73c133ad0 0x7ff73c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.151+0000 7ff73a7fc700 1 -- 172.21.15.156:0/1600128176 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff730009550 con 0x7ff73c1309f0 2023-09-30T22:21:52.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.151+0000 7fcf36ffd700 1 -- 172.21.15.156:0/1254779639 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf38134570 msgr2=0x7fcf38139e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:52.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.151+0000 7fcf36ffd700 1 --2- 172.21.15.156:0/1254779639 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf38134570 0x7fcf38139e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.151+0000 7fcf36ffd700 1 -- 172.21.15.156:0/1254779639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf38134140 msgr2=0x7fcf38139930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:52.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.151+0000 7fcf36ffd700 1 --2- 172.21.15.156:0/1254779639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf38134140 0x7fcf38139930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.151+0000 7fcf36ffd700 1 -- 172.21.15.156:0/1254779639 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf30009a70 con 0x7fcf3809ad40 2023-09-30T22:21:52.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.151+0000 7fcf367fc700 1 --2- 172.21.15.156:0/1254779639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf38134140 0x7fcf38139930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:52.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.151+0000 7fcf36ffd700 1 --2- 172.21.15.156:0/1254779639 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf3809ad40 0x7fcf381393f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fcf28001eb0 tx=0x7fcf2800c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:52.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.151+0000 7ff73a7fc700 1 --2- 172.21.15.156:0/1600128176 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff73c1309f0 0x7ff73c11df80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff730014040 tx=0x7ff730004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:52.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.151+0000 7fcf1ffff700 1 -- 172.21.15.156:0/1254779639 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf28005d70 con 0x7fcf3809ad40 2023-09-30T22:21:52.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.151+0000 7fcf1ffff700 1 -- 172.21.15.156:0/1254779639 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf280070d0 con 0x7fcf3809ad40 2023-09-30T22:21:52.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.151+0000 7fcf1ffff700 1 -- 172.21.15.156:0/1254779639 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf28007460 con 0x7fcf3809ad40 2023-09-30T22:21:52.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.151+0000 7ff723fff700 1 -- 172.21.15.156:0/1600128176 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff730004450 con 0x7ff73c1309f0 2023-09-30T22:21:52.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.151+0000 7ff723fff700 1 -- 172.21.15.156:0/1600128176 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73001e070 con 0x7ff73c1309f0 2023-09-30T22:21:52.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.151+0000 7ff7419c0700 1 -- 172.21.15.156:0/1600128176 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff73c0724a0 con 0x7ff73c1309f0 2023-09-30T22:21:52.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.151+0000 7ff723fff700 1 -- 172.21.15.156:0/1600128176 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7300038e0 con 0x7ff73c1309f0 2023-09-30T22:21:52.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.152+0000 7ff7419c0700 1 -- 172.21.15.156:0/1600128176 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff73c12fe10 con 0x7ff73c1309f0 2023-09-30T22:21:52.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.152+0000 7fcf3da12700 1 -- 172.21.15.156:0/1254779639 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf3809c7e0 con 0x7fcf3809ad40 2023-09-30T22:21:52.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.152+0000 7ff723fff700 1 -- 172.21.15.156:0/1600128176 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff730003a40 con 0x7ff73c1309f0 2023-09-30T22:21:52.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.152+0000 7fcf3da12700 1 -- 172.21.15.156:0/1254779639 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3813a7c0 con 0x7fcf3809ad40 2023-09-30T22:21:52.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.153+0000 7ff723fff700 1 -- 172.21.15.156:0/1600128176 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff730020070 con 0x7ff73c1309f0 2023-09-30T22:21:52.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.153+0000 7ff7419c0700 1 -- 172.21.15.156:0/1600128176 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff73c09e840 con 0x7ff73c1309f0 2023-09-30T22:21:52.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.153+0000 7fcf1ffff700 1 -- 172.21.15.156:0/1254779639 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf280075c0 con 0x7fcf3809ad40 2023-09-30T22:21:52.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.153+0000 7fcf1ffff700 1 -- 172.21.15.156:0/1254779639 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcf2803eac0 con 0x7fcf3809ad40 2023-09-30T22:21:52.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.153+0000 7fcf3da12700 1 -- 172.21.15.156:0/1254779639 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf381361e0 con 0x7fcf3809ad40 2023-09-30T22:21:52.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.157+0000 7ff723fff700 1 -- 172.21.15.156:0/1600128176 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff73002a080 con 0x7ff73c1309f0 2023-09-30T22:21:52.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.161+0000 7fcf1ffff700 1 -- 172.21.15.156:0/1254779639 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf28017080 con 0x7fcf3809ad40 2023-09-30T22:21:52.248 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:52.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.351+0000 7ff7419c0700 1 -- 172.21.15.156:0/1600128176 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff73c12dd00 con 0x7ff73c1309f0 2023-09-30T22:21:52.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.352+0000 7ff723fff700 1 -- 172.21.15.156:0/1600128176 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff730015020 con 0x7ff73c1309f0 2023-09-30T22:21:52.353 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:52.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.355+0000 7ff7419c0700 1 -- 172.21.15.156:0/1600128176 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff73c1309f0 msgr2=0x7ff73c11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:52.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.355+0000 7ff7419c0700 1 --2- 172.21.15.156:0/1600128176 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff73c1309f0 0x7ff73c11df80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff730014040 tx=0x7ff730004750 comp rx=0 tx=0).stop 2023-09-30T22:21:52.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.355+0000 7ff7419c0700 1 -- 172.21.15.156:0/1600128176 shutdown_connections 2023-09-30T22:21:52.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.355+0000 7ff7419c0700 1 --2- 172.21.15.156:0/1600128176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff73c133ad0 0x7ff73c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.355+0000 7ff7419c0700 1 --2- 172.21.15.156:0/1600128176 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff73c1300a0 0x7ff73c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.355+0000 7ff7419c0700 1 --2- 172.21.15.156:0/1600128176 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff73c1309f0 0x7ff73c11df80 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.355+0000 7ff7419c0700 1 -- 172.21.15.156:0/1600128176 >> 172.21.15.156:0/1600128176 conn(0x7ff73c099c40 msgr2=0x7ff73c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:52.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.355+0000 7ff7419c0700 1 -- 172.21.15.156:0/1600128176 shutdown_connections 2023-09-30T22:21:52.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.355+0000 7ff7419c0700 1 -- 172.21.15.156:0/1600128176 wait complete. 2023-09-30T22:21:52.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.360+0000 7fcf3da12700 1 -- 172.21.15.156:0/1254779639 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcf3811e850 con 0x7fcf3809ad40 2023-09-30T22:21:52.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.361+0000 7fcf1ffff700 1 -- 172.21.15.156:0/1254779639 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcf2800f260 con 0x7fcf3809ad40 2023-09-30T22:21:52.361 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:52.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.364+0000 7fcf3da12700 1 -- 172.21.15.156:0/1254779639 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf3809ad40 msgr2=0x7fcf381393f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:52.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.364+0000 7fcf3da12700 1 --2- 172.21.15.156:0/1254779639 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf3809ad40 0x7fcf381393f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fcf28001eb0 tx=0x7fcf2800c7b0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.364+0000 7fcf3da12700 1 -- 172.21.15.156:0/1254779639 shutdown_connections 2023-09-30T22:21:52.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.364+0000 7fcf3da12700 1 --2- 172.21.15.156:0/1254779639 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf38134570 0x7fcf38139e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.364+0000 7fcf3da12700 1 --2- 172.21.15.156:0/1254779639 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf3809ad40 0x7fcf381393f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.364+0000 7fcf3da12700 1 --2- 172.21.15.156:0/1254779639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf38134140 0x7fcf38139930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.364+0000 7fcf3da12700 1 -- 172.21.15.156:0/1254779639 >> 172.21.15.156:0/1254779639 conn(0x7fcf38099c40 msgr2=0x7fcf3813afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:52.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.365+0000 7fcf3da12700 1 -- 172.21.15.156:0/1254779639 shutdown_connections 2023-09-30T22:21:52.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.365+0000 7fcf3da12700 1 -- 172.21.15.156:0/1254779639 wait complete. 2023-09-30T22:21:52.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:52.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.375+0000 7fb437d3b700 1 Processor -- start 2023-09-30T22:21:52.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.376+0000 7fb437d3b700 1 -- start start 2023-09-30T22:21:52.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.376+0000 7fb437d3b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb430099eb0 0x7fb43009a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:52.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.376+0000 7fb437d3b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb43009a7c0 0x7fb430130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:52.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.376+0000 7fb437d3b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb430130890 0x7fb430130d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:52.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.376+0000 7fb437d3b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43009b930 con 0x7fb430099eb0 2023-09-30T22:21:52.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.376+0000 7fb437d3b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb430072410 con 0x7fb43009a7c0 2023-09-30T22:21:52.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.376+0000 7fb437d3b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb43009cd30 con 0x7fb430130890 2023-09-30T22:21:52.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.376+0000 7fb4362d8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb430130890 0x7fb430130d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:52.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.376+0000 7fb4352d6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb43009a7c0 0x7fb430130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:52.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.376+0000 7fb435ad7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb430099eb0 0x7fb43009a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:52.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.376+0000 7fb4362d8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb430130890 0x7fb430130d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33322/0 (socket says 172.21.15.156:33322) 2023-09-30T22:21:52.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.376+0000 7fb4352d6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb43009a7c0 0x7fb430130350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:55574/0 (socket says 172.21.15.156:55574) 2023-09-30T22:21:52.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.376+0000 7fb4362d8700 1 -- 172.21.15.156:0/2705410295 learned_addr learned my addr 172.21.15.156:0/2705410295 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:52.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.377+0000 7fb4362d8700 1 -- 172.21.15.156:0/2705410295 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb43009a7c0 msgr2=0x7fb430130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:52.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.377+0000 7fb4362d8700 1 --2- 172.21.15.156:0/2705410295 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb43009a7c0 0x7fb430130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.377+0000 7fb4362d8700 1 -- 172.21.15.156:0/2705410295 >> v2:172.21.15.156:3300/0 conn(0x7fb430099eb0 msgr2=0x7fb43009a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:52.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.377+0000 7fb4362d8700 1 --2- 172.21.15.156:0/2705410295 >> v2:172.21.15.156:3300/0 conn(0x7fb430099eb0 0x7fb43009a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.377+0000 7fb4362d8700 1 -- 172.21.15.156:0/2705410295 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb430099a60 con 0x7fb430130890 2023-09-30T22:21:52.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.377+0000 7fb435ad7700 1 --2- 172.21.15.156:0/2705410295 >> v2:172.21.15.156:3300/0 conn(0x7fb430099eb0 0x7fb43009a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:52.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.377+0000 7fb4352d6700 1 --2- 172.21.15.156:0/2705410295 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb43009a7c0 0x7fb430130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:52.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.377+0000 7fb4362d8700 1 --2- 172.21.15.156:0/2705410295 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb430130890 0x7fb430130d00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb428009920 tx=0x7fb428009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=575dff645adda0c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:52.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.377+0000 7fb434ad5700 1 -- 172.21.15.156:0/2705410295 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb428011830 con 0x7fb430130890 2023-09-30T22:21:52.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.377+0000 7fb434ad5700 1 -- 172.21.15.156:0/2705410295 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb428011990 con 0x7fb430130890 2023-09-30T22:21:52.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.377+0000 7fb434ad5700 1 -- 172.21.15.156:0/2705410295 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb428011d20 con 0x7fb430130890 2023-09-30T22:21:52.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.378+0000 7fb437d3b700 1 -- 172.21.15.156:0/2705410295 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb430130890 msgr2=0x7fb430130d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:52.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.378+0000 7fb437d3b700 1 --2- 172.21.15.156:0/2705410295 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb430130890 0x7fb430130d00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb428009920 tx=0x7fb428009c30 comp rx=0 tx=0).stop 2023-09-30T22:21:52.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.378+0000 7fb437d3b700 1 -- 172.21.15.156:0/2705410295 shutdown_connections 2023-09-30T22:21:52.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.378+0000 7fb437d3b700 1 --2- 172.21.15.156:0/2705410295 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb430130890 0x7fb430130d00 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.378+0000 7fb437d3b700 1 --2- 172.21.15.156:0/2705410295 >> v2:172.21.15.156:3300/0 conn(0x7fb430099eb0 0x7fb43009a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.378+0000 7fb437d3b700 1 --2- 172.21.15.156:0/2705410295 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb43009a7c0 0x7fb430130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.378+0000 7fb437d3b700 1 -- 172.21.15.156:0/2705410295 >> 172.21.15.156:0/2705410295 conn(0x7fb4300a2980 msgr2=0x7fb4300a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:52.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.378+0000 7fb437d3b700 1 -- 172.21.15.156:0/2705410295 shutdown_connections 2023-09-30T22:21:52.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.378+0000 7fb437d3b700 1 -- 172.21.15.156:0/2705410295 wait complete. 2023-09-30T22:21:52.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.379+0000 7fb437d3b700 1 Processor -- start 2023-09-30T22:21:52.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.379+0000 7fb437d3b700 1 -- start start 2023-09-30T22:21:52.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.379+0000 7fb437d3b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb430099eb0 0x7fb43011fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:52.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.379+0000 7fb437d3b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb43009a7c0 0x7fb430120220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:52.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.379+0000 7fb437d3b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb430130890 0x7fb430120760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:52.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.379+0000 7fb437d3b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb430122f00 con 0x7fb430099eb0 2023-09-30T22:21:52.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.379+0000 7fb437d3b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4301218f0 con 0x7fb430130890 2023-09-30T22:21:52.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.379+0000 7fb437d3b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4300a15a0 con 0x7fb43009a7c0 2023-09-30T22:21:52.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.379+0000 7fb4352d6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb43009a7c0 0x7fb430120220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:52.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.379+0000 7fb435ad7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb430099eb0 0x7fb43011fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:52.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.379+0000 7fb4362d8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb430130890 0x7fb430120760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:52.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.379+0000 7fb4352d6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb43009a7c0 0x7fb430120220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33330/0 (socket says 172.21.15.156:33330) 2023-09-30T22:21:52.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:52.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.379+0000 7fb435ad7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb430099eb0 0x7fb43011fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54102/0 (socket says 172.21.15.156:54102) 2023-09-30T22:21:52.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.379+0000 7fb4352d6700 1 -- 172.21.15.156:0/765403817 learned_addr learned my addr 172.21.15.156:0/765403817 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:52.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.380+0000 7fb4352d6700 1 -- 172.21.15.156:0/765403817 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb430130890 msgr2=0x7fb430120760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:52.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.380+0000 7fb4352d6700 1 --2- 172.21.15.156:0/765403817 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb430130890 0x7fb430120760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.380+0000 7fb4352d6700 1 -- 172.21.15.156:0/765403817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb430099eb0 msgr2=0x7fb43011fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:52.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.380+0000 7fb4352d6700 1 --2- 172.21.15.156:0/765403817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb430099eb0 0x7fb43011fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.380+0000 7fb4352d6700 1 -- 172.21.15.156:0/765403817 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb42000bc80 con 0x7fb43009a7c0 2023-09-30T22:21:52.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.380+0000 7fb435ad7700 1 --2- 172.21.15.156:0/765403817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb430099eb0 0x7fb43011fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:52.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.380+0000 7fb4362d8700 1 --2- 172.21.15.156:0/765403817 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb430130890 0x7fb430120760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:52.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.380+0000 7fb4352d6700 1 --2- 172.21.15.156:0/765403817 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb43009a7c0 0x7fb430120220 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb42400ebb0 tx=0x7fb42400eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:52.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.380+0000 7fb42e7fc700 1 -- 172.21.15.156:0/765403817 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42400c850 con 0x7fb43009a7c0 2023-09-30T22:21:52.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.380+0000 7fb42e7fc700 1 -- 172.21.15.156:0/765403817 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42400c9b0 con 0x7fb43009a7c0 2023-09-30T22:21:52.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.380+0000 7fb437d3b700 1 -- 172.21.15.156:0/765403817 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4240094a0 con 0x7fb43009a7c0 2023-09-30T22:21:52.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.380+0000 7fb42e7fc700 1 -- 172.21.15.156:0/765403817 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42400cd40 con 0x7fb43009a7c0 2023-09-30T22:21:52.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.380+0000 7fb437d3b700 1 -- 172.21.15.156:0/765403817 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb428009550 con 0x7fb43009a7c0 2023-09-30T22:21:52.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.381+0000 7fb437d3b700 1 -- 172.21.15.156:0/765403817 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43004f2a0 con 0x7fb43009a7c0 2023-09-30T22:21:52.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.381+0000 7fb42e7fc700 1 -- 172.21.15.156:0/765403817 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb424013470 con 0x7fb43009a7c0 2023-09-30T22:21:52.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.382+0000 7fb42e7fc700 1 -- 172.21.15.156:0/765403817 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb42403ff00 con 0x7fb43009a7c0 2023-09-30T22:21:52.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.386+0000 7fb42e7fc700 1 -- 172.21.15.156:0/765403817 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb424011760 con 0x7fb43009a7c0 2023-09-30T22:21:52.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.571+0000 7fb437d3b700 1 -- 172.21.15.156:0/765403817 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb43006bce0 con 0x7fb43009a7c0 2023-09-30T22:21:52.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.571+0000 7fb42e7fc700 1 -- 172.21.15.156:0/765403817 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb424021020 con 0x7fb43009a7c0 2023-09-30T22:21:52.572 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:52.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.573+0000 7fb437d3b700 1 -- 172.21.15.156:0/765403817 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb43009a7c0 msgr2=0x7fb430120220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:52.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.573+0000 7fb437d3b700 1 --2- 172.21.15.156:0/765403817 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb43009a7c0 0x7fb430120220 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb42400ebb0 tx=0x7fb42400eec0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.573+0000 7fb437d3b700 1 -- 172.21.15.156:0/765403817 shutdown_connections 2023-09-30T22:21:52.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.573+0000 7fb437d3b700 1 --2- 172.21.15.156:0/765403817 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb430130890 0x7fb430120760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.573+0000 7fb437d3b700 1 --2- 172.21.15.156:0/765403817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb430099eb0 0x7fb43011fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.573+0000 7fb437d3b700 1 --2- 172.21.15.156:0/765403817 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb43009a7c0 0x7fb430120220 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.573+0000 7fb437d3b700 1 -- 172.21.15.156:0/765403817 >> 172.21.15.156:0/765403817 conn(0x7fb4300a2980 msgr2=0x7fb43012f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:52.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.573+0000 7fb437d3b700 1 -- 172.21.15.156:0/765403817 shutdown_connections 2023-09-30T22:21:52.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:52.573+0000 7fb437d3b700 1 -- 172.21.15.156:0/765403817 wait complete. 2023-09-30T22:21:52.586 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:53.086 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:53.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.210+0000 7ffbf204f700 1 Processor -- start 2023-09-30T22:21:53.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.210+0000 7ffbf204f700 1 -- start start 2023-09-30T22:21:53.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.210+0000 7ffbf204f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffbec0a0a70 0x7ffbec0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.210+0000 7ffbf204f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffbec134120 0x7ffbec13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.210+0000 7ffbf204f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbec09dc00 con 0x7ffbec0a1380 2023-09-30T22:21:53.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.210+0000 7ffbf204f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbec09ea90 con 0x7ffbec134120 2023-09-30T22:21:53.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.210+0000 7ffbf204f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbec09dec0 con 0x7ffbec0a0a70 2023-09-30T22:21:53.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.210+0000 7ffbebfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffbec134120 0x7ffbec13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.210+0000 7ffbeb7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffbec0a0a70 0x7ffbec0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.210+0000 7ffbeaffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ffbec0a1380 0x7ffbec133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40536/0 (socket says 172.21.15.156:40536) 2023-09-30T22:21:53.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.210+0000 7ffbeaffd700 1 -- 172.21.15.156:0/3441129826 learned_addr learned my addr 172.21.15.156:0/3441129826 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:53.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.211+0000 7ffbea7fc700 1 -- 172.21.15.156:0/3441129826 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3415943315 0 0) 0x7ffbec09dc00 con 0x7ffbec0a1380 2023-09-30T22:21:53.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.211+0000 7ffbeb7fe700 1 -- 172.21.15.156:0/3441129826 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffbec134120 msgr2=0x7ffbec13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:53.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.211+0000 7ffbeb7fe700 1 --2- 172.21.15.156:0/3441129826 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffbec134120 0x7ffbec13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.211+0000 7ffbeb7fe700 1 -- 172.21.15.156:0/3441129826 >> v1:172.21.15.156:6789/0 conn(0x7ffbec0a1380 legacy=0x7ffbec133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.211+0000 7ffbeb7fe700 1 -- 172.21.15.156:0/3441129826 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbec09e6a0 con 0x7ffbec0a0a70 2023-09-30T22:21:53.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.211+0000 7ffbebfff700 1 --2- 172.21.15.156:0/3441129826 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffbec134120 0x7ffbec13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:53.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.211+0000 7ffbeb7fe700 1 --2- 172.21.15.156:0/3441129826 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffbec0a0a70 0x7ffbec0a0e40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc009870 tx=0x7ffbdc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28c219b61b443db7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:53.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.211+0000 7ffbea7fc700 1 -- 172.21.15.156:0/3441129826 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc011830 con 0x7ffbec0a0a70 2023-09-30T22:21:53.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.211+0000 7ffbea7fc700 1 -- 172.21.15.156:0/3441129826 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbdc011990 con 0x7ffbec0a0a70 2023-09-30T22:21:53.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.211+0000 7ffbea7fc700 1 -- 172.21.15.156:0/3441129826 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc011d20 con 0x7ffbec0a0a70 2023-09-30T22:21:53.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.212+0000 7ffbf204f700 1 -- 172.21.15.156:0/3441129826 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffbec0a0a70 msgr2=0x7ffbec0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.212+0000 7ffbf204f700 1 --2- 172.21.15.156:0/3441129826 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffbec0a0a70 0x7ffbec0a0e40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc009870 tx=0x7ffbdc009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:53.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.212+0000 7ffbf204f700 1 -- 172.21.15.156:0/3441129826 shutdown_connections 2023-09-30T22:21:53.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.212+0000 7ffbf204f700 1 --2- 172.21.15.156:0/3441129826 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffbec134120 0x7ffbec13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.212+0000 7ffbf204f700 1 --2- 172.21.15.156:0/3441129826 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffbec0a0a70 0x7ffbec0a0e40 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.212+0000 7ffbf204f700 1 -- 172.21.15.156:0/3441129826 >> 172.21.15.156:0/3441129826 conn(0x7ffbec0a6610 msgr2=0x7ffbec0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:53.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.212+0000 7ffbf204f700 1 -- 172.21.15.156:0/3441129826 shutdown_connections 2023-09-30T22:21:53.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.212+0000 7ffbf204f700 1 -- 172.21.15.156:0/3441129826 wait complete. 2023-09-30T22:21:53.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.213+0000 7ffbf204f700 1 Processor -- start 2023-09-30T22:21:53.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.213+0000 7ffbf204f700 1 -- start start 2023-09-30T22:21:53.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.213+0000 7ffbf204f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffbec0a0a70 0x7ffbec122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.213+0000 7ffbf204f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffbec0a1380 0x7ffbec122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.213+0000 7ffbf204f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbec134120 0x7ffbec123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.213+0000 7ffbf204f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbec125920 con 0x7ffbec134120 2023-09-30T22:21:53.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.213+0000 7ffbf204f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbec124310 con 0x7ffbec0a1380 2023-09-30T22:21:53.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.213+0000 7ffbf204f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbec1332d0 con 0x7ffbec0a0a70 2023-09-30T22:21:53.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.213+0000 7ffbebfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbec134120 0x7ffbec123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.213+0000 7ffbeb7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffbec0a0a70 0x7ffbec122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.213+0000 7ffbeb7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffbec0a0a70 0x7ffbec122700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33342/0 (socket says 172.21.15.156:33342) 2023-09-30T22:21:53.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.213+0000 7ffbeb7fe700 1 -- 172.21.15.156:0/3340601507 learned_addr learned my addr 172.21.15.156:0/3340601507 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:53.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.213+0000 7ffbeaffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffbec0a1380 0x7ffbec122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.213+0000 7ffbebfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbec134120 0x7ffbec123180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54110/0 (socket says 172.21.15.156:54110) 2023-09-30T22:21:53.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.214+0000 7ffbeb7fe700 1 -- 172.21.15.156:0/3340601507 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffbec0a1380 msgr2=0x7ffbec122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.214+0000 7ffbeb7fe700 1 --2- 172.21.15.156:0/3340601507 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffbec0a1380 0x7ffbec122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.214+0000 7ffbeb7fe700 1 -- 172.21.15.156:0/3340601507 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbec134120 msgr2=0x7ffbec123180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.214+0000 7ffbeb7fe700 1 --2- 172.21.15.156:0/3340601507 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbec134120 0x7ffbec123180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.214+0000 7ffbeb7fe700 1 -- 172.21.15.156:0/3340601507 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe4009a70 con 0x7ffbec0a0a70 2023-09-30T22:21:53.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.214+0000 7ffbeb7fe700 1 --2- 172.21.15.156:0/3340601507 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffbec0a0a70 0x7ffbec122700 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc0090b0 tx=0x7ffbdc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:53.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.214+0000 7ffbd3fff700 1 -- 172.21.15.156:0/3340601507 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc0044d0 con 0x7ffbec0a0a70 2023-09-30T22:21:53.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.214+0000 7ffbd3fff700 1 -- 172.21.15.156:0/3340601507 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbdc01f070 con 0x7ffbec0a0a70 2023-09-30T22:21:53.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.214+0000 7ffbd3fff700 1 -- 172.21.15.156:0/3340601507 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc0038e0 con 0x7ffbec0a0a70 2023-09-30T22:21:53.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.214+0000 7ffbf204f700 1 -- 172.21.15.156:0/3340601507 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbdc0094a0 con 0x7ffbec0a0a70 2023-09-30T22:21:53.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.214+0000 7ffbf204f700 1 -- 172.21.15.156:0/3340601507 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbec0a03e0 con 0x7ffbec0a0a70 2023-09-30T22:21:53.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.214+0000 7ffbd3fff700 1 -- 172.21.15.156:0/3340601507 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffbdc003a40 con 0x7ffbec0a0a70 2023-09-30T22:21:53.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.215+0000 7ffbd3fff700 1 -- 172.21.15.156:0/3340601507 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffbdc021070 con 0x7ffbec0a0a70 2023-09-30T22:21:53.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.215+0000 7ffbf204f700 1 -- 172.21.15.156:0/3340601507 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbec04f2a0 con 0x7ffbec0a0a70 2023-09-30T22:21:53.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.220+0000 7ffbd3fff700 1 -- 172.21.15.156:0/3340601507 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffbdc01a430 con 0x7ffbec0a0a70 2023-09-30T22:21:53.373 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:53.386 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:53.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.406+0000 7ffbf204f700 1 -- 172.21.15.156:0/3340601507 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffbec072980 con 0x7ffbec0a0a70 2023-09-30T22:21:53.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.406+0000 7ffbd3fff700 1 -- 172.21.15.156:0/3340601507 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffbdc015020 con 0x7ffbec0a0a70 2023-09-30T22:21:53.407 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:53.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.408+0000 7ffbf204f700 1 -- 172.21.15.156:0/3340601507 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffbec0a0a70 msgr2=0x7ffbec122700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.408+0000 7ffbf204f700 1 --2- 172.21.15.156:0/3340601507 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffbec0a0a70 0x7ffbec122700 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc0090b0 tx=0x7ffbdc004750 comp rx=0 tx=0).stop 2023-09-30T22:21:53.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.408+0000 7ffbf204f700 1 -- 172.21.15.156:0/3340601507 shutdown_connections 2023-09-30T22:21:53.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.408+0000 7ffbf204f700 1 --2- 172.21.15.156:0/3340601507 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbec134120 0x7ffbec123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.408+0000 7ffbf204f700 1 --2- 172.21.15.156:0/3340601507 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffbec0a0a70 0x7ffbec122700 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.408+0000 7ffbf204f700 1 --2- 172.21.15.156:0/3340601507 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffbec0a1380 0x7ffbec122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.408+0000 7ffbf204f700 1 -- 172.21.15.156:0/3340601507 >> 172.21.15.156:0/3340601507 conn(0x7ffbec0a6610 msgr2=0x7ffbec09aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:53.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.409+0000 7ffbf204f700 1 -- 172.21.15.156:0/3340601507 shutdown_connections 2023-09-30T22:21:53.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.409+0000 7ffbf204f700 1 -- 172.21.15.156:0/3340601507 wait complete. 2023-09-30T22:21:53.424 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:53.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.501+0000 7f809891a700 1 Processor -- start 2023-09-30T22:21:53.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.501+0000 7f809891a700 1 -- start start 2023-09-30T22:21:53.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.501+0000 7f809891a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f80940a0a70 0x7f80940a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.501+0000 7f809891a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80940a1380 0x7f8094133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.501+0000 7f809891a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8094133f50 0x7f80941343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.501+0000 7f809891a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f809409e9d0 con 0x7f80940a0a70 2023-09-30T22:21:53.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.501+0000 7f809891a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809409dc00 con 0x7f8094133f50 2023-09-30T22:21:53.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.501+0000 7f809891a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f809409dec0 con 0x7f80940a1380 2023-09-30T22:21:53.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.501+0000 7f809259c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f80940a0a70 0x7f80940a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.501+0000 7f8091d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80940a1380 0x7f8094133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.501+0000 7f809259c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f80940a0a70 0x7f80940a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54124/0 (socket says 172.21.15.156:54124) 2023-09-30T22:21:53.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.501+0000 7f8091d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80940a1380 0x7f8094133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33356/0 (socket says 172.21.15.156:33356) 2023-09-30T22:21:53.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.501+0000 7f809259c700 1 -- 172.21.15.156:0/4260664824 learned_addr learned my addr 172.21.15.156:0/4260664824 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:53.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.501+0000 7f8092d9d700 1 --2- 172.21.15.156:0/4260664824 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8094133f50 0x7f80941343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.502+0000 7f8091d9b700 1 -- 172.21.15.156:0/4260664824 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8094133f50 msgr2=0x7f80941343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:53.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.502+0000 7f8091d9b700 1 --2- 172.21.15.156:0/4260664824 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8094133f50 0x7f80941343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.502+0000 7f8091d9b700 1 -- 172.21.15.156:0/4260664824 >> v2:172.21.15.156:3300/0 conn(0x7f80940a0a70 msgr2=0x7f80940a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:53.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.502+0000 7f8091d9b700 1 --2- 172.21.15.156:0/4260664824 >> v2:172.21.15.156:3300/0 conn(0x7f80940a0a70 0x7f80940a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.502+0000 7f8091d9b700 1 -- 172.21.15.156:0/4260664824 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809409e6a0 con 0x7f80940a1380 2023-09-30T22:21:53.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.502+0000 7f809259c700 1 --2- 172.21.15.156:0/4260664824 >> v2:172.21.15.156:3300/0 conn(0x7f80940a0a70 0x7f80940a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:53.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.502+0000 7f8091d9b700 1 --2- 172.21.15.156:0/4260664824 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80940a1380 0x7f8094133a10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8088009840 tx=0x7f8088009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29e3b0299ef6d6c3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:53.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.502+0000 7f809159a700 1 -- 172.21.15.156:0/4260664824 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8088011830 con 0x7f80940a1380 2023-09-30T22:21:53.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.502+0000 7f809159a700 1 -- 172.21.15.156:0/4260664824 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8088011990 con 0x7f80940a1380 2023-09-30T22:21:53.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.502+0000 7f809159a700 1 -- 172.21.15.156:0/4260664824 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8088011d20 con 0x7f80940a1380 2023-09-30T22:21:53.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.503+0000 7f809891a700 1 -- 172.21.15.156:0/4260664824 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80940a1380 msgr2=0x7f8094133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.503+0000 7f809891a700 1 --2- 172.21.15.156:0/4260664824 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80940a1380 0x7f8094133a10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8088009840 tx=0x7f8088009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:53.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.503+0000 7f809891a700 1 -- 172.21.15.156:0/4260664824 shutdown_connections 2023-09-30T22:21:53.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.503+0000 7f809891a700 1 --2- 172.21.15.156:0/4260664824 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8094133f50 0x7f80941343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.503+0000 7f809891a700 1 --2- 172.21.15.156:0/4260664824 >> v2:172.21.15.156:3300/0 conn(0x7f80940a0a70 0x7f80940a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.503+0000 7f809891a700 1 --2- 172.21.15.156:0/4260664824 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80940a1380 0x7f8094133a10 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.503+0000 7f809891a700 1 -- 172.21.15.156:0/4260664824 >> 172.21.15.156:0/4260664824 conn(0x7f80940a6610 msgr2=0x7f80940a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:53.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.503+0000 7f809891a700 1 -- 172.21.15.156:0/4260664824 shutdown_connections 2023-09-30T22:21:53.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.503+0000 7f809891a700 1 -- 172.21.15.156:0/4260664824 wait complete. 2023-09-30T22:21:53.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.504+0000 7f809891a700 1 Processor -- start 2023-09-30T22:21:53.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.504+0000 7f809891a700 1 -- start start 2023-09-30T22:21:53.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.504+0000 7f809891a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80940a0a70 0x7f809411f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.504+0000 7f809891a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f80940a1380 0x7f809411f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.504+0000 7f809891a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8094133f50 0x7f809411fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.504+0000 7f809891a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8094122af0 con 0x7f8094133f50 2023-09-30T22:21:53.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.504+0000 7f809891a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8094133a10 con 0x7f80940a1380 2023-09-30T22:21:53.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.504+0000 7f809891a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8094120fd0 con 0x7f80940a0a70 2023-09-30T22:21:53.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.505+0000 7f809259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80940a0a70 0x7f809411f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.505+0000 7f8092d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8094133f50 0x7f809411fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.505+0000 7f8091d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f80940a1380 0x7f809411f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.505+0000 7f809259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80940a0a70 0x7f809411f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33372/0 (socket says 172.21.15.156:33372) 2023-09-30T22:21:53.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.505+0000 7f809259c700 1 -- 172.21.15.156:0/77955114 learned_addr learned my addr 172.21.15.156:0/77955114 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:53.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.505+0000 7f8092d9d700 1 -- 172.21.15.156:0/77955114 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80940a0a70 msgr2=0x7f809411f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.505+0000 7f8092d9d700 1 --2- 172.21.15.156:0/77955114 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80940a0a70 0x7f809411f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.505+0000 7f8092d9d700 1 -- 172.21.15.156:0/77955114 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f80940a1380 msgr2=0x7f809411f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.505+0000 7f8092d9d700 1 --2- 172.21.15.156:0/77955114 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f80940a1380 0x7f809411f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.505+0000 7f8092d9d700 1 -- 172.21.15.156:0/77955114 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8084009550 con 0x7f8094133f50 2023-09-30T22:21:53.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.505+0000 7f809259c700 1 --2- 172.21.15.156:0/77955114 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80940a0a70 0x7f809411f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:53.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.505+0000 7f8091d9b700 1 --2- 172.21.15.156:0/77955114 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f80940a1380 0x7f809411f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:53.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.505+0000 7f8092d9d700 1 --2- 172.21.15.156:0/77955114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8094133f50 0x7f809411fd80 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f808c00efc0 tx=0x7f808c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:53.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.505+0000 7f8082ffd700 1 -- 172.21.15.156:0/77955114 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c00cc90 con 0x7f8094133f50 2023-09-30T22:21:53.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.505+0000 7f8082ffd700 1 -- 172.21.15.156:0/77955114 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808c00f040 con 0x7f8094133f50 2023-09-30T22:21:53.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.505+0000 7f809891a700 1 -- 172.21.15.156:0/77955114 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80880094a0 con 0x7f8094133f50 2023-09-30T22:21:53.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.505+0000 7f8082ffd700 1 -- 172.21.15.156:0/77955114 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c0146c0 con 0x7f8094133f50 2023-09-30T22:21:53.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.505+0000 7f809891a700 1 -- 172.21.15.156:0/77955114 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8094122dd0 con 0x7f8094133f50 2023-09-30T22:21:53.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.506+0000 7f8082ffd700 1 -- 172.21.15.156:0/77955114 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f808c014820 con 0x7f8094133f50 2023-09-30T22:21:53.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.506+0000 7f8082ffd700 1 -- 172.21.15.156:0/77955114 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f808c0401a0 con 0x7f8094133f50 2023-09-30T22:21:53.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.506+0000 7f809891a700 1 -- 172.21.15.156:0/77955114 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8094122c30 con 0x7f8094133f50 2023-09-30T22:21:53.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.511+0000 7f8082ffd700 1 -- 172.21.15.156:0/77955114 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8094122c30 con 0x7f8094133f50 2023-09-30T22:21:53.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.533+0000 7f1da74d8700 1 Processor -- start 2023-09-30T22:21:53.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.533+0000 7f1da74d8700 1 -- start start 2023-09-30T22:21:53.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.534+0000 7f1da74d8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1da00a1550 0x7f1da0138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.534+0000 7f1da74d8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1da0139200 0x7f1da013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.534+0000 7f1da74d8700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da009e9d0 con 0x7f1da00a0a70 2023-09-30T22:21:53.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.534+0000 7f1da74d8700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da009dc00 con 0x7f1da00a1550 2023-09-30T22:21:53.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.534+0000 7f1da74d8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1da009dec0 con 0x7f1da0139200 2023-09-30T22:21:53.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.534+0000 7f1da4a73700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1da00a1550 0x7f1da0138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.534+0000 7f1da4a73700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1da00a1550 0x7f1da0138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54128/0 (socket says 172.21.15.156:54128) 2023-09-30T22:21:53.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.534+0000 7f1da4a73700 1 -- 172.21.15.156:0/3946233488 learned_addr learned my addr 172.21.15.156:0/3946233488 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:53.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.534+0000 7f1da5a75700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1da0139200 0x7f1da013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.534+0000 7f1da4a73700 1 -- 172.21.15.156:0/3946233488 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1da0139200 msgr2=0x7f1da013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:53.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.534+0000 7f1da4a73700 1 --2- 172.21.15.156:0/3946233488 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1da0139200 0x7f1da013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.534+0000 7f1da4a73700 1 -- 172.21.15.156:0/3946233488 >> v1:172.21.15.156:6789/0 conn(0x7f1da00a0a70 legacy=0x7f1da00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.534+0000 7f1d97fff700 1 -- 172.21.15.156:0/3946233488 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2725657425 0 0) 0x7f1da009e9d0 con 0x7f1da00a0a70 2023-09-30T22:21:53.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.534+0000 7f1da4a73700 1 -- 172.21.15.156:0/3946233488 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da009e6a0 con 0x7f1da00a1550 2023-09-30T22:21:53.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.535+0000 7f1da4a73700 1 --2- 172.21.15.156:0/3946233488 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1da00a1550 0x7f1da0138cc0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f1d900098f0 tx=0x7f1d90009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9833bfe17a284359 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:53.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.535+0000 7f1d97fff700 1 -- 172.21.15.156:0/3946233488 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90011830 con 0x7f1da00a1550 2023-09-30T22:21:53.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.535+0000 7f1d97fff700 1 -- 172.21.15.156:0/3946233488 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d90011990 con 0x7f1da00a1550 2023-09-30T22:21:53.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.535+0000 7f1d97fff700 1 -- 172.21.15.156:0/3946233488 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90011d20 con 0x7f1da00a1550 2023-09-30T22:21:53.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.535+0000 7f1da74d8700 1 -- 172.21.15.156:0/3946233488 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1da00a1550 msgr2=0x7f1da0138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.535+0000 7f1da74d8700 1 --2- 172.21.15.156:0/3946233488 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1da00a1550 0x7f1da0138cc0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f1d900098f0 tx=0x7f1d90009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:53.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.535+0000 7f1da74d8700 1 -- 172.21.15.156:0/3946233488 shutdown_connections 2023-09-30T22:21:53.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.535+0000 7f1da74d8700 1 --2- 172.21.15.156:0/3946233488 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1da0139200 0x7f1da013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.535+0000 7f1da74d8700 1 --2- 172.21.15.156:0/3946233488 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1da00a1550 0x7f1da0138cc0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.535+0000 7f1da74d8700 1 -- 172.21.15.156:0/3946233488 >> 172.21.15.156:0/3946233488 conn(0x7f1da00a6610 msgr2=0x7f1da00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:53.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.535+0000 7f1da74d8700 1 -- 172.21.15.156:0/3946233488 shutdown_connections 2023-09-30T22:21:53.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.536+0000 7f1da74d8700 1 -- 172.21.15.156:0/3946233488 wait complete. 2023-09-30T22:21:53.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.536+0000 7f1da74d8700 1 Processor -- start 2023-09-30T22:21:53.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.536+0000 7f1da74d8700 1 -- start start 2023-09-30T22:21:53.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.537+0000 7f1da74d8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1da00a0a70 0x7f1da011e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.537+0000 7f1da74d8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1da00a1550 0x7f1da011ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.537+0000 7f1da74d8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1da0139200 0x7f1da011f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.537+0000 7f1da74d8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da01345d0 con 0x7f1da00a1550 2023-09-30T22:21:53.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.537+0000 7f1da74d8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da0120b10 con 0x7f1da0139200 2023-09-30T22:21:53.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.537+0000 7f1da74d8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1da00a5100 con 0x7f1da00a0a70 2023-09-30T22:21:53.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.537+0000 7f1da4a73700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1da00a1550 0x7f1da011ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.537+0000 7f1da4a73700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1da00a1550 0x7f1da011ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54136/0 (socket says 172.21.15.156:54136) 2023-09-30T22:21:53.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.537+0000 7f1da4a73700 1 -- 172.21.15.156:0/3962990477 learned_addr learned my addr 172.21.15.156:0/3962990477 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:53.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.537+0000 7f1da5274700 1 --2- 172.21.15.156:0/3962990477 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1da00a0a70 0x7f1da011e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.537+0000 7f1da4a73700 1 -- 172.21.15.156:0/3962990477 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1da00a0a70 msgr2=0x7f1da011e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.537+0000 7f1da4a73700 1 --2- 172.21.15.156:0/3962990477 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1da00a0a70 0x7f1da011e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.537+0000 7f1da4a73700 1 -- 172.21.15.156:0/3962990477 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1da0139200 msgr2=0x7f1da011f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.537+0000 7f1da4a73700 1 --2- 172.21.15.156:0/3962990477 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1da0139200 0x7f1da011f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.537+0000 7f1da4a73700 1 -- 172.21.15.156:0/3962990477 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d90009550 con 0x7f1da00a1550 2023-09-30T22:21:53.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.537+0000 7f1da4a73700 1 --2- 172.21.15.156:0/3962990477 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1da00a1550 0x7f1da011ecc0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f1d90009c40 tx=0x7f1d90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:53.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.537+0000 7f1d95ffb700 1 -- 172.21.15.156:0/3962990477 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90004550 con 0x7f1da00a1550 2023-09-30T22:21:53.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.537+0000 7f1d95ffb700 1 -- 172.21.15.156:0/3962990477 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d900036a0 con 0x7f1da00a1550 2023-09-30T22:21:53.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.537+0000 7f1da74d8700 1 -- 172.21.15.156:0/3962990477 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da00a03e0 con 0x7f1da00a1550 2023-09-30T22:21:53.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.537+0000 7f1d95ffb700 1 -- 172.21.15.156:0/3962990477 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90003a50 con 0x7f1da00a1550 2023-09-30T22:21:53.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.538+0000 7f1da74d8700 1 -- 172.21.15.156:0/3962990477 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da0122990 con 0x7f1da00a1550 2023-09-30T22:21:53.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.538+0000 7f1d95ffb700 1 -- 172.21.15.156:0/3962990477 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1d90021070 con 0x7f1da00a1550 2023-09-30T22:21:53.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.538+0000 7f1d95ffb700 1 -- 172.21.15.156:0/3962990477 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1d90040b40 con 0x7f1da00a1550 2023-09-30T22:21:53.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.538+0000 7f1da74d8700 1 -- 172.21.15.156:0/3962990477 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da004f2a0 con 0x7f1da00a1550 2023-09-30T22:21:53.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.547+0000 7f1d95ffb700 1 -- 172.21.15.156:0/3962990477 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d90015030 con 0x7f1da00a1550 2023-09-30T22:21:53.587 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:53.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.710+0000 7f809891a700 1 -- 172.21.15.156:0/77955114 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8094122c30 con 0x7f8094133f50 2023-09-30T22:21:53.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.710+0000 7f8082ffd700 1 -- 172.21.15.156:0/77955114 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8094122c30 con 0x7f8094133f50 2023-09-30T22:21:53.711 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:53.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.712+0000 7f809891a700 1 -- 172.21.15.156:0/77955114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8094133f50 msgr2=0x7f809411fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.712+0000 7f809891a700 1 --2- 172.21.15.156:0/77955114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8094133f50 0x7f809411fd80 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f808c00efc0 tx=0x7f808c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.712+0000 7f809891a700 1 -- 172.21.15.156:0/77955114 shutdown_connections 2023-09-30T22:21:53.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.712+0000 7f809891a700 1 --2- 172.21.15.156:0/77955114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8094133f50 0x7f809411fd80 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.712+0000 7f809891a700 1 --2- 172.21.15.156:0/77955114 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f80940a0a70 0x7f809411f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.712+0000 7f809891a700 1 --2- 172.21.15.156:0/77955114 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f80940a1380 0x7f809411f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.712+0000 7f809891a700 1 -- 172.21.15.156:0/77955114 >> 172.21.15.156:0/77955114 conn(0x7f80940a6610 msgr2=0x7f809409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:53.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.712+0000 7f5d5125d700 1 Processor -- start 2023-09-30T22:21:53.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.712+0000 7f809891a700 1 -- 172.21.15.156:0/77955114 shutdown_connections 2023-09-30T22:21:53.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.712+0000 7f809891a700 1 -- 172.21.15.156:0/77955114 wait complete. 2023-09-30T22:21:53.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.712+0000 7f5d5125d700 1 -- start start 2023-09-30T22:21:53.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.713+0000 7f5d5125d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d4c09a150 0x7f5d4c09e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.713+0000 7f5d5125d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d4c09f1a0 0x7f5d4c134330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.713+0000 7f5d5125d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4c09af80 con 0x7f5d4c09edb0 2023-09-30T22:21:53.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.713+0000 7f5d5125d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c09a520 con 0x7f5d4c09a150 2023-09-30T22:21:53.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.713+0000 7f5d5125d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c09fe00 con 0x7f5d4c09f1a0 2023-09-30T22:21:53.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.713+0000 7f5d4a59c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f5d4c09edb0 0x7f5d4c133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40564/0 (socket says 172.21.15.156:40564) 2023-09-30T22:21:53.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.713+0000 7f5d4ad9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d4c09a150 0x7f5d4c09e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.713+0000 7f5d4a59c700 1 -- 172.21.15.156:0/3134954149 learned_addr learned my addr 172.21.15.156:0/3134954149 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:53.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.713+0000 7f5d4b59e700 1 --2- 172.21.15.156:0/3134954149 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d4c09f1a0 0x7f5d4c134330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.713+0000 7f5d4ad9d700 1 -- 172.21.15.156:0/3134954149 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d4c09f1a0 msgr2=0x7f5d4c134330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:53.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.713+0000 7f5d4ad9d700 1 --2- 172.21.15.156:0/3134954149 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d4c09f1a0 0x7f5d4c134330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.713+0000 7f5d4ad9d700 1 -- 172.21.15.156:0/3134954149 >> v1:172.21.15.156:6789/0 conn(0x7f5d4c09edb0 legacy=0x7f5d4c133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.713+0000 7f5d49d9b700 1 -- 172.21.15.156:0/3134954149 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3206926676 0 0) 0x7f5d4c09af80 con 0x7f5d4c09edb0 2023-09-30T22:21:53.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.713+0000 7f5d4ad9d700 1 -- 172.21.15.156:0/3134954149 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c06bc20 con 0x7f5d4c09a150 2023-09-30T22:21:53.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.714+0000 7f5d4ad9d700 1 --2- 172.21.15.156:0/3134954149 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d4c09a150 0x7f5d4c09e870 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009dc0 tx=0x7f5d4400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18bf37b100c95cb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:53.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.714+0000 7f5d49d9b700 1 -- 172.21.15.156:0/3134954149 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4400e070 con 0x7f5d4c09a150 2023-09-30T22:21:53.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.714+0000 7f5d49d9b700 1 -- 172.21.15.156:0/3134954149 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4400bbd0 con 0x7f5d4c09a150 2023-09-30T22:21:53.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.714+0000 7f5d49d9b700 1 -- 172.21.15.156:0/3134954149 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44012430 con 0x7f5d4c09a150 2023-09-30T22:21:53.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.715+0000 7f5d5125d700 1 -- 172.21.15.156:0/3134954149 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d4c09a150 msgr2=0x7f5d4c09e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.715+0000 7f5d5125d700 1 --2- 172.21.15.156:0/3134954149 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d4c09a150 0x7f5d4c09e870 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009dc0 tx=0x7f5d4400b330 comp rx=0 tx=0).stop 2023-09-30T22:21:53.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.715+0000 7f5d5125d700 1 -- 172.21.15.156:0/3134954149 shutdown_connections 2023-09-30T22:21:53.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.715+0000 7f5d5125d700 1 --2- 172.21.15.156:0/3134954149 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d4c09a150 0x7f5d4c09e870 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.715+0000 7f5d5125d700 1 --2- 172.21.15.156:0/3134954149 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d4c09f1a0 0x7f5d4c134330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.715+0000 7f5d5125d700 1 -- 172.21.15.156:0/3134954149 >> 172.21.15.156:0/3134954149 conn(0x7f5d4c0a4430 msgr2=0x7f5d4c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:53.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.715+0000 7f5d5125d700 1 -- 172.21.15.156:0/3134954149 shutdown_connections 2023-09-30T22:21:53.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.715+0000 7f5d5125d700 1 -- 172.21.15.156:0/3134954149 wait complete. 2023-09-30T22:21:53.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.716+0000 7f5d5125d700 1 Processor -- start 2023-09-30T22:21:53.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.716+0000 7f5d5125d700 1 -- start start 2023-09-30T22:21:53.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.717+0000 7f5d5125d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d4c09a150 0x7f5d4c1c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.717+0000 7f5d5125d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d4c09edb0 0x7f5d4c1c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.717+0000 7f5d5125d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d4c09f1a0 0x7f5d4c1c4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.717+0000 7f5d5125d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c1aaec0 con 0x7f5d4c09f1a0 2023-09-30T22:21:53.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.717+0000 7f5d5125d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c09bc60 con 0x7f5d4c09edb0 2023-09-30T22:21:53.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.717+0000 7f5d5125d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c0a0440 con 0x7f5d4c09a150 2023-09-30T22:21:53.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.717+0000 7f5d4b59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d4c09f1a0 0x7f5d4c1c4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.717+0000 7f5d4b59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d4c09f1a0 0x7f5d4c1c4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54148/0 (socket says 172.21.15.156:54148) 2023-09-30T22:21:53.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.717+0000 7f5d4ad9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d4c09a150 0x7f5d4c1c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.717+0000 7f5d4b59e700 1 -- 172.21.15.156:0/3767840246 learned_addr learned my addr 172.21.15.156:0/3767840246 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:53.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.717+0000 7f5d4a59c700 1 --2- 172.21.15.156:0/3767840246 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d4c09edb0 0x7f5d4c1c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.717+0000 7f5d4b59e700 1 -- 172.21.15.156:0/3767840246 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d4c09a150 msgr2=0x7f5d4c1c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.717+0000 7f5d4b59e700 1 --2- 172.21.15.156:0/3767840246 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d4c09a150 0x7f5d4c1c8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.717+0000 7f5d4b59e700 1 -- 172.21.15.156:0/3767840246 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d4c09edb0 msgr2=0x7f5d4c1c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.717+0000 7f5d4b59e700 1 --2- 172.21.15.156:0/3767840246 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d4c09edb0 0x7f5d4c1c9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.717+0000 7f5d4b59e700 1 -- 172.21.15.156:0/3767840246 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d44009a70 con 0x7f5d4c09f1a0 2023-09-30T22:21:53.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.717+0000 7f5d4ad9d700 1 --2- 172.21.15.156:0/3767840246 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d4c09a150 0x7f5d4c1c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:53.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.717+0000 7f5d4b59e700 1 --2- 172.21.15.156:0/3767840246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d4c09f1a0 0x7f5d4c1c4e80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000e810 tx=0x7f5d4000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:53.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.718+0000 7f5d337fe700 1 -- 172.21.15.156:0/3767840246 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4000c070 con 0x7f5d4c09f1a0 2023-09-30T22:21:53.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.718+0000 7f5d337fe700 1 -- 172.21.15.156:0/3767840246 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d40013610 con 0x7f5d4c09f1a0 2023-09-30T22:21:53.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.718+0000 7f5d5125d700 1 -- 172.21.15.156:0/3767840246 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d4c1aa0a0 con 0x7f5d4c09f1a0 2023-09-30T22:21:53.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.718+0000 7f5d337fe700 1 -- 172.21.15.156:0/3767840246 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d400139c0 con 0x7f5d4c09f1a0 2023-09-30T22:21:53.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.718+0000 7f5d5125d700 1 -- 172.21.15.156:0/3767840246 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d4c1ac670 con 0x7f5d4c09f1a0 2023-09-30T22:21:53.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.719+0000 7f5d5125d700 1 -- 172.21.15.156:0/3767840246 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d4c09fa30 con 0x7f5d4c09f1a0 2023-09-30T22:21:53.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.719+0000 7f5d337fe700 1 -- 172.21.15.156:0/3767840246 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5d40013b20 con 0x7f5d4c09f1a0 2023-09-30T22:21:53.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.719+0000 7f5d337fe700 1 -- 172.21.15.156:0/3767840246 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5d4003f370 con 0x7f5d4c09f1a0 2023-09-30T22:21:53.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.727+0000 7f5d337fe700 1 -- 172.21.15.156:0/3767840246 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5d40010900 con 0x7f5d4c09f1a0 2023-09-30T22:21:53.729 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:53.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.745+0000 7f1da74d8700 1 -- 172.21.15.156:0/3962990477 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1da0072980 con 0x7f1da00a1550 2023-09-30T22:21:53.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.746+0000 7f1d95ffb700 1 -- 172.21.15.156:0/3962990477 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1d900193b0 con 0x7f1da00a1550 2023-09-30T22:21:53.746 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:53.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.748+0000 7f1da74d8700 1 -- 172.21.15.156:0/3962990477 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1da00a1550 msgr2=0x7f1da011ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.748+0000 7f1da74d8700 1 --2- 172.21.15.156:0/3962990477 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1da00a1550 0x7f1da011ecc0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f1d90009c40 tx=0x7f1d90004750 comp rx=0 tx=0).stop 2023-09-30T22:21:53.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.748+0000 7f1da74d8700 1 -- 172.21.15.156:0/3962990477 shutdown_connections 2023-09-30T22:21:53.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.748+0000 7f1da74d8700 1 --2- 172.21.15.156:0/3962990477 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1da0139200 0x7f1da011f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.748+0000 7f1da74d8700 1 --2- 172.21.15.156:0/3962990477 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1da00a0a70 0x7f1da011e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.748+0000 7f1da74d8700 1 --2- 172.21.15.156:0/3962990477 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1da00a1550 0x7f1da011ecc0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.748+0000 7f1da74d8700 1 -- 172.21.15.156:0/3962990477 >> 172.21.15.156:0/3962990477 conn(0x7f1da00a6610 msgr2=0x7f1da00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:53.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.748+0000 7f1da74d8700 1 -- 172.21.15.156:0/3962990477 shutdown_connections 2023-09-30T22:21:53.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.748+0000 7f1da74d8700 1 -- 172.21.15.156:0/3962990477 wait complete. 2023-09-30T22:21:53.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:53.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.914+0000 7f5d5125d700 1 -- 172.21.15.156:0/3767840246 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5d4c1aa290 con 0x7f5d4c09f1a0 2023-09-30T22:21:53.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.914+0000 7f5d337fe700 1 -- 172.21.15.156:0/3767840246 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5d40017030 con 0x7f5d4c09f1a0 2023-09-30T22:21:53.915 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:53.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.916+0000 7f5d5125d700 1 -- 172.21.15.156:0/3767840246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d4c09f1a0 msgr2=0x7f5d4c1c4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.916+0000 7f5d5125d700 1 --2- 172.21.15.156:0/3767840246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d4c09f1a0 0x7f5d4c1c4e80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000e810 tx=0x7f5d4000eb20 comp rx=0 tx=0).stop 2023-09-30T22:21:53.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.917+0000 7f5d5125d700 1 -- 172.21.15.156:0/3767840246 shutdown_connections 2023-09-30T22:21:53.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.917+0000 7f5d5125d700 1 --2- 172.21.15.156:0/3767840246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d4c09f1a0 0x7f5d4c1c4e80 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.917+0000 7f5d5125d700 1 --2- 172.21.15.156:0/3767840246 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d4c09a150 0x7f5d4c1c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.917+0000 7f5d5125d700 1 --2- 172.21.15.156:0/3767840246 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d4c09edb0 0x7f5d4c1c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.917+0000 7f5d5125d700 1 -- 172.21.15.156:0/3767840246 >> 172.21.15.156:0/3767840246 conn(0x7f5d4c0a4430 msgr2=0x7f5d4c0a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:53.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.917+0000 7f5d5125d700 1 -- 172.21.15.156:0/3767840246 shutdown_connections 2023-09-30T22:21:53.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:53.917+0000 7f5d5125d700 1 -- 172.21.15.156:0/3767840246 wait complete. 2023-09-30T22:21:53.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:54.425 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:54.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.549+0000 7f47c135e700 1 Processor -- start 2023-09-30T22:21:54.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.549+0000 7f47c135e700 1 -- start start 2023-09-30T22:21:54.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.549+0000 7f47c135e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f47bc0a0a70 0x7f47bc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.549+0000 7f47c135e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47bc134120 0x7f47bc13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.550+0000 7f47c135e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47bc09dc00 con 0x7f47bc0a1380 2023-09-30T22:21:54.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.550+0000 7f47c135e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47bc09ea90 con 0x7f47bc0a0a70 2023-09-30T22:21:54.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.550+0000 7f47c135e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc09dec0 con 0x7f47bc134120 2023-09-30T22:21:54.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.550+0000 7f47baffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f47bc0a0a70 0x7f47bc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.550+0000 7f47bb7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47bc134120 0x7f47bc13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.550+0000 7f47baffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f47bc0a0a70 0x7f47bc0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54164/0 (socket says 172.21.15.156:54164) 2023-09-30T22:21:54.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.550+0000 7f47ba7fc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f47bc0a1380 0x7f47bc133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40574/0 (socket says 172.21.15.156:40574) 2023-09-30T22:21:54.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.550+0000 7f47baffd700 1 -- 172.21.15.156:0/31066711 learned_addr learned my addr 172.21.15.156:0/31066711 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:54.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.550+0000 7f47b9ffb700 1 -- 172.21.15.156:0/31066711 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2453277319 0 0) 0x7f47bc09dc00 con 0x7f47bc0a1380 2023-09-30T22:21:54.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.550+0000 7f47b9ffb700 1 -- 172.21.15.156:0/31066711 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47a40035b0 con 0x7f47bc0a1380 2023-09-30T22:21:54.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.550+0000 7f47bb7fe700 1 -- 172.21.15.156:0/31066711 >> v2:172.21.15.156:3300/0 conn(0x7f47bc0a0a70 msgr2=0x7f47bc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:54.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.550+0000 7f47bb7fe700 1 --2- 172.21.15.156:0/31066711 >> v2:172.21.15.156:3300/0 conn(0x7f47bc0a0a70 0x7f47bc0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.550+0000 7f47bb7fe700 1 -- 172.21.15.156:0/31066711 >> v1:172.21.15.156:6789/0 conn(0x7f47bc0a1380 legacy=0x7f47bc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.550+0000 7f47bb7fe700 1 -- 172.21.15.156:0/31066711 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc09e6a0 con 0x7f47bc134120 2023-09-30T22:21:54.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.550+0000 7f47baffd700 1 --2- 172.21.15.156:0/31066711 >> v2:172.21.15.156:3300/0 conn(0x7f47bc0a0a70 0x7f47bc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:54.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.550+0000 7f47bb7fe700 1 --2- 172.21.15.156:0/31066711 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47bc134120 0x7f47bc13bce0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f47b4009d90 tx=0x7f47b400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22804cc0205d1630 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:54.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.550+0000 7f47b9ffb700 1 -- 172.21.15.156:0/31066711 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b400e070 con 0x7f47bc134120 2023-09-30T22:21:54.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.550+0000 7f47b9ffb700 1 -- 172.21.15.156:0/31066711 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b400bb20 con 0x7f47bc134120 2023-09-30T22:21:54.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.550+0000 7f47b9ffb700 1 -- 172.21.15.156:0/31066711 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b4012430 con 0x7f47bc134120 2023-09-30T22:21:54.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.551+0000 7f47c135e700 1 -- 172.21.15.156:0/31066711 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47bc134120 msgr2=0x7f47bc13bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.551+0000 7f47c135e700 1 --2- 172.21.15.156:0/31066711 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47bc134120 0x7f47bc13bce0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f47b4009d90 tx=0x7f47b400b330 comp rx=0 tx=0).stop 2023-09-30T22:21:54.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.551+0000 7f47c135e700 1 -- 172.21.15.156:0/31066711 shutdown_connections 2023-09-30T22:21:54.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.551+0000 7f47c135e700 1 --2- 172.21.15.156:0/31066711 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47bc134120 0x7f47bc13bce0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.551+0000 7f47c135e700 1 --2- 172.21.15.156:0/31066711 >> v2:172.21.15.156:3300/0 conn(0x7f47bc0a0a70 0x7f47bc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.551+0000 7f47c135e700 1 -- 172.21.15.156:0/31066711 >> 172.21.15.156:0/31066711 conn(0x7f47bc0a6610 msgr2=0x7f47bc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:54.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.551+0000 7f47c135e700 1 -- 172.21.15.156:0/31066711 shutdown_connections 2023-09-30T22:21:54.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.551+0000 7f47c135e700 1 -- 172.21.15.156:0/31066711 wait complete. 2023-09-30T22:21:54.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.552+0000 7f47c135e700 1 Processor -- start 2023-09-30T22:21:54.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.552+0000 7f47c135e700 1 -- start start 2023-09-30T22:21:54.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.552+0000 7f47c135e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47bc0a0a70 0x7f47bc122650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.552+0000 7f47c135e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47bc0a1380 0x7f47bc122b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.552+0000 7f47c135e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47bc134120 0x7f47bc1230d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.552+0000 7f47c135e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc124b30 con 0x7f47bc134120 2023-09-30T22:21:54.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.552+0000 7f47c135e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc125e90 con 0x7f47bc0a1380 2023-09-30T22:21:54.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.552+0000 7f47c135e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc124370 con 0x7f47bc0a0a70 2023-09-30T22:21:54.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.552+0000 7f47ba7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47bc0a1380 0x7f47bc122b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.553+0000 7f47bb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47bc134120 0x7f47bc1230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.553+0000 7f47ba7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47bc0a1380 0x7f47bc122b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:55660/0 (socket says 172.21.15.156:55660) 2023-09-30T22:21:54.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.553+0000 7f47baffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47bc0a0a70 0x7f47bc122650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.553+0000 7f47bb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47bc134120 0x7f47bc1230d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54180/0 (socket says 172.21.15.156:54180) 2023-09-30T22:21:54.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.553+0000 7f47ba7fc700 1 -- 172.21.15.156:0/1328523074 learned_addr learned my addr 172.21.15.156:0/1328523074 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:54.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.553+0000 7f47ba7fc700 1 -- 172.21.15.156:0/1328523074 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47bc0a0a70 msgr2=0x7f47bc122650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.553+0000 7f47ba7fc700 1 --2- 172.21.15.156:0/1328523074 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47bc0a0a70 0x7f47bc122650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.553+0000 7f47ba7fc700 1 -- 172.21.15.156:0/1328523074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47bc134120 msgr2=0x7f47bc1230d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.553+0000 7f47ba7fc700 1 --2- 172.21.15.156:0/1328523074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47bc134120 0x7f47bc1230d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.553+0000 7f47ba7fc700 1 -- 172.21.15.156:0/1328523074 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b0009550 con 0x7f47bc0a1380 2023-09-30T22:21:54.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.553+0000 7f47bb7fe700 1 --2- 172.21.15.156:0/1328523074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47bc134120 0x7f47bc1230d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:54.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.553+0000 7f47ba7fc700 1 --2- 172.21.15.156:0/1328523074 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47bc0a1380 0x7f47bc122b90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00c760 tx=0x7f47ac00ca70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:54.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.553+0000 7f47a37fe700 1 -- 172.21.15.156:0/1328523074 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac005cb0 con 0x7f47bc0a1380 2023-09-30T22:21:54.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.553+0000 7f47a37fe700 1 -- 172.21.15.156:0/1328523074 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ac005e10 con 0x7f47bc0a1380 2023-09-30T22:21:54.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.553+0000 7f47c135e700 1 -- 172.21.15.156:0/1328523074 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b4009a70 con 0x7f47bc0a1380 2023-09-30T22:21:54.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.553+0000 7f47a37fe700 1 -- 172.21.15.156:0/1328523074 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac0072d0 con 0x7f47bc0a1380 2023-09-30T22:21:54.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.553+0000 7f47c135e700 1 -- 172.21.15.156:0/1328523074 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47bc133170 con 0x7f47bc0a1380 2023-09-30T22:21:54.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.554+0000 7f47a37fe700 1 -- 172.21.15.156:0/1328523074 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f47ac007430 con 0x7f47bc0a1380 2023-09-30T22:21:54.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.554+0000 7f47a37fe700 1 -- 172.21.15.156:0/1328523074 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f47ac03eac0 con 0x7f47bc0a1380 2023-09-30T22:21:54.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.554+0000 7f47c135e700 1 -- 172.21.15.156:0/1328523074 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47bc04f2a0 con 0x7f47bc0a1380 2023-09-30T22:21:54.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.559+0000 7f47a37fe700 1 -- 172.21.15.156:0/1328523074 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f47ac01b3b0 con 0x7f47bc0a1380 2023-09-30T22:21:54.731 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:54.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.745+0000 7f47c135e700 1 -- 172.21.15.156:0/1328523074 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f47bc072980 con 0x7f47bc0a1380 2023-09-30T22:21:54.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.746+0000 7f47a37fe700 1 -- 172.21.15.156:0/1328523074 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f47ac017020 con 0x7f47bc0a1380 2023-09-30T22:21:54.746 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:54.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.748+0000 7f47c135e700 1 -- 172.21.15.156:0/1328523074 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47bc0a1380 msgr2=0x7f47bc122b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.748+0000 7f47c135e700 1 --2- 172.21.15.156:0/1328523074 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47bc0a1380 0x7f47bc122b90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00c760 tx=0x7f47ac00ca70 comp rx=0 tx=0).stop 2023-09-30T22:21:54.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.748+0000 7f47c135e700 1 -- 172.21.15.156:0/1328523074 shutdown_connections 2023-09-30T22:21:54.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.748+0000 7f47c135e700 1 --2- 172.21.15.156:0/1328523074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47bc134120 0x7f47bc1230d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.748+0000 7f47c135e700 1 --2- 172.21.15.156:0/1328523074 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f47bc0a0a70 0x7f47bc122650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.748+0000 7f47c135e700 1 --2- 172.21.15.156:0/1328523074 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f47bc0a1380 0x7f47bc122b90 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.748+0000 7f47c135e700 1 -- 172.21.15.156:0/1328523074 >> 172.21.15.156:0/1328523074 conn(0x7f47bc0a6610 msgr2=0x7f47bc0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:54.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.748+0000 7f47c135e700 1 -- 172.21.15.156:0/1328523074 shutdown_connections 2023-09-30T22:21:54.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.748+0000 7f47c135e700 1 -- 172.21.15.156:0/1328523074 wait complete. 2023-09-30T22:21:54.762 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:54.762 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:54.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.856+0000 7fdd9af9a700 1 Processor -- start 2023-09-30T22:21:54.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.856+0000 7fdd9af9a700 1 -- start start 2023-09-30T22:21:54.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.856+0000 7fdd9af9a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd9409ad40 0x7fdd94133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.856+0000 7fdd9af9a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdd94133f70 0x7fdd941343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.856+0000 7fdd9af9a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdd940a0a70 0x7fdd940a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.856+0000 7fdd9af9a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd940a3b60 con 0x7fdd940a0a70 2023-09-30T22:21:54.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.856+0000 7fdd9af9a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd941348e0 con 0x7fdd9409ad40 2023-09-30T22:21:54.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.856+0000 7fdd9af9a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9409b110 con 0x7fdd94133f70 2023-09-30T22:21:54.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.856+0000 7fdd99537700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdd940a0a70 0x7fdd940a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.856+0000 7fdd98d36700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd9409ad40 0x7fdd94133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.856+0000 7fdd93fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdd94133f70 0x7fdd941343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.856+0000 7fdd98d36700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd9409ad40 0x7fdd94133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:55664/0 (socket says 172.21.15.156:55664) 2023-09-30T22:21:54.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.856+0000 7fdd99537700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdd940a0a70 0x7fdd940a0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54190/0 (socket says 172.21.15.156:54190) 2023-09-30T22:21:54.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.856+0000 7fdd93fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdd94133f70 0x7fdd941343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33440/0 (socket says 172.21.15.156:33440) 2023-09-30T22:21:54.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.856+0000 7fdd98d36700 1 -- 172.21.15.156:0/3929499226 learned_addr learned my addr 172.21.15.156:0/3929499226 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:54.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.857+0000 7fdd99537700 1 -- 172.21.15.156:0/3929499226 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdd94133f70 msgr2=0x7fdd941343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:54.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.857+0000 7fdd99537700 1 --2- 172.21.15.156:0/3929499226 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdd94133f70 0x7fdd941343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.857+0000 7fdd99537700 1 -- 172.21.15.156:0/3929499226 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd9409ad40 msgr2=0x7fdd94133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:54.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.857+0000 7fdd99537700 1 --2- 172.21.15.156:0/3929499226 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd9409ad40 0x7fdd94133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.857+0000 7fdd99537700 1 -- 172.21.15.156:0/3929499226 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd940a2fa0 con 0x7fdd940a0a70 2023-09-30T22:21:54.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.857+0000 7fdd93fff700 1 --2- 172.21.15.156:0/3929499226 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdd94133f70 0x7fdd941343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:54.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.857+0000 7fdd98d36700 1 --2- 172.21.15.156:0/3929499226 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd9409ad40 0x7fdd94133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:54.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.857+0000 7fdd99537700 1 --2- 172.21.15.156:0/3929499226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd940a0a70 0x7fdd940a0ef0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c009dc0 tx=0x7fdd8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ac59768399d282 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:54.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.857+0000 7fdd937fe700 1 -- 172.21.15.156:0/3929499226 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c00e070 con 0x7fdd940a0a70 2023-09-30T22:21:54.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.857+0000 7fdd937fe700 1 -- 172.21.15.156:0/3929499226 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c00bae0 con 0x7fdd940a0a70 2023-09-30T22:21:54.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.857+0000 7fdd937fe700 1 -- 172.21.15.156:0/3929499226 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c00be90 con 0x7fdd940a0a70 2023-09-30T22:21:54.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.857+0000 7fdd9af9a700 1 -- 172.21.15.156:0/3929499226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd940a0a70 msgr2=0x7fdd940a0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.857+0000 7fdd9af9a700 1 --2- 172.21.15.156:0/3929499226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd940a0a70 0x7fdd940a0ef0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c009dc0 tx=0x7fdd8c00b330 comp rx=0 tx=0).stop 2023-09-30T22:21:54.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.857+0000 7fdd9af9a700 1 -- 172.21.15.156:0/3929499226 shutdown_connections 2023-09-30T22:21:54.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.858+0000 7fdd9af9a700 1 --2- 172.21.15.156:0/3929499226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd940a0a70 0x7fdd940a0ef0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.858+0000 7fdd9af9a700 1 --2- 172.21.15.156:0/3929499226 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd9409ad40 0x7fdd94133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.858+0000 7fdd9af9a700 1 --2- 172.21.15.156:0/3929499226 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdd94133f70 0x7fdd941343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.858+0000 7fdd9af9a700 1 -- 172.21.15.156:0/3929499226 >> 172.21.15.156:0/3929499226 conn(0x7fdd94099c40 msgr2=0x7fdd9406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:54.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.858+0000 7fdd9af9a700 1 -- 172.21.15.156:0/3929499226 shutdown_connections 2023-09-30T22:21:54.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.858+0000 7fdd9af9a700 1 -- 172.21.15.156:0/3929499226 wait complete. 2023-09-30T22:21:54.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.858+0000 7fdd9af9a700 1 Processor -- start 2023-09-30T22:21:54.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.858+0000 7fdd9af9a700 1 -- start start 2023-09-30T22:21:54.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.859+0000 7fdd9af9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd9409ad40 0x7fdd94121390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.859+0000 7fdd9af9a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd940a0a70 0x7fdd941218d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.859+0000 7fdd9af9a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdd94133f70 0x7fdd94121e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.859+0000 7fdd9af9a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd94124eb0 con 0x7fdd9409ad40 2023-09-30T22:21:54.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.859+0000 7fdd9af9a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd941249a0 con 0x7fdd940a0a70 2023-09-30T22:21:54.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.859+0000 7fdd9af9a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd94123e30 con 0x7fdd94133f70 2023-09-30T22:21:54.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.859+0000 7fdd99537700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdd94133f70 0x7fdd94121e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.859+0000 7fdd99537700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdd94133f70 0x7fdd94121e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33454/0 (socket says 172.21.15.156:33454) 2023-09-30T22:21:54.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.859+0000 7fdd98d36700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd9409ad40 0x7fdd94121390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.859+0000 7fdd99537700 1 -- 172.21.15.156:0/1748291819 learned_addr learned my addr 172.21.15.156:0/1748291819 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:54.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.859+0000 7fdd93fff700 1 --2- 172.21.15.156:0/1748291819 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd940a0a70 0x7fdd941218d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.860+0000 7fdd98d36700 1 -- 172.21.15.156:0/1748291819 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdd94133f70 msgr2=0x7fdd94121e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.860+0000 7fdd98d36700 1 --2- 172.21.15.156:0/1748291819 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdd94133f70 0x7fdd94121e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.860+0000 7fdd98d36700 1 -- 172.21.15.156:0/1748291819 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd940a0a70 msgr2=0x7fdd941218d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.860+0000 7fdd98d36700 1 --2- 172.21.15.156:0/1748291819 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd940a0a70 0x7fdd941218d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.860+0000 7fdd98d36700 1 -- 172.21.15.156:0/1748291819 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd88009550 con 0x7fdd9409ad40 2023-09-30T22:21:54.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.860+0000 7fdd99537700 1 --2- 172.21.15.156:0/1748291819 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdd94133f70 0x7fdd94121e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:54.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.860+0000 7fdd98d36700 1 --2- 172.21.15.156:0/1748291819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd9409ad40 0x7fdd94121390 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fdd8800e8e0 tx=0x7fdd8800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:54.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.860+0000 7fdd917fa700 1 -- 172.21.15.156:0/1748291819 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd88013680 con 0x7fdd9409ad40 2023-09-30T22:21:54.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.860+0000 7fdd917fa700 1 -- 172.21.15.156:0/1748291819 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd880137e0 con 0x7fdd9409ad40 2023-09-30T22:21:54.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.860+0000 7fdd917fa700 1 -- 172.21.15.156:0/1748291819 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd88013b70 con 0x7fdd9409ad40 2023-09-30T22:21:54.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.860+0000 7fdd9af9a700 1 -- 172.21.15.156:0/1748291819 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd800094a0 con 0x7fdd9409ad40 2023-09-30T22:21:54.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.860+0000 7fdd9af9a700 1 -- 172.21.15.156:0/1748291819 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8c009a70 con 0x7fdd9409ad40 2023-09-30T22:21:54.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.861+0000 7fdd917fa700 1 -- 172.21.15.156:0/1748291819 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdd88013cd0 con 0x7fdd9409ad40 2023-09-30T22:21:54.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.861+0000 7fdd9af9a700 1 -- 172.21.15.156:0/1748291819 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd9409d360 con 0x7fdd9409ad40 2023-09-30T22:21:54.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.861+0000 7fdd917fa700 1 -- 172.21.15.156:0/1748291819 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdd8803f950 con 0x7fdd9409ad40 2023-09-30T22:21:54.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.866+0000 7fdd917fa700 1 -- 172.21.15.156:0/1748291819 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdd88011db0 con 0x7fdd9409ad40 2023-09-30T22:21:54.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.928+0000 7f1fa65e2700 1 Processor -- start 2023-09-30T22:21:54.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.928+0000 7f1fa65e2700 1 -- start start 2023-09-30T22:21:54.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.929+0000 7f1fa65e2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fa006a770 0x7f1fa006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.929+0000 7f1fa65e2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1fa0136cb0 0x7f1fa0139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.929+0000 7f1fa65e2700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa006e900 con 0x7f1fa009dec0 2023-09-30T22:21:54.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.929+0000 7f1fa65e2700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa009d180 con 0x7f1fa0136cb0 2023-09-30T22:21:54.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.929+0000 7f1fa65e2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa009e780 con 0x7f1fa006a770 2023-09-30T22:21:54.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.929+0000 7f1fa4b7f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1fa0136cb0 0x7f1fa0139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.929+0000 7f1f9f7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f1fa009dec0 0x7f1fa006b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40588/0 (socket says 172.21.15.156:40588) 2023-09-30T22:21:54.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.929+0000 7f1f9f7fe700 1 -- 172.21.15.156:0/4092037756 learned_addr learned my addr 172.21.15.156:0/4092037756 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:54.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.929+0000 7f1f9ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fa006a770 0x7f1fa006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.929+0000 7f1fa4b7f700 1 -- 172.21.15.156:0/4092037756 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fa006a770 msgr2=0x7f1fa006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:54.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.929+0000 7f1fa4b7f700 1 --2- 172.21.15.156:0/4092037756 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fa006a770 0x7f1fa006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.929+0000 7f1fa4b7f700 1 -- 172.21.15.156:0/4092037756 >> v1:172.21.15.156:6789/0 conn(0x7f1fa009dec0 legacy=0x7f1fa006b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.929+0000 7f1fa4b7f700 1 -- 172.21.15.156:0/4092037756 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa009d3c0 con 0x7f1fa0136cb0 2023-09-30T22:21:54.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.929+0000 7f1f9ffff700 1 --2- 172.21.15.156:0/4092037756 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fa006a770 0x7f1fa006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:54.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.929+0000 7f1fa4b7f700 1 --2- 172.21.15.156:0/4092037756 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fa0136cb0 0x7f1fa0139090 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f1f98009d90 tx=0x7f1f9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc36e560ff41bf4a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:54.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.930+0000 7f1f9effd700 1 -- 172.21.15.156:0/4092037756 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9800e070 con 0x7f1fa0136cb0 2023-09-30T22:21:54.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.930+0000 7f1f9effd700 1 -- 172.21.15.156:0/4092037756 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9800bb20 con 0x7f1fa0136cb0 2023-09-30T22:21:54.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.930+0000 7f1f9effd700 1 -- 172.21.15.156:0/4092037756 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f98012430 con 0x7f1fa0136cb0 2023-09-30T22:21:54.932 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:54.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.930+0000 7f1fa65e2700 1 -- 172.21.15.156:0/4092037756 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fa0136cb0 msgr2=0x7f1fa0139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.930+0000 7f1fa65e2700 1 --2- 172.21.15.156:0/4092037756 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fa0136cb0 0x7f1fa0139090 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f1f98009d90 tx=0x7f1f9800b330 comp rx=0 tx=0).stop 2023-09-30T22:21:54.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.930+0000 7f1fa65e2700 1 -- 172.21.15.156:0/4092037756 shutdown_connections 2023-09-30T22:21:54.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.930+0000 7f1fa65e2700 1 --2- 172.21.15.156:0/4092037756 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fa0136cb0 0x7f1fa0139090 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.930+0000 7f1fa65e2700 1 --2- 172.21.15.156:0/4092037756 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fa006a770 0x7f1fa006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.930+0000 7f1fa65e2700 1 -- 172.21.15.156:0/4092037756 >> 172.21.15.156:0/4092037756 conn(0x7f1fa0099c40 msgr2=0x7f1fa00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:54.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.930+0000 7f1fa65e2700 1 -- 172.21.15.156:0/4092037756 shutdown_connections 2023-09-30T22:21:54.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.930+0000 7f1fa65e2700 1 -- 172.21.15.156:0/4092037756 wait complete. 2023-09-30T22:21:54.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.931+0000 7f1fa65e2700 1 Processor -- start 2023-09-30T22:21:54.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.931+0000 7f1fa65e2700 1 -- start start 2023-09-30T22:21:54.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.932+0000 7f1fa65e2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fa006a770 0x7f1fa0133ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.932+0000 7f1fa65e2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fa009dec0 0x7f1fa0134010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.932+0000 7f1fa65e2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1fa0136cb0 0x7f1fa0134550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.932+0000 7f1fa65e2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa0134fa0 con 0x7f1fa009dec0 2023-09-30T22:21:54.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.932+0000 7f1fa65e2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa011a6b0 con 0x7f1fa006a770 2023-09-30T22:21:54.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.932+0000 7f1fa65e2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa0139280 con 0x7f1fa0136cb0 2023-09-30T22:21:54.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.932+0000 7f1f9f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fa009dec0 0x7f1fa0134010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.932+0000 7f1f9ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fa006a770 0x7f1fa0133ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.932+0000 7f1f9f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fa009dec0 0x7f1fa0134010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54216/0 (socket says 172.21.15.156:54216) 2023-09-30T22:21:54.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.932+0000 7f1f9ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fa006a770 0x7f1fa0133ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:55690/0 (socket says 172.21.15.156:55690) 2023-09-30T22:21:54.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.932+0000 7f1f9f7fe700 1 -- 172.21.15.156:0/3843576540 learned_addr learned my addr 172.21.15.156:0/3843576540 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:54.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.932+0000 7f1fa4b7f700 1 --2- 172.21.15.156:0/3843576540 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1fa0136cb0 0x7f1fa0134550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.932+0000 7f1f9f7fe700 1 -- 172.21.15.156:0/3843576540 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1fa0136cb0 msgr2=0x7f1fa0134550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.932+0000 7f1f9f7fe700 1 --2- 172.21.15.156:0/3843576540 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1fa0136cb0 0x7f1fa0134550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.932+0000 7f1f9f7fe700 1 -- 172.21.15.156:0/3843576540 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fa006a770 msgr2=0x7f1fa0133ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.932+0000 7f1f9f7fe700 1 --2- 172.21.15.156:0/3843576540 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fa006a770 0x7f1fa0133ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.932+0000 7f1f9f7fe700 1 -- 172.21.15.156:0/3843576540 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f900094a0 con 0x7f1fa009dec0 2023-09-30T22:21:54.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.932+0000 7f1f9f7fe700 1 --2- 172.21.15.156:0/3843576540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fa009dec0 0x7f1fa0134010 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f1f9400c550 tx=0x7f1f9400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:54.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.932+0000 7f1f9cff9700 1 -- 172.21.15.156:0/3843576540 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f94005d70 con 0x7f1fa009dec0 2023-09-30T22:21:54.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.933+0000 7f1f9cff9700 1 -- 172.21.15.156:0/3843576540 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f940070d0 con 0x7f1fa009dec0 2023-09-30T22:21:54.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.933+0000 7f1f9cff9700 1 -- 172.21.15.156:0/3843576540 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f94007440 con 0x7f1fa009dec0 2023-09-30T22:21:54.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.933+0000 7f1fa65e2700 1 -- 172.21.15.156:0/3843576540 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f98009a70 con 0x7f1fa009dec0 2023-09-30T22:21:54.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.933+0000 7f1fa65e2700 1 -- 172.21.15.156:0/3843576540 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa01196a0 con 0x7f1fa009dec0 2023-09-30T22:21:54.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.933+0000 7f1fa65e2700 1 -- 172.21.15.156:0/3843576540 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa004f2a0 con 0x7f1fa009dec0 2023-09-30T22:21:54.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.933+0000 7f1f9cff9700 1 -- 172.21.15.156:0/3843576540 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f940075a0 con 0x7f1fa009dec0 2023-09-30T22:21:54.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.934+0000 7f1f9cff9700 1 -- 172.21.15.156:0/3843576540 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1f9403ea60 con 0x7f1fa009dec0 2023-09-30T22:21:54.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:54.938+0000 7f1f9cff9700 1 -- 172.21.15.156:0/3843576540 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f94019b40 con 0x7f1fa009dec0 2023-09-30T22:21:55.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.058+0000 7fd6e94cd700 1 Processor -- start 2023-09-30T22:21:55.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.058+0000 7fd6e94cd700 1 -- start start 2023-09-30T22:21:55.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.059+0000 7fd6e94cd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6e409f350 0x7fd6e4136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:55.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.059+0000 7fd6e94cd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6e41371c0 0x7fd6e41395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:55.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.059+0000 7fd6e94cd700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e409c970 con 0x7fd6e409e870 2023-09-30T22:21:55.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.059+0000 7fd6e94cd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e40a0920 con 0x7fd6e41371c0 2023-09-30T22:21:55.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.059+0000 7fd6e94cd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e409f9c0 con 0x7fd6e409f350 2023-09-30T22:21:55.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.059+0000 7fdd9af9a700 1 -- 172.21.15.156:0/1748291819 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdd9404f2a0 con 0x7fdd9409ad40 2023-09-30T22:21:55.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.059+0000 7fd6e2ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fd6e409e870 0x7fd6e409ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40598/0 (socket says 172.21.15.156:40598) 2023-09-30T22:21:55.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.059+0000 7fd6e2ffd700 1 -- 172.21.15.156:0/557780375 learned_addr learned my addr 172.21.15.156:0/557780375 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:55.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.059+0000 7fd6e27fc700 1 --2- 172.21.15.156:0/557780375 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6e409f350 0x7fd6e4136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:55.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.059+0000 7fd6e37fe700 1 --2- 172.21.15.156:0/557780375 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6e41371c0 0x7fd6e41395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:55.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.060+0000 7fd6e27fc700 1 -- 172.21.15.156:0/557780375 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6e41371c0 msgr2=0x7fd6e41395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:55.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.060+0000 7fd6e27fc700 1 --2- 172.21.15.156:0/557780375 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6e41371c0 0x7fd6e41395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.060+0000 7fd6e27fc700 1 -- 172.21.15.156:0/557780375 >> v1:172.21.15.156:6789/0 conn(0x7fd6e409e870 legacy=0x7fd6e409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.060+0000 7fd6e27fc700 1 -- 172.21.15.156:0/557780375 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e409bab0 con 0x7fd6e409f350 2023-09-30T22:21:55.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.060+0000 7fd6e37fe700 1 --2- 172.21.15.156:0/557780375 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6e41371c0 0x7fd6e41395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:55.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.060+0000 7fdd917fa700 1 -- 172.21.15.156:0/1748291819 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdd88017070 con 0x7fdd9409ad40 2023-09-30T22:21:55.063 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:55.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.060+0000 7fd6e27fc700 1 --2- 172.21.15.156:0/557780375 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6e409f350 0x7fd6e4136c80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8009870 tx=0x7fd6d8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64980dcb63048d1b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:55.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.060+0000 7fd6e1ffb700 1 -- 172.21.15.156:0/557780375 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8011830 con 0x7fd6e409f350 2023-09-30T22:21:55.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.060+0000 7fd6e1ffb700 1 -- 172.21.15.156:0/557780375 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d8011990 con 0x7fd6e409f350 2023-09-30T22:21:55.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.060+0000 7fd6e1ffb700 1 -- 172.21.15.156:0/557780375 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8011d20 con 0x7fd6e409f350 2023-09-30T22:21:55.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.061+0000 7fd6e94cd700 1 -- 172.21.15.156:0/557780375 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6e409f350 msgr2=0x7fd6e4136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.061+0000 7fd6e94cd700 1 --2- 172.21.15.156:0/557780375 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6e409f350 0x7fd6e4136c80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8009870 tx=0x7fd6d8009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:55.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.061+0000 7fd6e94cd700 1 -- 172.21.15.156:0/557780375 shutdown_connections 2023-09-30T22:21:55.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.061+0000 7fd6e94cd700 1 --2- 172.21.15.156:0/557780375 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6e41371c0 0x7fd6e41395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.061+0000 7fd6e94cd700 1 --2- 172.21.15.156:0/557780375 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6e409f350 0x7fd6e4136c80 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.061+0000 7fd6e94cd700 1 -- 172.21.15.156:0/557780375 >> 172.21.15.156:0/557780375 conn(0x7fd6e40a4430 msgr2=0x7fd6e40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:55.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.061+0000 7fd6e94cd700 1 -- 172.21.15.156:0/557780375 shutdown_connections 2023-09-30T22:21:55.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.061+0000 7fd6e94cd700 1 -- 172.21.15.156:0/557780375 wait complete. 2023-09-30T22:21:55.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.062+0000 7fdd9af9a700 1 -- 172.21.15.156:0/1748291819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd9409ad40 msgr2=0x7fdd94121390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.062+0000 7fdd9af9a700 1 --2- 172.21.15.156:0/1748291819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd9409ad40 0x7fdd94121390 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fdd8800e8e0 tx=0x7fdd8800ebf0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.062+0000 7fdd9af9a700 1 -- 172.21.15.156:0/1748291819 shutdown_connections 2023-09-30T22:21:55.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.062+0000 7fdd9af9a700 1 --2- 172.21.15.156:0/1748291819 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdd94133f70 0x7fdd94121e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.062+0000 7fdd9af9a700 1 --2- 172.21.15.156:0/1748291819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd9409ad40 0x7fdd94121390 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.062+0000 7fdd9af9a700 1 --2- 172.21.15.156:0/1748291819 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd940a0a70 0x7fdd941218d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.062+0000 7fdd9af9a700 1 -- 172.21.15.156:0/1748291819 >> 172.21.15.156:0/1748291819 conn(0x7fdd94099c40 msgr2=0x7fdd94132b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:55.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.062+0000 7fdd9af9a700 1 -- 172.21.15.156:0/1748291819 shutdown_connections 2023-09-30T22:21:55.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.062+0000 7fdd9af9a700 1 -- 172.21.15.156:0/1748291819 wait complete. 2023-09-30T22:21:55.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.063+0000 7fd6e94cd700 1 Processor -- start 2023-09-30T22:21:55.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.063+0000 7fd6e94cd700 1 -- start start 2023-09-30T22:21:55.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.063+0000 7fd6e94cd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6e409e870 0x7fd6e41c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:55.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.063+0000 7fd6e94cd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6e409f350 0x7fd6e41c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:55.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.063+0000 7fd6e94cd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6e41371c0 0x7fd6e41c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:55.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.063+0000 7fd6e94cd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e4125350 con 0x7fd6e409f350 2023-09-30T22:21:55.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.063+0000 7fd6e94cd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e4126050 con 0x7fd6e41371c0 2023-09-30T22:21:55.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.063+0000 7fd6e94cd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e409dba0 con 0x7fd6e409e870 2023-09-30T22:21:55.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.063+0000 7fd6e2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6e409e870 0x7fd6e41c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:55.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.063+0000 7fd6e2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6e409e870 0x7fd6e41c8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33480/0 (socket says 172.21.15.156:33480) 2023-09-30T22:21:55.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.063+0000 7fd6e2ffd700 1 -- 172.21.15.156:0/2599177060 learned_addr learned my addr 172.21.15.156:0/2599177060 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:55.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.064+0000 7fd6e37fe700 1 --2- 172.21.15.156:0/2599177060 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6e41371c0 0x7fd6e41c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:55.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.064+0000 7fd6e27fc700 1 --2- 172.21.15.156:0/2599177060 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6e409f350 0x7fd6e41c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:55.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.064+0000 7fd6e2ffd700 1 -- 172.21.15.156:0/2599177060 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6e41371c0 msgr2=0x7fd6e41c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.064+0000 7fd6e2ffd700 1 --2- 172.21.15.156:0/2599177060 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6e41371c0 0x7fd6e41c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.064+0000 7fd6e2ffd700 1 -- 172.21.15.156:0/2599177060 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6e409f350 msgr2=0x7fd6e41c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.064+0000 7fd6e2ffd700 1 --2- 172.21.15.156:0/2599177060 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6e409f350 0x7fd6e41c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.064+0000 7fd6e2ffd700 1 -- 172.21.15.156:0/2599177060 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc009a70 con 0x7fd6e409e870 2023-09-30T22:21:55.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.064+0000 7fd6e37fe700 1 --2- 172.21.15.156:0/2599177060 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6e41371c0 0x7fd6e41c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:55.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.064+0000 7fd6e2ffd700 1 --2- 172.21.15.156:0/2599177060 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6e409e870 0x7fd6e41c8440 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd6d400c520 tx=0x7fd6d400c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:55.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.064+0000 7fd6cb7fe700 1 -- 172.21.15.156:0/2599177060 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4005d70 con 0x7fd6e409e870 2023-09-30T22:21:55.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.064+0000 7fd6cb7fe700 1 -- 172.21.15.156:0/2599177060 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d40070d0 con 0x7fd6e409e870 2023-09-30T22:21:55.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.064+0000 7fd6cb7fe700 1 -- 172.21.15.156:0/2599177060 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4007440 con 0x7fd6e409e870 2023-09-30T22:21:55.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.064+0000 7fd6e94cd700 1 -- 172.21.15.156:0/2599177060 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d80094a0 con 0x7fd6e409e870 2023-09-30T22:21:55.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.064+0000 7fd6e94cd700 1 -- 172.21.15.156:0/2599177060 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e406d430 con 0x7fd6e409e870 2023-09-30T22:21:55.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.065+0000 7fd6cb7fe700 1 -- 172.21.15.156:0/2599177060 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd6d40075a0 con 0x7fd6e409e870 2023-09-30T22:21:55.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.065+0000 7fd6cb7fe700 1 -- 172.21.15.156:0/2599177060 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd6d403e9e0 con 0x7fd6e409e870 2023-09-30T22:21:55.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.065+0000 7fd6e94cd700 1 -- 172.21.15.156:0/2599177060 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e404f2a0 con 0x7fd6e409e870 2023-09-30T22:21:55.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.070+0000 7fd6cb7fe700 1 -- 172.21.15.156:0/2599177060 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd6d4019b40 con 0x7fd6e409e870 2023-09-30T22:21:55.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:55.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.138+0000 7f1fa65e2700 1 -- 172.21.15.156:0/3843576540 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1fa009e380 con 0x7f1fa009dec0 2023-09-30T22:21:55.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.138+0000 7f1f9cff9700 1 -- 172.21.15.156:0/3843576540 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f94017030 con 0x7f1fa009dec0 2023-09-30T22:21:55.139 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:55.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.140+0000 7f1fa65e2700 1 -- 172.21.15.156:0/3843576540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fa009dec0 msgr2=0x7f1fa0134010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.140+0000 7f1fa65e2700 1 --2- 172.21.15.156:0/3843576540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fa009dec0 0x7f1fa0134010 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f1f9400c550 tx=0x7f1f9400c860 comp rx=0 tx=0).stop 2023-09-30T22:21:55.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.140+0000 7f1fa65e2700 1 -- 172.21.15.156:0/3843576540 shutdown_connections 2023-09-30T22:21:55.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.140+0000 7f1fa65e2700 1 --2- 172.21.15.156:0/3843576540 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1fa0136cb0 0x7f1fa0134550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.140+0000 7f1fa65e2700 1 --2- 172.21.15.156:0/3843576540 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1fa006a770 0x7f1fa0133ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.140+0000 7f1fa65e2700 1 --2- 172.21.15.156:0/3843576540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fa009dec0 0x7f1fa0134010 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.140+0000 7f1fa65e2700 1 -- 172.21.15.156:0/3843576540 >> 172.21.15.156:0/3843576540 conn(0x7f1fa0099c40 msgr2=0x7f1fa01362a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:55.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.140+0000 7f1fa65e2700 1 -- 172.21.15.156:0/3843576540 shutdown_connections 2023-09-30T22:21:55.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.140+0000 7f1fa65e2700 1 -- 172.21.15.156:0/3843576540 wait complete. 2023-09-30T22:21:55.153 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:55.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.258+0000 7fd6e94cd700 1 -- 172.21.15.156:0/2599177060 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd6e4126530 con 0x7fd6e409e870 2023-09-30T22:21:55.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.259+0000 7fd6cb7fe700 1 -- 172.21.15.156:0/2599177060 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd6d4017020 con 0x7fd6e409e870 2023-09-30T22:21:55.259 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:55.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.261+0000 7fd6e94cd700 1 -- 172.21.15.156:0/2599177060 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6e409e870 msgr2=0x7fd6e41c8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.261+0000 7fd6e94cd700 1 --2- 172.21.15.156:0/2599177060 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6e409e870 0x7fd6e41c8440 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd6d400c520 tx=0x7fd6d400c830 comp rx=0 tx=0).stop 2023-09-30T22:21:55.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.261+0000 7fd6e94cd700 1 -- 172.21.15.156:0/2599177060 shutdown_connections 2023-09-30T22:21:55.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.261+0000 7fd6e94cd700 1 --2- 172.21.15.156:0/2599177060 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6e41371c0 0x7fd6e41c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.261+0000 7fd6e94cd700 1 --2- 172.21.15.156:0/2599177060 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6e409e870 0x7fd6e41c8440 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.261+0000 7fd6e94cd700 1 --2- 172.21.15.156:0/2599177060 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6e409f350 0x7fd6e41c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.261+0000 7fd6e94cd700 1 -- 172.21.15.156:0/2599177060 >> 172.21.15.156:0/2599177060 conn(0x7fd6e40a4430 msgr2=0x7fd6e409cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:55.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.261+0000 7fd6e94cd700 1 -- 172.21.15.156:0/2599177060 shutdown_connections 2023-09-30T22:21:55.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.261+0000 7fd6e94cd700 1 -- 172.21.15.156:0/2599177060 wait complete. 2023-09-30T22:21:55.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:55.763 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:55.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.888+0000 7f25f410a700 1 Processor -- start 2023-09-30T22:21:55.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.888+0000 7f25f410a700 1 -- start start 2023-09-30T22:21:55.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.889+0000 7f25f410a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f25ec136960 0x7f25ec138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:55.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.889+0000 7f25f410a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25ec139280 0x7f25ec13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:55.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.889+0000 7f25f410a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25ec06b2d0 con 0x7f25ec133ad0 2023-09-30T22:21:55.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.889+0000 7f25f410a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25ec1345b0 con 0x7f25ec136960 2023-09-30T22:21:55.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.889+0000 7f25f410a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25ec133610 con 0x7f25ec139280 2023-09-30T22:21:55.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.889+0000 7f25f26a7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25ec139280 0x7f25ec13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:55.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.889+0000 7f25f26a7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25ec139280 0x7f25ec13b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33488/0 (socket says 172.21.15.156:33488) 2023-09-30T22:21:55.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.889+0000 7f25f26a7700 1 -- 172.21.15.156:0/597331983 learned_addr learned my addr 172.21.15.156:0/597331983 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:55.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.889+0000 7f25f16a5700 1 --2- 172.21.15.156:0/597331983 >> v2:172.21.15.156:3300/0 conn(0x7f25ec136960 0x7f25ec138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:55.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.889+0000 7f25f16a5700 1 -- 172.21.15.156:0/597331983 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25ec139280 msgr2=0x7f25ec13b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:55.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.889+0000 7f25f16a5700 1 --2- 172.21.15.156:0/597331983 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25ec139280 0x7f25ec13b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.889+0000 7f25f16a5700 1 -- 172.21.15.156:0/597331983 >> v1:172.21.15.156:6789/0 conn(0x7f25ec133ad0 legacy=0x7f25ec133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.889+0000 7f25f16a5700 1 -- 172.21.15.156:0/597331983 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ec09a500 con 0x7f25ec136960 2023-09-30T22:21:55.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.889+0000 7f25f26a7700 1 --2- 172.21.15.156:0/597331983 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25ec139280 0x7f25ec13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:55.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.889+0000 7f25f0ea4700 1 -- 172.21.15.156:0/597331983 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4001317818 0 0) 0x7f25ec06b2d0 con 0x7f25ec133ad0 2023-09-30T22:21:55.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.890+0000 7f25f16a5700 1 --2- 172.21.15.156:0/597331983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25ec136960 0x7f25ec138d40 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f25e8009840 tx=0x7f25e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10501d623631f6b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:55.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.890+0000 7f25f0ea4700 1 -- 172.21.15.156:0/597331983 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e8011830 con 0x7f25ec136960 2023-09-30T22:21:55.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.890+0000 7f25f0ea4700 1 -- 172.21.15.156:0/597331983 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e8011990 con 0x7f25ec136960 2023-09-30T22:21:55.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.890+0000 7f25f0ea4700 1 -- 172.21.15.156:0/597331983 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e8011d20 con 0x7f25ec136960 2023-09-30T22:21:55.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.890+0000 7f25f410a700 1 -- 172.21.15.156:0/597331983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25ec136960 msgr2=0x7f25ec138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.890+0000 7f25f410a700 1 --2- 172.21.15.156:0/597331983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25ec136960 0x7f25ec138d40 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f25e8009840 tx=0x7f25e8009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:55.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.890+0000 7f25f410a700 1 -- 172.21.15.156:0/597331983 shutdown_connections 2023-09-30T22:21:55.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.890+0000 7f25f410a700 1 --2- 172.21.15.156:0/597331983 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25ec139280 0x7f25ec13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.890+0000 7f25f410a700 1 --2- 172.21.15.156:0/597331983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25ec136960 0x7f25ec138d40 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.890+0000 7f25f410a700 1 -- 172.21.15.156:0/597331983 >> 172.21.15.156:0/597331983 conn(0x7f25ec099c40 msgr2=0x7f25ec0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:55.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.890+0000 7f25f410a700 1 -- 172.21.15.156:0/597331983 shutdown_connections 2023-09-30T22:21:55.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.890+0000 7f25f410a700 1 -- 172.21.15.156:0/597331983 wait complete. 2023-09-30T22:21:55.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.891+0000 7f25f410a700 1 Processor -- start 2023-09-30T22:21:55.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.891+0000 7f25f410a700 1 -- start start 2023-09-30T22:21:55.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.892+0000 7f25f410a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25ec133ad0 0x7f25ec071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:55.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.892+0000 7f25f410a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25ec136960 0x7f25ec071690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:55.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.892+0000 7f25f410a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25ec139280 0x7f25ec071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:55.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.892+0000 7f25f410a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ec06ec30 con 0x7f25ec136960 2023-09-30T22:21:55.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.892+0000 7f25f410a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25ec072200 con 0x7f25ec133ad0 2023-09-30T22:21:55.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.892+0000 7f25f410a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25ec1317a0 con 0x7f25ec139280 2023-09-30T22:21:55.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.892+0000 7f25f1ea6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25ec133ad0 0x7f25ec071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:55.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.892+0000 7f25f26a7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25ec139280 0x7f25ec071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:55.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.892+0000 7f25f26a7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25ec139280 0x7f25ec071bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33498/0 (socket says 172.21.15.156:33498) 2023-09-30T22:21:55.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.892+0000 7f25f1ea6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25ec133ad0 0x7f25ec071150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:55730/0 (socket says 172.21.15.156:55730) 2023-09-30T22:21:55.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.892+0000 7f25f26a7700 1 -- 172.21.15.156:0/1538688768 learned_addr learned my addr 172.21.15.156:0/1538688768 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:55.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.892+0000 7f25f16a5700 1 --2- 172.21.15.156:0/1538688768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25ec136960 0x7f25ec071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:55.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.892+0000 7f25f26a7700 1 -- 172.21.15.156:0/1538688768 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25ec133ad0 msgr2=0x7f25ec071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.892+0000 7f25f26a7700 1 --2- 172.21.15.156:0/1538688768 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25ec133ad0 0x7f25ec071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.892+0000 7f25f26a7700 1 -- 172.21.15.156:0/1538688768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25ec136960 msgr2=0x7f25ec071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.892+0000 7f25f26a7700 1 --2- 172.21.15.156:0/1538688768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25ec136960 0x7f25ec071690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.892+0000 7f25f26a7700 1 -- 172.21.15.156:0/1538688768 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e4009b30 con 0x7f25ec139280 2023-09-30T22:21:55.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.892+0000 7f25f1ea6700 1 --2- 172.21.15.156:0/1538688768 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25ec133ad0 0x7f25ec071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:55.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.892+0000 7f25f16a5700 1 --2- 172.21.15.156:0/1538688768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25ec136960 0x7f25ec071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:55.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.892+0000 7f25f26a7700 1 --2- 172.21.15.156:0/1538688768 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25ec139280 0x7f25ec071bd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f25e400ef90 tx=0x7f25e400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:55.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.892+0000 7f25e27fc700 1 -- 172.21.15.156:0/1538688768 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e4003c20 con 0x7f25ec139280 2023-09-30T22:21:55.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.892+0000 7f25e27fc700 1 -- 172.21.15.156:0/1538688768 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e400f040 con 0x7f25ec139280 2023-09-30T22:21:55.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.892+0000 7f25e27fc700 1 -- 172.21.15.156:0/1538688768 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e400c880 con 0x7f25ec139280 2023-09-30T22:21:55.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.892+0000 7f25f410a700 1 -- 172.21.15.156:0/1538688768 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e80094a0 con 0x7f25ec139280 2023-09-30T22:21:55.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.893+0000 7f25f410a700 1 -- 172.21.15.156:0/1538688768 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25ec06ee50 con 0x7f25ec139280 2023-09-30T22:21:55.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.893+0000 7f25e27fc700 1 -- 172.21.15.156:0/1538688768 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25e400c9e0 con 0x7f25ec139280 2023-09-30T22:21:55.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.893+0000 7f25e27fc700 1 -- 172.21.15.156:0/1538688768 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f25e403fa80 con 0x7f25ec139280 2023-09-30T22:21:55.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.893+0000 7f25f410a700 1 -- 172.21.15.156:0/1538688768 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25ec04f2a0 con 0x7f25ec139280 2023-09-30T22:21:55.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:55.898+0000 7f25e27fc700 1 -- 172.21.15.156:0/1538688768 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25e4014440 con 0x7f25ec139280 2023-09-30T22:21:56.077 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:56.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.080+0000 7f25f410a700 1 -- 172.21.15.156:0/1538688768 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f25ec09f0f0 con 0x7f25ec139280 2023-09-30T22:21:56.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.080+0000 7f25e27fc700 1 -- 172.21.15.156:0/1538688768 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25e40133e0 con 0x7f25ec139280 2023-09-30T22:21:56.081 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:56.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.082+0000 7f25f410a700 1 -- 172.21.15.156:0/1538688768 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25ec139280 msgr2=0x7f25ec071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.082+0000 7f25f410a700 1 --2- 172.21.15.156:0/1538688768 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25ec139280 0x7f25ec071bd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f25e400ef90 tx=0x7f25e400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.082+0000 7f25f410a700 1 -- 172.21.15.156:0/1538688768 shutdown_connections 2023-09-30T22:21:56.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.082+0000 7f25f410a700 1 --2- 172.21.15.156:0/1538688768 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25ec139280 0x7f25ec071bd0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.082+0000 7f25f410a700 1 --2- 172.21.15.156:0/1538688768 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25ec133ad0 0x7f25ec071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.082+0000 7f25f410a700 1 --2- 172.21.15.156:0/1538688768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25ec136960 0x7f25ec071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.082+0000 7f25f410a700 1 -- 172.21.15.156:0/1538688768 >> 172.21.15.156:0/1538688768 conn(0x7f25ec099c40 msgr2=0x7f25ec0a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:56.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.082+0000 7f25f410a700 1 -- 172.21.15.156:0/1538688768 shutdown_connections 2023-09-30T22:21:56.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.082+0000 7f25f410a700 1 -- 172.21.15.156:0/1538688768 wait complete. 2023-09-30T22:21:56.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:56.154 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:56.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.203+0000 7fe3189ea700 1 Processor -- start 2023-09-30T22:21:56.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.203+0000 7fe3189ea700 1 -- start start 2023-09-30T22:21:56.206 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.203+0000 7fe3189ea700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe31409ad40 0x7fe314133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.206 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.203+0000 7fe3189ea700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe314133f70 0x7fe3141343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.206 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.203+0000 7fe3189ea700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3140a0a70 0x7fe3140a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.206 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.203+0000 7fe3189ea700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3140a3b60 con 0x7fe314133f70 2023-09-30T22:21:56.206 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.203+0000 7fe3189ea700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3141348e0 con 0x7fe3140a0a70 2023-09-30T22:21:56.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.203+0000 7fe3189ea700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe31409b110 con 0x7fe31409ad40 2023-09-30T22:21:56.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.204+0000 7fe311d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe314133f70 0x7fe3141343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.204+0000 7fe312d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3140a0a70 0x7fe3140a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.204+0000 7fe311d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe314133f70 0x7fe3141343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54256/0 (socket says 172.21.15.156:54256) 2023-09-30T22:21:56.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.204+0000 7fe312d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3140a0a70 0x7fe3140a0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:55732/0 (socket says 172.21.15.156:55732) 2023-09-30T22:21:56.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.204+0000 7fe311d9b700 1 -- 172.21.15.156:0/4200689589 learned_addr learned my addr 172.21.15.156:0/4200689589 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:56.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.204+0000 7fe31259c700 1 --2- 172.21.15.156:0/4200689589 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe31409ad40 0x7fe314133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.204+0000 7fe31259c700 1 -- 172.21.15.156:0/4200689589 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3140a0a70 msgr2=0x7fe3140a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:56.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.204+0000 7fe31259c700 1 --2- 172.21.15.156:0/4200689589 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3140a0a70 0x7fe3140a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.204+0000 7fe31259c700 1 -- 172.21.15.156:0/4200689589 >> v2:172.21.15.156:3300/0 conn(0x7fe314133f70 msgr2=0x7fe3141343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:56.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.204+0000 7fe31259c700 1 --2- 172.21.15.156:0/4200689589 >> v2:172.21.15.156:3300/0 conn(0x7fe314133f70 0x7fe3141343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.204+0000 7fe31259c700 1 -- 172.21.15.156:0/4200689589 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3140a2fa0 con 0x7fe31409ad40 2023-09-30T22:21:56.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.204+0000 7fe312d9d700 1 --2- 172.21.15.156:0/4200689589 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3140a0a70 0x7fe3140a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:56.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.204+0000 7fe311d9b700 1 --2- 172.21.15.156:0/4200689589 >> v2:172.21.15.156:3300/0 conn(0x7fe314133f70 0x7fe3141343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:56.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.204+0000 7fe31259c700 1 --2- 172.21.15.156:0/4200689589 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe31409ad40 0x7fe314133a30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe304009870 tx=0x7fe304009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed3a485065ddde3e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:56.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.204+0000 7fe31159a700 1 -- 172.21.15.156:0/4200689589 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe304011830 con 0x7fe31409ad40 2023-09-30T22:21:56.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.204+0000 7fe31159a700 1 -- 172.21.15.156:0/4200689589 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe304011990 con 0x7fe31409ad40 2023-09-30T22:21:56.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.204+0000 7fe31159a700 1 -- 172.21.15.156:0/4200689589 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe304011d20 con 0x7fe31409ad40 2023-09-30T22:21:56.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.205+0000 7fe3189ea700 1 -- 172.21.15.156:0/4200689589 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe31409ad40 msgr2=0x7fe314133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.205+0000 7fe3189ea700 1 --2- 172.21.15.156:0/4200689589 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe31409ad40 0x7fe314133a30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe304009870 tx=0x7fe304009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:56.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.205+0000 7fe3189ea700 1 -- 172.21.15.156:0/4200689589 shutdown_connections 2023-09-30T22:21:56.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.205+0000 7fe3189ea700 1 --2- 172.21.15.156:0/4200689589 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe3140a0a70 0x7fe3140a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.205+0000 7fe3189ea700 1 --2- 172.21.15.156:0/4200689589 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe31409ad40 0x7fe314133a30 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.205+0000 7fe3189ea700 1 --2- 172.21.15.156:0/4200689589 >> v2:172.21.15.156:3300/0 conn(0x7fe314133f70 0x7fe3141343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.205+0000 7fe3189ea700 1 -- 172.21.15.156:0/4200689589 >> 172.21.15.156:0/4200689589 conn(0x7fe314099c40 msgr2=0x7fe31406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:56.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.205+0000 7fe3189ea700 1 -- 172.21.15.156:0/4200689589 shutdown_connections 2023-09-30T22:21:56.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.205+0000 7fe3189ea700 1 -- 172.21.15.156:0/4200689589 wait complete. 2023-09-30T22:21:56.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.206+0000 7fe3189ea700 1 Processor -- start 2023-09-30T22:21:56.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.206+0000 7fe3189ea700 1 -- start start 2023-09-30T22:21:56.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.207+0000 7fe3189ea700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe31409ad40 0x7fe314121210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.207+0000 7fe3189ea700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3140a0a70 0x7fe314121750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.207+0000 7fe3189ea700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe314133f70 0x7fe314121c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.207+0000 7fe3189ea700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe314124d30 con 0x7fe3140a0a70 2023-09-30T22:21:56.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.207+0000 7fe3189ea700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe314123cd0 con 0x7fe31409ad40 2023-09-30T22:21:56.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.207+0000 7fe3189ea700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe314122670 con 0x7fe314133f70 2023-09-30T22:21:56.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.207+0000 7fe311d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3140a0a70 0x7fe314121750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.207+0000 7fe312d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe314133f70 0x7fe314121c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.207+0000 7fe312d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe314133f70 0x7fe314121c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33506/0 (socket says 172.21.15.156:33506) 2023-09-30T22:21:56.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.207+0000 7fe31259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe31409ad40 0x7fe314121210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.207+0000 7fe311d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3140a0a70 0x7fe314121750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54264/0 (socket says 172.21.15.156:54264) 2023-09-30T22:21:56.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.207+0000 7fe312d9d700 1 -- 172.21.15.156:0/2728169332 learned_addr learned my addr 172.21.15.156:0/2728169332 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:56.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.207+0000 7fe311d9b700 1 -- 172.21.15.156:0/2728169332 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe314133f70 msgr2=0x7fe314121c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.207+0000 7fe311d9b700 1 --2- 172.21.15.156:0/2728169332 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe314133f70 0x7fe314121c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.207+0000 7fe311d9b700 1 -- 172.21.15.156:0/2728169332 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe31409ad40 msgr2=0x7fe314121210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.207+0000 7fe311d9b700 1 --2- 172.21.15.156:0/2728169332 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe31409ad40 0x7fe314121210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.207+0000 7fe311d9b700 1 -- 172.21.15.156:0/2728169332 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30c009a70 con 0x7fe3140a0a70 2023-09-30T22:21:56.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.207+0000 7fe312d9d700 1 --2- 172.21.15.156:0/2728169332 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe314133f70 0x7fe314121c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:56.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.207+0000 7fe311d9b700 1 --2- 172.21.15.156:0/2728169332 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3140a0a70 0x7fe314121750 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe30800e9a0 tx=0x7fe30800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:56.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.207+0000 7fe302ffd700 1 -- 172.21.15.156:0/2728169332 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe308004240 con 0x7fe3140a0a70 2023-09-30T22:21:56.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.207+0000 7fe302ffd700 1 -- 172.21.15.156:0/2728169332 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3080043a0 con 0x7fe3140a0a70 2023-09-30T22:21:56.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.207+0000 7fe3189ea700 1 -- 172.21.15.156:0/2728169332 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe308009550 con 0x7fe3140a0a70 2023-09-30T22:21:56.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.207+0000 7fe302ffd700 1 -- 172.21.15.156:0/2728169332 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3080036a0 con 0x7fe3140a0a70 2023-09-30T22:21:56.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.208+0000 7fe3189ea700 1 -- 172.21.15.156:0/2728169332 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3040094a0 con 0x7fe3140a0a70 2023-09-30T22:21:56.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.208+0000 7fe302ffd700 1 -- 172.21.15.156:0/2728169332 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe308003800 con 0x7fe3140a0a70 2023-09-30T22:21:56.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.208+0000 7fe302ffd700 1 -- 172.21.15.156:0/2728169332 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe30803f880 con 0x7fe3140a0a70 2023-09-30T22:21:56.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.209+0000 7fe3189ea700 1 -- 172.21.15.156:0/2728169332 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe31411e060 con 0x7fe3140a0a70 2023-09-30T22:21:56.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.213+0000 7fe302ffd700 1 -- 172.21.15.156:0/2728169332 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe308013470 con 0x7fe3140a0a70 2023-09-30T22:21:56.275 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:56.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.280+0000 7fbadf9d8700 1 Processor -- start 2023-09-30T22:21:56.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.280+0000 7fbadf9d8700 1 -- start start 2023-09-30T22:21:56.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.280+0000 7fbadf9d8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbad809d860 0x7fbad809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.280+0000 7fbadf9d8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbad8130eb0 0x7fbad8138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.280+0000 7fbadf9d8700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad809aaa0 con 0x7fbad809e170 2023-09-30T22:21:56.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.280+0000 7fbadf9d8700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad809f870 con 0x7fbad809d860 2023-09-30T22:21:56.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.280+0000 7fbadf9d8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad809b360 con 0x7fbad8130eb0 2023-09-30T22:21:56.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.280+0000 7fbadcf73700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fbad809e170 0x7fbad81307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40620/0 (socket says 172.21.15.156:40620) 2023-09-30T22:21:56.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.280+0000 7fbadcf73700 1 -- 172.21.15.156:0/217964462 learned_addr learned my addr 172.21.15.156:0/217964462 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:56.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.280+0000 7fbadd774700 1 --2- 172.21.15.156:0/217964462 >> v2:172.21.15.156:3300/0 conn(0x7fbad809d860 0x7fbad809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.280+0000 7fbaddf75700 1 --2- 172.21.15.156:0/217964462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbad8130eb0 0x7fbad8138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.281+0000 7fbacffff700 1 -- 172.21.15.156:0/217964462 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1573608756 0 0) 0x7fbad809aaa0 con 0x7fbad809e170 2023-09-30T22:21:56.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.281+0000 7fbacffff700 1 -- 172.21.15.156:0/217964462 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbac40035b0 con 0x7fbad809e170 2023-09-30T22:21:56.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.281+0000 7fbaddf75700 1 -- 172.21.15.156:0/217964462 >> v2:172.21.15.156:3300/0 conn(0x7fbad809d860 msgr2=0x7fbad809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:56.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.281+0000 7fbaddf75700 1 --2- 172.21.15.156:0/217964462 >> v2:172.21.15.156:3300/0 conn(0x7fbad809d860 0x7fbad809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.281+0000 7fbaddf75700 1 -- 172.21.15.156:0/217964462 >> v1:172.21.15.156:6789/0 conn(0x7fbad809e170 legacy=0x7fbad81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.281+0000 7fbaddf75700 1 -- 172.21.15.156:0/217964462 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad809b620 con 0x7fbad8130eb0 2023-09-30T22:21:56.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.281+0000 7fbaddf75700 1 --2- 172.21.15.156:0/217964462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbad8130eb0 0x7fbad8138a00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbad000f370 tx=0x7fbad000f680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=575fd3224abf0fb2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:56.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.281+0000 7fbacffff700 1 -- 172.21.15.156:0/217964462 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad0012070 con 0x7fbad8130eb0 2023-09-30T22:21:56.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.281+0000 7fbacffff700 1 -- 172.21.15.156:0/217964462 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad000fe70 con 0x7fbad8130eb0 2023-09-30T22:21:56.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.281+0000 7fbacffff700 1 -- 172.21.15.156:0/217964462 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad000d2f0 con 0x7fbad8130eb0 2023-09-30T22:21:56.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.282+0000 7fbadf9d8700 1 -- 172.21.15.156:0/217964462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbad8130eb0 msgr2=0x7fbad8138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.282+0000 7fbadf9d8700 1 --2- 172.21.15.156:0/217964462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbad8130eb0 0x7fbad8138a00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbad000f370 tx=0x7fbad000f680 comp rx=0 tx=0).stop 2023-09-30T22:21:56.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.282+0000 7fbadf9d8700 1 -- 172.21.15.156:0/217964462 shutdown_connections 2023-09-30T22:21:56.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.282+0000 7fbadf9d8700 1 --2- 172.21.15.156:0/217964462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbad8130eb0 0x7fbad8138a00 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.282+0000 7fbadf9d8700 1 --2- 172.21.15.156:0/217964462 >> v2:172.21.15.156:3300/0 conn(0x7fbad809d860 0x7fbad809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.282+0000 7fbadf9d8700 1 -- 172.21.15.156:0/217964462 >> 172.21.15.156:0/217964462 conn(0x7fbad8099c40 msgr2=0x7fbad80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:56.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.282+0000 7fbadf9d8700 1 -- 172.21.15.156:0/217964462 shutdown_connections 2023-09-30T22:21:56.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.282+0000 7fbadf9d8700 1 -- 172.21.15.156:0/217964462 wait complete. 2023-09-30T22:21:56.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.283+0000 7fbadf9d8700 1 Processor -- start 2023-09-30T22:21:56.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.283+0000 7fbadf9d8700 1 -- start start 2023-09-30T22:21:56.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.284+0000 7fbadf9d8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbad809d860 0x7fbad811e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.284+0000 7fbadf9d8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbad809e170 0x7fbad811e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.284+0000 7fbadf9d8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbad8130eb0 0x7fbad811ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.284+0000 7fbadf9d8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad809c920 con 0x7fbad809d860 2023-09-30T22:21:56.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.284+0000 7fbadf9d8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad80a07b0 con 0x7fbad809e170 2023-09-30T22:21:56.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.284+0000 7fbadf9d8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbad81206a0 con 0x7fbad8130eb0 2023-09-30T22:21:56.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.284+0000 7fbadcf73700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbad809e170 0x7fbad811e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.284+0000 7fbadcf73700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbad809e170 0x7fbad811e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:55764/0 (socket says 172.21.15.156:55764) 2023-09-30T22:21:56.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.284+0000 7fbadcf73700 1 -- 172.21.15.156:0/1580825383 learned_addr learned my addr 172.21.15.156:0/1580825383 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:56.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.284+0000 7fbadd774700 1 --2- 172.21.15.156:0/1580825383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbad809d860 0x7fbad811e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.284+0000 7fbaddf75700 1 --2- 172.21.15.156:0/1580825383 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbad8130eb0 0x7fbad811ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.284+0000 7fbadcf73700 1 -- 172.21.15.156:0/1580825383 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbad8130eb0 msgr2=0x7fbad811ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.284+0000 7fbadcf73700 1 --2- 172.21.15.156:0/1580825383 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbad8130eb0 0x7fbad811ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.284+0000 7fbadcf73700 1 -- 172.21.15.156:0/1580825383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbad809d860 msgr2=0x7fbad811e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.284+0000 7fbadcf73700 1 --2- 172.21.15.156:0/1580825383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbad809d860 0x7fbad811e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.284+0000 7fbadcf73700 1 -- 172.21.15.156:0/1580825383 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad000f050 con 0x7fbad809e170 2023-09-30T22:21:56.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.284+0000 7fbadcf73700 1 --2- 172.21.15.156:0/1580825383 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbad809e170 0x7fbad811e7b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbac8005910 tx=0x7fbac800c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:56.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.285+0000 7fbacdffb700 1 -- 172.21.15.156:0/1580825383 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac8005d70 con 0x7fbad809e170 2023-09-30T22:21:56.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.285+0000 7fbacdffb700 1 -- 172.21.15.156:0/1580825383 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac80070d0 con 0x7fbad809e170 2023-09-30T22:21:56.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.285+0000 7fbacdffb700 1 -- 172.21.15.156:0/1580825383 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac8007460 con 0x7fbad809e170 2023-09-30T22:21:56.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.285+0000 7fbadf9d8700 1 -- 172.21.15.156:0/1580825383 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad81210d0 con 0x7fbad809e170 2023-09-30T22:21:56.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.285+0000 7fbadf9d8700 1 -- 172.21.15.156:0/1580825383 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad8121520 con 0x7fbad809e170 2023-09-30T22:21:56.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.285+0000 7fbacdffb700 1 -- 172.21.15.156:0/1580825383 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbac80075c0 con 0x7fbad809e170 2023-09-30T22:21:56.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.286+0000 7fbacdffb700 1 -- 172.21.15.156:0/1580825383 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbac803eb20 con 0x7fbad809e170 2023-09-30T22:21:56.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.286+0000 7fbadf9d8700 1 -- 172.21.15.156:0/1580825383 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad804f2a0 con 0x7fbad809e170 2023-09-30T22:21:56.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.290+0000 7fbacdffb700 1 -- 172.21.15.156:0/1580825383 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbac8017080 con 0x7fbad809e170 2023-09-30T22:21:56.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.401+0000 7fe00897e700 1 Processor -- start 2023-09-30T22:21:56.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.401+0000 7fe00897e700 1 -- start start 2023-09-30T22:21:56.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.402+0000 7fe00897e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe0040a0a70 0x7fe0040a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.402+0000 7fe00897e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0040a1380 0x7fe004133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.402+0000 7fe00897e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe00409dc00 con 0x7fe004133f50 2023-09-30T22:21:56.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.402+0000 7fe00897e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00409ea60 con 0x7fe0040a1380 2023-09-30T22:21:56.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.402+0000 7fe00897e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe00409dec0 con 0x7fe0040a0a70 2023-09-30T22:21:56.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.402+0000 7fe00259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe0040a0a70 0x7fe0040a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.402+0000 7fe002d9d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe004133f50 0x7fe00413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40626/0 (socket says 172.21.15.156:40626) 2023-09-30T22:21:56.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.402+0000 7fe002d9d700 1 -- 172.21.15.156:0/1988714278 learned_addr learned my addr 172.21.15.156:0/1988714278 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:56.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.402+0000 7fe001d9b700 1 --2- 172.21.15.156:0/1988714278 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0040a1380 0x7fe004133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.403+0000 7fe00159a700 1 -- 172.21.15.156:0/1988714278 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 817245388 0 0) 0x7fe00409dc00 con 0x7fe004133f50 2023-09-30T22:21:56.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.403+0000 7fe00159a700 1 -- 172.21.15.156:0/1988714278 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfec0035b0 con 0x7fe004133f50 2023-09-30T22:21:56.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.403+0000 7fe00259c700 1 -- 172.21.15.156:0/1988714278 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0040a1380 msgr2=0x7fe004133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:56.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.403+0000 7fe00259c700 1 --2- 172.21.15.156:0/1988714278 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0040a1380 0x7fe004133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.403+0000 7fe00259c700 1 -- 172.21.15.156:0/1988714278 >> v1:172.21.15.156:6789/0 conn(0x7fe004133f50 legacy=0x7fe00413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.403+0000 7fe00259c700 1 -- 172.21.15.156:0/1988714278 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00409e6a0 con 0x7fe0040a0a70 2023-09-30T22:21:56.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.403+0000 7fe001d9b700 1 --2- 172.21.15.156:0/1988714278 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0040a1380 0x7fe004133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:56.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.403+0000 7fe00259c700 1 --2- 172.21.15.156:0/1988714278 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe0040a0a70 0x7fe0040a0e40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdff4009870 tx=0x7fdff4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86d68c39c3c84af9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:56.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.403+0000 7fe00159a700 1 -- 172.21.15.156:0/1988714278 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff4011830 con 0x7fe0040a0a70 2023-09-30T22:21:56.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.403+0000 7fe00159a700 1 -- 172.21.15.156:0/1988714278 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff4011990 con 0x7fe0040a0a70 2023-09-30T22:21:56.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.403+0000 7fe00159a700 1 -- 172.21.15.156:0/1988714278 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff4011d00 con 0x7fe0040a0a70 2023-09-30T22:21:56.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.404+0000 7fe00897e700 1 -- 172.21.15.156:0/1988714278 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe0040a0a70 msgr2=0x7fe0040a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.404+0000 7fe00897e700 1 --2- 172.21.15.156:0/1988714278 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe0040a0a70 0x7fe0040a0e40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdff4009870 tx=0x7fdff4009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:56.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.404+0000 7fe00897e700 1 -- 172.21.15.156:0/1988714278 shutdown_connections 2023-09-30T22:21:56.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.404+0000 7fe00897e700 1 --2- 172.21.15.156:0/1988714278 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe0040a0a70 0x7fe0040a0e40 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.404+0000 7fe00897e700 1 --2- 172.21.15.156:0/1988714278 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0040a1380 0x7fe004133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.404+0000 7fe00897e700 1 -- 172.21.15.156:0/1988714278 >> 172.21.15.156:0/1988714278 conn(0x7fe0040a6610 msgr2=0x7fe0040a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:56.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.404+0000 7fe00897e700 1 -- 172.21.15.156:0/1988714278 shutdown_connections 2023-09-30T22:21:56.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.404+0000 7fe00897e700 1 -- 172.21.15.156:0/1988714278 wait complete. 2023-09-30T22:21:56.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.405+0000 7fe00897e700 1 Processor -- start 2023-09-30T22:21:56.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.405+0000 7fe00897e700 1 -- start start 2023-09-30T22:21:56.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.405+0000 7fe00897e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0040a0a70 0x7fe004122760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.405+0000 7fe00897e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0040a1380 0x7fe004122ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.405+0000 7fe00897e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe004133f50 0x7fe0041231e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.405+0000 7fe00897e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0041259d0 con 0x7fe0040a0a70 2023-09-30T22:21:56.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.405+0000 7fe00897e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe004133330 con 0x7fe0040a1380 2023-09-30T22:21:56.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.405+0000 7fe00897e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe004124370 con 0x7fe004133f50 2023-09-30T22:21:56.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.405+0000 7fe001d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0040a1380 0x7fe004122ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.405+0000 7fe001d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0040a1380 0x7fe004122ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:55784/0 (socket says 172.21.15.156:55784) 2023-09-30T22:21:56.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.405+0000 7fe001d9b700 1 -- 172.21.15.156:0/3205797144 learned_addr learned my addr 172.21.15.156:0/3205797144 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:56.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.405+0000 7fe002d9d700 1 --2- 172.21.15.156:0/3205797144 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe004133f50 0x7fe0041231e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.406+0000 7fe00259c700 1 --2- 172.21.15.156:0/3205797144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0040a0a70 0x7fe004122760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.406+0000 7fe001d9b700 1 -- 172.21.15.156:0/3205797144 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe004133f50 msgr2=0x7fe0041231e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.406+0000 7fe001d9b700 1 --2- 172.21.15.156:0/3205797144 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe004133f50 0x7fe0041231e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.406+0000 7fe001d9b700 1 -- 172.21.15.156:0/3205797144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0040a0a70 msgr2=0x7fe004122760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.406+0000 7fe001d9b700 1 --2- 172.21.15.156:0/3205797144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0040a0a70 0x7fe004122760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.406+0000 7fe001d9b700 1 -- 172.21.15.156:0/3205797144 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff80094a0 con 0x7fe0040a1380 2023-09-30T22:21:56.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.406+0000 7fe002d9d700 1 --2- 172.21.15.156:0/3205797144 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe004133f50 0x7fe0041231e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:56.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.406+0000 7fe001d9b700 1 --2- 172.21.15.156:0/3205797144 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0040a1380 0x7fe004122ca0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdff800ebb0 tx=0x7fdff800eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:56.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.406+0000 7fdff2ffd700 1 -- 172.21.15.156:0/3205797144 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff800c850 con 0x7fe0040a1380 2023-09-30T22:21:56.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.406+0000 7fdff2ffd700 1 -- 172.21.15.156:0/3205797144 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff800c9b0 con 0x7fe0040a1380 2023-09-30T22:21:56.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.406+0000 7fe00897e700 1 -- 172.21.15.156:0/3205797144 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff40094a0 con 0x7fe0040a1380 2023-09-30T22:21:56.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.406+0000 7fdff2ffd700 1 -- 172.21.15.156:0/3205797144 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff800cd40 con 0x7fe0040a1380 2023-09-30T22:21:56.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.406+0000 7fe00897e700 1 -- 172.21.15.156:0/3205797144 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0041336b0 con 0x7fe0040a1380 2023-09-30T22:21:56.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.407+0000 7fdff2ffd700 1 -- 172.21.15.156:0/3205797144 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdff8013470 con 0x7fe0040a1380 2023-09-30T22:21:56.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.407+0000 7fe00897e700 1 -- 172.21.15.156:0/3205797144 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe00404f2a0 con 0x7fe0040a1380 2023-09-30T22:21:56.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.408+0000 7fdff2ffd700 1 -- 172.21.15.156:0/3205797144 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdff803f8a0 con 0x7fe0040a1380 2023-09-30T22:21:56.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.412+0000 7fdff2ffd700 1 -- 172.21.15.156:0/3205797144 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdff80232f0 con 0x7fe0040a1380 2023-09-30T22:21:56.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.412+0000 7fe3189ea700 1 -- 172.21.15.156:0/2728169332 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe31409c7e0 con 0x7fe3140a0a70 2023-09-30T22:21:56.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.413+0000 7fe302ffd700 1 -- 172.21.15.156:0/2728169332 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe30802a090 con 0x7fe3140a0a70 2023-09-30T22:21:56.415 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:56.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.415+0000 7fe3189ea700 1 -- 172.21.15.156:0/2728169332 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3140a0a70 msgr2=0x7fe314121750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.415+0000 7fe3189ea700 1 --2- 172.21.15.156:0/2728169332 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3140a0a70 0x7fe314121750 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe30800e9a0 tx=0x7fe30800ecb0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.415+0000 7fe3189ea700 1 -- 172.21.15.156:0/2728169332 shutdown_connections 2023-09-30T22:21:56.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.415+0000 7fe3189ea700 1 --2- 172.21.15.156:0/2728169332 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe314133f70 0x7fe314121c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.415+0000 7fe3189ea700 1 --2- 172.21.15.156:0/2728169332 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe31409ad40 0x7fe314121210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.415+0000 7fe3189ea700 1 --2- 172.21.15.156:0/2728169332 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3140a0a70 0x7fe314121750 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.415+0000 7fe3189ea700 1 -- 172.21.15.156:0/2728169332 >> 172.21.15.156:0/2728169332 conn(0x7fe314099c40 msgr2=0x7fe3141332d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:56.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.415+0000 7fe3189ea700 1 -- 172.21.15.156:0/2728169332 shutdown_connections 2023-09-30T22:21:56.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.415+0000 7fe3189ea700 1 -- 172.21.15.156:0/2728169332 wait complete. 2023-09-30T22:21:56.428 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:56.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.489+0000 7fbadf9d8700 1 -- 172.21.15.156:0/1580825383 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbad8121880 con 0x7fbad809e170 2023-09-30T22:21:56.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.490+0000 7fbacdffb700 1 -- 172.21.15.156:0/1580825383 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbac800f260 con 0x7fbad809e170 2023-09-30T22:21:56.490 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:56.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.492+0000 7fbadf9d8700 1 -- 172.21.15.156:0/1580825383 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbad809e170 msgr2=0x7fbad811e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.492+0000 7fbadf9d8700 1 --2- 172.21.15.156:0/1580825383 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbad809e170 0x7fbad811e7b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbac8005910 tx=0x7fbac800c9e0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.492+0000 7fbadf9d8700 1 -- 172.21.15.156:0/1580825383 shutdown_connections 2023-09-30T22:21:56.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.492+0000 7fbadf9d8700 1 --2- 172.21.15.156:0/1580825383 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbad8130eb0 0x7fbad811ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.492+0000 7fbadf9d8700 1 --2- 172.21.15.156:0/1580825383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbad809d860 0x7fbad811e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.492+0000 7fbadf9d8700 1 --2- 172.21.15.156:0/1580825383 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbad809e170 0x7fbad811e7b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.492+0000 7fbadf9d8700 1 -- 172.21.15.156:0/1580825383 >> 172.21.15.156:0/1580825383 conn(0x7fbad8099c40 msgr2=0x7fbad80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:56.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.492+0000 7fbadf9d8700 1 -- 172.21.15.156:0/1580825383 shutdown_connections 2023-09-30T22:21:56.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.492+0000 7fbadf9d8700 1 -- 172.21.15.156:0/1580825383 wait complete. 2023-09-30T22:21:56.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:56.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.602+0000 7fe00897e700 1 -- 172.21.15.156:0/3205797144 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe004072980 con 0x7fe0040a1380 2023-09-30T22:21:56.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.603+0000 7fdff2ffd700 1 -- 172.21.15.156:0/3205797144 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdff8017030 con 0x7fe0040a1380 2023-09-30T22:21:56.604 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:56.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.605+0000 7fe00897e700 1 -- 172.21.15.156:0/3205797144 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0040a1380 msgr2=0x7fe004122ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.605+0000 7fe00897e700 1 --2- 172.21.15.156:0/3205797144 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0040a1380 0x7fe004122ca0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdff800ebb0 tx=0x7fdff800eec0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.605+0000 7fe00897e700 1 -- 172.21.15.156:0/3205797144 shutdown_connections 2023-09-30T22:21:56.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.605+0000 7fe00897e700 1 --2- 172.21.15.156:0/3205797144 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe004133f50 0x7fe0041231e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.605+0000 7fe00897e700 1 --2- 172.21.15.156:0/3205797144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0040a0a70 0x7fe004122760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.605+0000 7fe00897e700 1 --2- 172.21.15.156:0/3205797144 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0040a1380 0x7fe004122ca0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.605+0000 7fe00897e700 1 -- 172.21.15.156:0/3205797144 >> 172.21.15.156:0/3205797144 conn(0x7fe0040a6610 msgr2=0x7fe00409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:56.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.605+0000 7fe00897e700 1 -- 172.21.15.156:0/3205797144 shutdown_connections 2023-09-30T22:21:56.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:56.605+0000 7fe00897e700 1 -- 172.21.15.156:0/3205797144 wait complete. 2023-09-30T22:21:56.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:57.097 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:57.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.218+0000 7f8adf3f5700 1 Processor -- start 2023-09-30T22:21:57.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.219+0000 7f8adf3f5700 1 -- start start 2023-09-30T22:21:57.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.219+0000 7f8adf3f5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ad809d860 0x7f8ad809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.219+0000 7f8adf3f5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8ad809e170 0x7f8ad81307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.219+0000 7f8adf3f5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ad8130ce0 0x7f8ad8131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.219+0000 7f8adf3f5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad809aaa0 con 0x7f8ad809e170 2023-09-30T22:21:57.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.219+0000 7f8adf3f5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad809f870 con 0x7f8ad809d860 2023-09-30T22:21:57.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.219+0000 7f8adf3f5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad809b360 con 0x7f8ad8130ce0 2023-09-30T22:21:57.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.219+0000 7f8adc990700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8ad809e170 0x7f8ad81307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.219+0000 7f8add191700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ad809d860 0x7f8ad809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.219+0000 7f8adc990700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8ad809e170 0x7f8ad81307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54292/0 (socket says 172.21.15.156:54292) 2023-09-30T22:21:57.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.219+0000 7f8add191700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ad809d860 0x7f8ad809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:55790/0 (socket says 172.21.15.156:55790) 2023-09-30T22:21:57.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.219+0000 7f8add992700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ad8130ce0 0x7f8ad8131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.219+0000 7f8adc990700 1 -- 172.21.15.156:0/4091105947 learned_addr learned my addr 172.21.15.156:0/4091105947 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:57.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.219+0000 7f8add191700 1 -- 172.21.15.156:0/4091105947 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ad8130ce0 msgr2=0x7f8ad8131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:57.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.219+0000 7f8add191700 1 --2- 172.21.15.156:0/4091105947 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ad8130ce0 0x7f8ad8131180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.219+0000 7f8add191700 1 -- 172.21.15.156:0/4091105947 >> v2:172.21.15.156:3300/0 conn(0x7f8ad809e170 msgr2=0x7f8ad81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:57.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.219+0000 7f8add191700 1 --2- 172.21.15.156:0/4091105947 >> v2:172.21.15.156:3300/0 conn(0x7f8ad809e170 0x7f8ad81307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.220+0000 7f8add191700 1 -- 172.21.15.156:0/4091105947 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad809b620 con 0x7f8ad809d860 2023-09-30T22:21:57.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.220+0000 7f8adc990700 1 --2- 172.21.15.156:0/4091105947 >> v2:172.21.15.156:3300/0 conn(0x7f8ad809e170 0x7f8ad81307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:57.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.220+0000 7f8add191700 1 --2- 172.21.15.156:0/4091105947 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ad809d860 0x7f8ad809dc30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8009870 tx=0x7f8ac8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4fd7987e67abea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:57.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.220+0000 7f8acffff700 1 -- 172.21.15.156:0/4091105947 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac8011830 con 0x7f8ad809d860 2023-09-30T22:21:57.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.220+0000 7f8acffff700 1 -- 172.21.15.156:0/4091105947 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac8011990 con 0x7f8ad809d860 2023-09-30T22:21:57.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.220+0000 7f8acffff700 1 -- 172.21.15.156:0/4091105947 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac8011d20 con 0x7f8ad809d860 2023-09-30T22:21:57.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.220+0000 7f8adf3f5700 1 -- 172.21.15.156:0/4091105947 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ad809d860 msgr2=0x7f8ad809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.220+0000 7f8adf3f5700 1 --2- 172.21.15.156:0/4091105947 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ad809d860 0x7f8ad809dc30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8009870 tx=0x7f8ac8009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:57.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.220+0000 7f8adf3f5700 1 -- 172.21.15.156:0/4091105947 shutdown_connections 2023-09-30T22:21:57.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.220+0000 7f8adf3f5700 1 --2- 172.21.15.156:0/4091105947 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ad8130ce0 0x7f8ad8131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.220+0000 7f8adf3f5700 1 --2- 172.21.15.156:0/4091105947 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ad809d860 0x7f8ad809dc30 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.220+0000 7f8adf3f5700 1 --2- 172.21.15.156:0/4091105947 >> v2:172.21.15.156:3300/0 conn(0x7f8ad809e170 0x7f8ad81307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.220+0000 7f8adf3f5700 1 -- 172.21.15.156:0/4091105947 >> 172.21.15.156:0/4091105947 conn(0x7f8ad8099c40 msgr2=0x7f8ad80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:57.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.220+0000 7f8adf3f5700 1 -- 172.21.15.156:0/4091105947 shutdown_connections 2023-09-30T22:21:57.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.221+0000 7f8adf3f5700 1 -- 172.21.15.156:0/4091105947 wait complete. 2023-09-30T22:21:57.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.222+0000 7f8adf3f5700 1 Processor -- start 2023-09-30T22:21:57.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.222+0000 7f8adf3f5700 1 -- start start 2023-09-30T22:21:57.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.222+0000 7f8adf3f5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ad809d860 0x7f8ad811e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.222+0000 7f8adf3f5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ad809e170 0x7f8ad811e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.222+0000 7f8adf3f5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ad8130ce0 0x7f8ad811ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.222+0000 7f8adf3f5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad81218a0 con 0x7f8ad809d860 2023-09-30T22:21:57.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.222+0000 7f8adf3f5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad8120d30 con 0x7f8ad8130ce0 2023-09-30T22:21:57.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.222+0000 7f8adf3f5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad809c8b0 con 0x7f8ad809e170 2023-09-30T22:21:57.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.222+0000 7f8add191700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ad809d860 0x7f8ad811e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.222+0000 7f8add191700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ad809d860 0x7f8ad811e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54308/0 (socket says 172.21.15.156:54308) 2023-09-30T22:21:57.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.222+0000 7f8add191700 1 -- 172.21.15.156:0/2420786120 learned_addr learned my addr 172.21.15.156:0/2420786120 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:57.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.222+0000 7f8add992700 1 --2- 172.21.15.156:0/2420786120 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ad8130ce0 0x7f8ad811ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.223+0000 7f8adc990700 1 --2- 172.21.15.156:0/2420786120 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ad809e170 0x7f8ad811e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.223+0000 7f8add191700 1 -- 172.21.15.156:0/2420786120 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ad809e170 msgr2=0x7f8ad811e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.223+0000 7f8add191700 1 --2- 172.21.15.156:0/2420786120 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ad809e170 0x7f8ad811e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.223+0000 7f8add191700 1 -- 172.21.15.156:0/2420786120 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ad8130ce0 msgr2=0x7f8ad811ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.223+0000 7f8add191700 1 --2- 172.21.15.156:0/2420786120 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ad8130ce0 0x7f8ad811ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.223+0000 7f8add191700 1 -- 172.21.15.156:0/2420786120 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad4009550 con 0x7f8ad809d860 2023-09-30T22:21:57.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.223+0000 7f8add992700 1 --2- 172.21.15.156:0/2420786120 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ad8130ce0 0x7f8ad811ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:57.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.223+0000 7f8add191700 1 --2- 172.21.15.156:0/2420786120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ad809d860 0x7f8ad811e2e0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8009840 tx=0x7f8ac8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:57.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.223+0000 7f8acdffb700 1 -- 172.21.15.156:0/2420786120 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac8004450 con 0x7f8ad809d860 2023-09-30T22:21:57.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.223+0000 7f8acdffb700 1 -- 172.21.15.156:0/2420786120 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac801e070 con 0x7f8ad809d860 2023-09-30T22:21:57.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.223+0000 7f8adf3f5700 1 -- 172.21.15.156:0/2420786120 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac80094a0 con 0x7f8ad809d860 2023-09-30T22:21:57.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.223+0000 7f8acdffb700 1 -- 172.21.15.156:0/2420786120 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac80038e0 con 0x7f8ad809d860 2023-09-30T22:21:57.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.223+0000 7f8adf3f5700 1 -- 172.21.15.156:0/2420786120 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad812f660 con 0x7f8ad809d860 2023-09-30T22:21:57.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.224+0000 7f8acdffb700 1 -- 172.21.15.156:0/2420786120 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ac8003a40 con 0x7f8ad809d860 2023-09-30T22:21:57.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.224+0000 7f8acdffb700 1 -- 172.21.15.156:0/2420786120 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8ac8020070 con 0x7f8ad809d860 2023-09-30T22:21:57.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.224+0000 7f8adf3f5700 1 -- 172.21.15.156:0/2420786120 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad8121180 con 0x7f8ad809d860 2023-09-30T22:21:57.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.229+0000 7f8acdffb700 1 -- 172.21.15.156:0/2420786120 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ac802a080 con 0x7f8ad809d860 2023-09-30T22:21:57.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.411+0000 7f8adf3f5700 1 -- 172.21.15.156:0/2420786120 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8ad804f2a0 con 0x7f8ad809d860 2023-09-30T22:21:57.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.411+0000 7f8acdffb700 1 -- 172.21.15.156:0/2420786120 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ac8015020 con 0x7f8ad809d860 2023-09-30T22:21:57.412 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:57.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.413+0000 7f8adf3f5700 1 -- 172.21.15.156:0/2420786120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ad809d860 msgr2=0x7f8ad811e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.414+0000 7f8adf3f5700 1 --2- 172.21.15.156:0/2420786120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ad809d860 0x7f8ad811e2e0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8009840 tx=0x7f8ac8004750 comp rx=0 tx=0).stop 2023-09-30T22:21:57.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.414+0000 7f8adf3f5700 1 -- 172.21.15.156:0/2420786120 shutdown_connections 2023-09-30T22:21:57.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.414+0000 7f8adf3f5700 1 --2- 172.21.15.156:0/2420786120 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ad8130ce0 0x7f8ad811ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.414+0000 7f8adf3f5700 1 --2- 172.21.15.156:0/2420786120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ad809d860 0x7f8ad811e2e0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.414+0000 7f8adf3f5700 1 --2- 172.21.15.156:0/2420786120 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ad809e170 0x7f8ad811e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.414+0000 7f8adf3f5700 1 -- 172.21.15.156:0/2420786120 >> 172.21.15.156:0/2420786120 conn(0x7f8ad8099c40 msgr2=0x7f8ad80a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:57.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.414+0000 7f8adf3f5700 1 -- 172.21.15.156:0/2420786120 shutdown_connections 2023-09-30T22:21:57.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.414+0000 7f8adf3f5700 1 -- 172.21.15.156:0/2420786120 wait complete. 2023-09-30T22:21:57.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:57.430 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:57.505 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:57.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.554+0000 7f95f3d8a700 1 Processor -- start 2023-09-30T22:21:57.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.554+0000 7f95f3d8a700 1 -- start start 2023-09-30T22:21:57.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.555+0000 7f95f3d8a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f95ec09ef80 0x7f95ec138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.555+0000 7f95f3d8a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95ec09f370 0x7f95ec13b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.555+0000 7f95f3d8a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95ec09af80 con 0x7f95ec09a150 2023-09-30T22:21:57.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.555+0000 7f95f3d8a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec09a520 con 0x7f95ec09ef80 2023-09-30T22:21:57.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.555+0000 7f95f3d8a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec09fe00 con 0x7f95ec09f370 2023-09-30T22:21:57.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.555+0000 7f95f1325700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f95ec09ef80 0x7f95ec138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.555+0000 7f95f1325700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f95ec09ef80 0x7f95ec138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:55818/0 (socket says 172.21.15.156:55818) 2023-09-30T22:21:57.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.555+0000 7f95f1b26700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f95ec09a150 0x7f95ec09e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40642/0 (socket says 172.21.15.156:40642) 2023-09-30T22:21:57.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.555+0000 7f95f1325700 1 -- 172.21.15.156:0/1479296714 learned_addr learned my addr 172.21.15.156:0/1479296714 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:57.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.555+0000 7f95f2327700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95ec09f370 0x7f95ec13b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.555+0000 7f95f1325700 1 -- 172.21.15.156:0/1479296714 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95ec09f370 msgr2=0x7f95ec13b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:57.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.555+0000 7f95f1325700 1 --2- 172.21.15.156:0/1479296714 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95ec09f370 0x7f95ec13b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.555+0000 7f95f1325700 1 -- 172.21.15.156:0/1479296714 >> v1:172.21.15.156:6789/0 conn(0x7f95ec09a150 legacy=0x7f95ec09e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.555+0000 7f95f1325700 1 -- 172.21.15.156:0/1479296714 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ec06bc20 con 0x7f95ec09ef80 2023-09-30T22:21:57.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.555+0000 7f95f2327700 1 --2- 172.21.15.156:0/1479296714 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95ec09f370 0x7f95ec13b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:57.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.555+0000 7f95f1325700 1 --2- 172.21.15.156:0/1479296714 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f95ec09ef80 0x7f95ec138e60 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009920 tx=0x7f95dc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74fe6ee5844d3f17 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:57.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.555+0000 7f95f0b24700 1 -- 172.21.15.156:0/1479296714 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc011830 con 0x7f95ec09ef80 2023-09-30T22:21:57.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.555+0000 7f95f0b24700 1 -- 172.21.15.156:0/1479296714 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95dc011990 con 0x7f95ec09ef80 2023-09-30T22:21:57.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.555+0000 7f95f0b24700 1 -- 172.21.15.156:0/1479296714 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc011d20 con 0x7f95ec09ef80 2023-09-30T22:21:57.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.556+0000 7f95f3d8a700 1 -- 172.21.15.156:0/1479296714 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f95ec09ef80 msgr2=0x7f95ec138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.556+0000 7f95f3d8a700 1 --2- 172.21.15.156:0/1479296714 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f95ec09ef80 0x7f95ec138e60 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009920 tx=0x7f95dc009c30 comp rx=0 tx=0).stop 2023-09-30T22:21:57.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.556+0000 7f95f3d8a700 1 -- 172.21.15.156:0/1479296714 shutdown_connections 2023-09-30T22:21:57.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.556+0000 7f95f3d8a700 1 --2- 172.21.15.156:0/1479296714 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95ec09f370 0x7f95ec13b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.556+0000 7f95f3d8a700 1 --2- 172.21.15.156:0/1479296714 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f95ec09ef80 0x7f95ec138e60 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.556+0000 7f95f3d8a700 1 -- 172.21.15.156:0/1479296714 >> 172.21.15.156:0/1479296714 conn(0x7f95ec0a4430 msgr2=0x7f95ec0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:57.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.556+0000 7f95f3d8a700 1 -- 172.21.15.156:0/1479296714 shutdown_connections 2023-09-30T22:21:57.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.556+0000 7f95f3d8a700 1 -- 172.21.15.156:0/1479296714 wait complete. 2023-09-30T22:21:57.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.557+0000 7f95f3d8a700 1 Processor -- start 2023-09-30T22:21:57.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.557+0000 7f95f3d8a700 1 -- start start 2023-09-30T22:21:57.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.558+0000 7f95f3d8a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f95ec09a150 0x7f95ec123620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.558+0000 7f95f3d8a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95ec09ef80 0x7f95ec123b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.558+0000 7f95f3d8a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95ec09f370 0x7f95ec1240a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.558+0000 7f95f3d8a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec126c80 con 0x7f95ec09f370 2023-09-30T22:21:57.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.558+0000 7f95f3d8a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec13aec0 con 0x7f95ec09a150 2023-09-30T22:21:57.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.558+0000 7f95f3d8a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec09bcf0 con 0x7f95ec09ef80 2023-09-30T22:21:57.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.558+0000 7f95f1b26700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f95ec09a150 0x7f95ec123620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.558+0000 7f95f2327700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95ec09f370 0x7f95ec1240a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.558+0000 7f95f1325700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95ec09ef80 0x7f95ec123b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.558+0000 7f95f1b26700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f95ec09a150 0x7f95ec123620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:55820/0 (socket says 172.21.15.156:55820) 2023-09-30T22:21:57.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.558+0000 7f95f1b26700 1 -- 172.21.15.156:0/650703476 learned_addr learned my addr 172.21.15.156:0/650703476 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:57.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.558+0000 7f95f2327700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95ec09f370 0x7f95ec1240a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54318/0 (socket says 172.21.15.156:54318) 2023-09-30T22:21:57.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.559+0000 7f95f2327700 1 -- 172.21.15.156:0/650703476 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95ec09ef80 msgr2=0x7f95ec123b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.559+0000 7f95f2327700 1 --2- 172.21.15.156:0/650703476 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95ec09ef80 0x7f95ec123b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.559+0000 7f95f2327700 1 -- 172.21.15.156:0/650703476 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f95ec09a150 msgr2=0x7f95ec123620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.559+0000 7f95f2327700 1 --2- 172.21.15.156:0/650703476 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f95ec09a150 0x7f95ec123620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.559+0000 7f95f2327700 1 -- 172.21.15.156:0/650703476 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e4009a70 con 0x7f95ec09f370 2023-09-30T22:21:57.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.559+0000 7f95f1b26700 1 --2- 172.21.15.156:0/650703476 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f95ec09a150 0x7f95ec123620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:57.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.559+0000 7f95f1325700 1 --2- 172.21.15.156:0/650703476 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95ec09ef80 0x7f95ec123b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:57.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.559+0000 7f95f2327700 1 --2- 172.21.15.156:0/650703476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95ec09f370 0x7f95ec1240a0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f95e4009e50 tx=0x7f95e400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:57.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.559+0000 7f95e27fc700 1 -- 172.21.15.156:0/650703476 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e400ca90 con 0x7f95ec09f370 2023-09-30T22:21:57.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.559+0000 7f95e27fc700 1 -- 172.21.15.156:0/650703476 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e400f040 con 0x7f95ec09f370 2023-09-30T22:21:57.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.559+0000 7f95e27fc700 1 -- 172.21.15.156:0/650703476 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e400ce50 con 0x7f95ec09f370 2023-09-30T22:21:57.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.559+0000 7f95f3d8a700 1 -- 172.21.15.156:0/650703476 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95dc009550 con 0x7f95ec09f370 2023-09-30T22:21:57.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.559+0000 7f95f3d8a700 1 -- 172.21.15.156:0/650703476 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95ec0a04a0 con 0x7f95ec09f370 2023-09-30T22:21:57.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.560+0000 7f95e27fc700 1 -- 172.21.15.156:0/650703476 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f95e4014480 con 0x7f95ec09f370 2023-09-30T22:21:57.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.560+0000 7f95e27fc700 1 -- 172.21.15.156:0/650703476 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f95e403fc30 con 0x7f95ec09f370 2023-09-30T22:21:57.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.560+0000 7f95f3d8a700 1 -- 172.21.15.156:0/650703476 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95ec09fa30 con 0x7f95ec09f370 2023-09-30T22:21:57.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.565+0000 7f95e27fc700 1 -- 172.21.15.156:0/650703476 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f95e4012930 con 0x7f95ec09f370 2023-09-30T22:21:57.619 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:57.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.633+0000 7fd139d75700 1 Processor -- start 2023-09-30T22:21:57.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.633+0000 7fd139d75700 1 -- start start 2023-09-30T22:21:57.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.634+0000 7fd139d75700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd134136960 0x7fd134138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.634+0000 7fd139d75700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd134139280 0x7fd13413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.634+0000 7fd139d75700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13406b2d0 con 0x7fd134133ad0 2023-09-30T22:21:57.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.634+0000 7fd139d75700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1341345b0 con 0x7fd134136960 2023-09-30T22:21:57.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.634+0000 7fd139d75700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd134133610 con 0x7fd134139280 2023-09-30T22:21:57.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.634+0000 7fd1337fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fd134133ad0 0x7fd134133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40646/0 (socket says 172.21.15.156:40646) 2023-09-30T22:21:57.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.634+0000 7fd1337fe700 1 -- 172.21.15.156:0/1994125699 learned_addr learned my addr 172.21.15.156:0/1994125699 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:57.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.634+0000 7fd132ffd700 1 --2- 172.21.15.156:0/1994125699 >> v2:172.21.15.156:3300/0 conn(0x7fd134136960 0x7fd134138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.634+0000 7fd133fff700 1 --2- 172.21.15.156:0/1994125699 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd134139280 0x7fd13413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.634+0000 7fd1327fc700 1 -- 172.21.15.156:0/1994125699 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2829000061 0 0) 0x7fd13406b2d0 con 0x7fd134133ad0 2023-09-30T22:21:57.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.634+0000 7fd1327fc700 1 -- 172.21.15.156:0/1994125699 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd11c0035b0 con 0x7fd134133ad0 2023-09-30T22:21:57.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.634+0000 7fd132ffd700 1 -- 172.21.15.156:0/1994125699 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd134139280 msgr2=0x7fd13413b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:57.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.634+0000 7fd132ffd700 1 --2- 172.21.15.156:0/1994125699 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd134139280 0x7fd13413b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.634+0000 7fd132ffd700 1 -- 172.21.15.156:0/1994125699 >> v1:172.21.15.156:6789/0 conn(0x7fd134133ad0 legacy=0x7fd134133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.634+0000 7fd132ffd700 1 -- 172.21.15.156:0/1994125699 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13409a500 con 0x7fd134136960 2023-09-30T22:21:57.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.635+0000 7fd132ffd700 1 --2- 172.21.15.156:0/1994125699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd134136960 0x7fd134138d40 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fd128009840 tx=0x7fd128009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11477e6c945dee3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:57.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.635+0000 7fd1327fc700 1 -- 172.21.15.156:0/1994125699 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd128011830 con 0x7fd134136960 2023-09-30T22:21:57.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.635+0000 7fd1327fc700 1 -- 172.21.15.156:0/1994125699 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd128011990 con 0x7fd134136960 2023-09-30T22:21:57.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.635+0000 7fd1327fc700 1 -- 172.21.15.156:0/1994125699 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd128011d20 con 0x7fd134136960 2023-09-30T22:21:57.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.635+0000 7fd139d75700 1 -- 172.21.15.156:0/1994125699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd134136960 msgr2=0x7fd134138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.635+0000 7fd139d75700 1 --2- 172.21.15.156:0/1994125699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd134136960 0x7fd134138d40 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fd128009840 tx=0x7fd128009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:57.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.636+0000 7fd139d75700 1 -- 172.21.15.156:0/1994125699 shutdown_connections 2023-09-30T22:21:57.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.636+0000 7fd139d75700 1 --2- 172.21.15.156:0/1994125699 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd134139280 0x7fd13413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.636+0000 7fd139d75700 1 --2- 172.21.15.156:0/1994125699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd134136960 0x7fd134138d40 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.636+0000 7fd139d75700 1 -- 172.21.15.156:0/1994125699 >> 172.21.15.156:0/1994125699 conn(0x7fd134099c40 msgr2=0x7fd1340a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:57.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.636+0000 7fd139d75700 1 -- 172.21.15.156:0/1994125699 shutdown_connections 2023-09-30T22:21:57.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.636+0000 7fd139d75700 1 -- 172.21.15.156:0/1994125699 wait complete. 2023-09-30T22:21:57.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.636+0000 7fd139d75700 1 Processor -- start 2023-09-30T22:21:57.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.637+0000 7fd139d75700 1 -- start start 2023-09-30T22:21:57.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.637+0000 7fd139d75700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd134133ad0 0x7fd134071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.637+0000 7fd139d75700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd134136960 0x7fd1340715b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.637+0000 7fd139d75700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd134139280 0x7fd134071af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.637+0000 7fd139d75700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1341317a0 con 0x7fd134139280 2023-09-30T22:21:57.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.637+0000 7fd139d75700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13409f390 con 0x7fd134136960 2023-09-30T22:21:57.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.637+0000 7fd139d75700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd13412f1b0 con 0x7fd134133ad0 2023-09-30T22:21:57.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.637+0000 7fd1337fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd134133ad0 0x7fd134071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.637+0000 7fd1337fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd134133ad0 0x7fd134071070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33562/0 (socket says 172.21.15.156:33562) 2023-09-30T22:21:57.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.637+0000 7fd1337fe700 1 -- 172.21.15.156:0/3676097595 learned_addr learned my addr 172.21.15.156:0/3676097595 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:57.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.637+0000 7fd132ffd700 1 --2- 172.21.15.156:0/3676097595 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd134136960 0x7fd1340715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.638+0000 7fd133fff700 1 --2- 172.21.15.156:0/3676097595 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd134139280 0x7fd134071af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.638+0000 7fd1337fe700 1 -- 172.21.15.156:0/3676097595 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd134136960 msgr2=0x7fd1340715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.638+0000 7fd1337fe700 1 --2- 172.21.15.156:0/3676097595 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd134136960 0x7fd1340715b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.638+0000 7fd1337fe700 1 -- 172.21.15.156:0/3676097595 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd134139280 msgr2=0x7fd134071af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.638+0000 7fd1337fe700 1 --2- 172.21.15.156:0/3676097595 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd134139280 0x7fd134071af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.638+0000 7fd1337fe700 1 -- 172.21.15.156:0/3676097595 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1280094a0 con 0x7fd134133ad0 2023-09-30T22:21:57.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.638+0000 7fd1337fe700 1 --2- 172.21.15.156:0/3676097595 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd134133ad0 0x7fd134071070 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd124001eb0 tx=0x7fd12400c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:57.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.638+0000 7fd11bfff700 1 -- 172.21.15.156:0/3676097595 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd124005d70 con 0x7fd134133ad0 2023-09-30T22:21:57.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.638+0000 7fd11bfff700 1 -- 172.21.15.156:0/3676097595 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1240070d0 con 0x7fd134133ad0 2023-09-30T22:21:57.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.638+0000 7fd11bfff700 1 -- 172.21.15.156:0/3676097595 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd124007460 con 0x7fd134133ad0 2023-09-30T22:21:57.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.638+0000 7fd139d75700 1 -- 172.21.15.156:0/3676097595 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd13406ed70 con 0x7fd134133ad0 2023-09-30T22:21:57.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.638+0000 7fd139d75700 1 -- 172.21.15.156:0/3676097595 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd134130b80 con 0x7fd134133ad0 2023-09-30T22:21:57.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.639+0000 7fd11bfff700 1 -- 172.21.15.156:0/3676097595 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd1240075c0 con 0x7fd134133ad0 2023-09-30T22:21:57.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.639+0000 7fd11bfff700 1 -- 172.21.15.156:0/3676097595 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd12403eb70 con 0x7fd134133ad0 2023-09-30T22:21:57.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.639+0000 7fd139d75700 1 -- 172.21.15.156:0/3676097595 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd13406be10 con 0x7fd134133ad0 2023-09-30T22:21:57.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.644+0000 7fd11bfff700 1 -- 172.21.15.156:0/3676097595 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd12400f260 con 0x7fd134133ad0 2023-09-30T22:21:57.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.744+0000 7f22c8948700 1 Processor -- start 2023-09-30T22:21:57.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.744+0000 7f22c8948700 1 -- start start 2023-09-30T22:21:57.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.745+0000 7f22c8948700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f22c4136960 0x7f22c4138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.745+0000 7f22c8948700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f22c4139280 0x7f22c413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.745+0000 7f22c8948700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22c406b2d0 con 0x7f22c4133ad0 2023-09-30T22:21:57.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.745+0000 7f22c8948700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22c41345b0 con 0x7f22c4139280 2023-09-30T22:21:57.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.745+0000 7f22c8948700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22c4133610 con 0x7f22c4136960 2023-09-30T22:21:57.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.745+0000 7f22c2d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f22c4139280 0x7f22c413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.745+0000 7f22c2d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f22c4139280 0x7f22c413b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54346/0 (socket says 172.21.15.156:54346) 2023-09-30T22:21:57.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.745+0000 7f22c2d9d700 1 -- 172.21.15.156:0/2208500678 learned_addr learned my addr 172.21.15.156:0/2208500678 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:57.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.745+0000 7f22c1d9b700 1 --2- 172.21.15.156:0/2208500678 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f22c4136960 0x7f22c4138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.745+0000 7f22c1d9b700 1 -- 172.21.15.156:0/2208500678 >> v2:172.21.15.156:3300/0 conn(0x7f22c4139280 msgr2=0x7f22c413b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:57.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.745+0000 7f22c1d9b700 1 --2- 172.21.15.156:0/2208500678 >> v2:172.21.15.156:3300/0 conn(0x7f22c4139280 0x7f22c413b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.745+0000 7f22c1d9b700 1 -- 172.21.15.156:0/2208500678 >> v1:172.21.15.156:6789/0 conn(0x7f22c4133ad0 legacy=0x7f22c4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.745+0000 7f22c1d9b700 1 -- 172.21.15.156:0/2208500678 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c409a500 con 0x7f22c4136960 2023-09-30T22:21:57.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.745+0000 7f22c2d9d700 1 --2- 172.21.15.156:0/2208500678 >> v2:172.21.15.156:3300/0 conn(0x7f22c4139280 0x7f22c413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:57.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.746+0000 7f22c1d9b700 1 --2- 172.21.15.156:0/2208500678 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f22c4136960 0x7f22c4138d40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f22b8009870 tx=0x7f22b8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10b849e1a314127c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:57.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.746+0000 7f22c159a700 1 -- 172.21.15.156:0/2208500678 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b8011830 con 0x7f22c4136960 2023-09-30T22:21:57.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.746+0000 7f22c159a700 1 -- 172.21.15.156:0/2208500678 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b8011990 con 0x7f22c4136960 2023-09-30T22:21:57.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.746+0000 7f22c159a700 1 -- 172.21.15.156:0/2208500678 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b8011d20 con 0x7f22c4136960 2023-09-30T22:21:57.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.746+0000 7f22c8948700 1 -- 172.21.15.156:0/2208500678 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f22c4136960 msgr2=0x7f22c4138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.746+0000 7f22c8948700 1 --2- 172.21.15.156:0/2208500678 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f22c4136960 0x7f22c4138d40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f22b8009870 tx=0x7f22b8009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:57.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.746+0000 7f22c8948700 1 -- 172.21.15.156:0/2208500678 shutdown_connections 2023-09-30T22:21:57.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.746+0000 7f22c8948700 1 --2- 172.21.15.156:0/2208500678 >> v2:172.21.15.156:3300/0 conn(0x7f22c4139280 0x7f22c413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.746+0000 7f22c8948700 1 --2- 172.21.15.156:0/2208500678 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f22c4136960 0x7f22c4138d40 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.746+0000 7f22c8948700 1 -- 172.21.15.156:0/2208500678 >> 172.21.15.156:0/2208500678 conn(0x7f22c4099c40 msgr2=0x7f22c40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:57.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.746+0000 7f22c8948700 1 -- 172.21.15.156:0/2208500678 shutdown_connections 2023-09-30T22:21:57.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.746+0000 7f22c8948700 1 -- 172.21.15.156:0/2208500678 wait complete. 2023-09-30T22:21:57.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.748+0000 7f22c8948700 1 Processor -- start 2023-09-30T22:21:57.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.748+0000 7f22c8948700 1 -- start start 2023-09-30T22:21:57.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.748+0000 7f22c8948700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f22c4133ad0 0x7f22c4071930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.748+0000 7f22c8948700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f22c4136960 0x7f22c4071e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.749+0000 7f22c8948700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22c4139280 0x7f22c41c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.749+0000 7f22c8948700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c4070450 con 0x7f22c4139280 2023-09-30T22:21:57.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.749+0000 7f22c8948700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c409f390 con 0x7f22c4136960 2023-09-30T22:21:57.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.749+0000 7f22c8948700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22c4138f50 con 0x7f22c4133ad0 2023-09-30T22:21:57.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.749+0000 7f22c1d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f22c4136960 0x7f22c4071e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.749+0000 7f22c1d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f22c4136960 0x7f22c4071e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:55844/0 (socket says 172.21.15.156:55844) 2023-09-30T22:21:57.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.749+0000 7f22c1d9b700 1 -- 172.21.15.156:0/121291578 learned_addr learned my addr 172.21.15.156:0/121291578 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:57.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.749+0000 7f22c259c700 1 --2- 172.21.15.156:0/121291578 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f22c4133ad0 0x7f22c4071930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.749+0000 7f22c2d9d700 1 --2- 172.21.15.156:0/121291578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22c4139280 0x7f22c41c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.749+0000 7f22c259c700 1 -- 172.21.15.156:0/121291578 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f22c4136960 msgr2=0x7f22c4071e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.749+0000 7f22c259c700 1 --2- 172.21.15.156:0/121291578 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f22c4136960 0x7f22c4071e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.749+0000 7f22c259c700 1 -- 172.21.15.156:0/121291578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22c4139280 msgr2=0x7f22c41c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.749+0000 7f22c259c700 1 --2- 172.21.15.156:0/121291578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22c4139280 0x7f22c41c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.749+0000 7f22c259c700 1 -- 172.21.15.156:0/121291578 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc009b30 con 0x7f22c4133ad0 2023-09-30T22:21:57.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.749+0000 7f22c2d9d700 1 --2- 172.21.15.156:0/121291578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22c4139280 0x7f22c41c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:57.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.749+0000 7f22c259c700 1 --2- 172.21.15.156:0/121291578 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f22c4133ad0 0x7f22c4071930 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f22b4000f60 tx=0x7f22b400c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:57.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.749+0000 7f22b2ffd700 1 -- 172.21.15.156:0/121291578 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b40052d0 con 0x7f22c4133ad0 2023-09-30T22:21:57.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.749+0000 7f22b2ffd700 1 -- 172.21.15.156:0/121291578 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b4005430 con 0x7f22c4133ad0 2023-09-30T22:21:57.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.749+0000 7f22c8948700 1 -- 172.21.15.156:0/121291578 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b80094a0 con 0x7f22c4133ad0 2023-09-30T22:21:57.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.749+0000 7f22b2ffd700 1 -- 172.21.15.156:0/121291578 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b40038c0 con 0x7f22c4133ad0 2023-09-30T22:21:57.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.750+0000 7f22c8948700 1 -- 172.21.15.156:0/121291578 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c406f0c0 con 0x7f22c4133ad0 2023-09-30T22:21:57.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.750+0000 7f22c8948700 1 -- 172.21.15.156:0/121291578 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22c404f2a0 con 0x7f22c4133ad0 2023-09-30T22:21:57.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.751+0000 7f22b2ffd700 1 -- 172.21.15.156:0/121291578 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f22b4003c30 con 0x7f22c4133ad0 2023-09-30T22:21:57.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.751+0000 7f22b2ffd700 1 -- 172.21.15.156:0/121291578 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f22b403efc0 con 0x7f22c4133ad0 2023-09-30T22:21:57.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.759+0000 7f22b2ffd700 1 -- 172.21.15.156:0/121291578 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f22b401b3b0 con 0x7f22c4133ad0 2023-09-30T22:21:57.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.765+0000 7f95f3d8a700 1 -- 172.21.15.156:0/650703476 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f95ec126ab0 con 0x7f95ec09f370 2023-09-30T22:21:57.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.766+0000 7f95e27fc700 1 -- 172.21.15.156:0/650703476 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f95e4012340 con 0x7f95ec09f370 2023-09-30T22:21:57.766 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:57.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.767+0000 7f95f3d8a700 1 -- 172.21.15.156:0/650703476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95ec09f370 msgr2=0x7f95ec1240a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.767+0000 7f95f3d8a700 1 --2- 172.21.15.156:0/650703476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95ec09f370 0x7f95ec1240a0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f95e4009e50 tx=0x7f95e400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.768+0000 7f95f3d8a700 1 -- 172.21.15.156:0/650703476 shutdown_connections 2023-09-30T22:21:57.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.768+0000 7f95f3d8a700 1 --2- 172.21.15.156:0/650703476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95ec09f370 0x7f95ec1240a0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.768+0000 7f95f3d8a700 1 --2- 172.21.15.156:0/650703476 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f95ec09a150 0x7f95ec123620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.768+0000 7f95f3d8a700 1 --2- 172.21.15.156:0/650703476 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95ec09ef80 0x7f95ec123b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.768+0000 7f95f3d8a700 1 -- 172.21.15.156:0/650703476 >> 172.21.15.156:0/650703476 conn(0x7f95ec0a4430 msgr2=0x7f95ec0722f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:57.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.768+0000 7f95f3d8a700 1 -- 172.21.15.156:0/650703476 shutdown_connections 2023-09-30T22:21:57.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.768+0000 7f95f3d8a700 1 -- 172.21.15.156:0/650703476 wait complete. 2023-09-30T22:21:57.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:57.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.842+0000 7fd139d75700 1 -- 172.21.15.156:0/3676097595 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd13404f2a0 con 0x7fd134133ad0 2023-09-30T22:21:57.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.843+0000 7fd11bfff700 1 -- 172.21.15.156:0/3676097595 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd124017020 con 0x7fd134133ad0 2023-09-30T22:21:57.846 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:57.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.845+0000 7fd139d75700 1 -- 172.21.15.156:0/3676097595 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd134133ad0 msgr2=0x7fd134071070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.845+0000 7fd139d75700 1 --2- 172.21.15.156:0/3676097595 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd134133ad0 0x7fd134071070 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd124001eb0 tx=0x7fd12400c7b0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.845+0000 7fd139d75700 1 -- 172.21.15.156:0/3676097595 shutdown_connections 2023-09-30T22:21:57.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.845+0000 7fd139d75700 1 --2- 172.21.15.156:0/3676097595 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd134139280 0x7fd134071af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.845+0000 7fd139d75700 1 --2- 172.21.15.156:0/3676097595 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd134133ad0 0x7fd134071070 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.845+0000 7fd139d75700 1 --2- 172.21.15.156:0/3676097595 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd134136960 0x7fd1340715b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.845+0000 7fd139d75700 1 -- 172.21.15.156:0/3676097595 >> 172.21.15.156:0/3676097595 conn(0x7fd134099c40 msgr2=0x7fd134134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:57.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.845+0000 7fd139d75700 1 -- 172.21.15.156:0/3676097595 shutdown_connections 2023-09-30T22:21:57.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.845+0000 7fd139d75700 1 -- 172.21.15.156:0/3676097595 wait complete. 2023-09-30T22:21:57.858 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:57.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.951+0000 7f22c8948700 1 -- 172.21.15.156:0/121291578 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f22c409f0f0 con 0x7f22c4133ad0 2023-09-30T22:21:57.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.951+0000 7f22b2ffd700 1 -- 172.21.15.156:0/121291578 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f22b4017030 con 0x7f22c4133ad0 2023-09-30T22:21:57.952 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:57.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.953+0000 7f22c8948700 1 -- 172.21.15.156:0/121291578 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f22c4133ad0 msgr2=0x7f22c4071930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.953+0000 7f22c8948700 1 --2- 172.21.15.156:0/121291578 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f22c4133ad0 0x7f22c4071930 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f22b4000f60 tx=0x7f22b400c6e0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.953+0000 7f22c8948700 1 -- 172.21.15.156:0/121291578 shutdown_connections 2023-09-30T22:21:57.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.953+0000 7f22c8948700 1 --2- 172.21.15.156:0/121291578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22c4139280 0x7f22c41c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.953+0000 7f22c8948700 1 --2- 172.21.15.156:0/121291578 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f22c4133ad0 0x7f22c4071930 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.953+0000 7f22c8948700 1 --2- 172.21.15.156:0/121291578 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f22c4136960 0x7f22c4071e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.953+0000 7f22c8948700 1 -- 172.21.15.156:0/121291578 >> 172.21.15.156:0/121291578 conn(0x7f22c4099c40 msgr2=0x7f22c4134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:57.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.953+0000 7f22c8948700 1 -- 172.21.15.156:0/121291578 shutdown_connections 2023-09-30T22:21:57.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:57.953+0000 7f22c8948700 1 -- 172.21.15.156:0/121291578 wait complete. 2023-09-30T22:21:57.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:58.429 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:58.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.554+0000 7f0bfdc23700 1 Processor -- start 2023-09-30T22:21:58.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.554+0000 7f0bfdc23700 1 -- start start 2023-09-30T22:21:58.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.554+0000 7f0bfdc23700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0bf809e340 0x7f0bf81359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.554+0000 7f0bfdc23700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bf8135f20 0x7f0bf8138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.554+0000 7f0bfdc23700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf809aaa0 con 0x7f0bf809d860 2023-09-30T22:21:58.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.554+0000 7f0bfdc23700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf809e730 con 0x7f0bf809e340 2023-09-30T22:21:58.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.554+0000 7f0bfdc23700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf809f870 con 0x7f0bf8135f20 2023-09-30T22:21:58.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.554+0000 7f0bf6ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0bf809e340 0x7f0bf81359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.554+0000 7f0bf7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bf8135f20 0x7f0bf8138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.554+0000 7f0bf77fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f0bf809d860 0x7f0bf809dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40664/0 (socket says 172.21.15.156:40664) 2023-09-30T22:21:58.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.554+0000 7f0bf7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bf8135f20 0x7f0bf8138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:55858/0 (socket says 172.21.15.156:55858) 2023-09-30T22:21:58.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.554+0000 7f0bf77fe700 1 -- 172.21.15.156:0/3199326851 learned_addr learned my addr 172.21.15.156:0/3199326851 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:58.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.554+0000 7f0bf6ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0bf809e340 0x7f0bf81359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54366/0 (socket says 172.21.15.156:54366) 2023-09-30T22:21:58.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.555+0000 7f0bf67fc700 1 -- 172.21.15.156:0/3199326851 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672924598 0 0) 0x7f0bf809aaa0 con 0x7f0bf809d860 2023-09-30T22:21:58.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.555+0000 7f0bf7fff700 1 -- 172.21.15.156:0/3199326851 >> v2:172.21.15.156:3300/0 conn(0x7f0bf809e340 msgr2=0x7f0bf81359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:58.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.555+0000 7f0bf7fff700 1 --2- 172.21.15.156:0/3199326851 >> v2:172.21.15.156:3300/0 conn(0x7f0bf809e340 0x7f0bf81359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.555+0000 7f0bf7fff700 1 -- 172.21.15.156:0/3199326851 >> v1:172.21.15.156:6789/0 conn(0x7f0bf809d860 legacy=0x7f0bf809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.555+0000 7f0bf7fff700 1 -- 172.21.15.156:0/3199326851 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf809b360 con 0x7f0bf8135f20 2023-09-30T22:21:58.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.555+0000 7f0bf6ffd700 1 --2- 172.21.15.156:0/3199326851 >> v2:172.21.15.156:3300/0 conn(0x7f0bf809e340 0x7f0bf81359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:58.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.555+0000 7f0bf7fff700 1 --2- 172.21.15.156:0/3199326851 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bf8135f20 0x7f0bf8138300 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0009dc0 tx=0x7f0bf000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aecbb3bbc3dda72f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:58.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.555+0000 7f0bf67fc700 1 -- 172.21.15.156:0/3199326851 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf000e070 con 0x7f0bf8135f20 2023-09-30T22:21:58.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.555+0000 7f0bf67fc700 1 -- 172.21.15.156:0/3199326851 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf000bae0 con 0x7f0bf8135f20 2023-09-30T22:21:58.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.555+0000 7f0bf67fc700 1 -- 172.21.15.156:0/3199326851 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf000be90 con 0x7f0bf8135f20 2023-09-30T22:21:58.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.555+0000 7f0bfdc23700 1 -- 172.21.15.156:0/3199326851 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bf8135f20 msgr2=0x7f0bf8138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.555+0000 7f0bfdc23700 1 --2- 172.21.15.156:0/3199326851 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bf8135f20 0x7f0bf8138300 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0009dc0 tx=0x7f0bf000b330 comp rx=0 tx=0).stop 2023-09-30T22:21:58.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.555+0000 7f0bfdc23700 1 -- 172.21.15.156:0/3199326851 shutdown_connections 2023-09-30T22:21:58.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.555+0000 7f0bfdc23700 1 --2- 172.21.15.156:0/3199326851 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bf8135f20 0x7f0bf8138300 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.556+0000 7f0bfdc23700 1 --2- 172.21.15.156:0/3199326851 >> v2:172.21.15.156:3300/0 conn(0x7f0bf809e340 0x7f0bf81359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.556+0000 7f0bfdc23700 1 -- 172.21.15.156:0/3199326851 >> 172.21.15.156:0/3199326851 conn(0x7f0bf8099c40 msgr2=0x7f0bf80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:58.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.556+0000 7f0bfdc23700 1 -- 172.21.15.156:0/3199326851 shutdown_connections 2023-09-30T22:21:58.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.556+0000 7f0bfdc23700 1 -- 172.21.15.156:0/3199326851 wait complete. 2023-09-30T22:21:58.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.556+0000 7f0bfdc23700 1 Processor -- start 2023-09-30T22:21:58.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.557+0000 7f0bfdc23700 1 -- start start 2023-09-30T22:21:58.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.557+0000 7f0bfdc23700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bf809d860 0x7f0bf811b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.557+0000 7f0bfdc23700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bf809e340 0x7f0bf811b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.557+0000 7f0bfdc23700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bf8135f20 0x7f0bf811bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.557+0000 7f0bfdc23700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf811c680 con 0x7f0bf8135f20 2023-09-30T22:21:58.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.557+0000 7f0bfdc23700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf811d690 con 0x7f0bf809e340 2023-09-30T22:21:58.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.557+0000 7f0bfdc23700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf811ecd0 con 0x7f0bf809d860 2023-09-30T22:21:58.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.557+0000 7f0bf6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bf809e340 0x7f0bf811b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.557+0000 7f0bf7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bf8135f20 0x7f0bf811bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.557+0000 7f0bf6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bf809e340 0x7f0bf811b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:55864/0 (socket says 172.21.15.156:55864) 2023-09-30T22:21:58.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.557+0000 7f0bf77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bf809d860 0x7f0bf811b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.557+0000 7f0bf6ffd700 1 -- 172.21.15.156:0/3748255593 learned_addr learned my addr 172.21.15.156:0/3748255593 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:58.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.557+0000 7f0bf7fff700 1 -- 172.21.15.156:0/3748255593 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bf809d860 msgr2=0x7f0bf811b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.557+0000 7f0bf7fff700 1 --2- 172.21.15.156:0/3748255593 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bf809d860 0x7f0bf811b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.557+0000 7f0bf7fff700 1 -- 172.21.15.156:0/3748255593 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bf809e340 msgr2=0x7f0bf811b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.557+0000 7f0bf7fff700 1 --2- 172.21.15.156:0/3748255593 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bf809e340 0x7f0bf811b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.557+0000 7f0bf7fff700 1 -- 172.21.15.156:0/3748255593 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bec00b740 con 0x7f0bf8135f20 2023-09-30T22:21:58.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.557+0000 7f0bf6ffd700 1 --2- 172.21.15.156:0/3748255593 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bf809e340 0x7f0bf811b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:58.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.558+0000 7f0bf7fff700 1 --2- 172.21.15.156:0/3748255593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bf8135f20 0x7f0bf811bc30 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f0bf80729f0 tx=0x7f0bf0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:58.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.558+0000 7f0bdffff700 1 -- 172.21.15.156:0/3748255593 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf00045d0 con 0x7f0bf8135f20 2023-09-30T22:21:58.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.558+0000 7f0bdffff700 1 -- 172.21.15.156:0/3748255593 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf0020070 con 0x7f0bf8135f20 2023-09-30T22:21:58.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.558+0000 7f0bfdc23700 1 -- 172.21.15.156:0/3748255593 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf0009a70 con 0x7f0bf8135f20 2023-09-30T22:21:58.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.558+0000 7f0bdffff700 1 -- 172.21.15.156:0/3748255593 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0027480 con 0x7f0bf8135f20 2023-09-30T22:21:58.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.558+0000 7f0bfdc23700 1 -- 172.21.15.156:0/3748255593 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf809c8b0 con 0x7f0bf8135f20 2023-09-30T22:21:58.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.558+0000 7f0bdffff700 1 -- 172.21.15.156:0/3748255593 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0bf0012430 con 0x7f0bf8135f20 2023-09-30T22:21:58.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.559+0000 7f0bdffff700 1 -- 172.21.15.156:0/3748255593 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0bf0022070 con 0x7f0bf8135f20 2023-09-30T22:21:58.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.559+0000 7f0bfdc23700 1 -- 172.21.15.156:0/3748255593 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf8132640 con 0x7f0bf8135f20 2023-09-30T22:21:58.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.563+0000 7f0bdffff700 1 -- 172.21.15.156:0/3748255593 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0bf00269d0 con 0x7f0bf8135f20 2023-09-30T22:21:58.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.748+0000 7f0bfdc23700 1 -- 172.21.15.156:0/3748255593 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0bf811e870 con 0x7f0bf8135f20 2023-09-30T22:21:58.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.749+0000 7f0bdffff700 1 -- 172.21.15.156:0/3748255593 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0bf00263e0 con 0x7f0bf8135f20 2023-09-30T22:21:58.750 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:21:58.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.751+0000 7f0bfdc23700 1 -- 172.21.15.156:0/3748255593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bf8135f20 msgr2=0x7f0bf811bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.751+0000 7f0bfdc23700 1 --2- 172.21.15.156:0/3748255593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bf8135f20 0x7f0bf811bc30 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f0bf80729f0 tx=0x7f0bf0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.751+0000 7f0bfdc23700 1 -- 172.21.15.156:0/3748255593 shutdown_connections 2023-09-30T22:21:58.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.751+0000 7f0bfdc23700 1 --2- 172.21.15.156:0/3748255593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0bf8135f20 0x7f0bf811bc30 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.751+0000 7f0bfdc23700 1 --2- 172.21.15.156:0/3748255593 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0bf809d860 0x7f0bf811b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.751+0000 7f0bfdc23700 1 --2- 172.21.15.156:0/3748255593 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0bf809e340 0x7f0bf811b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.751+0000 7f0bfdc23700 1 -- 172.21.15.156:0/3748255593 >> 172.21.15.156:0/3748255593 conn(0x7f0bf8099c40 msgr2=0x7f0bf8132830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:58.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.751+0000 7f0bfdc23700 1 -- 172.21.15.156:0/3748255593 shutdown_connections 2023-09-30T22:21:58.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.751+0000 7f0bfdc23700 1 -- 172.21.15.156:0/3748255593 wait complete. 2023-09-30T22:21:58.764 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:21:58.782 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:58.859 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:58.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.909+0000 7f7ed06da700 1 Processor -- start 2023-09-30T22:21:58.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.909+0000 7f7ed06da700 1 -- start start 2023-09-30T22:21:58.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.909+0000 7f7ed06da700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ec80a0a70 0x7f7ec80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.909+0000 7f7ed06da700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7ec8134120 0x7f7ec813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.909+0000 7f7ed06da700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec809dc00 con 0x7f7ec80a1380 2023-09-30T22:21:58.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.909+0000 7f7ed06da700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec809ea60 con 0x7f7ec8134120 2023-09-30T22:21:58.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.909+0000 7f7ed06da700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec809dec0 con 0x7f7ec80a0a70 2023-09-30T22:21:58.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.910+0000 7f7ece476700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ec80a0a70 0x7f7ec80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.910+0000 7f7ecec77700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7ec8134120 0x7f7ec813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.910+0000 7f7ecdc75700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f7ec80a1380 0x7f7ec8133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40668/0 (socket says 172.21.15.156:40668) 2023-09-30T22:21:58.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.910+0000 7f7ecdc75700 1 -- 172.21.15.156:0/2303233534 learned_addr learned my addr 172.21.15.156:0/2303233534 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:58.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.910+0000 7f7ece476700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ec80a0a70 0x7f7ec80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:55876/0 (socket says 172.21.15.156:55876) 2023-09-30T22:21:58.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.910+0000 7f7ecd474700 1 -- 172.21.15.156:0/2303233534 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 754207434 0 0) 0x7f7ec809dc00 con 0x7f7ec80a1380 2023-09-30T22:21:58.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.910+0000 7f7ecd474700 1 -- 172.21.15.156:0/2303233534 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eb40035b0 con 0x7f7ec80a1380 2023-09-30T22:21:58.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.910+0000 7f7ece476700 1 -- 172.21.15.156:0/2303233534 >> v2:172.21.15.156:3300/0 conn(0x7f7ec8134120 msgr2=0x7f7ec813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:58.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.910+0000 7f7ece476700 1 --2- 172.21.15.156:0/2303233534 >> v2:172.21.15.156:3300/0 conn(0x7f7ec8134120 0x7f7ec813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.910+0000 7f7ece476700 1 -- 172.21.15.156:0/2303233534 >> v1:172.21.15.156:6789/0 conn(0x7f7ec80a1380 legacy=0x7f7ec8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.910+0000 7f7ece476700 1 -- 172.21.15.156:0/2303233534 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec809e6a0 con 0x7f7ec80a0a70 2023-09-30T22:21:58.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.910+0000 7f7ecec77700 1 --2- 172.21.15.156:0/2303233534 >> v2:172.21.15.156:3300/0 conn(0x7f7ec8134120 0x7f7ec813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:58.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.910+0000 7f7ece476700 1 --2- 172.21.15.156:0/2303233534 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ec80a0a70 0x7f7ec80a0e40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4009840 tx=0x7f7ec4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6f64fc0ce064e30 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:58.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.910+0000 7f7ecd474700 1 -- 172.21.15.156:0/2303233534 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec4011830 con 0x7f7ec80a0a70 2023-09-30T22:21:58.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.910+0000 7f7ecd474700 1 -- 172.21.15.156:0/2303233534 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec4011990 con 0x7f7ec80a0a70 2023-09-30T22:21:58.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.910+0000 7f7ecd474700 1 -- 172.21.15.156:0/2303233534 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec4011d20 con 0x7f7ec80a0a70 2023-09-30T22:21:58.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.911+0000 7f7ed06da700 1 -- 172.21.15.156:0/2303233534 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ec80a0a70 msgr2=0x7f7ec80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.911+0000 7f7ed06da700 1 --2- 172.21.15.156:0/2303233534 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ec80a0a70 0x7f7ec80a0e40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4009840 tx=0x7f7ec4009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:58.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.911+0000 7f7ed06da700 1 -- 172.21.15.156:0/2303233534 shutdown_connections 2023-09-30T22:21:58.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.911+0000 7f7ed06da700 1 --2- 172.21.15.156:0/2303233534 >> v2:172.21.15.156:3300/0 conn(0x7f7ec8134120 0x7f7ec813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.911+0000 7f7ed06da700 1 --2- 172.21.15.156:0/2303233534 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ec80a0a70 0x7f7ec80a0e40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.911+0000 7f7ed06da700 1 -- 172.21.15.156:0/2303233534 >> 172.21.15.156:0/2303233534 conn(0x7f7ec80a6610 msgr2=0x7f7ec80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:58.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.911+0000 7f7ed06da700 1 -- 172.21.15.156:0/2303233534 shutdown_connections 2023-09-30T22:21:58.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.911+0000 7f7ed06da700 1 -- 172.21.15.156:0/2303233534 wait complete. 2023-09-30T22:21:58.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.912+0000 7f7ed06da700 1 Processor -- start 2023-09-30T22:21:58.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.912+0000 7f7ed06da700 1 -- start start 2023-09-30T22:21:58.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.912+0000 7f7ed06da700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ec80a0a70 0x7f7ec8122740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.912+0000 7f7ed06da700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ec80a1380 0x7f7ec8122c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.912+0000 7f7ed06da700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7ec8134120 0x7f7ec81231c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.912+0000 7f7ed06da700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec8123ba0 con 0x7f7ec80a0a70 2023-09-30T22:21:58.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.912+0000 7f7ed06da700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec8125c70 con 0x7f7ec80a1380 2023-09-30T22:21:58.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.912+0000 7f7ed06da700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec8133640 con 0x7f7ec8134120 2023-09-30T22:21:58.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.912+0000 7f7ece476700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ec80a0a70 0x7f7ec8122740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.912+0000 7f7ece476700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ec80a0a70 0x7f7ec8122740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54398/0 (socket says 172.21.15.156:54398) 2023-09-30T22:21:58.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.912+0000 7f7ece476700 1 -- 172.21.15.156:0/2752341855 learned_addr learned my addr 172.21.15.156:0/2752341855 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:58.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.913+0000 7f7ecdc75700 1 --2- 172.21.15.156:0/2752341855 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ec80a1380 0x7f7ec8122c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.913+0000 7f7ecec77700 1 --2- 172.21.15.156:0/2752341855 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7ec8134120 0x7f7ec81231c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.913+0000 7f7ece476700 1 -- 172.21.15.156:0/2752341855 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7ec8134120 msgr2=0x7f7ec81231c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.913+0000 7f7ece476700 1 --2- 172.21.15.156:0/2752341855 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7ec8134120 0x7f7ec81231c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.913+0000 7f7ece476700 1 -- 172.21.15.156:0/2752341855 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ec80a1380 msgr2=0x7f7ec8122c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.913+0000 7f7ece476700 1 --2- 172.21.15.156:0/2752341855 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ec80a1380 0x7f7ec8122c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.913+0000 7f7ece476700 1 -- 172.21.15.156:0/2752341855 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec0009a70 con 0x7f7ec80a0a70 2023-09-30T22:21:58.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.913+0000 7f7ecdc75700 1 --2- 172.21.15.156:0/2752341855 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ec80a1380 0x7f7ec8122c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:58.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.913+0000 7f7ece476700 1 --2- 172.21.15.156:0/2752341855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ec80a0a70 0x7f7ec8122740 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f7ec40090b0 tx=0x7f7ec4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:58.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.913+0000 7f7ebeffd700 1 -- 172.21.15.156:0/2752341855 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec4004550 con 0x7f7ec80a0a70 2023-09-30T22:21:58.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.913+0000 7f7ebeffd700 1 -- 172.21.15.156:0/2752341855 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec401f070 con 0x7f7ec80a0a70 2023-09-30T22:21:58.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.913+0000 7f7ed06da700 1 -- 172.21.15.156:0/2752341855 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec40094a0 con 0x7f7ec80a0a70 2023-09-30T22:21:58.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.913+0000 7f7ebeffd700 1 -- 172.21.15.156:0/2752341855 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec40038e0 con 0x7f7ec80a0a70 2023-09-30T22:21:58.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.913+0000 7f7ed06da700 1 -- 172.21.15.156:0/2752341855 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec81269a0 con 0x7f7ec80a0a70 2023-09-30T22:21:58.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.914+0000 7f7ebeffd700 1 -- 172.21.15.156:0/2752341855 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ec4003a40 con 0x7f7ec80a0a70 2023-09-30T22:21:58.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.914+0000 7f7ebeffd700 1 -- 172.21.15.156:0/2752341855 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7ec4021070 con 0x7f7ec80a0a70 2023-09-30T22:21:58.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.915+0000 7f7ed06da700 1 -- 172.21.15.156:0/2752341855 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec804f2a0 con 0x7f7ec80a0a70 2023-09-30T22:21:58.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.920+0000 7f7ebeffd700 1 -- 172.21.15.156:0/2752341855 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ec401a430 con 0x7f7ec80a0a70 2023-09-30T22:21:58.967 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:58.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.985+0000 7fc3f78f7700 1 Processor -- start 2023-09-30T22:21:58.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.985+0000 7fc3f78f7700 1 -- start start 2023-09-30T22:21:58.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.986+0000 7fc3f78f7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3f0066410 0x7fc3f01319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.986+0000 7fc3f78f7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3f01314b0 0x7fc3f0131f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.986+0000 7fc3f78f7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc3f009bc70 0x7fc3f009c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.986+0000 7fc3f78f7700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f00667e0 con 0x7fc3f009bc70 2023-09-30T22:21:58.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.986+0000 7fc3f78f7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f00a23c0 con 0x7fc3f0066410 2023-09-30T22:21:58.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.986+0000 7fc3f78f7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f00a0f20 con 0x7fc3f01314b0 2023-09-30T22:21:58.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.986+0000 7fc3f4e92700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3f01314b0 0x7fc3f0131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.986+0000 7fc3f5e94700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc3f009bc70 0x7fc3f009c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.986+0000 7fc3f4e92700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3f01314b0 0x7fc3f0131f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33606/0 (socket says 172.21.15.156:33606) 2023-09-30T22:21:58.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.986+0000 7fc3f4e92700 1 -- 172.21.15.156:0/4256453738 learned_addr learned my addr 172.21.15.156:0/4256453738 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:58.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.986+0000 7fc3f5693700 1 --2- 172.21.15.156:0/4256453738 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3f0066410 0x7fc3f01319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.986+0000 7fc3f5e94700 1 -- 172.21.15.156:0/4256453738 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3f01314b0 msgr2=0x7fc3f0131f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:58.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.986+0000 7fc3f5e94700 1 --2- 172.21.15.156:0/4256453738 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3f01314b0 0x7fc3f0131f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.986+0000 7fc3f5e94700 1 -- 172.21.15.156:0/4256453738 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3f0066410 msgr2=0x7fc3f01319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:58.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.986+0000 7fc3f5e94700 1 --2- 172.21.15.156:0/4256453738 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3f0066410 0x7fc3f01319f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.986+0000 7fc3f5e94700 1 -- 172.21.15.156:0/4256453738 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f00a16e0 con 0x7fc3f009bc70 2023-09-30T22:21:58.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.986+0000 7fc3f4e92700 1 --2- 172.21.15.156:0/4256453738 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3f01314b0 0x7fc3f0131f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:58.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.987+0000 7fc3f5e94700 1 --2- 172.21.15.156:0/4256453738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3f009bc70 0x7fc3f009c0f0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8009e20 tx=0x7fc3e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1259eaa8511262af server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:58.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.987+0000 7fc3e7fff700 1 -- 172.21.15.156:0/4256453738 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e800e070 con 0x7fc3f009bc70 2023-09-30T22:21:58.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.987+0000 7fc3e7fff700 1 -- 172.21.15.156:0/4256453738 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e800baa0 con 0x7fc3f009bc70 2023-09-30T22:21:58.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.987+0000 7fc3e7fff700 1 -- 172.21.15.156:0/4256453738 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e800be50 con 0x7fc3f009bc70 2023-09-30T22:21:58.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.988+0000 7fc3f78f7700 1 -- 172.21.15.156:0/4256453738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3f009bc70 msgr2=0x7fc3f009c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.988+0000 7fc3f78f7700 1 --2- 172.21.15.156:0/4256453738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3f009bc70 0x7fc3f009c0f0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8009e20 tx=0x7fc3e800b330 comp rx=0 tx=0).stop 2023-09-30T22:21:58.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.988+0000 7fc3f78f7700 1 -- 172.21.15.156:0/4256453738 shutdown_connections 2023-09-30T22:21:58.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.988+0000 7fc3f78f7700 1 --2- 172.21.15.156:0/4256453738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3f009bc70 0x7fc3f009c0f0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.988+0000 7fc3f78f7700 1 --2- 172.21.15.156:0/4256453738 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3f0066410 0x7fc3f01319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.988+0000 7fc3f78f7700 1 --2- 172.21.15.156:0/4256453738 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3f01314b0 0x7fc3f0131f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.988+0000 7fc3f78f7700 1 -- 172.21.15.156:0/4256453738 >> 172.21.15.156:0/4256453738 conn(0x7fc3f00a2980 msgr2=0x7fc3f00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:58.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.988+0000 7fc3f78f7700 1 -- 172.21.15.156:0/4256453738 shutdown_connections 2023-09-30T22:21:58.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.988+0000 7fc3f78f7700 1 -- 172.21.15.156:0/4256453738 wait complete. 2023-09-30T22:21:58.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.989+0000 7fc3f78f7700 1 Processor -- start 2023-09-30T22:21:58.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.989+0000 7fc3f78f7700 1 -- start start 2023-09-30T22:21:58.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.989+0000 7fc3f78f7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3f0066410 0x7fc3f0099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.989+0000 7fc3f78f7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3f009bc70 0x7fc3f0099fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.989+0000 7fc3f78f7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3f01314b0 0x7fc3f009a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.989+0000 7fc3f78f7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f012dce0 con 0x7fc3f0066410 2023-09-30T22:21:58.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.989+0000 7fc3f78f7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f011fe90 con 0x7fc3f01314b0 2023-09-30T22:21:58.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.989+0000 7fc3f78f7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f011f3b0 con 0x7fc3f009bc70 2023-09-30T22:21:58.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.989+0000 7fc3f4e92700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3f009bc70 0x7fc3f0099fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.989+0000 7fc3f4e92700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3f009bc70 0x7fc3f0099fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33618/0 (socket says 172.21.15.156:33618) 2023-09-30T22:21:58.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.989+0000 7fc3f4e92700 1 -- 172.21.15.156:0/1189040925 learned_addr learned my addr 172.21.15.156:0/1189040925 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:58.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.990+0000 7fc3f5693700 1 --2- 172.21.15.156:0/1189040925 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3f0066410 0x7fc3f0099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.990+0000 7fc3f5e94700 1 --2- 172.21.15.156:0/1189040925 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3f01314b0 0x7fc3f009a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.990+0000 7fc3f4e92700 1 -- 172.21.15.156:0/1189040925 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3f01314b0 msgr2=0x7fc3f009a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.990+0000 7fc3f4e92700 1 --2- 172.21.15.156:0/1189040925 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3f01314b0 0x7fc3f009a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.990+0000 7fc3f4e92700 1 -- 172.21.15.156:0/1189040925 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3f0066410 msgr2=0x7fc3f0099a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.990+0000 7fc3f4e92700 1 --2- 172.21.15.156:0/1189040925 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3f0066410 0x7fc3f0099a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.990+0000 7fc3f4e92700 1 -- 172.21.15.156:0/1189040925 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e0009550 con 0x7fc3f009bc70 2023-09-30T22:21:58.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.990+0000 7fc3f4e92700 1 --2- 172.21.15.156:0/1189040925 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3f009bc70 0x7fc3f0099fd0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc3e000ebe0 tx=0x7fc3e000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:58.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.990+0000 7fc3e5ffb700 1 -- 172.21.15.156:0/1189040925 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e000c850 con 0x7fc3f009bc70 2023-09-30T22:21:58.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.990+0000 7fc3e5ffb700 1 -- 172.21.15.156:0/1189040925 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e000c9b0 con 0x7fc3f009bc70 2023-09-30T22:21:58.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.990+0000 7fc3f78f7700 1 -- 172.21.15.156:0/1189040925 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e8009a70 con 0x7fc3f009bc70 2023-09-30T22:21:58.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.990+0000 7fc3e5ffb700 1 -- 172.21.15.156:0/1189040925 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e000cd60 con 0x7fc3f009bc70 2023-09-30T22:21:58.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.990+0000 7fc3f78f7700 1 -- 172.21.15.156:0/1189040925 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f0130d70 con 0x7fc3f009bc70 2023-09-30T22:21:58.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.991+0000 7fc3e5ffb700 1 -- 172.21.15.156:0/1189040925 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc3e0013470 con 0x7fc3f009bc70 2023-09-30T22:21:58.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.991+0000 7fc3f78f7700 1 -- 172.21.15.156:0/1189040925 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f00704b0 con 0x7fc3f009bc70 2023-09-30T22:21:58.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.992+0000 7fc3e5ffb700 1 -- 172.21.15.156:0/1189040925 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc3e003fb80 con 0x7fc3f009bc70 2023-09-30T22:21:58.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:58.996+0000 7fc3e5ffb700 1 -- 172.21.15.156:0/1189040925 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc3e001b3b0 con 0x7fc3f009bc70 2023-09-30T22:21:59.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.094+0000 7fb820b7e700 1 Processor -- start 2023-09-30T22:21:59.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.094+0000 7fb820b7e700 1 -- start start 2023-09-30T22:21:59.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.095+0000 7fb820b7e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb81c09f350 0x7fb81c136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:59.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.095+0000 7fb820b7e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb81c1371c0 0x7fb81c1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:59.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.095+0000 7fb820b7e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb81c09c970 con 0x7fb81c09e870 2023-09-30T22:21:59.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.095+0000 7fb820b7e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb81c0a0920 con 0x7fb81c1371c0 2023-09-30T22:21:59.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.095+0000 7fb820b7e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c09f9c0 con 0x7fb81c09f350 2023-09-30T22:21:59.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.095+0000 7fb819d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb81c09f350 0x7fb81c136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:59.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.095+0000 7fb819d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb81c09f350 0x7fb81c136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:55914/0 (socket says 172.21.15.156:55914) 2023-09-30T22:21:59.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.095+0000 7fb819d9b700 1 -- 172.21.15.156:0/4235027454 learned_addr learned my addr 172.21.15.156:0/4235027454 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:59.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.095+0000 7fb81a59c700 1 --1- 172.21.15.156:0/4235027454 >> v1:172.21.15.156:6789/0 conn(0x7fb81c09e870 0x7fb81c09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40678/0 (socket says 172.21.15.156:40678) 2023-09-30T22:21:59.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.095+0000 7fb81ad9d700 1 --2- 172.21.15.156:0/4235027454 >> v2:172.21.15.156:3300/0 conn(0x7fb81c1371c0 0x7fb81c1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:59.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.095+0000 7fb819d9b700 1 -- 172.21.15.156:0/4235027454 >> v2:172.21.15.156:3300/0 conn(0x7fb81c1371c0 msgr2=0x7fb81c1395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:59.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.095+0000 7fb819d9b700 1 --2- 172.21.15.156:0/4235027454 >> v2:172.21.15.156:3300/0 conn(0x7fb81c1371c0 0x7fb81c1395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.095+0000 7fb81959a700 1 -- 172.21.15.156:0/4235027454 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4131936315 0 0) 0x7fb81c09c970 con 0x7fb81c09e870 2023-09-30T22:21:59.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.095+0000 7fb819d9b700 1 -- 172.21.15.156:0/4235027454 >> v1:172.21.15.156:6789/0 conn(0x7fb81c09e870 legacy=0x7fb81c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.095+0000 7fb819d9b700 1 -- 172.21.15.156:0/4235027454 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81c09bab0 con 0x7fb81c09f350 2023-09-30T22:21:59.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.095+0000 7fb819d9b700 1 --2- 172.21.15.156:0/4235027454 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb81c09f350 0x7fb81c136c80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb8100098f0 tx=0x7fb810009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2ade0434008748c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:59.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.096+0000 7fb81959a700 1 -- 172.21.15.156:0/4235027454 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb810011830 con 0x7fb81c09f350 2023-09-30T22:21:59.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.096+0000 7fb81959a700 1 -- 172.21.15.156:0/4235027454 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb810011990 con 0x7fb81c09f350 2023-09-30T22:21:59.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.096+0000 7fb81959a700 1 -- 172.21.15.156:0/4235027454 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb810011d20 con 0x7fb81c09f350 2023-09-30T22:21:59.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.096+0000 7fb820b7e700 1 -- 172.21.15.156:0/4235027454 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb81c09f350 msgr2=0x7fb81c136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.096+0000 7fb820b7e700 1 --2- 172.21.15.156:0/4235027454 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb81c09f350 0x7fb81c136c80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb8100098f0 tx=0x7fb810009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:59.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.097+0000 7fb820b7e700 1 -- 172.21.15.156:0/4235027454 shutdown_connections 2023-09-30T22:21:59.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.097+0000 7fb820b7e700 1 --2- 172.21.15.156:0/4235027454 >> v2:172.21.15.156:3300/0 conn(0x7fb81c1371c0 0x7fb81c1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.097+0000 7fb820b7e700 1 --2- 172.21.15.156:0/4235027454 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb81c09f350 0x7fb81c136c80 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.097+0000 7fb820b7e700 1 -- 172.21.15.156:0/4235027454 >> 172.21.15.156:0/4235027454 conn(0x7fb81c0a4430 msgr2=0x7fb81c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:59.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.097+0000 7fb820b7e700 1 -- 172.21.15.156:0/4235027454 shutdown_connections 2023-09-30T22:21:59.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.097+0000 7fb820b7e700 1 -- 172.21.15.156:0/4235027454 wait complete. 2023-09-30T22:21:59.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.098+0000 7fb820b7e700 1 Processor -- start 2023-09-30T22:21:59.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.098+0000 7fb820b7e700 1 -- start start 2023-09-30T22:21:59.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.099+0000 7fb820b7e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb81c09e870 0x7fb81c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:59.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.099+0000 7fb820b7e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb81c09f350 0x7fb81c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:59.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.099+0000 7fb820b7e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb81c1371c0 0x7fb81c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:59.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.099+0000 7fb820b7e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c124dd0 con 0x7fb81c09e870 2023-09-30T22:21:59.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.099+0000 7fb820b7e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c06d5d0 con 0x7fb81c09f350 2023-09-30T22:21:59.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.099+0000 7fb820b7e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c1368e0 con 0x7fb81c1371c0 2023-09-30T22:21:59.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.099+0000 7fb81a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb81c09e870 0x7fb81c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:59.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.099+0000 7fb81a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb81c09e870 0x7fb81c06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54424/0 (socket says 172.21.15.156:54424) 2023-09-30T22:21:59.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.099+0000 7fb81a59c700 1 -- 172.21.15.156:0/3854295295 learned_addr learned my addr 172.21.15.156:0/3854295295 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:59.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.099+0000 7fb819d9b700 1 --2- 172.21.15.156:0/3854295295 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb81c09f350 0x7fb81c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:59.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.099+0000 7fb81ad9d700 1 --2- 172.21.15.156:0/3854295295 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb81c1371c0 0x7fb81c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:59.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.099+0000 7fb81a59c700 1 -- 172.21.15.156:0/3854295295 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb81c1371c0 msgr2=0x7fb81c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.099+0000 7fb81a59c700 1 --2- 172.21.15.156:0/3854295295 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb81c1371c0 0x7fb81c06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.099+0000 7fb81a59c700 1 -- 172.21.15.156:0/3854295295 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb81c09f350 msgr2=0x7fb81c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.099+0000 7fb81a59c700 1 --2- 172.21.15.156:0/3854295295 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb81c09f350 0x7fb81c06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.099+0000 7fb81a59c700 1 -- 172.21.15.156:0/3854295295 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb810009550 con 0x7fb81c09e870 2023-09-30T22:21:59.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.099+0000 7fb819d9b700 1 --2- 172.21.15.156:0/3854295295 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb81c09f350 0x7fb81c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:59.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.100+0000 7fb81a59c700 1 --2- 172.21.15.156:0/3854295295 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb81c09e870 0x7fb81c06b8b0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00c520 tx=0x7fb80c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:59.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.100+0000 7fb80affd700 1 -- 172.21.15.156:0/3854295295 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c004c80 con 0x7fb81c09e870 2023-09-30T22:21:59.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.100+0000 7fb80affd700 1 -- 172.21.15.156:0/3854295295 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80c004e00 con 0x7fb81c09e870 2023-09-30T22:21:59.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.100+0000 7fb820b7e700 1 -- 172.21.15.156:0/3854295295 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb81c09dba0 con 0x7fb81c09e870 2023-09-30T22:21:59.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.100+0000 7fb80affd700 1 -- 172.21.15.156:0/3854295295 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c007310 con 0x7fb81c09e870 2023-09-30T22:21:59.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.100+0000 7fb820b7e700 1 -- 172.21.15.156:0/3854295295 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb81c126480 con 0x7fb81c09e870 2023-09-30T22:21:59.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.101+0000 7fb820b7e700 1 -- 172.21.15.156:0/3854295295 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb81c04f2a0 con 0x7fb81c09e870 2023-09-30T22:21:59.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.101+0000 7fb80affd700 1 -- 172.21.15.156:0/3854295295 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb80c007470 con 0x7fb81c09e870 2023-09-30T22:21:59.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.101+0000 7fb80affd700 1 -- 172.21.15.156:0/3854295295 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb80c03f230 con 0x7fb81c09e870 2023-09-30T22:21:59.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.110+0000 7fb80affd700 1 -- 172.21.15.156:0/3854295295 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb80c0133c0 con 0x7fb81c09e870 2023-09-30T22:21:59.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.124+0000 7f7ed06da700 1 -- 172.21.15.156:0/2752341855 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7ec8072980 con 0x7f7ec80a0a70 2023-09-30T22:21:59.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.124+0000 7f7ebeffd700 1 -- 172.21.15.156:0/2752341855 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7ec4015020 con 0x7f7ec80a0a70 2023-09-30T22:21:59.125 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:21:59.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.126+0000 7f7ed06da700 1 -- 172.21.15.156:0/2752341855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ec80a0a70 msgr2=0x7f7ec8122740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.126+0000 7f7ed06da700 1 --2- 172.21.15.156:0/2752341855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ec80a0a70 0x7f7ec8122740 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f7ec40090b0 tx=0x7f7ec4004750 comp rx=0 tx=0).stop 2023-09-30T22:21:59.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.126+0000 7f7ed06da700 1 -- 172.21.15.156:0/2752341855 shutdown_connections 2023-09-30T22:21:59.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.126+0000 7f7ed06da700 1 --2- 172.21.15.156:0/2752341855 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7ec8134120 0x7f7ec81231c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.126+0000 7f7ed06da700 1 --2- 172.21.15.156:0/2752341855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ec80a0a70 0x7f7ec8122740 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.126+0000 7f7ed06da700 1 --2- 172.21.15.156:0/2752341855 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ec80a1380 0x7f7ec8122c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.126+0000 7f7ed06da700 1 -- 172.21.15.156:0/2752341855 >> 172.21.15.156:0/2752341855 conn(0x7f7ec80a6610 msgr2=0x7f7ec80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:59.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.127+0000 7f7ed06da700 1 -- 172.21.15.156:0/2752341855 shutdown_connections 2023-09-30T22:21:59.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.127+0000 7f7ed06da700 1 -- 172.21.15.156:0/2752341855 wait complete. 2023-09-30T22:21:59.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:21:59.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.191+0000 7fc3f78f7700 1 -- 172.21.15.156:0/1189040925 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc3f00a1d50 con 0x7fc3f009bc70 2023-09-30T22:21:59.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.191+0000 7fc3e5ffb700 1 -- 172.21.15.156:0/1189040925 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc3e0017020 con 0x7fc3f009bc70 2023-09-30T22:21:59.192 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:21:59.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.193+0000 7fc3f78f7700 1 -- 172.21.15.156:0/1189040925 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3f009bc70 msgr2=0x7fc3f0099fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.193+0000 7fc3f78f7700 1 --2- 172.21.15.156:0/1189040925 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3f009bc70 0x7fc3f0099fd0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc3e000ebe0 tx=0x7fc3e000eef0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.193+0000 7fc3f78f7700 1 -- 172.21.15.156:0/1189040925 shutdown_connections 2023-09-30T22:21:59.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.193+0000 7fc3f78f7700 1 --2- 172.21.15.156:0/1189040925 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc3f01314b0 0x7fc3f009a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.193+0000 7fc3f78f7700 1 --2- 172.21.15.156:0/1189040925 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3f0066410 0x7fc3f0099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.193+0000 7fc3f78f7700 1 --2- 172.21.15.156:0/1189040925 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3f009bc70 0x7fc3f0099fd0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.193+0000 7fc3f78f7700 1 -- 172.21.15.156:0/1189040925 >> 172.21.15.156:0/1189040925 conn(0x7fc3f00a2980 msgr2=0x7fc3f01b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:59.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.193+0000 7fc3f78f7700 1 -- 172.21.15.156:0/1189040925 shutdown_connections 2023-09-30T22:21:59.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.193+0000 7fc3f78f7700 1 -- 172.21.15.156:0/1189040925 wait complete. 2023-09-30T22:21:59.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:21:59.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.300+0000 7fb820b7e700 1 -- 172.21.15.156:0/3854295295 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb81c126100 con 0x7fb81c09e870 2023-09-30T22:21:59.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.300+0000 7fb80affd700 1 -- 172.21.15.156:0/3854295295 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb80c011360 con 0x7fb81c09e870 2023-09-30T22:21:59.301 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:21:59.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.302+0000 7fb820b7e700 1 -- 172.21.15.156:0/3854295295 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb81c09e870 msgr2=0x7fb81c06b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.302+0000 7fb820b7e700 1 --2- 172.21.15.156:0/3854295295 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb81c09e870 0x7fb81c06b8b0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00c520 tx=0x7fb80c00c830 comp rx=0 tx=0).stop 2023-09-30T22:21:59.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.302+0000 7fb820b7e700 1 -- 172.21.15.156:0/3854295295 shutdown_connections 2023-09-30T22:21:59.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.302+0000 7fb820b7e700 1 --2- 172.21.15.156:0/3854295295 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb81c1371c0 0x7fb81c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.302+0000 7fb820b7e700 1 --2- 172.21.15.156:0/3854295295 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb81c09e870 0x7fb81c06b8b0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.302+0000 7fb820b7e700 1 --2- 172.21.15.156:0/3854295295 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb81c09f350 0x7fb81c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.302+0000 7fb820b7e700 1 -- 172.21.15.156:0/3854295295 >> 172.21.15.156:0/3854295295 conn(0x7fb81c0a4430 msgr2=0x7fb81c0a2960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:59.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.302+0000 7fb820b7e700 1 -- 172.21.15.156:0/3854295295 shutdown_connections 2023-09-30T22:21:59.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.302+0000 7fb820b7e700 1 -- 172.21.15.156:0/3854295295 wait complete. 2023-09-30T22:21:59.315 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:21:59.764 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:59.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.888+0000 7f36ae49a700 1 Processor -- start 2023-09-30T22:21:59.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.888+0000 7f36ae49a700 1 -- start start 2023-09-30T22:21:59.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.889+0000 7f36ae49a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f36a809e870 0x7f36a809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:59.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.889+0000 7f36ae49a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f36a8131f40 0x7f36a8139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:59.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.889+0000 7f36ae49a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a809c970 con 0x7f36a809f180 2023-09-30T22:21:59.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.889+0000 7f36ae49a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a80a0920 con 0x7f36a8131f40 2023-09-30T22:21:59.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.889+0000 7f36ae49a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36a809f9c0 con 0x7f36a809e870 2023-09-30T22:21:59.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.889+0000 7f36aca37700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f36a8131f40 0x7f36a8139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:59.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.889+0000 7f36a77fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f36a809f180 0x7f36a8131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40686/0 (socket says 172.21.15.156:40686) 2023-09-30T22:21:59.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.889+0000 7f36a7fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f36a809e870 0x7f36a809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:59.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.889+0000 7f36a77fe700 1 -- 172.21.15.156:0/1205986049 learned_addr learned my addr 172.21.15.156:0/1205986049 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:21:59.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.889+0000 7f36a6ffd700 1 -- 172.21.15.156:0/1205986049 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3751875172 0 0) 0x7f36a809c970 con 0x7f36a809f180 2023-09-30T22:21:59.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.889+0000 7f36a6ffd700 1 -- 172.21.15.156:0/1205986049 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36900035b0 con 0x7f36a809f180 2023-09-30T22:21:59.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.889+0000 7f36aca37700 1 -- 172.21.15.156:0/1205986049 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f36a809e870 msgr2=0x7f36a809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:59.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.889+0000 7f36aca37700 1 --2- 172.21.15.156:0/1205986049 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f36a809e870 0x7f36a809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.889+0000 7f36aca37700 1 -- 172.21.15.156:0/1205986049 >> v1:172.21.15.156:6789/0 conn(0x7f36a809f180 legacy=0x7f36a8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.889+0000 7f36aca37700 1 -- 172.21.15.156:0/1205986049 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a809bab0 con 0x7f36a8131f40 2023-09-30T22:21:59.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.889+0000 7f36a7fff700 1 --2- 172.21.15.156:0/1205986049 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f36a809e870 0x7f36a809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:59.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.890+0000 7f36aca37700 1 --2- 172.21.15.156:0/1205986049 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f36a8131f40 0x7f36a8139ca0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009dc0 tx=0x7f36a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5b54f5a2e06b52e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:59.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.890+0000 7f36a6ffd700 1 -- 172.21.15.156:0/1205986049 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a000e070 con 0x7f36a8131f40 2023-09-30T22:21:59.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.890+0000 7f36a6ffd700 1 -- 172.21.15.156:0/1205986049 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a000bb20 con 0x7f36a8131f40 2023-09-30T22:21:59.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.890+0000 7f36a6ffd700 1 -- 172.21.15.156:0/1205986049 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a0012430 con 0x7f36a8131f40 2023-09-30T22:21:59.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.890+0000 7f36ae49a700 1 -- 172.21.15.156:0/1205986049 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f36a8131f40 msgr2=0x7f36a8139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.890+0000 7f36ae49a700 1 --2- 172.21.15.156:0/1205986049 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f36a8131f40 0x7f36a8139ca0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009dc0 tx=0x7f36a000b330 comp rx=0 tx=0).stop 2023-09-30T22:21:59.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.890+0000 7f36ae49a700 1 -- 172.21.15.156:0/1205986049 shutdown_connections 2023-09-30T22:21:59.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.890+0000 7f36ae49a700 1 --2- 172.21.15.156:0/1205986049 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f36a8131f40 0x7f36a8139ca0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.890+0000 7f36ae49a700 1 --2- 172.21.15.156:0/1205986049 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f36a809e870 0x7f36a809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.890+0000 7f36ae49a700 1 -- 172.21.15.156:0/1205986049 >> 172.21.15.156:0/1205986049 conn(0x7f36a80a4430 msgr2=0x7f36a80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:59.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.890+0000 7f36ae49a700 1 -- 172.21.15.156:0/1205986049 shutdown_connections 2023-09-30T22:21:59.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.890+0000 7f36ae49a700 1 -- 172.21.15.156:0/1205986049 wait complete. 2023-09-30T22:21:59.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.891+0000 7f36ae49a700 1 Processor -- start 2023-09-30T22:21:59.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.891+0000 7f36ae49a700 1 -- start start 2023-09-30T22:21:59.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.892+0000 7f36ae49a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f36a809e870 0x7f36a811d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:59.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.892+0000 7f36ae49a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f36a809f180 0x7f36a811d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:59.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.892+0000 7f36ae49a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36a8131f40 0x7f36a811db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:59.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.892+0000 7f36ae49a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a811fe40 con 0x7f36a8131f40 2023-09-30T22:21:59.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.892+0000 7f36ae49a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a811ed70 con 0x7f36a809e870 2023-09-30T22:21:59.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.892+0000 7f36ae49a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36a809dba0 con 0x7f36a809f180 2023-09-30T22:21:59.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.892+0000 7f36a7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f36a809e870 0x7f36a811d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:59.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.892+0000 7f36aca37700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36a8131f40 0x7f36a811db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:59.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.892+0000 7f36a7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f36a809e870 0x7f36a811d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:55942/0 (socket says 172.21.15.156:55942) 2023-09-30T22:21:59.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.892+0000 7f36a7fff700 1 -- 172.21.15.156:0/3304731711 learned_addr learned my addr 172.21.15.156:0/3304731711 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:21:59.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.892+0000 7f36a77fe700 1 --2- 172.21.15.156:0/3304731711 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f36a809f180 0x7f36a811d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:59.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.892+0000 7f36a7fff700 1 -- 172.21.15.156:0/3304731711 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f36a809f180 msgr2=0x7f36a811d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.892+0000 7f36a7fff700 1 --2- 172.21.15.156:0/3304731711 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f36a809f180 0x7f36a811d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.892+0000 7f36a7fff700 1 -- 172.21.15.156:0/3304731711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36a8131f40 msgr2=0x7f36a811db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.892+0000 7f36a7fff700 1 --2- 172.21.15.156:0/3304731711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36a8131f40 0x7f36a811db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.892+0000 7f36a7fff700 1 -- 172.21.15.156:0/3304731711 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36980094a0 con 0x7f36a809e870 2023-09-30T22:21:59.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.892+0000 7f36a7fff700 1 --2- 172.21.15.156:0/3304731711 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f36a809e870 0x7f36a811d0c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f369800ebe0 tx=0x7f369800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:59.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.892+0000 7f36a4ff9700 1 -- 172.21.15.156:0/3304731711 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3698009760 con 0x7f36a809e870 2023-09-30T22:21:59.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.892+0000 7f36a4ff9700 1 -- 172.21.15.156:0/3304731711 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369800c850 con 0x7f36a809e870 2023-09-30T22:21:59.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.892+0000 7f36ae49a700 1 -- 172.21.15.156:0/3304731711 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a0009a70 con 0x7f36a809e870 2023-09-30T22:21:59.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.892+0000 7f36a4ff9700 1 -- 172.21.15.156:0/3304731711 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369800cbe0 con 0x7f36a809e870 2023-09-30T22:21:59.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.893+0000 7f36ae49a700 1 -- 172.21.15.156:0/3304731711 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a8120820 con 0x7f36a809e870 2023-09-30T22:21:59.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.893+0000 7f36a4ff9700 1 -- 172.21.15.156:0/3304731711 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f369800cd40 con 0x7f36a809e870 2023-09-30T22:21:59.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.893+0000 7f36a4ff9700 1 -- 172.21.15.156:0/3304731711 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f369803fac0 con 0x7f36a809e870 2023-09-30T22:21:59.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.893+0000 7f36ae49a700 1 -- 172.21.15.156:0/3304731711 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a81204c0 con 0x7f36a809e870 2023-09-30T22:21:59.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:21:59.898+0000 7f36a4ff9700 1 -- 172.21.15.156:0/3304731711 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f369801b3b0 con 0x7f36a809e870 2023-09-30T22:22:00.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.081+0000 7f36ae49a700 1 -- 172.21.15.156:0/3304731711 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f36a80727b0 con 0x7f36a809e870 2023-09-30T22:22:00.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.081+0000 7f36a4ff9700 1 -- 172.21.15.156:0/3304731711 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3698021020 con 0x7f36a809e870 2023-09-30T22:22:00.082 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:00.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.084+0000 7f36ae49a700 1 -- 172.21.15.156:0/3304731711 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f36a809e870 msgr2=0x7f36a811d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.084+0000 7f36ae49a700 1 --2- 172.21.15.156:0/3304731711 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f36a809e870 0x7f36a811d0c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f369800ebe0 tx=0x7f369800eef0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.084+0000 7f36ae49a700 1 -- 172.21.15.156:0/3304731711 shutdown_connections 2023-09-30T22:22:00.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.084+0000 7f36ae49a700 1 --2- 172.21.15.156:0/3304731711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36a8131f40 0x7f36a811db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.084+0000 7f36ae49a700 1 --2- 172.21.15.156:0/3304731711 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f36a809e870 0x7f36a811d0c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.084+0000 7f36ae49a700 1 --2- 172.21.15.156:0/3304731711 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f36a809f180 0x7f36a811d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.084+0000 7f36ae49a700 1 -- 172.21.15.156:0/3304731711 >> 172.21.15.156:0/3304731711 conn(0x7f36a80a4430 msgr2=0x7f36a806f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:00.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.084+0000 7f36ae49a700 1 -- 172.21.15.156:0/3304731711 shutdown_connections 2023-09-30T22:22:00.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.084+0000 7f36ae49a700 1 -- 172.21.15.156:0/3304731711 wait complete. 2023-09-30T22:22:00.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:00.140 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:00.207 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:00.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.265+0000 7f2a57386700 1 Processor -- start 2023-09-30T22:22:00.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.265+0000 7f2a57386700 1 -- start start 2023-09-30T22:22:00.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.266+0000 7f2a57386700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a500a0a70 0x7f2a500a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:00.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.266+0000 7f2a57386700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a500a1380 0x7f2a50133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:00.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.266+0000 7f2a57386700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2a50133f50 0x7f2a501343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:00.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.266+0000 7f2a57386700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a5009e9d0 con 0x7f2a50133f50 2023-09-30T22:22:00.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.266+0000 7f2a57386700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5009dc00 con 0x7f2a500a0a70 2023-09-30T22:22:00.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.266+0000 7f2a57386700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5009dec0 con 0x7f2a500a1380 2023-09-30T22:22:00.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.266+0000 7f2a55122700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a500a0a70 0x7f2a500a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:00.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.266+0000 7f2a54921700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a500a1380 0x7f2a50133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:00.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.266+0000 7f2a55923700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2a50133f50 0x7f2a501343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:00.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.266+0000 7f2a54921700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a500a1380 0x7f2a50133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33660/0 (socket says 172.21.15.156:33660) 2023-09-30T22:22:00.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.266+0000 7f2a55122700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a500a0a70 0x7f2a500a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:55956/0 (socket says 172.21.15.156:55956) 2023-09-30T22:22:00.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.266+0000 7f2a55923700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2a50133f50 0x7f2a501343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54440/0 (socket says 172.21.15.156:54440) 2023-09-30T22:22:00.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.266+0000 7f2a54921700 1 -- 172.21.15.156:0/3202636992 learned_addr learned my addr 172.21.15.156:0/3202636992 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:00.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.266+0000 7f2a55923700 1 -- 172.21.15.156:0/3202636992 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a500a1380 msgr2=0x7f2a50133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:00.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.266+0000 7f2a55923700 1 --2- 172.21.15.156:0/3202636992 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a500a1380 0x7f2a50133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.266+0000 7f2a55923700 1 -- 172.21.15.156:0/3202636992 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a500a0a70 msgr2=0x7f2a500a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:00.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.266+0000 7f2a55923700 1 --2- 172.21.15.156:0/3202636992 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a500a0a70 0x7f2a500a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.266+0000 7f2a55923700 1 -- 172.21.15.156:0/3202636992 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5009e6a0 con 0x7f2a50133f50 2023-09-30T22:22:00.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.266+0000 7f2a54921700 1 --2- 172.21.15.156:0/3202636992 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a500a1380 0x7f2a50133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:00.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.266+0000 7f2a55122700 1 --2- 172.21.15.156:0/3202636992 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a500a0a70 0x7f2a500a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:00.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.266+0000 7f2a55923700 1 --2- 172.21.15.156:0/3202636992 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a50133f50 0x7f2a501343f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f2a48009d90 tx=0x7f2a4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6228a71e2d46559a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:00.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.266+0000 7f2a47fff700 1 -- 172.21.15.156:0/3202636992 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4800e070 con 0x7f2a50133f50 2023-09-30T22:22:00.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.267+0000 7f2a47fff700 1 -- 172.21.15.156:0/3202636992 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4800bb20 con 0x7f2a50133f50 2023-09-30T22:22:00.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.267+0000 7f2a47fff700 1 -- 172.21.15.156:0/3202636992 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48012430 con 0x7f2a50133f50 2023-09-30T22:22:00.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.267+0000 7f2a57386700 1 -- 172.21.15.156:0/3202636992 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a50133f50 msgr2=0x7f2a501343f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.267+0000 7f2a57386700 1 --2- 172.21.15.156:0/3202636992 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a50133f50 0x7f2a501343f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f2a48009d90 tx=0x7f2a4800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:00.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.267+0000 7f2a57386700 1 -- 172.21.15.156:0/3202636992 shutdown_connections 2023-09-30T22:22:00.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.267+0000 7f2a57386700 1 --2- 172.21.15.156:0/3202636992 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a50133f50 0x7f2a501343f0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.267+0000 7f2a57386700 1 --2- 172.21.15.156:0/3202636992 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a500a0a70 0x7f2a500a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.267+0000 7f2a57386700 1 --2- 172.21.15.156:0/3202636992 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a500a1380 0x7f2a50133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.267+0000 7f2a57386700 1 -- 172.21.15.156:0/3202636992 >> 172.21.15.156:0/3202636992 conn(0x7f2a500a6610 msgr2=0x7f2a500a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:00.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.267+0000 7f2a57386700 1 -- 172.21.15.156:0/3202636992 shutdown_connections 2023-09-30T22:22:00.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.267+0000 7f2a57386700 1 -- 172.21.15.156:0/3202636992 wait complete. 2023-09-30T22:22:00.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.268+0000 7f2a57386700 1 Processor -- start 2023-09-30T22:22:00.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.268+0000 7f2a57386700 1 -- start start 2023-09-30T22:22:00.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.269+0000 7f2a57386700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a500a0a70 0x7f2a5011f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:00.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.269+0000 7f2a57386700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a500a1380 0x7f2a5011fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:00.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.269+0000 7f2a57386700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a50133f50 0x7f2a501c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:00.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.269+0000 7f2a57386700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a50133530 con 0x7f2a50133f50 2023-09-30T22:22:00.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.269+0000 7f2a57386700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a50120fa0 con 0x7f2a500a1380 2023-09-30T22:22:00.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.269+0000 7f2a57386700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5011f080 con 0x7f2a500a0a70 2023-09-30T22:22:00.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.269+0000 7f2a55122700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a500a0a70 0x7f2a5011f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:00.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.269+0000 7f2a54921700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a500a1380 0x7f2a5011fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:00.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.269+0000 7f2a55122700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a500a0a70 0x7f2a5011f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33670/0 (socket says 172.21.15.156:33670) 2023-09-30T22:22:00.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.269+0000 7f2a55122700 1 -- 172.21.15.156:0/3560181791 learned_addr learned my addr 172.21.15.156:0/3560181791 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:00.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.269+0000 7f2a55923700 1 --2- 172.21.15.156:0/3560181791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a50133f50 0x7f2a501c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:00.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.269+0000 7f2a55122700 1 -- 172.21.15.156:0/3560181791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a500a1380 msgr2=0x7f2a5011fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.269+0000 7f2a55122700 1 --2- 172.21.15.156:0/3560181791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a500a1380 0x7f2a5011fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.269+0000 7f2a55122700 1 -- 172.21.15.156:0/3560181791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a50133f50 msgr2=0x7f2a501c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.269+0000 7f2a55122700 1 --2- 172.21.15.156:0/3560181791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a50133f50 0x7f2a501c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.269+0000 7f2a55122700 1 -- 172.21.15.156:0/3560181791 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4c0094a0 con 0x7f2a500a0a70 2023-09-30T22:22:00.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.269+0000 7f2a55923700 1 --2- 172.21.15.156:0/3560181791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a50133f50 0x7f2a501c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:00.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.269+0000 7f2a55122700 1 --2- 172.21.15.156:0/3560181791 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a500a0a70 0x7f2a5011f500 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c00ec10 tx=0x7f2a4c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:00.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.269+0000 7f2a45ffb700 1 -- 172.21.15.156:0/3560181791 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c00c850 con 0x7f2a500a0a70 2023-09-30T22:22:00.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.269+0000 7f2a45ffb700 1 -- 172.21.15.156:0/3560181791 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4c00c9b0 con 0x7f2a500a0a70 2023-09-30T22:22:00.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.269+0000 7f2a57386700 1 -- 172.21.15.156:0/3560181791 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a40009550 con 0x7f2a500a0a70 2023-09-30T22:22:00.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.269+0000 7f2a45ffb700 1 -- 172.21.15.156:0/3560181791 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c00cd40 con 0x7f2a500a0a70 2023-09-30T22:22:00.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.270+0000 7f2a57386700 1 -- 172.21.15.156:0/3560181791 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a48009a70 con 0x7f2a500a0a70 2023-09-30T22:22:00.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.270+0000 7f2a45ffb700 1 -- 172.21.15.156:0/3560181791 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a4c013470 con 0x7f2a500a0a70 2023-09-30T22:22:00.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.270+0000 7f2a57386700 1 -- 172.21.15.156:0/3560181791 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a50120d60 con 0x7f2a500a0a70 2023-09-30T22:22:00.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.270+0000 7f2a45ffb700 1 -- 172.21.15.156:0/3560181791 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2a4c03fb60 con 0x7f2a500a0a70 2023-09-30T22:22:00.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.275+0000 7f2a45ffb700 1 -- 172.21.15.156:0/3560181791 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a4c013720 con 0x7f2a500a0a70 2023-09-30T22:22:00.316 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:00.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.334+0000 7fd8dd6e9700 1 Processor -- start 2023-09-30T22:22:00.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.334+0000 7fd8dd6e9700 1 -- start start 2023-09-30T22:22:00.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.334+0000 7fd8dd6e9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8d8133900 0x7fd8d8133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:00.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.334+0000 7fd8dd6e9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd8d80a10b0 0x7fd8d813b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:00.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.334+0000 7fd8dd6e9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d809a760 con 0x7fd8d8134210 2023-09-30T22:22:00.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.334+0000 7fd8dd6e9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d81336e0 con 0x7fd8d80a10b0 2023-09-30T22:22:00.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.334+0000 7fd8dd6e9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d809a080 con 0x7fd8d8133900 2023-09-30T22:22:00.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.334+0000 7fd8d6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8d8133900 0x7fd8d8133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:00.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.334+0000 7fd8d77fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd8d80a10b0 0x7fd8d813b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:00.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.335+0000 7fd8d6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8d8133900 0x7fd8d8133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:55966/0 (socket says 172.21.15.156:55966) 2023-09-30T22:22:00.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.335+0000 7fd8d6ffd700 1 -- 172.21.15.156:0/1346801690 learned_addr learned my addr 172.21.15.156:0/1346801690 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:00.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.335+0000 7fd8d6ffd700 1 -- 172.21.15.156:0/1346801690 >> v2:172.21.15.156:3300/0 conn(0x7fd8d80a10b0 msgr2=0x7fd8d813b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:00.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.335+0000 7fd8d6ffd700 1 --2- 172.21.15.156:0/1346801690 >> v2:172.21.15.156:3300/0 conn(0x7fd8d80a10b0 0x7fd8d813b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.335+0000 7fd8d6ffd700 1 -- 172.21.15.156:0/1346801690 >> v1:172.21.15.156:6789/0 conn(0x7fd8d8134210 legacy=0x7fd8d80a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.335+0000 7fd8d6ffd700 1 -- 172.21.15.156:0/1346801690 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d80a23e0 con 0x7fd8d8133900 2023-09-30T22:22:00.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.335+0000 7fd8d77fe700 1 --2- 172.21.15.156:0/1346801690 >> v2:172.21.15.156:3300/0 conn(0x7fd8d80a10b0 0x7fd8d813b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:00.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.335+0000 7fd8d6ffd700 1 --2- 172.21.15.156:0/1346801690 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8d8133900 0x7fd8d8133cd0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8006fd0 tx=0x7fd8c8009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91acc04182537867 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:00.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.335+0000 7fd8d5ffb700 1 -- 172.21.15.156:0/1346801690 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8005e30 con 0x7fd8d8133900 2023-09-30T22:22:00.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.335+0000 7fd8d5ffb700 1 -- 172.21.15.156:0/1346801690 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c8004030 con 0x7fd8d8133900 2023-09-30T22:22:00.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.335+0000 7fd8d5ffb700 1 -- 172.21.15.156:0/1346801690 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c80043e0 con 0x7fd8d8133900 2023-09-30T22:22:00.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.336+0000 7fd8dd6e9700 1 -- 172.21.15.156:0/1346801690 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8d8133900 msgr2=0x7fd8d8133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.336+0000 7fd8dd6e9700 1 --2- 172.21.15.156:0/1346801690 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8d8133900 0x7fd8d8133cd0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8006fd0 tx=0x7fd8c8009bd0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.336+0000 7fd8dd6e9700 1 -- 172.21.15.156:0/1346801690 shutdown_connections 2023-09-30T22:22:00.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.336+0000 7fd8dd6e9700 1 --2- 172.21.15.156:0/1346801690 >> v2:172.21.15.156:3300/0 conn(0x7fd8d80a10b0 0x7fd8d813b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.336+0000 7fd8dd6e9700 1 --2- 172.21.15.156:0/1346801690 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8d8133900 0x7fd8d8133cd0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.336+0000 7fd8dd6e9700 1 -- 172.21.15.156:0/1346801690 >> 172.21.15.156:0/1346801690 conn(0x7fd8d80a2980 msgr2=0x7fd8d80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:00.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.336+0000 7fd8dd6e9700 1 -- 172.21.15.156:0/1346801690 shutdown_connections 2023-09-30T22:22:00.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.336+0000 7fd8dd6e9700 1 -- 172.21.15.156:0/1346801690 wait complete. 2023-09-30T22:22:00.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.337+0000 7fd8dd6e9700 1 Processor -- start 2023-09-30T22:22:00.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.337+0000 7fd8dd6e9700 1 -- start start 2023-09-30T22:22:00.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.338+0000 7fd8dd6e9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8d80a10b0 0x7fd8d811bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:00.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.338+0000 7fd8dd6e9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8d8133900 0x7fd8d811c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:00.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.338+0000 7fd8dd6e9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8d8134210 0x7fd8d811c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:00.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.338+0000 7fd8dd6e9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d811f380 con 0x7fd8d8134210 2023-09-30T22:22:00.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.338+0000 7fd8dd6e9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d811d860 con 0x7fd8d80a10b0 2023-09-30T22:22:00.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.338+0000 7fd8dd6e9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d809a2c0 con 0x7fd8d8133900 2023-09-30T22:22:00.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.338+0000 7fd8d6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8d80a10b0 0x7fd8d811bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:00.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.338+0000 7fd8d6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8d80a10b0 0x7fd8d811bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:55982/0 (socket says 172.21.15.156:55982) 2023-09-30T22:22:00.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.338+0000 7fd8d6ffd700 1 -- 172.21.15.156:0/2468875918 learned_addr learned my addr 172.21.15.156:0/2468875918 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:00.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.338+0000 7fd8d67fc700 1 --2- 172.21.15.156:0/2468875918 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8d8133900 0x7fd8d811c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:00.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.338+0000 7fd8d77fe700 1 --2- 172.21.15.156:0/2468875918 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8d8134210 0x7fd8d811c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:00.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.338+0000 7fd8d6ffd700 1 -- 172.21.15.156:0/2468875918 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8d8133900 msgr2=0x7fd8d811c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.338+0000 7fd8d6ffd700 1 --2- 172.21.15.156:0/2468875918 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8d8133900 0x7fd8d811c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.338+0000 7fd8d6ffd700 1 -- 172.21.15.156:0/2468875918 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8d8134210 msgr2=0x7fd8d811c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.338+0000 7fd8d6ffd700 1 --2- 172.21.15.156:0/2468875918 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8d8134210 0x7fd8d811c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.338+0000 7fd8d6ffd700 1 -- 172.21.15.156:0/2468875918 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d0009a70 con 0x7fd8d80a10b0 2023-09-30T22:22:00.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.339+0000 7fd8d6ffd700 1 --2- 172.21.15.156:0/2468875918 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8d80a10b0 0x7fd8d811bb40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8004000 tx=0x7fd8c8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:00.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.339+0000 7fd8bf7fe700 1 -- 172.21.15.156:0/2468875918 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8003ce0 con 0x7fd8d80a10b0 2023-09-30T22:22:00.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.339+0000 7fd8bf7fe700 1 -- 172.21.15.156:0/2468875918 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c8003e40 con 0x7fd8d80a10b0 2023-09-30T22:22:00.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.339+0000 7fd8bf7fe700 1 -- 172.21.15.156:0/2468875918 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c801c640 con 0x7fd8d80a10b0 2023-09-30T22:22:00.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.339+0000 7fd8dd6e9700 1 -- 172.21.15.156:0/2468875918 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c8009500 con 0x7fd8d80a10b0 2023-09-30T22:22:00.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.339+0000 7fd8dd6e9700 1 -- 172.21.15.156:0/2468875918 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d812c660 con 0x7fd8d80a10b0 2023-09-30T22:22:00.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.340+0000 7fd8bf7fe700 1 -- 172.21.15.156:0/2468875918 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd8c801c7a0 con 0x7fd8d80a10b0 2023-09-30T22:22:00.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.340+0000 7fd8bf7fe700 1 -- 172.21.15.156:0/2468875918 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd8c80405d0 con 0x7fd8d80a10b0 2023-09-30T22:22:00.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.340+0000 7fd8dd6e9700 1 -- 172.21.15.156:0/2468875918 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d811feb0 con 0x7fd8d80a10b0 2023-09-30T22:22:00.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.345+0000 7fd8bf7fe700 1 -- 172.21.15.156:0/2468875918 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd8c8011420 con 0x7fd8d80a10b0 2023-09-30T22:22:00.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.447+0000 7f79b8817700 1 Processor -- start 2023-09-30T22:22:00.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.447+0000 7f79b8817700 1 -- start start 2023-09-30T22:22:00.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.448+0000 7f79b8817700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f79b409e870 0x7f79b409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:00.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.448+0000 7f79b8817700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79b4131f40 0x7f79b4139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:00.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.448+0000 7f79b8817700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b409c970 con 0x7f79b409f180 2023-09-30T22:22:00.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.448+0000 7f79b8817700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b40a0920 con 0x7f79b409e870 2023-09-30T22:22:00.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.448+0000 7f79b8817700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79b409f9c0 con 0x7f79b4131f40 2023-09-30T22:22:00.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.448+0000 7f79b259c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f79b409e870 0x7f79b409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:00.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.448+0000 7f79b259c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f79b409e870 0x7f79b409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54478/0 (socket says 172.21.15.156:54478) 2023-09-30T22:22:00.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.448+0000 7f79b259c700 1 -- 172.21.15.156:0/1839657793 learned_addr learned my addr 172.21.15.156:0/1839657793 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:00.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.448+0000 7f79b1d9b700 1 --1- 172.21.15.156:0/1839657793 >> v1:172.21.15.156:6789/0 conn(0x7f79b409f180 0x7f79b4131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40698/0 (socket says 172.21.15.156:40698) 2023-09-30T22:22:00.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.448+0000 7f79b2d9d700 1 --2- 172.21.15.156:0/1839657793 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79b4131f40 0x7f79b4139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:00.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.448+0000 7f79b2d9d700 1 -- 172.21.15.156:0/1839657793 >> v2:172.21.15.156:3300/0 conn(0x7f79b409e870 msgr2=0x7f79b409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:00.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.448+0000 7f79b2d9d700 1 --2- 172.21.15.156:0/1839657793 >> v2:172.21.15.156:3300/0 conn(0x7f79b409e870 0x7f79b409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.448+0000 7f79b2d9d700 1 -- 172.21.15.156:0/1839657793 >> v1:172.21.15.156:6789/0 conn(0x7f79b409f180 legacy=0x7f79b4131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.449+0000 7f79b2d9d700 1 -- 172.21.15.156:0/1839657793 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b409bab0 con 0x7f79b4131f40 2023-09-30T22:22:00.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.448+0000 7f79b159a700 1 -- 172.21.15.156:0/1839657793 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1268228767 0 0) 0x7f79b409c970 con 0x7f79b409f180 2023-09-30T22:22:00.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.449+0000 7f79b259c700 1 --2- 172.21.15.156:0/1839657793 >> v2:172.21.15.156:3300/0 conn(0x7f79b409e870 0x7f79b409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:00.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.449+0000 7f79b2d9d700 1 --2- 172.21.15.156:0/1839657793 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79b4131f40 0x7f79b4139ca0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f79ac009d90 tx=0x7f79ac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f751742e2c15a78 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:00.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.449+0000 7f79b159a700 1 -- 172.21.15.156:0/1839657793 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac00e070 con 0x7f79b4131f40 2023-09-30T22:22:00.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.449+0000 7f79b159a700 1 -- 172.21.15.156:0/1839657793 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ac00bb20 con 0x7f79b4131f40 2023-09-30T22:22:00.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.449+0000 7f79b159a700 1 -- 172.21.15.156:0/1839657793 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac012430 con 0x7f79b4131f40 2023-09-30T22:22:00.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.449+0000 7f79b8817700 1 -- 172.21.15.156:0/1839657793 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79b4131f40 msgr2=0x7f79b4139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.449+0000 7f79b8817700 1 --2- 172.21.15.156:0/1839657793 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79b4131f40 0x7f79b4139ca0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f79ac009d90 tx=0x7f79ac00b330 comp rx=0 tx=0).stop 2023-09-30T22:22:00.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.449+0000 7f79b8817700 1 -- 172.21.15.156:0/1839657793 shutdown_connections 2023-09-30T22:22:00.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.449+0000 7f79b8817700 1 --2- 172.21.15.156:0/1839657793 >> v2:172.21.15.156:3300/0 conn(0x7f79b409e870 0x7f79b409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.449+0000 7f79b8817700 1 --2- 172.21.15.156:0/1839657793 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79b4131f40 0x7f79b4139ca0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.449+0000 7f79b8817700 1 -- 172.21.15.156:0/1839657793 >> 172.21.15.156:0/1839657793 conn(0x7f79b40a4430 msgr2=0x7f79b40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:00.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.449+0000 7f79b8817700 1 -- 172.21.15.156:0/1839657793 shutdown_connections 2023-09-30T22:22:00.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.450+0000 7f79b8817700 1 -- 172.21.15.156:0/1839657793 wait complete. 2023-09-30T22:22:00.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.451+0000 7f79b8817700 1 Processor -- start 2023-09-30T22:22:00.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.451+0000 7f79b8817700 1 -- start start 2023-09-30T22:22:00.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.451+0000 7f79b8817700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79b409e870 0x7f79b41c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:00.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.451+0000 7f79b8817700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79b409f180 0x7f79b41c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:00.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.451+0000 7f79b8817700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79b4131f40 0x7f79b41c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:00.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.451+0000 7f79b8817700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b411fda0 con 0x7f79b409e870 2023-09-30T22:22:00.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.451+0000 7f79b8817700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b411f1a0 con 0x7f79b4131f40 2023-09-30T22:22:00.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.451+0000 7f79b8817700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79b411e430 con 0x7f79b409f180 2023-09-30T22:22:00.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.451+0000 7f79b1d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79b409f180 0x7f79b41c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:00.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.451+0000 7f79b259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79b409e870 0x7f79b41c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:00.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.451+0000 7f79b1d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79b409f180 0x7f79b41c65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33702/0 (socket says 172.21.15.156:33702) 2023-09-30T22:22:00.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.451+0000 7f79b1d9b700 1 -- 172.21.15.156:0/1782184293 learned_addr learned my addr 172.21.15.156:0/1782184293 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:00.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.451+0000 7f79b2d9d700 1 --2- 172.21.15.156:0/1782184293 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79b4131f40 0x7f79b41c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:00.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.451+0000 7f79b259c700 1 -- 172.21.15.156:0/1782184293 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79b409f180 msgr2=0x7f79b41c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.451+0000 7f79b259c700 1 --2- 172.21.15.156:0/1782184293 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79b409f180 0x7f79b41c65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.452+0000 7f79b259c700 1 -- 172.21.15.156:0/1782184293 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79b4131f40 msgr2=0x7f79b41c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.452+0000 7f79b259c700 1 --2- 172.21.15.156:0/1782184293 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79b4131f40 0x7f79b41c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.452+0000 7f79b259c700 1 -- 172.21.15.156:0/1782184293 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a4009550 con 0x7f79b409e870 2023-09-30T22:22:00.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.452+0000 7f79b1d9b700 1 --2- 172.21.15.156:0/1782184293 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79b409f180 0x7f79b41c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:00.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.452+0000 7f79b259c700 1 --2- 172.21.15.156:0/1782184293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79b409e870 0x7f79b41c6070 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f79a400e980 tx=0x7f79a400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:00.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.452+0000 7f79a2ffd700 1 -- 172.21.15.156:0/1782184293 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a4004030 con 0x7f79b409e870 2023-09-30T22:22:00.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.452+0000 7f79a2ffd700 1 -- 172.21.15.156:0/1782184293 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a4004190 con 0x7f79b409e870 2023-09-30T22:22:00.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.452+0000 7f79b8817700 1 -- 172.21.15.156:0/1782184293 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79ac009a70 con 0x7f79b409e870 2023-09-30T22:22:00.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.452+0000 7f79a2ffd700 1 -- 172.21.15.156:0/1782184293 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a4004520 con 0x7f79b409e870 2023-09-30T22:22:00.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.452+0000 7f79b8817700 1 -- 172.21.15.156:0/1782184293 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b411ec20 con 0x7f79b409e870 2023-09-30T22:22:00.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.453+0000 7f79a2ffd700 1 -- 172.21.15.156:0/1782184293 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f79a40036a0 con 0x7f79b409e870 2023-09-30T22:22:00.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.453+0000 7f79a2ffd700 1 -- 172.21.15.156:0/1782184293 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f79a403f500 con 0x7f79b409e870 2023-09-30T22:22:00.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.453+0000 7f79b8817700 1 -- 172.21.15.156:0/1782184293 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b404f2a0 con 0x7f79b409e870 2023-09-30T22:22:00.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.458+0000 7f79a2ffd700 1 -- 172.21.15.156:0/1782184293 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f79a4019b80 con 0x7f79b409e870 2023-09-30T22:22:00.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.473+0000 7f2a57386700 1 -- 172.21.15.156:0/3560181791 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2a50122080 con 0x7f2a500a0a70 2023-09-30T22:22:00.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.474+0000 7f2a45ffb700 1 -- 172.21.15.156:0/3560181791 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2a50122080 con 0x7f2a500a0a70 2023-09-30T22:22:00.474 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:00.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.476+0000 7f2a57386700 1 -- 172.21.15.156:0/3560181791 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a500a0a70 msgr2=0x7f2a5011f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.476+0000 7f2a57386700 1 --2- 172.21.15.156:0/3560181791 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a500a0a70 0x7f2a5011f500 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c00ec10 tx=0x7f2a4c00ef20 comp rx=0 tx=0).stop 2023-09-30T22:22:00.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.476+0000 7f2a57386700 1 -- 172.21.15.156:0/3560181791 shutdown_connections 2023-09-30T22:22:00.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.476+0000 7f2a57386700 1 --2- 172.21.15.156:0/3560181791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a50133f50 0x7f2a501c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.476+0000 7f2a57386700 1 --2- 172.21.15.156:0/3560181791 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2a500a0a70 0x7f2a5011f500 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.476+0000 7f2a57386700 1 --2- 172.21.15.156:0/3560181791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2a500a1380 0x7f2a5011fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.476+0000 7f2a57386700 1 -- 172.21.15.156:0/3560181791 >> 172.21.15.156:0/3560181791 conn(0x7f2a500a6610 msgr2=0x7f2a501bbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:00.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.476+0000 7f2a57386700 1 -- 172.21.15.156:0/3560181791 shutdown_connections 2023-09-30T22:22:00.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.476+0000 7f2a57386700 1 -- 172.21.15.156:0/3560181791 wait complete. 2023-09-30T22:22:00.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:00.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.550+0000 7fd8dd6e9700 1 -- 172.21.15.156:0/2468875918 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd8d804f2a0 con 0x7fd8d80a10b0 2023-09-30T22:22:00.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.551+0000 7fd8bf7fe700 1 -- 172.21.15.156:0/2468875918 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd8c8034090 con 0x7fd8d80a10b0 2023-09-30T22:22:00.551 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:00.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.553+0000 7fd8dd6e9700 1 -- 172.21.15.156:0/2468875918 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8d80a10b0 msgr2=0x7fd8d811bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.553+0000 7fd8dd6e9700 1 --2- 172.21.15.156:0/2468875918 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8d80a10b0 0x7fd8d811bb40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8004000 tx=0x7fd8c8004750 comp rx=0 tx=0).stop 2023-09-30T22:22:00.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.553+0000 7fd8dd6e9700 1 -- 172.21.15.156:0/2468875918 shutdown_connections 2023-09-30T22:22:00.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.553+0000 7fd8dd6e9700 1 --2- 172.21.15.156:0/2468875918 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8d8134210 0x7fd8d811c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.553+0000 7fd8dd6e9700 1 --2- 172.21.15.156:0/2468875918 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8d80a10b0 0x7fd8d811bb40 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.553+0000 7fd8dd6e9700 1 --2- 172.21.15.156:0/2468875918 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8d8133900 0x7fd8d811c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.553+0000 7fd8dd6e9700 1 -- 172.21.15.156:0/2468875918 >> 172.21.15.156:0/2468875918 conn(0x7fd8d80a2980 msgr2=0x7fd8d81314d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:00.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.553+0000 7fd8dd6e9700 1 -- 172.21.15.156:0/2468875918 shutdown_connections 2023-09-30T22:22:00.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.553+0000 7fd8dd6e9700 1 -- 172.21.15.156:0/2468875918 wait complete. 2023-09-30T22:22:00.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:00.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.651+0000 7f79b8817700 1 -- 172.21.15.156:0/1782184293 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f79b41317b0 con 0x7f79b409e870 2023-09-30T22:22:00.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.651+0000 7f79a2ffd700 1 -- 172.21.15.156:0/1782184293 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f79a4020020 con 0x7f79b409e870 2023-09-30T22:22:00.652 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:00.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.653+0000 7f79b8817700 1 -- 172.21.15.156:0/1782184293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79b409e870 msgr2=0x7f79b41c6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.653+0000 7f79b8817700 1 --2- 172.21.15.156:0/1782184293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79b409e870 0x7f79b41c6070 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f79a400e980 tx=0x7f79a400ec90 comp rx=0 tx=0).stop 2023-09-30T22:22:00.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.653+0000 7f79b8817700 1 -- 172.21.15.156:0/1782184293 shutdown_connections 2023-09-30T22:22:00.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.653+0000 7f79b8817700 1 --2- 172.21.15.156:0/1782184293 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f79b4131f40 0x7f79b41c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.653+0000 7f79b8817700 1 --2- 172.21.15.156:0/1782184293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79b409e870 0x7f79b41c6070 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.653+0000 7f79b8817700 1 --2- 172.21.15.156:0/1782184293 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f79b409f180 0x7f79b41c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.653+0000 7f79b8817700 1 -- 172.21.15.156:0/1782184293 >> 172.21.15.156:0/1782184293 conn(0x7f79b40a4430 msgr2=0x7f79b409c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:00.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.653+0000 7f79b8817700 1 -- 172.21.15.156:0/1782184293 shutdown_connections 2023-09-30T22:22:00.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:00.653+0000 7f79b8817700 1 -- 172.21.15.156:0/1782184293 wait complete. 2023-09-30T22:22:00.666 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:01.098 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:01.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.220+0000 7fb4da33a700 1 Processor -- start 2023-09-30T22:22:01.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.220+0000 7fb4da33a700 1 -- start start 2023-09-30T22:22:01.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.220+0000 7fb4da33a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4d409e870 0x7fb4d409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.220+0000 7fb4da33a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb4d409f180 0x7fb4d4131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.220+0000 7fb4da33a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4d4131d70 0x7fb4d4132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.220+0000 7fb4da33a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4d40a0920 con 0x7fb4d409f180 2023-09-30T22:22:01.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.220+0000 7fb4da33a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d409c970 con 0x7fb4d409e870 2023-09-30T22:22:01.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.220+0000 7fb4da33a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d409bab0 con 0x7fb4d4131d70 2023-09-30T22:22:01.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.220+0000 7fb4d37fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb4d409f180 0x7fb4d4131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.220+0000 7fb4d88d7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4d4131d70 0x7fb4d4132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.220+0000 7fb4d3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4d409e870 0x7fb4d409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.220+0000 7fb4d37fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb4d409f180 0x7fb4d4131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54494/0 (socket says 172.21.15.156:54494) 2023-09-30T22:22:01.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.220+0000 7fb4d88d7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4d4131d70 0x7fb4d4132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33710/0 (socket says 172.21.15.156:33710) 2023-09-30T22:22:01.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.220+0000 7fb4d37fe700 1 -- 172.21.15.156:0/1194228523 learned_addr learned my addr 172.21.15.156:0/1194228523 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:01.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.221+0000 7fb4d37fe700 1 -- 172.21.15.156:0/1194228523 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4d4131d70 msgr2=0x7fb4d4132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:01.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.221+0000 7fb4d37fe700 1 --2- 172.21.15.156:0/1194228523 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4d4131d70 0x7fb4d4132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.221+0000 7fb4d37fe700 1 -- 172.21.15.156:0/1194228523 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4d409e870 msgr2=0x7fb4d409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:01.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.221+0000 7fb4d37fe700 1 --2- 172.21.15.156:0/1194228523 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4d409e870 0x7fb4d409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.221+0000 7fb4d37fe700 1 -- 172.21.15.156:0/1194228523 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d409f9c0 con 0x7fb4d409f180 2023-09-30T22:22:01.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.221+0000 7fb4d3fff700 1 --2- 172.21.15.156:0/1194228523 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4d409e870 0x7fb4d409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:01.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.221+0000 7fb4d88d7700 1 --2- 172.21.15.156:0/1194228523 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4d4131d70 0x7fb4d4132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:01.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.221+0000 7fb4d37fe700 1 --2- 172.21.15.156:0/1194228523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4d409f180 0x7fb4d4131830 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8009920 tx=0x7fb4c8009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb4261d9b945f65a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:01.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.221+0000 7fb4d2ffd700 1 -- 172.21.15.156:0/1194228523 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8011830 con 0x7fb4d409f180 2023-09-30T22:22:01.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.221+0000 7fb4d2ffd700 1 -- 172.21.15.156:0/1194228523 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c8011990 con 0x7fb4d409f180 2023-09-30T22:22:01.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.221+0000 7fb4d2ffd700 1 -- 172.21.15.156:0/1194228523 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8011d20 con 0x7fb4d409f180 2023-09-30T22:22:01.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.221+0000 7fb4da33a700 1 -- 172.21.15.156:0/1194228523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4d409f180 msgr2=0x7fb4d4131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.221+0000 7fb4da33a700 1 --2- 172.21.15.156:0/1194228523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4d409f180 0x7fb4d4131830 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8009920 tx=0x7fb4c8009c30 comp rx=0 tx=0).stop 2023-09-30T22:22:01.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.221+0000 7fb4da33a700 1 -- 172.21.15.156:0/1194228523 shutdown_connections 2023-09-30T22:22:01.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.221+0000 7fb4da33a700 1 --2- 172.21.15.156:0/1194228523 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4d4131d70 0x7fb4d4132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.221+0000 7fb4da33a700 1 --2- 172.21.15.156:0/1194228523 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4d409e870 0x7fb4d409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.221+0000 7fb4da33a700 1 --2- 172.21.15.156:0/1194228523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4d409f180 0x7fb4d4131830 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.221+0000 7fb4da33a700 1 -- 172.21.15.156:0/1194228523 >> 172.21.15.156:0/1194228523 conn(0x7fb4d40a4430 msgr2=0x7fb4d40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:01.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.222+0000 7fb4da33a700 1 -- 172.21.15.156:0/1194228523 shutdown_connections 2023-09-30T22:22:01.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.222+0000 7fb4da33a700 1 -- 172.21.15.156:0/1194228523 wait complete. 2023-09-30T22:22:01.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.222+0000 7fb4da33a700 1 Processor -- start 2023-09-30T22:22:01.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.223+0000 7fb4da33a700 1 -- start start 2023-09-30T22:22:01.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.223+0000 7fb4da33a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4d409e870 0x7fb4d41226f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.223+0000 7fb4da33a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4d409f180 0x7fb4d4122c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.223+0000 7fb4da33a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4d4131d70 0x7fb4d4123170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.223+0000 7fb4da33a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d41261c0 con 0x7fb4d409f180 2023-09-30T22:22:01.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.223+0000 7fb4da33a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d4131a50 con 0x7fb4d409e870 2023-09-30T22:22:01.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.223+0000 7fb4da33a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d40a2af0 con 0x7fb4d4131d70 2023-09-30T22:22:01.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.223+0000 7fb4d3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4d409e870 0x7fb4d41226f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.223+0000 7fb4d37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4d409f180 0x7fb4d4122c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.223+0000 7fb4d3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4d409e870 0x7fb4d41226f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:56010/0 (socket says 172.21.15.156:56010) 2023-09-30T22:22:01.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.223+0000 7fb4d3fff700 1 -- 172.21.15.156:0/2809240466 learned_addr learned my addr 172.21.15.156:0/2809240466 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:01.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.223+0000 7fb4d37fe700 1 --2- 172.21.15.156:0/2809240466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4d409f180 0x7fb4d4122c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54498/0 (socket says 172.21.15.156:54498) 2023-09-30T22:22:01.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.223+0000 7fb4d88d7700 1 --2- 172.21.15.156:0/2809240466 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4d4131d70 0x7fb4d4123170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.223+0000 7fb4d3fff700 1 -- 172.21.15.156:0/2809240466 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4d4131d70 msgr2=0x7fb4d4123170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.223+0000 7fb4d3fff700 1 --2- 172.21.15.156:0/2809240466 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4d4131d70 0x7fb4d4123170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.223+0000 7fb4d3fff700 1 -- 172.21.15.156:0/2809240466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4d409f180 msgr2=0x7fb4d4122c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.223+0000 7fb4d3fff700 1 --2- 172.21.15.156:0/2809240466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4d409f180 0x7fb4d4122c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.223+0000 7fb4d3fff700 1 -- 172.21.15.156:0/2809240466 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c40094a0 con 0x7fb4d409e870 2023-09-30T22:22:01.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.223+0000 7fb4d88d7700 1 --2- 172.21.15.156:0/2809240466 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4d4131d70 0x7fb4d4123170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:01.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.224+0000 7fb4d3fff700 1 --2- 172.21.15.156:0/2809240466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4d409e870 0x7fb4d41226f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb4c400ebe0 tx=0x7fb4c400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:01.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.224+0000 7fb4d0ff9700 1 -- 172.21.15.156:0/2809240466 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c4009780 con 0x7fb4d409e870 2023-09-30T22:22:01.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.224+0000 7fb4d0ff9700 1 -- 172.21.15.156:0/2809240466 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c400c850 con 0x7fb4d409e870 2023-09-30T22:22:01.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.224+0000 7fb4da33a700 1 -- 172.21.15.156:0/2809240466 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4cc009a70 con 0x7fb4d409e870 2023-09-30T22:22:01.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.224+0000 7fb4d0ff9700 1 -- 172.21.15.156:0/2809240466 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c400cbe0 con 0x7fb4d409e870 2023-09-30T22:22:01.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.224+0000 7fb4da33a700 1 -- 172.21.15.156:0/2809240466 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c8009550 con 0x7fb4d409e870 2023-09-30T22:22:01.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.224+0000 7fb4d0ff9700 1 -- 172.21.15.156:0/2809240466 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb4c400cd40 con 0x7fb4d409e870 2023-09-30T22:22:01.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.225+0000 7fb4d0ff9700 1 -- 172.21.15.156:0/2809240466 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb4c403fbb0 con 0x7fb4d409e870 2023-09-30T22:22:01.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.225+0000 7fb4da33a700 1 -- 172.21.15.156:0/2809240466 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4d404f2a0 con 0x7fb4d409e870 2023-09-30T22:22:01.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.229+0000 7fb4d0ff9700 1 -- 172.21.15.156:0/2809240466 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4c4011d90 con 0x7fb4d409e870 2023-09-30T22:22:01.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.412+0000 7fb4da33a700 1 -- 172.21.15.156:0/2809240466 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb4d409f660 con 0x7fb4d409e870 2023-09-30T22:22:01.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.413+0000 7fb4d0ff9700 1 -- 172.21.15.156:0/2809240466 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb4c401ae60 con 0x7fb4d409e870 2023-09-30T22:22:01.414 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:01.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.415+0000 7fb4da33a700 1 -- 172.21.15.156:0/2809240466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4d409e870 msgr2=0x7fb4d41226f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.415+0000 7fb4da33a700 1 --2- 172.21.15.156:0/2809240466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4d409e870 0x7fb4d41226f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb4c400ebe0 tx=0x7fb4c400eef0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.415+0000 7fb4da33a700 1 -- 172.21.15.156:0/2809240466 shutdown_connections 2023-09-30T22:22:01.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.415+0000 7fb4da33a700 1 --2- 172.21.15.156:0/2809240466 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4d4131d70 0x7fb4d4123170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.415+0000 7fb4da33a700 1 --2- 172.21.15.156:0/2809240466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4d409e870 0x7fb4d41226f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.415+0000 7fb4da33a700 1 --2- 172.21.15.156:0/2809240466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4d409f180 0x7fb4d4122c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.415+0000 7fb4da33a700 1 -- 172.21.15.156:0/2809240466 >> 172.21.15.156:0/2809240466 conn(0x7fb4d40a4430 msgr2=0x7fb4d409cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:01.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.415+0000 7fb4da33a700 1 -- 172.21.15.156:0/2809240466 shutdown_connections 2023-09-30T22:22:01.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.415+0000 7fb4da33a700 1 -- 172.21.15.156:0/2809240466 wait complete. 2023-09-30T22:22:01.428 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:01.491 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:01.566 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:01.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.616+0000 7f336248c700 1 Processor -- start 2023-09-30T22:22:01.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.616+0000 7f336248c700 1 -- start start 2023-09-30T22:22:01.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.617+0000 7f336248c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f335c134140 0x7f335c138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.617+0000 7f336248c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f335c134570 0x7f335c13b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.617+0000 7f336248c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f335c09b110 con 0x7f335c09ad40 2023-09-30T22:22:01.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.617+0000 7f336248c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335c0a3b60 con 0x7f335c134140 2023-09-30T22:22:01.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.617+0000 7f336248c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f335c0a1a80 con 0x7f335c134570 2023-09-30T22:22:01.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.617+0000 7f335b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f335c134140 0x7f335c138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.617+0000 7f3360a29700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f335c134570 0x7f335c13b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.617+0000 7f3360a29700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f335c134570 0x7f335c13b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33410/0 (socket says 172.21.15.156:33410) 2023-09-30T22:22:01.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.617+0000 7f335b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f335c134140 0x7f335c138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57622/0 (socket says 172.21.15.156:57622) 2023-09-30T22:22:01.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.617+0000 7f3360a29700 1 -- 172.21.15.156:0/3119372197 learned_addr learned my addr 172.21.15.156:0/3119372197 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:01.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.617+0000 7f335b7fe700 1 -- 172.21.15.156:0/3119372197 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f335c134570 msgr2=0x7f335c13b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:01.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.617+0000 7f335b7fe700 1 --2- 172.21.15.156:0/3119372197 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f335c134570 0x7f335c13b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.617+0000 7f335b7fe700 1 -- 172.21.15.156:0/3119372197 >> v1:172.21.15.156:6789/0 conn(0x7f335c09ad40 legacy=0x7f335c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.617+0000 7f335b7fe700 1 -- 172.21.15.156:0/3119372197 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c0a2fa0 con 0x7f335c134140 2023-09-30T22:22:01.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.617+0000 7f3360a29700 1 --2- 172.21.15.156:0/3119372197 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f335c134570 0x7f335c13b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:01.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.618+0000 7f335b7fe700 1 --2- 172.21.15.156:0/3119372197 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f335c134140 0x7f335c138e80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f33500098a0 tx=0x7f3350009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3fc2a9cd0b61251 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:01.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.618+0000 7f335affd700 1 -- 172.21.15.156:0/3119372197 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3350011830 con 0x7f335c134140 2023-09-30T22:22:01.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.618+0000 7f335affd700 1 -- 172.21.15.156:0/3119372197 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3350011990 con 0x7f335c134140 2023-09-30T22:22:01.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.618+0000 7f335affd700 1 -- 172.21.15.156:0/3119372197 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3350011d20 con 0x7f335c134140 2023-09-30T22:22:01.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.618+0000 7f336248c700 1 -- 172.21.15.156:0/3119372197 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f335c134140 msgr2=0x7f335c138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.618+0000 7f336248c700 1 --2- 172.21.15.156:0/3119372197 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f335c134140 0x7f335c138e80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f33500098a0 tx=0x7f3350009bb0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.618+0000 7f336248c700 1 -- 172.21.15.156:0/3119372197 shutdown_connections 2023-09-30T22:22:01.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.618+0000 7f336248c700 1 --2- 172.21.15.156:0/3119372197 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f335c134570 0x7f335c13b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.618+0000 7f336248c700 1 --2- 172.21.15.156:0/3119372197 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f335c134140 0x7f335c138e80 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.618+0000 7f336248c700 1 -- 172.21.15.156:0/3119372197 >> 172.21.15.156:0/3119372197 conn(0x7f335c099c40 msgr2=0x7f335c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:01.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.618+0000 7f336248c700 1 -- 172.21.15.156:0/3119372197 shutdown_connections 2023-09-30T22:22:01.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.618+0000 7f336248c700 1 -- 172.21.15.156:0/3119372197 wait complete. 2023-09-30T22:22:01.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.619+0000 7f336248c700 1 Processor -- start 2023-09-30T22:22:01.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.620+0000 7f336248c700 1 -- start start 2023-09-30T22:22:01.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.620+0000 7f336248c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f335c09ad40 0x7f335c11c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.620+0000 7f336248c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f335c134140 0x7f335c11ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.620+0000 7f336248c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f335c134570 0x7f335c11d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.620+0000 7f336248c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335c11efb0 con 0x7f335c134140 2023-09-30T22:22:01.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.620+0000 7f336248c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335c09e880 con 0x7f335c09ad40 2023-09-30T22:22:01.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.620+0000 7f336248c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f335c09c7e0 con 0x7f335c134570 2023-09-30T22:22:01.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.620+0000 7f3360a29700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f335c134570 0x7f335c11d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.620+0000 7f335b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f335c134140 0x7f335c11ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.620+0000 7f3360a29700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f335c134570 0x7f335c11d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33420/0 (socket says 172.21.15.156:33420) 2023-09-30T22:22:01.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.620+0000 7f3360a29700 1 -- 172.21.15.156:0/1441340356 learned_addr learned my addr 172.21.15.156:0/1441340356 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:01.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.620+0000 7f335bfff700 1 --2- 172.21.15.156:0/1441340356 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f335c09ad40 0x7f335c11c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.620+0000 7f335bfff700 1 -- 172.21.15.156:0/1441340356 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f335c134570 msgr2=0x7f335c11d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.620+0000 7f335bfff700 1 --2- 172.21.15.156:0/1441340356 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f335c134570 0x7f335c11d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.620+0000 7f335bfff700 1 -- 172.21.15.156:0/1441340356 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f335c134140 msgr2=0x7f335c11ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.620+0000 7f335bfff700 1 --2- 172.21.15.156:0/1441340356 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f335c134140 0x7f335c11ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.620+0000 7f335bfff700 1 -- 172.21.15.156:0/1441340356 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3354009b30 con 0x7f335c09ad40 2023-09-30T22:22:01.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.620+0000 7f335b7fe700 1 --2- 172.21.15.156:0/1441340356 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f335c134140 0x7f335c11ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:01.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.620+0000 7f3360a29700 1 --2- 172.21.15.156:0/1441340356 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f335c134570 0x7f335c11d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:01.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.621+0000 7f335bfff700 1 --2- 172.21.15.156:0/1441340356 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f335c09ad40 0x7f335c11c8c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f334c000f60 tx=0x7f334c00c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:01.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.621+0000 7f3358ff9700 1 -- 172.21.15.156:0/1441340356 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c0052d0 con 0x7f335c09ad40 2023-09-30T22:22:01.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.621+0000 7f3358ff9700 1 -- 172.21.15.156:0/1441340356 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334c005430 con 0x7f335c09ad40 2023-09-30T22:22:01.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.621+0000 7f336248c700 1 -- 172.21.15.156:0/1441340356 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33500094a0 con 0x7f335c09ad40 2023-09-30T22:22:01.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.621+0000 7f3358ff9700 1 -- 172.21.15.156:0/1441340356 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c0038a0 con 0x7f335c09ad40 2023-09-30T22:22:01.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.621+0000 7f336248c700 1 -- 172.21.15.156:0/1441340356 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f335c11f890 con 0x7f335c09ad40 2023-09-30T22:22:01.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.621+0000 7f3358ff9700 1 -- 172.21.15.156:0/1441340356 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f334c003a00 con 0x7f335c09ad40 2023-09-30T22:22:01.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.622+0000 7f3358ff9700 1 -- 172.21.15.156:0/1441340356 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f334c03e960 con 0x7f335c09ad40 2023-09-30T22:22:01.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.622+0000 7f336248c700 1 -- 172.21.15.156:0/1441340356 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f335c11e380 con 0x7f335c09ad40 2023-09-30T22:22:01.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.626+0000 7f3358ff9700 1 -- 172.21.15.156:0/1441340356 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f334c017020 con 0x7f335c09ad40 2023-09-30T22:22:01.666 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:01.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.696+0000 7fc688c3a700 1 Processor -- start 2023-09-30T22:22:01.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.696+0000 7fc688c3a700 1 -- start start 2023-09-30T22:22:01.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.696+0000 7fc688c3a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc684136960 0x7fc684138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.696+0000 7fc688c3a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc684139280 0x7fc68413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.696+0000 7fc688c3a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc68406b2d0 con 0x7fc684133ad0 2023-09-30T22:22:01.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.696+0000 7fc688c3a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6841345b0 con 0x7fc684136960 2023-09-30T22:22:01.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.696+0000 7fc688c3a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc684133610 con 0x7fc684139280 2023-09-30T22:22:01.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.697+0000 7fc681d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc684136960 0x7fc684138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.697+0000 7fc682d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc684139280 0x7fc68413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.697+0000 7fc681d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc684136960 0x7fc684138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47012/0 (socket says 172.21.15.156:47012) 2023-09-30T22:22:01.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.697+0000 7fc681d9b700 1 -- 172.21.15.156:0/1032055115 learned_addr learned my addr 172.21.15.156:0/1032055115 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:01.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.697+0000 7fc682d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc684139280 0x7fc68413b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33430/0 (socket says 172.21.15.156:33430) 2023-09-30T22:22:01.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.697+0000 7fc681d9b700 1 -- 172.21.15.156:0/1032055115 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc684139280 msgr2=0x7fc68413b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:01.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.697+0000 7fc681d9b700 1 --2- 172.21.15.156:0/1032055115 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc684139280 0x7fc68413b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.697+0000 7fc681d9b700 1 -- 172.21.15.156:0/1032055115 >> v1:172.21.15.156:6789/0 conn(0x7fc684133ad0 legacy=0x7fc684133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:01.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.697+0000 7fc681d9b700 1 -- 172.21.15.156:0/1032055115 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68409a500 con 0x7fc684136960 2023-09-30T22:22:01.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.697+0000 7fc682d9d700 1 --2- 172.21.15.156:0/1032055115 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc684139280 0x7fc68413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:01.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.697+0000 7fc681d9b700 1 --2- 172.21.15.156:0/1032055115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc684136960 0x7fc684138d40 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc6780098f0 tx=0x7fc678009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=746c951037ac47f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:01.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.697+0000 7fc68159a700 1 -- 172.21.15.156:0/1032055115 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc678004230 con 0x7fc684136960 2023-09-30T22:22:01.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.697+0000 7fc68159a700 1 -- 172.21.15.156:0/1032055115 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc678004390 con 0x7fc684136960 2023-09-30T22:22:01.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.697+0000 7fc68159a700 1 -- 172.21.15.156:0/1032055115 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6780036a0 con 0x7fc684136960 2023-09-30T22:22:01.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.698+0000 7fc688c3a700 1 -- 172.21.15.156:0/1032055115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc684136960 msgr2=0x7fc684138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.698+0000 7fc688c3a700 1 --2- 172.21.15.156:0/1032055115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc684136960 0x7fc684138d40 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc6780098f0 tx=0x7fc678009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:01.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.698+0000 7fc688c3a700 1 -- 172.21.15.156:0/1032055115 shutdown_connections 2023-09-30T22:22:01.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.698+0000 7fc688c3a700 1 --2- 172.21.15.156:0/1032055115 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc684139280 0x7fc68413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.698+0000 7fc688c3a700 1 --2- 172.21.15.156:0/1032055115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc684136960 0x7fc684138d40 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.698+0000 7fc688c3a700 1 -- 172.21.15.156:0/1032055115 >> 172.21.15.156:0/1032055115 conn(0x7fc684099c40 msgr2=0x7fc6840a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:01.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.698+0000 7fc688c3a700 1 -- 172.21.15.156:0/1032055115 shutdown_connections 2023-09-30T22:22:01.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.698+0000 7fc688c3a700 1 -- 172.21.15.156:0/1032055115 wait complete. 2023-09-30T22:22:01.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.699+0000 7fc688c3a700 1 Processor -- start 2023-09-30T22:22:01.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.700+0000 7fc688c3a700 1 -- start start 2023-09-30T22:22:01.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.700+0000 7fc688c3a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc684133ad0 0x7fc684071b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.700+0000 7fc688c3a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc684136960 0x7fc6840720d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.700+0000 7fc688c3a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc684139280 0x7fc6841c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.700+0000 7fc688c3a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc684072610 con 0x7fc684139280 2023-09-30T22:22:01.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.700+0000 7fc688c3a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc684130c90 con 0x7fc684136960 2023-09-30T22:22:01.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.700+0000 7fc688c3a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc684070760 con 0x7fc684133ad0 2023-09-30T22:22:01.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.700+0000 7fc681d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc684136960 0x7fc6840720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.700+0000 7fc681d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc684136960 0x7fc6840720d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57650/0 (socket says 172.21.15.156:57650) 2023-09-30T22:22:01.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.700+0000 7fc681d9b700 1 -- 172.21.15.156:0/317776550 learned_addr learned my addr 172.21.15.156:0/317776550 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:01.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.700+0000 7fc68259c700 1 --2- 172.21.15.156:0/317776550 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc684133ad0 0x7fc684071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.700+0000 7fc682d9d700 1 --2- 172.21.15.156:0/317776550 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc684139280 0x7fc6841c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.701+0000 7fc68259c700 1 -- 172.21.15.156:0/317776550 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc684136960 msgr2=0x7fc6840720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.701+0000 7fc68259c700 1 --2- 172.21.15.156:0/317776550 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc684136960 0x7fc6840720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.701+0000 7fc68259c700 1 -- 172.21.15.156:0/317776550 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc684139280 msgr2=0x7fc6841c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.701+0000 7fc68259c700 1 --2- 172.21.15.156:0/317776550 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc684139280 0x7fc6841c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.701+0000 7fc68259c700 1 -- 172.21.15.156:0/317776550 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc67c009a70 con 0x7fc684133ad0 2023-09-30T22:22:01.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.701+0000 7fc681d9b700 1 --2- 172.21.15.156:0/317776550 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc684136960 0x7fc6840720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:01.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.701+0000 7fc68259c700 1 --2- 172.21.15.156:0/317776550 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc684133ad0 0x7fc684071b90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc67400b440 tx=0x7fc674009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:01.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.701+0000 7fc672ffd700 1 -- 172.21.15.156:0/317776550 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc674011620 con 0x7fc684133ad0 2023-09-30T22:22:01.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.701+0000 7fc672ffd700 1 -- 172.21.15.156:0/317776550 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6740117a0 con 0x7fc684133ad0 2023-09-30T22:22:01.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.701+0000 7fc688c3a700 1 -- 172.21.15.156:0/317776550 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc678009550 con 0x7fc684133ad0 2023-09-30T22:22:01.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.701+0000 7fc672ffd700 1 -- 172.21.15.156:0/317776550 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc674011b50 con 0x7fc684133ad0 2023-09-30T22:22:01.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.701+0000 7fc688c3a700 1 -- 172.21.15.156:0/317776550 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc684131790 con 0x7fc684133ad0 2023-09-30T22:22:01.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.702+0000 7fc672ffd700 1 -- 172.21.15.156:0/317776550 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc674011cb0 con 0x7fc684133ad0 2023-09-30T22:22:01.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.702+0000 7fc672ffd700 1 -- 172.21.15.156:0/317776550 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc67403f530 con 0x7fc684133ad0 2023-09-30T22:22:01.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.702+0000 7fc688c3a700 1 -- 172.21.15.156:0/317776550 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc68406fff0 con 0x7fc684133ad0 2023-09-30T22:22:01.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.707+0000 7fc672ffd700 1 -- 172.21.15.156:0/317776550 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc68406fff0 con 0x7fc684133ad0 2023-09-30T22:22:01.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.792+0000 7fd65f9d9700 1 Processor -- start 2023-09-30T22:22:01.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.793+0000 7fd65f9d9700 1 -- start start 2023-09-30T22:22:01.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.793+0000 7fd65f9d9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd65806a770 0x7fd6581349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.793+0000 7fd65f9d9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd658134f00 0x7fd65809d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.793+0000 7fd65f9d9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd65809eca0 con 0x7fd65809dea0 2023-09-30T22:22:01.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.793+0000 7fd65f9d9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd65809f720 con 0x7fd658134f00 2023-09-30T22:22:01.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.793+0000 7fd65f9d9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd65806b480 con 0x7fd65806a770 2023-09-30T22:22:01.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.793+0000 7fd65d775700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd65806a770 0x7fd6581349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.793+0000 7fd65d775700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd65806a770 0x7fd6581349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33444/0 (socket says 172.21.15.156:33444) 2023-09-30T22:22:01.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.793+0000 7fd65d775700 1 -- 172.21.15.156:0/2915432108 learned_addr learned my addr 172.21.15.156:0/2915432108 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:01.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.793+0000 7fd65cf74700 1 --2- 172.21.15.156:0/2915432108 >> v2:172.21.15.156:3300/0 conn(0x7fd658134f00 0x7fd65809d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.794+0000 7fd65cf74700 1 -- 172.21.15.156:0/2915432108 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd65806a770 msgr2=0x7fd6581349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:01.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.794+0000 7fd65cf74700 1 --2- 172.21.15.156:0/2915432108 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd65806a770 0x7fd6581349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.794+0000 7fd65cf74700 1 -- 172.21.15.156:0/2915432108 >> v1:172.21.15.156:6789/0 conn(0x7fd65809dea0 legacy=0x7fd65813ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.794+0000 7fd65cf74700 1 -- 172.21.15.156:0/2915432108 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6581352d0 con 0x7fd658134f00 2023-09-30T22:22:01.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.794+0000 7fd64ffff700 1 -- 172.21.15.156:0/2915432108 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371809764 0 0) 0x7fd65809eca0 con 0x7fd65809dea0 2023-09-30T22:22:01.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.794+0000 7fd65d775700 1 --2- 172.21.15.156:0/2915432108 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd65806a770 0x7fd6581349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:01.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.794+0000 7fd65cf74700 1 --2- 172.21.15.156:0/2915432108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd658134f00 0x7fd65809d960 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fd648009840 tx=0x7fd648009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63768d916ab7cd2e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:01.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.794+0000 7fd64ffff700 1 -- 172.21.15.156:0/2915432108 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd648011830 con 0x7fd658134f00 2023-09-30T22:22:01.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.794+0000 7fd64ffff700 1 -- 172.21.15.156:0/2915432108 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd648011990 con 0x7fd658134f00 2023-09-30T22:22:01.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.794+0000 7fd64ffff700 1 -- 172.21.15.156:0/2915432108 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd648011d20 con 0x7fd658134f00 2023-09-30T22:22:01.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.794+0000 7fd65f9d9700 1 -- 172.21.15.156:0/2915432108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd658134f00 msgr2=0x7fd65809d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.794+0000 7fd65f9d9700 1 --2- 172.21.15.156:0/2915432108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd658134f00 0x7fd65809d960 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fd648009840 tx=0x7fd648009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:01.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.794+0000 7fd65f9d9700 1 -- 172.21.15.156:0/2915432108 shutdown_connections 2023-09-30T22:22:01.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.794+0000 7fd65f9d9700 1 --2- 172.21.15.156:0/2915432108 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd65806a770 0x7fd6581349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.794+0000 7fd65f9d9700 1 --2- 172.21.15.156:0/2915432108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd658134f00 0x7fd65809d960 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.794+0000 7fd65f9d9700 1 -- 172.21.15.156:0/2915432108 >> 172.21.15.156:0/2915432108 conn(0x7fd658099c40 msgr2=0x7fd6580a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:01.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.795+0000 7fd65f9d9700 1 -- 172.21.15.156:0/2915432108 shutdown_connections 2023-09-30T22:22:01.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.795+0000 7fd65f9d9700 1 -- 172.21.15.156:0/2915432108 wait complete. 2023-09-30T22:22:01.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.795+0000 7fd65f9d9700 1 Processor -- start 2023-09-30T22:22:01.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.795+0000 7fd65f9d9700 1 -- start start 2023-09-30T22:22:01.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.796+0000 7fd65f9d9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd65806a770 0x7fd658135850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.796+0000 7fd65f9d9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd65809dea0 0x7fd658135d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.796+0000 7fd65f9d9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd658134f00 0x7fd6581362d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.796+0000 7fd65f9d9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6581395b0 con 0x7fd65809dea0 2023-09-30T22:22:01.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.796+0000 7fd65f9d9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd658136ce0 con 0x7fd658134f00 2023-09-30T22:22:01.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.796+0000 7fd65f9d9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd658138650 con 0x7fd65806a770 2023-09-30T22:22:01.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.796+0000 7fd65cf74700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd65809dea0 0x7fd658135d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.796+0000 7fd65cf74700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd65809dea0 0x7fd658135d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47046/0 (socket says 172.21.15.156:47046) 2023-09-30T22:22:01.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.796+0000 7fd65cf74700 1 -- 172.21.15.156:0/1652387697 learned_addr learned my addr 172.21.15.156:0/1652387697 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:01.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.796+0000 7fd65d775700 1 --2- 172.21.15.156:0/1652387697 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd65806a770 0x7fd658135850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.796+0000 7fd65df76700 1 --2- 172.21.15.156:0/1652387697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd658134f00 0x7fd6581362d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.796+0000 7fd65cf74700 1 -- 172.21.15.156:0/1652387697 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd65806a770 msgr2=0x7fd658135850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.796+0000 7fd65cf74700 1 --2- 172.21.15.156:0/1652387697 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd65806a770 0x7fd658135850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.796+0000 7fd65cf74700 1 -- 172.21.15.156:0/1652387697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd658134f00 msgr2=0x7fd6581362d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.796+0000 7fd65cf74700 1 --2- 172.21.15.156:0/1652387697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd658134f00 0x7fd6581362d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.796+0000 7fd65cf74700 1 -- 172.21.15.156:0/1652387697 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd654009550 con 0x7fd65809dea0 2023-09-30T22:22:01.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.797+0000 7fd65cf74700 1 --2- 172.21.15.156:0/1652387697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd65809dea0 0x7fd658135d90 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fd6480090b0 tx=0x7fd648004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:01.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.797+0000 7fd64dffb700 1 -- 172.21.15.156:0/1652387697 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd648004400 con 0x7fd65809dea0 2023-09-30T22:22:01.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.797+0000 7fd64dffb700 1 -- 172.21.15.156:0/1652387697 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64801f070 con 0x7fd65809dea0 2023-09-30T22:22:01.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.797+0000 7fd64dffb700 1 -- 172.21.15.156:0/1652387697 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6480038a0 con 0x7fd65809dea0 2023-09-30T22:22:01.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.797+0000 7fd65f9d9700 1 -- 172.21.15.156:0/1652387697 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6480094a0 con 0x7fd65809dea0 2023-09-30T22:22:01.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.797+0000 7fd65f9d9700 1 -- 172.21.15.156:0/1652387697 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd658138380 con 0x7fd65809dea0 2023-09-30T22:22:01.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.798+0000 7fd65f9d9700 1 -- 172.21.15.156:0/1652387697 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd658141260 con 0x7fd65809dea0 2023-09-30T22:22:01.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.798+0000 7fd64dffb700 1 -- 172.21.15.156:0/1652387697 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd648021030 con 0x7fd65809dea0 2023-09-30T22:22:01.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.799+0000 7fd64dffb700 1 -- 172.21.15.156:0/1652387697 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd648040860 con 0x7fd65809dea0 2023-09-30T22:22:01.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.803+0000 7fd64dffb700 1 -- 172.21.15.156:0/1652387697 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd6480199a0 con 0x7fd65809dea0 2023-09-30T22:22:01.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.821+0000 7f336248c700 1 -- 172.21.15.156:0/1441340356 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f335c11eb20 con 0x7f335c09ad40 2023-09-30T22:22:01.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.822+0000 7f3358ff9700 1 -- 172.21.15.156:0/1441340356 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f334c019d20 con 0x7f335c09ad40 2023-09-30T22:22:01.823 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:01.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.824+0000 7f336248c700 1 -- 172.21.15.156:0/1441340356 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f335c09ad40 msgr2=0x7f335c11c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.824+0000 7f336248c700 1 --2- 172.21.15.156:0/1441340356 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f335c09ad40 0x7f335c11c8c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f334c000f60 tx=0x7f334c00c6e0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.824+0000 7f336248c700 1 -- 172.21.15.156:0/1441340356 shutdown_connections 2023-09-30T22:22:01.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.824+0000 7f336248c700 1 --2- 172.21.15.156:0/1441340356 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f335c134570 0x7f335c11d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.824+0000 7f336248c700 1 --2- 172.21.15.156:0/1441340356 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f335c09ad40 0x7f335c11c8c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.824+0000 7f336248c700 1 --2- 172.21.15.156:0/1441340356 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f335c134140 0x7f335c11ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.824+0000 7f336248c700 1 -- 172.21.15.156:0/1441340356 >> 172.21.15.156:0/1441340356 conn(0x7f335c099c40 msgr2=0x7f335c0a4110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:01.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.824+0000 7f336248c700 1 -- 172.21.15.156:0/1441340356 shutdown_connections 2023-09-30T22:22:01.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.824+0000 7f336248c700 1 -- 172.21.15.156:0/1441340356 wait complete. 2023-09-30T22:22:01.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:01.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.902+0000 7fc688c3a700 1 -- 172.21.15.156:0/317776550 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc68406fff0 con 0x7fc684133ad0 2023-09-30T22:22:01.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.903+0000 7fc672ffd700 1 -- 172.21.15.156:0/317776550 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc68406fff0 con 0x7fc684133ad0 2023-09-30T22:22:01.903 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:01.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.905+0000 7fc688c3a700 1 -- 172.21.15.156:0/317776550 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc684133ad0 msgr2=0x7fc684071b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.905+0000 7fc688c3a700 1 --2- 172.21.15.156:0/317776550 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc684133ad0 0x7fc684071b90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc67400b440 tx=0x7fc674009f90 comp rx=0 tx=0).stop 2023-09-30T22:22:01.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.905+0000 7fc688c3a700 1 -- 172.21.15.156:0/317776550 shutdown_connections 2023-09-30T22:22:01.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.905+0000 7fc688c3a700 1 --2- 172.21.15.156:0/317776550 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc684139280 0x7fc6841c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.905+0000 7fc688c3a700 1 --2- 172.21.15.156:0/317776550 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc684133ad0 0x7fc684071b90 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.905+0000 7fc688c3a700 1 --2- 172.21.15.156:0/317776550 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc684136960 0x7fc6840720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.905+0000 7fc688c3a700 1 -- 172.21.15.156:0/317776550 >> 172.21.15.156:0/317776550 conn(0x7fc684099c40 msgr2=0x7fc684134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:01.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.905+0000 7fc688c3a700 1 -- 172.21.15.156:0/317776550 shutdown_connections 2023-09-30T22:22:01.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.905+0000 7fc688c3a700 1 -- 172.21.15.156:0/317776550 wait complete. 2023-09-30T22:22:01.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:01.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.994+0000 7fd65f9d9700 1 -- 172.21.15.156:0/1652387697 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd6580a0970 con 0x7fd65809dea0 2023-09-30T22:22:01.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.995+0000 7fd64dffb700 1 -- 172.21.15.156:0/1652387697 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd648015070 con 0x7fd65809dea0 2023-09-30T22:22:01.996 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:01.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.997+0000 7fd65f9d9700 1 -- 172.21.15.156:0/1652387697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd65809dea0 msgr2=0x7fd658135d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.997+0000 7fd65f9d9700 1 --2- 172.21.15.156:0/1652387697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd65809dea0 0x7fd658135d90 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fd6480090b0 tx=0x7fd648004750 comp rx=0 tx=0).stop 2023-09-30T22:22:01.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.997+0000 7fd65f9d9700 1 -- 172.21.15.156:0/1652387697 shutdown_connections 2023-09-30T22:22:01.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.997+0000 7fd65f9d9700 1 --2- 172.21.15.156:0/1652387697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd658134f00 0x7fd6581362d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.997+0000 7fd65f9d9700 1 --2- 172.21.15.156:0/1652387697 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd65806a770 0x7fd658135850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.997+0000 7fd65f9d9700 1 --2- 172.21.15.156:0/1652387697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd65809dea0 0x7fd658135d90 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.997+0000 7fd65f9d9700 1 -- 172.21.15.156:0/1652387697 >> 172.21.15.156:0/1652387697 conn(0x7fd658099c40 msgr2=0x7fd65809b320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:01.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.997+0000 7fd65f9d9700 1 -- 172.21.15.156:0/1652387697 shutdown_connections 2023-09-30T22:22:01.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:01.997+0000 7fd65f9d9700 1 -- 172.21.15.156:0/1652387697 wait complete. 2023-09-30T22:22:02.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:02.428 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:02.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.554+0000 7f72082c7700 1 Processor -- start 2023-09-30T22:22:02.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.554+0000 7f72082c7700 1 -- start start 2023-09-30T22:22:02.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.554+0000 7f72082c7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7200133ad0 0x7f7200133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:02.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.554+0000 7f72082c7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72001300a0 0x7f72001304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:02.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.554+0000 7f72082c7700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f720006b2d0 con 0x7f72001309f0 2023-09-30T22:22:02.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.554+0000 7f72082c7700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7200133610 con 0x7f7200133ad0 2023-09-30T22:22:02.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.554+0000 7f72082c7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f720009a500 con 0x7f72001300a0 2023-09-30T22:22:02.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.554+0000 7f7206063700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7200133ad0 0x7f7200133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:02.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.554+0000 7f7205862700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72001300a0 0x7f72001304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:02.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.555+0000 7f7206063700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7200133ad0 0x7f7200133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47048/0 (socket says 172.21.15.156:47048) 2023-09-30T22:22:02.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.555+0000 7f7206063700 1 -- 172.21.15.156:0/3550789882 learned_addr learned my addr 172.21.15.156:0/3550789882 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:02.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.555+0000 7f7206864700 1 --1- 172.21.15.156:0/3550789882 >> v1:172.21.15.156:6789/0 conn(0x7f72001309f0 0x7f720013a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58102/0 (socket says 172.21.15.156:58102) 2023-09-30T22:22:02.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.555+0000 7f7205862700 1 -- 172.21.15.156:0/3550789882 >> v2:172.21.15.156:3300/0 conn(0x7f7200133ad0 msgr2=0x7f7200133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:02.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.555+0000 7f7205862700 1 --2- 172.21.15.156:0/3550789882 >> v2:172.21.15.156:3300/0 conn(0x7f7200133ad0 0x7f7200133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:02.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.555+0000 7f7205862700 1 -- 172.21.15.156:0/3550789882 >> v1:172.21.15.156:6789/0 conn(0x7f72001309f0 legacy=0x7f720013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.555+0000 7f7205862700 1 -- 172.21.15.156:0/3550789882 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72001338b0 con 0x7f72001300a0 2023-09-30T22:22:02.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.555+0000 7f7205061700 1 -- 172.21.15.156:0/3550789882 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2801845319 0 0) 0x7f720006b2d0 con 0x7f72001309f0 2023-09-30T22:22:02.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.555+0000 7f7206063700 1 --2- 172.21.15.156:0/3550789882 >> v2:172.21.15.156:3300/0 conn(0x7f7200133ad0 0x7f7200133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:02.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.555+0000 7f7205862700 1 --2- 172.21.15.156:0/3550789882 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72001300a0 0x7f72001304b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f71f0009840 tx=0x7f71f0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb867bc32637f09f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:02.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.555+0000 7f7205061700 1 -- 172.21.15.156:0/3550789882 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f0011830 con 0x7f72001300a0 2023-09-30T22:22:02.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.555+0000 7f7205061700 1 -- 172.21.15.156:0/3550789882 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f0011990 con 0x7f72001300a0 2023-09-30T22:22:02.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.555+0000 7f7205061700 1 -- 172.21.15.156:0/3550789882 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f0011d20 con 0x7f72001300a0 2023-09-30T22:22:02.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.556+0000 7f72082c7700 1 -- 172.21.15.156:0/3550789882 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72001300a0 msgr2=0x7f72001304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.556+0000 7f72082c7700 1 --2- 172.21.15.156:0/3550789882 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72001300a0 0x7f72001304b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f71f0009840 tx=0x7f71f0009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:02.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.556+0000 7f72082c7700 1 -- 172.21.15.156:0/3550789882 shutdown_connections 2023-09-30T22:22:02.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.556+0000 7f72082c7700 1 --2- 172.21.15.156:0/3550789882 >> v2:172.21.15.156:3300/0 conn(0x7f7200133ad0 0x7f7200133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:02.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.556+0000 7f72082c7700 1 --2- 172.21.15.156:0/3550789882 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72001300a0 0x7f72001304b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:02.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.556+0000 7f72082c7700 1 -- 172.21.15.156:0/3550789882 >> 172.21.15.156:0/3550789882 conn(0x7f7200099c40 msgr2=0x7f72000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:02.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.556+0000 7f72082c7700 1 -- 172.21.15.156:0/3550789882 shutdown_connections 2023-09-30T22:22:02.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.556+0000 7f72082c7700 1 -- 172.21.15.156:0/3550789882 wait complete. 2023-09-30T22:22:02.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.557+0000 7f72082c7700 1 Processor -- start 2023-09-30T22:22:02.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.557+0000 7f72082c7700 1 -- start start 2023-09-30T22:22:02.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.557+0000 7f72082c7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72001300a0 0x7f720011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:02.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.557+0000 7f72082c7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72001309f0 0x7f720011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:02.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.557+0000 7f72082c7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7200133ad0 0x7f720011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:02.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.557+0000 7f72082c7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720011fe30 con 0x7f72001300a0 2023-09-30T22:22:02.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.557+0000 7f72082c7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7200120010 con 0x7f7200133ad0 2023-09-30T22:22:02.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.557+0000 7f72082c7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f720011eb60 con 0x7f72001309f0 2023-09-30T22:22:02.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.557+0000 7f7205862700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72001309f0 0x7f720011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:02.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.557+0000 7f7205862700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72001309f0 0x7f720011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33472/0 (socket says 172.21.15.156:33472) 2023-09-30T22:22:02.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.557+0000 7f7205862700 1 -- 172.21.15.156:0/3893501092 learned_addr learned my addr 172.21.15.156:0/3893501092 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:02.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.557+0000 7f7206864700 1 --2- 172.21.15.156:0/3893501092 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7200133ad0 0x7f720011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:02.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.557+0000 7f7206063700 1 --2- 172.21.15.156:0/3893501092 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72001300a0 0x7f720011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:02.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.557+0000 7f7205862700 1 -- 172.21.15.156:0/3893501092 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7200133ad0 msgr2=0x7f720011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.557+0000 7f7205862700 1 --2- 172.21.15.156:0/3893501092 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7200133ad0 0x7f720011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:02.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.557+0000 7f7205862700 1 -- 172.21.15.156:0/3893501092 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72001300a0 msgr2=0x7f720011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.557+0000 7f7205862700 1 --2- 172.21.15.156:0/3893501092 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72001300a0 0x7f720011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:02.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.557+0000 7f7205862700 1 -- 172.21.15.156:0/3893501092 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71fc009550 con 0x7f72001309f0 2023-09-30T22:22:02.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.558+0000 7f7205862700 1 --2- 172.21.15.156:0/3893501092 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72001309f0 0x7f720011df80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f71f0009fd0 tx=0x7f71f0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:02.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.558+0000 7f71f6ffd700 1 -- 172.21.15.156:0/3893501092 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f00036a0 con 0x7f72001309f0 2023-09-30T22:22:02.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.558+0000 7f71f6ffd700 1 -- 172.21.15.156:0/3893501092 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f001e070 con 0x7f72001309f0 2023-09-30T22:22:02.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.558+0000 7f72082c7700 1 -- 172.21.15.156:0/3893501092 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f00094a0 con 0x7f72001309f0 2023-09-30T22:22:02.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.558+0000 7f71f6ffd700 1 -- 172.21.15.156:0/3893501092 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f0003a40 con 0x7f72001309f0 2023-09-30T22:22:02.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.558+0000 7f72082c7700 1 -- 172.21.15.156:0/3893501092 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f720011fa70 con 0x7f72001309f0 2023-09-30T22:22:02.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.558+0000 7f71f6ffd700 1 -- 172.21.15.156:0/3893501092 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f71f0003ba0 con 0x7f72001309f0 2023-09-30T22:22:02.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.559+0000 7f71f6ffd700 1 -- 172.21.15.156:0/3893501092 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f71f0020070 con 0x7f72001309f0 2023-09-30T22:22:02.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.559+0000 7f72082c7700 1 -- 172.21.15.156:0/3893501092 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f720011f460 con 0x7f72001309f0 2023-09-30T22:22:02.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.563+0000 7f71f6ffd700 1 -- 172.21.15.156:0/3893501092 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f720011f460 con 0x7f72001309f0 2023-09-30T22:22:02.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.751+0000 7f72082c7700 1 -- 172.21.15.156:0/3893501092 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f720011fc60 con 0x7f72001309f0 2023-09-30T22:22:02.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.751+0000 7f71f6ffd700 1 -- 172.21.15.156:0/3893501092 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f71f002a020 con 0x7f72001309f0 2023-09-30T22:22:02.752 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:02.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.753+0000 7f72082c7700 1 -- 172.21.15.156:0/3893501092 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72001309f0 msgr2=0x7f720011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.753+0000 7f72082c7700 1 --2- 172.21.15.156:0/3893501092 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72001309f0 0x7f720011df80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f71f0009fd0 tx=0x7f71f0004750 comp rx=0 tx=0).stop 2023-09-30T22:22:02.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.753+0000 7f72082c7700 1 -- 172.21.15.156:0/3893501092 shutdown_connections 2023-09-30T22:22:02.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.753+0000 7f72082c7700 1 --2- 172.21.15.156:0/3893501092 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7200133ad0 0x7f720011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:02.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.753+0000 7f72082c7700 1 --2- 172.21.15.156:0/3893501092 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72001300a0 0x7f720011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:02.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.753+0000 7f72082c7700 1 --2- 172.21.15.156:0/3893501092 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72001309f0 0x7f720011df80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:02.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.753+0000 7f72082c7700 1 -- 172.21.15.156:0/3893501092 >> 172.21.15.156:0/3893501092 conn(0x7f7200099c40 msgr2=0x7f720012e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:02.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.753+0000 7f72082c7700 1 -- 172.21.15.156:0/3893501092 shutdown_connections 2023-09-30T22:22:02.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.753+0000 7f72082c7700 1 -- 172.21.15.156:0/3893501092 wait complete. 2023-09-30T22:22:02.766 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:02.838 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:02.918 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:02.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.962+0000 7fbb78e0f700 1 Processor -- start 2023-09-30T22:22:02.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.962+0000 7fbb78e0f700 1 -- start start 2023-09-30T22:22:02.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.963+0000 7fbb78e0f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb740a0a70 0x7fbb740a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:02.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.963+0000 7fbb78e0f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb74134120 0x7fbb7413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:02.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.963+0000 7fbb78e0f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb7409dc00 con 0x7fbb740a1380 2023-09-30T22:22:02.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.963+0000 7fbb78e0f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7409ea90 con 0x7fbb740a0a70 2023-09-30T22:22:02.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.963+0000 7fbb78e0f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7409dec0 con 0x7fbb74134120 2023-09-30T22:22:02.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.963+0000 7fbb7259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb740a0a70 0x7fbb740a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:02.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.963+0000 7fbb7259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb740a0a70 0x7fbb740a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57668/0 (socket says 172.21.15.156:57668) 2023-09-30T22:22:02.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.963+0000 7fbb7259c700 1 -- 172.21.15.156:0/4141942022 learned_addr learned my addr 172.21.15.156:0/4141942022 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:02.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.963+0000 7fbb72d9d700 1 --2- 172.21.15.156:0/4141942022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb74134120 0x7fbb7413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:02.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.963+0000 7fbb71d9b700 1 --1- 172.21.15.156:0/4141942022 >> v1:172.21.15.156:6789/0 conn(0x7fbb740a1380 0x7fbb74133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58108/0 (socket says 172.21.15.156:58108) 2023-09-30T22:22:02.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.963+0000 7fbb72d9d700 1 -- 172.21.15.156:0/4141942022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb740a0a70 msgr2=0x7fbb740a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:02.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.963+0000 7fbb72d9d700 1 --2- 172.21.15.156:0/4141942022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb740a0a70 0x7fbb740a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:02.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.963+0000 7fbb7159a700 1 -- 172.21.15.156:0/4141942022 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3909254008 0 0) 0x7fbb7409dc00 con 0x7fbb740a1380 2023-09-30T22:22:02.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.963+0000 7fbb72d9d700 1 -- 172.21.15.156:0/4141942022 >> v1:172.21.15.156:6789/0 conn(0x7fbb740a1380 legacy=0x7fbb74133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.963+0000 7fbb72d9d700 1 -- 172.21.15.156:0/4141942022 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7409e6a0 con 0x7fbb74134120 2023-09-30T22:22:02.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.963+0000 7fbb7259c700 1 --2- 172.21.15.156:0/4141942022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb740a0a70 0x7fbb740a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:02.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.964+0000 7fbb72d9d700 1 --2- 172.21.15.156:0/4141942022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb74134120 0x7fbb7413bce0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c009dc0 tx=0x7fbb6c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbcea58128703bd5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:02.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.964+0000 7fbb7159a700 1 -- 172.21.15.156:0/4141942022 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c00e070 con 0x7fbb74134120 2023-09-30T22:22:02.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.964+0000 7fbb7159a700 1 -- 172.21.15.156:0/4141942022 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6c00bb20 con 0x7fbb74134120 2023-09-30T22:22:02.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.964+0000 7fbb7159a700 1 -- 172.21.15.156:0/4141942022 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c012430 con 0x7fbb74134120 2023-09-30T22:22:02.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.964+0000 7fbb78e0f700 1 -- 172.21.15.156:0/4141942022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb74134120 msgr2=0x7fbb7413bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.964+0000 7fbb78e0f700 1 --2- 172.21.15.156:0/4141942022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb74134120 0x7fbb7413bce0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c009dc0 tx=0x7fbb6c00b330 comp rx=0 tx=0).stop 2023-09-30T22:22:02.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.964+0000 7fbb78e0f700 1 -- 172.21.15.156:0/4141942022 shutdown_connections 2023-09-30T22:22:02.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.964+0000 7fbb78e0f700 1 --2- 172.21.15.156:0/4141942022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb740a0a70 0x7fbb740a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:02.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.964+0000 7fbb78e0f700 1 --2- 172.21.15.156:0/4141942022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb74134120 0x7fbb7413bce0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:02.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.964+0000 7fbb78e0f700 1 -- 172.21.15.156:0/4141942022 >> 172.21.15.156:0/4141942022 conn(0x7fbb740a6610 msgr2=0x7fbb740a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:02.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.964+0000 7fbb78e0f700 1 -- 172.21.15.156:0/4141942022 shutdown_connections 2023-09-30T22:22:02.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.964+0000 7fbb78e0f700 1 -- 172.21.15.156:0/4141942022 wait complete. 2023-09-30T22:22:02.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.965+0000 7fbb78e0f700 1 Processor -- start 2023-09-30T22:22:02.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.966+0000 7fbb78e0f700 1 -- start start 2023-09-30T22:22:02.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.966+0000 7fbb78e0f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb740a0a70 0x7fbb74122820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:02.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.966+0000 7fbb78e0f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb740a1380 0x7fbb74122d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:02.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.966+0000 7fbb78e0f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb74134120 0x7fbb741232a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:02.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.966+0000 7fbb78e0f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb74125950 con 0x7fbb74134120 2023-09-30T22:22:02.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.966+0000 7fbb78e0f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb741242f0 con 0x7fbb740a0a70 2023-09-30T22:22:02.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.966+0000 7fbb78e0f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb74126270 con 0x7fbb740a1380 2023-09-30T22:22:02.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.966+0000 7fbb7259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb740a0a70 0x7fbb74122820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:02.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.966+0000 7fbb72d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb74134120 0x7fbb741232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:02.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.966+0000 7fbb7259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb740a0a70 0x7fbb74122820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57682/0 (socket says 172.21.15.156:57682) 2023-09-30T22:22:02.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.966+0000 7fbb7259c700 1 -- 172.21.15.156:0/3725452193 learned_addr learned my addr 172.21.15.156:0/3725452193 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:02.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.966+0000 7fbb71d9b700 1 --2- 172.21.15.156:0/3725452193 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb740a1380 0x7fbb74122d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:02.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.966+0000 7fbb72d9d700 1 -- 172.21.15.156:0/3725452193 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb740a1380 msgr2=0x7fbb74122d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.966+0000 7fbb72d9d700 1 --2- 172.21.15.156:0/3725452193 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb740a1380 0x7fbb74122d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:02.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.966+0000 7fbb72d9d700 1 -- 172.21.15.156:0/3725452193 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb740a0a70 msgr2=0x7fbb74122820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.966+0000 7fbb72d9d700 1 --2- 172.21.15.156:0/3725452193 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb740a0a70 0x7fbb74122820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:02.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.966+0000 7fbb72d9d700 1 -- 172.21.15.156:0/3725452193 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb64009550 con 0x7fbb74134120 2023-09-30T22:22:02.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.966+0000 7fbb7259c700 1 --2- 172.21.15.156:0/3725452193 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb740a0a70 0x7fbb74122820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:02.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.966+0000 7fbb71d9b700 1 --2- 172.21.15.156:0/3725452193 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb740a1380 0x7fbb74122d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:02.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.967+0000 7fbb72d9d700 1 --2- 172.21.15.156:0/3725452193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb74134120 0x7fbb741232a0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c016000 tx=0x7fbb6c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:02.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.967+0000 7fbb62ffd700 1 -- 172.21.15.156:0/3725452193 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c004880 con 0x7fbb74134120 2023-09-30T22:22:02.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.967+0000 7fbb62ffd700 1 -- 172.21.15.156:0/3725452193 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6c020070 con 0x7fbb74134120 2023-09-30T22:22:02.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.967+0000 7fbb62ffd700 1 -- 172.21.15.156:0/3725452193 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c0276c0 con 0x7fbb74134120 2023-09-30T22:22:02.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.967+0000 7fbb78e0f700 1 -- 172.21.15.156:0/3725452193 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb6c009a70 con 0x7fbb74134120 2023-09-30T22:22:02.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.967+0000 7fbb78e0f700 1 -- 172.21.15.156:0/3725452193 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb74125cd0 con 0x7fbb74134120 2023-09-30T22:22:02.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.968+0000 7fbb62ffd700 1 -- 172.21.15.156:0/3725452193 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbb6c012430 con 0x7fbb74134120 2023-09-30T22:22:02.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.968+0000 7fbb62ffd700 1 -- 172.21.15.156:0/3725452193 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbb6c022070 con 0x7fbb74134120 2023-09-30T22:22:02.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.968+0000 7fbb78e0f700 1 -- 172.21.15.156:0/3725452193 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb7404f2a0 con 0x7fbb74134120 2023-09-30T22:22:02.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:02.973+0000 7fbb62ffd700 1 -- 172.21.15.156:0/3725452193 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb6c01b400 con 0x7fbb74134120 2023-09-30T22:22:03.011 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:03.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.046+0000 7fead3115700 1 Processor -- start 2023-09-30T22:22:03.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.046+0000 7fead3115700 1 -- start start 2023-09-30T22:22:03.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.047+0000 7fead3115700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feacc09d860 0x7feacc09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:03.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.047+0000 7fead3115700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feacc130eb0 0x7feacc138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:03.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.047+0000 7fead3115700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feacc09aaa0 con 0x7feacc09e170 2023-09-30T22:22:03.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.047+0000 7fead3115700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feacc09f870 con 0x7feacc130eb0 2023-09-30T22:22:03.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.047+0000 7fead3115700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feacc09b360 con 0x7feacc09d860 2023-09-30T22:22:03.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.047+0000 7feacbfff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7feacc09e170 0x7feacc1307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58110/0 (socket says 172.21.15.156:58110) 2023-09-30T22:22:03.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.047+0000 7feacbfff700 1 -- 172.21.15.156:0/156638579 learned_addr learned my addr 172.21.15.156:0/156638579 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:03.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.047+0000 7fead16b2700 1 --2- 172.21.15.156:0/156638579 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feacc130eb0 0x7feacc138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:03.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.047+0000 7fead0eb1700 1 --2- 172.21.15.156:0/156638579 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feacc09d860 0x7feacc09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:03.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.047+0000 7feacb7fe700 1 -- 172.21.15.156:0/156638579 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3380281856 0 0) 0x7feacc09aaa0 con 0x7feacc09e170 2023-09-30T22:22:03.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.047+0000 7feacb7fe700 1 -- 172.21.15.156:0/156638579 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feabc0035b0 con 0x7feacc09e170 2023-09-30T22:22:03.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.047+0000 7fead16b2700 1 -- 172.21.15.156:0/156638579 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feacc09d860 msgr2=0x7feacc09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:03.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.047+0000 7fead16b2700 1 --2- 172.21.15.156:0/156638579 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feacc09d860 0x7feacc09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.047+0000 7fead16b2700 1 -- 172.21.15.156:0/156638579 >> v1:172.21.15.156:6789/0 conn(0x7feacc09e170 legacy=0x7feacc1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:03.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.047+0000 7fead16b2700 1 -- 172.21.15.156:0/156638579 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feacc09b620 con 0x7feacc130eb0 2023-09-30T22:22:03.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.047+0000 7fead16b2700 1 --2- 172.21.15.156:0/156638579 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feacc130eb0 0x7feacc138a00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7feac4009dc0 tx=0x7feac400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f95992b4ea03d2f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:03.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.048+0000 7feacb7fe700 1 -- 172.21.15.156:0/156638579 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac400e070 con 0x7feacc130eb0 2023-09-30T22:22:03.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.048+0000 7feacb7fe700 1 -- 172.21.15.156:0/156638579 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac400bb20 con 0x7feacc130eb0 2023-09-30T22:22:03.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.048+0000 7feacb7fe700 1 -- 172.21.15.156:0/156638579 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac4012430 con 0x7feacc130eb0 2023-09-30T22:22:03.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.048+0000 7fead3115700 1 -- 172.21.15.156:0/156638579 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feacc130eb0 msgr2=0x7feacc138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:03.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.048+0000 7fead3115700 1 --2- 172.21.15.156:0/156638579 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feacc130eb0 0x7feacc138a00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7feac4009dc0 tx=0x7feac400b330 comp rx=0 tx=0).stop 2023-09-30T22:22:03.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.049+0000 7fead3115700 1 -- 172.21.15.156:0/156638579 shutdown_connections 2023-09-30T22:22:03.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.049+0000 7fead3115700 1 --2- 172.21.15.156:0/156638579 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feacc130eb0 0x7feacc138a00 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.049+0000 7fead3115700 1 --2- 172.21.15.156:0/156638579 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feacc09d860 0x7feacc09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.049+0000 7fead3115700 1 -- 172.21.15.156:0/156638579 >> 172.21.15.156:0/156638579 conn(0x7feacc099c40 msgr2=0x7feacc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:03.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.049+0000 7fead3115700 1 -- 172.21.15.156:0/156638579 shutdown_connections 2023-09-30T22:22:03.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.049+0000 7fead3115700 1 -- 172.21.15.156:0/156638579 wait complete. 2023-09-30T22:22:03.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.049+0000 7fead3115700 1 Processor -- start 2023-09-30T22:22:03.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.050+0000 7fead3115700 1 -- start start 2023-09-30T22:22:03.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.050+0000 7fead3115700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feacc09d860 0x7feacc138510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:03.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.050+0000 7fead3115700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feacc09e170 0x7feacc138a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:03.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.050+0000 7fead3115700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feacc130eb0 0x7feacc1c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:03.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.050+0000 7fead3115700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feacc136de0 con 0x7feacc09d860 2023-09-30T22:22:03.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.050+0000 7fead3115700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feacc09c8b0 con 0x7feacc130eb0 2023-09-30T22:22:03.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.050+0000 7fead3115700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feacc1359e0 con 0x7feacc09e170 2023-09-30T22:22:03.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.051+0000 7feacbfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feacc09e170 0x7feacc138a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:03.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.051+0000 7feacbfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feacc09e170 0x7feacc138a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33514/0 (socket says 172.21.15.156:33514) 2023-09-30T22:22:03.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.051+0000 7fead0eb1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feacc09d860 0x7feacc138510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:03.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.051+0000 7feacbfff700 1 -- 172.21.15.156:0/424905079 learned_addr learned my addr 172.21.15.156:0/424905079 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:03.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.051+0000 7fead16b2700 1 --2- 172.21.15.156:0/424905079 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feacc130eb0 0x7feacc1c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:03.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.051+0000 7fead16b2700 1 -- 172.21.15.156:0/424905079 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feacc09e170 msgr2=0x7feacc138a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:03.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.051+0000 7fead16b2700 1 --2- 172.21.15.156:0/424905079 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feacc09e170 0x7feacc138a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.051+0000 7fead16b2700 1 -- 172.21.15.156:0/424905079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feacc09d860 msgr2=0x7feacc138510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:03.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.051+0000 7fead16b2700 1 --2- 172.21.15.156:0/424905079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feacc09d860 0x7feacc138510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.051+0000 7fead16b2700 1 -- 172.21.15.156:0/424905079 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac4009a70 con 0x7feacc130eb0 2023-09-30T22:22:03.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.051+0000 7fead16b2700 1 --2- 172.21.15.156:0/424905079 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feacc130eb0 0x7feacc1c8050 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7feac4016000 tx=0x7feac4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:03.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.051+0000 7feac97fa700 1 -- 172.21.15.156:0/424905079 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac4012430 con 0x7feacc130eb0 2023-09-30T22:22:03.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.051+0000 7feac97fa700 1 -- 172.21.15.156:0/424905079 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac4020070 con 0x7feacc130eb0 2023-09-30T22:22:03.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.051+0000 7fead3115700 1 -- 172.21.15.156:0/424905079 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feacc138f90 con 0x7feacc130eb0 2023-09-30T22:22:03.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.051+0000 7feac97fa700 1 -- 172.21.15.156:0/424905079 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac4004280 con 0x7feacc130eb0 2023-09-30T22:22:03.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.051+0000 7fead3115700 1 -- 172.21.15.156:0/424905079 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feacc13bd70 con 0x7feacc130eb0 2023-09-30T22:22:03.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.052+0000 7feac97fa700 1 -- 172.21.15.156:0/424905079 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feac40043e0 con 0x7feacc130eb0 2023-09-30T22:22:03.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.052+0000 7feac97fa700 1 -- 172.21.15.156:0/424905079 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feac4022070 con 0x7feacc130eb0 2023-09-30T22:22:03.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.053+0000 7fead3115700 1 -- 172.21.15.156:0/424905079 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feacc13bd70 con 0x7feacc130eb0 2023-09-30T22:22:03.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.057+0000 7feac97fa700 1 -- 172.21.15.156:0/424905079 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feac406c750 con 0x7feacc130eb0 2023-09-30T22:22:03.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.137+0000 7f4b435ba700 1 Processor -- start 2023-09-30T22:22:03.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.137+0000 7f4b435ba700 1 -- start start 2023-09-30T22:22:03.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.137+0000 7f4b435ba700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b3c0a0a70 0x7f4b3c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:03.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.137+0000 7f4b435ba700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b3c134120 0x7f4b3c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:03.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.137+0000 7f4b435ba700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b3c09dc00 con 0x7f4b3c0a1380 2023-09-30T22:22:03.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.137+0000 7f4b435ba700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c09ea90 con 0x7f4b3c0a0a70 2023-09-30T22:22:03.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.137+0000 7f4b435ba700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c09dec0 con 0x7f4b3c134120 2023-09-30T22:22:03.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.138+0000 7f4b41356700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b3c0a0a70 0x7f4b3c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:03.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.138+0000 7f4b40b55700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4b3c0a1380 0x7f4b3c133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58112/0 (socket says 172.21.15.156:58112) 2023-09-30T22:22:03.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.138+0000 7f4b41b57700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b3c134120 0x7f4b3c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:03.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.138+0000 7f4b40b55700 1 -- 172.21.15.156:0/1936397106 learned_addr learned my addr 172.21.15.156:0/1936397106 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:03.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.138+0000 7f4b33fff700 1 -- 172.21.15.156:0/1936397106 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 941559027 0 0) 0x7f4b3c09dc00 con 0x7f4b3c0a1380 2023-09-30T22:22:03.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.138+0000 7f4b41b57700 1 -- 172.21.15.156:0/1936397106 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b3c0a0a70 msgr2=0x7f4b3c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:03.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.138+0000 7f4b41b57700 1 --2- 172.21.15.156:0/1936397106 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b3c0a0a70 0x7f4b3c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.138+0000 7f4b41b57700 1 -- 172.21.15.156:0/1936397106 >> v1:172.21.15.156:6789/0 conn(0x7f4b3c0a1380 legacy=0x7f4b3c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:03.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.138+0000 7f4b41b57700 1 -- 172.21.15.156:0/1936397106 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3c09e6a0 con 0x7f4b3c134120 2023-09-30T22:22:03.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.138+0000 7f4b41356700 1 --2- 172.21.15.156:0/1936397106 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b3c0a0a70 0x7f4b3c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:03.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.138+0000 7f4b41b57700 1 --2- 172.21.15.156:0/1936397106 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b3c134120 0x7f4b3c13bce0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4b34009dc0 tx=0x7f4b3400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cff086c1307f1c92 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:03.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.138+0000 7f4b33fff700 1 -- 172.21.15.156:0/1936397106 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3400e070 con 0x7f4b3c134120 2023-09-30T22:22:03.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.138+0000 7f4b33fff700 1 -- 172.21.15.156:0/1936397106 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3400bb20 con 0x7f4b3c134120 2023-09-30T22:22:03.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.138+0000 7f4b33fff700 1 -- 172.21.15.156:0/1936397106 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b34012430 con 0x7f4b3c134120 2023-09-30T22:22:03.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.139+0000 7f4b435ba700 1 -- 172.21.15.156:0/1936397106 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b3c134120 msgr2=0x7f4b3c13bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:03.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.139+0000 7f4b435ba700 1 --2- 172.21.15.156:0/1936397106 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b3c134120 0x7f4b3c13bce0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4b34009dc0 tx=0x7f4b3400b330 comp rx=0 tx=0).stop 2023-09-30T22:22:03.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.139+0000 7f4b435ba700 1 -- 172.21.15.156:0/1936397106 shutdown_connections 2023-09-30T22:22:03.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.139+0000 7f4b435ba700 1 --2- 172.21.15.156:0/1936397106 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b3c0a0a70 0x7f4b3c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.139+0000 7f4b435ba700 1 --2- 172.21.15.156:0/1936397106 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b3c134120 0x7f4b3c13bce0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.139+0000 7f4b435ba700 1 -- 172.21.15.156:0/1936397106 >> 172.21.15.156:0/1936397106 conn(0x7f4b3c0a6610 msgr2=0x7f4b3c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:03.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.139+0000 7f4b435ba700 1 -- 172.21.15.156:0/1936397106 shutdown_connections 2023-09-30T22:22:03.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.139+0000 7f4b435ba700 1 -- 172.21.15.156:0/1936397106 wait complete. 2023-09-30T22:22:03.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.140+0000 7f4b435ba700 1 Processor -- start 2023-09-30T22:22:03.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.140+0000 7f4b435ba700 1 -- start start 2023-09-30T22:22:03.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.141+0000 7f4b435ba700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b3c0a0a70 0x7f4b3c122760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:03.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.141+0000 7f4b435ba700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b3c0a1380 0x7f4b3c122ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:03.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.141+0000 7f4b435ba700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b3c134120 0x7f4b3c1231e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:03.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.141+0000 7f4b435ba700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c1332c0 con 0x7f4b3c0a0a70 2023-09-30T22:22:03.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.141+0000 7f4b435ba700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c1258c0 con 0x7f4b3c134120 2023-09-30T22:22:03.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.141+0000 7f4b435ba700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c1242d0 con 0x7f4b3c0a1380 2023-09-30T22:22:03.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.141+0000 7f4b40b55700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b3c0a1380 0x7f4b3c122ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:03.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.141+0000 7f4b41356700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b3c0a0a70 0x7f4b3c122760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:03.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.141+0000 7f4b40b55700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b3c0a1380 0x7f4b3c122ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33522/0 (socket says 172.21.15.156:33522) 2023-09-30T22:22:03.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.141+0000 7f4b40b55700 1 -- 172.21.15.156:0/4005059944 learned_addr learned my addr 172.21.15.156:0/4005059944 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:03.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.141+0000 7f4b41b57700 1 --2- 172.21.15.156:0/4005059944 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b3c134120 0x7f4b3c1231e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:03.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.141+0000 7f4b40b55700 1 -- 172.21.15.156:0/4005059944 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b3c134120 msgr2=0x7f4b3c1231e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:03.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.141+0000 7f4b40b55700 1 --2- 172.21.15.156:0/4005059944 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b3c134120 0x7f4b3c1231e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.141+0000 7f4b40b55700 1 -- 172.21.15.156:0/4005059944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b3c0a0a70 msgr2=0x7f4b3c122760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:03.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.141+0000 7f4b40b55700 1 --2- 172.21.15.156:0/4005059944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b3c0a0a70 0x7f4b3c122760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.141+0000 7f4b40b55700 1 -- 172.21.15.156:0/4005059944 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b380094a0 con 0x7f4b3c0a1380 2023-09-30T22:22:03.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.141+0000 7f4b40b55700 1 --2- 172.21.15.156:0/4005059944 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b3c0a1380 0x7f4b3c122ca0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c00c520 tx=0x7f4b2c00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:03.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.142+0000 7f4b31ffb700 1 -- 172.21.15.156:0/4005059944 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c004c80 con 0x7f4b3c0a1380 2023-09-30T22:22:03.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.142+0000 7f4b31ffb700 1 -- 172.21.15.156:0/4005059944 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2c004de0 con 0x7f4b3c0a1380 2023-09-30T22:22:03.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.142+0000 7f4b435ba700 1 -- 172.21.15.156:0/4005059944 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b34009a70 con 0x7f4b3c0a1380 2023-09-30T22:22:03.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.142+0000 7f4b31ffb700 1 -- 172.21.15.156:0/4005059944 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c007310 con 0x7f4b3c0a1380 2023-09-30T22:22:03.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.142+0000 7f4b435ba700 1 -- 172.21.15.156:0/4005059944 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b3c0a03e0 con 0x7f4b3c0a1380 2023-09-30T22:22:03.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.143+0000 7f4b31ffb700 1 -- 172.21.15.156:0/4005059944 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b2c007470 con 0x7f4b3c0a1380 2023-09-30T22:22:03.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.143+0000 7f4b31ffb700 1 -- 172.21.15.156:0/4005059944 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4b2c03f2c0 con 0x7f4b3c0a1380 2023-09-30T22:22:03.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.143+0000 7f4b435ba700 1 -- 172.21.15.156:0/4005059944 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b3c04f2a0 con 0x7f4b3c0a1380 2023-09-30T22:22:03.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.148+0000 7f4b31ffb700 1 -- 172.21.15.156:0/4005059944 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b2c0123b0 con 0x7f4b3c0a1380 2023-09-30T22:22:03.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.171+0000 7fbb78e0f700 1 -- 172.21.15.156:0/3725452193 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbb74072980 con 0x7fbb74134120 2023-09-30T22:22:03.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.172+0000 7fbb62ffd700 1 -- 172.21.15.156:0/3725452193 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbb6c02c020 con 0x7fbb74134120 2023-09-30T22:22:03.172 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:03.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.174+0000 7fbb78e0f700 1 -- 172.21.15.156:0/3725452193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb74134120 msgr2=0x7fbb741232a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:03.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.174+0000 7fbb78e0f700 1 --2- 172.21.15.156:0/3725452193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb74134120 0x7fbb741232a0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c016000 tx=0x7fbb6c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.174+0000 7fbb78e0f700 1 -- 172.21.15.156:0/3725452193 shutdown_connections 2023-09-30T22:22:03.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.174+0000 7fbb78e0f700 1 --2- 172.21.15.156:0/3725452193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb74134120 0x7fbb741232a0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.174+0000 7fbb78e0f700 1 --2- 172.21.15.156:0/3725452193 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb740a0a70 0x7fbb74122820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.174+0000 7fbb78e0f700 1 --2- 172.21.15.156:0/3725452193 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb740a1380 0x7fbb74122d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.174+0000 7fbb78e0f700 1 -- 172.21.15.156:0/3725452193 >> 172.21.15.156:0/3725452193 conn(0x7fbb740a6610 msgr2=0x7fbb7411c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:03.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.174+0000 7fbb78e0f700 1 -- 172.21.15.156:0/3725452193 shutdown_connections 2023-09-30T22:22:03.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.174+0000 7fbb78e0f700 1 -- 172.21.15.156:0/3725452193 wait complete. 2023-09-30T22:22:03.187 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:03.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.254+0000 7fead3115700 1 -- 172.21.15.156:0/424905079 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feacc04f2a0 con 0x7feacc130eb0 2023-09-30T22:22:03.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.255+0000 7feac97fa700 1 -- 172.21.15.156:0/424905079 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feacc13bd70 con 0x7feacc130eb0 2023-09-30T22:22:03.256 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:03.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.257+0000 7fead3115700 1 -- 172.21.15.156:0/424905079 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feacc130eb0 msgr2=0x7feacc1c8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:03.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.257+0000 7fead3115700 1 --2- 172.21.15.156:0/424905079 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feacc130eb0 0x7feacc1c8050 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7feac4016000 tx=0x7feac4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.257+0000 7fead3115700 1 -- 172.21.15.156:0/424905079 shutdown_connections 2023-09-30T22:22:03.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.257+0000 7fead3115700 1 --2- 172.21.15.156:0/424905079 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feacc130eb0 0x7feacc1c8050 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.257+0000 7fead3115700 1 --2- 172.21.15.156:0/424905079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feacc09d860 0x7feacc138510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.257+0000 7fead3115700 1 --2- 172.21.15.156:0/424905079 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feacc09e170 0x7feacc138a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.257+0000 7fead3115700 1 -- 172.21.15.156:0/424905079 >> 172.21.15.156:0/424905079 conn(0x7feacc099c40 msgr2=0x7feacc1395d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:03.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.257+0000 7fead3115700 1 -- 172.21.15.156:0/424905079 shutdown_connections 2023-09-30T22:22:03.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.257+0000 7fead3115700 1 -- 172.21.15.156:0/424905079 wait complete. 2023-09-30T22:22:03.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:03.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.341+0000 7f4b435ba700 1 -- 172.21.15.156:0/4005059944 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4b3c072980 con 0x7f4b3c0a1380 2023-09-30T22:22:03.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.341+0000 7f4b31ffb700 1 -- 172.21.15.156:0/4005059944 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b2c011360 con 0x7f4b3c0a1380 2023-09-30T22:22:03.342 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:03.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.343+0000 7f4b435ba700 1 -- 172.21.15.156:0/4005059944 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b3c0a1380 msgr2=0x7f4b3c122ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:03.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.343+0000 7f4b435ba700 1 --2- 172.21.15.156:0/4005059944 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b3c0a1380 0x7f4b3c122ca0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c00c520 tx=0x7f4b2c00c830 comp rx=0 tx=0).stop 2023-09-30T22:22:03.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.343+0000 7f4b435ba700 1 -- 172.21.15.156:0/4005059944 shutdown_connections 2023-09-30T22:22:03.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.343+0000 7f4b435ba700 1 --2- 172.21.15.156:0/4005059944 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4b3c134120 0x7f4b3c1231e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.343+0000 7f4b435ba700 1 --2- 172.21.15.156:0/4005059944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4b3c0a0a70 0x7f4b3c122760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.343+0000 7f4b435ba700 1 --2- 172.21.15.156:0/4005059944 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4b3c0a1380 0x7f4b3c122ca0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.343+0000 7f4b435ba700 1 -- 172.21.15.156:0/4005059944 >> 172.21.15.156:0/4005059944 conn(0x7f4b3c0a6610 msgr2=0x7f4b3c0a4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:03.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.343+0000 7f4b435ba700 1 -- 172.21.15.156:0/4005059944 shutdown_connections 2023-09-30T22:22:03.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.343+0000 7f4b435ba700 1 -- 172.21.15.156:0/4005059944 wait complete. 2023-09-30T22:22:03.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:03.767 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:03.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.891+0000 7fe145d97700 1 Processor -- start 2023-09-30T22:22:03.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.891+0000 7fe145d97700 1 -- start start 2023-09-30T22:22:03.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.891+0000 7fe145d97700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe140133ad0 0x7fe140133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:03.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.891+0000 7fe145d97700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe140130bc0 0x7fe14013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:03.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.891+0000 7fe145d97700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14006b2d0 con 0x7fe1401300a0 2023-09-30T22:22:03.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.891+0000 7fe145d97700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe140133610 con 0x7fe140133ad0 2023-09-30T22:22:03.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.891+0000 7fe145d97700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe14009a500 con 0x7fe140130bc0 2023-09-30T22:22:03.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.892+0000 7fe13ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe140130bc0 0x7fe14013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:03.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.892+0000 7fe13f7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe140133ad0 0x7fe140133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:03.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.892+0000 7fe13effd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe1401300a0 0x7fe1401304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58126/0 (socket says 172.21.15.156:58126) 2023-09-30T22:22:03.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.892+0000 7fe13effd700 1 -- 172.21.15.156:0/3638352970 learned_addr learned my addr 172.21.15.156:0/3638352970 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:03.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.892+0000 7fe13f7fe700 1 --2- 172.21.15.156:0/3638352970 >> v2:172.21.15.156:3300/0 conn(0x7fe140133ad0 0x7fe140133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47088/0 (socket says 172.21.15.156:47088) 2023-09-30T22:22:03.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.892+0000 7fe13f7fe700 1 -- 172.21.15.156:0/3638352970 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe140130bc0 msgr2=0x7fe14013b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:03.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.892+0000 7fe13f7fe700 1 --2- 172.21.15.156:0/3638352970 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe140130bc0 0x7fe14013b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.892+0000 7fe13f7fe700 1 -- 172.21.15.156:0/3638352970 >> v1:172.21.15.156:6789/0 conn(0x7fe1401300a0 legacy=0x7fe1401304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:03.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.892+0000 7fe13f7fe700 1 -- 172.21.15.156:0/3638352970 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1401338b0 con 0x7fe140133ad0 2023-09-30T22:22:03.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.892+0000 7fe13e7fc700 1 -- 172.21.15.156:0/3638352970 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2514489973 0 0) 0x7fe14006b2d0 con 0x7fe1401300a0 2023-09-30T22:22:03.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.892+0000 7fe13ffff700 1 --2- 172.21.15.156:0/3638352970 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe140130bc0 0x7fe14013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:03.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.892+0000 7fe13f7fe700 1 --2- 172.21.15.156:0/3638352970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe140133ad0 0x7fe140133ea0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fe128009840 tx=0x7fe128009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f3eeb7d3ae993e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:03.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.892+0000 7fe13e7fc700 1 -- 172.21.15.156:0/3638352970 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe128011830 con 0x7fe140133ad0 2023-09-30T22:22:03.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.892+0000 7fe13e7fc700 1 -- 172.21.15.156:0/3638352970 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe128011990 con 0x7fe140133ad0 2023-09-30T22:22:03.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.892+0000 7fe13e7fc700 1 -- 172.21.15.156:0/3638352970 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe128011d20 con 0x7fe140133ad0 2023-09-30T22:22:03.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.893+0000 7fe145d97700 1 -- 172.21.15.156:0/3638352970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe140133ad0 msgr2=0x7fe140133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:03.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.893+0000 7fe145d97700 1 --2- 172.21.15.156:0/3638352970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe140133ad0 0x7fe140133ea0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fe128009840 tx=0x7fe128009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:03.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.893+0000 7fe145d97700 1 -- 172.21.15.156:0/3638352970 shutdown_connections 2023-09-30T22:22:03.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.893+0000 7fe145d97700 1 --2- 172.21.15.156:0/3638352970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe140133ad0 0x7fe140133ea0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.893+0000 7fe145d97700 1 --2- 172.21.15.156:0/3638352970 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe140130bc0 0x7fe14013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.893+0000 7fe145d97700 1 -- 172.21.15.156:0/3638352970 >> 172.21.15.156:0/3638352970 conn(0x7fe140099c40 msgr2=0x7fe1400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:03.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.893+0000 7fe145d97700 1 -- 172.21.15.156:0/3638352970 shutdown_connections 2023-09-30T22:22:03.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.893+0000 7fe145d97700 1 -- 172.21.15.156:0/3638352970 wait complete. 2023-09-30T22:22:03.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.894+0000 7fe145d97700 1 Processor -- start 2023-09-30T22:22:03.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.894+0000 7fe145d97700 1 -- start start 2023-09-30T22:22:03.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.894+0000 7fe145d97700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1401300a0 0x7fe14011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:03.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.894+0000 7fe145d97700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe140130bc0 0x7fe14011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:03.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.894+0000 7fe145d97700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe140133ad0 0x7fe14011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:03.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.894+0000 7fe145d97700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14011fd00 con 0x7fe140133ad0 2023-09-30T22:22:03.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.894+0000 7fe145d97700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14012dd00 con 0x7fe1401300a0 2023-09-30T22:22:03.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.894+0000 7fe145d97700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1400720a0 con 0x7fe140130bc0 2023-09-30T22:22:03.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.894+0000 7fe13effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe140130bc0 0x7fe14011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:03.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.894+0000 7fe13ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe140133ad0 0x7fe14011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:03.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.894+0000 7fe13effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe140130bc0 0x7fe14011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33542/0 (socket says 172.21.15.156:33542) 2023-09-30T22:22:03.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.894+0000 7fe13effd700 1 -- 172.21.15.156:0/4009070240 learned_addr learned my addr 172.21.15.156:0/4009070240 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:03.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.894+0000 7fe13f7fe700 1 --2- 172.21.15.156:0/4009070240 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1401300a0 0x7fe14011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:03.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.895+0000 7fe13ffff700 1 -- 172.21.15.156:0/4009070240 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe140130bc0 msgr2=0x7fe14011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:03.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.895+0000 7fe13ffff700 1 --2- 172.21.15.156:0/4009070240 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe140130bc0 0x7fe14011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.895+0000 7fe13ffff700 1 -- 172.21.15.156:0/4009070240 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1401300a0 msgr2=0x7fe14011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:03.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.895+0000 7fe13ffff700 1 --2- 172.21.15.156:0/4009070240 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1401300a0 0x7fe14011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.895+0000 7fe13ffff700 1 -- 172.21.15.156:0/4009070240 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe138009a70 con 0x7fe140133ad0 2023-09-30T22:22:03.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.895+0000 7fe13ffff700 1 --2- 172.21.15.156:0/4009070240 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe140133ad0 0x7fe14011e4c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fe138009e50 tx=0x7fe13800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:03.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.895+0000 7fe137fff700 1 -- 172.21.15.156:0/4009070240 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13800ca90 con 0x7fe140133ad0 2023-09-30T22:22:03.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.895+0000 7fe137fff700 1 -- 172.21.15.156:0/4009070240 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13800f040 con 0x7fe140133ad0 2023-09-30T22:22:03.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.895+0000 7fe145d97700 1 -- 172.21.15.156:0/4009070240 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1280094a0 con 0x7fe140133ad0 2023-09-30T22:22:03.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.895+0000 7fe137fff700 1 -- 172.21.15.156:0/4009070240 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13800ce50 con 0x7fe140133ad0 2023-09-30T22:22:03.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.895+0000 7fe145d97700 1 -- 172.21.15.156:0/4009070240 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14011ffe0 con 0x7fe140133ad0 2023-09-30T22:22:03.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.896+0000 7fe145d97700 1 -- 172.21.15.156:0/4009070240 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe14009cb20 con 0x7fe140133ad0 2023-09-30T22:22:03.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.896+0000 7fe137fff700 1 -- 172.21.15.156:0/4009070240 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe138014480 con 0x7fe140133ad0 2023-09-30T22:22:03.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.896+0000 7fe137fff700 1 -- 172.21.15.156:0/4009070240 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe13803fc80 con 0x7fe140133ad0 2023-09-30T22:22:03.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:03.901+0000 7fe137fff700 1 -- 172.21.15.156:0/4009070240 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe138045020 con 0x7fe140133ad0 2023-09-30T22:22:04.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.085+0000 7fe145d97700 1 -- 172.21.15.156:0/4009070240 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe14004f2a0 con 0x7fe140133ad0 2023-09-30T22:22:04.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.085+0000 7fe137fff700 1 -- 172.21.15.156:0/4009070240 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe138012930 con 0x7fe140133ad0 2023-09-30T22:22:04.086 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:04.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.087+0000 7fe145d97700 1 -- 172.21.15.156:0/4009070240 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe140133ad0 msgr2=0x7fe14011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:04.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.087+0000 7fe145d97700 1 --2- 172.21.15.156:0/4009070240 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe140133ad0 0x7fe14011e4c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fe138009e50 tx=0x7fe13800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.087+0000 7fe145d97700 1 -- 172.21.15.156:0/4009070240 shutdown_connections 2023-09-30T22:22:04.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.087+0000 7fe145d97700 1 --2- 172.21.15.156:0/4009070240 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe140133ad0 0x7fe14011e4c0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.087+0000 7fe145d97700 1 --2- 172.21.15.156:0/4009070240 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1401300a0 0x7fe14011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.087+0000 7fe145d97700 1 --2- 172.21.15.156:0/4009070240 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe140130bc0 0x7fe14011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.087+0000 7fe145d97700 1 -- 172.21.15.156:0/4009070240 >> 172.21.15.156:0/4009070240 conn(0x7fe140099c40 msgr2=0x7fe140132bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:04.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.087+0000 7fe145d97700 1 -- 172.21.15.156:0/4009070240 shutdown_connections 2023-09-30T22:22:04.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.087+0000 7fe145d97700 1 -- 172.21.15.156:0/4009070240 wait complete. 2023-09-30T22:22:04.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:04.188 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:04.271 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:04.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.311+0000 7fa157adb700 1 Processor -- start 2023-09-30T22:22:04.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.312+0000 7fa157adb700 1 -- start start 2023-09-30T22:22:04.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.312+0000 7fa157adb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa15009ad40 0x7fa150133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:04.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.312+0000 7fa157adb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa150133f70 0x7fa1501343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:04.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.312+0000 7fa157adb700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa15009b110 con 0x7fa1500a0a70 2023-09-30T22:22:04.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.312+0000 7fa157adb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1500a3b60 con 0x7fa150133f70 2023-09-30T22:22:04.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.312+0000 7fa157adb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1501348e0 con 0x7fa15009ad40 2023-09-30T22:22:04.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.312+0000 7fa156078700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fa1500a0a70 0x7fa1500a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58128/0 (socket says 172.21.15.156:58128) 2023-09-30T22:22:04.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.312+0000 7fa155877700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa15009ad40 0x7fa150133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:04.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.312+0000 7fa156078700 1 -- 172.21.15.156:0/2421383477 learned_addr learned my addr 172.21.15.156:0/2421383477 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:04.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.312+0000 7fa155076700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa150133f70 0x7fa1501343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:04.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.312+0000 7fa154875700 1 -- 172.21.15.156:0/2421383477 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674549990 0 0) 0x7fa15009b110 con 0x7fa1500a0a70 2023-09-30T22:22:04.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.313+0000 7fa154875700 1 -- 172.21.15.156:0/2421383477 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa13c0035b0 con 0x7fa1500a0a70 2023-09-30T22:22:04.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.313+0000 7fa155877700 1 -- 172.21.15.156:0/2421383477 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa150133f70 msgr2=0x7fa1501343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:04.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.313+0000 7fa155877700 1 --2- 172.21.15.156:0/2421383477 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa150133f70 0x7fa1501343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.313+0000 7fa155877700 1 -- 172.21.15.156:0/2421383477 >> v1:172.21.15.156:6789/0 conn(0x7fa1500a0a70 legacy=0x7fa1500a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:04.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.313+0000 7fa155877700 1 -- 172.21.15.156:0/2421383477 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1500a2fa0 con 0x7fa15009ad40 2023-09-30T22:22:04.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.313+0000 7fa155076700 1 --2- 172.21.15.156:0/2421383477 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa150133f70 0x7fa1501343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:04.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.313+0000 7fa155877700 1 --2- 172.21.15.156:0/2421383477 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa15009ad40 0x7fa150133a30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa14c009870 tx=0x7fa14c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c097cc07596fcbe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:04.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.313+0000 7fa154875700 1 -- 172.21.15.156:0/2421383477 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c011830 con 0x7fa15009ad40 2023-09-30T22:22:04.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.313+0000 7fa154875700 1 -- 172.21.15.156:0/2421383477 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14c011990 con 0x7fa15009ad40 2023-09-30T22:22:04.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.313+0000 7fa154875700 1 -- 172.21.15.156:0/2421383477 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c011d20 con 0x7fa15009ad40 2023-09-30T22:22:04.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.313+0000 7fa157adb700 1 -- 172.21.15.156:0/2421383477 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa15009ad40 msgr2=0x7fa150133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:04.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.313+0000 7fa157adb700 1 --2- 172.21.15.156:0/2421383477 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa15009ad40 0x7fa150133a30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa14c009870 tx=0x7fa14c009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:04.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.314+0000 7fa157adb700 1 -- 172.21.15.156:0/2421383477 shutdown_connections 2023-09-30T22:22:04.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.314+0000 7fa157adb700 1 --2- 172.21.15.156:0/2421383477 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa15009ad40 0x7fa150133a30 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.314+0000 7fa157adb700 1 --2- 172.21.15.156:0/2421383477 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa150133f70 0x7fa1501343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.314+0000 7fa157adb700 1 -- 172.21.15.156:0/2421383477 >> 172.21.15.156:0/2421383477 conn(0x7fa150099c40 msgr2=0x7fa15006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:04.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.314+0000 7fa157adb700 1 -- 172.21.15.156:0/2421383477 shutdown_connections 2023-09-30T22:22:04.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.314+0000 7fa157adb700 1 -- 172.21.15.156:0/2421383477 wait complete. 2023-09-30T22:22:04.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.314+0000 7fa157adb700 1 Processor -- start 2023-09-30T22:22:04.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.315+0000 7fa157adb700 1 -- start start 2023-09-30T22:22:04.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.315+0000 7fa157adb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa15009ad40 0x7fa15011f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:04.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.315+0000 7fa157adb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1500a0a70 0x7fa15011f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:04.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.315+0000 7fa157adb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa150133f70 0x7fa1501c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:04.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.315+0000 7fa157adb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15011ef00 con 0x7fa150133f70 2023-09-30T22:22:04.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.315+0000 7fa157adb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1501333d0 con 0x7fa15009ad40 2023-09-30T22:22:04.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.315+0000 7fa157adb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa150121fc0 con 0x7fa1500a0a70 2023-09-30T22:22:04.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.315+0000 7fa155076700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1500a0a70 0x7fa15011f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:04.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.315+0000 7fa156078700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa150133f70 0x7fa1501c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:04.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.315+0000 7fa155076700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1500a0a70 0x7fa15011f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33556/0 (socket says 172.21.15.156:33556) 2023-09-30T22:22:04.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.315+0000 7fa155076700 1 -- 172.21.15.156:0/1541550344 learned_addr learned my addr 172.21.15.156:0/1541550344 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:04.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.315+0000 7fa155877700 1 --2- 172.21.15.156:0/1541550344 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa15009ad40 0x7fa15011f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:04.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.315+0000 7fa155076700 1 -- 172.21.15.156:0/1541550344 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa15009ad40 msgr2=0x7fa15011f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:04.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.315+0000 7fa155076700 1 --2- 172.21.15.156:0/1541550344 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa15009ad40 0x7fa15011f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.315+0000 7fa155076700 1 -- 172.21.15.156:0/1541550344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa150133f70 msgr2=0x7fa1501c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:04.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.315+0000 7fa155076700 1 --2- 172.21.15.156:0/1541550344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa150133f70 0x7fa1501c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.315+0000 7fa155076700 1 -- 172.21.15.156:0/1541550344 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1400094a0 con 0x7fa1500a0a70 2023-09-30T22:22:04.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.315+0000 7fa156078700 1 --2- 172.21.15.156:0/1541550344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa150133f70 0x7fa1501c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:04.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.316+0000 7fa155076700 1 --2- 172.21.15.156:0/1541550344 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1500a0a70 0x7fa15011f910 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa14000ebb0 tx=0x7fa14000eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:04.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.316+0000 7fa1467fc700 1 -- 172.21.15.156:0/1541550344 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14000c850 con 0x7fa1500a0a70 2023-09-30T22:22:04.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.316+0000 7fa1467fc700 1 -- 172.21.15.156:0/1541550344 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14000c9b0 con 0x7fa1500a0a70 2023-09-30T22:22:04.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.316+0000 7fa1467fc700 1 -- 172.21.15.156:0/1541550344 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14000cd40 con 0x7fa1500a0a70 2023-09-30T22:22:04.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.316+0000 7fa157adb700 1 -- 172.21.15.156:0/1541550344 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa14c0094a0 con 0x7fa1500a0a70 2023-09-30T22:22:04.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.316+0000 7fa157adb700 1 -- 172.21.15.156:0/1541550344 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15009e830 con 0x7fa1500a0a70 2023-09-30T22:22:04.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.316+0000 7fa1467fc700 1 -- 172.21.15.156:0/1541550344 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa140013470 con 0x7fa1500a0a70 2023-09-30T22:22:04.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.317+0000 7fa1467fc700 1 -- 172.21.15.156:0/1541550344 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa14003f770 con 0x7fa1500a0a70 2023-09-30T22:22:04.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.317+0000 7fa157adb700 1 -- 172.21.15.156:0/1541550344 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa15004f2a0 con 0x7fa1500a0a70 2023-09-30T22:22:04.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.321+0000 7fa1467fc700 1 -- 172.21.15.156:0/1541550344 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa140017020 con 0x7fa1500a0a70 2023-09-30T22:22:04.357 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:04.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.397+0000 7f7548797700 1 Processor -- start 2023-09-30T22:22:04.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.397+0000 7f7548797700 1 -- start start 2023-09-30T22:22:04.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.397+0000 7f7548797700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f754009e870 0x7f754009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:04.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.397+0000 7f7548797700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f754009f180 0x7f7540131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:04.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.397+0000 7f7548797700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f754009c970 con 0x7f7540131d70 2023-09-30T22:22:04.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.397+0000 7f7548797700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75400a0920 con 0x7f754009f180 2023-09-30T22:22:04.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.397+0000 7f7548797700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f754009f9c0 con 0x7f754009e870 2023-09-30T22:22:04.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.397+0000 7f7546533700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f754009e870 0x7f754009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:04.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.397+0000 7f7546533700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f754009e870 0x7f754009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33558/0 (socket says 172.21.15.156:33558) 2023-09-30T22:22:04.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.397+0000 7f7546533700 1 -- 172.21.15.156:0/3233647157 learned_addr learned my addr 172.21.15.156:0/3233647157 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:04.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.398+0000 7f7545d32700 1 --2- 172.21.15.156:0/3233647157 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f754009f180 0x7f7540131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:04.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.398+0000 7f7546533700 1 -- 172.21.15.156:0/3233647157 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f754009f180 msgr2=0x7f7540131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:04.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.398+0000 7f7546533700 1 --2- 172.21.15.156:0/3233647157 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f754009f180 0x7f7540131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.398+0000 7f7546533700 1 -- 172.21.15.156:0/3233647157 >> v1:172.21.15.156:6789/0 conn(0x7f7540131d70 legacy=0x7f7540138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:04.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.398+0000 7f7546533700 1 -- 172.21.15.156:0/3233647157 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754009bab0 con 0x7f754009e870 2023-09-30T22:22:04.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.398+0000 7f7545d32700 1 --2- 172.21.15.156:0/3233647157 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f754009f180 0x7f7540131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:04.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.398+0000 7f7546533700 1 --2- 172.21.15.156:0/3233647157 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f754009e870 0x7f754009ec40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f753c009920 tx=0x7f753c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=727d96e25c8542a8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:04.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.398+0000 7f7545531700 1 -- 172.21.15.156:0/3233647157 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c011830 con 0x7f754009e870 2023-09-30T22:22:04.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.398+0000 7f7545531700 1 -- 172.21.15.156:0/3233647157 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753c011990 con 0x7f754009e870 2023-09-30T22:22:04.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.398+0000 7f7545531700 1 -- 172.21.15.156:0/3233647157 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c011d20 con 0x7f754009e870 2023-09-30T22:22:04.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.399+0000 7f7548797700 1 -- 172.21.15.156:0/3233647157 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f754009e870 msgr2=0x7f754009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:04.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.399+0000 7f7548797700 1 --2- 172.21.15.156:0/3233647157 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f754009e870 0x7f754009ec40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f753c009920 tx=0x7f753c009c30 comp rx=0 tx=0).stop 2023-09-30T22:22:04.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.399+0000 7f7548797700 1 -- 172.21.15.156:0/3233647157 shutdown_connections 2023-09-30T22:22:04.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.399+0000 7f7548797700 1 --2- 172.21.15.156:0/3233647157 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f754009e870 0x7f754009ec40 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.399+0000 7f7548797700 1 --2- 172.21.15.156:0/3233647157 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f754009f180 0x7f7540131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.399+0000 7f7548797700 1 -- 172.21.15.156:0/3233647157 >> 172.21.15.156:0/3233647157 conn(0x7f75400a4430 msgr2=0x7f75400a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:04.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.399+0000 7f7548797700 1 -- 172.21.15.156:0/3233647157 shutdown_connections 2023-09-30T22:22:04.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.399+0000 7f7548797700 1 -- 172.21.15.156:0/3233647157 wait complete. 2023-09-30T22:22:04.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.400+0000 7f7548797700 1 Processor -- start 2023-09-30T22:22:04.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.400+0000 7f7548797700 1 -- start start 2023-09-30T22:22:04.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.401+0000 7f7548797700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f754009e870 0x7f754006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:04.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.401+0000 7f7548797700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f754009f180 0x7f754006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:04.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.401+0000 7f7548797700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7540131d70 0x7f754006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:04.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.401+0000 7f7548797700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7540125e00 con 0x7f754009e870 2023-09-30T22:22:04.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.401+0000 7f7548797700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754009b160 con 0x7f754009f180 2023-09-30T22:22:04.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.401+0000 7f7548797700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f754009dba0 con 0x7f7540131d70 2023-09-30T22:22:04.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.401+0000 7f7545d32700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f754009f180 0x7f754006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:04.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.401+0000 7f7546533700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f754009e870 0x7f754006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:04.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.401+0000 7f7545d32700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f754009f180 0x7f754006bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57774/0 (socket says 172.21.15.156:57774) 2023-09-30T22:22:04.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.401+0000 7f7545d32700 1 -- 172.21.15.156:0/3952128069 learned_addr learned my addr 172.21.15.156:0/3952128069 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:04.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.401+0000 7f7546d34700 1 --2- 172.21.15.156:0/3952128069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7540131d70 0x7f754006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:04.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.402+0000 7f7545d32700 1 -- 172.21.15.156:0/3952128069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7540131d70 msgr2=0x7f754006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:04.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.402+0000 7f7545d32700 1 --2- 172.21.15.156:0/3952128069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7540131d70 0x7f754006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.402+0000 7f7545d32700 1 -- 172.21.15.156:0/3952128069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f754009e870 msgr2=0x7f754006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:04.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.402+0000 7f7545d32700 1 --2- 172.21.15.156:0/3952128069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f754009e870 0x7f754006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.402+0000 7f7545d32700 1 -- 172.21.15.156:0/3952128069 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75300094a0 con 0x7f754009f180 2023-09-30T22:22:04.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.402+0000 7f7545d32700 1 --2- 172.21.15.156:0/3952128069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f754009f180 0x7f754006bdf0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f753000ebb0 tx=0x7f753000eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:04.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.402+0000 7f7536ffd700 1 -- 172.21.15.156:0/3952128069 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753000c850 con 0x7f754009f180 2023-09-30T22:22:04.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.402+0000 7f7536ffd700 1 -- 172.21.15.156:0/3952128069 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753000c9b0 con 0x7f754009f180 2023-09-30T22:22:04.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.402+0000 7f7536ffd700 1 -- 172.21.15.156:0/3952128069 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753000cd40 con 0x7f754009f180 2023-09-30T22:22:04.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.402+0000 7f7548797700 1 -- 172.21.15.156:0/3952128069 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f753c009550 con 0x7f754009f180 2023-09-30T22:22:04.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.402+0000 7f7548797700 1 -- 172.21.15.156:0/3952128069 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7540126870 con 0x7f754009f180 2023-09-30T22:22:04.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.403+0000 7f7536ffd700 1 -- 172.21.15.156:0/3952128069 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7530013470 con 0x7f754009f180 2023-09-30T22:22:04.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.403+0000 7f7548797700 1 -- 172.21.15.156:0/3952128069 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f754004f2a0 con 0x7f754009f180 2023-09-30T22:22:04.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.403+0000 7f7536ffd700 1 -- 172.21.15.156:0/3952128069 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f753003f770 con 0x7f754009f180 2023-09-30T22:22:04.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.408+0000 7f7536ffd700 1 -- 172.21.15.156:0/3952128069 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f75300232f0 con 0x7f754009f180 2023-09-30T22:22:04.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.504+0000 7f1f56dfe700 1 Processor -- start 2023-09-30T22:22:04.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.504+0000 7f1f56dfe700 1 -- start start 2023-09-30T22:22:04.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.504+0000 7f1f56dfe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1f5009f430 0x7f1f50136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:04.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.504+0000 7f1f56dfe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f50137010 0x7f1f501393f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:04.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.504+0000 7f1f56dfe700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5009b6d0 con 0x7f1f5009e950 2023-09-30T22:22:04.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.505+0000 7f1f56dfe700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f5009afb0 con 0x7f1f5009f430 2023-09-30T22:22:04.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.505+0000 7f1f56dfe700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f500a0970 con 0x7f1f50137010 2023-09-30T22:22:04.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.505+0000 7f1f4ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1f5009f430 0x7f1f50136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:04.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.505+0000 7f1f5539b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f50137010 0x7f1f501393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:04.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.505+0000 7f1f54b9a700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f1f5009e950 0x7f1f5009ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58142/0 (socket says 172.21.15.156:58142) 2023-09-30T22:22:04.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.505+0000 7f1f54b9a700 1 -- 172.21.15.156:0/204463567 learned_addr learned my addr 172.21.15.156:0/204463567 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:04.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.505+0000 7f1f5539b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f50137010 0x7f1f501393f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33564/0 (socket says 172.21.15.156:33564) 2023-09-30T22:22:04.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.505+0000 7f1f4f7fe700 1 -- 172.21.15.156:0/204463567 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225297689 0 0) 0x7f1f5009b6d0 con 0x7f1f5009e950 2023-09-30T22:22:04.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.505+0000 7f1f4f7fe700 1 -- 172.21.15.156:0/204463567 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f400035b0 con 0x7f1f5009e950 2023-09-30T22:22:04.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.505+0000 7f1f5539b700 1 -- 172.21.15.156:0/204463567 >> v2:172.21.15.156:3300/0 conn(0x7f1f5009f430 msgr2=0x7f1f50136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:04.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.505+0000 7f1f5539b700 1 --2- 172.21.15.156:0/204463567 >> v2:172.21.15.156:3300/0 conn(0x7f1f5009f430 0x7f1f50136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.505+0000 7f1f5539b700 1 -- 172.21.15.156:0/204463567 >> v1:172.21.15.156:6789/0 conn(0x7f1f5009e950 legacy=0x7f1f5009ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:04.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.505+0000 7f1f5539b700 1 -- 172.21.15.156:0/204463567 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f500a0320 con 0x7f1f50137010 2023-09-30T22:22:04.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.505+0000 7f1f5539b700 1 --2- 172.21.15.156:0/204463567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f50137010 0x7f1f501393f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1f48009d90 tx=0x7f1f4800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afbb63bfb03ae43 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:04.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.505+0000 7f1f4f7fe700 1 -- 172.21.15.156:0/204463567 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4800e070 con 0x7f1f50137010 2023-09-30T22:22:04.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.505+0000 7f1f4f7fe700 1 -- 172.21.15.156:0/204463567 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4800bb20 con 0x7f1f50137010 2023-09-30T22:22:04.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.505+0000 7f1f4f7fe700 1 -- 172.21.15.156:0/204463567 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f48012430 con 0x7f1f50137010 2023-09-30T22:22:04.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.506+0000 7f1f56dfe700 1 -- 172.21.15.156:0/204463567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f50137010 msgr2=0x7f1f501393f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:04.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.506+0000 7f1f56dfe700 1 --2- 172.21.15.156:0/204463567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f50137010 0x7f1f501393f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1f48009d90 tx=0x7f1f4800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:04.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.506+0000 7f1f56dfe700 1 -- 172.21.15.156:0/204463567 shutdown_connections 2023-09-30T22:22:04.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.506+0000 7f1f56dfe700 1 --2- 172.21.15.156:0/204463567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f50137010 0x7f1f501393f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.506+0000 7f1f56dfe700 1 --2- 172.21.15.156:0/204463567 >> v2:172.21.15.156:3300/0 conn(0x7f1f5009f430 0x7f1f50136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.506+0000 7f1f56dfe700 1 -- 172.21.15.156:0/204463567 >> 172.21.15.156:0/204463567 conn(0x7f1f500a0f70 msgr2=0x7f1f500a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:04.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.506+0000 7f1f56dfe700 1 -- 172.21.15.156:0/204463567 shutdown_connections 2023-09-30T22:22:04.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.506+0000 7f1f56dfe700 1 -- 172.21.15.156:0/204463567 wait complete. 2023-09-30T22:22:04.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.507+0000 7f1f56dfe700 1 Processor -- start 2023-09-30T22:22:04.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.507+0000 7f1f56dfe700 1 -- start start 2023-09-30T22:22:04.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.508+0000 7f1f56dfe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f5009e950 0x7f1f5011f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:04.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.508+0000 7f1f56dfe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f5009f430 0x7f1f5011f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:04.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.508+0000 7f1f56dfe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f50137010 0x7f1f5011fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:04.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.508+0000 7f1f56dfe700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f50121060 con 0x7f1f5009e950 2023-09-30T22:22:04.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.508+0000 7f1f56dfe700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f50122f70 con 0x7f1f50137010 2023-09-30T22:22:04.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.508+0000 7f1f56dfe700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f50122320 con 0x7f1f5009f430 2023-09-30T22:22:04.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.508+0000 7f1f54b9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f5009e950 0x7f1f5011f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:04.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.508+0000 7f1f54b9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f5009e950 0x7f1f5011f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47114/0 (socket says 172.21.15.156:47114) 2023-09-30T22:22:04.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.508+0000 7f1f54b9a700 1 -- 172.21.15.156:0/1379015555 learned_addr learned my addr 172.21.15.156:0/1379015555 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:04.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.508+0000 7f1f4ffff700 1 --2- 172.21.15.156:0/1379015555 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f5009f430 0x7f1f5011f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:04.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.508+0000 7f1f5539b700 1 --2- 172.21.15.156:0/1379015555 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f50137010 0x7f1f5011fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:04.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.509+0000 7f1f54b9a700 1 -- 172.21.15.156:0/1379015555 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f5009f430 msgr2=0x7f1f5011f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:04.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.509+0000 7f1f54b9a700 1 --2- 172.21.15.156:0/1379015555 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f5009f430 0x7f1f5011f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.509+0000 7f1f54b9a700 1 -- 172.21.15.156:0/1379015555 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f50137010 msgr2=0x7f1f5011fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:04.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.509+0000 7f1f54b9a700 1 --2- 172.21.15.156:0/1379015555 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f50137010 0x7f1f5011fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.509+0000 7f1f54b9a700 1 -- 172.21.15.156:0/1379015555 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f48009a70 con 0x7f1f5009e950 2023-09-30T22:22:04.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.509+0000 7f1f54b9a700 1 --2- 172.21.15.156:0/1379015555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f5009e950 0x7f1f5011f450 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f1f44001260 tx=0x7f1f4400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:04.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.509+0000 7f1f4d7fa700 1 -- 172.21.15.156:0/1379015555 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f440074e0 con 0x7f1f5009e950 2023-09-30T22:22:04.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.509+0000 7f1f4d7fa700 1 -- 172.21.15.156:0/1379015555 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f44007640 con 0x7f1f5009e950 2023-09-30T22:22:04.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.509+0000 7f1f4d7fa700 1 -- 172.21.15.156:0/1379015555 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f44005a30 con 0x7f1f5009e950 2023-09-30T22:22:04.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.509+0000 7f1f56dfe700 1 -- 172.21.15.156:0/1379015555 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f500a4c80 con 0x7f1f5009e950 2023-09-30T22:22:04.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.509+0000 7f1f56dfe700 1 -- 172.21.15.156:0/1379015555 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f50122c90 con 0x7f1f5009e950 2023-09-30T22:22:04.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.510+0000 7f1f4d7fa700 1 -- 172.21.15.156:0/1379015555 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f44005b90 con 0x7f1f5009e950 2023-09-30T22:22:04.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.510+0000 7f1f56dfe700 1 -- 172.21.15.156:0/1379015555 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f5004f2a0 con 0x7f1f5009e950 2023-09-30T22:22:04.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.510+0000 7f1f4d7fa700 1 -- 172.21.15.156:0/1379015555 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1f4403eaf0 con 0x7f1f5009e950 2023-09-30T22:22:04.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.519+0000 7f1f4d7fa700 1 -- 172.21.15.156:0/1379015555 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f4401b3b0 con 0x7f1f5009e950 2023-09-30T22:22:04.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.527+0000 7fa157adb700 1 -- 172.21.15.156:0/1541550344 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa150120650 con 0x7fa1500a0a70 2023-09-30T22:22:04.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.527+0000 7fa1467fc700 1 -- 172.21.15.156:0/1541550344 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa1400232f0 con 0x7fa1500a0a70 2023-09-30T22:22:04.528 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:04.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.529+0000 7fa157adb700 1 -- 172.21.15.156:0/1541550344 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1500a0a70 msgr2=0x7fa15011f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:04.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.529+0000 7fa157adb700 1 --2- 172.21.15.156:0/1541550344 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1500a0a70 0x7fa15011f910 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa14000ebb0 tx=0x7fa14000eec0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.529+0000 7fa157adb700 1 -- 172.21.15.156:0/1541550344 shutdown_connections 2023-09-30T22:22:04.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.529+0000 7fa157adb700 1 --2- 172.21.15.156:0/1541550344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa150133f70 0x7fa1501c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.529+0000 7fa157adb700 1 --2- 172.21.15.156:0/1541550344 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa15009ad40 0x7fa15011f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.529+0000 7fa157adb700 1 --2- 172.21.15.156:0/1541550344 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1500a0a70 0x7fa15011f910 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.529+0000 7fa157adb700 1 -- 172.21.15.156:0/1541550344 >> 172.21.15.156:0/1541550344 conn(0x7fa150099c40 msgr2=0x7fa1501bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:04.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.529+0000 7fa157adb700 1 -- 172.21.15.156:0/1541550344 shutdown_connections 2023-09-30T22:22:04.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.529+0000 7fa157adb700 1 -- 172.21.15.156:0/1541550344 wait complete. 2023-09-30T22:22:04.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:04.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.630+0000 7f7548797700 1 -- 172.21.15.156:0/3952128069 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7540131b50 con 0x7f754009f180 2023-09-30T22:22:04.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.631+0000 7f7536ffd700 1 -- 172.21.15.156:0/3952128069 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7530021070 con 0x7f754009f180 2023-09-30T22:22:04.631 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:04.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.633+0000 7f7548797700 1 -- 172.21.15.156:0/3952128069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f754009f180 msgr2=0x7f754006bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:04.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.633+0000 7f7548797700 1 --2- 172.21.15.156:0/3952128069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f754009f180 0x7f754006bdf0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f753000ebb0 tx=0x7f753000eec0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.633+0000 7f7548797700 1 -- 172.21.15.156:0/3952128069 shutdown_connections 2023-09-30T22:22:04.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.633+0000 7f7548797700 1 --2- 172.21.15.156:0/3952128069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7540131d70 0x7f754006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.633+0000 7f7548797700 1 --2- 172.21.15.156:0/3952128069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f754009e870 0x7f754006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.633+0000 7f7548797700 1 --2- 172.21.15.156:0/3952128069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f754009f180 0x7f754006bdf0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.633+0000 7f7548797700 1 -- 172.21.15.156:0/3952128069 >> 172.21.15.156:0/3952128069 conn(0x7f75400a4430 msgr2=0x7f754006fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:04.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.633+0000 7f7548797700 1 -- 172.21.15.156:0/3952128069 shutdown_connections 2023-09-30T22:22:04.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.633+0000 7f7548797700 1 -- 172.21.15.156:0/3952128069 wait complete. 2023-09-30T22:22:04.645 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:04.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.711+0000 7f1f56dfe700 1 -- 172.21.15.156:0/1379015555 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1f5009b8b0 con 0x7f1f5009e950 2023-09-30T22:22:04.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.711+0000 7f1f4d7fa700 1 -- 172.21.15.156:0/1379015555 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f44019ae0 con 0x7f1f5009e950 2023-09-30T22:22:04.712 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:04.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.713+0000 7f1f56dfe700 1 -- 172.21.15.156:0/1379015555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f5009e950 msgr2=0x7f1f5011f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:04.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.713+0000 7f1f56dfe700 1 --2- 172.21.15.156:0/1379015555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f5009e950 0x7f1f5011f450 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f1f44001260 tx=0x7f1f4400c9e0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.713+0000 7f1f56dfe700 1 -- 172.21.15.156:0/1379015555 shutdown_connections 2023-09-30T22:22:04.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.713+0000 7f1f56dfe700 1 --2- 172.21.15.156:0/1379015555 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f50137010 0x7f1f5011fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.713+0000 7f1f56dfe700 1 --2- 172.21.15.156:0/1379015555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f5009e950 0x7f1f5011f450 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.713+0000 7f1f56dfe700 1 --2- 172.21.15.156:0/1379015555 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f5009f430 0x7f1f5011f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.713+0000 7f1f56dfe700 1 -- 172.21.15.156:0/1379015555 >> 172.21.15.156:0/1379015555 conn(0x7f1f500a0f70 msgr2=0x7f1f50135ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:04.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.713+0000 7f1f56dfe700 1 -- 172.21.15.156:0/1379015555 shutdown_connections 2023-09-30T22:22:04.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:04.713+0000 7f1f56dfe700 1 -- 172.21.15.156:0/1379015555 wait complete. 2023-09-30T22:22:04.726 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:05.101 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:05.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.224+0000 7f0b4833d700 1 Processor -- start 2023-09-30T22:22:05.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.224+0000 7f0b4833d700 1 -- start start 2023-09-30T22:22:05.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.225+0000 7f0b4833d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b40131980 0x7f0b40131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:05.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.225+0000 7f0b4833d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b4009bc70 0x7f0b4009c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:05.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.225+0000 7f0b4833d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0b4009c5c0 0x7f0b40138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:05.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.225+0000 7f0b4833d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b4006eb30 con 0x7f0b4009c5c0 2023-09-30T22:22:05.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.225+0000 7f0b4833d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b400a1640 con 0x7f0b40131980 2023-09-30T22:22:05.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.225+0000 7f0b4833d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b400a22d0 con 0x7f0b4009bc70 2023-09-30T22:22:05.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.225+0000 7f0b460d9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b40131980 0x7f0b40131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:05.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.225+0000 7f0b458d8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b4009bc70 0x7f0b4009c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:05.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.225+0000 7f0b468da700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0b4009c5c0 0x7f0b40138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:05.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.225+0000 7f0b460d9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b40131980 0x7f0b40131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57796/0 (socket says 172.21.15.156:57796) 2023-09-30T22:22:05.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.225+0000 7f0b460d9700 1 -- 172.21.15.156:0/1691622582 learned_addr learned my addr 172.21.15.156:0/1691622582 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:05.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.225+0000 7f0b458d8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b4009bc70 0x7f0b4009c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33584/0 (socket says 172.21.15.156:33584) 2023-09-30T22:22:05.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.225+0000 7f0b460d9700 1 -- 172.21.15.156:0/1691622582 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b4009bc70 msgr2=0x7f0b4009c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:05.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.225+0000 7f0b460d9700 1 --2- 172.21.15.156:0/1691622582 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b4009bc70 0x7f0b4009c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.225+0000 7f0b460d9700 1 -- 172.21.15.156:0/1691622582 >> v2:172.21.15.156:3300/0 conn(0x7f0b4009c5c0 msgr2=0x7f0b40138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:05.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.225+0000 7f0b460d9700 1 --2- 172.21.15.156:0/1691622582 >> v2:172.21.15.156:3300/0 conn(0x7f0b4009c5c0 0x7f0b40138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.225+0000 7f0b460d9700 1 -- 172.21.15.156:0/1691622582 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b40131550 con 0x7f0b40131980 2023-09-30T22:22:05.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.225+0000 7f0b458d8700 1 --2- 172.21.15.156:0/1691622582 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b4009bc70 0x7f0b4009c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:05.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.225+0000 7f0b468da700 1 --2- 172.21.15.156:0/1691622582 >> v2:172.21.15.156:3300/0 conn(0x7f0b4009c5c0 0x7f0b40138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:05.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.225+0000 7f0b460d9700 1 --2- 172.21.15.156:0/1691622582 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b40131980 0x7f0b40131d50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0b30006fd0 tx=0x7f0b30009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=689c8e04d9ef0e59 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:05.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.226+0000 7f0b450d7700 1 -- 172.21.15.156:0/1691622582 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b30005e30 con 0x7f0b40131980 2023-09-30T22:22:05.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.226+0000 7f0b450d7700 1 -- 172.21.15.156:0/1691622582 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b30004030 con 0x7f0b40131980 2023-09-30T22:22:05.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.226+0000 7f0b450d7700 1 -- 172.21.15.156:0/1691622582 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b300043e0 con 0x7f0b40131980 2023-09-30T22:22:05.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.226+0000 7f0b4833d700 1 -- 172.21.15.156:0/1691622582 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b40131980 msgr2=0x7f0b40131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.226+0000 7f0b4833d700 1 --2- 172.21.15.156:0/1691622582 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b40131980 0x7f0b40131d50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0b30006fd0 tx=0x7f0b30009bd0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.226+0000 7f0b4833d700 1 -- 172.21.15.156:0/1691622582 shutdown_connections 2023-09-30T22:22:05.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.226+0000 7f0b4833d700 1 --2- 172.21.15.156:0/1691622582 >> v2:172.21.15.156:3300/0 conn(0x7f0b4009c5c0 0x7f0b40138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.226+0000 7f0b4833d700 1 --2- 172.21.15.156:0/1691622582 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b40131980 0x7f0b40131d50 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.226+0000 7f0b4833d700 1 --2- 172.21.15.156:0/1691622582 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b4009bc70 0x7f0b4009c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.226+0000 7f0b4833d700 1 -- 172.21.15.156:0/1691622582 >> 172.21.15.156:0/1691622582 conn(0x7f0b400a2980 msgr2=0x7f0b400a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:05.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.226+0000 7f0b4833d700 1 -- 172.21.15.156:0/1691622582 shutdown_connections 2023-09-30T22:22:05.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.226+0000 7f0b4833d700 1 -- 172.21.15.156:0/1691622582 wait complete. 2023-09-30T22:22:05.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.227+0000 7f0b4833d700 1 Processor -- start 2023-09-30T22:22:05.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.227+0000 7f0b4833d700 1 -- start start 2023-09-30T22:22:05.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.228+0000 7f0b4833d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b4009bc70 0x7f0b401c0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:05.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.228+0000 7f0b4833d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b4009c5c0 0x7f0b401c1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:05.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.228+0000 7f0b4833d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b40131980 0x7f0b401c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:05.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.228+0000 7f0b4833d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4011eec0 con 0x7f0b4009c5c0 2023-09-30T22:22:05.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.228+0000 7f0b4833d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4011e400 con 0x7f0b40131980 2023-09-30T22:22:05.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.228+0000 7f0b4833d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b401c1750 con 0x7f0b4009bc70 2023-09-30T22:22:05.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.228+0000 7f0b458d8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b4009c5c0 0x7f0b401c1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:05.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.228+0000 7f0b460d9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b4009bc70 0x7f0b401c0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:05.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.228+0000 7f0b468da700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b40131980 0x7f0b401c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:05.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.228+0000 7f0b460d9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b4009bc70 0x7f0b401c0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33592/0 (socket says 172.21.15.156:33592) 2023-09-30T22:22:05.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.228+0000 7f0b458d8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b4009c5c0 0x7f0b401c1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47136/0 (socket says 172.21.15.156:47136) 2023-09-30T22:22:05.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.228+0000 7f0b460d9700 1 -- 172.21.15.156:0/3801956992 learned_addr learned my addr 172.21.15.156:0/3801956992 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:05.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.228+0000 7f0b468da700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b40131980 0x7f0b401c3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57812/0 (socket says 172.21.15.156:57812) 2023-09-30T22:22:05.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.228+0000 7f0b468da700 1 -- 172.21.15.156:0/3801956992 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b4009bc70 msgr2=0x7f0b401c0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.228+0000 7f0b468da700 1 --2- 172.21.15.156:0/3801956992 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b4009bc70 0x7f0b401c0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.228+0000 7f0b468da700 1 -- 172.21.15.156:0/3801956992 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b4009c5c0 msgr2=0x7f0b401c1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.228+0000 7f0b468da700 1 --2- 172.21.15.156:0/3801956992 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b4009c5c0 0x7f0b401c1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.228+0000 7f0b468da700 1 -- 172.21.15.156:0/3801956992 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3c00d940 con 0x7f0b40131980 2023-09-30T22:22:05.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.228+0000 7f0b458d8700 1 --2- 172.21.15.156:0/3801956992 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b4009c5c0 0x7f0b401c1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:05.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.228+0000 7f0b460d9700 1 --2- 172.21.15.156:0/3801956992 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b4009bc70 0x7f0b401c0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:05.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.228+0000 7f0b468da700 1 --2- 172.21.15.156:0/3801956992 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b40131980 0x7f0b401c3cf0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800efc0 tx=0x7f0b3800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:05.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.228+0000 7f0b36ffd700 1 -- 172.21.15.156:0/3801956992 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3800cc90 con 0x7f0b40131980 2023-09-30T22:22:05.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.228+0000 7f0b36ffd700 1 -- 172.21.15.156:0/3801956992 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3800f040 con 0x7f0b40131980 2023-09-30T22:22:05.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.228+0000 7f0b4833d700 1 -- 172.21.15.156:0/3801956992 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b38009a70 con 0x7f0b40131980 2023-09-30T22:22:05.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.228+0000 7f0b36ffd700 1 -- 172.21.15.156:0/3801956992 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b38014480 con 0x7f0b40131980 2023-09-30T22:22:05.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.228+0000 7f0b4833d700 1 -- 172.21.15.156:0/3801956992 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b30009500 con 0x7f0b40131980 2023-09-30T22:22:05.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.229+0000 7f0b36ffd700 1 -- 172.21.15.156:0/3801956992 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b38014600 con 0x7f0b40131980 2023-09-30T22:22:05.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.229+0000 7f0b36ffd700 1 -- 172.21.15.156:0/3801956992 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0b3803feb0 con 0x7f0b40131980 2023-09-30T22:22:05.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.229+0000 7f0b4833d700 1 -- 172.21.15.156:0/3801956992 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b4004f2a0 con 0x7f0b40131980 2023-09-30T22:22:05.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.234+0000 7f0b36ffd700 1 -- 172.21.15.156:0/3801956992 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b38018080 con 0x7f0b40131980 2023-09-30T22:22:05.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.418+0000 7f0b4833d700 1 -- 172.21.15.156:0/3801956992 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0b4011ea60 con 0x7f0b40131980 2023-09-30T22:22:05.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.419+0000 7f0b36ffd700 1 -- 172.21.15.156:0/3801956992 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0b38011680 con 0x7f0b40131980 2023-09-30T22:22:05.419 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:05.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.421+0000 7f0b4833d700 1 -- 172.21.15.156:0/3801956992 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b40131980 msgr2=0x7f0b401c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.421+0000 7f0b4833d700 1 --2- 172.21.15.156:0/3801956992 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b40131980 0x7f0b401c3cf0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800efc0 tx=0x7f0b3800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.421+0000 7f0b4833d700 1 -- 172.21.15.156:0/3801956992 shutdown_connections 2023-09-30T22:22:05.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.421+0000 7f0b4833d700 1 --2- 172.21.15.156:0/3801956992 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b40131980 0x7f0b401c3cf0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.421+0000 7f0b4833d700 1 --2- 172.21.15.156:0/3801956992 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b4009bc70 0x7f0b401c0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.421+0000 7f0b4833d700 1 --2- 172.21.15.156:0/3801956992 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b4009c5c0 0x7f0b401c1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.421+0000 7f0b4833d700 1 -- 172.21.15.156:0/3801956992 >> 172.21.15.156:0/3801956992 conn(0x7f0b400a2980 msgr2=0x7f0b4009fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:05.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.421+0000 7f0b4833d700 1 -- 172.21.15.156:0/3801956992 shutdown_connections 2023-09-30T22:22:05.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.421+0000 7f0b4833d700 1 -- 172.21.15.156:0/3801956992 wait complete. 2023-09-30T22:22:05.433 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:05.543 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:05.646 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:05.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.665+0000 7fdb04520700 1 Processor -- start 2023-09-30T22:22:05.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.665+0000 7fdb04520700 1 -- start start 2023-09-30T22:22:05.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.666+0000 7fdb04520700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdafc133ad0 0x7fdafc133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:05.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.666+0000 7fdb04520700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdafc1300a0 0x7fdafc1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:05.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.666+0000 7fdb04520700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdafc06b2d0 con 0x7fdafc1309f0 2023-09-30T22:22:05.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.666+0000 7fdb04520700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc133610 con 0x7fdafc1300a0 2023-09-30T22:22:05.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.666+0000 7fdb04520700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc09a500 con 0x7fdafc133ad0 2023-09-30T22:22:05.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.666+0000 7fdb022bc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdafc133ad0 0x7fdafc133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:05.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.666+0000 7fdb01abb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdafc1300a0 0x7fdafc1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:05.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.666+0000 7fdb022bc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdafc133ad0 0x7fdafc133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33594/0 (socket says 172.21.15.156:33594) 2023-09-30T22:22:05.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.666+0000 7fdb022bc700 1 -- 172.21.15.156:0/1459821118 learned_addr learned my addr 172.21.15.156:0/1459821118 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:05.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.666+0000 7fdb01abb700 1 -- 172.21.15.156:0/1459821118 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdafc133ad0 msgr2=0x7fdafc133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:05.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.666+0000 7fdb01abb700 1 --2- 172.21.15.156:0/1459821118 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdafc133ad0 0x7fdafc133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.666+0000 7fdb01abb700 1 -- 172.21.15.156:0/1459821118 >> v1:172.21.15.156:6789/0 conn(0x7fdafc1309f0 legacy=0x7fdafc13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.666+0000 7fdb01abb700 1 -- 172.21.15.156:0/1459821118 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdafc1338b0 con 0x7fdafc1300a0 2023-09-30T22:22:05.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.666+0000 7fdb022bc700 1 --2- 172.21.15.156:0/1459821118 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdafc133ad0 0x7fdafc133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:05.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.667+0000 7fdb01abb700 1 --2- 172.21.15.156:0/1459821118 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdafc1300a0 0x7fdafc1304b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009870 tx=0x7fdaec009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f013a23771c5066 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:05.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.667+0000 7fdb012ba700 1 -- 172.21.15.156:0/1459821118 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec011830 con 0x7fdafc1300a0 2023-09-30T22:22:05.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.667+0000 7fdb012ba700 1 -- 172.21.15.156:0/1459821118 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaec011990 con 0x7fdafc1300a0 2023-09-30T22:22:05.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.667+0000 7fdb012ba700 1 -- 172.21.15.156:0/1459821118 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec011d20 con 0x7fdafc1300a0 2023-09-30T22:22:05.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.667+0000 7fdb04520700 1 -- 172.21.15.156:0/1459821118 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdafc1300a0 msgr2=0x7fdafc1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.667+0000 7fdb04520700 1 --2- 172.21.15.156:0/1459821118 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdafc1300a0 0x7fdafc1304b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009870 tx=0x7fdaec009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:05.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.668+0000 7fdb04520700 1 -- 172.21.15.156:0/1459821118 shutdown_connections 2023-09-30T22:22:05.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.668+0000 7fdb04520700 1 --2- 172.21.15.156:0/1459821118 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdafc133ad0 0x7fdafc133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.668+0000 7fdb04520700 1 --2- 172.21.15.156:0/1459821118 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdafc1300a0 0x7fdafc1304b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.668+0000 7fdb04520700 1 -- 172.21.15.156:0/1459821118 >> 172.21.15.156:0/1459821118 conn(0x7fdafc099c40 msgr2=0x7fdafc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:05.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.668+0000 7fdb04520700 1 -- 172.21.15.156:0/1459821118 shutdown_connections 2023-09-30T22:22:05.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.668+0000 7fdb04520700 1 -- 172.21.15.156:0/1459821118 wait complete. 2023-09-30T22:22:05.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.669+0000 7fdb04520700 1 Processor -- start 2023-09-30T22:22:05.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.669+0000 7fdb04520700 1 -- start start 2023-09-30T22:22:05.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.669+0000 7fdb04520700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdafc1300a0 0x7fdafc11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:05.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.669+0000 7fdb04520700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdafc1309f0 0x7fdafc11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:05.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.669+0000 7fdb04520700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdafc133ad0 0x7fdafc11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:05.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.669+0000 7fdb04520700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc12d710 con 0x7fdafc133ad0 2023-09-30T22:22:05.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.669+0000 7fdb04520700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc11ff40 con 0x7fdafc1309f0 2023-09-30T22:22:05.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.669+0000 7fdb04520700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc12dd00 con 0x7fdafc1300a0 2023-09-30T22:22:05.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.669+0000 7fdb01abb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdafc1309f0 0x7fdafc11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:05.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.669+0000 7fdb022bc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdafc1300a0 0x7fdafc11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:05.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.669+0000 7fdb022bc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdafc1300a0 0x7fdafc11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33606/0 (socket says 172.21.15.156:33606) 2023-09-30T22:22:05.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.669+0000 7fdb01abb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdafc1309f0 0x7fdafc11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57822/0 (socket says 172.21.15.156:57822) 2023-09-30T22:22:05.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.669+0000 7fdb022bc700 1 -- 172.21.15.156:0/3607496987 learned_addr learned my addr 172.21.15.156:0/3607496987 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:05.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.669+0000 7fdb02abd700 1 --2- 172.21.15.156:0/3607496987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdafc133ad0 0x7fdafc11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:05.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.670+0000 7fdb01abb700 1 -- 172.21.15.156:0/3607496987 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdafc1300a0 msgr2=0x7fdafc11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.670+0000 7fdb01abb700 1 --2- 172.21.15.156:0/3607496987 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdafc1300a0 0x7fdafc11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.670+0000 7fdb01abb700 1 -- 172.21.15.156:0/3607496987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdafc133ad0 msgr2=0x7fdafc11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.670+0000 7fdb01abb700 1 --2- 172.21.15.156:0/3607496987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdafc133ad0 0x7fdafc11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.670+0000 7fdb01abb700 1 -- 172.21.15.156:0/3607496987 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf8009550 con 0x7fdafc1309f0 2023-09-30T22:22:05.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.670+0000 7fdb022bc700 1 --2- 172.21.15.156:0/3607496987 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdafc1300a0 0x7fdafc11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:05.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.670+0000 7fdb01abb700 1 --2- 172.21.15.156:0/3607496987 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdafc1309f0 0x7fdafc11df80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fdaec016000 tx=0x7fdaec004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:05.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.670+0000 7fdaf2ffd700 1 -- 172.21.15.156:0/3607496987 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec004510 con 0x7fdafc1309f0 2023-09-30T22:22:05.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.670+0000 7fdaf2ffd700 1 -- 172.21.15.156:0/3607496987 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaec01e070 con 0x7fdafc1309f0 2023-09-30T22:22:05.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.670+0000 7fdb04520700 1 -- 172.21.15.156:0/3607496987 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaec0094a0 con 0x7fdafc1309f0 2023-09-30T22:22:05.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.670+0000 7fdaf2ffd700 1 -- 172.21.15.156:0/3607496987 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec0038a0 con 0x7fdafc1309f0 2023-09-30T22:22:05.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.670+0000 7fdb04520700 1 -- 172.21.15.156:0/3607496987 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdafc12fd40 con 0x7fdafc1309f0 2023-09-30T22:22:05.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.671+0000 7fdaf2ffd700 1 -- 172.21.15.156:0/3607496987 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdaec003a00 con 0x7fdafc1309f0 2023-09-30T22:22:05.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.671+0000 7fdaf2ffd700 1 -- 172.21.15.156:0/3607496987 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdaec020070 con 0x7fdafc1309f0 2023-09-30T22:22:05.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.671+0000 7fdb04520700 1 -- 172.21.15.156:0/3607496987 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdafc0723b0 con 0x7fdafc1309f0 2023-09-30T22:22:05.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.676+0000 7fdaf2ffd700 1 -- 172.21.15.156:0/3607496987 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdaec02a080 con 0x7fdafc1309f0 2023-09-30T22:22:05.726 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:05.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.773+0000 7f2e59640700 1 Processor -- start 2023-09-30T22:22:05.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.773+0000 7f2e59640700 1 -- start start 2023-09-30T22:22:05.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.773+0000 7f2e59640700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e54133ad0 0x7f2e54133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:05.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.773+0000 7f2e59640700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e541300a0 0x7f2e541304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:05.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.773+0000 7f2e59640700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2e541309f0 0x7f2e5413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:05.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.773+0000 7f2e59640700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e5406b2d0 con 0x7f2e541309f0 2023-09-30T22:22:05.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.774+0000 7f2e59640700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e54133610 con 0x7f2e541300a0 2023-09-30T22:22:05.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.774+0000 7f2e59640700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5409a500 con 0x7f2e54133ad0 2023-09-30T22:22:05.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.774+0000 7f2e527fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e541300a0 0x7f2e541304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:05.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.774+0000 7f2e537fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2e541309f0 0x7f2e5413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:05.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.774+0000 7f2e52ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e54133ad0 0x7f2e54133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:05.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.774+0000 7f2e537fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2e541309f0 0x7f2e5413a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47148/0 (socket says 172.21.15.156:47148) 2023-09-30T22:22:05.775 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.774+0000 7f2e537fe700 1 -- 172.21.15.156:0/759427384 learned_addr learned my addr 172.21.15.156:0/759427384 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:05.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.774+0000 7f2e52ffd700 1 -- 172.21.15.156:0/759427384 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e541300a0 msgr2=0x7f2e541304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:05.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.774+0000 7f2e52ffd700 1 --2- 172.21.15.156:0/759427384 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e541300a0 0x7f2e541304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.774+0000 7f2e52ffd700 1 -- 172.21.15.156:0/759427384 >> v2:172.21.15.156:3300/0 conn(0x7f2e541309f0 msgr2=0x7f2e5413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:05.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.774+0000 7f2e52ffd700 1 --2- 172.21.15.156:0/759427384 >> v2:172.21.15.156:3300/0 conn(0x7f2e541309f0 0x7f2e5413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.774+0000 7f2e52ffd700 1 -- 172.21.15.156:0/759427384 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e541338b0 con 0x7f2e54133ad0 2023-09-30T22:22:05.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.774+0000 7f2e527fc700 1 --2- 172.21.15.156:0/759427384 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e541300a0 0x7f2e541304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:05.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.774+0000 7f2e52ffd700 1 --2- 172.21.15.156:0/759427384 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e54133ad0 0x7f2e54133ea0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2e44009840 tx=0x7f2e44009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81457e30edab9ba9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:05.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.774+0000 7f2e51ffb700 1 -- 172.21.15.156:0/759427384 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e44011830 con 0x7f2e54133ad0 2023-09-30T22:22:05.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.775+0000 7f2e51ffb700 1 -- 172.21.15.156:0/759427384 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e44011990 con 0x7f2e54133ad0 2023-09-30T22:22:05.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.775+0000 7f2e51ffb700 1 -- 172.21.15.156:0/759427384 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e44011d20 con 0x7f2e54133ad0 2023-09-30T22:22:05.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.775+0000 7f2e59640700 1 -- 172.21.15.156:0/759427384 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e54133ad0 msgr2=0x7f2e54133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.775+0000 7f2e59640700 1 --2- 172.21.15.156:0/759427384 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e54133ad0 0x7f2e54133ea0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2e44009840 tx=0x7f2e44009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:05.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.775+0000 7f2e59640700 1 -- 172.21.15.156:0/759427384 shutdown_connections 2023-09-30T22:22:05.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.775+0000 7f2e59640700 1 --2- 172.21.15.156:0/759427384 >> v2:172.21.15.156:3300/0 conn(0x7f2e541309f0 0x7f2e5413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.775+0000 7f2e59640700 1 --2- 172.21.15.156:0/759427384 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e54133ad0 0x7f2e54133ea0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.775+0000 7f2e59640700 1 --2- 172.21.15.156:0/759427384 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e541300a0 0x7f2e541304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.775+0000 7f2e59640700 1 -- 172.21.15.156:0/759427384 >> 172.21.15.156:0/759427384 conn(0x7f2e54099c40 msgr2=0x7f2e540a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:05.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.775+0000 7f2e59640700 1 -- 172.21.15.156:0/759427384 shutdown_connections 2023-09-30T22:22:05.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.775+0000 7f2e59640700 1 -- 172.21.15.156:0/759427384 wait complete. 2023-09-30T22:22:05.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.776+0000 7f2e59640700 1 Processor -- start 2023-09-30T22:22:05.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.776+0000 7f2e59640700 1 -- start start 2023-09-30T22:22:05.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.777+0000 7f2e59640700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e541300a0 0x7f2e54071240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:05.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.777+0000 7f2e59640700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e541309f0 0x7f2e54071780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:05.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.777+0000 7f2e59640700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e54133ad0 0x7f2e54071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:05.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.777+0000 7f2e59640700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e54119a60 con 0x7f2e541300a0 2023-09-30T22:22:05.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.777+0000 7f2e59640700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5411a2f0 con 0x7f2e541309f0 2023-09-30T22:22:05.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.777+0000 7f2e59640700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5412fcd0 con 0x7f2e54133ad0 2023-09-30T22:22:05.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.777+0000 7f2e527fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e541309f0 0x7f2e54071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:05.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.777+0000 7f2e527fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e541309f0 0x7f2e54071780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57838/0 (socket says 172.21.15.156:57838) 2023-09-30T22:22:05.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.777+0000 7f2e527fc700 1 -- 172.21.15.156:0/2943348235 learned_addr learned my addr 172.21.15.156:0/2943348235 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:05.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.777+0000 7f2e537fe700 1 --2- 172.21.15.156:0/2943348235 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e54133ad0 0x7f2e54071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:05.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.777+0000 7f2e52ffd700 1 --2- 172.21.15.156:0/2943348235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e541300a0 0x7f2e54071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:05.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.777+0000 7f2e527fc700 1 -- 172.21.15.156:0/2943348235 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e54133ad0 msgr2=0x7f2e54071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.777+0000 7f2e527fc700 1 --2- 172.21.15.156:0/2943348235 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e54133ad0 0x7f2e54071cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.777+0000 7f2e527fc700 1 -- 172.21.15.156:0/2943348235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e541300a0 msgr2=0x7f2e54071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.777+0000 7f2e527fc700 1 --2- 172.21.15.156:0/2943348235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e541300a0 0x7f2e54071240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.777+0000 7f2e527fc700 1 -- 172.21.15.156:0/2943348235 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e480094a0 con 0x7f2e541309f0 2023-09-30T22:22:05.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.777+0000 7f2e537fe700 1 --2- 172.21.15.156:0/2943348235 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e54133ad0 0x7f2e54071cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:05.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.777+0000 7f2e527fc700 1 --2- 172.21.15.156:0/2943348235 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e541309f0 0x7f2e54071780 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800ebb0 tx=0x7f2e4800eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:05.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.778+0000 7f2e3b7fe700 1 -- 172.21.15.156:0/2943348235 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4800c850 con 0x7f2e541309f0 2023-09-30T22:22:05.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.778+0000 7f2e3b7fe700 1 -- 172.21.15.156:0/2943348235 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4800c9b0 con 0x7f2e541309f0 2023-09-30T22:22:05.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.778+0000 7f2e3b7fe700 1 -- 172.21.15.156:0/2943348235 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4800cd40 con 0x7f2e541309f0 2023-09-30T22:22:05.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.778+0000 7f2e59640700 1 -- 172.21.15.156:0/2943348235 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e440094a0 con 0x7f2e541309f0 2023-09-30T22:22:05.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.778+0000 7f2e59640700 1 -- 172.21.15.156:0/2943348235 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e5411acb0 con 0x7f2e541309f0 2023-09-30T22:22:05.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.779+0000 7f2e3b7fe700 1 -- 172.21.15.156:0/2943348235 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e48013470 con 0x7f2e541309f0 2023-09-30T22:22:05.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.779+0000 7f2e3b7fe700 1 -- 172.21.15.156:0/2943348235 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2e4803fac0 con 0x7f2e541309f0 2023-09-30T22:22:05.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.779+0000 7f2e59640700 1 -- 172.21.15.156:0/2943348235 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e5409cb20 con 0x7f2e541309f0 2023-09-30T22:22:05.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.784+0000 7f2e3b7fe700 1 -- 172.21.15.156:0/2943348235 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e4801b3b0 con 0x7f2e541309f0 2023-09-30T22:22:05.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.852+0000 7fa78fbe4700 1 Processor -- start 2023-09-30T22:22:05.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.852+0000 7fa78fbe4700 1 -- start start 2023-09-30T22:22:05.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.853+0000 7fa78fbe4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa78809f430 0x7fa788136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:05.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.853+0000 7fa78fbe4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa788137010 0x7fa7881393f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:05.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.853+0000 7fa78fbe4700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa78809b6d0 con 0x7fa78809e950 2023-09-30T22:22:05.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.853+0000 7fa78fbe4700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa78809afb0 con 0x7fa78809f430 2023-09-30T22:22:05.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.853+0000 7fa78fbe4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7880a0970 con 0x7fa788137010 2023-09-30T22:22:05.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.853+0000 7fa78d17f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa78809f430 0x7fa788136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:05.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.853+0000 7fa78d980700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fa78809e950 0x7fa78809ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58162/0 (socket says 172.21.15.156:58162) 2023-09-30T22:22:05.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.853+0000 7fa78d980700 1 -- 172.21.15.156:0/2570773185 learned_addr learned my addr 172.21.15.156:0/2570773185 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:05.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.853+0000 7fa78d17f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa78809f430 0x7fa788136ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47170/0 (socket says 172.21.15.156:47170) 2023-09-30T22:22:05.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.853+0000 7fa78e181700 1 --2- 172.21.15.156:0/2570773185 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa788137010 0x7fa7881393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:05.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.853+0000 7fa78c97e700 1 -- 172.21.15.156:0/2570773185 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1358705759 0 0) 0x7fa78809b6d0 con 0x7fa78809e950 2023-09-30T22:22:05.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.853+0000 7fa78e181700 1 -- 172.21.15.156:0/2570773185 >> v2:172.21.15.156:3300/0 conn(0x7fa78809f430 msgr2=0x7fa788136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:05.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.853+0000 7fa78e181700 1 --2- 172.21.15.156:0/2570773185 >> v2:172.21.15.156:3300/0 conn(0x7fa78809f430 0x7fa788136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.853+0000 7fa78e181700 1 -- 172.21.15.156:0/2570773185 >> v1:172.21.15.156:6789/0 conn(0x7fa78809e950 legacy=0x7fa78809ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.853+0000 7fa78e181700 1 -- 172.21.15.156:0/2570773185 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7880a0320 con 0x7fa788137010 2023-09-30T22:22:05.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.853+0000 7fa78d17f700 1 --2- 172.21.15.156:0/2570773185 >> v2:172.21.15.156:3300/0 conn(0x7fa78809f430 0x7fa788136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:05.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.854+0000 7fa78e181700 1 --2- 172.21.15.156:0/2570773185 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa788137010 0x7fa7881393f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa780009d90 tx=0x7fa78000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef9eed0d1741f4af server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:05.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.854+0000 7fa78c97e700 1 -- 172.21.15.156:0/2570773185 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78000bd20 con 0x7fa788137010 2023-09-30T22:22:05.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.854+0000 7fa78c97e700 1 -- 172.21.15.156:0/2570773185 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78000be80 con 0x7fa788137010 2023-09-30T22:22:05.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.854+0000 7fa78c97e700 1 -- 172.21.15.156:0/2570773185 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa780010710 con 0x7fa788137010 2023-09-30T22:22:05.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.854+0000 7fa78fbe4700 1 -- 172.21.15.156:0/2570773185 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa788137010 msgr2=0x7fa7881393f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.854+0000 7fa78fbe4700 1 --2- 172.21.15.156:0/2570773185 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa788137010 0x7fa7881393f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa780009d90 tx=0x7fa78000b330 comp rx=0 tx=0).stop 2023-09-30T22:22:05.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.854+0000 7fa78fbe4700 1 -- 172.21.15.156:0/2570773185 shutdown_connections 2023-09-30T22:22:05.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.854+0000 7fa78fbe4700 1 --2- 172.21.15.156:0/2570773185 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa788137010 0x7fa7881393f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.854+0000 7fa78fbe4700 1 --2- 172.21.15.156:0/2570773185 >> v2:172.21.15.156:3300/0 conn(0x7fa78809f430 0x7fa788136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.854+0000 7fa78fbe4700 1 -- 172.21.15.156:0/2570773185 >> 172.21.15.156:0/2570773185 conn(0x7fa7880a0f70 msgr2=0x7fa7880a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:05.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.854+0000 7fa78fbe4700 1 -- 172.21.15.156:0/2570773185 shutdown_connections 2023-09-30T22:22:05.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.854+0000 7fa78fbe4700 1 -- 172.21.15.156:0/2570773185 wait complete. 2023-09-30T22:22:05.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.855+0000 7fa78fbe4700 1 Processor -- start 2023-09-30T22:22:05.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.855+0000 7fa78fbe4700 1 -- start start 2023-09-30T22:22:05.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.856+0000 7fa78fbe4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa78809e950 0x7fa78811b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:05.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.856+0000 7fa78fbe4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa78809f430 0x7fa78811b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:05.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.856+0000 7fa78fbe4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa788137010 0x7fa78811bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:05.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.856+0000 7fa78fbe4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78809dad0 con 0x7fa788137010 2023-09-30T22:22:05.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.856+0000 7fa78fbe4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7880a4d30 con 0x7fa78809e950 2023-09-30T22:22:05.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.856+0000 7fa78fbe4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa78811d670 con 0x7fa78809f430 2023-09-30T22:22:05.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.856+0000 7fa78d17f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa78809f430 0x7fa78811b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:05.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.856+0000 7fa78d17f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa78809f430 0x7fa78811b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33638/0 (socket says 172.21.15.156:33638) 2023-09-30T22:22:05.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.856+0000 7fa78d17f700 1 -- 172.21.15.156:0/3024079878 learned_addr learned my addr 172.21.15.156:0/3024079878 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:05.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.856+0000 7fa78e181700 1 --2- 172.21.15.156:0/3024079878 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa788137010 0x7fa78811bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:05.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.856+0000 7fa78d17f700 1 -- 172.21.15.156:0/3024079878 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa78809e950 msgr2=0x7fa78811b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.856+0000 7fa78d17f700 1 --2- 172.21.15.156:0/3024079878 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa78809e950 0x7fa78811b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.856+0000 7fa78d17f700 1 -- 172.21.15.156:0/3024079878 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa788137010 msgr2=0x7fa78811bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.856+0000 7fa78d17f700 1 --2- 172.21.15.156:0/3024079878 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa788137010 0x7fa78811bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.856+0000 7fa78d17f700 1 -- 172.21.15.156:0/3024079878 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7780094a0 con 0x7fa78809f430 2023-09-30T22:22:05.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.856+0000 7fa78d17f700 1 --2- 172.21.15.156:0/3024079878 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa78809f430 0x7fa78811b9c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa77800ec10 tx=0x7fa77800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:05.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.856+0000 7fa77e7fc700 1 -- 172.21.15.156:0/3024079878 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77800c8b0 con 0x7fa78809f430 2023-09-30T22:22:05.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.856+0000 7fa77e7fc700 1 -- 172.21.15.156:0/3024079878 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77800ca10 con 0x7fa78809f430 2023-09-30T22:22:05.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.856+0000 7fa78fbe4700 1 -- 172.21.15.156:0/3024079878 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa780009a70 con 0x7fa78809f430 2023-09-30T22:22:05.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.856+0000 7fa77e7fc700 1 -- 172.21.15.156:0/3024079878 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77800cd80 con 0x7fa78809f430 2023-09-30T22:22:05.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.857+0000 7fa78fbe4700 1 -- 172.21.15.156:0/3024079878 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa78811d880 con 0x7fa78809f430 2023-09-30T22:22:05.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.857+0000 7fa77e7fc700 1 -- 172.21.15.156:0/3024079878 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa778013470 con 0x7fa78809f430 2023-09-30T22:22:05.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.857+0000 7fa77e7fc700 1 -- 172.21.15.156:0/3024079878 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa77803fbe0 con 0x7fa78809f430 2023-09-30T22:22:05.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.858+0000 7fa78fbe4700 1 -- 172.21.15.156:0/3024079878 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa78811e8f0 con 0x7fa78809f430 2023-09-30T22:22:05.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.862+0000 7fa77e7fc700 1 -- 172.21.15.156:0/3024079878 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa77801b3b0 con 0x7fa78809f430 2023-09-30T22:22:05.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.887+0000 7fdb04520700 1 -- 172.21.15.156:0/3607496987 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdafc04f2a0 con 0x7fdafc1309f0 2023-09-30T22:22:05.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.887+0000 7fdaf2ffd700 1 -- 172.21.15.156:0/3607496987 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdaec015020 con 0x7fdafc1309f0 2023-09-30T22:22:05.888 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:05.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.891+0000 7fdb04520700 1 -- 172.21.15.156:0/3607496987 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdafc1309f0 msgr2=0x7fdafc11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.891+0000 7fdb04520700 1 --2- 172.21.15.156:0/3607496987 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdafc1309f0 0x7fdafc11df80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fdaec016000 tx=0x7fdaec004750 comp rx=0 tx=0).stop 2023-09-30T22:22:05.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.891+0000 7fdb04520700 1 -- 172.21.15.156:0/3607496987 shutdown_connections 2023-09-30T22:22:05.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.891+0000 7fdb04520700 1 --2- 172.21.15.156:0/3607496987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdafc133ad0 0x7fdafc11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.891+0000 7fdb04520700 1 --2- 172.21.15.156:0/3607496987 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdafc1300a0 0x7fdafc11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.891+0000 7fdb04520700 1 --2- 172.21.15.156:0/3607496987 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdafc1309f0 0x7fdafc11df80 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.891+0000 7fdb04520700 1 -- 172.21.15.156:0/3607496987 >> 172.21.15.156:0/3607496987 conn(0x7fdafc099c40 msgr2=0x7fdafc131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:05.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.891+0000 7fdb04520700 1 -- 172.21.15.156:0/3607496987 shutdown_connections 2023-09-30T22:22:05.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.891+0000 7fdb04520700 1 -- 172.21.15.156:0/3607496987 wait complete. 2023-09-30T22:22:05.904 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:05.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.980+0000 7f2e59640700 1 -- 172.21.15.156:0/2943348235 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2e5404f2a0 con 0x7f2e541309f0 2023-09-30T22:22:05.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.981+0000 7f2e3b7fe700 1 -- 172.21.15.156:0/2943348235 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e48024350 con 0x7f2e541309f0 2023-09-30T22:22:05.982 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:05.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.983+0000 7f2e59640700 1 -- 172.21.15.156:0/2943348235 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e541309f0 msgr2=0x7f2e54071780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.983+0000 7f2e59640700 1 --2- 172.21.15.156:0/2943348235 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e541309f0 0x7f2e54071780 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800ebb0 tx=0x7f2e4800eec0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.983+0000 7f2e59640700 1 -- 172.21.15.156:0/2943348235 shutdown_connections 2023-09-30T22:22:05.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.983+0000 7f2e59640700 1 --2- 172.21.15.156:0/2943348235 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e54133ad0 0x7f2e54071cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.983+0000 7f2e59640700 1 --2- 172.21.15.156:0/2943348235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e541300a0 0x7f2e54071240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.983+0000 7f2e59640700 1 --2- 172.21.15.156:0/2943348235 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e541309f0 0x7f2e54071780 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.983+0000 7f2e59640700 1 -- 172.21.15.156:0/2943348235 >> 172.21.15.156:0/2943348235 conn(0x7f2e54099c40 msgr2=0x7f2e54132bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:05.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.983+0000 7f2e59640700 1 -- 172.21.15.156:0/2943348235 shutdown_connections 2023-09-30T22:22:05.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:05.983+0000 7f2e59640700 1 -- 172.21.15.156:0/2943348235 wait complete. 2023-09-30T22:22:05.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:06.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.067+0000 7fa78fbe4700 1 -- 172.21.15.156:0/3024079878 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa78804f2a0 con 0x7fa78809f430 2023-09-30T22:22:06.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.067+0000 7fa77e7fc700 1 -- 172.21.15.156:0/3024079878 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa77802b090 con 0x7fa78809f430 2023-09-30T22:22:06.068 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:06.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.069+0000 7fa78fbe4700 1 -- 172.21.15.156:0/3024079878 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa78809f430 msgr2=0x7fa78811b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:06.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.069+0000 7fa78fbe4700 1 --2- 172.21.15.156:0/3024079878 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa78809f430 0x7fa78811b9c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa77800ec10 tx=0x7fa77800ef20 comp rx=0 tx=0).stop 2023-09-30T22:22:06.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.069+0000 7fa78fbe4700 1 -- 172.21.15.156:0/3024079878 shutdown_connections 2023-09-30T22:22:06.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.069+0000 7fa78fbe4700 1 --2- 172.21.15.156:0/3024079878 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa788137010 0x7fa78811bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:06.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.069+0000 7fa78fbe4700 1 --2- 172.21.15.156:0/3024079878 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa78809e950 0x7fa78811b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:06.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.069+0000 7fa78fbe4700 1 --2- 172.21.15.156:0/3024079878 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa78809f430 0x7fa78811b9c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:06.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.069+0000 7fa78fbe4700 1 -- 172.21.15.156:0/3024079878 >> 172.21.15.156:0/3024079878 conn(0x7fa7880a0f70 msgr2=0x7fa788071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:06.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.069+0000 7fa78fbe4700 1 -- 172.21.15.156:0/3024079878 shutdown_connections 2023-09-30T22:22:06.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.069+0000 7fa78fbe4700 1 -- 172.21.15.156:0/3024079878 wait complete. 2023-09-30T22:22:06.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:06.435 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:06.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.557+0000 7fce50cdc700 1 Processor -- start 2023-09-30T22:22:06.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.557+0000 7fce50cdc700 1 -- start start 2023-09-30T22:22:06.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.558+0000 7fce50cdc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce4c09d860 0x7fce4c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:06.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.558+0000 7fce50cdc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce4c09e170 0x7fce4c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:06.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.558+0000 7fce50cdc700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce4c09aaa0 con 0x7fce4c130ce0 2023-09-30T22:22:06.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.558+0000 7fce50cdc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c09f870 con 0x7fce4c09e170 2023-09-30T22:22:06.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.558+0000 7fce50cdc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c09b360 con 0x7fce4c09d860 2023-09-30T22:22:06.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.558+0000 7fce4a59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce4c09d860 0x7fce4c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:06.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.558+0000 7fce49d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce4c09e170 0x7fce4c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:06.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.558+0000 7fce4ad9d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fce4c130ce0 0x7fce4c1379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58176/0 (socket says 172.21.15.156:58176) 2023-09-30T22:22:06.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.558+0000 7fce4a59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce4c09d860 0x7fce4c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33648/0 (socket says 172.21.15.156:33648) 2023-09-30T22:22:06.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.558+0000 7fce4ad9d700 1 -- 172.21.15.156:0/2898158772 learned_addr learned my addr 172.21.15.156:0/2898158772 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:06.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.558+0000 7fce4959a700 1 -- 172.21.15.156:0/2898158772 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1126381987 0 0) 0x7fce4c09aaa0 con 0x7fce4c130ce0 2023-09-30T22:22:06.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.558+0000 7fce4959a700 1 -- 172.21.15.156:0/2898158772 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce380035b0 con 0x7fce4c130ce0 2023-09-30T22:22:06.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.558+0000 7fce4a59c700 1 -- 172.21.15.156:0/2898158772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce4c09e170 msgr2=0x7fce4c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:06.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.558+0000 7fce4a59c700 1 --2- 172.21.15.156:0/2898158772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce4c09e170 0x7fce4c1307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:06.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.558+0000 7fce4a59c700 1 -- 172.21.15.156:0/2898158772 >> v1:172.21.15.156:6789/0 conn(0x7fce4c130ce0 legacy=0x7fce4c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:06.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.558+0000 7fce4a59c700 1 -- 172.21.15.156:0/2898158772 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4c09b620 con 0x7fce4c09d860 2023-09-30T22:22:06.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.559+0000 7fce49d9b700 1 --2- 172.21.15.156:0/2898158772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce4c09e170 0x7fce4c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:06.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.559+0000 7fce4a59c700 1 --2- 172.21.15.156:0/2898158772 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce4c09d860 0x7fce4c09dc30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fce34009870 tx=0x7fce34009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15b8c1aad282d45d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:06.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.559+0000 7fce4959a700 1 -- 172.21.15.156:0/2898158772 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce34011830 con 0x7fce4c09d860 2023-09-30T22:22:06.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.559+0000 7fce4959a700 1 -- 172.21.15.156:0/2898158772 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce34011990 con 0x7fce4c09d860 2023-09-30T22:22:06.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.559+0000 7fce4959a700 1 -- 172.21.15.156:0/2898158772 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce34011d20 con 0x7fce4c09d860 2023-09-30T22:22:06.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.559+0000 7fce50cdc700 1 -- 172.21.15.156:0/2898158772 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce4c09d860 msgr2=0x7fce4c09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:06.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.559+0000 7fce50cdc700 1 --2- 172.21.15.156:0/2898158772 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce4c09d860 0x7fce4c09dc30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fce34009870 tx=0x7fce34009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:06.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.559+0000 7fce50cdc700 1 -- 172.21.15.156:0/2898158772 shutdown_connections 2023-09-30T22:22:06.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.559+0000 7fce50cdc700 1 --2- 172.21.15.156:0/2898158772 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce4c09d860 0x7fce4c09dc30 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:06.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.559+0000 7fce50cdc700 1 --2- 172.21.15.156:0/2898158772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce4c09e170 0x7fce4c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:06.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.559+0000 7fce50cdc700 1 -- 172.21.15.156:0/2898158772 >> 172.21.15.156:0/2898158772 conn(0x7fce4c099c40 msgr2=0x7fce4c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:06.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.559+0000 7fce50cdc700 1 -- 172.21.15.156:0/2898158772 shutdown_connections 2023-09-30T22:22:06.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.559+0000 7fce50cdc700 1 -- 172.21.15.156:0/2898158772 wait complete. 2023-09-30T22:22:06.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.560+0000 7fce50cdc700 1 Processor -- start 2023-09-30T22:22:06.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.561+0000 7fce50cdc700 1 -- start start 2023-09-30T22:22:06.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.561+0000 7fce50cdc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce4c09d860 0x7fce4c120600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:06.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.561+0000 7fce50cdc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce4c09e170 0x7fce4c120b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:06.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.561+0000 7fce50cdc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce4c130ce0 0x7fce4c121080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:06.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.561+0000 7fce50cdc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c123e80 con 0x7fce4c09d860 2023-09-30T22:22:06.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.561+0000 7fce50cdc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c1240d0 con 0x7fce4c130ce0 2023-09-30T22:22:06.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.561+0000 7fce50cdc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c130730 con 0x7fce4c09e170 2023-09-30T22:22:06.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.561+0000 7fce49d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce4c09e170 0x7fce4c120b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:06.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.561+0000 7fce4ad9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce4c130ce0 0x7fce4c121080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:06.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.561+0000 7fce49d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce4c09e170 0x7fce4c120b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33652/0 (socket says 172.21.15.156:33652) 2023-09-30T22:22:06.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.561+0000 7fce49d9b700 1 -- 172.21.15.156:0/2958724167 learned_addr learned my addr 172.21.15.156:0/2958724167 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:06.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.561+0000 7fce4a59c700 1 --2- 172.21.15.156:0/2958724167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce4c09d860 0x7fce4c120600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:06.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.561+0000 7fce49d9b700 1 -- 172.21.15.156:0/2958724167 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce4c130ce0 msgr2=0x7fce4c121080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:06.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.561+0000 7fce49d9b700 1 --2- 172.21.15.156:0/2958724167 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce4c130ce0 0x7fce4c121080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:06.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.561+0000 7fce49d9b700 1 -- 172.21.15.156:0/2958724167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce4c09d860 msgr2=0x7fce4c120600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:06.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.561+0000 7fce49d9b700 1 --2- 172.21.15.156:0/2958724167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce4c09d860 0x7fce4c120600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:06.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.561+0000 7fce49d9b700 1 -- 172.21.15.156:0/2958724167 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3c0094a0 con 0x7fce4c09e170 2023-09-30T22:22:06.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.561+0000 7fce4ad9d700 1 --2- 172.21.15.156:0/2958724167 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce4c130ce0 0x7fce4c121080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:06.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.561+0000 7fce49d9b700 1 --2- 172.21.15.156:0/2958724167 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce4c09e170 0x7fce4c120b40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00ebb0 tx=0x7fce3c00eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:06.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.562+0000 7fce42ffd700 1 -- 172.21.15.156:0/2958724167 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c00c850 con 0x7fce4c09e170 2023-09-30T22:22:06.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.562+0000 7fce42ffd700 1 -- 172.21.15.156:0/2958724167 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3c00c9b0 con 0x7fce4c09e170 2023-09-30T22:22:06.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.562+0000 7fce50cdc700 1 -- 172.21.15.156:0/2958724167 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce340094a0 con 0x7fce4c09e170 2023-09-30T22:22:06.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.562+0000 7fce42ffd700 1 -- 172.21.15.156:0/2958724167 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c00cd40 con 0x7fce4c09e170 2023-09-30T22:22:06.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.562+0000 7fce50cdc700 1 -- 172.21.15.156:0/2958724167 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce4c123b30 con 0x7fce4c09e170 2023-09-30T22:22:06.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.562+0000 7fce42ffd700 1 -- 172.21.15.156:0/2958724167 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fce3c013470 con 0x7fce4c09e170 2023-09-30T22:22:06.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.562+0000 7fce42ffd700 1 -- 172.21.15.156:0/2958724167 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fce3c03f770 con 0x7fce4c09e170 2023-09-30T22:22:06.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.563+0000 7fce50cdc700 1 -- 172.21.15.156:0/2958724167 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce4c04f2a0 con 0x7fce4c09e170 2023-09-30T22:22:06.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.567+0000 7fce42ffd700 1 -- 172.21.15.156:0/2958724167 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fce3c0232f0 con 0x7fce4c09e170 2023-09-30T22:22:06.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.753+0000 7fce50cdc700 1 -- 172.21.15.156:0/2958724167 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fce4c09c580 con 0x7fce4c09e170 2023-09-30T22:22:06.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.753+0000 7fce42ffd700 1 -- 172.21.15.156:0/2958724167 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fce4c09c580 con 0x7fce4c09e170 2023-09-30T22:22:06.754 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:06.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.755+0000 7fce50cdc700 1 -- 172.21.15.156:0/2958724167 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce4c09e170 msgr2=0x7fce4c120b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:06.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.755+0000 7fce50cdc700 1 --2- 172.21.15.156:0/2958724167 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce4c09e170 0x7fce4c120b40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00ebb0 tx=0x7fce3c00eec0 comp rx=0 tx=0).stop 2023-09-30T22:22:06.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.755+0000 7fce50cdc700 1 -- 172.21.15.156:0/2958724167 shutdown_connections 2023-09-30T22:22:06.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.755+0000 7fce50cdc700 1 --2- 172.21.15.156:0/2958724167 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce4c130ce0 0x7fce4c121080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:06.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.755+0000 7fce50cdc700 1 --2- 172.21.15.156:0/2958724167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce4c09d860 0x7fce4c120600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:06.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.755+0000 7fce50cdc700 1 --2- 172.21.15.156:0/2958724167 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce4c09e170 0x7fce4c120b40 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:06.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.755+0000 7fce50cdc700 1 -- 172.21.15.156:0/2958724167 >> 172.21.15.156:0/2958724167 conn(0x7fce4c099c40 msgr2=0x7fce4c070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:06.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.755+0000 7fce50cdc700 1 -- 172.21.15.156:0/2958724167 shutdown_connections 2023-09-30T22:22:06.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:06.755+0000 7fce50cdc700 1 -- 172.21.15.156:0/2958724167 wait complete. 2023-09-30T22:22:06.767 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:06.905 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:06.996 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:07.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.028+0000 7f9187618700 1 Processor -- start 2023-09-30T22:22:07.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.029+0000 7f9187618700 1 -- start start 2023-09-30T22:22:07.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.029+0000 7f9187618700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9180136960 0x7f9180138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:07.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.029+0000 7f9187618700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9180139280 0x7f918013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:07.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.029+0000 7f9187618700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f918006b2d0 con 0x7f9180133ad0 2023-09-30T22:22:07.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.029+0000 7f9187618700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91801345b0 con 0x7f9180139280 2023-09-30T22:22:07.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.029+0000 7f9187618700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9180133610 con 0x7f9180136960 2023-09-30T22:22:07.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.030+0000 7f9185bb5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9180139280 0x7f918013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:07.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.030+0000 7f9184bb3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9180136960 0x7f9180138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:07.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.030+0000 7f9185bb5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9180139280 0x7f918013b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47194/0 (socket says 172.21.15.156:47194) 2023-09-30T22:22:07.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.030+0000 7f91853b4700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f9180133ad0 0x7f9180133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58192/0 (socket says 172.21.15.156:58192) 2023-09-30T22:22:07.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.030+0000 7f9185bb5700 1 -- 172.21.15.156:0/3517226616 learned_addr learned my addr 172.21.15.156:0/3517226616 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:07.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.030+0000 7f9184bb3700 1 -- 172.21.15.156:0/3517226616 >> v2:172.21.15.156:3300/0 conn(0x7f9180139280 msgr2=0x7f918013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:07.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.030+0000 7f9184bb3700 1 --2- 172.21.15.156:0/3517226616 >> v2:172.21.15.156:3300/0 conn(0x7f9180139280 0x7f918013b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.030+0000 7f9184bb3700 1 -- 172.21.15.156:0/3517226616 >> v1:172.21.15.156:6789/0 conn(0x7f9180133ad0 legacy=0x7f9180133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.030+0000 7f9184bb3700 1 -- 172.21.15.156:0/3517226616 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f918009a500 con 0x7f9180136960 2023-09-30T22:22:07.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.030+0000 7f9177fff700 1 -- 172.21.15.156:0/3517226616 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159339235 0 0) 0x7f918006b2d0 con 0x7f9180133ad0 2023-09-30T22:22:07.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.030+0000 7f9185bb5700 1 --2- 172.21.15.156:0/3517226616 >> v2:172.21.15.156:3300/0 conn(0x7f9180139280 0x7f918013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:07.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.030+0000 7f9184bb3700 1 --2- 172.21.15.156:0/3517226616 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9180136960 0x7f9180138d40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9170009870 tx=0x7f9170009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28fcd200388b6157 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:07.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.030+0000 7f9177fff700 1 -- 172.21.15.156:0/3517226616 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9170011830 con 0x7f9180136960 2023-09-30T22:22:07.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.030+0000 7f9177fff700 1 -- 172.21.15.156:0/3517226616 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9170011990 con 0x7f9180136960 2023-09-30T22:22:07.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.030+0000 7f9177fff700 1 -- 172.21.15.156:0/3517226616 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9170011d20 con 0x7f9180136960 2023-09-30T22:22:07.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.031+0000 7f9187618700 1 -- 172.21.15.156:0/3517226616 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9180136960 msgr2=0x7f9180138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.031+0000 7f9187618700 1 --2- 172.21.15.156:0/3517226616 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9180136960 0x7f9180138d40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9170009870 tx=0x7f9170009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:07.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.031+0000 7f9187618700 1 -- 172.21.15.156:0/3517226616 shutdown_connections 2023-09-30T22:22:07.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.031+0000 7f9187618700 1 --2- 172.21.15.156:0/3517226616 >> v2:172.21.15.156:3300/0 conn(0x7f9180139280 0x7f918013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.031+0000 7f9187618700 1 --2- 172.21.15.156:0/3517226616 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9180136960 0x7f9180138d40 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.031+0000 7f9187618700 1 -- 172.21.15.156:0/3517226616 >> 172.21.15.156:0/3517226616 conn(0x7f9180099c40 msgr2=0x7f91800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:07.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.031+0000 7f9187618700 1 -- 172.21.15.156:0/3517226616 shutdown_connections 2023-09-30T22:22:07.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.031+0000 7f9187618700 1 -- 172.21.15.156:0/3517226616 wait complete. 2023-09-30T22:22:07.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.032+0000 7f9187618700 1 Processor -- start 2023-09-30T22:22:07.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.032+0000 7f9187618700 1 -- start start 2023-09-30T22:22:07.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.033+0000 7f9187618700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9180133ad0 0x7f9180071770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:07.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.033+0000 7f9187618700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9180136960 0x7f9180071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:07.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.033+0000 7f9187618700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9180139280 0x7f91801c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:07.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.033+0000 7f9187618700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9180070040 con 0x7f9180133ad0 2023-09-30T22:22:07.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.033+0000 7f9187618700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9180130b10 con 0x7f9180139280 2023-09-30T22:22:07.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.033+0000 7f9187618700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f918009f390 con 0x7f9180136960 2023-09-30T22:22:07.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.033+0000 7f9185bb5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9180139280 0x7f91801c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:07.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.033+0000 7f9185bb5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9180139280 0x7f91801c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57862/0 (socket says 172.21.15.156:57862) 2023-09-30T22:22:07.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.033+0000 7f9185bb5700 1 -- 172.21.15.156:0/2991885221 learned_addr learned my addr 172.21.15.156:0/2991885221 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:07.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.033+0000 7f9184bb3700 1 --2- 172.21.15.156:0/2991885221 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9180136960 0x7f9180071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:07.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.033+0000 7f91853b4700 1 --2- 172.21.15.156:0/2991885221 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9180133ad0 0x7f9180071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:07.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.033+0000 7f9185bb5700 1 -- 172.21.15.156:0/2991885221 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9180136960 msgr2=0x7f9180071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.033+0000 7f9185bb5700 1 --2- 172.21.15.156:0/2991885221 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9180136960 0x7f9180071cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.033+0000 7f9185bb5700 1 -- 172.21.15.156:0/2991885221 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9180133ad0 msgr2=0x7f9180071770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.033+0000 7f9185bb5700 1 --2- 172.21.15.156:0/2991885221 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9180133ad0 0x7f9180071770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.033+0000 7f9185bb5700 1 -- 172.21.15.156:0/2991885221 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9178009b30 con 0x7f9180139280 2023-09-30T22:22:07.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.033+0000 7f91853b4700 1 --2- 172.21.15.156:0/2991885221 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9180133ad0 0x7f9180071770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:07.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.033+0000 7f9185bb5700 1 --2- 172.21.15.156:0/2991885221 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9180139280 0x7f91801c8470 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f917800ef90 tx=0x7f917800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:07.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.033+0000 7f9175ffb700 1 -- 172.21.15.156:0/2991885221 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9178018070 con 0x7f9180139280 2023-09-30T22:22:07.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.033+0000 7f9175ffb700 1 -- 172.21.15.156:0/2991885221 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917800f040 con 0x7f9180139280 2023-09-30T22:22:07.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.033+0000 7f9187618700 1 -- 172.21.15.156:0/2991885221 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91700094a0 con 0x7f9180139280 2023-09-30T22:22:07.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.033+0000 7f9175ffb700 1 -- 172.21.15.156:0/2991885221 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9178003c40 con 0x7f9180139280 2023-09-30T22:22:07.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.034+0000 7f9187618700 1 -- 172.21.15.156:0/2991885221 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91800721f0 con 0x7f9180139280 2023-09-30T22:22:07.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.034+0000 7f9175ffb700 1 -- 172.21.15.156:0/2991885221 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f917800c930 con 0x7f9180139280 2023-09-30T22:22:07.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.034+0000 7f9175ffb700 1 -- 172.21.15.156:0/2991885221 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f917803f960 con 0x7f9180139280 2023-09-30T22:22:07.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.035+0000 7f9187618700 1 -- 172.21.15.156:0/2991885221 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91800701b0 con 0x7f9180139280 2023-09-30T22:22:07.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.039+0000 7f9175ffb700 1 -- 172.21.15.156:0/2991885221 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f917800cbe0 con 0x7f9180139280 2023-09-30T22:22:07.083 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:07.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.123+0000 7fb9c54f9700 1 Processor -- start 2023-09-30T22:22:07.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.124+0000 7fb9c54f9700 1 -- start start 2023-09-30T22:22:07.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.124+0000 7fb9c54f9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb9c0133900 0x7fb9c0133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:07.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.124+0000 7fb9c54f9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb9c0134210 0x7fb9c00a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:07.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.124+0000 7fb9c54f9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb9c00a0ee0 0x7fb9c00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:07.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.124+0000 7fb9c54f9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c009a760 con 0x7fb9c0133900 2023-09-30T22:22:07.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.124+0000 7fb9c54f9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c01336e0 con 0x7fb9c00a0ee0 2023-09-30T22:22:07.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.124+0000 7fb9c54f9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c009a080 con 0x7fb9c0134210 2023-09-30T22:22:07.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.124+0000 7fb9beffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb9c0133900 0x7fb9c0133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:07.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.124+0000 7fb9be7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb9c0134210 0x7fb9c00a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:07.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.124+0000 7fb9be7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb9c0134210 0x7fb9c00a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33660/0 (socket says 172.21.15.156:33660) 2023-09-30T22:22:07.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.124+0000 7fb9beffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb9c0133900 0x7fb9c0133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47212/0 (socket says 172.21.15.156:47212) 2023-09-30T22:22:07.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.124+0000 7fb9be7fc700 1 -- 172.21.15.156:0/3376535791 learned_addr learned my addr 172.21.15.156:0/3376535791 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:07.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.124+0000 7fb9bf7fe700 1 --2- 172.21.15.156:0/3376535791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb9c00a0ee0 0x7fb9c00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:07.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.125+0000 7fb9beffd700 1 -- 172.21.15.156:0/3376535791 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb9c0134210 msgr2=0x7fb9c00a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:07.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.125+0000 7fb9beffd700 1 --2- 172.21.15.156:0/3376535791 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb9c0134210 0x7fb9c00a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.125+0000 7fb9beffd700 1 -- 172.21.15.156:0/3376535791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb9c00a0ee0 msgr2=0x7fb9c00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:07.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.125+0000 7fb9beffd700 1 --2- 172.21.15.156:0/3376535791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb9c00a0ee0 0x7fb9c00a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.125+0000 7fb9beffd700 1 -- 172.21.15.156:0/3376535791 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c00a23e0 con 0x7fb9c0133900 2023-09-30T22:22:07.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.125+0000 7fb9bf7fe700 1 --2- 172.21.15.156:0/3376535791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb9c00a0ee0 0x7fb9c00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:07.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.125+0000 7fb9beffd700 1 --2- 172.21.15.156:0/3376535791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9c0133900 0x7fb9c0133cd0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0009820 tx=0x7fb9b0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e85f14d7d331bec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:07.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.125+0000 7fb9bdffb700 1 -- 172.21.15.156:0/3376535791 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0005e30 con 0x7fb9c0133900 2023-09-30T22:22:07.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.125+0000 7fb9bdffb700 1 -- 172.21.15.156:0/3376535791 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b0006030 con 0x7fb9c0133900 2023-09-30T22:22:07.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.125+0000 7fb9bdffb700 1 -- 172.21.15.156:0/3376535791 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b00063c0 con 0x7fb9c0133900 2023-09-30T22:22:07.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.126+0000 7fb9c54f9700 1 -- 172.21.15.156:0/3376535791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9c0133900 msgr2=0x7fb9c0133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.126+0000 7fb9c54f9700 1 --2- 172.21.15.156:0/3376535791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9c0133900 0x7fb9c0133cd0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0009820 tx=0x7fb9b0009b30 comp rx=0 tx=0).stop 2023-09-30T22:22:07.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.126+0000 7fb9c54f9700 1 -- 172.21.15.156:0/3376535791 shutdown_connections 2023-09-30T22:22:07.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.126+0000 7fb9c54f9700 1 --2- 172.21.15.156:0/3376535791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb9c00a0ee0 0x7fb9c00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.126+0000 7fb9c54f9700 1 --2- 172.21.15.156:0/3376535791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9c0133900 0x7fb9c0133cd0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.126+0000 7fb9c54f9700 1 --2- 172.21.15.156:0/3376535791 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb9c0134210 0x7fb9c00a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.126+0000 7fb9c54f9700 1 -- 172.21.15.156:0/3376535791 >> 172.21.15.156:0/3376535791 conn(0x7fb9c00a2980 msgr2=0x7fb9c00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:07.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.126+0000 7fb9c54f9700 1 -- 172.21.15.156:0/3376535791 shutdown_connections 2023-09-30T22:22:07.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.126+0000 7fb9c54f9700 1 -- 172.21.15.156:0/3376535791 wait complete. 2023-09-30T22:22:07.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.127+0000 7fb9c54f9700 1 Processor -- start 2023-09-30T22:22:07.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.127+0000 7fb9c54f9700 1 -- start start 2023-09-30T22:22:07.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.127+0000 7fb9c54f9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9c00a0ee0 0x7fb9c011d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:07.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.127+0000 7fb9c54f9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb9c0133900 0x7fb9c011dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:07.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.127+0000 7fb9c54f9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb9c0134210 0x7fb9c011e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:07.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.127+0000 7fb9c54f9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c01212c0 con 0x7fb9c00a0ee0 2023-09-30T22:22:07.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.127+0000 7fb9c54f9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c011f450 con 0x7fb9c0133900 2023-09-30T22:22:07.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.127+0000 7fb9c54f9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c0132db0 con 0x7fb9c0134210 2023-09-30T22:22:07.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.127+0000 7fb9bf7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb9c0134210 0x7fb9c011e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:07.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.127+0000 7fb9be7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb9c0133900 0x7fb9c011dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:07.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.127+0000 7fb9bf7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb9c0134210 0x7fb9c011e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33676/0 (socket says 172.21.15.156:33676) 2023-09-30T22:22:07.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.127+0000 7fb9bf7fe700 1 -- 172.21.15.156:0/4235651910 learned_addr learned my addr 172.21.15.156:0/4235651910 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:07.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.127+0000 7fb9beffd700 1 --2- 172.21.15.156:0/4235651910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9c00a0ee0 0x7fb9c011d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:07.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.128+0000 7fb9bf7fe700 1 -- 172.21.15.156:0/4235651910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb9c0133900 msgr2=0x7fb9c011dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.128+0000 7fb9bf7fe700 1 --2- 172.21.15.156:0/4235651910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb9c0133900 0x7fb9c011dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.128+0000 7fb9bf7fe700 1 -- 172.21.15.156:0/4235651910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9c00a0ee0 msgr2=0x7fb9c011d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.128+0000 7fb9bf7fe700 1 --2- 172.21.15.156:0/4235651910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9c00a0ee0 0x7fb9c011d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.128+0000 7fb9bf7fe700 1 -- 172.21.15.156:0/4235651910 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b8009a70 con 0x7fb9c0134210 2023-09-30T22:22:07.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.128+0000 7fb9be7fc700 1 --2- 172.21.15.156:0/4235651910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb9c0133900 0x7fb9c011dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:07.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.128+0000 7fb9beffd700 1 --2- 172.21.15.156:0/4235651910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9c00a0ee0 0x7fb9c011d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:07.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.128+0000 7fb9bf7fe700 1 --2- 172.21.15.156:0/4235651910 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb9c0134210 0x7fb9c011e220 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800efc0 tx=0x7fb9b800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:07.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.128+0000 7fb9a77fe700 1 -- 172.21.15.156:0/4235651910 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b800cb40 con 0x7fb9c0134210 2023-09-30T22:22:07.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.128+0000 7fb9a77fe700 1 -- 172.21.15.156:0/4235651910 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b800f040 con 0x7fb9c0134210 2023-09-30T22:22:07.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.128+0000 7fb9c54f9700 1 -- 172.21.15.156:0/4235651910 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b0009430 con 0x7fb9c0134210 2023-09-30T22:22:07.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.128+0000 7fb9a77fe700 1 -- 172.21.15.156:0/4235651910 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8003a20 con 0x7fb9c0134210 2023-09-30T22:22:07.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.128+0000 7fb9c54f9700 1 -- 172.21.15.156:0/4235651910 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c01201b0 con 0x7fb9c0134210 2023-09-30T22:22:07.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.129+0000 7fb9a77fe700 1 -- 172.21.15.156:0/4235651910 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb9b8014480 con 0x7fb9c0134210 2023-09-30T22:22:07.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.129+0000 7fb9c54f9700 1 -- 172.21.15.156:0/4235651910 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c011a590 con 0x7fb9c0134210 2023-09-30T22:22:07.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.129+0000 7fb9a77fe700 1 -- 172.21.15.156:0/4235651910 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb9b8040110 con 0x7fb9c0134210 2023-09-30T22:22:07.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.138+0000 7fb9a77fe700 1 -- 172.21.15.156:0/4235651910 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb9b8012930 con 0x7fb9c0134210 2023-09-30T22:22:07.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.218+0000 7f5573a1d700 1 Processor -- start 2023-09-30T22:22:07.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.218+0000 7f5573a1d700 1 -- start start 2023-09-30T22:22:07.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.219+0000 7f5573a1d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f556c0a0a70 0x7f556c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:07.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.219+0000 7f5573a1d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f556c134120 0x7f556c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:07.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.219+0000 7f5573a1d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f556c09dc00 con 0x7f556c0a1380 2023-09-30T22:22:07.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.219+0000 7f5573a1d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556c09ea90 con 0x7f556c134120 2023-09-30T22:22:07.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.219+0000 7f5573a1d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f556c09dec0 con 0x7f556c0a0a70 2023-09-30T22:22:07.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.219+0000 7f55717b9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f556c0a0a70 0x7f556c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:07.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.219+0000 7f5571fba700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f556c134120 0x7f556c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:07.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.219+0000 7f5571fba700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f556c134120 0x7f556c13bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57890/0 (socket says 172.21.15.156:57890) 2023-09-30T22:22:07.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.219+0000 7f5571fba700 1 -- 172.21.15.156:0/27444353 learned_addr learned my addr 172.21.15.156:0/27444353 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:07.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.219+0000 7f55717b9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f556c0a0a70 0x7f556c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33692/0 (socket says 172.21.15.156:33692) 2023-09-30T22:22:07.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.219+0000 7f55717b9700 1 -- 172.21.15.156:0/27444353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f556c134120 msgr2=0x7f556c13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:07.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.219+0000 7f55717b9700 1 --2- 172.21.15.156:0/27444353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f556c134120 0x7f556c13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.219+0000 7f5563fff700 1 -- 172.21.15.156:0/27444353 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3007806675 0 0) 0x7f556c09dc00 con 0x7f556c0a1380 2023-09-30T22:22:07.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.219+0000 7f55717b9700 1 -- 172.21.15.156:0/27444353 >> v1:172.21.15.156:6789/0 conn(0x7f556c0a1380 legacy=0x7f556c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.219+0000 7f55717b9700 1 -- 172.21.15.156:0/27444353 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556c09e6a0 con 0x7f556c0a0a70 2023-09-30T22:22:07.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.219+0000 7f5571fba700 1 --2- 172.21.15.156:0/27444353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f556c134120 0x7f556c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:07.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.219+0000 7f55717b9700 1 --2- 172.21.15.156:0/27444353 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f556c0a0a70 0x7f556c0a0e40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5568009870 tx=0x7f5568009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77fe248f3c2dc34f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:07.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.220+0000 7f5563fff700 1 -- 172.21.15.156:0/27444353 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5568011830 con 0x7f556c0a0a70 2023-09-30T22:22:07.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.220+0000 7f5563fff700 1 -- 172.21.15.156:0/27444353 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5568011990 con 0x7f556c0a0a70 2023-09-30T22:22:07.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.220+0000 7f5563fff700 1 -- 172.21.15.156:0/27444353 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5568011d20 con 0x7f556c0a0a70 2023-09-30T22:22:07.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.220+0000 7f5573a1d700 1 -- 172.21.15.156:0/27444353 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f556c0a0a70 msgr2=0x7f556c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.220+0000 7f5573a1d700 1 --2- 172.21.15.156:0/27444353 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f556c0a0a70 0x7f556c0a0e40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5568009870 tx=0x7f5568009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:07.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.220+0000 7f5573a1d700 1 -- 172.21.15.156:0/27444353 shutdown_connections 2023-09-30T22:22:07.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.220+0000 7f5573a1d700 1 --2- 172.21.15.156:0/27444353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f556c134120 0x7f556c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.220+0000 7f5573a1d700 1 --2- 172.21.15.156:0/27444353 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f556c0a0a70 0x7f556c0a0e40 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.220+0000 7f5573a1d700 1 -- 172.21.15.156:0/27444353 >> 172.21.15.156:0/27444353 conn(0x7f556c0a6610 msgr2=0x7f556c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:07.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.221+0000 7f5573a1d700 1 -- 172.21.15.156:0/27444353 shutdown_connections 2023-09-30T22:22:07.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.221+0000 7f5573a1d700 1 -- 172.21.15.156:0/27444353 wait complete. 2023-09-30T22:22:07.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.221+0000 7f5573a1d700 1 Processor -- start 2023-09-30T22:22:07.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.221+0000 7f5573a1d700 1 -- start start 2023-09-30T22:22:07.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.222+0000 7f5573a1d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f556c0a0a70 0x7f556c122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:07.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.222+0000 7f5573a1d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f556c0a1380 0x7f556c122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:07.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.222+0000 7f5573a1d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f556c134120 0x7f556c123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:07.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.222+0000 7f5573a1d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556c125920 con 0x7f556c0a0a70 2023-09-30T22:22:07.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.222+0000 7f5573a1d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556c124310 con 0x7f556c0a1380 2023-09-30T22:22:07.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.222+0000 7f5573a1d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f556c1332d0 con 0x7f556c134120 2023-09-30T22:22:07.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.222+0000 7f5570fb8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f556c0a1380 0x7f556c122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:07.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.222+0000 7f5570fb8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f556c0a1380 0x7f556c122c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57902/0 (socket says 172.21.15.156:57902) 2023-09-30T22:22:07.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.222+0000 7f5570fb8700 1 -- 172.21.15.156:0/1411685519 learned_addr learned my addr 172.21.15.156:0/1411685519 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:07.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.222+0000 7f5571fba700 1 --2- 172.21.15.156:0/1411685519 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f556c134120 0x7f556c123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:07.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.222+0000 7f55717b9700 1 --2- 172.21.15.156:0/1411685519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f556c0a0a70 0x7f556c122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:07.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.222+0000 7f5570fb8700 1 -- 172.21.15.156:0/1411685519 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f556c134120 msgr2=0x7f556c123180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.222+0000 7f5570fb8700 1 --2- 172.21.15.156:0/1411685519 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f556c134120 0x7f556c123180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.222+0000 7f5570fb8700 1 -- 172.21.15.156:0/1411685519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f556c0a0a70 msgr2=0x7f556c122700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.222+0000 7f5570fb8700 1 --2- 172.21.15.156:0/1411685519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f556c0a0a70 0x7f556c122700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.222+0000 7f5570fb8700 1 -- 172.21.15.156:0/1411685519 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5564009b30 con 0x7f556c0a1380 2023-09-30T22:22:07.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.222+0000 7f5571fba700 1 --2- 172.21.15.156:0/1411685519 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f556c134120 0x7f556c123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:07.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.222+0000 7f55717b9700 1 --2- 172.21.15.156:0/1411685519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f556c0a0a70 0x7f556c122700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:07.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.223+0000 7f5570fb8700 1 --2- 172.21.15.156:0/1411685519 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f556c0a1380 0x7f556c122c40 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f555c00c550 tx=0x7f555c00c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:07.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.223+0000 7f5561ffb700 1 -- 172.21.15.156:0/1411685519 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c0054e0 con 0x7f556c0a1380 2023-09-30T22:22:07.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.223+0000 7f5561ffb700 1 -- 172.21.15.156:0/1411685519 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555c003680 con 0x7f556c0a1380 2023-09-30T22:22:07.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.223+0000 7f5573a1d700 1 -- 172.21.15.156:0/1411685519 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55680094a0 con 0x7f556c0a1380 2023-09-30T22:22:07.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.223+0000 7f5561ffb700 1 -- 172.21.15.156:0/1411685519 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c003a30 con 0x7f556c0a1380 2023-09-30T22:22:07.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.223+0000 7f5573a1d700 1 -- 172.21.15.156:0/1411685519 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f556c0a03e0 con 0x7f556c0a1380 2023-09-30T22:22:07.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.224+0000 7f5561ffb700 1 -- 172.21.15.156:0/1411685519 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f555c003b90 con 0x7f556c0a1380 2023-09-30T22:22:07.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.224+0000 7f5561ffb700 1 -- 172.21.15.156:0/1411685519 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f555c03ea90 con 0x7f556c0a1380 2023-09-30T22:22:07.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.224+0000 7f5573a1d700 1 -- 172.21.15.156:0/1411685519 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f556c04f2a0 con 0x7f556c0a1380 2023-09-30T22:22:07.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.229+0000 7f5561ffb700 1 -- 172.21.15.156:0/1411685519 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f555c017080 con 0x7f556c0a1380 2023-09-30T22:22:07.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.237+0000 7f9187618700 1 -- 172.21.15.156:0/2991885221 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f918006ef20 con 0x7f9180139280 2023-09-30T22:22:07.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.238+0000 7f9175ffb700 1 -- 172.21.15.156:0/2991885221 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f917802b090 con 0x7f9180139280 2023-09-30T22:22:07.238 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:07.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.240+0000 7f9187618700 1 -- 172.21.15.156:0/2991885221 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9180139280 msgr2=0x7f91801c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.240+0000 7f9187618700 1 --2- 172.21.15.156:0/2991885221 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9180139280 0x7f91801c8470 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f917800ef90 tx=0x7f917800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.240+0000 7f9187618700 1 -- 172.21.15.156:0/2991885221 shutdown_connections 2023-09-30T22:22:07.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.240+0000 7f9187618700 1 --2- 172.21.15.156:0/2991885221 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9180139280 0x7f91801c8470 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.240+0000 7f9187618700 1 --2- 172.21.15.156:0/2991885221 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9180133ad0 0x7f9180071770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.240+0000 7f9187618700 1 --2- 172.21.15.156:0/2991885221 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9180136960 0x7f9180071cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.240+0000 7f9187618700 1 -- 172.21.15.156:0/2991885221 >> 172.21.15.156:0/2991885221 conn(0x7f9180099c40 msgr2=0x7f91801371c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:07.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.240+0000 7f9187618700 1 -- 172.21.15.156:0/2991885221 shutdown_connections 2023-09-30T22:22:07.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.240+0000 7f9187618700 1 -- 172.21.15.156:0/2991885221 wait complete. 2023-09-30T22:22:07.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:07.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.358+0000 7fb9c54f9700 1 -- 172.21.15.156:0/4235651910 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb9c004f2a0 con 0x7fb9c0134210 2023-09-30T22:22:07.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.359+0000 7fb9a77fe700 1 -- 172.21.15.156:0/4235651910 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb9b801c3b0 con 0x7fb9c0134210 2023-09-30T22:22:07.360 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:07.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.362+0000 7fb9c54f9700 1 -- 172.21.15.156:0/4235651910 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb9c0134210 msgr2=0x7fb9c011e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.362+0000 7fb9c54f9700 1 --2- 172.21.15.156:0/4235651910 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb9c0134210 0x7fb9c011e220 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800efc0 tx=0x7fb9b800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.362+0000 7fb9c54f9700 1 -- 172.21.15.156:0/4235651910 shutdown_connections 2023-09-30T22:22:07.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.362+0000 7fb9c54f9700 1 --2- 172.21.15.156:0/4235651910 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb9c0134210 0x7fb9c011e220 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.362+0000 7fb9c54f9700 1 --2- 172.21.15.156:0/4235651910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9c00a0ee0 0x7fb9c011d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.362+0000 7fb9c54f9700 1 --2- 172.21.15.156:0/4235651910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb9c0133900 0x7fb9c011dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.362+0000 7fb9c54f9700 1 -- 172.21.15.156:0/4235651910 >> 172.21.15.156:0/4235651910 conn(0x7fb9c00a2980 msgr2=0x7fb9c01bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:07.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.362+0000 7fb9c54f9700 1 -- 172.21.15.156:0/4235651910 shutdown_connections 2023-09-30T22:22:07.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.362+0000 7fb9c54f9700 1 -- 172.21.15.156:0/4235651910 wait complete. 2023-09-30T22:22:07.375 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:07.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.437+0000 7f5573a1d700 1 -- 172.21.15.156:0/1411685519 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f556c072980 con 0x7f556c0a1380 2023-09-30T22:22:07.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.438+0000 7f5561ffb700 1 -- 172.21.15.156:0/1411685519 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f555c003e40 con 0x7f556c0a1380 2023-09-30T22:22:07.439 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:07.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.440+0000 7f5573a1d700 1 -- 172.21.15.156:0/1411685519 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f556c0a1380 msgr2=0x7f556c122c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.440+0000 7f5573a1d700 1 --2- 172.21.15.156:0/1411685519 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f556c0a1380 0x7f556c122c40 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f555c00c550 tx=0x7f555c00c860 comp rx=0 tx=0).stop 2023-09-30T22:22:07.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.440+0000 7f5573a1d700 1 -- 172.21.15.156:0/1411685519 shutdown_connections 2023-09-30T22:22:07.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.440+0000 7f5573a1d700 1 --2- 172.21.15.156:0/1411685519 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f556c134120 0x7f556c123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.440+0000 7f5573a1d700 1 --2- 172.21.15.156:0/1411685519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f556c0a0a70 0x7f556c122700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.440+0000 7f5573a1d700 1 --2- 172.21.15.156:0/1411685519 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f556c0a1380 0x7f556c122c40 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.440+0000 7f5573a1d700 1 -- 172.21.15.156:0/1411685519 >> 172.21.15.156:0/1411685519 conn(0x7f556c0a6610 msgr2=0x7f556c09aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:07.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.440+0000 7f5573a1d700 1 -- 172.21.15.156:0/1411685519 shutdown_connections 2023-09-30T22:22:07.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.440+0000 7f5573a1d700 1 -- 172.21.15.156:0/1411685519 wait complete. 2023-09-30T22:22:07.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:07.768 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:07.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.891+0000 7f6fabc99700 1 Processor -- start 2023-09-30T22:22:07.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.891+0000 7f6fabc99700 1 -- start start 2023-09-30T22:22:07.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.892+0000 7f6fabc99700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fa4133ad0 0x7f6fa4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:07.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.892+0000 7f6fabc99700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6fa4130bc0 0x7f6fa413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:07.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.892+0000 7f6fabc99700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa406b2d0 con 0x7f6fa41300a0 2023-09-30T22:22:07.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.892+0000 7f6fabc99700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa4133610 con 0x7f6fa4130bc0 2023-09-30T22:22:07.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.892+0000 7f6fabc99700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa409a500 con 0x7f6fa4133ad0 2023-09-30T22:22:07.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.892+0000 7f6faa236700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6fa4130bc0 0x7f6fa413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:07.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.892+0000 7f6faa236700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6fa4130bc0 0x7f6fa413b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47248/0 (socket says 172.21.15.156:47248) 2023-09-30T22:22:07.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.892+0000 7f6fa9234700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6fa41300a0 0x7f6fa41304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58206/0 (socket says 172.21.15.156:58206) 2023-09-30T22:22:07.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.892+0000 7f6faa236700 1 -- 172.21.15.156:0/124958112 learned_addr learned my addr 172.21.15.156:0/124958112 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:07.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.892+0000 7f6fa9a35700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fa4133ad0 0x7f6fa4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:07.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.892+0000 7f6faa236700 1 -- 172.21.15.156:0/124958112 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fa4133ad0 msgr2=0x7f6fa4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:07.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.892+0000 7f6faa236700 1 --2- 172.21.15.156:0/124958112 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fa4133ad0 0x7f6fa4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.892+0000 7f6faa236700 1 -- 172.21.15.156:0/124958112 >> v1:172.21.15.156:6789/0 conn(0x7f6fa41300a0 legacy=0x7f6fa41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.892+0000 7f6fa8a33700 1 -- 172.21.15.156:0/124958112 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262322601 0 0) 0x7f6fa406b2d0 con 0x7f6fa41300a0 2023-09-30T22:22:07.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.892+0000 7f6faa236700 1 -- 172.21.15.156:0/124958112 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa41338b0 con 0x7f6fa4130bc0 2023-09-30T22:22:07.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.892+0000 7f6fa9a35700 1 --2- 172.21.15.156:0/124958112 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fa4133ad0 0x7f6fa4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:07.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.892+0000 7f6faa236700 1 --2- 172.21.15.156:0/124958112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fa4130bc0 0x7f6fa413b990 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c009e50 tx=0x7f6f9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e3ecb35e030511 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:07.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.893+0000 7f6fa8a33700 1 -- 172.21.15.156:0/124958112 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c00e070 con 0x7f6fa4130bc0 2023-09-30T22:22:07.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.893+0000 7f6fa8a33700 1 -- 172.21.15.156:0/124958112 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9c00b910 con 0x7f6fa4130bc0 2023-09-30T22:22:07.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.893+0000 7f6fa8a33700 1 -- 172.21.15.156:0/124958112 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c00bcc0 con 0x7f6fa4130bc0 2023-09-30T22:22:07.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.893+0000 7f6fabc99700 1 -- 172.21.15.156:0/124958112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fa4130bc0 msgr2=0x7f6fa413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.893+0000 7f6fabc99700 1 --2- 172.21.15.156:0/124958112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fa4130bc0 0x7f6fa413b990 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c009e50 tx=0x7f6f9c00b330 comp rx=0 tx=0).stop 2023-09-30T22:22:07.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.893+0000 7f6fabc99700 1 -- 172.21.15.156:0/124958112 shutdown_connections 2023-09-30T22:22:07.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.893+0000 7f6fabc99700 1 --2- 172.21.15.156:0/124958112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fa4130bc0 0x7f6fa413b990 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.893+0000 7f6fabc99700 1 --2- 172.21.15.156:0/124958112 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fa4133ad0 0x7f6fa4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.893+0000 7f6fabc99700 1 -- 172.21.15.156:0/124958112 >> 172.21.15.156:0/124958112 conn(0x7f6fa4099c40 msgr2=0x7f6fa40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:07.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.893+0000 7f6fabc99700 1 -- 172.21.15.156:0/124958112 shutdown_connections 2023-09-30T22:22:07.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.893+0000 7f6fabc99700 1 -- 172.21.15.156:0/124958112 wait complete. 2023-09-30T22:22:07.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.894+0000 7f6fabc99700 1 Processor -- start 2023-09-30T22:22:07.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.894+0000 7f6fabc99700 1 -- start start 2023-09-30T22:22:07.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.894+0000 7f6fabc99700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fa41300a0 0x7f6fa411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:07.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.894+0000 7f6fabc99700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fa4130bc0 0x7f6fa411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:07.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.894+0000 7f6fabc99700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fa4133ad0 0x7f6fa411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:07.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.894+0000 7f6fabc99700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa41208e0 con 0x7f6fa4133ad0 2023-09-30T22:22:07.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.894+0000 7f6fabc99700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa411f9d0 con 0x7f6fa4130bc0 2023-09-30T22:22:07.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.894+0000 7f6fabc99700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa4120070 con 0x7f6fa41300a0 2023-09-30T22:22:07.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.895+0000 7f6fa9234700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fa4130bc0 0x7f6fa411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:07.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.895+0000 7f6faa236700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fa4133ad0 0x7f6fa411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:07.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.895+0000 7f6fa9a35700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fa41300a0 0x7f6fa411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:07.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.895+0000 7f6fa9234700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fa4130bc0 0x7f6fa411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57926/0 (socket says 172.21.15.156:57926) 2023-09-30T22:22:07.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.895+0000 7f6fa9a35700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fa41300a0 0x7f6fa411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33720/0 (socket says 172.21.15.156:33720) 2023-09-30T22:22:07.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.895+0000 7f6fa9234700 1 -- 172.21.15.156:0/3652046003 learned_addr learned my addr 172.21.15.156:0/3652046003 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:07.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.895+0000 7f6faa236700 1 --2- 172.21.15.156:0/3652046003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fa4133ad0 0x7f6fa411e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47262/0 (socket says 172.21.15.156:47262) 2023-09-30T22:22:07.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.895+0000 7f6fa9234700 1 -- 172.21.15.156:0/3652046003 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fa41300a0 msgr2=0x7f6fa411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.895+0000 7f6fa9234700 1 --2- 172.21.15.156:0/3652046003 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fa41300a0 0x7f6fa411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.895+0000 7f6fa9234700 1 -- 172.21.15.156:0/3652046003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fa4133ad0 msgr2=0x7f6fa411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.895+0000 7f6fa9234700 1 --2- 172.21.15.156:0/3652046003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fa4133ad0 0x7f6fa411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:07.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.895+0000 7f6fa9234700 1 -- 172.21.15.156:0/3652046003 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f940094a0 con 0x7f6fa4130bc0 2023-09-30T22:22:07.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.895+0000 7f6faa236700 1 --2- 172.21.15.156:0/3652046003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fa4133ad0 0x7f6fa411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:07.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.895+0000 7f6fa9a35700 1 --2- 172.21.15.156:0/3652046003 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fa41300a0 0x7f6fa411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:07.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.895+0000 7f6fa9234700 1 --2- 172.21.15.156:0/3652046003 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fa4130bc0 0x7f6fa411df80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6fa000c450 tx=0x7f6fa000c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:07.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.895+0000 7f6f9a7fc700 1 -- 172.21.15.156:0/3652046003 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0004c80 con 0x7f6fa4130bc0 2023-09-30T22:22:07.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.895+0000 7f6f9a7fc700 1 -- 172.21.15.156:0/3652046003 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa0004e00 con 0x7f6fa4130bc0 2023-09-30T22:22:07.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.895+0000 7f6fabc99700 1 -- 172.21.15.156:0/3652046003 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f9c009b30 con 0x7f6fa4130bc0 2023-09-30T22:22:07.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.895+0000 7f6f9a7fc700 1 -- 172.21.15.156:0/3652046003 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0007310 con 0x7f6fa4130bc0 2023-09-30T22:22:07.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.895+0000 7f6fabc99700 1 -- 172.21.15.156:0/3652046003 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa412dd00 con 0x7f6fa4130bc0 2023-09-30T22:22:07.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.896+0000 7f6f9a7fc700 1 -- 172.21.15.156:0/3652046003 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6fa0007470 con 0x7f6fa4130bc0 2023-09-30T22:22:07.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.896+0000 7f6fabc99700 1 -- 172.21.15.156:0/3652046003 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa411feb0 con 0x7f6fa4130bc0 2023-09-30T22:22:07.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.896+0000 7f6f9a7fc700 1 -- 172.21.15.156:0/3652046003 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6fa003f210 con 0x7f6fa4130bc0 2023-09-30T22:22:07.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:07.901+0000 7f6f9a7fc700 1 -- 172.21.15.156:0/3652046003 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6fa411feb0 con 0x7f6fa4130bc0 2023-09-30T22:22:08.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.082+0000 7f6fabc99700 1 -- 172.21.15.156:0/3652046003 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6fa409cb20 con 0x7f6fa4130bc0 2023-09-30T22:22:08.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.082+0000 7f6f9a7fc700 1 -- 172.21.15.156:0/3652046003 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6fa000ce60 con 0x7f6fa4130bc0 2023-09-30T22:22:08.083 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:08.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.084+0000 7f6fabc99700 1 -- 172.21.15.156:0/3652046003 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fa4130bc0 msgr2=0x7f6fa411df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:08.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.084+0000 7f6fabc99700 1 --2- 172.21.15.156:0/3652046003 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fa4130bc0 0x7f6fa411df80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6fa000c450 tx=0x7f6fa000c760 comp rx=0 tx=0).stop 2023-09-30T22:22:08.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.084+0000 7f6fabc99700 1 -- 172.21.15.156:0/3652046003 shutdown_connections 2023-09-30T22:22:08.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.084+0000 7f6fabc99700 1 --2- 172.21.15.156:0/3652046003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fa4133ad0 0x7f6fa411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.084+0000 7f6fabc99700 1 --2- 172.21.15.156:0/3652046003 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fa41300a0 0x7f6fa411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.084+0000 7f6fabc99700 1 --2- 172.21.15.156:0/3652046003 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fa4130bc0 0x7f6fa411df80 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.084+0000 7f6fabc99700 1 -- 172.21.15.156:0/3652046003 >> 172.21.15.156:0/3652046003 conn(0x7f6fa4099c40 msgr2=0x7f6fa4132950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:08.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.084+0000 7f6fabc99700 1 -- 172.21.15.156:0/3652046003 shutdown_connections 2023-09-30T22:22:08.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.084+0000 7f6fabc99700 1 -- 172.21.15.156:0/3652046003 wait complete. 2023-09-30T22:22:08.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:08.254 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:08.376 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:08.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.376+0000 7f8f83c33700 1 Processor -- start 2023-09-30T22:22:08.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.376+0000 7f8f83c33700 1 -- start start 2023-09-30T22:22:08.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.377+0000 7f8f83c33700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f7c09e870 0x7f8f7c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:08.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.377+0000 7f8f83c33700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8f7c09f180 0x7f8f7c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:08.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.377+0000 7f8f83c33700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f7c09c970 con 0x7f8f7c131d70 2023-09-30T22:22:08.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.377+0000 7f8f83c33700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f7c0a0920 con 0x7f8f7c09f180 2023-09-30T22:22:08.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.377+0000 7f8f83c33700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c09f9c0 con 0x7f8f7c09e870 2023-09-30T22:22:08.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.377+0000 7f8f811ce700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8f7c09f180 0x7f8f7c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:08.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.377+0000 7f8f819cf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f7c09e870 0x7f8f7c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:08.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.377+0000 7f8f821d0700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f8f7c131d70 0x7f8f7c138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58214/0 (socket says 172.21.15.156:58214) 2023-09-30T22:22:08.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.377+0000 7f8f811ce700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8f7c09f180 0x7f8f7c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47274/0 (socket says 172.21.15.156:47274) 2023-09-30T22:22:08.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.377+0000 7f8f821d0700 1 -- 172.21.15.156:0/2511008219 learned_addr learned my addr 172.21.15.156:0/2511008219 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:08.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.377+0000 7f8f819cf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f7c09e870 0x7f8f7c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33736/0 (socket says 172.21.15.156:33736) 2023-09-30T22:22:08.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.377+0000 7f8f811ce700 1 -- 172.21.15.156:0/2511008219 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f7c09e870 msgr2=0x7f8f7c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:08.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.377+0000 7f8f811ce700 1 --2- 172.21.15.156:0/2511008219 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f7c09e870 0x7f8f7c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.377+0000 7f8f811ce700 1 -- 172.21.15.156:0/2511008219 >> v1:172.21.15.156:6789/0 conn(0x7f8f7c131d70 legacy=0x7f8f7c138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:08.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.377+0000 7f8f811ce700 1 -- 172.21.15.156:0/2511008219 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7c09bab0 con 0x7f8f7c09f180 2023-09-30T22:22:08.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.377+0000 7f8f809cd700 1 -- 172.21.15.156:0/2511008219 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1707213670 0 0) 0x7f8f7c09c970 con 0x7f8f7c131d70 2023-09-30T22:22:08.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.377+0000 7f8f819cf700 1 --2- 172.21.15.156:0/2511008219 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f7c09e870 0x7f8f7c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:08.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.378+0000 7f8f811ce700 1 --2- 172.21.15.156:0/2511008219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f7c09f180 0x7f8f7c131830 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009840 tx=0x7f8f78009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa547168f2743f42 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:08.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.378+0000 7f8f809cd700 1 -- 172.21.15.156:0/2511008219 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f78011830 con 0x7f8f7c09f180 2023-09-30T22:22:08.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.378+0000 7f8f809cd700 1 -- 172.21.15.156:0/2511008219 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f78011990 con 0x7f8f7c09f180 2023-09-30T22:22:08.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.378+0000 7f8f809cd700 1 -- 172.21.15.156:0/2511008219 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f78011d20 con 0x7f8f7c09f180 2023-09-30T22:22:08.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.378+0000 7f8f83c33700 1 -- 172.21.15.156:0/2511008219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f7c09f180 msgr2=0x7f8f7c131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:08.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.378+0000 7f8f83c33700 1 --2- 172.21.15.156:0/2511008219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f7c09f180 0x7f8f7c131830 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009840 tx=0x7f8f78009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:08.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.378+0000 7f8f83c33700 1 -- 172.21.15.156:0/2511008219 shutdown_connections 2023-09-30T22:22:08.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.378+0000 7f8f83c33700 1 --2- 172.21.15.156:0/2511008219 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f7c09e870 0x7f8f7c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.378+0000 7f8f83c33700 1 --2- 172.21.15.156:0/2511008219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f7c09f180 0x7f8f7c131830 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.378+0000 7f8f83c33700 1 -- 172.21.15.156:0/2511008219 >> 172.21.15.156:0/2511008219 conn(0x7f8f7c0a4430 msgr2=0x7f8f7c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:08.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.378+0000 7f8f83c33700 1 -- 172.21.15.156:0/2511008219 shutdown_connections 2023-09-30T22:22:08.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.379+0000 7f8f83c33700 1 -- 172.21.15.156:0/2511008219 wait complete. 2023-09-30T22:22:08.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.379+0000 7f8f83c33700 1 Processor -- start 2023-09-30T22:22:08.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.379+0000 7f8f83c33700 1 -- start start 2023-09-30T22:22:08.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.380+0000 7f8f83c33700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f7c09e870 0x7f8f7c11f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:08.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.380+0000 7f8f83c33700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f7c09f180 0x7f8f7c11f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:08.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.380+0000 7f8f83c33700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f7c131d70 0x7f8f7c11fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:08.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.380+0000 7f8f83c33700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c122e20 con 0x7f8f7c131d70 2023-09-30T22:22:08.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.380+0000 7f8f83c33700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c121da0 con 0x7f8f7c09e870 2023-09-30T22:22:08.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.380+0000 7f8f83c33700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c1225b0 con 0x7f8f7c09f180 2023-09-30T22:22:08.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.380+0000 7f8f819cf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f7c09e870 0x7f8f7c11f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:08.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.380+0000 7f8f811ce700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f7c09f180 0x7f8f7c11f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:08.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.380+0000 7f8f811ce700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f7c09f180 0x7f8f7c11f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33752/0 (socket says 172.21.15.156:33752) 2023-09-30T22:22:08.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.380+0000 7f8f811ce700 1 -- 172.21.15.156:0/767896120 learned_addr learned my addr 172.21.15.156:0/767896120 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:08.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.380+0000 7f8f821d0700 1 --2- 172.21.15.156:0/767896120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f7c131d70 0x7f8f7c11fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:08.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.380+0000 7f8f811ce700 1 -- 172.21.15.156:0/767896120 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f7c09e870 msgr2=0x7f8f7c11f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:08.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.380+0000 7f8f811ce700 1 --2- 172.21.15.156:0/767896120 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f7c09e870 0x7f8f7c11f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.380+0000 7f8f811ce700 1 -- 172.21.15.156:0/767896120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f7c131d70 msgr2=0x7f8f7c11fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:08.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.380+0000 7f8f811ce700 1 --2- 172.21.15.156:0/767896120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f7c131d70 0x7f8f7c11fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.380+0000 7f8f811ce700 1 -- 172.21.15.156:0/767896120 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6c0094a0 con 0x7f8f7c09f180 2023-09-30T22:22:08.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.380+0000 7f8f811ce700 1 --2- 172.21.15.156:0/767896120 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f7c09f180 0x7f8f7c11f840 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8f780090b0 tx=0x7f8f78004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:08.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.381+0000 7f8f727fc700 1 -- 172.21.15.156:0/767896120 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f78004550 con 0x7f8f7c09f180 2023-09-30T22:22:08.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.381+0000 7f8f727fc700 1 -- 172.21.15.156:0/767896120 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7801f070 con 0x7f8f7c09f180 2023-09-30T22:22:08.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.381+0000 7f8f83c33700 1 -- 172.21.15.156:0/767896120 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f780094a0 con 0x7f8f7c09f180 2023-09-30T22:22:08.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.381+0000 7f8f727fc700 1 -- 172.21.15.156:0/767896120 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f780038e0 con 0x7f8f7c09f180 2023-09-30T22:22:08.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.381+0000 7f8f83c33700 1 -- 172.21.15.156:0/767896120 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f7c131880 con 0x7f8f7c09f180 2023-09-30T22:22:08.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.382+0000 7f8f83c33700 1 -- 172.21.15.156:0/767896120 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f7c1229a0 con 0x7f8f7c09f180 2023-09-30T22:22:08.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.382+0000 7f8f727fc700 1 -- 172.21.15.156:0/767896120 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f78003a40 con 0x7f8f7c09f180 2023-09-30T22:22:08.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.382+0000 7f8f727fc700 1 -- 172.21.15.156:0/767896120 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8f78021070 con 0x7f8f7c09f180 2023-09-30T22:22:08.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.387+0000 7f8f727fc700 1 -- 172.21.15.156:0/767896120 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f780193b0 con 0x7f8f7c09f180 2023-09-30T22:22:08.453 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:08.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.508+0000 7fc07bccc700 1 Processor -- start 2023-09-30T22:22:08.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.508+0000 7fc07bccc700 1 -- start start 2023-09-30T22:22:08.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.509+0000 7fc07bccc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc07409e870 0x7fc07409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:08.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.509+0000 7fc07bccc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc07409f180 0x7fc074133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:08.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.509+0000 7fc07bccc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc074134160 0x7fc074134600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:08.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.509+0000 7fc07bccc700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0740a0370 con 0x7fc07409f180 2023-09-30T22:22:08.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.509+0000 7fc07bccc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07409fa00 con 0x7fc07409e870 2023-09-30T22:22:08.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.509+0000 7fc07bccc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc07409ada0 con 0x7fc074134160 2023-09-30T22:22:08.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.509+0000 7fc079a68700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc07409e870 0x7fc07409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:08.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.509+0000 7fc079267700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc07409f180 0x7fc074133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:08.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.509+0000 7fc079a68700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc07409e870 0x7fc07409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57934/0 (socket says 172.21.15.156:57934) 2023-09-30T22:22:08.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.509+0000 7fc079267700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc07409f180 0x7fc074133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47282/0 (socket says 172.21.15.156:47282) 2023-09-30T22:22:08.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.509+0000 7fc079a68700 1 -- 172.21.15.156:0/2407350808 learned_addr learned my addr 172.21.15.156:0/2407350808 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:08.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.509+0000 7fc07a269700 1 --2- 172.21.15.156:0/2407350808 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc074134160 0x7fc074134600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:08.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.510+0000 7fc079267700 1 -- 172.21.15.156:0/2407350808 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc074134160 msgr2=0x7fc074134600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:08.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.510+0000 7fc079267700 1 --2- 172.21.15.156:0/2407350808 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc074134160 0x7fc074134600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.510+0000 7fc079267700 1 -- 172.21.15.156:0/2407350808 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc07409e870 msgr2=0x7fc07409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:08.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.510+0000 7fc079267700 1 --2- 172.21.15.156:0/2407350808 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc07409e870 0x7fc07409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.510+0000 7fc079267700 1 -- 172.21.15.156:0/2407350808 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07406bec0 con 0x7fc07409f180 2023-09-30T22:22:08.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.510+0000 7fc079a68700 1 --2- 172.21.15.156:0/2407350808 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc07409e870 0x7fc07409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:08.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.510+0000 7fc079267700 1 --2- 172.21.15.156:0/2407350808 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc07409f180 0x7fc074133c20 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fc064009870 tx=0x7fc064009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588eb1369defc056 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:08.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.510+0000 7fc078a66700 1 -- 172.21.15.156:0/2407350808 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc064011830 con 0x7fc07409f180 2023-09-30T22:22:08.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.510+0000 7fc078a66700 1 -- 172.21.15.156:0/2407350808 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc064011990 con 0x7fc07409f180 2023-09-30T22:22:08.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.510+0000 7fc078a66700 1 -- 172.21.15.156:0/2407350808 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc064011d20 con 0x7fc07409f180 2023-09-30T22:22:08.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.511+0000 7fc07bccc700 1 -- 172.21.15.156:0/2407350808 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc07409f180 msgr2=0x7fc074133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:08.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.511+0000 7fc07bccc700 1 --2- 172.21.15.156:0/2407350808 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc07409f180 0x7fc074133c20 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fc064009870 tx=0x7fc064009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:08.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.511+0000 7fc07bccc700 1 -- 172.21.15.156:0/2407350808 shutdown_connections 2023-09-30T22:22:08.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.511+0000 7fc07bccc700 1 --2- 172.21.15.156:0/2407350808 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc074134160 0x7fc074134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.511+0000 7fc07bccc700 1 --2- 172.21.15.156:0/2407350808 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc07409e870 0x7fc07409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.511+0000 7fc07bccc700 1 --2- 172.21.15.156:0/2407350808 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc07409f180 0x7fc074133c20 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.511+0000 7fc07bccc700 1 -- 172.21.15.156:0/2407350808 >> 172.21.15.156:0/2407350808 conn(0x7fc0740a4430 msgr2=0x7fc0740a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:08.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.511+0000 7fc07bccc700 1 -- 172.21.15.156:0/2407350808 shutdown_connections 2023-09-30T22:22:08.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.511+0000 7fc07bccc700 1 -- 172.21.15.156:0/2407350808 wait complete. 2023-09-30T22:22:08.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.512+0000 7fc07bccc700 1 Processor -- start 2023-09-30T22:22:08.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.512+0000 7fc07bccc700 1 -- start start 2023-09-30T22:22:08.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.513+0000 7fc07bccc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc07409e870 0x7fc074122540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:08.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.513+0000 7fc07bccc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc07409f180 0x7fc074122a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:08.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.513+0000 7fc07bccc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc074134160 0x7fc074122fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:08.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.513+0000 7fc07bccc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc074123a10 con 0x7fc074134160 2023-09-30T22:22:08.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.513+0000 7fc07bccc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc074133910 con 0x7fc07409f180 2023-09-30T22:22:08.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.513+0000 7fc07bccc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc074124fe0 con 0x7fc07409e870 2023-09-30T22:22:08.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.513+0000 7fc079267700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc07409f180 0x7fc074122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:08.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.513+0000 7fc079a68700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc07409e870 0x7fc074122540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:08.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.513+0000 7fc079267700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc07409f180 0x7fc074122a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57948/0 (socket says 172.21.15.156:57948) 2023-09-30T22:22:08.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.513+0000 7fc079267700 1 -- 172.21.15.156:0/3443822961 learned_addr learned my addr 172.21.15.156:0/3443822961 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:08.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.513+0000 7fc07a269700 1 --2- 172.21.15.156:0/3443822961 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc074134160 0x7fc074122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:08.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.513+0000 7fc079267700 1 -- 172.21.15.156:0/3443822961 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc07409e870 msgr2=0x7fc074122540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:08.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.513+0000 7fc079267700 1 --2- 172.21.15.156:0/3443822961 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc07409e870 0x7fc074122540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.513+0000 7fc079267700 1 -- 172.21.15.156:0/3443822961 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc074134160 msgr2=0x7fc074122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:08.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.513+0000 7fc079267700 1 --2- 172.21.15.156:0/3443822961 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc074134160 0x7fc074122fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.513+0000 7fc079267700 1 -- 172.21.15.156:0/3443822961 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc070009550 con 0x7fc07409f180 2023-09-30T22:22:08.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.514+0000 7fc079267700 1 --2- 172.21.15.156:0/3443822961 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc07409f180 0x7fc074122a80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc0640090b0 tx=0x7fc064004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:08.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.514+0000 7fc06a7fc700 1 -- 172.21.15.156:0/3443822961 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc064004450 con 0x7fc07409f180 2023-09-30T22:22:08.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.514+0000 7fc06a7fc700 1 -- 172.21.15.156:0/3443822961 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06401f070 con 0x7fc07409f180 2023-09-30T22:22:08.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.514+0000 7fc07bccc700 1 -- 172.21.15.156:0/3443822961 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0640094a0 con 0x7fc07409f180 2023-09-30T22:22:08.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.514+0000 7fc06a7fc700 1 -- 172.21.15.156:0/3443822961 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0640038e0 con 0x7fc07409f180 2023-09-30T22:22:08.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.514+0000 7fc07bccc700 1 -- 172.21.15.156:0/3443822961 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0741257f0 con 0x7fc07409f180 2023-09-30T22:22:08.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.515+0000 7fc06a7fc700 1 -- 172.21.15.156:0/3443822961 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc064003a40 con 0x7fc07409f180 2023-09-30T22:22:08.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.515+0000 7fc06a7fc700 1 -- 172.21.15.156:0/3443822961 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc064021070 con 0x7fc07409f180 2023-09-30T22:22:08.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.515+0000 7fc07bccc700 1 -- 172.21.15.156:0/3443822961 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0740a16c0 con 0x7fc07409f180 2023-09-30T22:22:08.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.520+0000 7fc06a7fc700 1 -- 172.21.15.156:0/3443822961 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc064015020 con 0x7fc07409f180 2023-09-30T22:22:08.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.585+0000 7f8f83c33700 1 -- 172.21.15.156:0/767896120 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8f7c1229a0 con 0x7f8f7c09f180 2023-09-30T22:22:08.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.585+0000 7f8f727fc700 1 -- 172.21.15.156:0/767896120 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f7c1229a0 con 0x7f8f7c09f180 2023-09-30T22:22:08.586 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:08.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.586+0000 7f7c72c25700 1 Processor -- start 2023-09-30T22:22:08.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.586+0000 7f7c72c25700 1 -- start start 2023-09-30T22:22:08.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.586+0000 7f7c72c25700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c6c133ad0 0x7f7c6c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:08.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.586+0000 7f7c72c25700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c6c1300a0 0x7f7c6c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:08.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.586+0000 7f7c72c25700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7c6c1309f0 0x7f7c6c13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:08.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.586+0000 7f7c72c25700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c6c06b2d0 con 0x7f7c6c1309f0 2023-09-30T22:22:08.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.586+0000 7f7c72c25700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c133610 con 0x7f7c6c1300a0 2023-09-30T22:22:08.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.586+0000 7f7c72c25700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c09a500 con 0x7f7c6c133ad0 2023-09-30T22:22:08.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.586+0000 7f7c6bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c6c1300a0 0x7f7c6c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:08.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.587+0000 7f7c6bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c6c1300a0 0x7f7c6c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57952/0 (socket says 172.21.15.156:57952) 2023-09-30T22:22:08.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.587+0000 7f7c6bfff700 1 -- 172.21.15.156:0/4029245411 learned_addr learned my addr 172.21.15.156:0/4029245411 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:08.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.587+0000 7f7c711c2700 1 --2- 172.21.15.156:0/4029245411 >> v2:172.21.15.156:3300/0 conn(0x7f7c6c1309f0 0x7f7c6c13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:08.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.587+0000 7f7c709c1700 1 --2- 172.21.15.156:0/4029245411 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c6c133ad0 0x7f7c6c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:08.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.587+0000 7f7c6bfff700 1 -- 172.21.15.156:0/4029245411 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c6c133ad0 msgr2=0x7f7c6c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:08.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.587+0000 7f7c6bfff700 1 --2- 172.21.15.156:0/4029245411 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c6c133ad0 0x7f7c6c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.587+0000 7f7c6bfff700 1 -- 172.21.15.156:0/4029245411 >> v2:172.21.15.156:3300/0 conn(0x7f7c6c1309f0 msgr2=0x7f7c6c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:08.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.587+0000 7f7c6bfff700 1 --2- 172.21.15.156:0/4029245411 >> v2:172.21.15.156:3300/0 conn(0x7f7c6c1309f0 0x7f7c6c13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.587+0000 7f7c6bfff700 1 -- 172.21.15.156:0/4029245411 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c1338b0 con 0x7f7c6c1300a0 2023-09-30T22:22:08.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.587+0000 7f7c6bfff700 1 --2- 172.21.15.156:0/4029245411 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c6c1300a0 0x7f7c6c1304b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7c580098f0 tx=0x7f7c58009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81a3d9e4d1df3a12 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:08.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.587+0000 7f7c6b7fe700 1 -- 172.21.15.156:0/4029245411 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58011830 con 0x7f7c6c1300a0 2023-09-30T22:22:08.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.587+0000 7f7c6b7fe700 1 -- 172.21.15.156:0/4029245411 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c58011990 con 0x7f7c6c1300a0 2023-09-30T22:22:08.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.587+0000 7f7c6b7fe700 1 -- 172.21.15.156:0/4029245411 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58011d20 con 0x7f7c6c1300a0 2023-09-30T22:22:08.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.587+0000 7f8f83c33700 1 -- 172.21.15.156:0/767896120 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f7c09f180 msgr2=0x7f8f7c11f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:08.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.587+0000 7f8f83c33700 1 --2- 172.21.15.156:0/767896120 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f7c09f180 0x7f8f7c11f840 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8f780090b0 tx=0x7f8f78004750 comp rx=0 tx=0).stop 2023-09-30T22:22:08.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.588+0000 7f8f83c33700 1 -- 172.21.15.156:0/767896120 shutdown_connections 2023-09-30T22:22:08.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.588+0000 7f8f83c33700 1 --2- 172.21.15.156:0/767896120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f7c131d70 0x7f8f7c11fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.588+0000 7f8f83c33700 1 --2- 172.21.15.156:0/767896120 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f7c09e870 0x7f8f7c11f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.588+0000 7f8f83c33700 1 --2- 172.21.15.156:0/767896120 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f7c09f180 0x7f8f7c11f840 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.588+0000 7f8f83c33700 1 -- 172.21.15.156:0/767896120 >> 172.21.15.156:0/767896120 conn(0x7f8f7c0a4430 msgr2=0x7f8f7c1310a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:08.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.588+0000 7f8f83c33700 1 -- 172.21.15.156:0/767896120 shutdown_connections 2023-09-30T22:22:08.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.588+0000 7f8f83c33700 1 -- 172.21.15.156:0/767896120 wait complete. 2023-09-30T22:22:08.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.588+0000 7f7c72c25700 1 -- 172.21.15.156:0/4029245411 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c6c1300a0 msgr2=0x7f7c6c1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:08.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.588+0000 7f7c72c25700 1 --2- 172.21.15.156:0/4029245411 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c6c1300a0 0x7f7c6c1304b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7c580098f0 tx=0x7f7c58009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:08.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.588+0000 7f7c72c25700 1 -- 172.21.15.156:0/4029245411 shutdown_connections 2023-09-30T22:22:08.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.588+0000 7f7c72c25700 1 --2- 172.21.15.156:0/4029245411 >> v2:172.21.15.156:3300/0 conn(0x7f7c6c1309f0 0x7f7c6c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.588+0000 7f7c72c25700 1 --2- 172.21.15.156:0/4029245411 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c6c133ad0 0x7f7c6c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.588+0000 7f7c72c25700 1 --2- 172.21.15.156:0/4029245411 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c6c1300a0 0x7f7c6c1304b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.588+0000 7f7c72c25700 1 -- 172.21.15.156:0/4029245411 >> 172.21.15.156:0/4029245411 conn(0x7f7c6c099c40 msgr2=0x7f7c6c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:08.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.588+0000 7f7c72c25700 1 -- 172.21.15.156:0/4029245411 shutdown_connections 2023-09-30T22:22:08.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.588+0000 7f7c72c25700 1 -- 172.21.15.156:0/4029245411 wait complete. 2023-09-30T22:22:08.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.589+0000 7f7c72c25700 1 Processor -- start 2023-09-30T22:22:08.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.589+0000 7f7c72c25700 1 -- start start 2023-09-30T22:22:08.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.590+0000 7f7c72c25700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c6c1300a0 0x7f7c6c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:08.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.590+0000 7f7c72c25700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c6c1309f0 0x7f7c6c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:08.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.590+0000 7f7c72c25700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c6c133ad0 0x7f7c6c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:08.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.590+0000 7f7c72c25700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c11fb90 con 0x7f7c6c133ad0 2023-09-30T22:22:08.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.590+0000 7f7c72c25700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c12da50 con 0x7f7c6c1300a0 2023-09-30T22:22:08.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.590+0000 7f7c72c25700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c072210 con 0x7f7c6c1309f0 2023-09-30T22:22:08.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.590+0000 7f7c709c1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c6c1300a0 0x7f7c6c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:08.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.590+0000 7f7c709c1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c6c1300a0 0x7f7c6c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57968/0 (socket says 172.21.15.156:57968) 2023-09-30T22:22:08.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.590+0000 7f7c709c1700 1 -- 172.21.15.156:0/1390354460 learned_addr learned my addr 172.21.15.156:0/1390354460 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:08.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.590+0000 7f7c6bfff700 1 --2- 172.21.15.156:0/1390354460 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c6c1309f0 0x7f7c6c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:08.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.590+0000 7f7c709c1700 1 -- 172.21.15.156:0/1390354460 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c6c1309f0 msgr2=0x7f7c6c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:08.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.590+0000 7f7c709c1700 1 --2- 172.21.15.156:0/1390354460 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c6c1309f0 0x7f7c6c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.590+0000 7f7c709c1700 1 -- 172.21.15.156:0/1390354460 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c6c133ad0 msgr2=0x7f7c6c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:08.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.590+0000 7f7c709c1700 1 --2- 172.21.15.156:0/1390354460 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c6c133ad0 0x7f7c6c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.590+0000 7f7c709c1700 1 -- 172.21.15.156:0/1390354460 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c58009550 con 0x7f7c6c1300a0 2023-09-30T22:22:08.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.590+0000 7f7c709c1700 1 --2- 172.21.15.156:0/1390354460 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c6c1300a0 0x7f7c6c11da40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7c6000e9e0 tx=0x7f7c6000ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:08.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.590+0000 7f7c697fa700 1 -- 172.21.15.156:0/1390354460 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c60009710 con 0x7f7c6c1300a0 2023-09-30T22:22:08.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.590+0000 7f7c697fa700 1 -- 172.21.15.156:0/1390354460 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6000c7d0 con 0x7f7c6c1300a0 2023-09-30T22:22:08.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.590+0000 7f7c72c25700 1 -- 172.21.15.156:0/1390354460 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6c11fe50 con 0x7f7c6c1300a0 2023-09-30T22:22:08.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.591+0000 7f7c697fa700 1 -- 172.21.15.156:0/1390354460 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6000cb40 con 0x7f7c6c1300a0 2023-09-30T22:22:08.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.591+0000 7f7c72c25700 1 -- 172.21.15.156:0/1390354460 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6c0a2ef0 con 0x7f7c6c1300a0 2023-09-30T22:22:08.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.591+0000 7f7c697fa700 1 -- 172.21.15.156:0/1390354460 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c6000cca0 con 0x7f7c6c1300a0 2023-09-30T22:22:08.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.591+0000 7f7c697fa700 1 -- 172.21.15.156:0/1390354460 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7c6003f740 con 0x7f7c6c1300a0 2023-09-30T22:22:08.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.592+0000 7f7c72c25700 1 -- 172.21.15.156:0/1390354460 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c6c04f2a0 con 0x7f7c6c1300a0 2023-09-30T22:22:08.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.596+0000 7f7c697fa700 1 -- 172.21.15.156:0/1390354460 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c6001be10 con 0x7f7c6c1300a0 2023-09-30T22:22:08.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:08.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.718+0000 7fc07bccc700 1 -- 172.21.15.156:0/3443822961 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc07406cfa0 con 0x7fc07409f180 2023-09-30T22:22:08.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.718+0000 7fc06a7fc700 1 -- 172.21.15.156:0/3443822961 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc064024380 con 0x7fc07409f180 2023-09-30T22:22:08.719 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:08.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.720+0000 7fc07bccc700 1 -- 172.21.15.156:0/3443822961 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc07409f180 msgr2=0x7fc074122a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:08.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.720+0000 7fc07bccc700 1 --2- 172.21.15.156:0/3443822961 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc07409f180 0x7fc074122a80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc0640090b0 tx=0x7fc064004750 comp rx=0 tx=0).stop 2023-09-30T22:22:08.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.720+0000 7fc07bccc700 1 -- 172.21.15.156:0/3443822961 shutdown_connections 2023-09-30T22:22:08.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.720+0000 7fc07bccc700 1 --2- 172.21.15.156:0/3443822961 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc074134160 0x7fc074122fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.720+0000 7fc07bccc700 1 --2- 172.21.15.156:0/3443822961 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc07409e870 0x7fc074122540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.720+0000 7fc07bccc700 1 --2- 172.21.15.156:0/3443822961 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc07409f180 0x7fc074122a80 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.720+0000 7fc07bccc700 1 -- 172.21.15.156:0/3443822961 >> 172.21.15.156:0/3443822961 conn(0x7fc0740a4430 msgr2=0x7fc074072650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:08.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.721+0000 7fc07bccc700 1 -- 172.21.15.156:0/3443822961 shutdown_connections 2023-09-30T22:22:08.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.721+0000 7fc07bccc700 1 -- 172.21.15.156:0/3443822961 wait complete. 2023-09-30T22:22:08.733 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:08.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.787+0000 7f7c72c25700 1 -- 172.21.15.156:0/1390354460 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7c6c06c3b0 con 0x7f7c6c1300a0 2023-09-30T22:22:08.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.787+0000 7f7c697fa700 1 -- 172.21.15.156:0/1390354460 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c6002a090 con 0x7f7c6c1300a0 2023-09-30T22:22:08.789 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:08.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.789+0000 7f7c72c25700 1 -- 172.21.15.156:0/1390354460 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c6c1300a0 msgr2=0x7f7c6c11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:08.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.789+0000 7f7c72c25700 1 --2- 172.21.15.156:0/1390354460 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c6c1300a0 0x7f7c6c11da40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7c6000e9e0 tx=0x7f7c6000ecf0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.790+0000 7f7c72c25700 1 -- 172.21.15.156:0/1390354460 shutdown_connections 2023-09-30T22:22:08.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.790+0000 7f7c72c25700 1 --2- 172.21.15.156:0/1390354460 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c6c133ad0 0x7f7c6c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.790+0000 7f7c72c25700 1 --2- 172.21.15.156:0/1390354460 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c6c1300a0 0x7f7c6c11da40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.790+0000 7f7c72c25700 1 --2- 172.21.15.156:0/1390354460 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c6c1309f0 0x7f7c6c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.790+0000 7f7c72c25700 1 -- 172.21.15.156:0/1390354460 >> 172.21.15.156:0/1390354460 conn(0x7f7c6c099c40 msgr2=0x7f7c6c1321d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:08.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.790+0000 7f7c72c25700 1 -- 172.21.15.156:0/1390354460 shutdown_connections 2023-09-30T22:22:08.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:08.790+0000 7f7c72c25700 1 -- 172.21.15.156:0/1390354460 wait complete. 2023-09-30T22:22:08.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:09.098 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:09.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.220+0000 7f24fe016700 1 Processor -- start 2023-09-30T22:22:09.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.220+0000 7f24fe016700 1 -- start start 2023-09-30T22:22:09.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.221+0000 7f24fe016700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24f809a150 0x7f24f809e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:09.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.221+0000 7f24fe016700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f24f809edb0 0x7f24f809f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:09.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.221+0000 7f24fe016700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f809af80 con 0x7f24f8133c20 2023-09-30T22:22:09.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.221+0000 7f24fe016700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24f809fe00 con 0x7f24f809edb0 2023-09-30T22:22:09.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.221+0000 7f24fe016700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24f806bec0 con 0x7f24f809a150 2023-09-30T22:22:09.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.221+0000 7f24f77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24f809a150 0x7f24f809e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:09.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.221+0000 7f24f6ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f24f809edb0 0x7f24f809f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:09.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.221+0000 7f24f6ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f24f809edb0 0x7f24f809f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47304/0 (socket says 172.21.15.156:47304) 2023-09-30T22:22:09.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.221+0000 7f24f77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24f809a150 0x7f24f809e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33784/0 (socket says 172.21.15.156:33784) 2023-09-30T22:22:09.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.221+0000 7f24f6ffd700 1 -- 172.21.15.156:0/604867661 learned_addr learned my addr 172.21.15.156:0/604867661 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:09.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.221+0000 7f24f7fff700 1 --1- 172.21.15.156:0/604867661 >> v1:172.21.15.156:6789/0 conn(0x7f24f8133c20 0x7f24f8134070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58230/0 (socket says 172.21.15.156:58230) 2023-09-30T22:22:09.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.221+0000 7f24f6ffd700 1 -- 172.21.15.156:0/604867661 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24f809a150 msgr2=0x7f24f809e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:09.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.221+0000 7f24f6ffd700 1 --2- 172.21.15.156:0/604867661 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24f809a150 0x7f24f809e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:09.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.221+0000 7f24f6ffd700 1 -- 172.21.15.156:0/604867661 >> v1:172.21.15.156:6789/0 conn(0x7f24f8133c20 legacy=0x7f24f8134070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:09.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.221+0000 7f24f6ffd700 1 -- 172.21.15.156:0/604867661 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f809f6e0 con 0x7f24f809edb0 2023-09-30T22:22:09.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.221+0000 7f24f77fe700 1 --2- 172.21.15.156:0/604867661 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24f809a150 0x7f24f809e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:09.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.221+0000 7f24f67fc700 1 -- 172.21.15.156:0/604867661 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4092334954 0 0) 0x7f24f809af80 con 0x7f24f8133c20 2023-09-30T22:22:09.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.222+0000 7f24f6ffd700 1 --2- 172.21.15.156:0/604867661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f809edb0 0x7f24f809f1a0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f24e80098f0 tx=0x7f24e8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5456ab47bab4b7ec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:09.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.222+0000 7f24f67fc700 1 -- 172.21.15.156:0/604867661 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e8011830 con 0x7f24f809edb0 2023-09-30T22:22:09.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.222+0000 7f24f67fc700 1 -- 172.21.15.156:0/604867661 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e8011990 con 0x7f24f809edb0 2023-09-30T22:22:09.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.222+0000 7f24f67fc700 1 -- 172.21.15.156:0/604867661 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e8011d20 con 0x7f24f809edb0 2023-09-30T22:22:09.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.222+0000 7f24fe016700 1 -- 172.21.15.156:0/604867661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f809edb0 msgr2=0x7f24f809f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:09.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.222+0000 7f24fe016700 1 --2- 172.21.15.156:0/604867661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f809edb0 0x7f24f809f1a0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f24e80098f0 tx=0x7f24e8009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:09.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.222+0000 7f24fe016700 1 -- 172.21.15.156:0/604867661 shutdown_connections 2023-09-30T22:22:09.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.222+0000 7f24fe016700 1 --2- 172.21.15.156:0/604867661 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24f809a150 0x7f24f809e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:09.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.222+0000 7f24fe016700 1 --2- 172.21.15.156:0/604867661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f809edb0 0x7f24f809f1a0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:09.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.222+0000 7f24fe016700 1 -- 172.21.15.156:0/604867661 >> 172.21.15.156:0/604867661 conn(0x7f24f80a4430 msgr2=0x7f24f80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:09.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.222+0000 7f24fe016700 1 -- 172.21.15.156:0/604867661 shutdown_connections 2023-09-30T22:22:09.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.222+0000 7f24fe016700 1 -- 172.21.15.156:0/604867661 wait complete. 2023-09-30T22:22:09.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.223+0000 7f24fe016700 1 Processor -- start 2023-09-30T22:22:09.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.224+0000 7f24fe016700 1 -- start start 2023-09-30T22:22:09.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.224+0000 7f24fe016700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24f809a150 0x7f24f81225f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:09.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.224+0000 7f24fe016700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24f809edb0 0x7f24f8122b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:09.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.224+0000 7f24fe016700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f8133c20 0x7f24f8123070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:09.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.224+0000 7f24fe016700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f8126110 con 0x7f24f8133c20 2023-09-30T22:22:09.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.224+0000 7f24fe016700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f8125090 con 0x7f24f809edb0 2023-09-30T22:22:09.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.224+0000 7f24fe016700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24f81258a0 con 0x7f24f809a150 2023-09-30T22:22:09.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.224+0000 7f24f77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24f809a150 0x7f24f81225f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:09.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.224+0000 7f24f77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24f809a150 0x7f24f81225f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33798/0 (socket says 172.21.15.156:33798) 2023-09-30T22:22:09.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.224+0000 7f24f77fe700 1 -- 172.21.15.156:0/208809561 learned_addr learned my addr 172.21.15.156:0/208809561 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:09.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.224+0000 7f24f7fff700 1 --2- 172.21.15.156:0/208809561 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f8133c20 0x7f24f8123070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:09.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.224+0000 7f24f6ffd700 1 --2- 172.21.15.156:0/208809561 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24f809edb0 0x7f24f8122b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:09.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.225+0000 7f24f77fe700 1 -- 172.21.15.156:0/208809561 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24f809edb0 msgr2=0x7f24f8122b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:09.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.225+0000 7f24f77fe700 1 --2- 172.21.15.156:0/208809561 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24f809edb0 0x7f24f8122b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:09.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.225+0000 7f24f77fe700 1 -- 172.21.15.156:0/208809561 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f8133c20 msgr2=0x7f24f8123070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:09.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.225+0000 7f24f77fe700 1 --2- 172.21.15.156:0/208809561 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f8133c20 0x7f24f8123070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:09.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.225+0000 7f24f77fe700 1 -- 172.21.15.156:0/208809561 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e00094a0 con 0x7f24f809a150 2023-09-30T22:22:09.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.225+0000 7f24f6ffd700 1 --2- 172.21.15.156:0/208809561 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24f809edb0 0x7f24f8122b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:09.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.225+0000 7f24f7fff700 1 --2- 172.21.15.156:0/208809561 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f8133c20 0x7f24f8123070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:09.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.225+0000 7f24f77fe700 1 --2- 172.21.15.156:0/208809561 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24f809a150 0x7f24f81225f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f24e000ebe0 tx=0x7f24e000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:09.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.225+0000 7f24effff700 1 -- 172.21.15.156:0/208809561 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e0009760 con 0x7f24f809a150 2023-09-30T22:22:09.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.225+0000 7f24effff700 1 -- 172.21.15.156:0/208809561 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e000c850 con 0x7f24f809a150 2023-09-30T22:22:09.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.225+0000 7f24effff700 1 -- 172.21.15.156:0/208809561 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e000cbe0 con 0x7f24f809a150 2023-09-30T22:22:09.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.225+0000 7f24fe016700 1 -- 172.21.15.156:0/208809561 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e8009550 con 0x7f24f809a150 2023-09-30T22:22:09.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.225+0000 7f24fe016700 1 -- 172.21.15.156:0/208809561 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f81339c0 con 0x7f24f809a150 2023-09-30T22:22:09.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.226+0000 7f24effff700 1 -- 172.21.15.156:0/208809561 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f24e000cd40 con 0x7f24f809a150 2023-09-30T22:22:09.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.226+0000 7f24effff700 1 -- 172.21.15.156:0/208809561 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f24e003f7a0 con 0x7f24f809a150 2023-09-30T22:22:09.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.226+0000 7f24fe016700 1 -- 172.21.15.156:0/208809561 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f809fa30 con 0x7f24f809a150 2023-09-30T22:22:09.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.231+0000 7f24effff700 1 -- 172.21.15.156:0/208809561 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f24e00232f0 con 0x7f24f809a150 2023-09-30T22:22:09.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.412+0000 7f24fe016700 1 -- 172.21.15.156:0/208809561 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f24f804f2a0 con 0x7f24f809a150 2023-09-30T22:22:09.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.413+0000 7f24effff700 1 -- 172.21.15.156:0/208809561 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f24e0011350 con 0x7f24f809a150 2023-09-30T22:22:09.413 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:09.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.415+0000 7f24fe016700 1 -- 172.21.15.156:0/208809561 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24f809a150 msgr2=0x7f24f81225f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:09.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.415+0000 7f24fe016700 1 --2- 172.21.15.156:0/208809561 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24f809a150 0x7f24f81225f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f24e000ebe0 tx=0x7f24e000eef0 comp rx=0 tx=0).stop 2023-09-30T22:22:09.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.415+0000 7f24fe016700 1 -- 172.21.15.156:0/208809561 shutdown_connections 2023-09-30T22:22:09.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.415+0000 7f24fe016700 1 --2- 172.21.15.156:0/208809561 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f8133c20 0x7f24f8123070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:09.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.415+0000 7f24fe016700 1 --2- 172.21.15.156:0/208809561 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24f809a150 0x7f24f81225f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:09.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.415+0000 7f24fe016700 1 --2- 172.21.15.156:0/208809561 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24f809edb0 0x7f24f8122b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:09.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.415+0000 7f24fe016700 1 -- 172.21.15.156:0/208809561 >> 172.21.15.156:0/208809561 conn(0x7f24f80a4430 msgr2=0x7f24f80a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:09.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.415+0000 7f24fe016700 1 -- 172.21.15.156:0/208809561 shutdown_connections 2023-09-30T22:22:09.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.415+0000 7f24fe016700 1 -- 172.21.15.156:0/208809561 wait complete. 2023-09-30T22:22:09.427 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:09.602 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:09.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.726+0000 7f7d9ba15700 1 Processor -- start 2023-09-30T22:22:09.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.726+0000 7f7d9ba15700 1 -- start start 2023-09-30T22:22:09.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.726+0000 7f7d9ba15700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7d941346e0 0x7f7d94136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:09.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.726+0000 7f7d9ba15700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7d94137000 0x7f7d941393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:09.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.726+0000 7f7d9ba15700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d940a1640 con 0x7f7d94131980 2023-09-30T22:22:09.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.726+0000 7f7d9ba15700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d9406eb30 con 0x7f7d94137000 2023-09-30T22:22:09.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.726+0000 7f7d9ba15700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d940a22d0 con 0x7f7d941346e0 2023-09-30T22:22:09.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.727+0000 7f7d99fb2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7d94137000 0x7f7d941393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:09.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.727+0000 7f7d98fb0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7d941346e0 0x7f7d94136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:09.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.727+0000 7f7d98fb0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7d941346e0 0x7f7d94136ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33808/0 (socket says 172.21.15.156:33808) 2023-09-30T22:22:09.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.727+0000 7f7d99fb2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7d94137000 0x7f7d941393e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47322/0 (socket says 172.21.15.156:47322) 2023-09-30T22:22:09.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.727+0000 7f7d997b1700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f7d94131980 0x7f7d94131d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58244/0 (socket says 172.21.15.156:58244) 2023-09-30T22:22:09.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.727+0000 7f7d98fb0700 1 -- 172.21.15.156:0/1928691799 learned_addr learned my addr 172.21.15.156:0/1928691799 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:09.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.727+0000 7f7d99fb2700 1 -- 172.21.15.156:0/1928691799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7d941346e0 msgr2=0x7f7d94136ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:09.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.727+0000 7f7d99fb2700 1 --2- 172.21.15.156:0/1928691799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7d941346e0 0x7f7d94136ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:09.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.727+0000 7f7d99fb2700 1 -- 172.21.15.156:0/1928691799 >> v1:172.21.15.156:6789/0 conn(0x7f7d94131980 legacy=0x7f7d94131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:09.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.727+0000 7f7d99fb2700 1 -- 172.21.15.156:0/1928691799 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d94131550 con 0x7f7d94137000 2023-09-30T22:22:09.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.727+0000 7f7d8bfff700 1 -- 172.21.15.156:0/1928691799 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3735345546 0 0) 0x7f7d940a1640 con 0x7f7d94131980 2023-09-30T22:22:09.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.727+0000 7f7d98fb0700 1 --2- 172.21.15.156:0/1928691799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7d941346e0 0x7f7d94136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:09.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.727+0000 7f7d99fb2700 1 --2- 172.21.15.156:0/1928691799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d94137000 0x7f7d941393e0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c009d90 tx=0x7f7d8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766c0fe40760059f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:09.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.727+0000 7f7d8bfff700 1 -- 172.21.15.156:0/1928691799 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c00e070 con 0x7f7d94137000 2023-09-30T22:22:09.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.727+0000 7f7d8bfff700 1 -- 172.21.15.156:0/1928691799 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8c00bb20 con 0x7f7d94137000 2023-09-30T22:22:09.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.727+0000 7f7d8bfff700 1 -- 172.21.15.156:0/1928691799 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c012430 con 0x7f7d94137000 2023-09-30T22:22:09.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.728+0000 7f7d9ba15700 1 -- 172.21.15.156:0/1928691799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d94137000 msgr2=0x7f7d941393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:09.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.728+0000 7f7d9ba15700 1 --2- 172.21.15.156:0/1928691799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d94137000 0x7f7d941393e0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c009d90 tx=0x7f7d8c00b330 comp rx=0 tx=0).stop 2023-09-30T22:22:09.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.728+0000 7f7d9ba15700 1 -- 172.21.15.156:0/1928691799 shutdown_connections 2023-09-30T22:22:09.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.728+0000 7f7d9ba15700 1 --2- 172.21.15.156:0/1928691799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d94137000 0x7f7d941393e0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:09.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.728+0000 7f7d9ba15700 1 --2- 172.21.15.156:0/1928691799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7d941346e0 0x7f7d94136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:09.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.728+0000 7f7d9ba15700 1 -- 172.21.15.156:0/1928691799 >> 172.21.15.156:0/1928691799 conn(0x7f7d940a2980 msgr2=0x7f7d940a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:09.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.728+0000 7f7d9ba15700 1 -- 172.21.15.156:0/1928691799 shutdown_connections 2023-09-30T22:22:09.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.728+0000 7f7d9ba15700 1 -- 172.21.15.156:0/1928691799 wait complete. 2023-09-30T22:22:09.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.729+0000 7f7d9ba15700 1 Processor -- start 2023-09-30T22:22:09.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.729+0000 7f7d9ba15700 1 -- start start 2023-09-30T22:22:09.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.729+0000 7f7d9ba15700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7d94131980 0x7f7d94118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:09.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.729+0000 7f7d9ba15700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7d941346e0 0x7f7d94119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:09.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.729+0000 7f7d9ba15700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d94137000 0x7f7d94119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:09.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.729+0000 7f7d9ba15700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9411c480 con 0x7f7d94137000 2023-09-30T22:22:09.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.729+0000 7f7d9ba15700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9411c660 con 0x7f7d941346e0 2023-09-30T22:22:09.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.729+0000 7f7d9ba15700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d940a1c40 con 0x7f7d94131980 2023-09-30T22:22:09.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.729+0000 7f7d98fb0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7d941346e0 0x7f7d94119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:09.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.729+0000 7f7d997b1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7d94131980 0x7f7d94118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:09.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.729+0000 7f7d99fb2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d94137000 0x7f7d94119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:09.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.729+0000 7f7d98fb0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7d941346e0 0x7f7d94119330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57982/0 (socket says 172.21.15.156:57982) 2023-09-30T22:22:09.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.729+0000 7f7d98fb0700 1 -- 172.21.15.156:0/3526726587 learned_addr learned my addr 172.21.15.156:0/3526726587 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:09.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.729+0000 7f7d99fb2700 1 -- 172.21.15.156:0/3526726587 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7d94131980 msgr2=0x7f7d94118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:09.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.729+0000 7f7d99fb2700 1 --2- 172.21.15.156:0/3526726587 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7d94131980 0x7f7d94118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:09.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.729+0000 7f7d99fb2700 1 -- 172.21.15.156:0/3526726587 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7d941346e0 msgr2=0x7f7d94119330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:09.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.730+0000 7f7d99fb2700 1 --2- 172.21.15.156:0/3526726587 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7d941346e0 0x7f7d94119330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:09.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.730+0000 7f7d99fb2700 1 -- 172.21.15.156:0/3526726587 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d90009550 con 0x7f7d94137000 2023-09-30T22:22:09.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.730+0000 7f7d997b1700 1 --2- 172.21.15.156:0/3526726587 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7d94131980 0x7f7d94118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:09.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.730+0000 7f7d98fb0700 1 --2- 172.21.15.156:0/3526726587 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7d941346e0 0x7f7d94119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:09.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.730+0000 7f7d99fb2700 1 --2- 172.21.15.156:0/3526726587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d94137000 0x7f7d94119870 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f7d9406c040 tx=0x7f7d8c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:09.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.730+0000 7f7d89ffb700 1 -- 172.21.15.156:0/3526726587 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c012430 con 0x7f7d94137000 2023-09-30T22:22:09.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.730+0000 7f7d89ffb700 1 -- 172.21.15.156:0/3526726587 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8c020070 con 0x7f7d94137000 2023-09-30T22:22:09.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.730+0000 7f7d9ba15700 1 -- 172.21.15.156:0/3526726587 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d8c009a70 con 0x7f7d94137000 2023-09-30T22:22:09.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.730+0000 7f7d89ffb700 1 -- 172.21.15.156:0/3526726587 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c01bdd0 con 0x7f7d94137000 2023-09-30T22:22:09.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.730+0000 7f7d9ba15700 1 -- 172.21.15.156:0/3526726587 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9411c0c0 con 0x7f7d94137000 2023-09-30T22:22:09.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.731+0000 7f7d89ffb700 1 -- 172.21.15.156:0/3526726587 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d8c026400 con 0x7f7d94137000 2023-09-30T22:22:09.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.731+0000 7f7d89ffb700 1 -- 172.21.15.156:0/3526726587 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7d8c0413c0 con 0x7f7d94137000 2023-09-30T22:22:09.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.731+0000 7f7d9ba15700 1 -- 172.21.15.156:0/3526726587 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d9411c2b0 con 0x7f7d94137000 2023-09-30T22:22:09.736 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:09.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.736+0000 7f7d89ffb700 1 -- 172.21.15.156:0/3526726587 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d8c012e60 con 0x7f7d94137000 2023-09-30T22:22:09.804 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:09.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.862+0000 7f6a87436700 1 Processor -- start 2023-09-30T22:22:09.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.862+0000 7f6a87436700 1 -- start start 2023-09-30T22:22:09.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.863+0000 7f6a87436700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6a800a0a70 0x7f6a800a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:09.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.863+0000 7f6a87436700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a80134120 0x7f6a8013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:09.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.863+0000 7f6a87436700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a8009dc00 con 0x7f6a800a1380 2023-09-30T22:22:09.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.863+0000 7f6a87436700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a8009ea90 con 0x7f6a800a0a70 2023-09-30T22:22:09.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.863+0000 7f6a87436700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8009dec0 con 0x7f6a80134120 2023-09-30T22:22:09.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.863+0000 7f6a851d2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6a800a0a70 0x7f6a800a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:09.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.863+0000 7f6a851d2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6a800a0a70 0x7f6a800a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47344/0 (socket says 172.21.15.156:47344) 2023-09-30T22:22:09.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.863+0000 7f6a851d2700 1 -- 172.21.15.156:0/1176237368 learned_addr learned my addr 172.21.15.156:0/1176237368 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:09.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.863+0000 7f6a859d3700 1 --2- 172.21.15.156:0/1176237368 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a80134120 0x7f6a8013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:09.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.863+0000 7f6a851d2700 1 -- 172.21.15.156:0/1176237368 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a80134120 msgr2=0x7f6a8013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:09.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.863+0000 7f6a851d2700 1 --2- 172.21.15.156:0/1176237368 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a80134120 0x7f6a8013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:09.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.863+0000 7f6a851d2700 1 -- 172.21.15.156:0/1176237368 >> v1:172.21.15.156:6789/0 conn(0x7f6a800a1380 legacy=0x7f6a80133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:09.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.863+0000 7f6a77fff700 1 -- 172.21.15.156:0/1176237368 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1133897949 0 0) 0x7f6a8009dc00 con 0x7f6a800a1380 2023-09-30T22:22:09.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.863+0000 7f6a851d2700 1 -- 172.21.15.156:0/1176237368 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8009e6a0 con 0x7f6a800a0a70 2023-09-30T22:22:09.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.863+0000 7f6a859d3700 1 --2- 172.21.15.156:0/1176237368 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a80134120 0x7f6a8013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:09.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.863+0000 7f6a851d2700 1 --2- 172.21.15.156:0/1176237368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a800a0a70 0x7f6a800a0e40 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c0098f0 tx=0x7f6a7c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9044ba465f324b68 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:09.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.864+0000 7f6a77fff700 1 -- 172.21.15.156:0/1176237368 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c011830 con 0x7f6a800a0a70 2023-09-30T22:22:09.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.864+0000 7f6a77fff700 1 -- 172.21.15.156:0/1176237368 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7c011990 con 0x7f6a800a0a70 2023-09-30T22:22:09.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.864+0000 7f6a77fff700 1 -- 172.21.15.156:0/1176237368 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c011d20 con 0x7f6a800a0a70 2023-09-30T22:22:09.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.864+0000 7f6a87436700 1 -- 172.21.15.156:0/1176237368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a800a0a70 msgr2=0x7f6a800a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:09.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.864+0000 7f6a87436700 1 --2- 172.21.15.156:0/1176237368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a800a0a70 0x7f6a800a0e40 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c0098f0 tx=0x7f6a7c009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:09.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.864+0000 7f6a87436700 1 -- 172.21.15.156:0/1176237368 shutdown_connections 2023-09-30T22:22:09.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.864+0000 7f6a87436700 1 --2- 172.21.15.156:0/1176237368 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a80134120 0x7f6a8013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:09.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.864+0000 7f6a87436700 1 --2- 172.21.15.156:0/1176237368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a800a0a70 0x7f6a800a0e40 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:09.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.864+0000 7f6a87436700 1 -- 172.21.15.156:0/1176237368 >> 172.21.15.156:0/1176237368 conn(0x7f6a800a6610 msgr2=0x7f6a800a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:09.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.864+0000 7f6a87436700 1 -- 172.21.15.156:0/1176237368 shutdown_connections 2023-09-30T22:22:09.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.864+0000 7f6a87436700 1 -- 172.21.15.156:0/1176237368 wait complete. 2023-09-30T22:22:09.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.865+0000 7f6a87436700 1 Processor -- start 2023-09-30T22:22:09.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.865+0000 7f6a87436700 1 -- start start 2023-09-30T22:22:09.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.866+0000 7f6a87436700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6a800a0a70 0x7f6a80122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:09.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.866+0000 7f6a87436700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a800a1380 0x7f6a80122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:09.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.866+0000 7f6a87436700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a80134120 0x7f6a80123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:09.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.866+0000 7f6a87436700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a80133300 con 0x7f6a80134120 2023-09-30T22:22:09.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.866+0000 7f6a87436700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a80125920 con 0x7f6a800a1380 2023-09-30T22:22:09.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.866+0000 7f6a87436700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a80124310 con 0x7f6a800a0a70 2023-09-30T22:22:09.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.866+0000 7f6a859d3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a80134120 0x7f6a80123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:09.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.866+0000 7f6a859d3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a80134120 0x7f6a80123180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47352/0 (socket says 172.21.15.156:47352) 2023-09-30T22:22:09.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.866+0000 7f6a859d3700 1 -- 172.21.15.156:0/2488207483 learned_addr learned my addr 172.21.15.156:0/2488207483 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:09.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.866+0000 7f6a851d2700 1 --2- 172.21.15.156:0/2488207483 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6a800a0a70 0x7f6a80122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:09.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.866+0000 7f6a849d1700 1 --2- 172.21.15.156:0/2488207483 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a800a1380 0x7f6a80122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:09.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.866+0000 7f6a859d3700 1 -- 172.21.15.156:0/2488207483 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6a800a0a70 msgr2=0x7f6a80122700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:09.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.866+0000 7f6a859d3700 1 --2- 172.21.15.156:0/2488207483 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6a800a0a70 0x7f6a80122700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:09.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.866+0000 7f6a859d3700 1 -- 172.21.15.156:0/2488207483 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a800a1380 msgr2=0x7f6a80122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:09.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.866+0000 7f6a859d3700 1 --2- 172.21.15.156:0/2488207483 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a800a1380 0x7f6a80122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:09.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.866+0000 7f6a859d3700 1 -- 172.21.15.156:0/2488207483 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a78009a70 con 0x7f6a80134120 2023-09-30T22:22:09.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.866+0000 7f6a859d3700 1 --2- 172.21.15.156:0/2488207483 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a80134120 0x7f6a80123180 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f6a7800efc0 tx=0x7f6a7800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:09.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.866+0000 7f6a75ffb700 1 -- 172.21.15.156:0/2488207483 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7800ca90 con 0x7f6a80134120 2023-09-30T22:22:09.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.867+0000 7f6a75ffb700 1 -- 172.21.15.156:0/2488207483 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7800f040 con 0x7f6a80134120 2023-09-30T22:22:09.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.867+0000 7f6a87436700 1 -- 172.21.15.156:0/2488207483 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7c009550 con 0x7f6a80134120 2023-09-30T22:22:09.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.867+0000 7f6a75ffb700 1 -- 172.21.15.156:0/2488207483 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7800ce10 con 0x7f6a80134120 2023-09-30T22:22:09.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.867+0000 7f6a87436700 1 -- 172.21.15.156:0/2488207483 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a80125c80 con 0x7f6a80134120 2023-09-30T22:22:09.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.867+0000 7f6a75ffb700 1 -- 172.21.15.156:0/2488207483 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a78014480 con 0x7f6a80134120 2023-09-30T22:22:09.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.868+0000 7f6a75ffb700 1 -- 172.21.15.156:0/2488207483 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6a7803fce0 con 0x7f6a80134120 2023-09-30T22:22:09.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.868+0000 7f6a87436700 1 -- 172.21.15.156:0/2488207483 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a8004f2a0 con 0x7f6a80134120 2023-09-30T22:22:09.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.872+0000 7f6a75ffb700 1 -- 172.21.15.156:0/2488207483 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a78012930 con 0x7f6a80134120 2023-09-30T22:22:09.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.930+0000 7f92d6950700 1 Processor -- start 2023-09-30T22:22:09.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.930+0000 7f92d6950700 1 -- start start 2023-09-30T22:22:09.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.931+0000 7f92d6950700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92d009f350 0x7f92d0136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:09.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.931+0000 7f92d6950700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f92d01371c0 0x7f92d01395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:09.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.931+0000 7f92d6950700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d009c970 con 0x7f92d009e870 2023-09-30T22:22:09.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.931+0000 7f92d6950700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d00a0920 con 0x7f92d01371c0 2023-09-30T22:22:09.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.931+0000 7f92d6950700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92d009f9c0 con 0x7f92d009f350 2023-09-30T22:22:09.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.931+0000 7f92cf7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92d009f350 0x7f92d0136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:09.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.931+0000 7f92d4eed700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f92d01371c0 0x7f92d01395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:09.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.931+0000 7f92cf7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92d009f350 0x7f92d0136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33848/0 (socket says 172.21.15.156:33848) 2023-09-30T22:22:09.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.931+0000 7f92d4eed700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f92d01371c0 0x7f92d01395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47354/0 (socket says 172.21.15.156:47354) 2023-09-30T22:22:09.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.931+0000 7f92cffff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f92d009e870 0x7f92d009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58270/0 (socket says 172.21.15.156:58270) 2023-09-30T22:22:09.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.931+0000 7f92cf7fe700 1 -- 172.21.15.156:0/686065832 learned_addr learned my addr 172.21.15.156:0/686065832 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:09.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.931+0000 7f92cf7fe700 1 -- 172.21.15.156:0/686065832 >> v2:172.21.15.156:3300/0 conn(0x7f92d01371c0 msgr2=0x7f92d01395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:09.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.931+0000 7f92cf7fe700 1 --2- 172.21.15.156:0/686065832 >> v2:172.21.15.156:3300/0 conn(0x7f92d01371c0 0x7f92d01395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:09.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.931+0000 7f92cf7fe700 1 -- 172.21.15.156:0/686065832 >> v1:172.21.15.156:6789/0 conn(0x7f92d009e870 legacy=0x7f92d009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:09.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.931+0000 7f92cf7fe700 1 -- 172.21.15.156:0/686065832 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d009bab0 con 0x7f92d009f350 2023-09-30T22:22:09.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.932+0000 7f92cf7fe700 1 --2- 172.21.15.156:0/686065832 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92d009f350 0x7f92d0136c80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f92c40098f0 tx=0x7f92c4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81c96ce416f47694 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:09.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.932+0000 7f92ceffd700 1 -- 172.21.15.156:0/686065832 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c4004230 con 0x7f92d009f350 2023-09-30T22:22:09.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.932+0000 7f92ceffd700 1 -- 172.21.15.156:0/686065832 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c4004390 con 0x7f92d009f350 2023-09-30T22:22:09.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.932+0000 7f92ceffd700 1 -- 172.21.15.156:0/686065832 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c40036a0 con 0x7f92d009f350 2023-09-30T22:22:09.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.932+0000 7f92d6950700 1 -- 172.21.15.156:0/686065832 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92d009f350 msgr2=0x7f92d0136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:09.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.932+0000 7f92d6950700 1 --2- 172.21.15.156:0/686065832 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92d009f350 0x7f92d0136c80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f92c40098f0 tx=0x7f92c4009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:09.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.932+0000 7f92d6950700 1 -- 172.21.15.156:0/686065832 shutdown_connections 2023-09-30T22:22:09.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.933+0000 7f92d6950700 1 --2- 172.21.15.156:0/686065832 >> v2:172.21.15.156:3300/0 conn(0x7f92d01371c0 0x7f92d01395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:09.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.933+0000 7f92d6950700 1 --2- 172.21.15.156:0/686065832 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92d009f350 0x7f92d0136c80 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:09.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.933+0000 7f92d6950700 1 -- 172.21.15.156:0/686065832 >> 172.21.15.156:0/686065832 conn(0x7f92d00a4430 msgr2=0x7f92d00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:09.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.933+0000 7f92d6950700 1 -- 172.21.15.156:0/686065832 shutdown_connections 2023-09-30T22:22:09.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.933+0000 7f92d6950700 1 -- 172.21.15.156:0/686065832 wait complete. 2023-09-30T22:22:09.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.933+0000 7f92d6950700 1 Processor -- start 2023-09-30T22:22:09.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.934+0000 7f92d6950700 1 -- start start 2023-09-30T22:22:09.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.934+0000 7f92d6950700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92d009e870 0x7f92d0120840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:09.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.934+0000 7f92d6950700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92d009f350 0x7f92d0120d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:09.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.934+0000 7f92d6950700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92d01371c0 0x7f92d01212c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:09.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.934+0000 7f92d6950700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d0136c20 con 0x7f92d01371c0 2023-09-30T22:22:09.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.934+0000 7f92d6950700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d0122a30 con 0x7f92d009e870 2023-09-30T22:22:09.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.934+0000 7f92d6950700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92d0122450 con 0x7f92d009f350 2023-09-30T22:22:09.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.934+0000 7f92cf7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92d009f350 0x7f92d0120d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:09.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.934+0000 7f92d4eed700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92d01371c0 0x7f92d01212c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:09.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.934+0000 7f92cf7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92d009f350 0x7f92d0120d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33854/0 (socket says 172.21.15.156:33854) 2023-09-30T22:22:09.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.934+0000 7f92cf7fe700 1 -- 172.21.15.156:0/3304505069 learned_addr learned my addr 172.21.15.156:0/3304505069 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:09.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.934+0000 7f92cffff700 1 --2- 172.21.15.156:0/3304505069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92d009e870 0x7f92d0120840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:09.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.934+0000 7f92d4eed700 1 -- 172.21.15.156:0/3304505069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92d009f350 msgr2=0x7f92d0120d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:09.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.934+0000 7f92d4eed700 1 --2- 172.21.15.156:0/3304505069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92d009f350 0x7f92d0120d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:09.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.934+0000 7f92d4eed700 1 -- 172.21.15.156:0/3304505069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92d009e870 msgr2=0x7f92d0120840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:09.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.934+0000 7f92d4eed700 1 --2- 172.21.15.156:0/3304505069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92d009e870 0x7f92d0120840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:09.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.935+0000 7f92d4eed700 1 -- 172.21.15.156:0/3304505069 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c4009550 con 0x7f92d01371c0 2023-09-30T22:22:09.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.935+0000 7f92d4eed700 1 --2- 172.21.15.156:0/3304505069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92d01371c0 0x7f92d01212c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f92c800ef90 tx=0x7f92c800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:09.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.935+0000 7f92ccff9700 1 -- 172.21.15.156:0/3304505069 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c800cc90 con 0x7f92d01371c0 2023-09-30T22:22:09.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.935+0000 7f92ccff9700 1 -- 172.21.15.156:0/3304505069 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c800f040 con 0x7f92d01371c0 2023-09-30T22:22:09.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.935+0000 7f92d6950700 1 -- 172.21.15.156:0/3304505069 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d009dba0 con 0x7f92d01371c0 2023-09-30T22:22:09.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.935+0000 7f92ccff9700 1 -- 172.21.15.156:0/3304505069 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c80146c0 con 0x7f92d01371c0 2023-09-30T22:22:09.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.935+0000 7f92d6950700 1 -- 172.21.15.156:0/3304505069 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d0122c40 con 0x7f92d01371c0 2023-09-30T22:22:09.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.936+0000 7f7d9ba15700 1 -- 172.21.15.156:0/3526726587 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7d9404f2a0 con 0x7f7d94137000 2023-09-30T22:22:09.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.936+0000 7f92d6950700 1 -- 172.21.15.156:0/3304505069 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d004f2a0 con 0x7f92d01371c0 2023-09-30T22:22:09.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.936+0000 7f92ccff9700 1 -- 172.21.15.156:0/3304505069 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f92c8014820 con 0x7f92d01371c0 2023-09-30T22:22:09.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.936+0000 7f7d89ffb700 1 -- 172.21.15.156:0/3526726587 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d8c02eb80 con 0x7f7d94137000 2023-09-30T22:22:09.940 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:09.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.936+0000 7f92ccff9700 1 -- 172.21.15.156:0/3304505069 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f92c8040180 con 0x7f92d01371c0 2023-09-30T22:22:09.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.938+0000 7f7d9ba15700 1 -- 172.21.15.156:0/3526726587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d94137000 msgr2=0x7f7d94119870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:09.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.938+0000 7f7d9ba15700 1 --2- 172.21.15.156:0/3526726587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d94137000 0x7f7d94119870 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f7d9406c040 tx=0x7f7d8c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:22:09.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.938+0000 7f7d9ba15700 1 -- 172.21.15.156:0/3526726587 shutdown_connections 2023-09-30T22:22:09.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.938+0000 7f7d9ba15700 1 --2- 172.21.15.156:0/3526726587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d94137000 0x7f7d94119870 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:09.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.938+0000 7f7d9ba15700 1 --2- 172.21.15.156:0/3526726587 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7d94131980 0x7f7d94118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:09.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.938+0000 7f7d9ba15700 1 --2- 172.21.15.156:0/3526726587 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7d941346e0 0x7f7d94119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:09.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.938+0000 7f7d9ba15700 1 -- 172.21.15.156:0/3526726587 >> 172.21.15.156:0/3526726587 conn(0x7f7d940a2980 msgr2=0x7f7d94133560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:09.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.939+0000 7f7d9ba15700 1 -- 172.21.15.156:0/3526726587 shutdown_connections 2023-09-30T22:22:09.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.939+0000 7f7d9ba15700 1 -- 172.21.15.156:0/3526726587 wait complete. 2023-09-30T22:22:09.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:09.941+0000 7f92ccff9700 1 -- 172.21.15.156:0/3304505069 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92c8014ad0 con 0x7f92d01371c0 2023-09-30T22:22:09.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:10.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.066+0000 7f6a87436700 1 -- 172.21.15.156:0/2488207483 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6a80125fa0 con 0x7f6a80134120 2023-09-30T22:22:10.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.066+0000 7f6a75ffb700 1 -- 172.21.15.156:0/2488207483 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6a7802a090 con 0x7f6a80134120 2023-09-30T22:22:10.067 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:10.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.068+0000 7f6a87436700 1 -- 172.21.15.156:0/2488207483 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a80134120 msgr2=0x7f6a80123180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:10.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.068+0000 7f6a87436700 1 --2- 172.21.15.156:0/2488207483 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a80134120 0x7f6a80123180 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f6a7800efc0 tx=0x7f6a7800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:10.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.068+0000 7f6a87436700 1 -- 172.21.15.156:0/2488207483 shutdown_connections 2023-09-30T22:22:10.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.068+0000 7f6a87436700 1 --2- 172.21.15.156:0/2488207483 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a80134120 0x7f6a80123180 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:10.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.068+0000 7f6a87436700 1 --2- 172.21.15.156:0/2488207483 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6a800a0a70 0x7f6a80122700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:10.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.069+0000 7f6a87436700 1 --2- 172.21.15.156:0/2488207483 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a800a1380 0x7f6a80122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:10.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.069+0000 7f6a87436700 1 -- 172.21.15.156:0/2488207483 >> 172.21.15.156:0/2488207483 conn(0x7f6a800a6610 msgr2=0x7f6a800a5050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:10.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.069+0000 7f6a87436700 1 -- 172.21.15.156:0/2488207483 shutdown_connections 2023-09-30T22:22:10.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.069+0000 7f6a87436700 1 -- 172.21.15.156:0/2488207483 wait complete. 2023-09-30T22:22:10.081 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:10.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.132+0000 7f92d6950700 1 -- 172.21.15.156:0/3304505069 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f92d006b2a0 con 0x7f92d01371c0 2023-09-30T22:22:10.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.132+0000 7f92ccff9700 1 -- 172.21.15.156:0/3304505069 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f92c801c3b0 con 0x7f92d01371c0 2023-09-30T22:22:10.134 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:10.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.134+0000 7f92d6950700 1 -- 172.21.15.156:0/3304505069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92d01371c0 msgr2=0x7f92d01212c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:10.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.134+0000 7f92d6950700 1 --2- 172.21.15.156:0/3304505069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92d01371c0 0x7f92d01212c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f92c800ef90 tx=0x7f92c800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:10.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.135+0000 7f92d6950700 1 -- 172.21.15.156:0/3304505069 shutdown_connections 2023-09-30T22:22:10.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.135+0000 7f92d6950700 1 --2- 172.21.15.156:0/3304505069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92d01371c0 0x7f92d01212c0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:10.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.135+0000 7f92d6950700 1 --2- 172.21.15.156:0/3304505069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92d009e870 0x7f92d0120840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:10.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.135+0000 7f92d6950700 1 --2- 172.21.15.156:0/3304505069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92d009f350 0x7f92d0120d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:10.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.135+0000 7f92d6950700 1 -- 172.21.15.156:0/3304505069 >> 172.21.15.156:0/3304505069 conn(0x7f92d00a4430 msgr2=0x7f92d009cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:10.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.135+0000 7f92d6950700 1 -- 172.21.15.156:0/3304505069 shutdown_connections 2023-09-30T22:22:10.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.135+0000 7f92d6950700 1 -- 172.21.15.156:0/3304505069 wait complete. 2023-09-30T22:22:10.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:10.429 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:10.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.552+0000 7f32f38a6700 1 Processor -- start 2023-09-30T22:22:10.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.552+0000 7f32f38a6700 1 -- start start 2023-09-30T22:22:10.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.552+0000 7f32f38a6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32ec09e340 0x7f32ec1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:10.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.552+0000 7f32f38a6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ec135f20 0x7f32ec138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:10.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.552+0000 7f32f38a6700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32ec09aaa0 con 0x7f32ec09d860 2023-09-30T22:22:10.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.552+0000 7f32f38a6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec09e730 con 0x7f32ec135f20 2023-09-30T22:22:10.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.552+0000 7f32f38a6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec09f870 con 0x7f32ec09e340 2023-09-30T22:22:10.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.553+0000 7f32f0e41700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32ec09e340 0x7f32ec1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:10.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.553+0000 7f32f1e43700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ec135f20 0x7f32ec138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:10.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.553+0000 7f32f0e41700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32ec09e340 0x7f32ec1359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33862/0 (socket says 172.21.15.156:33862) 2023-09-30T22:22:10.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.553+0000 7f32f1642700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f32ec09d860 0x7f32ec09dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58272/0 (socket says 172.21.15.156:58272) 2023-09-30T22:22:10.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.553+0000 7f32f0e41700 1 -- 172.21.15.156:0/3444782463 learned_addr learned my addr 172.21.15.156:0/3444782463 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:10.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.553+0000 7f32f0e41700 1 -- 172.21.15.156:0/3444782463 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ec135f20 msgr2=0x7f32ec138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:10.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.553+0000 7f32e3fff700 1 -- 172.21.15.156:0/3444782463 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2550591196 0 0) 0x7f32ec09aaa0 con 0x7f32ec09d860 2023-09-30T22:22:10.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.553+0000 7f32f0e41700 1 --2- 172.21.15.156:0/3444782463 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ec135f20 0x7f32ec138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:10.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.553+0000 7f32f0e41700 1 -- 172.21.15.156:0/3444782463 >> v1:172.21.15.156:6789/0 conn(0x7f32ec09d860 legacy=0x7f32ec09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:10.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.553+0000 7f32f0e41700 1 -- 172.21.15.156:0/3444782463 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ec09b360 con 0x7f32ec09e340 2023-09-30T22:22:10.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.553+0000 7f32f1e43700 1 --2- 172.21.15.156:0/3444782463 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ec135f20 0x7f32ec138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:10.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.553+0000 7f32f0e41700 1 --2- 172.21.15.156:0/3444782463 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32ec09e340 0x7f32ec1359e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00bbf0 tx=0x7f32dc00bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=deab26d072595ea9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:10.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.553+0000 7f32e3fff700 1 -- 172.21.15.156:0/3444782463 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc00dcf0 con 0x7f32ec09e340 2023-09-30T22:22:10.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.553+0000 7f32e3fff700 1 -- 172.21.15.156:0/3444782463 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32dc00de50 con 0x7f32ec09e340 2023-09-30T22:22:10.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.553+0000 7f32e3fff700 1 -- 172.21.15.156:0/3444782463 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc010690 con 0x7f32ec09e340 2023-09-30T22:22:10.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.554+0000 7f32f38a6700 1 -- 172.21.15.156:0/3444782463 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32ec09e340 msgr2=0x7f32ec1359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:10.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.554+0000 7f32f38a6700 1 --2- 172.21.15.156:0/3444782463 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32ec09e340 0x7f32ec1359e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00bbf0 tx=0x7f32dc00bf00 comp rx=0 tx=0).stop 2023-09-30T22:22:10.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.554+0000 7f32f38a6700 1 -- 172.21.15.156:0/3444782463 shutdown_connections 2023-09-30T22:22:10.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.554+0000 7f32f38a6700 1 --2- 172.21.15.156:0/3444782463 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ec135f20 0x7f32ec138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:10.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.554+0000 7f32f38a6700 1 --2- 172.21.15.156:0/3444782463 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32ec09e340 0x7f32ec1359e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:10.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.554+0000 7f32f38a6700 1 -- 172.21.15.156:0/3444782463 >> 172.21.15.156:0/3444782463 conn(0x7f32ec099c40 msgr2=0x7f32ec0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:10.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.554+0000 7f32f38a6700 1 -- 172.21.15.156:0/3444782463 shutdown_connections 2023-09-30T22:22:10.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.554+0000 7f32f38a6700 1 -- 172.21.15.156:0/3444782463 wait complete. 2023-09-30T22:22:10.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.555+0000 7f32f38a6700 1 Processor -- start 2023-09-30T22:22:10.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.555+0000 7f32f38a6700 1 -- start start 2023-09-30T22:22:10.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.555+0000 7f32f38a6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ec09d860 0x7f32ec11c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:10.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.555+0000 7f32f38a6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32ec09e340 0x7f32ec11c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:10.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.555+0000 7f32f38a6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32ec135f20 0x7f32ec11cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:10.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.555+0000 7f32f38a6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec11fd00 con 0x7f32ec135f20 2023-09-30T22:22:10.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.555+0000 7f32f38a6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec09c920 con 0x7f32ec09d860 2023-09-30T22:22:10.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.555+0000 7f32f38a6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec0726f0 con 0x7f32ec09e340 2023-09-30T22:22:10.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.555+0000 7f32f0e41700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32ec09e340 0x7f32ec11c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:10.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.555+0000 7f32f1e43700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32ec135f20 0x7f32ec11cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:10.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.555+0000 7f32f0e41700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32ec09e340 0x7f32ec11c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33878/0 (socket says 172.21.15.156:33878) 2023-09-30T22:22:10.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.555+0000 7f32f1e43700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32ec135f20 0x7f32ec11cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47378/0 (socket says 172.21.15.156:47378) 2023-09-30T22:22:10.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.555+0000 7f32f0e41700 1 -- 172.21.15.156:0/2820254197 learned_addr learned my addr 172.21.15.156:0/2820254197 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:10.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.555+0000 7f32f1642700 1 --2- 172.21.15.156:0/2820254197 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ec09d860 0x7f32ec11c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:10.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.556+0000 7f32f0e41700 1 -- 172.21.15.156:0/2820254197 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ec09d860 msgr2=0x7f32ec11c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:10.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.556+0000 7f32f0e41700 1 --2- 172.21.15.156:0/2820254197 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ec09d860 0x7f32ec11c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:10.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.556+0000 7f32f0e41700 1 -- 172.21.15.156:0/2820254197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32ec135f20 msgr2=0x7f32ec11cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:10.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.556+0000 7f32f0e41700 1 --2- 172.21.15.156:0/2820254197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32ec135f20 0x7f32ec11cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:10.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.556+0000 7f32f0e41700 1 -- 172.21.15.156:0/2820254197 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e4009a70 con 0x7f32ec09e340 2023-09-30T22:22:10.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.556+0000 7f32f1e43700 1 --2- 172.21.15.156:0/2820254197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32ec135f20 0x7f32ec11cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:10.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.556+0000 7f32f0e41700 1 --2- 172.21.15.156:0/2820254197 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32ec09e340 0x7f32ec11c720 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f32dc000c00 tx=0x7f32dc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:10.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.556+0000 7f32e1ffb700 1 -- 172.21.15.156:0/2820254197 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc01d070 con 0x7f32ec09e340 2023-09-30T22:22:10.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.556+0000 7f32e1ffb700 1 -- 172.21.15.156:0/2820254197 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32dc01e040 con 0x7f32ec09e340 2023-09-30T22:22:10.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.556+0000 7f32e1ffb700 1 -- 172.21.15.156:0/2820254197 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc023880 con 0x7f32ec09e340 2023-09-30T22:22:10.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.556+0000 7f32f38a6700 1 -- 172.21.15.156:0/2820254197 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32dc00b7f0 con 0x7f32ec09e340 2023-09-30T22:22:10.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.556+0000 7f32f38a6700 1 -- 172.21.15.156:0/2820254197 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32ec11f490 con 0x7f32ec09e340 2023-09-30T22:22:10.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.557+0000 7f32e1ffb700 1 -- 172.21.15.156:0/2820254197 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f32dc0239e0 con 0x7f32ec09e340 2023-09-30T22:22:10.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.557+0000 7f32e1ffb700 1 -- 172.21.15.156:0/2820254197 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f32dc043860 con 0x7f32ec09e340 2023-09-30T22:22:10.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.557+0000 7f32f38a6700 1 -- 172.21.15.156:0/2820254197 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32ec04f2a0 con 0x7f32ec09e340 2023-09-30T22:22:10.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.562+0000 7f32e1ffb700 1 -- 172.21.15.156:0/2820254197 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f32dc00e360 con 0x7f32ec09e340 2023-09-30T22:22:10.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.745+0000 7f32f38a6700 1 -- 172.21.15.156:0/2820254197 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f32ec11e5e0 con 0x7f32ec09e340 2023-09-30T22:22:10.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.746+0000 7f32e1ffb700 1 -- 172.21.15.156:0/2820254197 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f32dc021b10 con 0x7f32ec09e340 2023-09-30T22:22:10.747 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:10.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.748+0000 7f32f38a6700 1 -- 172.21.15.156:0/2820254197 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32ec09e340 msgr2=0x7f32ec11c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:10.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.748+0000 7f32f38a6700 1 --2- 172.21.15.156:0/2820254197 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32ec09e340 0x7f32ec11c720 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f32dc000c00 tx=0x7f32dc004750 comp rx=0 tx=0).stop 2023-09-30T22:22:10.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.748+0000 7f32f38a6700 1 -- 172.21.15.156:0/2820254197 shutdown_connections 2023-09-30T22:22:10.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.748+0000 7f32f38a6700 1 --2- 172.21.15.156:0/2820254197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32ec135f20 0x7f32ec11cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:10.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.748+0000 7f32f38a6700 1 --2- 172.21.15.156:0/2820254197 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32ec09d860 0x7f32ec11c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:10.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.748+0000 7f32f38a6700 1 --2- 172.21.15.156:0/2820254197 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32ec09e340 0x7f32ec11c720 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:10.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.748+0000 7f32f38a6700 1 -- 172.21.15.156:0/2820254197 >> 172.21.15.156:0/2820254197 conn(0x7f32ec099c40 msgr2=0x7f32ec06ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:10.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.748+0000 7f32f38a6700 1 -- 172.21.15.156:0/2820254197 shutdown_connections 2023-09-30T22:22:10.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:10.748+0000 7f32f38a6700 1 -- 172.21.15.156:0/2820254197 wait complete. 2023-09-30T22:22:10.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:10.953 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:11.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.075+0000 7f3830b89700 1 Processor -- start 2023-09-30T22:22:11.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.075+0000 7f3830b89700 1 -- start start 2023-09-30T22:22:11.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.075+0000 7f3830b89700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f382c133ad0 0x7f382c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:11.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.075+0000 7f3830b89700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f382c130bc0 0x7f382c13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:11.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.075+0000 7f3830b89700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f382c06b2d0 con 0x7f382c1300a0 2023-09-30T22:22:11.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.075+0000 7f3830b89700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382c133610 con 0x7f382c130bc0 2023-09-30T22:22:11.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.075+0000 7f3830b89700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f382c09a500 con 0x7f382c133ad0 2023-09-30T22:22:11.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.075+0000 7f382a59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f382c133ad0 0x7f382c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:11.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.075+0000 7f382ad9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f382c130bc0 0x7f382c13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:11.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.075+0000 7f3829d9b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f382c1300a0 0x7f382c1304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58288/0 (socket says 172.21.15.156:58288) 2023-09-30T22:22:11.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.076+0000 7f3829d9b700 1 -- 172.21.15.156:0/561330365 learned_addr learned my addr 172.21.15.156:0/561330365 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:11.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.076+0000 7f382959a700 1 -- 172.21.15.156:0/561330365 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571027875 0 0) 0x7f382c06b2d0 con 0x7f382c1300a0 2023-09-30T22:22:11.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.076+0000 7f382959a700 1 -- 172.21.15.156:0/561330365 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38140035b0 con 0x7f382c1300a0 2023-09-30T22:22:11.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.076+0000 7f382a59c700 1 -- 172.21.15.156:0/561330365 >> v2:172.21.15.156:3300/0 conn(0x7f382c130bc0 msgr2=0x7f382c13b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:11.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.076+0000 7f382a59c700 1 --2- 172.21.15.156:0/561330365 >> v2:172.21.15.156:3300/0 conn(0x7f382c130bc0 0x7f382c13b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.076+0000 7f382a59c700 1 -- 172.21.15.156:0/561330365 >> v1:172.21.15.156:6789/0 conn(0x7f382c1300a0 legacy=0x7f382c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.076+0000 7f382a59c700 1 -- 172.21.15.156:0/561330365 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382c1338b0 con 0x7f382c133ad0 2023-09-30T22:22:11.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.076+0000 7f382ad9d700 1 --2- 172.21.15.156:0/561330365 >> v2:172.21.15.156:3300/0 conn(0x7f382c130bc0 0x7f382c13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:11.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.076+0000 7f382a59c700 1 --2- 172.21.15.156:0/561330365 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f382c133ad0 0x7f382c133ea0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f381c009840 tx=0x7f381c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c88ec64908cc597 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:11.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.076+0000 7f382959a700 1 -- 172.21.15.156:0/561330365 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c011830 con 0x7f382c133ad0 2023-09-30T22:22:11.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.076+0000 7f382959a700 1 -- 172.21.15.156:0/561330365 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381c011990 con 0x7f382c133ad0 2023-09-30T22:22:11.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.076+0000 7f382959a700 1 -- 172.21.15.156:0/561330365 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c011d20 con 0x7f382c133ad0 2023-09-30T22:22:11.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.077+0000 7f3830b89700 1 -- 172.21.15.156:0/561330365 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f382c133ad0 msgr2=0x7f382c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.077+0000 7f3830b89700 1 --2- 172.21.15.156:0/561330365 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f382c133ad0 0x7f382c133ea0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f381c009840 tx=0x7f381c009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:11.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.077+0000 7f3830b89700 1 -- 172.21.15.156:0/561330365 shutdown_connections 2023-09-30T22:22:11.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.077+0000 7f3830b89700 1 --2- 172.21.15.156:0/561330365 >> v2:172.21.15.156:3300/0 conn(0x7f382c130bc0 0x7f382c13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.077+0000 7f3830b89700 1 --2- 172.21.15.156:0/561330365 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f382c133ad0 0x7f382c133ea0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.077+0000 7f3830b89700 1 -- 172.21.15.156:0/561330365 >> 172.21.15.156:0/561330365 conn(0x7f382c099c40 msgr2=0x7f382c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:11.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.077+0000 7f3830b89700 1 -- 172.21.15.156:0/561330365 shutdown_connections 2023-09-30T22:22:11.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.077+0000 7f3830b89700 1 -- 172.21.15.156:0/561330365 wait complete. 2023-09-30T22:22:11.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.078+0000 7f3830b89700 1 Processor -- start 2023-09-30T22:22:11.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.078+0000 7f3830b89700 1 -- start start 2023-09-30T22:22:11.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.078+0000 7f3830b89700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f382c1300a0 0x7f382c071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:11.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.078+0000 7f3830b89700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f382c130bc0 0x7f382c071840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:11.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.078+0000 7f3830b89700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f382c133ad0 0x7f382c071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:11.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.078+0000 7f3830b89700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382c0727d0 con 0x7f382c130bc0 2023-09-30T22:22:11.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.078+0000 7f3830b89700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382c11ff20 con 0x7f382c1300a0 2023-09-30T22:22:11.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.078+0000 7f3830b89700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f382c11eec0 con 0x7f382c133ad0 2023-09-30T22:22:11.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.078+0000 7f3829d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f382c130bc0 0x7f382c071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:11.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.078+0000 7f382ad9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f382c133ad0 0x7f382c071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:11.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.078+0000 7f3829d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f382c130bc0 0x7f382c071840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47390/0 (socket says 172.21.15.156:47390) 2023-09-30T22:22:11.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.078+0000 7f3829d9b700 1 -- 172.21.15.156:0/1605517576 learned_addr learned my addr 172.21.15.156:0/1605517576 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:11.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.078+0000 7f382a59c700 1 --2- 172.21.15.156:0/1605517576 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f382c1300a0 0x7f382c071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:11.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.079+0000 7f3829d9b700 1 -- 172.21.15.156:0/1605517576 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f382c133ad0 msgr2=0x7f382c071d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.079+0000 7f3829d9b700 1 --2- 172.21.15.156:0/1605517576 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f382c133ad0 0x7f382c071d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.079+0000 7f3829d9b700 1 -- 172.21.15.156:0/1605517576 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f382c1300a0 msgr2=0x7f382c071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.079+0000 7f3829d9b700 1 --2- 172.21.15.156:0/1605517576 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f382c1300a0 0x7f382c071300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.079+0000 7f3829d9b700 1 -- 172.21.15.156:0/1605517576 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3824009a70 con 0x7f382c130bc0 2023-09-30T22:22:11.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.079+0000 7f382a59c700 1 --2- 172.21.15.156:0/1605517576 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f382c1300a0 0x7f382c071300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:11.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.079+0000 7f3829d9b700 1 --2- 172.21.15.156:0/1605517576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f382c130bc0 0x7f382c071840 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f3820001eb0 tx=0x7f382000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:11.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.079+0000 7f381affd700 1 -- 172.21.15.156:0/1605517576 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820005d70 con 0x7f382c130bc0 2023-09-30T22:22:11.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.079+0000 7f381affd700 1 -- 172.21.15.156:0/1605517576 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382000ce60 con 0x7f382c130bc0 2023-09-30T22:22:11.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.079+0000 7f3830b89700 1 -- 172.21.15.156:0/1605517576 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f381c0094a0 con 0x7f382c130bc0 2023-09-30T22:22:11.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.079+0000 7f381affd700 1 -- 172.21.15.156:0/1605517576 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38200072f0 con 0x7f382c130bc0 2023-09-30T22:22:11.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.079+0000 7f3830b89700 1 -- 172.21.15.156:0/1605517576 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f382c11f980 con 0x7f382c130bc0 2023-09-30T22:22:11.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.080+0000 7f381affd700 1 -- 172.21.15.156:0/1605517576 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3820007450 con 0x7f382c130bc0 2023-09-30T22:22:11.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.080+0000 7f3830b89700 1 -- 172.21.15.156:0/1605517576 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f382c12dd60 con 0x7f382c130bc0 2023-09-30T22:22:11.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.080+0000 7f381affd700 1 -- 172.21.15.156:0/1605517576 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f382003ea50 con 0x7f382c130bc0 2023-09-30T22:22:11.085 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:11.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.084+0000 7f381affd700 1 -- 172.21.15.156:0/1605517576 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3820017070 con 0x7f382c130bc0 2023-09-30T22:22:11.148 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:11.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.211+0000 7f8d318fa700 1 Processor -- start 2023-09-30T22:22:11.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.211+0000 7f8d318fa700 1 -- start start 2023-09-30T22:22:11.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.212+0000 7f8d318fa700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8d2c133ad0 0x7f8d2c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:11.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.212+0000 7f8d318fa700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d2c1300a0 0x7f8d2c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:11.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.212+0000 7f8d318fa700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d2c06b2d0 con 0x7f8d2c1309f0 2023-09-30T22:22:11.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.212+0000 7f8d318fa700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d2c133610 con 0x7f8d2c133ad0 2023-09-30T22:22:11.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.212+0000 7f8d318fa700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c09a500 con 0x7f8d2c1300a0 2023-09-30T22:22:11.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.212+0000 7f8d2affd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8d2c133ad0 0x7f8d2c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:11.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.212+0000 7f8d2a7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d2c1300a0 0x7f8d2c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:11.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.212+0000 7f8d2affd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8d2c133ad0 0x7f8d2c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47392/0 (socket says 172.21.15.156:47392) 2023-09-30T22:22:11.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.212+0000 7f8d2affd700 1 -- 172.21.15.156:0/1325726574 learned_addr learned my addr 172.21.15.156:0/1325726574 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:11.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.212+0000 7f8d2b7fe700 1 --1- 172.21.15.156:0/1325726574 >> v1:172.21.15.156:6789/0 conn(0x7f8d2c1309f0 0x7f8d2c13a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:58300/0 (socket says 172.21.15.156:58300) 2023-09-30T22:22:11.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.213+0000 7f8d2a7fc700 1 -- 172.21.15.156:0/1325726574 >> v2:172.21.15.156:3300/0 conn(0x7f8d2c133ad0 msgr2=0x7f8d2c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:11.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.213+0000 7f8d2a7fc700 1 --2- 172.21.15.156:0/1325726574 >> v2:172.21.15.156:3300/0 conn(0x7f8d2c133ad0 0x7f8d2c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.213+0000 7f8d2a7fc700 1 -- 172.21.15.156:0/1325726574 >> v1:172.21.15.156:6789/0 conn(0x7f8d2c1309f0 legacy=0x7f8d2c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.213+0000 7f8d2a7fc700 1 -- 172.21.15.156:0/1325726574 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2c1338b0 con 0x7f8d2c1300a0 2023-09-30T22:22:11.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.213+0000 7f8d2affd700 1 --2- 172.21.15.156:0/1325726574 >> v2:172.21.15.156:3300/0 conn(0x7f8d2c133ad0 0x7f8d2c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:11.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.213+0000 7f8d2a7fc700 1 --2- 172.21.15.156:0/1325726574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d2c1300a0 0x7f8d2c1304b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8d20009840 tx=0x7f8d20009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d07a3c99505b7735 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:11.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.213+0000 7f8d29ffb700 1 -- 172.21.15.156:0/1325726574 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d20011830 con 0x7f8d2c1300a0 2023-09-30T22:22:11.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.213+0000 7f8d29ffb700 1 -- 172.21.15.156:0/1325726574 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d20011990 con 0x7f8d2c1300a0 2023-09-30T22:22:11.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.213+0000 7f8d29ffb700 1 -- 172.21.15.156:0/1325726574 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d20011d20 con 0x7f8d2c1300a0 2023-09-30T22:22:11.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.214+0000 7f8d318fa700 1 -- 172.21.15.156:0/1325726574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d2c1300a0 msgr2=0x7f8d2c1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.214+0000 7f8d318fa700 1 --2- 172.21.15.156:0/1325726574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d2c1300a0 0x7f8d2c1304b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8d20009840 tx=0x7f8d20009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:11.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.214+0000 7f8d318fa700 1 -- 172.21.15.156:0/1325726574 shutdown_connections 2023-09-30T22:22:11.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.214+0000 7f8d318fa700 1 --2- 172.21.15.156:0/1325726574 >> v2:172.21.15.156:3300/0 conn(0x7f8d2c133ad0 0x7f8d2c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.214+0000 7f8d318fa700 1 --2- 172.21.15.156:0/1325726574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d2c1300a0 0x7f8d2c1304b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.214+0000 7f8d318fa700 1 -- 172.21.15.156:0/1325726574 >> 172.21.15.156:0/1325726574 conn(0x7f8d2c099c40 msgr2=0x7f8d2c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:11.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.214+0000 7f8d318fa700 1 -- 172.21.15.156:0/1325726574 shutdown_connections 2023-09-30T22:22:11.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.214+0000 7f8d318fa700 1 -- 172.21.15.156:0/1325726574 wait complete. 2023-09-30T22:22:11.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.215+0000 7f8d318fa700 1 Processor -- start 2023-09-30T22:22:11.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.215+0000 7f8d318fa700 1 -- start start 2023-09-30T22:22:11.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.216+0000 7f8d318fa700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d2c1300a0 0x7f8d2c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:11.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.216+0000 7f8d318fa700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d2c1309f0 0x7f8d2c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:11.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.216+0000 7f8d318fa700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d2c133ad0 0x7f8d2c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:11.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.216+0000 7f8d318fa700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c11f5b0 con 0x7f8d2c133ad0 2023-09-30T22:22:11.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.216+0000 7f8d318fa700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c12fcc0 con 0x7f8d2c1300a0 2023-09-30T22:22:11.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.216+0000 7f8d318fa700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c12dd00 con 0x7f8d2c1309f0 2023-09-30T22:22:11.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.216+0000 7f8d2affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d2c1300a0 0x7f8d2c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:11.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.216+0000 7f8d2affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d2c1300a0 0x7f8d2c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:58070/0 (socket says 172.21.15.156:58070) 2023-09-30T22:22:11.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.216+0000 7f8d2affd700 1 -- 172.21.15.156:0/3293669422 learned_addr learned my addr 172.21.15.156:0/3293669422 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:11.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.216+0000 7f8d2a7fc700 1 --2- 172.21.15.156:0/3293669422 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d2c1309f0 0x7f8d2c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:11.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.216+0000 7f8d2b7fe700 1 --2- 172.21.15.156:0/3293669422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d2c133ad0 0x7f8d2c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:11.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.216+0000 7f8d2affd700 1 -- 172.21.15.156:0/3293669422 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d2c1309f0 msgr2=0x7f8d2c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.216+0000 7f8d2affd700 1 --2- 172.21.15.156:0/3293669422 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d2c1309f0 0x7f8d2c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.216+0000 7f8d2affd700 1 -- 172.21.15.156:0/3293669422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d2c133ad0 msgr2=0x7f8d2c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.216+0000 7f8d2affd700 1 --2- 172.21.15.156:0/3293669422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d2c133ad0 0x7f8d2c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.216+0000 7f8d2affd700 1 -- 172.21.15.156:0/3293669422 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1c009550 con 0x7f8d2c1300a0 2023-09-30T22:22:11.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.216+0000 7f8d2affd700 1 --2- 172.21.15.156:0/3293669422 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d2c1300a0 0x7f8d2c11da40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00ec10 tx=0x7f8d1c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:11.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.216+0000 7f8d13fff700 1 -- 172.21.15.156:0/3293669422 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c00c850 con 0x7f8d2c1300a0 2023-09-30T22:22:11.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.217+0000 7f8d13fff700 1 -- 172.21.15.156:0/3293669422 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1c00c9b0 con 0x7f8d2c1300a0 2023-09-30T22:22:11.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.217+0000 7f8d318fa700 1 -- 172.21.15.156:0/3293669422 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d200094a0 con 0x7f8d2c1300a0 2023-09-30T22:22:11.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.217+0000 7f8d13fff700 1 -- 172.21.15.156:0/3293669422 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c00cd20 con 0x7f8d2c1300a0 2023-09-30T22:22:11.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.217+0000 7f8d318fa700 1 -- 172.21.15.156:0/3293669422 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d2c11f920 con 0x7f8d2c1300a0 2023-09-30T22:22:11.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.217+0000 7f8d13fff700 1 -- 172.21.15.156:0/3293669422 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d1c013470 con 0x7f8d2c1300a0 2023-09-30T22:22:11.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.218+0000 7f8d13fff700 1 -- 172.21.15.156:0/3293669422 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8d1c03f920 con 0x7f8d2c1300a0 2023-09-30T22:22:11.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.218+0000 7f8d318fa700 1 -- 172.21.15.156:0/3293669422 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d2c04f2a0 con 0x7f8d2c1300a0 2023-09-30T22:22:11.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.222+0000 7f8d13fff700 1 -- 172.21.15.156:0/3293669422 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d1c00ce80 con 0x7f8d2c1300a0 2023-09-30T22:22:11.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.273+0000 7fb486a50700 1 Processor -- start 2023-09-30T22:22:11.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.273+0000 7fb486a50700 1 -- start start 2023-09-30T22:22:11.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.274+0000 7fb486a50700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb48009f350 0x7fb480136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:11.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.274+0000 7fb486a50700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb4801371c0 0x7fb4801395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:11.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.274+0000 7fb486a50700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb48009c970 con 0x7fb48009e870 2023-09-30T22:22:11.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.274+0000 7fb486a50700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4800a0920 con 0x7fb4801371c0 2023-09-30T22:22:11.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.274+0000 7fb486a50700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb48009f9c0 con 0x7fb48009f350 2023-09-30T22:22:11.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.274+0000 7fb47f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb48009f350 0x7fb480136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:11.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.274+0000 7fb484fed700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb4801371c0 0x7fb4801395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:11.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.274+0000 7fb47f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb48009f350 0x7fb480136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39354/0 (socket says 172.21.15.156:39354) 2023-09-30T22:22:11.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.274+0000 7fb47f7fe700 1 -- 172.21.15.156:0/2747415618 learned_addr learned my addr 172.21.15.156:0/2747415618 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:11.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.274+0000 7fb47f7fe700 1 -- 172.21.15.156:0/2747415618 >> v2:172.21.15.156:3300/0 conn(0x7fb4801371c0 msgr2=0x7fb4801395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:11.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.274+0000 7fb47f7fe700 1 --2- 172.21.15.156:0/2747415618 >> v2:172.21.15.156:3300/0 conn(0x7fb4801371c0 0x7fb4801395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.274+0000 7fb47f7fe700 1 -- 172.21.15.156:0/2747415618 >> v1:172.21.15.156:6789/0 conn(0x7fb48009e870 legacy=0x7fb48009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.274+0000 7fb47f7fe700 1 -- 172.21.15.156:0/2747415618 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48009bab0 con 0x7fb48009f350 2023-09-30T22:22:11.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.274+0000 7fb47effd700 1 -- 172.21.15.156:0/2747415618 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 421567559 0 0) 0x7fb48009c970 con 0x7fb48009e870 2023-09-30T22:22:11.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.274+0000 7fb484fed700 1 --2- 172.21.15.156:0/2747415618 >> v2:172.21.15.156:3300/0 conn(0x7fb4801371c0 0x7fb4801395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:11.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.274+0000 7fb47f7fe700 1 --2- 172.21.15.156:0/2747415618 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb48009f350 0x7fb480136c80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb4740098f0 tx=0x7fb474009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4b6f4c83c28d68d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:11.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.274+0000 7fb47effd700 1 -- 172.21.15.156:0/2747415618 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb474011830 con 0x7fb48009f350 2023-09-30T22:22:11.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.275+0000 7fb47effd700 1 -- 172.21.15.156:0/2747415618 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb474011990 con 0x7fb48009f350 2023-09-30T22:22:11.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.275+0000 7fb47effd700 1 -- 172.21.15.156:0/2747415618 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb474011d20 con 0x7fb48009f350 2023-09-30T22:22:11.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.275+0000 7fb486a50700 1 -- 172.21.15.156:0/2747415618 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb48009f350 msgr2=0x7fb480136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.275+0000 7fb486a50700 1 --2- 172.21.15.156:0/2747415618 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb48009f350 0x7fb480136c80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb4740098f0 tx=0x7fb474009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.275+0000 7fb486a50700 1 -- 172.21.15.156:0/2747415618 shutdown_connections 2023-09-30T22:22:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.275+0000 7fb486a50700 1 --2- 172.21.15.156:0/2747415618 >> v2:172.21.15.156:3300/0 conn(0x7fb4801371c0 0x7fb4801395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.275+0000 7fb486a50700 1 --2- 172.21.15.156:0/2747415618 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb48009f350 0x7fb480136c80 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.275+0000 7fb486a50700 1 -- 172.21.15.156:0/2747415618 >> 172.21.15.156:0/2747415618 conn(0x7fb4800a4430 msgr2=0x7fb4800a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.275+0000 7fb486a50700 1 -- 172.21.15.156:0/2747415618 shutdown_connections 2023-09-30T22:22:11.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.275+0000 7fb486a50700 1 -- 172.21.15.156:0/2747415618 wait complete. 2023-09-30T22:22:11.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.276+0000 7fb486a50700 1 Processor -- start 2023-09-30T22:22:11.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.276+0000 7fb486a50700 1 -- start start 2023-09-30T22:22:11.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.277+0000 7fb486a50700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb48009e870 0x7fb480120760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:11.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.277+0000 7fb486a50700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb48009f350 0x7fb480120ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:11.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.277+0000 7fb486a50700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4801371c0 0x7fb4801211e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:11.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.277+0000 7fb486a50700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb480122be0 con 0x7fb4801371c0 2023-09-30T22:22:11.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.277+0000 7fb486a50700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb480072230 con 0x7fb48009e870 2023-09-30T22:22:11.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.277+0000 7fb486a50700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb480136650 con 0x7fb48009f350 2023-09-30T22:22:11.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.277+0000 7fb484fed700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4801371c0 0x7fb4801211e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:11.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.277+0000 7fb484fed700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4801371c0 0x7fb4801211e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:43308/0 (socket says 172.21.15.156:43308) 2023-09-30T22:22:11.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.277+0000 7fb47f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb48009f350 0x7fb480120ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:11.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.277+0000 7fb484fed700 1 -- 172.21.15.156:0/424587066 learned_addr learned my addr 172.21.15.156:0/424587066 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:11.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.277+0000 7fb484fed700 1 -- 172.21.15.156:0/424587066 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb48009f350 msgr2=0x7fb480120ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.277+0000 7fb484fed700 1 --2- 172.21.15.156:0/424587066 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb48009f350 0x7fb480120ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.277+0000 7fb484fed700 1 -- 172.21.15.156:0/424587066 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb48009e870 msgr2=0x7fb480120760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.277+0000 7fb484fed700 1 --2- 172.21.15.156:0/424587066 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb48009e870 0x7fb480120760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.277+0000 7fb484fed700 1 -- 172.21.15.156:0/424587066 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb478009a70 con 0x7fb4801371c0 2023-09-30T22:22:11.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.277+0000 7fb484fed700 1 --2- 172.21.15.156:0/424587066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4801371c0 0x7fb4801211e0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fb47800ef90 tx=0x7fb47800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:11.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.277+0000 7fb47cff9700 1 -- 172.21.15.156:0/424587066 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47800cd40 con 0x7fb4801371c0 2023-09-30T22:22:11.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.278+0000 7fb47cff9700 1 -- 172.21.15.156:0/424587066 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47800f040 con 0x7fb4801371c0 2023-09-30T22:22:11.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.278+0000 7fb47cff9700 1 -- 172.21.15.156:0/424587066 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4780146c0 con 0x7fb4801371c0 2023-09-30T22:22:11.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.278+0000 7fb486a50700 1 -- 172.21.15.156:0/424587066 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb474009550 con 0x7fb4801371c0 2023-09-30T22:22:11.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.278+0000 7fb486a50700 1 -- 172.21.15.156:0/424587066 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb48009dba0 con 0x7fb4801371c0 2023-09-30T22:22:11.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.278+0000 7fb486a50700 1 -- 172.21.15.156:0/424587066 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb48004f2a0 con 0x7fb4801371c0 2023-09-30T22:22:11.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.279+0000 7fb47cff9700 1 -- 172.21.15.156:0/424587066 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb478014820 con 0x7fb4801371c0 2023-09-30T22:22:11.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.279+0000 7fb47cff9700 1 -- 172.21.15.156:0/424587066 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb4780403b0 con 0x7fb4801371c0 2023-09-30T22:22:11.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.283+0000 7fb47cff9700 1 -- 172.21.15.156:0/424587066 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb478007900 con 0x7fb4801371c0 2023-09-30T22:22:11.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.286+0000 7f3830b89700 1 -- 172.21.15.156:0/1605517576 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f382c09cb20 con 0x7f382c130bc0 2023-09-30T22:22:11.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.286+0000 7f381affd700 1 -- 172.21.15.156:0/1605517576 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3820017030 con 0x7f382c130bc0 2023-09-30T22:22:11.287 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:11.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.289+0000 7f3830b89700 1 -- 172.21.15.156:0/1605517576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f382c130bc0 msgr2=0x7f382c071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.289+0000 7f3830b89700 1 --2- 172.21.15.156:0/1605517576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f382c130bc0 0x7f382c071840 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f3820001eb0 tx=0x7f382000c7b0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.289+0000 7f3830b89700 1 -- 172.21.15.156:0/1605517576 shutdown_connections 2023-09-30T22:22:11.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.289+0000 7f3830b89700 1 --2- 172.21.15.156:0/1605517576 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f382c133ad0 0x7f382c071d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.289+0000 7f3830b89700 1 --2- 172.21.15.156:0/1605517576 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f382c1300a0 0x7f382c071300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.289+0000 7f3830b89700 1 --2- 172.21.15.156:0/1605517576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f382c130bc0 0x7f382c071840 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.289+0000 7f3830b89700 1 -- 172.21.15.156:0/1605517576 >> 172.21.15.156:0/1605517576 conn(0x7f382c099c40 msgr2=0x7f382c132990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:11.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.289+0000 7f3830b89700 1 -- 172.21.15.156:0/1605517576 shutdown_connections 2023-09-30T22:22:11.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.289+0000 7f3830b89700 1 -- 172.21.15.156:0/1605517576 wait complete. 2023-09-30T22:22:11.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:11.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.417+0000 7f8d318fa700 1 -- 172.21.15.156:0/3293669422 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8d2c06c3b0 con 0x7f8d2c1300a0 2023-09-30T22:22:11.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.417+0000 7f8d13fff700 1 -- 172.21.15.156:0/3293669422 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8d1c01b9c0 con 0x7f8d2c1300a0 2023-09-30T22:22:11.418 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:11.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.419+0000 7f8d318fa700 1 -- 172.21.15.156:0/3293669422 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d2c1300a0 msgr2=0x7f8d2c11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.419+0000 7f8d318fa700 1 --2- 172.21.15.156:0/3293669422 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d2c1300a0 0x7f8d2c11da40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00ec10 tx=0x7f8d1c00ef20 comp rx=0 tx=0).stop 2023-09-30T22:22:11.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.419+0000 7f8d318fa700 1 -- 172.21.15.156:0/3293669422 shutdown_connections 2023-09-30T22:22:11.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.419+0000 7f8d318fa700 1 --2- 172.21.15.156:0/3293669422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d2c133ad0 0x7f8d2c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.419+0000 7f8d318fa700 1 --2- 172.21.15.156:0/3293669422 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d2c1300a0 0x7f8d2c11da40 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.419+0000 7f8d318fa700 1 --2- 172.21.15.156:0/3293669422 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d2c1309f0 0x7f8d2c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.419+0000 7f8d318fa700 1 -- 172.21.15.156:0/3293669422 >> 172.21.15.156:0/3293669422 conn(0x7f8d2c099c40 msgr2=0x7f8d2c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:11.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.419+0000 7f8d318fa700 1 -- 172.21.15.156:0/3293669422 shutdown_connections 2023-09-30T22:22:11.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.419+0000 7f8d318fa700 1 -- 172.21.15.156:0/3293669422 wait complete. 2023-09-30T22:22:11.432 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:11.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.473+0000 7fb486a50700 1 -- 172.21.15.156:0/424587066 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb48006b2a0 con 0x7fb4801371c0 2023-09-30T22:22:11.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.473+0000 7fb47cff9700 1 -- 172.21.15.156:0/424587066 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb478009d70 con 0x7fb4801371c0 2023-09-30T22:22:11.474 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:11.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.475+0000 7fb486a50700 1 -- 172.21.15.156:0/424587066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4801371c0 msgr2=0x7fb4801211e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.475+0000 7fb486a50700 1 --2- 172.21.15.156:0/424587066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4801371c0 0x7fb4801211e0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fb47800ef90 tx=0x7fb47800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.475+0000 7fb486a50700 1 -- 172.21.15.156:0/424587066 shutdown_connections 2023-09-30T22:22:11.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.475+0000 7fb486a50700 1 --2- 172.21.15.156:0/424587066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4801371c0 0x7fb4801211e0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.475+0000 7fb486a50700 1 --2- 172.21.15.156:0/424587066 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb48009e870 0x7fb480120760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.475+0000 7fb486a50700 1 --2- 172.21.15.156:0/424587066 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb48009f350 0x7fb480120ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.475+0000 7fb486a50700 1 -- 172.21.15.156:0/424587066 >> 172.21.15.156:0/424587066 conn(0x7fb4800a4430 msgr2=0x7fb4800a2960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:11.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.475+0000 7fb486a50700 1 -- 172.21.15.156:0/424587066 shutdown_connections 2023-09-30T22:22:11.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.475+0000 7fb486a50700 1 -- 172.21.15.156:0/424587066 wait complete. 2023-09-30T22:22:11.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:11.762 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:11.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.885+0000 7f9ada1a6700 1 Processor -- start 2023-09-30T22:22:11.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.885+0000 7f9ada1a6700 1 -- start start 2023-09-30T22:22:11.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.886+0000 7f9ada1a6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9ad4133ad0 0x7f9ad4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:11.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.886+0000 7f9ada1a6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ad41300a0 0x7f9ad41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:11.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.886+0000 7f9ada1a6700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad406b2d0 con 0x7f9ad41309f0 2023-09-30T22:22:11.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.886+0000 7f9ada1a6700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad4133610 con 0x7f9ad4133ad0 2023-09-30T22:22:11.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.886+0000 7f9ada1a6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad409a500 con 0x7f9ad41300a0 2023-09-30T22:22:11.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.886+0000 7f9ad37fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9ad4133ad0 0x7f9ad4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:11.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.886+0000 7f9ad2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ad41300a0 0x7f9ad41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:11.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.886+0000 7f9ad37fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9ad4133ad0 0x7f9ad4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:43316/0 (socket says 172.21.15.156:43316) 2023-09-30T22:22:11.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.886+0000 7f9ad37fe700 1 -- 172.21.15.156:0/3961039892 learned_addr learned my addr 172.21.15.156:0/3961039892 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:11.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.886+0000 7f9ad3fff700 1 --1- 172.21.15.156:0/3961039892 >> v1:172.21.15.156:6789/0 conn(0x7f9ad41309f0 0x7f9ad413a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47924/0 (socket says 172.21.15.156:47924) 2023-09-30T22:22:11.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.886+0000 7f9ad37fe700 1 -- 172.21.15.156:0/3961039892 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ad41300a0 msgr2=0x7f9ad41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:11.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.886+0000 7f9ad37fe700 1 --2- 172.21.15.156:0/3961039892 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ad41300a0 0x7f9ad41304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.886+0000 7f9ad37fe700 1 -- 172.21.15.156:0/3961039892 >> v1:172.21.15.156:6789/0 conn(0x7f9ad41309f0 legacy=0x7f9ad413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.886+0000 7f9ad27fc700 1 -- 172.21.15.156:0/3961039892 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2456836488 0 0) 0x7f9ad406b2d0 con 0x7f9ad41309f0 2023-09-30T22:22:11.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.886+0000 7f9ad37fe700 1 -- 172.21.15.156:0/3961039892 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad41338b0 con 0x7f9ad4133ad0 2023-09-30T22:22:11.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.886+0000 7f9ad2ffd700 1 --2- 172.21.15.156:0/3961039892 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ad41300a0 0x7f9ad41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:11.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.886+0000 7f9ad37fe700 1 --2- 172.21.15.156:0/3961039892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ad4133ad0 0x7f9ad4133ea0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80098f0 tx=0x7f9ac8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebdc240ed419dd68 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:11.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.886+0000 7f9ad27fc700 1 -- 172.21.15.156:0/3961039892 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8011830 con 0x7f9ad4133ad0 2023-09-30T22:22:11.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.886+0000 7f9ad27fc700 1 -- 172.21.15.156:0/3961039892 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac8011990 con 0x7f9ad4133ad0 2023-09-30T22:22:11.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.887+0000 7f9ad27fc700 1 -- 172.21.15.156:0/3961039892 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8011d20 con 0x7f9ad4133ad0 2023-09-30T22:22:11.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.887+0000 7f9ada1a6700 1 -- 172.21.15.156:0/3961039892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ad4133ad0 msgr2=0x7f9ad4133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.887+0000 7f9ada1a6700 1 --2- 172.21.15.156:0/3961039892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ad4133ad0 0x7f9ad4133ea0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80098f0 tx=0x7f9ac8009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:11.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.887+0000 7f9ada1a6700 1 -- 172.21.15.156:0/3961039892 shutdown_connections 2023-09-30T22:22:11.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.887+0000 7f9ada1a6700 1 --2- 172.21.15.156:0/3961039892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ad4133ad0 0x7f9ad4133ea0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.887+0000 7f9ada1a6700 1 --2- 172.21.15.156:0/3961039892 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ad41300a0 0x7f9ad41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.887+0000 7f9ada1a6700 1 -- 172.21.15.156:0/3961039892 >> 172.21.15.156:0/3961039892 conn(0x7f9ad4099c40 msgr2=0x7f9ad40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:11.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.887+0000 7f9ada1a6700 1 -- 172.21.15.156:0/3961039892 shutdown_connections 2023-09-30T22:22:11.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.887+0000 7f9ada1a6700 1 -- 172.21.15.156:0/3961039892 wait complete. 2023-09-30T22:22:11.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.888+0000 7f9ada1a6700 1 Processor -- start 2023-09-30T22:22:11.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.888+0000 7f9ada1a6700 1 -- start start 2023-09-30T22:22:11.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.889+0000 7f9ada1a6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ad41300a0 0x7f9ad411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:11.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.889+0000 7f9ada1a6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ad41309f0 0x7f9ad411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:11.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.889+0000 7f9ada1a6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ad4133ad0 0x7f9ad411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:11.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.889+0000 7f9ada1a6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad411fd70 con 0x7f9ad41309f0 2023-09-30T22:22:11.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.889+0000 7f9ada1a6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad411f080 con 0x7f9ad41300a0 2023-09-30T22:22:11.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.889+0000 7f9ada1a6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad4120050 con 0x7f9ad4133ad0 2023-09-30T22:22:11.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.889+0000 7f9ad37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ad41300a0 0x7f9ad411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:11.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.889+0000 7f9ad3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ad4133ad0 0x7f9ad411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:11.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.889+0000 7f9ad2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ad41309f0 0x7f9ad411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:11.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.889+0000 7f9ad37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ad41300a0 0x7f9ad411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45042/0 (socket says 172.21.15.156:45042) 2023-09-30T22:22:11.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.889+0000 7f9ad37fe700 1 -- 172.21.15.156:0/3291668017 learned_addr learned my addr 172.21.15.156:0/3291668017 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:11.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.889+0000 7f9ad3fff700 1 -- 172.21.15.156:0/3291668017 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ad41300a0 msgr2=0x7f9ad411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.889+0000 7f9ad3fff700 1 --2- 172.21.15.156:0/3291668017 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ad41300a0 0x7f9ad411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.889+0000 7f9ad3fff700 1 -- 172.21.15.156:0/3291668017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ad41309f0 msgr2=0x7f9ad411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.889+0000 7f9ad3fff700 1 --2- 172.21.15.156:0/3291668017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ad41309f0 0x7f9ad411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.889+0000 7f9ad3fff700 1 -- 172.21.15.156:0/3291668017 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac40094a0 con 0x7f9ad4133ad0 2023-09-30T22:22:11.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.889+0000 7f9ad2ffd700 1 --2- 172.21.15.156:0/3291668017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ad41309f0 0x7f9ad411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:11.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.889+0000 7f9ad3fff700 1 --2- 172.21.15.156:0/3291668017 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ad4133ad0 0x7f9ad411e4c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00caf0 tx=0x7f9acc00ce00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:11.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.889+0000 7f9abbfff700 1 -- 172.21.15.156:0/3291668017 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc00a9e0 con 0x7f9ad4133ad0 2023-09-30T22:22:11.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.889+0000 7f9abbfff700 1 -- 172.21.15.156:0/3291668017 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9acc00ab60 con 0x7f9ad4133ad0 2023-09-30T22:22:11.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.889+0000 7f9ada1a6700 1 -- 172.21.15.156:0/3291668017 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac8009550 con 0x7f9ad4133ad0 2023-09-30T22:22:11.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.889+0000 7f9abbfff700 1 -- 172.21.15.156:0/3291668017 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc0070d0 con 0x7f9ad4133ad0 2023-09-30T22:22:11.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.889+0000 7f9ada1a6700 1 -- 172.21.15.156:0/3291668017 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad40a3350 con 0x7f9ad4133ad0 2023-09-30T22:22:11.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.890+0000 7f9abbfff700 1 -- 172.21.15.156:0/3291668017 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9acc007230 con 0x7f9ad4133ad0 2023-09-30T22:22:11.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.890+0000 7f9ada1a6700 1 -- 172.21.15.156:0/3291668017 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad404f2a0 con 0x7f9ad4133ad0 2023-09-30T22:22:11.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.890+0000 7f9abbfff700 1 -- 172.21.15.156:0/3291668017 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9acc03f100 con 0x7f9ad4133ad0 2023-09-30T22:22:11.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:11.895+0000 7f9abbfff700 1 -- 172.21.15.156:0/3291668017 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9acc01b360 con 0x7f9ad4133ad0 2023-09-30T22:22:12.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.078+0000 7f9ada1a6700 1 -- 172.21.15.156:0/3291668017 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9ad406c3b0 con 0x7f9ad4133ad0 2023-09-30T22:22:12.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.078+0000 7f9abbfff700 1 -- 172.21.15.156:0/3291668017 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9acc018030 con 0x7f9ad4133ad0 2023-09-30T22:22:12.079 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:12.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.080+0000 7f9ada1a6700 1 -- 172.21.15.156:0/3291668017 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ad4133ad0 msgr2=0x7f9ad411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.080+0000 7f9ada1a6700 1 --2- 172.21.15.156:0/3291668017 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ad4133ad0 0x7f9ad411e4c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00caf0 tx=0x7f9acc00ce00 comp rx=0 tx=0).stop 2023-09-30T22:22:12.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.080+0000 7f9ada1a6700 1 -- 172.21.15.156:0/3291668017 shutdown_connections 2023-09-30T22:22:12.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.080+0000 7f9ada1a6700 1 --2- 172.21.15.156:0/3291668017 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ad4133ad0 0x7f9ad411e4c0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.080+0000 7f9ada1a6700 1 --2- 172.21.15.156:0/3291668017 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ad41300a0 0x7f9ad411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.080+0000 7f9ada1a6700 1 --2- 172.21.15.156:0/3291668017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ad41309f0 0x7f9ad411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.080+0000 7f9ada1a6700 1 -- 172.21.15.156:0/3291668017 >> 172.21.15.156:0/3291668017 conn(0x7f9ad4099c40 msgr2=0x7f9ad412e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:12.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.080+0000 7f9ada1a6700 1 -- 172.21.15.156:0/3291668017 shutdown_connections 2023-09-30T22:22:12.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.080+0000 7f9ada1a6700 1 -- 172.21.15.156:0/3291668017 wait complete. 2023-09-30T22:22:12.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:12.303 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:12.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.425+0000 7f83430b8700 1 Processor -- start 2023-09-30T22:22:12.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.425+0000 7f83430b8700 1 -- start start 2023-09-30T22:22:12.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.425+0000 7f83430b8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f833c09e870 0x7f833c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:12.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.425+0000 7f83430b8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f833c09f180 0x7f833c133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:12.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.425+0000 7f83430b8700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f833c06c6a0 con 0x7f833c134160 2023-09-30T22:22:12.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.425+0000 7f83430b8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f833c06bcd0 con 0x7f833c09f180 2023-09-30T22:22:12.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.425+0000 7f83430b8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f833c06bec0 con 0x7f833c09e870 2023-09-30T22:22:12.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.425+0000 7f8340e54700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f833c09e870 0x7f833c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:12.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.425+0000 7f8341655700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f833c134160 0x7f833c13ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47932/0 (socket says 172.21.15.156:47932) 2023-09-30T22:22:12.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.425+0000 7f833bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f833c09f180 0x7f833c133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:12.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.425+0000 7f8341655700 1 -- 172.21.15.156:0/895804243 learned_addr learned my addr 172.21.15.156:0/895804243 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:12.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.426+0000 7f8340e54700 1 -- 172.21.15.156:0/895804243 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f833c09f180 msgr2=0x7f833c133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:12.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.426+0000 7f8340e54700 1 --2- 172.21.15.156:0/895804243 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f833c09f180 0x7f833c133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.426+0000 7f833b7fe700 1 -- 172.21.15.156:0/895804243 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036414355 0 0) 0x7f833c06c6a0 con 0x7f833c134160 2023-09-30T22:22:12.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.426+0000 7f8340e54700 1 -- 172.21.15.156:0/895804243 >> v1:172.21.15.156:6789/0 conn(0x7f833c134160 legacy=0x7f833c13ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.426+0000 7f8340e54700 1 -- 172.21.15.156:0/895804243 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833c06c8f0 con 0x7f833c09e870 2023-09-30T22:22:12.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.426+0000 7f833bfff700 1 --2- 172.21.15.156:0/895804243 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f833c09f180 0x7f833c133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:12.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.426+0000 7f8340e54700 1 --2- 172.21.15.156:0/895804243 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f833c09e870 0x7f833c09ec40 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8330009870 tx=0x7f8330009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a62574a1319cec2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:12.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.426+0000 7f833b7fe700 1 -- 172.21.15.156:0/895804243 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8330011830 con 0x7f833c09e870 2023-09-30T22:22:12.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.426+0000 7f833b7fe700 1 -- 172.21.15.156:0/895804243 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8330011990 con 0x7f833c09e870 2023-09-30T22:22:12.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.426+0000 7f833b7fe700 1 -- 172.21.15.156:0/895804243 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8330011d20 con 0x7f833c09e870 2023-09-30T22:22:12.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.426+0000 7f83430b8700 1 -- 172.21.15.156:0/895804243 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f833c09e870 msgr2=0x7f833c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.426+0000 7f83430b8700 1 --2- 172.21.15.156:0/895804243 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f833c09e870 0x7f833c09ec40 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8330009870 tx=0x7f8330009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:12.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.427+0000 7f83430b8700 1 -- 172.21.15.156:0/895804243 shutdown_connections 2023-09-30T22:22:12.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.427+0000 7f83430b8700 1 --2- 172.21.15.156:0/895804243 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f833c09e870 0x7f833c09ec40 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.427+0000 7f83430b8700 1 --2- 172.21.15.156:0/895804243 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f833c09f180 0x7f833c133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.427+0000 7f83430b8700 1 -- 172.21.15.156:0/895804243 >> 172.21.15.156:0/895804243 conn(0x7f833c0a4430 msgr2=0x7f833c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:12.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.427+0000 7f83430b8700 1 -- 172.21.15.156:0/895804243 shutdown_connections 2023-09-30T22:22:12.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.427+0000 7f83430b8700 1 -- 172.21.15.156:0/895804243 wait complete. 2023-09-30T22:22:12.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.427+0000 7f83430b8700 1 Processor -- start 2023-09-30T22:22:12.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.427+0000 7f83430b8700 1 -- start start 2023-09-30T22:22:12.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.428+0000 7f83430b8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f833c09e870 0x7f833c11ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:12.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.428+0000 7f83430b8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f833c09f180 0x7f833c11f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:12.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.428+0000 7f83430b8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f833c134160 0x7f833c11f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:12.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.428+0000 7f83430b8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833c1205a0 con 0x7f833c09f180 2023-09-30T22:22:12.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.428+0000 7f83430b8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f833c06cfa0 con 0x7f833c09e870 2023-09-30T22:22:12.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.428+0000 7f83430b8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f833c122470 con 0x7f833c134160 2023-09-30T22:22:12.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.428+0000 7f8340e54700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f833c09e870 0x7f833c11ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:12.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.428+0000 7f8340e54700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f833c09e870 0x7f833c11ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45066/0 (socket says 172.21.15.156:45066) 2023-09-30T22:22:12.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.428+0000 7f8340e54700 1 -- 172.21.15.156:0/690658675 learned_addr learned my addr 172.21.15.156:0/690658675 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:12.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.428+0000 7f8341655700 1 --2- 172.21.15.156:0/690658675 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f833c134160 0x7f833c11f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:12.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.428+0000 7f833bfff700 1 --2- 172.21.15.156:0/690658675 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f833c09f180 0x7f833c11f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:12.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.428+0000 7f8340e54700 1 -- 172.21.15.156:0/690658675 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f833c134160 msgr2=0x7f833c11f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.428+0000 7f8340e54700 1 --2- 172.21.15.156:0/690658675 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f833c134160 0x7f833c11f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.428+0000 7f8340e54700 1 -- 172.21.15.156:0/690658675 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f833c09f180 msgr2=0x7f833c11f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.428+0000 7f8340e54700 1 --2- 172.21.15.156:0/690658675 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f833c09f180 0x7f833c11f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.428+0000 7f8340e54700 1 -- 172.21.15.156:0/690658675 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83280094a0 con 0x7f833c09e870 2023-09-30T22:22:12.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.428+0000 7f8341655700 1 --2- 172.21.15.156:0/690658675 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f833c134160 0x7f833c11f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:12.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.429+0000 7f8340e54700 1 --2- 172.21.15.156:0/690658675 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f833c09e870 0x7f833c11ead0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8330014040 tx=0x7f8330004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:12.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.429+0000 7f83397fa700 1 -- 172.21.15.156:0/690658675 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8330004510 con 0x7f833c09e870 2023-09-30T22:22:12.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.429+0000 7f83397fa700 1 -- 172.21.15.156:0/690658675 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833001e070 con 0x7f833c09e870 2023-09-30T22:22:12.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.429+0000 7f83430b8700 1 -- 172.21.15.156:0/690658675 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83300094a0 con 0x7f833c09e870 2023-09-30T22:22:12.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.429+0000 7f83397fa700 1 -- 172.21.15.156:0/690658675 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83300038c0 con 0x7f833c09e870 2023-09-30T22:22:12.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.429+0000 7f83430b8700 1 -- 172.21.15.156:0/690658675 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f833c09b160 con 0x7f833c09e870 2023-09-30T22:22:12.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.429+0000 7f83397fa700 1 -- 172.21.15.156:0/690658675 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8330003a20 con 0x7f833c09e870 2023-09-30T22:22:12.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.430+0000 7f83397fa700 1 -- 172.21.15.156:0/690658675 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8330040410 con 0x7f833c09e870 2023-09-30T22:22:12.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.430+0000 7f83430b8700 1 -- 172.21.15.156:0/690658675 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f833c121e10 con 0x7f833c09e870 2023-09-30T22:22:12.435 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:12.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.434+0000 7f83397fa700 1 -- 172.21.15.156:0/690658675 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f833c121e10 con 0x7f833c09e870 2023-09-30T22:22:12.489 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:12.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.561+0000 7fd894bca700 1 Processor -- start 2023-09-30T22:22:12.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.561+0000 7fd894bca700 1 -- start start 2023-09-30T22:22:12.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.562+0000 7fd894bca700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd8900a1550 0x7fd890138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:12.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.562+0000 7fd894bca700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd890139200 0x7fd89013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:12.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.562+0000 7fd894bca700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89009e9d0 con 0x7fd8900a0a70 2023-09-30T22:22:12.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.562+0000 7fd894bca700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd89009dc00 con 0x7fd8900a1550 2023-09-30T22:22:12.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.562+0000 7fd894bca700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd89009dec0 con 0x7fd890139200 2023-09-30T22:22:12.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.562+0000 7fd88ed9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd890139200 0x7fd89013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:12.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.562+0000 7fd88dd9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd8900a1550 0x7fd890138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:12.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.562+0000 7fd88dd9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd8900a1550 0x7fd890138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:43338/0 (socket says 172.21.15.156:43338) 2023-09-30T22:22:12.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.562+0000 7fd88ed9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd890139200 0x7fd89013b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39426/0 (socket says 172.21.15.156:39426) 2023-09-30T22:22:12.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.562+0000 7fd88dd9b700 1 -- 172.21.15.156:0/3443186489 learned_addr learned my addr 172.21.15.156:0/3443186489 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:12.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.562+0000 7fd88ed9d700 1 -- 172.21.15.156:0/3443186489 >> v2:172.21.15.156:3300/0 conn(0x7fd8900a1550 msgr2=0x7fd890138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:12.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.562+0000 7fd88ed9d700 1 --2- 172.21.15.156:0/3443186489 >> v2:172.21.15.156:3300/0 conn(0x7fd8900a1550 0x7fd890138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.562+0000 7fd88ed9d700 1 -- 172.21.15.156:0/3443186489 >> v1:172.21.15.156:6789/0 conn(0x7fd8900a0a70 legacy=0x7fd8900a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.563+0000 7fd88ed9d700 1 -- 172.21.15.156:0/3443186489 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89009e6a0 con 0x7fd890139200 2023-09-30T22:22:12.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.563+0000 7fd88d59a700 1 -- 172.21.15.156:0/3443186489 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1775862188 0 0) 0x7fd89009e9d0 con 0x7fd8900a0a70 2023-09-30T22:22:12.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.563+0000 7fd88dd9b700 1 --2- 172.21.15.156:0/3443186489 >> v2:172.21.15.156:3300/0 conn(0x7fd8900a1550 0x7fd890138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:12.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.563+0000 7fd88ed9d700 1 --2- 172.21.15.156:0/3443186489 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd890139200 0x7fd89013b5e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd888009d90 tx=0x7fd88800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4f8ee39b1e0582f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:12.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.563+0000 7fd88d59a700 1 -- 172.21.15.156:0/3443186489 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88800e070 con 0x7fd890139200 2023-09-30T22:22:12.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.563+0000 7fd88d59a700 1 -- 172.21.15.156:0/3443186489 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88800bb20 con 0x7fd890139200 2023-09-30T22:22:12.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.563+0000 7fd88d59a700 1 -- 172.21.15.156:0/3443186489 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd888012430 con 0x7fd890139200 2023-09-30T22:22:12.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.563+0000 7fd894bca700 1 -- 172.21.15.156:0/3443186489 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd890139200 msgr2=0x7fd89013b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.563+0000 7fd894bca700 1 --2- 172.21.15.156:0/3443186489 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd890139200 0x7fd89013b5e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd888009d90 tx=0x7fd88800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:12.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.564+0000 7fd894bca700 1 -- 172.21.15.156:0/3443186489 shutdown_connections 2023-09-30T22:22:12.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.564+0000 7fd894bca700 1 --2- 172.21.15.156:0/3443186489 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd890139200 0x7fd89013b5e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.564+0000 7fd894bca700 1 --2- 172.21.15.156:0/3443186489 >> v2:172.21.15.156:3300/0 conn(0x7fd8900a1550 0x7fd890138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.564+0000 7fd894bca700 1 -- 172.21.15.156:0/3443186489 >> 172.21.15.156:0/3443186489 conn(0x7fd8900a6610 msgr2=0x7fd8900a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:12.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.564+0000 7fd894bca700 1 -- 172.21.15.156:0/3443186489 shutdown_connections 2023-09-30T22:22:12.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.564+0000 7fd894bca700 1 -- 172.21.15.156:0/3443186489 wait complete. 2023-09-30T22:22:12.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.565+0000 7fd894bca700 1 Processor -- start 2023-09-30T22:22:12.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.565+0000 7fd894bca700 1 -- start start 2023-09-30T22:22:12.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.566+0000 7fd894bca700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8900a0a70 0x7fd89011e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:12.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.566+0000 7fd894bca700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8900a1550 0x7fd89011ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:12.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.566+0000 7fd894bca700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd890139200 0x7fd89011f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:12.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.566+0000 7fd894bca700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8900a03e0 con 0x7fd8900a0a70 2023-09-30T22:22:12.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.566+0000 7fd894bca700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd890121990 con 0x7fd890139200 2023-09-30T22:22:12.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.566+0000 7fd894bca700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd890121eb0 con 0x7fd8900a1550 2023-09-30T22:22:12.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.566+0000 7fd88ed9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd890139200 0x7fd89011f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:12.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.566+0000 7fd88e59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8900a0a70 0x7fd89011e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:12.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.566+0000 7fd88ed9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd890139200 0x7fd89011f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45082/0 (socket says 172.21.15.156:45082) 2023-09-30T22:22:12.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.566+0000 7fd88ed9d700 1 -- 172.21.15.156:0/528773904 learned_addr learned my addr 172.21.15.156:0/528773904 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:12.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.566+0000 7fd88dd9b700 1 --2- 172.21.15.156:0/528773904 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8900a1550 0x7fd89011ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:12.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.566+0000 7fd88ed9d700 1 -- 172.21.15.156:0/528773904 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8900a1550 msgr2=0x7fd89011ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.566+0000 7fd88ed9d700 1 --2- 172.21.15.156:0/528773904 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8900a1550 0x7fd89011ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.566+0000 7fd88ed9d700 1 -- 172.21.15.156:0/528773904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8900a0a70 msgr2=0x7fd89011e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.566+0000 7fd88ed9d700 1 --2- 172.21.15.156:0/528773904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8900a0a70 0x7fd89011e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.566+0000 7fd88ed9d700 1 -- 172.21.15.156:0/528773904 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd884009550 con 0x7fd890139200 2023-09-30T22:22:12.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.566+0000 7fd88e59c700 1 --2- 172.21.15.156:0/528773904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8900a0a70 0x7fd89011e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:12.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.566+0000 7fd88ed9d700 1 --2- 172.21.15.156:0/528773904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd890139200 0x7fd89011f0f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd888013000 tx=0x7fd888004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:12.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.567+0000 7fd87effd700 1 -- 172.21.15.156:0/528773904 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd888012430 con 0x7fd890139200 2023-09-30T22:22:12.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.567+0000 7fd894bca700 1 -- 172.21.15.156:0/528773904 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd888009a70 con 0x7fd890139200 2023-09-30T22:22:12.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.567+0000 7fd87effd700 1 -- 172.21.15.156:0/528773904 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd888020070 con 0x7fd890139200 2023-09-30T22:22:12.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.567+0000 7fd87effd700 1 -- 172.21.15.156:0/528773904 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd888004280 con 0x7fd890139200 2023-09-30T22:22:12.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.567+0000 7fd894bca700 1 -- 172.21.15.156:0/528773904 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd890122920 con 0x7fd890139200 2023-09-30T22:22:12.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.567+0000 7fd87effd700 1 -- 172.21.15.156:0/528773904 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd8880043e0 con 0x7fd890139200 2023-09-30T22:22:12.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.568+0000 7fd894bca700 1 -- 172.21.15.156:0/528773904 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd890121b50 con 0x7fd890139200 2023-09-30T22:22:12.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.568+0000 7fd87effd700 1 -- 172.21.15.156:0/528773904 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd888022070 con 0x7fd890139200 2023-09-30T22:22:12.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.572+0000 7fd87effd700 1 -- 172.21.15.156:0/528773904 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd890121b50 con 0x7fd890139200 2023-09-30T22:22:12.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.625+0000 7f8116df5700 1 Processor -- start 2023-09-30T22:22:12.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.625+0000 7f8116df5700 1 -- start start 2023-09-30T22:22:12.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.625+0000 7f8116df5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8110136960 0x7f8110138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:12.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.625+0000 7f8116df5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8110139280 0x7f811013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:12.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.625+0000 7f8116df5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f811006b2d0 con 0x7f8110133ad0 2023-09-30T22:22:12.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.625+0000 7f8116df5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81101345b0 con 0x7f8110136960 2023-09-30T22:22:12.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.625+0000 7f8116df5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8110133610 con 0x7f8110139280 2023-09-30T22:22:12.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.625+0000 7f810ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8110136960 0x7f8110138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:12.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.626+0000 7f810ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8110136960 0x7f8110138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:43364/0 (socket says 172.21.15.156:43364) 2023-09-30T22:22:12.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.626+0000 7f810ffff700 1 -- 172.21.15.156:0/3194667895 learned_addr learned my addr 172.21.15.156:0/3194667895 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:12.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.626+0000 7f8115392700 1 --2- 172.21.15.156:0/3194667895 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8110139280 0x7f811013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:12.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.626+0000 7f8115392700 1 -- 172.21.15.156:0/3194667895 >> v2:172.21.15.156:3300/0 conn(0x7f8110136960 msgr2=0x7f8110138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:12.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.626+0000 7f8115392700 1 --2- 172.21.15.156:0/3194667895 >> v2:172.21.15.156:3300/0 conn(0x7f8110136960 0x7f8110138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.626+0000 7f8115392700 1 -- 172.21.15.156:0/3194667895 >> v1:172.21.15.156:6789/0 conn(0x7f8110133ad0 legacy=0x7f8110133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.626+0000 7f8115392700 1 -- 172.21.15.156:0/3194667895 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811009a500 con 0x7f8110139280 2023-09-30T22:22:12.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.626+0000 7f810f7fe700 1 -- 172.21.15.156:0/3194667895 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 232421623 0 0) 0x7f811006b2d0 con 0x7f8110133ad0 2023-09-30T22:22:12.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.626+0000 7f810ffff700 1 --2- 172.21.15.156:0/3194667895 >> v2:172.21.15.156:3300/0 conn(0x7f8110136960 0x7f8110138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:12.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.626+0000 7f8115392700 1 --2- 172.21.15.156:0/3194667895 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8110139280 0x7f811013b660 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8108009d90 tx=0x7f810800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4207a561ffd83ea8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:12.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.626+0000 7f810f7fe700 1 -- 172.21.15.156:0/3194667895 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810800e070 con 0x7f8110139280 2023-09-30T22:22:12.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.626+0000 7f810f7fe700 1 -- 172.21.15.156:0/3194667895 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810800bb20 con 0x7f8110139280 2023-09-30T22:22:12.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.626+0000 7f810f7fe700 1 -- 172.21.15.156:0/3194667895 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8108012430 con 0x7f8110139280 2023-09-30T22:22:12.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.627+0000 7f8116df5700 1 -- 172.21.15.156:0/3194667895 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8110139280 msgr2=0x7f811013b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.627+0000 7f8116df5700 1 --2- 172.21.15.156:0/3194667895 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8110139280 0x7f811013b660 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8108009d90 tx=0x7f810800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:12.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.627+0000 7f8116df5700 1 -- 172.21.15.156:0/3194667895 shutdown_connections 2023-09-30T22:22:12.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.627+0000 7f8116df5700 1 --2- 172.21.15.156:0/3194667895 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8110139280 0x7f811013b660 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.627+0000 7f8116df5700 1 --2- 172.21.15.156:0/3194667895 >> v2:172.21.15.156:3300/0 conn(0x7f8110136960 0x7f8110138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.627+0000 7f8116df5700 1 -- 172.21.15.156:0/3194667895 >> 172.21.15.156:0/3194667895 conn(0x7f8110099c40 msgr2=0x7f81100a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:12.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.627+0000 7f8116df5700 1 -- 172.21.15.156:0/3194667895 shutdown_connections 2023-09-30T22:22:12.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.627+0000 7f8116df5700 1 -- 172.21.15.156:0/3194667895 wait complete. 2023-09-30T22:22:12.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.628+0000 7f8116df5700 1 Processor -- start 2023-09-30T22:22:12.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.628+0000 7f8116df5700 1 -- start start 2023-09-30T22:22:12.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.629+0000 7f8116df5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8110133ad0 0x7f811012cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:12.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.629+0000 7f8116df5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8110136960 0x7f811012d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:12.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.629+0000 7f8116df5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8110139280 0x7f811012d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:12.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.629+0000 7f8116df5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811006fe90 con 0x7f8110136960 2023-09-30T22:22:12.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.629+0000 7f8116df5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8110072720 con 0x7f8110133ad0 2023-09-30T22:22:12.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.629+0000 7f8116df5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f811009f390 con 0x7f8110139280 2023-09-30T22:22:12.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.629+0000 7f8115392700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8110139280 0x7f811012d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:12.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.629+0000 7f8114b91700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8110133ad0 0x7f811012cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:12.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.629+0000 7f8115392700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8110139280 0x7f811012d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39460/0 (socket says 172.21.15.156:39460) 2023-09-30T22:22:12.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.629+0000 7f8114b91700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8110133ad0 0x7f811012cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45090/0 (socket says 172.21.15.156:45090) 2023-09-30T22:22:12.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.629+0000 7f8115392700 1 -- 172.21.15.156:0/1280744078 learned_addr learned my addr 172.21.15.156:0/1280744078 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:12.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.629+0000 7f810ffff700 1 --2- 172.21.15.156:0/1280744078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8110136960 0x7f811012d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:12.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.629+0000 7f8115392700 1 -- 172.21.15.156:0/1280744078 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8110133ad0 msgr2=0x7f811012cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.629+0000 7f8115392700 1 --2- 172.21.15.156:0/1280744078 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8110133ad0 0x7f811012cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.629+0000 7f8115392700 1 -- 172.21.15.156:0/1280744078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8110136960 msgr2=0x7f811012d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.629+0000 7f8115392700 1 --2- 172.21.15.156:0/1280744078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8110136960 0x7f811012d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.629+0000 7f8115392700 1 -- 172.21.15.156:0/1280744078 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80fc009550 con 0x7f8110139280 2023-09-30T22:22:12.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.629+0000 7f8115392700 1 --2- 172.21.15.156:0/1280744078 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8110139280 0x7f811012d5b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8108013000 tx=0x7f8108004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:12.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.629+0000 7f810d7fa700 1 -- 172.21.15.156:0/1280744078 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8108012430 con 0x7f8110139280 2023-09-30T22:22:12.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.629+0000 7f810d7fa700 1 -- 172.21.15.156:0/1280744078 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8108020070 con 0x7f8110139280 2023-09-30T22:22:12.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.629+0000 7f810d7fa700 1 -- 172.21.15.156:0/1280744078 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8108004280 con 0x7f8110139280 2023-09-30T22:22:12.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.630+0000 7f8116df5700 1 -- 172.21.15.156:0/1280744078 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8108009a70 con 0x7f8110139280 2023-09-30T22:22:12.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.630+0000 7f8116df5700 1 -- 172.21.15.156:0/1280744078 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8110070bc0 con 0x7f8110139280 2023-09-30T22:22:12.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.630+0000 7f8116df5700 1 -- 172.21.15.156:0/1280744078 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f811006be10 con 0x7f8110139280 2023-09-30T22:22:12.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.631+0000 7f810d7fa700 1 -- 172.21.15.156:0/1280744078 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81080043e0 con 0x7f8110139280 2023-09-30T22:22:12.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.631+0000 7f810d7fa700 1 -- 172.21.15.156:0/1280744078 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8108022070 con 0x7f8110139280 2023-09-30T22:22:12.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.634+0000 7f83430b8700 1 -- 172.21.15.156:0/690658675 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f833c121e10 con 0x7f833c09e870 2023-09-30T22:22:12.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.634+0000 7f83397fa700 1 -- 172.21.15.156:0/690658675 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8330015030 con 0x7f833c09e870 2023-09-30T22:22:12.635 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:12.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.635+0000 7f810d7fa700 1 -- 172.21.15.156:0/1280744078 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f810801b400 con 0x7f8110139280 2023-09-30T22:22:12.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.637+0000 7f83430b8700 1 -- 172.21.15.156:0/690658675 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f833c09e870 msgr2=0x7f833c11ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.637+0000 7f83430b8700 1 --2- 172.21.15.156:0/690658675 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f833c09e870 0x7f833c11ead0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8330014040 tx=0x7f8330004750 comp rx=0 tx=0).stop 2023-09-30T22:22:12.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.637+0000 7f83430b8700 1 -- 172.21.15.156:0/690658675 shutdown_connections 2023-09-30T22:22:12.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.637+0000 7f83430b8700 1 --2- 172.21.15.156:0/690658675 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f833c134160 0x7f833c11f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.637+0000 7f83430b8700 1 --2- 172.21.15.156:0/690658675 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f833c09e870 0x7f833c11ead0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.637+0000 7f83430b8700 1 --2- 172.21.15.156:0/690658675 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f833c09f180 0x7f833c11f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.637+0000 7f83430b8700 1 -- 172.21.15.156:0/690658675 >> 172.21.15.156:0/690658675 conn(0x7f833c0a4430 msgr2=0x7f833c070ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:12.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.637+0000 7f83430b8700 1 -- 172.21.15.156:0/690658675 shutdown_connections 2023-09-30T22:22:12.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.637+0000 7f83430b8700 1 -- 172.21.15.156:0/690658675 wait complete. 2023-09-30T22:22:12.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:12.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.779+0000 7fd894bca700 1 -- 172.21.15.156:0/528773904 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd890121b50 con 0x7fd890139200 2023-09-30T22:22:12.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.780+0000 7fd87effd700 1 -- 172.21.15.156:0/528773904 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd890121b50 con 0x7fd890139200 2023-09-30T22:22:12.781 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:12.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.782+0000 7fd894bca700 1 -- 172.21.15.156:0/528773904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd890139200 msgr2=0x7fd89011f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.782+0000 7fd894bca700 1 --2- 172.21.15.156:0/528773904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd890139200 0x7fd89011f0f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd888013000 tx=0x7fd888004ad0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.782+0000 7fd894bca700 1 -- 172.21.15.156:0/528773904 shutdown_connections 2023-09-30T22:22:12.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.782+0000 7fd894bca700 1 --2- 172.21.15.156:0/528773904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd890139200 0x7fd89011f0f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.782+0000 7fd894bca700 1 --2- 172.21.15.156:0/528773904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8900a0a70 0x7fd89011e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.782+0000 7fd894bca700 1 --2- 172.21.15.156:0/528773904 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8900a1550 0x7fd89011ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.782+0000 7fd894bca700 1 -- 172.21.15.156:0/528773904 >> 172.21.15.156:0/528773904 conn(0x7fd8900a6610 msgr2=0x7fd890136bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:12.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.782+0000 7fd894bca700 1 -- 172.21.15.156:0/528773904 shutdown_connections 2023-09-30T22:22:12.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.782+0000 7fd894bca700 1 -- 172.21.15.156:0/528773904 wait complete. 2023-09-30T22:22:12.795 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:12.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.830+0000 7f8116df5700 1 -- 172.21.15.156:0/1280744078 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f811004f2a0 con 0x7f8110139280 2023-09-30T22:22:12.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.830+0000 7f810d7fa700 1 -- 172.21.15.156:0/1280744078 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f810801a380 con 0x7f8110139280 2023-09-30T22:22:12.831 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:12.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.832+0000 7f8116df5700 1 -- 172.21.15.156:0/1280744078 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8110139280 msgr2=0x7f811012d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.832+0000 7f8116df5700 1 --2- 172.21.15.156:0/1280744078 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8110139280 0x7f811012d5b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8108013000 tx=0x7f8108004ad0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.832+0000 7f8116df5700 1 -- 172.21.15.156:0/1280744078 shutdown_connections 2023-09-30T22:22:12.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.832+0000 7f8116df5700 1 --2- 172.21.15.156:0/1280744078 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8110139280 0x7f811012d5b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.832+0000 7f8116df5700 1 --2- 172.21.15.156:0/1280744078 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8110133ad0 0x7f811012cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.832+0000 7f8116df5700 1 --2- 172.21.15.156:0/1280744078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8110136960 0x7f811012d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.832+0000 7f8116df5700 1 -- 172.21.15.156:0/1280744078 >> 172.21.15.156:0/1280744078 conn(0x7f8110099c40 msgr2=0x7f8110132980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:12.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.832+0000 7f8116df5700 1 -- 172.21.15.156:0/1280744078 shutdown_connections 2023-09-30T22:22:12.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:12.832+0000 7f8116df5700 1 -- 172.21.15.156:0/1280744078 wait complete. 2023-09-30T22:22:12.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:13.094 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:13.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.217+0000 7f27b4ab7700 1 Processor -- start 2023-09-30T22:22:13.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.217+0000 7f27b4ab7700 1 -- start start 2023-09-30T22:22:13.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.217+0000 7f27b4ab7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27b009d860 0x7f27b009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:13.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.217+0000 7f27b4ab7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27b009e170 0x7f27b01307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:13.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.217+0000 7f27b4ab7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f27b0130ce0 0x7f27b0131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:13.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.217+0000 7f27b4ab7700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27b009aaa0 con 0x7f27b0130ce0 2023-09-30T22:22:13.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.217+0000 7f27b4ab7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b009f870 con 0x7f27b009e170 2023-09-30T22:22:13.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.217+0000 7f27b4ab7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27b009b360 con 0x7f27b009d860 2023-09-30T22:22:13.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.218+0000 7f27add9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27b009e170 0x7f27b01307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:13.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.218+0000 7f27aed9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f27b0130ce0 0x7f27b0131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:13.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.218+0000 7f27ae59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27b009d860 0x7f27b009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:13.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.218+0000 7f27aed9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f27b0130ce0 0x7f27b0131150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:43384/0 (socket says 172.21.15.156:43384) 2023-09-30T22:22:13.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.218+0000 7f27ae59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27b009d860 0x7f27b009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39462/0 (socket says 172.21.15.156:39462) 2023-09-30T22:22:13.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.218+0000 7f27add9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27b009e170 0x7f27b01307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45106/0 (socket says 172.21.15.156:45106) 2023-09-30T22:22:13.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.218+0000 7f27aed9d700 1 -- 172.21.15.156:0/3469450092 learned_addr learned my addr 172.21.15.156:0/3469450092 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:13.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.218+0000 7f27aed9d700 1 -- 172.21.15.156:0/3469450092 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27b009d860 msgr2=0x7f27b009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:13.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.218+0000 7f27aed9d700 1 --2- 172.21.15.156:0/3469450092 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27b009d860 0x7f27b009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.218+0000 7f27aed9d700 1 -- 172.21.15.156:0/3469450092 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27b009e170 msgr2=0x7f27b01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:13.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.218+0000 7f27aed9d700 1 --2- 172.21.15.156:0/3469450092 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27b009e170 0x7f27b01307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.218+0000 7f27aed9d700 1 -- 172.21.15.156:0/3469450092 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b009b620 con 0x7f27b0130ce0 2023-09-30T22:22:13.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.218+0000 7f27aed9d700 1 --2- 172.21.15.156:0/3469450092 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27b0130ce0 0x7f27b0131150 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f27a8009e50 tx=0x7f27a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=296619a336a27fe1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:13.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.218+0000 7f27ad59a700 1 -- 172.21.15.156:0/3469450092 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a800e070 con 0x7f27b0130ce0 2023-09-30T22:22:13.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.218+0000 7f27ad59a700 1 -- 172.21.15.156:0/3469450092 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a800b910 con 0x7f27b0130ce0 2023-09-30T22:22:13.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.218+0000 7f27ad59a700 1 -- 172.21.15.156:0/3469450092 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a800bcc0 con 0x7f27b0130ce0 2023-09-30T22:22:13.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.219+0000 7f27b4ab7700 1 -- 172.21.15.156:0/3469450092 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27b0130ce0 msgr2=0x7f27b0131150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.219+0000 7f27b4ab7700 1 --2- 172.21.15.156:0/3469450092 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27b0130ce0 0x7f27b0131150 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f27a8009e50 tx=0x7f27a800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:13.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.219+0000 7f27b4ab7700 1 -- 172.21.15.156:0/3469450092 shutdown_connections 2023-09-30T22:22:13.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.219+0000 7f27b4ab7700 1 --2- 172.21.15.156:0/3469450092 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27b0130ce0 0x7f27b0131150 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.219+0000 7f27b4ab7700 1 --2- 172.21.15.156:0/3469450092 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27b009d860 0x7f27b009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.219+0000 7f27b4ab7700 1 --2- 172.21.15.156:0/3469450092 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27b009e170 0x7f27b01307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.219+0000 7f27b4ab7700 1 -- 172.21.15.156:0/3469450092 >> 172.21.15.156:0/3469450092 conn(0x7f27b0099c40 msgr2=0x7f27b00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:13.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.219+0000 7f27b4ab7700 1 -- 172.21.15.156:0/3469450092 shutdown_connections 2023-09-30T22:22:13.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.219+0000 7f27b4ab7700 1 -- 172.21.15.156:0/3469450092 wait complete. 2023-09-30T22:22:13.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.220+0000 7f27b4ab7700 1 Processor -- start 2023-09-30T22:22:13.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.220+0000 7f27b4ab7700 1 -- start start 2023-09-30T22:22:13.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.220+0000 7f27b4ab7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27b009d860 0x7f27b011e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:13.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.220+0000 7f27b4ab7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27b009e170 0x7f27b011e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:13.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.220+0000 7f27b4ab7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27b0130ce0 0x7f27b011ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:13.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.220+0000 7f27b4ab7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b011fc20 con 0x7f27b009d860 2023-09-30T22:22:13.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.220+0000 7f27b4ab7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b01218f0 con 0x7f27b0130ce0 2023-09-30T22:22:13.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.220+0000 7f27b4ab7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27b0120ab0 con 0x7f27b009e170 2023-09-30T22:22:13.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.220+0000 7f27add9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27b009e170 0x7f27b011e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:13.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.220+0000 7f27ae59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27b009d860 0x7f27b011e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:13.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.220+0000 7f27aed9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27b0130ce0 0x7f27b011ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:13.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.220+0000 7f27add9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27b009e170 0x7f27b011e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39470/0 (socket says 172.21.15.156:39470) 2023-09-30T22:22:13.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.220+0000 7f27aed9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27b0130ce0 0x7f27b011ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45110/0 (socket says 172.21.15.156:45110) 2023-09-30T22:22:13.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.220+0000 7f27add9b700 1 -- 172.21.15.156:0/3350944434 learned_addr learned my addr 172.21.15.156:0/3350944434 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:13.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.220+0000 7f27ae59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27b009d860 0x7f27b011e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:43396/0 (socket says 172.21.15.156:43396) 2023-09-30T22:22:13.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.221+0000 7f27add9b700 1 -- 172.21.15.156:0/3350944434 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27b0130ce0 msgr2=0x7f27b011ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.221+0000 7f27add9b700 1 --2- 172.21.15.156:0/3350944434 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27b0130ce0 0x7f27b011ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.221+0000 7f27add9b700 1 -- 172.21.15.156:0/3350944434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27b009d860 msgr2=0x7f27b011e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.221+0000 7f27add9b700 1 --2- 172.21.15.156:0/3350944434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27b009d860 0x7f27b011e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.221+0000 7f27add9b700 1 -- 172.21.15.156:0/3350944434 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a8009b30 con 0x7f27b009e170 2023-09-30T22:22:13.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.221+0000 7f27aed9d700 1 --2- 172.21.15.156:0/3350944434 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27b0130ce0 0x7f27b011ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:13.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.221+0000 7f27ae59c700 1 --2- 172.21.15.156:0/3350944434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27b009d860 0x7f27b011e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:13.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.221+0000 7f27add9b700 1 --2- 172.21.15.156:0/3350944434 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27b009e170 0x7f27b011e550 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f27a0010bc0 tx=0x7f27a0010ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:13.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.221+0000 7f279effd700 1 -- 172.21.15.156:0/3350944434 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a0009710 con 0x7f27b009e170 2023-09-30T22:22:13.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.221+0000 7f279effd700 1 -- 172.21.15.156:0/3350944434 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a000ed20 con 0x7f27b009e170 2023-09-30T22:22:13.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.221+0000 7f27b4ab7700 1 -- 172.21.15.156:0/3350944434 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b0121590 con 0x7f27b009e170 2023-09-30T22:22:13.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.221+0000 7f279effd700 1 -- 172.21.15.156:0/3350944434 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a0011670 con 0x7f27b009e170 2023-09-30T22:22:13.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.221+0000 7f27b4ab7700 1 -- 172.21.15.156:0/3350944434 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b009c8b0 con 0x7f27b009e170 2023-09-30T22:22:13.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.222+0000 7f279effd700 1 -- 172.21.15.156:0/3350944434 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f27a00117d0 con 0x7f27b009e170 2023-09-30T22:22:13.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.222+0000 7f279effd700 1 -- 172.21.15.156:0/3350944434 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f27a00419a0 con 0x7f27b009e170 2023-09-30T22:22:13.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.222+0000 7f27b4ab7700 1 -- 172.21.15.156:0/3350944434 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27b004f2a0 con 0x7f27b009e170 2023-09-30T22:22:13.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.227+0000 7f279effd700 1 -- 172.21.15.156:0/3350944434 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f27a001e070 con 0x7f27b009e170 2023-09-30T22:22:13.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.411+0000 7f27b4ab7700 1 -- 172.21.15.156:0/3350944434 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f27b006c3b0 con 0x7f27b009e170 2023-09-30T22:22:13.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.411+0000 7f279effd700 1 -- 172.21.15.156:0/3350944434 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f27a0018990 con 0x7f27b009e170 2023-09-30T22:22:13.412 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:13.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.413+0000 7f27b4ab7700 1 -- 172.21.15.156:0/3350944434 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27b009e170 msgr2=0x7f27b011e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.413+0000 7f27b4ab7700 1 --2- 172.21.15.156:0/3350944434 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27b009e170 0x7f27b011e550 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f27a0010bc0 tx=0x7f27a0010ed0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.413+0000 7f27b4ab7700 1 -- 172.21.15.156:0/3350944434 shutdown_connections 2023-09-30T22:22:13.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.413+0000 7f27b4ab7700 1 --2- 172.21.15.156:0/3350944434 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27b0130ce0 0x7f27b011ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.413+0000 7f27b4ab7700 1 --2- 172.21.15.156:0/3350944434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27b009d860 0x7f27b011e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.413+0000 7f27b4ab7700 1 --2- 172.21.15.156:0/3350944434 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27b009e170 0x7f27b011e550 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.413+0000 7f27b4ab7700 1 -- 172.21.15.156:0/3350944434 >> 172.21.15.156:0/3350944434 conn(0x7f27b0099c40 msgr2=0x7f27b0130040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:13.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.414+0000 7f27b4ab7700 1 -- 172.21.15.156:0/3350944434 shutdown_connections 2023-09-30T22:22:13.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.414+0000 7f27b4ab7700 1 -- 172.21.15.156:0/3350944434 wait complete. 2023-09-30T22:22:13.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:13.651 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:13.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.773+0000 7f81e3648700 1 Processor -- start 2023-09-30T22:22:13.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.774+0000 7f81e3648700 1 -- start start 2023-09-30T22:22:13.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.774+0000 7f81e3648700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81dc09d860 0x7f81dc09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:13.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.774+0000 7f81e3648700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f81dc130eb0 0x7f81dc138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:13.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.774+0000 7f81e3648700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81dc09aaa0 con 0x7f81dc09e170 2023-09-30T22:22:13.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.774+0000 7f81e3648700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81dc09f870 con 0x7f81dc130eb0 2023-09-30T22:22:13.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.774+0000 7f81e3648700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc09b360 con 0x7f81dc09d860 2023-09-30T22:22:13.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.774+0000 7f81e13e4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81dc09d860 0x7f81dc09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:13.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.774+0000 7f81e1be5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f81dc130eb0 0x7f81dc138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:13.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.774+0000 7f81e13e4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81dc09d860 0x7f81dc09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45116/0 (socket says 172.21.15.156:45116) 2023-09-30T22:22:13.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.774+0000 7f81e13e4700 1 -- 172.21.15.156:0/2916797226 learned_addr learned my addr 172.21.15.156:0/2916797226 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:13.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.775+0000 7f81e1be5700 1 -- 172.21.15.156:0/2916797226 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81dc09d860 msgr2=0x7f81dc09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:13.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.775+0000 7f81e1be5700 1 --2- 172.21.15.156:0/2916797226 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81dc09d860 0x7f81dc09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.775+0000 7f81e1be5700 1 -- 172.21.15.156:0/2916797226 >> v1:172.21.15.156:6789/0 conn(0x7f81dc09e170 legacy=0x7f81dc1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.775+0000 7f81e1be5700 1 -- 172.21.15.156:0/2916797226 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81dc09b620 con 0x7f81dc130eb0 2023-09-30T22:22:13.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.775+0000 7f81d3fff700 1 -- 172.21.15.156:0/2916797226 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2071044700 0 0) 0x7f81dc09aaa0 con 0x7f81dc09e170 2023-09-30T22:22:13.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.775+0000 7f81e13e4700 1 --2- 172.21.15.156:0/2916797226 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81dc09d860 0x7f81dc09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:13.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.775+0000 7f81e1be5700 1 --2- 172.21.15.156:0/2916797226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81dc130eb0 0x7f81dc138a00 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f81d4009d90 tx=0x7f81d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5440e7cd11624547 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:13.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.775+0000 7f81d3fff700 1 -- 172.21.15.156:0/2916797226 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d400e070 con 0x7f81dc130eb0 2023-09-30T22:22:13.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.775+0000 7f81d3fff700 1 -- 172.21.15.156:0/2916797226 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d400bb20 con 0x7f81dc130eb0 2023-09-30T22:22:13.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.775+0000 7f81d3fff700 1 -- 172.21.15.156:0/2916797226 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d4012430 con 0x7f81dc130eb0 2023-09-30T22:22:13.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.775+0000 7f81e3648700 1 -- 172.21.15.156:0/2916797226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81dc130eb0 msgr2=0x7f81dc138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.775+0000 7f81e3648700 1 --2- 172.21.15.156:0/2916797226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81dc130eb0 0x7f81dc138a00 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f81d4009d90 tx=0x7f81d400b330 comp rx=0 tx=0).stop 2023-09-30T22:22:13.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.775+0000 7f81e3648700 1 -- 172.21.15.156:0/2916797226 shutdown_connections 2023-09-30T22:22:13.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.775+0000 7f81e3648700 1 --2- 172.21.15.156:0/2916797226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81dc130eb0 0x7f81dc138a00 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.775+0000 7f81e3648700 1 --2- 172.21.15.156:0/2916797226 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81dc09d860 0x7f81dc09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.775+0000 7f81e3648700 1 -- 172.21.15.156:0/2916797226 >> 172.21.15.156:0/2916797226 conn(0x7f81dc099c40 msgr2=0x7f81dc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:13.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.776+0000 7f81e3648700 1 -- 172.21.15.156:0/2916797226 shutdown_connections 2023-09-30T22:22:13.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.776+0000 7f81e3648700 1 -- 172.21.15.156:0/2916797226 wait complete. 2023-09-30T22:22:13.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.776+0000 7f81e3648700 1 Processor -- start 2023-09-30T22:22:13.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.776+0000 7f81e3648700 1 -- start start 2023-09-30T22:22:13.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.777+0000 7f81e3648700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81dc09d860 0x7f81dc11e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:13.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.777+0000 7f81e3648700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81dc09e170 0x7f81dc11e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:13.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.777+0000 7f81e3648700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81dc130eb0 0x7f81dc11eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:13.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.777+0000 7f81e3648700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc120cf0 con 0x7f81dc130eb0 2023-09-30T22:22:13.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.777+0000 7f81e3648700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc0a07b0 con 0x7f81dc09d860 2023-09-30T22:22:13.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.777+0000 7f81e3648700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc09c8b0 con 0x7f81dc09e170 2023-09-30T22:22:13.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.777+0000 7f81e13e4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81dc09d860 0x7f81dc11e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:13.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.777+0000 7f81e13e4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81dc09d860 0x7f81dc11e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45120/0 (socket says 172.21.15.156:45120) 2023-09-30T22:22:13.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.777+0000 7f81e13e4700 1 -- 172.21.15.156:0/2567697280 learned_addr learned my addr 172.21.15.156:0/2567697280 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:13.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.777+0000 7f81e1be5700 1 --2- 172.21.15.156:0/2567697280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81dc130eb0 0x7f81dc11eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:13.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.777+0000 7f81e0be3700 1 --2- 172.21.15.156:0/2567697280 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81dc09e170 0x7f81dc11e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:13.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.777+0000 7f81e1be5700 1 -- 172.21.15.156:0/2567697280 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81dc09e170 msgr2=0x7f81dc11e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.777+0000 7f81e1be5700 1 --2- 172.21.15.156:0/2567697280 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81dc09e170 0x7f81dc11e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.777+0000 7f81e1be5700 1 -- 172.21.15.156:0/2567697280 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81dc09d860 msgr2=0x7f81dc11e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.777+0000 7f81e1be5700 1 --2- 172.21.15.156:0/2567697280 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81dc09d860 0x7f81dc11e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.777+0000 7f81e1be5700 1 -- 172.21.15.156:0/2567697280 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d800da00 con 0x7f81dc130eb0 2023-09-30T22:22:13.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.777+0000 7f81e13e4700 1 --2- 172.21.15.156:0/2567697280 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81dc09d860 0x7f81dc11e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:13.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.777+0000 7f81e1be5700 1 --2- 172.21.15.156:0/2567697280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81dc130eb0 0x7f81dc11eea0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f81d4016000 tx=0x7f81d4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:13.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.778+0000 7f81d1ffb700 1 -- 172.21.15.156:0/2567697280 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d4012430 con 0x7f81dc130eb0 2023-09-30T22:22:13.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.778+0000 7f81d1ffb700 1 -- 172.21.15.156:0/2567697280 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d4020070 con 0x7f81dc130eb0 2023-09-30T22:22:13.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.778+0000 7f81e3648700 1 -- 172.21.15.156:0/2567697280 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d4009a70 con 0x7f81dc130eb0 2023-09-30T22:22:13.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.778+0000 7f81d1ffb700 1 -- 172.21.15.156:0/2567697280 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d4004280 con 0x7f81dc130eb0 2023-09-30T22:22:13.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.778+0000 7f81e3648700 1 -- 172.21.15.156:0/2567697280 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81dc11f810 con 0x7f81dc130eb0 2023-09-30T22:22:13.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.778+0000 7f81d1ffb700 1 -- 172.21.15.156:0/2567697280 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81d40043e0 con 0x7f81dc130eb0 2023-09-30T22:22:13.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.779+0000 7f81d1ffb700 1 -- 172.21.15.156:0/2567697280 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f81d4022070 con 0x7f81dc130eb0 2023-09-30T22:22:13.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.779+0000 7f81e3648700 1 -- 172.21.15.156:0/2567697280 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81dc04f2a0 con 0x7f81dc130eb0 2023-09-30T22:22:13.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.783+0000 7f81d1ffb700 1 -- 172.21.15.156:0/2567697280 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81d4025380 con 0x7f81dc130eb0 2023-09-30T22:22:13.796 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:13.846 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:13.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.923+0000 7fc188d92700 1 Processor -- start 2023-09-30T22:22:13.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.923+0000 7fc188d92700 1 -- start start 2023-09-30T22:22:13.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.924+0000 7fc188d92700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1840a0a70 0x7fc1840a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:13.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.924+0000 7fc188d92700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc184134120 0x7fc18413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:13.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.924+0000 7fc188d92700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc18409dc00 con 0x7fc1840a1380 2023-09-30T22:22:13.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.924+0000 7fc188d92700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18409ea90 con 0x7fc184134120 2023-09-30T22:22:13.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.924+0000 7fc188d92700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc18409dec0 con 0x7fc1840a0a70 2023-09-30T22:22:13.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.924+0000 7fc18259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1840a0a70 0x7fc1840a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:13.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.924+0000 7fc181d9b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc1840a1380 0x7fc184133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47968/0 (socket says 172.21.15.156:47968) 2023-09-30T22:22:13.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.925+0000 7fc181d9b700 1 -- 172.21.15.156:0/2211035972 learned_addr learned my addr 172.21.15.156:0/2211035972 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:13.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.925+0000 7fc182d9d700 1 --2- 172.21.15.156:0/2211035972 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc184134120 0x7fc18413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:13.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.925+0000 7fc18259c700 1 -- 172.21.15.156:0/2211035972 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc184134120 msgr2=0x7fc18413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:13.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.925+0000 7fc18259c700 1 --2- 172.21.15.156:0/2211035972 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc184134120 0x7fc18413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.925+0000 7fc18259c700 1 -- 172.21.15.156:0/2211035972 >> v1:172.21.15.156:6789/0 conn(0x7fc1840a1380 legacy=0x7fc184133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.925+0000 7fc18259c700 1 -- 172.21.15.156:0/2211035972 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18409e6a0 con 0x7fc1840a0a70 2023-09-30T22:22:13.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.925+0000 7fc18159a700 1 -- 172.21.15.156:0/2211035972 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231434829 0 0) 0x7fc18409dc00 con 0x7fc1840a1380 2023-09-30T22:22:13.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.925+0000 7fc18259c700 1 --2- 172.21.15.156:0/2211035972 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1840a0a70 0x7fc1840a0e40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc174009870 tx=0x7fc174009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=898432f8664e3def server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:13.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.925+0000 7fc18159a700 1 -- 172.21.15.156:0/2211035972 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc174011830 con 0x7fc1840a0a70 2023-09-30T22:22:13.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.925+0000 7fc18159a700 1 -- 172.21.15.156:0/2211035972 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc174011990 con 0x7fc1840a0a70 2023-09-30T22:22:13.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.925+0000 7fc18159a700 1 -- 172.21.15.156:0/2211035972 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc174011d20 con 0x7fc1840a0a70 2023-09-30T22:22:13.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.926+0000 7fc188d92700 1 -- 172.21.15.156:0/2211035972 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1840a0a70 msgr2=0x7fc1840a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.926+0000 7fc188d92700 1 --2- 172.21.15.156:0/2211035972 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1840a0a70 0x7fc1840a0e40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc174009870 tx=0x7fc174009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:13.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.926+0000 7fc188d92700 1 -- 172.21.15.156:0/2211035972 shutdown_connections 2023-09-30T22:22:13.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.926+0000 7fc188d92700 1 --2- 172.21.15.156:0/2211035972 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc184134120 0x7fc18413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.926+0000 7fc188d92700 1 --2- 172.21.15.156:0/2211035972 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1840a0a70 0x7fc1840a0e40 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.926+0000 7fc188d92700 1 -- 172.21.15.156:0/2211035972 >> 172.21.15.156:0/2211035972 conn(0x7fc1840a6610 msgr2=0x7fc1840a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:13.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.926+0000 7fc188d92700 1 -- 172.21.15.156:0/2211035972 shutdown_connections 2023-09-30T22:22:13.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.926+0000 7fc188d92700 1 -- 172.21.15.156:0/2211035972 wait complete. 2023-09-30T22:22:13.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.928+0000 7fc188d92700 1 Processor -- start 2023-09-30T22:22:13.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.928+0000 7fc188d92700 1 -- start start 2023-09-30T22:22:13.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.928+0000 7fc188d92700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1840a0a70 0x7fc1841227b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:13.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.928+0000 7fc188d92700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1840a1380 0x7fc184122cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:13.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.928+0000 7fc188d92700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc184134120 0x7fc184123230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:13.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.928+0000 7fc188d92700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc184125930 con 0x7fc1840a0a70 2023-09-30T22:22:13.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.928+0000 7fc188d92700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc184124320 con 0x7fc1840a1380 2023-09-30T22:22:13.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.928+0000 7fc188d92700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1840a56b0 con 0x7fc184134120 2023-09-30T22:22:13.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.928+0000 7fc181d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1840a1380 0x7fc184122cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:13.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.928+0000 7fc18259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1840a0a70 0x7fc1841227b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:13.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.928+0000 7fc181d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1840a1380 0x7fc184122cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45140/0 (socket says 172.21.15.156:45140) 2023-09-30T22:22:13.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.928+0000 7fc181d9b700 1 -- 172.21.15.156:0/3594433724 learned_addr learned my addr 172.21.15.156:0/3594433724 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:13.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.928+0000 7fc182d9d700 1 --2- 172.21.15.156:0/3594433724 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc184134120 0x7fc184123230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:13.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.929+0000 7fc181d9b700 1 -- 172.21.15.156:0/3594433724 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc184134120 msgr2=0x7fc184123230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.929+0000 7fc181d9b700 1 --2- 172.21.15.156:0/3594433724 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc184134120 0x7fc184123230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.929+0000 7fc181d9b700 1 -- 172.21.15.156:0/3594433724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1840a0a70 msgr2=0x7fc1841227b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.929+0000 7fc181d9b700 1 --2- 172.21.15.156:0/3594433724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1840a0a70 0x7fc1841227b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.929+0000 7fc181d9b700 1 -- 172.21.15.156:0/3594433724 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1740094a0 con 0x7fc1840a1380 2023-09-30T22:22:13.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.929+0000 7fc181d9b700 1 --2- 172.21.15.156:0/3594433724 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1840a1380 0x7fc184122cf0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc178001eb0 tx=0x7fc17800c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:13.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.929+0000 7fc172ffd700 1 -- 172.21.15.156:0/3594433724 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc178004c80 con 0x7fc1840a1380 2023-09-30T22:22:13.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.929+0000 7fc188d92700 1 -- 172.21.15.156:0/3594433724 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc184126230 con 0x7fc1840a1380 2023-09-30T22:22:13.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.929+0000 7fc172ffd700 1 -- 172.21.15.156:0/3594433724 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc178004de0 con 0x7fc1840a1380 2023-09-30T22:22:13.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.929+0000 7fc172ffd700 1 -- 172.21.15.156:0/3594433724 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc178007310 con 0x7fc1840a1380 2023-09-30T22:22:13.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.929+0000 7fc188d92700 1 -- 172.21.15.156:0/3594433724 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc184125f50 con 0x7fc1840a1380 2023-09-30T22:22:13.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.930+0000 7fc188d92700 1 -- 172.21.15.156:0/3594433724 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1841336f0 con 0x7fc1840a1380 2023-09-30T22:22:13.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.931+0000 7fc172ffd700 1 -- 172.21.15.156:0/3594433724 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc178007470 con 0x7fc1840a1380 2023-09-30T22:22:13.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.931+0000 7fc172ffd700 1 -- 172.21.15.156:0/3594433724 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc17803f8d0 con 0x7fc1840a1380 2023-09-30T22:22:13.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.935+0000 7fc172ffd700 1 -- 172.21.15.156:0/3594433724 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc1780106d0 con 0x7fc1840a1380 2023-09-30T22:22:13.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.975+0000 7fa89becb700 1 Processor -- start 2023-09-30T22:22:13.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.975+0000 7fa89becb700 1 -- start start 2023-09-30T22:22:13.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.975+0000 7fa89becb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa894133ad0 0x7fa894133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:13.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.975+0000 7fa89becb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8941300a0 0x7fa8941304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:13.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.976+0000 7fa89becb700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa89406b2d0 con 0x7fa8941309f0 2023-09-30T22:22:13.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.976+0000 7fa89becb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa894133610 con 0x7fa8941300a0 2023-09-30T22:22:13.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.976+0000 7fa89becb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa89409a500 con 0x7fa894133ad0 2023-09-30T22:22:13.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.976+0000 7fa899466700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8941300a0 0x7fa8941304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:13.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.976+0000 7fa899c67700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa894133ad0 0x7fa894133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:13.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.976+0000 7fa899466700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8941300a0 0x7fa8941304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45156/0 (socket says 172.21.15.156:45156) 2023-09-30T22:22:13.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.976+0000 7fa899c67700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa894133ad0 0x7fa894133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39520/0 (socket says 172.21.15.156:39520) 2023-09-30T22:22:13.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.976+0000 7fa899466700 1 -- 172.21.15.156:0/3708055960 learned_addr learned my addr 172.21.15.156:0/3708055960 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:13.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.976+0000 7fa89a468700 1 --1- 172.21.15.156:0/3708055960 >> v1:172.21.15.156:6789/0 conn(0x7fa8941309f0 0x7fa89413a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47974/0 (socket says 172.21.15.156:47974) 2023-09-30T22:22:13.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.976+0000 7fa899466700 1 -- 172.21.15.156:0/3708055960 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa894133ad0 msgr2=0x7fa894133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:13.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.976+0000 7fa899466700 1 --2- 172.21.15.156:0/3708055960 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa894133ad0 0x7fa894133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.976+0000 7fa899466700 1 -- 172.21.15.156:0/3708055960 >> v1:172.21.15.156:6789/0 conn(0x7fa8941309f0 legacy=0x7fa89413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.976+0000 7fa899466700 1 -- 172.21.15.156:0/3708055960 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8941338b0 con 0x7fa8941300a0 2023-09-30T22:22:13.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.976+0000 7fa899c67700 1 --2- 172.21.15.156:0/3708055960 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa894133ad0 0x7fa894133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:13.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.976+0000 7fa899466700 1 --2- 172.21.15.156:0/3708055960 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8941300a0 0x7fa8941304b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa884009920 tx=0x7fa884009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a262cec18065e57 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:13.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.976+0000 7fa898c65700 1 -- 172.21.15.156:0/3708055960 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa884011830 con 0x7fa8941300a0 2023-09-30T22:22:13.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.976+0000 7fa898c65700 1 -- 172.21.15.156:0/3708055960 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa884011990 con 0x7fa8941300a0 2023-09-30T22:22:13.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.976+0000 7fa898c65700 1 -- 172.21.15.156:0/3708055960 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa884011d20 con 0x7fa8941300a0 2023-09-30T22:22:13.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.977+0000 7fa89becb700 1 -- 172.21.15.156:0/3708055960 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8941300a0 msgr2=0x7fa8941304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.977+0000 7fa89becb700 1 --2- 172.21.15.156:0/3708055960 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8941300a0 0x7fa8941304b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa884009920 tx=0x7fa884009c30 comp rx=0 tx=0).stop 2023-09-30T22:22:13.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.977+0000 7fa89becb700 1 -- 172.21.15.156:0/3708055960 shutdown_connections 2023-09-30T22:22:13.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.977+0000 7fa89becb700 1 --2- 172.21.15.156:0/3708055960 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa894133ad0 0x7fa894133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.977+0000 7fa89becb700 1 --2- 172.21.15.156:0/3708055960 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8941300a0 0x7fa8941304b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.977+0000 7fa89becb700 1 -- 172.21.15.156:0/3708055960 >> 172.21.15.156:0/3708055960 conn(0x7fa894099c40 msgr2=0x7fa8940a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:13.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.977+0000 7fa89becb700 1 -- 172.21.15.156:0/3708055960 shutdown_connections 2023-09-30T22:22:13.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.977+0000 7fa89becb700 1 -- 172.21.15.156:0/3708055960 wait complete. 2023-09-30T22:22:13.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.978+0000 7fa89becb700 1 Processor -- start 2023-09-30T22:22:13.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.979+0000 7fa89becb700 1 -- start start 2023-09-30T22:22:13.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.979+0000 7fa89becb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8941300a0 0x7fa8941c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:13.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.979+0000 7fa89becb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa8941309f0 0x7fa8941c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:13.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.979+0000 7fa89becb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa894133ad0 0x7fa8941c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:13.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.979+0000 7fa89becb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89411f930 con 0x7fa894133ad0 2023-09-30T22:22:13.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.979+0000 7fa89becb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa894072230 con 0x7fa8941300a0 2023-09-30T22:22:13.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.979+0000 7fa899c67700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8941300a0 0x7fa8941c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:13.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.979+0000 7fa899c67700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8941300a0 0x7fa8941c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45172/0 (socket says 172.21.15.156:45172) 2023-09-30T22:22:13.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.979+0000 7fa899c67700 1 -- 172.21.15.156:0/3998190632 learned_addr learned my addr 172.21.15.156:0/3998190632 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:13.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.979+0000 7fa89becb700 1 -- 172.21.15.156:0/3998190632 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa89412dd00 con 0x7fa8941309f0 2023-09-30T22:22:13.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.979+0000 7fa89a468700 1 --2- 172.21.15.156:0/3998190632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa894133ad0 0x7fa8941c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:13.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.979+0000 7fa899466700 1 --2- 172.21.15.156:0/3998190632 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa8941309f0 0x7fa8941c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:13.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.980+0000 7fa899466700 1 -- 172.21.15.156:0/3998190632 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8941300a0 msgr2=0x7fa8941c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.980+0000 7fa899466700 1 --2- 172.21.15.156:0/3998190632 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8941300a0 0x7fa8941c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.980+0000 7fa899466700 1 -- 172.21.15.156:0/3998190632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa894133ad0 msgr2=0x7fa8941c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.980+0000 7fa899466700 1 --2- 172.21.15.156:0/3998190632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa894133ad0 0x7fa8941c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.980+0000 7fa899466700 1 -- 172.21.15.156:0/3998190632 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8900094a0 con 0x7fa8941309f0 2023-09-30T22:22:13.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.980+0000 7fa89a468700 1 --2- 172.21.15.156:0/3998190632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa894133ad0 0x7fa8941c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:13.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.980+0000 7fa899c67700 1 --2- 172.21.15.156:0/3998190632 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8941300a0 0x7fa8941c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:13.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.980+0000 7fa899466700 1 --2- 172.21.15.156:0/3998190632 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa8941309f0 0x7fa8941c8c90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa884016000 tx=0x7fa884004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:13.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.980+0000 7fa88a7fc700 1 -- 172.21.15.156:0/3998190632 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa884004450 con 0x7fa8941309f0 2023-09-30T22:22:13.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.980+0000 7fa88a7fc700 1 -- 172.21.15.156:0/3998190632 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88401e070 con 0x7fa8941309f0 2023-09-30T22:22:13.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.980+0000 7fa89becb700 1 -- 172.21.15.156:0/3998190632 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa884009550 con 0x7fa8941309f0 2023-09-30T22:22:13.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.980+0000 7fa88a7fc700 1 -- 172.21.15.156:0/3998190632 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8840038c0 con 0x7fa8941309f0 2023-09-30T22:22:13.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.980+0000 7fa89becb700 1 -- 172.21.15.156:0/3998190632 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa89411fcb0 con 0x7fa8941309f0 2023-09-30T22:22:13.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.981+0000 7fa89becb700 1 -- 172.21.15.156:0/3998190632 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa89404f2a0 con 0x7fa8941309f0 2023-09-30T22:22:13.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.981+0000 7fa88a7fc700 1 -- 172.21.15.156:0/3998190632 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa884003a20 con 0x7fa8941309f0 2023-09-30T22:22:13.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.981+0000 7fa88a7fc700 1 -- 172.21.15.156:0/3998190632 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa8840406a0 con 0x7fa8941309f0 2023-09-30T22:22:13.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.989+0000 7f81e3648700 1 -- 172.21.15.156:0/2567697280 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f81dc06c3b0 con 0x7f81dc130eb0 2023-09-30T22:22:13.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.989+0000 7f81d1ffb700 1 -- 172.21.15.156:0/2567697280 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f81d4026bd0 con 0x7f81dc130eb0 2023-09-30T22:22:13.990 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:13.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.990+0000 7fa88a7fc700 1 -- 172.21.15.156:0/3998190632 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa8840045b0 con 0x7fa8941309f0 2023-09-30T22:22:13.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.991+0000 7f81e3648700 1 -- 172.21.15.156:0/2567697280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81dc130eb0 msgr2=0x7f81dc11eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.991+0000 7f81e3648700 1 --2- 172.21.15.156:0/2567697280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81dc130eb0 0x7f81dc11eea0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f81d4016000 tx=0x7f81d4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.991+0000 7f81e3648700 1 -- 172.21.15.156:0/2567697280 shutdown_connections 2023-09-30T22:22:13.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.991+0000 7f81e3648700 1 --2- 172.21.15.156:0/2567697280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81dc130eb0 0x7f81dc11eea0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.991+0000 7f81e3648700 1 --2- 172.21.15.156:0/2567697280 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81dc09d860 0x7f81dc11e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.991+0000 7f81e3648700 1 --2- 172.21.15.156:0/2567697280 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81dc09e170 0x7f81dc11e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:13.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.991+0000 7f81e3648700 1 -- 172.21.15.156:0/2567697280 >> 172.21.15.156:0/2567697280 conn(0x7f81dc099c40 msgr2=0x7f81dc0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:13.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.992+0000 7f81e3648700 1 -- 172.21.15.156:0/2567697280 shutdown_connections 2023-09-30T22:22:13.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:13.992+0000 7f81e3648700 1 -- 172.21.15.156:0/2567697280 wait complete. 2023-09-30T22:22:14.009 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:14.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.135+0000 7fc188d92700 1 -- 172.21.15.156:0/3594433724 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc18404f2a0 con 0x7fc1840a1380 2023-09-30T22:22:14.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.135+0000 7fc172ffd700 1 -- 172.21.15.156:0/3594433724 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc17801b340 con 0x7fc1840a1380 2023-09-30T22:22:14.136 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:14.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.138+0000 7fc188d92700 1 -- 172.21.15.156:0/3594433724 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1840a1380 msgr2=0x7fc184122cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.138+0000 7fc188d92700 1 --2- 172.21.15.156:0/3594433724 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1840a1380 0x7fc184122cf0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc178001eb0 tx=0x7fc17800c800 comp rx=0 tx=0).stop 2023-09-30T22:22:14.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.138+0000 7fc188d92700 1 -- 172.21.15.156:0/3594433724 shutdown_connections 2023-09-30T22:22:14.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.138+0000 7fc188d92700 1 --2- 172.21.15.156:0/3594433724 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc184134120 0x7fc184123230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:14.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.138+0000 7fc188d92700 1 --2- 172.21.15.156:0/3594433724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1840a0a70 0x7fc1841227b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:14.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.138+0000 7fc188d92700 1 --2- 172.21.15.156:0/3594433724 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1840a1380 0x7fc184122cf0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:14.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.138+0000 7fc188d92700 1 -- 172.21.15.156:0/3594433724 >> 172.21.15.156:0/3594433724 conn(0x7fc1840a6610 msgr2=0x7fc18411c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:14.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.138+0000 7fc188d92700 1 -- 172.21.15.156:0/3594433724 shutdown_connections 2023-09-30T22:22:14.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.138+0000 7fc188d92700 1 -- 172.21.15.156:0/3594433724 wait complete. 2023-09-30T22:22:14.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:14.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.188+0000 7fa89becb700 1 -- 172.21.15.156:0/3998190632 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa894120100 con 0x7fa8941309f0 2023-09-30T22:22:14.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.188+0000 7fa88a7fc700 1 -- 172.21.15.156:0/3998190632 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa884015020 con 0x7fa8941309f0 2023-09-30T22:22:14.189 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:14.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.190+0000 7fa89becb700 1 -- 172.21.15.156:0/3998190632 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa8941309f0 msgr2=0x7fa8941c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.190+0000 7fa89becb700 1 --2- 172.21.15.156:0/3998190632 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa8941309f0 0x7fa8941c8c90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa884016000 tx=0x7fa884004750 comp rx=0 tx=0).stop 2023-09-30T22:22:14.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.190+0000 7fa89becb700 1 -- 172.21.15.156:0/3998190632 shutdown_connections 2023-09-30T22:22:14.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.190+0000 7fa89becb700 1 --2- 172.21.15.156:0/3998190632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa894133ad0 0x7fa8941c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:14.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.190+0000 7fa89becb700 1 --2- 172.21.15.156:0/3998190632 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8941300a0 0x7fa8941c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:14.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.190+0000 7fa89becb700 1 --2- 172.21.15.156:0/3998190632 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa8941309f0 0x7fa8941c8c90 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:14.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.190+0000 7fa89becb700 1 -- 172.21.15.156:0/3998190632 >> 172.21.15.156:0/3998190632 conn(0x7fa894099c40 msgr2=0x7fa89409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:14.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.190+0000 7fa89becb700 1 -- 172.21.15.156:0/3998190632 shutdown_connections 2023-09-30T22:22:14.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.190+0000 7fa89becb700 1 -- 172.21.15.156:0/3998190632 wait complete. 2023-09-30T22:22:14.203 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:14.427 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:14.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.549+0000 7f0177654700 1 Processor -- start 2023-09-30T22:22:14.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.550+0000 7f0177654700 1 -- start start 2023-09-30T22:22:14.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.550+0000 7f0177654700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f017009e870 0x7f017009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:14.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.550+0000 7f0177654700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f017009f180 0x7f0170131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:14.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.550+0000 7f0177654700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f017009c970 con 0x7f0170131d70 2023-09-30T22:22:14.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.550+0000 7f0177654700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01700a0920 con 0x7f017009f180 2023-09-30T22:22:14.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.550+0000 7f0177654700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f017009f9c0 con 0x7f017009e870 2023-09-30T22:22:14.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.550+0000 7f0174bef700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f017009f180 0x7f0170131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:14.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.550+0000 7f01753f0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f017009e870 0x7f017009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:14.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.550+0000 7f01753f0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f017009e870 0x7f017009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39526/0 (socket says 172.21.15.156:39526) 2023-09-30T22:22:14.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.550+0000 7f0174bef700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f017009f180 0x7f0170131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45176/0 (socket says 172.21.15.156:45176) 2023-09-30T22:22:14.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.550+0000 7f01753f0700 1 -- 172.21.15.156:0/1775980184 learned_addr learned my addr 172.21.15.156:0/1775980184 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:14.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.550+0000 7f0175bf1700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f0170131d70 0x7f0170138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47976/0 (socket says 172.21.15.156:47976) 2023-09-30T22:22:14.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.550+0000 7f0174bef700 1 -- 172.21.15.156:0/1775980184 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f017009e870 msgr2=0x7f017009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:14.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.550+0000 7f0167fff700 1 -- 172.21.15.156:0/1775980184 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 811142811 0 0) 0x7f017009c970 con 0x7f0170131d70 2023-09-30T22:22:14.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.550+0000 7f0174bef700 1 --2- 172.21.15.156:0/1775980184 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f017009e870 0x7f017009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:14.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.550+0000 7f0174bef700 1 -- 172.21.15.156:0/1775980184 >> v1:172.21.15.156:6789/0 conn(0x7f0170131d70 legacy=0x7f0170138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.551+0000 7f0174bef700 1 -- 172.21.15.156:0/1775980184 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017009bab0 con 0x7f017009f180 2023-09-30T22:22:14.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.551+0000 7f01753f0700 1 --2- 172.21.15.156:0/1775980184 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f017009e870 0x7f017009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:14.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.551+0000 7f0174bef700 1 --2- 172.21.15.156:0/1775980184 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f017009f180 0x7f0170131830 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f016c009870 tx=0x7f016c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1dbde01ac2c58af server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:14.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.551+0000 7f0167fff700 1 -- 172.21.15.156:0/1775980184 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c011830 con 0x7f017009f180 2023-09-30T22:22:14.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.551+0000 7f0167fff700 1 -- 172.21.15.156:0/1775980184 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016c011990 con 0x7f017009f180 2023-09-30T22:22:14.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.551+0000 7f0167fff700 1 -- 172.21.15.156:0/1775980184 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c011d20 con 0x7f017009f180 2023-09-30T22:22:14.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.551+0000 7f0177654700 1 -- 172.21.15.156:0/1775980184 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f017009f180 msgr2=0x7f0170131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.551+0000 7f0177654700 1 --2- 172.21.15.156:0/1775980184 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f017009f180 0x7f0170131830 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f016c009870 tx=0x7f016c009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:14.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.551+0000 7f0177654700 1 -- 172.21.15.156:0/1775980184 shutdown_connections 2023-09-30T22:22:14.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.551+0000 7f0177654700 1 --2- 172.21.15.156:0/1775980184 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f017009e870 0x7f017009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:14.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.551+0000 7f0177654700 1 --2- 172.21.15.156:0/1775980184 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f017009f180 0x7f0170131830 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:14.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.551+0000 7f0177654700 1 -- 172.21.15.156:0/1775980184 >> 172.21.15.156:0/1775980184 conn(0x7f01700a4430 msgr2=0x7f01700a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:14.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.552+0000 7f0177654700 1 -- 172.21.15.156:0/1775980184 shutdown_connections 2023-09-30T22:22:14.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.552+0000 7f0177654700 1 -- 172.21.15.156:0/1775980184 wait complete. 2023-09-30T22:22:14.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.552+0000 7f0177654700 1 Processor -- start 2023-09-30T22:22:14.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.552+0000 7f0177654700 1 -- start start 2023-09-30T22:22:14.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.553+0000 7f0177654700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f017009e870 0x7f017006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:14.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.553+0000 7f0177654700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f017009f180 0x7f017006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:14.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.553+0000 7f0177654700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0170131d70 0x7f017006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:14.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.553+0000 7f0177654700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0170130690 con 0x7f0170131d70 2023-09-30T22:22:14.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.553+0000 7f0177654700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0170124860 con 0x7f017009f180 2023-09-30T22:22:14.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.553+0000 7f0177654700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0170123750 con 0x7f017009e870 2023-09-30T22:22:14.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.553+0000 7f01753f0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f017009e870 0x7f017006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:14.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.553+0000 7f0175bf1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0170131d70 0x7f017006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:14.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.553+0000 7f01753f0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f017009e870 0x7f017006b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39532/0 (socket says 172.21.15.156:39532) 2023-09-30T22:22:14.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.553+0000 7f01753f0700 1 -- 172.21.15.156:0/3981600353 learned_addr learned my addr 172.21.15.156:0/3981600353 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:14.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.553+0000 7f0174bef700 1 --2- 172.21.15.156:0/3981600353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f017009f180 0x7f017006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:14.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.553+0000 7f01753f0700 1 -- 172.21.15.156:0/3981600353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f017009f180 msgr2=0x7f017006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.553+0000 7f01753f0700 1 --2- 172.21.15.156:0/3981600353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f017009f180 0x7f017006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:14.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.553+0000 7f01753f0700 1 -- 172.21.15.156:0/3981600353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0170131d70 msgr2=0x7f017006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.553+0000 7f01753f0700 1 --2- 172.21.15.156:0/3981600353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0170131d70 0x7f017006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:14.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.553+0000 7f01753f0700 1 -- 172.21.15.156:0/3981600353 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0160009550 con 0x7f017009e870 2023-09-30T22:22:14.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.553+0000 7f0175bf1700 1 --2- 172.21.15.156:0/3981600353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0170131d70 0x7f017006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:14.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.553+0000 7f01753f0700 1 --2- 172.21.15.156:0/3981600353 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f017009e870 0x7f017006b8b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f016000e9b0 tx=0x7f016000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:14.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.554+0000 7f0165ffb700 1 -- 172.21.15.156:0/3981600353 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016000ee50 con 0x7f017009e870 2023-09-30T22:22:14.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.554+0000 7f0165ffb700 1 -- 172.21.15.156:0/3981600353 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016000c850 con 0x7f017009e870 2023-09-30T22:22:14.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.554+0000 7f0165ffb700 1 -- 172.21.15.156:0/3981600353 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016000cbc0 con 0x7f017009e870 2023-09-30T22:22:14.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.554+0000 7f0177654700 1 -- 172.21.15.156:0/3981600353 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f016c0094a0 con 0x7f017009e870 2023-09-30T22:22:14.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.554+0000 7f0177654700 1 -- 172.21.15.156:0/3981600353 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0170124590 con 0x7f017009e870 2023-09-30T22:22:14.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.554+0000 7f0165ffb700 1 -- 172.21.15.156:0/3981600353 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f016000cd20 con 0x7f017009e870 2023-09-30T22:22:14.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.555+0000 7f0165ffb700 1 -- 172.21.15.156:0/3981600353 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f016003fa80 con 0x7f017009e870 2023-09-30T22:22:14.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.555+0000 7f0177654700 1 -- 172.21.15.156:0/3981600353 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f017011be60 con 0x7f017009e870 2023-09-30T22:22:14.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.559+0000 7f0165ffb700 1 -- 172.21.15.156:0/3981600353 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f016001b3b0 con 0x7f017009e870 2023-09-30T22:22:14.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.746+0000 7f0177654700 1 -- 172.21.15.156:0/3981600353 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f017009dba0 con 0x7f017009e870 2023-09-30T22:22:14.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.746+0000 7f0165ffb700 1 -- 172.21.15.156:0/3981600353 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f016002a090 con 0x7f017009e870 2023-09-30T22:22:14.747 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:14.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.748+0000 7f0177654700 1 -- 172.21.15.156:0/3981600353 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f017009e870 msgr2=0x7f017006b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.748+0000 7f0177654700 1 --2- 172.21.15.156:0/3981600353 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f017009e870 0x7f017006b8b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f016000e9b0 tx=0x7f016000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:22:14.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.748+0000 7f0177654700 1 -- 172.21.15.156:0/3981600353 shutdown_connections 2023-09-30T22:22:14.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.748+0000 7f0177654700 1 --2- 172.21.15.156:0/3981600353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0170131d70 0x7f017006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:14.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.748+0000 7f0177654700 1 --2- 172.21.15.156:0/3981600353 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f017009e870 0x7f017006b8b0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:14.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.748+0000 7f0177654700 1 --2- 172.21.15.156:0/3981600353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f017009f180 0x7f017006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:14.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.748+0000 7f0177654700 1 -- 172.21.15.156:0/3981600353 >> 172.21.15.156:0/3981600353 conn(0x7f01700a4430 msgr2=0x7f0170131040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:14.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.748+0000 7f0177654700 1 -- 172.21.15.156:0/3981600353 shutdown_connections 2023-09-30T22:22:14.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:14.748+0000 7f0177654700 1 -- 172.21.15.156:0/3981600353 wait complete. 2023-09-30T22:22:14.762 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:15.010 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:15.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.132+0000 7f4885eb5700 1 Processor -- start 2023-09-30T22:22:15.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.132+0000 7f4885eb5700 1 -- start start 2023-09-30T22:22:15.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.133+0000 7f4885eb5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f488009e870 0x7f488009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.133+0000 7f4885eb5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f48801343a0 0x7f488013bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.133+0000 7f4885eb5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f488006bec0 con 0x7f488009f180 2023-09-30T22:22:15.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.133+0000 7f4885eb5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f488006ce60 con 0x7f48801343a0 2023-09-30T22:22:15.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.133+0000 7f4885eb5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f488009fa00 con 0x7f488009e870 2023-09-30T22:22:15.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.133+0000 7f487ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f48801343a0 0x7f488013bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.133+0000 7f487f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f488009e870 0x7f488009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.133+0000 7f487ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f48801343a0 0x7f488013bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:43468/0 (socket says 172.21.15.156:43468) 2023-09-30T22:22:15.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.133+0000 7f487f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f488009e870 0x7f488009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39548/0 (socket says 172.21.15.156:39548) 2023-09-30T22:22:15.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.133+0000 7f487ffff700 1 -- 172.21.15.156:0/2276781388 learned_addr learned my addr 172.21.15.156:0/2276781388 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:15.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.133+0000 7f4876ffd700 1 --1- 172.21.15.156:0/2276781388 >> v1:172.21.15.156:6789/0 conn(0x7f488009f180 0x7f4880133c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47980/0 (socket says 172.21.15.156:47980) 2023-09-30T22:22:15.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.133+0000 7f487f7fe700 1 -- 172.21.15.156:0/2276781388 >> v2:172.21.15.156:3300/0 conn(0x7f48801343a0 msgr2=0x7f488013bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:15.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.133+0000 7f487f7fe700 1 --2- 172.21.15.156:0/2276781388 >> v2:172.21.15.156:3300/0 conn(0x7f48801343a0 0x7f488013bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.133+0000 7f487f7fe700 1 -- 172.21.15.156:0/2276781388 >> v1:172.21.15.156:6789/0 conn(0x7f488009f180 legacy=0x7f4880133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.133+0000 7f487f7fe700 1 -- 172.21.15.156:0/2276781388 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488009ad80 con 0x7f488009e870 2023-09-30T22:22:15.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.133+0000 7f487effd700 1 -- 172.21.15.156:0/2276781388 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1130884890 0 0) 0x7f488006bec0 con 0x7f488009f180 2023-09-30T22:22:15.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.133+0000 7f487ffff700 1 --2- 172.21.15.156:0/2276781388 >> v2:172.21.15.156:3300/0 conn(0x7f48801343a0 0x7f488013bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:15.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.133+0000 7f487f7fe700 1 --2- 172.21.15.156:0/2276781388 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f488009e870 0x7f488009ec40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4870009840 tx=0x7f4870009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b6c46e2f5945d0d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:15.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.134+0000 7f487effd700 1 -- 172.21.15.156:0/2276781388 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4870011830 con 0x7f488009e870 2023-09-30T22:22:15.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.134+0000 7f487effd700 1 -- 172.21.15.156:0/2276781388 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4870011990 con 0x7f488009e870 2023-09-30T22:22:15.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.134+0000 7f487effd700 1 -- 172.21.15.156:0/2276781388 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4870011d20 con 0x7f488009e870 2023-09-30T22:22:15.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.134+0000 7f4885eb5700 1 -- 172.21.15.156:0/2276781388 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f488009e870 msgr2=0x7f488009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.134+0000 7f4885eb5700 1 --2- 172.21.15.156:0/2276781388 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f488009e870 0x7f488009ec40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4870009840 tx=0x7f4870009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:15.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.134+0000 7f4885eb5700 1 -- 172.21.15.156:0/2276781388 shutdown_connections 2023-09-30T22:22:15.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.134+0000 7f4885eb5700 1 --2- 172.21.15.156:0/2276781388 >> v2:172.21.15.156:3300/0 conn(0x7f48801343a0 0x7f488013bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.134+0000 7f4885eb5700 1 --2- 172.21.15.156:0/2276781388 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f488009e870 0x7f488009ec40 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.134+0000 7f4885eb5700 1 -- 172.21.15.156:0/2276781388 >> 172.21.15.156:0/2276781388 conn(0x7f48800a4430 msgr2=0x7f48800a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:15.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.134+0000 7f4885eb5700 1 -- 172.21.15.156:0/2276781388 shutdown_connections 2023-09-30T22:22:15.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.134+0000 7f4885eb5700 1 -- 172.21.15.156:0/2276781388 wait complete. 2023-09-30T22:22:15.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.135+0000 7f4885eb5700 1 Processor -- start 2023-09-30T22:22:15.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.135+0000 7f4885eb5700 1 -- start start 2023-09-30T22:22:15.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.136+0000 7f4885eb5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f488009e870 0x7f4880122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.136+0000 7f4885eb5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f488009f180 0x7f4880122e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.136+0000 7f4885eb5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48801343a0 0x7f48801233b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.136+0000 7f4885eb5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4880125b00 con 0x7f488009f180 2023-09-30T22:22:15.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.136+0000 7f4885eb5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48801244f0 con 0x7f488009e870 2023-09-30T22:22:15.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.136+0000 7f4885eb5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4880133490 con 0x7f48801343a0 2023-09-30T22:22:15.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.136+0000 7f487ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48801343a0 0x7f48801233b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.136+0000 7f4876ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f488009f180 0x7f4880122e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.136+0000 7f487f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f488009e870 0x7f4880122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.136+0000 7f487ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48801343a0 0x7f48801233b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39552/0 (socket says 172.21.15.156:39552) 2023-09-30T22:22:15.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.136+0000 7f4876ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f488009f180 0x7f4880122e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:43478/0 (socket says 172.21.15.156:43478) 2023-09-30T22:22:15.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.136+0000 7f487f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f488009e870 0x7f4880122930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45182/0 (socket says 172.21.15.156:45182) 2023-09-30T22:22:15.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.136+0000 7f487ffff700 1 -- 172.21.15.156:0/2036956522 learned_addr learned my addr 172.21.15.156:0/2036956522 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:15.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.136+0000 7f487ffff700 1 -- 172.21.15.156:0/2036956522 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f488009e870 msgr2=0x7f4880122930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.136+0000 7f487ffff700 1 --2- 172.21.15.156:0/2036956522 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f488009e870 0x7f4880122930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.136+0000 7f487ffff700 1 -- 172.21.15.156:0/2036956522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f488009f180 msgr2=0x7f4880122e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.136+0000 7f487ffff700 1 --2- 172.21.15.156:0/2036956522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f488009f180 0x7f4880122e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.136+0000 7f487ffff700 1 -- 172.21.15.156:0/2036956522 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4878009b30 con 0x7f48801343a0 2023-09-30T22:22:15.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.136+0000 7f487ffff700 1 --2- 172.21.15.156:0/2036956522 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48801343a0 0x7f48801233b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f487800efc0 tx=0x7f487800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:15.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.136+0000 7f487cff9700 1 -- 172.21.15.156:0/2036956522 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4878018070 con 0x7f48801343a0 2023-09-30T22:22:15.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.136+0000 7f487cff9700 1 -- 172.21.15.156:0/2036956522 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487800f040 con 0x7f48801343a0 2023-09-30T22:22:15.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.136+0000 7f487cff9700 1 -- 172.21.15.156:0/2036956522 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4878003c20 con 0x7f48801343a0 2023-09-30T22:22:15.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.136+0000 7f4885eb5700 1 -- 172.21.15.156:0/2036956522 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48700094a0 con 0x7f48801343a0 2023-09-30T22:22:15.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.136+0000 7f4885eb5700 1 -- 172.21.15.156:0/2036956522 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f488006cfa0 con 0x7f48801343a0 2023-09-30T22:22:15.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.137+0000 7f487cff9700 1 -- 172.21.15.156:0/2036956522 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f487800c880 con 0x7f48801343a0 2023-09-30T22:22:15.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.137+0000 7f487cff9700 1 -- 172.21.15.156:0/2036956522 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f487803f790 con 0x7f48801343a0 2023-09-30T22:22:15.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.137+0000 7f4885eb5700 1 -- 172.21.15.156:0/2036956522 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488004f2a0 con 0x7f48801343a0 2023-09-30T22:22:15.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.142+0000 7f487cff9700 1 -- 172.21.15.156:0/2036956522 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f487800ce10 con 0x7f48801343a0 2023-09-30T22:22:15.151 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:15.204 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:15.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.286+0000 7f873f86f700 1 Processor -- start 2023-09-30T22:22:15.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.287+0000 7f873f86f700 1 -- start start 2023-09-30T22:22:15.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.287+0000 7f873f86f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8738133ad0 0x7f8738133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.287+0000 7f873f86f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87381300a0 0x7f87381304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.287+0000 7f873f86f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f87381309f0 0x7f873813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.287+0000 7f873f86f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f873806b2d0 con 0x7f87381309f0 2023-09-30T22:22:15.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.287+0000 7f873f86f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8738133610 con 0x7f87381300a0 2023-09-30T22:22:15.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.287+0000 7f873f86f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f873809a500 con 0x7f8738133ad0 2023-09-30T22:22:15.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.287+0000 7f873d60b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8738133ad0 0x7f8738133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.287+0000 7f873ce0a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87381300a0 0x7f87381304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.287+0000 7f873de0c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f87381309f0 0x7f873813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.287+0000 7f873d60b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8738133ad0 0x7f8738133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39556/0 (socket says 172.21.15.156:39556) 2023-09-30T22:22:15.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.287+0000 7f873d60b700 1 -- 172.21.15.156:0/4176438175 learned_addr learned my addr 172.21.15.156:0/4176438175 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:15.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.288+0000 7f873ce0a700 1 -- 172.21.15.156:0/4176438175 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8738133ad0 msgr2=0x7f8738133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:15.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.288+0000 7f873ce0a700 1 --2- 172.21.15.156:0/4176438175 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8738133ad0 0x7f8738133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.288+0000 7f873ce0a700 1 -- 172.21.15.156:0/4176438175 >> v2:172.21.15.156:3300/0 conn(0x7f87381309f0 msgr2=0x7f873813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:15.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.288+0000 7f873ce0a700 1 --2- 172.21.15.156:0/4176438175 >> v2:172.21.15.156:3300/0 conn(0x7f87381309f0 0x7f873813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.288+0000 7f873ce0a700 1 -- 172.21.15.156:0/4176438175 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87381338b0 con 0x7f87381300a0 2023-09-30T22:22:15.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.288+0000 7f873d60b700 1 --2- 172.21.15.156:0/4176438175 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8738133ad0 0x7f8738133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:15.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.288+0000 7f873ce0a700 1 --2- 172.21.15.156:0/4176438175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87381300a0 0x7f87381304b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8728009840 tx=0x7f8728009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27fa10d384e5c3f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:15.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.288+0000 7f872ffff700 1 -- 172.21.15.156:0/4176438175 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728011830 con 0x7f87381300a0 2023-09-30T22:22:15.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.288+0000 7f872ffff700 1 -- 172.21.15.156:0/4176438175 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8728011990 con 0x7f87381300a0 2023-09-30T22:22:15.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.288+0000 7f872ffff700 1 -- 172.21.15.156:0/4176438175 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728011d20 con 0x7f87381300a0 2023-09-30T22:22:15.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.289+0000 7f873f86f700 1 -- 172.21.15.156:0/4176438175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87381300a0 msgr2=0x7f87381304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.289+0000 7f873f86f700 1 --2- 172.21.15.156:0/4176438175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87381300a0 0x7f87381304b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8728009840 tx=0x7f8728009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:15.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.289+0000 7f873f86f700 1 -- 172.21.15.156:0/4176438175 shutdown_connections 2023-09-30T22:22:15.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.289+0000 7f873f86f700 1 --2- 172.21.15.156:0/4176438175 >> v2:172.21.15.156:3300/0 conn(0x7f87381309f0 0x7f873813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.289+0000 7f873f86f700 1 --2- 172.21.15.156:0/4176438175 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8738133ad0 0x7f8738133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.289+0000 7f873f86f700 1 --2- 172.21.15.156:0/4176438175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87381300a0 0x7f87381304b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.289+0000 7f873f86f700 1 -- 172.21.15.156:0/4176438175 >> 172.21.15.156:0/4176438175 conn(0x7f8738099c40 msgr2=0x7f87380a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:15.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.289+0000 7f873f86f700 1 -- 172.21.15.156:0/4176438175 shutdown_connections 2023-09-30T22:22:15.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.289+0000 7f873f86f700 1 -- 172.21.15.156:0/4176438175 wait complete. 2023-09-30T22:22:15.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.290+0000 7f873f86f700 1 Processor -- start 2023-09-30T22:22:15.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.290+0000 7f873f86f700 1 -- start start 2023-09-30T22:22:15.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.290+0000 7f873f86f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87381300a0 0x7f873811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.291+0000 7f873f86f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87381309f0 0x7f873811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.291+0000 7f873f86f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8738133ad0 0x7f873811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.291+0000 7f873f86f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873811fb90 con 0x7f8738133ad0 2023-09-30T22:22:15.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.291+0000 7f873f86f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873812da50 con 0x7f87381300a0 2023-09-30T22:22:15.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.291+0000 7f873f86f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8738072210 con 0x7f87381309f0 2023-09-30T22:22:15.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.291+0000 7f873ce0a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87381309f0 0x7f873811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.291+0000 7f873d60b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87381300a0 0x7f873811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.291+0000 7f873ce0a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87381309f0 0x7f873811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39570/0 (socket says 172.21.15.156:39570) 2023-09-30T22:22:15.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.291+0000 7f873ce0a700 1 -- 172.21.15.156:0/1725866012 learned_addr learned my addr 172.21.15.156:0/1725866012 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:15.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.291+0000 7f873de0c700 1 --2- 172.21.15.156:0/1725866012 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8738133ad0 0x7f873811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.291+0000 7f873d60b700 1 -- 172.21.15.156:0/1725866012 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87381309f0 msgr2=0x7f873811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.291+0000 7f873d60b700 1 --2- 172.21.15.156:0/1725866012 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87381309f0 0x7f873811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.291+0000 7f873d60b700 1 -- 172.21.15.156:0/1725866012 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8738133ad0 msgr2=0x7f873811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.291+0000 7f873d60b700 1 --2- 172.21.15.156:0/1725866012 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8738133ad0 0x7f873811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.291+0000 7f873d60b700 1 -- 172.21.15.156:0/1725866012 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8734009550 con 0x7f87381300a0 2023-09-30T22:22:15.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.291+0000 7f873ce0a700 1 --2- 172.21.15.156:0/1725866012 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87381309f0 0x7f873811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:15.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.291+0000 7f873de0c700 1 --2- 172.21.15.156:0/1725866012 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8738133ad0 0x7f873811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:22:15.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.291+0000 7f873d60b700 1 --2- 172.21.15.156:0/1725866012 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87381300a0 0x7f873811da40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f873400e9d0 tx=0x7f873400ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:15.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.291+0000 7f872dffb700 1 -- 172.21.15.156:0/1725866012 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8734004030 con 0x7f87381300a0 2023-09-30T22:22:15.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.291+0000 7f872dffb700 1 -- 172.21.15.156:0/1725866012 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8734004190 con 0x7f87381300a0 2023-09-30T22:22:15.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.291+0000 7f872dffb700 1 -- 172.21.15.156:0/1725866012 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8734004520 con 0x7f87381300a0 2023-09-30T22:22:15.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.291+0000 7f873f86f700 1 -- 172.21.15.156:0/1725866012 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87280094a0 con 0x7f87381300a0 2023-09-30T22:22:15.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.292+0000 7f873f86f700 1 -- 172.21.15.156:0/1725866012 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f873811fea0 con 0x7f87381300a0 2023-09-30T22:22:15.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.292+0000 7f872dffb700 1 -- 172.21.15.156:0/1725866012 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f873400c850 con 0x7f87381300a0 2023-09-30T22:22:15.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.292+0000 7f873f86f700 1 -- 172.21.15.156:0/1725866012 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f873804f2a0 con 0x7f87381300a0 2023-09-30T22:22:15.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.293+0000 7f872dffb700 1 -- 172.21.15.156:0/1725866012 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f87340421c0 con 0x7f87381300a0 2023-09-30T22:22:15.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.297+0000 7f872dffb700 1 -- 172.21.15.156:0/1725866012 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f873811fea0 con 0x7f87381300a0 2023-09-30T22:22:15.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.339+0000 7f4d52bef700 1 Processor -- start 2023-09-30T22:22:15.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.339+0000 7f4d52bef700 1 -- start start 2023-09-30T22:22:15.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.340+0000 7f4d52bef700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4d4c0a1550 0x7f4d4c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.340+0000 7f4d52bef700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d4c139200 0x7f4d4c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.340+0000 7f4d52bef700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4c09e9d0 con 0x7f4d4c0a0a70 2023-09-30T22:22:15.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.340+0000 7f4d52bef700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4c09dc00 con 0x7f4d4c0a1550 2023-09-30T22:22:15.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.340+0000 7f4d52bef700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c09dec0 con 0x7f4d4c139200 2023-09-30T22:22:15.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.340+0000 7f4d5118c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d4c139200 0x7f4d4c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.340+0000 7f4d4bfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4d4c0a1550 0x7f4d4c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.340+0000 7f4d5118c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d4c139200 0x7f4d4c13b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39582/0 (socket says 172.21.15.156:39582) 2023-09-30T22:22:15.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.340+0000 7f4d5118c700 1 -- 172.21.15.156:0/3663040338 learned_addr learned my addr 172.21.15.156:0/3663040338 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:15.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.340+0000 7f4d4bfff700 1 -- 172.21.15.156:0/3663040338 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d4c139200 msgr2=0x7f4d4c13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:15.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.340+0000 7f4d4bfff700 1 --2- 172.21.15.156:0/3663040338 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d4c139200 0x7f4d4c13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.340+0000 7f4d4bfff700 1 -- 172.21.15.156:0/3663040338 >> v1:172.21.15.156:6789/0 conn(0x7f4d4c0a0a70 legacy=0x7f4d4c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.340+0000 7f4d4b7fe700 1 -- 172.21.15.156:0/3663040338 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1394198972 0 0) 0x7f4d4c09e9d0 con 0x7f4d4c0a0a70 2023-09-30T22:22:15.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.341+0000 7f4d4bfff700 1 -- 172.21.15.156:0/3663040338 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c09e6a0 con 0x7f4d4c0a1550 2023-09-30T22:22:15.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.341+0000 7f4d4bfff700 1 --2- 172.21.15.156:0/3663040338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d4c0a1550 0x7f4d4c138cc0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f4d38009840 tx=0x7f4d38009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da3508083696379 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:15.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.341+0000 7f4d4b7fe700 1 -- 172.21.15.156:0/3663040338 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d38011830 con 0x7f4d4c0a1550 2023-09-30T22:22:15.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.341+0000 7f4d4b7fe700 1 -- 172.21.15.156:0/3663040338 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d38011990 con 0x7f4d4c0a1550 2023-09-30T22:22:15.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.341+0000 7f4d4b7fe700 1 -- 172.21.15.156:0/3663040338 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d38011d20 con 0x7f4d4c0a1550 2023-09-30T22:22:15.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.341+0000 7f4d52bef700 1 -- 172.21.15.156:0/3663040338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d4c0a1550 msgr2=0x7f4d4c138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.341+0000 7f4d52bef700 1 --2- 172.21.15.156:0/3663040338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d4c0a1550 0x7f4d4c138cc0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f4d38009840 tx=0x7f4d38009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:15.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.341+0000 7f4d52bef700 1 -- 172.21.15.156:0/3663040338 shutdown_connections 2023-09-30T22:22:15.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.341+0000 7f4d52bef700 1 --2- 172.21.15.156:0/3663040338 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d4c139200 0x7f4d4c13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.341+0000 7f4d52bef700 1 --2- 172.21.15.156:0/3663040338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d4c0a1550 0x7f4d4c138cc0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.341+0000 7f4d52bef700 1 -- 172.21.15.156:0/3663040338 >> 172.21.15.156:0/3663040338 conn(0x7f4d4c0a6610 msgr2=0x7f4d4c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:15.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.341+0000 7f4d52bef700 1 -- 172.21.15.156:0/3663040338 shutdown_connections 2023-09-30T22:22:15.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.341+0000 7f4d52bef700 1 -- 172.21.15.156:0/3663040338 wait complete. 2023-09-30T22:22:15.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.342+0000 7f4d52bef700 1 Processor -- start 2023-09-30T22:22:15.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.342+0000 7f4d52bef700 1 -- start start 2023-09-30T22:22:15.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.343+0000 7f4d52bef700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d4c0a0a70 0x7f4d4c11e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.343+0000 7f4d52bef700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d4c0a1550 0x7f4d4c11ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.343+0000 7f4d52bef700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d4c139200 0x7f4d4c11f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.343+0000 7f4d52bef700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c121eb0 con 0x7f4d4c0a1550 2023-09-30T22:22:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.343+0000 7f4d52bef700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c0a03e0 con 0x7f4d4c0a0a70 2023-09-30T22:22:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.343+0000 7f4d52bef700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c0a5100 con 0x7f4d4c139200 2023-09-30T22:22:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.343+0000 7f4d4bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d4c0a1550 0x7f4d4c11ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.343+0000 7f4d5098b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d4c0a0a70 0x7f4d4c11e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.343+0000 7f4d4bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d4c0a1550 0x7f4d4c11ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:43512/0 (socket says 172.21.15.156:43512) 2023-09-30T22:22:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.343+0000 7f4d4bfff700 1 -- 172.21.15.156:0/1542340495 learned_addr learned my addr 172.21.15.156:0/1542340495 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.343+0000 7f4d5118c700 1 --2- 172.21.15.156:0/1542340495 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d4c139200 0x7f4d4c11f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.343+0000 7f4d4bfff700 1 -- 172.21.15.156:0/1542340495 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d4c139200 msgr2=0x7f4d4c11f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.343+0000 7f4d4bfff700 1 --2- 172.21.15.156:0/1542340495 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d4c139200 0x7f4d4c11f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.343+0000 7f4d4bfff700 1 -- 172.21.15.156:0/1542340495 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d4c0a0a70 msgr2=0x7f4d4c11e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.343+0000 7f4d4bfff700 1 --2- 172.21.15.156:0/1542340495 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d4c0a0a70 0x7f4d4c11e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.343+0000 7f4d4bfff700 1 -- 172.21.15.156:0/1542340495 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d380094a0 con 0x7f4d4c0a1550 2023-09-30T22:22:15.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.343+0000 7f4d5118c700 1 --2- 172.21.15.156:0/1542340495 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d4c139200 0x7f4d4c11f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:15.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.343+0000 7f4d5098b700 1 --2- 172.21.15.156:0/1542340495 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d4c0a0a70 0x7f4d4c11e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:15.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.344+0000 7f4d4bfff700 1 --2- 172.21.15.156:0/1542340495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d4c0a1550 0x7f4d4c11ecc0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f4d38009fd0 tx=0x7f4d38004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:15.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.344+0000 7f4d497fa700 1 -- 172.21.15.156:0/1542340495 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d38004550 con 0x7f4d4c0a1550 2023-09-30T22:22:15.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.344+0000 7f4d497fa700 1 -- 172.21.15.156:0/1542340495 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3801f070 con 0x7f4d4c0a1550 2023-09-30T22:22:15.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.344+0000 7f4d52bef700 1 -- 172.21.15.156:0/1542340495 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d4c120a40 con 0x7f4d4c0a1550 2023-09-30T22:22:15.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.344+0000 7f4d497fa700 1 -- 172.21.15.156:0/1542340495 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d380038e0 con 0x7f4d4c0a1550 2023-09-30T22:22:15.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.344+0000 7f4d52bef700 1 -- 172.21.15.156:0/1542340495 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4c122190 con 0x7f4d4c0a1550 2023-09-30T22:22:15.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.345+0000 7f4d497fa700 1 -- 172.21.15.156:0/1542340495 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d38003a40 con 0x7f4d4c0a1550 2023-09-30T22:22:15.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.345+0000 7f4d497fa700 1 -- 172.21.15.156:0/1542340495 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4d38021070 con 0x7f4d4c0a1550 2023-09-30T22:22:15.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.345+0000 7f4d52bef700 1 -- 172.21.15.156:0/1542340495 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d4c04f2a0 con 0x7f4d4c0a1550 2023-09-30T22:22:15.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.347+0000 7f4885eb5700 1 -- 172.21.15.156:0/2036956522 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4880072d60 con 0x7f48801343a0 2023-09-30T22:22:15.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.348+0000 7f487cff9700 1 -- 172.21.15.156:0/2036956522 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f487802c090 con 0x7f48801343a0 2023-09-30T22:22:15.349 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:15.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.350+0000 7f4885eb5700 1 -- 172.21.15.156:0/2036956522 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48801343a0 msgr2=0x7f48801233b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.350+0000 7f4885eb5700 1 --2- 172.21.15.156:0/2036956522 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48801343a0 0x7f48801233b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f487800efc0 tx=0x7f487800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.350+0000 7f4885eb5700 1 -- 172.21.15.156:0/2036956522 shutdown_connections 2023-09-30T22:22:15.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.350+0000 7f4885eb5700 1 --2- 172.21.15.156:0/2036956522 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48801343a0 0x7f48801233b0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.350+0000 7f4885eb5700 1 --2- 172.21.15.156:0/2036956522 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f488009e870 0x7f4880122930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.350+0000 7f4885eb5700 1 --2- 172.21.15.156:0/2036956522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f488009f180 0x7f4880122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.350+0000 7f4885eb5700 1 -- 172.21.15.156:0/2036956522 >> 172.21.15.156:0/2036956522 conn(0x7f48800a4430 msgr2=0x7f488009d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:15.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.350+0000 7f4885eb5700 1 -- 172.21.15.156:0/2036956522 shutdown_connections 2023-09-30T22:22:15.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.350+0000 7f4885eb5700 1 -- 172.21.15.156:0/2036956522 wait complete. 2023-09-30T22:22:15.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.350+0000 7f4d497fa700 1 -- 172.21.15.156:0/1542340495 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d38015020 con 0x7f4d4c0a1550 2023-09-30T22:22:15.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:15.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.494+0000 7f873f86f700 1 -- 172.21.15.156:0/1725866012 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f873811fea0 con 0x7f87381300a0 2023-09-30T22:22:15.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.495+0000 7f872dffb700 1 -- 172.21.15.156:0/1725866012 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f873811fea0 con 0x7f87381300a0 2023-09-30T22:22:15.496 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:15.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.497+0000 7f873f86f700 1 -- 172.21.15.156:0/1725866012 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87381300a0 msgr2=0x7f873811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.497+0000 7f873f86f700 1 --2- 172.21.15.156:0/1725866012 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87381300a0 0x7f873811da40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f873400e9d0 tx=0x7f873400ece0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.497+0000 7f873f86f700 1 -- 172.21.15.156:0/1725866012 shutdown_connections 2023-09-30T22:22:15.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.497+0000 7f873f86f700 1 --2- 172.21.15.156:0/1725866012 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8738133ad0 0x7f873811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.497+0000 7f873f86f700 1 --2- 172.21.15.156:0/1725866012 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87381300a0 0x7f873811da40 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.497+0000 7f873f86f700 1 --2- 172.21.15.156:0/1725866012 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87381309f0 0x7f873811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.497+0000 7f873f86f700 1 -- 172.21.15.156:0/1725866012 >> 172.21.15.156:0/1725866012 conn(0x7f8738099c40 msgr2=0x7f87381321d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:15.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.497+0000 7f873f86f700 1 -- 172.21.15.156:0/1725866012 shutdown_connections 2023-09-30T22:22:15.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.497+0000 7f873f86f700 1 -- 172.21.15.156:0/1725866012 wait complete. 2023-09-30T22:22:15.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:15.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.551+0000 7f4d52bef700 1 -- 172.21.15.156:0/1542340495 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4d4c072980 con 0x7f4d4c0a1550 2023-09-30T22:22:15.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.551+0000 7f4d497fa700 1 -- 172.21.15.156:0/1542340495 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4d3801a950 con 0x7f4d4c0a1550 2023-09-30T22:22:15.552 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:15.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.553+0000 7f4d52bef700 1 -- 172.21.15.156:0/1542340495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d4c0a1550 msgr2=0x7f4d4c11ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.553+0000 7f4d52bef700 1 --2- 172.21.15.156:0/1542340495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d4c0a1550 0x7f4d4c11ecc0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f4d38009fd0 tx=0x7f4d38004750 comp rx=0 tx=0).stop 2023-09-30T22:22:15.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.553+0000 7f4d52bef700 1 -- 172.21.15.156:0/1542340495 shutdown_connections 2023-09-30T22:22:15.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.553+0000 7f4d52bef700 1 --2- 172.21.15.156:0/1542340495 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d4c139200 0x7f4d4c11f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.553+0000 7f4d52bef700 1 --2- 172.21.15.156:0/1542340495 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d4c0a0a70 0x7f4d4c11e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.553+0000 7f4d52bef700 1 --2- 172.21.15.156:0/1542340495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d4c0a1550 0x7f4d4c11ecc0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.553+0000 7f4d52bef700 1 -- 172.21.15.156:0/1542340495 >> 172.21.15.156:0/1542340495 conn(0x7f4d4c0a6610 msgr2=0x7f4d4c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:15.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.553+0000 7f4d52bef700 1 -- 172.21.15.156:0/1542340495 shutdown_connections 2023-09-30T22:22:15.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.553+0000 7f4d52bef700 1 -- 172.21.15.156:0/1542340495 wait complete. 2023-09-30T22:22:15.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:15.763 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:15.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.885+0000 7f4573147700 1 Processor -- start 2023-09-30T22:22:15.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.885+0000 7f4573147700 1 -- start start 2023-09-30T22:22:15.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.886+0000 7f4573147700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f456c09e870 0x7f456c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.886+0000 7f4573147700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f456c09f180 0x7f456c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.886+0000 7f4573147700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f456c131d70 0x7f456c1321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.886+0000 7f4573147700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f456c0a0920 con 0x7f456c09e870 2023-09-30T22:22:15.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.886+0000 7f4573147700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456c09c970 con 0x7f456c09f180 2023-09-30T22:22:15.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.886+0000 7f4573147700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f456c09bab0 con 0x7f456c131d70 2023-09-30T22:22:15.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.886+0000 7f4570ee3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f456c09e870 0x7f456c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.886+0000 7f456bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f456c09f180 0x7f456c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.886+0000 7f45716e4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f456c131d70 0x7f456c1321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.886+0000 7f4570ee3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f456c09e870 0x7f456c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:43518/0 (socket says 172.21.15.156:43518) 2023-09-30T22:22:15.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.886+0000 7f456bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f456c09f180 0x7f456c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45224/0 (socket says 172.21.15.156:45224) 2023-09-30T22:22:15.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.886+0000 7f4570ee3700 1 -- 172.21.15.156:0/2970130555 learned_addr learned my addr 172.21.15.156:0/2970130555 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:15.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.886+0000 7f456bfff700 1 -- 172.21.15.156:0/2970130555 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f456c131d70 msgr2=0x7f456c1321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:15.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.886+0000 7f456bfff700 1 --2- 172.21.15.156:0/2970130555 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f456c131d70 0x7f456c1321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.886+0000 7f456bfff700 1 -- 172.21.15.156:0/2970130555 >> v2:172.21.15.156:3300/0 conn(0x7f456c09e870 msgr2=0x7f456c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:15.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.886+0000 7f456bfff700 1 --2- 172.21.15.156:0/2970130555 >> v2:172.21.15.156:3300/0 conn(0x7f456c09e870 0x7f456c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.886+0000 7f456bfff700 1 -- 172.21.15.156:0/2970130555 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456c09f9c0 con 0x7f456c09f180 2023-09-30T22:22:15.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.886+0000 7f4570ee3700 1 --2- 172.21.15.156:0/2970130555 >> v2:172.21.15.156:3300/0 conn(0x7f456c09e870 0x7f456c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:15.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.886+0000 7f45716e4700 1 --2- 172.21.15.156:0/2970130555 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f456c131d70 0x7f456c1321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:15.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.886+0000 7f456bfff700 1 --2- 172.21.15.156:0/2970130555 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f456c09f180 0x7f456c131830 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4558009870 tx=0x7f4558009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce525bce48cc9951 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:15.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.887+0000 7f456b7fe700 1 -- 172.21.15.156:0/2970130555 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4558011830 con 0x7f456c09f180 2023-09-30T22:22:15.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.887+0000 7f456b7fe700 1 -- 172.21.15.156:0/2970130555 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4558011990 con 0x7f456c09f180 2023-09-30T22:22:15.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.887+0000 7f456b7fe700 1 -- 172.21.15.156:0/2970130555 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4558011d20 con 0x7f456c09f180 2023-09-30T22:22:15.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.887+0000 7f4573147700 1 -- 172.21.15.156:0/2970130555 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f456c09f180 msgr2=0x7f456c131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.887+0000 7f4573147700 1 --2- 172.21.15.156:0/2970130555 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f456c09f180 0x7f456c131830 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4558009870 tx=0x7f4558009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:15.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.887+0000 7f4573147700 1 -- 172.21.15.156:0/2970130555 shutdown_connections 2023-09-30T22:22:15.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.887+0000 7f4573147700 1 --2- 172.21.15.156:0/2970130555 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f456c131d70 0x7f456c1321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.887+0000 7f4573147700 1 --2- 172.21.15.156:0/2970130555 >> v2:172.21.15.156:3300/0 conn(0x7f456c09e870 0x7f456c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.887+0000 7f4573147700 1 --2- 172.21.15.156:0/2970130555 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f456c09f180 0x7f456c131830 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.887+0000 7f4573147700 1 -- 172.21.15.156:0/2970130555 >> 172.21.15.156:0/2970130555 conn(0x7f456c0a4430 msgr2=0x7f456c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:15.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.887+0000 7f4573147700 1 -- 172.21.15.156:0/2970130555 shutdown_connections 2023-09-30T22:22:15.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.887+0000 7f4573147700 1 -- 172.21.15.156:0/2970130555 wait complete. 2023-09-30T22:22:15.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.888+0000 7f4573147700 1 Processor -- start 2023-09-30T22:22:15.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.888+0000 7f4573147700 1 -- start start 2023-09-30T22:22:15.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.889+0000 7f4573147700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f456c09e870 0x7f456c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.889+0000 7f4573147700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f456c09f180 0x7f456c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.889+0000 7f4573147700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f456c131d70 0x7f456c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.889+0000 7f4573147700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c06cd80 con 0x7f456c131d70 2023-09-30T22:22:15.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.889+0000 7f4573147700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456c125d00 con 0x7f456c09f180 2023-09-30T22:22:15.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.889+0000 7f4573147700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f456c06d4c0 con 0x7f456c09e870 2023-09-30T22:22:15.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.889+0000 7f456bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f456c09f180 0x7f456c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.889+0000 7f45716e4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f456c131d70 0x7f456c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.889+0000 7f456bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f456c09f180 0x7f456c06bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45228/0 (socket says 172.21.15.156:45228) 2023-09-30T22:22:15.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.889+0000 7f456bfff700 1 -- 172.21.15.156:0/4171532567 learned_addr learned my addr 172.21.15.156:0/4171532567 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:15.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.889+0000 7f4570ee3700 1 --2- 172.21.15.156:0/4171532567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f456c09e870 0x7f456c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.889+0000 7f45716e4700 1 -- 172.21.15.156:0/4171532567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f456c09e870 msgr2=0x7f456c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.889+0000 7f45716e4700 1 --2- 172.21.15.156:0/4171532567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f456c09e870 0x7f456c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.889+0000 7f45716e4700 1 -- 172.21.15.156:0/4171532567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f456c09f180 msgr2=0x7f456c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.889+0000 7f45716e4700 1 --2- 172.21.15.156:0/4171532567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f456c09f180 0x7f456c06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.889+0000 7f45716e4700 1 -- 172.21.15.156:0/4171532567 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4560009550 con 0x7f456c131d70 2023-09-30T22:22:15.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.889+0000 7f4570ee3700 1 --2- 172.21.15.156:0/4171532567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f456c09e870 0x7f456c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:15.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.889+0000 7f456bfff700 1 --2- 172.21.15.156:0/4171532567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f456c09f180 0x7f456c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:15.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.889+0000 7f45716e4700 1 --2- 172.21.15.156:0/4171532567 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f456c131d70 0x7f456c06c330 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f456400efc0 tx=0x7f456400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:15.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.889+0000 7f45697fa700 1 -- 172.21.15.156:0/4171532567 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4564009e60 con 0x7f456c131d70 2023-09-30T22:22:15.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.889+0000 7f45697fa700 1 -- 172.21.15.156:0/4171532567 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456400f040 con 0x7f456c131d70 2023-09-30T22:22:15.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.889+0000 7f4573147700 1 -- 172.21.15.156:0/4171532567 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4564009a70 con 0x7f456c131d70 2023-09-30T22:22:15.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.889+0000 7f45697fa700 1 -- 172.21.15.156:0/4171532567 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456400cd60 con 0x7f456c131d70 2023-09-30T22:22:15.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.890+0000 7f4573147700 1 -- 172.21.15.156:0/4171532567 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45580094a0 con 0x7f456c131d70 2023-09-30T22:22:15.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.890+0000 7f45697fa700 1 -- 172.21.15.156:0/4171532567 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4564014480 con 0x7f456c131d70 2023-09-30T22:22:15.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.890+0000 7f45697fa700 1 -- 172.21.15.156:0/4171532567 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f456403fbd0 con 0x7f456c131d70 2023-09-30T22:22:15.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.891+0000 7f4573147700 1 -- 172.21.15.156:0/4171532567 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f456c04f2a0 con 0x7f456c131d70 2023-09-30T22:22:15.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:15.895+0000 7f45697fa700 1 -- 172.21.15.156:0/4171532567 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4564012910 con 0x7f456c131d70 2023-09-30T22:22:16.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.079+0000 7f4573147700 1 -- 172.21.15.156:0/4171532567 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f456c1247e0 con 0x7f456c131d70 2023-09-30T22:22:16.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.079+0000 7f45697fa700 1 -- 172.21.15.156:0/4171532567 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4564012340 con 0x7f456c131d70 2023-09-30T22:22:16.082 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:16.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.081+0000 7f4573147700 1 -- 172.21.15.156:0/4171532567 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f456c131d70 msgr2=0x7f456c06c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.081+0000 7f4573147700 1 --2- 172.21.15.156:0/4171532567 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f456c131d70 0x7f456c06c330 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f456400efc0 tx=0x7f456400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.081+0000 7f4573147700 1 -- 172.21.15.156:0/4171532567 shutdown_connections 2023-09-30T22:22:16.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.081+0000 7f4573147700 1 --2- 172.21.15.156:0/4171532567 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f456c131d70 0x7f456c06c330 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.081+0000 7f4573147700 1 --2- 172.21.15.156:0/4171532567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f456c09e870 0x7f456c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.081+0000 7f4573147700 1 --2- 172.21.15.156:0/4171532567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f456c09f180 0x7f456c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.081+0000 7f4573147700 1 -- 172.21.15.156:0/4171532567 >> 172.21.15.156:0/4171532567 conn(0x7f456c0a4430 msgr2=0x7f456c09cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:16.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.081+0000 7f4573147700 1 -- 172.21.15.156:0/4171532567 shutdown_connections 2023-09-30T22:22:16.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.081+0000 7f4573147700 1 -- 172.21.15.156:0/4171532567 wait complete. 2023-09-30T22:22:16.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:16.369 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:16.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.491+0000 7ff564452700 1 Processor -- start 2023-09-30T22:22:16.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.491+0000 7ff564452700 1 -- start start 2023-09-30T22:22:16.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.492+0000 7ff564452700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff55c09e870 0x7ff55c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:16.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.492+0000 7ff564452700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff55c1343a0 0x7ff55c13bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:16.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.492+0000 7ff564452700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff55c06bec0 con 0x7ff55c09f180 2023-09-30T22:22:16.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.492+0000 7ff564452700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff55c06ce60 con 0x7ff55c09e870 2023-09-30T22:22:16.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.492+0000 7ff564452700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c09fa00 con 0x7ff55c1343a0 2023-09-30T22:22:16.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.492+0000 7ff5621ee700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff55c09e870 0x7ff55c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:16.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.492+0000 7ff5621ee700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff55c09e870 0x7ff55c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:43534/0 (socket says 172.21.15.156:43534) 2023-09-30T22:22:16.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.492+0000 7ff5619ed700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff55c09f180 0x7ff55c133c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48004/0 (socket says 172.21.15.156:48004) 2023-09-30T22:22:16.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.492+0000 7ff5621ee700 1 -- 172.21.15.156:0/909772262 learned_addr learned my addr 172.21.15.156:0/909772262 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:16.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.492+0000 7ff5629ef700 1 --2- 172.21.15.156:0/909772262 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff55c1343a0 0x7ff55c13bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:16.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.492+0000 7ff5629ef700 1 -- 172.21.15.156:0/909772262 >> v2:172.21.15.156:3300/0 conn(0x7ff55c09e870 msgr2=0x7ff55c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:16.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.492+0000 7ff5629ef700 1 --2- 172.21.15.156:0/909772262 >> v2:172.21.15.156:3300/0 conn(0x7ff55c09e870 0x7ff55c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.492+0000 7ff5629ef700 1 -- 172.21.15.156:0/909772262 >> v1:172.21.15.156:6789/0 conn(0x7ff55c09f180 legacy=0x7ff55c133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.492+0000 7ff5629ef700 1 -- 172.21.15.156:0/909772262 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55c09ad80 con 0x7ff55c1343a0 2023-09-30T22:22:16.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.492+0000 7ff5611ec700 1 -- 172.21.15.156:0/909772262 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3446332060 0 0) 0x7ff55c06bec0 con 0x7ff55c09f180 2023-09-30T22:22:16.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.492+0000 7ff5621ee700 1 --2- 172.21.15.156:0/909772262 >> v2:172.21.15.156:3300/0 conn(0x7ff55c09e870 0x7ff55c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:16.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.492+0000 7ff5629ef700 1 --2- 172.21.15.156:0/909772262 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff55c1343a0 0x7ff55c13bf60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff554009d90 tx=0x7ff55400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8708e64a96a46b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:16.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.493+0000 7ff5611ec700 1 -- 172.21.15.156:0/909772262 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55400e070 con 0x7ff55c1343a0 2023-09-30T22:22:16.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.493+0000 7ff5611ec700 1 -- 172.21.15.156:0/909772262 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55400bb20 con 0x7ff55c1343a0 2023-09-30T22:22:16.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.493+0000 7ff5611ec700 1 -- 172.21.15.156:0/909772262 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff554012430 con 0x7ff55c1343a0 2023-09-30T22:22:16.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.493+0000 7ff564452700 1 -- 172.21.15.156:0/909772262 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff55c1343a0 msgr2=0x7ff55c13bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.493+0000 7ff564452700 1 --2- 172.21.15.156:0/909772262 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff55c1343a0 0x7ff55c13bf60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff554009d90 tx=0x7ff55400b330 comp rx=0 tx=0).stop 2023-09-30T22:22:16.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.493+0000 7ff564452700 1 -- 172.21.15.156:0/909772262 shutdown_connections 2023-09-30T22:22:16.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.493+0000 7ff564452700 1 --2- 172.21.15.156:0/909772262 >> v2:172.21.15.156:3300/0 conn(0x7ff55c09e870 0x7ff55c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.493+0000 7ff564452700 1 --2- 172.21.15.156:0/909772262 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff55c1343a0 0x7ff55c13bf60 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.493+0000 7ff564452700 1 -- 172.21.15.156:0/909772262 >> 172.21.15.156:0/909772262 conn(0x7ff55c0a4430 msgr2=0x7ff55c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:16.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.493+0000 7ff564452700 1 -- 172.21.15.156:0/909772262 shutdown_connections 2023-09-30T22:22:16.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.493+0000 7ff564452700 1 -- 172.21.15.156:0/909772262 wait complete. 2023-09-30T22:22:16.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.494+0000 7ff564452700 1 Processor -- start 2023-09-30T22:22:16.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.495+0000 7ff564452700 1 -- start start 2023-09-30T22:22:16.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.495+0000 7ff564452700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff55c09e870 0x7ff55c122960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:16.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.495+0000 7ff564452700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff55c09f180 0x7ff55c122ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:16.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.495+0000 7ff564452700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff55c1343a0 0x7ff55c1233e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:16.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.495+0000 7ff564452700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c1261d0 con 0x7ff55c09f180 2023-09-30T22:22:16.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.495+0000 7ff564452700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c1263b0 con 0x7ff55c09e870 2023-09-30T22:22:16.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.495+0000 7ff564452700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c126f90 con 0x7ff55c1343a0 2023-09-30T22:22:16.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.495+0000 7ff5621ee700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff55c09e870 0x7ff55c122960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:16.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.495+0000 7ff5629ef700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff55c1343a0 0x7ff55c1233e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:16.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.495+0000 7ff5629ef700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff55c1343a0 0x7ff55c1233e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39634/0 (socket says 172.21.15.156:39634) 2023-09-30T22:22:16.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.495+0000 7ff5621ee700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff55c09e870 0x7ff55c122960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45234/0 (socket says 172.21.15.156:45234) 2023-09-30T22:22:16.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.495+0000 7ff5629ef700 1 -- 172.21.15.156:0/3228434133 learned_addr learned my addr 172.21.15.156:0/3228434133 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:16.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.495+0000 7ff5619ed700 1 --2- 172.21.15.156:0/3228434133 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff55c09f180 0x7ff55c122ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:16.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.496+0000 7ff5629ef700 1 -- 172.21.15.156:0/3228434133 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff55c09e870 msgr2=0x7ff55c122960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.496+0000 7ff5629ef700 1 --2- 172.21.15.156:0/3228434133 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff55c09e870 0x7ff55c122960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.496+0000 7ff5629ef700 1 -- 172.21.15.156:0/3228434133 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff55c09f180 msgr2=0x7ff55c122ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.496+0000 7ff5629ef700 1 --2- 172.21.15.156:0/3228434133 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff55c09f180 0x7ff55c122ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.496+0000 7ff5629ef700 1 -- 172.21.15.156:0/3228434133 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff54c009550 con 0x7ff55c1343a0 2023-09-30T22:22:16.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.496+0000 7ff5629ef700 1 --2- 172.21.15.156:0/3228434133 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff55c1343a0 0x7ff55c1233e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff55c09fb40 tx=0x7ff554004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:16.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.496+0000 7ff552ffd700 1 -- 172.21.15.156:0/3228434133 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff554012430 con 0x7ff55c1343a0 2023-09-30T22:22:16.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.496+0000 7ff552ffd700 1 -- 172.21.15.156:0/3228434133 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff554020070 con 0x7ff55c1343a0 2023-09-30T22:22:16.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.496+0000 7ff564452700 1 -- 172.21.15.156:0/3228434133 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff554009a70 con 0x7ff55c1343a0 2023-09-30T22:22:16.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.496+0000 7ff552ffd700 1 -- 172.21.15.156:0/3228434133 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff554004280 con 0x7ff55c1343a0 2023-09-30T22:22:16.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.496+0000 7ff564452700 1 -- 172.21.15.156:0/3228434133 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff55c124980 con 0x7ff55c1343a0 2023-09-30T22:22:16.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.497+0000 7ff552ffd700 1 -- 172.21.15.156:0/3228434133 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff5540043e0 con 0x7ff55c1343a0 2023-09-30T22:22:16.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.497+0000 7ff552ffd700 1 -- 172.21.15.156:0/3228434133 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff554022070 con 0x7ff55c1343a0 2023-09-30T22:22:16.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.497+0000 7ff564452700 1 -- 172.21.15.156:0/3228434133 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff55c06c660 con 0x7ff55c1343a0 2023-09-30T22:22:16.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.501+0000 7ff552ffd700 1 -- 172.21.15.156:0/3228434133 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff55401b400 con 0x7ff55c1343a0 2023-09-30T22:22:16.511 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:16.566 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:16.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.640+0000 7f1e6dc78700 1 Processor -- start 2023-09-30T22:22:16.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.640+0000 7f1e6dc78700 1 -- start start 2023-09-30T22:22:16.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.640+0000 7f1e6dc78700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e680a1550 0x7f1e68138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:16.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.640+0000 7f1e6dc78700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e68139200 0x7f1e6813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:16.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.640+0000 7f1e6dc78700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e6809e9d0 con 0x7f1e680a0a70 2023-09-30T22:22:16.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.640+0000 7f1e6dc78700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6809dc00 con 0x7f1e680a1550 2023-09-30T22:22:16.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.640+0000 7f1e6dc78700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6809dec0 con 0x7f1e68139200 2023-09-30T22:22:16.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.641+0000 7f1e67fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e68139200 0x7f1e6813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:16.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.641+0000 7f1e677fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f1e680a0a70 0x7f1e680a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48020/0 (socket says 172.21.15.156:48020) 2023-09-30T22:22:16.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.641+0000 7f1e677fe700 1 -- 172.21.15.156:0/3582039150 learned_addr learned my addr 172.21.15.156:0/3582039150 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:16.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.641+0000 7f1e66ffd700 1 --2- 172.21.15.156:0/3582039150 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e680a1550 0x7f1e68138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:16.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.641+0000 7f1e667fc700 1 -- 172.21.15.156:0/3582039150 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3381133599 0 0) 0x7f1e6809e9d0 con 0x7f1e680a0a70 2023-09-30T22:22:16.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.641+0000 7f1e67fff700 1 -- 172.21.15.156:0/3582039150 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e680a1550 msgr2=0x7f1e68138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:16.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.641+0000 7f1e67fff700 1 --2- 172.21.15.156:0/3582039150 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e680a1550 0x7f1e68138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.641+0000 7f1e67fff700 1 -- 172.21.15.156:0/3582039150 >> v1:172.21.15.156:6789/0 conn(0x7f1e680a0a70 legacy=0x7f1e680a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.641+0000 7f1e67fff700 1 -- 172.21.15.156:0/3582039150 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6809e6a0 con 0x7f1e68139200 2023-09-30T22:22:16.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.641+0000 7f1e67fff700 1 --2- 172.21.15.156:0/3582039150 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e68139200 0x7f1e6813b5e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1e60009870 tx=0x7f1e60009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c455d668ad8acd96 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:16.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.641+0000 7f1e667fc700 1 -- 172.21.15.156:0/3582039150 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e60011830 con 0x7f1e68139200 2023-09-30T22:22:16.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.641+0000 7f1e667fc700 1 -- 172.21.15.156:0/3582039150 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e60011990 con 0x7f1e68139200 2023-09-30T22:22:16.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.641+0000 7f1e667fc700 1 -- 172.21.15.156:0/3582039150 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e60011d20 con 0x7f1e68139200 2023-09-30T22:22:16.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.642+0000 7f1e6dc78700 1 -- 172.21.15.156:0/3582039150 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e68139200 msgr2=0x7f1e6813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.642+0000 7f1e6dc78700 1 --2- 172.21.15.156:0/3582039150 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e68139200 0x7f1e6813b5e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1e60009870 tx=0x7f1e60009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:16.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.642+0000 7f1e6dc78700 1 -- 172.21.15.156:0/3582039150 shutdown_connections 2023-09-30T22:22:16.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.642+0000 7f1e6dc78700 1 --2- 172.21.15.156:0/3582039150 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e68139200 0x7f1e6813b5e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.642+0000 7f1e6dc78700 1 --2- 172.21.15.156:0/3582039150 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e680a1550 0x7f1e68138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.642+0000 7f1e6dc78700 1 -- 172.21.15.156:0/3582039150 >> 172.21.15.156:0/3582039150 conn(0x7f1e680a6610 msgr2=0x7f1e680a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:16.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.642+0000 7f1e6dc78700 1 -- 172.21.15.156:0/3582039150 shutdown_connections 2023-09-30T22:22:16.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.642+0000 7f1e6dc78700 1 -- 172.21.15.156:0/3582039150 wait complete. 2023-09-30T22:22:16.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.643+0000 7f1e6dc78700 1 Processor -- start 2023-09-30T22:22:16.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.644+0000 7f1e6dc78700 1 -- start start 2023-09-30T22:22:16.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.644+0000 7f1e6dc78700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e680a0a70 0x7f1e6811e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:16.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.644+0000 7f1e6dc78700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e680a1550 0x7f1e6811ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:16.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.644+0000 7f1e6dc78700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e68139200 0x7f1e6811f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:16.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.644+0000 7f1e6dc78700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e68122080 con 0x7f1e680a0a70 2023-09-30T22:22:16.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.644+0000 7f1e6dc78700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e68120560 con 0x7f1e680a1550 2023-09-30T22:22:16.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.644+0000 7f1e6dc78700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6809d340 con 0x7f1e68139200 2023-09-30T22:22:16.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.644+0000 7f1e66ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e680a1550 0x7f1e6811ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:16.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.644+0000 7f1e66ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e680a1550 0x7f1e6811ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45252/0 (socket says 172.21.15.156:45252) 2023-09-30T22:22:16.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.644+0000 7f1e66ffd700 1 -- 172.21.15.156:0/13164899 learned_addr learned my addr 172.21.15.156:0/13164899 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:16.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.644+0000 7f1e67fff700 1 --2- 172.21.15.156:0/13164899 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e68139200 0x7f1e6811f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:16.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.645+0000 7f1e677fe700 1 --2- 172.21.15.156:0/13164899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e680a0a70 0x7f1e6811e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:16.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.645+0000 7f1e66ffd700 1 -- 172.21.15.156:0/13164899 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e68139200 msgr2=0x7f1e6811f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.645+0000 7f1e66ffd700 1 --2- 172.21.15.156:0/13164899 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e68139200 0x7f1e6811f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.645+0000 7f1e66ffd700 1 -- 172.21.15.156:0/13164899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e680a0a70 msgr2=0x7f1e6811e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.645+0000 7f1e66ffd700 1 --2- 172.21.15.156:0/13164899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e680a0a70 0x7f1e6811e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.645+0000 7f1e66ffd700 1 -- 172.21.15.156:0/13164899 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e600094a0 con 0x7f1e680a1550 2023-09-30T22:22:16.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.645+0000 7f1e66ffd700 1 --2- 172.21.15.156:0/13164899 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e680a1550 0x7f1e6811ece0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1e5000e9b0 tx=0x7f1e5000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:16.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.645+0000 7f1e5ffff700 1 -- 172.21.15.156:0/13164899 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e50009710 con 0x7f1e680a1550 2023-09-30T22:22:16.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.645+0000 7f1e5ffff700 1 -- 172.21.15.156:0/13164899 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5000c850 con 0x7f1e680a1550 2023-09-30T22:22:16.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.645+0000 7f1e6dc78700 1 -- 172.21.15.156:0/13164899 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e680a03e0 con 0x7f1e680a1550 2023-09-30T22:22:16.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.645+0000 7f1e5ffff700 1 -- 172.21.15.156:0/13164899 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5000cbc0 con 0x7f1e680a1550 2023-09-30T22:22:16.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.645+0000 7f1e6dc78700 1 -- 172.21.15.156:0/13164899 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e68122af0 con 0x7f1e680a1550 2023-09-30T22:22:16.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.646+0000 7f1e5ffff700 1 -- 172.21.15.156:0/13164899 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e5000cd20 con 0x7f1e680a1550 2023-09-30T22:22:16.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.646+0000 7f1e5ffff700 1 -- 172.21.15.156:0/13164899 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1e5003fb60 con 0x7f1e680a1550 2023-09-30T22:22:16.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.646+0000 7f1e6dc78700 1 -- 172.21.15.156:0/13164899 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e6804f2a0 con 0x7f1e680a1550 2023-09-30T22:22:16.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.651+0000 7f1e5ffff700 1 -- 172.21.15.156:0/13164899 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e50017080 con 0x7f1e680a1550 2023-09-30T22:22:16.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.695+0000 7f0d7e82a700 1 Processor -- start 2023-09-30T22:22:16.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.695+0000 7f0d7e82a700 1 -- start start 2023-09-30T22:22:16.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.695+0000 7f0d7e82a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0d7809e870 0x7f0d7809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:16.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.695+0000 7f0d7e82a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d7809f180 0x7f0d78131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:16.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.695+0000 7f0d7e82a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d78131d70 0x7f0d781321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:16.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.695+0000 7f0d7e82a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d780a0920 con 0x7f0d7809e870 2023-09-30T22:22:16.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.695+0000 7f0d7e82a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7809c970 con 0x7f0d7809f180 2023-09-30T22:22:16.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.695+0000 7f0d7e82a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7809bab0 con 0x7f0d78131d70 2023-09-30T22:22:16.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.695+0000 7f0d7cdc7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d78131d70 0x7f0d781321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:16.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.695+0000 7f0d7cdc7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d78131d70 0x7f0d781321f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39650/0 (socket says 172.21.15.156:39650) 2023-09-30T22:22:16.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.695+0000 7f0d7cdc7700 1 -- 172.21.15.156:0/1723406668 learned_addr learned my addr 172.21.15.156:0/1723406668 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:16.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.695+0000 7f0d777fe700 1 --2- 172.21.15.156:0/1723406668 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d7809f180 0x7f0d78131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:16.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.695+0000 7f0d77fff700 1 --2- 172.21.15.156:0/1723406668 >> v2:172.21.15.156:3300/0 conn(0x7f0d7809e870 0x7f0d7809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:16.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.696+0000 7f0d7cdc7700 1 -- 172.21.15.156:0/1723406668 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d7809f180 msgr2=0x7f0d78131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:16.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.696+0000 7f0d7cdc7700 1 --2- 172.21.15.156:0/1723406668 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d7809f180 0x7f0d78131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.696+0000 7f0d7cdc7700 1 -- 172.21.15.156:0/1723406668 >> v2:172.21.15.156:3300/0 conn(0x7f0d7809e870 msgr2=0x7f0d7809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:16.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.696+0000 7f0d7cdc7700 1 --2- 172.21.15.156:0/1723406668 >> v2:172.21.15.156:3300/0 conn(0x7f0d7809e870 0x7f0d7809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.696+0000 7f0d7cdc7700 1 -- 172.21.15.156:0/1723406668 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7809f9c0 con 0x7f0d78131d70 2023-09-30T22:22:16.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.696+0000 7f0d7cdc7700 1 --2- 172.21.15.156:0/1723406668 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d78131d70 0x7f0d781321f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009e50 tx=0x7f0d7000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=859ae1fde06c605d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:16.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.696+0000 7f0d76ffd700 1 -- 172.21.15.156:0/1723406668 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7000e070 con 0x7f0d78131d70 2023-09-30T22:22:16.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.696+0000 7f0d76ffd700 1 -- 172.21.15.156:0/1723406668 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7000b910 con 0x7f0d78131d70 2023-09-30T22:22:16.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.696+0000 7f0d76ffd700 1 -- 172.21.15.156:0/1723406668 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7000bcc0 con 0x7f0d78131d70 2023-09-30T22:22:16.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.697+0000 7f0d7e82a700 1 -- 172.21.15.156:0/1723406668 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d78131d70 msgr2=0x7f0d781321f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.697+0000 7f0d7e82a700 1 --2- 172.21.15.156:0/1723406668 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d78131d70 0x7f0d781321f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009e50 tx=0x7f0d7000b330 comp rx=0 tx=0).stop 2023-09-30T22:22:16.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.697+0000 7f0d7e82a700 1 -- 172.21.15.156:0/1723406668 shutdown_connections 2023-09-30T22:22:16.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.697+0000 7f0d7e82a700 1 --2- 172.21.15.156:0/1723406668 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d78131d70 0x7f0d781321f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.697+0000 7f0d7e82a700 1 --2- 172.21.15.156:0/1723406668 >> v2:172.21.15.156:3300/0 conn(0x7f0d7809e870 0x7f0d7809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.697+0000 7f0d7e82a700 1 --2- 172.21.15.156:0/1723406668 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d7809f180 0x7f0d78131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.697+0000 7f0d7e82a700 1 -- 172.21.15.156:0/1723406668 >> 172.21.15.156:0/1723406668 conn(0x7f0d780a4430 msgr2=0x7f0d780a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:16.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.697+0000 7f0d7e82a700 1 -- 172.21.15.156:0/1723406668 shutdown_connections 2023-09-30T22:22:16.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.697+0000 7f0d7e82a700 1 -- 172.21.15.156:0/1723406668 wait complete. 2023-09-30T22:22:16.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.698+0000 7f0d7e82a700 1 Processor -- start 2023-09-30T22:22:16.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.698+0000 7f0d7e82a700 1 -- start start 2023-09-30T22:22:16.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.698+0000 7f0d7e82a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d7809e870 0x7f0d7811b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:16.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.698+0000 7f0d7e82a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d7809f180 0x7f0d781c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:16.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.698+0000 7f0d7e82a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d78131d70 0x7f0d781c4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:16.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.698+0000 7f0d7e82a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7811d6f0 con 0x7f0d78131d70 2023-09-30T22:22:16.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.698+0000 7f0d7e82a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7812e6f0 con 0x7f0d7809f180 2023-09-30T22:22:16.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.698+0000 7f0d7e82a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7811ead0 con 0x7f0d7809e870 2023-09-30T22:22:16.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.698+0000 7f0d777fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d7809f180 0x7f0d781c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:16.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.698+0000 7f0d77fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d7809e870 0x7f0d7811b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:16.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.698+0000 7f0d777fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d7809f180 0x7f0d781c3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45264/0 (socket says 172.21.15.156:45264) 2023-09-30T22:22:16.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.698+0000 7f0d777fe700 1 -- 172.21.15.156:0/2295089119 learned_addr learned my addr 172.21.15.156:0/2295089119 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:16.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.698+0000 7f0d7cdc7700 1 --2- 172.21.15.156:0/2295089119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d78131d70 0x7f0d781c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:16.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.699+0000 7f0d777fe700 1 -- 172.21.15.156:0/2295089119 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d7809e870 msgr2=0x7f0d7811b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.699+0000 7f0d777fe700 1 --2- 172.21.15.156:0/2295089119 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d7809e870 0x7f0d7811b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.699+0000 7f0d777fe700 1 -- 172.21.15.156:0/2295089119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d78131d70 msgr2=0x7f0d781c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.699+0000 7f0d777fe700 1 --2- 172.21.15.156:0/2295089119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d78131d70 0x7f0d781c4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.699+0000 7f0d777fe700 1 -- 172.21.15.156:0/2295089119 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d70009b30 con 0x7f0d7809f180 2023-09-30T22:22:16.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.699+0000 7f0d777fe700 1 --2- 172.21.15.156:0/2295089119 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d7809f180 0x7f0d781c3cf0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00e9e0 tx=0x7f0d6c00ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:16.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.699+0000 7f0d74ff9700 1 -- 172.21.15.156:0/2295089119 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c009710 con 0x7f0d7809f180 2023-09-30T22:22:16.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.699+0000 7f0d74ff9700 1 -- 172.21.15.156:0/2295089119 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6c00ee80 con 0x7f0d7809f180 2023-09-30T22:22:16.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.699+0000 7f0d7e82a700 1 -- 172.21.15.156:0/2295089119 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d7811da90 con 0x7f0d7809f180 2023-09-30T22:22:16.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.699+0000 7f0d74ff9700 1 -- 172.21.15.156:0/2295089119 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c00c9f0 con 0x7f0d7809f180 2023-09-30T22:22:16.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.699+0000 7f0d7e82a700 1 -- 172.21.15.156:0/2295089119 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d7811e5b0 con 0x7f0d7809f180 2023-09-30T22:22:16.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.700+0000 7f0d74ff9700 1 -- 172.21.15.156:0/2295089119 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d6c00cb50 con 0x7f0d7809f180 2023-09-30T22:22:16.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.700+0000 7f0d7e82a700 1 -- 172.21.15.156:0/2295089119 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d7804f2a0 con 0x7f0d7809f180 2023-09-30T22:22:16.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.700+0000 7f0d74ff9700 1 -- 172.21.15.156:0/2295089119 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0d6c03fac0 con 0x7f0d7809f180 2023-09-30T22:22:16.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.709+0000 7f0d74ff9700 1 -- 172.21.15.156:0/2295089119 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d6c01b3b0 con 0x7f0d7809f180 2023-09-30T22:22:16.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.714+0000 7ff564452700 1 -- 172.21.15.156:0/3228434133 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff55c125ff0 con 0x7ff55c1343a0 2023-09-30T22:22:16.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.715+0000 7ff552ffd700 1 -- 172.21.15.156:0/3228434133 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff554025380 con 0x7ff55c1343a0 2023-09-30T22:22:16.715 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:16.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.717+0000 7ff564452700 1 -- 172.21.15.156:0/3228434133 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff55c1343a0 msgr2=0x7ff55c1233e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.717+0000 7ff564452700 1 --2- 172.21.15.156:0/3228434133 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff55c1343a0 0x7ff55c1233e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff55c09fb40 tx=0x7ff554004ad0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.717+0000 7ff564452700 1 -- 172.21.15.156:0/3228434133 shutdown_connections 2023-09-30T22:22:16.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.717+0000 7ff564452700 1 --2- 172.21.15.156:0/3228434133 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff55c1343a0 0x7ff55c1233e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.717+0000 7ff564452700 1 --2- 172.21.15.156:0/3228434133 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff55c09e870 0x7ff55c122960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.717+0000 7ff564452700 1 --2- 172.21.15.156:0/3228434133 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff55c09f180 0x7ff55c122ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.717+0000 7ff564452700 1 -- 172.21.15.156:0/3228434133 >> 172.21.15.156:0/3228434133 conn(0x7ff55c0a4430 msgr2=0x7ff55c070ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:16.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.717+0000 7ff564452700 1 -- 172.21.15.156:0/3228434133 shutdown_connections 2023-09-30T22:22:16.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.717+0000 7ff564452700 1 -- 172.21.15.156:0/3228434133 wait complete. 2023-09-30T22:22:16.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:16.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.848+0000 7f1e6dc78700 1 -- 172.21.15.156:0/13164899 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1e6809cba0 con 0x7f1e680a1550 2023-09-30T22:22:16.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.848+0000 7f1e5ffff700 1 -- 172.21.15.156:0/13164899 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e50021020 con 0x7f1e680a1550 2023-09-30T22:22:16.851 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:16.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.851+0000 7f1e6dc78700 1 -- 172.21.15.156:0/13164899 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e680a1550 msgr2=0x7f1e6811ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.851+0000 7f1e6dc78700 1 --2- 172.21.15.156:0/13164899 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e680a1550 0x7f1e6811ece0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1e5000e9b0 tx=0x7f1e5000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.852+0000 7f1e6dc78700 1 -- 172.21.15.156:0/13164899 shutdown_connections 2023-09-30T22:22:16.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.852+0000 7f1e6dc78700 1 --2- 172.21.15.156:0/13164899 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e68139200 0x7f1e6811f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.852+0000 7f1e6dc78700 1 --2- 172.21.15.156:0/13164899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e680a0a70 0x7f1e6811e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.852+0000 7f1e6dc78700 1 --2- 172.21.15.156:0/13164899 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e680a1550 0x7f1e6811ece0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.852+0000 7f1e6dc78700 1 -- 172.21.15.156:0/13164899 >> 172.21.15.156:0/13164899 conn(0x7f1e680a6610 msgr2=0x7f1e680a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:16.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.852+0000 7f1e6dc78700 1 -- 172.21.15.156:0/13164899 shutdown_connections 2023-09-30T22:22:16.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.852+0000 7f1e6dc78700 1 -- 172.21.15.156:0/13164899 wait complete. 2023-09-30T22:22:16.865 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:16.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.912+0000 7f0d7e82a700 1 -- 172.21.15.156:0/2295089119 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0d7806b2a0 con 0x7f0d7809f180 2023-09-30T22:22:16.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.912+0000 7f0d74ff9700 1 -- 172.21.15.156:0/2295089119 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d6c021070 con 0x7f0d7809f180 2023-09-30T22:22:16.913 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:16.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.914+0000 7f0d7e82a700 1 -- 172.21.15.156:0/2295089119 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d7809f180 msgr2=0x7f0d781c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.914+0000 7f0d7e82a700 1 --2- 172.21.15.156:0/2295089119 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d7809f180 0x7f0d781c3cf0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00e9e0 tx=0x7f0d6c00ecf0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.914+0000 7f0d7e82a700 1 -- 172.21.15.156:0/2295089119 shutdown_connections 2023-09-30T22:22:16.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.914+0000 7f0d7e82a700 1 --2- 172.21.15.156:0/2295089119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d78131d70 0x7f0d781c4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.914+0000 7f0d7e82a700 1 --2- 172.21.15.156:0/2295089119 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0d7809e870 0x7f0d7811b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.914+0000 7f0d7e82a700 1 --2- 172.21.15.156:0/2295089119 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0d7809f180 0x7f0d781c3cf0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.914+0000 7f0d7e82a700 1 -- 172.21.15.156:0/2295089119 >> 172.21.15.156:0/2295089119 conn(0x7f0d780a4430 msgr2=0x7f0d78130000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:16.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.914+0000 7f0d7e82a700 1 -- 172.21.15.156:0/2295089119 shutdown_connections 2023-09-30T22:22:16.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:16.914+0000 7f0d7e82a700 1 -- 172.21.15.156:0/2295089119 wait complete. 2023-09-30T22:22:16.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:17.095 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:17.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.218+0000 7ff8a13bb700 1 Processor -- start 2023-09-30T22:22:17.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.218+0000 7ff8a13bb700 1 -- start start 2023-09-30T22:22:17.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.219+0000 7ff8a13bb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff89c09ad40 0x7ff89c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:17.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.219+0000 7ff8a13bb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff89c1343a0 0x7ff89c0a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:17.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.219+0000 7ff8a13bb700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff89c09b110 con 0x7ff89c133f70 2023-09-30T22:22:17.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.219+0000 7ff8a13bb700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff89c0a3b60 con 0x7ff89c1343a0 2023-09-30T22:22:17.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.219+0000 7ff8a13bb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c0a2fa0 con 0x7ff89c09ad40 2023-09-30T22:22:17.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.219+0000 7ff89b7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff89c1343a0 0x7ff89c0a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:17.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.219+0000 7ff89affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff89c09ad40 0x7ff89c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:17.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.219+0000 7ff89b7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff89c1343a0 0x7ff89c0a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:43574/0 (socket says 172.21.15.156:43574) 2023-09-30T22:22:17.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.219+0000 7ff89affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff89c09ad40 0x7ff89c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39664/0 (socket says 172.21.15.156:39664) 2023-09-30T22:22:17.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.219+0000 7ff89b7fe700 1 -- 172.21.15.156:0/2357137771 learned_addr learned my addr 172.21.15.156:0/2357137771 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:17.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.219+0000 7ff89a7fc700 1 --1- 172.21.15.156:0/2357137771 >> v1:172.21.15.156:6789/0 conn(0x7ff89c133f70 0x7ff89c0a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48030/0 (socket says 172.21.15.156:48030) 2023-09-30T22:22:17.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.219+0000 7ff89affd700 1 -- 172.21.15.156:0/2357137771 >> v2:172.21.15.156:3300/0 conn(0x7ff89c1343a0 msgr2=0x7ff89c0a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:17.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.219+0000 7ff89affd700 1 --2- 172.21.15.156:0/2357137771 >> v2:172.21.15.156:3300/0 conn(0x7ff89c1343a0 0x7ff89c0a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:17.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.219+0000 7ff89affd700 1 -- 172.21.15.156:0/2357137771 >> v1:172.21.15.156:6789/0 conn(0x7ff89c133f70 legacy=0x7ff89c0a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.219+0000 7ff89affd700 1 -- 172.21.15.156:0/2357137771 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff89c09a280 con 0x7ff89c09ad40 2023-09-30T22:22:17.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.219+0000 7ff899ffb700 1 -- 172.21.15.156:0/2357137771 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130528128 0 0) 0x7ff89c09b110 con 0x7ff89c133f70 2023-09-30T22:22:17.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.219+0000 7ff89b7fe700 1 --2- 172.21.15.156:0/2357137771 >> v2:172.21.15.156:3300/0 conn(0x7ff89c1343a0 0x7ff89c0a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:17.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.219+0000 7ff89affd700 1 --2- 172.21.15.156:0/2357137771 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff89c09ad40 0x7ff89c133a30 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff890009870 tx=0x7ff890009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71f9f35ad9c9a676 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:17.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.219+0000 7ff899ffb700 1 -- 172.21.15.156:0/2357137771 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff890011830 con 0x7ff89c09ad40 2023-09-30T22:22:17.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.219+0000 7ff899ffb700 1 -- 172.21.15.156:0/2357137771 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff890011990 con 0x7ff89c09ad40 2023-09-30T22:22:17.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.220+0000 7ff899ffb700 1 -- 172.21.15.156:0/2357137771 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff890011d20 con 0x7ff89c09ad40 2023-09-30T22:22:17.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.220+0000 7ff8a13bb700 1 -- 172.21.15.156:0/2357137771 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff89c09ad40 msgr2=0x7ff89c133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.220+0000 7ff8a13bb700 1 --2- 172.21.15.156:0/2357137771 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff89c09ad40 0x7ff89c133a30 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff890009870 tx=0x7ff890009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:17.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.220+0000 7ff8a13bb700 1 -- 172.21.15.156:0/2357137771 shutdown_connections 2023-09-30T22:22:17.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.220+0000 7ff8a13bb700 1 --2- 172.21.15.156:0/2357137771 >> v2:172.21.15.156:3300/0 conn(0x7ff89c1343a0 0x7ff89c0a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:17.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.220+0000 7ff8a13bb700 1 --2- 172.21.15.156:0/2357137771 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff89c09ad40 0x7ff89c133a30 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:17.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.220+0000 7ff8a13bb700 1 -- 172.21.15.156:0/2357137771 >> 172.21.15.156:0/2357137771 conn(0x7ff89c099c40 msgr2=0x7ff89c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:17.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.220+0000 7ff8a13bb700 1 -- 172.21.15.156:0/2357137771 shutdown_connections 2023-09-30T22:22:17.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.220+0000 7ff8a13bb700 1 -- 172.21.15.156:0/2357137771 wait complete. 2023-09-30T22:22:17.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.221+0000 7ff8a13bb700 1 Processor -- start 2023-09-30T22:22:17.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.221+0000 7ff8a13bb700 1 -- start start 2023-09-30T22:22:17.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.222+0000 7ff8a13bb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff89c09ad40 0x7ff89c11e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:17.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.222+0000 7ff8a13bb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff89c133f70 0x7ff89c11e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:17.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.222+0000 7ff8a13bb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff89c1343a0 0x7ff89c11ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:17.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.222+0000 7ff8a13bb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c1216d0 con 0x7ff89c133f70 2023-09-30T22:22:17.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.222+0000 7ff8a13bb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c09c7e0 con 0x7ff89c09ad40 2023-09-30T22:22:17.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.222+0000 7ff8a13bb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c11fff0 con 0x7ff89c1343a0 2023-09-30T22:22:17.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.222+0000 7ff89b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff89c1343a0 0x7ff89c11ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:17.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.222+0000 7ff89affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff89c09ad40 0x7ff89c11e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:17.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.222+0000 7ff89a7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff89c133f70 0x7ff89c11e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:17.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.222+0000 7ff89b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff89c1343a0 0x7ff89c11ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39680/0 (socket says 172.21.15.156:39680) 2023-09-30T22:22:17.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.222+0000 7ff89affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff89c09ad40 0x7ff89c11e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45278/0 (socket says 172.21.15.156:45278) 2023-09-30T22:22:17.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.222+0000 7ff89b7fe700 1 -- 172.21.15.156:0/2917322676 learned_addr learned my addr 172.21.15.156:0/2917322676 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:17.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.222+0000 7ff89b7fe700 1 -- 172.21.15.156:0/2917322676 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff89c09ad40 msgr2=0x7ff89c11e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.222+0000 7ff89b7fe700 1 --2- 172.21.15.156:0/2917322676 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff89c09ad40 0x7ff89c11e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:17.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.222+0000 7ff89b7fe700 1 -- 172.21.15.156:0/2917322676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff89c133f70 msgr2=0x7ff89c11e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.222+0000 7ff89b7fe700 1 --2- 172.21.15.156:0/2917322676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff89c133f70 0x7ff89c11e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:17.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.222+0000 7ff89b7fe700 1 -- 172.21.15.156:0/2917322676 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff894009b30 con 0x7ff89c1343a0 2023-09-30T22:22:17.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.222+0000 7ff89b7fe700 1 --2- 172.21.15.156:0/2917322676 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff89c1343a0 0x7ff89c11ee90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff894009f10 tx=0x7ff89400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:17.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.222+0000 7ff8837fe700 1 -- 172.21.15.156:0/2917322676 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff894018070 con 0x7ff89c1343a0 2023-09-30T22:22:17.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.222+0000 7ff8837fe700 1 -- 172.21.15.156:0/2917322676 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89400f040 con 0x7ff89c1343a0 2023-09-30T22:22:17.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.222+0000 7ff8837fe700 1 -- 172.21.15.156:0/2917322676 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff894003c40 con 0x7ff89c1343a0 2023-09-30T22:22:17.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.222+0000 7ff8a13bb700 1 -- 172.21.15.156:0/2917322676 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8900094a0 con 0x7ff89c1343a0 2023-09-30T22:22:17.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.222+0000 7ff8a13bb700 1 -- 172.21.15.156:0/2917322676 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff89c121e60 con 0x7ff89c1343a0 2023-09-30T22:22:17.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.223+0000 7ff8837fe700 1 -- 172.21.15.156:0/2917322676 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff89400c940 con 0x7ff89c1343a0 2023-09-30T22:22:17.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.223+0000 7ff8837fe700 1 -- 172.21.15.156:0/2917322676 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff89403f700 con 0x7ff89c1343a0 2023-09-30T22:22:17.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.223+0000 7ff8a13bb700 1 -- 172.21.15.156:0/2917322676 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff89c04f2a0 con 0x7ff89c1343a0 2023-09-30T22:22:17.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.228+0000 7ff8837fe700 1 -- 172.21.15.156:0/2917322676 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff894014480 con 0x7ff89c1343a0 2023-09-30T22:22:17.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.409+0000 7ff8a13bb700 1 -- 172.21.15.156:0/2917322676 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff89c09d360 con 0x7ff89c1343a0 2023-09-30T22:22:17.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.410+0000 7ff8837fe700 1 -- 172.21.15.156:0/2917322676 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff89401cb60 con 0x7ff89c1343a0 2023-09-30T22:22:17.411 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:17.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.412+0000 7ff8a13bb700 1 -- 172.21.15.156:0/2917322676 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff89c1343a0 msgr2=0x7ff89c11ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.412+0000 7ff8a13bb700 1 --2- 172.21.15.156:0/2917322676 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff89c1343a0 0x7ff89c11ee90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff894009f10 tx=0x7ff89400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:17.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.412+0000 7ff8a13bb700 1 -- 172.21.15.156:0/2917322676 shutdown_connections 2023-09-30T22:22:17.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.412+0000 7ff8a13bb700 1 --2- 172.21.15.156:0/2917322676 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff89c1343a0 0x7ff89c11ee90 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:17.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.412+0000 7ff8a13bb700 1 --2- 172.21.15.156:0/2917322676 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff89c09ad40 0x7ff89c11e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:17.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.412+0000 7ff8a13bb700 1 --2- 172.21.15.156:0/2917322676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff89c133f70 0x7ff89c11e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:17.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.412+0000 7ff8a13bb700 1 -- 172.21.15.156:0/2917322676 >> 172.21.15.156:0/2917322676 conn(0x7ff89c099c40 msgr2=0x7ff89c09b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:17.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.412+0000 7ff8a13bb700 1 -- 172.21.15.156:0/2917322676 shutdown_connections 2023-09-30T22:22:17.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.412+0000 7ff8a13bb700 1 -- 172.21.15.156:0/2917322676 wait complete. 2023-09-30T22:22:17.425 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:17.732 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:17.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.855+0000 7efd87b76700 1 Processor -- start 2023-09-30T22:22:17.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.855+0000 7efd87b76700 1 -- start start 2023-09-30T22:22:17.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.856+0000 7efd87b76700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd80131980 0x7efd80131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:17.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.856+0000 7efd87b76700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7efd8009c790 0x7efd80139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:17.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.856+0000 7efd87b76700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd800a1640 con 0x7efd8009bc70 2023-09-30T22:22:17.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.856+0000 7efd87b76700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd8006eb30 con 0x7efd8009c790 2023-09-30T22:22:17.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.856+0000 7efd87b76700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd800a22d0 con 0x7efd80131980 2023-09-30T22:22:17.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.856+0000 7efd85912700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd80131980 0x7efd80131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:17.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.856+0000 7efd85912700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd80131980 0x7efd80131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45286/0 (socket says 172.21.15.156:45286) 2023-09-30T22:22:17.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.856+0000 7efd85912700 1 -- 172.21.15.156:0/3950319207 learned_addr learned my addr 172.21.15.156:0/3950319207 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:17.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.856+0000 7efd86113700 1 --2- 172.21.15.156:0/3950319207 >> v2:172.21.15.156:3300/0 conn(0x7efd8009c790 0x7efd80139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:17.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.856+0000 7efd86113700 1 -- 172.21.15.156:0/3950319207 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd80131980 msgr2=0x7efd80131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:17.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.856+0000 7efd86113700 1 --2- 172.21.15.156:0/3950319207 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd80131980 0x7efd80131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:17.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.856+0000 7efd86113700 1 -- 172.21.15.156:0/3950319207 >> v1:172.21.15.156:6789/0 conn(0x7efd8009bc70 legacy=0x7efd8009c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.856+0000 7efd86113700 1 -- 172.21.15.156:0/3950319207 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd80131550 con 0x7efd8009c790 2023-09-30T22:22:17.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.856+0000 7efd84910700 1 -- 172.21.15.156:0/3950319207 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892449887 0 0) 0x7efd800a1640 con 0x7efd8009bc70 2023-09-30T22:22:17.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.856+0000 7efd85912700 1 --2- 172.21.15.156:0/3950319207 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd80131980 0x7efd80131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:17.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.856+0000 7efd86113700 1 --2- 172.21.15.156:0/3950319207 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd8009c790 0x7efd80139710 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7efd78009d90 tx=0x7efd7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289e03581963ac66 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:17.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.856+0000 7efd84910700 1 -- 172.21.15.156:0/3950319207 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7800e070 con 0x7efd8009c790 2023-09-30T22:22:17.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.857+0000 7efd84910700 1 -- 172.21.15.156:0/3950319207 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7800bb20 con 0x7efd8009c790 2023-09-30T22:22:17.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.857+0000 7efd84910700 1 -- 172.21.15.156:0/3950319207 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd78012430 con 0x7efd8009c790 2023-09-30T22:22:17.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.857+0000 7efd87b76700 1 -- 172.21.15.156:0/3950319207 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd8009c790 msgr2=0x7efd80139710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.857+0000 7efd87b76700 1 --2- 172.21.15.156:0/3950319207 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd8009c790 0x7efd80139710 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7efd78009d90 tx=0x7efd7800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:17.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.857+0000 7efd87b76700 1 -- 172.21.15.156:0/3950319207 shutdown_connections 2023-09-30T22:22:17.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.857+0000 7efd87b76700 1 --2- 172.21.15.156:0/3950319207 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd8009c790 0x7efd80139710 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:17.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.857+0000 7efd87b76700 1 --2- 172.21.15.156:0/3950319207 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd80131980 0x7efd80131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:17.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.857+0000 7efd87b76700 1 -- 172.21.15.156:0/3950319207 >> 172.21.15.156:0/3950319207 conn(0x7efd800a2980 msgr2=0x7efd800a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:17.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.857+0000 7efd87b76700 1 -- 172.21.15.156:0/3950319207 shutdown_connections 2023-09-30T22:22:17.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.857+0000 7efd87b76700 1 -- 172.21.15.156:0/3950319207 wait complete. 2023-09-30T22:22:17.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.858+0000 7efd87b76700 1 Processor -- start 2023-09-30T22:22:17.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.858+0000 7efd87b76700 1 -- start start 2023-09-30T22:22:17.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.858+0000 7efd87b76700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd8009bc70 0x7efd801196b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:17.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.858+0000 7efd87b76700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd8009c790 0x7efd80119bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:17.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.858+0000 7efd87b76700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efd80131980 0x7efd8011a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:17.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.858+0000 7efd87b76700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8011db90 con 0x7efd8009c790 2023-09-30T22:22:17.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.858+0000 7efd87b76700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8011b2c0 con 0x7efd8009bc70 2023-09-30T22:22:17.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.858+0000 7efd87b76700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd8011b8e0 con 0x7efd80131980 2023-09-30T22:22:17.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.859+0000 7efd85912700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd8009bc70 0x7efd801196b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:17.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.859+0000 7efd85111700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd8009c790 0x7efd80119bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:17.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.859+0000 7efd85912700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd8009bc70 0x7efd801196b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45302/0 (socket says 172.21.15.156:45302) 2023-09-30T22:22:17.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.859+0000 7efd85912700 1 -- 172.21.15.156:0/4105231088 learned_addr learned my addr 172.21.15.156:0/4105231088 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:17.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.859+0000 7efd86113700 1 --2- 172.21.15.156:0/4105231088 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efd80131980 0x7efd8011a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:17.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.859+0000 7efd85912700 1 -- 172.21.15.156:0/4105231088 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efd80131980 msgr2=0x7efd8011a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.859+0000 7efd85912700 1 --2- 172.21.15.156:0/4105231088 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efd80131980 0x7efd8011a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:17.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.859+0000 7efd85912700 1 -- 172.21.15.156:0/4105231088 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd8009c790 msgr2=0x7efd80119bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.859+0000 7efd85912700 1 --2- 172.21.15.156:0/4105231088 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd8009c790 0x7efd80119bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:17.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.859+0000 7efd85912700 1 -- 172.21.15.156:0/4105231088 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd70009500 con 0x7efd8009bc70 2023-09-30T22:22:17.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.859+0000 7efd85912700 1 --2- 172.21.15.156:0/4105231088 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd8009bc70 0x7efd801196b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7efd7000ec10 tx=0x7efd7000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:17.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.859+0000 7efd767fc700 1 -- 172.21.15.156:0/4105231088 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd70005a20 con 0x7efd8009bc70 2023-09-30T22:22:17.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.859+0000 7efd767fc700 1 -- 172.21.15.156:0/4105231088 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd70005b80 con 0x7efd8009bc70 2023-09-30T22:22:17.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.859+0000 7efd87b76700 1 -- 172.21.15.156:0/4105231088 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd78009a70 con 0x7efd8009bc70 2023-09-30T22:22:17.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.859+0000 7efd767fc700 1 -- 172.21.15.156:0/4105231088 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7000c850 con 0x7efd8009bc70 2023-09-30T22:22:17.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.859+0000 7efd87b76700 1 -- 172.21.15.156:0/4105231088 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd80130940 con 0x7efd8009bc70 2023-09-30T22:22:17.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.860+0000 7efd767fc700 1 -- 172.21.15.156:0/4105231088 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efd7000c9b0 con 0x7efd8009bc70 2023-09-30T22:22:17.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.860+0000 7efd767fc700 1 -- 172.21.15.156:0/4105231088 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efd7003f930 con 0x7efd8009bc70 2023-09-30T22:22:17.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.860+0000 7efd87b76700 1 -- 172.21.15.156:0/4105231088 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd800a1c40 con 0x7efd8009bc70 2023-09-30T22:22:17.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.865+0000 7efd767fc700 1 -- 172.21.15.156:0/4105231088 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efd70020070 con 0x7efd8009bc70 2023-09-30T22:22:17.866 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:17.927 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:17.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.991+0000 7f5b9e0d2700 1 Processor -- start 2023-09-30T22:22:17.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.991+0000 7f5b9e0d2700 1 -- start start 2023-09-30T22:22:17.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.992+0000 7f5b9e0d2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b980a0a70 0x7f5b980a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:17.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.992+0000 7f5b9e0d2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5b98134120 0x7f5b9813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:17.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.992+0000 7f5b9e0d2700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b9809dc00 con 0x7f5b980a1380 2023-09-30T22:22:17.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.992+0000 7f5b9e0d2700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b9809ea60 con 0x7f5b98134120 2023-09-30T22:22:17.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.992+0000 7f5b9e0d2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9809dec0 con 0x7f5b980a0a70 2023-09-30T22:22:17.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.992+0000 7f5b97fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5b98134120 0x7f5b9813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:17.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.992+0000 7f5b977fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b980a0a70 0x7f5b980a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:17.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.992+0000 7f5b97fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5b98134120 0x7f5b9813bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:43606/0 (socket says 172.21.15.156:43606) 2023-09-30T22:22:17.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.992+0000 7f5b977fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b980a0a70 0x7f5b980a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39706/0 (socket says 172.21.15.156:39706) 2023-09-30T22:22:17.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.992+0000 7f5b97fff700 1 -- 172.21.15.156:0/340284810 learned_addr learned my addr 172.21.15.156:0/340284810 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:17.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.992+0000 7f5b97fff700 1 -- 172.21.15.156:0/340284810 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b980a0a70 msgr2=0x7f5b980a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:17.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.992+0000 7f5b97fff700 1 --2- 172.21.15.156:0/340284810 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b980a0a70 0x7f5b980a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:17.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.992+0000 7f5b97fff700 1 -- 172.21.15.156:0/340284810 >> v1:172.21.15.156:6789/0 conn(0x7f5b980a1380 legacy=0x7f5b98133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.992+0000 7f5b97fff700 1 -- 172.21.15.156:0/340284810 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9809e6a0 con 0x7f5b98134120 2023-09-30T22:22:17.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.992+0000 7f5b967fc700 1 -- 172.21.15.156:0/340284810 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296792336 0 0) 0x7f5b9809dc00 con 0x7f5b980a1380 2023-09-30T22:22:17.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.992+0000 7f5b97fff700 1 --2- 172.21.15.156:0/340284810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b98134120 0x7f5b9813bce0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f5b90009e50 tx=0x7f5b9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=111632c3cc654bd6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:17.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.992+0000 7f5b967fc700 1 -- 172.21.15.156:0/340284810 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9000e070 con 0x7f5b98134120 2023-09-30T22:22:17.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.992+0000 7f5b967fc700 1 -- 172.21.15.156:0/340284810 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9000b910 con 0x7f5b98134120 2023-09-30T22:22:17.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.992+0000 7f5b967fc700 1 -- 172.21.15.156:0/340284810 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9000bcc0 con 0x7f5b98134120 2023-09-30T22:22:17.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.993+0000 7f5b9e0d2700 1 -- 172.21.15.156:0/340284810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b98134120 msgr2=0x7f5b9813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.993+0000 7f5b9e0d2700 1 --2- 172.21.15.156:0/340284810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b98134120 0x7f5b9813bce0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f5b90009e50 tx=0x7f5b9000b330 comp rx=0 tx=0).stop 2023-09-30T22:22:17.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.993+0000 7f5b9e0d2700 1 -- 172.21.15.156:0/340284810 shutdown_connections 2023-09-30T22:22:17.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.993+0000 7f5b9e0d2700 1 --2- 172.21.15.156:0/340284810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b98134120 0x7f5b9813bce0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:17.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.993+0000 7f5b9e0d2700 1 --2- 172.21.15.156:0/340284810 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b980a0a70 0x7f5b980a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:17.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.993+0000 7f5b9e0d2700 1 -- 172.21.15.156:0/340284810 >> 172.21.15.156:0/340284810 conn(0x7f5b980a6610 msgr2=0x7f5b980a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:17.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.993+0000 7f5b9e0d2700 1 -- 172.21.15.156:0/340284810 shutdown_connections 2023-09-30T22:22:17.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.993+0000 7f5b9e0d2700 1 -- 172.21.15.156:0/340284810 wait complete. 2023-09-30T22:22:17.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.995+0000 7f5b9e0d2700 1 Processor -- start 2023-09-30T22:22:17.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.995+0000 7f5b9e0d2700 1 -- start start 2023-09-30T22:22:17.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.996+0000 7f5b9e0d2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b980a0a70 0x7f5b98122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:17.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.996+0000 7f5b9e0d2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b980a1380 0x7f5b98122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:17.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.996+0000 7f5b9e0d2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b98134120 0x7f5b981231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:17.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.996+0000 7f5b9e0d2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b981332b0 con 0x7f5b980a0a70 2023-09-30T22:22:17.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.996+0000 7f5b9e0d2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b981258b0 con 0x7f5b980a1380 2023-09-30T22:22:17.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.996+0000 7f5b9e0d2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b981242c0 con 0x7f5b98134120 2023-09-30T22:22:17.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.996+0000 7f5b977fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b980a0a70 0x7f5b98122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:18.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.996+0000 7f5b96ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b980a1380 0x7f5b98122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:18.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.996+0000 7f5b977fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b980a0a70 0x7f5b98122750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:43614/0 (socket says 172.21.15.156:43614) 2023-09-30T22:22:18.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.996+0000 7f5b977fe700 1 -- 172.21.15.156:0/3742033948 learned_addr learned my addr 172.21.15.156:0/3742033948 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:18.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.996+0000 7f5b97fff700 1 --2- 172.21.15.156:0/3742033948 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b98134120 0x7f5b981231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:18.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.996+0000 7f5b977fe700 1 -- 172.21.15.156:0/3742033948 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b98134120 msgr2=0x7f5b981231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.996+0000 7f5b977fe700 1 --2- 172.21.15.156:0/3742033948 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b98134120 0x7f5b981231d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.996+0000 7f5b977fe700 1 -- 172.21.15.156:0/3742033948 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b980a1380 msgr2=0x7f5b98122c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.996+0000 7f5b977fe700 1 --2- 172.21.15.156:0/3742033948 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b980a1380 0x7f5b98122c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.996+0000 7f5b977fe700 1 -- 172.21.15.156:0/3742033948 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b90009b30 con 0x7f5b980a0a70 2023-09-30T22:22:18.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.996+0000 7f5b97fff700 1 --2- 172.21.15.156:0/3742033948 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b98134120 0x7f5b981231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:22:18.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.996+0000 7f5b96ffd700 1 --2- 172.21.15.156:0/3742033948 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b980a1380 0x7f5b98122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:18.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.996+0000 7f5b977fe700 1 --2- 172.21.15.156:0/3742033948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b980a0a70 0x7f5b98122750 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f5b8800e9e0 tx=0x7f5b8800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:18.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.997+0000 7f5b7ffff700 1 -- 172.21.15.156:0/3742033948 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b88009710 con 0x7f5b980a0a70 2023-09-30T22:22:18.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.997+0000 7f5b7ffff700 1 -- 172.21.15.156:0/3742033948 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8800c850 con 0x7f5b980a0a70 2023-09-30T22:22:18.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.997+0000 7f5b9e0d2700 1 -- 172.21.15.156:0/3742033948 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b981261d0 con 0x7f5b980a0a70 2023-09-30T22:22:18.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.997+0000 7f5b7ffff700 1 -- 172.21.15.156:0/3742033948 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8800cbc0 con 0x7f5b980a0a70 2023-09-30T22:22:18.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.997+0000 7f5b9e0d2700 1 -- 172.21.15.156:0/3742033948 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b980a0430 con 0x7f5b980a0a70 2023-09-30T22:22:18.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.998+0000 7f5b7ffff700 1 -- 172.21.15.156:0/3742033948 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5b8800cd20 con 0x7f5b980a0a70 2023-09-30T22:22:18.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.998+0000 7f5b7ffff700 1 -- 172.21.15.156:0/3742033948 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5b8803f7b0 con 0x7f5b980a0a70 2023-09-30T22:22:18.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:17.998+0000 7f5b9e0d2700 1 -- 172.21.15.156:0/3742033948 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b98126010 con 0x7f5b980a0a70 2023-09-30T22:22:18.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.007+0000 7f5b7ffff700 1 -- 172.21.15.156:0/3742033948 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5b88021020 con 0x7f5b980a0a70 2023-09-30T22:22:18.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.052+0000 7efede968700 1 Processor -- start 2023-09-30T22:22:18.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.052+0000 7efede968700 1 -- start start 2023-09-30T22:22:18.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.053+0000 7efede968700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efed809f350 0x7efed8136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:18.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.053+0000 7efede968700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efed81371c0 0x7efed81395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:18.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.053+0000 7efede968700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed809c970 con 0x7efed809e870 2023-09-30T22:22:18.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.053+0000 7efede968700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed80a0920 con 0x7efed81371c0 2023-09-30T22:22:18.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.053+0000 7efede968700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efed809f9c0 con 0x7efed809f350 2023-09-30T22:22:18.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.053+0000 7efed7fff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7efed809e870 0x7efed809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48050/0 (socket says 172.21.15.156:48050) 2023-09-30T22:22:18.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.053+0000 7efed7fff700 1 -- 172.21.15.156:0/4197829026 learned_addr learned my addr 172.21.15.156:0/4197829026 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:18.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.053+0000 7efed77fe700 1 --2- 172.21.15.156:0/4197829026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efed809f350 0x7efed8136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:18.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.053+0000 7efedcf05700 1 --2- 172.21.15.156:0/4197829026 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efed81371c0 0x7efed81395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:18.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.053+0000 7efed6ffd700 1 -- 172.21.15.156:0/4197829026 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1280937187 0 0) 0x7efed809c970 con 0x7efed809e870 2023-09-30T22:22:18.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.053+0000 7efed6ffd700 1 -- 172.21.15.156:0/4197829026 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efec00035b0 con 0x7efed809e870 2023-09-30T22:22:18.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.053+0000 7efedcf05700 1 -- 172.21.15.156:0/4197829026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efed809f350 msgr2=0x7efed8136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:18.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.053+0000 7efedcf05700 1 --2- 172.21.15.156:0/4197829026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efed809f350 0x7efed8136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.053+0000 7efedcf05700 1 -- 172.21.15.156:0/4197829026 >> v1:172.21.15.156:6789/0 conn(0x7efed809e870 legacy=0x7efed809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.053+0000 7efedcf05700 1 -- 172.21.15.156:0/4197829026 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed809bab0 con 0x7efed81371c0 2023-09-30T22:22:18.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.054+0000 7efedcf05700 1 --2- 172.21.15.156:0/4197829026 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efed81371c0 0x7efed81395a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7efed0009dc0 tx=0x7efed000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc671711b69ef7f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:18.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.054+0000 7efed6ffd700 1 -- 172.21.15.156:0/4197829026 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed000e070 con 0x7efed81371c0 2023-09-30T22:22:18.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.054+0000 7efed6ffd700 1 -- 172.21.15.156:0/4197829026 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed000bb20 con 0x7efed81371c0 2023-09-30T22:22:18.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.054+0000 7efed6ffd700 1 -- 172.21.15.156:0/4197829026 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed000be90 con 0x7efed81371c0 2023-09-30T22:22:18.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.054+0000 7efede968700 1 -- 172.21.15.156:0/4197829026 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efed81371c0 msgr2=0x7efed81395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.054+0000 7efede968700 1 --2- 172.21.15.156:0/4197829026 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efed81371c0 0x7efed81395a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7efed0009dc0 tx=0x7efed000b330 comp rx=0 tx=0).stop 2023-09-30T22:22:18.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.054+0000 7efede968700 1 -- 172.21.15.156:0/4197829026 shutdown_connections 2023-09-30T22:22:18.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.054+0000 7efede968700 1 --2- 172.21.15.156:0/4197829026 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efed81371c0 0x7efed81395a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.054+0000 7efede968700 1 --2- 172.21.15.156:0/4197829026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efed809f350 0x7efed8136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.054+0000 7efede968700 1 -- 172.21.15.156:0/4197829026 >> 172.21.15.156:0/4197829026 conn(0x7efed80a4430 msgr2=0x7efed80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:18.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.054+0000 7efede968700 1 -- 172.21.15.156:0/4197829026 shutdown_connections 2023-09-30T22:22:18.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.054+0000 7efede968700 1 -- 172.21.15.156:0/4197829026 wait complete. 2023-09-30T22:22:18.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.055+0000 7efede968700 1 Processor -- start 2023-09-30T22:22:18.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.055+0000 7efede968700 1 -- start start 2023-09-30T22:22:18.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.056+0000 7efede968700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efed809e870 0x7efed806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:18.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.056+0000 7efede968700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efed809f350 0x7efed806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:18.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.056+0000 7efede968700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efed81371c0 0x7efed806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:18.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.056+0000 7efede968700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed809dba0 con 0x7efed81371c0 2023-09-30T22:22:18.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.056+0000 7efede968700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed8126100 con 0x7efed809e870 2023-09-30T22:22:18.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.056+0000 7efede968700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efed8126370 con 0x7efed809f350 2023-09-30T22:22:18.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.056+0000 7efedcf05700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efed81371c0 0x7efed806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:18.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.056+0000 7efed77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efed809f350 0x7efed806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:18.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.056+0000 7efed7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efed809e870 0x7efed806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:18.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.056+0000 7efedcf05700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efed81371c0 0x7efed806c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:43624/0 (socket says 172.21.15.156:43624) 2023-09-30T22:22:18.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.056+0000 7efed77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efed809f350 0x7efed806bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39736/0 (socket says 172.21.15.156:39736) 2023-09-30T22:22:18.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.056+0000 7efedcf05700 1 -- 172.21.15.156:0/1529728563 learned_addr learned my addr 172.21.15.156:0/1529728563 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:18.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.056+0000 7efed7fff700 1 -- 172.21.15.156:0/1529728563 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efed809f350 msgr2=0x7efed806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.056+0000 7efed7fff700 1 --2- 172.21.15.156:0/1529728563 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efed809f350 0x7efed806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.056+0000 7efed7fff700 1 -- 172.21.15.156:0/1529728563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efed81371c0 msgr2=0x7efed806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.056+0000 7efed7fff700 1 --2- 172.21.15.156:0/1529728563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efed81371c0 0x7efed806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.056+0000 7efed7fff700 1 -- 172.21.15.156:0/1529728563 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed0009a70 con 0x7efed809e870 2023-09-30T22:22:18.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.056+0000 7efedcf05700 1 --2- 172.21.15.156:0/1529728563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efed81371c0 0x7efed806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:18.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.057+0000 7efed7fff700 1 --2- 172.21.15.156:0/1529728563 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efed809e870 0x7efed806b8b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7efec800c490 tx=0x7efec800c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:18.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.057+0000 7efed4ff9700 1 -- 172.21.15.156:0/1529728563 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec8005d70 con 0x7efed809e870 2023-09-30T22:22:18.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.057+0000 7efed4ff9700 1 -- 172.21.15.156:0/1529728563 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec80070d0 con 0x7efed809e870 2023-09-30T22:22:18.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.057+0000 7efed4ff9700 1 -- 172.21.15.156:0/1529728563 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec8007440 con 0x7efed809e870 2023-09-30T22:22:18.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.057+0000 7efede968700 1 -- 172.21.15.156:0/1529728563 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed806d4c0 con 0x7efed809e870 2023-09-30T22:22:18.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.057+0000 7efede968700 1 -- 172.21.15.156:0/1529728563 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed8072150 con 0x7efed809e870 2023-09-30T22:22:18.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.058+0000 7efed4ff9700 1 -- 172.21.15.156:0/1529728563 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efec80075a0 con 0x7efed809e870 2023-09-30T22:22:18.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.058+0000 7efede968700 1 -- 172.21.15.156:0/1529728563 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed8125d30 con 0x7efed809e870 2023-09-30T22:22:18.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.058+0000 7efed4ff9700 1 -- 172.21.15.156:0/1529728563 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efec803e700 con 0x7efed809e870 2023-09-30T22:22:18.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.067+0000 7efed4ff9700 1 -- 172.21.15.156:0/1529728563 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efec8018af0 con 0x7efed809e870 2023-09-30T22:22:18.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.073+0000 7efd87b76700 1 -- 172.21.15.156:0/4105231088 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efd8004f2a0 con 0x7efd8009bc70 2023-09-30T22:22:18.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.073+0000 7efd767fc700 1 -- 172.21.15.156:0/4105231088 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efd70029090 con 0x7efd8009bc70 2023-09-30T22:22:18.074 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:18.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.076+0000 7efd87b76700 1 -- 172.21.15.156:0/4105231088 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd8009bc70 msgr2=0x7efd801196b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.076+0000 7efd87b76700 1 --2- 172.21.15.156:0/4105231088 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd8009bc70 0x7efd801196b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7efd7000ec10 tx=0x7efd7000ef20 comp rx=0 tx=0).stop 2023-09-30T22:22:18.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.076+0000 7efd87b76700 1 -- 172.21.15.156:0/4105231088 shutdown_connections 2023-09-30T22:22:18.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.076+0000 7efd87b76700 1 --2- 172.21.15.156:0/4105231088 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efd80131980 0x7efd8011a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.076+0000 7efd87b76700 1 --2- 172.21.15.156:0/4105231088 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd8009bc70 0x7efd801196b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.076+0000 7efd87b76700 1 --2- 172.21.15.156:0/4105231088 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd8009c790 0x7efd80119bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.076+0000 7efd87b76700 1 -- 172.21.15.156:0/4105231088 >> 172.21.15.156:0/4105231088 conn(0x7efd800a2980 msgr2=0x7efd8012e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:18.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.076+0000 7efd87b76700 1 -- 172.21.15.156:0/4105231088 shutdown_connections 2023-09-30T22:22:18.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.076+0000 7efd87b76700 1 -- 172.21.15.156:0/4105231088 wait complete. 2023-09-30T22:22:18.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:18.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.201+0000 7f5b9e0d2700 1 -- 172.21.15.156:0/3742033948 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5b9804f2a0 con 0x7f5b980a0a70 2023-09-30T22:22:18.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.201+0000 7f5b7ffff700 1 -- 172.21.15.156:0/3742033948 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5b880232f0 con 0x7f5b980a0a70 2023-09-30T22:22:18.202 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:18.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.203+0000 7f5b9e0d2700 1 -- 172.21.15.156:0/3742033948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b980a0a70 msgr2=0x7f5b98122750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.203+0000 7f5b9e0d2700 1 --2- 172.21.15.156:0/3742033948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b980a0a70 0x7f5b98122750 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f5b8800e9e0 tx=0x7f5b8800ecf0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.203+0000 7f5b9e0d2700 1 -- 172.21.15.156:0/3742033948 shutdown_connections 2023-09-30T22:22:18.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.203+0000 7f5b9e0d2700 1 --2- 172.21.15.156:0/3742033948 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b98134120 0x7f5b981231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.203+0000 7f5b9e0d2700 1 --2- 172.21.15.156:0/3742033948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b980a0a70 0x7f5b98122750 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.203+0000 7f5b9e0d2700 1 --2- 172.21.15.156:0/3742033948 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b980a1380 0x7f5b98122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.203+0000 7f5b9e0d2700 1 -- 172.21.15.156:0/3742033948 >> 172.21.15.156:0/3742033948 conn(0x7f5b980a6610 msgr2=0x7f5b9811c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:18.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.204+0000 7f5b9e0d2700 1 -- 172.21.15.156:0/3742033948 shutdown_connections 2023-09-30T22:22:18.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.204+0000 7f5b9e0d2700 1 -- 172.21.15.156:0/3742033948 wait complete. 2023-09-30T22:22:18.216 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:18.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.268+0000 7efede968700 1 -- 172.21.15.156:0/1529728563 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efed804f2a0 con 0x7efed809e870 2023-09-30T22:22:18.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.268+0000 7efed4ff9700 1 -- 172.21.15.156:0/1529728563 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efec8017020 con 0x7efed809e870 2023-09-30T22:22:18.269 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:18.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.270+0000 7efede968700 1 -- 172.21.15.156:0/1529728563 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efed809e870 msgr2=0x7efed806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.270+0000 7efede968700 1 --2- 172.21.15.156:0/1529728563 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efed809e870 0x7efed806b8b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7efec800c490 tx=0x7efec800c7a0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.270+0000 7efede968700 1 -- 172.21.15.156:0/1529728563 shutdown_connections 2023-09-30T22:22:18.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.270+0000 7efede968700 1 --2- 172.21.15.156:0/1529728563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efed81371c0 0x7efed806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.270+0000 7efede968700 1 --2- 172.21.15.156:0/1529728563 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efed809e870 0x7efed806b8b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.270+0000 7efede968700 1 --2- 172.21.15.156:0/1529728563 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efed809f350 0x7efed806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.270+0000 7efede968700 1 -- 172.21.15.156:0/1529728563 >> 172.21.15.156:0/1529728563 conn(0x7efed80a4430 msgr2=0x7efed80a2890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:18.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.270+0000 7efede968700 1 -- 172.21.15.156:0/1529728563 shutdown_connections 2023-09-30T22:22:18.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.270+0000 7efede968700 1 -- 172.21.15.156:0/1529728563 wait complete. 2023-09-30T22:22:18.283 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:18.426 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:18.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.548+0000 7f6f30a7f700 1 Processor -- start 2023-09-30T22:22:18.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.548+0000 7f6f30a7f700 1 -- start start 2023-09-30T22:22:18.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.549+0000 7f6f30a7f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f2c133ad0 0x7f6f2c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:18.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.549+0000 7f6f30a7f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6f2c1300a0 0x7f6f2c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:18.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.549+0000 7f6f30a7f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c1309f0 0x7f6f2c13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:18.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.549+0000 7f6f30a7f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f2c06b2d0 con 0x7f6f2c1300a0 2023-09-30T22:22:18.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.549+0000 7f6f30a7f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c133610 con 0x7f6f2c1309f0 2023-09-30T22:22:18.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.549+0000 7f6f30a7f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c09a500 con 0x7f6f2c133ad0 2023-09-30T22:22:18.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.549+0000 7f6f2a59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f2c133ad0 0x7f6f2c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:18.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.549+0000 7f6f29d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6f2c1300a0 0x7f6f2c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:18.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.549+0000 7f6f2ad9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c1309f0 0x7f6f2c13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:18.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.549+0000 7f6f2a59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f2c133ad0 0x7f6f2c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39748/0 (socket says 172.21.15.156:39748) 2023-09-30T22:22:18.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.549+0000 7f6f29d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6f2c1300a0 0x7f6f2c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:43636/0 (socket says 172.21.15.156:43636) 2023-09-30T22:22:18.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.549+0000 7f6f2a59c700 1 -- 172.21.15.156:0/3894074756 learned_addr learned my addr 172.21.15.156:0/3894074756 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:18.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.549+0000 7f6f2ad9d700 1 -- 172.21.15.156:0/3894074756 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f2c133ad0 msgr2=0x7f6f2c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:18.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.549+0000 7f6f2ad9d700 1 --2- 172.21.15.156:0/3894074756 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f2c133ad0 0x7f6f2c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.549+0000 7f6f2ad9d700 1 -- 172.21.15.156:0/3894074756 >> v2:172.21.15.156:3300/0 conn(0x7f6f2c1300a0 msgr2=0x7f6f2c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:18.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.549+0000 7f6f2ad9d700 1 --2- 172.21.15.156:0/3894074756 >> v2:172.21.15.156:3300/0 conn(0x7f6f2c1300a0 0x7f6f2c1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.549+0000 7f6f2ad9d700 1 -- 172.21.15.156:0/3894074756 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2c1338b0 con 0x7f6f2c1309f0 2023-09-30T22:22:18.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.549+0000 7f6f2a59c700 1 --2- 172.21.15.156:0/3894074756 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f2c133ad0 0x7f6f2c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:18.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.549+0000 7f6f2ad9d700 1 --2- 172.21.15.156:0/3894074756 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c1309f0 0x7f6f2c13a980 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6f24009d90 tx=0x7f6f2400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cb8dcc5e6698259 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:18.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.549+0000 7f6f2959a700 1 -- 172.21.15.156:0/3894074756 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2400e070 con 0x7f6f2c1309f0 2023-09-30T22:22:18.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.549+0000 7f6f2959a700 1 -- 172.21.15.156:0/3894074756 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2400bb20 con 0x7f6f2c1309f0 2023-09-30T22:22:18.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.549+0000 7f6f2959a700 1 -- 172.21.15.156:0/3894074756 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f24012430 con 0x7f6f2c1309f0 2023-09-30T22:22:18.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.550+0000 7f6f30a7f700 1 -- 172.21.15.156:0/3894074756 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c1309f0 msgr2=0x7f6f2c13a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.550+0000 7f6f30a7f700 1 --2- 172.21.15.156:0/3894074756 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c1309f0 0x7f6f2c13a980 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6f24009d90 tx=0x7f6f2400b330 comp rx=0 tx=0).stop 2023-09-30T22:22:18.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.550+0000 7f6f30a7f700 1 -- 172.21.15.156:0/3894074756 shutdown_connections 2023-09-30T22:22:18.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.550+0000 7f6f30a7f700 1 --2- 172.21.15.156:0/3894074756 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c1309f0 0x7f6f2c13a980 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.550+0000 7f6f30a7f700 1 --2- 172.21.15.156:0/3894074756 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f2c133ad0 0x7f6f2c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.550+0000 7f6f30a7f700 1 --2- 172.21.15.156:0/3894074756 >> v2:172.21.15.156:3300/0 conn(0x7f6f2c1300a0 0x7f6f2c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.550+0000 7f6f30a7f700 1 -- 172.21.15.156:0/3894074756 >> 172.21.15.156:0/3894074756 conn(0x7f6f2c099c40 msgr2=0x7f6f2c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:18.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.550+0000 7f6f30a7f700 1 -- 172.21.15.156:0/3894074756 shutdown_connections 2023-09-30T22:22:18.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.550+0000 7f6f30a7f700 1 -- 172.21.15.156:0/3894074756 wait complete. 2023-09-30T22:22:18.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.551+0000 7f6f30a7f700 1 Processor -- start 2023-09-30T22:22:18.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.551+0000 7f6f30a7f700 1 -- start start 2023-09-30T22:22:18.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.552+0000 7f6f30a7f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c1300a0 0x7f6f2c0712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:18.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.552+0000 7f6f30a7f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f2c1309f0 0x7f6f2c071810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:18.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.552+0000 7f6f30a7f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f2c133ad0 0x7f6f2c071d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:18.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.552+0000 7f6f30a7f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c11dfe0 con 0x7f6f2c1309f0 2023-09-30T22:22:18.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.552+0000 7f6f30a7f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c072730 con 0x7f6f2c1300a0 2023-09-30T22:22:18.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.552+0000 7f6f30a7f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c11ee70 con 0x7f6f2c133ad0 2023-09-30T22:22:18.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.552+0000 7f6f29d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f2c1309f0 0x7f6f2c071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:18.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.552+0000 7f6f2ad9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f2c133ad0 0x7f6f2c071d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:18.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.552+0000 7f6f29d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f2c1309f0 0x7f6f2c071810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:43638/0 (socket says 172.21.15.156:43638) 2023-09-30T22:22:18.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.552+0000 7f6f29d9b700 1 -- 172.21.15.156:0/842048604 learned_addr learned my addr 172.21.15.156:0/842048604 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:18.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.552+0000 7f6f2a59c700 1 --2- 172.21.15.156:0/842048604 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c1300a0 0x7f6f2c0712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:18.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.552+0000 7f6f29d9b700 1 -- 172.21.15.156:0/842048604 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f2c133ad0 msgr2=0x7f6f2c071d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.552+0000 7f6f29d9b700 1 --2- 172.21.15.156:0/842048604 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f2c133ad0 0x7f6f2c071d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.552+0000 7f6f29d9b700 1 -- 172.21.15.156:0/842048604 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c1300a0 msgr2=0x7f6f2c0712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.552+0000 7f6f29d9b700 1 --2- 172.21.15.156:0/842048604 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c1300a0 0x7f6f2c0712d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.552+0000 7f6f29d9b700 1 -- 172.21.15.156:0/842048604 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f20009550 con 0x7f6f2c1309f0 2023-09-30T22:22:18.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.552+0000 7f6f2ad9d700 1 --2- 172.21.15.156:0/842048604 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f2c133ad0 0x7f6f2c071d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:18.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.552+0000 7f6f2a59c700 1 --2- 172.21.15.156:0/842048604 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c1300a0 0x7f6f2c0712d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:18.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.553+0000 7f6f29d9b700 1 --2- 172.21.15.156:0/842048604 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f2c1309f0 0x7f6f2c071810 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c00e9b0 tx=0x7f6f1c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:18.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.553+0000 7f6f1affd700 1 -- 172.21.15.156:0/842048604 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c009710 con 0x7f6f2c1309f0 2023-09-30T22:22:18.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.553+0000 7f6f1affd700 1 -- 172.21.15.156:0/842048604 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1c00ee50 con 0x7f6f2c1309f0 2023-09-30T22:22:18.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.553+0000 7f6f30a7f700 1 -- 172.21.15.156:0/842048604 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f24009a70 con 0x7f6f2c1309f0 2023-09-30T22:22:18.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.553+0000 7f6f1affd700 1 -- 172.21.15.156:0/842048604 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c00ca70 con 0x7f6f2c1309f0 2023-09-30T22:22:18.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.553+0000 7f6f30a7f700 1 -- 172.21.15.156:0/842048604 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f2c12f760 con 0x7f6f2c1309f0 2023-09-30T22:22:18.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.553+0000 7f6f1affd700 1 -- 172.21.15.156:0/842048604 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f1c00cbd0 con 0x7f6f2c1309f0 2023-09-30T22:22:18.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.554+0000 7f6f1affd700 1 -- 172.21.15.156:0/842048604 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6f1c03fa80 con 0x7f6f2c1309f0 2023-09-30T22:22:18.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.554+0000 7f6f30a7f700 1 -- 172.21.15.156:0/842048604 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f2c0a2620 con 0x7f6f2c1309f0 2023-09-30T22:22:18.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.559+0000 7f6f1affd700 1 -- 172.21.15.156:0/842048604 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f1c017080 con 0x7f6f2c1309f0 2023-09-30T22:22:18.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.744+0000 7f6f30a7f700 1 -- 172.21.15.156:0/842048604 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6f2c04f2a0 con 0x7f6f2c1309f0 2023-09-30T22:22:18.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.745+0000 7f6f1affd700 1 -- 172.21.15.156:0/842048604 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f1c01b3b0 con 0x7f6f2c1309f0 2023-09-30T22:22:18.745 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:18.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.746+0000 7f6f30a7f700 1 -- 172.21.15.156:0/842048604 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f2c1309f0 msgr2=0x7f6f2c071810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.747+0000 7f6f30a7f700 1 --2- 172.21.15.156:0/842048604 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f2c1309f0 0x7f6f2c071810 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c00e9b0 tx=0x7f6f1c00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.747+0000 7f6f30a7f700 1 -- 172.21.15.156:0/842048604 shutdown_connections 2023-09-30T22:22:18.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.747+0000 7f6f30a7f700 1 --2- 172.21.15.156:0/842048604 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f2c133ad0 0x7f6f2c071d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.747+0000 7f6f30a7f700 1 --2- 172.21.15.156:0/842048604 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c1300a0 0x7f6f2c0712d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.747+0000 7f6f30a7f700 1 --2- 172.21.15.156:0/842048604 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f2c1309f0 0x7f6f2c071810 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.747+0000 7f6f30a7f700 1 -- 172.21.15.156:0/842048604 >> 172.21.15.156:0/842048604 conn(0x7f6f2c099c40 msgr2=0x7f6f2c132b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:18.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.747+0000 7f6f30a7f700 1 -- 172.21.15.156:0/842048604 shutdown_connections 2023-09-30T22:22:18.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:18.747+0000 7f6f30a7f700 1 -- 172.21.15.156:0/842048604 wait complete. 2023-09-30T22:22:18.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:19.095 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:19.217 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:19.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.219+0000 7f4f00927700 1 Processor -- start 2023-09-30T22:22:19.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.219+0000 7f4f00927700 1 -- start start 2023-09-30T22:22:19.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.220+0000 7f4f00927700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4efc09f350 0x7f4efc136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:19.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.220+0000 7f4f00927700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4efc1371c0 0x7f4efc1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:19.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.220+0000 7f4f00927700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4efc09c970 con 0x7f4efc09e870 2023-09-30T22:22:19.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.220+0000 7f4f00927700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc0a0920 con 0x7f4efc1371c0 2023-09-30T22:22:19.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.220+0000 7f4f00927700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc09f9c0 con 0x7f4efc09f350 2023-09-30T22:22:19.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.220+0000 7f4efa59c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4efc09e870 0x7f4efc09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48064/0 (socket says 172.21.15.156:48064) 2023-09-30T22:22:19.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.220+0000 7f4efa59c700 1 -- 172.21.15.156:0/4121014611 learned_addr learned my addr 172.21.15.156:0/4121014611 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:19.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.220+0000 7f4ef9d9b700 1 --2- 172.21.15.156:0/4121014611 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4efc09f350 0x7f4efc136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:19.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.220+0000 7f4efad9d700 1 --2- 172.21.15.156:0/4121014611 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4efc1371c0 0x7f4efc1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:19.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.220+0000 7f4ef959a700 1 -- 172.21.15.156:0/4121014611 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4022787707 0 0) 0x7f4efc09c970 con 0x7f4efc09e870 2023-09-30T22:22:19.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.220+0000 7f4ef959a700 1 -- 172.21.15.156:0/4121014611 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ee40035b0 con 0x7f4efc09e870 2023-09-30T22:22:19.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.220+0000 7f4ef9d9b700 1 -- 172.21.15.156:0/4121014611 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4efc1371c0 msgr2=0x7f4efc1395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:19.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.220+0000 7f4ef9d9b700 1 --2- 172.21.15.156:0/4121014611 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4efc1371c0 0x7f4efc1395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.220+0000 7f4ef9d9b700 1 -- 172.21.15.156:0/4121014611 >> v1:172.21.15.156:6789/0 conn(0x7f4efc09e870 legacy=0x7f4efc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.220+0000 7f4ef9d9b700 1 -- 172.21.15.156:0/4121014611 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4efc09bab0 con 0x7f4efc09f350 2023-09-30T22:22:19.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.220+0000 7f4efad9d700 1 --2- 172.21.15.156:0/4121014611 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4efc1371c0 0x7f4efc1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:19.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.221+0000 7f4ef9d9b700 1 --2- 172.21.15.156:0/4121014611 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4efc09f350 0x7f4efc136c80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0009870 tx=0x7f4ef0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cab87ec4823692bb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:19.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.221+0000 7f4ef959a700 1 -- 172.21.15.156:0/4121014611 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0011830 con 0x7f4efc09f350 2023-09-30T22:22:19.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.221+0000 7f4ef959a700 1 -- 172.21.15.156:0/4121014611 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef0011990 con 0x7f4efc09f350 2023-09-30T22:22:19.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.221+0000 7f4ef959a700 1 -- 172.21.15.156:0/4121014611 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0011d20 con 0x7f4efc09f350 2023-09-30T22:22:19.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.221+0000 7f4f00927700 1 -- 172.21.15.156:0/4121014611 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4efc09f350 msgr2=0x7f4efc136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.221+0000 7f4f00927700 1 --2- 172.21.15.156:0/4121014611 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4efc09f350 0x7f4efc136c80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0009870 tx=0x7f4ef0009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:19.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.222+0000 7f4f00927700 1 -- 172.21.15.156:0/4121014611 shutdown_connections 2023-09-30T22:22:19.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.222+0000 7f4f00927700 1 --2- 172.21.15.156:0/4121014611 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4efc1371c0 0x7f4efc1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.222+0000 7f4f00927700 1 --2- 172.21.15.156:0/4121014611 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4efc09f350 0x7f4efc136c80 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.222+0000 7f4f00927700 1 -- 172.21.15.156:0/4121014611 >> 172.21.15.156:0/4121014611 conn(0x7f4efc0a4430 msgr2=0x7f4efc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:19.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.222+0000 7f4f00927700 1 -- 172.21.15.156:0/4121014611 shutdown_connections 2023-09-30T22:22:19.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.222+0000 7f4f00927700 1 -- 172.21.15.156:0/4121014611 wait complete. 2023-09-30T22:22:19.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.223+0000 7f4f00927700 1 Processor -- start 2023-09-30T22:22:19.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.223+0000 7f4f00927700 1 -- start start 2023-09-30T22:22:19.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.224+0000 7f4f00927700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4efc09e870 0x7f4efc1c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:19.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.224+0000 7f4f00927700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4efc09f350 0x7f4efc1c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:19.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.224+0000 7f4f00927700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4efc1371c0 0x7f4efc1c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:19.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.224+0000 7f4f00927700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc1228d0 con 0x7f4efc09e870 2023-09-30T22:22:19.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.224+0000 7f4f00927700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc122fb0 con 0x7f4efc09f350 2023-09-30T22:22:19.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.224+0000 7f4f00927700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc072300 con 0x7f4efc1371c0 2023-09-30T22:22:19.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.224+0000 7f4ef9d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4efc09f350 0x7f4efc1c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:19.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.224+0000 7f4ef9d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4efc09f350 0x7f4efc1c68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45352/0 (socket says 172.21.15.156:45352) 2023-09-30T22:22:19.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.224+0000 7f4efad9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4efc1371c0 0x7f4efc1c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:19.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.224+0000 7f4ef9d9b700 1 -- 172.21.15.156:0/3443352542 learned_addr learned my addr 172.21.15.156:0/3443352542 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:19.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.224+0000 7f4efa59c700 1 --2- 172.21.15.156:0/3443352542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4efc09e870 0x7f4efc1c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:19.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.224+0000 7f4ef9d9b700 1 -- 172.21.15.156:0/3443352542 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4efc1371c0 msgr2=0x7f4efc1c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.224+0000 7f4ef9d9b700 1 --2- 172.21.15.156:0/3443352542 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4efc1371c0 0x7f4efc1c6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.224+0000 7f4ef9d9b700 1 -- 172.21.15.156:0/3443352542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4efc09e870 msgr2=0x7f4efc1c63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.224+0000 7f4ef9d9b700 1 --2- 172.21.15.156:0/3443352542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4efc09e870 0x7f4efc1c63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.224+0000 7f4ef9d9b700 1 -- 172.21.15.156:0/3443352542 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef4009a70 con 0x7f4efc09f350 2023-09-30T22:22:19.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.224+0000 7f4efa59c700 1 --2- 172.21.15.156:0/3443352542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4efc09e870 0x7f4efc1c63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:19.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.224+0000 7f4ef9d9b700 1 --2- 172.21.15.156:0/3443352542 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4efc09f350 0x7f4efc1c68f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4ef00090b0 tx=0x7f4ef0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:19.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.225+0000 7f4eeaffd700 1 -- 172.21.15.156:0/3443352542 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0004510 con 0x7f4efc09f350 2023-09-30T22:22:19.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.225+0000 7f4eeaffd700 1 -- 172.21.15.156:0/3443352542 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef001f070 con 0x7f4efc09f350 2023-09-30T22:22:19.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.225+0000 7f4f00927700 1 -- 172.21.15.156:0/3443352542 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef00094a0 con 0x7f4efc09f350 2023-09-30T22:22:19.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.225+0000 7f4eeaffd700 1 -- 172.21.15.156:0/3443352542 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef00038e0 con 0x7f4efc09f350 2023-09-30T22:22:19.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.225+0000 7f4f00927700 1 -- 172.21.15.156:0/3443352542 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4efc124380 con 0x7f4efc09f350 2023-09-30T22:22:19.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.225+0000 7f4eeaffd700 1 -- 172.21.15.156:0/3443352542 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4ef0003a40 con 0x7f4efc09f350 2023-09-30T22:22:19.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.225+0000 7f4eeaffd700 1 -- 172.21.15.156:0/3443352542 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4ef0021070 con 0x7f4efc09f350 2023-09-30T22:22:19.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.226+0000 7f4f00927700 1 -- 172.21.15.156:0/3443352542 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4efc124eb0 con 0x7f4efc09f350 2023-09-30T22:22:19.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.230+0000 7f4eeaffd700 1 -- 172.21.15.156:0/3443352542 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ef002b080 con 0x7f4efc09f350 2023-09-30T22:22:19.283 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:19.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.343+0000 7fd325f6e700 1 Processor -- start 2023-09-30T22:22:19.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.343+0000 7fd325f6e700 1 -- start start 2023-09-30T22:22:19.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.344+0000 7fd325f6e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd32009e870 0x7fd32009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:19.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.344+0000 7fd325f6e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd32009f180 0x7fd320133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:19.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.344+0000 7fd325f6e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3201341d0 0x7fd320134650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:19.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.344+0000 7fd325f6e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32006ce60 con 0x7fd32009e870 2023-09-30T22:22:19.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.344+0000 7fd325f6e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32006bec0 con 0x7fd32009f180 2023-09-30T22:22:19.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.344+0000 7fd325f6e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd32009fa00 con 0x7fd3201341d0 2023-09-30T22:22:19.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.344+0000 7fd31f7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd32009e870 0x7fd32009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:19.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.344+0000 7fd31effd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd32009f180 0x7fd320133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:19.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.344+0000 7fd31f7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd32009e870 0x7fd32009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:43652/0 (socket says 172.21.15.156:43652) 2023-09-30T22:22:19.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.344+0000 7fd31f7fe700 1 -- 172.21.15.156:0/4037795552 learned_addr learned my addr 172.21.15.156:0/4037795552 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:19.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.344+0000 7fd31ffff700 1 --2- 172.21.15.156:0/4037795552 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3201341d0 0x7fd320134650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:19.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.344+0000 7fd31effd700 1 -- 172.21.15.156:0/4037795552 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3201341d0 msgr2=0x7fd320134650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:19.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.344+0000 7fd31effd700 1 --2- 172.21.15.156:0/4037795552 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3201341d0 0x7fd320134650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.344+0000 7fd31effd700 1 -- 172.21.15.156:0/4037795552 >> v2:172.21.15.156:3300/0 conn(0x7fd32009e870 msgr2=0x7fd32009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:19.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.344+0000 7fd31effd700 1 --2- 172.21.15.156:0/4037795552 >> v2:172.21.15.156:3300/0 conn(0x7fd32009e870 0x7fd32009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.344+0000 7fd31effd700 1 -- 172.21.15.156:0/4037795552 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32009ad80 con 0x7fd32009f180 2023-09-30T22:22:19.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.344+0000 7fd31f7fe700 1 --2- 172.21.15.156:0/4037795552 >> v2:172.21.15.156:3300/0 conn(0x7fd32009e870 0x7fd32009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:19.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.344+0000 7fd31effd700 1 --2- 172.21.15.156:0/4037795552 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd32009f180 0x7fd320133c90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd314009840 tx=0x7fd314009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a2a0409d0380e72 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:19.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.344+0000 7fd31e7fc700 1 -- 172.21.15.156:0/4037795552 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd314011830 con 0x7fd32009f180 2023-09-30T22:22:19.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.345+0000 7fd31e7fc700 1 -- 172.21.15.156:0/4037795552 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd314011990 con 0x7fd32009f180 2023-09-30T22:22:19.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.345+0000 7fd31e7fc700 1 -- 172.21.15.156:0/4037795552 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd314011d20 con 0x7fd32009f180 2023-09-30T22:22:19.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.345+0000 7fd325f6e700 1 -- 172.21.15.156:0/4037795552 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd32009f180 msgr2=0x7fd320133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.345+0000 7fd325f6e700 1 --2- 172.21.15.156:0/4037795552 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd32009f180 0x7fd320133c90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd314009840 tx=0x7fd314009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:19.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.345+0000 7fd325f6e700 1 -- 172.21.15.156:0/4037795552 shutdown_connections 2023-09-30T22:22:19.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.345+0000 7fd325f6e700 1 --2- 172.21.15.156:0/4037795552 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3201341d0 0x7fd320134650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.345+0000 7fd325f6e700 1 --2- 172.21.15.156:0/4037795552 >> v2:172.21.15.156:3300/0 conn(0x7fd32009e870 0x7fd32009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.345+0000 7fd325f6e700 1 --2- 172.21.15.156:0/4037795552 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd32009f180 0x7fd320133c90 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.345+0000 7fd325f6e700 1 -- 172.21.15.156:0/4037795552 >> 172.21.15.156:0/4037795552 conn(0x7fd3200a4430 msgr2=0x7fd3200a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:19.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.345+0000 7fd325f6e700 1 -- 172.21.15.156:0/4037795552 shutdown_connections 2023-09-30T22:22:19.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.345+0000 7fd325f6e700 1 -- 172.21.15.156:0/4037795552 wait complete. 2023-09-30T22:22:19.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.346+0000 7fd325f6e700 1 Processor -- start 2023-09-30T22:22:19.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.346+0000 7fd325f6e700 1 -- start start 2023-09-30T22:22:19.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.347+0000 7fd325f6e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd32009e870 0x7fd320122430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:19.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.347+0000 7fd325f6e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd32009f180 0x7fd320122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:19.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.347+0000 7fd325f6e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3201341d0 0x7fd320122eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:19.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.347+0000 7fd325f6e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd320125f50 con 0x7fd3201341d0 2023-09-30T22:22:19.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.347+0000 7fd325f6e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd320124ef0 con 0x7fd32009e870 2023-09-30T22:22:19.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.347+0000 7fd325f6e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd320123890 con 0x7fd32009f180 2023-09-30T22:22:19.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.347+0000 7fd31f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd32009e870 0x7fd320122430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:19.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.347+0000 7fd31f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd32009e870 0x7fd320122430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45376/0 (socket says 172.21.15.156:45376) 2023-09-30T22:22:19.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.347+0000 7fd31f7fe700 1 -- 172.21.15.156:0/3779176250 learned_addr learned my addr 172.21.15.156:0/3779176250 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:19.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.347+0000 7fd31effd700 1 --2- 172.21.15.156:0/3779176250 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd32009f180 0x7fd320122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:19.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.347+0000 7fd31ffff700 1 --2- 172.21.15.156:0/3779176250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3201341d0 0x7fd320122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:19.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.347+0000 7fd31f7fe700 1 -- 172.21.15.156:0/3779176250 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd32009f180 msgr2=0x7fd320122970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.347+0000 7fd31f7fe700 1 --2- 172.21.15.156:0/3779176250 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd32009f180 0x7fd320122970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.347+0000 7fd31f7fe700 1 -- 172.21.15.156:0/3779176250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3201341d0 msgr2=0x7fd320122eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.347+0000 7fd31f7fe700 1 --2- 172.21.15.156:0/3779176250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3201341d0 0x7fd320122eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.347+0000 7fd31f7fe700 1 -- 172.21.15.156:0/3779176250 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd310009550 con 0x7fd32009e870 2023-09-30T22:22:19.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.347+0000 7fd31effd700 1 --2- 172.21.15.156:0/3779176250 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd32009f180 0x7fd320122970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:19.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.347+0000 7fd31f7fe700 1 --2- 172.21.15.156:0/3779176250 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd32009e870 0x7fd320122430 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd31000ec10 tx=0x7fd31000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:19.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.348+0000 7fd307fff700 1 -- 172.21.15.156:0/3779176250 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31000c850 con 0x7fd32009e870 2023-09-30T22:22:19.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.348+0000 7fd307fff700 1 -- 172.21.15.156:0/3779176250 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31000c9b0 con 0x7fd32009e870 2023-09-30T22:22:19.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.348+0000 7fd325f6e700 1 -- 172.21.15.156:0/3779176250 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3140094a0 con 0x7fd32009e870 2023-09-30T22:22:19.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.348+0000 7fd307fff700 1 -- 172.21.15.156:0/3779176250 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31000cd20 con 0x7fd32009e870 2023-09-30T22:22:19.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.348+0000 7fd325f6e700 1 -- 172.21.15.156:0/3779176250 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3201259b0 con 0x7fd32009e870 2023-09-30T22:22:19.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.349+0000 7fd307fff700 1 -- 172.21.15.156:0/3779176250 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd310013470 con 0x7fd32009e870 2023-09-30T22:22:19.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.349+0000 7fd325f6e700 1 -- 172.21.15.156:0/3779176250 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32006d000 con 0x7fd32009e870 2023-09-30T22:22:19.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.349+0000 7fd307fff700 1 -- 172.21.15.156:0/3779176250 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd31003fbb0 con 0x7fd32009e870 2023-09-30T22:22:19.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.353+0000 7fd307fff700 1 -- 172.21.15.156:0/3779176250 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd31006d750 con 0x7fd32009e870 2023-09-30T22:22:19.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.411+0000 7fcf15ade700 1 Processor -- start 2023-09-30T22:22:19.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.411+0000 7fcf15ade700 1 -- start start 2023-09-30T22:22:19.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.411+0000 7fcf15ade700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf1009f350 0x7fcf10136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:19.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.411+0000 7fcf15ade700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf101371c0 0x7fcf101395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:19.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.411+0000 7fcf15ade700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf1009c970 con 0x7fcf1009e870 2023-09-30T22:22:19.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.411+0000 7fcf15ade700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf100a0920 con 0x7fcf1009f350 2023-09-30T22:22:19.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.411+0000 7fcf15ade700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1009f9c0 con 0x7fcf101371c0 2023-09-30T22:22:19.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.412+0000 7fcf0f7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fcf1009e870 0x7fcf1009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48080/0 (socket says 172.21.15.156:48080) 2023-09-30T22:22:19.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.412+0000 7fcf0f7fe700 1 -- 172.21.15.156:0/1609067202 learned_addr learned my addr 172.21.15.156:0/1609067202 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:19.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.412+0000 7fcf0effd700 1 --2- 172.21.15.156:0/1609067202 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf1009f350 0x7fcf10136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:19.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.412+0000 7fcf0ffff700 1 --2- 172.21.15.156:0/1609067202 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf101371c0 0x7fcf101395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:19.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.412+0000 7fcf0e7fc700 1 -- 172.21.15.156:0/1609067202 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2756445810 0 0) 0x7fcf1009c970 con 0x7fcf1009e870 2023-09-30T22:22:19.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.412+0000 7fcf0e7fc700 1 -- 172.21.15.156:0/1609067202 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcef80035b0 con 0x7fcf1009e870 2023-09-30T22:22:19.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.412+0000 7fcf0effd700 1 -- 172.21.15.156:0/1609067202 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf101371c0 msgr2=0x7fcf101395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:19.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.412+0000 7fcf0effd700 1 --2- 172.21.15.156:0/1609067202 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf101371c0 0x7fcf101395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.412+0000 7fcf0effd700 1 -- 172.21.15.156:0/1609067202 >> v1:172.21.15.156:6789/0 conn(0x7fcf1009e870 legacy=0x7fcf1009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.412+0000 7fcf0effd700 1 -- 172.21.15.156:0/1609067202 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1009bab0 con 0x7fcf1009f350 2023-09-30T22:22:19.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.412+0000 7fcf0effd700 1 --2- 172.21.15.156:0/1609067202 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf1009f350 0x7fcf10136c80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009870 tx=0x7fcf04009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32b98c181c537e44 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:19.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.412+0000 7fcf0e7fc700 1 -- 172.21.15.156:0/1609067202 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04011830 con 0x7fcf1009f350 2023-09-30T22:22:19.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.412+0000 7fcf0e7fc700 1 -- 172.21.15.156:0/1609067202 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf04011990 con 0x7fcf1009f350 2023-09-30T22:22:19.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.412+0000 7fcf0e7fc700 1 -- 172.21.15.156:0/1609067202 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04011d20 con 0x7fcf1009f350 2023-09-30T22:22:19.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.413+0000 7fcf15ade700 1 -- 172.21.15.156:0/1609067202 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf1009f350 msgr2=0x7fcf10136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.413+0000 7fcf15ade700 1 --2- 172.21.15.156:0/1609067202 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf1009f350 0x7fcf10136c80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009870 tx=0x7fcf04009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:19.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.413+0000 7fcf15ade700 1 -- 172.21.15.156:0/1609067202 shutdown_connections 2023-09-30T22:22:19.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.413+0000 7fcf15ade700 1 --2- 172.21.15.156:0/1609067202 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf101371c0 0x7fcf101395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.413+0000 7fcf15ade700 1 --2- 172.21.15.156:0/1609067202 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf1009f350 0x7fcf10136c80 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.413+0000 7fcf15ade700 1 -- 172.21.15.156:0/1609067202 >> 172.21.15.156:0/1609067202 conn(0x7fcf100a4430 msgr2=0x7fcf100a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:19.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.413+0000 7fcf15ade700 1 -- 172.21.15.156:0/1609067202 shutdown_connections 2023-09-30T22:22:19.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.413+0000 7fcf15ade700 1 -- 172.21.15.156:0/1609067202 wait complete. 2023-09-30T22:22:19.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.414+0000 7fcf15ade700 1 Processor -- start 2023-09-30T22:22:19.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.414+0000 7fcf15ade700 1 -- start start 2023-09-30T22:22:19.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.415+0000 7fcf15ade700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf1009e870 0x7fcf1006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:19.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.415+0000 7fcf15ade700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf1009f350 0x7fcf1006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:19.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.415+0000 7fcf15ade700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf101371c0 0x7fcf1006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:19.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.415+0000 7fcf15ade700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf101366e0 con 0x7fcf1009f350 2023-09-30T22:22:19.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.415+0000 7fcf15ade700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf100721e0 con 0x7fcf1009e870 2023-09-30T22:22:19.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.415+0000 7fcf15ade700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1006d640 con 0x7fcf101371c0 2023-09-30T22:22:19.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.415+0000 7fcf0f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf1009e870 0x7fcf1006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:19.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.415+0000 7fcf0f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf1009e870 0x7fcf1006b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45390/0 (socket says 172.21.15.156:45390) 2023-09-30T22:22:19.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.415+0000 7fcf0f7fe700 1 -- 172.21.15.156:0/47665768 learned_addr learned my addr 172.21.15.156:0/47665768 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:19.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.415+0000 7fcf0effd700 1 --2- 172.21.15.156:0/47665768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf1009f350 0x7fcf1006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:19.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.415+0000 7fcf0ffff700 1 --2- 172.21.15.156:0/47665768 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf101371c0 0x7fcf1006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:19.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.415+0000 7fcf0f7fe700 1 -- 172.21.15.156:0/47665768 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf101371c0 msgr2=0x7fcf1006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.415+0000 7fcf0f7fe700 1 --2- 172.21.15.156:0/47665768 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf101371c0 0x7fcf1006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.415+0000 7fcf0f7fe700 1 -- 172.21.15.156:0/47665768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf1009f350 msgr2=0x7fcf1006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.415+0000 7fcf0f7fe700 1 --2- 172.21.15.156:0/47665768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf1009f350 0x7fcf1006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.415+0000 7fcf0f7fe700 1 -- 172.21.15.156:0/47665768 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf040094a0 con 0x7fcf1009e870 2023-09-30T22:22:19.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.415+0000 7fcf0f7fe700 1 --2- 172.21.15.156:0/47665768 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf1009e870 0x7fcf1006b8b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fcf0000cbc0 tx=0x7fcf0000ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:19.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.415+0000 7fcef7fff700 1 -- 172.21.15.156:0/47665768 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0000aaa0 con 0x7fcf1009e870 2023-09-30T22:22:19.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.416+0000 7fcef7fff700 1 -- 172.21.15.156:0/47665768 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0000ac00 con 0x7fcf1009e870 2023-09-30T22:22:19.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.416+0000 7fcef7fff700 1 -- 172.21.15.156:0/47665768 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf00012400 con 0x7fcf1009e870 2023-09-30T22:22:19.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.416+0000 7fcf15ade700 1 -- 172.21.15.156:0/47665768 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf10126340 con 0x7fcf1009e870 2023-09-30T22:22:19.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.416+0000 7fcf15ade700 1 -- 172.21.15.156:0/47665768 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1009dba0 con 0x7fcf1009e870 2023-09-30T22:22:19.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.416+0000 7fcf15ade700 1 -- 172.21.15.156:0/47665768 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf10136ad0 con 0x7fcf1009e870 2023-09-30T22:22:19.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.417+0000 7fcef7fff700 1 -- 172.21.15.156:0/47665768 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf0001b3b0 con 0x7fcf1009e870 2023-09-30T22:22:19.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.417+0000 7fcef7fff700 1 -- 172.21.15.156:0/47665768 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcf0003f850 con 0x7fcf1009e870 2023-09-30T22:22:19.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.421+0000 7fcef7fff700 1 -- 172.21.15.156:0/47665768 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf000113a0 con 0x7fcf1009e870 2023-09-30T22:22:19.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.434+0000 7f4f00927700 1 -- 172.21.15.156:0/3443352542 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4efc09ddb0 con 0x7f4efc09f350 2023-09-30T22:22:19.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.434+0000 7f4eeaffd700 1 -- 172.21.15.156:0/3443352542 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ef0015020 con 0x7f4efc09f350 2023-09-30T22:22:19.435 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:19.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.436+0000 7f4f00927700 1 -- 172.21.15.156:0/3443352542 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4efc09f350 msgr2=0x7f4efc1c68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.436+0000 7f4f00927700 1 --2- 172.21.15.156:0/3443352542 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4efc09f350 0x7f4efc1c68f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4ef00090b0 tx=0x7f4ef0004750 comp rx=0 tx=0).stop 2023-09-30T22:22:19.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.436+0000 7f4f00927700 1 -- 172.21.15.156:0/3443352542 shutdown_connections 2023-09-30T22:22:19.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.436+0000 7f4f00927700 1 --2- 172.21.15.156:0/3443352542 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4efc1371c0 0x7f4efc1c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.436+0000 7f4f00927700 1 --2- 172.21.15.156:0/3443352542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4efc09e870 0x7f4efc1c63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.436+0000 7f4f00927700 1 --2- 172.21.15.156:0/3443352542 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4efc09f350 0x7f4efc1c68f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.436+0000 7f4f00927700 1 -- 172.21.15.156:0/3443352542 >> 172.21.15.156:0/3443352542 conn(0x7f4efc0a4430 msgr2=0x7f4efc0a2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:19.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.436+0000 7f4f00927700 1 -- 172.21.15.156:0/3443352542 shutdown_connections 2023-09-30T22:22:19.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.436+0000 7f4f00927700 1 -- 172.21.15.156:0/3443352542 wait complete. 2023-09-30T22:22:19.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:19.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.554+0000 7fd325f6e700 1 -- 172.21.15.156:0/3779176250 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd32004f2a0 con 0x7fd32009e870 2023-09-30T22:22:19.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.554+0000 7fd307fff700 1 -- 172.21.15.156:0/3779176250 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd310017020 con 0x7fd32009e870 2023-09-30T22:22:19.555 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:19.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.556+0000 7fd325f6e700 1 -- 172.21.15.156:0/3779176250 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd32009e870 msgr2=0x7fd320122430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.556+0000 7fd325f6e700 1 --2- 172.21.15.156:0/3779176250 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd32009e870 0x7fd320122430 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd31000ec10 tx=0x7fd31000ef20 comp rx=0 tx=0).stop 2023-09-30T22:22:19.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.556+0000 7fd325f6e700 1 -- 172.21.15.156:0/3779176250 shutdown_connections 2023-09-30T22:22:19.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.556+0000 7fd325f6e700 1 --2- 172.21.15.156:0/3779176250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3201341d0 0x7fd320122eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.556+0000 7fd325f6e700 1 --2- 172.21.15.156:0/3779176250 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd32009e870 0x7fd320122430 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.556+0000 7fd325f6e700 1 --2- 172.21.15.156:0/3779176250 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd32009f180 0x7fd320122970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.556+0000 7fd325f6e700 1 -- 172.21.15.156:0/3779176250 >> 172.21.15.156:0/3779176250 conn(0x7fd3200a4430 msgr2=0x7fd320070a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:19.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.556+0000 7fd325f6e700 1 -- 172.21.15.156:0/3779176250 shutdown_connections 2023-09-30T22:22:19.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.556+0000 7fd325f6e700 1 -- 172.21.15.156:0/3779176250 wait complete. 2023-09-30T22:22:19.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:19.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.612+0000 7fcf15ade700 1 -- 172.21.15.156:0/47665768 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcf10125fe0 con 0x7fcf1009e870 2023-09-30T22:22:19.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.612+0000 7fcef7fff700 1 -- 172.21.15.156:0/47665768 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcf10125fe0 con 0x7fcf1009e870 2023-09-30T22:22:19.613 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:19.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.614+0000 7fcf15ade700 1 -- 172.21.15.156:0/47665768 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf1009e870 msgr2=0x7fcf1006b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.614+0000 7fcf15ade700 1 --2- 172.21.15.156:0/47665768 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf1009e870 0x7fcf1006b8b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fcf0000cbc0 tx=0x7fcf0000ced0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.615+0000 7fcf15ade700 1 -- 172.21.15.156:0/47665768 shutdown_connections 2023-09-30T22:22:19.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.615+0000 7fcf15ade700 1 --2- 172.21.15.156:0/47665768 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf101371c0 0x7fcf1006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.615+0000 7fcf15ade700 1 --2- 172.21.15.156:0/47665768 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf1009e870 0x7fcf1006b8b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.615+0000 7fcf15ade700 1 --2- 172.21.15.156:0/47665768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf1009f350 0x7fcf1006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.615+0000 7fcf15ade700 1 -- 172.21.15.156:0/47665768 >> 172.21.15.156:0/47665768 conn(0x7fcf100a4430 msgr2=0x7fcf100a2920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:19.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.615+0000 7fcf15ade700 1 -- 172.21.15.156:0/47665768 shutdown_connections 2023-09-30T22:22:19.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.615+0000 7fcf15ade700 1 -- 172.21.15.156:0/47665768 wait complete. 2023-09-30T22:22:19.627 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:19.760 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:19.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.882+0000 7f0e07b9d700 1 Processor -- start 2023-09-30T22:22:19.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.883+0000 7f0e07b9d700 1 -- start start 2023-09-30T22:22:19.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.883+0000 7f0e07b9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0e00133ad0 0x7f0e00133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:19.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.883+0000 7f0e07b9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0e00130bc0 0x7f0e0013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:19.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.883+0000 7f0e07b9d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e0006b2d0 con 0x7f0e001300a0 2023-09-30T22:22:19.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.883+0000 7f0e07b9d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e00133610 con 0x7f0e00133ad0 2023-09-30T22:22:19.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.883+0000 7f0e07b9d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0009a500 con 0x7f0e00130bc0 2023-09-30T22:22:19.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.883+0000 7f0e0613a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0e00130bc0 0x7f0e0013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:19.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.883+0000 7f0e05939700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0e00133ad0 0x7f0e00133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:19.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.883+0000 7f0e05939700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0e00133ad0 0x7f0e00133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:43680/0 (socket says 172.21.15.156:43680) 2023-09-30T22:22:19.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.883+0000 7f0e05138700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f0e001300a0 0x7f0e001304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48094/0 (socket says 172.21.15.156:48094) 2023-09-30T22:22:19.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.883+0000 7f0e05939700 1 -- 172.21.15.156:0/307619541 learned_addr learned my addr 172.21.15.156:0/307619541 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:19.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.883+0000 7f0e0613a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0e00130bc0 0x7f0e0013b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45402/0 (socket says 172.21.15.156:45402) 2023-09-30T22:22:19.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.884+0000 7f0e0613a700 1 -- 172.21.15.156:0/307619541 >> v2:172.21.15.156:3300/0 conn(0x7f0e00133ad0 msgr2=0x7f0e00133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:19.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.884+0000 7f0e0613a700 1 --2- 172.21.15.156:0/307619541 >> v2:172.21.15.156:3300/0 conn(0x7f0e00133ad0 0x7f0e00133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.884+0000 7f0e0613a700 1 -- 172.21.15.156:0/307619541 >> v1:172.21.15.156:6789/0 conn(0x7f0e001300a0 legacy=0x7f0e001304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.884+0000 7f0e04937700 1 -- 172.21.15.156:0/307619541 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657372962 0 0) 0x7f0e0006b2d0 con 0x7f0e001300a0 2023-09-30T22:22:19.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.884+0000 7f0e0613a700 1 -- 172.21.15.156:0/307619541 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e001338b0 con 0x7f0e00130bc0 2023-09-30T22:22:19.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.884+0000 7f0e05939700 1 --2- 172.21.15.156:0/307619541 >> v2:172.21.15.156:3300/0 conn(0x7f0e00133ad0 0x7f0e00133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:19.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.884+0000 7f0e0613a700 1 --2- 172.21.15.156:0/307619541 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0e00130bc0 0x7f0e0013b990 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0df8009d90 tx=0x7f0df800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c786c183a20dbf9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:19.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.884+0000 7f0e04937700 1 -- 172.21.15.156:0/307619541 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df800e070 con 0x7f0e00130bc0 2023-09-30T22:22:19.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.884+0000 7f0e04937700 1 -- 172.21.15.156:0/307619541 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df800bb20 con 0x7f0e00130bc0 2023-09-30T22:22:19.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.884+0000 7f0e04937700 1 -- 172.21.15.156:0/307619541 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df8012430 con 0x7f0e00130bc0 2023-09-30T22:22:19.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.884+0000 7f0e07b9d700 1 -- 172.21.15.156:0/307619541 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0e00130bc0 msgr2=0x7f0e0013b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.884+0000 7f0e07b9d700 1 --2- 172.21.15.156:0/307619541 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0e00130bc0 0x7f0e0013b990 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0df8009d90 tx=0x7f0df800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:19.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.884+0000 7f0e07b9d700 1 -- 172.21.15.156:0/307619541 shutdown_connections 2023-09-30T22:22:19.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.884+0000 7f0e07b9d700 1 --2- 172.21.15.156:0/307619541 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0e00130bc0 0x7f0e0013b990 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.884+0000 7f0e07b9d700 1 --2- 172.21.15.156:0/307619541 >> v2:172.21.15.156:3300/0 conn(0x7f0e00133ad0 0x7f0e00133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.884+0000 7f0e07b9d700 1 -- 172.21.15.156:0/307619541 >> 172.21.15.156:0/307619541 conn(0x7f0e00099c40 msgr2=0x7f0e000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:19.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.885+0000 7f0e07b9d700 1 -- 172.21.15.156:0/307619541 shutdown_connections 2023-09-30T22:22:19.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.885+0000 7f0e07b9d700 1 -- 172.21.15.156:0/307619541 wait complete. 2023-09-30T22:22:19.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.885+0000 7f0e07b9d700 1 Processor -- start 2023-09-30T22:22:19.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.885+0000 7f0e07b9d700 1 -- start start 2023-09-30T22:22:19.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.886+0000 7f0e07b9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0e001300a0 0x7f0e0011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:19.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.886+0000 7f0e07b9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0e00130bc0 0x7f0e0011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:19.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.886+0000 7f0e07b9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e00133ad0 0x7f0e0011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:19.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.886+0000 7f0e07b9d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e00120aa0 con 0x7f0e00133ad0 2023-09-30T22:22:19.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.886+0000 7f0e07b9d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0012dd00 con 0x7f0e001300a0 2023-09-30T22:22:19.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.886+0000 7f0e07b9d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0009a150 con 0x7f0e00130bc0 2023-09-30T22:22:19.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.886+0000 7f0e05939700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0e001300a0 0x7f0e0011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:19.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.886+0000 7f0e05939700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0e001300a0 0x7f0e0011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45404/0 (socket says 172.21.15.156:45404) 2023-09-30T22:22:19.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.886+0000 7f0e05138700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0e00130bc0 0x7f0e0011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:19.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.886+0000 7f0e05939700 1 -- 172.21.15.156:0/1840739891 learned_addr learned my addr 172.21.15.156:0/1840739891 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:19.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.886+0000 7f0e0613a700 1 --2- 172.21.15.156:0/1840739891 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e00133ad0 0x7f0e0011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:19.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.886+0000 7f0e05939700 1 -- 172.21.15.156:0/1840739891 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0e00130bc0 msgr2=0x7f0e0011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.886+0000 7f0e05939700 1 --2- 172.21.15.156:0/1840739891 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0e00130bc0 0x7f0e0011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.886+0000 7f0e05939700 1 -- 172.21.15.156:0/1840739891 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e00133ad0 msgr2=0x7f0e0011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.886+0000 7f0e05939700 1 --2- 172.21.15.156:0/1840739891 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e00133ad0 0x7f0e0011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.886+0000 7f0e05939700 1 -- 172.21.15.156:0/1840739891 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df0009550 con 0x7f0e001300a0 2023-09-30T22:22:19.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.886+0000 7f0e05939700 1 --2- 172.21.15.156:0/1840739891 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0e001300a0 0x7f0e0011da40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0df000ebe0 tx=0x7f0df000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:19.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.887+0000 7f0df67fc700 1 -- 172.21.15.156:0/1840739891 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df000c850 con 0x7f0e001300a0 2023-09-30T22:22:19.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.887+0000 7f0df67fc700 1 -- 172.21.15.156:0/1840739891 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df000c9b0 con 0x7f0e001300a0 2023-09-30T22:22:19.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.887+0000 7f0e07b9d700 1 -- 172.21.15.156:0/1840739891 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df8009a70 con 0x7f0e001300a0 2023-09-30T22:22:19.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.887+0000 7f0df67fc700 1 -- 172.21.15.156:0/1840739891 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df000cd40 con 0x7f0e001300a0 2023-09-30T22:22:19.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.887+0000 7f0e07b9d700 1 -- 172.21.15.156:0/1840739891 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e0011f8c0 con 0x7f0e001300a0 2023-09-30T22:22:19.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.887+0000 7f0e07b9d700 1 -- 172.21.15.156:0/1840739891 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e0004f2a0 con 0x7f0e001300a0 2023-09-30T22:22:19.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.888+0000 7f0df67fc700 1 -- 172.21.15.156:0/1840739891 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0df0013470 con 0x7f0e001300a0 2023-09-30T22:22:19.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.888+0000 7f0df67fc700 1 -- 172.21.15.156:0/1840739891 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0df0040180 con 0x7f0e001300a0 2023-09-30T22:22:19.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:19.892+0000 7f0df67fc700 1 -- 172.21.15.156:0/1840739891 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0df0011760 con 0x7f0e001300a0 2023-09-30T22:22:20.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.075+0000 7f0e07b9d700 1 -- 172.21.15.156:0/1840739891 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0e000a3470 con 0x7f0e001300a0 2023-09-30T22:22:20.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.076+0000 7f0df67fc700 1 -- 172.21.15.156:0/1840739891 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0df0021020 con 0x7f0e001300a0 2023-09-30T22:22:20.076 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:20.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.078+0000 7f0e07b9d700 1 -- 172.21.15.156:0/1840739891 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0e001300a0 msgr2=0x7f0e0011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.078+0000 7f0e07b9d700 1 --2- 172.21.15.156:0/1840739891 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0e001300a0 0x7f0e0011da40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0df000ebe0 tx=0x7f0df000eef0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.078+0000 7f0e07b9d700 1 -- 172.21.15.156:0/1840739891 shutdown_connections 2023-09-30T22:22:20.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.078+0000 7f0e07b9d700 1 --2- 172.21.15.156:0/1840739891 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e00133ad0 0x7f0e0011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.078+0000 7f0e07b9d700 1 --2- 172.21.15.156:0/1840739891 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0e001300a0 0x7f0e0011da40 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.078+0000 7f0e07b9d700 1 --2- 172.21.15.156:0/1840739891 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0e00130bc0 0x7f0e0011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.078+0000 7f0e07b9d700 1 -- 172.21.15.156:0/1840739891 >> 172.21.15.156:0/1840739891 conn(0x7f0e00099c40 msgr2=0x7f0e00132af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:20.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.078+0000 7f0e07b9d700 1 -- 172.21.15.156:0/1840739891 shutdown_connections 2023-09-30T22:22:20.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.078+0000 7f0e07b9d700 1 -- 172.21.15.156:0/1840739891 wait complete. 2023-09-30T22:22:20.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:20.455 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:20.571 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:20.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.579+0000 7fa555c1b700 1 Processor -- start 2023-09-30T22:22:20.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.579+0000 7fa555c1b700 1 -- start start 2023-09-30T22:22:20.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.580+0000 7fa555c1b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa55009e870 0x7fa55009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:20.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.580+0000 7fa555c1b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa55009f180 0x7fa550131810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:20.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.580+0000 7fa555c1b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa550131d50 0x7fa5501321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:20.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.580+0000 7fa555c1b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55009b6a0 con 0x7fa550131d50 2023-09-30T22:22:20.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.580+0000 7fa555c1b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55009ad60 con 0x7fa55009e870 2023-09-30T22:22:20.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.580+0000 7fa555c1b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5500a0650 con 0x7fa55009f180 2023-09-30T22:22:20.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.580+0000 7fa54effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa55009f180 0x7fa550131810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:20.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.580+0000 7fa54ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa550131d50 0x7fa5501321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:20.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.580+0000 7fa54f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa55009e870 0x7fa55009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:20.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.580+0000 7fa54effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa55009f180 0x7fa550131810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39832/0 (socket says 172.21.15.156:39832) 2023-09-30T22:22:20.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.580+0000 7fa54effd700 1 -- 172.21.15.156:0/2704524227 learned_addr learned my addr 172.21.15.156:0/2704524227 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:20.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.580+0000 7fa54f7fe700 1 -- 172.21.15.156:0/2704524227 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa55009f180 msgr2=0x7fa550131810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:20.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.580+0000 7fa54f7fe700 1 --2- 172.21.15.156:0/2704524227 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa55009f180 0x7fa550131810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.580+0000 7fa54f7fe700 1 -- 172.21.15.156:0/2704524227 >> v2:172.21.15.156:3300/0 conn(0x7fa550131d50 msgr2=0x7fa5501321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:20.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.580+0000 7fa54f7fe700 1 --2- 172.21.15.156:0/2704524227 >> v2:172.21.15.156:3300/0 conn(0x7fa550131d50 0x7fa5501321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.580+0000 7fa54f7fe700 1 -- 172.21.15.156:0/2704524227 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55009f9f0 con 0x7fa55009e870 2023-09-30T22:22:20.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.580+0000 7fa54effd700 1 --2- 172.21.15.156:0/2704524227 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa55009f180 0x7fa550131810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:20.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.580+0000 7fa54ffff700 1 --2- 172.21.15.156:0/2704524227 >> v2:172.21.15.156:3300/0 conn(0x7fa550131d50 0x7fa5501321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:20.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.580+0000 7fa54f7fe700 1 --2- 172.21.15.156:0/2704524227 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa55009e870 0x7fa55009ec40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa540009dc0 tx=0x7fa54000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=350097f61fef88c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:20.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.580+0000 7fa54e7fc700 1 -- 172.21.15.156:0/2704524227 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54000e070 con 0x7fa55009e870 2023-09-30T22:22:20.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.580+0000 7fa54e7fc700 1 -- 172.21.15.156:0/2704524227 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54000bae0 con 0x7fa55009e870 2023-09-30T22:22:20.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.580+0000 7fa54e7fc700 1 -- 172.21.15.156:0/2704524227 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54000be90 con 0x7fa55009e870 2023-09-30T22:22:20.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.581+0000 7fa555c1b700 1 -- 172.21.15.156:0/2704524227 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa55009e870 msgr2=0x7fa55009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.581+0000 7fa555c1b700 1 --2- 172.21.15.156:0/2704524227 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa55009e870 0x7fa55009ec40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa540009dc0 tx=0x7fa54000b330 comp rx=0 tx=0).stop 2023-09-30T22:22:20.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.581+0000 7fa555c1b700 1 -- 172.21.15.156:0/2704524227 shutdown_connections 2023-09-30T22:22:20.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.581+0000 7fa555c1b700 1 --2- 172.21.15.156:0/2704524227 >> v2:172.21.15.156:3300/0 conn(0x7fa550131d50 0x7fa5501321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.581+0000 7fa555c1b700 1 --2- 172.21.15.156:0/2704524227 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa55009e870 0x7fa55009ec40 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.581+0000 7fa555c1b700 1 --2- 172.21.15.156:0/2704524227 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa55009f180 0x7fa550131810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.581+0000 7fa555c1b700 1 -- 172.21.15.156:0/2704524227 >> 172.21.15.156:0/2704524227 conn(0x7fa5500a4150 msgr2=0x7fa5500a4550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:20.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.581+0000 7fa555c1b700 1 -- 172.21.15.156:0/2704524227 shutdown_connections 2023-09-30T22:22:20.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.581+0000 7fa555c1b700 1 -- 172.21.15.156:0/2704524227 wait complete. 2023-09-30T22:22:20.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.582+0000 7fa555c1b700 1 Processor -- start 2023-09-30T22:22:20.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.582+0000 7fa555c1b700 1 -- start start 2023-09-30T22:22:20.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.583+0000 7fa555c1b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa55009e870 0x7fa55011bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:20.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.583+0000 7fa555c1b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa55009f180 0x7fa55011c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:20.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.583+0000 7fa555c1b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa550131d50 0x7fa55011c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:20.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.583+0000 7fa555c1b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa550120270 con 0x7fa55009e870 2023-09-30T22:22:20.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.583+0000 7fa555c1b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55011d9a0 con 0x7fa550131d50 2023-09-30T22:22:20.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.583+0000 7fa555c1b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa55011dfc0 con 0x7fa55009f180 2023-09-30T22:22:20.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.583+0000 7fa54ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa550131d50 0x7fa55011c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:20.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.583+0000 7fa54f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa55009e870 0x7fa55011bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:20.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.583+0000 7fa54ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa550131d50 0x7fa55011c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45422/0 (socket says 172.21.15.156:45422) 2023-09-30T22:22:20.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.583+0000 7fa54f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa55009e870 0x7fa55011bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:43704/0 (socket says 172.21.15.156:43704) 2023-09-30T22:22:20.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.583+0000 7fa54ffff700 1 -- 172.21.15.156:0/3039543082 learned_addr learned my addr 172.21.15.156:0/3039543082 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:20.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.583+0000 7fa54effd700 1 --2- 172.21.15.156:0/3039543082 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa55009f180 0x7fa55011c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:20.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.583+0000 7fa54ffff700 1 -- 172.21.15.156:0/3039543082 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa55009f180 msgr2=0x7fa55011c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.583+0000 7fa54ffff700 1 --2- 172.21.15.156:0/3039543082 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa55009f180 0x7fa55011c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.583+0000 7fa54ffff700 1 -- 172.21.15.156:0/3039543082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa55009e870 msgr2=0x7fa55011bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.583+0000 7fa54ffff700 1 --2- 172.21.15.156:0/3039543082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa55009e870 0x7fa55011bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.583+0000 7fa54ffff700 1 -- 172.21.15.156:0/3039543082 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54400d9f0 con 0x7fa550131d50 2023-09-30T22:22:20.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.583+0000 7fa54f7fe700 1 --2- 172.21.15.156:0/3039543082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa55009e870 0x7fa55011bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:20.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.583+0000 7fa54effd700 1 --2- 172.21.15.156:0/3039543082 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa55009f180 0x7fa55011c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:20.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.583+0000 7fa54ffff700 1 --2- 172.21.15.156:0/3039543082 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa550131d50 0x7fa55011c810 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa54800ebc0 tx=0x7fa54800eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:20.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.583+0000 7fa537fff700 1 -- 172.21.15.156:0/3039543082 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5480097a0 con 0x7fa550131d50 2023-09-30T22:22:20.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.584+0000 7fa555c1b700 1 -- 172.21.15.156:0/3039543082 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5480094a0 con 0x7fa550131d50 2023-09-30T22:22:20.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.584+0000 7fa537fff700 1 -- 172.21.15.156:0/3039543082 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa548004020 con 0x7fa550131d50 2023-09-30T22:22:20.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.584+0000 7fa537fff700 1 -- 172.21.15.156:0/3039543082 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5480043b0 con 0x7fa550131d50 2023-09-30T22:22:20.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.584+0000 7fa555c1b700 1 -- 172.21.15.156:0/3039543082 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa540009a70 con 0x7fa550131d50 2023-09-30T22:22:20.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.584+0000 7fa537fff700 1 -- 172.21.15.156:0/3039543082 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa54800c850 con 0x7fa550131d50 2023-09-30T22:22:20.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.584+0000 7fa537fff700 1 -- 172.21.15.156:0/3039543082 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa54803f380 con 0x7fa550131d50 2023-09-30T22:22:20.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.585+0000 7fa555c1b700 1 -- 172.21.15.156:0/3039543082 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa550070fb0 con 0x7fa550131d50 2023-09-30T22:22:20.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.590+0000 7fa537fff700 1 -- 172.21.15.156:0/3039543082 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa548017080 con 0x7fa550131d50 2023-09-30T22:22:20.628 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:20.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.700+0000 7f16b07ca700 1 Processor -- start 2023-09-30T22:22:20.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.700+0000 7f16b07ca700 1 -- start start 2023-09-30T22:22:20.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.700+0000 7f16b07ca700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16a809e870 0x7f16a809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:20.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.700+0000 7f16b07ca700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16a809f180 0x7f16a8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:20.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.700+0000 7f16b07ca700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a809c970 con 0x7f16a8131d70 2023-09-30T22:22:20.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.700+0000 7f16b07ca700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a80a0920 con 0x7f16a809e870 2023-09-30T22:22:20.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.700+0000 7f16b07ca700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16a809f9c0 con 0x7f16a809f180 2023-09-30T22:22:20.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.701+0000 7f16add65700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16a809f180 0x7f16a8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:20.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.701+0000 7f16ae566700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16a809e870 0x7f16a809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:20.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.701+0000 7f16ae566700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16a809e870 0x7f16a809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45434/0 (socket says 172.21.15.156:45434) 2023-09-30T22:22:20.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.701+0000 7f16add65700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16a809f180 0x7f16a8131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39858/0 (socket says 172.21.15.156:39858) 2023-09-30T22:22:20.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.701+0000 7f16ae566700 1 -- 172.21.15.156:0/2536311072 learned_addr learned my addr 172.21.15.156:0/2536311072 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:20.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.701+0000 7f16aed67700 1 --1- 172.21.15.156:0/2536311072 >> v1:172.21.15.156:6789/0 conn(0x7f16a8131d70 0x7f16a8138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48102/0 (socket says 172.21.15.156:48102) 2023-09-30T22:22:20.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.701+0000 7f16add65700 1 -- 172.21.15.156:0/2536311072 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16a809e870 msgr2=0x7f16a809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:20.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.701+0000 7f16add65700 1 --2- 172.21.15.156:0/2536311072 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16a809e870 0x7f16a809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.701+0000 7f16add65700 1 -- 172.21.15.156:0/2536311072 >> v1:172.21.15.156:6789/0 conn(0x7f16a8131d70 legacy=0x7f16a8138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.701+0000 7f16add65700 1 -- 172.21.15.156:0/2536311072 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a809bab0 con 0x7f16a809f180 2023-09-30T22:22:20.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.701+0000 7f16add65700 1 --2- 172.21.15.156:0/2536311072 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16a809f180 0x7f16a8131830 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1698009870 tx=0x7f1698009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17e32256a23acc4e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:20.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.701+0000 7f16ad564700 1 -- 172.21.15.156:0/2536311072 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1698011830 con 0x7f16a809f180 2023-09-30T22:22:20.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.701+0000 7f16ad564700 1 -- 172.21.15.156:0/2536311072 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1698011990 con 0x7f16a809f180 2023-09-30T22:22:20.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.701+0000 7f16ad564700 1 -- 172.21.15.156:0/2536311072 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1698011d20 con 0x7f16a809f180 2023-09-30T22:22:20.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.702+0000 7f16b07ca700 1 -- 172.21.15.156:0/2536311072 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16a809f180 msgr2=0x7f16a8131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.702+0000 7f16b07ca700 1 --2- 172.21.15.156:0/2536311072 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16a809f180 0x7f16a8131830 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1698009870 tx=0x7f1698009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:20.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.702+0000 7f16b07ca700 1 -- 172.21.15.156:0/2536311072 shutdown_connections 2023-09-30T22:22:20.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.702+0000 7f16b07ca700 1 --2- 172.21.15.156:0/2536311072 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16a809e870 0x7f16a809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.702+0000 7f16b07ca700 1 --2- 172.21.15.156:0/2536311072 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16a809f180 0x7f16a8131830 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.702+0000 7f16b07ca700 1 -- 172.21.15.156:0/2536311072 >> 172.21.15.156:0/2536311072 conn(0x7f16a80a4430 msgr2=0x7f16a80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:20.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.702+0000 7f16b07ca700 1 -- 172.21.15.156:0/2536311072 shutdown_connections 2023-09-30T22:22:20.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.702+0000 7f16b07ca700 1 -- 172.21.15.156:0/2536311072 wait complete. 2023-09-30T22:22:20.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.703+0000 7f16b07ca700 1 Processor -- start 2023-09-30T22:22:20.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.703+0000 7f16b07ca700 1 -- start start 2023-09-30T22:22:20.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.703+0000 7f16b07ca700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16a809e870 0x7f16a8122800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:20.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.703+0000 7f16b07ca700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f16a809f180 0x7f16a8122d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:20.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.703+0000 7f16b07ca700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16a8131d70 0x7f16a8123280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:20.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.703+0000 7f16b07ca700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a8126320 con 0x7f16a809f180 2023-09-30T22:22:20.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.703+0000 7f16b07ca700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a8124a30 con 0x7f16a8131d70 2023-09-30T22:22:20.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.703+0000 7f16b07ca700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16a809dba0 con 0x7f16a809e870 2023-09-30T22:22:20.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.703+0000 7f16add65700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f16a809f180 0x7f16a8122d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:20.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.703+0000 7f16add65700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f16a809f180 0x7f16a8122d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:43716/0 (socket says 172.21.15.156:43716) 2023-09-30T22:22:20.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.703+0000 7f16add65700 1 -- 172.21.15.156:0/2650380251 learned_addr learned my addr 172.21.15.156:0/2650380251 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:20.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.703+0000 7f16ae566700 1 --2- 172.21.15.156:0/2650380251 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16a809e870 0x7f16a8122800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:20.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.703+0000 7f16aed67700 1 --2- 172.21.15.156:0/2650380251 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16a8131d70 0x7f16a8123280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:20.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.704+0000 7f16add65700 1 -- 172.21.15.156:0/2650380251 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16a809e870 msgr2=0x7f16a8122800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.704+0000 7f16add65700 1 --2- 172.21.15.156:0/2650380251 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16a809e870 0x7f16a8122800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.704+0000 7f16add65700 1 -- 172.21.15.156:0/2650380251 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16a8131d70 msgr2=0x7f16a8123280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.704+0000 7f16add65700 1 --2- 172.21.15.156:0/2650380251 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16a8131d70 0x7f16a8123280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.704+0000 7f16add65700 1 -- 172.21.15.156:0/2650380251 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16980094a0 con 0x7f16a809f180 2023-09-30T22:22:20.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.704+0000 7f16add65700 1 --2- 172.21.15.156:0/2650380251 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f16a809f180 0x7f16a8122d40 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f1698009bc0 tx=0x7f1698004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:20.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.704+0000 7f169effd700 1 -- 172.21.15.156:0/2650380251 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1698004550 con 0x7f16a809f180 2023-09-30T22:22:20.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.704+0000 7f169effd700 1 -- 172.21.15.156:0/2650380251 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169801f070 con 0x7f16a809f180 2023-09-30T22:22:20.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.704+0000 7f169effd700 1 -- 172.21.15.156:0/2650380251 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16980038e0 con 0x7f16a809f180 2023-09-30T22:22:20.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.704+0000 7f16b07ca700 1 -- 172.21.15.156:0/2650380251 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a8124410 con 0x7f16a809f180 2023-09-30T22:22:20.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.704+0000 7f16b07ca700 1 -- 172.21.15.156:0/2650380251 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a8124c00 con 0x7f16a809f180 2023-09-30T22:22:20.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.705+0000 7f169effd700 1 -- 172.21.15.156:0/2650380251 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1698003a40 con 0x7f16a809f180 2023-09-30T22:22:20.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.705+0000 7f169effd700 1 -- 172.21.15.156:0/2650380251 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1698021070 con 0x7f16a809f180 2023-09-30T22:22:20.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.705+0000 7f16b07ca700 1 -- 172.21.15.156:0/2650380251 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a8125ce0 con 0x7f16a809f180 2023-09-30T22:22:20.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.710+0000 7f169effd700 1 -- 172.21.15.156:0/2650380251 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16a8125ce0 con 0x7f16a809f180 2023-09-30T22:22:20.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.753+0000 7f5fb1f1b700 1 Processor -- start 2023-09-30T22:22:20.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.753+0000 7f5fb1f1b700 1 -- start start 2023-09-30T22:22:20.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.753+0000 7f5fb1f1b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5fac09e870 0x7f5fac09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:20.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.753+0000 7f5fb1f1b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5fac131f40 0x7f5fac139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:20.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.753+0000 7f5fb1f1b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fac09c970 con 0x7f5fac09f180 2023-09-30T22:22:20.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.753+0000 7f5fb1f1b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac0a0920 con 0x7f5fac131f40 2023-09-30T22:22:20.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.753+0000 7f5fb1f1b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac09f9c0 con 0x7f5fac09e870 2023-09-30T22:22:20.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.753+0000 7f5fabfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5fac131f40 0x7f5fac139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:20.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.753+0000 7f5faaffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f5fac09f180 0x7f5fac131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48110/0 (socket says 172.21.15.156:48110) 2023-09-30T22:22:20.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.753+0000 7f5faaffd700 1 -- 172.21.15.156:0/4289248455 learned_addr learned my addr 172.21.15.156:0/4289248455 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:20.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.753+0000 7f5fabfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5fac131f40 0x7f5fac139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45464/0 (socket says 172.21.15.156:45464) 2023-09-30T22:22:20.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.753+0000 7f5fab7fe700 1 --2- 172.21.15.156:0/4289248455 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5fac09e870 0x7f5fac09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:20.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.754+0000 7f5faa7fc700 1 -- 172.21.15.156:0/4289248455 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305264748 0 0) 0x7f5fac09c970 con 0x7f5fac09f180 2023-09-30T22:22:20.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.754+0000 7f5faa7fc700 1 -- 172.21.15.156:0/4289248455 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f940035b0 con 0x7f5fac09f180 2023-09-30T22:22:20.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.754+0000 7f5fabfff700 1 -- 172.21.15.156:0/4289248455 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5fac09e870 msgr2=0x7f5fac09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:20.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.754+0000 7f5fabfff700 1 --2- 172.21.15.156:0/4289248455 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5fac09e870 0x7f5fac09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.754+0000 7f5fabfff700 1 -- 172.21.15.156:0/4289248455 >> v1:172.21.15.156:6789/0 conn(0x7f5fac09f180 legacy=0x7f5fac131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.754+0000 7f5fabfff700 1 -- 172.21.15.156:0/4289248455 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fac09bab0 con 0x7f5fac131f40 2023-09-30T22:22:20.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.754+0000 7f5fab7fe700 1 --2- 172.21.15.156:0/4289248455 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5fac09e870 0x7f5fac09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:20.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.754+0000 7f5fabfff700 1 --2- 172.21.15.156:0/4289248455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5fac131f40 0x7f5fac139ca0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4009dc0 tx=0x7f5fa400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fd1dcb3369a1917 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:20.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.754+0000 7f5faa7fc700 1 -- 172.21.15.156:0/4289248455 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa400bd20 con 0x7f5fac131f40 2023-09-30T22:22:20.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.754+0000 7f5faa7fc700 1 -- 172.21.15.156:0/4289248455 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa400be80 con 0x7f5fac131f40 2023-09-30T22:22:20.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.754+0000 7f5faa7fc700 1 -- 172.21.15.156:0/4289248455 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4010710 con 0x7f5fac131f40 2023-09-30T22:22:20.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.755+0000 7f5fb1f1b700 1 -- 172.21.15.156:0/4289248455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5fac131f40 msgr2=0x7f5fac139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.755+0000 7f5fb1f1b700 1 --2- 172.21.15.156:0/4289248455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5fac131f40 0x7f5fac139ca0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4009dc0 tx=0x7f5fa400b330 comp rx=0 tx=0).stop 2023-09-30T22:22:20.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.755+0000 7f5fb1f1b700 1 -- 172.21.15.156:0/4289248455 shutdown_connections 2023-09-30T22:22:20.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.755+0000 7f5fb1f1b700 1 --2- 172.21.15.156:0/4289248455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5fac131f40 0x7f5fac139ca0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.755+0000 7f5fb1f1b700 1 --2- 172.21.15.156:0/4289248455 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5fac09e870 0x7f5fac09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.755+0000 7f5fb1f1b700 1 -- 172.21.15.156:0/4289248455 >> 172.21.15.156:0/4289248455 conn(0x7f5fac0a4430 msgr2=0x7f5fac0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:20.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.755+0000 7f5fb1f1b700 1 -- 172.21.15.156:0/4289248455 shutdown_connections 2023-09-30T22:22:20.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.755+0000 7f5fb1f1b700 1 -- 172.21.15.156:0/4289248455 wait complete. 2023-09-30T22:22:20.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.756+0000 7f5fb1f1b700 1 Processor -- start 2023-09-30T22:22:20.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.756+0000 7f5fb1f1b700 1 -- start start 2023-09-30T22:22:20.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.756+0000 7f5fb1f1b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fac09e870 0x7f5fac12f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:20.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.756+0000 7f5fb1f1b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5fac09f180 0x7f5fac11bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:20.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.756+0000 7f5fb1f1b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5fac131f40 0x7f5fac11c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:20.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.756+0000 7f5fb1f1b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac1203c0 con 0x7f5fac09e870 2023-09-30T22:22:20.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.756+0000 7f5fb1f1b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac11fa00 con 0x7f5fac09f180 2023-09-30T22:22:20.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.756+0000 7f5fb1f1b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac11f190 con 0x7f5fac131f40 2023-09-30T22:22:20.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.756+0000 7f5faaffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5fac09f180 0x7f5fac11bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:20.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.757+0000 7f5faaffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5fac09f180 0x7f5fac11bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45466/0 (socket says 172.21.15.156:45466) 2023-09-30T22:22:20.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.757+0000 7f5faaffd700 1 -- 172.21.15.156:0/1128687825 learned_addr learned my addr 172.21.15.156:0/1128687825 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:20.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.757+0000 7f5fab7fe700 1 --2- 172.21.15.156:0/1128687825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fac09e870 0x7f5fac12f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:20.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.757+0000 7f5fabfff700 1 --2- 172.21.15.156:0/1128687825 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5fac131f40 0x7f5fac11c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:20.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.757+0000 7f5faaffd700 1 -- 172.21.15.156:0/1128687825 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5fac131f40 msgr2=0x7f5fac11c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.757+0000 7f5faaffd700 1 --2- 172.21.15.156:0/1128687825 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5fac131f40 0x7f5fac11c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.757+0000 7f5faaffd700 1 -- 172.21.15.156:0/1128687825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fac09e870 msgr2=0x7f5fac12f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.757+0000 7f5faaffd700 1 --2- 172.21.15.156:0/1128687825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fac09e870 0x7f5fac12f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.757+0000 7f5faaffd700 1 -- 172.21.15.156:0/1128687825 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9c0094a0 con 0x7f5fac09f180 2023-09-30T22:22:20.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.757+0000 7f5fab7fe700 1 --2- 172.21.15.156:0/1128687825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fac09e870 0x7f5fac12f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:20.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.757+0000 7f5faaffd700 1 --2- 172.21.15.156:0/1128687825 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5fac09f180 0x7f5fac11bf30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000c700 tx=0x7f5fa000ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:20.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.757+0000 7f5f93fff700 1 -- 172.21.15.156:0/1128687825 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa0005d70 con 0x7f5fac09f180 2023-09-30T22:22:20.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.757+0000 7f5f93fff700 1 -- 172.21.15.156:0/1128687825 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa00070d0 con 0x7f5fac09f180 2023-09-30T22:22:20.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.757+0000 7f5f93fff700 1 -- 172.21.15.156:0/1128687825 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa0007460 con 0x7f5fac09f180 2023-09-30T22:22:20.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.757+0000 7f5fb1f1b700 1 -- 172.21.15.156:0/1128687825 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa4009a70 con 0x7f5fac09f180 2023-09-30T22:22:20.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.757+0000 7f5fb1f1b700 1 -- 172.21.15.156:0/1128687825 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fac09dba0 con 0x7f5fac09f180 2023-09-30T22:22:20.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.759+0000 7f5fb1f1b700 1 -- 172.21.15.156:0/1128687825 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fac11f3c0 con 0x7f5fac09f180 2023-09-30T22:22:20.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.759+0000 7f5f93fff700 1 -- 172.21.15.156:0/1128687825 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5fa00075c0 con 0x7f5fac09f180 2023-09-30T22:22:20.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.759+0000 7f5f93fff700 1 -- 172.21.15.156:0/1128687825 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5fa0010d50 con 0x7f5fac09f180 2023-09-30T22:22:20.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.768+0000 7f5f93fff700 1 -- 172.21.15.156:0/1128687825 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5fac11f3c0 con 0x7f5fac09f180 2023-09-30T22:22:20.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.792+0000 7fa555c1b700 1 -- 172.21.15.156:0/3039543082 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa55009d820 con 0x7fa550131d50 2023-09-30T22:22:20.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.793+0000 7fa537fff700 1 -- 172.21.15.156:0/3039543082 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa548020020 con 0x7fa550131d50 2023-09-30T22:22:20.793 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:20.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.795+0000 7fa555c1b700 1 -- 172.21.15.156:0/3039543082 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa550131d50 msgr2=0x7fa55011c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.795+0000 7fa555c1b700 1 --2- 172.21.15.156:0/3039543082 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa550131d50 0x7fa55011c810 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa54800ebc0 tx=0x7fa54800eed0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.795+0000 7fa555c1b700 1 -- 172.21.15.156:0/3039543082 shutdown_connections 2023-09-30T22:22:20.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.795+0000 7fa555c1b700 1 --2- 172.21.15.156:0/3039543082 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa550131d50 0x7fa55011c810 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.795+0000 7fa555c1b700 1 --2- 172.21.15.156:0/3039543082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa55009e870 0x7fa55011bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.795+0000 7fa555c1b700 1 --2- 172.21.15.156:0/3039543082 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa55009f180 0x7fa55011c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.795+0000 7fa555c1b700 1 -- 172.21.15.156:0/3039543082 >> 172.21.15.156:0/3039543082 conn(0x7fa5500a4150 msgr2=0x7fa550130e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:20.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.795+0000 7fa555c1b700 1 -- 172.21.15.156:0/3039543082 shutdown_connections 2023-09-30T22:22:20.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.795+0000 7fa555c1b700 1 -- 172.21.15.156:0/3039543082 wait complete. 2023-09-30T22:22:20.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:20.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.909+0000 7f16b07ca700 1 -- 172.21.15.156:0/2650380251 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f16a8125ce0 con 0x7f16a809f180 2023-09-30T22:22:20.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.909+0000 7f169effd700 1 -- 172.21.15.156:0/2650380251 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f16a8125ce0 con 0x7f16a809f180 2023-09-30T22:22:20.910 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:20.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.911+0000 7f16b07ca700 1 -- 172.21.15.156:0/2650380251 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f16a809f180 msgr2=0x7f16a8122d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.911+0000 7f16b07ca700 1 --2- 172.21.15.156:0/2650380251 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f16a809f180 0x7f16a8122d40 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f1698009bc0 tx=0x7f1698004750 comp rx=0 tx=0).stop 2023-09-30T22:22:20.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.911+0000 7f16b07ca700 1 -- 172.21.15.156:0/2650380251 shutdown_connections 2023-09-30T22:22:20.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.911+0000 7f16b07ca700 1 --2- 172.21.15.156:0/2650380251 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16a8131d70 0x7f16a8123280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.911+0000 7f16b07ca700 1 --2- 172.21.15.156:0/2650380251 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16a809e870 0x7f16a8122800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.911+0000 7f16b07ca700 1 --2- 172.21.15.156:0/2650380251 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f16a809f180 0x7f16a8122d40 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.911+0000 7f16b07ca700 1 -- 172.21.15.156:0/2650380251 >> 172.21.15.156:0/2650380251 conn(0x7f16a80a4430 msgr2=0x7f16a809cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:20.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.911+0000 7f16b07ca700 1 -- 172.21.15.156:0/2650380251 shutdown_connections 2023-09-30T22:22:20.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.911+0000 7f16b07ca700 1 -- 172.21.15.156:0/2650380251 wait complete. 2023-09-30T22:22:20.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:20.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.960+0000 7f5fb1f1b700 1 -- 172.21.15.156:0/1128687825 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5fac11f3c0 con 0x7f5fac09f180 2023-09-30T22:22:20.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.960+0000 7f5f93fff700 1 -- 172.21.15.156:0/1128687825 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5fac11f3c0 con 0x7f5fac09f180 2023-09-30T22:22:20.961 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:20.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.963+0000 7f5fb1f1b700 1 -- 172.21.15.156:0/1128687825 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5fac09f180 msgr2=0x7f5fac11bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.963+0000 7f5fb1f1b700 1 --2- 172.21.15.156:0/1128687825 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5fac09f180 0x7f5fac11bf30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000c700 tx=0x7f5fa000ca10 comp rx=0 tx=0).stop 2023-09-30T22:22:20.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.963+0000 7f5fb1f1b700 1 -- 172.21.15.156:0/1128687825 shutdown_connections 2023-09-30T22:22:20.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.963+0000 7f5fb1f1b700 1 --2- 172.21.15.156:0/1128687825 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5fac131f40 0x7f5fac11c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.963+0000 7f5fb1f1b700 1 --2- 172.21.15.156:0/1128687825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fac09e870 0x7f5fac12f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.963+0000 7f5fb1f1b700 1 --2- 172.21.15.156:0/1128687825 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5fac09f180 0x7f5fac11bf30 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.963+0000 7f5fb1f1b700 1 -- 172.21.15.156:0/1128687825 >> 172.21.15.156:0/1128687825 conn(0x7f5fac0a4430 msgr2=0x7f5fac130c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:20.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.963+0000 7f5fb1f1b700 1 -- 172.21.15.156:0/1128687825 shutdown_connections 2023-09-30T22:22:20.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:20.963+0000 7f5fb1f1b700 1 -- 172.21.15.156:0/1128687825 wait complete. 2023-09-30T22:22:20.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:21.091 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:21.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.213+0000 7f38fa151700 1 Processor -- start 2023-09-30T22:22:21.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.213+0000 7f38fa151700 1 -- start start 2023-09-30T22:22:21.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.213+0000 7f38fa151700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f38f409ad40 0x7f38f4133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:21.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.213+0000 7f38fa151700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38f41343d0 0x7f38f40a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:21.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.213+0000 7f38fa151700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f409b110 con 0x7f38f4133f70 2023-09-30T22:22:21.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.213+0000 7f38fa151700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f40a3b60 con 0x7f38f409ad40 2023-09-30T22:22:21.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.213+0000 7f38fa151700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38f4134850 con 0x7f38f41343d0 2023-09-30T22:22:21.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.214+0000 7f38f37fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f38f409ad40 0x7f38f4133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:21.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.214+0000 7f38f3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38f41343d0 0x7f38f40a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:21.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.214+0000 7f38f37fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f38f409ad40 0x7f38f4133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:43738/0 (socket says 172.21.15.156:43738) 2023-09-30T22:22:21.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.214+0000 7f38f2ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f38f4133f70 0x7f38f40a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48114/0 (socket says 172.21.15.156:48114) 2023-09-30T22:22:21.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.214+0000 7f38f37fe700 1 -- 172.21.15.156:0/3788732727 learned_addr learned my addr 172.21.15.156:0/3788732727 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:21.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.214+0000 7f38f3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38f41343d0 0x7f38f40a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39884/0 (socket says 172.21.15.156:39884) 2023-09-30T22:22:21.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.214+0000 7f38f37fe700 1 -- 172.21.15.156:0/3788732727 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38f41343d0 msgr2=0x7f38f40a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:21.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.214+0000 7f38f37fe700 1 --2- 172.21.15.156:0/3788732727 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38f41343d0 0x7f38f40a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:21.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.214+0000 7f38f37fe700 1 -- 172.21.15.156:0/3788732727 >> v1:172.21.15.156:6789/0 conn(0x7f38f4133f70 legacy=0x7f38f40a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:21.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.214+0000 7f38f37fe700 1 -- 172.21.15.156:0/3788732727 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f40a2fa0 con 0x7f38f409ad40 2023-09-30T22:22:21.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.214+0000 7f38f3fff700 1 --2- 172.21.15.156:0/3788732727 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38f41343d0 0x7f38f40a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:21.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.214+0000 7f38f27fc700 1 -- 172.21.15.156:0/3788732727 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674324448 0 0) 0x7f38f409b110 con 0x7f38f4133f70 2023-09-30T22:22:21.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.214+0000 7f38f37fe700 1 --2- 172.21.15.156:0/3788732727 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38f409ad40 0x7f38f4133a30 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f38e4009e50 tx=0x7f38e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18f4dcd283c7e799 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:21.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.214+0000 7f38f27fc700 1 -- 172.21.15.156:0/3788732727 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e400e070 con 0x7f38f409ad40 2023-09-30T22:22:21.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.214+0000 7f38f27fc700 1 -- 172.21.15.156:0/3788732727 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e400b910 con 0x7f38f409ad40 2023-09-30T22:22:21.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.214+0000 7f38f27fc700 1 -- 172.21.15.156:0/3788732727 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e400bcc0 con 0x7f38f409ad40 2023-09-30T22:22:21.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.215+0000 7f38fa151700 1 -- 172.21.15.156:0/3788732727 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38f409ad40 msgr2=0x7f38f4133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:21.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.215+0000 7f38fa151700 1 --2- 172.21.15.156:0/3788732727 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38f409ad40 0x7f38f4133a30 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f38e4009e50 tx=0x7f38e400b330 comp rx=0 tx=0).stop 2023-09-30T22:22:21.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.215+0000 7f38fa151700 1 -- 172.21.15.156:0/3788732727 shutdown_connections 2023-09-30T22:22:21.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.215+0000 7f38fa151700 1 --2- 172.21.15.156:0/3788732727 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38f409ad40 0x7f38f4133a30 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:21.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.215+0000 7f38fa151700 1 --2- 172.21.15.156:0/3788732727 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38f41343d0 0x7f38f40a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:21.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.215+0000 7f38fa151700 1 -- 172.21.15.156:0/3788732727 >> 172.21.15.156:0/3788732727 conn(0x7f38f4099c40 msgr2=0x7f38f406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:21.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.215+0000 7f38fa151700 1 -- 172.21.15.156:0/3788732727 shutdown_connections 2023-09-30T22:22:21.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.215+0000 7f38fa151700 1 -- 172.21.15.156:0/3788732727 wait complete. 2023-09-30T22:22:21.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.216+0000 7f38fa151700 1 Processor -- start 2023-09-30T22:22:21.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.216+0000 7f38fa151700 1 -- start start 2023-09-30T22:22:21.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.216+0000 7f38fa151700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38f409ad40 0x7f38f411f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:21.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.216+0000 7f38fa151700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38f4133f70 0x7f38f411fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:21.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.216+0000 7f38fa151700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38f41343d0 0x7f38f41c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:21.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.216+0000 7f38fa151700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f411f140 con 0x7f38f4133f70 2023-09-30T22:22:21.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.216+0000 7f38fa151700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f4133790 con 0x7f38f41343d0 2023-09-30T22:22:21.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.216+0000 7f38fa151700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38f4133550 con 0x7f38f409ad40 2023-09-30T22:22:21.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.216+0000 7f38f37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38f409ad40 0x7f38f411f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:21.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.216+0000 7f38f2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38f4133f70 0x7f38f411fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:21.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.216+0000 7f38f37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38f409ad40 0x7f38f411f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:39896/0 (socket says 172.21.15.156:39896) 2023-09-30T22:22:21.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.216+0000 7f38f37fe700 1 -- 172.21.15.156:0/1350522197 learned_addr learned my addr 172.21.15.156:0/1350522197 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:21.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.216+0000 7f38f3fff700 1 --2- 172.21.15.156:0/1350522197 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38f41343d0 0x7f38f41c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:21.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.217+0000 7f38f2ffd700 1 -- 172.21.15.156:0/1350522197 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38f409ad40 msgr2=0x7f38f411f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:21.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.217+0000 7f38f2ffd700 1 --2- 172.21.15.156:0/1350522197 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38f409ad40 0x7f38f411f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:21.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.217+0000 7f38f2ffd700 1 -- 172.21.15.156:0/1350522197 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38f41343d0 msgr2=0x7f38f41c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:21.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.217+0000 7f38f2ffd700 1 --2- 172.21.15.156:0/1350522197 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38f41343d0 0x7f38f41c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:21.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.217+0000 7f38f2ffd700 1 -- 172.21.15.156:0/1350522197 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ec0094a0 con 0x7f38f4133f70 2023-09-30T22:22:21.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.217+0000 7f38f2ffd700 1 --2- 172.21.15.156:0/1350522197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38f4133f70 0x7f38f411fa30 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f38dc00c470 tx=0x7f38dc00c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:21.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.217+0000 7f38ebfff700 1 -- 172.21.15.156:0/1350522197 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38dc004c80 con 0x7f38f4133f70 2023-09-30T22:22:21.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.217+0000 7f38ebfff700 1 -- 172.21.15.156:0/1350522197 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38dc004de0 con 0x7f38f4133f70 2023-09-30T22:22:21.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.217+0000 7f38ebfff700 1 -- 172.21.15.156:0/1350522197 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38dc007310 con 0x7f38f4133f70 2023-09-30T22:22:21.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.217+0000 7f38fa151700 1 -- 172.21.15.156:0/1350522197 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38e4009b30 con 0x7f38f4133f70 2023-09-30T22:22:21.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.217+0000 7f38fa151700 1 -- 172.21.15.156:0/1350522197 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f41207d0 con 0x7f38f4133f70 2023-09-30T22:22:21.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.218+0000 7f38ebfff700 1 -- 172.21.15.156:0/1350522197 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f38dc007470 con 0x7f38f4133f70 2023-09-30T22:22:21.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.218+0000 7f38fa151700 1 -- 172.21.15.156:0/1350522197 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f404f2a0 con 0x7f38f4133f70 2023-09-30T22:22:21.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.218+0000 7f38ebfff700 1 -- 172.21.15.156:0/1350522197 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f38dc03f2f0 con 0x7f38f4133f70 2023-09-30T22:22:21.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.223+0000 7f38ebfff700 1 -- 172.21.15.156:0/1350522197 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f38dc007720 con 0x7f38f4133f70 2023-09-30T22:22:21.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.403+0000 7f38fa151700 1 -- 172.21.15.156:0/1350522197 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f38f4120d50 con 0x7f38f4133f70 2023-09-30T22:22:21.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.403+0000 7f38ebfff700 1 -- 172.21.15.156:0/1350522197 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f38dc02c020 con 0x7f38f4133f70 2023-09-30T22:22:21.404 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:21.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.405+0000 7f38fa151700 1 -- 172.21.15.156:0/1350522197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38f4133f70 msgr2=0x7f38f411fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:21.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.405+0000 7f38fa151700 1 --2- 172.21.15.156:0/1350522197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38f4133f70 0x7f38f411fa30 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f38dc00c470 tx=0x7f38dc00c780 comp rx=0 tx=0).stop 2023-09-30T22:22:21.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.405+0000 7f38fa151700 1 -- 172.21.15.156:0/1350522197 shutdown_connections 2023-09-30T22:22:21.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.405+0000 7f38fa151700 1 --2- 172.21.15.156:0/1350522197 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38f41343d0 0x7f38f41c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:21.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.405+0000 7f38fa151700 1 --2- 172.21.15.156:0/1350522197 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38f409ad40 0x7f38f411f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:21.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.405+0000 7f38fa151700 1 --2- 172.21.15.156:0/1350522197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38f4133f70 0x7f38f411fa30 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:21.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.405+0000 7f38fa151700 1 -- 172.21.15.156:0/1350522197 >> 172.21.15.156:0/1350522197 conn(0x7f38f4099c40 msgr2=0x7f38f40a61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:21.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.405+0000 7f38fa151700 1 -- 172.21.15.156:0/1350522197 shutdown_connections 2023-09-30T22:22:21.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.405+0000 7f38fa151700 1 -- 172.21.15.156:0/1350522197 wait complete. 2023-09-30T22:22:21.418 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:21.809 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:21.926 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:21.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.934+0000 7f1b6201c700 1 Processor -- start 2023-09-30T22:22:21.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.934+0000 7f1b6201c700 1 -- start start 2023-09-30T22:22:21.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.934+0000 7f1b6201c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b5c136770 0x7f1b5c138b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:21.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.934+0000 7f1b6201c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1b5c139090 0x7f1b5c13b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:21.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.934+0000 7f1b6201c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b5c09fd90 con 0x7f1b5c12d210 2023-09-30T22:22:21.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.934+0000 7f1b6201c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b5c09f980 con 0x7f1b5c139090 2023-09-30T22:22:21.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.934+0000 7f1b6201c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c06f520 con 0x7f1b5c136770 2023-09-30T22:22:21.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.934+0000 7f1b5affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b5c136770 0x7f1b5c138b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:21.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.934+0000 7f1b5bfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1b5c139090 0x7f1b5c13b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:21.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.934+0000 7f1b5b7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f1b5c12d210 0x7f1b5c12d5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:56284/0 (socket says 172.21.15.156:56284) 2023-09-30T22:22:21.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.934+0000 7f1b5affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b5c136770 0x7f1b5c138b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33150/0 (socket says 172.21.15.156:33150) 2023-09-30T22:22:21.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.934+0000 7f1b5bfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1b5c139090 0x7f1b5c13b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59706/0 (socket says 172.21.15.156:59706) 2023-09-30T22:22:21.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.934+0000 7f1b5b7fe700 1 -- 172.21.15.156:0/1405439203 learned_addr learned my addr 172.21.15.156:0/1405439203 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:21.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.935+0000 7f1b5affd700 1 -- 172.21.15.156:0/1405439203 >> v2:172.21.15.156:3300/0 conn(0x7f1b5c139090 msgr2=0x7f1b5c13b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:21.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.935+0000 7f1b5affd700 1 --2- 172.21.15.156:0/1405439203 >> v2:172.21.15.156:3300/0 conn(0x7f1b5c139090 0x7f1b5c13b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:21.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.935+0000 7f1b5affd700 1 -- 172.21.15.156:0/1405439203 >> v1:172.21.15.156:6789/0 conn(0x7f1b5c12d210 legacy=0x7f1b5c12d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:21.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.935+0000 7f1b5affd700 1 -- 172.21.15.156:0/1405439203 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c06fbe0 con 0x7f1b5c136770 2023-09-30T22:22:21.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.935+0000 7f1b5bfff700 1 --2- 172.21.15.156:0/1405439203 >> v2:172.21.15.156:3300/0 conn(0x7f1b5c139090 0x7f1b5c13b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:21.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.935+0000 7f1b5affd700 1 --2- 172.21.15.156:0/1405439203 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b5c136770 0x7f1b5c138b50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1b50009840 tx=0x7f1b50009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ce522071aa60bf6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:21.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.935+0000 7f1b5a7fc700 1 -- 172.21.15.156:0/1405439203 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b50004230 con 0x7f1b5c136770 2023-09-30T22:22:21.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.935+0000 7f1b5a7fc700 1 -- 172.21.15.156:0/1405439203 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b50004390 con 0x7f1b5c136770 2023-09-30T22:22:21.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.935+0000 7f1b5a7fc700 1 -- 172.21.15.156:0/1405439203 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b500036a0 con 0x7f1b5c136770 2023-09-30T22:22:21.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.936+0000 7f1b6201c700 1 -- 172.21.15.156:0/1405439203 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b5c136770 msgr2=0x7f1b5c138b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:21.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.936+0000 7f1b6201c700 1 --2- 172.21.15.156:0/1405439203 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b5c136770 0x7f1b5c138b50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1b50009840 tx=0x7f1b50009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:21.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.936+0000 7f1b6201c700 1 -- 172.21.15.156:0/1405439203 shutdown_connections 2023-09-30T22:22:21.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.936+0000 7f1b6201c700 1 --2- 172.21.15.156:0/1405439203 >> v2:172.21.15.156:3300/0 conn(0x7f1b5c139090 0x7f1b5c13b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:21.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.936+0000 7f1b6201c700 1 --2- 172.21.15.156:0/1405439203 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b5c136770 0x7f1b5c138b50 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:21.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.936+0000 7f1b6201c700 1 -- 172.21.15.156:0/1405439203 >> 172.21.15.156:0/1405439203 conn(0x7f1b5c0a2810 msgr2=0x7f1b5c0a2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:21.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.936+0000 7f1b6201c700 1 -- 172.21.15.156:0/1405439203 shutdown_connections 2023-09-30T22:22:21.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.936+0000 7f1b6201c700 1 -- 172.21.15.156:0/1405439203 wait complete. 2023-09-30T22:22:21.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.937+0000 7f1b6201c700 1 Processor -- start 2023-09-30T22:22:21.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.937+0000 7f1b6201c700 1 -- start start 2023-09-30T22:22:21.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.937+0000 7f1b6201c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b5c12d210 0x7f1b5c1c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:21.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.937+0000 7f1b6201c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b5c136770 0x7f1b5c1c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:21.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.938+0000 7f1b6201c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b5c139090 0x7f1b5c1c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:21.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.938+0000 7f1b6201c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c11a4a0 con 0x7f1b5c12d210 2023-09-30T22:22:21.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.938+0000 7f1b6201c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c138c80 con 0x7f1b5c139090 2023-09-30T22:22:21.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.938+0000 7f1b6201c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c06f760 con 0x7f1b5c136770 2023-09-30T22:22:21.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.938+0000 7f1b5b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b5c12d210 0x7f1b5c1c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:21.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.938+0000 7f1b5bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b5c139090 0x7f1b5c1c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:21.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.938+0000 7f1b5b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b5c12d210 0x7f1b5c1c8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59708/0 (socket says 172.21.15.156:59708) 2023-09-30T22:22:21.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.938+0000 7f1b5affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b5c136770 0x7f1b5c1c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:21.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.938+0000 7f1b5b7fe700 1 -- 172.21.15.156:0/3151510471 learned_addr learned my addr 172.21.15.156:0/3151510471 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:21.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.938+0000 7f1b5b7fe700 1 -- 172.21.15.156:0/3151510471 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b5c136770 msgr2=0x7f1b5c1c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:21.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.938+0000 7f1b5b7fe700 1 --2- 172.21.15.156:0/3151510471 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b5c136770 0x7f1b5c1c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:21.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.938+0000 7f1b5b7fe700 1 -- 172.21.15.156:0/3151510471 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b5c139090 msgr2=0x7f1b5c1c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:21.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.938+0000 7f1b5b7fe700 1 --2- 172.21.15.156:0/3151510471 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b5c139090 0x7f1b5c1c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:21.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.938+0000 7f1b5b7fe700 1 -- 172.21.15.156:0/3151510471 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b54009a70 con 0x7f1b5c12d210 2023-09-30T22:22:21.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.938+0000 7f1b5affd700 1 --2- 172.21.15.156:0/3151510471 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b5c136770 0x7f1b5c1c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:21.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.938+0000 7f1b5bfff700 1 --2- 172.21.15.156:0/3151510471 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b5c139090 0x7f1b5c1c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:21.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.938+0000 7f1b5b7fe700 1 --2- 172.21.15.156:0/3151510471 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b5c12d210 0x7f1b5c1c8280 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c00c780 tx=0x7f1b4c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:21.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.938+0000 7f1b43fff700 1 -- 172.21.15.156:0/3151510471 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c004c80 con 0x7f1b5c12d210 2023-09-30T22:22:21.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.938+0000 7f1b43fff700 1 -- 172.21.15.156:0/3151510471 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4c004de0 con 0x7f1b5c12d210 2023-09-30T22:22:21.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.938+0000 7f1b6201c700 1 -- 172.21.15.156:0/3151510471 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b500094a0 con 0x7f1b5c12d210 2023-09-30T22:22:21.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.938+0000 7f1b43fff700 1 -- 172.21.15.156:0/3151510471 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c007310 con 0x7f1b5c12d210 2023-09-30T22:22:21.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.938+0000 7f1b6201c700 1 -- 172.21.15.156:0/3151510471 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b5c119240 con 0x7f1b5c12d210 2023-09-30T22:22:21.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.939+0000 7f1b43fff700 1 -- 172.21.15.156:0/3151510471 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1b4c007470 con 0x7f1b5c12d210 2023-09-30T22:22:21.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.939+0000 7f1b6201c700 1 -- 172.21.15.156:0/3151510471 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b5c130be0 con 0x7f1b5c12d210 2023-09-30T22:22:21.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.940+0000 7f1b43fff700 1 -- 172.21.15.156:0/3151510471 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1b4c03e720 con 0x7f1b5c12d210 2023-09-30T22:22:21.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:21.944+0000 7f1b43fff700 1 -- 172.21.15.156:0/3151510471 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1b4c007720 con 0x7f1b5c12d210 2023-09-30T22:22:21.976 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:22.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.054+0000 7effcabc9700 1 Processor -- start 2023-09-30T22:22:22.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.054+0000 7effcabc9700 1 -- start start 2023-09-30T22:22:22.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.055+0000 7effcabc9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7effc40a0a70 0x7effc40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.055+0000 7effcabc9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7effc40a1380 0x7effc4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.055+0000 7effcabc9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc409dc00 con 0x7effc4133f50 2023-09-30T22:22:22.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.055+0000 7effcabc9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc409ea60 con 0x7effc40a0a70 2023-09-30T22:22:22.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.055+0000 7effcabc9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effc409dec0 con 0x7effc40a1380 2023-09-30T22:22:22.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.055+0000 7effc8965700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7effc40a0a70 0x7effc40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.055+0000 7effc8965700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7effc40a0a70 0x7effc40a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59718/0 (socket says 172.21.15.156:59718) 2023-09-30T22:22:22.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.055+0000 7effc8965700 1 -- 172.21.15.156:0/127492960 learned_addr learned my addr 172.21.15.156:0/127492960 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:22.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.055+0000 7effc9166700 1 --1- 172.21.15.156:0/127492960 >> v1:172.21.15.156:6789/0 conn(0x7effc4133f50 0x7effc413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:56296/0 (socket says 172.21.15.156:56296) 2023-09-30T22:22:22.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.055+0000 7effc3fff700 1 --2- 172.21.15.156:0/127492960 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7effc40a1380 0x7effc4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.055+0000 7effc8965700 1 -- 172.21.15.156:0/127492960 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7effc40a1380 msgr2=0x7effc4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:22.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.055+0000 7effc8965700 1 --2- 172.21.15.156:0/127492960 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7effc40a1380 0x7effc4133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.055+0000 7effc8965700 1 -- 172.21.15.156:0/127492960 >> v1:172.21.15.156:6789/0 conn(0x7effc4133f50 legacy=0x7effc413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.055+0000 7effc8965700 1 -- 172.21.15.156:0/127492960 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc409e6a0 con 0x7effc40a0a70 2023-09-30T22:22:22.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.055+0000 7effc8965700 1 --2- 172.21.15.156:0/127492960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effc40a0a70 0x7effc40a0e40 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7effb80098f0 tx=0x7effb8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=416a9b57764fb5d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:22.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.056+0000 7effc37fe700 1 -- 172.21.15.156:0/127492960 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb8004230 con 0x7effc40a0a70 2023-09-30T22:22:22.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.056+0000 7effc37fe700 1 -- 172.21.15.156:0/127492960 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb8004390 con 0x7effc40a0a70 2023-09-30T22:22:22.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.056+0000 7effc37fe700 1 -- 172.21.15.156:0/127492960 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb80036a0 con 0x7effc40a0a70 2023-09-30T22:22:22.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.056+0000 7effcabc9700 1 -- 172.21.15.156:0/127492960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effc40a0a70 msgr2=0x7effc40a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.056+0000 7effcabc9700 1 --2- 172.21.15.156:0/127492960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effc40a0a70 0x7effc40a0e40 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7effb80098f0 tx=0x7effb8009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:22.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.056+0000 7effcabc9700 1 -- 172.21.15.156:0/127492960 shutdown_connections 2023-09-30T22:22:22.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.056+0000 7effcabc9700 1 --2- 172.21.15.156:0/127492960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effc40a0a70 0x7effc40a0e40 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.056+0000 7effcabc9700 1 --2- 172.21.15.156:0/127492960 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7effc40a1380 0x7effc4133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.056+0000 7effcabc9700 1 -- 172.21.15.156:0/127492960 >> 172.21.15.156:0/127492960 conn(0x7effc40a6610 msgr2=0x7effc40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:22.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.056+0000 7effcabc9700 1 -- 172.21.15.156:0/127492960 shutdown_connections 2023-09-30T22:22:22.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.056+0000 7effcabc9700 1 -- 172.21.15.156:0/127492960 wait complete. 2023-09-30T22:22:22.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.057+0000 7effcabc9700 1 Processor -- start 2023-09-30T22:22:22.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.057+0000 7effcabc9700 1 -- start start 2023-09-30T22:22:22.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.058+0000 7effcabc9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7effc40a0a70 0x7effc41234a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.058+0000 7effcabc9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effc40a1380 0x7effc41239e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.058+0000 7effcabc9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7effc4133f50 0x7effc41c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.058+0000 7effcabc9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc4126480 con 0x7effc40a1380 2023-09-30T22:22:22.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.058+0000 7effcabc9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc4126660 con 0x7effc4133f50 2023-09-30T22:22:22.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.058+0000 7effcabc9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effc4133aa0 con 0x7effc40a0a70 2023-09-30T22:22:22.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.058+0000 7effc8965700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7effc40a0a70 0x7effc41234a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.058+0000 7effc8965700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7effc40a0a70 0x7effc41234a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51146/0 (socket says 172.21.15.156:51146) 2023-09-30T22:22:22.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.058+0000 7effc8965700 1 -- 172.21.15.156:0/1159477904 learned_addr learned my addr 172.21.15.156:0/1159477904 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:22.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.058+0000 7effc3fff700 1 --2- 172.21.15.156:0/1159477904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effc40a1380 0x7effc41239e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.058+0000 7effc9166700 1 --2- 172.21.15.156:0/1159477904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7effc4133f50 0x7effc41c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.058+0000 7effc8965700 1 -- 172.21.15.156:0/1159477904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7effc4133f50 msgr2=0x7effc41c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.058+0000 7effc8965700 1 --2- 172.21.15.156:0/1159477904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7effc4133f50 0x7effc41c82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.058+0000 7effc8965700 1 -- 172.21.15.156:0/1159477904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effc40a1380 msgr2=0x7effc41239e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.058+0000 7effc8965700 1 --2- 172.21.15.156:0/1159477904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effc40a1380 0x7effc41239e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.058+0000 7effc8965700 1 -- 172.21.15.156:0/1159477904 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb8009550 con 0x7effc40a0a70 2023-09-30T22:22:22.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.058+0000 7effc3fff700 1 --2- 172.21.15.156:0/1159477904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effc40a1380 0x7effc41239e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:22.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.059+0000 7effc8965700 1 --2- 172.21.15.156:0/1159477904 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7effc40a0a70 0x7effc41234a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7effb8009130 tx=0x7effb8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:22.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.059+0000 7effc17fa700 1 -- 172.21.15.156:0/1159477904 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb80045d0 con 0x7effc40a0a70 2023-09-30T22:22:22.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.059+0000 7effc17fa700 1 -- 172.21.15.156:0/1159477904 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb8011630 con 0x7effc40a0a70 2023-09-30T22:22:22.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.059+0000 7effcabc9700 1 -- 172.21.15.156:0/1159477904 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc4123090 con 0x7effc40a0a70 2023-09-30T22:22:22.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.059+0000 7effc17fa700 1 -- 172.21.15.156:0/1159477904 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb80119e0 con 0x7effc40a0a70 2023-09-30T22:22:22.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.059+0000 7effcabc9700 1 -- 172.21.15.156:0/1159477904 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc4124750 con 0x7effc40a0a70 2023-09-30T22:22:22.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.060+0000 7effcabc9700 1 -- 172.21.15.156:0/1159477904 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc404f2a0 con 0x7effc40a0a70 2023-09-30T22:22:22.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.060+0000 7effc17fa700 1 -- 172.21.15.156:0/1159477904 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7effb8022070 con 0x7effc40a0a70 2023-09-30T22:22:22.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.061+0000 7effc17fa700 1 -- 172.21.15.156:0/1159477904 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7effb8041360 con 0x7effc40a0a70 2023-09-30T22:22:22.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.065+0000 7effc17fa700 1 -- 172.21.15.156:0/1159477904 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7effb8010380 con 0x7effc40a0a70 2023-09-30T22:22:22.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.102+0000 7fa2ba2d2700 1 Processor -- start 2023-09-30T22:22:22.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.102+0000 7fa2ba2d2700 1 -- start start 2023-09-30T22:22:22.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.102+0000 7fa2ba2d2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2b40a0a70 0x7fa2b40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.102+0000 7fa2ba2d2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2b4134120 0x7fa2b413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.102+0000 7fa2ba2d2700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2b409dc00 con 0x7fa2b40a1380 2023-09-30T22:22:22.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.102+0000 7fa2ba2d2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b409ea90 con 0x7fa2b40a0a70 2023-09-30T22:22:22.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.102+0000 7fa2ba2d2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b409dec0 con 0x7fa2b4134120 2023-09-30T22:22:22.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.102+0000 7fa2b886f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2b4134120 0x7fa2b413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.102+0000 7fa2b37fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fa2b40a1380 0x7fa2b4133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:56300/0 (socket says 172.21.15.156:56300) 2023-09-30T22:22:22.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.102+0000 7fa2b886f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2b4134120 0x7fa2b413bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51156/0 (socket says 172.21.15.156:51156) 2023-09-30T22:22:22.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.102+0000 7fa2b37fe700 1 -- 172.21.15.156:0/2419924488 learned_addr learned my addr 172.21.15.156:0/2419924488 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:22.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.102+0000 7fa2b3fff700 1 --2- 172.21.15.156:0/2419924488 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2b40a0a70 0x7fa2b40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.103+0000 7fa2b886f700 1 -- 172.21.15.156:0/2419924488 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2b40a0a70 msgr2=0x7fa2b40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:22.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.103+0000 7fa2b886f700 1 --2- 172.21.15.156:0/2419924488 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2b40a0a70 0x7fa2b40a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.103+0000 7fa2b886f700 1 -- 172.21.15.156:0/2419924488 >> v1:172.21.15.156:6789/0 conn(0x7fa2b40a1380 legacy=0x7fa2b4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.103+0000 7fa2b886f700 1 -- 172.21.15.156:0/2419924488 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b409e6a0 con 0x7fa2b4134120 2023-09-30T22:22:22.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.103+0000 7fa2b886f700 1 --2- 172.21.15.156:0/2419924488 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2b4134120 0x7fa2b413bce0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac009dc0 tx=0x7fa2ac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66a6da538df5882d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:22.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.103+0000 7fa2b2ffd700 1 -- 172.21.15.156:0/2419924488 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac00e070 con 0x7fa2b4134120 2023-09-30T22:22:22.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.103+0000 7fa2b2ffd700 1 -- 172.21.15.156:0/2419924488 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ac003a20 con 0x7fa2b4134120 2023-09-30T22:22:22.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.103+0000 7fa2b2ffd700 1 -- 172.21.15.156:0/2419924488 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac003dd0 con 0x7fa2b4134120 2023-09-30T22:22:22.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.104+0000 7fa2ba2d2700 1 -- 172.21.15.156:0/2419924488 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2b4134120 msgr2=0x7fa2b413bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.104+0000 7fa2ba2d2700 1 --2- 172.21.15.156:0/2419924488 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2b4134120 0x7fa2b413bce0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac009dc0 tx=0x7fa2ac00b330 comp rx=0 tx=0).stop 2023-09-30T22:22:22.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.104+0000 7fa2ba2d2700 1 -- 172.21.15.156:0/2419924488 shutdown_connections 2023-09-30T22:22:22.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.104+0000 7fa2ba2d2700 1 --2- 172.21.15.156:0/2419924488 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2b40a0a70 0x7fa2b40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.104+0000 7fa2ba2d2700 1 --2- 172.21.15.156:0/2419924488 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2b4134120 0x7fa2b413bce0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.104+0000 7fa2ba2d2700 1 -- 172.21.15.156:0/2419924488 >> 172.21.15.156:0/2419924488 conn(0x7fa2b40a6610 msgr2=0x7fa2b40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:22.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.104+0000 7fa2ba2d2700 1 -- 172.21.15.156:0/2419924488 shutdown_connections 2023-09-30T22:22:22.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.104+0000 7fa2ba2d2700 1 -- 172.21.15.156:0/2419924488 wait complete. 2023-09-30T22:22:22.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.105+0000 7fa2ba2d2700 1 Processor -- start 2023-09-30T22:22:22.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.105+0000 7fa2ba2d2700 1 -- start start 2023-09-30T22:22:22.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.105+0000 7fa2ba2d2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2b40a0a70 0x7fa2b41228f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.106+0000 7fa2ba2d2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2b40a1380 0x7fa2b4122e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.106+0000 7fa2ba2d2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2b4134120 0x7fa2b4123370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.106+0000 7fa2ba2d2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b4133ad0 con 0x7fa2b40a1380 2023-09-30T22:22:22.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.106+0000 7fa2ba2d2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b4125de0 con 0x7fa2b40a0a70 2023-09-30T22:22:22.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.106+0000 7fa2ba2d2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b4124510 con 0x7fa2b4134120 2023-09-30T22:22:22.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.106+0000 7fa2b3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2b40a0a70 0x7fa2b41228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.106+0000 7fa2b3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2b40a0a70 0x7fa2b41228f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33188/0 (socket says 172.21.15.156:33188) 2023-09-30T22:22:22.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.106+0000 7fa2b3fff700 1 -- 172.21.15.156:0/4100102246 learned_addr learned my addr 172.21.15.156:0/4100102246 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:22.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.106+0000 7fa2b37fe700 1 --2- 172.21.15.156:0/4100102246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2b40a1380 0x7fa2b4122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.106+0000 7fa2b886f700 1 --2- 172.21.15.156:0/4100102246 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2b4134120 0x7fa2b4123370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.106+0000 7fa2b3fff700 1 -- 172.21.15.156:0/4100102246 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2b4134120 msgr2=0x7fa2b4123370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.106+0000 7fa2b3fff700 1 --2- 172.21.15.156:0/4100102246 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2b4134120 0x7fa2b4123370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.106+0000 7fa2b3fff700 1 -- 172.21.15.156:0/4100102246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2b40a1380 msgr2=0x7fa2b4122e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.106+0000 7fa2b3fff700 1 --2- 172.21.15.156:0/4100102246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2b40a1380 0x7fa2b4122e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.106+0000 7fa2b3fff700 1 -- 172.21.15.156:0/4100102246 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac009a70 con 0x7fa2b40a0a70 2023-09-30T22:22:22.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.106+0000 7fa2b3fff700 1 --2- 172.21.15.156:0/4100102246 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2b40a0a70 0x7fa2b41228f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa2a400e9e0 tx=0x7fa2a400ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:22.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.106+0000 7fa2b0ff9700 1 -- 172.21.15.156:0/4100102246 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4009710 con 0x7fa2b40a0a70 2023-09-30T22:22:22.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.106+0000 7fa2b0ff9700 1 -- 172.21.15.156:0/4100102246 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a400ee80 con 0x7fa2b40a0a70 2023-09-30T22:22:22.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.106+0000 7fa2b0ff9700 1 -- 172.21.15.156:0/4100102246 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a400ca50 con 0x7fa2b40a0a70 2023-09-30T22:22:22.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.106+0000 7fa2ba2d2700 1 -- 172.21.15.156:0/4100102246 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b4126100 con 0x7fa2b40a0a70 2023-09-30T22:22:22.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.107+0000 7fa2ba2d2700 1 -- 172.21.15.156:0/4100102246 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b4126380 con 0x7fa2b40a0a70 2023-09-30T22:22:22.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.107+0000 7fa2b0ff9700 1 -- 172.21.15.156:0/4100102246 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa2a400cbb0 con 0x7fa2b40a0a70 2023-09-30T22:22:22.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.108+0000 7fa2ba2d2700 1 -- 172.21.15.156:0/4100102246 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b404f2a0 con 0x7fa2b40a0a70 2023-09-30T22:22:22.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.108+0000 7fa2b0ff9700 1 -- 172.21.15.156:0/4100102246 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa2a403f6d0 con 0x7fa2b40a0a70 2023-09-30T22:22:22.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.116+0000 7fa2b0ff9700 1 -- 172.21.15.156:0/4100102246 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa2a40232f0 con 0x7fa2b40a0a70 2023-09-30T22:22:22.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.153+0000 7f1b6201c700 1 -- 172.21.15.156:0/3151510471 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1b5c11a2a0 con 0x7f1b5c12d210 2023-09-30T22:22:22.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.154+0000 7f1b43fff700 1 -- 172.21.15.156:0/3151510471 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1b4c018020 con 0x7f1b5c12d210 2023-09-30T22:22:22.155 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:22.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.156+0000 7f1b6201c700 1 -- 172.21.15.156:0/3151510471 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b5c12d210 msgr2=0x7f1b5c1c8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.156+0000 7f1b6201c700 1 --2- 172.21.15.156:0/3151510471 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b5c12d210 0x7f1b5c1c8280 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c00c780 tx=0x7f1b4c00ca90 comp rx=0 tx=0).stop 2023-09-30T22:22:22.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.156+0000 7f1b6201c700 1 -- 172.21.15.156:0/3151510471 shutdown_connections 2023-09-30T22:22:22.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.156+0000 7f1b6201c700 1 --2- 172.21.15.156:0/3151510471 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b5c139090 0x7f1b5c1c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.156+0000 7f1b6201c700 1 --2- 172.21.15.156:0/3151510471 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b5c12d210 0x7f1b5c1c8280 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.156+0000 7f1b6201c700 1 --2- 172.21.15.156:0/3151510471 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b5c136770 0x7f1b5c1c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.156+0000 7f1b6201c700 1 -- 172.21.15.156:0/3151510471 >> 172.21.15.156:0/3151510471 conn(0x7f1b5c0a2810 msgr2=0x7f1b5c070d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:22.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.156+0000 7f1b6201c700 1 -- 172.21.15.156:0/3151510471 shutdown_connections 2023-09-30T22:22:22.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.156+0000 7f1b6201c700 1 -- 172.21.15.156:0/3151510471 wait complete. 2023-09-30T22:22:22.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:22.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.260+0000 7effcabc9700 1 -- 172.21.15.156:0/1159477904 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7effc4072980 con 0x7effc40a0a70 2023-09-30T22:22:22.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.260+0000 7effc17fa700 1 -- 172.21.15.156:0/1159477904 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7effb8033020 con 0x7effc40a0a70 2023-09-30T22:22:22.261 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:22.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.262+0000 7effcabc9700 1 -- 172.21.15.156:0/1159477904 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7effc40a0a70 msgr2=0x7effc41234a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.262+0000 7effcabc9700 1 --2- 172.21.15.156:0/1159477904 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7effc40a0a70 0x7effc41234a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7effb8009130 tx=0x7effb8004750 comp rx=0 tx=0).stop 2023-09-30T22:22:22.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.262+0000 7effcabc9700 1 -- 172.21.15.156:0/1159477904 shutdown_connections 2023-09-30T22:22:22.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.262+0000 7effcabc9700 1 --2- 172.21.15.156:0/1159477904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7effc4133f50 0x7effc41c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.262+0000 7effcabc9700 1 --2- 172.21.15.156:0/1159477904 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7effc40a0a70 0x7effc41234a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.262+0000 7effcabc9700 1 --2- 172.21.15.156:0/1159477904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effc40a1380 0x7effc41239e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.262+0000 7effcabc9700 1 -- 172.21.15.156:0/1159477904 >> 172.21.15.156:0/1159477904 conn(0x7effc40a6610 msgr2=0x7effc40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:22.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.262+0000 7effcabc9700 1 -- 172.21.15.156:0/1159477904 shutdown_connections 2023-09-30T22:22:22.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.262+0000 7effcabc9700 1 -- 172.21.15.156:0/1159477904 wait complete. 2023-09-30T22:22:22.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:22.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.310+0000 7fa2ba2d2700 1 -- 172.21.15.156:0/4100102246 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa2b40a0440 con 0x7fa2b40a0a70 2023-09-30T22:22:22.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.311+0000 7fa2b0ff9700 1 -- 172.21.15.156:0/4100102246 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa2a4021030 con 0x7fa2b40a0a70 2023-09-30T22:22:22.312 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:22.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.313+0000 7fa2ba2d2700 1 -- 172.21.15.156:0/4100102246 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2b40a0a70 msgr2=0x7fa2b41228f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.313+0000 7fa2ba2d2700 1 --2- 172.21.15.156:0/4100102246 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2b40a0a70 0x7fa2b41228f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa2a400e9e0 tx=0x7fa2a400ecf0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.313+0000 7fa2ba2d2700 1 -- 172.21.15.156:0/4100102246 shutdown_connections 2023-09-30T22:22:22.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.313+0000 7fa2ba2d2700 1 --2- 172.21.15.156:0/4100102246 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2b4134120 0x7fa2b4123370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.313+0000 7fa2ba2d2700 1 --2- 172.21.15.156:0/4100102246 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2b40a0a70 0x7fa2b41228f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.313+0000 7fa2ba2d2700 1 --2- 172.21.15.156:0/4100102246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2b40a1380 0x7fa2b4122e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.313+0000 7fa2ba2d2700 1 -- 172.21.15.156:0/4100102246 >> 172.21.15.156:0/4100102246 conn(0x7fa2b40a6610 msgr2=0x7fa2b40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:22.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.313+0000 7fa2ba2d2700 1 -- 172.21.15.156:0/4100102246 shutdown_connections 2023-09-30T22:22:22.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.313+0000 7fa2ba2d2700 1 -- 172.21.15.156:0/4100102246 wait complete. 2023-09-30T22:22:22.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:22.419 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:22.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.541+0000 7f514e5ed700 1 Processor -- start 2023-09-30T22:22:22.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.541+0000 7f514e5ed700 1 -- start start 2023-09-30T22:22:22.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.542+0000 7f514e5ed700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f514809d860 0x7f514809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.542+0000 7f514e5ed700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5148130eb0 0x7f5148138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.542+0000 7f514e5ed700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514809aaa0 con 0x7f514809e170 2023-09-30T22:22:22.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.542+0000 7f514e5ed700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f514809f870 con 0x7f514809d860 2023-09-30T22:22:22.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.542+0000 7f514e5ed700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514809b360 con 0x7f5148130eb0 2023-09-30T22:22:22.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.542+0000 7f514cb8a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5148130eb0 0x7f5148138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.542+0000 7f5147fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f514809d860 0x7f514809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.542+0000 7f514cb8a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5148130eb0 0x7f5148138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33196/0 (socket says 172.21.15.156:33196) 2023-09-30T22:22:22.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.542+0000 7f514cb8a700 1 -- 172.21.15.156:0/681864250 learned_addr learned my addr 172.21.15.156:0/681864250 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:22.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.542+0000 7f5147fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f514809d860 0x7f514809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59742/0 (socket says 172.21.15.156:59742) 2023-09-30T22:22:22.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.542+0000 7f51477fe700 1 --1- 172.21.15.156:0/681864250 >> v1:172.21.15.156:6789/0 conn(0x7f514809e170 0x7f51481307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:56314/0 (socket says 172.21.15.156:56314) 2023-09-30T22:22:22.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.542+0000 7f5147fff700 1 -- 172.21.15.156:0/681864250 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5148130eb0 msgr2=0x7f5148138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:22.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.542+0000 7f5147fff700 1 --2- 172.21.15.156:0/681864250 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5148130eb0 0x7f5148138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.542+0000 7f5147fff700 1 -- 172.21.15.156:0/681864250 >> v1:172.21.15.156:6789/0 conn(0x7f514809e170 legacy=0x7f51481307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.542+0000 7f5147fff700 1 -- 172.21.15.156:0/681864250 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514809b620 con 0x7f514809d860 2023-09-30T22:22:22.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.542+0000 7f5146ffd700 1 -- 172.21.15.156:0/681864250 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1199456063 0 0) 0x7f514809aaa0 con 0x7f514809e170 2023-09-30T22:22:22.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.542+0000 7f514cb8a700 1 --2- 172.21.15.156:0/681864250 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5148130eb0 0x7f5148138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:22.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.542+0000 7f5147fff700 1 --2- 172.21.15.156:0/681864250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f514809d860 0x7f514809dc30 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f513c009840 tx=0x7f513c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e97a1762fabf41 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:22.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.542+0000 7f5146ffd700 1 -- 172.21.15.156:0/681864250 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c011830 con 0x7f514809d860 2023-09-30T22:22:22.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.543+0000 7f5146ffd700 1 -- 172.21.15.156:0/681864250 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c011990 con 0x7f514809d860 2023-09-30T22:22:22.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.543+0000 7f5146ffd700 1 -- 172.21.15.156:0/681864250 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c011d20 con 0x7f514809d860 2023-09-30T22:22:22.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.543+0000 7f514e5ed700 1 -- 172.21.15.156:0/681864250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f514809d860 msgr2=0x7f514809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.543+0000 7f514e5ed700 1 --2- 172.21.15.156:0/681864250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f514809d860 0x7f514809dc30 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f513c009840 tx=0x7f513c009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:22.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.543+0000 7f514e5ed700 1 -- 172.21.15.156:0/681864250 shutdown_connections 2023-09-30T22:22:22.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.543+0000 7f514e5ed700 1 --2- 172.21.15.156:0/681864250 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5148130eb0 0x7f5148138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.543+0000 7f514e5ed700 1 --2- 172.21.15.156:0/681864250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f514809d860 0x7f514809dc30 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.543+0000 7f514e5ed700 1 -- 172.21.15.156:0/681864250 >> 172.21.15.156:0/681864250 conn(0x7f5148099c40 msgr2=0x7f51480a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:22.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.543+0000 7f514e5ed700 1 -- 172.21.15.156:0/681864250 shutdown_connections 2023-09-30T22:22:22.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.543+0000 7f514e5ed700 1 -- 172.21.15.156:0/681864250 wait complete. 2023-09-30T22:22:22.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.544+0000 7f514e5ed700 1 Processor -- start 2023-09-30T22:22:22.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.544+0000 7f514e5ed700 1 -- start start 2023-09-30T22:22:22.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.545+0000 7f514e5ed700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f514809d860 0x7f514811e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.545+0000 7f514e5ed700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f514809e170 0x7f514811e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.545+0000 7f514e5ed700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5148130eb0 0x7f514811ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.545+0000 7f514e5ed700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5148121b20 con 0x7f5148130eb0 2023-09-30T22:22:22.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.545+0000 7f514e5ed700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51481207c0 con 0x7f514809e170 2023-09-30T22:22:22.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.545+0000 7f514e5ed700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5148072030 con 0x7f514809d860 2023-09-30T22:22:22.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.545+0000 7f514cb8a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5148130eb0 0x7f514811ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.545+0000 7f5147fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f514809d860 0x7f514811e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.545+0000 7f51477fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f514809e170 0x7f514811e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.545+0000 7f514cb8a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5148130eb0 0x7f514811ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59744/0 (socket says 172.21.15.156:59744) 2023-09-30T22:22:22.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.545+0000 7f514cb8a700 1 -- 172.21.15.156:0/1628805067 learned_addr learned my addr 172.21.15.156:0/1628805067 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:22.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.545+0000 7f5147fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f514809d860 0x7f514811e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51166/0 (socket says 172.21.15.156:51166) 2023-09-30T22:22:22.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.545+0000 7f5147fff700 1 -- 172.21.15.156:0/1628805067 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f514809e170 msgr2=0x7f514811e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.545+0000 7f5147fff700 1 --2- 172.21.15.156:0/1628805067 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f514809e170 0x7f514811e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.545+0000 7f5147fff700 1 -- 172.21.15.156:0/1628805067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5148130eb0 msgr2=0x7f514811ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.545+0000 7f5147fff700 1 --2- 172.21.15.156:0/1628805067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5148130eb0 0x7f514811ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.545+0000 7f5147fff700 1 -- 172.21.15.156:0/1628805067 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5140009b30 con 0x7f514809d860 2023-09-30T22:22:22.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.545+0000 7f514cb8a700 1 --2- 172.21.15.156:0/1628805067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5148130eb0 0x7f514811ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:22.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.545+0000 7f5147fff700 1 --2- 172.21.15.156:0/1628805067 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f514809d860 0x7f514811e380 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f514806d590 tx=0x7f513c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:22.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.545+0000 7f5144ff9700 1 -- 172.21.15.156:0/1628805067 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c0045d0 con 0x7f514809d860 2023-09-30T22:22:22.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.545+0000 7f5144ff9700 1 -- 172.21.15.156:0/1628805067 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c01f070 con 0x7f514809d860 2023-09-30T22:22:22.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.545+0000 7f514e5ed700 1 -- 172.21.15.156:0/1628805067 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f513c0094a0 con 0x7f514809d860 2023-09-30T22:22:22.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.545+0000 7f5144ff9700 1 -- 172.21.15.156:0/1628805067 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c0038e0 con 0x7f514809d860 2023-09-30T22:22:22.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.545+0000 7f514e5ed700 1 -- 172.21.15.156:0/1628805067 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5148121860 con 0x7f514809d860 2023-09-30T22:22:22.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.546+0000 7f5144ff9700 1 -- 172.21.15.156:0/1628805067 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f513c003a40 con 0x7f514809d860 2023-09-30T22:22:22.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.546+0000 7f5144ff9700 1 -- 172.21.15.156:0/1628805067 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f513c021070 con 0x7f514809d860 2023-09-30T22:22:22.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.546+0000 7f514e5ed700 1 -- 172.21.15.156:0/1628805067 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514804f2a0 con 0x7f514809d860 2023-09-30T22:22:22.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.551+0000 7f5144ff9700 1 -- 172.21.15.156:0/1628805067 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f513c02b080 con 0x7f514809d860 2023-09-30T22:22:22.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.738+0000 7f514e5ed700 1 -- 172.21.15.156:0/1628805067 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f514806c3b0 con 0x7f514809d860 2023-09-30T22:22:22.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.738+0000 7f5144ff9700 1 -- 172.21.15.156:0/1628805067 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f513c015070 con 0x7f514809d860 2023-09-30T22:22:22.739 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:22.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.740+0000 7f514e5ed700 1 -- 172.21.15.156:0/1628805067 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f514809d860 msgr2=0x7f514811e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.740+0000 7f514e5ed700 1 --2- 172.21.15.156:0/1628805067 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f514809d860 0x7f514811e380 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f514806d590 tx=0x7f513c004750 comp rx=0 tx=0).stop 2023-09-30T22:22:22.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.741+0000 7f514e5ed700 1 -- 172.21.15.156:0/1628805067 shutdown_connections 2023-09-30T22:22:22.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.741+0000 7f514e5ed700 1 --2- 172.21.15.156:0/1628805067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5148130eb0 0x7f514811ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.741+0000 7f514e5ed700 1 --2- 172.21.15.156:0/1628805067 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f514809d860 0x7f514811e380 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.741+0000 7f514e5ed700 1 --2- 172.21.15.156:0/1628805067 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f514809e170 0x7f514811e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.741+0000 7f514e5ed700 1 -- 172.21.15.156:0/1628805067 >> 172.21.15.156:0/1628805067 conn(0x7f5148099c40 msgr2=0x7f5148070de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:22.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.741+0000 7f514e5ed700 1 -- 172.21.15.156:0/1628805067 shutdown_connections 2023-09-30T22:22:22.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:22.741+0000 7f514e5ed700 1 -- 172.21.15.156:0/1628805067 wait complete. 2023-09-30T22:22:22.753 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:23.171 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:23.276 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:23.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.294+0000 7f7e6e2b5700 1 Processor -- start 2023-09-30T22:22:23.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.294+0000 7f7e6e2b5700 1 -- start start 2023-09-30T22:22:23.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.294+0000 7f7e6e2b5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7e6809d860 0x7f7e6809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:23.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.294+0000 7f7e6e2b5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e6809e170 0x7f7e681307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:23.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.294+0000 7f7e6e2b5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e68130ce0 0x7f7e68131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:23.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.294+0000 7f7e6e2b5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e68131670 con 0x7f7e6809d860 2023-09-30T22:22:23.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.294+0000 7f7e6e2b5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6809aaa0 con 0x7f7e68130ce0 2023-09-30T22:22:23.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.294+0000 7f7e6e2b5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6809f870 con 0x7f7e6809e170 2023-09-30T22:22:23.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.294+0000 7f7e67fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7e6809d860 0x7f7e6809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:23.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.294+0000 7f7e677fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e6809e170 0x7f7e681307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:23.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.294+0000 7f7e6c852700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e68130ce0 0x7f7e68131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:23.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.294+0000 7f7e67fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7e6809d860 0x7f7e6809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59746/0 (socket says 172.21.15.156:59746) 2023-09-30T22:22:23.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.294+0000 7f7e677fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e6809e170 0x7f7e681307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51170/0 (socket says 172.21.15.156:51170) 2023-09-30T22:22:23.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.294+0000 7f7e67fff700 1 -- 172.21.15.156:0/3108142949 learned_addr learned my addr 172.21.15.156:0/3108142949 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:23.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.295+0000 7f7e6c852700 1 -- 172.21.15.156:0/3108142949 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e6809e170 msgr2=0x7f7e681307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:23.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.295+0000 7f7e6c852700 1 --2- 172.21.15.156:0/3108142949 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e6809e170 0x7f7e681307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.295+0000 7f7e6c852700 1 -- 172.21.15.156:0/3108142949 >> v2:172.21.15.156:3300/0 conn(0x7f7e6809d860 msgr2=0x7f7e6809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:23.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.295+0000 7f7e6c852700 1 --2- 172.21.15.156:0/3108142949 >> v2:172.21.15.156:3300/0 conn(0x7f7e6809d860 0x7f7e6809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.295+0000 7f7e6c852700 1 -- 172.21.15.156:0/3108142949 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6809b360 con 0x7f7e68130ce0 2023-09-30T22:22:23.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.295+0000 7f7e67fff700 1 --2- 172.21.15.156:0/3108142949 >> v2:172.21.15.156:3300/0 conn(0x7f7e6809d860 0x7f7e6809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:23.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.295+0000 7f7e677fe700 1 --2- 172.21.15.156:0/3108142949 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e6809e170 0x7f7e681307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:23.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.295+0000 7f7e6c852700 1 --2- 172.21.15.156:0/3108142949 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e68130ce0 0x7f7e68131130 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7e60009d90 tx=0x7f7e6000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f89451d140c1ac2d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:23.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.295+0000 7f7e66ffd700 1 -- 172.21.15.156:0/3108142949 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6000e070 con 0x7f7e68130ce0 2023-09-30T22:22:23.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.295+0000 7f7e66ffd700 1 -- 172.21.15.156:0/3108142949 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6000bb20 con 0x7f7e68130ce0 2023-09-30T22:22:23.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.295+0000 7f7e66ffd700 1 -- 172.21.15.156:0/3108142949 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e60012430 con 0x7f7e68130ce0 2023-09-30T22:22:23.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.296+0000 7f7e6e2b5700 1 -- 172.21.15.156:0/3108142949 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e68130ce0 msgr2=0x7f7e68131130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:23.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.296+0000 7f7e6e2b5700 1 --2- 172.21.15.156:0/3108142949 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e68130ce0 0x7f7e68131130 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7e60009d90 tx=0x7f7e6000b330 comp rx=0 tx=0).stop 2023-09-30T22:22:23.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.296+0000 7f7e6e2b5700 1 -- 172.21.15.156:0/3108142949 shutdown_connections 2023-09-30T22:22:23.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.296+0000 7f7e6e2b5700 1 --2- 172.21.15.156:0/3108142949 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e68130ce0 0x7f7e68131130 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.296+0000 7f7e6e2b5700 1 --2- 172.21.15.156:0/3108142949 >> v2:172.21.15.156:3300/0 conn(0x7f7e6809d860 0x7f7e6809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.296+0000 7f7e6e2b5700 1 --2- 172.21.15.156:0/3108142949 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e6809e170 0x7f7e681307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.296+0000 7f7e6e2b5700 1 -- 172.21.15.156:0/3108142949 >> 172.21.15.156:0/3108142949 conn(0x7f7e68099c40 msgr2=0x7f7e680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:23.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.296+0000 7f7e6e2b5700 1 -- 172.21.15.156:0/3108142949 shutdown_connections 2023-09-30T22:22:23.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.296+0000 7f7e6e2b5700 1 -- 172.21.15.156:0/3108142949 wait complete. 2023-09-30T22:22:23.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.297+0000 7f7e6e2b5700 1 Processor -- start 2023-09-30T22:22:23.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.297+0000 7f7e6e2b5700 1 -- start start 2023-09-30T22:22:23.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.297+0000 7f7e6e2b5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e6809d860 0x7f7e6811c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:23.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.297+0000 7f7e6e2b5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e6809e170 0x7f7e6811c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:23.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.297+0000 7f7e6e2b5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e68130ce0 0x7f7e6811cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:23.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.297+0000 7f7e6e2b5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6811f650 con 0x7f7e6809d860 2023-09-30T22:22:23.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.297+0000 7f7e6e2b5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6811f2a0 con 0x7f7e68130ce0 2023-09-30T22:22:23.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.297+0000 7f7e6e2b5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6811e1b0 con 0x7f7e6809e170 2023-09-30T22:22:23.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.297+0000 7f7e67fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e6809d860 0x7f7e6811c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:23.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.297+0000 7f7e67fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e6809d860 0x7f7e6811c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59748/0 (socket says 172.21.15.156:59748) 2023-09-30T22:22:23.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.297+0000 7f7e67fff700 1 -- 172.21.15.156:0/1484925046 learned_addr learned my addr 172.21.15.156:0/1484925046 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:23.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.297+0000 7f7e677fe700 1 --2- 172.21.15.156:0/1484925046 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e6809e170 0x7f7e6811c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:23.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.297+0000 7f7e6c852700 1 --2- 172.21.15.156:0/1484925046 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e68130ce0 0x7f7e6811cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:23.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.298+0000 7f7e677fe700 1 -- 172.21.15.156:0/1484925046 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e68130ce0 msgr2=0x7f7e6811cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:23.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.298+0000 7f7e677fe700 1 --2- 172.21.15.156:0/1484925046 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e68130ce0 0x7f7e6811cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.298+0000 7f7e677fe700 1 -- 172.21.15.156:0/1484925046 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e6809d860 msgr2=0x7f7e6811c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:23.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.298+0000 7f7e677fe700 1 --2- 172.21.15.156:0/1484925046 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e6809d860 0x7f7e6811c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.298+0000 7f7e677fe700 1 -- 172.21.15.156:0/1484925046 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e58009550 con 0x7f7e6809e170 2023-09-30T22:22:23.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.298+0000 7f7e67fff700 1 --2- 172.21.15.156:0/1484925046 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e6809d860 0x7f7e6811c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:23.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.298+0000 7f7e6c852700 1 --2- 172.21.15.156:0/1484925046 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e68130ce0 0x7f7e6811cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:23.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.298+0000 7f7e677fe700 1 --2- 172.21.15.156:0/1484925046 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e6809e170 0x7f7e6811c5f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c010f40 tx=0x7f7e5c00e640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:23.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.298+0000 7f7e64ff9700 1 -- 172.21.15.156:0/1484925046 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c011450 con 0x7f7e6809e170 2023-09-30T22:22:23.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.298+0000 7f7e64ff9700 1 -- 172.21.15.156:0/1484925046 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c0115b0 con 0x7f7e6809e170 2023-09-30T22:22:23.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.298+0000 7f7e6e2b5700 1 -- 172.21.15.156:0/1484925046 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e5c00b740 con 0x7f7e6809e170 2023-09-30T22:22:23.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.298+0000 7f7e64ff9700 1 -- 172.21.15.156:0/1484925046 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c011960 con 0x7f7e6809e170 2023-09-30T22:22:23.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.298+0000 7f7e6e2b5700 1 -- 172.21.15.156:0/1484925046 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e60009a70 con 0x7f7e6809e170 2023-09-30T22:22:23.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.299+0000 7f7e64ff9700 1 -- 172.21.15.156:0/1484925046 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e5c011ac0 con 0x7f7e6809e170 2023-09-30T22:22:23.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.299+0000 7f7e64ff9700 1 -- 172.21.15.156:0/1484925046 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7e5c0422c0 con 0x7f7e6809e170 2023-09-30T22:22:23.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.299+0000 7f7e6e2b5700 1 -- 172.21.15.156:0/1484925046 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e6804f2a0 con 0x7f7e6809e170 2023-09-30T22:22:23.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.304+0000 7f7e64ff9700 1 -- 172.21.15.156:0/1484925046 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e5c01e020 con 0x7f7e6809e170 2023-09-30T22:22:23.326 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:23.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.403+0000 7ff5a0912700 1 Processor -- start 2023-09-30T22:22:23.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.403+0000 7ff5a0912700 1 -- start start 2023-09-30T22:22:23.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.404+0000 7ff5a0912700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff59c133ad0 0x7ff59c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:23.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.404+0000 7ff5a0912700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff59c1300a0 0x7ff59c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:23.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.404+0000 7ff5a0912700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff59c06b2d0 con 0x7ff59c1309f0 2023-09-30T22:22:23.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.404+0000 7ff5a0912700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c133610 con 0x7ff59c133ad0 2023-09-30T22:22:23.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.404+0000 7ff5a0912700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c09a500 con 0x7ff59c1300a0 2023-09-30T22:22:23.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.404+0000 7ff599d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff59c1300a0 0x7ff59c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:23.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.404+0000 7ff59a59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff59c133ad0 0x7ff59c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:23.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.404+0000 7ff599d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff59c1300a0 0x7ff59c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51186/0 (socket says 172.21.15.156:51186) 2023-09-30T22:22:23.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.404+0000 7ff59ad9d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff59c1309f0 0x7ff59c13a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:56326/0 (socket says 172.21.15.156:56326) 2023-09-30T22:22:23.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.404+0000 7ff599d9b700 1 -- 172.21.15.156:0/3115012976 learned_addr learned my addr 172.21.15.156:0/3115012976 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:23.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.404+0000 7ff599d9b700 1 -- 172.21.15.156:0/3115012976 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff59c133ad0 msgr2=0x7ff59c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:23.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.404+0000 7ff599d9b700 1 --2- 172.21.15.156:0/3115012976 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff59c133ad0 0x7ff59c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.404+0000 7ff59959a700 1 -- 172.21.15.156:0/3115012976 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3048285523 0 0) 0x7ff59c06b2d0 con 0x7ff59c1309f0 2023-09-30T22:22:23.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.404+0000 7ff599d9b700 1 -- 172.21.15.156:0/3115012976 >> v1:172.21.15.156:6789/0 conn(0x7ff59c1309f0 legacy=0x7ff59c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:23.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.404+0000 7ff599d9b700 1 -- 172.21.15.156:0/3115012976 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59c1338b0 con 0x7ff59c1300a0 2023-09-30T22:22:23.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.404+0000 7ff59a59c700 1 --2- 172.21.15.156:0/3115012976 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff59c133ad0 0x7ff59c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:23.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.404+0000 7ff599d9b700 1 --2- 172.21.15.156:0/3115012976 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff59c1300a0 0x7ff59c1304b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff590009920 tx=0x7ff590009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3800bca810c13d4e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:23.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.405+0000 7ff59959a700 1 -- 172.21.15.156:0/3115012976 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590011830 con 0x7ff59c1300a0 2023-09-30T22:22:23.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.405+0000 7ff59959a700 1 -- 172.21.15.156:0/3115012976 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff590011990 con 0x7ff59c1300a0 2023-09-30T22:22:23.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.405+0000 7ff59959a700 1 -- 172.21.15.156:0/3115012976 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590011d20 con 0x7ff59c1300a0 2023-09-30T22:22:23.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.405+0000 7ff5a0912700 1 -- 172.21.15.156:0/3115012976 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff59c1300a0 msgr2=0x7ff59c1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:23.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.405+0000 7ff5a0912700 1 --2- 172.21.15.156:0/3115012976 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff59c1300a0 0x7ff59c1304b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff590009920 tx=0x7ff590009c30 comp rx=0 tx=0).stop 2023-09-30T22:22:23.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.405+0000 7ff5a0912700 1 -- 172.21.15.156:0/3115012976 shutdown_connections 2023-09-30T22:22:23.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.405+0000 7ff5a0912700 1 --2- 172.21.15.156:0/3115012976 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff59c133ad0 0x7ff59c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.405+0000 7ff5a0912700 1 --2- 172.21.15.156:0/3115012976 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff59c1300a0 0x7ff59c1304b0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.405+0000 7ff5a0912700 1 -- 172.21.15.156:0/3115012976 >> 172.21.15.156:0/3115012976 conn(0x7ff59c099c40 msgr2=0x7ff59c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:23.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.405+0000 7ff5a0912700 1 -- 172.21.15.156:0/3115012976 shutdown_connections 2023-09-30T22:22:23.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.405+0000 7ff5a0912700 1 -- 172.21.15.156:0/3115012976 wait complete. 2023-09-30T22:22:23.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.406+0000 7ff5a0912700 1 Processor -- start 2023-09-30T22:22:23.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.406+0000 7ff5a0912700 1 -- start start 2023-09-30T22:22:23.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.407+0000 7ff5a0912700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff59c1300a0 0x7ff59c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:23.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.407+0000 7ff5a0912700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff59c1309f0 0x7ff59c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:23.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.407+0000 7ff5a0912700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff59c133ad0 0x7ff59c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:23.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.407+0000 7ff5a0912700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c11fde0 con 0x7ff59c1300a0 2023-09-30T22:22:23.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.407+0000 7ff5a0912700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c120a30 con 0x7ff59c1309f0 2023-09-30T22:22:23.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.407+0000 7ff5a0912700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c11f850 con 0x7ff59c133ad0 2023-09-30T22:22:23.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.407+0000 7ff59a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff59c1300a0 0x7ff59c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:23.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.407+0000 7ff59ad9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff59c133ad0 0x7ff59c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:23.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.407+0000 7ff59a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff59c1300a0 0x7ff59c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59750/0 (socket says 172.21.15.156:59750) 2023-09-30T22:22:23.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.407+0000 7ff59a59c700 1 -- 172.21.15.156:0/3996421246 learned_addr learned my addr 172.21.15.156:0/3996421246 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:23.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.407+0000 7ff599d9b700 1 --2- 172.21.15.156:0/3996421246 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff59c1309f0 0x7ff59c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:23.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.407+0000 7ff59a59c700 1 -- 172.21.15.156:0/3996421246 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff59c133ad0 msgr2=0x7ff59c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:23.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.407+0000 7ff59a59c700 1 --2- 172.21.15.156:0/3996421246 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff59c133ad0 0x7ff59c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.407+0000 7ff59a59c700 1 -- 172.21.15.156:0/3996421246 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff59c1309f0 msgr2=0x7ff59c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:23.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.407+0000 7ff59a59c700 1 --2- 172.21.15.156:0/3996421246 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff59c1309f0 0x7ff59c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.407+0000 7ff59a59c700 1 -- 172.21.15.156:0/3996421246 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58c0094a0 con 0x7ff59c1300a0 2023-09-30T22:22:23.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.407+0000 7ff59ad9d700 1 --2- 172.21.15.156:0/3996421246 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff59c133ad0 0x7ff59c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:23.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.407+0000 7ff599d9b700 1 --2- 172.21.15.156:0/3996421246 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff59c1309f0 0x7ff59c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:23.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.407+0000 7ff59a59c700 1 --2- 172.21.15.156:0/3996421246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff59c1300a0 0x7ff59c11da40 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00ec10 tx=0x7ff58c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:23.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.408+0000 7ff58affd700 1 -- 172.21.15.156:0/3996421246 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c00c850 con 0x7ff59c1300a0 2023-09-30T22:22:23.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.408+0000 7ff58affd700 1 -- 172.21.15.156:0/3996421246 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58c00c9b0 con 0x7ff59c1300a0 2023-09-30T22:22:23.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.408+0000 7ff5a0912700 1 -- 172.21.15.156:0/3996421246 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff590009550 con 0x7ff59c1300a0 2023-09-30T22:22:23.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.408+0000 7ff58affd700 1 -- 172.21.15.156:0/3996421246 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c00cd20 con 0x7ff59c1300a0 2023-09-30T22:22:23.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.408+0000 7ff5a0912700 1 -- 172.21.15.156:0/3996421246 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff59c12dd00 con 0x7ff59c1300a0 2023-09-30T22:22:23.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.408+0000 7ff58affd700 1 -- 172.21.15.156:0/3996421246 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff58c013470 con 0x7ff59c1300a0 2023-09-30T22:22:23.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.409+0000 7ff58affd700 1 -- 172.21.15.156:0/3996421246 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff58c03fc60 con 0x7ff59c1300a0 2023-09-30T22:22:23.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.409+0000 7ff5a0912700 1 -- 172.21.15.156:0/3996421246 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff59c120120 con 0x7ff59c1300a0 2023-09-30T22:22:23.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.414+0000 7ff58affd700 1 -- 172.21.15.156:0/3996421246 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff58c013720 con 0x7ff59c1300a0 2023-09-30T22:22:23.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.453+0000 7f91607b1700 1 Processor -- start 2023-09-30T22:22:23.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.453+0000 7f91607b1700 1 -- start start 2023-09-30T22:22:23.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.453+0000 7f91607b1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f91580a0a70 0x7f91580a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:23.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.453+0000 7f91607b1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9158134120 0x7f915813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:23.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.453+0000 7f91607b1700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f915809dc00 con 0x7f91580a1380 2023-09-30T22:22:23.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.453+0000 7f91607b1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f915809ea90 con 0x7f9158134120 2023-09-30T22:22:23.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.453+0000 7f91607b1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f915809dec0 con 0x7f91580a0a70 2023-09-30T22:22:23.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.453+0000 7f915e54d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f91580a0a70 0x7f91580a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:23.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.454+0000 7f915e54d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f91580a0a70 0x7f91580a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51212/0 (socket says 172.21.15.156:51212) 2023-09-30T22:22:23.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.454+0000 7f915e54d700 1 -- 172.21.15.156:0/316442254 learned_addr learned my addr 172.21.15.156:0/316442254 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:23.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.454+0000 7f915ed4e700 1 --2- 172.21.15.156:0/316442254 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9158134120 0x7f915813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:23.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.454+0000 7f915e54d700 1 -- 172.21.15.156:0/316442254 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9158134120 msgr2=0x7f915813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:23.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.454+0000 7f915e54d700 1 --2- 172.21.15.156:0/316442254 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9158134120 0x7f915813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.454+0000 7f915e54d700 1 -- 172.21.15.156:0/316442254 >> v1:172.21.15.156:6789/0 conn(0x7f91580a1380 legacy=0x7f9158133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:23.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.454+0000 7f915e54d700 1 -- 172.21.15.156:0/316442254 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915809e6a0 con 0x7f91580a0a70 2023-09-30T22:22:23.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.454+0000 7f915e54d700 1 --2- 172.21.15.156:0/316442254 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f91580a0a70 0x7f91580a0e40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9154009920 tx=0x7f9154009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3b403356fb0c805 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:23.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.454+0000 7f915d54b700 1 -- 172.21.15.156:0/316442254 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915400ba60 con 0x7f91580a0a70 2023-09-30T22:22:23.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.454+0000 7f915d54b700 1 -- 172.21.15.156:0/316442254 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915400bbc0 con 0x7f91580a0a70 2023-09-30T22:22:23.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.454+0000 7f915d54b700 1 -- 172.21.15.156:0/316442254 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9154009e70 con 0x7f91580a0a70 2023-09-30T22:22:23.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.455+0000 7f91607b1700 1 -- 172.21.15.156:0/316442254 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f91580a0a70 msgr2=0x7f91580a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:23.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.455+0000 7f91607b1700 1 --2- 172.21.15.156:0/316442254 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f91580a0a70 0x7f91580a0e40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9154009920 tx=0x7f9154009c30 comp rx=0 tx=0).stop 2023-09-30T22:22:23.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.455+0000 7f91607b1700 1 -- 172.21.15.156:0/316442254 shutdown_connections 2023-09-30T22:22:23.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.455+0000 7f91607b1700 1 --2- 172.21.15.156:0/316442254 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9158134120 0x7f915813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.455+0000 7f91607b1700 1 --2- 172.21.15.156:0/316442254 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f91580a0a70 0x7f91580a0e40 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.455+0000 7f91607b1700 1 -- 172.21.15.156:0/316442254 >> 172.21.15.156:0/316442254 conn(0x7f91580a6610 msgr2=0x7f91580a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:23.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.455+0000 7f91607b1700 1 -- 172.21.15.156:0/316442254 shutdown_connections 2023-09-30T22:22:23.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.455+0000 7f91607b1700 1 -- 172.21.15.156:0/316442254 wait complete. 2023-09-30T22:22:23.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.456+0000 7f91607b1700 1 Processor -- start 2023-09-30T22:22:23.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.456+0000 7f91607b1700 1 -- start start 2023-09-30T22:22:23.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.456+0000 7f91607b1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91580a0a70 0x7f9158122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:23.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.456+0000 7f91607b1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91580a1380 0x7f9158122e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:23.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.456+0000 7f91607b1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9158134120 0x7f91581233b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:23.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.456+0000 7f91607b1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9158133aa0 con 0x7f91580a1380 2023-09-30T22:22:23.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.456+0000 7f91607b1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91580a03e0 con 0x7f91580a0a70 2023-09-30T22:22:23.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.456+0000 7f91607b1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91581245c0 con 0x7f9158134120 2023-09-30T22:22:23.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.456+0000 7f915dd4c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91580a1380 0x7f9158122e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:23.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.456+0000 7f915ed4e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9158134120 0x7f91581233b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:23.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.456+0000 7f915dd4c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91580a1380 0x7f9158122e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59766/0 (socket says 172.21.15.156:59766) 2023-09-30T22:22:23.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.456+0000 7f915dd4c700 1 -- 172.21.15.156:0/1623842549 learned_addr learned my addr 172.21.15.156:0/1623842549 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:23.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.456+0000 7f915e54d700 1 --2- 172.21.15.156:0/1623842549 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91580a0a70 0x7f9158122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:23.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.457+0000 7f915dd4c700 1 -- 172.21.15.156:0/1623842549 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9158134120 msgr2=0x7f91581233b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:23.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.457+0000 7f915dd4c700 1 --2- 172.21.15.156:0/1623842549 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9158134120 0x7f91581233b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.457+0000 7f915dd4c700 1 -- 172.21.15.156:0/1623842549 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91580a0a70 msgr2=0x7f9158122930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:23.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.457+0000 7f915dd4c700 1 --2- 172.21.15.156:0/1623842549 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91580a0a70 0x7f9158122930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.457+0000 7f915dd4c700 1 -- 172.21.15.156:0/1623842549 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9154009550 con 0x7f91580a1380 2023-09-30T22:22:23.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.457+0000 7f915ed4e700 1 --2- 172.21.15.156:0/1623842549 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9158134120 0x7f91581233b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:23.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.457+0000 7f915e54d700 1 --2- 172.21.15.156:0/1623842549 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91580a0a70 0x7f9158122930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:23.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.457+0000 7f915dd4c700 1 --2- 172.21.15.156:0/1623842549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91580a1380 0x7f9158122e70 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f914800c4b0 tx=0x7f914800c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:23.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.457+0000 7f914effd700 1 -- 172.21.15.156:0/1623842549 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91480052d0 con 0x7f91580a1380 2023-09-30T22:22:23.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.457+0000 7f914effd700 1 -- 172.21.15.156:0/1623842549 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9148005430 con 0x7f91580a1380 2023-09-30T22:22:23.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.457+0000 7f91607b1700 1 -- 172.21.15.156:0/1623842549 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91581337f0 con 0x7f91580a1380 2023-09-30T22:22:23.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.457+0000 7f914effd700 1 -- 172.21.15.156:0/1623842549 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91480038c0 con 0x7f91580a1380 2023-09-30T22:22:23.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.457+0000 7f91607b1700 1 -- 172.21.15.156:0/1623842549 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9158126ac0 con 0x7f91580a1380 2023-09-30T22:22:23.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.458+0000 7f914effd700 1 -- 172.21.15.156:0/1623842549 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9148003a20 con 0x7f91580a1380 2023-09-30T22:22:23.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.458+0000 7f914effd700 1 -- 172.21.15.156:0/1623842549 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f914803ea00 con 0x7f91580a1380 2023-09-30T22:22:23.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.458+0000 7f91607b1700 1 -- 172.21.15.156:0/1623842549 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9158125fb0 con 0x7f91580a1380 2023-09-30T22:22:23.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.463+0000 7f914effd700 1 -- 172.21.15.156:0/1623842549 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9158125fb0 con 0x7f91580a1380 2023-09-30T22:22:23.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.528+0000 7f7e6e2b5700 1 -- 172.21.15.156:0/1484925046 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7e68130ac0 con 0x7f7e6809e170 2023-09-30T22:22:23.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.529+0000 7f7e64ff9700 1 -- 172.21.15.156:0/1484925046 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e5c019440 con 0x7f7e6809e170 2023-09-30T22:22:23.530 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:23.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.531+0000 7f7e6e2b5700 1 -- 172.21.15.156:0/1484925046 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e6809e170 msgr2=0x7f7e6811c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:23.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.531+0000 7f7e6e2b5700 1 --2- 172.21.15.156:0/1484925046 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e6809e170 0x7f7e6811c5f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c010f40 tx=0x7f7e5c00e640 comp rx=0 tx=0).stop 2023-09-30T22:22:23.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.531+0000 7f7e6e2b5700 1 -- 172.21.15.156:0/1484925046 shutdown_connections 2023-09-30T22:22:23.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.531+0000 7f7e6e2b5700 1 --2- 172.21.15.156:0/1484925046 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e68130ce0 0x7f7e6811cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.531+0000 7f7e6e2b5700 1 --2- 172.21.15.156:0/1484925046 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e6809d860 0x7f7e6811c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.531+0000 7f7e6e2b5700 1 --2- 172.21.15.156:0/1484925046 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e6809e170 0x7f7e6811c5f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.531+0000 7f7e6e2b5700 1 -- 172.21.15.156:0/1484925046 >> 172.21.15.156:0/1484925046 conn(0x7f7e68099c40 msgr2=0x7f7e6812e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:23.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.531+0000 7f7e6e2b5700 1 -- 172.21.15.156:0/1484925046 shutdown_connections 2023-09-30T22:22:23.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.531+0000 7f7e6e2b5700 1 -- 172.21.15.156:0/1484925046 wait complete. 2023-09-30T22:22:23.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:23.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.632+0000 7ff5a0912700 1 -- 172.21.15.156:0/3996421246 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff59c04f2a0 con 0x7ff59c1300a0 2023-09-30T22:22:23.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.633+0000 7ff58affd700 1 -- 172.21.15.156:0/3996421246 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff58c011b00 con 0x7ff59c1300a0 2023-09-30T22:22:23.633 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:23.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.635+0000 7ff5a0912700 1 -- 172.21.15.156:0/3996421246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff59c1300a0 msgr2=0x7ff59c11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:23.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.635+0000 7ff5a0912700 1 --2- 172.21.15.156:0/3996421246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff59c1300a0 0x7ff59c11da40 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00ec10 tx=0x7ff58c00ef20 comp rx=0 tx=0).stop 2023-09-30T22:22:23.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.635+0000 7ff5a0912700 1 -- 172.21.15.156:0/3996421246 shutdown_connections 2023-09-30T22:22:23.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.635+0000 7ff5a0912700 1 --2- 172.21.15.156:0/3996421246 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff59c133ad0 0x7ff59c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.635+0000 7ff5a0912700 1 --2- 172.21.15.156:0/3996421246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff59c1300a0 0x7ff59c11da40 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.635+0000 7ff5a0912700 1 --2- 172.21.15.156:0/3996421246 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff59c1309f0 0x7ff59c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.635+0000 7ff5a0912700 1 -- 172.21.15.156:0/3996421246 >> 172.21.15.156:0/3996421246 conn(0x7ff59c099c40 msgr2=0x7ff59c132050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:23.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.635+0000 7ff5a0912700 1 -- 172.21.15.156:0/3996421246 shutdown_connections 2023-09-30T22:22:23.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.635+0000 7ff5a0912700 1 -- 172.21.15.156:0/3996421246 wait complete. 2023-09-30T22:22:23.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:23.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.659+0000 7f91607b1700 1 -- 172.21.15.156:0/1623842549 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9158125fb0 con 0x7f91580a1380 2023-09-30T22:22:23.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.659+0000 7f914effd700 1 -- 172.21.15.156:0/1623842549 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9158125fb0 con 0x7f91580a1380 2023-09-30T22:22:23.660 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:23.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.661+0000 7f91607b1700 1 -- 172.21.15.156:0/1623842549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91580a1380 msgr2=0x7f9158122e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:23.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.661+0000 7f91607b1700 1 --2- 172.21.15.156:0/1623842549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91580a1380 0x7f9158122e70 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f914800c4b0 tx=0x7f914800c7c0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.661+0000 7f91607b1700 1 -- 172.21.15.156:0/1623842549 shutdown_connections 2023-09-30T22:22:23.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.661+0000 7f91607b1700 1 --2- 172.21.15.156:0/1623842549 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9158134120 0x7f91581233b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.661+0000 7f91607b1700 1 --2- 172.21.15.156:0/1623842549 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91580a0a70 0x7f9158122930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.661+0000 7f91607b1700 1 --2- 172.21.15.156:0/1623842549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91580a1380 0x7f9158122e70 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.661+0000 7f91607b1700 1 -- 172.21.15.156:0/1623842549 >> 172.21.15.156:0/1623842549 conn(0x7f91580a6610 msgr2=0x7f91580a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:23.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.661+0000 7f91607b1700 1 -- 172.21.15.156:0/1623842549 shutdown_connections 2023-09-30T22:22:23.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.661+0000 7f91607b1700 1 -- 172.21.15.156:0/1623842549 wait complete. 2023-09-30T22:22:23.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:23.754 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:23.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.876+0000 7f35b0cb8700 1 Processor -- start 2023-09-30T22:22:23.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.876+0000 7f35b0cb8700 1 -- start start 2023-09-30T22:22:23.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.877+0000 7f35b0cb8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35ac09d860 0x7f35ac09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:23.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.877+0000 7f35b0cb8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f35ac130eb0 0x7f35ac138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:23.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.877+0000 7f35b0cb8700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35ac09aaa0 con 0x7f35ac09e170 2023-09-30T22:22:23.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.877+0000 7f35b0cb8700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ac09f870 con 0x7f35ac130eb0 2023-09-30T22:22:23.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.877+0000 7f35b0cb8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac09b360 con 0x7f35ac09d860 2023-09-30T22:22:23.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.877+0000 7f35aa59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35ac09d860 0x7f35ac09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:23.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.877+0000 7f35a9d9b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f35ac09e170 0x7f35ac1307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:56348/0 (socket says 172.21.15.156:56348) 2023-09-30T22:22:23.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.877+0000 7f35a9d9b700 1 -- 172.21.15.156:0/1386287929 learned_addr learned my addr 172.21.15.156:0/1386287929 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:23.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.877+0000 7f35aad9d700 1 --2- 172.21.15.156:0/1386287929 >> v2:172.21.15.156:3300/0 conn(0x7f35ac130eb0 0x7f35ac138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:23.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.877+0000 7f35aad9d700 1 -- 172.21.15.156:0/1386287929 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35ac09d860 msgr2=0x7f35ac09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:23.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.877+0000 7f35aad9d700 1 --2- 172.21.15.156:0/1386287929 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35ac09d860 0x7f35ac09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.877+0000 7f35aad9d700 1 -- 172.21.15.156:0/1386287929 >> v1:172.21.15.156:6789/0 conn(0x7f35ac09e170 legacy=0x7f35ac1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:23.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.877+0000 7f35aad9d700 1 -- 172.21.15.156:0/1386287929 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ac09b620 con 0x7f35ac130eb0 2023-09-30T22:22:23.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.877+0000 7f35a959a700 1 -- 172.21.15.156:0/1386287929 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2823576755 0 0) 0x7f35ac09aaa0 con 0x7f35ac09e170 2023-09-30T22:22:23.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.877+0000 7f35aa59c700 1 --2- 172.21.15.156:0/1386287929 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35ac09d860 0x7f35ac09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:23.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.877+0000 7f35aad9d700 1 --2- 172.21.15.156:0/1386287929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35ac130eb0 0x7f35ac138a00 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f35a4009d90 tx=0x7f35a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e310e3a54b0a34 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:23.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.878+0000 7f35a959a700 1 -- 172.21.15.156:0/1386287929 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a400e070 con 0x7f35ac130eb0 2023-09-30T22:22:23.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.878+0000 7f35a959a700 1 -- 172.21.15.156:0/1386287929 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a400bb20 con 0x7f35ac130eb0 2023-09-30T22:22:23.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.878+0000 7f35a959a700 1 -- 172.21.15.156:0/1386287929 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a4012430 con 0x7f35ac130eb0 2023-09-30T22:22:23.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.878+0000 7f35b0cb8700 1 -- 172.21.15.156:0/1386287929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35ac130eb0 msgr2=0x7f35ac138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:23.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.878+0000 7f35b0cb8700 1 --2- 172.21.15.156:0/1386287929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35ac130eb0 0x7f35ac138a00 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f35a4009d90 tx=0x7f35a400b330 comp rx=0 tx=0).stop 2023-09-30T22:22:23.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.878+0000 7f35b0cb8700 1 -- 172.21.15.156:0/1386287929 shutdown_connections 2023-09-30T22:22:23.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.878+0000 7f35b0cb8700 1 --2- 172.21.15.156:0/1386287929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35ac130eb0 0x7f35ac138a00 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.878+0000 7f35b0cb8700 1 --2- 172.21.15.156:0/1386287929 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35ac09d860 0x7f35ac09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.878+0000 7f35b0cb8700 1 -- 172.21.15.156:0/1386287929 >> 172.21.15.156:0/1386287929 conn(0x7f35ac099c40 msgr2=0x7f35ac0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:23.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.878+0000 7f35b0cb8700 1 -- 172.21.15.156:0/1386287929 shutdown_connections 2023-09-30T22:22:23.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.878+0000 7f35b0cb8700 1 -- 172.21.15.156:0/1386287929 wait complete. 2023-09-30T22:22:23.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.879+0000 7f35b0cb8700 1 Processor -- start 2023-09-30T22:22:23.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.879+0000 7f35b0cb8700 1 -- start start 2023-09-30T22:22:23.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.880+0000 7f35b0cb8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35ac09d860 0x7f35ac1c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:23.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.880+0000 7f35b0cb8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35ac09e170 0x7f35ac1c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:23.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.880+0000 7f35b0cb8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35ac130eb0 0x7f35ac135a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:23.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.880+0000 7f35b0cb8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac1306d0 con 0x7f35ac09d860 2023-09-30T22:22:23.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.880+0000 7f35b0cb8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac119af0 con 0x7f35ac09e170 2023-09-30T22:22:23.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.880+0000 7f35b0cb8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac1377f0 con 0x7f35ac130eb0 2023-09-30T22:22:23.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.880+0000 7f35aa59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35ac09d860 0x7f35ac1c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:23.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.880+0000 7f35aa59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35ac09d860 0x7f35ac1c6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59798/0 (socket says 172.21.15.156:59798) 2023-09-30T22:22:23.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.880+0000 7f35aad9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35ac130eb0 0x7f35ac135a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:23.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.880+0000 7f35aa59c700 1 -- 172.21.15.156:0/3583411123 learned_addr learned my addr 172.21.15.156:0/3583411123 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:23.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.880+0000 7f35a9d9b700 1 --2- 172.21.15.156:0/3583411123 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35ac09e170 0x7f35ac1c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:23.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.880+0000 7f35aad9d700 1 -- 172.21.15.156:0/3583411123 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35ac09e170 msgr2=0x7f35ac1c67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:23.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.880+0000 7f35aad9d700 1 --2- 172.21.15.156:0/3583411123 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35ac09e170 0x7f35ac1c67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.880+0000 7f35aad9d700 1 -- 172.21.15.156:0/3583411123 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35ac09d860 msgr2=0x7f35ac1c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:23.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.880+0000 7f35aad9d700 1 --2- 172.21.15.156:0/3583411123 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35ac09d860 0x7f35ac1c6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.880+0000 7f35aad9d700 1 -- 172.21.15.156:0/3583411123 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a00094a0 con 0x7f35ac130eb0 2023-09-30T22:22:23.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.880+0000 7f35a9d9b700 1 --2- 172.21.15.156:0/3583411123 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35ac09e170 0x7f35ac1c67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:23.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.880+0000 7f35aad9d700 1 --2- 172.21.15.156:0/3583411123 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35ac130eb0 0x7f35ac135a60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f35a4016000 tx=0x7f35a4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:23.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.880+0000 7f359affd700 1 -- 172.21.15.156:0/3583411123 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a4012430 con 0x7f35ac130eb0 2023-09-30T22:22:23.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.880+0000 7f359affd700 1 -- 172.21.15.156:0/3583411123 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a4020070 con 0x7f35ac130eb0 2023-09-30T22:22:23.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.880+0000 7f35b0cb8700 1 -- 172.21.15.156:0/3583411123 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a4009a70 con 0x7f35ac130eb0 2023-09-30T22:22:23.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.880+0000 7f359affd700 1 -- 172.21.15.156:0/3583411123 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a4004280 con 0x7f35ac130eb0 2023-09-30T22:22:23.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.880+0000 7f35b0cb8700 1 -- 172.21.15.156:0/3583411123 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35ac137e80 con 0x7f35ac130eb0 2023-09-30T22:22:23.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.881+0000 7f359affd700 1 -- 172.21.15.156:0/3583411123 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f35a40043e0 con 0x7f35ac130eb0 2023-09-30T22:22:23.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.881+0000 7f35b0cb8700 1 -- 172.21.15.156:0/3583411123 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35ac09c8b0 con 0x7f35ac130eb0 2023-09-30T22:22:23.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.881+0000 7f359affd700 1 -- 172.21.15.156:0/3583411123 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f35a4022070 con 0x7f35ac130eb0 2023-09-30T22:22:23.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:23.886+0000 7f359affd700 1 -- 172.21.15.156:0/3583411123 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f35a4026db0 con 0x7f35ac130eb0 2023-09-30T22:22:24.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.072+0000 7f35b0cb8700 1 -- 172.21.15.156:0/3583411123 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f35ac04f2a0 con 0x7f35ac130eb0 2023-09-30T22:22:24.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.072+0000 7f359affd700 1 -- 172.21.15.156:0/3583411123 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f35a4026bd0 con 0x7f35ac130eb0 2023-09-30T22:22:24.073 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:24.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.074+0000 7f35b0cb8700 1 -- 172.21.15.156:0/3583411123 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35ac130eb0 msgr2=0x7f35ac135a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.074+0000 7f35b0cb8700 1 --2- 172.21.15.156:0/3583411123 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35ac130eb0 0x7f35ac135a60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f35a4016000 tx=0x7f35a4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.074+0000 7f35b0cb8700 1 -- 172.21.15.156:0/3583411123 shutdown_connections 2023-09-30T22:22:24.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.074+0000 7f35b0cb8700 1 --2- 172.21.15.156:0/3583411123 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35ac130eb0 0x7f35ac135a60 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.074+0000 7f35b0cb8700 1 --2- 172.21.15.156:0/3583411123 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35ac09d860 0x7f35ac1c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.074+0000 7f35b0cb8700 1 --2- 172.21.15.156:0/3583411123 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35ac09e170 0x7f35ac1c67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.074+0000 7f35b0cb8700 1 -- 172.21.15.156:0/3583411123 >> 172.21.15.156:0/3583411123 conn(0x7f35ac099c40 msgr2=0x7f35ac138600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:24.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.074+0000 7f35b0cb8700 1 -- 172.21.15.156:0/3583411123 shutdown_connections 2023-09-30T22:22:24.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.075+0000 7f35b0cb8700 1 -- 172.21.15.156:0/3583411123 wait complete. 2023-09-30T22:22:24.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:24.545 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:24.648 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:24.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.674+0000 7f7142fa0700 1 Processor -- start 2023-09-30T22:22:24.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.674+0000 7f7142fa0700 1 -- start start 2023-09-30T22:22:24.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.674+0000 7f7142fa0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f713c0a0a70 0x7f713c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.674+0000 7f7142fa0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f713c134120 0x7f713c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.674+0000 7f7142fa0700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713c09dc00 con 0x7f713c0a1380 2023-09-30T22:22:24.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.674+0000 7f7142fa0700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f713c09ea60 con 0x7f713c134120 2023-09-30T22:22:24.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.674+0000 7f7142fa0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713c09dec0 con 0x7f713c0a0a70 2023-09-30T22:22:24.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.674+0000 7f714153d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f713c134120 0x7f713c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.674+0000 7f713bfff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f713c0a1380 0x7f713c133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:56364/0 (socket says 172.21.15.156:56364) 2023-09-30T22:22:24.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.674+0000 7f714153d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f713c134120 0x7f713c13bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59804/0 (socket says 172.21.15.156:59804) 2023-09-30T22:22:24.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.674+0000 7f713bfff700 1 -- 172.21.15.156:0/3936255714 learned_addr learned my addr 172.21.15.156:0/3936255714 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:24.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.674+0000 7f714153d700 1 -- 172.21.15.156:0/3936255714 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f713c0a0a70 msgr2=0x7f713c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:24.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.674+0000 7f714153d700 1 --2- 172.21.15.156:0/3936255714 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f713c0a0a70 0x7f713c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.674+0000 7f713b7fe700 1 -- 172.21.15.156:0/3936255714 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1398215582 0 0) 0x7f713c09dc00 con 0x7f713c0a1380 2023-09-30T22:22:24.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.675+0000 7f714153d700 1 -- 172.21.15.156:0/3936255714 >> v1:172.21.15.156:6789/0 conn(0x7f713c0a1380 legacy=0x7f713c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.675+0000 7f714153d700 1 -- 172.21.15.156:0/3936255714 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c09e6a0 con 0x7f713c134120 2023-09-30T22:22:24.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.675+0000 7f714153d700 1 --2- 172.21.15.156:0/3936255714 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f713c134120 0x7f713c13bce0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f7134009d90 tx=0x7f713400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24082dd599d22879 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:24.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.675+0000 7f713b7fe700 1 -- 172.21.15.156:0/3936255714 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713400e070 con 0x7f713c134120 2023-09-30T22:22:24.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.675+0000 7f713b7fe700 1 -- 172.21.15.156:0/3936255714 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713400bbd0 con 0x7f713c134120 2023-09-30T22:22:24.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.675+0000 7f713b7fe700 1 -- 172.21.15.156:0/3936255714 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7134012430 con 0x7f713c134120 2023-09-30T22:22:24.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.675+0000 7f7142fa0700 1 -- 172.21.15.156:0/3936255714 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f713c134120 msgr2=0x7f713c13bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.675+0000 7f7142fa0700 1 --2- 172.21.15.156:0/3936255714 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f713c134120 0x7f713c13bce0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f7134009d90 tx=0x7f713400b330 comp rx=0 tx=0).stop 2023-09-30T22:22:24.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.676+0000 7f7142fa0700 1 -- 172.21.15.156:0/3936255714 shutdown_connections 2023-09-30T22:22:24.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.676+0000 7f7142fa0700 1 --2- 172.21.15.156:0/3936255714 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f713c134120 0x7f713c13bce0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.676+0000 7f7142fa0700 1 --2- 172.21.15.156:0/3936255714 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f713c0a0a70 0x7f713c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.676+0000 7f7142fa0700 1 -- 172.21.15.156:0/3936255714 >> 172.21.15.156:0/3936255714 conn(0x7f713c0a6610 msgr2=0x7f713c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:24.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.676+0000 7f7142fa0700 1 -- 172.21.15.156:0/3936255714 shutdown_connections 2023-09-30T22:22:24.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.676+0000 7f7142fa0700 1 -- 172.21.15.156:0/3936255714 wait complete. 2023-09-30T22:22:24.679 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:24.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.676+0000 7f7142fa0700 1 Processor -- start 2023-09-30T22:22:24.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.676+0000 7f7142fa0700 1 -- start start 2023-09-30T22:22:24.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.677+0000 7f7142fa0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f713c0a0a70 0x7f713c06dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.677+0000 7f7142fa0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f713c0a1380 0x7f713c06e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.677+0000 7f7142fa0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f713c134120 0x7f713c06e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.677+0000 7f7142fa0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0713e0 con 0x7f713c134120 2023-09-30T22:22:24.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.677+0000 7f7142fa0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713c06f6d0 con 0x7f713c0a1380 2023-09-30T22:22:24.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.677+0000 7f7142fa0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0715e0 con 0x7f713c0a0a70 2023-09-30T22:22:24.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.677+0000 7f714153d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f713c134120 0x7f713c06e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.677+0000 7f7140d3c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f713c0a0a70 0x7f713c06dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.677+0000 7f714153d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f713c134120 0x7f713c06e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59818/0 (socket says 172.21.15.156:59818) 2023-09-30T22:22:24.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.677+0000 7f714153d700 1 -- 172.21.15.156:0/1995711118 learned_addr learned my addr 172.21.15.156:0/1995711118 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:24.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.677+0000 7f713bfff700 1 --2- 172.21.15.156:0/1995711118 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f713c0a1380 0x7f713c06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.678+0000 7f714153d700 1 -- 172.21.15.156:0/1995711118 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f713c0a0a70 msgr2=0x7f713c06dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.678+0000 7f714153d700 1 --2- 172.21.15.156:0/1995711118 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f713c0a0a70 0x7f713c06dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.678+0000 7f714153d700 1 -- 172.21.15.156:0/1995711118 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f713c0a1380 msgr2=0x7f713c06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.678+0000 7f714153d700 1 --2- 172.21.15.156:0/1995711118 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f713c0a1380 0x7f713c06e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.678+0000 7f714153d700 1 -- 172.21.15.156:0/1995711118 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7134009a70 con 0x7f713c134120 2023-09-30T22:22:24.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.678+0000 7f714153d700 1 --2- 172.21.15.156:0/1995711118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f713c134120 0x7f713c06e540 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f713400b730 tx=0x7f7134004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:24.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.678+0000 7f71397fa700 1 -- 172.21.15.156:0/1995711118 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7134012e10 con 0x7f713c134120 2023-09-30T22:22:24.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.678+0000 7f71397fa700 1 -- 172.21.15.156:0/1995711118 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7134020070 con 0x7f713c134120 2023-09-30T22:22:24.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.678+0000 7f71397fa700 1 -- 172.21.15.156:0/1995711118 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7134004280 con 0x7f713c134120 2023-09-30T22:22:24.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.678+0000 7f7142fa0700 1 -- 172.21.15.156:0/1995711118 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f713c12af60 con 0x7f713c134120 2023-09-30T22:22:24.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.678+0000 7f7142fa0700 1 -- 172.21.15.156:0/1995711118 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713c0700c0 con 0x7f713c134120 2023-09-30T22:22:24.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.679+0000 7f7142fa0700 1 -- 172.21.15.156:0/1995711118 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f713c04f2a0 con 0x7f713c134120 2023-09-30T22:22:24.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.679+0000 7f71397fa700 1 -- 172.21.15.156:0/1995711118 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f71340043e0 con 0x7f713c134120 2023-09-30T22:22:24.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.679+0000 7f71397fa700 1 -- 172.21.15.156:0/1995711118 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7134022070 con 0x7f713c134120 2023-09-30T22:22:24.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.684+0000 7f71397fa700 1 -- 172.21.15.156:0/1995711118 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7134027480 con 0x7f713c134120 2023-09-30T22:22:24.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.800+0000 7f3ff1201700 1 Processor -- start 2023-09-30T22:22:24.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.800+0000 7f3ff1201700 1 -- start start 2023-09-30T22:22:24.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.800+0000 7f3ff1201700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3fec09bb60 0x7f3fec09e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.800+0000 7f3ff1201700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fec130720 0x7f3fec130b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.800+0000 7f3ff1201700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fec09aaa0 con 0x7f3fec12cf70 2023-09-30T22:22:24.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.800+0000 7f3ff1201700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fec09bf30 con 0x7f3fec09bb60 2023-09-30T22:22:24.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.800+0000 7f3ff1201700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec09a8e0 con 0x7f3fec130720 2023-09-30T22:22:24.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.800+0000 7f3feb59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fec130720 0x7f3fec130b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.800+0000 7f3fea59c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f3fec12cf70 0x7f3fec130010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:56366/0 (socket says 172.21.15.156:56366) 2023-09-30T22:22:24.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.800+0000 7f3fea59c700 1 -- 172.21.15.156:0/1334609938 learned_addr learned my addr 172.21.15.156:0/1334609938 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:24.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.801+0000 7f3fead9d700 1 --2- 172.21.15.156:0/1334609938 >> v2:172.21.15.156:3300/0 conn(0x7f3fec09bb60 0x7f3fec09e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.801+0000 7f3fe9d9b700 1 -- 172.21.15.156:0/1334609938 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393952921 0 0) 0x7f3fec09aaa0 con 0x7f3fec12cf70 2023-09-30T22:22:24.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.801+0000 7f3feb59e700 1 -- 172.21.15.156:0/1334609938 >> v2:172.21.15.156:3300/0 conn(0x7f3fec09bb60 msgr2=0x7f3fec09e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:24.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.801+0000 7f3feb59e700 1 --2- 172.21.15.156:0/1334609938 >> v2:172.21.15.156:3300/0 conn(0x7f3fec09bb60 0x7f3fec09e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.801+0000 7f3feb59e700 1 -- 172.21.15.156:0/1334609938 >> v1:172.21.15.156:6789/0 conn(0x7f3fec12cf70 legacy=0x7f3fec130010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.801+0000 7f3feb59e700 1 -- 172.21.15.156:0/1334609938 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fec12d450 con 0x7f3fec130720 2023-09-30T22:22:24.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.801+0000 7f3feb59e700 1 --2- 172.21.15.156:0/1334609938 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fec130720 0x7f3fec130b20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3fe4009dc0 tx=0x7f3fe400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5efdd0a85725f23e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:24.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.801+0000 7f3fe9d9b700 1 -- 172.21.15.156:0/1334609938 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe400e070 con 0x7f3fec130720 2023-09-30T22:22:24.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.801+0000 7f3fe9d9b700 1 -- 172.21.15.156:0/1334609938 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe400bae0 con 0x7f3fec130720 2023-09-30T22:22:24.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.801+0000 7f3fe9d9b700 1 -- 172.21.15.156:0/1334609938 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe400be90 con 0x7f3fec130720 2023-09-30T22:22:24.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.802+0000 7f3ff1201700 1 -- 172.21.15.156:0/1334609938 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fec130720 msgr2=0x7f3fec130b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.802+0000 7f3ff1201700 1 --2- 172.21.15.156:0/1334609938 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fec130720 0x7f3fec130b20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3fe4009dc0 tx=0x7f3fe400b330 comp rx=0 tx=0).stop 2023-09-30T22:22:24.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.802+0000 7f3ff1201700 1 -- 172.21.15.156:0/1334609938 shutdown_connections 2023-09-30T22:22:24.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.802+0000 7f3ff1201700 1 --2- 172.21.15.156:0/1334609938 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fec130720 0x7f3fec130b20 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.802+0000 7f3ff1201700 1 --2- 172.21.15.156:0/1334609938 >> v2:172.21.15.156:3300/0 conn(0x7f3fec09bb60 0x7f3fec09e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.802+0000 7f3ff1201700 1 -- 172.21.15.156:0/1334609938 >> 172.21.15.156:0/1334609938 conn(0x7f3fec0a2d80 msgr2=0x7f3fec0a3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:24.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.802+0000 7f3ff1201700 1 -- 172.21.15.156:0/1334609938 shutdown_connections 2023-09-30T22:22:24.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.802+0000 7f3ff1201700 1 -- 172.21.15.156:0/1334609938 wait complete. 2023-09-30T22:22:24.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.803+0000 7f3ff1201700 1 Processor -- start 2023-09-30T22:22:24.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.803+0000 7f3ff1201700 1 -- start start 2023-09-30T22:22:24.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.804+0000 7f3ff1201700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fec09bb60 0x7f3fec131160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.804+0000 7f3ff1201700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fec12cf70 0x7f3fec1316a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.804+0000 7f3ff1201700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fec130720 0x7f3fec131be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.804+0000 7f3ff1201700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec12a6a0 con 0x7f3fec130720 2023-09-30T22:22:24.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.804+0000 7f3ff1201700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec138080 con 0x7f3fec12cf70 2023-09-30T22:22:24.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.804+0000 7f3ff1201700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec134560 con 0x7f3fec09bb60 2023-09-30T22:22:24.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.804+0000 7f3feb59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fec130720 0x7f3fec131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.804+0000 7f3feb59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fec130720 0x7f3fec131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59832/0 (socket says 172.21.15.156:59832) 2023-09-30T22:22:24.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.804+0000 7f3feb59e700 1 -- 172.21.15.156:0/1446440602 learned_addr learned my addr 172.21.15.156:0/1446440602 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:24.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.804+0000 7f3fead9d700 1 --2- 172.21.15.156:0/1446440602 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fec09bb60 0x7f3fec131160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.804+0000 7f3fea59c700 1 --2- 172.21.15.156:0/1446440602 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fec12cf70 0x7f3fec1316a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.805+0000 7f3fea59c700 1 -- 172.21.15.156:0/1446440602 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fec09bb60 msgr2=0x7f3fec131160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.805+0000 7f3fea59c700 1 --2- 172.21.15.156:0/1446440602 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fec09bb60 0x7f3fec131160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.805+0000 7f3fea59c700 1 -- 172.21.15.156:0/1446440602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fec130720 msgr2=0x7f3fec131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.805+0000 7f3fea59c700 1 --2- 172.21.15.156:0/1446440602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fec130720 0x7f3fec131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.805+0000 7f3fea59c700 1 -- 172.21.15.156:0/1446440602 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe4009a70 con 0x7f3fec12cf70 2023-09-30T22:22:24.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.805+0000 7f3feb59e700 1 --2- 172.21.15.156:0/1446440602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fec130720 0x7f3fec131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:24.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.805+0000 7f3fea59c700 1 --2- 172.21.15.156:0/1446440602 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fec12cf70 0x7f3fec1316a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3fe00018d0 tx=0x7f3fe0001be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:24.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.805+0000 7f3fd37fe700 1 -- 172.21.15.156:0/1446440602 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0013070 con 0x7f3fec12cf70 2023-09-30T22:22:24.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.805+0000 7f3fd37fe700 1 -- 172.21.15.156:0/1446440602 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe000e110 con 0x7f3fec12cf70 2023-09-30T22:22:24.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.805+0000 7f3fd37fe700 1 -- 172.21.15.156:0/1446440602 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0004870 con 0x7f3fec12cf70 2023-09-30T22:22:24.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.805+0000 7f3ff1201700 1 -- 172.21.15.156:0/1446440602 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fec132ef0 con 0x7f3fec12cf70 2023-09-30T22:22:24.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.805+0000 7f3ff1201700 1 -- 172.21.15.156:0/1446440602 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fec133120 con 0x7f3fec12cf70 2023-09-30T22:22:24.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.806+0000 7f3fd37fe700 1 -- 172.21.15.156:0/1446440602 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3fe00049d0 con 0x7f3fec12cf70 2023-09-30T22:22:24.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.806+0000 7f3fd37fe700 1 -- 172.21.15.156:0/1446440602 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3fe0042a70 con 0x7f3fec12cf70 2023-09-30T22:22:24.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.806+0000 7f3ff1201700 1 -- 172.21.15.156:0/1446440602 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fec135090 con 0x7f3fec12cf70 2023-09-30T22:22:24.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.814+0000 7f27e98f0700 1 Processor -- start 2023-09-30T22:22:24.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.814+0000 7f27e98f0700 1 -- start start 2023-09-30T22:22:24.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.815+0000 7f3fd37fe700 1 -- 172.21.15.156:0/1446440602 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3fe001e070 con 0x7f3fec12cf70 2023-09-30T22:22:24.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.815+0000 7f27e98f0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27e4134140 0x7f27e4138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.815+0000 7f27e98f0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f27e4134570 0x7f27e413b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.815+0000 7f27e98f0700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e409b110 con 0x7f27e409ad40 2023-09-30T22:22:24.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.815+0000 7f27e98f0700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e40a3b60 con 0x7f27e4134570 2023-09-30T22:22:24.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.815+0000 7f27e98f0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27e40a1a80 con 0x7f27e4134140 2023-09-30T22:22:24.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.815+0000 7f27e2ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f27e409ad40 0x7f27e4133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:56372/0 (socket says 172.21.15.156:56372) 2023-09-30T22:22:24.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.815+0000 7f27e37fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f27e4134570 0x7f27e413b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.815+0000 7f27e2ffd700 1 -- 172.21.15.156:0/1659998902 learned_addr learned my addr 172.21.15.156:0/1659998902 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:24.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.815+0000 7f27e27fc700 1 --2- 172.21.15.156:0/1659998902 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27e4134140 0x7f27e4138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.816+0000 7f27e1ffb700 1 -- 172.21.15.156:0/1659998902 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 379008002 0 0) 0x7f27e409b110 con 0x7f27e409ad40 2023-09-30T22:22:24.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.816+0000 7f27e1ffb700 1 -- 172.21.15.156:0/1659998902 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27cc0035b0 con 0x7f27e409ad40 2023-09-30T22:22:24.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.816+0000 7f27e27fc700 1 -- 172.21.15.156:0/1659998902 >> v2:172.21.15.156:3300/0 conn(0x7f27e4134570 msgr2=0x7f27e413b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:24.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.816+0000 7f27e27fc700 1 --2- 172.21.15.156:0/1659998902 >> v2:172.21.15.156:3300/0 conn(0x7f27e4134570 0x7f27e413b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.816+0000 7f27e27fc700 1 -- 172.21.15.156:0/1659998902 >> v1:172.21.15.156:6789/0 conn(0x7f27e409ad40 legacy=0x7f27e4133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.816+0000 7f27e27fc700 1 -- 172.21.15.156:0/1659998902 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e40a2fa0 con 0x7f27e4134140 2023-09-30T22:22:24.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.816+0000 7f27e27fc700 1 --2- 172.21.15.156:0/1659998902 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27e4134140 0x7f27e4138e80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f27d8009840 tx=0x7f27d8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e694fe9ee57a18d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:24.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.816+0000 7f27e1ffb700 1 -- 172.21.15.156:0/1659998902 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d8011830 con 0x7f27e4134140 2023-09-30T22:22:24.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.816+0000 7f27e1ffb700 1 -- 172.21.15.156:0/1659998902 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d8011990 con 0x7f27e4134140 2023-09-30T22:22:24.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.816+0000 7f27e1ffb700 1 -- 172.21.15.156:0/1659998902 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d8011d20 con 0x7f27e4134140 2023-09-30T22:22:24.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.817+0000 7f27e98f0700 1 -- 172.21.15.156:0/1659998902 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27e4134140 msgr2=0x7f27e4138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.817+0000 7f27e98f0700 1 --2- 172.21.15.156:0/1659998902 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27e4134140 0x7f27e4138e80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f27d8009840 tx=0x7f27d8009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:24.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.817+0000 7f27e98f0700 1 -- 172.21.15.156:0/1659998902 shutdown_connections 2023-09-30T22:22:24.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.817+0000 7f27e98f0700 1 --2- 172.21.15.156:0/1659998902 >> v2:172.21.15.156:3300/0 conn(0x7f27e4134570 0x7f27e413b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.817+0000 7f27e98f0700 1 --2- 172.21.15.156:0/1659998902 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27e4134140 0x7f27e4138e80 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.817+0000 7f27e98f0700 1 -- 172.21.15.156:0/1659998902 >> 172.21.15.156:0/1659998902 conn(0x7f27e4099c40 msgr2=0x7f27e406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:24.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.817+0000 7f27e98f0700 1 -- 172.21.15.156:0/1659998902 shutdown_connections 2023-09-30T22:22:24.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.817+0000 7f27e98f0700 1 -- 172.21.15.156:0/1659998902 wait complete. 2023-09-30T22:22:24.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.818+0000 7f27e98f0700 1 Processor -- start 2023-09-30T22:22:24.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.819+0000 7f27e98f0700 1 -- start start 2023-09-30T22:22:24.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.819+0000 7f27e98f0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27e409ad40 0x7f27e411c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.819+0000 7f27e98f0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27e4134140 0x7f27e411ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.819+0000 7f27e98f0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27e4134570 0x7f27e411d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.819+0000 7f27e98f0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e411f010 con 0x7f27e4134570 2023-09-30T22:22:24.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.819+0000 7f27e98f0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e411e7e0 con 0x7f27e409ad40 2023-09-30T22:22:24.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.819+0000 7f27e98f0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27e40a4330 con 0x7f27e4134140 2023-09-30T22:22:24.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.819+0000 7f27e2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27e409ad40 0x7f27e411c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.819+0000 7f27e2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27e409ad40 0x7f27e411c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33338/0 (socket says 172.21.15.156:33338) 2023-09-30T22:22:24.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.819+0000 7f27e2ffd700 1 -- 172.21.15.156:0/2717285411 learned_addr learned my addr 172.21.15.156:0/2717285411 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:24.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.819+0000 7f27e27fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27e4134140 0x7f27e411ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.819+0000 7f27e37fe700 1 --2- 172.21.15.156:0/2717285411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27e4134570 0x7f27e411d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.820+0000 7f27e27fc700 1 -- 172.21.15.156:0/2717285411 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27e409ad40 msgr2=0x7f27e411c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.820+0000 7f27e27fc700 1 --2- 172.21.15.156:0/2717285411 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27e409ad40 0x7f27e411c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.820+0000 7f27e27fc700 1 -- 172.21.15.156:0/2717285411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27e4134570 msgr2=0x7f27e411d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.820+0000 7f27e27fc700 1 --2- 172.21.15.156:0/2717285411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27e4134570 0x7f27e411d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.820+0000 7f27e27fc700 1 -- 172.21.15.156:0/2717285411 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d80094a0 con 0x7f27e4134140 2023-09-30T22:22:24.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.820+0000 7f27e2ffd700 1 --2- 172.21.15.156:0/2717285411 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27e409ad40 0x7f27e411c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:24.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.820+0000 7f27e37fe700 1 --2- 172.21.15.156:0/2717285411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27e4134570 0x7f27e411d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:24.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.820+0000 7f27e27fc700 1 --2- 172.21.15.156:0/2717285411 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27e4134140 0x7f27e411ce00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f27e40a0830 tx=0x7f27d8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:24.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.820+0000 7f27cbfff700 1 -- 172.21.15.156:0/2717285411 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d8004590 con 0x7f27e4134140 2023-09-30T22:22:24.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.820+0000 7f27cbfff700 1 -- 172.21.15.156:0/2717285411 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d801e070 con 0x7f27e4134140 2023-09-30T22:22:24.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.820+0000 7f27e98f0700 1 -- 172.21.15.156:0/2717285411 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e409c7e0 con 0x7f27e4134140 2023-09-30T22:22:24.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.820+0000 7f27cbfff700 1 -- 172.21.15.156:0/2717285411 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d80038e0 con 0x7f27e4134140 2023-09-30T22:22:24.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.820+0000 7f27e98f0700 1 -- 172.21.15.156:0/2717285411 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e41398a0 con 0x7f27e4134140 2023-09-30T22:22:24.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.821+0000 7f27cbfff700 1 -- 172.21.15.156:0/2717285411 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f27d8003a40 con 0x7f27e4134140 2023-09-30T22:22:24.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.821+0000 7f27e98f0700 1 -- 172.21.15.156:0/2717285411 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e41361e0 con 0x7f27e4134140 2023-09-30T22:22:24.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.821+0000 7f27cbfff700 1 -- 172.21.15.156:0/2717285411 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f27d8040350 con 0x7f27e4134140 2023-09-30T22:22:24.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.826+0000 7f27cbfff700 1 -- 172.21.15.156:0/2717285411 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f27d802c3b0 con 0x7f27e4134140 2023-09-30T22:22:24.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.910+0000 7f7142fa0700 1 -- 172.21.15.156:0/1995711118 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f713c072980 con 0x7f713c134120 2023-09-30T22:22:24.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.910+0000 7f71397fa700 1 -- 172.21.15.156:0/1995711118 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f713402c030 con 0x7f713c134120 2023-09-30T22:22:24.911 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:24.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.912+0000 7f7142fa0700 1 -- 172.21.15.156:0/1995711118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f713c134120 msgr2=0x7f713c06e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.912+0000 7f7142fa0700 1 --2- 172.21.15.156:0/1995711118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f713c134120 0x7f713c06e540 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f713400b730 tx=0x7f7134004ad0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.912+0000 7f7142fa0700 1 -- 172.21.15.156:0/1995711118 shutdown_connections 2023-09-30T22:22:24.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.912+0000 7f7142fa0700 1 --2- 172.21.15.156:0/1995711118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f713c134120 0x7f713c06e540 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.912+0000 7f7142fa0700 1 --2- 172.21.15.156:0/1995711118 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f713c0a0a70 0x7f713c06dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.912+0000 7f7142fa0700 1 --2- 172.21.15.156:0/1995711118 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f713c0a1380 0x7f713c06e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.912+0000 7f7142fa0700 1 -- 172.21.15.156:0/1995711118 >> 172.21.15.156:0/1995711118 conn(0x7f713c0a6610 msgr2=0x7f713c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:24.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.912+0000 7f7142fa0700 1 -- 172.21.15.156:0/1995711118 shutdown_connections 2023-09-30T22:22:24.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:24.912+0000 7f7142fa0700 1 -- 172.21.15.156:0/1995711118 wait complete. 2023-09-30T22:22:24.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:25.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.012+0000 7f3ff1201700 1 -- 172.21.15.156:0/1446440602 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3fec04f2a0 con 0x7f3fec12cf70 2023-09-30T22:22:25.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.012+0000 7f3fd37fe700 1 -- 172.21.15.156:0/1446440602 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3fe0018980 con 0x7f3fec12cf70 2023-09-30T22:22:25.013 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:25.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.014+0000 7f3ff1201700 1 -- 172.21.15.156:0/1446440602 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fec12cf70 msgr2=0x7f3fec1316a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.014+0000 7f3ff1201700 1 --2- 172.21.15.156:0/1446440602 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fec12cf70 0x7f3fec1316a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3fe00018d0 tx=0x7f3fe0001be0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.014+0000 7f3ff1201700 1 -- 172.21.15.156:0/1446440602 shutdown_connections 2023-09-30T22:22:25.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.014+0000 7f3ff1201700 1 --2- 172.21.15.156:0/1446440602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fec130720 0x7f3fec131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.014+0000 7f3ff1201700 1 --2- 172.21.15.156:0/1446440602 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fec09bb60 0x7f3fec131160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.014+0000 7f3ff1201700 1 --2- 172.21.15.156:0/1446440602 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fec12cf70 0x7f3fec1316a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.014+0000 7f3ff1201700 1 -- 172.21.15.156:0/1446440602 >> 172.21.15.156:0/1446440602 conn(0x7f3fec0a2d80 msgr2=0x7f3fec09f880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:25.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.014+0000 7f3ff1201700 1 -- 172.21.15.156:0/1446440602 shutdown_connections 2023-09-30T22:22:25.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.014+0000 7f3ff1201700 1 -- 172.21.15.156:0/1446440602 wait complete. 2023-09-30T22:22:25.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.022+0000 7f27e98f0700 1 -- 172.21.15.156:0/2717285411 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f27e404f2a0 con 0x7f27e4134140 2023-09-30T22:22:25.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.022+0000 7f27cbfff700 1 -- 172.21.15.156:0/2717285411 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f27d8015030 con 0x7f27e4134140 2023-09-30T22:22:25.023 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:25.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.025+0000 7f27e98f0700 1 -- 172.21.15.156:0/2717285411 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27e4134140 msgr2=0x7f27e411ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.025+0000 7f27e98f0700 1 --2- 172.21.15.156:0/2717285411 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27e4134140 0x7f27e411ce00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f27e40a0830 tx=0x7f27d8004750 comp rx=0 tx=0).stop 2023-09-30T22:22:25.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.025+0000 7f27e98f0700 1 -- 172.21.15.156:0/2717285411 shutdown_connections 2023-09-30T22:22:25.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.025+0000 7f27e98f0700 1 --2- 172.21.15.156:0/2717285411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27e4134570 0x7f27e411d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.025+0000 7f27e98f0700 1 --2- 172.21.15.156:0/2717285411 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f27e409ad40 0x7f27e411c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.025+0000 7f27e98f0700 1 --2- 172.21.15.156:0/2717285411 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f27e4134140 0x7f27e411ce00 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.025+0000 7f27e98f0700 1 -- 172.21.15.156:0/2717285411 >> 172.21.15.156:0/2717285411 conn(0x7f27e4099c40 msgr2=0x7f27e413afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:25.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.025+0000 7f27e98f0700 1 -- 172.21.15.156:0/2717285411 shutdown_connections 2023-09-30T22:22:25.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.025+0000 7f27e98f0700 1 -- 172.21.15.156:0/2717285411 wait complete. 2023-09-30T22:22:25.027 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:25.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:25.091 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:25.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.213+0000 7f1900567700 1 Processor -- start 2023-09-30T22:22:25.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.213+0000 7f1900567700 1 -- start start 2023-09-30T22:22:25.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.214+0000 7f1900567700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18f8133ad0 0x7f18f8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:25.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.214+0000 7f1900567700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18f81300a0 0x7f18f81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:25.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.214+0000 7f1900567700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f18f81309f0 0x7f18f813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:25.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.214+0000 7f1900567700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f806b2d0 con 0x7f18f81309f0 2023-09-30T22:22:25.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.214+0000 7f1900567700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f8133610 con 0x7f18f81300a0 2023-09-30T22:22:25.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.214+0000 7f1900567700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18f809a500 con 0x7f18f8133ad0 2023-09-30T22:22:25.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.214+0000 7f18fe303700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18f8133ad0 0x7f18f8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:25.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.214+0000 7f18feb04700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f18f81309f0 0x7f18f813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:25.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.214+0000 7f18fdb02700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18f81300a0 0x7f18f81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:25.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.214+0000 7f18fe303700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18f8133ad0 0x7f18f8133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51292/0 (socket says 172.21.15.156:51292) 2023-09-30T22:22:25.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.214+0000 7f18feb04700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f18f81309f0 0x7f18f813a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59854/0 (socket says 172.21.15.156:59854) 2023-09-30T22:22:25.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.214+0000 7f18fdb02700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18f81300a0 0x7f18f81304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33340/0 (socket says 172.21.15.156:33340) 2023-09-30T22:22:25.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.214+0000 7f18fe303700 1 -- 172.21.15.156:0/3859335858 learned_addr learned my addr 172.21.15.156:0/3859335858 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:25.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.214+0000 7f18fe303700 1 -- 172.21.15.156:0/3859335858 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18f81300a0 msgr2=0x7f18f81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:25.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.214+0000 7f18fe303700 1 --2- 172.21.15.156:0/3859335858 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18f81300a0 0x7f18f81304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.214+0000 7f18fe303700 1 -- 172.21.15.156:0/3859335858 >> v2:172.21.15.156:3300/0 conn(0x7f18f81309f0 msgr2=0x7f18f813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:25.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.214+0000 7f18fe303700 1 --2- 172.21.15.156:0/3859335858 >> v2:172.21.15.156:3300/0 conn(0x7f18f81309f0 0x7f18f813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.214+0000 7f18fe303700 1 -- 172.21.15.156:0/3859335858 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f81338b0 con 0x7f18f8133ad0 2023-09-30T22:22:25.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.215+0000 7f18fe303700 1 --2- 172.21.15.156:0/3859335858 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18f8133ad0 0x7f18f8133ea0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f18e80098f0 tx=0x7f18e8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e90beb88771447d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:25.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.215+0000 7f18fd301700 1 -- 172.21.15.156:0/3859335858 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e8011830 con 0x7f18f8133ad0 2023-09-30T22:22:25.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.215+0000 7f18fd301700 1 -- 172.21.15.156:0/3859335858 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e8011990 con 0x7f18f8133ad0 2023-09-30T22:22:25.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.215+0000 7f18fd301700 1 -- 172.21.15.156:0/3859335858 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e8011d20 con 0x7f18f8133ad0 2023-09-30T22:22:25.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.215+0000 7f1900567700 1 -- 172.21.15.156:0/3859335858 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18f8133ad0 msgr2=0x7f18f8133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.215+0000 7f1900567700 1 --2- 172.21.15.156:0/3859335858 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18f8133ad0 0x7f18f8133ea0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f18e80098f0 tx=0x7f18e8009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:25.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.215+0000 7f1900567700 1 -- 172.21.15.156:0/3859335858 shutdown_connections 2023-09-30T22:22:25.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.215+0000 7f1900567700 1 --2- 172.21.15.156:0/3859335858 >> v2:172.21.15.156:3300/0 conn(0x7f18f81309f0 0x7f18f813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.215+0000 7f1900567700 1 --2- 172.21.15.156:0/3859335858 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18f8133ad0 0x7f18f8133ea0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.215+0000 7f1900567700 1 --2- 172.21.15.156:0/3859335858 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18f81300a0 0x7f18f81304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.215+0000 7f1900567700 1 -- 172.21.15.156:0/3859335858 >> 172.21.15.156:0/3859335858 conn(0x7f18f8099c40 msgr2=0x7f18f80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:25.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.215+0000 7f1900567700 1 -- 172.21.15.156:0/3859335858 shutdown_connections 2023-09-30T22:22:25.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.215+0000 7f1900567700 1 -- 172.21.15.156:0/3859335858 wait complete. 2023-09-30T22:22:25.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.216+0000 7f1900567700 1 Processor -- start 2023-09-30T22:22:25.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.216+0000 7f1900567700 1 -- start start 2023-09-30T22:22:25.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.217+0000 7f1900567700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18f81300a0 0x7f18f811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:25.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.217+0000 7f1900567700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18f81309f0 0x7f18f811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:25.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.217+0000 7f1900567700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18f8133ad0 0x7f18f811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:25.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.217+0000 7f1900567700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f811ffe0 con 0x7f18f8133ad0 2023-09-30T22:22:25.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.217+0000 7f1900567700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f811f770 con 0x7f18f81309f0 2023-09-30T22:22:25.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.217+0000 7f1900567700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18f812d890 con 0x7f18f81300a0 2023-09-30T22:22:25.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.217+0000 7f18fe303700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18f81300a0 0x7f18f811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:25.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.217+0000 7f18fdb02700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18f81309f0 0x7f18f811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:25.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.217+0000 7f18fe303700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18f81300a0 0x7f18f811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51298/0 (socket says 172.21.15.156:51298) 2023-09-30T22:22:25.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.217+0000 7f18fe303700 1 -- 172.21.15.156:0/1973917482 learned_addr learned my addr 172.21.15.156:0/1973917482 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:25.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.217+0000 7f18fdb02700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18f81309f0 0x7f18f811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33354/0 (socket says 172.21.15.156:33354) 2023-09-30T22:22:25.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.217+0000 7f18feb04700 1 --2- 172.21.15.156:0/1973917482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18f8133ad0 0x7f18f811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:25.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.217+0000 7f18fe303700 1 -- 172.21.15.156:0/1973917482 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18f81309f0 msgr2=0x7f18f811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.217+0000 7f18fe303700 1 --2- 172.21.15.156:0/1973917482 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18f81309f0 0x7f18f811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.217+0000 7f18fe303700 1 -- 172.21.15.156:0/1973917482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18f8133ad0 msgr2=0x7f18f811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.217+0000 7f18fe303700 1 --2- 172.21.15.156:0/1973917482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18f8133ad0 0x7f18f811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.217+0000 7f18fe303700 1 -- 172.21.15.156:0/1973917482 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e8009550 con 0x7f18f81300a0 2023-09-30T22:22:25.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.217+0000 7f18fe303700 1 --2- 172.21.15.156:0/1973917482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18f81300a0 0x7f18f811da40 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f18e8009c40 tx=0x7f18e8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:25.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.217+0000 7f18eeffd700 1 -- 172.21.15.156:0/1973917482 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e8004450 con 0x7f18f81300a0 2023-09-30T22:22:25.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.217+0000 7f18eeffd700 1 -- 172.21.15.156:0/1973917482 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e80045b0 con 0x7f18f81300a0 2023-09-30T22:22:25.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.217+0000 7f1900567700 1 -- 172.21.15.156:0/1973917482 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f80a2ea0 con 0x7f18f81300a0 2023-09-30T22:22:25.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.217+0000 7f18eeffd700 1 -- 172.21.15.156:0/1973917482 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e80038e0 con 0x7f18f81300a0 2023-09-30T22:22:25.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.218+0000 7f1900567700 1 -- 172.21.15.156:0/1973917482 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f8071460 con 0x7f18f81300a0 2023-09-30T22:22:25.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.218+0000 7f18eeffd700 1 -- 172.21.15.156:0/1973917482 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f18e8003a40 con 0x7f18f81300a0 2023-09-30T22:22:25.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.218+0000 7f18eeffd700 1 -- 172.21.15.156:0/1973917482 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f18e8040500 con 0x7f18f81300a0 2023-09-30T22:22:25.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.218+0000 7f1900567700 1 -- 172.21.15.156:0/1973917482 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f809cb20 con 0x7f18f81300a0 2023-09-30T22:22:25.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.223+0000 7f18eeffd700 1 -- 172.21.15.156:0/1973917482 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f18e8028080 con 0x7f18f81300a0 2023-09-30T22:22:25.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.407+0000 7f1900567700 1 -- 172.21.15.156:0/1973917482 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f18f804f2a0 con 0x7f18f81300a0 2023-09-30T22:22:25.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.407+0000 7f18eeffd700 1 -- 172.21.15.156:0/1973917482 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f18e8015020 con 0x7f18f81300a0 2023-09-30T22:22:25.408 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:25.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.409+0000 7f1900567700 1 -- 172.21.15.156:0/1973917482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18f81300a0 msgr2=0x7f18f811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.409+0000 7f1900567700 1 --2- 172.21.15.156:0/1973917482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18f81300a0 0x7f18f811da40 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f18e8009c40 tx=0x7f18e8004750 comp rx=0 tx=0).stop 2023-09-30T22:22:25.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.409+0000 7f1900567700 1 -- 172.21.15.156:0/1973917482 shutdown_connections 2023-09-30T22:22:25.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.409+0000 7f1900567700 1 --2- 172.21.15.156:0/1973917482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18f8133ad0 0x7f18f811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.409+0000 7f1900567700 1 --2- 172.21.15.156:0/1973917482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18f81300a0 0x7f18f811da40 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.409+0000 7f1900567700 1 --2- 172.21.15.156:0/1973917482 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18f81309f0 0x7f18f811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.409+0000 7f1900567700 1 -- 172.21.15.156:0/1973917482 >> 172.21.15.156:0/1973917482 conn(0x7f18f8099c40 msgr2=0x7f18f8132c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:25.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.409+0000 7f1900567700 1 -- 172.21.15.156:0/1973917482 shutdown_connections 2023-09-30T22:22:25.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:25.409+0000 7f1900567700 1 -- 172.21.15.156:0/1973917482 wait complete. 2023-09-30T22:22:25.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:25.926 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:26.028 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:26.038 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:26.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.050+0000 7fe1c7c86700 1 Processor -- start 2023-09-30T22:22:26.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.051+0000 7fe1c7c86700 1 -- start start 2023-09-30T22:22:26.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.052+0000 7fe1c7c86700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe1c0136950 0x7fe1c0138d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:26.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.052+0000 7fe1c7c86700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1c0139270 0x7fe1c013b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:26.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.052+0000 7fe1c7c86700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c0133640 con 0x7fe1c0133a70 2023-09-30T22:22:26.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.052+0000 7fe1c7c86700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c00a1d50 con 0x7fe1c0136950 2023-09-30T22:22:26.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.052+0000 7fe1c7c86700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c0134550 con 0x7fe1c0139270 2023-09-30T22:22:26.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.052+0000 7fe1c5221700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe1c0136950 0x7fe1c0138d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:26.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.052+0000 7fe1c6223700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1c0139270 0x7fe1c013b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:26.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.052+0000 7fe1c5221700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe1c0136950 0x7fe1c0138d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59868/0 (socket says 172.21.15.156:59868) 2023-09-30T22:22:26.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.052+0000 7fe1c5a22700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe1c0133a70 0x7fe1c0133e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:56384/0 (socket says 172.21.15.156:56384) 2023-09-30T22:22:26.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.052+0000 7fe1c6223700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1c0139270 0x7fe1c013b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51310/0 (socket says 172.21.15.156:51310) 2023-09-30T22:22:26.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.052+0000 7fe1c5221700 1 -- 172.21.15.156:0/743514684 learned_addr learned my addr 172.21.15.156:0/743514684 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:26.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.052+0000 7fe1c6223700 1 -- 172.21.15.156:0/743514684 >> v2:172.21.15.156:3300/0 conn(0x7fe1c0136950 msgr2=0x7fe1c0138d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:26.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.052+0000 7fe1c6223700 1 --2- 172.21.15.156:0/743514684 >> v2:172.21.15.156:3300/0 conn(0x7fe1c0136950 0x7fe1c0138d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.052+0000 7fe1c6223700 1 -- 172.21.15.156:0/743514684 >> v1:172.21.15.156:6789/0 conn(0x7fe1c0133a70 legacy=0x7fe1c0133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.052+0000 7fe1c6223700 1 -- 172.21.15.156:0/743514684 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c009b620 con 0x7fe1c0139270 2023-09-30T22:22:26.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.052+0000 7fe1c5221700 1 --2- 172.21.15.156:0/743514684 >> v2:172.21.15.156:3300/0 conn(0x7fe1c0136950 0x7fe1c0138d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:26.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.052+0000 7fe1c6223700 1 --2- 172.21.15.156:0/743514684 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1c0139270 0x7fe1c013b650 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8009d90 tx=0x7fe1b800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70d4bf407b5f0620 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:26.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.052+0000 7fe1c4a20700 1 -- 172.21.15.156:0/743514684 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b800e070 con 0x7fe1c0139270 2023-09-30T22:22:26.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.052+0000 7fe1c4a20700 1 -- 172.21.15.156:0/743514684 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b800bb20 con 0x7fe1c0139270 2023-09-30T22:22:26.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.052+0000 7fe1c4a20700 1 -- 172.21.15.156:0/743514684 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8012430 con 0x7fe1c0139270 2023-09-30T22:22:26.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.053+0000 7fe1c7c86700 1 -- 172.21.15.156:0/743514684 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1c0139270 msgr2=0x7fe1c013b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.053+0000 7fe1c7c86700 1 --2- 172.21.15.156:0/743514684 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1c0139270 0x7fe1c013b650 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8009d90 tx=0x7fe1b800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:26.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.053+0000 7fe1c7c86700 1 -- 172.21.15.156:0/743514684 shutdown_connections 2023-09-30T22:22:26.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.053+0000 7fe1c7c86700 1 --2- 172.21.15.156:0/743514684 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1c0139270 0x7fe1c013b650 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.053+0000 7fe1c7c86700 1 --2- 172.21.15.156:0/743514684 >> v2:172.21.15.156:3300/0 conn(0x7fe1c0136950 0x7fe1c0138d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.053+0000 7fe1c7c86700 1 -- 172.21.15.156:0/743514684 >> 172.21.15.156:0/743514684 conn(0x7fe1c00a2980 msgr2=0x7fe1c00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:26.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.053+0000 7fe1c7c86700 1 -- 172.21.15.156:0/743514684 shutdown_connections 2023-09-30T22:22:26.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.053+0000 7fe1c7c86700 1 -- 172.21.15.156:0/743514684 wait complete. 2023-09-30T22:22:26.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.054+0000 7fe1c7c86700 1 Processor -- start 2023-09-30T22:22:26.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.055+0000 7fe1c7c86700 1 -- start start 2023-09-30T22:22:26.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.055+0000 7fe1c7c86700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1c0133a70 0x7fe1c0119d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:26.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.055+0000 7fe1c7c86700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1c0136950 0x7fe1c011a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:26.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.055+0000 7fe1c7c86700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1c0139270 0x7fe1c011a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:26.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.055+0000 7fe1c7c86700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c012f550 con 0x7fe1c0139270 2023-09-30T22:22:26.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.055+0000 7fe1c7c86700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c011c2f0 con 0x7fe1c0136950 2023-09-30T22:22:26.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.055+0000 7fe1c7c86700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c011b830 con 0x7fe1c0133a70 2023-09-30T22:22:26.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.055+0000 7fe1c5221700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1c0136950 0x7fe1c011a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:26.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.055+0000 7fe1c5a22700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1c0133a70 0x7fe1c0119d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:26.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.055+0000 7fe1c5221700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1c0136950 0x7fe1c011a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33360/0 (socket says 172.21.15.156:33360) 2023-09-30T22:22:26.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.055+0000 7fe1c5221700 1 -- 172.21.15.156:0/1154678624 learned_addr learned my addr 172.21.15.156:0/1154678624 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:26.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.055+0000 7fe1c5a22700 1 --2- 172.21.15.156:0/1154678624 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1c0133a70 0x7fe1c0119d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51324/0 (socket says 172.21.15.156:51324) 2023-09-30T22:22:26.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.055+0000 7fe1c6223700 1 --2- 172.21.15.156:0/1154678624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1c0139270 0x7fe1c011a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:26.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.056+0000 7fe1c5221700 1 -- 172.21.15.156:0/1154678624 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1c0133a70 msgr2=0x7fe1c0119d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.056+0000 7fe1c5221700 1 --2- 172.21.15.156:0/1154678624 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1c0133a70 0x7fe1c0119d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.056+0000 7fe1c5221700 1 -- 172.21.15.156:0/1154678624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1c0139270 msgr2=0x7fe1c011a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.056+0000 7fe1c5221700 1 --2- 172.21.15.156:0/1154678624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1c0139270 0x7fe1c011a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.056+0000 7fe1c5221700 1 -- 172.21.15.156:0/1154678624 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b0009550 con 0x7fe1c0136950 2023-09-30T22:22:26.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.056+0000 7fe1c5a22700 1 --2- 172.21.15.156:0/1154678624 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1c0133a70 0x7fe1c0119d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:26.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.056+0000 7fe1c5221700 1 --2- 172.21.15.156:0/1154678624 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1c0136950 0x7fe1c011a240 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000ebe0 tx=0x7fe1b000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:26.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.056+0000 7fe1b67fc700 1 -- 172.21.15.156:0/1154678624 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b000c850 con 0x7fe1c0136950 2023-09-30T22:22:26.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.056+0000 7fe1b67fc700 1 -- 172.21.15.156:0/1154678624 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b000c9b0 con 0x7fe1c0136950 2023-09-30T22:22:26.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.056+0000 7fe1c7c86700 1 -- 172.21.15.156:0/1154678624 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b8009a70 con 0x7fe1c0136950 2023-09-30T22:22:26.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.056+0000 7fe1b67fc700 1 -- 172.21.15.156:0/1154678624 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b000cd20 con 0x7fe1c0136950 2023-09-30T22:22:26.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.056+0000 7fe1c7c86700 1 -- 172.21.15.156:0/1154678624 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c0138e60 con 0x7fe1c0136950 2023-09-30T22:22:26.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.057+0000 7fe1b67fc700 1 -- 172.21.15.156:0/1154678624 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe1b0013470 con 0x7fe1c0136950 2023-09-30T22:22:26.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.057+0000 7fe1c7c86700 1 -- 172.21.15.156:0/1154678624 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c009a3b0 con 0x7fe1c0136950 2023-09-30T22:22:26.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.057+0000 7fe1b67fc700 1 -- 172.21.15.156:0/1154678624 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe1b003f490 con 0x7fe1c0136950 2023-09-30T22:22:26.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.063+0000 7fe1b67fc700 1 -- 172.21.15.156:0/1154678624 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe1b00102b0 con 0x7fe1c0136950 2023-09-30T22:22:26.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.157+0000 7f3f43ade700 1 Processor -- start 2023-09-30T22:22:26.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.157+0000 7f3f43ade700 1 -- start start 2023-09-30T22:22:26.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.158+0000 7f3f43ade700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f3c133a70 0x7f3f3c133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:26.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.158+0000 7f3f43ade700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f3c0a08e0 0x7f3f3c0a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:26.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.158+0000 7f3f43ade700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3f3c0a1290 0x7f3f3c13a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:26.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.158+0000 7f3f43ade700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f3c133640 con 0x7f3f3c0a1290 2023-09-30T22:22:26.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.158+0000 7f3f43ade700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c0a1d50 con 0x7f3f3c0a08e0 2023-09-30T22:22:26.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.158+0000 7f3f43ade700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c0a1730 con 0x7f3f3c133a70 2023-09-30T22:22:26.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.158+0000 7f3f41079700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f3c0a08e0 0x7f3f3c0a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:26.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.158+0000 7f3f41079700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f3c0a08e0 0x7f3f3c0a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33376/0 (socket says 172.21.15.156:33376) 2023-09-30T22:22:26.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.158+0000 7f3f41079700 1 -- 172.21.15.156:0/3636405744 learned_addr learned my addr 172.21.15.156:0/3636405744 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:26.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.158+0000 7f3f4187a700 1 --2- 172.21.15.156:0/3636405744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f3c133a70 0x7f3f3c133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:26.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.158+0000 7f3f4207b700 1 --2- 172.21.15.156:0/3636405744 >> v2:172.21.15.156:3300/0 conn(0x7f3f3c0a1290 0x7f3f3c13a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:26.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.158+0000 7f3f4207b700 1 -- 172.21.15.156:0/3636405744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f3c133a70 msgr2=0x7f3f3c133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:26.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.158+0000 7f3f4207b700 1 --2- 172.21.15.156:0/3636405744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f3c133a70 0x7f3f3c133e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.158+0000 7f3f4207b700 1 -- 172.21.15.156:0/3636405744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f3c0a08e0 msgr2=0x7f3f3c0a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:26.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.158+0000 7f3f4207b700 1 --2- 172.21.15.156:0/3636405744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f3c0a08e0 0x7f3f3c0a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.158+0000 7f3f4207b700 1 -- 172.21.15.156:0/3636405744 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3c09b620 con 0x7f3f3c0a1290 2023-09-30T22:22:26.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.158+0000 7f3f41079700 1 --2- 172.21.15.156:0/3636405744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f3c0a08e0 0x7f3f3c0a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:26.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.158+0000 7f3f4207b700 1 --2- 172.21.15.156:0/3636405744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f3c0a1290 0x7f3f3c13a970 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009d90 tx=0x7f3f3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbbd936fc741bc24 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:26.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.158+0000 7f3f40878700 1 -- 172.21.15.156:0/3636405744 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3400e070 con 0x7f3f3c0a1290 2023-09-30T22:22:26.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.159+0000 7f3f40878700 1 -- 172.21.15.156:0/3636405744 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3400bb20 con 0x7f3f3c0a1290 2023-09-30T22:22:26.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.159+0000 7f3f40878700 1 -- 172.21.15.156:0/3636405744 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34012430 con 0x7f3f3c0a1290 2023-09-30T22:22:26.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.159+0000 7f3f43ade700 1 -- 172.21.15.156:0/3636405744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f3c0a1290 msgr2=0x7f3f3c13a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.159+0000 7f3f43ade700 1 --2- 172.21.15.156:0/3636405744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f3c0a1290 0x7f3f3c13a970 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009d90 tx=0x7f3f3400b330 comp rx=0 tx=0).stop 2023-09-30T22:22:26.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.159+0000 7f3f43ade700 1 -- 172.21.15.156:0/3636405744 shutdown_connections 2023-09-30T22:22:26.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.159+0000 7f3f43ade700 1 --2- 172.21.15.156:0/3636405744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f3c0a1290 0x7f3f3c13a970 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.159+0000 7f3f43ade700 1 --2- 172.21.15.156:0/3636405744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f3c133a70 0x7f3f3c133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.159+0000 7f3f43ade700 1 --2- 172.21.15.156:0/3636405744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f3c0a08e0 0x7f3f3c0a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.159+0000 7f3f43ade700 1 -- 172.21.15.156:0/3636405744 >> 172.21.15.156:0/3636405744 conn(0x7f3f3c0a2980 msgr2=0x7f3f3c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:26.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.159+0000 7f3f43ade700 1 -- 172.21.15.156:0/3636405744 shutdown_connections 2023-09-30T22:22:26.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.159+0000 7f3f43ade700 1 -- 172.21.15.156:0/3636405744 wait complete. 2023-09-30T22:22:26.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.161+0000 7f3f43ade700 1 Processor -- start 2023-09-30T22:22:26.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.161+0000 7f3f43ade700 1 -- start start 2023-09-30T22:22:26.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.161+0000 7f3f43ade700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f3c0a08e0 0x7f3f3c11c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:26.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.161+0000 7f3f43ade700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f3c0a1290 0x7f3f3c11cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:26.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.161+0000 7f3f43ade700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f3c133a70 0x7f3f3c11d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:26.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.161+0000 7f3f43ade700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c11e2c0 con 0x7f3f3c0a1290 2023-09-30T22:22:26.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.161+0000 7f3f43ade700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c11dcc0 con 0x7f3f3c0a08e0 2023-09-30T22:22:26.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.161+0000 7f3f43ade700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c11fd30 con 0x7f3f3c133a70 2023-09-30T22:22:26.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.161+0000 7f3f4187a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f3c0a08e0 0x7f3f3c11c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:26.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.161+0000 7f3f4187a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f3c0a08e0 0x7f3f3c11c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33392/0 (socket says 172.21.15.156:33392) 2023-09-30T22:22:26.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.161+0000 7f3f41079700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f3c0a1290 0x7f3f3c11cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:26.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.161+0000 7f3f4187a700 1 -- 172.21.15.156:0/629980621 learned_addr learned my addr 172.21.15.156:0/629980621 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:26.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.162+0000 7f3f4207b700 1 --2- 172.21.15.156:0/629980621 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f3c133a70 0x7f3f3c11d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:26.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.162+0000 7f3f4187a700 1 -- 172.21.15.156:0/629980621 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f3c133a70 msgr2=0x7f3f3c11d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.162+0000 7f3f4187a700 1 --2- 172.21.15.156:0/629980621 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f3c133a70 0x7f3f3c11d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.162+0000 7f3f4187a700 1 -- 172.21.15.156:0/629980621 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f3c0a1290 msgr2=0x7f3f3c11cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.162+0000 7f3f4187a700 1 --2- 172.21.15.156:0/629980621 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f3c0a1290 0x7f3f3c11cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.162+0000 7f3f4187a700 1 -- 172.21.15.156:0/629980621 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2c009550 con 0x7f3f3c0a08e0 2023-09-30T22:22:26.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.162+0000 7f3f41079700 1 --2- 172.21.15.156:0/629980621 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f3c0a1290 0x7f3f3c11cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:26.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.162+0000 7f3f4187a700 1 --2- 172.21.15.156:0/629980621 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f3c0a08e0 0x7f3f3c11c830 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800e9e0 tx=0x7f3f3800ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:26.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.162+0000 7f3f327fc700 1 -- 172.21.15.156:0/629980621 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f38009710 con 0x7f3f3c0a08e0 2023-09-30T22:22:26.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.162+0000 7f3f327fc700 1 -- 172.21.15.156:0/629980621 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3800ee80 con 0x7f3f3c0a08e0 2023-09-30T22:22:26.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.162+0000 7f3f327fc700 1 -- 172.21.15.156:0/629980621 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3800ca70 con 0x7f3f3c0a08e0 2023-09-30T22:22:26.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.162+0000 7f3f43ade700 1 -- 172.21.15.156:0/629980621 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f34009a70 con 0x7f3f3c0a08e0 2023-09-30T22:22:26.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.162+0000 7f3f43ade700 1 -- 172.21.15.156:0/629980621 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f3c11eac0 con 0x7f3f3c0a08e0 2023-09-30T22:22:26.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.163+0000 7f3f327fc700 1 -- 172.21.15.156:0/629980621 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f3800cbd0 con 0x7f3f3c0a08e0 2023-09-30T22:22:26.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.163+0000 7f3f43ade700 1 -- 172.21.15.156:0/629980621 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f3c11fff0 con 0x7f3f3c0a08e0 2023-09-30T22:22:26.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.163+0000 7f3f327fc700 1 -- 172.21.15.156:0/629980621 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3f3803faa0 con 0x7f3f3c0a08e0 2023-09-30T22:22:26.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.168+0000 7f3f327fc700 1 -- 172.21.15.156:0/629980621 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f38013470 con 0x7f3f3c0a08e0 2023-09-30T22:22:26.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.178+0000 7f8bc5a06700 1 Processor -- start 2023-09-30T22:22:26.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.179+0000 7f8bc5a06700 1 -- start start 2023-09-30T22:22:26.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.179+0000 7f8bc5a06700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bc01368e0 0x7f8bc0138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:26.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.179+0000 7f8bc5a06700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bc0139200 0x7f8bc013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:26.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.179+0000 7f8bc5a06700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bc009a760 con 0x7f8bc0133900 2023-09-30T22:22:26.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.179+0000 7f8bc5a06700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc01336e0 con 0x7f8bc01368e0 2023-09-30T22:22:26.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.179+0000 7f8bc5a06700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc009a080 con 0x7f8bc0139200 2023-09-30T22:22:26.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.179+0000 7f8bbeffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f8bc0133900 0x7f8bc0133cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:56392/0 (socket says 172.21.15.156:56392) 2023-09-30T22:22:26.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.179+0000 7f8bbe7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bc01368e0 0x7f8bc0138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:26.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.179+0000 7f8bbf7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bc0139200 0x7f8bc013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:26.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.179+0000 7f8bbeffd700 1 -- 172.21.15.156:0/4202121499 learned_addr learned my addr 172.21.15.156:0/4202121499 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:26.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.180+0000 7f8bbdffb700 1 -- 172.21.15.156:0/4202121499 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4001409390 0 0) 0x7f8bc009a760 con 0x7f8bc0133900 2023-09-30T22:22:26.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.180+0000 7f8bbdffb700 1 -- 172.21.15.156:0/4202121499 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ba80035b0 con 0x7f8bc0133900 2023-09-30T22:22:26.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.180+0000 7f8bbf7fe700 1 -- 172.21.15.156:0/4202121499 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bc01368e0 msgr2=0x7f8bc0138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:26.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.180+0000 7f8bbf7fe700 1 --2- 172.21.15.156:0/4202121499 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bc01368e0 0x7f8bc0138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.180+0000 7f8bbf7fe700 1 -- 172.21.15.156:0/4202121499 >> v1:172.21.15.156:6789/0 conn(0x7f8bc0133900 legacy=0x7f8bc0133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.180+0000 7f8bbf7fe700 1 -- 172.21.15.156:0/4202121499 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc00a23e0 con 0x7f8bc0139200 2023-09-30T22:22:26.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.180+0000 7f8bbe7fc700 1 --2- 172.21.15.156:0/4202121499 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bc01368e0 0x7f8bc0138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:26.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.180+0000 7f8bbf7fe700 1 --2- 172.21.15.156:0/4202121499 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bc0139200 0x7f8bc013b5e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009dc0 tx=0x7f8bb800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4cbf6e482500860 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:26.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.180+0000 7f8bbdffb700 1 -- 172.21.15.156:0/4202121499 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb800e070 con 0x7f8bc0139200 2023-09-30T22:22:26.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.180+0000 7f8bbdffb700 1 -- 172.21.15.156:0/4202121499 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb800bb20 con 0x7f8bc0139200 2023-09-30T22:22:26.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.180+0000 7f8bbdffb700 1 -- 172.21.15.156:0/4202121499 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8012430 con 0x7f8bc0139200 2023-09-30T22:22:26.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.180+0000 7f8bc5a06700 1 -- 172.21.15.156:0/4202121499 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bc0139200 msgr2=0x7f8bc013b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.180+0000 7f8bc5a06700 1 --2- 172.21.15.156:0/4202121499 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bc0139200 0x7f8bc013b5e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009dc0 tx=0x7f8bb800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:26.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.181+0000 7f8bc5a06700 1 -- 172.21.15.156:0/4202121499 shutdown_connections 2023-09-30T22:22:26.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.181+0000 7f8bc5a06700 1 --2- 172.21.15.156:0/4202121499 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bc0139200 0x7f8bc013b5e0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.181+0000 7f8bc5a06700 1 --2- 172.21.15.156:0/4202121499 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bc01368e0 0x7f8bc0138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.181+0000 7f8bc5a06700 1 -- 172.21.15.156:0/4202121499 >> 172.21.15.156:0/4202121499 conn(0x7f8bc00a2980 msgr2=0x7f8bc00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:26.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.181+0000 7f8bc5a06700 1 -- 172.21.15.156:0/4202121499 shutdown_connections 2023-09-30T22:22:26.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.181+0000 7f8bc5a06700 1 -- 172.21.15.156:0/4202121499 wait complete. 2023-09-30T22:22:26.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.181+0000 7f8bc5a06700 1 Processor -- start 2023-09-30T22:22:26.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.182+0000 7f8bc5a06700 1 -- start start 2023-09-30T22:22:26.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.182+0000 7f8bc5a06700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bc0133900 0x7f8bc0119cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:26.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.182+0000 7f8bc5a06700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bc01368e0 0x7f8bc011a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:26.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.182+0000 7f8bc5a06700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bc0139200 0x7f8bc011a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:26.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.182+0000 7f8bc5a06700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc009a2c0 con 0x7f8bc0133900 2023-09-30T22:22:26.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.182+0000 7f8bc5a06700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc011c780 con 0x7f8bc01368e0 2023-09-30T22:22:26.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.182+0000 7f8bc5a06700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc011d4a0 con 0x7f8bc0139200 2023-09-30T22:22:26.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.182+0000 7f8bbe7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bc01368e0 0x7f8bc011a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:26.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.182+0000 7f8bbe7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bc01368e0 0x7f8bc011a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33422/0 (socket says 172.21.15.156:33422) 2023-09-30T22:22:26.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.182+0000 7f8bbe7fc700 1 -- 172.21.15.156:0/2334974288 learned_addr learned my addr 172.21.15.156:0/2334974288 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:26.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.182+0000 7f8bbeffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bc0133900 0x7f8bc0119cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:26.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.183+0000 7f8bbf7fe700 1 --2- 172.21.15.156:0/2334974288 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bc0139200 0x7f8bc011a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:26.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.183+0000 7f8bbf7fe700 1 -- 172.21.15.156:0/2334974288 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bc01368e0 msgr2=0x7f8bc011a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.183+0000 7f8bbf7fe700 1 --2- 172.21.15.156:0/2334974288 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bc01368e0 0x7f8bc011a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.183+0000 7f8bbf7fe700 1 -- 172.21.15.156:0/2334974288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bc0133900 msgr2=0x7f8bc0119cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.183+0000 7f8bbf7fe700 1 --2- 172.21.15.156:0/2334974288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bc0133900 0x7f8bc0119cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.183+0000 7f8bbf7fe700 1 -- 172.21.15.156:0/2334974288 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb40094a0 con 0x7f8bc0139200 2023-09-30T22:22:26.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.183+0000 7f8bbeffd700 1 --2- 172.21.15.156:0/2334974288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bc0133900 0x7f8bc0119cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:26.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.183+0000 7f8bbf7fe700 1 --2- 172.21.15.156:0/2334974288 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bc0139200 0x7f8bc011a730 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8016000 tx=0x7f8bb8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:26.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.183+0000 7f8ba7fff700 1 -- 172.21.15.156:0/2334974288 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8004800 con 0x7f8bc0139200 2023-09-30T22:22:26.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.183+0000 7f8bc5a06700 1 -- 172.21.15.156:0/2334974288 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb8009a70 con 0x7f8bc0139200 2023-09-30T22:22:26.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.183+0000 7f8bc5a06700 1 -- 172.21.15.156:0/2334974288 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc011c060 con 0x7f8bc0139200 2023-09-30T22:22:26.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.183+0000 7f8ba7fff700 1 -- 172.21.15.156:0/2334974288 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb8020070 con 0x7f8bc0139200 2023-09-30T22:22:26.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.183+0000 7f8ba7fff700 1 -- 172.21.15.156:0/2334974288 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb80276c0 con 0x7f8bc0139200 2023-09-30T22:22:26.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.184+0000 7f8bc5a06700 1 -- 172.21.15.156:0/2334974288 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bc004f2a0 con 0x7f8bc0139200 2023-09-30T22:22:26.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.185+0000 7f8ba7fff700 1 -- 172.21.15.156:0/2334974288 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8bb8027820 con 0x7f8bc0139200 2023-09-30T22:22:26.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.185+0000 7f8ba7fff700 1 -- 172.21.15.156:0/2334974288 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8bb8022070 con 0x7f8bc0139200 2023-09-30T22:22:26.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.193+0000 7f8ba7fff700 1 -- 172.21.15.156:0/2334974288 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8bb8046060 con 0x7f8bc0139200 2023-09-30T22:22:26.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.264+0000 7fe1c7c86700 1 -- 172.21.15.156:0/1154678624 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe1c01338b0 con 0x7fe1c0136950 2023-09-30T22:22:26.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.265+0000 7fe1b67fc700 1 -- 172.21.15.156:0/1154678624 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe1b0011350 con 0x7fe1c0136950 2023-09-30T22:22:26.266 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:26.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.267+0000 7fe1c7c86700 1 -- 172.21.15.156:0/1154678624 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1c0136950 msgr2=0x7fe1c011a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.267+0000 7fe1c7c86700 1 --2- 172.21.15.156:0/1154678624 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1c0136950 0x7fe1c011a240 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000ebe0 tx=0x7fe1b000eef0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.267+0000 7fe1c7c86700 1 -- 172.21.15.156:0/1154678624 shutdown_connections 2023-09-30T22:22:26.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.267+0000 7fe1c7c86700 1 --2- 172.21.15.156:0/1154678624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1c0139270 0x7fe1c011a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.267+0000 7fe1c7c86700 1 --2- 172.21.15.156:0/1154678624 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe1c0133a70 0x7fe1c0119d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.267+0000 7fe1c7c86700 1 --2- 172.21.15.156:0/1154678624 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe1c0136950 0x7fe1c011a240 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.267+0000 7fe1c7c86700 1 -- 172.21.15.156:0/1154678624 >> 172.21.15.156:0/1154678624 conn(0x7fe1c00a2980 msgr2=0x7fe1c0134710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:26.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.267+0000 7fe1c7c86700 1 -- 172.21.15.156:0/1154678624 shutdown_connections 2023-09-30T22:22:26.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.267+0000 7fe1c7c86700 1 -- 172.21.15.156:0/1154678624 wait complete. 2023-09-30T22:22:26.280 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:26.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.360+0000 7f3f43ade700 1 -- 172.21.15.156:0/629980621 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3f3c04f2a0 con 0x7f3f3c0a08e0 2023-09-30T22:22:26.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.360+0000 7f3f327fc700 1 -- 172.21.15.156:0/629980621 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f38021030 con 0x7f3f3c0a08e0 2023-09-30T22:22:26.361 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:26.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.362+0000 7f3f43ade700 1 -- 172.21.15.156:0/629980621 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f3c0a08e0 msgr2=0x7f3f3c11c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.362+0000 7f3f43ade700 1 --2- 172.21.15.156:0/629980621 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f3c0a08e0 0x7f3f3c11c830 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800e9e0 tx=0x7f3f3800ecf0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.362+0000 7f3f43ade700 1 -- 172.21.15.156:0/629980621 shutdown_connections 2023-09-30T22:22:26.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.362+0000 7f3f43ade700 1 --2- 172.21.15.156:0/629980621 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f3c133a70 0x7f3f3c11d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.362+0000 7f3f43ade700 1 --2- 172.21.15.156:0/629980621 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f3c0a08e0 0x7f3f3c11c830 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.362+0000 7f3f43ade700 1 --2- 172.21.15.156:0/629980621 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f3c0a1290 0x7f3f3c11cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.362+0000 7f3f43ade700 1 -- 172.21.15.156:0/629980621 >> 172.21.15.156:0/629980621 conn(0x7f3f3c0a2980 msgr2=0x7f3f3c1baec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:26.363 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.362+0000 7f3f43ade700 1 -- 172.21.15.156:0/629980621 shutdown_connections 2023-09-30T22:22:26.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.362+0000 7f3f43ade700 1 -- 172.21.15.156:0/629980621 wait complete. 2023-09-30T22:22:26.375 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:26.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.387+0000 7f8bc5a06700 1 -- 172.21.15.156:0/2334974288 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8bc011df70 con 0x7f8bc0139200 2023-09-30T22:22:26.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.387+0000 7f8ba7fff700 1 -- 172.21.15.156:0/2334974288 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8bb8046070 con 0x7f8bc0139200 2023-09-30T22:22:26.388 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:26.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.389+0000 7f8bc5a06700 1 -- 172.21.15.156:0/2334974288 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bc0139200 msgr2=0x7f8bc011a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.389+0000 7f8bc5a06700 1 --2- 172.21.15.156:0/2334974288 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bc0139200 0x7f8bc011a730 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8016000 tx=0x7f8bb8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.389+0000 7f8bc5a06700 1 -- 172.21.15.156:0/2334974288 shutdown_connections 2023-09-30T22:22:26.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.389+0000 7f8bc5a06700 1 --2- 172.21.15.156:0/2334974288 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8bc0139200 0x7f8bc011a730 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.389+0000 7f8bc5a06700 1 --2- 172.21.15.156:0/2334974288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bc0133900 0x7f8bc0119cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.389+0000 7f8bc5a06700 1 --2- 172.21.15.156:0/2334974288 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8bc01368e0 0x7f8bc011a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.389+0000 7f8bc5a06700 1 -- 172.21.15.156:0/2334974288 >> 172.21.15.156:0/2334974288 conn(0x7f8bc00a2980 msgr2=0x7f8bc00a0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:26.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.389+0000 7f8bc5a06700 1 -- 172.21.15.156:0/2334974288 shutdown_connections 2023-09-30T22:22:26.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.389+0000 7f8bc5a06700 1 -- 172.21.15.156:0/2334974288 wait complete. 2023-09-30T22:22:26.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:26.423 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:26.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.564+0000 7f384bc72700 1 Processor -- start 2023-09-30T22:22:26.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.565+0000 7f384bc72700 1 -- start start 2023-09-30T22:22:26.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.565+0000 7f384bc72700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3844133ad0 0x7f3844133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:26.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.565+0000 7f384bc72700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38441300a0 0x7f38441304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:26.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.565+0000 7f384bc72700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f38441309f0 0x7f384413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:26.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.565+0000 7f384bc72700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f384406b2d0 con 0x7f38441309f0 2023-09-30T22:22:26.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.565+0000 7f384bc72700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3844133610 con 0x7f3844133ad0 2023-09-30T22:22:26.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.565+0000 7f384bc72700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f384409a500 con 0x7f38441300a0 2023-09-30T22:22:26.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.565+0000 7f3849a0e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3844133ad0 0x7f3844133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:26.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.565+0000 7f384920d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38441300a0 0x7f38441304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:26.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.565+0000 7f384a20f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f38441309f0 0x7f384413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:26.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.565+0000 7f3849a0e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3844133ad0 0x7f3844133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33428/0 (socket says 172.21.15.156:33428) 2023-09-30T22:22:26.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.565+0000 7f384920d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38441300a0 0x7f38441304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51368/0 (socket says 172.21.15.156:51368) 2023-09-30T22:22:26.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.565+0000 7f3849a0e700 1 -- 172.21.15.156:0/2116504818 learned_addr learned my addr 172.21.15.156:0/2116504818 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:26.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.566+0000 7f384a20f700 1 -- 172.21.15.156:0/2116504818 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38441300a0 msgr2=0x7f38441304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:26.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.566+0000 7f384a20f700 1 --2- 172.21.15.156:0/2116504818 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38441300a0 0x7f38441304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.566+0000 7f384a20f700 1 -- 172.21.15.156:0/2116504818 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3844133ad0 msgr2=0x7f3844133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:26.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.566+0000 7f384a20f700 1 --2- 172.21.15.156:0/2116504818 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3844133ad0 0x7f3844133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.566+0000 7f384a20f700 1 -- 172.21.15.156:0/2116504818 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38441338b0 con 0x7f38441309f0 2023-09-30T22:22:26.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.566+0000 7f3849a0e700 1 --2- 172.21.15.156:0/2116504818 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3844133ad0 0x7f3844133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:26.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.566+0000 7f384a20f700 1 --2- 172.21.15.156:0/2116504818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38441309f0 0x7f384413a980 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f383c009d90 tx=0x7f383c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58443e19ef82a2a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:26.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.566+0000 7f3848a0c700 1 -- 172.21.15.156:0/2116504818 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c00e070 con 0x7f38441309f0 2023-09-30T22:22:26.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.566+0000 7f3848a0c700 1 -- 172.21.15.156:0/2116504818 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383c00bb20 con 0x7f38441309f0 2023-09-30T22:22:26.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.566+0000 7f3848a0c700 1 -- 172.21.15.156:0/2116504818 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c012430 con 0x7f38441309f0 2023-09-30T22:22:26.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.566+0000 7f384bc72700 1 -- 172.21.15.156:0/2116504818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38441309f0 msgr2=0x7f384413a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.566+0000 7f384bc72700 1 --2- 172.21.15.156:0/2116504818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38441309f0 0x7f384413a980 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f383c009d90 tx=0x7f383c00b330 comp rx=0 tx=0).stop 2023-09-30T22:22:26.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.566+0000 7f384bc72700 1 -- 172.21.15.156:0/2116504818 shutdown_connections 2023-09-30T22:22:26.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.566+0000 7f384bc72700 1 --2- 172.21.15.156:0/2116504818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38441309f0 0x7f384413a980 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.566+0000 7f384bc72700 1 --2- 172.21.15.156:0/2116504818 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3844133ad0 0x7f3844133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.566+0000 7f384bc72700 1 --2- 172.21.15.156:0/2116504818 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38441300a0 0x7f38441304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.566+0000 7f384bc72700 1 -- 172.21.15.156:0/2116504818 >> 172.21.15.156:0/2116504818 conn(0x7f3844099c40 msgr2=0x7f38440a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:26.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.567+0000 7f384bc72700 1 -- 172.21.15.156:0/2116504818 shutdown_connections 2023-09-30T22:22:26.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.567+0000 7f384bc72700 1 -- 172.21.15.156:0/2116504818 wait complete. 2023-09-30T22:22:26.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.567+0000 7f384bc72700 1 Processor -- start 2023-09-30T22:22:26.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.567+0000 7f384bc72700 1 -- start start 2023-09-30T22:22:26.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.568+0000 7f384bc72700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38441300a0 0x7f384411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:26.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.568+0000 7f384bc72700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38441309f0 0x7f384411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:26.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.568+0000 7f384bc72700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3844133ad0 0x7f384411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:26.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.568+0000 7f384bc72700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384412da10 con 0x7f3844133ad0 2023-09-30T22:22:26.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.568+0000 7f384bc72700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384412dd00 con 0x7f38441300a0 2023-09-30T22:22:26.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.568+0000 7f384bc72700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f384411fe50 con 0x7f38441309f0 2023-09-30T22:22:26.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.568+0000 7f3849a0e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38441300a0 0x7f384411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:26.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.568+0000 7f384920d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38441309f0 0x7f384411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:26.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.568+0000 7f3849a0e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38441300a0 0x7f384411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33436/0 (socket says 172.21.15.156:33436) 2023-09-30T22:22:26.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.568+0000 7f384920d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38441309f0 0x7f384411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51372/0 (socket says 172.21.15.156:51372) 2023-09-30T22:22:26.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.568+0000 7f3849a0e700 1 -- 172.21.15.156:0/3432001711 learned_addr learned my addr 172.21.15.156:0/3432001711 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:26.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.568+0000 7f384a20f700 1 --2- 172.21.15.156:0/3432001711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3844133ad0 0x7f384411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:26.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.568+0000 7f3849a0e700 1 -- 172.21.15.156:0/3432001711 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38441309f0 msgr2=0x7f384411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.568+0000 7f3849a0e700 1 --2- 172.21.15.156:0/3432001711 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38441309f0 0x7f384411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.568+0000 7f3849a0e700 1 -- 172.21.15.156:0/3432001711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3844133ad0 msgr2=0x7f384411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.568+0000 7f3849a0e700 1 --2- 172.21.15.156:0/3432001711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3844133ad0 0x7f384411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.568+0000 7f3849a0e700 1 -- 172.21.15.156:0/3432001711 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3834009550 con 0x7f38441300a0 2023-09-30T22:22:26.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.568+0000 7f3849a0e700 1 --2- 172.21.15.156:0/3432001711 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38441300a0 0x7f384411da40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f383400ebe0 tx=0x7f383400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:26.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.569+0000 7f383a7fc700 1 -- 172.21.15.156:0/3432001711 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383400c850 con 0x7f38441300a0 2023-09-30T22:22:26.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.569+0000 7f383a7fc700 1 -- 172.21.15.156:0/3432001711 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383400c9b0 con 0x7f38441300a0 2023-09-30T22:22:26.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.569+0000 7f384bc72700 1 -- 172.21.15.156:0/3432001711 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f383c009a70 con 0x7f38441300a0 2023-09-30T22:22:26.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.569+0000 7f383a7fc700 1 -- 172.21.15.156:0/3432001711 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383400cd40 con 0x7f38441300a0 2023-09-30T22:22:26.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.569+0000 7f384bc72700 1 -- 172.21.15.156:0/3432001711 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384411ef90 con 0x7f38441300a0 2023-09-30T22:22:26.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.569+0000 7f383a7fc700 1 -- 172.21.15.156:0/3432001711 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3834013470 con 0x7f38441300a0 2023-09-30T22:22:26.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.569+0000 7f383a7fc700 1 -- 172.21.15.156:0/3432001711 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f383403f7c0 con 0x7f38441300a0 2023-09-30T22:22:26.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.570+0000 7f384bc72700 1 -- 172.21.15.156:0/3432001711 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f384404f2a0 con 0x7f38441300a0 2023-09-30T22:22:26.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.574+0000 7f383a7fc700 1 -- 172.21.15.156:0/3432001711 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f38340232f0 con 0x7f38441300a0 2023-09-30T22:22:26.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.761+0000 7f384bc72700 1 -- 172.21.15.156:0/3432001711 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f384406c3b0 con 0x7f38441300a0 2023-09-30T22:22:26.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.761+0000 7f383a7fc700 1 -- 172.21.15.156:0/3432001711 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3834017020 con 0x7f38441300a0 2023-09-30T22:22:26.762 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:26.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.763+0000 7f384bc72700 1 -- 172.21.15.156:0/3432001711 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38441300a0 msgr2=0x7f384411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.763+0000 7f384bc72700 1 --2- 172.21.15.156:0/3432001711 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38441300a0 0x7f384411da40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f383400ebe0 tx=0x7f383400eef0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.763+0000 7f384bc72700 1 -- 172.21.15.156:0/3432001711 shutdown_connections 2023-09-30T22:22:26.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.763+0000 7f384bc72700 1 --2- 172.21.15.156:0/3432001711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3844133ad0 0x7f384411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.763+0000 7f384bc72700 1 --2- 172.21.15.156:0/3432001711 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38441300a0 0x7f384411da40 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.763+0000 7f384bc72700 1 --2- 172.21.15.156:0/3432001711 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38441309f0 0x7f384411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.763+0000 7f384bc72700 1 -- 172.21.15.156:0/3432001711 >> 172.21.15.156:0/3432001711 conn(0x7f3844099c40 msgr2=0x7f38440a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:26.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.764+0000 7f384bc72700 1 -- 172.21.15.156:0/3432001711 shutdown_connections 2023-09-30T22:22:26.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:26.764+0000 7f384bc72700 1 -- 172.21.15.156:0/3432001711 wait complete. 2023-09-30T22:22:26.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:27.281 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:27.377 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:27.403 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:27.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.410+0000 7fb25834a700 1 Processor -- start 2023-09-30T22:22:27.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.410+0000 7fb25834a700 1 -- start start 2023-09-30T22:22:27.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.411+0000 7fb25834a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb250131980 0x7fb250131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.411+0000 7fb25834a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb25009c790 0x7fb250139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.411+0000 7fb25834a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2500a1640 con 0x7fb25009bc70 2023-09-30T22:22:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.411+0000 7fb25834a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb25006eb30 con 0x7fb250131980 2023-09-30T22:22:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.411+0000 7fb25834a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2500a22d0 con 0x7fb25009c790 2023-09-30T22:22:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.411+0000 7fb2560e6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb250131980 0x7fb250131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.411+0000 7fb2568e7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb25009c790 0x7fb250139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.411+0000 7fb2560e6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb250131980 0x7fb250131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33446/0 (socket says 172.21.15.156:33446) 2023-09-30T22:22:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.411+0000 7fb2568e7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb25009c790 0x7fb250139710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51380/0 (socket says 172.21.15.156:51380) 2023-09-30T22:22:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.411+0000 7fb2560e6700 1 -- 172.21.15.156:0/260082736 learned_addr learned my addr 172.21.15.156:0/260082736 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.411+0000 7fb2550e4700 1 -- 172.21.15.156:0/260082736 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685749828 0 0) 0x7fb2500a1640 con 0x7fb25009bc70 2023-09-30T22:22:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.411+0000 7fb2568e7700 1 -- 172.21.15.156:0/260082736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb250131980 msgr2=0x7fb250131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.411+0000 7fb2568e7700 1 --2- 172.21.15.156:0/260082736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb250131980 0x7fb250131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.411+0000 7fb2568e7700 1 -- 172.21.15.156:0/260082736 >> v1:172.21.15.156:6789/0 conn(0x7fb25009bc70 legacy=0x7fb25009c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.411+0000 7fb2568e7700 1 -- 172.21.15.156:0/260082736 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb250131550 con 0x7fb25009c790 2023-09-30T22:22:27.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.411+0000 7fb2560e6700 1 --2- 172.21.15.156:0/260082736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb250131980 0x7fb250131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:27.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.412+0000 7fb2568e7700 1 --2- 172.21.15.156:0/260082736 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb25009c790 0x7fb250139710 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb248009dc0 tx=0x7fb24800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d76d68dd424d15fe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:27.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.412+0000 7fb2550e4700 1 -- 172.21.15.156:0/260082736 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24800e070 con 0x7fb25009c790 2023-09-30T22:22:27.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.412+0000 7fb2550e4700 1 -- 172.21.15.156:0/260082736 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24800bb20 con 0x7fb25009c790 2023-09-30T22:22:27.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.412+0000 7fb2550e4700 1 -- 172.21.15.156:0/260082736 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb248012430 con 0x7fb25009c790 2023-09-30T22:22:27.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.412+0000 7fb25834a700 1 -- 172.21.15.156:0/260082736 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb25009c790 msgr2=0x7fb250139710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.412+0000 7fb25834a700 1 --2- 172.21.15.156:0/260082736 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb25009c790 0x7fb250139710 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb248009dc0 tx=0x7fb24800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:27.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.412+0000 7fb25834a700 1 -- 172.21.15.156:0/260082736 shutdown_connections 2023-09-30T22:22:27.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.412+0000 7fb25834a700 1 --2- 172.21.15.156:0/260082736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb250131980 0x7fb250131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.412+0000 7fb25834a700 1 --2- 172.21.15.156:0/260082736 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb25009c790 0x7fb250139710 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.412+0000 7fb25834a700 1 -- 172.21.15.156:0/260082736 >> 172.21.15.156:0/260082736 conn(0x7fb2500a2980 msgr2=0x7fb2500a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:27.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.413+0000 7fb25834a700 1 -- 172.21.15.156:0/260082736 shutdown_connections 2023-09-30T22:22:27.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.413+0000 7fb25834a700 1 -- 172.21.15.156:0/260082736 wait complete. 2023-09-30T22:22:27.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.414+0000 7fb25834a700 1 Processor -- start 2023-09-30T22:22:27.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.414+0000 7fb25834a700 1 -- start start 2023-09-30T22:22:27.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.414+0000 7fb25834a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb25009bc70 0x7fb250119850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.414+0000 7fb25834a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb25009c790 0x7fb250119d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.414+0000 7fb25834a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb250131980 0x7fb25011a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.414+0000 7fb25834a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25012cbb0 con 0x7fb250131980 2023-09-30T22:22:27.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.414+0000 7fb25834a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb25011acb0 con 0x7fb25009c790 2023-09-30T22:22:27.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.414+0000 7fb25834a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb25011c620 con 0x7fb25009bc70 2023-09-30T22:22:27.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.414+0000 7fb2560e6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb25009bc70 0x7fb250119850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.414+0000 7fb2560e6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb25009bc70 0x7fb250119850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51396/0 (socket says 172.21.15.156:51396) 2023-09-30T22:22:27.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.414+0000 7fb2560e6700 1 -- 172.21.15.156:0/970853522 learned_addr learned my addr 172.21.15.156:0/970853522 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:27.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.414+0000 7fb2558e5700 1 --2- 172.21.15.156:0/970853522 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb25009c790 0x7fb250119d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.415+0000 7fb2568e7700 1 --2- 172.21.15.156:0/970853522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb250131980 0x7fb25011a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.415+0000 7fb2560e6700 1 -- 172.21.15.156:0/970853522 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb25009c790 msgr2=0x7fb250119d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.415+0000 7fb2560e6700 1 --2- 172.21.15.156:0/970853522 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb25009c790 0x7fb250119d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.415+0000 7fb2560e6700 1 -- 172.21.15.156:0/970853522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb250131980 msgr2=0x7fb25011a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.415+0000 7fb2560e6700 1 --2- 172.21.15.156:0/970853522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb250131980 0x7fb25011a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.415+0000 7fb2560e6700 1 -- 172.21.15.156:0/970853522 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24c009500 con 0x7fb25009bc70 2023-09-30T22:22:27.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.415+0000 7fb2560e6700 1 --2- 172.21.15.156:0/970853522 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb25009bc70 0x7fb250119850 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb24c00ebe0 tx=0x7fb24c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:27.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.415+0000 7fb246ffd700 1 -- 172.21.15.156:0/970853522 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c005a20 con 0x7fb25009bc70 2023-09-30T22:22:27.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.415+0000 7fb246ffd700 1 -- 172.21.15.156:0/970853522 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24c005b80 con 0x7fb25009bc70 2023-09-30T22:22:27.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.415+0000 7fb246ffd700 1 -- 172.21.15.156:0/970853522 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c00c850 con 0x7fb25009bc70 2023-09-30T22:22:27.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.415+0000 7fb25834a700 1 -- 172.21.15.156:0/970853522 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb248009a70 con 0x7fb25009bc70 2023-09-30T22:22:27.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.415+0000 7fb25834a700 1 -- 172.21.15.156:0/970853522 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb25011ca70 con 0x7fb25009bc70 2023-09-30T22:22:27.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.416+0000 7fb246ffd700 1 -- 172.21.15.156:0/970853522 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb24c00c9b0 con 0x7fb25009bc70 2023-09-30T22:22:27.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.416+0000 7fb25834a700 1 -- 172.21.15.156:0/970853522 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb250130ad0 con 0x7fb25009bc70 2023-09-30T22:22:27.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.416+0000 7fb246ffd700 1 -- 172.21.15.156:0/970853522 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb24c03f930 con 0x7fb25009bc70 2023-09-30T22:22:27.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.421+0000 7fb246ffd700 1 -- 172.21.15.156:0/970853522 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb24c022300 con 0x7fb25009bc70 2023-09-30T22:22:27.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.506+0000 7fd8dbf76700 1 Processor -- start 2023-09-30T22:22:27.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.506+0000 7fd8dbf76700 1 -- start start 2023-09-30T22:22:27.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.507+0000 7fd8dbf76700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd8d409f430 0x7fd8d4138ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.507+0000 7fd8dbf76700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8d4139400 0x7fd8d413b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.507+0000 7fd8dbf76700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d406bcc0 con 0x7fd8d409e950 2023-09-30T22:22:27.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.507+0000 7fd8dbf76700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d406c9a0 con 0x7fd8d409f430 2023-09-30T22:22:27.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.507+0000 7fd8dbf76700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d409afe0 con 0x7fd8d4139400 2023-09-30T22:22:27.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.507+0000 7fd8d9511700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd8d409f430 0x7fd8d4138ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.507+0000 7fd8d9511700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd8d409f430 0x7fd8d4138ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59950/0 (socket says 172.21.15.156:59950) 2023-09-30T22:22:27.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.507+0000 7fd8d9511700 1 -- 172.21.15.156:0/1449515743 learned_addr learned my addr 172.21.15.156:0/1449515743 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:27.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.507+0000 7fd8d9d12700 1 --1- 172.21.15.156:0/1449515743 >> v1:172.21.15.156:6789/0 conn(0x7fd8d409e950 0x7fd8d409ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:56416/0 (socket says 172.21.15.156:56416) 2023-09-30T22:22:27.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.507+0000 7fd8da513700 1 --2- 172.21.15.156:0/1449515743 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8d4139400 0x7fd8d413b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.507+0000 7fd8d9511700 1 -- 172.21.15.156:0/1449515743 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8d4139400 msgr2=0x7fd8d413b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:27.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.507+0000 7fd8d9511700 1 --2- 172.21.15.156:0/1449515743 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8d4139400 0x7fd8d413b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.507+0000 7fd8d8d10700 1 -- 172.21.15.156:0/1449515743 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170079885 0 0) 0x7fd8d406bcc0 con 0x7fd8d409e950 2023-09-30T22:22:27.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.507+0000 7fd8d9511700 1 -- 172.21.15.156:0/1449515743 >> v1:172.21.15.156:6789/0 conn(0x7fd8d409e950 legacy=0x7fd8d409ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.507+0000 7fd8d9511700 1 -- 172.21.15.156:0/1449515743 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d406cb80 con 0x7fd8d409f430 2023-09-30T22:22:27.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.507+0000 7fd8da513700 1 --2- 172.21.15.156:0/1449515743 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8d4139400 0x7fd8d413b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:27.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.508+0000 7fd8d9511700 1 --2- 172.21.15.156:0/1449515743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8d409f430 0x7fd8d4138ec0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4009920 tx=0x7fd8c4009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d12962e2a50c9a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:27.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.508+0000 7fd8d8d10700 1 -- 172.21.15.156:0/1449515743 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4011830 con 0x7fd8d409f430 2023-09-30T22:22:27.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.508+0000 7fd8d8d10700 1 -- 172.21.15.156:0/1449515743 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c4011990 con 0x7fd8d409f430 2023-09-30T22:22:27.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.508+0000 7fd8d8d10700 1 -- 172.21.15.156:0/1449515743 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4011d20 con 0x7fd8d409f430 2023-09-30T22:22:27.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.508+0000 7fd8dbf76700 1 -- 172.21.15.156:0/1449515743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8d409f430 msgr2=0x7fd8d4138ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.508+0000 7fd8dbf76700 1 --2- 172.21.15.156:0/1449515743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8d409f430 0x7fd8d4138ec0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4009920 tx=0x7fd8c4009c30 comp rx=0 tx=0).stop 2023-09-30T22:22:27.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.508+0000 7fd8dbf76700 1 -- 172.21.15.156:0/1449515743 shutdown_connections 2023-09-30T22:22:27.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.508+0000 7fd8dbf76700 1 --2- 172.21.15.156:0/1449515743 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8d4139400 0x7fd8d413b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.508+0000 7fd8dbf76700 1 --2- 172.21.15.156:0/1449515743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8d409f430 0x7fd8d4138ec0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.508+0000 7fd8dbf76700 1 -- 172.21.15.156:0/1449515743 >> 172.21.15.156:0/1449515743 conn(0x7fd8d40a0f70 msgr2=0x7fd8d40a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:27.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.509+0000 7fd8dbf76700 1 -- 172.21.15.156:0/1449515743 shutdown_connections 2023-09-30T22:22:27.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.509+0000 7fd8dbf76700 1 -- 172.21.15.156:0/1449515743 wait complete. 2023-09-30T22:22:27.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.509+0000 7fd8dbf76700 1 Processor -- start 2023-09-30T22:22:27.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.510+0000 7fd8dbf76700 1 -- start start 2023-09-30T22:22:27.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.510+0000 7fd8dbf76700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8d409e950 0x7fd8d4121a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.510+0000 7fd8dbf76700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8d409f430 0x7fd8d4121fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.510+0000 7fd8dbf76700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8d4139400 0x7fd8d41224f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.510+0000 7fd8dbf76700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d4123680 con 0x7fd8d4139400 2023-09-30T22:22:27.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.510+0000 7fd8dbf76700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d4137960 con 0x7fd8d409e950 2023-09-30T22:22:27.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.510+0000 7fd8dbf76700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d41252b0 con 0x7fd8d409f430 2023-09-30T22:22:27.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.510+0000 7fd8d9511700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8d409f430 0x7fd8d4121fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.510+0000 7fd8d9511700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8d409f430 0x7fd8d4121fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51406/0 (socket says 172.21.15.156:51406) 2023-09-30T22:22:27.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.510+0000 7fd8d9511700 1 -- 172.21.15.156:0/1084645327 learned_addr learned my addr 172.21.15.156:0/1084645327 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:27.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.510+0000 7fd8da513700 1 --2- 172.21.15.156:0/1084645327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8d4139400 0x7fd8d41224f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.510+0000 7fd8da513700 1 -- 172.21.15.156:0/1084645327 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8d409f430 msgr2=0x7fd8d4121fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.510+0000 7fd8da513700 1 --2- 172.21.15.156:0/1084645327 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8d409f430 0x7fd8d4121fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.510+0000 7fd8da513700 1 -- 172.21.15.156:0/1084645327 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8d409e950 msgr2=0x7fd8d4121a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.510+0000 7fd8da513700 1 --2- 172.21.15.156:0/1084645327 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8d409e950 0x7fd8d4121a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.510+0000 7fd8da513700 1 -- 172.21.15.156:0/1084645327 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8cc009a70 con 0x7fd8d4139400 2023-09-30T22:22:27.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.510+0000 7fd8d9511700 1 --2- 172.21.15.156:0/1084645327 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8d409f430 0x7fd8d4121fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:27.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.511+0000 7fd8da513700 1 --2- 172.21.15.156:0/1084645327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8d4139400 0x7fd8d41224f0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc00efc0 tx=0x7fd8cc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:27.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.511+0000 7fd8ca7fc700 1 -- 172.21.15.156:0/1084645327 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc00cb40 con 0x7fd8d4139400 2023-09-30T22:22:27.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.511+0000 7fd8ca7fc700 1 -- 172.21.15.156:0/1084645327 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8cc00f040 con 0x7fd8d4139400 2023-09-30T22:22:27.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.511+0000 7fd8dbf76700 1 -- 172.21.15.156:0/1084645327 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c4009550 con 0x7fd8d4139400 2023-09-30T22:22:27.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.511+0000 7fd8ca7fc700 1 -- 172.21.15.156:0/1084645327 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc003a20 con 0x7fd8d4139400 2023-09-30T22:22:27.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.511+0000 7fd8dbf76700 1 -- 172.21.15.156:0/1084645327 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d4123ea0 con 0x7fd8d4139400 2023-09-30T22:22:27.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.511+0000 7fd8ca7fc700 1 -- 172.21.15.156:0/1084645327 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd8cc014480 con 0x7fd8d4139400 2023-09-30T22:22:27.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.512+0000 7fd8ca7fc700 1 -- 172.21.15.156:0/1084645327 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd8cc040150 con 0x7fd8d4139400 2023-09-30T22:22:27.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.512+0000 7fd8dbf76700 1 -- 172.21.15.156:0/1084645327 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d40a0400 con 0x7fd8d4139400 2023-09-30T22:22:27.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.517+0000 7fd8ca7fc700 1 -- 172.21.15.156:0/1084645327 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd8cc012930 con 0x7fd8d4139400 2023-09-30T22:22:27.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.538+0000 7fa3e7397700 1 Processor -- start 2023-09-30T22:22:27.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.539+0000 7fa3e7397700 1 -- start start 2023-09-30T22:22:27.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.539+0000 7fa3e7397700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3e00a1550 0x7fa3e0138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.539+0000 7fa3e7397700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa3e0139200 0x7fa3e013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.539+0000 7fa3e7397700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e009e9d0 con 0x7fa3e00a0a70 2023-09-30T22:22:27.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.539+0000 7fa3e7397700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e009dc00 con 0x7fa3e00a1550 2023-09-30T22:22:27.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.539+0000 7fa3e7397700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e009dec0 con 0x7fa3e0139200 2023-09-30T22:22:27.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.539+0000 7fa3e5133700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fa3e00a0a70 0x7fa3e00a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:56418/0 (socket says 172.21.15.156:56418) 2023-09-30T22:22:27.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.539+0000 7fa3e5133700 1 -- 172.21.15.156:0/648675121 learned_addr learned my addr 172.21.15.156:0/648675121 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:27.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.539+0000 7fa3e4932700 1 --2- 172.21.15.156:0/648675121 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3e00a1550 0x7fa3e0138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.539+0000 7fa3e5934700 1 --2- 172.21.15.156:0/648675121 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa3e0139200 0x7fa3e013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.540+0000 7fa3d7fff700 1 -- 172.21.15.156:0/648675121 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875118965 0 0) 0x7fa3e009e9d0 con 0x7fa3e00a0a70 2023-09-30T22:22:27.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.540+0000 7fa3d7fff700 1 -- 172.21.15.156:0/648675121 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3cc0035b0 con 0x7fa3e00a0a70 2023-09-30T22:22:27.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.540+0000 7fa3e4932700 1 -- 172.21.15.156:0/648675121 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa3e0139200 msgr2=0x7fa3e013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:27.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.540+0000 7fa3e4932700 1 --2- 172.21.15.156:0/648675121 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa3e0139200 0x7fa3e013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.540+0000 7fa3e4932700 1 -- 172.21.15.156:0/648675121 >> v1:172.21.15.156:6789/0 conn(0x7fa3e00a0a70 legacy=0x7fa3e00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.540+0000 7fa3e4932700 1 -- 172.21.15.156:0/648675121 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e009e6a0 con 0x7fa3e00a1550 2023-09-30T22:22:27.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.540+0000 7fa3e5934700 1 --2- 172.21.15.156:0/648675121 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa3e0139200 0x7fa3e013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:27.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.540+0000 7fa3e4932700 1 --2- 172.21.15.156:0/648675121 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3e00a1550 0x7fa3e0138cc0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0009870 tx=0x7fa3d0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a75849120cec0e0c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:27.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.540+0000 7fa3d7fff700 1 -- 172.21.15.156:0/648675121 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0011830 con 0x7fa3e00a1550 2023-09-30T22:22:27.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.540+0000 7fa3d7fff700 1 -- 172.21.15.156:0/648675121 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d0011990 con 0x7fa3e00a1550 2023-09-30T22:22:27.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.540+0000 7fa3d7fff700 1 -- 172.21.15.156:0/648675121 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0011d20 con 0x7fa3e00a1550 2023-09-30T22:22:27.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.541+0000 7fa3e7397700 1 -- 172.21.15.156:0/648675121 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3e00a1550 msgr2=0x7fa3e0138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.541+0000 7fa3e7397700 1 --2- 172.21.15.156:0/648675121 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3e00a1550 0x7fa3e0138cc0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0009870 tx=0x7fa3d0009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:27.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.541+0000 7fa3e7397700 1 -- 172.21.15.156:0/648675121 shutdown_connections 2023-09-30T22:22:27.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.541+0000 7fa3e7397700 1 --2- 172.21.15.156:0/648675121 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa3e0139200 0x7fa3e013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.541+0000 7fa3e7397700 1 --2- 172.21.15.156:0/648675121 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3e00a1550 0x7fa3e0138cc0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.541+0000 7fa3e7397700 1 -- 172.21.15.156:0/648675121 >> 172.21.15.156:0/648675121 conn(0x7fa3e00a6610 msgr2=0x7fa3e00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:27.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.541+0000 7fa3e7397700 1 -- 172.21.15.156:0/648675121 shutdown_connections 2023-09-30T22:22:27.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.541+0000 7fa3e7397700 1 -- 172.21.15.156:0/648675121 wait complete. 2023-09-30T22:22:27.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.542+0000 7fa3e7397700 1 Processor -- start 2023-09-30T22:22:27.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.542+0000 7fa3e7397700 1 -- start start 2023-09-30T22:22:27.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.542+0000 7fa3e7397700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3e00a0a70 0x7fa3e0120810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.542+0000 7fa3e7397700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa3e00a1550 0x7fa3e0120d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.542+0000 7fa3e7397700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3e0139200 0x7fa3e0121290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.542+0000 7fa3e7397700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e0122b50 con 0x7fa3e0139200 2023-09-30T22:22:27.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.542+0000 7fa3e7397700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e00a5100 con 0x7fa3e00a0a70 2023-09-30T22:22:27.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.542+0000 7fa3e7397700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e00a03e0 con 0x7fa3e00a1550 2023-09-30T22:22:27.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.543+0000 7fa3e5133700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3e00a0a70 0x7fa3e0120810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.543+0000 7fa3e5133700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3e00a0a70 0x7fa3e0120810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33474/0 (socket says 172.21.15.156:33474) 2023-09-30T22:22:27.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.543+0000 7fa3e4932700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa3e00a1550 0x7fa3e0120d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.543+0000 7fa3e5133700 1 -- 172.21.15.156:0/2774326653 learned_addr learned my addr 172.21.15.156:0/2774326653 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:27.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.543+0000 7fa3e5934700 1 --2- 172.21.15.156:0/2774326653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3e0139200 0x7fa3e0121290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.543+0000 7fa3e4932700 1 -- 172.21.15.156:0/2774326653 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3e00a0a70 msgr2=0x7fa3e0120810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.543+0000 7fa3e4932700 1 --2- 172.21.15.156:0/2774326653 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3e00a0a70 0x7fa3e0120810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.543+0000 7fa3e4932700 1 -- 172.21.15.156:0/2774326653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3e0139200 msgr2=0x7fa3e0121290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.543+0000 7fa3e4932700 1 --2- 172.21.15.156:0/2774326653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3e0139200 0x7fa3e0121290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.543+0000 7fa3e4932700 1 -- 172.21.15.156:0/2774326653 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d8009a70 con 0x7fa3e00a1550 2023-09-30T22:22:27.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.543+0000 7fa3e5934700 1 --2- 172.21.15.156:0/2774326653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3e0139200 0x7fa3e0121290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:27.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.543+0000 7fa3e5133700 1 --2- 172.21.15.156:0/2774326653 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3e00a0a70 0x7fa3e0120810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:27.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.543+0000 7fa3e4932700 1 --2- 172.21.15.156:0/2774326653 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa3e00a1550 0x7fa3e0120d50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0016000 tx=0x7fa3d0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:27.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.543+0000 7fa3d5ffb700 1 -- 172.21.15.156:0/2774326653 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0004450 con 0x7fa3e00a1550 2023-09-30T22:22:27.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.543+0000 7fa3d5ffb700 1 -- 172.21.15.156:0/2774326653 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d001f070 con 0x7fa3e00a1550 2023-09-30T22:22:27.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.543+0000 7fa3e7397700 1 -- 172.21.15.156:0/2774326653 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d00094a0 con 0x7fa3e00a1550 2023-09-30T22:22:27.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.543+0000 7fa3d5ffb700 1 -- 172.21.15.156:0/2774326653 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d00038e0 con 0x7fa3e00a1550 2023-09-30T22:22:27.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.544+0000 7fa3e7397700 1 -- 172.21.15.156:0/2774326653 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e01239d0 con 0x7fa3e00a1550 2023-09-30T22:22:27.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.544+0000 7fa3d5ffb700 1 -- 172.21.15.156:0/2774326653 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa3d0003a40 con 0x7fa3e00a1550 2023-09-30T22:22:27.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.544+0000 7fa3d5ffb700 1 -- 172.21.15.156:0/2774326653 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa3d0021070 con 0x7fa3e00a1550 2023-09-30T22:22:27.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.545+0000 7fa3e7397700 1 -- 172.21.15.156:0/2774326653 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e004f2a0 con 0x7fa3e00a1550 2023-09-30T22:22:27.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.550+0000 7fa3d5ffb700 1 -- 172.21.15.156:0/2774326653 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa3d001a430 con 0x7fa3e00a1550 2023-09-30T22:22:27.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.621+0000 7fb25834a700 1 -- 172.21.15.156:0/970853522 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb2500a1c40 con 0x7fb25009bc70 2023-09-30T22:22:27.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.621+0000 7fb246ffd700 1 -- 172.21.15.156:0/970853522 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb24c013e60 con 0x7fb25009bc70 2023-09-30T22:22:27.622 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:27.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.623+0000 7fb25834a700 1 -- 172.21.15.156:0/970853522 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb25009bc70 msgr2=0x7fb250119850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.623+0000 7fb25834a700 1 --2- 172.21.15.156:0/970853522 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb25009bc70 0x7fb250119850 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb24c00ebe0 tx=0x7fb24c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.623+0000 7fb25834a700 1 -- 172.21.15.156:0/970853522 shutdown_connections 2023-09-30T22:22:27.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.623+0000 7fb25834a700 1 --2- 172.21.15.156:0/970853522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb250131980 0x7fb25011a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.623+0000 7fb25834a700 1 --2- 172.21.15.156:0/970853522 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb25009bc70 0x7fb250119850 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.623+0000 7fb25834a700 1 --2- 172.21.15.156:0/970853522 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb25009c790 0x7fb250119d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.624+0000 7fb25834a700 1 -- 172.21.15.156:0/970853522 >> 172.21.15.156:0/970853522 conn(0x7fb2500a2980 msgr2=0x7fb25012e680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:27.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.624+0000 7fb25834a700 1 -- 172.21.15.156:0/970853522 shutdown_connections 2023-09-30T22:22:27.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.624+0000 7fb25834a700 1 -- 172.21.15.156:0/970853522 wait complete. 2023-09-30T22:22:27.637 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:27.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.737+0000 7fd8dbf76700 1 -- 172.21.15.156:0/1084645327 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd8d404f2a0 con 0x7fd8d4139400 2023-09-30T22:22:27.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.738+0000 7fd8ca7fc700 1 -- 172.21.15.156:0/1084645327 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd8cc02b090 con 0x7fd8d4139400 2023-09-30T22:22:27.739 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:27.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.740+0000 7fd8dbf76700 1 -- 172.21.15.156:0/1084645327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8d4139400 msgr2=0x7fd8d41224f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.740+0000 7fd8dbf76700 1 --2- 172.21.15.156:0/1084645327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8d4139400 0x7fd8d41224f0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc00efc0 tx=0x7fd8cc00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.740+0000 7fd8dbf76700 1 -- 172.21.15.156:0/1084645327 shutdown_connections 2023-09-30T22:22:27.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.740+0000 7fd8dbf76700 1 --2- 172.21.15.156:0/1084645327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8d4139400 0x7fd8d41224f0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.740+0000 7fd8dbf76700 1 --2- 172.21.15.156:0/1084645327 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8d409e950 0x7fd8d4121a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.740+0000 7fd8dbf76700 1 --2- 172.21.15.156:0/1084645327 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8d409f430 0x7fd8d4121fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.740+0000 7fd8dbf76700 1 -- 172.21.15.156:0/1084645327 >> 172.21.15.156:0/1084645327 conn(0x7fd8d40a0f70 msgr2=0x7fd8d4071010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:27.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.740+0000 7fd8dbf76700 1 -- 172.21.15.156:0/1084645327 shutdown_connections 2023-09-30T22:22:27.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.740+0000 7fd8dbf76700 1 -- 172.21.15.156:0/1084645327 wait complete. 2023-09-30T22:22:27.753 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:27.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.767+0000 7fa3e7397700 1 -- 172.21.15.156:0/2774326653 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa3e0072980 con 0x7fa3e00a1550 2023-09-30T22:22:27.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.767+0000 7fa3d5ffb700 1 -- 172.21.15.156:0/2774326653 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa3d0015020 con 0x7fa3e00a1550 2023-09-30T22:22:27.768 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:27.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.769+0000 7fa3e7397700 1 -- 172.21.15.156:0/2774326653 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa3e00a1550 msgr2=0x7fa3e0120d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.769+0000 7fa3e7397700 1 --2- 172.21.15.156:0/2774326653 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa3e00a1550 0x7fa3e0120d50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0016000 tx=0x7fa3d0004750 comp rx=0 tx=0).stop 2023-09-30T22:22:27.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.769+0000 7fa3e7397700 1 -- 172.21.15.156:0/2774326653 shutdown_connections 2023-09-30T22:22:27.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.769+0000 7fa3e7397700 1 --2- 172.21.15.156:0/2774326653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3e0139200 0x7fa3e0121290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.769+0000 7fa3e7397700 1 --2- 172.21.15.156:0/2774326653 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3e00a0a70 0x7fa3e0120810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.769+0000 7fa3e7397700 1 --2- 172.21.15.156:0/2774326653 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa3e00a1550 0x7fa3e0120d50 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.769+0000 7fa3e7397700 1 -- 172.21.15.156:0/2774326653 >> 172.21.15.156:0/2774326653 conn(0x7fa3e00a6610 msgr2=0x7fa3e00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:27.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.769+0000 7fa3e7397700 1 -- 172.21.15.156:0/2774326653 shutdown_connections 2023-09-30T22:22:27.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.769+0000 7fa3e7397700 1 -- 172.21.15.156:0/2774326653 wait complete. 2023-09-30T22:22:27.777 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:27.782 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:27.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.898+0000 7f44b0145700 1 Processor -- start 2023-09-30T22:22:27.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.899+0000 7f44b0145700 1 -- start start 2023-09-30T22:22:27.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.899+0000 7f44b0145700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44a8133660 0x7f44a8135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.899+0000 7f44b0145700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f44a8135f80 0x7f44a8138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.899+0000 7f44b0145700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a8099a60 con 0x7f44a8099e20 2023-09-30T22:22:27.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.899+0000 7f44b0145700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a809bf50 con 0x7f44a8133660 2023-09-30T22:22:27.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.899+0000 7f44b0145700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44a809b230 con 0x7f44a8135f80 2023-09-30T22:22:27.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.899+0000 7f44ad6e0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44a8133660 0x7f44a8135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.899+0000 7f44adee1700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f44a8099e20 0x7f44a809a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:56428/0 (socket says 172.21.15.156:56428) 2023-09-30T22:22:27.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.899+0000 7f44ae6e2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f44a8135f80 0x7f44a8138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.899+0000 7f44adee1700 1 -- 172.21.15.156:0/1166902876 learned_addr learned my addr 172.21.15.156:0/1166902876 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:27.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.899+0000 7f44acedf700 1 -- 172.21.15.156:0/1166902876 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2247285153 0 0) 0x7f44a8099a60 con 0x7f44a8099e20 2023-09-30T22:22:27.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.899+0000 7f44ae6e2700 1 -- 172.21.15.156:0/1166902876 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44a8133660 msgr2=0x7f44a8135a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:27.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.899+0000 7f44ae6e2700 1 --2- 172.21.15.156:0/1166902876 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44a8133660 0x7f44a8135a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.899+0000 7f44ae6e2700 1 -- 172.21.15.156:0/1166902876 >> v1:172.21.15.156:6789/0 conn(0x7f44a8099e20 legacy=0x7f44a809a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.899+0000 7f44ae6e2700 1 -- 172.21.15.156:0/1166902876 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a809bb90 con 0x7f44a8135f80 2023-09-30T22:22:27.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.899+0000 7f44ad6e0700 1 --2- 172.21.15.156:0/1166902876 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44a8133660 0x7f44a8135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:27.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.900+0000 7f44ae6e2700 1 --2- 172.21.15.156:0/1166902876 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f44a8135f80 0x7f44a8138360 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f44a0009dc0 tx=0x7f44a000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b467ff5fddc0b7fe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:27.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.900+0000 7f44acedf700 1 -- 172.21.15.156:0/1166902876 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a000e070 con 0x7f44a8135f80 2023-09-30T22:22:27.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.900+0000 7f44acedf700 1 -- 172.21.15.156:0/1166902876 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a000bb20 con 0x7f44a8135f80 2023-09-30T22:22:27.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.900+0000 7f44acedf700 1 -- 172.21.15.156:0/1166902876 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0012430 con 0x7f44a8135f80 2023-09-30T22:22:27.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.900+0000 7f44b0145700 1 -- 172.21.15.156:0/1166902876 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f44a8135f80 msgr2=0x7f44a8138360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.900+0000 7f44b0145700 1 --2- 172.21.15.156:0/1166902876 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f44a8135f80 0x7f44a8138360 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f44a0009dc0 tx=0x7f44a000b330 comp rx=0 tx=0).stop 2023-09-30T22:22:27.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.900+0000 7f44b0145700 1 -- 172.21.15.156:0/1166902876 shutdown_connections 2023-09-30T22:22:27.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.900+0000 7f44b0145700 1 --2- 172.21.15.156:0/1166902876 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f44a8135f80 0x7f44a8138360 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.900+0000 7f44b0145700 1 --2- 172.21.15.156:0/1166902876 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44a8133660 0x7f44a8135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.900+0000 7f44b0145700 1 -- 172.21.15.156:0/1166902876 >> 172.21.15.156:0/1166902876 conn(0x7f44a80a2980 msgr2=0x7f44a80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:27.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.900+0000 7f44b0145700 1 -- 172.21.15.156:0/1166902876 shutdown_connections 2023-09-30T22:22:27.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.900+0000 7f44b0145700 1 -- 172.21.15.156:0/1166902876 wait complete. 2023-09-30T22:22:27.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.901+0000 7f44b0145700 1 Processor -- start 2023-09-30T22:22:27.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.901+0000 7f44b0145700 1 -- start start 2023-09-30T22:22:27.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.902+0000 7f44b0145700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f44a8099e20 0x7f44a81c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.902+0000 7f44b0145700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44a8133660 0x7f44a81c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.902+0000 7f44b0145700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44a8135f80 0x7f44a806ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.902+0000 7f44b0145700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a8071b10 con 0x7f44a8133660 2023-09-30T22:22:27.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.902+0000 7f44b0145700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a809b4e0 con 0x7f44a8135f80 2023-09-30T22:22:27.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.902+0000 7f44b0145700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44a8133a30 con 0x7f44a8099e20 2023-09-30T22:22:27.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.902+0000 7f44ae6e2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44a8135f80 0x7f44a806ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.902+0000 7f44ad6e0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44a8133660 0x7f44a81c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.902+0000 7f44adee1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f44a8099e20 0x7f44a81c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.902+0000 7f44ae6e2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44a8135f80 0x7f44a806ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33492/0 (socket says 172.21.15.156:33492) 2023-09-30T22:22:27.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.902+0000 7f44ae6e2700 1 -- 172.21.15.156:0/2317307222 learned_addr learned my addr 172.21.15.156:0/2317307222 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:27.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.902+0000 7f44ad6e0700 1 -- 172.21.15.156:0/2317307222 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f44a8099e20 msgr2=0x7f44a81c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.902+0000 7f44ad6e0700 1 --2- 172.21.15.156:0/2317307222 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f44a8099e20 0x7f44a81c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.902+0000 7f44ad6e0700 1 -- 172.21.15.156:0/2317307222 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44a8135f80 msgr2=0x7f44a806ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.902+0000 7f44ad6e0700 1 --2- 172.21.15.156:0/2317307222 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44a8135f80 0x7f44a806ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.902+0000 7f44ad6e0700 1 -- 172.21.15.156:0/2317307222 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c0094a0 con 0x7f44a8133660 2023-09-30T22:22:27.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.902+0000 7f44adee1700 1 --2- 172.21.15.156:0/2317307222 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f44a8099e20 0x7f44a81c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:27.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.902+0000 7f44ae6e2700 1 --2- 172.21.15.156:0/2317307222 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44a8135f80 0x7f44a806ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:27.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.902+0000 7f44ad6e0700 1 --2- 172.21.15.156:0/2317307222 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44a8133660 0x7f44a81c8a80 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f449c00e9b0 tx=0x7f449c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:27.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.902+0000 7f449a7fc700 1 -- 172.21.15.156:0/2317307222 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c00ee50 con 0x7f44a8133660 2023-09-30T22:22:27.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.902+0000 7f449a7fc700 1 -- 172.21.15.156:0/2317307222 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449c00c850 con 0x7f44a8133660 2023-09-30T22:22:27.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.902+0000 7f44b0145700 1 -- 172.21.15.156:0/2317307222 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a0009a70 con 0x7f44a8133660 2023-09-30T22:22:27.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.902+0000 7f449a7fc700 1 -- 172.21.15.156:0/2317307222 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c00cc00 con 0x7f44a8133660 2023-09-30T22:22:27.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.902+0000 7f44b0145700 1 -- 172.21.15.156:0/2317307222 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a811e600 con 0x7f44a8133660 2023-09-30T22:22:27.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.903+0000 7f449a7fc700 1 -- 172.21.15.156:0/2317307222 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f449c013470 con 0x7f44a8133660 2023-09-30T22:22:27.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.903+0000 7f449a7fc700 1 -- 172.21.15.156:0/2317307222 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f449c03f760 con 0x7f44a8133660 2023-09-30T22:22:27.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.903+0000 7f44b0145700 1 -- 172.21.15.156:0/2317307222 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a8072480 con 0x7f44a8133660 2023-09-30T22:22:27.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:27.908+0000 7f449a7fc700 1 -- 172.21.15.156:0/2317307222 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f44a8072480 con 0x7f44a8133660 2023-09-30T22:22:28.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.091+0000 7f44b0145700 1 -- 172.21.15.156:0/2317307222 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f44a8072480 con 0x7f44a8133660 2023-09-30T22:22:28.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.091+0000 7f449a7fc700 1 -- 172.21.15.156:0/2317307222 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f44a8072480 con 0x7f44a8133660 2023-09-30T22:22:28.092 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:28.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.093+0000 7f44b0145700 1 -- 172.21.15.156:0/2317307222 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44a8133660 msgr2=0x7f44a81c8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.093+0000 7f44b0145700 1 --2- 172.21.15.156:0/2317307222 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44a8133660 0x7f44a81c8a80 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f449c00e9b0 tx=0x7f449c00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.093+0000 7f44b0145700 1 -- 172.21.15.156:0/2317307222 shutdown_connections 2023-09-30T22:22:28.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.093+0000 7f44b0145700 1 --2- 172.21.15.156:0/2317307222 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44a8135f80 0x7f44a806ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.093+0000 7f44b0145700 1 --2- 172.21.15.156:0/2317307222 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f44a8099e20 0x7f44a81c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.093+0000 7f44b0145700 1 --2- 172.21.15.156:0/2317307222 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44a8133660 0x7f44a81c8a80 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.093+0000 7f44b0145700 1 -- 172.21.15.156:0/2317307222 >> 172.21.15.156:0/2317307222 conn(0x7f44a80a2980 msgr2=0x7f44a81324e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:28.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.093+0000 7f44b0145700 1 -- 172.21.15.156:0/2317307222 shutdown_connections 2023-09-30T22:22:28.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.093+0000 7f44b0145700 1 -- 172.21.15.156:0/2317307222 wait complete. 2023-09-30T22:22:28.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:28.638 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:28.753 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:28.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.760+0000 7ff4f6074700 1 Processor -- start 2023-09-30T22:22:28.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.760+0000 7ff4f6074700 1 -- start start 2023-09-30T22:22:28.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.761+0000 7ff4f6074700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff4f0133a70 0x7ff4f0133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.761+0000 7ff4f6074700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4f00a08e0 0x7ff4f00a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.761+0000 7ff4f6074700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f0133640 con 0x7ff4f00a1290 2023-09-30T22:22:28.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.761+0000 7ff4f6074700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f00a1d50 con 0x7ff4f0133a70 2023-09-30T22:22:28.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.761+0000 7ff4f6074700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00a1710 con 0x7ff4f00a08e0 2023-09-30T22:22:28.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.761+0000 7ff4eeffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4f00a08e0 0x7ff4f00a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.761+0000 7ff4eeffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4f00a08e0 0x7ff4f00a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33498/0 (socket says 172.21.15.156:33498) 2023-09-30T22:22:28.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.761+0000 7ff4eeffd700 1 -- 172.21.15.156:0/621977041 learned_addr learned my addr 172.21.15.156:0/621977041 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:28.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.761+0000 7ff4ef7fe700 1 --2- 172.21.15.156:0/621977041 >> v2:172.21.15.156:3300/0 conn(0x7ff4f0133a70 0x7ff4f0133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.761+0000 7ff4eeffd700 1 -- 172.21.15.156:0/621977041 >> v2:172.21.15.156:3300/0 conn(0x7ff4f0133a70 msgr2=0x7ff4f0133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:28.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.761+0000 7ff4eeffd700 1 --2- 172.21.15.156:0/621977041 >> v2:172.21.15.156:3300/0 conn(0x7ff4f0133a70 0x7ff4f0133e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.761+0000 7ff4eeffd700 1 -- 172.21.15.156:0/621977041 >> v1:172.21.15.156:6789/0 conn(0x7ff4f00a1290 legacy=0x7ff4f013a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.761+0000 7ff4eeffd700 1 -- 172.21.15.156:0/621977041 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f009b620 con 0x7ff4f00a08e0 2023-09-30T22:22:28.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.761+0000 7ff4eeffd700 1 --2- 172.21.15.156:0/621977041 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4f00a08e0 0x7ff4f00a0d50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40098f0 tx=0x7ff4e4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56aa007c0b64f756 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:28.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.761+0000 7ff4ee7fc700 1 -- 172.21.15.156:0/621977041 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4011830 con 0x7ff4f00a08e0 2023-09-30T22:22:28.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.762+0000 7ff4ee7fc700 1 -- 172.21.15.156:0/621977041 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e4011990 con 0x7ff4f00a08e0 2023-09-30T22:22:28.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.762+0000 7ff4ee7fc700 1 -- 172.21.15.156:0/621977041 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4011d20 con 0x7ff4f00a08e0 2023-09-30T22:22:28.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.762+0000 7ff4f6074700 1 -- 172.21.15.156:0/621977041 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4f00a08e0 msgr2=0x7ff4f00a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.762+0000 7ff4f6074700 1 --2- 172.21.15.156:0/621977041 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4f00a08e0 0x7ff4f00a0d50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40098f0 tx=0x7ff4e4009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:28.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.762+0000 7ff4f6074700 1 -- 172.21.15.156:0/621977041 shutdown_connections 2023-09-30T22:22:28.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.762+0000 7ff4f6074700 1 --2- 172.21.15.156:0/621977041 >> v2:172.21.15.156:3300/0 conn(0x7ff4f0133a70 0x7ff4f0133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.762+0000 7ff4f6074700 1 --2- 172.21.15.156:0/621977041 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4f00a08e0 0x7ff4f00a0d50 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.762+0000 7ff4f6074700 1 -- 172.21.15.156:0/621977041 >> 172.21.15.156:0/621977041 conn(0x7ff4f00a2980 msgr2=0x7ff4f00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:28.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.762+0000 7ff4f6074700 1 -- 172.21.15.156:0/621977041 shutdown_connections 2023-09-30T22:22:28.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.762+0000 7ff4f6074700 1 -- 172.21.15.156:0/621977041 wait complete. 2023-09-30T22:22:28.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.763+0000 7ff4f6074700 1 Processor -- start 2023-09-30T22:22:28.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.763+0000 7ff4f6074700 1 -- start start 2023-09-30T22:22:28.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.764+0000 7ff4f6074700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4f00a08e0 0x7ff4f011c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.764+0000 7ff4f6074700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4f00a1290 0x7ff4f011cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.764+0000 7ff4f6074700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4f0133a70 0x7ff4f011d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.764+0000 7ff4f6074700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f011e3b0 con 0x7ff4f00a08e0 2023-09-30T22:22:28.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.764+0000 7ff4f6074700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f01202c0 con 0x7ff4f0133a70 2023-09-30T22:22:28.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.764+0000 7ff4f6074700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f011f670 con 0x7ff4f00a1290 2023-09-30T22:22:28.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.764+0000 7ff4ef7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4f00a08e0 0x7ff4f011c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.764+0000 7ff4eeffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4f00a1290 0x7ff4f011cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.764+0000 7ff4ef7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4f00a08e0 0x7ff4f011c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60010/0 (socket says 172.21.15.156:60010) 2023-09-30T22:22:28.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.764+0000 7ff4eeffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4f00a1290 0x7ff4f011cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51456/0 (socket says 172.21.15.156:51456) 2023-09-30T22:22:28.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.764+0000 7ff4ef7fe700 1 -- 172.21.15.156:0/1470364412 learned_addr learned my addr 172.21.15.156:0/1470364412 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:28.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.764+0000 7ff4effff700 1 --2- 172.21.15.156:0/1470364412 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4f0133a70 0x7ff4f011d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.764+0000 7ff4ef7fe700 1 -- 172.21.15.156:0/1470364412 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4f00a1290 msgr2=0x7ff4f011cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.764+0000 7ff4ef7fe700 1 --2- 172.21.15.156:0/1470364412 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4f00a1290 0x7ff4f011cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.764+0000 7ff4ef7fe700 1 -- 172.21.15.156:0/1470364412 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4f0133a70 msgr2=0x7ff4f011d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.764+0000 7ff4ef7fe700 1 --2- 172.21.15.156:0/1470364412 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4f0133a70 0x7ff4f011d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.764+0000 7ff4ef7fe700 1 -- 172.21.15.156:0/1470364412 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e4009550 con 0x7ff4f00a08e0 2023-09-30T22:22:28.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.764+0000 7ff4ef7fe700 1 --2- 172.21.15.156:0/1470364412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4f00a08e0 0x7ff4f011c830 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000e990 tx=0x7ff4e000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:28.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.765+0000 7ff4d7fff700 1 -- 172.21.15.156:0/1470364412 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e00096f0 con 0x7ff4f00a08e0 2023-09-30T22:22:28.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.765+0000 7ff4d7fff700 1 -- 172.21.15.156:0/1470364412 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e000c850 con 0x7ff4f00a08e0 2023-09-30T22:22:28.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.765+0000 7ff4f6074700 1 -- 172.21.15.156:0/1470364412 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f0131dc0 con 0x7ff4f00a08e0 2023-09-30T22:22:28.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.765+0000 7ff4d7fff700 1 -- 172.21.15.156:0/1470364412 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e000eee0 con 0x7ff4f00a08e0 2023-09-30T22:22:28.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.765+0000 7ff4f6074700 1 -- 172.21.15.156:0/1470364412 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f011ffe0 con 0x7ff4f00a08e0 2023-09-30T22:22:28.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.765+0000 7ff4d7fff700 1 -- 172.21.15.156:0/1470364412 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff4e000cbc0 con 0x7ff4f00a08e0 2023-09-30T22:22:28.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.766+0000 7ff4f6074700 1 -- 172.21.15.156:0/1470364412 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f011fc50 con 0x7ff4f00a08e0 2023-09-30T22:22:28.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.766+0000 7ff4d7fff700 1 -- 172.21.15.156:0/1470364412 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff4e003fb90 con 0x7ff4f00a08e0 2023-09-30T22:22:28.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.771+0000 7ff4d7fff700 1 -- 172.21.15.156:0/1470364412 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff4e001b3b0 con 0x7ff4f00a08e0 2023-09-30T22:22:28.783 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:28.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.882+0000 7f162f37c700 1 Processor -- start 2023-09-30T22:22:28.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.883+0000 7f162f37c700 1 -- start start 2023-09-30T22:22:28.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.883+0000 7f162f37c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f162809e950 0x7f162809ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.883+0000 7f162f37c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f162809f260 0x7f1628133c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.883+0000 7f162f37c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16281341c0 0x7f1628134640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.883+0000 7f162f37c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f162806c9a0 con 0x7f162809e950 2023-09-30T22:22:28.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.883+0000 7f162f37c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162809afe0 con 0x7f16281341c0 2023-09-30T22:22:28.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.883+0000 7f162f37c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f162806bcc0 con 0x7f162809f260 2023-09-30T22:22:28.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.883+0000 7f162c917700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f162809f260 0x7f1628133c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.883+0000 7f162d919700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16281341c0 0x7f1628134640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.883+0000 7f162c917700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f162809f260 0x7f1628133c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51464/0 (socket says 172.21.15.156:51464) 2023-09-30T22:22:28.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.883+0000 7f162c917700 1 -- 172.21.15.156:0/3418211360 learned_addr learned my addr 172.21.15.156:0/3418211360 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:28.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.883+0000 7f162d118700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f162809e950 0x7f162809ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.884+0000 7f162c917700 1 -- 172.21.15.156:0/3418211360 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16281341c0 msgr2=0x7f1628134640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:28.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.884+0000 7f162c917700 1 --2- 172.21.15.156:0/3418211360 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16281341c0 0x7f1628134640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.884+0000 7f162c917700 1 -- 172.21.15.156:0/3418211360 >> v2:172.21.15.156:3300/0 conn(0x7f162809e950 msgr2=0x7f162809ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:28.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.884+0000 7f162c917700 1 --2- 172.21.15.156:0/3418211360 >> v2:172.21.15.156:3300/0 conn(0x7f162809e950 0x7f162809ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.884+0000 7f162c917700 1 -- 172.21.15.156:0/3418211360 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162806cb80 con 0x7f162809f260 2023-09-30T22:22:28.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.884+0000 7f162d118700 1 --2- 172.21.15.156:0/3418211360 >> v2:172.21.15.156:3300/0 conn(0x7f162809e950 0x7f162809ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:28.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.884+0000 7f162d919700 1 --2- 172.21.15.156:0/3418211360 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16281341c0 0x7f1628134640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:28.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.884+0000 7f162c917700 1 --2- 172.21.15.156:0/3418211360 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f162809f260 0x7f1628133c80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f16180098f0 tx=0x7f1618009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fced4b508a4cc6f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:28.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.884+0000 7f161ffff700 1 -- 172.21.15.156:0/3418211360 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618011830 con 0x7f162809f260 2023-09-30T22:22:28.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.884+0000 7f161ffff700 1 -- 172.21.15.156:0/3418211360 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1618011990 con 0x7f162809f260 2023-09-30T22:22:28.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.884+0000 7f161ffff700 1 -- 172.21.15.156:0/3418211360 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618011d20 con 0x7f162809f260 2023-09-30T22:22:28.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.885+0000 7f162f37c700 1 -- 172.21.15.156:0/3418211360 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f162809f260 msgr2=0x7f1628133c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.885+0000 7f162f37c700 1 --2- 172.21.15.156:0/3418211360 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f162809f260 0x7f1628133c80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f16180098f0 tx=0x7f1618009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:28.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.885+0000 7f162f37c700 1 -- 172.21.15.156:0/3418211360 shutdown_connections 2023-09-30T22:22:28.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.885+0000 7f162f37c700 1 --2- 172.21.15.156:0/3418211360 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16281341c0 0x7f1628134640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.885+0000 7f162f37c700 1 --2- 172.21.15.156:0/3418211360 >> v2:172.21.15.156:3300/0 conn(0x7f162809e950 0x7f162809ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.885+0000 7f162f37c700 1 --2- 172.21.15.156:0/3418211360 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f162809f260 0x7f1628133c80 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.885+0000 7f162f37c700 1 -- 172.21.15.156:0/3418211360 >> 172.21.15.156:0/3418211360 conn(0x7f16280a0f70 msgr2=0x7f16280a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:28.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.885+0000 7f162f37c700 1 -- 172.21.15.156:0/3418211360 shutdown_connections 2023-09-30T22:22:28.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.885+0000 7f162f37c700 1 -- 172.21.15.156:0/3418211360 wait complete. 2023-09-30T22:22:28.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.886+0000 7f162f37c700 1 Processor -- start 2023-09-30T22:22:28.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.886+0000 7f162f37c700 1 -- start start 2023-09-30T22:22:28.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.886+0000 7f162f37c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f162809e950 0x7f162811f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.886+0000 7f162f37c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f162809f260 0x7f162811fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.886+0000 7f162f37c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16281341c0 0x7f16281c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.886+0000 7f162f37c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1628122690 con 0x7f162809e950 2023-09-30T22:22:28.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.886+0000 7f162f37c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1628122870 con 0x7f162809f260 2023-09-30T22:22:28.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.886+0000 7f162f37c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16281336e0 con 0x7f16281341c0 2023-09-30T22:22:28.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.886+0000 7f162c917700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f162809f260 0x7f162811fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.886+0000 7f162c917700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f162809f260 0x7f162811fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33532/0 (socket says 172.21.15.156:33532) 2023-09-30T22:22:28.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.886+0000 7f162c917700 1 -- 172.21.15.156:0/1582065705 learned_addr learned my addr 172.21.15.156:0/1582065705 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:28.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.886+0000 7f162d118700 1 --2- 172.21.15.156:0/1582065705 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f162809e950 0x7f162811f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.886+0000 7f162d919700 1 --2- 172.21.15.156:0/1582065705 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16281341c0 0x7f16281c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.887+0000 7f162c917700 1 -- 172.21.15.156:0/1582065705 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16281341c0 msgr2=0x7f16281c88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.887+0000 7f162c917700 1 --2- 172.21.15.156:0/1582065705 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16281341c0 0x7f16281c88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.887+0000 7f162c917700 1 -- 172.21.15.156:0/1582065705 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f162809e950 msgr2=0x7f162811f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.887+0000 7f162c917700 1 --2- 172.21.15.156:0/1582065705 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f162809e950 0x7f162811f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.887+0000 7f162c917700 1 -- 172.21.15.156:0/1582065705 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1624009430 con 0x7f162809f260 2023-09-30T22:22:28.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.887+0000 7f162c917700 1 --2- 172.21.15.156:0/1582065705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f162809f260 0x7f162811fe10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1618009f50 tx=0x7f1618004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:28.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.887+0000 7f161dffb700 1 -- 172.21.15.156:0/1582065705 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618004450 con 0x7f162809f260 2023-09-30T22:22:28.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.887+0000 7f161dffb700 1 -- 172.21.15.156:0/1582065705 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16180045b0 con 0x7f162809f260 2023-09-30T22:22:28.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.887+0000 7f162f37c700 1 -- 172.21.15.156:0/1582065705 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1620009a70 con 0x7f162809f260 2023-09-30T22:22:28.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.887+0000 7f161dffb700 1 -- 172.21.15.156:0/1582065705 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16180038a0 con 0x7f162809f260 2023-09-30T22:22:28.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.887+0000 7f162f37c700 1 -- 172.21.15.156:0/1582065705 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1618009550 con 0x7f162809f260 2023-09-30T22:22:28.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.888+0000 7f161dffb700 1 -- 172.21.15.156:0/1582065705 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1618021070 con 0x7f162809f260 2023-09-30T22:22:28.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.888+0000 7f161dffb700 1 -- 172.21.15.156:0/1582065705 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f16180405b0 con 0x7f162809f260 2023-09-30T22:22:28.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.889+0000 7f162f37c700 1 -- 172.21.15.156:0/1582065705 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16281229b0 con 0x7f162809f260 2023-09-30T22:22:28.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.893+0000 7f161dffb700 1 -- 172.21.15.156:0/1582065705 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16281229b0 con 0x7f162809f260 2023-09-30T22:22:28.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.910+0000 7f58f0aa1700 1 Processor -- start 2023-09-30T22:22:28.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.911+0000 7f58f0aa1700 1 -- start start 2023-09-30T22:22:28.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.911+0000 7f58f0aa1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58ec09e870 0x7f58ec09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.911+0000 7f58f0aa1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f58ec09f180 0x7f58ec131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.911+0000 7f58f0aa1700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58ec09c970 con 0x7f58ec131d70 2023-09-30T22:22:28.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.911+0000 7f58f0aa1700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58ec0a0920 con 0x7f58ec09f180 2023-09-30T22:22:28.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.911+0000 7f58f0aa1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec09f9c0 con 0x7f58ec09e870 2023-09-30T22:22:28.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.911+0000 7f58e9d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f58ec09f180 0x7f58ec131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.911+0000 7f58ead9d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f58ec131d70 0x7f58ec138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:56440/0 (socket says 172.21.15.156:56440) 2023-09-30T22:22:28.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.911+0000 7f58e9d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f58ec09f180 0x7f58ec131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60026/0 (socket says 172.21.15.156:60026) 2023-09-30T22:22:28.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.911+0000 7f58ead9d700 1 -- 172.21.15.156:0/723562687 learned_addr learned my addr 172.21.15.156:0/723562687 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:28.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.911+0000 7f58ea59c700 1 --2- 172.21.15.156:0/723562687 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58ec09e870 0x7f58ec09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.912+0000 7f58e959a700 1 -- 172.21.15.156:0/723562687 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2669483675 0 0) 0x7f58ec09c970 con 0x7f58ec131d70 2023-09-30T22:22:28.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.912+0000 7f58e959a700 1 -- 172.21.15.156:0/723562687 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58d40035b0 con 0x7f58ec131d70 2023-09-30T22:22:28.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.912+0000 7f58e9d9b700 1 -- 172.21.15.156:0/723562687 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58ec09e870 msgr2=0x7f58ec09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:28.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.912+0000 7f58e9d9b700 1 --2- 172.21.15.156:0/723562687 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58ec09e870 0x7f58ec09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.912+0000 7f58e9d9b700 1 -- 172.21.15.156:0/723562687 >> v1:172.21.15.156:6789/0 conn(0x7f58ec131d70 legacy=0x7f58ec138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.912+0000 7f58e9d9b700 1 -- 172.21.15.156:0/723562687 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ec09bab0 con 0x7f58ec09f180 2023-09-30T22:22:28.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.912+0000 7f58ea59c700 1 --2- 172.21.15.156:0/723562687 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58ec09e870 0x7f58ec09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:28.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.912+0000 7f58e9d9b700 1 --2- 172.21.15.156:0/723562687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58ec09f180 0x7f58ec131830 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f58e0009840 tx=0x7f58e0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721586b8fe2b59be server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:28.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.912+0000 7f58e959a700 1 -- 172.21.15.156:0/723562687 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e0011830 con 0x7f58ec09f180 2023-09-30T22:22:28.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.912+0000 7f58e959a700 1 -- 172.21.15.156:0/723562687 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e0011990 con 0x7f58ec09f180 2023-09-30T22:22:28.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.912+0000 7f58e959a700 1 -- 172.21.15.156:0/723562687 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e0011d20 con 0x7f58ec09f180 2023-09-30T22:22:28.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.913+0000 7f58f0aa1700 1 -- 172.21.15.156:0/723562687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58ec09f180 msgr2=0x7f58ec131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.913+0000 7f58f0aa1700 1 --2- 172.21.15.156:0/723562687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58ec09f180 0x7f58ec131830 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f58e0009840 tx=0x7f58e0009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:28.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.913+0000 7f58f0aa1700 1 -- 172.21.15.156:0/723562687 shutdown_connections 2023-09-30T22:22:28.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.913+0000 7f58f0aa1700 1 --2- 172.21.15.156:0/723562687 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58ec09e870 0x7f58ec09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.913+0000 7f58f0aa1700 1 --2- 172.21.15.156:0/723562687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58ec09f180 0x7f58ec131830 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.913+0000 7f58f0aa1700 1 -- 172.21.15.156:0/723562687 >> 172.21.15.156:0/723562687 conn(0x7f58ec0a4430 msgr2=0x7f58ec0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:28.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.913+0000 7f58f0aa1700 1 -- 172.21.15.156:0/723562687 shutdown_connections 2023-09-30T22:22:28.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.913+0000 7f58f0aa1700 1 -- 172.21.15.156:0/723562687 wait complete. 2023-09-30T22:22:28.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.914+0000 7f58f0aa1700 1 Processor -- start 2023-09-30T22:22:28.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.914+0000 7f58f0aa1700 1 -- start start 2023-09-30T22:22:28.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.914+0000 7f58f0aa1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f58ec09e870 0x7f58ec06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.914+0000 7f58f0aa1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58ec09f180 0x7f58ec06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.914+0000 7f58f0aa1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58ec131d70 0x7f58ec06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.914+0000 7f58f0aa1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec1248c0 con 0x7f58ec09f180 2023-09-30T22:22:28.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.914+0000 7f58f0aa1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec124e90 con 0x7f58ec131d70 2023-09-30T22:22:28.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.914+0000 7f58f0aa1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec124aa0 con 0x7f58ec09e870 2023-09-30T22:22:28.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.914+0000 7f58e9d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58ec09f180 0x7f58ec06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.914+0000 7f58e9d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58ec09f180 0x7f58ec06bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60036/0 (socket says 172.21.15.156:60036) 2023-09-30T22:22:28.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.914+0000 7f58e9d9b700 1 -- 172.21.15.156:0/4090653871 learned_addr learned my addr 172.21.15.156:0/4090653871 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:28.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.914+0000 7f58ead9d700 1 --2- 172.21.15.156:0/4090653871 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58ec131d70 0x7f58ec06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.915+0000 7f58ea59c700 1 --2- 172.21.15.156:0/4090653871 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f58ec09e870 0x7f58ec06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.915+0000 7f58e9d9b700 1 -- 172.21.15.156:0/4090653871 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f58ec09e870 msgr2=0x7f58ec06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.915+0000 7f58e9d9b700 1 --2- 172.21.15.156:0/4090653871 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f58ec09e870 0x7f58ec06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.915+0000 7f58e9d9b700 1 -- 172.21.15.156:0/4090653871 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58ec131d70 msgr2=0x7f58ec06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.915+0000 7f58e9d9b700 1 --2- 172.21.15.156:0/4090653871 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58ec131d70 0x7f58ec06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.915+0000 7f58e9d9b700 1 -- 172.21.15.156:0/4090653871 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58dc0094a0 con 0x7f58ec09f180 2023-09-30T22:22:28.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.915+0000 7f58ead9d700 1 --2- 172.21.15.156:0/4090653871 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58ec131d70 0x7f58ec06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:28.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.915+0000 7f58e9d9b700 1 --2- 172.21.15.156:0/4090653871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58ec09f180 0x7f58ec06bdf0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f58e0000c00 tx=0x7f58e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:28.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.915+0000 7f58daffd700 1 -- 172.21.15.156:0/4090653871 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e0004590 con 0x7f58ec09f180 2023-09-30T22:22:28.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.915+0000 7f58daffd700 1 -- 172.21.15.156:0/4090653871 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e001f070 con 0x7f58ec09f180 2023-09-30T22:22:28.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.915+0000 7f58f0aa1700 1 -- 172.21.15.156:0/4090653871 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e00094a0 con 0x7f58ec09f180 2023-09-30T22:22:28.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.915+0000 7f58daffd700 1 -- 172.21.15.156:0/4090653871 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e00038e0 con 0x7f58ec09f180 2023-09-30T22:22:28.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.915+0000 7f58f0aa1700 1 -- 172.21.15.156:0/4090653871 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58ec124150 con 0x7f58ec09f180 2023-09-30T22:22:28.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.916+0000 7f58daffd700 1 -- 172.21.15.156:0/4090653871 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f58e0003a40 con 0x7f58ec09f180 2023-09-30T22:22:28.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.916+0000 7f58f0aa1700 1 -- 172.21.15.156:0/4090653871 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58ec123b40 con 0x7f58ec09f180 2023-09-30T22:22:28.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.916+0000 7f58daffd700 1 -- 172.21.15.156:0/4090653871 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f58e0021070 con 0x7f58ec09f180 2023-09-30T22:22:28.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.925+0000 7f58daffd700 1 -- 172.21.15.156:0/4090653871 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f58ec123b40 con 0x7f58ec09f180 2023-09-30T22:22:28.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.969+0000 7ff4f6074700 1 -- 172.21.15.156:0/1470364412 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff4f004f2a0 con 0x7ff4f00a08e0 2023-09-30T22:22:28.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.969+0000 7ff4d7fff700 1 -- 172.21.15.156:0/1470364412 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff4e0021070 con 0x7ff4f00a08e0 2023-09-30T22:22:28.970 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:28.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.971+0000 7ff4f6074700 1 -- 172.21.15.156:0/1470364412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4f00a08e0 msgr2=0x7ff4f011c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.971+0000 7ff4f6074700 1 --2- 172.21.15.156:0/1470364412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4f00a08e0 0x7ff4f011c830 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000e990 tx=0x7ff4e000eca0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.971+0000 7ff4f6074700 1 -- 172.21.15.156:0/1470364412 shutdown_connections 2023-09-30T22:22:28.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.971+0000 7ff4f6074700 1 --2- 172.21.15.156:0/1470364412 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4f0133a70 0x7ff4f011d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.971+0000 7ff4f6074700 1 --2- 172.21.15.156:0/1470364412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4f00a08e0 0x7ff4f011c830 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.971+0000 7ff4f6074700 1 --2- 172.21.15.156:0/1470364412 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4f00a1290 0x7ff4f011cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.971+0000 7ff4f6074700 1 -- 172.21.15.156:0/1470364412 >> 172.21.15.156:0/1470364412 conn(0x7ff4f00a2980 msgr2=0x7ff4f01baf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:28.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.971+0000 7ff4f6074700 1 -- 172.21.15.156:0/1470364412 shutdown_connections 2023-09-30T22:22:28.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:28.972+0000 7ff4f6074700 1 -- 172.21.15.156:0/1470364412 wait complete. 2023-09-30T22:22:28.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:29.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.094+0000 7f162f37c700 1 -- 172.21.15.156:0/1582065705 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f16281229b0 con 0x7f162809f260 2023-09-30T22:22:29.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.095+0000 7f161dffb700 1 -- 172.21.15.156:0/1582065705 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f16281229b0 con 0x7f162809f260 2023-09-30T22:22:29.096 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:29.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.097+0000 7f162f37c700 1 -- 172.21.15.156:0/1582065705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f162809f260 msgr2=0x7f162811fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.097+0000 7f162f37c700 1 --2- 172.21.15.156:0/1582065705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f162809f260 0x7f162811fe10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1618009f50 tx=0x7f1618004750 comp rx=0 tx=0).stop 2023-09-30T22:22:29.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.097+0000 7f162f37c700 1 -- 172.21.15.156:0/1582065705 shutdown_connections 2023-09-30T22:22:29.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.097+0000 7f162f37c700 1 --2- 172.21.15.156:0/1582065705 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16281341c0 0x7f16281c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.097+0000 7f162f37c700 1 --2- 172.21.15.156:0/1582065705 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f162809e950 0x7f162811f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.097+0000 7f162f37c700 1 --2- 172.21.15.156:0/1582065705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f162809f260 0x7f162811fe10 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.097+0000 7f162f37c700 1 -- 172.21.15.156:0/1582065705 >> 172.21.15.156:0/1582065705 conn(0x7f16280a0f70 msgr2=0x7f1628071010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:29.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.097+0000 7f162f37c700 1 -- 172.21.15.156:0/1582065705 shutdown_connections 2023-09-30T22:22:29.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.097+0000 7f162f37c700 1 -- 172.21.15.156:0/1582065705 wait complete. 2023-09-30T22:22:29.106 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:29.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:29.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.121+0000 7f58f0aa1700 1 -- 172.21.15.156:0/4090653871 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f58ec11be60 con 0x7f58ec09f180 2023-09-30T22:22:29.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.121+0000 7f58daffd700 1 -- 172.21.15.156:0/4090653871 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f58e0015070 con 0x7f58ec09f180 2023-09-30T22:22:29.122 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:29.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.123+0000 7f58f0aa1700 1 -- 172.21.15.156:0/4090653871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58ec09f180 msgr2=0x7f58ec06bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.123+0000 7f58f0aa1700 1 --2- 172.21.15.156:0/4090653871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58ec09f180 0x7f58ec06bdf0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f58e0000c00 tx=0x7f58e0004750 comp rx=0 tx=0).stop 2023-09-30T22:22:29.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.123+0000 7f58f0aa1700 1 -- 172.21.15.156:0/4090653871 shutdown_connections 2023-09-30T22:22:29.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.123+0000 7f58f0aa1700 1 --2- 172.21.15.156:0/4090653871 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58ec131d70 0x7f58ec06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.123+0000 7f58f0aa1700 1 --2- 172.21.15.156:0/4090653871 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f58ec09e870 0x7f58ec06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.123+0000 7f58f0aa1700 1 --2- 172.21.15.156:0/4090653871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58ec09f180 0x7f58ec06bdf0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.123+0000 7f58f0aa1700 1 -- 172.21.15.156:0/4090653871 >> 172.21.15.156:0/4090653871 conn(0x7f58ec0a4430 msgr2=0x7f58ec1310f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:29.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.123+0000 7f58f0aa1700 1 -- 172.21.15.156:0/4090653871 shutdown_connections 2023-09-30T22:22:29.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.123+0000 7f58f0aa1700 1 -- 172.21.15.156:0/4090653871 wait complete. 2023-09-30T22:22:29.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:29.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.230+0000 7fdeb2bd1700 1 Processor -- start 2023-09-30T22:22:29.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.230+0000 7fdeb2bd1700 1 -- start start 2023-09-30T22:22:29.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.230+0000 7fdeb2bd1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdeac06a770 0x7fdeac06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:29.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.230+0000 7fdeb2bd1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdeac09dec0 0x7fdeac06b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:29.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.231+0000 7fdeb2bd1700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeac06b5c0 con 0x7fdeac131a00 2023-09-30T22:22:29.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.231+0000 7fdeb2bd1700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeac06e900 con 0x7fdeac09dec0 2023-09-30T22:22:29.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.231+0000 7fdeb2bd1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac09d180 con 0x7fdeac06a770 2023-09-30T22:22:29.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.231+0000 7fdeabfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdeac09dec0 0x7fdeac06b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:29.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.231+0000 7fdeb116e700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fdeac131a00 0x7fdeac131e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:56450/0 (socket says 172.21.15.156:56450) 2023-09-30T22:22:29.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.231+0000 7fdeabfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdeac09dec0 0x7fdeac06b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60046/0 (socket says 172.21.15.156:60046) 2023-09-30T22:22:29.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.231+0000 7fdeb116e700 1 -- 172.21.15.156:0/3777421100 learned_addr learned my addr 172.21.15.156:0/3777421100 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:29.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.231+0000 7fdeb096d700 1 --2- 172.21.15.156:0/3777421100 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdeac06a770 0x7fdeac06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:29.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.231+0000 7fdeabfff700 1 -- 172.21.15.156:0/3777421100 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdeac06a770 msgr2=0x7fdeac06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:29.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.231+0000 7fdeabfff700 1 --2- 172.21.15.156:0/3777421100 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdeac06a770 0x7fdeac06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.231+0000 7fdeabfff700 1 -- 172.21.15.156:0/3777421100 >> v1:172.21.15.156:6789/0 conn(0x7fdeac131a00 legacy=0x7fdeac131e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.231+0000 7fdeab7fe700 1 -- 172.21.15.156:0/3777421100 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362556482 0 0) 0x7fdeac06b5c0 con 0x7fdeac131a00 2023-09-30T22:22:29.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.231+0000 7fdeabfff700 1 -- 172.21.15.156:0/3777421100 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac09e780 con 0x7fdeac09dec0 2023-09-30T22:22:29.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.231+0000 7fdeb096d700 1 --2- 172.21.15.156:0/3777421100 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdeac06a770 0x7fdeac06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:29.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.231+0000 7fdeabfff700 1 --2- 172.21.15.156:0/3777421100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdeac09dec0 0x7fdeac06b080 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fde98009840 tx=0x7fde98009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f0727d9a176747f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:29.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.231+0000 7fdeab7fe700 1 -- 172.21.15.156:0/3777421100 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde98011830 con 0x7fdeac09dec0 2023-09-30T22:22:29.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.231+0000 7fdeab7fe700 1 -- 172.21.15.156:0/3777421100 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde98011990 con 0x7fdeac09dec0 2023-09-30T22:22:29.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.231+0000 7fdeab7fe700 1 -- 172.21.15.156:0/3777421100 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde98011d20 con 0x7fdeac09dec0 2023-09-30T22:22:29.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.232+0000 7fdeb2bd1700 1 -- 172.21.15.156:0/3777421100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdeac09dec0 msgr2=0x7fdeac06b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.232+0000 7fdeb2bd1700 1 --2- 172.21.15.156:0/3777421100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdeac09dec0 0x7fdeac06b080 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fde98009840 tx=0x7fde98009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:29.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.232+0000 7fdeb2bd1700 1 -- 172.21.15.156:0/3777421100 shutdown_connections 2023-09-30T22:22:29.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.232+0000 7fdeb2bd1700 1 --2- 172.21.15.156:0/3777421100 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdeac06a770 0x7fdeac06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.232+0000 7fdeb2bd1700 1 --2- 172.21.15.156:0/3777421100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdeac09dec0 0x7fdeac06b080 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.232+0000 7fdeb2bd1700 1 -- 172.21.15.156:0/3777421100 >> 172.21.15.156:0/3777421100 conn(0x7fdeac099c40 msgr2=0x7fdeac0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:29.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.232+0000 7fdeb2bd1700 1 -- 172.21.15.156:0/3777421100 shutdown_connections 2023-09-30T22:22:29.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.232+0000 7fdeb2bd1700 1 -- 172.21.15.156:0/3777421100 wait complete. 2023-09-30T22:22:29.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.233+0000 7fdeb2bd1700 1 Processor -- start 2023-09-30T22:22:29.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.233+0000 7fdeb2bd1700 1 -- start start 2023-09-30T22:22:29.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.233+0000 7fdeb2bd1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdeac06a770 0x7fdeac119f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:29.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.233+0000 7fdeb2bd1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdeac09dec0 0x7fdeac11a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:29.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.233+0000 7fdeb2bd1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdeac131a00 0x7fdeac11a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:29.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.233+0000 7fdeb2bd1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac11b3e0 con 0x7fdeac09dec0 2023-09-30T22:22:29.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.233+0000 7fdeb2bd1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac11baa0 con 0x7fdeac06a770 2023-09-30T22:22:29.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.233+0000 7fdeb2bd1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac11ccf0 con 0x7fdeac131a00 2023-09-30T22:22:29.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.233+0000 7fdeabfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdeac09dec0 0x7fdeac11a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:29.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.233+0000 7fdeb096d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdeac06a770 0x7fdeac119f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:29.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.233+0000 7fdeb116e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdeac131a00 0x7fdeac11a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:29.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.233+0000 7fdeabfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdeac09dec0 0x7fdeac11a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60052/0 (socket says 172.21.15.156:60052) 2023-09-30T22:22:29.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.233+0000 7fdeabfff700 1 -- 172.21.15.156:0/3709347462 learned_addr learned my addr 172.21.15.156:0/3709347462 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:29.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.234+0000 7fdeabfff700 1 -- 172.21.15.156:0/3709347462 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdeac131a00 msgr2=0x7fdeac11a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.234+0000 7fdeabfff700 1 --2- 172.21.15.156:0/3709347462 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdeac131a00 0x7fdeac11a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.234+0000 7fdeabfff700 1 -- 172.21.15.156:0/3709347462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdeac06a770 msgr2=0x7fdeac119f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.234+0000 7fdeabfff700 1 --2- 172.21.15.156:0/3709347462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdeac06a770 0x7fdeac119f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.234+0000 7fdeabfff700 1 -- 172.21.15.156:0/3709347462 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea00094a0 con 0x7fdeac09dec0 2023-09-30T22:22:29.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.234+0000 7fdeb096d700 1 --2- 172.21.15.156:0/3709347462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdeac06a770 0x7fdeac119f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:29.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.234+0000 7fdeb116e700 1 --2- 172.21.15.156:0/3709347462 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdeac131a00 0x7fdeac11a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:29.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.234+0000 7fdeabfff700 1 --2- 172.21.15.156:0/3709347462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdeac09dec0 0x7fdeac11a470 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fde980090b0 tx=0x7fde98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:29.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.234+0000 7fdea97fa700 1 -- 172.21.15.156:0/3709347462 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde980036a0 con 0x7fdeac09dec0 2023-09-30T22:22:29.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.234+0000 7fdea97fa700 1 -- 172.21.15.156:0/3709347462 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9801f070 con 0x7fdeac09dec0 2023-09-30T22:22:29.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.234+0000 7fdea97fa700 1 -- 172.21.15.156:0/3709347462 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde98003a60 con 0x7fdeac09dec0 2023-09-30T22:22:29.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.234+0000 7fdeb2bd1700 1 -- 172.21.15.156:0/3709347462 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde980094a0 con 0x7fdeac09dec0 2023-09-30T22:22:29.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.234+0000 7fdeb2bd1700 1 -- 172.21.15.156:0/3709347462 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeac11d140 con 0x7fdeac09dec0 2023-09-30T22:22:29.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.235+0000 7fdea97fa700 1 -- 172.21.15.156:0/3709347462 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fde98003bc0 con 0x7fdeac09dec0 2023-09-30T22:22:29.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.235+0000 7fdea97fa700 1 -- 172.21.15.156:0/3709347462 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fde98021070 con 0x7fdeac09dec0 2023-09-30T22:22:29.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.235+0000 7fdeb2bd1700 1 -- 172.21.15.156:0/3709347462 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeac131190 con 0x7fdeac09dec0 2023-09-30T22:22:29.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.240+0000 7fdea97fa700 1 -- 172.21.15.156:0/3709347462 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fde98010380 con 0x7fdeac09dec0 2023-09-30T22:22:29.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.424+0000 7fdeb2bd1700 1 -- 172.21.15.156:0/3709347462 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdeac071ce0 con 0x7fdeac09dec0 2023-09-30T22:22:29.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.425+0000 7fdea97fa700 1 -- 172.21.15.156:0/3709347462 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fde98015020 con 0x7fdeac09dec0 2023-09-30T22:22:29.427 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:29.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.427+0000 7fdeb2bd1700 1 -- 172.21.15.156:0/3709347462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdeac09dec0 msgr2=0x7fdeac11a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.427+0000 7fdeb2bd1700 1 --2- 172.21.15.156:0/3709347462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdeac09dec0 0x7fdeac11a470 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fde980090b0 tx=0x7fde98004750 comp rx=0 tx=0).stop 2023-09-30T22:22:29.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.427+0000 7fdeb2bd1700 1 -- 172.21.15.156:0/3709347462 shutdown_connections 2023-09-30T22:22:29.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.427+0000 7fdeb2bd1700 1 --2- 172.21.15.156:0/3709347462 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdeac131a00 0x7fdeac11a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.427+0000 7fdeb2bd1700 1 --2- 172.21.15.156:0/3709347462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdeac06a770 0x7fdeac119f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.427+0000 7fdeb2bd1700 1 --2- 172.21.15.156:0/3709347462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdeac09dec0 0x7fdeac11a470 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.427+0000 7fdeb2bd1700 1 -- 172.21.15.156:0/3709347462 >> 172.21.15.156:0/3709347462 conn(0x7fdeac099c40 msgr2=0x7fdeac12ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:29.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.427+0000 7fdeb2bd1700 1 -- 172.21.15.156:0/3709347462 shutdown_connections 2023-09-30T22:22:29.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:29.427+0000 7fdeb2bd1700 1 -- 172.21.15.156:0/3709347462 wait complete. 2023-09-30T22:22:29.440 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:29.986 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:30.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.109+0000 7f3b5ab60700 1 Processor -- start 2023-09-30T22:22:30.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.109+0000 7f3b5ab60700 1 -- start start 2023-09-30T22:22:30.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.110+0000 7f3b5ab60700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3b540a0a70 0x7f3b540a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:30.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.110+0000 7f3b5ab60700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3b540a1380 0x7f3b54133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:30.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.110+0000 7f3b5ab60700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b5409dc00 con 0x7f3b54133f50 2023-09-30T22:22:30.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.110+0000 7f3b5ab60700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5409ea60 con 0x7f3b540a0a70 2023-09-30T22:22:30.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.110+0000 7f3b5ab60700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5409dec0 con 0x7f3b540a1380 2023-09-30T22:22:30.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.110+0000 7f3b53fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3b540a1380 0x7f3b54133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:30.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.110+0000 7f3b588fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3b540a0a70 0x7f3b540a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:30.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.110+0000 7f3b53fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3b540a1380 0x7f3b54133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51518/0 (socket says 172.21.15.156:51518) 2023-09-30T22:22:30.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.110+0000 7f3b53fff700 1 -- 172.21.15.156:0/2788133037 learned_addr learned my addr 172.21.15.156:0/2788133037 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:30.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.110+0000 7f3b590fd700 1 --1- 172.21.15.156:0/2788133037 >> v1:172.21.15.156:6789/0 conn(0x7f3b54133f50 0x7f3b5413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:56466/0 (socket says 172.21.15.156:56466) 2023-09-30T22:22:30.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.110+0000 7f3b588fc700 1 -- 172.21.15.156:0/2788133037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3b540a1380 msgr2=0x7f3b54133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:30.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.110+0000 7f3b588fc700 1 --2- 172.21.15.156:0/2788133037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3b540a1380 0x7f3b54133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.110+0000 7f3b588fc700 1 -- 172.21.15.156:0/2788133037 >> v1:172.21.15.156:6789/0 conn(0x7f3b54133f50 legacy=0x7f3b5413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:30.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.110+0000 7f3b588fc700 1 -- 172.21.15.156:0/2788133037 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5409e6a0 con 0x7f3b540a0a70 2023-09-30T22:22:30.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.110+0000 7f3b537fe700 1 -- 172.21.15.156:0/2788133037 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198572810 0 0) 0x7f3b5409dc00 con 0x7f3b54133f50 2023-09-30T22:22:30.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.110+0000 7f3b53fff700 1 --2- 172.21.15.156:0/2788133037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3b540a1380 0x7f3b54133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:30.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.110+0000 7f3b588fc700 1 --2- 172.21.15.156:0/2788133037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b540a0a70 0x7f3b540a0e40 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f3b48009840 tx=0x7f3b48009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3096caf5b573009a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:30.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.110+0000 7f3b537fe700 1 -- 172.21.15.156:0/2788133037 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b48011830 con 0x7f3b540a0a70 2023-09-30T22:22:30.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.111+0000 7f3b537fe700 1 -- 172.21.15.156:0/2788133037 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b48011990 con 0x7f3b540a0a70 2023-09-30T22:22:30.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.111+0000 7f3b537fe700 1 -- 172.21.15.156:0/2788133037 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b48011d20 con 0x7f3b540a0a70 2023-09-30T22:22:30.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.111+0000 7f3b5ab60700 1 -- 172.21.15.156:0/2788133037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b540a0a70 msgr2=0x7f3b540a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:30.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.111+0000 7f3b5ab60700 1 --2- 172.21.15.156:0/2788133037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b540a0a70 0x7f3b540a0e40 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f3b48009840 tx=0x7f3b48009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:30.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.111+0000 7f3b5ab60700 1 -- 172.21.15.156:0/2788133037 shutdown_connections 2023-09-30T22:22:30.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.111+0000 7f3b5ab60700 1 --2- 172.21.15.156:0/2788133037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b540a0a70 0x7f3b540a0e40 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.111+0000 7f3b5ab60700 1 --2- 172.21.15.156:0/2788133037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3b540a1380 0x7f3b54133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.111+0000 7f3b5ab60700 1 -- 172.21.15.156:0/2788133037 >> 172.21.15.156:0/2788133037 conn(0x7f3b540a6610 msgr2=0x7f3b540a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:30.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.111+0000 7f3b5ab60700 1 -- 172.21.15.156:0/2788133037 shutdown_connections 2023-09-30T22:22:30.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.111+0000 7f3b5ab60700 1 -- 172.21.15.156:0/2788133037 wait complete. 2023-09-30T22:22:30.115 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:30.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.112+0000 7f3b5ab60700 1 Processor -- start 2023-09-30T22:22:30.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.112+0000 7f3b5ab60700 1 -- start start 2023-09-30T22:22:30.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.113+0000 7f3b5ab60700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3b540a0a70 0x7f3b54122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:30.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.113+0000 7f3b5ab60700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3b540a1380 0x7f3b54122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:30.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.113+0000 7f3b5ab60700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b54133f50 0x7f3b541232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:30.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.113+0000 7f3b5ab60700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b54133ad0 con 0x7f3b54133f50 2023-09-30T22:22:30.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.113+0000 7f3b5ab60700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b54125de0 con 0x7f3b540a1380 2023-09-30T22:22:30.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.113+0000 7f3b5ab60700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b54124510 con 0x7f3b540a0a70 2023-09-30T22:22:30.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.113+0000 7f3b53fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3b540a1380 0x7f3b54122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:30.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.113+0000 7f3b588fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3b540a0a70 0x7f3b54122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:30.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.113+0000 7f3b53fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3b540a1380 0x7f3b54122da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33578/0 (socket says 172.21.15.156:33578) 2023-09-30T22:22:30.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.113+0000 7f3b588fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3b540a0a70 0x7f3b54122860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51534/0 (socket says 172.21.15.156:51534) 2023-09-30T22:22:30.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.113+0000 7f3b53fff700 1 -- 172.21.15.156:0/2553246995 learned_addr learned my addr 172.21.15.156:0/2553246995 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:30.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.113+0000 7f3b590fd700 1 --2- 172.21.15.156:0/2553246995 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b54133f50 0x7f3b541232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:30.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.113+0000 7f3b53fff700 1 -- 172.21.15.156:0/2553246995 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3b540a0a70 msgr2=0x7f3b54122860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:30.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.113+0000 7f3b53fff700 1 --2- 172.21.15.156:0/2553246995 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3b540a0a70 0x7f3b54122860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.113+0000 7f3b53fff700 1 -- 172.21.15.156:0/2553246995 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b54133f50 msgr2=0x7f3b541232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:30.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.113+0000 7f3b53fff700 1 --2- 172.21.15.156:0/2553246995 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b54133f50 0x7f3b541232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.113+0000 7f3b53fff700 1 -- 172.21.15.156:0/2553246995 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b40009550 con 0x7f3b540a1380 2023-09-30T22:22:30.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.113+0000 7f3b588fc700 1 --2- 172.21.15.156:0/2553246995 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3b540a0a70 0x7f3b54122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:30.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.113+0000 7f3b590fd700 1 --2- 172.21.15.156:0/2553246995 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b54133f50 0x7f3b541232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:30.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.113+0000 7f3b53fff700 1 --2- 172.21.15.156:0/2553246995 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3b540a1380 0x7f3b54122da0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3b4000ec10 tx=0x7f3b4000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:30.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.113+0000 7f3b517fa700 1 -- 172.21.15.156:0/2553246995 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4000c850 con 0x7f3b540a1380 2023-09-30T22:22:30.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.113+0000 7f3b517fa700 1 -- 172.21.15.156:0/2553246995 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4000c9b0 con 0x7f3b540a1380 2023-09-30T22:22:30.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.113+0000 7f3b5ab60700 1 -- 172.21.15.156:0/2553246995 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b480094a0 con 0x7f3b540a1380 2023-09-30T22:22:30.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.113+0000 7f3b517fa700 1 -- 172.21.15.156:0/2553246995 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4000cd40 con 0x7f3b540a1380 2023-09-30T22:22:30.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.113+0000 7f3b5ab60700 1 -- 172.21.15.156:0/2553246995 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b540a0430 con 0x7f3b540a1380 2023-09-30T22:22:30.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.114+0000 7f3b517fa700 1 -- 172.21.15.156:0/2553246995 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b40013470 con 0x7f3b540a1380 2023-09-30T22:22:30.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.114+0000 7f3b517fa700 1 -- 172.21.15.156:0/2553246995 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3b4003f860 con 0x7f3b540a1380 2023-09-30T22:22:30.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.114+0000 7f3b5ab60700 1 -- 172.21.15.156:0/2553246995 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b5404f2a0 con 0x7f3b540a1380 2023-09-30T22:22:30.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.119+0000 7f3b517fa700 1 -- 172.21.15.156:0/2553246995 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b40013720 con 0x7f3b540a1380 2023-09-30T22:22:30.137 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:30.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.244+0000 7fa07711e700 1 Processor -- start 2023-09-30T22:22:30.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.244+0000 7fa07711e700 1 -- start start 2023-09-30T22:22:30.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.244+0000 7fa07711e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa07009e340 0x7fa0701359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:30.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.244+0000 7fa07711e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa070135f20 0x7fa070138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:30.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.244+0000 7fa07711e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa07009aaa0 con 0x7fa07009d860 2023-09-30T22:22:30.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.244+0000 7fa07711e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07009e730 con 0x7fa07009e340 2023-09-30T22:22:30.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.244+0000 7fa07711e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa07009f870 con 0x7fa070135f20 2023-09-30T22:22:30.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.244+0000 7fa06ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa07009e340 0x7fa0701359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:30.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.244+0000 7fa074eba700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fa07009d860 0x7fa07009dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:56468/0 (socket says 172.21.15.156:56468) 2023-09-30T22:22:30.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.245+0000 7fa074eba700 1 -- 172.21.15.156:0/2305580581 learned_addr learned my addr 172.21.15.156:0/2305580581 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:30.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.245+0000 7fa06ffff700 1 --2- 172.21.15.156:0/2305580581 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa07009e340 0x7fa0701359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33588/0 (socket says 172.21.15.156:33588) 2023-09-30T22:22:30.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.245+0000 7fa0756bb700 1 --2- 172.21.15.156:0/2305580581 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa070135f20 0x7fa070138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:30.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.245+0000 7fa06ffff700 1 -- 172.21.15.156:0/2305580581 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa070135f20 msgr2=0x7fa070138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:30.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.245+0000 7fa06f7fe700 1 -- 172.21.15.156:0/2305580581 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4069278282 0 0) 0x7fa07009aaa0 con 0x7fa07009d860 2023-09-30T22:22:30.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.245+0000 7fa06ffff700 1 --2- 172.21.15.156:0/2305580581 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa070135f20 0x7fa070138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.245+0000 7fa06ffff700 1 -- 172.21.15.156:0/2305580581 >> v1:172.21.15.156:6789/0 conn(0x7fa07009d860 legacy=0x7fa07009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:30.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.245+0000 7fa06ffff700 1 -- 172.21.15.156:0/2305580581 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07009b360 con 0x7fa07009e340 2023-09-30T22:22:30.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.245+0000 7fa06ffff700 1 --2- 172.21.15.156:0/2305580581 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa07009e340 0x7fa0701359e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00bb10 tx=0x7fa05c00be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0baafcc5defdd35 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:30.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.245+0000 7fa06f7fe700 1 -- 172.21.15.156:0/2305580581 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c00dc70 con 0x7fa07009e340 2023-09-30T22:22:30.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.245+0000 7fa06f7fe700 1 -- 172.21.15.156:0/2305580581 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05c00ddd0 con 0x7fa07009e340 2023-09-30T22:22:30.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.245+0000 7fa06f7fe700 1 -- 172.21.15.156:0/2305580581 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c010690 con 0x7fa07009e340 2023-09-30T22:22:30.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.246+0000 7fa07711e700 1 -- 172.21.15.156:0/2305580581 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa07009e340 msgr2=0x7fa0701359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:30.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.246+0000 7fa07711e700 1 --2- 172.21.15.156:0/2305580581 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa07009e340 0x7fa0701359e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00bb10 tx=0x7fa05c00be20 comp rx=0 tx=0).stop 2023-09-30T22:22:30.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.246+0000 7fa07711e700 1 -- 172.21.15.156:0/2305580581 shutdown_connections 2023-09-30T22:22:30.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.246+0000 7fa07711e700 1 --2- 172.21.15.156:0/2305580581 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa070135f20 0x7fa070138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.246+0000 7fa07711e700 1 --2- 172.21.15.156:0/2305580581 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa07009e340 0x7fa0701359e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.246+0000 7fa07711e700 1 -- 172.21.15.156:0/2305580581 >> 172.21.15.156:0/2305580581 conn(0x7fa070099c40 msgr2=0x7fa0700a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:30.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.246+0000 7fa07711e700 1 -- 172.21.15.156:0/2305580581 shutdown_connections 2023-09-30T22:22:30.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.246+0000 7fa07711e700 1 -- 172.21.15.156:0/2305580581 wait complete. 2023-09-30T22:22:30.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.247+0000 7fa07711e700 1 Processor -- start 2023-09-30T22:22:30.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.247+0000 7fa07711e700 1 -- start start 2023-09-30T22:22:30.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.248+0000 7fa07711e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa07009d860 0x7fa07011c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:30.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.248+0000 7fa07711e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa07009e340 0x7fa07011c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:30.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.248+0000 7fa07711e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa070135f20 0x7fa07011cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:30.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.248+0000 7fa07711e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07011e4c0 con 0x7fa070135f20 2023-09-30T22:22:30.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.248+0000 7fa07711e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0700a2020 con 0x7fa07009e340 2023-09-30T22:22:30.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.248+0000 7fa07711e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa07011f530 con 0x7fa07009d860 2023-09-30T22:22:30.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.248+0000 7fa06ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa07009e340 0x7fa07011c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:30.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.248+0000 7fa06ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa07009e340 0x7fa07011c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33598/0 (socket says 172.21.15.156:33598) 2023-09-30T22:22:30.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.248+0000 7fa06ffff700 1 -- 172.21.15.156:0/1672901555 learned_addr learned my addr 172.21.15.156:0/1672901555 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:30.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.248+0000 7fa0756bb700 1 --2- 172.21.15.156:0/1672901555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa070135f20 0x7fa07011cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:30.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.248+0000 7fa074eba700 1 --2- 172.21.15.156:0/1672901555 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa07009d860 0x7fa07011c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:30.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.248+0000 7fa06ffff700 1 -- 172.21.15.156:0/1672901555 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa07009d860 msgr2=0x7fa07011c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:30.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.248+0000 7fa06ffff700 1 --2- 172.21.15.156:0/1672901555 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa07009d860 0x7fa07011c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.248+0000 7fa06ffff700 1 -- 172.21.15.156:0/1672901555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa070135f20 msgr2=0x7fa07011cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:30.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.249+0000 7fa06ffff700 1 --2- 172.21.15.156:0/1672901555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa070135f20 0x7fa07011cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.249+0000 7fa06ffff700 1 -- 172.21.15.156:0/1672901555 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05c00b740 con 0x7fa07009e340 2023-09-30T22:22:30.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.249+0000 7fa0756bb700 1 --2- 172.21.15.156:0/1672901555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa070135f20 0x7fa07011cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:30.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.249+0000 7fa06ffff700 1 --2- 172.21.15.156:0/1672901555 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa07009e340 0x7fa07011c7c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00bae0 tx=0x7fa05c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:30.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.249+0000 7fa06d7fa700 1 -- 172.21.15.156:0/1672901555 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c01d070 con 0x7fa07009e340 2023-09-30T22:22:30.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.249+0000 7fa06d7fa700 1 -- 172.21.15.156:0/1672901555 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05c01e040 con 0x7fa07009e340 2023-09-30T22:22:30.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.249+0000 7fa07711e700 1 -- 172.21.15.156:0/1672901555 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa07011fac0 con 0x7fa07009e340 2023-09-30T22:22:30.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.249+0000 7fa06d7fa700 1 -- 172.21.15.156:0/1672901555 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c003cb0 con 0x7fa07009e340 2023-09-30T22:22:30.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.249+0000 7fa07711e700 1 -- 172.21.15.156:0/1672901555 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa070120530 con 0x7fa07009e340 2023-09-30T22:22:30.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.250+0000 7fa06d7fa700 1 -- 172.21.15.156:0/1672901555 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa05c023460 con 0x7fa07009e340 2023-09-30T22:22:30.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.250+0000 7fa06d7fa700 1 -- 172.21.15.156:0/1672901555 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa05c043290 con 0x7fa07009e340 2023-09-30T22:22:30.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.250+0000 7fa07711e700 1 -- 172.21.15.156:0/1672901555 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa07011f700 con 0x7fa07009e340 2023-09-30T22:22:30.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.255+0000 7fa06d7fa700 1 -- 172.21.15.156:0/1672901555 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa05c02c410 con 0x7fa07009e340 2023-09-30T22:22:30.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.288+0000 7fee1188e700 1 Processor -- start 2023-09-30T22:22:30.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.288+0000 7fee1188e700 1 -- start start 2023-09-30T22:22:30.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.288+0000 7fee1188e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee0c09e950 0x7fee0c09ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:30.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.288+0000 7fee1188e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fee0c09f260 0x7fee0c137ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:30.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.288+0000 7fee1188e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee0c09ac20 con 0x7fee0c1381e0 2023-09-30T22:22:30.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.288+0000 7fee1188e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c0a06c0 con 0x7fee0c09e950 2023-09-30T22:22:30.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.288+0000 7fee1188e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c09ae90 con 0x7fee0c09f260 2023-09-30T22:22:30.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.289+0000 7fee0affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee0c09e950 0x7fee0c09ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:30.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.289+0000 7fee0affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee0c09e950 0x7fee0c09ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33606/0 (socket says 172.21.15.156:33606) 2023-09-30T22:22:30.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.289+0000 7fee0affd700 1 -- 172.21.15.156:0/2124484132 learned_addr learned my addr 172.21.15.156:0/2124484132 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:30.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.289+0000 7fee0a7fc700 1 --2- 172.21.15.156:0/2124484132 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fee0c09f260 0x7fee0c137ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:30.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.289+0000 7fee0affd700 1 -- 172.21.15.156:0/2124484132 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fee0c09f260 msgr2=0x7fee0c137ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:30.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.289+0000 7fee0affd700 1 --2- 172.21.15.156:0/2124484132 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fee0c09f260 0x7fee0c137ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.289+0000 7fee0affd700 1 -- 172.21.15.156:0/2124484132 >> v1:172.21.15.156:6789/0 conn(0x7fee0c1381e0 legacy=0x7fee0c13a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:30.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.289+0000 7fee0affd700 1 -- 172.21.15.156:0/2124484132 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0c06ba00 con 0x7fee0c09e950 2023-09-30T22:22:30.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.289+0000 7fee0a7fc700 1 --2- 172.21.15.156:0/2124484132 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fee0c09f260 0x7fee0c137ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:30.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.289+0000 7fee0affd700 1 --2- 172.21.15.156:0/2124484132 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee0c09e950 0x7fee0c09ed20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0098f0 tx=0x7fedfc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37fd0b05abc9fe77 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:30.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.289+0000 7fee09ffb700 1 -- 172.21.15.156:0/2124484132 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc005e30 con 0x7fee0c09e950 2023-09-30T22:22:30.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.289+0000 7fee09ffb700 1 -- 172.21.15.156:0/2124484132 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedfc004030 con 0x7fee0c09e950 2023-09-30T22:22:30.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.289+0000 7fee09ffb700 1 -- 172.21.15.156:0/2124484132 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0043e0 con 0x7fee0c09e950 2023-09-30T22:22:30.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.290+0000 7fee1188e700 1 -- 172.21.15.156:0/2124484132 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee0c09e950 msgr2=0x7fee0c09ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:30.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.290+0000 7fee1188e700 1 --2- 172.21.15.156:0/2124484132 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee0c09e950 0x7fee0c09ed20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0098f0 tx=0x7fedfc009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:30.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.290+0000 7fee1188e700 1 -- 172.21.15.156:0/2124484132 shutdown_connections 2023-09-30T22:22:30.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.290+0000 7fee1188e700 1 --2- 172.21.15.156:0/2124484132 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee0c09e950 0x7fee0c09ed20 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.290+0000 7fee1188e700 1 --2- 172.21.15.156:0/2124484132 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fee0c09f260 0x7fee0c137ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.290+0000 7fee1188e700 1 -- 172.21.15.156:0/2124484132 >> 172.21.15.156:0/2124484132 conn(0x7fee0c0a0f70 msgr2=0x7fee0c0a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:30.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.290+0000 7fee1188e700 1 -- 172.21.15.156:0/2124484132 shutdown_connections 2023-09-30T22:22:30.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.290+0000 7fee1188e700 1 -- 172.21.15.156:0/2124484132 wait complete. 2023-09-30T22:22:30.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.291+0000 7fee1188e700 1 Processor -- start 2023-09-30T22:22:30.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.291+0000 7fee1188e700 1 -- start start 2023-09-30T22:22:30.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.292+0000 7fee1188e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee0c09e950 0x7fee0c120690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:30.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.292+0000 7fee1188e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee0c09f260 0x7fee0c120bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:30.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.292+0000 7fee1188e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fee0c1381e0 0x7fee0c1c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:30.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.292+0000 7fee1188e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c121110 con 0x7fee0c09f260 2023-09-30T22:22:30.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.292+0000 7fee1188e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c1238e0 con 0x7fee0c09e950 2023-09-30T22:22:30.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.292+0000 7fee1188e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c120180 con 0x7fee0c1381e0 2023-09-30T22:22:30.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.292+0000 7fee0a7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee0c09f260 0x7fee0c120bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:30.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.292+0000 7fee0a7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee0c09f260 0x7fee0c120bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60090/0 (socket says 172.21.15.156:60090) 2023-09-30T22:22:30.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.292+0000 7fee0a7fc700 1 -- 172.21.15.156:0/2115445462 learned_addr learned my addr 172.21.15.156:0/2115445462 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:30.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.292+0000 7fee0b7fe700 1 --2- 172.21.15.156:0/2115445462 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fee0c1381e0 0x7fee0c1c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:30.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.292+0000 7fee0affd700 1 --2- 172.21.15.156:0/2115445462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee0c09e950 0x7fee0c120690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:30.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.292+0000 7fee0a7fc700 1 -- 172.21.15.156:0/2115445462 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fee0c1381e0 msgr2=0x7fee0c1c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:30.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.292+0000 7fee0a7fc700 1 --2- 172.21.15.156:0/2115445462 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fee0c1381e0 0x7fee0c1c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.292+0000 7fee0a7fc700 1 -- 172.21.15.156:0/2115445462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee0c09e950 msgr2=0x7fee0c120690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:30.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.292+0000 7fee0a7fc700 1 --2- 172.21.15.156:0/2115445462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee0c09e950 0x7fee0c120690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.292+0000 7fee0a7fc700 1 -- 172.21.15.156:0/2115445462 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee000094a0 con 0x7fee0c09f260 2023-09-30T22:22:30.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.293+0000 7fee0b7fe700 1 --2- 172.21.15.156:0/2115445462 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fee0c1381e0 0x7fee0c1c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:30.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.293+0000 7fee0a7fc700 1 --2- 172.21.15.156:0/2115445462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee0c09f260 0x7fee0c120bd0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fee0000ebb0 tx=0x7fee0000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:30.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.293+0000 7fedf3fff700 1 -- 172.21.15.156:0/2115445462 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0000c850 con 0x7fee0c09f260 2023-09-30T22:22:30.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.293+0000 7fedf3fff700 1 -- 172.21.15.156:0/2115445462 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0000c9b0 con 0x7fee0c09f260 2023-09-30T22:22:30.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.293+0000 7fedf3fff700 1 -- 172.21.15.156:0/2115445462 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0000cd40 con 0x7fee0c09f260 2023-09-30T22:22:30.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.293+0000 7fee1188e700 1 -- 172.21.15.156:0/2115445462 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedfc009500 con 0x7fee0c09f260 2023-09-30T22:22:30.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.293+0000 7fee1188e700 1 -- 172.21.15.156:0/2115445462 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee0c0a0820 con 0x7fee0c09f260 2023-09-30T22:22:30.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.294+0000 7fedf3fff700 1 -- 172.21.15.156:0/2115445462 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee00013470 con 0x7fee0c09f260 2023-09-30T22:22:30.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.294+0000 7fedf3fff700 1 -- 172.21.15.156:0/2115445462 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fee0003fc50 con 0x7fee0c09f260 2023-09-30T22:22:30.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.294+0000 7fee1188e700 1 -- 172.21.15.156:0/2115445462 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee0c123720 con 0x7fee0c09f260 2023-09-30T22:22:30.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.299+0000 7fedf3fff700 1 -- 172.21.15.156:0/2115445462 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee0c123720 con 0x7fee0c09f260 2023-09-30T22:22:30.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.319+0000 7f3b5ab60700 1 -- 172.21.15.156:0/2553246995 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3b54126440 con 0x7f3b540a1380 2023-09-30T22:22:30.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.319+0000 7f3b517fa700 1 -- 172.21.15.156:0/2553246995 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3b40021020 con 0x7f3b540a1380 2023-09-30T22:22:30.320 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:30.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.321+0000 7f3b5ab60700 1 -- 172.21.15.156:0/2553246995 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3b540a1380 msgr2=0x7f3b54122da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:30.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.321+0000 7f3b5ab60700 1 --2- 172.21.15.156:0/2553246995 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3b540a1380 0x7f3b54122da0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3b4000ec10 tx=0x7f3b4000ef20 comp rx=0 tx=0).stop 2023-09-30T22:22:30.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.322+0000 7f3b5ab60700 1 -- 172.21.15.156:0/2553246995 shutdown_connections 2023-09-30T22:22:30.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.322+0000 7f3b5ab60700 1 --2- 172.21.15.156:0/2553246995 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b54133f50 0x7f3b541232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.322+0000 7f3b5ab60700 1 --2- 172.21.15.156:0/2553246995 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3b540a0a70 0x7f3b54122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.322+0000 7f3b5ab60700 1 --2- 172.21.15.156:0/2553246995 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3b540a1380 0x7f3b54122da0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.322+0000 7f3b5ab60700 1 -- 172.21.15.156:0/2553246995 >> 172.21.15.156:0/2553246995 conn(0x7f3b540a6610 msgr2=0x7f3b5409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:30.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.322+0000 7f3b5ab60700 1 -- 172.21.15.156:0/2553246995 shutdown_connections 2023-09-30T22:22:30.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.322+0000 7f3b5ab60700 1 -- 172.21.15.156:0/2553246995 wait complete. 2023-09-30T22:22:30.335 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:30.441 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:30.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.449+0000 7fa07711e700 1 -- 172.21.15.156:0/1672901555 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa07011f0e0 con 0x7fa07009e340 2023-09-30T22:22:30.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.450+0000 7fa06d7fa700 1 -- 172.21.15.156:0/1672901555 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa05c0223c0 con 0x7fa07009e340 2023-09-30T22:22:30.451 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:30.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.452+0000 7fa07711e700 1 -- 172.21.15.156:0/1672901555 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa07009e340 msgr2=0x7fa07011c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:30.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.452+0000 7fa07711e700 1 --2- 172.21.15.156:0/1672901555 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa07009e340 0x7fa07011c7c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00bae0 tx=0x7fa05c004750 comp rx=0 tx=0).stop 2023-09-30T22:22:30.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.452+0000 7fa07711e700 1 -- 172.21.15.156:0/1672901555 shutdown_connections 2023-09-30T22:22:30.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.452+0000 7fa07711e700 1 --2- 172.21.15.156:0/1672901555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa070135f20 0x7fa07011cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.452+0000 7fa07711e700 1 --2- 172.21.15.156:0/1672901555 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa07009d860 0x7fa07011c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.452+0000 7fa07711e700 1 --2- 172.21.15.156:0/1672901555 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa07009e340 0x7fa07011c7c0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.452+0000 7fa07711e700 1 -- 172.21.15.156:0/1672901555 >> 172.21.15.156:0/1672901555 conn(0x7fa070099c40 msgr2=0x7fa0700a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:30.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.452+0000 7fa07711e700 1 -- 172.21.15.156:0/1672901555 shutdown_connections 2023-09-30T22:22:30.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.452+0000 7fa07711e700 1 -- 172.21.15.156:0/1672901555 wait complete. 2023-09-30T22:22:30.466 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:30.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.493+0000 7fee1188e700 1 -- 172.21.15.156:0/2115445462 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fee0c123720 con 0x7fee0c09f260 2023-09-30T22:22:30.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.494+0000 7fedf3fff700 1 -- 172.21.15.156:0/2115445462 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fee0c123720 con 0x7fee0c09f260 2023-09-30T22:22:30.494 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:30.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.496+0000 7fee1188e700 1 -- 172.21.15.156:0/2115445462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee0c09f260 msgr2=0x7fee0c120bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:30.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.496+0000 7fee1188e700 1 --2- 172.21.15.156:0/2115445462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee0c09f260 0x7fee0c120bd0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fee0000ebb0 tx=0x7fee0000eec0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.496+0000 7fee1188e700 1 -- 172.21.15.156:0/2115445462 shutdown_connections 2023-09-30T22:22:30.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.496+0000 7fee1188e700 1 --2- 172.21.15.156:0/2115445462 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fee0c1381e0 0x7fee0c1c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.496+0000 7fee1188e700 1 --2- 172.21.15.156:0/2115445462 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fee0c09e950 0x7fee0c120690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.496+0000 7fee1188e700 1 --2- 172.21.15.156:0/2115445462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee0c09f260 0x7fee0c120bd0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.496+0000 7fee1188e700 1 -- 172.21.15.156:0/2115445462 >> 172.21.15.156:0/2115445462 conn(0x7fee0c0a0f70 msgr2=0x7fee0c136e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:30.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.496+0000 7fee1188e700 1 -- 172.21.15.156:0/2115445462 shutdown_connections 2023-09-30T22:22:30.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.496+0000 7fee1188e700 1 -- 172.21.15.156:0/2115445462 wait complete. 2023-09-30T22:22:30.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:30.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.567+0000 7f8396bef700 1 Processor -- start 2023-09-30T22:22:30.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.568+0000 7f8396bef700 1 -- start start 2023-09-30T22:22:30.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.568+0000 7f8396bef700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8390133ad0 0x7f8390133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:30.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.568+0000 7f8396bef700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83901300a0 0x7f83901304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:30.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.568+0000 7f8396bef700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f83901309f0 0x7f839013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:30.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.568+0000 7f8396bef700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f839006b2d0 con 0x7f83901309f0 2023-09-30T22:22:30.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.568+0000 7f8396bef700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8390133610 con 0x7f83901300a0 2023-09-30T22:22:30.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.568+0000 7f8396bef700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f839009a500 con 0x7f8390133ad0 2023-09-30T22:22:30.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.568+0000 7f839518c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f83901309f0 0x7f839013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:30.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.568+0000 7f839498b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8390133ad0 0x7f8390133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:30.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.568+0000 7f838ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83901300a0 0x7f83901304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:30.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.568+0000 7f839518c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f83901309f0 0x7f839013a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60106/0 (socket says 172.21.15.156:60106) 2023-09-30T22:22:30.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.568+0000 7f839498b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8390133ad0 0x7f8390133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51588/0 (socket says 172.21.15.156:51588) 2023-09-30T22:22:30.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.568+0000 7f839518c700 1 -- 172.21.15.156:0/3892410493 learned_addr learned my addr 172.21.15.156:0/3892410493 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:30.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.568+0000 7f838ffff700 1 -- 172.21.15.156:0/3892410493 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8390133ad0 msgr2=0x7f8390133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:30.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.568+0000 7f838ffff700 1 --2- 172.21.15.156:0/3892410493 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8390133ad0 0x7f8390133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.568+0000 7f838ffff700 1 -- 172.21.15.156:0/3892410493 >> v2:172.21.15.156:3300/0 conn(0x7f83901309f0 msgr2=0x7f839013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:30.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.568+0000 7f838ffff700 1 --2- 172.21.15.156:0/3892410493 >> v2:172.21.15.156:3300/0 conn(0x7f83901309f0 0x7f839013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.568+0000 7f838ffff700 1 -- 172.21.15.156:0/3892410493 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83901338b0 con 0x7f83901300a0 2023-09-30T22:22:30.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.568+0000 7f839518c700 1 --2- 172.21.15.156:0/3892410493 >> v2:172.21.15.156:3300/0 conn(0x7f83901309f0 0x7f839013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:30.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.569+0000 7f838ffff700 1 --2- 172.21.15.156:0/3892410493 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83901300a0 0x7f83901304b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f837c009840 tx=0x7f837c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3705eee9f12e5d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:30.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.569+0000 7f838f7fe700 1 -- 172.21.15.156:0/3892410493 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c011830 con 0x7f83901300a0 2023-09-30T22:22:30.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.569+0000 7f838f7fe700 1 -- 172.21.15.156:0/3892410493 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c011990 con 0x7f83901300a0 2023-09-30T22:22:30.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.569+0000 7f838f7fe700 1 -- 172.21.15.156:0/3892410493 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c011d20 con 0x7f83901300a0 2023-09-30T22:22:30.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.569+0000 7f8396bef700 1 -- 172.21.15.156:0/3892410493 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83901300a0 msgr2=0x7f83901304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:30.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.569+0000 7f8396bef700 1 --2- 172.21.15.156:0/3892410493 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83901300a0 0x7f83901304b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f837c009840 tx=0x7f837c009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:30.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.569+0000 7f8396bef700 1 -- 172.21.15.156:0/3892410493 shutdown_connections 2023-09-30T22:22:30.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.569+0000 7f8396bef700 1 --2- 172.21.15.156:0/3892410493 >> v2:172.21.15.156:3300/0 conn(0x7f83901309f0 0x7f839013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.569+0000 7f8396bef700 1 --2- 172.21.15.156:0/3892410493 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8390133ad0 0x7f8390133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.569+0000 7f8396bef700 1 --2- 172.21.15.156:0/3892410493 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83901300a0 0x7f83901304b0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.569+0000 7f8396bef700 1 -- 172.21.15.156:0/3892410493 >> 172.21.15.156:0/3892410493 conn(0x7f8390099c40 msgr2=0x7f83900a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:30.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.569+0000 7f8396bef700 1 -- 172.21.15.156:0/3892410493 shutdown_connections 2023-09-30T22:22:30.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.569+0000 7f8396bef700 1 -- 172.21.15.156:0/3892410493 wait complete. 2023-09-30T22:22:30.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.570+0000 7f8396bef700 1 Processor -- start 2023-09-30T22:22:30.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.570+0000 7f8396bef700 1 -- start start 2023-09-30T22:22:30.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.571+0000 7f8396bef700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83901300a0 0x7f83901c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:30.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.571+0000 7f8396bef700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83901309f0 0x7f83901c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:30.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.571+0000 7f8396bef700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8390133ad0 0x7f83901c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:30.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.571+0000 7f8396bef700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839011fe90 con 0x7f83901300a0 2023-09-30T22:22:30.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.571+0000 7f8396bef700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8390120170 con 0x7f83901309f0 2023-09-30T22:22:30.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.571+0000 7f8396bef700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f839012fd70 con 0x7f8390133ad0 2023-09-30T22:22:30.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.571+0000 7f839498b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83901300a0 0x7f83901c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:30.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.571+0000 7f838ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83901309f0 0x7f83901c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:30.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.571+0000 7f839498b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83901300a0 0x7f83901c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60116/0 (socket says 172.21.15.156:60116) 2023-09-30T22:22:30.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.571+0000 7f839498b700 1 -- 172.21.15.156:0/3556601953 learned_addr learned my addr 172.21.15.156:0/3556601953 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:30.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.571+0000 7f839518c700 1 --2- 172.21.15.156:0/3556601953 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8390133ad0 0x7f83901c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:30.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.571+0000 7f839498b700 1 -- 172.21.15.156:0/3556601953 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8390133ad0 msgr2=0x7f83901c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:30.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.571+0000 7f839498b700 1 --2- 172.21.15.156:0/3556601953 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8390133ad0 0x7f83901c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.571+0000 7f839498b700 1 -- 172.21.15.156:0/3556601953 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83901309f0 msgr2=0x7f83901c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:30.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.571+0000 7f839498b700 1 --2- 172.21.15.156:0/3556601953 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83901309f0 0x7f83901c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.571+0000 7f839498b700 1 -- 172.21.15.156:0/3556601953 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8388009b30 con 0x7f83901300a0 2023-09-30T22:22:30.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.571+0000 7f838ffff700 1 --2- 172.21.15.156:0/3556601953 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83901309f0 0x7f83901c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:30.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.571+0000 7f839498b700 1 --2- 172.21.15.156:0/3556601953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83901300a0 0x7f83901c8750 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f838400e9b0 tx=0x7f838400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:30.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.572+0000 7f838d7fa700 1 -- 172.21.15.156:0/3556601953 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8384009710 con 0x7f83901300a0 2023-09-30T22:22:30.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.572+0000 7f838d7fa700 1 -- 172.21.15.156:0/3556601953 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838400ee50 con 0x7f83901300a0 2023-09-30T22:22:30.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.572+0000 7f8396bef700 1 -- 172.21.15.156:0/3556601953 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837c0094a0 con 0x7f83901300a0 2023-09-30T22:22:30.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.572+0000 7f838d7fa700 1 -- 172.21.15.156:0/3556601953 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838400ca50 con 0x7f83901300a0 2023-09-30T22:22:30.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.572+0000 7f8396bef700 1 -- 172.21.15.156:0/3556601953 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f839011f4b0 con 0x7f83901300a0 2023-09-30T22:22:30.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.572+0000 7f838d7fa700 1 -- 172.21.15.156:0/3556601953 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f838400cbb0 con 0x7f83901300a0 2023-09-30T22:22:30.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.573+0000 7f838d7fa700 1 -- 172.21.15.156:0/3556601953 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f838403fa90 con 0x7f83901300a0 2023-09-30T22:22:30.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.573+0000 7f8396bef700 1 -- 172.21.15.156:0/3556601953 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f839004f2a0 con 0x7f83901300a0 2023-09-30T22:22:30.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.577+0000 7f838d7fa700 1 -- 172.21.15.156:0/3556601953 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f838401b3b0 con 0x7f83901300a0 2023-09-30T22:22:30.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.761+0000 7f8396bef700 1 -- 172.21.15.156:0/3556601953 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f839011fc10 con 0x7f83901300a0 2023-09-30T22:22:30.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.762+0000 7f838d7fa700 1 -- 172.21.15.156:0/3556601953 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8384017020 con 0x7f83901300a0 2023-09-30T22:22:30.763 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:30.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.764+0000 7f8396bef700 1 -- 172.21.15.156:0/3556601953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83901300a0 msgr2=0x7f83901c8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:30.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.764+0000 7f8396bef700 1 --2- 172.21.15.156:0/3556601953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83901300a0 0x7f83901c8750 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f838400e9b0 tx=0x7f838400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.764+0000 7f8396bef700 1 -- 172.21.15.156:0/3556601953 shutdown_connections 2023-09-30T22:22:30.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.764+0000 7f8396bef700 1 --2- 172.21.15.156:0/3556601953 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8390133ad0 0x7f83901c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.764+0000 7f8396bef700 1 --2- 172.21.15.156:0/3556601953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83901300a0 0x7f83901c8750 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.764+0000 7f8396bef700 1 --2- 172.21.15.156:0/3556601953 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83901309f0 0x7f83901c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.764+0000 7f8396bef700 1 -- 172.21.15.156:0/3556601953 >> 172.21.15.156:0/3556601953 conn(0x7f8390099c40 msgr2=0x7f83900a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:30.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.764+0000 7f8396bef700 1 -- 172.21.15.156:0/3556601953 shutdown_connections 2023-09-30T22:22:30.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:30.764+0000 7f8396bef700 1 -- 172.21.15.156:0/3556601953 wait complete. 2023-09-30T22:22:30.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:31.336 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:31.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.459+0000 7f078f4aa700 1 Processor -- start 2023-09-30T22:22:31.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.460+0000 7f078f4aa700 1 -- start start 2023-09-30T22:22:31.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.460+0000 7f078f4aa700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f078809e340 0x7f07881359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.460+0000 7f078f4aa700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0788135f20 0x7f0788138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.460+0000 7f078f4aa700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078809aaa0 con 0x7f078809d860 2023-09-30T22:22:31.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.460+0000 7f078f4aa700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078809e730 con 0x7f0788135f20 2023-09-30T22:22:31.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.460+0000 7f078f4aa700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f078809f870 con 0x7f078809e340 2023-09-30T22:22:31.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.460+0000 7f078ca45700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f078809e340 0x7f07881359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.460+0000 7f078d246700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f078809d860 0x7f078809dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48636/0 (socket says 172.21.15.156:48636) 2023-09-30T22:22:31.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.460+0000 7f078ca45700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f078809e340 0x7f07881359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55674/0 (socket says 172.21.15.156:55674) 2023-09-30T22:22:31.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.460+0000 7f078d246700 1 -- 172.21.15.156:0/1378547229 learned_addr learned my addr 172.21.15.156:0/1378547229 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:31.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.460+0000 7f078da47700 1 --2- 172.21.15.156:0/1378547229 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0788135f20 0x7f0788138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.460+0000 7f078ca45700 1 -- 172.21.15.156:0/1378547229 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0788135f20 msgr2=0x7f0788138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:31.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.460+0000 7f077ffff700 1 -- 172.21.15.156:0/1378547229 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3706056493 0 0) 0x7f078809aaa0 con 0x7f078809d860 2023-09-30T22:22:31.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.461+0000 7f078ca45700 1 --2- 172.21.15.156:0/1378547229 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0788135f20 0x7f0788138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.461+0000 7f078ca45700 1 -- 172.21.15.156:0/1378547229 >> v1:172.21.15.156:6789/0 conn(0x7f078809d860 legacy=0x7f078809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.461+0000 7f078ca45700 1 -- 172.21.15.156:0/1378547229 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078809b360 con 0x7f078809e340 2023-09-30T22:22:31.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.461+0000 7f078da47700 1 --2- 172.21.15.156:0/1378547229 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0788135f20 0x7f0788138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:31.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.461+0000 7f078ca45700 1 --2- 172.21.15.156:0/1378547229 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f078809e340 0x7f07881359e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f07840098a0 tx=0x7f0784009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85bd72bb1a7b2fc8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:31.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.461+0000 7f077ffff700 1 -- 172.21.15.156:0/1378547229 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0784011830 con 0x7f078809e340 2023-09-30T22:22:31.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.461+0000 7f077ffff700 1 -- 172.21.15.156:0/1378547229 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0784011990 con 0x7f078809e340 2023-09-30T22:22:31.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.461+0000 7f077ffff700 1 -- 172.21.15.156:0/1378547229 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0784011d20 con 0x7f078809e340 2023-09-30T22:22:31.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.461+0000 7f078f4aa700 1 -- 172.21.15.156:0/1378547229 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f078809e340 msgr2=0x7f07881359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.461+0000 7f078f4aa700 1 --2- 172.21.15.156:0/1378547229 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f078809e340 0x7f07881359e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f07840098a0 tx=0x7f0784009bb0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.461+0000 7f078f4aa700 1 -- 172.21.15.156:0/1378547229 shutdown_connections 2023-09-30T22:22:31.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.461+0000 7f078f4aa700 1 --2- 172.21.15.156:0/1378547229 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0788135f20 0x7f0788138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.461+0000 7f078f4aa700 1 --2- 172.21.15.156:0/1378547229 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f078809e340 0x7f07881359e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.461+0000 7f078f4aa700 1 -- 172.21.15.156:0/1378547229 >> 172.21.15.156:0/1378547229 conn(0x7f0788099c40 msgr2=0x7f07880a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:31.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.462+0000 7f078f4aa700 1 -- 172.21.15.156:0/1378547229 shutdown_connections 2023-09-30T22:22:31.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.462+0000 7f078f4aa700 1 -- 172.21.15.156:0/1378547229 wait complete. 2023-09-30T22:22:31.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.462+0000 7f078f4aa700 1 Processor -- start 2023-09-30T22:22:31.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.462+0000 7f078f4aa700 1 -- start start 2023-09-30T22:22:31.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.463+0000 7f078f4aa700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f078809d860 0x7f07881c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.463+0000 7f078f4aa700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f078809e340 0x7f07881c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.463+0000 7f078f4aa700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0788135f20 0x7f07881c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.463+0000 7f078f4aa700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078811d5c0 con 0x7f078809e340 2023-09-30T22:22:31.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.463+0000 7f078f4aa700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078811eae0 con 0x7f078809d860 2023-09-30T22:22:31.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.463+0000 7f078f4aa700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f078809c8b0 con 0x7f0788135f20 2023-09-30T22:22:31.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.463+0000 7f078ca45700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f078809e340 0x7f07881c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.463+0000 7f078da47700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0788135f20 0x7f07881c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.463+0000 7f078ca45700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f078809e340 0x7f07881c5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36478/0 (socket says 172.21.15.156:36478) 2023-09-30T22:22:31.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.463+0000 7f078ca45700 1 -- 172.21.15.156:0/2854365170 learned_addr learned my addr 172.21.15.156:0/2854365170 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:31.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.463+0000 7f078d246700 1 --2- 172.21.15.156:0/2854365170 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f078809d860 0x7f07881c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.463+0000 7f078ca45700 1 -- 172.21.15.156:0/2854365170 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0788135f20 msgr2=0x7f07881c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.463+0000 7f078ca45700 1 --2- 172.21.15.156:0/2854365170 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0788135f20 0x7f07881c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.463+0000 7f078ca45700 1 -- 172.21.15.156:0/2854365170 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f078809d860 msgr2=0x7f07881c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.463+0000 7f078ca45700 1 --2- 172.21.15.156:0/2854365170 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f078809d860 0x7f07881c5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.463+0000 7f078ca45700 1 -- 172.21.15.156:0/2854365170 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0780009a70 con 0x7f078809e340 2023-09-30T22:22:31.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.463+0000 7f078da47700 1 --2- 172.21.15.156:0/2854365170 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0788135f20 0x7f07881c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:31.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.463+0000 7f078d246700 1 --2- 172.21.15.156:0/2854365170 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f078809d860 0x7f07881c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:31.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.463+0000 7f078ca45700 1 --2- 172.21.15.156:0/2854365170 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f078809e340 0x7f07881c5750 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f0784000c00 tx=0x7f0784004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:31.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.463+0000 7f077dffb700 1 -- 172.21.15.156:0/2854365170 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0784004550 con 0x7f078809e340 2023-09-30T22:22:31.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.464+0000 7f077dffb700 1 -- 172.21.15.156:0/2854365170 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07840036a0 con 0x7f078809e340 2023-09-30T22:22:31.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.464+0000 7f077dffb700 1 -- 172.21.15.156:0/2854365170 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0784003a50 con 0x7f078809e340 2023-09-30T22:22:31.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.464+0000 7f078f4aa700 1 -- 172.21.15.156:0/2854365170 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07840094a0 con 0x7f078809e340 2023-09-30T22:22:31.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.464+0000 7f078f4aa700 1 -- 172.21.15.156:0/2854365170 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f078811e0b0 con 0x7f078809e340 2023-09-30T22:22:31.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.464+0000 7f077dffb700 1 -- 172.21.15.156:0/2854365170 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0784003bb0 con 0x7f078809e340 2023-09-30T22:22:31.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.465+0000 7f077dffb700 1 -- 172.21.15.156:0/2854365170 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f07840420a0 con 0x7f078809e340 2023-09-30T22:22:31.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.465+0000 7f078f4aa700 1 -- 172.21.15.156:0/2854365170 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f078804f2a0 con 0x7f078809e340 2023-09-30T22:22:31.471 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:31.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.469+0000 7f077dffb700 1 -- 172.21.15.156:0/2854365170 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0784029020 con 0x7f078809e340 2023-09-30T22:22:31.510 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:31.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.596+0000 7f872163e700 1 Processor -- start 2023-09-30T22:22:31.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.596+0000 7f872163e700 1 -- start start 2023-09-30T22:22:31.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.597+0000 7f872163e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f871c09e870 0x7f871c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.597+0000 7f872163e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f871c09f180 0x7f871c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.597+0000 7f872163e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f871c131d70 0x7f871c132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.597+0000 7f872163e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f871c0a0920 con 0x7f871c09f180 2023-09-30T22:22:31.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.597+0000 7f872163e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871c09c970 con 0x7f871c131d70 2023-09-30T22:22:31.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.597+0000 7f872163e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f871c09bab0 con 0x7f871c09e870 2023-09-30T22:22:31.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.597+0000 7f871affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f871c09e870 0x7f871c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.597+0000 7f871affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f871c09e870 0x7f871c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55686/0 (socket says 172.21.15.156:55686) 2023-09-30T22:22:31.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.597+0000 7f871affd700 1 -- 172.21.15.156:0/1461620528 learned_addr learned my addr 172.21.15.156:0/1461620528 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:31.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.597+0000 7f871a7fc700 1 --2- 172.21.15.156:0/1461620528 >> v2:172.21.15.156:3300/0 conn(0x7f871c09f180 0x7f871c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.597+0000 7f871b7fe700 1 --2- 172.21.15.156:0/1461620528 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f871c131d70 0x7f871c132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.597+0000 7f871a7fc700 1 -- 172.21.15.156:0/1461620528 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f871c09e870 msgr2=0x7f871c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:31.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.597+0000 7f871a7fc700 1 --2- 172.21.15.156:0/1461620528 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f871c09e870 0x7f871c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.597+0000 7f871a7fc700 1 -- 172.21.15.156:0/1461620528 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f871c131d70 msgr2=0x7f871c132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:31.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.597+0000 7f871a7fc700 1 --2- 172.21.15.156:0/1461620528 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f871c131d70 0x7f871c132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.597+0000 7f871a7fc700 1 -- 172.21.15.156:0/1461620528 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871c09f9c0 con 0x7f871c09f180 2023-09-30T22:22:31.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.597+0000 7f871b7fe700 1 --2- 172.21.15.156:0/1461620528 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f871c131d70 0x7f871c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:31.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.597+0000 7f871affd700 1 --2- 172.21.15.156:0/1461620528 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f871c09e870 0x7f871c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:31.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.598+0000 7f871a7fc700 1 --2- 172.21.15.156:0/1461620528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f871c09f180 0x7f871c131830 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f8710009870 tx=0x7f8710009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9df634d0a9bc15 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:31.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.598+0000 7f8719ffb700 1 -- 172.21.15.156:0/1461620528 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710011830 con 0x7f871c09f180 2023-09-30T22:22:31.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.598+0000 7f8719ffb700 1 -- 172.21.15.156:0/1461620528 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8710011990 con 0x7f871c09f180 2023-09-30T22:22:31.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.598+0000 7f8719ffb700 1 -- 172.21.15.156:0/1461620528 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710011d20 con 0x7f871c09f180 2023-09-30T22:22:31.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.598+0000 7f872163e700 1 -- 172.21.15.156:0/1461620528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f871c09f180 msgr2=0x7f871c131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.598+0000 7f872163e700 1 --2- 172.21.15.156:0/1461620528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f871c09f180 0x7f871c131830 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f8710009870 tx=0x7f8710009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:31.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.598+0000 7f872163e700 1 -- 172.21.15.156:0/1461620528 shutdown_connections 2023-09-30T22:22:31.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.598+0000 7f872163e700 1 --2- 172.21.15.156:0/1461620528 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f871c131d70 0x7f871c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.598+0000 7f872163e700 1 --2- 172.21.15.156:0/1461620528 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f871c09e870 0x7f871c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.598+0000 7f872163e700 1 --2- 172.21.15.156:0/1461620528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f871c09f180 0x7f871c131830 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.598+0000 7f872163e700 1 -- 172.21.15.156:0/1461620528 >> 172.21.15.156:0/1461620528 conn(0x7f871c0a4430 msgr2=0x7f871c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:31.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.599+0000 7f872163e700 1 -- 172.21.15.156:0/1461620528 shutdown_connections 2023-09-30T22:22:31.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.599+0000 7f872163e700 1 -- 172.21.15.156:0/1461620528 wait complete. 2023-09-30T22:22:31.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.600+0000 7f872163e700 1 Processor -- start 2023-09-30T22:22:31.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.600+0000 7f872163e700 1 -- start start 2023-09-30T22:22:31.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.600+0000 7f872163e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f871c09e870 0x7f871c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.600+0000 7f872163e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f871c09f180 0x7f871c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.600+0000 7f872163e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f871c131d70 0x7f871c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.600+0000 7f872163e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c124d70 con 0x7f871c09f180 2023-09-30T22:22:31.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.600+0000 7f872163e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871c125db0 con 0x7f871c131d70 2023-09-30T22:22:31.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.600+0000 7f872163e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f871c0a0280 con 0x7f871c09e870 2023-09-30T22:22:31.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.600+0000 7f871affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f871c09e870 0x7f871c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.600+0000 7f871b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f871c131d70 0x7f871c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.600+0000 7f871affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f871c09e870 0x7f871c06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55688/0 (socket says 172.21.15.156:55688) 2023-09-30T22:22:31.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.600+0000 7f871b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f871c131d70 0x7f871c06c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33094/0 (socket says 172.21.15.156:33094) 2023-09-30T22:22:31.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.600+0000 7f871affd700 1 -- 172.21.15.156:0/1448812821 learned_addr learned my addr 172.21.15.156:0/1448812821 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:31.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.600+0000 7f871a7fc700 1 --2- 172.21.15.156:0/1448812821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f871c09f180 0x7f871c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.601+0000 7f871affd700 1 -- 172.21.15.156:0/1448812821 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f871c131d70 msgr2=0x7f871c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.601+0000 7f871affd700 1 --2- 172.21.15.156:0/1448812821 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f871c131d70 0x7f871c06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.601+0000 7f871affd700 1 -- 172.21.15.156:0/1448812821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f871c09f180 msgr2=0x7f871c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.601+0000 7f871affd700 1 --2- 172.21.15.156:0/1448812821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f871c09f180 0x7f871c06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.601+0000 7f871affd700 1 -- 172.21.15.156:0/1448812821 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c009550 con 0x7f871c09e870 2023-09-30T22:22:31.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.601+0000 7f871affd700 1 --2- 172.21.15.156:0/1448812821 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f871c09e870 0x7f871c06b8b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f870c00ebe0 tx=0x7f870c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:31.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.604+0000 7f87037fe700 1 -- 172.21.15.156:0/1448812821 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c004030 con 0x7f871c09e870 2023-09-30T22:22:31.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.604+0000 7f87037fe700 1 -- 172.21.15.156:0/1448812821 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870c004190 con 0x7f871c09e870 2023-09-30T22:22:31.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.604+0000 7f872163e700 1 -- 172.21.15.156:0/1448812821 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87100094a0 con 0x7f871c09e870 2023-09-30T22:22:31.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.604+0000 7f87037fe700 1 -- 172.21.15.156:0/1448812821 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c004520 con 0x7f871c09e870 2023-09-30T22:22:31.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.604+0000 7f872163e700 1 -- 172.21.15.156:0/1448812821 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871c125540 con 0x7f871c09e870 2023-09-30T22:22:31.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.605+0000 7f872163e700 1 -- 172.21.15.156:0/1448812821 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871c11d580 con 0x7f871c09e870 2023-09-30T22:22:31.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.605+0000 7f87037fe700 1 -- 172.21.15.156:0/1448812821 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f870c00c850 con 0x7f871c09e870 2023-09-30T22:22:31.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.605+0000 7f87037fe700 1 -- 172.21.15.156:0/1448812821 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f870c013e30 con 0x7f871c09e870 2023-09-30T22:22:31.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.613+0000 7f87037fe700 1 -- 172.21.15.156:0/1448812821 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f870c0036a0 con 0x7f871c09e870 2023-09-30T22:22:31.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.644+0000 7ff15c6bb700 1 Processor -- start 2023-09-30T22:22:31.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.644+0000 7ff15c6bb700 1 -- start start 2023-09-30T22:22:31.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.644+0000 7ff15c6bb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1540a1550 0x7ff154138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.644+0000 7ff15c6bb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff154139200 0x7ff15413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.644+0000 7ff15c6bb700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff15409e9d0 con 0x7ff1540a0a70 2023-09-30T22:22:31.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.644+0000 7ff15c6bb700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff15409dc00 con 0x7ff154139200 2023-09-30T22:22:31.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.644+0000 7ff15c6bb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff15409dec0 con 0x7ff1540a1550 2023-09-30T22:22:31.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.645+0000 7ff15ac58700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff154139200 0x7ff15413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.645+0000 7ff159c56700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1540a1550 0x7ff154138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.645+0000 7ff15a457700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff1540a0a70 0x7ff1540a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48644/0 (socket says 172.21.15.156:48644) 2023-09-30T22:22:31.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.645+0000 7ff159c56700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1540a1550 0x7ff154138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33102/0 (socket says 172.21.15.156:33102) 2023-09-30T22:22:31.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.645+0000 7ff15ac58700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff154139200 0x7ff15413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36496/0 (socket says 172.21.15.156:36496) 2023-09-30T22:22:31.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.645+0000 7ff15a457700 1 -- 172.21.15.156:0/3822771726 learned_addr learned my addr 172.21.15.156:0/3822771726 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:31.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.645+0000 7ff15ac58700 1 -- 172.21.15.156:0/3822771726 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1540a1550 msgr2=0x7ff154138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:31.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.645+0000 7ff15ac58700 1 --2- 172.21.15.156:0/3822771726 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1540a1550 0x7ff154138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.645+0000 7ff15ac58700 1 -- 172.21.15.156:0/3822771726 >> v1:172.21.15.156:6789/0 conn(0x7ff1540a0a70 legacy=0x7ff1540a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.645+0000 7ff15ac58700 1 -- 172.21.15.156:0/3822771726 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff15409e6a0 con 0x7ff154139200 2023-09-30T22:22:31.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.645+0000 7ff159455700 1 -- 172.21.15.156:0/3822771726 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 808672422 0 0) 0x7ff15409e9d0 con 0x7ff1540a0a70 2023-09-30T22:22:31.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.645+0000 7ff159c56700 1 --2- 172.21.15.156:0/3822771726 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1540a1550 0x7ff154138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:31.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.645+0000 7ff15ac58700 1 --2- 172.21.15.156:0/3822771726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff154139200 0x7ff15413b5e0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ff14c009d90 tx=0x7ff14c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c4121a45f0d4276 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:31.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.645+0000 7ff159455700 1 -- 172.21.15.156:0/3822771726 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c00e070 con 0x7ff154139200 2023-09-30T22:22:31.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.645+0000 7ff159455700 1 -- 172.21.15.156:0/3822771726 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c00bb20 con 0x7ff154139200 2023-09-30T22:22:31.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.645+0000 7ff159455700 1 -- 172.21.15.156:0/3822771726 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c012430 con 0x7ff154139200 2023-09-30T22:22:31.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.646+0000 7ff15c6bb700 1 -- 172.21.15.156:0/3822771726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff154139200 msgr2=0x7ff15413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.646+0000 7ff15c6bb700 1 --2- 172.21.15.156:0/3822771726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff154139200 0x7ff15413b5e0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ff14c009d90 tx=0x7ff14c00b330 comp rx=0 tx=0).stop 2023-09-30T22:22:31.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.646+0000 7ff15c6bb700 1 -- 172.21.15.156:0/3822771726 shutdown_connections 2023-09-30T22:22:31.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.646+0000 7ff15c6bb700 1 --2- 172.21.15.156:0/3822771726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff154139200 0x7ff15413b5e0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.646+0000 7ff15c6bb700 1 --2- 172.21.15.156:0/3822771726 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1540a1550 0x7ff154138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.646+0000 7ff15c6bb700 1 -- 172.21.15.156:0/3822771726 >> 172.21.15.156:0/3822771726 conn(0x7ff1540a6610 msgr2=0x7ff1540a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:31.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.646+0000 7ff15c6bb700 1 -- 172.21.15.156:0/3822771726 shutdown_connections 2023-09-30T22:22:31.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.646+0000 7ff15c6bb700 1 -- 172.21.15.156:0/3822771726 wait complete. 2023-09-30T22:22:31.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.647+0000 7ff15c6bb700 1 Processor -- start 2023-09-30T22:22:31.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.647+0000 7ff15c6bb700 1 -- start start 2023-09-30T22:22:31.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.648+0000 7ff15c6bb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1540a0a70 0x7ff154120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.648+0000 7ff15c6bb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1540a1550 0x7ff154120b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.648+0000 7ff15c6bb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff154139200 0x7ff1541210a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.648+0000 7ff15c6bb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff154124140 con 0x7ff1540a1550 2023-09-30T22:22:31.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.648+0000 7ff15c6bb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff154122850 con 0x7ff1540a0a70 2023-09-30T22:22:31.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.648+0000 7ff15c6bb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1540a03e0 con 0x7ff154139200 2023-09-30T22:22:31.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.648+0000 7ff15a457700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1540a0a70 0x7ff154120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.648+0000 7ff15a457700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1540a0a70 0x7ff154120620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33108/0 (socket says 172.21.15.156:33108) 2023-09-30T22:22:31.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.648+0000 7ff15ac58700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff154139200 0x7ff1541210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.648+0000 7ff15a457700 1 -- 172.21.15.156:0/4236007834 learned_addr learned my addr 172.21.15.156:0/4236007834 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:31.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.648+0000 7ff159c56700 1 --2- 172.21.15.156:0/4236007834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1540a1550 0x7ff154120b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.648+0000 7ff15ac58700 1 -- 172.21.15.156:0/4236007834 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1540a0a70 msgr2=0x7ff154120620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.648+0000 7ff15ac58700 1 --2- 172.21.15.156:0/4236007834 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1540a0a70 0x7ff154120620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.648+0000 7ff15ac58700 1 -- 172.21.15.156:0/4236007834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1540a1550 msgr2=0x7ff154120b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.648+0000 7ff15ac58700 1 --2- 172.21.15.156:0/4236007834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1540a1550 0x7ff154120b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.648+0000 7ff15ac58700 1 -- 172.21.15.156:0/4236007834 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1440094a0 con 0x7ff154139200 2023-09-30T22:22:31.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.648+0000 7ff15ac58700 1 --2- 172.21.15.156:0/4236007834 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff154139200 0x7ff1541210a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff14c016000 tx=0x7ff14c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:31.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.649+0000 7ff14affd700 1 -- 172.21.15.156:0/4236007834 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c01b810 con 0x7ff154139200 2023-09-30T22:22:31.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.649+0000 7ff14affd700 1 -- 172.21.15.156:0/4236007834 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c020070 con 0x7ff154139200 2023-09-30T22:22:31.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.649+0000 7ff14affd700 1 -- 172.21.15.156:0/4236007834 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c01bb90 con 0x7ff154139200 2023-09-30T22:22:31.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.649+0000 7ff15c6bb700 1 -- 172.21.15.156:0/4236007834 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14c009a70 con 0x7ff154139200 2023-09-30T22:22:31.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.649+0000 7ff15c6bb700 1 -- 172.21.15.156:0/4236007834 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff154122290 con 0x7ff154139200 2023-09-30T22:22:31.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.650+0000 7ff15c6bb700 1 -- 172.21.15.156:0/4236007834 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff154123cb0 con 0x7ff154139200 2023-09-30T22:22:31.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.650+0000 7ff14affd700 1 -- 172.21.15.156:0/4236007834 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff14c01bcf0 con 0x7ff154139200 2023-09-30T22:22:31.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.650+0000 7ff14affd700 1 -- 172.21.15.156:0/4236007834 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff14c022070 con 0x7ff154139200 2023-09-30T22:22:31.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.654+0000 7ff14affd700 1 -- 172.21.15.156:0/4236007834 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff14c02fdb0 con 0x7ff154139200 2023-09-30T22:22:31.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.667+0000 7f078f4aa700 1 -- 172.21.15.156:0/2854365170 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f078806ecd0 con 0x7f078809e340 2023-09-30T22:22:31.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.668+0000 7f077dffb700 1 -- 172.21.15.156:0/2854365170 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0784003e60 con 0x7f078809e340 2023-09-30T22:22:31.755 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:31.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.670+0000 7f078f4aa700 1 -- 172.21.15.156:0/2854365170 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f078809e340 msgr2=0x7f07881c5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.670+0000 7f078f4aa700 1 --2- 172.21.15.156:0/2854365170 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f078809e340 0x7f07881c5750 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f0784000c00 tx=0x7f0784004750 comp rx=0 tx=0).stop 2023-09-30T22:22:31.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.670+0000 7f078f4aa700 1 -- 172.21.15.156:0/2854365170 shutdown_connections 2023-09-30T22:22:31.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.670+0000 7f078f4aa700 1 --2- 172.21.15.156:0/2854365170 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0788135f20 0x7f07881c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.670+0000 7f078f4aa700 1 --2- 172.21.15.156:0/2854365170 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f078809d860 0x7f07881c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.670+0000 7f078f4aa700 1 --2- 172.21.15.156:0/2854365170 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f078809e340 0x7f07881c5750 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.670+0000 7f078f4aa700 1 -- 172.21.15.156:0/2854365170 >> 172.21.15.156:0/2854365170 conn(0x7f0788099c40 msgr2=0x7f0788133a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:31.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.670+0000 7f078f4aa700 1 -- 172.21.15.156:0/2854365170 shutdown_connections 2023-09-30T22:22:31.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.670+0000 7f078f4aa700 1 -- 172.21.15.156:0/2854365170 wait complete. 2023-09-30T22:22:31.757 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:31.777 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:31.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.809+0000 7f872163e700 1 -- 172.21.15.156:0/1448812821 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f871c04f2a0 con 0x7f871c09e870 2023-09-30T22:22:31.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.809+0000 7f87037fe700 1 -- 172.21.15.156:0/1448812821 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f870c019ab0 con 0x7f871c09e870 2023-09-30T22:22:31.810 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:31.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.812+0000 7f872163e700 1 -- 172.21.15.156:0/1448812821 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f871c09e870 msgr2=0x7f871c06b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.812+0000 7f872163e700 1 --2- 172.21.15.156:0/1448812821 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f871c09e870 0x7f871c06b8b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f870c00ebe0 tx=0x7f870c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.812+0000 7f872163e700 1 -- 172.21.15.156:0/1448812821 shutdown_connections 2023-09-30T22:22:31.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.812+0000 7f872163e700 1 --2- 172.21.15.156:0/1448812821 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f871c131d70 0x7f871c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.812+0000 7f872163e700 1 --2- 172.21.15.156:0/1448812821 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f871c09e870 0x7f871c06b8b0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.812+0000 7f872163e700 1 --2- 172.21.15.156:0/1448812821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f871c09f180 0x7f871c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.812+0000 7f872163e700 1 -- 172.21.15.156:0/1448812821 >> 172.21.15.156:0/1448812821 conn(0x7f871c0a4430 msgr2=0x7f871c11a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:31.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.813+0000 7f872163e700 1 -- 172.21.15.156:0/1448812821 shutdown_connections 2023-09-30T22:22:31.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.813+0000 7f872163e700 1 -- 172.21.15.156:0/1448812821 wait complete. 2023-09-30T22:22:31.830 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:31.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.863+0000 7ff15c6bb700 1 -- 172.21.15.156:0/4236007834 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff154122290 con 0x7ff154139200 2023-09-30T22:22:31.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.864+0000 7ff14affd700 1 -- 172.21.15.156:0/4236007834 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff154122290 con 0x7ff154139200 2023-09-30T22:22:31.865 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.866+0000 7ff15c6bb700 1 -- 172.21.15.156:0/4236007834 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff154139200 msgr2=0x7ff1541210a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.866+0000 7ff15c6bb700 1 --2- 172.21.15.156:0/4236007834 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff154139200 0x7ff1541210a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff14c016000 tx=0x7ff14c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.866+0000 7ff15c6bb700 1 -- 172.21.15.156:0/4236007834 shutdown_connections 2023-09-30T22:22:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.866+0000 7ff15c6bb700 1 --2- 172.21.15.156:0/4236007834 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff154139200 0x7ff1541210a0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.866+0000 7ff15c6bb700 1 --2- 172.21.15.156:0/4236007834 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1540a0a70 0x7ff154120620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.866+0000 7ff15c6bb700 1 --2- 172.21.15.156:0/4236007834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1540a1550 0x7ff154120b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.866+0000 7ff15c6bb700 1 -- 172.21.15.156:0/4236007834 >> 172.21.15.156:0/4236007834 conn(0x7ff1540a6610 msgr2=0x7ff1540a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.866+0000 7ff15c6bb700 1 -- 172.21.15.156:0/4236007834 shutdown_connections 2023-09-30T22:22:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.866+0000 7ff15c6bb700 1 -- 172.21.15.156:0/4236007834 wait complete. 2023-09-30T22:22:31.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:31.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.905+0000 7fc509dfe700 1 Processor -- start 2023-09-30T22:22:31.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.906+0000 7fc509dfe700 1 -- start start 2023-09-30T22:22:31.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.906+0000 7fc509dfe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc50406a770 0x7fc50406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.906+0000 7fc509dfe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc50406b080 0x7fc5041317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.906+0000 7fc509dfe700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc50409da80 con 0x7fc504131cf0 2023-09-30T22:22:31.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.906+0000 7fc509dfe700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc50409dce0 con 0x7fc50406b080 2023-09-30T22:22:31.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.906+0000 7fc509dfe700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc50409eb20 con 0x7fc50406a770 2023-09-30T22:22:31.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.906+0000 7fc502ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc50406b080 0x7fc5041317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.906+0000 7fc502ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc50406b080 0x7fc5041317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33122/0 (socket says 172.21.15.156:33122) 2023-09-30T22:22:31.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.906+0000 7fc503fff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc504131cf0 0x7fc504138c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48654/0 (socket says 172.21.15.156:48654) 2023-09-30T22:22:31.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.906+0000 7fc5037fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc50406a770 0x7fc50406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.906+0000 7fc502ffd700 1 -- 172.21.15.156:0/4056664884 learned_addr learned my addr 172.21.15.156:0/4056664884 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:31.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.906+0000 7fc5027fc700 1 -- 172.21.15.156:0/4056664884 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1520128339 0 0) 0x7fc50409da80 con 0x7fc504131cf0 2023-09-30T22:22:31.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.906+0000 7fc5027fc700 1 -- 172.21.15.156:0/4056664884 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4f00035b0 con 0x7fc504131cf0 2023-09-30T22:22:31.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.906+0000 7fc502ffd700 1 -- 172.21.15.156:0/4056664884 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc50406a770 msgr2=0x7fc50406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:31.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.906+0000 7fc502ffd700 1 --2- 172.21.15.156:0/4056664884 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc50406a770 0x7fc50406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.906+0000 7fc502ffd700 1 -- 172.21.15.156:0/4056664884 >> v1:172.21.15.156:6789/0 conn(0x7fc504131cf0 legacy=0x7fc504138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.906+0000 7fc502ffd700 1 -- 172.21.15.156:0/4056664884 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc50409d860 con 0x7fc50406b080 2023-09-30T22:22:31.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.906+0000 7fc5037fe700 1 --2- 172.21.15.156:0/4056664884 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc50406a770 0x7fc50406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:31.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.907+0000 7fc502ffd700 1 --2- 172.21.15.156:0/4056664884 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc50406b080 0x7fc5041317b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4009950 tx=0x7fc4f4009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10c0ecf111042380 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:31.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.907+0000 7fc5027fc700 1 -- 172.21.15.156:0/4056664884 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4011830 con 0x7fc50406b080 2023-09-30T22:22:31.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.907+0000 7fc5027fc700 1 -- 172.21.15.156:0/4056664884 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f4011990 con 0x7fc50406b080 2023-09-30T22:22:31.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.907+0000 7fc5027fc700 1 -- 172.21.15.156:0/4056664884 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4011d40 con 0x7fc50406b080 2023-09-30T22:22:31.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.907+0000 7fc509dfe700 1 -- 172.21.15.156:0/4056664884 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc50406b080 msgr2=0x7fc5041317b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.907+0000 7fc509dfe700 1 --2- 172.21.15.156:0/4056664884 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc50406b080 0x7fc5041317b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4009950 tx=0x7fc4f4009c60 comp rx=0 tx=0).stop 2023-09-30T22:22:31.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.907+0000 7fc509dfe700 1 -- 172.21.15.156:0/4056664884 shutdown_connections 2023-09-30T22:22:31.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.907+0000 7fc509dfe700 1 --2- 172.21.15.156:0/4056664884 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc50406a770 0x7fc50406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.907+0000 7fc509dfe700 1 --2- 172.21.15.156:0/4056664884 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc50406b080 0x7fc5041317b0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.907+0000 7fc509dfe700 1 -- 172.21.15.156:0/4056664884 >> 172.21.15.156:0/4056664884 conn(0x7fc504099c40 msgr2=0x7fc5040a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:31.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.907+0000 7fc509dfe700 1 -- 172.21.15.156:0/4056664884 shutdown_connections 2023-09-30T22:22:31.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.907+0000 7fc509dfe700 1 -- 172.21.15.156:0/4056664884 wait complete. 2023-09-30T22:22:31.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.909+0000 7fc509dfe700 1 Processor -- start 2023-09-30T22:22:31.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.909+0000 7fc509dfe700 1 -- start start 2023-09-30T22:22:31.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.909+0000 7fc509dfe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc50406a770 0x7fc5041c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.909+0000 7fc509dfe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc50406b080 0x7fc5041c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.909+0000 7fc509dfe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc504131cf0 0x7fc5041c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.909+0000 7fc509dfe700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50411f0b0 con 0x7fc50406a770 2023-09-30T22:22:31.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.909+0000 7fc509dfe700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5041200a0 con 0x7fc50406b080 2023-09-30T22:22:31.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.909+0000 7fc509dfe700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc50411e390 con 0x7fc504131cf0 2023-09-30T22:22:31.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.909+0000 7fc5037fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc50406a770 0x7fc5041c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.910+0000 7fc502ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc50406b080 0x7fc5041c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.910+0000 7fc5037fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc50406a770 0x7fc5041c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36516/0 (socket says 172.21.15.156:36516) 2023-09-30T22:22:31.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.910+0000 7fc5037fe700 1 -- 172.21.15.156:0/956233950 learned_addr learned my addr 172.21.15.156:0/956233950 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:31.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.910+0000 7fc503fff700 1 --2- 172.21.15.156:0/956233950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc504131cf0 0x7fc5041c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.910+0000 7fc502ffd700 1 -- 172.21.15.156:0/956233950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc504131cf0 msgr2=0x7fc5041c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.910+0000 7fc502ffd700 1 --2- 172.21.15.156:0/956233950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc504131cf0 0x7fc5041c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.910+0000 7fc502ffd700 1 -- 172.21.15.156:0/956233950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc50406a770 msgr2=0x7fc5041c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.910+0000 7fc502ffd700 1 --2- 172.21.15.156:0/956233950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc50406a770 0x7fc5041c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.910+0000 7fc502ffd700 1 -- 172.21.15.156:0/956233950 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec0094a0 con 0x7fc50406b080 2023-09-30T22:22:31.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.910+0000 7fc502ffd700 1 --2- 172.21.15.156:0/956233950 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc50406b080 0x7fc5041c63e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4009920 tx=0x7fc4f4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:31.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.910+0000 7fc4fbfff700 1 -- 172.21.15.156:0/956233950 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4004450 con 0x7fc50406b080 2023-09-30T22:22:31.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.910+0000 7fc4fbfff700 1 -- 172.21.15.156:0/956233950 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f40045b0 con 0x7fc50406b080 2023-09-30T22:22:31.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.910+0000 7fc4fbfff700 1 -- 172.21.15.156:0/956233950 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f401d9e0 con 0x7fc50406b080 2023-09-30T22:22:31.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.910+0000 7fc509dfe700 1 -- 172.21.15.156:0/956233950 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f4009550 con 0x7fc50406b080 2023-09-30T22:22:31.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.910+0000 7fc509dfe700 1 -- 172.21.15.156:0/956233950 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc50411eb80 con 0x7fc50406b080 2023-09-30T22:22:31.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.911+0000 7fc509dfe700 1 -- 172.21.15.156:0/956233950 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc50404f2a0 con 0x7fc50406b080 2023-09-30T22:22:31.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.911+0000 7fc4fbfff700 1 -- 172.21.15.156:0/956233950 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc4f4006bd0 con 0x7fc50406b080 2023-09-30T22:22:31.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.912+0000 7fc4fbfff700 1 -- 172.21.15.156:0/956233950 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc4f4044e30 con 0x7fc50406b080 2023-09-30T22:22:31.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:31.916+0000 7fc4fbfff700 1 -- 172.21.15.156:0/956233950 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc4f4025390 con 0x7fc50406b080 2023-09-30T22:22:32.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.099+0000 7fc509dfe700 1 -- 172.21.15.156:0/956233950 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc504131230 con 0x7fc50406b080 2023-09-30T22:22:32.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.099+0000 7fc4fbfff700 1 -- 172.21.15.156:0/956233950 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc4f4015020 con 0x7fc50406b080 2023-09-30T22:22:32.100 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:32.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.101+0000 7fc509dfe700 1 -- 172.21.15.156:0/956233950 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc50406b080 msgr2=0x7fc5041c63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:32.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.101+0000 7fc509dfe700 1 --2- 172.21.15.156:0/956233950 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc50406b080 0x7fc5041c63e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4009920 tx=0x7fc4f4004750 comp rx=0 tx=0).stop 2023-09-30T22:22:32.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.101+0000 7fc509dfe700 1 -- 172.21.15.156:0/956233950 shutdown_connections 2023-09-30T22:22:32.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.101+0000 7fc509dfe700 1 --2- 172.21.15.156:0/956233950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc504131cf0 0x7fc5041c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.101+0000 7fc509dfe700 1 --2- 172.21.15.156:0/956233950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc50406a770 0x7fc5041c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.101+0000 7fc509dfe700 1 --2- 172.21.15.156:0/956233950 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc50406b080 0x7fc5041c63e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.101+0000 7fc509dfe700 1 -- 172.21.15.156:0/956233950 >> 172.21.15.156:0/956233950 conn(0x7fc504099c40 msgr2=0x7fc5041b9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:32.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.101+0000 7fc509dfe700 1 -- 172.21.15.156:0/956233950 shutdown_connections 2023-09-30T22:22:32.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.101+0000 7fc509dfe700 1 -- 172.21.15.156:0/956233950 wait complete. 2023-09-30T22:22:32.114 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:32.758 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:32.831 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:32.880 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:32.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.892+0000 7f2f61925700 1 Processor -- start 2023-09-30T22:22:32.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.892+0000 7f2f61925700 1 -- start start 2023-09-30T22:22:32.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.892+0000 7f2f61925700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f5c1346e0 0x7f2f5c136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.892+0000 7f2f61925700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2f5c137000 0x7f2f5c1393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.892+0000 7f2f61925700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f5c0a1640 con 0x7f2f5c131980 2023-09-30T22:22:32.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.892+0000 7f2f61925700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c06eb30 con 0x7f2f5c1346e0 2023-09-30T22:22:32.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.892+0000 7f2f61925700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c0a22d0 con 0x7f2f5c137000 2023-09-30T22:22:32.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.892+0000 7f2f5b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2f5c137000 0x7f2f5c1393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:32.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.893+0000 7f2f5b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2f5c137000 0x7f2f5c1393e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55726/0 (socket says 172.21.15.156:55726) 2023-09-30T22:22:32.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.893+0000 7f2f5b7fe700 1 -- 172.21.15.156:0/3854130175 learned_addr learned my addr 172.21.15.156:0/3854130175 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:32.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.893+0000 7f2f5a7fc700 1 --2- 172.21.15.156:0/3854130175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f5c1346e0 0x7f2f5c136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:32.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.893+0000 7f2f5b7fe700 1 -- 172.21.15.156:0/3854130175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f5c1346e0 msgr2=0x7f2f5c136ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:32.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.893+0000 7f2f59ffb700 1 -- 172.21.15.156:0/3854130175 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2251565153 0 0) 0x7f2f5c0a1640 con 0x7f2f5c131980 2023-09-30T22:22:32.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.893+0000 7f2f5b7fe700 1 --2- 172.21.15.156:0/3854130175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f5c1346e0 0x7f2f5c136ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.893+0000 7f2f5b7fe700 1 -- 172.21.15.156:0/3854130175 >> v1:172.21.15.156:6789/0 conn(0x7f2f5c131980 legacy=0x7f2f5c131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:32.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.893+0000 7f2f5b7fe700 1 -- 172.21.15.156:0/3854130175 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5c131550 con 0x7f2f5c137000 2023-09-30T22:22:32.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.893+0000 7f2f5a7fc700 1 --2- 172.21.15.156:0/3854130175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f5c1346e0 0x7f2f5c136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:32.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.893+0000 7f2f5b7fe700 1 --2- 172.21.15.156:0/3854130175 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2f5c137000 0x7f2f5c1393e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009e80 tx=0x7f2f5400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95e2be46daebbad0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:32.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.893+0000 7f2f59ffb700 1 -- 172.21.15.156:0/3854130175 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5400e070 con 0x7f2f5c137000 2023-09-30T22:22:32.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.893+0000 7f2f59ffb700 1 -- 172.21.15.156:0/3854130175 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5400b9c0 con 0x7f2f5c137000 2023-09-30T22:22:32.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.893+0000 7f2f59ffb700 1 -- 172.21.15.156:0/3854130175 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5400bd70 con 0x7f2f5c137000 2023-09-30T22:22:32.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.894+0000 7f2f61925700 1 -- 172.21.15.156:0/3854130175 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2f5c137000 msgr2=0x7f2f5c1393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:32.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.894+0000 7f2f61925700 1 --2- 172.21.15.156:0/3854130175 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2f5c137000 0x7f2f5c1393e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009e80 tx=0x7f2f5400b330 comp rx=0 tx=0).stop 2023-09-30T22:22:32.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.894+0000 7f2f61925700 1 -- 172.21.15.156:0/3854130175 shutdown_connections 2023-09-30T22:22:32.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.894+0000 7f2f61925700 1 --2- 172.21.15.156:0/3854130175 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2f5c137000 0x7f2f5c1393e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.894+0000 7f2f61925700 1 --2- 172.21.15.156:0/3854130175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f5c1346e0 0x7f2f5c136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.894+0000 7f2f61925700 1 -- 172.21.15.156:0/3854130175 >> 172.21.15.156:0/3854130175 conn(0x7f2f5c0a2980 msgr2=0x7f2f5c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:32.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.894+0000 7f2f61925700 1 -- 172.21.15.156:0/3854130175 shutdown_connections 2023-09-30T22:22:32.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.894+0000 7f2f61925700 1 -- 172.21.15.156:0/3854130175 wait complete. 2023-09-30T22:22:32.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.895+0000 7f2f61925700 1 Processor -- start 2023-09-30T22:22:32.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.895+0000 7f2f61925700 1 -- start start 2023-09-30T22:22:32.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.896+0000 7f2f61925700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f5c131980 0x7f2f5c118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.896+0000 7f2f61925700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2f5c1346e0 0x7f2f5c119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.896+0000 7f2f61925700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f5c137000 0x7f2f5c119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.896+0000 7f2f61925700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c0a1c40 con 0x7f2f5c137000 2023-09-30T22:22:32.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.896+0000 7f2f61925700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c11aef0 con 0x7f2f5c131980 2023-09-30T22:22:32.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.896+0000 7f2f61925700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c11a910 con 0x7f2f5c1346e0 2023-09-30T22:22:32.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.896+0000 7f2f5a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2f5c1346e0 0x7f2f5c119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:32.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.896+0000 7f2f5a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2f5c1346e0 0x7f2f5c119330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55728/0 (socket says 172.21.15.156:55728) 2023-09-30T22:22:32.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.896+0000 7f2f5a7fc700 1 -- 172.21.15.156:0/849670872 learned_addr learned my addr 172.21.15.156:0/849670872 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:32.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.896+0000 7f2f5b7fe700 1 --2- 172.21.15.156:0/849670872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f5c137000 0x7f2f5c119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:32.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.896+0000 7f2f5affd700 1 --2- 172.21.15.156:0/849670872 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f5c131980 0x7f2f5c118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:32.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.896+0000 7f2f5a7fc700 1 -- 172.21.15.156:0/849670872 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f5c131980 msgr2=0x7f2f5c118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:32.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.896+0000 7f2f5a7fc700 1 --2- 172.21.15.156:0/849670872 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f5c131980 0x7f2f5c118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.896+0000 7f2f5a7fc700 1 -- 172.21.15.156:0/849670872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f5c137000 msgr2=0x7f2f5c119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:32.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.896+0000 7f2f5a7fc700 1 --2- 172.21.15.156:0/849670872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f5c137000 0x7f2f5c119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.896+0000 7f2f5a7fc700 1 -- 172.21.15.156:0/849670872 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f54009b30 con 0x7f2f5c1346e0 2023-09-30T22:22:32.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.896+0000 7f2f5b7fe700 1 --2- 172.21.15.156:0/849670872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f5c137000 0x7f2f5c119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:32.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.896+0000 7f2f5affd700 1 --2- 172.21.15.156:0/849670872 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f5c131980 0x7f2f5c118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:32.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.897+0000 7f2f5a7fc700 1 --2- 172.21.15.156:0/849670872 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2f5c1346e0 0x7f2f5c119330 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2f5000e840 tx=0x7f2f5000eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:32.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.897+0000 7f2f43fff700 1 -- 172.21.15.156:0/849670872 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f50004230 con 0x7f2f5c1346e0 2023-09-30T22:22:32.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.897+0000 7f2f43fff700 1 -- 172.21.15.156:0/849670872 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f50004390 con 0x7f2f5c1346e0 2023-09-30T22:22:32.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.897+0000 7f2f43fff700 1 -- 172.21.15.156:0/849670872 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f500036a0 con 0x7f2f5c1346e0 2023-09-30T22:22:32.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.897+0000 7f2f61925700 1 -- 172.21.15.156:0/849670872 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f5c136c60 con 0x7f2f5c1346e0 2023-09-30T22:22:32.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.897+0000 7f2f61925700 1 -- 172.21.15.156:0/849670872 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5c11b100 con 0x7f2f5c1346e0 2023-09-30T22:22:32.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.898+0000 7f2f43fff700 1 -- 172.21.15.156:0/849670872 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2f50003800 con 0x7f2f5c1346e0 2023-09-30T22:22:32.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.898+0000 7f2f43fff700 1 -- 172.21.15.156:0/849670872 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2f5003f120 con 0x7f2f5c1346e0 2023-09-30T22:22:32.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.898+0000 7f2f61925700 1 -- 172.21.15.156:0/849670872 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f5c04f2a0 con 0x7f2f5c1346e0 2023-09-30T22:22:32.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.903+0000 7f2f43fff700 1 -- 172.21.15.156:0/849670872 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f500228f0 con 0x7f2f5c1346e0 2023-09-30T22:22:32.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.964+0000 7fe04e4a2700 1 Processor -- start 2023-09-30T22:22:32.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.964+0000 7fe04e4a2700 1 -- start start 2023-09-30T22:22:32.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.965+0000 7fe04e4a2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe048134140 0x7fe048138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.965+0000 7fe04e4a2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0481345a0 0x7fe04813b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.965+0000 7fe04e4a2700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe04809b110 con 0x7fe04809ad40 2023-09-30T22:22:32.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.965+0000 7fe04e4a2700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0480a3b60 con 0x7fe048134140 2023-09-30T22:22:32.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.965+0000 7fe04e4a2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0480a1a80 con 0x7fe0481345a0 2023-09-30T22:22:32.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.965+0000 7fe0477fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe048134140 0x7fe048138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:32.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.965+0000 7fe0477fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe048134140 0x7fe048138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36542/0 (socket says 172.21.15.156:36542) 2023-09-30T22:22:32.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.965+0000 7fe0477fe700 1 -- 172.21.15.156:0/3366205917 learned_addr learned my addr 172.21.15.156:0/3366205917 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:32.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.965+0000 7fe04ca3f700 1 --2- 172.21.15.156:0/3366205917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0481345a0 0x7fe04813b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:32.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.965+0000 7fe0477fe700 1 -- 172.21.15.156:0/3366205917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0481345a0 msgr2=0x7fe04813b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:32.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.965+0000 7fe0477fe700 1 --2- 172.21.15.156:0/3366205917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0481345a0 0x7fe04813b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.965+0000 7fe0477fe700 1 -- 172.21.15.156:0/3366205917 >> v1:172.21.15.156:6789/0 conn(0x7fe04809ad40 legacy=0x7fe048133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:32.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.965+0000 7fe0477fe700 1 -- 172.21.15.156:0/3366205917 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0480a2fa0 con 0x7fe048134140 2023-09-30T22:22:32.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.966+0000 7fe0477fe700 1 --2- 172.21.15.156:0/3366205917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe048134140 0x7fe048138e80 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fe03c0098f0 tx=0x7fe03c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9d23c29abc901a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:32.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.966+0000 7fe046ffd700 1 -- 172.21.15.156:0/3366205917 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c011830 con 0x7fe048134140 2023-09-30T22:22:32.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.966+0000 7fe046ffd700 1 -- 172.21.15.156:0/3366205917 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03c011990 con 0x7fe048134140 2023-09-30T22:22:32.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.966+0000 7fe046ffd700 1 -- 172.21.15.156:0/3366205917 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c011d20 con 0x7fe048134140 2023-09-30T22:22:32.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.966+0000 7fe04e4a2700 1 -- 172.21.15.156:0/3366205917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe048134140 msgr2=0x7fe048138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:32.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.966+0000 7fe04e4a2700 1 --2- 172.21.15.156:0/3366205917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe048134140 0x7fe048138e80 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fe03c0098f0 tx=0x7fe03c009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:32.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.966+0000 7fe04e4a2700 1 -- 172.21.15.156:0/3366205917 shutdown_connections 2023-09-30T22:22:32.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.966+0000 7fe04e4a2700 1 --2- 172.21.15.156:0/3366205917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe0481345a0 0x7fe04813b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.966+0000 7fe04e4a2700 1 --2- 172.21.15.156:0/3366205917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe048134140 0x7fe048138e80 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.966+0000 7fe04e4a2700 1 -- 172.21.15.156:0/3366205917 >> 172.21.15.156:0/3366205917 conn(0x7fe048099c40 msgr2=0x7fe04806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:32.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.966+0000 7fe04e4a2700 1 -- 172.21.15.156:0/3366205917 shutdown_connections 2023-09-30T22:22:32.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.966+0000 7fe04e4a2700 1 -- 172.21.15.156:0/3366205917 wait complete. 2023-09-30T22:22:32.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.967+0000 7fe04e4a2700 1 Processor -- start 2023-09-30T22:22:32.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.967+0000 7fe04e4a2700 1 -- start start 2023-09-30T22:22:32.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.968+0000 7fe04e4a2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe04809ad40 0x7fe04811c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.968+0000 7fe04e4a2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe048134140 0x7fe04811ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.968+0000 7fe04e4a2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe0481345a0 0x7fe04811d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.968+0000 7fe04e4a2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04811e7e0 con 0x7fe048134140 2023-09-30T22:22:32.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.968+0000 7fe04e4a2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04811e2b0 con 0x7fe04809ad40 2023-09-30T22:22:32.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.968+0000 7fe04e4a2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0480a4110 con 0x7fe0481345a0 2023-09-30T22:22:32.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.968+0000 7fe0477fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe048134140 0x7fe04811ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:32.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.968+0000 7fe0477fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe048134140 0x7fe04811ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36558/0 (socket says 172.21.15.156:36558) 2023-09-30T22:22:32.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.968+0000 7fe047fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe04809ad40 0x7fe04811c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:32.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.968+0000 7fe0477fe700 1 -- 172.21.15.156:0/1077707107 learned_addr learned my addr 172.21.15.156:0/1077707107 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:32.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.968+0000 7fe04ca3f700 1 --2- 172.21.15.156:0/1077707107 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe0481345a0 0x7fe04811d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:32.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.968+0000 7fe0477fe700 1 -- 172.21.15.156:0/1077707107 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe0481345a0 msgr2=0x7fe04811d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:32.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.968+0000 7fe0477fe700 1 --2- 172.21.15.156:0/1077707107 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe0481345a0 0x7fe04811d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.968+0000 7fe0477fe700 1 -- 172.21.15.156:0/1077707107 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe04809ad40 msgr2=0x7fe04811c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:32.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.968+0000 7fe0477fe700 1 --2- 172.21.15.156:0/1077707107 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe04809ad40 0x7fe04811c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.968+0000 7fe0477fe700 1 -- 172.21.15.156:0/1077707107 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03c009550 con 0x7fe048134140 2023-09-30T22:22:32.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.968+0000 7fe0477fe700 1 --2- 172.21.15.156:0/1077707107 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe048134140 0x7fe04811ce00 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fe03c009c40 tx=0x7fe03c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:32.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.969+0000 7fe044ff9700 1 -- 172.21.15.156:0/1077707107 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c004510 con 0x7fe048134140 2023-09-30T22:22:32.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.969+0000 7fe044ff9700 1 -- 172.21.15.156:0/1077707107 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03c01e070 con 0x7fe048134140 2023-09-30T22:22:32.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.969+0000 7fe04e4a2700 1 -- 172.21.15.156:0/1077707107 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe04809c7e0 con 0x7fe048134140 2023-09-30T22:22:32.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.969+0000 7fe044ff9700 1 -- 172.21.15.156:0/1077707107 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c0038e0 con 0x7fe048134140 2023-09-30T22:22:32.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.969+0000 7fe04e4a2700 1 -- 172.21.15.156:0/1077707107 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0481399f0 con 0x7fe048134140 2023-09-30T22:22:32.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.969+0000 7fe044ff9700 1 -- 172.21.15.156:0/1077707107 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe03c003a40 con 0x7fe048134140 2023-09-30T22:22:32.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.970+0000 7fe044ff9700 1 -- 172.21.15.156:0/1077707107 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe03c020070 con 0x7fe048134140 2023-09-30T22:22:32.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.970+0000 7fe04e4a2700 1 -- 172.21.15.156:0/1077707107 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe04804f2a0 con 0x7fe048134140 2023-09-30T22:22:32.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:32.975+0000 7fe044ff9700 1 -- 172.21.15.156:0/1077707107 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe03c015020 con 0x7fe048134140 2023-09-30T22:22:33.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.009+0000 7f53fec18700 1 Processor -- start 2023-09-30T22:22:33.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.009+0000 7f53fec18700 1 -- start start 2023-09-30T22:22:33.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.010+0000 7f53fec18700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53f80a1550 0x7f53f8138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:33.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.010+0000 7f53fec18700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f53f8139200 0x7f53f813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:33.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.010+0000 7f53fec18700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f809e9d0 con 0x7f53f80a0a70 2023-09-30T22:22:33.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.010+0000 7f53fec18700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f809dc00 con 0x7f53f80a1550 2023-09-30T22:22:33.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.010+0000 7f53fec18700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53f809dec0 con 0x7f53f8139200 2023-09-30T22:22:33.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.010+0000 7f53f7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53f80a1550 0x7f53f8138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:33.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.010+0000 7f53fc9b4700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f53f80a0a70 0x7f53f80a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48686/0 (socket says 172.21.15.156:48686) 2023-09-30T22:22:33.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.010+0000 7f53fc9b4700 1 -- 172.21.15.156:0/2186219320 learned_addr learned my addr 172.21.15.156:0/2186219320 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:33.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.010+0000 7f53fd1b5700 1 --2- 172.21.15.156:0/2186219320 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f53f8139200 0x7f53f813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:33.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.011+0000 7f53f77fe700 1 -- 172.21.15.156:0/2186219320 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2235516325 0 0) 0x7f53f809e9d0 con 0x7f53f80a0a70 2023-09-30T22:22:33.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.011+0000 7f53f77fe700 1 -- 172.21.15.156:0/2186219320 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53e80035b0 con 0x7f53f80a0a70 2023-09-30T22:22:33.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.011+0000 7f53f7fff700 1 -- 172.21.15.156:0/2186219320 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f53f8139200 msgr2=0x7f53f813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:33.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.011+0000 7f53f7fff700 1 --2- 172.21.15.156:0/2186219320 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f53f8139200 0x7f53f813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.011+0000 7f53f7fff700 1 -- 172.21.15.156:0/2186219320 >> v1:172.21.15.156:6789/0 conn(0x7f53f80a0a70 legacy=0x7f53f80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:33.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.011+0000 7f53f7fff700 1 -- 172.21.15.156:0/2186219320 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f809e6a0 con 0x7f53f80a1550 2023-09-30T22:22:33.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.011+0000 7f53f7fff700 1 --2- 172.21.15.156:0/2186219320 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53f80a1550 0x7f53f8138cc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f53e4009870 tx=0x7f53e4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d961723db3a42f64 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:33.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.011+0000 7f53f77fe700 1 -- 172.21.15.156:0/2186219320 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e4011830 con 0x7f53f80a1550 2023-09-30T22:22:33.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.011+0000 7f53f77fe700 1 -- 172.21.15.156:0/2186219320 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e4011990 con 0x7f53f80a1550 2023-09-30T22:22:33.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.011+0000 7f53f77fe700 1 -- 172.21.15.156:0/2186219320 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e4011d20 con 0x7f53f80a1550 2023-09-30T22:22:33.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.012+0000 7f53fec18700 1 -- 172.21.15.156:0/2186219320 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53f80a1550 msgr2=0x7f53f8138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:33.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.012+0000 7f53fec18700 1 --2- 172.21.15.156:0/2186219320 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53f80a1550 0x7f53f8138cc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f53e4009870 tx=0x7f53e4009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:33.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.012+0000 7f53fec18700 1 -- 172.21.15.156:0/2186219320 shutdown_connections 2023-09-30T22:22:33.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.012+0000 7f53fec18700 1 --2- 172.21.15.156:0/2186219320 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f53f8139200 0x7f53f813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.012+0000 7f53fec18700 1 --2- 172.21.15.156:0/2186219320 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53f80a1550 0x7f53f8138cc0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.012+0000 7f53fec18700 1 -- 172.21.15.156:0/2186219320 >> 172.21.15.156:0/2186219320 conn(0x7f53f80a6610 msgr2=0x7f53f80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:33.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.012+0000 7f53fec18700 1 -- 172.21.15.156:0/2186219320 shutdown_connections 2023-09-30T22:22:33.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.012+0000 7f53fec18700 1 -- 172.21.15.156:0/2186219320 wait complete. 2023-09-30T22:22:33.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.013+0000 7f53fec18700 1 Processor -- start 2023-09-30T22:22:33.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.013+0000 7f53fec18700 1 -- start start 2023-09-30T22:22:33.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.013+0000 7f53fec18700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f53f80a0a70 0x7f53f811e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:33.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.013+0000 7f53fec18700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53f80a1550 0x7f53f811ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:33.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.013+0000 7f53fec18700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53f8139200 0x7f53f811f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:33.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.013+0000 7f53fec18700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f8133ff0 con 0x7f53f8139200 2023-09-30T22:22:33.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.013+0000 7f53fec18700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f81345d0 con 0x7f53f80a1550 2023-09-30T22:22:33.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.013+0000 7f53fec18700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53f8122200 con 0x7f53f80a0a70 2023-09-30T22:22:33.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.013+0000 7f53fc9b4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f53f80a0a70 0x7f53f811e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:33.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.013+0000 7f53fd1b5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53f8139200 0x7f53f811f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:33.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.013+0000 7f53fc9b4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f53f80a0a70 0x7f53f811e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55752/0 (socket says 172.21.15.156:55752) 2023-09-30T22:22:33.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.013+0000 7f53fc9b4700 1 -- 172.21.15.156:0/785867156 learned_addr learned my addr 172.21.15.156:0/785867156 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:33.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.013+0000 7f53f7fff700 1 --2- 172.21.15.156:0/785867156 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53f80a1550 0x7f53f811ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:33.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.014+0000 7f53fd1b5700 1 -- 172.21.15.156:0/785867156 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f53f80a0a70 msgr2=0x7f53f811e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:33.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.014+0000 7f53fd1b5700 1 --2- 172.21.15.156:0/785867156 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f53f80a0a70 0x7f53f811e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.014+0000 7f53fd1b5700 1 -- 172.21.15.156:0/785867156 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53f80a1550 msgr2=0x7f53f811ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:33.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.014+0000 7f53fd1b5700 1 --2- 172.21.15.156:0/785867156 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53f80a1550 0x7f53f811ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.014+0000 7f53fd1b5700 1 -- 172.21.15.156:0/785867156 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e40094a0 con 0x7f53f8139200 2023-09-30T22:22:33.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.014+0000 7f53fd1b5700 1 --2- 172.21.15.156:0/785867156 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53f8139200 0x7f53f811f1b0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f53f000ef90 tx=0x7f53f000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:33.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.014+0000 7f53f57fa700 1 -- 172.21.15.156:0/785867156 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f000cc90 con 0x7f53f8139200 2023-09-30T22:22:33.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.014+0000 7f53f57fa700 1 -- 172.21.15.156:0/785867156 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f000f040 con 0x7f53f8139200 2023-09-30T22:22:33.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.014+0000 7f53f57fa700 1 -- 172.21.15.156:0/785867156 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f00146c0 con 0x7f53f8139200 2023-09-30T22:22:33.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.014+0000 7f53fec18700 1 -- 172.21.15.156:0/785867156 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f8120b10 con 0x7f53f8139200 2023-09-30T22:22:33.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.014+0000 7f53fec18700 1 -- 172.21.15.156:0/785867156 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f80a03e0 con 0x7f53f8139200 2023-09-30T22:22:33.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.015+0000 7f53f57fa700 1 -- 172.21.15.156:0/785867156 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f53f0014820 con 0x7f53f8139200 2023-09-30T22:22:33.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.015+0000 7f53fec18700 1 -- 172.21.15.156:0/785867156 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f804f2a0 con 0x7f53f8139200 2023-09-30T22:22:33.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.015+0000 7f53f57fa700 1 -- 172.21.15.156:0/785867156 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f53f00403f0 con 0x7f53f8139200 2023-09-30T22:22:33.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.020+0000 7f53f57fa700 1 -- 172.21.15.156:0/785867156 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f53f0012930 con 0x7f53f8139200 2023-09-30T22:22:33.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.105+0000 7f2f61925700 1 -- 172.21.15.156:0/849670872 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2f5c06bce0 con 0x7f2f5c1346e0 2023-09-30T22:22:33.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.105+0000 7f2f43fff700 1 -- 172.21.15.156:0/849670872 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2f50022300 con 0x7f2f5c1346e0 2023-09-30T22:22:33.108 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:33.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.108+0000 7f2f61925700 1 -- 172.21.15.156:0/849670872 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2f5c1346e0 msgr2=0x7f2f5c119330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:33.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.108+0000 7f2f61925700 1 --2- 172.21.15.156:0/849670872 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2f5c1346e0 0x7f2f5c119330 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2f5000e840 tx=0x7f2f5000eb50 comp rx=0 tx=0).stop 2023-09-30T22:22:33.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.108+0000 7f2f61925700 1 -- 172.21.15.156:0/849670872 shutdown_connections 2023-09-30T22:22:33.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.108+0000 7f2f61925700 1 --2- 172.21.15.156:0/849670872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f5c137000 0x7f2f5c119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.108+0000 7f2f61925700 1 --2- 172.21.15.156:0/849670872 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f5c131980 0x7f2f5c118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.108+0000 7f2f61925700 1 --2- 172.21.15.156:0/849670872 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2f5c1346e0 0x7f2f5c119330 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.108+0000 7f2f61925700 1 -- 172.21.15.156:0/849670872 >> 172.21.15.156:0/849670872 conn(0x7f2f5c0a2980 msgr2=0x7f2f5c133560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:33.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.108+0000 7f2f61925700 1 -- 172.21.15.156:0/849670872 shutdown_connections 2023-09-30T22:22:33.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.109+0000 7f2f61925700 1 -- 172.21.15.156:0/849670872 wait complete. 2023-09-30T22:22:33.115 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:33.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:33.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.171+0000 7fe04e4a2700 1 -- 172.21.15.156:0/1077707107 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe0480729d0 con 0x7fe048134140 2023-09-30T22:22:33.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.171+0000 7fe044ff9700 1 -- 172.21.15.156:0/1077707107 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe03c033070 con 0x7fe048134140 2023-09-30T22:22:33.172 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:33.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.174+0000 7fe04e4a2700 1 -- 172.21.15.156:0/1077707107 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe048134140 msgr2=0x7fe04811ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:33.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.174+0000 7fe04e4a2700 1 --2- 172.21.15.156:0/1077707107 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe048134140 0x7fe04811ce00 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fe03c009c40 tx=0x7fe03c004750 comp rx=0 tx=0).stop 2023-09-30T22:22:33.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.174+0000 7fe04e4a2700 1 -- 172.21.15.156:0/1077707107 shutdown_connections 2023-09-30T22:22:33.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.174+0000 7fe04e4a2700 1 --2- 172.21.15.156:0/1077707107 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe0481345a0 0x7fe04811d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.174+0000 7fe04e4a2700 1 --2- 172.21.15.156:0/1077707107 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe04809ad40 0x7fe04811c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.174+0000 7fe04e4a2700 1 --2- 172.21.15.156:0/1077707107 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe048134140 0x7fe04811ce00 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.174+0000 7fe04e4a2700 1 -- 172.21.15.156:0/1077707107 >> 172.21.15.156:0/1077707107 conn(0x7fe048099c40 msgr2=0x7fe0480a61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:33.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.174+0000 7fe04e4a2700 1 -- 172.21.15.156:0/1077707107 shutdown_connections 2023-09-30T22:22:33.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.174+0000 7fe04e4a2700 1 -- 172.21.15.156:0/1077707107 wait complete. 2023-09-30T22:22:33.187 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:33.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.222+0000 7f53fec18700 1 -- 172.21.15.156:0/785867156 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f53f8072980 con 0x7f53f8139200 2023-09-30T22:22:33.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.222+0000 7f53f57fa700 1 -- 172.21.15.156:0/785867156 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f53f0015990 con 0x7f53f8139200 2023-09-30T22:22:33.223 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:33.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.224+0000 7f53fec18700 1 -- 172.21.15.156:0/785867156 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53f8139200 msgr2=0x7f53f811f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:33.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.224+0000 7f53fec18700 1 --2- 172.21.15.156:0/785867156 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53f8139200 0x7f53f811f1b0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f53f000ef90 tx=0x7f53f000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.224+0000 7f53fec18700 1 -- 172.21.15.156:0/785867156 shutdown_connections 2023-09-30T22:22:33.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.224+0000 7f53fec18700 1 --2- 172.21.15.156:0/785867156 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53f8139200 0x7f53f811f1b0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.224+0000 7f53fec18700 1 --2- 172.21.15.156:0/785867156 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f53f80a0a70 0x7f53f811e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.224+0000 7f53fec18700 1 --2- 172.21.15.156:0/785867156 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53f80a1550 0x7f53f811ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.224+0000 7f53fec18700 1 -- 172.21.15.156:0/785867156 >> 172.21.15.156:0/785867156 conn(0x7f53f80a6610 msgr2=0x7f53f80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:33.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.224+0000 7f53fec18700 1 -- 172.21.15.156:0/785867156 shutdown_connections 2023-09-30T22:22:33.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.224+0000 7f53fec18700 1 -- 172.21.15.156:0/785867156 wait complete. 2023-09-30T22:22:33.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:33.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.241+0000 7fa6d8bf5700 1 Processor -- start 2023-09-30T22:22:33.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.241+0000 7fa6d8bf5700 1 -- start start 2023-09-30T22:22:33.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.242+0000 7fa6d8bf5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa6d412d380 0x7fa6d412d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:33.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.242+0000 7fa6d8bf5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa6d4099a60 0x7fa6d4099e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:33.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.242+0000 7fa6d8bf5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa6d409a3d0 0x7fa6d4137610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:33.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.242+0000 7fa6d8bf5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d409bb90 con 0x7fa6d412d380 2023-09-30T22:22:33.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.242+0000 7fa6d8bf5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d409c210 con 0x7fa6d409a3d0 2023-09-30T22:22:33.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.242+0000 7fa6d8bf5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d409ced0 con 0x7fa6d4099a60 2023-09-30T22:22:33.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.242+0000 7fa6d259c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa6d412d380 0x7fa6d412d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:33.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.242+0000 7fa6d2d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa6d409a3d0 0x7fa6d4137610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:33.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.242+0000 7fa6d1d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa6d4099a60 0x7fa6d4099e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:33.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.242+0000 7fa6d2d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa6d409a3d0 0x7fa6d4137610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33196/0 (socket says 172.21.15.156:33196) 2023-09-30T22:22:33.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.242+0000 7fa6d259c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa6d412d380 0x7fa6d412d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36574/0 (socket says 172.21.15.156:36574) 2023-09-30T22:22:33.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.242+0000 7fa6d1d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa6d4099a60 0x7fa6d4099e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55768/0 (socket says 172.21.15.156:55768) 2023-09-30T22:22:33.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.242+0000 7fa6d2d9d700 1 -- 172.21.15.156:0/3383666378 learned_addr learned my addr 172.21.15.156:0/3383666378 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:33.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.242+0000 7fa6d1d9b700 1 -- 172.21.15.156:0/3383666378 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa6d409a3d0 msgr2=0x7fa6d4137610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:33.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.242+0000 7fa6d1d9b700 1 --2- 172.21.15.156:0/3383666378 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa6d409a3d0 0x7fa6d4137610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.242+0000 7fa6d1d9b700 1 -- 172.21.15.156:0/3383666378 >> v2:172.21.15.156:3300/0 conn(0x7fa6d412d380 msgr2=0x7fa6d412d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:33.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.242+0000 7fa6d1d9b700 1 --2- 172.21.15.156:0/3383666378 >> v2:172.21.15.156:3300/0 conn(0x7fa6d412d380 0x7fa6d412d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.242+0000 7fa6d1d9b700 1 -- 172.21.15.156:0/3383666378 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d409ac30 con 0x7fa6d4099a60 2023-09-30T22:22:33.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.242+0000 7fa6d259c700 1 --2- 172.21.15.156:0/3383666378 >> v2:172.21.15.156:3300/0 conn(0x7fa6d412d380 0x7fa6d412d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:33.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.242+0000 7fa6d2d9d700 1 --2- 172.21.15.156:0/3383666378 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa6d409a3d0 0x7fa6d4137610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:33.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.242+0000 7fa6d1d9b700 1 --2- 172.21.15.156:0/3383666378 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa6d4099a60 0x7fa6d4099e90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4009840 tx=0x7fa6c4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f58dacf47c0d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:33.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.242+0000 7fa6d159a700 1 -- 172.21.15.156:0/3383666378 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4011830 con 0x7fa6d4099a60 2023-09-30T22:22:33.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.242+0000 7fa6d159a700 1 -- 172.21.15.156:0/3383666378 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c4011990 con 0x7fa6d4099a60 2023-09-30T22:22:33.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.242+0000 7fa6d159a700 1 -- 172.21.15.156:0/3383666378 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4011d20 con 0x7fa6d4099a60 2023-09-30T22:22:33.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.243+0000 7fa6d8bf5700 1 -- 172.21.15.156:0/3383666378 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa6d4099a60 msgr2=0x7fa6d4099e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:33.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.243+0000 7fa6d8bf5700 1 --2- 172.21.15.156:0/3383666378 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa6d4099a60 0x7fa6d4099e90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4009840 tx=0x7fa6c4009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:33.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.243+0000 7fa6d8bf5700 1 -- 172.21.15.156:0/3383666378 shutdown_connections 2023-09-30T22:22:33.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.243+0000 7fa6d8bf5700 1 --2- 172.21.15.156:0/3383666378 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa6d409a3d0 0x7fa6d4137610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.243+0000 7fa6d8bf5700 1 --2- 172.21.15.156:0/3383666378 >> v2:172.21.15.156:3300/0 conn(0x7fa6d412d380 0x7fa6d412d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.243+0000 7fa6d8bf5700 1 --2- 172.21.15.156:0/3383666378 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa6d4099a60 0x7fa6d4099e90 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.243+0000 7fa6d8bf5700 1 -- 172.21.15.156:0/3383666378 >> 172.21.15.156:0/3383666378 conn(0x7fa6d40a2980 msgr2=0x7fa6d40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:33.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.243+0000 7fa6d8bf5700 1 -- 172.21.15.156:0/3383666378 shutdown_connections 2023-09-30T22:22:33.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.243+0000 7fa6d8bf5700 1 -- 172.21.15.156:0/3383666378 wait complete. 2023-09-30T22:22:33.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.244+0000 7fa6d8bf5700 1 Processor -- start 2023-09-30T22:22:33.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.244+0000 7fa6d8bf5700 1 -- start start 2023-09-30T22:22:33.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.244+0000 7fa6d8bf5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6d4099a60 0x7fa6d411ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:33.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.244+0000 7fa6d8bf5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa6d409a3d0 0x7fa6d411b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:33.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.245+0000 7fa6d8bf5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa6d412d380 0x7fa6d411b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:33.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.245+0000 7fa6d8bf5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d411e370 con 0x7fa6d4099a60 2023-09-30T22:22:33.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.245+0000 7fa6d8bf5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d411c850 con 0x7fa6d409a3d0 2023-09-30T22:22:33.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.245+0000 7fa6d8bf5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d411ccf0 con 0x7fa6d412d380 2023-09-30T22:22:33.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.245+0000 7fa6d259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6d4099a60 0x7fa6d411ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:33.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.245+0000 7fa6d1d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa6d409a3d0 0x7fa6d411b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:33.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.245+0000 7fa6d259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6d4099a60 0x7fa6d411ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36580/0 (socket says 172.21.15.156:36580) 2023-09-30T22:22:33.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.245+0000 7fa6d259c700 1 -- 172.21.15.156:0/366611075 learned_addr learned my addr 172.21.15.156:0/366611075 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:33.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.245+0000 7fa6d2d9d700 1 --2- 172.21.15.156:0/366611075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa6d412d380 0x7fa6d411b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:33.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.245+0000 7fa6d259c700 1 -- 172.21.15.156:0/366611075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa6d412d380 msgr2=0x7fa6d411b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:33.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.245+0000 7fa6d259c700 1 --2- 172.21.15.156:0/366611075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa6d412d380 0x7fa6d411b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.245+0000 7fa6d259c700 1 -- 172.21.15.156:0/366611075 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa6d409a3d0 msgr2=0x7fa6d411b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:33.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.245+0000 7fa6d259c700 1 --2- 172.21.15.156:0/366611075 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa6d409a3d0 0x7fa6d411b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.245+0000 7fa6d259c700 1 -- 172.21.15.156:0/366611075 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6cc00bd40 con 0x7fa6d4099a60 2023-09-30T22:22:33.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.245+0000 7fa6d1d9b700 1 --2- 172.21.15.156:0/366611075 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa6d409a3d0 0x7fa6d411b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:33.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.245+0000 7fa6d259c700 1 --2- 172.21.15.156:0/366611075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6d4099a60 0x7fa6d411ab30 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800ebe0 tx=0x7fa6c800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:33.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.245+0000 7fa6c2ffd700 1 -- 172.21.15.156:0/366611075 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8009740 con 0x7fa6d4099a60 2023-09-30T22:22:33.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.245+0000 7fa6c2ffd700 1 -- 172.21.15.156:0/366611075 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c8005a20 con 0x7fa6d4099a60 2023-09-30T22:22:33.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.245+0000 7fa6c2ffd700 1 -- 172.21.15.156:0/366611075 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8005db0 con 0x7fa6d4099a60 2023-09-30T22:22:33.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.245+0000 7fa6d8bf5700 1 -- 172.21.15.156:0/366611075 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c8009430 con 0x7fa6d4099a60 2023-09-30T22:22:33.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.245+0000 7fa6d8bf5700 1 -- 172.21.15.156:0/366611075 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c40094a0 con 0x7fa6d4099a60 2023-09-30T22:22:33.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.246+0000 7fa6c2ffd700 1 -- 172.21.15.156:0/366611075 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa6c800c850 con 0x7fa6d4099a60 2023-09-30T22:22:33.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.246+0000 7fa6c2ffd700 1 -- 172.21.15.156:0/366611075 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa6c803f8f0 con 0x7fa6d4099a60 2023-09-30T22:22:33.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.246+0000 7fa6d8bf5700 1 -- 172.21.15.156:0/366611075 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d404f2a0 con 0x7fa6d4099a60 2023-09-30T22:22:33.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.251+0000 7fa6c2ffd700 1 -- 172.21.15.156:0/366611075 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa6c8006030 con 0x7fa6d4099a60 2023-09-30T22:22:33.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.432+0000 7fa6d8bf5700 1 -- 172.21.15.156:0/366611075 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa6d409b3e0 con 0x7fa6d4099a60 2023-09-30T22:22:33.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.433+0000 7fa6c2ffd700 1 -- 172.21.15.156:0/366611075 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa6c802a090 con 0x7fa6d4099a60 2023-09-30T22:22:33.434 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:33.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.435+0000 7fa6d8bf5700 1 -- 172.21.15.156:0/366611075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6d4099a60 msgr2=0x7fa6d411ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:33.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.435+0000 7fa6d8bf5700 1 --2- 172.21.15.156:0/366611075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6d4099a60 0x7fa6d411ab30 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800ebe0 tx=0x7fa6c800eef0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.435+0000 7fa6d8bf5700 1 -- 172.21.15.156:0/366611075 shutdown_connections 2023-09-30T22:22:33.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.435+0000 7fa6d8bf5700 1 --2- 172.21.15.156:0/366611075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa6d412d380 0x7fa6d411b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.435+0000 7fa6d8bf5700 1 --2- 172.21.15.156:0/366611075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6d4099a60 0x7fa6d411ab30 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.435+0000 7fa6d8bf5700 1 --2- 172.21.15.156:0/366611075 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa6d409a3d0 0x7fa6d411b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.435+0000 7fa6d8bf5700 1 -- 172.21.15.156:0/366611075 >> 172.21.15.156:0/366611075 conn(0x7fa6d40a2980 msgr2=0x7fa6d409d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:33.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.435+0000 7fa6d8bf5700 1 -- 172.21.15.156:0/366611075 shutdown_connections 2023-09-30T22:22:33.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:33.435+0000 7fa6d8bf5700 1 -- 172.21.15.156:0/366611075 wait complete. 2023-09-30T22:22:33.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:34.129 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:34.188 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:34.238 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:34.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.270+0000 7f2d94f9c700 1 Processor -- start 2023-09-30T22:22:34.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.270+0000 7f2d94f9c700 1 -- start start 2023-09-30T22:22:34.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.271+0000 7f2d94f9c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d9009dec0 0x7f2d9006b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.271+0000 7f2d94f9c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d90136cb0 0x7f2d90139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.271+0000 7f2d94f9c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d9006e900 con 0x7f2d9006a770 2023-09-30T22:22:34.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.271+0000 7f2d94f9c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9009d180 con 0x7f2d90136cb0 2023-09-30T22:22:34.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.271+0000 7f2d94f9c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9009e780 con 0x7f2d9009dec0 2023-09-30T22:22:34.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.271+0000 7f2d8dd9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d9009dec0 0x7f2d9006b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.271+0000 7f2d8e59c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f2d9006a770 0x7f2d9006ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48688/0 (socket says 172.21.15.156:48688) 2023-09-30T22:22:34.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.271+0000 7f2d8e59c700 1 -- 172.21.15.156:0/3885446189 learned_addr learned my addr 172.21.15.156:0/3885446189 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:34.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.271+0000 7f2d8ed9d700 1 --2- 172.21.15.156:0/3885446189 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d90136cb0 0x7f2d90139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.272+0000 7f2d8dd9b700 1 -- 172.21.15.156:0/3885446189 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d90136cb0 msgr2=0x7f2d90139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:34.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.272+0000 7f2d8dd9b700 1 --2- 172.21.15.156:0/3885446189 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d90136cb0 0x7f2d90139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.272+0000 7f2d8dd9b700 1 -- 172.21.15.156:0/3885446189 >> v1:172.21.15.156:6789/0 conn(0x7f2d9006a770 legacy=0x7f2d9006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.272+0000 7f2d8dd9b700 1 -- 172.21.15.156:0/3885446189 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9009d3c0 con 0x7f2d9009dec0 2023-09-30T22:22:34.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.272+0000 7f2d8dd9b700 1 --2- 172.21.15.156:0/3885446189 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d9009dec0 0x7f2d9006b250 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2d84009870 tx=0x7f2d84009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49d8f36add477047 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:34.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.272+0000 7f2d8d59a700 1 -- 172.21.15.156:0/3885446189 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d84011830 con 0x7f2d9009dec0 2023-09-30T22:22:34.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.272+0000 7f2d8d59a700 1 -- 172.21.15.156:0/3885446189 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d84011990 con 0x7f2d9009dec0 2023-09-30T22:22:34.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.272+0000 7f2d8d59a700 1 -- 172.21.15.156:0/3885446189 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d84011d20 con 0x7f2d9009dec0 2023-09-30T22:22:34.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.273+0000 7f2d94f9c700 1 -- 172.21.15.156:0/3885446189 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d9009dec0 msgr2=0x7f2d9006b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.273+0000 7f2d94f9c700 1 --2- 172.21.15.156:0/3885446189 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d9009dec0 0x7f2d9006b250 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2d84009870 tx=0x7f2d84009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:34.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.273+0000 7f2d94f9c700 1 -- 172.21.15.156:0/3885446189 shutdown_connections 2023-09-30T22:22:34.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.273+0000 7f2d94f9c700 1 --2- 172.21.15.156:0/3885446189 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d90136cb0 0x7f2d90139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.273+0000 7f2d94f9c700 1 --2- 172.21.15.156:0/3885446189 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d9009dec0 0x7f2d9006b250 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.273+0000 7f2d94f9c700 1 -- 172.21.15.156:0/3885446189 >> 172.21.15.156:0/3885446189 conn(0x7f2d90099c40 msgr2=0x7f2d900a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:34.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.273+0000 7f2d94f9c700 1 -- 172.21.15.156:0/3885446189 shutdown_connections 2023-09-30T22:22:34.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.273+0000 7f2d94f9c700 1 -- 172.21.15.156:0/3885446189 wait complete. 2023-09-30T22:22:34.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.274+0000 7f2d94f9c700 1 Processor -- start 2023-09-30T22:22:34.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.274+0000 7f2d94f9c700 1 -- start start 2023-09-30T22:22:34.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.275+0000 7f2d94f9c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d9006a770 0x7f2d90134520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.275+0000 7f2d94f9c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d9009dec0 0x7f2d90134a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.275+0000 7f2d94f9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d90136cb0 0x7f2d90134fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.275+0000 7f2d94f9c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d90131230 con 0x7f2d90136cb0 2023-09-30T22:22:34.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.275+0000 7f2d94f9c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9011aca0 con 0x7f2d9009dec0 2023-09-30T22:22:34.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.275+0000 7f2d94f9c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d90071ce0 con 0x7f2d9006a770 2023-09-30T22:22:34.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.275+0000 7f2d8e59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d9006a770 0x7f2d90134520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.275+0000 7f2d8e59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d9006a770 0x7f2d90134520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55788/0 (socket says 172.21.15.156:55788) 2023-09-30T22:22:34.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.275+0000 7f2d8e59c700 1 -- 172.21.15.156:0/475821633 learned_addr learned my addr 172.21.15.156:0/475821633 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:34.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.275+0000 7f2d8ed9d700 1 --2- 172.21.15.156:0/475821633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d90136cb0 0x7f2d90134fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.275+0000 7f2d8dd9b700 1 --2- 172.21.15.156:0/475821633 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d9009dec0 0x7f2d90134a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.275+0000 7f2d8e59c700 1 -- 172.21.15.156:0/475821633 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d9009dec0 msgr2=0x7f2d90134a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.275+0000 7f2d8e59c700 1 --2- 172.21.15.156:0/475821633 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d9009dec0 0x7f2d90134a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.275+0000 7f2d8e59c700 1 -- 172.21.15.156:0/475821633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d90136cb0 msgr2=0x7f2d90134fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.275+0000 7f2d8e59c700 1 --2- 172.21.15.156:0/475821633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d90136cb0 0x7f2d90134fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.275+0000 7f2d8e59c700 1 -- 172.21.15.156:0/475821633 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d840094a0 con 0x7f2d9006a770 2023-09-30T22:22:34.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.275+0000 7f2d8ed9d700 1 --2- 172.21.15.156:0/475821633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d90136cb0 0x7f2d90134fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:34.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.276+0000 7f2d8e59c700 1 --2- 172.21.15.156:0/475821633 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d9006a770 0x7f2d90134520 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000c520 tx=0x7f2d8000c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:34.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.276+0000 7f2d7effd700 1 -- 172.21.15.156:0/475821633 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d80005d70 con 0x7f2d9006a770 2023-09-30T22:22:34.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.276+0000 7f2d7effd700 1 -- 172.21.15.156:0/475821633 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d800070d0 con 0x7f2d9006a770 2023-09-30T22:22:34.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.276+0000 7f2d7effd700 1 -- 172.21.15.156:0/475821633 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d80007440 con 0x7f2d9006a770 2023-09-30T22:22:34.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.276+0000 7f2d94f9c700 1 -- 172.21.15.156:0/475821633 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d9011a700 con 0x7f2d9006a770 2023-09-30T22:22:34.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.276+0000 7f2d94f9c700 1 -- 172.21.15.156:0/475821633 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9011b430 con 0x7f2d9006a770 2023-09-30T22:22:34.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.277+0000 7f2d7effd700 1 -- 172.21.15.156:0/475821633 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d800075a0 con 0x7f2d9006a770 2023-09-30T22:22:34.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.277+0000 7f2d7effd700 1 -- 172.21.15.156:0/475821633 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2d8003ea20 con 0x7f2d9006a770 2023-09-30T22:22:34.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.277+0000 7f2d94f9c700 1 -- 172.21.15.156:0/475821633 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d9004f2a0 con 0x7f2d9006a770 2023-09-30T22:22:34.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.282+0000 7f2d7effd700 1 -- 172.21.15.156:0/475821633 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d80019b40 con 0x7f2d9006a770 2023-09-30T22:22:34.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.322+0000 7fa147966700 1 Processor -- start 2023-09-30T22:22:34.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.323+0000 7fa147966700 1 -- start start 2023-09-30T22:22:34.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.323+0000 7fa147966700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa140133ad0 0x7fa140133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.323+0000 7fa147966700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa140130bc0 0x7fa14013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.323+0000 7fa147966700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa14006b2d0 con 0x7fa1401300a0 2023-09-30T22:22:34.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.323+0000 7fa147966700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa140133610 con 0x7fa140133ad0 2023-09-30T22:22:34.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.323+0000 7fa147966700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa14009a500 con 0x7fa140130bc0 2023-09-30T22:22:34.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.324+0000 7fa145f03700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa140130bc0 0x7fa14013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.324+0000 7fa145f03700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa140130bc0 0x7fa14013b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55798/0 (socket says 172.21.15.156:55798) 2023-09-30T22:22:34.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.324+0000 7fa144f01700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fa1401300a0 0x7fa1401304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48690/0 (socket says 172.21.15.156:48690) 2023-09-30T22:22:34.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.324+0000 7fa145f03700 1 -- 172.21.15.156:0/3855906397 learned_addr learned my addr 172.21.15.156:0/3855906397 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:34.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.324+0000 7fa145702700 1 --2- 172.21.15.156:0/3855906397 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa140133ad0 0x7fa140133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.324+0000 7fa137fff700 1 -- 172.21.15.156:0/3855906397 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1694315563 0 0) 0x7fa14006b2d0 con 0x7fa1401300a0 2023-09-30T22:22:34.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.324+0000 7fa137fff700 1 -- 172.21.15.156:0/3855906397 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa12c0035b0 con 0x7fa1401300a0 2023-09-30T22:22:34.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.324+0000 7fa145702700 1 -- 172.21.15.156:0/3855906397 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa140130bc0 msgr2=0x7fa14013b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:34.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.324+0000 7fa145702700 1 --2- 172.21.15.156:0/3855906397 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa140130bc0 0x7fa14013b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.324+0000 7fa145702700 1 -- 172.21.15.156:0/3855906397 >> v1:172.21.15.156:6789/0 conn(0x7fa1401300a0 legacy=0x7fa1401304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.324+0000 7fa145702700 1 -- 172.21.15.156:0/3855906397 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1401338b0 con 0x7fa140133ad0 2023-09-30T22:22:34.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.324+0000 7fa145f03700 1 --2- 172.21.15.156:0/3855906397 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa140130bc0 0x7fa14013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:34.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.324+0000 7fa145702700 1 --2- 172.21.15.156:0/3855906397 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa140133ad0 0x7fa140133ea0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa13c009870 tx=0x7fa13c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f93e2938db305e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:34.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.324+0000 7fa137fff700 1 -- 172.21.15.156:0/3855906397 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13c011830 con 0x7fa140133ad0 2023-09-30T22:22:34.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.324+0000 7fa137fff700 1 -- 172.21.15.156:0/3855906397 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa13c011990 con 0x7fa140133ad0 2023-09-30T22:22:34.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.324+0000 7fa137fff700 1 -- 172.21.15.156:0/3855906397 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13c011d20 con 0x7fa140133ad0 2023-09-30T22:22:34.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.325+0000 7fa147966700 1 -- 172.21.15.156:0/3855906397 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa140133ad0 msgr2=0x7fa140133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.325+0000 7fa147966700 1 --2- 172.21.15.156:0/3855906397 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa140133ad0 0x7fa140133ea0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa13c009870 tx=0x7fa13c009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:34.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.325+0000 7fa147966700 1 -- 172.21.15.156:0/3855906397 shutdown_connections 2023-09-30T22:22:34.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.325+0000 7fa147966700 1 --2- 172.21.15.156:0/3855906397 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa140133ad0 0x7fa140133ea0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.325+0000 7fa147966700 1 --2- 172.21.15.156:0/3855906397 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa140130bc0 0x7fa14013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.325+0000 7fa147966700 1 -- 172.21.15.156:0/3855906397 >> 172.21.15.156:0/3855906397 conn(0x7fa140099c40 msgr2=0x7fa1400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:34.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.325+0000 7fa147966700 1 -- 172.21.15.156:0/3855906397 shutdown_connections 2023-09-30T22:22:34.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.325+0000 7fa147966700 1 -- 172.21.15.156:0/3855906397 wait complete. 2023-09-30T22:22:34.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.326+0000 7fa147966700 1 Processor -- start 2023-09-30T22:22:34.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.326+0000 7fa147966700 1 -- start start 2023-09-30T22:22:34.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.327+0000 7fa147966700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1401300a0 0x7fa14011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.327+0000 7fa147966700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa140130bc0 0x7fa14011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.327+0000 7fa147966700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa140133ad0 0x7fa14011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.327+0000 7fa147966700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14012dd00 con 0x7fa140130bc0 2023-09-30T22:22:34.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.327+0000 7fa147966700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa140072330 con 0x7fa140133ad0 2023-09-30T22:22:34.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.327+0000 7fa147966700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa14011ffb0 con 0x7fa1401300a0 2023-09-30T22:22:34.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.327+0000 7fa145f03700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa140133ad0 0x7fa14011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.327+0000 7fa145f03700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa140133ad0 0x7fa14011e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33234/0 (socket says 172.21.15.156:33234) 2023-09-30T22:22:34.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.327+0000 7fa145f03700 1 -- 172.21.15.156:0/316573803 learned_addr learned my addr 172.21.15.156:0/316573803 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:34.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.327+0000 7fa144f01700 1 --2- 172.21.15.156:0/316573803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa140130bc0 0x7fa14011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.327+0000 7fa145702700 1 --2- 172.21.15.156:0/316573803 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1401300a0 0x7fa14011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.327+0000 7fa144f01700 1 -- 172.21.15.156:0/316573803 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1401300a0 msgr2=0x7fa14011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.327+0000 7fa144f01700 1 --2- 172.21.15.156:0/316573803 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1401300a0 0x7fa14011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.327+0000 7fa144f01700 1 -- 172.21.15.156:0/316573803 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa140133ad0 msgr2=0x7fa14011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.327+0000 7fa144f01700 1 --2- 172.21.15.156:0/316573803 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa140133ad0 0x7fa14011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.327+0000 7fa144f01700 1 -- 172.21.15.156:0/316573803 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa138009b30 con 0x7fa140130bc0 2023-09-30T22:22:34.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.327+0000 7fa145f03700 1 --2- 172.21.15.156:0/316573803 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa140133ad0 0x7fa14011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:34.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.327+0000 7fa144f01700 1 --2- 172.21.15.156:0/316573803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa140130bc0 0x7fa14011df80 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fa13000c430 tx=0x7fa13000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:34.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.327+0000 7fa135ffb700 1 -- 172.21.15.156:0/316573803 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa130004a70 con 0x7fa140130bc0 2023-09-30T22:22:34.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.327+0000 7fa135ffb700 1 -- 172.21.15.156:0/316573803 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa130004bf0 con 0x7fa140130bc0 2023-09-30T22:22:34.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.327+0000 7fa135ffb700 1 -- 172.21.15.156:0/316573803 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1300070d0 con 0x7fa140130bc0 2023-09-30T22:22:34.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.327+0000 7fa147966700 1 -- 172.21.15.156:0/316573803 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa13c0094a0 con 0x7fa140130bc0 2023-09-30T22:22:34.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.328+0000 7fa147966700 1 -- 172.21.15.156:0/316573803 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa140120c40 con 0x7fa140130bc0 2023-09-30T22:22:34.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.328+0000 7fa135ffb700 1 -- 172.21.15.156:0/316573803 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa130007230 con 0x7fa140130bc0 2023-09-30T22:22:34.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.329+0000 7fa135ffb700 1 -- 172.21.15.156:0/316573803 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa13003eb90 con 0x7fa140130bc0 2023-09-30T22:22:34.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.329+0000 7fa147966700 1 -- 172.21.15.156:0/316573803 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa14012d2f0 con 0x7fa140130bc0 2023-09-30T22:22:34.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.333+0000 7fa135ffb700 1 -- 172.21.15.156:0/316573803 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa13001c970 con 0x7fa140130bc0 2023-09-30T22:22:34.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.367+0000 7f3a8bc9e700 1 Processor -- start 2023-09-30T22:22:34.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.367+0000 7f3a8bc9e700 1 -- start start 2023-09-30T22:22:34.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.368+0000 7f3a8bc9e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3a840a0a70 0x7f3a840a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.368+0000 7f3a8bc9e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3a84134120 0x7f3a8413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.368+0000 7f3a8bc9e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a8409dc00 con 0x7f3a840a1380 2023-09-30T22:22:34.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.368+0000 7f3a8bc9e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a8409ea90 con 0x7f3a840a0a70 2023-09-30T22:22:34.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.368+0000 7f3a8bc9e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8409dec0 con 0x7f3a84134120 2023-09-30T22:22:34.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.368+0000 7f3a89a3a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3a840a0a70 0x7f3a840a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.368+0000 7f3a89a3a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3a840a0a70 0x7f3a840a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36608/0 (socket says 172.21.15.156:36608) 2023-09-30T22:22:34.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.368+0000 7f3a89a3a700 1 -- 172.21.15.156:0/1918158767 learned_addr learned my addr 172.21.15.156:0/1918158767 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:34.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.368+0000 7f3a8a23b700 1 --2- 172.21.15.156:0/1918158767 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3a84134120 0x7f3a8413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.368+0000 7f3a89a3a700 1 -- 172.21.15.156:0/1918158767 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3a84134120 msgr2=0x7f3a8413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:34.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.368+0000 7f3a89a3a700 1 --2- 172.21.15.156:0/1918158767 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3a84134120 0x7f3a8413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.368+0000 7f3a89a3a700 1 -- 172.21.15.156:0/1918158767 >> v1:172.21.15.156:6789/0 conn(0x7f3a840a1380 legacy=0x7f3a84133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.368+0000 7f3a88a38700 1 -- 172.21.15.156:0/1918158767 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1756089215 0 0) 0x7f3a8409dc00 con 0x7f3a840a1380 2023-09-30T22:22:34.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.368+0000 7f3a89a3a700 1 -- 172.21.15.156:0/1918158767 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8409e6a0 con 0x7f3a840a0a70 2023-09-30T22:22:34.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.368+0000 7f3a8a23b700 1 --2- 172.21.15.156:0/1918158767 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3a84134120 0x7f3a8413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:34.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.368+0000 7f3a89a3a700 1 --2- 172.21.15.156:0/1918158767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a840a0a70 0x7f3a840a0e40 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f3a800098f0 tx=0x7f3a80009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4fb4507a4f8359f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:34.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.369+0000 7f3a88a38700 1 -- 172.21.15.156:0/1918158767 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a80011830 con 0x7f3a840a0a70 2023-09-30T22:22:34.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.369+0000 7f3a88a38700 1 -- 172.21.15.156:0/1918158767 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a80011990 con 0x7f3a840a0a70 2023-09-30T22:22:34.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.369+0000 7f3a88a38700 1 -- 172.21.15.156:0/1918158767 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a80011d20 con 0x7f3a840a0a70 2023-09-30T22:22:34.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.369+0000 7f3a8bc9e700 1 -- 172.21.15.156:0/1918158767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a840a0a70 msgr2=0x7f3a840a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.369+0000 7f3a8bc9e700 1 --2- 172.21.15.156:0/1918158767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a840a0a70 0x7f3a840a0e40 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f3a800098f0 tx=0x7f3a80009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:34.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.369+0000 7f3a8bc9e700 1 -- 172.21.15.156:0/1918158767 shutdown_connections 2023-09-30T22:22:34.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.369+0000 7f3a8bc9e700 1 --2- 172.21.15.156:0/1918158767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a840a0a70 0x7f3a840a0e40 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.369+0000 7f3a8bc9e700 1 --2- 172.21.15.156:0/1918158767 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3a84134120 0x7f3a8413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.369+0000 7f3a8bc9e700 1 -- 172.21.15.156:0/1918158767 >> 172.21.15.156:0/1918158767 conn(0x7f3a840a6610 msgr2=0x7f3a840a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:34.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.369+0000 7f3a8bc9e700 1 -- 172.21.15.156:0/1918158767 shutdown_connections 2023-09-30T22:22:34.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.369+0000 7f3a8bc9e700 1 -- 172.21.15.156:0/1918158767 wait complete. 2023-09-30T22:22:34.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.371+0000 7f3a8bc9e700 1 Processor -- start 2023-09-30T22:22:34.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.371+0000 7f3a8bc9e700 1 -- start start 2023-09-30T22:22:34.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.371+0000 7f3a8bc9e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3a840a0a70 0x7f3a84122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.371+0000 7f3a8bc9e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3a840a1380 0x7f3a84122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.371+0000 7f3a8bc9e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a84134120 0x7f3a84123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.371+0000 7f3a8bc9e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a84133300 con 0x7f3a84134120 2023-09-30T22:22:34.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.371+0000 7f3a8bc9e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a84125920 con 0x7f3a840a0a70 2023-09-30T22:22:34.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.371+0000 7f3a8bc9e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a84124310 con 0x7f3a840a1380 2023-09-30T22:22:34.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.371+0000 7f3a89a3a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3a840a0a70 0x7f3a84122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.371+0000 7f3a89a3a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3a840a0a70 0x7f3a84122700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33244/0 (socket says 172.21.15.156:33244) 2023-09-30T22:22:34.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.371+0000 7f3a89a3a700 1 -- 172.21.15.156:0/3396864216 learned_addr learned my addr 172.21.15.156:0/3396864216 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:34.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.371+0000 7f3a89239700 1 --2- 172.21.15.156:0/3396864216 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3a840a1380 0x7f3a84122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.371+0000 7f3a8a23b700 1 --2- 172.21.15.156:0/3396864216 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a84134120 0x7f3a84123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.372+0000 7f3a89a3a700 1 -- 172.21.15.156:0/3396864216 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3a840a1380 msgr2=0x7f3a84122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.372+0000 7f3a89a3a700 1 --2- 172.21.15.156:0/3396864216 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3a840a1380 0x7f3a84122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.372+0000 7f3a89a3a700 1 -- 172.21.15.156:0/3396864216 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a84134120 msgr2=0x7f3a84123180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.372+0000 7f3a89a3a700 1 --2- 172.21.15.156:0/3396864216 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a84134120 0x7f3a84123180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.372+0000 7f3a89a3a700 1 -- 172.21.15.156:0/3396864216 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7c009a70 con 0x7f3a840a0a70 2023-09-30T22:22:34.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.372+0000 7f3a8a23b700 1 --2- 172.21.15.156:0/3396864216 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a84134120 0x7f3a84123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:34.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.372+0000 7f3a89a3a700 1 --2- 172.21.15.156:0/3396864216 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3a840a0a70 0x7f3a84122700 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009c40 tx=0x7f3a80004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:34.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.372+0000 7f3a7a7fc700 1 -- 172.21.15.156:0/3396864216 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a80004340 con 0x7f3a840a0a70 2023-09-30T22:22:34.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.372+0000 7f3a7a7fc700 1 -- 172.21.15.156:0/3396864216 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8001f070 con 0x7f3a840a0a70 2023-09-30T22:22:34.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.372+0000 7f3a8bc9e700 1 -- 172.21.15.156:0/3396864216 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a80009550 con 0x7f3a840a0a70 2023-09-30T22:22:34.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.372+0000 7f3a7a7fc700 1 -- 172.21.15.156:0/3396864216 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a800036a0 con 0x7f3a840a0a70 2023-09-30T22:22:34.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.372+0000 7f3a8bc9e700 1 -- 172.21.15.156:0/3396864216 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a84125c80 con 0x7f3a840a0a70 2023-09-30T22:22:34.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.373+0000 7f3a7a7fc700 1 -- 172.21.15.156:0/3396864216 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a80021030 con 0x7f3a840a0a70 2023-09-30T22:22:34.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.373+0000 7f3a8bc9e700 1 -- 172.21.15.156:0/3396864216 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a8404f2a0 con 0x7f3a840a0a70 2023-09-30T22:22:34.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.373+0000 7f3a7a7fc700 1 -- 172.21.15.156:0/3396864216 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3a800409e0 con 0x7f3a840a0a70 2023-09-30T22:22:34.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.378+0000 7f3a7a7fc700 1 -- 172.21.15.156:0/3396864216 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a800199a0 con 0x7f3a840a0a70 2023-09-30T22:22:34.449 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:34.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.488+0000 7f2d94f9c700 1 -- 172.21.15.156:0/475821633 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2d9009e3a0 con 0x7f2d9006a770 2023-09-30T22:22:34.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.489+0000 7f2d7effd700 1 -- 172.21.15.156:0/475821633 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d80017030 con 0x7f2d9006a770 2023-09-30T22:22:34.489 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:34.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.491+0000 7f2d94f9c700 1 -- 172.21.15.156:0/475821633 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d9006a770 msgr2=0x7f2d90134520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.491+0000 7f2d94f9c700 1 --2- 172.21.15.156:0/475821633 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d9006a770 0x7f2d90134520 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000c520 tx=0x7f2d8000c830 comp rx=0 tx=0).stop 2023-09-30T22:22:34.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.491+0000 7f2d94f9c700 1 -- 172.21.15.156:0/475821633 shutdown_connections 2023-09-30T22:22:34.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.491+0000 7f2d94f9c700 1 --2- 172.21.15.156:0/475821633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d90136cb0 0x7f2d90134fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.491+0000 7f2d94f9c700 1 --2- 172.21.15.156:0/475821633 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d9006a770 0x7f2d90134520 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.491+0000 7f2d94f9c700 1 --2- 172.21.15.156:0/475821633 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d9009dec0 0x7f2d90134a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.491+0000 7f2d94f9c700 1 -- 172.21.15.156:0/475821633 >> 172.21.15.156:0/475821633 conn(0x7f2d90099c40 msgr2=0x7f2d90138c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:34.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.492+0000 7f2d94f9c700 1 -- 172.21.15.156:0/475821633 shutdown_connections 2023-09-30T22:22:34.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.494+0000 7f2d94f9c700 1 -- 172.21.15.156:0/475821633 wait complete. 2023-09-30T22:22:34.507 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:34.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.531+0000 7fa147966700 1 -- 172.21.15.156:0/316573803 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa14004f2a0 con 0x7fa140130bc0 2023-09-30T22:22:34.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.531+0000 7fa135ffb700 1 -- 172.21.15.156:0/316573803 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa13001a350 con 0x7fa140130bc0 2023-09-30T22:22:34.532 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:34.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.534+0000 7fa147966700 1 -- 172.21.15.156:0/316573803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa140130bc0 msgr2=0x7fa14011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.534+0000 7fa147966700 1 --2- 172.21.15.156:0/316573803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa140130bc0 0x7fa14011df80 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fa13000c430 tx=0x7fa13000c740 comp rx=0 tx=0).stop 2023-09-30T22:22:34.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.534+0000 7fa147966700 1 -- 172.21.15.156:0/316573803 shutdown_connections 2023-09-30T22:22:34.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.534+0000 7fa147966700 1 --2- 172.21.15.156:0/316573803 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa140133ad0 0x7fa14011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.534+0000 7fa147966700 1 --2- 172.21.15.156:0/316573803 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1401300a0 0x7fa14011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.534+0000 7fa147966700 1 --2- 172.21.15.156:0/316573803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa140130bc0 0x7fa14011df80 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.534+0000 7fa147966700 1 -- 172.21.15.156:0/316573803 >> 172.21.15.156:0/316573803 conn(0x7fa140099c40 msgr2=0x7fa140131fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:34.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.534+0000 7fa147966700 1 -- 172.21.15.156:0/316573803 shutdown_connections 2023-09-30T22:22:34.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.534+0000 7fa147966700 1 -- 172.21.15.156:0/316573803 wait complete. 2023-09-30T22:22:34.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:34.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.573+0000 7f3a8bc9e700 1 -- 172.21.15.156:0/3396864216 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3a84072980 con 0x7f3a840a0a70 2023-09-30T22:22:34.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.574+0000 7f3a7a7fc700 1 -- 172.21.15.156:0/3396864216 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a80015030 con 0x7f3a840a0a70 2023-09-30T22:22:34.575 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:34.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.576+0000 7f3a8bc9e700 1 -- 172.21.15.156:0/3396864216 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3a840a0a70 msgr2=0x7f3a84122700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.576+0000 7f3a8bc9e700 1 --2- 172.21.15.156:0/3396864216 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3a840a0a70 0x7f3a84122700 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009c40 tx=0x7f3a80004750 comp rx=0 tx=0).stop 2023-09-30T22:22:34.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.576+0000 7f3a8bc9e700 1 -- 172.21.15.156:0/3396864216 shutdown_connections 2023-09-30T22:22:34.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.576+0000 7f3a8bc9e700 1 --2- 172.21.15.156:0/3396864216 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a84134120 0x7f3a84123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.576+0000 7f3a8bc9e700 1 --2- 172.21.15.156:0/3396864216 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3a840a0a70 0x7f3a84122700 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.576+0000 7f3a8bc9e700 1 --2- 172.21.15.156:0/3396864216 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3a840a1380 0x7f3a84122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.576+0000 7f3a8bc9e700 1 -- 172.21.15.156:0/3396864216 >> 172.21.15.156:0/3396864216 conn(0x7f3a840a6610 msgr2=0x7f3a840a5050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:34.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.576+0000 7f3a8bc9e700 1 -- 172.21.15.156:0/3396864216 shutdown_connections 2023-09-30T22:22:34.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.576+0000 7f3a8bc9e700 1 -- 172.21.15.156:0/3396864216 wait complete. 2023-09-30T22:22:34.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.578+0000 7f71bdb07700 1 Processor -- start 2023-09-30T22:22:34.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.578+0000 7f71bdb07700 1 -- start start 2023-09-30T22:22:34.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.579+0000 7f71bdb07700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f71b8136960 0x7f71b8138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.579+0000 7f71bdb07700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f71b8139280 0x7f71b813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.579+0000 7f71bdb07700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b806b2d0 con 0x7f71b8133ad0 2023-09-30T22:22:34.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.579+0000 7f71bdb07700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b81345b0 con 0x7f71b8139280 2023-09-30T22:22:34.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.579+0000 7f71bdb07700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71b8133610 con 0x7f71b8136960 2023-09-30T22:22:34.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.579+0000 7f71b7fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f71b8139280 0x7f71b813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.579+0000 7f71b77fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f71b8133ad0 0x7f71b8133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48708/0 (socket says 172.21.15.156:48708) 2023-09-30T22:22:34.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.579+0000 7f71b7fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f71b8139280 0x7f71b813b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36620/0 (socket says 172.21.15.156:36620) 2023-09-30T22:22:34.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.579+0000 7f71b77fe700 1 -- 172.21.15.156:0/792595356 learned_addr learned my addr 172.21.15.156:0/792595356 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:34.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.579+0000 7f71b7fff700 1 -- 172.21.15.156:0/792595356 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f71b8136960 msgr2=0x7f71b8138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:34.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.579+0000 7f71b7fff700 1 --2- 172.21.15.156:0/792595356 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f71b8136960 0x7f71b8138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.579+0000 7f71b7fff700 1 -- 172.21.15.156:0/792595356 >> v1:172.21.15.156:6789/0 conn(0x7f71b8133ad0 legacy=0x7f71b8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.579+0000 7f71b7fff700 1 -- 172.21.15.156:0/792595356 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b809a500 con 0x7f71b8139280 2023-09-30T22:22:34.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.579+0000 7f71b67fc700 1 -- 172.21.15.156:0/792595356 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2847029243 0 0) 0x7f71b806b2d0 con 0x7f71b8133ad0 2023-09-30T22:22:34.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.579+0000 7f71b7fff700 1 --2- 172.21.15.156:0/792595356 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71b8139280 0x7f71b813b660 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009dc0 tx=0x7f71b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca6e42bcf043d9a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:34.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.579+0000 7f71b67fc700 1 -- 172.21.15.156:0/792595356 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b000e070 con 0x7f71b8139280 2023-09-30T22:22:34.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.580+0000 7f71b67fc700 1 -- 172.21.15.156:0/792595356 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b000bb90 con 0x7f71b8139280 2023-09-30T22:22:34.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.580+0000 7f71b67fc700 1 -- 172.21.15.156:0/792595356 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b0012430 con 0x7f71b8139280 2023-09-30T22:22:34.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.580+0000 7f71bdb07700 1 -- 172.21.15.156:0/792595356 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71b8139280 msgr2=0x7f71b813b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.580+0000 7f71bdb07700 1 --2- 172.21.15.156:0/792595356 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71b8139280 0x7f71b813b660 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009dc0 tx=0x7f71b000b330 comp rx=0 tx=0).stop 2023-09-30T22:22:34.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.580+0000 7f71bdb07700 1 -- 172.21.15.156:0/792595356 shutdown_connections 2023-09-30T22:22:34.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.580+0000 7f71bdb07700 1 --2- 172.21.15.156:0/792595356 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71b8139280 0x7f71b813b660 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.580+0000 7f71bdb07700 1 --2- 172.21.15.156:0/792595356 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f71b8136960 0x7f71b8138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.580+0000 7f71bdb07700 1 -- 172.21.15.156:0/792595356 >> 172.21.15.156:0/792595356 conn(0x7f71b8099c40 msgr2=0x7f71b80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:34.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.580+0000 7f71bdb07700 1 -- 172.21.15.156:0/792595356 shutdown_connections 2023-09-30T22:22:34.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.580+0000 7f71bdb07700 1 -- 172.21.15.156:0/792595356 wait complete. 2023-09-30T22:22:34.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.581+0000 7f71bdb07700 1 Processor -- start 2023-09-30T22:22:34.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.581+0000 7f71bdb07700 1 -- start start 2023-09-30T22:22:34.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.582+0000 7f71bdb07700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f71b8133ad0 0x7f71b80711c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.582+0000 7f71bdb07700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71b8136960 0x7f71b8071700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.582+0000 7f71bdb07700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f71b8139280 0x7f71b8071c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.582+0000 7f71bdb07700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b8070300 con 0x7f71b8136960 2023-09-30T22:22:34.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.582+0000 7f71bdb07700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b8072270 con 0x7f71b8139280 2023-09-30T22:22:34.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.582+0000 7f71bdb07700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71b809f390 con 0x7f71b8133ad0 2023-09-30T22:22:34.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.582+0000 7f71b77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f71b8133ad0 0x7f71b80711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.582+0000 7f71b7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f71b8139280 0x7f71b8071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.582+0000 7f71b7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f71b8139280 0x7f71b8071c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33248/0 (socket says 172.21.15.156:33248) 2023-09-30T22:22:34.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.582+0000 7f71b77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f71b8133ad0 0x7f71b80711c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55846/0 (socket says 172.21.15.156:55846) 2023-09-30T22:22:34.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.582+0000 7f71b7fff700 1 -- 172.21.15.156:0/2161629624 learned_addr learned my addr 172.21.15.156:0/2161629624 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:34.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.582+0000 7f71b6ffd700 1 --2- 172.21.15.156:0/2161629624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71b8136960 0x7f71b8071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.582+0000 7f71b77fe700 1 -- 172.21.15.156:0/2161629624 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f71b8139280 msgr2=0x7f71b8071c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.582+0000 7f71b77fe700 1 --2- 172.21.15.156:0/2161629624 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f71b8139280 0x7f71b8071c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.582+0000 7f71b77fe700 1 -- 172.21.15.156:0/2161629624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71b8136960 msgr2=0x7f71b8071700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.582+0000 7f71b77fe700 1 --2- 172.21.15.156:0/2161629624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71b8136960 0x7f71b8071700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.582+0000 7f71b77fe700 1 -- 172.21.15.156:0/2161629624 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b0009a70 con 0x7f71b8133ad0 2023-09-30T22:22:34.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.582+0000 7f71b7fff700 1 --2- 172.21.15.156:0/2161629624 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f71b8139280 0x7f71b8071c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:34.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.582+0000 7f71b6ffd700 1 --2- 172.21.15.156:0/2161629624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71b8136960 0x7f71b8071700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:34.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.582+0000 7f71b77fe700 1 --2- 172.21.15.156:0/2161629624 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f71b8133ad0 0x7f71b80711c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f71a800c3c0 tx=0x7f71a800c6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:34.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.583+0000 7f719ffff700 1 -- 172.21.15.156:0/2161629624 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8004a70 con 0x7f71b8133ad0 2023-09-30T22:22:34.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.583+0000 7f71bdb07700 1 -- 172.21.15.156:0/2161629624 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b8070040 con 0x7f71b8133ad0 2023-09-30T22:22:34.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.583+0000 7f719ffff700 1 -- 172.21.15.156:0/2161629624 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a8004bf0 con 0x7f71b8133ad0 2023-09-30T22:22:34.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.583+0000 7f719ffff700 1 -- 172.21.15.156:0/2161629624 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a80070d0 con 0x7f71b8133ad0 2023-09-30T22:22:34.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.583+0000 7f71bdb07700 1 -- 172.21.15.156:0/2161629624 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b8070d70 con 0x7f71b8133ad0 2023-09-30T22:22:34.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.584+0000 7f719ffff700 1 -- 172.21.15.156:0/2161629624 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f71a8007230 con 0x7f71b8133ad0 2023-09-30T22:22:34.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.584+0000 7f719ffff700 1 -- 172.21.15.156:0/2161629624 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f71a803f210 con 0x7f71b8133ad0 2023-09-30T22:22:34.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.584+0000 7f71bdb07700 1 -- 172.21.15.156:0/2161629624 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b804f2a0 con 0x7f71b8133ad0 2023-09-30T22:22:34.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.589+0000 7f719ffff700 1 -- 172.21.15.156:0/2161629624 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f71a80074e0 con 0x7f71b8133ad0 2023-09-30T22:22:34.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:34.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.776+0000 7f71bdb07700 1 -- 172.21.15.156:0/2161629624 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f71b809f0f0 con 0x7f71b8133ad0 2023-09-30T22:22:34.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.777+0000 7f719ffff700 1 -- 172.21.15.156:0/2161629624 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f71a801b340 con 0x7f71b8133ad0 2023-09-30T22:22:34.777 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:34.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.779+0000 7f71bdb07700 1 -- 172.21.15.156:0/2161629624 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f71b8133ad0 msgr2=0x7f71b80711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.779+0000 7f71bdb07700 1 --2- 172.21.15.156:0/2161629624 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f71b8133ad0 0x7f71b80711c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f71a800c3c0 tx=0x7f71a800c6d0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.779+0000 7f71bdb07700 1 -- 172.21.15.156:0/2161629624 shutdown_connections 2023-09-30T22:22:34.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.779+0000 7f71bdb07700 1 --2- 172.21.15.156:0/2161629624 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f71b8139280 0x7f71b8071c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.779+0000 7f71bdb07700 1 --2- 172.21.15.156:0/2161629624 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f71b8133ad0 0x7f71b80711c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.779+0000 7f71bdb07700 1 --2- 172.21.15.156:0/2161629624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71b8136960 0x7f71b8071700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.779+0000 7f71bdb07700 1 -- 172.21.15.156:0/2161629624 >> 172.21.15.156:0/2161629624 conn(0x7f71b8099c40 msgr2=0x7f71b8134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:34.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.779+0000 7f71bdb07700 1 -- 172.21.15.156:0/2161629624 shutdown_connections 2023-09-30T22:22:34.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:34.779+0000 7f71bdb07700 1 -- 172.21.15.156:0/2161629624 wait complete. 2023-09-30T22:22:34.792 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:35.508 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:35.548 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:35.591 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:35.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.652+0000 7f6e424bb700 1 Processor -- start 2023-09-30T22:22:35.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.652+0000 7f6e424bb700 1 -- start start 2023-09-30T22:22:35.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.653+0000 7f6e424bb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e3c133ad0 0x7f6e3c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.653+0000 7f6e424bb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e3c1300a0 0x7f6e3c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.653+0000 7f6e424bb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6e3c1309f0 0x7f6e3c13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.653+0000 7f6e424bb700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e3c06b2d0 con 0x7f6e3c1309f0 2023-09-30T22:22:35.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.653+0000 7f6e424bb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c133610 con 0x7f6e3c133ad0 2023-09-30T22:22:35.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.653+0000 7f6e424bb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c09a500 con 0x7f6e3c1300a0 2023-09-30T22:22:35.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.653+0000 7f6e3bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e3c133ad0 0x7f6e3c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.653+0000 7f6e3b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e3c1300a0 0x7f6e3c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.653+0000 7f6e3bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e3c133ad0 0x7f6e3c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33264/0 (socket says 172.21.15.156:33264) 2023-09-30T22:22:35.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.653+0000 7f6e3bfff700 1 -- 172.21.15.156:0/2855247640 learned_addr learned my addr 172.21.15.156:0/2855247640 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:35.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.653+0000 7f6e40a58700 1 --2- 172.21.15.156:0/2855247640 >> v2:172.21.15.156:3300/0 conn(0x7f6e3c1309f0 0x7f6e3c13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.653+0000 7f6e3bfff700 1 -- 172.21.15.156:0/2855247640 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e3c1300a0 msgr2=0x7f6e3c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:35.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.653+0000 7f6e3bfff700 1 --2- 172.21.15.156:0/2855247640 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e3c1300a0 0x7f6e3c1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.653+0000 7f6e3bfff700 1 -- 172.21.15.156:0/2855247640 >> v2:172.21.15.156:3300/0 conn(0x7f6e3c1309f0 msgr2=0x7f6e3c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:35.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.653+0000 7f6e3bfff700 1 --2- 172.21.15.156:0/2855247640 >> v2:172.21.15.156:3300/0 conn(0x7f6e3c1309f0 0x7f6e3c13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.653+0000 7f6e3bfff700 1 -- 172.21.15.156:0/2855247640 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3c1338b0 con 0x7f6e3c133ad0 2023-09-30T22:22:35.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.653+0000 7f6e40a58700 1 --2- 172.21.15.156:0/2855247640 >> v2:172.21.15.156:3300/0 conn(0x7f6e3c1309f0 0x7f6e3c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:35.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.653+0000 7f6e3b7fe700 1 --2- 172.21.15.156:0/2855247640 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e3c1300a0 0x7f6e3c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:35.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.654+0000 7f6e3bfff700 1 --2- 172.21.15.156:0/2855247640 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e3c133ad0 0x7f6e3c133ea0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0098f0 tx=0x7f6e2c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a75e9bfc4b2dc3b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:35.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.654+0000 7f6e3affd700 1 -- 172.21.15.156:0/2855247640 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c011830 con 0x7f6e3c133ad0 2023-09-30T22:22:35.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.654+0000 7f6e3affd700 1 -- 172.21.15.156:0/2855247640 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2c011990 con 0x7f6e3c133ad0 2023-09-30T22:22:35.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.654+0000 7f6e3affd700 1 -- 172.21.15.156:0/2855247640 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c011d20 con 0x7f6e3c133ad0 2023-09-30T22:22:35.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.654+0000 7f6e424bb700 1 -- 172.21.15.156:0/2855247640 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e3c133ad0 msgr2=0x7f6e3c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.654+0000 7f6e424bb700 1 --2- 172.21.15.156:0/2855247640 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e3c133ad0 0x7f6e3c133ea0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0098f0 tx=0x7f6e2c009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:35.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.655+0000 7f6e424bb700 1 -- 172.21.15.156:0/2855247640 shutdown_connections 2023-09-30T22:22:35.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.655+0000 7f6e424bb700 1 --2- 172.21.15.156:0/2855247640 >> v2:172.21.15.156:3300/0 conn(0x7f6e3c1309f0 0x7f6e3c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.655+0000 7f6e424bb700 1 --2- 172.21.15.156:0/2855247640 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e3c133ad0 0x7f6e3c133ea0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.655+0000 7f6e424bb700 1 --2- 172.21.15.156:0/2855247640 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e3c1300a0 0x7f6e3c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.655+0000 7f6e424bb700 1 -- 172.21.15.156:0/2855247640 >> 172.21.15.156:0/2855247640 conn(0x7f6e3c099c40 msgr2=0x7f6e3c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:35.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.655+0000 7f6e424bb700 1 -- 172.21.15.156:0/2855247640 shutdown_connections 2023-09-30T22:22:35.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.655+0000 7f6e424bb700 1 -- 172.21.15.156:0/2855247640 wait complete. 2023-09-30T22:22:35.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.655+0000 7f6e424bb700 1 Processor -- start 2023-09-30T22:22:35.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.656+0000 7f6e424bb700 1 -- start start 2023-09-30T22:22:35.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.656+0000 7f6e424bb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e3c1300a0 0x7f6e3c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.656+0000 7f6e424bb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e3c1309f0 0x7f6e3c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.656+0000 7f6e424bb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e3c133ad0 0x7f6e3c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.656+0000 7f6e424bb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c11fde0 con 0x7f6e3c1300a0 2023-09-30T22:22:35.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.656+0000 7f6e424bb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c1200c0 con 0x7f6e3c133ad0 2023-09-30T22:22:35.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.656+0000 7f6e424bb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c0a2ea0 con 0x7f6e3c1309f0 2023-09-30T22:22:35.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.656+0000 7f6e3b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e3c1309f0 0x7f6e3c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.656+0000 7f6e3bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e3c1300a0 0x7f6e3c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.656+0000 7f6e3b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e3c1309f0 0x7f6e3c11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55862/0 (socket says 172.21.15.156:55862) 2023-09-30T22:22:35.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.656+0000 7f6e3b7fe700 1 -- 172.21.15.156:0/1926741720 learned_addr learned my addr 172.21.15.156:0/1926741720 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:35.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.656+0000 7f6e40a58700 1 --2- 172.21.15.156:0/1926741720 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e3c133ad0 0x7f6e3c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.657+0000 7f6e3bfff700 1 -- 172.21.15.156:0/1926741720 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e3c1309f0 msgr2=0x7f6e3c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.657+0000 7f6e3bfff700 1 --2- 172.21.15.156:0/1926741720 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e3c1309f0 0x7f6e3c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.657+0000 7f6e3bfff700 1 -- 172.21.15.156:0/1926741720 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e3c133ad0 msgr2=0x7f6e3c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.657+0000 7f6e3bfff700 1 --2- 172.21.15.156:0/1926741720 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e3c133ad0 0x7f6e3c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.657+0000 7f6e3bfff700 1 -- 172.21.15.156:0/1926741720 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e300094a0 con 0x7f6e3c1300a0 2023-09-30T22:22:35.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.657+0000 7f6e3bfff700 1 --2- 172.21.15.156:0/1926741720 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e3c1300a0 0x7f6e3c11da40 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c016000 tx=0x7f6e2c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:35.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.657+0000 7f6e38ff9700 1 -- 172.21.15.156:0/1926741720 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c004450 con 0x7f6e3c1300a0 2023-09-30T22:22:35.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.657+0000 7f6e38ff9700 1 -- 172.21.15.156:0/1926741720 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2c0045b0 con 0x7f6e3c1300a0 2023-09-30T22:22:35.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.657+0000 7f6e38ff9700 1 -- 172.21.15.156:0/1926741720 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c0038c0 con 0x7f6e3c1300a0 2023-09-30T22:22:35.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.657+0000 7f6e424bb700 1 -- 172.21.15.156:0/1926741720 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e34009a70 con 0x7f6e3c1300a0 2023-09-30T22:22:35.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.657+0000 7f6e424bb700 1 -- 172.21.15.156:0/1926741720 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e2c009550 con 0x7f6e3c1300a0 2023-09-30T22:22:35.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.658+0000 7f6e38ff9700 1 -- 172.21.15.156:0/1926741720 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6e2c003a20 con 0x7f6e3c1300a0 2023-09-30T22:22:35.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.658+0000 7f6e424bb700 1 -- 172.21.15.156:0/1926741720 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e3c09cb20 con 0x7f6e3c1300a0 2023-09-30T22:22:35.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.658+0000 7f6e38ff9700 1 -- 172.21.15.156:0/1926741720 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6e2c040250 con 0x7f6e3c1300a0 2023-09-30T22:22:35.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.663+0000 7f6e38ff9700 1 -- 172.21.15.156:0/1926741720 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6e2c01a420 con 0x7f6e3c1300a0 2023-09-30T22:22:35.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.687+0000 7fa7350cf700 1 Processor -- start 2023-09-30T22:22:35.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.687+0000 7fa7350cf700 1 -- start start 2023-09-30T22:22:35.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.687+0000 7fa7350cf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7300a1550 0x7fa730138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.687+0000 7fa7350cf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa730139200 0x7fa73013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.687+0000 7fa7350cf700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73009e9d0 con 0x7fa7300a0a70 2023-09-30T22:22:35.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.687+0000 7fa7350cf700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73009dc00 con 0x7fa730139200 2023-09-30T22:22:35.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.687+0000 7fa7350cf700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa73009dec0 con 0x7fa7300a1550 2023-09-30T22:22:35.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.688+0000 7fa72e59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7300a1550 0x7fa730138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.688+0000 7fa72e59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7300a1550 0x7fa730138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55868/0 (socket says 172.21.15.156:55868) 2023-09-30T22:22:35.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.688+0000 7fa72e59c700 1 -- 172.21.15.156:0/2509311797 learned_addr learned my addr 172.21.15.156:0/2509311797 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:35.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.688+0000 7fa72f59e700 1 --2- 172.21.15.156:0/2509311797 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa730139200 0x7fa73013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.688+0000 7fa72f59e700 1 -- 172.21.15.156:0/2509311797 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7300a1550 msgr2=0x7fa730138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:35.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.688+0000 7fa72f59e700 1 --2- 172.21.15.156:0/2509311797 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7300a1550 0x7fa730138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.688+0000 7fa72f59e700 1 -- 172.21.15.156:0/2509311797 >> v1:172.21.15.156:6789/0 conn(0x7fa7300a0a70 legacy=0x7fa7300a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.688+0000 7fa72dd9b700 1 -- 172.21.15.156:0/2509311797 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2767305049 0 0) 0x7fa73009e9d0 con 0x7fa7300a0a70 2023-09-30T22:22:35.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.688+0000 7fa72f59e700 1 -- 172.21.15.156:0/2509311797 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73009e6a0 con 0x7fa730139200 2023-09-30T22:22:35.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.688+0000 7fa72e59c700 1 --2- 172.21.15.156:0/2509311797 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7300a1550 0x7fa730138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:35.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.688+0000 7fa72f59e700 1 --2- 172.21.15.156:0/2509311797 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa730139200 0x7fa73013b5e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa728009dc0 tx=0x7fa72800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=786981c84beae137 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:35.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.688+0000 7fa72dd9b700 1 -- 172.21.15.156:0/2509311797 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72800e070 con 0x7fa730139200 2023-09-30T22:22:35.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.688+0000 7fa72dd9b700 1 -- 172.21.15.156:0/2509311797 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72800bb20 con 0x7fa730139200 2023-09-30T22:22:35.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.688+0000 7fa72dd9b700 1 -- 172.21.15.156:0/2509311797 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728012430 con 0x7fa730139200 2023-09-30T22:22:35.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.689+0000 7fa7350cf700 1 -- 172.21.15.156:0/2509311797 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa730139200 msgr2=0x7fa73013b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.689+0000 7fa7350cf700 1 --2- 172.21.15.156:0/2509311797 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa730139200 0x7fa73013b5e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa728009dc0 tx=0x7fa72800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:35.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.689+0000 7fa7350cf700 1 -- 172.21.15.156:0/2509311797 shutdown_connections 2023-09-30T22:22:35.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.689+0000 7fa7350cf700 1 --2- 172.21.15.156:0/2509311797 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa730139200 0x7fa73013b5e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.689+0000 7fa7350cf700 1 --2- 172.21.15.156:0/2509311797 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7300a1550 0x7fa730138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.689+0000 7fa7350cf700 1 -- 172.21.15.156:0/2509311797 >> 172.21.15.156:0/2509311797 conn(0x7fa7300a6610 msgr2=0x7fa7300a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:35.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.689+0000 7fa7350cf700 1 -- 172.21.15.156:0/2509311797 shutdown_connections 2023-09-30T22:22:35.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.689+0000 7fa7350cf700 1 -- 172.21.15.156:0/2509311797 wait complete. 2023-09-30T22:22:35.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.690+0000 7fa7350cf700 1 Processor -- start 2023-09-30T22:22:35.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.690+0000 7fa7350cf700 1 -- start start 2023-09-30T22:22:35.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.691+0000 7fa7350cf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7300a0a70 0x7fa73011e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.691+0000 7fa7350cf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7300a1550 0x7fa73011edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.691+0000 7fa7350cf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa730139200 0x7fa73011f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.691+0000 7fa7350cf700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7300a03e0 con 0x7fa7300a0a70 2023-09-30T22:22:35.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.691+0000 7fa7350cf700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7301220d0 con 0x7fa730139200 2023-09-30T22:22:35.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.691+0000 7fa7350cf700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7301205b0 con 0x7fa7300a1550 2023-09-30T22:22:35.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.691+0000 7fa72e59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7300a1550 0x7fa73011edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.691+0000 7fa72f59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa730139200 0x7fa73011f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.691+0000 7fa72f59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa730139200 0x7fa73011f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33276/0 (socket says 172.21.15.156:33276) 2023-09-30T22:22:35.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.691+0000 7fa72e59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7300a1550 0x7fa73011edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55872/0 (socket says 172.21.15.156:55872) 2023-09-30T22:22:35.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.691+0000 7fa72f59e700 1 -- 172.21.15.156:0/1177517400 learned_addr learned my addr 172.21.15.156:0/1177517400 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:35.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.691+0000 7fa72ed9d700 1 --2- 172.21.15.156:0/1177517400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7300a0a70 0x7fa73011e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.692+0000 7fa72e59c700 1 -- 172.21.15.156:0/1177517400 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa730139200 msgr2=0x7fa73011f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.692+0000 7fa72e59c700 1 --2- 172.21.15.156:0/1177517400 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa730139200 0x7fa73011f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.692+0000 7fa72e59c700 1 -- 172.21.15.156:0/1177517400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7300a0a70 msgr2=0x7fa73011e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.692+0000 7fa72e59c700 1 --2- 172.21.15.156:0/1177517400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7300a0a70 0x7fa73011e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.692+0000 7fa72e59c700 1 -- 172.21.15.156:0/1177517400 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa724009550 con 0x7fa7300a1550 2023-09-30T22:22:35.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.692+0000 7fa72f59e700 1 --2- 172.21.15.156:0/1177517400 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa730139200 0x7fa73011f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:35.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.692+0000 7fa72ed9d700 1 --2- 172.21.15.156:0/1177517400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7300a0a70 0x7fa73011e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:35.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.692+0000 7fa72e59c700 1 --2- 172.21.15.156:0/1177517400 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7300a1550 0x7fa73011edd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa72400e9a0 tx=0x7fa72400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:35.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.692+0000 7fa7177fe700 1 -- 172.21.15.156:0/1177517400 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa724004030 con 0x7fa7300a1550 2023-09-30T22:22:35.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.692+0000 7fa7177fe700 1 -- 172.21.15.156:0/1177517400 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa724004190 con 0x7fa7300a1550 2023-09-30T22:22:35.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.692+0000 7fa7350cf700 1 -- 172.21.15.156:0/1177517400 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa728009a70 con 0x7fa7300a1550 2023-09-30T22:22:35.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.692+0000 7fa7177fe700 1 -- 172.21.15.156:0/1177517400 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa724004520 con 0x7fa7300a1550 2023-09-30T22:22:35.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.692+0000 7fa7350cf700 1 -- 172.21.15.156:0/1177517400 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73009d390 con 0x7fa7300a1550 2023-09-30T22:22:35.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.693+0000 7fa7177fe700 1 -- 172.21.15.156:0/1177517400 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa7240036a0 con 0x7fa7300a1550 2023-09-30T22:22:35.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.693+0000 7fa7350cf700 1 -- 172.21.15.156:0/1177517400 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa730122c00 con 0x7fa7300a1550 2023-09-30T22:22:35.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.693+0000 7fa7177fe700 1 -- 172.21.15.156:0/1177517400 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa72403f8e0 con 0x7fa7300a1550 2023-09-30T22:22:35.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.698+0000 7fa7177fe700 1 -- 172.21.15.156:0/1177517400 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa724011db0 con 0x7fa7300a1550 2023-09-30T22:22:35.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.726+0000 7f3a8dfdc700 1 Processor -- start 2023-09-30T22:22:35.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.726+0000 7f3a8dfdc700 1 -- start start 2023-09-30T22:22:35.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.727+0000 7f3a8dfdc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3a8809ad40 0x7f3a88133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.727+0000 7f3a8dfdc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3a881343d0 0x7f3a880a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.727+0000 7f3a8dfdc700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a8809b110 con 0x7f3a88133f70 2023-09-30T22:22:35.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.727+0000 7f3a8dfdc700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a880a3b60 con 0x7f3a8809ad40 2023-09-30T22:22:35.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.727+0000 7f3a8dfdc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a88134850 con 0x7f3a881343d0 2023-09-30T22:22:35.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.727+0000 7f3a87fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3a881343d0 0x7f3a880a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.727+0000 7f3a86ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f3a88133f70 0x7f3a880a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48722/0 (socket says 172.21.15.156:48722) 2023-09-30T22:22:35.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.727+0000 7f3a86ffd700 1 -- 172.21.15.156:0/1170403718 learned_addr learned my addr 172.21.15.156:0/1170403718 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:35.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.727+0000 7f3a877fe700 1 --2- 172.21.15.156:0/1170403718 >> v2:172.21.15.156:3300/0 conn(0x7f3a8809ad40 0x7f3a88133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.727+0000 7f3a87fff700 1 -- 172.21.15.156:0/1170403718 >> v2:172.21.15.156:3300/0 conn(0x7f3a8809ad40 msgr2=0x7f3a88133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:35.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.727+0000 7f3a87fff700 1 --2- 172.21.15.156:0/1170403718 >> v2:172.21.15.156:3300/0 conn(0x7f3a8809ad40 0x7f3a88133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.727+0000 7f3a867fc700 1 -- 172.21.15.156:0/1170403718 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950353936 0 0) 0x7f3a8809b110 con 0x7f3a88133f70 2023-09-30T22:22:35.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.727+0000 7f3a87fff700 1 -- 172.21.15.156:0/1170403718 >> v1:172.21.15.156:6789/0 conn(0x7f3a88133f70 legacy=0x7f3a880a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.727+0000 7f3a87fff700 1 -- 172.21.15.156:0/1170403718 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a880a2fa0 con 0x7f3a881343d0 2023-09-30T22:22:35.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.728+0000 7f3a87fff700 1 --2- 172.21.15.156:0/1170403718 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3a881343d0 0x7f3a880a1180 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3a78009d90 tx=0x7f3a7800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1fd85b96eb9fc02 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:35.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.728+0000 7f3a867fc700 1 -- 172.21.15.156:0/1170403718 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7800e070 con 0x7f3a881343d0 2023-09-30T22:22:35.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.728+0000 7f3a867fc700 1 -- 172.21.15.156:0/1170403718 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7800bb20 con 0x7f3a881343d0 2023-09-30T22:22:35.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.728+0000 7f3a867fc700 1 -- 172.21.15.156:0/1170403718 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78012430 con 0x7f3a881343d0 2023-09-30T22:22:35.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.729+0000 7f3a8dfdc700 1 -- 172.21.15.156:0/1170403718 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3a881343d0 msgr2=0x7f3a880a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.729+0000 7f3a8dfdc700 1 --2- 172.21.15.156:0/1170403718 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3a881343d0 0x7f3a880a1180 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3a78009d90 tx=0x7f3a7800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:35.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.729+0000 7f3a8dfdc700 1 -- 172.21.15.156:0/1170403718 shutdown_connections 2023-09-30T22:22:35.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.729+0000 7f3a8dfdc700 1 --2- 172.21.15.156:0/1170403718 >> v2:172.21.15.156:3300/0 conn(0x7f3a8809ad40 0x7f3a88133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.729+0000 7f3a8dfdc700 1 --2- 172.21.15.156:0/1170403718 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3a881343d0 0x7f3a880a1180 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.729+0000 7f3a8dfdc700 1 -- 172.21.15.156:0/1170403718 >> 172.21.15.156:0/1170403718 conn(0x7f3a88099c40 msgr2=0x7f3a8806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:35.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.729+0000 7f3a8dfdc700 1 -- 172.21.15.156:0/1170403718 shutdown_connections 2023-09-30T22:22:35.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.729+0000 7f3a8dfdc700 1 -- 172.21.15.156:0/1170403718 wait complete. 2023-09-30T22:22:35.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.730+0000 7f3a8dfdc700 1 Processor -- start 2023-09-30T22:22:35.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.730+0000 7f3a8dfdc700 1 -- start start 2023-09-30T22:22:35.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.731+0000 7f3a8dfdc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a8809ad40 0x7f3a8811f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.731+0000 7f3a8dfdc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3a88133f70 0x7f3a8811f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.731+0000 7f3a8dfdc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3a881343d0 0x7f3a881c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.731+0000 7f3a8dfdc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a88133430 con 0x7f3a8809ad40 2023-09-30T22:22:35.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.731+0000 7f3a8dfdc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8811ef80 con 0x7f3a88133f70 2023-09-30T22:22:35.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.731+0000 7f3a8dfdc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a881206b0 con 0x7f3a881343d0 2023-09-30T22:22:35.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.731+0000 7f3a86ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3a88133f70 0x7f3a8811f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.731+0000 7f3a87fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3a881343d0 0x7f3a881c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.731+0000 7f3a86ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3a88133f70 0x7f3a8811f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33292/0 (socket says 172.21.15.156:33292) 2023-09-30T22:22:35.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.731+0000 7f3a87fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3a881343d0 0x7f3a881c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55892/0 (socket says 172.21.15.156:55892) 2023-09-30T22:22:35.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.731+0000 7f3a86ffd700 1 -- 172.21.15.156:0/3793359991 learned_addr learned my addr 172.21.15.156:0/3793359991 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:35.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.731+0000 7f3a877fe700 1 --2- 172.21.15.156:0/3793359991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a8809ad40 0x7f3a8811f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.732+0000 7f3a87fff700 1 -- 172.21.15.156:0/3793359991 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3a88133f70 msgr2=0x7f3a8811f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.732+0000 7f3a87fff700 1 --2- 172.21.15.156:0/3793359991 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3a88133f70 0x7f3a8811f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.732+0000 7f3a87fff700 1 -- 172.21.15.156:0/3793359991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a8809ad40 msgr2=0x7f3a8811f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.732+0000 7f3a87fff700 1 --2- 172.21.15.156:0/3793359991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a8809ad40 0x7f3a8811f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.732+0000 7f3a87fff700 1 -- 172.21.15.156:0/3793359991 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a78009a70 con 0x7f3a881343d0 2023-09-30T22:22:35.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.732+0000 7f3a86ffd700 1 --2- 172.21.15.156:0/3793359991 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3a88133f70 0x7f3a8811f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:35.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.732+0000 7f3a87fff700 1 --2- 172.21.15.156:0/3793359991 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3a881343d0 0x7f3a881c8120 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3a78016000 tx=0x7f3a78004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:35.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.732+0000 7f3a7ffff700 1 -- 172.21.15.156:0/3793359991 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78012430 con 0x7f3a881343d0 2023-09-30T22:22:35.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.732+0000 7f3a7ffff700 1 -- 172.21.15.156:0/3793359991 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a78020070 con 0x7f3a881343d0 2023-09-30T22:22:35.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.732+0000 7f3a8dfdc700 1 -- 172.21.15.156:0/3793359991 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a88122020 con 0x7f3a881343d0 2023-09-30T22:22:35.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.732+0000 7f3a7ffff700 1 -- 172.21.15.156:0/3793359991 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78004280 con 0x7f3a881343d0 2023-09-30T22:22:35.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.732+0000 7f3a8dfdc700 1 -- 172.21.15.156:0/3793359991 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a88121320 con 0x7f3a881343d0 2023-09-30T22:22:35.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.733+0000 7f3a7ffff700 1 -- 172.21.15.156:0/3793359991 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a780043e0 con 0x7f3a881343d0 2023-09-30T22:22:35.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.733+0000 7f3a8dfdc700 1 -- 172.21.15.156:0/3793359991 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a8804f2a0 con 0x7f3a881343d0 2023-09-30T22:22:35.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.733+0000 7f3a7ffff700 1 -- 172.21.15.156:0/3793359991 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3a78022070 con 0x7f3a881343d0 2023-09-30T22:22:35.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.738+0000 7f3a7ffff700 1 -- 172.21.15.156:0/3793359991 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a78011d60 con 0x7f3a881343d0 2023-09-30T22:22:35.793 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:35.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.865+0000 7f6e424bb700 1 -- 172.21.15.156:0/1926741720 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6e3c11ff20 con 0x7f6e3c1300a0 2023-09-30T22:22:35.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.865+0000 7f6e38ff9700 1 -- 172.21.15.156:0/1926741720 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6e3c11ff20 con 0x7f6e3c1300a0 2023-09-30T22:22:35.866 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:35.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.867+0000 7f6e424bb700 1 -- 172.21.15.156:0/1926741720 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e3c1300a0 msgr2=0x7f6e3c11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.867+0000 7f6e424bb700 1 --2- 172.21.15.156:0/1926741720 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e3c1300a0 0x7f6e3c11da40 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c016000 tx=0x7f6e2c004750 comp rx=0 tx=0).stop 2023-09-30T22:22:35.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.867+0000 7f6e424bb700 1 -- 172.21.15.156:0/1926741720 shutdown_connections 2023-09-30T22:22:35.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.867+0000 7f6e424bb700 1 --2- 172.21.15.156:0/1926741720 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e3c133ad0 0x7f6e3c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.867+0000 7f6e424bb700 1 --2- 172.21.15.156:0/1926741720 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e3c1300a0 0x7f6e3c11da40 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.867+0000 7f6e424bb700 1 --2- 172.21.15.156:0/1926741720 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e3c1309f0 0x7f6e3c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.867+0000 7f6e424bb700 1 -- 172.21.15.156:0/1926741720 >> 172.21.15.156:0/1926741720 conn(0x7f6e3c099c40 msgr2=0x7f6e3c12f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:35.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.867+0000 7f6e424bb700 1 -- 172.21.15.156:0/1926741720 shutdown_connections 2023-09-30T22:22:35.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.867+0000 7f6e424bb700 1 -- 172.21.15.156:0/1926741720 wait complete. 2023-09-30T22:22:35.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:35.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.895+0000 7fa7350cf700 1 -- 172.21.15.156:0/1177517400 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa73004f2a0 con 0x7fa7300a1550 2023-09-30T22:22:35.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.895+0000 7fa7177fe700 1 -- 172.21.15.156:0/1177517400 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa724011350 con 0x7fa7300a1550 2023-09-30T22:22:35.896 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:35.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.897+0000 7fa7350cf700 1 -- 172.21.15.156:0/1177517400 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7300a1550 msgr2=0x7fa73011edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.897+0000 7fa7350cf700 1 --2- 172.21.15.156:0/1177517400 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7300a1550 0x7fa73011edd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa72400e9a0 tx=0x7fa72400ecb0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.897+0000 7fa7350cf700 1 -- 172.21.15.156:0/1177517400 shutdown_connections 2023-09-30T22:22:35.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.897+0000 7fa7350cf700 1 --2- 172.21.15.156:0/1177517400 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa730139200 0x7fa73011f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.897+0000 7fa7350cf700 1 --2- 172.21.15.156:0/1177517400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7300a0a70 0x7fa73011e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.897+0000 7fa7350cf700 1 --2- 172.21.15.156:0/1177517400 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7300a1550 0x7fa73011edd0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.897+0000 7fa7350cf700 1 -- 172.21.15.156:0/1177517400 >> 172.21.15.156:0/1177517400 conn(0x7fa7300a6610 msgr2=0x7fa730136c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:35.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.897+0000 7fa7350cf700 1 -- 172.21.15.156:0/1177517400 shutdown_connections 2023-09-30T22:22:35.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.897+0000 7fa7350cf700 1 -- 172.21.15.156:0/1177517400 wait complete. 2023-09-30T22:22:35.910 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:35.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.919+0000 7f6783eff700 1 Processor -- start 2023-09-30T22:22:35.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.919+0000 7f6783eff700 1 -- start start 2023-09-30T22:22:35.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.919+0000 7f6783eff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f677c133ad0 0x7f677c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.919+0000 7f6783eff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f677c1300a0 0x7f677c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.919+0000 7f6783eff700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f677c06b2d0 con 0x7f677c1309f0 2023-09-30T22:22:35.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.919+0000 7f6783eff700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f677c133610 con 0x7f677c133ad0 2023-09-30T22:22:35.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.919+0000 7f6783eff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677c09a500 con 0x7f677c1300a0 2023-09-30T22:22:35.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.920+0000 7f678149a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f677c1300a0 0x7f677c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.920+0000 7f6781c9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f677c133ad0 0x7f677c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.920+0000 7f678149a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f677c1300a0 0x7f677c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33304/0 (socket says 172.21.15.156:33304) 2023-09-30T22:22:35.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.920+0000 7f678149a700 1 -- 172.21.15.156:0/2887208628 learned_addr learned my addr 172.21.15.156:0/2887208628 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:35.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.920+0000 7f6781c9b700 1 -- 172.21.15.156:0/2887208628 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f677c1300a0 msgr2=0x7f677c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:35.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.920+0000 7f6781c9b700 1 --2- 172.21.15.156:0/2887208628 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f677c1300a0 0x7f677c1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.920+0000 7f6781c9b700 1 -- 172.21.15.156:0/2887208628 >> v1:172.21.15.156:6789/0 conn(0x7f677c1309f0 legacy=0x7f677c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.920+0000 7f6781c9b700 1 -- 172.21.15.156:0/2887208628 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677c1338b0 con 0x7f677c133ad0 2023-09-30T22:22:35.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.920+0000 7f6780c99700 1 -- 172.21.15.156:0/2887208628 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2207210662 0 0) 0x7f677c06b2d0 con 0x7f677c1309f0 2023-09-30T22:22:35.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.920+0000 7f6781c9b700 1 --2- 172.21.15.156:0/2887208628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f677c133ad0 0x7f677c133ea0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f6778009840 tx=0x7f6778009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915a8028d3c0677e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:35.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.920+0000 7f6780c99700 1 -- 172.21.15.156:0/2887208628 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6778011830 con 0x7f677c133ad0 2023-09-30T22:22:35.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.920+0000 7f6780c99700 1 -- 172.21.15.156:0/2887208628 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6778011990 con 0x7f677c133ad0 2023-09-30T22:22:35.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.920+0000 7f6780c99700 1 -- 172.21.15.156:0/2887208628 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6778011d20 con 0x7f677c133ad0 2023-09-30T22:22:35.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.921+0000 7f6783eff700 1 -- 172.21.15.156:0/2887208628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f677c133ad0 msgr2=0x7f677c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.921+0000 7f6783eff700 1 --2- 172.21.15.156:0/2887208628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f677c133ad0 0x7f677c133ea0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f6778009840 tx=0x7f6778009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:35.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.921+0000 7f6783eff700 1 -- 172.21.15.156:0/2887208628 shutdown_connections 2023-09-30T22:22:35.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.921+0000 7f6783eff700 1 --2- 172.21.15.156:0/2887208628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f677c133ad0 0x7f677c133ea0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.921+0000 7f6783eff700 1 --2- 172.21.15.156:0/2887208628 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f677c1300a0 0x7f677c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.921+0000 7f6783eff700 1 -- 172.21.15.156:0/2887208628 >> 172.21.15.156:0/2887208628 conn(0x7f677c099c40 msgr2=0x7f677c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:35.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.921+0000 7f6783eff700 1 -- 172.21.15.156:0/2887208628 shutdown_connections 2023-09-30T22:22:35.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.921+0000 7f6783eff700 1 -- 172.21.15.156:0/2887208628 wait complete. 2023-09-30T22:22:35.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.922+0000 7f6783eff700 1 Processor -- start 2023-09-30T22:22:35.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.922+0000 7f6783eff700 1 -- start start 2023-09-30T22:22:35.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.922+0000 7f6783eff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f677c1300a0 0x7f677c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.922+0000 7f6783eff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f677c1309f0 0x7f677c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.922+0000 7f6783eff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f677c133ad0 0x7f677c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.922+0000 7f6783eff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677c120b10 con 0x7f677c133ad0 2023-09-30T22:22:35.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.922+0000 7f6783eff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677c11f530 con 0x7f677c1300a0 2023-09-30T22:22:35.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.922+0000 7f6783eff700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f677c0a3350 con 0x7f677c1309f0 2023-09-30T22:22:35.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.922+0000 7f6781c9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f677c1300a0 0x7f677c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.922+0000 7f6781c9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f677c1300a0 0x7f677c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33318/0 (socket says 172.21.15.156:33318) 2023-09-30T22:22:35.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.922+0000 7f6781c9b700 1 -- 172.21.15.156:0/199735712 learned_addr learned my addr 172.21.15.156:0/199735712 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:35.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.922+0000 7f678149a700 1 --2- 172.21.15.156:0/199735712 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f677c1309f0 0x7f677c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.922+0000 7f678249c700 1 --2- 172.21.15.156:0/199735712 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f677c133ad0 0x7f677c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.923+0000 7f678149a700 1 -- 172.21.15.156:0/199735712 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f677c1300a0 msgr2=0x7f677c11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.923+0000 7f678149a700 1 --2- 172.21.15.156:0/199735712 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f677c1300a0 0x7f677c11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.923+0000 7f678149a700 1 -- 172.21.15.156:0/199735712 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f677c133ad0 msgr2=0x7f677c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.923+0000 7f678149a700 1 --2- 172.21.15.156:0/199735712 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f677c133ad0 0x7f677c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.923+0000 7f678149a700 1 -- 172.21.15.156:0/199735712 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67780094a0 con 0x7f677c1309f0 2023-09-30T22:22:35.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.923+0000 7f678249c700 1 --2- 172.21.15.156:0/199735712 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f677c133ad0 0x7f677c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:35.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.923+0000 7f6781c9b700 1 --2- 172.21.15.156:0/199735712 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f677c1300a0 0x7f677c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:35.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.923+0000 7f678149a700 1 --2- 172.21.15.156:0/199735712 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f677c1309f0 0x7f677c11df80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f676c00e870 tx=0x7f676c00eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:35.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.923+0000 7f67727fc700 1 -- 172.21.15.156:0/199735712 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c013680 con 0x7f677c1309f0 2023-09-30T22:22:35.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.923+0000 7f67727fc700 1 -- 172.21.15.156:0/199735712 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676c0137e0 con 0x7f677c1309f0 2023-09-30T22:22:35.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.923+0000 7f6783eff700 1 -- 172.21.15.156:0/199735712 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f677c12dd00 con 0x7f677c1309f0 2023-09-30T22:22:35.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.923+0000 7f67727fc700 1 -- 172.21.15.156:0/199735712 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c013b70 con 0x7f677c1309f0 2023-09-30T22:22:35.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.923+0000 7f6783eff700 1 -- 172.21.15.156:0/199735712 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f677c11f8a0 con 0x7f677c1309f0 2023-09-30T22:22:35.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.924+0000 7f67727fc700 1 -- 172.21.15.156:0/199735712 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f676c013cd0 con 0x7f677c1309f0 2023-09-30T22:22:35.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.924+0000 7f67727fc700 1 -- 172.21.15.156:0/199735712 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f676c03f530 con 0x7f677c1309f0 2023-09-30T22:22:35.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.924+0000 7f6783eff700 1 -- 172.21.15.156:0/199735712 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f677c04f2a0 con 0x7f677c1309f0 2023-09-30T22:22:35.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.933+0000 7f67727fc700 1 -- 172.21.15.156:0/199735712 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f676c01be10 con 0x7f677c1309f0 2023-09-30T22:22:35.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.942+0000 7f3a8dfdc700 1 -- 172.21.15.156:0/3793359991 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3a880729d0 con 0x7f3a881343d0 2023-09-30T22:22:35.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.942+0000 7f3a7ffff700 1 -- 172.21.15.156:0/3793359991 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a78011b80 con 0x7f3a881343d0 2023-09-30T22:22:35.943 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:35.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.944+0000 7f3a8dfdc700 1 -- 172.21.15.156:0/3793359991 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3a881343d0 msgr2=0x7f3a881c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.944+0000 7f3a8dfdc700 1 --2- 172.21.15.156:0/3793359991 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3a881343d0 0x7f3a881c8120 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3a78016000 tx=0x7f3a78004ad0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.944+0000 7f3a8dfdc700 1 -- 172.21.15.156:0/3793359991 shutdown_connections 2023-09-30T22:22:35.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.944+0000 7f3a8dfdc700 1 --2- 172.21.15.156:0/3793359991 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3a881343d0 0x7f3a881c8120 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.944+0000 7f3a8dfdc700 1 --2- 172.21.15.156:0/3793359991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a8809ad40 0x7f3a8811f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.944+0000 7f3a8dfdc700 1 --2- 172.21.15.156:0/3793359991 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3a88133f70 0x7f3a8811f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.944+0000 7f3a8dfdc700 1 -- 172.21.15.156:0/3793359991 >> 172.21.15.156:0/3793359991 conn(0x7f3a88099c40 msgr2=0x7f3a880a61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:35.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.945+0000 7f3a8dfdc700 1 -- 172.21.15.156:0/3793359991 shutdown_connections 2023-09-30T22:22:35.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:35.945+0000 7f3a8dfdc700 1 -- 172.21.15.156:0/3793359991 wait complete. 2023-09-30T22:22:35.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:36.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:36.117+0000 7f6783eff700 1 -- 172.21.15.156:0/199735712 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f677c06c3b0 con 0x7f677c1309f0 2023-09-30T22:22:36.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:36.118+0000 7f67727fc700 1 -- 172.21.15.156:0/199735712 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f676c017020 con 0x7f677c1309f0 2023-09-30T22:22:36.119 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:36.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:36.120+0000 7f6783eff700 1 -- 172.21.15.156:0/199735712 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f677c1309f0 msgr2=0x7f677c11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:36.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:36.120+0000 7f6783eff700 1 --2- 172.21.15.156:0/199735712 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f677c1309f0 0x7f677c11df80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f676c00e870 tx=0x7f676c00eb80 comp rx=0 tx=0).stop 2023-09-30T22:22:36.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:36.120+0000 7f6783eff700 1 -- 172.21.15.156:0/199735712 shutdown_connections 2023-09-30T22:22:36.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:36.120+0000 7f6783eff700 1 --2- 172.21.15.156:0/199735712 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f677c133ad0 0x7f677c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:36.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:36.120+0000 7f6783eff700 1 --2- 172.21.15.156:0/199735712 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f677c1300a0 0x7f677c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:36.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:36.120+0000 7f6783eff700 1 --2- 172.21.15.156:0/199735712 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f677c1309f0 0x7f677c11df80 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:36.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:36.120+0000 7f6783eff700 1 -- 172.21.15.156:0/199735712 >> 172.21.15.156:0/199735712 conn(0x7f677c099c40 msgr2=0x7f677c12e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:36.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:36.120+0000 7f6783eff700 1 -- 172.21.15.156:0/199735712 shutdown_connections 2023-09-30T22:22:36.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:36.120+0000 7f6783eff700 1 -- 172.21.15.156:0/199735712 wait complete. 2023-09-30T22:22:36.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:36.882 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:36.911 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:36.958 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:37.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.023+0000 7fdaa1c06700 1 Processor -- start 2023-09-30T22:22:37.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.024+0000 7fdaa1c06700 1 -- start start 2023-09-30T22:22:37.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.024+0000 7fdaa1c06700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fda9c09d860 0x7fda9c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:37.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.024+0000 7fdaa1c06700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda9c130eb0 0x7fda9c138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:37.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.024+0000 7fdaa1c06700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9c09aaa0 con 0x7fda9c09e170 2023-09-30T22:22:37.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.024+0000 7fdaa1c06700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9c09f870 con 0x7fda9c09d860 2023-09-30T22:22:37.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.024+0000 7fdaa1c06700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c09b360 con 0x7fda9c130eb0 2023-09-30T22:22:37.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.025+0000 7fda9b7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fda9c09d860 0x7fda9c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:37.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.025+0000 7fda9b7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fda9c09d860 0x7fda9c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36732/0 (socket says 172.21.15.156:36732) 2023-09-30T22:22:37.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.025+0000 7fda9b7fe700 1 -- 172.21.15.156:0/1418157147 learned_addr learned my addr 172.21.15.156:0/1418157147 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:37.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.025+0000 7fda9affd700 1 --1- 172.21.15.156:0/1418157147 >> v1:172.21.15.156:6789/0 conn(0x7fda9c09e170 0x7fda9c1307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48744/0 (socket says 172.21.15.156:48744) 2023-09-30T22:22:37.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.025+0000 7fda9bfff700 1 --2- 172.21.15.156:0/1418157147 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda9c130eb0 0x7fda9c138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:37.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.025+0000 7fda9a7fc700 1 -- 172.21.15.156:0/1418157147 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 472172916 0 0) 0x7fda9c09aaa0 con 0x7fda9c09e170 2023-09-30T22:22:37.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.025+0000 7fda9a7fc700 1 -- 172.21.15.156:0/1418157147 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda840035b0 con 0x7fda9c09e170 2023-09-30T22:22:37.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.025+0000 7fda9b7fe700 1 -- 172.21.15.156:0/1418157147 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda9c130eb0 msgr2=0x7fda9c138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:37.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.025+0000 7fda9b7fe700 1 --2- 172.21.15.156:0/1418157147 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda9c130eb0 0x7fda9c138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.025+0000 7fda9b7fe700 1 -- 172.21.15.156:0/1418157147 >> v1:172.21.15.156:6789/0 conn(0x7fda9c09e170 legacy=0x7fda9c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:37.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.025+0000 7fda9b7fe700 1 -- 172.21.15.156:0/1418157147 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c09b620 con 0x7fda9c09d860 2023-09-30T22:22:37.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.025+0000 7fda9b7fe700 1 --2- 172.21.15.156:0/1418157147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda9c09d860 0x7fda9c09dc30 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0098f0 tx=0x7fda8c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c666ce7c7564c17d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:37.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.025+0000 7fda9a7fc700 1 -- 172.21.15.156:0/1418157147 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c011830 con 0x7fda9c09d860 2023-09-30T22:22:37.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.025+0000 7fda9a7fc700 1 -- 172.21.15.156:0/1418157147 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c011990 con 0x7fda9c09d860 2023-09-30T22:22:37.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.025+0000 7fda9a7fc700 1 -- 172.21.15.156:0/1418157147 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c011d20 con 0x7fda9c09d860 2023-09-30T22:22:37.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.026+0000 7fdaa1c06700 1 -- 172.21.15.156:0/1418157147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda9c09d860 msgr2=0x7fda9c09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:37.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.026+0000 7fdaa1c06700 1 --2- 172.21.15.156:0/1418157147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda9c09d860 0x7fda9c09dc30 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0098f0 tx=0x7fda8c009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:37.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.026+0000 7fdaa1c06700 1 -- 172.21.15.156:0/1418157147 shutdown_connections 2023-09-30T22:22:37.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.026+0000 7fdaa1c06700 1 --2- 172.21.15.156:0/1418157147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda9c09d860 0x7fda9c09dc30 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.026+0000 7fdaa1c06700 1 --2- 172.21.15.156:0/1418157147 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda9c130eb0 0x7fda9c138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.026+0000 7fdaa1c06700 1 -- 172.21.15.156:0/1418157147 >> 172.21.15.156:0/1418157147 conn(0x7fda9c099c40 msgr2=0x7fda9c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:37.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.026+0000 7fdaa1c06700 1 -- 172.21.15.156:0/1418157147 shutdown_connections 2023-09-30T22:22:37.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.026+0000 7fdaa1c06700 1 -- 172.21.15.156:0/1418157147 wait complete. 2023-09-30T22:22:37.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.027+0000 7fdaa1c06700 1 Processor -- start 2023-09-30T22:22:37.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.028+0000 7fdaa1c06700 1 -- start start 2023-09-30T22:22:37.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.028+0000 7fdaa1c06700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda9c09d860 0x7fda9c135ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:37.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.028+0000 7fdaa1c06700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda9c09e170 0x7fda9c136010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:37.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.028+0000 7fdaa1c06700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fda9c130eb0 0x7fda9c136550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:37.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.028+0000 7fdaa1c06700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c0a0780 con 0x7fda9c09e170 2023-09-30T22:22:37.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.028+0000 7fdaa1c06700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c09c8b0 con 0x7fda9c130eb0 2023-09-30T22:22:37.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.028+0000 7fdaa1c06700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c137700 con 0x7fda9c09d860 2023-09-30T22:22:37.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.028+0000 7fda9b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda9c09d860 0x7fda9c135ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:37.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.028+0000 7fda9affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda9c09e170 0x7fda9c136010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:37.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.028+0000 7fda9b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda9c09d860 0x7fda9c135ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55916/0 (socket says 172.21.15.156:55916) 2023-09-30T22:22:37.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.028+0000 7fda9b7fe700 1 -- 172.21.15.156:0/3062463896 learned_addr learned my addr 172.21.15.156:0/3062463896 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:37.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.028+0000 7fda9bfff700 1 --2- 172.21.15.156:0/3062463896 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fda9c130eb0 0x7fda9c136550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:37.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.029+0000 7fda9affd700 1 -- 172.21.15.156:0/3062463896 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda9c09d860 msgr2=0x7fda9c135ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:37.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.029+0000 7fda9affd700 1 --2- 172.21.15.156:0/3062463896 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda9c09d860 0x7fda9c135ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.029+0000 7fda9affd700 1 -- 172.21.15.156:0/3062463896 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fda9c130eb0 msgr2=0x7fda9c136550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:37.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.029+0000 7fda9affd700 1 --2- 172.21.15.156:0/3062463896 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fda9c130eb0 0x7fda9c136550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.029+0000 7fda9affd700 1 -- 172.21.15.156:0/3062463896 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c009550 con 0x7fda9c09e170 2023-09-30T22:22:37.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.029+0000 7fda9bfff700 1 --2- 172.21.15.156:0/3062463896 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fda9c130eb0 0x7fda9c136550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:37.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.029+0000 7fda9affd700 1 --2- 172.21.15.156:0/3062463896 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda9c09e170 0x7fda9c136010 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fda9000c460 tx=0x7fda9000c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:37.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.029+0000 7fda83fff700 1 -- 172.21.15.156:0/3062463896 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda90005cb0 con 0x7fda9c09e170 2023-09-30T22:22:37.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.029+0000 7fda83fff700 1 -- 172.21.15.156:0/3062463896 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda90005e10 con 0x7fda9c09e170 2023-09-30T22:22:37.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.029+0000 7fdaa1c06700 1 -- 172.21.15.156:0/3062463896 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9c11a580 con 0x7fda9c09e170 2023-09-30T22:22:37.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.029+0000 7fda83fff700 1 -- 172.21.15.156:0/3062463896 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda90007310 con 0x7fda9c09e170 2023-09-30T22:22:37.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.029+0000 7fdaa1c06700 1 -- 172.21.15.156:0/3062463896 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9c11afd0 con 0x7fda9c09e170 2023-09-30T22:22:37.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.030+0000 7fda83fff700 1 -- 172.21.15.156:0/3062463896 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fda90007470 con 0x7fda9c09e170 2023-09-30T22:22:37.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.030+0000 7fdaa1c06700 1 -- 172.21.15.156:0/3062463896 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9c04f2a0 con 0x7fda9c09e170 2023-09-30T22:22:37.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.030+0000 7fda83fff700 1 -- 172.21.15.156:0/3062463896 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fda9003ea70 con 0x7fda9c09e170 2023-09-30T22:22:37.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.035+0000 7fda83fff700 1 -- 172.21.15.156:0/3062463896 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fda90040e60 con 0x7fda9c09e170 2023-09-30T22:22:37.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.059+0000 7f0f94daf700 1 Processor -- start 2023-09-30T22:22:37.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.059+0000 7f0f94daf700 1 -- start start 2023-09-30T22:22:37.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.060+0000 7f0f94daf700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0f9009f430 0x7f0f90136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:37.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.060+0000 7f0f94daf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f90137010 0x7f0f901393f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:37.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.060+0000 7f0f94daf700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f9009b6d0 con 0x7f0f9009e950 2023-09-30T22:22:37.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.060+0000 7f0f94daf700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f9009afb0 con 0x7f0f9009f430 2023-09-30T22:22:37.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.060+0000 7f0f94daf700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f900a0970 con 0x7f0f90137010 2023-09-30T22:22:37.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.060+0000 7f0f8dd9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0f9009f430 0x7f0f90136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:37.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.060+0000 7f0f8ed9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f90137010 0x7f0f901393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:37.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.060+0000 7f0f8e59c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f0f9009e950 0x7f0f9009ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48750/0 (socket says 172.21.15.156:48750) 2023-09-30T22:22:37.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.060+0000 7f0f8e59c700 1 -- 172.21.15.156:0/3638863753 learned_addr learned my addr 172.21.15.156:0/3638863753 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:37.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.060+0000 7f0f8d59a700 1 -- 172.21.15.156:0/3638863753 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 352472871 0 0) 0x7f0f9009b6d0 con 0x7f0f9009e950 2023-09-30T22:22:37.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.060+0000 7f0f8ed9d700 1 -- 172.21.15.156:0/3638863753 >> v2:172.21.15.156:3300/0 conn(0x7f0f9009f430 msgr2=0x7f0f90136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:37.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.061+0000 7f0f8ed9d700 1 --2- 172.21.15.156:0/3638863753 >> v2:172.21.15.156:3300/0 conn(0x7f0f9009f430 0x7f0f90136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.061+0000 7f0f8ed9d700 1 -- 172.21.15.156:0/3638863753 >> v1:172.21.15.156:6789/0 conn(0x7f0f9009e950 legacy=0x7f0f9009ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:37.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.061+0000 7f0f8ed9d700 1 -- 172.21.15.156:0/3638863753 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f900a0320 con 0x7f0f90137010 2023-09-30T22:22:37.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.061+0000 7f0f8ed9d700 1 --2- 172.21.15.156:0/3638863753 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f90137010 0x7f0f901393f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0f88009d90 tx=0x7f0f8800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bdd1097ed6554a4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:37.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.061+0000 7f0f8d59a700 1 -- 172.21.15.156:0/3638863753 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8800e070 con 0x7f0f90137010 2023-09-30T22:22:37.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.061+0000 7f0f8d59a700 1 -- 172.21.15.156:0/3638863753 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8800bb20 con 0x7f0f90137010 2023-09-30T22:22:37.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.061+0000 7f0f8d59a700 1 -- 172.21.15.156:0/3638863753 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f88012430 con 0x7f0f90137010 2023-09-30T22:22:37.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.062+0000 7f0f94daf700 1 -- 172.21.15.156:0/3638863753 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f90137010 msgr2=0x7f0f901393f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:37.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.062+0000 7f0f94daf700 1 --2- 172.21.15.156:0/3638863753 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f90137010 0x7f0f901393f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0f88009d90 tx=0x7f0f8800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:37.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.062+0000 7f0f94daf700 1 -- 172.21.15.156:0/3638863753 shutdown_connections 2023-09-30T22:22:37.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.062+0000 7f0f94daf700 1 --2- 172.21.15.156:0/3638863753 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f90137010 0x7f0f901393f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.062+0000 7f0f94daf700 1 --2- 172.21.15.156:0/3638863753 >> v2:172.21.15.156:3300/0 conn(0x7f0f9009f430 0x7f0f90136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.062+0000 7f0f94daf700 1 -- 172.21.15.156:0/3638863753 >> 172.21.15.156:0/3638863753 conn(0x7f0f900a0f70 msgr2=0x7f0f900a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:37.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.062+0000 7f0f94daf700 1 -- 172.21.15.156:0/3638863753 shutdown_connections 2023-09-30T22:22:37.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.062+0000 7f0f94daf700 1 -- 172.21.15.156:0/3638863753 wait complete. 2023-09-30T22:22:37.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.063+0000 7f0f94daf700 1 Processor -- start 2023-09-30T22:22:37.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.063+0000 7f0f94daf700 1 -- start start 2023-09-30T22:22:37.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.063+0000 7f0f94daf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f9009e950 0x7f0f9011c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:37.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.063+0000 7f0f94daf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f9009f430 0x7f0f9011cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:37.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.063+0000 7f0f94daf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f90137010 0x7f0f9011d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:37.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.063+0000 7f0f94daf700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9011ff30 con 0x7f0f9009f430 2023-09-30T22:22:37.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.063+0000 7f0f94daf700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9011e410 con 0x7f0f9009e950 2023-09-30T22:22:37.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.063+0000 7f0f94daf700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f90072100 con 0x7f0f90137010 2023-09-30T22:22:37.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.063+0000 7f0f8ed9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f90137010 0x7f0f9011d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:37.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.063+0000 7f0f8ed9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f90137010 0x7f0f9011d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55924/0 (socket says 172.21.15.156:55924) 2023-09-30T22:22:37.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.063+0000 7f0f8dd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f9009f430 0x7f0f9011cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:37.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.063+0000 7f0f8ed9d700 1 -- 172.21.15.156:0/2176645490 learned_addr learned my addr 172.21.15.156:0/2176645490 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:37.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.064+0000 7f0f8e59c700 1 --2- 172.21.15.156:0/2176645490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f9009e950 0x7f0f9011c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:37.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.064+0000 7f0f8ed9d700 1 -- 172.21.15.156:0/2176645490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f9009e950 msgr2=0x7f0f9011c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:37.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.064+0000 7f0f8ed9d700 1 --2- 172.21.15.156:0/2176645490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f9009e950 0x7f0f9011c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.064+0000 7f0f8ed9d700 1 -- 172.21.15.156:0/2176645490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f9009f430 msgr2=0x7f0f9011cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:37.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.064+0000 7f0f8ed9d700 1 --2- 172.21.15.156:0/2176645490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f9009f430 0x7f0f9011cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.064+0000 7f0f8ed9d700 1 -- 172.21.15.156:0/2176645490 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f88009a70 con 0x7f0f90137010 2023-09-30T22:22:37.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.064+0000 7f0f8dd9b700 1 --2- 172.21.15.156:0/2176645490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f9009f430 0x7f0f9011cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:37.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.064+0000 7f0f8ed9d700 1 --2- 172.21.15.156:0/2176645490 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f90137010 0x7f0f9011d1c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0f88013000 tx=0x7f0f88004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:37.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.064+0000 7f0f7effd700 1 -- 172.21.15.156:0/2176645490 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f88012430 con 0x7f0f90137010 2023-09-30T22:22:37.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.064+0000 7f0f7effd700 1 -- 172.21.15.156:0/2176645490 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f88020070 con 0x7f0f90137010 2023-09-30T22:22:37.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.064+0000 7f0f94daf700 1 -- 172.21.15.156:0/2176645490 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f9009da40 con 0x7f0f90137010 2023-09-30T22:22:37.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.064+0000 7f0f7effd700 1 -- 172.21.15.156:0/2176645490 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f88004280 con 0x7f0f90137010 2023-09-30T22:22:37.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.064+0000 7f0f94daf700 1 -- 172.21.15.156:0/2176645490 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f90132630 con 0x7f0f90137010 2023-09-30T22:22:37.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.065+0000 7f0f7effd700 1 -- 172.21.15.156:0/2176645490 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f880043e0 con 0x7f0f90137010 2023-09-30T22:22:37.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.065+0000 7f0f7effd700 1 -- 172.21.15.156:0/2176645490 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0f88022070 con 0x7f0f90137010 2023-09-30T22:22:37.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.065+0000 7f0f94daf700 1 -- 172.21.15.156:0/2176645490 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f9004f2a0 con 0x7f0f90137010 2023-09-30T22:22:37.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.074+0000 7f0f7effd700 1 -- 172.21.15.156:0/2176645490 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f8801a380 con 0x7f0f90137010 2023-09-30T22:22:37.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.100+0000 7f31e0085700 1 Processor -- start 2023-09-30T22:22:37.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.101+0000 7f31e0085700 1 -- start start 2023-09-30T22:22:37.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.101+0000 7f31e0085700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31d80a0a70 0x7f31d80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:37.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.101+0000 7f31e0085700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f31d8134120 0x7f31d813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:37.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.101+0000 7f31e0085700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d809dc00 con 0x7f31d80a1380 2023-09-30T22:22:37.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.101+0000 7f31e0085700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d809ea60 con 0x7f31d8134120 2023-09-30T22:22:37.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.101+0000 7f31e0085700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d809dec0 con 0x7f31d80a0a70 2023-09-30T22:22:37.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.101+0000 7f31de622700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f31d8134120 0x7f31d813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:37.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.101+0000 7f31de622700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f31d8134120 0x7f31d813bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36778/0 (socket says 172.21.15.156:36778) 2023-09-30T22:22:37.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.101+0000 7f31de622700 1 -- 172.21.15.156:0/190273983 learned_addr learned my addr 172.21.15.156:0/190273983 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:37.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.101+0000 7f31dd620700 1 --1- 172.21.15.156:0/190273983 >> v1:172.21.15.156:6789/0 conn(0x7f31d80a1380 0x7f31d8133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48762/0 (socket says 172.21.15.156:48762) 2023-09-30T22:22:37.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.101+0000 7f31dde21700 1 --2- 172.21.15.156:0/190273983 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31d80a0a70 0x7f31d80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:37.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.102+0000 7f31de622700 1 -- 172.21.15.156:0/190273983 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31d80a0a70 msgr2=0x7f31d80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:37.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.102+0000 7f31de622700 1 --2- 172.21.15.156:0/190273983 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31d80a0a70 0x7f31d80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.102+0000 7f31de622700 1 -- 172.21.15.156:0/190273983 >> v1:172.21.15.156:6789/0 conn(0x7f31d80a1380 legacy=0x7f31d8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:37.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.102+0000 7f31de622700 1 -- 172.21.15.156:0/190273983 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d809e6a0 con 0x7f31d8134120 2023-09-30T22:22:37.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.102+0000 7f31de622700 1 --2- 172.21.15.156:0/190273983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31d8134120 0x7f31d813bce0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009e50 tx=0x7f31d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99144767206902fc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:37.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.102+0000 7f31dce1f700 1 -- 172.21.15.156:0/190273983 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d000e070 con 0x7f31d8134120 2023-09-30T22:22:37.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.102+0000 7f31dce1f700 1 -- 172.21.15.156:0/190273983 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d000b910 con 0x7f31d8134120 2023-09-30T22:22:37.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.102+0000 7f31dce1f700 1 -- 172.21.15.156:0/190273983 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d000bcc0 con 0x7f31d8134120 2023-09-30T22:22:37.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.103+0000 7f31e0085700 1 -- 172.21.15.156:0/190273983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31d8134120 msgr2=0x7f31d813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:37.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.103+0000 7f31e0085700 1 --2- 172.21.15.156:0/190273983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31d8134120 0x7f31d813bce0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009e50 tx=0x7f31d000b330 comp rx=0 tx=0).stop 2023-09-30T22:22:37.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.103+0000 7f31e0085700 1 -- 172.21.15.156:0/190273983 shutdown_connections 2023-09-30T22:22:37.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.103+0000 7f31e0085700 1 --2- 172.21.15.156:0/190273983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31d8134120 0x7f31d813bce0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.103+0000 7f31e0085700 1 --2- 172.21.15.156:0/190273983 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31d80a0a70 0x7f31d80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.103+0000 7f31e0085700 1 -- 172.21.15.156:0/190273983 >> 172.21.15.156:0/190273983 conn(0x7f31d80a6610 msgr2=0x7f31d80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:37.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.103+0000 7f31e0085700 1 -- 172.21.15.156:0/190273983 shutdown_connections 2023-09-30T22:22:37.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.103+0000 7f31e0085700 1 -- 172.21.15.156:0/190273983 wait complete. 2023-09-30T22:22:37.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.104+0000 7f31e0085700 1 Processor -- start 2023-09-30T22:22:37.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.104+0000 7f31e0085700 1 -- start start 2023-09-30T22:22:37.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.105+0000 7f31e0085700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31d80a0a70 0x7f31d81228b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:37.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.105+0000 7f31e0085700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31d80a1380 0x7f31d8122df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:37.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.105+0000 7f31e0085700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31d8134120 0x7f31d8123330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:37.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.105+0000 7f31e0085700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d8126160 con 0x7f31d80a0a70 2023-09-30T22:22:37.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.105+0000 7f31e0085700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d8126340 con 0x7f31d8134120 2023-09-30T22:22:37.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.105+0000 7f31e0085700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31d8125da0 con 0x7f31d80a1380 2023-09-30T22:22:37.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.105+0000 7f31dde21700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31d80a0a70 0x7f31d81228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:37.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.105+0000 7f31dde21700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31d80a0a70 0x7f31d81228b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36780/0 (socket says 172.21.15.156:36780) 2023-09-30T22:22:37.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.105+0000 7f31dde21700 1 -- 172.21.15.156:0/3070041296 learned_addr learned my addr 172.21.15.156:0/3070041296 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:37.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.105+0000 7f31dd620700 1 --2- 172.21.15.156:0/3070041296 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31d80a1380 0x7f31d8122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:37.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.105+0000 7f31de622700 1 --2- 172.21.15.156:0/3070041296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31d8134120 0x7f31d8123330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:37.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.105+0000 7f31dde21700 1 -- 172.21.15.156:0/3070041296 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31d80a1380 msgr2=0x7f31d8122df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:37.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.105+0000 7f31dde21700 1 --2- 172.21.15.156:0/3070041296 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31d80a1380 0x7f31d8122df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.105+0000 7f31dde21700 1 -- 172.21.15.156:0/3070041296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31d8134120 msgr2=0x7f31d8123330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:37.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.105+0000 7f31dde21700 1 --2- 172.21.15.156:0/3070041296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31d8134120 0x7f31d8123330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.105+0000 7f31dde21700 1 -- 172.21.15.156:0/3070041296 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d0009b30 con 0x7f31d80a0a70 2023-09-30T22:22:37.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.106+0000 7f31dde21700 1 --2- 172.21.15.156:0/3070041296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31d80a0a70 0x7f31d81228b0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f31d400e9b0 tx=0x7f31d400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:37.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.106+0000 7f31ce7fc700 1 -- 172.21.15.156:0/3070041296 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d4009710 con 0x7f31d80a0a70 2023-09-30T22:22:37.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.106+0000 7f31ce7fc700 1 -- 172.21.15.156:0/3070041296 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d400ee50 con 0x7f31d80a0a70 2023-09-30T22:22:37.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.106+0000 7f31e0085700 1 -- 172.21.15.156:0/3070041296 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d80a03e0 con 0x7f31d80a0a70 2023-09-30T22:22:37.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.106+0000 7f31ce7fc700 1 -- 172.21.15.156:0/3070041296 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d400ca50 con 0x7f31d80a0a70 2023-09-30T22:22:37.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.106+0000 7f31e0085700 1 -- 172.21.15.156:0/3070041296 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d81339b0 con 0x7f31d80a0a70 2023-09-30T22:22:37.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.107+0000 7f31ce7fc700 1 -- 172.21.15.156:0/3070041296 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f31d400cbb0 con 0x7f31d80a0a70 2023-09-30T22:22:37.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.107+0000 7f31ce7fc700 1 -- 172.21.15.156:0/3070041296 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f31d403f770 con 0x7f31d80a0a70 2023-09-30T22:22:37.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.107+0000 7f31e0085700 1 -- 172.21.15.156:0/3070041296 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d804f2a0 con 0x7f31d80a0a70 2023-09-30T22:22:37.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.112+0000 7f31ce7fc700 1 -- 172.21.15.156:0/3070041296 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f31d4021020 con 0x7f31d80a0a70 2023-09-30T22:22:37.134 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:37.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.235+0000 7fdaa1c06700 1 -- 172.21.15.156:0/3062463896 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fda9c06c3b0 con 0x7fda9c09e170 2023-09-30T22:22:37.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.235+0000 7fda83fff700 1 -- 172.21.15.156:0/3062463896 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fda90017030 con 0x7fda9c09e170 2023-09-30T22:22:37.236 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:37.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.237+0000 7fdaa1c06700 1 -- 172.21.15.156:0/3062463896 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda9c09e170 msgr2=0x7fda9c136010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:37.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.237+0000 7fdaa1c06700 1 --2- 172.21.15.156:0/3062463896 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda9c09e170 0x7fda9c136010 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fda9000c460 tx=0x7fda9000c770 comp rx=0 tx=0).stop 2023-09-30T22:22:37.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.237+0000 7fdaa1c06700 1 -- 172.21.15.156:0/3062463896 shutdown_connections 2023-09-30T22:22:37.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.237+0000 7fdaa1c06700 1 --2- 172.21.15.156:0/3062463896 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fda9c130eb0 0x7fda9c136550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.237+0000 7fdaa1c06700 1 --2- 172.21.15.156:0/3062463896 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda9c09d860 0x7fda9c135ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.237+0000 7fdaa1c06700 1 --2- 172.21.15.156:0/3062463896 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda9c09e170 0x7fda9c136010 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.237+0000 7fdaa1c06700 1 -- 172.21.15.156:0/3062463896 >> 172.21.15.156:0/3062463896 conn(0x7fda9c099c40 msgr2=0x7fda9c1385c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:37.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.238+0000 7fdaa1c06700 1 -- 172.21.15.156:0/3062463896 shutdown_connections 2023-09-30T22:22:37.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.238+0000 7fdaa1c06700 1 -- 172.21.15.156:0/3062463896 wait complete. 2023-09-30T22:22:37.251 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:37.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.260+0000 7fdc4f427700 1 Processor -- start 2023-09-30T22:22:37.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.260+0000 7fdc4f427700 1 -- start start 2023-09-30T22:22:37.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.261+0000 7fdc4f427700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc4809d860 0x7fdc4809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:37.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.261+0000 7fdc4f427700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc4809e170 0x7fdc481307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:37.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.261+0000 7fdc4f427700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc4809aaa0 con 0x7fdc48130ce0 2023-09-30T22:22:37.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.261+0000 7fdc4f427700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4809f870 con 0x7fdc4809e170 2023-09-30T22:22:37.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.261+0000 7fdc4f427700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4809b360 con 0x7fdc4809d860 2023-09-30T22:22:37.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.261+0000 7fdc4c9c2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc4809e170 0x7fdc481307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:37.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.261+0000 7fdc4c9c2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc4809e170 0x7fdc481307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33364/0 (socket says 172.21.15.156:33364) 2023-09-30T22:22:37.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.261+0000 7fdc4c9c2700 1 -- 172.21.15.156:0/2198555526 learned_addr learned my addr 172.21.15.156:0/2198555526 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:37.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.261+0000 7fdc4d1c3700 1 --2- 172.21.15.156:0/2198555526 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc4809d860 0x7fdc4809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:37.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.261+0000 7fdc3ffff700 1 -- 172.21.15.156:0/2198555526 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3024425977 0 0) 0x7fdc4809aaa0 con 0x7fdc48130ce0 2023-09-30T22:22:37.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.261+0000 7fdc4c9c2700 1 -- 172.21.15.156:0/2198555526 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc4809d860 msgr2=0x7fdc4809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:37.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.261+0000 7fdc4c9c2700 1 --2- 172.21.15.156:0/2198555526 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc4809d860 0x7fdc4809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.261+0000 7fdc4c9c2700 1 -- 172.21.15.156:0/2198555526 >> v1:172.21.15.156:6789/0 conn(0x7fdc48130ce0 legacy=0x7fdc481379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:37.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.261+0000 7fdc4c9c2700 1 -- 172.21.15.156:0/2198555526 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4809b620 con 0x7fdc4809e170 2023-09-30T22:22:37.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.261+0000 7fdc4c9c2700 1 --2- 172.21.15.156:0/2198555526 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc4809e170 0x7fdc481307a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fdc38009920 tx=0x7fdc38009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=888e19d6304e5179 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:37.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.262+0000 7fdc3ffff700 1 -- 172.21.15.156:0/2198555526 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc38011830 con 0x7fdc4809e170 2023-09-30T22:22:37.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.262+0000 7fdc3ffff700 1 -- 172.21.15.156:0/2198555526 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc38011990 con 0x7fdc4809e170 2023-09-30T22:22:37.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.262+0000 7fdc3ffff700 1 -- 172.21.15.156:0/2198555526 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc38011d20 con 0x7fdc4809e170 2023-09-30T22:22:37.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.262+0000 7fdc4f427700 1 -- 172.21.15.156:0/2198555526 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc4809e170 msgr2=0x7fdc481307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:37.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.262+0000 7fdc4f427700 1 --2- 172.21.15.156:0/2198555526 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc4809e170 0x7fdc481307a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fdc38009920 tx=0x7fdc38009c30 comp rx=0 tx=0).stop 2023-09-30T22:22:37.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.262+0000 7fdc4f427700 1 -- 172.21.15.156:0/2198555526 shutdown_connections 2023-09-30T22:22:37.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.262+0000 7fdc4f427700 1 --2- 172.21.15.156:0/2198555526 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc4809d860 0x7fdc4809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.262+0000 7fdc4f427700 1 --2- 172.21.15.156:0/2198555526 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc4809e170 0x7fdc481307a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.262+0000 7fdc4f427700 1 -- 172.21.15.156:0/2198555526 >> 172.21.15.156:0/2198555526 conn(0x7fdc48099c40 msgr2=0x7fdc480a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:37.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.262+0000 7fdc4f427700 1 -- 172.21.15.156:0/2198555526 shutdown_connections 2023-09-30T22:22:37.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.262+0000 7fdc4f427700 1 -- 172.21.15.156:0/2198555526 wait complete. 2023-09-30T22:22:37.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.263+0000 7fdc4f427700 1 Processor -- start 2023-09-30T22:22:37.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.263+0000 7fdc4f427700 1 -- start start 2023-09-30T22:22:37.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.264+0000 7fdc4f427700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc4809d860 0x7fdc4812fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:37.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.264+0000 7fdc4f427700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc4809e170 0x7fdc481301c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:37.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.264+0000 7fdc4f427700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc48130ce0 0x7fdc48130700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:37.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.264+0000 7fdc4f427700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc48136b80 con 0x7fdc4809d860 2023-09-30T22:22:37.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.264+0000 7fdc4f427700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4809c8b0 con 0x7fdc48130ce0 2023-09-30T22:22:37.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.264+0000 7fdc4f427700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4813be00 con 0x7fdc4809e170 2023-09-30T22:22:37.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.264+0000 7fdc4c9c2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc4809e170 0x7fdc481301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:37.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.264+0000 7fdc4c9c2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc4809e170 0x7fdc481301c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55960/0 (socket says 172.21.15.156:55960) 2023-09-30T22:22:37.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.264+0000 7fdc4c9c2700 1 -- 172.21.15.156:0/114393918 learned_addr learned my addr 172.21.15.156:0/114393918 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:37.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.264+0000 7fdc4d9c4700 1 --2- 172.21.15.156:0/114393918 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc48130ce0 0x7fdc48130700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:37.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.264+0000 7fdc4d1c3700 1 --2- 172.21.15.156:0/114393918 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc4809d860 0x7fdc4812fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:37.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.264+0000 7fdc4d9c4700 1 -- 172.21.15.156:0/114393918 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc4809e170 msgr2=0x7fdc481301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:37.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.264+0000 7fdc4d9c4700 1 --2- 172.21.15.156:0/114393918 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc4809e170 0x7fdc481301c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.264+0000 7fdc4d9c4700 1 -- 172.21.15.156:0/114393918 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc4809d860 msgr2=0x7fdc4812fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:37.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.264+0000 7fdc4d9c4700 1 --2- 172.21.15.156:0/114393918 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc4809d860 0x7fdc4812fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.264+0000 7fdc4d9c4700 1 -- 172.21.15.156:0/114393918 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc38009550 con 0x7fdc48130ce0 2023-09-30T22:22:37.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.264+0000 7fdc4c9c2700 1 --2- 172.21.15.156:0/114393918 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc4809e170 0x7fdc481301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:37.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.264+0000 7fdc4d9c4700 1 --2- 172.21.15.156:0/114393918 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc48130ce0 0x7fdc48130700 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fdc4000c7c0 tx=0x7fdc4000cad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:37.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.265+0000 7fdc3dffb700 1 -- 172.21.15.156:0/114393918 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40003e30 con 0x7fdc48130ce0 2023-09-30T22:22:37.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.265+0000 7fdc3dffb700 1 -- 172.21.15.156:0/114393918 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc40005070 con 0x7fdc48130ce0 2023-09-30T22:22:37.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.265+0000 7fdc4f427700 1 -- 172.21.15.156:0/114393918 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc481367e0 con 0x7fdc48130ce0 2023-09-30T22:22:37.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.265+0000 7fdc3dffb700 1 -- 172.21.15.156:0/114393918 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40005400 con 0x7fdc48130ce0 2023-09-30T22:22:37.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.265+0000 7fdc4f427700 1 -- 172.21.15.156:0/114393918 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc48137510 con 0x7fdc48130ce0 2023-09-30T22:22:37.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.265+0000 7fdc3dffb700 1 -- 172.21.15.156:0/114393918 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc40005560 con 0x7fdc48130ce0 2023-09-30T22:22:37.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.266+0000 7fdc3dffb700 1 -- 172.21.15.156:0/114393918 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdc4003ec90 con 0x7fdc48130ce0 2023-09-30T22:22:37.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.266+0000 7fdc4f427700 1 -- 172.21.15.156:0/114393918 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc48138ae0 con 0x7fdc48130ce0 2023-09-30T22:22:37.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.270+0000 7fdc3dffb700 1 -- 172.21.15.156:0/114393918 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc48138ae0 con 0x7fdc48130ce0 2023-09-30T22:22:37.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.277+0000 7f0f94daf700 1 -- 172.21.15.156:0/2176645490 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0f9009b8b0 con 0x7f0f90137010 2023-09-30T22:22:37.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.277+0000 7f0f7effd700 1 -- 172.21.15.156:0/2176645490 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f88034090 con 0x7f0f90137010 2023-09-30T22:22:37.278 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:37.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.279+0000 7f0f94daf700 1 -- 172.21.15.156:0/2176645490 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f90137010 msgr2=0x7f0f9011d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:37.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.279+0000 7f0f94daf700 1 --2- 172.21.15.156:0/2176645490 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f90137010 0x7f0f9011d1c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0f88013000 tx=0x7f0f88004ad0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.279+0000 7f0f94daf700 1 -- 172.21.15.156:0/2176645490 shutdown_connections 2023-09-30T22:22:37.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.279+0000 7f0f94daf700 1 --2- 172.21.15.156:0/2176645490 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f90137010 0x7f0f9011d1c0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.279+0000 7f0f94daf700 1 --2- 172.21.15.156:0/2176645490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f9009e950 0x7f0f9011c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.279+0000 7f0f94daf700 1 --2- 172.21.15.156:0/2176645490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f9009f430 0x7f0f9011cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.279+0000 7f0f94daf700 1 -- 172.21.15.156:0/2176645490 >> 172.21.15.156:0/2176645490 conn(0x7f0f900a0f70 msgr2=0x7f0f90134a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:37.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.279+0000 7f0f94daf700 1 -- 172.21.15.156:0/2176645490 shutdown_connections 2023-09-30T22:22:37.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.279+0000 7f0f94daf700 1 -- 172.21.15.156:0/2176645490 wait complete. 2023-09-30T22:22:37.293 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:37.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.308+0000 7f31e0085700 1 -- 172.21.15.156:0/3070041296 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f31d8072980 con 0x7f31d80a0a70 2023-09-30T22:22:37.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.309+0000 7f31ce7fc700 1 -- 172.21.15.156:0/3070041296 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f31d401be10 con 0x7f31d80a0a70 2023-09-30T22:22:37.309 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:37.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.311+0000 7f31e0085700 1 -- 172.21.15.156:0/3070041296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31d80a0a70 msgr2=0x7f31d81228b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:37.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.311+0000 7f31e0085700 1 --2- 172.21.15.156:0/3070041296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31d80a0a70 0x7f31d81228b0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f31d400e9b0 tx=0x7f31d400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.311+0000 7f31e0085700 1 -- 172.21.15.156:0/3070041296 shutdown_connections 2023-09-30T22:22:37.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.311+0000 7f31e0085700 1 --2- 172.21.15.156:0/3070041296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31d8134120 0x7f31d8123330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.311+0000 7f31e0085700 1 --2- 172.21.15.156:0/3070041296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31d80a0a70 0x7f31d81228b0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.311+0000 7f31e0085700 1 --2- 172.21.15.156:0/3070041296 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31d80a1380 0x7f31d8122df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.311+0000 7f31e0085700 1 -- 172.21.15.156:0/3070041296 >> 172.21.15.156:0/3070041296 conn(0x7f31d80a6610 msgr2=0x7f31d80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:37.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.311+0000 7f31e0085700 1 -- 172.21.15.156:0/3070041296 shutdown_connections 2023-09-30T22:22:37.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.311+0000 7f31e0085700 1 -- 172.21.15.156:0/3070041296 wait complete. 2023-09-30T22:22:37.324 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:37.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.458+0000 7fdc4f427700 1 -- 172.21.15.156:0/114393918 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdc48138ae0 con 0x7fdc48130ce0 2023-09-30T22:22:37.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.458+0000 7fdc3dffb700 1 -- 172.21.15.156:0/114393918 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdc48138ae0 con 0x7fdc48130ce0 2023-09-30T22:22:37.459 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:37.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.460+0000 7fdc4f427700 1 -- 172.21.15.156:0/114393918 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc48130ce0 msgr2=0x7fdc48130700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:37.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.460+0000 7fdc4f427700 1 --2- 172.21.15.156:0/114393918 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc48130ce0 0x7fdc48130700 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fdc4000c7c0 tx=0x7fdc4000cad0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.460+0000 7fdc4f427700 1 -- 172.21.15.156:0/114393918 shutdown_connections 2023-09-30T22:22:37.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.460+0000 7fdc4f427700 1 --2- 172.21.15.156:0/114393918 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc48130ce0 0x7fdc48130700 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.460+0000 7fdc4f427700 1 --2- 172.21.15.156:0/114393918 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc4809d860 0x7fdc4812fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.460+0000 7fdc4f427700 1 --2- 172.21.15.156:0/114393918 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc4809e170 0x7fdc481301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.460+0000 7fdc4f427700 1 -- 172.21.15.156:0/114393918 >> 172.21.15.156:0/114393918 conn(0x7fdc48099c40 msgr2=0x7fdc481393c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:37.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.460+0000 7fdc4f427700 1 -- 172.21.15.156:0/114393918 shutdown_connections 2023-09-30T22:22:37.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:37.460+0000 7fdc4f427700 1 -- 172.21.15.156:0/114393918 wait complete. 2023-09-30T22:22:37.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:38.253 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:38.294 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:38.325 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:38.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.392+0000 7fb74e2e8700 1 Processor -- start 2023-09-30T22:22:38.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.392+0000 7fb74e2e8700 1 -- start start 2023-09-30T22:22:38.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.392+0000 7fb74e2e8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb74809f350 0x7fb748136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.392+0000 7fb74e2e8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7481371c0 0x7fb7481395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.392+0000 7fb74e2e8700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb74809c970 con 0x7fb74809e870 2023-09-30T22:22:38.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.392+0000 7fb74e2e8700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7480a0920 con 0x7fb74809f350 2023-09-30T22:22:38.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.392+0000 7fb74e2e8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb74809f9c0 con 0x7fb7481371c0 2023-09-30T22:22:38.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.392+0000 7fb7477fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb74809f350 0x7fb748136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.392+0000 7fb74c885700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7481371c0 0x7fb7481395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.392+0000 7fb747fff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb74809e870 0x7fb74809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48776/0 (socket says 172.21.15.156:48776) 2023-09-30T22:22:38.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.392+0000 7fb747fff700 1 -- 172.21.15.156:0/1047651156 learned_addr learned my addr 172.21.15.156:0/1047651156 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:38.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.393+0000 7fb7477fe700 1 -- 172.21.15.156:0/1047651156 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7481371c0 msgr2=0x7fb7481395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:38.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.393+0000 7fb7477fe700 1 --2- 172.21.15.156:0/1047651156 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7481371c0 0x7fb7481395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.393+0000 7fb7477fe700 1 -- 172.21.15.156:0/1047651156 >> v1:172.21.15.156:6789/0 conn(0x7fb74809e870 legacy=0x7fb74809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.393+0000 7fb7477fe700 1 -- 172.21.15.156:0/1047651156 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74809bab0 con 0x7fb74809f350 2023-09-30T22:22:38.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.393+0000 7fb746ffd700 1 -- 172.21.15.156:0/1047651156 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 178188550 0 0) 0x7fb74809c970 con 0x7fb74809e870 2023-09-30T22:22:38.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.393+0000 7fb74c885700 1 --2- 172.21.15.156:0/1047651156 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7481371c0 0x7fb7481395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:38.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.393+0000 7fb7477fe700 1 --2- 172.21.15.156:0/1047651156 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb74809f350 0x7fb748136c80 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fb73c009840 tx=0x7fb73c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8b0baabd2b5557 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:38.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.393+0000 7fb746ffd700 1 -- 172.21.15.156:0/1047651156 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c011830 con 0x7fb74809f350 2023-09-30T22:22:38.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.393+0000 7fb746ffd700 1 -- 172.21.15.156:0/1047651156 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73c011990 con 0x7fb74809f350 2023-09-30T22:22:38.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.393+0000 7fb746ffd700 1 -- 172.21.15.156:0/1047651156 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c011d20 con 0x7fb74809f350 2023-09-30T22:22:38.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.394+0000 7fb74e2e8700 1 -- 172.21.15.156:0/1047651156 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb74809f350 msgr2=0x7fb748136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.394+0000 7fb74e2e8700 1 --2- 172.21.15.156:0/1047651156 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb74809f350 0x7fb748136c80 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fb73c009840 tx=0x7fb73c009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:38.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.394+0000 7fb74e2e8700 1 -- 172.21.15.156:0/1047651156 shutdown_connections 2023-09-30T22:22:38.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.394+0000 7fb74e2e8700 1 --2- 172.21.15.156:0/1047651156 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7481371c0 0x7fb7481395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.394+0000 7fb74e2e8700 1 --2- 172.21.15.156:0/1047651156 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb74809f350 0x7fb748136c80 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.394+0000 7fb74e2e8700 1 -- 172.21.15.156:0/1047651156 >> 172.21.15.156:0/1047651156 conn(0x7fb7480a4430 msgr2=0x7fb7480a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:38.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.394+0000 7fb74e2e8700 1 -- 172.21.15.156:0/1047651156 shutdown_connections 2023-09-30T22:22:38.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.394+0000 7fb74e2e8700 1 -- 172.21.15.156:0/1047651156 wait complete. 2023-09-30T22:22:38.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.395+0000 7fb74e2e8700 1 Processor -- start 2023-09-30T22:22:38.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.395+0000 7fb74e2e8700 1 -- start start 2023-09-30T22:22:38.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.395+0000 7fb74e2e8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb74809e870 0x7fb748120700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.395+0000 7fb74e2e8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb74809f350 0x7fb748120c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.395+0000 7fb74e2e8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7481371c0 0x7fb748121180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.395+0000 7fb74e2e8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb748122310 con 0x7fb74809f350 2023-09-30T22:22:38.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.395+0000 7fb74e2e8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb74809dba0 con 0x7fb7481371c0 2023-09-30T22:22:38.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.395+0000 7fb74e2e8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb748123fb0 con 0x7fb74809e870 2023-09-30T22:22:38.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.396+0000 7fb747fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb74809e870 0x7fb748120700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.396+0000 7fb7477fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb74809f350 0x7fb748120c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.396+0000 7fb747fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb74809e870 0x7fb748120700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55992/0 (socket says 172.21.15.156:55992) 2023-09-30T22:22:38.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.396+0000 7fb747fff700 1 -- 172.21.15.156:0/3744668352 learned_addr learned my addr 172.21.15.156:0/3744668352 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:38.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.396+0000 7fb7477fe700 1 -- 172.21.15.156:0/3744668352 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb74809e870 msgr2=0x7fb748120700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.396+0000 7fb7477fe700 1 --2- 172.21.15.156:0/3744668352 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb74809e870 0x7fb748120700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.396+0000 7fb7477fe700 1 -- 172.21.15.156:0/3744668352 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7481371c0 msgr2=0x7fb748121180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.396+0000 7fb7477fe700 1 --2- 172.21.15.156:0/3744668352 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7481371c0 0x7fb748121180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.396+0000 7fb7477fe700 1 -- 172.21.15.156:0/3744668352 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb740009a70 con 0x7fb74809f350 2023-09-30T22:22:38.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.396+0000 7fb747fff700 1 --2- 172.21.15.156:0/3744668352 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb74809e870 0x7fb748120700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:38.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.396+0000 7fb7477fe700 1 --2- 172.21.15.156:0/3744668352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb74809f350 0x7fb748120c40 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fb73c016000 tx=0x7fb73c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:38.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.396+0000 7fb744ff9700 1 -- 172.21.15.156:0/3744668352 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c0036a0 con 0x7fb74809f350 2023-09-30T22:22:38.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.396+0000 7fb744ff9700 1 -- 172.21.15.156:0/3744668352 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73c01f070 con 0x7fb74809f350 2023-09-30T22:22:38.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.396+0000 7fb744ff9700 1 -- 172.21.15.156:0/3744668352 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c003a00 con 0x7fb74809f350 2023-09-30T22:22:38.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.396+0000 7fb74e2e8700 1 -- 172.21.15.156:0/3744668352 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb73c0094a0 con 0x7fb74809f350 2023-09-30T22:22:38.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.396+0000 7fb74e2e8700 1 -- 172.21.15.156:0/3744668352 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7481365f0 con 0x7fb74809f350 2023-09-30T22:22:38.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.397+0000 7fb74e2e8700 1 -- 172.21.15.156:0/3744668352 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb74804f2a0 con 0x7fb74809f350 2023-09-30T22:22:38.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.398+0000 7fb744ff9700 1 -- 172.21.15.156:0/3744668352 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb73c003b60 con 0x7fb74809f350 2023-09-30T22:22:38.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.398+0000 7fb744ff9700 1 -- 172.21.15.156:0/3744668352 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb73c021070 con 0x7fb74809f350 2023-09-30T22:22:38.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.403+0000 7fb744ff9700 1 -- 172.21.15.156:0/3744668352 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb73c003e10 con 0x7fb74809f350 2023-09-30T22:22:38.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.433+0000 7f6706618700 1 Processor -- start 2023-09-30T22:22:38.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.433+0000 7f6706618700 1 -- start start 2023-09-30T22:22:38.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.433+0000 7f6706618700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67000a0a70 0x7f67000a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.433+0000 7f6706618700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67000a1380 0x7f6700133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.433+0000 7f6706618700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6700133f50 0x7f67001343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.433+0000 7f6706618700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f670009e9d0 con 0x7f6700133f50 2023-09-30T22:22:38.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.433+0000 7f6706618700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f670009dc00 con 0x7f67000a0a70 2023-09-30T22:22:38.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.433+0000 7f6706618700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f670009dec0 con 0x7f67000a1380 2023-09-30T22:22:38.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.434+0000 7f66ff7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67000a1380 0x7f6700133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.434+0000 7f66fffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67000a0a70 0x7f67000a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.434+0000 7f66ff7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67000a1380 0x7f6700133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55998/0 (socket says 172.21.15.156:55998) 2023-09-30T22:22:38.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.434+0000 7f66ff7fe700 1 -- 172.21.15.156:0/3785580807 learned_addr learned my addr 172.21.15.156:0/3785580807 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:38.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.434+0000 7f6704bb5700 1 --2- 172.21.15.156:0/3785580807 >> v2:172.21.15.156:3300/0 conn(0x7f6700133f50 0x7f67001343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.434+0000 7f66ff7fe700 1 -- 172.21.15.156:0/3785580807 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67000a0a70 msgr2=0x7f67000a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:38.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.434+0000 7f66ff7fe700 1 --2- 172.21.15.156:0/3785580807 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67000a0a70 0x7f67000a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.434+0000 7f66ff7fe700 1 -- 172.21.15.156:0/3785580807 >> v2:172.21.15.156:3300/0 conn(0x7f6700133f50 msgr2=0x7f67001343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:38.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.434+0000 7f66ff7fe700 1 --2- 172.21.15.156:0/3785580807 >> v2:172.21.15.156:3300/0 conn(0x7f6700133f50 0x7f67001343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.434+0000 7f66ff7fe700 1 -- 172.21.15.156:0/3785580807 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670009e6a0 con 0x7f67000a1380 2023-09-30T22:22:38.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.434+0000 7f6704bb5700 1 --2- 172.21.15.156:0/3785580807 >> v2:172.21.15.156:3300/0 conn(0x7f6700133f50 0x7f67001343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:38.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.434+0000 7f66ff7fe700 1 --2- 172.21.15.156:0/3785580807 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67000a1380 0x7f6700133a10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f66f40098f0 tx=0x7f66f4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31747c8d67691f6e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:38.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.434+0000 7f66feffd700 1 -- 172.21.15.156:0/3785580807 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f4011830 con 0x7f67000a1380 2023-09-30T22:22:38.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.434+0000 7f66feffd700 1 -- 172.21.15.156:0/3785580807 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f4011990 con 0x7f67000a1380 2023-09-30T22:22:38.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.434+0000 7f66feffd700 1 -- 172.21.15.156:0/3785580807 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f4011d20 con 0x7f67000a1380 2023-09-30T22:22:38.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.435+0000 7f6706618700 1 -- 172.21.15.156:0/3785580807 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67000a1380 msgr2=0x7f6700133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.435+0000 7f6706618700 1 --2- 172.21.15.156:0/3785580807 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67000a1380 0x7f6700133a10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f66f40098f0 tx=0x7f66f4009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:38.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.435+0000 7f6706618700 1 -- 172.21.15.156:0/3785580807 shutdown_connections 2023-09-30T22:22:38.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.435+0000 7f6706618700 1 --2- 172.21.15.156:0/3785580807 >> v2:172.21.15.156:3300/0 conn(0x7f6700133f50 0x7f67001343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.435+0000 7f6706618700 1 --2- 172.21.15.156:0/3785580807 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67000a0a70 0x7f67000a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.435+0000 7f6706618700 1 --2- 172.21.15.156:0/3785580807 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67000a1380 0x7f6700133a10 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.435+0000 7f6706618700 1 -- 172.21.15.156:0/3785580807 >> 172.21.15.156:0/3785580807 conn(0x7f67000a6610 msgr2=0x7f67000a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:38.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.435+0000 7f6706618700 1 -- 172.21.15.156:0/3785580807 shutdown_connections 2023-09-30T22:22:38.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.435+0000 7f6706618700 1 -- 172.21.15.156:0/3785580807 wait complete. 2023-09-30T22:22:38.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.436+0000 7f6706618700 1 Processor -- start 2023-09-30T22:22:38.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.436+0000 7f6706618700 1 -- start start 2023-09-30T22:22:38.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.436+0000 7f6706618700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67000a0a70 0x7f670011f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.436+0000 7f6706618700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67000a1380 0x7f670011fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.437+0000 7f6706618700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6700133f50 0x7f6700120100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.437+0000 7f6706618700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6700123cb0 con 0x7f67000a1380 2023-09-30T22:22:38.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.437+0000 7f6706618700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6700122b30 con 0x7f67000a0a70 2023-09-30T22:22:38.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.437+0000 7f6706618700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67001231d0 con 0x7f6700133f50 2023-09-30T22:22:38.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.437+0000 7f66fffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67000a0a70 0x7f670011f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.437+0000 7f66fffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67000a0a70 0x7f670011f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33410/0 (socket says 172.21.15.156:33410) 2023-09-30T22:22:38.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.437+0000 7f66fffff700 1 -- 172.21.15.156:0/2317847057 learned_addr learned my addr 172.21.15.156:0/2317847057 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:38.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.437+0000 7f66ff7fe700 1 --2- 172.21.15.156:0/2317847057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67000a1380 0x7f670011fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.437+0000 7f6704bb5700 1 --2- 172.21.15.156:0/2317847057 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6700133f50 0x7f6700120100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.437+0000 7f66fffff700 1 -- 172.21.15.156:0/2317847057 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6700133f50 msgr2=0x7f6700120100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.437+0000 7f66fffff700 1 --2- 172.21.15.156:0/2317847057 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6700133f50 0x7f6700120100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.437+0000 7f66fffff700 1 -- 172.21.15.156:0/2317847057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67000a1380 msgr2=0x7f670011fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.437+0000 7f66fffff700 1 --2- 172.21.15.156:0/2317847057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67000a1380 0x7f670011fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.437+0000 7f66fffff700 1 -- 172.21.15.156:0/2317847057 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f8009a70 con 0x7f67000a0a70 2023-09-30T22:22:38.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.437+0000 7f66fffff700 1 --2- 172.21.15.156:0/2317847057 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67000a0a70 0x7f670011f680 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f66f000e930 tx=0x7f66f000ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:38.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.437+0000 7f66fcff9700 1 -- 172.21.15.156:0/2317847057 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f000c640 con 0x7f67000a0a70 2023-09-30T22:22:38.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.437+0000 7f66fcff9700 1 -- 172.21.15.156:0/2317847057 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f000c7a0 con 0x7f67000a0a70 2023-09-30T22:22:38.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.437+0000 7f66fcff9700 1 -- 172.21.15.156:0/2317847057 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f000cb30 con 0x7f67000a0a70 2023-09-30T22:22:38.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.437+0000 7f6706618700 1 -- 172.21.15.156:0/2317847057 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f4009550 con 0x7f67000a0a70 2023-09-30T22:22:38.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.438+0000 7f6706618700 1 -- 172.21.15.156:0/2317847057 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6700133a10 con 0x7f67000a0a70 2023-09-30T22:22:38.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.438+0000 7f66fcff9700 1 -- 172.21.15.156:0/2317847057 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f66f000cc90 con 0x7f67000a0a70 2023-09-30T22:22:38.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.439+0000 7f66fcff9700 1 -- 172.21.15.156:0/2317847057 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f66f003fa40 con 0x7f67000a0a70 2023-09-30T22:22:38.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.439+0000 7f6706618700 1 -- 172.21.15.156:0/2317847057 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67000a0440 con 0x7f67000a0a70 2023-09-30T22:22:38.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.444+0000 7f66fcff9700 1 -- 172.21.15.156:0/2317847057 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66f001b3b0 con 0x7f67000a0a70 2023-09-30T22:22:38.473 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:38.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.476+0000 7f5d34c7c700 1 Processor -- start 2023-09-30T22:22:38.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.476+0000 7f5d34c7c700 1 -- start start 2023-09-30T22:22:38.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.477+0000 7f5d34c7c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5d300a0a70 0x7f5d300a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.477+0000 7f5d34c7c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d300a1380 0x7f5d30133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.477+0000 7f5d34c7c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d30133f50 0x7f5d301343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.477+0000 7f5d34c7c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d3009e9d0 con 0x7f5d300a0a70 2023-09-30T22:22:38.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.477+0000 7f5d34c7c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3009dc00 con 0x7f5d300a1380 2023-09-30T22:22:38.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.477+0000 7f5d34c7c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3009dec0 con 0x7f5d30133f50 2023-09-30T22:22:38.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.477+0000 7f5d2dd9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d300a1380 0x7f5d30133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.477+0000 7f5d2dd9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d300a1380 0x7f5d30133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33412/0 (socket says 172.21.15.156:33412) 2023-09-30T22:22:38.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.477+0000 7f5d2dd9b700 1 -- 172.21.15.156:0/845940237 learned_addr learned my addr 172.21.15.156:0/845940237 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:38.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.477+0000 7f5d2ed9d700 1 --2- 172.21.15.156:0/845940237 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d30133f50 0x7f5d301343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.477+0000 7f5d2e59c700 1 --2- 172.21.15.156:0/845940237 >> v2:172.21.15.156:3300/0 conn(0x7f5d300a0a70 0x7f5d300a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.477+0000 7f5d2dd9b700 1 -- 172.21.15.156:0/845940237 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d30133f50 msgr2=0x7f5d301343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:38.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.477+0000 7f5d2dd9b700 1 --2- 172.21.15.156:0/845940237 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d30133f50 0x7f5d301343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.477+0000 7f5d2dd9b700 1 -- 172.21.15.156:0/845940237 >> v2:172.21.15.156:3300/0 conn(0x7f5d300a0a70 msgr2=0x7f5d300a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:38.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.477+0000 7f5d2dd9b700 1 --2- 172.21.15.156:0/845940237 >> v2:172.21.15.156:3300/0 conn(0x7f5d300a0a70 0x7f5d300a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.477+0000 7f5d2dd9b700 1 -- 172.21.15.156:0/845940237 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3009e6a0 con 0x7f5d300a1380 2023-09-30T22:22:38.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.477+0000 7f5d2dd9b700 1 --2- 172.21.15.156:0/845940237 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d300a1380 0x7f5d30133a10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5d240098f0 tx=0x7f5d24009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1256a591a3c5a505 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:38.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.478+0000 7f5d2d59a700 1 -- 172.21.15.156:0/845940237 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d24011830 con 0x7f5d300a1380 2023-09-30T22:22:38.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.478+0000 7f5d2d59a700 1 -- 172.21.15.156:0/845940237 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d24011990 con 0x7f5d300a1380 2023-09-30T22:22:38.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.478+0000 7f5d2d59a700 1 -- 172.21.15.156:0/845940237 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d24011d20 con 0x7f5d300a1380 2023-09-30T22:22:38.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.478+0000 7f5d34c7c700 1 -- 172.21.15.156:0/845940237 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d300a1380 msgr2=0x7f5d30133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.478+0000 7f5d34c7c700 1 --2- 172.21.15.156:0/845940237 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d300a1380 0x7f5d30133a10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5d240098f0 tx=0x7f5d24009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:38.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.479+0000 7f5d34c7c700 1 -- 172.21.15.156:0/845940237 shutdown_connections 2023-09-30T22:22:38.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.479+0000 7f5d34c7c700 1 --2- 172.21.15.156:0/845940237 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d30133f50 0x7f5d301343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.479+0000 7f5d34c7c700 1 --2- 172.21.15.156:0/845940237 >> v2:172.21.15.156:3300/0 conn(0x7f5d300a0a70 0x7f5d300a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.479+0000 7f5d34c7c700 1 --2- 172.21.15.156:0/845940237 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d300a1380 0x7f5d30133a10 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.479+0000 7f5d34c7c700 1 -- 172.21.15.156:0/845940237 >> 172.21.15.156:0/845940237 conn(0x7f5d300a6610 msgr2=0x7f5d300a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:38.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.479+0000 7f5d34c7c700 1 -- 172.21.15.156:0/845940237 shutdown_connections 2023-09-30T22:22:38.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.479+0000 7f5d34c7c700 1 -- 172.21.15.156:0/845940237 wait complete. 2023-09-30T22:22:38.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.480+0000 7f5d34c7c700 1 Processor -- start 2023-09-30T22:22:38.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.480+0000 7f5d34c7c700 1 -- start start 2023-09-30T22:22:38.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.480+0000 7f5d34c7c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d300a0a70 0x7f5d3011f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.481+0000 7f5d34c7c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d300a1380 0x7f5d3011f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.481+0000 7f5d34c7c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d30133f50 0x7f5d3011fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.481+0000 7f5d34c7c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d30122650 con 0x7f5d30133f50 2023-09-30T22:22:38.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.481+0000 7f5d34c7c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d300a03e0 con 0x7f5d300a0a70 2023-09-30T22:22:38.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.481+0000 7f5d34c7c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d30120f70 con 0x7f5d300a1380 2023-09-30T22:22:38.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.481+0000 7f5d2ed9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d30133f50 0x7f5d3011fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.481+0000 7f5d2ed9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d30133f50 0x7f5d3011fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36822/0 (socket says 172.21.15.156:36822) 2023-09-30T22:22:38.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.481+0000 7f5d2ed9d700 1 -- 172.21.15.156:0/52547261 learned_addr learned my addr 172.21.15.156:0/52547261 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:38.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.481+0000 7f5d2e59c700 1 --2- 172.21.15.156:0/52547261 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d300a0a70 0x7f5d3011f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.481+0000 7f5d2dd9b700 1 --2- 172.21.15.156:0/52547261 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d300a1380 0x7f5d3011f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.481+0000 7f5d2ed9d700 1 -- 172.21.15.156:0/52547261 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d300a1380 msgr2=0x7f5d3011f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.481+0000 7f5d2ed9d700 1 --2- 172.21.15.156:0/52547261 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d300a1380 0x7f5d3011f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.481+0000 7f5d2ed9d700 1 -- 172.21.15.156:0/52547261 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d300a0a70 msgr2=0x7f5d3011f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.481+0000 7f5d2ed9d700 1 --2- 172.21.15.156:0/52547261 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d300a0a70 0x7f5d3011f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.481+0000 7f5d2ed9d700 1 -- 172.21.15.156:0/52547261 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d24009550 con 0x7f5d30133f50 2023-09-30T22:22:38.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.481+0000 7f5d2e59c700 1 --2- 172.21.15.156:0/52547261 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d300a0a70 0x7f5d3011f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:38.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.481+0000 7f5d2ed9d700 1 --2- 172.21.15.156:0/52547261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d30133f50 0x7f5d3011fdc0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009dd0 tx=0x7f5d2800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:38.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.482+0000 7f5d1effd700 1 -- 172.21.15.156:0/52547261 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d28009c40 con 0x7f5d30133f50 2023-09-30T22:22:38.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.482+0000 7f5d1effd700 1 -- 172.21.15.156:0/52547261 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2800f040 con 0x7f5d30133f50 2023-09-30T22:22:38.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.482+0000 7f5d34c7c700 1 -- 172.21.15.156:0/52547261 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d30133a10 con 0x7f5d30133f50 2023-09-30T22:22:38.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.482+0000 7f5d1effd700 1 -- 172.21.15.156:0/52547261 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d28014480 con 0x7f5d30133f50 2023-09-30T22:22:38.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.482+0000 7f5d34c7c700 1 -- 172.21.15.156:0/52547261 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d30122de0 con 0x7f5d30133f50 2023-09-30T22:22:38.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.483+0000 7f5d1effd700 1 -- 172.21.15.156:0/52547261 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5d280145e0 con 0x7f5d30133f50 2023-09-30T22:22:38.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.483+0000 7f5d1effd700 1 -- 172.21.15.156:0/52547261 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5d2803ff00 con 0x7f5d30133f50 2023-09-30T22:22:38.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.483+0000 7f5d34c7c700 1 -- 172.21.15.156:0/52547261 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d30122b60 con 0x7f5d30133f50 2023-09-30T22:22:38.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.492+0000 7f5d1effd700 1 -- 172.21.15.156:0/52547261 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5d28018020 con 0x7f5d30133f50 2023-09-30T22:22:38.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.600+0000 7f77d305f700 1 Processor -- start 2023-09-30T22:22:38.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.600+0000 7f77d305f700 1 -- start start 2023-09-30T22:22:38.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.600+0000 7f77d305f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f77cc0a0a70 0x7f77cc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.600+0000 7f77d305f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77cc134120 0x7f77cc13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.600+0000 7f77d305f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77cc09dc00 con 0x7f77cc0a1380 2023-09-30T22:22:38.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.600+0000 7f77d305f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77cc09ea90 con 0x7f77cc0a0a70 2023-09-30T22:22:38.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.600+0000 7f77d305f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc09dec0 con 0x7f77cc134120 2023-09-30T22:22:38.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.600+0000 7f77d15fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77cc134120 0x7f77cc13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.600+0000 7f77cbfff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f77cc0a1380 0x7f77cc133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48786/0 (socket says 172.21.15.156:48786) 2023-09-30T22:22:38.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.600+0000 7f77cbfff700 1 -- 172.21.15.156:0/648074531 learned_addr learned my addr 172.21.15.156:0/648074531 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:38.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.601+0000 7f77d0dfb700 1 --2- 172.21.15.156:0/648074531 >> v2:172.21.15.156:3300/0 conn(0x7f77cc0a0a70 0x7f77cc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.601+0000 7f77cb7fe700 1 -- 172.21.15.156:0/648074531 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629397651 0 0) 0x7f77cc09dc00 con 0x7f77cc0a1380 2023-09-30T22:22:38.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.601+0000 7f77d15fc700 1 -- 172.21.15.156:0/648074531 >> v2:172.21.15.156:3300/0 conn(0x7f77cc0a0a70 msgr2=0x7f77cc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:38.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.601+0000 7f77d15fc700 1 --2- 172.21.15.156:0/648074531 >> v2:172.21.15.156:3300/0 conn(0x7f77cc0a0a70 0x7f77cc0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.601+0000 7f77d15fc700 1 -- 172.21.15.156:0/648074531 >> v1:172.21.15.156:6789/0 conn(0x7f77cc0a1380 legacy=0x7f77cc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.601+0000 7f77d15fc700 1 -- 172.21.15.156:0/648074531 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77cc09e6a0 con 0x7f77cc134120 2023-09-30T22:22:38.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.601+0000 7f77d15fc700 1 --2- 172.21.15.156:0/648074531 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77cc134120 0x7f77cc13bce0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f77c4009d90 tx=0x7f77c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6ca9a2d43794677 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:38.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.601+0000 7f77cb7fe700 1 -- 172.21.15.156:0/648074531 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c400e070 con 0x7f77cc134120 2023-09-30T22:22:38.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.601+0000 7f77cb7fe700 1 -- 172.21.15.156:0/648074531 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c400bb20 con 0x7f77cc134120 2023-09-30T22:22:38.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.601+0000 7f77cb7fe700 1 -- 172.21.15.156:0/648074531 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c4012430 con 0x7f77cc134120 2023-09-30T22:22:38.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.602+0000 7f77d305f700 1 -- 172.21.15.156:0/648074531 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77cc134120 msgr2=0x7f77cc13bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.602+0000 7f77d305f700 1 --2- 172.21.15.156:0/648074531 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77cc134120 0x7f77cc13bce0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f77c4009d90 tx=0x7f77c400b330 comp rx=0 tx=0).stop 2023-09-30T22:22:38.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.602+0000 7f77d305f700 1 -- 172.21.15.156:0/648074531 shutdown_connections 2023-09-30T22:22:38.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.602+0000 7f77d305f700 1 --2- 172.21.15.156:0/648074531 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77cc134120 0x7f77cc13bce0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.602+0000 7f77d305f700 1 --2- 172.21.15.156:0/648074531 >> v2:172.21.15.156:3300/0 conn(0x7f77cc0a0a70 0x7f77cc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.602+0000 7f77d305f700 1 -- 172.21.15.156:0/648074531 >> 172.21.15.156:0/648074531 conn(0x7f77cc0a6610 msgr2=0x7f77cc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:38.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.602+0000 7f77d305f700 1 -- 172.21.15.156:0/648074531 shutdown_connections 2023-09-30T22:22:38.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.602+0000 7f77d305f700 1 -- 172.21.15.156:0/648074531 wait complete. 2023-09-30T22:22:38.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.603+0000 7f77d305f700 1 Processor -- start 2023-09-30T22:22:38.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.603+0000 7f77d305f700 1 -- start start 2023-09-30T22:22:38.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.604+0000 7f77d305f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77cc0a0a70 0x7f77cc122690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.604+0000 7f77d305f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77cc0a1380 0x7f77cc122bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.604+0000 7f77d305f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f77cc134120 0x7f77cc123110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.604+0000 7f77d305f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc125c10 con 0x7f77cc0a1380 2023-09-30T22:22:38.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.604+0000 7f77d305f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc1335e0 con 0x7f77cc0a0a70 2023-09-30T22:22:38.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.604+0000 7f77d305f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc0a03e0 con 0x7f77cc134120 2023-09-30T22:22:38.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.604+0000 7f77d0dfb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77cc0a0a70 0x7f77cc122690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.604+0000 7f77d0dfb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77cc0a0a70 0x7f77cc122690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33444/0 (socket says 172.21.15.156:33444) 2023-09-30T22:22:38.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.604+0000 7f77d0dfb700 1 -- 172.21.15.156:0/2628896953 learned_addr learned my addr 172.21.15.156:0/2628896953 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:38.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.604+0000 7f77d15fc700 1 --2- 172.21.15.156:0/2628896953 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f77cc134120 0x7f77cc123110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.604+0000 7f77cbfff700 1 --2- 172.21.15.156:0/2628896953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77cc0a1380 0x7f77cc122bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.605+0000 7f77d0dfb700 1 -- 172.21.15.156:0/2628896953 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f77cc134120 msgr2=0x7f77cc123110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.605+0000 7f77d0dfb700 1 --2- 172.21.15.156:0/2628896953 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f77cc134120 0x7f77cc123110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.605+0000 7f77d0dfb700 1 -- 172.21.15.156:0/2628896953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77cc0a1380 msgr2=0x7f77cc122bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.605+0000 7f77d0dfb700 1 --2- 172.21.15.156:0/2628896953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77cc0a1380 0x7f77cc122bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.605+0000 7f77d0dfb700 1 -- 172.21.15.156:0/2628896953 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c4009a70 con 0x7f77cc0a0a70 2023-09-30T22:22:38.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.605+0000 7f77cbfff700 1 --2- 172.21.15.156:0/2628896953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77cc0a1380 0x7f77cc122bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:38.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.605+0000 7f77d0dfb700 1 --2- 172.21.15.156:0/2628896953 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77cc0a0a70 0x7f77cc122690 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f77c000e9b0 tx=0x7f77c000ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:38.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.605+0000 7f77c97fa700 1 -- 172.21.15.156:0/2628896953 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c0009710 con 0x7f77cc0a0a70 2023-09-30T22:22:38.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.605+0000 7f77c97fa700 1 -- 172.21.15.156:0/2628896953 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c000c850 con 0x7f77cc0a0a70 2023-09-30T22:22:38.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.605+0000 7f77c97fa700 1 -- 172.21.15.156:0/2628896953 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c000cbc0 con 0x7f77cc0a0a70 2023-09-30T22:22:38.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.605+0000 7f77d305f700 1 -- 172.21.15.156:0/2628896953 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77cc123a80 con 0x7f77cc0a0a70 2023-09-30T22:22:38.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.605+0000 7f77d305f700 1 -- 172.21.15.156:0/2628896953 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77cc126940 con 0x7f77cc0a0a70 2023-09-30T22:22:38.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.606+0000 7f77d305f700 1 -- 172.21.15.156:0/2628896953 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77cc125e30 con 0x7f77cc0a0a70 2023-09-30T22:22:38.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.606+0000 7f77c97fa700 1 -- 172.21.15.156:0/2628896953 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f77c000cd20 con 0x7f77cc0a0a70 2023-09-30T22:22:38.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.606+0000 7f77c97fa700 1 -- 172.21.15.156:0/2628896953 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f77c003fc00 con 0x7f77cc0a0a70 2023-09-30T22:22:38.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.615+0000 7f77c97fa700 1 -- 172.21.15.156:0/2628896953 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f77c001b3b0 con 0x7f77cc0a0a70 2023-09-30T22:22:38.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.630+0000 7fb74e2e8700 1 -- 172.21.15.156:0/3744668352 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb7481238a0 con 0x7fb74809f350 2023-09-30T22:22:38.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.630+0000 7fb744ff9700 1 -- 172.21.15.156:0/3744668352 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb73c02b030 con 0x7fb74809f350 2023-09-30T22:22:38.631 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:38.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.632+0000 7fb74e2e8700 1 -- 172.21.15.156:0/3744668352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb74809f350 msgr2=0x7fb748120c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.632+0000 7fb74e2e8700 1 --2- 172.21.15.156:0/3744668352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb74809f350 0x7fb748120c40 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fb73c016000 tx=0x7fb73c004750 comp rx=0 tx=0).stop 2023-09-30T22:22:38.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.632+0000 7fb74e2e8700 1 -- 172.21.15.156:0/3744668352 shutdown_connections 2023-09-30T22:22:38.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.632+0000 7fb74e2e8700 1 --2- 172.21.15.156:0/3744668352 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7481371c0 0x7fb748121180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.632+0000 7fb74e2e8700 1 --2- 172.21.15.156:0/3744668352 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb74809e870 0x7fb748120700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.632+0000 7fb74e2e8700 1 --2- 172.21.15.156:0/3744668352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb74809f350 0x7fb748120c40 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.632+0000 7fb74e2e8700 1 -- 172.21.15.156:0/3744668352 >> 172.21.15.156:0/3744668352 conn(0x7fb7480a4430 msgr2=0x7fb7480a2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:38.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.632+0000 7fb74e2e8700 1 -- 172.21.15.156:0/3744668352 shutdown_connections 2023-09-30T22:22:38.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.632+0000 7fb74e2e8700 1 -- 172.21.15.156:0/3744668352 wait complete. 2023-09-30T22:22:38.645 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:38.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.657+0000 7f6706618700 1 -- 172.21.15.156:0/2317847057 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f670004f2a0 con 0x7f67000a0a70 2023-09-30T22:22:38.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.658+0000 7f66fcff9700 1 -- 172.21.15.156:0/2317847057 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f66f0021020 con 0x7f67000a0a70 2023-09-30T22:22:38.658 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:38.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.660+0000 7f6706618700 1 -- 172.21.15.156:0/2317847057 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67000a0a70 msgr2=0x7f670011f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.660+0000 7f6706618700 1 --2- 172.21.15.156:0/2317847057 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67000a0a70 0x7f670011f680 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f66f000e930 tx=0x7f66f000ec40 comp rx=0 tx=0).stop 2023-09-30T22:22:38.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.660+0000 7f6706618700 1 -- 172.21.15.156:0/2317847057 shutdown_connections 2023-09-30T22:22:38.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.660+0000 7f6706618700 1 --2- 172.21.15.156:0/2317847057 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6700133f50 0x7f6700120100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.660+0000 7f6706618700 1 --2- 172.21.15.156:0/2317847057 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67000a0a70 0x7f670011f680 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.660+0000 7f6706618700 1 --2- 172.21.15.156:0/2317847057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67000a1380 0x7f670011fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.660+0000 7f6706618700 1 -- 172.21.15.156:0/2317847057 >> 172.21.15.156:0/2317847057 conn(0x7f67000a6610 msgr2=0x7f67000a5310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:38.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.660+0000 7f6706618700 1 -- 172.21.15.156:0/2317847057 shutdown_connections 2023-09-30T22:22:38.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.660+0000 7f6706618700 1 -- 172.21.15.156:0/2317847057 wait complete. 2023-09-30T22:22:38.673 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:38.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.724+0000 7f5d34c7c700 1 -- 172.21.15.156:0/52547261 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5d3009b510 con 0x7f5d30133f50 2023-09-30T22:22:38.725 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.724+0000 7f5d1effd700 1 -- 172.21.15.156:0/52547261 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5d280114a0 con 0x7f5d30133f50 2023-09-30T22:22:38.725 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:38.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.726+0000 7f5d34c7c700 1 -- 172.21.15.156:0/52547261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d30133f50 msgr2=0x7f5d3011fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.726+0000 7f5d34c7c700 1 --2- 172.21.15.156:0/52547261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d30133f50 0x7f5d3011fdc0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009dd0 tx=0x7f5d2800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.726+0000 7f5d34c7c700 1 -- 172.21.15.156:0/52547261 shutdown_connections 2023-09-30T22:22:38.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.726+0000 7f5d34c7c700 1 --2- 172.21.15.156:0/52547261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d30133f50 0x7f5d3011fdc0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.726+0000 7f5d34c7c700 1 --2- 172.21.15.156:0/52547261 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d300a0a70 0x7f5d3011f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.726+0000 7f5d34c7c700 1 --2- 172.21.15.156:0/52547261 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d300a1380 0x7f5d3011f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.726+0000 7f5d34c7c700 1 -- 172.21.15.156:0/52547261 >> 172.21.15.156:0/52547261 conn(0x7f5d300a6610 msgr2=0x7f5d300a52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:38.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.726+0000 7f5d34c7c700 1 -- 172.21.15.156:0/52547261 shutdown_connections 2023-09-30T22:22:38.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.726+0000 7f5d34c7c700 1 -- 172.21.15.156:0/52547261 wait complete. 2023-09-30T22:22:38.739 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:38.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.828+0000 7f77d305f700 1 -- 172.21.15.156:0/2628896953 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f77cc04f2a0 con 0x7f77cc0a0a70 2023-09-30T22:22:38.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.828+0000 7f77c97fa700 1 -- 172.21.15.156:0/2628896953 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f77c0021030 con 0x7f77cc0a0a70 2023-09-30T22:22:38.829 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:38.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.830+0000 7f77d305f700 1 -- 172.21.15.156:0/2628896953 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77cc0a0a70 msgr2=0x7f77cc122690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.830+0000 7f77d305f700 1 --2- 172.21.15.156:0/2628896953 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77cc0a0a70 0x7f77cc122690 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f77c000e9b0 tx=0x7f77c000ed70 comp rx=0 tx=0).stop 2023-09-30T22:22:38.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.831+0000 7f77d305f700 1 -- 172.21.15.156:0/2628896953 shutdown_connections 2023-09-30T22:22:38.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.831+0000 7f77d305f700 1 --2- 172.21.15.156:0/2628896953 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f77cc134120 0x7f77cc123110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.831+0000 7f77d305f700 1 --2- 172.21.15.156:0/2628896953 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77cc0a0a70 0x7f77cc122690 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.831+0000 7f77d305f700 1 --2- 172.21.15.156:0/2628896953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77cc0a1380 0x7f77cc122bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.831+0000 7f77d305f700 1 -- 172.21.15.156:0/2628896953 >> 172.21.15.156:0/2628896953 conn(0x7f77cc0a6610 msgr2=0x7f77cc0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:38.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.831+0000 7f77d305f700 1 -- 172.21.15.156:0/2628896953 shutdown_connections 2023-09-30T22:22:38.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:38.831+0000 7f77d305f700 1 -- 172.21.15.156:0/2628896953 wait complete. 2023-09-30T22:22:38.843 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:39.645 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:39.674 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:39.740 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:39.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.784+0000 7f0db0db7700 1 Processor -- start 2023-09-30T22:22:39.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.784+0000 7f0db0db7700 1 -- start start 2023-09-30T22:22:39.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.785+0000 7f0db0db7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0dac136960 0x7f0dac138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.785+0000 7f0db0db7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0dac139280 0x7f0dac13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.785+0000 7f0db0db7700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dac06b2d0 con 0x7f0dac133ad0 2023-09-30T22:22:39.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.785+0000 7f0db0db7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac1345b0 con 0x7f0dac136960 2023-09-30T22:22:39.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.785+0000 7f0db0db7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac133610 con 0x7f0dac139280 2023-09-30T22:22:39.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.785+0000 7f0da9d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0dac136960 0x7f0dac138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.785+0000 7f0da9d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0dac136960 0x7f0dac138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33458/0 (socket says 172.21.15.156:33458) 2023-09-30T22:22:39.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.785+0000 7f0da9d9b700 1 -- 172.21.15.156:0/3703562022 learned_addr learned my addr 172.21.15.156:0/3703562022 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:39.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.785+0000 7f0daa59c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f0dac133ad0 0x7f0dac133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48798/0 (socket says 172.21.15.156:48798) 2023-09-30T22:22:39.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.785+0000 7f0daad9d700 1 --2- 172.21.15.156:0/3703562022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0dac139280 0x7f0dac13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.785+0000 7f0da9d9b700 1 -- 172.21.15.156:0/3703562022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0dac139280 msgr2=0x7f0dac13b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:39.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.785+0000 7f0da9d9b700 1 --2- 172.21.15.156:0/3703562022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0dac139280 0x7f0dac13b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.785+0000 7f0da959a700 1 -- 172.21.15.156:0/3703562022 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741440154 0 0) 0x7f0dac06b2d0 con 0x7f0dac133ad0 2023-09-30T22:22:39.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.785+0000 7f0da9d9b700 1 -- 172.21.15.156:0/3703562022 >> v1:172.21.15.156:6789/0 conn(0x7f0dac133ad0 legacy=0x7f0dac133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.785+0000 7f0da9d9b700 1 -- 172.21.15.156:0/3703562022 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac09a500 con 0x7f0dac136960 2023-09-30T22:22:39.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.785+0000 7f0daad9d700 1 --2- 172.21.15.156:0/3703562022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0dac139280 0x7f0dac13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:39.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.785+0000 7f0da9d9b700 1 --2- 172.21.15.156:0/3703562022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0dac136960 0x7f0dac138d40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0da0009920 tx=0x7f0da0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60561972e7ea9da8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:39.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.785+0000 7f0da959a700 1 -- 172.21.15.156:0/3703562022 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da0011830 con 0x7f0dac136960 2023-09-30T22:22:39.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.785+0000 7f0da959a700 1 -- 172.21.15.156:0/3703562022 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da0011990 con 0x7f0dac136960 2023-09-30T22:22:39.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.785+0000 7f0da959a700 1 -- 172.21.15.156:0/3703562022 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da0011d20 con 0x7f0dac136960 2023-09-30T22:22:39.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.786+0000 7f0db0db7700 1 -- 172.21.15.156:0/3703562022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0dac136960 msgr2=0x7f0dac138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.786+0000 7f0db0db7700 1 --2- 172.21.15.156:0/3703562022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0dac136960 0x7f0dac138d40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0da0009920 tx=0x7f0da0009c30 comp rx=0 tx=0).stop 2023-09-30T22:22:39.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.786+0000 7f0db0db7700 1 -- 172.21.15.156:0/3703562022 shutdown_connections 2023-09-30T22:22:39.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.786+0000 7f0db0db7700 1 --2- 172.21.15.156:0/3703562022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0dac139280 0x7f0dac13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.786+0000 7f0db0db7700 1 --2- 172.21.15.156:0/3703562022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0dac136960 0x7f0dac138d40 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.786+0000 7f0db0db7700 1 -- 172.21.15.156:0/3703562022 >> 172.21.15.156:0/3703562022 conn(0x7f0dac099c40 msgr2=0x7f0dac0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:39.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.786+0000 7f0db0db7700 1 -- 172.21.15.156:0/3703562022 shutdown_connections 2023-09-30T22:22:39.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.786+0000 7f0db0db7700 1 -- 172.21.15.156:0/3703562022 wait complete. 2023-09-30T22:22:39.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.788+0000 7f0db0db7700 1 Processor -- start 2023-09-30T22:22:39.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.788+0000 7f0db0db7700 1 -- start start 2023-09-30T22:22:39.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.788+0000 7f0db0db7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dac133ad0 0x7f0dac071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.788+0000 7f0db0db7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0dac136960 0x7f0dac071690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.788+0000 7f0db0db7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0dac139280 0x7f0dac071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.788+0000 7f0db0db7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac0722c0 con 0x7f0dac133ad0 2023-09-30T22:22:39.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.788+0000 7f0db0db7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac06ffd0 con 0x7f0dac139280 2023-09-30T22:22:39.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.788+0000 7f0db0db7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac09f390 con 0x7f0dac136960 2023-09-30T22:22:39.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.789+0000 7f0daa59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dac133ad0 0x7f0dac071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.789+0000 7f0daa59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dac133ad0 0x7f0dac071150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36866/0 (socket says 172.21.15.156:36866) 2023-09-30T22:22:39.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.789+0000 7f0da9d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0dac136960 0x7f0dac071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.789+0000 7f0daa59c700 1 -- 172.21.15.156:0/1220885053 learned_addr learned my addr 172.21.15.156:0/1220885053 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:39.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.789+0000 7f0daad9d700 1 --2- 172.21.15.156:0/1220885053 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0dac139280 0x7f0dac071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.789+0000 7f0da9d9b700 1 -- 172.21.15.156:0/1220885053 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0dac139280 msgr2=0x7f0dac071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.789+0000 7f0da9d9b700 1 --2- 172.21.15.156:0/1220885053 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0dac139280 0x7f0dac071bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.789+0000 7f0da9d9b700 1 -- 172.21.15.156:0/1220885053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dac133ad0 msgr2=0x7f0dac071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.789+0000 7f0da9d9b700 1 --2- 172.21.15.156:0/1220885053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dac133ad0 0x7f0dac071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.789+0000 7f0da9d9b700 1 -- 172.21.15.156:0/1220885053 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da4009a70 con 0x7f0dac136960 2023-09-30T22:22:39.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.789+0000 7f0daa59c700 1 --2- 172.21.15.156:0/1220885053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dac133ad0 0x7f0dac071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:39.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.789+0000 7f0da9d9b700 1 --2- 172.21.15.156:0/1220885053 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0dac136960 0x7f0dac071690 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0da0016000 tx=0x7f0da0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:39.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.789+0000 7f0d9affd700 1 -- 172.21.15.156:0/1220885053 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da0004450 con 0x7f0dac136960 2023-09-30T22:22:39.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.789+0000 7f0d9affd700 1 -- 172.21.15.156:0/1220885053 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da00045b0 con 0x7f0dac136960 2023-09-30T22:22:39.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.789+0000 7f0d9affd700 1 -- 172.21.15.156:0/1220885053 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da00038c0 con 0x7f0dac136960 2023-09-30T22:22:39.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.789+0000 7f0db0db7700 1 -- 172.21.15.156:0/1220885053 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da0009550 con 0x7f0dac136960 2023-09-30T22:22:39.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.789+0000 7f0db0db7700 1 -- 172.21.15.156:0/1220885053 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dac130e50 con 0x7f0dac136960 2023-09-30T22:22:39.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.790+0000 7f0d9affd700 1 -- 172.21.15.156:0/1220885053 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0da0021030 con 0x7f0dac136960 2023-09-30T22:22:39.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.790+0000 7f0db0db7700 1 -- 172.21.15.156:0/1220885053 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dac070e20 con 0x7f0dac136960 2023-09-30T22:22:39.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.791+0000 7f0d9affd700 1 -- 172.21.15.156:0/1220885053 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0da00409e0 con 0x7f0dac136960 2023-09-30T22:22:39.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.795+0000 7f0d9affd700 1 -- 172.21.15.156:0/1220885053 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0da002d990 con 0x7f0dac136960 2023-09-30T22:22:39.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.822+0000 7fabc1a3a700 1 Processor -- start 2023-09-30T22:22:39.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.822+0000 7fabc1a3a700 1 -- start start 2023-09-30T22:22:39.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.822+0000 7fabc1a3a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fabbc09ad40 0x7fabbc133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.822+0000 7fabc1a3a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabbc1343d0 0x7fabbc0a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.822+0000 7fabc1a3a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabbc09b110 con 0x7fabbc133f70 2023-09-30T22:22:39.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.822+0000 7fabc1a3a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabbc0a3b60 con 0x7fabbc09ad40 2023-09-30T22:22:39.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.822+0000 7fabc1a3a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc134850 con 0x7fabbc1343d0 2023-09-30T22:22:39.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.822+0000 7fabbaffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fabbc09ad40 0x7fabbc133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.823+0000 7fabba7fc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fabbc133f70 0x7fabbc0a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48804/0 (socket says 172.21.15.156:48804) 2023-09-30T22:22:39.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.823+0000 7fabba7fc700 1 -- 172.21.15.156:0/3267402477 learned_addr learned my addr 172.21.15.156:0/3267402477 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:39.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.823+0000 7fabbb7fe700 1 --2- 172.21.15.156:0/3267402477 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabbc1343d0 0x7fabbc0a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.823+0000 7fabbaffd700 1 -- 172.21.15.156:0/3267402477 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabbc1343d0 msgr2=0x7fabbc0a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:39.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.823+0000 7fabbaffd700 1 --2- 172.21.15.156:0/3267402477 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabbc1343d0 0x7fabbc0a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.823+0000 7fabbaffd700 1 -- 172.21.15.156:0/3267402477 >> v1:172.21.15.156:6789/0 conn(0x7fabbc133f70 legacy=0x7fabbc0a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.823+0000 7fabbaffd700 1 -- 172.21.15.156:0/3267402477 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc0a2fa0 con 0x7fabbc09ad40 2023-09-30T22:22:39.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.823+0000 7fabbb7fe700 1 --2- 172.21.15.156:0/3267402477 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabbc1343d0 0x7fabbc0a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:39.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.823+0000 7fabbaffd700 1 --2- 172.21.15.156:0/3267402477 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabbc09ad40 0x7fabbc133a30 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fabac009840 tx=0x7fabac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1fcc4bb6bbfe686 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:39.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.823+0000 7fabb9ffb700 1 -- 172.21.15.156:0/3267402477 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac011830 con 0x7fabbc09ad40 2023-09-30T22:22:39.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.823+0000 7fabb9ffb700 1 -- 172.21.15.156:0/3267402477 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabac011990 con 0x7fabbc09ad40 2023-09-30T22:22:39.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.823+0000 7fabb9ffb700 1 -- 172.21.15.156:0/3267402477 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac011d20 con 0x7fabbc09ad40 2023-09-30T22:22:39.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.824+0000 7fabc1a3a700 1 -- 172.21.15.156:0/3267402477 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabbc09ad40 msgr2=0x7fabbc133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.824+0000 7fabc1a3a700 1 --2- 172.21.15.156:0/3267402477 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabbc09ad40 0x7fabbc133a30 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fabac009840 tx=0x7fabac009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:39.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.824+0000 7fabc1a3a700 1 -- 172.21.15.156:0/3267402477 shutdown_connections 2023-09-30T22:22:39.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.824+0000 7fabc1a3a700 1 --2- 172.21.15.156:0/3267402477 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabbc1343d0 0x7fabbc0a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.824+0000 7fabc1a3a700 1 --2- 172.21.15.156:0/3267402477 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabbc09ad40 0x7fabbc133a30 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.824+0000 7fabc1a3a700 1 -- 172.21.15.156:0/3267402477 >> 172.21.15.156:0/3267402477 conn(0x7fabbc099c40 msgr2=0x7fabbc06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:39.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.824+0000 7fabc1a3a700 1 -- 172.21.15.156:0/3267402477 shutdown_connections 2023-09-30T22:22:39.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.824+0000 7fabc1a3a700 1 -- 172.21.15.156:0/3267402477 wait complete. 2023-09-30T22:22:39.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.825+0000 7fabc1a3a700 1 Processor -- start 2023-09-30T22:22:39.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.825+0000 7fabc1a3a700 1 -- start start 2023-09-30T22:22:39.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.825+0000 7fabc1a3a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabbc09ad40 0x7fabbc1202a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.825+0000 7fabc1a3a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabbc133f70 0x7fabbc1207e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.825+0000 7fabc1a3a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabbc1343d0 0x7fabbc120d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.825+0000 7fabc1a3a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc121eb0 con 0x7fabbc133f70 2023-09-30T22:22:39.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.825+0000 7fabc1a3a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc1224d0 con 0x7fabbc09ad40 2023-09-30T22:22:39.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.825+0000 7fabc1a3a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc123100 con 0x7fabbc1343d0 2023-09-30T22:22:39.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.826+0000 7fabbaffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabbc09ad40 0x7fabbc1202a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.826+0000 7fabbaffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabbc09ad40 0x7fabbc1202a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33472/0 (socket says 172.21.15.156:33472) 2023-09-30T22:22:39.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.826+0000 7fabbaffd700 1 -- 172.21.15.156:0/2263232661 learned_addr learned my addr 172.21.15.156:0/2263232661 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:39.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.826+0000 7fabba7fc700 1 --2- 172.21.15.156:0/2263232661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabbc133f70 0x7fabbc1207e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.826+0000 7fabbb7fe700 1 --2- 172.21.15.156:0/2263232661 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabbc1343d0 0x7fabbc120d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.826+0000 7fabbaffd700 1 -- 172.21.15.156:0/2263232661 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabbc1343d0 msgr2=0x7fabbc120d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.826+0000 7fabbaffd700 1 --2- 172.21.15.156:0/2263232661 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabbc1343d0 0x7fabbc120d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.826+0000 7fabbaffd700 1 -- 172.21.15.156:0/2263232661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabbc133f70 msgr2=0x7fabbc1207e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.826+0000 7fabbaffd700 1 --2- 172.21.15.156:0/2263232661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabbc133f70 0x7fabbc1207e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.826+0000 7fabbaffd700 1 -- 172.21.15.156:0/2263232661 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb4009a70 con 0x7fabbc09ad40 2023-09-30T22:22:39.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.826+0000 7fabbaffd700 1 --2- 172.21.15.156:0/2263232661 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabbc09ad40 0x7fabbc1202a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fabac009fd0 tx=0x7fabac004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:39.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.826+0000 7faba3fff700 1 -- 172.21.15.156:0/2263232661 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac0045d0 con 0x7fabbc09ad40 2023-09-30T22:22:39.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.826+0000 7faba3fff700 1 -- 172.21.15.156:0/2263232661 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabac01e070 con 0x7fabbc09ad40 2023-09-30T22:22:39.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.826+0000 7fabc1a3a700 1 -- 172.21.15.156:0/2263232661 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabac0094a0 con 0x7fabbc09ad40 2023-09-30T22:22:39.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.826+0000 7faba3fff700 1 -- 172.21.15.156:0/2263232661 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac0038e0 con 0x7fabbc09ad40 2023-09-30T22:22:39.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.826+0000 7fabc1a3a700 1 -- 172.21.15.156:0/2263232661 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabbc0a44e0 con 0x7fabbc09ad40 2023-09-30T22:22:39.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.827+0000 7fabc1a3a700 1 -- 172.21.15.156:0/2263232661 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabbc0a5180 con 0x7fabbc09ad40 2023-09-30T22:22:39.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.827+0000 7faba3fff700 1 -- 172.21.15.156:0/2263232661 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fabac003a40 con 0x7fabbc09ad40 2023-09-30T22:22:39.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.828+0000 7faba3fff700 1 -- 172.21.15.156:0/2263232661 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fabac0404e0 con 0x7fabbc09ad40 2023-09-30T22:22:39.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.832+0000 7faba3fff700 1 -- 172.21.15.156:0/2263232661 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fabac02d450 con 0x7fabbc09ad40 2023-09-30T22:22:39.845 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:39.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.874+0000 7f423cadf700 1 Processor -- start 2023-09-30T22:22:39.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.874+0000 7f423cadf700 1 -- start start 2023-09-30T22:22:39.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.874+0000 7f423cadf700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f423809d860 0x7f423809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.874+0000 7f423cadf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4238130eb0 0x7f4238138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.874+0000 7f423cadf700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f423809aaa0 con 0x7f423809e170 2023-09-30T22:22:39.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.874+0000 7f423cadf700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f423809f870 con 0x7f423809d860 2023-09-30T22:22:39.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.874+0000 7f423cadf700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423809b360 con 0x7f4238130eb0 2023-09-30T22:22:39.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.875+0000 7f4236d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4238130eb0 0x7f4238138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.875+0000 7f4236d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4238130eb0 0x7f4238138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33482/0 (socket says 172.21.15.156:33482) 2023-09-30T22:22:39.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.875+0000 7f4236d9d700 1 -- 172.21.15.156:0/2475443823 learned_addr learned my addr 172.21.15.156:0/2475443823 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:39.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.875+0000 7f4235d9b700 1 --1- 172.21.15.156:0/2475443823 >> v1:172.21.15.156:6789/0 conn(0x7f423809e170 0x7f42381307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48816/0 (socket says 172.21.15.156:48816) 2023-09-30T22:22:39.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.875+0000 7f423659c700 1 --2- 172.21.15.156:0/2475443823 >> v2:172.21.15.156:3300/0 conn(0x7f423809d860 0x7f423809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.875+0000 7f4236d9d700 1 -- 172.21.15.156:0/2475443823 >> v2:172.21.15.156:3300/0 conn(0x7f423809d860 msgr2=0x7f423809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:39.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.875+0000 7f4236d9d700 1 --2- 172.21.15.156:0/2475443823 >> v2:172.21.15.156:3300/0 conn(0x7f423809d860 0x7f423809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.875+0000 7f423559a700 1 -- 172.21.15.156:0/2475443823 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4183303398 0 0) 0x7f423809aaa0 con 0x7f423809e170 2023-09-30T22:22:39.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.875+0000 7f4236d9d700 1 -- 172.21.15.156:0/2475443823 >> v1:172.21.15.156:6789/0 conn(0x7f423809e170 legacy=0x7f42381307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.875+0000 7f4236d9d700 1 -- 172.21.15.156:0/2475443823 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423809b620 con 0x7f4238130eb0 2023-09-30T22:22:39.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.875+0000 7f4236d9d700 1 --2- 172.21.15.156:0/2475443823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4238130eb0 0x7f4238138a00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4230009e50 tx=0x7f423000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d098782c51a9ae6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:39.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.875+0000 7f423559a700 1 -- 172.21.15.156:0/2475443823 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423000e070 con 0x7f4238130eb0 2023-09-30T22:22:39.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.875+0000 7f423559a700 1 -- 172.21.15.156:0/2475443823 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423000bbc0 con 0x7f4238130eb0 2023-09-30T22:22:39.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.875+0000 7f423559a700 1 -- 172.21.15.156:0/2475443823 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42300126e0 con 0x7f4238130eb0 2023-09-30T22:22:39.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.876+0000 7f423cadf700 1 -- 172.21.15.156:0/2475443823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4238130eb0 msgr2=0x7f4238138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.876+0000 7f423cadf700 1 --2- 172.21.15.156:0/2475443823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4238130eb0 0x7f4238138a00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4230009e50 tx=0x7f423000b330 comp rx=0 tx=0).stop 2023-09-30T22:22:39.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.876+0000 7f423cadf700 1 -- 172.21.15.156:0/2475443823 shutdown_connections 2023-09-30T22:22:39.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.877+0000 7f423cadf700 1 --2- 172.21.15.156:0/2475443823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4238130eb0 0x7f4238138a00 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.877+0000 7f423cadf700 1 --2- 172.21.15.156:0/2475443823 >> v2:172.21.15.156:3300/0 conn(0x7f423809d860 0x7f423809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.877+0000 7f423cadf700 1 -- 172.21.15.156:0/2475443823 >> 172.21.15.156:0/2475443823 conn(0x7f4238099c40 msgr2=0x7f42380a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:39.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.877+0000 7f423cadf700 1 -- 172.21.15.156:0/2475443823 shutdown_connections 2023-09-30T22:22:39.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.877+0000 7f423cadf700 1 -- 172.21.15.156:0/2475443823 wait complete. 2023-09-30T22:22:39.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.878+0000 7f423cadf700 1 Processor -- start 2023-09-30T22:22:39.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.878+0000 7f423cadf700 1 -- start start 2023-09-30T22:22:39.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.879+0000 7f423cadf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f423809d860 0x7f423811e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.879+0000 7f423cadf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f423809e170 0x7f423811e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.879+0000 7f423cadf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4238130eb0 0x7f423811eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.879+0000 7f423cadf700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423809c8b0 con 0x7f423809d860 2023-09-30T22:22:39.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.879+0000 7f423cadf700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4238072000 con 0x7f423809e170 2023-09-30T22:22:39.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.879+0000 7f423cadf700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4238120d50 con 0x7f4238130eb0 2023-09-30T22:22:39.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.879+0000 7f4236d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4238130eb0 0x7f423811eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.879+0000 7f4235d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f423809e170 0x7f423811e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.879+0000 7f4236d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4238130eb0 0x7f423811eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56056/0 (socket says 172.21.15.156:56056) 2023-09-30T22:22:39.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.879+0000 7f4236d9d700 1 -- 172.21.15.156:0/4123142570 learned_addr learned my addr 172.21.15.156:0/4123142570 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:39.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.879+0000 7f423659c700 1 --2- 172.21.15.156:0/4123142570 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f423809d860 0x7f423811e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.880+0000 7f423659c700 1 -- 172.21.15.156:0/4123142570 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4238130eb0 msgr2=0x7f423811eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.880+0000 7f423659c700 1 --2- 172.21.15.156:0/4123142570 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4238130eb0 0x7f423811eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.880+0000 7f423659c700 1 -- 172.21.15.156:0/4123142570 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f423809e170 msgr2=0x7f423811e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.880+0000 7f423659c700 1 --2- 172.21.15.156:0/4123142570 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f423809e170 0x7f423811e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.880+0000 7f423659c700 1 -- 172.21.15.156:0/4123142570 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4230009b30 con 0x7f423809d860 2023-09-30T22:22:39.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.880+0000 7f4235d9b700 1 --2- 172.21.15.156:0/4123142570 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f423809e170 0x7f423811e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:39.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.880+0000 7f423659c700 1 --2- 172.21.15.156:0/4123142570 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f423809d860 0x7f423811e320 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f422800e7e0 tx=0x7f422800eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:39.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.880+0000 7f4226ffd700 1 -- 172.21.15.156:0/4123142570 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422800c070 con 0x7f423809d860 2023-09-30T22:22:39.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.880+0000 7f4226ffd700 1 -- 172.21.15.156:0/4123142570 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4228013610 con 0x7f423809d860 2023-09-30T22:22:39.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.880+0000 7f4226ffd700 1 -- 172.21.15.156:0/4123142570 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42280139a0 con 0x7f423809d860 2023-09-30T22:22:39.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.880+0000 7f423cadf700 1 -- 172.21.15.156:0/4123142570 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42381215d0 con 0x7f423809d860 2023-09-30T22:22:39.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.880+0000 7f423cadf700 1 -- 172.21.15.156:0/4123142570 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42381225d0 con 0x7f423809d860 2023-09-30T22:22:39.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.881+0000 7f4226ffd700 1 -- 172.21.15.156:0/4123142570 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4228013b00 con 0x7f423809d860 2023-09-30T22:22:39.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.882+0000 7f4226ffd700 1 -- 172.21.15.156:0/4123142570 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f422803f370 con 0x7f423809d860 2023-09-30T22:22:39.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.882+0000 7f423cadf700 1 -- 172.21.15.156:0/4123142570 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f423804f2a0 con 0x7f423809d860 2023-09-30T22:22:39.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.890+0000 7f4226ffd700 1 -- 172.21.15.156:0/4123142570 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f42280108e0 con 0x7f423809d860 2023-09-30T22:22:39.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.977+0000 7fb35abc5700 1 Processor -- start 2023-09-30T22:22:39.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.977+0000 7fb35abc5700 1 -- start start 2023-09-30T22:22:39.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.977+0000 7fb35abc5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb35409a150 0x7fb35409e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.977+0000 7fb35abc5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb35409edb0 0x7fb35409f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.977+0000 7fb35abc5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb354133c20 0x7fb3541340a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.977+0000 7fb35abc5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb35409a520 con 0x7fb35409edb0 2023-09-30T22:22:39.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.977+0000 7fb35abc5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35409fe00 con 0x7fb354133c20 2023-09-30T22:22:39.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.977+0000 7fb35abc5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb35406bec0 con 0x7fb35409a150 2023-09-30T22:22:39.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.978+0000 7fb353fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb35409edb0 0x7fb35409f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.978+0000 7fb353fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb35409edb0 0x7fb35409f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36904/0 (socket says 172.21.15.156:36904) 2023-09-30T22:22:39.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.978+0000 7fb353fff700 1 -- 172.21.15.156:0/2546115332 learned_addr learned my addr 172.21.15.156:0/2546115332 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:39.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.978+0000 7fb358961700 1 --2- 172.21.15.156:0/2546115332 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb35409a150 0x7fb35409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.978+0000 7fb359162700 1 --2- 172.21.15.156:0/2546115332 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb354133c20 0x7fb3541340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.978+0000 7fb353fff700 1 -- 172.21.15.156:0/2546115332 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb35409a150 msgr2=0x7fb35409e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:39.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.978+0000 7fb353fff700 1 --2- 172.21.15.156:0/2546115332 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb35409a150 0x7fb35409e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.978+0000 7fb353fff700 1 -- 172.21.15.156:0/2546115332 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb354133c20 msgr2=0x7fb3541340a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:39.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.978+0000 7fb353fff700 1 --2- 172.21.15.156:0/2546115332 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb354133c20 0x7fb3541340a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.978+0000 7fb353fff700 1 -- 172.21.15.156:0/2546115332 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35409af80 con 0x7fb35409edb0 2023-09-30T22:22:39.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.978+0000 7fb353fff700 1 --2- 172.21.15.156:0/2546115332 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb35409edb0 0x7fb35409f1a0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fb340009920 tx=0x7fb340009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6bb43a525c30d90 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:39.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.978+0000 7fb3537fe700 1 -- 172.21.15.156:0/2546115332 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb340011830 con 0x7fb35409edb0 2023-09-30T22:22:39.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.979+0000 7fb3537fe700 1 -- 172.21.15.156:0/2546115332 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb340011990 con 0x7fb35409edb0 2023-09-30T22:22:39.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.979+0000 7fb3537fe700 1 -- 172.21.15.156:0/2546115332 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb340011d20 con 0x7fb35409edb0 2023-09-30T22:22:39.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.979+0000 7fb35abc5700 1 -- 172.21.15.156:0/2546115332 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb35409edb0 msgr2=0x7fb35409f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.979+0000 7fb35abc5700 1 --2- 172.21.15.156:0/2546115332 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb35409edb0 0x7fb35409f1a0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fb340009920 tx=0x7fb340009c30 comp rx=0 tx=0).stop 2023-09-30T22:22:39.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.979+0000 7fb35abc5700 1 -- 172.21.15.156:0/2546115332 shutdown_connections 2023-09-30T22:22:39.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.979+0000 7fb35abc5700 1 --2- 172.21.15.156:0/2546115332 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb354133c20 0x7fb3541340a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.979+0000 7fb35abc5700 1 --2- 172.21.15.156:0/2546115332 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb35409a150 0x7fb35409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.979+0000 7fb35abc5700 1 --2- 172.21.15.156:0/2546115332 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb35409edb0 0x7fb35409f1a0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.979+0000 7fb35abc5700 1 -- 172.21.15.156:0/2546115332 >> 172.21.15.156:0/2546115332 conn(0x7fb3540a4430 msgr2=0x7fb3540a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:39.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.979+0000 7fb35abc5700 1 -- 172.21.15.156:0/2546115332 shutdown_connections 2023-09-30T22:22:39.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.979+0000 7fb35abc5700 1 -- 172.21.15.156:0/2546115332 wait complete. 2023-09-30T22:22:39.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.981+0000 7fb35abc5700 1 Processor -- start 2023-09-30T22:22:39.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.981+0000 7fb35abc5700 1 -- start start 2023-09-30T22:22:39.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.982+0000 7fb35abc5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb35409a150 0x7fb35411ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.982+0000 7fb35abc5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb35409edb0 0x7fb35411f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.982+0000 7fb35abc5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb354133c20 0x7fb35411f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.982+0000 7fb35abc5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb354121f90 con 0x7fb354133c20 2023-09-30T22:22:39.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.982+0000 7fb35abc5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3540a0440 con 0x7fb35409a150 2023-09-30T22:22:39.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.982+0000 7fb35abc5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb354120650 con 0x7fb35409edb0 2023-09-30T22:22:39.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.982+0000 7fb358961700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb35409a150 0x7fb35411ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.982+0000 7fb358961700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb35409a150 0x7fb35411ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33492/0 (socket says 172.21.15.156:33492) 2023-09-30T22:22:39.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.982+0000 7fb358961700 1 -- 172.21.15.156:0/3373480978 learned_addr learned my addr 172.21.15.156:0/3373480978 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:39.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.982+0000 7fb353fff700 1 --2- 172.21.15.156:0/3373480978 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb35409edb0 0x7fb35411f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.982+0000 7fb359162700 1 --2- 172.21.15.156:0/3373480978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb354133c20 0x7fb35411f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.982+0000 7fb358961700 1 -- 172.21.15.156:0/3373480978 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb35409edb0 msgr2=0x7fb35411f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.982+0000 7fb358961700 1 --2- 172.21.15.156:0/3373480978 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb35409edb0 0x7fb35411f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.982+0000 7fb358961700 1 -- 172.21.15.156:0/3373480978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb354133c20 msgr2=0x7fb35411f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.982+0000 7fb358961700 1 --2- 172.21.15.156:0/3373480978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb354133c20 0x7fb35411f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.982+0000 7fb358961700 1 -- 172.21.15.156:0/3373480978 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb340009550 con 0x7fb35409a150 2023-09-30T22:22:39.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.982+0000 7fb353fff700 1 --2- 172.21.15.156:0/3373480978 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb35409edb0 0x7fb35411f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:39.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.982+0000 7fb358961700 1 --2- 172.21.15.156:0/3373480978 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb35409a150 0x7fb35411ead0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb34800e870 tx=0x7fb34800eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:39.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.983+0000 7fb3517fa700 1 -- 172.21.15.156:0/3373480978 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348009590 con 0x7fb35409a150 2023-09-30T22:22:39.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.983+0000 7fb3517fa700 1 -- 172.21.15.156:0/3373480978 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb348013680 con 0x7fb35409a150 2023-09-30T22:22:39.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.983+0000 7fb35abc5700 1 -- 172.21.15.156:0/3373480978 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3541221e0 con 0x7fb35409a150 2023-09-30T22:22:39.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.983+0000 7fb3517fa700 1 -- 172.21.15.156:0/3373480978 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3480139f0 con 0x7fb35409a150 2023-09-30T22:22:39.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.983+0000 7fb35abc5700 1 -- 172.21.15.156:0/3373480978 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3540a14e0 con 0x7fb35409a150 2023-09-30T22:22:39.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.984+0000 7fb3517fa700 1 -- 172.21.15.156:0/3373480978 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb348013b50 con 0x7fb35409a150 2023-09-30T22:22:39.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.984+0000 7fb35abc5700 1 -- 172.21.15.156:0/3373480978 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb35409fa30 con 0x7fb35409a150 2023-09-30T22:22:39.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.984+0000 7fb3517fa700 1 -- 172.21.15.156:0/3373480978 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb34803f6c0 con 0x7fb35409a150 2023-09-30T22:22:39.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:39.993+0000 7fb3517fa700 1 -- 172.21.15.156:0/3373480978 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb34800c970 con 0x7fb35409a150 2023-09-30T22:22:40.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.015+0000 7f0db0db7700 1 -- 172.21.15.156:0/1220885053 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0dac04f2a0 con 0x7f0dac136960 2023-09-30T22:22:40.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.015+0000 7f0d9affd700 1 -- 172.21.15.156:0/1220885053 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0da0029070 con 0x7f0dac136960 2023-09-30T22:22:40.016 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:40.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.018+0000 7f0db0db7700 1 -- 172.21.15.156:0/1220885053 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0dac136960 msgr2=0x7f0dac071690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:40.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.018+0000 7f0db0db7700 1 --2- 172.21.15.156:0/1220885053 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0dac136960 0x7f0dac071690 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0da0016000 tx=0x7f0da0004750 comp rx=0 tx=0).stop 2023-09-30T22:22:40.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.018+0000 7f0db0db7700 1 -- 172.21.15.156:0/1220885053 shutdown_connections 2023-09-30T22:22:40.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.018+0000 7f0db0db7700 1 --2- 172.21.15.156:0/1220885053 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0dac139280 0x7f0dac071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:40.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.018+0000 7f0db0db7700 1 --2- 172.21.15.156:0/1220885053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dac133ad0 0x7f0dac071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:40.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.018+0000 7f0db0db7700 1 --2- 172.21.15.156:0/1220885053 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0dac136960 0x7f0dac071690 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:40.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.018+0000 7f0db0db7700 1 -- 172.21.15.156:0/1220885053 >> 172.21.15.156:0/1220885053 conn(0x7f0dac099c40 msgr2=0x7f0dac134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:40.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.018+0000 7f0db0db7700 1 -- 172.21.15.156:0/1220885053 shutdown_connections 2023-09-30T22:22:40.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.018+0000 7f0db0db7700 1 -- 172.21.15.156:0/1220885053 wait complete. 2023-09-30T22:22:40.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:40.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.037+0000 7fabc1a3a700 1 -- 172.21.15.156:0/2263232661 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fabbc09c7e0 con 0x7fabbc09ad40 2023-09-30T22:22:40.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.037+0000 7faba3fff700 1 -- 172.21.15.156:0/2263232661 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fabac015030 con 0x7fabbc09ad40 2023-09-30T22:22:40.038 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:40.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.039+0000 7fabc1a3a700 1 -- 172.21.15.156:0/2263232661 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabbc09ad40 msgr2=0x7fabbc1202a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:40.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.039+0000 7fabc1a3a700 1 --2- 172.21.15.156:0/2263232661 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabbc09ad40 0x7fabbc1202a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fabac009fd0 tx=0x7fabac004750 comp rx=0 tx=0).stop 2023-09-30T22:22:40.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.039+0000 7fabc1a3a700 1 -- 172.21.15.156:0/2263232661 shutdown_connections 2023-09-30T22:22:40.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.039+0000 7fabc1a3a700 1 --2- 172.21.15.156:0/2263232661 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabbc1343d0 0x7fabbc120d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:40.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.039+0000 7fabc1a3a700 1 --2- 172.21.15.156:0/2263232661 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabbc09ad40 0x7fabbc1202a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:40.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.040+0000 7fabc1a3a700 1 --2- 172.21.15.156:0/2263232661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabbc133f70 0x7fabbc1207e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:40.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.040+0000 7fabc1a3a700 1 -- 172.21.15.156:0/2263232661 >> 172.21.15.156:0/2263232661 conn(0x7fabbc099c40 msgr2=0x7fabbc1bb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:40.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.040+0000 7fabc1a3a700 1 -- 172.21.15.156:0/2263232661 shutdown_connections 2023-09-30T22:22:40.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.040+0000 7fabc1a3a700 1 -- 172.21.15.156:0/2263232661 wait complete. 2023-09-30T22:22:40.052 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:40.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.091+0000 7f423cadf700 1 -- 172.21.15.156:0/4123142570 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f423806c3b0 con 0x7f423809d860 2023-09-30T22:22:40.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.092+0000 7f4226ffd700 1 -- 172.21.15.156:0/4123142570 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f422802b090 con 0x7f423809d860 2023-09-30T22:22:40.093 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:40.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.094+0000 7f423cadf700 1 -- 172.21.15.156:0/4123142570 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f423809d860 msgr2=0x7f423811e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:40.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.094+0000 7f423cadf700 1 --2- 172.21.15.156:0/4123142570 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f423809d860 0x7f423811e320 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f422800e7e0 tx=0x7f422800eaf0 comp rx=0 tx=0).stop 2023-09-30T22:22:40.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.094+0000 7f423cadf700 1 -- 172.21.15.156:0/4123142570 shutdown_connections 2023-09-30T22:22:40.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.094+0000 7f423cadf700 1 --2- 172.21.15.156:0/4123142570 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4238130eb0 0x7f423811eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:40.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.094+0000 7f423cadf700 1 --2- 172.21.15.156:0/4123142570 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f423809d860 0x7f423811e320 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:40.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.094+0000 7f423cadf700 1 --2- 172.21.15.156:0/4123142570 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f423809e170 0x7f423811e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:40.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.094+0000 7f423cadf700 1 -- 172.21.15.156:0/4123142570 >> 172.21.15.156:0/4123142570 conn(0x7f4238099c40 msgr2=0x7f4238070de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:40.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.094+0000 7f423cadf700 1 -- 172.21.15.156:0/4123142570 shutdown_connections 2023-09-30T22:22:40.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.094+0000 7f423cadf700 1 -- 172.21.15.156:0/4123142570 wait complete. 2023-09-30T22:22:40.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:40.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.195+0000 7fb35abc5700 1 -- 172.21.15.156:0/3373480978 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb354122d10 con 0x7fb35409a150 2023-09-30T22:22:40.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.196+0000 7fb3517fa700 1 -- 172.21.15.156:0/3373480978 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb348017070 con 0x7fb35409a150 2023-09-30T22:22:40.197 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:40.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.198+0000 7fb35abc5700 1 -- 172.21.15.156:0/3373480978 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb35409a150 msgr2=0x7fb35411ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:40.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.198+0000 7fb35abc5700 1 --2- 172.21.15.156:0/3373480978 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb35409a150 0x7fb35411ead0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb34800e870 tx=0x7fb34800eb80 comp rx=0 tx=0).stop 2023-09-30T22:22:40.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.198+0000 7fb35abc5700 1 -- 172.21.15.156:0/3373480978 shutdown_connections 2023-09-30T22:22:40.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.198+0000 7fb35abc5700 1 --2- 172.21.15.156:0/3373480978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb354133c20 0x7fb35411f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:40.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.198+0000 7fb35abc5700 1 --2- 172.21.15.156:0/3373480978 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb35409a150 0x7fb35411ead0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:40.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.198+0000 7fb35abc5700 1 --2- 172.21.15.156:0/3373480978 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb35409edb0 0x7fb35411f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:40.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.198+0000 7fb35abc5700 1 -- 172.21.15.156:0/3373480978 >> 172.21.15.156:0/3373480978 conn(0x7fb3540a4430 msgr2=0x7fb3540a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:40.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.198+0000 7fb35abc5700 1 -- 172.21.15.156:0/3373480978 shutdown_connections 2023-09-30T22:22:40.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:40.198+0000 7fb35abc5700 1 -- 172.21.15.156:0/3373480978 wait complete. 2023-09-30T22:22:40.210 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:41.033 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:41.053 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:41.107 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:41.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.179+0000 7ffb53c48700 1 Processor -- start 2023-09-30T22:22:41.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.180+0000 7ffb53c48700 1 -- start start 2023-09-30T22:22:41.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.180+0000 7ffb53c48700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ffb4c133900 0x7ffb4c133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.180+0000 7ffb53c48700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffb4c0a10b0 0x7ffb4c13b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.180+0000 7ffb53c48700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb4c09a760 con 0x7ffb4c134210 2023-09-30T22:22:41.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.180+0000 7ffb53c48700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb4c1336e0 con 0x7ffb4c133900 2023-09-30T22:22:41.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.180+0000 7ffb53c48700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c09a080 con 0x7ffb4c0a10b0 2023-09-30T22:22:41.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.180+0000 7ffb519e4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ffb4c133900 0x7ffb4c133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.180+0000 7ffb511e3700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ffb4c134210 0x7ffb4c0a09a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48818/0 (socket says 172.21.15.156:48818) 2023-09-30T22:22:41.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.180+0000 7ffb511e3700 1 -- 172.21.15.156:0/2508029204 learned_addr learned my addr 172.21.15.156:0/2508029204 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:41.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.180+0000 7ffb521e5700 1 --2- 172.21.15.156:0/2508029204 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffb4c0a10b0 0x7ffb4c13b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.181+0000 7ffb519e4700 1 -- 172.21.15.156:0/2508029204 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffb4c0a10b0 msgr2=0x7ffb4c13b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:41.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.181+0000 7ffb519e4700 1 --2- 172.21.15.156:0/2508029204 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffb4c0a10b0 0x7ffb4c13b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.181+0000 7ffb519e4700 1 -- 172.21.15.156:0/2508029204 >> v1:172.21.15.156:6789/0 conn(0x7ffb4c134210 legacy=0x7ffb4c0a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.181+0000 7ffb519e4700 1 -- 172.21.15.156:0/2508029204 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4c0a23e0 con 0x7ffb4c133900 2023-09-30T22:22:41.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.181+0000 7ffb509e2700 1 -- 172.21.15.156:0/2508029204 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2174482979 0 0) 0x7ffb4c09a760 con 0x7ffb4c134210 2023-09-30T22:22:41.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.181+0000 7ffb519e4700 1 --2- 172.21.15.156:0/2508029204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb4c133900 0x7ffb4c133cd0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009820 tx=0x7ffb48009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a07b9fbfa681332 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:41.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.181+0000 7ffb509e2700 1 -- 172.21.15.156:0/2508029204 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb48005e30 con 0x7ffb4c133900 2023-09-30T22:22:41.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.181+0000 7ffb509e2700 1 -- 172.21.15.156:0/2508029204 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb48006030 con 0x7ffb4c133900 2023-09-30T22:22:41.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.181+0000 7ffb509e2700 1 -- 172.21.15.156:0/2508029204 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb480063c0 con 0x7ffb4c133900 2023-09-30T22:22:41.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.182+0000 7ffb53c48700 1 -- 172.21.15.156:0/2508029204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb4c133900 msgr2=0x7ffb4c133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.182+0000 7ffb53c48700 1 --2- 172.21.15.156:0/2508029204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb4c133900 0x7ffb4c133cd0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009820 tx=0x7ffb48009b30 comp rx=0 tx=0).stop 2023-09-30T22:22:41.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.182+0000 7ffb53c48700 1 -- 172.21.15.156:0/2508029204 shutdown_connections 2023-09-30T22:22:41.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.182+0000 7ffb53c48700 1 --2- 172.21.15.156:0/2508029204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb4c133900 0x7ffb4c133cd0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.182+0000 7ffb53c48700 1 --2- 172.21.15.156:0/2508029204 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffb4c0a10b0 0x7ffb4c13b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.182+0000 7ffb53c48700 1 -- 172.21.15.156:0/2508029204 >> 172.21.15.156:0/2508029204 conn(0x7ffb4c0a2980 msgr2=0x7ffb4c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:41.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.182+0000 7ffb53c48700 1 -- 172.21.15.156:0/2508029204 shutdown_connections 2023-09-30T22:22:41.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.182+0000 7ffb53c48700 1 -- 172.21.15.156:0/2508029204 wait complete. 2023-09-30T22:22:41.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.183+0000 7ffb53c48700 1 Processor -- start 2023-09-30T22:22:41.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.183+0000 7ffb53c48700 1 -- start start 2023-09-30T22:22:41.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.184+0000 7ffb53c48700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffb4c0a10b0 0x7ffb4c1c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.184+0000 7ffb53c48700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb4c133900 0x7ffb4c1c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.184+0000 7ffb53c48700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffb4c134210 0x7ffb4c1c4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.184+0000 7ffb53c48700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c11c920 con 0x7ffb4c133900 2023-09-30T22:22:41.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.184+0000 7ffb53c48700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c11df10 con 0x7ffb4c134210 2023-09-30T22:22:41.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.184+0000 7ffb53c48700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c11e2f0 con 0x7ffb4c0a10b0 2023-09-30T22:22:41.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.184+0000 7ffb511e3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb4c133900 0x7ffb4c1c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.184+0000 7ffb511e3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb4c133900 0x7ffb4c1c8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:36926/0 (socket says 172.21.15.156:36926) 2023-09-30T22:22:41.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.184+0000 7ffb511e3700 1 -- 172.21.15.156:0/2639989238 learned_addr learned my addr 172.21.15.156:0/2639989238 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:41.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.184+0000 7ffb519e4700 1 --2- 172.21.15.156:0/2639989238 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffb4c0a10b0 0x7ffb4c1c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.184+0000 7ffb521e5700 1 --2- 172.21.15.156:0/2639989238 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffb4c134210 0x7ffb4c1c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.185+0000 7ffb511e3700 1 -- 172.21.15.156:0/2639989238 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffb4c0a10b0 msgr2=0x7ffb4c1c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.185+0000 7ffb511e3700 1 --2- 172.21.15.156:0/2639989238 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffb4c0a10b0 0x7ffb4c1c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.185+0000 7ffb511e3700 1 -- 172.21.15.156:0/2639989238 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffb4c134210 msgr2=0x7ffb4c1c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.185+0000 7ffb511e3700 1 --2- 172.21.15.156:0/2639989238 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffb4c134210 0x7ffb4c1c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.185+0000 7ffb511e3700 1 -- 172.21.15.156:0/2639989238 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb48009430 con 0x7ffb4c133900 2023-09-30T22:22:41.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.185+0000 7ffb511e3700 1 --2- 172.21.15.156:0/2639989238 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb4c133900 0x7ffb4c1c8a50 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c00c520 tx=0x7ffb3c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:41.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.185+0000 7ffb427fc700 1 -- 172.21.15.156:0/2639989238 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c004c80 con 0x7ffb4c133900 2023-09-30T22:22:41.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.185+0000 7ffb427fc700 1 -- 172.21.15.156:0/2639989238 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3c004e00 con 0x7ffb4c133900 2023-09-30T22:22:41.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.185+0000 7ffb427fc700 1 -- 172.21.15.156:0/2639989238 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c007310 con 0x7ffb4c133900 2023-09-30T22:22:41.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.185+0000 7ffb53c48700 1 -- 172.21.15.156:0/2639989238 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb4c11ea30 con 0x7ffb4c133900 2023-09-30T22:22:41.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.185+0000 7ffb53c48700 1 -- 172.21.15.156:0/2639989238 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb4c11f760 con 0x7ffb4c133900 2023-09-30T22:22:41.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.186+0000 7ffb53c48700 1 -- 172.21.15.156:0/2639989238 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb4c04f2a0 con 0x7ffb4c133900 2023-09-30T22:22:41.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.187+0000 7ffb427fc700 1 -- 172.21.15.156:0/2639989238 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb3c007470 con 0x7ffb4c133900 2023-09-30T22:22:41.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.187+0000 7ffb427fc700 1 -- 172.21.15.156:0/2639989238 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffb3c03f890 con 0x7ffb4c133900 2023-09-30T22:22:41.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.191+0000 7ffb427fc700 1 -- 172.21.15.156:0/2639989238 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb3c0133c0 con 0x7ffb4c133900 2023-09-30T22:22:41.211 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:41.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.219+0000 7f044f936700 1 Processor -- start 2023-09-30T22:22:41.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.219+0000 7f044f936700 1 -- start start 2023-09-30T22:22:41.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.219+0000 7f044f936700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f044809d860 0x7f044809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.219+0000 7f044f936700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f044809e170 0x7f04481307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.219+0000 7f044f936700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f044809aaa0 con 0x7f0448130ce0 2023-09-30T22:22:41.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.219+0000 7f044f936700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f044809f870 con 0x7f044809d860 2023-09-30T22:22:41.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.219+0000 7f044f936700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f044809b360 con 0x7f044809e170 2023-09-30T22:22:41.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.220+0000 7f044ced1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f044809e170 0x7f04481307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.220+0000 7f044ced1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f044809e170 0x7f04481307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56110/0 (socket says 172.21.15.156:56110) 2023-09-30T22:22:41.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.220+0000 7f044ded3700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f0448130ce0 0x7f04481379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48826/0 (socket says 172.21.15.156:48826) 2023-09-30T22:22:41.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.220+0000 7f044ced1700 1 -- 172.21.15.156:0/3009584382 learned_addr learned my addr 172.21.15.156:0/3009584382 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:41.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.220+0000 7f044d6d2700 1 --2- 172.21.15.156:0/3009584382 >> v2:172.21.15.156:3300/0 conn(0x7f044809d860 0x7f044809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.220+0000 7f043ffff700 1 -- 172.21.15.156:0/3009584382 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4018795477 0 0) 0x7f044809aaa0 con 0x7f0448130ce0 2023-09-30T22:22:41.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.220+0000 7f044ced1700 1 -- 172.21.15.156:0/3009584382 >> v2:172.21.15.156:3300/0 conn(0x7f044809d860 msgr2=0x7f044809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:41.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.220+0000 7f044ced1700 1 --2- 172.21.15.156:0/3009584382 >> v2:172.21.15.156:3300/0 conn(0x7f044809d860 0x7f044809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.220+0000 7f044ced1700 1 -- 172.21.15.156:0/3009584382 >> v1:172.21.15.156:6789/0 conn(0x7f0448130ce0 legacy=0x7f04481379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.220+0000 7f044ced1700 1 -- 172.21.15.156:0/3009584382 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044809b620 con 0x7f044809e170 2023-09-30T22:22:41.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.220+0000 7f044ced1700 1 --2- 172.21.15.156:0/3009584382 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f044809e170 0x7f04481307a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f043800bb90 tx=0x7f043800bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a21d671d684658dc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:41.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.221+0000 7f043ffff700 1 -- 172.21.15.156:0/3009584382 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043800dd30 con 0x7f044809e170 2023-09-30T22:22:41.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.221+0000 7f043ffff700 1 -- 172.21.15.156:0/3009584382 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043800de90 con 0x7f044809e170 2023-09-30T22:22:41.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.221+0000 7f043ffff700 1 -- 172.21.15.156:0/3009584382 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0438010690 con 0x7f044809e170 2023-09-30T22:22:41.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.221+0000 7f044f936700 1 -- 172.21.15.156:0/3009584382 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f044809e170 msgr2=0x7f04481307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.221+0000 7f044f936700 1 --2- 172.21.15.156:0/3009584382 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f044809e170 0x7f04481307a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f043800bb90 tx=0x7f043800bea0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.221+0000 7f044f936700 1 -- 172.21.15.156:0/3009584382 shutdown_connections 2023-09-30T22:22:41.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.221+0000 7f044f936700 1 --2- 172.21.15.156:0/3009584382 >> v2:172.21.15.156:3300/0 conn(0x7f044809d860 0x7f044809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.221+0000 7f044f936700 1 --2- 172.21.15.156:0/3009584382 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f044809e170 0x7f04481307a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.221+0000 7f044f936700 1 -- 172.21.15.156:0/3009584382 >> 172.21.15.156:0/3009584382 conn(0x7f0448099c40 msgr2=0x7f04480a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:41.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.222+0000 7f044f936700 1 -- 172.21.15.156:0/3009584382 shutdown_connections 2023-09-30T22:22:41.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.222+0000 7f044f936700 1 -- 172.21.15.156:0/3009584382 wait complete. 2023-09-30T22:22:41.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.223+0000 7f044f936700 1 Processor -- start 2023-09-30T22:22:41.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.223+0000 7f044f936700 1 -- start start 2023-09-30T22:22:41.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.224+0000 7f044f936700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f044809d860 0x7f044811e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.224+0000 7f044f936700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f044809e170 0x7f044811e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.224+0000 7f044f936700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0448130ce0 0x7f044811ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.224+0000 7f044f936700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0448121d00 con 0x7f044809e170 2023-09-30T22:22:41.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.224+0000 7f044f936700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044811fff0 con 0x7f044809d860 2023-09-30T22:22:41.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.224+0000 7f044f936700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04481205a0 con 0x7f0448130ce0 2023-09-30T22:22:41.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.224+0000 7f044d6d2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f044809d860 0x7f044811e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.224+0000 7f044d6d2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f044809d860 0x7f044811e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33504/0 (socket says 172.21.15.156:33504) 2023-09-30T22:22:41.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.224+0000 7f044d6d2700 1 -- 172.21.15.156:0/1500684411 learned_addr learned my addr 172.21.15.156:0/1500684411 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:41.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.224+0000 7f044ded3700 1 --2- 172.21.15.156:0/1500684411 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0448130ce0 0x7f044811ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.224+0000 7f044ded3700 1 -- 172.21.15.156:0/1500684411 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f044809d860 msgr2=0x7f044811e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.224+0000 7f044ded3700 1 --2- 172.21.15.156:0/1500684411 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f044809d860 0x7f044811e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.224+0000 7f044ded3700 1 -- 172.21.15.156:0/1500684411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f044809e170 msgr2=0x7f044811e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.224+0000 7f044ded3700 1 --2- 172.21.15.156:0/1500684411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f044809e170 0x7f044811e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.224+0000 7f044ded3700 1 -- 172.21.15.156:0/1500684411 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043800b7f0 con 0x7f0448130ce0 2023-09-30T22:22:41.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.224+0000 7f044ded3700 1 --2- 172.21.15.156:0/1500684411 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0448130ce0 0x7f044811ee60 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f044000cbe0 tx=0x7f044000cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:41.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.225+0000 7f043dffb700 1 -- 172.21.15.156:0/1500684411 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044000ab50 con 0x7f0448130ce0 2023-09-30T22:22:41.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.225+0000 7f043dffb700 1 -- 172.21.15.156:0/1500684411 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044000acb0 con 0x7f0448130ce0 2023-09-30T22:22:41.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.225+0000 7f043dffb700 1 -- 172.21.15.156:0/1500684411 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0440007310 con 0x7f0448130ce0 2023-09-30T22:22:41.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.225+0000 7f044f936700 1 -- 172.21.15.156:0/1500684411 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f044809c8b0 con 0x7f0448130ce0 2023-09-30T22:22:41.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.225+0000 7f044f936700 1 -- 172.21.15.156:0/1500684411 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04481303a0 con 0x7f0448130ce0 2023-09-30T22:22:41.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.226+0000 7f043dffb700 1 -- 172.21.15.156:0/1500684411 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0440007470 con 0x7f0448130ce0 2023-09-30T22:22:41.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.226+0000 7f044f936700 1 -- 172.21.15.156:0/1500684411 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f044804f2a0 con 0x7f0448130ce0 2023-09-30T22:22:41.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.226+0000 7f043dffb700 1 -- 172.21.15.156:0/1500684411 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f044003f180 con 0x7f0448130ce0 2023-09-30T22:22:41.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.231+0000 7f043dffb700 1 -- 172.21.15.156:0/1500684411 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0440019680 con 0x7f0448130ce0 2023-09-30T22:22:41.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.260+0000 7fb434673700 1 Processor -- start 2023-09-30T22:22:41.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.260+0000 7fb434673700 1 -- start start 2023-09-30T22:22:41.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.261+0000 7fb434673700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb42c09a150 0x7fb42c09e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.261+0000 7fb434673700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb42c09f1a0 0x7fb42c134330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.261+0000 7fb434673700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb42c09af80 con 0x7fb42c09edb0 2023-09-30T22:22:41.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.261+0000 7fb434673700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb42c09fe00 con 0x7fb42c09f1a0 2023-09-30T22:22:41.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.261+0000 7fb434673700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c06bec0 con 0x7fb42c09a150 2023-09-30T22:22:41.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.261+0000 7fb43240f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb42c09a150 0x7fb42c09e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.261+0000 7fb43240f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb42c09a150 0x7fb42c09e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:56578/0 (socket says 172.21.15.156:56578) 2023-09-30T22:22:41.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.261+0000 7fb43240f700 1 -- 172.21.15.156:0/2649763241 learned_addr learned my addr 172.21.15.156:0/2649763241 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:41.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.261+0000 7fb432c10700 1 --2- 172.21.15.156:0/2649763241 >> v2:172.21.15.156:3300/0 conn(0x7fb42c09f1a0 0x7fb42c134330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.262+0000 7fb43240f700 1 -- 172.21.15.156:0/2649763241 >> v2:172.21.15.156:3300/0 conn(0x7fb42c09f1a0 msgr2=0x7fb42c134330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:41.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.262+0000 7fb43240f700 1 --2- 172.21.15.156:0/2649763241 >> v2:172.21.15.156:3300/0 conn(0x7fb42c09f1a0 0x7fb42c134330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.262+0000 7fb43240f700 1 -- 172.21.15.156:0/2649763241 >> v1:172.21.15.156:6789/0 conn(0x7fb42c09edb0 legacy=0x7fb42c133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.262+0000 7fb43240f700 1 -- 172.21.15.156:0/2649763241 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb42c06bc20 con 0x7fb42c09a150 2023-09-30T22:22:41.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.262+0000 7fb43240f700 1 --2- 172.21.15.156:0/2649763241 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb42c09a150 0x7fb42c09e870 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb428009920 tx=0x7fb428009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c97504021ce38db6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:41.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.262+0000 7fb43140d700 1 -- 172.21.15.156:0/2649763241 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb428011830 con 0x7fb42c09a150 2023-09-30T22:22:41.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.262+0000 7fb43140d700 1 -- 172.21.15.156:0/2649763241 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb428011990 con 0x7fb42c09a150 2023-09-30T22:22:41.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.262+0000 7fb43140d700 1 -- 172.21.15.156:0/2649763241 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb428011d20 con 0x7fb42c09a150 2023-09-30T22:22:41.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.263+0000 7fb434673700 1 -- 172.21.15.156:0/2649763241 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb42c09a150 msgr2=0x7fb42c09e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.263+0000 7fb434673700 1 --2- 172.21.15.156:0/2649763241 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb42c09a150 0x7fb42c09e870 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb428009920 tx=0x7fb428009c30 comp rx=0 tx=0).stop 2023-09-30T22:22:41.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.263+0000 7fb434673700 1 -- 172.21.15.156:0/2649763241 shutdown_connections 2023-09-30T22:22:41.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.263+0000 7fb434673700 1 --2- 172.21.15.156:0/2649763241 >> v2:172.21.15.156:3300/0 conn(0x7fb42c09f1a0 0x7fb42c134330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.263+0000 7fb434673700 1 --2- 172.21.15.156:0/2649763241 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb42c09a150 0x7fb42c09e870 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.263+0000 7fb434673700 1 -- 172.21.15.156:0/2649763241 >> 172.21.15.156:0/2649763241 conn(0x7fb42c0a4430 msgr2=0x7fb42c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:41.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.263+0000 7fb434673700 1 -- 172.21.15.156:0/2649763241 shutdown_connections 2023-09-30T22:22:41.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.263+0000 7fb434673700 1 -- 172.21.15.156:0/2649763241 wait complete. 2023-09-30T22:22:41.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.264+0000 7fb434673700 1 Processor -- start 2023-09-30T22:22:41.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.264+0000 7fb434673700 1 -- start start 2023-09-30T22:22:41.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.265+0000 7fb434673700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb42c09a150 0x7fb42c122840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.265+0000 7fb434673700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb42c09edb0 0x7fb42c122d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.265+0000 7fb434673700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb42c09f1a0 0x7fb42c1232c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.265+0000 7fb434673700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c124cb0 con 0x7fb42c09edb0 2023-09-30T22:22:41.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.265+0000 7fb434673700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c123ca0 con 0x7fb42c09f1a0 2023-09-30T22:22:41.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.265+0000 7fb434673700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c09bb00 con 0x7fb42c09a150 2023-09-30T22:22:41.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.265+0000 7fb43240f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb42c09a150 0x7fb42c122840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.265+0000 7fb432c10700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb42c09f1a0 0x7fb42c1232c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.265+0000 7fb43240f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb42c09a150 0x7fb42c122840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51580/0 (socket says 172.21.15.156:51580) 2023-09-30T22:22:41.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.265+0000 7fb43240f700 1 -- 172.21.15.156:0/358894389 learned_addr learned my addr 172.21.15.156:0/358894389 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:41.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.265+0000 7fb431c0e700 1 --2- 172.21.15.156:0/358894389 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb42c09edb0 0x7fb42c122d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.265+0000 7fb43240f700 1 -- 172.21.15.156:0/358894389 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb42c09f1a0 msgr2=0x7fb42c1232c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.266+0000 7fb43240f700 1 --2- 172.21.15.156:0/358894389 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb42c09f1a0 0x7fb42c1232c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.266+0000 7fb43240f700 1 -- 172.21.15.156:0/358894389 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb42c09edb0 msgr2=0x7fb42c122d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.266+0000 7fb43240f700 1 --2- 172.21.15.156:0/358894389 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb42c09edb0 0x7fb42c122d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.266+0000 7fb43240f700 1 -- 172.21.15.156:0/358894389 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb428009550 con 0x7fb42c09a150 2023-09-30T22:22:41.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.266+0000 7fb432c10700 1 --2- 172.21.15.156:0/358894389 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb42c09f1a0 0x7fb42c1232c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:41.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.266+0000 7fb43240f700 1 --2- 172.21.15.156:0/358894389 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb42c09a150 0x7fb42c122840 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb428014040 tx=0x7fb428004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:41.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.266+0000 7fb422ffd700 1 -- 172.21.15.156:0/358894389 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb428004510 con 0x7fb42c09a150 2023-09-30T22:22:41.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.266+0000 7fb422ffd700 1 -- 172.21.15.156:0/358894389 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42801e070 con 0x7fb42c09a150 2023-09-30T22:22:41.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.266+0000 7fb434673700 1 -- 172.21.15.156:0/358894389 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb42c1244d0 con 0x7fb42c09a150 2023-09-30T22:22:41.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.266+0000 7fb422ffd700 1 -- 172.21.15.156:0/358894389 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4280038e0 con 0x7fb42c09a150 2023-09-30T22:22:41.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.266+0000 7fb434673700 1 -- 172.21.15.156:0/358894389 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb42c126040 con 0x7fb42c09a150 2023-09-30T22:22:41.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.267+0000 7fb422ffd700 1 -- 172.21.15.156:0/358894389 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb428003a40 con 0x7fb42c09a150 2023-09-30T22:22:41.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.267+0000 7fb422ffd700 1 -- 172.21.15.156:0/358894389 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb428040260 con 0x7fb42c09a150 2023-09-30T22:22:41.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.267+0000 7fb434673700 1 -- 172.21.15.156:0/358894389 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb42c09fa30 con 0x7fb42c09a150 2023-09-30T22:22:41.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.276+0000 7fb422ffd700 1 -- 172.21.15.156:0/358894389 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb428015070 con 0x7fb42c09a150 2023-09-30T22:22:41.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.347+0000 7f2e2fb38700 1 Processor -- start 2023-09-30T22:22:41.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.347+0000 7f2e2fb38700 1 -- start start 2023-09-30T22:22:41.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.348+0000 7f2e2fb38700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e2809e950 0x7f2e2809ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.348+0000 7f2e2fb38700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e2809f260 0x7f2e28137ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.348+0000 7f2e2fb38700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2809ac20 con 0x7f2e281381e0 2023-09-30T22:22:41.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.348+0000 7f2e2fb38700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e280a06c0 con 0x7f2e2809f260 2023-09-30T22:22:41.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.348+0000 7f2e2fb38700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2809ae90 con 0x7f2e2809e950 2023-09-30T22:22:41.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.348+0000 7f2e2d8d4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e2809e950 0x7f2e2809ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.348+0000 7f2e2d8d4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e2809e950 0x7f2e2809ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51594/0 (socket says 172.21.15.156:51594) 2023-09-30T22:22:41.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.348+0000 7f2e2e0d5700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f2e281381e0 0x7f2e2813a5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45552/0 (socket says 172.21.15.156:45552) 2023-09-30T22:22:41.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.348+0000 7f2e2d8d4700 1 -- 172.21.15.156:0/3810911842 learned_addr learned my addr 172.21.15.156:0/3810911842 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:41.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.348+0000 7f2e2d0d3700 1 --2- 172.21.15.156:0/3810911842 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e2809f260 0x7f2e28137ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.348+0000 7f2e2d8d4700 1 -- 172.21.15.156:0/3810911842 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e2809f260 msgr2=0x7f2e28137ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:41.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.348+0000 7f2e2d8d4700 1 --2- 172.21.15.156:0/3810911842 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e2809f260 0x7f2e28137ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.348+0000 7f2e2d8d4700 1 -- 172.21.15.156:0/3810911842 >> v1:172.21.15.156:6789/0 conn(0x7f2e281381e0 legacy=0x7f2e2813a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.349+0000 7f2e2d8d4700 1 -- 172.21.15.156:0/3810911842 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2806ba00 con 0x7f2e2809e950 2023-09-30T22:22:41.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.349+0000 7f2e2d8d4700 1 --2- 172.21.15.156:0/3810911842 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e2809e950 0x7f2e2809ed20 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009920 tx=0x7f2e24009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7635a1999d34045e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:41.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.349+0000 7f2e2c8d2700 1 -- 172.21.15.156:0/3810911842 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24005e30 con 0x7f2e2809e950 2023-09-30T22:22:41.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.349+0000 7f2e2c8d2700 1 -- 172.21.15.156:0/3810911842 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e24004030 con 0x7f2e2809e950 2023-09-30T22:22:41.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.349+0000 7f2e2c8d2700 1 -- 172.21.15.156:0/3810911842 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e240043e0 con 0x7f2e2809e950 2023-09-30T22:22:41.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.349+0000 7f2e2fb38700 1 -- 172.21.15.156:0/3810911842 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e2809e950 msgr2=0x7f2e2809ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.349+0000 7f2e2fb38700 1 --2- 172.21.15.156:0/3810911842 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e2809e950 0x7f2e2809ed20 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009920 tx=0x7f2e24009c30 comp rx=0 tx=0).stop 2023-09-30T22:22:41.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.349+0000 7f2e2fb38700 1 -- 172.21.15.156:0/3810911842 shutdown_connections 2023-09-30T22:22:41.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.349+0000 7f2e2fb38700 1 --2- 172.21.15.156:0/3810911842 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e2809e950 0x7f2e2809ed20 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.349+0000 7f2e2fb38700 1 --2- 172.21.15.156:0/3810911842 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e2809f260 0x7f2e28137ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.349+0000 7f2e2fb38700 1 -- 172.21.15.156:0/3810911842 >> 172.21.15.156:0/3810911842 conn(0x7f2e280a0f70 msgr2=0x7f2e280a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:41.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.350+0000 7f2e2fb38700 1 -- 172.21.15.156:0/3810911842 shutdown_connections 2023-09-30T22:22:41.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.350+0000 7f2e2fb38700 1 -- 172.21.15.156:0/3810911842 wait complete. 2023-09-30T22:22:41.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.350+0000 7f2e2fb38700 1 Processor -- start 2023-09-30T22:22:41.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.351+0000 7f2e2fb38700 1 -- start start 2023-09-30T22:22:41.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.351+0000 7f2e2fb38700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e2809e950 0x7f2e2811fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.351+0000 7f2e2fb38700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e2809f260 0x7f2e2811ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.351+0000 7f2e2fb38700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e281381e0 0x7f2e281204a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.351+0000 7f2e2fb38700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e28134990 con 0x7f2e281381e0 2023-09-30T22:22:41.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.351+0000 7f2e2fb38700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e281215a0 con 0x7f2e2809e950 2023-09-30T22:22:41.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.351+0000 7f2e2fb38700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e281234b0 con 0x7f2e2809f260 2023-09-30T22:22:41.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.351+0000 7f2e2d0d3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e2809f260 0x7f2e2811ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.351+0000 7f2e2d8d4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e2809e950 0x7f2e2811fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.351+0000 7f2e2d0d3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e2809f260 0x7f2e2811ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51596/0 (socket says 172.21.15.156:51596) 2023-09-30T22:22:41.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.351+0000 7f2e2d0d3700 1 -- 172.21.15.156:0/1926717455 learned_addr learned my addr 172.21.15.156:0/1926717455 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:41.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.351+0000 7f2e2e0d5700 1 --2- 172.21.15.156:0/1926717455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e281381e0 0x7f2e281204a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.351+0000 7f2e2d0d3700 1 -- 172.21.15.156:0/1926717455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e2809e950 msgr2=0x7f2e2811fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.351+0000 7f2e2d0d3700 1 --2- 172.21.15.156:0/1926717455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e2809e950 0x7f2e2811fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.351+0000 7f2e2d0d3700 1 -- 172.21.15.156:0/1926717455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e281381e0 msgr2=0x7f2e281204a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.351+0000 7f2e2d0d3700 1 --2- 172.21.15.156:0/1926717455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e281381e0 0x7f2e281204a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.352+0000 7f2e2d0d3700 1 -- 172.21.15.156:0/1926717455 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e24009500 con 0x7f2e2809f260 2023-09-30T22:22:41.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.352+0000 7f2e2d0d3700 1 --2- 172.21.15.156:0/1926717455 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e2809f260 0x7f2e2811ff60 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2e1800e980 tx=0x7f2e1800ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:41.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.352+0000 7f2e1e7fc700 1 -- 172.21.15.156:0/1926717455 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e18009710 con 0x7f2e2809f260 2023-09-30T22:22:41.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.352+0000 7f2e1e7fc700 1 -- 172.21.15.156:0/1926717455 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1800c690 con 0x7f2e2809f260 2023-09-30T22:22:41.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.352+0000 7f2e2fb38700 1 -- 172.21.15.156:0/1926717455 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e28121e20 con 0x7f2e2809f260 2023-09-30T22:22:41.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.352+0000 7f2e1e7fc700 1 -- 172.21.15.156:0/1926717455 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1800ca20 con 0x7f2e2809f260 2023-09-30T22:22:41.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.352+0000 7f2e2fb38700 1 -- 172.21.15.156:0/1926717455 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e281231d0 con 0x7f2e2809f260 2023-09-30T22:22:41.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.353+0000 7f2e1e7fc700 1 -- 172.21.15.156:0/1926717455 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e1800cb80 con 0x7f2e2809f260 2023-09-30T22:22:41.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.353+0000 7f2e2fb38700 1 -- 172.21.15.156:0/1926717455 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e28123d00 con 0x7f2e2809f260 2023-09-30T22:22:41.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.353+0000 7f2e1e7fc700 1 -- 172.21.15.156:0/1926717455 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2e1803f720 con 0x7f2e2809f260 2023-09-30T22:22:41.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.358+0000 7f2e1e7fc700 1 -- 172.21.15.156:0/1926717455 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e180232f0 con 0x7f2e2809f260 2023-09-30T22:22:41.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.410+0000 7ffb53c48700 1 -- 172.21.15.156:0/2639989238 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffb4c06bce0 con 0x7ffb4c133900 2023-09-30T22:22:41.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.411+0000 7ffb427fc700 1 -- 172.21.15.156:0/2639989238 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb3c011360 con 0x7ffb4c133900 2023-09-30T22:22:41.412 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:41.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.413+0000 7ffb53c48700 1 -- 172.21.15.156:0/2639989238 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb4c133900 msgr2=0x7ffb4c1c8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.413+0000 7ffb53c48700 1 --2- 172.21.15.156:0/2639989238 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb4c133900 0x7ffb4c1c8a50 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c00c520 tx=0x7ffb3c00c830 comp rx=0 tx=0).stop 2023-09-30T22:22:41.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.413+0000 7ffb53c48700 1 -- 172.21.15.156:0/2639989238 shutdown_connections 2023-09-30T22:22:41.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.413+0000 7ffb53c48700 1 --2- 172.21.15.156:0/2639989238 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffb4c134210 0x7ffb4c1c4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.413+0000 7ffb53c48700 1 --2- 172.21.15.156:0/2639989238 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffb4c0a10b0 0x7ffb4c1c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.413+0000 7ffb53c48700 1 --2- 172.21.15.156:0/2639989238 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb4c133900 0x7ffb4c1c8a50 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.413+0000 7ffb53c48700 1 -- 172.21.15.156:0/2639989238 >> 172.21.15.156:0/2639989238 conn(0x7ffb4c0a2980 msgr2=0x7ffb4c1305c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:41.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.413+0000 7ffb53c48700 1 -- 172.21.15.156:0/2639989238 shutdown_connections 2023-09-30T22:22:41.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.413+0000 7ffb53c48700 1 -- 172.21.15.156:0/2639989238 wait complete. 2023-09-30T22:22:41.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:41.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.497+0000 7f044f936700 1 -- 172.21.15.156:0/1500684411 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0448130580 con 0x7f0448130ce0 2023-09-30T22:22:41.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.498+0000 7f043dffb700 1 -- 172.21.15.156:0/1500684411 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0440010300 con 0x7f0448130ce0 2023-09-30T22:22:41.499 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:41.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.501+0000 7f044f936700 1 -- 172.21.15.156:0/1500684411 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0448130ce0 msgr2=0x7f044811ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.501+0000 7f044f936700 1 --2- 172.21.15.156:0/1500684411 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0448130ce0 0x7f044811ee60 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f044000cbe0 tx=0x7f044000cef0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.501+0000 7f044f936700 1 -- 172.21.15.156:0/1500684411 shutdown_connections 2023-09-30T22:22:41.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.501+0000 7f044f936700 1 --2- 172.21.15.156:0/1500684411 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0448130ce0 0x7f044811ee60 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.501+0000 7f044f936700 1 --2- 172.21.15.156:0/1500684411 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f044809d860 0x7f044811e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.501+0000 7f044f936700 1 --2- 172.21.15.156:0/1500684411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f044809e170 0x7f044811e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.501+0000 7f044f936700 1 -- 172.21.15.156:0/1500684411 >> 172.21.15.156:0/1500684411 conn(0x7f0448099c40 msgr2=0x7f04480a29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:41.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.501+0000 7f044f936700 1 -- 172.21.15.156:0/1500684411 shutdown_connections 2023-09-30T22:22:41.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.501+0000 7f044f936700 1 -- 172.21.15.156:0/1500684411 wait complete. 2023-09-30T22:22:41.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:41.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.533+0000 7fb434673700 1 -- 172.21.15.156:0/358894389 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb42c126040 con 0x7fb42c09a150 2023-09-30T22:22:41.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.534+0000 7fb422ffd700 1 -- 172.21.15.156:0/358894389 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb42c126040 con 0x7fb42c09a150 2023-09-30T22:22:41.534 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:41.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.536+0000 7fb434673700 1 -- 172.21.15.156:0/358894389 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb42c09a150 msgr2=0x7fb42c122840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.536+0000 7fb434673700 1 --2- 172.21.15.156:0/358894389 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb42c09a150 0x7fb42c122840 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb428014040 tx=0x7fb428004750 comp rx=0 tx=0).stop 2023-09-30T22:22:41.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.536+0000 7fb434673700 1 -- 172.21.15.156:0/358894389 shutdown_connections 2023-09-30T22:22:41.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.536+0000 7fb434673700 1 --2- 172.21.15.156:0/358894389 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb42c09f1a0 0x7fb42c1232c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.536+0000 7fb434673700 1 --2- 172.21.15.156:0/358894389 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb42c09a150 0x7fb42c122840 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.536+0000 7fb434673700 1 --2- 172.21.15.156:0/358894389 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb42c09edb0 0x7fb42c122d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.536+0000 7fb434673700 1 -- 172.21.15.156:0/358894389 >> 172.21.15.156:0/358894389 conn(0x7fb42c0a4430 msgr2=0x7fb42c09c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:41.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.536+0000 7fb434673700 1 -- 172.21.15.156:0/358894389 shutdown_connections 2023-09-30T22:22:41.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.536+0000 7fb434673700 1 -- 172.21.15.156:0/358894389 wait complete. 2023-09-30T22:22:41.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:41.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.553+0000 7f2e2fb38700 1 -- 172.21.15.156:0/1926717455 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2e2804f2a0 con 0x7f2e2809f260 2023-09-30T22:22:41.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.553+0000 7f2e1e7fc700 1 -- 172.21.15.156:0/1926717455 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e1801bd00 con 0x7f2e2809f260 2023-09-30T22:22:41.554 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:41.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.556+0000 7f2e2fb38700 1 -- 172.21.15.156:0/1926717455 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e2809f260 msgr2=0x7f2e2811ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.556+0000 7f2e2fb38700 1 --2- 172.21.15.156:0/1926717455 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e2809f260 0x7f2e2811ff60 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2e1800e980 tx=0x7f2e1800ec90 comp rx=0 tx=0).stop 2023-09-30T22:22:41.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.556+0000 7f2e2fb38700 1 -- 172.21.15.156:0/1926717455 shutdown_connections 2023-09-30T22:22:41.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.556+0000 7f2e2fb38700 1 --2- 172.21.15.156:0/1926717455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e281381e0 0x7f2e281204a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.556+0000 7f2e2fb38700 1 --2- 172.21.15.156:0/1926717455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2e2809e950 0x7f2e2811fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.556+0000 7f2e2fb38700 1 --2- 172.21.15.156:0/1926717455 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2e2809f260 0x7f2e2811ff60 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.556+0000 7f2e2fb38700 1 -- 172.21.15.156:0/1926717455 >> 172.21.15.156:0/1926717455 conn(0x7f2e280a0f70 msgr2=0x7f2e28136fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:41.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.556+0000 7f2e2fb38700 1 -- 172.21.15.156:0/1926717455 shutdown_connections 2023-09-30T22:22:41.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:41.556+0000 7f2e2fb38700 1 -- 172.21.15.156:0/1926717455 wait complete. 2023-09-30T22:22:41.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:42.428 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:42.514 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:42.549 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:42.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.563+0000 7f7880055700 1 Processor -- start 2023-09-30T22:22:42.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.563+0000 7f7880055700 1 -- start start 2023-09-30T22:22:42.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.563+0000 7f7880055700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f787812cb80 0x7f787812cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.563+0000 7f7880055700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f787812fab0 0x7f787812ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.563+0000 7f7880055700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7878130460 0x7f7878136de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.563+0000 7f7880055700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f787809b700 con 0x7f787812cb80 2023-09-30T22:22:42.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.563+0000 7f7880055700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787809c350 con 0x7f7878130460 2023-09-30T22:22:42.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.563+0000 7f7880055700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f787809abf0 con 0x7f787812fab0 2023-09-30T22:22:42.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.564+0000 7f787d5f0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f787812fab0 0x7f787812ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.564+0000 7f787ddf1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f787812cb80 0x7f787812cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.564+0000 7f787d5f0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f787812fab0 0x7f787812ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51604/0 (socket says 172.21.15.156:51604) 2023-09-30T22:22:42.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.564+0000 7f787e5f2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7878130460 0x7f7878136de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.564+0000 7f787d5f0700 1 -- 172.21.15.156:0/2781764208 learned_addr learned my addr 172.21.15.156:0/2781764208 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:42.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.564+0000 7f787e5f2700 1 -- 172.21.15.156:0/2781764208 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f787812fab0 msgr2=0x7f787812ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:42.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.564+0000 7f787e5f2700 1 --2- 172.21.15.156:0/2781764208 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f787812fab0 0x7f787812ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.564+0000 7f787e5f2700 1 -- 172.21.15.156:0/2781764208 >> v2:172.21.15.156:3300/0 conn(0x7f787812cb80 msgr2=0x7f787812cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:42.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.564+0000 7f787e5f2700 1 --2- 172.21.15.156:0/2781764208 >> v2:172.21.15.156:3300/0 conn(0x7f787812cb80 0x7f787812cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.564+0000 7f787e5f2700 1 -- 172.21.15.156:0/2781764208 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787812d490 con 0x7f7878130460 2023-09-30T22:22:42.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.564+0000 7f787ddf1700 1 --2- 172.21.15.156:0/2781764208 >> v2:172.21.15.156:3300/0 conn(0x7f787812cb80 0x7f787812cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:42.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.564+0000 7f787e5f2700 1 --2- 172.21.15.156:0/2781764208 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7878130460 0x7f7878136de0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7870009dc0 tx=0x7f787000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf56eb584991228a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:42.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.564+0000 7f787cdef700 1 -- 172.21.15.156:0/2781764208 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787000e070 con 0x7f7878130460 2023-09-30T22:22:42.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.564+0000 7f787cdef700 1 -- 172.21.15.156:0/2781764208 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787000bae0 con 0x7f7878130460 2023-09-30T22:22:42.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.564+0000 7f787cdef700 1 -- 172.21.15.156:0/2781764208 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787000be90 con 0x7f7878130460 2023-09-30T22:22:42.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.565+0000 7f7880055700 1 -- 172.21.15.156:0/2781764208 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7878130460 msgr2=0x7f7878136de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.565+0000 7f7880055700 1 --2- 172.21.15.156:0/2781764208 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7878130460 0x7f7878136de0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7870009dc0 tx=0x7f787000b330 comp rx=0 tx=0).stop 2023-09-30T22:22:42.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.565+0000 7f7880055700 1 -- 172.21.15.156:0/2781764208 shutdown_connections 2023-09-30T22:22:42.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.565+0000 7f7880055700 1 --2- 172.21.15.156:0/2781764208 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7878130460 0x7f7878136de0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.565+0000 7f7880055700 1 --2- 172.21.15.156:0/2781764208 >> v2:172.21.15.156:3300/0 conn(0x7f787812cb80 0x7f787812cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.565+0000 7f7880055700 1 --2- 172.21.15.156:0/2781764208 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f787812fab0 0x7f787812ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.565+0000 7f7880055700 1 -- 172.21.15.156:0/2781764208 >> 172.21.15.156:0/2781764208 conn(0x7f78780a2eb0 msgr2=0x7f787809eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:42.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.566+0000 7f7880055700 1 -- 172.21.15.156:0/2781764208 shutdown_connections 2023-09-30T22:22:42.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.566+0000 7f7880055700 1 -- 172.21.15.156:0/2781764208 wait complete. 2023-09-30T22:22:42.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.567+0000 7f7880055700 1 Processor -- start 2023-09-30T22:22:42.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.567+0000 7f7880055700 1 -- start start 2023-09-30T22:22:42.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.567+0000 7f7880055700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f787812cb80 0x7f7878129180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.567+0000 7f7880055700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f787812fab0 0x7f78781296c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.567+0000 7f7880055700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7878130460 0x7f78781c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.567+0000 7f7880055700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7878129c00 con 0x7f787812cb80 2023-09-30T22:22:42.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.567+0000 7f7880055700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7878098cb0 con 0x7f7878130460 2023-09-30T22:22:42.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.567+0000 7f7880055700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7878128d90 con 0x7f787812fab0 2023-09-30T22:22:42.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.567+0000 7f787ddf1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f787812cb80 0x7f7878129180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.567+0000 7f787e5f2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7878130460 0x7f78781c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.567+0000 7f787ddf1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f787812cb80 0x7f7878129180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44052/0 (socket says 172.21.15.156:44052) 2023-09-30T22:22:42.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.567+0000 7f787ddf1700 1 -- 172.21.15.156:0/215603516 learned_addr learned my addr 172.21.15.156:0/215603516 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:42.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.568+0000 7f787e5f2700 1 -- 172.21.15.156:0/215603516 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f787812fab0 msgr2=0x7f78781296c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.568+0000 7f787d5f0700 1 --2- 172.21.15.156:0/215603516 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f787812fab0 0x7f78781296c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.568+0000 7f787e5f2700 1 --2- 172.21.15.156:0/215603516 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f787812fab0 0x7f78781296c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.568+0000 7f787e5f2700 1 -- 172.21.15.156:0/215603516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f787812cb80 msgr2=0x7f7878129180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.568+0000 7f787e5f2700 1 --2- 172.21.15.156:0/215603516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f787812cb80 0x7f7878129180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.568+0000 7f787e5f2700 1 -- 172.21.15.156:0/215603516 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78740094a0 con 0x7f7878130460 2023-09-30T22:22:42.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.568+0000 7f787ddf1700 1 --2- 172.21.15.156:0/215603516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f787812cb80 0x7f7878129180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:42.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.568+0000 7f787d5f0700 1 --2- 172.21.15.156:0/215603516 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f787812fab0 0x7f78781296c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:22:42.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.568+0000 7f787e5f2700 1 --2- 172.21.15.156:0/215603516 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7878130460 0x7f78781c3c10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7870016000 tx=0x7f7870004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:42.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.568+0000 7f786e7fc700 1 -- 172.21.15.156:0/215603516 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7870004680 con 0x7f7878130460 2023-09-30T22:22:42.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.568+0000 7f786e7fc700 1 -- 172.21.15.156:0/215603516 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7870020070 con 0x7f7878130460 2023-09-30T22:22:42.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.568+0000 7f7880055700 1 -- 172.21.15.156:0/215603516 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7870009a70 con 0x7f7878130460 2023-09-30T22:22:42.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.568+0000 7f786e7fc700 1 -- 172.21.15.156:0/215603516 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7870027480 con 0x7f7878130460 2023-09-30T22:22:42.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.568+0000 7f7880055700 1 -- 172.21.15.156:0/215603516 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f787812be80 con 0x7f7878130460 2023-09-30T22:22:42.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.569+0000 7f786e7fc700 1 -- 172.21.15.156:0/215603516 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7870012430 con 0x7f7878130460 2023-09-30T22:22:42.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.569+0000 7f786e7fc700 1 -- 172.21.15.156:0/215603516 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7870022070 con 0x7f7878130460 2023-09-30T22:22:42.573 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:42.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.570+0000 7f785bfff700 1 -- 172.21.15.156:0/215603516 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78540052e0 con 0x7f7878130460 2023-09-30T22:22:42.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.575+0000 7f786e7fc700 1 -- 172.21.15.156:0/215603516 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f787001c400 con 0x7f7878130460 2023-09-30T22:22:42.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.657+0000 7f878d2f4700 1 Processor -- start 2023-09-30T22:22:42.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.657+0000 7f878d2f4700 1 -- start start 2023-09-30T22:22:42.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.658+0000 7f878d2f4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8788133ad0 0x7f8788133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.658+0000 7f878d2f4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87881300a0 0x7f87881304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.658+0000 7f878d2f4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f87881309f0 0x7f878813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.658+0000 7f878d2f4700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f878806b2d0 con 0x7f87881309f0 2023-09-30T22:22:42.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.658+0000 7f878d2f4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8788133610 con 0x7f87881300a0 2023-09-30T22:22:42.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.658+0000 7f878d2f4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f878809a500 con 0x7f8788133ad0 2023-09-30T22:22:42.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.658+0000 7f87867fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87881300a0 0x7f87881304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.658+0000 7f87867fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87881300a0 0x7f87881304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:56638/0 (socket says 172.21.15.156:56638) 2023-09-30T22:22:42.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.658+0000 7f87867fc700 1 -- 172.21.15.156:0/655787367 learned_addr learned my addr 172.21.15.156:0/655787367 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:42.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.658+0000 7f87877fe700 1 --2- 172.21.15.156:0/655787367 >> v2:172.21.15.156:3300/0 conn(0x7f87881309f0 0x7f878813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.658+0000 7f8786ffd700 1 --2- 172.21.15.156:0/655787367 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8788133ad0 0x7f8788133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.658+0000 7f87877fe700 1 -- 172.21.15.156:0/655787367 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8788133ad0 msgr2=0x7f8788133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:42.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.658+0000 7f87877fe700 1 --2- 172.21.15.156:0/655787367 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8788133ad0 0x7f8788133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.658+0000 7f87877fe700 1 -- 172.21.15.156:0/655787367 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87881300a0 msgr2=0x7f87881304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:42.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.658+0000 7f87877fe700 1 --2- 172.21.15.156:0/655787367 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87881300a0 0x7f87881304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.658+0000 7f87877fe700 1 -- 172.21.15.156:0/655787367 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87881338b0 con 0x7f87881309f0 2023-09-30T22:22:42.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.658+0000 7f87867fc700 1 --2- 172.21.15.156:0/655787367 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87881300a0 0x7f87881304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:42.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.659+0000 7f87877fe700 1 --2- 172.21.15.156:0/655787367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87881309f0 0x7f878813a980 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f8780009d90 tx=0x7f878000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=640361bf2400ad0b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:42.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.659+0000 7f8785ffb700 1 -- 172.21.15.156:0/655787367 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878000e070 con 0x7f87881309f0 2023-09-30T22:22:42.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.659+0000 7f8785ffb700 1 -- 172.21.15.156:0/655787367 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878000bb20 con 0x7f87881309f0 2023-09-30T22:22:42.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.659+0000 7f8785ffb700 1 -- 172.21.15.156:0/655787367 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8780012430 con 0x7f87881309f0 2023-09-30T22:22:42.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.659+0000 7f878d2f4700 1 -- 172.21.15.156:0/655787367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87881309f0 msgr2=0x7f878813a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.659+0000 7f878d2f4700 1 --2- 172.21.15.156:0/655787367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87881309f0 0x7f878813a980 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f8780009d90 tx=0x7f878000b330 comp rx=0 tx=0).stop 2023-09-30T22:22:42.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.660+0000 7f878d2f4700 1 -- 172.21.15.156:0/655787367 shutdown_connections 2023-09-30T22:22:42.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.660+0000 7f878d2f4700 1 --2- 172.21.15.156:0/655787367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87881309f0 0x7f878813a980 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.660+0000 7f878d2f4700 1 --2- 172.21.15.156:0/655787367 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8788133ad0 0x7f8788133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.660+0000 7f878d2f4700 1 --2- 172.21.15.156:0/655787367 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87881300a0 0x7f87881304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.660+0000 7f878d2f4700 1 -- 172.21.15.156:0/655787367 >> 172.21.15.156:0/655787367 conn(0x7f8788099c40 msgr2=0x7f87880a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:42.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.660+0000 7f878d2f4700 1 -- 172.21.15.156:0/655787367 shutdown_connections 2023-09-30T22:22:42.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.660+0000 7f878d2f4700 1 -- 172.21.15.156:0/655787367 wait complete. 2023-09-30T22:22:42.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.661+0000 7f878d2f4700 1 Processor -- start 2023-09-30T22:22:42.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.661+0000 7f878d2f4700 1 -- start start 2023-09-30T22:22:42.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.662+0000 7f878d2f4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87881300a0 0x7f878811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.662+0000 7f878d2f4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87881309f0 0x7f878811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.662+0000 7f878d2f4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8788133ad0 0x7f878811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.662+0000 7f878d2f4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87881200c0 con 0x7f8788133ad0 2023-09-30T22:22:42.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.662+0000 7f878d2f4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878811f040 con 0x7f87881300a0 2023-09-30T22:22:42.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.662+0000 7f878d2f4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f878811fb20 con 0x7f87881309f0 2023-09-30T22:22:42.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.662+0000 7f87877fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8788133ad0 0x7f878811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.662+0000 7f87877fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8788133ad0 0x7f878811e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44076/0 (socket says 172.21.15.156:44076) 2023-09-30T22:22:42.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.662+0000 7f87877fe700 1 -- 172.21.15.156:0/2624776626 learned_addr learned my addr 172.21.15.156:0/2624776626 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:42.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.662+0000 7f87867fc700 1 --2- 172.21.15.156:0/2624776626 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87881309f0 0x7f878811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.662+0000 7f8786ffd700 1 --2- 172.21.15.156:0/2624776626 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87881300a0 0x7f878811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.662+0000 7f87877fe700 1 -- 172.21.15.156:0/2624776626 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87881309f0 msgr2=0x7f878811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.662+0000 7f87877fe700 1 --2- 172.21.15.156:0/2624776626 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87881309f0 0x7f878811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.662+0000 7f87877fe700 1 -- 172.21.15.156:0/2624776626 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87881300a0 msgr2=0x7f878811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.662+0000 7f87877fe700 1 --2- 172.21.15.156:0/2624776626 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87881300a0 0x7f878811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.662+0000 7f87877fe700 1 -- 172.21.15.156:0/2624776626 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877c009550 con 0x7f8788133ad0 2023-09-30T22:22:42.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.663+0000 7f87877fe700 1 --2- 172.21.15.156:0/2624776626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8788133ad0 0x7f878811e4c0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f878806b410 tx=0x7f8780004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:42.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.663+0000 7f876f7fe700 1 -- 172.21.15.156:0/2624776626 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8780004450 con 0x7f8788133ad0 2023-09-30T22:22:42.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.663+0000 7f876f7fe700 1 -- 172.21.15.156:0/2624776626 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8780020070 con 0x7f8788133ad0 2023-09-30T22:22:42.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.663+0000 7f878d2f4700 1 -- 172.21.15.156:0/2624776626 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8780009a70 con 0x7f8788133ad0 2023-09-30T22:22:42.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.663+0000 7f876f7fe700 1 -- 172.21.15.156:0/2624776626 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8780004810 con 0x7f8788133ad0 2023-09-30T22:22:42.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.663+0000 7f878d2f4700 1 -- 172.21.15.156:0/2624776626 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878812dd00 con 0x7f8788133ad0 2023-09-30T22:22:42.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.664+0000 7f878d2f4700 1 -- 172.21.15.156:0/2624776626 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f878804f2a0 con 0x7f8788133ad0 2023-09-30T22:22:42.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.664+0000 7f876f7fe700 1 -- 172.21.15.156:0/2624776626 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8780012430 con 0x7f8788133ad0 2023-09-30T22:22:42.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.664+0000 7f876f7fe700 1 -- 172.21.15.156:0/2624776626 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8780022070 con 0x7f8788133ad0 2023-09-30T22:22:42.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.672+0000 7f876f7fe700 1 -- 172.21.15.156:0/2624776626 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8780072750 con 0x7f8788133ad0 2023-09-30T22:22:42.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.692+0000 7f5b91934700 1 Processor -- start 2023-09-30T22:22:42.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.692+0000 7f5b91934700 1 -- start start 2023-09-30T22:22:42.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.692+0000 7f5b91934700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5b8c0a0a70 0x7f5b8c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.692+0000 7f5b91934700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b8c0a1380 0x7f5b8c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.692+0000 7f5b91934700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b8c133f50 0x7f5b8c1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.692+0000 7f5b91934700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b8c09e9d0 con 0x7f5b8c0a0a70 2023-09-30T22:22:42.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.692+0000 7f5b91934700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c09dc00 con 0x7f5b8c133f50 2023-09-30T22:22:42.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.692+0000 7f5b91934700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c09dec0 con 0x7f5b8c0a1380 2023-09-30T22:22:42.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.692+0000 7f5b8a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b8c0a1380 0x7f5b8c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.692+0000 7f5b8b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b8c133f50 0x7f5b8c1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.693+0000 7f5b8a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b8c0a1380 0x7f5b8c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51632/0 (socket says 172.21.15.156:51632) 2023-09-30T22:22:42.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.693+0000 7f5b8a7fc700 1 -- 172.21.15.156:0/633661249 learned_addr learned my addr 172.21.15.156:0/633661249 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:42.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.693+0000 7f5b8affd700 1 --2- 172.21.15.156:0/633661249 >> v2:172.21.15.156:3300/0 conn(0x7f5b8c0a0a70 0x7f5b8c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.693+0000 7f5b8a7fc700 1 -- 172.21.15.156:0/633661249 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b8c133f50 msgr2=0x7f5b8c1343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:42.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.693+0000 7f5b8a7fc700 1 --2- 172.21.15.156:0/633661249 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b8c133f50 0x7f5b8c1343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.693+0000 7f5b8a7fc700 1 -- 172.21.15.156:0/633661249 >> v2:172.21.15.156:3300/0 conn(0x7f5b8c0a0a70 msgr2=0x7f5b8c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:42.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.693+0000 7f5b8a7fc700 1 --2- 172.21.15.156:0/633661249 >> v2:172.21.15.156:3300/0 conn(0x7f5b8c0a0a70 0x7f5b8c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.693+0000 7f5b8a7fc700 1 -- 172.21.15.156:0/633661249 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8c09e6a0 con 0x7f5b8c0a1380 2023-09-30T22:22:42.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.693+0000 7f5b8affd700 1 --2- 172.21.15.156:0/633661249 >> v2:172.21.15.156:3300/0 conn(0x7f5b8c0a0a70 0x7f5b8c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:42.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.693+0000 7f5b8b7fe700 1 --2- 172.21.15.156:0/633661249 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b8c133f50 0x7f5b8c1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:42.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.693+0000 7f5b8a7fc700 1 --2- 172.21.15.156:0/633661249 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b8c0a1380 0x7f5b8c133a10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5b800098f0 tx=0x7f5b80009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a527d7d5211e89e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:42.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.693+0000 7f5b89ffb700 1 -- 172.21.15.156:0/633661249 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b80011830 con 0x7f5b8c0a1380 2023-09-30T22:22:42.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.693+0000 7f5b89ffb700 1 -- 172.21.15.156:0/633661249 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b80011990 con 0x7f5b8c0a1380 2023-09-30T22:22:42.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.693+0000 7f5b89ffb700 1 -- 172.21.15.156:0/633661249 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b80011d20 con 0x7f5b8c0a1380 2023-09-30T22:22:42.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.694+0000 7f5b91934700 1 -- 172.21.15.156:0/633661249 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b8c0a1380 msgr2=0x7f5b8c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.694+0000 7f5b91934700 1 --2- 172.21.15.156:0/633661249 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b8c0a1380 0x7f5b8c133a10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5b800098f0 tx=0x7f5b80009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:42.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.694+0000 7f5b91934700 1 -- 172.21.15.156:0/633661249 shutdown_connections 2023-09-30T22:22:42.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.694+0000 7f5b91934700 1 --2- 172.21.15.156:0/633661249 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b8c133f50 0x7f5b8c1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.694+0000 7f5b91934700 1 --2- 172.21.15.156:0/633661249 >> v2:172.21.15.156:3300/0 conn(0x7f5b8c0a0a70 0x7f5b8c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.694+0000 7f5b91934700 1 --2- 172.21.15.156:0/633661249 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b8c0a1380 0x7f5b8c133a10 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.694+0000 7f5b91934700 1 -- 172.21.15.156:0/633661249 >> 172.21.15.156:0/633661249 conn(0x7f5b8c0a6610 msgr2=0x7f5b8c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:42.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.694+0000 7f5b91934700 1 -- 172.21.15.156:0/633661249 shutdown_connections 2023-09-30T22:22:42.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.694+0000 7f5b91934700 1 -- 172.21.15.156:0/633661249 wait complete. 2023-09-30T22:22:42.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.695+0000 7f5b91934700 1 Processor -- start 2023-09-30T22:22:42.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.696+0000 7f5b91934700 1 -- start start 2023-09-30T22:22:42.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.696+0000 7f5b91934700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b8c0a0a70 0x7f5b8c1226f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.696+0000 7f5b91934700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b8c0a1380 0x7f5b8c122c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.696+0000 7f5b91934700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b8c133f50 0x7f5b8c123170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.696+0000 7f5b91934700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c133ad0 con 0x7f5b8c0a0a70 2023-09-30T22:22:42.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.696+0000 7f5b91934700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c125bd0 con 0x7f5b8c133f50 2023-09-30T22:22:42.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.696+0000 7f5b91934700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c124300 con 0x7f5b8c0a1380 2023-09-30T22:22:42.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.696+0000 7f5b8b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b8c133f50 0x7f5b8c123170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.696+0000 7f5b8b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b8c133f50 0x7f5b8c123170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:56678/0 (socket says 172.21.15.156:56678) 2023-09-30T22:22:42.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.696+0000 7f5b8b7fe700 1 -- 172.21.15.156:0/4083426495 learned_addr learned my addr 172.21.15.156:0/4083426495 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:42.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.696+0000 7f5b8a7fc700 1 --2- 172.21.15.156:0/4083426495 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b8c0a1380 0x7f5b8c122c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.696+0000 7f5b8affd700 1 --2- 172.21.15.156:0/4083426495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b8c0a0a70 0x7f5b8c1226f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.697+0000 7f5b8a7fc700 1 -- 172.21.15.156:0/4083426495 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b8c133f50 msgr2=0x7f5b8c123170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.697+0000 7f5b8a7fc700 1 --2- 172.21.15.156:0/4083426495 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b8c133f50 0x7f5b8c123170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.697+0000 7f5b8a7fc700 1 -- 172.21.15.156:0/4083426495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b8c0a0a70 msgr2=0x7f5b8c1226f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.697+0000 7f5b8a7fc700 1 --2- 172.21.15.156:0/4083426495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b8c0a0a70 0x7f5b8c1226f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.697+0000 7f5b8a7fc700 1 -- 172.21.15.156:0/4083426495 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7c0094a0 con 0x7f5b8c0a1380 2023-09-30T22:22:42.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.697+0000 7f5b8a7fc700 1 --2- 172.21.15.156:0/4083426495 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b8c0a1380 0x7f5b8c122c30 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c0a72d0 tx=0x7f5b80004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:42.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.697+0000 7f5b73fff700 1 -- 172.21.15.156:0/4083426495 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b80004240 con 0x7f5b8c0a1380 2023-09-30T22:22:42.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.697+0000 7f5b73fff700 1 -- 172.21.15.156:0/4083426495 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8001f070 con 0x7f5b8c0a1380 2023-09-30T22:22:42.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.697+0000 7f5b91934700 1 -- 172.21.15.156:0/4083426495 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b84009a70 con 0x7f5b8c0a1380 2023-09-30T22:22:42.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.697+0000 7f5b73fff700 1 -- 172.21.15.156:0/4083426495 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b800045e0 con 0x7f5b8c0a1380 2023-09-30T22:22:42.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.697+0000 7f5b91934700 1 -- 172.21.15.156:0/4083426495 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b80009550 con 0x7f5b8c0a1380 2023-09-30T22:22:42.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.698+0000 7f5b91934700 1 -- 172.21.15.156:0/4083426495 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b6c0052e0 con 0x7f5b8c0a1380 2023-09-30T22:22:42.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.699+0000 7f5b73fff700 1 -- 172.21.15.156:0/4083426495 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5b80021030 con 0x7f5b8c0a1380 2023-09-30T22:22:42.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.699+0000 7f5b73fff700 1 -- 172.21.15.156:0/4083426495 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5b800408c0 con 0x7f5b8c0a1380 2023-09-30T22:22:42.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.705+0000 7f5b73fff700 1 -- 172.21.15.156:0/4083426495 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5b800197c0 con 0x7f5b8c0a1380 2023-09-30T22:22:42.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.706+0000 7f2403c34700 1 Processor -- start 2023-09-30T22:22:42.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.707+0000 7f2403c34700 1 -- start start 2023-09-30T22:22:42.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.707+0000 7f2403c34700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23fc09a150 0x7f23fc09e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.707+0000 7f2403c34700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f23fc09edb0 0x7f23fc09f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.707+0000 7f2403c34700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23fc133c20 0x7f23fc1340a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.707+0000 7f2403c34700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23fc09a520 con 0x7f23fc09edb0 2023-09-30T22:22:42.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.707+0000 7f2403c34700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc09fe00 con 0x7f23fc09a150 2023-09-30T22:22:42.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.707+0000 7f2403c34700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc06bec0 con 0x7f23fc133c20 2023-09-30T22:22:42.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.707+0000 7f24021d1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23fc133c20 0x7f23fc1340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.707+0000 7f24021d1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23fc133c20 0x7f23fc1340a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51652/0 (socket says 172.21.15.156:51652) 2023-09-30T22:22:42.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.707+0000 7f24021d1700 1 -- 172.21.15.156:0/589735083 learned_addr learned my addr 172.21.15.156:0/589735083 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:42.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.708+0000 7f24011cf700 1 --2- 172.21.15.156:0/589735083 >> v2:172.21.15.156:3300/0 conn(0x7f23fc09edb0 0x7f23fc09f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.708+0000 7f24021d1700 1 -- 172.21.15.156:0/589735083 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23fc09a150 msgr2=0x7f23fc09e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:42.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.708+0000 7f24021d1700 1 --2- 172.21.15.156:0/589735083 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23fc09a150 0x7f23fc09e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.708+0000 7f24021d1700 1 -- 172.21.15.156:0/589735083 >> v2:172.21.15.156:3300/0 conn(0x7f23fc09edb0 msgr2=0x7f23fc09f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:42.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.708+0000 7f24021d1700 1 --2- 172.21.15.156:0/589735083 >> v2:172.21.15.156:3300/0 conn(0x7f23fc09edb0 0x7f23fc09f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.708+0000 7f24021d1700 1 -- 172.21.15.156:0/589735083 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23fc09af80 con 0x7f23fc133c20 2023-09-30T22:22:42.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.708+0000 7f24011cf700 1 --2- 172.21.15.156:0/589735083 >> v2:172.21.15.156:3300/0 conn(0x7f23fc09edb0 0x7f23fc09f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:42.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.708+0000 7f24021d1700 1 --2- 172.21.15.156:0/589735083 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23fc133c20 0x7f23fc1340a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009e80 tx=0x7f23f400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b1055004e384178 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:42.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.708+0000 7f24009ce700 1 -- 172.21.15.156:0/589735083 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f400e070 con 0x7f23fc133c20 2023-09-30T22:22:42.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.708+0000 7f24009ce700 1 -- 172.21.15.156:0/589735083 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f400b8d0 con 0x7f23fc133c20 2023-09-30T22:22:42.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.708+0000 7f24009ce700 1 -- 172.21.15.156:0/589735083 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f400bc80 con 0x7f23fc133c20 2023-09-30T22:22:42.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.709+0000 7f2403c34700 1 -- 172.21.15.156:0/589735083 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23fc133c20 msgr2=0x7f23fc1340a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.709+0000 7f2403c34700 1 --2- 172.21.15.156:0/589735083 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23fc133c20 0x7f23fc1340a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009e80 tx=0x7f23f400b330 comp rx=0 tx=0).stop 2023-09-30T22:22:42.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.709+0000 7f2403c34700 1 -- 172.21.15.156:0/589735083 shutdown_connections 2023-09-30T22:22:42.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.709+0000 7f2403c34700 1 --2- 172.21.15.156:0/589735083 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23fc133c20 0x7f23fc1340a0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.709+0000 7f2403c34700 1 --2- 172.21.15.156:0/589735083 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23fc09a150 0x7f23fc09e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.709+0000 7f2403c34700 1 --2- 172.21.15.156:0/589735083 >> v2:172.21.15.156:3300/0 conn(0x7f23fc09edb0 0x7f23fc09f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.709+0000 7f2403c34700 1 -- 172.21.15.156:0/589735083 >> 172.21.15.156:0/589735083 conn(0x7f23fc0a4430 msgr2=0x7f23fc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:42.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.709+0000 7f2403c34700 1 -- 172.21.15.156:0/589735083 shutdown_connections 2023-09-30T22:22:42.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.709+0000 7f2403c34700 1 -- 172.21.15.156:0/589735083 wait complete. 2023-09-30T22:22:42.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.710+0000 7f2403c34700 1 Processor -- start 2023-09-30T22:22:42.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.710+0000 7f2403c34700 1 -- start start 2023-09-30T22:22:42.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.710+0000 7f2403c34700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23fc09a150 0x7f23fc11ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.710+0000 7f2403c34700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23fc09edb0 0x7f23fc11f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.710+0000 7f2403c34700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23fc133c20 0x7f23fc11f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.710+0000 7f2403c34700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc0a0440 con 0x7f23fc09edb0 2023-09-30T22:22:42.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.710+0000 7f2403c34700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc1206b0 con 0x7f23fc09a150 2023-09-30T22:22:42.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.710+0000 7f2403c34700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc1221d0 con 0x7f23fc133c20 2023-09-30T22:22:42.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.711+0000 7f24011cf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23fc09edb0 0x7f23fc11f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.711+0000 7f24011cf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23fc09edb0 0x7f23fc11f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44098/0 (socket says 172.21.15.156:44098) 2023-09-30T22:22:42.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.711+0000 7f24011cf700 1 -- 172.21.15.156:0/3434860939 learned_addr learned my addr 172.21.15.156:0/3434860939 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:42.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.711+0000 7f24021d1700 1 --2- 172.21.15.156:0/3434860939 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23fc133c20 0x7f23fc11f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.711+0000 7f24019d0700 1 --2- 172.21.15.156:0/3434860939 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23fc09a150 0x7f23fc11ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.711+0000 7f24011cf700 1 -- 172.21.15.156:0/3434860939 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23fc133c20 msgr2=0x7f23fc11f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.711+0000 7f24011cf700 1 --2- 172.21.15.156:0/3434860939 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23fc133c20 0x7f23fc11f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.711+0000 7f24011cf700 1 -- 172.21.15.156:0/3434860939 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23fc09a150 msgr2=0x7f23fc11ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.711+0000 7f24011cf700 1 --2- 172.21.15.156:0/3434860939 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23fc09a150 0x7f23fc11ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.711+0000 7f24011cf700 1 -- 172.21.15.156:0/3434860939 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ec0094a0 con 0x7f23fc09edb0 2023-09-30T22:22:42.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.711+0000 7f24011cf700 1 --2- 172.21.15.156:0/3434860939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23fc09edb0 0x7f23fc11f010 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f23ec00ebb0 tx=0x7f23ec00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:42.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.711+0000 7f23f27fc700 1 -- 172.21.15.156:0/3434860939 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec00c850 con 0x7f23fc09edb0 2023-09-30T22:22:42.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.711+0000 7f23f27fc700 1 -- 172.21.15.156:0/3434860939 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ec00c9b0 con 0x7f23fc09edb0 2023-09-30T22:22:42.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.711+0000 7f2403c34700 1 -- 172.21.15.156:0/3434860939 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f4009b30 con 0x7f23fc09edb0 2023-09-30T22:22:42.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.711+0000 7f2403c34700 1 -- 172.21.15.156:0/3434860939 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23fc120d90 con 0x7f23fc09edb0 2023-09-30T22:22:42.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.711+0000 7f23f27fc700 1 -- 172.21.15.156:0/3434860939 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec00cd40 con 0x7f23fc09edb0 2023-09-30T22:22:42.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.712+0000 7f2403c34700 1 -- 172.21.15.156:0/3434860939 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e40052e0 con 0x7f23fc09edb0 2023-09-30T22:22:42.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.713+0000 7f23f27fc700 1 -- 172.21.15.156:0/3434860939 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f23ec013470 con 0x7f23fc09edb0 2023-09-30T22:22:42.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.713+0000 7f23f27fc700 1 -- 172.21.15.156:0/3434860939 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f23ec0400a0 con 0x7f23fc09edb0 2023-09-30T22:22:42.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.718+0000 7f23f27fc700 1 -- 172.21.15.156:0/3434860939 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23ec024350 con 0x7f23fc09edb0 2023-09-30T22:22:42.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.825+0000 7f785bfff700 1 -- 172.21.15.156:0/215603516 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7854005590 con 0x7f7878130460 2023-09-30T22:22:42.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.825+0000 7f786e7fc700 1 -- 172.21.15.156:0/215603516 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f787002c070 con 0x7f7878130460 2023-09-30T22:22:42.826 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:42.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.827+0000 7f785bfff700 1 -- 172.21.15.156:0/215603516 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7878130460 msgr2=0x7f78781c3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.827+0000 7f785bfff700 1 --2- 172.21.15.156:0/215603516 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7878130460 0x7f78781c3c10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7870016000 tx=0x7f7870004ad0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.827+0000 7f785bfff700 1 -- 172.21.15.156:0/215603516 shutdown_connections 2023-09-30T22:22:42.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.827+0000 7f785bfff700 1 --2- 172.21.15.156:0/215603516 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7878130460 0x7f78781c3c10 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.827+0000 7f785bfff700 1 --2- 172.21.15.156:0/215603516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f787812cb80 0x7f7878129180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.827+0000 7f785bfff700 1 --2- 172.21.15.156:0/215603516 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f787812fab0 0x7f78781296c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.827+0000 7f785bfff700 1 -- 172.21.15.156:0/215603516 >> 172.21.15.156:0/215603516 conn(0x7f78780a2eb0 msgr2=0x7f787806dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:42.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.827+0000 7f785bfff700 1 -- 172.21.15.156:0/215603516 shutdown_connections 2023-09-30T22:22:42.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.827+0000 7f785bfff700 1 -- 172.21.15.156:0/215603516 wait complete. 2023-09-30T22:22:42.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:42.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.908+0000 7f878d2f4700 1 -- 172.21.15.156:0/2624776626 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f878812d970 con 0x7f8788133ad0 2023-09-30T22:22:42.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.908+0000 7f876f7fe700 1 -- 172.21.15.156:0/2624776626 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f878001c400 con 0x7f8788133ad0 2023-09-30T22:22:42.909 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:42.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.908+0000 7f5b91934700 1 -- 172.21.15.156:0/4083426495 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5b6c005590 con 0x7f5b8c0a1380 2023-09-30T22:22:42.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.909+0000 7f5b73fff700 1 -- 172.21.15.156:0/4083426495 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5b80015070 con 0x7f5b8c0a1380 2023-09-30T22:22:42.910 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:42.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.910+0000 7f878d2f4700 1 -- 172.21.15.156:0/2624776626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8788133ad0 msgr2=0x7f878811e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.910+0000 7f878d2f4700 1 --2- 172.21.15.156:0/2624776626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8788133ad0 0x7f878811e4c0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f878806b410 tx=0x7f8780004ad0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.911+0000 7f878d2f4700 1 -- 172.21.15.156:0/2624776626 shutdown_connections 2023-09-30T22:22:42.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.911+0000 7f878d2f4700 1 --2- 172.21.15.156:0/2624776626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8788133ad0 0x7f878811e4c0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.911+0000 7f878d2f4700 1 --2- 172.21.15.156:0/2624776626 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87881300a0 0x7f878811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.911+0000 7f878d2f4700 1 --2- 172.21.15.156:0/2624776626 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87881309f0 0x7f878811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.911+0000 7f878d2f4700 1 -- 172.21.15.156:0/2624776626 >> 172.21.15.156:0/2624776626 conn(0x7f8788099c40 msgr2=0x7f8788131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:42.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.911+0000 7f878d2f4700 1 -- 172.21.15.156:0/2624776626 shutdown_connections 2023-09-30T22:22:42.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.911+0000 7f878d2f4700 1 -- 172.21.15.156:0/2624776626 wait complete. 2023-09-30T22:22:42.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.911+0000 7f5b91934700 1 -- 172.21.15.156:0/4083426495 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b8c0a1380 msgr2=0x7f5b8c122c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.911+0000 7f5b91934700 1 --2- 172.21.15.156:0/4083426495 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b8c0a1380 0x7f5b8c122c30 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c0a72d0 tx=0x7f5b80004750 comp rx=0 tx=0).stop 2023-09-30T22:22:42.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.911+0000 7f5b91934700 1 -- 172.21.15.156:0/4083426495 shutdown_connections 2023-09-30T22:22:42.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.911+0000 7f5b91934700 1 --2- 172.21.15.156:0/4083426495 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b8c133f50 0x7f5b8c123170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.911+0000 7f5b91934700 1 --2- 172.21.15.156:0/4083426495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b8c0a0a70 0x7f5b8c1226f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.911+0000 7f5b91934700 1 --2- 172.21.15.156:0/4083426495 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b8c0a1380 0x7f5b8c122c30 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.911+0000 7f5b91934700 1 -- 172.21.15.156:0/4083426495 >> 172.21.15.156:0/4083426495 conn(0x7f5b8c0a6610 msgr2=0x7f5b8c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:42.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.911+0000 7f5b91934700 1 -- 172.21.15.156:0/4083426495 shutdown_connections 2023-09-30T22:22:42.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.911+0000 7f5b91934700 1 -- 172.21.15.156:0/4083426495 wait complete. 2023-09-30T22:22:42.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.918+0000 7f2403c34700 1 -- 172.21.15.156:0/3434860939 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f23e4005150 con 0x7f23fc09edb0 2023-09-30T22:22:42.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.919+0000 7f23f27fc700 1 -- 172.21.15.156:0/3434860939 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f23ec01ab10 con 0x7f23fc09edb0 2023-09-30T22:22:42.919 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:42.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.923+0000 7f2403c34700 1 -- 172.21.15.156:0/3434860939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23fc09edb0 msgr2=0x7f23fc11f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.923+0000 7f2403c34700 1 --2- 172.21.15.156:0/3434860939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23fc09edb0 0x7f23fc11f010 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f23ec00ebb0 tx=0x7f23ec00eec0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.923+0000 7f2403c34700 1 -- 172.21.15.156:0/3434860939 shutdown_connections 2023-09-30T22:22:42.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.923+0000 7f2403c34700 1 --2- 172.21.15.156:0/3434860939 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23fc133c20 0x7f23fc11f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.923+0000 7f2403c34700 1 --2- 172.21.15.156:0/3434860939 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23fc09a150 0x7f23fc11ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.923+0000 7f2403c34700 1 --2- 172.21.15.156:0/3434860939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23fc09edb0 0x7f23fc11f010 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.923+0000 7f2403c34700 1 -- 172.21.15.156:0/3434860939 >> 172.21.15.156:0/3434860939 conn(0x7f23fc0a4430 msgr2=0x7f23fc071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:42.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.923+0000 7f2403c34700 1 -- 172.21.15.156:0/3434860939 shutdown_connections 2023-09-30T22:22:42.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:42.923+0000 7f2403c34700 1 -- 172.21.15.156:0/3434860939 wait complete. 2023-09-30T22:22:42.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:42.927 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:42.936 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:43.841 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:43.926 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:43.928 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:43.937 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:43.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.987+0000 7fe534291700 1 Processor -- start 2023-09-30T22:22:43.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.987+0000 7fe534291700 1 -- start start 2023-09-30T22:22:43.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.988+0000 7fe534291700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe52c12d280 0x7fe52c12d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:43.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.988+0000 7fe534291700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe52c130350 0x7fe52c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:43.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.988+0000 7fe534291700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe52c09ae40 con 0x7fe52c130ce0 2023-09-30T22:22:43.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.988+0000 7fe534291700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52c09b9a0 con 0x7fe52c12d280 2023-09-30T22:22:43.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.988+0000 7fe534291700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c09bbb0 con 0x7fe52c130350 2023-09-30T22:22:43.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.988+0000 7fe53202d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe52c12d280 0x7fe52c12d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:43.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.988+0000 7fe53202d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe52c12d280 0x7fe52c12d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44106/0 (socket says 172.21.15.156:44106) 2023-09-30T22:22:43.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.988+0000 7fe53202d700 1 -- 172.21.15.156:0/2470609234 learned_addr learned my addr 172.21.15.156:0/2470609234 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:43.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.988+0000 7fe53182c700 1 --2- 172.21.15.156:0/2470609234 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe52c130350 0x7fe52c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:43.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.989+0000 7fe53202d700 1 -- 172.21.15.156:0/2470609234 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe52c130350 msgr2=0x7fe52c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:43.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.989+0000 7fe53202d700 1 --2- 172.21.15.156:0/2470609234 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe52c130350 0x7fe52c1307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.989+0000 7fe53202d700 1 -- 172.21.15.156:0/2470609234 >> v1:172.21.15.156:6789/0 conn(0x7fe52c130ce0 legacy=0x7fe52c137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:43.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.989+0000 7fe53102b700 1 -- 172.21.15.156:0/2470609234 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3906160973 0 0) 0x7fe52c09ae40 con 0x7fe52c130ce0 2023-09-30T22:22:43.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.989+0000 7fe53202d700 1 -- 172.21.15.156:0/2470609234 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52c09b250 con 0x7fe52c12d280 2023-09-30T22:22:43.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.989+0000 7fe53182c700 1 --2- 172.21.15.156:0/2470609234 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe52c130350 0x7fe52c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:43.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.989+0000 7fe53202d700 1 --2- 172.21.15.156:0/2470609234 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe52c12d280 0x7fe52c12d650 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fe528006fd0 tx=0x7fe528009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44998c84674b771e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:43.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.989+0000 7fe53102b700 1 -- 172.21.15.156:0/2470609234 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe528005e30 con 0x7fe52c12d280 2023-09-30T22:22:43.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.989+0000 7fe53102b700 1 -- 172.21.15.156:0/2470609234 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe528004030 con 0x7fe52c12d280 2023-09-30T22:22:43.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.989+0000 7fe53102b700 1 -- 172.21.15.156:0/2470609234 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5280043e0 con 0x7fe52c12d280 2023-09-30T22:22:43.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.990+0000 7fe534291700 1 -- 172.21.15.156:0/2470609234 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe52c12d280 msgr2=0x7fe52c12d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:43.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.990+0000 7fe534291700 1 --2- 172.21.15.156:0/2470609234 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe52c12d280 0x7fe52c12d650 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fe528006fd0 tx=0x7fe528009bd0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.990+0000 7fe534291700 1 -- 172.21.15.156:0/2470609234 shutdown_connections 2023-09-30T22:22:43.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.990+0000 7fe534291700 1 --2- 172.21.15.156:0/2470609234 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe52c12d280 0x7fe52c12d650 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.990+0000 7fe534291700 1 --2- 172.21.15.156:0/2470609234 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe52c130350 0x7fe52c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.990+0000 7fe534291700 1 -- 172.21.15.156:0/2470609234 >> 172.21.15.156:0/2470609234 conn(0x7fe52c0a2980 msgr2=0x7fe52c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:43.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.990+0000 7fe534291700 1 -- 172.21.15.156:0/2470609234 shutdown_connections 2023-09-30T22:22:43.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.990+0000 7fe534291700 1 -- 172.21.15.156:0/2470609234 wait complete. 2023-09-30T22:22:43.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.991+0000 7fe534291700 1 Processor -- start 2023-09-30T22:22:43.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.991+0000 7fe534291700 1 -- start start 2023-09-30T22:22:43.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.992+0000 7fe534291700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe52c12d280 0x7fe52c11eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:43.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.992+0000 7fe534291700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe52c130350 0x7fe52c11f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:43.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.992+0000 7fe534291700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe52c130ce0 0x7fe52c11f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:43.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.992+0000 7fe534291700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c1208b0 con 0x7fe52c12d280 2023-09-30T22:22:43.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.992+0000 7fe534291700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c122220 con 0x7fe52c130350 2023-09-30T22:22:43.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.992+0000 7fe534291700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c1227c0 con 0x7fe52c130ce0 2023-09-30T22:22:43.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.992+0000 7fe53202d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe52c12d280 0x7fe52c11eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:43.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.992+0000 7fe53202d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe52c12d280 0x7fe52c11eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44110/0 (socket says 172.21.15.156:44110) 2023-09-30T22:22:43.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.992+0000 7fe53202d700 1 -- 172.21.15.156:0/1639353794 learned_addr learned my addr 172.21.15.156:0/1639353794 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:43.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.992+0000 7fe53182c700 1 --2- 172.21.15.156:0/1639353794 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe52c130350 0x7fe52c11f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:43.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.992+0000 7fe53282e700 1 --2- 172.21.15.156:0/1639353794 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe52c130ce0 0x7fe52c11f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:43.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.993+0000 7fe53202d700 1 -- 172.21.15.156:0/1639353794 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe52c130ce0 msgr2=0x7fe52c11f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:43.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.993+0000 7fe53202d700 1 --2- 172.21.15.156:0/1639353794 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe52c130ce0 0x7fe52c11f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.993+0000 7fe53202d700 1 -- 172.21.15.156:0/1639353794 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe52c130350 msgr2=0x7fe52c11f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:43.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.993+0000 7fe53202d700 1 --2- 172.21.15.156:0/1639353794 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe52c130350 0x7fe52c11f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.993+0000 7fe53202d700 1 -- 172.21.15.156:0/1639353794 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe51c0094a0 con 0x7fe52c12d280 2023-09-30T22:22:43.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.993+0000 7fe53202d700 1 --2- 172.21.15.156:0/1639353794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe52c12d280 0x7fe52c11eca0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fe528004000 tx=0x7fe528004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:43.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.993+0000 7fe522ffd700 1 -- 172.21.15.156:0/1639353794 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe528003c30 con 0x7fe52c12d280 2023-09-30T22:22:43.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.993+0000 7fe522ffd700 1 -- 172.21.15.156:0/1639353794 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe528003d90 con 0x7fe52c12d280 2023-09-30T22:22:43.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.993+0000 7fe534291700 1 -- 172.21.15.156:0/1639353794 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe528009500 con 0x7fe52c12d280 2023-09-30T22:22:43.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.993+0000 7fe522ffd700 1 -- 172.21.15.156:0/1639353794 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52801c640 con 0x7fe52c12d280 2023-09-30T22:22:43.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.993+0000 7fe534291700 1 -- 172.21.15.156:0/1639353794 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe52c09b490 con 0x7fe52c12d280 2023-09-30T22:22:43.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.994+0000 7fe522ffd700 1 -- 172.21.15.156:0/1639353794 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe52801c7a0 con 0x7fe52c12d280 2023-09-30T22:22:43.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.994+0000 7fe534291700 1 -- 172.21.15.156:0/1639353794 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe52c04f2a0 con 0x7fe52c12d280 2023-09-30T22:22:43.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:43.995+0000 7fe522ffd700 1 -- 172.21.15.156:0/1639353794 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe528040660 con 0x7fe52c12d280 2023-09-30T22:22:44.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.001+0000 7fe522ffd700 1 -- 172.21.15.156:0/1639353794 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe528011420 con 0x7fe52c12d280 2023-09-30T22:22:44.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.062+0000 7fd1e775c700 1 Processor -- start 2023-09-30T22:22:44.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.063+0000 7fd1e775c700 1 -- start start 2023-09-30T22:22:44.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.063+0000 7fd1e775c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1e009d860 0x7fd1e009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:44.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.063+0000 7fd1e775c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1e009e170 0x7fd1e01307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:44.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.063+0000 7fd1e775c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd1e0130ce0 0x7fd1e0131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:44.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.063+0000 7fd1e775c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e009aaa0 con 0x7fd1e0130ce0 2023-09-30T22:22:44.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.063+0000 7fd1e775c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e009f870 con 0x7fd1e009e170 2023-09-30T22:22:44.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.063+0000 7fd1e775c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e009b360 con 0x7fd1e009d860 2023-09-30T22:22:44.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.063+0000 7fd1e54f8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1e009d860 0x7fd1e009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:44.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.063+0000 7fd1e54f8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1e009d860 0x7fd1e009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51698/0 (socket says 172.21.15.156:51698) 2023-09-30T22:22:44.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.063+0000 7fd1e54f8700 1 -- 172.21.15.156:0/1671035823 learned_addr learned my addr 172.21.15.156:0/1671035823 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:44.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.064+0000 7fd1e4cf7700 1 --2- 172.21.15.156:0/1671035823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1e009e170 0x7fd1e01307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:44.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.064+0000 7fd1e5cf9700 1 --2- 172.21.15.156:0/1671035823 >> v2:172.21.15.156:3300/0 conn(0x7fd1e0130ce0 0x7fd1e0131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:44.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.064+0000 7fd1e54f8700 1 -- 172.21.15.156:0/1671035823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1e009e170 msgr2=0x7fd1e01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:44.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.064+0000 7fd1e54f8700 1 --2- 172.21.15.156:0/1671035823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1e009e170 0x7fd1e01307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.064+0000 7fd1e54f8700 1 -- 172.21.15.156:0/1671035823 >> v2:172.21.15.156:3300/0 conn(0x7fd1e0130ce0 msgr2=0x7fd1e0131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:44.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.064+0000 7fd1e54f8700 1 --2- 172.21.15.156:0/1671035823 >> v2:172.21.15.156:3300/0 conn(0x7fd1e0130ce0 0x7fd1e0131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.064+0000 7fd1e54f8700 1 -- 172.21.15.156:0/1671035823 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e009b620 con 0x7fd1e009d860 2023-09-30T22:22:44.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.064+0000 7fd1e54f8700 1 --2- 172.21.15.156:0/1671035823 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1e009d860 0x7fd1e009dc30 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc0098f0 tx=0x7fd1dc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d23a59e0a0f0f65 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:44.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.064+0000 7fd1d7fff700 1 -- 172.21.15.156:0/1671035823 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc00b8a0 con 0x7fd1e009d860 2023-09-30T22:22:44.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.064+0000 7fd1d7fff700 1 -- 172.21.15.156:0/1671035823 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1dc00ba00 con 0x7fd1e009d860 2023-09-30T22:22:44.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.064+0000 7fd1d7fff700 1 -- 172.21.15.156:0/1671035823 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc00bd90 con 0x7fd1e009d860 2023-09-30T22:22:44.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.065+0000 7fd1e775c700 1 -- 172.21.15.156:0/1671035823 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1e009d860 msgr2=0x7fd1e009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:44.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.065+0000 7fd1e775c700 1 --2- 172.21.15.156:0/1671035823 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1e009d860 0x7fd1e009dc30 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc0098f0 tx=0x7fd1dc009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:44.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.065+0000 7fd1e775c700 1 -- 172.21.15.156:0/1671035823 shutdown_connections 2023-09-30T22:22:44.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.065+0000 7fd1e775c700 1 --2- 172.21.15.156:0/1671035823 >> v2:172.21.15.156:3300/0 conn(0x7fd1e0130ce0 0x7fd1e0131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.065+0000 7fd1e775c700 1 --2- 172.21.15.156:0/1671035823 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1e009d860 0x7fd1e009dc30 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.065+0000 7fd1e775c700 1 --2- 172.21.15.156:0/1671035823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1e009e170 0x7fd1e01307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.065+0000 7fd1e775c700 1 -- 172.21.15.156:0/1671035823 >> 172.21.15.156:0/1671035823 conn(0x7fd1e0099c40 msgr2=0x7fd1e00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:44.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.065+0000 7fd1e775c700 1 -- 172.21.15.156:0/1671035823 shutdown_connections 2023-09-30T22:22:44.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.065+0000 7fd1e775c700 1 -- 172.21.15.156:0/1671035823 wait complete. 2023-09-30T22:22:44.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.066+0000 7fd1e775c700 1 Processor -- start 2023-09-30T22:22:44.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.066+0000 7fd1e775c700 1 -- start start 2023-09-30T22:22:44.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.067+0000 7fd1e775c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1e009d860 0x7fd1e011e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:44.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.067+0000 7fd1e775c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1e009e170 0x7fd1e011e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:44.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.067+0000 7fd1e775c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1e0130ce0 0x7fd1e011eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:44.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.067+0000 7fd1e775c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e009c8b0 con 0x7fd1e009e170 2023-09-30T22:22:44.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.067+0000 7fd1e775c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e0120bf0 con 0x7fd1e009d860 2023-09-30T22:22:44.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.067+0000 7fd1e775c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e011fd20 con 0x7fd1e0130ce0 2023-09-30T22:22:44.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.067+0000 7fd1e54f8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1e009d860 0x7fd1e011e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:44.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.067+0000 7fd1e54f8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1e009d860 0x7fd1e011e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:56736/0 (socket says 172.21.15.156:56736) 2023-09-30T22:22:44.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.067+0000 7fd1e54f8700 1 -- 172.21.15.156:0/2085090893 learned_addr learned my addr 172.21.15.156:0/2085090893 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:44.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.067+0000 7fd1e5cf9700 1 --2- 172.21.15.156:0/2085090893 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1e0130ce0 0x7fd1e011eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:44.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.067+0000 7fd1e4cf7700 1 --2- 172.21.15.156:0/2085090893 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1e009e170 0x7fd1e011e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:44.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.067+0000 7fd1e54f8700 1 -- 172.21.15.156:0/2085090893 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1e0130ce0 msgr2=0x7fd1e011eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:44.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.067+0000 7fd1e54f8700 1 --2- 172.21.15.156:0/2085090893 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1e0130ce0 0x7fd1e011eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.068+0000 7fd1e54f8700 1 -- 172.21.15.156:0/2085090893 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1e009e170 msgr2=0x7fd1e011e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:44.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.068+0000 7fd1e54f8700 1 --2- 172.21.15.156:0/2085090893 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1e009e170 0x7fd1e011e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.068+0000 7fd1e54f8700 1 -- 172.21.15.156:0/2085090893 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc009550 con 0x7fd1e009d860 2023-09-30T22:22:44.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.068+0000 7fd1e5cf9700 1 --2- 172.21.15.156:0/2085090893 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1e0130ce0 0x7fd1e011eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:44.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.068+0000 7fd1e4cf7700 1 --2- 172.21.15.156:0/2085090893 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1e009e170 0x7fd1e011e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:44.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.068+0000 7fd1e54f8700 1 --2- 172.21.15.156:0/2085090893 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1e009d860 0x7fd1e011e110 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc009c40 tx=0x7fd1dc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:44.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.068+0000 7fd1d5ffb700 1 -- 172.21.15.156:0/2085090893 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc004310 con 0x7fd1e009d860 2023-09-30T22:22:44.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.068+0000 7fd1d5ffb700 1 -- 172.21.15.156:0/2085090893 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1dc004470 con 0x7fd1e009d860 2023-09-30T22:22:44.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.068+0000 7fd1e775c700 1 -- 172.21.15.156:0/2085090893 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e01307a0 con 0x7fd1e009d860 2023-09-30T22:22:44.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.068+0000 7fd1d5ffb700 1 -- 172.21.15.156:0/2085090893 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc0038e0 con 0x7fd1e009d860 2023-09-30T22:22:44.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.068+0000 7fd1e775c700 1 -- 172.21.15.156:0/2085090893 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e0121950 con 0x7fd1e009d860 2023-09-30T22:22:44.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.069+0000 7fd1d5ffb700 1 -- 172.21.15.156:0/2085090893 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd1dc003a40 con 0x7fd1e009d860 2023-09-30T22:22:44.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.069+0000 7fd1d5ffb700 1 -- 172.21.15.156:0/2085090893 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd1dc044650 con 0x7fd1e009d860 2023-09-30T22:22:44.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.069+0000 7fd1e775c700 1 -- 172.21.15.156:0/2085090893 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e0121000 con 0x7fd1e009d860 2023-09-30T22:22:44.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.074+0000 7fd1d5ffb700 1 -- 172.21.15.156:0/2085090893 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd1dc015080 con 0x7fd1e009d860 2023-09-30T22:22:44.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.085+0000 7f97f978a700 1 Processor -- start 2023-09-30T22:22:44.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.085+0000 7f97f978a700 1 -- start start 2023-09-30T22:22:44.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.086+0000 7f97f978a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97f4133ad0 0x7f97f4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:44.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.086+0000 7f97f978a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f97f41300a0 0x7f97f41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:44.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.086+0000 7f97f978a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97f41309f0 0x7f97f413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:44.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.086+0000 7f97f978a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f406b2d0 con 0x7f97f41300a0 2023-09-30T22:22:44.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.086+0000 7f97f978a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f4133610 con 0x7f97f41309f0 2023-09-30T22:22:44.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.086+0000 7f97f978a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97f409a500 con 0x7f97f4133ad0 2023-09-30T22:22:44.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.086+0000 7f97f2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97f4133ad0 0x7f97f4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:44.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.086+0000 7f97f37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97f41309f0 0x7f97f413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:44.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.086+0000 7f97f2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97f4133ad0 0x7f97f4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51714/0 (socket says 172.21.15.156:51714) 2023-09-30T22:22:44.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.086+0000 7f97f2ffd700 1 -- 172.21.15.156:0/3444921667 learned_addr learned my addr 172.21.15.156:0/3444921667 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:44.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.086+0000 7f97f37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97f41309f0 0x7f97f413a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:56748/0 (socket says 172.21.15.156:56748) 2023-09-30T22:22:44.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.086+0000 7f97f27fc700 1 --2- 172.21.15.156:0/3444921667 >> v2:172.21.15.156:3300/0 conn(0x7f97f41300a0 0x7f97f41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:44.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.086+0000 7f97f2ffd700 1 -- 172.21.15.156:0/3444921667 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97f41309f0 msgr2=0x7f97f413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:44.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.086+0000 7f97f2ffd700 1 --2- 172.21.15.156:0/3444921667 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97f41309f0 0x7f97f413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.086+0000 7f97f2ffd700 1 -- 172.21.15.156:0/3444921667 >> v2:172.21.15.156:3300/0 conn(0x7f97f41300a0 msgr2=0x7f97f41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:44.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.086+0000 7f97f2ffd700 1 --2- 172.21.15.156:0/3444921667 >> v2:172.21.15.156:3300/0 conn(0x7f97f41300a0 0x7f97f41304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.086+0000 7f97f2ffd700 1 -- 172.21.15.156:0/3444921667 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f41338b0 con 0x7f97f4133ad0 2023-09-30T22:22:44.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.087+0000 7f97f2ffd700 1 --2- 172.21.15.156:0/3444921667 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97f4133ad0 0x7f97f4133ea0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f97e40098f0 tx=0x7f97e4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4090bea33b65ccf1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:44.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.087+0000 7f97f1ffb700 1 -- 172.21.15.156:0/3444921667 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e4011830 con 0x7f97f4133ad0 2023-09-30T22:22:44.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.087+0000 7f97f1ffb700 1 -- 172.21.15.156:0/3444921667 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e4011990 con 0x7f97f4133ad0 2023-09-30T22:22:44.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.087+0000 7f97f1ffb700 1 -- 172.21.15.156:0/3444921667 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e4011d20 con 0x7f97f4133ad0 2023-09-30T22:22:44.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.087+0000 7f97f978a700 1 -- 172.21.15.156:0/3444921667 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97f4133ad0 msgr2=0x7f97f4133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:44.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.087+0000 7f97f978a700 1 --2- 172.21.15.156:0/3444921667 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97f4133ad0 0x7f97f4133ea0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f97e40098f0 tx=0x7f97e4009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:44.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.088+0000 7f97f978a700 1 -- 172.21.15.156:0/3444921667 shutdown_connections 2023-09-30T22:22:44.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.088+0000 7f97f978a700 1 --2- 172.21.15.156:0/3444921667 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97f41309f0 0x7f97f413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.088+0000 7f97f978a700 1 --2- 172.21.15.156:0/3444921667 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97f4133ad0 0x7f97f4133ea0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.088+0000 7f97f978a700 1 --2- 172.21.15.156:0/3444921667 >> v2:172.21.15.156:3300/0 conn(0x7f97f41300a0 0x7f97f41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.088+0000 7f97f978a700 1 -- 172.21.15.156:0/3444921667 >> 172.21.15.156:0/3444921667 conn(0x7f97f4099c40 msgr2=0x7f97f40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:44.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.088+0000 7f97f978a700 1 -- 172.21.15.156:0/3444921667 shutdown_connections 2023-09-30T22:22:44.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.088+0000 7f97f978a700 1 -- 172.21.15.156:0/3444921667 wait complete. 2023-09-30T22:22:44.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.089+0000 7f97f978a700 1 Processor -- start 2023-09-30T22:22:44.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.089+0000 7f97f978a700 1 -- start start 2023-09-30T22:22:44.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.089+0000 7f97f978a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97f41300a0 0x7f97f40713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:44.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.089+0000 7f97f978a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97f41309f0 0x7f97f4071900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:44.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.089+0000 7f97f978a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97f4133ad0 0x7f97f4071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:44.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.089+0000 7f97f978a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f411e040 con 0x7f97f4133ad0 2023-09-30T22:22:44.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.089+0000 7f97f978a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f4072820 con 0x7f97f41309f0 2023-09-30T22:22:44.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.089+0000 7f97f978a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97f411eed0 con 0x7f97f41300a0 2023-09-30T22:22:44.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.090+0000 7f97f2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97f41300a0 0x7f97f40713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:44.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.090+0000 7f97f2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97f41300a0 0x7f97f40713c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51726/0 (socket says 172.21.15.156:51726) 2023-09-30T22:22:44.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.090+0000 7f97f2ffd700 1 -- 172.21.15.156:0/3857108556 learned_addr learned my addr 172.21.15.156:0/3857108556 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:44.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.090+0000 7f97f27fc700 1 --2- 172.21.15.156:0/3857108556 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97f41309f0 0x7f97f4071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:44.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.090+0000 7f97f37fe700 1 --2- 172.21.15.156:0/3857108556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97f4133ad0 0x7f97f4071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:44.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.090+0000 7f97f2ffd700 1 -- 172.21.15.156:0/3857108556 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97f41309f0 msgr2=0x7f97f4071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:44.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.090+0000 7f97f2ffd700 1 --2- 172.21.15.156:0/3857108556 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97f41309f0 0x7f97f4071900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.090+0000 7f97f2ffd700 1 -- 172.21.15.156:0/3857108556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97f4133ad0 msgr2=0x7f97f4071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:44.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.090+0000 7f97f2ffd700 1 --2- 172.21.15.156:0/3857108556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97f4133ad0 0x7f97f4071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.090+0000 7f97f2ffd700 1 -- 172.21.15.156:0/3857108556 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e4009550 con 0x7f97f41300a0 2023-09-30T22:22:44.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.090+0000 7f97f2ffd700 1 --2- 172.21.15.156:0/3857108556 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97f41300a0 0x7f97f40713c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f97e4009c40 tx=0x7f97e4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:44.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.090+0000 7f97db7fe700 1 -- 172.21.15.156:0/3857108556 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e4004450 con 0x7f97f41300a0 2023-09-30T22:22:44.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.090+0000 7f97db7fe700 1 -- 172.21.15.156:0/3857108556 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e40045b0 con 0x7f97f41300a0 2023-09-30T22:22:44.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.090+0000 7f97f978a700 1 -- 172.21.15.156:0/3857108556 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f411f9b0 con 0x7f97f41300a0 2023-09-30T22:22:44.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.090+0000 7f97db7fe700 1 -- 172.21.15.156:0/3857108556 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e40038c0 con 0x7f97f41300a0 2023-09-30T22:22:44.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.090+0000 7f97f978a700 1 -- 172.21.15.156:0/3857108556 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f412dd00 con 0x7f97f41300a0 2023-09-30T22:22:44.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.092+0000 7f97f978a700 1 -- 172.21.15.156:0/3857108556 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f409cb20 con 0x7f97f41300a0 2023-09-30T22:22:44.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.092+0000 7f97db7fe700 1 -- 172.21.15.156:0/3857108556 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f97e4003a20 con 0x7f97f41300a0 2023-09-30T22:22:44.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.092+0000 7f97db7fe700 1 -- 172.21.15.156:0/3857108556 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f97e4051640 con 0x7f97f41300a0 2023-09-30T22:22:44.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.096+0000 7f97db7fe700 1 -- 172.21.15.156:0/3857108556 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f97e401a420 con 0x7f97f41300a0 2023-09-30T22:22:44.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.111+0000 7f145978f700 1 Processor -- start 2023-09-30T22:22:44.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.112+0000 7f145978f700 1 -- start start 2023-09-30T22:22:44.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.112+0000 7f145978f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14541368e0 0x7f1454138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:44.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.112+0000 7f145978f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1454139200 0x7f145413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:44.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.112+0000 7f145978f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f145409a760 con 0x7f1454133900 2023-09-30T22:22:44.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.112+0000 7f145978f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14541336e0 con 0x7f1454139200 2023-09-30T22:22:44.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.112+0000 7f145978f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145409a080 con 0x7f14541368e0 2023-09-30T22:22:44.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.112+0000 7f1452ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f1454133900 0x7f1454133cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45582/0 (socket says 172.21.15.156:45582) 2023-09-30T22:22:44.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.112+0000 7f1452ffd700 1 -- 172.21.15.156:0/230309133 learned_addr learned my addr 172.21.15.156:0/230309133 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:44.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.112+0000 7f14527fc700 1 --2- 172.21.15.156:0/230309133 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14541368e0 0x7f1454138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:44.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.112+0000 7f1451ffb700 1 -- 172.21.15.156:0/230309133 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642395500 0 0) 0x7f145409a760 con 0x7f1454133900 2023-09-30T22:22:44.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.113+0000 7f1451ffb700 1 -- 172.21.15.156:0/230309133 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f143c0035b0 con 0x7f1454133900 2023-09-30T22:22:44.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.113+0000 7f1451ffb700 1 -- 172.21.15.156:0/230309133 <== mon.0 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1956551943 0 0) 0x7f143c0035b0 con 0x7f1454133900 2023-09-30T22:22:44.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.113+0000 7f1451ffb700 1 -- 172.21.15.156:0/230309133 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14541368e0 msgr2=0x7f1454138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:44.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.113+0000 7f1451ffb700 1 --2- 172.21.15.156:0/230309133 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14541368e0 0x7f1454138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.113+0000 7f1451ffb700 1 -- 172.21.15.156:0/230309133 >> v2:172.21.15.156:3300/0 conn(0x7f1454139200 msgr2=0x7f145413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:44.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.113+0000 7f1451ffb700 1 --2- 172.21.15.156:0/230309133 >> v2:172.21.15.156:3300/0 conn(0x7f1454139200 0x7f145413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.113+0000 7f1451ffb700 1 -- 172.21.15.156:0/230309133 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14540a23e0 con 0x7f1454133900 2023-09-30T22:22:44.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.113+0000 7f1451ffb700 1 -- 172.21.15.156:0/230309133 <== mon.0 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2864602571 0 0) 0x7f14440017f0 con 0x7f1454133900 2023-09-30T22:22:44.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.113+0000 7f1451ffb700 1 -- 172.21.15.156:0/230309133 >> v1:172.21.15.156:6789/0 conn(0x7f1454133900 legacy=0x7f1454133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:44.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.113+0000 7f1451ffb700 1 --2- 172.21.15.156:0/230309133 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f143c003a70 0x7f143c003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:44.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.113+0000 7f1451ffb700 1 --2- 172.21.15.156:0/230309133 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14541368e0 0x7f143c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:44.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.113+0000 7f1451ffb700 1 --2- 172.21.15.156:0/230309133 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f143c004d90 0x7f143c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:44.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.113+0000 7f1451ffb700 1 -- 172.21.15.156:0/230309133 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14541336e0 con 0x7f143c004d90 2023-09-30T22:22:44.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.113+0000 7f1451ffb700 1 -- 172.21.15.156:0/230309133 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145409a080 con 0x7f14541368e0 2023-09-30T22:22:44.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.113+0000 7f1451ffb700 1 -- 172.21.15.156:0/230309133 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f143c00bbc0 con 0x7f143c003a70 2023-09-30T22:22:44.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.113+0000 7f14537fe700 1 --2- 172.21.15.156:0/230309133 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f143c004d90 0x7f143c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:44.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.113+0000 7f1452ffd700 1 --2- 172.21.15.156:0/230309133 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f143c003a70 0x7f143c003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:44.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.113+0000 7f14527fc700 1 --2- 172.21.15.156:0/230309133 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14541368e0 0x7f143c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:44.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.113+0000 7f14537fe700 1 -- 172.21.15.156:0/230309133 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f143c003a70 msgr2=0x7f143c003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:44.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.113+0000 7f14537fe700 1 --2- 172.21.15.156:0/230309133 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f143c003a70 0x7f143c003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.113+0000 7f14537fe700 1 -- 172.21.15.156:0/230309133 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14541368e0 msgr2=0x7f143c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:44.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.113+0000 7f14537fe700 1 --2- 172.21.15.156:0/230309133 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14541368e0 0x7f143c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.113+0000 7f14537fe700 1 -- 172.21.15.156:0/230309133 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143c0035b0 con 0x7f143c004d90 2023-09-30T22:22:44.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.113+0000 7f14527fc700 1 --2- 172.21.15.156:0/230309133 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14541368e0 0x7f143c004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:22:44.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.113+0000 7f14537fe700 1 --2- 172.21.15.156:0/230309133 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f143c004d90 0x7f143c005200 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f144c009e40 tx=0x7f143c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41353d2a97b1b745 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:44.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.114+0000 7f1451ffb700 1 -- 172.21.15.156:0/230309133 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144c00baa0 con 0x7f143c004d90 2023-09-30T22:22:44.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.114+0000 7f1451ffb700 1 -- 172.21.15.156:0/230309133 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144c00bc00 con 0x7f143c004d90 2023-09-30T22:22:44.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.114+0000 7f1451ffb700 1 -- 172.21.15.156:0/230309133 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144c015420 con 0x7f143c004d90 2023-09-30T22:22:44.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.114+0000 7f145978f700 1 -- 172.21.15.156:0/230309133 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f143c004d90 msgr2=0x7f143c005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:44.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.114+0000 7f145978f700 1 --2- 172.21.15.156:0/230309133 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f143c004d90 0x7f143c005200 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f144c009e40 tx=0x7f143c005880 comp rx=0 tx=0).stop 2023-09-30T22:22:44.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.114+0000 7f14537fe700 1 -- 172.21.15.156:0/230309133 reap_dead start 2023-09-30T22:22:44.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.114+0000 7f145978f700 1 -- 172.21.15.156:0/230309133 shutdown_connections 2023-09-30T22:22:44.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.114+0000 7f145978f700 1 -- 172.21.15.156:0/230309133 >> 172.21.15.156:0/230309133 conn(0x7f14540a2980 msgr2=0x7f14540a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:44.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.114+0000 7f145978f700 1 -- 172.21.15.156:0/230309133 shutdown_connections 2023-09-30T22:22:44.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.114+0000 7f145978f700 1 -- 172.21.15.156:0/230309133 wait complete. 2023-09-30T22:22:44.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.116+0000 7f145978f700 1 Processor -- start 2023-09-30T22:22:44.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.116+0000 7f145978f700 1 -- start start 2023-09-30T22:22:44.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.116+0000 7f145978f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f143c004d90 0x7f14541cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:44.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.116+0000 7f145978f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14541ccdd0 0x7f14541cd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:44.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.116+0000 7f145978f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f14540704b0 0x7f1454070920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:44.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.116+0000 7f145978f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14541cd740 con 0x7f14541ccdd0 2023-09-30T22:22:44.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.116+0000 7f145978f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1454121e70 con 0x7f143c004d90 2023-09-30T22:22:44.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.116+0000 7f145978f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1454122ae0 con 0x7f14540704b0 2023-09-30T22:22:44.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.116+0000 7f14537fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f14540704b0 0x7f1454070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:44.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.116+0000 7f14537fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f14540704b0 0x7f1454070920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51742/0 (socket says 172.21.15.156:51742) 2023-09-30T22:22:44.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.116+0000 7f14537fe700 1 -- 172.21.15.156:0/2338331676 learned_addr learned my addr 172.21.15.156:0/2338331676 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:44.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.116+0000 7f14527fc700 1 --2- 172.21.15.156:0/2338331676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14541ccdd0 0x7f14541cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:44.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.116+0000 7f14537fe700 1 -- 172.21.15.156:0/2338331676 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f143c004d90 msgr2=0x7f14541cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:44.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.116+0000 7f14537fe700 1 --2- 172.21.15.156:0/2338331676 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f143c004d90 0x7f14541cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.117+0000 7f14537fe700 1 -- 172.21.15.156:0/2338331676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14541ccdd0 msgr2=0x7f14541cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:44.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.117+0000 7f14537fe700 1 --2- 172.21.15.156:0/2338331676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14541ccdd0 0x7f14541cd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.117+0000 7f14537fe700 1 -- 172.21.15.156:0/2338331676 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145409a2c0 con 0x7f14540704b0 2023-09-30T22:22:44.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.117+0000 7f14537fe700 1 --2- 172.21.15.156:0/2338331676 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f14540704b0 0x7f1454070920 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f144c013000 tx=0x7f144c004be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:44.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.117+0000 7f143b7fe700 1 -- 172.21.15.156:0/2338331676 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144c00baa0 con 0x7f14540704b0 2023-09-30T22:22:44.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.117+0000 7f143b7fe700 1 -- 172.21.15.156:0/2338331676 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144c015e40 con 0x7f14540704b0 2023-09-30T22:22:44.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.117+0000 7f145978f700 1 -- 172.21.15.156:0/2338331676 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1454122280 con 0x7f14540704b0 2023-09-30T22:22:44.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.117+0000 7f143b7fe700 1 -- 172.21.15.156:0/2338331676 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144c003c40 con 0x7f14540704b0 2023-09-30T22:22:44.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.117+0000 7f145978f700 1 -- 172.21.15.156:0/2338331676 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1454071b10 con 0x7f14540704b0 2023-09-30T22:22:44.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.118+0000 7f145978f700 1 -- 172.21.15.156:0/2338331676 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1454122d00 con 0x7f14540704b0 2023-09-30T22:22:44.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.118+0000 7f143b7fe700 1 -- 172.21.15.156:0/2338331676 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f144c004030 con 0x7f14540704b0 2023-09-30T22:22:44.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.118+0000 7f143b7fe700 1 -- 172.21.15.156:0/2338331676 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f144c011070 con 0x7f14540704b0 2023-09-30T22:22:44.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.127+0000 7f143b7fe700 1 -- 172.21.15.156:0/2338331676 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f144c0293c0 con 0x7f14540704b0 2023-09-30T22:22:44.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.255+0000 7fe534291700 1 -- 172.21.15.156:0/1639353794 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe52c122540 con 0x7fe52c12d280 2023-09-30T22:22:44.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.256+0000 7fe522ffd700 1 -- 172.21.15.156:0/1639353794 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe52802a030 con 0x7fe52c12d280 2023-09-30T22:22:44.255 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:44.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.258+0000 7fe534291700 1 -- 172.21.15.156:0/1639353794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe52c12d280 msgr2=0x7fe52c11eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:44.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.258+0000 7fe534291700 1 --2- 172.21.15.156:0/1639353794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe52c12d280 0x7fe52c11eca0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fe528004000 tx=0x7fe528004750 comp rx=0 tx=0).stop 2023-09-30T22:22:44.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.258+0000 7fe534291700 1 -- 172.21.15.156:0/1639353794 shutdown_connections 2023-09-30T22:22:44.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.258+0000 7fe534291700 1 --2- 172.21.15.156:0/1639353794 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe52c130ce0 0x7fe52c11f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.258+0000 7fe534291700 1 --2- 172.21.15.156:0/1639353794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe52c12d280 0x7fe52c11eca0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.258+0000 7fe534291700 1 --2- 172.21.15.156:0/1639353794 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe52c130350 0x7fe52c11f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.258+0000 7fe534291700 1 -- 172.21.15.156:0/1639353794 >> 172.21.15.156:0/1639353794 conn(0x7fe52c0a2980 msgr2=0x7fe52c0a0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:44.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.258+0000 7fe534291700 1 -- 172.21.15.156:0/1639353794 shutdown_connections 2023-09-30T22:22:44.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.258+0000 7fe534291700 1 -- 172.21.15.156:0/1639353794 wait complete. 2023-09-30T22:22:44.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:44.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.297+0000 7f97f978a700 1 -- 172.21.15.156:0/3857108556 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f97f404f2a0 con 0x7f97f41300a0 2023-09-30T22:22:44.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.297+0000 7f97db7fe700 1 -- 172.21.15.156:0/3857108556 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f97e4039030 con 0x7f97f41300a0 2023-09-30T22:22:44.297 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:44.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.300+0000 7f97f978a700 1 -- 172.21.15.156:0/3857108556 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97f41300a0 msgr2=0x7f97f40713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:44.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.300+0000 7f97f978a700 1 --2- 172.21.15.156:0/3857108556 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97f41300a0 0x7f97f40713c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f97e4009c40 tx=0x7f97e4004750 comp rx=0 tx=0).stop 2023-09-30T22:22:44.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.300+0000 7f97f978a700 1 -- 172.21.15.156:0/3857108556 shutdown_connections 2023-09-30T22:22:44.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.300+0000 7f97f978a700 1 --2- 172.21.15.156:0/3857108556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97f4133ad0 0x7f97f4071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.300+0000 7f97f978a700 1 --2- 172.21.15.156:0/3857108556 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f97f41300a0 0x7f97f40713c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.300+0000 7f97f978a700 1 --2- 172.21.15.156:0/3857108556 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f97f41309f0 0x7f97f4071900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.300+0000 7f97f978a700 1 -- 172.21.15.156:0/3857108556 >> 172.21.15.156:0/3857108556 conn(0x7f97f4099c40 msgr2=0x7f97f4132be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:44.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.300+0000 7f97f978a700 1 -- 172.21.15.156:0/3857108556 shutdown_connections 2023-09-30T22:22:44.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.300+0000 7f97f978a700 1 -- 172.21.15.156:0/3857108556 wait complete. 2023-09-30T22:22:44.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.303+0000 7fd1e775c700 1 -- 172.21.15.156:0/2085090893 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd1e004f2a0 con 0x7fd1e009d860 2023-09-30T22:22:44.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.303+0000 7fd1d5ffb700 1 -- 172.21.15.156:0/2085090893 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd1dc02f020 con 0x7fd1e009d860 2023-09-30T22:22:44.303 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:44.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.306+0000 7fd1e775c700 1 -- 172.21.15.156:0/2085090893 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1e009d860 msgr2=0x7fd1e011e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:44.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.306+0000 7fd1e775c700 1 --2- 172.21.15.156:0/2085090893 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1e009d860 0x7fd1e011e110 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc009c40 tx=0x7fd1dc004750 comp rx=0 tx=0).stop 2023-09-30T22:22:44.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.306+0000 7fd1e775c700 1 -- 172.21.15.156:0/2085090893 shutdown_connections 2023-09-30T22:22:44.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.306+0000 7fd1e775c700 1 --2- 172.21.15.156:0/2085090893 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1e0130ce0 0x7fd1e011eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.306+0000 7fd1e775c700 1 --2- 172.21.15.156:0/2085090893 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1e009d860 0x7fd1e011e110 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.306+0000 7fd1e775c700 1 --2- 172.21.15.156:0/2085090893 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1e009e170 0x7fd1e011e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.306+0000 7fd1e775c700 1 -- 172.21.15.156:0/2085090893 >> 172.21.15.156:0/2085090893 conn(0x7fd1e0099c40 msgr2=0x7fd1e0130010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:44.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.306+0000 7fd1e775c700 1 -- 172.21.15.156:0/2085090893 shutdown_connections 2023-09-30T22:22:44.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.306+0000 7fd1e775c700 1 -- 172.21.15.156:0/2085090893 wait complete. 2023-09-30T22:22:44.318 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:44.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:44.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.329+0000 7f145978f700 1 -- 172.21.15.156:0/2338331676 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f145404f2a0 con 0x7f14540704b0 2023-09-30T22:22:44.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.329+0000 7f143b7fe700 1 -- 172.21.15.156:0/2338331676 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f144c014bc0 con 0x7f14540704b0 2023-09-30T22:22:44.329 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:44.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.331+0000 7f145978f700 1 -- 172.21.15.156:0/2338331676 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f14540704b0 msgr2=0x7f1454070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:44.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.331+0000 7f145978f700 1 --2- 172.21.15.156:0/2338331676 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f14540704b0 0x7f1454070920 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f144c013000 tx=0x7f144c004be0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.331+0000 7f145978f700 1 -- 172.21.15.156:0/2338331676 shutdown_connections 2023-09-30T22:22:44.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.331+0000 7f145978f700 1 --2- 172.21.15.156:0/2338331676 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f14540704b0 0x7f1454070920 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.331+0000 7f145978f700 1 --2- 172.21.15.156:0/2338331676 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f143c004d90 0x7f14541cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.331+0000 7f145978f700 1 --2- 172.21.15.156:0/2338331676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14541ccdd0 0x7f14541cd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.331+0000 7f145978f700 1 -- 172.21.15.156:0/2338331676 >> 172.21.15.156:0/2338331676 conn(0x7f14540a2980 msgr2=0x7f14541346c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:44.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.331+0000 7f145978f700 1 -- 172.21.15.156:0/2338331676 shutdown_connections 2023-09-30T22:22:44.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:44.331+0000 7f145978f700 1 -- 172.21.15.156:0/2338331676 wait complete. 2023-09-30T22:22:44.343 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:45.271 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:45.319 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:45.320 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:45.344 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:45.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.416+0000 7fb739387700 1 Processor -- start 2023-09-30T22:22:45.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.416+0000 7fb739387700 1 -- start start 2023-09-30T22:22:45.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.416+0000 7fb739387700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb73409d860 0x7fb73409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.416+0000 7fb739387700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb734130eb0 0x7fb734138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.416+0000 7fb739387700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb73409aaa0 con 0x7fb73409e170 2023-09-30T22:22:45.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.416+0000 7fb739387700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb73409f870 con 0x7fb73409d860 2023-09-30T22:22:45.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.417+0000 7fb739387700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb73409b360 con 0x7fb734130eb0 2023-09-30T22:22:45.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.417+0000 7fb7337fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb734130eb0 0x7fb734138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.417+0000 7fb7327fc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb73409e170 0x7fb7341307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45592/0 (socket says 172.21.15.156:45592) 2023-09-30T22:22:45.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.417+0000 7fb7337fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb734130eb0 0x7fb734138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51746/0 (socket says 172.21.15.156:51746) 2023-09-30T22:22:45.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.417+0000 7fb7327fc700 1 -- 172.21.15.156:0/4279834525 learned_addr learned my addr 172.21.15.156:0/4279834525 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:45.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.417+0000 7fb732ffd700 1 --2- 172.21.15.156:0/4279834525 >> v2:172.21.15.156:3300/0 conn(0x7fb73409d860 0x7fb73409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.417+0000 7fb7337fe700 1 -- 172.21.15.156:0/4279834525 >> v2:172.21.15.156:3300/0 conn(0x7fb73409d860 msgr2=0x7fb73409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:45.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.417+0000 7fb7337fe700 1 --2- 172.21.15.156:0/4279834525 >> v2:172.21.15.156:3300/0 conn(0x7fb73409d860 0x7fb73409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.417+0000 7fb731ffb700 1 -- 172.21.15.156:0/4279834525 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909987939 0 0) 0x7fb73409aaa0 con 0x7fb73409e170 2023-09-30T22:22:45.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.417+0000 7fb7337fe700 1 -- 172.21.15.156:0/4279834525 >> v1:172.21.15.156:6789/0 conn(0x7fb73409e170 legacy=0x7fb7341307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.417+0000 7fb7337fe700 1 -- 172.21.15.156:0/4279834525 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb73409b620 con 0x7fb734130eb0 2023-09-30T22:22:45.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.417+0000 7fb7337fe700 1 --2- 172.21.15.156:0/4279834525 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb734130eb0 0x7fb734138a00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009d90 tx=0x7fb72c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=587f13229b8790d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:45.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.418+0000 7fb731ffb700 1 -- 172.21.15.156:0/4279834525 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c00bd20 con 0x7fb734130eb0 2023-09-30T22:22:45.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.418+0000 7fb731ffb700 1 -- 172.21.15.156:0/4279834525 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72c00be80 con 0x7fb734130eb0 2023-09-30T22:22:45.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.418+0000 7fb731ffb700 1 -- 172.21.15.156:0/4279834525 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c0116a0 con 0x7fb734130eb0 2023-09-30T22:22:45.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.418+0000 7fb739387700 1 -- 172.21.15.156:0/4279834525 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb734130eb0 msgr2=0x7fb734138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.418+0000 7fb739387700 1 --2- 172.21.15.156:0/4279834525 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb734130eb0 0x7fb734138a00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009d90 tx=0x7fb72c00b330 comp rx=0 tx=0).stop 2023-09-30T22:22:45.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.418+0000 7fb739387700 1 -- 172.21.15.156:0/4279834525 shutdown_connections 2023-09-30T22:22:45.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.418+0000 7fb739387700 1 --2- 172.21.15.156:0/4279834525 >> v2:172.21.15.156:3300/0 conn(0x7fb73409d860 0x7fb73409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.418+0000 7fb739387700 1 --2- 172.21.15.156:0/4279834525 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb734130eb0 0x7fb734138a00 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.418+0000 7fb739387700 1 -- 172.21.15.156:0/4279834525 >> 172.21.15.156:0/4279834525 conn(0x7fb734099c40 msgr2=0x7fb7340a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:45.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.418+0000 7fb739387700 1 -- 172.21.15.156:0/4279834525 shutdown_connections 2023-09-30T22:22:45.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.419+0000 7fb739387700 1 -- 172.21.15.156:0/4279834525 wait complete. 2023-09-30T22:22:45.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.420+0000 7fb739387700 1 Processor -- start 2023-09-30T22:22:45.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.420+0000 7fb739387700 1 -- start start 2023-09-30T22:22:45.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.420+0000 7fb739387700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb73409d860 0x7fb73411e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.420+0000 7fb739387700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb73409e170 0x7fb73411ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.420+0000 7fb739387700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb734130eb0 0x7fb73411ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.420+0000 7fb739387700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73411f9a0 con 0x7fb73409e170 2023-09-30T22:22:45.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.420+0000 7fb739387700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb734120e50 con 0x7fb734130eb0 2023-09-30T22:22:45.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.420+0000 7fb739387700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb734120280 con 0x7fb73409d860 2023-09-30T22:22:45.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.420+0000 7fb7327fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb73409e170 0x7fb73411ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.420+0000 7fb7327fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb73409e170 0x7fb73411ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44196/0 (socket says 172.21.15.156:44196) 2023-09-30T22:22:45.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.420+0000 7fb732ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb73409d860 0x7fb73411e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.420+0000 7fb7327fc700 1 -- 172.21.15.156:0/341899609 learned_addr learned my addr 172.21.15.156:0/341899609 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:45.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.420+0000 7fb7337fe700 1 --2- 172.21.15.156:0/341899609 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb734130eb0 0x7fb73411ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.421+0000 7fb7327fc700 1 -- 172.21.15.156:0/341899609 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb73409d860 msgr2=0x7fb73411e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.421+0000 7fb7327fc700 1 --2- 172.21.15.156:0/341899609 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb73409d860 0x7fb73411e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.421+0000 7fb7327fc700 1 -- 172.21.15.156:0/341899609 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb734130eb0 msgr2=0x7fb73411ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.421+0000 7fb7327fc700 1 --2- 172.21.15.156:0/341899609 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb734130eb0 0x7fb73411ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.421+0000 7fb7327fc700 1 -- 172.21.15.156:0/341899609 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72c009a70 con 0x7fb73409e170 2023-09-30T22:22:45.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.421+0000 7fb7337fe700 1 --2- 172.21.15.156:0/341899609 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb734130eb0 0x7fb73411ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:45.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.421+0000 7fb7327fc700 1 --2- 172.21.15.156:0/341899609 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb73409e170 0x7fb73411ea30 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fb72800c520 tx=0x7fb72800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:45.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.421+0000 7fb71b7fe700 1 -- 172.21.15.156:0/341899609 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb728004c80 con 0x7fb73409e170 2023-09-30T22:22:45.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.421+0000 7fb71b7fe700 1 -- 172.21.15.156:0/341899609 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb728004de0 con 0x7fb73409e170 2023-09-30T22:22:45.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.421+0000 7fb71b7fe700 1 -- 172.21.15.156:0/341899609 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb728007310 con 0x7fb73409e170 2023-09-30T22:22:45.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.421+0000 7fb739387700 1 -- 172.21.15.156:0/341899609 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb734121210 con 0x7fb73409e170 2023-09-30T22:22:45.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.421+0000 7fb739387700 1 -- 172.21.15.156:0/341899609 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7341cc5f0 con 0x7fb73409e170 2023-09-30T22:22:45.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.422+0000 7fb739387700 1 -- 172.21.15.156:0/341899609 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb73404f2a0 con 0x7fb73409e170 2023-09-30T22:22:45.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.422+0000 7fb71b7fe700 1 -- 172.21.15.156:0/341899609 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb728007470 con 0x7fb73409e170 2023-09-30T22:22:45.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.423+0000 7fb71b7fe700 1 -- 172.21.15.156:0/341899609 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb72803f2c0 con 0x7fb73409e170 2023-09-30T22:22:45.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.431+0000 7fb71b7fe700 1 -- 172.21.15.156:0/341899609 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb7280133c0 con 0x7fb73409e170 2023-09-30T22:22:45.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.457+0000 7f42a6c61700 1 Processor -- start 2023-09-30T22:22:45.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.457+0000 7f42a6c61700 1 -- start start 2023-09-30T22:22:45.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.457+0000 7f42a6c61700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f42a006a770 0x7f42a01349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.457+0000 7f42a6c61700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f42a0134f00 0x7f42a009d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.457+0000 7f42a6c61700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42a009dea0 0x7f42a009e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.457+0000 7f42a6c61700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a006b2e0 con 0x7f42a0134f00 2023-09-30T22:22:45.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.457+0000 7f42a6c61700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a009eca0 con 0x7f42a009dea0 2023-09-30T22:22:45.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.457+0000 7f42a6c61700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42a009f720 con 0x7f42a006a770 2023-09-30T22:22:45.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.457+0000 7f429ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f42a0134f00 0x7f42a009d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.458+0000 7f429ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f42a0134f00 0x7f42a009d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44208/0 (socket says 172.21.15.156:44208) 2023-09-30T22:22:45.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.458+0000 7f429ffff700 1 -- 172.21.15.156:0/218437783 learned_addr learned my addr 172.21.15.156:0/218437783 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:45.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.458+0000 7f42a49fd700 1 --2- 172.21.15.156:0/218437783 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f42a006a770 0x7f42a01349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.458+0000 7f42a51fe700 1 --2- 172.21.15.156:0/218437783 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42a009dea0 0x7f42a009e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.458+0000 7f42a51fe700 1 -- 172.21.15.156:0/218437783 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f42a006a770 msgr2=0x7f42a01349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:45.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.458+0000 7f42a51fe700 1 --2- 172.21.15.156:0/218437783 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f42a006a770 0x7f42a01349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.458+0000 7f42a51fe700 1 -- 172.21.15.156:0/218437783 >> v2:172.21.15.156:3300/0 conn(0x7f42a0134f00 msgr2=0x7f42a009d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:45.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.458+0000 7f42a51fe700 1 --2- 172.21.15.156:0/218437783 >> v2:172.21.15.156:3300/0 conn(0x7f42a0134f00 0x7f42a009d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.458+0000 7f42a51fe700 1 -- 172.21.15.156:0/218437783 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a006b480 con 0x7f42a009dea0 2023-09-30T22:22:45.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.458+0000 7f429ffff700 1 --2- 172.21.15.156:0/218437783 >> v2:172.21.15.156:3300/0 conn(0x7f42a0134f00 0x7f42a009d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:45.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.458+0000 7f42a51fe700 1 --2- 172.21.15.156:0/218437783 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42a009dea0 0x7f42a009e340 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4298009d90 tx=0x7f429800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e816689e8e071984 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:45.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.458+0000 7f429f7fe700 1 -- 172.21.15.156:0/218437783 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429800e070 con 0x7f42a009dea0 2023-09-30T22:22:45.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.458+0000 7f429f7fe700 1 -- 172.21.15.156:0/218437783 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429800bb20 con 0x7f42a009dea0 2023-09-30T22:22:45.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.458+0000 7f429f7fe700 1 -- 172.21.15.156:0/218437783 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4298012430 con 0x7f42a009dea0 2023-09-30T22:22:45.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.459+0000 7f42a6c61700 1 -- 172.21.15.156:0/218437783 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42a009dea0 msgr2=0x7f42a009e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.459+0000 7f42a6c61700 1 --2- 172.21.15.156:0/218437783 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42a009dea0 0x7f42a009e340 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4298009d90 tx=0x7f429800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:45.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.459+0000 7f42a6c61700 1 -- 172.21.15.156:0/218437783 shutdown_connections 2023-09-30T22:22:45.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.459+0000 7f42a6c61700 1 --2- 172.21.15.156:0/218437783 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42a009dea0 0x7f42a009e340 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.459+0000 7f42a6c61700 1 --2- 172.21.15.156:0/218437783 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f42a006a770 0x7f42a01349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.459+0000 7f42a6c61700 1 --2- 172.21.15.156:0/218437783 >> v2:172.21.15.156:3300/0 conn(0x7f42a0134f00 0x7f42a009d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.459+0000 7f42a6c61700 1 -- 172.21.15.156:0/218437783 >> 172.21.15.156:0/218437783 conn(0x7f42a0099c40 msgr2=0x7f42a00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:45.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.459+0000 7f42a6c61700 1 -- 172.21.15.156:0/218437783 shutdown_connections 2023-09-30T22:22:45.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.459+0000 7f42a6c61700 1 -- 172.21.15.156:0/218437783 wait complete. 2023-09-30T22:22:45.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.460+0000 7f42a6c61700 1 Processor -- start 2023-09-30T22:22:45.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.460+0000 7f42a6c61700 1 -- start start 2023-09-30T22:22:45.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.460+0000 7f892728c700 1 Processor -- start 2023-09-30T22:22:45.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.461+0000 7f892728c700 1 -- start start 2023-09-30T22:22:45.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.461+0000 7f42a6c61700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42a006a770 0x7f42a0133d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.461+0000 7f42a6c61700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f42a009dea0 0x7f42a011a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.461+0000 7f42a6c61700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42a0134f00 0x7f42a011aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.461+0000 7f42a6c61700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a0139250 con 0x7f42a0134f00 2023-09-30T22:22:45.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.461+0000 7f42a6c61700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a0138a80 con 0x7f42a006a770 2023-09-30T22:22:45.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.461+0000 7f42a6c61700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42a009f220 con 0x7f42a009dea0 2023-09-30T22:22:45.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.461+0000 7f892728c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8920131980 0x7f8920131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.461+0000 7f892728c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f892009bc70 0x7f892009c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.461+0000 7f892728c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89200a1640 con 0x7f892009c5c0 2023-09-30T22:22:45.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.461+0000 7f892728c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f892006eb30 con 0x7f892009bc70 2023-09-30T22:22:45.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.461+0000 7f892728c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89200a22d0 con 0x7f8920131980 2023-09-30T22:22:45.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.461+0000 7f42a51fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42a0134f00 0x7f42a011aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.461+0000 7f42a51fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42a0134f00 0x7f42a011aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44224/0 (socket says 172.21.15.156:44224) 2023-09-30T22:22:45.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.461+0000 7f42a51fe700 1 -- 172.21.15.156:0/1867563066 learned_addr learned my addr 172.21.15.156:0/1867563066 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:45.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.461+0000 7f42a49fd700 1 --2- 172.21.15.156:0/1867563066 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42a006a770 0x7f42a0133d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.461+0000 7f429ffff700 1 --2- 172.21.15.156:0/1867563066 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f42a009dea0 0x7f42a011a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.461+0000 7f8925829700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f892009c5c0 0x7f8920138700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45604/0 (socket says 172.21.15.156:45604) 2023-09-30T22:22:45.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.461+0000 7f8925829700 1 -- 172.21.15.156:0/83673569 learned_addr learned my addr 172.21.15.156:0/83673569 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:45.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.461+0000 7f8925028700 1 --2- 172.21.15.156:0/83673569 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8920131980 0x7f8920131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.461+0000 7f8924827700 1 --2- 172.21.15.156:0/83673569 >> v2:172.21.15.156:3300/0 conn(0x7f892009bc70 0x7f892009c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.461+0000 7f42a51fe700 1 -- 172.21.15.156:0/1867563066 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f42a009dea0 msgr2=0x7f42a011a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.461+0000 7f42a51fe700 1 --2- 172.21.15.156:0/1867563066 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f42a009dea0 0x7f42a011a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.461+0000 7f42a51fe700 1 -- 172.21.15.156:0/1867563066 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42a006a770 msgr2=0x7f42a0133d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.461+0000 7f42a51fe700 1 --2- 172.21.15.156:0/1867563066 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42a006a770 0x7f42a0133d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.462+0000 7f42a51fe700 1 -- 172.21.15.156:0/1867563066 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c009550 con 0x7f42a0134f00 2023-09-30T22:22:45.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.462+0000 7f8925028700 1 -- 172.21.15.156:0/83673569 >> v2:172.21.15.156:3300/0 conn(0x7f892009bc70 msgr2=0x7f892009c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:45.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.462+0000 7f8925028700 1 --2- 172.21.15.156:0/83673569 >> v2:172.21.15.156:3300/0 conn(0x7f892009bc70 0x7f892009c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.462+0000 7f8925028700 1 -- 172.21.15.156:0/83673569 >> v1:172.21.15.156:6789/0 conn(0x7f892009c5c0 legacy=0x7f8920138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.462+0000 7f8925028700 1 -- 172.21.15.156:0/83673569 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8920131550 con 0x7f8920131980 2023-09-30T22:22:45.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.462+0000 7f42a51fe700 1 --2- 172.21.15.156:0/1867563066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42a0134f00 0x7f42a011aa90 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f42a009ede0 tx=0x7f4298004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:45.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.462+0000 7f429d7fa700 1 -- 172.21.15.156:0/1867563066 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4298012ac0 con 0x7f42a0134f00 2023-09-30T22:22:45.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.462+0000 7f8925028700 1 --2- 172.21.15.156:0/83673569 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8920131980 0x7f8920131d50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f891c009820 tx=0x7f891c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5c179866b20b230 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:45.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.462+0000 7f429d7fa700 1 -- 172.21.15.156:0/1867563066 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4298020070 con 0x7f42a0134f00 2023-09-30T22:22:45.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.462+0000 7f42a6c61700 1 -- 172.21.15.156:0/1867563066 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4298009a70 con 0x7f42a0134f00 2023-09-30T22:22:45.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.462+0000 7f429d7fa700 1 -- 172.21.15.156:0/1867563066 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4298012e80 con 0x7f42a0134f00 2023-09-30T22:22:45.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.462+0000 7f42a6c61700 1 -- 172.21.15.156:0/1867563066 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a0138cb0 con 0x7f42a0134f00 2023-09-30T22:22:45.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.463+0000 7f429d7fa700 1 -- 172.21.15.156:0/1867563066 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4298004040 con 0x7f42a0134f00 2023-09-30T22:22:45.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.463+0000 7f429d7fa700 1 -- 172.21.15.156:0/1867563066 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4298022070 con 0x7f42a0134f00 2023-09-30T22:22:45.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.463+0000 7f8917fff700 1 -- 172.21.15.156:0/83673569 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c005e30 con 0x7f8920131980 2023-09-30T22:22:45.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.463+0000 7f8917fff700 1 -- 172.21.15.156:0/83673569 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891c006030 con 0x7f8920131980 2023-09-30T22:22:45.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.463+0000 7f8917fff700 1 -- 172.21.15.156:0/83673569 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c0063e0 con 0x7f8920131980 2023-09-30T22:22:45.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.463+0000 7f42a6c61700 1 -- 172.21.15.156:0/1867563066 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a004f2a0 con 0x7f42a0134f00 2023-09-30T22:22:45.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.464+0000 7f892728c700 1 -- 172.21.15.156:0/83673569 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8920131980 msgr2=0x7f8920131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.464+0000 7f892728c700 1 --2- 172.21.15.156:0/83673569 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8920131980 0x7f8920131d50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f891c009820 tx=0x7f891c009b30 comp rx=0 tx=0).stop 2023-09-30T22:22:45.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.464+0000 7f892728c700 1 -- 172.21.15.156:0/83673569 shutdown_connections 2023-09-30T22:22:45.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.464+0000 7f892728c700 1 --2- 172.21.15.156:0/83673569 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8920131980 0x7f8920131d50 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.464+0000 7f892728c700 1 --2- 172.21.15.156:0/83673569 >> v2:172.21.15.156:3300/0 conn(0x7f892009bc70 0x7f892009c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.464+0000 7f892728c700 1 -- 172.21.15.156:0/83673569 >> 172.21.15.156:0/83673569 conn(0x7f89200a2980 msgr2=0x7f89200a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:45.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.465+0000 7f892728c700 1 -- 172.21.15.156:0/83673569 shutdown_connections 2023-09-30T22:22:45.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.465+0000 7f892728c700 1 -- 172.21.15.156:0/83673569 wait complete. 2023-09-30T22:22:45.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.466+0000 7f892728c700 1 Processor -- start 2023-09-30T22:22:45.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.466+0000 7f892728c700 1 -- start start 2023-09-30T22:22:45.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.467+0000 7f892728c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f892009bc70 0x7f8920139800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.467+0000 7f892728c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f892009c5c0 0x7f8920139d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.467+0000 7f892728c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8920131980 0x7f89201c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.467+0000 7f892728c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89200a1c40 con 0x7f8920131980 2023-09-30T22:22:45.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.467+0000 7f892728c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89201380d0 con 0x7f892009bc70 2023-09-30T22:22:45.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.467+0000 7f892728c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8920137870 con 0x7f892009c5c0 2023-09-30T22:22:45.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.467+0000 7f8924827700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f892009c5c0 0x7f8920139d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.467+0000 7f8925028700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f892009bc70 0x7f8920139800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.467+0000 7f8925028700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f892009bc70 0x7f8920139800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:56834/0 (socket says 172.21.15.156:56834) 2023-09-30T22:22:45.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.467+0000 7f8924827700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f892009c5c0 0x7f8920139d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51792/0 (socket says 172.21.15.156:51792) 2023-09-30T22:22:45.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.467+0000 7f8925028700 1 -- 172.21.15.156:0/1818515120 learned_addr learned my addr 172.21.15.156:0/1818515120 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:45.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.467+0000 7f8925829700 1 --2- 172.21.15.156:0/1818515120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8920131980 0x7f89201c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.467+0000 7f8925028700 1 -- 172.21.15.156:0/1818515120 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f892009c5c0 msgr2=0x7f8920139d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.467+0000 7f8925028700 1 --2- 172.21.15.156:0/1818515120 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f892009c5c0 0x7f8920139d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.467+0000 7f8925028700 1 -- 172.21.15.156:0/1818515120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8920131980 msgr2=0x7f89201c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.467+0000 7f8925028700 1 --2- 172.21.15.156:0/1818515120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8920131980 0x7f89201c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.467+0000 7f8925028700 1 -- 172.21.15.156:0/1818515120 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891c009430 con 0x7f892009bc70 2023-09-30T22:22:45.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.467+0000 7f8925028700 1 --2- 172.21.15.156:0/1818515120 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f892009bc70 0x7f8920139800 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f891c000c00 tx=0x7f891c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:45.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.467+0000 7f8915ffb700 1 -- 172.21.15.156:0/1818515120 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c004070 con 0x7f892009bc70 2023-09-30T22:22:45.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.467+0000 7f8915ffb700 1 -- 172.21.15.156:0/1818515120 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891c0041d0 con 0x7f892009bc70 2023-09-30T22:22:45.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.467+0000 7f892728c700 1 -- 172.21.15.156:0/1818515120 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89201373d0 con 0x7f892009bc70 2023-09-30T22:22:45.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.468+0000 7f8915ffb700 1 -- 172.21.15.156:0/1818515120 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c004560 con 0x7f892009bc70 2023-09-30T22:22:45.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.468+0000 7f892728c700 1 -- 172.21.15.156:0/1818515120 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8920136760 con 0x7f892009bc70 2023-09-30T22:22:45.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.469+0000 7f8915ffb700 1 -- 172.21.15.156:0/1818515120 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f891c02a020 con 0x7f892009bc70 2023-09-30T22:22:45.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.469+0000 7f8915ffb700 1 -- 172.21.15.156:0/1818515120 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f891c04ada0 con 0x7f892009bc70 2023-09-30T22:22:45.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.469+0000 7f429d7fa700 1 -- 172.21.15.156:0/1867563066 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f429801a970 con 0x7f42a0134f00 2023-09-30T22:22:45.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.470+0000 7f892728c700 1 -- 172.21.15.156:0/1818515120 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8920138420 con 0x7f892009bc70 2023-09-30T22:22:45.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.474+0000 7f8915ffb700 1 -- 172.21.15.156:0/1818515120 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f891c04e060 con 0x7f892009bc70 2023-09-30T22:22:45.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.511+0000 7f0a97c61700 1 Processor -- start 2023-09-30T22:22:45.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.512+0000 7f0a97c61700 1 -- start start 2023-09-30T22:22:45.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.512+0000 7f0a97c61700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0a9009d7f0 0x7f0a9009dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.513+0000 7f0a97c61700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a9009e100 0x7f0a90130e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.513+0000 7f0a97c61700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a9009bca0 con 0x7f0a9009a580 2023-09-30T22:22:45.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.513+0000 7f0a97c61700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9009ac80 con 0x7f0a9009d7f0 2023-09-30T22:22:45.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.513+0000 7f0a97c61700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9009b700 con 0x7f0a9009e100 2023-09-30T22:22:45.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.513+0000 7f0a961fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a9009e100 0x7f0a90130e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.513+0000 7f0a951fc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f0a9009a580 0x7f0a90130730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45614/0 (socket says 172.21.15.156:45614) 2023-09-30T22:22:45.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.513+0000 7f0a951fc700 1 -- 172.21.15.156:0/4112813098 learned_addr learned my addr 172.21.15.156:0/4112813098 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:45.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.513+0000 7f0a959fd700 1 --2- 172.21.15.156:0/4112813098 >> v2:172.21.15.156:3300/0 conn(0x7f0a9009d7f0 0x7f0a9009dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.513+0000 7f0a961fe700 1 -- 172.21.15.156:0/4112813098 >> v2:172.21.15.156:3300/0 conn(0x7f0a9009d7f0 msgr2=0x7f0a9009dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:45.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.513+0000 7f0a961fe700 1 --2- 172.21.15.156:0/4112813098 >> v2:172.21.15.156:3300/0 conn(0x7f0a9009d7f0 0x7f0a9009dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.513+0000 7f0a961fe700 1 -- 172.21.15.156:0/4112813098 >> v1:172.21.15.156:6789/0 conn(0x7f0a9009a580 legacy=0x7f0a90130730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.513+0000 7f0a961fe700 1 -- 172.21.15.156:0/4112813098 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9009b450 con 0x7f0a9009e100 2023-09-30T22:22:45.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.513+0000 7f0a961fe700 1 --2- 172.21.15.156:0/4112813098 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a9009e100 0x7f0a90130e40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f0a88009d90 tx=0x7f0a8800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd8ff4291590f232 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:45.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.513+0000 7f0a949fb700 1 -- 172.21.15.156:0/4112813098 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8800e070 con 0x7f0a9009e100 2023-09-30T22:22:45.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.513+0000 7f0a949fb700 1 -- 172.21.15.156:0/4112813098 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8800bb20 con 0x7f0a9009e100 2023-09-30T22:22:45.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.514+0000 7f0a949fb700 1 -- 172.21.15.156:0/4112813098 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a88012430 con 0x7f0a9009e100 2023-09-30T22:22:45.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.514+0000 7f0a97c61700 1 -- 172.21.15.156:0/4112813098 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a9009e100 msgr2=0x7f0a90130e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.514+0000 7f0a97c61700 1 --2- 172.21.15.156:0/4112813098 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a9009e100 0x7f0a90130e40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f0a88009d90 tx=0x7f0a8800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:45.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.514+0000 7f0a97c61700 1 -- 172.21.15.156:0/4112813098 shutdown_connections 2023-09-30T22:22:45.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.514+0000 7f0a97c61700 1 --2- 172.21.15.156:0/4112813098 >> v2:172.21.15.156:3300/0 conn(0x7f0a9009d7f0 0x7f0a9009dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.514+0000 7f0a97c61700 1 --2- 172.21.15.156:0/4112813098 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a9009e100 0x7f0a90130e40 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.514+0000 7f0a97c61700 1 -- 172.21.15.156:0/4112813098 >> 172.21.15.156:0/4112813098 conn(0x7f0a9009f9f0 msgr2=0x7f0a9009fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:45.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.514+0000 7f0a97c61700 1 -- 172.21.15.156:0/4112813098 shutdown_connections 2023-09-30T22:22:45.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.514+0000 7f0a97c61700 1 -- 172.21.15.156:0/4112813098 wait complete. 2023-09-30T22:22:45.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.516+0000 7f0a97c61700 1 Processor -- start 2023-09-30T22:22:45.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.516+0000 7f0a97c61700 1 -- start start 2023-09-30T22:22:45.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.516+0000 7f0a97c61700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a9009a580 0x7f0a9011de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.516+0000 7f0a97c61700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a9009d7f0 0x7f0a9011e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.516+0000 7f0a97c61700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a9009e100 0x7f0a9011e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.516+0000 7f0a97c61700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9011fa10 con 0x7f0a9009a580 2023-09-30T22:22:45.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.516+0000 7f0a97c61700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a90120c60 con 0x7f0a9009e100 2023-09-30T22:22:45.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.516+0000 7f0a97c61700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a90131690 con 0x7f0a9009d7f0 2023-09-30T22:22:45.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.516+0000 7f0a959fd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a9009a580 0x7f0a9011de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.516+0000 7f0a959fd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a9009a580 0x7f0a9011de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44266/0 (socket says 172.21.15.156:44266) 2023-09-30T22:22:45.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.517+0000 7f0a959fd700 1 -- 172.21.15.156:0/2258406490 learned_addr learned my addr 172.21.15.156:0/2258406490 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:45.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.517+0000 7f0a961fe700 1 --2- 172.21.15.156:0/2258406490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a9009e100 0x7f0a9011e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.517+0000 7f0a951fc700 1 --2- 172.21.15.156:0/2258406490 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a9009d7f0 0x7f0a9011e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.517+0000 7f0a959fd700 1 -- 172.21.15.156:0/2258406490 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a9009d7f0 msgr2=0x7f0a9011e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.517+0000 7f0a959fd700 1 --2- 172.21.15.156:0/2258406490 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a9009d7f0 0x7f0a9011e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.517+0000 7f0a959fd700 1 -- 172.21.15.156:0/2258406490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a9009e100 msgr2=0x7f0a9011e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.517+0000 7f0a959fd700 1 --2- 172.21.15.156:0/2258406490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a9009e100 0x7f0a9011e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.517+0000 7f0a959fd700 1 -- 172.21.15.156:0/2258406490 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a88009a70 con 0x7f0a9009a580 2023-09-30T22:22:45.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.517+0000 7f0a959fd700 1 --2- 172.21.15.156:0/2258406490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a9009a580 0x7f0a9011de50 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c014370 tx=0x7f0a8c014680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:45.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.517+0000 7f0a867fc700 1 -- 172.21.15.156:0/2258406490 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c016050 con 0x7f0a9009a580 2023-09-30T22:22:45.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.517+0000 7f0a867fc700 1 -- 172.21.15.156:0/2258406490 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8c017040 con 0x7f0a9009a580 2023-09-30T22:22:45.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.517+0000 7f0a867fc700 1 -- 172.21.15.156:0/2258406490 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c0112d0 con 0x7f0a9009a580 2023-09-30T22:22:45.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.518+0000 7f0a97c61700 1 -- 172.21.15.156:0/2258406490 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a90120000 con 0x7f0a9009a580 2023-09-30T22:22:45.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.518+0000 7f0a97c61700 1 -- 172.21.15.156:0/2258406490 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a90121110 con 0x7f0a9009a580 2023-09-30T22:22:45.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.519+0000 7f0a867fc700 1 -- 172.21.15.156:0/2258406490 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0a8c011430 con 0x7f0a9009a580 2023-09-30T22:22:45.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.519+0000 7f0a97c61700 1 -- 172.21.15.156:0/2258406490 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a9009cb00 con 0x7f0a9009a580 2023-09-30T22:22:45.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.519+0000 7f0a867fc700 1 -- 172.21.15.156:0/2258406490 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0a8c047b80 con 0x7f0a9009a580 2023-09-30T22:22:45.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.524+0000 7f0a867fc700 1 -- 172.21.15.156:0/2258406490 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0a8c01a950 con 0x7f0a9009a580 2023-09-30T22:22:45.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.653+0000 7fb739387700 1 -- 172.21.15.156:0/341899609 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb73406c3b0 con 0x7fb73409e170 2023-09-30T22:22:45.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.653+0000 7fb71b7fe700 1 -- 172.21.15.156:0/341899609 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb728011360 con 0x7fb73409e170 2023-09-30T22:22:45.653 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:45.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.655+0000 7fb739387700 1 -- 172.21.15.156:0/341899609 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb73409e170 msgr2=0x7fb73411ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.655+0000 7fb739387700 1 --2- 172.21.15.156:0/341899609 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb73409e170 0x7fb73411ea30 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fb72800c520 tx=0x7fb72800c830 comp rx=0 tx=0).stop 2023-09-30T22:22:45.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.655+0000 7fb739387700 1 -- 172.21.15.156:0/341899609 shutdown_connections 2023-09-30T22:22:45.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.655+0000 7fb739387700 1 --2- 172.21.15.156:0/341899609 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb734130eb0 0x7fb73411ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.655+0000 7fb739387700 1 --2- 172.21.15.156:0/341899609 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb73409d860 0x7fb73411e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.655+0000 7fb739387700 1 --2- 172.21.15.156:0/341899609 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb73409e170 0x7fb73411ea30 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.655+0000 7fb739387700 1 -- 172.21.15.156:0/341899609 >> 172.21.15.156:0/341899609 conn(0x7fb734099c40 msgr2=0x7fb734070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:45.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.655+0000 7fb739387700 1 -- 172.21.15.156:0/341899609 shutdown_connections 2023-09-30T22:22:45.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.655+0000 7fb739387700 1 -- 172.21.15.156:0/341899609 wait complete. 2023-09-30T22:22:45.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.665+0000 7f42a6c61700 1 -- 172.21.15.156:0/1867563066 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f42a011cac0 con 0x7f42a0134f00 2023-09-30T22:22:45.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.665+0000 7f429d7fa700 1 -- 172.21.15.156:0/1867563066 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f429801a380 con 0x7f42a0134f00 2023-09-30T22:22:45.665 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:45.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.668+0000 7f42a6c61700 1 -- 172.21.15.156:0/1867563066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42a0134f00 msgr2=0x7f42a011aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.668+0000 7f42a6c61700 1 --2- 172.21.15.156:0/1867563066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42a0134f00 0x7f42a011aa90 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f42a009ede0 tx=0x7f4298004ad0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.668+0000 7f42a6c61700 1 -- 172.21.15.156:0/1867563066 shutdown_connections 2023-09-30T22:22:45.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.668+0000 7f42a6c61700 1 --2- 172.21.15.156:0/1867563066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42a0134f00 0x7f42a011aa90 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.668+0000 7f42a6c61700 1 --2- 172.21.15.156:0/1867563066 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f42a006a770 0x7f42a0133d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.668+0000 7f42a6c61700 1 --2- 172.21.15.156:0/1867563066 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f42a009dea0 0x7f42a011a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.668+0000 7f42a6c61700 1 -- 172.21.15.156:0/1867563066 >> 172.21.15.156:0/1867563066 conn(0x7f42a0099c40 msgr2=0x7f42a009c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:45.669 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:45.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.669+0000 7f42a6c61700 1 -- 172.21.15.156:0/1867563066 shutdown_connections 2023-09-30T22:22:45.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.669+0000 7f42a6c61700 1 -- 172.21.15.156:0/1867563066 wait complete. 2023-09-30T22:22:45.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.671+0000 7f892728c700 1 -- 172.21.15.156:0/1818515120 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f892004f2a0 con 0x7f892009bc70 2023-09-30T22:22:45.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.672+0000 7f8915ffb700 1 -- 172.21.15.156:0/1818515120 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f891c00b9d0 con 0x7f892009bc70 2023-09-30T22:22:45.671 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:45.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.675+0000 7f892728c700 1 -- 172.21.15.156:0/1818515120 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f892009bc70 msgr2=0x7f8920139800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.675+0000 7f892728c700 1 --2- 172.21.15.156:0/1818515120 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f892009bc70 0x7f8920139800 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f891c000c00 tx=0x7f891c004750 comp rx=0 tx=0).stop 2023-09-30T22:22:45.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.675+0000 7f892728c700 1 -- 172.21.15.156:0/1818515120 shutdown_connections 2023-09-30T22:22:45.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.675+0000 7f892728c700 1 --2- 172.21.15.156:0/1818515120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8920131980 0x7f89201c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.675+0000 7f892728c700 1 --2- 172.21.15.156:0/1818515120 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f892009bc70 0x7f8920139800 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.675+0000 7f892728c700 1 --2- 172.21.15.156:0/1818515120 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f892009c5c0 0x7f8920139d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.675+0000 7f892728c700 1 -- 172.21.15.156:0/1818515120 >> 172.21.15.156:0/1818515120 conn(0x7f89200a2980 msgr2=0x7f892009f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:45.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.677+0000 7f892728c700 1 -- 172.21.15.156:0/1818515120 shutdown_connections 2023-09-30T22:22:45.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.677+0000 7f892728c700 1 -- 172.21.15.156:0/1818515120 wait complete. 2023-09-30T22:22:45.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:45.693 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:45.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.740+0000 7f0a97c61700 1 -- 172.21.15.156:0/2258406490 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0a90121110 con 0x7f0a9009a580 2023-09-30T22:22:45.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.740+0000 7f0a867fc700 1 -- 172.21.15.156:0/2258406490 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0a90121110 con 0x7f0a9009a580 2023-09-30T22:22:45.741 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:45.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.742+0000 7f0a97c61700 1 -- 172.21.15.156:0/2258406490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a9009a580 msgr2=0x7f0a9011de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.742+0000 7f0a97c61700 1 --2- 172.21.15.156:0/2258406490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a9009a580 0x7f0a9011de50 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c014370 tx=0x7f0a8c014680 comp rx=0 tx=0).stop 2023-09-30T22:22:45.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.742+0000 7f0a97c61700 1 -- 172.21.15.156:0/2258406490 shutdown_connections 2023-09-30T22:22:45.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.742+0000 7f0a97c61700 1 --2- 172.21.15.156:0/2258406490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a9009e100 0x7f0a9011e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.742+0000 7f0a97c61700 1 --2- 172.21.15.156:0/2258406490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a9009a580 0x7f0a9011de50 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.742+0000 7f0a97c61700 1 --2- 172.21.15.156:0/2258406490 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a9009d7f0 0x7f0a9011e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.742+0000 7f0a97c61700 1 -- 172.21.15.156:0/2258406490 >> 172.21.15.156:0/2258406490 conn(0x7f0a9009f9f0 msgr2=0x7f0a90071eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:45.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.742+0000 7f0a97c61700 1 -- 172.21.15.156:0/2258406490 shutdown_connections 2023-09-30T22:22:45.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:45.743+0000 7f0a97c61700 1 -- 172.21.15.156:0/2258406490 wait complete. 2023-09-30T22:22:45.754 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:46.670 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:46.682 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:46.694 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:46.755 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:46.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.817+0000 7f6f30a8f700 1 Processor -- start 2023-09-30T22:22:46.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.817+0000 7f6f30a8f700 1 -- start start 2023-09-30T22:22:46.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.818+0000 7f6f30a8f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c0a1510 0x7f6f2c1351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.818+0000 7f6f30a8f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6f2c1356e0 0x7f6f2c137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.818+0000 7f6f30a8f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f2c0a1e70 con 0x7f6f2c0a0a30 2023-09-30T22:22:46.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.818+0000 7f6f30a8f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f2c09a720 con 0x7f6f2c1356e0 2023-09-30T22:22:46.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.818+0000 7f6f30a8f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c09b300 con 0x7f6f2c0a1510 2023-09-30T22:22:46.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.818+0000 7f6f29d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c0a1510 0x7f6f2c1351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.818+0000 7f6f29d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c0a1510 0x7f6f2c1351a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:56860/0 (socket says 172.21.15.156:56860) 2023-09-30T22:22:46.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.818+0000 7f6f29d9b700 1 -- 172.21.15.156:0/622703195 learned_addr learned my addr 172.21.15.156:0/622703195 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:46.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.818+0000 7f6f2ad9d700 1 --2- 172.21.15.156:0/622703195 >> v2:172.21.15.156:3300/0 conn(0x7f6f2c1356e0 0x7f6f2c137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.819+0000 7f6f29d9b700 1 -- 172.21.15.156:0/622703195 >> v2:172.21.15.156:3300/0 conn(0x7f6f2c1356e0 msgr2=0x7f6f2c137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:46.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.819+0000 7f6f29d9b700 1 --2- 172.21.15.156:0/622703195 >> v2:172.21.15.156:3300/0 conn(0x7f6f2c1356e0 0x7f6f2c137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.819+0000 7f6f29d9b700 1 -- 172.21.15.156:0/622703195 >> v1:172.21.15.156:6789/0 conn(0x7f6f2c0a0a30 legacy=0x7f6f2c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.819+0000 7f6f29d9b700 1 -- 172.21.15.156:0/622703195 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2c09abc0 con 0x7f6f2c0a1510 2023-09-30T22:22:46.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.819+0000 7f6f29d9b700 1 --2- 172.21.15.156:0/622703195 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c0a1510 0x7f6f2c1351a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000bb90 tx=0x7f6f2000bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c5fe029e36cfaf5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:46.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.819+0000 7f6f2959a700 1 -- 172.21.15.156:0/622703195 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2000dc20 con 0x7f6f2c0a1510 2023-09-30T22:22:46.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.819+0000 7f6f2959a700 1 -- 172.21.15.156:0/622703195 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2000dd80 con 0x7f6f2c0a1510 2023-09-30T22:22:46.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.819+0000 7f6f2959a700 1 -- 172.21.15.156:0/622703195 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f20017630 con 0x7f6f2c0a1510 2023-09-30T22:22:46.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.820+0000 7f6f30a8f700 1 -- 172.21.15.156:0/622703195 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c0a1510 msgr2=0x7f6f2c1351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.820+0000 7f6f30a8f700 1 --2- 172.21.15.156:0/622703195 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c0a1510 0x7f6f2c1351a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000bb90 tx=0x7f6f2000bea0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.820+0000 7f6f30a8f700 1 -- 172.21.15.156:0/622703195 shutdown_connections 2023-09-30T22:22:46.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.820+0000 7f6f30a8f700 1 --2- 172.21.15.156:0/622703195 >> v2:172.21.15.156:3300/0 conn(0x7f6f2c1356e0 0x7f6f2c137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.820+0000 7f6f30a8f700 1 --2- 172.21.15.156:0/622703195 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c0a1510 0x7f6f2c1351a0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.820+0000 7f6f30a8f700 1 -- 172.21.15.156:0/622703195 >> 172.21.15.156:0/622703195 conn(0x7f6f2c0a2980 msgr2=0x7f6f2c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:46.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.820+0000 7f6f30a8f700 1 -- 172.21.15.156:0/622703195 shutdown_connections 2023-09-30T22:22:46.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.820+0000 7f6f30a8f700 1 -- 172.21.15.156:0/622703195 wait complete. 2023-09-30T22:22:46.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.822+0000 7f6f30a8f700 1 Processor -- start 2023-09-30T22:22:46.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.822+0000 7f6f30a8f700 1 -- start start 2023-09-30T22:22:46.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.822+0000 7f6f30a8f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c0a0a30 0x7f6f2c123050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.822+0000 7f6f30a8f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f2c0a1510 0x7f6f2c123590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.822+0000 7f6f30a8f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f2c1356e0 0x7f6f2c123ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.822+0000 7f6f30a8f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c124520 con 0x7f6f2c1356e0 2023-09-30T22:22:46.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.822+0000 7f6f30a8f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c135430 con 0x7f6f2c0a0a30 2023-09-30T22:22:46.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.822+0000 7f6f30a8f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c125eb0 con 0x7f6f2c0a1510 2023-09-30T22:22:46.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.823+0000 7f6f2a59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c0a0a30 0x7f6f2c123050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.823+0000 7f6f2a59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c0a0a30 0x7f6f2c123050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:56862/0 (socket says 172.21.15.156:56862) 2023-09-30T22:22:46.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.823+0000 7f6f2a59c700 1 -- 172.21.15.156:0/4199987911 learned_addr learned my addr 172.21.15.156:0/4199987911 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:46.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.823+0000 7f6f2ad9d700 1 --2- 172.21.15.156:0/4199987911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f2c1356e0 0x7f6f2c123ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.823+0000 7f6f29d9b700 1 --2- 172.21.15.156:0/4199987911 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f2c0a1510 0x7f6f2c123590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.823+0000 7f6f2ad9d700 1 -- 172.21.15.156:0/4199987911 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f2c0a1510 msgr2=0x7f6f2c123590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.823+0000 7f6f2ad9d700 1 --2- 172.21.15.156:0/4199987911 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f2c0a1510 0x7f6f2c123590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.823+0000 7f6f2ad9d700 1 -- 172.21.15.156:0/4199987911 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c0a0a30 msgr2=0x7f6f2c123050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.823+0000 7f6f2ad9d700 1 --2- 172.21.15.156:0/4199987911 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c0a0a30 0x7f6f2c123050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.823+0000 7f6f2ad9d700 1 -- 172.21.15.156:0/4199987911 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2000b7f0 con 0x7f6f2c1356e0 2023-09-30T22:22:46.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.823+0000 7f6f2a59c700 1 --2- 172.21.15.156:0/4199987911 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c0a0a30 0x7f6f2c123050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:46.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.823+0000 7f6f2ad9d700 1 --2- 172.21.15.156:0/4199987911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f2c1356e0 0x7f6f2c123ad0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400ef90 tx=0x7f6f2400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:46.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.823+0000 7f6f1affd700 1 -- 172.21.15.156:0/4199987911 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2400cc90 con 0x7f6f2c1356e0 2023-09-30T22:22:46.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.823+0000 7f6f1affd700 1 -- 172.21.15.156:0/4199987911 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2400f040 con 0x7f6f2c1356e0 2023-09-30T22:22:46.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.823+0000 7f6f1affd700 1 -- 172.21.15.156:0/4199987911 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f240146c0 con 0x7f6f2c1356e0 2023-09-30T22:22:46.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.823+0000 7f6f30a8f700 1 -- 172.21.15.156:0/4199987911 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f2c1268f0 con 0x7f6f2c1356e0 2023-09-30T22:22:46.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.824+0000 7f6f30a8f700 1 -- 172.21.15.156:0/4199987911 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f2c09ff10 con 0x7f6f2c1356e0 2023-09-30T22:22:46.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.824+0000 7f6f30a8f700 1 -- 172.21.15.156:0/4199987911 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f2c09ae00 con 0x7f6f2c1356e0 2023-09-30T22:22:46.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.825+0000 7f6f1affd700 1 -- 172.21.15.156:0/4199987911 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f24014820 con 0x7f6f2c1356e0 2023-09-30T22:22:46.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.825+0000 7f6f1affd700 1 -- 172.21.15.156:0/4199987911 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6f24041740 con 0x7f6f2c1356e0 2023-09-30T22:22:46.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.830+0000 7f6f1affd700 1 -- 172.21.15.156:0/4199987911 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f24045060 con 0x7f6f2c1356e0 2023-09-30T22:22:46.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.854+0000 7f6c0ff3e700 1 Processor -- start 2023-09-30T22:22:46.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.854+0000 7f6c0ff3e700 1 -- start start 2023-09-30T22:22:46.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.855+0000 7f6c0ff3e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6c0809e950 0x7f6c0809ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.855+0000 7f6c0ff3e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6c081393c0 0x7f6c0813b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.855+0000 7f6c0ff3e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c0809ac20 con 0x7f6c0809f260 2023-09-30T22:22:46.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.855+0000 7f6c0ff3e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c080a06c0 con 0x7f6c081393c0 2023-09-30T22:22:46.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.855+0000 7f6c0ff3e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0809ae90 con 0x7f6c0809e950 2023-09-30T22:22:46.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.855+0000 7f6c0d4d9700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6c0809f260 0x7f6c08137ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45626/0 (socket says 172.21.15.156:45626) 2023-09-30T22:22:46.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.855+0000 7f6c0d4d9700 1 -- 172.21.15.156:0/1098471894 learned_addr learned my addr 172.21.15.156:0/1098471894 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:46.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.855+0000 7f6c0ccd8700 1 -- 172.21.15.156:0/1098471894 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1247341382 0 0) 0x7f6c0809ac20 con 0x7f6c0809f260 2023-09-30T22:22:46.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.855+0000 7f6c0ccd8700 1 -- 172.21.15.156:0/1098471894 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bf40035b0 con 0x7f6c0809f260 2023-09-30T22:22:46.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.855+0000 7f647e258700 1 Processor -- start 2023-09-30T22:22:46.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.855+0000 7f6c0e4db700 1 --2- 172.21.15.156:0/1098471894 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6c081393c0 0x7f6c0813b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.855+0000 7f647e258700 1 -- start start 2023-09-30T22:22:46.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.855+0000 7f6c0dcda700 1 --2- 172.21.15.156:0/1098471894 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6c0809e950 0x7f6c0809ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.856+0000 7f6c0e4db700 1 -- 172.21.15.156:0/1098471894 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6c0809e950 msgr2=0x7f6c0809ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:46.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.855+0000 7f6c0ccd8700 1 -- 172.21.15.156:0/1098471894 <== mon.0 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2444691448 0 0) 0x7f6bf40035b0 con 0x7f6c0809f260 2023-09-30T22:22:46.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.856+0000 7f6c0e4db700 1 --2- 172.21.15.156:0/1098471894 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6c0809e950 0x7f6c0809ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.856+0000 7f6c0e4db700 1 -- 172.21.15.156:0/1098471894 >> v1:172.21.15.156:6789/0 conn(0x7f6c0809f260 legacy=0x7f6c08137ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.856+0000 7f6c0e4db700 1 -- 172.21.15.156:0/1098471894 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0806ba00 con 0x7f6c081393c0 2023-09-30T22:22:46.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.856+0000 7f6c0dcda700 1 --2- 172.21.15.156:0/1098471894 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6c0809e950 0x7f6c0809ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:22:46.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.856+0000 7f6c0e4db700 1 --2- 172.21.15.156:0/1098471894 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6c081393c0 0x7f6c0813b7a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6c00009df0 tx=0x7f6c0000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa4e585271db923c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:46.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.856+0000 7f647e258700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f647809ad40 0x7f6478133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.856+0000 7f647e258700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6478133f70 0x7f64781343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.856+0000 7f647e258700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647809b110 con 0x7f64780a0a70 2023-09-30T22:22:46.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.856+0000 7f647e258700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64780a3b60 con 0x7f647809ad40 2023-09-30T22:22:46.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.856+0000 7f647e258700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64781348e0 con 0x7f6478133f70 2023-09-30T22:22:46.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.856+0000 7f6c0ccd8700 1 -- 172.21.15.156:0/1098471894 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0000e070 con 0x7f6c081393c0 2023-09-30T22:22:46.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.856+0000 7f6c0ccd8700 1 -- 172.21.15.156:0/1098471894 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c00003a20 con 0x7f6c081393c0 2023-09-30T22:22:46.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.856+0000 7f6477fff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f64780a0a70 0x7f64780a0ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45642/0 (socket says 172.21.15.156:45642) 2023-09-30T22:22:46.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.856+0000 7f6477fff700 1 -- 172.21.15.156:0/2609459629 learned_addr learned my addr 172.21.15.156:0/2609459629 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:46.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.856+0000 7f6c0ccd8700 1 -- 172.21.15.156:0/1098471894 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8001670 con 0x7f6c081393c0 2023-09-30T22:22:46.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.856+0000 7f64767fc700 1 -- 172.21.15.156:0/2609459629 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247591477 0 0) 0x7f647809b110 con 0x7f64780a0a70 2023-09-30T22:22:46.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.856+0000 7f64777fe700 1 --2- 172.21.15.156:0/2609459629 >> v2:172.21.15.156:3300/0 conn(0x7f647809ad40 0x7f6478133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f64767fc700 1 -- 172.21.15.156:0/2609459629 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64600035b0 con 0x7f64780a0a70 2023-09-30T22:22:46.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f6476ffd700 1 --2- 172.21.15.156:0/2609459629 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6478133f70 0x7f64781343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f64767fc700 1 -- 172.21.15.156:0/2609459629 <== mon.0 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4076432121 0 0) 0x7f64600035b0 con 0x7f64780a0a70 2023-09-30T22:22:46.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f64767fc700 1 -- 172.21.15.156:0/2609459629 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6478133f70 msgr2=0x7f64781343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:46.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f64767fc700 1 --2- 172.21.15.156:0/2609459629 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6478133f70 0x7f64781343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f64767fc700 1 -- 172.21.15.156:0/2609459629 >> v2:172.21.15.156:3300/0 conn(0x7f647809ad40 msgr2=0x7f6478133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:46.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f64767fc700 1 --2- 172.21.15.156:0/2609459629 >> v2:172.21.15.156:3300/0 conn(0x7f647809ad40 0x7f6478133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f64767fc700 1 -- 172.21.15.156:0/2609459629 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64780a2fa0 con 0x7f64780a0a70 2023-09-30T22:22:46.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f64767fc700 1 -- 172.21.15.156:0/2609459629 <== mon.0 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2864602571 0 0) 0x7f64700019f0 con 0x7f64780a0a70 2023-09-30T22:22:46.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f64767fc700 1 -- 172.21.15.156:0/2609459629 >> v1:172.21.15.156:6789/0 conn(0x7f64780a0a70 legacy=0x7f64780a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f64767fc700 1 --2- 172.21.15.156:0/2609459629 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6460003a70 0x7f6460003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f64767fc700 1 --2- 172.21.15.156:0/2609459629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6460004850 0x7f6460004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f64767fc700 1 --2- 172.21.15.156:0/2609459629 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6460005250 0x7f646000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f64767fc700 1 -- 172.21.15.156:0/2609459629 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64780a3b60 con 0x7f6460004850 2023-09-30T22:22:46.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f64767fc700 1 -- 172.21.15.156:0/2609459629 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64781348e0 con 0x7f6460003a70 2023-09-30T22:22:46.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f64767fc700 1 -- 172.21.15.156:0/2609459629 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f646000c1e0 con 0x7f6460005250 2023-09-30T22:22:46.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f6476ffd700 1 --2- 172.21.15.156:0/2609459629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6460004850 0x7f6460004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f64777fe700 1 --2- 172.21.15.156:0/2609459629 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6460003a70 0x7f6460003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f6c0ff3e700 1 -- 172.21.15.156:0/1098471894 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6c081393c0 msgr2=0x7f6c0813b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f6c0ff3e700 1 --2- 172.21.15.156:0/1098471894 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6c081393c0 0x7f6c0813b7a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6c00009df0 tx=0x7f6c0000b330 comp rx=0 tx=0).stop 2023-09-30T22:22:46.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f6477fff700 1 --2- 172.21.15.156:0/2609459629 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6460005250 0x7f646000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f6c0ff3e700 1 -- 172.21.15.156:0/1098471894 shutdown_connections 2023-09-30T22:22:46.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f6c0ff3e700 1 --2- 172.21.15.156:0/1098471894 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6c081393c0 0x7f6c0813b7a0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f6c0ff3e700 1 --2- 172.21.15.156:0/1098471894 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6c0809e950 0x7f6c0809ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f6c0ff3e700 1 -- 172.21.15.156:0/1098471894 >> 172.21.15.156:0/1098471894 conn(0x7f6c080a0f70 msgr2=0x7f6c080a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:46.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f6c0ff3e700 1 -- 172.21.15.156:0/1098471894 shutdown_connections 2023-09-30T22:22:46.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f6c0ff3e700 1 -- 172.21.15.156:0/1098471894 wait complete. 2023-09-30T22:22:46.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f6476ffd700 1 -- 172.21.15.156:0/2609459629 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6460005250 msgr2=0x7f646000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:46.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f6476ffd700 1 --2- 172.21.15.156:0/2609459629 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6460005250 0x7f646000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f6476ffd700 1 -- 172.21.15.156:0/2609459629 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6460003a70 msgr2=0x7f6460003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:46.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.857+0000 7f6476ffd700 1 --2- 172.21.15.156:0/2609459629 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6460003a70 0x7f6460003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.858+0000 7f6476ffd700 1 -- 172.21.15.156:0/2609459629 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64600035b0 con 0x7f6460004850 2023-09-30T22:22:46.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.858+0000 7f6476ffd700 1 --2- 172.21.15.156:0/2609459629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6460004850 0x7f6460004cc0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f64780a31c0 tx=0x7f6460005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f816bac75831964 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:46.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.858+0000 7f64767fc700 1 -- 172.21.15.156:0/2609459629 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c00c070 con 0x7f6460004850 2023-09-30T22:22:46.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.858+0000 7f64767fc700 1 -- 172.21.15.156:0/2609459629 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646c013630 con 0x7f6460004850 2023-09-30T22:22:46.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.858+0000 7f64767fc700 1 -- 172.21.15.156:0/2609459629 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c0139c0 con 0x7f6460004850 2023-09-30T22:22:46.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.858+0000 7f6c0ff3e700 1 Processor -- start 2023-09-30T22:22:46.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.858+0000 7f6c0ff3e700 1 -- start start 2023-09-30T22:22:46.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.859+0000 7f647e258700 1 -- 172.21.15.156:0/2609459629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6460004850 msgr2=0x7f6460004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.859+0000 7f647e258700 1 --2- 172.21.15.156:0/2609459629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6460004850 0x7f6460004cc0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f64780a31c0 tx=0x7f6460005880 comp rx=0 tx=0).stop 2023-09-30T22:22:46.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.859+0000 7f6477fff700 1 -- 172.21.15.156:0/2609459629 reap_dead start 2023-09-30T22:22:46.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.859+0000 7f647e258700 1 -- 172.21.15.156:0/2609459629 shutdown_connections 2023-09-30T22:22:46.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.859+0000 7f647e258700 1 -- 172.21.15.156:0/2609459629 >> 172.21.15.156:0/2609459629 conn(0x7f6478099c40 msgr2=0x7f647806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:46.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.860+0000 7f6c0ff3e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6c0809e950 0x7f6c08121680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.860+0000 7f6c0ff3e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6c0809f260 0x7f6c08121bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.860+0000 7f6c0ff3e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c081393c0 0x7f6c08122100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.860+0000 7f6c0ff3e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c081251a0 con 0x7f6c081393c0 2023-09-30T22:22:46.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.860+0000 7f6c0ff3e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c08137aa0 con 0x7f6c0809e950 2023-09-30T22:22:46.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.860+0000 7f6c0ff3e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c08072790 con 0x7f6c0809f260 2023-09-30T22:22:46.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.860+0000 7f6c0d4d9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6c0809f260 0x7f6c08121bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.860+0000 7f6c0d4d9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6c0809f260 0x7f6c08121bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51860/0 (socket says 172.21.15.156:51860) 2023-09-30T22:22:46.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.860+0000 7f6c0d4d9700 1 -- 172.21.15.156:0/115918066 learned_addr learned my addr 172.21.15.156:0/115918066 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:46.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.860+0000 7f6c0dcda700 1 --2- 172.21.15.156:0/115918066 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6c0809e950 0x7f6c08121680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.860+0000 7f6c0e4db700 1 --2- 172.21.15.156:0/115918066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c081393c0 0x7f6c08122100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.860+0000 7f647e258700 1 -- 172.21.15.156:0/2609459629 shutdown_connections 2023-09-30T22:22:46.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.860+0000 7f647e258700 1 -- 172.21.15.156:0/2609459629 wait complete. 2023-09-30T22:22:46.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.860+0000 7f6c0dcda700 1 -- 172.21.15.156:0/115918066 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6c0809f260 msgr2=0x7f6c08121bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.860+0000 7f6c0dcda700 1 --2- 172.21.15.156:0/115918066 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6c0809f260 0x7f6c08121bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.860+0000 7f6c0dcda700 1 -- 172.21.15.156:0/115918066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c081393c0 msgr2=0x7f6c08122100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.860+0000 7f6c0dcda700 1 --2- 172.21.15.156:0/115918066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c081393c0 0x7f6c08122100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.860+0000 7f6c0dcda700 1 -- 172.21.15.156:0/115918066 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c00009a70 con 0x7f6c0809e950 2023-09-30T22:22:46.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.860+0000 7f6c0e4db700 1 --2- 172.21.15.156:0/115918066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c081393c0 0x7f6c08122100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:46.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.860+0000 7f6c0dcda700 1 --2- 172.21.15.156:0/115918066 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6c0809e950 0x7f6c08121680 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f6c0400c7f0 tx=0x7f6c0400cb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:46.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.861+0000 7f6bfe7fc700 1 -- 172.21.15.156:0/115918066 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c04005c20 con 0x7f6c0809e950 2023-09-30T22:22:46.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.861+0000 7f6bfe7fc700 1 -- 172.21.15.156:0/115918066 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c04005d80 con 0x7f6c0809e950 2023-09-30T22:22:46.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.861+0000 7f6bfe7fc700 1 -- 172.21.15.156:0/115918066 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c04011820 con 0x7f6c0809e950 2023-09-30T22:22:46.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.861+0000 7f6c0ff3e700 1 -- 172.21.15.156:0/115918066 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c080a0820 con 0x7f6c0809e950 2023-09-30T22:22:46.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.861+0000 7f6c0ff3e700 1 -- 172.21.15.156:0/115918066 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c08124930 con 0x7f6c0809e950 2023-09-30T22:22:46.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.862+0000 7f6c0ff3e700 1 -- 172.21.15.156:0/115918066 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c0804f2a0 con 0x7f6c0809e950 2023-09-30T22:22:46.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.861+0000 7f647e258700 1 Processor -- start 2023-09-30T22:22:46.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.861+0000 7f647e258700 1 -- start start 2023-09-30T22:22:46.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.862+0000 7f647e258700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6460004850 0x7f647811e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.862+0000 7f647e258700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64781314c0 0x7f647811e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.862+0000 7f647e258700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f647811eb30 0x7f64781cec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.862+0000 7f647e258700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64781219f0 con 0x7f64781314c0 2023-09-30T22:22:46.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.862+0000 7f647e258700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647811ef80 con 0x7f647811eb30 2023-09-30T22:22:46.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.862+0000 7f647e258700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6478120f80 con 0x7f6460004850 2023-09-30T22:22:46.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.862+0000 7f64777fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6460004850 0x7f647811e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.862+0000 7f64777fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6460004850 0x7f647811e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51874/0 (socket says 172.21.15.156:51874) 2023-09-30T22:22:46.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.862+0000 7f64777fe700 1 -- 172.21.15.156:0/840518744 learned_addr learned my addr 172.21.15.156:0/840518744 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:46.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.862+0000 7f6477fff700 1 --2- 172.21.15.156:0/840518744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f647811eb30 0x7f64781cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.863+0000 7f64777fe700 1 -- 172.21.15.156:0/840518744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f647811eb30 msgr2=0x7f64781cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.863+0000 7f64777fe700 1 --2- 172.21.15.156:0/840518744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f647811eb30 0x7f64781cec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.863+0000 7f64777fe700 1 -- 172.21.15.156:0/840518744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64781314c0 msgr2=0x7f647811e5f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:46.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.863+0000 7f64777fe700 1 --2- 172.21.15.156:0/840518744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64781314c0 0x7f647811e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.863+0000 7f64777fe700 1 -- 172.21.15.156:0/840518744 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6478121bd0 con 0x7f6460004850 2023-09-30T22:22:46.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.863+0000 7f64777fe700 1 --2- 172.21.15.156:0/840518744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6460004850 0x7f647811e0b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f64680116d0 tx=0x7f64680119e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:46.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.863+0000 7f645ffff700 1 -- 172.21.15.156:0/840518744 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646800c070 con 0x7f6460004850 2023-09-30T22:22:46.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.863+0000 7f647e258700 1 -- 172.21.15.156:0/840518744 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f647811fd60 con 0x7f6460004850 2023-09-30T22:22:46.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.863+0000 7f647e258700 1 -- 172.21.15.156:0/840518744 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64780a44d0 con 0x7f6460004850 2023-09-30T22:22:46.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.863+0000 7f645ffff700 1 -- 172.21.15.156:0/840518744 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6468015870 con 0x7f6460004850 2023-09-30T22:22:46.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.863+0000 7f645ffff700 1 -- 172.21.15.156:0/840518744 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6468015be0 con 0x7f6460004850 2023-09-30T22:22:46.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.863+0000 7f6bfe7fc700 1 -- 172.21.15.156:0/115918066 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6c04011980 con 0x7f6c0809e950 2023-09-30T22:22:46.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.863+0000 7f6bfe7fc700 1 -- 172.21.15.156:0/115918066 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6c0403fb00 con 0x7f6c0809e950 2023-09-30T22:22:46.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.864+0000 7f647e258700 1 -- 172.21.15.156:0/840518744 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64580052e0 con 0x7f6460004850 2023-09-30T22:22:46.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.865+0000 7f645ffff700 1 -- 172.21.15.156:0/840518744 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6468015d40 con 0x7f6460004850 2023-09-30T22:22:46.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.865+0000 7f645ffff700 1 -- 172.21.15.156:0/840518744 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f646801cc60 con 0x7f6460004850 2023-09-30T22:22:46.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.867+0000 7f6bfe7fc700 1 -- 172.21.15.156:0/115918066 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c04020300 con 0x7f6c0809e950 2023-09-30T22:22:46.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.870+0000 7f645ffff700 1 -- 172.21.15.156:0/840518744 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6468013400 con 0x7f6460004850 2023-09-30T22:22:46.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.926+0000 7fa624fb8700 1 Processor -- start 2023-09-30T22:22:46.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.926+0000 7fa624fb8700 1 -- start start 2023-09-30T22:22:46.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.927+0000 7fa624fb8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa62009d860 0x7fa62009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.927+0000 7fa624fb8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa620130eb0 0x7fa620138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.927+0000 7fa624fb8700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62009aaa0 con 0x7fa62009e170 2023-09-30T22:22:46.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.927+0000 7fa624fb8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62009f870 con 0x7fa62009d860 2023-09-30T22:22:46.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.927+0000 7fa624fb8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa62009b360 con 0x7fa620130eb0 2023-09-30T22:22:46.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.927+0000 7fa61e59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa62009d860 0x7fa62009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.927+0000 7fa61e59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa62009d860 0x7fa62009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:56918/0 (socket says 172.21.15.156:56918) 2023-09-30T22:22:46.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.927+0000 7fa61e59c700 1 -- 172.21.15.156:0/1795039240 learned_addr learned my addr 172.21.15.156:0/1795039240 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:46.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.927+0000 7fa61ed9d700 1 --2- 172.21.15.156:0/1795039240 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa620130eb0 0x7fa620138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.927+0000 7fa61ed9d700 1 -- 172.21.15.156:0/1795039240 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa62009d860 msgr2=0x7fa62009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:46.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.927+0000 7fa61ed9d700 1 --2- 172.21.15.156:0/1795039240 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa62009d860 0x7fa62009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.927+0000 7fa61d59a700 1 -- 172.21.15.156:0/1795039240 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3985472239 0 0) 0x7fa62009aaa0 con 0x7fa62009e170 2023-09-30T22:22:46.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.927+0000 7fa61ed9d700 1 -- 172.21.15.156:0/1795039240 >> v1:172.21.15.156:6789/0 conn(0x7fa62009e170 legacy=0x7fa6201307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.927+0000 7fa61ed9d700 1 -- 172.21.15.156:0/1795039240 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62009b620 con 0x7fa620130eb0 2023-09-30T22:22:46.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.928+0000 7fa61ed9d700 1 --2- 172.21.15.156:0/1795039240 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa620130eb0 0x7fa620138a00 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa618009dc0 tx=0x7fa61800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=daa5a391f698f25 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:46.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.928+0000 7fa61d59a700 1 -- 172.21.15.156:0/1795039240 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61800e070 con 0x7fa620130eb0 2023-09-30T22:22:46.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.928+0000 7fa61d59a700 1 -- 172.21.15.156:0/1795039240 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61800bb20 con 0x7fa620130eb0 2023-09-30T22:22:46.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.928+0000 7fa61d59a700 1 -- 172.21.15.156:0/1795039240 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa618012430 con 0x7fa620130eb0 2023-09-30T22:22:46.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.929+0000 7fa624fb8700 1 -- 172.21.15.156:0/1795039240 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa620130eb0 msgr2=0x7fa620138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.929+0000 7fa624fb8700 1 --2- 172.21.15.156:0/1795039240 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa620130eb0 0x7fa620138a00 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa618009dc0 tx=0x7fa61800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:46.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.929+0000 7fa624fb8700 1 -- 172.21.15.156:0/1795039240 shutdown_connections 2023-09-30T22:22:46.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.929+0000 7fa624fb8700 1 --2- 172.21.15.156:0/1795039240 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa62009d860 0x7fa62009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.929+0000 7fa624fb8700 1 --2- 172.21.15.156:0/1795039240 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa620130eb0 0x7fa620138a00 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.929+0000 7fa624fb8700 1 -- 172.21.15.156:0/1795039240 >> 172.21.15.156:0/1795039240 conn(0x7fa620099c40 msgr2=0x7fa6200a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:46.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.929+0000 7fa624fb8700 1 -- 172.21.15.156:0/1795039240 shutdown_connections 2023-09-30T22:22:46.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.929+0000 7fa624fb8700 1 -- 172.21.15.156:0/1795039240 wait complete. 2023-09-30T22:22:46.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.931+0000 7fa624fb8700 1 Processor -- start 2023-09-30T22:22:46.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.931+0000 7fa624fb8700 1 -- start start 2023-09-30T22:22:46.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.931+0000 7fa624fb8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa62009d860 0x7fa6201c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.931+0000 7fa624fb8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa62009e170 0x7fa6201c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.931+0000 7fa624fb8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa620130eb0 0x7fa6201c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.931+0000 7fa624fb8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa620120650 con 0x7fa62009d860 2023-09-30T22:22:46.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.931+0000 7fa624fb8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62011f3b0 con 0x7fa62009e170 2023-09-30T22:22:46.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.931+0000 7fa624fb8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa62009c8b0 con 0x7fa620130eb0 2023-09-30T22:22:46.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.932+0000 7fa61e59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa62009d860 0x7fa6201c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.932+0000 7fa61e59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa62009d860 0x7fa6201c8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44326/0 (socket says 172.21.15.156:44326) 2023-09-30T22:22:46.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.932+0000 7fa61e59c700 1 -- 172.21.15.156:0/2321000750 learned_addr learned my addr 172.21.15.156:0/2321000750 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:46.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.932+0000 7fa61ed9d700 1 --2- 172.21.15.156:0/2321000750 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa620130eb0 0x7fa6201c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.932+0000 7fa61dd9b700 1 --2- 172.21.15.156:0/2321000750 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa62009e170 0x7fa6201c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.932+0000 7fa61ed9d700 1 -- 172.21.15.156:0/2321000750 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa62009e170 msgr2=0x7fa6201c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.932+0000 7fa61ed9d700 1 --2- 172.21.15.156:0/2321000750 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa62009e170 0x7fa6201c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.932+0000 7fa61ed9d700 1 -- 172.21.15.156:0/2321000750 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa62009d860 msgr2=0x7fa6201c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.932+0000 7fa61ed9d700 1 --2- 172.21.15.156:0/2321000750 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa62009d860 0x7fa6201c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.932+0000 7fa61ed9d700 1 -- 172.21.15.156:0/2321000750 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa618009a70 con 0x7fa620130eb0 2023-09-30T22:22:46.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.932+0000 7fa61ed9d700 1 --2- 172.21.15.156:0/2321000750 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa620130eb0 0x7fa6201c8bd0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa618016000 tx=0x7fa618004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:46.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.932+0000 7fa60effd700 1 -- 172.21.15.156:0/2321000750 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa618012430 con 0x7fa620130eb0 2023-09-30T22:22:46.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.932+0000 7fa60effd700 1 -- 172.21.15.156:0/2321000750 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa618020070 con 0x7fa620130eb0 2023-09-30T22:22:46.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.932+0000 7fa624fb8700 1 -- 172.21.15.156:0/2321000750 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6200a0790 con 0x7fa620130eb0 2023-09-30T22:22:46.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.933+0000 7fa60effd700 1 -- 172.21.15.156:0/2321000750 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa618004280 con 0x7fa620130eb0 2023-09-30T22:22:46.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.933+0000 7fa624fb8700 1 -- 172.21.15.156:0/2321000750 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa620125ac0 con 0x7fa620130eb0 2023-09-30T22:22:46.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.934+0000 7fa624fb8700 1 -- 172.21.15.156:0/2321000750 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62006b2e0 con 0x7fa620130eb0 2023-09-30T22:22:46.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.934+0000 7fa60effd700 1 -- 172.21.15.156:0/2321000750 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa6180043e0 con 0x7fa620130eb0 2023-09-30T22:22:46.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.934+0000 7fa60effd700 1 -- 172.21.15.156:0/2321000750 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa618022070 con 0x7fa620130eb0 2023-09-30T22:22:46.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:46.939+0000 7fa60effd700 1 -- 172.21.15.156:0/2321000750 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa618027480 con 0x7fa620130eb0 2023-09-30T22:22:47.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.064+0000 7f647e258700 1 -- 172.21.15.156:0/840518744 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6458005590 con 0x7f6460004850 2023-09-30T22:22:47.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.064+0000 7f645ffff700 1 -- 172.21.15.156:0/840518744 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6468023020 con 0x7f6460004850 2023-09-30T22:22:47.065 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:47.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.065+0000 7f6c0ff3e700 1 -- 172.21.15.156:0/115918066 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6c0806bbe0 con 0x7f6c0809e950 2023-09-30T22:22:47.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.065+0000 7f6bfe7fc700 1 -- 172.21.15.156:0/115918066 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6c04023e40 con 0x7f6c0809e950 2023-09-30T22:22:47.065 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:47.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.067+0000 7f6c0ff3e700 1 -- 172.21.15.156:0/115918066 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6c0809e950 msgr2=0x7f6c08121680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:47.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.067+0000 7f6c0ff3e700 1 --2- 172.21.15.156:0/115918066 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6c0809e950 0x7f6c08121680 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f6c0400c7f0 tx=0x7f6c0400cb00 comp rx=0 tx=0).stop 2023-09-30T22:22:47.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.067+0000 7f6c0ff3e700 1 -- 172.21.15.156:0/115918066 shutdown_connections 2023-09-30T22:22:47.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.067+0000 7f6c0ff3e700 1 --2- 172.21.15.156:0/115918066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c081393c0 0x7f6c08122100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.067+0000 7f6c0ff3e700 1 --2- 172.21.15.156:0/115918066 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6c0809e950 0x7f6c08121680 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.067+0000 7f6c0ff3e700 1 --2- 172.21.15.156:0/115918066 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6c0809f260 0x7f6c08121bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.067+0000 7f6c0ff3e700 1 -- 172.21.15.156:0/115918066 >> 172.21.15.156:0/115918066 conn(0x7f6c080a0f70 msgr2=0x7f6c0809ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:47.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.067+0000 7f647e258700 1 -- 172.21.15.156:0/840518744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6460004850 msgr2=0x7f647811e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:47.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.067+0000 7f647e258700 1 --2- 172.21.15.156:0/840518744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6460004850 0x7f647811e0b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f64680116d0 tx=0x7f64680119e0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.067+0000 7f6c0ff3e700 1 -- 172.21.15.156:0/115918066 shutdown_connections 2023-09-30T22:22:47.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.067+0000 7f6c0ff3e700 1 -- 172.21.15.156:0/115918066 wait complete. 2023-09-30T22:22:47.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.067+0000 7f647e258700 1 -- 172.21.15.156:0/840518744 shutdown_connections 2023-09-30T22:22:47.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.068+0000 7f647e258700 1 --2- 172.21.15.156:0/840518744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f647811eb30 0x7f64781cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.068+0000 7f647e258700 1 --2- 172.21.15.156:0/840518744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6460004850 0x7f647811e0b0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.068+0000 7f647e258700 1 --2- 172.21.15.156:0/840518744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64781314c0 0x7f647811e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.068+0000 7f647e258700 1 -- 172.21.15.156:0/840518744 >> 172.21.15.156:0/840518744 conn(0x7f6478099c40 msgr2=0x7f64781330d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:47.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.068+0000 7f647e258700 1 -- 172.21.15.156:0/840518744 shutdown_connections 2023-09-30T22:22:47.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.068+0000 7f647e258700 1 -- 172.21.15.156:0/840518744 wait complete. 2023-09-30T22:22:47.080 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:47.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:47.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.102+0000 7f6f30a8f700 1 -- 172.21.15.156:0/4199987911 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6f2c04f2a0 con 0x7f6f2c1356e0 2023-09-30T22:22:47.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.102+0000 7f6f1affd700 1 -- 172.21.15.156:0/4199987911 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f24018070 con 0x7f6f2c1356e0 2023-09-30T22:22:47.102 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:47.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.104+0000 7f6f30a8f700 1 -- 172.21.15.156:0/4199987911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f2c1356e0 msgr2=0x7f6f2c123ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:47.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.104+0000 7f6f30a8f700 1 --2- 172.21.15.156:0/4199987911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f2c1356e0 0x7f6f2c123ad0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400ef90 tx=0x7f6f2400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.104+0000 7f6f30a8f700 1 -- 172.21.15.156:0/4199987911 shutdown_connections 2023-09-30T22:22:47.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.104+0000 7f6f30a8f700 1 --2- 172.21.15.156:0/4199987911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f2c1356e0 0x7f6f2c123ad0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.104+0000 7f6f30a8f700 1 --2- 172.21.15.156:0/4199987911 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c0a0a30 0x7f6f2c123050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.104+0000 7f6f30a8f700 1 --2- 172.21.15.156:0/4199987911 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f2c0a1510 0x7f6f2c123590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.104+0000 7f6f30a8f700 1 -- 172.21.15.156:0/4199987911 >> 172.21.15.156:0/4199987911 conn(0x7f6f2c0a2980 msgr2=0x7f6f2c06f330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:47.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.104+0000 7f6f30a8f700 1 -- 172.21.15.156:0/4199987911 shutdown_connections 2023-09-30T22:22:47.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.105+0000 7f6f30a8f700 1 -- 172.21.15.156:0/4199987911 wait complete. 2023-09-30T22:22:47.116 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:47.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.175+0000 7fa624fb8700 1 -- 172.21.15.156:0/2321000750 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa62004f2a0 con 0x7fa620130eb0 2023-09-30T22:22:47.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.175+0000 7fa60effd700 1 -- 172.21.15.156:0/2321000750 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa61802c020 con 0x7fa620130eb0 2023-09-30T22:22:47.175 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:47.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.177+0000 7fa624fb8700 1 -- 172.21.15.156:0/2321000750 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa620130eb0 msgr2=0x7fa6201c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:47.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.177+0000 7fa624fb8700 1 --2- 172.21.15.156:0/2321000750 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa620130eb0 0x7fa6201c8bd0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa618016000 tx=0x7fa618004ad0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.177+0000 7fa624fb8700 1 -- 172.21.15.156:0/2321000750 shutdown_connections 2023-09-30T22:22:47.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.177+0000 7fa624fb8700 1 --2- 172.21.15.156:0/2321000750 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa620130eb0 0x7fa6201c8bd0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.177+0000 7fa624fb8700 1 --2- 172.21.15.156:0/2321000750 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa62009d860 0x7fa6201c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.177+0000 7fa624fb8700 1 --2- 172.21.15.156:0/2321000750 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa62009e170 0x7fa6201c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.177+0000 7fa624fb8700 1 -- 172.21.15.156:0/2321000750 >> 172.21.15.156:0/2321000750 conn(0x7fa620099c40 msgr2=0x7fa620119630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:47.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.177+0000 7fa624fb8700 1 -- 172.21.15.156:0/2321000750 shutdown_connections 2023-09-30T22:22:47.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:47.177+0000 7fa624fb8700 1 -- 172.21.15.156:0/2321000750 wait complete. 2023-09-30T22:22:47.189 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:48.082 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:48.086 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:48.118 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:48.190 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:48.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.223+0000 7f13aa861700 1 Processor -- start 2023-09-30T22:22:48.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.224+0000 7f13aa861700 1 -- start start 2023-09-30T22:22:48.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.224+0000 7f13aa861700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13a409d860 0x7f13a409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:48.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.224+0000 7f13aa861700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f13a409e170 0x7f13a41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:48.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.224+0000 7f13aa861700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a409aaa0 con 0x7f13a4130ce0 2023-09-30T22:22:48.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.224+0000 7f13aa861700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a409f870 con 0x7f13a409e170 2023-09-30T22:22:48.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.224+0000 7f13aa861700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13a409b360 con 0x7f13a409d860 2023-09-30T22:22:48.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.224+0000 7f13a3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13a409d860 0x7f13a409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:48.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.224+0000 7f13a37fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f13a409e170 0x7f13a41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:48.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.224+0000 7f13a3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13a409d860 0x7f13a409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51900/0 (socket says 172.21.15.156:51900) 2023-09-30T22:22:48.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.224+0000 7f13a37fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f13a409e170 0x7f13a41307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44330/0 (socket says 172.21.15.156:44330) 2023-09-30T22:22:48.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.224+0000 7f13a3fff700 1 -- 172.21.15.156:0/1917214755 learned_addr learned my addr 172.21.15.156:0/1917214755 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:48.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.225+0000 7f13a3fff700 1 -- 172.21.15.156:0/1917214755 >> v2:172.21.15.156:3300/0 conn(0x7f13a409e170 msgr2=0x7f13a41307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:48.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.225+0000 7f13a3fff700 1 --2- 172.21.15.156:0/1917214755 >> v2:172.21.15.156:3300/0 conn(0x7f13a409e170 0x7f13a41307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.225+0000 7f13a3fff700 1 -- 172.21.15.156:0/1917214755 >> v1:172.21.15.156:6789/0 conn(0x7f13a4130ce0 legacy=0x7f13a41379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:48.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.225+0000 7f13a3fff700 1 -- 172.21.15.156:0/1917214755 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a409b620 con 0x7f13a409d860 2023-09-30T22:22:48.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.225+0000 7f13a3fff700 1 --2- 172.21.15.156:0/1917214755 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13a409d860 0x7f13a409dc30 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f139400b9a0 tx=0x7f139400bcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=576c29a01e924885 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:48.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.225+0000 7f13a2ffd700 1 -- 172.21.15.156:0/1917214755 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139400caa0 con 0x7f13a409d860 2023-09-30T22:22:48.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.225+0000 7f13a2ffd700 1 -- 172.21.15.156:0/1917214755 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139400cc00 con 0x7f13a409d860 2023-09-30T22:22:48.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.225+0000 7f13a2ffd700 1 -- 172.21.15.156:0/1917214755 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139400f460 con 0x7f13a409d860 2023-09-30T22:22:48.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.226+0000 7f13aa861700 1 -- 172.21.15.156:0/1917214755 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13a409d860 msgr2=0x7f13a409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:48.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.226+0000 7f13aa861700 1 --2- 172.21.15.156:0/1917214755 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13a409d860 0x7f13a409dc30 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f139400b9a0 tx=0x7f139400bcb0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.226+0000 7f13aa861700 1 -- 172.21.15.156:0/1917214755 shutdown_connections 2023-09-30T22:22:48.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.226+0000 7f13aa861700 1 --2- 172.21.15.156:0/1917214755 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13a409d860 0x7f13a409dc30 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.226+0000 7f13aa861700 1 --2- 172.21.15.156:0/1917214755 >> v2:172.21.15.156:3300/0 conn(0x7f13a409e170 0x7f13a41307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.226+0000 7f13aa861700 1 -- 172.21.15.156:0/1917214755 >> 172.21.15.156:0/1917214755 conn(0x7f13a4099c40 msgr2=0x7f13a40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:48.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.226+0000 7f13aa861700 1 -- 172.21.15.156:0/1917214755 shutdown_connections 2023-09-30T22:22:48.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.226+0000 7f13aa861700 1 -- 172.21.15.156:0/1917214755 wait complete. 2023-09-30T22:22:48.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.227+0000 7f13aa861700 1 Processor -- start 2023-09-30T22:22:48.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.227+0000 7f13aa861700 1 -- start start 2023-09-30T22:22:48.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.228+0000 7f13aa861700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13a409d860 0x7f13a411e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:48.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.228+0000 7f13aa861700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13a409e170 0x7f13a411eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:48.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.228+0000 7f13aa861700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13a4130ce0 0x7f13a411f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:48.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.228+0000 7f13aa861700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a4121ad0 con 0x7f13a409d860 2023-09-30T22:22:48.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.228+0000 7f13aa861700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a4120780 con 0x7f13a409e170 2023-09-30T22:22:48.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.228+0000 7f13aa861700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13a4122070 con 0x7f13a4130ce0 2023-09-30T22:22:48.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.228+0000 7f13a37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13a409e170 0x7f13a411eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:48.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.228+0000 7f13a37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13a409e170 0x7f13a411eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:56944/0 (socket says 172.21.15.156:56944) 2023-09-30T22:22:48.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.228+0000 7f13a37fe700 1 -- 172.21.15.156:0/2962688705 learned_addr learned my addr 172.21.15.156:0/2962688705 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:48.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.228+0000 7f13a8dfe700 1 --2- 172.21.15.156:0/2962688705 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13a4130ce0 0x7f13a411f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:48.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.228+0000 7f13a3fff700 1 --2- 172.21.15.156:0/2962688705 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13a409d860 0x7f13a411e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:48.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.228+0000 7f13a3fff700 1 -- 172.21.15.156:0/2962688705 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13a4130ce0 msgr2=0x7f13a411f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:48.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.228+0000 7f13a3fff700 1 --2- 172.21.15.156:0/2962688705 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13a4130ce0 0x7f13a411f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.228+0000 7f13a3fff700 1 -- 172.21.15.156:0/2962688705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13a409e170 msgr2=0x7f13a411eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:48.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.228+0000 7f13a3fff700 1 --2- 172.21.15.156:0/2962688705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13a409e170 0x7f13a411eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.228+0000 7f13a3fff700 1 -- 172.21.15.156:0/2962688705 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139400b600 con 0x7f13a409d860 2023-09-30T22:22:48.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.228+0000 7f13a8dfe700 1 --2- 172.21.15.156:0/2962688705 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13a4130ce0 0x7f13a411f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:48.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.228+0000 7f13a3fff700 1 --2- 172.21.15.156:0/2962688705 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13a409d860 0x7f13a411e5e0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f1394016000 tx=0x7f1394004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:48.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.229+0000 7f13a0ff9700 1 -- 172.21.15.156:0/2962688705 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139400caa0 con 0x7f13a409d860 2023-09-30T22:22:48.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.229+0000 7f13aa861700 1 -- 172.21.15.156:0/2962688705 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a41304b0 con 0x7f13a409d860 2023-09-30T22:22:48.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.229+0000 7f13aa861700 1 -- 172.21.15.156:0/2962688705 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a4122800 con 0x7f13a409d860 2023-09-30T22:22:48.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.229+0000 7f13a0ff9700 1 -- 172.21.15.156:0/2962688705 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139400f610 con 0x7f13a409d860 2023-09-30T22:22:48.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.229+0000 7f13a0ff9700 1 -- 172.21.15.156:0/2962688705 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139400f9c0 con 0x7f13a409d860 2023-09-30T22:22:48.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.230+0000 7f13a0ff9700 1 -- 172.21.15.156:0/2962688705 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1394029070 con 0x7f13a409d860 2023-09-30T22:22:48.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.230+0000 7f13a0ff9700 1 -- 172.21.15.156:0/2962688705 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f13940494c0 con 0x7f13a409d860 2023-09-30T22:22:48.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.230+0000 7f13aa861700 1 -- 172.21.15.156:0/2962688705 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a409a5b0 con 0x7f13a409d860 2023-09-30T22:22:48.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.235+0000 7f13a0ff9700 1 -- 172.21.15.156:0/2962688705 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f139400fb20 con 0x7f13a409d860 2023-09-30T22:22:48.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.262+0000 7fcadff85700 1 Processor -- start 2023-09-30T22:22:48.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.262+0000 7fcadff85700 1 -- start start 2023-09-30T22:22:48.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.263+0000 7fcadff85700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcad80a0a30 0x7fcad80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:48.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.263+0000 7fcadff85700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcad80a1340 0x7fcad812ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:48.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.263+0000 7fcadff85700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad80a1e70 con 0x7fcad81304a0 2023-09-30T22:22:48.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.263+0000 7fcadff85700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad809a720 con 0x7fcad80a1340 2023-09-30T22:22:48.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.263+0000 7fcadff85700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcad809b300 con 0x7fcad80a0a30 2023-09-30T22:22:48.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.263+0000 7fcaddd21700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcad80a0a30 0x7fcad80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:48.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.263+0000 7fcaddd21700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcad80a0a30 0x7fcad80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51922/0 (socket says 172.21.15.156:51922) 2023-09-30T22:22:48.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.263+0000 7fcaddd21700 1 -- 172.21.15.156:0/1763643071 learned_addr learned my addr 172.21.15.156:0/1763643071 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:48.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.263+0000 7fcadd520700 1 --2- 172.21.15.156:0/1763643071 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcad80a1340 0x7fcad812ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:48.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.263+0000 7fcaddd21700 1 -- 172.21.15.156:0/1763643071 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcad80a1340 msgr2=0x7fcad812ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:48.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.263+0000 7fcaddd21700 1 --2- 172.21.15.156:0/1763643071 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcad80a1340 0x7fcad812ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.263+0000 7fcaddd21700 1 -- 172.21.15.156:0/1763643071 >> v1:172.21.15.156:6789/0 conn(0x7fcad81304a0 legacy=0x7fcad81371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:48.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.263+0000 7fcaddd21700 1 -- 172.21.15.156:0/1763643071 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad809abc0 con 0x7fcad80a0a30 2023-09-30T22:22:48.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.263+0000 7fcaddd21700 1 --2- 172.21.15.156:0/1763643071 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcad80a0a30 0x7fcad80a0e00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcad400bb90 tx=0x7fcad400bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe51f0a471d7940e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:48.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.264+0000 7fcadcd1f700 1 -- 172.21.15.156:0/1763643071 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad4005c20 con 0x7fcad80a0a30 2023-09-30T22:22:48.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.264+0000 7fcadcd1f700 1 -- 172.21.15.156:0/1763643071 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad4005d80 con 0x7fcad80a0a30 2023-09-30T22:22:48.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.264+0000 7fcadcd1f700 1 -- 172.21.15.156:0/1763643071 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad400dc40 con 0x7fcad80a0a30 2023-09-30T22:22:48.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.264+0000 7fcadff85700 1 -- 172.21.15.156:0/1763643071 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcad80a0a30 msgr2=0x7fcad80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:48.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.264+0000 7fcadff85700 1 --2- 172.21.15.156:0/1763643071 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcad80a0a30 0x7fcad80a0e00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcad400bb90 tx=0x7fcad400bea0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.264+0000 7fcadff85700 1 -- 172.21.15.156:0/1763643071 shutdown_connections 2023-09-30T22:22:48.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.264+0000 7fcadff85700 1 --2- 172.21.15.156:0/1763643071 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcad80a0a30 0x7fcad80a0e00 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.264+0000 7fcadff85700 1 --2- 172.21.15.156:0/1763643071 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcad80a1340 0x7fcad812ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.264+0000 7fcadff85700 1 -- 172.21.15.156:0/1763643071 >> 172.21.15.156:0/1763643071 conn(0x7fcad80a2980 msgr2=0x7fcad80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:48.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.264+0000 7fcadff85700 1 -- 172.21.15.156:0/1763643071 shutdown_connections 2023-09-30T22:22:48.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.264+0000 7fcadff85700 1 -- 172.21.15.156:0/1763643071 wait complete. 2023-09-30T22:22:48.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.265+0000 7fcadff85700 1 Processor -- start 2023-09-30T22:22:48.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.265+0000 7fcadff85700 1 -- start start 2023-09-30T22:22:48.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.266+0000 7fcadff85700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcad80a0a30 0x7fcad811a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:48.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.266+0000 7fcadff85700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcad80a1340 0x7fcad811ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:48.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.266+0000 7fcadff85700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcad81304a0 0x7fcad811b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:48.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.266+0000 7fcadff85700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad811e310 con 0x7fcad80a0a30 2023-09-30T22:22:48.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.266+0000 7fcadff85700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad811de00 con 0x7fcad81304a0 2023-09-30T22:22:48.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.266+0000 7fcadff85700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcad811d2a0 con 0x7fcad80a1340 2023-09-30T22:22:48.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.266+0000 7fcaddd21700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcad80a0a30 0x7fcad811a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:48.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.266+0000 7fcaddd21700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcad80a0a30 0x7fcad811a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44348/0 (socket says 172.21.15.156:44348) 2023-09-30T22:22:48.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.266+0000 7fcaddd21700 1 -- 172.21.15.156:0/1359737030 learned_addr learned my addr 172.21.15.156:0/1359737030 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:48.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.266+0000 7fcadd520700 1 --2- 172.21.15.156:0/1359737030 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcad80a1340 0x7fcad811ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:48.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.266+0000 7fcade522700 1 --2- 172.21.15.156:0/1359737030 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcad81304a0 0x7fcad811b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:48.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.266+0000 7fcadd520700 1 -- 172.21.15.156:0/1359737030 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcad81304a0 msgr2=0x7fcad811b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:48.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.266+0000 7fcadd520700 1 --2- 172.21.15.156:0/1359737030 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcad81304a0 0x7fcad811b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.266+0000 7fcadd520700 1 -- 172.21.15.156:0/1359737030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcad80a0a30 msgr2=0x7fcad811a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:48.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.266+0000 7fcadd520700 1 --2- 172.21.15.156:0/1359737030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcad80a0a30 0x7fcad811a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.266+0000 7fcadd520700 1 -- 172.21.15.156:0/1359737030 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad400b7a0 con 0x7fcad80a1340 2023-09-30T22:22:48.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.267+0000 7fcadd520700 1 --2- 172.21.15.156:0/1359737030 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcad80a1340 0x7fcad811ad30 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fcac800e900 tx=0x7fcac800ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:48.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.267+0000 7fcace7fc700 1 -- 172.21.15.156:0/1359737030 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac8013680 con 0x7fcad80a1340 2023-09-30T22:22:48.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.267+0000 7fcace7fc700 1 -- 172.21.15.156:0/1359737030 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac80137e0 con 0x7fcad80a1340 2023-09-30T22:22:48.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.267+0000 7fcadff85700 1 -- 172.21.15.156:0/1359737030 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad811bc50 con 0x7fcad80a1340 2023-09-30T22:22:48.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.267+0000 7fcace7fc700 1 -- 172.21.15.156:0/1359737030 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac8013b50 con 0x7fcad80a1340 2023-09-30T22:22:48.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.267+0000 7fcadff85700 1 -- 172.21.15.156:0/1359737030 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad811c400 con 0x7fcad80a1340 2023-09-30T22:22:48.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.268+0000 7fcace7fc700 1 -- 172.21.15.156:0/1359737030 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcac8013cb0 con 0x7fcad80a1340 2023-09-30T22:22:48.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.268+0000 7fcadff85700 1 -- 172.21.15.156:0/1359737030 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad804f2a0 con 0x7fcad80a1340 2023-09-30T22:22:48.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.268+0000 7fcace7fc700 1 -- 172.21.15.156:0/1359737030 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcac803f930 con 0x7fcad80a1340 2023-09-30T22:22:48.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.271+0000 7fc1fecd5700 1 Processor -- start 2023-09-30T22:22:48.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.271+0000 7fc1fecd5700 1 -- start start 2023-09-30T22:22:48.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.271+0000 7fc1fecd5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1f8138410 0x7fc1f80a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:48.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.271+0000 7fc1fecd5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc1f813dd10 0x7fc1f81400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:48.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.271+0000 7fc1fecd5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f81379e0 con 0x7fc1f8138040 2023-09-30T22:22:48.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.271+0000 7fc1fecd5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f80a2100 con 0x7fc1f813dd10 2023-09-30T22:22:48.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.271+0000 7fc1fecd5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f809b9b0 con 0x7fc1f8138410 2023-09-30T22:22:48.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.272+0000 7fc1f7fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1f8138410 0x7fc1f80a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:48.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.272+0000 7fc1f7fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1f8138410 0x7fc1f80a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51936/0 (socket says 172.21.15.156:51936) 2023-09-30T22:22:48.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.272+0000 7fc1f7fff700 1 -- 172.21.15.156:0/378561799 learned_addr learned my addr 172.21.15.156:0/378561799 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:48.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.272+0000 7fc1fca71700 1 --1- 172.21.15.156:0/378561799 >> v1:172.21.15.156:6789/0 conn(0x7fc1f8138040 0x7fc1f80a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45678/0 (socket says 172.21.15.156:45678) 2023-09-30T22:22:48.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.272+0000 7fc1fd272700 1 --2- 172.21.15.156:0/378561799 >> v2:172.21.15.156:3300/0 conn(0x7fc1f813dd10 0x7fc1f81400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:48.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.272+0000 7fc1f77fe700 1 -- 172.21.15.156:0/378561799 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342801723 0 0) 0x7fc1f81379e0 con 0x7fc1f8138040 2023-09-30T22:22:48.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.272+0000 7fc1f77fe700 1 -- 172.21.15.156:0/378561799 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1e80035b0 con 0x7fc1f8138040 2023-09-30T22:22:48.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.272+0000 7fc1f7fff700 1 -- 172.21.15.156:0/378561799 >> v2:172.21.15.156:3300/0 conn(0x7fc1f813dd10 msgr2=0x7fc1f81400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:48.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.272+0000 7fc1f7fff700 1 --2- 172.21.15.156:0/378561799 >> v2:172.21.15.156:3300/0 conn(0x7fc1f813dd10 0x7fc1f81400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.272+0000 7fc1f7fff700 1 -- 172.21.15.156:0/378561799 >> v1:172.21.15.156:6789/0 conn(0x7fc1f8138040 legacy=0x7fc1f80a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:48.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.272+0000 7fc1f7fff700 1 -- 172.21.15.156:0/378561799 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f8137c10 con 0x7fc1f8138410 2023-09-30T22:22:48.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.272+0000 7fc1f7fff700 1 --2- 172.21.15.156:0/378561799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1f8138410 0x7fc1f80a0ff0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4009920 tx=0x7fc1e4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4030d24189f04d6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:48.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.277+0000 7fc1f77fe700 1 -- 172.21.15.156:0/378561799 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4011830 con 0x7fc1f8138410 2023-09-30T22:22:48.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.277+0000 7fc1f77fe700 1 -- 172.21.15.156:0/378561799 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e4011990 con 0x7fc1f8138410 2023-09-30T22:22:48.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.277+0000 7fc1f77fe700 1 -- 172.21.15.156:0/378561799 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4011d00 con 0x7fc1f8138410 2023-09-30T22:22:48.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.277+0000 7fcace7fc700 1 -- 172.21.15.156:0/1359737030 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcac801abe0 con 0x7fcad80a1340 2023-09-30T22:22:48.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.277+0000 7fc1fecd5700 1 -- 172.21.15.156:0/378561799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1f8138410 msgr2=0x7fc1f80a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:48.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.277+0000 7fc1fecd5700 1 --2- 172.21.15.156:0/378561799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1f8138410 0x7fc1f80a0ff0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4009920 tx=0x7fc1e4009c30 comp rx=0 tx=0).stop 2023-09-30T22:22:48.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.277+0000 7fc1fecd5700 1 -- 172.21.15.156:0/378561799 shutdown_connections 2023-09-30T22:22:48.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.277+0000 7fc1fecd5700 1 --2- 172.21.15.156:0/378561799 >> v2:172.21.15.156:3300/0 conn(0x7fc1f813dd10 0x7fc1f81400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.277+0000 7fc1fecd5700 1 --2- 172.21.15.156:0/378561799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1f8138410 0x7fc1f80a0ff0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.277+0000 7fc1fecd5700 1 -- 172.21.15.156:0/378561799 >> 172.21.15.156:0/378561799 conn(0x7fc1f80a2980 msgr2=0x7fc1f80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:48.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.277+0000 7fc1fecd5700 1 -- 172.21.15.156:0/378561799 shutdown_connections 2023-09-30T22:22:48.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.277+0000 7fc1fecd5700 1 -- 172.21.15.156:0/378561799 wait complete. 2023-09-30T22:22:48.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.278+0000 7fc1fecd5700 1 Processor -- start 2023-09-30T22:22:48.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.278+0000 7fc1fecd5700 1 -- start start 2023-09-30T22:22:48.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.279+0000 7fc1fecd5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1f8138040 0x7fc1f8126160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:48.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.279+0000 7fc1fecd5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1f8138410 0x7fc1f81266a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:48.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.279+0000 7fc1fecd5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1f813dd10 0x7fc1f80701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:48.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.279+0000 7fc1fecd5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f8139e50 con 0x7fc1f8138040 2023-09-30T22:22:48.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.279+0000 7fc1fecd5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f813d870 con 0x7fc1f8138410 2023-09-30T22:22:48.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.279+0000 7fc1fecd5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f809e8a0 con 0x7fc1f813dd10 2023-09-30T22:22:48.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.279+0000 7fc1fca71700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1f8138040 0x7fc1f8126160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:48.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.279+0000 7fc1fca71700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1f8138040 0x7fc1f8126160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44370/0 (socket says 172.21.15.156:44370) 2023-09-30T22:22:48.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.279+0000 7fc1fca71700 1 -- 172.21.15.156:0/603995284 learned_addr learned my addr 172.21.15.156:0/603995284 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:48.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.279+0000 7fc1fd272700 1 --2- 172.21.15.156:0/603995284 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1f813dd10 0x7fc1f80701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:48.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.280+0000 7fc1fca71700 1 -- 172.21.15.156:0/603995284 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1f813dd10 msgr2=0x7fc1f80701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:48.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.280+0000 7fc1fca71700 1 --2- 172.21.15.156:0/603995284 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1f813dd10 0x7fc1f80701a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.280+0000 7fc1fca71700 1 -- 172.21.15.156:0/603995284 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1f8138410 msgr2=0x7fc1f81266a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:48.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.280+0000 7fc1f7fff700 1 --2- 172.21.15.156:0/603995284 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1f8138410 0x7fc1f81266a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:48.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.280+0000 7fc1fca71700 1 --2- 172.21.15.156:0/603995284 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1f8138410 0x7fc1f81266a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.280+0000 7fc1fca71700 1 -- 172.21.15.156:0/603995284 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e4009550 con 0x7fc1f8138040 2023-09-30T22:22:48.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.280+0000 7fc1f7fff700 1 --2- 172.21.15.156:0/603995284 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1f8138410 0x7fc1f81266a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:22:48.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.280+0000 7fc1fca71700 1 --2- 172.21.15.156:0/603995284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1f8138040 0x7fc1f8126160 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec00c490 tx=0x7fc1ec00c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:48.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.280+0000 7fc1f57fa700 1 -- 172.21.15.156:0/603995284 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec0074e0 con 0x7fc1f8138040 2023-09-30T22:22:48.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.280+0000 7fc1f57fa700 1 -- 172.21.15.156:0/603995284 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec007640 con 0x7fc1f8138040 2023-09-30T22:22:48.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.280+0000 7fc1f57fa700 1 -- 172.21.15.156:0/603995284 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec005a70 con 0x7fc1f8138040 2023-09-30T22:22:48.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.280+0000 7fc1fecd5700 1 -- 172.21.15.156:0/603995284 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f81390c0 con 0x7fc1f8138040 2023-09-30T22:22:48.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.280+0000 7fc1fecd5700 1 -- 172.21.15.156:0/603995284 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f813a4d0 con 0x7fc1f8138040 2023-09-30T22:22:48.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.281+0000 7fc1fecd5700 1 -- 172.21.15.156:0/603995284 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f804f2a0 con 0x7fc1f8138040 2023-09-30T22:22:48.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.281+0000 7fc1f57fa700 1 -- 172.21.15.156:0/603995284 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc1ec005bd0 con 0x7fc1f8138040 2023-09-30T22:22:48.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.282+0000 7fc1f57fa700 1 -- 172.21.15.156:0/603995284 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc1ec03eb60 con 0x7fc1f8138040 2023-09-30T22:22:48.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.287+0000 7fc1f57fa700 1 -- 172.21.15.156:0/603995284 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc1ec00f260 con 0x7fc1f8138040 2023-09-30T22:22:48.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.332+0000 7f19c1573700 1 Processor -- start 2023-09-30T22:22:48.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.332+0000 7f19c1573700 1 -- start start 2023-09-30T22:22:48.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.332+0000 7f19c1573700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f19bc09de70 0x7f19bc09e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:48.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.332+0000 7f19c1573700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f19bc09e780 0x7f19bc12cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:48.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.333+0000 7f19c1573700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f19bc12d290 0x7f19bc12d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:48.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.333+0000 7f19c1573700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19bc0a0050 con 0x7f19bc12d290 2023-09-30T22:22:48.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.333+0000 7f19c1573700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc09fdf0 con 0x7f19bc09e780 2023-09-30T22:22:48.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.333+0000 7f19c1573700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc06ffb0 con 0x7f19bc09de70 2023-09-30T22:22:48.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.333+0000 7f19bb7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f19bc12d290 0x7f19bc12d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:48.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.333+0000 7f19ba7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f19bc09e780 0x7f19bc12cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:48.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.333+0000 7f19bb7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f19bc12d290 0x7f19bc12d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44380/0 (socket says 172.21.15.156:44380) 2023-09-30T22:22:48.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.333+0000 7f19bb7fe700 1 -- 172.21.15.156:0/3412454359 learned_addr learned my addr 172.21.15.156:0/3412454359 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:48.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.333+0000 7f19baffd700 1 --2- 172.21.15.156:0/3412454359 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f19bc09de70 0x7f19bc09e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:48.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.333+0000 7f19ba7fc700 1 -- 172.21.15.156:0/3412454359 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f19bc09de70 msgr2=0x7f19bc09e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:48.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.333+0000 7f19ba7fc700 1 --2- 172.21.15.156:0/3412454359 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f19bc09de70 0x7f19bc09e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.333+0000 7f19ba7fc700 1 -- 172.21.15.156:0/3412454359 >> v2:172.21.15.156:3300/0 conn(0x7f19bc12d290 msgr2=0x7f19bc12d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:48.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.333+0000 7f19ba7fc700 1 --2- 172.21.15.156:0/3412454359 >> v2:172.21.15.156:3300/0 conn(0x7f19bc12d290 0x7f19bc12d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.333+0000 7f19ba7fc700 1 -- 172.21.15.156:0/3412454359 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19bc06b670 con 0x7f19bc09e780 2023-09-30T22:22:48.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.333+0000 7f19bb7fe700 1 --2- 172.21.15.156:0/3412454359 >> v2:172.21.15.156:3300/0 conn(0x7f19bc12d290 0x7f19bc12d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:48.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.333+0000 7f19ba7fc700 1 --2- 172.21.15.156:0/3412454359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f19bc09e780 0x7f19bc12cd50 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f19b0009870 tx=0x7f19b0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf6a77bf7012ccb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:48.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.334+0000 7f19b9ffb700 1 -- 172.21.15.156:0/3412454359 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b0011830 con 0x7f19bc09e780 2023-09-30T22:22:48.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.334+0000 7f19b9ffb700 1 -- 172.21.15.156:0/3412454359 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b0011990 con 0x7f19bc09e780 2023-09-30T22:22:48.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.334+0000 7f19b9ffb700 1 -- 172.21.15.156:0/3412454359 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b0011d20 con 0x7f19bc09e780 2023-09-30T22:22:48.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.335+0000 7f19c1573700 1 -- 172.21.15.156:0/3412454359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f19bc09e780 msgr2=0x7f19bc12cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:48.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.335+0000 7f19c1573700 1 --2- 172.21.15.156:0/3412454359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f19bc09e780 0x7f19bc12cd50 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f19b0009870 tx=0x7f19b0009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:48.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.335+0000 7f19c1573700 1 -- 172.21.15.156:0/3412454359 shutdown_connections 2023-09-30T22:22:48.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.335+0000 7f19c1573700 1 --2- 172.21.15.156:0/3412454359 >> v2:172.21.15.156:3300/0 conn(0x7f19bc12d290 0x7f19bc12d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.335+0000 7f19c1573700 1 --2- 172.21.15.156:0/3412454359 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f19bc09de70 0x7f19bc09e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.335+0000 7f19c1573700 1 --2- 172.21.15.156:0/3412454359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f19bc09e780 0x7f19bc12cd50 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.335+0000 7f19c1573700 1 -- 172.21.15.156:0/3412454359 >> 172.21.15.156:0/3412454359 conn(0x7f19bc0a27a0 msgr2=0x7f19bc0a2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:48.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.335+0000 7f19c1573700 1 -- 172.21.15.156:0/3412454359 shutdown_connections 2023-09-30T22:22:48.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.335+0000 7f19c1573700 1 -- 172.21.15.156:0/3412454359 wait complete. 2023-09-30T22:22:48.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.336+0000 7f19c1573700 1 Processor -- start 2023-09-30T22:22:48.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.336+0000 7f19c1573700 1 -- start start 2023-09-30T22:22:48.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.337+0000 7f19c1573700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f19bc09de70 0x7f19bc11b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:48.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.337+0000 7f19c1573700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f19bc09e780 0x7f19bc11bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:48.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.337+0000 7f19c1573700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f19bc12d290 0x7f19bc11c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:48.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.337+0000 7f19c1573700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc11e520 con 0x7f19bc09de70 2023-09-30T22:22:48.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.337+0000 7f19c1573700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc11d450 con 0x7f19bc09e780 2023-09-30T22:22:48.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.337+0000 7f19c1573700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc11e160 con 0x7f19bc12d290 2023-09-30T22:22:48.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.337+0000 7f19ba7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f19bc09e780 0x7f19bc11bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:48.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.337+0000 7f19ba7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f19bc09e780 0x7f19bc11bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:56996/0 (socket says 172.21.15.156:56996) 2023-09-30T22:22:48.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.337+0000 7f19ba7fc700 1 -- 172.21.15.156:0/2975594785 learned_addr learned my addr 172.21.15.156:0/2975594785 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:48.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.337+0000 7f19bb7fe700 1 --2- 172.21.15.156:0/2975594785 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f19bc12d290 0x7f19bc11c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:48.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.337+0000 7f19baffd700 1 --2- 172.21.15.156:0/2975594785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f19bc09de70 0x7f19bc11b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:48.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.338+0000 7f19ba7fc700 1 -- 172.21.15.156:0/2975594785 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f19bc12d290 msgr2=0x7f19bc11c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:48.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.338+0000 7f19ba7fc700 1 --2- 172.21.15.156:0/2975594785 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f19bc12d290 0x7f19bc11c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.338+0000 7f19ba7fc700 1 -- 172.21.15.156:0/2975594785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f19bc09de70 msgr2=0x7f19bc11b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:48.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.338+0000 7f19ba7fc700 1 --2- 172.21.15.156:0/2975594785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f19bc09de70 0x7f19bc11b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.338+0000 7f19ba7fc700 1 -- 172.21.15.156:0/2975594785 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b4009b30 con 0x7f19bc09e780 2023-09-30T22:22:48.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.338+0000 7f19bb7fe700 1 --2- 172.21.15.156:0/2975594785 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f19bc12d290 0x7f19bc11c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:48.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.338+0000 7f19ba7fc700 1 --2- 172.21.15.156:0/2975594785 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f19bc09e780 0x7f19bc11bc00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f19b00090b0 tx=0x7f19b0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:48.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.338+0000 7f19a37fe700 1 -- 172.21.15.156:0/2975594785 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b0004450 con 0x7f19bc09e780 2023-09-30T22:22:48.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.338+0000 7f19a37fe700 1 -- 172.21.15.156:0/2975594785 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b0027070 con 0x7f19bc09e780 2023-09-30T22:22:48.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.338+0000 7f19c1573700 1 -- 172.21.15.156:0/2975594785 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b00094a0 con 0x7f19bc09e780 2023-09-30T22:22:48.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.338+0000 7f19a37fe700 1 -- 172.21.15.156:0/2975594785 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b00038c0 con 0x7f19bc09e780 2023-09-30T22:22:48.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.338+0000 7f19c1573700 1 -- 172.21.15.156:0/2975594785 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19bc11ec40 con 0x7f19bc09e780 2023-09-30T22:22:48.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.339+0000 7f19a37fe700 1 -- 172.21.15.156:0/2975594785 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f19b0003a20 con 0x7f19bc09e780 2023-09-30T22:22:48.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.339+0000 7f19c1573700 1 -- 172.21.15.156:0/2975594785 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19bc04f2a0 con 0x7f19bc09e780 2023-09-30T22:22:48.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.340+0000 7f19a37fe700 1 -- 172.21.15.156:0/2975594785 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f19b0029070 con 0x7f19bc09e780 2023-09-30T22:22:48.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.349+0000 7f19a37fe700 1 -- 172.21.15.156:0/2975594785 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f19b00045b0 con 0x7f19bc09e780 2023-09-30T22:22:48.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.439+0000 7f13aa861700 1 -- 172.21.15.156:0/2962688705 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f13a4121cf0 con 0x7f13a409d860 2023-09-30T22:22:48.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.439+0000 7f13a0ff9700 1 -- 172.21.15.156:0/2962688705 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1394017400 con 0x7f13a409d860 2023-09-30T22:22:48.439 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:48.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.441+0000 7f13aa861700 1 -- 172.21.15.156:0/2962688705 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13a409d860 msgr2=0x7f13a411e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:48.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.441+0000 7f13aa861700 1 --2- 172.21.15.156:0/2962688705 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13a409d860 0x7f13a411e5e0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f1394016000 tx=0x7f1394004750 comp rx=0 tx=0).stop 2023-09-30T22:22:48.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.441+0000 7f13aa861700 1 -- 172.21.15.156:0/2962688705 shutdown_connections 2023-09-30T22:22:48.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.441+0000 7f13aa861700 1 --2- 172.21.15.156:0/2962688705 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13a4130ce0 0x7f13a411f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.441+0000 7f13aa861700 1 --2- 172.21.15.156:0/2962688705 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13a409d860 0x7f13a411e5e0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.441+0000 7f13aa861700 1 --2- 172.21.15.156:0/2962688705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13a409e170 0x7f13a411eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.441+0000 7f13aa861700 1 -- 172.21.15.156:0/2962688705 >> 172.21.15.156:0/2962688705 conn(0x7f13a4099c40 msgr2=0x7f13a4070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:48.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.441+0000 7f13aa861700 1 -- 172.21.15.156:0/2962688705 shutdown_connections 2023-09-30T22:22:48.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.441+0000 7f13aa861700 1 -- 172.21.15.156:0/2962688705 wait complete. 2023-09-30T22:22:48.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:48.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.479+0000 7fcadff85700 1 -- 172.21.15.156:0/1359737030 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcad8130280 con 0x7fcad80a1340 2023-09-30T22:22:48.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.479+0000 7fcace7fc700 1 -- 172.21.15.156:0/1359737030 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcac8021020 con 0x7fcad80a1340 2023-09-30T22:22:48.479 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:48.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.481+0000 7fcadff85700 1 -- 172.21.15.156:0/1359737030 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcad80a1340 msgr2=0x7fcad811ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:48.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.481+0000 7fcadff85700 1 --2- 172.21.15.156:0/1359737030 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcad80a1340 0x7fcad811ad30 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fcac800e900 tx=0x7fcac800ec10 comp rx=0 tx=0).stop 2023-09-30T22:22:48.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.481+0000 7fcadff85700 1 -- 172.21.15.156:0/1359737030 shutdown_connections 2023-09-30T22:22:48.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.481+0000 7fcadff85700 1 --2- 172.21.15.156:0/1359737030 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcad81304a0 0x7fcad811b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.481+0000 7fcadff85700 1 --2- 172.21.15.156:0/1359737030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcad80a0a30 0x7fcad811a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.481+0000 7fcadff85700 1 --2- 172.21.15.156:0/1359737030 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcad80a1340 0x7fcad811ad30 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.481+0000 7fcadff85700 1 -- 172.21.15.156:0/1359737030 >> 172.21.15.156:0/1359737030 conn(0x7fcad80a2980 msgr2=0x7fcad809deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:48.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.481+0000 7fcadff85700 1 -- 172.21.15.156:0/1359737030 shutdown_connections 2023-09-30T22:22:48.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.481+0000 7fcadff85700 1 -- 172.21.15.156:0/1359737030 wait complete. 2023-09-30T22:22:48.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.483+0000 7fc1fecd5700 1 -- 172.21.15.156:0/603995284 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc1f8071d70 con 0x7fc1f8138040 2023-09-30T22:22:48.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.483+0000 7fc1f57fa700 1 -- 172.21.15.156:0/603995284 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc1ec017030 con 0x7fc1f8138040 2023-09-30T22:22:48.484 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:48.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.485+0000 7fc1fecd5700 1 -- 172.21.15.156:0/603995284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1f8138040 msgr2=0x7fc1f8126160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:48.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.485+0000 7fc1fecd5700 1 --2- 172.21.15.156:0/603995284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1f8138040 0x7fc1f8126160 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec00c490 tx=0x7fc1ec00c7a0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.485+0000 7fc1fecd5700 1 -- 172.21.15.156:0/603995284 shutdown_connections 2023-09-30T22:22:48.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.485+0000 7fc1fecd5700 1 --2- 172.21.15.156:0/603995284 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc1f813dd10 0x7fc1f80701a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.485+0000 7fc1fecd5700 1 --2- 172.21.15.156:0/603995284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1f8138040 0x7fc1f8126160 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.485+0000 7fc1fecd5700 1 --2- 172.21.15.156:0/603995284 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1f8138410 0x7fc1f81266a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.485+0000 7fc1fecd5700 1 -- 172.21.15.156:0/603995284 >> 172.21.15.156:0/603995284 conn(0x7fc1f80a2980 msgr2=0x7fc1f809d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:48.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.485+0000 7fc1fecd5700 1 -- 172.21.15.156:0/603995284 shutdown_connections 2023-09-30T22:22:48.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.485+0000 7fc1fecd5700 1 -- 172.21.15.156:0/603995284 wait complete. 2023-09-30T22:22:48.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:48.498 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:48.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.540+0000 7f19c1573700 1 -- 172.21.15.156:0/2975594785 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f19bc06b930 con 0x7f19bc09e780 2023-09-30T22:22:48.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.541+0000 7f19a37fe700 1 -- 172.21.15.156:0/2975594785 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f19b0015030 con 0x7f19bc09e780 2023-09-30T22:22:48.540 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:48.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.543+0000 7f19c1573700 1 -- 172.21.15.156:0/2975594785 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f19bc09e780 msgr2=0x7f19bc11bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:48.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.543+0000 7f19c1573700 1 --2- 172.21.15.156:0/2975594785 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f19bc09e780 0x7f19bc11bc00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f19b00090b0 tx=0x7f19b0004750 comp rx=0 tx=0).stop 2023-09-30T22:22:48.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.543+0000 7f19c1573700 1 -- 172.21.15.156:0/2975594785 shutdown_connections 2023-09-30T22:22:48.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.543+0000 7f19c1573700 1 --2- 172.21.15.156:0/2975594785 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f19bc12d290 0x7f19bc11c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.543+0000 7f19c1573700 1 --2- 172.21.15.156:0/2975594785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f19bc09de70 0x7f19bc11b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.543+0000 7f19c1573700 1 --2- 172.21.15.156:0/2975594785 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f19bc09e780 0x7f19bc11bc00 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.543+0000 7f19c1573700 1 -- 172.21.15.156:0/2975594785 >> 172.21.15.156:0/2975594785 conn(0x7f19bc0a27a0 msgr2=0x7f19bc0a1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:48.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.543+0000 7f19c1573700 1 -- 172.21.15.156:0/2975594785 shutdown_connections 2023-09-30T22:22:48.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:48.543+0000 7f19c1573700 1 -- 172.21.15.156:0/2975594785 wait complete. 2023-09-30T22:22:48.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:49.454 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:49.495 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:49.498 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:49.555 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:49.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.586+0000 7f8f012c5700 1 Processor -- start 2023-09-30T22:22:49.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.586+0000 7f8f012c5700 1 -- start start 2023-09-30T22:22:49.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.586+0000 7f8f012c5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8efc133660 0x7f8efc135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.586+0000 7f8f012c5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8efc135f80 0x7f8efc138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.586+0000 7f8f012c5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8efc099a60 con 0x7f8efc099e20 2023-09-30T22:22:49.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.586+0000 7f8f012c5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc09bf50 con 0x7f8efc133660 2023-09-30T22:22:49.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.586+0000 7f8f012c5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc09b230 con 0x7f8efc135f80 2023-09-30T22:22:49.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.587+0000 7f8efaffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f8efc099e20 0x7f8efc09a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45694/0 (socket says 172.21.15.156:45694) 2023-09-30T22:22:49.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.587+0000 7f8efaffd700 1 -- 172.21.15.156:0/1144331169 learned_addr learned my addr 172.21.15.156:0/1144331169 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:49.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.587+0000 7f8efb7fe700 1 --2- 172.21.15.156:0/1144331169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8efc135f80 0x7f8efc138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.587+0000 7f8efa7fc700 1 --2- 172.21.15.156:0/1144331169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8efc133660 0x7f8efc135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.587+0000 7f8efb7fe700 1 -- 172.21.15.156:0/1144331169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8efc133660 msgr2=0x7f8efc135a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:49.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.587+0000 7f8efb7fe700 1 --2- 172.21.15.156:0/1144331169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8efc133660 0x7f8efc135a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.587+0000 7f8efb7fe700 1 -- 172.21.15.156:0/1144331169 >> v1:172.21.15.156:6789/0 conn(0x7f8efc099e20 legacy=0x7f8efc09a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:49.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.587+0000 7f8efb7fe700 1 -- 172.21.15.156:0/1144331169 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc09bb90 con 0x7f8efc135f80 2023-09-30T22:22:49.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.587+0000 7f8efa7fc700 1 --2- 172.21.15.156:0/1144331169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8efc133660 0x7f8efc135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:49.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.587+0000 7f8efb7fe700 1 --2- 172.21.15.156:0/1144331169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8efc135f80 0x7f8efc138360 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4009dc0 tx=0x7f8ef400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c94aa4ee61fd1768 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:49.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.587+0000 7f8ef9ffb700 1 -- 172.21.15.156:0/1144331169 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef400e070 con 0x7f8efc135f80 2023-09-30T22:22:49.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.588+0000 7f8ef9ffb700 1 -- 172.21.15.156:0/1144331169 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef400bae0 con 0x7f8efc135f80 2023-09-30T22:22:49.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.588+0000 7f8ef9ffb700 1 -- 172.21.15.156:0/1144331169 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef400be90 con 0x7f8efc135f80 2023-09-30T22:22:49.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.588+0000 7f8f012c5700 1 -- 172.21.15.156:0/1144331169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8efc135f80 msgr2=0x7f8efc138360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.588+0000 7f8f012c5700 1 --2- 172.21.15.156:0/1144331169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8efc135f80 0x7f8efc138360 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4009dc0 tx=0x7f8ef400b330 comp rx=0 tx=0).stop 2023-09-30T22:22:49.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.588+0000 7f8f012c5700 1 -- 172.21.15.156:0/1144331169 shutdown_connections 2023-09-30T22:22:49.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.588+0000 7f8f012c5700 1 --2- 172.21.15.156:0/1144331169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8efc135f80 0x7f8efc138360 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.588+0000 7f8f012c5700 1 --2- 172.21.15.156:0/1144331169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8efc133660 0x7f8efc135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.588+0000 7f8f012c5700 1 -- 172.21.15.156:0/1144331169 >> 172.21.15.156:0/1144331169 conn(0x7f8efc0a2980 msgr2=0x7f8efc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:49.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.588+0000 7f8f012c5700 1 -- 172.21.15.156:0/1144331169 shutdown_connections 2023-09-30T22:22:49.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.588+0000 7f8f012c5700 1 -- 172.21.15.156:0/1144331169 wait complete. 2023-09-30T22:22:49.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.589+0000 7f8f012c5700 1 Processor -- start 2023-09-30T22:22:49.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.589+0000 7f8f012c5700 1 -- start start 2023-09-30T22:22:49.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.590+0000 7f8f012c5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8efc099e20 0x7f8efc070170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.590+0000 7f8f012c5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8efc133660 0x7f8efc0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.590+0000 7f8f012c5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8efc135f80 0x7f8efc070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.590+0000 7f8f012c5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc11a630 con 0x7f8efc099e20 2023-09-30T22:22:49.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.590+0000 7f8f012c5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc071d30 con 0x7f8efc135f80 2023-09-30T22:22:49.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.590+0000 7f8f012c5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc09b470 con 0x7f8efc133660 2023-09-30T22:22:49.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.590+0000 7f8efaffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8efc099e20 0x7f8efc070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.590+0000 7f8efaffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8efc099e20 0x7f8efc070170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44384/0 (socket says 172.21.15.156:44384) 2023-09-30T22:22:49.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.590+0000 7f8efaffd700 1 -- 172.21.15.156:0/153737311 learned_addr learned my addr 172.21.15.156:0/153737311 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:49.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.590+0000 7f8efb7fe700 1 --2- 172.21.15.156:0/153737311 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8efc135f80 0x7f8efc070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.590+0000 7f8efa7fc700 1 --2- 172.21.15.156:0/153737311 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8efc133660 0x7f8efc0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.590+0000 7f8efaffd700 1 -- 172.21.15.156:0/153737311 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8efc133660 msgr2=0x7f8efc0706b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.590+0000 7f8efaffd700 1 --2- 172.21.15.156:0/153737311 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8efc133660 0x7f8efc0706b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.590+0000 7f8efaffd700 1 -- 172.21.15.156:0/153737311 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8efc135f80 msgr2=0x7f8efc070bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.590+0000 7f8efaffd700 1 --2- 172.21.15.156:0/153737311 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8efc135f80 0x7f8efc070bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.591+0000 7f8efaffd700 1 -- 172.21.15.156:0/153737311 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef000dca0 con 0x7f8efc099e20 2023-09-30T22:22:49.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.591+0000 7f8efb7fe700 1 --2- 172.21.15.156:0/153737311 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8efc135f80 0x7f8efc070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:49.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.591+0000 7f8efaffd700 1 --2- 172.21.15.156:0/153737311 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8efc099e20 0x7f8efc070170 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00c520 tx=0x7f8eec00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:49.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.591+0000 7f8ee37fe700 1 -- 172.21.15.156:0/153737311 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec0074e0 con 0x7f8efc099e20 2023-09-30T22:22:49.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.591+0000 7f8ee37fe700 1 -- 172.21.15.156:0/153737311 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec007660 con 0x7f8efc099e20 2023-09-30T22:22:49.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.591+0000 7f8f012c5700 1 -- 172.21.15.156:0/153737311 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef4009a70 con 0x7f8efc099e20 2023-09-30T22:22:49.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.591+0000 7f8ee37fe700 1 -- 172.21.15.156:0/153737311 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec005a70 con 0x7f8efc099e20 2023-09-30T22:22:49.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.591+0000 7f8f012c5700 1 -- 172.21.15.156:0/153737311 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8efc1196d0 con 0x7f8efc099e20 2023-09-30T22:22:49.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.592+0000 7f8ee37fe700 1 -- 172.21.15.156:0/153737311 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8eec005bd0 con 0x7f8efc099e20 2023-09-30T22:22:49.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.592+0000 7f8f012c5700 1 -- 172.21.15.156:0/153737311 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8efc04f2a0 con 0x7f8efc099e20 2023-09-30T22:22:49.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.592+0000 7f8ee37fe700 1 -- 172.21.15.156:0/153737311 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8eec03eb00 con 0x7f8efc099e20 2023-09-30T22:22:49.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.597+0000 7f8ee37fe700 1 -- 172.21.15.156:0/153737311 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8eec019c50 con 0x7f8efc099e20 2023-09-30T22:22:49.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.632+0000 7f19417ed700 1 Processor -- start 2023-09-30T22:22:49.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.632+0000 7f19417ed700 1 -- start start 2023-09-30T22:22:49.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.633+0000 7f19417ed700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f193c09b400 0x7f193c09b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.633+0000 7f19417ed700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f193c13d940 0x7f193c13fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.633+0000 7f19417ed700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f193c0a0a70 con 0x7f193c09bd10 2023-09-30T22:22:49.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.633+0000 7f19417ed700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193c09b190 con 0x7f193c09b400 2023-09-30T22:22:49.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.633+0000 7f19417ed700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193c09a820 con 0x7f193c13d940 2023-09-30T22:22:49.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.633+0000 7f193b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f193c13d940 0x7f193c13fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.633+0000 7f193b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f193c13d940 0x7f193c13fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57006/0 (socket says 172.21.15.156:57006) 2023-09-30T22:22:49.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.633+0000 7f193b7fe700 1 -- 172.21.15.156:0/2639452069 learned_addr learned my addr 172.21.15.156:0/2639452069 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:49.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.633+0000 7f193affd700 1 --2- 172.21.15.156:0/2639452069 >> v2:172.21.15.156:3300/0 conn(0x7f193c09b400 0x7f193c09b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.633+0000 7f193b7fe700 1 -- 172.21.15.156:0/2639452069 >> v2:172.21.15.156:3300/0 conn(0x7f193c09b400 msgr2=0x7f193c09b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:49.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.633+0000 7f193b7fe700 1 --2- 172.21.15.156:0/2639452069 >> v2:172.21.15.156:3300/0 conn(0x7f193c09b400 0x7f193c09b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.633+0000 7f193b7fe700 1 -- 172.21.15.156:0/2639452069 >> v1:172.21.15.156:6789/0 conn(0x7f193c09bd10 legacy=0x7f193c13c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.633+0000 7f193b7fe700 1 -- 172.21.15.156:0/2639452069 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c09a280 con 0x7f193c13d940 2023-09-30T22:22:49.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.633+0000 7f193b7fe700 1 --2- 172.21.15.156:0/2639452069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f193c13d940 0x7f193c13fd20 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1934009e50 tx=0x7f193400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72083a892c56c3d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:49.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.634+0000 7f1939ffb700 1 -- 172.21.15.156:0/2639452069 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193400e070 con 0x7f193c13d940 2023-09-30T22:22:49.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.634+0000 7f1939ffb700 1 -- 172.21.15.156:0/2639452069 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193400b910 con 0x7f193c13d940 2023-09-30T22:22:49.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.634+0000 7f1939ffb700 1 -- 172.21.15.156:0/2639452069 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193400bcc0 con 0x7f193c13d940 2023-09-30T22:22:49.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.634+0000 7f19417ed700 1 -- 172.21.15.156:0/2639452069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f193c13d940 msgr2=0x7f193c13fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.634+0000 7f19417ed700 1 --2- 172.21.15.156:0/2639452069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f193c13d940 0x7f193c13fd20 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1934009e50 tx=0x7f193400b330 comp rx=0 tx=0).stop 2023-09-30T22:22:49.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.634+0000 7f19417ed700 1 -- 172.21.15.156:0/2639452069 shutdown_connections 2023-09-30T22:22:49.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.634+0000 7f19417ed700 1 --2- 172.21.15.156:0/2639452069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f193c13d940 0x7f193c13fd20 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.634+0000 7f19417ed700 1 --2- 172.21.15.156:0/2639452069 >> v2:172.21.15.156:3300/0 conn(0x7f193c09b400 0x7f193c09b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.634+0000 7f19417ed700 1 -- 172.21.15.156:0/2639452069 >> 172.21.15.156:0/2639452069 conn(0x7f193c099c40 msgr2=0x7f193c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:49.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.635+0000 7f19417ed700 1 -- 172.21.15.156:0/2639452069 shutdown_connections 2023-09-30T22:22:49.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.635+0000 7f19417ed700 1 -- 172.21.15.156:0/2639452069 wait complete. 2023-09-30T22:22:49.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.636+0000 7f19417ed700 1 Processor -- start 2023-09-30T22:22:49.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.636+0000 7f19417ed700 1 -- start start 2023-09-30T22:22:49.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.637+0000 7f19417ed700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f193c09b400 0x7f193c125190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.637+0000 7f19417ed700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f193c09bd10 0x7f193c1256d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.637+0000 7f19417ed700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f193c13d940 0x7f193c125c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.637+0000 7f19417ed700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c126e60 con 0x7f193c13d940 2023-09-30T22:22:49.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.637+0000 7f19417ed700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193c09d360 con 0x7f193c09b400 2023-09-30T22:22:49.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.637+0000 7f19417ed700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f193c09c630 con 0x7f193c09bd10 2023-09-30T22:22:49.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.637+0000 7f193a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f193c09bd10 0x7f193c1256d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.637+0000 7f193a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f193c09bd10 0x7f193c1256d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51994/0 (socket says 172.21.15.156:51994) 2023-09-30T22:22:49.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.637+0000 7f193a7fc700 1 -- 172.21.15.156:0/1606910707 learned_addr learned my addr 172.21.15.156:0/1606910707 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:49.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.637+0000 7f193affd700 1 --2- 172.21.15.156:0/1606910707 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f193c09b400 0x7f193c125190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.637+0000 7f193b7fe700 1 --2- 172.21.15.156:0/1606910707 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f193c13d940 0x7f193c125c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.637+0000 7f193a7fc700 1 -- 172.21.15.156:0/1606910707 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f193c09b400 msgr2=0x7f193c125190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.637+0000 7f193a7fc700 1 --2- 172.21.15.156:0/1606910707 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f193c09b400 0x7f193c125190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.637+0000 7f193a7fc700 1 -- 172.21.15.156:0/1606910707 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f193c13d940 msgr2=0x7f193c125c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.637+0000 7f193a7fc700 1 --2- 172.21.15.156:0/1606910707 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f193c13d940 0x7f193c125c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.637+0000 7f193a7fc700 1 -- 172.21.15.156:0/1606910707 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1934009b30 con 0x7f193c09bd10 2023-09-30T22:22:49.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.638+0000 7f193a7fc700 1 --2- 172.21.15.156:0/1606910707 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f193c09bd10 0x7f193c1256d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f193000c4e0 tx=0x7f193000c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:49.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.638+0000 7f19237fe700 1 -- 172.21.15.156:0/1606910707 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19300052d0 con 0x7f193c09bd10 2023-09-30T22:22:49.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.638+0000 7f19237fe700 1 -- 172.21.15.156:0/1606910707 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1930005430 con 0x7f193c09bd10 2023-09-30T22:22:49.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.638+0000 7f19417ed700 1 -- 172.21.15.156:0/1606910707 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f193c127510 con 0x7f193c09bd10 2023-09-30T22:22:49.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.638+0000 7f19237fe700 1 -- 172.21.15.156:0/1606910707 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19300038c0 con 0x7f193c09bd10 2023-09-30T22:22:49.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.638+0000 7f19417ed700 1 -- 172.21.15.156:0/1606910707 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193c128c60 con 0x7f193c09bd10 2023-09-30T22:22:49.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.639+0000 7f19237fe700 1 -- 172.21.15.156:0/1606910707 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1930003a20 con 0x7f193c09bd10 2023-09-30T22:22:49.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.639+0000 7f19417ed700 1 -- 172.21.15.156:0/1606910707 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193c04f2a0 con 0x7f193c09bd10 2023-09-30T22:22:49.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.639+0000 7f19237fe700 1 -- 172.21.15.156:0/1606910707 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f193003eba0 con 0x7f193c09bd10 2023-09-30T22:22:49.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.640+0000 7f3eb10e1700 1 Processor -- start 2023-09-30T22:22:49.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.640+0000 7f3eb10e1700 1 -- start start 2023-09-30T22:22:49.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.641+0000 7f3eb10e1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3eac06a770 0x7f3eac1349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.641+0000 7f3eb10e1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3eac134f00 0x7f3eac09d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.641+0000 7f3eb10e1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3eac09dea0 0x7f3eac09e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.641+0000 7f3eb10e1700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eac06b2e0 con 0x7f3eac134f00 2023-09-30T22:22:49.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.641+0000 7f3eb10e1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac09eca0 con 0x7f3eac06a770 2023-09-30T22:22:49.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.641+0000 7f3eb10e1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac09f720 con 0x7f3eac09dea0 2023-09-30T22:22:49.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.641+0000 7f3eaa59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3eac134f00 0x7f3eac09d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.641+0000 7f3eaa59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3eac134f00 0x7f3eac09d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44400/0 (socket says 172.21.15.156:44400) 2023-09-30T22:22:49.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.641+0000 7f3eaa59c700 1 -- 172.21.15.156:0/1808225954 learned_addr learned my addr 172.21.15.156:0/1808225954 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:49.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.641+0000 7f3eab59e700 1 --2- 172.21.15.156:0/1808225954 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3eac09dea0 0x7f3eac09e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.641+0000 7f3eaad9d700 1 --2- 172.21.15.156:0/1808225954 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3eac06a770 0x7f3eac1349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.641+0000 7f3eaa59c700 1 -- 172.21.15.156:0/1808225954 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3eac09dea0 msgr2=0x7f3eac09e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:49.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.641+0000 7f3eaa59c700 1 --2- 172.21.15.156:0/1808225954 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3eac09dea0 0x7f3eac09e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.641+0000 7f3eaa59c700 1 -- 172.21.15.156:0/1808225954 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3eac06a770 msgr2=0x7f3eac1349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:49.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.641+0000 7f3eaa59c700 1 --2- 172.21.15.156:0/1808225954 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3eac06a770 0x7f3eac1349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.641+0000 7f3eaa59c700 1 -- 172.21.15.156:0/1808225954 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac06b480 con 0x7f3eac134f00 2023-09-30T22:22:49.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.642+0000 7f3eaa59c700 1 --2- 172.21.15.156:0/1808225954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3eac134f00 0x7f3eac09d960 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f3ea00098f0 tx=0x7f3ea0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=959755842e83eaca server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:49.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.642+0000 7f3ea9d9b700 1 -- 172.21.15.156:0/1808225954 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea0011830 con 0x7f3eac134f00 2023-09-30T22:22:49.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.642+0000 7f3ea9d9b700 1 -- 172.21.15.156:0/1808225954 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea0011990 con 0x7f3eac134f00 2023-09-30T22:22:49.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.642+0000 7f3ea9d9b700 1 -- 172.21.15.156:0/1808225954 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea0011d20 con 0x7f3eac134f00 2023-09-30T22:22:49.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.642+0000 7f3eb10e1700 1 -- 172.21.15.156:0/1808225954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3eac134f00 msgr2=0x7f3eac09d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.642+0000 7f3eb10e1700 1 --2- 172.21.15.156:0/1808225954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3eac134f00 0x7f3eac09d960 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f3ea00098f0 tx=0x7f3ea0009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:49.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.643+0000 7f3eb10e1700 1 -- 172.21.15.156:0/1808225954 shutdown_connections 2023-09-30T22:22:49.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.643+0000 7f3eb10e1700 1 --2- 172.21.15.156:0/1808225954 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3eac09dea0 0x7f3eac09e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.643+0000 7f3eb10e1700 1 --2- 172.21.15.156:0/1808225954 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3eac06a770 0x7f3eac1349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.643+0000 7f3eb10e1700 1 --2- 172.21.15.156:0/1808225954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3eac134f00 0x7f3eac09d960 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.643+0000 7f3eb10e1700 1 -- 172.21.15.156:0/1808225954 >> 172.21.15.156:0/1808225954 conn(0x7f3eac099c40 msgr2=0x7f3eac0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:49.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.643+0000 7f3eb10e1700 1 -- 172.21.15.156:0/1808225954 shutdown_connections 2023-09-30T22:22:49.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.643+0000 7f3eb10e1700 1 -- 172.21.15.156:0/1808225954 wait complete. 2023-09-30T22:22:49.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.644+0000 7f3eb10e1700 1 Processor -- start 2023-09-30T22:22:49.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.644+0000 7f3eb10e1700 1 -- start start 2023-09-30T22:22:49.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.644+0000 7f3eb10e1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3eac06a770 0x7f3eac11a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.644+0000 7f3eb10e1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3eac09dea0 0x7f3eac11ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.644+0000 7f3eb10e1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3eac134f00 0x7f3eac11b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.644+0000 7f3eb10e1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac139720 con 0x7f3eac09dea0 2023-09-30T22:22:49.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.644+0000 7f3eb10e1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac11bb20 con 0x7f3eac06a770 2023-09-30T22:22:49.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.644+0000 7f3eb10e1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac138f90 con 0x7f3eac134f00 2023-09-30T22:22:49.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.645+0000 7f3eaad9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3eac06a770 0x7f3eac11a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.645+0000 7f3eaad9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3eac06a770 0x7f3eac11a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57028/0 (socket says 172.21.15.156:57028) 2023-09-30T22:22:49.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.645+0000 7f3eaad9d700 1 -- 172.21.15.156:0/2758129386 learned_addr learned my addr 172.21.15.156:0/2758129386 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:49.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.645+0000 7f3eaa59c700 1 --2- 172.21.15.156:0/2758129386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3eac09dea0 0x7f3eac11ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.645+0000 7f3eab59e700 1 --2- 172.21.15.156:0/2758129386 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3eac134f00 0x7f3eac11b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.645+0000 7f3eaad9d700 1 -- 172.21.15.156:0/2758129386 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3eac134f00 msgr2=0x7f3eac11b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.645+0000 7f3eaad9d700 1 --2- 172.21.15.156:0/2758129386 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3eac134f00 0x7f3eac11b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.645+0000 7f3eaad9d700 1 -- 172.21.15.156:0/2758129386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3eac09dea0 msgr2=0x7f3eac11ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.645+0000 7f3eaad9d700 1 --2- 172.21.15.156:0/2758129386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3eac09dea0 0x7f3eac11ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.645+0000 7f3eaad9d700 1 -- 172.21.15.156:0/2758129386 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea0009550 con 0x7f3eac06a770 2023-09-30T22:22:49.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.645+0000 7f3eaa59c700 1 --2- 172.21.15.156:0/2758129386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3eac09dea0 0x7f3eac11ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:49.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.645+0000 7f3eaad9d700 1 --2- 172.21.15.156:0/2758129386 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3eac06a770 0x7f3eac11a6c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00e8a0 tx=0x7f3e9c00ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:49.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.645+0000 7f3e937fe700 1 -- 172.21.15.156:0/2758129386 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c009590 con 0x7f3eac06a770 2023-09-30T22:22:49.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.646+0000 7f3e937fe700 1 -- 172.21.15.156:0/2758129386 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9c013680 con 0x7f3eac06a770 2023-09-30T22:22:49.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.646+0000 7f3eb10e1700 1 -- 172.21.15.156:0/2758129386 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eac1341b0 con 0x7f3eac06a770 2023-09-30T22:22:49.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.646+0000 7f3e937fe700 1 -- 172.21.15.156:0/2758129386 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c0139f0 con 0x7f3eac06a770 2023-09-30T22:22:49.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.646+0000 7f3eb10e1700 1 -- 172.21.15.156:0/2758129386 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eac09f220 con 0x7f3eac06a770 2023-09-30T22:22:49.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.646+0000 7f3eb10e1700 1 -- 172.21.15.156:0/2758129386 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eac04f2a0 con 0x7f3eac06a770 2023-09-30T22:22:49.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.647+0000 7f3e937fe700 1 -- 172.21.15.156:0/2758129386 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3e9c013b50 con 0x7f3eac06a770 2023-09-30T22:22:49.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.647+0000 7f3e937fe700 1 -- 172.21.15.156:0/2758129386 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3e9c01ac60 con 0x7f3eac06a770 2023-09-30T22:22:49.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.648+0000 7f19237fe700 1 -- 172.21.15.156:0/1606910707 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1930018260 con 0x7f193c09bd10 2023-09-30T22:22:49.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.651+0000 7f3e937fe700 1 -- 172.21.15.156:0/2758129386 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3e9c01be10 con 0x7f3eac06a770 2023-09-30T22:22:49.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.696+0000 7f8ae8346700 1 Processor -- start 2023-09-30T22:22:49.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.696+0000 7f8ae8346700 1 -- start start 2023-09-30T22:22:49.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.697+0000 7f8ae8346700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ae0131980 0x7f8ae0131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.697+0000 7f8ae8346700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8ae009c790 0x7f8ae0139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.697+0000 7f8ae8346700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae00a1640 con 0x7f8ae009bc70 2023-09-30T22:22:49.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.697+0000 7f8ae8346700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae006eb30 con 0x7f8ae009c790 2023-09-30T22:22:49.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.697+0000 7f8ae8346700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae00a22d0 con 0x7f8ae0131980 2023-09-30T22:22:49.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.697+0000 7f8ae60e2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ae0131980 0x7f8ae0131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.697+0000 7f8ae60e2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ae0131980 0x7f8ae0131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57044/0 (socket says 172.21.15.156:57044) 2023-09-30T22:22:49.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.697+0000 7f8ae60e2700 1 -- 172.21.15.156:0/2137176939 learned_addr learned my addr 172.21.15.156:0/2137176939 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:49.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.697+0000 7f8ae68e3700 1 --2- 172.21.15.156:0/2137176939 >> v2:172.21.15.156:3300/0 conn(0x7f8ae009c790 0x7f8ae0139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.698+0000 7f8ae60e2700 1 -- 172.21.15.156:0/2137176939 >> v2:172.21.15.156:3300/0 conn(0x7f8ae009c790 msgr2=0x7f8ae0139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:49.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.698+0000 7f8ae60e2700 1 --2- 172.21.15.156:0/2137176939 >> v2:172.21.15.156:3300/0 conn(0x7f8ae009c790 0x7f8ae0139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.698+0000 7f8ae60e2700 1 -- 172.21.15.156:0/2137176939 >> v1:172.21.15.156:6789/0 conn(0x7f8ae009bc70 legacy=0x7f8ae009c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.698+0000 7f8ae60e2700 1 -- 172.21.15.156:0/2137176939 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae0131550 con 0x7f8ae0131980 2023-09-30T22:22:49.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.698+0000 7f8ae60e2700 1 --2- 172.21.15.156:0/2137176939 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ae0131980 0x7f8ae0131d50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8adc006fd0 tx=0x7f8adc009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c857a82ac46e230 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:49.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.698+0000 7f8ae50e0700 1 -- 172.21.15.156:0/2137176939 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc005e30 con 0x7f8ae0131980 2023-09-30T22:22:49.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.698+0000 7f8ae50e0700 1 -- 172.21.15.156:0/2137176939 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8adc004030 con 0x7f8ae0131980 2023-09-30T22:22:49.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.698+0000 7f8ae50e0700 1 -- 172.21.15.156:0/2137176939 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0043e0 con 0x7f8ae0131980 2023-09-30T22:22:49.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.698+0000 7f8ae8346700 1 -- 172.21.15.156:0/2137176939 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ae0131980 msgr2=0x7f8ae0131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.698+0000 7f8ae8346700 1 --2- 172.21.15.156:0/2137176939 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ae0131980 0x7f8ae0131d50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8adc006fd0 tx=0x7f8adc009bd0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.699+0000 7f8ae8346700 1 -- 172.21.15.156:0/2137176939 shutdown_connections 2023-09-30T22:22:49.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.699+0000 7f8ae8346700 1 --2- 172.21.15.156:0/2137176939 >> v2:172.21.15.156:3300/0 conn(0x7f8ae009c790 0x7f8ae0139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.699+0000 7f8ae8346700 1 --2- 172.21.15.156:0/2137176939 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ae0131980 0x7f8ae0131d50 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.699+0000 7f8ae8346700 1 -- 172.21.15.156:0/2137176939 >> 172.21.15.156:0/2137176939 conn(0x7f8ae00a2980 msgr2=0x7f8ae00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:49.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.699+0000 7f8ae8346700 1 -- 172.21.15.156:0/2137176939 shutdown_connections 2023-09-30T22:22:49.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.699+0000 7f8ae8346700 1 -- 172.21.15.156:0/2137176939 wait complete. 2023-09-30T22:22:49.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.700+0000 7f8ae8346700 1 Processor -- start 2023-09-30T22:22:49.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.700+0000 7f8ae8346700 1 -- start start 2023-09-30T22:22:49.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.701+0000 7f8ae8346700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ae009bc70 0x7f8ae0099a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.701+0000 7f8ae8346700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ae009c790 0x7f8ae0099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.701+0000 7f8ae8346700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ae0131980 0x7f8ae009a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.701+0000 7f8ae8346700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae01235b0 con 0x7f8ae009c790 2023-09-30T22:22:49.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.701+0000 7f8ae8346700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae009aec0 con 0x7f8ae009bc70 2023-09-30T22:22:49.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.701+0000 7f8ae8346700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae0123790 con 0x7f8ae0131980 2023-09-30T22:22:49.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.701+0000 7f8ae60e2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ae009bc70 0x7f8ae0099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.701+0000 7f8ae58e1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ae009c790 0x7f8ae0099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.701+0000 7f8ae60e2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ae009bc70 0x7f8ae0099a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57048/0 (socket says 172.21.15.156:57048) 2023-09-30T22:22:49.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.701+0000 7f8ae60e2700 1 -- 172.21.15.156:0/626319230 learned_addr learned my addr 172.21.15.156:0/626319230 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:49.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.701+0000 7f8ae68e3700 1 --2- 172.21.15.156:0/626319230 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ae0131980 0x7f8ae009a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.701+0000 7f8ae58e1700 1 -- 172.21.15.156:0/626319230 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ae0131980 msgr2=0x7f8ae009a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.701+0000 7f8ae58e1700 1 --2- 172.21.15.156:0/626319230 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ae0131980 0x7f8ae009a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.701+0000 7f8ae58e1700 1 -- 172.21.15.156:0/626319230 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ae009bc70 msgr2=0x7f8ae0099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.701+0000 7f8ae58e1700 1 --2- 172.21.15.156:0/626319230 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ae009bc70 0x7f8ae0099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.701+0000 7f8ae58e1700 1 -- 172.21.15.156:0/626319230 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8adc009500 con 0x7f8ae009c790 2023-09-30T22:22:49.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.701+0000 7f8ae60e2700 1 --2- 172.21.15.156:0/626319230 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ae009bc70 0x7f8ae0099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:49.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.702+0000 7f8ae58e1700 1 --2- 172.21.15.156:0/626319230 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ae009c790 0x7f8ae0099fa0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0000f60 tx=0x7f8ad000c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:49.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.702+0000 7f8ad6ffd700 1 -- 172.21.15.156:0/626319230 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad00052d0 con 0x7f8ae009c790 2023-09-30T22:22:49.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.702+0000 7f8ad6ffd700 1 -- 172.21.15.156:0/626319230 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad0005430 con 0x7f8ae009c790 2023-09-30T22:22:49.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.702+0000 7f8ae8346700 1 -- 172.21.15.156:0/626319230 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae0130f50 con 0x7f8ae009c790 2023-09-30T22:22:49.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.702+0000 7f8ad6ffd700 1 -- 172.21.15.156:0/626319230 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad00038c0 con 0x7f8ae009c790 2023-09-30T22:22:49.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.702+0000 7f8ae8346700 1 -- 172.21.15.156:0/626319230 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae009b6f0 con 0x7f8ae009c790 2023-09-30T22:22:49.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.703+0000 7f8ae8346700 1 -- 172.21.15.156:0/626319230 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae004f2a0 con 0x7f8ae009c790 2023-09-30T22:22:49.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.703+0000 7f8ad6ffd700 1 -- 172.21.15.156:0/626319230 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ad0003a20 con 0x7f8ae009c790 2023-09-30T22:22:49.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.703+0000 7f8ad6ffd700 1 -- 172.21.15.156:0/626319230 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8ad003ea50 con 0x7f8ae009c790 2023-09-30T22:22:49.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.712+0000 7f8ad6ffd700 1 -- 172.21.15.156:0/626319230 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ad0018260 con 0x7f8ae009c790 2023-09-30T22:22:49.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.826+0000 7f8f012c5700 1 -- 172.21.15.156:0/153737311 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8efc11a770 con 0x7f8efc099e20 2023-09-30T22:22:49.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.826+0000 7f8ee37fe700 1 -- 172.21.15.156:0/153737311 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8eec019a70 con 0x7f8efc099e20 2023-09-30T22:22:49.826 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:49.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.829+0000 7f8f012c5700 1 -- 172.21.15.156:0/153737311 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8efc099e20 msgr2=0x7f8efc070170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.829+0000 7f8f012c5700 1 --2- 172.21.15.156:0/153737311 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8efc099e20 0x7f8efc070170 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00c520 tx=0x7f8eec00c830 comp rx=0 tx=0).stop 2023-09-30T22:22:49.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.829+0000 7f8f012c5700 1 -- 172.21.15.156:0/153737311 shutdown_connections 2023-09-30T22:22:49.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.829+0000 7f8f012c5700 1 --2- 172.21.15.156:0/153737311 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8efc135f80 0x7f8efc070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.829+0000 7f8f012c5700 1 --2- 172.21.15.156:0/153737311 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8efc099e20 0x7f8efc070170 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.829+0000 7f8f012c5700 1 --2- 172.21.15.156:0/153737311 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8efc133660 0x7f8efc0706b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.829+0000 7f8f012c5700 1 -- 172.21.15.156:0/153737311 >> 172.21.15.156:0/153737311 conn(0x7f8efc0a2980 msgr2=0x7f8efc1324e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:49.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.830+0000 7f8f012c5700 1 -- 172.21.15.156:0/153737311 shutdown_connections 2023-09-30T22:22:49.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.830+0000 7f8f012c5700 1 -- 172.21.15.156:0/153737311 wait complete. 2023-09-30T22:22:49.842 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:49.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.849+0000 7f19417ed700 1 -- 172.21.15.156:0/1606910707 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f193c128a40 con 0x7f193c09bd10 2023-09-30T22:22:49.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.849+0000 7f19237fe700 1 -- 172.21.15.156:0/1606910707 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1930017020 con 0x7f193c09bd10 2023-09-30T22:22:49.849 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:49.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.851+0000 7f19417ed700 1 -- 172.21.15.156:0/1606910707 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f193c09bd10 msgr2=0x7f193c1256d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.851+0000 7f19417ed700 1 --2- 172.21.15.156:0/1606910707 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f193c09bd10 0x7f193c1256d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f193000c4e0 tx=0x7f193000c7f0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.851+0000 7f19417ed700 1 -- 172.21.15.156:0/1606910707 shutdown_connections 2023-09-30T22:22:49.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.851+0000 7f19417ed700 1 --2- 172.21.15.156:0/1606910707 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f193c13d940 0x7f193c125c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.851+0000 7f19417ed700 1 --2- 172.21.15.156:0/1606910707 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f193c09b400 0x7f193c125190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.851+0000 7f19417ed700 1 --2- 172.21.15.156:0/1606910707 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f193c09bd10 0x7f193c1256d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.851+0000 7f19417ed700 1 -- 172.21.15.156:0/1606910707 >> 172.21.15.156:0/1606910707 conn(0x7f193c099c40 msgr2=0x7f193c09e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:49.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.851+0000 7f19417ed700 1 -- 172.21.15.156:0/1606910707 shutdown_connections 2023-09-30T22:22:49.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.851+0000 7f19417ed700 1 -- 172.21.15.156:0/1606910707 wait complete. 2023-09-30T22:22:49.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:49.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.865+0000 7f3eb10e1700 1 -- 172.21.15.156:0/2758129386 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3eac138be0 con 0x7f3eac06a770 2023-09-30T22:22:49.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.866+0000 7f3e937fe700 1 -- 172.21.15.156:0/2758129386 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3e9c017020 con 0x7f3eac06a770 2023-09-30T22:22:49.865 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:49.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.868+0000 7f3eb10e1700 1 -- 172.21.15.156:0/2758129386 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3eac06a770 msgr2=0x7f3eac11a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.868+0000 7f3eb10e1700 1 --2- 172.21.15.156:0/2758129386 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3eac06a770 0x7f3eac11a6c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00e8a0 tx=0x7f3e9c00ebb0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.868+0000 7f3eb10e1700 1 -- 172.21.15.156:0/2758129386 shutdown_connections 2023-09-30T22:22:49.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.868+0000 7f3eb10e1700 1 --2- 172.21.15.156:0/2758129386 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3eac134f00 0x7f3eac11b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.868+0000 7f3eb10e1700 1 --2- 172.21.15.156:0/2758129386 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3eac06a770 0x7f3eac11a6c0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.868+0000 7f3eb10e1700 1 --2- 172.21.15.156:0/2758129386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3eac09dea0 0x7f3eac11ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.868+0000 7f3eb10e1700 1 -- 172.21.15.156:0/2758129386 >> 172.21.15.156:0/2758129386 conn(0x7f3eac099c40 msgr2=0x7f3eac09c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:49.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.868+0000 7f3eb10e1700 1 -- 172.21.15.156:0/2758129386 shutdown_connections 2023-09-30T22:22:49.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.868+0000 7f3eb10e1700 1 -- 172.21.15.156:0/2758129386 wait complete. 2023-09-30T22:22:49.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:49.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.910+0000 7f8ae8346700 1 -- 172.21.15.156:0/626319230 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8ae0123410 con 0x7f8ae009c790 2023-09-30T22:22:49.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.911+0000 7f8ad6ffd700 1 -- 172.21.15.156:0/626319230 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ae0123410 con 0x7f8ae009c790 2023-09-30T22:22:49.911 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:49.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.913+0000 7f8ae8346700 1 -- 172.21.15.156:0/626319230 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ae009c790 msgr2=0x7f8ae0099fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.913+0000 7f8ae8346700 1 --2- 172.21.15.156:0/626319230 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ae009c790 0x7f8ae0099fa0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0000f60 tx=0x7f8ad000c730 comp rx=0 tx=0).stop 2023-09-30T22:22:49.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.913+0000 7f8ae8346700 1 -- 172.21.15.156:0/626319230 shutdown_connections 2023-09-30T22:22:49.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.913+0000 7f8ae8346700 1 --2- 172.21.15.156:0/626319230 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ae0131980 0x7f8ae009a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.913+0000 7f8ae8346700 1 --2- 172.21.15.156:0/626319230 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ae009bc70 0x7f8ae0099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.913+0000 7f8ae8346700 1 --2- 172.21.15.156:0/626319230 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ae009c790 0x7f8ae0099fa0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.913+0000 7f8ae8346700 1 -- 172.21.15.156:0/626319230 >> 172.21.15.156:0/626319230 conn(0x7f8ae00a2980 msgr2=0x7f8ae006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:49.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.913+0000 7f8ae8346700 1 -- 172.21.15.156:0/626319230 shutdown_connections 2023-09-30T22:22:49.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:49.913+0000 7f8ae8346700 1 -- 172.21.15.156:0/626319230 wait complete. 2023-09-30T22:22:49.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:50.845 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:50.864 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:50.880 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:50.925 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:50.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.988+0000 7f7672d14700 1 Processor -- start 2023-09-30T22:22:50.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.988+0000 7f7672d14700 1 -- start start 2023-09-30T22:22:50.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.988+0000 7f7672d14700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f766c0a0a30 0x7f766c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:50.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.988+0000 7f7672d14700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f766c0a1340 0x7f766c12ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:50.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.988+0000 7f7672d14700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f766c1304a0 0x7f766c130940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:50.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.988+0000 7f7672d14700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f766c0a1e70 con 0x7f766c0a1340 2023-09-30T22:22:50.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.988+0000 7f7672d14700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766c09a720 con 0x7f766c1304a0 2023-09-30T22:22:50.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.988+0000 7f7672d14700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f766c09b300 con 0x7f766c0a0a30 2023-09-30T22:22:50.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.989+0000 7f76712b1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f766c1304a0 0x7f766c130940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:50.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.989+0000 7f7670ab0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f766c0a0a30 0x7f766c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:50.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.989+0000 7f76712b1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f766c1304a0 0x7f766c130940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57054/0 (socket says 172.21.15.156:57054) 2023-09-30T22:22:50.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.989+0000 7f76712b1700 1 -- 172.21.15.156:0/1026154933 learned_addr learned my addr 172.21.15.156:0/1026154933 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:50.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.989+0000 7f766bfff700 1 --2- 172.21.15.156:0/1026154933 >> v2:172.21.15.156:3300/0 conn(0x7f766c0a1340 0x7f766c12ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:50.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.989+0000 7f766bfff700 1 -- 172.21.15.156:0/1026154933 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f766c0a0a30 msgr2=0x7f766c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:50.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.989+0000 7f766bfff700 1 --2- 172.21.15.156:0/1026154933 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f766c0a0a30 0x7f766c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.989+0000 7f766bfff700 1 -- 172.21.15.156:0/1026154933 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f766c1304a0 msgr2=0x7f766c130940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:50.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.989+0000 7f766bfff700 1 --2- 172.21.15.156:0/1026154933 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f766c1304a0 0x7f766c130940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.989+0000 7f766bfff700 1 -- 172.21.15.156:0/1026154933 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766c09abc0 con 0x7f766c0a1340 2023-09-30T22:22:50.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.989+0000 7f766bfff700 1 --2- 172.21.15.156:0/1026154933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f766c0a1340 0x7f766c12ff60 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f7658009840 tx=0x7f7658009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb61f513aabd95b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:50.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.990+0000 7f766b7fe700 1 -- 172.21.15.156:0/1026154933 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7658011830 con 0x7f766c0a1340 2023-09-30T22:22:50.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.990+0000 7f766b7fe700 1 -- 172.21.15.156:0/1026154933 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7658011990 con 0x7f766c0a1340 2023-09-30T22:22:50.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.990+0000 7f766b7fe700 1 -- 172.21.15.156:0/1026154933 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7658011d20 con 0x7f766c0a1340 2023-09-30T22:22:50.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.990+0000 7f7672d14700 1 -- 172.21.15.156:0/1026154933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f766c0a1340 msgr2=0x7f766c12ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:50.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.990+0000 7f7672d14700 1 --2- 172.21.15.156:0/1026154933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f766c0a1340 0x7f766c12ff60 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f7658009840 tx=0x7f7658009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:50.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.990+0000 7f7672d14700 1 -- 172.21.15.156:0/1026154933 shutdown_connections 2023-09-30T22:22:50.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.990+0000 7f7672d14700 1 --2- 172.21.15.156:0/1026154933 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f766c1304a0 0x7f766c130940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.990+0000 7f7672d14700 1 --2- 172.21.15.156:0/1026154933 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f766c0a0a30 0x7f766c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.990+0000 7f7672d14700 1 --2- 172.21.15.156:0/1026154933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f766c0a1340 0x7f766c12ff60 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.990+0000 7f7672d14700 1 -- 172.21.15.156:0/1026154933 >> 172.21.15.156:0/1026154933 conn(0x7f766c0a2980 msgr2=0x7f766c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:50.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.990+0000 7f7672d14700 1 -- 172.21.15.156:0/1026154933 shutdown_connections 2023-09-30T22:22:50.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.990+0000 7f7672d14700 1 -- 172.21.15.156:0/1026154933 wait complete. 2023-09-30T22:22:50.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.992+0000 7f7672d14700 1 Processor -- start 2023-09-30T22:22:50.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.992+0000 7f7672d14700 1 -- start start 2023-09-30T22:22:50.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.993+0000 7f7672d14700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f766c0a0a30 0x7f766c1c0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:50.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.993+0000 7f7672d14700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f766c0a1340 0x7f766c1c1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:50.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.993+0000 7f7672d14700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f766c1304a0 0x7f766c1c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:50.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.993+0000 7f7672d14700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766c11eaf0 con 0x7f766c0a1340 2023-09-30T22:22:50.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.993+0000 7f7672d14700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766c120b70 con 0x7f766c0a0a30 2023-09-30T22:22:50.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.993+0000 7f7672d14700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f766c1c17d0 con 0x7f766c1304a0 2023-09-30T22:22:50.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.993+0000 7f766bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f766c0a1340 0x7f766c1c1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:50.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.993+0000 7f766bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f766c0a1340 0x7f766c1c1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44460/0 (socket says 172.21.15.156:44460) 2023-09-30T22:22:50.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.993+0000 7f766bfff700 1 -- 172.21.15.156:0/2561976391 learned_addr learned my addr 172.21.15.156:0/2561976391 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:50.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.993+0000 7f76712b1700 1 --2- 172.21.15.156:0/2561976391 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f766c1304a0 0x7f766c1c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:50.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.993+0000 7f7670ab0700 1 --2- 172.21.15.156:0/2561976391 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f766c0a0a30 0x7f766c1c0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:50.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.993+0000 7f76712b1700 1 -- 172.21.15.156:0/2561976391 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f766c0a0a30 msgr2=0x7f766c1c0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:50.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.993+0000 7f76712b1700 1 --2- 172.21.15.156:0/2561976391 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f766c0a0a30 0x7f766c1c0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.993+0000 7f76712b1700 1 -- 172.21.15.156:0/2561976391 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f766c0a1340 msgr2=0x7f766c1c1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:50.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.993+0000 7f76712b1700 1 --2- 172.21.15.156:0/2561976391 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f766c0a1340 0x7f766c1c1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.993+0000 7f76712b1700 1 -- 172.21.15.156:0/2561976391 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76580094a0 con 0x7f766c1304a0 2023-09-30T22:22:50.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.994+0000 7f766bfff700 1 --2- 172.21.15.156:0/2561976391 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f766c0a1340 0x7f766c1c1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:50.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.994+0000 7f76712b1700 1 --2- 172.21.15.156:0/2561976391 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f766c1304a0 0x7f766c1c3d70 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7664012e70 tx=0x7f76640096f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:50.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.994+0000 7f76697fa700 1 -- 172.21.15.156:0/2561976391 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7664009dd0 con 0x7f766c1304a0 2023-09-30T22:22:50.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.994+0000 7f76697fa700 1 -- 172.21.15.156:0/2561976391 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766400a340 con 0x7f766c1304a0 2023-09-30T22:22:50.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.994+0000 7f76697fa700 1 -- 172.21.15.156:0/2561976391 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766401b680 con 0x7f766c1304a0 2023-09-30T22:22:50.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.994+0000 7f7672d14700 1 -- 172.21.15.156:0/2561976391 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f766c09ae60 con 0x7f766c1304a0 2023-09-30T22:22:50.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.994+0000 7f7672d14700 1 -- 172.21.15.156:0/2561976391 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f766c121110 con 0x7f766c1304a0 2023-09-30T22:22:50.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.995+0000 7f76697fa700 1 -- 172.21.15.156:0/2561976391 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f766401b7e0 con 0x7f766c1304a0 2023-09-30T22:22:50.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.995+0000 7f7672d14700 1 -- 172.21.15.156:0/2561976391 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f766c1204b0 con 0x7f766c1304a0 2023-09-30T22:22:50.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:50.995+0000 7f76697fa700 1 -- 172.21.15.156:0/2561976391 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f76640199e0 con 0x7f766c1304a0 2023-09-30T22:22:51.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.004+0000 7f76697fa700 1 -- 172.21.15.156:0/2561976391 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7664018d50 con 0x7f766c1304a0 2023-09-30T22:22:51.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.036+0000 7fe5ecb8d700 1 Processor -- start 2023-09-30T22:22:51.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.036+0000 7fe5ecb8d700 1 -- start start 2023-09-30T22:22:51.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.037+0000 7fe5ecb8d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5e80a1550 0x7fe5e8138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:51.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.037+0000 7fe5ecb8d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe5e8139200 0x7fe5e813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:51.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.037+0000 7fe5ecb8d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e809e9d0 con 0x7fe5e80a0a70 2023-09-30T22:22:51.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.037+0000 7fe5ecb8d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e809dc00 con 0x7fe5e8139200 2023-09-30T22:22:51.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.037+0000 7fe5ecb8d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e809dec0 con 0x7fe5e80a1550 2023-09-30T22:22:51.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.037+0000 7fe5e659c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe5e80a0a70 0x7fe5e80a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45720/0 (socket says 172.21.15.156:45720) 2023-09-30T22:22:51.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.037+0000 7fe5e659c700 1 -- 172.21.15.156:0/2172935861 learned_addr learned my addr 172.21.15.156:0/2172935861 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:51.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.037+0000 7fe5e6d9d700 1 --2- 172.21.15.156:0/2172935861 >> v2:172.21.15.156:3300/0 conn(0x7fe5e8139200 0x7fe5e813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:51.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.037+0000 7fe5e5d9b700 1 --2- 172.21.15.156:0/2172935861 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5e80a1550 0x7fe5e8138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:51.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.037+0000 7fe5e6d9d700 1 -- 172.21.15.156:0/2172935861 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5e80a1550 msgr2=0x7fe5e8138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:51.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.037+0000 7fe5e6d9d700 1 --2- 172.21.15.156:0/2172935861 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5e80a1550 0x7fe5e8138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.037+0000 7fe5e6d9d700 1 -- 172.21.15.156:0/2172935861 >> v1:172.21.15.156:6789/0 conn(0x7fe5e80a0a70 legacy=0x7fe5e80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:51.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.037+0000 7fe5e6d9d700 1 -- 172.21.15.156:0/2172935861 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e809e6a0 con 0x7fe5e8139200 2023-09-30T22:22:51.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.037+0000 7fe5e6d9d700 1 --2- 172.21.15.156:0/2172935861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5e8139200 0x7fe5e813b5e0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0009d90 tx=0x7fe5e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ab51d13c644ea2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:51.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.038+0000 7fe5e559a700 1 -- 172.21.15.156:0/2172935861 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e000e070 con 0x7fe5e8139200 2023-09-30T22:22:51.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.038+0000 7fe5e559a700 1 -- 172.21.15.156:0/2172935861 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e000bb20 con 0x7fe5e8139200 2023-09-30T22:22:51.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.038+0000 7fe5e559a700 1 -- 172.21.15.156:0/2172935861 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0012430 con 0x7fe5e8139200 2023-09-30T22:22:51.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.038+0000 7ff83887f700 1 Processor -- start 2023-09-30T22:22:51.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.038+0000 7ff83887f700 1 -- start start 2023-09-30T22:22:51.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.038+0000 7fe5ecb8d700 1 -- 172.21.15.156:0/2172935861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5e8139200 msgr2=0x7fe5e813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:51.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.038+0000 7fe5ecb8d700 1 --2- 172.21.15.156:0/2172935861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5e8139200 0x7fe5e813b5e0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0009d90 tx=0x7fe5e000b330 comp rx=0 tx=0).stop 2023-09-30T22:22:51.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.038+0000 7fe5ecb8d700 1 -- 172.21.15.156:0/2172935861 shutdown_connections 2023-09-30T22:22:51.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.038+0000 7fe5ecb8d700 1 --2- 172.21.15.156:0/2172935861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5e8139200 0x7fe5e813b5e0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.038+0000 7fe5ecb8d700 1 --2- 172.21.15.156:0/2172935861 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5e80a1550 0x7fe5e8138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.038+0000 7fe5ecb8d700 1 -- 172.21.15.156:0/2172935861 >> 172.21.15.156:0/2172935861 conn(0x7fe5e80a6610 msgr2=0x7fe5e80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:51.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.039+0000 7fe5ecb8d700 1 -- 172.21.15.156:0/2172935861 shutdown_connections 2023-09-30T22:22:51.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.039+0000 7fe5ecb8d700 1 -- 172.21.15.156:0/2172935861 wait complete. 2023-09-30T22:22:51.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.039+0000 7ff83887f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff834136ae0 0x7ff834138ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:51.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.039+0000 7ff83887f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff834139400 0x7ff83413b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:51.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.039+0000 7ff83887f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83409a8e0 con 0x7ff83409bd20 2023-09-30T22:22:51.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.039+0000 7ff83887f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83409ad30 con 0x7ff834139400 2023-09-30T22:22:51.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.039+0000 7ff83887f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff83409c800 con 0x7ff834136ae0 2023-09-30T22:22:51.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.039+0000 7ff83259c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff83409bd20 0x7ff83409c0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:45726/0 (socket says 172.21.15.156:45726) 2023-09-30T22:22:51.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.039+0000 7ff83259c700 1 -- 172.21.15.156:0/3638291109 learned_addr learned my addr 172.21.15.156:0/3638291109 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:51.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.039+0000 7ff831d9b700 1 --2- 172.21.15.156:0/3638291109 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff834136ae0 0x7ff834138ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:51.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.039+0000 7ff83159a700 1 -- 172.21.15.156:0/3638291109 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 152847535 0 0) 0x7ff83409a8e0 con 0x7ff83409bd20 2023-09-30T22:22:51.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.039+0000 7ff83159a700 1 -- 172.21.15.156:0/3638291109 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff81c0035b0 con 0x7ff83409bd20 2023-09-30T22:22:51.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.040+0000 7ff831d9b700 1 -- 172.21.15.156:0/3638291109 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff834139400 msgr2=0x7ff83413b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:51.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.040+0000 7ff831d9b700 1 --2- 172.21.15.156:0/3638291109 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff834139400 0x7ff83413b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.040+0000 7ff831d9b700 1 -- 172.21.15.156:0/3638291109 >> v1:172.21.15.156:6789/0 conn(0x7ff83409bd20 legacy=0x7ff83409c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:51.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.040+0000 7ff831d9b700 1 -- 172.21.15.156:0/3638291109 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83409a620 con 0x7ff834136ae0 2023-09-30T22:22:51.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.040+0000 7ff831d9b700 1 --2- 172.21.15.156:0/3638291109 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff834136ae0 0x7ff834138ec0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff828009870 tx=0x7ff828009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9aa07bd751c57cf2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:51.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.040+0000 7fe5ecb8d700 1 Processor -- start 2023-09-30T22:22:51.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.040+0000 7ff83159a700 1 -- 172.21.15.156:0/3638291109 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff828011830 con 0x7ff834136ae0 2023-09-30T22:22:51.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.040+0000 7ff83159a700 1 -- 172.21.15.156:0/3638291109 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff828011990 con 0x7ff834136ae0 2023-09-30T22:22:51.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.040+0000 7ff83159a700 1 -- 172.21.15.156:0/3638291109 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff828011d20 con 0x7ff834136ae0 2023-09-30T22:22:51.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.040+0000 7fe5ecb8d700 1 -- start start 2023-09-30T22:22:51.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.040+0000 7fe5ecb8d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5e80a0a70 0x7fe5e806da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:51.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.040+0000 7fe5ecb8d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5e80a1550 0x7fe5e806dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:51.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.040+0000 7fe5ecb8d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5e8139200 0x7fe5e806e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:51.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.040+0000 7fe5ecb8d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e8071060 con 0x7fe5e80a1550 2023-09-30T22:22:51.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.040+0000 7fe5ecb8d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e8071240 con 0x7fe5e8139200 2023-09-30T22:22:51.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.040+0000 7fe5ecb8d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e806fbc0 con 0x7fe5e80a0a70 2023-09-30T22:22:51.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.041+0000 7fe5e659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5e80a0a70 0x7fe5e806da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:51.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.041+0000 7fe5e659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5e80a0a70 0x7fe5e806da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52048/0 (socket says 172.21.15.156:52048) 2023-09-30T22:22:51.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.041+0000 7fe5e659c700 1 -- 172.21.15.156:0/2299546289 learned_addr learned my addr 172.21.15.156:0/2299546289 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:51.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.041+0000 7fe5e6d9d700 1 --2- 172.21.15.156:0/2299546289 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5e8139200 0x7fe5e806e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:51.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.041+0000 7ff83887f700 1 -- 172.21.15.156:0/3638291109 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff834136ae0 msgr2=0x7ff834138ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:51.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.041+0000 7ff83887f700 1 --2- 172.21.15.156:0/3638291109 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff834136ae0 0x7ff834138ec0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff828009870 tx=0x7ff828009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:51.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.041+0000 7fe5e659c700 1 -- 172.21.15.156:0/2299546289 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5e8139200 msgr2=0x7fe5e806e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:51.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.041+0000 7fe5e659c700 1 --2- 172.21.15.156:0/2299546289 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5e8139200 0x7fe5e806e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.041+0000 7fe5e659c700 1 -- 172.21.15.156:0/2299546289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5e80a1550 msgr2=0x7fe5e806dfd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:51.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.041+0000 7fe5e659c700 1 --2- 172.21.15.156:0/2299546289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5e80a1550 0x7fe5e806dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.041+0000 7fe5e659c700 1 -- 172.21.15.156:0/2299546289 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e0009a70 con 0x7fe5e80a0a70 2023-09-30T22:22:51.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.041+0000 7fe5e6d9d700 1 --2- 172.21.15.156:0/2299546289 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5e8139200 0x7fe5e806e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:51.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.041+0000 7ff83887f700 1 -- 172.21.15.156:0/3638291109 shutdown_connections 2023-09-30T22:22:51.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.041+0000 7ff83887f700 1 --2- 172.21.15.156:0/3638291109 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff834139400 0x7ff83413b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.041+0000 7ff83887f700 1 --2- 172.21.15.156:0/3638291109 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff834136ae0 0x7ff834138ec0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.041+0000 7ff83887f700 1 -- 172.21.15.156:0/3638291109 >> 172.21.15.156:0/3638291109 conn(0x7ff83409f9f0 msgr2=0x7ff83409fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:51.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.041+0000 7ff83887f700 1 -- 172.21.15.156:0/3638291109 shutdown_connections 2023-09-30T22:22:51.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.041+0000 7fe5e659c700 1 --2- 172.21.15.156:0/2299546289 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5e80a0a70 0x7fe5e806da90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe5d800c550 tx=0x7fe5d800c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:51.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.042+0000 7fe5d6ffd700 1 -- 172.21.15.156:0/2299546289 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d8005d70 con 0x7fe5e80a0a70 2023-09-30T22:22:51.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.042+0000 7fe5d6ffd700 1 -- 172.21.15.156:0/2299546289 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d80070d0 con 0x7fe5e80a0a70 2023-09-30T22:22:51.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.042+0000 7fe5d6ffd700 1 -- 172.21.15.156:0/2299546289 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d8007440 con 0x7fe5e80a0a70 2023-09-30T22:22:51.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.042+0000 7fe5ecb8d700 1 -- 172.21.15.156:0/2299546289 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e8071a20 con 0x7fe5e80a0a70 2023-09-30T22:22:51.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.042+0000 7fe5ecb8d700 1 -- 172.21.15.156:0/2299546289 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e806f680 con 0x7fe5e80a0a70 2023-09-30T22:22:51.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.043+0000 7fe5d6ffd700 1 -- 172.21.15.156:0/2299546289 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe5d80075a0 con 0x7fe5e80a0a70 2023-09-30T22:22:51.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.041+0000 7ff83887f700 1 -- 172.21.15.156:0/3638291109 wait complete. 2023-09-30T22:22:51.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.043+0000 7ff83887f700 1 Processor -- start 2023-09-30T22:22:51.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.043+0000 7fe5d6ffd700 1 -- 172.21.15.156:0/2299546289 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe5d803ea90 con 0x7fe5e80a0a70 2023-09-30T22:22:51.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.043+0000 7fe5ecb8d700 1 -- 172.21.15.156:0/2299546289 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5e8071380 con 0x7fe5e80a0a70 2023-09-30T22:22:51.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.043+0000 7ff83887f700 1 -- start start 2023-09-30T22:22:51.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.044+0000 7ff83887f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff83409bd20 0x7ff83412b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:51.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.044+0000 7ff83887f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff834136ae0 0x7ff83412bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:51.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.044+0000 7ff83887f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff834139400 0x7ff83412c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:51.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.044+0000 7ff83887f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83412ea60 con 0x7ff834136ae0 2023-09-30T22:22:51.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.044+0000 7ff83887f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83412cd90 con 0x7ff834139400 2023-09-30T22:22:51.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.044+0000 7ff83887f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff83412e700 con 0x7ff83409bd20 2023-09-30T22:22:51.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.044+0000 7ff83259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff83409bd20 0x7ff83412b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:51.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.044+0000 7ff83259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff83409bd20 0x7ff83412b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52064/0 (socket says 172.21.15.156:52064) 2023-09-30T22:22:51.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.044+0000 7ff83259c700 1 -- 172.21.15.156:0/2885383118 learned_addr learned my addr 172.21.15.156:0/2885383118 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:51.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.044+0000 7ff83259c700 1 -- 172.21.15.156:0/2885383118 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff834139400 msgr2=0x7ff83412c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:51.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.044+0000 7ff832d9d700 1 --2- 172.21.15.156:0/2885383118 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff834139400 0x7ff83412c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:51.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.044+0000 7ff83259c700 1 --2- 172.21.15.156:0/2885383118 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff834139400 0x7ff83412c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.044+0000 7ff83259c700 1 -- 172.21.15.156:0/2885383118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff834136ae0 msgr2=0x7ff83412bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:51.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.044+0000 7ff83259c700 1 --2- 172.21.15.156:0/2885383118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff834136ae0 0x7ff83412bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.044+0000 7ff83259c700 1 -- 172.21.15.156:0/2885383118 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8280094a0 con 0x7ff83409bd20 2023-09-30T22:22:51.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.044+0000 7ff832d9d700 1 --2- 172.21.15.156:0/2885383118 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff834139400 0x7ff83412c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:22:51.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.044+0000 7ff83259c700 1 --2- 172.21.15.156:0/2885383118 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff83409bd20 0x7ff83412b620 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff82400c700 tx=0x7ff82400cac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:51.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.048+0000 7ff822ffd700 1 -- 172.21.15.156:0/2885383118 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8240074e0 con 0x7ff83409bd20 2023-09-30T22:22:51.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.048+0000 7ff822ffd700 1 -- 172.21.15.156:0/2885383118 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff824007640 con 0x7ff83409bd20 2023-09-30T22:22:51.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.048+0000 7ff822ffd700 1 -- 172.21.15.156:0/2885383118 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff824005a50 con 0x7ff83409bd20 2023-09-30T22:22:51.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.048+0000 7ff83887f700 1 -- 172.21.15.156:0/2885383118 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83412d5f0 con 0x7ff83409bd20 2023-09-30T22:22:51.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.048+0000 7ff83887f700 1 -- 172.21.15.156:0/2885383118 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83409cc90 con 0x7ff83409bd20 2023-09-30T22:22:51.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.048+0000 7fe5d6ffd700 1 -- 172.21.15.156:0/2299546289 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe5e8071380 con 0x7fe5e80a0a70 2023-09-30T22:22:51.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.050+0000 7ff83887f700 1 -- 172.21.15.156:0/2885383118 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8340700c0 con 0x7ff83409bd20 2023-09-30T22:22:51.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.050+0000 7ff822ffd700 1 -- 172.21.15.156:0/2885383118 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff824005bb0 con 0x7ff83409bd20 2023-09-30T22:22:51.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.050+0000 7ff822ffd700 1 -- 172.21.15.156:0/2885383118 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff82403ecb0 con 0x7ff83409bd20 2023-09-30T22:22:51.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.059+0000 7ff822ffd700 1 -- 172.21.15.156:0/2885383118 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff82401b400 con 0x7ff83409bd20 2023-09-30T22:22:51.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.066+0000 7f6d44db7700 1 Processor -- start 2023-09-30T22:22:51.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.066+0000 7f6d44db7700 1 -- start start 2023-09-30T22:22:51.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.067+0000 7f6d44db7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6d4006a770 0x7f6d4006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:51.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.067+0000 7f6d44db7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d4009dec0 0x7f6d4006b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:51.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.067+0000 7f6d44db7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d40131a00 0x7f6d40131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:51.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.067+0000 7f6d44db7700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d4006b5c0 con 0x7f6d4006a770 2023-09-30T22:22:51.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.067+0000 7f6d44db7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4006e900 con 0x7f6d40131a00 2023-09-30T22:22:51.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.067+0000 7f6d44db7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4009d180 con 0x7f6d4009dec0 2023-09-30T22:22:51.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.067+0000 7f6d3e59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6d4006a770 0x7f6d4006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:51.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.067+0000 7f6d3e59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6d4006a770 0x7f6d4006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44504/0 (socket says 172.21.15.156:44504) 2023-09-30T22:22:51.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.067+0000 7f6d3e59c700 1 -- 172.21.15.156:0/4270849759 learned_addr learned my addr 172.21.15.156:0/4270849759 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:51.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.067+0000 7f6d3ed9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d40131a00 0x7f6d40131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:51.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.067+0000 7f6d3dd9b700 1 --2- 172.21.15.156:0/4270849759 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d4009dec0 0x7f6d4006b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:51.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.067+0000 7f6d3dd9b700 1 -- 172.21.15.156:0/4270849759 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d40131a00 msgr2=0x7f6d40131e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:51.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.067+0000 7f6d3dd9b700 1 --2- 172.21.15.156:0/4270849759 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d40131a00 0x7f6d40131e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.067+0000 7f6d3dd9b700 1 -- 172.21.15.156:0/4270849759 >> v2:172.21.15.156:3300/0 conn(0x7f6d4006a770 msgr2=0x7f6d4006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:51.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.067+0000 7f6d3dd9b700 1 --2- 172.21.15.156:0/4270849759 >> v2:172.21.15.156:3300/0 conn(0x7f6d4006a770 0x7f6d4006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.068+0000 7f6d3dd9b700 1 -- 172.21.15.156:0/4270849759 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4009e780 con 0x7f6d4009dec0 2023-09-30T22:22:51.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.068+0000 7f6d3ed9d700 1 --2- 172.21.15.156:0/4270849759 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d40131a00 0x7f6d40131e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:51.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.068+0000 7f6d3dd9b700 1 --2- 172.21.15.156:0/4270849759 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d4009dec0 0x7f6d4006b080 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6d34009840 tx=0x7f6d34009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c5667f0282be4ce server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:51.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.068+0000 7f6d3d59a700 1 -- 172.21.15.156:0/4270849759 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d34011830 con 0x7f6d4009dec0 2023-09-30T22:22:51.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.068+0000 7f6d3d59a700 1 -- 172.21.15.156:0/4270849759 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d34011990 con 0x7f6d4009dec0 2023-09-30T22:22:51.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.068+0000 7f6d3d59a700 1 -- 172.21.15.156:0/4270849759 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d34011d20 con 0x7f6d4009dec0 2023-09-30T22:22:51.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.069+0000 7f6d44db7700 1 -- 172.21.15.156:0/4270849759 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d4009dec0 msgr2=0x7f6d4006b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:51.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.069+0000 7f6d44db7700 1 --2- 172.21.15.156:0/4270849759 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d4009dec0 0x7f6d4006b080 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6d34009840 tx=0x7f6d34009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:51.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.069+0000 7f6d44db7700 1 -- 172.21.15.156:0/4270849759 shutdown_connections 2023-09-30T22:22:51.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.069+0000 7f6d44db7700 1 --2- 172.21.15.156:0/4270849759 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d40131a00 0x7f6d40131e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.069+0000 7f6d44db7700 1 --2- 172.21.15.156:0/4270849759 >> v2:172.21.15.156:3300/0 conn(0x7f6d4006a770 0x7f6d4006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.069+0000 7f6d44db7700 1 --2- 172.21.15.156:0/4270849759 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d4009dec0 0x7f6d4006b080 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.069+0000 7f6d44db7700 1 -- 172.21.15.156:0/4270849759 >> 172.21.15.156:0/4270849759 conn(0x7f6d40099c40 msgr2=0x7f6d400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:51.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.069+0000 7f6d44db7700 1 -- 172.21.15.156:0/4270849759 shutdown_connections 2023-09-30T22:22:51.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.069+0000 7f6d44db7700 1 -- 172.21.15.156:0/4270849759 wait complete. 2023-09-30T22:22:51.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.070+0000 7f6d44db7700 1 Processor -- start 2023-09-30T22:22:51.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.070+0000 7f6d44db7700 1 -- start start 2023-09-30T22:22:51.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.070+0000 7f6d44db7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d4006a770 0x7f6d40119f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:51.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.070+0000 7f6d44db7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d4009dec0 0x7f6d4011a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:51.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.070+0000 7f6d44db7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d40131a00 0x7f6d4011a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:51.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.070+0000 7f6d44db7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4011da90 con 0x7f6d4009dec0 2023-09-30T22:22:51.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.070+0000 7f6d44db7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4011e2d0 con 0x7f6d40131a00 2023-09-30T22:22:51.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.070+0000 7f6d44db7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4011ba00 con 0x7f6d4006a770 2023-09-30T22:22:51.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.070+0000 7f6d3e59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d4006a770 0x7f6d40119f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:51.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.070+0000 7f6d3ed9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d40131a00 0x7f6d4011a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:51.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.070+0000 7f6d3ed9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d40131a00 0x7f6d4011a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:57124/0 (socket says 172.21.15.156:57124) 2023-09-30T22:22:51.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.070+0000 7f6d3e59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d4006a770 0x7f6d40119f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52072/0 (socket says 172.21.15.156:52072) 2023-09-30T22:22:51.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.070+0000 7f6d3ed9d700 1 -- 172.21.15.156:0/2471608590 learned_addr learned my addr 172.21.15.156:0/2471608590 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:51.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.071+0000 7f6d3dd9b700 1 --2- 172.21.15.156:0/2471608590 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d4009dec0 0x7f6d4011a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:51.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.071+0000 7f6d3ed9d700 1 -- 172.21.15.156:0/2471608590 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d4006a770 msgr2=0x7f6d40119f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:51.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.071+0000 7f6d3ed9d700 1 --2- 172.21.15.156:0/2471608590 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d4006a770 0x7f6d40119f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.071+0000 7f6d3ed9d700 1 -- 172.21.15.156:0/2471608590 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d4009dec0 msgr2=0x7f6d4011a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:51.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.071+0000 7f6d3ed9d700 1 --2- 172.21.15.156:0/2471608590 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d4009dec0 0x7f6d4011a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.071+0000 7f6d3ed9d700 1 -- 172.21.15.156:0/2471608590 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3800f050 con 0x7f6d40131a00 2023-09-30T22:22:51.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.071+0000 7f6d3ed9d700 1 --2- 172.21.15.156:0/2471608590 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d40131a00 0x7f6d4011a9a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6d3800f530 tx=0x7f6d3800f840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:51.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.071+0000 7f6d2effd700 1 -- 172.21.15.156:0/2471608590 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d38012050 con 0x7f6d40131a00 2023-09-30T22:22:51.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.071+0000 7f6d2effd700 1 -- 172.21.15.156:0/2471608590 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d38013040 con 0x7f6d40131a00 2023-09-30T22:22:51.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.071+0000 7f6d2effd700 1 -- 172.21.15.156:0/2471608590 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d38003e60 con 0x7f6d40131a00 2023-09-30T22:22:51.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.072+0000 7f6d44db7700 1 -- 172.21.15.156:0/2471608590 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d340094a0 con 0x7f6d40131a00 2023-09-30T22:22:51.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.072+0000 7f6d44db7700 1 -- 172.21.15.156:0/2471608590 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d40071ce0 con 0x7f6d40131a00 2023-09-30T22:22:51.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.073+0000 7f6d2effd700 1 -- 172.21.15.156:0/2471608590 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6d38004030 con 0x7f6d40131a00 2023-09-30T22:22:51.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.073+0000 7f6d44db7700 1 -- 172.21.15.156:0/2471608590 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d4004f2a0 con 0x7f6d40131a00 2023-09-30T22:22:51.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.073+0000 7f6d2effd700 1 -- 172.21.15.156:0/2471608590 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6d380441d0 con 0x7f6d40131a00 2023-09-30T22:22:51.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.078+0000 7f6d2effd700 1 -- 172.21.15.156:0/2471608590 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6d38019410 con 0x7f6d40131a00 2023-09-30T22:22:51.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.203+0000 7f7672d14700 1 -- 172.21.15.156:0/2561976391 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f766c04f2a0 con 0x7f766c1304a0 2023-09-30T22:22:51.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.204+0000 7f76697fa700 1 -- 172.21.15.156:0/2561976391 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7664036020 con 0x7f766c1304a0 2023-09-30T22:22:51.204 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:51.206 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.206+0000 7f7672d14700 1 -- 172.21.15.156:0/2561976391 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f766c1304a0 msgr2=0x7f766c1c3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:51.206 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.206+0000 7f7672d14700 1 --2- 172.21.15.156:0/2561976391 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f766c1304a0 0x7f766c1c3d70 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7664012e70 tx=0x7f76640096f0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.206 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.206+0000 7f7672d14700 1 -- 172.21.15.156:0/2561976391 shutdown_connections 2023-09-30T22:22:51.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.206+0000 7f7672d14700 1 --2- 172.21.15.156:0/2561976391 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f766c1304a0 0x7f766c1c3d70 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.206+0000 7f7672d14700 1 --2- 172.21.15.156:0/2561976391 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f766c0a0a30 0x7f766c1c0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.206+0000 7f7672d14700 1 --2- 172.21.15.156:0/2561976391 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f766c0a1340 0x7f766c1c1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.206+0000 7f7672d14700 1 -- 172.21.15.156:0/2561976391 >> 172.21.15.156:0/2561976391 conn(0x7f766c0a2980 msgr2=0x7f766c12f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:51.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.206+0000 7f7672d14700 1 -- 172.21.15.156:0/2561976391 shutdown_connections 2023-09-30T22:22:51.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.206+0000 7f7672d14700 1 -- 172.21.15.156:0/2561976391 wait complete. 2023-09-30T22:22:51.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:51.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.264+0000 7fe5ecb8d700 1 -- 172.21.15.156:0/2299546289 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe5e8071380 con 0x7fe5e80a0a70 2023-09-30T22:22:51.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.264+0000 7fe5d6ffd700 1 -- 172.21.15.156:0/2299546289 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe5e8071380 con 0x7fe5e80a0a70 2023-09-30T22:22:51.265 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:51.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.267+0000 7fe5ecb8d700 1 -- 172.21.15.156:0/2299546289 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5e80a0a70 msgr2=0x7fe5e806da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:51.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.267+0000 7fe5ecb8d700 1 --2- 172.21.15.156:0/2299546289 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5e80a0a70 0x7fe5e806da90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe5d800c550 tx=0x7fe5d800c860 comp rx=0 tx=0).stop 2023-09-30T22:22:51.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.267+0000 7fe5ecb8d700 1 -- 172.21.15.156:0/2299546289 shutdown_connections 2023-09-30T22:22:51.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.267+0000 7fe5ecb8d700 1 --2- 172.21.15.156:0/2299546289 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5e8139200 0x7fe5e806e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.267+0000 7fe5ecb8d700 1 --2- 172.21.15.156:0/2299546289 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5e80a0a70 0x7fe5e806da90 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.267+0000 7fe5ecb8d700 1 --2- 172.21.15.156:0/2299546289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5e80a1550 0x7fe5e806dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.267+0000 7fe5ecb8d700 1 -- 172.21.15.156:0/2299546289 >> 172.21.15.156:0/2299546289 conn(0x7fe5e80a6610 msgr2=0x7fe5e80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:51.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.267+0000 7fe5ecb8d700 1 -- 172.21.15.156:0/2299546289 shutdown_connections 2023-09-30T22:22:51.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.267+0000 7fe5ecb8d700 1 -- 172.21.15.156:0/2299546289 wait complete. 2023-09-30T22:22:51.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.271+0000 7ff83887f700 1 -- 172.21.15.156:0/2885383118 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff83404f2a0 con 0x7ff83409bd20 2023-09-30T22:22:51.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.271+0000 7ff822ffd700 1 -- 172.21.15.156:0/2885383118 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff824017020 con 0x7ff83409bd20 2023-09-30T22:22:51.271 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:51.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.275+0000 7ff83887f700 1 -- 172.21.15.156:0/2885383118 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff83409bd20 msgr2=0x7ff83412b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:51.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.275+0000 7ff83887f700 1 --2- 172.21.15.156:0/2885383118 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff83409bd20 0x7ff83412b620 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff82400c700 tx=0x7ff82400cac0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.275+0000 7ff83887f700 1 -- 172.21.15.156:0/2885383118 shutdown_connections 2023-09-30T22:22:51.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.275+0000 7ff83887f700 1 --2- 172.21.15.156:0/2885383118 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff834139400 0x7ff83412c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.275+0000 7ff83887f700 1 --2- 172.21.15.156:0/2885383118 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff83409bd20 0x7ff83412b620 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.275+0000 7ff83887f700 1 --2- 172.21.15.156:0/2885383118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff834136ae0 0x7ff83412bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.275+0000 7ff83887f700 1 -- 172.21.15.156:0/2885383118 >> 172.21.15.156:0/2885383118 conn(0x7ff83409f9f0 msgr2=0x7ff8340a3610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:51.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.275+0000 7ff83887f700 1 -- 172.21.15.156:0/2885383118 shutdown_connections 2023-09-30T22:22:51.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.275+0000 7ff83887f700 1 -- 172.21.15.156:0/2885383118 wait complete. 2023-09-30T22:22:51.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.279+0000 7f6d44db7700 1 -- 172.21.15.156:0/2471608590 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6d4009e3a0 con 0x7f6d40131a00 2023-09-30T22:22:51.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.279+0000 7f6d2effd700 1 -- 172.21.15.156:0/2471608590 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6d38021b50 con 0x7f6d40131a00 2023-09-30T22:22:51.279 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:51.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.282+0000 7f6d44db7700 1 -- 172.21.15.156:0/2471608590 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d40131a00 msgr2=0x7f6d4011a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:51.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.282+0000 7f6d44db7700 1 --2- 172.21.15.156:0/2471608590 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d40131a00 0x7f6d4011a9a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6d3800f530 tx=0x7f6d3800f840 comp rx=0 tx=0).stop 2023-09-30T22:22:51.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.282+0000 7f6d44db7700 1 -- 172.21.15.156:0/2471608590 shutdown_connections 2023-09-30T22:22:51.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.282+0000 7f6d44db7700 1 --2- 172.21.15.156:0/2471608590 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6d40131a00 0x7f6d4011a9a0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.282+0000 7f6d44db7700 1 --2- 172.21.15.156:0/2471608590 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6d4006a770 0x7f6d40119f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.282+0000 7f6d44db7700 1 --2- 172.21.15.156:0/2471608590 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d4009dec0 0x7f6d4011a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.282+0000 7f6d44db7700 1 -- 172.21.15.156:0/2471608590 >> 172.21.15.156:0/2471608590 conn(0x7f6d40099c40 msgr2=0x7f6d4012eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:51.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.282+0000 7f6d44db7700 1 -- 172.21.15.156:0/2471608590 shutdown_connections 2023-09-30T22:22:51.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:51.282+0000 7f6d44db7700 1 -- 172.21.15.156:0/2471608590 wait complete. 2023-09-30T22:22:51.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:51.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:51.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:52.224 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:52.285 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:52.291 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:52.295 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:52.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.377+0000 7faa4926c700 1 Processor -- start 2023-09-30T22:22:52.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.377+0000 7faa4926c700 1 -- start start 2023-09-30T22:22:52.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.378+0000 7faa4926c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faa44133ad0 0x7faa44133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.378+0000 7faa4926c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7faa44130bc0 0x7faa4413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.378+0000 7faa4926c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa4406b2d0 con 0x7faa441300a0 2023-09-30T22:22:52.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.378+0000 7faa4926c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa44133610 con 0x7faa44130bc0 2023-09-30T22:22:52.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.378+0000 7faa4926c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4409a500 con 0x7faa44133ad0 2023-09-30T22:22:52.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.378+0000 7faa437fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7faa44130bc0 0x7faa4413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.378+0000 7faa437fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7faa44130bc0 0x7faa4413b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39978/0 (socket says 172.21.15.156:39978) 2023-09-30T22:22:52.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.378+0000 7faa437fe700 1 -- 172.21.15.156:0/1797318294 learned_addr learned my addr 172.21.15.156:0/1797318294 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:52.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.378+0000 7faa42ffd700 1 --2- 172.21.15.156:0/1797318294 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faa44133ad0 0x7faa44133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.378+0000 7faa437fe700 1 -- 172.21.15.156:0/1797318294 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faa44133ad0 msgr2=0x7faa44133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:52.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.378+0000 7faa437fe700 1 --2- 172.21.15.156:0/1797318294 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faa44133ad0 0x7faa44133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.378+0000 7faa437fe700 1 -- 172.21.15.156:0/1797318294 >> v1:172.21.15.156:6789/0 conn(0x7faa441300a0 legacy=0x7faa441304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.378+0000 7faa437fe700 1 -- 172.21.15.156:0/1797318294 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa441338b0 con 0x7faa44130bc0 2023-09-30T22:22:52.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.379+0000 7faa437fe700 1 --2- 172.21.15.156:0/1797318294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa44130bc0 0x7faa4413b990 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7faa3c009e50 tx=0x7faa3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c914784b197c856d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:52.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.379+0000 7faa41ffb700 1 -- 172.21.15.156:0/1797318294 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c00e070 con 0x7faa44130bc0 2023-09-30T22:22:52.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.379+0000 7faa41ffb700 1 -- 172.21.15.156:0/1797318294 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c00b910 con 0x7faa44130bc0 2023-09-30T22:22:52.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.379+0000 7faa41ffb700 1 -- 172.21.15.156:0/1797318294 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c00bcc0 con 0x7faa44130bc0 2023-09-30T22:22:52.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.379+0000 7faa4926c700 1 -- 172.21.15.156:0/1797318294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa44130bc0 msgr2=0x7faa4413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.379+0000 7faa4926c700 1 --2- 172.21.15.156:0/1797318294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa44130bc0 0x7faa4413b990 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7faa3c009e50 tx=0x7faa3c00b330 comp rx=0 tx=0).stop 2023-09-30T22:22:52.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.380+0000 7faa4926c700 1 -- 172.21.15.156:0/1797318294 shutdown_connections 2023-09-30T22:22:52.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.380+0000 7faa4926c700 1 --2- 172.21.15.156:0/1797318294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa44130bc0 0x7faa4413b990 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.380+0000 7faa4926c700 1 --2- 172.21.15.156:0/1797318294 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faa44133ad0 0x7faa44133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.380+0000 7faa4926c700 1 -- 172.21.15.156:0/1797318294 >> 172.21.15.156:0/1797318294 conn(0x7faa44099c40 msgr2=0x7faa440a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:52.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.380+0000 7faa4926c700 1 -- 172.21.15.156:0/1797318294 shutdown_connections 2023-09-30T22:22:52.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.380+0000 7faa4926c700 1 -- 172.21.15.156:0/1797318294 wait complete. 2023-09-30T22:22:52.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.381+0000 7faa4926c700 1 Processor -- start 2023-09-30T22:22:52.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.381+0000 7faa4926c700 1 -- start start 2023-09-30T22:22:52.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.381+0000 7faa4926c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faa441300a0 0x7faa4411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.381+0000 7faa4926c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa44130bc0 0x7faa4411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.381+0000 7faa4926c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faa44133ad0 0x7faa4411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.381+0000 7faa4926c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa441201f0 con 0x7faa44130bc0 2023-09-30T22:22:52.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.381+0000 7faa4926c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa44132720 con 0x7faa44133ad0 2023-09-30T22:22:52.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.381+0000 7faa4926c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa4412dd00 con 0x7faa441300a0 2023-09-30T22:22:52.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.381+0000 7faa42ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faa441300a0 0x7faa4411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.381+0000 7faa42ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faa441300a0 0x7faa4411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54296/0 (socket says 172.21.15.156:54296) 2023-09-30T22:22:52.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.381+0000 7faa42ffd700 1 -- 172.21.15.156:0/768974154 learned_addr learned my addr 172.21.15.156:0/768974154 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:52.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.381+0000 7faa437fe700 1 --2- 172.21.15.156:0/768974154 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faa44133ad0 0x7faa4411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.382+0000 7faa427fc700 1 --2- 172.21.15.156:0/768974154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa44130bc0 0x7faa4411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.382+0000 7faa42ffd700 1 -- 172.21.15.156:0/768974154 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faa44133ad0 msgr2=0x7faa4411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.382+0000 7faa42ffd700 1 --2- 172.21.15.156:0/768974154 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faa44133ad0 0x7faa4411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.382+0000 7faa42ffd700 1 -- 172.21.15.156:0/768974154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa44130bc0 msgr2=0x7faa4411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.382+0000 7faa42ffd700 1 --2- 172.21.15.156:0/768974154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa44130bc0 0x7faa4411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.382+0000 7faa42ffd700 1 -- 172.21.15.156:0/768974154 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3c009b30 con 0x7faa441300a0 2023-09-30T22:22:52.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.382+0000 7faa437fe700 1 --2- 172.21.15.156:0/768974154 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faa44133ad0 0x7faa4411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:52.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.382+0000 7faa427fc700 1 --2- 172.21.15.156:0/768974154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa44130bc0 0x7faa4411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:22:52.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.382+0000 7faa42ffd700 1 --2- 172.21.15.156:0/768974154 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faa441300a0 0x7faa4411da40 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7faa3400e9b0 tx=0x7faa3400ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:52.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.382+0000 7faa2b7fe700 1 -- 172.21.15.156:0/768974154 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa34009710 con 0x7faa441300a0 2023-09-30T22:22:52.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.382+0000 7faa2b7fe700 1 -- 172.21.15.156:0/768974154 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3400c850 con 0x7faa441300a0 2023-09-30T22:22:52.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.382+0000 7faa4926c700 1 -- 172.21.15.156:0/768974154 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa4411fbb0 con 0x7faa441300a0 2023-09-30T22:22:52.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.382+0000 7faa2b7fe700 1 -- 172.21.15.156:0/768974154 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3400cbc0 con 0x7faa441300a0 2023-09-30T22:22:52.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.382+0000 7faa4926c700 1 -- 172.21.15.156:0/768974154 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa4411fe70 con 0x7faa441300a0 2023-09-30T22:22:52.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.383+0000 7faa4926c700 1 -- 172.21.15.156:0/768974154 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa4409cb20 con 0x7faa441300a0 2023-09-30T22:22:52.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.383+0000 7faa2b7fe700 1 -- 172.21.15.156:0/768974154 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faa3400cd20 con 0x7faa441300a0 2023-09-30T22:22:52.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.385+0000 7faa2b7fe700 1 -- 172.21.15.156:0/768974154 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faa3401a360 con 0x7faa441300a0 2023-09-30T22:22:52.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.388+0000 7faa2b7fe700 1 -- 172.21.15.156:0/768974154 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa34044060 con 0x7faa441300a0 2023-09-30T22:22:52.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.433+0000 7f41856ec700 1 Processor -- start 2023-09-30T22:22:52.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.434+0000 7f41856ec700 1 -- start start 2023-09-30T22:22:52.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.434+0000 7f41856ec700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4180133ad0 0x7f4180133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.434+0000 7f41856ec700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41801300a0 0x7f41801304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.434+0000 7f41856ec700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41801309f0 0x7f418013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.434+0000 7f41856ec700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418006b2d0 con 0x7f4180133ad0 2023-09-30T22:22:52.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.434+0000 7f41856ec700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4180133610 con 0x7f41801300a0 2023-09-30T22:22:52.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.434+0000 7f41856ec700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f418009a500 con 0x7f41801309f0 2023-09-30T22:22:52.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.434+0000 7f417effd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4180133ad0 0x7f4180133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.435+0000 7f417effd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4180133ad0 0x7f4180133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39996/0 (socket says 172.21.15.156:39996) 2023-09-30T22:22:52.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.435+0000 7f417effd700 1 -- 172.21.15.156:0/1611392081 learned_addr learned my addr 172.21.15.156:0/1611392081 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:52.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.435+0000 7f417e7fc700 1 --2- 172.21.15.156:0/1611392081 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41801300a0 0x7f41801304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.435+0000 7f417f7fe700 1 --2- 172.21.15.156:0/1611392081 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41801309f0 0x7f418013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.435+0000 7f417effd700 1 -- 172.21.15.156:0/1611392081 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41801309f0 msgr2=0x7f418013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:52.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.435+0000 7f417effd700 1 --2- 172.21.15.156:0/1611392081 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41801309f0 0x7f418013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.435+0000 7f417effd700 1 -- 172.21.15.156:0/1611392081 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41801300a0 msgr2=0x7f41801304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:52.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.435+0000 7f417effd700 1 --2- 172.21.15.156:0/1611392081 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41801300a0 0x7f41801304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.435+0000 7f417effd700 1 -- 172.21.15.156:0/1611392081 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41801338b0 con 0x7f4180133ad0 2023-09-30T22:22:52.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.435+0000 7f417e7fc700 1 --2- 172.21.15.156:0/1611392081 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41801300a0 0x7f41801304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:52.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.435+0000 7f417f7fe700 1 --2- 172.21.15.156:0/1611392081 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41801309f0 0x7f418013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:52.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.435+0000 7f417effd700 1 --2- 172.21.15.156:0/1611392081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4180133ad0 0x7f4180133ea0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f41700098f0 tx=0x7f4170009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d7959a33df3040f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:52.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.435+0000 7f417dffb700 1 -- 172.21.15.156:0/1611392081 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4170011830 con 0x7f4180133ad0 2023-09-30T22:22:52.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.435+0000 7f417dffb700 1 -- 172.21.15.156:0/1611392081 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4170011990 con 0x7f4180133ad0 2023-09-30T22:22:52.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.435+0000 7f417dffb700 1 -- 172.21.15.156:0/1611392081 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4170011d20 con 0x7f4180133ad0 2023-09-30T22:22:52.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.436+0000 7f41856ec700 1 -- 172.21.15.156:0/1611392081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4180133ad0 msgr2=0x7f4180133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.436+0000 7f41856ec700 1 --2- 172.21.15.156:0/1611392081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4180133ad0 0x7f4180133ea0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f41700098f0 tx=0x7f4170009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:52.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.436+0000 7f41856ec700 1 -- 172.21.15.156:0/1611392081 shutdown_connections 2023-09-30T22:22:52.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.436+0000 7f41856ec700 1 --2- 172.21.15.156:0/1611392081 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41801309f0 0x7f418013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.436+0000 7f41856ec700 1 --2- 172.21.15.156:0/1611392081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4180133ad0 0x7f4180133ea0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.436+0000 7f41856ec700 1 --2- 172.21.15.156:0/1611392081 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41801300a0 0x7f41801304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.436+0000 7f41856ec700 1 -- 172.21.15.156:0/1611392081 >> 172.21.15.156:0/1611392081 conn(0x7f4180099c40 msgr2=0x7f41800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:52.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.437+0000 7f41856ec700 1 -- 172.21.15.156:0/1611392081 shutdown_connections 2023-09-30T22:22:52.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.437+0000 7f41856ec700 1 -- 172.21.15.156:0/1611392081 wait complete. 2023-09-30T22:22:52.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.438+0000 7f41856ec700 1 Processor -- start 2023-09-30T22:22:52.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.438+0000 7f41856ec700 1 -- start start 2023-09-30T22:22:52.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.439+0000 7f41856ec700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41801300a0 0x7f418011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.439+0000 7f41856ec700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41801309f0 0x7f418011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.439+0000 7f41856ec700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4180133ad0 0x7f418011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.439+0000 7f41856ec700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418011fd00 con 0x7f4180133ad0 2023-09-30T22:22:52.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.439+0000 7f41856ec700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418012dd00 con 0x7f41801300a0 2023-09-30T22:22:52.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.439+0000 7f41856ec700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4180120950 con 0x7f41801309f0 2023-09-30T22:22:52.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.439+0000 7f417f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4180133ad0 0x7f418011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.439+0000 7f417f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4180133ad0 0x7f418011e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40006/0 (socket says 172.21.15.156:40006) 2023-09-30T22:22:52.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.439+0000 7f417f7fe700 1 -- 172.21.15.156:0/600681497 learned_addr learned my addr 172.21.15.156:0/600681497 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:52.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.439+0000 7f417e7fc700 1 --2- 172.21.15.156:0/600681497 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41801309f0 0x7f418011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.439+0000 7f417effd700 1 --2- 172.21.15.156:0/600681497 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41801300a0 0x7f418011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.439+0000 7f417f7fe700 1 -- 172.21.15.156:0/600681497 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41801309f0 msgr2=0x7f418011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.439+0000 7f417f7fe700 1 --2- 172.21.15.156:0/600681497 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41801309f0 0x7f418011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.439+0000 7f417f7fe700 1 -- 172.21.15.156:0/600681497 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41801300a0 msgr2=0x7f418011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.439+0000 7f417f7fe700 1 --2- 172.21.15.156:0/600681497 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41801300a0 0x7f418011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.439+0000 7f417f7fe700 1 -- 172.21.15.156:0/600681497 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41740094a0 con 0x7f4180133ad0 2023-09-30T22:22:52.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.440+0000 7f417effd700 1 --2- 172.21.15.156:0/600681497 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41801300a0 0x7f418011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:22:52.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.440+0000 7f417f7fe700 1 --2- 172.21.15.156:0/600681497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4180133ad0 0x7f418011e4c0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f417800efc0 tx=0x7f417800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:52.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.440+0000 7f41677fe700 1 -- 172.21.15.156:0/600681497 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4178009d70 con 0x7f4180133ad0 2023-09-30T22:22:52.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.440+0000 7f41677fe700 1 -- 172.21.15.156:0/600681497 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417800f040 con 0x7f4180133ad0 2023-09-30T22:22:52.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.440+0000 7f41856ec700 1 -- 172.21.15.156:0/600681497 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4178009a70 con 0x7f4180133ad0 2023-09-30T22:22:52.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.440+0000 7f41677fe700 1 -- 172.21.15.156:0/600681497 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417800ce00 con 0x7f4180133ad0 2023-09-30T22:22:52.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.440+0000 7f41856ec700 1 -- 172.21.15.156:0/600681497 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4170009550 con 0x7f4180133ad0 2023-09-30T22:22:52.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.441+0000 7f41856ec700 1 -- 172.21.15.156:0/600681497 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f418004f2a0 con 0x7f4180133ad0 2023-09-30T22:22:52.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.441+0000 7f41677fe700 1 -- 172.21.15.156:0/600681497 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4178014480 con 0x7f4180133ad0 2023-09-30T22:22:52.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.441+0000 7f41677fe700 1 -- 172.21.15.156:0/600681497 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f417803ff90 con 0x7f4180133ad0 2023-09-30T22:22:52.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.450+0000 7f41677fe700 1 -- 172.21.15.156:0/600681497 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4178012910 con 0x7f4180133ad0 2023-09-30T22:22:52.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.462+0000 7ff7e90c9700 1 Processor -- start 2023-09-30T22:22:52.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.462+0000 7ff7e90c9700 1 -- start start 2023-09-30T22:22:52.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.463+0000 7ff7e90c9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff7e4133ad0 0x7ff7e4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.463+0000 7ff7e90c9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7e41300a0 0x7ff7e41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.463+0000 7ff7e90c9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7e41309f0 0x7ff7e413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.463+0000 7ff7e90c9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7e406b2d0 con 0x7ff7e4133ad0 2023-09-30T22:22:52.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.463+0000 7ff7e90c9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e4133610 con 0x7ff7e41300a0 2023-09-30T22:22:52.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.463+0000 7ff7e90c9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e409a500 con 0x7ff7e41309f0 2023-09-30T22:22:52.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.463+0000 7ff7e359e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7e41309f0 0x7ff7e413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.463+0000 7ff7e2d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff7e4133ad0 0x7ff7e4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.463+0000 7ff7e359e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7e41309f0 0x7ff7e413a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54316/0 (socket says 172.21.15.156:54316) 2023-09-30T22:22:52.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.463+0000 7ff7e359e700 1 -- 172.21.15.156:0/2108927989 learned_addr learned my addr 172.21.15.156:0/2108927989 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:52.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.463+0000 7ff7e259c700 1 --2- 172.21.15.156:0/2108927989 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7e41300a0 0x7ff7e41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.464+0000 7ff7e359e700 1 -- 172.21.15.156:0/2108927989 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7e41300a0 msgr2=0x7ff7e41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:52.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.464+0000 7ff7e359e700 1 --2- 172.21.15.156:0/2108927989 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7e41300a0 0x7ff7e41304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.464+0000 7ff7e359e700 1 -- 172.21.15.156:0/2108927989 >> v2:172.21.15.156:3300/0 conn(0x7ff7e4133ad0 msgr2=0x7ff7e4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:52.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.464+0000 7ff7e359e700 1 --2- 172.21.15.156:0/2108927989 >> v2:172.21.15.156:3300/0 conn(0x7ff7e4133ad0 0x7ff7e4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.464+0000 7ff7e359e700 1 -- 172.21.15.156:0/2108927989 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e41338b0 con 0x7ff7e41309f0 2023-09-30T22:22:52.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.464+0000 7ff7e2d9d700 1 --2- 172.21.15.156:0/2108927989 >> v2:172.21.15.156:3300/0 conn(0x7ff7e4133ad0 0x7ff7e4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:52.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.464+0000 7ff7e259c700 1 --2- 172.21.15.156:0/2108927989 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7e41300a0 0x7ff7e41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:52.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.464+0000 7ff7e359e700 1 --2- 172.21.15.156:0/2108927989 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7e41309f0 0x7ff7e413a980 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc009e50 tx=0x7ff7dc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d22e903e954915a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:52.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.464+0000 7ff7e1d9b700 1 -- 172.21.15.156:0/2108927989 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc00e070 con 0x7ff7e41309f0 2023-09-30T22:22:52.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.464+0000 7ff7e1d9b700 1 -- 172.21.15.156:0/2108927989 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7dc00b910 con 0x7ff7e41309f0 2023-09-30T22:22:52.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.464+0000 7ff7e1d9b700 1 -- 172.21.15.156:0/2108927989 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc00bcc0 con 0x7ff7e41309f0 2023-09-30T22:22:52.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.465+0000 7ff7e90c9700 1 -- 172.21.15.156:0/2108927989 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7e41309f0 msgr2=0x7ff7e413a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.465+0000 7ff7e90c9700 1 --2- 172.21.15.156:0/2108927989 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7e41309f0 0x7ff7e413a980 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc009e50 tx=0x7ff7dc00b330 comp rx=0 tx=0).stop 2023-09-30T22:22:52.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.465+0000 7ff7e90c9700 1 -- 172.21.15.156:0/2108927989 shutdown_connections 2023-09-30T22:22:52.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.465+0000 7ff7e90c9700 1 --2- 172.21.15.156:0/2108927989 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7e41309f0 0x7ff7e413a980 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.465+0000 7ff7e90c9700 1 --2- 172.21.15.156:0/2108927989 >> v2:172.21.15.156:3300/0 conn(0x7ff7e4133ad0 0x7ff7e4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.465+0000 7ff7e90c9700 1 --2- 172.21.15.156:0/2108927989 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7e41300a0 0x7ff7e41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.465+0000 7ff7e90c9700 1 -- 172.21.15.156:0/2108927989 >> 172.21.15.156:0/2108927989 conn(0x7ff7e4099c40 msgr2=0x7ff7e40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:52.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.465+0000 7ff7e90c9700 1 -- 172.21.15.156:0/2108927989 shutdown_connections 2023-09-30T22:22:52.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.465+0000 7ff7e90c9700 1 -- 172.21.15.156:0/2108927989 wait complete. 2023-09-30T22:22:52.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.466+0000 7ff7e90c9700 1 Processor -- start 2023-09-30T22:22:52.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.466+0000 7ff7e90c9700 1 -- start start 2023-09-30T22:22:52.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.467+0000 7ff7e90c9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7e41300a0 0x7ff7e4071930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.467+0000 7ff7e90c9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7e41309f0 0x7ff7e4071e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.467+0000 7ff7e90c9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7e4133ad0 0x7ff7e41c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.467+0000 7ff7e90c9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e4071550 con 0x7ff7e41309f0 2023-09-30T22:22:52.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.467+0000 7ff7e90c9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e411b210 con 0x7ff7e41300a0 2023-09-30T22:22:52.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.467+0000 7ff7e90c9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e411af40 con 0x7ff7e4133ad0 2023-09-30T22:22:52.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.467+0000 7ff7e2d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7e41300a0 0x7ff7e4071930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.467+0000 7ff7e2d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7e41300a0 0x7ff7e4071930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46284/0 (socket says 172.21.15.156:46284) 2023-09-30T22:22:52.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.467+0000 7ff7e2d9d700 1 -- 172.21.15.156:0/77296490 learned_addr learned my addr 172.21.15.156:0/77296490 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:52.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.467+0000 7ff7e359e700 1 --2- 172.21.15.156:0/77296490 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7e4133ad0 0x7ff7e41c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.467+0000 7ff7e259c700 1 --2- 172.21.15.156:0/77296490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7e41309f0 0x7ff7e4071e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.467+0000 7ff7e2d9d700 1 -- 172.21.15.156:0/77296490 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7e4133ad0 msgr2=0x7ff7e41c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.467+0000 7ff7e2d9d700 1 --2- 172.21.15.156:0/77296490 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7e4133ad0 0x7ff7e41c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.467+0000 7ff7e2d9d700 1 -- 172.21.15.156:0/77296490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7e41309f0 msgr2=0x7ff7e4071e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.467+0000 7ff7e2d9d700 1 --2- 172.21.15.156:0/77296490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7e41309f0 0x7ff7e4071e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.467+0000 7ff7e2d9d700 1 -- 172.21.15.156:0/77296490 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d8011d40 con 0x7ff7e41300a0 2023-09-30T22:22:52.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.468+0000 7ff7e2d9d700 1 --2- 172.21.15.156:0/77296490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7e41300a0 0x7ff7e4071930 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff7d400ebe0 tx=0x7ff7d400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:52.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.468+0000 7ff7cb7fe700 1 -- 172.21.15.156:0/77296490 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d400c850 con 0x7ff7e41300a0 2023-09-30T22:22:52.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.468+0000 7ff7cb7fe700 1 -- 172.21.15.156:0/77296490 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d400c9b0 con 0x7ff7e41300a0 2023-09-30T22:22:52.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.468+0000 7ff7cb7fe700 1 -- 172.21.15.156:0/77296490 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d400cd40 con 0x7ff7e41300a0 2023-09-30T22:22:52.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.468+0000 7ff7e90c9700 1 -- 172.21.15.156:0/77296490 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d40094a0 con 0x7ff7e41300a0 2023-09-30T22:22:52.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.468+0000 7ff7e90c9700 1 -- 172.21.15.156:0/77296490 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7dc009b30 con 0x7ff7e41300a0 2023-09-30T22:22:52.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.469+0000 7ff7cb7fe700 1 -- 172.21.15.156:0/77296490 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff7d4013470 con 0x7ff7e41300a0 2023-09-30T22:22:52.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.469+0000 7ff7e90c9700 1 -- 172.21.15.156:0/77296490 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e411b3d0 con 0x7ff7e41300a0 2023-09-30T22:22:52.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.469+0000 7ff7cb7fe700 1 -- 172.21.15.156:0/77296490 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff7d403f720 con 0x7ff7e41300a0 2023-09-30T22:22:52.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.478+0000 7ff7cb7fe700 1 -- 172.21.15.156:0/77296490 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff7d4013720 con 0x7ff7e41300a0 2023-09-30T22:22:52.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.480+0000 7f64f74f5700 1 Processor -- start 2023-09-30T22:22:52.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.481+0000 7f64f74f5700 1 -- start start 2023-09-30T22:22:52.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.481+0000 7f64f74f5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f64f009ad40 0x7f64f0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.481+0000 7f64f74f5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f64f0133f70 0x7f64f01343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.481+0000 7f64f74f5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f009b110 con 0x7f64f00a0a70 2023-09-30T22:22:52.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.481+0000 7f64f74f5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f00a3b60 con 0x7f64f0133f70 2023-09-30T22:22:52.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.481+0000 7f64f74f5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f01348e0 con 0x7f64f009ad40 2023-09-30T22:22:52.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.482+0000 7f64f5a92700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f64f00a0a70 0x7f64f00a0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40252/0 (socket says 172.21.15.156:40252) 2023-09-30T22:22:52.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.482+0000 7f64f5a92700 1 -- 172.21.15.156:0/834696471 learned_addr learned my addr 172.21.15.156:0/834696471 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:52.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.482+0000 7f64f4a90700 1 --2- 172.21.15.156:0/834696471 >> v2:172.21.15.156:3300/0 conn(0x7f64f0133f70 0x7f64f01343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.482+0000 7f64f5291700 1 --2- 172.21.15.156:0/834696471 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f64f009ad40 0x7f64f0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.482+0000 7f64f4a90700 1 -- 172.21.15.156:0/834696471 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f64f009ad40 msgr2=0x7f64f0133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:52.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.482+0000 7f64f4a90700 1 --2- 172.21.15.156:0/834696471 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f64f009ad40 0x7f64f0133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.482+0000 7f64f4a90700 1 -- 172.21.15.156:0/834696471 >> v1:172.21.15.156:6789/0 conn(0x7f64f00a0a70 legacy=0x7f64f00a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.482+0000 7f64f4a90700 1 -- 172.21.15.156:0/834696471 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f00a2fa0 con 0x7f64f0133f70 2023-09-30T22:22:52.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.482+0000 7f64f4a90700 1 --2- 172.21.15.156:0/834696471 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64f0133f70 0x7f64f01343a0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f64e0009840 tx=0x7f64e0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e4e4ed9751942 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:52.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.483+0000 7f64e7fff700 1 -- 172.21.15.156:0/834696471 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e0011830 con 0x7f64f0133f70 2023-09-30T22:22:52.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.483+0000 7f64e7fff700 1 -- 172.21.15.156:0/834696471 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e0011990 con 0x7f64f0133f70 2023-09-30T22:22:52.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.483+0000 7f64e7fff700 1 -- 172.21.15.156:0/834696471 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e0011d20 con 0x7f64f0133f70 2023-09-30T22:22:52.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.484+0000 7f64f74f5700 1 -- 172.21.15.156:0/834696471 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64f0133f70 msgr2=0x7f64f01343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.484+0000 7f64f74f5700 1 --2- 172.21.15.156:0/834696471 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64f0133f70 0x7f64f01343a0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f64e0009840 tx=0x7f64e0009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:52.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.484+0000 7f64f74f5700 1 -- 172.21.15.156:0/834696471 shutdown_connections 2023-09-30T22:22:52.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.484+0000 7f64f74f5700 1 --2- 172.21.15.156:0/834696471 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f64f009ad40 0x7f64f0133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.484+0000 7f64f74f5700 1 --2- 172.21.15.156:0/834696471 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64f0133f70 0x7f64f01343a0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.484+0000 7f64f74f5700 1 -- 172.21.15.156:0/834696471 >> 172.21.15.156:0/834696471 conn(0x7f64f0099c40 msgr2=0x7f64f006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:52.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.484+0000 7f64f74f5700 1 -- 172.21.15.156:0/834696471 shutdown_connections 2023-09-30T22:22:52.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.484+0000 7f64f74f5700 1 -- 172.21.15.156:0/834696471 wait complete. 2023-09-30T22:22:52.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.485+0000 7f64f74f5700 1 Processor -- start 2023-09-30T22:22:52.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.485+0000 7f64f74f5700 1 -- start start 2023-09-30T22:22:52.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.486+0000 7f64f74f5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f64f009ad40 0x7f64f006da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.486+0000 7f64f74f5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f64f00a0a70 0x7f64f006dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.486+0000 7f64f74f5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64f0133f70 0x7f64f006e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.486+0000 7f64f74f5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f0070e80 con 0x7f64f0133f70 2023-09-30T22:22:52.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.486+0000 7f64f74f5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f009c7e0 con 0x7f64f009ad40 2023-09-30T22:22:52.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.486+0000 7f64f74f5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64f006fd70 con 0x7f64f00a0a70 2023-09-30T22:22:52.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.486+0000 7f64f5a92700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64f0133f70 0x7f64f006e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.486+0000 7f64f5a92700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64f0133f70 0x7f64f006e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40058/0 (socket says 172.21.15.156:40058) 2023-09-30T22:22:52.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.486+0000 7f64f5a92700 1 -- 172.21.15.156:0/295175253 learned_addr learned my addr 172.21.15.156:0/295175253 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:52.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.486+0000 7f64f5291700 1 --2- 172.21.15.156:0/295175253 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f64f009ad40 0x7f64f006da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.486+0000 7f64f5a92700 1 -- 172.21.15.156:0/295175253 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f64f00a0a70 msgr2=0x7f64f006dfd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:52.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.486+0000 7f64f5a92700 1 --2- 172.21.15.156:0/295175253 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f64f00a0a70 0x7f64f006dfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.486+0000 7f64f5a92700 1 -- 172.21.15.156:0/295175253 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f64f009ad40 msgr2=0x7f64f006da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.486+0000 7f64f5a92700 1 --2- 172.21.15.156:0/295175253 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f64f009ad40 0x7f64f006da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.486+0000 7f64f5a92700 1 -- 172.21.15.156:0/295175253 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e00094a0 con 0x7f64f0133f70 2023-09-30T22:22:52.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.487+0000 7f64f5a92700 1 --2- 172.21.15.156:0/295175253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64f0133f70 0x7f64f006e510 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f64e800cbf0 tx=0x7f64e80021c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:52.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.487+0000 7f64e5ffb700 1 -- 172.21.15.156:0/295175253 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e800ab40 con 0x7f64f0133f70 2023-09-30T22:22:52.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.487+0000 7f64e5ffb700 1 -- 172.21.15.156:0/295175253 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e800aca0 con 0x7f64f0133f70 2023-09-30T22:22:52.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.487+0000 7f64e5ffb700 1 -- 172.21.15.156:0/295175253 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e8012600 con 0x7f64f0133f70 2023-09-30T22:22:52.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.487+0000 7f64f74f5700 1 -- 172.21.15.156:0/295175253 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f00a0eb0 con 0x7f64f0133f70 2023-09-30T22:22:52.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.487+0000 7f64f74f5700 1 -- 172.21.15.156:0/295175253 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f0071140 con 0x7f64f0133f70 2023-09-30T22:22:52.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.488+0000 7f64e5ffb700 1 -- 172.21.15.156:0/295175253 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f64e8012760 con 0x7f64f0133f70 2023-09-30T22:22:52.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.488+0000 7f64e5ffb700 1 -- 172.21.15.156:0/295175253 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f64e8007470 con 0x7f64f0133f70 2023-09-30T22:22:52.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.488+0000 7f64f74f5700 1 -- 172.21.15.156:0/295175253 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f009ed10 con 0x7f64f0133f70 2023-09-30T22:22:52.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.498+0000 7f64e5ffb700 1 -- 172.21.15.156:0/295175253 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f64e8017030 con 0x7f64f0133f70 2023-09-30T22:22:52.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.602+0000 7faa4926c700 1 -- 172.21.15.156:0/768974154 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faa4404f2a0 con 0x7faa441300a0 2023-09-30T22:22:52.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.602+0000 7faa2b7fe700 1 -- 172.21.15.156:0/768974154 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa34017020 con 0x7faa441300a0 2023-09-30T22:22:52.602 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:52.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.606+0000 7faa4926c700 1 -- 172.21.15.156:0/768974154 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faa441300a0 msgr2=0x7faa4411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.606+0000 7faa4926c700 1 --2- 172.21.15.156:0/768974154 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faa441300a0 0x7faa4411da40 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7faa3400e9b0 tx=0x7faa3400ed70 comp rx=0 tx=0).stop 2023-09-30T22:22:52.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.606+0000 7faa4926c700 1 -- 172.21.15.156:0/768974154 shutdown_connections 2023-09-30T22:22:52.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.606+0000 7faa4926c700 1 --2- 172.21.15.156:0/768974154 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faa44133ad0 0x7faa4411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.606+0000 7faa4926c700 1 --2- 172.21.15.156:0/768974154 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faa441300a0 0x7faa4411da40 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.606+0000 7faa4926c700 1 --2- 172.21.15.156:0/768974154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faa44130bc0 0x7faa4411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.606+0000 7faa4926c700 1 -- 172.21.15.156:0/768974154 >> 172.21.15.156:0/768974154 conn(0x7faa44099c40 msgr2=0x7faa440a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:52.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.606+0000 7faa4926c700 1 -- 172.21.15.156:0/768974154 shutdown_connections 2023-09-30T22:22:52.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.606+0000 7faa4926c700 1 -- 172.21.15.156:0/768974154 wait complete. 2023-09-30T22:22:52.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:52.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.680+0000 7ff7e90c9700 1 -- 172.21.15.156:0/77296490 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff7e404f2a0 con 0x7ff7e41300a0 2023-09-30T22:22:52.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.680+0000 7ff7cb7fe700 1 -- 172.21.15.156:0/77296490 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff7d4017030 con 0x7ff7e41300a0 2023-09-30T22:22:52.680 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:52.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.682+0000 7ff7e90c9700 1 -- 172.21.15.156:0/77296490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7e41300a0 msgr2=0x7ff7e4071930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.682+0000 7ff7e90c9700 1 --2- 172.21.15.156:0/77296490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7e41300a0 0x7ff7e4071930 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff7d400ebe0 tx=0x7ff7d400eef0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.682+0000 7ff7e90c9700 1 -- 172.21.15.156:0/77296490 shutdown_connections 2023-09-30T22:22:52.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.682+0000 7ff7e90c9700 1 --2- 172.21.15.156:0/77296490 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff7e4133ad0 0x7ff7e41c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.682+0000 7ff7e90c9700 1 --2- 172.21.15.156:0/77296490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7e41300a0 0x7ff7e4071930 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.682+0000 7ff7e90c9700 1 --2- 172.21.15.156:0/77296490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7e41309f0 0x7ff7e4071e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.682+0000 7ff7e90c9700 1 -- 172.21.15.156:0/77296490 >> 172.21.15.156:0/77296490 conn(0x7ff7e4099c40 msgr2=0x7ff7e4132820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:52.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.683+0000 7ff7e90c9700 1 -- 172.21.15.156:0/77296490 shutdown_connections 2023-09-30T22:22:52.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.683+0000 7ff7e90c9700 1 -- 172.21.15.156:0/77296490 wait complete. 2023-09-30T22:22:52.694 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:52.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.702+0000 7f41856ec700 1 -- 172.21.15.156:0/600681497 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f418011ee40 con 0x7f4180133ad0 2023-09-30T22:22:52.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.702+0000 7f41677fe700 1 -- 172.21.15.156:0/600681497 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4178012340 con 0x7f4180133ad0 2023-09-30T22:22:52.702 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:52.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.704+0000 7f41856ec700 1 -- 172.21.15.156:0/600681497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4180133ad0 msgr2=0x7f418011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.704+0000 7f41856ec700 1 --2- 172.21.15.156:0/600681497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4180133ad0 0x7f418011e4c0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f417800efc0 tx=0x7f417800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.704+0000 7f41856ec700 1 -- 172.21.15.156:0/600681497 shutdown_connections 2023-09-30T22:22:52.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.704+0000 7f41856ec700 1 --2- 172.21.15.156:0/600681497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4180133ad0 0x7f418011e4c0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.704+0000 7f41856ec700 1 --2- 172.21.15.156:0/600681497 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41801300a0 0x7f418011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.704+0000 7f41856ec700 1 --2- 172.21.15.156:0/600681497 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41801309f0 0x7f418011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.704+0000 7f41856ec700 1 -- 172.21.15.156:0/600681497 >> 172.21.15.156:0/600681497 conn(0x7f4180099c40 msgr2=0x7f418012e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:52.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.704+0000 7f41856ec700 1 -- 172.21.15.156:0/600681497 shutdown_connections 2023-09-30T22:22:52.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.705+0000 7f41856ec700 1 -- 172.21.15.156:0/600681497 wait complete. 2023-09-30T22:22:52.716 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:52.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.732+0000 7f64f74f5700 1 -- 172.21.15.156:0/295175253 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f64f004f2a0 con 0x7f64f0133f70 2023-09-30T22:22:52.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.732+0000 7f64e5ffb700 1 -- 172.21.15.156:0/295175253 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f64e800ae10 con 0x7f64f0133f70 2023-09-30T22:22:52.732 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:52.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.734+0000 7f64f74f5700 1 -- 172.21.15.156:0/295175253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64f0133f70 msgr2=0x7f64f006e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.734+0000 7f64f74f5700 1 --2- 172.21.15.156:0/295175253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64f0133f70 0x7f64f006e510 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f64e800cbf0 tx=0x7f64e80021c0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.735+0000 7f64f74f5700 1 -- 172.21.15.156:0/295175253 shutdown_connections 2023-09-30T22:22:52.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.735+0000 7f64f74f5700 1 --2- 172.21.15.156:0/295175253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64f0133f70 0x7f64f006e510 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.735+0000 7f64f74f5700 1 --2- 172.21.15.156:0/295175253 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f64f009ad40 0x7f64f006da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.735+0000 7f64f74f5700 1 --2- 172.21.15.156:0/295175253 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f64f00a0a70 0x7f64f006dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.735+0000 7f64f74f5700 1 -- 172.21.15.156:0/295175253 >> 172.21.15.156:0/295175253 conn(0x7f64f0099c40 msgr2=0x7f64f01332a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:52.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.735+0000 7f64f74f5700 1 -- 172.21.15.156:0/295175253 shutdown_connections 2023-09-30T22:22:52.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:52.735+0000 7f64f74f5700 1 -- 172.21.15.156:0/295175253 wait complete. 2023-09-30T22:22:52.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:53.619 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:53.695 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:53.717 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:53.747 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:53.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.759+0000 7f35a99e9700 1 Processor -- start 2023-09-30T22:22:53.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.759+0000 7f35a99e9700 1 -- start start 2023-09-30T22:22:53.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.760+0000 7f35a99e9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35a409d860 0x7f35a409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.760+0000 7f35a99e9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35a409e170 0x7f35a41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.760+0000 7f35a99e9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f35a4130ce0 0x7f35a4131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.760+0000 7f35a99e9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a409aaa0 con 0x7f35a4130ce0 2023-09-30T22:22:53.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.760+0000 7f35a99e9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a409f870 con 0x7f35a409d860 2023-09-30T22:22:53.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.760+0000 7f35a99e9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35a409b360 con 0x7f35a409e170 2023-09-30T22:22:53.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.760+0000 7f35a2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35a409d860 0x7f35a409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.760+0000 7f35a2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35a409d860 0x7f35a409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46302/0 (socket says 172.21.15.156:46302) 2023-09-30T22:22:53.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.760+0000 7f35a2ffd700 1 -- 172.21.15.156:0/1419492349 learned_addr learned my addr 172.21.15.156:0/1419492349 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:53.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.760+0000 7f35a27fc700 1 --2- 172.21.15.156:0/1419492349 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35a409e170 0x7f35a41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.760+0000 7f35a37fe700 1 --2- 172.21.15.156:0/1419492349 >> v2:172.21.15.156:3300/0 conn(0x7f35a4130ce0 0x7f35a4131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.760+0000 7f35a27fc700 1 -- 172.21.15.156:0/1419492349 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35a409d860 msgr2=0x7f35a409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:53.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.760+0000 7f35a27fc700 1 --2- 172.21.15.156:0/1419492349 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35a409d860 0x7f35a409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.760+0000 7f35a27fc700 1 -- 172.21.15.156:0/1419492349 >> v2:172.21.15.156:3300/0 conn(0x7f35a4130ce0 msgr2=0x7f35a4131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:53.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.760+0000 7f35a27fc700 1 --2- 172.21.15.156:0/1419492349 >> v2:172.21.15.156:3300/0 conn(0x7f35a4130ce0 0x7f35a4131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.760+0000 7f35a27fc700 1 -- 172.21.15.156:0/1419492349 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a409b620 con 0x7f35a409e170 2023-09-30T22:22:53.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.761+0000 7f35a27fc700 1 --2- 172.21.15.156:0/1419492349 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35a409e170 0x7f35a41307a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3598009840 tx=0x7f3598009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ed18affa2b495dc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:53.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.761+0000 7f35a1ffb700 1 -- 172.21.15.156:0/1419492349 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3598011830 con 0x7f35a409e170 2023-09-30T22:22:53.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.761+0000 7f35a1ffb700 1 -- 172.21.15.156:0/1419492349 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3598011990 con 0x7f35a409e170 2023-09-30T22:22:53.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.761+0000 7f35a1ffb700 1 -- 172.21.15.156:0/1419492349 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3598011d20 con 0x7f35a409e170 2023-09-30T22:22:53.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.762+0000 7f35a99e9700 1 -- 172.21.15.156:0/1419492349 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35a409e170 msgr2=0x7f35a41307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.762+0000 7f35a99e9700 1 --2- 172.21.15.156:0/1419492349 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35a409e170 0x7f35a41307a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3598009840 tx=0x7f3598009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:53.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.762+0000 7f35a99e9700 1 -- 172.21.15.156:0/1419492349 shutdown_connections 2023-09-30T22:22:53.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.762+0000 7f35a99e9700 1 --2- 172.21.15.156:0/1419492349 >> v2:172.21.15.156:3300/0 conn(0x7f35a4130ce0 0x7f35a4131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.762+0000 7f35a99e9700 1 --2- 172.21.15.156:0/1419492349 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35a409d860 0x7f35a409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.762+0000 7f35a99e9700 1 --2- 172.21.15.156:0/1419492349 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35a409e170 0x7f35a41307a0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.762+0000 7f35a99e9700 1 -- 172.21.15.156:0/1419492349 >> 172.21.15.156:0/1419492349 conn(0x7f35a4099c40 msgr2=0x7f35a40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:53.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.762+0000 7f35a99e9700 1 -- 172.21.15.156:0/1419492349 shutdown_connections 2023-09-30T22:22:53.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.762+0000 7f35a99e9700 1 -- 172.21.15.156:0/1419492349 wait complete. 2023-09-30T22:22:53.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.763+0000 7f35a99e9700 1 Processor -- start 2023-09-30T22:22:53.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.763+0000 7f35a99e9700 1 -- start start 2023-09-30T22:22:53.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.764+0000 7f35a99e9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35a409d860 0x7f35a411f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.764+0000 7f35a99e9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35a409e170 0x7f35a411f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.764+0000 7f35a99e9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35a4130ce0 0x7f35a411faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.764+0000 7f35a99e9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a4122680 con 0x7f35a4130ce0 2023-09-30T22:22:53.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.764+0000 7f35a99e9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a4121b10 con 0x7f35a409e170 2023-09-30T22:22:53.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.764+0000 7f35a99e9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35a409c8b0 con 0x7f35a409d860 2023-09-30T22:22:53.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.764+0000 7f35a2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35a409d860 0x7f35a411f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.764+0000 7f35a2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35a409d860 0x7f35a411f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54344/0 (socket says 172.21.15.156:54344) 2023-09-30T22:22:53.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.764+0000 7f35a2ffd700 1 -- 172.21.15.156:0/1925563469 learned_addr learned my addr 172.21.15.156:0/1925563469 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:53.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.764+0000 7f35a37fe700 1 --2- 172.21.15.156:0/1925563469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35a4130ce0 0x7f35a411faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.764+0000 7f35a27fc700 1 --2- 172.21.15.156:0/1925563469 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35a409e170 0x7f35a411f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.765+0000 7f35a27fc700 1 -- 172.21.15.156:0/1925563469 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35a409d860 msgr2=0x7f35a411f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.765+0000 7f35a27fc700 1 --2- 172.21.15.156:0/1925563469 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35a409d860 0x7f35a411f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.765+0000 7f35a27fc700 1 -- 172.21.15.156:0/1925563469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35a4130ce0 msgr2=0x7f35a411faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.765+0000 7f35a27fc700 1 --2- 172.21.15.156:0/1925563469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35a4130ce0 0x7f35a411faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.765+0000 7f35a27fc700 1 -- 172.21.15.156:0/1925563469 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35980094a0 con 0x7f35a409e170 2023-09-30T22:22:53.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.765+0000 7f35a37fe700 1 --2- 172.21.15.156:0/1925563469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35a4130ce0 0x7f35a411faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:53.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.765+0000 7f35a27fc700 1 --2- 172.21.15.156:0/1925563469 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35a409e170 0x7f35a411f5b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3598016000 tx=0x7f3598004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:53.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.765+0000 7f358bfff700 1 -- 172.21.15.156:0/1925563469 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3598004240 con 0x7f35a409e170 2023-09-30T22:22:53.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.765+0000 7f358bfff700 1 -- 172.21.15.156:0/1925563469 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3598021070 con 0x7f35a409e170 2023-09-30T22:22:53.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.765+0000 7f35a99e9700 1 -- 172.21.15.156:0/1925563469 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a4122320 con 0x7f35a409e170 2023-09-30T22:22:53.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.765+0000 7f358bfff700 1 -- 172.21.15.156:0/1925563469 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35980045c0 con 0x7f35a409e170 2023-09-30T22:22:53.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.765+0000 7f35a99e9700 1 -- 172.21.15.156:0/1925563469 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a40a33f0 con 0x7f35a409e170 2023-09-30T22:22:53.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.766+0000 7f358bfff700 1 -- 172.21.15.156:0/1925563469 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3598023030 con 0x7f35a409e170 2023-09-30T22:22:53.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.766+0000 7f358bfff700 1 -- 172.21.15.156:0/1925563469 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3598042a90 con 0x7f35a409e170 2023-09-30T22:22:53.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.767+0000 7f35a99e9700 1 -- 172.21.15.156:0/1925563469 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a404f2a0 con 0x7f35a409e170 2023-09-30T22:22:53.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.772+0000 7f358bfff700 1 -- 172.21.15.156:0/1925563469 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f359802e390 con 0x7f35a409e170 2023-09-30T22:22:53.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.840+0000 7f9ba27f3700 1 Processor -- start 2023-09-30T22:22:53.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.840+0000 7f9ba27f3700 1 -- start start 2023-09-30T22:22:53.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.841+0000 7f9ba27f3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b9c0a1550 0x7f9b9c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.841+0000 7f9ba27f3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b9c139200 0x7f9b9c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.841+0000 7f9ba27f3700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b9c09e9d0 con 0x7f9b9c0a0a70 2023-09-30T22:22:53.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.841+0000 7f9ba27f3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c09dc00 con 0x7f9b9c139200 2023-09-30T22:22:53.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.841+0000 7f9ba27f3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c09dec0 con 0x7f9b9c0a1550 2023-09-30T22:22:53.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.841+0000 7f9ba0d90700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b9c139200 0x7f9b9c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.841+0000 7f9b9bfff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f9b9c0a0a70 0x7f9b9c0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40266/0 (socket says 172.21.15.156:40266) 2023-09-30T22:22:53.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.841+0000 7f9b9bfff700 1 -- 172.21.15.156:0/2362970027 learned_addr learned my addr 172.21.15.156:0/2362970027 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:53.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.841+0000 7f9b9b7fe700 1 --2- 172.21.15.156:0/2362970027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b9c0a1550 0x7f9b9c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.842+0000 7f9ba0d90700 1 -- 172.21.15.156:0/2362970027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b9c0a1550 msgr2=0x7f9b9c138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:53.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.842+0000 7f9ba0d90700 1 --2- 172.21.15.156:0/2362970027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b9c0a1550 0x7f9b9c138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.842+0000 7f9ba0d90700 1 -- 172.21.15.156:0/2362970027 >> v1:172.21.15.156:6789/0 conn(0x7f9b9c0a0a70 legacy=0x7f9b9c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.842+0000 7f9ba0d90700 1 -- 172.21.15.156:0/2362970027 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b9c09e6a0 con 0x7f9b9c139200 2023-09-30T22:22:53.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.842+0000 7f9ba0d90700 1 --2- 172.21.15.156:0/2362970027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b9c139200 0x7f9b9c13b5e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f9b94009dc0 tx=0x7f9b9400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f950babc60eb55b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:53.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.842+0000 7f9b9affd700 1 -- 172.21.15.156:0/2362970027 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9400e070 con 0x7f9b9c139200 2023-09-30T22:22:53.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.842+0000 7f9b9affd700 1 -- 172.21.15.156:0/2362970027 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9400bb20 con 0x7f9b9c139200 2023-09-30T22:22:53.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.842+0000 7f9b9affd700 1 -- 172.21.15.156:0/2362970027 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b94012430 con 0x7f9b9c139200 2023-09-30T22:22:53.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.843+0000 7f9ba27f3700 1 -- 172.21.15.156:0/2362970027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b9c139200 msgr2=0x7f9b9c13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.843+0000 7f9ba27f3700 1 --2- 172.21.15.156:0/2362970027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b9c139200 0x7f9b9c13b5e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f9b94009dc0 tx=0x7f9b9400b330 comp rx=0 tx=0).stop 2023-09-30T22:22:53.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.843+0000 7f9ba27f3700 1 -- 172.21.15.156:0/2362970027 shutdown_connections 2023-09-30T22:22:53.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.843+0000 7f9ba27f3700 1 --2- 172.21.15.156:0/2362970027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b9c139200 0x7f9b9c13b5e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.843+0000 7f9ba27f3700 1 --2- 172.21.15.156:0/2362970027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b9c0a1550 0x7f9b9c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.843+0000 7f9ba27f3700 1 -- 172.21.15.156:0/2362970027 >> 172.21.15.156:0/2362970027 conn(0x7f9b9c0a6610 msgr2=0x7f9b9c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:53.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.843+0000 7f9ba27f3700 1 -- 172.21.15.156:0/2362970027 shutdown_connections 2023-09-30T22:22:53.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.843+0000 7f9ba27f3700 1 -- 172.21.15.156:0/2362970027 wait complete. 2023-09-30T22:22:53.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.844+0000 7f9ba27f3700 1 Processor -- start 2023-09-30T22:22:53.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.844+0000 7f9ba27f3700 1 -- start start 2023-09-30T22:22:53.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.845+0000 7f9ba27f3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b9c0a0a70 0x7f9b9c11e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.845+0000 7f9ba27f3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b9c0a1550 0x7f9b9c11ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.845+0000 7f9ba27f3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b9c139200 0x7f9b9c11f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.845+0000 7f9ba27f3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c134100 con 0x7f9b9c0a0a70 2023-09-30T22:22:53.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.845+0000 7f9ba27f3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c122310 con 0x7f9b9c0a1550 2023-09-30T22:22:53.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.845+0000 7f9ba27f3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c0a03e0 con 0x7f9b9c139200 2023-09-30T22:22:53.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.845+0000 7f9b9bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b9c0a0a70 0x7f9b9c11e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.845+0000 7f9b9bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b9c0a0a70 0x7f9b9c11e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40082/0 (socket says 172.21.15.156:40082) 2023-09-30T22:22:53.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.845+0000 7f9b9bfff700 1 -- 172.21.15.156:0/2525323719 learned_addr learned my addr 172.21.15.156:0/2525323719 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:53.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.845+0000 7f9ba0d90700 1 --2- 172.21.15.156:0/2525323719 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b9c139200 0x7f9b9c11f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.845+0000 7f9b9b7fe700 1 --2- 172.21.15.156:0/2525323719 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b9c0a1550 0x7f9b9c11ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.846+0000 7f9b9bfff700 1 -- 172.21.15.156:0/2525323719 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b9c139200 msgr2=0x7f9b9c11f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.846+0000 7f9b9bfff700 1 --2- 172.21.15.156:0/2525323719 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b9c139200 0x7f9b9c11f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.846+0000 7f9b9bfff700 1 -- 172.21.15.156:0/2525323719 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b9c0a1550 msgr2=0x7f9b9c11ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.846+0000 7f9b9bfff700 1 --2- 172.21.15.156:0/2525323719 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b9c0a1550 0x7f9b9c11ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.846+0000 7f9b9bfff700 1 -- 172.21.15.156:0/2525323719 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b94009a70 con 0x7f9b9c0a0a70 2023-09-30T22:22:53.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.846+0000 7f9ba0d90700 1 --2- 172.21.15.156:0/2525323719 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b9c139200 0x7f9b9c11f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:53.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.846+0000 7f9b9bfff700 1 --2- 172.21.15.156:0/2525323719 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b9c0a0a70 0x7f9b9c11e7f0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00c520 tx=0x7f9b8c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:53.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.846+0000 7f9b98ff9700 1 -- 172.21.15.156:0/2525323719 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c005d70 con 0x7f9b9c0a0a70 2023-09-30T22:22:53.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.846+0000 7f9b98ff9700 1 -- 172.21.15.156:0/2525323719 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c0070d0 con 0x7f9b9c0a0a70 2023-09-30T22:22:53.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.846+0000 7f9ba27f3700 1 -- 172.21.15.156:0/2525323719 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b9c120400 con 0x7f9b9c0a0a70 2023-09-30T22:22:53.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.846+0000 7f9b98ff9700 1 -- 172.21.15.156:0/2525323719 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c007440 con 0x7f9b9c0a0a70 2023-09-30T22:22:53.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.846+0000 7f9ba27f3700 1 -- 172.21.15.156:0/2525323719 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b9c120bf0 con 0x7f9b9c0a0a70 2023-09-30T22:22:53.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.847+0000 7f9b98ff9700 1 -- 172.21.15.156:0/2525323719 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9b8c0075a0 con 0x7f9b9c0a0a70 2023-09-30T22:22:53.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.847+0000 7f9b98ff9700 1 -- 172.21.15.156:0/2525323719 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9b8c03ea80 con 0x7f9b9c0a0a70 2023-09-30T22:22:53.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.847+0000 7f9ba27f3700 1 -- 172.21.15.156:0/2525323719 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b9c04f2a0 con 0x7f9b9c0a0a70 2023-09-30T22:22:53.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.852+0000 7f9b98ff9700 1 -- 172.21.15.156:0/2525323719 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9b8c019b40 con 0x7f9b9c0a0a70 2023-09-30T22:22:53.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.877+0000 7f338f7b5700 1 Processor -- start 2023-09-30T22:22:53.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.877+0000 7f338f7b5700 1 -- start start 2023-09-30T22:22:53.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.878+0000 7f338f7b5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f338809f350 0x7f3388136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.878+0000 7f338f7b5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f33881371c0 0x7f33881395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.878+0000 7f338f7b5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f338809c970 con 0x7f338809e870 2023-09-30T22:22:53.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.878+0000 7f338f7b5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33880a0920 con 0x7f33881371c0 2023-09-30T22:22:53.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.878+0000 7f338f7b5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338809f9c0 con 0x7f338809f350 2023-09-30T22:22:53.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.878+0000 7f338cd50700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f338809f350 0x7f3388136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.878+0000 7f338cd50700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f338809f350 0x7f3388136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46324/0 (socket says 172.21.15.156:46324) 2023-09-30T22:22:53.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.878+0000 7f338cd50700 1 -- 172.21.15.156:0/2063997540 learned_addr learned my addr 172.21.15.156:0/2063997540 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:53.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.878+0000 7f338dd52700 1 --2- 172.21.15.156:0/2063997540 >> v2:172.21.15.156:3300/0 conn(0x7f33881371c0 0x7f33881395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.878+0000 7f338cd50700 1 -- 172.21.15.156:0/2063997540 >> v2:172.21.15.156:3300/0 conn(0x7f33881371c0 msgr2=0x7f33881395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:53.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.878+0000 7f338cd50700 1 --2- 172.21.15.156:0/2063997540 >> v2:172.21.15.156:3300/0 conn(0x7f33881371c0 0x7f33881395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.878+0000 7f338cd50700 1 -- 172.21.15.156:0/2063997540 >> v1:172.21.15.156:6789/0 conn(0x7f338809e870 legacy=0x7f338809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.878+0000 7f338cd50700 1 -- 172.21.15.156:0/2063997540 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338809bab0 con 0x7f338809f350 2023-09-30T22:22:53.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.878+0000 7f338cd50700 1 --2- 172.21.15.156:0/2063997540 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f338809f350 0x7f3388136c80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f337800dd10 tx=0x7f337800f330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dcc72815bb316ce server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:53.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.879+0000 7f337ffff700 1 -- 172.21.15.156:0/2063997540 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3378012070 con 0x7f338809f350 2023-09-30T22:22:53.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.879+0000 7f337ffff700 1 -- 172.21.15.156:0/2063997540 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337800d2e0 con 0x7f338809f350 2023-09-30T22:22:53.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.879+0000 7f337ffff700 1 -- 172.21.15.156:0/2063997540 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337800fb10 con 0x7f338809f350 2023-09-30T22:22:53.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.879+0000 7f338f7b5700 1 -- 172.21.15.156:0/2063997540 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f338809f350 msgr2=0x7f3388136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.879+0000 7f338f7b5700 1 --2- 172.21.15.156:0/2063997540 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f338809f350 0x7f3388136c80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f337800dd10 tx=0x7f337800f330 comp rx=0 tx=0).stop 2023-09-30T22:22:53.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.879+0000 7f338f7b5700 1 -- 172.21.15.156:0/2063997540 shutdown_connections 2023-09-30T22:22:53.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.879+0000 7f338f7b5700 1 --2- 172.21.15.156:0/2063997540 >> v2:172.21.15.156:3300/0 conn(0x7f33881371c0 0x7f33881395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.879+0000 7f338f7b5700 1 --2- 172.21.15.156:0/2063997540 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f338809f350 0x7f3388136c80 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.879+0000 7f338f7b5700 1 -- 172.21.15.156:0/2063997540 >> 172.21.15.156:0/2063997540 conn(0x7f33880a4430 msgr2=0x7f33880a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:53.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.879+0000 7f338f7b5700 1 -- 172.21.15.156:0/2063997540 shutdown_connections 2023-09-30T22:22:53.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.880+0000 7f338f7b5700 1 -- 172.21.15.156:0/2063997540 wait complete. 2023-09-30T22:22:53.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.880+0000 7f338f7b5700 1 Processor -- start 2023-09-30T22:22:53.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.880+0000 7f338f7b5700 1 -- start start 2023-09-30T22:22:53.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.881+0000 7f338f7b5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f338809e870 0x7f338811b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.881+0000 7f338f7b5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33881371c0 0x7f338811bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.881+0000 7f338f7b5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f338811c130 0x7f3388131f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.881+0000 7f338f7b5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3388132fb0 con 0x7f338811c130 2023-09-30T22:22:53.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.881+0000 7f338f7b5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338811eea0 con 0x7f33881371c0 2023-09-30T22:22:53.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.881+0000 7f338f7b5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f338811d380 con 0x7f338809e870 2023-09-30T22:22:53.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.881+0000 7f338cd50700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33881371c0 0x7f338811bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.881+0000 7f338dd52700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f338811c130 0x7f3388131f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.881+0000 7f338cd50700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33881371c0 0x7f338811bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46326/0 (socket says 172.21.15.156:46326) 2023-09-30T22:22:53.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.881+0000 7f338cd50700 1 -- 172.21.15.156:0/4149408119 learned_addr learned my addr 172.21.15.156:0/4149408119 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:53.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.881+0000 7f338dd52700 1 -- 172.21.15.156:0/4149408119 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f338809e870 msgr2=0x7f338811b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.881+0000 7f338dd52700 1 --2- 172.21.15.156:0/4149408119 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f338809e870 0x7f338811b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.881+0000 7f338dd52700 1 -- 172.21.15.156:0/4149408119 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33881371c0 msgr2=0x7f338811bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.881+0000 7f338dd52700 1 --2- 172.21.15.156:0/4149408119 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33881371c0 0x7f338811bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.881+0000 7f338dd52700 1 -- 172.21.15.156:0/4149408119 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337800d9f0 con 0x7f338811c130 2023-09-30T22:22:53.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.881+0000 7f338cd50700 1 --2- 172.21.15.156:0/4149408119 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33881371c0 0x7f338811bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:53.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.881+0000 7f338dd52700 1 --2- 172.21.15.156:0/4149408119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f338811c130 0x7f3388131f10 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f338000ef90 tx=0x7f338000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:53.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.883+0000 7f337dffb700 1 -- 172.21.15.156:0/4149408119 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338000cd40 con 0x7f338811c130 2023-09-30T22:22:53.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.883+0000 7f337dffb700 1 -- 172.21.15.156:0/4149408119 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338000f040 con 0x7f338811c130 2023-09-30T22:22:53.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.883+0000 7f338f7b5700 1 -- 172.21.15.156:0/4149408119 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f338809dba0 con 0x7f338811c130 2023-09-30T22:22:53.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.883+0000 7f337dffb700 1 -- 172.21.15.156:0/4149408119 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33800146c0 con 0x7f338811c130 2023-09-30T22:22:53.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.883+0000 7f338f7b5700 1 -- 172.21.15.156:0/4149408119 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f338806d490 con 0x7f338811c130 2023-09-30T22:22:53.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.884+0000 7f338f7b5700 1 -- 172.21.15.156:0/4149408119 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f338811eb20 con 0x7f338811c130 2023-09-30T22:22:53.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.884+0000 7f337dffb700 1 -- 172.21.15.156:0/4149408119 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3380014820 con 0x7f338811c130 2023-09-30T22:22:53.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.884+0000 7f337dffb700 1 -- 172.21.15.156:0/4149408119 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3380040310 con 0x7f338811c130 2023-09-30T22:22:53.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.889+0000 7f337dffb700 1 -- 172.21.15.156:0/4149408119 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f338811eb20 con 0x7f338811c130 2023-09-30T22:22:53.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.900+0000 7f13ccb8d700 1 Processor -- start 2023-09-30T22:22:53.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.900+0000 7f13ccb8d700 1 -- start start 2023-09-30T22:22:53.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.901+0000 7f13ccb8d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13c80a0a70 0x7f13c80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.901+0000 7f13ccb8d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f13c80a1380 0x7f13c8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.901+0000 7f13ccb8d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13c8133f50 0x7f13c8134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.901+0000 7f13ccb8d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c809e9d0 con 0x7f13c80a1380 2023-09-30T22:22:53.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.901+0000 7f13ccb8d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c809dc00 con 0x7f13c80a0a70 2023-09-30T22:22:53.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.901+0000 7f13ccb8d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13c809dec0 con 0x7f13c8133f50 2023-09-30T22:22:53.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.901+0000 7f13c659c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13c80a0a70 0x7f13c80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.901+0000 7f13c6d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13c8133f50 0x7f13c8134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.901+0000 7f13c659c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13c80a0a70 0x7f13c80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46338/0 (socket says 172.21.15.156:46338) 2023-09-30T22:22:53.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.901+0000 7f13c659c700 1 -- 172.21.15.156:0/1034039043 learned_addr learned my addr 172.21.15.156:0/1034039043 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:53.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.901+0000 7f13c5d9b700 1 --2- 172.21.15.156:0/1034039043 >> v2:172.21.15.156:3300/0 conn(0x7f13c80a1380 0x7f13c8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.902+0000 7f13c659c700 1 -- 172.21.15.156:0/1034039043 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13c8133f50 msgr2=0x7f13c8134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:53.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.902+0000 7f13c659c700 1 --2- 172.21.15.156:0/1034039043 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13c8133f50 0x7f13c8134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.902+0000 7f13c659c700 1 -- 172.21.15.156:0/1034039043 >> v2:172.21.15.156:3300/0 conn(0x7f13c80a1380 msgr2=0x7f13c8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:53.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.902+0000 7f13c659c700 1 --2- 172.21.15.156:0/1034039043 >> v2:172.21.15.156:3300/0 conn(0x7f13c80a1380 0x7f13c8133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.902+0000 7f13c659c700 1 -- 172.21.15.156:0/1034039043 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c809e6a0 con 0x7f13c80a0a70 2023-09-30T22:22:53.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.902+0000 7f13c659c700 1 --2- 172.21.15.156:0/1034039043 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13c80a0a70 0x7f13c80a0e40 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f13b80098f0 tx=0x7f13b8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb71d39c6e330e33 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:53.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.902+0000 7f13c559a700 1 -- 172.21.15.156:0/1034039043 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b8011830 con 0x7f13c80a0a70 2023-09-30T22:22:53.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.902+0000 7f13c559a700 1 -- 172.21.15.156:0/1034039043 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b8011990 con 0x7f13c80a0a70 2023-09-30T22:22:53.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.902+0000 7f13c559a700 1 -- 172.21.15.156:0/1034039043 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b8011d20 con 0x7f13c80a0a70 2023-09-30T22:22:53.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.903+0000 7f13ccb8d700 1 -- 172.21.15.156:0/1034039043 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13c80a0a70 msgr2=0x7f13c80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.903+0000 7f13ccb8d700 1 --2- 172.21.15.156:0/1034039043 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13c80a0a70 0x7f13c80a0e40 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f13b80098f0 tx=0x7f13b8009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:53.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.903+0000 7f13ccb8d700 1 -- 172.21.15.156:0/1034039043 shutdown_connections 2023-09-30T22:22:53.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.903+0000 7f13ccb8d700 1 --2- 172.21.15.156:0/1034039043 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13c8133f50 0x7f13c8134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.903+0000 7f13ccb8d700 1 --2- 172.21.15.156:0/1034039043 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13c80a0a70 0x7f13c80a0e40 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.903+0000 7f13ccb8d700 1 --2- 172.21.15.156:0/1034039043 >> v2:172.21.15.156:3300/0 conn(0x7f13c80a1380 0x7f13c8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.903+0000 7f13ccb8d700 1 -- 172.21.15.156:0/1034039043 >> 172.21.15.156:0/1034039043 conn(0x7f13c80a6610 msgr2=0x7f13c80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:53.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.903+0000 7f13ccb8d700 1 -- 172.21.15.156:0/1034039043 shutdown_connections 2023-09-30T22:22:53.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.903+0000 7f13ccb8d700 1 -- 172.21.15.156:0/1034039043 wait complete. 2023-09-30T22:22:53.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.904+0000 7f13ccb8d700 1 Processor -- start 2023-09-30T22:22:53.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.904+0000 7f13ccb8d700 1 -- start start 2023-09-30T22:22:53.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.905+0000 7f13ccb8d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13c80a0a70 0x7f13c81224e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.905+0000 7f13ccb8d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13c80a1380 0x7f13c8122a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.905+0000 7f13ccb8d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13c8133f50 0x7f13c8122f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.905+0000 7f13ccb8d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c8124ed0 con 0x7f13c80a1380 2023-09-30T22:22:53.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.905+0000 7f13ccb8d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c81241c0 con 0x7f13c8133f50 2023-09-30T22:22:53.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.905+0000 7f13ccb8d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13c8123fd0 con 0x7f13c80a0a70 2023-09-30T22:22:53.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.905+0000 7f13c6d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13c8133f50 0x7f13c8122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.905+0000 7f13c5d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13c80a1380 0x7f13c8122a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.905+0000 7f13c5d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13c80a1380 0x7f13c8122a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40120/0 (socket says 172.21.15.156:40120) 2023-09-30T22:22:53.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.905+0000 7f13c5d9b700 1 -- 172.21.15.156:0/1438350852 learned_addr learned my addr 172.21.15.156:0/1438350852 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:53.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.905+0000 7f13c6d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13c8133f50 0x7f13c8122f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46350/0 (socket says 172.21.15.156:46350) 2023-09-30T22:22:53.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.905+0000 7f13c659c700 1 --2- 172.21.15.156:0/1438350852 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13c80a0a70 0x7f13c81224e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.906+0000 7f13c5d9b700 1 -- 172.21.15.156:0/1438350852 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13c80a0a70 msgr2=0x7f13c81224e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.906+0000 7f13c5d9b700 1 --2- 172.21.15.156:0/1438350852 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13c80a0a70 0x7f13c81224e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.906+0000 7f13c5d9b700 1 -- 172.21.15.156:0/1438350852 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13c8133f50 msgr2=0x7f13c8122f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.906+0000 7f13c5d9b700 1 --2- 172.21.15.156:0/1438350852 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13c8133f50 0x7f13c8122f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.906+0000 7f13c5d9b700 1 -- 172.21.15.156:0/1438350852 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b8009550 con 0x7f13c80a1380 2023-09-30T22:22:53.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.906+0000 7f13c6d9d700 1 --2- 172.21.15.156:0/1438350852 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13c8133f50 0x7f13c8122f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:53.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.906+0000 7f13c5d9b700 1 --2- 172.21.15.156:0/1438350852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13c80a1380 0x7f13c8122a20 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00e900 tx=0x7f13bc00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:53.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.906+0000 7f13b6ffd700 1 -- 172.21.15.156:0/1438350852 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc00ee50 con 0x7f13c80a1380 2023-09-30T22:22:53.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.906+0000 7f13b6ffd700 1 -- 172.21.15.156:0/1438350852 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13bc00c850 con 0x7f13c80a1380 2023-09-30T22:22:53.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.906+0000 7f13ccb8d700 1 -- 172.21.15.156:0/1438350852 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c80a03e0 con 0x7f13c80a1380 2023-09-30T22:22:53.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.906+0000 7f13b6ffd700 1 -- 172.21.15.156:0/1438350852 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc00cbe0 con 0x7f13c80a1380 2023-09-30T22:22:53.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.906+0000 7f13ccb8d700 1 -- 172.21.15.156:0/1438350852 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c8125220 con 0x7f13c80a1380 2023-09-30T22:22:53.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.907+0000 7f13b6ffd700 1 -- 172.21.15.156:0/1438350852 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f13bc00cd40 con 0x7f13c80a1380 2023-09-30T22:22:53.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.907+0000 7f13b6ffd700 1 -- 172.21.15.156:0/1438350852 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f13bc03f4d0 con 0x7f13c80a1380 2023-09-30T22:22:53.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.908+0000 7f13ccb8d700 1 -- 172.21.15.156:0/1438350852 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c804f2a0 con 0x7f13c80a1380 2023-09-30T22:22:53.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.917+0000 7f13b6ffd700 1 -- 172.21.15.156:0/1438350852 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f13bc021080 con 0x7f13c80a1380 2023-09-30T22:22:53.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.980+0000 7f35a99e9700 1 -- 172.21.15.156:0/1925563469 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f35a406c3b0 con 0x7f35a409e170 2023-09-30T22:22:53.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.980+0000 7f358bfff700 1 -- 172.21.15.156:0/1925563469 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3598015070 con 0x7f35a409e170 2023-09-30T22:22:53.980 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:53.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.982+0000 7f35a99e9700 1 -- 172.21.15.156:0/1925563469 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35a409e170 msgr2=0x7f35a411f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.983+0000 7f35a99e9700 1 --2- 172.21.15.156:0/1925563469 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35a409e170 0x7f35a411f5b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3598016000 tx=0x7f3598004750 comp rx=0 tx=0).stop 2023-09-30T22:22:53.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.983+0000 7f35a99e9700 1 -- 172.21.15.156:0/1925563469 shutdown_connections 2023-09-30T22:22:53.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.983+0000 7f35a99e9700 1 --2- 172.21.15.156:0/1925563469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35a4130ce0 0x7f35a411faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.983+0000 7f35a99e9700 1 --2- 172.21.15.156:0/1925563469 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35a409d860 0x7f35a411f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.983+0000 7f35a99e9700 1 --2- 172.21.15.156:0/1925563469 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35a409e170 0x7f35a411f5b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.983+0000 7f35a99e9700 1 -- 172.21.15.156:0/1925563469 >> 172.21.15.156:0/1925563469 conn(0x7f35a4099c40 msgr2=0x7f35a40722d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:53.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.983+0000 7f35a99e9700 1 -- 172.21.15.156:0/1925563469 shutdown_connections 2023-09-30T22:22:53.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:53.983+0000 7f35a99e9700 1 -- 172.21.15.156:0/1925563469 wait complete. 2023-09-30T22:22:53.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:54.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.052+0000 7f9ba27f3700 1 -- 172.21.15.156:0/2525323719 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9b9c072980 con 0x7f9b9c0a0a70 2023-09-30T22:22:54.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.052+0000 7f9b98ff9700 1 -- 172.21.15.156:0/2525323719 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9b8c017020 con 0x7f9b9c0a0a70 2023-09-30T22:22:54.052 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:54.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.054+0000 7f9ba27f3700 1 -- 172.21.15.156:0/2525323719 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b9c0a0a70 msgr2=0x7f9b9c11e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:54.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.054+0000 7f9ba27f3700 1 --2- 172.21.15.156:0/2525323719 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b9c0a0a70 0x7f9b9c11e7f0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00c520 tx=0x7f9b8c00c830 comp rx=0 tx=0).stop 2023-09-30T22:22:54.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.054+0000 7f9ba27f3700 1 -- 172.21.15.156:0/2525323719 shutdown_connections 2023-09-30T22:22:54.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.054+0000 7f9ba27f3700 1 --2- 172.21.15.156:0/2525323719 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b9c139200 0x7f9b9c11f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:54.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.054+0000 7f9ba27f3700 1 --2- 172.21.15.156:0/2525323719 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b9c0a0a70 0x7f9b9c11e7f0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:54.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.054+0000 7f9ba27f3700 1 --2- 172.21.15.156:0/2525323719 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b9c0a1550 0x7f9b9c11ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:54.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.054+0000 7f9ba27f3700 1 -- 172.21.15.156:0/2525323719 >> 172.21.15.156:0/2525323719 conn(0x7f9b9c0a6610 msgr2=0x7f9b9c138120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:54.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.054+0000 7f9ba27f3700 1 -- 172.21.15.156:0/2525323719 shutdown_connections 2023-09-30T22:22:54.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.054+0000 7f9ba27f3700 1 -- 172.21.15.156:0/2525323719 wait complete. 2023-09-30T22:22:54.066 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:54.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.096+0000 7f338f7b5700 1 -- 172.21.15.156:0/4149408119 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f338811eb20 con 0x7f338811c130 2023-09-30T22:22:54.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.096+0000 7f337dffb700 1 -- 172.21.15.156:0/4149408119 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f338811eb20 con 0x7f338811c130 2023-09-30T22:22:54.096 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:54.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.098+0000 7f338f7b5700 1 -- 172.21.15.156:0/4149408119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f338811c130 msgr2=0x7f3388131f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:54.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.098+0000 7f338f7b5700 1 --2- 172.21.15.156:0/4149408119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f338811c130 0x7f3388131f10 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f338000ef90 tx=0x7f338000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:54.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.098+0000 7f338f7b5700 1 -- 172.21.15.156:0/4149408119 shutdown_connections 2023-09-30T22:22:54.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.098+0000 7f338f7b5700 1 --2- 172.21.15.156:0/4149408119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f338811c130 0x7f3388131f10 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:54.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.098+0000 7f338f7b5700 1 --2- 172.21.15.156:0/4149408119 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f338809e870 0x7f338811b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:54.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.098+0000 7f338f7b5700 1 --2- 172.21.15.156:0/4149408119 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33881371c0 0x7f338811bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:54.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.098+0000 7f338f7b5700 1 -- 172.21.15.156:0/4149408119 >> 172.21.15.156:0/4149408119 conn(0x7f33880a4430 msgr2=0x7f338809cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:54.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.098+0000 7f338f7b5700 1 -- 172.21.15.156:0/4149408119 shutdown_connections 2023-09-30T22:22:54.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.098+0000 7f338f7b5700 1 -- 172.21.15.156:0/4149408119 wait complete. 2023-09-30T22:22:54.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:54.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.114+0000 7f13ccb8d700 1 -- 172.21.15.156:0/1438350852 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f13c81256e0 con 0x7f13c80a1380 2023-09-30T22:22:54.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.114+0000 7f13b6ffd700 1 -- 172.21.15.156:0/1438350852 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f13bc017020 con 0x7f13c80a1380 2023-09-30T22:22:54.114 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:54.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.116+0000 7f13ccb8d700 1 -- 172.21.15.156:0/1438350852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13c80a1380 msgr2=0x7f13c8122a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:54.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.116+0000 7f13ccb8d700 1 --2- 172.21.15.156:0/1438350852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13c80a1380 0x7f13c8122a20 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00e900 tx=0x7f13bc00ec10 comp rx=0 tx=0).stop 2023-09-30T22:22:54.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.116+0000 7f13ccb8d700 1 -- 172.21.15.156:0/1438350852 shutdown_connections 2023-09-30T22:22:54.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.116+0000 7f13ccb8d700 1 --2- 172.21.15.156:0/1438350852 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13c8133f50 0x7f13c8122f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:54.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.116+0000 7f13ccb8d700 1 --2- 172.21.15.156:0/1438350852 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13c80a0a70 0x7f13c81224e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:54.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.116+0000 7f13ccb8d700 1 --2- 172.21.15.156:0/1438350852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13c80a1380 0x7f13c8122a20 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:54.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.116+0000 7f13ccb8d700 1 -- 172.21.15.156:0/1438350852 >> 172.21.15.156:0/1438350852 conn(0x7f13c80a6610 msgr2=0x7f13c809c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:54.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.116+0000 7f13ccb8d700 1 -- 172.21.15.156:0/1438350852 shutdown_connections 2023-09-30T22:22:54.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:54.116+0000 7f13ccb8d700 1 -- 172.21.15.156:0/1438350852 wait complete. 2023-09-30T22:22:54.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:55.000 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:55.067 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:55.111 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:55.129 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:55.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.141+0000 7f55b3964700 1 Processor -- start 2023-09-30T22:22:55.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.141+0000 7f55b3964700 1 -- start start 2023-09-30T22:22:55.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.141+0000 7f55b3964700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55ac06b250 0x7f55ac136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.141+0000 7f55b3964700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55ac137140 0x7f55ac139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.141+0000 7f55b3964700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55ac09da80 con 0x7f55ac06a770 2023-09-30T22:22:55.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.141+0000 7f55b3964700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac09dce0 con 0x7f55ac137140 2023-09-30T22:22:55.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.141+0000 7f55b3964700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac06b620 con 0x7f55ac06b250 2023-09-30T22:22:55.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.142+0000 7f55b1f01700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55ac137140 0x7f55ac139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.142+0000 7f55b1f01700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55ac137140 0x7f55ac139520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46364/0 (socket says 172.21.15.156:46364) 2023-09-30T22:22:55.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.142+0000 7f55b1f01700 1 -- 172.21.15.156:0/394535961 learned_addr learned my addr 172.21.15.156:0/394535961 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:55.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.142+0000 7f55b0eff700 1 --2- 172.21.15.156:0/394535961 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55ac06b250 0x7f55ac136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.142+0000 7f55b0eff700 1 -- 172.21.15.156:0/394535961 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55ac137140 msgr2=0x7f55ac139520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:55.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.142+0000 7f55b0eff700 1 --2- 172.21.15.156:0/394535961 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55ac137140 0x7f55ac139520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.142+0000 7f55a3fff700 1 -- 172.21.15.156:0/394535961 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1376350318 0 0) 0x7f55ac09da80 con 0x7f55ac06a770 2023-09-30T22:22:55.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.142+0000 7f55b0eff700 1 -- 172.21.15.156:0/394535961 >> v1:172.21.15.156:6789/0 conn(0x7f55ac06a770 legacy=0x7f55ac06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.142+0000 7f55b0eff700 1 -- 172.21.15.156:0/394535961 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ac09eb20 con 0x7f55ac06b250 2023-09-30T22:22:55.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.142+0000 7f55b0eff700 1 --2- 172.21.15.156:0/394535961 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55ac06b250 0x7f55ac136c00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f559c00dc90 tx=0x7f559c00f050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19ccd632c6d25fdc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:55.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.142+0000 7f55a3fff700 1 -- 172.21.15.156:0/394535961 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559c012070 con 0x7f55ac06b250 2023-09-30T22:22:55.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.143+0000 7f55a3fff700 1 -- 172.21.15.156:0/394535961 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559c00d2e0 con 0x7f55ac06b250 2023-09-30T22:22:55.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.143+0000 7f55a3fff700 1 -- 172.21.15.156:0/394535961 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559c00f9a0 con 0x7f55ac06b250 2023-09-30T22:22:55.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.143+0000 7f55b3964700 1 -- 172.21.15.156:0/394535961 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55ac06b250 msgr2=0x7f55ac136c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.143+0000 7f55b3964700 1 --2- 172.21.15.156:0/394535961 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55ac06b250 0x7f55ac136c00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f559c00dc90 tx=0x7f559c00f050 comp rx=0 tx=0).stop 2023-09-30T22:22:55.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.144+0000 7f55b3964700 1 -- 172.21.15.156:0/394535961 shutdown_connections 2023-09-30T22:22:55.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.144+0000 7f55b3964700 1 --2- 172.21.15.156:0/394535961 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55ac137140 0x7f55ac139520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.144+0000 7f55b3964700 1 --2- 172.21.15.156:0/394535961 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55ac06b250 0x7f55ac136c00 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.144+0000 7f55b3964700 1 -- 172.21.15.156:0/394535961 >> 172.21.15.156:0/394535961 conn(0x7f55ac099c40 msgr2=0x7f55ac0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:55.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.144+0000 7f55b3964700 1 -- 172.21.15.156:0/394535961 shutdown_connections 2023-09-30T22:22:55.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.144+0000 7f55b3964700 1 -- 172.21.15.156:0/394535961 wait complete. 2023-09-30T22:22:55.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.145+0000 7f55b3964700 1 Processor -- start 2023-09-30T22:22:55.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.145+0000 7f55b3964700 1 -- start start 2023-09-30T22:22:55.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.145+0000 7f55b3964700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55ac06a770 0x7f55ac11e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.145+0000 7f55b3964700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55ac06b250 0x7f55ac11e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.145+0000 7f55b3964700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55ac137140 0x7f55ac11edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.145+0000 7f55b3964700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac11f800 con 0x7f55ac137140 2023-09-30T22:22:55.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.145+0000 7f55b3964700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac136770 con 0x7f55ac06b250 2023-09-30T22:22:55.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.145+0000 7f55b3964700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac121190 con 0x7f55ac06a770 2023-09-30T22:22:55.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.146+0000 7f55b1700700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55ac06a770 0x7f55ac11e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.146+0000 7f55b1700700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55ac06a770 0x7f55ac11e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54406/0 (socket says 172.21.15.156:54406) 2023-09-30T22:22:55.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.146+0000 7f55b1700700 1 -- 172.21.15.156:0/21940372 learned_addr learned my addr 172.21.15.156:0/21940372 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:55.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.146+0000 7f55b0eff700 1 --2- 172.21.15.156:0/21940372 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55ac06b250 0x7f55ac11e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.146+0000 7f55b1f01700 1 --2- 172.21.15.156:0/21940372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55ac137140 0x7f55ac11edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.146+0000 7f55b1700700 1 -- 172.21.15.156:0/21940372 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55ac06b250 msgr2=0x7f55ac11e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.146+0000 7f55b1700700 1 --2- 172.21.15.156:0/21940372 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55ac06b250 0x7f55ac11e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.146+0000 7f55b1700700 1 -- 172.21.15.156:0/21940372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55ac137140 msgr2=0x7f55ac11edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.146+0000 7f55b1700700 1 --2- 172.21.15.156:0/21940372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55ac137140 0x7f55ac11edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.146+0000 7f55b1700700 1 -- 172.21.15.156:0/21940372 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559c00d940 con 0x7f55ac06a770 2023-09-30T22:22:55.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.146+0000 7f55b0eff700 1 --2- 172.21.15.156:0/21940372 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55ac06b250 0x7f55ac11e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:55.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.146+0000 7f55b1f01700 1 --2- 172.21.15.156:0/21940372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55ac137140 0x7f55ac11edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:55.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.146+0000 7f55b1700700 1 --2- 172.21.15.156:0/21940372 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55ac06a770 0x7f55ac11e330 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f55a8001eb0 tx=0x7f55a800c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:55.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.146+0000 7f55a1ffb700 1 -- 172.21.15.156:0/21940372 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a80054e0 con 0x7f55ac06a770 2023-09-30T22:22:55.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.147+0000 7f55b3964700 1 -- 172.21.15.156:0/21940372 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55ac121b70 con 0x7f55ac06a770 2023-09-30T22:22:55.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.147+0000 7f55a1ffb700 1 -- 172.21.15.156:0/21940372 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a8003680 con 0x7f55ac06a770 2023-09-30T22:22:55.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.147+0000 7f55a1ffb700 1 -- 172.21.15.156:0/21940372 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a80039f0 con 0x7f55ac06a770 2023-09-30T22:22:55.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.147+0000 7f55b3964700 1 -- 172.21.15.156:0/21940372 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55ac0a0660 con 0x7f55ac06a770 2023-09-30T22:22:55.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.148+0000 7f55b3964700 1 -- 172.21.15.156:0/21940372 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55ac071e10 con 0x7f55ac06a770 2023-09-30T22:22:55.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.148+0000 7f55a1ffb700 1 -- 172.21.15.156:0/21940372 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f55a8003b50 con 0x7f55ac06a770 2023-09-30T22:22:55.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.148+0000 7f55a1ffb700 1 -- 172.21.15.156:0/21940372 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f55a803ead0 con 0x7f55ac06a770 2023-09-30T22:22:55.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.153+0000 7f55a1ffb700 1 -- 172.21.15.156:0/21940372 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f55a801b3b0 con 0x7f55ac06a770 2023-09-30T22:22:55.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.227+0000 7f9cac535700 1 Processor -- start 2023-09-30T22:22:55.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.227+0000 7f9cac535700 1 -- start start 2023-09-30T22:22:55.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.228+0000 7f9cac535700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ca4099e20 0x7f9ca409a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.228+0000 7f9cac535700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9ca4130a60 0x7f9ca4138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.228+0000 7f9cac535700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ca4099a60 con 0x7f9ca409a730 2023-09-30T22:22:55.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.228+0000 7f9cac535700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ca409bf50 con 0x7f9ca4130a60 2023-09-30T22:22:55.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.228+0000 7f9cac535700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca409b230 con 0x7f9ca4099e20 2023-09-30T22:22:55.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.228+0000 7f9caaad2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9ca4130a60 0x7f9ca4138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.228+0000 7f9ca9ad0700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f9ca409a730 0x7f9ca4130350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40294/0 (socket says 172.21.15.156:40294) 2023-09-30T22:22:55.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.228+0000 7f9ca9ad0700 1 -- 172.21.15.156:0/2827265783 learned_addr learned my addr 172.21.15.156:0/2827265783 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:55.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.228+0000 7f9caa2d1700 1 --2- 172.21.15.156:0/2827265783 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ca4099e20 0x7f9ca409a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.229+0000 7f9caa2d1700 1 -- 172.21.15.156:0/2827265783 >> v2:172.21.15.156:3300/0 conn(0x7f9ca4130a60 msgr2=0x7f9ca4138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:55.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.229+0000 7f9caa2d1700 1 --2- 172.21.15.156:0/2827265783 >> v2:172.21.15.156:3300/0 conn(0x7f9ca4130a60 0x7f9ca4138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.229+0000 7f9caa2d1700 1 -- 172.21.15.156:0/2827265783 >> v1:172.21.15.156:6789/0 conn(0x7f9ca409a730 legacy=0x7f9ca4130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.229+0000 7f9caa2d1700 1 -- 172.21.15.156:0/2827265783 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca409bb90 con 0x7f9ca4099e20 2023-09-30T22:22:55.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.229+0000 7f9caaad2700 1 --2- 172.21.15.156:0/2827265783 >> v2:172.21.15.156:3300/0 conn(0x7f9ca4130a60 0x7f9ca4138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:55.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.229+0000 7f9caa2d1700 1 --2- 172.21.15.156:0/2827265783 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ca4099e20 0x7f9ca409a1f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0009820 tx=0x7f9ca0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f8319ebb22bb17 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:55.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.229+0000 7f9ca92cf700 1 -- 172.21.15.156:0/2827265783 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0005e30 con 0x7f9ca4099e20 2023-09-30T22:22:55.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.229+0000 7f9ca92cf700 1 -- 172.21.15.156:0/2827265783 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca0006030 con 0x7f9ca4099e20 2023-09-30T22:22:55.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.229+0000 7f9ca92cf700 1 -- 172.21.15.156:0/2827265783 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca00063c0 con 0x7f9ca4099e20 2023-09-30T22:22:55.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.230+0000 7f9cac535700 1 -- 172.21.15.156:0/2827265783 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ca4099e20 msgr2=0x7f9ca409a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.230+0000 7f9cac535700 1 --2- 172.21.15.156:0/2827265783 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ca4099e20 0x7f9ca409a1f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0009820 tx=0x7f9ca0009b30 comp rx=0 tx=0).stop 2023-09-30T22:22:55.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.230+0000 7f9cac535700 1 -- 172.21.15.156:0/2827265783 shutdown_connections 2023-09-30T22:22:55.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.230+0000 7f9cac535700 1 --2- 172.21.15.156:0/2827265783 >> v2:172.21.15.156:3300/0 conn(0x7f9ca4130a60 0x7f9ca4138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.230+0000 7f9cac535700 1 --2- 172.21.15.156:0/2827265783 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ca4099e20 0x7f9ca409a1f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.230+0000 7f9cac535700 1 -- 172.21.15.156:0/2827265783 >> 172.21.15.156:0/2827265783 conn(0x7f9ca40a2980 msgr2=0x7f9ca40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:55.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.230+0000 7f9cac535700 1 -- 172.21.15.156:0/2827265783 shutdown_connections 2023-09-30T22:22:55.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.230+0000 7f9cac535700 1 -- 172.21.15.156:0/2827265783 wait complete. 2023-09-30T22:22:55.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.231+0000 7f9cac535700 1 Processor -- start 2023-09-30T22:22:55.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.232+0000 7f9cac535700 1 -- start start 2023-09-30T22:22:55.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.232+0000 7f9cac535700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ca4099e20 0x7f9ca4133d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.232+0000 7f9cac535700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ca409a730 0x7f9ca4134250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.232+0000 7f9cac535700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ca4130a60 0x7f9ca4134790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.232+0000 7f9cac535700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca41394a0 con 0x7f9ca4130a60 2023-09-30T22:22:55.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.232+0000 7f9cac535700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca4138410 con 0x7f9ca409a730 2023-09-30T22:22:55.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.232+0000 7f9cac535700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca4137290 con 0x7f9ca4099e20 2023-09-30T22:22:55.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.232+0000 7f9caaad2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ca4130a60 0x7f9ca4134790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.232+0000 7f9caaad2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ca4130a60 0x7f9ca4134790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40154/0 (socket says 172.21.15.156:40154) 2023-09-30T22:22:55.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.232+0000 7f9caaad2700 1 -- 172.21.15.156:0/3495871307 learned_addr learned my addr 172.21.15.156:0/3495871307 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:55.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.232+0000 7f9ca9ad0700 1 --2- 172.21.15.156:0/3495871307 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ca409a730 0x7f9ca4134250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.233+0000 7f9caaad2700 1 -- 172.21.15.156:0/3495871307 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ca4099e20 msgr2=0x7f9ca4133d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.233+0000 7f9caaad2700 1 --2- 172.21.15.156:0/3495871307 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ca4099e20 0x7f9ca4133d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.233+0000 7f9caaad2700 1 -- 172.21.15.156:0/3495871307 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ca409a730 msgr2=0x7f9ca4134250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.233+0000 7f9caaad2700 1 --2- 172.21.15.156:0/3495871307 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ca409a730 0x7f9ca4134250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.233+0000 7f9caaad2700 1 -- 172.21.15.156:0/3495871307 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9c009a70 con 0x7f9ca4130a60 2023-09-30T22:22:55.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.233+0000 7f9caaad2700 1 --2- 172.21.15.156:0/3495871307 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ca4130a60 0x7f9ca4134790 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c00efc0 tx=0x7f9c9c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:55.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.233+0000 7f9c9affd700 1 -- 172.21.15.156:0/3495871307 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c00cb40 con 0x7f9ca4130a60 2023-09-30T22:22:55.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.233+0000 7f9c9affd700 1 -- 172.21.15.156:0/3495871307 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9c00f040 con 0x7f9ca4130a60 2023-09-30T22:22:55.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.233+0000 7f9c9affd700 1 -- 172.21.15.156:0/3495871307 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c003a20 con 0x7f9ca4130a60 2023-09-30T22:22:55.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.234+0000 7f9cac535700 1 -- 172.21.15.156:0/3495871307 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca0009430 con 0x7f9ca4130a60 2023-09-30T22:22:55.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.234+0000 7f9cac535700 1 -- 172.21.15.156:0/3495871307 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca409b470 con 0x7f9ca4130a60 2023-09-30T22:22:55.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.235+0000 7f9c9affd700 1 -- 172.21.15.156:0/3495871307 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c9c014480 con 0x7f9ca4130a60 2023-09-30T22:22:55.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.235+0000 7f9c9affd700 1 -- 172.21.15.156:0/3495871307 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9c9c0400e0 con 0x7f9ca4130a60 2023-09-30T22:22:55.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.235+0000 7f9cac535700 1 -- 172.21.15.156:0/3495871307 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca4071740 con 0x7f9ca4130a60 2023-09-30T22:22:55.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.240+0000 7f9c9affd700 1 -- 172.21.15.156:0/3495871307 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c9c012930 con 0x7f9ca4130a60 2023-09-30T22:22:55.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.246+0000 7fd25dacc700 1 Processor -- start 2023-09-30T22:22:55.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.246+0000 7fd25dacc700 1 -- start start 2023-09-30T22:22:55.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.247+0000 7fd25dacc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2580a0a30 0x7fd2580a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.247+0000 7fd25dacc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd258130670 0x7fd2581381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.247+0000 7fd25dacc700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2580a1e70 con 0x7fd2580a1340 2023-09-30T22:22:55.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.247+0000 7fd25dacc700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd25809a720 con 0x7fd258130670 2023-09-30T22:22:55.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.247+0000 7fd25dacc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd25809b300 con 0x7fd2580a0a30 2023-09-30T22:22:55.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.247+0000 7fd2577fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2580a0a30 0x7fd2580a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.247+0000 7fd2577fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2580a0a30 0x7fd2580a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54416/0 (socket says 172.21.15.156:54416) 2023-09-30T22:22:55.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.247+0000 7fd2577fe700 1 -- 172.21.15.156:0/181277477 learned_addr learned my addr 172.21.15.156:0/181277477 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:55.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.247+0000 7fd257fff700 1 --2- 172.21.15.156:0/181277477 >> v2:172.21.15.156:3300/0 conn(0x7fd258130670 0x7fd2581381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.247+0000 7fd2577fe700 1 -- 172.21.15.156:0/181277477 >> v2:172.21.15.156:3300/0 conn(0x7fd258130670 msgr2=0x7fd2581381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:55.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.247+0000 7fd2577fe700 1 --2- 172.21.15.156:0/181277477 >> v2:172.21.15.156:3300/0 conn(0x7fd258130670 0x7fd2581381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.247+0000 7fd2577fe700 1 -- 172.21.15.156:0/181277477 >> v1:172.21.15.156:6789/0 conn(0x7fd2580a1340 legacy=0x7fd25812ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.247+0000 7fd2577fe700 1 -- 172.21.15.156:0/181277477 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd25809abc0 con 0x7fd2580a0a30 2023-09-30T22:22:55.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.247+0000 7fd2577fe700 1 --2- 172.21.15.156:0/181277477 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2580a0a30 0x7fd2580a0e00 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fd248006fd0 tx=0x7fd24800be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b00153638e10c6fd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:55.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.248+0000 7fd2567fc700 1 -- 172.21.15.156:0/181277477 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248005c20 con 0x7fd2580a0a30 2023-09-30T22:22:55.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.248+0000 7fd2567fc700 1 -- 172.21.15.156:0/181277477 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd248005d80 con 0x7fd2580a0a30 2023-09-30T22:22:55.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.248+0000 7fd2567fc700 1 -- 172.21.15.156:0/181277477 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24800db80 con 0x7fd2580a0a30 2023-09-30T22:22:55.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.248+0000 7fd25dacc700 1 -- 172.21.15.156:0/181277477 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2580a0a30 msgr2=0x7fd2580a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.248+0000 7fd25dacc700 1 --2- 172.21.15.156:0/181277477 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2580a0a30 0x7fd2580a0e00 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fd248006fd0 tx=0x7fd24800be70 comp rx=0 tx=0).stop 2023-09-30T22:22:55.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.248+0000 7fd25dacc700 1 -- 172.21.15.156:0/181277477 shutdown_connections 2023-09-30T22:22:55.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.248+0000 7fd25dacc700 1 --2- 172.21.15.156:0/181277477 >> v2:172.21.15.156:3300/0 conn(0x7fd258130670 0x7fd2581381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.248+0000 7fd25dacc700 1 --2- 172.21.15.156:0/181277477 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2580a0a30 0x7fd2580a0e00 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.248+0000 7fd25dacc700 1 -- 172.21.15.156:0/181277477 >> 172.21.15.156:0/181277477 conn(0x7fd2580a2980 msgr2=0x7fd2580a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:55.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.248+0000 7fd25dacc700 1 -- 172.21.15.156:0/181277477 shutdown_connections 2023-09-30T22:22:55.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.248+0000 7fd25dacc700 1 -- 172.21.15.156:0/181277477 wait complete. 2023-09-30T22:22:55.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.250+0000 7fd25dacc700 1 Processor -- start 2023-09-30T22:22:55.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.250+0000 7fd25dacc700 1 -- start start 2023-09-30T22:22:55.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.250+0000 7fd25dacc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2580a0a30 0x7fd2581c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.250+0000 7fd25dacc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2580a1340 0x7fd2581c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.250+0000 7fd25dacc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd258130670 0x7fd2581c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.250+0000 7fd25dacc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd258121a00 con 0x7fd2580a1340 2023-09-30T22:22:55.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.250+0000 7fd25dacc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2581c5c20 con 0x7fd2580a0a30 2023-09-30T22:22:55.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.250+0000 7fd25dacc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd25809ae00 con 0x7fd258130670 2023-09-30T22:22:55.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.251+0000 7fd257fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd258130670 0x7fd2581c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.251+0000 7fd257fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd258130670 0x7fd2581c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54430/0 (socket says 172.21.15.156:54430) 2023-09-30T22:22:55.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.251+0000 7fd257fff700 1 -- 172.21.15.156:0/3419692774 learned_addr learned my addr 172.21.15.156:0/3419692774 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:55.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.251+0000 7fd256ffd700 1 --2- 172.21.15.156:0/3419692774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2580a1340 0x7fd2581c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.251+0000 7fd257fff700 1 -- 172.21.15.156:0/3419692774 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2580a0a30 msgr2=0x7fd2581c51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.251+0000 7fd257fff700 1 --2- 172.21.15.156:0/3419692774 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2580a0a30 0x7fd2581c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.251+0000 7fd257fff700 1 -- 172.21.15.156:0/3419692774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2580a1340 msgr2=0x7fd2581c56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.251+0000 7fd257fff700 1 --2- 172.21.15.156:0/3419692774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2580a1340 0x7fd2581c56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.251+0000 7fd257fff700 1 -- 172.21.15.156:0/3419692774 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24800b7a0 con 0x7fd258130670 2023-09-30T22:22:55.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.251+0000 7fd256ffd700 1 --2- 172.21.15.156:0/3419692774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2580a1340 0x7fd2581c56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:55.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.251+0000 7fd257fff700 1 --2- 172.21.15.156:0/3419692774 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd258130670 0x7fd2581c81c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd25000efc0 tx=0x7fd25000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:55.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.251+0000 7fd23ffff700 1 -- 172.21.15.156:0/3419692774 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd250009ea0 con 0x7fd258130670 2023-09-30T22:22:55.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.251+0000 7fd23ffff700 1 -- 172.21.15.156:0/3419692774 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25000f040 con 0x7fd258130670 2023-09-30T22:22:55.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.251+0000 7fd25dacc700 1 -- 172.21.15.156:0/3419692774 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd258120e00 con 0x7fd258130670 2023-09-30T22:22:55.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.251+0000 7fd23ffff700 1 -- 172.21.15.156:0/3419692774 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd250014480 con 0x7fd258130670 2023-09-30T22:22:55.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.252+0000 7fd25dacc700 1 -- 172.21.15.156:0/3419692774 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd258121fa0 con 0x7fd258130670 2023-09-30T22:22:55.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.252+0000 7fd23ffff700 1 -- 172.21.15.156:0/3419692774 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd2500145e0 con 0x7fd258130670 2023-09-30T22:22:55.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.252+0000 7fd23ffff700 1 -- 172.21.15.156:0/3419692774 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd25003ff90 con 0x7fd258130670 2023-09-30T22:22:55.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.253+0000 7fd25dacc700 1 -- 172.21.15.156:0/3419692774 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd25804f2a0 con 0x7fd258130670 2023-09-30T22:22:55.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.258+0000 7fd23ffff700 1 -- 172.21.15.156:0/3419692774 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd250018070 con 0x7fd258130670 2023-09-30T22:22:55.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.275+0000 7fc3295e2700 1 Processor -- start 2023-09-30T22:22:55.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.275+0000 7fc3295e2700 1 -- start start 2023-09-30T22:22:55.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.275+0000 7fc3295e2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc32409f350 0x7fc324136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.275+0000 7fc3295e2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3241371c0 0x7fc3241395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.275+0000 7fc3295e2700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc32409c970 con 0x7fc32409e870 2023-09-30T22:22:55.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.275+0000 7fc3295e2700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3240a0920 con 0x7fc32409f350 2023-09-30T22:22:55.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.275+0000 7fc3295e2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc32409f9c0 con 0x7fc3241371c0 2023-09-30T22:22:55.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.276+0000 7fc322ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc32409e870 0x7fc32409ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40312/0 (socket says 172.21.15.156:40312) 2023-09-30T22:22:55.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.276+0000 7fc3227fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc32409f350 0x7fc324136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.276+0000 7fc322ffd700 1 -- 172.21.15.156:0/11135293 learned_addr learned my addr 172.21.15.156:0/11135293 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:55.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.276+0000 7fc3227fc700 1 -- 172.21.15.156:0/11135293 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3241371c0 msgr2=0x7fc3241395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:55.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.276+0000 7fc3227fc700 1 --2- 172.21.15.156:0/11135293 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3241371c0 0x7fc3241395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.276+0000 7fc3227fc700 1 -- 172.21.15.156:0/11135293 >> v1:172.21.15.156:6789/0 conn(0x7fc32409e870 legacy=0x7fc32409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.276+0000 7fc321ffb700 1 -- 172.21.15.156:0/11135293 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400960914 0 0) 0x7fc32409c970 con 0x7fc32409e870 2023-09-30T22:22:55.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.276+0000 7fc3227fc700 1 -- 172.21.15.156:0/11135293 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32409bab0 con 0x7fc32409f350 2023-09-30T22:22:55.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.276+0000 7fc3227fc700 1 --2- 172.21.15.156:0/11135293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc32409f350 0x7fc324136c80 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fc318009840 tx=0x7fc318009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b4031fe3a3a5c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:55.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.276+0000 7fc321ffb700 1 -- 172.21.15.156:0/11135293 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318011830 con 0x7fc32409f350 2023-09-30T22:22:55.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.276+0000 7fc321ffb700 1 -- 172.21.15.156:0/11135293 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc318011990 con 0x7fc32409f350 2023-09-30T22:22:55.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.276+0000 7fc321ffb700 1 -- 172.21.15.156:0/11135293 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318011d20 con 0x7fc32409f350 2023-09-30T22:22:55.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.277+0000 7fc3295e2700 1 -- 172.21.15.156:0/11135293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc32409f350 msgr2=0x7fc324136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.277+0000 7fc3295e2700 1 --2- 172.21.15.156:0/11135293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc32409f350 0x7fc324136c80 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fc318009840 tx=0x7fc318009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:55.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.277+0000 7fc3295e2700 1 -- 172.21.15.156:0/11135293 shutdown_connections 2023-09-30T22:22:55.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.277+0000 7fc3295e2700 1 --2- 172.21.15.156:0/11135293 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3241371c0 0x7fc3241395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.277+0000 7fc3295e2700 1 --2- 172.21.15.156:0/11135293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc32409f350 0x7fc324136c80 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.277+0000 7fc3295e2700 1 -- 172.21.15.156:0/11135293 >> 172.21.15.156:0/11135293 conn(0x7fc3240a4430 msgr2=0x7fc3240a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:55.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.277+0000 7fc3295e2700 1 -- 172.21.15.156:0/11135293 shutdown_connections 2023-09-30T22:22:55.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.277+0000 7fc3295e2700 1 -- 172.21.15.156:0/11135293 wait complete. 2023-09-30T22:22:55.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.278+0000 7fc3295e2700 1 Processor -- start 2023-09-30T22:22:55.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.278+0000 7fc3295e2700 1 -- start start 2023-09-30T22:22:55.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.279+0000 7fc3295e2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc32409e870 0x7fc324123270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.279+0000 7fc3295e2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc32409f350 0x7fc324121a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.279+0000 7fc3295e2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3241371c0 0x7fc324121fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.279+0000 7fc3295e2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32411fa20 con 0x7fc32409f350 2023-09-30T22:22:55.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.279+0000 7fc3295e2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3241208f0 con 0x7fc32409e870 2023-09-30T22:22:55.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.279+0000 7fc3295e2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc324072350 con 0x7fc3241371c0 2023-09-30T22:22:55.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.279+0000 7fc322ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc32409e870 0x7fc324123270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.279+0000 7fc322ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc32409e870 0x7fc324123270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46410/0 (socket says 172.21.15.156:46410) 2023-09-30T22:22:55.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.279+0000 7fc322ffd700 1 -- 172.21.15.156:0/3612033809 learned_addr learned my addr 172.21.15.156:0/3612033809 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:55.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.279+0000 7fc3227fc700 1 --2- 172.21.15.156:0/3612033809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc32409f350 0x7fc324121a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.280+0000 7fc322ffd700 1 -- 172.21.15.156:0/3612033809 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3241371c0 msgr2=0x7fc324121fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.280+0000 7fc322ffd700 1 --2- 172.21.15.156:0/3612033809 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3241371c0 0x7fc324121fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.280+0000 7fc322ffd700 1 -- 172.21.15.156:0/3612033809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc32409f350 msgr2=0x7fc324121a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.280+0000 7fc322ffd700 1 --2- 172.21.15.156:0/3612033809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc32409f350 0x7fc324121a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.280+0000 7fc322ffd700 1 -- 172.21.15.156:0/3612033809 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3180094a0 con 0x7fc32409e870 2023-09-30T22:22:55.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.280+0000 7fc3227fc700 1 --2- 172.21.15.156:0/3612033809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc32409f350 0x7fc324121a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:55.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.280+0000 7fc322ffd700 1 --2- 172.21.15.156:0/3612033809 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc32409e870 0x7fc324123270 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc31400c520 tx=0x7fc31400c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:55.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.280+0000 7fc30b7fe700 1 -- 172.21.15.156:0/3612033809 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc314004c80 con 0x7fc32409e870 2023-09-30T22:22:55.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.280+0000 7fc30b7fe700 1 -- 172.21.15.156:0/3612033809 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc314004de0 con 0x7fc32409e870 2023-09-30T22:22:55.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.280+0000 7fc3295e2700 1 -- 172.21.15.156:0/3612033809 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc32406d4e0 con 0x7fc32409e870 2023-09-30T22:22:55.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.280+0000 7fc30b7fe700 1 -- 172.21.15.156:0/3612033809 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc314007310 con 0x7fc32409e870 2023-09-30T22:22:55.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.280+0000 7fc3295e2700 1 -- 172.21.15.156:0/3612033809 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc324121620 con 0x7fc32409e870 2023-09-30T22:22:55.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.281+0000 7fc3295e2700 1 -- 172.21.15.156:0/3612033809 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc32404f2a0 con 0x7fc32409e870 2023-09-30T22:22:55.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.281+0000 7fc30b7fe700 1 -- 172.21.15.156:0/3612033809 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc314007470 con 0x7fc32409e870 2023-09-30T22:22:55.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.281+0000 7fc30b7fe700 1 -- 172.21.15.156:0/3612033809 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc3140135a0 con 0x7fc32409e870 2023-09-30T22:22:55.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.286+0000 7fc30b7fe700 1 -- 172.21.15.156:0/3612033809 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc314044060 con 0x7fc32409e870 2023-09-30T22:22:55.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.418+0000 7f55b3964700 1 -- 172.21.15.156:0/21940372 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f55ac04f2a0 con 0x7f55ac06a770 2023-09-30T22:22:55.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.418+0000 7f55a1ffb700 1 -- 172.21.15.156:0/21940372 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f55a8017030 con 0x7f55ac06a770 2023-09-30T22:22:55.418 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:55.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.420+0000 7f55b3964700 1 -- 172.21.15.156:0/21940372 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55ac06a770 msgr2=0x7f55ac11e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.420+0000 7f55b3964700 1 --2- 172.21.15.156:0/21940372 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55ac06a770 0x7f55ac11e330 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f55a8001eb0 tx=0x7f55a800c800 comp rx=0 tx=0).stop 2023-09-30T22:22:55.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.421+0000 7f55b3964700 1 -- 172.21.15.156:0/21940372 shutdown_connections 2023-09-30T22:22:55.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.421+0000 7f55b3964700 1 --2- 172.21.15.156:0/21940372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55ac137140 0x7f55ac11edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.421+0000 7f55b3964700 1 --2- 172.21.15.156:0/21940372 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f55ac06a770 0x7f55ac11e330 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.421+0000 7f55b3964700 1 --2- 172.21.15.156:0/21940372 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f55ac06b250 0x7f55ac11e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.421+0000 7f55b3964700 1 -- 172.21.15.156:0/21940372 >> 172.21.15.156:0/21940372 conn(0x7f55ac099c40 msgr2=0x7f55ac0a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:55.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.421+0000 7f55b3964700 1 -- 172.21.15.156:0/21940372 shutdown_connections 2023-09-30T22:22:55.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.421+0000 7f55b3964700 1 -- 172.21.15.156:0/21940372 wait complete. 2023-09-30T22:22:55.432 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:55.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.452+0000 7fd25dacc700 1 -- 172.21.15.156:0/3419692774 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd25806bce0 con 0x7fd258130670 2023-09-30T22:22:55.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.453+0000 7fd23ffff700 1 -- 172.21.15.156:0/3419692774 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd25002b090 con 0x7fd258130670 2023-09-30T22:22:55.452 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:55.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.455+0000 7fd25dacc700 1 -- 172.21.15.156:0/3419692774 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd258130670 msgr2=0x7fd2581c81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.455+0000 7fd25dacc700 1 --2- 172.21.15.156:0/3419692774 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd258130670 0x7fd2581c81c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd25000efc0 tx=0x7fd25000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.455+0000 7fd25dacc700 1 -- 172.21.15.156:0/3419692774 shutdown_connections 2023-09-30T22:22:55.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.455+0000 7fd25dacc700 1 --2- 172.21.15.156:0/3419692774 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd258130670 0x7fd2581c81c0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.455+0000 7fd25dacc700 1 --2- 172.21.15.156:0/3419692774 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2580a0a30 0x7fd2581c51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.455+0000 7fd25dacc700 1 --2- 172.21.15.156:0/3419692774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2580a1340 0x7fd2581c56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.455+0000 7fd25dacc700 1 -- 172.21.15.156:0/3419692774 >> 172.21.15.156:0/3419692774 conn(0x7fd2580a2980 msgr2=0x7fd25812f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:55.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.455+0000 7fd25dacc700 1 -- 172.21.15.156:0/3419692774 shutdown_connections 2023-09-30T22:22:55.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.455+0000 7fd25dacc700 1 -- 172.21.15.156:0/3419692774 wait complete. 2023-09-30T22:22:55.467 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:55.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.473+0000 7f9cac535700 1 -- 172.21.15.156:0/3495871307 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9ca404f2a0 con 0x7f9ca4130a60 2023-09-30T22:22:55.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.473+0000 7f9c9affd700 1 -- 172.21.15.156:0/3495871307 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9c9c02c090 con 0x7f9ca4130a60 2023-09-30T22:22:55.473 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:55.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.475+0000 7f9cac535700 1 -- 172.21.15.156:0/3495871307 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ca4130a60 msgr2=0x7f9ca4134790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.475+0000 7f9cac535700 1 --2- 172.21.15.156:0/3495871307 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ca4130a60 0x7f9ca4134790 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c00efc0 tx=0x7f9c9c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.475+0000 7f9cac535700 1 -- 172.21.15.156:0/3495871307 shutdown_connections 2023-09-30T22:22:55.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.475+0000 7f9cac535700 1 --2- 172.21.15.156:0/3495871307 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ca4130a60 0x7f9ca4134790 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.475+0000 7f9cac535700 1 --2- 172.21.15.156:0/3495871307 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ca4099e20 0x7f9ca4133d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.475+0000 7f9cac535700 1 --2- 172.21.15.156:0/3495871307 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ca409a730 0x7f9ca4134250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.475+0000 7f9cac535700 1 -- 172.21.15.156:0/3495871307 >> 172.21.15.156:0/3495871307 conn(0x7f9ca40a2980 msgr2=0x7f9ca409f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:55.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.476+0000 7f9cac535700 1 -- 172.21.15.156:0/3495871307 shutdown_connections 2023-09-30T22:22:55.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.476+0000 7f9cac535700 1 -- 172.21.15.156:0/3495871307 wait complete. 2023-09-30T22:22:55.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.481+0000 7fc3295e2700 1 -- 172.21.15.156:0/3612033809 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc32406b2a0 con 0x7fc32409e870 2023-09-30T22:22:55.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.481+0000 7fc30b7fe700 1 -- 172.21.15.156:0/3612033809 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc314044020 con 0x7fc32409e870 2023-09-30T22:22:55.480 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:55.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.483+0000 7fc3295e2700 1 -- 172.21.15.156:0/3612033809 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc32409e870 msgr2=0x7fc324123270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.483+0000 7fc3295e2700 1 --2- 172.21.15.156:0/3612033809 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc32409e870 0x7fc324123270 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc31400c520 tx=0x7fc31400c830 comp rx=0 tx=0).stop 2023-09-30T22:22:55.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.483+0000 7fc3295e2700 1 -- 172.21.15.156:0/3612033809 shutdown_connections 2023-09-30T22:22:55.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.483+0000 7fc3295e2700 1 --2- 172.21.15.156:0/3612033809 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc3241371c0 0x7fc324121fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.483+0000 7fc3295e2700 1 --2- 172.21.15.156:0/3612033809 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc32409e870 0x7fc324123270 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.483+0000 7fc3295e2700 1 --2- 172.21.15.156:0/3612033809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc32409f350 0x7fc324121a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.483+0000 7fc3295e2700 1 -- 172.21.15.156:0/3612033809 >> 172.21.15.156:0/3612033809 conn(0x7fc3240a4430 msgr2=0x7fc3240a2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:55.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.483+0000 7fc3295e2700 1 -- 172.21.15.156:0/3612033809 shutdown_connections 2023-09-30T22:22:55.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:55.483+0000 7fc3295e2700 1 -- 172.21.15.156:0/3612033809 wait complete. 2023-09-30T22:22:55.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:55.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:56.433 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:56.467 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:56.489 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:56.496 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:56.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.587+0000 7f8c7dc6b700 1 Processor -- start 2023-09-30T22:22:56.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.587+0000 7f8c7dc6b700 1 -- start start 2023-09-30T22:22:56.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.588+0000 7f8c7dc6b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c780a0a30 0x7f8c780a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.588+0000 7f8c7dc6b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8c780a1340 0x7f8c7812ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.588+0000 7f8c7dc6b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c781304a0 0x7f8c78130940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.588+0000 7f8c7dc6b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c780a1e70 con 0x7f8c780a1340 2023-09-30T22:22:56.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.588+0000 7f8c7dc6b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7809a720 con 0x7f8c780a0a30 2023-09-30T22:22:56.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.588+0000 7f8c7dc6b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7809b300 con 0x7f8c781304a0 2023-09-30T22:22:56.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.588+0000 7f8c777fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c780a0a30 0x7f8c780a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.588+0000 7f8c777fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c780a0a30 0x7f8c780a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46414/0 (socket says 172.21.15.156:46414) 2023-09-30T22:22:56.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.588+0000 7f8c777fe700 1 -- 172.21.15.156:0/2251554824 learned_addr learned my addr 172.21.15.156:0/2251554824 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:56.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.588+0000 7f8c77fff700 1 --2- 172.21.15.156:0/2251554824 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c781304a0 0x7f8c78130940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.589+0000 7f8c76ffd700 1 --2- 172.21.15.156:0/2251554824 >> v2:172.21.15.156:3300/0 conn(0x7f8c780a1340 0x7f8c7812ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.589+0000 7f8c777fe700 1 -- 172.21.15.156:0/2251554824 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c781304a0 msgr2=0x7f8c78130940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:56.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.589+0000 7f8c777fe700 1 --2- 172.21.15.156:0/2251554824 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c781304a0 0x7f8c78130940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.589+0000 7f8c777fe700 1 -- 172.21.15.156:0/2251554824 >> v2:172.21.15.156:3300/0 conn(0x7f8c780a1340 msgr2=0x7f8c7812ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:56.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.589+0000 7f8c777fe700 1 --2- 172.21.15.156:0/2251554824 >> v2:172.21.15.156:3300/0 conn(0x7f8c780a1340 0x7f8c7812ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.589+0000 7f8c777fe700 1 -- 172.21.15.156:0/2251554824 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7809abc0 con 0x7f8c780a0a30 2023-09-30T22:22:56.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.589+0000 7f8c777fe700 1 --2- 172.21.15.156:0/2251554824 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c780a0a30 0x7f8c780a0e00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8c68006fd0 tx=0x7f8c6800be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55014fe13e42d97a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:56.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.589+0000 7f8c767fc700 1 -- 172.21.15.156:0/2251554824 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68005c20 con 0x7f8c780a0a30 2023-09-30T22:22:56.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.589+0000 7f8c767fc700 1 -- 172.21.15.156:0/2251554824 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c68005d80 con 0x7f8c780a0a30 2023-09-30T22:22:56.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.589+0000 7f8c767fc700 1 -- 172.21.15.156:0/2251554824 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6800db80 con 0x7f8c780a0a30 2023-09-30T22:22:56.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.590+0000 7f8c7dc6b700 1 -- 172.21.15.156:0/2251554824 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c780a0a30 msgr2=0x7f8c780a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.590+0000 7f8c7dc6b700 1 --2- 172.21.15.156:0/2251554824 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c780a0a30 0x7f8c780a0e00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8c68006fd0 tx=0x7f8c6800be70 comp rx=0 tx=0).stop 2023-09-30T22:22:56.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.590+0000 7f8c7dc6b700 1 -- 172.21.15.156:0/2251554824 shutdown_connections 2023-09-30T22:22:56.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.590+0000 7f8c7dc6b700 1 --2- 172.21.15.156:0/2251554824 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c781304a0 0x7f8c78130940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.590+0000 7f8c7dc6b700 1 --2- 172.21.15.156:0/2251554824 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c780a0a30 0x7f8c780a0e00 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.590+0000 7f8c7dc6b700 1 --2- 172.21.15.156:0/2251554824 >> v2:172.21.15.156:3300/0 conn(0x7f8c780a1340 0x7f8c7812ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.590+0000 7f8c7dc6b700 1 -- 172.21.15.156:0/2251554824 >> 172.21.15.156:0/2251554824 conn(0x7f8c780a2980 msgr2=0x7f8c780a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:56.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.590+0000 7f8c7dc6b700 1 -- 172.21.15.156:0/2251554824 shutdown_connections 2023-09-30T22:22:56.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.590+0000 7f8c7dc6b700 1 -- 172.21.15.156:0/2251554824 wait complete. 2023-09-30T22:22:56.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.591+0000 7f8c7dc6b700 1 Processor -- start 2023-09-30T22:22:56.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.592+0000 7f8c7dc6b700 1 -- start start 2023-09-30T22:22:56.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.592+0000 7f8c7dc6b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c780a0a30 0x7f8c781c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.592+0000 7f8c7dc6b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c780a1340 0x7f8c781c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.592+0000 7f8c7dc6b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c781304a0 0x7f8c781c4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.592+0000 7f8c7dc6b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7811cdd0 con 0x7f8c780a0a30 2023-09-30T22:22:56.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.592+0000 7f8c7dc6b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7811d420 con 0x7f8c780a1340 2023-09-30T22:22:56.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.592+0000 7f8c7dc6b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7811ece0 con 0x7f8c781304a0 2023-09-30T22:22:56.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.592+0000 7f8c77fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c781304a0 0x7f8c781c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.592+0000 7f8c77fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c781304a0 0x7f8c781c4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54458/0 (socket says 172.21.15.156:54458) 2023-09-30T22:22:56.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.592+0000 7f8c77fff700 1 -- 172.21.15.156:0/4212257753 learned_addr learned my addr 172.21.15.156:0/4212257753 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:56.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.592+0000 7f8c777fe700 1 --2- 172.21.15.156:0/4212257753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c780a0a30 0x7f8c781c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.592+0000 7f8c76ffd700 1 --2- 172.21.15.156:0/4212257753 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c780a1340 0x7f8c781c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.593+0000 7f8c77fff700 1 -- 172.21.15.156:0/4212257753 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c780a1340 msgr2=0x7f8c781c4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.593+0000 7f8c77fff700 1 --2- 172.21.15.156:0/4212257753 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c780a1340 0x7f8c781c4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.593+0000 7f8c77fff700 1 -- 172.21.15.156:0/4212257753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c780a0a30 msgr2=0x7f8c781c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.593+0000 7f8c77fff700 1 --2- 172.21.15.156:0/4212257753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c780a0a30 0x7f8c781c3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.593+0000 7f8c77fff700 1 -- 172.21.15.156:0/4212257753 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6800b7a0 con 0x7f8c781304a0 2023-09-30T22:22:56.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.593+0000 7f8c77fff700 1 --2- 172.21.15.156:0/4212257753 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c781304a0 0x7f8c781c4890 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8c7000efc0 tx=0x7f8c7000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:56.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.593+0000 7f8c5ffff700 1 -- 172.21.15.156:0/4212257753 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c70009ea0 con 0x7f8c781304a0 2023-09-30T22:22:56.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.593+0000 7f8c5ffff700 1 -- 172.21.15.156:0/4212257753 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7000f040 con 0x7f8c781304a0 2023-09-30T22:22:56.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.593+0000 7f8c7dc6b700 1 -- 172.21.15.156:0/4212257753 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7809fc60 con 0x7f8c781304a0 2023-09-30T22:22:56.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.593+0000 7f8c7dc6b700 1 -- 172.21.15.156:0/4212257753 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7811d5c0 con 0x7f8c781304a0 2023-09-30T22:22:56.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.593+0000 7f8c5ffff700 1 -- 172.21.15.156:0/4212257753 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c70014480 con 0x7f8c781304a0 2023-09-30T22:22:56.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.594+0000 7f8c5ffff700 1 -- 172.21.15.156:0/4212257753 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c700145e0 con 0x7f8c781304a0 2023-09-30T22:22:56.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.594+0000 7f8c7dc6b700 1 -- 172.21.15.156:0/4212257753 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c580052e0 con 0x7f8c781304a0 2023-09-30T22:22:56.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.594+0000 7f8c5ffff700 1 -- 172.21.15.156:0/4212257753 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8c7003ff50 con 0x7f8c781304a0 2023-09-30T22:22:56.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.599+0000 7f8c5ffff700 1 -- 172.21.15.156:0/4212257753 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c700118b0 con 0x7f8c781304a0 2023-09-30T22:22:56.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.630+0000 7fb0dd156700 1 Processor -- start 2023-09-30T22:22:56.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.630+0000 7fb0dd156700 1 -- start start 2023-09-30T22:22:56.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.631+0000 7fb0dd156700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0d80a0a70 0x7fb0d80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.631+0000 7fb0dd156700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0d80a1380 0x7fb0d8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.631+0000 7fb0dd156700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb0d8133f50 0x7fb0d81343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.631+0000 7fb0dd156700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d809e9d0 con 0x7fb0d8133f50 2023-09-30T22:22:56.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.631+0000 7fb0dd156700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d809dc00 con 0x7fb0d80a0a70 2023-09-30T22:22:56.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.631+0000 7fb0dd156700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d809dec0 con 0x7fb0d80a1380 2023-09-30T22:22:56.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.631+0000 7fb0d659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0d80a1380 0x7fb0d8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.631+0000 7fb0d659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0d80a1380 0x7fb0d8133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54460/0 (socket says 172.21.15.156:54460) 2023-09-30T22:22:56.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.631+0000 7fb0d659c700 1 -- 172.21.15.156:0/3838116435 learned_addr learned my addr 172.21.15.156:0/3838116435 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:56.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.631+0000 7fb0d6d9d700 1 --2- 172.21.15.156:0/3838116435 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0d80a0a70 0x7fb0d80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.631+0000 7fb0d759e700 1 --2- 172.21.15.156:0/3838116435 >> v2:172.21.15.156:3300/0 conn(0x7fb0d8133f50 0x7fb0d81343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.631+0000 7fb0d6d9d700 1 -- 172.21.15.156:0/3838116435 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0d80a1380 msgr2=0x7fb0d8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:56.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.631+0000 7fb0d6d9d700 1 --2- 172.21.15.156:0/3838116435 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0d80a1380 0x7fb0d8133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.631+0000 7fb0d6d9d700 1 -- 172.21.15.156:0/3838116435 >> v2:172.21.15.156:3300/0 conn(0x7fb0d8133f50 msgr2=0x7fb0d81343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:56.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.631+0000 7fb0d6d9d700 1 --2- 172.21.15.156:0/3838116435 >> v2:172.21.15.156:3300/0 conn(0x7fb0d8133f50 0x7fb0d81343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.631+0000 7fb0d6d9d700 1 -- 172.21.15.156:0/3838116435 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d809e6a0 con 0x7fb0d80a0a70 2023-09-30T22:22:56.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.631+0000 7fb0d759e700 1 --2- 172.21.15.156:0/3838116435 >> v2:172.21.15.156:3300/0 conn(0x7fb0d8133f50 0x7fb0d81343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:56.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.632+0000 7fb0d6d9d700 1 --2- 172.21.15.156:0/3838116435 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0d80a0a70 0x7fb0d80a0e40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8009840 tx=0x7fb0c8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0fad8ad856733f9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:56.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.632+0000 7fb0d5d9b700 1 -- 172.21.15.156:0/3838116435 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8011830 con 0x7fb0d80a0a70 2023-09-30T22:22:56.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.632+0000 7fb0d5d9b700 1 -- 172.21.15.156:0/3838116435 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c8011990 con 0x7fb0d80a0a70 2023-09-30T22:22:56.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.632+0000 7fb0d5d9b700 1 -- 172.21.15.156:0/3838116435 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8011d20 con 0x7fb0d80a0a70 2023-09-30T22:22:56.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.633+0000 7fb0dd156700 1 -- 172.21.15.156:0/3838116435 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0d80a0a70 msgr2=0x7fb0d80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.633+0000 7fb0dd156700 1 --2- 172.21.15.156:0/3838116435 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0d80a0a70 0x7fb0d80a0e40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8009840 tx=0x7fb0c8009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:56.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.633+0000 7fb0dd156700 1 -- 172.21.15.156:0/3838116435 shutdown_connections 2023-09-30T22:22:56.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.633+0000 7fb0dd156700 1 --2- 172.21.15.156:0/3838116435 >> v2:172.21.15.156:3300/0 conn(0x7fb0d8133f50 0x7fb0d81343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.633+0000 7fb0dd156700 1 --2- 172.21.15.156:0/3838116435 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0d80a0a70 0x7fb0d80a0e40 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.633+0000 7fb0dd156700 1 --2- 172.21.15.156:0/3838116435 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0d80a1380 0x7fb0d8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.633+0000 7fb0dd156700 1 -- 172.21.15.156:0/3838116435 >> 172.21.15.156:0/3838116435 conn(0x7fb0d80a6610 msgr2=0x7fb0d80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:56.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.633+0000 7fb0dd156700 1 -- 172.21.15.156:0/3838116435 shutdown_connections 2023-09-30T22:22:56.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.633+0000 7fb0dd156700 1 -- 172.21.15.156:0/3838116435 wait complete. 2023-09-30T22:22:56.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.634+0000 7fb0dd156700 1 Processor -- start 2023-09-30T22:22:56.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.634+0000 7fb0dd156700 1 -- start start 2023-09-30T22:22:56.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.634+0000 7fb0dd156700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0d80a0a70 0x7fb0d81223a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.634+0000 7fb0dd156700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0d80a1380 0x7fb0d81228e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.634+0000 7fb0dd156700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0d8133f50 0x7fb0d8122e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.634+0000 7fb0dd156700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d8124150 con 0x7fb0d8133f50 2023-09-30T22:22:56.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.634+0000 7fb0dd156700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d8123f60 con 0x7fb0d80a1380 2023-09-30T22:22:56.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.634+0000 7fb0dd156700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d8124e30 con 0x7fb0d80a0a70 2023-09-30T22:22:56.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.635+0000 7fb0d759e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0d8133f50 0x7fb0d8122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.635+0000 7fb0d759e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0d8133f50 0x7fb0d8122e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40220/0 (socket says 172.21.15.156:40220) 2023-09-30T22:22:56.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.635+0000 7fb0d759e700 1 -- 172.21.15.156:0/479772204 learned_addr learned my addr 172.21.15.156:0/479772204 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:56.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.635+0000 7fb0d659c700 1 --2- 172.21.15.156:0/479772204 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0d80a1380 0x7fb0d81228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.635+0000 7fb0d6d9d700 1 --2- 172.21.15.156:0/479772204 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0d80a0a70 0x7fb0d81223a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.635+0000 7fb0d759e700 1 -- 172.21.15.156:0/479772204 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0d80a0a70 msgr2=0x7fb0d81223a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.635+0000 7fb0d759e700 1 --2- 172.21.15.156:0/479772204 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0d80a0a70 0x7fb0d81223a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.635+0000 7fb0d759e700 1 -- 172.21.15.156:0/479772204 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0d80a1380 msgr2=0x7fb0d81228e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.635+0000 7fb0d759e700 1 --2- 172.21.15.156:0/479772204 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0d80a1380 0x7fb0d81228e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.635+0000 7fb0d759e700 1 -- 172.21.15.156:0/479772204 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d0009a70 con 0x7fb0d8133f50 2023-09-30T22:22:56.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.635+0000 7fb0d759e700 1 --2- 172.21.15.156:0/479772204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0d8133f50 0x7fb0d8122e20 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0009f00 tx=0x7fb0d000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:56.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.636+0000 7fb0bf7fe700 1 -- 172.21.15.156:0/479772204 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0009d70 con 0x7fb0d8133f50 2023-09-30T22:22:56.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.636+0000 7fb0bf7fe700 1 -- 172.21.15.156:0/479772204 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d000f040 con 0x7fb0d8133f50 2023-09-30T22:22:56.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.636+0000 7fb0dd156700 1 -- 172.21.15.156:0/479772204 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c80094a0 con 0x7fb0d8133f50 2023-09-30T22:22:56.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.636+0000 7fb0bf7fe700 1 -- 172.21.15.156:0/479772204 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0003a20 con 0x7fb0d8133f50 2023-09-30T22:22:56.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.636+0000 7fb0dd156700 1 -- 172.21.15.156:0/479772204 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d8125b90 con 0x7fb0d8133f50 2023-09-30T22:22:56.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.637+0000 7fb0bf7fe700 1 -- 172.21.15.156:0/479772204 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb0d000c930 con 0x7fb0d8133f50 2023-09-30T22:22:56.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.638+0000 7fb0bf7fe700 1 -- 172.21.15.156:0/479772204 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb0d0048220 con 0x7fb0d8133f50 2023-09-30T22:22:56.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.638+0000 7fb0dd156700 1 -- 172.21.15.156:0/479772204 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d8125740 con 0x7fb0d8133f50 2023-09-30T22:22:56.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.643+0000 7fb0bf7fe700 1 -- 172.21.15.156:0/479772204 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb0d000cbe0 con 0x7fb0d8133f50 2023-09-30T22:22:56.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.661+0000 7ff0cd58c700 1 Processor -- start 2023-09-30T22:22:56.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.661+0000 7ff0cd58c700 1 -- start start 2023-09-30T22:22:56.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.661+0000 7ff0cd58c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff0c8133ad0 0x7ff0c8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.661+0000 7ff0cd58c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0c81300a0 0x7ff0c81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.661+0000 7ff0cd58c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c806b2d0 con 0x7ff0c81309f0 2023-09-30T22:22:56.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.661+0000 7ff0cd58c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c8133610 con 0x7ff0c8133ad0 2023-09-30T22:22:56.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.661+0000 7ff0cd58c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c809a500 con 0x7ff0c81300a0 2023-09-30T22:22:56.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.662+0000 7ff0c77fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff0c81309f0 0x7ff0c813a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40316/0 (socket says 172.21.15.156:40316) 2023-09-30T22:22:56.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.662+0000 7ff0c77fe700 1 -- 172.21.15.156:0/924760219 learned_addr learned my addr 172.21.15.156:0/924760219 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:56.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.662+0000 7ff0c6ffd700 1 --2- 172.21.15.156:0/924760219 >> v2:172.21.15.156:3300/0 conn(0x7ff0c8133ad0 0x7ff0c8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.662+0000 7ff0c67fc700 1 --2- 172.21.15.156:0/924760219 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0c81300a0 0x7ff0c81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.662+0000 7ff0c6ffd700 1 -- 172.21.15.156:0/924760219 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0c81300a0 msgr2=0x7ff0c81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:56.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.662+0000 7ff0c6ffd700 1 --2- 172.21.15.156:0/924760219 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0c81300a0 0x7ff0c81304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.662+0000 7ff0c6ffd700 1 -- 172.21.15.156:0/924760219 >> v1:172.21.15.156:6789/0 conn(0x7ff0c81309f0 legacy=0x7ff0c813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.662+0000 7ff0c6ffd700 1 -- 172.21.15.156:0/924760219 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c81338b0 con 0x7ff0c8133ad0 2023-09-30T22:22:56.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.662+0000 7ff0c6ffd700 1 --2- 172.21.15.156:0/924760219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0c8133ad0 0x7ff0c8133ea0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8009840 tx=0x7ff0b8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c0010c8209ddf05 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:56.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.662+0000 7ff0c5ffb700 1 -- 172.21.15.156:0/924760219 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8011830 con 0x7ff0c8133ad0 2023-09-30T22:22:56.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.662+0000 7ff0c5ffb700 1 -- 172.21.15.156:0/924760219 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b8011990 con 0x7ff0c8133ad0 2023-09-30T22:22:56.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.662+0000 7ff0c5ffb700 1 -- 172.21.15.156:0/924760219 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8011d20 con 0x7ff0c8133ad0 2023-09-30T22:22:56.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.663+0000 7ff0cd58c700 1 -- 172.21.15.156:0/924760219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0c8133ad0 msgr2=0x7ff0c8133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.663+0000 7ff0cd58c700 1 --2- 172.21.15.156:0/924760219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0c8133ad0 0x7ff0c8133ea0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8009840 tx=0x7ff0b8009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:56.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.663+0000 7ff0cd58c700 1 -- 172.21.15.156:0/924760219 shutdown_connections 2023-09-30T22:22:56.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.663+0000 7ff0cd58c700 1 --2- 172.21.15.156:0/924760219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0c8133ad0 0x7ff0c8133ea0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.663+0000 7ff0cd58c700 1 --2- 172.21.15.156:0/924760219 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0c81300a0 0x7ff0c81304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.663+0000 7ff0cd58c700 1 -- 172.21.15.156:0/924760219 >> 172.21.15.156:0/924760219 conn(0x7ff0c8099c40 msgr2=0x7ff0c80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:56.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.663+0000 7ff0cd58c700 1 -- 172.21.15.156:0/924760219 shutdown_connections 2023-09-30T22:22:56.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.663+0000 7ff0cd58c700 1 -- 172.21.15.156:0/924760219 wait complete. 2023-09-30T22:22:56.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.664+0000 7ff0cd58c700 1 Processor -- start 2023-09-30T22:22:56.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.664+0000 7ff0cd58c700 1 -- start start 2023-09-30T22:22:56.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.665+0000 7ff0cd58c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0c81300a0 0x7ff0c811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.665+0000 7ff0cd58c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0c81309f0 0x7ff0c811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.665+0000 7ff0cd58c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0c8133ad0 0x7ff0c811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.665+0000 7ff0cd58c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c812d300 con 0x7ff0c8133ad0 2023-09-30T22:22:56.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.665+0000 7ff0cd58c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c811ff40 con 0x7ff0c81300a0 2023-09-30T22:22:56.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.665+0000 7ff0cd58c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c812fe00 con 0x7ff0c81309f0 2023-09-30T22:22:56.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.665+0000 7ff0c77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0c8133ad0 0x7ff0c811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.665+0000 7ff0c77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0c8133ad0 0x7ff0c811e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40246/0 (socket says 172.21.15.156:40246) 2023-09-30T22:22:56.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.665+0000 7ff0c67fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0c81309f0 0x7ff0c811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.665+0000 7ff0c77fe700 1 -- 172.21.15.156:0/3023174449 learned_addr learned my addr 172.21.15.156:0/3023174449 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:56.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.665+0000 7ff0c6ffd700 1 --2- 172.21.15.156:0/3023174449 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0c81300a0 0x7ff0c811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.665+0000 7ff0c67fc700 1 -- 172.21.15.156:0/3023174449 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0c81300a0 msgr2=0x7ff0c811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.665+0000 7ff0c67fc700 1 --2- 172.21.15.156:0/3023174449 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0c81300a0 0x7ff0c811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.665+0000 7ff0c67fc700 1 -- 172.21.15.156:0/3023174449 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0c8133ad0 msgr2=0x7ff0c811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.665+0000 7ff0c67fc700 1 --2- 172.21.15.156:0/3023174449 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0c8133ad0 0x7ff0c811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.665+0000 7ff0c67fc700 1 -- 172.21.15.156:0/3023174449 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b80094a0 con 0x7ff0c81309f0 2023-09-30T22:22:56.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.665+0000 7ff0c77fe700 1 --2- 172.21.15.156:0/3023174449 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0c8133ad0 0x7ff0c811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:56.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.665+0000 7ff0c67fc700 1 --2- 172.21.15.156:0/3023174449 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0c81309f0 0x7ff0c811df80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc009f30 tx=0x7ff0bc00eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:56.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.666+0000 7ff0af7fe700 1 -- 172.21.15.156:0/3023174449 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc024690 con 0x7ff0c81309f0 2023-09-30T22:22:56.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.666+0000 7ff0af7fe700 1 -- 172.21.15.156:0/3023174449 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0bc0247f0 con 0x7ff0c81309f0 2023-09-30T22:22:56.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.666+0000 7ff0af7fe700 1 -- 172.21.15.156:0/3023174449 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc024ba0 con 0x7ff0c81309f0 2023-09-30T22:22:56.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.666+0000 7ff0cd58c700 1 -- 172.21.15.156:0/3023174449 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c812dd00 con 0x7ff0c81309f0 2023-09-30T22:22:56.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.666+0000 7ff0cd58c700 1 -- 172.21.15.156:0/3023174449 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c8071980 con 0x7ff0c81309f0 2023-09-30T22:22:56.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.667+0000 7ff0af7fe700 1 -- 172.21.15.156:0/3023174449 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff0bc024d00 con 0x7ff0c81309f0 2023-09-30T22:22:56.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.667+0000 7ff0cd58c700 1 -- 172.21.15.156:0/3023174449 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c8072390 con 0x7ff0c81309f0 2023-09-30T22:22:56.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.667+0000 7ff0af7fe700 1 -- 172.21.15.156:0/3023174449 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff0bc050550 con 0x7ff0c81309f0 2023-09-30T22:22:56.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.671+0000 7ff0af7fe700 1 -- 172.21.15.156:0/3023174449 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0bc02cc10 con 0x7ff0c81309f0 2023-09-30T22:22:56.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.685+0000 7f39a2486700 1 Processor -- start 2023-09-30T22:22:56.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.685+0000 7f39a2486700 1 -- start start 2023-09-30T22:22:56.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.685+0000 7f39a2486700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f399c09e870 0x7f399c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.685+0000 7f39a2486700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f399c09f180 0x7f399c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.685+0000 7f39a2486700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399c09c970 con 0x7f399c131d70 2023-09-30T22:22:56.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.685+0000 7f39a2486700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399c0a0920 con 0x7f399c09f180 2023-09-30T22:22:56.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.685+0000 7f39a2486700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f399c09f9c0 con 0x7f399c09e870 2023-09-30T22:22:56.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.686+0000 7f399b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f399c09f180 0x7f399c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.686+0000 7f399b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f399c09f180 0x7f399c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46476/0 (socket says 172.21.15.156:46476) 2023-09-30T22:22:56.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.686+0000 7f399b7fe700 1 -- 172.21.15.156:0/312258482 learned_addr learned my addr 172.21.15.156:0/312258482 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:56.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.686+0000 7f399bfff700 1 --2- 172.21.15.156:0/312258482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f399c09e870 0x7f399c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.686+0000 7f399b7fe700 1 -- 172.21.15.156:0/312258482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f399c09e870 msgr2=0x7f399c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:56.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.686+0000 7f399b7fe700 1 --2- 172.21.15.156:0/312258482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f399c09e870 0x7f399c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.686+0000 7f399b7fe700 1 -- 172.21.15.156:0/312258482 >> v1:172.21.15.156:6789/0 conn(0x7f399c131d70 legacy=0x7f399c138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.686+0000 7f399b7fe700 1 -- 172.21.15.156:0/312258482 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399c09bab0 con 0x7f399c09f180 2023-09-30T22:22:56.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.686+0000 7f399affd700 1 -- 172.21.15.156:0/312258482 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3599213654 0 0) 0x7f399c09c970 con 0x7f399c131d70 2023-09-30T22:22:56.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.686+0000 7f399bfff700 1 --2- 172.21.15.156:0/312258482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f399c09e870 0x7f399c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:56.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.686+0000 7f399b7fe700 1 --2- 172.21.15.156:0/312258482 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f399c09f180 0x7f399c131830 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3990009920 tx=0x7f3990009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=876bacf63ea4378f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:56.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.686+0000 7f399affd700 1 -- 172.21.15.156:0/312258482 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3990011830 con 0x7f399c09f180 2023-09-30T22:22:56.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.686+0000 7f399affd700 1 -- 172.21.15.156:0/312258482 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3990011990 con 0x7f399c09f180 2023-09-30T22:22:56.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.687+0000 7f399affd700 1 -- 172.21.15.156:0/312258482 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3990011d20 con 0x7f399c09f180 2023-09-30T22:22:56.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.687+0000 7f39a2486700 1 -- 172.21.15.156:0/312258482 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f399c09f180 msgr2=0x7f399c131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.687+0000 7f39a2486700 1 --2- 172.21.15.156:0/312258482 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f399c09f180 0x7f399c131830 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3990009920 tx=0x7f3990009c30 comp rx=0 tx=0).stop 2023-09-30T22:22:56.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.687+0000 7f39a2486700 1 -- 172.21.15.156:0/312258482 shutdown_connections 2023-09-30T22:22:56.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.687+0000 7f39a2486700 1 --2- 172.21.15.156:0/312258482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f399c09e870 0x7f399c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.687+0000 7f39a2486700 1 --2- 172.21.15.156:0/312258482 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f399c09f180 0x7f399c131830 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.687+0000 7f39a2486700 1 -- 172.21.15.156:0/312258482 >> 172.21.15.156:0/312258482 conn(0x7f399c0a4430 msgr2=0x7f399c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:56.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.688+0000 7f39a2486700 1 -- 172.21.15.156:0/312258482 shutdown_connections 2023-09-30T22:22:56.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.688+0000 7f39a2486700 1 -- 172.21.15.156:0/312258482 wait complete. 2023-09-30T22:22:56.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.690+0000 7f39a2486700 1 Processor -- start 2023-09-30T22:22:56.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.690+0000 7f39a2486700 1 -- start start 2023-09-30T22:22:56.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.691+0000 7f39a2486700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f399c09e870 0x7f399c11d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.691+0000 7f39a2486700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f399c09f180 0x7f399c11db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.691+0000 7f39a2486700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f399c131d70 0x7f399c1c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.691+0000 7f39a2486700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399c131530 con 0x7f399c09e870 2023-09-30T22:22:56.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.691+0000 7f39a2486700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399c11d110 con 0x7f399c131d70 2023-09-30T22:22:56.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.691+0000 7f39a2486700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f399c11e050 con 0x7f399c09f180 2023-09-30T22:22:56.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.691+0000 7f399b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f399c09f180 0x7f399c11db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.691+0000 7f39a0a23700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f399c131d70 0x7f399c1c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.691+0000 7f399b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f399c09f180 0x7f399c11db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54522/0 (socket says 172.21.15.156:54522) 2023-09-30T22:22:56.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.691+0000 7f399b7fe700 1 -- 172.21.15.156:0/2837400306 learned_addr learned my addr 172.21.15.156:0/2837400306 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:56.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.691+0000 7f399bfff700 1 --2- 172.21.15.156:0/2837400306 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f399c09e870 0x7f399c11d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.691+0000 7f39a0a23700 1 -- 172.21.15.156:0/2837400306 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f399c09f180 msgr2=0x7f399c11db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.691+0000 7f39a0a23700 1 --2- 172.21.15.156:0/2837400306 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f399c09f180 0x7f399c11db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.691+0000 7f39a0a23700 1 -- 172.21.15.156:0/2837400306 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f399c09e870 msgr2=0x7f399c11d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.691+0000 7f39a0a23700 1 --2- 172.21.15.156:0/2837400306 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f399c09e870 0x7f399c11d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.691+0000 7f39a0a23700 1 -- 172.21.15.156:0/2837400306 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c009a70 con 0x7f399c131d70 2023-09-30T22:22:56.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.692+0000 7f39a0a23700 1 --2- 172.21.15.156:0/2837400306 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f399c131d70 0x7f399c1c62a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f399400c480 tx=0x7f399400c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:56.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.692+0000 7f3998ff9700 1 -- 172.21.15.156:0/2837400306 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39940052d0 con 0x7f399c131d70 2023-09-30T22:22:56.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.693+0000 7f3998ff9700 1 -- 172.21.15.156:0/2837400306 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3994005430 con 0x7f399c131d70 2023-09-30T22:22:56.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.693+0000 7f3998ff9700 1 -- 172.21.15.156:0/2837400306 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39940038c0 con 0x7f399c131d70 2023-09-30T22:22:56.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.693+0000 7f39a2486700 1 -- 172.21.15.156:0/2837400306 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3990009550 con 0x7f399c131d70 2023-09-30T22:22:56.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.693+0000 7f39a2486700 1 -- 172.21.15.156:0/2837400306 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f399c120100 con 0x7f399c131d70 2023-09-30T22:22:56.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.694+0000 7f3998ff9700 1 -- 172.21.15.156:0/2837400306 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3994003a20 con 0x7f399c131d70 2023-09-30T22:22:56.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.694+0000 7f39a2486700 1 -- 172.21.15.156:0/2837400306 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f399c04f2a0 con 0x7f399c131d70 2023-09-30T22:22:56.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.694+0000 7f3998ff9700 1 -- 172.21.15.156:0/2837400306 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f39940409b0 con 0x7f399c131d70 2023-09-30T22:22:56.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.703+0000 7f3998ff9700 1 -- 172.21.15.156:0/2837400306 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3994044060 con 0x7f399c131d70 2023-09-30T22:22:56.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.806+0000 7f8c7dc6b700 1 -- 172.21.15.156:0/4212257753 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8c58005590 con 0x7f8c781304a0 2023-09-30T22:22:56.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.806+0000 7f8c5ffff700 1 -- 172.21.15.156:0/4212257753 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c70018020 con 0x7f8c781304a0 2023-09-30T22:22:56.806 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:56.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.808+0000 7f8c7dc6b700 1 -- 172.21.15.156:0/4212257753 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c781304a0 msgr2=0x7f8c781c4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.808+0000 7f8c7dc6b700 1 --2- 172.21.15.156:0/4212257753 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c781304a0 0x7f8c781c4890 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8c7000efc0 tx=0x7f8c7000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.808+0000 7f8c7dc6b700 1 -- 172.21.15.156:0/4212257753 shutdown_connections 2023-09-30T22:22:56.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.808+0000 7f8c7dc6b700 1 --2- 172.21.15.156:0/4212257753 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8c781304a0 0x7f8c781c4890 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.808+0000 7f8c7dc6b700 1 --2- 172.21.15.156:0/4212257753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c780a0a30 0x7f8c781c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.808+0000 7f8c7dc6b700 1 --2- 172.21.15.156:0/4212257753 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8c780a1340 0x7f8c781c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.808+0000 7f8c7dc6b700 1 -- 172.21.15.156:0/4212257753 >> 172.21.15.156:0/4212257753 conn(0x7f8c780a2980 msgr2=0x7f8c781b77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:56.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.808+0000 7f8c7dc6b700 1 -- 172.21.15.156:0/4212257753 shutdown_connections 2023-09-30T22:22:56.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.808+0000 7f8c7dc6b700 1 -- 172.21.15.156:0/4212257753 wait complete. 2023-09-30T22:22:56.820 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:56.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.870+0000 7fb0dd156700 1 -- 172.21.15.156:0/479772204 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb0d804f2a0 con 0x7fb0d8133f50 2023-09-30T22:22:56.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.870+0000 7fb0bf7fe700 1 -- 172.21.15.156:0/479772204 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb0d0007ae0 con 0x7fb0d8133f50 2023-09-30T22:22:56.870 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:56.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.873+0000 7fb0dd156700 1 -- 172.21.15.156:0/479772204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0d8133f50 msgr2=0x7fb0d8122e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.873+0000 7fb0dd156700 1 --2- 172.21.15.156:0/479772204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0d8133f50 0x7fb0d8122e20 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0009f00 tx=0x7fb0d000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.873+0000 7fb0dd156700 1 -- 172.21.15.156:0/479772204 shutdown_connections 2023-09-30T22:22:56.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.873+0000 7fb0dd156700 1 --2- 172.21.15.156:0/479772204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0d8133f50 0x7fb0d8122e20 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.873+0000 7fb0dd156700 1 --2- 172.21.15.156:0/479772204 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0d80a0a70 0x7fb0d81223a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.873+0000 7fb0dd156700 1 --2- 172.21.15.156:0/479772204 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0d80a1380 0x7fb0d81228e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.873+0000 7fb0dd156700 1 -- 172.21.15.156:0/479772204 >> 172.21.15.156:0/479772204 conn(0x7fb0d80a6610 msgr2=0x7fb0d809ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:56.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.873+0000 7fb0dd156700 1 -- 172.21.15.156:0/479772204 shutdown_connections 2023-09-30T22:22:56.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.873+0000 7fb0dd156700 1 -- 172.21.15.156:0/479772204 wait complete. 2023-09-30T22:22:56.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.878+0000 7ff0cd58c700 1 -- 172.21.15.156:0/3023174449 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff0c804f2a0 con 0x7ff0c81309f0 2023-09-30T22:22:56.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.878+0000 7ff0af7fe700 1 -- 172.21.15.156:0/3023174449 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff0bc032020 con 0x7ff0c81309f0 2023-09-30T22:22:56.878 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:56.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.880+0000 7ff0cd58c700 1 -- 172.21.15.156:0/3023174449 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0c81309f0 msgr2=0x7ff0c811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.880+0000 7ff0cd58c700 1 --2- 172.21.15.156:0/3023174449 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0c81309f0 0x7ff0c811df80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc009f30 tx=0x7ff0bc00eb50 comp rx=0 tx=0).stop 2023-09-30T22:22:56.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.880+0000 7ff0cd58c700 1 -- 172.21.15.156:0/3023174449 shutdown_connections 2023-09-30T22:22:56.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.880+0000 7ff0cd58c700 1 --2- 172.21.15.156:0/3023174449 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0c8133ad0 0x7ff0c811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.880+0000 7ff0cd58c700 1 --2- 172.21.15.156:0/3023174449 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0c81300a0 0x7ff0c811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.880+0000 7ff0cd58c700 1 --2- 172.21.15.156:0/3023174449 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0c81309f0 0x7ff0c811df80 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.880+0000 7ff0cd58c700 1 -- 172.21.15.156:0/3023174449 >> 172.21.15.156:0/3023174449 conn(0x7ff0c8099c40 msgr2=0x7ff0c809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:56.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.880+0000 7ff0cd58c700 1 -- 172.21.15.156:0/3023174449 shutdown_connections 2023-09-30T22:22:56.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.880+0000 7ff0cd58c700 1 -- 172.21.15.156:0/3023174449 wait complete. 2023-09-30T22:22:56.890 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:56.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:56.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.923+0000 7f39a2486700 1 -- 172.21.15.156:0/2837400306 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f399c0a22e0 con 0x7f399c131d70 2023-09-30T22:22:56.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.923+0000 7f3998ff9700 1 -- 172.21.15.156:0/2837400306 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3994044070 con 0x7f399c131d70 2023-09-30T22:22:56.923 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:56.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.925+0000 7f39a2486700 1 -- 172.21.15.156:0/2837400306 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f399c131d70 msgr2=0x7f399c1c62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.925+0000 7f39a2486700 1 --2- 172.21.15.156:0/2837400306 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f399c131d70 0x7f399c1c62a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f399400c480 tx=0x7f399400c790 comp rx=0 tx=0).stop 2023-09-30T22:22:56.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.925+0000 7f39a2486700 1 -- 172.21.15.156:0/2837400306 shutdown_connections 2023-09-30T22:22:56.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.925+0000 7f39a2486700 1 --2- 172.21.15.156:0/2837400306 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f399c131d70 0x7f399c1c62a0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.925+0000 7f39a2486700 1 --2- 172.21.15.156:0/2837400306 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f399c09e870 0x7f399c11d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.925+0000 7f39a2486700 1 --2- 172.21.15.156:0/2837400306 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f399c09f180 0x7f399c11db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.925+0000 7f39a2486700 1 -- 172.21.15.156:0/2837400306 >> 172.21.15.156:0/2837400306 conn(0x7f399c0a4430 msgr2=0x7f399c09c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:56.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.925+0000 7f39a2486700 1 -- 172.21.15.156:0/2837400306 shutdown_connections 2023-09-30T22:22:56.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:56.925+0000 7f39a2486700 1 -- 172.21.15.156:0/2837400306 wait complete. 2023-09-30T22:22:56.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:57.821 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:57.892 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:57.892 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:57.938 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:57.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.959+0000 7f2480280700 1 Processor -- start 2023-09-30T22:22:57.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.960+0000 7f2480280700 1 -- start start 2023-09-30T22:22:57.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.960+0000 7f2480280700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2478133ad0 0x7f2478133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:57.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.960+0000 7f2480280700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f24781300a0 0x7f24781304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:57.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.960+0000 7f2480280700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f247806b2d0 con 0x7f24781309f0 2023-09-30T22:22:57.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.960+0000 7f2480280700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2478133610 con 0x7f24781300a0 2023-09-30T22:22:57.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.960+0000 7f2480280700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f247809a500 con 0x7f2478133ad0 2023-09-30T22:22:57.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.961+0000 7f247d81b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f24781300a0 0x7f24781304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:57.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.961+0000 7f247e01c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2478133ad0 0x7f2478133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:57.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.961+0000 7f247d81b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f24781300a0 0x7f24781304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40256/0 (socket says 172.21.15.156:40256) 2023-09-30T22:22:57.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.961+0000 7f247e01c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2478133ad0 0x7f2478133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54524/0 (socket says 172.21.15.156:54524) 2023-09-30T22:22:57.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.961+0000 7f247d81b700 1 -- 172.21.15.156:0/3993210980 learned_addr learned my addr 172.21.15.156:0/3993210980 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:57.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.961+0000 7f247e81d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f24781309f0 0x7f247813a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40330/0 (socket says 172.21.15.156:40330) 2023-09-30T22:22:57.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.961+0000 7f247d81b700 1 -- 172.21.15.156:0/3993210980 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2478133ad0 msgr2=0x7f2478133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:57.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.961+0000 7f247d81b700 1 --2- 172.21.15.156:0/3993210980 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2478133ad0 0x7f2478133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:57.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.961+0000 7f247d81b700 1 -- 172.21.15.156:0/3993210980 >> v1:172.21.15.156:6789/0 conn(0x7f24781309f0 legacy=0x7f247813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:57.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.961+0000 7f247d81b700 1 -- 172.21.15.156:0/3993210980 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24781338b0 con 0x7f24781300a0 2023-09-30T22:22:57.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.961+0000 7f247e01c700 1 --2- 172.21.15.156:0/3993210980 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2478133ad0 0x7f2478133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:57.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.961+0000 7f247d81b700 1 --2- 172.21.15.156:0/3993210980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24781300a0 0x7f24781304b0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f24680098f0 tx=0x7f2468009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320b9710e5a8148c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:57.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.961+0000 7f247d01a700 1 -- 172.21.15.156:0/3993210980 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2468011830 con 0x7f24781300a0 2023-09-30T22:22:57.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.962+0000 7f247d01a700 1 -- 172.21.15.156:0/3993210980 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2468011990 con 0x7f24781300a0 2023-09-30T22:22:57.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.962+0000 7f247d01a700 1 -- 172.21.15.156:0/3993210980 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2468011d20 con 0x7f24781300a0 2023-09-30T22:22:57.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.962+0000 7f2480280700 1 -- 172.21.15.156:0/3993210980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24781300a0 msgr2=0x7f24781304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:57.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.962+0000 7f2480280700 1 --2- 172.21.15.156:0/3993210980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24781300a0 0x7f24781304b0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f24680098f0 tx=0x7f2468009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:57.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.962+0000 7f2480280700 1 -- 172.21.15.156:0/3993210980 shutdown_connections 2023-09-30T22:22:57.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.962+0000 7f2480280700 1 --2- 172.21.15.156:0/3993210980 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2478133ad0 0x7f2478133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:57.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.962+0000 7f2480280700 1 --2- 172.21.15.156:0/3993210980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24781300a0 0x7f24781304b0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:57.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.962+0000 7f2480280700 1 -- 172.21.15.156:0/3993210980 >> 172.21.15.156:0/3993210980 conn(0x7f2478099c40 msgr2=0x7f24780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:57.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.963+0000 7f2480280700 1 -- 172.21.15.156:0/3993210980 shutdown_connections 2023-09-30T22:22:57.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.963+0000 7f2480280700 1 -- 172.21.15.156:0/3993210980 wait complete. 2023-09-30T22:22:57.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.964+0000 7f2480280700 1 Processor -- start 2023-09-30T22:22:57.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.964+0000 7f2480280700 1 -- start start 2023-09-30T22:22:57.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.965+0000 7f2480280700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24781300a0 0x7f247811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:57.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.965+0000 7f2480280700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24781309f0 0x7f247811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:57.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.965+0000 7f2480280700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2478133ad0 0x7f247811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:57.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.965+0000 7f2480280700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2478120220 con 0x7f24781300a0 2023-09-30T22:22:57.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.965+0000 7f2480280700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247811f060 con 0x7f2478133ad0 2023-09-30T22:22:57.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.965+0000 7f2480280700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f247812d950 con 0x7f24781309f0 2023-09-30T22:22:57.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.965+0000 7f247d81b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24781309f0 0x7f247811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:57.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.965+0000 7f247e81d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2478133ad0 0x7f247811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:57.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.965+0000 7f247d81b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24781309f0 0x7f247811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54538/0 (socket says 172.21.15.156:54538) 2023-09-30T22:22:57.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.965+0000 7f247e81d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2478133ad0 0x7f247811e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46482/0 (socket says 172.21.15.156:46482) 2023-09-30T22:22:57.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.965+0000 7f247d81b700 1 -- 172.21.15.156:0/1772391418 learned_addr learned my addr 172.21.15.156:0/1772391418 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:57.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.965+0000 7f247e01c700 1 --2- 172.21.15.156:0/1772391418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24781300a0 0x7f247811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:57.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.965+0000 7f247e81d700 1 -- 172.21.15.156:0/1772391418 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24781309f0 msgr2=0x7f247811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:57.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.965+0000 7f247e81d700 1 --2- 172.21.15.156:0/1772391418 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24781309f0 0x7f247811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:57.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.965+0000 7f247e81d700 1 -- 172.21.15.156:0/1772391418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24781300a0 msgr2=0x7f247811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:57.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.965+0000 7f247e81d700 1 --2- 172.21.15.156:0/1772391418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24781300a0 0x7f247811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:57.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.965+0000 7f247e81d700 1 -- 172.21.15.156:0/1772391418 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24740094a0 con 0x7f2478133ad0 2023-09-30T22:22:57.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.965+0000 7f247d81b700 1 --2- 172.21.15.156:0/1772391418 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24781309f0 0x7f247811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:57.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.965+0000 7f247e81d700 1 --2- 172.21.15.156:0/1772391418 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2478133ad0 0x7f247811e4c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f247000cb10 tx=0x7f247000ce20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:57.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.966+0000 7f246effd700 1 -- 172.21.15.156:0/1772391418 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247000aaa0 con 0x7f2478133ad0 2023-09-30T22:22:57.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.966+0000 7f246effd700 1 -- 172.21.15.156:0/1772391418 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247000ac00 con 0x7f2478133ad0 2023-09-30T22:22:57.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.966+0000 7f246effd700 1 -- 172.21.15.156:0/1772391418 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2470007070 con 0x7f2478133ad0 2023-09-30T22:22:57.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.966+0000 7f2480280700 1 -- 172.21.15.156:0/1772391418 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2468009550 con 0x7f2478133ad0 2023-09-30T22:22:57.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.966+0000 7f2480280700 1 -- 172.21.15.156:0/1772391418 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24780a3400 con 0x7f2478133ad0 2023-09-30T22:22:57.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.967+0000 7f2480280700 1 -- 172.21.15.156:0/1772391418 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f247804f2a0 con 0x7f2478133ad0 2023-09-30T22:22:57.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.968+0000 7f246effd700 1 -- 172.21.15.156:0/1772391418 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f24700071d0 con 0x7f2478133ad0 2023-09-30T22:22:57.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.968+0000 7f246effd700 1 -- 172.21.15.156:0/1772391418 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f247003fdc0 con 0x7f2478133ad0 2023-09-30T22:22:57.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:57.976+0000 7f246effd700 1 -- 172.21.15.156:0/1772391418 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2470012400 con 0x7f2478133ad0 2023-09-30T22:22:58.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.026+0000 7fccc7466700 1 Processor -- start 2023-09-30T22:22:58.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.026+0000 7fccc7466700 1 -- start start 2023-09-30T22:22:58.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.027+0000 7fccc7466700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fccc0138040 0x7fccc0138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:58.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.027+0000 7fccc7466700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fccc00a1400 0x7fccc013fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:58.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.027+0000 7fccc7466700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc01379e0 con 0x7fccc00a08e0 2023-09-30T22:22:58.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.027+0000 7fccc7466700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc00a2100 con 0x7fccc0138040 2023-09-30T22:22:58.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.027+0000 7fccc7466700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc0138950 con 0x7fccc00a1400 2023-09-30T22:22:58.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.027+0000 7fccc5a03700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fccc00a1400 0x7fccc013fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:58.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.027+0000 7fccc5a03700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fccc00a1400 0x7fccc013fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46486/0 (socket says 172.21.15.156:46486) 2023-09-30T22:22:58.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.027+0000 7fccc5a03700 1 -- 172.21.15.156:0/3041680346 learned_addr learned my addr 172.21.15.156:0/3041680346 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:58.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.027+0000 7fccc5202700 1 --2- 172.21.15.156:0/3041680346 >> v2:172.21.15.156:3300/0 conn(0x7fccc0138040 0x7fccc0138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:58.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.027+0000 7fccc5202700 1 -- 172.21.15.156:0/3041680346 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fccc00a1400 msgr2=0x7fccc013fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:58.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.027+0000 7fccc5202700 1 --2- 172.21.15.156:0/3041680346 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fccc00a1400 0x7fccc013fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.027+0000 7fccc5202700 1 -- 172.21.15.156:0/3041680346 >> v1:172.21.15.156:6789/0 conn(0x7fccc00a08e0 legacy=0x7fccc00a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:58.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.027+0000 7fccb7fff700 1 -- 172.21.15.156:0/3041680346 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2748269403 0 0) 0x7fccc01379e0 con 0x7fccc00a08e0 2023-09-30T22:22:58.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.027+0000 7fccc5202700 1 -- 172.21.15.156:0/3041680346 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc009b9b0 con 0x7fccc0138040 2023-09-30T22:22:58.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.027+0000 7fccc5a03700 1 --2- 172.21.15.156:0/3041680346 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fccc00a1400 0x7fccc013fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:58.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.028+0000 7fccc5202700 1 --2- 172.21.15.156:0/3041680346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fccc0138040 0x7fccc0138410 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fccbc009850 tx=0x7fccbc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eae163733b29cbb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:58.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.028+0000 7fccb7fff700 1 -- 172.21.15.156:0/3041680346 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc005e30 con 0x7fccc0138040 2023-09-30T22:22:58.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.028+0000 7fccb7fff700 1 -- 172.21.15.156:0/3041680346 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccbc006030 con 0x7fccc0138040 2023-09-30T22:22:58.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.028+0000 7fccb7fff700 1 -- 172.21.15.156:0/3041680346 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc0063c0 con 0x7fccc0138040 2023-09-30T22:22:58.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.028+0000 7fccc7466700 1 -- 172.21.15.156:0/3041680346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fccc0138040 msgr2=0x7fccc0138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:58.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.028+0000 7fccc7466700 1 --2- 172.21.15.156:0/3041680346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fccc0138040 0x7fccc0138410 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fccbc009850 tx=0x7fccbc009b60 comp rx=0 tx=0).stop 2023-09-30T22:22:58.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.029+0000 7fccc7466700 1 -- 172.21.15.156:0/3041680346 shutdown_connections 2023-09-30T22:22:58.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.029+0000 7fccc7466700 1 --2- 172.21.15.156:0/3041680346 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fccc00a1400 0x7fccc013fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.029+0000 7fccc7466700 1 --2- 172.21.15.156:0/3041680346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fccc0138040 0x7fccc0138410 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.029+0000 7fccc7466700 1 -- 172.21.15.156:0/3041680346 >> 172.21.15.156:0/3041680346 conn(0x7fccc00a2980 msgr2=0x7fccc00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:58.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.029+0000 7fccc7466700 1 -- 172.21.15.156:0/3041680346 shutdown_connections 2023-09-30T22:22:58.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.029+0000 7fccc7466700 1 -- 172.21.15.156:0/3041680346 wait complete. 2023-09-30T22:22:58.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.030+0000 7fccc7466700 1 Processor -- start 2023-09-30T22:22:58.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.030+0000 7fccc7466700 1 -- start start 2023-09-30T22:22:58.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.030+0000 7fccc7466700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fccc00a08e0 0x7fccc0137330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:58.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.030+0000 7fccc7466700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fccc00a1400 0x7fccc0135b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:58.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.030+0000 7fccc7466700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fccc0119a50 0x7fccc0136070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:58.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.030+0000 7fccc7466700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc0119370 con 0x7fccc0119a50 2023-09-30T22:22:58.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.030+0000 7fccc7466700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc009f0b0 con 0x7fccc00a08e0 2023-09-30T22:22:58.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.030+0000 7fccc7466700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccc009a240 con 0x7fccc00a1400 2023-09-30T22:22:58.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.030+0000 7fccc5202700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fccc00a08e0 0x7fccc0137330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:58.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.030+0000 7fccc5202700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fccc00a08e0 0x7fccc0137330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46498/0 (socket says 172.21.15.156:46498) 2023-09-30T22:22:58.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.030+0000 7fccc5202700 1 -- 172.21.15.156:0/590892241 learned_addr learned my addr 172.21.15.156:0/590892241 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:58.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.030+0000 7fccc5a03700 1 --2- 172.21.15.156:0/590892241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fccc0119a50 0x7fccc0136070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:58.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.030+0000 7fccc4a01700 1 --2- 172.21.15.156:0/590892241 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fccc00a1400 0x7fccc0135b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:58.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.031+0000 7fccc4a01700 1 -- 172.21.15.156:0/590892241 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fccc00a08e0 msgr2=0x7fccc0137330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:58.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.031+0000 7fccc4a01700 1 --2- 172.21.15.156:0/590892241 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fccc00a08e0 0x7fccc0137330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.031+0000 7fccc4a01700 1 -- 172.21.15.156:0/590892241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fccc0119a50 msgr2=0x7fccc0136070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:58.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.031+0000 7fccc4a01700 1 --2- 172.21.15.156:0/590892241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fccc0119a50 0x7fccc0136070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.031+0000 7fccc4a01700 1 -- 172.21.15.156:0/590892241 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb8009b30 con 0x7fccc00a1400 2023-09-30T22:22:58.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.031+0000 7fccc5a03700 1 --2- 172.21.15.156:0/590892241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fccc0119a50 0x7fccc0136070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:58.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.031+0000 7fccc5202700 1 --2- 172.21.15.156:0/590892241 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fccc00a08e0 0x7fccc0137330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:58.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.031+0000 7fccc4a01700 1 --2- 172.21.15.156:0/590892241 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fccc00a1400 0x7fccc0135b30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fccb000c3c0 tx=0x7fccb000c6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:58.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.031+0000 7fccb5ffb700 1 -- 172.21.15.156:0/590892241 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb00052d0 con 0x7fccc00a1400 2023-09-30T22:22:58.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.031+0000 7fccb5ffb700 1 -- 172.21.15.156:0/590892241 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb0005450 con 0x7fccc00a1400 2023-09-30T22:22:58.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.031+0000 7fccc7466700 1 -- 172.21.15.156:0/590892241 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccbc009430 con 0x7fccc00a1400 2023-09-30T22:22:58.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.031+0000 7fccb5ffb700 1 -- 172.21.15.156:0/590892241 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb00038c0 con 0x7fccc00a1400 2023-09-30T22:22:58.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.031+0000 7fccc7466700 1 -- 172.21.15.156:0/590892241 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc013f330 con 0x7fccc00a1400 2023-09-30T22:22:58.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.032+0000 7fccc7466700 1 -- 172.21.15.156:0/590892241 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc004f2a0 con 0x7fccc00a1400 2023-09-30T22:22:58.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.033+0000 7fccb5ffb700 1 -- 172.21.15.156:0/590892241 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fccb0003a20 con 0x7fccc00a1400 2023-09-30T22:22:58.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.033+0000 7fccb5ffb700 1 -- 172.21.15.156:0/590892241 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fccb003edc0 con 0x7fccc00a1400 2023-09-30T22:22:58.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.037+0000 7fccb5ffb700 1 -- 172.21.15.156:0/590892241 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fccb0019b40 con 0x7fccc00a1400 2023-09-30T22:22:58.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.048+0000 7f013cc49700 1 Processor -- start 2023-09-30T22:22:58.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.048+0000 7f013cc49700 1 -- start start 2023-09-30T22:22:58.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.049+0000 7f013cc49700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f013809a130 0x7f013809e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:58.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.049+0000 7f013cc49700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f013809edb0 0x7f013809f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:58.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.049+0000 7f013cc49700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0138072b30 con 0x7f013813c410 2023-09-30T22:22:58.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.049+0000 7f013cc49700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f013809a500 con 0x7f013809a130 2023-09-30T22:22:58.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.049+0000 7f013cc49700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013809f720 con 0x7f013809edb0 2023-09-30T22:22:58.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.049+0000 7f013659c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f013809a130 0x7f013809e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:58.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.049+0000 7f013659c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f013809a130 0x7f013809e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40266/0 (socket says 172.21.15.156:40266) 2023-09-30T22:22:58.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.049+0000 7f013659c700 1 -- 172.21.15.156:0/2481724622 learned_addr learned my addr 172.21.15.156:0/2481724622 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:58.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.049+0000 7f0135d9b700 1 --2- 172.21.15.156:0/2481724622 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f013809edb0 0x7f013809f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:58.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.049+0000 7f013659c700 1 -- 172.21.15.156:0/2481724622 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f013809edb0 msgr2=0x7f013809f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:58.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.049+0000 7f013659c700 1 --2- 172.21.15.156:0/2481724622 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f013809edb0 0x7f013809f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.049+0000 7f013659c700 1 -- 172.21.15.156:0/2481724622 >> v1:172.21.15.156:6789/0 conn(0x7f013813c410 legacy=0x7f013813e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:58.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.049+0000 7f013659c700 1 -- 172.21.15.156:0/2481724622 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013809fe00 con 0x7f013809a130 2023-09-30T22:22:58.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.050+0000 7f013659c700 1 --2- 172.21.15.156:0/2481724622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f013809a130 0x7f013809e870 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f01280098f0 tx=0x7f0128009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa6762e5a980c2d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:58.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.050+0000 7f013559a700 1 -- 172.21.15.156:0/2481724622 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0128011830 con 0x7f013809a130 2023-09-30T22:22:58.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.050+0000 7f013559a700 1 -- 172.21.15.156:0/2481724622 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0128011990 con 0x7f013809a130 2023-09-30T22:22:58.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.050+0000 7f013559a700 1 -- 172.21.15.156:0/2481724622 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0128011d20 con 0x7f013809a130 2023-09-30T22:22:58.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.051+0000 7f013cc49700 1 -- 172.21.15.156:0/2481724622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f013809a130 msgr2=0x7f013809e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:58.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.051+0000 7f013cc49700 1 --2- 172.21.15.156:0/2481724622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f013809a130 0x7f013809e870 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f01280098f0 tx=0x7f0128009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:58.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.051+0000 7f013cc49700 1 -- 172.21.15.156:0/2481724622 shutdown_connections 2023-09-30T22:22:58.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.051+0000 7f013cc49700 1 --2- 172.21.15.156:0/2481724622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f013809a130 0x7f013809e870 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.051+0000 7f013cc49700 1 --2- 172.21.15.156:0/2481724622 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f013809edb0 0x7f013809f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.051+0000 7f013cc49700 1 -- 172.21.15.156:0/2481724622 >> 172.21.15.156:0/2481724622 conn(0x7f01380a4430 msgr2=0x7f01380a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:58.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.052+0000 7f013cc49700 1 -- 172.21.15.156:0/2481724622 shutdown_connections 2023-09-30T22:22:58.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.052+0000 7f013cc49700 1 -- 172.21.15.156:0/2481724622 wait complete. 2023-09-30T22:22:58.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.053+0000 7f013cc49700 1 Processor -- start 2023-09-30T22:22:58.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.053+0000 7f013cc49700 1 -- start start 2023-09-30T22:22:58.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.054+0000 7f013cc49700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f013809a130 0x7f013811b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:58.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.054+0000 7f013cc49700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f013809edb0 0x7f013811b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:58.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.054+0000 7f013cc49700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f013813c410 0x7f013811bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:58.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.054+0000 7f013cc49700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0138127460 con 0x7f013809a130 2023-09-30T22:22:58.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.054+0000 7f013cc49700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013811d400 con 0x7f013809edb0 2023-09-30T22:22:58.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.054+0000 7f013cc49700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0138127720 con 0x7f013813c410 2023-09-30T22:22:58.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.054+0000 7f013659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f013809a130 0x7f013811b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:58.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.054+0000 7f013659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f013809a130 0x7f013811b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40268/0 (socket says 172.21.15.156:40268) 2023-09-30T22:22:58.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.054+0000 7f013659c700 1 -- 172.21.15.156:0/2730691275 learned_addr learned my addr 172.21.15.156:0/2730691275 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:58.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.054+0000 7f0136d9d700 1 --2- 172.21.15.156:0/2730691275 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f013813c410 0x7f013811bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:58.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.055+0000 7f013659c700 1 -- 172.21.15.156:0/2730691275 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f013813c410 msgr2=0x7f013811bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:58.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.055+0000 7f013659c700 1 --2- 172.21.15.156:0/2730691275 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f013813c410 0x7f013811bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.055+0000 7f013659c700 1 -- 172.21.15.156:0/2730691275 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f013809edb0 msgr2=0x7f013811b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:58.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.055+0000 7f013659c700 1 --2- 172.21.15.156:0/2730691275 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f013809edb0 0x7f013811b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.055+0000 7f013659c700 1 -- 172.21.15.156:0/2730691275 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0128009550 con 0x7f013809a130 2023-09-30T22:22:58.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.055+0000 7f013659c700 1 --2- 172.21.15.156:0/2730691275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f013809a130 0x7f013811b330 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f0128009c40 tx=0x7f0128004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:58.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.055+0000 7f0126ffd700 1 -- 172.21.15.156:0/2730691275 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0128004590 con 0x7f013809a130 2023-09-30T22:22:58.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.055+0000 7f0126ffd700 1 -- 172.21.15.156:0/2730691275 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012801e070 con 0x7f013809a130 2023-09-30T22:22:58.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.055+0000 7f013cc49700 1 -- 172.21.15.156:0/2730691275 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f013811d640 con 0x7f013809a130 2023-09-30T22:22:58.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.055+0000 7f0126ffd700 1 -- 172.21.15.156:0/2730691275 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01280038e0 con 0x7f013809a130 2023-09-30T22:22:58.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.055+0000 7f013cc49700 1 -- 172.21.15.156:0/2730691275 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01381d2e80 con 0x7f013809a130 2023-09-30T22:22:58.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.057+0000 7f013cc49700 1 -- 172.21.15.156:0/2730691275 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f013804f2a0 con 0x7f013809a130 2023-09-30T22:22:58.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.057+0000 7f0126ffd700 1 -- 172.21.15.156:0/2730691275 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0128003a40 con 0x7f013809a130 2023-09-30T22:22:58.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.057+0000 7f0126ffd700 1 -- 172.21.15.156:0/2730691275 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f01280405b0 con 0x7f013809a130 2023-09-30T22:22:58.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.067+0000 7f0126ffd700 1 -- 172.21.15.156:0/2730691275 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f012802d450 con 0x7f013809a130 2023-09-30T22:22:58.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.070+0000 7fb4f834c700 1 Processor -- start 2023-09-30T22:22:58.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.070+0000 7fb4f834c700 1 -- start start 2023-09-30T22:22:58.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.070+0000 7fb4f834c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb4f00a0a70 0x7fb4f00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:58.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.070+0000 7fb4f834c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4f0134120 0x7fb4f013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:58.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.071+0000 7fb4f834c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f009dc00 con 0x7fb4f00a1380 2023-09-30T22:22:58.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.071+0000 7fb4f834c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f009ea90 con 0x7fb4f00a0a70 2023-09-30T22:22:58.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.071+0000 7fb4f834c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f009dec0 con 0x7fb4f0134120 2023-09-30T22:22:58.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.071+0000 7fb4f68e9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4f0134120 0x7fb4f013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:58.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.071+0000 7fb4f60e8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb4f00a0a70 0x7fb4f00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:58.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.071+0000 7fb4f68e9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4f0134120 0x7fb4f013bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46514/0 (socket says 172.21.15.156:46514) 2023-09-30T22:22:58.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.071+0000 7fb4f68e9700 1 -- 172.21.15.156:0/4242521072 learned_addr learned my addr 172.21.15.156:0/4242521072 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:58.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.071+0000 7fb4f68e9700 1 -- 172.21.15.156:0/4242521072 >> v2:172.21.15.156:3300/0 conn(0x7fb4f00a0a70 msgr2=0x7fb4f00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:58.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.071+0000 7fb4f68e9700 1 --2- 172.21.15.156:0/4242521072 >> v2:172.21.15.156:3300/0 conn(0x7fb4f00a0a70 0x7fb4f00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.071+0000 7fb4f68e9700 1 -- 172.21.15.156:0/4242521072 >> v1:172.21.15.156:6789/0 conn(0x7fb4f00a1380 legacy=0x7fb4f0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:58.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.071+0000 7fb4f68e9700 1 -- 172.21.15.156:0/4242521072 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f009e6a0 con 0x7fb4f0134120 2023-09-30T22:22:58.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.071+0000 7fb4f60e8700 1 --2- 172.21.15.156:0/4242521072 >> v2:172.21.15.156:3300/0 conn(0x7fb4f00a0a70 0x7fb4f00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:58.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.071+0000 7fb4f68e9700 1 --2- 172.21.15.156:0/4242521072 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4f0134120 0x7fb4f013bce0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8009e50 tx=0x7fb4e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3cdf04a9b80fec8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:58.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.072+0000 7fb4f50e6700 1 -- 172.21.15.156:0/4242521072 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e800e070 con 0x7fb4f0134120 2023-09-30T22:22:58.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.072+0000 7fb4f50e6700 1 -- 172.21.15.156:0/4242521072 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e800b910 con 0x7fb4f0134120 2023-09-30T22:22:58.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.072+0000 7fb4f50e6700 1 -- 172.21.15.156:0/4242521072 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e800bcc0 con 0x7fb4f0134120 2023-09-30T22:22:58.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.072+0000 7fb4f834c700 1 -- 172.21.15.156:0/4242521072 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4f0134120 msgr2=0x7fb4f013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:58.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.072+0000 7fb4f834c700 1 --2- 172.21.15.156:0/4242521072 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4f0134120 0x7fb4f013bce0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8009e50 tx=0x7fb4e800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:58.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.072+0000 7fb4f834c700 1 -- 172.21.15.156:0/4242521072 shutdown_connections 2023-09-30T22:22:58.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.072+0000 7fb4f834c700 1 --2- 172.21.15.156:0/4242521072 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4f0134120 0x7fb4f013bce0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.072+0000 7fb4f834c700 1 --2- 172.21.15.156:0/4242521072 >> v2:172.21.15.156:3300/0 conn(0x7fb4f00a0a70 0x7fb4f00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.072+0000 7fb4f834c700 1 -- 172.21.15.156:0/4242521072 >> 172.21.15.156:0/4242521072 conn(0x7fb4f00a6610 msgr2=0x7fb4f00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:58.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.072+0000 7fb4f834c700 1 -- 172.21.15.156:0/4242521072 shutdown_connections 2023-09-30T22:22:58.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.073+0000 7fb4f834c700 1 -- 172.21.15.156:0/4242521072 wait complete. 2023-09-30T22:22:58.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.073+0000 7fb4f834c700 1 Processor -- start 2023-09-30T22:22:58.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.073+0000 7fb4f834c700 1 -- start start 2023-09-30T22:22:58.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.074+0000 7fb4f834c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4f00a0a70 0x7fb4f01228a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:58.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.074+0000 7fb4f834c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4f00a1380 0x7fb4f0122de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:58.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.074+0000 7fb4f834c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4f0134120 0x7fb4f0123320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:58.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.074+0000 7fb4f834c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f0126330 con 0x7fb4f0134120 2023-09-30T22:22:58.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.074+0000 7fb4f834c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f00a03e0 con 0x7fb4f00a1380 2023-09-30T22:22:58.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.074+0000 7fb4f834c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f01244c0 con 0x7fb4f00a0a70 2023-09-30T22:22:58.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.074+0000 7fb4f60e8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4f00a0a70 0x7fb4f01228a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:58.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.074+0000 7fb4f60e8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4f00a0a70 0x7fb4f01228a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54578/0 (socket says 172.21.15.156:54578) 2023-09-30T22:22:58.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.074+0000 7fb4f60e8700 1 -- 172.21.15.156:0/415963132 learned_addr learned my addr 172.21.15.156:0/415963132 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:58.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.074+0000 7fb4f58e7700 1 --2- 172.21.15.156:0/415963132 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4f00a1380 0x7fb4f0122de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:58.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.074+0000 7fb4f68e9700 1 --2- 172.21.15.156:0/415963132 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4f0134120 0x7fb4f0123320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:58.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.074+0000 7fb4f60e8700 1 -- 172.21.15.156:0/415963132 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4f00a1380 msgr2=0x7fb4f0122de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:58.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.074+0000 7fb4f60e8700 1 --2- 172.21.15.156:0/415963132 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4f00a1380 0x7fb4f0122de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.074+0000 7fb4f60e8700 1 -- 172.21.15.156:0/415963132 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4f0134120 msgr2=0x7fb4f0123320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:58.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.074+0000 7fb4f60e8700 1 --2- 172.21.15.156:0/415963132 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4f0134120 0x7fb4f0123320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.075+0000 7fb4f60e8700 1 -- 172.21.15.156:0/415963132 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ec0094a0 con 0x7fb4f00a0a70 2023-09-30T22:22:58.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.075+0000 7fb4f60e8700 1 --2- 172.21.15.156:0/415963132 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4f00a0a70 0x7fb4f01228a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec00ebe0 tx=0x7fb4ec00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:58.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.075+0000 7fb4e6ffd700 1 -- 172.21.15.156:0/415963132 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec00c850 con 0x7fb4f00a0a70 2023-09-30T22:22:58.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.075+0000 7fb4f834c700 1 -- 172.21.15.156:0/415963132 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e8009b30 con 0x7fb4f00a0a70 2023-09-30T22:22:58.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.075+0000 7fb4f834c700 1 -- 172.21.15.156:0/415963132 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f0123c70 con 0x7fb4f00a0a70 2023-09-30T22:22:58.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.075+0000 7fb4e6ffd700 1 -- 172.21.15.156:0/415963132 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ec00c9b0 con 0x7fb4f00a0a70 2023-09-30T22:22:58.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.075+0000 7fb4e6ffd700 1 -- 172.21.15.156:0/415963132 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec00cd20 con 0x7fb4f00a0a70 2023-09-30T22:22:58.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.076+0000 7fb4e6ffd700 1 -- 172.21.15.156:0/415963132 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb4ec013470 con 0x7fb4f00a0a70 2023-09-30T22:22:58.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.076+0000 7fb4f834c700 1 -- 172.21.15.156:0/415963132 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4d80052e0 con 0x7fb4f00a0a70 2023-09-30T22:22:58.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.078+0000 7fb4e6ffd700 1 -- 172.21.15.156:0/415963132 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb4ec01b3b0 con 0x7fb4f00a0a70 2023-09-30T22:22:58.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.085+0000 7fb4e6ffd700 1 -- 172.21.15.156:0/415963132 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4ec013720 con 0x7fb4f00a0a70 2023-09-30T22:22:58.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.238+0000 7f2480280700 1 -- 172.21.15.156:0/1772391418 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f247806c3b0 con 0x7f2478133ad0 2023-09-30T22:22:58.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.238+0000 7f246effd700 1 -- 172.21.15.156:0/1772391418 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2470010300 con 0x7f2478133ad0 2023-09-30T22:22:58.238 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:58.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.239+0000 7fccc7466700 1 -- 172.21.15.156:0/590892241 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fccc006bce0 con 0x7fccc00a1400 2023-09-30T22:22:58.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.240+0000 7fccb5ffb700 1 -- 172.21.15.156:0/590892241 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fccb0017030 con 0x7fccc00a1400 2023-09-30T22:22:58.239 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:58.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.240+0000 7f2480280700 1 -- 172.21.15.156:0/1772391418 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2478133ad0 msgr2=0x7f247811e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:58.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.240+0000 7f2480280700 1 --2- 172.21.15.156:0/1772391418 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2478133ad0 0x7f247811e4c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f247000cb10 tx=0x7f247000ce20 comp rx=0 tx=0).stop 2023-09-30T22:22:58.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.241+0000 7f2480280700 1 -- 172.21.15.156:0/1772391418 shutdown_connections 2023-09-30T22:22:58.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.241+0000 7f2480280700 1 --2- 172.21.15.156:0/1772391418 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2478133ad0 0x7f247811e4c0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.241+0000 7f2480280700 1 --2- 172.21.15.156:0/1772391418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24781300a0 0x7f247811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.241+0000 7f2480280700 1 --2- 172.21.15.156:0/1772391418 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24781309f0 0x7f247811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.241+0000 7f2480280700 1 -- 172.21.15.156:0/1772391418 >> 172.21.15.156:0/1772391418 conn(0x7f2478099c40 msgr2=0x7f247812e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:58.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.241+0000 7f2480280700 1 -- 172.21.15.156:0/1772391418 shutdown_connections 2023-09-30T22:22:58.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.241+0000 7f2480280700 1 -- 172.21.15.156:0/1772391418 wait complete. 2023-09-30T22:22:58.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.242+0000 7fccc7466700 1 -- 172.21.15.156:0/590892241 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fccc00a1400 msgr2=0x7fccc0135b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:58.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.242+0000 7fccc7466700 1 --2- 172.21.15.156:0/590892241 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fccc00a1400 0x7fccc0135b30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fccb000c3c0 tx=0x7fccb000c6d0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.242+0000 7fccc7466700 1 -- 172.21.15.156:0/590892241 shutdown_connections 2023-09-30T22:22:58.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.242+0000 7fccc7466700 1 --2- 172.21.15.156:0/590892241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fccc0119a50 0x7fccc0136070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.242+0000 7fccc7466700 1 --2- 172.21.15.156:0/590892241 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fccc00a08e0 0x7fccc0137330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.242+0000 7fccc7466700 1 --2- 172.21.15.156:0/590892241 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fccc00a1400 0x7fccc0135b30 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.242+0000 7fccc7466700 1 -- 172.21.15.156:0/590892241 >> 172.21.15.156:0/590892241 conn(0x7fccc00a2980 msgr2=0x7fccc009f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:58.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.242+0000 7fccc7466700 1 -- 172.21.15.156:0/590892241 shutdown_connections 2023-09-30T22:22:58.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.242+0000 7fccc7466700 1 -- 172.21.15.156:0/590892241 wait complete. 2023-09-30T22:22:58.254 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:58.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:58.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.280+0000 7fb4f834c700 1 -- 172.21.15.156:0/415963132 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb4d8005590 con 0x7fb4f00a0a70 2023-09-30T22:22:58.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.280+0000 7fb4e6ffd700 1 -- 172.21.15.156:0/415963132 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb4ec017030 con 0x7fb4f00a0a70 2023-09-30T22:22:58.280 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:58.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.282+0000 7fb4f834c700 1 -- 172.21.15.156:0/415963132 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4f00a0a70 msgr2=0x7fb4f01228a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:58.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.282+0000 7fb4f834c700 1 --2- 172.21.15.156:0/415963132 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4f00a0a70 0x7fb4f01228a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec00ebe0 tx=0x7fb4ec00eef0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.283+0000 7fb4f834c700 1 -- 172.21.15.156:0/415963132 shutdown_connections 2023-09-30T22:22:58.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.283+0000 7fb4f834c700 1 --2- 172.21.15.156:0/415963132 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4f0134120 0x7fb4f0123320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.283+0000 7fb4f834c700 1 --2- 172.21.15.156:0/415963132 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4f00a0a70 0x7fb4f01228a0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.283+0000 7fb4f834c700 1 --2- 172.21.15.156:0/415963132 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4f00a1380 0x7fb4f0122de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.283+0000 7fb4f834c700 1 -- 172.21.15.156:0/415963132 >> 172.21.15.156:0/415963132 conn(0x7fb4f00a6610 msgr2=0x7fb4f009a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:58.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.283+0000 7fb4f834c700 1 -- 172.21.15.156:0/415963132 shutdown_connections 2023-09-30T22:22:58.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.283+0000 7fb4f834c700 1 -- 172.21.15.156:0/415963132 wait complete. 2023-09-30T22:22:58.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:58.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.301+0000 7f013cc49700 1 -- 172.21.15.156:0/2730691275 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f013806be20 con 0x7f013809a130 2023-09-30T22:22:58.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.302+0000 7f0126ffd700 1 -- 172.21.15.156:0/2730691275 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0128015030 con 0x7f013809a130 2023-09-30T22:22:58.301 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:58.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.304+0000 7f013cc49700 1 -- 172.21.15.156:0/2730691275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f013809a130 msgr2=0x7f013811b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:58.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.304+0000 7f013cc49700 1 --2- 172.21.15.156:0/2730691275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f013809a130 0x7f013811b330 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f0128009c40 tx=0x7f0128004750 comp rx=0 tx=0).stop 2023-09-30T22:22:58.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.304+0000 7f013cc49700 1 -- 172.21.15.156:0/2730691275 shutdown_connections 2023-09-30T22:22:58.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.304+0000 7f013cc49700 1 --2- 172.21.15.156:0/2730691275 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f013813c410 0x7f013811bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.304+0000 7f013cc49700 1 --2- 172.21.15.156:0/2730691275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f013809a130 0x7f013811b330 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.304+0000 7f013cc49700 1 --2- 172.21.15.156:0/2730691275 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f013809edb0 0x7f013811b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.304+0000 7f013cc49700 1 -- 172.21.15.156:0/2730691275 >> 172.21.15.156:0/2730691275 conn(0x7f01380a4430 msgr2=0x7f013809c990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:58.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.304+0000 7f013cc49700 1 -- 172.21.15.156:0/2730691275 shutdown_connections 2023-09-30T22:22:58.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:58.304+0000 7f013cc49700 1 -- 172.21.15.156:0/2730691275 wait complete. 2023-09-30T22:22:58.315 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:22:59.254 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:59.261 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:59.295 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:59.316 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:59.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.410+0000 7f4e3a51d700 1 Processor -- start 2023-09-30T22:22:59.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.410+0000 7f4e3a51d700 1 -- start start 2023-09-30T22:22:59.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.411+0000 7f4e3a51d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e34133ad0 0x7f4e34133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.411+0000 7f4e3a51d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e341300a0 0x7f4e341304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.411+0000 7f4e3a51d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4e341309f0 0x7f4e3413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.411+0000 7f4e3a51d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3406b2d0 con 0x7f4e341309f0 2023-09-30T22:22:59.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.411+0000 7f4e3a51d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e34133610 con 0x7f4e341300a0 2023-09-30T22:22:59.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.411+0000 7f4e3a51d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3409a500 con 0x7f4e34133ad0 2023-09-30T22:22:59.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.411+0000 7f4e337fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e341300a0 0x7f4e341304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.411+0000 7f4e38aba700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4e341309f0 0x7f4e3413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.411+0000 7f4e337fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e341300a0 0x7f4e341304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46530/0 (socket says 172.21.15.156:46530) 2023-09-30T22:22:59.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.411+0000 7f4e337fe700 1 -- 172.21.15.156:0/1556373880 learned_addr learned my addr 172.21.15.156:0/1556373880 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:59.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.411+0000 7f4e33fff700 1 --2- 172.21.15.156:0/1556373880 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e34133ad0 0x7f4e34133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.411+0000 7f4e38aba700 1 -- 172.21.15.156:0/1556373880 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e34133ad0 msgr2=0x7f4e34133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:59.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.411+0000 7f4e38aba700 1 --2- 172.21.15.156:0/1556373880 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e34133ad0 0x7f4e34133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.411+0000 7f4e38aba700 1 -- 172.21.15.156:0/1556373880 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e341300a0 msgr2=0x7f4e341304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:59.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.411+0000 7f4e38aba700 1 --2- 172.21.15.156:0/1556373880 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e341300a0 0x7f4e341304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.411+0000 7f4e38aba700 1 -- 172.21.15.156:0/1556373880 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e341338b0 con 0x7f4e341309f0 2023-09-30T22:22:59.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.412+0000 7f4e38aba700 1 --2- 172.21.15.156:0/1556373880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e341309f0 0x7f4e3413a980 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009d90 tx=0x7f4e2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b39b1743c7bf4b14 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:59.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.412+0000 7f4e32ffd700 1 -- 172.21.15.156:0/1556373880 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c00e070 con 0x7f4e341309f0 2023-09-30T22:22:59.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.412+0000 7f4e32ffd700 1 -- 172.21.15.156:0/1556373880 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2c00bb20 con 0x7f4e341309f0 2023-09-30T22:22:59.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.412+0000 7f4e32ffd700 1 -- 172.21.15.156:0/1556373880 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c012430 con 0x7f4e341309f0 2023-09-30T22:22:59.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.413+0000 7f4e3a51d700 1 -- 172.21.15.156:0/1556373880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e341309f0 msgr2=0x7f4e3413a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.413+0000 7f4e3a51d700 1 --2- 172.21.15.156:0/1556373880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e341309f0 0x7f4e3413a980 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009d90 tx=0x7f4e2c00b330 comp rx=0 tx=0).stop 2023-09-30T22:22:59.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.413+0000 7f4e3a51d700 1 -- 172.21.15.156:0/1556373880 shutdown_connections 2023-09-30T22:22:59.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.413+0000 7f4e3a51d700 1 --2- 172.21.15.156:0/1556373880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e341309f0 0x7f4e3413a980 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.413+0000 7f4e3a51d700 1 --2- 172.21.15.156:0/1556373880 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e34133ad0 0x7f4e34133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.413+0000 7f4e3a51d700 1 --2- 172.21.15.156:0/1556373880 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e341300a0 0x7f4e341304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.413+0000 7f4e3a51d700 1 -- 172.21.15.156:0/1556373880 >> 172.21.15.156:0/1556373880 conn(0x7f4e34099c40 msgr2=0x7f4e340a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:59.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.413+0000 7f4e3a51d700 1 -- 172.21.15.156:0/1556373880 shutdown_connections 2023-09-30T22:22:59.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.413+0000 7f4e3a51d700 1 -- 172.21.15.156:0/1556373880 wait complete. 2023-09-30T22:22:59.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.414+0000 7f4e3a51d700 1 Processor -- start 2023-09-30T22:22:59.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.414+0000 7f4e3a51d700 1 -- start start 2023-09-30T22:22:59.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.415+0000 7f4e3a51d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e341300a0 0x7f4e341cc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.415+0000 7f4e3a51d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e341309f0 0x7f4e341cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.415+0000 7f4e3a51d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e34133ad0 0x7f4e341cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.415+0000 7f4e3a51d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e340724e0 con 0x7f4e34133ad0 2023-09-30T22:22:59.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.415+0000 7f4e3a51d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3406fff0 con 0x7f4e341309f0 2023-09-30T22:22:59.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.415+0000 7f4e3a51d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3411d2a0 con 0x7f4e341300a0 2023-09-30T22:22:59.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.415+0000 7f4e33fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e341300a0 0x7f4e341cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.415+0000 7f4e38aba700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e34133ad0 0x7f4e341cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.415+0000 7f4e33fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e341300a0 0x7f4e341cc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54596/0 (socket says 172.21.15.156:54596) 2023-09-30T22:22:59.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.415+0000 7f4e33fff700 1 -- 172.21.15.156:0/1164201002 learned_addr learned my addr 172.21.15.156:0/1164201002 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:59.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.415+0000 7f4e337fe700 1 --2- 172.21.15.156:0/1164201002 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e341309f0 0x7f4e341cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.416+0000 7f4e38aba700 1 -- 172.21.15.156:0/1164201002 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e341300a0 msgr2=0x7f4e341cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.416+0000 7f4e38aba700 1 --2- 172.21.15.156:0/1164201002 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e341300a0 0x7f4e341cc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.416+0000 7f4e38aba700 1 -- 172.21.15.156:0/1164201002 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e341309f0 msgr2=0x7f4e341cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.416+0000 7f4e38aba700 1 --2- 172.21.15.156:0/1164201002 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e341309f0 0x7f4e341cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.416+0000 7f4e38aba700 1 -- 172.21.15.156:0/1164201002 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2c009a70 con 0x7f4e34133ad0 2023-09-30T22:22:59.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.416+0000 7f4e337fe700 1 --2- 172.21.15.156:0/1164201002 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e341309f0 0x7f4e341cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:22:59.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.416+0000 7f4e38aba700 1 --2- 172.21.15.156:0/1164201002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e34133ad0 0x7f4e341cd210 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c016000 tx=0x7f4e2c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:59.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.416+0000 7f4e30ff9700 1 -- 172.21.15.156:0/1164201002 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c0048b0 con 0x7f4e34133ad0 2023-09-30T22:22:59.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.416+0000 7f4e3a51d700 1 -- 172.21.15.156:0/1164201002 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e34070220 con 0x7f4e34133ad0 2023-09-30T22:22:59.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.416+0000 7f4e3a51d700 1 -- 172.21.15.156:0/1164201002 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3406ed70 con 0x7f4e34133ad0 2023-09-30T22:22:59.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.416+0000 7f4e30ff9700 1 -- 172.21.15.156:0/1164201002 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2c020070 con 0x7f4e34133ad0 2023-09-30T22:22:59.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.416+0000 7f4e30ff9700 1 -- 172.21.15.156:0/1164201002 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c0276c0 con 0x7f4e34133ad0 2023-09-30T22:22:59.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.417+0000 7f4e30ff9700 1 -- 172.21.15.156:0/1164201002 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4e2c012430 con 0x7f4e34133ad0 2023-09-30T22:22:59.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.417+0000 7f4e30ff9700 1 -- 172.21.15.156:0/1164201002 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4e2c022070 con 0x7f4e34133ad0 2023-09-30T22:22:59.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.417+0000 7f4e3a51d700 1 -- 172.21.15.156:0/1164201002 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e3406fe40 con 0x7f4e34133ad0 2023-09-30T22:22:59.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.422+0000 7f4e30ff9700 1 -- 172.21.15.156:0/1164201002 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e2c011980 con 0x7f4e34133ad0 2023-09-30T22:22:59.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.435+0000 7fedc3b42700 1 Processor -- start 2023-09-30T22:22:59.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.436+0000 7fedc3b42700 1 -- start start 2023-09-30T22:22:59.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.436+0000 7f88eefbf700 1 Processor -- start 2023-09-30T22:22:59.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.436+0000 7f88eefbf700 1 -- start start 2023-09-30T22:22:59.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.436+0000 7fedc3b42700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fedbc0a0a70 0x7fedbc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.436+0000 7fedc3b42700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fedbc0a1380 0x7fedbc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.436+0000 7fedc3b42700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fedbc133f50 0x7fedbc134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.436+0000 7fedc3b42700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedbc09e9d0 con 0x7fedbc0a1380 2023-09-30T22:22:59.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.436+0000 7fedc3b42700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedbc09dc00 con 0x7fedbc133f50 2023-09-30T22:22:59.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.436+0000 7fedc3b42700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedbc09dec0 con 0x7fedbc0a0a70 2023-09-30T22:22:59.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.436+0000 7f88eefbf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88e8133900 0x7f88e8133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.436+0000 7f88eefbf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88e8134210 0x7f88e80a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.436+0000 7f88eefbf700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f88e80a0ee0 0x7f88e80a1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.436+0000 7f88eefbf700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e809a760 con 0x7f88e80a0ee0 2023-09-30T22:22:59.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.436+0000 7f88eefbf700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e81336e0 con 0x7f88e8133900 2023-09-30T22:22:59.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.436+0000 7f88eefbf700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88e809a080 con 0x7f88e8134210 2023-09-30T22:22:59.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.436+0000 7fedc10dd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fedbc0a1380 0x7fedbc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.436+0000 7fedc18de700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fedbc0a0a70 0x7fedbc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.436+0000 7fedc10dd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fedbc0a1380 0x7fedbc133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40302/0 (socket says 172.21.15.156:40302) 2023-09-30T22:22:59.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.436+0000 7fedc10dd700 1 -- 172.21.15.156:0/752277254 learned_addr learned my addr 172.21.15.156:0/752277254 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:59.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.436+0000 7f88e7fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88e8134210 0x7f88e80a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.436+0000 7f88e7fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88e8134210 0x7f88e80a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54616/0 (socket says 172.21.15.156:54616) 2023-09-30T22:22:59.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.436+0000 7f88e7fff700 1 -- 172.21.15.156:0/2776393238 learned_addr learned my addr 172.21.15.156:0/2776393238 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:59.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.437+0000 7f88ed55c700 1 --2- 172.21.15.156:0/2776393238 >> v2:172.21.15.156:3300/0 conn(0x7f88e80a0ee0 0x7f88e80a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.437+0000 7fedc10dd700 1 -- 172.21.15.156:0/752277254 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fedbc0a0a70 msgr2=0x7fedbc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:59.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.437+0000 7fedc10dd700 1 --2- 172.21.15.156:0/752277254 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fedbc0a0a70 0x7fedbc0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.437+0000 7fedc10dd700 1 -- 172.21.15.156:0/752277254 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fedbc133f50 msgr2=0x7fedbc134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:59.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.437+0000 7fedc10dd700 1 --2- 172.21.15.156:0/752277254 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fedbc133f50 0x7fedbc134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.437+0000 7fedc10dd700 1 -- 172.21.15.156:0/752277254 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedbc09e6a0 con 0x7fedbc0a1380 2023-09-30T22:22:59.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.437+0000 7f88e7fff700 1 -- 172.21.15.156:0/2776393238 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88e8133900 msgr2=0x7f88e8133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:59.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.437+0000 7f88e7fff700 1 --2- 172.21.15.156:0/2776393238 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88e8133900 0x7f88e8133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.437+0000 7f88e7fff700 1 -- 172.21.15.156:0/2776393238 >> v2:172.21.15.156:3300/0 conn(0x7f88e80a0ee0 msgr2=0x7f88e80a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:59.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.437+0000 7f88e7fff700 1 --2- 172.21.15.156:0/2776393238 >> v2:172.21.15.156:3300/0 conn(0x7f88e80a0ee0 0x7f88e80a1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.437+0000 7f88e7fff700 1 -- 172.21.15.156:0/2776393238 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e80a23e0 con 0x7f88e8134210 2023-09-30T22:22:59.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.437+0000 7f88ed55c700 1 --2- 172.21.15.156:0/2776393238 >> v2:172.21.15.156:3300/0 conn(0x7f88e80a0ee0 0x7f88e80a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:59.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.437+0000 7f88e7fff700 1 --2- 172.21.15.156:0/2776393238 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88e8134210 0x7f88e80a09a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f88d40098f0 tx=0x7f88d4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5308f7ab9755b5d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:59.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.437+0000 7fedc10dd700 1 --2- 172.21.15.156:0/752277254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedbc0a1380 0x7fedbc133a10 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fedac0098f0 tx=0x7fedac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d27408c2360fe15 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:59.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.437+0000 7f88e77fe700 1 -- 172.21.15.156:0/2776393238 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d400b8a0 con 0x7f88e8134210 2023-09-30T22:22:59.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.437+0000 7f88e77fe700 1 -- 172.21.15.156:0/2776393238 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d400ba00 con 0x7f88e8134210 2023-09-30T22:22:59.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.437+0000 7f88e77fe700 1 -- 172.21.15.156:0/2776393238 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d400bd90 con 0x7f88e8134210 2023-09-30T22:22:59.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.437+0000 7fedc08dc700 1 -- 172.21.15.156:0/752277254 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac011830 con 0x7fedbc0a1380 2023-09-30T22:22:59.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.437+0000 7fedc08dc700 1 -- 172.21.15.156:0/752277254 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac011990 con 0x7fedbc0a1380 2023-09-30T22:22:59.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.437+0000 7fedc08dc700 1 -- 172.21.15.156:0/752277254 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac011d20 con 0x7fedbc0a1380 2023-09-30T22:22:59.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.438+0000 7f88eefbf700 1 -- 172.21.15.156:0/2776393238 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88e8134210 msgr2=0x7f88e80a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.438+0000 7f88eefbf700 1 --2- 172.21.15.156:0/2776393238 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88e8134210 0x7f88e80a09a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f88d40098f0 tx=0x7f88d4009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:59.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.438+0000 7f88eefbf700 1 -- 172.21.15.156:0/2776393238 shutdown_connections 2023-09-30T22:22:59.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.438+0000 7f88eefbf700 1 --2- 172.21.15.156:0/2776393238 >> v2:172.21.15.156:3300/0 conn(0x7f88e80a0ee0 0x7f88e80a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.438+0000 7f88eefbf700 1 --2- 172.21.15.156:0/2776393238 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88e8133900 0x7f88e8133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.438+0000 7f88eefbf700 1 --2- 172.21.15.156:0/2776393238 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88e8134210 0x7f88e80a09a0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.438+0000 7f88eefbf700 1 -- 172.21.15.156:0/2776393238 >> 172.21.15.156:0/2776393238 conn(0x7f88e80a2980 msgr2=0x7f88e80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:59.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.438+0000 7fedc3b42700 1 -- 172.21.15.156:0/752277254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedbc0a1380 msgr2=0x7fedbc133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.438+0000 7fedc3b42700 1 --2- 172.21.15.156:0/752277254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedbc0a1380 0x7fedbc133a10 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fedac0098f0 tx=0x7fedac009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:59.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.438+0000 7fedc3b42700 1 -- 172.21.15.156:0/752277254 shutdown_connections 2023-09-30T22:22:59.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.438+0000 7fedc3b42700 1 --2- 172.21.15.156:0/752277254 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fedbc133f50 0x7fedbc134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.438+0000 7fedc3b42700 1 --2- 172.21.15.156:0/752277254 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fedbc0a0a70 0x7fedbc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.438+0000 7fedc3b42700 1 --2- 172.21.15.156:0/752277254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedbc0a1380 0x7fedbc133a10 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.438+0000 7fedc3b42700 1 -- 172.21.15.156:0/752277254 >> 172.21.15.156:0/752277254 conn(0x7fedbc0a6610 msgr2=0x7fedbc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:59.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.438+0000 7f88eefbf700 1 -- 172.21.15.156:0/2776393238 shutdown_connections 2023-09-30T22:22:59.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.438+0000 7f88eefbf700 1 -- 172.21.15.156:0/2776393238 wait complete. 2023-09-30T22:22:59.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.438+0000 7fedc3b42700 1 -- 172.21.15.156:0/752277254 shutdown_connections 2023-09-30T22:22:59.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.438+0000 7fedc3b42700 1 -- 172.21.15.156:0/752277254 wait complete. 2023-09-30T22:22:59.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.439+0000 7f88eefbf700 1 Processor -- start 2023-09-30T22:22:59.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.439+0000 7f88eefbf700 1 -- start start 2023-09-30T22:22:59.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.439+0000 7fedc3b42700 1 Processor -- start 2023-09-30T22:22:59.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.440+0000 7f88eefbf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88e80a0ee0 0x7f88e811c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.440+0000 7f88eefbf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88e8133900 0x7f88e811cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.440+0000 7f88eefbf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88e8134210 0x7f88e811d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.440+0000 7f88eefbf700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e811ffc0 con 0x7f88e80a0ee0 2023-09-30T22:22:59.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.440+0000 7f88eefbf700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e811e2f0 con 0x7f88e8133900 2023-09-30T22:22:59.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.440+0000 7f88eefbf700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88e811f540 con 0x7f88e8134210 2023-09-30T22:22:59.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.440+0000 7f88ecd5b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88e80a0ee0 0x7f88e811c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.440+0000 7f88ecd5b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88e80a0ee0 0x7f88e811c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40324/0 (socket says 172.21.15.156:40324) 2023-09-30T22:22:59.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.440+0000 7f88ecd5b700 1 -- 172.21.15.156:0/1873219069 learned_addr learned my addr 172.21.15.156:0/1873219069 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:59.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.440+0000 7f88ed55c700 1 --2- 172.21.15.156:0/1873219069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88e8134210 0x7f88e811d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.440+0000 7f88e7fff700 1 --2- 172.21.15.156:0/1873219069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88e8133900 0x7f88e811cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.440+0000 7f88ecd5b700 1 -- 172.21.15.156:0/1873219069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88e8134210 msgr2=0x7f88e811d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.440+0000 7f88ecd5b700 1 --2- 172.21.15.156:0/1873219069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88e8134210 0x7f88e811d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.440+0000 7f88ecd5b700 1 -- 172.21.15.156:0/1873219069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88e8133900 msgr2=0x7f88e811cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.440+0000 7f88ecd5b700 1 --2- 172.21.15.156:0/1873219069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88e8133900 0x7f88e811cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.440+0000 7f88ecd5b700 1 -- 172.21.15.156:0/1873219069 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d4009550 con 0x7f88e80a0ee0 2023-09-30T22:22:59.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.440+0000 7fedc3b42700 1 -- start start 2023-09-30T22:22:59.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.440+0000 7fedc3b42700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fedbc0a0a70 0x7fedbc122510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.440+0000 7fedc3b42700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedbc0a1380 0x7fedbc122a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.440+0000 7fedc3b42700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fedbc133f50 0x7fedbc122f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.440+0000 7fedc3b42700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedbc125db0 con 0x7fedbc0a1380 2023-09-30T22:22:59.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.440+0000 7fedc3b42700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedbc133800 con 0x7fedbc133f50 2023-09-30T22:22:59.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.440+0000 7fedc3b42700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedbc125fb0 con 0x7fedbc0a0a70 2023-09-30T22:22:59.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.440+0000 7fedc20df700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fedbc133f50 0x7fedbc122f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.440+0000 7fedc20df700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fedbc133f50 0x7fedbc122f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46574/0 (socket says 172.21.15.156:46574) 2023-09-30T22:22:59.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.440+0000 7fedc20df700 1 -- 172.21.15.156:0/2813612333 learned_addr learned my addr 172.21.15.156:0/2813612333 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:59.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.440+0000 7fedc18de700 1 --2- 172.21.15.156:0/2813612333 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fedbc0a0a70 0x7fedbc122510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.441+0000 7f88ecd5b700 1 --2- 172.21.15.156:0/1873219069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88e80a0ee0 0x7f88e811c730 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f88dc00b550 tx=0x7f88dc00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:59.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.441+0000 7fedc20df700 1 -- 172.21.15.156:0/2813612333 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fedbc0a0a70 msgr2=0x7fedbc122510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.441+0000 7fedc20df700 1 --2- 172.21.15.156:0/2813612333 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fedbc0a0a70 0x7fedbc122510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.441+0000 7fedc20df700 1 -- 172.21.15.156:0/2813612333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedbc0a1380 msgr2=0x7fedbc122a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.441+0000 7fedc20df700 1 --2- 172.21.15.156:0/2813612333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedbc0a1380 0x7fedbc122a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.441+0000 7fedc20df700 1 -- 172.21.15.156:0/2813612333 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac009550 con 0x7fedbc133f50 2023-09-30T22:22:59.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.441+0000 7f88e57fa700 1 -- 172.21.15.156:0/1873219069 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc005aa0 con 0x7f88e80a0ee0 2023-09-30T22:22:59.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.441+0000 7f88e57fa700 1 -- 172.21.15.156:0/1873219069 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88dc005c00 con 0x7f88e80a0ee0 2023-09-30T22:22:59.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.441+0000 7f88eefbf700 1 -- 172.21.15.156:0/1873219069 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e811e8b0 con 0x7f88e80a0ee0 2023-09-30T22:22:59.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.441+0000 7f88e57fa700 1 -- 172.21.15.156:0/1873219069 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc011630 con 0x7f88e80a0ee0 2023-09-30T22:22:59.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.441+0000 7f88eefbf700 1 -- 172.21.15.156:0/1873219069 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e811f9e0 con 0x7f88e80a0ee0 2023-09-30T22:22:59.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.441+0000 7fedc20df700 1 --2- 172.21.15.156:0/2813612333 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fedbc133f50 0x7fedbc122f90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fedb400b9a0 tx=0x7fedb400bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:59.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.442+0000 7fedb27fc700 1 -- 172.21.15.156:0/2813612333 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb400c930 con 0x7fedbc133f50 2023-09-30T22:22:59.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.442+0000 7fedb27fc700 1 -- 172.21.15.156:0/2813612333 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb400cab0 con 0x7fedbc133f50 2023-09-30T22:22:59.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.442+0000 7fedc3b42700 1 -- 172.21.15.156:0/2813612333 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedbc0a51b0 con 0x7fedbc133f50 2023-09-30T22:22:59.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.442+0000 7fedb27fc700 1 -- 172.21.15.156:0/2813612333 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb400ce60 con 0x7fedbc133f50 2023-09-30T22:22:59.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.442+0000 7fedc3b42700 1 -- 172.21.15.156:0/2813612333 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedbc126740 con 0x7fedbc133f50 2023-09-30T22:22:59.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.442+0000 7f88eefbf700 1 -- 172.21.15.156:0/1873219069 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e804f2a0 con 0x7f88e80a0ee0 2023-09-30T22:22:59.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.443+0000 7fedb27fc700 1 -- 172.21.15.156:0/2813612333 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fedb401d3b0 con 0x7fedbc133f50 2023-09-30T22:22:59.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.443+0000 7fedb27fc700 1 -- 172.21.15.156:0/2813612333 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fedb4006e40 con 0x7fedbc133f50 2023-09-30T22:22:59.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.443+0000 7fedc3b42700 1 -- 172.21.15.156:0/2813612333 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedbc11f050 con 0x7fedbc133f50 2023-09-30T22:22:59.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.443+0000 7f88e57fa700 1 -- 172.21.15.156:0/1873219069 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f88dc011790 con 0x7f88e80a0ee0 2023-09-30T22:22:59.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.444+0000 7f88e57fa700 1 -- 172.21.15.156:0/1873219069 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f88dc03fac0 con 0x7f88e80a0ee0 2023-09-30T22:22:59.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.448+0000 7fedb27fc700 1 -- 172.21.15.156:0/2813612333 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fedb4019080 con 0x7fedbc133f50 2023-09-30T22:22:59.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.448+0000 7f88e57fa700 1 -- 172.21.15.156:0/1873219069 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f88dc0233e0 con 0x7f88e80a0ee0 2023-09-30T22:22:59.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.508+0000 7fd55638c700 1 Processor -- start 2023-09-30T22:22:59.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.508+0000 7fd55638c700 1 -- start start 2023-09-30T22:22:59.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.508+0000 7fd55638c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd5501346e0 0x7fd550136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.508+0000 7fd55638c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd550137000 0x7fd5501393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.508+0000 7fd55638c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5500a1640 con 0x7fd550131980 2023-09-30T22:22:59.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.508+0000 7fd55638c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd55006eb30 con 0x7fd550137000 2023-09-30T22:22:59.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.508+0000 7fd55638c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5500a22d0 con 0x7fd5501346e0 2023-09-30T22:22:59.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.509+0000 7fd54ffff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fd550131980 0x7fd550131d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40356/0 (socket says 172.21.15.156:40356) 2023-09-30T22:22:59.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.509+0000 7fd54ffff700 1 -- 172.21.15.156:0/720695290 learned_addr learned my addr 172.21.15.156:0/720695290 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:22:59.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.509+0000 7fd554929700 1 --2- 172.21.15.156:0/720695290 >> v2:172.21.15.156:3300/0 conn(0x7fd550137000 0x7fd5501393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.509+0000 7fd54f7fe700 1 --2- 172.21.15.156:0/720695290 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd5501346e0 0x7fd550136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.509+0000 7fd554929700 1 -- 172.21.15.156:0/720695290 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd5501346e0 msgr2=0x7fd550136ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:59.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.509+0000 7fd554929700 1 --2- 172.21.15.156:0/720695290 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd5501346e0 0x7fd550136ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.509+0000 7fd554929700 1 -- 172.21.15.156:0/720695290 >> v1:172.21.15.156:6789/0 conn(0x7fd550131980 legacy=0x7fd550131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.509+0000 7fd554929700 1 -- 172.21.15.156:0/720695290 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd550131550 con 0x7fd550137000 2023-09-30T22:22:59.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.509+0000 7fd554929700 1 --2- 172.21.15.156:0/720695290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd550137000 0x7fd5501393e0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fd548009d90 tx=0x7fd54800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=126b7798d14431c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:59.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.509+0000 7fd54effd700 1 -- 172.21.15.156:0/720695290 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54800e070 con 0x7fd550137000 2023-09-30T22:22:59.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.509+0000 7fd54effd700 1 -- 172.21.15.156:0/720695290 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54800bb20 con 0x7fd550137000 2023-09-30T22:22:59.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.509+0000 7fd54effd700 1 -- 172.21.15.156:0/720695290 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd548012430 con 0x7fd550137000 2023-09-30T22:22:59.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.510+0000 7fd55638c700 1 -- 172.21.15.156:0/720695290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd550137000 msgr2=0x7fd5501393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.510+0000 7fd55638c700 1 --2- 172.21.15.156:0/720695290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd550137000 0x7fd5501393e0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fd548009d90 tx=0x7fd54800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:59.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.510+0000 7fd55638c700 1 -- 172.21.15.156:0/720695290 shutdown_connections 2023-09-30T22:22:59.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.510+0000 7fd55638c700 1 --2- 172.21.15.156:0/720695290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd550137000 0x7fd5501393e0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.510+0000 7fd55638c700 1 --2- 172.21.15.156:0/720695290 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd5501346e0 0x7fd550136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.510+0000 7fd55638c700 1 -- 172.21.15.156:0/720695290 >> 172.21.15.156:0/720695290 conn(0x7fd5500a2980 msgr2=0x7fd5500a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:59.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.510+0000 7fd55638c700 1 -- 172.21.15.156:0/720695290 shutdown_connections 2023-09-30T22:22:59.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.510+0000 7fd55638c700 1 -- 172.21.15.156:0/720695290 wait complete. 2023-09-30T22:22:59.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.511+0000 7fd55638c700 1 Processor -- start 2023-09-30T22:22:59.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.511+0000 7fd55638c700 1 -- start start 2023-09-30T22:22:59.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.512+0000 7fd55638c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd550131980 0x7fd55012c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.512+0000 7fd55638c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5501346e0 0x7fd55012cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.512+0000 7fd55638c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd550137000 0x7fd55012d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.512+0000 7fd55638c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55011b5d0 con 0x7fd5501346e0 2023-09-30T22:22:59.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.512+0000 7fd55638c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd550071950 con 0x7fd550131980 2023-09-30T22:22:59.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.512+0000 7fd55638c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd55011b7d0 con 0x7fd550137000 2023-09-30T22:22:59.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.512+0000 7fd54ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd550131980 0x7fd55012c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.512+0000 7fd54f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5501346e0 0x7fd55012cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.512+0000 7fd54f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5501346e0 0x7fd55012cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40360/0 (socket says 172.21.15.156:40360) 2023-09-30T22:22:59.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.512+0000 7fd54f7fe700 1 -- 172.21.15.156:0/105844286 learned_addr learned my addr 172.21.15.156:0/105844286 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:22:59.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.512+0000 7fd54ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd550131980 0x7fd55012c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46602/0 (socket says 172.21.15.156:46602) 2023-09-30T22:22:59.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.512+0000 7fd554929700 1 --2- 172.21.15.156:0/105844286 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd550137000 0x7fd55012d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.512+0000 7fd54f7fe700 1 -- 172.21.15.156:0/105844286 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd550137000 msgr2=0x7fd55012d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.512+0000 7fd54f7fe700 1 --2- 172.21.15.156:0/105844286 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd550137000 0x7fd55012d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.512+0000 7fd54f7fe700 1 -- 172.21.15.156:0/105844286 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd550131980 msgr2=0x7fd55012c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.512+0000 7fd54f7fe700 1 --2- 172.21.15.156:0/105844286 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd550131980 0x7fd55012c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.513+0000 7fd54f7fe700 1 -- 172.21.15.156:0/105844286 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd548009a70 con 0x7fd5501346e0 2023-09-30T22:22:59.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.513+0000 7fd54ffff700 1 --2- 172.21.15.156:0/105844286 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd550131980 0x7fd55012c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:59.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.513+0000 7fd54f7fe700 1 --2- 172.21.15.156:0/105844286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5501346e0 0x7fd55012cb80 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fd54400e9b0 tx=0x7fd54400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:59.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.513+0000 7fd54cff9700 1 -- 172.21.15.156:0/105844286 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd544009710 con 0x7fd5501346e0 2023-09-30T22:22:59.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.513+0000 7fd54cff9700 1 -- 172.21.15.156:0/105844286 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54400c850 con 0x7fd5501346e0 2023-09-30T22:22:59.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.513+0000 7fd55638c700 1 -- 172.21.15.156:0/105844286 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd550136d60 con 0x7fd5501346e0 2023-09-30T22:22:59.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.513+0000 7fd55638c700 1 -- 172.21.15.156:0/105844286 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd550070f20 con 0x7fd5501346e0 2023-09-30T22:22:59.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.514+0000 7fd54cff9700 1 -- 172.21.15.156:0/105844286 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54400cbc0 con 0x7fd5501346e0 2023-09-30T22:22:59.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.514+0000 7fd54cff9700 1 -- 172.21.15.156:0/105844286 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd544013470 con 0x7fd5501346e0 2023-09-30T22:22:59.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.514+0000 7fd55638c700 1 -- 172.21.15.156:0/105844286 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd55004f2a0 con 0x7fd5501346e0 2023-09-30T22:22:59.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.514+0000 7fd54cff9700 1 -- 172.21.15.156:0/105844286 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd54403fce0 con 0x7fd5501346e0 2023-09-30T22:22:59.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.519+0000 7fd54cff9700 1 -- 172.21.15.156:0/105844286 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd544013720 con 0x7fd5501346e0 2023-09-30T22:22:59.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.644+0000 7fedc3b42700 1 -- 172.21.15.156:0/2813612333 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fedbc04f2a0 con 0x7fedbc133f50 2023-09-30T22:22:59.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.644+0000 7fedb27fc700 1 -- 172.21.15.156:0/2813612333 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fedb4007370 con 0x7fedbc133f50 2023-09-30T22:22:59.644 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:22:59.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.645+0000 7f88eefbf700 1 -- 172.21.15.156:0/1873219069 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f88e806bce0 con 0x7f88e80a0ee0 2023-09-30T22:22:59.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.645+0000 7f88e57fa700 1 -- 172.21.15.156:0/1873219069 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f88dc010b70 con 0x7f88e80a0ee0 2023-09-30T22:22:59.645 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:22:59.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.647+0000 7fedc3b42700 1 -- 172.21.15.156:0/2813612333 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fedbc133f50 msgr2=0x7fedbc122f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.647+0000 7fedc3b42700 1 --2- 172.21.15.156:0/2813612333 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fedbc133f50 0x7fedbc122f90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fedb400b9a0 tx=0x7fedb400bcb0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.647+0000 7fedc3b42700 1 -- 172.21.15.156:0/2813612333 shutdown_connections 2023-09-30T22:22:59.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.647+0000 7fedc3b42700 1 --2- 172.21.15.156:0/2813612333 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fedbc133f50 0x7fedbc122f90 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.647+0000 7fedc3b42700 1 --2- 172.21.15.156:0/2813612333 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fedbc0a0a70 0x7fedbc122510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.647+0000 7fedc3b42700 1 --2- 172.21.15.156:0/2813612333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedbc0a1380 0x7fedbc122a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.647+0000 7fedc3b42700 1 -- 172.21.15.156:0/2813612333 >> 172.21.15.156:0/2813612333 conn(0x7fedbc0a6610 msgr2=0x7fedbc09f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:59.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.647+0000 7fedc3b42700 1 -- 172.21.15.156:0/2813612333 shutdown_connections 2023-09-30T22:22:59.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.647+0000 7fedc3b42700 1 -- 172.21.15.156:0/2813612333 wait complete. 2023-09-30T22:22:59.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.648+0000 7f88eefbf700 1 -- 172.21.15.156:0/1873219069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88e80a0ee0 msgr2=0x7f88e811c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.648+0000 7f88eefbf700 1 --2- 172.21.15.156:0/1873219069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88e80a0ee0 0x7f88e811c730 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f88dc00b550 tx=0x7f88dc00b860 comp rx=0 tx=0).stop 2023-09-30T22:22:59.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.649+0000 7f88eefbf700 1 -- 172.21.15.156:0/1873219069 shutdown_connections 2023-09-30T22:22:59.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.649+0000 7f88eefbf700 1 --2- 172.21.15.156:0/1873219069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88e8134210 0x7f88e811d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.649+0000 7f88eefbf700 1 --2- 172.21.15.156:0/1873219069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88e80a0ee0 0x7f88e811c730 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.649+0000 7f88eefbf700 1 --2- 172.21.15.156:0/1873219069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88e8133900 0x7f88e811cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.649+0000 7f88eefbf700 1 -- 172.21.15.156:0/1873219069 >> 172.21.15.156:0/1873219069 conn(0x7f88e80a2980 msgr2=0x7f88e81bae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:59.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.649+0000 7f88eefbf700 1 -- 172.21.15.156:0/1873219069 shutdown_connections 2023-09-30T22:22:59.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.649+0000 7f88eefbf700 1 -- 172.21.15.156:0/1873219069 wait complete. 2023-09-30T22:22:59.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.654+0000 7f4e3a51d700 1 -- 172.21.15.156:0/1164201002 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4e3406f010 con 0x7f4e34133ad0 2023-09-30T22:22:59.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.654+0000 7f4e30ff9700 1 -- 172.21.15.156:0/1164201002 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e3406f010 con 0x7f4e34133ad0 2023-09-30T22:22:59.654 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:22:59.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.656+0000 7f4e3a51d700 1 -- 172.21.15.156:0/1164201002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e34133ad0 msgr2=0x7f4e341cd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.656+0000 7f4e3a51d700 1 --2- 172.21.15.156:0/1164201002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e34133ad0 0x7f4e341cd210 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c016000 tx=0x7f4e2c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.656+0000 7f4e3a51d700 1 -- 172.21.15.156:0/1164201002 shutdown_connections 2023-09-30T22:22:59.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.656+0000 7f4e3a51d700 1 --2- 172.21.15.156:0/1164201002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e34133ad0 0x7f4e341cd210 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.656+0000 7f4e3a51d700 1 --2- 172.21.15.156:0/1164201002 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e341300a0 0x7f4e341cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.656+0000 7f4e3a51d700 1 --2- 172.21.15.156:0/1164201002 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e341309f0 0x7f4e341cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.656+0000 7f4e3a51d700 1 -- 172.21.15.156:0/1164201002 >> 172.21.15.156:0/1164201002 conn(0x7f4e34099c40 msgr2=0x7f4e34131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:59.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.656+0000 7f4e3a51d700 1 -- 172.21.15.156:0/1164201002 shutdown_connections 2023-09-30T22:22:59.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.656+0000 7f4e3a51d700 1 -- 172.21.15.156:0/1164201002 wait complete. 2023-09-30T22:22:59.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:22:59.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:22:59.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:22:59.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.719+0000 7fd55638c700 1 -- 172.21.15.156:0/105844286 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd55011b3c0 con 0x7fd5501346e0 2023-09-30T22:22:59.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.719+0000 7fd54cff9700 1 -- 172.21.15.156:0/105844286 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd544017020 con 0x7fd5501346e0 2023-09-30T22:22:59.719 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:22:59.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.721+0000 7fd55638c700 1 -- 172.21.15.156:0/105844286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5501346e0 msgr2=0x7fd55012cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.721+0000 7fd55638c700 1 --2- 172.21.15.156:0/105844286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5501346e0 0x7fd55012cb80 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fd54400e9b0 tx=0x7fd54400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.721+0000 7fd55638c700 1 -- 172.21.15.156:0/105844286 shutdown_connections 2023-09-30T22:22:59.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.721+0000 7fd55638c700 1 --2- 172.21.15.156:0/105844286 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd550137000 0x7fd55012d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.721+0000 7fd55638c700 1 --2- 172.21.15.156:0/105844286 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd550131980 0x7fd55012c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.721+0000 7fd55638c700 1 --2- 172.21.15.156:0/105844286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5501346e0 0x7fd55012cb80 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.721+0000 7fd55638c700 1 -- 172.21.15.156:0/105844286 >> 172.21.15.156:0/105844286 conn(0x7fd5500a2980 msgr2=0x7fd55012e150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:59.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.721+0000 7fd55638c700 1 -- 172.21.15.156:0/105844286 shutdown_connections 2023-09-30T22:22:59.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:22:59.721+0000 7fd55638c700 1 -- 172.21.15.156:0/105844286 wait complete. 2023-09-30T22:22:59.733 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:00.662 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:00.663 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:00.675 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:00.734 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:00.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.805+0000 7f05eeb1d700 1 Processor -- start 2023-09-30T22:23:00.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.805+0000 7f05eeb1d700 1 -- start start 2023-09-30T22:23:00.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.805+0000 7f05eeb1d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05e80a0a30 0x7f05e80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.805+0000 7f05eeb1d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05e80a1340 0x7f05e812ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.805+0000 7f05eeb1d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f05e81304a0 0x7f05e81308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.805+0000 7f05eeb1d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e8130e30 con 0x7f05e81304a0 2023-09-30T22:23:00.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.805+0000 7f05eeb1d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e80a1e70 con 0x7f05e80a1340 2023-09-30T22:23:00.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.805+0000 7f05eeb1d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05e809a720 con 0x7f05e80a0a30 2023-09-30T22:23:00.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.805+0000 7f05ec8b9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05e80a0a30 0x7f05e80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.805+0000 7f05ec8b9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05e80a0a30 0x7f05e80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54656/0 (socket says 172.21.15.156:54656) 2023-09-30T22:23:00.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.805+0000 7f05ec8b9700 1 -- 172.21.15.156:0/956077419 learned_addr learned my addr 172.21.15.156:0/956077419 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:00.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.805+0000 7f05e7fff700 1 --2- 172.21.15.156:0/956077419 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05e80a1340 0x7f05e812ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.806+0000 7f05ed0ba700 1 --2- 172.21.15.156:0/956077419 >> v2:172.21.15.156:3300/0 conn(0x7f05e81304a0 0x7f05e81308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.806+0000 7f05e7fff700 1 -- 172.21.15.156:0/956077419 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05e80a0a30 msgr2=0x7f05e80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:00.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.806+0000 7f05e7fff700 1 --2- 172.21.15.156:0/956077419 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05e80a0a30 0x7f05e80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.806+0000 7f05e7fff700 1 -- 172.21.15.156:0/956077419 >> v2:172.21.15.156:3300/0 conn(0x7f05e81304a0 msgr2=0x7f05e81308f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:00.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.806+0000 7f05e7fff700 1 --2- 172.21.15.156:0/956077419 >> v2:172.21.15.156:3300/0 conn(0x7f05e81304a0 0x7f05e81308f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.806+0000 7f05e7fff700 1 -- 172.21.15.156:0/956077419 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e809b300 con 0x7f05e80a1340 2023-09-30T22:23:00.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.806+0000 7f05ed0ba700 1 --2- 172.21.15.156:0/956077419 >> v2:172.21.15.156:3300/0 conn(0x7f05e81304a0 0x7f05e81308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:23:00.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.806+0000 7f05ec8b9700 1 --2- 172.21.15.156:0/956077419 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05e80a0a30 0x7f05e80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:00.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.806+0000 7f05e7fff700 1 --2- 172.21.15.156:0/956077419 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05e80a1340 0x7f05e812ff60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f05d4009840 tx=0x7f05d4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a310f15ece863f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:00.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.806+0000 7f05e77fe700 1 -- 172.21.15.156:0/956077419 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d4011830 con 0x7f05e80a1340 2023-09-30T22:23:00.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.806+0000 7f05e77fe700 1 -- 172.21.15.156:0/956077419 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d4011990 con 0x7f05e80a1340 2023-09-30T22:23:00.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.806+0000 7f05e77fe700 1 -- 172.21.15.156:0/956077419 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d4011d20 con 0x7f05e80a1340 2023-09-30T22:23:00.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.807+0000 7f05eeb1d700 1 -- 172.21.15.156:0/956077419 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05e80a1340 msgr2=0x7f05e812ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.807+0000 7f05eeb1d700 1 --2- 172.21.15.156:0/956077419 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05e80a1340 0x7f05e812ff60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f05d4009840 tx=0x7f05d4009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:00.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.807+0000 7f05eeb1d700 1 -- 172.21.15.156:0/956077419 shutdown_connections 2023-09-30T22:23:00.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.807+0000 7f05eeb1d700 1 --2- 172.21.15.156:0/956077419 >> v2:172.21.15.156:3300/0 conn(0x7f05e81304a0 0x7f05e81308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.807+0000 7f05eeb1d700 1 --2- 172.21.15.156:0/956077419 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05e80a0a30 0x7f05e80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.807+0000 7f05eeb1d700 1 --2- 172.21.15.156:0/956077419 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05e80a1340 0x7f05e812ff60 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.807+0000 7f05eeb1d700 1 -- 172.21.15.156:0/956077419 >> 172.21.15.156:0/956077419 conn(0x7f05e80a2980 msgr2=0x7f05e80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:00.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.807+0000 7f05eeb1d700 1 -- 172.21.15.156:0/956077419 shutdown_connections 2023-09-30T22:23:00.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.807+0000 7f05eeb1d700 1 -- 172.21.15.156:0/956077419 wait complete. 2023-09-30T22:23:00.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.808+0000 7f33f9de8700 1 Processor -- start 2023-09-30T22:23:00.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.808+0000 7f33f9de8700 1 -- start start 2023-09-30T22:23:00.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.808+0000 7f05eeb1d700 1 Processor -- start 2023-09-30T22:23:00.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.809+0000 7f05eeb1d700 1 -- start start 2023-09-30T22:23:00.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.809+0000 7f33f9de8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33f4133ad0 0x7f33f4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.809+0000 7f33f9de8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f33f41300a0 0x7f33f41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.809+0000 7f33f9de8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f41309f0 0x7f33f413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.809+0000 7f33f9de8700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f406b2d0 con 0x7f33f41300a0 2023-09-30T22:23:00.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.809+0000 7f33f9de8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f4133610 con 0x7f33f4133ad0 2023-09-30T22:23:00.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.809+0000 7f33f9de8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33f409a500 con 0x7f33f41309f0 2023-09-30T22:23:00.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.809+0000 7f33f2ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f33f41300a0 0x7f33f41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.809+0000 7f33f2ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f33f41300a0 0x7f33f41304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40372/0 (socket says 172.21.15.156:40372) 2023-09-30T22:23:00.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.809+0000 7f33f2ffd700 1 -- 172.21.15.156:0/1995860666 learned_addr learned my addr 172.21.15.156:0/1995860666 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:00.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.809+0000 7f33f2ffd700 1 -- 172.21.15.156:0/1995860666 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f41309f0 msgr2=0x7f33f413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:00.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.809+0000 7f33f2ffd700 1 --2- 172.21.15.156:0/1995860666 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f41309f0 0x7f33f413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.809+0000 7f33f2ffd700 1 -- 172.21.15.156:0/1995860666 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33f4133ad0 msgr2=0x7f33f4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:00.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.809+0000 7f33f2ffd700 1 --2- 172.21.15.156:0/1995860666 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33f4133ad0 0x7f33f4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.809+0000 7f33f2ffd700 1 -- 172.21.15.156:0/1995860666 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f41338b0 con 0x7f33f41300a0 2023-09-30T22:23:00.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.809+0000 7f05eeb1d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05e80a0a30 0x7f05e81c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.809+0000 7f05eeb1d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05e80a1340 0x7f05e81c4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.809+0000 7f05eeb1d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05e81304a0 0x7f05e81c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.809+0000 7f05eeb1d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e811e580 con 0x7f05e81304a0 2023-09-30T22:23:00.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.809+0000 7f05eeb1d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e81219a0 con 0x7f05e80a0a30 2023-09-30T22:23:00.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.809+0000 7f05eeb1d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05e811fce0 con 0x7f05e80a1340 2023-09-30T22:23:00.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.810+0000 7f33f2ffd700 1 --2- 172.21.15.156:0/1995860666 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33f41300a0 0x7f33f41304b0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f33e80098f0 tx=0x7f33e8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8988f39ed642dfef server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:00.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.810+0000 7f05ec8b9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05e80a0a30 0x7f05e81c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.810+0000 7f05ec8b9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05e80a0a30 0x7f05e81c3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46638/0 (socket says 172.21.15.156:46638) 2023-09-30T22:23:00.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.810+0000 7f05ec8b9700 1 -- 172.21.15.156:0/1965446271 learned_addr learned my addr 172.21.15.156:0/1965446271 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:00.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.810+0000 7f05ed0ba700 1 --2- 172.21.15.156:0/1965446271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05e81304a0 0x7f05e81c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.810+0000 7f05e7fff700 1 --2- 172.21.15.156:0/1965446271 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05e80a1340 0x7f05e81c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.810+0000 7f05ec8b9700 1 -- 172.21.15.156:0/1965446271 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05e80a1340 msgr2=0x7f05e81c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.810+0000 7f33f27fc700 1 -- 172.21.15.156:0/1995860666 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e800b8a0 con 0x7f33f41300a0 2023-09-30T22:23:00.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.810+0000 7f33f27fc700 1 -- 172.21.15.156:0/1995860666 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e800ba00 con 0x7f33f41300a0 2023-09-30T22:23:00.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.810+0000 7f33f27fc700 1 -- 172.21.15.156:0/1995860666 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e800bd90 con 0x7f33f41300a0 2023-09-30T22:23:00.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.810+0000 7f05ec8b9700 1 --2- 172.21.15.156:0/1965446271 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05e80a1340 0x7f05e81c4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.810+0000 7f05ec8b9700 1 -- 172.21.15.156:0/1965446271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05e81304a0 msgr2=0x7f05e81c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.810+0000 7f05ec8b9700 1 --2- 172.21.15.156:0/1965446271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05e81304a0 0x7f05e81c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.810+0000 7f05ec8b9700 1 -- 172.21.15.156:0/1965446271 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05dc00b7a0 con 0x7f05e80a0a30 2023-09-30T22:23:00.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.810+0000 7f05e7fff700 1 --2- 172.21.15.156:0/1965446271 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05e80a1340 0x7f05e81c4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:23:00.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.810+0000 7f05ec8b9700 1 --2- 172.21.15.156:0/1965446271 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05e80a0a30 0x7f05e81c3f40 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00dd40 tx=0x7f05dc009440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:00.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.810+0000 7f05e57fa700 1 -- 172.21.15.156:0/1965446271 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc009e60 con 0x7f05e80a0a30 2023-09-30T22:23:00.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.810+0000 7f05e57fa700 1 -- 172.21.15.156:0/1965446271 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05dc017070 con 0x7f05e80a0a30 2023-09-30T22:23:00.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.810+0000 7f05e57fa700 1 -- 172.21.15.156:0/1965446271 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc005c40 con 0x7f05e80a0a30 2023-09-30T22:23:00.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.811+0000 7f33f9de8700 1 -- 172.21.15.156:0/1995860666 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33f41300a0 msgr2=0x7f33f41304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.811+0000 7f33f9de8700 1 --2- 172.21.15.156:0/1995860666 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33f41300a0 0x7f33f41304b0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f33e80098f0 tx=0x7f33e8009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:00.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.811+0000 7f33f9de8700 1 -- 172.21.15.156:0/1995860666 shutdown_connections 2023-09-30T22:23:00.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.811+0000 7f33f9de8700 1 --2- 172.21.15.156:0/1995860666 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f41309f0 0x7f33f413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.811+0000 7f33f9de8700 1 --2- 172.21.15.156:0/1995860666 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33f4133ad0 0x7f33f4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.811+0000 7f33f9de8700 1 --2- 172.21.15.156:0/1995860666 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33f41300a0 0x7f33f41304b0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.811+0000 7f33f9de8700 1 -- 172.21.15.156:0/1995860666 >> 172.21.15.156:0/1995860666 conn(0x7f33f4099c40 msgr2=0x7f33f40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:00.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.811+0000 7f33f9de8700 1 -- 172.21.15.156:0/1995860666 shutdown_connections 2023-09-30T22:23:00.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.811+0000 7f33f9de8700 1 -- 172.21.15.156:0/1995860666 wait complete. 2023-09-30T22:23:00.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.811+0000 7f05eeb1d700 1 -- 172.21.15.156:0/1965446271 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d40094a0 con 0x7f05e80a0a30 2023-09-30T22:23:00.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.811+0000 7f05eeb1d700 1 -- 172.21.15.156:0/1965446271 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e809ae00 con 0x7f05e80a0a30 2023-09-30T22:23:00.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.812+0000 7f05e57fa700 1 -- 172.21.15.156:0/1965446271 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f05dc004020 con 0x7f05e80a0a30 2023-09-30T22:23:00.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.812+0000 7f05e57fa700 1 -- 172.21.15.156:0/1965446271 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f05dc019070 con 0x7f05e80a0a30 2023-09-30T22:23:00.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.812+0000 7f33f9de8700 1 Processor -- start 2023-09-30T22:23:00.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.813+0000 7f05eeb1d700 1 -- 172.21.15.156:0/1965446271 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e8121590 con 0x7f05e80a0a30 2023-09-30T22:23:00.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.813+0000 7f33f9de8700 1 -- start start 2023-09-30T22:23:00.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.813+0000 7f33f9de8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33f41300a0 0x7f33f411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.813+0000 7f33f9de8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f41309f0 0x7f33f411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.813+0000 7f33f9de8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33f4133ad0 0x7f33f411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.813+0000 7f33f9de8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f412da10 con 0x7f33f41300a0 2023-09-30T22:23:00.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.813+0000 7f33f9de8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f4120a30 con 0x7f33f4133ad0 2023-09-30T22:23:00.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.813+0000 7f33f9de8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33f412f890 con 0x7f33f41309f0 2023-09-30T22:23:00.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.814+0000 7f33f3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33f4133ad0 0x7f33f411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.814+0000 7f33f3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33f4133ad0 0x7f33f411e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46640/0 (socket says 172.21.15.156:46640) 2023-09-30T22:23:00.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.814+0000 7f33f3fff700 1 -- 172.21.15.156:0/2695615475 learned_addr learned my addr 172.21.15.156:0/2695615475 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:00.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.814+0000 7f33f2ffd700 1 --2- 172.21.15.156:0/2695615475 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f41309f0 0x7f33f411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.814+0000 7f33f37fe700 1 --2- 172.21.15.156:0/2695615475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33f41300a0 0x7f33f411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.814+0000 7f33f2ffd700 1 -- 172.21.15.156:0/2695615475 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33f4133ad0 msgr2=0x7f33f411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.814+0000 7f33f2ffd700 1 --2- 172.21.15.156:0/2695615475 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33f4133ad0 0x7f33f411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.814+0000 7f33f2ffd700 1 -- 172.21.15.156:0/2695615475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33f41300a0 msgr2=0x7f33f411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.814+0000 7f33f2ffd700 1 --2- 172.21.15.156:0/2695615475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33f41300a0 0x7f33f411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.814+0000 7f33f2ffd700 1 -- 172.21.15.156:0/2695615475 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e8009550 con 0x7f33f41309f0 2023-09-30T22:23:00.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.814+0000 7f33f2ffd700 1 --2- 172.21.15.156:0/2695615475 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f41309f0 0x7f33f411df80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f33e8016000 tx=0x7f33e8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:00.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.814+0000 7f33dbfff700 1 -- 172.21.15.156:0/2695615475 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e8004300 con 0x7f33f41309f0 2023-09-30T22:23:00.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.814+0000 7f33dbfff700 1 -- 172.21.15.156:0/2695615475 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e801f070 con 0x7f33f41309f0 2023-09-30T22:23:00.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.814+0000 7f33f9de8700 1 -- 172.21.15.156:0/2695615475 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f412dd00 con 0x7f33f41309f0 2023-09-30T22:23:00.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.815+0000 7f33dbfff700 1 -- 172.21.15.156:0/2695615475 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e80036a0 con 0x7f33f41309f0 2023-09-30T22:23:00.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.815+0000 7f33f9de8700 1 -- 172.21.15.156:0/2695615475 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f411fbe0 con 0x7f33f41309f0 2023-09-30T22:23:00.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.815+0000 7f33dbfff700 1 -- 172.21.15.156:0/2695615475 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f33e8021030 con 0x7f33f41309f0 2023-09-30T22:23:00.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.815+0000 7f33f9de8700 1 -- 172.21.15.156:0/2695615475 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f40718a0 con 0x7f33f41309f0 2023-09-30T22:23:00.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.816+0000 7f33dbfff700 1 -- 172.21.15.156:0/2695615475 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f33e8040670 con 0x7f33f41309f0 2023-09-30T22:23:00.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.820+0000 7f33dbfff700 1 -- 172.21.15.156:0/2695615475 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f33e80199a0 con 0x7f33f41309f0 2023-09-30T22:23:00.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.821+0000 7f05e57fa700 1 -- 172.21.15.156:0/1965446271 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f05e8121590 con 0x7f05e80a0a30 2023-09-30T22:23:00.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.848+0000 7f794402f700 1 Processor -- start 2023-09-30T22:23:00.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.848+0000 7f794402f700 1 -- start start 2023-09-30T22:23:00.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.849+0000 7f794402f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f793c136960 0x7f793c138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.849+0000 7f794402f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f793c139280 0x7f793c13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.849+0000 7f794402f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f793c06b2d0 con 0x7f793c133ad0 2023-09-30T22:23:00.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.849+0000 7f794402f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f793c1345b0 con 0x7f793c139280 2023-09-30T22:23:00.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.849+0000 7f794402f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793c133610 con 0x7f793c136960 2023-09-30T22:23:00.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.849+0000 7f7941dcb700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f793c133ad0 0x7f793c133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40362/0 (socket says 172.21.15.156:40362) 2023-09-30T22:23:00.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.849+0000 7f7941dcb700 1 -- 172.21.15.156:0/2444753179 learned_addr learned my addr 172.21.15.156:0/2444753179 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:00.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.849+0000 7f79425cc700 1 --2- 172.21.15.156:0/2444753179 >> v2:172.21.15.156:3300/0 conn(0x7f793c139280 0x7f793c13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.849+0000 7f79415ca700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f793c136960 0x7f793c138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.850+0000 7f79425cc700 1 -- 172.21.15.156:0/2444753179 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f793c136960 msgr2=0x7f793c138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:00.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.850+0000 7f79425cc700 1 --2- 172.21.15.156:0/2444753179 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f793c136960 0x7f793c138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.850+0000 7f79425cc700 1 -- 172.21.15.156:0/2444753179 >> v1:172.21.15.156:6789/0 conn(0x7f793c133ad0 legacy=0x7f793c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.850+0000 7f79425cc700 1 -- 172.21.15.156:0/2444753179 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c09a500 con 0x7f793c139280 2023-09-30T22:23:00.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.850+0000 7f79425cc700 1 --2- 172.21.15.156:0/2444753179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f793c139280 0x7f793c13b660 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f7934009dc0 tx=0x7f793400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6542b0086591bfb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:00.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.850+0000 7f7940dc9700 1 -- 172.21.15.156:0/2444753179 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793400e070 con 0x7f793c139280 2023-09-30T22:23:00.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.850+0000 7f7940dc9700 1 -- 172.21.15.156:0/2444753179 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7934003a20 con 0x7f793c139280 2023-09-30T22:23:00.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.850+0000 7f7940dc9700 1 -- 172.21.15.156:0/2444753179 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7934003db0 con 0x7f793c139280 2023-09-30T22:23:00.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.851+0000 7f794402f700 1 -- 172.21.15.156:0/2444753179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f793c139280 msgr2=0x7f793c13b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.851+0000 7f794402f700 1 --2- 172.21.15.156:0/2444753179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f793c139280 0x7f793c13b660 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f7934009dc0 tx=0x7f793400b330 comp rx=0 tx=0).stop 2023-09-30T22:23:00.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.851+0000 7f794402f700 1 -- 172.21.15.156:0/2444753179 shutdown_connections 2023-09-30T22:23:00.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.851+0000 7f794402f700 1 --2- 172.21.15.156:0/2444753179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f793c139280 0x7f793c13b660 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.851+0000 7f794402f700 1 --2- 172.21.15.156:0/2444753179 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f793c136960 0x7f793c138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.851+0000 7f794402f700 1 -- 172.21.15.156:0/2444753179 >> 172.21.15.156:0/2444753179 conn(0x7f793c099c40 msgr2=0x7f793c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:00.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.851+0000 7f794402f700 1 -- 172.21.15.156:0/2444753179 shutdown_connections 2023-09-30T22:23:00.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.851+0000 7f794402f700 1 -- 172.21.15.156:0/2444753179 wait complete. 2023-09-30T22:23:00.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.852+0000 7f794402f700 1 Processor -- start 2023-09-30T22:23:00.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.852+0000 7f794402f700 1 -- start start 2023-09-30T22:23:00.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.853+0000 7f794402f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f793c133ad0 0x7f793c071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.853+0000 7f794402f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f793c136960 0x7f793c0715b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.853+0000 7f794402f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f793c139280 0x7f793c071af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.853+0000 7f794402f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793c06ffd0 con 0x7f793c139280 2023-09-30T22:23:00.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.853+0000 7f794402f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793c06ee10 con 0x7f793c136960 2023-09-30T22:23:00.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.853+0000 7f794402f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f793c139070 con 0x7f793c133ad0 2023-09-30T22:23:00.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.853+0000 7f79425cc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f793c139280 0x7f793c071af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.853+0000 7f79425cc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f793c139280 0x7f793c071af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40416/0 (socket says 172.21.15.156:40416) 2023-09-30T22:23:00.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.853+0000 7f7941dcb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f793c133ad0 0x7f793c071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.853+0000 7f79425cc700 1 -- 172.21.15.156:0/2612176541 learned_addr learned my addr 172.21.15.156:0/2612176541 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:00.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.853+0000 7f79415ca700 1 --2- 172.21.15.156:0/2612176541 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f793c136960 0x7f793c0715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.853+0000 7f79425cc700 1 -- 172.21.15.156:0/2612176541 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f793c133ad0 msgr2=0x7f793c071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.853+0000 7f79425cc700 1 --2- 172.21.15.156:0/2612176541 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f793c133ad0 0x7f793c071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.853+0000 7f79425cc700 1 -- 172.21.15.156:0/2612176541 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f793c136960 msgr2=0x7f793c0715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.853+0000 7f79425cc700 1 --2- 172.21.15.156:0/2612176541 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f793c136960 0x7f793c0715b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.853+0000 7f79425cc700 1 -- 172.21.15.156:0/2612176541 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7934009a70 con 0x7f793c139280 2023-09-30T22:23:00.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.853+0000 7f7941dcb700 1 --2- 172.21.15.156:0/2612176541 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f793c133ad0 0x7f793c071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:00.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.854+0000 7f79425cc700 1 --2- 172.21.15.156:0/2612176541 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f793c139280 0x7f793c071af0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f7934015040 tx=0x7f7934004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:00.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.854+0000 7f79327fc700 1 -- 172.21.15.156:0/2612176541 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7934004540 con 0x7f793c139280 2023-09-30T22:23:00.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.854+0000 7f79327fc700 1 -- 172.21.15.156:0/2612176541 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79340046c0 con 0x7f793c139280 2023-09-30T22:23:00.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.854+0000 7f794402f700 1 -- 172.21.15.156:0/2612176541 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f793c12dd00 con 0x7f793c139280 2023-09-30T22:23:00.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.854+0000 7f79327fc700 1 -- 172.21.15.156:0/2612176541 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7934012450 con 0x7f793c139280 2023-09-30T22:23:00.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.854+0000 7f794402f700 1 -- 172.21.15.156:0/2612176541 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f793c070c20 con 0x7f793c139280 2023-09-30T22:23:00.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.855+0000 7f794402f700 1 -- 172.21.15.156:0/2612176541 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f793c04f2a0 con 0x7f793c139280 2023-09-30T22:23:00.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.855+0000 7f79327fc700 1 -- 172.21.15.156:0/2612176541 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f79340125b0 con 0x7f793c139280 2023-09-30T22:23:00.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.855+0000 7f79327fc700 1 -- 172.21.15.156:0/2612176541 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7934040d10 con 0x7f793c139280 2023-09-30T22:23:00.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.864+0000 7f79327fc700 1 -- 172.21.15.156:0/2612176541 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7934046020 con 0x7f793c139280 2023-09-30T22:23:00.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.889+0000 7fb96673c700 1 Processor -- start 2023-09-30T22:23:00.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.889+0000 7fb96673c700 1 -- start start 2023-09-30T22:23:00.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.890+0000 7fb96673c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb960136960 0x7fb960138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.890+0000 7fb96673c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb960139280 0x7fb96013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.890+0000 7fb96673c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb96006b2d0 con 0x7fb960133ad0 2023-09-30T22:23:00.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.890+0000 7fb96673c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9601345b0 con 0x7fb960136960 2023-09-30T22:23:00.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.890+0000 7fb96673c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb960133610 con 0x7fb960139280 2023-09-30T22:23:00.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.890+0000 7fb95ffff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb960133ad0 0x7fb960133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:40378/0 (socket says 172.21.15.156:40378) 2023-09-30T22:23:00.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.890+0000 7fb95ffff700 1 -- 172.21.15.156:0/2293602838 learned_addr learned my addr 172.21.15.156:0/2293602838 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:00.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.890+0000 7fb964cd9700 1 --2- 172.21.15.156:0/2293602838 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb960139280 0x7fb96013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.890+0000 7fb95f7fe700 1 --2- 172.21.15.156:0/2293602838 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb960136960 0x7fb960138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.890+0000 7fb964cd9700 1 -- 172.21.15.156:0/2293602838 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb960136960 msgr2=0x7fb960138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:00.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.890+0000 7fb964cd9700 1 --2- 172.21.15.156:0/2293602838 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb960136960 0x7fb960138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.890+0000 7fb964cd9700 1 -- 172.21.15.156:0/2293602838 >> v1:172.21.15.156:6789/0 conn(0x7fb960133ad0 legacy=0x7fb960133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.890+0000 7fb964cd9700 1 -- 172.21.15.156:0/2293602838 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96009a500 con 0x7fb960139280 2023-09-30T22:23:00.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.890+0000 7fb964cd9700 1 --2- 172.21.15.156:0/2293602838 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb960139280 0x7fb96013b660 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb958009dc0 tx=0x7fb95800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=929585ac62a24b44 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:00.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.891+0000 7fb95effd700 1 -- 172.21.15.156:0/2293602838 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95800e070 con 0x7fb960139280 2023-09-30T22:23:00.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.891+0000 7fb95effd700 1 -- 172.21.15.156:0/2293602838 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95800bb20 con 0x7fb960139280 2023-09-30T22:23:00.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.891+0000 7fb95effd700 1 -- 172.21.15.156:0/2293602838 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb958012430 con 0x7fb960139280 2023-09-30T22:23:00.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.891+0000 7fb96673c700 1 -- 172.21.15.156:0/2293602838 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb960139280 msgr2=0x7fb96013b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.891+0000 7fb96673c700 1 --2- 172.21.15.156:0/2293602838 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb960139280 0x7fb96013b660 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb958009dc0 tx=0x7fb95800b330 comp rx=0 tx=0).stop 2023-09-30T22:23:00.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.891+0000 7fb96673c700 1 -- 172.21.15.156:0/2293602838 shutdown_connections 2023-09-30T22:23:00.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.891+0000 7fb96673c700 1 --2- 172.21.15.156:0/2293602838 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb960139280 0x7fb96013b660 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.891+0000 7fb96673c700 1 --2- 172.21.15.156:0/2293602838 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb960136960 0x7fb960138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.891+0000 7fb96673c700 1 -- 172.21.15.156:0/2293602838 >> 172.21.15.156:0/2293602838 conn(0x7fb960099c40 msgr2=0x7fb9600a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:00.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.891+0000 7fb96673c700 1 -- 172.21.15.156:0/2293602838 shutdown_connections 2023-09-30T22:23:00.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.891+0000 7fb96673c700 1 -- 172.21.15.156:0/2293602838 wait complete. 2023-09-30T22:23:00.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.892+0000 7fb96673c700 1 Processor -- start 2023-09-30T22:23:00.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.892+0000 7fb96673c700 1 -- start start 2023-09-30T22:23:00.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.893+0000 7fb96673c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb960133ad0 0x7fb96012cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.893+0000 7fb96673c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb960136960 0x7fb96012d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.893+0000 7fb96673c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb960139280 0x7fb96012d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.893+0000 7fb96673c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9600702c0 con 0x7fb960133ad0 2023-09-30T22:23:00.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.893+0000 7fb96673c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb960130ac0 con 0x7fb960139280 2023-09-30T22:23:00.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.893+0000 7fb96673c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb960131630 con 0x7fb960136960 2023-09-30T22:23:00.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.893+0000 7fb95ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb960133ad0 0x7fb96012cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.893+0000 7fb95f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb960136960 0x7fb96012d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.893+0000 7fb95ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb960133ad0 0x7fb96012cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40430/0 (socket says 172.21.15.156:40430) 2023-09-30T22:23:00.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.893+0000 7fb95ffff700 1 -- 172.21.15.156:0/2373388943 learned_addr learned my addr 172.21.15.156:0/2373388943 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:00.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.893+0000 7fb95f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb960136960 0x7fb96012d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:54716/0 (socket says 172.21.15.156:54716) 2023-09-30T22:23:00.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.893+0000 7fb964cd9700 1 --2- 172.21.15.156:0/2373388943 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb960139280 0x7fb96012d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.893+0000 7fb95f7fe700 1 -- 172.21.15.156:0/2373388943 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb960139280 msgr2=0x7fb96012d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.893+0000 7fb95f7fe700 1 --2- 172.21.15.156:0/2373388943 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb960139280 0x7fb96012d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.893+0000 7fb95f7fe700 1 -- 172.21.15.156:0/2373388943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb960133ad0 msgr2=0x7fb96012cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.893+0000 7fb95f7fe700 1 --2- 172.21.15.156:0/2373388943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb960133ad0 0x7fb96012cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.893+0000 7fb95f7fe700 1 -- 172.21.15.156:0/2373388943 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb958009a70 con 0x7fb960136960 2023-09-30T22:23:00.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.893+0000 7fb95ffff700 1 --2- 172.21.15.156:0/2373388943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb960133ad0 0x7fb96012cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:00.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.894+0000 7fb95f7fe700 1 --2- 172.21.15.156:0/2373388943 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb960136960 0x7fb96012d070 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb95400e900 tx=0x7fb95400ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:00.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.894+0000 7fb95cff9700 1 -- 172.21.15.156:0/2373388943 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb954013680 con 0x7fb960136960 2023-09-30T22:23:00.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.894+0000 7fb95cff9700 1 -- 172.21.15.156:0/2373388943 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9540137e0 con 0x7fb960136960 2023-09-30T22:23:00.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.894+0000 7fb95cff9700 1 -- 172.21.15.156:0/2373388943 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb954013b50 con 0x7fb960136960 2023-09-30T22:23:00.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.894+0000 7fb96673c700 1 -- 172.21.15.156:0/2373388943 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9600723c0 con 0x7fb960136960 2023-09-30T22:23:00.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.894+0000 7fb96673c700 1 -- 172.21.15.156:0/2373388943 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb960070d30 con 0x7fb960136960 2023-09-30T22:23:00.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.895+0000 7fb95cff9700 1 -- 172.21.15.156:0/2373388943 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb954013cb0 con 0x7fb960136960 2023-09-30T22:23:00.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.895+0000 7fb96673c700 1 -- 172.21.15.156:0/2373388943 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb960070120 con 0x7fb960136960 2023-09-30T22:23:00.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.895+0000 7fb95cff9700 1 -- 172.21.15.156:0/2373388943 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb95403f670 con 0x7fb960136960 2023-09-30T22:23:00.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:00.904+0000 7fb95cff9700 1 -- 172.21.15.156:0/2373388943 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb960070120 con 0x7fb960136960 2023-09-30T22:23:01.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.021+0000 7f05eeb1d700 1 -- 172.21.15.156:0/1965446271 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f05e8121590 con 0x7f05e80a0a30 2023-09-30T22:23:01.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.022+0000 7f33f9de8700 1 -- 172.21.15.156:0/2695615475 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f33f404f2a0 con 0x7f33f41309f0 2023-09-30T22:23:01.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.022+0000 7f05e57fa700 1 -- 172.21.15.156:0/1965446271 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f05e8121590 con 0x7f05e80a0a30 2023-09-30T22:23:01.023 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:01.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.022+0000 7f33dbfff700 1 -- 172.21.15.156:0/2695615475 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f33e8011420 con 0x7f33f41309f0 2023-09-30T22:23:01.023 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:01.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.025+0000 7f05eeb1d700 1 -- 172.21.15.156:0/1965446271 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05e80a0a30 msgr2=0x7f05e81c3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:01.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.025+0000 7f05eeb1d700 1 --2- 172.21.15.156:0/1965446271 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05e80a0a30 0x7f05e81c3f40 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00dd40 tx=0x7f05dc009440 comp rx=0 tx=0).stop 2023-09-30T22:23:01.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.025+0000 7f05eeb1d700 1 -- 172.21.15.156:0/1965446271 shutdown_connections 2023-09-30T22:23:01.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.025+0000 7f05eeb1d700 1 --2- 172.21.15.156:0/1965446271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05e81304a0 0x7f05e81c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:01.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.025+0000 7f05eeb1d700 1 --2- 172.21.15.156:0/1965446271 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05e80a0a30 0x7f05e81c3f40 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:01.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.025+0000 7f05eeb1d700 1 --2- 172.21.15.156:0/1965446271 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05e80a1340 0x7f05e81c4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:01.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.025+0000 7f05eeb1d700 1 -- 172.21.15.156:0/1965446271 >> 172.21.15.156:0/1965446271 conn(0x7f05e80a2980 msgr2=0x7f05e809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:01.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.025+0000 7f05eeb1d700 1 -- 172.21.15.156:0/1965446271 shutdown_connections 2023-09-30T22:23:01.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.025+0000 7f33f9de8700 1 -- 172.21.15.156:0/2695615475 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f41309f0 msgr2=0x7f33f411df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:01.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.025+0000 7f33f9de8700 1 --2- 172.21.15.156:0/2695615475 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f41309f0 0x7f33f411df80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f33e8016000 tx=0x7f33e8004750 comp rx=0 tx=0).stop 2023-09-30T22:23:01.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.025+0000 7f05eeb1d700 1 -- 172.21.15.156:0/1965446271 wait complete. 2023-09-30T22:23:01.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.025+0000 7f33f9de8700 1 -- 172.21.15.156:0/2695615475 shutdown_connections 2023-09-30T22:23:01.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.025+0000 7f33f9de8700 1 --2- 172.21.15.156:0/2695615475 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33f4133ad0 0x7f33f411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:01.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.025+0000 7f33f9de8700 1 --2- 172.21.15.156:0/2695615475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33f41300a0 0x7f33f411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:01.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.025+0000 7f33f9de8700 1 --2- 172.21.15.156:0/2695615475 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33f41309f0 0x7f33f411df80 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:01.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.025+0000 7f33f9de8700 1 -- 172.21.15.156:0/2695615475 >> 172.21.15.156:0/2695615475 conn(0x7f33f4099c40 msgr2=0x7f33f4132080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:01.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.025+0000 7f33f9de8700 1 -- 172.21.15.156:0/2695615475 shutdown_connections 2023-09-30T22:23:01.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.025+0000 7f33f9de8700 1 -- 172.21.15.156:0/2695615475 wait complete. 2023-09-30T22:23:01.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:01.044 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:01.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.058+0000 7f794402f700 1 -- 172.21.15.156:0/2612176541 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f793c06c3b0 con 0x7f793c139280 2023-09-30T22:23:01.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.058+0000 7f79327fc700 1 -- 172.21.15.156:0/2612176541 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f79340117c0 con 0x7f793c139280 2023-09-30T22:23:01.059 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:01.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.060+0000 7f794402f700 1 -- 172.21.15.156:0/2612176541 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f793c139280 msgr2=0x7f793c071af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:01.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.060+0000 7f794402f700 1 --2- 172.21.15.156:0/2612176541 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f793c139280 0x7f793c071af0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f7934015040 tx=0x7f7934004ad0 comp rx=0 tx=0).stop 2023-09-30T22:23:01.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.060+0000 7f794402f700 1 -- 172.21.15.156:0/2612176541 shutdown_connections 2023-09-30T22:23:01.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.060+0000 7f794402f700 1 --2- 172.21.15.156:0/2612176541 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f793c139280 0x7f793c071af0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:01.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.060+0000 7f794402f700 1 --2- 172.21.15.156:0/2612176541 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f793c133ad0 0x7f793c071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:01.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.060+0000 7f794402f700 1 --2- 172.21.15.156:0/2612176541 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f793c136960 0x7f793c0715b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:01.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.060+0000 7f794402f700 1 -- 172.21.15.156:0/2612176541 >> 172.21.15.156:0/2612176541 conn(0x7f793c099c40 msgr2=0x7f793c134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:01.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.060+0000 7f794402f700 1 -- 172.21.15.156:0/2612176541 shutdown_connections 2023-09-30T22:23:01.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.060+0000 7f794402f700 1 -- 172.21.15.156:0/2612176541 wait complete. 2023-09-30T22:23:01.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:01.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.101+0000 7fb96673c700 1 -- 172.21.15.156:0/2373388943 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb960070120 con 0x7fb960136960 2023-09-30T22:23:01.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.101+0000 7fb95cff9700 1 -- 172.21.15.156:0/2373388943 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb960070120 con 0x7fb960136960 2023-09-30T22:23:01.103 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:01.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.104+0000 7fb96673c700 1 -- 172.21.15.156:0/2373388943 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb960136960 msgr2=0x7fb96012d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:01.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.104+0000 7fb96673c700 1 --2- 172.21.15.156:0/2373388943 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb960136960 0x7fb96012d070 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb95400e900 tx=0x7fb95400ec10 comp rx=0 tx=0).stop 2023-09-30T22:23:01.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.104+0000 7fb96673c700 1 -- 172.21.15.156:0/2373388943 shutdown_connections 2023-09-30T22:23:01.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.104+0000 7fb96673c700 1 --2- 172.21.15.156:0/2373388943 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb960139280 0x7fb96012d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:01.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.104+0000 7fb96673c700 1 --2- 172.21.15.156:0/2373388943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb960133ad0 0x7fb96012cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:01.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.104+0000 7fb96673c700 1 --2- 172.21.15.156:0/2373388943 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb960136960 0x7fb96012d070 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:01.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.104+0000 7fb96673c700 1 -- 172.21.15.156:0/2373388943 >> 172.21.15.156:0/2373388943 conn(0x7fb960099c40 msgr2=0x7fb960138590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:01.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.104+0000 7fb96673c700 1 -- 172.21.15.156:0/2373388943 shutdown_connections 2023-09-30T22:23:01.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:01.104+0000 7fb96673c700 1 -- 172.21.15.156:0/2373388943 wait complete. 2023-09-30T22:23:01.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:02.045 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:02.045 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:02.074 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:02.118 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:02.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.189+0000 7fa9bcb0b700 1 Processor -- start 2023-09-30T22:23:02.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.189+0000 7fa9bcb0b700 1 -- start start 2023-09-30T22:23:02.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.189+0000 7f72bbfa2700 1 Processor -- start 2023-09-30T22:23:02.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.190+0000 7f72bbfa2700 1 -- start start 2023-09-30T22:23:02.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.190+0000 7fa9bcb0b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa9b809e870 0x7fa9b809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.190+0000 7fa9bcb0b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa9b8131f40 0x7fa9b8139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.190+0000 7fa9bcb0b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b809c970 con 0x7fa9b809f180 2023-09-30T22:23:02.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.190+0000 7fa9bcb0b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b80a0920 con 0x7fa9b809e870 2023-09-30T22:23:02.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.190+0000 7fa9bcb0b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b809f9c0 con 0x7fa9b8131f40 2023-09-30T22:23:02.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.190+0000 7fa9b659c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa9b809e870 0x7fa9b809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.190+0000 7fa9b659c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa9b809e870 0x7fa9b809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51584/0 (socket says 172.21.15.156:51584) 2023-09-30T22:23:02.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.190+0000 7fa9b659c700 1 -- 172.21.15.156:0/2537011372 learned_addr learned my addr 172.21.15.156:0/2537011372 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:02.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.190+0000 7fa9b6d9d700 1 --2- 172.21.15.156:0/2537011372 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa9b8131f40 0x7fa9b8139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.190+0000 7f72bbfa2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72b4099e20 0x7f72b409a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.190+0000 7f72bbfa2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72b409a730 0x7f72b4130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.190+0000 7f72bbfa2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f72b4130890 0x7f72b4130d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.190+0000 7f72bbfa2700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b409bf50 con 0x7f72b4130890 2023-09-30T22:23:02.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.190+0000 7f72bbfa2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b4099a60 con 0x7f72b4099e20 2023-09-30T22:23:02.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.190+0000 7f72bbfa2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72b409b230 con 0x7f72b409a730 2023-09-30T22:23:02.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.190+0000 7f72b9d3e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72b4099e20 0x7f72b409a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.190+0000 7f72b9d3e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72b4099e20 0x7f72b409a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51586/0 (socket says 172.21.15.156:51586) 2023-09-30T22:23:02.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.190+0000 7f72b9d3e700 1 -- 172.21.15.156:0/688925762 learned_addr learned my addr 172.21.15.156:0/688925762 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:02.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.190+0000 7f72ba53f700 1 --2- 172.21.15.156:0/688925762 >> v2:172.21.15.156:3300/0 conn(0x7f72b4130890 0x7f72b4130d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.190+0000 7fa9b6d9d700 1 -- 172.21.15.156:0/2537011372 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa9b809e870 msgr2=0x7fa9b809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:02.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.190+0000 7fa9b6d9d700 1 --2- 172.21.15.156:0/2537011372 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa9b809e870 0x7fa9b809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.190+0000 7fa9b6d9d700 1 -- 172.21.15.156:0/2537011372 >> v1:172.21.15.156:6789/0 conn(0x7fa9b809f180 legacy=0x7fa9b8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.191+0000 7fa9b6d9d700 1 -- 172.21.15.156:0/2537011372 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b809bab0 con 0x7fa9b8131f40 2023-09-30T22:23:02.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.191+0000 7f72b953d700 1 --2- 172.21.15.156:0/688925762 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72b409a730 0x7f72b4130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.191+0000 7f72b9d3e700 1 -- 172.21.15.156:0/688925762 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72b409a730 msgr2=0x7f72b4130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:02.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.191+0000 7f72b9d3e700 1 --2- 172.21.15.156:0/688925762 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72b409a730 0x7f72b4130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.191+0000 7f72b9d3e700 1 -- 172.21.15.156:0/688925762 >> v2:172.21.15.156:3300/0 conn(0x7f72b4130890 msgr2=0x7f72b4130d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:02.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.191+0000 7f72b9d3e700 1 --2- 172.21.15.156:0/688925762 >> v2:172.21.15.156:3300/0 conn(0x7f72b4130890 0x7f72b4130d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.191+0000 7f72b9d3e700 1 -- 172.21.15.156:0/688925762 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b409bb90 con 0x7f72b4099e20 2023-09-30T22:23:02.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.191+0000 7f72b953d700 1 --2- 172.21.15.156:0/688925762 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72b409a730 0x7f72b4130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:02.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.191+0000 7fa9b6d9d700 1 --2- 172.21.15.156:0/2537011372 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa9b8131f40 0x7fa9b8139ca0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0009dc0 tx=0x7fa9b000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbf297feb7eaded0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:02.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.191+0000 7f72b9d3e700 1 --2- 172.21.15.156:0/688925762 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72b4099e20 0x7f72b409a1f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f72b0006fd0 tx=0x7f72b0009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e78a496031891563 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:02.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.191+0000 7f72b8d3c700 1 -- 172.21.15.156:0/688925762 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0005e30 con 0x7f72b4099e20 2023-09-30T22:23:02.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.191+0000 7f72b8d3c700 1 -- 172.21.15.156:0/688925762 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b0004030 con 0x7f72b4099e20 2023-09-30T22:23:02.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.191+0000 7f72b8d3c700 1 -- 172.21.15.156:0/688925762 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b00043e0 con 0x7f72b4099e20 2023-09-30T22:23:02.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.192+0000 7fa9b559a700 1 -- 172.21.15.156:0/2537011372 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b000e070 con 0x7fa9b8131f40 2023-09-30T22:23:02.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.192+0000 7fa9b559a700 1 -- 172.21.15.156:0/2537011372 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b000bb20 con 0x7fa9b8131f40 2023-09-30T22:23:02.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.192+0000 7fa9b559a700 1 -- 172.21.15.156:0/2537011372 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0012430 con 0x7fa9b8131f40 2023-09-30T22:23:02.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.192+0000 7f72bbfa2700 1 -- 172.21.15.156:0/688925762 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72b4099e20 msgr2=0x7f72b409a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.192+0000 7f72bbfa2700 1 --2- 172.21.15.156:0/688925762 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72b4099e20 0x7f72b409a1f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f72b0006fd0 tx=0x7f72b0009bd0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.192+0000 7f72bbfa2700 1 -- 172.21.15.156:0/688925762 shutdown_connections 2023-09-30T22:23:02.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.192+0000 7f72bbfa2700 1 --2- 172.21.15.156:0/688925762 >> v2:172.21.15.156:3300/0 conn(0x7f72b4130890 0x7f72b4130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.192+0000 7f72bbfa2700 1 --2- 172.21.15.156:0/688925762 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72b4099e20 0x7f72b409a1f0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.192+0000 7f72bbfa2700 1 --2- 172.21.15.156:0/688925762 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72b409a730 0x7f72b4130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.192+0000 7f72bbfa2700 1 -- 172.21.15.156:0/688925762 >> 172.21.15.156:0/688925762 conn(0x7f72b40a2980 msgr2=0x7f72b40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:02.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.192+0000 7f72bbfa2700 1 -- 172.21.15.156:0/688925762 shutdown_connections 2023-09-30T22:23:02.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.192+0000 7f72bbfa2700 1 -- 172.21.15.156:0/688925762 wait complete. 2023-09-30T22:23:02.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.192+0000 7fa9bcb0b700 1 -- 172.21.15.156:0/2537011372 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa9b8131f40 msgr2=0x7fa9b8139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.192+0000 7fa9bcb0b700 1 --2- 172.21.15.156:0/2537011372 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa9b8131f40 0x7fa9b8139ca0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0009dc0 tx=0x7fa9b000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:02.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.193+0000 7fa9bcb0b700 1 -- 172.21.15.156:0/2537011372 shutdown_connections 2023-09-30T22:23:02.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.193+0000 7fa9bcb0b700 1 --2- 172.21.15.156:0/2537011372 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa9b809e870 0x7fa9b809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.193+0000 7fa9bcb0b700 1 --2- 172.21.15.156:0/2537011372 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa9b8131f40 0x7fa9b8139ca0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.193+0000 7fa9bcb0b700 1 -- 172.21.15.156:0/2537011372 >> 172.21.15.156:0/2537011372 conn(0x7fa9b80a4430 msgr2=0x7fa9b80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:02.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.193+0000 7fa9bcb0b700 1 -- 172.21.15.156:0/2537011372 shutdown_connections 2023-09-30T22:23:02.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.193+0000 7fa9bcb0b700 1 -- 172.21.15.156:0/2537011372 wait complete. 2023-09-30T22:23:02.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.193+0000 7f72bbfa2700 1 Processor -- start 2023-09-30T22:23:02.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.193+0000 7f72bbfa2700 1 -- start start 2023-09-30T22:23:02.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.194+0000 7fa9bcb0b700 1 Processor -- start 2023-09-30T22:23:02.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.194+0000 7fa9bcb0b700 1 -- start start 2023-09-30T22:23:02.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.194+0000 7f72bbfa2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72b4099e20 0x7f72b411a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.194+0000 7f72bbfa2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72b409a730 0x7f72b411aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.194+0000 7f72bbfa2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72b4130890 0x7f72b411b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.194+0000 7f72bbfa2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b411be60 con 0x7f72b4099e20 2023-09-30T22:23:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.194+0000 7f72bbfa2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b411e4b0 con 0x7f72b4130890 2023-09-30T22:23:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.194+0000 7f72bbfa2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72b411d7f0 con 0x7f72b409a730 2023-09-30T22:23:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.194+0000 7f72b9d3e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72b4099e20 0x7f72b411a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.194+0000 7f72b9d3e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72b4099e20 0x7f72b411a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:45628/0 (socket says 172.21.15.156:45628) 2023-09-30T22:23:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.194+0000 7f72b9d3e700 1 -- 172.21.15.156:0/1736059194 learned_addr learned my addr 172.21.15.156:0/1736059194 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.194+0000 7f72ba53f700 1 --2- 172.21.15.156:0/1736059194 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72b4130890 0x7f72b411b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.194+0000 7f72b953d700 1 --2- 172.21.15.156:0/1736059194 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72b409a730 0x7f72b411aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.194+0000 7fa9bcb0b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9b809e870 0x7fa9b8120160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.194+0000 7fa9bcb0b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa9b809f180 0x7fa9b81206a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.194+0000 7fa9bcb0b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa9b8131f40 0x7fa9b8120be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.194+0000 7fa9bcb0b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b8131530 con 0x7fa9b809e870 2023-09-30T22:23:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.194+0000 7fa9bcb0b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b81215c0 con 0x7fa9b809f180 2023-09-30T22:23:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.194+0000 7fa9bcb0b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b8122c00 con 0x7fa9b8131f40 2023-09-30T22:23:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.195+0000 7fa9b6d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa9b8131f40 0x7fa9b8120be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.195+0000 7fa9b5d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa9b809f180 0x7fa9b81206a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.195+0000 7fa9b6d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa9b8131f40 0x7fa9b8120be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56614/0 (socket says 172.21.15.156:56614) 2023-09-30T22:23:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.195+0000 7fa9b6d9d700 1 -- 172.21.15.156:0/3905077613 learned_addr learned my addr 172.21.15.156:0/3905077613 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.195+0000 7fa9b6d9d700 1 -- 172.21.15.156:0/3905077613 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa9b809f180 msgr2=0x7fa9b81206a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.195+0000 7fa9b6d9d700 1 --2- 172.21.15.156:0/3905077613 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa9b809f180 0x7fa9b81206a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.195+0000 7fa9b6d9d700 1 -- 172.21.15.156:0/3905077613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9b809e870 msgr2=0x7fa9b8120160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.195+0000 7fa9b6d9d700 1 --2- 172.21.15.156:0/3905077613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9b809e870 0x7fa9b8120160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.195+0000 7fa9b6d9d700 1 -- 172.21.15.156:0/3905077613 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b0009a70 con 0x7fa9b8131f40 2023-09-30T22:23:02.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.194+0000 7f72ba53f700 1 -- 172.21.15.156:0/1736059194 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72b409a730 msgr2=0x7f72b411aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.194+0000 7f72ba53f700 1 --2- 172.21.15.156:0/1736059194 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72b409a730 0x7f72b411aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.194+0000 7f72ba53f700 1 -- 172.21.15.156:0/1736059194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72b4099e20 msgr2=0x7f72b411a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.194+0000 7f72ba53f700 1 --2- 172.21.15.156:0/1736059194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72b4099e20 0x7f72b411a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.194+0000 7f72ba53f700 1 -- 172.21.15.156:0/1736059194 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b0009500 con 0x7f72b4130890 2023-09-30T22:23:02.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.195+0000 7f72ba53f700 1 --2- 172.21.15.156:0/1736059194 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72b4130890 0x7f72b411b410 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00efc0 tx=0x7f72ac00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:02.206 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.195+0000 7fa9b6d9d700 1 --2- 172.21.15.156:0/3905077613 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa9b8131f40 0x7fa9b8120be0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa9b000b370 tx=0x7fa9b0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:02.206 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.195+0000 7f72aa7fc700 1 -- 172.21.15.156:0/1736059194 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac00cd40 con 0x7f72b4130890 2023-09-30T22:23:02.206 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.195+0000 7f72aa7fc700 1 -- 172.21.15.156:0/1736059194 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ac00f040 con 0x7f72b4130890 2023-09-30T22:23:02.206 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.196+0000 7f72aa7fc700 1 -- 172.21.15.156:0/1736059194 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac0146c0 con 0x7f72b4130890 2023-09-30T22:23:02.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.196+0000 7fa9a6ffd700 1 -- 172.21.15.156:0/3905077613 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0026070 con 0x7fa9b8131f40 2023-09-30T22:23:02.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.196+0000 7fa9a6ffd700 1 -- 172.21.15.156:0/3905077613 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b0003e00 con 0x7fa9b8131f40 2023-09-30T22:23:02.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.196+0000 7fa9a6ffd700 1 -- 172.21.15.156:0/3905077613 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0004490 con 0x7fa9b8131f40 2023-09-30T22:23:02.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.196+0000 7fa9bcb0b700 1 -- 172.21.15.156:0/3905077613 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b81236e0 con 0x7fa9b8131f40 2023-09-30T22:23:02.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.196+0000 7fa9bcb0b700 1 -- 172.21.15.156:0/3905077613 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b809dba0 con 0x7fa9b8131f40 2023-09-30T22:23:02.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.196+0000 7f72bbfa2700 1 -- 172.21.15.156:0/1736059194 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b411cb80 con 0x7f72b4130890 2023-09-30T22:23:02.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.196+0000 7f72bbfa2700 1 -- 172.21.15.156:0/1736059194 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b409b470 con 0x7f72b4130890 2023-09-30T22:23:02.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.197+0000 7fa9bcb0b700 1 -- 172.21.15.156:0/3905077613 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b811ce70 con 0x7fa9b8131f40 2023-09-30T22:23:02.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.198+0000 7f72aa7fc700 1 -- 172.21.15.156:0/1736059194 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f72ac014820 con 0x7f72b4130890 2023-09-30T22:23:02.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.198+0000 7f72bbfa2700 1 -- 172.21.15.156:0/1736059194 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b4070e50 con 0x7f72b4130890 2023-09-30T22:23:02.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.198+0000 7f72aa7fc700 1 -- 172.21.15.156:0/1736059194 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f72ac0402e0 con 0x7f72b4130890 2023-09-30T22:23:02.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.198+0000 7fa9a6ffd700 1 -- 172.21.15.156:0/3905077613 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa9b00045f0 con 0x7fa9b8131f40 2023-09-30T22:23:02.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.198+0000 7fa9a6ffd700 1 -- 172.21.15.156:0/3905077613 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa9b0048fd0 con 0x7fa9b8131f40 2023-09-30T22:23:02.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.206+0000 7fa9a6ffd700 1 -- 172.21.15.156:0/3905077613 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa9b0011390 con 0x7fa9b8131f40 2023-09-30T22:23:02.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.207+0000 7f72aa7fc700 1 -- 172.21.15.156:0/1736059194 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f72ac018020 con 0x7f72b4130890 2023-09-30T22:23:02.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.226+0000 7f1ac903c700 1 Processor -- start 2023-09-30T22:23:02.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.227+0000 7f1ac903c700 1 -- start start 2023-09-30T22:23:02.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.227+0000 7f1ac903c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ac406a770 0x7f1ac406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.227+0000 7f1ac903c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1ac406b080 0x7f1ac41317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.227+0000 7f1ac903c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1ac4131cf0 0x7f1ac4132190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.227+0000 7f1ac903c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac409f770 con 0x7f1ac406b080 2023-09-30T22:23:02.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.227+0000 7f1ac903c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac409dce0 con 0x7f1ac406a770 2023-09-30T22:23:02.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.227+0000 7f1ac903c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac409da80 con 0x7f1ac4131cf0 2023-09-30T22:23:02.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.227+0000 7f1ac259c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1ac406b080 0x7f1ac41317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.227+0000 7f1ac259c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1ac406b080 0x7f1ac41317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:45654/0 (socket says 172.21.15.156:45654) 2023-09-30T22:23:02.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.227+0000 7f1ac259c700 1 -- 172.21.15.156:0/2225102381 learned_addr learned my addr 172.21.15.156:0/2225102381 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:02.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.227+0000 7f1ac2d9d700 1 --2- 172.21.15.156:0/2225102381 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ac406a770 0x7f1ac406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.228+0000 7f1ac359e700 1 --2- 172.21.15.156:0/2225102381 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1ac4131cf0 0x7f1ac4132190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.228+0000 7f1ac2d9d700 1 -- 172.21.15.156:0/2225102381 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1ac4131cf0 msgr2=0x7f1ac4132190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:02.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.228+0000 7f1ac2d9d700 1 --2- 172.21.15.156:0/2225102381 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1ac4131cf0 0x7f1ac4132190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.228+0000 7f1ac2d9d700 1 -- 172.21.15.156:0/2225102381 >> v2:172.21.15.156:3300/0 conn(0x7f1ac406b080 msgr2=0x7f1ac41317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:02.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.228+0000 7f1ac2d9d700 1 --2- 172.21.15.156:0/2225102381 >> v2:172.21.15.156:3300/0 conn(0x7f1ac406b080 0x7f1ac41317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.228+0000 7f1ac2d9d700 1 -- 172.21.15.156:0/2225102381 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac409eb20 con 0x7f1ac406a770 2023-09-30T22:23:02.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.228+0000 7f1ac259c700 1 --2- 172.21.15.156:0/2225102381 >> v2:172.21.15.156:3300/0 conn(0x7f1ac406b080 0x7f1ac41317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:02.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.228+0000 7f1ac359e700 1 --2- 172.21.15.156:0/2225102381 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1ac4131cf0 0x7f1ac4132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:23:02.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.228+0000 7f1ac2d9d700 1 --2- 172.21.15.156:0/2225102381 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ac406a770 0x7f1ac406ab40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4009840 tx=0x7f1ab4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1665137632647d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:02.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.228+0000 7f1ac1d9b700 1 -- 172.21.15.156:0/2225102381 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab4010a90 con 0x7f1ac406a770 2023-09-30T22:23:02.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.228+0000 7f1ac1d9b700 1 -- 172.21.15.156:0/2225102381 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab4010bf0 con 0x7f1ac406a770 2023-09-30T22:23:02.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.228+0000 7f1ac1d9b700 1 -- 172.21.15.156:0/2225102381 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab4018440 con 0x7f1ac406a770 2023-09-30T22:23:02.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.228+0000 7f1ac903c700 1 -- 172.21.15.156:0/2225102381 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ac406a770 msgr2=0x7f1ac406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.229+0000 7f1ac903c700 1 --2- 172.21.15.156:0/2225102381 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ac406a770 0x7f1ac406ab40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4009840 tx=0x7f1ab4009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:02.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.229+0000 7f1ac903c700 1 -- 172.21.15.156:0/2225102381 shutdown_connections 2023-09-30T22:23:02.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.229+0000 7f1ac903c700 1 --2- 172.21.15.156:0/2225102381 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1ac4131cf0 0x7f1ac4132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.229+0000 7f1ac903c700 1 --2- 172.21.15.156:0/2225102381 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ac406a770 0x7f1ac406ab40 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.229+0000 7f1ac903c700 1 --2- 172.21.15.156:0/2225102381 >> v2:172.21.15.156:3300/0 conn(0x7f1ac406b080 0x7f1ac41317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.229+0000 7f1ac903c700 1 -- 172.21.15.156:0/2225102381 >> 172.21.15.156:0/2225102381 conn(0x7f1ac4099c40 msgr2=0x7f1ac40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:02.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.229+0000 7f1ac903c700 1 -- 172.21.15.156:0/2225102381 shutdown_connections 2023-09-30T22:23:02.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.229+0000 7f1ac903c700 1 -- 172.21.15.156:0/2225102381 wait complete. 2023-09-30T22:23:02.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.230+0000 7f1ac903c700 1 Processor -- start 2023-09-30T22:23:02.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.230+0000 7f1ac903c700 1 -- start start 2023-09-30T22:23:02.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.230+0000 7f1ac903c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ac406a770 0x7f1ac411c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.230+0000 7f1ac903c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ac406b080 0x7f1ac411c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.230+0000 7f1ac903c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1ac4131cf0 0x7f1ac41c3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.230+0000 7f1ac903c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac412f540 con 0x7f1ac406b080 2023-09-30T22:23:02.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.230+0000 7f1ac903c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac411c0a0 con 0x7f1ac406a770 2023-09-30T22:23:02.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.230+0000 7f1ac903c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac411f6e0 con 0x7f1ac4131cf0 2023-09-30T22:23:02.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.231+0000 7f1ac2d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ac406a770 0x7f1ac411c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.231+0000 7f1ac2d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ac406a770 0x7f1ac411c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51616/0 (socket says 172.21.15.156:51616) 2023-09-30T22:23:02.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.231+0000 7f1ac2d9d700 1 -- 172.21.15.156:0/2150124929 learned_addr learned my addr 172.21.15.156:0/2150124929 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:02.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.231+0000 7f1ac259c700 1 --2- 172.21.15.156:0/2150124929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ac406b080 0x7f1ac411c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.231+0000 7f1ac359e700 1 --2- 172.21.15.156:0/2150124929 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1ac4131cf0 0x7f1ac41c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.231+0000 7f1ac2d9d700 1 -- 172.21.15.156:0/2150124929 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1ac4131cf0 msgr2=0x7f1ac41c3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.231+0000 7f1ac2d9d700 1 --2- 172.21.15.156:0/2150124929 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1ac4131cf0 0x7f1ac41c3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.231+0000 7f1ac2d9d700 1 -- 172.21.15.156:0/2150124929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ac406b080 msgr2=0x7f1ac411c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.231+0000 7f1ac2d9d700 1 --2- 172.21.15.156:0/2150124929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ac406b080 0x7f1ac411c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.231+0000 7f1ac2d9d700 1 -- 172.21.15.156:0/2150124929 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab8009550 con 0x7f1ac406a770 2023-09-30T22:23:02.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.231+0000 7f1ac2d9d700 1 --2- 172.21.15.156:0/2150124929 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ac406a770 0x7f1ac411c490 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4009fd0 tx=0x7f1ab4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:02.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.231+0000 7f1aab7fe700 1 -- 172.21.15.156:0/2150124929 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab4003ab0 con 0x7f1ac406a770 2023-09-30T22:23:02.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.231+0000 7f1aab7fe700 1 -- 172.21.15.156:0/2150124929 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab4003c10 con 0x7f1ac406a770 2023-09-30T22:23:02.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.231+0000 7f1ac903c700 1 -- 172.21.15.156:0/2150124929 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab40094a0 con 0x7f1ac406a770 2023-09-30T22:23:02.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.231+0000 7f1aab7fe700 1 -- 172.21.15.156:0/2150124929 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab4018640 con 0x7f1ac406a770 2023-09-30T22:23:02.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.231+0000 7f1ac903c700 1 -- 172.21.15.156:0/2150124929 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac411e870 con 0x7f1ac406a770 2023-09-30T22:23:02.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.232+0000 7f1aab7fe700 1 -- 172.21.15.156:0/2150124929 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1ab40187a0 con 0x7f1ac406a770 2023-09-30T22:23:02.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.232+0000 7f1ac903c700 1 -- 172.21.15.156:0/2150124929 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ac409d2f0 con 0x7f1ac406a770 2023-09-30T22:23:02.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.233+0000 7f1aab7fe700 1 -- 172.21.15.156:0/2150124929 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1ab4040e70 con 0x7f1ac406a770 2023-09-30T22:23:02.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.242+0000 7f1aab7fe700 1 -- 172.21.15.156:0/2150124929 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1ab401d070 con 0x7f1ac406a770 2023-09-30T22:23:02.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.280+0000 7f4968986700 1 Processor -- start 2023-09-30T22:23:02.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.280+0000 7f4968986700 1 -- start start 2023-09-30T22:23:02.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.281+0000 7f4968986700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49640a1510 0x7f49641351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.281+0000 7f4968986700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49641356e0 0x7f4964137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.281+0000 7f4968986700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49640a1e70 con 0x7f49640a0a30 2023-09-30T22:23:02.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.281+0000 7f4968986700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496409a720 con 0x7f49640a1510 2023-09-30T22:23:02.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.281+0000 7f4968986700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f496409b300 con 0x7f49641356e0 2023-09-30T22:23:02.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.281+0000 7f4962d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49641356e0 0x7f4964137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.281+0000 7f496259c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f49640a0a30 0x7f49640a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49258/0 (socket says 172.21.15.156:49258) 2023-09-30T22:23:02.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.281+0000 7f496259c700 1 -- 172.21.15.156:0/375774775 learned_addr learned my addr 172.21.15.156:0/375774775 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:02.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.281+0000 7f4961d9b700 1 --2- 172.21.15.156:0/375774775 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49640a1510 0x7f49641351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.281+0000 7f4962d9d700 1 -- 172.21.15.156:0/375774775 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49640a1510 msgr2=0x7f49641351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:02.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.281+0000 7f4962d9d700 1 --2- 172.21.15.156:0/375774775 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49640a1510 0x7f49641351a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.281+0000 7f4962d9d700 1 -- 172.21.15.156:0/375774775 >> v1:172.21.15.156:6789/0 conn(0x7f49640a0a30 legacy=0x7f49640a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.281+0000 7f496159a700 1 -- 172.21.15.156:0/375774775 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2447703352 0 0) 0x7f49640a1e70 con 0x7f49640a0a30 2023-09-30T22:23:02.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.281+0000 7f4962d9d700 1 -- 172.21.15.156:0/375774775 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496409abc0 con 0x7f49641356e0 2023-09-30T22:23:02.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.282+0000 7f4962d9d700 1 --2- 172.21.15.156:0/375774775 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49641356e0 0x7f4964137ac0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f495c007cb0 tx=0x7f495c007ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ef911e4482977c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:02.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.282+0000 7f496159a700 1 -- 172.21.15.156:0/375774775 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c007e70 con 0x7f49641356e0 2023-09-30T22:23:02.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.282+0000 7f496159a700 1 -- 172.21.15.156:0/375774775 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495c00a2e0 con 0x7f49641356e0 2023-09-30T22:23:02.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.282+0000 7f496159a700 1 -- 172.21.15.156:0/375774775 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c00bc60 con 0x7f49641356e0 2023-09-30T22:23:02.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.282+0000 7f4968986700 1 -- 172.21.15.156:0/375774775 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49641356e0 msgr2=0x7f4964137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.282+0000 7f4968986700 1 --2- 172.21.15.156:0/375774775 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49641356e0 0x7f4964137ac0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f495c007cb0 tx=0x7f495c007ce0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.283+0000 7f4968986700 1 -- 172.21.15.156:0/375774775 shutdown_connections 2023-09-30T22:23:02.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.283+0000 7f4968986700 1 --2- 172.21.15.156:0/375774775 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49641356e0 0x7f4964137ac0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.283+0000 7f4968986700 1 --2- 172.21.15.156:0/375774775 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49640a1510 0x7f49641351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.283+0000 7f4968986700 1 -- 172.21.15.156:0/375774775 >> 172.21.15.156:0/375774775 conn(0x7f49640a2980 msgr2=0x7f49640a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:02.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.283+0000 7f4968986700 1 -- 172.21.15.156:0/375774775 shutdown_connections 2023-09-30T22:23:02.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.283+0000 7f4968986700 1 -- 172.21.15.156:0/375774775 wait complete. 2023-09-30T22:23:02.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.284+0000 7f4968986700 1 Processor -- start 2023-09-30T22:23:02.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.284+0000 7f4968986700 1 -- start start 2023-09-30T22:23:02.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.284+0000 7f4968986700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49640a0a30 0x7f4964134540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.284+0000 7f4968986700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49640a1510 0x7f4964134a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.284+0000 7f4968986700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49641356e0 0x7f49641c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.284+0000 7f4968986700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496409fb70 con 0x7f49641356e0 2023-09-30T22:23:02.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.284+0000 7f4968986700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496409ae00 con 0x7f49640a0a30 2023-09-30T22:23:02.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.284+0000 7f4968986700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49641197f0 con 0x7f49640a1510 2023-09-30T22:23:02.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.284+0000 7f496259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49640a0a30 0x7f4964134540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.285+0000 7f496259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49640a0a30 0x7f4964134540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51632/0 (socket says 172.21.15.156:51632) 2023-09-30T22:23:02.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.285+0000 7f496259c700 1 -- 172.21.15.156:0/3951274115 learned_addr learned my addr 172.21.15.156:0/3951274115 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:02.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.285+0000 7f4961d9b700 1 --2- 172.21.15.156:0/3951274115 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49640a1510 0x7f4964134a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.285+0000 7f4962d9d700 1 --2- 172.21.15.156:0/3951274115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49641356e0 0x7f49641c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.285+0000 7f496259c700 1 -- 172.21.15.156:0/3951274115 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49640a1510 msgr2=0x7f4964134a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.285+0000 7f496259c700 1 --2- 172.21.15.156:0/3951274115 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49640a1510 0x7f4964134a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.285+0000 7f496259c700 1 -- 172.21.15.156:0/3951274115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49641356e0 msgr2=0x7f49641c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.285+0000 7f496259c700 1 --2- 172.21.15.156:0/3951274115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49641356e0 0x7f49641c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.285+0000 7f496259c700 1 -- 172.21.15.156:0/3951274115 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f495c0078e0 con 0x7f49640a0a30 2023-09-30T22:23:02.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.285+0000 7f4962d9d700 1 --2- 172.21.15.156:0/3951274115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49641356e0 0x7f49641c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:23:02.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.285+0000 7f496259c700 1 --2- 172.21.15.156:0/3951274115 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49640a0a30 0x7f4964134540 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f495400c6d0 tx=0x7f495400c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:02.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.285+0000 7f4952ffd700 1 -- 172.21.15.156:0/3951274115 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49540074e0 con 0x7f49640a0a30 2023-09-30T22:23:02.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.285+0000 7f4952ffd700 1 -- 172.21.15.156:0/3951274115 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4954007660 con 0x7f49640a0a30 2023-09-30T22:23:02.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.285+0000 7f4968986700 1 -- 172.21.15.156:0/3951274115 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4964119030 con 0x7f49640a0a30 2023-09-30T22:23:02.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.285+0000 7f4952ffd700 1 -- 172.21.15.156:0/3951274115 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4954005a70 con 0x7f49640a0a30 2023-09-30T22:23:02.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.285+0000 7f4968986700 1 -- 172.21.15.156:0/3951274115 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496411aea0 con 0x7f49640a0a30 2023-09-30T22:23:02.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.286+0000 7f4952ffd700 1 -- 172.21.15.156:0/3951274115 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4954005bd0 con 0x7f49640a0a30 2023-09-30T22:23:02.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.286+0000 7f4952ffd700 1 -- 172.21.15.156:0/3951274115 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f495403eb40 con 0x7f49640a0a30 2023-09-30T22:23:02.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.287+0000 7f4968986700 1 -- 172.21.15.156:0/3951274115 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49480052e0 con 0x7f49640a0a30 2023-09-30T22:23:02.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.291+0000 7f4952ffd700 1 -- 172.21.15.156:0/3951274115 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4954018260 con 0x7f49640a0a30 2023-09-30T22:23:02.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.409+0000 7fa9bcb0b700 1 -- 172.21.15.156:0/3905077613 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa9b804f2a0 con 0x7fa9b8131f40 2023-09-30T22:23:02.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.409+0000 7fa9a6ffd700 1 -- 172.21.15.156:0/3905077613 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa9b0029b80 con 0x7fa9b8131f40 2023-09-30T22:23:02.410 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:02.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.411+0000 7fa9bcb0b700 1 -- 172.21.15.156:0/3905077613 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa9b8131f40 msgr2=0x7fa9b8120be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.411+0000 7fa9bcb0b700 1 --2- 172.21.15.156:0/3905077613 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa9b8131f40 0x7fa9b8120be0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa9b000b370 tx=0x7fa9b0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.411+0000 7fa9bcb0b700 1 -- 172.21.15.156:0/3905077613 shutdown_connections 2023-09-30T22:23:02.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.411+0000 7fa9bcb0b700 1 --2- 172.21.15.156:0/3905077613 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa9b8131f40 0x7fa9b8120be0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.411+0000 7fa9bcb0b700 1 --2- 172.21.15.156:0/3905077613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9b809e870 0x7fa9b8120160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.411+0000 7fa9bcb0b700 1 --2- 172.21.15.156:0/3905077613 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa9b809f180 0x7fa9b81206a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.411+0000 7fa9bcb0b700 1 -- 172.21.15.156:0/3905077613 >> 172.21.15.156:0/3905077613 conn(0x7fa9b80a4430 msgr2=0x7fa9b80721a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:02.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.411+0000 7fa9bcb0b700 1 -- 172.21.15.156:0/3905077613 shutdown_connections 2023-09-30T22:23:02.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.411+0000 7fa9bcb0b700 1 -- 172.21.15.156:0/3905077613 wait complete. 2023-09-30T22:23:02.424 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:02.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.438+0000 7f72bbfa2700 1 -- 172.21.15.156:0/1736059194 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f72b404f2a0 con 0x7f72b4130890 2023-09-30T22:23:02.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.438+0000 7f72aa7fc700 1 -- 172.21.15.156:0/1736059194 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f72ac02b090 con 0x7f72b4130890 2023-09-30T22:23:02.439 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:02.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.439+0000 7f1ac903c700 1 -- 172.21.15.156:0/2150124929 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1ac411d830 con 0x7f1ac406a770 2023-09-30T22:23:02.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.439+0000 7f1aab7fe700 1 -- 172.21.15.156:0/2150124929 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1ab4018a50 con 0x7f1ac406a770 2023-09-30T22:23:02.440 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:02.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.440+0000 7f72bbfa2700 1 -- 172.21.15.156:0/1736059194 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72b4130890 msgr2=0x7f72b411b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.440+0000 7f72bbfa2700 1 --2- 172.21.15.156:0/1736059194 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72b4130890 0x7f72b411b410 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00efc0 tx=0x7f72ac00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.440+0000 7f72bbfa2700 1 -- 172.21.15.156:0/1736059194 shutdown_connections 2023-09-30T22:23:02.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.440+0000 7f72bbfa2700 1 --2- 172.21.15.156:0/1736059194 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72b4130890 0x7f72b411b410 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.440+0000 7f72bbfa2700 1 --2- 172.21.15.156:0/1736059194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72b4099e20 0x7f72b411a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.440+0000 7f72bbfa2700 1 --2- 172.21.15.156:0/1736059194 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72b409a730 0x7f72b411aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.440+0000 7f72bbfa2700 1 -- 172.21.15.156:0/1736059194 >> 172.21.15.156:0/1736059194 conn(0x7f72b40a2980 msgr2=0x7f72b406df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:02.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.441+0000 7f72bbfa2700 1 -- 172.21.15.156:0/1736059194 shutdown_connections 2023-09-30T22:23:02.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.441+0000 7f72bbfa2700 1 -- 172.21.15.156:0/1736059194 wait complete. 2023-09-30T22:23:02.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.441+0000 7f1ac903c700 1 -- 172.21.15.156:0/2150124929 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ac406a770 msgr2=0x7f1ac411c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.441+0000 7f1ac903c700 1 --2- 172.21.15.156:0/2150124929 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ac406a770 0x7f1ac411c490 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4009fd0 tx=0x7f1ab4004750 comp rx=0 tx=0).stop 2023-09-30T22:23:02.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.441+0000 7f1ac903c700 1 -- 172.21.15.156:0/2150124929 shutdown_connections 2023-09-30T22:23:02.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.441+0000 7f1ac903c700 1 --2- 172.21.15.156:0/2150124929 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1ac4131cf0 0x7f1ac41c3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.441+0000 7f1ac903c700 1 --2- 172.21.15.156:0/2150124929 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1ac406a770 0x7f1ac411c490 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.441+0000 7f1ac903c700 1 --2- 172.21.15.156:0/2150124929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ac406b080 0x7f1ac411c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.441+0000 7f1ac903c700 1 -- 172.21.15.156:0/2150124929 >> 172.21.15.156:0/2150124929 conn(0x7f1ac4099c40 msgr2=0x7f1ac4130d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:02.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.441+0000 7f1ac903c700 1 -- 172.21.15.156:0/2150124929 shutdown_connections 2023-09-30T22:23:02.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.441+0000 7f1ac903c700 1 -- 172.21.15.156:0/2150124929 wait complete. 2023-09-30T22:23:02.460 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:02.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:02.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.515+0000 7f4968986700 1 -- 172.21.15.156:0/3951274115 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4948005590 con 0x7f49640a0a30 2023-09-30T22:23:02.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.515+0000 7f4952ffd700 1 -- 172.21.15.156:0/3951274115 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4954017030 con 0x7f49640a0a30 2023-09-30T22:23:02.516 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:02.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.517+0000 7f4968986700 1 -- 172.21.15.156:0/3951274115 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49640a0a30 msgr2=0x7f4964134540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.517+0000 7f4968986700 1 --2- 172.21.15.156:0/3951274115 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49640a0a30 0x7f4964134540 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f495400c6d0 tx=0x7f495400c9e0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.517+0000 7f4968986700 1 -- 172.21.15.156:0/3951274115 shutdown_connections 2023-09-30T22:23:02.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.517+0000 7f4968986700 1 --2- 172.21.15.156:0/3951274115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49641356e0 0x7f49641c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.517+0000 7f4968986700 1 --2- 172.21.15.156:0/3951274115 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49640a0a30 0x7f4964134540 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.517+0000 7f4968986700 1 --2- 172.21.15.156:0/3951274115 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49640a1510 0x7f4964134a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.517+0000 7f4968986700 1 -- 172.21.15.156:0/3951274115 >> 172.21.15.156:0/3951274115 conn(0x7f49640a2980 msgr2=0x7f4964131070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:02.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.517+0000 7f4968986700 1 -- 172.21.15.156:0/3951274115 shutdown_connections 2023-09-30T22:23:02.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:02.517+0000 7f4968986700 1 -- 172.21.15.156:0/3951274115 wait complete. 2023-09-30T22:23:02.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:03.425 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:03.461 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:03.462 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:03.531 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:03.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.565+0000 7fb8f4606700 1 Processor -- start 2023-09-30T22:23:03.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.566+0000 7fb8f4606700 1 -- start start 2023-09-30T22:23:03.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.566+0000 7fb8f4606700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8ec09e340 0x7fb8ec1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.566+0000 7fb8f4606700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8ec135f20 0x7fb8ec138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.566+0000 7fb8f4606700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8ec09aaa0 con 0x7fb8ec09d860 2023-09-30T22:23:03.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.566+0000 7fb8f4606700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec09e730 con 0x7fb8ec09e340 2023-09-30T22:23:03.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.566+0000 7fb8f4606700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec09f870 con 0x7fb8ec135f20 2023-09-30T22:23:03.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.567+0000 7fb8f2ba3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8ec135f20 0x7fb8ec138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.567+0000 7fb8f1ba1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8ec09e340 0x7fb8ec1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.567+0000 7fb8f23a2700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb8ec09d860 0x7fb8ec09dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49270/0 (socket says 172.21.15.156:49270) 2023-09-30T22:23:03.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.567+0000 7fb8f23a2700 1 -- 172.21.15.156:0/2998806959 learned_addr learned my addr 172.21.15.156:0/2998806959 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:03.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.567+0000 7fb8f1ba1700 1 -- 172.21.15.156:0/2998806959 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8ec135f20 msgr2=0x7fb8ec138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:03.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.567+0000 7fb8f1ba1700 1 --2- 172.21.15.156:0/2998806959 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8ec135f20 0x7fb8ec138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.567+0000 7fb8f1ba1700 1 -- 172.21.15.156:0/2998806959 >> v1:172.21.15.156:6789/0 conn(0x7fb8ec09d860 legacy=0x7fb8ec09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.567+0000 7fb8f13a0700 1 -- 172.21.15.156:0/2998806959 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717879477 0 0) 0x7fb8ec09aaa0 con 0x7fb8ec09d860 2023-09-30T22:23:03.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.567+0000 7fb8f1ba1700 1 -- 172.21.15.156:0/2998806959 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ec09b360 con 0x7fb8ec09e340 2023-09-30T22:23:03.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.567+0000 7fb8f2ba3700 1 --2- 172.21.15.156:0/2998806959 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8ec135f20 0x7fb8ec138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:03.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.567+0000 7fb8f1ba1700 1 --2- 172.21.15.156:0/2998806959 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8ec09e340 0x7fb8ec1359e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc009870 tx=0x7fb8dc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8cf4cbb8032eb75 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:03.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.568+0000 7fb8f13a0700 1 -- 172.21.15.156:0/2998806959 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc011830 con 0x7fb8ec09e340 2023-09-30T22:23:03.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.568+0000 7fb8f13a0700 1 -- 172.21.15.156:0/2998806959 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8dc011990 con 0x7fb8ec09e340 2023-09-30T22:23:03.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.568+0000 7fb8f13a0700 1 -- 172.21.15.156:0/2998806959 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc011d20 con 0x7fb8ec09e340 2023-09-30T22:23:03.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.569+0000 7fb8f4606700 1 -- 172.21.15.156:0/2998806959 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8ec09e340 msgr2=0x7fb8ec1359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.569+0000 7fb8f4606700 1 --2- 172.21.15.156:0/2998806959 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8ec09e340 0x7fb8ec1359e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc009870 tx=0x7fb8dc009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:03.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.569+0000 7fb8f4606700 1 -- 172.21.15.156:0/2998806959 shutdown_connections 2023-09-30T22:23:03.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.569+0000 7fb8f4606700 1 --2- 172.21.15.156:0/2998806959 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8ec135f20 0x7fb8ec138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.569+0000 7fb8f4606700 1 --2- 172.21.15.156:0/2998806959 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8ec09e340 0x7fb8ec1359e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.569+0000 7fb8f4606700 1 -- 172.21.15.156:0/2998806959 >> 172.21.15.156:0/2998806959 conn(0x7fb8ec099c40 msgr2=0x7fb8ec0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:03.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.569+0000 7fb8f4606700 1 -- 172.21.15.156:0/2998806959 shutdown_connections 2023-09-30T22:23:03.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.569+0000 7fb8f4606700 1 -- 172.21.15.156:0/2998806959 wait complete. 2023-09-30T22:23:03.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.570+0000 7fb8f4606700 1 Processor -- start 2023-09-30T22:23:03.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.570+0000 7fb8f4606700 1 -- start start 2023-09-30T22:23:03.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.571+0000 7fb8f4606700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8ec09d860 0x7fb8ec1c8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.571+0000 7fb8f4606700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8ec09e340 0x7fb8ec1c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.571+0000 7fb8f4606700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8ec135f20 0x7fb8ec1c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.571+0000 7fb8f4606700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec06b280 con 0x7fb8ec135f20 2023-09-30T22:23:03.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.571+0000 7fb8f4606700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec121fd0 con 0x7fb8ec09e340 2023-09-30T22:23:03.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.571+0000 7fb8f4606700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec121bf0 con 0x7fb8ec09d860 2023-09-30T22:23:03.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.571+0000 7fb8f1ba1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8ec09e340 0x7fb8ec1c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.571+0000 7fb8f23a2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8ec09d860 0x7fb8ec1c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.571+0000 7fb8f1ba1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8ec09e340 0x7fb8ec1c8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51658/0 (socket says 172.21.15.156:51658) 2023-09-30T22:23:03.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.571+0000 7fb8f1ba1700 1 -- 172.21.15.156:0/1980561613 learned_addr learned my addr 172.21.15.156:0/1980561613 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:03.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.571+0000 7fb8f2ba3700 1 --2- 172.21.15.156:0/1980561613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8ec135f20 0x7fb8ec1c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.571+0000 7fb8f1ba1700 1 -- 172.21.15.156:0/1980561613 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8ec09d860 msgr2=0x7fb8ec1c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.571+0000 7fb8f1ba1700 1 --2- 172.21.15.156:0/1980561613 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8ec09d860 0x7fb8ec1c8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.571+0000 7fb8f1ba1700 1 -- 172.21.15.156:0/1980561613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8ec135f20 msgr2=0x7fb8ec1c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.571+0000 7fb8f1ba1700 1 --2- 172.21.15.156:0/1980561613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8ec135f20 0x7fb8ec1c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.571+0000 7fb8f1ba1700 1 -- 172.21.15.156:0/1980561613 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e4009a70 con 0x7fb8ec09e340 2023-09-30T22:23:03.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.572+0000 7fb8f1ba1700 1 --2- 172.21.15.156:0/1980561613 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8ec09e340 0x7fb8ec1c8780 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc0090b0 tx=0x7fb8dc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:03.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.572+0000 7fb8e2ffd700 1 -- 172.21.15.156:0/1980561613 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc01a830 con 0x7fb8ec09e340 2023-09-30T22:23:03.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.572+0000 7fb8e2ffd700 1 -- 172.21.15.156:0/1980561613 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8dc01a990 con 0x7fb8ec09e340 2023-09-30T22:23:03.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.572+0000 7fb8f4606700 1 -- 172.21.15.156:0/1980561613 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8dc0094a0 con 0x7fb8ec09e340 2023-09-30T22:23:03.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.572+0000 7fb8f4606700 1 -- 172.21.15.156:0/1980561613 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ec09c8b0 con 0x7fb8ec09e340 2023-09-30T22:23:03.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.572+0000 7fb8e2ffd700 1 -- 172.21.15.156:0/1980561613 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc01ad00 con 0x7fb8ec09e340 2023-09-30T22:23:03.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.573+0000 7fb8f4606700 1 -- 172.21.15.156:0/1980561613 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8ec122c20 con 0x7fb8ec09e340 2023-09-30T22:23:03.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.574+0000 7fb8e2ffd700 1 -- 172.21.15.156:0/1980561613 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb8dc0243f0 con 0x7fb8ec09e340 2023-09-30T22:23:03.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.574+0000 7fb8e2ffd700 1 -- 172.21.15.156:0/1980561613 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb8dc041000 con 0x7fb8ec09e340 2023-09-30T22:23:03.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.578+0000 7fb8e2ffd700 1 -- 172.21.15.156:0/1980561613 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb8dc01ae60 con 0x7fb8ec09e340 2023-09-30T22:23:03.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.603+0000 7f6ae5915700 1 Processor -- start 2023-09-30T22:23:03.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.603+0000 7f6ae5915700 1 -- start start 2023-09-30T22:23:03.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.603+0000 7f6ae5915700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ae009e340 0x7f6ae01359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.603+0000 7f6ae5915700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6ae0135f20 0x7f6ae0138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.603+0000 7f6ae5915700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae009aaa0 con 0x7f6ae009d860 2023-09-30T22:23:03.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.603+0000 7f6ae5915700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae009e730 con 0x7f6ae0135f20 2023-09-30T22:23:03.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.603+0000 7f6ae5915700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae009f870 con 0x7f6ae009e340 2023-09-30T22:23:03.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.604+0000 7f6ade7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ae009e340 0x7f6ae01359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.604+0000 7f6ade7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ae009e340 0x7f6ae01359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51662/0 (socket says 172.21.15.156:51662) 2023-09-30T22:23:03.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.604+0000 7f6adeffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6ae009d860 0x7f6ae009dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49276/0 (socket says 172.21.15.156:49276) 2023-09-30T22:23:03.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.604+0000 7f6ade7fc700 1 -- 172.21.15.156:0/1001665770 learned_addr learned my addr 172.21.15.156:0/1001665770 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:03.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.604+0000 7f6adf7fe700 1 --2- 172.21.15.156:0/1001665770 >> v2:172.21.15.156:3300/0 conn(0x7f6ae0135f20 0x7f6ae0138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.604+0000 7f6ade7fc700 1 -- 172.21.15.156:0/1001665770 >> v2:172.21.15.156:3300/0 conn(0x7f6ae0135f20 msgr2=0x7f6ae0138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:03.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.604+0000 7f6ade7fc700 1 --2- 172.21.15.156:0/1001665770 >> v2:172.21.15.156:3300/0 conn(0x7f6ae0135f20 0x7f6ae0138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.604+0000 7f6ade7fc700 1 -- 172.21.15.156:0/1001665770 >> v1:172.21.15.156:6789/0 conn(0x7f6ae009d860 legacy=0x7f6ae009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.604+0000 7f6ade7fc700 1 -- 172.21.15.156:0/1001665770 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae009b360 con 0x7f6ae009e340 2023-09-30T22:23:03.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.604+0000 7f6ade7fc700 1 --2- 172.21.15.156:0/1001665770 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ae009e340 0x7f6ae01359e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40098f0 tx=0x7f6ad4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85377da1e756495f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:03.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.604+0000 7f6addffb700 1 -- 172.21.15.156:0/1001665770 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4011830 con 0x7f6ae009e340 2023-09-30T22:23:03.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.604+0000 7f6addffb700 1 -- 172.21.15.156:0/1001665770 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad4011990 con 0x7f6ae009e340 2023-09-30T22:23:03.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.604+0000 7f6addffb700 1 -- 172.21.15.156:0/1001665770 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4011d20 con 0x7f6ae009e340 2023-09-30T22:23:03.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.605+0000 7f6ae5915700 1 -- 172.21.15.156:0/1001665770 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ae009e340 msgr2=0x7f6ae01359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.605+0000 7f6ae5915700 1 --2- 172.21.15.156:0/1001665770 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ae009e340 0x7f6ae01359e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40098f0 tx=0x7f6ad4009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:03.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.605+0000 7f6ae5915700 1 -- 172.21.15.156:0/1001665770 shutdown_connections 2023-09-30T22:23:03.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.605+0000 7f6ae5915700 1 --2- 172.21.15.156:0/1001665770 >> v2:172.21.15.156:3300/0 conn(0x7f6ae0135f20 0x7f6ae0138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.605+0000 7f6ae5915700 1 --2- 172.21.15.156:0/1001665770 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ae009e340 0x7f6ae01359e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.605+0000 7f6ae5915700 1 -- 172.21.15.156:0/1001665770 >> 172.21.15.156:0/1001665770 conn(0x7f6ae0099c40 msgr2=0x7f6ae00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:03.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.605+0000 7f6ae5915700 1 -- 172.21.15.156:0/1001665770 shutdown_connections 2023-09-30T22:23:03.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.605+0000 7f6ae5915700 1 -- 172.21.15.156:0/1001665770 wait complete. 2023-09-30T22:23:03.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.607+0000 7f6ae5915700 1 Processor -- start 2023-09-30T22:23:03.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.607+0000 7f6ae5915700 1 -- start start 2023-09-30T22:23:03.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.607+0000 7f6ae5915700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ae009d860 0x7f6ae01c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.607+0000 7f6ae5915700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ae009e340 0x7f6ae01c6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.607+0000 7f6ae5915700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ae0135f20 0x7f6ae01c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.607+0000 7f6ae5915700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae0121e30 con 0x7f6ae009e340 2023-09-30T22:23:03.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.607+0000 7f6ae5915700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae011f840 con 0x7f6ae0135f20 2023-09-30T22:23:03.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.607+0000 7f6ae5915700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae0122060 con 0x7f6ae009d860 2023-09-30T22:23:03.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.608+0000 7f6adeffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ae009d860 0x7f6ae01c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.608+0000 7f6ade7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ae009e340 0x7f6ae01c6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.608+0000 7f6ade7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ae009e340 0x7f6ae01c6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:45702/0 (socket says 172.21.15.156:45702) 2023-09-30T22:23:03.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.608+0000 7f6adeffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ae009d860 0x7f6ae01c6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56670/0 (socket says 172.21.15.156:56670) 2023-09-30T22:23:03.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.608+0000 7f6ade7fc700 1 -- 172.21.15.156:0/2923531419 learned_addr learned my addr 172.21.15.156:0/2923531419 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:03.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.608+0000 7f6adf7fe700 1 --2- 172.21.15.156:0/2923531419 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ae0135f20 0x7f6ae01c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.608+0000 7f6adeffd700 1 -- 172.21.15.156:0/2923531419 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ae0135f20 msgr2=0x7f6ae01c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.608+0000 7f6adeffd700 1 --2- 172.21.15.156:0/2923531419 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ae0135f20 0x7f6ae01c6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.608+0000 7f6adeffd700 1 -- 172.21.15.156:0/2923531419 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ae009e340 msgr2=0x7f6ae01c6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.608+0000 7f6adeffd700 1 --2- 172.21.15.156:0/2923531419 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ae009e340 0x7f6ae01c6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.608+0000 7f6adeffd700 1 -- 172.21.15.156:0/2923531419 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad4009550 con 0x7f6ae009d860 2023-09-30T22:23:03.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.608+0000 7f6adf7fe700 1 --2- 172.21.15.156:0/2923531419 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ae0135f20 0x7f6ae01c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:03.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.608+0000 7f6adeffd700 1 --2- 172.21.15.156:0/2923531419 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ae009d860 0x7f6ae01c6120 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6ad000c480 tx=0x7f6ad000c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:03.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.608+0000 7f6ac7fff700 1 -- 172.21.15.156:0/2923531419 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0005cb0 con 0x7f6ae009d860 2023-09-30T22:23:03.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.608+0000 7f6ac7fff700 1 -- 172.21.15.156:0/2923531419 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad0005e10 con 0x7f6ae009d860 2023-09-30T22:23:03.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.608+0000 7f6ae5915700 1 -- 172.21.15.156:0/2923531419 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae006b400 con 0x7f6ae009d860 2023-09-30T22:23:03.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.608+0000 7f6ac7fff700 1 -- 172.21.15.156:0/2923531419 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad00072d0 con 0x7f6ae009d860 2023-09-30T22:23:03.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.609+0000 7f6ae5915700 1 -- 172.21.15.156:0/2923531419 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae0120a30 con 0x7f6ae009d860 2023-09-30T22:23:03.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.609+0000 7f6ac7fff700 1 -- 172.21.15.156:0/2923531419 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6ad0007430 con 0x7f6ae009d860 2023-09-30T22:23:03.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.609+0000 7f6ac7fff700 1 -- 172.21.15.156:0/2923531419 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6ad003e9b0 con 0x7f6ae009d860 2023-09-30T22:23:03.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.610+0000 7f6ae5915700 1 -- 172.21.15.156:0/2923531419 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae004f2a0 con 0x7f6ae009d860 2023-09-30T22:23:03.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.611+0000 7faaf6de8700 1 Processor -- start 2023-09-30T22:23:03.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.611+0000 7faaf6de8700 1 -- start start 2023-09-30T22:23:03.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.612+0000 7faaf6de8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faaf0099e20 0x7faaf009a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.612+0000 7faaf6de8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7faaf009a730 0x7faaf0130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.612+0000 7faaf6de8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faaf0130890 0x7faaf0130d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.612+0000 7faaf6de8700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaf009bf50 con 0x7faaf009a730 2023-09-30T22:23:03.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.612+0000 7faaf6de8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf0099a60 con 0x7faaf0099e20 2023-09-30T22:23:03.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.612+0000 7faaf6de8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faaf009b230 con 0x7faaf0130890 2023-09-30T22:23:03.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.612+0000 7faaf5385700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faaf0130890 0x7faaf0130d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.612+0000 7faaeffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7faaf009a730 0x7faaf0130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.612+0000 7faaf5385700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faaf0130890 0x7faaf0130d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56678/0 (socket says 172.21.15.156:56678) 2023-09-30T22:23:03.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.612+0000 7faaf5385700 1 -- 172.21.15.156:0/2534999431 learned_addr learned my addr 172.21.15.156:0/2534999431 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:03.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.612+0000 7faaf4b84700 1 --2- 172.21.15.156:0/2534999431 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faaf0099e20 0x7faaf009a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.612+0000 7faaf5385700 1 -- 172.21.15.156:0/2534999431 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faaf0099e20 msgr2=0x7faaf009a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:03.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.612+0000 7faaf5385700 1 --2- 172.21.15.156:0/2534999431 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faaf0099e20 0x7faaf009a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.612+0000 7faaf5385700 1 -- 172.21.15.156:0/2534999431 >> v2:172.21.15.156:3300/0 conn(0x7faaf009a730 msgr2=0x7faaf0130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:03.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.612+0000 7faaf5385700 1 --2- 172.21.15.156:0/2534999431 >> v2:172.21.15.156:3300/0 conn(0x7faaf009a730 0x7faaf0130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.612+0000 7faaf5385700 1 -- 172.21.15.156:0/2534999431 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf009bb90 con 0x7faaf0130890 2023-09-30T22:23:03.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.613+0000 7faaf5385700 1 --2- 172.21.15.156:0/2534999431 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faaf0130890 0x7faaf0130d00 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7faae8009e80 tx=0x7faae800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1d2e89713ffe85d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:03.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.615+0000 7faaef7fe700 1 -- 172.21.15.156:0/2534999431 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae800e070 con 0x7faaf0130890 2023-09-30T22:23:03.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.615+0000 7faaef7fe700 1 -- 172.21.15.156:0/2534999431 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae800b8d0 con 0x7faaf0130890 2023-09-30T22:23:03.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.615+0000 7faaef7fe700 1 -- 172.21.15.156:0/2534999431 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae800bc80 con 0x7faaf0130890 2023-09-30T22:23:03.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.615+0000 7f6ac7fff700 1 -- 172.21.15.156:0/2923531419 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ad0017080 con 0x7f6ae009d860 2023-09-30T22:23:03.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.615+0000 7faaf6de8700 1 -- 172.21.15.156:0/2534999431 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faaf0130890 msgr2=0x7faaf0130d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.616+0000 7faaf6de8700 1 --2- 172.21.15.156:0/2534999431 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faaf0130890 0x7faaf0130d00 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7faae8009e80 tx=0x7faae800b330 comp rx=0 tx=0).stop 2023-09-30T22:23:03.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.616+0000 7faaf6de8700 1 -- 172.21.15.156:0/2534999431 shutdown_connections 2023-09-30T22:23:03.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.616+0000 7faaf6de8700 1 --2- 172.21.15.156:0/2534999431 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faaf0130890 0x7faaf0130d00 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.616+0000 7faaf6de8700 1 --2- 172.21.15.156:0/2534999431 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faaf0099e20 0x7faaf009a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.616+0000 7faaf6de8700 1 --2- 172.21.15.156:0/2534999431 >> v2:172.21.15.156:3300/0 conn(0x7faaf009a730 0x7faaf0130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.616+0000 7faaf6de8700 1 -- 172.21.15.156:0/2534999431 >> 172.21.15.156:0/2534999431 conn(0x7faaf00a2980 msgr2=0x7faaf00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:03.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.616+0000 7faaf6de8700 1 -- 172.21.15.156:0/2534999431 shutdown_connections 2023-09-30T22:23:03.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.616+0000 7faaf6de8700 1 -- 172.21.15.156:0/2534999431 wait complete. 2023-09-30T22:23:03.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.617+0000 7faaf6de8700 1 Processor -- start 2023-09-30T22:23:03.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.617+0000 7faaf6de8700 1 -- start start 2023-09-30T22:23:03.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.618+0000 7faaf6de8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faaf0099e20 0x7faaf0133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.618+0000 7faaf6de8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faaf009a730 0x7faaf0134100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.618+0000 7faaf6de8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faaf0130890 0x7faaf0134640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.618+0000 7faaf6de8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf0138380 con 0x7faaf0130890 2023-09-30T22:23:03.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.618+0000 7faaf6de8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf0137140 con 0x7faaf009a730 2023-09-30T22:23:03.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.618+0000 7faaf6de8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faaf01377c0 con 0x7faaf0099e20 2023-09-30T22:23:03.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.618+0000 7faaf4b84700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faaf0099e20 0x7faaf0133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.618+0000 7faaf4b84700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faaf0099e20 0x7faaf0133bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56686/0 (socket says 172.21.15.156:56686) 2023-09-30T22:23:03.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.618+0000 7faaf4b84700 1 -- 172.21.15.156:0/2936938405 learned_addr learned my addr 172.21.15.156:0/2936938405 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:03.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.618+0000 7faaeffff700 1 --2- 172.21.15.156:0/2936938405 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faaf009a730 0x7faaf0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.618+0000 7faaf4b84700 1 -- 172.21.15.156:0/2936938405 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faaf009a730 msgr2=0x7faaf0134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.618+0000 7faaf4b84700 1 --2- 172.21.15.156:0/2936938405 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faaf009a730 0x7faaf0134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.618+0000 7faaf4b84700 1 -- 172.21.15.156:0/2936938405 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faaf0130890 msgr2=0x7faaf0134640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.618+0000 7faaf4b84700 1 --2- 172.21.15.156:0/2936938405 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faaf0130890 0x7faaf0134640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.618+0000 7faaf4b84700 1 -- 172.21.15.156:0/2936938405 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae8009b30 con 0x7faaf0099e20 2023-09-30T22:23:03.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.618+0000 7faaf4b84700 1 --2- 172.21.15.156:0/2936938405 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faaf0099e20 0x7faaf0133bc0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7faae400e990 tx=0x7faae400eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:03.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.619+0000 7faaed7fa700 1 -- 172.21.15.156:0/2936938405 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae40096f0 con 0x7faaf0099e20 2023-09-30T22:23:03.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.619+0000 7faaf6de8700 1 -- 172.21.15.156:0/2936938405 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf012fd30 con 0x7faaf0099e20 2023-09-30T22:23:03.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.619+0000 7faaf6de8700 1 -- 172.21.15.156:0/2936938405 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf0139290 con 0x7faaf0099e20 2023-09-30T22:23:03.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.619+0000 7faaed7fa700 1 -- 172.21.15.156:0/2936938405 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae400c850 con 0x7faaf0099e20 2023-09-30T22:23:03.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.619+0000 7faaed7fa700 1 -- 172.21.15.156:0/2936938405 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae400eee0 con 0x7faaf0099e20 2023-09-30T22:23:03.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.620+0000 7faaf6de8700 1 -- 172.21.15.156:0/2936938405 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad00052e0 con 0x7faaf0099e20 2023-09-30T22:23:03.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.620+0000 7faaed7fa700 1 -- 172.21.15.156:0/2936938405 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faae400cbc0 con 0x7faaf0099e20 2023-09-30T22:23:03.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.620+0000 7faaed7fa700 1 -- 172.21.15.156:0/2936938405 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faae403fea0 con 0x7faaf0099e20 2023-09-30T22:23:03.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.624+0000 7faaed7fa700 1 -- 172.21.15.156:0/2936938405 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faae4024350 con 0x7faaf0099e20 2023-09-30T22:23:03.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.666+0000 7f5961da4700 1 Processor -- start 2023-09-30T22:23:03.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.666+0000 7f5961da4700 1 -- start start 2023-09-30T22:23:03.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.666+0000 7f5961da4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f595c0a0a70 0x7f595c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.666+0000 7f5961da4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f595c0a1380 0x7f595c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.666+0000 7f5961da4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f595c133f50 0x7f595c1343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.666+0000 7f5961da4700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f595c09e9d0 con 0x7f595c133f50 2023-09-30T22:23:03.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.666+0000 7f5961da4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f595c09dc00 con 0x7f595c0a1380 2023-09-30T22:23:03.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.666+0000 7f5961da4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f595c09dec0 con 0x7f595c0a0a70 2023-09-30T22:23:03.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.667+0000 7f595b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f595c0a0a70 0x7f595c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.667+0000 7f595b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f595c0a0a70 0x7f595c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56692/0 (socket says 172.21.15.156:56692) 2023-09-30T22:23:03.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.667+0000 7f595b7fe700 1 -- 172.21.15.156:0/741333755 learned_addr learned my addr 172.21.15.156:0/741333755 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:03.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.667+0000 7f595bfff700 1 --2- 172.21.15.156:0/741333755 >> v2:172.21.15.156:3300/0 conn(0x7f595c133f50 0x7f595c1343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.667+0000 7f595b7fe700 1 -- 172.21.15.156:0/741333755 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f595c0a1380 msgr2=0x7f595c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:03.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.667+0000 7f595b7fe700 1 --2- 172.21.15.156:0/741333755 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f595c0a1380 0x7f595c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.667+0000 7f595b7fe700 1 -- 172.21.15.156:0/741333755 >> v2:172.21.15.156:3300/0 conn(0x7f595c133f50 msgr2=0x7f595c1343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:03.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.667+0000 7f595b7fe700 1 --2- 172.21.15.156:0/741333755 >> v2:172.21.15.156:3300/0 conn(0x7f595c133f50 0x7f595c1343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.667+0000 7f595b7fe700 1 -- 172.21.15.156:0/741333755 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595c09e6a0 con 0x7f595c0a0a70 2023-09-30T22:23:03.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.667+0000 7f595bfff700 1 --2- 172.21.15.156:0/741333755 >> v2:172.21.15.156:3300/0 conn(0x7f595c133f50 0x7f595c1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:03.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.667+0000 7f595b7fe700 1 --2- 172.21.15.156:0/741333755 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f595c0a0a70 0x7f595c0a0e40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5954009e50 tx=0x7f595400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2210b52ee58bd12e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:03.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.667+0000 7f595a7fc700 1 -- 172.21.15.156:0/741333755 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595400e070 con 0x7f595c0a0a70 2023-09-30T22:23:03.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.667+0000 7f595a7fc700 1 -- 172.21.15.156:0/741333755 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595400b910 con 0x7f595c0a0a70 2023-09-30T22:23:03.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.667+0000 7f595a7fc700 1 -- 172.21.15.156:0/741333755 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595400bcc0 con 0x7f595c0a0a70 2023-09-30T22:23:03.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.668+0000 7f5961da4700 1 -- 172.21.15.156:0/741333755 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f595c0a0a70 msgr2=0x7f595c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.668+0000 7f5961da4700 1 --2- 172.21.15.156:0/741333755 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f595c0a0a70 0x7f595c0a0e40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5954009e50 tx=0x7f595400b330 comp rx=0 tx=0).stop 2023-09-30T22:23:03.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.668+0000 7f5961da4700 1 -- 172.21.15.156:0/741333755 shutdown_connections 2023-09-30T22:23:03.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.668+0000 7f5961da4700 1 --2- 172.21.15.156:0/741333755 >> v2:172.21.15.156:3300/0 conn(0x7f595c133f50 0x7f595c1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.668+0000 7f5961da4700 1 --2- 172.21.15.156:0/741333755 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f595c0a0a70 0x7f595c0a0e40 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.668+0000 7f5961da4700 1 --2- 172.21.15.156:0/741333755 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f595c0a1380 0x7f595c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.668+0000 7f5961da4700 1 -- 172.21.15.156:0/741333755 >> 172.21.15.156:0/741333755 conn(0x7f595c0a6610 msgr2=0x7f595c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:03.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.668+0000 7f5961da4700 1 -- 172.21.15.156:0/741333755 shutdown_connections 2023-09-30T22:23:03.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.668+0000 7f5961da4700 1 -- 172.21.15.156:0/741333755 wait complete. 2023-09-30T22:23:03.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.669+0000 7f5961da4700 1 Processor -- start 2023-09-30T22:23:03.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.669+0000 7f5961da4700 1 -- start start 2023-09-30T22:23:03.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.670+0000 7f5961da4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f595c0a0a70 0x7f595c1214a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.670+0000 7f5961da4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f595c0a1380 0x7f595c1219e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.670+0000 7f5961da4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f595c133f50 0x7f595c121f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.670+0000 7f5961da4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c124c10 con 0x7f595c0a0a70 2023-09-30T22:23:03.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.670+0000 7f5961da4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f595c133a10 con 0x7f595c133f50 2023-09-30T22:23:03.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.670+0000 7f5961da4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f595c0a03e0 con 0x7f595c0a1380 2023-09-30T22:23:03.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.670+0000 7f595b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f595c0a0a70 0x7f595c1214a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.670+0000 7f595b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f595c0a0a70 0x7f595c1214a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:45722/0 (socket says 172.21.15.156:45722) 2023-09-30T22:23:03.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.670+0000 7f595b7fe700 1 -- 172.21.15.156:0/2244600381 learned_addr learned my addr 172.21.15.156:0/2244600381 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:03.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.670+0000 7f595affd700 1 --2- 172.21.15.156:0/2244600381 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f595c0a1380 0x7f595c1219e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.670+0000 7f595bfff700 1 --2- 172.21.15.156:0/2244600381 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f595c133f50 0x7f595c121f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.670+0000 7f595b7fe700 1 -- 172.21.15.156:0/2244600381 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f595c0a1380 msgr2=0x7f595c1219e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.670+0000 7f595b7fe700 1 --2- 172.21.15.156:0/2244600381 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f595c0a1380 0x7f595c1219e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.670+0000 7f595b7fe700 1 -- 172.21.15.156:0/2244600381 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f595c133f50 msgr2=0x7f595c121f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.670+0000 7f595b7fe700 1 --2- 172.21.15.156:0/2244600381 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f595c133f50 0x7f595c121f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.670+0000 7f595b7fe700 1 -- 172.21.15.156:0/2244600381 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f594c0094a0 con 0x7f595c0a0a70 2023-09-30T22:23:03.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.670+0000 7f595affd700 1 --2- 172.21.15.156:0/2244600381 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f595c0a1380 0x7f595c1219e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:03.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.670+0000 7f595b7fe700 1 --2- 172.21.15.156:0/2244600381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f595c0a0a70 0x7f595c1214a0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f595400b370 tx=0x7f5954004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:03.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.671+0000 7f5953fff700 1 -- 172.21.15.156:0/2244600381 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59540099b0 con 0x7f595c0a0a70 2023-09-30T22:23:03.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.671+0000 7f5953fff700 1 -- 172.21.15.156:0/2244600381 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5954004250 con 0x7f595c0a0a70 2023-09-30T22:23:03.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.671+0000 7f5961da4700 1 -- 172.21.15.156:0/2244600381 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5954009b30 con 0x7f595c0a0a70 2023-09-30T22:23:03.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.671+0000 7f5953fff700 1 -- 172.21.15.156:0/2244600381 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59540045e0 con 0x7f595c0a0a70 2023-09-30T22:23:03.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.671+0000 7f5961da4700 1 -- 172.21.15.156:0/2244600381 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f595c124950 con 0x7f595c0a0a70 2023-09-30T22:23:03.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.671+0000 7f5953fff700 1 -- 172.21.15.156:0/2244600381 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5954004740 con 0x7f595c0a0a70 2023-09-30T22:23:03.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.672+0000 7f5953fff700 1 -- 172.21.15.156:0/2244600381 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5954040a70 con 0x7f595c0a0a70 2023-09-30T22:23:03.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.672+0000 7f5961da4700 1 -- 172.21.15.156:0/2244600381 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f595c11e040 con 0x7f595c0a0a70 2023-09-30T22:23:03.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.677+0000 7f5953fff700 1 -- 172.21.15.156:0/2244600381 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5954019740 con 0x7f595c0a0a70 2023-09-30T22:23:03.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.829+0000 7faaf6de8700 1 -- 172.21.15.156:0/2936938405 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faad0005150 con 0x7faaf0099e20 2023-09-30T22:23:03.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.829+0000 7faaed7fa700 1 -- 172.21.15.156:0/2936938405 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faae4017030 con 0x7faaf0099e20 2023-09-30T22:23:03.830 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:03.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.831+0000 7faaf6de8700 1 -- 172.21.15.156:0/2936938405 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faaf0099e20 msgr2=0x7faaf0133bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.831+0000 7faaf6de8700 1 --2- 172.21.15.156:0/2936938405 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faaf0099e20 0x7faaf0133bc0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7faae400e990 tx=0x7faae400eca0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.831+0000 7faaf6de8700 1 -- 172.21.15.156:0/2936938405 shutdown_connections 2023-09-30T22:23:03.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.831+0000 7faaf6de8700 1 --2- 172.21.15.156:0/2936938405 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faaf0130890 0x7faaf0134640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.831+0000 7faaf6de8700 1 --2- 172.21.15.156:0/2936938405 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faaf0099e20 0x7faaf0133bc0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.831+0000 7faaf6de8700 1 --2- 172.21.15.156:0/2936938405 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faaf009a730 0x7faaf0134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.831+0000 7faaf6de8700 1 -- 172.21.15.156:0/2936938405 >> 172.21.15.156:0/2936938405 conn(0x7faaf00a2980 msgr2=0x7faaf009f870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:03.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.832+0000 7faaf6de8700 1 -- 172.21.15.156:0/2936938405 shutdown_connections 2023-09-30T22:23:03.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.832+0000 7faaf6de8700 1 -- 172.21.15.156:0/2936938405 wait complete. 2023-09-30T22:23:03.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.839+0000 7fb8f4606700 1 -- 172.21.15.156:0/1980561613 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb8ec122c20 con 0x7fb8ec09e340 2023-09-30T22:23:03.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.840+0000 7fb8e2ffd700 1 -- 172.21.15.156:0/1980561613 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb8ec122c20 con 0x7fb8ec09e340 2023-09-30T22:23:03.841 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:03.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.842+0000 7fb8f4606700 1 -- 172.21.15.156:0/1980561613 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8ec09e340 msgr2=0x7fb8ec1c8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.842+0000 7fb8f4606700 1 --2- 172.21.15.156:0/1980561613 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8ec09e340 0x7fb8ec1c8780 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc0090b0 tx=0x7fb8dc004750 comp rx=0 tx=0).stop 2023-09-30T22:23:03.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.842+0000 7fb8f4606700 1 -- 172.21.15.156:0/1980561613 shutdown_connections 2023-09-30T22:23:03.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.842+0000 7fb8f4606700 1 --2- 172.21.15.156:0/1980561613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8ec135f20 0x7fb8ec1c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.842+0000 7fb8f4606700 1 --2- 172.21.15.156:0/1980561613 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb8ec09d860 0x7fb8ec1c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.842+0000 7fb8f4606700 1 --2- 172.21.15.156:0/1980561613 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb8ec09e340 0x7fb8ec1c8780 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.842+0000 7fb8f4606700 1 -- 172.21.15.156:0/1980561613 >> 172.21.15.156:0/1980561613 conn(0x7fb8ec099c40 msgr2=0x7fb8ec133a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:03.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.842+0000 7fb8f4606700 1 -- 172.21.15.156:0/1980561613 shutdown_connections 2023-09-30T22:23:03.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.842+0000 7fb8f4606700 1 -- 172.21.15.156:0/1980561613 wait complete. 2023-09-30T22:23:03.846 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:03.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:03.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.872+0000 7f6ae5915700 1 -- 172.21.15.156:0/2923531419 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6ae006c3b0 con 0x7f6ae009d860 2023-09-30T22:23:03.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.873+0000 7f6ac7fff700 1 -- 172.21.15.156:0/2923531419 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ad00076e0 con 0x7f6ae009d860 2023-09-30T22:23:03.873 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:03.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.875+0000 7f6ae5915700 1 -- 172.21.15.156:0/2923531419 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ae009d860 msgr2=0x7f6ae01c6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.875+0000 7f6ae5915700 1 --2- 172.21.15.156:0/2923531419 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ae009d860 0x7f6ae01c6120 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6ad000c480 tx=0x7f6ad000c790 comp rx=0 tx=0).stop 2023-09-30T22:23:03.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.875+0000 7f6ae5915700 1 -- 172.21.15.156:0/2923531419 shutdown_connections 2023-09-30T22:23:03.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.875+0000 7f6ae5915700 1 --2- 172.21.15.156:0/2923531419 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ae0135f20 0x7f6ae01c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.875+0000 7f6ae5915700 1 --2- 172.21.15.156:0/2923531419 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ae009d860 0x7f6ae01c6120 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.875+0000 7f6ae5915700 1 --2- 172.21.15.156:0/2923531419 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ae009e340 0x7f6ae01c6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.875+0000 7f6ae5915700 1 -- 172.21.15.156:0/2923531419 >> 172.21.15.156:0/2923531419 conn(0x7f6ae0099c40 msgr2=0x7f6ae01338b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:03.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.875+0000 7f6ae5915700 1 -- 172.21.15.156:0/2923531419 shutdown_connections 2023-09-30T22:23:03.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.875+0000 7f6ae5915700 1 -- 172.21.15.156:0/2923531419 wait complete. 2023-09-30T22:23:03.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.881+0000 7f5961da4700 1 -- 172.21.15.156:0/2244600381 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f595c124780 con 0x7f595c0a0a70 2023-09-30T22:23:03.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.881+0000 7f5953fff700 1 -- 172.21.15.156:0/2244600381 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5954019350 con 0x7f595c0a0a70 2023-09-30T22:23:03.882 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:03.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.883+0000 7f5961da4700 1 -- 172.21.15.156:0/2244600381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f595c0a0a70 msgr2=0x7f595c1214a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.883+0000 7f5961da4700 1 --2- 172.21.15.156:0/2244600381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f595c0a0a70 0x7f595c1214a0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f595400b370 tx=0x7f5954004ad0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.883+0000 7f5961da4700 1 -- 172.21.15.156:0/2244600381 shutdown_connections 2023-09-30T22:23:03.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.883+0000 7f5961da4700 1 --2- 172.21.15.156:0/2244600381 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f595c133f50 0x7f595c121f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.883+0000 7f5961da4700 1 --2- 172.21.15.156:0/2244600381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f595c0a0a70 0x7f595c1214a0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.883+0000 7f5961da4700 1 --2- 172.21.15.156:0/2244600381 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f595c0a1380 0x7f595c1219e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.883+0000 7f5961da4700 1 -- 172.21.15.156:0/2244600381 >> 172.21.15.156:0/2244600381 conn(0x7f595c0a6610 msgr2=0x7f595c0a53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:03.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.883+0000 7f5961da4700 1 -- 172.21.15.156:0/2244600381 shutdown_connections 2023-09-30T22:23:03.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:03.883+0000 7f5961da4700 1 -- 172.21.15.156:0/2244600381 wait complete. 2023-09-30T22:23:03.890 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:03.897 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:04.847 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:04.858 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:04.890 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:04.897 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:04.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.988+0000 7f96b5826700 1 Processor -- start 2023-09-30T22:23:04.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.988+0000 7f96b5826700 1 -- start start 2023-09-30T22:23:04.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.988+0000 7f96b5826700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96b00a1570 0x7f96b0138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:04.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.988+0000 7f96b5826700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96b01393c0 0x7f96b013b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:04.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.988+0000 7f96b5826700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b00a1fe0 con 0x7f96b00a0a90 2023-09-30T22:23:04.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.988+0000 7f96b5826700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b00a3aa0 con 0x7f96b01393c0 2023-09-30T22:23:04.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.988+0000 7f96b5826700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96b009a540 con 0x7f96b00a1570 2023-09-30T22:23:04.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.988+0000 7f96ae7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96b00a1570 0x7f96b0138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:04.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.988+0000 7f96ae7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96b00a1570 0x7f96b0138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56708/0 (socket says 172.21.15.156:56708) 2023-09-30T22:23:04.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.988+0000 7f96ae7fc700 1 -- 172.21.15.156:0/3708245562 learned_addr learned my addr 172.21.15.156:0/3708245562 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:04.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.989+0000 7f96af7fe700 1 --2- 172.21.15.156:0/3708245562 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96b01393c0 0x7f96b013b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:04.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.989+0000 7f96ae7fc700 1 -- 172.21.15.156:0/3708245562 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96b01393c0 msgr2=0x7f96b013b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:04.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.989+0000 7f96ae7fc700 1 --2- 172.21.15.156:0/3708245562 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96b01393c0 0x7f96b013b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.989+0000 7f96ae7fc700 1 -- 172.21.15.156:0/3708245562 >> v1:172.21.15.156:6789/0 conn(0x7f96b00a0a90 legacy=0x7f96b00a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:04.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.989+0000 7f96ae7fc700 1 -- 172.21.15.156:0/3708245562 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b009a280 con 0x7f96b00a1570 2023-09-30T22:23:04.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.989+0000 7f96ae7fc700 1 --2- 172.21.15.156:0/3708245562 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96b00a1570 0x7f96b0138e80 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f96a4009920 tx=0x7f96a4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7f6ec3ac845e812 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:04.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.989+0000 7f96adffb700 1 -- 172.21.15.156:0/3708245562 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a4004230 con 0x7f96b00a1570 2023-09-30T22:23:04.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.989+0000 7f96adffb700 1 -- 172.21.15.156:0/3708245562 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a4004390 con 0x7f96b00a1570 2023-09-30T22:23:04.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.989+0000 7f96adffb700 1 -- 172.21.15.156:0/3708245562 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a40036a0 con 0x7f96b00a1570 2023-09-30T22:23:04.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.990+0000 7f96b5826700 1 -- 172.21.15.156:0/3708245562 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96b00a1570 msgr2=0x7f96b0138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:04.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.990+0000 7f96b5826700 1 --2- 172.21.15.156:0/3708245562 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96b00a1570 0x7f96b0138e80 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f96a4009920 tx=0x7f96a4009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:04.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.990+0000 7f96b5826700 1 -- 172.21.15.156:0/3708245562 shutdown_connections 2023-09-30T22:23:04.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.990+0000 7f96b5826700 1 --2- 172.21.15.156:0/3708245562 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96b01393c0 0x7f96b013b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.990+0000 7f96b5826700 1 --2- 172.21.15.156:0/3708245562 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96b00a1570 0x7f96b0138e80 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.990+0000 7f96b5826700 1 -- 172.21.15.156:0/3708245562 >> 172.21.15.156:0/3708245562 conn(0x7f96b0099c40 msgr2=0x7f96b006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:04.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.990+0000 7f96b5826700 1 -- 172.21.15.156:0/3708245562 shutdown_connections 2023-09-30T22:23:04.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.990+0000 7f96b5826700 1 -- 172.21.15.156:0/3708245562 wait complete. 2023-09-30T22:23:04.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.991+0000 7f96b5826700 1 Processor -- start 2023-09-30T22:23:04.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.991+0000 7f96b5826700 1 -- start start 2023-09-30T22:23:04.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.992+0000 7f96b5826700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96b00a0a90 0x7f96b0121950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:04.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.992+0000 7f96b5826700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96b00a1570 0x7f96b0121e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:04.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.992+0000 7f96b5826700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96b01393c0 0x7f96b01223d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:04.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.992+0000 7f96b5826700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b0125510 con 0x7f96b00a1570 2023-09-30T22:23:04.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.992+0000 7f96b5826700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b01250c0 con 0x7f96b00a0a90 2023-09-30T22:23:04.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.992+0000 7f96b5826700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96b00a6bc0 con 0x7f96b01393c0 2023-09-30T22:23:04.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.992+0000 7f96aeffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96b00a0a90 0x7f96b0121950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:04.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.992+0000 7f96aeffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96b00a0a90 0x7f96b0121950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51706/0 (socket says 172.21.15.156:51706) 2023-09-30T22:23:04.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.992+0000 7f96aeffd700 1 -- 172.21.15.156:0/1354827636 learned_addr learned my addr 172.21.15.156:0/1354827636 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:04.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.992+0000 7f96af7fe700 1 --2- 172.21.15.156:0/1354827636 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96b01393c0 0x7f96b01223d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:04.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.992+0000 7f96ae7fc700 1 --2- 172.21.15.156:0/1354827636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96b00a1570 0x7f96b0121e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:04.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.992+0000 7f96aeffd700 1 -- 172.21.15.156:0/1354827636 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96b01393c0 msgr2=0x7f96b01223d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:04.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.992+0000 7f96aeffd700 1 --2- 172.21.15.156:0/1354827636 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96b01393c0 0x7f96b01223d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.992+0000 7f96aeffd700 1 -- 172.21.15.156:0/1354827636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96b00a1570 msgr2=0x7f96b0121e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:04.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.992+0000 7f96aeffd700 1 --2- 172.21.15.156:0/1354827636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96b00a1570 0x7f96b0121e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.993+0000 7f96aeffd700 1 -- 172.21.15.156:0/1354827636 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a4009550 con 0x7f96b00a0a90 2023-09-30T22:23:04.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.993+0000 7f96af7fe700 1 --2- 172.21.15.156:0/1354827636 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96b01393c0 0x7f96b01223d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:04.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.993+0000 7f96ae7fc700 1 --2- 172.21.15.156:0/1354827636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96b00a1570 0x7f96b0121e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:04.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.993+0000 7f96aeffd700 1 --2- 172.21.15.156:0/1354827636 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96b00a0a90 0x7f96b0121950 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f96a000c750 tx=0x7f96a000ca60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:04.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.993+0000 7f9697fff700 1 -- 172.21.15.156:0/1354827636 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a00054e0 con 0x7f96b00a0a90 2023-09-30T22:23:04.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.993+0000 7f9697fff700 1 -- 172.21.15.156:0/1354827636 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a0003680 con 0x7f96b00a0a90 2023-09-30T22:23:04.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.993+0000 7f96b5826700 1 -- 172.21.15.156:0/1354827636 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b009b130 con 0x7f96b00a0a90 2023-09-30T22:23:04.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.993+0000 7f96b5826700 1 -- 172.21.15.156:0/1354827636 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b01235a0 con 0x7f96b00a0a90 2023-09-30T22:23:04.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.994+0000 7f9697fff700 1 -- 172.21.15.156:0/1354827636 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a0003a30 con 0x7f96b00a0a90 2023-09-30T22:23:04.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.994+0000 7f9697fff700 1 -- 172.21.15.156:0/1354827636 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f96a0003bd0 con 0x7f96b00a0a90 2023-09-30T22:23:04.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.994+0000 7f9697fff700 1 -- 172.21.15.156:0/1354827636 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f96a003ec40 con 0x7f96b00a0a90 2023-09-30T22:23:04.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.995+0000 7f96b5826700 1 -- 172.21.15.156:0/1354827636 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b0125200 con 0x7f96b00a0a90 2023-09-30T22:23:05.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:04.999+0000 7f9697fff700 1 -- 172.21.15.156:0/1354827636 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f96b0125200 con 0x7f96b00a0a90 2023-09-30T22:23:05.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.026+0000 7f523272f700 1 Processor -- start 2023-09-30T22:23:05.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.026+0000 7f523272f700 1 -- start start 2023-09-30T22:23:05.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.026+0000 7f523272f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f522c09e870 0x7f522c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:05.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.026+0000 7f523272f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f522c09f180 0x7f522c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:05.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.026+0000 7f523272f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f522c131d70 0x7f522c132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:05.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.026+0000 7f523272f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f522c0a0920 con 0x7f522c131d70 2023-09-30T22:23:05.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.026+0000 7f523272f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522c09c970 con 0x7f522c09f180 2023-09-30T22:23:05.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.026+0000 7f523272f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f522c09bab0 con 0x7f522c09e870 2023-09-30T22:23:05.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.026+0000 7f522bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f522c09e870 0x7f522c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:05.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.027+0000 7f522bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f522c09e870 0x7f522c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56726/0 (socket says 172.21.15.156:56726) 2023-09-30T22:23:05.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.027+0000 7f522bfff700 1 -- 172.21.15.156:0/3568631783 learned_addr learned my addr 172.21.15.156:0/3568631783 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:05.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.027+0000 7f5230ccc700 1 --2- 172.21.15.156:0/3568631783 >> v2:172.21.15.156:3300/0 conn(0x7f522c131d70 0x7f522c132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:05.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.027+0000 7f522b7fe700 1 --2- 172.21.15.156:0/3568631783 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f522c09f180 0x7f522c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:05.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.027+0000 7f522bfff700 1 -- 172.21.15.156:0/3568631783 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f522c09f180 msgr2=0x7f522c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:05.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.027+0000 7f522bfff700 1 --2- 172.21.15.156:0/3568631783 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f522c09f180 0x7f522c131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.027+0000 7f522bfff700 1 -- 172.21.15.156:0/3568631783 >> v2:172.21.15.156:3300/0 conn(0x7f522c131d70 msgr2=0x7f522c132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:05.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.027+0000 7f522bfff700 1 --2- 172.21.15.156:0/3568631783 >> v2:172.21.15.156:3300/0 conn(0x7f522c131d70 0x7f522c132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.027+0000 7f522bfff700 1 -- 172.21.15.156:0/3568631783 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522c09f9c0 con 0x7f522c09e870 2023-09-30T22:23:05.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.027+0000 7f522bfff700 1 --2- 172.21.15.156:0/3568631783 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f522c09e870 0x7f522c09ec40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f521c0098f0 tx=0x7f521c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efddb3c64918530f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:05.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.027+0000 7f522affd700 1 -- 172.21.15.156:0/3568631783 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c010a90 con 0x7f522c09e870 2023-09-30T22:23:05.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.027+0000 7f522affd700 1 -- 172.21.15.156:0/3568631783 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521c010bf0 con 0x7f522c09e870 2023-09-30T22:23:05.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.027+0000 7f522affd700 1 -- 172.21.15.156:0/3568631783 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c018440 con 0x7f522c09e870 2023-09-30T22:23:05.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.028+0000 7f523272f700 1 -- 172.21.15.156:0/3568631783 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f522c09e870 msgr2=0x7f522c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:05.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.028+0000 7f523272f700 1 --2- 172.21.15.156:0/3568631783 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f522c09e870 0x7f522c09ec40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f521c0098f0 tx=0x7f521c009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:05.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.028+0000 7f523272f700 1 -- 172.21.15.156:0/3568631783 shutdown_connections 2023-09-30T22:23:05.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.028+0000 7f523272f700 1 --2- 172.21.15.156:0/3568631783 >> v2:172.21.15.156:3300/0 conn(0x7f522c131d70 0x7f522c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.028+0000 7f523272f700 1 --2- 172.21.15.156:0/3568631783 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f522c09e870 0x7f522c09ec40 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.028+0000 7f523272f700 1 --2- 172.21.15.156:0/3568631783 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f522c09f180 0x7f522c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.028+0000 7f523272f700 1 -- 172.21.15.156:0/3568631783 >> 172.21.15.156:0/3568631783 conn(0x7f522c0a4430 msgr2=0x7f522c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:05.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.028+0000 7f523272f700 1 -- 172.21.15.156:0/3568631783 shutdown_connections 2023-09-30T22:23:05.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.028+0000 7f523272f700 1 -- 172.21.15.156:0/3568631783 wait complete. 2023-09-30T22:23:05.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.030+0000 7f523272f700 1 Processor -- start 2023-09-30T22:23:05.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.030+0000 7f523272f700 1 -- start start 2023-09-30T22:23:05.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.030+0000 7f523272f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f522c09e870 0x7f522c1c0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:05.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.030+0000 7f523272f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f522c09f180 0x7f522c1c1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:05.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.031+0000 7f523272f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f522c131d70 0x7f522c1c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:05.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.031+0000 7f523272f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522c11e770 con 0x7f522c131d70 2023-09-30T22:23:05.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.031+0000 7f523272f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522c11dcb0 con 0x7f522c09e870 2023-09-30T22:23:05.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.031+0000 7f523272f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f522c1c18c0 con 0x7f522c09f180 2023-09-30T22:23:05.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.031+0000 7f522b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f522c09f180 0x7f522c1c1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:05.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.031+0000 7f5230ccc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f522c131d70 0x7f522c1c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:05.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.031+0000 7f522b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f522c09f180 0x7f522c1c1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56736/0 (socket says 172.21.15.156:56736) 2023-09-30T22:23:05.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.031+0000 7f522b7fe700 1 -- 172.21.15.156:0/232005235 learned_addr learned my addr 172.21.15.156:0/232005235 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:05.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.031+0000 7f5230ccc700 1 -- 172.21.15.156:0/232005235 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f522c09f180 msgr2=0x7f522c1c1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:05.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.031+0000 7f5230ccc700 1 --2- 172.21.15.156:0/232005235 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f522c09f180 0x7f522c1c1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.031+0000 7f5230ccc700 1 -- 172.21.15.156:0/232005235 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f522c09e870 msgr2=0x7f522c1c0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:05.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.031+0000 7f5230ccc700 1 --2- 172.21.15.156:0/232005235 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f522c09e870 0x7f522c1c0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.031+0000 7f5230ccc700 1 -- 172.21.15.156:0/232005235 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521c009550 con 0x7f522c131d70 2023-09-30T22:23:05.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.031+0000 7f522b7fe700 1 --2- 172.21.15.156:0/232005235 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f522c09f180 0x7f522c1c1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:05.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.031+0000 7f5230ccc700 1 --2- 172.21.15.156:0/232005235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f522c131d70 0x7f522c1c3e60 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f522400efc0 tx=0x7f522400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:05.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.031+0000 7f5228ff9700 1 -- 172.21.15.156:0/232005235 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522400cd40 con 0x7f522c131d70 2023-09-30T22:23:05.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.032+0000 7f5228ff9700 1 -- 172.21.15.156:0/232005235 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522400f040 con 0x7f522c131d70 2023-09-30T22:23:05.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.032+0000 7f5228ff9700 1 -- 172.21.15.156:0/232005235 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52240146c0 con 0x7f522c131d70 2023-09-30T22:23:05.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.032+0000 7f523272f700 1 -- 172.21.15.156:0/232005235 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f522c11ca60 con 0x7f522c131d70 2023-09-30T22:23:05.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.032+0000 7f523272f700 1 -- 172.21.15.156:0/232005235 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f522c11e970 con 0x7f522c131d70 2023-09-30T22:23:05.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.033+0000 7f5228ff9700 1 -- 172.21.15.156:0/232005235 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5224014820 con 0x7f522c131d70 2023-09-30T22:23:05.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.033+0000 7f5228ff9700 1 -- 172.21.15.156:0/232005235 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5224040220 con 0x7f522c131d70 2023-09-30T22:23:05.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.033+0000 7f523272f700 1 -- 172.21.15.156:0/232005235 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f522c04f2a0 con 0x7f522c131d70 2023-09-30T22:23:05.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.038+0000 7f5228ff9700 1 -- 172.21.15.156:0/232005235 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5224018080 con 0x7f522c131d70 2023-09-30T22:23:05.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.038+0000 7ff2da4c5700 1 Processor -- start 2023-09-30T22:23:05.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.038+0000 7ff2da4c5700 1 -- start start 2023-09-30T22:23:05.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.039+0000 7ff2da4c5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2d409a750 0x7ff2d4070230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:05.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.039+0000 7ff2da4c5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff2d412f8c0 0x7ff2d412fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:05.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.039+0000 7ff2da4c5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d4099c90 con 0x7ff2d4130230 2023-09-30T22:23:05.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.039+0000 7ff2da4c5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d409ab20 con 0x7ff2d409a750 2023-09-30T22:23:05.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.039+0000 7ff2da4c5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d40714b0 con 0x7ff2d412f8c0 2023-09-30T22:23:05.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.039+0000 7ff2d3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2d409a750 0x7ff2d4070230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:05.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.039+0000 7ff2d3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2d409a750 0x7ff2d4070230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51734/0 (socket says 172.21.15.156:51734) 2023-09-30T22:23:05.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.039+0000 7ff2d3fff700 1 -- 172.21.15.156:0/176006107 learned_addr learned my addr 172.21.15.156:0/176006107 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:05.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.039+0000 7ff2cbfff700 1 --2- 172.21.15.156:0/176006107 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff2d412f8c0 0x7ff2d412fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:05.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.039+0000 7ff2d3fff700 1 -- 172.21.15.156:0/176006107 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff2d412f8c0 msgr2=0x7ff2d412fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:05.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.040+0000 7ff2d3fff700 1 --2- 172.21.15.156:0/176006107 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff2d412f8c0 0x7ff2d412fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.040+0000 7ff2d3fff700 1 -- 172.21.15.156:0/176006107 >> v1:172.21.15.156:6789/0 conn(0x7ff2d4130230 legacy=0x7ff2d4136c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:05.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.040+0000 7ff2d3fff700 1 -- 172.21.15.156:0/176006107 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d412cb80 con 0x7ff2d409a750 2023-09-30T22:23:05.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.040+0000 7ff2d3fff700 1 --2- 172.21.15.156:0/176006107 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2d409a750 0x7ff2d4070230 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4009920 tx=0x7ff2c4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c3b65ff0e5f6482 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:05.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.040+0000 7ff2d37fe700 1 -- 172.21.15.156:0/176006107 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c4004230 con 0x7ff2d409a750 2023-09-30T22:23:05.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.040+0000 7ff2d37fe700 1 -- 172.21.15.156:0/176006107 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c4004390 con 0x7ff2d409a750 2023-09-30T22:23:05.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.040+0000 7ff2d37fe700 1 -- 172.21.15.156:0/176006107 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c40036a0 con 0x7ff2d409a750 2023-09-30T22:23:05.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.041+0000 7ff2da4c5700 1 -- 172.21.15.156:0/176006107 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2d409a750 msgr2=0x7ff2d4070230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:05.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.041+0000 7ff2da4c5700 1 --2- 172.21.15.156:0/176006107 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2d409a750 0x7ff2d4070230 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4009920 tx=0x7ff2c4009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:05.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.041+0000 7ff2da4c5700 1 -- 172.21.15.156:0/176006107 shutdown_connections 2023-09-30T22:23:05.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.041+0000 7ff2da4c5700 1 --2- 172.21.15.156:0/176006107 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2d409a750 0x7ff2d4070230 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.041+0000 7ff2da4c5700 1 --2- 172.21.15.156:0/176006107 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff2d412f8c0 0x7ff2d412fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.041+0000 7ff2da4c5700 1 -- 172.21.15.156:0/176006107 >> 172.21.15.156:0/176006107 conn(0x7ff2d40a2810 msgr2=0x7ff2d40a2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:05.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.041+0000 7ff2da4c5700 1 -- 172.21.15.156:0/176006107 shutdown_connections 2023-09-30T22:23:05.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.041+0000 7ff2da4c5700 1 -- 172.21.15.156:0/176006107 wait complete. 2023-09-30T22:23:05.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.042+0000 7ff2da4c5700 1 Processor -- start 2023-09-30T22:23:05.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.042+0000 7ff2da4c5700 1 -- start start 2023-09-30T22:23:05.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.043+0000 7ff2da4c5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff2d409a750 0x7ff2d4130a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:05.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.043+0000 7ff2da4c5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2d412f8c0 0x7ff2d4130f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:05.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.043+0000 7ff2da4c5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2d4130230 0x7ff2d4131490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:05.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.043+0000 7ff2da4c5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d412db50 con 0x7ff2d4130230 2023-09-30T22:23:05.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.043+0000 7ff2da4c5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d4132da0 con 0x7ff2d412f8c0 2023-09-30T22:23:05.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.043+0000 7ff2da4c5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d4133ce0 con 0x7ff2d409a750 2023-09-30T22:23:05.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.043+0000 7ff2d8a62700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2d4130230 0x7ff2d4131490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:05.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.043+0000 7ff2d8a62700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2d4130230 0x7ff2d4131490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:45776/0 (socket says 172.21.15.156:45776) 2023-09-30T22:23:05.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.043+0000 7ff2d8a62700 1 -- 172.21.15.156:0/3076105350 learned_addr learned my addr 172.21.15.156:0/3076105350 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:05.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.043+0000 7ff2d3fff700 1 --2- 172.21.15.156:0/3076105350 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff2d409a750 0x7ff2d4130a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:05.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.043+0000 7ff2cbfff700 1 --2- 172.21.15.156:0/3076105350 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2d412f8c0 0x7ff2d4130f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:05.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.043+0000 7ff2d8a62700 1 -- 172.21.15.156:0/3076105350 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff2d409a750 msgr2=0x7ff2d4130a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:05.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.043+0000 7ff2d8a62700 1 --2- 172.21.15.156:0/3076105350 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff2d409a750 0x7ff2d4130a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.043+0000 7ff2d8a62700 1 -- 172.21.15.156:0/3076105350 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2d412f8c0 msgr2=0x7ff2d4130f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:05.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.043+0000 7ff2d8a62700 1 --2- 172.21.15.156:0/3076105350 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2d412f8c0 0x7ff2d4130f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.043+0000 7ff2d8a62700 1 -- 172.21.15.156:0/3076105350 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c4009550 con 0x7ff2d4130230 2023-09-30T22:23:05.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.044+0000 7ff2d8a62700 1 --2- 172.21.15.156:0/3076105350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2d4130230 0x7ff2d4131490 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00c7a0 tx=0x7ff2cc00cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:05.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.044+0000 7ff2d17fa700 1 -- 172.21.15.156:0/3076105350 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc003e10 con 0x7ff2d4130230 2023-09-30T22:23:05.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.044+0000 7ff2d17fa700 1 -- 172.21.15.156:0/3076105350 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2cc005070 con 0x7ff2d4130230 2023-09-30T22:23:05.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.044+0000 7ff2da4c5700 1 -- 172.21.15.156:0/3076105350 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d41392d0 con 0x7ff2d4130230 2023-09-30T22:23:05.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.044+0000 7ff2d17fa700 1 -- 172.21.15.156:0/3076105350 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc005420 con 0x7ff2d4130230 2023-09-30T22:23:05.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.044+0000 7ff2da4c5700 1 -- 172.21.15.156:0/3076105350 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d409f050 con 0x7ff2d4130230 2023-09-30T22:23:05.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.045+0000 7ff2d17fa700 1 -- 172.21.15.156:0/3076105350 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff2cc005580 con 0x7ff2d4130230 2023-09-30T22:23:05.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.045+0000 7ff2d17fa700 1 -- 172.21.15.156:0/3076105350 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff2cc03ecb0 con 0x7ff2d4130230 2023-09-30T22:23:05.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.045+0000 7ff2da4c5700 1 -- 172.21.15.156:0/3076105350 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d4132ee0 con 0x7ff2d4130230 2023-09-30T22:23:05.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.050+0000 7ff2d17fa700 1 -- 172.21.15.156:0/3076105350 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff2cc017020 con 0x7ff2d4130230 2023-09-30T22:23:05.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.070+0000 7ff8d1463700 1 Processor -- start 2023-09-30T22:23:05.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.070+0000 7ff8d1463700 1 -- start start 2023-09-30T22:23:05.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.071+0000 7ff8d1463700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8cc09ad40 0x7ff8cc133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:05.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.071+0000 7ff8d1463700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff8cc133f70 0x7ff8cc1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:05.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.071+0000 7ff8caffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8cc09ad40 0x7ff8cc133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:05.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.071+0000 7ff8d1463700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8cc09b110 con 0x7ff8cc0a0a70 2023-09-30T22:23:05.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.071+0000 7ff8d1463700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc0a3b60 con 0x7ff8cc09ad40 2023-09-30T22:23:05.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.071+0000 7ff8cb7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff8cc0a0a70 0x7ff8cc0a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49308/0 (socket says 172.21.15.156:49308) 2023-09-30T22:23:05.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.071+0000 7ff8d1463700 1 -- 172.21.15.156:0/339785107 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc1348e0 con 0x7ff8cc133f70 2023-09-30T22:23:05.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.071+0000 7ff8cb7fe700 1 -- 172.21.15.156:0/339785107 learned_addr learned my addr 172.21.15.156:0/339785107 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:05.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.072+0000 7ff8caffd700 1 -- 172.21.15.156:0/339785107 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff8cc133f70 msgr2=0x7ff8cc1343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:05.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.072+0000 7ff8c9ffb700 1 -- 172.21.15.156:0/339785107 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1194288096 0 0) 0x7ff8cc09b110 con 0x7ff8cc0a0a70 2023-09-30T22:23:05.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.072+0000 7ff8caffd700 1 --2- 172.21.15.156:0/339785107 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff8cc133f70 0x7ff8cc1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.072+0000 7ff8caffd700 1 -- 172.21.15.156:0/339785107 >> v1:172.21.15.156:6789/0 conn(0x7ff8cc0a0a70 legacy=0x7ff8cc0a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:05.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.072+0000 7ff8caffd700 1 -- 172.21.15.156:0/339785107 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8cc0a2fa0 con 0x7ff8cc09ad40 2023-09-30T22:23:05.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.072+0000 7ff8caffd700 1 --2- 172.21.15.156:0/339785107 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8cc09ad40 0x7ff8cc133a30 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009870 tx=0x7ff8bc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f087553bc7c02034 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:05.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.072+0000 7ff8c9ffb700 1 -- 172.21.15.156:0/339785107 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc011830 con 0x7ff8cc09ad40 2023-09-30T22:23:05.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.072+0000 7ff8c9ffb700 1 -- 172.21.15.156:0/339785107 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8bc011990 con 0x7ff8cc09ad40 2023-09-30T22:23:05.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.072+0000 7ff8c9ffb700 1 -- 172.21.15.156:0/339785107 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc011d20 con 0x7ff8cc09ad40 2023-09-30T22:23:05.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.073+0000 7ff8d1463700 1 -- 172.21.15.156:0/339785107 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8cc09ad40 msgr2=0x7ff8cc133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:05.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.073+0000 7ff8d1463700 1 --2- 172.21.15.156:0/339785107 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8cc09ad40 0x7ff8cc133a30 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009870 tx=0x7ff8bc009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:05.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.073+0000 7ff8d1463700 1 -- 172.21.15.156:0/339785107 shutdown_connections 2023-09-30T22:23:05.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.073+0000 7ff8d1463700 1 --2- 172.21.15.156:0/339785107 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8cc09ad40 0x7ff8cc133a30 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.073+0000 7ff8d1463700 1 --2- 172.21.15.156:0/339785107 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff8cc133f70 0x7ff8cc1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.073+0000 7ff8d1463700 1 -- 172.21.15.156:0/339785107 >> 172.21.15.156:0/339785107 conn(0x7ff8cc099c40 msgr2=0x7ff8cc06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:05.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.073+0000 7ff8d1463700 1 -- 172.21.15.156:0/339785107 shutdown_connections 2023-09-30T22:23:05.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.073+0000 7ff8d1463700 1 -- 172.21.15.156:0/339785107 wait complete. 2023-09-30T22:23:05.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.075+0000 7ff8d1463700 1 Processor -- start 2023-09-30T22:23:05.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.075+0000 7ff8d1463700 1 -- start start 2023-09-30T22:23:05.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.075+0000 7ff8d1463700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8cc09ad40 0x7ff8cc1c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:05.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.075+0000 7ff8d1463700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8cc0a0a70 0x7ff8cc1c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:05.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.075+0000 7ff8d1463700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff8cc133f70 0x7ff8cc1c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:05.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.075+0000 7ff8d1463700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc122470 con 0x7ff8cc0a0a70 2023-09-30T22:23:05.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.075+0000 7ff8d1463700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc120760 con 0x7ff8cc09ad40 2023-09-30T22:23:05.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.075+0000 7ff8d1463700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc09e7f0 con 0x7ff8cc133f70 2023-09-30T22:23:05.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.076+0000 7ff8cb7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff8cc133f70 0x7ff8cc1c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:05.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.076+0000 7ff8cb7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff8cc133f70 0x7ff8cc1c8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56754/0 (socket says 172.21.15.156:56754) 2023-09-30T22:23:05.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.076+0000 7ff8cb7fe700 1 -- 172.21.15.156:0/1445974476 learned_addr learned my addr 172.21.15.156:0/1445974476 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:05.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.076+0000 7ff8caffd700 1 --2- 172.21.15.156:0/1445974476 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8cc09ad40 0x7ff8cc1c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:05.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.076+0000 7ff8ca7fc700 1 --2- 172.21.15.156:0/1445974476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8cc0a0a70 0x7ff8cc1c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:05.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.076+0000 7ff8cb7fe700 1 -- 172.21.15.156:0/1445974476 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8cc09ad40 msgr2=0x7ff8cc1c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:05.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.076+0000 7ff8cb7fe700 1 --2- 172.21.15.156:0/1445974476 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8cc09ad40 0x7ff8cc1c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.076+0000 7ff8cb7fe700 1 -- 172.21.15.156:0/1445974476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8cc0a0a70 msgr2=0x7ff8cc1c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:05.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.076+0000 7ff8cb7fe700 1 --2- 172.21.15.156:0/1445974476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8cc0a0a70 0x7ff8cc1c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.076+0000 7ff8cb7fe700 1 -- 172.21.15.156:0/1445974476 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc0094a0 con 0x7ff8cc133f70 2023-09-30T22:23:05.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.076+0000 7ff8cb7fe700 1 --2- 172.21.15.156:0/1445974476 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff8cc133f70 0x7ff8cc1c8d10 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4002230 tx=0x7ff8c400cf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:05.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.076+0000 7ff8b37fe700 1 -- 172.21.15.156:0/1445974476 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c400aac0 con 0x7ff8cc133f70 2023-09-30T22:23:05.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.077+0000 7ff8b37fe700 1 -- 172.21.15.156:0/1445974476 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c400ac40 con 0x7ff8cc133f70 2023-09-30T22:23:05.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.077+0000 7ff8d1463700 1 -- 172.21.15.156:0/1445974476 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8cc120f50 con 0x7ff8cc133f70 2023-09-30T22:23:05.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.077+0000 7ff8b37fe700 1 -- 172.21.15.156:0/1445974476 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c40070d0 con 0x7ff8cc133f70 2023-09-30T22:23:05.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.077+0000 7ff8d1463700 1 -- 172.21.15.156:0/1445974476 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8cc122670 con 0x7ff8cc133f70 2023-09-30T22:23:05.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.078+0000 7ff8b37fe700 1 -- 172.21.15.156:0/1445974476 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff8c4007250 con 0x7ff8cc133f70 2023-09-30T22:23:05.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.078+0000 7ff8d1463700 1 -- 172.21.15.156:0/1445974476 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8cc04f2a0 con 0x7ff8cc133f70 2023-09-30T22:23:05.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.078+0000 7ff8b37fe700 1 -- 172.21.15.156:0/1445974476 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff8c403f490 con 0x7ff8cc133f70 2023-09-30T22:23:05.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.087+0000 7ff8b37fe700 1 -- 172.21.15.156:0/1445974476 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff8c4018080 con 0x7ff8cc133f70 2023-09-30T22:23:05.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.214+0000 7f96b5826700 1 -- 172.21.15.156:0/1354827636 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f96b0125200 con 0x7f96b00a0a90 2023-09-30T22:23:05.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.214+0000 7f9697fff700 1 -- 172.21.15.156:0/1354827636 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f96b0125200 con 0x7f96b00a0a90 2023-09-30T22:23:05.215 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:05.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.216+0000 7f96b5826700 1 -- 172.21.15.156:0/1354827636 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96b00a0a90 msgr2=0x7f96b0121950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:05.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.216+0000 7f96b5826700 1 --2- 172.21.15.156:0/1354827636 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96b00a0a90 0x7f96b0121950 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f96a000c750 tx=0x7f96a000ca60 comp rx=0 tx=0).stop 2023-09-30T22:23:05.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.216+0000 7f96b5826700 1 -- 172.21.15.156:0/1354827636 shutdown_connections 2023-09-30T22:23:05.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.216+0000 7f96b5826700 1 --2- 172.21.15.156:0/1354827636 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96b01393c0 0x7f96b01223d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.216+0000 7f96b5826700 1 --2- 172.21.15.156:0/1354827636 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96b00a0a90 0x7f96b0121950 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.216+0000 7f96b5826700 1 --2- 172.21.15.156:0/1354827636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96b00a1570 0x7f96b0121e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.216+0000 7f96b5826700 1 -- 172.21.15.156:0/1354827636 >> 172.21.15.156:0/1354827636 conn(0x7f96b0099c40 msgr2=0x7f96b009e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:05.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.216+0000 7f96b5826700 1 -- 172.21.15.156:0/1354827636 shutdown_connections 2023-09-30T22:23:05.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.216+0000 7f96b5826700 1 -- 172.21.15.156:0/1354827636 wait complete. 2023-09-30T22:23:05.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:05.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.249+0000 7ff2da4c5700 1 -- 172.21.15.156:0/3076105350 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff2d404f2a0 con 0x7ff2d4130230 2023-09-30T22:23:05.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.249+0000 7ff2d17fa700 1 -- 172.21.15.156:0/3076105350 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff2cc005830 con 0x7ff2d4130230 2023-09-30T22:23:05.250 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:05.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.253+0000 7ff2da4c5700 1 -- 172.21.15.156:0/3076105350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2d4130230 msgr2=0x7ff2d4131490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:05.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.253+0000 7ff2da4c5700 1 --2- 172.21.15.156:0/3076105350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2d4130230 0x7ff2d4131490 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00c7a0 tx=0x7ff2cc00cab0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.253+0000 7ff2da4c5700 1 -- 172.21.15.156:0/3076105350 shutdown_connections 2023-09-30T22:23:05.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.253+0000 7ff2da4c5700 1 --2- 172.21.15.156:0/3076105350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2d4130230 0x7ff2d4131490 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.253+0000 7ff2da4c5700 1 --2- 172.21.15.156:0/3076105350 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff2d409a750 0x7ff2d4130a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.253+0000 7ff2da4c5700 1 --2- 172.21.15.156:0/3076105350 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2d412f8c0 0x7ff2d4130f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.253+0000 7ff2da4c5700 1 -- 172.21.15.156:0/3076105350 >> 172.21.15.156:0/3076105350 conn(0x7ff2d40a2810 msgr2=0x7ff2d406f170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:05.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.253+0000 7ff2da4c5700 1 -- 172.21.15.156:0/3076105350 shutdown_connections 2023-09-30T22:23:05.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.253+0000 7ff2da4c5700 1 -- 172.21.15.156:0/3076105350 wait complete. 2023-09-30T22:23:05.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.253+0000 7f523272f700 1 -- 172.21.15.156:0/232005235 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f522c09dba0 con 0x7f522c131d70 2023-09-30T22:23:05.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.253+0000 7f5228ff9700 1 -- 172.21.15.156:0/232005235 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5224007920 con 0x7f522c131d70 2023-09-30T22:23:05.255 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:05.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.257+0000 7f523272f700 1 -- 172.21.15.156:0/232005235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f522c131d70 msgr2=0x7f522c1c3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:05.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.257+0000 7f523272f700 1 --2- 172.21.15.156:0/232005235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f522c131d70 0x7f522c1c3e60 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f522400efc0 tx=0x7f522400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.257+0000 7f523272f700 1 -- 172.21.15.156:0/232005235 shutdown_connections 2023-09-30T22:23:05.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.257+0000 7f523272f700 1 --2- 172.21.15.156:0/232005235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f522c131d70 0x7f522c1c3e60 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.257+0000 7f523272f700 1 --2- 172.21.15.156:0/232005235 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f522c09e870 0x7f522c1c0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.257+0000 7f523272f700 1 --2- 172.21.15.156:0/232005235 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f522c09f180 0x7f522c1c1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.257+0000 7f523272f700 1 -- 172.21.15.156:0/232005235 >> 172.21.15.156:0/232005235 conn(0x7f522c0a4430 msgr2=0x7f522c130000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:05.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.257+0000 7f523272f700 1 -- 172.21.15.156:0/232005235 shutdown_connections 2023-09-30T22:23:05.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.257+0000 7f523272f700 1 -- 172.21.15.156:0/232005235 wait complete. 2023-09-30T22:23:05.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:05.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:05.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.304+0000 7ff8d1463700 1 -- 172.21.15.156:0/1445974476 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff8cc0729d0 con 0x7ff8cc133f70 2023-09-30T22:23:05.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.304+0000 7ff8b37fe700 1 -- 172.21.15.156:0/1445974476 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff8c4007500 con 0x7ff8cc133f70 2023-09-30T22:23:05.305 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:05.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.306+0000 7ff8d1463700 1 -- 172.21.15.156:0/1445974476 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff8cc133f70 msgr2=0x7ff8cc1c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:05.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.306+0000 7ff8d1463700 1 --2- 172.21.15.156:0/1445974476 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff8cc133f70 0x7ff8cc1c8d10 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4002230 tx=0x7ff8c400cf50 comp rx=0 tx=0).stop 2023-09-30T22:23:05.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.306+0000 7ff8d1463700 1 -- 172.21.15.156:0/1445974476 shutdown_connections 2023-09-30T22:23:05.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.306+0000 7ff8d1463700 1 --2- 172.21.15.156:0/1445974476 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff8cc133f70 0x7ff8cc1c8d10 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.306+0000 7ff8d1463700 1 --2- 172.21.15.156:0/1445974476 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8cc09ad40 0x7ff8cc1c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.306+0000 7ff8d1463700 1 --2- 172.21.15.156:0/1445974476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8cc0a0a70 0x7ff8cc1c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.306+0000 7ff8d1463700 1 -- 172.21.15.156:0/1445974476 >> 172.21.15.156:0/1445974476 conn(0x7ff8cc099c40 msgr2=0x7ff8cc1bbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:05.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.306+0000 7ff8d1463700 1 -- 172.21.15.156:0/1445974476 shutdown_connections 2023-09-30T22:23:05.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:05.306+0000 7ff8d1463700 1 -- 172.21.15.156:0/1445974476 wait complete. 2023-09-30T22:23:05.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:06.230 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:06.269 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:06.280 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:06.320 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:06.367 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.366+0000 7f104e1b0700 1 Processor -- start 2023-09-30T22:23:06.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.366+0000 7f104e1b0700 1 -- start start 2023-09-30T22:23:06.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.367+0000 7f104e1b0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f104812d380 0x7f104812d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.367+0000 7f104e1b0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f104809a5a0 0x7f1048138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.367+0000 7f104e1b0700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f104809bb90 con 0x7f1048099a60 2023-09-30T22:23:06.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.367+0000 7f104e1b0700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f104809c210 con 0x7f104812d380 2023-09-30T22:23:06.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.367+0000 7f104e1b0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f104809ced0 con 0x7f104809a5a0 2023-09-30T22:23:06.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.367+0000 7f1047fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f104809a5a0 0x7f1048138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.367+0000 7f1047fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f104809a5a0 0x7f1048138620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51772/0 (socket says 172.21.15.156:51772) 2023-09-30T22:23:06.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.367+0000 7f1047fff700 1 -- 172.21.15.156:0/2245871633 learned_addr learned my addr 172.21.15.156:0/2245871633 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:06.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.367+0000 7f1046ffd700 1 --1- 172.21.15.156:0/2245871633 >> v1:172.21.15.156:6789/0 conn(0x7f1048099a60 0x7f1048099e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49316/0 (socket says 172.21.15.156:49316) 2023-09-30T22:23:06.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.367+0000 7f10477fe700 1 --2- 172.21.15.156:0/2245871633 >> v2:172.21.15.156:3300/0 conn(0x7f104812d380 0x7f104812d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.367+0000 7f1047fff700 1 -- 172.21.15.156:0/2245871633 >> v2:172.21.15.156:3300/0 conn(0x7f104812d380 msgr2=0x7f104812d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:06.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.367+0000 7f1047fff700 1 --2- 172.21.15.156:0/2245871633 >> v2:172.21.15.156:3300/0 conn(0x7f104812d380 0x7f104812d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.367+0000 7f1047fff700 1 -- 172.21.15.156:0/2245871633 >> v1:172.21.15.156:6789/0 conn(0x7f1048099a60 legacy=0x7f1048099e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.367+0000 7f1047fff700 1 -- 172.21.15.156:0/2245871633 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f104809ac30 con 0x7f104809a5a0 2023-09-30T22:23:06.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.368+0000 7f1047fff700 1 --2- 172.21.15.156:0/2245871633 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f104809a5a0 0x7f1048138620 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1040009e50 tx=0x7f104000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2db36d8e86ee48de server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:06.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.368+0000 7f10467fc700 1 -- 172.21.15.156:0/2245871633 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104000bb10 con 0x7f104809a5a0 2023-09-30T22:23:06.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.368+0000 7f10467fc700 1 -- 172.21.15.156:0/2245871633 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104000bc70 con 0x7f104809a5a0 2023-09-30T22:23:06.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.368+0000 7f10467fc700 1 -- 172.21.15.156:0/2245871633 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10400148d0 con 0x7f104809a5a0 2023-09-30T22:23:06.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.369+0000 7f104e1b0700 1 -- 172.21.15.156:0/2245871633 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f104809a5a0 msgr2=0x7f1048138620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.369+0000 7f104e1b0700 1 --2- 172.21.15.156:0/2245871633 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f104809a5a0 0x7f1048138620 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1040009e50 tx=0x7f104000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:06.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.369+0000 7f104e1b0700 1 -- 172.21.15.156:0/2245871633 shutdown_connections 2023-09-30T22:23:06.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.369+0000 7f104e1b0700 1 --2- 172.21.15.156:0/2245871633 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f104809a5a0 0x7f1048138620 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.369+0000 7f104e1b0700 1 --2- 172.21.15.156:0/2245871633 >> v2:172.21.15.156:3300/0 conn(0x7f104812d380 0x7f104812d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.369+0000 7f104e1b0700 1 -- 172.21.15.156:0/2245871633 >> 172.21.15.156:0/2245871633 conn(0x7f10480a2980 msgr2=0x7f10480a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:06.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.369+0000 7f104e1b0700 1 -- 172.21.15.156:0/2245871633 shutdown_connections 2023-09-30T22:23:06.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.369+0000 7f104e1b0700 1 -- 172.21.15.156:0/2245871633 wait complete. 2023-09-30T22:23:06.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.370+0000 7f104e1b0700 1 Processor -- start 2023-09-30T22:23:06.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.370+0000 7f104e1b0700 1 -- start start 2023-09-30T22:23:06.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.370+0000 7f104e1b0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1048099a60 0x7f1048119740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.370+0000 7f104e1b0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f104809a5a0 0x7f1048119c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.370+0000 7f104e1b0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f104812d380 0x7f104811a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.370+0000 7f104e1b0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104811d260 con 0x7f104809a5a0 2023-09-30T22:23:06.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.371+0000 7f104e1b0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f104811c630 con 0x7f1048099a60 2023-09-30T22:23:06.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.371+0000 7f104e1b0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10480a1850 con 0x7f104812d380 2023-09-30T22:23:06.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.371+0000 7f10477fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1048099a60 0x7f1048119740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.371+0000 7f10477fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1048099a60 0x7f1048119740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51776/0 (socket says 172.21.15.156:51776) 2023-09-30T22:23:06.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.371+0000 7f10477fe700 1 -- 172.21.15.156:0/3328582219 learned_addr learned my addr 172.21.15.156:0/3328582219 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:06.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.371+0000 7f1046ffd700 1 --2- 172.21.15.156:0/3328582219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f104809a5a0 0x7f1048119c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.371+0000 7f1047fff700 1 --2- 172.21.15.156:0/3328582219 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f104812d380 0x7f104811a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.371+0000 7f10477fe700 1 -- 172.21.15.156:0/3328582219 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f104812d380 msgr2=0x7f104811a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.371+0000 7f10477fe700 1 --2- 172.21.15.156:0/3328582219 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f104812d380 0x7f104811a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.371+0000 7f10477fe700 1 -- 172.21.15.156:0/3328582219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f104809a5a0 msgr2=0x7f1048119c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.371+0000 7f10477fe700 1 --2- 172.21.15.156:0/3328582219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f104809a5a0 0x7f1048119c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.371+0000 7f10477fe700 1 -- 172.21.15.156:0/3328582219 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1040009b30 con 0x7f1048099a60 2023-09-30T22:23:06.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.371+0000 7f1046ffd700 1 --2- 172.21.15.156:0/3328582219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f104809a5a0 0x7f1048119c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:06.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.371+0000 7f10477fe700 1 --2- 172.21.15.156:0/3328582219 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1048099a60 0x7f1048119740 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f10380099b0 tx=0x7f1038009cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:06.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.372+0000 7f102ffff700 1 -- 172.21.15.156:0/3328582219 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103800c5e0 con 0x7f1048099a60 2023-09-30T22:23:06.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.372+0000 7f102ffff700 1 -- 172.21.15.156:0/3328582219 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103800c740 con 0x7f1048099a60 2023-09-30T22:23:06.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.372+0000 7f104e1b0700 1 -- 172.21.15.156:0/3328582219 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f104809b3e0 con 0x7f1048099a60 2023-09-30T22:23:06.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.372+0000 7f102ffff700 1 -- 172.21.15.156:0/3328582219 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103800cab0 con 0x7f1048099a60 2023-09-30T22:23:06.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.372+0000 7f104e1b0700 1 -- 172.21.15.156:0/3328582219 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f104811c9f0 con 0x7f1048099a60 2023-09-30T22:23:06.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.373+0000 7f104e1b0700 1 -- 172.21.15.156:0/3328582219 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f104806f730 con 0x7f1048099a60 2023-09-30T22:23:06.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.373+0000 7f102ffff700 1 -- 172.21.15.156:0/3328582219 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f103800cc10 con 0x7f1048099a60 2023-09-30T22:23:06.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.373+0000 7f102ffff700 1 -- 172.21.15.156:0/3328582219 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f103803f7c0 con 0x7f1048099a60 2023-09-30T22:23:06.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.378+0000 7f102ffff700 1 -- 172.21.15.156:0/3328582219 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f10380282f0 con 0x7f1048099a60 2023-09-30T22:23:06.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.421+0000 7f4efa66b700 1 Processor -- start 2023-09-30T22:23:06.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.422+0000 7f4efa66b700 1 -- start start 2023-09-30T22:23:06.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.422+0000 7f4efa66b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4ef40a0a70 0x7f4ef40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.422+0000 7f4efa66b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ef40a1380 0x7f4ef4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.422+0000 7f4efa66b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ef4133f50 0x7f4ef41343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.422+0000 7f4efa66b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef409e9d0 con 0x7f4ef40a0a70 2023-09-30T22:23:06.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.422+0000 7f4efa66b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef409dc00 con 0x7f4ef4133f50 2023-09-30T22:23:06.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.422+0000 7f4efa66b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef409dec0 con 0x7f4ef40a1380 2023-09-30T22:23:06.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.423+0000 7f4ef3fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4ef40a0a70 0x7f4ef40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.423+0000 7f4ef3fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4ef40a0a70 0x7f4ef40a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:45798/0 (socket says 172.21.15.156:45798) 2023-09-30T22:23:06.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.423+0000 7f4ef37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ef40a1380 0x7f4ef4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.423+0000 7f4ef3fff700 1 -- 172.21.15.156:0/1081664238 learned_addr learned my addr 172.21.15.156:0/1081664238 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:06.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.423+0000 7f4ef8c08700 1 --2- 172.21.15.156:0/1081664238 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ef4133f50 0x7f4ef41343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.423+0000 7f4ef37fe700 1 -- 172.21.15.156:0/1081664238 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ef4133f50 msgr2=0x7f4ef41343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:06.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.423+0000 7f4ef37fe700 1 --2- 172.21.15.156:0/1081664238 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ef4133f50 0x7f4ef41343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.423+0000 7f4ef37fe700 1 -- 172.21.15.156:0/1081664238 >> v2:172.21.15.156:3300/0 conn(0x7f4ef40a0a70 msgr2=0x7f4ef40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:06.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.423+0000 7f4ef37fe700 1 --2- 172.21.15.156:0/1081664238 >> v2:172.21.15.156:3300/0 conn(0x7f4ef40a0a70 0x7f4ef40a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.423+0000 7f4ef37fe700 1 -- 172.21.15.156:0/1081664238 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef409e6a0 con 0x7f4ef40a1380 2023-09-30T22:23:06.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.423+0000 7f4ef3fff700 1 --2- 172.21.15.156:0/1081664238 >> v2:172.21.15.156:3300/0 conn(0x7f4ef40a0a70 0x7f4ef40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:06.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.423+0000 7f4ef37fe700 1 --2- 172.21.15.156:0/1081664238 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ef40a1380 0x7f4ef4133a10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8009840 tx=0x7f4ee8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d829696b2cede9cb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:06.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.423+0000 7f4ef2ffd700 1 -- 172.21.15.156:0/1081664238 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8011830 con 0x7f4ef40a1380 2023-09-30T22:23:06.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.423+0000 7f4ef2ffd700 1 -- 172.21.15.156:0/1081664238 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee8011990 con 0x7f4ef40a1380 2023-09-30T22:23:06.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.423+0000 7f4ef2ffd700 1 -- 172.21.15.156:0/1081664238 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8011d20 con 0x7f4ef40a1380 2023-09-30T22:23:06.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.424+0000 7f4efa66b700 1 -- 172.21.15.156:0/1081664238 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ef40a1380 msgr2=0x7f4ef4133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.424+0000 7f4efa66b700 1 --2- 172.21.15.156:0/1081664238 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ef40a1380 0x7f4ef4133a10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8009840 tx=0x7f4ee8009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:06.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.424+0000 7f4efa66b700 1 -- 172.21.15.156:0/1081664238 shutdown_connections 2023-09-30T22:23:06.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.424+0000 7f4efa66b700 1 --2- 172.21.15.156:0/1081664238 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ef4133f50 0x7f4ef41343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.424+0000 7f4efa66b700 1 --2- 172.21.15.156:0/1081664238 >> v2:172.21.15.156:3300/0 conn(0x7f4ef40a0a70 0x7f4ef40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.424+0000 7f4efa66b700 1 --2- 172.21.15.156:0/1081664238 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ef40a1380 0x7f4ef4133a10 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.424+0000 7f4efa66b700 1 -- 172.21.15.156:0/1081664238 >> 172.21.15.156:0/1081664238 conn(0x7f4ef40a6610 msgr2=0x7f4ef40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:06.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.424+0000 7f4efa66b700 1 -- 172.21.15.156:0/1081664238 shutdown_connections 2023-09-30T22:23:06.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.424+0000 7f4efa66b700 1 -- 172.21.15.156:0/1081664238 wait complete. 2023-09-30T22:23:06.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.425+0000 7f4efa66b700 1 Processor -- start 2023-09-30T22:23:06.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.425+0000 7f4efa66b700 1 -- start start 2023-09-30T22:23:06.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.426+0000 7f4efa66b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ef40a0a70 0x7f4ef41223e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.426+0000 7f4efa66b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ef40a1380 0x7f4ef4122920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.426+0000 7f4efa66b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ef4133f50 0x7f4ef4122e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.426+0000 7f4efa66b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef4125f50 con 0x7f4ef40a1380 2023-09-30T22:23:06.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.426+0000 7f4efa66b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef4124120 con 0x7f4ef40a0a70 2023-09-30T22:23:06.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.426+0000 7f4efa66b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef4124e30 con 0x7f4ef4133f50 2023-09-30T22:23:06.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.426+0000 7f4ef37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ef40a1380 0x7f4ef4122920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.426+0000 7f4ef37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ef40a1380 0x7f4ef4122920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:45814/0 (socket says 172.21.15.156:45814) 2023-09-30T22:23:06.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.426+0000 7f4ef37fe700 1 -- 172.21.15.156:0/3231494490 learned_addr learned my addr 172.21.15.156:0/3231494490 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:06.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.426+0000 7f4ef3fff700 1 --2- 172.21.15.156:0/3231494490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ef40a0a70 0x7f4ef41223e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.426+0000 7f4ef8c08700 1 --2- 172.21.15.156:0/3231494490 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ef4133f50 0x7f4ef4122e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.426+0000 7f4ef37fe700 1 -- 172.21.15.156:0/3231494490 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ef4133f50 msgr2=0x7f4ef4122e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.426+0000 7f4ef37fe700 1 --2- 172.21.15.156:0/3231494490 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ef4133f50 0x7f4ef4122e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.426+0000 7f4ef37fe700 1 -- 172.21.15.156:0/3231494490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ef40a0a70 msgr2=0x7f4ef41223e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.426+0000 7f4ef37fe700 1 --2- 172.21.15.156:0/3231494490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ef40a0a70 0x7f4ef41223e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.426+0000 7f4ef37fe700 1 -- 172.21.15.156:0/3231494490 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee4009550 con 0x7f4ef40a1380 2023-09-30T22:23:06.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.426+0000 7f4ef3fff700 1 --2- 172.21.15.156:0/3231494490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ef40a0a70 0x7f4ef41223e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:06.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.427+0000 7f4ef37fe700 1 --2- 172.21.15.156:0/3231494490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ef40a1380 0x7f4ef4122920 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8000c00 tx=0x7f4ee8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:06.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.427+0000 7f4ef0ff9700 1 -- 172.21.15.156:0/3231494490 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8004450 con 0x7f4ef40a1380 2023-09-30T22:23:06.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.427+0000 7f4ef0ff9700 1 -- 172.21.15.156:0/3231494490 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee801f070 con 0x7f4ef40a1380 2023-09-30T22:23:06.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.427+0000 7f4ef0ff9700 1 -- 172.21.15.156:0/3231494490 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee80038c0 con 0x7f4ef40a1380 2023-09-30T22:23:06.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.427+0000 7f4efa66b700 1 -- 172.21.15.156:0/3231494490 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee80094a0 con 0x7f4ef40a1380 2023-09-30T22:23:06.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.427+0000 7f4efa66b700 1 -- 172.21.15.156:0/3231494490 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef4125bd0 con 0x7f4ef40a1380 2023-09-30T22:23:06.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.428+0000 7f4ef0ff9700 1 -- 172.21.15.156:0/3231494490 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4ee8003a20 con 0x7f4ef40a1380 2023-09-30T22:23:06.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.428+0000 7f4ef0ff9700 1 -- 172.21.15.156:0/3231494490 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4ee8021070 con 0x7f4ef40a1380 2023-09-30T22:23:06.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.428+0000 7f4efa66b700 1 -- 172.21.15.156:0/3231494490 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef404f2a0 con 0x7f4ef40a1380 2023-09-30T22:23:06.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.434+0000 7f4ef0ff9700 1 -- 172.21.15.156:0/3231494490 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ee8003cd0 con 0x7f4ef40a1380 2023-09-30T22:23:06.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.450+0000 7f6347ba2700 1 Processor -- start 2023-09-30T22:23:06.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.450+0000 7f6347ba2700 1 -- start start 2023-09-30T22:23:06.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.451+0000 7f6347ba2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6340133ad0 0x7f6340133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.451+0000 7f6347ba2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f63401300a0 0x7f63401304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.451+0000 7f6347ba2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f63401309f0 0x7f634013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.451+0000 7f6347ba2700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634006b2d0 con 0x7f63401300a0 2023-09-30T22:23:06.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.451+0000 7f6347ba2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6340133610 con 0x7f6340133ad0 2023-09-30T22:23:06.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.451+0000 7f6347ba2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f634009a500 con 0x7f63401309f0 2023-09-30T22:23:06.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.451+0000 7f634593e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6340133ad0 0x7f6340133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.451+0000 7f634593e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6340133ad0 0x7f6340133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51814/0 (socket says 172.21.15.156:51814) 2023-09-30T22:23:06.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.451+0000 7f634593e700 1 -- 172.21.15.156:0/2283071878 learned_addr learned my addr 172.21.15.156:0/2283071878 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:06.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.451+0000 7f634513d700 1 --2- 172.21.15.156:0/2283071878 >> v2:172.21.15.156:3300/0 conn(0x7f63401300a0 0x7f63401304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.451+0000 7f634613f700 1 --2- 172.21.15.156:0/2283071878 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f63401309f0 0x7f634013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.451+0000 7f634513d700 1 -- 172.21.15.156:0/2283071878 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f63401309f0 msgr2=0x7f634013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:06.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.451+0000 7f634513d700 1 --2- 172.21.15.156:0/2283071878 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f63401309f0 0x7f634013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.451+0000 7f634513d700 1 -- 172.21.15.156:0/2283071878 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6340133ad0 msgr2=0x7f6340133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:06.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.451+0000 7f634513d700 1 --2- 172.21.15.156:0/2283071878 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6340133ad0 0x7f6340133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.451+0000 7f634513d700 1 -- 172.21.15.156:0/2283071878 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63401338b0 con 0x7f63401300a0 2023-09-30T22:23:06.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.451+0000 7f634593e700 1 --2- 172.21.15.156:0/2283071878 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6340133ad0 0x7f6340133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:06.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.451+0000 7f634513d700 1 --2- 172.21.15.156:0/2283071878 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63401300a0 0x7f63401304b0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f6330009840 tx=0x7f6330009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9822a252b315cc97 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:06.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.452+0000 7f634493c700 1 -- 172.21.15.156:0/2283071878 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6330011830 con 0x7f63401300a0 2023-09-30T22:23:06.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.452+0000 7f634493c700 1 -- 172.21.15.156:0/2283071878 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6330011990 con 0x7f63401300a0 2023-09-30T22:23:06.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.452+0000 7f634493c700 1 -- 172.21.15.156:0/2283071878 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6330011d20 con 0x7f63401300a0 2023-09-30T22:23:06.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.452+0000 7f6347ba2700 1 -- 172.21.15.156:0/2283071878 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63401300a0 msgr2=0x7f63401304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.452+0000 7f6347ba2700 1 --2- 172.21.15.156:0/2283071878 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63401300a0 0x7f63401304b0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f6330009840 tx=0x7f6330009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:06.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.452+0000 7f6347ba2700 1 -- 172.21.15.156:0/2283071878 shutdown_connections 2023-09-30T22:23:06.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.452+0000 7f6347ba2700 1 --2- 172.21.15.156:0/2283071878 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f63401309f0 0x7f634013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.452+0000 7f6347ba2700 1 --2- 172.21.15.156:0/2283071878 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6340133ad0 0x7f6340133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.452+0000 7f6347ba2700 1 --2- 172.21.15.156:0/2283071878 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63401300a0 0x7f63401304b0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.452+0000 7f6347ba2700 1 -- 172.21.15.156:0/2283071878 >> 172.21.15.156:0/2283071878 conn(0x7f6340099c40 msgr2=0x7f63400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:06.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.452+0000 7f6347ba2700 1 -- 172.21.15.156:0/2283071878 shutdown_connections 2023-09-30T22:23:06.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.452+0000 7f6347ba2700 1 -- 172.21.15.156:0/2283071878 wait complete. 2023-09-30T22:23:06.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.453+0000 7f6347ba2700 1 Processor -- start 2023-09-30T22:23:06.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.453+0000 7f6347ba2700 1 -- start start 2023-09-30T22:23:06.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.454+0000 7f6347ba2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63401300a0 0x7f634011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.454+0000 7f6347ba2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f63401309f0 0x7f634011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.454+0000 7f6347ba2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6340133ad0 0x7f634011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.454+0000 7f6347ba2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634011f5b0 con 0x7f6340133ad0 2023-09-30T22:23:06.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.454+0000 7f6347ba2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634012f800 con 0x7f63401300a0 2023-09-30T22:23:06.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.454+0000 7f6347ba2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f634012dd00 con 0x7f63401309f0 2023-09-30T22:23:06.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.454+0000 7f634613f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6340133ad0 0x7f634011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.454+0000 7f634593e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63401300a0 0x7f634011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.454+0000 7f634613f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6340133ad0 0x7f634011e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:45844/0 (socket says 172.21.15.156:45844) 2023-09-30T22:23:06.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.454+0000 7f634593e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63401300a0 0x7f634011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51816/0 (socket says 172.21.15.156:51816) 2023-09-30T22:23:06.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.454+0000 7f634613f700 1 -- 172.21.15.156:0/3514420911 learned_addr learned my addr 172.21.15.156:0/3514420911 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:06.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.454+0000 7f634513d700 1 --2- 172.21.15.156:0/3514420911 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f63401309f0 0x7f634011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.454+0000 7f634593e700 1 -- 172.21.15.156:0/3514420911 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f63401309f0 msgr2=0x7f634011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.454+0000 7f634593e700 1 --2- 172.21.15.156:0/3514420911 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f63401309f0 0x7f634011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.454+0000 7f634593e700 1 -- 172.21.15.156:0/3514420911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6340133ad0 msgr2=0x7f634011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.454+0000 7f634593e700 1 --2- 172.21.15.156:0/3514420911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6340133ad0 0x7f634011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.454+0000 7f634593e700 1 -- 172.21.15.156:0/3514420911 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c009550 con 0x7f63401300a0 2023-09-30T22:23:06.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.454+0000 7f634513d700 1 --2- 172.21.15.156:0/3514420911 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f63401309f0 0x7f634011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:06.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.455+0000 7f634593e700 1 --2- 172.21.15.156:0/3514420911 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63401300a0 0x7f634011da40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f633c00e9d0 tx=0x7f633c00ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:06.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.455+0000 7f63367fc700 1 -- 172.21.15.156:0/3514420911 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c004030 con 0x7f63401300a0 2023-09-30T22:23:06.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.455+0000 7f63367fc700 1 -- 172.21.15.156:0/3514420911 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c004190 con 0x7f63401300a0 2023-09-30T22:23:06.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.455+0000 7f6347ba2700 1 -- 172.21.15.156:0/3514420911 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63300094a0 con 0x7f63401300a0 2023-09-30T22:23:06.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.455+0000 7f63367fc700 1 -- 172.21.15.156:0/3514420911 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c004520 con 0x7f63401300a0 2023-09-30T22:23:06.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.455+0000 7f6347ba2700 1 -- 172.21.15.156:0/3514420911 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634011f920 con 0x7f63401300a0 2023-09-30T22:23:06.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.456+0000 7f63367fc700 1 -- 172.21.15.156:0/3514420911 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f633c00c850 con 0x7f63401300a0 2023-09-30T22:23:06.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.456+0000 7f63367fc700 1 -- 172.21.15.156:0/3514420911 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f633c03f590 con 0x7f63401300a0 2023-09-30T22:23:06.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.456+0000 7f6347ba2700 1 -- 172.21.15.156:0/3514420911 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634004f2a0 con 0x7f63401300a0 2023-09-30T22:23:06.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.461+0000 7f63367fc700 1 -- 172.21.15.156:0/3514420911 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f633c0036a0 con 0x7f63401300a0 2023-09-30T22:23:06.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.493+0000 7f627e242700 1 Processor -- start 2023-09-30T22:23:06.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.493+0000 7f627e242700 1 -- start start 2023-09-30T22:23:06.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.493+0000 7f627e242700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f627806cc70 0x7f62780a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.493+0000 7f627e242700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f62780a13e0 0x7f627813f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.493+0000 7f627e242700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627809df50 con 0x7f62780a0fb0 2023-09-30T22:23:06.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.493+0000 7f627e242700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627809cf30 con 0x7f62780a13e0 2023-09-30T22:23:06.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.493+0000 7f627e242700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62780a24a0 con 0x7f627806cc70 2023-09-30T22:23:06.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.494+0000 7f62777fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f627806cc70 0x7f62780a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.494+0000 7f6276ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f62780a0fb0 0x7f627813c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49324/0 (socket says 172.21.15.156:49324) 2023-09-30T22:23:06.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.494+0000 7f62777fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f627806cc70 0x7f62780a0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51826/0 (socket says 172.21.15.156:51826) 2023-09-30T22:23:06.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.494+0000 7f62777fe700 1 -- 172.21.15.156:0/1051089102 learned_addr learned my addr 172.21.15.156:0/1051089102 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:06.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.494+0000 7f6277fff700 1 --2- 172.21.15.156:0/1051089102 >> v2:172.21.15.156:3300/0 conn(0x7f62780a13e0 0x7f627813f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.494+0000 7f62777fe700 1 -- 172.21.15.156:0/1051089102 >> v2:172.21.15.156:3300/0 conn(0x7f62780a13e0 msgr2=0x7f627813f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:06.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.494+0000 7f62777fe700 1 --2- 172.21.15.156:0/1051089102 >> v2:172.21.15.156:3300/0 conn(0x7f62780a13e0 0x7f627813f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.494+0000 7f62777fe700 1 -- 172.21.15.156:0/1051089102 >> v1:172.21.15.156:6789/0 conn(0x7f62780a0fb0 legacy=0x7f627813c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.494+0000 7f62777fe700 1 -- 172.21.15.156:0/1051089102 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627809e1a0 con 0x7f627806cc70 2023-09-30T22:23:06.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.494+0000 7f62767fc700 1 -- 172.21.15.156:0/1051089102 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2888577977 0 0) 0x7f627809df50 con 0x7f62780a0fb0 2023-09-30T22:23:06.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.494+0000 7f6277fff700 1 --2- 172.21.15.156:0/1051089102 >> v2:172.21.15.156:3300/0 conn(0x7f62780a13e0 0x7f627813f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:06.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.494+0000 7f62777fe700 1 --2- 172.21.15.156:0/1051089102 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f627806cc70 0x7f62780a0a70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f62680098f0 tx=0x7f6268009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc0f94c475a4f01b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:06.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.494+0000 7f62767fc700 1 -- 172.21.15.156:0/1051089102 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6268011830 con 0x7f627806cc70 2023-09-30T22:23:06.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.494+0000 7f62767fc700 1 -- 172.21.15.156:0/1051089102 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6268011990 con 0x7f627806cc70 2023-09-30T22:23:06.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.494+0000 7f62767fc700 1 -- 172.21.15.156:0/1051089102 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6268011d20 con 0x7f627806cc70 2023-09-30T22:23:06.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.495+0000 7f627e242700 1 -- 172.21.15.156:0/1051089102 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f627806cc70 msgr2=0x7f62780a0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.495+0000 7f627e242700 1 --2- 172.21.15.156:0/1051089102 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f627806cc70 0x7f62780a0a70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f62680098f0 tx=0x7f6268009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:06.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.495+0000 7f627e242700 1 -- 172.21.15.156:0/1051089102 shutdown_connections 2023-09-30T22:23:06.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.495+0000 7f627e242700 1 --2- 172.21.15.156:0/1051089102 >> v2:172.21.15.156:3300/0 conn(0x7f62780a13e0 0x7f627813f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.495+0000 7f627e242700 1 --2- 172.21.15.156:0/1051089102 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f627806cc70 0x7f62780a0a70 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.495+0000 7f627e242700 1 -- 172.21.15.156:0/1051089102 >> 172.21.15.156:0/1051089102 conn(0x7f62780a6610 msgr2=0x7f62780a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:06.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.495+0000 7f627e242700 1 -- 172.21.15.156:0/1051089102 shutdown_connections 2023-09-30T22:23:06.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.495+0000 7f627e242700 1 -- 172.21.15.156:0/1051089102 wait complete. 2023-09-30T22:23:06.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.496+0000 7f627e242700 1 Processor -- start 2023-09-30T22:23:06.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.496+0000 7f627e242700 1 -- start start 2023-09-30T22:23:06.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.497+0000 7f627e242700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f627806cc70 0x7f627812f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.497+0000 7f627e242700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62780a0fb0 0x7f627812db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.497+0000 7f627e242700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62780a13e0 0x7f627812e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.497+0000 7f627e242700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62781347c0 con 0x7f627806cc70 2023-09-30T22:23:06.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.497+0000 7f627e242700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62780718d0 con 0x7f62780a13e0 2023-09-30T22:23:06.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.497+0000 7f627e242700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6278133140 con 0x7f62780a0fb0 2023-09-30T22:23:06.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.497+0000 7f62777fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f627806cc70 0x7f627812f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.497+0000 7f62777fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f627806cc70 0x7f627812f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:45852/0 (socket says 172.21.15.156:45852) 2023-09-30T22:23:06.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.497+0000 7f62777fe700 1 -- 172.21.15.156:0/2230733464 learned_addr learned my addr 172.21.15.156:0/2230733464 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:06.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.497+0000 7f6276ffd700 1 --2- 172.21.15.156:0/2230733464 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62780a0fb0 0x7f627812db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.497+0000 7f6277fff700 1 --2- 172.21.15.156:0/2230733464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62780a13e0 0x7f627812e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.497+0000 7f6276ffd700 1 -- 172.21.15.156:0/2230733464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62780a13e0 msgr2=0x7f627812e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.497+0000 7f6276ffd700 1 --2- 172.21.15.156:0/2230733464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62780a13e0 0x7f627812e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.497+0000 7f6276ffd700 1 -- 172.21.15.156:0/2230733464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f627806cc70 msgr2=0x7f627812f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.497+0000 7f6276ffd700 1 --2- 172.21.15.156:0/2230733464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f627806cc70 0x7f627812f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.497+0000 7f6276ffd700 1 -- 172.21.15.156:0/2230733464 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6270009a70 con 0x7f62780a0fb0 2023-09-30T22:23:06.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.497+0000 7f62777fe700 1 --2- 172.21.15.156:0/2230733464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f627806cc70 0x7f627812f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:06.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.498+0000 7f6276ffd700 1 --2- 172.21.15.156:0/2230733464 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62780a0fb0 0x7f627812db20 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f626c00c470 tx=0x7f626c00c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:06.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.498+0000 7f625ffff700 1 -- 172.21.15.156:0/2230733464 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c004c80 con 0x7f62780a0fb0 2023-09-30T22:23:06.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.498+0000 7f625ffff700 1 -- 172.21.15.156:0/2230733464 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c004de0 con 0x7f62780a0fb0 2023-09-30T22:23:06.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.498+0000 7f627e242700 1 -- 172.21.15.156:0/2230733464 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6268009550 con 0x7f62780a0fb0 2023-09-30T22:23:06.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.498+0000 7f625ffff700 1 -- 172.21.15.156:0/2230733464 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c007310 con 0x7f62780a0fb0 2023-09-30T22:23:06.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.498+0000 7f627e242700 1 -- 172.21.15.156:0/2230733464 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6278134aa0 con 0x7f62780a0fb0 2023-09-30T22:23:06.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.499+0000 7f625ffff700 1 -- 172.21.15.156:0/2230733464 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f626c007470 con 0x7f62780a0fb0 2023-09-30T22:23:06.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.499+0000 7f627e242700 1 -- 172.21.15.156:0/2230733464 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6278071e20 con 0x7f62780a0fb0 2023-09-30T22:23:06.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.499+0000 7f625ffff700 1 -- 172.21.15.156:0/2230733464 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f626c03f1d0 con 0x7f62780a0fb0 2023-09-30T22:23:06.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.504+0000 7f625ffff700 1 -- 172.21.15.156:0/2230733464 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f626c007720 con 0x7f62780a0fb0 2023-09-30T22:23:06.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.616+0000 7f104e1b0700 1 -- 172.21.15.156:0/3328582219 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f104811cbe0 con 0x7f1048099a60 2023-09-30T22:23:06.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.617+0000 7f102ffff700 1 -- 172.21.15.156:0/3328582219 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f103801c020 con 0x7f1048099a60 2023-09-30T22:23:06.618 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:06.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.619+0000 7f104e1b0700 1 -- 172.21.15.156:0/3328582219 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1048099a60 msgr2=0x7f1048119740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.619+0000 7f104e1b0700 1 --2- 172.21.15.156:0/3328582219 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1048099a60 0x7f1048119740 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f10380099b0 tx=0x7f1038009cc0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.619+0000 7f104e1b0700 1 -- 172.21.15.156:0/3328582219 shutdown_connections 2023-09-30T22:23:06.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.619+0000 7f104e1b0700 1 --2- 172.21.15.156:0/3328582219 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f104812d380 0x7f104811a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.619+0000 7f104e1b0700 1 --2- 172.21.15.156:0/3328582219 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1048099a60 0x7f1048119740 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.619+0000 7f104e1b0700 1 --2- 172.21.15.156:0/3328582219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f104809a5a0 0x7f1048119c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.619+0000 7f104e1b0700 1 -- 172.21.15.156:0/3328582219 >> 172.21.15.156:0/3328582219 conn(0x7f10480a2980 msgr2=0x7f104809fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:06.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.620+0000 7f104e1b0700 1 -- 172.21.15.156:0/3328582219 shutdown_connections 2023-09-30T22:23:06.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.620+0000 7f104e1b0700 1 -- 172.21.15.156:0/3328582219 wait complete. 2023-09-30T22:23:06.633 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:06.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.651+0000 7f4efa66b700 1 -- 172.21.15.156:0/3231494490 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4ef4072980 con 0x7f4ef40a1380 2023-09-30T22:23:06.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.651+0000 7f4ef0ff9700 1 -- 172.21.15.156:0/3231494490 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ee802b030 con 0x7f4ef40a1380 2023-09-30T22:23:06.652 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:06.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.653+0000 7f4efa66b700 1 -- 172.21.15.156:0/3231494490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ef40a1380 msgr2=0x7f4ef4122920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.653+0000 7f4efa66b700 1 --2- 172.21.15.156:0/3231494490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ef40a1380 0x7f4ef4122920 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8000c00 tx=0x7f4ee8004750 comp rx=0 tx=0).stop 2023-09-30T22:23:06.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.653+0000 7f4efa66b700 1 -- 172.21.15.156:0/3231494490 shutdown_connections 2023-09-30T22:23:06.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.653+0000 7f4efa66b700 1 --2- 172.21.15.156:0/3231494490 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ef4133f50 0x7f4ef4122e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.653+0000 7f4efa66b700 1 --2- 172.21.15.156:0/3231494490 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ef40a0a70 0x7f4ef41223e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.653+0000 7f4efa66b700 1 --2- 172.21.15.156:0/3231494490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ef40a1380 0x7f4ef4122920 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.653+0000 7f4efa66b700 1 -- 172.21.15.156:0/3231494490 >> 172.21.15.156:0/3231494490 conn(0x7f4ef40a6610 msgr2=0x7f4ef409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:06.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.653+0000 7f4efa66b700 1 -- 172.21.15.156:0/3231494490 shutdown_connections 2023-09-30T22:23:06.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.654+0000 7f4efa66b700 1 -- 172.21.15.156:0/3231494490 wait complete. 2023-09-30T22:23:06.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.655+0000 7f6347ba2700 1 -- 172.21.15.156:0/3514420911 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f63400a2fc0 con 0x7f63401300a0 2023-09-30T22:23:06.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.656+0000 7f63367fc700 1 -- 172.21.15.156:0/3514420911 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f633c019ab0 con 0x7f63401300a0 2023-09-30T22:23:06.656 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:06.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.658+0000 7f6347ba2700 1 -- 172.21.15.156:0/3514420911 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63401300a0 msgr2=0x7f634011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.658+0000 7f6347ba2700 1 --2- 172.21.15.156:0/3514420911 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63401300a0 0x7f634011da40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f633c00e9d0 tx=0x7f633c00ece0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.658+0000 7f6347ba2700 1 -- 172.21.15.156:0/3514420911 shutdown_connections 2023-09-30T22:23:06.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.658+0000 7f6347ba2700 1 --2- 172.21.15.156:0/3514420911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6340133ad0 0x7f634011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.658+0000 7f6347ba2700 1 --2- 172.21.15.156:0/3514420911 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63401300a0 0x7f634011da40 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.658+0000 7f6347ba2700 1 --2- 172.21.15.156:0/3514420911 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f63401309f0 0x7f634011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.658+0000 7f6347ba2700 1 -- 172.21.15.156:0/3514420911 >> 172.21.15.156:0/3514420911 conn(0x7f6340099c40 msgr2=0x7f634012e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:06.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.658+0000 7f6347ba2700 1 -- 172.21.15.156:0/3514420911 shutdown_connections 2023-09-30T22:23:06.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.658+0000 7f6347ba2700 1 -- 172.21.15.156:0/3514420911 wait complete. 2023-09-30T22:23:06.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:06.671 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:06.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.699+0000 7f627e242700 1 -- 172.21.15.156:0/2230733464 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6278134900 con 0x7f62780a0fb0 2023-09-30T22:23:06.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.700+0000 7f625ffff700 1 -- 172.21.15.156:0/2230733464 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6278134900 con 0x7f62780a0fb0 2023-09-30T22:23:06.700 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:06.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.702+0000 7f627e242700 1 -- 172.21.15.156:0/2230733464 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62780a0fb0 msgr2=0x7f627812db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.702+0000 7f627e242700 1 --2- 172.21.15.156:0/2230733464 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62780a0fb0 0x7f627812db20 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f626c00c470 tx=0x7f626c00c780 comp rx=0 tx=0).stop 2023-09-30T22:23:06.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.702+0000 7f627e242700 1 -- 172.21.15.156:0/2230733464 shutdown_connections 2023-09-30T22:23:06.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.702+0000 7f627e242700 1 --2- 172.21.15.156:0/2230733464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62780a13e0 0x7f627812e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.702+0000 7f627e242700 1 --2- 172.21.15.156:0/2230733464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f627806cc70 0x7f627812f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.702+0000 7f627e242700 1 --2- 172.21.15.156:0/2230733464 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62780a0fb0 0x7f627812db20 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.702+0000 7f627e242700 1 -- 172.21.15.156:0/2230733464 >> 172.21.15.156:0/2230733464 conn(0x7f62780a6610 msgr2=0x7f6278131b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:06.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.702+0000 7f627e242700 1 -- 172.21.15.156:0/2230733464 shutdown_connections 2023-09-30T22:23:06.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:06.702+0000 7f627e242700 1 -- 172.21.15.156:0/2230733464 wait complete. 2023-09-30T22:23:06.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:07.634 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:07.669 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:07.672 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:07.716 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:07.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.778+0000 7fb4090c9700 1 Processor -- start 2023-09-30T22:23:07.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.778+0000 7fb4090c9700 1 -- start start 2023-09-30T22:23:07.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.778+0000 7fb4090c9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb404133ad0 0x7fb404133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.778+0000 7fb4090c9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb404130bc0 0x7fb40413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.778+0000 7fb4090c9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb40406b2d0 con 0x7fb4041300a0 2023-09-30T22:23:07.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.778+0000 7fb4090c9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb404133610 con 0x7fb404130bc0 2023-09-30T22:23:07.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.778+0000 7fb4090c9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb40409a500 con 0x7fb404133ad0 2023-09-30T22:23:07.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.778+0000 7fb40359e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb404130bc0 0x7fb40413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.778+0000 7fb40359e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb404130bc0 0x7fb40413b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:45868/0 (socket says 172.21.15.156:45868) 2023-09-30T22:23:07.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.778+0000 7fb40359e700 1 -- 172.21.15.156:0/2416813949 learned_addr learned my addr 172.21.15.156:0/2416813949 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:07.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.779+0000 7fb402d9d700 1 --2- 172.21.15.156:0/2416813949 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb404133ad0 0x7fb404133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.779+0000 7fb402d9d700 1 -- 172.21.15.156:0/2416813949 >> v2:172.21.15.156:3300/0 conn(0x7fb404130bc0 msgr2=0x7fb40413b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:07.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.779+0000 7fb402d9d700 1 --2- 172.21.15.156:0/2416813949 >> v2:172.21.15.156:3300/0 conn(0x7fb404130bc0 0x7fb40413b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.779+0000 7fb402d9d700 1 -- 172.21.15.156:0/2416813949 >> v1:172.21.15.156:6789/0 conn(0x7fb4041300a0 legacy=0x7fb4041304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.779+0000 7fb401d9b700 1 -- 172.21.15.156:0/2416813949 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1837654027 0 0) 0x7fb40406b2d0 con 0x7fb4041300a0 2023-09-30T22:23:07.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.779+0000 7fb402d9d700 1 -- 172.21.15.156:0/2416813949 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4041338b0 con 0x7fb404133ad0 2023-09-30T22:23:07.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.779+0000 7fb40359e700 1 --2- 172.21.15.156:0/2416813949 >> v2:172.21.15.156:3300/0 conn(0x7fb404130bc0 0x7fb40413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:07.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.779+0000 7fb402d9d700 1 --2- 172.21.15.156:0/2416813949 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb404133ad0 0x7fb404133ea0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4009840 tx=0x7fb3f4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e2d27049406a01e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:07.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.780+0000 7fb401d9b700 1 -- 172.21.15.156:0/2416813949 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4011830 con 0x7fb404133ad0 2023-09-30T22:23:07.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.780+0000 7fb401d9b700 1 -- 172.21.15.156:0/2416813949 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f4011990 con 0x7fb404133ad0 2023-09-30T22:23:07.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.780+0000 7fb401d9b700 1 -- 172.21.15.156:0/2416813949 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4011d20 con 0x7fb404133ad0 2023-09-30T22:23:07.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.781+0000 7fb4090c9700 1 -- 172.21.15.156:0/2416813949 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb404133ad0 msgr2=0x7fb404133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.781+0000 7fb4090c9700 1 --2- 172.21.15.156:0/2416813949 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb404133ad0 0x7fb404133ea0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4009840 tx=0x7fb3f4009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:07.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.781+0000 7fb4090c9700 1 -- 172.21.15.156:0/2416813949 shutdown_connections 2023-09-30T22:23:07.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.781+0000 7fb4090c9700 1 --2- 172.21.15.156:0/2416813949 >> v2:172.21.15.156:3300/0 conn(0x7fb404130bc0 0x7fb40413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.781+0000 7fb4090c9700 1 --2- 172.21.15.156:0/2416813949 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb404133ad0 0x7fb404133ea0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.781+0000 7fb4090c9700 1 -- 172.21.15.156:0/2416813949 >> 172.21.15.156:0/2416813949 conn(0x7fb404099c40 msgr2=0x7fb4040a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:07.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.781+0000 7fb4090c9700 1 -- 172.21.15.156:0/2416813949 shutdown_connections 2023-09-30T22:23:07.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.781+0000 7fb4090c9700 1 -- 172.21.15.156:0/2416813949 wait complete. 2023-09-30T22:23:07.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.782+0000 7fb4090c9700 1 Processor -- start 2023-09-30T22:23:07.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.782+0000 7fb4090c9700 1 -- start start 2023-09-30T22:23:07.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.782+0000 7fb4090c9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4041300a0 0x7fb40411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.782+0000 7fb4090c9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb404130bc0 0x7fb40411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.783+0000 7fb4090c9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb404133ad0 0x7fb40411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.783+0000 7fb4090c9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb404120950 con 0x7fb4041300a0 2023-09-30T22:23:07.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.783+0000 7fb4090c9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb404072130 con 0x7fb404133ad0 2023-09-30T22:23:07.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.783+0000 7fb4090c9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040a3400 con 0x7fb404130bc0 2023-09-30T22:23:07.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.783+0000 7fb402d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4041300a0 0x7fb40411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.783+0000 7fb40259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb404130bc0 0x7fb40411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.783+0000 7fb402d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4041300a0 0x7fb40411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:45880/0 (socket says 172.21.15.156:45880) 2023-09-30T22:23:07.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.783+0000 7fb40259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb404130bc0 0x7fb40411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56838/0 (socket says 172.21.15.156:56838) 2023-09-30T22:23:07.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.783+0000 7fb402d9d700 1 -- 172.21.15.156:0/232754934 learned_addr learned my addr 172.21.15.156:0/232754934 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:07.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.783+0000 7fb40359e700 1 --2- 172.21.15.156:0/232754934 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb404133ad0 0x7fb40411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.783+0000 7fb402d9d700 1 -- 172.21.15.156:0/232754934 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb404130bc0 msgr2=0x7fb40411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.783+0000 7fb402d9d700 1 --2- 172.21.15.156:0/232754934 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb404130bc0 0x7fb40411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.783+0000 7fb402d9d700 1 -- 172.21.15.156:0/232754934 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb404133ad0 msgr2=0x7fb40411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.783+0000 7fb402d9d700 1 --2- 172.21.15.156:0/232754934 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb404133ad0 0x7fb40411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.783+0000 7fb402d9d700 1 -- 172.21.15.156:0/232754934 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3fc009b30 con 0x7fb4041300a0 2023-09-30T22:23:07.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.783+0000 7fb402d9d700 1 --2- 172.21.15.156:0/232754934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4041300a0 0x7fb40411da40 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40090b0 tx=0x7fb3f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:07.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.784+0000 7fb3eb7fe700 1 -- 172.21.15.156:0/232754934 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4004300 con 0x7fb4041300a0 2023-09-30T22:23:07.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.784+0000 7fb3eb7fe700 1 -- 172.21.15.156:0/232754934 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f401f070 con 0x7fb4041300a0 2023-09-30T22:23:07.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.784+0000 7fb4090c9700 1 -- 172.21.15.156:0/232754934 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f40094a0 con 0x7fb4041300a0 2023-09-30T22:23:07.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.784+0000 7fb3eb7fe700 1 -- 172.21.15.156:0/232754934 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f40036a0 con 0x7fb4041300a0 2023-09-30T22:23:07.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.784+0000 7fb4090c9700 1 -- 172.21.15.156:0/232754934 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40411fd00 con 0x7fb4041300a0 2023-09-30T22:23:07.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.785+0000 7fb3eb7fe700 1 -- 172.21.15.156:0/232754934 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb3f4021030 con 0x7fb4041300a0 2023-09-30T22:23:07.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.785+0000 7fb3eb7fe700 1 -- 172.21.15.156:0/232754934 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb3f4040610 con 0x7fb4041300a0 2023-09-30T22:23:07.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.785+0000 7fb4090c9700 1 -- 172.21.15.156:0/232754934 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb40404f2a0 con 0x7fb4041300a0 2023-09-30T22:23:07.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.790+0000 7fb3eb7fe700 1 -- 172.21.15.156:0/232754934 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb3f4015080 con 0x7fb4041300a0 2023-09-30T22:23:07.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.818+0000 7f7e1c269700 1 Processor -- start 2023-09-30T22:23:07.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.818+0000 7f7e1c269700 1 -- start start 2023-09-30T22:23:07.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.819+0000 7f7e1c269700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7e14133ad0 0x7f7e14133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.819+0000 7f7e1c269700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e141300a0 0x7f7e141304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.819+0000 7f7e1c269700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1406b2d0 con 0x7f7e141309f0 2023-09-30T22:23:07.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.819+0000 7f7e1c269700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e14133610 con 0x7f7e14133ad0 2023-09-30T22:23:07.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.819+0000 7f7e1c269700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1409a500 con 0x7f7e141300a0 2023-09-30T22:23:07.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.819+0000 7f7e1a005700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7e14133ad0 0x7f7e14133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.819+0000 7f7e1a806700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f7e141309f0 0x7f7e1413a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49352/0 (socket says 172.21.15.156:49352) 2023-09-30T22:23:07.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.819+0000 7f7e1a806700 1 -- 172.21.15.156:0/647308901 learned_addr learned my addr 172.21.15.156:0/647308901 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:07.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.819+0000 7f7e19804700 1 --2- 172.21.15.156:0/647308901 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e141300a0 0x7f7e141304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.819+0000 7f7e19003700 1 -- 172.21.15.156:0/647308901 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1088203072 0 0) 0x7f7e1406b2d0 con 0x7f7e141309f0 2023-09-30T22:23:07.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.819+0000 7f7e19003700 1 -- 172.21.15.156:0/647308901 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e0000bdc0 con 0x7f7e141309f0 2023-09-30T22:23:07.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.819+0000 7f7e1a005700 1 -- 172.21.15.156:0/647308901 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e141300a0 msgr2=0x7f7e141304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:07.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.819+0000 7f7e1a005700 1 --2- 172.21.15.156:0/647308901 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e141300a0 0x7f7e141304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.819+0000 7f7e1a005700 1 -- 172.21.15.156:0/647308901 >> v1:172.21.15.156:6789/0 conn(0x7f7e141309f0 legacy=0x7f7e1413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.819+0000 7f7e1a005700 1 -- 172.21.15.156:0/647308901 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e141338b0 con 0x7f7e14133ad0 2023-09-30T22:23:07.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.820+0000 7f7e1a005700 1 --2- 172.21.15.156:0/647308901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e14133ad0 0x7f7e14133ea0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f7e10009840 tx=0x7f7e10009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4124b9f31fc662a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:07.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.820+0000 7f7e19003700 1 -- 172.21.15.156:0/647308901 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e10004230 con 0x7f7e14133ad0 2023-09-30T22:23:07.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.820+0000 7f7e19003700 1 -- 172.21.15.156:0/647308901 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e10004390 con 0x7f7e14133ad0 2023-09-30T22:23:07.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.820+0000 7f7e19003700 1 -- 172.21.15.156:0/647308901 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e100036a0 con 0x7f7e14133ad0 2023-09-30T22:23:07.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.820+0000 7f7e1c269700 1 -- 172.21.15.156:0/647308901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e14133ad0 msgr2=0x7f7e14133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.820+0000 7f7e1c269700 1 --2- 172.21.15.156:0/647308901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e14133ad0 0x7f7e14133ea0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f7e10009840 tx=0x7f7e10009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:07.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.820+0000 7f7e1c269700 1 -- 172.21.15.156:0/647308901 shutdown_connections 2023-09-30T22:23:07.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.820+0000 7f7e1c269700 1 --2- 172.21.15.156:0/647308901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e14133ad0 0x7f7e14133ea0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.820+0000 7f7e1c269700 1 --2- 172.21.15.156:0/647308901 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e141300a0 0x7f7e141304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.820+0000 7f7e1c269700 1 -- 172.21.15.156:0/647308901 >> 172.21.15.156:0/647308901 conn(0x7f7e14099c40 msgr2=0x7f7e140a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:07.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.821+0000 7f7e1c269700 1 -- 172.21.15.156:0/647308901 shutdown_connections 2023-09-30T22:23:07.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.821+0000 7f7e1c269700 1 -- 172.21.15.156:0/647308901 wait complete. 2023-09-30T22:23:07.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.821+0000 7f7e1c269700 1 Processor -- start 2023-09-30T22:23:07.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.821+0000 7f7e1c269700 1 -- start start 2023-09-30T22:23:07.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.822+0000 7f7e1c269700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e141300a0 0x7f7e14071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.822+0000 7f7e1c269700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e141309f0 0x7f7e140716d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.822+0000 7f7e1c269700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e14133ad0 0x7f7e14071c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.822+0000 7f7e1c269700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1411a8e0 con 0x7f7e14133ad0 2023-09-30T22:23:07.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.822+0000 7f7e1c269700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e140a2ea0 con 0x7f7e141300a0 2023-09-30T22:23:07.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.822+0000 7f7e1c269700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e14119bc0 con 0x7f7e141309f0 2023-09-30T22:23:07.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.822+0000 7f7e1a005700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e141300a0 0x7f7e14071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.822+0000 7f7e1a005700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e141300a0 0x7f7e14071190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51878/0 (socket says 172.21.15.156:51878) 2023-09-30T22:23:07.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.822+0000 7f7e1a005700 1 -- 172.21.15.156:0/2027681011 learned_addr learned my addr 172.21.15.156:0/2027681011 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:07.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.822+0000 7f7e1a806700 1 --2- 172.21.15.156:0/2027681011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e14133ad0 0x7f7e14071c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.822+0000 7f7e19804700 1 --2- 172.21.15.156:0/2027681011 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e141309f0 0x7f7e140716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.822+0000 7f7e1a005700 1 -- 172.21.15.156:0/2027681011 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e141309f0 msgr2=0x7f7e140716d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.822+0000 7f7e1a005700 1 --2- 172.21.15.156:0/2027681011 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e141309f0 0x7f7e140716d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.822+0000 7f7e1a005700 1 -- 172.21.15.156:0/2027681011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e14133ad0 msgr2=0x7f7e14071c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.822+0000 7f7e1a005700 1 --2- 172.21.15.156:0/2027681011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e14133ad0 0x7f7e14071c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.822+0000 7f7e1a005700 1 -- 172.21.15.156:0/2027681011 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e100094a0 con 0x7f7e141300a0 2023-09-30T22:23:07.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.823+0000 7f7e1a005700 1 --2- 172.21.15.156:0/2027681011 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e141300a0 0x7f7e14071190 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7e10000c00 tx=0x7f7e10004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:07.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.823+0000 7f7e19804700 1 --2- 172.21.15.156:0/2027681011 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e141309f0 0x7f7e140716d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:07.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.823+0000 7f7e0affd700 1 -- 172.21.15.156:0/2027681011 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e10003d70 con 0x7f7e141300a0 2023-09-30T22:23:07.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.823+0000 7f7e0affd700 1 -- 172.21.15.156:0/2027681011 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e10011630 con 0x7f7e141300a0 2023-09-30T22:23:07.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.823+0000 7f7e0affd700 1 -- 172.21.15.156:0/2027681011 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e100119e0 con 0x7f7e141300a0 2023-09-30T22:23:07.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.823+0000 7f7e1c269700 1 -- 172.21.15.156:0/2027681011 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e1411a260 con 0x7f7e141300a0 2023-09-30T22:23:07.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.823+0000 7f7e1c269700 1 -- 172.21.15.156:0/2027681011 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1411b9c0 con 0x7f7e141300a0 2023-09-30T22:23:07.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.824+0000 7f7e1c269700 1 -- 172.21.15.156:0/2027681011 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1409cb20 con 0x7f7e141300a0 2023-09-30T22:23:07.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.824+0000 7f7e0affd700 1 -- 172.21.15.156:0/2027681011 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e10018040 con 0x7f7e141300a0 2023-09-30T22:23:07.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.824+0000 7f7e0affd700 1 -- 172.21.15.156:0/2027681011 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7e1003fe80 con 0x7f7e141300a0 2023-09-30T22:23:07.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.826+0000 7f9c924d9700 1 Processor -- start 2023-09-30T22:23:07.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.826+0000 7f9c924d9700 1 -- start start 2023-09-30T22:23:07.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.827+0000 7f9c924d9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9c8c099eb0 0x7f9c8c09a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.827+0000 7f9c924d9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c8c09a7c0 0x7f9c8c130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.827+0000 7f9c924d9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9c8c130890 0x7f9c8c130d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.827+0000 7f9c924d9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c8c09b930 con 0x7f9c8c130890 2023-09-30T22:23:07.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.827+0000 7f9c924d9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c072410 con 0x7f9c8c09a7c0 2023-09-30T22:23:07.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.827+0000 7f9c924d9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c09cd30 con 0x7f9c8c099eb0 2023-09-30T22:23:07.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.827+0000 7f9c8bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9c8c099eb0 0x7f9c8c09a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.827+0000 7f9c8bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9c8c099eb0 0x7f9c8c09a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56864/0 (socket says 172.21.15.156:56864) 2023-09-30T22:23:07.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.827+0000 7f9c8bfff700 1 -- 172.21.15.156:0/4268348233 learned_addr learned my addr 172.21.15.156:0/4268348233 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:07.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.827+0000 7f9c90a76700 1 --2- 172.21.15.156:0/4268348233 >> v2:172.21.15.156:3300/0 conn(0x7f9c8c130890 0x7f9c8c130d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.827+0000 7f9c8bfff700 1 -- 172.21.15.156:0/4268348233 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c8c09a7c0 msgr2=0x7f9c8c130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:07.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.827+0000 7f9c8bfff700 1 --2- 172.21.15.156:0/4268348233 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c8c09a7c0 0x7f9c8c130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.827+0000 7f9c8bfff700 1 -- 172.21.15.156:0/4268348233 >> v2:172.21.15.156:3300/0 conn(0x7f9c8c130890 msgr2=0x7f9c8c130d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:07.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.827+0000 7f9c8bfff700 1 --2- 172.21.15.156:0/4268348233 >> v2:172.21.15.156:3300/0 conn(0x7f9c8c130890 0x7f9c8c130d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.827+0000 7f9c8bfff700 1 -- 172.21.15.156:0/4268348233 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8c099a60 con 0x7f9c8c099eb0 2023-09-30T22:23:07.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.827+0000 7f9c90a76700 1 --2- 172.21.15.156:0/4268348233 >> v2:172.21.15.156:3300/0 conn(0x7f9c8c130890 0x7f9c8c130d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:07.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.828+0000 7f9c8bfff700 1 --2- 172.21.15.156:0/4268348233 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9c8c099eb0 0x7f9c8c09a280 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c006fd0 tx=0x7f9c7c010ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd9a33bcb71081e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:07.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.828+0000 7f9c8affd700 1 -- 172.21.15.156:0/4268348233 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c005a20 con 0x7f9c8c099eb0 2023-09-30T22:23:07.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.828+0000 7f9c8affd700 1 -- 172.21.15.156:0/4268348233 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7c005b80 con 0x7f9c8c099eb0 2023-09-30T22:23:07.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.828+0000 7f9c8affd700 1 -- 172.21.15.156:0/4268348233 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c004030 con 0x7f9c8c099eb0 2023-09-30T22:23:07.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.829+0000 7f9c924d9700 1 -- 172.21.15.156:0/4268348233 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9c8c099eb0 msgr2=0x7f9c8c09a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.829+0000 7f9c924d9700 1 --2- 172.21.15.156:0/4268348233 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9c8c099eb0 0x7f9c8c09a280 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c006fd0 tx=0x7f9c7c010ec0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.829+0000 7f9c924d9700 1 -- 172.21.15.156:0/4268348233 shutdown_connections 2023-09-30T22:23:07.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.829+0000 7f9c924d9700 1 --2- 172.21.15.156:0/4268348233 >> v2:172.21.15.156:3300/0 conn(0x7f9c8c130890 0x7f9c8c130d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.829+0000 7f9c924d9700 1 --2- 172.21.15.156:0/4268348233 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9c8c099eb0 0x7f9c8c09a280 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.829+0000 7f9c924d9700 1 --2- 172.21.15.156:0/4268348233 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c8c09a7c0 0x7f9c8c130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.829+0000 7f9c924d9700 1 -- 172.21.15.156:0/4268348233 >> 172.21.15.156:0/4268348233 conn(0x7f9c8c0a2980 msgr2=0x7f9c8c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:07.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.829+0000 7f9c924d9700 1 -- 172.21.15.156:0/4268348233 shutdown_connections 2023-09-30T22:23:07.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.829+0000 7f9c924d9700 1 -- 172.21.15.156:0/4268348233 wait complete. 2023-09-30T22:23:07.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.830+0000 7f9c924d9700 1 Processor -- start 2023-09-30T22:23:07.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.830+0000 7f9c924d9700 1 -- start start 2023-09-30T22:23:07.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.830+0000 7f9c924d9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c8c099eb0 0x7f9c8c11bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.830+0000 7f9c924d9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c8c09a7c0 0x7f9c8c11c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.830+0000 7f9c924d9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9c8c130890 0x7f9c8c11c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.830+0000 7f9c924d9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c09b490 con 0x7f9c8c09a7c0 2023-09-30T22:23:07.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.830+0000 7f9c924d9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c11f730 con 0x7f9c8c099eb0 2023-09-30T22:23:07.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.830+0000 7f9c924d9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c11f090 con 0x7f9c8c130890 2023-09-30T22:23:07.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.830+0000 7f9c8bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c8c099eb0 0x7f9c8c11bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.830+0000 7f9c8bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c8c099eb0 0x7f9c8c11bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51884/0 (socket says 172.21.15.156:51884) 2023-09-30T22:23:07.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.830+0000 7f9c8bfff700 1 -- 172.21.15.156:0/3322862660 learned_addr learned my addr 172.21.15.156:0/3322862660 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:07.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.831+0000 7f9c90a76700 1 --2- 172.21.15.156:0/3322862660 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9c8c130890 0x7f9c8c11c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.831+0000 7f9c8b7fe700 1 --2- 172.21.15.156:0/3322862660 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c8c09a7c0 0x7f9c8c11c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.831+0000 7f9c90a76700 1 -- 172.21.15.156:0/3322862660 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c8c099eb0 msgr2=0x7f9c8c11bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.831+0000 7f9c90a76700 1 --2- 172.21.15.156:0/3322862660 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c8c099eb0 0x7f9c8c11bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.831+0000 7f9c90a76700 1 -- 172.21.15.156:0/3322862660 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c8c09a7c0 msgr2=0x7f9c8c11c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.831+0000 7f9c90a76700 1 --2- 172.21.15.156:0/3322862660 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c8c09a7c0 0x7f9c8c11c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.831+0000 7f9c90a76700 1 -- 172.21.15.156:0/3322862660 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c84009a70 con 0x7f9c8c130890 2023-09-30T22:23:07.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.831+0000 7f9c8bfff700 1 --2- 172.21.15.156:0/3322862660 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c8c099eb0 0x7f9c8c11bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:07.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.831+0000 7f9c8b7fe700 1 --2- 172.21.15.156:0/3322862660 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c8c09a7c0 0x7f9c8c11c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:23:07.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.831+0000 7f9c90a76700 1 --2- 172.21.15.156:0/3322862660 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9c8c130890 0x7f9c8c11c6b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400efc0 tx=0x7f9c8400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:07.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.831+0000 7f9c88ff9700 1 -- 172.21.15.156:0/3322862660 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8400cb40 con 0x7f9c8c130890 2023-09-30T22:23:07.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.831+0000 7f9c88ff9700 1 -- 172.21.15.156:0/3322862660 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8400f040 con 0x7f9c8c130890 2023-09-30T22:23:07.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.831+0000 7f9c924d9700 1 -- 172.21.15.156:0/3322862660 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c7c0107f0 con 0x7f9c8c130890 2023-09-30T22:23:07.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.831+0000 7f9c88ff9700 1 -- 172.21.15.156:0/3322862660 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c84003a20 con 0x7f9c8c130890 2023-09-30T22:23:07.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.831+0000 7f9c924d9700 1 -- 172.21.15.156:0/3322862660 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c8c11def0 con 0x7f9c8c130890 2023-09-30T22:23:07.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.833+0000 7f9c924d9700 1 -- 172.21.15.156:0/3322862660 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8c11f570 con 0x7f9c8c130890 2023-09-30T22:23:07.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.833+0000 7f7e0affd700 1 -- 172.21.15.156:0/2027681011 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e10011b40 con 0x7f7e141300a0 2023-09-30T22:23:07.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.833+0000 7f9c88ff9700 1 -- 172.21.15.156:0/3322862660 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c84014480 con 0x7f9c8c130890 2023-09-30T22:23:07.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.833+0000 7f9c88ff9700 1 -- 172.21.15.156:0/3322862660 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9c84040910 con 0x7f9c8c130890 2023-09-30T22:23:07.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.838+0000 7f9c88ff9700 1 -- 172.21.15.156:0/3322862660 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c8401c3b0 con 0x7f9c8c130890 2023-09-30T22:23:07.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.864+0000 7fc9af487700 1 Processor -- start 2023-09-30T22:23:07.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.865+0000 7fc9af487700 1 -- start start 2023-09-30T22:23:07.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.865+0000 7fc9af487700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9a8133ad0 0x7fc9a8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.865+0000 7fc9af487700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc9a81300a0 0x7fc9a81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.865+0000 7fc9af487700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9a81309f0 0x7fc9a813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.865+0000 7fc9af487700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a806b2d0 con 0x7fc9a81300a0 2023-09-30T22:23:07.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.865+0000 7fc9af487700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a8133610 con 0x7fc9a81309f0 2023-09-30T22:23:07.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.865+0000 7fc9af487700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a809a500 con 0x7fc9a8133ad0 2023-09-30T22:23:07.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.865+0000 7fc9ad223700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9a8133ad0 0x7fc9a8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.865+0000 7fc9ad223700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9a8133ad0 0x7fc9a8133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56888/0 (socket says 172.21.15.156:56888) 2023-09-30T22:23:07.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.865+0000 7fc9ad223700 1 -- 172.21.15.156:0/1321504573 learned_addr learned my addr 172.21.15.156:0/1321504573 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:07.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.865+0000 7fc9aca22700 1 --2- 172.21.15.156:0/1321504573 >> v2:172.21.15.156:3300/0 conn(0x7fc9a81300a0 0x7fc9a81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.865+0000 7fc9ada24700 1 --2- 172.21.15.156:0/1321504573 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9a81309f0 0x7fc9a813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.866+0000 7fc9ad223700 1 -- 172.21.15.156:0/1321504573 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9a81309f0 msgr2=0x7fc9a813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:07.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.866+0000 7fc9ad223700 1 --2- 172.21.15.156:0/1321504573 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9a81309f0 0x7fc9a813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.866+0000 7fc9ad223700 1 -- 172.21.15.156:0/1321504573 >> v2:172.21.15.156:3300/0 conn(0x7fc9a81300a0 msgr2=0x7fc9a81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:07.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.866+0000 7fc9ad223700 1 --2- 172.21.15.156:0/1321504573 >> v2:172.21.15.156:3300/0 conn(0x7fc9a81300a0 0x7fc9a81304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.866+0000 7fc9ad223700 1 -- 172.21.15.156:0/1321504573 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a81338b0 con 0x7fc9a8133ad0 2023-09-30T22:23:07.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.866+0000 7fc9aca22700 1 --2- 172.21.15.156:0/1321504573 >> v2:172.21.15.156:3300/0 conn(0x7fc9a81300a0 0x7fc9a81304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:07.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.866+0000 7fc9ad223700 1 --2- 172.21.15.156:0/1321504573 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9a8133ad0 0x7fc9a8133ea0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40098f0 tx=0x7fc9a4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d849452b8396af6b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:07.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.866+0000 7fc99ffff700 1 -- 172.21.15.156:0/1321504573 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4011830 con 0x7fc9a8133ad0 2023-09-30T22:23:07.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.866+0000 7fc99ffff700 1 -- 172.21.15.156:0/1321504573 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a4011990 con 0x7fc9a8133ad0 2023-09-30T22:23:07.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.866+0000 7fc99ffff700 1 -- 172.21.15.156:0/1321504573 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4011d20 con 0x7fc9a8133ad0 2023-09-30T22:23:07.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.867+0000 7fc9af487700 1 -- 172.21.15.156:0/1321504573 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9a8133ad0 msgr2=0x7fc9a8133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.867+0000 7fc9af487700 1 --2- 172.21.15.156:0/1321504573 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9a8133ad0 0x7fc9a8133ea0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40098f0 tx=0x7fc9a4009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:07.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.867+0000 7fc9af487700 1 -- 172.21.15.156:0/1321504573 shutdown_connections 2023-09-30T22:23:07.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.867+0000 7fc9af487700 1 --2- 172.21.15.156:0/1321504573 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9a81309f0 0x7fc9a813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.867+0000 7fc9af487700 1 --2- 172.21.15.156:0/1321504573 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9a8133ad0 0x7fc9a8133ea0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.867+0000 7fc9af487700 1 --2- 172.21.15.156:0/1321504573 >> v2:172.21.15.156:3300/0 conn(0x7fc9a81300a0 0x7fc9a81304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.867+0000 7fc9af487700 1 -- 172.21.15.156:0/1321504573 >> 172.21.15.156:0/1321504573 conn(0x7fc9a8099c40 msgr2=0x7fc9a80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:07.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.867+0000 7fc9af487700 1 -- 172.21.15.156:0/1321504573 shutdown_connections 2023-09-30T22:23:07.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.867+0000 7fc9af487700 1 -- 172.21.15.156:0/1321504573 wait complete. 2023-09-30T22:23:07.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.868+0000 7fc9af487700 1 Processor -- start 2023-09-30T22:23:07.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.868+0000 7fc9af487700 1 -- start start 2023-09-30T22:23:07.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.868+0000 7fc9af487700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9a81300a0 0x7fc9a80713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.868+0000 7fc9af487700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9a81309f0 0x7fc9a8071900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.868+0000 7fc9af487700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9a8133ad0 0x7fc9a8071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.868+0000 7fc9af487700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a811e040 con 0x7fc9a81300a0 2023-09-30T22:23:07.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.868+0000 7fc9af487700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a8072820 con 0x7fc9a81309f0 2023-09-30T22:23:07.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.868+0000 7fc9af487700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a811eed0 con 0x7fc9a8133ad0 2023-09-30T22:23:07.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.868+0000 7fc9ad223700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9a81300a0 0x7fc9a80713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.868+0000 7fc9aca22700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9a81309f0 0x7fc9a8071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.868+0000 7fc9ad223700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9a81300a0 0x7fc9a80713c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:45944/0 (socket says 172.21.15.156:45944) 2023-09-30T22:23:07.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.868+0000 7fc9ad223700 1 -- 172.21.15.156:0/279694448 learned_addr learned my addr 172.21.15.156:0/279694448 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:07.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.869+0000 7fc9ada24700 1 --2- 172.21.15.156:0/279694448 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9a8133ad0 0x7fc9a8071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.869+0000 7fc9aca22700 1 -- 172.21.15.156:0/279694448 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9a8133ad0 msgr2=0x7fc9a8071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.869+0000 7fc9aca22700 1 --2- 172.21.15.156:0/279694448 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9a8133ad0 0x7fc9a8071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.869+0000 7fc9aca22700 1 -- 172.21.15.156:0/279694448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9a81300a0 msgr2=0x7fc9a80713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.869+0000 7fc9aca22700 1 --2- 172.21.15.156:0/279694448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9a81300a0 0x7fc9a80713c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.869+0000 7fc9aca22700 1 -- 172.21.15.156:0/279694448 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9980094a0 con 0x7fc9a81309f0 2023-09-30T22:23:07.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.869+0000 7fc9aca22700 1 --2- 172.21.15.156:0/279694448 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9a81309f0 0x7fc9a8071900 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc99800e9b0 tx=0x7fc99800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:07.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.869+0000 7fc99dffb700 1 -- 172.21.15.156:0/279694448 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99800ee50 con 0x7fc9a81309f0 2023-09-30T22:23:07.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.869+0000 7fc99dffb700 1 -- 172.21.15.156:0/279694448 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99800c850 con 0x7fc9a81309f0 2023-09-30T22:23:07.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.869+0000 7fc9af487700 1 -- 172.21.15.156:0/279694448 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a4009550 con 0x7fc9a81309f0 2023-09-30T22:23:07.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.869+0000 7fc99dffb700 1 -- 172.21.15.156:0/279694448 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99800cbe0 con 0x7fc9a81309f0 2023-09-30T22:23:07.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.870+0000 7fc9af487700 1 -- 172.21.15.156:0/279694448 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a80a33e0 con 0x7fc9a81309f0 2023-09-30T22:23:07.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.870+0000 7fc99dffb700 1 -- 172.21.15.156:0/279694448 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc99800cd40 con 0x7fc9a81309f0 2023-09-30T22:23:07.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.870+0000 7fc99dffb700 1 -- 172.21.15.156:0/279694448 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc99803fb90 con 0x7fc9a81309f0 2023-09-30T22:23:07.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.871+0000 7fc9af487700 1 -- 172.21.15.156:0/279694448 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a809cb20 con 0x7fc9a81309f0 2023-09-30T22:23:07.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:07.875+0000 7fc99dffb700 1 -- 172.21.15.156:0/279694448 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc99801b3b0 con 0x7fc9a81309f0 2023-09-30T22:23:08.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.025+0000 7f7e1c269700 1 -- 172.21.15.156:0/2027681011 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7e1404f2a0 con 0x7f7e141300a0 2023-09-30T22:23:08.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.026+0000 7f7e0affd700 1 -- 172.21.15.156:0/2027681011 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e1002a020 con 0x7f7e141300a0 2023-09-30T22:23:08.027 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:08.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.029+0000 7f7e1c269700 1 -- 172.21.15.156:0/2027681011 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e141300a0 msgr2=0x7f7e14071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:08.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.029+0000 7f7e1c269700 1 --2- 172.21.15.156:0/2027681011 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e141300a0 0x7f7e14071190 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7e10000c00 tx=0x7f7e10004750 comp rx=0 tx=0).stop 2023-09-30T22:23:08.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.029+0000 7f7e1c269700 1 -- 172.21.15.156:0/2027681011 shutdown_connections 2023-09-30T22:23:08.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.029+0000 7f7e1c269700 1 --2- 172.21.15.156:0/2027681011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e14133ad0 0x7f7e14071c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:08.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.029+0000 7f7e1c269700 1 --2- 172.21.15.156:0/2027681011 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7e141300a0 0x7f7e14071190 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:08.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.029+0000 7f7e1c269700 1 --2- 172.21.15.156:0/2027681011 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7e141309f0 0x7f7e140716d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:08.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.029+0000 7f7e1c269700 1 -- 172.21.15.156:0/2027681011 >> 172.21.15.156:0/2027681011 conn(0x7f7e14099c40 msgr2=0x7f7e14132a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:08.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.029+0000 7f7e1c269700 1 -- 172.21.15.156:0/2027681011 shutdown_connections 2023-09-30T22:23:08.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.029+0000 7f7e1c269700 1 -- 172.21.15.156:0/2027681011 wait complete. 2023-09-30T22:23:08.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:08.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.064+0000 7fb4090c9700 1 -- 172.21.15.156:0/232754934 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb40406c3b0 con 0x7fb4041300a0 2023-09-30T22:23:08.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.064+0000 7fb3eb7fe700 1 -- 172.21.15.156:0/232754934 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb3f40239c0 con 0x7fb4041300a0 2023-09-30T22:23:08.065 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:08.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.068+0000 7fb4090c9700 1 -- 172.21.15.156:0/232754934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4041300a0 msgr2=0x7fb40411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:08.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.068+0000 7fb4090c9700 1 --2- 172.21.15.156:0/232754934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4041300a0 0x7fb40411da40 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40090b0 tx=0x7fb3f4004750 comp rx=0 tx=0).stop 2023-09-30T22:23:08.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.068+0000 7fb4090c9700 1 -- 172.21.15.156:0/232754934 shutdown_connections 2023-09-30T22:23:08.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.068+0000 7fb4090c9700 1 --2- 172.21.15.156:0/232754934 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb404133ad0 0x7fb40411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:08.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.068+0000 7fb4090c9700 1 --2- 172.21.15.156:0/232754934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4041300a0 0x7fb40411da40 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:08.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.068+0000 7fb4090c9700 1 --2- 172.21.15.156:0/232754934 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb404130bc0 0x7fb40411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:08.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.068+0000 7fb4090c9700 1 -- 172.21.15.156:0/232754934 >> 172.21.15.156:0/232754934 conn(0x7fb404099c40 msgr2=0x7fb40412e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:08.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.068+0000 7fb4090c9700 1 -- 172.21.15.156:0/232754934 shutdown_connections 2023-09-30T22:23:08.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.068+0000 7fb4090c9700 1 -- 172.21.15.156:0/232754934 wait complete. 2023-09-30T22:23:08.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.068+0000 7fc9af487700 1 -- 172.21.15.156:0/279694448 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc9a804f2a0 con 0x7fc9a81309f0 2023-09-30T22:23:08.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.069+0000 7fc99dffb700 1 -- 172.21.15.156:0/279694448 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc99802b090 con 0x7fc9a81309f0 2023-09-30T22:23:08.072 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:08.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.071+0000 7fc9af487700 1 -- 172.21.15.156:0/279694448 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9a81309f0 msgr2=0x7fc9a8071900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:08.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.071+0000 7fc9af487700 1 --2- 172.21.15.156:0/279694448 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9a81309f0 0x7fc9a8071900 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc99800e9b0 tx=0x7fc99800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:23:08.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.071+0000 7fc9af487700 1 -- 172.21.15.156:0/279694448 shutdown_connections 2023-09-30T22:23:08.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.071+0000 7fc9af487700 1 --2- 172.21.15.156:0/279694448 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9a8133ad0 0x7fc9a8071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:08.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.071+0000 7fc9af487700 1 --2- 172.21.15.156:0/279694448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9a81300a0 0x7fc9a80713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:08.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.071+0000 7fc9af487700 1 --2- 172.21.15.156:0/279694448 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9a81309f0 0x7fc9a8071900 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:08.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.071+0000 7fc9af487700 1 -- 172.21.15.156:0/279694448 >> 172.21.15.156:0/279694448 conn(0x7fc9a8099c40 msgr2=0x7fc9a8132be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:08.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.072+0000 7fc9af487700 1 -- 172.21.15.156:0/279694448 shutdown_connections 2023-09-30T22:23:08.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.072+0000 7fc9af487700 1 -- 172.21.15.156:0/279694448 wait complete. 2023-09-30T22:23:08.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:08.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:08.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.114+0000 7f9c924d9700 1 -- 172.21.15.156:0/3322862660 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9c8c11f570 con 0x7f9c8c130890 2023-09-30T22:23:08.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.114+0000 7f9c88ff9700 1 -- 172.21.15.156:0/3322862660 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9c8c11f570 con 0x7f9c8c130890 2023-09-30T22:23:08.115 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:08.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.116+0000 7f9c924d9700 1 -- 172.21.15.156:0/3322862660 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9c8c130890 msgr2=0x7f9c8c11c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:08.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.116+0000 7f9c924d9700 1 --2- 172.21.15.156:0/3322862660 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9c8c130890 0x7f9c8c11c6b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400efc0 tx=0x7f9c8400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:08.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.116+0000 7f9c924d9700 1 -- 172.21.15.156:0/3322862660 shutdown_connections 2023-09-30T22:23:08.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.116+0000 7f9c924d9700 1 --2- 172.21.15.156:0/3322862660 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9c8c130890 0x7f9c8c11c6b0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:08.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.116+0000 7f9c924d9700 1 --2- 172.21.15.156:0/3322862660 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c8c099eb0 0x7f9c8c11bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:08.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.116+0000 7f9c924d9700 1 --2- 172.21.15.156:0/3322862660 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c8c09a7c0 0x7f9c8c11c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:08.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.116+0000 7f9c924d9700 1 -- 172.21.15.156:0/3322862660 >> 172.21.15.156:0/3322862660 conn(0x7f9c8c0a2980 msgr2=0x7f9c8c12f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:08.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.116+0000 7f9c924d9700 1 -- 172.21.15.156:0/3322862660 shutdown_connections 2023-09-30T22:23:08.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:08.116+0000 7f9c924d9700 1 -- 172.21.15.156:0/3322862660 wait complete. 2023-09-30T22:23:08.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:09.047 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:09.083 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:09.085 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:09.130 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:09.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.199+0000 7fae9d27a700 1 Processor -- start 2023-09-30T22:23:09.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.199+0000 7fae9d27a700 1 -- start start 2023-09-30T22:23:09.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.200+0000 7fae9d27a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fae9809f350 0x7fae98136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.200+0000 7fae9d27a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae981371c0 0x7fae981395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.200+0000 7fae9d27a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae9809c970 con 0x7fae9809e870 2023-09-30T22:23:09.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.200+0000 7fae9d27a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae980a0920 con 0x7fae9809f350 2023-09-30T22:23:09.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.200+0000 7fae9d27a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae9809f9c0 con 0x7fae981371c0 2023-09-30T22:23:09.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.200+0000 7fae977fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae981371c0 0x7fae981395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:09.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.200+0000 7fae977fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae981371c0 0x7fae981395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51912/0 (socket says 172.21.15.156:51912) 2023-09-30T22:23:09.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.200+0000 7fae977fe700 1 -- 172.21.15.156:0/2708895079 learned_addr learned my addr 172.21.15.156:0/2708895079 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:09.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.200+0000 7fae96ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fae9809e870 0x7fae9809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49368/0 (socket says 172.21.15.156:49368) 2023-09-30T22:23:09.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.200+0000 7fae967fc700 1 --2- 172.21.15.156:0/2708895079 >> v2:172.21.15.156:3300/0 conn(0x7fae9809f350 0x7fae98136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:09.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.201+0000 7fae977fe700 1 -- 172.21.15.156:0/2708895079 >> v2:172.21.15.156:3300/0 conn(0x7fae9809f350 msgr2=0x7fae98136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:09.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.201+0000 7fae977fe700 1 --2- 172.21.15.156:0/2708895079 >> v2:172.21.15.156:3300/0 conn(0x7fae9809f350 0x7fae98136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.201+0000 7fae977fe700 1 -- 172.21.15.156:0/2708895079 >> v1:172.21.15.156:6789/0 conn(0x7fae9809e870 legacy=0x7fae9809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.201+0000 7fae95ffb700 1 -- 172.21.15.156:0/2708895079 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3766276164 0 0) 0x7fae9809c970 con 0x7fae9809e870 2023-09-30T22:23:09.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.201+0000 7fae977fe700 1 -- 172.21.15.156:0/2708895079 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae9809bab0 con 0x7fae981371c0 2023-09-30T22:23:09.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.201+0000 7fae977fe700 1 --2- 172.21.15.156:0/2708895079 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae981371c0 0x7fae981395a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fae90009e50 tx=0x7fae9000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db6fdafc2b67f411 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:09.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.201+0000 7fae95ffb700 1 -- 172.21.15.156:0/2708895079 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9000e070 con 0x7fae981371c0 2023-09-30T22:23:09.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.201+0000 7fae95ffb700 1 -- 172.21.15.156:0/2708895079 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9000b910 con 0x7fae981371c0 2023-09-30T22:23:09.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.201+0000 7fae95ffb700 1 -- 172.21.15.156:0/2708895079 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9000bcc0 con 0x7fae981371c0 2023-09-30T22:23:09.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.202+0000 7fae9d27a700 1 -- 172.21.15.156:0/2708895079 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae981371c0 msgr2=0x7fae981395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.202+0000 7fae9d27a700 1 --2- 172.21.15.156:0/2708895079 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae981371c0 0x7fae981395a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fae90009e50 tx=0x7fae9000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:09.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.202+0000 7fae9d27a700 1 -- 172.21.15.156:0/2708895079 shutdown_connections 2023-09-30T22:23:09.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.202+0000 7fae9d27a700 1 --2- 172.21.15.156:0/2708895079 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae981371c0 0x7fae981395a0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.202+0000 7fae9d27a700 1 --2- 172.21.15.156:0/2708895079 >> v2:172.21.15.156:3300/0 conn(0x7fae9809f350 0x7fae98136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.202+0000 7fae9d27a700 1 -- 172.21.15.156:0/2708895079 >> 172.21.15.156:0/2708895079 conn(0x7fae980a4430 msgr2=0x7fae980a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:09.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.202+0000 7fae9d27a700 1 -- 172.21.15.156:0/2708895079 shutdown_connections 2023-09-30T22:23:09.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.202+0000 7fae9d27a700 1 -- 172.21.15.156:0/2708895079 wait complete. 2023-09-30T22:23:09.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.204+0000 7fae9d27a700 1 Processor -- start 2023-09-30T22:23:09.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.204+0000 7fae9d27a700 1 -- start start 2023-09-30T22:23:09.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.205+0000 7fae9d27a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae9809e870 0x7fae9806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.205+0000 7fae9d27a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae9809f350 0x7fae9806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.205+0000 7fae9d27a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae981371c0 0x7fae9806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.205+0000 7fae9d27a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9806cd80 con 0x7fae981371c0 2023-09-30T22:23:09.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.205+0000 7fae9d27a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae981263c0 con 0x7fae9809f350 2023-09-30T22:23:09.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.205+0000 7fae9d27a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae9806d4c0 con 0x7fae9809e870 2023-09-30T22:23:09.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.205+0000 7fae967fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae9809f350 0x7fae9806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:09.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.205+0000 7fae967fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae9809f350 0x7fae9806bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51918/0 (socket says 172.21.15.156:51918) 2023-09-30T22:23:09.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.205+0000 7fae967fc700 1 -- 172.21.15.156:0/330656863 learned_addr learned my addr 172.21.15.156:0/330656863 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:09.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.205+0000 7fae977fe700 1 --2- 172.21.15.156:0/330656863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae981371c0 0x7fae9806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:09.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.205+0000 7fae967fc700 1 -- 172.21.15.156:0/330656863 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae9809e870 msgr2=0x7fae9806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.205+0000 7fae967fc700 1 --2- 172.21.15.156:0/330656863 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae9809e870 0x7fae9806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.205+0000 7fae967fc700 1 -- 172.21.15.156:0/330656863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae981371c0 msgr2=0x7fae9806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.205+0000 7fae967fc700 1 --2- 172.21.15.156:0/330656863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae981371c0 0x7fae9806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.205+0000 7fae967fc700 1 -- 172.21.15.156:0/330656863 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae90009b30 con 0x7fae9809f350 2023-09-30T22:23:09.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.205+0000 7fae977fe700 1 --2- 172.21.15.156:0/330656863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae981371c0 0x7fae9806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:09.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.206+0000 7fae967fc700 1 --2- 172.21.15.156:0/330656863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae9809f350 0x7fae9806bdf0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fae8c00e9b0 tx=0x7fae8c00ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:09.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.206+0000 7fae7f7fe700 1 -- 172.21.15.156:0/330656863 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c009710 con 0x7fae9809f350 2023-09-30T22:23:09.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.206+0000 7fae7f7fe700 1 -- 172.21.15.156:0/330656863 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8c00c850 con 0x7fae9809f350 2023-09-30T22:23:09.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.206+0000 7fae7f7fe700 1 -- 172.21.15.156:0/330656863 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c00cbc0 con 0x7fae9809f350 2023-09-30T22:23:09.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.206+0000 7fae9d27a700 1 -- 172.21.15.156:0/330656863 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae98072190 con 0x7fae9809f350 2023-09-30T22:23:09.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.206+0000 7fae9d27a700 1 -- 172.21.15.156:0/330656863 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae9809dbf0 con 0x7fae9809f350 2023-09-30T22:23:09.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.207+0000 7fae9d27a700 1 -- 172.21.15.156:0/330656863 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae9804f2a0 con 0x7fae9809f350 2023-09-30T22:23:09.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.208+0000 7fae7f7fe700 1 -- 172.21.15.156:0/330656863 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fae8c00cd20 con 0x7fae9809f350 2023-09-30T22:23:09.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.208+0000 7fae7f7fe700 1 -- 172.21.15.156:0/330656863 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fae8c03fcc0 con 0x7fae9809f350 2023-09-30T22:23:09.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.212+0000 7fae7f7fe700 1 -- 172.21.15.156:0/330656863 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae8c01b3b0 con 0x7fae9809f350 2023-09-30T22:23:09.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.228+0000 7f3f0fc0a700 1 Processor -- start 2023-09-30T22:23:09.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.229+0000 7f3f0fc0a700 1 -- start start 2023-09-30T22:23:09.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.229+0000 7f3f0fc0a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f08099e20 0x7f3f0809a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.229+0000 7f3f0fc0a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f08130a60 0x7f3f08138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.229+0000 7f3f0fc0a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f08099a60 con 0x7f3f0809a730 2023-09-30T22:23:09.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.229+0000 7f3f0fc0a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0809bf50 con 0x7f3f08130a60 2023-09-30T22:23:09.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.229+0000 7f3f0fc0a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0809b230 con 0x7f3f08099e20 2023-09-30T22:23:09.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.229+0000 7f3f0d1a5700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f3f0809a730 0x7f3f08130350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49382/0 (socket says 172.21.15.156:49382) 2023-09-30T22:23:09.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.229+0000 7f3f0d1a5700 1 -- 172.21.15.156:0/1670715797 learned_addr learned my addr 172.21.15.156:0/1670715797 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:09.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.229+0000 7f3f0d9a6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f08099e20 0x7f3f0809a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:09.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.229+0000 7f3f0e1a7700 1 --2- 172.21.15.156:0/1670715797 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f08130a60 0x7f3f08138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:09.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.230+0000 7f3f0c9a4700 1 -- 172.21.15.156:0/1670715797 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 51349229 0 0) 0x7f3f08099a60 con 0x7f3f0809a730 2023-09-30T22:23:09.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.230+0000 7f3f0c9a4700 1 -- 172.21.15.156:0/1670715797 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ef40035b0 con 0x7f3f0809a730 2023-09-30T22:23:09.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.230+0000 7f3f0d9a6700 1 -- 172.21.15.156:0/1670715797 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f08130a60 msgr2=0x7f3f08138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:09.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.230+0000 7f3f0d9a6700 1 --2- 172.21.15.156:0/1670715797 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f08130a60 0x7f3f08138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.230+0000 7f3f0d9a6700 1 -- 172.21.15.156:0/1670715797 >> v1:172.21.15.156:6789/0 conn(0x7f3f0809a730 legacy=0x7f3f08130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.230+0000 7f3f0d9a6700 1 -- 172.21.15.156:0/1670715797 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0809bb90 con 0x7f3f08099e20 2023-09-30T22:23:09.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.230+0000 7f3f0d9a6700 1 --2- 172.21.15.156:0/1670715797 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f08099e20 0x7f3f0809a1f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f3f00009e10 tx=0x7f3f0000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cecff6003314741 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:09.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.230+0000 7f3f0c9a4700 1 -- 172.21.15.156:0/1670715797 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0000e070 con 0x7f3f08099e20 2023-09-30T22:23:09.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.230+0000 7f3f0c9a4700 1 -- 172.21.15.156:0/1670715797 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0000bb20 con 0x7f3f08099e20 2023-09-30T22:23:09.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.230+0000 7f3f0c9a4700 1 -- 172.21.15.156:0/1670715797 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f00012430 con 0x7f3f08099e20 2023-09-30T22:23:09.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.231+0000 7f3f0fc0a700 1 -- 172.21.15.156:0/1670715797 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f08099e20 msgr2=0x7f3f0809a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.231+0000 7f3f0fc0a700 1 --2- 172.21.15.156:0/1670715797 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f08099e20 0x7f3f0809a1f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f3f00009e10 tx=0x7f3f0000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:09.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.231+0000 7f3f0fc0a700 1 -- 172.21.15.156:0/1670715797 shutdown_connections 2023-09-30T22:23:09.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.231+0000 7f3f0fc0a700 1 --2- 172.21.15.156:0/1670715797 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f08130a60 0x7f3f08138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.231+0000 7f3f0fc0a700 1 --2- 172.21.15.156:0/1670715797 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f08099e20 0x7f3f0809a1f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.231+0000 7f3f0fc0a700 1 -- 172.21.15.156:0/1670715797 >> 172.21.15.156:0/1670715797 conn(0x7f3f080a2980 msgr2=0x7f3f080a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:09.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.231+0000 7f3f0fc0a700 1 -- 172.21.15.156:0/1670715797 shutdown_connections 2023-09-30T22:23:09.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.231+0000 7f3f0fc0a700 1 -- 172.21.15.156:0/1670715797 wait complete. 2023-09-30T22:23:09.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.232+0000 7f3f0fc0a700 1 Processor -- start 2023-09-30T22:23:09.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.232+0000 7f3f0fc0a700 1 -- start start 2023-09-30T22:23:09.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.232+0000 7f3f0fc0a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f08099e20 0x7f3f081c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.232+0000 7f3f0fc0a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f0809a730 0x7f3f081c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.232+0000 7f3f0fc0a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f08130a60 0x7f3f081c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.232+0000 7f3f0fc0a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0811a7d0 con 0x7f3f08130a60 2023-09-30T22:23:09.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.232+0000 7f3f0fc0a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0809b470 con 0x7f3f0809a730 2023-09-30T22:23:09.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.232+0000 7f3f0fc0a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0809d8f0 con 0x7f3f08099e20 2023-09-30T22:23:09.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.232+0000 7f3f0d9a6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f08099e20 0x7f3f081c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:09.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.232+0000 7f3f0d1a5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f0809a730 0x7f3f081c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:09.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.232+0000 7f3f0d9a6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f08099e20 0x7f3f081c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56906/0 (socket says 172.21.15.156:56906) 2023-09-30T22:23:09.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.232+0000 7f3f0d9a6700 1 -- 172.21.15.156:0/2717957404 learned_addr learned my addr 172.21.15.156:0/2717957404 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:09.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.233+0000 7f3f0e1a7700 1 --2- 172.21.15.156:0/2717957404 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f08130a60 0x7f3f081c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:09.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.233+0000 7f3f0d9a6700 1 -- 172.21.15.156:0/2717957404 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f0809a730 msgr2=0x7f3f081c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.233+0000 7f3f0d9a6700 1 --2- 172.21.15.156:0/2717957404 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f0809a730 0x7f3f081c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.233+0000 7f3f0d9a6700 1 -- 172.21.15.156:0/2717957404 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f08130a60 msgr2=0x7f3f081c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.233+0000 7f3f0d9a6700 1 --2- 172.21.15.156:0/2717957404 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f08130a60 0x7f3f081c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.233+0000 7f3f0d9a6700 1 -- 172.21.15.156:0/2717957404 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f00009a70 con 0x7f3f08099e20 2023-09-30T22:23:09.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.233+0000 7f3f0d1a5700 1 --2- 172.21.15.156:0/2717957404 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f0809a730 0x7f3f081c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:09.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.233+0000 7f3f0e1a7700 1 --2- 172.21.15.156:0/2717957404 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f08130a60 0x7f3f081c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:09.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.233+0000 7f3f0d9a6700 1 --2- 172.21.15.156:0/2717957404 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f08099e20 0x7f3f081c8100 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3f00014040 tx=0x7f3f00004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:09.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.233+0000 7f3efe7fc700 1 -- 172.21.15.156:0/2717957404 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f00012430 con 0x7f3f08099e20 2023-09-30T22:23:09.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.233+0000 7f3efe7fc700 1 -- 172.21.15.156:0/2717957404 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f00020070 con 0x7f3f08099e20 2023-09-30T22:23:09.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.233+0000 7f3f0fc0a700 1 -- 172.21.15.156:0/2717957404 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f0811fd70 con 0x7f3f08099e20 2023-09-30T22:23:09.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.233+0000 7f3efe7fc700 1 -- 172.21.15.156:0/2717957404 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f00012e70 con 0x7f3f08099e20 2023-09-30T22:23:09.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.233+0000 7f3f0fc0a700 1 -- 172.21.15.156:0/2717957404 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f080a13a0 con 0x7f3f08099e20 2023-09-30T22:23:09.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.234+0000 7f3efe7fc700 1 -- 172.21.15.156:0/2717957404 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f00004040 con 0x7f3f08099e20 2023-09-30T22:23:09.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.234+0000 7f3efe7fc700 1 -- 172.21.15.156:0/2717957404 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3f00022070 con 0x7f3f08099e20 2023-09-30T22:23:09.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.235+0000 7f3eebfff700 1 -- 172.21.15.156:0/2717957404 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee40052e0 con 0x7f3f08099e20 2023-09-30T22:23:09.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.239+0000 7f3efe7fc700 1 -- 172.21.15.156:0/2717957404 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f0001b400 con 0x7f3f08099e20 2023-09-30T22:23:09.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.248+0000 7f84246c7700 1 Processor -- start 2023-09-30T22:23:09.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.248+0000 7f84246c7700 1 -- start start 2023-09-30T22:23:09.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.249+0000 7f84246c7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f841c06a770 0x7f841c1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.249+0000 7f84246c7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f841c134a40 0x7f841c134eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.249+0000 7f84246c7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f841c137920 0x7f841c137d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.249+0000 7f84246c7700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f841c06ab40 con 0x7f841c134a40 2023-09-30T22:23:09.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.249+0000 7f84246c7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841c09b000 con 0x7f841c06a770 2023-09-30T22:23:09.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.249+0000 7f84246c7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f841c06b820 con 0x7f841c137920 2023-09-30T22:23:09.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.249+0000 7f8422c64700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f841c137920 0x7f841c137d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:09.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.249+0000 7f8422c64700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f841c137920 0x7f841c137d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56914/0 (socket says 172.21.15.156:56914) 2023-09-30T22:23:09.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.249+0000 7f8422c64700 1 -- 172.21.15.156:0/1606327250 learned_addr learned my addr 172.21.15.156:0/1606327250 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:09.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.249+0000 7f8422463700 1 --2- 172.21.15.156:0/1606327250 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f841c06a770 0x7f841c1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:09.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.249+0000 7f8422c64700 1 -- 172.21.15.156:0/1606327250 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f841c06a770 msgr2=0x7f841c1343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:09.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.249+0000 7f8422c64700 1 --2- 172.21.15.156:0/1606327250 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f841c06a770 0x7f841c1343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.249+0000 7f8422c64700 1 -- 172.21.15.156:0/1606327250 >> v2:172.21.15.156:3300/0 conn(0x7f841c134a40 msgr2=0x7f841c134eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:09.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.249+0000 7f8422c64700 1 --2- 172.21.15.156:0/1606327250 >> v2:172.21.15.156:3300/0 conn(0x7f841c134a40 0x7f841c134eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.249+0000 7f8422c64700 1 -- 172.21.15.156:0/1606327250 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f841c09eb80 con 0x7f841c137920 2023-09-30T22:23:09.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.249+0000 7f8422c64700 1 --2- 172.21.15.156:0/1606327250 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f841c137920 0x7f841c137d70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f8414009eb0 tx=0x7f841400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b5830fc48901ea9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:09.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.250+0000 7f8421461700 1 -- 172.21.15.156:0/1606327250 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841400e070 con 0x7f841c137920 2023-09-30T22:23:09.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.250+0000 7f8421461700 1 -- 172.21.15.156:0/1606327250 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841400b890 con 0x7f841c137920 2023-09-30T22:23:09.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.250+0000 7f8421461700 1 -- 172.21.15.156:0/1606327250 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841400bc40 con 0x7f841c137920 2023-09-30T22:23:09.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.250+0000 7f84246c7700 1 -- 172.21.15.156:0/1606327250 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f841c137920 msgr2=0x7f841c137d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.250+0000 7f84246c7700 1 --2- 172.21.15.156:0/1606327250 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f841c137920 0x7f841c137d70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f8414009eb0 tx=0x7f841400b330 comp rx=0 tx=0).stop 2023-09-30T22:23:09.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.250+0000 7f84246c7700 1 -- 172.21.15.156:0/1606327250 shutdown_connections 2023-09-30T22:23:09.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.250+0000 7f84246c7700 1 --2- 172.21.15.156:0/1606327250 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f841c137920 0x7f841c137d70 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.250+0000 7f84246c7700 1 --2- 172.21.15.156:0/1606327250 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f841c06a770 0x7f841c1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.250+0000 7f84246c7700 1 --2- 172.21.15.156:0/1606327250 >> v2:172.21.15.156:3300/0 conn(0x7f841c134a40 0x7f841c134eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.250+0000 7f84246c7700 1 -- 172.21.15.156:0/1606327250 >> 172.21.15.156:0/1606327250 conn(0x7f841c0a2ef0 msgr2=0x7f841c0a32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:09.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.250+0000 7f84246c7700 1 -- 172.21.15.156:0/1606327250 shutdown_connections 2023-09-30T22:23:09.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.251+0000 7f84246c7700 1 -- 172.21.15.156:0/1606327250 wait complete. 2023-09-30T22:23:09.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.251+0000 7f84246c7700 1 Processor -- start 2023-09-30T22:23:09.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.251+0000 7f84246c7700 1 -- start start 2023-09-30T22:23:09.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.252+0000 7f84246c7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f841c06a770 0x7f841c11a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.252+0000 7f84246c7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f841c134a40 0x7f841c11aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.252+0000 7f84246c7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f841c137920 0x7f841c11b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.252+0000 7f84246c7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841c126560 con 0x7f841c137920 2023-09-30T22:23:09.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.252+0000 7f84246c7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841c09f200 con 0x7f841c134a40 2023-09-30T22:23:09.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.252+0000 7f84246c7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f841c126760 con 0x7f841c06a770 2023-09-30T22:23:09.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.252+0000 7f8422463700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f841c06a770 0x7f841c11a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:09.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.252+0000 7f8422463700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f841c06a770 0x7f841c11a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56924/0 (socket says 172.21.15.156:56924) 2023-09-30T22:23:09.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.252+0000 7f8422463700 1 -- 172.21.15.156:0/2190638894 learned_addr learned my addr 172.21.15.156:0/2190638894 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:09.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.252+0000 7f8422463700 1 -- 172.21.15.156:0/2190638894 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f841c134a40 msgr2=0x7f841c11aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.252+0000 7f8422463700 1 --2- 172.21.15.156:0/2190638894 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f841c134a40 0x7f841c11aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.252+0000 7f8422463700 1 -- 172.21.15.156:0/2190638894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f841c137920 msgr2=0x7f841c11b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.252+0000 7f8422463700 1 --2- 172.21.15.156:0/2190638894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f841c137920 0x7f841c11b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.252+0000 7f8422463700 1 -- 172.21.15.156:0/2190638894 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8414009b30 con 0x7f841c06a770 2023-09-30T22:23:09.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.252+0000 7f8422463700 1 --2- 172.21.15.156:0/2190638894 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f841c06a770 0x7f841c11a590 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f841800e9e0 tx=0x7f841800eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:09.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.253+0000 7f8412ffd700 1 -- 172.21.15.156:0/2190638894 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8418009710 con 0x7f841c06a770 2023-09-30T22:23:09.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.253+0000 7f8412ffd700 1 -- 172.21.15.156:0/2190638894 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841800c850 con 0x7f841c06a770 2023-09-30T22:23:09.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.253+0000 7f84246c7700 1 -- 172.21.15.156:0/2190638894 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f841c1340b0 con 0x7f841c06a770 2023-09-30T22:23:09.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.253+0000 7f8412ffd700 1 -- 172.21.15.156:0/2190638894 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841800cbc0 con 0x7f841c06a770 2023-09-30T22:23:09.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.253+0000 7f84246c7700 1 -- 172.21.15.156:0/2190638894 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f841c11d410 con 0x7f841c06a770 2023-09-30T22:23:09.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.253+0000 7f8412ffd700 1 -- 172.21.15.156:0/2190638894 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f841800cd20 con 0x7f841c06a770 2023-09-30T22:23:09.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.254+0000 7f8412ffd700 1 -- 172.21.15.156:0/2190638894 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f84180421c0 con 0x7f841c06a770 2023-09-30T22:23:09.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.254+0000 7f84246c7700 1 -- 172.21.15.156:0/2190638894 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f841c04f2a0 con 0x7f841c06a770 2023-09-30T22:23:09.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.259+0000 7f8412ffd700 1 -- 172.21.15.156:0/2190638894 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8418017020 con 0x7f841c06a770 2023-09-30T22:23:09.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.270+0000 7f8762826700 1 Processor -- start 2023-09-30T22:23:09.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.270+0000 7f8762826700 1 -- start start 2023-09-30T22:23:09.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.271+0000 7f8762826700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f875c133ad0 0x7f875c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.271+0000 7f8762826700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f875c1300a0 0x7f875c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.271+0000 7f8762826700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f875c1309f0 0x7f875c13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.271+0000 7f8762826700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f875c06b2d0 con 0x7f875c1309f0 2023-09-30T22:23:09.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.271+0000 7f8762826700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f875c133610 con 0x7f875c1300a0 2023-09-30T22:23:09.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.271+0000 7f8762826700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f875c09a500 con 0x7f875c133ad0 2023-09-30T22:23:09.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.271+0000 7f8760dc3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f875c1309f0 0x7f875c13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:09.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.271+0000 7f8760dc3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f875c1309f0 0x7f875c13a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:45994/0 (socket says 172.21.15.156:45994) 2023-09-30T22:23:09.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.271+0000 7f8760dc3700 1 -- 172.21.15.156:0/942710924 learned_addr learned my addr 172.21.15.156:0/942710924 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:09.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.271+0000 7f875bfff700 1 --2- 172.21.15.156:0/942710924 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f875c133ad0 0x7f875c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:09.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.271+0000 7f875b7fe700 1 --2- 172.21.15.156:0/942710924 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f875c1300a0 0x7f875c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:09.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.271+0000 7f8760dc3700 1 -- 172.21.15.156:0/942710924 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f875c133ad0 msgr2=0x7f875c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:09.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.271+0000 7f8760dc3700 1 --2- 172.21.15.156:0/942710924 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f875c133ad0 0x7f875c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.271+0000 7f8760dc3700 1 -- 172.21.15.156:0/942710924 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f875c1300a0 msgr2=0x7f875c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:09.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.271+0000 7f8760dc3700 1 --2- 172.21.15.156:0/942710924 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f875c1300a0 0x7f875c1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.271+0000 7f8760dc3700 1 -- 172.21.15.156:0/942710924 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875c1338b0 con 0x7f875c1309f0 2023-09-30T22:23:09.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.271+0000 7f875b7fe700 1 --2- 172.21.15.156:0/942710924 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f875c1300a0 0x7f875c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:09.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.272+0000 7f8760dc3700 1 --2- 172.21.15.156:0/942710924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f875c1309f0 0x7f875c13a980 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f8754009e50 tx=0x7f875400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362ec22796df10cb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:09.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.272+0000 7f875affd700 1 -- 172.21.15.156:0/942710924 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875400e070 con 0x7f875c1309f0 2023-09-30T22:23:09.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.272+0000 7f875affd700 1 -- 172.21.15.156:0/942710924 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875400b910 con 0x7f875c1309f0 2023-09-30T22:23:09.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.272+0000 7f875affd700 1 -- 172.21.15.156:0/942710924 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875400bcc0 con 0x7f875c1309f0 2023-09-30T22:23:09.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.272+0000 7f8762826700 1 -- 172.21.15.156:0/942710924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f875c1309f0 msgr2=0x7f875c13a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.272+0000 7f8762826700 1 --2- 172.21.15.156:0/942710924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f875c1309f0 0x7f875c13a980 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f8754009e50 tx=0x7f875400b330 comp rx=0 tx=0).stop 2023-09-30T22:23:09.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.273+0000 7f8762826700 1 -- 172.21.15.156:0/942710924 shutdown_connections 2023-09-30T22:23:09.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.273+0000 7f8762826700 1 --2- 172.21.15.156:0/942710924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f875c1309f0 0x7f875c13a980 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.273+0000 7f8762826700 1 --2- 172.21.15.156:0/942710924 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f875c133ad0 0x7f875c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.273+0000 7f8762826700 1 --2- 172.21.15.156:0/942710924 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f875c1300a0 0x7f875c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.273+0000 7f8762826700 1 -- 172.21.15.156:0/942710924 >> 172.21.15.156:0/942710924 conn(0x7f875c099c40 msgr2=0x7f875c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:09.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.273+0000 7f8762826700 1 -- 172.21.15.156:0/942710924 shutdown_connections 2023-09-30T22:23:09.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.273+0000 7f8762826700 1 -- 172.21.15.156:0/942710924 wait complete. 2023-09-30T22:23:09.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.274+0000 7f8762826700 1 Processor -- start 2023-09-30T22:23:09.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.274+0000 7f8762826700 1 -- start start 2023-09-30T22:23:09.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.275+0000 7f8762826700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f875c1300a0 0x7f875c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.275+0000 7f8762826700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f875c1309f0 0x7f875c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.275+0000 7f875b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f875c1309f0 0x7f875c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:09.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.275+0000 7f875b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f875c1309f0 0x7f875c11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51978/0 (socket says 172.21.15.156:51978) 2023-09-30T22:23:09.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.275+0000 7f875bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f875c1300a0 0x7f875c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:09.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.275+0000 7f875bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f875c1300a0 0x7f875c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:46002/0 (socket says 172.21.15.156:46002) 2023-09-30T22:23:09.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.275+0000 7f8762826700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f875c133ad0 0x7f875c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.275+0000 7f875b7fe700 1 -- 172.21.15.156:0/2574793212 learned_addr learned my addr 172.21.15.156:0/2574793212 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:09.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.275+0000 7f8762826700 1 -- 172.21.15.156:0/2574793212 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875c11f9a0 con 0x7f875c1300a0 2023-09-30T22:23:09.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.275+0000 7f8762826700 1 -- 172.21.15.156:0/2574793212 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f875c12d380 con 0x7f875c1309f0 2023-09-30T22:23:09.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.275+0000 7f8762826700 1 -- 172.21.15.156:0/2574793212 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f875c120300 con 0x7f875c133ad0 2023-09-30T22:23:09.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.275+0000 7f8760dc3700 1 --2- 172.21.15.156:0/2574793212 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f875c133ad0 0x7f875c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:09.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.275+0000 7f875bfff700 1 -- 172.21.15.156:0/2574793212 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f875c133ad0 msgr2=0x7f875c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.275+0000 7f875bfff700 1 --2- 172.21.15.156:0/2574793212 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f875c133ad0 0x7f875c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.275+0000 7f875bfff700 1 -- 172.21.15.156:0/2574793212 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f875c1309f0 msgr2=0x7f875c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.275+0000 7f875bfff700 1 --2- 172.21.15.156:0/2574793212 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f875c1309f0 0x7f875c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.275+0000 7f875bfff700 1 -- 172.21.15.156:0/2574793212 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87500094a0 con 0x7f875c1300a0 2023-09-30T22:23:09.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.276+0000 7f875bfff700 1 --2- 172.21.15.156:0/2574793212 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f875c1300a0 0x7f875c11da40 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f874c00e930 tx=0x7f874c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:09.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.276+0000 7f8758ff9700 1 -- 172.21.15.156:0/2574793212 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c00ee80 con 0x7f875c1300a0 2023-09-30T22:23:09.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.276+0000 7f8758ff9700 1 -- 172.21.15.156:0/2574793212 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874c00c7f0 con 0x7f875c1300a0 2023-09-30T22:23:09.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.276+0000 7f8762826700 1 -- 172.21.15.156:0/2574793212 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8754009b30 con 0x7f875c1300a0 2023-09-30T22:23:09.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.276+0000 7f8758ff9700 1 -- 172.21.15.156:0/2574793212 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c00cb60 con 0x7f875c1300a0 2023-09-30T22:23:09.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.276+0000 7f8762826700 1 -- 172.21.15.156:0/2574793212 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f875c12dd00 con 0x7f875c1300a0 2023-09-30T22:23:09.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.277+0000 7f8762826700 1 -- 172.21.15.156:0/2574793212 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f875c04f2a0 con 0x7f875c1300a0 2023-09-30T22:23:09.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.277+0000 7f8758ff9700 1 -- 172.21.15.156:0/2574793212 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f874c00ccc0 con 0x7f875c1300a0 2023-09-30T22:23:09.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.277+0000 7f8758ff9700 1 -- 172.21.15.156:0/2574793212 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f874c03f6a0 con 0x7f875c1300a0 2023-09-30T22:23:09.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.286+0000 7f8758ff9700 1 -- 172.21.15.156:0/2574793212 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f874c0232f0 con 0x7f875c1300a0 2023-09-30T22:23:09.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.440+0000 7f3eebfff700 1 -- 172.21.15.156:0/2717957404 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3ee4005590 con 0x7f3f08099e20 2023-09-30T22:23:09.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.441+0000 7f3efe7fc700 1 -- 172.21.15.156:0/2717957404 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f0002c020 con 0x7f3f08099e20 2023-09-30T22:23:09.442 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:09.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.443+0000 7f3eebfff700 1 -- 172.21.15.156:0/2717957404 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f08099e20 msgr2=0x7f3f081c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.443+0000 7f3eebfff700 1 --2- 172.21.15.156:0/2717957404 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f08099e20 0x7f3f081c8100 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3f00014040 tx=0x7f3f00004ad0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.443+0000 7f3eebfff700 1 -- 172.21.15.156:0/2717957404 shutdown_connections 2023-09-30T22:23:09.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.443+0000 7f3eebfff700 1 --2- 172.21.15.156:0/2717957404 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f08130a60 0x7f3f081c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.443+0000 7f3eebfff700 1 --2- 172.21.15.156:0/2717957404 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3f08099e20 0x7f3f081c8100 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.443+0000 7f3eebfff700 1 --2- 172.21.15.156:0/2717957404 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f0809a730 0x7f3f081c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.443+0000 7f3eebfff700 1 -- 172.21.15.156:0/2717957404 >> 172.21.15.156:0/2717957404 conn(0x7f3f080a2980 msgr2=0x7f3f0812f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:09.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.443+0000 7f3eebfff700 1 -- 172.21.15.156:0/2717957404 shutdown_connections 2023-09-30T22:23:09.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.443+0000 7f3eebfff700 1 -- 172.21.15.156:0/2717957404 wait complete. 2023-09-30T22:23:09.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.444+0000 7fae9d27a700 1 -- 172.21.15.156:0/330656863 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fae9806b2a0 con 0x7fae9809f350 2023-09-30T22:23:09.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.445+0000 7fae7f7fe700 1 -- 172.21.15.156:0/330656863 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fae8c017070 con 0x7fae9809f350 2023-09-30T22:23:09.445 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:09.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.448+0000 7fae9d27a700 1 -- 172.21.15.156:0/330656863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae9809f350 msgr2=0x7fae9806bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.448+0000 7fae9d27a700 1 --2- 172.21.15.156:0/330656863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae9809f350 0x7fae9806bdf0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fae8c00e9b0 tx=0x7fae8c00ed70 comp rx=0 tx=0).stop 2023-09-30T22:23:09.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.448+0000 7fae9d27a700 1 -- 172.21.15.156:0/330656863 shutdown_connections 2023-09-30T22:23:09.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.448+0000 7fae9d27a700 1 --2- 172.21.15.156:0/330656863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae981371c0 0x7fae9806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.448+0000 7fae9d27a700 1 --2- 172.21.15.156:0/330656863 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae9809e870 0x7fae9806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.448+0000 7fae9d27a700 1 --2- 172.21.15.156:0/330656863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae9809f350 0x7fae9806bdf0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.448+0000 7fae9d27a700 1 -- 172.21.15.156:0/330656863 >> 172.21.15.156:0/330656863 conn(0x7fae980a4430 msgr2=0x7fae980a2870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:09.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.448+0000 7fae9d27a700 1 -- 172.21.15.156:0/330656863 shutdown_connections 2023-09-30T22:23:09.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.448+0000 7fae9d27a700 1 -- 172.21.15.156:0/330656863 wait complete. 2023-09-30T22:23:09.457 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:09.467 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:09.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.481+0000 7f8762826700 1 -- 172.21.15.156:0/2574793212 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f875c12f670 con 0x7f875c1300a0 2023-09-30T22:23:09.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.481+0000 7f8758ff9700 1 -- 172.21.15.156:0/2574793212 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f874c021020 con 0x7f875c1300a0 2023-09-30T22:23:09.482 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:09.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.484+0000 7f8762826700 1 -- 172.21.15.156:0/2574793212 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f875c1300a0 msgr2=0x7f875c11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.484+0000 7f8762826700 1 --2- 172.21.15.156:0/2574793212 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f875c1300a0 0x7f875c11da40 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f874c00e930 tx=0x7f874c00ec40 comp rx=0 tx=0).stop 2023-09-30T22:23:09.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.484+0000 7f8762826700 1 -- 172.21.15.156:0/2574793212 shutdown_connections 2023-09-30T22:23:09.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.484+0000 7f8762826700 1 --2- 172.21.15.156:0/2574793212 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f875c133ad0 0x7f875c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.484+0000 7f8762826700 1 --2- 172.21.15.156:0/2574793212 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f875c1300a0 0x7f875c11da40 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.484+0000 7f8762826700 1 --2- 172.21.15.156:0/2574793212 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f875c1309f0 0x7f875c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.484+0000 7f8762826700 1 -- 172.21.15.156:0/2574793212 >> 172.21.15.156:0/2574793212 conn(0x7f875c099c40 msgr2=0x7f875c12e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:09.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.484+0000 7f8762826700 1 -- 172.21.15.156:0/2574793212 shutdown_connections 2023-09-30T22:23:09.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.484+0000 7f8762826700 1 -- 172.21.15.156:0/2574793212 wait complete. 2023-09-30T22:23:09.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.484+0000 7f84246c7700 1 -- 172.21.15.156:0/2190638894 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f841c06c300 con 0x7f841c06a770 2023-09-30T22:23:09.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.484+0000 7f8412ffd700 1 -- 172.21.15.156:0/2190638894 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8418044060 con 0x7f841c06a770 2023-09-30T22:23:09.486 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:09.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.487+0000 7f84246c7700 1 -- 172.21.15.156:0/2190638894 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f841c06a770 msgr2=0x7f841c11a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.487+0000 7f84246c7700 1 --2- 172.21.15.156:0/2190638894 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f841c06a770 0x7f841c11a590 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f841800e9e0 tx=0x7f841800eda0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.487+0000 7f84246c7700 1 -- 172.21.15.156:0/2190638894 shutdown_connections 2023-09-30T22:23:09.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.487+0000 7f84246c7700 1 --2- 172.21.15.156:0/2190638894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f841c137920 0x7f841c11b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.487+0000 7f84246c7700 1 --2- 172.21.15.156:0/2190638894 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f841c06a770 0x7f841c11a590 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.487+0000 7f84246c7700 1 --2- 172.21.15.156:0/2190638894 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f841c134a40 0x7f841c11aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.487+0000 7f84246c7700 1 -- 172.21.15.156:0/2190638894 >> 172.21.15.156:0/2190638894 conn(0x7f841c0a2ef0 msgr2=0x7f841c135c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:09.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.487+0000 7f84246c7700 1 -- 172.21.15.156:0/2190638894 shutdown_connections 2023-09-30T22:23:09.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:09.487+0000 7f84246c7700 1 -- 172.21.15.156:0/2190638894 wait complete. 2023-09-30T22:23:09.498 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:09.500 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:10.458 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:10.467 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:10.499 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:10.501 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:10.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.605+0000 7f39214de700 1 Processor -- start 2023-09-30T22:23:10.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.605+0000 7f39214de700 1 -- start start 2023-09-30T22:23:10.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.605+0000 7f39214de700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f391c133ad0 0x7f391c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.605+0000 7f39214de700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f391c130bc0 0x7f391c13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.605+0000 7f39214de700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f391c06b2d0 con 0x7f391c1300a0 2023-09-30T22:23:10.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.605+0000 7f39214de700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f391c133610 con 0x7f391c133ad0 2023-09-30T22:23:10.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.605+0000 7f39214de700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f391c09a500 con 0x7f391c130bc0 2023-09-30T22:23:10.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.606+0000 7f391affd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f391c133ad0 0x7f391c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.606+0000 7f391affd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f391c133ad0 0x7f391c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:46004/0 (socket says 172.21.15.156:46004) 2023-09-30T22:23:10.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.606+0000 7f391affd700 1 -- 172.21.15.156:0/2902236192 learned_addr learned my addr 172.21.15.156:0/2902236192 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:10.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.606+0000 7f391b7fe700 1 --2- 172.21.15.156:0/2902236192 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f391c130bc0 0x7f391c13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.606+0000 7f391affd700 1 -- 172.21.15.156:0/2902236192 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f391c130bc0 msgr2=0x7f391c13b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:10.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.606+0000 7f391affd700 1 --2- 172.21.15.156:0/2902236192 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f391c130bc0 0x7f391c13b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.606+0000 7f391affd700 1 -- 172.21.15.156:0/2902236192 >> v1:172.21.15.156:6789/0 conn(0x7f391c1300a0 legacy=0x7f391c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:10.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.606+0000 7f391affd700 1 -- 172.21.15.156:0/2902236192 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c1338b0 con 0x7f391c133ad0 2023-09-30T22:23:10.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.606+0000 7f391affd700 1 --2- 172.21.15.156:0/2902236192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f391c133ad0 0x7f391c133ea0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f390c0098f0 tx=0x7f390c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da1c1e7defbebaa3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:10.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.606+0000 7f3919ffb700 1 -- 172.21.15.156:0/2902236192 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c004230 con 0x7f391c133ad0 2023-09-30T22:23:10.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.606+0000 7f3919ffb700 1 -- 172.21.15.156:0/2902236192 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390c004390 con 0x7f391c133ad0 2023-09-30T22:23:10.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.606+0000 7f3919ffb700 1 -- 172.21.15.156:0/2902236192 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c0036a0 con 0x7f391c133ad0 2023-09-30T22:23:10.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.607+0000 7f39214de700 1 -- 172.21.15.156:0/2902236192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f391c133ad0 msgr2=0x7f391c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.607+0000 7f39214de700 1 --2- 172.21.15.156:0/2902236192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f391c133ad0 0x7f391c133ea0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f390c0098f0 tx=0x7f390c009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:10.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.607+0000 7f39214de700 1 -- 172.21.15.156:0/2902236192 shutdown_connections 2023-09-30T22:23:10.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.607+0000 7f39214de700 1 --2- 172.21.15.156:0/2902236192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f391c133ad0 0x7f391c133ea0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.607+0000 7f39214de700 1 --2- 172.21.15.156:0/2902236192 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f391c130bc0 0x7f391c13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.607+0000 7f39214de700 1 -- 172.21.15.156:0/2902236192 >> 172.21.15.156:0/2902236192 conn(0x7f391c099c40 msgr2=0x7f391c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:10.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.607+0000 7f39214de700 1 -- 172.21.15.156:0/2902236192 shutdown_connections 2023-09-30T22:23:10.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.607+0000 7f39214de700 1 -- 172.21.15.156:0/2902236192 wait complete. 2023-09-30T22:23:10.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.608+0000 7f39214de700 1 Processor -- start 2023-09-30T22:23:10.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.608+0000 7f39214de700 1 -- start start 2023-09-30T22:23:10.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.609+0000 7f39214de700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f391c1300a0 0x7f391c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.609+0000 7f39214de700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f391c130bc0 0x7f391c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.609+0000 7f39214de700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f391c133ad0 0x7f391c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.609+0000 7f39214de700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c12dd00 con 0x7f391c130bc0 2023-09-30T22:23:10.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.609+0000 7f39214de700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c12fe60 con 0x7f391c1300a0 2023-09-30T22:23:10.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.609+0000 7f39214de700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f391c120280 con 0x7f391c133ad0 2023-09-30T22:23:10.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.609+0000 7f391affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f391c1300a0 0x7f391c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.609+0000 7f391affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f391c1300a0 0x7f391c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51994/0 (socket says 172.21.15.156:51994) 2023-09-30T22:23:10.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.609+0000 7f391affd700 1 -- 172.21.15.156:0/3501660576 learned_addr learned my addr 172.21.15.156:0/3501660576 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:10.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.609+0000 7f391b7fe700 1 --2- 172.21.15.156:0/3501660576 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f391c133ad0 0x7f391c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.609+0000 7f391a7fc700 1 --2- 172.21.15.156:0/3501660576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f391c130bc0 0x7f391c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.609+0000 7f391affd700 1 -- 172.21.15.156:0/3501660576 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f391c133ad0 msgr2=0x7f391c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.609+0000 7f391affd700 1 --2- 172.21.15.156:0/3501660576 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f391c133ad0 0x7f391c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.609+0000 7f391affd700 1 -- 172.21.15.156:0/3501660576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f391c130bc0 msgr2=0x7f391c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.609+0000 7f391affd700 1 --2- 172.21.15.156:0/3501660576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f391c130bc0 0x7f391c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.609+0000 7f391affd700 1 -- 172.21.15.156:0/3501660576 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c009550 con 0x7f391c1300a0 2023-09-30T22:23:10.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.609+0000 7f391a7fc700 1 --2- 172.21.15.156:0/3501660576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f391c130bc0 0x7f391c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:10.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.610+0000 7f391affd700 1 --2- 172.21.15.156:0/3501660576 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f391c1300a0 0x7f391c11da40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f391c133750 tx=0x7f390c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:10.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.610+0000 7f39037fe700 1 -- 172.21.15.156:0/3501660576 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c003de0 con 0x7f391c1300a0 2023-09-30T22:23:10.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.610+0000 7f39214de700 1 -- 172.21.15.156:0/3501660576 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f391c11f900 con 0x7f391c1300a0 2023-09-30T22:23:10.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.610+0000 7f39037fe700 1 -- 172.21.15.156:0/3501660576 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390c011630 con 0x7f391c1300a0 2023-09-30T22:23:10.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.610+0000 7f39037fe700 1 -- 172.21.15.156:0/3501660576 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c0119a0 con 0x7f391c1300a0 2023-09-30T22:23:10.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.610+0000 7f39214de700 1 -- 172.21.15.156:0/3501660576 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f391c11ea00 con 0x7f391c1300a0 2023-09-30T22:23:10.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.611+0000 7f39037fe700 1 -- 172.21.15.156:0/3501660576 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f390c021070 con 0x7f391c1300a0 2023-09-30T22:23:10.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.611+0000 7f39037fe700 1 -- 172.21.15.156:0/3501660576 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f390c040e70 con 0x7f391c1300a0 2023-09-30T22:23:10.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.611+0000 7f39214de700 1 -- 172.21.15.156:0/3501660576 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f391c04f2a0 con 0x7f391c1300a0 2023-09-30T22:23:10.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.620+0000 7f39037fe700 1 -- 172.21.15.156:0/3501660576 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f390c00b3e0 con 0x7f391c1300a0 2023-09-30T22:23:10.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.639+0000 7fa01fa08700 1 Processor -- start 2023-09-30T22:23:10.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.639+0000 7fa01fa08700 1 -- start start 2023-09-30T22:23:10.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.640+0000 7fa01fa08700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa01809e870 0x7fa01809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.640+0000 7fa01fa08700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa01809f180 0x7fa018131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.640+0000 7fa01fa08700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa01809c970 con 0x7fa018131d70 2023-09-30T22:23:10.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.640+0000 7fa01fa08700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0180a0920 con 0x7fa01809e870 2023-09-30T22:23:10.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.640+0000 7fa01fa08700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01809f9c0 con 0x7fa01809f180 2023-09-30T22:23:10.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.640+0000 7fa01cfa3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa01809f180 0x7fa018131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.640+0000 7fa01cfa3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa01809f180 0x7fa018131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52010/0 (socket says 172.21.15.156:52010) 2023-09-30T22:23:10.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.640+0000 7fa01cfa3700 1 -- 172.21.15.156:0/797057181 learned_addr learned my addr 172.21.15.156:0/797057181 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:10.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.640+0000 7fa01d7a4700 1 --2- 172.21.15.156:0/797057181 >> v2:172.21.15.156:3300/0 conn(0x7fa01809e870 0x7fa01809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.641+0000 7fa01cfa3700 1 -- 172.21.15.156:0/797057181 >> v2:172.21.15.156:3300/0 conn(0x7fa01809e870 msgr2=0x7fa01809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:10.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.641+0000 7fa01cfa3700 1 --2- 172.21.15.156:0/797057181 >> v2:172.21.15.156:3300/0 conn(0x7fa01809e870 0x7fa01809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.641+0000 7fa01cfa3700 1 -- 172.21.15.156:0/797057181 >> v1:172.21.15.156:6789/0 conn(0x7fa018131d70 legacy=0x7fa018138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.641+0000 7fa00ffff700 1 -- 172.21.15.156:0/797057181 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1617966920 0 0) 0x7fa01809c970 con 0x7fa018131d70 2023-09-30T22:23:10.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.641+0000 7fa01cfa3700 1 -- 172.21.15.156:0/797057181 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01809bab0 con 0x7fa01809f180 2023-09-30T22:23:10.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.641+0000 7fa01d7a4700 1 --2- 172.21.15.156:0/797057181 >> v2:172.21.15.156:3300/0 conn(0x7fa01809e870 0x7fa01809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:10.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.641+0000 7fa01cfa3700 1 --2- 172.21.15.156:0/797057181 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa01809f180 0x7fa018131830 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa0080098f0 tx=0x7fa008009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37a9899dd86e5e11 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:10.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.641+0000 7fa00ffff700 1 -- 172.21.15.156:0/797057181 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa008011830 con 0x7fa01809f180 2023-09-30T22:23:10.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.641+0000 7fa00ffff700 1 -- 172.21.15.156:0/797057181 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa008011990 con 0x7fa01809f180 2023-09-30T22:23:10.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.641+0000 7fa00ffff700 1 -- 172.21.15.156:0/797057181 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa008011d20 con 0x7fa01809f180 2023-09-30T22:23:10.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.642+0000 7fed3d27b700 1 Processor -- start 2023-09-30T22:23:10.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.642+0000 7fed3d27b700 1 -- start start 2023-09-30T22:23:10.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.642+0000 7fa01fa08700 1 -- 172.21.15.156:0/797057181 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa01809f180 msgr2=0x7fa018131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.642+0000 7fa01fa08700 1 --2- 172.21.15.156:0/797057181 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa01809f180 0x7fa018131830 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa0080098f0 tx=0x7fa008009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:10.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.642+0000 7fa01fa08700 1 -- 172.21.15.156:0/797057181 shutdown_connections 2023-09-30T22:23:10.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.642+0000 7fa01fa08700 1 --2- 172.21.15.156:0/797057181 >> v2:172.21.15.156:3300/0 conn(0x7fa01809e870 0x7fa01809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.642+0000 7fa01fa08700 1 --2- 172.21.15.156:0/797057181 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa01809f180 0x7fa018131830 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.642+0000 7fa01fa08700 1 -- 172.21.15.156:0/797057181 >> 172.21.15.156:0/797057181 conn(0x7fa0180a4430 msgr2=0x7fa0180a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:10.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.643+0000 7fed3d27b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fed381307a0 0x7fed38130b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.643+0000 7fed3d27b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fed3806d7f0 0x7fed3812fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.643+0000 7fed3d27b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed3806dcd0 con 0x7fed381310b0 2023-09-30T22:23:10.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.643+0000 7fed3d27b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed38130660 con 0x7fed3806d7f0 2023-09-30T22:23:10.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.643+0000 7fed3d27b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed3806eb40 con 0x7fed381307a0 2023-09-30T22:23:10.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.643+0000 7fed377fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fed3806d7f0 0x7fed3812fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.643+0000 7fed36ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fed381307a0 0x7fed38130b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.643+0000 7fed377fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fed3806d7f0 0x7fed3812fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52026/0 (socket says 172.21.15.156:52026) 2023-09-30T22:23:10.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.643+0000 7fed377fe700 1 -- 172.21.15.156:0/2526836550 learned_addr learned my addr 172.21.15.156:0/2526836550 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:10.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.643+0000 7fed36ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fed381307a0 0x7fed38130b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56988/0 (socket says 172.21.15.156:56988) 2023-09-30T22:23:10.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.643+0000 7fa01fa08700 1 -- 172.21.15.156:0/797057181 shutdown_connections 2023-09-30T22:23:10.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.643+0000 7fa01fa08700 1 -- 172.21.15.156:0/797057181 wait complete. 2023-09-30T22:23:10.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.643+0000 7fed377fe700 1 -- 172.21.15.156:0/2526836550 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fed381307a0 msgr2=0x7fed38130b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:10.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.643+0000 7fed377fe700 1 --2- 172.21.15.156:0/2526836550 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fed381307a0 0x7fed38130b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.643+0000 7fed377fe700 1 -- 172.21.15.156:0/2526836550 >> v1:172.21.15.156:6789/0 conn(0x7fed381310b0 legacy=0x7fed3812f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.643+0000 7fed377fe700 1 -- 172.21.15.156:0/2526836550 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3806df80 con 0x7fed3806d7f0 2023-09-30T22:23:10.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.643+0000 7fed377fe700 1 --2- 172.21.15.156:0/2526836550 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fed3806d7f0 0x7fed3812fb20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fed30009e80 tx=0x7fed3000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8325bc95386b1423 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:10.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.644+0000 7fed35ffb700 1 -- 172.21.15.156:0/2526836550 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3000e070 con 0x7fed3806d7f0 2023-09-30T22:23:10.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.644+0000 7fed35ffb700 1 -- 172.21.15.156:0/2526836550 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed30003a20 con 0x7fed3806d7f0 2023-09-30T22:23:10.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.644+0000 7fed35ffb700 1 -- 172.21.15.156:0/2526836550 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed30003dd0 con 0x7fed3806d7f0 2023-09-30T22:23:10.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.644+0000 7fa01fa08700 1 Processor -- start 2023-09-30T22:23:10.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.644+0000 7fa01fa08700 1 -- start start 2023-09-30T22:23:10.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.645+0000 7fed3d27b700 1 -- 172.21.15.156:0/2526836550 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fed3806d7f0 msgr2=0x7fed3812fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.645+0000 7fed3d27b700 1 --2- 172.21.15.156:0/2526836550 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fed3806d7f0 0x7fed3812fb20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fed30009e80 tx=0x7fed3000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:10.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.645+0000 7fed3d27b700 1 -- 172.21.15.156:0/2526836550 shutdown_connections 2023-09-30T22:23:10.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.645+0000 7fed3d27b700 1 --2- 172.21.15.156:0/2526836550 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fed3806d7f0 0x7fed3812fb20 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.645+0000 7fed3d27b700 1 --2- 172.21.15.156:0/2526836550 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fed381307a0 0x7fed38130b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.645+0000 7fed3d27b700 1 -- 172.21.15.156:0/2526836550 >> 172.21.15.156:0/2526836550 conn(0x7fed380a1ee0 msgr2=0x7fed380a22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:10.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.645+0000 7fed3d27b700 1 -- 172.21.15.156:0/2526836550 shutdown_connections 2023-09-30T22:23:10.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.645+0000 7fed3d27b700 1 -- 172.21.15.156:0/2526836550 wait complete. 2023-09-30T22:23:10.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.645+0000 7fa01fa08700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa01809e870 0x7fa01806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.645+0000 7fa01fa08700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa01809f180 0x7fa01806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.645+0000 7fa01fa08700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa018131d70 0x7fa01806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.645+0000 7fa01fa08700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01806d470 con 0x7fa01809e870 2023-09-30T22:23:10.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.645+0000 7fa01fa08700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa018125a70 con 0x7fa01809f180 2023-09-30T22:23:10.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.645+0000 7fa01fa08700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa018126010 con 0x7fa018131d70 2023-09-30T22:23:10.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.645+0000 7fa01dfa5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa018131d70 0x7fa01806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.645+0000 7fa01dfa5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa018131d70 0x7fa01806c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56996/0 (socket says 172.21.15.156:56996) 2023-09-30T22:23:10.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.645+0000 7fa01dfa5700 1 -- 172.21.15.156:0/1172868115 learned_addr learned my addr 172.21.15.156:0/1172868115 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:10.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.645+0000 7fa01dfa5700 1 -- 172.21.15.156:0/1172868115 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa01809f180 msgr2=0x7fa01806bdf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:23:10.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.645+0000 7fa01dfa5700 1 --2- 172.21.15.156:0/1172868115 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa01809f180 0x7fa01806bdf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.645+0000 7fa01dfa5700 1 -- 172.21.15.156:0/1172868115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa01809e870 msgr2=0x7fa01806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.645+0000 7fa01dfa5700 1 --2- 172.21.15.156:0/1172868115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa01809e870 0x7fa01806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.645+0000 7fa01dfa5700 1 -- 172.21.15.156:0/1172868115 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0140094a0 con 0x7fa018131d70 2023-09-30T22:23:10.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.645+0000 7fa01dfa5700 1 --2- 172.21.15.156:0/1172868115 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa018131d70 0x7fa01806c330 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa01000c840 tx=0x7fa01000cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:10.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.646+0000 7fa00dffb700 1 -- 172.21.15.156:0/1172868115 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa010003e30 con 0x7fa018131d70 2023-09-30T22:23:10.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.646+0000 7fa00dffb700 1 -- 172.21.15.156:0/1172868115 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa010005070 con 0x7fa018131d70 2023-09-30T22:23:10.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.646+0000 7fa00dffb700 1 -- 172.21.15.156:0/1172868115 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa010005400 con 0x7fa018131d70 2023-09-30T22:23:10.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.646+0000 7fa01fa08700 1 -- 172.21.15.156:0/1172868115 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa008009550 con 0x7fa018131d70 2023-09-30T22:23:10.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.646+0000 7fa01fa08700 1 -- 172.21.15.156:0/1172868115 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa018125d30 con 0x7fa018131d70 2023-09-30T22:23:10.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.646+0000 7fed3d27b700 1 Processor -- start 2023-09-30T22:23:10.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.647+0000 7fed3d27b700 1 -- start start 2023-09-30T22:23:10.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.647+0000 7fa00dffb700 1 -- 172.21.15.156:0/1172868115 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa010005560 con 0x7fa018131d70 2023-09-30T22:23:10.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.647+0000 7fa01fa08700 1 -- 172.21.15.156:0/1172868115 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa01804f2a0 con 0x7fa018131d70 2023-09-30T22:23:10.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.647+0000 7fa00dffb700 1 -- 172.21.15.156:0/1172868115 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa01003f480 con 0x7fa018131d70 2023-09-30T22:23:10.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.647+0000 7fed3d27b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fed3806d7f0 0x7fed380959f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.647+0000 7fed3d27b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fed381307a0 0x7fed38095f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.647+0000 7fed3d27b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fed381310b0 0x7fed38096470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.647+0000 7fed3d27b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed381278f0 con 0x7fed381310b0 2023-09-30T22:23:10.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.647+0000 7fed3d27b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed38097540 con 0x7fed3806d7f0 2023-09-30T22:23:10.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.647+0000 7fed3d27b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed38127af0 con 0x7fed381307a0 2023-09-30T22:23:10.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.647+0000 7fed36ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fed3806d7f0 0x7fed380959f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.647+0000 7fed36ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fed3806d7f0 0x7fed380959f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52042/0 (socket says 172.21.15.156:52042) 2023-09-30T22:23:10.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.647+0000 7fed36ffd700 1 -- 172.21.15.156:0/2116829494 learned_addr learned my addr 172.21.15.156:0/2116829494 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:10.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.647+0000 7fed367fc700 1 --2- 172.21.15.156:0/2116829494 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fed381307a0 0x7fed38095f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.648+0000 7fed377fe700 1 --2- 172.21.15.156:0/2116829494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fed381310b0 0x7fed38096470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.648+0000 7fed36ffd700 1 -- 172.21.15.156:0/2116829494 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fed381307a0 msgr2=0x7fed38095f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.648+0000 7fed36ffd700 1 --2- 172.21.15.156:0/2116829494 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fed381307a0 0x7fed38095f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.648+0000 7fed36ffd700 1 -- 172.21.15.156:0/2116829494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fed381310b0 msgr2=0x7fed38096470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.648+0000 7fed36ffd700 1 --2- 172.21.15.156:0/2116829494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fed381310b0 0x7fed38096470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.648+0000 7fed36ffd700 1 -- 172.21.15.156:0/2116829494 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed30009b30 con 0x7fed3806d7f0 2023-09-30T22:23:10.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.648+0000 7fed367fc700 1 --2- 172.21.15.156:0/2116829494 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fed381307a0 0x7fed38095f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:10.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.648+0000 7fed377fe700 1 --2- 172.21.15.156:0/2116829494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fed381310b0 0x7fed38096470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:10.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.648+0000 7fed36ffd700 1 --2- 172.21.15.156:0/2116829494 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fed3806d7f0 0x7fed380959f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fed2800e9b0 tx=0x7fed2800ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:10.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.648+0000 7fed1f7fe700 1 -- 172.21.15.156:0/2116829494 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed28009710 con 0x7fed3806d7f0 2023-09-30T22:23:10.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.648+0000 7fed1f7fe700 1 -- 172.21.15.156:0/2116829494 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2800c850 con 0x7fed3806d7f0 2023-09-30T22:23:10.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.648+0000 7fed1f7fe700 1 -- 172.21.15.156:0/2116829494 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2800cbc0 con 0x7fed3806d7f0 2023-09-30T22:23:10.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.649+0000 7fa3a1cd1700 1 Processor -- start 2023-09-30T22:23:10.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.649+0000 7fa3a1cd1700 1 -- start start 2023-09-30T22:23:10.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.649+0000 7fa3a1cd1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa39c09e870 0x7fa39c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.649+0000 7fa3a1cd1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa39c09f180 0x7fa39c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.649+0000 7fa3a1cd1700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa39c09c970 con 0x7fa39c131d70 2023-09-30T22:23:10.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.649+0000 7fa3a1cd1700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa39c0a0920 con 0x7fa39c09f180 2023-09-30T22:23:10.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.649+0000 7fa3a1cd1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c09f9c0 con 0x7fa39c09e870 2023-09-30T22:23:10.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.649+0000 7fa39bfff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fa39c131d70 0x7fa39c138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49404/0 (socket says 172.21.15.156:49404) 2023-09-30T22:23:10.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.649+0000 7fa39b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa39c09e870 0x7fa39c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.649+0000 7fa39bfff700 1 -- 172.21.15.156:0/3593722106 learned_addr learned my addr 172.21.15.156:0/3593722106 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:10.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.649+0000 7fed3d27b700 1 -- 172.21.15.156:0/2116829494 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed380986d0 con 0x7fed3806d7f0 2023-09-30T22:23:10.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.650+0000 7fed3d27b700 1 -- 172.21.15.156:0/2116829494 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed3809cef0 con 0x7fed3806d7f0 2023-09-30T22:23:10.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.650+0000 7fa39affd700 1 --2- 172.21.15.156:0/3593722106 >> v2:172.21.15.156:3300/0 conn(0x7fa39c09f180 0x7fa39c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.650+0000 7fa39a7fc700 1 -- 172.21.15.156:0/3593722106 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 12368037 0 0) 0x7fa39c09c970 con 0x7fa39c131d70 2023-09-30T22:23:10.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.650+0000 7fa39a7fc700 1 -- 172.21.15.156:0/3593722106 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3840035b0 con 0x7fa39c131d70 2023-09-30T22:23:10.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.650+0000 7fa39a7fc700 1 -- 172.21.15.156:0/3593722106 <== mon.0 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1531723612 0 0) 0x7fa3840035b0 con 0x7fa39c131d70 2023-09-30T22:23:10.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.650+0000 7fa39a7fc700 1 -- 172.21.15.156:0/3593722106 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa39c09e870 msgr2=0x7fa39c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:10.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.650+0000 7fa39a7fc700 1 --2- 172.21.15.156:0/3593722106 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa39c09e870 0x7fa39c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.650+0000 7fa39a7fc700 1 -- 172.21.15.156:0/3593722106 >> v2:172.21.15.156:3300/0 conn(0x7fa39c09f180 msgr2=0x7fa39c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:10.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.650+0000 7fa39a7fc700 1 --2- 172.21.15.156:0/3593722106 >> v2:172.21.15.156:3300/0 conn(0x7fa39c09f180 0x7fa39c131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.650+0000 7fa39a7fc700 1 -- 172.21.15.156:0/3593722106 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c09bab0 con 0x7fa39c131d70 2023-09-30T22:23:10.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.650+0000 7fa39a7fc700 1 -- 172.21.15.156:0/3593722106 <== mon.0 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2864602571 0 0) 0x7fa3940019f0 con 0x7fa39c131d70 2023-09-30T22:23:10.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.650+0000 7fa39a7fc700 1 -- 172.21.15.156:0/3593722106 >> v1:172.21.15.156:6789/0 conn(0x7fa39c131d70 legacy=0x7fa39c138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.650+0000 7fa39a7fc700 1 --2- 172.21.15.156:0/3593722106 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa39c09e870 0x7fa384003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.650+0000 7fa39a7fc700 1 --2- 172.21.15.156:0/3593722106 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa384003ff0 0x7fa384004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.650+0000 7fa39a7fc700 1 --2- 172.21.15.156:0/3593722106 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa384004d90 0x7fa384005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.650+0000 7fa39a7fc700 1 -- 172.21.15.156:0/3593722106 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c09f9c0 con 0x7fa384003ff0 2023-09-30T22:23:10.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.650+0000 7fa39a7fc700 1 -- 172.21.15.156:0/3593722106 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38400fe50 con 0x7fa384004d90 2023-09-30T22:23:10.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.650+0000 7fa39a7fc700 1 -- 172.21.15.156:0/3593722106 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa384010010 con 0x7fa39c09e870 2023-09-30T22:23:10.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.651+0000 7fed1f7fe700 1 -- 172.21.15.156:0/2116829494 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fed2800cd20 con 0x7fed3806d7f0 2023-09-30T22:23:10.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.651+0000 7fa39affd700 1 --2- 172.21.15.156:0/3593722106 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa384003ff0 0x7fa384004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.651+0000 7fed3d27b700 1 -- 172.21.15.156:0/2116829494 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed3804f2a0 con 0x7fed3806d7f0 2023-09-30T22:23:10.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.651+0000 7fa39b7fe700 1 --2- 172.21.15.156:0/3593722106 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa39c09e870 0x7fa384003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.651+0000 7fed1f7fe700 1 -- 172.21.15.156:0/2116829494 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fed2801a360 con 0x7fed3806d7f0 2023-09-30T22:23:10.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.651+0000 7fa39affd700 1 -- 172.21.15.156:0/3593722106 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa39c09e870 msgr2=0x7fa384003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:10.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.651+0000 7fa39affd700 1 --2- 172.21.15.156:0/3593722106 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa39c09e870 0x7fa384003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.651+0000 7fa39affd700 1 -- 172.21.15.156:0/3593722106 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa384004d90 msgr2=0x7fa384005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:10.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.651+0000 7fa39affd700 1 --2- 172.21.15.156:0/3593722106 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa384004d90 0x7fa384005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.651+0000 7fa39affd700 1 -- 172.21.15.156:0/3593722106 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c09bab0 con 0x7fa384003ff0 2023-09-30T22:23:10.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.651+0000 7fa39affd700 1 --2- 172.21.15.156:0/3593722106 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa384003ff0 0x7fa384004850 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0a1a80 tx=0x7fa384005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af5042eabf8a67c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:10.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.652+0000 7fa39a7fc700 1 -- 172.21.15.156:0/3593722106 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39000e6c0 con 0x7fa384003ff0 2023-09-30T22:23:10.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.652+0000 7fa39a7fc700 1 -- 172.21.15.156:0/3593722106 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39000e820 con 0x7fa384003ff0 2023-09-30T22:23:10.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.652+0000 7fa39a7fc700 1 -- 172.21.15.156:0/3593722106 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39000eb90 con 0x7fa384003ff0 2023-09-30T22:23:10.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.652+0000 7fa3a1cd1700 1 -- 172.21.15.156:0/3593722106 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa384003ff0 msgr2=0x7fa384004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.652+0000 7fa3a1cd1700 1 --2- 172.21.15.156:0/3593722106 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa384003ff0 0x7fa384004850 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0a1a80 tx=0x7fa384005880 comp rx=0 tx=0).stop 2023-09-30T22:23:10.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.652+0000 7fa39bfff700 1 -- 172.21.15.156:0/3593722106 reap_dead start 2023-09-30T22:23:10.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.652+0000 7fa3a1cd1700 1 -- 172.21.15.156:0/3593722106 shutdown_connections 2023-09-30T22:23:10.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.652+0000 7fa3a1cd1700 1 -- 172.21.15.156:0/3593722106 >> 172.21.15.156:0/3593722106 conn(0x7fa39c0a4430 msgr2=0x7fa39c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:10.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.653+0000 7fa3a1cd1700 1 -- 172.21.15.156:0/3593722106 shutdown_connections 2023-09-30T22:23:10.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.653+0000 7fa3a1cd1700 1 -- 172.21.15.156:0/3593722106 wait complete. 2023-09-30T22:23:10.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.653+0000 7fa00dffb700 1 -- 172.21.15.156:0/1172868115 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa010005810 con 0x7fa018131d70 2023-09-30T22:23:10.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.654+0000 7fa3a1cd1700 1 Processor -- start 2023-09-30T22:23:10.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.654+0000 7fa3a1cd1700 1 -- start start 2023-09-30T22:23:10.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.655+0000 7fa3a1cd1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa39c11b0b0 0x7fa39c11b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.655+0000 7fa3a1cd1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa39c11b9c0 0x7fa39c1d9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.655+0000 7fa3a1cd1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa39c1d9da0 0x7fa39c1dc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.655+0000 7fa3a1cd1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c11d310 con 0x7fa39c1d9da0 2023-09-30T22:23:10.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.655+0000 7fa3a1cd1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c11ebd0 con 0x7fa39c11b9c0 2023-09-30T22:23:10.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.655+0000 7fa3a1cd1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c11dfa0 con 0x7fa39c11b0b0 2023-09-30T22:23:10.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.655+0000 7fa39b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa39c11b0b0 0x7fa39c11b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.655+0000 7fa39b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa39c11b0b0 0x7fa39c11b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:57026/0 (socket says 172.21.15.156:57026) 2023-09-30T22:23:10.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.655+0000 7fa39b7fe700 1 -- 172.21.15.156:0/664847657 learned_addr learned my addr 172.21.15.156:0/664847657 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:10.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.655+0000 7fa39bfff700 1 --2- 172.21.15.156:0/664847657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa39c1d9da0 0x7fa39c1dc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.655+0000 7fa39b7fe700 1 -- 172.21.15.156:0/664847657 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa39c11b9c0 msgr2=0x7fa39c1d9860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:23:10.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.655+0000 7fa39b7fe700 1 --2- 172.21.15.156:0/664847657 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa39c11b9c0 0x7fa39c1d9860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.655+0000 7fa39b7fe700 1 -- 172.21.15.156:0/664847657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa39c1d9da0 msgr2=0x7fa39c1dc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.655+0000 7fa39b7fe700 1 --2- 172.21.15.156:0/664847657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa39c1d9da0 0x7fa39c1dc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.655+0000 7fa39b7fe700 1 -- 172.21.15.156:0/664847657 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c0a2bb0 con 0x7fa39c11b0b0 2023-09-30T22:23:10.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.655+0000 7fa39b7fe700 1 --2- 172.21.15.156:0/664847657 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa39c11b0b0 0x7fa39c11b480 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0116c0 tx=0x7fa38c011a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:10.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.656+0000 7fa383fff700 1 -- 172.21.15.156:0/664847657 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c00c070 con 0x7fa39c11b0b0 2023-09-30T22:23:10.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.656+0000 7fa383fff700 1 -- 172.21.15.156:0/664847657 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38c015870 con 0x7fa39c11b0b0 2023-09-30T22:23:10.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.656+0000 7fa3a1cd1700 1 -- 172.21.15.156:0/664847657 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa39c09dba0 con 0x7fa39c11b0b0 2023-09-30T22:23:10.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.656+0000 7fa383fff700 1 -- 172.21.15.156:0/664847657 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c015c00 con 0x7fa39c11b0b0 2023-09-30T22:23:10.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.656+0000 7fa3a1cd1700 1 -- 172.21.15.156:0/664847657 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa39c11e360 con 0x7fa39c11b0b0 2023-09-30T22:23:10.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.657+0000 7fa383fff700 1 -- 172.21.15.156:0/664847657 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa38c013400 con 0x7fa39c11b0b0 2023-09-30T22:23:10.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.657+0000 7fa383fff700 1 -- 172.21.15.156:0/664847657 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa38c03f9f0 con 0x7fa39c11b0b0 2023-09-30T22:23:10.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.658+0000 7fa3a1cd1700 1 -- 172.21.15.156:0/664847657 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa39c04f2a0 con 0x7fa39c11b0b0 2023-09-30T22:23:10.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.658+0000 7fed1f7fe700 1 -- 172.21.15.156:0/2116829494 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fed28017080 con 0x7fed3806d7f0 2023-09-30T22:23:10.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.665+0000 7fa383fff700 1 -- 172.21.15.156:0/664847657 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa38c015d60 con 0x7fa39c11b0b0 2023-09-30T22:23:10.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.838+0000 7f39214de700 1 -- 172.21.15.156:0/3501660576 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f391c06c3b0 con 0x7f391c1300a0 2023-09-30T22:23:10.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.839+0000 7f39037fe700 1 -- 172.21.15.156:0/3501660576 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f390c019bb0 con 0x7f391c1300a0 2023-09-30T22:23:10.840 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:10.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.842+0000 7f39214de700 1 -- 172.21.15.156:0/3501660576 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f391c1300a0 msgr2=0x7f391c11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.842+0000 7f39214de700 1 --2- 172.21.15.156:0/3501660576 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f391c1300a0 0x7f391c11da40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f391c133750 tx=0x7f390c004750 comp rx=0 tx=0).stop 2023-09-30T22:23:10.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.842+0000 7f39214de700 1 -- 172.21.15.156:0/3501660576 shutdown_connections 2023-09-30T22:23:10.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.842+0000 7f39214de700 1 --2- 172.21.15.156:0/3501660576 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f391c133ad0 0x7f391c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.842+0000 7f39214de700 1 --2- 172.21.15.156:0/3501660576 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f391c1300a0 0x7f391c11da40 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.842+0000 7f39214de700 1 --2- 172.21.15.156:0/3501660576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f391c130bc0 0x7f391c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.842+0000 7f39214de700 1 -- 172.21.15.156:0/3501660576 >> 172.21.15.156:0/3501660576 conn(0x7f391c099c40 msgr2=0x7f391c1321c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:10.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.843+0000 7f39214de700 1 -- 172.21.15.156:0/3501660576 shutdown_connections 2023-09-30T22:23:10.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.845+0000 7f39214de700 1 -- 172.21.15.156:0/3501660576 wait complete. 2023-09-30T22:23:10.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.851+0000 7fa01fa08700 1 -- 172.21.15.156:0/1172868115 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa018131b50 con 0x7fa018131d70 2023-09-30T22:23:10.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.852+0000 7fa00dffb700 1 -- 172.21.15.156:0/1172868115 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa01001a360 con 0x7fa018131d70 2023-09-30T22:23:10.853 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:10.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.854+0000 7fa01fa08700 1 -- 172.21.15.156:0/1172868115 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa018131d70 msgr2=0x7fa01806c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.854+0000 7fa01fa08700 1 --2- 172.21.15.156:0/1172868115 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa018131d70 0x7fa01806c330 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa01000c840 tx=0x7fa01000cc00 comp rx=0 tx=0).stop 2023-09-30T22:23:10.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.854+0000 7fa01fa08700 1 -- 172.21.15.156:0/1172868115 shutdown_connections 2023-09-30T22:23:10.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.854+0000 7fa01fa08700 1 --2- 172.21.15.156:0/1172868115 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa018131d70 0x7fa01806c330 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.854+0000 7fa01fa08700 1 --2- 172.21.15.156:0/1172868115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa01809e870 0x7fa01806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.854+0000 7fa01fa08700 1 --2- 172.21.15.156:0/1172868115 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa01809f180 0x7fa01806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.854+0000 7fa01fa08700 1 -- 172.21.15.156:0/1172868115 >> 172.21.15.156:0/1172868115 conn(0x7fa0180a4430 msgr2=0x7fa01811a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:10.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.856+0000 7fa01fa08700 1 -- 172.21.15.156:0/1172868115 shutdown_connections 2023-09-30T22:23:10.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.856+0000 7fa01fa08700 1 -- 172.21.15.156:0/1172868115 wait complete. 2023-09-30T22:23:10.858 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:10.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.862+0000 7fa3a1cd1700 1 -- 172.21.15.156:0/664847657 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa39c0008d0 con 0x7fa39c11b0b0 2023-09-30T22:23:10.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.862+0000 7fa383fff700 1 -- 172.21.15.156:0/664847657 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa38c02d090 con 0x7fa39c11b0b0 2023-09-30T22:23:10.863 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:10.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.865+0000 7fa3a1cd1700 1 -- 172.21.15.156:0/664847657 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa39c11b0b0 msgr2=0x7fa39c11b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.865+0000 7fa3a1cd1700 1 --2- 172.21.15.156:0/664847657 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa39c11b0b0 0x7fa39c11b480 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0116c0 tx=0x7fa38c011a80 comp rx=0 tx=0).stop 2023-09-30T22:23:10.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.865+0000 7fa3a1cd1700 1 -- 172.21.15.156:0/664847657 shutdown_connections 2023-09-30T22:23:10.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.865+0000 7fa3a1cd1700 1 --2- 172.21.15.156:0/664847657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa39c1d9da0 0x7fa39c1dc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.865+0000 7fa3a1cd1700 1 --2- 172.21.15.156:0/664847657 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa39c11b0b0 0x7fa39c11b480 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.865+0000 7fa3a1cd1700 1 --2- 172.21.15.156:0/664847657 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa39c11b9c0 0x7fa39c1d9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.865+0000 7fa3a1cd1700 1 -- 172.21.15.156:0/664847657 >> 172.21.15.156:0/664847657 conn(0x7fa39c0a4430 msgr2=0x7fa39c131110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:10.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.865+0000 7fa3a1cd1700 1 -- 172.21.15.156:0/664847657 shutdown_connections 2023-09-30T22:23:10.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.865+0000 7fa3a1cd1700 1 -- 172.21.15.156:0/664847657 wait complete. 2023-09-30T22:23:10.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:10.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.870+0000 7fed3d27b700 1 -- 172.21.15.156:0/2116829494 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fed38127460 con 0x7fed3806d7f0 2023-09-30T22:23:10.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.871+0000 7fed1f7fe700 1 -- 172.21.15.156:0/2116829494 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fed28044020 con 0x7fed3806d7f0 2023-09-30T22:23:10.871 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:10.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.873+0000 7fed3d27b700 1 -- 172.21.15.156:0/2116829494 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fed3806d7f0 msgr2=0x7fed380959f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.873+0000 7fed3d27b700 1 --2- 172.21.15.156:0/2116829494 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fed3806d7f0 0x7fed380959f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fed2800e9b0 tx=0x7fed2800ed70 comp rx=0 tx=0).stop 2023-09-30T22:23:10.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.873+0000 7fed3d27b700 1 -- 172.21.15.156:0/2116829494 shutdown_connections 2023-09-30T22:23:10.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.873+0000 7fed3d27b700 1 --2- 172.21.15.156:0/2116829494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fed381310b0 0x7fed38096470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.873+0000 7fed3d27b700 1 --2- 172.21.15.156:0/2116829494 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fed3806d7f0 0x7fed380959f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.873+0000 7fed3d27b700 1 --2- 172.21.15.156:0/2116829494 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fed381307a0 0x7fed38095f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.873+0000 7fed3d27b700 1 -- 172.21.15.156:0/2116829494 >> 172.21.15.156:0/2116829494 conn(0x7fed380a1ee0 msgr2=0x7fed380a0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:10.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.873+0000 7fed3d27b700 1 -- 172.21.15.156:0/2116829494 shutdown_connections 2023-09-30T22:23:10.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:10.873+0000 7fed3d27b700 1 -- 172.21.15.156:0/2116829494 wait complete. 2023-09-30T22:23:10.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:10.886 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:11.859 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:11.871 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:11.880 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:11.888 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:12.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.005+0000 7fba2bf2c700 1 Processor -- start 2023-09-30T22:23:12.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.005+0000 7fba2bf2c700 1 -- start start 2023-09-30T22:23:12.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.006+0000 7fba2bf2c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba24131a80 0x7fba24131e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:12.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.006+0000 7fba2bf2c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fba2409c7d0 0x7fba24139780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:12.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.006+0000 7fba2bf2c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba240a23a0 con 0x7fba2409bc70 2023-09-30T22:23:12.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.006+0000 7fba2bf2c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba24131440 con 0x7fba2409c7d0 2023-09-30T22:23:12.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.006+0000 7fba2bf2c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba24132390 con 0x7fba24131a80 2023-09-30T22:23:12.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.006+0000 7fba294c7700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fba2409bc70 0x7fba2409c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:42532/0 (socket says 172.21.15.156:42532) 2023-09-30T22:23:12.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.006+0000 7fba294c7700 1 -- 172.21.15.156:0/3436064135 learned_addr learned my addr 172.21.15.156:0/3436064135 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:12.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.006+0000 7fba29cc8700 1 --2- 172.21.15.156:0/3436064135 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba24131a80 0x7fba24131e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:12.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.006+0000 7fba2a4c9700 1 --2- 172.21.15.156:0/3436064135 >> v2:172.21.15.156:3300/0 conn(0x7fba2409c7d0 0x7fba24139780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:12.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.006+0000 7fba29cc8700 1 -- 172.21.15.156:0/3436064135 >> v2:172.21.15.156:3300/0 conn(0x7fba2409c7d0 msgr2=0x7fba24139780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:12.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.006+0000 7fba29cc8700 1 --2- 172.21.15.156:0/3436064135 >> v2:172.21.15.156:3300/0 conn(0x7fba2409c7d0 0x7fba24139780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.006+0000 7fba29cc8700 1 -- 172.21.15.156:0/3436064135 >> v1:172.21.15.156:6789/0 conn(0x7fba2409bc70 legacy=0x7fba2409c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:12.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.006+0000 7fba29cc8700 1 -- 172.21.15.156:0/3436064135 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2406eaa0 con 0x7fba24131a80 2023-09-30T22:23:12.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.006+0000 7fba29cc8700 1 --2- 172.21.15.156:0/3436064135 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba24131a80 0x7fba24131e50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fba20009820 tx=0x7fba20009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a051d4d037a31c8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:12.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.007+0000 7fba28cc6700 1 -- 172.21.15.156:0/3436064135 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba20005e30 con 0x7fba24131a80 2023-09-30T22:23:12.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.007+0000 7fba28cc6700 1 -- 172.21.15.156:0/3436064135 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba20006030 con 0x7fba24131a80 2023-09-30T22:23:12.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.007+0000 7fba28cc6700 1 -- 172.21.15.156:0/3436064135 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba200063c0 con 0x7fba24131a80 2023-09-30T22:23:12.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.008+0000 7fba2bf2c700 1 -- 172.21.15.156:0/3436064135 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba24131a80 msgr2=0x7fba24131e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:12.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.008+0000 7fba2bf2c700 1 --2- 172.21.15.156:0/3436064135 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba24131a80 0x7fba24131e50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fba20009820 tx=0x7fba20009b30 comp rx=0 tx=0).stop 2023-09-30T22:23:12.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.008+0000 7fba2bf2c700 1 -- 172.21.15.156:0/3436064135 shutdown_connections 2023-09-30T22:23:12.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.008+0000 7fba2bf2c700 1 --2- 172.21.15.156:0/3436064135 >> v2:172.21.15.156:3300/0 conn(0x7fba2409c7d0 0x7fba24139780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.008+0000 7fba2bf2c700 1 --2- 172.21.15.156:0/3436064135 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba24131a80 0x7fba24131e50 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.008+0000 7fba2bf2c700 1 -- 172.21.15.156:0/3436064135 >> 172.21.15.156:0/3436064135 conn(0x7fba240a2980 msgr2=0x7fba240a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:12.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.008+0000 7fba2bf2c700 1 -- 172.21.15.156:0/3436064135 shutdown_connections 2023-09-30T22:23:12.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.008+0000 7fba2bf2c700 1 -- 172.21.15.156:0/3436064135 wait complete. 2023-09-30T22:23:12.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.009+0000 7fba2bf2c700 1 Processor -- start 2023-09-30T22:23:12.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.009+0000 7fba2bf2c700 1 -- start start 2023-09-30T22:23:12.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.010+0000 7fba2bf2c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba2409bc70 0x7fba24134dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:12.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.010+0000 7fba2bf2c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba2409c7d0 0x7fba24135310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:12.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.010+0000 7fba2bf2c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fba24131a80 0x7fba24135850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:12.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.010+0000 7fba2bf2c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba24138610 con 0x7fba2409c7d0 2023-09-30T22:23:12.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.010+0000 7fba2bf2c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba24138a40 con 0x7fba2409bc70 2023-09-30T22:23:12.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.010+0000 7fba2bf2c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba24136a80 con 0x7fba24131a80 2023-09-30T22:23:12.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.010+0000 7fba29cc8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba2409bc70 0x7fba24134dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:12.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.010+0000 7fba29cc8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba2409bc70 0x7fba24134dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59740/0 (socket says 172.21.15.156:59740) 2023-09-30T22:23:12.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.010+0000 7fba29cc8700 1 -- 172.21.15.156:0/3312831083 learned_addr learned my addr 172.21.15.156:0/3312831083 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:12.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.010+0000 7fba294c7700 1 --2- 172.21.15.156:0/3312831083 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba2409c7d0 0x7fba24135310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:12.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.010+0000 7fba2a4c9700 1 --2- 172.21.15.156:0/3312831083 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fba24131a80 0x7fba24135850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:12.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.010+0000 7fba29cc8700 1 -- 172.21.15.156:0/3312831083 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fba24131a80 msgr2=0x7fba24135850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:12.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.010+0000 7fba29cc8700 1 --2- 172.21.15.156:0/3312831083 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fba24131a80 0x7fba24135850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.010+0000 7fba29cc8700 1 -- 172.21.15.156:0/3312831083 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba2409c7d0 msgr2=0x7fba24135310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:12.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.010+0000 7fba29cc8700 1 --2- 172.21.15.156:0/3312831083 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba2409c7d0 0x7fba24135310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.010+0000 7fba29cc8700 1 -- 172.21.15.156:0/3312831083 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba20009430 con 0x7fba2409bc70 2023-09-30T22:23:12.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.011+0000 7fba294c7700 1 --2- 172.21.15.156:0/3312831083 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba2409c7d0 0x7fba24135310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:12.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.011+0000 7fba29cc8700 1 --2- 172.21.15.156:0/3312831083 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba2409bc70 0x7fba24134dd0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fba241324d0 tx=0x7fba20004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:12.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.011+0000 7fba1a7fc700 1 -- 172.21.15.156:0/3312831083 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba20006940 con 0x7fba2409bc70 2023-09-30T22:23:12.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.011+0000 7fba1a7fc700 1 -- 172.21.15.156:0/3312831083 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba20020070 con 0x7fba2409bc70 2023-09-30T22:23:12.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.011+0000 7fba2bf2c700 1 -- 172.21.15.156:0/3312831083 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba24138350 con 0x7fba2409bc70 2023-09-30T22:23:12.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.011+0000 7fba1a7fc700 1 -- 172.21.15.156:0/3312831083 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba20004280 con 0x7fba2409bc70 2023-09-30T22:23:12.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.011+0000 7fba2bf2c700 1 -- 172.21.15.156:0/3312831083 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba241394d0 con 0x7fba2409bc70 2023-09-30T22:23:12.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.012+0000 7fba1a7fc700 1 -- 172.21.15.156:0/3312831083 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fba20022030 con 0x7fba2409bc70 2023-09-30T22:23:12.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.012+0000 7fba1a7fc700 1 -- 172.21.15.156:0/3312831083 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fba20040bd0 con 0x7fba2409bc70 2023-09-30T22:23:12.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.012+0000 7fba2bf2c700 1 -- 172.21.15.156:0/3312831083 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba240714c0 con 0x7fba2409bc70 2023-09-30T22:23:12.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.017+0000 7fba1a7fc700 1 -- 172.21.15.156:0/3312831083 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fba200247e0 con 0x7fba2409bc70 2023-09-30T22:23:12.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.041+0000 7f548ea44700 1 Processor -- start 2023-09-30T22:23:12.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.041+0000 7f548ea44700 1 -- start start 2023-09-30T22:23:12.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.041+0000 7f548ea44700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5488133ad0 0x7f5488133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:12.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.041+0000 7f548ea44700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f54881300a0 0x7f54881304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:12.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.041+0000 7f548ea44700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54881309f0 0x7f548813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:12.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.041+0000 7f548ea44700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f548806b2d0 con 0x7f54881300a0 2023-09-30T22:23:12.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.041+0000 7f548ea44700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5488133610 con 0x7f5488133ad0 2023-09-30T22:23:12.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.041+0000 7f548ea44700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f548809a500 con 0x7f54881309f0 2023-09-30T22:23:12.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.042+0000 7f5487fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5488133ad0 0x7f5488133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:12.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.042+0000 7f5487fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5488133ad0 0x7f5488133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59748/0 (socket says 172.21.15.156:59748) 2023-09-30T22:23:12.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.042+0000 7f5487fff700 1 -- 172.21.15.156:0/1082389903 learned_addr learned my addr 172.21.15.156:0/1082389903 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:12.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.042+0000 7f548cfe1700 1 --2- 172.21.15.156:0/1082389903 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54881309f0 0x7f548813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:12.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.042+0000 7f548cfe1700 1 -- 172.21.15.156:0/1082389903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5488133ad0 msgr2=0x7f5488133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:12.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.042+0000 7f548cfe1700 1 --2- 172.21.15.156:0/1082389903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5488133ad0 0x7f5488133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.042+0000 7f548cfe1700 1 -- 172.21.15.156:0/1082389903 >> v2:172.21.15.156:3300/0 conn(0x7f54881300a0 msgr2=0x7f54881304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:12.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.042+0000 7f548cfe1700 1 --2- 172.21.15.156:0/1082389903 >> v2:172.21.15.156:3300/0 conn(0x7f54881300a0 0x7f54881304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.042+0000 7f548cfe1700 1 -- 172.21.15.156:0/1082389903 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54881338b0 con 0x7f54881309f0 2023-09-30T22:23:12.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.042+0000 7f5487fff700 1 --2- 172.21.15.156:0/1082389903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5488133ad0 0x7f5488133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:12.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.042+0000 7f548cfe1700 1 --2- 172.21.15.156:0/1082389903 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54881309f0 0x7f548813a980 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5480009d90 tx=0x7f548000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed278878c846e1ba server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:12.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.042+0000 7f5486ffd700 1 -- 172.21.15.156:0/1082389903 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548000e070 con 0x7f54881309f0 2023-09-30T22:23:12.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.042+0000 7f5486ffd700 1 -- 172.21.15.156:0/1082389903 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548000bb20 con 0x7f54881309f0 2023-09-30T22:23:12.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.042+0000 7f5486ffd700 1 -- 172.21.15.156:0/1082389903 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5480012430 con 0x7f54881309f0 2023-09-30T22:23:12.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.043+0000 7f548ea44700 1 -- 172.21.15.156:0/1082389903 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54881309f0 msgr2=0x7f548813a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:12.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.043+0000 7f548ea44700 1 --2- 172.21.15.156:0/1082389903 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54881309f0 0x7f548813a980 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5480009d90 tx=0x7f548000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:12.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.043+0000 7f548ea44700 1 -- 172.21.15.156:0/1082389903 shutdown_connections 2023-09-30T22:23:12.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.043+0000 7f548ea44700 1 --2- 172.21.15.156:0/1082389903 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54881309f0 0x7f548813a980 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.043+0000 7f548ea44700 1 --2- 172.21.15.156:0/1082389903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5488133ad0 0x7f5488133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.043+0000 7f548ea44700 1 --2- 172.21.15.156:0/1082389903 >> v2:172.21.15.156:3300/0 conn(0x7f54881300a0 0x7f54881304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.043+0000 7f548ea44700 1 -- 172.21.15.156:0/1082389903 >> 172.21.15.156:0/1082389903 conn(0x7f5488099c40 msgr2=0x7f54880a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:12.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.044+0000 7f548ea44700 1 -- 172.21.15.156:0/1082389903 shutdown_connections 2023-09-30T22:23:12.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.044+0000 7f548ea44700 1 -- 172.21.15.156:0/1082389903 wait complete. 2023-09-30T22:23:12.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.044+0000 7f548ea44700 1 Processor -- start 2023-09-30T22:23:12.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.045+0000 7fabeaea3700 1 Processor -- start 2023-09-30T22:23:12.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.045+0000 7f548ea44700 1 -- start start 2023-09-30T22:23:12.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.045+0000 7fabeaea3700 1 -- start start 2023-09-30T22:23:12.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.045+0000 7f548ea44700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54881300a0 0x7f548811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:12.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.045+0000 7f548ea44700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54881309f0 0x7f548811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:12.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.045+0000 7f548ea44700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5488133ad0 0x7f548811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:12.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.045+0000 7f548ea44700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5488120160 con 0x7f5488133ad0 2023-09-30T22:23:12.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.045+0000 7f548ea44700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548811f8e0 con 0x7f54881300a0 2023-09-30T22:23:12.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.045+0000 7f548ea44700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f548812f800 con 0x7f54881309f0 2023-09-30T22:23:12.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.045+0000 7f5487fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54881300a0 0x7f548811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:12.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.045+0000 7f5487fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54881300a0 0x7f548811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59750/0 (socket says 172.21.15.156:59750) 2023-09-30T22:23:12.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.045+0000 7f5487fff700 1 -- 172.21.15.156:0/1805845941 learned_addr learned my addr 172.21.15.156:0/1805845941 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:12.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.045+0000 7f548cfe1700 1 --2- 172.21.15.156:0/1805845941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5488133ad0 0x7f548811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:12.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.045+0000 7fabeaea3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fabe4131980 0x7fabe4131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:12.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.045+0000 7fabeaea3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabe409bc70 0x7fabe409c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:12.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.045+0000 7fabeaea3700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe40a1640 con 0x7fabe409c5c0 2023-09-30T22:23:12.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.045+0000 7fabeaea3700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe406eb30 con 0x7fabe4131980 2023-09-30T22:23:12.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.045+0000 7fabeaea3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe40a22d0 con 0x7fabe409bc70 2023-09-30T22:23:12.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.046+0000 7f548cfe1700 1 -- 172.21.15.156:0/1805845941 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54881309f0 msgr2=0x7f548811df80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:23:12.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.046+0000 7f548cfe1700 1 --2- 172.21.15.156:0/1805845941 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54881309f0 0x7f548811df80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.046+0000 7f548cfe1700 1 -- 172.21.15.156:0/1805845941 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54881300a0 msgr2=0x7f548811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:12.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.046+0000 7f548cfe1700 1 --2- 172.21.15.156:0/1805845941 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54881300a0 0x7f548811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.046+0000 7f548cfe1700 1 -- 172.21.15.156:0/1805845941 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5478009550 con 0x7f5488133ad0 2023-09-30T22:23:12.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.046+0000 7fabe3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabe409bc70 0x7fabe409c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:12.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.046+0000 7fabe3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabe409bc70 0x7fabe409c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59752/0 (socket says 172.21.15.156:59752) 2023-09-30T22:23:12.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.046+0000 7fabe3fff700 1 -- 172.21.15.156:0/3282145833 learned_addr learned my addr 172.21.15.156:0/3282145833 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:12.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.046+0000 7f548cfe1700 1 --2- 172.21.15.156:0/1805845941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5488133ad0 0x7f548811e4c0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f5480016000 tx=0x7f5480004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:12.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.046+0000 7fabe3fff700 1 -- 172.21.15.156:0/3282145833 >> v2:172.21.15.156:3300/0 conn(0x7fabe4131980 msgr2=0x7fabe4131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:12.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.046+0000 7fabe3fff700 1 --2- 172.21.15.156:0/3282145833 >> v2:172.21.15.156:3300/0 conn(0x7fabe4131980 0x7fabe4131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.046+0000 7fabe3fff700 1 -- 172.21.15.156:0/3282145833 >> v1:172.21.15.156:6789/0 conn(0x7fabe409c5c0 legacy=0x7fabe4138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:12.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.046+0000 7fabe3fff700 1 -- 172.21.15.156:0/3282145833 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe4131550 con 0x7fabe409bc70 2023-09-30T22:23:12.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.046+0000 7fabe3fff700 1 --2- 172.21.15.156:0/3282145833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabe409bc70 0x7fabe409c080 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fabd80098f0 tx=0x7fabd8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c8217f38fde907e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:12.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.046+0000 7f5484ff9700 1 -- 172.21.15.156:0/1805845941 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5480012430 con 0x7f5488133ad0 2023-09-30T22:23:12.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.046+0000 7f5484ff9700 1 -- 172.21.15.156:0/1805845941 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5480020070 con 0x7f5488133ad0 2023-09-30T22:23:12.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.046+0000 7f5484ff9700 1 -- 172.21.15.156:0/1805845941 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5480004280 con 0x7f5488133ad0 2023-09-30T22:23:12.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.046+0000 7f548ea44700 1 -- 172.21.15.156:0/1805845941 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5480009a70 con 0x7f5488133ad0 2023-09-30T22:23:12.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.046+0000 7f548ea44700 1 -- 172.21.15.156:0/1805845941 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548811fb20 con 0x7f5488133ad0 2023-09-30T22:23:12.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.046+0000 7fabe37fe700 1 -- 172.21.15.156:0/3282145833 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd800b8a0 con 0x7fabe409bc70 2023-09-30T22:23:12.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.046+0000 7fabe37fe700 1 -- 172.21.15.156:0/3282145833 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd800ba00 con 0x7fabe409bc70 2023-09-30T22:23:12.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.046+0000 7fabe37fe700 1 -- 172.21.15.156:0/3282145833 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd800bd90 con 0x7fabe409bc70 2023-09-30T22:23:12.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.047+0000 7f5484ff9700 1 -- 172.21.15.156:0/1805845941 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f54800043e0 con 0x7f5488133ad0 2023-09-30T22:23:12.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.047+0000 7f5484ff9700 1 -- 172.21.15.156:0/1805845941 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5480022070 con 0x7f5488133ad0 2023-09-30T22:23:12.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.048+0000 7f548ea44700 1 -- 172.21.15.156:0/1805845941 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f548804f2a0 con 0x7f5488133ad0 2023-09-30T22:23:12.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.048+0000 7fabeaea3700 1 -- 172.21.15.156:0/3282145833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabe409bc70 msgr2=0x7fabe409c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:12.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.048+0000 7fabeaea3700 1 --2- 172.21.15.156:0/3282145833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabe409bc70 0x7fabe409c080 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fabd80098f0 tx=0x7fabd8009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:12.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.048+0000 7fabeaea3700 1 -- 172.21.15.156:0/3282145833 shutdown_connections 2023-09-30T22:23:12.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.048+0000 7fabeaea3700 1 --2- 172.21.15.156:0/3282145833 >> v2:172.21.15.156:3300/0 conn(0x7fabe4131980 0x7fabe4131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.048+0000 7fabeaea3700 1 --2- 172.21.15.156:0/3282145833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabe409bc70 0x7fabe409c080 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.048+0000 7fabeaea3700 1 -- 172.21.15.156:0/3282145833 >> 172.21.15.156:0/3282145833 conn(0x7fabe40a2980 msgr2=0x7fabe40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:12.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.048+0000 7fabeaea3700 1 -- 172.21.15.156:0/3282145833 shutdown_connections 2023-09-30T22:23:12.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.048+0000 7fabeaea3700 1 -- 172.21.15.156:0/3282145833 wait complete. 2023-09-30T22:23:12.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.050+0000 7fabeaea3700 1 Processor -- start 2023-09-30T22:23:12.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.050+0000 7fabeaea3700 1 -- start start 2023-09-30T22:23:12.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.050+0000 7fabeaea3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabe409bc70 0x7fabe4119400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:12.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.050+0000 7fabeaea3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabe409c5c0 0x7fabe4119940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:12.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.050+0000 7fabeaea3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabe4131980 0x7fabe4119e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:12.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.050+0000 7fabeaea3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe411c920 con 0x7fabe4131980 2023-09-30T22:23:12.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.050+0000 7fabeaea3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe411cb00 con 0x7fabe409c5c0 2023-09-30T22:23:12.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.050+0000 7fabeaea3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabe411b480 con 0x7fabe409bc70 2023-09-30T22:23:12.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.051+0000 7fabe3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabe409c5c0 0x7fabe4119940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:12.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.051+0000 7fabe3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabe409c5c0 0x7fabe4119940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59754/0 (socket says 172.21.15.156:59754) 2023-09-30T22:23:12.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.051+0000 7fabe3fff700 1 -- 172.21.15.156:0/2938261765 learned_addr learned my addr 172.21.15.156:0/2938261765 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:12.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.051+0000 7fabe8c3f700 1 --2- 172.21.15.156:0/2938261765 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabe409bc70 0x7fabe4119400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:12.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.051+0000 7fabe9440700 1 --2- 172.21.15.156:0/2938261765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabe4131980 0x7fabe4119e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:12.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.051+0000 7fabe8c3f700 1 -- 172.21.15.156:0/2938261765 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabe409c5c0 msgr2=0x7fabe4119940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:12.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.051+0000 7fabe8c3f700 1 --2- 172.21.15.156:0/2938261765 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabe409c5c0 0x7fabe4119940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.051+0000 7fabe8c3f700 1 -- 172.21.15.156:0/2938261765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabe4131980 msgr2=0x7fabe4119e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:12.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.051+0000 7fabe8c3f700 1 --2- 172.21.15.156:0/2938261765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabe4131980 0x7fabe4119e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.051+0000 7fabe8c3f700 1 -- 172.21.15.156:0/2938261765 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd8009550 con 0x7fabe409bc70 2023-09-30T22:23:12.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.052+0000 7efdda1b9700 1 Processor -- start 2023-09-30T22:23:12.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.052+0000 7fabe8c3f700 1 --2- 172.21.15.156:0/2938261765 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabe409bc70 0x7fabe4119400 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fabd400b480 tx=0x7fabd400b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:12.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.052+0000 7efdda1b9700 1 -- start start 2023-09-30T22:23:12.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.052+0000 7fabe3fff700 1 --2- 172.21.15.156:0/2938261765 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabe409c5c0 0x7fabe4119940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:12.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.052+0000 7fabe17fa700 1 -- 172.21.15.156:0/2938261765 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd4011830 con 0x7fabe409bc70 2023-09-30T22:23:12.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.052+0000 7fabe17fa700 1 -- 172.21.15.156:0/2938261765 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd40119b0 con 0x7fabe409bc70 2023-09-30T22:23:12.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.052+0000 7fabe17fa700 1 -- 172.21.15.156:0/2938261765 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd4011d60 con 0x7fabe409bc70 2023-09-30T22:23:12.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.052+0000 7fabeaea3700 1 -- 172.21.15.156:0/2938261765 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe4130da0 con 0x7fabe409bc70 2023-09-30T22:23:12.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.052+0000 7fabeaea3700 1 -- 172.21.15.156:0/2938261765 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe4125f10 con 0x7fabe409bc70 2023-09-30T22:23:12.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.052+0000 7efdda1b9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7efdd4072310 0x7efdd4138b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:12.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.052+0000 7efdda1b9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efdd4139090 0x7efdd413b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:12.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.052+0000 7efdda1b9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd4096310 con 0x7efdd4133bb0 2023-09-30T22:23:12.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.052+0000 7efdda1b9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd4096ca0 con 0x7efdd4072310 2023-09-30T22:23:12.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.052+0000 7efdda1b9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd40969e0 con 0x7efdd4139090 2023-09-30T22:23:12.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.053+0000 7efdd2ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7efdd4072310 0x7efdd4138b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:12.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.053+0000 7efdd37fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7efdd4133bb0 0x7efdd4133f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:42536/0 (socket says 172.21.15.156:42536) 2023-09-30T22:23:12.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.053+0000 7efdd2ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7efdd4072310 0x7efdd4138b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44422/0 (socket says 172.21.15.156:44422) 2023-09-30T22:23:12.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.053+0000 7efdd37fe700 1 -- 172.21.15.156:0/2585540828 learned_addr learned my addr 172.21.15.156:0/2585540828 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:12.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.053+0000 7efdd2ffd700 1 -- 172.21.15.156:0/2585540828 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efdd4139090 msgr2=0x7efdd413b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:12.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.053+0000 7efdd2ffd700 1 --2- 172.21.15.156:0/2585540828 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efdd4139090 0x7efdd413b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.053+0000 7efdd2ffd700 1 -- 172.21.15.156:0/2585540828 >> v1:172.21.15.156:6789/0 conn(0x7efdd4133bb0 legacy=0x7efdd4133f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:12.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.053+0000 7efdd2ffd700 1 -- 172.21.15.156:0/2585540828 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd41339b0 con 0x7efdd4072310 2023-09-30T22:23:12.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.053+0000 7fabe17fa700 1 -- 172.21.15.156:0/2938261765 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fabd401a400 con 0x7fabe409bc70 2023-09-30T22:23:12.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.053+0000 7efdd2ffd700 1 --2- 172.21.15.156:0/2585540828 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efdd4072310 0x7efdd4138b50 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7efdc4009840 tx=0x7efdc4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5beaa7c9a5ecbb2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:12.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.053+0000 7efdd27fc700 1 -- 172.21.15.156:0/2585540828 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc4011830 con 0x7efdd4072310 2023-09-30T22:23:12.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.053+0000 7efdd27fc700 1 -- 172.21.15.156:0/2585540828 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc4011990 con 0x7efdd4072310 2023-09-30T22:23:12.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.053+0000 7efdd27fc700 1 -- 172.21.15.156:0/2585540828 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc4011d20 con 0x7efdd4072310 2023-09-30T22:23:12.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.053+0000 7fabe17fa700 1 -- 172.21.15.156:0/2938261765 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fabd4010dd0 con 0x7fabe409bc70 2023-09-30T22:23:12.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.054+0000 7fabeaea3700 1 -- 172.21.15.156:0/2938261765 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe409cc80 con 0x7fabe409bc70 2023-09-30T22:23:12.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.054+0000 7f5484ff9700 1 -- 172.21.15.156:0/1805845941 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f548001b400 con 0x7f5488133ad0 2023-09-30T22:23:12.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.054+0000 7efdda1b9700 1 -- 172.21.15.156:0/2585540828 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efdd4072310 msgr2=0x7efdd4138b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:12.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.054+0000 7efdda1b9700 1 --2- 172.21.15.156:0/2585540828 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efdd4072310 0x7efdd4138b50 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7efdc4009840 tx=0x7efdc4009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:12.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.054+0000 7efdda1b9700 1 -- 172.21.15.156:0/2585540828 shutdown_connections 2023-09-30T22:23:12.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.054+0000 7efdda1b9700 1 --2- 172.21.15.156:0/2585540828 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efdd4139090 0x7efdd413b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.054+0000 7efdda1b9700 1 --2- 172.21.15.156:0/2585540828 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efdd4072310 0x7efdd4138b50 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.054+0000 7efdda1b9700 1 -- 172.21.15.156:0/2585540828 >> 172.21.15.156:0/2585540828 conn(0x7efdd409eda0 msgr2=0x7efdd409f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:12.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.054+0000 7efdda1b9700 1 -- 172.21.15.156:0/2585540828 shutdown_connections 2023-09-30T22:23:12.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.054+0000 7efdda1b9700 1 -- 172.21.15.156:0/2585540828 wait complete. 2023-09-30T22:23:12.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.056+0000 7efdda1b9700 1 Processor -- start 2023-09-30T22:23:12.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.056+0000 7efdda1b9700 1 -- start start 2023-09-30T22:23:12.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.057+0000 7efdda1b9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efdd4072310 0x7efdd41cc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:12.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.057+0000 7efdda1b9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efdd4133bb0 0x7efdd41cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:12.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.057+0000 7efdda1b9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efdd4139090 0x7efdd41cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:12.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.057+0000 7efdda1b9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd4134920 con 0x7efdd4139090 2023-09-30T22:23:12.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.057+0000 7efdda1b9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd4138530 con 0x7efdd4072310 2023-09-30T22:23:12.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.057+0000 7efdda1b9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efdd4138170 con 0x7efdd4133bb0 2023-09-30T22:23:12.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.057+0000 7efdd3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efdd4139090 0x7efdd41cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:12.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.057+0000 7efdd3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efdd4139090 0x7efdd41cd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44432/0 (socket says 172.21.15.156:44432) 2023-09-30T22:23:12.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.057+0000 7efdd3fff700 1 -- 172.21.15.156:0/2769165078 learned_addr learned my addr 172.21.15.156:0/2769165078 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:12.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.057+0000 7efdd2ffd700 1 --2- 172.21.15.156:0/2769165078 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efdd4133bb0 0x7efdd41cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:12.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.057+0000 7efdd3fff700 1 -- 172.21.15.156:0/2769165078 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efdd4133bb0 msgr2=0x7efdd41cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:12.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.057+0000 7efdd3fff700 1 --2- 172.21.15.156:0/2769165078 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efdd4133bb0 0x7efdd41cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.057+0000 7efdd3fff700 1 -- 172.21.15.156:0/2769165078 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efdd4072310 msgr2=0x7efdd41cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:12.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.057+0000 7efdd3fff700 1 --2- 172.21.15.156:0/2769165078 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efdd4072310 0x7efdd41cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.057+0000 7efdd3fff700 1 -- 172.21.15.156:0/2769165078 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc40094a0 con 0x7efdd4139090 2023-09-30T22:23:12.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.057+0000 7efdd2ffd700 1 --2- 172.21.15.156:0/2769165078 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efdd4133bb0 0x7efdd41cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:12.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.057+0000 7efdd3fff700 1 --2- 172.21.15.156:0/2769165078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efdd4139090 0x7efdd41cd3f0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7efdc800b480 tx=0x7efdc800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:12.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.058+0000 7efdbbfff700 1 -- 172.21.15.156:0/2769165078 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc8011830 con 0x7efdd4139090 2023-09-30T22:23:12.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.058+0000 7efdbbfff700 1 -- 172.21.15.156:0/2769165078 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc8011990 con 0x7efdd4139090 2023-09-30T22:23:12.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.058+0000 7efdbbfff700 1 -- 172.21.15.156:0/2769165078 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc8011d40 con 0x7efdd4139090 2023-09-30T22:23:12.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.059+0000 7efdda1b9700 1 -- 172.21.15.156:0/2769165078 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd4136ff0 con 0x7efdd4139090 2023-09-30T22:23:12.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.059+0000 7efdda1b9700 1 -- 172.21.15.156:0/2769165078 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd409bde0 con 0x7efdd4139090 2023-09-30T22:23:12.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.060+0000 7efdbbfff700 1 -- 172.21.15.156:0/2769165078 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efdc801a400 con 0x7efdd4139090 2023-09-30T22:23:12.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.059+0000 7fabe17fa700 1 -- 172.21.15.156:0/2938261765 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fabd4015020 con 0x7fabe409bc70 2023-09-30T22:23:12.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.060+0000 7efdbbfff700 1 -- 172.21.15.156:0/2769165078 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efdc803f5d0 con 0x7efdd4139090 2023-09-30T22:23:12.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.060+0000 7efdda1b9700 1 -- 172.21.15.156:0/2769165078 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd4072df0 con 0x7efdd4139090 2023-09-30T22:23:12.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.065+0000 7efdbbfff700 1 -- 172.21.15.156:0/2769165078 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efdc8015030 con 0x7efdd4139090 2023-09-30T22:23:12.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.224+0000 7fba2bf2c700 1 -- 172.21.15.156:0/3312831083 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fba2404f2a0 con 0x7fba2409bc70 2023-09-30T22:23:12.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.224+0000 7fba1a7fc700 1 -- 172.21.15.156:0/3312831083 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fba2001b410 con 0x7fba2409bc70 2023-09-30T22:23:12.225 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:12.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.227+0000 7fba2bf2c700 1 -- 172.21.15.156:0/3312831083 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba2409bc70 msgr2=0x7fba24134dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:12.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.227+0000 7fba2bf2c700 1 --2- 172.21.15.156:0/3312831083 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba2409bc70 0x7fba24134dd0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fba241324d0 tx=0x7fba20004750 comp rx=0 tx=0).stop 2023-09-30T22:23:12.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.227+0000 7fba2bf2c700 1 -- 172.21.15.156:0/3312831083 shutdown_connections 2023-09-30T22:23:12.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.227+0000 7fba2bf2c700 1 --2- 172.21.15.156:0/3312831083 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fba24131a80 0x7fba24135850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.227+0000 7fba2bf2c700 1 --2- 172.21.15.156:0/3312831083 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fba2409bc70 0x7fba24134dd0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.227+0000 7fba2bf2c700 1 --2- 172.21.15.156:0/3312831083 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba2409c7d0 0x7fba24135310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.227+0000 7fba2bf2c700 1 -- 172.21.15.156:0/3312831083 >> 172.21.15.156:0/3312831083 conn(0x7fba240a2980 msgr2=0x7fba2409f820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:12.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.228+0000 7fba2bf2c700 1 -- 172.21.15.156:0/3312831083 shutdown_connections 2023-09-30T22:23:12.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.228+0000 7fba2bf2c700 1 -- 172.21.15.156:0/3312831083 wait complete. 2023-09-30T22:23:12.245 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:12.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.257+0000 7efdda1b9700 1 -- 172.21.15.156:0/2769165078 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efdd41376c0 con 0x7efdd4139090 2023-09-30T22:23:12.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.258+0000 7efdbbfff700 1 -- 172.21.15.156:0/2769165078 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efdc8029090 con 0x7efdd4139090 2023-09-30T22:23:12.258 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:12.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.260+0000 7efdda1b9700 1 -- 172.21.15.156:0/2769165078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efdd4139090 msgr2=0x7efdd41cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:12.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.260+0000 7efdda1b9700 1 --2- 172.21.15.156:0/2769165078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efdd4139090 0x7efdd41cd3f0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7efdc800b480 tx=0x7efdc800b790 comp rx=0 tx=0).stop 2023-09-30T22:23:12.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.260+0000 7efdda1b9700 1 -- 172.21.15.156:0/2769165078 shutdown_connections 2023-09-30T22:23:12.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.260+0000 7efdda1b9700 1 --2- 172.21.15.156:0/2769165078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efdd4139090 0x7efdd41cd3f0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.260+0000 7efdda1b9700 1 --2- 172.21.15.156:0/2769165078 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efdd4072310 0x7efdd41cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.260+0000 7efdda1b9700 1 --2- 172.21.15.156:0/2769165078 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efdd4133bb0 0x7efdd41cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.260+0000 7efdda1b9700 1 -- 172.21.15.156:0/2769165078 >> 172.21.15.156:0/2769165078 conn(0x7efdd409eda0 msgr2=0x7efdd409cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:12.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.260+0000 7efdda1b9700 1 -- 172.21.15.156:0/2769165078 shutdown_connections 2023-09-30T22:23:12.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.260+0000 7efdda1b9700 1 -- 172.21.15.156:0/2769165078 wait complete. 2023-09-30T22:23:12.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:12.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.277+0000 7f548ea44700 1 -- 172.21.15.156:0/1805845941 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f548812d970 con 0x7f5488133ad0 2023-09-30T22:23:12.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.278+0000 7f5484ff9700 1 -- 172.21.15.156:0/1805845941 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5480036090 con 0x7f5488133ad0 2023-09-30T22:23:12.278 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:12.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.280+0000 7f548ea44700 1 -- 172.21.15.156:0/1805845941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5488133ad0 msgr2=0x7f548811e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:12.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.280+0000 7f548ea44700 1 --2- 172.21.15.156:0/1805845941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5488133ad0 0x7f548811e4c0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f5480016000 tx=0x7f5480004ad0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.280+0000 7f548ea44700 1 -- 172.21.15.156:0/1805845941 shutdown_connections 2023-09-30T22:23:12.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.280+0000 7f548ea44700 1 --2- 172.21.15.156:0/1805845941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5488133ad0 0x7f548811e4c0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.280+0000 7f548ea44700 1 --2- 172.21.15.156:0/1805845941 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54881300a0 0x7f548811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.280+0000 7f548ea44700 1 --2- 172.21.15.156:0/1805845941 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54881309f0 0x7f548811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.280+0000 7f548ea44700 1 -- 172.21.15.156:0/1805845941 >> 172.21.15.156:0/1805845941 conn(0x7f5488099c40 msgr2=0x7f5488132020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:12.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.281+0000 7f548ea44700 1 -- 172.21.15.156:0/1805845941 shutdown_connections 2023-09-30T22:23:12.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.281+0000 7f548ea44700 1 -- 172.21.15.156:0/1805845941 wait complete. 2023-09-30T22:23:12.293 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:12.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.296+0000 7fabeaea3700 1 -- 172.21.15.156:0/2938261765 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fabe411c780 con 0x7fabe409bc70 2023-09-30T22:23:12.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.296+0000 7fabe17fa700 1 -- 172.21.15.156:0/2938261765 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fabe411c780 con 0x7fabe409bc70 2023-09-30T22:23:12.297 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:12.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.298+0000 7fabeaea3700 1 -- 172.21.15.156:0/2938261765 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabe409bc70 msgr2=0x7fabe4119400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:12.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.298+0000 7fabeaea3700 1 --2- 172.21.15.156:0/2938261765 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabe409bc70 0x7fabe4119400 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fabd400b480 tx=0x7fabd400b790 comp rx=0 tx=0).stop 2023-09-30T22:23:12.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.298+0000 7fabeaea3700 1 -- 172.21.15.156:0/2938261765 shutdown_connections 2023-09-30T22:23:12.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.298+0000 7fabeaea3700 1 --2- 172.21.15.156:0/2938261765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabe4131980 0x7fabe4119e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.298+0000 7fabeaea3700 1 --2- 172.21.15.156:0/2938261765 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabe409bc70 0x7fabe4119400 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.298+0000 7fabeaea3700 1 --2- 172.21.15.156:0/2938261765 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabe409c5c0 0x7fabe4119940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.298+0000 7fabeaea3700 1 -- 172.21.15.156:0/2938261765 >> 172.21.15.156:0/2938261765 conn(0x7fabe40a2980 msgr2=0x7fabe4071250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:12.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.298+0000 7fabeaea3700 1 -- 172.21.15.156:0/2938261765 shutdown_connections 2023-09-30T22:23:12.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:12.298+0000 7fabeaea3700 1 -- 172.21.15.156:0/2938261765 wait complete. 2023-09-30T22:23:12.311 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:13.246 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:13.273 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:13.295 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:13.312 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:13.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.391+0000 7fac00b2a700 1 Processor -- start 2023-09-30T22:23:13.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.391+0000 7fac00b2a700 1 -- start start 2023-09-30T22:23:13.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.392+0000 7fac00b2a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fabfc131980 0x7fabfc131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.392+0000 7fac00b2a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabfc09c790 0x7fabfc139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.392+0000 7fac00b2a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabfc0a1640 con 0x7fabfc09bc70 2023-09-30T22:23:13.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.392+0000 7fac00b2a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabfc06eb30 con 0x7fabfc131980 2023-09-30T22:23:13.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.392+0000 7fac00b2a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc0a22d0 con 0x7fabfc09c790 2023-09-30T22:23:13.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.392+0000 7fabfa59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fabfc131980 0x7fabfc131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.392+0000 7fabfa59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fabfc131980 0x7fabfc131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44434/0 (socket says 172.21.15.156:44434) 2023-09-30T22:23:13.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.392+0000 7fabfa59c700 1 -- 172.21.15.156:0/1334808739 learned_addr learned my addr 172.21.15.156:0/1334808739 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:13.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.392+0000 7fabf9d9b700 1 --1- 172.21.15.156:0/1334808739 >> v1:172.21.15.156:6789/0 conn(0x7fabfc09bc70 0x7fabfc09c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:42538/0 (socket says 172.21.15.156:42538) 2023-09-30T22:23:13.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.392+0000 7fabfad9d700 1 --2- 172.21.15.156:0/1334808739 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabfc09c790 0x7fabfc139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.392+0000 7fabfa59c700 1 -- 172.21.15.156:0/1334808739 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabfc09c790 msgr2=0x7fabfc139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:13.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.393+0000 7fabfa59c700 1 --2- 172.21.15.156:0/1334808739 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabfc09c790 0x7fabfc139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.393+0000 7fabfa59c700 1 -- 172.21.15.156:0/1334808739 >> v1:172.21.15.156:6789/0 conn(0x7fabfc09bc70 legacy=0x7fabfc09c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.393+0000 7fabfa59c700 1 -- 172.21.15.156:0/1334808739 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabfc131550 con 0x7fabfc131980 2023-09-30T22:23:13.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.393+0000 7fabf959a700 1 -- 172.21.15.156:0/1334808739 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748424596 0 0) 0x7fabfc0a1640 con 0x7fabfc09bc70 2023-09-30T22:23:13.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.393+0000 7fabfa59c700 1 --2- 172.21.15.156:0/1334808739 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabfc131980 0x7fabfc131d50 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fabec006fd0 tx=0x7fabec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507c7eaff8d20808 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:13.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.393+0000 7fabf959a700 1 -- 172.21.15.156:0/1334808739 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec005e30 con 0x7fabfc131980 2023-09-30T22:23:13.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.393+0000 7fabf959a700 1 -- 172.21.15.156:0/1334808739 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabec006030 con 0x7fabfc131980 2023-09-30T22:23:13.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.393+0000 7fabf959a700 1 -- 172.21.15.156:0/1334808739 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec0063a0 con 0x7fabfc131980 2023-09-30T22:23:13.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.394+0000 7fac00b2a700 1 -- 172.21.15.156:0/1334808739 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabfc131980 msgr2=0x7fabfc131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.394+0000 7fac00b2a700 1 --2- 172.21.15.156:0/1334808739 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabfc131980 0x7fabfc131d50 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fabec006fd0 tx=0x7fabec009bd0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.394+0000 7fac00b2a700 1 -- 172.21.15.156:0/1334808739 shutdown_connections 2023-09-30T22:23:13.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.394+0000 7fac00b2a700 1 --2- 172.21.15.156:0/1334808739 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabfc131980 0x7fabfc131d50 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.394+0000 7fac00b2a700 1 --2- 172.21.15.156:0/1334808739 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabfc09c790 0x7fabfc139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.394+0000 7fac00b2a700 1 -- 172.21.15.156:0/1334808739 >> 172.21.15.156:0/1334808739 conn(0x7fabfc0a2980 msgr2=0x7fabfc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:13.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.394+0000 7fac00b2a700 1 -- 172.21.15.156:0/1334808739 shutdown_connections 2023-09-30T22:23:13.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.394+0000 7fac00b2a700 1 -- 172.21.15.156:0/1334808739 wait complete. 2023-09-30T22:23:13.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.396+0000 7fac00b2a700 1 Processor -- start 2023-09-30T22:23:13.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.396+0000 7fac00b2a700 1 -- start start 2023-09-30T22:23:13.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.396+0000 7fac00b2a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabfc09bc70 0x7fabfc11b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.396+0000 7fac00b2a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabfc09c790 0x7fabfc11bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.396+0000 7fac00b2a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabfc131980 0x7fabfc11c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.396+0000 7fac00b2a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc11d2d0 con 0x7fabfc131980 2023-09-30T22:23:13.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.396+0000 7fac00b2a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc0a1c40 con 0x7fabfc09bc70 2023-09-30T22:23:13.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.396+0000 7fac00b2a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc11f1b0 con 0x7fabfc09c790 2023-09-30T22:23:13.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.397+0000 7fabfad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabfc131980 0x7fabfc11c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.397+0000 7fabfad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabfc131980 0x7fabfc11c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44446/0 (socket says 172.21.15.156:44446) 2023-09-30T22:23:13.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.397+0000 7fabfad9d700 1 -- 172.21.15.156:0/2172402544 learned_addr learned my addr 172.21.15.156:0/2172402544 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:13.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.397+0000 7fabfa59c700 1 --2- 172.21.15.156:0/2172402544 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabfc09bc70 0x7fabfc11b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.397+0000 7fabf9d9b700 1 --2- 172.21.15.156:0/2172402544 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabfc09c790 0x7fabfc11bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.397+0000 7fabfad9d700 1 -- 172.21.15.156:0/2172402544 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabfc09c790 msgr2=0x7fabfc11bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.397+0000 7fabfad9d700 1 --2- 172.21.15.156:0/2172402544 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabfc09c790 0x7fabfc11bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.397+0000 7fabfad9d700 1 -- 172.21.15.156:0/2172402544 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabfc09bc70 msgr2=0x7fabfc11b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.397+0000 7fabfad9d700 1 --2- 172.21.15.156:0/2172402544 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabfc09bc70 0x7fabfc11b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.397+0000 7fabfad9d700 1 -- 172.21.15.156:0/2172402544 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec009500 con 0x7fabfc131980 2023-09-30T22:23:13.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.397+0000 7fabfad9d700 1 --2- 172.21.15.156:0/2172402544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabfc131980 0x7fabfc11c1e0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fabf400efc0 tx=0x7fabf400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:13.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.397+0000 7fabeaffd700 1 -- 172.21.15.156:0/2172402544 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf4009ea0 con 0x7fabfc131980 2023-09-30T22:23:13.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.397+0000 7fabeaffd700 1 -- 172.21.15.156:0/2172402544 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf400f040 con 0x7fabfc131980 2023-09-30T22:23:13.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.397+0000 7fac00b2a700 1 -- 172.21.15.156:0/2172402544 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabfc130940 con 0x7fabfc131980 2023-09-30T22:23:13.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.397+0000 7fabeaffd700 1 -- 172.21.15.156:0/2172402544 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf400ced0 con 0x7fabfc131980 2023-09-30T22:23:13.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.398+0000 7fac00b2a700 1 -- 172.21.15.156:0/2172402544 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabfc11e030 con 0x7fabfc131980 2023-09-30T22:23:13.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.398+0000 7fabeaffd700 1 -- 172.21.15.156:0/2172402544 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fabf4014480 con 0x7fabfc131980 2023-09-30T22:23:13.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.398+0000 7fabeaffd700 1 -- 172.21.15.156:0/2172402544 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fabf403ffe0 con 0x7fabfc131980 2023-09-30T22:23:13.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.399+0000 7fac00b2a700 1 -- 172.21.15.156:0/2172402544 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabfc11da80 con 0x7fabfc131980 2023-09-30T22:23:13.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.404+0000 7fabeaffd700 1 -- 172.21.15.156:0/2172402544 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fabf4018070 con 0x7fabfc131980 2023-09-30T22:23:13.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.424+0000 7f2f293b9700 1 Processor -- start 2023-09-30T22:23:13.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.424+0000 7f2f293b9700 1 -- start start 2023-09-30T22:23:13.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.424+0000 7f2f293b9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2f2409d860 0x7f2f2409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.424+0000 7f2f293b9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f24130eb0 0x7f2f24138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.424+0000 7f2f293b9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f2409aaa0 con 0x7f2f2409e170 2023-09-30T22:23:13.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.424+0000 7f2f293b9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f2409f870 con 0x7f2f2409d860 2023-09-30T22:23:13.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.424+0000 7f2f293b9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2409b360 con 0x7f2f24130eb0 2023-09-30T22:23:13.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.424+0000 7f2f22ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2f2409d860 0x7f2f2409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.424+0000 7f2f227fc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f2f2409e170 0x7f2f241307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:42550/0 (socket says 172.21.15.156:42550) 2023-09-30T22:23:13.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.425+0000 7f2f237fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f24130eb0 0x7f2f24138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.425+0000 7f2f227fc700 1 -- 172.21.15.156:0/4229462904 learned_addr learned my addr 172.21.15.156:0/4229462904 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:13.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.425+0000 7f2f22ffd700 1 -- 172.21.15.156:0/4229462904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f24130eb0 msgr2=0x7f2f24138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:13.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.425+0000 7f2f22ffd700 1 --2- 172.21.15.156:0/4229462904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f24130eb0 0x7f2f24138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.425+0000 7f2f22ffd700 1 -- 172.21.15.156:0/4229462904 >> v1:172.21.15.156:6789/0 conn(0x7f2f2409e170 legacy=0x7f2f241307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.425+0000 7f2f22ffd700 1 -- 172.21.15.156:0/4229462904 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2409b620 con 0x7f2f2409d860 2023-09-30T22:23:13.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.425+0000 7f2f21ffb700 1 -- 172.21.15.156:0/4229462904 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855343020 0 0) 0x7f2f2409aaa0 con 0x7f2f2409e170 2023-09-30T22:23:13.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.425+0000 7f2f237fe700 1 --2- 172.21.15.156:0/4229462904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f24130eb0 0x7f2f24138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:13.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.425+0000 7f2f22ffd700 1 --2- 172.21.15.156:0/4229462904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f2409d860 0x7f2f2409dc30 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f2f14009870 tx=0x7f2f14009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754c66c780af8cbb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:13.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.425+0000 7f2f21ffb700 1 -- 172.21.15.156:0/4229462904 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14011830 con 0x7f2f2409d860 2023-09-30T22:23:13.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.425+0000 7f2f21ffb700 1 -- 172.21.15.156:0/4229462904 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f14011990 con 0x7f2f2409d860 2023-09-30T22:23:13.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.425+0000 7f2f21ffb700 1 -- 172.21.15.156:0/4229462904 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14011d20 con 0x7f2f2409d860 2023-09-30T22:23:13.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.426+0000 7f2f293b9700 1 -- 172.21.15.156:0/4229462904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f2409d860 msgr2=0x7f2f2409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.426+0000 7f2f293b9700 1 --2- 172.21.15.156:0/4229462904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f2409d860 0x7f2f2409dc30 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f2f14009870 tx=0x7f2f14009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:13.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.426+0000 7f2f293b9700 1 -- 172.21.15.156:0/4229462904 shutdown_connections 2023-09-30T22:23:13.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.426+0000 7f2f293b9700 1 --2- 172.21.15.156:0/4229462904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f24130eb0 0x7f2f24138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.426+0000 7f2f293b9700 1 --2- 172.21.15.156:0/4229462904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f2409d860 0x7f2f2409dc30 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.426+0000 7f2f293b9700 1 -- 172.21.15.156:0/4229462904 >> 172.21.15.156:0/4229462904 conn(0x7f2f24099c40 msgr2=0x7f2f240a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:13.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.426+0000 7f2f293b9700 1 -- 172.21.15.156:0/4229462904 shutdown_connections 2023-09-30T22:23:13.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.426+0000 7f2f293b9700 1 -- 172.21.15.156:0/4229462904 wait complete. 2023-09-30T22:23:13.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.427+0000 7f2f293b9700 1 Processor -- start 2023-09-30T22:23:13.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.427+0000 7f2f293b9700 1 -- start start 2023-09-30T22:23:13.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.428+0000 7f2f293b9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f2409d860 0x7f2f241cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.428+0000 7f2f293b9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2f2409e170 0x7f2f241cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.428+0000 7f2f293b9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f24130eb0 0x7f2f241ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.428+0000 7f2f293b9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2409c8b0 con 0x7f2f2409d860 2023-09-30T22:23:13.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.428+0000 7f2f293b9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f241bc3a0 con 0x7f2f24130eb0 2023-09-30T22:23:13.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.428+0000 7f2f293b9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f240a0790 con 0x7f2f2409e170 2023-09-30T22:23:13.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.428+0000 7f2f237fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f24130eb0 0x7f2f241ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.428+0000 7f2f237fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f24130eb0 0x7f2f241ccf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59812/0 (socket says 172.21.15.156:59812) 2023-09-30T22:23:13.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.428+0000 7f2f237fe700 1 -- 172.21.15.156:0/4197860359 learned_addr learned my addr 172.21.15.156:0/4197860359 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:13.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.428+0000 7f2f22ffd700 1 --2- 172.21.15.156:0/4197860359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f2409d860 0x7f2f241cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.428+0000 7f2f237fe700 1 -- 172.21.15.156:0/4197860359 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2f2409e170 msgr2=0x7f2f241cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.428+0000 7f2f237fe700 1 --2- 172.21.15.156:0/4197860359 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2f2409e170 0x7f2f241cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.428+0000 7f2f237fe700 1 -- 172.21.15.156:0/4197860359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f2409d860 msgr2=0x7f2f241cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.428+0000 7f2f237fe700 1 --2- 172.21.15.156:0/4197860359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f2409d860 0x7f2f241cc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.428+0000 7f2f237fe700 1 -- 172.21.15.156:0/4197860359 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c009a70 con 0x7f2f24130eb0 2023-09-30T22:23:13.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.428+0000 7f2f237fe700 1 --2- 172.21.15.156:0/4197860359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f24130eb0 0x7f2f241ccf30 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00d380 tx=0x7f2f1c00d690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:13.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.429+0000 7f2f0b7fe700 1 -- 172.21.15.156:0/4197860359 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c003a20 con 0x7f2f24130eb0 2023-09-30T22:23:13.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.429+0000 7f2f293b9700 1 -- 172.21.15.156:0/4197860359 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f140094a0 con 0x7f2f24130eb0 2023-09-30T22:23:13.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.429+0000 7f2f0b7fe700 1 -- 172.21.15.156:0/4197860359 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1c013070 con 0x7f2f24130eb0 2023-09-30T22:23:13.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.429+0000 7f2f0b7fe700 1 -- 172.21.15.156:0/4197860359 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c003d80 con 0x7f2f24130eb0 2023-09-30T22:23:13.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.429+0000 7f2f293b9700 1 -- 172.21.15.156:0/4197860359 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f241be490 con 0x7f2f24130eb0 2023-09-30T22:23:13.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.430+0000 7f2f0b7fe700 1 -- 172.21.15.156:0/4197860359 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2f1c004020 con 0x7f2f24130eb0 2023-09-30T22:23:13.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.430+0000 7f2f293b9700 1 -- 172.21.15.156:0/4197860359 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f2404f2a0 con 0x7f2f24130eb0 2023-09-30T22:23:13.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.430+0000 7f2f0b7fe700 1 -- 172.21.15.156:0/4197860359 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2f1c015070 con 0x7f2f24130eb0 2023-09-30T22:23:13.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.440+0000 7f2f0b7fe700 1 -- 172.21.15.156:0/4197860359 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f1c0208a0 con 0x7f2f24130eb0 2023-09-30T22:23:13.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.470+0000 7f89b2ddc700 1 Processor -- start 2023-09-30T22:23:13.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.471+0000 7f89b2ddc700 1 -- start start 2023-09-30T22:23:13.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.471+0000 7f89b2ddc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89ac09a150 0x7f89ac09e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.471+0000 7f89b2ddc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f89ac09edb0 0x7f89ac09f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.471+0000 7f89b2ddc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89ac133c20 0x7f89ac1340a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.471+0000 7f89b2ddc700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ac09a520 con 0x7f89ac09edb0 2023-09-30T22:23:13.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.471+0000 7f89b2ddc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac09fe00 con 0x7f89ac133c20 2023-09-30T22:23:13.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.471+0000 7f89b2ddc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac06bec0 con 0x7f89ac09a150 2023-09-30T22:23:13.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.471+0000 7f89b0b78700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89ac09a150 0x7f89ac09e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.472+0000 7f89b0b78700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89ac09a150 0x7f89ac09e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55900/0 (socket says 172.21.15.156:55900) 2023-09-30T22:23:13.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.472+0000 7f89b0b78700 1 -- 172.21.15.156:0/2662712183 learned_addr learned my addr 172.21.15.156:0/2662712183 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:13.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.472+0000 7f89b1379700 1 --2- 172.21.15.156:0/2662712183 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89ac133c20 0x7f89ac1340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.472+0000 7f89a3fff700 1 --2- 172.21.15.156:0/2662712183 >> v2:172.21.15.156:3300/0 conn(0x7f89ac09edb0 0x7f89ac09f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.472+0000 7f89b0b78700 1 -- 172.21.15.156:0/2662712183 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89ac133c20 msgr2=0x7f89ac1340a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:13.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.472+0000 7f89b0b78700 1 --2- 172.21.15.156:0/2662712183 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89ac133c20 0x7f89ac1340a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.472+0000 7f89b0b78700 1 -- 172.21.15.156:0/2662712183 >> v2:172.21.15.156:3300/0 conn(0x7f89ac09edb0 msgr2=0x7f89ac09f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:13.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.472+0000 7f89b0b78700 1 --2- 172.21.15.156:0/2662712183 >> v2:172.21.15.156:3300/0 conn(0x7f89ac09edb0 0x7f89ac09f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.472+0000 7f89b0b78700 1 -- 172.21.15.156:0/2662712183 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ac09af80 con 0x7f89ac09a150 2023-09-30T22:23:13.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.472+0000 7f89b0b78700 1 --2- 172.21.15.156:0/2662712183 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89ac09a150 0x7f89ac09e870 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f89a8009920 tx=0x7f89a8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1523066388651a98 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:13.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.472+0000 7f89a37fe700 1 -- 172.21.15.156:0/2662712183 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a8011830 con 0x7f89ac09a150 2023-09-30T22:23:13.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.472+0000 7f89a37fe700 1 -- 172.21.15.156:0/2662712183 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a8011990 con 0x7f89ac09a150 2023-09-30T22:23:13.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.472+0000 7f89a37fe700 1 -- 172.21.15.156:0/2662712183 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a8011d20 con 0x7f89ac09a150 2023-09-30T22:23:13.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.473+0000 7f89b2ddc700 1 -- 172.21.15.156:0/2662712183 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89ac09a150 msgr2=0x7f89ac09e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.473+0000 7f89b2ddc700 1 --2- 172.21.15.156:0/2662712183 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89ac09a150 0x7f89ac09e870 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f89a8009920 tx=0x7f89a8009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:13.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.473+0000 7f89b2ddc700 1 -- 172.21.15.156:0/2662712183 shutdown_connections 2023-09-30T22:23:13.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.473+0000 7f89b2ddc700 1 --2- 172.21.15.156:0/2662712183 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89ac133c20 0x7f89ac1340a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.473+0000 7f89b2ddc700 1 --2- 172.21.15.156:0/2662712183 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89ac09a150 0x7f89ac09e870 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.473+0000 7f89b2ddc700 1 --2- 172.21.15.156:0/2662712183 >> v2:172.21.15.156:3300/0 conn(0x7f89ac09edb0 0x7f89ac09f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.473+0000 7f89b2ddc700 1 -- 172.21.15.156:0/2662712183 >> 172.21.15.156:0/2662712183 conn(0x7f89ac0a4430 msgr2=0x7f89ac0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:13.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.473+0000 7f89b2ddc700 1 -- 172.21.15.156:0/2662712183 shutdown_connections 2023-09-30T22:23:13.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.473+0000 7f89b2ddc700 1 -- 172.21.15.156:0/2662712183 wait complete. 2023-09-30T22:23:13.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.474+0000 7f89b2ddc700 1 Processor -- start 2023-09-30T22:23:13.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.474+0000 7f89b2ddc700 1 -- start start 2023-09-30T22:23:13.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.475+0000 7f89b2ddc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89ac09a150 0x7f89ac11ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.475+0000 7f89b2ddc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89ac09edb0 0x7f89ac11f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.475+0000 7f89b2ddc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89ac133c20 0x7f89ac11f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.475+0000 7f89b2ddc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac120bc0 con 0x7f89ac09a150 2023-09-30T22:23:13.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.475+0000 7f89b2ddc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac1224a0 con 0x7f89ac09edb0 2023-09-30T22:23:13.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.475+0000 7f89b2ddc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac0a1450 con 0x7f89ac133c20 2023-09-30T22:23:13.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.476+0000 7f89a3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89ac09edb0 0x7f89ac11f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.476+0000 7f89a3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89ac09edb0 0x7f89ac11f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59838/0 (socket says 172.21.15.156:59838) 2023-09-30T22:23:13.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.476+0000 7f89a3fff700 1 -- 172.21.15.156:0/3991463698 learned_addr learned my addr 172.21.15.156:0/3991463698 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:13.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.476+0000 7f89b1379700 1 --2- 172.21.15.156:0/3991463698 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89ac133c20 0x7f89ac11f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.476+0000 7f89b0b78700 1 --2- 172.21.15.156:0/3991463698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89ac09a150 0x7f89ac11ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.476+0000 7f8930f20700 1 Processor -- start 2023-09-30T22:23:13.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.476+0000 7f8930f20700 1 -- start start 2023-09-30T22:23:13.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.476+0000 7f89a3fff700 1 -- 172.21.15.156:0/3991463698 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89ac133c20 msgr2=0x7f89ac11f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.476+0000 7f89a3fff700 1 --2- 172.21.15.156:0/3991463698 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89ac133c20 0x7f89ac11f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.476+0000 7f89a3fff700 1 -- 172.21.15.156:0/3991463698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89ac09a150 msgr2=0x7f89ac11ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.476+0000 7f89a3fff700 1 --2- 172.21.15.156:0/3991463698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89ac09a150 0x7f89ac11ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.476+0000 7f89a3fff700 1 -- 172.21.15.156:0/3991463698 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a8009550 con 0x7f89ac09edb0 2023-09-30T22:23:13.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.476+0000 7f89a3fff700 1 --2- 172.21.15.156:0/3991463698 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89ac09edb0 0x7f89ac11f010 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f899c00e9b0 tx=0x7f899c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:13.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.476+0000 7f89a17fa700 1 -- 172.21.15.156:0/3991463698 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c009710 con 0x7f89ac09edb0 2023-09-30T22:23:13.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.477+0000 7f8930f20700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f892c09d860 0x7f892c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.477+0000 7f8930f20700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f892c09e170 0x7f892c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.477+0000 7f8930f20700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f892c130ce0 0x7f892c131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.477+0000 7f8930f20700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f892c131670 con 0x7f892c09d860 2023-09-30T22:23:13.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.477+0000 7f8930f20700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f892c09aaa0 con 0x7f892c09e170 2023-09-30T22:23:13.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.477+0000 7f8930f20700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f892c09f870 con 0x7f892c130ce0 2023-09-30T22:23:13.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.477+0000 7f892a59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f892c09d860 0x7f892c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.477+0000 7f892a59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f892c09d860 0x7f892c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44510/0 (socket says 172.21.15.156:44510) 2023-09-30T22:23:13.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.477+0000 7f892a59c700 1 -- 172.21.15.156:0/1937273673 learned_addr learned my addr 172.21.15.156:0/1937273673 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:13.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.477+0000 7f892a59c700 1 -- 172.21.15.156:0/1937273673 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f892c130ce0 msgr2=0x7f892c131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:13.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.477+0000 7f892a59c700 1 --2- 172.21.15.156:0/1937273673 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f892c130ce0 0x7f892c131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.477+0000 7f892a59c700 1 -- 172.21.15.156:0/1937273673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f892c09e170 msgr2=0x7f892c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:13.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.477+0000 7f892a59c700 1 --2- 172.21.15.156:0/1937273673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f892c09e170 0x7f892c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.477+0000 7f892a59c700 1 -- 172.21.15.156:0/1937273673 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f892c09b360 con 0x7f892c09d860 2023-09-30T22:23:13.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.477+0000 7f892a59c700 1 --2- 172.21.15.156:0/1937273673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f892c09d860 0x7f892c09dc30 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f891c009920 tx=0x7f891c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5561ada22a177501 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:13.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.477+0000 7f892959a700 1 -- 172.21.15.156:0/1937273673 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c00ba20 con 0x7f892c09d860 2023-09-30T22:23:13.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.478+0000 7f892959a700 1 -- 172.21.15.156:0/1937273673 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891c00bb80 con 0x7f892c09d860 2023-09-30T22:23:13.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.478+0000 7f892959a700 1 -- 172.21.15.156:0/1937273673 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c009e70 con 0x7f892c09d860 2023-09-30T22:23:13.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.476+0000 7f89b2ddc700 1 -- 172.21.15.156:0/3991463698 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89ac120570 con 0x7f89ac09edb0 2023-09-30T22:23:13.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.477+0000 7f89b2ddc700 1 -- 172.21.15.156:0/3991463698 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ac120d80 con 0x7f89ac09edb0 2023-09-30T22:23:13.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.477+0000 7f89a17fa700 1 -- 172.21.15.156:0/3991463698 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899c00ee50 con 0x7f89ac09edb0 2023-09-30T22:23:13.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.477+0000 7f89a17fa700 1 -- 172.21.15.156:0/3991463698 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c00ca70 con 0x7f89ac09edb0 2023-09-30T22:23:13.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.478+0000 7f89b2ddc700 1 -- 172.21.15.156:0/3991463698 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f898c0052e0 con 0x7f89ac09edb0 2023-09-30T22:23:13.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.478+0000 7f8930f20700 1 -- 172.21.15.156:0/1937273673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f892c09d860 msgr2=0x7f892c09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.478+0000 7f8930f20700 1 --2- 172.21.15.156:0/1937273673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f892c09d860 0x7f892c09dc30 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f891c009920 tx=0x7f891c009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:13.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.478+0000 7f8930f20700 1 -- 172.21.15.156:0/1937273673 shutdown_connections 2023-09-30T22:23:13.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.478+0000 7f8930f20700 1 --2- 172.21.15.156:0/1937273673 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f892c130ce0 0x7f892c131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.478+0000 7f8930f20700 1 --2- 172.21.15.156:0/1937273673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f892c09d860 0x7f892c09dc30 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.478+0000 7f8930f20700 1 --2- 172.21.15.156:0/1937273673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f892c09e170 0x7f892c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.478+0000 7f8930f20700 1 -- 172.21.15.156:0/1937273673 >> 172.21.15.156:0/1937273673 conn(0x7f892c099c40 msgr2=0x7f892c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:13.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.478+0000 7f8930f20700 1 -- 172.21.15.156:0/1937273673 shutdown_connections 2023-09-30T22:23:13.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.479+0000 7f8930f20700 1 -- 172.21.15.156:0/1937273673 wait complete. 2023-09-30T22:23:13.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.479+0000 7f89a17fa700 1 -- 172.21.15.156:0/3991463698 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f899c00cbd0 con 0x7f89ac09edb0 2023-09-30T22:23:13.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.479+0000 7f89a17fa700 1 -- 172.21.15.156:0/3991463698 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f899c03fb00 con 0x7f89ac09edb0 2023-09-30T22:23:13.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.480+0000 7f8930f20700 1 Processor -- start 2023-09-30T22:23:13.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.480+0000 7f8930f20700 1 -- start start 2023-09-30T22:23:13.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.480+0000 7f8930f20700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f892c09d860 0x7f892c122b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.480+0000 7f8930f20700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f892c09e170 0x7f892c1230b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.480+0000 7f8930f20700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f892c130ce0 0x7f892c1235f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.480+0000 7f8930f20700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892c130aa0 con 0x7f892c09d860 2023-09-30T22:23:13.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.480+0000 7f8930f20700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f892c123f40 con 0x7f892c130ce0 2023-09-30T22:23:13.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.480+0000 7f8930f20700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f892c0a0640 con 0x7f892c09e170 2023-09-30T22:23:13.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.480+0000 7f892ad9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f892c130ce0 0x7f892c1235f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.480+0000 7f892ad9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f892c130ce0 0x7f892c1235f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59846/0 (socket says 172.21.15.156:59846) 2023-09-30T22:23:13.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.480+0000 7f892ad9d700 1 -- 172.21.15.156:0/619862432 learned_addr learned my addr 172.21.15.156:0/619862432 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:13.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.480+0000 7f8929d9b700 1 --2- 172.21.15.156:0/619862432 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f892c09e170 0x7f892c1230b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.480+0000 7f892ad9d700 1 -- 172.21.15.156:0/619862432 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f892c09e170 msgr2=0x7f892c1230b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.480+0000 7f892ad9d700 1 --2- 172.21.15.156:0/619862432 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f892c09e170 0x7f892c1230b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.481+0000 7f892ad9d700 1 -- 172.21.15.156:0/619862432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f892c09d860 msgr2=0x7f892c122b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.481+0000 7f892ad9d700 1 --2- 172.21.15.156:0/619862432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f892c09d860 0x7f892c122b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.481+0000 7f892ad9d700 1 -- 172.21.15.156:0/619862432 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891c009550 con 0x7f892c130ce0 2023-09-30T22:23:13.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.481+0000 7f892ad9d700 1 --2- 172.21.15.156:0/619862432 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f892c130ce0 0x7f892c1235f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f892402d9e0 tx=0x7f892402dcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:13.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.488+0000 7f891affd700 1 -- 172.21.15.156:0/619862432 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892402e950 con 0x7f892c130ce0 2023-09-30T22:23:13.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.488+0000 7f891affd700 1 -- 172.21.15.156:0/619862432 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892402ead0 con 0x7f892c130ce0 2023-09-30T22:23:13.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.488+0000 7f891affd700 1 -- 172.21.15.156:0/619862432 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892402ee80 con 0x7f892c130ce0 2023-09-30T22:23:13.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.488+0000 7f8930f20700 1 -- 172.21.15.156:0/619862432 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f892c1247a0 con 0x7f892c130ce0 2023-09-30T22:23:13.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.488+0000 7f8930f20700 1 -- 172.21.15.156:0/619862432 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f892c126390 con 0x7f892c130ce0 2023-09-30T22:23:13.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.488+0000 7f89a17fa700 1 -- 172.21.15.156:0/3991463698 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f899c01b3b0 con 0x7f89ac09edb0 2023-09-30T22:23:13.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.489+0000 7f891affd700 1 -- 172.21.15.156:0/619862432 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f892403f3b0 con 0x7f892c130ce0 2023-09-30T22:23:13.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.489+0000 7f891affd700 1 -- 172.21.15.156:0/619862432 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8924006e40 con 0x7f892c130ce0 2023-09-30T22:23:13.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.489+0000 7f8930f20700 1 -- 172.21.15.156:0/619862432 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f892c125fb0 con 0x7f892c130ce0 2023-09-30T22:23:13.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.498+0000 7f891affd700 1 -- 172.21.15.156:0/619862432 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f892c125fb0 con 0x7f892c130ce0 2023-09-30T22:23:13.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.630+0000 7fac00b2a700 1 -- 172.21.15.156:0/2172402544 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fabfc04f2a0 con 0x7fabfc131980 2023-09-30T22:23:13.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.631+0000 7fabeaffd700 1 -- 172.21.15.156:0/2172402544 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fabf402b090 con 0x7fabfc131980 2023-09-30T22:23:13.632 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:13.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.633+0000 7fac00b2a700 1 -- 172.21.15.156:0/2172402544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabfc131980 msgr2=0x7fabfc11c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.633+0000 7fac00b2a700 1 --2- 172.21.15.156:0/2172402544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabfc131980 0x7fabfc11c1e0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fabf400efc0 tx=0x7fabf400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.633+0000 7fac00b2a700 1 -- 172.21.15.156:0/2172402544 shutdown_connections 2023-09-30T22:23:13.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.633+0000 7fac00b2a700 1 --2- 172.21.15.156:0/2172402544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabfc131980 0x7fabfc11c1e0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.633+0000 7fac00b2a700 1 --2- 172.21.15.156:0/2172402544 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabfc09bc70 0x7fabfc11b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.633+0000 7fac00b2a700 1 --2- 172.21.15.156:0/2172402544 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabfc09c790 0x7fabfc11bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.633+0000 7fac00b2a700 1 -- 172.21.15.156:0/2172402544 >> 172.21.15.156:0/2172402544 conn(0x7fabfc0a2980 msgr2=0x7fabfc1b8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:13.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.633+0000 7fac00b2a700 1 -- 172.21.15.156:0/2172402544 shutdown_connections 2023-09-30T22:23:13.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.633+0000 7fac00b2a700 1 -- 172.21.15.156:0/2172402544 wait complete. 2023-09-30T22:23:13.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.641+0000 7f2f293b9700 1 -- 172.21.15.156:0/4197860359 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2f241bbdf0 con 0x7f2f24130eb0 2023-09-30T22:23:13.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.641+0000 7f2f0b7fe700 1 -- 172.21.15.156:0/4197860359 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2f1c01e020 con 0x7f2f24130eb0 2023-09-30T22:23:13.642 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:13.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.643+0000 7f2f293b9700 1 -- 172.21.15.156:0/4197860359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f24130eb0 msgr2=0x7f2f241ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.643+0000 7f2f293b9700 1 --2- 172.21.15.156:0/4197860359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f24130eb0 0x7f2f241ccf30 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00d380 tx=0x7f2f1c00d690 comp rx=0 tx=0).stop 2023-09-30T22:23:13.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.643+0000 7f2f293b9700 1 -- 172.21.15.156:0/4197860359 shutdown_connections 2023-09-30T22:23:13.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.643+0000 7f2f293b9700 1 --2- 172.21.15.156:0/4197860359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2f24130eb0 0x7f2f241ccf30 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.643+0000 7f2f293b9700 1 --2- 172.21.15.156:0/4197860359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f2409d860 0x7f2f241cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.643+0000 7f2f293b9700 1 --2- 172.21.15.156:0/4197860359 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2f2409e170 0x7f2f241cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.643+0000 7f2f293b9700 1 -- 172.21.15.156:0/4197860359 >> 172.21.15.156:0/4197860359 conn(0x7f2f24099c40 msgr2=0x7f2f240a23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:13.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.643+0000 7f2f293b9700 1 -- 172.21.15.156:0/4197860359 shutdown_connections 2023-09-30T22:23:13.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.644+0000 7f2f293b9700 1 -- 172.21.15.156:0/4197860359 wait complete. 2023-09-30T22:23:13.647 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:13.656 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:13.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.682+0000 7f89b2ddc700 1 -- 172.21.15.156:0/3991463698 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f898c005590 con 0x7f89ac09edb0 2023-09-30T22:23:13.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.683+0000 7f89a17fa700 1 -- 172.21.15.156:0/3991463698 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f899c017020 con 0x7f89ac09edb0 2023-09-30T22:23:13.683 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:13.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.684+0000 7f89b2ddc700 1 -- 172.21.15.156:0/3991463698 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89ac09edb0 msgr2=0x7f89ac11f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.684+0000 7f89b2ddc700 1 --2- 172.21.15.156:0/3991463698 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89ac09edb0 0x7f89ac11f010 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f899c00e9b0 tx=0x7f899c00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.685+0000 7f89b2ddc700 1 -- 172.21.15.156:0/3991463698 shutdown_connections 2023-09-30T22:23:13.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.685+0000 7f89b2ddc700 1 --2- 172.21.15.156:0/3991463698 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89ac133c20 0x7f89ac11f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.685+0000 7f89b2ddc700 1 --2- 172.21.15.156:0/3991463698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89ac09a150 0x7f89ac11ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.685+0000 7f89b2ddc700 1 --2- 172.21.15.156:0/3991463698 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89ac09edb0 0x7f89ac11f010 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.685+0000 7f89b2ddc700 1 -- 172.21.15.156:0/3991463698 >> 172.21.15.156:0/3991463698 conn(0x7f89ac0a4430 msgr2=0x7f89ac071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:13.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.685+0000 7f89b2ddc700 1 -- 172.21.15.156:0/3991463698 shutdown_connections 2023-09-30T22:23:13.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.685+0000 7f89b2ddc700 1 -- 172.21.15.156:0/3991463698 wait complete. 2023-09-30T22:23:13.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:13.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.708+0000 7f8930f20700 1 -- 172.21.15.156:0/619862432 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f892c125fb0 con 0x7f892c130ce0 2023-09-30T22:23:13.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.709+0000 7f891affd700 1 -- 172.21.15.156:0/619862432 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f892c125fb0 con 0x7f892c130ce0 2023-09-30T22:23:13.709 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:13.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.711+0000 7f8930f20700 1 -- 172.21.15.156:0/619862432 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f892c130ce0 msgr2=0x7f892c1235f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.711+0000 7f8930f20700 1 --2- 172.21.15.156:0/619862432 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f892c130ce0 0x7f892c1235f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f892402d9e0 tx=0x7f892402dcf0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.711+0000 7f8930f20700 1 -- 172.21.15.156:0/619862432 shutdown_connections 2023-09-30T22:23:13.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.711+0000 7f8930f20700 1 --2- 172.21.15.156:0/619862432 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f892c130ce0 0x7f892c1235f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.711+0000 7f8930f20700 1 --2- 172.21.15.156:0/619862432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f892c09d860 0x7f892c122b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.711+0000 7f8930f20700 1 --2- 172.21.15.156:0/619862432 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f892c09e170 0x7f892c1230b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.711+0000 7f8930f20700 1 -- 172.21.15.156:0/619862432 >> 172.21.15.156:0/619862432 conn(0x7f892c099c40 msgr2=0x7f892c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:13.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.711+0000 7f8930f20700 1 -- 172.21.15.156:0/619862432 shutdown_connections 2023-09-30T22:23:13.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:13.711+0000 7f8930f20700 1 -- 172.21.15.156:0/619862432 wait complete. 2023-09-30T22:23:13.723 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:14.648 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:14.657 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:14.698 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:14.724 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:14.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.783+0000 7f0c9f97a700 1 Processor -- start 2023-09-30T22:23:14.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.784+0000 7f0c9f97a700 1 -- start start 2023-09-30T22:23:14.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.784+0000 7f0c9f97a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c98099e20 0x7f0c9809a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.784+0000 7f0c9f97a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c9809a730 0x7f0c98130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.784+0000 7f0c9f97a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c98099a60 con 0x7f0c98130890 2023-09-30T22:23:14.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.784+0000 7f0c9f97a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9809bf50 con 0x7f0c9809a730 2023-09-30T22:23:14.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.784+0000 7f0c9f97a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9809b230 con 0x7f0c98099e20 2023-09-30T22:23:14.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.784+0000 7f0c9df17700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f0c98130890 0x7f0c98137680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:42564/0 (socket says 172.21.15.156:42564) 2023-09-30T22:23:14.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.784+0000 7f0c9df17700 1 -- 172.21.15.156:0/1106854017 learned_addr learned my addr 172.21.15.156:0/1106854017 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:14.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.784+0000 7f0c9cf15700 1 --2- 172.21.15.156:0/1106854017 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c9809a730 0x7f0c98130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.784+0000 7f0c9d716700 1 --2- 172.21.15.156:0/1106854017 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c98099e20 0x7f0c9809a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.785+0000 7f0c8ffff700 1 -- 172.21.15.156:0/1106854017 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 224251984 0 0) 0x7f0c98099a60 con 0x7f0c98130890 2023-09-30T22:23:14.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.785+0000 7f0c8ffff700 1 -- 172.21.15.156:0/1106854017 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c840035b0 con 0x7f0c98130890 2023-09-30T22:23:14.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.785+0000 7f0c9cf15700 1 -- 172.21.15.156:0/1106854017 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c98099e20 msgr2=0x7f0c9809a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:14.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.785+0000 7f0c9cf15700 1 --2- 172.21.15.156:0/1106854017 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c98099e20 0x7f0c9809a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.785+0000 7f0c9cf15700 1 -- 172.21.15.156:0/1106854017 >> v1:172.21.15.156:6789/0 conn(0x7f0c98130890 legacy=0x7f0c98137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.785+0000 7f0c9cf15700 1 -- 172.21.15.156:0/1106854017 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9809bb90 con 0x7f0c9809a730 2023-09-30T22:23:14.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.785+0000 7f0c9cf15700 1 --2- 172.21.15.156:0/1106854017 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c9809a730 0x7f0c98130350 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0c88009870 tx=0x7f0c88009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d314cef5a9eedc78 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:14.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.785+0000 7f0c8ffff700 1 -- 172.21.15.156:0/1106854017 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c88011830 con 0x7f0c9809a730 2023-09-30T22:23:14.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.785+0000 7f0c8ffff700 1 -- 172.21.15.156:0/1106854017 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c88011990 con 0x7f0c9809a730 2023-09-30T22:23:14.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.785+0000 7f0c8ffff700 1 -- 172.21.15.156:0/1106854017 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c88011d00 con 0x7f0c9809a730 2023-09-30T22:23:14.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.786+0000 7f0c9f97a700 1 -- 172.21.15.156:0/1106854017 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c9809a730 msgr2=0x7f0c98130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.786+0000 7f0c9f97a700 1 --2- 172.21.15.156:0/1106854017 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c9809a730 0x7f0c98130350 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0c88009870 tx=0x7f0c88009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:14.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.786+0000 7f0c9f97a700 1 -- 172.21.15.156:0/1106854017 shutdown_connections 2023-09-30T22:23:14.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.786+0000 7f0c9f97a700 1 --2- 172.21.15.156:0/1106854017 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c98099e20 0x7f0c9809a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.786+0000 7f0c9f97a700 1 --2- 172.21.15.156:0/1106854017 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c9809a730 0x7f0c98130350 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.786+0000 7f0c9f97a700 1 -- 172.21.15.156:0/1106854017 >> 172.21.15.156:0/1106854017 conn(0x7f0c980a2980 msgr2=0x7f0c980a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:14.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.786+0000 7f0c9f97a700 1 -- 172.21.15.156:0/1106854017 shutdown_connections 2023-09-30T22:23:14.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.786+0000 7f0c9f97a700 1 -- 172.21.15.156:0/1106854017 wait complete. 2023-09-30T22:23:14.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.788+0000 7f0c9f97a700 1 Processor -- start 2023-09-30T22:23:14.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.788+0000 7f0c9f97a700 1 -- start start 2023-09-30T22:23:14.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.788+0000 7f0c9f97a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c98099e20 0x7f0c98138500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.788+0000 7f0c9f97a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c9809a730 0x7f0c98138a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.788+0000 7f0c9f97a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c98130890 0x7f0c981c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.788+0000 7f0c9f97a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c980a12b0 con 0x7f0c9809a730 2023-09-30T22:23:14.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.788+0000 7f0c9f97a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9809b470 con 0x7f0c98130890 2023-09-30T22:23:14.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.788+0000 7f0c9f97a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c981393c0 con 0x7f0c98099e20 2023-09-30T22:23:14.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.788+0000 7f0c9cf15700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c9809a730 0x7f0c98138a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.788+0000 7f0c9cf15700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c9809a730 0x7f0c98138a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44528/0 (socket says 172.21.15.156:44528) 2023-09-30T22:23:14.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.788+0000 7f0c9cf15700 1 -- 172.21.15.156:0/3493829496 learned_addr learned my addr 172.21.15.156:0/3493829496 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:14.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.789+0000 7f0c9d716700 1 --2- 172.21.15.156:0/3493829496 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c98099e20 0x7f0c98138500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.789+0000 7f0c9cf15700 1 -- 172.21.15.156:0/3493829496 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c98099e20 msgr2=0x7f0c98138500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.789+0000 7f0c9cf15700 1 --2- 172.21.15.156:0/3493829496 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c98099e20 0x7f0c98138500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.789+0000 7f0c9df17700 1 --2- 172.21.15.156:0/3493829496 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c98130890 0x7f0c981c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.789+0000 7f0c9cf15700 1 -- 172.21.15.156:0/3493829496 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c98130890 msgr2=0x7f0c981c5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.789+0000 7f0c9cf15700 1 --2- 172.21.15.156:0/3493829496 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c98130890 0x7f0c981c5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.789+0000 7f0c9cf15700 1 -- 172.21.15.156:0/3493829496 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c880094a0 con 0x7f0c9809a730 2023-09-30T22:23:14.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.789+0000 7f0c9df17700 1 --2- 172.21.15.156:0/3493829496 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c98130890 0x7f0c981c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:23:14.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.789+0000 7f0c9cf15700 1 --2- 172.21.15.156:0/3493829496 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c9809a730 0x7f0c98138a40 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f0c88009bc0 tx=0x7f0c88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:14.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.789+0000 7f0c8dffb700 1 -- 172.21.15.156:0/3493829496 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c88004550 con 0x7f0c9809a730 2023-09-30T22:23:14.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.789+0000 7f0c8dffb700 1 -- 172.21.15.156:0/3493829496 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8801f070 con 0x7f0c9809a730 2023-09-30T22:23:14.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.789+0000 7f0c8dffb700 1 -- 172.21.15.156:0/3493829496 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c880038a0 con 0x7f0c9809a730 2023-09-30T22:23:14.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.789+0000 7f0c9f97a700 1 -- 172.21.15.156:0/3493829496 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c98135500 con 0x7f0c9809a730 2023-09-30T22:23:14.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.790+0000 7f0c9f97a700 1 -- 172.21.15.156:0/3493829496 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c98137870 con 0x7f0c9809a730 2023-09-30T22:23:14.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.791+0000 7f0c9f97a700 1 -- 172.21.15.156:0/3493829496 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c98136d30 con 0x7f0c9809a730 2023-09-30T22:23:14.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.791+0000 7f0c8dffb700 1 -- 172.21.15.156:0/3493829496 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c88003a00 con 0x7f0c9809a730 2023-09-30T22:23:14.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.791+0000 7f0c8dffb700 1 -- 172.21.15.156:0/3493829496 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0c88021070 con 0x7f0c9809a730 2023-09-30T22:23:14.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.799+0000 7f0c8dffb700 1 -- 172.21.15.156:0/3493829496 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c98136d30 con 0x7f0c9809a730 2023-09-30T22:23:14.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.830+0000 7f83a891c700 1 Processor -- start 2023-09-30T22:23:14.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.831+0000 7f83a891c700 1 -- start start 2023-09-30T22:23:14.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.831+0000 7f83a891c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f83a412d380 0x7f83a412d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.831+0000 7f83a891c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83a409a5a0 0x7f83a4138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.831+0000 7f83a891c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a409bb90 con 0x7f83a4099a60 2023-09-30T22:23:14.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.831+0000 7f83a891c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a409c210 con 0x7f83a409a5a0 2023-09-30T22:23:14.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.831+0000 7f83a891c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83a409ced0 con 0x7f83a412d380 2023-09-30T22:23:14.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.831+0000 7f83a2d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83a409a5a0 0x7f83a4138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.831+0000 7f83a1d9b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f83a4099a60 0x7f83a4099e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:42580/0 (socket says 172.21.15.156:42580) 2023-09-30T22:23:14.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.831+0000 7f83a1d9b700 1 -- 172.21.15.156:0/37808898 learned_addr learned my addr 172.21.15.156:0/37808898 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:14.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.832+0000 7f83a2d9d700 1 -- 172.21.15.156:0/37808898 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f83a412d380 msgr2=0x7f83a412d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:14.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.832+0000 7f83a159a700 1 -- 172.21.15.156:0/37808898 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138583618 0 0) 0x7f83a409bb90 con 0x7f83a4099a60 2023-09-30T22:23:14.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.832+0000 7f83a2d9d700 1 --2- 172.21.15.156:0/37808898 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f83a412d380 0x7f83a412d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.832+0000 7f83a2d9d700 1 -- 172.21.15.156:0/37808898 >> v1:172.21.15.156:6789/0 conn(0x7f83a4099a60 legacy=0x7f83a4099e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.832+0000 7f83a2d9d700 1 -- 172.21.15.156:0/37808898 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a409ac30 con 0x7f83a409a5a0 2023-09-30T22:23:14.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.832+0000 7f83a2d9d700 1 --2- 172.21.15.156:0/37808898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83a409a5a0 0x7f83a4138620 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f839c009dc0 tx=0x7f839c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db48a9e591f4fe42 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:14.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.832+0000 7f83a159a700 1 -- 172.21.15.156:0/37808898 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c00bdd0 con 0x7f83a409a5a0 2023-09-30T22:23:14.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.832+0000 7f83a159a700 1 -- 172.21.15.156:0/37808898 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839c011460 con 0x7f83a409a5a0 2023-09-30T22:23:14.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.832+0000 7f83a159a700 1 -- 172.21.15.156:0/37808898 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c011810 con 0x7f83a409a5a0 2023-09-30T22:23:14.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.833+0000 7f83a891c700 1 -- 172.21.15.156:0/37808898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83a409a5a0 msgr2=0x7f83a4138620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.833+0000 7f83a891c700 1 --2- 172.21.15.156:0/37808898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83a409a5a0 0x7f83a4138620 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f839c009dc0 tx=0x7f839c00b330 comp rx=0 tx=0).stop 2023-09-30T22:23:14.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.833+0000 7f83a891c700 1 -- 172.21.15.156:0/37808898 shutdown_connections 2023-09-30T22:23:14.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.833+0000 7f83a891c700 1 --2- 172.21.15.156:0/37808898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83a409a5a0 0x7f83a4138620 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.833+0000 7f83a891c700 1 --2- 172.21.15.156:0/37808898 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f83a412d380 0x7f83a412d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.833+0000 7f83a891c700 1 -- 172.21.15.156:0/37808898 >> 172.21.15.156:0/37808898 conn(0x7f83a40a2980 msgr2=0x7f83a40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:14.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.833+0000 7f83a891c700 1 -- 172.21.15.156:0/37808898 shutdown_connections 2023-09-30T22:23:14.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.833+0000 7f83a891c700 1 -- 172.21.15.156:0/37808898 wait complete. 2023-09-30T22:23:14.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.834+0000 7f83a891c700 1 Processor -- start 2023-09-30T22:23:14.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.834+0000 7f83a891c700 1 -- start start 2023-09-30T22:23:14.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.835+0000 7f83a891c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83a4099a60 0x7f83a40708c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.835+0000 7f83a891c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f83a409a5a0 0x7f83a4070e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.835+0000 7f83a891c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83a412d380 0x7f83a4071340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.835+0000 7f83a891c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a41197b0 con 0x7f83a4099a60 2023-09-30T22:23:14.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.835+0000 7f83a891c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a411b090 con 0x7f83a412d380 2023-09-30T22:23:14.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.835+0000 7f83a891c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83a411ba30 con 0x7f83a409a5a0 2023-09-30T22:23:14.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.835+0000 7f83a1d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f83a409a5a0 0x7f83a4070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.835+0000 7f83a1d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f83a409a5a0 0x7f83a4070e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55952/0 (socket says 172.21.15.156:55952) 2023-09-30T22:23:14.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.835+0000 7f83a1d9b700 1 -- 172.21.15.156:0/1572516293 learned_addr learned my addr 172.21.15.156:0/1572516293 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:14.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.835+0000 7f83a2d9d700 1 --2- 172.21.15.156:0/1572516293 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83a412d380 0x7f83a4071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.835+0000 7f83a259c700 1 --2- 172.21.15.156:0/1572516293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83a4099a60 0x7f83a40708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.835+0000 7f83a1d9b700 1 -- 172.21.15.156:0/1572516293 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83a412d380 msgr2=0x7f83a4071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.835+0000 7f83a1d9b700 1 --2- 172.21.15.156:0/1572516293 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83a412d380 0x7f83a4071340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.835+0000 7f83a1d9b700 1 -- 172.21.15.156:0/1572516293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83a4099a60 msgr2=0x7f83a40708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.835+0000 7f83a1d9b700 1 --2- 172.21.15.156:0/1572516293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83a4099a60 0x7f83a40708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.835+0000 7f83a1d9b700 1 -- 172.21.15.156:0/1572516293 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839c009a70 con 0x7f83a409a5a0 2023-09-30T22:23:14.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.835+0000 7f83a1d9b700 1 --2- 172.21.15.156:0/1572516293 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f83a409a5a0 0x7f83a4070e00 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f839800c520 tx=0x7f839800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:14.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.836+0000 7f8392ffd700 1 -- 172.21.15.156:0/1572516293 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8398004c80 con 0x7f83a409a5a0 2023-09-30T22:23:14.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.836+0000 7f8392ffd700 1 -- 172.21.15.156:0/1572516293 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8398004de0 con 0x7f83a409a5a0 2023-09-30T22:23:14.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.836+0000 7f83a891c700 1 -- 172.21.15.156:0/1572516293 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a40a1710 con 0x7f83a409a5a0 2023-09-30T22:23:14.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.836+0000 7f8392ffd700 1 -- 172.21.15.156:0/1572516293 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8398007310 con 0x7f83a409a5a0 2023-09-30T22:23:14.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.836+0000 7f83a891c700 1 -- 172.21.15.156:0/1572516293 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a4119180 con 0x7f83a409a5a0 2023-09-30T22:23:14.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.837+0000 7f8392ffd700 1 -- 172.21.15.156:0/1572516293 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8398007470 con 0x7f83a409a5a0 2023-09-30T22:23:14.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.837+0000 7f83a891c700 1 -- 172.21.15.156:0/1572516293 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a411aa50 con 0x7f83a409a5a0 2023-09-30T22:23:14.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.837+0000 7f8392ffd700 1 -- 172.21.15.156:0/1572516293 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f839803f410 con 0x7f83a409a5a0 2023-09-30T22:23:14.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.846+0000 7f8392ffd700 1 -- 172.21.15.156:0/1572516293 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f83a411aa50 con 0x7f83a409a5a0 2023-09-30T22:23:14.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.875+0000 7fbd9c2be700 1 Processor -- start 2023-09-30T22:23:14.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.875+0000 7fbd9c2be700 1 -- start start 2023-09-30T22:23:14.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.876+0000 7fbd9c2be700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd94133ad0 0x7fbd94133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.876+0000 7fbd9c2be700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd94130bc0 0x7fbd9413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.876+0000 7fbd9c2be700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd9406b2d0 con 0x7fbd941300a0 2023-09-30T22:23:14.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.876+0000 7fbd9c2be700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd94133610 con 0x7fbd94133ad0 2023-09-30T22:23:14.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.876+0000 7fbd9c2be700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9409a500 con 0x7fbd94130bc0 2023-09-30T22:23:14.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.876+0000 7fbd9a05a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd94133ad0 0x7fbd94133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.876+0000 7fbd9a05a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd94133ad0 0x7fbd94133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59874/0 (socket says 172.21.15.156:59874) 2023-09-30T22:23:14.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.876+0000 7fbd9a05a700 1 -- 172.21.15.156:0/849417722 learned_addr learned my addr 172.21.15.156:0/849417722 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:14.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.876+0000 7fbd9a85b700 1 --2- 172.21.15.156:0/849417722 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd94130bc0 0x7fbd9413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.877+0000 7fbd9a05a700 1 -- 172.21.15.156:0/849417722 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd94130bc0 msgr2=0x7fbd9413b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:14.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.877+0000 7fbd9a05a700 1 --2- 172.21.15.156:0/849417722 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd94130bc0 0x7fbd9413b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.877+0000 7fbd9a05a700 1 -- 172.21.15.156:0/849417722 >> v1:172.21.15.156:6789/0 conn(0x7fbd941300a0 legacy=0x7fbd941304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:14.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.877+0000 7fbd9a05a700 1 -- 172.21.15.156:0/849417722 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd941338b0 con 0x7fbd94133ad0 2023-09-30T22:23:14.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.877+0000 7fbd9a05a700 1 --2- 172.21.15.156:0/849417722 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd94133ad0 0x7fbd94133ea0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fbd90009920 tx=0x7fbd90009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ddfd418cc3ccc95 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:14.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.877+0000 7fbd99058700 1 -- 172.21.15.156:0/849417722 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd90004230 con 0x7fbd94133ad0 2023-09-30T22:23:14.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.877+0000 7fbd99058700 1 -- 172.21.15.156:0/849417722 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd90004390 con 0x7fbd94133ad0 2023-09-30T22:23:14.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.877+0000 7fbd99058700 1 -- 172.21.15.156:0/849417722 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd900036a0 con 0x7fbd94133ad0 2023-09-30T22:23:14.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.878+0000 7fbd9c2be700 1 -- 172.21.15.156:0/849417722 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd94133ad0 msgr2=0x7fbd94133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.878+0000 7fbd9c2be700 1 --2- 172.21.15.156:0/849417722 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd94133ad0 0x7fbd94133ea0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fbd90009920 tx=0x7fbd90009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:14.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.878+0000 7fbd9c2be700 1 -- 172.21.15.156:0/849417722 shutdown_connections 2023-09-30T22:23:14.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.878+0000 7fbd9c2be700 1 --2- 172.21.15.156:0/849417722 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd94133ad0 0x7fbd94133ea0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.878+0000 7fbd9c2be700 1 --2- 172.21.15.156:0/849417722 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd94130bc0 0x7fbd9413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.878+0000 7fbd9c2be700 1 -- 172.21.15.156:0/849417722 >> 172.21.15.156:0/849417722 conn(0x7fbd94099c40 msgr2=0x7fbd940a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:14.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.878+0000 7fbd9c2be700 1 -- 172.21.15.156:0/849417722 shutdown_connections 2023-09-30T22:23:14.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.878+0000 7fbd9c2be700 1 -- 172.21.15.156:0/849417722 wait complete. 2023-09-30T22:23:14.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.879+0000 7fbd9c2be700 1 Processor -- start 2023-09-30T22:23:14.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.880+0000 7fbd9c2be700 1 -- start start 2023-09-30T22:23:14.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.880+0000 7fbd9c2be700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd941300a0 0x7fbd9411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.880+0000 7fbd9c2be700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd94130bc0 0x7fbd9411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.880+0000 7fbd9c2be700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd94133ad0 0x7fbd9411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.880+0000 7fbd9c2be700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd940726e0 con 0x7fbd94130bc0 2023-09-30T22:23:14.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.880+0000 7fbd9c2be700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd941202a0 con 0x7fbd94133ad0 2023-09-30T22:23:14.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.880+0000 7fbd9c2be700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9412fd70 con 0x7fbd941300a0 2023-09-30T22:23:14.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.880+0000 7fbd9a05a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd941300a0 0x7fbd9411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.880+0000 7fbd9a05a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd941300a0 0x7fbd9411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55964/0 (socket says 172.21.15.156:55964) 2023-09-30T22:23:14.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.880+0000 7fbd9a05a700 1 -- 172.21.15.156:0/3719344090 learned_addr learned my addr 172.21.15.156:0/3719344090 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:14.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.880+0000 7fbd9a85b700 1 --2- 172.21.15.156:0/3719344090 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd94133ad0 0x7fbd9411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.880+0000 7f8f076b5700 1 Processor -- start 2023-09-30T22:23:14.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.881+0000 7fbd9a85b700 1 -- 172.21.15.156:0/3719344090 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd941300a0 msgr2=0x7fbd9411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.881+0000 7fbd9a85b700 1 --2- 172.21.15.156:0/3719344090 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd941300a0 0x7fbd9411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.881+0000 7fbd9a85b700 1 -- 172.21.15.156:0/3719344090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd94130bc0 msgr2=0x7fbd9411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.881+0000 7fbd9a85b700 1 --2- 172.21.15.156:0/3719344090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd94130bc0 0x7fbd9411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.881+0000 7fbd9a85b700 1 -- 172.21.15.156:0/3719344090 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd90009550 con 0x7fbd94133ad0 2023-09-30T22:23:14.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.881+0000 7fbd9a05a700 1 --2- 172.21.15.156:0/3719344090 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd941300a0 0x7fbd9411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:14.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.881+0000 7fbd9a85b700 1 --2- 172.21.15.156:0/3719344090 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd94133ad0 0x7fbd9411e4c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c00eba0 tx=0x7fbd8c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:14.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.881+0000 7fbd8affd700 1 -- 172.21.15.156:0/3719344090 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c00ca30 con 0x7fbd94133ad0 2023-09-30T22:23:14.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.881+0000 7f8f076b5700 1 -- start start 2023-09-30T22:23:14.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.881+0000 7f8f076b5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8f0009f350 0x7f8f00136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.881+0000 7f8f076b5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f001371c0 0x7f8f001395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.881+0000 7f8f076b5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f0009c970 con 0x7f8f0009e870 2023-09-30T22:23:14.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.881+0000 7fbd8affd700 1 -- 172.21.15.156:0/3719344090 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8c00f040 con 0x7fbd94133ad0 2023-09-30T22:23:14.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.881+0000 7fbd9c2be700 1 -- 172.21.15.156:0/3719344090 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd9412dd60 con 0x7fbd94133ad0 2023-09-30T22:23:14.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.881+0000 7fbd8affd700 1 -- 172.21.15.156:0/3719344090 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c00cdd0 con 0x7fbd94133ad0 2023-09-30T22:23:14.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.881+0000 7fbd9c2be700 1 -- 172.21.15.156:0/3719344090 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd9411feb0 con 0x7fbd94133ad0 2023-09-30T22:23:14.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.882+0000 7f8f05451700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f8f0009e870 0x7f8f0009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:42592/0 (socket says 172.21.15.156:42592) 2023-09-30T22:23:14.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.882+0000 7f8f05451700 1 -- 172.21.15.156:0/3829895245 learned_addr learned my addr 172.21.15.156:0/3829895245 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:14.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.882+0000 7f8f04c50700 1 --2- 172.21.15.156:0/3829895245 >> v2:172.21.15.156:3300/0 conn(0x7f8f0009f350 0x7f8f00136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.882+0000 7f8f05c52700 1 --2- 172.21.15.156:0/3829895245 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f001371c0 0x7f8f001395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.882+0000 7f8f076b5700 1 -- 172.21.15.156:0/3829895245 --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f000a0920 con 0x7f8f0009f350 2023-09-30T22:23:14.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.882+0000 7f8f076b5700 1 -- 172.21.15.156:0/3829895245 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0009f9c0 con 0x7f8f001371c0 2023-09-30T22:23:14.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.882+0000 7f8f04c50700 1 -- 172.21.15.156:0/3829895245 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f001371c0 msgr2=0x7f8f001395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:14.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.882+0000 7f8f04c50700 1 --2- 172.21.15.156:0/3829895245 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f001371c0 0x7f8f001395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.882+0000 7f8f04c50700 1 -- 172.21.15.156:0/3829895245 >> v1:172.21.15.156:6789/0 conn(0x7f8f0009e870 legacy=0x7f8f0009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.882+0000 7f8f04c50700 1 -- 172.21.15.156:0/3829895245 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0009bab0 con 0x7f8f0009f350 2023-09-30T22:23:14.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.882+0000 7f8f04c50700 1 --2- 172.21.15.156:0/3829895245 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f0009f350 0x7f8f00136c80 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f8efc009840 tx=0x7f8efc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ae18a7bcf4e3a1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:14.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.883+0000 7fbd9c2be700 1 -- 172.21.15.156:0/3719344090 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd7c0052e0 con 0x7fbd94133ad0 2023-09-30T22:23:14.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.883+0000 7f8ef7fff700 1 -- 172.21.15.156:0/3829895245 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc004230 con 0x7f8f0009f350 2023-09-30T22:23:14.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.883+0000 7f8ef7fff700 1 -- 172.21.15.156:0/3829895245 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8efc004390 con 0x7f8f0009f350 2023-09-30T22:23:14.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.883+0000 7f8ef7fff700 1 -- 172.21.15.156:0/3829895245 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc0036a0 con 0x7f8f0009f350 2023-09-30T22:23:14.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.883+0000 7fbd8affd700 1 -- 172.21.15.156:0/3719344090 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbd8c014480 con 0x7fbd94133ad0 2023-09-30T22:23:14.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.883+0000 7fbd8affd700 1 -- 172.21.15.156:0/3719344090 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbd8c040690 con 0x7fbd94133ad0 2023-09-30T22:23:14.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.883+0000 7f8f076b5700 1 -- 172.21.15.156:0/3829895245 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f0009f350 msgr2=0x7f8f00136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.883+0000 7f8f076b5700 1 --2- 172.21.15.156:0/3829895245 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f0009f350 0x7f8f00136c80 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f8efc009840 tx=0x7f8efc009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:14.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.884+0000 7f8f076b5700 1 -- 172.21.15.156:0/3829895245 shutdown_connections 2023-09-30T22:23:14.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.884+0000 7f8f076b5700 1 --2- 172.21.15.156:0/3829895245 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f001371c0 0x7f8f001395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.884+0000 7f8f076b5700 1 --2- 172.21.15.156:0/3829895245 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f0009f350 0x7f8f00136c80 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.884+0000 7f8f076b5700 1 -- 172.21.15.156:0/3829895245 >> 172.21.15.156:0/3829895245 conn(0x7f8f000a4430 msgr2=0x7f8f000a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:14.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.884+0000 7f8f076b5700 1 -- 172.21.15.156:0/3829895245 shutdown_connections 2023-09-30T22:23:14.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.884+0000 7f8f076b5700 1 -- 172.21.15.156:0/3829895245 wait complete. 2023-09-30T22:23:14.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.885+0000 7f8f076b5700 1 Processor -- start 2023-09-30T22:23:14.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.885+0000 7f8f076b5700 1 -- start start 2023-09-30T22:23:14.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.885+0000 7f8f076b5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f0009e870 0x7f8f00123570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.885+0000 7f8f076b5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f0009f350 0x7f8f00121d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.885+0000 7f8f076b5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f001371c0 0x7f8f001222b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.885+0000 7f8f076b5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0006d2b0 con 0x7f8f0009e870 2023-09-30T22:23:14.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.885+0000 7f8f076b5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f00120bf0 con 0x7f8f0009f350 2023-09-30T22:23:14.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.885+0000 7f8f076b5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f000723f0 con 0x7f8f001371c0 2023-09-30T22:23:14.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.885+0000 7f8f04c50700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f0009f350 0x7f8f00121d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.885+0000 7f8f04c50700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f0009f350 0x7f8f00121d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59900/0 (socket says 172.21.15.156:59900) 2023-09-30T22:23:14.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.885+0000 7f8f04c50700 1 -- 172.21.15.156:0/1014179558 learned_addr learned my addr 172.21.15.156:0/1014179558 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:14.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.885+0000 7f8f05c52700 1 --2- 172.21.15.156:0/1014179558 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f001371c0 0x7f8f001222b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.885+0000 7f8f04c50700 1 -- 172.21.15.156:0/1014179558 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f001371c0 msgr2=0x7f8f001222b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.885+0000 7f8f04c50700 1 --2- 172.21.15.156:0/1014179558 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f001371c0 0x7f8f001222b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.885+0000 7f8f04c50700 1 -- 172.21.15.156:0/1014179558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f0009e870 msgr2=0x7f8f00123570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.885+0000 7f8f04c50700 1 --2- 172.21.15.156:0/1014179558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f0009e870 0x7f8f00123570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.885+0000 7f8f04c50700 1 -- 172.21.15.156:0/1014179558 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc0094a0 con 0x7f8f0009f350 2023-09-30T22:23:14.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.886+0000 7f8f04c50700 1 --2- 172.21.15.156:0/1014179558 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f0009f350 0x7f8f00121d70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8efc0090b0 tx=0x7f8efc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:14.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.892+0000 7f8ef5ffb700 1 -- 172.21.15.156:0/1014179558 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc003de0 con 0x7f8f0009f350 2023-09-30T22:23:14.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.892+0000 7f8ef5ffb700 1 -- 172.21.15.156:0/1014179558 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8efc041070 con 0x7f8f0009f350 2023-09-30T22:23:14.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.892+0000 7f8f076b5700 1 -- 172.21.15.156:0/1014179558 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f00123ab0 con 0x7f8f0009f350 2023-09-30T22:23:14.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.892+0000 7fbd8affd700 1 -- 172.21.15.156:0/3719344090 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd8c012930 con 0x7fbd94133ad0 2023-09-30T22:23:14.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.892+0000 7f8ef5ffb700 1 -- 172.21.15.156:0/1014179558 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc011870 con 0x7f8f0009f350 2023-09-30T22:23:14.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.892+0000 7f8f076b5700 1 -- 172.21.15.156:0/1014179558 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0006d860 con 0x7f8f0009f350 2023-09-30T22:23:14.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.893+0000 7f8ef5ffb700 1 -- 172.21.15.156:0/1014179558 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8efc0119d0 con 0x7f8f0009f350 2023-09-30T22:23:14.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.893+0000 7f8f076b5700 1 -- 172.21.15.156:0/1014179558 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f00120da0 con 0x7f8f0009f350 2023-09-30T22:23:14.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.893+0000 7f8ef5ffb700 1 -- 172.21.15.156:0/1014179558 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8efc043070 con 0x7f8f0009f350 2023-09-30T22:23:14.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.902+0000 7f8ef5ffb700 1 -- 172.21.15.156:0/1014179558 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8efc010d50 con 0x7f8f0009f350 2023-09-30T22:23:14.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.998+0000 7f0c9f97a700 1 -- 172.21.15.156:0/3493829496 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0c98136d30 con 0x7f0c9809a730 2023-09-30T22:23:15.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:14.999+0000 7f0c8dffb700 1 -- 172.21.15.156:0/3493829496 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c98136d30 con 0x7f0c9809a730 2023-09-30T22:23:15.000 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:15.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.001+0000 7f0c9f97a700 1 -- 172.21.15.156:0/3493829496 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c9809a730 msgr2=0x7f0c98138a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:15.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.001+0000 7f0c9f97a700 1 --2- 172.21.15.156:0/3493829496 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c9809a730 0x7f0c98138a40 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f0c88009bc0 tx=0x7f0c88004750 comp rx=0 tx=0).stop 2023-09-30T22:23:15.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.001+0000 7f0c9f97a700 1 -- 172.21.15.156:0/3493829496 shutdown_connections 2023-09-30T22:23:15.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.001+0000 7f0c9f97a700 1 --2- 172.21.15.156:0/3493829496 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c98130890 0x7f0c981c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.001+0000 7f0c9f97a700 1 --2- 172.21.15.156:0/3493829496 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c98099e20 0x7f0c98138500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.001+0000 7f0c9f97a700 1 --2- 172.21.15.156:0/3493829496 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c9809a730 0x7f0c98138a40 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.001+0000 7f0c9f97a700 1 -- 172.21.15.156:0/3493829496 >> 172.21.15.156:0/3493829496 conn(0x7f0c980a2980 msgr2=0x7f0c9809f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:15.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.001+0000 7f0c9f97a700 1 -- 172.21.15.156:0/3493829496 shutdown_connections 2023-09-30T22:23:15.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.001+0000 7f0c9f97a700 1 -- 172.21.15.156:0/3493829496 wait complete. 2023-09-30T22:23:15.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:15.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.059+0000 7f83a891c700 1 -- 172.21.15.156:0/1572516293 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f83a411aa50 con 0x7f83a409a5a0 2023-09-30T22:23:15.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.060+0000 7f8392ffd700 1 -- 172.21.15.156:0/1572516293 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f83a411aa50 con 0x7f83a409a5a0 2023-09-30T22:23:15.061 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:15.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.062+0000 7f83a891c700 1 -- 172.21.15.156:0/1572516293 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f83a409a5a0 msgr2=0x7f83a4070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:15.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.062+0000 7f83a891c700 1 --2- 172.21.15.156:0/1572516293 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f83a409a5a0 0x7f83a4070e00 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f839800c520 tx=0x7f839800c830 comp rx=0 tx=0).stop 2023-09-30T22:23:15.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.062+0000 7f83a891c700 1 -- 172.21.15.156:0/1572516293 shutdown_connections 2023-09-30T22:23:15.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.062+0000 7f83a891c700 1 --2- 172.21.15.156:0/1572516293 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83a412d380 0x7f83a4071340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.062+0000 7f83a891c700 1 --2- 172.21.15.156:0/1572516293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83a4099a60 0x7f83a40708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.062+0000 7f83a891c700 1 --2- 172.21.15.156:0/1572516293 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f83a409a5a0 0x7f83a4070e00 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.062+0000 7f83a891c700 1 -- 172.21.15.156:0/1572516293 >> 172.21.15.156:0/1572516293 conn(0x7f83a40a2980 msgr2=0x7f83a412c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:15.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.062+0000 7f83a891c700 1 -- 172.21.15.156:0/1572516293 shutdown_connections 2023-09-30T22:23:15.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.062+0000 7f83a891c700 1 -- 172.21.15.156:0/1572516293 wait complete. 2023-09-30T22:23:15.075 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:15.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.086+0000 7fbd9c2be700 1 -- 172.21.15.156:0/3719344090 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbd7c005860 con 0x7fbd94133ad0 2023-09-30T22:23:15.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.086+0000 7fbd8affd700 1 -- 172.21.15.156:0/3719344090 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbd8c02a020 con 0x7fbd94133ad0 2023-09-30T22:23:15.087 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:15.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.088+0000 7fbd9c2be700 1 -- 172.21.15.156:0/3719344090 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd94133ad0 msgr2=0x7fbd9411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:15.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.089+0000 7fbd9c2be700 1 --2- 172.21.15.156:0/3719344090 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd94133ad0 0x7fbd9411e4c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c00eba0 tx=0x7fbd8c00eeb0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.089+0000 7fbd9c2be700 1 -- 172.21.15.156:0/3719344090 shutdown_connections 2023-09-30T22:23:15.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.089+0000 7fbd9c2be700 1 --2- 172.21.15.156:0/3719344090 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd94133ad0 0x7fbd9411e4c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.089+0000 7fbd9c2be700 1 --2- 172.21.15.156:0/3719344090 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd941300a0 0x7fbd9411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.089+0000 7fbd9c2be700 1 --2- 172.21.15.156:0/3719344090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd94130bc0 0x7fbd9411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.089+0000 7fbd9c2be700 1 -- 172.21.15.156:0/3719344090 >> 172.21.15.156:0/3719344090 conn(0x7fbd94099c40 msgr2=0x7fbd940a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:15.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.089+0000 7fbd9c2be700 1 -- 172.21.15.156:0/3719344090 shutdown_connections 2023-09-30T22:23:15.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.089+0000 7fbd9c2be700 1 -- 172.21.15.156:0/3719344090 wait complete. 2023-09-30T22:23:15.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.095+0000 7f8f076b5700 1 -- 172.21.15.156:0/1014179558 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8f00120da0 con 0x7f8f0009f350 2023-09-30T22:23:15.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.095+0000 7f8ef5ffb700 1 -- 172.21.15.156:0/1014179558 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8efc010b70 con 0x7f8f0009f350 2023-09-30T22:23:15.096 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:15.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.097+0000 7f8f076b5700 1 -- 172.21.15.156:0/1014179558 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f0009f350 msgr2=0x7f8f00121d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:15.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.097+0000 7f8f076b5700 1 --2- 172.21.15.156:0/1014179558 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f0009f350 0x7f8f00121d70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8efc0090b0 tx=0x7f8efc004750 comp rx=0 tx=0).stop 2023-09-30T22:23:15.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.097+0000 7f8f076b5700 1 -- 172.21.15.156:0/1014179558 shutdown_connections 2023-09-30T22:23:15.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.097+0000 7f8f076b5700 1 --2- 172.21.15.156:0/1014179558 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8f001371c0 0x7f8f001222b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.097+0000 7f8f076b5700 1 --2- 172.21.15.156:0/1014179558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f0009e870 0x7f8f00123570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.097+0000 7f8f076b5700 1 --2- 172.21.15.156:0/1014179558 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8f0009f350 0x7f8f00121d70 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.097+0000 7f8f076b5700 1 -- 172.21.15.156:0/1014179558 >> 172.21.15.156:0/1014179558 conn(0x7f8f000a4430 msgr2=0x7f8f000a2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:15.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.098+0000 7f8f076b5700 1 -- 172.21.15.156:0/1014179558 shutdown_connections 2023-09-30T22:23:15.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:15.098+0000 7f8f076b5700 1 -- 172.21.15.156:0/1014179558 wait complete. 2023-09-30T22:23:15.102 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:15.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:16.015 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:16.075 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:16.103 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:16.111 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:16.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.157+0000 7fc62a382700 1 Processor -- start 2023-09-30T22:23:16.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.157+0000 7fc62a382700 1 -- start start 2023-09-30T22:23:16.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.158+0000 7fc62a382700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6240a0a30 0x7fc6240a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:16.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.158+0000 7fc62a382700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc6240a1340 0x7fc62412ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:16.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.158+0000 7fc62a382700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6240a1e70 con 0x7fc6241304a0 2023-09-30T22:23:16.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.158+0000 7fc62a382700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62409a720 con 0x7fc6240a0a30 2023-09-30T22:23:16.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.158+0000 7fc62a382700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc62409b300 con 0x7fc6240a1340 2023-09-30T22:23:16.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.158+0000 7fc62891f700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc6241304a0 0x7fc6241371b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:42606/0 (socket says 172.21.15.156:42606) 2023-09-30T22:23:16.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.158+0000 7fc62891f700 1 -- 172.21.15.156:0/1415304518 learned_addr learned my addr 172.21.15.156:0/1415304518 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:16.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.158+0000 7fc623fff700 1 --2- 172.21.15.156:0/1415304518 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6240a0a30 0x7fc6240a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:16.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.158+0000 7fc6237fe700 1 --2- 172.21.15.156:0/1415304518 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc6240a1340 0x7fc62412ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:16.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.158+0000 7fc623fff700 1 -- 172.21.15.156:0/1415304518 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc6240a1340 msgr2=0x7fc62412ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:16.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.159+0000 7fc623fff700 1 --2- 172.21.15.156:0/1415304518 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc6240a1340 0x7fc62412ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.159+0000 7fc623fff700 1 -- 172.21.15.156:0/1415304518 >> v1:172.21.15.156:6789/0 conn(0x7fc6241304a0 legacy=0x7fc6241371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:16.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.159+0000 7fc623fff700 1 -- 172.21.15.156:0/1415304518 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62409abc0 con 0x7fc6240a0a30 2023-09-30T22:23:16.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.159+0000 7fc623fff700 1 --2- 172.21.15.156:0/1415304518 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6240a0a30 0x7fc6240a0e00 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc61400a9f0 tx=0x7fc61400ad00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ecdb575ab52375c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:16.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.159+0000 7fc622ffd700 1 -- 172.21.15.156:0/1415304518 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc614005e30 con 0x7fc6240a0a30 2023-09-30T22:23:16.161 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.159+0000 7fc622ffd700 1 -- 172.21.15.156:0/1415304518 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61400ae30 con 0x7fc6240a0a30 2023-09-30T22:23:16.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.159+0000 7fc622ffd700 1 -- 172.21.15.156:0/1415304518 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61400c980 con 0x7fc6240a0a30 2023-09-30T22:23:16.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.160+0000 7fc62a382700 1 -- 172.21.15.156:0/1415304518 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6240a0a30 msgr2=0x7fc6240a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:16.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.160+0000 7fc62a382700 1 --2- 172.21.15.156:0/1415304518 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6240a0a30 0x7fc6240a0e00 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc61400a9f0 tx=0x7fc61400ad00 comp rx=0 tx=0).stop 2023-09-30T22:23:16.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.160+0000 7fc62a382700 1 -- 172.21.15.156:0/1415304518 shutdown_connections 2023-09-30T22:23:16.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.160+0000 7fc62a382700 1 --2- 172.21.15.156:0/1415304518 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6240a0a30 0x7fc6240a0e00 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.160+0000 7fc62a382700 1 --2- 172.21.15.156:0/1415304518 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc6240a1340 0x7fc62412ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.160+0000 7fc62a382700 1 -- 172.21.15.156:0/1415304518 >> 172.21.15.156:0/1415304518 conn(0x7fc6240a2980 msgr2=0x7fc6240a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:16.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.160+0000 7fc62a382700 1 -- 172.21.15.156:0/1415304518 shutdown_connections 2023-09-30T22:23:16.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.160+0000 7fc62a382700 1 -- 172.21.15.156:0/1415304518 wait complete. 2023-09-30T22:23:16.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.161+0000 7fc62a382700 1 Processor -- start 2023-09-30T22:23:16.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.161+0000 7fc62a382700 1 -- start start 2023-09-30T22:23:16.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.162+0000 7fc62a382700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc6240a0a30 0x7fc62411eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:16.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.162+0000 7fc62a382700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6240a1340 0x7fc62411f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:16.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.162+0000 7fc62a382700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6241304a0 0x7fc62411f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:16.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.162+0000 7fc62a382700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6241225f0 con 0x7fc6240a1340 2023-09-30T22:23:16.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.162+0000 7fc62a382700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62409ae00 con 0x7fc6241304a0 2023-09-30T22:23:16.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.162+0000 7fc62a382700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6241206e0 con 0x7fc6240a0a30 2023-09-30T22:23:16.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.162+0000 7fc623fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc6240a0a30 0x7fc62411eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:16.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.162+0000 7fc623fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc6240a0a30 0x7fc62411eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56000/0 (socket says 172.21.15.156:56000) 2023-09-30T22:23:16.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.162+0000 7fc623fff700 1 -- 172.21.15.156:0/2181451815 learned_addr learned my addr 172.21.15.156:0/2181451815 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:16.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.162+0000 7fc6237fe700 1 --2- 172.21.15.156:0/2181451815 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6240a1340 0x7fc62411f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:16.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.162+0000 7fc62891f700 1 --2- 172.21.15.156:0/2181451815 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6241304a0 0x7fc62411f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:16.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.162+0000 7fc623fff700 1 -- 172.21.15.156:0/2181451815 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6241304a0 msgr2=0x7fc62411f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:16.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.162+0000 7fc623fff700 1 --2- 172.21.15.156:0/2181451815 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6241304a0 0x7fc62411f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.162+0000 7fc623fff700 1 -- 172.21.15.156:0/2181451815 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6240a1340 msgr2=0x7fc62411f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:16.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.162+0000 7fc623fff700 1 --2- 172.21.15.156:0/2181451815 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6240a1340 0x7fc62411f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.162+0000 7fc623fff700 1 -- 172.21.15.156:0/2181451815 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61400a5d0 con 0x7fc6240a0a30 2023-09-30T22:23:16.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.163+0000 7fc623fff700 1 --2- 172.21.15.156:0/2181451815 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc6240a0a30 0x7fc62411eb60 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc61400ad40 tx=0x7fc614004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:16.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.163+0000 7fc620ff9700 1 -- 172.21.15.156:0/2181451815 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc614004460 con 0x7fc6240a0a30 2023-09-30T22:23:16.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.163+0000 7fc620ff9700 1 -- 172.21.15.156:0/2181451815 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6140045e0 con 0x7fc6240a0a30 2023-09-30T22:23:16.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.163+0000 7fc62a382700 1 -- 172.21.15.156:0/2181451815 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc624120f00 con 0x7fc6240a0a30 2023-09-30T22:23:16.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.163+0000 7fc620ff9700 1 -- 172.21.15.156:0/2181451815 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6140038e0 con 0x7fc6240a0a30 2023-09-30T22:23:16.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.163+0000 7fc62a382700 1 -- 172.21.15.156:0/2181451815 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc624072770 con 0x7fc6240a0a30 2023-09-30T22:23:16.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.164+0000 7fc620ff9700 1 -- 172.21.15.156:0/2181451815 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc614003a40 con 0x7fc6240a0a30 2023-09-30T22:23:16.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.164+0000 7fc62a382700 1 -- 172.21.15.156:0/2181451815 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc62404f2a0 con 0x7fc6240a0a30 2023-09-30T22:23:16.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.164+0000 7fc620ff9700 1 -- 172.21.15.156:0/2181451815 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc614013070 con 0x7fc6240a0a30 2023-09-30T22:23:16.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.169+0000 7fc620ff9700 1 -- 172.21.15.156:0/2181451815 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc614021340 con 0x7fc6240a0a30 2023-09-30T22:23:16.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.215+0000 7f615dfb3700 1 Processor -- start 2023-09-30T22:23:16.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.215+0000 7f615dfb3700 1 -- start start 2023-09-30T22:23:16.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.216+0000 7f615dfb3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f615809e340 0x7f61581359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:16.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.216+0000 7f615dfb3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6158135f20 0x7f6158138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:16.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.216+0000 7f615dfb3700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615809aaa0 con 0x7f615809d860 2023-09-30T22:23:16.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.216+0000 7f615dfb3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615809e730 con 0x7f615809e340 2023-09-30T22:23:16.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.216+0000 7f615dfb3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f615809f870 con 0x7f6158135f20 2023-09-30T22:23:16.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.216+0000 7f6156ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f615809e340 0x7f61581359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:16.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.216+0000 7f61577fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f615809d860 0x7f615809dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:42622/0 (socket says 172.21.15.156:42622) 2023-09-30T22:23:16.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.216+0000 7f61577fe700 1 -- 172.21.15.156:0/2969948276 learned_addr learned my addr 172.21.15.156:0/2969948276 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:16.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.216+0000 7f6157fff700 1 --2- 172.21.15.156:0/2969948276 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6158135f20 0x7f6158138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:16.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.216+0000 7f6157fff700 1 -- 172.21.15.156:0/2969948276 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f615809e340 msgr2=0x7f61581359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:16.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.216+0000 7f6157fff700 1 --2- 172.21.15.156:0/2969948276 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f615809e340 0x7f61581359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.216+0000 7f6157fff700 1 -- 172.21.15.156:0/2969948276 >> v1:172.21.15.156:6789/0 conn(0x7f615809d860 legacy=0x7f615809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:16.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.216+0000 7f6157fff700 1 -- 172.21.15.156:0/2969948276 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615809b360 con 0x7f6158135f20 2023-09-30T22:23:16.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.217+0000 7f6156ffd700 1 --2- 172.21.15.156:0/2969948276 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f615809e340 0x7f61581359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:16.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.217+0000 7f6157fff700 1 --2- 172.21.15.156:0/2969948276 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6158135f20 0x7f6158138300 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6150009df0 tx=0x7f615000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d0b7727034b2ec8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:16.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.217+0000 7f61567fc700 1 -- 172.21.15.156:0/2969948276 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615000e070 con 0x7f6158135f20 2023-09-30T22:23:16.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.217+0000 7f61567fc700 1 -- 172.21.15.156:0/2969948276 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615000bae0 con 0x7f6158135f20 2023-09-30T22:23:16.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.217+0000 7f61567fc700 1 -- 172.21.15.156:0/2969948276 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615000be90 con 0x7f6158135f20 2023-09-30T22:23:16.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.218+0000 7f615dfb3700 1 -- 172.21.15.156:0/2969948276 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6158135f20 msgr2=0x7f6158138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:16.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.218+0000 7f615dfb3700 1 --2- 172.21.15.156:0/2969948276 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6158135f20 0x7f6158138300 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6150009df0 tx=0x7f615000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:16.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.218+0000 7f615dfb3700 1 -- 172.21.15.156:0/2969948276 shutdown_connections 2023-09-30T22:23:16.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.218+0000 7f615dfb3700 1 --2- 172.21.15.156:0/2969948276 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6158135f20 0x7f6158138300 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.218+0000 7f615dfb3700 1 --2- 172.21.15.156:0/2969948276 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f615809e340 0x7f61581359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.218+0000 7f615dfb3700 1 -- 172.21.15.156:0/2969948276 >> 172.21.15.156:0/2969948276 conn(0x7f6158099c40 msgr2=0x7f61580a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:16.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.218+0000 7f615dfb3700 1 -- 172.21.15.156:0/2969948276 shutdown_connections 2023-09-30T22:23:16.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.218+0000 7f615dfb3700 1 -- 172.21.15.156:0/2969948276 wait complete. 2023-09-30T22:23:16.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.219+0000 7f615dfb3700 1 Processor -- start 2023-09-30T22:23:16.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.220+0000 7f615dfb3700 1 -- start start 2023-09-30T22:23:16.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.220+0000 7f615dfb3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f615809d860 0x7f61581c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:16.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.220+0000 7f615dfb3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f615809e340 0x7f61581c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:16.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.220+0000 7f615dfb3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6158135f20 0x7f61581c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:16.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.220+0000 7f615dfb3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615811bcd0 con 0x7f615809d860 2023-09-30T22:23:16.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.220+0000 7f615dfb3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615811aae0 con 0x7f615809e340 2023-09-30T22:23:16.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.220+0000 7f615dfb3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f615811c8b0 con 0x7f6158135f20 2023-09-30T22:23:16.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.220+0000 7f61577fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f615809d860 0x7f61581c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:16.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.220+0000 7f61577fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f615809d860 0x7f61581c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44608/0 (socket says 172.21.15.156:44608) 2023-09-30T22:23:16.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.220+0000 7f61577fe700 1 -- 172.21.15.156:0/420950191 learned_addr learned my addr 172.21.15.156:0/420950191 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:16.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.221+0000 7f6157fff700 1 --2- 172.21.15.156:0/420950191 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6158135f20 0x7f61581c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:16.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.221+0000 7f6156ffd700 1 --2- 172.21.15.156:0/420950191 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f615809e340 0x7f61581c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:16.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.221+0000 7f61577fe700 1 -- 172.21.15.156:0/420950191 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6158135f20 msgr2=0x7f61581c4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:16.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.221+0000 7f61577fe700 1 --2- 172.21.15.156:0/420950191 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6158135f20 0x7f61581c4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.221+0000 7f61577fe700 1 -- 172.21.15.156:0/420950191 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f615809e340 msgr2=0x7f61581c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:16.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.221+0000 7f61577fe700 1 --2- 172.21.15.156:0/420950191 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f615809e340 0x7f61581c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.221+0000 7f61577fe700 1 -- 172.21.15.156:0/420950191 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c0094a0 con 0x7f615809d860 2023-09-30T22:23:16.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.221+0000 7f61577fe700 1 --2- 172.21.15.156:0/420950191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f615809d860 0x7f61581c8520 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f614800c520 tx=0x7f614800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:16.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.221+0000 7f613ffff700 1 -- 172.21.15.156:0/420950191 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6148005d70 con 0x7f615809d860 2023-09-30T22:23:16.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.221+0000 7f613ffff700 1 -- 172.21.15.156:0/420950191 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61480070d0 con 0x7f615809d860 2023-09-30T22:23:16.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.221+0000 7f615dfb3700 1 -- 172.21.15.156:0/420950191 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6150009a70 con 0x7f615809d860 2023-09-30T22:23:16.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.221+0000 7f613ffff700 1 -- 172.21.15.156:0/420950191 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6148007440 con 0x7f615809d860 2023-09-30T22:23:16.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.221+0000 7f615dfb3700 1 -- 172.21.15.156:0/420950191 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615809c8b0 con 0x7f615809d860 2023-09-30T22:23:16.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.223+0000 7f615dfb3700 1 -- 172.21.15.156:0/420950191 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615804f2a0 con 0x7f615809d860 2023-09-30T22:23:16.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.223+0000 7f613ffff700 1 -- 172.21.15.156:0/420950191 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f61480075a0 con 0x7f615809d860 2023-09-30T22:23:16.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.223+0000 7f613ffff700 1 -- 172.21.15.156:0/420950191 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f614803fa70 con 0x7f615809d860 2023-09-30T22:23:16.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.228+0000 7f613ffff700 1 -- 172.21.15.156:0/420950191 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6148019d20 con 0x7f615809d860 2023-09-30T22:23:16.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.253+0000 7f462b845700 1 Processor -- start 2023-09-30T22:23:16.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.253+0000 7f462b845700 1 -- start start 2023-09-30T22:23:16.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.254+0000 7f462b845700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f462409e340 0x7f46241359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:16.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.254+0000 7f462b845700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4624135f20 0x7f4624138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:16.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.254+0000 7f462b845700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f462409aaa0 con 0x7f462409d860 2023-09-30T22:23:16.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.254+0000 7f462b845700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f462409e730 con 0x7f462409e340 2023-09-30T22:23:16.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.254+0000 7f462b845700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462409f870 con 0x7f4624135f20 2023-09-30T22:23:16.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.254+0000 7f4629de2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4624135f20 0x7f4624138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:16.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.254+0000 7f4629de2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4624135f20 0x7f4624138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59936/0 (socket says 172.21.15.156:59936) 2023-09-30T22:23:16.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.254+0000 7f4629de2700 1 -- 172.21.15.156:0/2765982082 learned_addr learned my addr 172.21.15.156:0/2765982082 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:16.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.254+0000 7f4628de0700 1 --2- 172.21.15.156:0/2765982082 >> v2:172.21.15.156:3300/0 conn(0x7f462409e340 0x7f46241359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:16.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.255+0000 7f1258d84700 1 Processor -- start 2023-09-30T22:23:16.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.255+0000 7f1258d84700 1 -- start start 2023-09-30T22:23:16.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.255+0000 7f461bfff700 1 -- 172.21.15.156:0/2765982082 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1849720492 0 0) 0x7f462409aaa0 con 0x7f462409d860 2023-09-30T22:23:16.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.255+0000 7f1258d84700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f125412d280 0x7f125412d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:16.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.255+0000 7f1258d84700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1254130350 0x7f12541307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:16.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.255+0000 7f1258d84700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1254130ce0 0x7f1254137680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:16.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.255+0000 7f1258d84700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f125409b9a0 con 0x7f1254130ce0 2023-09-30T22:23:16.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.255+0000 7f1258d84700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125409ae40 con 0x7f125412d280 2023-09-30T22:23:16.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.255+0000 7f1258d84700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f125409bbb0 con 0x7f1254130350 2023-09-30T22:23:16.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.255+0000 7f125259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f125412d280 0x7f125412d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:16.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.255+0000 7f1252d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1254130ce0 0x7f1254137680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:16.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.256+0000 7f461bfff700 1 -- 172.21.15.156:0/2765982082 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46100035b0 con 0x7f462409d860 2023-09-30T22:23:16.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.256+0000 7f4628de0700 1 -- 172.21.15.156:0/2765982082 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4624135f20 msgr2=0x7f4624138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:16.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.256+0000 7f4628de0700 1 --2- 172.21.15.156:0/2765982082 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4624135f20 0x7f4624138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.256+0000 7f4628de0700 1 -- 172.21.15.156:0/2765982082 >> v1:172.21.15.156:6789/0 conn(0x7f462409d860 legacy=0x7f462409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:16.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.256+0000 7f4628de0700 1 -- 172.21.15.156:0/2765982082 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462409b360 con 0x7f462409e340 2023-09-30T22:23:16.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.255+0000 7f1252d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1254130ce0 0x7f1254137680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44626/0 (socket says 172.21.15.156:44626) 2023-09-30T22:23:16.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.256+0000 7f1252d9d700 1 -- 172.21.15.156:0/2292507178 learned_addr learned my addr 172.21.15.156:0/2292507178 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:16.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.255+0000 7f125259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f125412d280 0x7f125412d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59952/0 (socket says 172.21.15.156:59952) 2023-09-30T22:23:16.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.256+0000 7f1251d9b700 1 --2- 172.21.15.156:0/2292507178 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1254130350 0x7f12541307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:16.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.256+0000 7f125259c700 1 -- 172.21.15.156:0/2292507178 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1254130350 msgr2=0x7f12541307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:16.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.256+0000 7f125259c700 1 --2- 172.21.15.156:0/2292507178 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1254130350 0x7f12541307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.256+0000 7f125259c700 1 -- 172.21.15.156:0/2292507178 >> v2:172.21.15.156:3300/0 conn(0x7f1254130ce0 msgr2=0x7f1254137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:16.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.256+0000 7f4628de0700 1 --2- 172.21.15.156:0/2765982082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f462409e340 0x7f46241359e0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f461400bae0 tx=0x7f461400bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f62b2ce1409ca3a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:16.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.256+0000 7f125259c700 1 --2- 172.21.15.156:0/2292507178 >> v2:172.21.15.156:3300/0 conn(0x7f1254130ce0 0x7f1254137680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.256+0000 7f125259c700 1 -- 172.21.15.156:0/2292507178 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1254131150 con 0x7f125412d280 2023-09-30T22:23:16.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.256+0000 7f1252d9d700 1 --2- 172.21.15.156:0/2292507178 >> v2:172.21.15.156:3300/0 conn(0x7f1254130ce0 0x7f1254137680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:16.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.256+0000 7f125259c700 1 --2- 172.21.15.156:0/2292507178 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f125412d280 0x7f125412d650 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f124c008650 tx=0x7f124c008960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2703bcd3b0b57af4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:16.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.256+0000 7f461bfff700 1 -- 172.21.15.156:0/2765982082 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461400dc70 con 0x7f462409e340 2023-09-30T22:23:16.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.256+0000 7f461bfff700 1 -- 172.21.15.156:0/2765982082 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461400ddd0 con 0x7f462409e340 2023-09-30T22:23:16.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.256+0000 7f461bfff700 1 -- 172.21.15.156:0/2765982082 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4614010670 con 0x7f462409e340 2023-09-30T22:23:16.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.256+0000 7f125159a700 1 -- 172.21.15.156:0/2292507178 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c00d2d0 con 0x7f125412d280 2023-09-30T22:23:16.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.256+0000 7f125159a700 1 -- 172.21.15.156:0/2292507178 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124c00d430 con 0x7f125412d280 2023-09-30T22:23:16.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.256+0000 7f125159a700 1 -- 172.21.15.156:0/2292507178 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c016a90 con 0x7f125412d280 2023-09-30T22:23:16.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.257+0000 7f1258d84700 1 -- 172.21.15.156:0/2292507178 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f125412d280 msgr2=0x7f125412d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:16.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.257+0000 7f1258d84700 1 --2- 172.21.15.156:0/2292507178 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f125412d280 0x7f125412d650 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f124c008650 tx=0x7f124c008960 comp rx=0 tx=0).stop 2023-09-30T22:23:16.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.257+0000 7f1258d84700 1 -- 172.21.15.156:0/2292507178 shutdown_connections 2023-09-30T22:23:16.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.257+0000 7f462b845700 1 -- 172.21.15.156:0/2765982082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f462409e340 msgr2=0x7f46241359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:16.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.257+0000 7f1258d84700 1 --2- 172.21.15.156:0/2292507178 >> v2:172.21.15.156:3300/0 conn(0x7f1254130ce0 0x7f1254137680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.257+0000 7f1258d84700 1 --2- 172.21.15.156:0/2292507178 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f125412d280 0x7f125412d650 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.257+0000 7f1258d84700 1 --2- 172.21.15.156:0/2292507178 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1254130350 0x7f12541307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.257+0000 7f1258d84700 1 -- 172.21.15.156:0/2292507178 >> 172.21.15.156:0/2292507178 conn(0x7f12540a2980 msgr2=0x7f12540a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:16.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.257+0000 7f462b845700 1 --2- 172.21.15.156:0/2765982082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f462409e340 0x7f46241359e0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f461400bae0 tx=0x7f461400bdf0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.257+0000 7f1258d84700 1 -- 172.21.15.156:0/2292507178 shutdown_connections 2023-09-30T22:23:16.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.257+0000 7f1258d84700 1 -- 172.21.15.156:0/2292507178 wait complete. 2023-09-30T22:23:16.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.257+0000 7f462b845700 1 -- 172.21.15.156:0/2765982082 shutdown_connections 2023-09-30T22:23:16.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.257+0000 7f462b845700 1 --2- 172.21.15.156:0/2765982082 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4624135f20 0x7f4624138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.257+0000 7f462b845700 1 --2- 172.21.15.156:0/2765982082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f462409e340 0x7f46241359e0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.257+0000 7f462b845700 1 -- 172.21.15.156:0/2765982082 >> 172.21.15.156:0/2765982082 conn(0x7f4624099c40 msgr2=0x7f46240a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:16.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.258+0000 7f462b845700 1 -- 172.21.15.156:0/2765982082 shutdown_connections 2023-09-30T22:23:16.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.258+0000 7f462b845700 1 -- 172.21.15.156:0/2765982082 wait complete. 2023-09-30T22:23:16.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.258+0000 7f1258d84700 1 Processor -- start 2023-09-30T22:23:16.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.259+0000 7f1258d84700 1 -- start start 2023-09-30T22:23:16.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.259+0000 7f1258d84700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f125412d280 0x7f125411aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:16.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.259+0000 7f462b845700 1 Processor -- start 2023-09-30T22:23:16.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.259+0000 7f1258d84700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1254130350 0x7f125411afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:16.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.259+0000 7f1258d84700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1254130ce0 0x7f125411b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:16.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.259+0000 7f1258d84700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125411e580 con 0x7f1254130ce0 2023-09-30T22:23:16.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.259+0000 7f1258d84700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125412ed80 con 0x7f1254130350 2023-09-30T22:23:16.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.259+0000 7f1258d84700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f125409b490 con 0x7f125412d280 2023-09-30T22:23:16.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.259+0000 7f462b845700 1 -- start start 2023-09-30T22:23:16.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.259+0000 7f125259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f125412d280 0x7f125411aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:16.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.259+0000 7f125259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f125412d280 0x7f125411aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56034/0 (socket says 172.21.15.156:56034) 2023-09-30T22:23:16.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.259+0000 7f125259c700 1 -- 172.21.15.156:0/518096375 learned_addr learned my addr 172.21.15.156:0/518096375 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:16.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.259+0000 7f1252d9d700 1 --2- 172.21.15.156:0/518096375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1254130ce0 0x7f125411b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:16.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.259+0000 7f125259c700 1 -- 172.21.15.156:0/518096375 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1254130350 msgr2=0x7f125411afa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:23:16.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.259+0000 7f125259c700 1 --2- 172.21.15.156:0/518096375 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1254130350 0x7f125411afa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.259+0000 7f125259c700 1 -- 172.21.15.156:0/518096375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1254130ce0 msgr2=0x7f125411b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:16.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.259+0000 7f125259c700 1 --2- 172.21.15.156:0/518096375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1254130ce0 0x7f125411b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.259+0000 7f125259c700 1 -- 172.21.15.156:0/518096375 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124400b600 con 0x7f125412d280 2023-09-30T22:23:16.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.259+0000 7f125259c700 1 --2- 172.21.15.156:0/518096375 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f125412d280 0x7f125411aa60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f124c000f80 tx=0x7f124c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:16.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.260+0000 7f462b845700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f462409d860 0x7f4624120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:16.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.260+0000 7f462b845700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f462409e340 0x7f4624120b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:16.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.260+0000 7f462b845700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4624135f20 0x7f46241210a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:16.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.260+0000 7f462b845700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4624123c40 con 0x7f462409e340 2023-09-30T22:23:16.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.260+0000 7f462b845700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4624123e20 con 0x7f462409d860 2023-09-30T22:23:16.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.260+0000 7f462b845700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46240727b0 con 0x7f4624135f20 2023-09-30T22:23:16.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.260+0000 7f4628de0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f462409e340 0x7f4624120b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:16.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.260+0000 7f46295e1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f462409d860 0x7f4624120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:16.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.260+0000 7f4628de0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f462409e340 0x7f4624120b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44636/0 (socket says 172.21.15.156:44636) 2023-09-30T22:23:16.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.260+0000 7f4628de0700 1 -- 172.21.15.156:0/2522268903 learned_addr learned my addr 172.21.15.156:0/2522268903 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:16.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.260+0000 7f4629de2700 1 --2- 172.21.15.156:0/2522268903 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4624135f20 0x7f46241210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:16.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.260+0000 7f4628de0700 1 -- 172.21.15.156:0/2522268903 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4624135f20 msgr2=0x7f46241210a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:16.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.260+0000 7f4628de0700 1 --2- 172.21.15.156:0/2522268903 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4624135f20 0x7f46241210a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.260+0000 7f4628de0700 1 -- 172.21.15.156:0/2522268903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f462409d860 msgr2=0x7f4624120620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:16.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.260+0000 7f4628de0700 1 --2- 172.21.15.156:0/2522268903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f462409d860 0x7f4624120620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.260+0000 7f4628de0700 1 -- 172.21.15.156:0/2522268903 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461400b740 con 0x7f462409e340 2023-09-30T22:23:16.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.260+0000 7f4628de0700 1 --2- 172.21.15.156:0/2522268903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f462409e340 0x7f4624120b60 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f461400be30 tx=0x7f4614004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:16.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.260+0000 7f1242ffd700 1 -- 172.21.15.156:0/518096375 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c026070 con 0x7f125412d280 2023-09-30T22:23:16.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.260+0000 7f1242ffd700 1 -- 172.21.15.156:0/518096375 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124c003a20 con 0x7f125412d280 2023-09-30T22:23:16.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.260+0000 7f1242ffd700 1 -- 172.21.15.156:0/518096375 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c003dd0 con 0x7f125412d280 2023-09-30T22:23:16.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.260+0000 7f1258d84700 1 -- 172.21.15.156:0/518096375 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f124c008260 con 0x7f125412d280 2023-09-30T22:23:16.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.261+0000 7f1258d84700 1 -- 172.21.15.156:0/518096375 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125411dd10 con 0x7f125412d280 2023-09-30T22:23:16.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.261+0000 7f4619ffb700 1 -- 172.21.15.156:0/2522268903 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461401d070 con 0x7f462409e340 2023-09-30T22:23:16.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.261+0000 7f4619ffb700 1 -- 172.21.15.156:0/2522268903 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4614010820 con 0x7f462409e340 2023-09-30T22:23:16.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.261+0000 7f4619ffb700 1 -- 172.21.15.156:0/2522268903 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4614010bd0 con 0x7f462409e340 2023-09-30T22:23:16.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.261+0000 7f462b845700 1 -- 172.21.15.156:0/2522268903 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f462409c8b0 con 0x7f462409e340 2023-09-30T22:23:16.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.261+0000 7f462b845700 1 -- 172.21.15.156:0/2522268903 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4624124100 con 0x7f462409e340 2023-09-30T22:23:16.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.262+0000 7f1258d84700 1 -- 172.21.15.156:0/518096375 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1254070e50 con 0x7f125412d280 2023-09-30T22:23:16.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.262+0000 7f462b845700 1 -- 172.21.15.156:0/2522268903 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46040052e0 con 0x7f462409e340 2023-09-30T22:23:16.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.262+0000 7f4619ffb700 1 -- 172.21.15.156:0/2522268903 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f46140036a0 con 0x7f462409e340 2023-09-30T22:23:16.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.262+0000 7f1242ffd700 1 -- 172.21.15.156:0/518096375 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f124c00b660 con 0x7f125412d280 2023-09-30T22:23:16.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.263+0000 7f1242ffd700 1 -- 172.21.15.156:0/518096375 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f124c049360 con 0x7f125412d280 2023-09-30T22:23:16.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.263+0000 7f4619ffb700 1 -- 172.21.15.156:0/2522268903 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4614040850 con 0x7f462409e340 2023-09-30T22:23:16.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.267+0000 7f4619ffb700 1 -- 172.21.15.156:0/2522268903 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4614003950 con 0x7f462409e340 2023-09-30T22:23:16.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.271+0000 7f1242ffd700 1 -- 172.21.15.156:0/518096375 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f124c02ae20 con 0x7f125412d280 2023-09-30T22:23:16.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.385+0000 7fc62a382700 1 -- 172.21.15.156:0/2181451815 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc6240a0100 con 0x7fc6240a0a30 2023-09-30T22:23:16.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.385+0000 7fc620ff9700 1 -- 172.21.15.156:0/2181451815 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc614017b90 con 0x7fc6240a0a30 2023-09-30T22:23:16.386 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:16.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.388+0000 7fc62a382700 1 -- 172.21.15.156:0/2181451815 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc6240a0a30 msgr2=0x7fc62411eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:16.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.388+0000 7fc62a382700 1 --2- 172.21.15.156:0/2181451815 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc6240a0a30 0x7fc62411eb60 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc61400ad40 tx=0x7fc614004750 comp rx=0 tx=0).stop 2023-09-30T22:23:16.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.388+0000 7fc62a382700 1 -- 172.21.15.156:0/2181451815 shutdown_connections 2023-09-30T22:23:16.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.388+0000 7fc62a382700 1 --2- 172.21.15.156:0/2181451815 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6241304a0 0x7fc62411f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.388+0000 7fc62a382700 1 --2- 172.21.15.156:0/2181451815 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc6240a0a30 0x7fc62411eb60 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.388+0000 7fc62a382700 1 --2- 172.21.15.156:0/2181451815 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6240a1340 0x7fc62411f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.388+0000 7fc62a382700 1 -- 172.21.15.156:0/2181451815 >> 172.21.15.156:0/2181451815 conn(0x7fc6240a2980 msgr2=0x7fc62406eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:16.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.389+0000 7fc62a382700 1 -- 172.21.15.156:0/2181451815 shutdown_connections 2023-09-30T22:23:16.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.389+0000 7fc62a382700 1 -- 172.21.15.156:0/2181451815 wait complete. 2023-09-30T22:23:16.406 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:16.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.437+0000 7f615dfb3700 1 -- 172.21.15.156:0/420950191 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f615811aed0 con 0x7f615809d860 2023-09-30T22:23:16.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.439+0000 7f613ffff700 1 -- 172.21.15.156:0/420950191 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f61480192c0 con 0x7f615809d860 2023-09-30T22:23:16.440 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:16.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.441+0000 7f615dfb3700 1 -- 172.21.15.156:0/420950191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f615809d860 msgr2=0x7f61581c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:16.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.441+0000 7f615dfb3700 1 --2- 172.21.15.156:0/420950191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f615809d860 0x7f61581c8520 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f614800c520 tx=0x7f614800c830 comp rx=0 tx=0).stop 2023-09-30T22:23:16.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.441+0000 7f615dfb3700 1 -- 172.21.15.156:0/420950191 shutdown_connections 2023-09-30T22:23:16.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.441+0000 7f615dfb3700 1 --2- 172.21.15.156:0/420950191 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6158135f20 0x7f61581c4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.441+0000 7f615dfb3700 1 --2- 172.21.15.156:0/420950191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f615809d860 0x7f61581c8520 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.441+0000 7f615dfb3700 1 --2- 172.21.15.156:0/420950191 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f615809e340 0x7f61581c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.441+0000 7f615dfb3700 1 -- 172.21.15.156:0/420950191 >> 172.21.15.156:0/420950191 conn(0x7f6158099c40 msgr2=0x7f6158070de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:16.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.442+0000 7f615dfb3700 1 -- 172.21.15.156:0/420950191 shutdown_connections 2023-09-30T22:23:16.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.442+0000 7f615dfb3700 1 -- 172.21.15.156:0/420950191 wait complete. 2023-09-30T22:23:16.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:16.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.464+0000 7f462b845700 1 -- 172.21.15.156:0/2522268903 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4604005590 con 0x7f462409e340 2023-09-30T22:23:16.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.464+0000 7f4619ffb700 1 -- 172.21.15.156:0/2522268903 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4614026090 con 0x7f462409e340 2023-09-30T22:23:16.465 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:16.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.466+0000 7f462b845700 1 -- 172.21.15.156:0/2522268903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f462409e340 msgr2=0x7f4624120b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:16.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.466+0000 7f462b845700 1 --2- 172.21.15.156:0/2522268903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f462409e340 0x7f4624120b60 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f461400be30 tx=0x7f4614004750 comp rx=0 tx=0).stop 2023-09-30T22:23:16.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.466+0000 7f462b845700 1 -- 172.21.15.156:0/2522268903 shutdown_connections 2023-09-30T22:23:16.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.466+0000 7f462b845700 1 --2- 172.21.15.156:0/2522268903 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4624135f20 0x7f46241210a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.466+0000 7f462b845700 1 --2- 172.21.15.156:0/2522268903 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f462409d860 0x7f4624120620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.466+0000 7f462b845700 1 --2- 172.21.15.156:0/2522268903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f462409e340 0x7f4624120b60 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.466+0000 7f462b845700 1 -- 172.21.15.156:0/2522268903 >> 172.21.15.156:0/2522268903 conn(0x7f4624099c40 msgr2=0x7f46240a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:16.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.466+0000 7f462b845700 1 -- 172.21.15.156:0/2522268903 shutdown_connections 2023-09-30T22:23:16.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.466+0000 7f462b845700 1 -- 172.21.15.156:0/2522268903 wait complete. 2023-09-30T22:23:16.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:16.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.478+0000 7f1258d84700 1 -- 172.21.15.156:0/518096375 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f125404f2a0 con 0x7f125412d280 2023-09-30T22:23:16.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.479+0000 7f1242ffd700 1 -- 172.21.15.156:0/518096375 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f124c01b030 con 0x7f125412d280 2023-09-30T22:23:16.479 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:16.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.481+0000 7f1258d84700 1 -- 172.21.15.156:0/518096375 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f125412d280 msgr2=0x7f125411aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:16.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.481+0000 7f1258d84700 1 --2- 172.21.15.156:0/518096375 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f125412d280 0x7f125411aa60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f124c000f80 tx=0x7f124c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.481+0000 7f1258d84700 1 -- 172.21.15.156:0/518096375 shutdown_connections 2023-09-30T22:23:16.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.481+0000 7f1258d84700 1 --2- 172.21.15.156:0/518096375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1254130ce0 0x7f125411b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.481+0000 7f1258d84700 1 --2- 172.21.15.156:0/518096375 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f125412d280 0x7f125411aa60 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.481+0000 7f1258d84700 1 --2- 172.21.15.156:0/518096375 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1254130350 0x7f125411afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.481+0000 7f1258d84700 1 -- 172.21.15.156:0/518096375 >> 172.21.15.156:0/518096375 conn(0x7f12540a2980 msgr2=0x7f125406df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:16.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.481+0000 7f1258d84700 1 -- 172.21.15.156:0/518096375 shutdown_connections 2023-09-30T22:23:16.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:16.481+0000 7f1258d84700 1 -- 172.21.15.156:0/518096375 wait complete. 2023-09-30T22:23:16.493 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:17.407 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:17.455 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:17.480 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:17.494 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:17.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.557+0000 7f1414d5d700 1 Processor -- start 2023-09-30T22:23:17.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.557+0000 7f1414d5d700 1 -- start start 2023-09-30T22:23:17.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.558+0000 7f1414d5d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1410136960 0x7f1410138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.558+0000 7f1414d5d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1410139280 0x7f141013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.558+0000 7f1414d5d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f141006b2d0 con 0x7f1410133ad0 2023-09-30T22:23:17.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.558+0000 7f1414d5d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14101345b0 con 0x7f1410139280 2023-09-30T22:23:17.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.558+0000 7f1414d5d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1410133610 con 0x7f1410136960 2023-09-30T22:23:17.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.558+0000 7f140e59c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f1410133ad0 0x7f1410133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:42650/0 (socket says 172.21.15.156:42650) 2023-09-30T22:23:17.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.558+0000 7f140e59c700 1 -- 172.21.15.156:0/2657648581 learned_addr learned my addr 172.21.15.156:0/2657648581 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:17.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.558+0000 7f140ed9d700 1 --2- 172.21.15.156:0/2657648581 >> v2:172.21.15.156:3300/0 conn(0x7f1410139280 0x7f141013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.558+0000 7f140dd9b700 1 --2- 172.21.15.156:0/2657648581 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1410136960 0x7f1410138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.558+0000 7f140d59a700 1 -- 172.21.15.156:0/2657648581 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3031022806 0 0) 0x7f141006b2d0 con 0x7f1410133ad0 2023-09-30T22:23:17.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.558+0000 7f140d59a700 1 -- 172.21.15.156:0/2657648581 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13f80035b0 con 0x7f1410133ad0 2023-09-30T22:23:17.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.558+0000 7f140dd9b700 1 -- 172.21.15.156:0/2657648581 >> v2:172.21.15.156:3300/0 conn(0x7f1410139280 msgr2=0x7f141013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:17.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.558+0000 7f140dd9b700 1 --2- 172.21.15.156:0/2657648581 >> v2:172.21.15.156:3300/0 conn(0x7f1410139280 0x7f141013b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.558+0000 7f140dd9b700 1 -- 172.21.15.156:0/2657648581 >> v1:172.21.15.156:6789/0 conn(0x7f1410133ad0 legacy=0x7f1410133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.558+0000 7f140dd9b700 1 -- 172.21.15.156:0/2657648581 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141009a500 con 0x7f1410136960 2023-09-30T22:23:17.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.558+0000 7f140ed9d700 1 --2- 172.21.15.156:0/2657648581 >> v2:172.21.15.156:3300/0 conn(0x7f1410139280 0x7f141013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:17.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.559+0000 7f140dd9b700 1 --2- 172.21.15.156:0/2657648581 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1410136960 0x7f1410138d40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f1404009870 tx=0x7f1404009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55793b18be4a3e80 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:17.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.559+0000 7f140d59a700 1 -- 172.21.15.156:0/2657648581 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1404011830 con 0x7f1410136960 2023-09-30T22:23:17.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.559+0000 7f140d59a700 1 -- 172.21.15.156:0/2657648581 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1404011990 con 0x7f1410136960 2023-09-30T22:23:17.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.559+0000 7f140d59a700 1 -- 172.21.15.156:0/2657648581 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1404011d20 con 0x7f1410136960 2023-09-30T22:23:17.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.560+0000 7f1414d5d700 1 -- 172.21.15.156:0/2657648581 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1410136960 msgr2=0x7f1410138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.560+0000 7f1414d5d700 1 --2- 172.21.15.156:0/2657648581 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1410136960 0x7f1410138d40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f1404009870 tx=0x7f1404009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:17.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.560+0000 7f1414d5d700 1 -- 172.21.15.156:0/2657648581 shutdown_connections 2023-09-30T22:23:17.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.560+0000 7f1414d5d700 1 --2- 172.21.15.156:0/2657648581 >> v2:172.21.15.156:3300/0 conn(0x7f1410139280 0x7f141013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.560+0000 7f1414d5d700 1 --2- 172.21.15.156:0/2657648581 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1410136960 0x7f1410138d40 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.560+0000 7f1414d5d700 1 -- 172.21.15.156:0/2657648581 >> 172.21.15.156:0/2657648581 conn(0x7f1410099c40 msgr2=0x7f14100a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:17.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.560+0000 7f1414d5d700 1 -- 172.21.15.156:0/2657648581 shutdown_connections 2023-09-30T22:23:17.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.560+0000 7f1414d5d700 1 -- 172.21.15.156:0/2657648581 wait complete. 2023-09-30T22:23:17.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.562+0000 7f1414d5d700 1 Processor -- start 2023-09-30T22:23:17.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.562+0000 7f1414d5d700 1 -- start start 2023-09-30T22:23:17.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.562+0000 7f1414d5d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1410133ad0 0x7f14100710a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.562+0000 7f1414d5d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1410136960 0x7f14100715e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.562+0000 7f1414d5d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1410139280 0x7f1410071b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.562+0000 7f1414d5d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141006ff20 con 0x7f1410136960 2023-09-30T22:23:17.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.562+0000 7f1414d5d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141009f390 con 0x7f1410139280 2023-09-30T22:23:17.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.562+0000 7f1414d5d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1410072150 con 0x7f1410133ad0 2023-09-30T22:23:17.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.562+0000 7f140e59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1410133ad0 0x7f14100710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.563+0000 7f140e59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1410133ad0 0x7f14100710a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56062/0 (socket says 172.21.15.156:56062) 2023-09-30T22:23:17.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.563+0000 7f140e59c700 1 -- 172.21.15.156:0/2230034227 learned_addr learned my addr 172.21.15.156:0/2230034227 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:17.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.563+0000 7f140ed9d700 1 --2- 172.21.15.156:0/2230034227 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1410139280 0x7f1410071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.563+0000 7f140dd9b700 1 --2- 172.21.15.156:0/2230034227 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1410136960 0x7f14100715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.563+0000 7f140e59c700 1 -- 172.21.15.156:0/2230034227 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1410139280 msgr2=0x7f1410071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.563+0000 7f140e59c700 1 --2- 172.21.15.156:0/2230034227 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1410139280 0x7f1410071b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.563+0000 7f140e59c700 1 -- 172.21.15.156:0/2230034227 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1410136960 msgr2=0x7f14100715e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.563+0000 7f140e59c700 1 --2- 172.21.15.156:0/2230034227 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1410136960 0x7f14100715e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.563+0000 7f140e59c700 1 -- 172.21.15.156:0/2230034227 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14040094a0 con 0x7f1410133ad0 2023-09-30T22:23:17.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.563+0000 7f140e59c700 1 --2- 172.21.15.156:0/2230034227 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1410133ad0 0x7f14100710a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1400001eb0 tx=0x7f140000c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:17.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.563+0000 7f13feffd700 1 -- 172.21.15.156:0/2230034227 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1400005d70 con 0x7f1410133ad0 2023-09-30T22:23:17.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.563+0000 7f13feffd700 1 -- 172.21.15.156:0/2230034227 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14000070d0 con 0x7f1410133ad0 2023-09-30T22:23:17.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.563+0000 7f1414d5d700 1 -- 172.21.15.156:0/2230034227 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f141006eda0 con 0x7f1410133ad0 2023-09-30T22:23:17.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.563+0000 7f13feffd700 1 -- 172.21.15.156:0/2230034227 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1400007440 con 0x7f1410133ad0 2023-09-30T22:23:17.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.563+0000 7f1414d5d700 1 -- 172.21.15.156:0/2230034227 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1410070c50 con 0x7f1410133ad0 2023-09-30T22:23:17.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.564+0000 7f13feffd700 1 -- 172.21.15.156:0/2230034227 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f14000075a0 con 0x7f1410133ad0 2023-09-30T22:23:17.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.564+0000 7f13feffd700 1 -- 172.21.15.156:0/2230034227 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f140003eae0 con 0x7f1410133ad0 2023-09-30T22:23:17.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.566+0000 7f1414d5d700 1 -- 172.21.15.156:0/2230034227 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f141004f2a0 con 0x7f1410133ad0 2023-09-30T22:23:17.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.570+0000 7f13feffd700 1 -- 172.21.15.156:0/2230034227 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1400019b40 con 0x7f1410133ad0 2023-09-30T22:23:17.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.610+0000 7f1f4e043700 1 Processor -- start 2023-09-30T22:23:17.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.610+0000 7f1f4e043700 1 -- start start 2023-09-30T22:23:17.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.611+0000 7f1f4e043700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f48133ad0 0x7f1f48133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.611+0000 7f1f4e043700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1f481300a0 0x7f1f481304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.611+0000 7f1f4e043700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f481309f0 0x7f1f4813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.611+0000 7f1f4e043700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f4806b2d0 con 0x7f1f481300a0 2023-09-30T22:23:17.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.611+0000 7f1f4e043700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f48133610 con 0x7f1f481309f0 2023-09-30T22:23:17.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.611+0000 7f1f4e043700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4809a500 con 0x7f1f48133ad0 2023-09-30T22:23:17.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.611+0000 7f1f477fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f48133ad0 0x7f1f48133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.611+0000 7f1f477fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f48133ad0 0x7f1f48133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56074/0 (socket says 172.21.15.156:56074) 2023-09-30T22:23:17.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.611+0000 7f1f47fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f481309f0 0x7f1f4813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.611+0000 7f1f477fe700 1 -- 172.21.15.156:0/3488343309 learned_addr learned my addr 172.21.15.156:0/3488343309 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:17.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.612+0000 7f1f46ffd700 1 --2- 172.21.15.156:0/3488343309 >> v2:172.21.15.156:3300/0 conn(0x7f1f481300a0 0x7f1f481304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.612+0000 7f1f477fe700 1 -- 172.21.15.156:0/3488343309 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f481309f0 msgr2=0x7f1f4813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:17.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.612+0000 7f1f477fe700 1 --2- 172.21.15.156:0/3488343309 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f481309f0 0x7f1f4813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.612+0000 7f1f477fe700 1 -- 172.21.15.156:0/3488343309 >> v2:172.21.15.156:3300/0 conn(0x7f1f481300a0 msgr2=0x7f1f481304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:17.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.612+0000 7f1f477fe700 1 --2- 172.21.15.156:0/3488343309 >> v2:172.21.15.156:3300/0 conn(0x7f1f481300a0 0x7f1f481304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.612+0000 7f1f477fe700 1 -- 172.21.15.156:0/3488343309 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f481338b0 con 0x7f1f48133ad0 2023-09-30T22:23:17.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.612+0000 7f1f477fe700 1 --2- 172.21.15.156:0/3488343309 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f48133ad0 0x7f1f48133ea0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1f380098f0 tx=0x7f1f38009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d0ea14dc2c7a522 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:17.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.612+0000 7f1f467fc700 1 -- 172.21.15.156:0/3488343309 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f38011830 con 0x7f1f48133ad0 2023-09-30T22:23:17.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.612+0000 7f1f467fc700 1 -- 172.21.15.156:0/3488343309 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f38011990 con 0x7f1f48133ad0 2023-09-30T22:23:17.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.612+0000 7f1f467fc700 1 -- 172.21.15.156:0/3488343309 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f38011d20 con 0x7f1f48133ad0 2023-09-30T22:23:17.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.613+0000 7f1f4e043700 1 -- 172.21.15.156:0/3488343309 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f48133ad0 msgr2=0x7f1f48133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.613+0000 7f1f4e043700 1 --2- 172.21.15.156:0/3488343309 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f48133ad0 0x7f1f48133ea0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1f380098f0 tx=0x7f1f38009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:17.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.613+0000 7f1f4e043700 1 -- 172.21.15.156:0/3488343309 shutdown_connections 2023-09-30T22:23:17.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.613+0000 7f1f4e043700 1 --2- 172.21.15.156:0/3488343309 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f481309f0 0x7f1f4813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.613+0000 7f1f4e043700 1 --2- 172.21.15.156:0/3488343309 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f48133ad0 0x7f1f48133ea0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.613+0000 7f1f4e043700 1 --2- 172.21.15.156:0/3488343309 >> v2:172.21.15.156:3300/0 conn(0x7f1f481300a0 0x7f1f481304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.613+0000 7f1f4e043700 1 -- 172.21.15.156:0/3488343309 >> 172.21.15.156:0/3488343309 conn(0x7f1f48099c40 msgr2=0x7f1f480a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:17.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.617+0000 7f1f4e043700 1 -- 172.21.15.156:0/3488343309 shutdown_connections 2023-09-30T22:23:17.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.617+0000 7f1f4e043700 1 -- 172.21.15.156:0/3488343309 wait complete. 2023-09-30T22:23:17.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.618+0000 7f1f4e043700 1 Processor -- start 2023-09-30T22:23:17.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.618+0000 7f1f4e043700 1 -- start start 2023-09-30T22:23:17.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.618+0000 7f1f4e043700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f481300a0 0x7f1f480713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.618+0000 7f1f4e043700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f481309f0 0x7f1f48071900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.618+0000 7f1f4e043700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f48133ad0 0x7f1f48071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.618+0000 7f1f4e043700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4811e040 con 0x7f1f481300a0 2023-09-30T22:23:17.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.618+0000 7f1f4e043700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f48072820 con 0x7f1f48133ad0 2023-09-30T22:23:17.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.618+0000 7f1f4e043700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4811eed0 con 0x7f1f481309f0 2023-09-30T22:23:17.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.618+0000 7f1f46ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f481309f0 0x7f1f48071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.618+0000 7f1f46ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f481309f0 0x7f1f48071900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56080/0 (socket says 172.21.15.156:56080) 2023-09-30T22:23:17.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.618+0000 7f1f46ffd700 1 -- 172.21.15.156:0/1266486037 learned_addr learned my addr 172.21.15.156:0/1266486037 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:17.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.618+0000 7f1f477fe700 1 --2- 172.21.15.156:0/1266486037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f481300a0 0x7f1f480713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.618+0000 7f1f47fff700 1 --2- 172.21.15.156:0/1266486037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f48133ad0 0x7f1f48071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.619+0000 7f1f46ffd700 1 -- 172.21.15.156:0/1266486037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f48133ad0 msgr2=0x7f1f48071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.619+0000 7f1f46ffd700 1 --2- 172.21.15.156:0/1266486037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f48133ad0 0x7f1f48071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.619+0000 7f1f46ffd700 1 -- 172.21.15.156:0/1266486037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f481300a0 msgr2=0x7f1f480713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.619+0000 7f1f46ffd700 1 --2- 172.21.15.156:0/1266486037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f481300a0 0x7f1f480713c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.619+0000 7f1f46ffd700 1 -- 172.21.15.156:0/1266486037 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f38009550 con 0x7f1f481309f0 2023-09-30T22:23:17.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.619+0000 7f1f46ffd700 1 --2- 172.21.15.156:0/1266486037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f481309f0 0x7f1f48071900 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00e980 tx=0x7f1f3c00ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:17.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.619+0000 7f1f2ffff700 1 -- 172.21.15.156:0/1266486037 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c009710 con 0x7f1f481309f0 2023-09-30T22:23:17.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.619+0000 7f1f2ffff700 1 -- 172.21.15.156:0/1266486037 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3c00c690 con 0x7f1f481309f0 2023-09-30T22:23:17.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.619+0000 7f1f4e043700 1 -- 172.21.15.156:0/1266486037 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f4811f9b0 con 0x7f1f481309f0 2023-09-30T22:23:17.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.619+0000 7f1f2ffff700 1 -- 172.21.15.156:0/1266486037 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c00ca00 con 0x7f1f481309f0 2023-09-30T22:23:17.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.619+0000 7f1f4e043700 1 -- 172.21.15.156:0/1266486037 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4812dd00 con 0x7f1f481309f0 2023-09-30T22:23:17.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.621+0000 7f1f4e043700 1 -- 172.21.15.156:0/1266486037 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f4809cb20 con 0x7f1f481309f0 2023-09-30T22:23:17.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.621+0000 7f1f2ffff700 1 -- 172.21.15.156:0/1266486037 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f3c00cb60 con 0x7f1f481309f0 2023-09-30T22:23:17.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.621+0000 7f1f2ffff700 1 -- 172.21.15.156:0/1266486037 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1f3c03fe80 con 0x7f1f481309f0 2023-09-30T22:23:17.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.629+0000 7f1f2ffff700 1 -- 172.21.15.156:0/1266486037 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f3c013470 con 0x7f1f481309f0 2023-09-30T22:23:17.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.635+0000 7fddd3c19700 1 Processor -- start 2023-09-30T22:23:17.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.635+0000 7fddd3c19700 1 -- start start 2023-09-30T22:23:17.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.635+0000 7fddd3c19700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fddcc0a0a30 0x7fddcc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.635+0000 7fddd3c19700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fddcc0a1340 0x7fddcc12ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.635+0000 7fddd3c19700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddcc0a1e70 con 0x7fddcc1304a0 2023-09-30T22:23:17.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.635+0000 7fddd3c19700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddcc09a720 con 0x7fddcc0a1340 2023-09-30T22:23:17.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.635+0000 7fddd3c19700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc09b300 con 0x7fddcc0a0a30 2023-09-30T22:23:17.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.636+0000 7fddd11b4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fddcc0a1340 0x7fddcc12ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.636+0000 7fddd21b6700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fddcc1304a0 0x7fddcc1371b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:42666/0 (socket says 172.21.15.156:42666) 2023-09-30T22:23:17.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.636+0000 7fddd21b6700 1 -- 172.21.15.156:0/259991558 learned_addr learned my addr 172.21.15.156:0/259991558 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:17.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.636+0000 7fddd19b5700 1 --2- 172.21.15.156:0/259991558 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fddcc0a0a30 0x7fddcc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.636+0000 7fddd11b4700 1 -- 172.21.15.156:0/259991558 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fddcc0a0a30 msgr2=0x7fddcc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:17.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.636+0000 7fddd11b4700 1 --2- 172.21.15.156:0/259991558 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fddcc0a0a30 0x7fddcc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.636+0000 7fddd11b4700 1 -- 172.21.15.156:0/259991558 >> v1:172.21.15.156:6789/0 conn(0x7fddcc1304a0 legacy=0x7fddcc1371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.636+0000 7fddd11b4700 1 -- 172.21.15.156:0/259991558 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc09abc0 con 0x7fddcc0a1340 2023-09-30T22:23:17.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.636+0000 7fddd11b4700 1 --2- 172.21.15.156:0/259991558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fddcc0a1340 0x7fddcc12ff60 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fddbc009840 tx=0x7fddbc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4dc9b0b2b5519b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:17.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.636+0000 7fddd09b3700 1 -- 172.21.15.156:0/259991558 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc011830 con 0x7fddcc0a1340 2023-09-30T22:23:17.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.636+0000 7fddd09b3700 1 -- 172.21.15.156:0/259991558 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddbc011990 con 0x7fddcc0a1340 2023-09-30T22:23:17.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.636+0000 7fddd09b3700 1 -- 172.21.15.156:0/259991558 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc011d20 con 0x7fddcc0a1340 2023-09-30T22:23:17.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.637+0000 7fddd3c19700 1 -- 172.21.15.156:0/259991558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fddcc0a1340 msgr2=0x7fddcc12ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.637+0000 7fddd3c19700 1 --2- 172.21.15.156:0/259991558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fddcc0a1340 0x7fddcc12ff60 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fddbc009840 tx=0x7fddbc009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:17.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.637+0000 7fddd3c19700 1 -- 172.21.15.156:0/259991558 shutdown_connections 2023-09-30T22:23:17.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.637+0000 7fddd3c19700 1 --2- 172.21.15.156:0/259991558 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fddcc0a0a30 0x7fddcc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.637+0000 7fddd3c19700 1 --2- 172.21.15.156:0/259991558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fddcc0a1340 0x7fddcc12ff60 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.637+0000 7fddd3c19700 1 -- 172.21.15.156:0/259991558 >> 172.21.15.156:0/259991558 conn(0x7fddcc0a2980 msgr2=0x7fddcc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:17.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.637+0000 7fddd3c19700 1 -- 172.21.15.156:0/259991558 shutdown_connections 2023-09-30T22:23:17.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.637+0000 7fddd3c19700 1 -- 172.21.15.156:0/259991558 wait complete. 2023-09-30T22:23:17.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.638+0000 7f9d69a3f700 1 Processor -- start 2023-09-30T22:23:17.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.638+0000 7f9d69a3f700 1 -- start start 2023-09-30T22:23:17.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.638+0000 7fddd3c19700 1 Processor -- start 2023-09-30T22:23:17.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.638+0000 7fddd3c19700 1 -- start start 2023-09-30T22:23:17.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7fddd3c19700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fddcc0a0a30 0x7fddcc11e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7fddd3c19700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fddcc0a1340 0x7fddcc11eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7f9d69a3f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d64133ad0 0x7f9d64133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7f9d69a3f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d641300a0 0x7f9d641304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7f9d69a3f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d6406b2d0 con 0x7f9d641309f0 2023-09-30T22:23:17.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7f9d69a3f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d64133610 con 0x7f9d641300a0 2023-09-30T22:23:17.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7f9d69a3f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6409a500 con 0x7f9d64133ad0 2023-09-30T22:23:17.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7fddd3c19700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fddcc1304a0 0x7fddcc11f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7fddd3c19700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc122b30 con 0x7fddcc0a1340 2023-09-30T22:23:17.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7fddd3c19700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc120300 con 0x7fddcc0a0a30 2023-09-30T22:23:17.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7fddd3c19700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc121e90 con 0x7fddcc1304a0 2023-09-30T22:23:17.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7f9d637fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f9d641309f0 0x7f9d6413a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:42670/0 (socket says 172.21.15.156:42670) 2023-09-30T22:23:17.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7f9d637fe700 1 -- 172.21.15.156:0/520375722 learned_addr learned my addr 172.21.15.156:0/520375722 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:17.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7fddd11b4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fddcc0a1340 0x7fddcc11eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7fddd11b4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fddcc0a1340 0x7fddcc11eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44670/0 (socket says 172.21.15.156:44670) 2023-09-30T22:23:17.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7fddd11b4700 1 -- 172.21.15.156:0/3091019309 learned_addr learned my addr 172.21.15.156:0/3091019309 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:17.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7f9d61ffb700 1 -- 172.21.15.156:0/520375722 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2327947234 0 0) 0x7f9d6406b2d0 con 0x7f9d641309f0 2023-09-30T22:23:17.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7f9d61ffb700 1 -- 172.21.15.156:0/520375722 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d500035b0 con 0x7f9d641309f0 2023-09-30T22:23:17.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7f9d61ffb700 1 -- 172.21.15.156:0/520375722 <== mon.0 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2702957448 0 0) 0x7f9d500035b0 con 0x7f9d641309f0 2023-09-30T22:23:17.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7fddd11b4700 1 -- 172.21.15.156:0/3091019309 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fddcc1304a0 msgr2=0x7fddcc11f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7fddd11b4700 1 --2- 172.21.15.156:0/3091019309 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fddcc1304a0 0x7fddcc11f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7fddd11b4700 1 -- 172.21.15.156:0/3091019309 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fddcc0a0a30 msgr2=0x7fddcc11e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7fddd11b4700 1 --2- 172.21.15.156:0/3091019309 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fddcc0a0a30 0x7fddcc11e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7fddd11b4700 1 -- 172.21.15.156:0/3091019309 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddbc0094a0 con 0x7fddcc0a1340 2023-09-30T22:23:17.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7f9d61ffb700 1 -- 172.21.15.156:0/520375722 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d64133ad0 msgr2=0x7f9d64133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:17.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7f9d61ffb700 1 --2- 172.21.15.156:0/520375722 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d64133ad0 0x7f9d64133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7f9d61ffb700 1 -- 172.21.15.156:0/520375722 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d641300a0 msgr2=0x7f9d641304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:17.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7f9d61ffb700 1 --2- 172.21.15.156:0/520375722 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d641300a0 0x7f9d641304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7f9d61ffb700 1 -- 172.21.15.156:0/520375722 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d641338b0 con 0x7f9d641309f0 2023-09-30T22:23:17.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7f9d61ffb700 1 -- 172.21.15.156:0/520375722 <== mon.0 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2864602571 0 0) 0x7f9d5c0019f0 con 0x7f9d641309f0 2023-09-30T22:23:17.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.639+0000 7f9d61ffb700 1 -- 172.21.15.156:0/520375722 >> v1:172.21.15.156:6789/0 conn(0x7f9d641309f0 legacy=0x7f9d6413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.640+0000 7f9d61ffb700 1 --2- 172.21.15.156:0/520375722 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d50003a70 0x7f9d50003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.640+0000 7f9d61ffb700 1 --2- 172.21.15.156:0/520375722 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d641300a0 0x7f9d50004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.640+0000 7f9d61ffb700 1 --2- 172.21.15.156:0/520375722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d50004e60 0x7f9d500052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.640+0000 7f9d61ffb700 1 -- 172.21.15.156:0/520375722 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d64133610 con 0x7f9d50004e60 2023-09-30T22:23:17.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.640+0000 7f9d61ffb700 1 -- 172.21.15.156:0/520375722 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6409a500 con 0x7f9d641300a0 2023-09-30T22:23:17.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.640+0000 7f9d61ffb700 1 -- 172.21.15.156:0/520375722 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5000bd40 con 0x7f9d50003a70 2023-09-30T22:23:17.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.640+0000 7fddd11b4700 1 --2- 172.21.15.156:0/3091019309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fddcc0a1340 0x7fddcc11eb90 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fddbc0090b0 tx=0x7fddbc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:17.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.640+0000 7fddc27fc700 1 -- 172.21.15.156:0/3091019309 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc0036a0 con 0x7fddcc0a1340 2023-09-30T22:23:17.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.640+0000 7f9d637fe700 1 --2- 172.21.15.156:0/520375722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d50004e60 0x7f9d500052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.640+0000 7f9d637fe700 1 -- 172.21.15.156:0/520375722 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d50003a70 msgr2=0x7f9d50003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:17.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.640+0000 7f9d637fe700 1 --2- 172.21.15.156:0/520375722 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d50003a70 0x7f9d50003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.640+0000 7f9d637fe700 1 -- 172.21.15.156:0/520375722 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d641300a0 msgr2=0x7f9d50004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:17.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.640+0000 7f9d637fe700 1 --2- 172.21.15.156:0/520375722 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d641300a0 0x7f9d50004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.640+0000 7f9d637fe700 1 -- 172.21.15.156:0/520375722 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d641338b0 con 0x7f9d50004e60 2023-09-30T22:23:17.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.640+0000 7f9d637fe700 1 --2- 172.21.15.156:0/520375722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d50004e60 0x7f9d500052d0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00a8a0 tx=0x7f9d50005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd448ff6eb806571 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:17.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.640+0000 7fddd3c19700 1 -- 172.21.15.156:0/3091019309 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddcc09fd00 con 0x7fddcc0a1340 2023-09-30T22:23:17.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.640+0000 7fddd3c19700 1 -- 172.21.15.156:0/3091019309 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddcc122170 con 0x7fddcc0a1340 2023-09-30T22:23:17.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.640+0000 7fddc27fc700 1 -- 172.21.15.156:0/3091019309 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddbc01f070 con 0x7fddcc0a1340 2023-09-30T22:23:17.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.640+0000 7fddc27fc700 1 -- 172.21.15.156:0/3091019309 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc003a20 con 0x7fddcc0a1340 2023-09-30T22:23:17.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.641+0000 7f9d61ffb700 1 -- 172.21.15.156:0/520375722 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c012600 con 0x7f9d50004e60 2023-09-30T22:23:17.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.641+0000 7f9d61ffb700 1 -- 172.21.15.156:0/520375722 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5c012760 con 0x7f9d50004e60 2023-09-30T22:23:17.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.641+0000 7f9d61ffb700 1 -- 172.21.15.156:0/520375722 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c012ad0 con 0x7f9d50004e60 2023-09-30T22:23:17.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.641+0000 7fddd3c19700 1 -- 172.21.15.156:0/3091019309 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb40052e0 con 0x7fddcc0a1340 2023-09-30T22:23:17.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.641+0000 7fddc27fc700 1 -- 172.21.15.156:0/3091019309 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fddbc003b80 con 0x7fddcc0a1340 2023-09-30T22:23:17.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.641+0000 7fddc27fc700 1 -- 172.21.15.156:0/3091019309 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fddbc021070 con 0x7fddcc0a1340 2023-09-30T22:23:17.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.642+0000 7f9d69a3f700 1 -- 172.21.15.156:0/520375722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d50004e60 msgr2=0x7f9d500052d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.642+0000 7f9d69a3f700 1 --2- 172.21.15.156:0/520375722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d50004e60 0x7f9d500052d0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00a8a0 tx=0x7f9d50005880 comp rx=0 tx=0).stop 2023-09-30T22:23:17.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.642+0000 7f9d69a3f700 1 -- 172.21.15.156:0/520375722 shutdown_connections 2023-09-30T22:23:17.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.642+0000 7f9d69a3f700 1 --2- 172.21.15.156:0/520375722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d50004e60 0x7f9d500052d0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.642+0000 7f9d69a3f700 1 --2- 172.21.15.156:0/520375722 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d641300a0 0x7f9d50004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.642+0000 7f9d69a3f700 1 --2- 172.21.15.156:0/520375722 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d50003a70 0x7f9d50003e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.642+0000 7f9d69a3f700 1 -- 172.21.15.156:0/520375722 >> 172.21.15.156:0/520375722 conn(0x7f9d64099c40 msgr2=0x7f9d640a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:17.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.642+0000 7f9d69a3f700 1 -- 172.21.15.156:0/520375722 shutdown_connections 2023-09-30T22:23:17.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.642+0000 7f9d69a3f700 1 -- 172.21.15.156:0/520375722 wait complete. 2023-09-30T22:23:17.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.644+0000 7f9d69a3f700 1 Processor -- start 2023-09-30T22:23:17.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.644+0000 7f9d69a3f700 1 -- start start 2023-09-30T22:23:17.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.645+0000 7f9d69a3f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d50003a70 0x7f9d6411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.645+0000 7f9d69a3f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d50004e60 0x7f9d6411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.645+0000 7f9d69a3f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d641300a0 0x7f9d6411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.645+0000 7f9d69a3f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6411ed90 con 0x7f9d50003a70 2023-09-30T22:23:17.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.645+0000 7f9d69a3f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d640a3300 con 0x7f9d50004e60 2023-09-30T22:23:17.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.645+0000 7f9d69a3f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6412dd00 con 0x7f9d641300a0 2023-09-30T22:23:17.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.645+0000 7f9d637fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d641300a0 0x7f9d6411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.645+0000 7f9d637fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d641300a0 0x7f9d6411e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56120/0 (socket says 172.21.15.156:56120) 2023-09-30T22:23:17.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.645+0000 7f9d637fe700 1 -- 172.21.15.156:0/657680684 learned_addr learned my addr 172.21.15.156:0/657680684 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:17.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.645+0000 7f9d62ffd700 1 --2- 172.21.15.156:0/657680684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d50003a70 0x7f9d6411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.646+0000 7f9d62ffd700 1 -- 172.21.15.156:0/657680684 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d641300a0 msgr2=0x7f9d6411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.646+0000 7f9d62ffd700 1 --2- 172.21.15.156:0/657680684 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d641300a0 0x7f9d6411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.646+0000 7f9d62ffd700 1 -- 172.21.15.156:0/657680684 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d50004e60 msgr2=0x7f9d6411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.646+0000 7f9d62ffd700 1 --2- 172.21.15.156:0/657680684 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d50004e60 0x7f9d6411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.646+0000 7f9d62ffd700 1 -- 172.21.15.156:0/657680684 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6412d970 con 0x7f9d50003a70 2023-09-30T22:23:17.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.646+0000 7f9d62ffd700 1 --2- 172.21.15.156:0/657680684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d50003a70 0x7f9d6411da40 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f9d640a0ad0 tx=0x7f9d5400b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:17.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.647+0000 7f9d5bfff700 1 -- 172.21.15.156:0/657680684 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d54011620 con 0x7f9d50003a70 2023-09-30T22:23:17.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.647+0000 7f9d5bfff700 1 -- 172.21.15.156:0/657680684 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d54011780 con 0x7f9d50003a70 2023-09-30T22:23:17.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.647+0000 7f9d5bfff700 1 -- 172.21.15.156:0/657680684 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d54011b30 con 0x7f9d50003a70 2023-09-30T22:23:17.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.647+0000 7fddc27fc700 1 -- 172.21.15.156:0/3091019309 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fddbc0253e0 con 0x7fddcc0a1340 2023-09-30T22:23:17.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.653+0000 7f9d69a3f700 1 -- 172.21.15.156:0/657680684 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d64120930 con 0x7f9d50003a70 2023-09-30T22:23:17.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.653+0000 7f9d69a3f700 1 -- 172.21.15.156:0/657680684 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d64071680 con 0x7f9d50003a70 2023-09-30T22:23:17.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.654+0000 7f9d69a3f700 1 -- 172.21.15.156:0/657680684 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d6411f9f0 con 0x7f9d50003a70 2023-09-30T22:23:17.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.654+0000 7f9d5bfff700 1 -- 172.21.15.156:0/657680684 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d54011c90 con 0x7f9d50003a70 2023-09-30T22:23:17.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.655+0000 7f9d5bfff700 1 -- 172.21.15.156:0/657680684 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9d5403f510 con 0x7f9d50003a70 2023-09-30T22:23:17.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.659+0000 7f9d5bfff700 1 -- 172.21.15.156:0/657680684 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d5400f2e0 con 0x7f9d50003a70 2023-09-30T22:23:17.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.817+0000 7f1414d5d700 1 -- 172.21.15.156:0/2230034227 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f141009f0f0 con 0x7f1410133ad0 2023-09-30T22:23:17.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.817+0000 7f13feffd700 1 -- 172.21.15.156:0/2230034227 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1400017030 con 0x7f1410133ad0 2023-09-30T22:23:17.818 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:17.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.819+0000 7f1414d5d700 1 -- 172.21.15.156:0/2230034227 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1410133ad0 msgr2=0x7f14100710a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.819+0000 7f1414d5d700 1 --2- 172.21.15.156:0/2230034227 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1410133ad0 0x7f14100710a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1400001eb0 tx=0x7f140000c7b0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.820+0000 7f1414d5d700 1 -- 172.21.15.156:0/2230034227 shutdown_connections 2023-09-30T22:23:17.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.820+0000 7f1414d5d700 1 --2- 172.21.15.156:0/2230034227 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1410139280 0x7f1410071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.820+0000 7f1414d5d700 1 --2- 172.21.15.156:0/2230034227 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1410133ad0 0x7f14100710a0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.820+0000 7f1414d5d700 1 --2- 172.21.15.156:0/2230034227 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1410136960 0x7f14100715e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.820+0000 7f1414d5d700 1 -- 172.21.15.156:0/2230034227 >> 172.21.15.156:0/2230034227 conn(0x7f1410099c40 msgr2=0x7f14100a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:17.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.820+0000 7f1414d5d700 1 -- 172.21.15.156:0/2230034227 shutdown_connections 2023-09-30T22:23:17.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.820+0000 7f1414d5d700 1 -- 172.21.15.156:0/2230034227 wait complete. 2023-09-30T22:23:17.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:17.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.856+0000 7f1f4e043700 1 -- 172.21.15.156:0/1266486037 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1f4804f2a0 con 0x7f1f481309f0 2023-09-30T22:23:17.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.856+0000 7f1f2ffff700 1 -- 172.21.15.156:0/1266486037 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f3c021070 con 0x7f1f481309f0 2023-09-30T22:23:17.857 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:17.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.858+0000 7f1f4e043700 1 -- 172.21.15.156:0/1266486037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f481309f0 msgr2=0x7f1f48071900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.858+0000 7f1f4e043700 1 --2- 172.21.15.156:0/1266486037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f481309f0 0x7f1f48071900 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00e980 tx=0x7f1f3c00ec90 comp rx=0 tx=0).stop 2023-09-30T22:23:17.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.858+0000 7f1f4e043700 1 -- 172.21.15.156:0/1266486037 shutdown_connections 2023-09-30T22:23:17.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.858+0000 7f1f4e043700 1 --2- 172.21.15.156:0/1266486037 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f48133ad0 0x7f1f48071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.858+0000 7f1f4e043700 1 --2- 172.21.15.156:0/1266486037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f481300a0 0x7f1f480713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.858+0000 7f1f4e043700 1 --2- 172.21.15.156:0/1266486037 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f481309f0 0x7f1f48071900 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.858+0000 7f1f4e043700 1 -- 172.21.15.156:0/1266486037 >> 172.21.15.156:0/1266486037 conn(0x7f1f48099c40 msgr2=0x7f1f48132be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:17.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.858+0000 7f1f4e043700 1 -- 172.21.15.156:0/1266486037 shutdown_connections 2023-09-30T22:23:17.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.858+0000 7f1f4e043700 1 -- 172.21.15.156:0/1266486037 wait complete. 2023-09-30T22:23:17.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.865+0000 7fddd3c19700 1 -- 172.21.15.156:0/3091019309 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fddb4005150 con 0x7fddcc0a1340 2023-09-30T22:23:17.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.866+0000 7fddc27fc700 1 -- 172.21.15.156:0/3091019309 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fddbc015030 con 0x7fddcc0a1340 2023-09-30T22:23:17.866 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:17.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.868+0000 7fddd3c19700 1 -- 172.21.15.156:0/3091019309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fddcc0a1340 msgr2=0x7fddcc11eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.868+0000 7fddd3c19700 1 --2- 172.21.15.156:0/3091019309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fddcc0a1340 0x7fddcc11eb90 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fddbc0090b0 tx=0x7fddbc004750 comp rx=0 tx=0).stop 2023-09-30T22:23:17.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.868+0000 7fddd3c19700 1 -- 172.21.15.156:0/3091019309 shutdown_connections 2023-09-30T22:23:17.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.868+0000 7fddd3c19700 1 --2- 172.21.15.156:0/3091019309 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fddcc1304a0 0x7fddcc11f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.868+0000 7fddd3c19700 1 --2- 172.21.15.156:0/3091019309 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fddcc0a0a30 0x7fddcc11e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.868+0000 7fddd3c19700 1 --2- 172.21.15.156:0/3091019309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fddcc0a1340 0x7fddcc11eb90 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.868+0000 7fddd3c19700 1 -- 172.21.15.156:0/3091019309 >> 172.21.15.156:0/3091019309 conn(0x7fddcc0a2980 msgr2=0x7fddcc09dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:17.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.868+0000 7fddd3c19700 1 -- 172.21.15.156:0/3091019309 shutdown_connections 2023-09-30T22:23:17.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.868+0000 7fddd3c19700 1 -- 172.21.15.156:0/3091019309 wait complete. 2023-09-30T22:23:17.872 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:17.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.878+0000 7f9d69a3f700 1 -- 172.21.15.156:0/657680684 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9d6404f2a0 con 0x7f9d50003a70 2023-09-30T22:23:17.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.879+0000 7f9d5bfff700 1 -- 172.21.15.156:0/657680684 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d54021ab0 con 0x7f9d50003a70 2023-09-30T22:23:17.879 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:17.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:17.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.881+0000 7f9d69a3f700 1 -- 172.21.15.156:0/657680684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d50003a70 msgr2=0x7f9d6411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.881+0000 7f9d69a3f700 1 --2- 172.21.15.156:0/657680684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d50003a70 0x7f9d6411da40 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f9d640a0ad0 tx=0x7f9d5400b670 comp rx=0 tx=0).stop 2023-09-30T22:23:17.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.881+0000 7f9d69a3f700 1 -- 172.21.15.156:0/657680684 shutdown_connections 2023-09-30T22:23:17.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.881+0000 7f9d69a3f700 1 --2- 172.21.15.156:0/657680684 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d641300a0 0x7f9d6411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.881+0000 7f9d69a3f700 1 --2- 172.21.15.156:0/657680684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d50003a70 0x7f9d6411da40 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.881+0000 7f9d69a3f700 1 --2- 172.21.15.156:0/657680684 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d50004e60 0x7f9d6411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.881+0000 7f9d69a3f700 1 -- 172.21.15.156:0/657680684 >> 172.21.15.156:0/657680684 conn(0x7f9d64099c40 msgr2=0x7f9d64132010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:17.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.881+0000 7f9d69a3f700 1 -- 172.21.15.156:0/657680684 shutdown_connections 2023-09-30T22:23:17.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:17.881+0000 7f9d69a3f700 1 -- 172.21.15.156:0/657680684 wait complete. 2023-09-30T22:23:17.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:18.834 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:18.872 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:18.882 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:18.895 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:18.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.988+0000 7f0b540b4700 1 Processor -- start 2023-09-30T22:23:18.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.988+0000 7f0b540b4700 1 -- start start 2023-09-30T22:23:18.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.989+0000 7f0b540b4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b4c09f350 0x7f0b4c136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:18.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.989+0000 7f0b540b4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b4c1371c0 0x7f0b4c1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:18.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.989+0000 7f0b540b4700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b4c09c970 con 0x7f0b4c09e870 2023-09-30T22:23:18.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.989+0000 7f0b540b4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c0a0920 con 0x7f0b4c1371c0 2023-09-30T22:23:18.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.989+0000 7f0b540b4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c09f9c0 con 0x7f0b4c09f350 2023-09-30T22:23:18.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.989+0000 7f0b52651700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b4c1371c0 0x7f0b4c1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:18.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.989+0000 7f0b52651700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b4c1371c0 0x7f0b4c1395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:60030/0 (socket says 172.21.15.156:60030) 2023-09-30T22:23:18.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.989+0000 7f0b52651700 1 -- 172.21.15.156:0/1773831772 learned_addr learned my addr 172.21.15.156:0/1773831772 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:18.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.989+0000 7f0b5164f700 1 --2- 172.21.15.156:0/1773831772 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b4c09f350 0x7f0b4c136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:18.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.990+0000 7f0b52651700 1 -- 172.21.15.156:0/1773831772 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b4c09f350 msgr2=0x7f0b4c136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:18.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.990+0000 7f0b52651700 1 --2- 172.21.15.156:0/1773831772 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b4c09f350 0x7f0b4c136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.990+0000 7f0b52651700 1 -- 172.21.15.156:0/1773831772 >> v1:172.21.15.156:6789/0 conn(0x7f0b4c09e870 legacy=0x7f0b4c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:18.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.990+0000 7f0b52651700 1 -- 172.21.15.156:0/1773831772 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4c09bab0 con 0x7f0b4c1371c0 2023-09-30T22:23:18.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.990+0000 7f0b52651700 1 --2- 172.21.15.156:0/1773831772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b4c1371c0 0x7f0b4c1395a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0b44009e80 tx=0x7f0b4400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c44b3f5d3f3041b8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:18.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.990+0000 7f0b50e4e700 1 -- 172.21.15.156:0/1773831772 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4400e070 con 0x7f0b4c1371c0 2023-09-30T22:23:18.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.990+0000 7f0b50e4e700 1 -- 172.21.15.156:0/1773831772 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b44003a20 con 0x7f0b4c1371c0 2023-09-30T22:23:18.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.990+0000 7f0b50e4e700 1 -- 172.21.15.156:0/1773831772 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b44003dd0 con 0x7f0b4c1371c0 2023-09-30T22:23:18.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.991+0000 7f0b540b4700 1 -- 172.21.15.156:0/1773831772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b4c1371c0 msgr2=0x7f0b4c1395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:18.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.991+0000 7f0b540b4700 1 --2- 172.21.15.156:0/1773831772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b4c1371c0 0x7f0b4c1395a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0b44009e80 tx=0x7f0b4400b330 comp rx=0 tx=0).stop 2023-09-30T22:23:18.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.991+0000 7f0b540b4700 1 -- 172.21.15.156:0/1773831772 shutdown_connections 2023-09-30T22:23:18.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.991+0000 7f0b540b4700 1 --2- 172.21.15.156:0/1773831772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b4c1371c0 0x7f0b4c1395a0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.991+0000 7f0b540b4700 1 --2- 172.21.15.156:0/1773831772 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b4c09f350 0x7f0b4c136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.991+0000 7f0b540b4700 1 -- 172.21.15.156:0/1773831772 >> 172.21.15.156:0/1773831772 conn(0x7f0b4c0a4430 msgr2=0x7f0b4c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:18.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.991+0000 7f0b540b4700 1 -- 172.21.15.156:0/1773831772 shutdown_connections 2023-09-30T22:23:18.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.991+0000 7f0b540b4700 1 -- 172.21.15.156:0/1773831772 wait complete. 2023-09-30T22:23:18.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.992+0000 7f0b540b4700 1 Processor -- start 2023-09-30T22:23:18.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.992+0000 7f0b540b4700 1 -- start start 2023-09-30T22:23:18.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.992+0000 7f0b540b4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b4c09e870 0x7f0b4c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:18.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.992+0000 7f0b540b4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b4c09f350 0x7f0b4c121b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:18.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.992+0000 7f0b540b4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b4c1371c0 0x7f0b4c1220a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:18.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.992+0000 7f0b540b4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c120a70 con 0x7f0b4c09f350 2023-09-30T22:23:18.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.992+0000 7f0b540b4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c123680 con 0x7f0b4c09e870 2023-09-30T22:23:18.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.992+0000 7f0b540b4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c120f80 con 0x7f0b4c1371c0 2023-09-30T22:23:18.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.993+0000 7f0b52651700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b4c1371c0 0x7f0b4c1220a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:18.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.993+0000 7f0b52651700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b4c1371c0 0x7f0b4c1220a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56126/0 (socket says 172.21.15.156:56126) 2023-09-30T22:23:18.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.993+0000 7f0b52651700 1 -- 172.21.15.156:0/2770658023 learned_addr learned my addr 172.21.15.156:0/2770658023 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:18.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.993+0000 7f0b51e50700 1 --2- 172.21.15.156:0/2770658023 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b4c09e870 0x7f0b4c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:18.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.993+0000 7f0b52651700 1 -- 172.21.15.156:0/2770658023 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b4c09e870 msgr2=0x7f0b4c06d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:18.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.993+0000 7f0b52651700 1 --2- 172.21.15.156:0/2770658023 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b4c09e870 0x7f0b4c06d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.993+0000 7f0b52651700 1 -- 172.21.15.156:0/2770658023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b4c09f350 msgr2=0x7f0b4c121b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:18.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.993+0000 7f0b52651700 1 --2- 172.21.15.156:0/2770658023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b4c09f350 0x7f0b4c121b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.993+0000 7f0b52651700 1 -- 172.21.15.156:0/2770658023 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b44009b30 con 0x7f0b4c1371c0 2023-09-30T22:23:18.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.993+0000 7f0b51e50700 1 --2- 172.21.15.156:0/2770658023 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b4c09e870 0x7f0b4c06d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:18.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.993+0000 7f0b52651700 1 --2- 172.21.15.156:0/2770658023 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b4c1371c0 0x7f0b4c1220a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f0b44015040 tx=0x7f0b44004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:18.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.993+0000 7f0b427fc700 1 -- 172.21.15.156:0/2770658023 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b44004440 con 0x7f0b4c1371c0 2023-09-30T22:23:18.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.993+0000 7f0b427fc700 1 -- 172.21.15.156:0/2770658023 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b440045a0 con 0x7f0b4c1371c0 2023-09-30T22:23:18.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.993+0000 7f0b540b4700 1 -- 172.21.15.156:0/2770658023 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b4c0723f0 con 0x7f0b4c1371c0 2023-09-30T22:23:18.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.993+0000 7f0b427fc700 1 -- 172.21.15.156:0/2770658023 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b44004950 con 0x7f0b4c1371c0 2023-09-30T22:23:18.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.993+0000 7f0b540b4700 1 -- 172.21.15.156:0/2770658023 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b4c121710 con 0x7f0b4c1371c0 2023-09-30T22:23:19.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.994+0000 7f0b427fc700 1 -- 172.21.15.156:0/2770658023 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b44019070 con 0x7f0b4c1371c0 2023-09-30T22:23:19.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.994+0000 7f0b427fc700 1 -- 172.21.15.156:0/2770658023 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0b44040780 con 0x7f0b4c1371c0 2023-09-30T22:23:19.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.995+0000 7f0b540b4700 1 -- 172.21.15.156:0/2770658023 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b4c04f2a0 con 0x7f0b4c1371c0 2023-09-30T22:23:19.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:18.999+0000 7f0b427fc700 1 -- 172.21.15.156:0/2770658023 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b44017080 con 0x7f0b4c1371c0 2023-09-30T22:23:19.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.026+0000 7f96ad2cd700 1 Processor -- start 2023-09-30T22:23:19.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.026+0000 7f96ad2cd700 1 -- start start 2023-09-30T22:23:19.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.026+0000 7f96ad2cd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96a809d860 0x7f96a809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:19.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.026+0000 7f96ad2cd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96a8130eb0 0x7f96a8138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:19.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.026+0000 7f96ad2cd700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a809aaa0 con 0x7f96a809e170 2023-09-30T22:23:19.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.026+0000 7f96ad2cd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a809f870 con 0x7f96a809d860 2023-09-30T22:23:19.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.026+0000 7f96ad2cd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96a809b360 con 0x7f96a8130eb0 2023-09-30T22:23:19.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.026+0000 7f96a77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96a8130eb0 0x7f96a8138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:19.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.026+0000 7f96a77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96a8130eb0 0x7f96a8138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56142/0 (socket says 172.21.15.156:56142) 2023-09-30T22:23:19.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.026+0000 7f96a77fe700 1 -- 172.21.15.156:0/4209478196 learned_addr learned my addr 172.21.15.156:0/4209478196 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:19.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.026+0000 7f96a6ffd700 1 --2- 172.21.15.156:0/4209478196 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96a809d860 0x7f96a809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:19.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.027+0000 7f96a77fe700 1 -- 172.21.15.156:0/4209478196 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96a809d860 msgr2=0x7f96a809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:19.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.027+0000 7f96a77fe700 1 --2- 172.21.15.156:0/4209478196 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96a809d860 0x7f96a809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.027+0000 7f96a77fe700 1 -- 172.21.15.156:0/4209478196 >> v1:172.21.15.156:6789/0 conn(0x7f96a809e170 legacy=0x7f96a81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:19.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.027+0000 7f96a77fe700 1 -- 172.21.15.156:0/4209478196 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a809b620 con 0x7f96a8130eb0 2023-09-30T22:23:19.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.027+0000 7f96a77fe700 1 --2- 172.21.15.156:0/4209478196 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96a8130eb0 0x7f96a8138a00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f96a0009e80 tx=0x7f96a000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8129116ed9cce578 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:19.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.027+0000 7f96a5ffb700 1 -- 172.21.15.156:0/4209478196 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a000bb10 con 0x7f96a8130eb0 2023-09-30T22:23:19.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.027+0000 7f96a5ffb700 1 -- 172.21.15.156:0/4209478196 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a000bc70 con 0x7f96a8130eb0 2023-09-30T22:23:19.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.027+0000 7f96a5ffb700 1 -- 172.21.15.156:0/4209478196 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a00148d0 con 0x7f96a8130eb0 2023-09-30T22:23:19.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.028+0000 7f96ad2cd700 1 -- 172.21.15.156:0/4209478196 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96a8130eb0 msgr2=0x7f96a8138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:19.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.028+0000 7f96ad2cd700 1 --2- 172.21.15.156:0/4209478196 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96a8130eb0 0x7f96a8138a00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f96a0009e80 tx=0x7f96a000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:19.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.028+0000 7f96ad2cd700 1 -- 172.21.15.156:0/4209478196 shutdown_connections 2023-09-30T22:23:19.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.028+0000 7f96ad2cd700 1 --2- 172.21.15.156:0/4209478196 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96a809d860 0x7f96a809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.028+0000 7f96ad2cd700 1 --2- 172.21.15.156:0/4209478196 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96a8130eb0 0x7f96a8138a00 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.028+0000 7f96ad2cd700 1 -- 172.21.15.156:0/4209478196 >> 172.21.15.156:0/4209478196 conn(0x7f96a8099c40 msgr2=0x7f96a80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:19.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.028+0000 7f96ad2cd700 1 -- 172.21.15.156:0/4209478196 shutdown_connections 2023-09-30T22:23:19.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.028+0000 7f96ad2cd700 1 -- 172.21.15.156:0/4209478196 wait complete. 2023-09-30T22:23:19.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.029+0000 7f96ad2cd700 1 Processor -- start 2023-09-30T22:23:19.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.029+0000 7f96ad2cd700 1 -- start start 2023-09-30T22:23:19.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.029+0000 7f96ad2cd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96a809d860 0x7f96a811e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:19.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.029+0000 7f96ad2cd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96a809e170 0x7f96a811e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:19.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.029+0000 7f96ad2cd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96a8130eb0 0x7f96a811ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:19.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.029+0000 7f96ad2cd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a81216a0 con 0x7f96a809e170 2023-09-30T22:23:19.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.029+0000 7f96ad2cd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a81200b0 con 0x7f96a8130eb0 2023-09-30T22:23:19.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.029+0000 7f96ad2cd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96a811f900 con 0x7f96a809d860 2023-09-30T22:23:19.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.030+0000 7f96a6ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96a809d860 0x7f96a811e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:19.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.030+0000 7f96a6ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96a809d860 0x7f96a811e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56156/0 (socket says 172.21.15.156:56156) 2023-09-30T22:23:19.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.030+0000 7f96a6ffd700 1 -- 172.21.15.156:0/488482516 learned_addr learned my addr 172.21.15.156:0/488482516 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:19.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.030+0000 7f96a67fc700 1 --2- 172.21.15.156:0/488482516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96a809e170 0x7f96a811e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:19.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.030+0000 7f96a77fe700 1 --2- 172.21.15.156:0/488482516 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96a8130eb0 0x7f96a811ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:19.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.030+0000 7f96a6ffd700 1 -- 172.21.15.156:0/488482516 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96a8130eb0 msgr2=0x7f96a811ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:19.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.030+0000 7f96a6ffd700 1 --2- 172.21.15.156:0/488482516 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96a8130eb0 0x7f96a811ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.030+0000 7f96a6ffd700 1 -- 172.21.15.156:0/488482516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96a809e170 msgr2=0x7f96a811e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:19.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.030+0000 7f96a6ffd700 1 --2- 172.21.15.156:0/488482516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96a809e170 0x7f96a811e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.030+0000 7f96a6ffd700 1 -- 172.21.15.156:0/488482516 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a0009b30 con 0x7f96a809d860 2023-09-30T22:23:19.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.030+0000 7f96a6ffd700 1 --2- 172.21.15.156:0/488482516 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96a809d860 0x7f96a811e4a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f969800bf10 tx=0x7f969800e640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:19.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.030+0000 7f968f7fe700 1 -- 172.21.15.156:0/488482516 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9698010a80 con 0x7f96a809d860 2023-09-30T22:23:19.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.030+0000 7f968f7fe700 1 -- 172.21.15.156:0/488482516 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9698018640 con 0x7f96a809d860 2023-09-30T22:23:19.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.030+0000 7f968f7fe700 1 -- 172.21.15.156:0/488482516 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96980189b0 con 0x7f96a809d860 2023-09-30T22:23:19.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.030+0000 7f96ad2cd700 1 -- 172.21.15.156:0/488482516 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a8121fc0 con 0x7f96a809d860 2023-09-30T22:23:19.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.030+0000 7f96ad2cd700 1 -- 172.21.15.156:0/488482516 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a8130460 con 0x7f96a809d860 2023-09-30T22:23:19.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.031+0000 7f96ad2cd700 1 -- 172.21.15.156:0/488482516 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a8121df0 con 0x7f96a809d860 2023-09-30T22:23:19.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.032+0000 7f968f7fe700 1 -- 172.21.15.156:0/488482516 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9698018b10 con 0x7f96a809d860 2023-09-30T22:23:19.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.032+0000 7f968f7fe700 1 -- 172.21.15.156:0/488482516 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9698040100 con 0x7f96a809d860 2023-09-30T22:23:19.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.036+0000 7f968f7fe700 1 -- 172.21.15.156:0/488482516 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9698018dc0 con 0x7f96a809d860 2023-09-30T22:23:19.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.056+0000 7fd20c2d9700 1 Processor -- start 2023-09-30T22:23:19.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.057+0000 7fd20c2d9700 1 -- start start 2023-09-30T22:23:19.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.057+0000 7fd20c2d9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd204131980 0x7fd204131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:19.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.057+0000 7fd20c2d9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd20409bc70 0x7fd20409c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:19.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.057+0000 7fd20c2d9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2040a1640 con 0x7fd20409c5c0 2023-09-30T22:23:19.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.057+0000 7fd20c2d9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20406eb30 con 0x7fd20409bc70 2023-09-30T22:23:19.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.057+0000 7fd20c2d9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2040a22d0 con 0x7fd204131980 2023-09-30T22:23:19.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.057+0000 7fd209874700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd20409bc70 0x7fd20409c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:19.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.057+0000 7fd20a075700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd204131980 0x7fd204131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:19.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.057+0000 7fd209874700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd20409bc70 0x7fd20409c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:60070/0 (socket says 172.21.15.156:60070) 2023-09-30T22:23:19.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.057+0000 7fd20a075700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd204131980 0x7fd204131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56172/0 (socket says 172.21.15.156:56172) 2023-09-30T22:23:19.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.057+0000 7fd209874700 1 -- 172.21.15.156:0/2707203780 learned_addr learned my addr 172.21.15.156:0/2707203780 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:19.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.058+0000 7fd209874700 1 -- 172.21.15.156:0/2707203780 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd204131980 msgr2=0x7fd204131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:19.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.058+0000 7fd209874700 1 --2- 172.21.15.156:0/2707203780 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd204131980 0x7fd204131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.058+0000 7fd209874700 1 -- 172.21.15.156:0/2707203780 >> v1:172.21.15.156:6789/0 conn(0x7fd20409c5c0 legacy=0x7fd204138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:19.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.058+0000 7fd209874700 1 -- 172.21.15.156:0/2707203780 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd204131550 con 0x7fd20409bc70 2023-09-30T22:23:19.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.058+0000 7fd20a075700 1 --2- 172.21.15.156:0/2707203780 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd204131980 0x7fd204131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:19.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.058+0000 7fd209874700 1 --2- 172.21.15.156:0/2707203780 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd20409bc70 0x7fd20409c080 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4009920 tx=0x7fd1f4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dd1a968a84d7ca8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:19.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.058+0000 7fd209073700 1 -- 172.21.15.156:0/2707203780 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4011830 con 0x7fd20409bc70 2023-09-30T22:23:19.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.058+0000 7fd209073700 1 -- 172.21.15.156:0/2707203780 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f4011990 con 0x7fd20409bc70 2023-09-30T22:23:19.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.058+0000 7fd209073700 1 -- 172.21.15.156:0/2707203780 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4011d20 con 0x7fd20409bc70 2023-09-30T22:23:19.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.059+0000 7fd20c2d9700 1 -- 172.21.15.156:0/2707203780 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd20409bc70 msgr2=0x7fd20409c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:19.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.059+0000 7fd20c2d9700 1 --2- 172.21.15.156:0/2707203780 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd20409bc70 0x7fd20409c080 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4009920 tx=0x7fd1f4009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:19.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.059+0000 7fd20c2d9700 1 -- 172.21.15.156:0/2707203780 shutdown_connections 2023-09-30T22:23:19.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.059+0000 7fd20c2d9700 1 --2- 172.21.15.156:0/2707203780 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd204131980 0x7fd204131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.059+0000 7fd20c2d9700 1 --2- 172.21.15.156:0/2707203780 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd20409bc70 0x7fd20409c080 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.059+0000 7fd20c2d9700 1 -- 172.21.15.156:0/2707203780 >> 172.21.15.156:0/2707203780 conn(0x7fd2040a2980 msgr2=0x7fd2040a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:19.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.059+0000 7fd20c2d9700 1 -- 172.21.15.156:0/2707203780 shutdown_connections 2023-09-30T22:23:19.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.059+0000 7fd20c2d9700 1 -- 172.21.15.156:0/2707203780 wait complete. 2023-09-30T22:23:19.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.060+0000 7fd20c2d9700 1 Processor -- start 2023-09-30T22:23:19.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.060+0000 7fd20c2d9700 1 -- start start 2023-09-30T22:23:19.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.061+0000 7fd20c2d9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd20409bc70 0x7fd204099a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:19.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.061+0000 7fd20c2d9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd20409c5c0 0x7fd204099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:19.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.061+0000 7fd20c2d9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd204131980 0x7fd20409a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:19.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.061+0000 7fd20c2d9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20412ed10 con 0x7fd20409c5c0 2023-09-30T22:23:19.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.061+0000 7fd20c2d9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20409b5c0 con 0x7fd20409bc70 2023-09-30T22:23:19.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.061+0000 7fd20c2d9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2041235b0 con 0x7fd204131980 2023-09-30T22:23:19.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.061+0000 7fd20a075700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd20409bc70 0x7fd204099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:19.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.061+0000 7fd20a075700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd20409bc70 0x7fd204099a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:60086/0 (socket says 172.21.15.156:60086) 2023-09-30T22:23:19.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.061+0000 7fd20a075700 1 -- 172.21.15.156:0/215676123 learned_addr learned my addr 172.21.15.156:0/215676123 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:19.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.061+0000 7fd209874700 1 --2- 172.21.15.156:0/215676123 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd20409c5c0 0x7fd204099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:19.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.061+0000 7fd20a876700 1 --2- 172.21.15.156:0/215676123 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd204131980 0x7fd20409a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:19.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.061+0000 7fd20a075700 1 -- 172.21.15.156:0/215676123 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd204131980 msgr2=0x7fd20409a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:19.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.061+0000 7fd20a075700 1 --2- 172.21.15.156:0/215676123 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd204131980 0x7fd20409a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.061+0000 7fd20a075700 1 -- 172.21.15.156:0/215676123 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd20409c5c0 msgr2=0x7fd204099fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:19.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.061+0000 7fd20a075700 1 --2- 172.21.15.156:0/215676123 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd20409c5c0 0x7fd204099fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.061+0000 7fd20a075700 1 -- 172.21.15.156:0/215676123 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd200009430 con 0x7fd20409bc70 2023-09-30T22:23:19.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.061+0000 7fd209874700 1 --2- 172.21.15.156:0/215676123 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd20409c5c0 0x7fd204099fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:19.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.061+0000 7fd20a075700 1 --2- 172.21.15.156:0/215676123 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd20409bc70 0x7fd204099a60 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd20000ebe0 tx=0x7fd200009ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:19.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.061+0000 7fd1faffd700 1 -- 172.21.15.156:0/215676123 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd200005a20 con 0x7fd20409bc70 2023-09-30T22:23:19.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.062+0000 7fd1faffd700 1 -- 172.21.15.156:0/215676123 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd200005b80 con 0x7fd20409bc70 2023-09-30T22:23:19.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.062+0000 7fd20c2d9700 1 -- 172.21.15.156:0/215676123 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f4009550 con 0x7fd20409bc70 2023-09-30T22:23:19.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.062+0000 7fd1faffd700 1 -- 172.21.15.156:0/215676123 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20000c910 con 0x7fd20409bc70 2023-09-30T22:23:19.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.062+0000 7fd20c2d9700 1 -- 172.21.15.156:0/215676123 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2041222e0 con 0x7fd20409bc70 2023-09-30T22:23:19.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.062+0000 7fd20c2d9700 1 -- 172.21.15.156:0/215676123 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd20404f2a0 con 0x7fd20409bc70 2023-09-30T22:23:19.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.063+0000 7fd1faffd700 1 -- 172.21.15.156:0/215676123 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd20000ca70 con 0x7fd20409bc70 2023-09-30T22:23:19.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.063+0000 7fd1faffd700 1 -- 172.21.15.156:0/215676123 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd20003fad0 con 0x7fd20409bc70 2023-09-30T22:23:19.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.067+0000 7fd1faffd700 1 -- 172.21.15.156:0/215676123 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd200022300 con 0x7fd20409bc70 2023-09-30T22:23:19.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.074+0000 7f54ba32a700 1 Processor -- start 2023-09-30T22:23:19.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.074+0000 7f54ba32a700 1 -- start start 2023-09-30T22:23:19.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.075+0000 7f54ba32a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f54b40a0a70 0x7f54b40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:19.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.075+0000 7f54ba32a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54b40a1380 0x7f54b4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:19.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.075+0000 7f54ba32a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54b4133f50 0x7f54b41343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:19.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.075+0000 7f54ba32a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b409e9d0 con 0x7f54b40a0a70 2023-09-30T22:23:19.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.075+0000 7f54ba32a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b409dc00 con 0x7f54b40a1380 2023-09-30T22:23:19.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.075+0000 7f54ba32a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54b409dec0 con 0x7f54b4133f50 2023-09-30T22:23:19.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.075+0000 7f54b3fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f54b40a0a70 0x7f54b40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:19.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.075+0000 7f54b3fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f54b40a0a70 0x7f54b40a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44720/0 (socket says 172.21.15.156:44720) 2023-09-30T22:23:19.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.075+0000 7f54b3fff700 1 -- 172.21.15.156:0/2242249925 learned_addr learned my addr 172.21.15.156:0/2242249925 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:19.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.075+0000 7f54b88c7700 1 --2- 172.21.15.156:0/2242249925 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54b4133f50 0x7f54b41343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:19.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.075+0000 7f54b88c7700 1 -- 172.21.15.156:0/2242249925 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54b40a1380 msgr2=0x7f54b4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:19.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.075+0000 7f54b88c7700 1 --2- 172.21.15.156:0/2242249925 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54b40a1380 0x7f54b4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.075+0000 7f54b88c7700 1 -- 172.21.15.156:0/2242249925 >> v2:172.21.15.156:3300/0 conn(0x7f54b40a0a70 msgr2=0x7f54b40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:19.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.075+0000 7f54b88c7700 1 --2- 172.21.15.156:0/2242249925 >> v2:172.21.15.156:3300/0 conn(0x7f54b40a0a70 0x7f54b40a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.075+0000 7f54b88c7700 1 -- 172.21.15.156:0/2242249925 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b409e6a0 con 0x7f54b4133f50 2023-09-30T22:23:19.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.075+0000 7f54b3fff700 1 --2- 172.21.15.156:0/2242249925 >> v2:172.21.15.156:3300/0 conn(0x7f54b40a0a70 0x7f54b40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:19.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.076+0000 7f54b88c7700 1 --2- 172.21.15.156:0/2242249925 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54b4133f50 0x7f54b41343b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f54ac009d90 tx=0x7f54ac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a21641aa3e11d43 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:19.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.076+0000 7f54b2ffd700 1 -- 172.21.15.156:0/2242249925 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac00e070 con 0x7f54b4133f50 2023-09-30T22:23:19.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.076+0000 7f54b2ffd700 1 -- 172.21.15.156:0/2242249925 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ac00bb20 con 0x7f54b4133f50 2023-09-30T22:23:19.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.076+0000 7f54b2ffd700 1 -- 172.21.15.156:0/2242249925 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac012430 con 0x7f54b4133f50 2023-09-30T22:23:19.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.077+0000 7f54ba32a700 1 -- 172.21.15.156:0/2242249925 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54b4133f50 msgr2=0x7f54b41343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:19.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.077+0000 7f54ba32a700 1 --2- 172.21.15.156:0/2242249925 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54b4133f50 0x7f54b41343b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f54ac009d90 tx=0x7f54ac00b330 comp rx=0 tx=0).stop 2023-09-30T22:23:19.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.077+0000 7f54ba32a700 1 -- 172.21.15.156:0/2242249925 shutdown_connections 2023-09-30T22:23:19.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.077+0000 7f54ba32a700 1 --2- 172.21.15.156:0/2242249925 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54b4133f50 0x7f54b41343b0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.077+0000 7f54ba32a700 1 --2- 172.21.15.156:0/2242249925 >> v2:172.21.15.156:3300/0 conn(0x7f54b40a0a70 0x7f54b40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.077+0000 7f54ba32a700 1 --2- 172.21.15.156:0/2242249925 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54b40a1380 0x7f54b4133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.077+0000 7f54ba32a700 1 -- 172.21.15.156:0/2242249925 >> 172.21.15.156:0/2242249925 conn(0x7f54b40a6610 msgr2=0x7f54b40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:19.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.077+0000 7f54ba32a700 1 -- 172.21.15.156:0/2242249925 shutdown_connections 2023-09-30T22:23:19.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.077+0000 7f54ba32a700 1 -- 172.21.15.156:0/2242249925 wait complete. 2023-09-30T22:23:19.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.078+0000 7f54ba32a700 1 Processor -- start 2023-09-30T22:23:19.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.078+0000 7f54ba32a700 1 -- start start 2023-09-30T22:23:19.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.079+0000 7f54ba32a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54b40a0a70 0x7f54b411f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:19.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.079+0000 7f54ba32a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54b40a1380 0x7f54b411fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:19.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.079+0000 7f54ba32a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54b4133f50 0x7f54b4120210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:19.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.079+0000 7f54ba32a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b4123100 con 0x7f54b40a1380 2023-09-30T22:23:19.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.079+0000 7f54ba32a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b4121a80 con 0x7f54b4133f50 2023-09-30T22:23:19.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.079+0000 7f54ba32a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54b4121210 con 0x7f54b40a0a70 2023-09-30T22:23:19.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.079+0000 7f54b3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54b40a0a70 0x7f54b411f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:19.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.079+0000 7f54b88c7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54b4133f50 0x7f54b4120210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:19.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.079+0000 7f54b37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54b40a1380 0x7f54b411fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:19.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.079+0000 7f54b3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54b40a0a70 0x7f54b411f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56200/0 (socket says 172.21.15.156:56200) 2023-09-30T22:23:19.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.079+0000 7f54b3fff700 1 -- 172.21.15.156:0/3098689155 learned_addr learned my addr 172.21.15.156:0/3098689155 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:19.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.080+0000 7f54b3fff700 1 -- 172.21.15.156:0/3098689155 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54b4133f50 msgr2=0x7f54b4120210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:19.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.080+0000 7f54b3fff700 1 --2- 172.21.15.156:0/3098689155 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54b4133f50 0x7f54b4120210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.080+0000 7f54b3fff700 1 -- 172.21.15.156:0/3098689155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54b40a1380 msgr2=0x7f54b411fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:19.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.080+0000 7f54b3fff700 1 --2- 172.21.15.156:0/3098689155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54b40a1380 0x7f54b411fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.080+0000 7f54b3fff700 1 -- 172.21.15.156:0/3098689155 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a4009550 con 0x7f54b40a0a70 2023-09-30T22:23:19.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.080+0000 7f54b88c7700 1 --2- 172.21.15.156:0/3098689155 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54b4133f50 0x7f54b4120210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:19.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.080+0000 7f54b3fff700 1 --2- 172.21.15.156:0/3098689155 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54b40a0a70 0x7f54b411f790 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f54a400b3f0 tx=0x7f54a400b700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:19.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.080+0000 7f54b0ff9700 1 -- 172.21.15.156:0/3098689155 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a4019070 con 0x7f54b40a0a70 2023-09-30T22:23:19.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.080+0000 7f54b0ff9700 1 -- 172.21.15.156:0/3098689155 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a400be10 con 0x7f54b40a0a70 2023-09-30T22:23:19.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.080+0000 7f54b0ff9700 1 -- 172.21.15.156:0/3098689155 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a401d610 con 0x7f54b40a0a70 2023-09-30T22:23:19.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.080+0000 7f54ba32a700 1 -- 172.21.15.156:0/3098689155 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54ac009a70 con 0x7f54b40a0a70 2023-09-30T22:23:19.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.080+0000 7f54ba32a700 1 -- 172.21.15.156:0/3098689155 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b4130530 con 0x7f54b40a0a70 2023-09-30T22:23:19.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.081+0000 7f54b0ff9700 1 -- 172.21.15.156:0/3098689155 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f54a401d770 con 0x7f54b40a0a70 2023-09-30T22:23:19.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.081+0000 7f54b0ff9700 1 -- 172.21.15.156:0/3098689155 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f54a401dd00 con 0x7f54b40a0a70 2023-09-30T22:23:19.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.082+0000 7f54ba32a700 1 -- 172.21.15.156:0/3098689155 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b40a43a0 con 0x7f54b40a0a70 2023-09-30T22:23:19.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.091+0000 7f54b0ff9700 1 -- 172.21.15.156:0/3098689155 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f54a4022020 con 0x7f54b40a0a70 2023-09-30T22:23:19.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.226+0000 7f0b540b4700 1 -- 172.21.15.156:0/2770658023 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0b4c06b2a0 con 0x7f0b4c1371c0 2023-09-30T22:23:19.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.226+0000 7f0b427fc700 1 -- 172.21.15.156:0/2770658023 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0b44024e10 con 0x7f0b4c1371c0 2023-09-30T22:23:19.227 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:19.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.228+0000 7f0b540b4700 1 -- 172.21.15.156:0/2770658023 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b4c1371c0 msgr2=0x7f0b4c1220a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:19.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.228+0000 7f0b540b4700 1 --2- 172.21.15.156:0/2770658023 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b4c1371c0 0x7f0b4c1220a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f0b44015040 tx=0x7f0b44004ad0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.228+0000 7f0b540b4700 1 -- 172.21.15.156:0/2770658023 shutdown_connections 2023-09-30T22:23:19.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.228+0000 7f0b540b4700 1 --2- 172.21.15.156:0/2770658023 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b4c1371c0 0x7f0b4c1220a0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.228+0000 7f0b540b4700 1 --2- 172.21.15.156:0/2770658023 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b4c09e870 0x7f0b4c06d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.228+0000 7f0b540b4700 1 --2- 172.21.15.156:0/2770658023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b4c09f350 0x7f0b4c121b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.228+0000 7f0b540b4700 1 -- 172.21.15.156:0/2770658023 >> 172.21.15.156:0/2770658023 conn(0x7f0b4c0a4430 msgr2=0x7f0b4c0a2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:19.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.228+0000 7f0b540b4700 1 -- 172.21.15.156:0/2770658023 shutdown_connections 2023-09-30T22:23:19.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.228+0000 7f0b540b4700 1 -- 172.21.15.156:0/2770658023 wait complete. 2023-09-30T22:23:19.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.233+0000 7f96ad2cd700 1 -- 172.21.15.156:0/488482516 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f96a8130460 con 0x7f96a809d860 2023-09-30T22:23:19.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.233+0000 7f968f7fe700 1 -- 172.21.15.156:0/488482516 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f96a8130460 con 0x7f96a809d860 2023-09-30T22:23:19.234 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:19.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.236+0000 7f96ad2cd700 1 -- 172.21.15.156:0/488482516 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96a809d860 msgr2=0x7f96a811e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:19.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.236+0000 7f96ad2cd700 1 --2- 172.21.15.156:0/488482516 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96a809d860 0x7f96a811e4a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f969800bf10 tx=0x7f969800e640 comp rx=0 tx=0).stop 2023-09-30T22:23:19.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.237+0000 7f96ad2cd700 1 -- 172.21.15.156:0/488482516 shutdown_connections 2023-09-30T22:23:19.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.237+0000 7f96ad2cd700 1 --2- 172.21.15.156:0/488482516 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f96a8130eb0 0x7f96a811ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.237+0000 7f96ad2cd700 1 --2- 172.21.15.156:0/488482516 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f96a809d860 0x7f96a811e4a0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.237+0000 7f96ad2cd700 1 --2- 172.21.15.156:0/488482516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96a809e170 0x7f96a811e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.237+0000 7f96ad2cd700 1 -- 172.21.15.156:0/488482516 >> 172.21.15.156:0/488482516 conn(0x7f96a8099c40 msgr2=0x7f96a8070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:19.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.237+0000 7f96ad2cd700 1 -- 172.21.15.156:0/488482516 shutdown_connections 2023-09-30T22:23:19.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.237+0000 7f96ad2cd700 1 -- 172.21.15.156:0/488482516 wait complete. 2023-09-30T22:23:19.243 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:19.255 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:19.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.266+0000 7fd20c2d9700 1 -- 172.21.15.156:0/215676123 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd204123230 con 0x7fd20409bc70 2023-09-30T22:23:19.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.267+0000 7fd1faffd700 1 -- 172.21.15.156:0/215676123 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd200020030 con 0x7fd20409bc70 2023-09-30T22:23:19.268 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:19.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.269+0000 7fd20c2d9700 1 -- 172.21.15.156:0/215676123 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd20409bc70 msgr2=0x7fd204099a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:19.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.269+0000 7fd20c2d9700 1 --2- 172.21.15.156:0/215676123 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd20409bc70 0x7fd204099a60 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd20000ebe0 tx=0x7fd200009ea0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.269+0000 7fd20c2d9700 1 -- 172.21.15.156:0/215676123 shutdown_connections 2023-09-30T22:23:19.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.269+0000 7fd20c2d9700 1 --2- 172.21.15.156:0/215676123 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd204131980 0x7fd20409a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.269+0000 7fd20c2d9700 1 --2- 172.21.15.156:0/215676123 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd20409bc70 0x7fd204099a60 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.269+0000 7fd20c2d9700 1 --2- 172.21.15.156:0/215676123 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd20409c5c0 0x7fd204099fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.269+0000 7fd20c2d9700 1 -- 172.21.15.156:0/215676123 >> 172.21.15.156:0/215676123 conn(0x7fd2040a2980 msgr2=0x7fd20406ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:19.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.269+0000 7fd20c2d9700 1 -- 172.21.15.156:0/215676123 shutdown_connections 2023-09-30T22:23:19.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.269+0000 7fd20c2d9700 1 -- 172.21.15.156:0/215676123 wait complete. 2023-09-30T22:23:19.282 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:19.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.294+0000 7f54ba32a700 1 -- 172.21.15.156:0/3098689155 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f54b404f2a0 con 0x7f54b40a0a70 2023-09-30T22:23:19.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.294+0000 7f54b0ff9700 1 -- 172.21.15.156:0/3098689155 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f54a40263b0 con 0x7f54b40a0a70 2023-09-30T22:23:19.295 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:19.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.297+0000 7f54ba32a700 1 -- 172.21.15.156:0/3098689155 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54b40a0a70 msgr2=0x7f54b411f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:19.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.297+0000 7f54ba32a700 1 --2- 172.21.15.156:0/3098689155 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54b40a0a70 0x7f54b411f790 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f54a400b3f0 tx=0x7f54a400b700 comp rx=0 tx=0).stop 2023-09-30T22:23:19.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.297+0000 7f54ba32a700 1 -- 172.21.15.156:0/3098689155 shutdown_connections 2023-09-30T22:23:19.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.297+0000 7f54ba32a700 1 --2- 172.21.15.156:0/3098689155 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f54b4133f50 0x7f54b4120210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.297+0000 7f54ba32a700 1 --2- 172.21.15.156:0/3098689155 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f54b40a0a70 0x7f54b411f790 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.297+0000 7f54ba32a700 1 --2- 172.21.15.156:0/3098689155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54b40a1380 0x7f54b411fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.297+0000 7f54ba32a700 1 -- 172.21.15.156:0/3098689155 >> 172.21.15.156:0/3098689155 conn(0x7f54b40a6610 msgr2=0x7f54b409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:19.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.297+0000 7f54ba32a700 1 -- 172.21.15.156:0/3098689155 shutdown_connections 2023-09-30T22:23:19.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:19.297+0000 7f54ba32a700 1 -- 172.21.15.156:0/3098689155 wait complete. 2023-09-30T22:23:19.309 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:20.244 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:20.255 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:20.283 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:20.310 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:20.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.399+0000 7f7311b1a700 1 Processor -- start 2023-09-30T22:23:20.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.399+0000 7f7311b1a700 1 -- start start 2023-09-30T22:23:20.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.400+0000 7f7311b1a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f730c0a1550 0x7f730c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.400+0000 7f7311b1a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f730c139200 0x7f730c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.400+0000 7f7311b1a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f730c09e9d0 con 0x7f730c0a0a70 2023-09-30T22:23:20.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.400+0000 7f7311b1a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730c09dc00 con 0x7f730c0a1550 2023-09-30T22:23:20.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.400+0000 7f7311b1a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f730c09dec0 con 0x7f730c139200 2023-09-30T22:23:20.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.400+0000 7f730b7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f730c0a0a70 0x7f730c0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:42716/0 (socket says 172.21.15.156:42716) 2023-09-30T22:23:20.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.400+0000 7f730b7fe700 1 -- 172.21.15.156:0/2304748055 learned_addr learned my addr 172.21.15.156:0/2304748055 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:20.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.400+0000 7f730bfff700 1 --2- 172.21.15.156:0/2304748055 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f730c139200 0x7f730c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.400+0000 7f730affd700 1 --2- 172.21.15.156:0/2304748055 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f730c0a1550 0x7f730c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.401+0000 7f730affd700 1 -- 172.21.15.156:0/2304748055 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f730c139200 msgr2=0x7f730c13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:20.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.401+0000 7f730affd700 1 --2- 172.21.15.156:0/2304748055 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f730c139200 0x7f730c13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.401+0000 7f730affd700 1 -- 172.21.15.156:0/2304748055 >> v1:172.21.15.156:6789/0 conn(0x7f730c0a0a70 legacy=0x7f730c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.401+0000 7f730affd700 1 -- 172.21.15.156:0/2304748055 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730c09e6a0 con 0x7f730c0a1550 2023-09-30T22:23:20.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.401+0000 7f730affd700 1 --2- 172.21.15.156:0/2304748055 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f730c0a1550 0x7f730c138cc0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7300009870 tx=0x7f7300009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ea8e7deab7b3919 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:20.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.401+0000 7f730a7fc700 1 -- 172.21.15.156:0/2304748055 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7300004230 con 0x7f730c0a1550 2023-09-30T22:23:20.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.401+0000 7f730a7fc700 1 -- 172.21.15.156:0/2304748055 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7300004390 con 0x7f730c0a1550 2023-09-30T22:23:20.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.401+0000 7f730a7fc700 1 -- 172.21.15.156:0/2304748055 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73000036a0 con 0x7f730c0a1550 2023-09-30T22:23:20.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.402+0000 7f7311b1a700 1 -- 172.21.15.156:0/2304748055 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f730c0a1550 msgr2=0x7f730c138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.402+0000 7f7311b1a700 1 --2- 172.21.15.156:0/2304748055 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f730c0a1550 0x7f730c138cc0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7300009870 tx=0x7f7300009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:20.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.402+0000 7f7311b1a700 1 -- 172.21.15.156:0/2304748055 shutdown_connections 2023-09-30T22:23:20.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.402+0000 7f7311b1a700 1 --2- 172.21.15.156:0/2304748055 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f730c139200 0x7f730c13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.402+0000 7f7311b1a700 1 --2- 172.21.15.156:0/2304748055 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f730c0a1550 0x7f730c138cc0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.402+0000 7f7311b1a700 1 -- 172.21.15.156:0/2304748055 >> 172.21.15.156:0/2304748055 conn(0x7f730c0a6610 msgr2=0x7f730c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:20.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.402+0000 7f7311b1a700 1 -- 172.21.15.156:0/2304748055 shutdown_connections 2023-09-30T22:23:20.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.402+0000 7f7311b1a700 1 -- 172.21.15.156:0/2304748055 wait complete. 2023-09-30T22:23:20.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.403+0000 7f7311b1a700 1 Processor -- start 2023-09-30T22:23:20.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.404+0000 7f7311b1a700 1 -- start start 2023-09-30T22:23:20.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.404+0000 7f7311b1a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f730c0a0a70 0x7f730c06dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.404+0000 7f7311b1a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f730c0a1550 0x7f730c06e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.404+0000 7f7311b1a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f730c139200 0x7f730c1cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.404+0000 7f7311b1a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730c071300 con 0x7f730c139200 2023-09-30T22:23:20.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.404+0000 7f7311b1a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730c0a5320 con 0x7f730c0a1550 2023-09-30T22:23:20.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.404+0000 7f7311b1a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f730c0a03e0 con 0x7f730c0a0a70 2023-09-30T22:23:20.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.405+0000 7f730b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f730c0a0a70 0x7f730c06dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.405+0000 7f730b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f730c0a0a70 0x7f730c06dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56208/0 (socket says 172.21.15.156:56208) 2023-09-30T22:23:20.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.405+0000 7f730b7fe700 1 -- 172.21.15.156:0/355280806 learned_addr learned my addr 172.21.15.156:0/355280806 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:20.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.405+0000 7f730affd700 1 --2- 172.21.15.156:0/355280806 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f730c0a1550 0x7f730c06e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.405+0000 7f730bfff700 1 --2- 172.21.15.156:0/355280806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f730c139200 0x7f730c1cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.405+0000 7f730b7fe700 1 -- 172.21.15.156:0/355280806 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f730c0a1550 msgr2=0x7f730c06e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.405+0000 7f730b7fe700 1 --2- 172.21.15.156:0/355280806 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f730c0a1550 0x7f730c06e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.405+0000 7f730b7fe700 1 -- 172.21.15.156:0/355280806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f730c139200 msgr2=0x7f730c1cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.405+0000 7f730b7fe700 1 --2- 172.21.15.156:0/355280806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f730c139200 0x7f730c1cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.405+0000 7f730b7fe700 1 -- 172.21.15.156:0/355280806 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73000094a0 con 0x7f730c0a0a70 2023-09-30T22:23:20.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.405+0000 7f730b7fe700 1 --2- 172.21.15.156:0/355280806 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f730c0a0a70 0x7f730c06dd30 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f72fc00c780 tx=0x7f72fc00ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:20.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.405+0000 7f72f3fff700 1 -- 172.21.15.156:0/355280806 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc004c80 con 0x7f730c0a0a70 2023-09-30T22:23:20.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.406+0000 7f72f3fff700 1 -- 172.21.15.156:0/355280806 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72fc004de0 con 0x7f730c0a0a70 2023-09-30T22:23:20.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.406+0000 7f72f3fff700 1 -- 172.21.15.156:0/355280806 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc007310 con 0x7f730c0a0a70 2023-09-30T22:23:20.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.406+0000 7f7311b1a700 1 -- 172.21.15.156:0/355280806 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f730c06f6d0 con 0x7f730c0a0a70 2023-09-30T22:23:20.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.406+0000 7f7311b1a700 1 -- 172.21.15.156:0/355280806 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730c127070 con 0x7f730c0a0a70 2023-09-30T22:23:20.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.407+0000 7f7311b1a700 1 -- 172.21.15.156:0/355280806 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f730c071140 con 0x7f730c0a0a70 2023-09-30T22:23:20.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.411+0000 7f72f3fff700 1 -- 172.21.15.156:0/355280806 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f72fc007470 con 0x7f730c0a0a70 2023-09-30T22:23:20.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.411+0000 7f72f3fff700 1 -- 172.21.15.156:0/355280806 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f72fc03fa30 con 0x7f730c0a0a70 2023-09-30T22:23:20.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.412+0000 7f72f3fff700 1 -- 172.21.15.156:0/355280806 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f72fc03fe60 con 0x7f730c0a0a70 2023-09-30T22:23:20.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.425+0000 7fdca91ed700 1 Processor -- start 2023-09-30T22:23:20.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.425+0000 7fdca91ed700 1 -- start start 2023-09-30T22:23:20.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.425+0000 7f9396194700 1 Processor -- start 2023-09-30T22:23:20.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.425+0000 7f9396194700 1 -- start start 2023-09-30T22:23:20.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.425+0000 7fdca91ed700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdca409d860 0x7fdca409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.425+0000 7fdca91ed700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdca409e170 0x7fdca41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.425+0000 7fdca91ed700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdca4130ce0 0x7fdca4131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.425+0000 7fdca91ed700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca409aaa0 con 0x7fdca409e170 2023-09-30T22:23:20.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.425+0000 7fdca91ed700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca409f870 con 0x7fdca4130ce0 2023-09-30T22:23:20.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.425+0000 7fdca91ed700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdca409b360 con 0x7fdca409d860 2023-09-30T22:23:20.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.426+0000 7f9396194700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9390133ad0 0x7f9390133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.426+0000 7f9396194700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93901300a0 0x7f93901304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.426+0000 7f9396194700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f939006b2d0 con 0x7f93901309f0 2023-09-30T22:23:20.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.426+0000 7f9396194700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9390133610 con 0x7f93901300a0 2023-09-30T22:23:20.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.426+0000 7f9396194700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f939009a500 con 0x7f9390133ad0 2023-09-30T22:23:20.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.426+0000 7f938effd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93901300a0 0x7f93901304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.426+0000 7f938effd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93901300a0 0x7f93901304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:60144/0 (socket says 172.21.15.156:60144) 2023-09-30T22:23:20.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.426+0000 7f938effd700 1 -- 172.21.15.156:0/1341805726 learned_addr learned my addr 172.21.15.156:0/1341805726 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:20.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.426+0000 7f938f7fe700 1 --2- 172.21.15.156:0/1341805726 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9390133ad0 0x7f9390133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.426+0000 7f938effd700 1 -- 172.21.15.156:0/1341805726 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9390133ad0 msgr2=0x7f9390133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:20.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.426+0000 7f938effd700 1 --2- 172.21.15.156:0/1341805726 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9390133ad0 0x7f9390133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.426+0000 7f938effd700 1 -- 172.21.15.156:0/1341805726 >> v1:172.21.15.156:6789/0 conn(0x7f93901309f0 legacy=0x7f939013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:20.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.426+0000 7fdca2d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdca409d860 0x7fdca409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.426+0000 7fdca2d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdca409d860 0x7fdca409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56218/0 (socket says 172.21.15.156:56218) 2023-09-30T22:23:20.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.426+0000 7fdca2d9d700 1 -- 172.21.15.156:0/292888921 learned_addr learned my addr 172.21.15.156:0/292888921 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:20.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.426+0000 7f938effd700 1 -- 172.21.15.156:0/1341805726 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93901338b0 con 0x7f93901300a0 2023-09-30T22:23:20.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.426+0000 7f938f7fe700 1 --2- 172.21.15.156:0/1341805726 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9390133ad0 0x7f9390133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:23:20.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.426+0000 7fdca259c700 1 --2- 172.21.15.156:0/292888921 >> v2:172.21.15.156:3300/0 conn(0x7fdca409e170 0x7fdca41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.426+0000 7fdca2d9d700 1 -- 172.21.15.156:0/292888921 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdca4130ce0 msgr2=0x7fdca4131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:20.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.426+0000 7fdca2d9d700 1 --2- 172.21.15.156:0/292888921 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdca4130ce0 0x7fdca4131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.426+0000 7fdca2d9d700 1 -- 172.21.15.156:0/292888921 >> v2:172.21.15.156:3300/0 conn(0x7fdca409e170 msgr2=0x7fdca41307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:20.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.426+0000 7fdca2d9d700 1 --2- 172.21.15.156:0/292888921 >> v2:172.21.15.156:3300/0 conn(0x7fdca409e170 0x7fdca41307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.426+0000 7fdca2d9d700 1 -- 172.21.15.156:0/292888921 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca409b620 con 0x7fdca409d860 2023-09-30T22:23:20.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.426+0000 7fdca2d9d700 1 --2- 172.21.15.156:0/292888921 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdca409d860 0x7fdca409dc30 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fdc94006e60 tx=0x7fdc94009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d19f53e8a001a237 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:20.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.426+0000 7f938effd700 1 --2- 172.21.15.156:0/1341805726 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93901300a0 0x7f93901304b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9384009920 tx=0x7f9384009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c9b1a6103579ecf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:20.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.427+0000 7f938e7fc700 1 -- 172.21.15.156:0/1341805726 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9384004230 con 0x7f93901300a0 2023-09-30T22:23:20.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.427+0000 7fdca1d9b700 1 -- 172.21.15.156:0/292888921 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc94009ea0 con 0x7fdca409d860 2023-09-30T22:23:20.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.427+0000 7f938e7fc700 1 -- 172.21.15.156:0/1341805726 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9384004390 con 0x7f93901300a0 2023-09-30T22:23:20.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.427+0000 7f938e7fc700 1 -- 172.21.15.156:0/1341805726 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9384009e70 con 0x7f93901300a0 2023-09-30T22:23:20.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.427+0000 7fdca1d9b700 1 -- 172.21.15.156:0/292888921 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc94004230 con 0x7fdca409d860 2023-09-30T22:23:20.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.427+0000 7fdca1d9b700 1 -- 172.21.15.156:0/292888921 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc94010380 con 0x7fdca409d860 2023-09-30T22:23:20.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.428+0000 7f9396194700 1 -- 172.21.15.156:0/1341805726 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93901300a0 msgr2=0x7f93901304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.428+0000 7f9396194700 1 --2- 172.21.15.156:0/1341805726 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93901300a0 0x7f93901304b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9384009920 tx=0x7f9384009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:20.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.428+0000 7fdca91ed700 1 -- 172.21.15.156:0/292888921 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdca409d860 msgr2=0x7fdca409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.428+0000 7fdca91ed700 1 --2- 172.21.15.156:0/292888921 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdca409d860 0x7fdca409dc30 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fdc94006e60 tx=0x7fdc94009c60 comp rx=0 tx=0).stop 2023-09-30T22:23:20.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.428+0000 7f9396194700 1 -- 172.21.15.156:0/1341805726 shutdown_connections 2023-09-30T22:23:20.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.428+0000 7f9396194700 1 --2- 172.21.15.156:0/1341805726 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9390133ad0 0x7f9390133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.428+0000 7f9396194700 1 --2- 172.21.15.156:0/1341805726 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93901300a0 0x7f93901304b0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.428+0000 7f9396194700 1 -- 172.21.15.156:0/1341805726 >> 172.21.15.156:0/1341805726 conn(0x7f9390099c40 msgr2=0x7f93900a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:20.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.428+0000 7fdca91ed700 1 -- 172.21.15.156:0/292888921 shutdown_connections 2023-09-30T22:23:20.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.428+0000 7fdca91ed700 1 --2- 172.21.15.156:0/292888921 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdca4130ce0 0x7fdca4131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.428+0000 7fdca91ed700 1 --2- 172.21.15.156:0/292888921 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdca409d860 0x7fdca409dc30 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.428+0000 7fdca91ed700 1 --2- 172.21.15.156:0/292888921 >> v2:172.21.15.156:3300/0 conn(0x7fdca409e170 0x7fdca41307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.428+0000 7fdca91ed700 1 -- 172.21.15.156:0/292888921 >> 172.21.15.156:0/292888921 conn(0x7fdca4099c40 msgr2=0x7fdca40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:20.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.428+0000 7f9396194700 1 -- 172.21.15.156:0/1341805726 shutdown_connections 2023-09-30T22:23:20.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.428+0000 7f9396194700 1 -- 172.21.15.156:0/1341805726 wait complete. 2023-09-30T22:23:20.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.428+0000 7fdca91ed700 1 -- 172.21.15.156:0/292888921 shutdown_connections 2023-09-30T22:23:20.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.428+0000 7fdca91ed700 1 -- 172.21.15.156:0/292888921 wait complete. 2023-09-30T22:23:20.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.429+0000 7f9396194700 1 Processor -- start 2023-09-30T22:23:20.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.429+0000 7f9396194700 1 -- start start 2023-09-30T22:23:20.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.429+0000 7fdca91ed700 1 Processor -- start 2023-09-30T22:23:20.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.430+0000 7fdca91ed700 1 -- start start 2023-09-30T22:23:20.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.430+0000 7f9396194700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93901300a0 0x7f939011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.430+0000 7f9396194700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f93901309f0 0x7f939011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.430+0000 7f9396194700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9390133ad0 0x7f939011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.430+0000 7f9396194700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939011fe90 con 0x7f9390133ad0 2023-09-30T22:23:20.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.430+0000 7f9396194700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f939012fcf0 con 0x7f93901300a0 2023-09-30T22:23:20.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.430+0000 7f9396194700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9390120170 con 0x7f93901309f0 2023-09-30T22:23:20.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.430+0000 7f938ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9390133ad0 0x7f939011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.430+0000 7f938ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9390133ad0 0x7f939011e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44756/0 (socket says 172.21.15.156:44756) 2023-09-30T22:23:20.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.430+0000 7f938ffff700 1 -- 172.21.15.156:0/347388022 learned_addr learned my addr 172.21.15.156:0/347388022 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:20.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.430+0000 7fdca91ed700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdca409d860 0x7fdca411e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.430+0000 7fdca91ed700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdca409e170 0x7fdca411e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.430+0000 7fdca91ed700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdca4130ce0 0x7fdca411ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.430+0000 7fdca91ed700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca4121d60 con 0x7fdca4130ce0 2023-09-30T22:23:20.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.430+0000 7fdca91ed700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca409c920 con 0x7fdca409d860 2023-09-30T22:23:20.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.430+0000 7fdca91ed700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdca409a150 con 0x7fdca409e170 2023-09-30T22:23:20.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.430+0000 7f938ffff700 1 -- 172.21.15.156:0/347388022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f93901309f0 msgr2=0x7f939011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.430+0000 7f938ffff700 1 --2- 172.21.15.156:0/347388022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f93901309f0 0x7f939011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.430+0000 7f938ffff700 1 -- 172.21.15.156:0/347388022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93901300a0 msgr2=0x7f939011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.430+0000 7f938ffff700 1 --2- 172.21.15.156:0/347388022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93901300a0 0x7f939011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.430+0000 7f938ffff700 1 -- 172.21.15.156:0/347388022 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9384009550 con 0x7f9390133ad0 2023-09-30T22:23:20.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.430+0000 7fdca2d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdca409d860 0x7fdca411e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.431+0000 7fdca2d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdca409d860 0x7fdca411e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:60160/0 (socket says 172.21.15.156:60160) 2023-09-30T22:23:20.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.431+0000 7fdca2d9d700 1 -- 172.21.15.156:0/4168450718 learned_addr learned my addr 172.21.15.156:0/4168450718 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:20.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.431+0000 7fdca259c700 1 --2- 172.21.15.156:0/4168450718 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdca409e170 0x7fdca411e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.431+0000 7fdca359e700 1 --2- 172.21.15.156:0/4168450718 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdca4130ce0 0x7fdca411ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.431+0000 7f938ffff700 1 --2- 172.21.15.156:0/347388022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9390133ad0 0x7f939011e4c0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f938800c7a0 tx=0x7f938800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:20.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.431+0000 7fdca259c700 1 -- 172.21.15.156:0/4168450718 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdca409d860 msgr2=0x7fdca411e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.431+0000 7fdca259c700 1 --2- 172.21.15.156:0/4168450718 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdca409d860 0x7fdca411e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.431+0000 7fdca259c700 1 -- 172.21.15.156:0/4168450718 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdca4130ce0 msgr2=0x7fdca411ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.431+0000 7fdca259c700 1 --2- 172.21.15.156:0/4168450718 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdca4130ce0 0x7fdca411ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.431+0000 7fdca259c700 1 -- 172.21.15.156:0/4168450718 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc94009550 con 0x7fdca409e170 2023-09-30T22:23:20.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.431+0000 7f9377fff700 1 -- 172.21.15.156:0/347388022 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9388003e10 con 0x7f9390133ad0 2023-09-30T22:23:20.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.431+0000 7f9377fff700 1 -- 172.21.15.156:0/347388022 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9388005070 con 0x7f9390133ad0 2023-09-30T22:23:20.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.431+0000 7f9396194700 1 -- 172.21.15.156:0/347388022 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f939012dd60 con 0x7f9390133ad0 2023-09-30T22:23:20.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.431+0000 7f9377fff700 1 -- 172.21.15.156:0/347388022 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9388005420 con 0x7f9390133ad0 2023-09-30T22:23:20.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.432+0000 7fdca259c700 1 --2- 172.21.15.156:0/4168450718 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdca409e170 0x7fdca411e780 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800d960 tx=0x7fdc9800dc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:20.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.432+0000 7fdc8b7fe700 1 -- 172.21.15.156:0/4168450718 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98004220 con 0x7fdca409e170 2023-09-30T22:23:20.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.432+0000 7fdc8b7fe700 1 -- 172.21.15.156:0/4168450718 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc98004380 con 0x7fdca409e170 2023-09-30T22:23:20.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.432+0000 7fdc8b7fe700 1 -- 172.21.15.156:0/4168450718 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9800f6d0 con 0x7fdca409e170 2023-09-30T22:23:20.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.432+0000 7f9396194700 1 -- 172.21.15.156:0/347388022 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f939011ea00 con 0x7f9390133ad0 2023-09-30T22:23:20.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.432+0000 7f9377fff700 1 -- 172.21.15.156:0/347388022 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9388005580 con 0x7f9390133ad0 2023-09-30T22:23:20.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.433+0000 7fdca91ed700 1 -- 172.21.15.156:0/4168450718 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca41206b0 con 0x7fdca409e170 2023-09-30T22:23:20.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.433+0000 7fdca91ed700 1 -- 172.21.15.156:0/4168450718 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca4120460 con 0x7fdca409e170 2023-09-30T22:23:20.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.433+0000 7f9377fff700 1 -- 172.21.15.156:0/347388022 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9388005830 con 0x7f9390133ad0 2023-09-30T22:23:20.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.433+0000 7f9396194700 1 -- 172.21.15.156:0/347388022 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f939004f2a0 con 0x7f9390133ad0 2023-09-30T22:23:20.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.434+0000 7fdca91ed700 1 -- 172.21.15.156:0/4168450718 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca4121610 con 0x7fdca409e170 2023-09-30T22:23:20.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.435+0000 7fdc8b7fe700 1 -- 172.21.15.156:0/4168450718 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc9800f830 con 0x7fdca409e170 2023-09-30T22:23:20.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.435+0000 7fdc8b7fe700 1 -- 172.21.15.156:0/4168450718 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdc9803f550 con 0x7fdca409e170 2023-09-30T22:23:20.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.442+0000 7f9377fff700 1 -- 172.21.15.156:0/347388022 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9388017030 con 0x7f9390133ad0 2023-09-30T22:23:20.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.443+0000 7fdc8b7fe700 1 -- 172.21.15.156:0/4168450718 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc98021bd0 con 0x7fdca409e170 2023-09-30T22:23:20.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.475+0000 7f220e30e700 1 Processor -- start 2023-09-30T22:23:20.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.475+0000 7f220e30e700 1 -- start start 2023-09-30T22:23:20.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.475+0000 7f220e30e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f220809dec0 0x7f220806b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.475+0000 7f220e30e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2208136cb0 0x7f2208139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.475+0000 7f220e30e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f220806e900 con 0x7f220806a770 2023-09-30T22:23:20.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.475+0000 7f220e30e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f220809d180 con 0x7f220809dec0 2023-09-30T22:23:20.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.475+0000 7f220e30e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f220809e780 con 0x7f2208136cb0 2023-09-30T22:23:20.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.475+0000 7f220c8ab700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2208136cb0 0x7f2208139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.475+0000 7f2207fff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f220806a770 0x7f220806ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:42736/0 (socket says 172.21.15.156:42736) 2023-09-30T22:23:20.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.475+0000 7f2207fff700 1 -- 172.21.15.156:0/852386664 learned_addr learned my addr 172.21.15.156:0/852386664 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:20.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.475+0000 7f220c8ab700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2208136cb0 0x7f2208139090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56254/0 (socket says 172.21.15.156:56254) 2023-09-30T22:23:20.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.475+0000 7f22077fe700 1 --2- 172.21.15.156:0/852386664 >> v2:172.21.15.156:3300/0 conn(0x7f220809dec0 0x7f220806b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.476+0000 7f220c8ab700 1 -- 172.21.15.156:0/852386664 >> v2:172.21.15.156:3300/0 conn(0x7f220809dec0 msgr2=0x7f220806b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:20.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.476+0000 7f220c8ab700 1 --2- 172.21.15.156:0/852386664 >> v2:172.21.15.156:3300/0 conn(0x7f220809dec0 0x7f220806b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.476+0000 7f2206ffd700 1 -- 172.21.15.156:0/852386664 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2711648676 0 0) 0x7f220806e900 con 0x7f220806a770 2023-09-30T22:23:20.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.476+0000 7f220c8ab700 1 -- 172.21.15.156:0/852386664 >> v1:172.21.15.156:6789/0 conn(0x7f220806a770 legacy=0x7f220806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.476+0000 7f220c8ab700 1 -- 172.21.15.156:0/852386664 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220809d3c0 con 0x7f2208136cb0 2023-09-30T22:23:20.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.476+0000 7f220c8ab700 1 --2- 172.21.15.156:0/852386664 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2208136cb0 0x7f2208139090 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2200009d90 tx=0x7f220000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aadde0e46e3aac02 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:20.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.476+0000 7f2206ffd700 1 -- 172.21.15.156:0/852386664 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220000e070 con 0x7f2208136cb0 2023-09-30T22:23:20.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.476+0000 7f2206ffd700 1 -- 172.21.15.156:0/852386664 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220000bb20 con 0x7f2208136cb0 2023-09-30T22:23:20.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.476+0000 7f2206ffd700 1 -- 172.21.15.156:0/852386664 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2200012430 con 0x7f2208136cb0 2023-09-30T22:23:20.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.477+0000 7f220e30e700 1 -- 172.21.15.156:0/852386664 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2208136cb0 msgr2=0x7f2208139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.477+0000 7f220e30e700 1 --2- 172.21.15.156:0/852386664 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2208136cb0 0x7f2208139090 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2200009d90 tx=0x7f220000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:20.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.477+0000 7f220e30e700 1 -- 172.21.15.156:0/852386664 shutdown_connections 2023-09-30T22:23:20.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.477+0000 7f220e30e700 1 --2- 172.21.15.156:0/852386664 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2208136cb0 0x7f2208139090 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.477+0000 7f220e30e700 1 --2- 172.21.15.156:0/852386664 >> v2:172.21.15.156:3300/0 conn(0x7f220809dec0 0x7f220806b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.477+0000 7f220e30e700 1 -- 172.21.15.156:0/852386664 >> 172.21.15.156:0/852386664 conn(0x7f2208099c40 msgr2=0x7f22080a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:20.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.477+0000 7f220e30e700 1 -- 172.21.15.156:0/852386664 shutdown_connections 2023-09-30T22:23:20.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.477+0000 7f220e30e700 1 -- 172.21.15.156:0/852386664 wait complete. 2023-09-30T22:23:20.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.478+0000 7f220e30e700 1 Processor -- start 2023-09-30T22:23:20.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.478+0000 7f220e30e700 1 -- start start 2023-09-30T22:23:20.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.478+0000 7f220e30e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f220806a770 0x7f22081318f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.478+0000 7f220e30e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f220809dec0 0x7f2208131e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.478+0000 7f220e30e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2208136cb0 0x7f2208132370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.478+0000 7f220e30e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2208134ca0 con 0x7f2208136cb0 2023-09-30T22:23:20.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.478+0000 7f220e30e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2208071ce0 con 0x7f220809dec0 2023-09-30T22:23:20.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.478+0000 7f220e30e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2208139330 con 0x7f220806a770 2023-09-30T22:23:20.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.479+0000 7f2207fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f220806a770 0x7f22081318f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.479+0000 7f2207fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f220806a770 0x7f22081318f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56260/0 (socket says 172.21.15.156:56260) 2023-09-30T22:23:20.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.479+0000 7f2207fff700 1 -- 172.21.15.156:0/2953345982 learned_addr learned my addr 172.21.15.156:0/2953345982 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:20.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.479+0000 7f220c8ab700 1 --2- 172.21.15.156:0/2953345982 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2208136cb0 0x7f2208132370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.479+0000 7f2207fff700 1 -- 172.21.15.156:0/2953345982 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f220809dec0 msgr2=0x7f2208131e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.479+0000 7f2207fff700 1 --2- 172.21.15.156:0/2953345982 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f220809dec0 0x7f2208131e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.479+0000 7f2207fff700 1 -- 172.21.15.156:0/2953345982 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2208136cb0 msgr2=0x7f2208132370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.479+0000 7f2207fff700 1 --2- 172.21.15.156:0/2953345982 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2208136cb0 0x7f2208132370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.479+0000 7f2207fff700 1 -- 172.21.15.156:0/2953345982 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2200009a70 con 0x7f220806a770 2023-09-30T22:23:20.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.479+0000 7f2207fff700 1 --2- 172.21.15.156:0/2953345982 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f220806a770 0x7f22081318f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f21f800c520 tx=0x7f21f800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:20.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.479+0000 7f2204ff9700 1 -- 172.21.15.156:0/2953345982 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f8004c80 con 0x7f220806a770 2023-09-30T22:23:20.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.479+0000 7f2204ff9700 1 -- 172.21.15.156:0/2953345982 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f8004de0 con 0x7f220806a770 2023-09-30T22:23:20.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.479+0000 7f2204ff9700 1 -- 172.21.15.156:0/2953345982 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f8007310 con 0x7f220806a770 2023-09-30T22:23:20.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.480+0000 7f220e30e700 1 -- 172.21.15.156:0/2953345982 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2208135b60 con 0x7f220806a770 2023-09-30T22:23:20.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.480+0000 7f220e30e700 1 -- 172.21.15.156:0/2953345982 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2208135710 con 0x7f220806a770 2023-09-30T22:23:20.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.480+0000 7f2204ff9700 1 -- 172.21.15.156:0/2953345982 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f21f8007470 con 0x7f220806a770 2023-09-30T22:23:20.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.480+0000 7f2204ff9700 1 -- 172.21.15.156:0/2953345982 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f21f803f4d0 con 0x7f220806a770 2023-09-30T22:23:20.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.481+0000 7f220e30e700 1 -- 172.21.15.156:0/2953345982 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f220804f2a0 con 0x7f220806a770 2023-09-30T22:23:20.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.485+0000 7f2204ff9700 1 -- 172.21.15.156:0/2953345982 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f21f80123b0 con 0x7f220806a770 2023-09-30T22:23:20.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.637+0000 7f9396194700 1 -- 172.21.15.156:0/347388022 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f939006c3b0 con 0x7f9390133ad0 2023-09-30T22:23:20.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.637+0000 7f9377fff700 1 -- 172.21.15.156:0/347388022 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9388031090 con 0x7f9390133ad0 2023-09-30T22:23:20.638 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:20.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.639+0000 7f9396194700 1 -- 172.21.15.156:0/347388022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9390133ad0 msgr2=0x7f939011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.639+0000 7f9396194700 1 --2- 172.21.15.156:0/347388022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9390133ad0 0x7f939011e4c0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f938800c7a0 tx=0x7f938800cb60 comp rx=0 tx=0).stop 2023-09-30T22:23:20.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.639+0000 7f9396194700 1 -- 172.21.15.156:0/347388022 shutdown_connections 2023-09-30T22:23:20.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.639+0000 7f9396194700 1 --2- 172.21.15.156:0/347388022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9390133ad0 0x7f939011e4c0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.639+0000 7f9396194700 1 --2- 172.21.15.156:0/347388022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93901300a0 0x7f939011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.639+0000 7f9396194700 1 --2- 172.21.15.156:0/347388022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f93901309f0 0x7f939011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.639+0000 7f9396194700 1 -- 172.21.15.156:0/347388022 >> 172.21.15.156:0/347388022 conn(0x7f9390099c40 msgr2=0x7f9390131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:20.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.639+0000 7f9396194700 1 -- 172.21.15.156:0/347388022 shutdown_connections 2023-09-30T22:23:20.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.639+0000 7f9396194700 1 -- 172.21.15.156:0/347388022 wait complete. 2023-09-30T22:23:20.657 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:20.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.659+0000 7f7311b1a700 1 -- 172.21.15.156:0/355280806 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f730c070f40 con 0x7f730c0a0a70 2023-09-30T22:23:20.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.660+0000 7f72f3fff700 1 -- 172.21.15.156:0/355280806 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f72fc007720 con 0x7f730c0a0a70 2023-09-30T22:23:20.660 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:20.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.662+0000 7f7311b1a700 1 -- 172.21.15.156:0/355280806 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f730c0a0a70 msgr2=0x7f730c06dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.662+0000 7f7311b1a700 1 --2- 172.21.15.156:0/355280806 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f730c0a0a70 0x7f730c06dd30 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f72fc00c780 tx=0x7f72fc00ca90 comp rx=0 tx=0).stop 2023-09-30T22:23:20.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.662+0000 7f7311b1a700 1 -- 172.21.15.156:0/355280806 shutdown_connections 2023-09-30T22:23:20.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.662+0000 7f7311b1a700 1 --2- 172.21.15.156:0/355280806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f730c139200 0x7f730c1cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.662+0000 7f7311b1a700 1 --2- 172.21.15.156:0/355280806 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f730c0a0a70 0x7f730c06dd30 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.662+0000 7f7311b1a700 1 --2- 172.21.15.156:0/355280806 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f730c0a1550 0x7f730c06e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.662+0000 7f7311b1a700 1 -- 172.21.15.156:0/355280806 >> 172.21.15.156:0/355280806 conn(0x7f730c0a6610 msgr2=0x7f730c136d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:20.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.662+0000 7f7311b1a700 1 -- 172.21.15.156:0/355280806 shutdown_connections 2023-09-30T22:23:20.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.662+0000 7f7311b1a700 1 -- 172.21.15.156:0/355280806 wait complete. 2023-09-30T22:23:20.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:20.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.681+0000 7f220e30e700 1 -- 172.21.15.156:0/2953345982 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f220809e3a0 con 0x7f220806a770 2023-09-30T22:23:20.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.681+0000 7f2204ff9700 1 -- 172.21.15.156:0/2953345982 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f21f8011360 con 0x7f220806a770 2023-09-30T22:23:20.682 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:20.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.683+0000 7f220e30e700 1 -- 172.21.15.156:0/2953345982 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f220806a770 msgr2=0x7f22081318f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.683+0000 7f220e30e700 1 --2- 172.21.15.156:0/2953345982 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f220806a770 0x7f22081318f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f21f800c520 tx=0x7f21f800c830 comp rx=0 tx=0).stop 2023-09-30T22:23:20.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.683+0000 7f220e30e700 1 -- 172.21.15.156:0/2953345982 shutdown_connections 2023-09-30T22:23:20.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.683+0000 7f220e30e700 1 --2- 172.21.15.156:0/2953345982 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2208136cb0 0x7f2208132370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.683+0000 7f220e30e700 1 --2- 172.21.15.156:0/2953345982 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f220806a770 0x7f22081318f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.683+0000 7f220e30e700 1 --2- 172.21.15.156:0/2953345982 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f220809dec0 0x7f2208131e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.683+0000 7f220e30e700 1 -- 172.21.15.156:0/2953345982 >> 172.21.15.156:0/2953345982 conn(0x7f2208099c40 msgr2=0x7f220812f890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:20.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.683+0000 7f220e30e700 1 -- 172.21.15.156:0/2953345982 shutdown_connections 2023-09-30T22:23:20.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.683+0000 7f220e30e700 1 -- 172.21.15.156:0/2953345982 wait complete. 2023-09-30T22:23:20.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:20.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.698+0000 7fdca91ed700 1 -- 172.21.15.156:0/4168450718 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdca404f2a0 con 0x7fdca409e170 2023-09-30T22:23:20.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.699+0000 7fdc8b7fe700 1 -- 172.21.15.156:0/4168450718 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdc98021e00 con 0x7fdca409e170 2023-09-30T22:23:20.699 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:20.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.701+0000 7fdca91ed700 1 -- 172.21.15.156:0/4168450718 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdca409e170 msgr2=0x7fdca411e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.701+0000 7fdca91ed700 1 --2- 172.21.15.156:0/4168450718 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdca409e170 0x7fdca411e780 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800d960 tx=0x7fdc9800dc70 comp rx=0 tx=0).stop 2023-09-30T22:23:20.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.701+0000 7fdca91ed700 1 -- 172.21.15.156:0/4168450718 shutdown_connections 2023-09-30T22:23:20.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.701+0000 7fdca91ed700 1 --2- 172.21.15.156:0/4168450718 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdca4130ce0 0x7fdca411ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.701+0000 7fdca91ed700 1 --2- 172.21.15.156:0/4168450718 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdca409d860 0x7fdca411e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.701+0000 7fdca91ed700 1 --2- 172.21.15.156:0/4168450718 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdca409e170 0x7fdca411e780 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.701+0000 7fdca91ed700 1 -- 172.21.15.156:0/4168450718 >> 172.21.15.156:0/4168450718 conn(0x7fdca4099c40 msgr2=0x7fdca40a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:20.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.701+0000 7fdca91ed700 1 -- 172.21.15.156:0/4168450718 shutdown_connections 2023-09-30T22:23:20.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:20.701+0000 7fdca91ed700 1 -- 172.21.15.156:0/4168450718 wait complete. 2023-09-30T22:23:20.714 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:21.658 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:21.676 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:21.699 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:21.715 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:21.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.800+0000 7f8a08e22700 1 Processor -- start 2023-09-30T22:23:21.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.801+0000 7f8a08e22700 1 -- start start 2023-09-30T22:23:21.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.801+0000 7f8a08e22700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a0406a770 0x7f8a041349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.801+0000 7f8a08e22700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8a04134f00 0x7f8a0409d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.801+0000 7f8a08e22700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a0409dea0 0x7f8a0409e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.801+0000 7f8a08e22700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0406b2e0 con 0x7f8a04134f00 2023-09-30T22:23:21.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.801+0000 7f8a08e22700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0409eca0 con 0x7f8a0406a770 2023-09-30T22:23:21.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.801+0000 7f8a08e22700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0409f720 con 0x7f8a0409dea0 2023-09-30T22:23:21.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.802+0000 7f8a0259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a0406a770 0x7f8a041349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.802+0000 7f8a02d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a0409dea0 0x7f8a0409e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.802+0000 7f8a01d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8a04134f00 0x7f8a0409d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.802+0000 7f8a0259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a0406a770 0x7f8a041349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:41000/0 (socket says 172.21.15.156:41000) 2023-09-30T22:23:21.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.802+0000 7f8a0259c700 1 -- 172.21.15.156:0/2752757672 learned_addr learned my addr 172.21.15.156:0/2752757672 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:21.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.802+0000 7f8a02d9d700 1 -- 172.21.15.156:0/2752757672 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a0406a770 msgr2=0x7f8a041349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:21.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.802+0000 7f8a02d9d700 1 --2- 172.21.15.156:0/2752757672 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a0406a770 0x7f8a041349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.802+0000 7f8a02d9d700 1 -- 172.21.15.156:0/2752757672 >> v2:172.21.15.156:3300/0 conn(0x7f8a04134f00 msgr2=0x7f8a0409d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:21.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.802+0000 7f8a02d9d700 1 --2- 172.21.15.156:0/2752757672 >> v2:172.21.15.156:3300/0 conn(0x7f8a04134f00 0x7f8a0409d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.802+0000 7f8a02d9d700 1 -- 172.21.15.156:0/2752757672 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0406b480 con 0x7f8a0409dea0 2023-09-30T22:23:21.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.802+0000 7f8a01d9b700 1 --2- 172.21.15.156:0/2752757672 >> v2:172.21.15.156:3300/0 conn(0x7f8a04134f00 0x7f8a0409d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:21.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.802+0000 7f8a0259c700 1 --2- 172.21.15.156:0/2752757672 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a0406a770 0x7f8a041349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:21.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.802+0000 7f8a02d9d700 1 --2- 172.21.15.156:0/2752757672 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a0409dea0 0x7f8a0409e340 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f89fc009d90 tx=0x7f89fc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5092fc9681f682b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:21.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.802+0000 7f8a0159a700 1 -- 172.21.15.156:0/2752757672 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc00e070 con 0x7f8a0409dea0 2023-09-30T22:23:21.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.803+0000 7f8a0159a700 1 -- 172.21.15.156:0/2752757672 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc00bb20 con 0x7f8a0409dea0 2023-09-30T22:23:21.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.803+0000 7f8a0159a700 1 -- 172.21.15.156:0/2752757672 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc012430 con 0x7f8a0409dea0 2023-09-30T22:23:21.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.803+0000 7f8a08e22700 1 -- 172.21.15.156:0/2752757672 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a0409dea0 msgr2=0x7f8a0409e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.803+0000 7f8a08e22700 1 --2- 172.21.15.156:0/2752757672 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a0409dea0 0x7f8a0409e340 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f89fc009d90 tx=0x7f89fc00b330 comp rx=0 tx=0).stop 2023-09-30T22:23:21.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.803+0000 7f8a08e22700 1 -- 172.21.15.156:0/2752757672 shutdown_connections 2023-09-30T22:23:21.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.803+0000 7f8a08e22700 1 --2- 172.21.15.156:0/2752757672 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a0409dea0 0x7f8a0409e340 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.803+0000 7f8a08e22700 1 --2- 172.21.15.156:0/2752757672 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a0406a770 0x7f8a041349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.803+0000 7f8a08e22700 1 --2- 172.21.15.156:0/2752757672 >> v2:172.21.15.156:3300/0 conn(0x7f8a04134f00 0x7f8a0409d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.803+0000 7f8a08e22700 1 -- 172.21.15.156:0/2752757672 >> 172.21.15.156:0/2752757672 conn(0x7f8a04099c40 msgr2=0x7f8a040a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:21.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.803+0000 7f8a08e22700 1 -- 172.21.15.156:0/2752757672 shutdown_connections 2023-09-30T22:23:21.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.804+0000 7f8a08e22700 1 -- 172.21.15.156:0/2752757672 wait complete. 2023-09-30T22:23:21.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.805+0000 7f8a08e22700 1 Processor -- start 2023-09-30T22:23:21.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.805+0000 7f8a08e22700 1 -- start start 2023-09-30T22:23:21.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.805+0000 7f8a08e22700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a0406a770 0x7f8a04133d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.805+0000 7f8a08e22700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a0409dea0 0x7f8a0411a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.805+0000 7f8a08e22700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a04134f00 0x7f8a0411aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.805+0000 7f8a08e22700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a04139250 con 0x7f8a0409dea0 2023-09-30T22:23:21.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.805+0000 7f8a08e22700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a04138a80 con 0x7f8a0406a770 2023-09-30T22:23:21.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.805+0000 7f8a08e22700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0409f220 con 0x7f8a04134f00 2023-09-30T22:23:21.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.805+0000 7f8a01d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a0409dea0 0x7f8a0411a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.805+0000 7f8a01d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a0409dea0 0x7f8a0411a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:37898/0 (socket says 172.21.15.156:37898) 2023-09-30T22:23:21.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.805+0000 7f8a01d9b700 1 -- 172.21.15.156:0/2978929934 learned_addr learned my addr 172.21.15.156:0/2978929934 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:21.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.805+0000 7f8a0259c700 1 --2- 172.21.15.156:0/2978929934 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a0406a770 0x7f8a04133d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.805+0000 7f8a02d9d700 1 --2- 172.21.15.156:0/2978929934 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a04134f00 0x7f8a0411aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.806+0000 7f8a01d9b700 1 -- 172.21.15.156:0/2978929934 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a04134f00 msgr2=0x7f8a0411aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.806+0000 7f8a01d9b700 1 --2- 172.21.15.156:0/2978929934 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a04134f00 0x7f8a0411aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.806+0000 7f8a01d9b700 1 -- 172.21.15.156:0/2978929934 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a0406a770 msgr2=0x7f8a04133d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.806+0000 7f8a01d9b700 1 --2- 172.21.15.156:0/2978929934 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a0406a770 0x7f8a04133d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.806+0000 7f8a01d9b700 1 -- 172.21.15.156:0/2978929934 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f4009550 con 0x7f8a0409dea0 2023-09-30T22:23:21.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.806+0000 7f8a0259c700 1 --2- 172.21.15.156:0/2978929934 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a0406a770 0x7f8a04133d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:21.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.806+0000 7f8a01d9b700 1 --2- 172.21.15.156:0/2978929934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a0409dea0 0x7f8a0411a550 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f89f800ebe0 tx=0x7f89f8009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:21.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.806+0000 7f89f2ffd700 1 -- 172.21.15.156:0/2978929934 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f800c910 con 0x7f8a0409dea0 2023-09-30T22:23:21.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.806+0000 7f89f2ffd700 1 -- 172.21.15.156:0/2978929934 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f800ca70 con 0x7f8a0409dea0 2023-09-30T22:23:21.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.806+0000 7f89f2ffd700 1 -- 172.21.15.156:0/2978929934 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f800cde0 con 0x7f8a0409dea0 2023-09-30T22:23:21.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.806+0000 7f8a08e22700 1 -- 172.21.15.156:0/2978929934 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f80094a0 con 0x7f8a0409dea0 2023-09-30T22:23:21.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.806+0000 7f8a08e22700 1 -- 172.21.15.156:0/2978929934 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89fc009a70 con 0x7f8a0409dea0 2023-09-30T22:23:21.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.807+0000 7f8a08e22700 1 -- 172.21.15.156:0/2978929934 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a04138d70 con 0x7f8a0409dea0 2023-09-30T22:23:21.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.808+0000 7f89f2ffd700 1 -- 172.21.15.156:0/2978929934 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f89f8013470 con 0x7f8a0409dea0 2023-09-30T22:23:21.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.808+0000 7f89f2ffd700 1 -- 172.21.15.156:0/2978929934 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f89f80400c0 con 0x7f8a0409dea0 2023-09-30T22:23:21.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.816+0000 7f89f2ffd700 1 -- 172.21.15.156:0/2978929934 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f89f8011350 con 0x7f8a0409dea0 2023-09-30T22:23:21.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.838+0000 7fa895ee4700 1 Processor -- start 2023-09-30T22:23:21.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.839+0000 7fa895ee4700 1 -- start start 2023-09-30T22:23:21.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.839+0000 7f0c26bdb700 1 Processor -- start 2023-09-30T22:23:21.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.839+0000 7f0c26bdb700 1 -- start start 2023-09-30T22:23:21.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.839+0000 7fa895ee4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa8901309f0 0x7fa890130dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.839+0000 7fa895ee4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa89009e450 0x7fa890138760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.839+0000 7fa895ee4700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa89009c1f0 con 0x7fa89009d8f0 2023-09-30T22:23:21.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.839+0000 7fa895ee4700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa89009b1f0 con 0x7fa8901309f0 2023-09-30T22:23:21.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.839+0000 7fa895ee4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa890131300 con 0x7fa89009e450 2023-09-30T22:23:21.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.839+0000 7f0c26bdb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c20099e20 0x7f0c2009a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.839+0000 7f0c26bdb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c2009a730 0x7f0c20130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.839+0000 7fa88f7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa8901309f0 0x7fa890130dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.839+0000 7f0c26bdb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0c20130890 0x7f0c20130d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.839+0000 7f0c26bdb700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c2009bf50 con 0x7f0c20130890 2023-09-30T22:23:21.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.839+0000 7f0c26bdb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c20099a60 con 0x7f0c20099e20 2023-09-30T22:23:21.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.839+0000 7f0c26bdb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2009b230 con 0x7f0c2009a730 2023-09-30T22:23:21.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.839+0000 7fa88ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa89009e450 0x7fa890138760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.839+0000 7fa88ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa89009e450 0x7fa890138760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:50748/0 (socket says 172.21.15.156:50748) 2023-09-30T22:23:21.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.839+0000 7fa88ffff700 1 -- 172.21.15.156:0/156317412 learned_addr learned my addr 172.21.15.156:0/156317412 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:21.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.839+0000 7f0c1ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c2009a730 0x7f0c20130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.839+0000 7f0c25178700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0c20130890 0x7f0c20130d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.839+0000 7f0c1ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c2009a730 0x7f0c20130350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:50762/0 (socket says 172.21.15.156:50762) 2023-09-30T22:23:21.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.839+0000 7f0c1ffff700 1 -- 172.21.15.156:0/3054228003 learned_addr learned my addr 172.21.15.156:0/3054228003 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:21.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.840+0000 7f0c24977700 1 --2- 172.21.15.156:0/3054228003 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c20099e20 0x7f0c2009a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.840+0000 7f0c1ffff700 1 -- 172.21.15.156:0/3054228003 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c20099e20 msgr2=0x7f0c2009a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:21.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.840+0000 7f0c1ffff700 1 --2- 172.21.15.156:0/3054228003 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c20099e20 0x7f0c2009a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.840+0000 7f0c1ffff700 1 -- 172.21.15.156:0/3054228003 >> v2:172.21.15.156:3300/0 conn(0x7f0c20130890 msgr2=0x7f0c20130d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:21.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.840+0000 7f0c1ffff700 1 --2- 172.21.15.156:0/3054228003 >> v2:172.21.15.156:3300/0 conn(0x7f0c20130890 0x7f0c20130d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.840+0000 7f0c1ffff700 1 -- 172.21.15.156:0/3054228003 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c2009bb90 con 0x7f0c2009a730 2023-09-30T22:23:21.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.839+0000 7fa88f7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa8901309f0 0x7fa890130dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:37912/0 (socket says 172.21.15.156:37912) 2023-09-30T22:23:21.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.840+0000 7fa88ffff700 1 -- 172.21.15.156:0/156317412 >> v2:172.21.15.156:3300/0 conn(0x7fa8901309f0 msgr2=0x7fa890130dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:21.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.840+0000 7fa88ffff700 1 --2- 172.21.15.156:0/156317412 >> v2:172.21.15.156:3300/0 conn(0x7fa8901309f0 0x7fa890130dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.840+0000 7fa88ffff700 1 -- 172.21.15.156:0/156317412 >> v1:172.21.15.156:6789/0 conn(0x7fa89009d8f0 legacy=0x7fa89009dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:21.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.840+0000 7fa88ffff700 1 -- 172.21.15.156:0/156317412 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8901305a0 con 0x7fa89009e450 2023-09-30T22:23:21.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.840+0000 7f0c1ffff700 1 --2- 172.21.15.156:0/3054228003 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c2009a730 0x7f0c20130350 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c009920 tx=0x7f0c0c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d96a085a1b05f55 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:21.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.840+0000 7f0c1f7fe700 1 -- 172.21.15.156:0/3054228003 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c011830 con 0x7f0c2009a730 2023-09-30T22:23:21.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.840+0000 7f0c1f7fe700 1 -- 172.21.15.156:0/3054228003 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0c011990 con 0x7f0c2009a730 2023-09-30T22:23:21.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.840+0000 7f0c1f7fe700 1 -- 172.21.15.156:0/3054228003 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c011d20 con 0x7f0c2009a730 2023-09-30T22:23:21.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.840+0000 7fa88ffff700 1 --2- 172.21.15.156:0/156317412 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa89009e450 0x7fa890138760 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa888009e50 tx=0x7fa88800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36a6665df27c6c87 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:21.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.841+0000 7fa88e7fc700 1 -- 172.21.15.156:0/156317412 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88800e070 con 0x7fa89009e450 2023-09-30T22:23:21.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.841+0000 7fa88e7fc700 1 -- 172.21.15.156:0/156317412 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa888003a20 con 0x7fa89009e450 2023-09-30T22:23:21.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.841+0000 7fa88e7fc700 1 -- 172.21.15.156:0/156317412 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa888003dd0 con 0x7fa89009e450 2023-09-30T22:23:21.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.841+0000 7fa895ee4700 1 -- 172.21.15.156:0/156317412 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa89009e450 msgr2=0x7fa890138760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.841+0000 7fa895ee4700 1 --2- 172.21.15.156:0/156317412 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa89009e450 0x7fa890138760 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa888009e50 tx=0x7fa88800b330 comp rx=0 tx=0).stop 2023-09-30T22:23:21.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.841+0000 7f0c26bdb700 1 -- 172.21.15.156:0/3054228003 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c2009a730 msgr2=0x7f0c20130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.841+0000 7f0c26bdb700 1 --2- 172.21.15.156:0/3054228003 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c2009a730 0x7f0c20130350 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c009920 tx=0x7f0c0c009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:21.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.841+0000 7f0c26bdb700 1 -- 172.21.15.156:0/3054228003 shutdown_connections 2023-09-30T22:23:21.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.841+0000 7f0c26bdb700 1 --2- 172.21.15.156:0/3054228003 >> v2:172.21.15.156:3300/0 conn(0x7f0c20130890 0x7f0c20130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.841+0000 7f0c26bdb700 1 --2- 172.21.15.156:0/3054228003 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c20099e20 0x7f0c2009a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.841+0000 7f0c26bdb700 1 --2- 172.21.15.156:0/3054228003 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c2009a730 0x7f0c20130350 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.841+0000 7f0c26bdb700 1 -- 172.21.15.156:0/3054228003 >> 172.21.15.156:0/3054228003 conn(0x7f0c200a2980 msgr2=0x7f0c200a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:21.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.841+0000 7fa895ee4700 1 -- 172.21.15.156:0/156317412 shutdown_connections 2023-09-30T22:23:21.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.841+0000 7fa895ee4700 1 --2- 172.21.15.156:0/156317412 >> v2:172.21.15.156:3300/0 conn(0x7fa8901309f0 0x7fa890130dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.841+0000 7fa895ee4700 1 --2- 172.21.15.156:0/156317412 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa89009e450 0x7fa890138760 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.841+0000 7fa895ee4700 1 -- 172.21.15.156:0/156317412 >> 172.21.15.156:0/156317412 conn(0x7fa8900a2b30 msgr2=0x7fa89009e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:21.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.841+0000 7f0c26bdb700 1 -- 172.21.15.156:0/3054228003 shutdown_connections 2023-09-30T22:23:21.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.841+0000 7fa895ee4700 1 -- 172.21.15.156:0/156317412 shutdown_connections 2023-09-30T22:23:21.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.841+0000 7fa895ee4700 1 -- 172.21.15.156:0/156317412 wait complete. 2023-09-30T22:23:21.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.841+0000 7f0c26bdb700 1 -- 172.21.15.156:0/3054228003 wait complete. 2023-09-30T22:23:21.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.842+0000 7f0c26bdb700 1 Processor -- start 2023-09-30T22:23:21.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.842+0000 7f0c26bdb700 1 -- start start 2023-09-30T22:23:21.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.843+0000 7fa895ee4700 1 Processor -- start 2023-09-30T22:23:21.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.843+0000 7fa895ee4700 1 -- start start 2023-09-30T22:23:21.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.843+0000 7f0c26bdb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c20099e20 0x7f0c2013cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.843+0000 7f0c26bdb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c2009a730 0x7f0c20125870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.843+0000 7f0c26bdb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c20130890 0x7f0c20125db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.843+0000 7f0c26bdb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c20127f90 con 0x7f0c20130890 2023-09-30T22:23:21.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.843+0000 7f0c26bdb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c20127810 con 0x7f0c2009a730 2023-09-30T22:23:21.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.843+0000 7f0c26bdb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2013d4e0 con 0x7f0c20099e20 2023-09-30T22:23:21.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.843+0000 7f0c25178700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c20130890 0x7f0c20125db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.843+0000 7f0c25178700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c20130890 0x7f0c20125db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:37924/0 (socket says 172.21.15.156:37924) 2023-09-30T22:23:21.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.843+0000 7f0c25178700 1 -- 172.21.15.156:0/4192423592 learned_addr learned my addr 172.21.15.156:0/4192423592 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:21.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.843+0000 7f0c1ffff700 1 --2- 172.21.15.156:0/4192423592 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c2009a730 0x7f0c20125870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.844+0000 7fa895ee4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa89009d8f0 0x7fa8901c6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.844+0000 7fa895ee4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa89009e450 0x7fa8901c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.844+0000 7fa895ee4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8901309f0 0x7fa8900993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.844+0000 7fa895ee4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89012def0 con 0x7fa89009e450 2023-09-30T22:23:21.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.844+0000 7fa895ee4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8901c65a0 con 0x7fa8901309f0 2023-09-30T22:23:21.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.844+0000 7fa895ee4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa89012d310 con 0x7fa89009d8f0 2023-09-30T22:23:21.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.844+0000 7fa88effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa89009e450 0x7fa8901c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.844+0000 7fa88effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa89009e450 0x7fa8901c6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:37928/0 (socket says 172.21.15.156:37928) 2023-09-30T22:23:21.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.844+0000 7fa88effd700 1 -- 172.21.15.156:0/1938964129 learned_addr learned my addr 172.21.15.156:0/1938964129 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:21.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.844+0000 7fa88ffff700 1 --2- 172.21.15.156:0/1938964129 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8901309f0 0x7fa8900993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.844+0000 7fa88f7fe700 1 --2- 172.21.15.156:0/1938964129 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa89009d8f0 0x7fa8901c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.844+0000 7f0c25178700 1 -- 172.21.15.156:0/4192423592 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c20099e20 msgr2=0x7f0c2013cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.844+0000 7f0c25178700 1 --2- 172.21.15.156:0/4192423592 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c20099e20 0x7f0c2013cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.844+0000 7f0c25178700 1 -- 172.21.15.156:0/4192423592 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c2009a730 msgr2=0x7f0c20125870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.844+0000 7f0c25178700 1 --2- 172.21.15.156:0/4192423592 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c2009a730 0x7f0c20125870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.844+0000 7f0c25178700 1 -- 172.21.15.156:0/4192423592 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0c009550 con 0x7f0c20130890 2023-09-30T22:23:21.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.844+0000 7f0c25178700 1 --2- 172.21.15.156:0/4192423592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c20130890 0x7f0c20125db0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800efc0 tx=0x7f0c1800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:21.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.844+0000 7f0c1d7fa700 1 -- 172.21.15.156:0/4192423592 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c18009ea0 con 0x7f0c20130890 2023-09-30T22:23:21.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.844+0000 7f0c1d7fa700 1 -- 172.21.15.156:0/4192423592 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1800f040 con 0x7f0c20130890 2023-09-30T22:23:21.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.844+0000 7f0c1d7fa700 1 -- 172.21.15.156:0/4192423592 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c18014480 con 0x7f0c20130890 2023-09-30T22:23:21.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.844+0000 7f0c26bdb700 1 -- 172.21.15.156:0/4192423592 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c20128e70 con 0x7f0c20130890 2023-09-30T22:23:21.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.845+0000 7f0c26bdb700 1 -- 172.21.15.156:0/4192423592 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c20129150 con 0x7f0c20130890 2023-09-30T22:23:21.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.845+0000 7fa88effd700 1 -- 172.21.15.156:0/1938964129 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa89009d8f0 msgr2=0x7fa8901c6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.845+0000 7fa88effd700 1 --2- 172.21.15.156:0/1938964129 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa89009d8f0 0x7fa8901c6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.845+0000 7fa88effd700 1 -- 172.21.15.156:0/1938964129 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8901309f0 msgr2=0x7fa8900993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.845+0000 7fa88effd700 1 --2- 172.21.15.156:0/1938964129 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8901309f0 0x7fa8900993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.845+0000 7fa88effd700 1 -- 172.21.15.156:0/1938964129 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa888009b30 con 0x7fa89009e450 2023-09-30T22:23:21.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.845+0000 7fa88effd700 1 --2- 172.21.15.156:0/1938964129 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa89009e450 0x7fa8901c6ea0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fa88400b4a0 tx=0x7fa88400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:21.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.845+0000 7fa877fff700 1 -- 172.21.15.156:0/1938964129 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa884011830 con 0x7fa89009e450 2023-09-30T22:23:21.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.845+0000 7f0c1d7fa700 1 -- 172.21.15.156:0/4192423592 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c180145e0 con 0x7f0c20130890 2023-09-30T22:23:21.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.845+0000 7fa895ee4700 1 -- 172.21.15.156:0/1938964129 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8900a17c0 con 0x7fa89009e450 2023-09-30T22:23:21.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.845+0000 7fa877fff700 1 -- 172.21.15.156:0/1938964129 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa884011990 con 0x7fa89009e450 2023-09-30T22:23:21.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.845+0000 7fa877fff700 1 -- 172.21.15.156:0/1938964129 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa884011d40 con 0x7fa89009e450 2023-09-30T22:23:21.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.846+0000 7fa895ee4700 1 -- 172.21.15.156:0/1938964129 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa89008ccd0 con 0x7fa89009e450 2023-09-30T22:23:21.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.846+0000 7f0c1d7fa700 1 -- 172.21.15.156:0/4192423592 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0c1803ff70 con 0x7f0c20130890 2023-09-30T22:23:21.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.846+0000 7f0c26bdb700 1 -- 172.21.15.156:0/4192423592 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c2004f2a0 con 0x7f0c20130890 2023-09-30T22:23:21.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.847+0000 7fa877fff700 1 -- 172.21.15.156:0/1938964129 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa88401a400 con 0x7fa89009e450 2023-09-30T22:23:21.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.847+0000 7fa877fff700 1 -- 172.21.15.156:0/1938964129 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa88403f600 con 0x7fa89009e450 2023-09-30T22:23:21.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.847+0000 7fa895ee4700 1 -- 172.21.15.156:0/1938964129 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8900a0ff0 con 0x7fa89009e450 2023-09-30T22:23:21.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.856+0000 7f0c1d7fa700 1 -- 172.21.15.156:0/4192423592 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c18018020 con 0x7f0c20130890 2023-09-30T22:23:21.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.864+0000 7fa877fff700 1 -- 172.21.15.156:0/1938964129 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa884015070 con 0x7fa89009e450 2023-09-30T22:23:21.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.888+0000 7f4f5526c700 1 Processor -- start 2023-09-30T22:23:21.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.889+0000 7f4f5526c700 1 -- start start 2023-09-30T22:23:21.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.889+0000 7f4f5526c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f5009d860 0x7f4f5009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.889+0000 7f4f5526c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f5009e170 0x7f4f501307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.889+0000 7f4f5526c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f5009aaa0 con 0x7f4f50130ce0 2023-09-30T22:23:21.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.889+0000 7f4f5526c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5009f870 con 0x7f4f5009d860 2023-09-30T22:23:21.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.889+0000 7f4f5526c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5009b360 con 0x7f4f5009e170 2023-09-30T22:23:21.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.890+0000 7f4f4effd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f5009d860 0x7f4f5009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.890+0000 7f4f4effd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f5009d860 0x7f4f5009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:41058/0 (socket says 172.21.15.156:41058) 2023-09-30T22:23:21.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.890+0000 7f4f4effd700 1 -- 172.21.15.156:0/758736203 learned_addr learned my addr 172.21.15.156:0/758736203 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:21.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.890+0000 7f4f467fc700 1 --2- 172.21.15.156:0/758736203 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f5009e170 0x7f4f501307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.890+0000 7f4f4effd700 1 -- 172.21.15.156:0/758736203 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f5009e170 msgr2=0x7f4f501307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:21.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.890+0000 7f4f4effd700 1 --2- 172.21.15.156:0/758736203 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f5009e170 0x7f4f501307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.890+0000 7f4f4effd700 1 -- 172.21.15.156:0/758736203 >> v1:172.21.15.156:6789/0 conn(0x7f4f50130ce0 legacy=0x7f4f501379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:21.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.890+0000 7f4f4effd700 1 -- 172.21.15.156:0/758736203 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5009b620 con 0x7f4f5009d860 2023-09-30T22:23:21.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.890+0000 7f4f4effd700 1 --2- 172.21.15.156:0/758736203 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f5009d860 0x7f4f5009dc30 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009920 tx=0x7f4f40009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e4982385ee685b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:21.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.890+0000 7f4f4e7fc700 1 -- 172.21.15.156:0/758736203 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f40004230 con 0x7f4f5009d860 2023-09-30T22:23:21.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.891+0000 7f4f4e7fc700 1 -- 172.21.15.156:0/758736203 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f40004390 con 0x7f4f5009d860 2023-09-30T22:23:21.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.891+0000 7f4f4e7fc700 1 -- 172.21.15.156:0/758736203 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f400036a0 con 0x7f4f5009d860 2023-09-30T22:23:21.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.891+0000 7f4f5526c700 1 -- 172.21.15.156:0/758736203 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f5009d860 msgr2=0x7f4f5009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.891+0000 7f4f5526c700 1 --2- 172.21.15.156:0/758736203 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f5009d860 0x7f4f5009dc30 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009920 tx=0x7f4f40009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:21.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.891+0000 7f4f5526c700 1 -- 172.21.15.156:0/758736203 shutdown_connections 2023-09-30T22:23:21.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.891+0000 7f4f5526c700 1 --2- 172.21.15.156:0/758736203 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f5009d860 0x7f4f5009dc30 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.891+0000 7f4f5526c700 1 --2- 172.21.15.156:0/758736203 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f5009e170 0x7f4f501307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.891+0000 7f4f5526c700 1 -- 172.21.15.156:0/758736203 >> 172.21.15.156:0/758736203 conn(0x7f4f50099c40 msgr2=0x7f4f500a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:21.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.892+0000 7f4f5526c700 1 -- 172.21.15.156:0/758736203 shutdown_connections 2023-09-30T22:23:21.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.892+0000 7f4f5526c700 1 -- 172.21.15.156:0/758736203 wait complete. 2023-09-30T22:23:21.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.893+0000 7f4f5526c700 1 Processor -- start 2023-09-30T22:23:21.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.893+0000 7f4f5526c700 1 -- start start 2023-09-30T22:23:21.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.894+0000 7f4f5526c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f5009d860 0x7f4f50138470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.894+0000 7f4f5526c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f5009e170 0x7f4f501389b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.894+0000 7f4f5526c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f50130ce0 0x7f4f501c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.894+0000 7f4f5526c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f50136f90 con 0x7f4f50130ce0 2023-09-30T22:23:21.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.894+0000 7f4f5526c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f50136060 con 0x7f4f5009d860 2023-09-30T22:23:21.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.894+0000 7f4f5526c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5009c8b0 con 0x7f4f5009e170 2023-09-30T22:23:21.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.894+0000 7f4f4effd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f5009d860 0x7f4f50138470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.894+0000 7f4f4effd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f5009d860 0x7f4f50138470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:41060/0 (socket says 172.21.15.156:41060) 2023-09-30T22:23:21.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.894+0000 7f4f4effd700 1 -- 172.21.15.156:0/1181924810 learned_addr learned my addr 172.21.15.156:0/1181924810 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:21.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.894+0000 7f4f467fc700 1 --2- 172.21.15.156:0/1181924810 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f5009e170 0x7f4f501389b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.894+0000 7f4f4f7fe700 1 --2- 172.21.15.156:0/1181924810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f50130ce0 0x7f4f501c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.894+0000 7f4f4effd700 1 -- 172.21.15.156:0/1181924810 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f5009e170 msgr2=0x7f4f501389b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.894+0000 7f4f4effd700 1 --2- 172.21.15.156:0/1181924810 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f5009e170 0x7f4f501389b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.894+0000 7f4f4effd700 1 -- 172.21.15.156:0/1181924810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f50130ce0 msgr2=0x7f4f501c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.894+0000 7f4f4effd700 1 --2- 172.21.15.156:0/1181924810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f50130ce0 0x7f4f501c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.894+0000 7f4f4effd700 1 -- 172.21.15.156:0/1181924810 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f40009550 con 0x7f4f5009d860 2023-09-30T22:23:21.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.895+0000 7f4f4effd700 1 --2- 172.21.15.156:0/1181924810 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f5009d860 0x7f4f50138470 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4f40000c00 tx=0x7f4f40004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:21.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.895+0000 7f4f47fff700 1 -- 172.21.15.156:0/1181924810 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f40003e60 con 0x7f4f5009d860 2023-09-30T22:23:21.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.895+0000 7f4f47fff700 1 -- 172.21.15.156:0/1181924810 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f400045d0 con 0x7f4f5009d860 2023-09-30T22:23:21.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.895+0000 7f4f5526c700 1 -- 172.21.15.156:0/1181924810 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f50136cd0 con 0x7f4f5009d860 2023-09-30T22:23:21.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.895+0000 7f4f5526c700 1 -- 172.21.15.156:0/1181924810 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f50138ef0 con 0x7f4f5009d860 2023-09-30T22:23:21.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.895+0000 7f4f47fff700 1 -- 172.21.15.156:0/1181924810 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f40011870 con 0x7f4f5009d860 2023-09-30T22:23:21.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.896+0000 7f4f47fff700 1 -- 172.21.15.156:0/1181924810 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4f40022020 con 0x7f4f5009d860 2023-09-30T22:23:21.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.896+0000 7f4f47fff700 1 -- 172.21.15.156:0/1181924810 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4f40040c80 con 0x7f4f5009d860 2023-09-30T22:23:21.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.898+0000 7f4f5526c700 1 -- 172.21.15.156:0/1181924810 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f340052e0 con 0x7f4f5009d860 2023-09-30T22:23:21.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:21.902+0000 7f4f47fff700 1 -- 172.21.15.156:0/1181924810 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4f400119d0 con 0x7f4f5009d860 2023-09-30T22:23:22.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.022+0000 7f8a08e22700 1 -- 172.21.15.156:0/2978929934 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8a0404f2a0 con 0x7f8a0409dea0 2023-09-30T22:23:22.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.023+0000 7f89f2ffd700 1 -- 172.21.15.156:0/2978929934 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f89f8017070 con 0x7f8a0409dea0 2023-09-30T22:23:22.023 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:22.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.025+0000 7f8a08e22700 1 -- 172.21.15.156:0/2978929934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a0409dea0 msgr2=0x7f8a0411a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:22.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.025+0000 7f8a08e22700 1 --2- 172.21.15.156:0/2978929934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a0409dea0 0x7f8a0411a550 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f89f800ebe0 tx=0x7f89f8009ea0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.025+0000 7f8a08e22700 1 -- 172.21.15.156:0/2978929934 shutdown_connections 2023-09-30T22:23:22.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.025+0000 7f8a08e22700 1 --2- 172.21.15.156:0/2978929934 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a04134f00 0x7f8a0411aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.025+0000 7f8a08e22700 1 --2- 172.21.15.156:0/2978929934 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a0406a770 0x7f8a04133d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.025+0000 7f8a08e22700 1 --2- 172.21.15.156:0/2978929934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a0409dea0 0x7f8a0411a550 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.025+0000 7f8a08e22700 1 -- 172.21.15.156:0/2978929934 >> 172.21.15.156:0/2978929934 conn(0x7f8a04099c40 msgr2=0x7f8a0409c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:22.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.025+0000 7f8a08e22700 1 -- 172.21.15.156:0/2978929934 shutdown_connections 2023-09-30T22:23:22.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.025+0000 7f8a08e22700 1 -- 172.21.15.156:0/2978929934 wait complete. 2023-09-30T22:23:22.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:22.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.057+0000 7f0c26bdb700 1 -- 172.21.15.156:0/4192423592 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0c2006bce0 con 0x7f0c20130890 2023-09-30T22:23:22.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.057+0000 7f0c1d7fa700 1 -- 172.21.15.156:0/4192423592 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c18011680 con 0x7f0c20130890 2023-09-30T22:23:22.058 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:22.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.059+0000 7f0c26bdb700 1 -- 172.21.15.156:0/4192423592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c20130890 msgr2=0x7f0c20125db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:22.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.059+0000 7f0c26bdb700 1 --2- 172.21.15.156:0/4192423592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c20130890 0x7f0c20125db0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800efc0 tx=0x7f0c1800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.060+0000 7f0c26bdb700 1 -- 172.21.15.156:0/4192423592 shutdown_connections 2023-09-30T22:23:22.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.060+0000 7f0c26bdb700 1 --2- 172.21.15.156:0/4192423592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c20130890 0x7f0c20125db0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.060+0000 7f0c26bdb700 1 --2- 172.21.15.156:0/4192423592 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c20099e20 0x7f0c2013cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.060+0000 7f0c26bdb700 1 --2- 172.21.15.156:0/4192423592 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c2009a730 0x7f0c20125870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.060+0000 7f0c26bdb700 1 -- 172.21.15.156:0/4192423592 >> 172.21.15.156:0/4192423592 conn(0x7f0c200a2980 msgr2=0x7f0c2009df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:22.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.060+0000 7f0c26bdb700 1 -- 172.21.15.156:0/4192423592 shutdown_connections 2023-09-30T22:23:22.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.060+0000 7f0c26bdb700 1 -- 172.21.15.156:0/4192423592 wait complete. 2023-09-30T22:23:22.072 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:22.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.088+0000 7fa895ee4700 1 -- 172.21.15.156:0/1938964129 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa890074f10 con 0x7fa89009e450 2023-09-30T22:23:22.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.089+0000 7fa877fff700 1 -- 172.21.15.156:0/1938964129 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa884028090 con 0x7fa89009e450 2023-09-30T22:23:22.089 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:22.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.090+0000 7fa895ee4700 1 -- 172.21.15.156:0/1938964129 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa89009e450 msgr2=0x7fa8901c6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:22.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.090+0000 7fa895ee4700 1 --2- 172.21.15.156:0/1938964129 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa89009e450 0x7fa8901c6ea0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fa88400b4a0 tx=0x7fa88400b7b0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.090+0000 7fa895ee4700 1 -- 172.21.15.156:0/1938964129 shutdown_connections 2023-09-30T22:23:22.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.091+0000 7fa895ee4700 1 --2- 172.21.15.156:0/1938964129 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa8901309f0 0x7fa8900993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.091+0000 7fa895ee4700 1 --2- 172.21.15.156:0/1938964129 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa89009d8f0 0x7fa8901c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.091+0000 7fa895ee4700 1 --2- 172.21.15.156:0/1938964129 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa89009e450 0x7fa8901c6ea0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.091+0000 7fa895ee4700 1 -- 172.21.15.156:0/1938964129 >> 172.21.15.156:0/1938964129 conn(0x7fa8900a2b30 msgr2=0x7fa89009fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:22.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.091+0000 7fa895ee4700 1 -- 172.21.15.156:0/1938964129 shutdown_connections 2023-09-30T22:23:22.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.091+0000 7fa895ee4700 1 -- 172.21.15.156:0/1938964129 wait complete. 2023-09-30T22:23:22.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:22.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.118+0000 7f4f5526c700 1 -- 172.21.15.156:0/1181924810 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4f34005590 con 0x7f4f5009d860 2023-09-30T22:23:22.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.118+0000 7f4f47fff700 1 -- 172.21.15.156:0/1181924810 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4f40034090 con 0x7f4f5009d860 2023-09-30T22:23:22.119 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:22.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.121+0000 7f4f5526c700 1 -- 172.21.15.156:0/1181924810 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f5009d860 msgr2=0x7f4f50138470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:22.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.121+0000 7f4f5526c700 1 --2- 172.21.15.156:0/1181924810 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f5009d860 0x7f4f50138470 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4f40000c00 tx=0x7f4f40004750 comp rx=0 tx=0).stop 2023-09-30T22:23:22.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.121+0000 7f4f5526c700 1 -- 172.21.15.156:0/1181924810 shutdown_connections 2023-09-30T22:23:22.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.121+0000 7f4f5526c700 1 --2- 172.21.15.156:0/1181924810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f50130ce0 0x7f4f501c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.121+0000 7f4f5526c700 1 --2- 172.21.15.156:0/1181924810 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f5009d860 0x7f4f50138470 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.121+0000 7f4f5526c700 1 --2- 172.21.15.156:0/1181924810 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f5009e170 0x7f4f501389b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.121+0000 7f4f5526c700 1 -- 172.21.15.156:0/1181924810 >> 172.21.15.156:0/1181924810 conn(0x7f4f50099c40 msgr2=0x7f4f50139550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:22.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.121+0000 7f4f5526c700 1 -- 172.21.15.156:0/1181924810 shutdown_connections 2023-09-30T22:23:22.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:22.121+0000 7f4f5526c700 1 -- 172.21.15.156:0/1181924810 wait complete. 2023-09-30T22:23:22.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:23.038 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:23.074 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:23.104 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:23.135 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:23.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.178+0000 7f661e052700 1 Processor -- start 2023-09-30T22:23:23.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.179+0000 7f661e052700 1 -- start start 2023-09-30T22:23:23.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.179+0000 7f661e052700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6618138040 0x7f6618138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:23.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.179+0000 7f661e052700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f66180a08e0 0x7f66180a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:23.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.179+0000 7f661e052700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66181379e0 con 0x7f66180a1230 2023-09-30T22:23:23.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.179+0000 7f661e052700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66180a2100 con 0x7f66180a08e0 2023-09-30T22:23:23.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.179+0000 7f661e052700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6618138950 con 0x7f6618138040 2023-09-30T22:23:23.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.179+0000 7f66177fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6618138040 0x7f6618138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:23.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.179+0000 7f66177fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6618138040 0x7f6618138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:41064/0 (socket says 172.21.15.156:41064) 2023-09-30T22:23:23.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.179+0000 7f66177fe700 1 -- 172.21.15.156:0/4294760350 learned_addr learned my addr 172.21.15.156:0/4294760350 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:23.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.179+0000 7f6616ffd700 1 --2- 172.21.15.156:0/4294760350 >> v2:172.21.15.156:3300/0 conn(0x7f66180a08e0 0x7f66180a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:23.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.180+0000 7f66177fe700 1 -- 172.21.15.156:0/4294760350 >> v2:172.21.15.156:3300/0 conn(0x7f66180a08e0 msgr2=0x7f66180a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:23.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.180+0000 7f66177fe700 1 --2- 172.21.15.156:0/4294760350 >> v2:172.21.15.156:3300/0 conn(0x7f66180a08e0 0x7f66180a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.180+0000 7f66177fe700 1 -- 172.21.15.156:0/4294760350 >> v1:172.21.15.156:6789/0 conn(0x7f66180a1230 legacy=0x7f661813ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:23.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.180+0000 7f66177fe700 1 -- 172.21.15.156:0/4294760350 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661809b9b0 con 0x7f6618138040 2023-09-30T22:23:23.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.180+0000 7f66177fe700 1 --2- 172.21.15.156:0/4294760350 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6618138040 0x7f6618138410 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f66080098f0 tx=0x7f6608009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ce2e25f136dc465 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:23.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.180+0000 7f66167fc700 1 -- 172.21.15.156:0/4294760350 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6608005e30 con 0x7f6618138040 2023-09-30T22:23:23.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.180+0000 7f66167fc700 1 -- 172.21.15.156:0/4294760350 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6608004030 con 0x7f6618138040 2023-09-30T22:23:23.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.180+0000 7f66167fc700 1 -- 172.21.15.156:0/4294760350 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66080043e0 con 0x7f6618138040 2023-09-30T22:23:23.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.181+0000 7f661e052700 1 -- 172.21.15.156:0/4294760350 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6618138040 msgr2=0x7f6618138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:23.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.181+0000 7f661e052700 1 --2- 172.21.15.156:0/4294760350 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6618138040 0x7f6618138410 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f66080098f0 tx=0x7f6608009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:23.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.181+0000 7f661e052700 1 -- 172.21.15.156:0/4294760350 shutdown_connections 2023-09-30T22:23:23.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.181+0000 7f661e052700 1 --2- 172.21.15.156:0/4294760350 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6618138040 0x7f6618138410 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.181+0000 7f661e052700 1 --2- 172.21.15.156:0/4294760350 >> v2:172.21.15.156:3300/0 conn(0x7f66180a08e0 0x7f66180a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.181+0000 7f661e052700 1 -- 172.21.15.156:0/4294760350 >> 172.21.15.156:0/4294760350 conn(0x7f66180a2980 msgr2=0x7f66180a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:23.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.181+0000 7f661e052700 1 -- 172.21.15.156:0/4294760350 shutdown_connections 2023-09-30T22:23:23.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.181+0000 7f661e052700 1 -- 172.21.15.156:0/4294760350 wait complete. 2023-09-30T22:23:23.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.182+0000 7f661e052700 1 Processor -- start 2023-09-30T22:23:23.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.183+0000 7f661e052700 1 -- start start 2023-09-30T22:23:23.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.183+0000 7f661e052700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66180a08e0 0x7f66181370f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:23.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.183+0000 7f661e052700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66180a1230 0x7f66181358e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:23.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.183+0000 7f661e052700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6618138040 0x7f6618135e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:23.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.183+0000 7f661e052700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661813f270 con 0x7f66180a1230 2023-09-30T22:23:23.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.183+0000 7f661e052700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661813eb60 con 0x7f66180a08e0 2023-09-30T22:23:23.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.183+0000 7f661e052700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6618130040 con 0x7f6618138040 2023-09-30T22:23:23.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.184+0000 7f66177fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66180a08e0 0x7f66181370f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:23.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.184+0000 7f6617fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6618138040 0x7f6618135e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:23.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.184+0000 7f6616ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66180a1230 0x7f66181358e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:23.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.184+0000 7f66177fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66180a08e0 0x7f66181370f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:41080/0 (socket says 172.21.15.156:41080) 2023-09-30T22:23:23.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.184+0000 7f66177fe700 1 -- 172.21.15.156:0/1456259855 learned_addr learned my addr 172.21.15.156:0/1456259855 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:23.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.184+0000 7f66177fe700 1 -- 172.21.15.156:0/1456259855 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6618138040 msgr2=0x7f6618135e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:23.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.184+0000 7f66177fe700 1 --2- 172.21.15.156:0/1456259855 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6618138040 0x7f6618135e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.184+0000 7f66177fe700 1 -- 172.21.15.156:0/1456259855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66180a1230 msgr2=0x7f66181358e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:23.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.184+0000 7f66177fe700 1 --2- 172.21.15.156:0/1456259855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66180a1230 0x7f66181358e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.184+0000 7f66177fe700 1 -- 172.21.15.156:0/1456259855 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6608009500 con 0x7f66180a08e0 2023-09-30T22:23:23.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.184+0000 7f66177fe700 1 --2- 172.21.15.156:0/1456259855 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66180a08e0 0x7f66181370f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6608014040 tx=0x7f6608004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:23.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.184+0000 7f65fffff700 1 -- 172.21.15.156:0/1456259855 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6608003ce0 con 0x7f66180a08e0 2023-09-30T22:23:23.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.185+0000 7f65fffff700 1 -- 172.21.15.156:0/1456259855 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6608003e40 con 0x7f66180a08e0 2023-09-30T22:23:23.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.185+0000 7f65fffff700 1 -- 172.21.15.156:0/1456259855 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6608011660 con 0x7f66180a08e0 2023-09-30T22:23:23.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.185+0000 7f661e052700 1 -- 172.21.15.156:0/1456259855 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f661813fad0 con 0x7f66180a08e0 2023-09-30T22:23:23.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.185+0000 7f661e052700 1 -- 172.21.15.156:0/1456259855 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f661809cb20 con 0x7f66180a08e0 2023-09-30T22:23:23.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.186+0000 7f65fffff700 1 -- 172.21.15.156:0/1456259855 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6608018070 con 0x7f66180a08e0 2023-09-30T22:23:23.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.186+0000 7f65fffff700 1 -- 172.21.15.156:0/1456259855 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f660803fe30 con 0x7f66180a08e0 2023-09-30T22:23:23.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.186+0000 7f661e052700 1 -- 172.21.15.156:0/1456259855 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f661804f2a0 con 0x7f66180a08e0 2023-09-30T22:23:23.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.195+0000 7f65fffff700 1 -- 172.21.15.156:0/1456259855 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6608029080 con 0x7f66180a08e0 2023-09-30T22:23:23.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.223+0000 7f5625066700 1 Processor -- start 2023-09-30T22:23:23.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.223+0000 7f5625066700 1 -- start start 2023-09-30T22:23:23.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.223+0000 7f5625066700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f562006a770 0x7f562006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:23.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.223+0000 7f5625066700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f562009dec0 0x7f562006b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:23.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.223+0000 7f5625066700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5620131a00 0x7f5620131e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:23.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.223+0000 7f5625066700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f562006b5c0 con 0x7f5620131a00 2023-09-30T22:23:23.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.223+0000 7f5625066700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f562006e900 con 0x7f562009dec0 2023-09-30T22:23:23.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.223+0000 7f5625066700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f562009d180 con 0x7f562006a770 2023-09-30T22:23:23.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.223+0000 7f561e59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f562009dec0 0x7f562006b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:23.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.223+0000 7f561ed9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f562006a770 0x7f562006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:23.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.223+0000 7f561e59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f562009dec0 0x7f562006b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:41086/0 (socket says 172.21.15.156:41086) 2023-09-30T22:23:23.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.223+0000 7f561e59c700 1 -- 172.21.15.156:0/2871076270 learned_addr learned my addr 172.21.15.156:0/2871076270 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:23.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.224+0000 7f561f59e700 1 --2- 172.21.15.156:0/2871076270 >> v2:172.21.15.156:3300/0 conn(0x7f5620131a00 0x7f5620131e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:23.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.224+0000 7f561ed9d700 1 -- 172.21.15.156:0/2871076270 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f562009dec0 msgr2=0x7f562006b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:23.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.224+0000 7f561ed9d700 1 --2- 172.21.15.156:0/2871076270 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f562009dec0 0x7f562006b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.224+0000 7f561ed9d700 1 -- 172.21.15.156:0/2871076270 >> v2:172.21.15.156:3300/0 conn(0x7f5620131a00 msgr2=0x7f5620131e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:23.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.224+0000 7f561ed9d700 1 --2- 172.21.15.156:0/2871076270 >> v2:172.21.15.156:3300/0 conn(0x7f5620131a00 0x7f5620131e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.224+0000 7f561ed9d700 1 -- 172.21.15.156:0/2871076270 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f562009e780 con 0x7f562006a770 2023-09-30T22:23:23.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.224+0000 7f561f59e700 1 --2- 172.21.15.156:0/2871076270 >> v2:172.21.15.156:3300/0 conn(0x7f5620131a00 0x7f5620131e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:23.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.224+0000 7f561e59c700 1 --2- 172.21.15.156:0/2871076270 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f562009dec0 0x7f562006b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:23.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.224+0000 7f561ed9d700 1 --2- 172.21.15.156:0/2871076270 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f562006a770 0x7f562006ab40 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5610009840 tx=0x7f5610009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea4e5e795502fc73 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:23.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.224+0000 7f561dd9b700 1 -- 172.21.15.156:0/2871076270 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5610011830 con 0x7f562006a770 2023-09-30T22:23:23.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.224+0000 7f561dd9b700 1 -- 172.21.15.156:0/2871076270 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5610011990 con 0x7f562006a770 2023-09-30T22:23:23.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.224+0000 7f561dd9b700 1 -- 172.21.15.156:0/2871076270 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5610011d20 con 0x7f562006a770 2023-09-30T22:23:23.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.225+0000 7f5625066700 1 -- 172.21.15.156:0/2871076270 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f562006a770 msgr2=0x7f562006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:23.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.225+0000 7f5625066700 1 --2- 172.21.15.156:0/2871076270 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f562006a770 0x7f562006ab40 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5610009840 tx=0x7f5610009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:23.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.225+0000 7f5625066700 1 -- 172.21.15.156:0/2871076270 shutdown_connections 2023-09-30T22:23:23.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.225+0000 7f5625066700 1 --2- 172.21.15.156:0/2871076270 >> v2:172.21.15.156:3300/0 conn(0x7f5620131a00 0x7f5620131e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.225+0000 7f5625066700 1 --2- 172.21.15.156:0/2871076270 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f562006a770 0x7f562006ab40 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.225+0000 7f5625066700 1 --2- 172.21.15.156:0/2871076270 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f562009dec0 0x7f562006b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.225+0000 7f5625066700 1 -- 172.21.15.156:0/2871076270 >> 172.21.15.156:0/2871076270 conn(0x7f5620099c40 msgr2=0x7f56200a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:23.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.225+0000 7f5625066700 1 -- 172.21.15.156:0/2871076270 shutdown_connections 2023-09-30T22:23:23.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.225+0000 7f5625066700 1 -- 172.21.15.156:0/2871076270 wait complete. 2023-09-30T22:23:23.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.227+0000 7f5625066700 1 Processor -- start 2023-09-30T22:23:23.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.227+0000 7f5625066700 1 -- start start 2023-09-30T22:23:23.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.227+0000 7f5625066700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f562006a770 0x7f562011c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:23.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.227+0000 7f5625066700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f562009dec0 0x7f562011c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:23.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.227+0000 7f5625066700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5620131a00 0x7f562011cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:23.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.227+0000 7f5625066700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562011e310 con 0x7f5620131a00 2023-09-30T22:23:23.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.227+0000 7f5625066700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f562011d5a0 con 0x7f562006a770 2023-09-30T22:23:23.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.227+0000 7f5625066700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f562012f4a0 con 0x7f562009dec0 2023-09-30T22:23:23.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.227+0000 7f561ed9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f562006a770 0x7f562011c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:23.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.228+0000 7f561ed9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f562006a770 0x7f562011c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:41100/0 (socket says 172.21.15.156:41100) 2023-09-30T22:23:23.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.228+0000 7f561ed9d700 1 -- 172.21.15.156:0/3282758547 learned_addr learned my addr 172.21.15.156:0/3282758547 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:23.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.228+0000 7f561e59c700 1 --2- 172.21.15.156:0/3282758547 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f562009dec0 0x7f562011c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:23.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.228+0000 7f561f59e700 1 --2- 172.21.15.156:0/3282758547 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5620131a00 0x7f562011cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:23.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.228+0000 7f561ed9d700 1 -- 172.21.15.156:0/3282758547 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f562009dec0 msgr2=0x7f562011c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:23.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.228+0000 7f561ed9d700 1 --2- 172.21.15.156:0/3282758547 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f562009dec0 0x7f562011c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.228+0000 7f561ed9d700 1 -- 172.21.15.156:0/3282758547 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5620131a00 msgr2=0x7f562011cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:23.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.228+0000 7f561ed9d700 1 --2- 172.21.15.156:0/3282758547 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5620131a00 0x7f562011cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.228+0000 7f561ed9d700 1 -- 172.21.15.156:0/3282758547 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5614009550 con 0x7f562006a770 2023-09-30T22:23:23.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.228+0000 7f561ed9d700 1 --2- 172.21.15.156:0/3282758547 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f562006a770 0x7f562011c140 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f56100090b0 tx=0x7f5610004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:23.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.228+0000 7f56077fe700 1 -- 172.21.15.156:0/3282758547 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5610004450 con 0x7f562006a770 2023-09-30T22:23:23.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.228+0000 7f56077fe700 1 -- 172.21.15.156:0/3282758547 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f561001f070 con 0x7f562006a770 2023-09-30T22:23:23.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.228+0000 7f56077fe700 1 -- 172.21.15.156:0/3282758547 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56100038c0 con 0x7f562006a770 2023-09-30T22:23:23.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.228+0000 7f5625066700 1 -- 172.21.15.156:0/3282758547 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56100094a0 con 0x7f562006a770 2023-09-30T22:23:23.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.228+0000 7f5625066700 1 -- 172.21.15.156:0/3282758547 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56201311e0 con 0x7f562006a770 2023-09-30T22:23:23.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.229+0000 7f5625066700 1 -- 172.21.15.156:0/3282758547 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f562004f2a0 con 0x7f562006a770 2023-09-30T22:23:23.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.230+0000 7f56077fe700 1 -- 172.21.15.156:0/3282758547 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5610003a20 con 0x7f562006a770 2023-09-30T22:23:23.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.230+0000 7f56077fe700 1 -- 172.21.15.156:0/3282758547 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5610021070 con 0x7f562006a770 2023-09-30T22:23:23.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.234+0000 7f56077fe700 1 -- 172.21.15.156:0/3282758547 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f56100045b0 con 0x7f562006a770 2023-09-30T22:23:23.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.260+0000 7f48dbd31700 1 Processor -- start 2023-09-30T22:23:23.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.260+0000 7f48dbd31700 1 -- start start 2023-09-30T22:23:23.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.260+0000 7f48dbd31700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48d4133ad0 0x7f48d4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:23.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.260+0000 7f48dbd31700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48d41300a0 0x7f48d41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:23.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.260+0000 7f48dbd31700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f48d41309f0 0x7f48d413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:23.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.261+0000 7f48dbd31700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48d406b2d0 con 0x7f48d41309f0 2023-09-30T22:23:23.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.261+0000 7f48dbd31700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d4133610 con 0x7f48d41300a0 2023-09-30T22:23:23.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.261+0000 7f48dbd31700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48d409a500 con 0x7f48d4133ad0 2023-09-30T22:23:23.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.261+0000 7f48d9acd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48d4133ad0 0x7f48d4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:23.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.261+0000 7f48d9acd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48d4133ad0 0x7f48d4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:50842/0 (socket says 172.21.15.156:50842) 2023-09-30T22:23:23.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.261+0000 7f48d9acd700 1 -- 172.21.15.156:0/1347197815 learned_addr learned my addr 172.21.15.156:0/1347197815 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:23.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.261+0000 7f48da2ce700 1 --2- 172.21.15.156:0/1347197815 >> v2:172.21.15.156:3300/0 conn(0x7f48d41309f0 0x7f48d413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:23.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.261+0000 7f48d9acd700 1 -- 172.21.15.156:0/1347197815 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48d41300a0 msgr2=0x7f48d41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:23.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.261+0000 7f48d9acd700 1 --2- 172.21.15.156:0/1347197815 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48d41300a0 0x7f48d41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.261+0000 7f48d9acd700 1 -- 172.21.15.156:0/1347197815 >> v2:172.21.15.156:3300/0 conn(0x7f48d41309f0 msgr2=0x7f48d413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:23.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.261+0000 7f48d9acd700 1 --2- 172.21.15.156:0/1347197815 >> v2:172.21.15.156:3300/0 conn(0x7f48d41309f0 0x7f48d413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.261+0000 7f48d9acd700 1 -- 172.21.15.156:0/1347197815 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d41338b0 con 0x7f48d4133ad0 2023-09-30T22:23:23.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.261+0000 7f48da2ce700 1 --2- 172.21.15.156:0/1347197815 >> v2:172.21.15.156:3300/0 conn(0x7f48d41309f0 0x7f48d413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:23.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.261+0000 7f48d9acd700 1 --2- 172.21.15.156:0/1347197815 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48d4133ad0 0x7f48d4133ea0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f48d00098f0 tx=0x7f48d0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=757a6b011a263209 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:23.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.261+0000 7f48d8acb700 1 -- 172.21.15.156:0/1347197815 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d0011830 con 0x7f48d4133ad0 2023-09-30T22:23:23.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.261+0000 7f48d8acb700 1 -- 172.21.15.156:0/1347197815 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d0011990 con 0x7f48d4133ad0 2023-09-30T22:23:23.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.261+0000 7f48d8acb700 1 -- 172.21.15.156:0/1347197815 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d0011d20 con 0x7f48d4133ad0 2023-09-30T22:23:23.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.262+0000 7f48dbd31700 1 -- 172.21.15.156:0/1347197815 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48d4133ad0 msgr2=0x7f48d4133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:23.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.262+0000 7f48dbd31700 1 --2- 172.21.15.156:0/1347197815 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48d4133ad0 0x7f48d4133ea0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f48d00098f0 tx=0x7f48d0009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:23.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.262+0000 7f48dbd31700 1 -- 172.21.15.156:0/1347197815 shutdown_connections 2023-09-30T22:23:23.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.262+0000 7f48dbd31700 1 --2- 172.21.15.156:0/1347197815 >> v2:172.21.15.156:3300/0 conn(0x7f48d41309f0 0x7f48d413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.262+0000 7f48dbd31700 1 --2- 172.21.15.156:0/1347197815 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48d4133ad0 0x7f48d4133ea0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.262+0000 7f48dbd31700 1 --2- 172.21.15.156:0/1347197815 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48d41300a0 0x7f48d41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.262+0000 7f48dbd31700 1 -- 172.21.15.156:0/1347197815 >> 172.21.15.156:0/1347197815 conn(0x7f48d4099c40 msgr2=0x7f48d40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:23.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.262+0000 7f48dbd31700 1 -- 172.21.15.156:0/1347197815 shutdown_connections 2023-09-30T22:23:23.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.262+0000 7f48dbd31700 1 -- 172.21.15.156:0/1347197815 wait complete. 2023-09-30T22:23:23.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.263+0000 7f48dbd31700 1 Processor -- start 2023-09-30T22:23:23.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.263+0000 7f48dbd31700 1 -- start start 2023-09-30T22:23:23.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.263+0000 7f48dbd31700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48d41300a0 0x7f48d411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:23.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.263+0000 7f48dbd31700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48d41309f0 0x7f48d411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:23.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.264+0000 7f48dbd31700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48d4133ad0 0x7f48d411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:23.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.264+0000 7f48dbd31700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d411fb10 con 0x7f48d41300a0 2023-09-30T22:23:23.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.264+0000 7f48dbd31700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d411fcf0 con 0x7f48d4133ad0 2023-09-30T22:23:23.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.264+0000 7f48dbd31700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48d412d390 con 0x7f48d41309f0 2023-09-30T22:23:23.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.264+0000 7f48d9acd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48d41300a0 0x7f48d411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:23.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.264+0000 7f48d9acd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48d41300a0 0x7f48d411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38008/0 (socket says 172.21.15.156:38008) 2023-09-30T22:23:23.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.264+0000 7f48d9acd700 1 -- 172.21.15.156:0/3858392035 learned_addr learned my addr 172.21.15.156:0/3858392035 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:23.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.264+0000 7f48d92cc700 1 --2- 172.21.15.156:0/3858392035 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48d41309f0 0x7f48d411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:23.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.264+0000 7f48da2ce700 1 --2- 172.21.15.156:0/3858392035 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48d4133ad0 0x7f48d411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:23.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.264+0000 7f48d9acd700 1 -- 172.21.15.156:0/3858392035 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48d41309f0 msgr2=0x7f48d411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:23.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.264+0000 7f48d9acd700 1 --2- 172.21.15.156:0/3858392035 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48d41309f0 0x7f48d411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.264+0000 7f48d9acd700 1 -- 172.21.15.156:0/3858392035 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48d4133ad0 msgr2=0x7f48d411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:23.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.264+0000 7f48d9acd700 1 --2- 172.21.15.156:0/3858392035 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48d4133ad0 0x7f48d411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.264+0000 7f48d9acd700 1 -- 172.21.15.156:0/3858392035 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48cc009a70 con 0x7f48d41300a0 2023-09-30T22:23:23.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.264+0000 7f48da2ce700 1 --2- 172.21.15.156:0/3858392035 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48d4133ad0 0x7f48d411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:23.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.264+0000 7f48d9acd700 1 --2- 172.21.15.156:0/3858392035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48d41300a0 0x7f48d411da40 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f48d409a640 tx=0x7f48d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:23.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.264+0000 7f48ca7fc700 1 -- 172.21.15.156:0/3858392035 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d0004510 con 0x7f48d41300a0 2023-09-30T22:23:23.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.264+0000 7f48ca7fc700 1 -- 172.21.15.156:0/3858392035 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d00036a0 con 0x7f48d41300a0 2023-09-30T22:23:23.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.264+0000 7f48ca7fc700 1 -- 172.21.15.156:0/3858392035 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d0003a50 con 0x7f48d41300a0 2023-09-30T22:23:23.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.264+0000 7f48dbd31700 1 -- 172.21.15.156:0/3858392035 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48d0009550 con 0x7f48d41300a0 2023-09-30T22:23:23.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.264+0000 7f48dbd31700 1 -- 172.21.15.156:0/3858392035 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d412fdc0 con 0x7f48d41300a0 2023-09-30T22:23:23.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.265+0000 7f48ca7fc700 1 -- 172.21.15.156:0/3858392035 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f48d0003bb0 con 0x7f48d41300a0 2023-09-30T22:23:23.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.266+0000 7f48dbd31700 1 -- 172.21.15.156:0/3858392035 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48d412dd60 con 0x7f48d41300a0 2023-09-30T22:23:23.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.266+0000 7f48ca7fc700 1 -- 172.21.15.156:0/3858392035 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f48d0040b20 con 0x7f48d41300a0 2023-09-30T22:23:23.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.275+0000 7f48ca7fc700 1 -- 172.21.15.156:0/3858392035 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f48d0003e60 con 0x7f48d41300a0 2023-09-30T22:23:23.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.350+0000 7fef4805c700 1 Processor -- start 2023-09-30T22:23:23.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.350+0000 7fef4805c700 1 -- start start 2023-09-30T22:23:23.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.351+0000 7fef4805c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fef400a1550 0x7fef40138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:23.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.351+0000 7fef4805c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef40139200 0x7fef4013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:23.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.351+0000 7fef4805c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef4009e9d0 con 0x7fef400a0a70 2023-09-30T22:23:23.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.351+0000 7fef4805c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef4009dc00 con 0x7fef400a1550 2023-09-30T22:23:23.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.351+0000 7fef4805c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef4009dec0 con 0x7fef40139200 2023-09-30T22:23:23.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.351+0000 7fef465f9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef40139200 0x7fef4013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:23.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.351+0000 7fef45df8700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fef400a0a70 0x7fef400a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49702/0 (socket says 172.21.15.156:49702) 2023-09-30T22:23:23.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.351+0000 7fef455f7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fef400a1550 0x7fef40138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:23.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.351+0000 7fef45df8700 1 -- 172.21.15.156:0/1284311859 learned_addr learned my addr 172.21.15.156:0/1284311859 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:23.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.352+0000 7fef44df6700 1 -- 172.21.15.156:0/1284311859 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 394791362 0 0) 0x7fef4009e9d0 con 0x7fef400a0a70 2023-09-30T22:23:23.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.352+0000 7fef455f7700 1 -- 172.21.15.156:0/1284311859 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef40139200 msgr2=0x7fef4013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:23.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.352+0000 7fef455f7700 1 --2- 172.21.15.156:0/1284311859 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef40139200 0x7fef4013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.352+0000 7fef455f7700 1 -- 172.21.15.156:0/1284311859 >> v1:172.21.15.156:6789/0 conn(0x7fef400a0a70 legacy=0x7fef400a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:23.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.352+0000 7fef455f7700 1 -- 172.21.15.156:0/1284311859 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4009e6a0 con 0x7fef400a1550 2023-09-30T22:23:23.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.352+0000 7fef455f7700 1 --2- 172.21.15.156:0/1284311859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef400a1550 0x7fef40138cc0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fef30009840 tx=0x7fef30009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=273041db85a70772 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:23.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.352+0000 7fef44df6700 1 -- 172.21.15.156:0/1284311859 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef30011830 con 0x7fef400a1550 2023-09-30T22:23:23.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.352+0000 7fef44df6700 1 -- 172.21.15.156:0/1284311859 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef30011990 con 0x7fef400a1550 2023-09-30T22:23:23.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.352+0000 7fef44df6700 1 -- 172.21.15.156:0/1284311859 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef30011d20 con 0x7fef400a1550 2023-09-30T22:23:23.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.353+0000 7fef4805c700 1 -- 172.21.15.156:0/1284311859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef400a1550 msgr2=0x7fef40138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:23.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.353+0000 7fef4805c700 1 --2- 172.21.15.156:0/1284311859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef400a1550 0x7fef40138cc0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fef30009840 tx=0x7fef30009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:23.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.353+0000 7fef4805c700 1 -- 172.21.15.156:0/1284311859 shutdown_connections 2023-09-30T22:23:23.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.353+0000 7fef4805c700 1 --2- 172.21.15.156:0/1284311859 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef40139200 0x7fef4013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.353+0000 7fef4805c700 1 --2- 172.21.15.156:0/1284311859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef400a1550 0x7fef40138cc0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.353+0000 7fef4805c700 1 -- 172.21.15.156:0/1284311859 >> 172.21.15.156:0/1284311859 conn(0x7fef400a6610 msgr2=0x7fef400a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:23.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.353+0000 7fef4805c700 1 -- 172.21.15.156:0/1284311859 shutdown_connections 2023-09-30T22:23:23.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.353+0000 7fef4805c700 1 -- 172.21.15.156:0/1284311859 wait complete. 2023-09-30T22:23:23.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.354+0000 7fef4805c700 1 Processor -- start 2023-09-30T22:23:23.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.355+0000 7fef4805c700 1 -- start start 2023-09-30T22:23:23.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.355+0000 7fef4805c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef400a0a70 0x7fef401207c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:23.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.355+0000 7fef4805c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef400a1550 0x7fef40120d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:23.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.355+0000 7fef4805c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef40139200 0x7fef40121240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:23.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.355+0000 7fef4805c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef401360a0 con 0x7fef400a1550 2023-09-30T22:23:23.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.355+0000 7fef4805c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef40136660 con 0x7fef400a0a70 2023-09-30T22:23:23.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.355+0000 7fef4805c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef40124290 con 0x7fef40139200 2023-09-30T22:23:23.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.355+0000 7fef45df8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef400a0a70 0x7fef401207c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:23.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.355+0000 7fef45df8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef400a0a70 0x7fef401207c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:41120/0 (socket says 172.21.15.156:41120) 2023-09-30T22:23:23.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.355+0000 7fef45df8700 1 -- 172.21.15.156:0/1469989618 learned_addr learned my addr 172.21.15.156:0/1469989618 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:23.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.355+0000 7fef465f9700 1 --2- 172.21.15.156:0/1469989618 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef40139200 0x7fef40121240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:23.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.355+0000 7fef455f7700 1 --2- 172.21.15.156:0/1469989618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef400a1550 0x7fef40120d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:23.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.356+0000 7fef45df8700 1 -- 172.21.15.156:0/1469989618 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef40139200 msgr2=0x7fef40121240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:23.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.356+0000 7fef45df8700 1 --2- 172.21.15.156:0/1469989618 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef40139200 0x7fef40121240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.356+0000 7fef45df8700 1 -- 172.21.15.156:0/1469989618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef400a1550 msgr2=0x7fef40120d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:23.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.356+0000 7fef45df8700 1 --2- 172.21.15.156:0/1469989618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef400a1550 0x7fef40120d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.356+0000 7fef45df8700 1 -- 172.21.15.156:0/1469989618 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef300094a0 con 0x7fef400a0a70 2023-09-30T22:23:23.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.356+0000 7fef465f9700 1 --2- 172.21.15.156:0/1469989618 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef40139200 0x7fef40121240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:23.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.356+0000 7fef45df8700 1 --2- 172.21.15.156:0/1469989618 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef400a0a70 0x7fef401207c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fef3c00c520 tx=0x7fef3c00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:23.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.356+0000 7fef367fc700 1 -- 172.21.15.156:0/1469989618 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c004c80 con 0x7fef400a0a70 2023-09-30T22:23:23.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.356+0000 7fef367fc700 1 -- 172.21.15.156:0/1469989618 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3c004de0 con 0x7fef400a0a70 2023-09-30T22:23:23.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.356+0000 7fef4805c700 1 -- 172.21.15.156:0/1469989618 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef400a5100 con 0x7fef400a0a70 2023-09-30T22:23:23.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.356+0000 7fef367fc700 1 -- 172.21.15.156:0/1469989618 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c007310 con 0x7fef400a0a70 2023-09-30T22:23:23.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.356+0000 7fef4805c700 1 -- 172.21.15.156:0/1469989618 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef40122b80 con 0x7fef400a0a70 2023-09-30T22:23:23.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.357+0000 7fef367fc700 1 -- 172.21.15.156:0/1469989618 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef3c007470 con 0x7fef400a0a70 2023-09-30T22:23:23.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.357+0000 7fef367fc700 1 -- 172.21.15.156:0/1469989618 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fef3c03f3b0 con 0x7fef400a0a70 2023-09-30T22:23:23.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.357+0000 7fef4805c700 1 -- 172.21.15.156:0/1469989618 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef4004f2a0 con 0x7fef400a0a70 2023-09-30T22:23:23.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.362+0000 7fef367fc700 1 -- 172.21.15.156:0/1469989618 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef3c0123b0 con 0x7fef400a0a70 2023-09-30T22:23:23.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.443+0000 7f5625066700 1 -- 172.21.15.156:0/3282758547 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f562011ef10 con 0x7f562006a770 2023-09-30T22:23:23.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.443+0000 7f56077fe700 1 -- 172.21.15.156:0/3282758547 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5610034090 con 0x7f562006a770 2023-09-30T22:23:23.444 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:23.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.445+0000 7f5625066700 1 -- 172.21.15.156:0/3282758547 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f562006a770 msgr2=0x7f562011c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:23.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.445+0000 7f5625066700 1 --2- 172.21.15.156:0/3282758547 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f562006a770 0x7f562011c140 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f56100090b0 tx=0x7f5610004750 comp rx=0 tx=0).stop 2023-09-30T22:23:23.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.446+0000 7f5625066700 1 -- 172.21.15.156:0/3282758547 shutdown_connections 2023-09-30T22:23:23.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.446+0000 7f5625066700 1 --2- 172.21.15.156:0/3282758547 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5620131a00 0x7f562011cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.446+0000 7f5625066700 1 --2- 172.21.15.156:0/3282758547 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f562006a770 0x7f562011c140 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.446+0000 7f5625066700 1 --2- 172.21.15.156:0/3282758547 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f562009dec0 0x7f562011c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.446+0000 7f5625066700 1 -- 172.21.15.156:0/3282758547 >> 172.21.15.156:0/3282758547 conn(0x7f5620099c40 msgr2=0x7f56201b8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:23.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.446+0000 7f5625066700 1 -- 172.21.15.156:0/3282758547 shutdown_connections 2023-09-30T22:23:23.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.446+0000 7f5625066700 1 -- 172.21.15.156:0/3282758547 wait complete. 2023-09-30T22:23:23.459 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:23.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.476+0000 7f48dbd31700 1 -- 172.21.15.156:0/3858392035 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f48d404f2a0 con 0x7f48d41300a0 2023-09-30T22:23:23.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.476+0000 7f48ca7fc700 1 -- 172.21.15.156:0/3858392035 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f48d0015070 con 0x7f48d41300a0 2023-09-30T22:23:23.477 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:23.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.478+0000 7f48dbd31700 1 -- 172.21.15.156:0/3858392035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48d41300a0 msgr2=0x7f48d411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:23.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.478+0000 7f48dbd31700 1 --2- 172.21.15.156:0/3858392035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48d41300a0 0x7f48d411da40 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f48d409a640 tx=0x7f48d0004750 comp rx=0 tx=0).stop 2023-09-30T22:23:23.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.478+0000 7f48dbd31700 1 -- 172.21.15.156:0/3858392035 shutdown_connections 2023-09-30T22:23:23.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.478+0000 7f48dbd31700 1 --2- 172.21.15.156:0/3858392035 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48d4133ad0 0x7f48d411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.478+0000 7f48dbd31700 1 --2- 172.21.15.156:0/3858392035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48d41300a0 0x7f48d411da40 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.478+0000 7f48dbd31700 1 --2- 172.21.15.156:0/3858392035 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48d41309f0 0x7f48d411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.478+0000 7f48dbd31700 1 -- 172.21.15.156:0/3858392035 >> 172.21.15.156:0/3858392035 conn(0x7f48d4099c40 msgr2=0x7f48d40a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:23.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.479+0000 7f48dbd31700 1 -- 172.21.15.156:0/3858392035 shutdown_connections 2023-09-30T22:23:23.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.480+0000 7f48dbd31700 1 -- 172.21.15.156:0/3858392035 wait complete. 2023-09-30T22:23:23.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.488+0000 7f661e052700 1 -- 172.21.15.156:0/1456259855 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6618118ff0 con 0x7f66180a08e0 2023-09-30T22:23:23.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.489+0000 7f65fffff700 1 -- 172.21.15.156:0/1456259855 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6608016020 con 0x7f66180a08e0 2023-09-30T22:23:23.490 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:23.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:23.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.492+0000 7f661e052700 1 -- 172.21.15.156:0/1456259855 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66180a08e0 msgr2=0x7f66181370f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:23.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.492+0000 7f661e052700 1 --2- 172.21.15.156:0/1456259855 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66180a08e0 0x7f66181370f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6608014040 tx=0x7f6608004750 comp rx=0 tx=0).stop 2023-09-30T22:23:23.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.492+0000 7f661e052700 1 -- 172.21.15.156:0/1456259855 shutdown_connections 2023-09-30T22:23:23.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.492+0000 7f661e052700 1 --2- 172.21.15.156:0/1456259855 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6618138040 0x7f6618135e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.492+0000 7f661e052700 1 --2- 172.21.15.156:0/1456259855 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66180a08e0 0x7f66181370f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.492+0000 7f661e052700 1 --2- 172.21.15.156:0/1456259855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66180a1230 0x7f66181358e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.492+0000 7f661e052700 1 -- 172.21.15.156:0/1456259855 >> 172.21.15.156:0/1456259855 conn(0x7f66180a2980 msgr2=0x7f6618071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:23.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.492+0000 7f661e052700 1 -- 172.21.15.156:0/1456259855 shutdown_connections 2023-09-30T22:23:23.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.492+0000 7f661e052700 1 -- 172.21.15.156:0/1456259855 wait complete. 2023-09-30T22:23:23.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:23.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.584+0000 7fef4805c700 1 -- 172.21.15.156:0/1469989618 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fef40124070 con 0x7fef400a0a70 2023-09-30T22:23:23.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.585+0000 7fef367fc700 1 -- 172.21.15.156:0/1469989618 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef3c0102c0 con 0x7fef400a0a70 2023-09-30T22:23:23.585 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:23.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.587+0000 7fef4805c700 1 -- 172.21.15.156:0/1469989618 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef400a0a70 msgr2=0x7fef401207c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:23.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.587+0000 7fef4805c700 1 --2- 172.21.15.156:0/1469989618 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef400a0a70 0x7fef401207c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fef3c00c520 tx=0x7fef3c00c830 comp rx=0 tx=0).stop 2023-09-30T22:23:23.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.587+0000 7fef4805c700 1 -- 172.21.15.156:0/1469989618 shutdown_connections 2023-09-30T22:23:23.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.587+0000 7fef4805c700 1 --2- 172.21.15.156:0/1469989618 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef40139200 0x7fef40121240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.587+0000 7fef4805c700 1 --2- 172.21.15.156:0/1469989618 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef400a0a70 0x7fef401207c0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.587+0000 7fef4805c700 1 --2- 172.21.15.156:0/1469989618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef400a1550 0x7fef40120d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.587+0000 7fef4805c700 1 -- 172.21.15.156:0/1469989618 >> 172.21.15.156:0/1469989618 conn(0x7fef400a6610 msgr2=0x7fef400a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:23.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.587+0000 7fef4805c700 1 -- 172.21.15.156:0/1469989618 shutdown_connections 2023-09-30T22:23:23.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:23.587+0000 7fef4805c700 1 -- 172.21.15.156:0/1469989618 wait complete. 2023-09-30T22:23:23.599 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:24.460 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:24.493 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:24.510 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:24.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.592+0000 7f681902f700 1 Processor -- start 2023-09-30T22:23:24.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.592+0000 7f681902f700 1 -- start start 2023-09-30T22:23:24.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.592+0000 7f681902f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f681409e870 0x7f681409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.592+0000 7f681902f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f681409f180 0x7f6814133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.592+0000 7f681902f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f681409fa00 con 0x7f6814134160 2023-09-30T22:23:24.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.592+0000 7f681902f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68140a0370 con 0x7f681409e870 2023-09-30T22:23:24.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.592+0000 7f681902f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f681406bec0 con 0x7f681409f180 2023-09-30T22:23:24.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.592+0000 7f6812d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f681409e870 0x7f681409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.592+0000 7f681359e700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6814134160 0x7f681413ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49704/0 (socket says 172.21.15.156:49704) 2023-09-30T22:23:24.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.592+0000 7f681359e700 1 -- 172.21.15.156:0/3688353349 learned_addr learned my addr 172.21.15.156:0/3688353349 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:24.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.592+0000 7f681259c700 1 --2- 172.21.15.156:0/3688353349 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f681409f180 0x7f6814133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.593+0000 7f681259c700 1 -- 172.21.15.156:0/3688353349 >> v2:172.21.15.156:3300/0 conn(0x7f681409e870 msgr2=0x7f681409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:24.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.593+0000 7f681259c700 1 --2- 172.21.15.156:0/3688353349 >> v2:172.21.15.156:3300/0 conn(0x7f681409e870 0x7f681409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.593+0000 7f681259c700 1 -- 172.21.15.156:0/3688353349 >> v1:172.21.15.156:6789/0 conn(0x7f6814134160 legacy=0x7f681413ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.593+0000 7f681259c700 1 -- 172.21.15.156:0/3688353349 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681409ada0 con 0x7f681409f180 2023-09-30T22:23:24.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.593+0000 7f6812d9d700 1 --2- 172.21.15.156:0/3688353349 >> v2:172.21.15.156:3300/0 conn(0x7f681409e870 0x7f681409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:24.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.593+0000 7f681259c700 1 --2- 172.21.15.156:0/3688353349 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f681409f180 0x7f6814133c20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6808009840 tx=0x7f6808009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b2aeaadd0804469 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:24.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.593+0000 7f6811d9b700 1 -- 172.21.15.156:0/3688353349 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808011830 con 0x7f681409f180 2023-09-30T22:23:24.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.593+0000 7f6811d9b700 1 -- 172.21.15.156:0/3688353349 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6808011990 con 0x7f681409f180 2023-09-30T22:23:24.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.593+0000 7f6811d9b700 1 -- 172.21.15.156:0/3688353349 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808011d20 con 0x7f681409f180 2023-09-30T22:23:24.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.594+0000 7f681902f700 1 -- 172.21.15.156:0/3688353349 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f681409f180 msgr2=0x7f6814133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.594+0000 7f681902f700 1 --2- 172.21.15.156:0/3688353349 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f681409f180 0x7f6814133c20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6808009840 tx=0x7f6808009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:24.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.594+0000 7f681902f700 1 -- 172.21.15.156:0/3688353349 shutdown_connections 2023-09-30T22:23:24.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.594+0000 7f681902f700 1 --2- 172.21.15.156:0/3688353349 >> v2:172.21.15.156:3300/0 conn(0x7f681409e870 0x7f681409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.594+0000 7f681902f700 1 --2- 172.21.15.156:0/3688353349 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f681409f180 0x7f6814133c20 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.594+0000 7f681902f700 1 -- 172.21.15.156:0/3688353349 >> 172.21.15.156:0/3688353349 conn(0x7f68140a4430 msgr2=0x7f68140a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:24.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.594+0000 7f681902f700 1 -- 172.21.15.156:0/3688353349 shutdown_connections 2023-09-30T22:23:24.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.594+0000 7f681902f700 1 -- 172.21.15.156:0/3688353349 wait complete. 2023-09-30T22:23:24.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.596+0000 7f681902f700 1 Processor -- start 2023-09-30T22:23:24.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.596+0000 7f681902f700 1 -- start start 2023-09-30T22:23:24.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.596+0000 7f681902f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f681409e870 0x7f681411ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.596+0000 7f681902f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f681409f180 0x7f681411f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.596+0000 7f681902f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6814134160 0x7f681411f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.596+0000 7f681902f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68141332f0 con 0x7f681409f180 2023-09-30T22:23:24.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.596+0000 7f681902f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f681406cfa0 con 0x7f6814134160 2023-09-30T22:23:24.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.596+0000 7f681902f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6814120b60 con 0x7f681409e870 2023-09-30T22:23:24.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.596+0000 7f681259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f681409f180 0x7f681411f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.596+0000 7f681259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f681409f180 0x7f681411f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38038/0 (socket says 172.21.15.156:38038) 2023-09-30T22:23:24.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.596+0000 7f681259c700 1 -- 172.21.15.156:0/3378015345 learned_addr learned my addr 172.21.15.156:0/3378015345 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:24.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.597+0000 7f6812d9d700 1 --2- 172.21.15.156:0/3378015345 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f681409e870 0x7f681411ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.597+0000 7f681359e700 1 --2- 172.21.15.156:0/3378015345 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6814134160 0x7f681411f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.597+0000 7f681259c700 1 -- 172.21.15.156:0/3378015345 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f681409e870 msgr2=0x7f681411ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.597+0000 7f681259c700 1 --2- 172.21.15.156:0/3378015345 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f681409e870 0x7f681411ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.597+0000 7f681259c700 1 -- 172.21.15.156:0/3378015345 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6814134160 msgr2=0x7f681411f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.597+0000 7f681259c700 1 --2- 172.21.15.156:0/3378015345 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6814134160 0x7f681411f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.597+0000 7f681259c700 1 -- 172.21.15.156:0/3378015345 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68040094a0 con 0x7f681409f180 2023-09-30T22:23:24.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.597+0000 7f681259c700 1 --2- 172.21.15.156:0/3378015345 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f681409f180 0x7f681411f010 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f68080090b0 tx=0x7f6808004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:24.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.597+0000 7f67fb7fe700 1 -- 172.21.15.156:0/3378015345 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68080036a0 con 0x7f681409f180 2023-09-30T22:23:24.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.597+0000 7f67fb7fe700 1 -- 172.21.15.156:0/3378015345 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680801f070 con 0x7f681409f180 2023-09-30T22:23:24.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.597+0000 7f681902f700 1 -- 172.21.15.156:0/3378015345 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68080094a0 con 0x7f681409f180 2023-09-30T22:23:24.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.597+0000 7f67fb7fe700 1 -- 172.21.15.156:0/3378015345 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808003a60 con 0x7f681409f180 2023-09-30T22:23:24.601 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:24.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.598+0000 7f681902f700 1 -- 172.21.15.156:0/3378015345 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6814121ee0 con 0x7f681409f180 2023-09-30T22:23:24.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.598+0000 7f67fb7fe700 1 -- 172.21.15.156:0/3378015345 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6808003bc0 con 0x7f681409f180 2023-09-30T22:23:24.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.598+0000 7f67fb7fe700 1 -- 172.21.15.156:0/3378015345 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6808021070 con 0x7f681409f180 2023-09-30T22:23:24.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.599+0000 7f681902f700 1 -- 172.21.15.156:0/3378015345 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f681404f2a0 con 0x7f681409f180 2023-09-30T22:23:24.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.608+0000 7f67fb7fe700 1 -- 172.21.15.156:0/3378015345 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6808015020 con 0x7f681409f180 2023-09-30T22:23:24.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.637+0000 7fb8863cd700 1 Processor -- start 2023-09-30T22:23:24.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.637+0000 7fb8863cd700 1 -- start start 2023-09-30T22:23:24.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.638+0000 7fb8863cd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb880138410 0x7fb8800a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.638+0000 7fb8863cd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb88013dd10 0x7fb8801400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.638+0000 7fb8863cd700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8801379e0 con 0x7fb880138040 2023-09-30T22:23:24.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.638+0000 7fb8863cd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8800a2100 con 0x7fb880138410 2023-09-30T22:23:24.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.638+0000 7fb8863cd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb88009b9b0 con 0x7fb88013dd10 2023-09-30T22:23:24.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.638+0000 7fb87f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb880138410 0x7fb8800a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.638+0000 7fb87f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb880138410 0x7fb8800a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:41140/0 (socket says 172.21.15.156:41140) 2023-09-30T22:23:24.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.638+0000 7fb87f7fe700 1 -- 172.21.15.156:0/2775156087 learned_addr learned my addr 172.21.15.156:0/2775156087 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:24.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.638+0000 7fb88496a700 1 --2- 172.21.15.156:0/2775156087 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb88013dd10 0x7fb8801400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.638+0000 7fb87effd700 1 -- 172.21.15.156:0/2775156087 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058001539 0 0) 0x7fb8801379e0 con 0x7fb880138040 2023-09-30T22:23:24.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.638+0000 7fb87f7fe700 1 -- 172.21.15.156:0/2775156087 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb88013dd10 msgr2=0x7fb8801400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:24.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.638+0000 7fb87f7fe700 1 --2- 172.21.15.156:0/2775156087 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb88013dd10 0x7fb8801400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.638+0000 7fb87f7fe700 1 -- 172.21.15.156:0/2775156087 >> v1:172.21.15.156:6789/0 conn(0x7fb880138040 legacy=0x7fb8800a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.638+0000 7fb87f7fe700 1 -- 172.21.15.156:0/2775156087 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb880137c10 con 0x7fb880138410 2023-09-30T22:23:24.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.638+0000 7fb87f7fe700 1 --2- 172.21.15.156:0/2775156087 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb880138410 0x7fb8800a0ff0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fb874009920 tx=0x7fb874009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3daafcffd2e4e48e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:24.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.639+0000 7fb87effd700 1 -- 172.21.15.156:0/2775156087 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874011830 con 0x7fb880138410 2023-09-30T22:23:24.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.639+0000 7fb87effd700 1 -- 172.21.15.156:0/2775156087 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb874011990 con 0x7fb880138410 2023-09-30T22:23:24.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.639+0000 7fb87effd700 1 -- 172.21.15.156:0/2775156087 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874011d20 con 0x7fb880138410 2023-09-30T22:23:24.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.639+0000 7fb8863cd700 1 -- 172.21.15.156:0/2775156087 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb880138410 msgr2=0x7fb8800a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.639+0000 7fb8863cd700 1 --2- 172.21.15.156:0/2775156087 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb880138410 0x7fb8800a0ff0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fb874009920 tx=0x7fb874009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:24.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.639+0000 7fb8863cd700 1 -- 172.21.15.156:0/2775156087 shutdown_connections 2023-09-30T22:23:24.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.639+0000 7fb8863cd700 1 --2- 172.21.15.156:0/2775156087 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb88013dd10 0x7fb8801400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.639+0000 7fb8863cd700 1 --2- 172.21.15.156:0/2775156087 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb880138410 0x7fb8800a0ff0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.639+0000 7fb8863cd700 1 -- 172.21.15.156:0/2775156087 >> 172.21.15.156:0/2775156087 conn(0x7fb8800a2980 msgr2=0x7fb8800a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:24.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.639+0000 7fb8863cd700 1 -- 172.21.15.156:0/2775156087 shutdown_connections 2023-09-30T22:23:24.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.639+0000 7fb8863cd700 1 -- 172.21.15.156:0/2775156087 wait complete. 2023-09-30T22:23:24.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.640+0000 7fb8863cd700 1 Processor -- start 2023-09-30T22:23:24.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.641+0000 7fb8863cd700 1 -- start start 2023-09-30T22:23:24.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.641+0000 7fb8863cd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb880138040 0x7fb880121600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.641+0000 7fb8863cd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb880138410 0x7fb880121b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.641+0000 7fb8863cd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb88013dd10 0x7fb880122080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.641+0000 7fb8863cd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8801235d0 con 0x7fb880138040 2023-09-30T22:23:24.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.641+0000 7fb8863cd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb880122fa0 con 0x7fb880138410 2023-09-30T22:23:24.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.641+0000 7fb8863cd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8801241f0 con 0x7fb88013dd10 2023-09-30T22:23:24.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.641+0000 7fb87ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb880138040 0x7fb880121600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.641+0000 7fb87f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb880138410 0x7fb880121b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.641+0000 7fb87ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb880138040 0x7fb880121600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38042/0 (socket says 172.21.15.156:38042) 2023-09-30T22:23:24.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.641+0000 7fb87ffff700 1 -- 172.21.15.156:0/2511390886 learned_addr learned my addr 172.21.15.156:0/2511390886 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:24.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.641+0000 7fb87f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb880138410 0x7fb880121b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:41154/0 (socket says 172.21.15.156:41154) 2023-09-30T22:23:24.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.641+0000 7fb88496a700 1 --2- 172.21.15.156:0/2511390886 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb88013dd10 0x7fb880122080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.642+0000 7fb87f7fe700 1 -- 172.21.15.156:0/2511390886 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb88013dd10 msgr2=0x7fb880122080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.642+0000 7fb87f7fe700 1 --2- 172.21.15.156:0/2511390886 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb88013dd10 0x7fb880122080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.642+0000 7fb87f7fe700 1 -- 172.21.15.156:0/2511390886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb880138040 msgr2=0x7fb880121600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.642+0000 7fb87f7fe700 1 --2- 172.21.15.156:0/2511390886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb880138040 0x7fb880121600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.642+0000 7fb87f7fe700 1 -- 172.21.15.156:0/2511390886 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb874009550 con 0x7fb880138410 2023-09-30T22:23:24.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.642+0000 7fb87ffff700 1 --2- 172.21.15.156:0/2511390886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb880138040 0x7fb880121600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:24.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.642+0000 7fb87f7fe700 1 --2- 172.21.15.156:0/2511390886 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb880138410 0x7fb880121b40 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb874016000 tx=0x7fb874004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:24.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.642+0000 7fb87cff9700 1 -- 172.21.15.156:0/2511390886 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874004450 con 0x7fb880138410 2023-09-30T22:23:24.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.642+0000 7fb87cff9700 1 -- 172.21.15.156:0/2511390886 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87401e070 con 0x7fb880138410 2023-09-30T22:23:24.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.642+0000 7fb8863cd700 1 -- 172.21.15.156:0/2511390886 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb880124bd0 con 0x7fb880138410 2023-09-30T22:23:24.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.642+0000 7fb87cff9700 1 -- 172.21.15.156:0/2511390886 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8740038e0 con 0x7fb880138410 2023-09-30T22:23:24.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.642+0000 7fb8863cd700 1 -- 172.21.15.156:0/2511390886 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb88009a240 con 0x7fb880138410 2023-09-30T22:23:24.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.643+0000 7fb87cff9700 1 -- 172.21.15.156:0/2511390886 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb874003a40 con 0x7fb880138410 2023-09-30T22:23:24.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.643+0000 7fb8863cd700 1 -- 172.21.15.156:0/2511390886 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb88004f2a0 con 0x7fb880138410 2023-09-30T22:23:24.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.643+0000 7fb87cff9700 1 -- 172.21.15.156:0/2511390886 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb874040490 con 0x7fb880138410 2023-09-30T22:23:24.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.648+0000 7fb87cff9700 1 -- 172.21.15.156:0/2511390886 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb87401a420 con 0x7fb880138410 2023-09-30T22:23:24.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.710+0000 7f1b6d3b9700 1 Processor -- start 2023-09-30T22:23:24.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.710+0000 7f1b6d3b9700 1 -- start start 2023-09-30T22:23:24.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.711+0000 7f1b6d3b9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b6809d860 0x7f1b6809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.711+0000 7f1b6d3b9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b6809e170 0x7f1b681307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.711+0000 7f1b6d3b9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b6809aaa0 con 0x7f1b68130ce0 2023-09-30T22:23:24.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.711+0000 7f1b6d3b9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6809f870 con 0x7f1b6809e170 2023-09-30T22:23:24.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.711+0000 7f1b6d3b9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6809b360 con 0x7f1b6809d860 2023-09-30T22:23:24.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.711+0000 7f1b667fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b6809e170 0x7f1b681307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.711+0000 7f1b667fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b6809e170 0x7f1b681307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:41164/0 (socket says 172.21.15.156:41164) 2023-09-30T22:23:24.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.711+0000 7f1b667fc700 1 -- 172.21.15.156:0/103869835 learned_addr learned my addr 172.21.15.156:0/103869835 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:24.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.711+0000 7f1b66ffd700 1 --2- 172.21.15.156:0/103869835 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b6809d860 0x7f1b6809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.712+0000 7f1b667fc700 1 -- 172.21.15.156:0/103869835 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b6809d860 msgr2=0x7f1b6809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:24.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.712+0000 7f1b65ffb700 1 -- 172.21.15.156:0/103869835 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1200273946 0 0) 0x7f1b6809aaa0 con 0x7f1b68130ce0 2023-09-30T22:23:24.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.712+0000 7f1b667fc700 1 --2- 172.21.15.156:0/103869835 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b6809d860 0x7f1b6809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.712+0000 7f1b667fc700 1 -- 172.21.15.156:0/103869835 >> v1:172.21.15.156:6789/0 conn(0x7f1b68130ce0 legacy=0x7f1b681379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.712+0000 7f1b667fc700 1 -- 172.21.15.156:0/103869835 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6809b620 con 0x7f1b6809e170 2023-09-30T22:23:24.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.712+0000 7f1b667fc700 1 --2- 172.21.15.156:0/103869835 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b6809e170 0x7f1b681307a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c009920 tx=0x7f1b5c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77031bd6fe26d378 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:24.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.712+0000 7f1b65ffb700 1 -- 172.21.15.156:0/103869835 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c00da40 con 0x7f1b6809e170 2023-09-30T22:23:24.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.712+0000 7f1b65ffb700 1 -- 172.21.15.156:0/103869835 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c00dba0 con 0x7f1b6809e170 2023-09-30T22:23:24.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.712+0000 7f1b65ffb700 1 -- 172.21.15.156:0/103869835 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c010470 con 0x7f1b6809e170 2023-09-30T22:23:24.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.713+0000 7f1b6d3b9700 1 -- 172.21.15.156:0/103869835 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b6809e170 msgr2=0x7f1b681307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.713+0000 7f1b6d3b9700 1 --2- 172.21.15.156:0/103869835 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b6809e170 0x7f1b681307a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c009920 tx=0x7f1b5c009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:24.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.713+0000 7f1b6d3b9700 1 -- 172.21.15.156:0/103869835 shutdown_connections 2023-09-30T22:23:24.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.713+0000 7f1b6d3b9700 1 --2- 172.21.15.156:0/103869835 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b6809d860 0x7f1b6809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.713+0000 7f1b6d3b9700 1 --2- 172.21.15.156:0/103869835 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b6809e170 0x7f1b681307a0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.713+0000 7f1b6d3b9700 1 -- 172.21.15.156:0/103869835 >> 172.21.15.156:0/103869835 conn(0x7f1b68099c40 msgr2=0x7f1b680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:24.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.713+0000 7f1b6d3b9700 1 -- 172.21.15.156:0/103869835 shutdown_connections 2023-09-30T22:23:24.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.713+0000 7f1b6d3b9700 1 -- 172.21.15.156:0/103869835 wait complete. 2023-09-30T22:23:24.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.714+0000 7f1b6d3b9700 1 Processor -- start 2023-09-30T22:23:24.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.714+0000 7f1b6d3b9700 1 -- start start 2023-09-30T22:23:24.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.715+0000 7f1b6d3b9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b6809d860 0x7f1b6811e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.715+0000 7f1b6d3b9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b6809e170 0x7f1b6811eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.715+0000 7f1b6d3b9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b68130ce0 0x7f1b6811f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.715+0000 7f1b6d3b9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6811fb30 con 0x7f1b6809e170 2023-09-30T22:23:24.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.715+0000 7f1b6d3b9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b680a1f00 con 0x7f1b68130ce0 2023-09-30T22:23:24.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.715+0000 7f1b6d3b9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b68121ea0 con 0x7f1b6809d860 2023-09-30T22:23:24.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.715+0000 7f1b66ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b6809d860 0x7f1b6811e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.715+0000 7f1b66ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b6809d860 0x7f1b6811e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:50930/0 (socket says 172.21.15.156:50930) 2023-09-30T22:23:24.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.715+0000 7f1b66ffd700 1 -- 172.21.15.156:0/3452913210 learned_addr learned my addr 172.21.15.156:0/3452913210 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:24.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.715+0000 7f1b677fe700 1 --2- 172.21.15.156:0/3452913210 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b68130ce0 0x7f1b6811f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.715+0000 7f1b667fc700 1 --2- 172.21.15.156:0/3452913210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b6809e170 0x7f1b6811eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.716+0000 7f1b667fc700 1 -- 172.21.15.156:0/3452913210 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b6809d860 msgr2=0x7f1b6811e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.716+0000 7f1b667fc700 1 --2- 172.21.15.156:0/3452913210 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b6809d860 0x7f1b6811e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.716+0000 7f1b667fc700 1 -- 172.21.15.156:0/3452913210 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b68130ce0 msgr2=0x7f1b6811f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.716+0000 7f1b667fc700 1 --2- 172.21.15.156:0/3452913210 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b68130ce0 0x7f1b6811f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.716+0000 7f1b667fc700 1 -- 172.21.15.156:0/3452913210 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c009550 con 0x7f1b6809e170 2023-09-30T22:23:24.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.716+0000 7f1b66ffd700 1 --2- 172.21.15.156:0/3452913210 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b6809d860 0x7f1b6811e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:24.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.716+0000 7f1b677fe700 1 --2- 172.21.15.156:0/3452913210 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b68130ce0 0x7f1b6811f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:24.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.716+0000 7f1b667fc700 1 --2- 172.21.15.156:0/3452913210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b6809e170 0x7f1b6811eba0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c018000 tx=0x7f1b5c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:24.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.716+0000 7f1b4f7fe700 1 -- 172.21.15.156:0/3452913210 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c01e070 con 0x7f1b6809e170 2023-09-30T22:23:24.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.716+0000 7f1b4f7fe700 1 -- 172.21.15.156:0/3452913210 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c00d980 con 0x7f1b6809e170 2023-09-30T22:23:24.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.716+0000 7f1b4f7fe700 1 -- 172.21.15.156:0/3452913210 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c0038c0 con 0x7f1b6809e170 2023-09-30T22:23:24.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.716+0000 7f1b6d3b9700 1 -- 172.21.15.156:0/3452913210 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b68120820 con 0x7f1b6809e170 2023-09-30T22:23:24.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.716+0000 7f1b6d3b9700 1 -- 172.21.15.156:0/3452913210 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b68120a60 con 0x7f1b6809e170 2023-09-30T22:23:24.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.717+0000 7f1b4f7fe700 1 -- 172.21.15.156:0/3452913210 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1b5c022070 con 0x7f1b6809e170 2023-09-30T22:23:24.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.718+0000 7f1b4f7fe700 1 -- 172.21.15.156:0/3452913210 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1b5c0451c0 con 0x7f1b6809e170 2023-09-30T22:23:24.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.718+0000 7f1b6d3b9700 1 -- 172.21.15.156:0/3452913210 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b6804f2a0 con 0x7f1b6809e170 2023-09-30T22:23:24.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.722+0000 7f1b4f7fe700 1 -- 172.21.15.156:0/3452913210 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1b5c047060 con 0x7f1b6809e170 2023-09-30T22:23:24.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.733+0000 7f23c0121700 1 Processor -- start 2023-09-30T22:23:24.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.734+0000 7f23c0121700 1 -- start start 2023-09-30T22:23:24.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.734+0000 7f23c0121700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f23b80a1550 0x7f23b8138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.734+0000 7f23c0121700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23b8139200 0x7f23b813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.734+0000 7f23c0121700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23b809e9d0 con 0x7f23b80a0a70 2023-09-30T22:23:24.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.734+0000 7f23c0121700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b809dc00 con 0x7f23b80a1550 2023-09-30T22:23:24.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.734+0000 7f23c0121700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23b809dec0 con 0x7f23b8139200 2023-09-30T22:23:24.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.734+0000 7f23bd6bc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f23b80a1550 0x7f23b8138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.734+0000 7f23bd6bc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f23b80a1550 0x7f23b8138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38066/0 (socket says 172.21.15.156:38066) 2023-09-30T22:23:24.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.734+0000 7f23bd6bc700 1 -- 172.21.15.156:0/91563437 learned_addr learned my addr 172.21.15.156:0/91563437 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:24.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.734+0000 7f23bdebd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f23b80a0a70 0x7f23b80a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49726/0 (socket says 172.21.15.156:49726) 2023-09-30T22:23:24.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.734+0000 7f23be6be700 1 --2- 172.21.15.156:0/91563437 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23b8139200 0x7f23b813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.735+0000 7f23bd6bc700 1 -- 172.21.15.156:0/91563437 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23b8139200 msgr2=0x7f23b813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:24.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.735+0000 7f23bd6bc700 1 --2- 172.21.15.156:0/91563437 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23b8139200 0x7f23b813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.735+0000 7f23bd6bc700 1 -- 172.21.15.156:0/91563437 >> v1:172.21.15.156:6789/0 conn(0x7f23b80a0a70 legacy=0x7f23b80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.735+0000 7f23bd6bc700 1 -- 172.21.15.156:0/91563437 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b809e6a0 con 0x7f23b80a1550 2023-09-30T22:23:24.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.735+0000 7f23be6be700 1 --2- 172.21.15.156:0/91563437 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23b8139200 0x7f23b813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:24.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.735+0000 7f23bd6bc700 1 --2- 172.21.15.156:0/91563437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23b80a1550 0x7f23b8138cc0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f23a80098f0 tx=0x7f23a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eead3d75a4946a1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:24.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.735+0000 7f23bcebb700 1 -- 172.21.15.156:0/91563437 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a8011830 con 0x7f23b80a1550 2023-09-30T22:23:24.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.735+0000 7f23bcebb700 1 -- 172.21.15.156:0/91563437 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a8011990 con 0x7f23b80a1550 2023-09-30T22:23:24.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.735+0000 7f23bcebb700 1 -- 172.21.15.156:0/91563437 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a8011d20 con 0x7f23b80a1550 2023-09-30T22:23:24.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.736+0000 7f23c0121700 1 -- 172.21.15.156:0/91563437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23b80a1550 msgr2=0x7f23b8138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.736+0000 7f23c0121700 1 --2- 172.21.15.156:0/91563437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23b80a1550 0x7f23b8138cc0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f23a80098f0 tx=0x7f23a8009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:24.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.736+0000 7f23c0121700 1 -- 172.21.15.156:0/91563437 shutdown_connections 2023-09-30T22:23:24.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.736+0000 7f23c0121700 1 --2- 172.21.15.156:0/91563437 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23b8139200 0x7f23b813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.736+0000 7f23c0121700 1 --2- 172.21.15.156:0/91563437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23b80a1550 0x7f23b8138cc0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.736+0000 7f23c0121700 1 -- 172.21.15.156:0/91563437 >> 172.21.15.156:0/91563437 conn(0x7f23b80a6610 msgr2=0x7f23b80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:24.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.736+0000 7f23c0121700 1 -- 172.21.15.156:0/91563437 shutdown_connections 2023-09-30T22:23:24.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.736+0000 7f23c0121700 1 -- 172.21.15.156:0/91563437 wait complete. 2023-09-30T22:23:24.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.737+0000 7f23c0121700 1 Processor -- start 2023-09-30T22:23:24.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.737+0000 7f23c0121700 1 -- start start 2023-09-30T22:23:24.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.737+0000 7f23c0121700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23b80a0a70 0x7f23b812f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.737+0000 7f23c0121700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23b80a1550 0x7f23b812fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.737+0000 7f23c0121700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23b8139200 0x7f23b812ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.737+0000 7f23c0121700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b8131900 con 0x7f23b80a1550 2023-09-30T22:23:24.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.737+0000 7f23c0121700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b8138770 con 0x7f23b8139200 2023-09-30T22:23:24.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.737+0000 7f23c0121700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23b80a03e0 con 0x7f23b80a0a70 2023-09-30T22:23:24.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.737+0000 7f23bd6bc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23b80a1550 0x7f23b812fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.737+0000 7f23be6be700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23b8139200 0x7f23b812ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.737+0000 7f23bd6bc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23b80a1550 0x7f23b812fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38074/0 (socket says 172.21.15.156:38074) 2023-09-30T22:23:24.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.737+0000 7f23bd6bc700 1 -- 172.21.15.156:0/3875046163 learned_addr learned my addr 172.21.15.156:0/3875046163 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:24.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.738+0000 7f23bdebd700 1 --2- 172.21.15.156:0/3875046163 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23b80a0a70 0x7f23b812f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.738+0000 7f23be6be700 1 -- 172.21.15.156:0/3875046163 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23b80a0a70 msgr2=0x7f23b812f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.738+0000 7f23be6be700 1 --2- 172.21.15.156:0/3875046163 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23b80a0a70 0x7f23b812f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.738+0000 7f23be6be700 1 -- 172.21.15.156:0/3875046163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23b80a1550 msgr2=0x7f23b812fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.738+0000 7f23be6be700 1 --2- 172.21.15.156:0/3875046163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23b80a1550 0x7f23b812fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.738+0000 7f23be6be700 1 -- 172.21.15.156:0/3875046163 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b0009a70 con 0x7f23b8139200 2023-09-30T22:23:24.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.738+0000 7f23be6be700 1 --2- 172.21.15.156:0/3875046163 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23b8139200 0x7f23b812ffb0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f23b000efc0 tx=0x7f23b000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:24.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.738+0000 7f23ae7fc700 1 -- 172.21.15.156:0/3875046163 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b000cc90 con 0x7f23b8139200 2023-09-30T22:23:24.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.738+0000 7f23ae7fc700 1 -- 172.21.15.156:0/3875046163 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b000f040 con 0x7f23b8139200 2023-09-30T22:23:24.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.738+0000 7f23ae7fc700 1 -- 172.21.15.156:0/3875046163 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b0014480 con 0x7f23b8139200 2023-09-30T22:23:24.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.738+0000 7f23c0121700 1 -- 172.21.15.156:0/3875046163 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a8009550 con 0x7f23b8139200 2023-09-30T22:23:24.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.738+0000 7f23c0121700 1 -- 172.21.15.156:0/3875046163 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b80a5310 con 0x7f23b8139200 2023-09-30T22:23:24.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.739+0000 7f23c0121700 1 -- 172.21.15.156:0/3875046163 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b81327f0 con 0x7f23b8139200 2023-09-30T22:23:24.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.739+0000 7f23ae7fc700 1 -- 172.21.15.156:0/3875046163 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f23b00145e0 con 0x7f23b8139200 2023-09-30T22:23:24.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.740+0000 7f23ae7fc700 1 -- 172.21.15.156:0/3875046163 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f23b00403f0 con 0x7f23b8139200 2023-09-30T22:23:24.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.744+0000 7f23ae7fc700 1 -- 172.21.15.156:0/3875046163 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23b0007920 con 0x7f23b8139200 2023-09-30T22:23:24.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.848+0000 7fb8863cd700 1 -- 172.21.15.156:0/2511390886 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb88006bce0 con 0x7fb880138410 2023-09-30T22:23:24.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.848+0000 7fb87cff9700 1 -- 172.21.15.156:0/2511390886 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb874015030 con 0x7fb880138410 2023-09-30T22:23:24.849 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:24.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.850+0000 7fb8863cd700 1 -- 172.21.15.156:0/2511390886 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb880138410 msgr2=0x7fb880121b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.850+0000 7fb8863cd700 1 --2- 172.21.15.156:0/2511390886 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb880138410 0x7fb880121b40 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb874016000 tx=0x7fb874004750 comp rx=0 tx=0).stop 2023-09-30T22:23:24.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.850+0000 7fb8863cd700 1 -- 172.21.15.156:0/2511390886 shutdown_connections 2023-09-30T22:23:24.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.850+0000 7fb8863cd700 1 --2- 172.21.15.156:0/2511390886 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb88013dd10 0x7fb880122080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.850+0000 7fb8863cd700 1 --2- 172.21.15.156:0/2511390886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb880138040 0x7fb880121600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.850+0000 7fb8863cd700 1 --2- 172.21.15.156:0/2511390886 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb880138410 0x7fb880121b40 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.850+0000 7fb8863cd700 1 -- 172.21.15.156:0/2511390886 >> 172.21.15.156:0/2511390886 conn(0x7fb8800a2980 msgr2=0x7fb88013b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:24.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.850+0000 7fb8863cd700 1 -- 172.21.15.156:0/2511390886 shutdown_connections 2023-09-30T22:23:24.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.850+0000 7fb8863cd700 1 -- 172.21.15.156:0/2511390886 wait complete. 2023-09-30T22:23:24.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:24.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.873+0000 7f681902f700 1 -- 172.21.15.156:0/3378015345 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f681406c9d0 con 0x7f681409f180 2023-09-30T22:23:24.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.874+0000 7f67fb7fe700 1 -- 172.21.15.156:0/3378015345 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f680801a430 con 0x7f681409f180 2023-09-30T22:23:24.874 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:24.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.876+0000 7f681902f700 1 -- 172.21.15.156:0/3378015345 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f681409f180 msgr2=0x7f681411f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.876+0000 7f681902f700 1 --2- 172.21.15.156:0/3378015345 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f681409f180 0x7f681411f010 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f68080090b0 tx=0x7f6808004750 comp rx=0 tx=0).stop 2023-09-30T22:23:24.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.876+0000 7f681902f700 1 -- 172.21.15.156:0/3378015345 shutdown_connections 2023-09-30T22:23:24.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.876+0000 7f681902f700 1 --2- 172.21.15.156:0/3378015345 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6814134160 0x7f681411f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.876+0000 7f681902f700 1 --2- 172.21.15.156:0/3378015345 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f681409e870 0x7f681411ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.876+0000 7f681902f700 1 --2- 172.21.15.156:0/3378015345 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f681409f180 0x7f681411f010 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.876+0000 7f681902f700 1 -- 172.21.15.156:0/3378015345 >> 172.21.15.156:0/3378015345 conn(0x7f68140a4430 msgr2=0x7f681409d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:24.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.876+0000 7f681902f700 1 -- 172.21.15.156:0/3378015345 shutdown_connections 2023-09-30T22:23:24.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.876+0000 7f681902f700 1 -- 172.21.15.156:0/3378015345 wait complete. 2023-09-30T22:23:24.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:24.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.940+0000 7f1b6d3b9700 1 -- 172.21.15.156:0/3452913210 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1b681305c0 con 0x7f1b6809e170 2023-09-30T22:23:24.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.940+0000 7f1b4f7fe700 1 -- 172.21.15.156:0/3452913210 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1b5c003a20 con 0x7f1b6809e170 2023-09-30T22:23:24.941 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:24.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.941+0000 7f23c0121700 1 -- 172.21.15.156:0/3875046163 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f23b8070950 con 0x7f23b8139200 2023-09-30T22:23:24.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.941+0000 7f23ae7fc700 1 -- 172.21.15.156:0/3875046163 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f23b0007330 con 0x7f23b8139200 2023-09-30T22:23:24.942 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:24.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.943+0000 7f1b6d3b9700 1 -- 172.21.15.156:0/3452913210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b6809e170 msgr2=0x7f1b6811eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.943+0000 7f1b6d3b9700 1 --2- 172.21.15.156:0/3452913210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b6809e170 0x7f1b6811eba0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c018000 tx=0x7f1b5c004750 comp rx=0 tx=0).stop 2023-09-30T22:23:24.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.943+0000 7f23c0121700 1 -- 172.21.15.156:0/3875046163 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23b8139200 msgr2=0x7f23b812ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.943+0000 7f23c0121700 1 --2- 172.21.15.156:0/3875046163 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23b8139200 0x7f23b812ffb0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f23b000efc0 tx=0x7f23b000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.943+0000 7f23c0121700 1 -- 172.21.15.156:0/3875046163 shutdown_connections 2023-09-30T22:23:24.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.943+0000 7f23c0121700 1 --2- 172.21.15.156:0/3875046163 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23b8139200 0x7f23b812ffb0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.943+0000 7f23c0121700 1 --2- 172.21.15.156:0/3875046163 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23b80a0a70 0x7f23b812f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.943+0000 7f23c0121700 1 --2- 172.21.15.156:0/3875046163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23b80a1550 0x7f23b812fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.943+0000 7f1b6d3b9700 1 -- 172.21.15.156:0/3452913210 shutdown_connections 2023-09-30T22:23:24.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.943+0000 7f23c0121700 1 -- 172.21.15.156:0/3875046163 >> 172.21.15.156:0/3875046163 conn(0x7f23b80a6610 msgr2=0x7f23b806da90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:24.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.943+0000 7f1b6d3b9700 1 --2- 172.21.15.156:0/3452913210 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b68130ce0 0x7f1b6811f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.943+0000 7f1b6d3b9700 1 --2- 172.21.15.156:0/3452913210 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b6809d860 0x7f1b6811e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.943+0000 7f1b6d3b9700 1 --2- 172.21.15.156:0/3452913210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b6809e170 0x7f1b6811eba0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.943+0000 7f1b6d3b9700 1 -- 172.21.15.156:0/3452913210 >> 172.21.15.156:0/3452913210 conn(0x7f1b68099c40 msgr2=0x7f1b680a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:24.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.943+0000 7f1b6d3b9700 1 -- 172.21.15.156:0/3452913210 shutdown_connections 2023-09-30T22:23:24.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.943+0000 7f1b6d3b9700 1 -- 172.21.15.156:0/3452913210 wait complete. 2023-09-30T22:23:24.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.943+0000 7f23c0121700 1 -- 172.21.15.156:0/3875046163 shutdown_connections 2023-09-30T22:23:24.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:24.943+0000 7f23c0121700 1 -- 172.21.15.156:0/3875046163 wait complete. 2023-09-30T22:23:24.957 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:24.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:25.864 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:25.889 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:25.958 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:25.959 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:26.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.008+0000 7feb554fb700 1 Processor -- start 2023-09-30T22:23:26.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.008+0000 7feb554fb700 1 -- start start 2023-09-30T22:23:26.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.008+0000 7feb554fb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb501368e0 0x7feb50138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.008+0000 7feb554fb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7feb50139200 0x7feb5013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.008+0000 7feb554fb700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb5009a760 con 0x7feb50133900 2023-09-30T22:23:26.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.008+0000 7feb554fb700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb501336e0 con 0x7feb50139200 2023-09-30T22:23:26.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.008+0000 7feb554fb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb5009a080 con 0x7feb501368e0 2023-09-30T22:23:26.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.008+0000 7feb4effd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7feb50133900 0x7feb50133cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49732/0 (socket says 172.21.15.156:49732) 2023-09-30T22:23:26.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.008+0000 7feb4effd700 1 -- 172.21.15.156:0/2439903735 learned_addr learned my addr 172.21.15.156:0/2439903735 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:26.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.008+0000 7feb4f7fe700 1 --2- 172.21.15.156:0/2439903735 >> v2:172.21.15.156:3300/0 conn(0x7feb50139200 0x7feb5013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.009+0000 7feb4e7fc700 1 --2- 172.21.15.156:0/2439903735 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb501368e0 0x7feb50138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.009+0000 7feb4f7fe700 1 -- 172.21.15.156:0/2439903735 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb501368e0 msgr2=0x7feb50138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:26.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.009+0000 7feb4f7fe700 1 --2- 172.21.15.156:0/2439903735 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb501368e0 0x7feb50138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.009+0000 7feb4f7fe700 1 -- 172.21.15.156:0/2439903735 >> v1:172.21.15.156:6789/0 conn(0x7feb50133900 legacy=0x7feb50133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.009+0000 7feb4dffb700 1 -- 172.21.15.156:0/2439903735 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2341713848 0 0) 0x7feb5009a760 con 0x7feb50133900 2023-09-30T22:23:26.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.009+0000 7feb4f7fe700 1 -- 172.21.15.156:0/2439903735 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb500a23e0 con 0x7feb50139200 2023-09-30T22:23:26.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.009+0000 7feb4f7fe700 1 --2- 172.21.15.156:0/2439903735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb50139200 0x7feb5013b5e0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7feb48009d90 tx=0x7feb4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4714dba238a72b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:26.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.009+0000 7feb4dffb700 1 -- 172.21.15.156:0/2439903735 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4800e070 con 0x7feb50139200 2023-09-30T22:23:26.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.009+0000 7feb4dffb700 1 -- 172.21.15.156:0/2439903735 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4800bb20 con 0x7feb50139200 2023-09-30T22:23:26.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.009+0000 7feb4dffb700 1 -- 172.21.15.156:0/2439903735 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb48012430 con 0x7feb50139200 2023-09-30T22:23:26.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.010+0000 7feb554fb700 1 -- 172.21.15.156:0/2439903735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb50139200 msgr2=0x7feb5013b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.010+0000 7feb554fb700 1 --2- 172.21.15.156:0/2439903735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb50139200 0x7feb5013b5e0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7feb48009d90 tx=0x7feb4800b330 comp rx=0 tx=0).stop 2023-09-30T22:23:26.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.010+0000 7feb554fb700 1 -- 172.21.15.156:0/2439903735 shutdown_connections 2023-09-30T22:23:26.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.010+0000 7feb554fb700 1 --2- 172.21.15.156:0/2439903735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb50139200 0x7feb5013b5e0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.010+0000 7feb554fb700 1 --2- 172.21.15.156:0/2439903735 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb501368e0 0x7feb50138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.010+0000 7feb554fb700 1 -- 172.21.15.156:0/2439903735 >> 172.21.15.156:0/2439903735 conn(0x7feb500a2980 msgr2=0x7feb500a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:26.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.010+0000 7feb554fb700 1 -- 172.21.15.156:0/2439903735 shutdown_connections 2023-09-30T22:23:26.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.010+0000 7feb554fb700 1 -- 172.21.15.156:0/2439903735 wait complete. 2023-09-30T22:23:26.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.012+0000 7feb554fb700 1 Processor -- start 2023-09-30T22:23:26.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.012+0000 7feb554fb700 1 -- start start 2023-09-30T22:23:26.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.013+0000 7feb554fb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb50133900 0x7feb5011ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.013+0000 7feb554fb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb501368e0 0x7feb5011b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.013+0000 7feb554fb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb50139200 0x7feb5011b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.013+0000 7feb554fb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5011e8c0 con 0x7feb50139200 2023-09-30T22:23:26.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.013+0000 7feb554fb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5011dc70 con 0x7feb501368e0 2023-09-30T22:23:26.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.013+0000 7feb554fb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb50138ff0 con 0x7feb50133900 2023-09-30T22:23:26.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.013+0000 7feb4effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb50133900 0x7feb5011ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.013+0000 7feb4f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb50139200 0x7feb5011b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.013+0000 7feb4effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb50133900 0x7feb5011ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:50952/0 (socket says 172.21.15.156:50952) 2023-09-30T22:23:26.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.013+0000 7feb4f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb50139200 0x7feb5011b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38090/0 (socket says 172.21.15.156:38090) 2023-09-30T22:23:26.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.013+0000 7feb4effd700 1 -- 172.21.15.156:0/1069192233 learned_addr learned my addr 172.21.15.156:0/1069192233 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:26.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.013+0000 7feb4e7fc700 1 --2- 172.21.15.156:0/1069192233 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb501368e0 0x7feb5011b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.013+0000 7feb4e7fc700 1 -- 172.21.15.156:0/1069192233 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb50133900 msgr2=0x7feb5011ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.013+0000 7feb4e7fc700 1 --2- 172.21.15.156:0/1069192233 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb50133900 0x7feb5011ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.013+0000 7feb4e7fc700 1 -- 172.21.15.156:0/1069192233 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb50139200 msgr2=0x7feb5011b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.013+0000 7feb4e7fc700 1 --2- 172.21.15.156:0/1069192233 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb50139200 0x7feb5011b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.013+0000 7feb4e7fc700 1 -- 172.21.15.156:0/1069192233 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb48009a70 con 0x7feb501368e0 2023-09-30T22:23:26.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.014+0000 7feb4e7fc700 1 --2- 172.21.15.156:0/1069192233 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb501368e0 0x7feb5011b2e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7feb4400e900 tx=0x7feb4400ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:26.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.014+0000 7feb377fe700 1 -- 172.21.15.156:0/1069192233 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb44013680 con 0x7feb501368e0 2023-09-30T22:23:26.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.014+0000 7feb377fe700 1 -- 172.21.15.156:0/1069192233 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb440137e0 con 0x7feb501368e0 2023-09-30T22:23:26.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.014+0000 7feb554fb700 1 -- 172.21.15.156:0/1069192233 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb5009a2c0 con 0x7feb501368e0 2023-09-30T22:23:26.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.014+0000 7feb377fe700 1 -- 172.21.15.156:0/1069192233 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb44013b50 con 0x7feb501368e0 2023-09-30T22:23:26.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.014+0000 7feb554fb700 1 -- 172.21.15.156:0/1069192233 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb5011f050 con 0x7feb501368e0 2023-09-30T22:23:26.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.015+0000 7feb377fe700 1 -- 172.21.15.156:0/1069192233 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb44013cb0 con 0x7feb501368e0 2023-09-30T22:23:26.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.015+0000 7feb377fe700 1 -- 172.21.15.156:0/1069192233 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feb4403f9d0 con 0x7feb501368e0 2023-09-30T22:23:26.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.015+0000 7feb554fb700 1 -- 172.21.15.156:0/1069192233 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb5004f2a0 con 0x7feb501368e0 2023-09-30T22:23:26.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.024+0000 7feb377fe700 1 -- 172.21.15.156:0/1069192233 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb44017080 con 0x7feb501368e0 2023-09-30T22:23:26.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.063+0000 7f848a72c700 1 Processor -- start 2023-09-30T22:23:26.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.063+0000 7f848a72c700 1 -- start start 2023-09-30T22:23:26.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.064+0000 7f848a72c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8484133ad0 0x7f8484133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.064+0000 7f848a72c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f84841300a0 0x7f84841304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.064+0000 7f848a72c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f84841309f0 0x7f848413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.064+0000 7f848a72c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848406b2d0 con 0x7f8484133ad0 2023-09-30T22:23:26.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.064+0000 7f848a72c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8484133610 con 0x7f84841309f0 2023-09-30T22:23:26.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.064+0000 7f848a72c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f848409a500 con 0x7f84841300a0 2023-09-30T22:23:26.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.064+0000 7f84837fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f84841300a0 0x7f84841304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.064+0000 7f84837fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f84841300a0 0x7f84841304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:50962/0 (socket says 172.21.15.156:50962) 2023-09-30T22:23:26.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.064+0000 7f84837fe700 1 -- 172.21.15.156:0/2280092186 learned_addr learned my addr 172.21.15.156:0/2280092186 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:26.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.064+0000 7f8488cc9700 1 --2- 172.21.15.156:0/2280092186 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f84841309f0 0x7f848413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.064+0000 7f8483fff700 1 --2- 172.21.15.156:0/2280092186 >> v2:172.21.15.156:3300/0 conn(0x7f8484133ad0 0x7f8484133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.064+0000 7f84837fe700 1 -- 172.21.15.156:0/2280092186 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f84841309f0 msgr2=0x7f848413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:26.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.064+0000 7f84837fe700 1 --2- 172.21.15.156:0/2280092186 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f84841309f0 0x7f848413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.064+0000 7f84837fe700 1 -- 172.21.15.156:0/2280092186 >> v2:172.21.15.156:3300/0 conn(0x7f8484133ad0 msgr2=0x7f8484133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:26.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.064+0000 7f84837fe700 1 --2- 172.21.15.156:0/2280092186 >> v2:172.21.15.156:3300/0 conn(0x7f8484133ad0 0x7f8484133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.064+0000 7f84837fe700 1 -- 172.21.15.156:0/2280092186 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84841338b0 con 0x7f84841300a0 2023-09-30T22:23:26.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.064+0000 7f8483fff700 1 --2- 172.21.15.156:0/2280092186 >> v2:172.21.15.156:3300/0 conn(0x7f8484133ad0 0x7f8484133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:26.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.065+0000 7f84837fe700 1 --2- 172.21.15.156:0/2280092186 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f84841300a0 0x7f84841304b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f84780098f0 tx=0x7f8478009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd9d4c680d950385 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:26.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.065+0000 7f8482ffd700 1 -- 172.21.15.156:0/2280092186 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8478011830 con 0x7f84841300a0 2023-09-30T22:23:26.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.065+0000 7f8482ffd700 1 -- 172.21.15.156:0/2280092186 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8478011990 con 0x7f84841300a0 2023-09-30T22:23:26.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.065+0000 7f8482ffd700 1 -- 172.21.15.156:0/2280092186 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8478011d20 con 0x7f84841300a0 2023-09-30T22:23:26.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.066+0000 7f848a72c700 1 -- 172.21.15.156:0/2280092186 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f84841300a0 msgr2=0x7f84841304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.066+0000 7f848a72c700 1 --2- 172.21.15.156:0/2280092186 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f84841300a0 0x7f84841304b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f84780098f0 tx=0x7f8478009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:26.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.066+0000 7f848a72c700 1 -- 172.21.15.156:0/2280092186 shutdown_connections 2023-09-30T22:23:26.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.066+0000 7f848a72c700 1 --2- 172.21.15.156:0/2280092186 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f84841309f0 0x7f848413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.066+0000 7f848a72c700 1 --2- 172.21.15.156:0/2280092186 >> v2:172.21.15.156:3300/0 conn(0x7f8484133ad0 0x7f8484133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.066+0000 7f848a72c700 1 --2- 172.21.15.156:0/2280092186 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f84841300a0 0x7f84841304b0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.066+0000 7f848a72c700 1 -- 172.21.15.156:0/2280092186 >> 172.21.15.156:0/2280092186 conn(0x7f8484099c40 msgr2=0x7f84840a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:26.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.066+0000 7f848a72c700 1 -- 172.21.15.156:0/2280092186 shutdown_connections 2023-09-30T22:23:26.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.066+0000 7f848a72c700 1 -- 172.21.15.156:0/2280092186 wait complete. 2023-09-30T22:23:26.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.067+0000 7f848a72c700 1 Processor -- start 2023-09-30T22:23:26.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.067+0000 7f848a72c700 1 -- start start 2023-09-30T22:23:26.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.068+0000 7f848a72c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84841300a0 0x7f848411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.068+0000 7f848a72c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f84841309f0 0x7f848411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.068+0000 7f848a72c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8484133ad0 0x7f848411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.068+0000 7f848a72c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848412d8e0 con 0x7f84841300a0 2023-09-30T22:23:26.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.068+0000 7f848a72c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848411ed20 con 0x7f8484133ad0 2023-09-30T22:23:26.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.068+0000 7f848a72c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f848411f850 con 0x7f84841309f0 2023-09-30T22:23:26.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.068+0000 7f8483fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84841300a0 0x7f848411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.068+0000 7f8483fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84841300a0 0x7f848411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38112/0 (socket says 172.21.15.156:38112) 2023-09-30T22:23:26.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.068+0000 7f8483fff700 1 -- 172.21.15.156:0/1120025645 learned_addr learned my addr 172.21.15.156:0/1120025645 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:26.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.068+0000 7f8488cc9700 1 --2- 172.21.15.156:0/1120025645 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8484133ad0 0x7f848411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.068+0000 7f84837fe700 1 --2- 172.21.15.156:0/1120025645 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f84841309f0 0x7f848411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.069+0000 7f8483fff700 1 -- 172.21.15.156:0/1120025645 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f84841309f0 msgr2=0x7f848411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.069+0000 7f8483fff700 1 --2- 172.21.15.156:0/1120025645 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f84841309f0 0x7f848411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.069+0000 7f8483fff700 1 -- 172.21.15.156:0/1120025645 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8484133ad0 msgr2=0x7f848411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.069+0000 7f8483fff700 1 --2- 172.21.15.156:0/1120025645 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8484133ad0 0x7f848411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.069+0000 7f8483fff700 1 -- 172.21.15.156:0/1120025645 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84740094a0 con 0x7f84841300a0 2023-09-30T22:23:26.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.069+0000 7f8483fff700 1 --2- 172.21.15.156:0/1120025645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84841300a0 0x7f848411da40 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f847400ec10 tx=0x7f847400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:26.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.069+0000 7f8480ff9700 1 -- 172.21.15.156:0/1120025645 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847400c8b0 con 0x7f84841300a0 2023-09-30T22:23:26.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.069+0000 7f8480ff9700 1 -- 172.21.15.156:0/1120025645 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f847400ca10 con 0x7f84841300a0 2023-09-30T22:23:26.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.069+0000 7f8480ff9700 1 -- 172.21.15.156:0/1120025645 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847400cd80 con 0x7f84841300a0 2023-09-30T22:23:26.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.069+0000 7f848a72c700 1 -- 172.21.15.156:0/1120025645 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8478009550 con 0x7f84841300a0 2023-09-30T22:23:26.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.069+0000 7f848a72c700 1 -- 172.21.15.156:0/1120025645 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f848411f390 con 0x7f84841300a0 2023-09-30T22:23:26.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.070+0000 7f8480ff9700 1 -- 172.21.15.156:0/1120025645 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8474013470 con 0x7f84841300a0 2023-09-30T22:23:26.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.071+0000 7f8480ff9700 1 -- 172.21.15.156:0/1120025645 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f847403fc00 con 0x7f84841300a0 2023-09-30T22:23:26.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.071+0000 7f848a72c700 1 -- 172.21.15.156:0/1120025645 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f848412f890 con 0x7f84841300a0 2023-09-30T22:23:26.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.080+0000 7f8480ff9700 1 -- 172.21.15.156:0/1120025645 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f847401b3b0 con 0x7f84841300a0 2023-09-30T22:23:26.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.096+0000 7fb9383c4700 1 Processor -- start 2023-09-30T22:23:26.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.096+0000 7fb9383c4700 1 -- start start 2023-09-30T22:23:26.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.097+0000 7fb9383c4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb93009d860 0x7fb93009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.097+0000 7fb9383c4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb93009e170 0x7fb9301307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.097+0000 7fb9383c4700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93009aaa0 con 0x7fb930130ce0 2023-09-30T22:23:26.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.097+0000 7fb9383c4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93009f870 con 0x7fb93009d860 2023-09-30T22:23:26.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.097+0000 7fb9383c4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb93009b360 con 0x7fb93009e170 2023-09-30T22:23:26.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.097+0000 7fb936160700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb93009d860 0x7fb93009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.097+0000 7fb936160700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb93009d860 0x7fb93009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:41204/0 (socket says 172.21.15.156:41204) 2023-09-30T22:23:26.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.097+0000 7fb936160700 1 -- 172.21.15.156:0/1474624239 learned_addr learned my addr 172.21.15.156:0/1474624239 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:26.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.097+0000 7fb93595f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb93009e170 0x7fb9301307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.098+0000 7fb93515e700 1 -- 172.21.15.156:0/1474624239 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3875550436 0 0) 0x7fb93009aaa0 con 0x7fb930130ce0 2023-09-30T22:23:26.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.098+0000 7fb93595f700 1 -- 172.21.15.156:0/1474624239 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb93009d860 msgr2=0x7fb93009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:26.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.098+0000 7fb93595f700 1 --2- 172.21.15.156:0/1474624239 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb93009d860 0x7fb93009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.098+0000 7fb93595f700 1 -- 172.21.15.156:0/1474624239 >> v1:172.21.15.156:6789/0 conn(0x7fb930130ce0 legacy=0x7fb9301379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.098+0000 7fb93595f700 1 -- 172.21.15.156:0/1474624239 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93009b620 con 0x7fb93009e170 2023-09-30T22:23:26.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.098+0000 7fb93595f700 1 --2- 172.21.15.156:0/1474624239 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb93009e170 0x7fb9301307a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb920009870 tx=0x7fb920009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11b8237b5962c807 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:26.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.098+0000 7fb93515e700 1 -- 172.21.15.156:0/1474624239 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb920011830 con 0x7fb93009e170 2023-09-30T22:23:26.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.098+0000 7fb93515e700 1 -- 172.21.15.156:0/1474624239 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb920011990 con 0x7fb93009e170 2023-09-30T22:23:26.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.098+0000 7fb93515e700 1 -- 172.21.15.156:0/1474624239 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb920011d20 con 0x7fb93009e170 2023-09-30T22:23:26.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.099+0000 7fb9383c4700 1 -- 172.21.15.156:0/1474624239 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb93009e170 msgr2=0x7fb9301307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.099+0000 7fb9383c4700 1 --2- 172.21.15.156:0/1474624239 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb93009e170 0x7fb9301307a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb920009870 tx=0x7fb920009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:26.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.099+0000 7fb9383c4700 1 -- 172.21.15.156:0/1474624239 shutdown_connections 2023-09-30T22:23:26.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.099+0000 7fb9383c4700 1 --2- 172.21.15.156:0/1474624239 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb93009d860 0x7fb93009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.099+0000 7fb9383c4700 1 --2- 172.21.15.156:0/1474624239 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb93009e170 0x7fb9301307a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.099+0000 7fb9383c4700 1 -- 172.21.15.156:0/1474624239 >> 172.21.15.156:0/1474624239 conn(0x7fb930099c40 msgr2=0x7fb9300a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:26.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.099+0000 7fb9383c4700 1 -- 172.21.15.156:0/1474624239 shutdown_connections 2023-09-30T22:23:26.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.099+0000 7fb9383c4700 1 -- 172.21.15.156:0/1474624239 wait complete. 2023-09-30T22:23:26.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.100+0000 7fb9383c4700 1 Processor -- start 2023-09-30T22:23:26.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.100+0000 7fb9383c4700 1 -- start start 2023-09-30T22:23:26.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.101+0000 7fb9383c4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb93009d860 0x7fb930121770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.101+0000 7fb9383c4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb93009e170 0x7fb930121cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.101+0000 7fb93595f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb93009e170 0x7fb930121cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.101+0000 7fb93595f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb93009e170 0x7fb930121cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:41216/0 (socket says 172.21.15.156:41216) 2023-09-30T22:23:26.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.101+0000 7fb9383c4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb930130ce0 0x7fb9301221f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.101+0000 7fb9383c4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb930130210 con 0x7fb930130ce0 2023-09-30T22:23:26.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.101+0000 7fb9383c4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb930130760 con 0x7fb93009e170 2023-09-30T22:23:26.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.101+0000 7fb9383c4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb930123c20 con 0x7fb93009d860 2023-09-30T22:23:26.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.101+0000 7fb93595f700 1 -- 172.21.15.156:0/3634763717 learned_addr learned my addr 172.21.15.156:0/3634763717 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:26.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.101+0000 7fb936961700 1 --2- 172.21.15.156:0/3634763717 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb930130ce0 0x7fb9301221f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.101+0000 7fb936961700 1 -- 172.21.15.156:0/3634763717 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb93009d860 msgr2=0x7fb930121770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.101+0000 7fb936961700 1 --2- 172.21.15.156:0/3634763717 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb93009d860 0x7fb930121770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.101+0000 7fb936961700 1 -- 172.21.15.156:0/3634763717 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb93009e170 msgr2=0x7fb930121cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.101+0000 7fb936961700 1 --2- 172.21.15.156:0/3634763717 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb93009e170 0x7fb930121cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.101+0000 7fb936961700 1 -- 172.21.15.156:0/3634763717 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9200094a0 con 0x7fb930130ce0 2023-09-30T22:23:26.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.101+0000 7fb936961700 1 --2- 172.21.15.156:0/3634763717 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb930130ce0 0x7fb9301221f0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fb92800c7c0 tx=0x7fb92800cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:26.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.102+0000 7fb926ffd700 1 -- 172.21.15.156:0/3634763717 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb928003e30 con 0x7fb930130ce0 2023-09-30T22:23:26.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.102+0000 7fb926ffd700 1 -- 172.21.15.156:0/3634763717 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb928005070 con 0x7fb930130ce0 2023-09-30T22:23:26.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.102+0000 7fb9383c4700 1 -- 172.21.15.156:0/3634763717 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb93009c8b0 con 0x7fb930130ce0 2023-09-30T22:23:26.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.102+0000 7fb926ffd700 1 -- 172.21.15.156:0/3634763717 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb928005420 con 0x7fb930130ce0 2023-09-30T22:23:26.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.102+0000 7fb9383c4700 1 -- 172.21.15.156:0/3634763717 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb930124950 con 0x7fb930130ce0 2023-09-30T22:23:26.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.103+0000 7fb9383c4700 1 -- 172.21.15.156:0/3634763717 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb930122760 con 0x7fb930130ce0 2023-09-30T22:23:26.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.104+0000 7fb926ffd700 1 -- 172.21.15.156:0/3634763717 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb928005580 con 0x7fb930130ce0 2023-09-30T22:23:26.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.104+0000 7fb926ffd700 1 -- 172.21.15.156:0/3634763717 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb92803ee10 con 0x7fb930130ce0 2023-09-30T22:23:26.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.109+0000 7fb926ffd700 1 -- 172.21.15.156:0/3634763717 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb92800ad20 con 0x7fb930130ce0 2023-09-30T22:23:26.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.116+0000 7f840e3cb700 1 Processor -- start 2023-09-30T22:23:26.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.117+0000 7f840e3cb700 1 -- start start 2023-09-30T22:23:26.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.117+0000 7f840e3cb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f840806a770 0x7f840806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.117+0000 7f840e3cb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8408136cb0 0x7f8408139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.117+0000 7f840e3cb700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f840806e900 con 0x7f840809dec0 2023-09-30T22:23:26.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.117+0000 7f840e3cb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840809d180 con 0x7f8408136cb0 2023-09-30T22:23:26.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.117+0000 7f840e3cb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f840809e780 con 0x7f840806a770 2023-09-30T22:23:26.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.118+0000 7f8407fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f840806a770 0x7f840806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.118+0000 7f840c968700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8408136cb0 0x7f8408139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.118+0000 7f840c968700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8408136cb0 0x7f8408139090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:41224/0 (socket says 172.21.15.156:41224) 2023-09-30T22:23:26.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.118+0000 7f840c968700 1 -- 172.21.15.156:0/1059535074 learned_addr learned my addr 172.21.15.156:0/1059535074 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:26.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.118+0000 7f8407fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f840806a770 0x7f840806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51010/0 (socket says 172.21.15.156:51010) 2023-09-30T22:23:26.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.118+0000 7f840c968700 1 -- 172.21.15.156:0/1059535074 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f840806a770 msgr2=0x7f840806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:26.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.118+0000 7f840c968700 1 --2- 172.21.15.156:0/1059535074 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f840806a770 0x7f840806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.118+0000 7f8406ffd700 1 -- 172.21.15.156:0/1059535074 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1264510559 0 0) 0x7f840806e900 con 0x7f840809dec0 2023-09-30T22:23:26.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.118+0000 7f840c968700 1 -- 172.21.15.156:0/1059535074 >> v1:172.21.15.156:6789/0 conn(0x7f840809dec0 legacy=0x7f840806b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.118+0000 7f840c968700 1 -- 172.21.15.156:0/1059535074 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840809d3c0 con 0x7f8408136cb0 2023-09-30T22:23:26.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.118+0000 7f840c968700 1 --2- 172.21.15.156:0/1059535074 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8408136cb0 0x7f8408139090 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8400009e80 tx=0x7f840000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb80471c777b84f8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:26.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.118+0000 7f8406ffd700 1 -- 172.21.15.156:0/1059535074 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840000e070 con 0x7f8408136cb0 2023-09-30T22:23:26.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.118+0000 7f8406ffd700 1 -- 172.21.15.156:0/1059535074 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840000b910 con 0x7f8408136cb0 2023-09-30T22:23:26.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.118+0000 7f8406ffd700 1 -- 172.21.15.156:0/1059535074 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840000bcc0 con 0x7f8408136cb0 2023-09-30T22:23:26.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.119+0000 7f840e3cb700 1 -- 172.21.15.156:0/1059535074 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8408136cb0 msgr2=0x7f8408139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.119+0000 7f840e3cb700 1 --2- 172.21.15.156:0/1059535074 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8408136cb0 0x7f8408139090 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8400009e80 tx=0x7f840000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:26.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.119+0000 7f840e3cb700 1 -- 172.21.15.156:0/1059535074 shutdown_connections 2023-09-30T22:23:26.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.119+0000 7f840e3cb700 1 --2- 172.21.15.156:0/1059535074 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8408136cb0 0x7f8408139090 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.119+0000 7f840e3cb700 1 --2- 172.21.15.156:0/1059535074 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f840806a770 0x7f840806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.119+0000 7f840e3cb700 1 -- 172.21.15.156:0/1059535074 >> 172.21.15.156:0/1059535074 conn(0x7f8408099c40 msgr2=0x7f84080a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:26.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.119+0000 7f840e3cb700 1 -- 172.21.15.156:0/1059535074 shutdown_connections 2023-09-30T22:23:26.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.119+0000 7f840e3cb700 1 -- 172.21.15.156:0/1059535074 wait complete. 2023-09-30T22:23:26.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.120+0000 7f840e3cb700 1 Processor -- start 2023-09-30T22:23:26.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.121+0000 7f840e3cb700 1 -- start start 2023-09-30T22:23:26.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.121+0000 7f840e3cb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f840806a770 0x7f8408131610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.121+0000 7f840e3cb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f840809dec0 0x7f8408131b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.121+0000 7f840e3cb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8408136cb0 0x7f8408132090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.121+0000 7f840e3cb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8408071ce0 con 0x7f840809dec0 2023-09-30T22:23:26.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.121+0000 7f840e3cb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84080a2a10 con 0x7f840806a770 2023-09-30T22:23:26.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.121+0000 7f840e3cb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8408134340 con 0x7f8408136cb0 2023-09-30T22:23:26.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.121+0000 7f84077fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f840809dec0 0x7f8408131b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.121+0000 7f84077fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f840809dec0 0x7f8408131b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38122/0 (socket says 172.21.15.156:38122) 2023-09-30T22:23:26.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.121+0000 7f84077fe700 1 -- 172.21.15.156:0/4270498678 learned_addr learned my addr 172.21.15.156:0/4270498678 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:26.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.121+0000 7f840c968700 1 --2- 172.21.15.156:0/4270498678 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8408136cb0 0x7f8408132090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.121+0000 7f8407fff700 1 --2- 172.21.15.156:0/4270498678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f840806a770 0x7f8408131610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.122+0000 7f84077fe700 1 -- 172.21.15.156:0/4270498678 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8408136cb0 msgr2=0x7f8408132090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.122+0000 7f84077fe700 1 --2- 172.21.15.156:0/4270498678 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8408136cb0 0x7f8408132090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.122+0000 7f84077fe700 1 -- 172.21.15.156:0/4270498678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f840806a770 msgr2=0x7f8408131610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.122+0000 7f84077fe700 1 --2- 172.21.15.156:0/4270498678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f840806a770 0x7f8408131610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.122+0000 7f84077fe700 1 -- 172.21.15.156:0/4270498678 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8400009b30 con 0x7f840809dec0 2023-09-30T22:23:26.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.122+0000 7f84077fe700 1 --2- 172.21.15.156:0/4270498678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f840809dec0 0x7f8408131b50 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f83fc001eb0 tx=0x7f83fc00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:26.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.122+0000 7f8404ff9700 1 -- 172.21.15.156:0/4270498678 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc0054e0 con 0x7f840809dec0 2023-09-30T22:23:26.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.122+0000 7f8404ff9700 1 -- 172.21.15.156:0/4270498678 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83fc003680 con 0x7f840809dec0 2023-09-30T22:23:26.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.122+0000 7f8404ff9700 1 -- 172.21.15.156:0/4270498678 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc0039f0 con 0x7f840809dec0 2023-09-30T22:23:26.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.122+0000 7f840e3cb700 1 -- 172.21.15.156:0/4270498678 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8408134790 con 0x7f840809dec0 2023-09-30T22:23:26.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.122+0000 7f840e3cb700 1 -- 172.21.15.156:0/4270498678 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8408135790 con 0x7f840809dec0 2023-09-30T22:23:26.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.123+0000 7f8404ff9700 1 -- 172.21.15.156:0/4270498678 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f83fc003b50 con 0x7f840809dec0 2023-09-30T22:23:26.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.124+0000 7f840e3cb700 1 -- 172.21.15.156:0/4270498678 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84080700a0 con 0x7f840809dec0 2023-09-30T22:23:26.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.124+0000 7f8404ff9700 1 -- 172.21.15.156:0/4270498678 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f83fc03eb60 con 0x7f840809dec0 2023-09-30T22:23:26.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.133+0000 7f8404ff9700 1 -- 172.21.15.156:0/4270498678 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f83fc017080 con 0x7f840809dec0 2023-09-30T22:23:26.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.235+0000 7feb554fb700 1 -- 172.21.15.156:0/1069192233 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feb5006bce0 con 0x7feb501368e0 2023-09-30T22:23:26.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.235+0000 7feb377fe700 1 -- 172.21.15.156:0/1069192233 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb4401b590 con 0x7feb501368e0 2023-09-30T22:23:26.236 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:26.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.238+0000 7feb554fb700 1 -- 172.21.15.156:0/1069192233 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb501368e0 msgr2=0x7feb5011b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.238+0000 7feb554fb700 1 --2- 172.21.15.156:0/1069192233 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb501368e0 0x7feb5011b2e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7feb4400e900 tx=0x7feb4400ec10 comp rx=0 tx=0).stop 2023-09-30T22:23:26.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.238+0000 7feb554fb700 1 -- 172.21.15.156:0/1069192233 shutdown_connections 2023-09-30T22:23:26.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.238+0000 7feb554fb700 1 --2- 172.21.15.156:0/1069192233 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb50139200 0x7feb5011b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.238+0000 7feb554fb700 1 --2- 172.21.15.156:0/1069192233 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb50133900 0x7feb5011ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.238+0000 7feb554fb700 1 --2- 172.21.15.156:0/1069192233 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb501368e0 0x7feb5011b2e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.238+0000 7feb554fb700 1 -- 172.21.15.156:0/1069192233 >> 172.21.15.156:0/1069192233 conn(0x7feb500a2980 msgr2=0x7feb50131af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:26.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.238+0000 7feb554fb700 1 -- 172.21.15.156:0/1069192233 shutdown_connections 2023-09-30T22:23:26.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.238+0000 7feb554fb700 1 -- 172.21.15.156:0/1069192233 wait complete. 2023-09-30T22:23:26.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:26.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.307+0000 7fb9383c4700 1 -- 172.21.15.156:0/3634763717 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb93004f2a0 con 0x7fb930130ce0 2023-09-30T22:23:26.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.307+0000 7fb926ffd700 1 -- 172.21.15.156:0/3634763717 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb92800a2e0 con 0x7fb930130ce0 2023-09-30T22:23:26.308 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:26.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.310+0000 7fb9383c4700 1 -- 172.21.15.156:0/3634763717 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb930130ce0 msgr2=0x7fb9301221f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.310+0000 7fb9383c4700 1 --2- 172.21.15.156:0/3634763717 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb930130ce0 0x7fb9301221f0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fb92800c7c0 tx=0x7fb92800cad0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.310+0000 7fb9383c4700 1 -- 172.21.15.156:0/3634763717 shutdown_connections 2023-09-30T22:23:26.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.310+0000 7fb9383c4700 1 --2- 172.21.15.156:0/3634763717 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb930130ce0 0x7fb9301221f0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.310+0000 7fb9383c4700 1 --2- 172.21.15.156:0/3634763717 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb93009d860 0x7fb930121770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.310+0000 7fb9383c4700 1 --2- 172.21.15.156:0/3634763717 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb93009e170 0x7fb930121cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.310+0000 7fb9383c4700 1 -- 172.21.15.156:0/3634763717 >> 172.21.15.156:0/3634763717 conn(0x7fb930099c40 msgr2=0x7fb930119630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:26.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.310+0000 7fb9383c4700 1 -- 172.21.15.156:0/3634763717 shutdown_connections 2023-09-30T22:23:26.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.310+0000 7fb9383c4700 1 -- 172.21.15.156:0/3634763717 wait complete. 2023-09-30T22:23:26.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.321+0000 7f848a72c700 1 -- 172.21.15.156:0/1120025645 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f848412dd00 con 0x7f84841300a0 2023-09-30T22:23:26.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.321+0000 7f8480ff9700 1 -- 172.21.15.156:0/1120025645 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8474017020 con 0x7f84841300a0 2023-09-30T22:23:26.322 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:26.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:26.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.323+0000 7f848a72c700 1 -- 172.21.15.156:0/1120025645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84841300a0 msgr2=0x7f848411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.323+0000 7f848a72c700 1 --2- 172.21.15.156:0/1120025645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84841300a0 0x7f848411da40 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f847400ec10 tx=0x7f847400ef20 comp rx=0 tx=0).stop 2023-09-30T22:23:26.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.323+0000 7f848a72c700 1 -- 172.21.15.156:0/1120025645 shutdown_connections 2023-09-30T22:23:26.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.323+0000 7f848a72c700 1 --2- 172.21.15.156:0/1120025645 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8484133ad0 0x7f848411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.323+0000 7f848a72c700 1 --2- 172.21.15.156:0/1120025645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84841300a0 0x7f848411da40 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.323+0000 7f848a72c700 1 --2- 172.21.15.156:0/1120025645 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f84841309f0 0x7f848411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.323+0000 7f848a72c700 1 -- 172.21.15.156:0/1120025645 >> 172.21.15.156:0/1120025645 conn(0x7f8484099c40 msgr2=0x7f848412e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:26.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.323+0000 7f848a72c700 1 -- 172.21.15.156:0/1120025645 shutdown_connections 2023-09-30T22:23:26.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.323+0000 7f848a72c700 1 -- 172.21.15.156:0/1120025645 wait complete. 2023-09-30T22:23:26.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:26.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.354+0000 7f840e3cb700 1 -- 172.21.15.156:0/4270498678 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8408135be0 con 0x7f840809dec0 2023-09-30T22:23:26.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.354+0000 7f8404ff9700 1 -- 172.21.15.156:0/4270498678 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f83fc01b3b0 con 0x7f840809dec0 2023-09-30T22:23:26.355 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:26.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.356+0000 7f840e3cb700 1 -- 172.21.15.156:0/4270498678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f840809dec0 msgr2=0x7f8408131b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.356+0000 7f840e3cb700 1 --2- 172.21.15.156:0/4270498678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f840809dec0 0x7f8408131b50 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f83fc001eb0 tx=0x7f83fc00c800 comp rx=0 tx=0).stop 2023-09-30T22:23:26.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.356+0000 7f840e3cb700 1 -- 172.21.15.156:0/4270498678 shutdown_connections 2023-09-30T22:23:26.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.356+0000 7f840e3cb700 1 --2- 172.21.15.156:0/4270498678 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8408136cb0 0x7f8408132090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.357+0000 7f840e3cb700 1 --2- 172.21.15.156:0/4270498678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f840806a770 0x7f8408131610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.357+0000 7f840e3cb700 1 --2- 172.21.15.156:0/4270498678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f840809dec0 0x7f8408131b50 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.357+0000 7f840e3cb700 1 -- 172.21.15.156:0/4270498678 >> 172.21.15.156:0/4270498678 conn(0x7f8408099c40 msgr2=0x7f84080a2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:26.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.357+0000 7f840e3cb700 1 -- 172.21.15.156:0/4270498678 shutdown_connections 2023-09-30T22:23:26.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:26.357+0000 7f840e3cb700 1 -- 172.21.15.156:0/4270498678 wait complete. 2023-09-30T22:23:26.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:27.257 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:27.324 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:27.340 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:27.369 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:27.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.389+0000 7f35d5b6b700 1 Processor -- start 2023-09-30T22:23:27.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.389+0000 7f35d5b6b700 1 -- start start 2023-09-30T22:23:27.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.389+0000 7f35d5b6b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35d00a0a30 0x7f35d00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:27.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.389+0000 7f35d5b6b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35d00a1340 0x7f35d012ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:27.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.389+0000 7f35d5b6b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f35d01304a0 0x7f35d01308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:27.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.389+0000 7f35d5b6b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d0130e30 con 0x7f35d01304a0 2023-09-30T22:23:27.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.389+0000 7f35d5b6b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d00a1e70 con 0x7f35d00a0a30 2023-09-30T22:23:27.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.389+0000 7f35d5b6b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35d009a720 con 0x7f35d00a1340 2023-09-30T22:23:27.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.389+0000 7f35cf7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35d00a0a30 0x7f35d00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:27.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.389+0000 7f35c6ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35d00a1340 0x7f35d012ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:27.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.389+0000 7f35cffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f35d01304a0 0x7f35d01308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:27.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.389+0000 7f35cf7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35d00a0a30 0x7f35d00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:41234/0 (socket says 172.21.15.156:41234) 2023-09-30T22:23:27.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.389+0000 7f35cf7fe700 1 -- 172.21.15.156:0/1886528252 learned_addr learned my addr 172.21.15.156:0/1886528252 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:27.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.390+0000 7f35cf7fe700 1 -- 172.21.15.156:0/1886528252 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35d00a1340 msgr2=0x7f35d012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:27.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.390+0000 7f35cf7fe700 1 --2- 172.21.15.156:0/1886528252 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35d00a1340 0x7f35d012ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.390+0000 7f35cf7fe700 1 -- 172.21.15.156:0/1886528252 >> v2:172.21.15.156:3300/0 conn(0x7f35d01304a0 msgr2=0x7f35d01308f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:27.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.390+0000 7f35cf7fe700 1 --2- 172.21.15.156:0/1886528252 >> v2:172.21.15.156:3300/0 conn(0x7f35d01304a0 0x7f35d01308f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.390+0000 7f35cf7fe700 1 -- 172.21.15.156:0/1886528252 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d009b300 con 0x7f35d00a0a30 2023-09-30T22:23:27.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.390+0000 7f35c6ffd700 1 --2- 172.21.15.156:0/1886528252 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35d00a1340 0x7f35d012ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:27.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.390+0000 7f35cf7fe700 1 --2- 172.21.15.156:0/1886528252 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35d00a0a30 0x7f35d00a0e00 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f35c0006fd0 tx=0x7f35c000bc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b097416e7241381 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:27.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.390+0000 7f35ceffd700 1 -- 172.21.15.156:0/1886528252 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c0009070 con 0x7f35d00a0a30 2023-09-30T22:23:27.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.390+0000 7f35ceffd700 1 -- 172.21.15.156:0/1886528252 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c0005e30 con 0x7f35d00a0a30 2023-09-30T22:23:27.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.390+0000 7f35ceffd700 1 -- 172.21.15.156:0/1886528252 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c0004270 con 0x7f35d00a0a30 2023-09-30T22:23:27.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.391+0000 7f35d5b6b700 1 -- 172.21.15.156:0/1886528252 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35d00a0a30 msgr2=0x7f35d00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:27.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.391+0000 7f35d5b6b700 1 --2- 172.21.15.156:0/1886528252 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35d00a0a30 0x7f35d00a0e00 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f35c0006fd0 tx=0x7f35c000bc80 comp rx=0 tx=0).stop 2023-09-30T22:23:27.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.392+0000 7f35d5b6b700 1 -- 172.21.15.156:0/1886528252 shutdown_connections 2023-09-30T22:23:27.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.392+0000 7f35d5b6b700 1 --2- 172.21.15.156:0/1886528252 >> v2:172.21.15.156:3300/0 conn(0x7f35d01304a0 0x7f35d01308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.392+0000 7f35d5b6b700 1 --2- 172.21.15.156:0/1886528252 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35d00a0a30 0x7f35d00a0e00 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.392+0000 7f35d5b6b700 1 --2- 172.21.15.156:0/1886528252 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35d00a1340 0x7f35d012ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.392+0000 7f35d5b6b700 1 -- 172.21.15.156:0/1886528252 >> 172.21.15.156:0/1886528252 conn(0x7f35d00a2980 msgr2=0x7f35d00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:27.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.392+0000 7f35d5b6b700 1 -- 172.21.15.156:0/1886528252 shutdown_connections 2023-09-30T22:23:27.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.392+0000 7f35d5b6b700 1 -- 172.21.15.156:0/1886528252 wait complete. 2023-09-30T22:23:27.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.393+0000 7f35d5b6b700 1 Processor -- start 2023-09-30T22:23:27.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.393+0000 7f35d5b6b700 1 -- start start 2023-09-30T22:23:27.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.393+0000 7f35d5b6b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35d00a0a30 0x7f35d011ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:27.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.393+0000 7f35d5b6b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35d00a1340 0x7f35d011f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:27.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.393+0000 7f35d5b6b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35d01304a0 0x7f35d01c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:27.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.393+0000 7f35d5b6b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d0121aa0 con 0x7f35d00a1340 2023-09-30T22:23:27.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.393+0000 7f35d5b6b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d011e630 con 0x7f35d00a0a30 2023-09-30T22:23:27.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.393+0000 7f35d5b6b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35d012fae0 con 0x7f35d01304a0 2023-09-30T22:23:27.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.394+0000 7f35cffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35d01304a0 0x7f35d01c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:27.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.394+0000 7f35c6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35d00a1340 0x7f35d011f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:27.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.394+0000 7f35cffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35d01304a0 0x7f35d01c3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51036/0 (socket says 172.21.15.156:51036) 2023-09-30T22:23:27.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.394+0000 7f35cffff700 1 -- 172.21.15.156:0/271527015 learned_addr learned my addr 172.21.15.156:0/271527015 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:27.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.394+0000 7f35cf7fe700 1 --2- 172.21.15.156:0/271527015 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35d00a0a30 0x7f35d011ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:27.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.394+0000 7f35cffff700 1 -- 172.21.15.156:0/271527015 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35d00a0a30 msgr2=0x7f35d011ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:27.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.394+0000 7f35cffff700 1 --2- 172.21.15.156:0/271527015 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35d00a0a30 0x7f35d011ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.394+0000 7f35cffff700 1 -- 172.21.15.156:0/271527015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35d00a1340 msgr2=0x7f35d011f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:27.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.394+0000 7f35cffff700 1 --2- 172.21.15.156:0/271527015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35d00a1340 0x7f35d011f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.394+0000 7f35cffff700 1 -- 172.21.15.156:0/271527015 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b80094a0 con 0x7f35d01304a0 2023-09-30T22:23:27.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.394+0000 7f35c6ffd700 1 --2- 172.21.15.156:0/271527015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35d00a1340 0x7f35d011f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:27.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.394+0000 7f35cffff700 1 --2- 172.21.15.156:0/271527015 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35d01304a0 0x7f35d01c3f40 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f35c8012420 tx=0x7f35c8012730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:27.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.394+0000 7f35ccff9700 1 -- 172.21.15.156:0/271527015 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c80101f0 con 0x7f35d01304a0 2023-09-30T22:23:27.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.394+0000 7f35ccff9700 1 -- 172.21.15.156:0/271527015 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c8013040 con 0x7f35d01304a0 2023-09-30T22:23:27.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.394+0000 7f35d5b6b700 1 -- 172.21.15.156:0/271527015 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c000b5b0 con 0x7f35d01304a0 2023-09-30T22:23:27.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.394+0000 7f35ccff9700 1 -- 172.21.15.156:0/271527015 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c8012ee0 con 0x7f35d01304a0 2023-09-30T22:23:27.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.395+0000 7f35d5b6b700 1 -- 172.21.15.156:0/271527015 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d0120340 con 0x7f35d01304a0 2023-09-30T22:23:27.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.395+0000 7f35ccff9700 1 -- 172.21.15.156:0/271527015 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f35c800b740 con 0x7f35d01304a0 2023-09-30T22:23:27.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.396+0000 7f35d5b6b700 1 -- 172.21.15.156:0/271527015 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d009efc0 con 0x7f35d01304a0 2023-09-30T22:23:27.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.396+0000 7f35ccff9700 1 -- 172.21.15.156:0/271527015 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f35c8044100 con 0x7f35d01304a0 2023-09-30T22:23:27.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.401+0000 7f35ccff9700 1 -- 172.21.15.156:0/271527015 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f35c800d510 con 0x7f35d01304a0 2023-09-30T22:23:27.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.464+0000 7f564bfa9700 1 Processor -- start 2023-09-30T22:23:27.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.464+0000 7f564bfa9700 1 -- start start 2023-09-30T22:23:27.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.465+0000 7f564bfa9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5644133a70 0x7f5644133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:27.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.465+0000 7f564bfa9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f56440a08e0 0x7f56440a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:27.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.465+0000 7f564bfa9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f56440a1290 0x7f564413a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:27.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.465+0000 7f564bfa9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5644133640 con 0x7f56440a08e0 2023-09-30T22:23:27.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.465+0000 7f564bfa9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56440a1d50 con 0x7f5644133a70 2023-09-30T22:23:27.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.465+0000 7f564bfa9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f564409b620 con 0x7f56440a1290 2023-09-30T22:23:27.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.465+0000 7f5649d45700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5644133a70 0x7f5644133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:27.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.465+0000 7f5649d45700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5644133a70 0x7f5644133e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:41248/0 (socket says 172.21.15.156:41248) 2023-09-30T22:23:27.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.465+0000 7f5649d45700 1 -- 172.21.15.156:0/3108843839 learned_addr learned my addr 172.21.15.156:0/3108843839 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:27.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.465+0000 7f564a546700 1 --2- 172.21.15.156:0/3108843839 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f56440a1290 0x7f564413a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:27.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.465+0000 7f5649544700 1 --2- 172.21.15.156:0/3108843839 >> v2:172.21.15.156:3300/0 conn(0x7f56440a08e0 0x7f56440a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:27.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.466+0000 7f5649d45700 1 -- 172.21.15.156:0/3108843839 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f56440a1290 msgr2=0x7f564413a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:27.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.466+0000 7f5649d45700 1 --2- 172.21.15.156:0/3108843839 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f56440a1290 0x7f564413a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.466+0000 7f5649d45700 1 -- 172.21.15.156:0/3108843839 >> v2:172.21.15.156:3300/0 conn(0x7f56440a08e0 msgr2=0x7f56440a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:27.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.466+0000 7f5649d45700 1 --2- 172.21.15.156:0/3108843839 >> v2:172.21.15.156:3300/0 conn(0x7f56440a08e0 0x7f56440a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.466+0000 7f5649d45700 1 -- 172.21.15.156:0/3108843839 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5644133870 con 0x7f5644133a70 2023-09-30T22:23:27.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.466+0000 7f5649d45700 1 --2- 172.21.15.156:0/3108843839 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5644133a70 0x7f5644133e40 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5640006fd0 tx=0x7f5640009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44ee3b55d53b3484 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:27.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.466+0000 7f5648d43700 1 -- 172.21.15.156:0/3108843839 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5640005e30 con 0x7f5644133a70 2023-09-30T22:23:27.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.466+0000 7f5648d43700 1 -- 172.21.15.156:0/3108843839 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5640004030 con 0x7f5644133a70 2023-09-30T22:23:27.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.466+0000 7f5648d43700 1 -- 172.21.15.156:0/3108843839 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56400043e0 con 0x7f5644133a70 2023-09-30T22:23:27.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.467+0000 7f564bfa9700 1 -- 172.21.15.156:0/3108843839 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5644133a70 msgr2=0x7f5644133e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:27.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.467+0000 7f564bfa9700 1 --2- 172.21.15.156:0/3108843839 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5644133a70 0x7f5644133e40 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5640006fd0 tx=0x7f5640009bd0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.467+0000 7f564bfa9700 1 -- 172.21.15.156:0/3108843839 shutdown_connections 2023-09-30T22:23:27.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.467+0000 7f564bfa9700 1 --2- 172.21.15.156:0/3108843839 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f56440a1290 0x7f564413a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.467+0000 7f564bfa9700 1 --2- 172.21.15.156:0/3108843839 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5644133a70 0x7f5644133e40 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.467+0000 7f564bfa9700 1 --2- 172.21.15.156:0/3108843839 >> v2:172.21.15.156:3300/0 conn(0x7f56440a08e0 0x7f56440a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.467+0000 7f564bfa9700 1 -- 172.21.15.156:0/3108843839 >> 172.21.15.156:0/3108843839 conn(0x7f56440a2980 msgr2=0x7f56440a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:27.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.467+0000 7f564bfa9700 1 -- 172.21.15.156:0/3108843839 shutdown_connections 2023-09-30T22:23:27.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.467+0000 7f564bfa9700 1 -- 172.21.15.156:0/3108843839 wait complete. 2023-09-30T22:23:27.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.469+0000 7f564bfa9700 1 Processor -- start 2023-09-30T22:23:27.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.469+0000 7f564bfa9700 1 -- start start 2023-09-30T22:23:27.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.469+0000 7f564bfa9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f56440a08e0 0x7f564411c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:27.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.469+0000 7f564bfa9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56440a1290 0x7f564411ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:27.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.469+0000 7f564bfa9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5644133a70 0x7f564411d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:27.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.469+0000 7f564bfa9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564411e3c0 con 0x7f56440a1290 2023-09-30T22:23:27.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.469+0000 7f564bfa9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564411f610 con 0x7f56440a08e0 2023-09-30T22:23:27.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.469+0000 7f564bfa9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f564411e9b0 con 0x7f5644133a70 2023-09-30T22:23:27.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.470+0000 7f5649d45700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f56440a08e0 0x7f564411c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:27.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.470+0000 7f5649d45700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f56440a08e0 0x7f564411c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:41252/0 (socket says 172.21.15.156:41252) 2023-09-30T22:23:27.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.470+0000 7f5649d45700 1 -- 172.21.15.156:0/1190511550 learned_addr learned my addr 172.21.15.156:0/1190511550 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:27.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.470+0000 7f5649544700 1 --2- 172.21.15.156:0/1190511550 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56440a1290 0x7f564411ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:27.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.470+0000 7f564a546700 1 --2- 172.21.15.156:0/1190511550 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5644133a70 0x7f564411d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:27.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.470+0000 7f564a546700 1 -- 172.21.15.156:0/1190511550 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f56440a08e0 msgr2=0x7f564411c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:27.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.470+0000 7f564a546700 1 --2- 172.21.15.156:0/1190511550 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f56440a08e0 0x7f564411c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.470+0000 7f564a546700 1 -- 172.21.15.156:0/1190511550 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56440a1290 msgr2=0x7f564411ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:27.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.470+0000 7f564a546700 1 --2- 172.21.15.156:0/1190511550 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56440a1290 0x7f564411ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.470+0000 7f564a546700 1 -- 172.21.15.156:0/1190511550 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5640009500 con 0x7f5644133a70 2023-09-30T22:23:27.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.470+0000 7f5649d45700 1 --2- 172.21.15.156:0/1190511550 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f56440a08e0 0x7f564411c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:27.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.470+0000 7f5649544700 1 --2- 172.21.15.156:0/1190511550 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56440a1290 0x7f564411ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:27.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.470+0000 7f564a546700 1 --2- 172.21.15.156:0/1190511550 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5644133a70 0x7f564411d230 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f563c009d90 tx=0x7f563c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:27.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.470+0000 7f563a7fc700 1 -- 172.21.15.156:0/1190511550 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c009c00 con 0x7f5644133a70 2023-09-30T22:23:27.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.470+0000 7f563a7fc700 1 -- 172.21.15.156:0/1190511550 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563c00f040 con 0x7f5644133a70 2023-09-30T22:23:27.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.470+0000 7f564bfa9700 1 -- 172.21.15.156:0/1190511550 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f564411fa60 con 0x7f5644133a70 2023-09-30T22:23:27.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.470+0000 7f563a7fc700 1 -- 172.21.15.156:0/1190511550 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c014480 con 0x7f5644133a70 2023-09-30T22:23:27.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.471+0000 7f564bfa9700 1 -- 172.21.15.156:0/1190511550 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5644131f80 con 0x7f5644133a70 2023-09-30T22:23:27.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.471+0000 7f563a7fc700 1 -- 172.21.15.156:0/1190511550 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f563c0145e0 con 0x7f5644133a70 2023-09-30T22:23:27.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.472+0000 7f564bfa9700 1 -- 172.21.15.156:0/1190511550 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f564404f2a0 con 0x7f5644133a70 2023-09-30T22:23:27.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.472+0000 7f563a7fc700 1 -- 172.21.15.156:0/1190511550 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f563c0417d0 con 0x7f5644133a70 2023-09-30T22:23:27.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.476+0000 7f563a7fc700 1 -- 172.21.15.156:0/1190511550 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f563c045060 con 0x7f5644133a70 2023-09-30T22:23:27.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.501+0000 7f6fe7861700 1 Processor -- start 2023-09-30T22:23:27.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.501+0000 7f6fe7861700 1 -- start start 2023-09-30T22:23:27.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.501+0000 7f6fe7861700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fe006b250 0x7f6fe0136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:27.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.501+0000 7f6fe7861700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6fe0137140 0x7f6fe0139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:27.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.501+0000 7f6fe7861700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe009da80 con 0x7f6fe006a770 2023-09-30T22:23:27.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.501+0000 7f6fe7861700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe009dce0 con 0x7f6fe0137140 2023-09-30T22:23:27.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.501+0000 7f6fe7861700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe006b620 con 0x7f6fe006b250 2023-09-30T22:23:27.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.502+0000 7f6fe5dfe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6fe0137140 0x7f6fe0139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:27.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.502+0000 7f6fe4dfc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fe006b250 0x7f6fe0136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:27.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.502+0000 7f6fe4dfc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fe006b250 0x7f6fe0136c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:41258/0 (socket says 172.21.15.156:41258) 2023-09-30T22:23:27.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.502+0000 7f6fe4dfc700 1 -- 172.21.15.156:0/4173333415 learned_addr learned my addr 172.21.15.156:0/4173333415 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:27.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.502+0000 7f6fe5dfe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6fe0137140 0x7f6fe0139520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38170/0 (socket says 172.21.15.156:38170) 2023-09-30T22:23:27.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.502+0000 7f6fe4dfc700 1 -- 172.21.15.156:0/4173333415 >> v2:172.21.15.156:3300/0 conn(0x7f6fe0137140 msgr2=0x7f6fe0139520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:27.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.502+0000 7f6fe4dfc700 1 --2- 172.21.15.156:0/4173333415 >> v2:172.21.15.156:3300/0 conn(0x7f6fe0137140 0x7f6fe0139520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.502+0000 7f6fe4dfc700 1 -- 172.21.15.156:0/4173333415 >> v1:172.21.15.156:6789/0 conn(0x7f6fe006a770 legacy=0x7f6fe006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:27.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.502+0000 7f6fe4dfc700 1 -- 172.21.15.156:0/4173333415 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe009eb20 con 0x7f6fe006b250 2023-09-30T22:23:27.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.502+0000 7f6fe4dfc700 1 --2- 172.21.15.156:0/4173333415 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fe006b250 0x7f6fe0136c00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f6fd00098f0 tx=0x7f6fd0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=470ace1f909b0313 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:27.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.502+0000 7f6fd7fff700 1 -- 172.21.15.156:0/4173333415 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0011830 con 0x7f6fe006b250 2023-09-30T22:23:27.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.502+0000 7f6fd7fff700 1 -- 172.21.15.156:0/4173333415 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd0011990 con 0x7f6fe006b250 2023-09-30T22:23:27.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.502+0000 7f6fd7fff700 1 -- 172.21.15.156:0/4173333415 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0011d20 con 0x7f6fe006b250 2023-09-30T22:23:27.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.503+0000 7f6fe7861700 1 -- 172.21.15.156:0/4173333415 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fe006b250 msgr2=0x7f6fe0136c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:27.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.503+0000 7f6fe7861700 1 --2- 172.21.15.156:0/4173333415 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fe006b250 0x7f6fe0136c00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f6fd00098f0 tx=0x7f6fd0009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:27.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.503+0000 7f6fe7861700 1 -- 172.21.15.156:0/4173333415 shutdown_connections 2023-09-30T22:23:27.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.503+0000 7f6fe7861700 1 --2- 172.21.15.156:0/4173333415 >> v2:172.21.15.156:3300/0 conn(0x7f6fe0137140 0x7f6fe0139520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.503+0000 7f6fe7861700 1 --2- 172.21.15.156:0/4173333415 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fe006b250 0x7f6fe0136c00 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.503+0000 7f6fe7861700 1 -- 172.21.15.156:0/4173333415 >> 172.21.15.156:0/4173333415 conn(0x7f6fe0099c40 msgr2=0x7f6fe00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:27.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.503+0000 7f6fe7861700 1 -- 172.21.15.156:0/4173333415 shutdown_connections 2023-09-30T22:23:27.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.503+0000 7f6fe7861700 1 -- 172.21.15.156:0/4173333415 wait complete. 2023-09-30T22:23:27.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.504+0000 7f6fe7861700 1 Processor -- start 2023-09-30T22:23:27.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.504+0000 7f6fe7861700 1 -- start start 2023-09-30T22:23:27.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.505+0000 7f6fe7861700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fe006a770 0x7f6fe011e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:27.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.505+0000 7f6fe7861700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fe006b250 0x7f6fe011e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:27.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.505+0000 7f6fe7861700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fe0137140 0x7f6fe011eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:27.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.505+0000 7f6fe7861700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe00a0620 con 0x7f6fe0137140 2023-09-30T22:23:27.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.505+0000 7f6fe7861700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe0120870 con 0x7f6fe006a770 2023-09-30T22:23:27.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.505+0000 7f6fe7861700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe0071e10 con 0x7f6fe006b250 2023-09-30T22:23:27.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.505+0000 7f6fe4dfc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fe006b250 0x7f6fe011e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:27.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.505+0000 7f6fe4dfc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fe006b250 0x7f6fe011e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51052/0 (socket says 172.21.15.156:51052) 2023-09-30T22:23:27.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.505+0000 7f6fe4dfc700 1 -- 172.21.15.156:0/3009821495 learned_addr learned my addr 172.21.15.156:0/3009821495 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:27.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.505+0000 7f6fe55fd700 1 --2- 172.21.15.156:0/3009821495 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fe006a770 0x7f6fe011e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:27.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.505+0000 7f6fe5dfe700 1 --2- 172.21.15.156:0/3009821495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fe0137140 0x7f6fe011eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:27.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.505+0000 7f6fe4dfc700 1 -- 172.21.15.156:0/3009821495 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fe006a770 msgr2=0x7f6fe011e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:27.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.505+0000 7f6fe4dfc700 1 --2- 172.21.15.156:0/3009821495 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fe006a770 0x7f6fe011e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.505+0000 7f6fe4dfc700 1 -- 172.21.15.156:0/3009821495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fe0137140 msgr2=0x7f6fe011eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:27.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.505+0000 7f6fe4dfc700 1 --2- 172.21.15.156:0/3009821495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fe0137140 0x7f6fe011eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.505+0000 7f6fe4dfc700 1 -- 172.21.15.156:0/3009821495 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd0009550 con 0x7f6fe006b250 2023-09-30T22:23:27.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.506+0000 7f6fe4dfc700 1 --2- 172.21.15.156:0/3009821495 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fe006b250 0x7f6fe011e970 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0000c00 tx=0x7f6fd0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:27.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.506+0000 7f6fd5ffb700 1 -- 172.21.15.156:0/3009821495 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd00036a0 con 0x7f6fe006b250 2023-09-30T22:23:27.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.506+0000 7f6fd5ffb700 1 -- 172.21.15.156:0/3009821495 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd0003800 con 0x7f6fe006b250 2023-09-30T22:23:27.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.506+0000 7f6fd5ffb700 1 -- 172.21.15.156:0/3009821495 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0003bb0 con 0x7f6fe006b250 2023-09-30T22:23:27.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.506+0000 7f6fe7861700 1 -- 172.21.15.156:0/3009821495 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe0136870 con 0x7f6fe006b250 2023-09-30T22:23:27.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.506+0000 7f6fe7861700 1 -- 172.21.15.156:0/3009821495 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe0121c70 con 0x7f6fe006b250 2023-09-30T22:23:27.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.507+0000 7f6fd5ffb700 1 -- 172.21.15.156:0/3009821495 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6fd0021070 con 0x7f6fe006b250 2023-09-30T22:23:27.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.507+0000 7f6fe7861700 1 -- 172.21.15.156:0/3009821495 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe004f2a0 con 0x7f6fe006b250 2023-09-30T22:23:27.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.507+0000 7f6fd5ffb700 1 -- 172.21.15.156:0/3009821495 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6fd0040d00 con 0x7f6fe006b250 2023-09-30T22:23:27.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.512+0000 7f6fd5ffb700 1 -- 172.21.15.156:0/3009821495 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6fd0044030 con 0x7f6fe006b250 2023-09-30T22:23:27.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.529+0000 7f0198fa1700 1 Processor -- start 2023-09-30T22:23:27.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.529+0000 7f0198fa1700 1 -- start start 2023-09-30T22:23:27.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.530+0000 7f0198fa1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f019406cc70 0x7f01940a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:27.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.530+0000 7f0198fa1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01940a0fb0 0x7f01940a13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:27.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.530+0000 7f0198fa1700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f019409df50 con 0x7f019413c200 2023-09-30T22:23:27.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.530+0000 7f0198fa1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01940a1920 con 0x7f01940a0fb0 2023-09-30T22:23:27.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.530+0000 7f0198fa1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f019409cf30 con 0x7f019406cc70 2023-09-30T22:23:27.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.530+0000 7f019259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f019406cc70 0x7f01940a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:27.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.530+0000 7f019259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f019406cc70 0x7f01940a0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51056/0 (socket says 172.21.15.156:51056) 2023-09-30T22:23:27.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.530+0000 7f019259c700 1 -- 172.21.15.156:0/117780307 learned_addr learned my addr 172.21.15.156:0/117780307 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:27.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.530+0000 7f0191d9b700 1 --2- 172.21.15.156:0/117780307 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01940a0fb0 0x7f01940a13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:27.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.531+0000 7f019259c700 1 -- 172.21.15.156:0/117780307 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01940a0fb0 msgr2=0x7f01940a13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:27.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.531+0000 7f019259c700 1 --2- 172.21.15.156:0/117780307 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01940a0fb0 0x7f01940a13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.531+0000 7f019259c700 1 -- 172.21.15.156:0/117780307 >> v1:172.21.15.156:6789/0 conn(0x7f019413c200 legacy=0x7f019413e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:27.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.531+0000 7f019259c700 1 -- 172.21.15.156:0/117780307 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01940a24a0 con 0x7f019406cc70 2023-09-30T22:23:27.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.531+0000 7f019259c700 1 --2- 172.21.15.156:0/117780307 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f019406cc70 0x7f01940a0a70 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0184009950 tx=0x7f0184009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52d2fa5ee71c5804 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:27.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.531+0000 7f019159a700 1 -- 172.21.15.156:0/117780307 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0184011830 con 0x7f019406cc70 2023-09-30T22:23:27.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.531+0000 7f019159a700 1 -- 172.21.15.156:0/117780307 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0184011990 con 0x7f019406cc70 2023-09-30T22:23:27.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.531+0000 7f019159a700 1 -- 172.21.15.156:0/117780307 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0184011d40 con 0x7f019406cc70 2023-09-30T22:23:27.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.532+0000 7f0198fa1700 1 -- 172.21.15.156:0/117780307 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f019406cc70 msgr2=0x7f01940a0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:27.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.532+0000 7f0198fa1700 1 --2- 172.21.15.156:0/117780307 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f019406cc70 0x7f01940a0a70 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0184009950 tx=0x7f0184009c60 comp rx=0 tx=0).stop 2023-09-30T22:23:27.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.532+0000 7f0198fa1700 1 -- 172.21.15.156:0/117780307 shutdown_connections 2023-09-30T22:23:27.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.532+0000 7f0198fa1700 1 --2- 172.21.15.156:0/117780307 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f019406cc70 0x7f01940a0a70 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.532+0000 7f0198fa1700 1 --2- 172.21.15.156:0/117780307 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01940a0fb0 0x7f01940a13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.532+0000 7f0198fa1700 1 -- 172.21.15.156:0/117780307 >> 172.21.15.156:0/117780307 conn(0x7f01940a6610 msgr2=0x7f01940a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:27.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.532+0000 7f0198fa1700 1 -- 172.21.15.156:0/117780307 shutdown_connections 2023-09-30T22:23:27.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.532+0000 7f0198fa1700 1 -- 172.21.15.156:0/117780307 wait complete. 2023-09-30T22:23:27.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.534+0000 7f0198fa1700 1 Processor -- start 2023-09-30T22:23:27.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.534+0000 7f0198fa1700 1 -- start start 2023-09-30T22:23:27.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.534+0000 7f0198fa1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f019406cc70 0x7f01941250b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:27.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.535+0000 7f0198fa1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01940a0fb0 0x7f01941255f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:27.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.535+0000 7f0191d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01940a0fb0 0x7f01941255f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:27.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.535+0000 7f0191d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01940a0fb0 0x7f01941255f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38184/0 (socket says 172.21.15.156:38184) 2023-09-30T22:23:27.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.535+0000 7f019259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f019406cc70 0x7f01941250b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:27.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.535+0000 7f019259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f019406cc70 0x7f01941250b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:41288/0 (socket says 172.21.15.156:41288) 2023-09-30T22:23:27.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.535+0000 7f0198fa1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f019413c200 0x7f0194125b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:27.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.535+0000 7f0198fa1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0194127f30 con 0x7f01940a0fb0 2023-09-30T22:23:27.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.535+0000 7f0198fa1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0194127040 con 0x7f019406cc70 2023-09-30T22:23:27.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.535+0000 7f0198fa1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f019409f7d0 con 0x7f019413c200 2023-09-30T22:23:27.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.535+0000 7f0191d9b700 1 -- 172.21.15.156:0/2760231596 learned_addr learned my addr 172.21.15.156:0/2760231596 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:27.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.535+0000 7f0192d9d700 1 --2- 172.21.15.156:0/2760231596 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f019413c200 0x7f0194125b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:27.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.535+0000 7f0191d9b700 1 -- 172.21.15.156:0/2760231596 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f019413c200 msgr2=0x7f0194125b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:27.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.535+0000 7f0191d9b700 1 --2- 172.21.15.156:0/2760231596 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f019413c200 0x7f0194125b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.535+0000 7f0191d9b700 1 -- 172.21.15.156:0/2760231596 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f019406cc70 msgr2=0x7f01941250b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:27.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.535+0000 7f0191d9b700 1 --2- 172.21.15.156:0/2760231596 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f019406cc70 0x7f01941250b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.535+0000 7f0191d9b700 1 -- 172.21.15.156:0/2760231596 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0184009550 con 0x7f01940a0fb0 2023-09-30T22:23:27.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.536+0000 7f0192d9d700 1 --2- 172.21.15.156:0/2760231596 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f019413c200 0x7f0194125b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:27.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.536+0000 7f0191d9b700 1 --2- 172.21.15.156:0/2760231596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01940a0fb0 0x7f01941255f0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f018800e980 tx=0x7f018800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:27.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.536+0000 7f0182ffd700 1 -- 172.21.15.156:0/2760231596 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0188009710 con 0x7f01940a0fb0 2023-09-30T22:23:27.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.536+0000 7f0182ffd700 1 -- 172.21.15.156:0/2760231596 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018800eed0 con 0x7f01940a0fb0 2023-09-30T22:23:27.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.536+0000 7f0198fa1700 1 -- 172.21.15.156:0/2760231596 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01940a0020 con 0x7f01940a0fb0 2023-09-30T22:23:27.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.536+0000 7f0198fa1700 1 -- 172.21.15.156:0/2760231596 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01941275e0 con 0x7f01940a0fb0 2023-09-30T22:23:27.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.536+0000 7f0182ffd700 1 -- 172.21.15.156:0/2760231596 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018800ca70 con 0x7f01940a0fb0 2023-09-30T22:23:27.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.537+0000 7f0182ffd700 1 -- 172.21.15.156:0/2760231596 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f018800cc90 con 0x7f01940a0fb0 2023-09-30T22:23:27.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.537+0000 7f0182ffd700 1 -- 172.21.15.156:0/2760231596 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f018803fb50 con 0x7f01940a0fb0 2023-09-30T22:23:27.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.537+0000 7f0198fa1700 1 -- 172.21.15.156:0/2760231596 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01780052e0 con 0x7f01940a0fb0 2023-09-30T22:23:27.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.543+0000 7f0182ffd700 1 -- 172.21.15.156:0/2760231596 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0188017080 con 0x7f01940a0fb0 2023-09-30T22:23:27.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.632+0000 7f35d5b6b700 1 -- 172.21.15.156:0/271527015 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f35d004f2a0 con 0x7f35d01304a0 2023-09-30T22:23:27.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.632+0000 7f35ccff9700 1 -- 172.21.15.156:0/271527015 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f35c8020360 con 0x7f35d01304a0 2023-09-30T22:23:27.633 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:27.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.634+0000 7f35d5b6b700 1 -- 172.21.15.156:0/271527015 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35d01304a0 msgr2=0x7f35d01c3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:27.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.634+0000 7f35d5b6b700 1 --2- 172.21.15.156:0/271527015 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35d01304a0 0x7f35d01c3f40 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f35c8012420 tx=0x7f35c8012730 comp rx=0 tx=0).stop 2023-09-30T22:23:27.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.634+0000 7f35d5b6b700 1 -- 172.21.15.156:0/271527015 shutdown_connections 2023-09-30T22:23:27.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.634+0000 7f35d5b6b700 1 --2- 172.21.15.156:0/271527015 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f35d01304a0 0x7f35d01c3f40 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.634+0000 7f35d5b6b700 1 --2- 172.21.15.156:0/271527015 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f35d00a0a30 0x7f35d011ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.634+0000 7f35d5b6b700 1 --2- 172.21.15.156:0/271527015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35d00a1340 0x7f35d011f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.634+0000 7f35d5b6b700 1 -- 172.21.15.156:0/271527015 >> 172.21.15.156:0/271527015 conn(0x7f35d00a2980 msgr2=0x7f35d009deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:27.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.635+0000 7f35d5b6b700 1 -- 172.21.15.156:0/271527015 shutdown_connections 2023-09-30T22:23:27.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.635+0000 7f35d5b6b700 1 -- 172.21.15.156:0/271527015 wait complete. 2023-09-30T22:23:27.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:27.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.674+0000 7f564bfa9700 1 -- 172.21.15.156:0/1190511550 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f564406bce0 con 0x7f5644133a70 2023-09-30T22:23:27.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.674+0000 7f563a7fc700 1 -- 172.21.15.156:0/1190511550 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f563c018020 con 0x7f5644133a70 2023-09-30T22:23:27.675 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:27.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.676+0000 7f564bfa9700 1 -- 172.21.15.156:0/1190511550 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5644133a70 msgr2=0x7f564411d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:27.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.676+0000 7f564bfa9700 1 --2- 172.21.15.156:0/1190511550 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5644133a70 0x7f564411d230 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f563c009d90 tx=0x7f563c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.676+0000 7f564bfa9700 1 -- 172.21.15.156:0/1190511550 shutdown_connections 2023-09-30T22:23:27.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.676+0000 7f564bfa9700 1 --2- 172.21.15.156:0/1190511550 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5644133a70 0x7f564411d230 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.676+0000 7f564bfa9700 1 --2- 172.21.15.156:0/1190511550 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f56440a08e0 0x7f564411c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.676+0000 7f564bfa9700 1 --2- 172.21.15.156:0/1190511550 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56440a1290 0x7f564411ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.676+0000 7f564bfa9700 1 -- 172.21.15.156:0/1190511550 >> 172.21.15.156:0/1190511550 conn(0x7f56440a2980 msgr2=0x7f56441bae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:27.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.676+0000 7f564bfa9700 1 -- 172.21.15.156:0/1190511550 shutdown_connections 2023-09-30T22:23:27.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.676+0000 7f564bfa9700 1 -- 172.21.15.156:0/1190511550 wait complete. 2023-09-30T22:23:27.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:27.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.715+0000 7f6fe7861700 1 -- 172.21.15.156:0/3009821495 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6fe0121ab0 con 0x7f6fe006b250 2023-09-30T22:23:27.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.715+0000 7f6fd5ffb700 1 -- 172.21.15.156:0/3009821495 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6fd002d3a0 con 0x7f6fe006b250 2023-09-30T22:23:27.716 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:27.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.717+0000 7f6fe7861700 1 -- 172.21.15.156:0/3009821495 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fe006b250 msgr2=0x7f6fe011e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:27.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.717+0000 7f6fe7861700 1 --2- 172.21.15.156:0/3009821495 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fe006b250 0x7f6fe011e970 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0000c00 tx=0x7f6fd0004750 comp rx=0 tx=0).stop 2023-09-30T22:23:27.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.717+0000 7f6fe7861700 1 -- 172.21.15.156:0/3009821495 shutdown_connections 2023-09-30T22:23:27.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.717+0000 7f6fe7861700 1 --2- 172.21.15.156:0/3009821495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fe0137140 0x7f6fe011eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.717+0000 7f6fe7861700 1 --2- 172.21.15.156:0/3009821495 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fe006a770 0x7f6fe011e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.717+0000 7f6fe7861700 1 --2- 172.21.15.156:0/3009821495 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fe006b250 0x7f6fe011e970 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.717+0000 7f6fe7861700 1 -- 172.21.15.156:0/3009821495 >> 172.21.15.156:0/3009821495 conn(0x7f6fe0099c40 msgr2=0x7f6fe00a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:27.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.717+0000 7f6fe7861700 1 -- 172.21.15.156:0/3009821495 shutdown_connections 2023-09-30T22:23:27.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.717+0000 7f6fe7861700 1 -- 172.21.15.156:0/3009821495 wait complete. 2023-09-30T22:23:27.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:27.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.760+0000 7f0198fa1700 1 -- 172.21.15.156:0/2760231596 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0178005590 con 0x7f01940a0fb0 2023-09-30T22:23:27.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.761+0000 7f0182ffd700 1 -- 172.21.15.156:0/2760231596 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0188021020 con 0x7f01940a0fb0 2023-09-30T22:23:27.762 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:27.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.763+0000 7f0198fa1700 1 -- 172.21.15.156:0/2760231596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01940a0fb0 msgr2=0x7f01941255f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:27.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.763+0000 7f0198fa1700 1 --2- 172.21.15.156:0/2760231596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01940a0fb0 0x7f01941255f0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f018800e980 tx=0x7f018800ec90 comp rx=0 tx=0).stop 2023-09-30T22:23:27.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.763+0000 7f0198fa1700 1 -- 172.21.15.156:0/2760231596 shutdown_connections 2023-09-30T22:23:27.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.763+0000 7f0198fa1700 1 --2- 172.21.15.156:0/2760231596 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f019413c200 0x7f0194125b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.763+0000 7f0198fa1700 1 --2- 172.21.15.156:0/2760231596 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f019406cc70 0x7f01941250b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.763+0000 7f0198fa1700 1 --2- 172.21.15.156:0/2760231596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01940a0fb0 0x7f01941255f0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.763+0000 7f0198fa1700 1 -- 172.21.15.156:0/2760231596 >> 172.21.15.156:0/2760231596 conn(0x7f01940a6610 msgr2=0x7f019413c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:27.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.763+0000 7f0198fa1700 1 -- 172.21.15.156:0/2760231596 shutdown_connections 2023-09-30T22:23:27.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:27.763+0000 7f0198fa1700 1 -- 172.21.15.156:0/2760231596 wait complete. 2023-09-30T22:23:27.775 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:28.649 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:28.690 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:28.731 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:28.776 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:28.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.790+0000 7fca70bd2700 1 Processor -- start 2023-09-30T22:23:28.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.790+0000 7fca70bd2700 1 -- start start 2023-09-30T22:23:28.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.791+0000 7fca70bd2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca6c0a0a30 0x7fca6c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.791+0000 7fca70bd2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fca6c0a1340 0x7fca6c12ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.791+0000 7fca70bd2700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca6c0a1e70 con 0x7fca6c1304a0 2023-09-30T22:23:28.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.791+0000 7fca70bd2700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca6c09a720 con 0x7fca6c0a1340 2023-09-30T22:23:28.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.791+0000 7fca70bd2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c09b300 con 0x7fca6c0a0a30 2023-09-30T22:23:28.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.791+0000 7fca6ad9d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fca6c1304a0 0x7fca6c1371b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49776/0 (socket says 172.21.15.156:49776) 2023-09-30T22:23:28.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.791+0000 7fca6ad9d700 1 -- 172.21.15.156:0/3262268786 learned_addr learned my addr 172.21.15.156:0/3262268786 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:28.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.791+0000 7fca6a59c700 1 --2- 172.21.15.156:0/3262268786 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca6c0a0a30 0x7fca6c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.791+0000 7fca69d9b700 1 --2- 172.21.15.156:0/3262268786 >> v2:172.21.15.156:3300/0 conn(0x7fca6c0a1340 0x7fca6c12ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.791+0000 7fca69d9b700 1 -- 172.21.15.156:0/3262268786 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca6c0a0a30 msgr2=0x7fca6c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:28.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.791+0000 7fca69d9b700 1 --2- 172.21.15.156:0/3262268786 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca6c0a0a30 0x7fca6c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.791+0000 7fca69d9b700 1 -- 172.21.15.156:0/3262268786 >> v1:172.21.15.156:6789/0 conn(0x7fca6c1304a0 legacy=0x7fca6c1371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.791+0000 7fca69d9b700 1 -- 172.21.15.156:0/3262268786 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca6c09abc0 con 0x7fca6c0a1340 2023-09-30T22:23:28.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.791+0000 7fca6a59c700 1 --2- 172.21.15.156:0/3262268786 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca6c0a0a30 0x7fca6c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:28.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.792+0000 7fca69d9b700 1 --2- 172.21.15.156:0/3262268786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca6c0a1340 0x7fca6c12ff60 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fca6000a8e0 tx=0x7fca6000abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0bee37b85995acf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:28.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.792+0000 7fca6959a700 1 -- 172.21.15.156:0/3262268786 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6000b6e0 con 0x7fca6c0a1340 2023-09-30T22:23:28.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.792+0000 7fca6959a700 1 -- 172.21.15.156:0/3262268786 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6000b840 con 0x7fca6c0a1340 2023-09-30T22:23:28.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.792+0000 7fca6959a700 1 -- 172.21.15.156:0/3262268786 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6000bbd0 con 0x7fca6c0a1340 2023-09-30T22:23:28.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.793+0000 7fca70bd2700 1 -- 172.21.15.156:0/3262268786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca6c0a1340 msgr2=0x7fca6c12ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.793+0000 7fca70bd2700 1 --2- 172.21.15.156:0/3262268786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca6c0a1340 0x7fca6c12ff60 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fca6000a8e0 tx=0x7fca6000abf0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.793+0000 7fca70bd2700 1 -- 172.21.15.156:0/3262268786 shutdown_connections 2023-09-30T22:23:28.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.793+0000 7fca70bd2700 1 --2- 172.21.15.156:0/3262268786 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca6c0a0a30 0x7fca6c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.793+0000 7fca70bd2700 1 --2- 172.21.15.156:0/3262268786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca6c0a1340 0x7fca6c12ff60 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.793+0000 7fca70bd2700 1 -- 172.21.15.156:0/3262268786 >> 172.21.15.156:0/3262268786 conn(0x7fca6c0a2980 msgr2=0x7fca6c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:28.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.793+0000 7fca70bd2700 1 -- 172.21.15.156:0/3262268786 shutdown_connections 2023-09-30T22:23:28.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.793+0000 7fca70bd2700 1 -- 172.21.15.156:0/3262268786 wait complete. 2023-09-30T22:23:28.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.794+0000 7fca70bd2700 1 Processor -- start 2023-09-30T22:23:28.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.794+0000 7fca70bd2700 1 -- start start 2023-09-30T22:23:28.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.794+0000 7fca70bd2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca6c0a0a30 0x7fca6c120dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.794+0000 7fca70bd2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca6c0a1340 0x7fca6c121300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.794+0000 7fca70bd2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca6c1304a0 0x7fca6c121840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.794+0000 7fca70bd2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c1229d0 con 0x7fca6c0a0a30 2023-09-30T22:23:28.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.794+0000 7fca70bd2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c124340 con 0x7fca6c0a1340 2023-09-30T22:23:28.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.794+0000 7fca70bd2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c072720 con 0x7fca6c1304a0 2023-09-30T22:23:28.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.794+0000 7fca6a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca6c0a0a30 0x7fca6c120dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.794+0000 7fca6ad9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca6c1304a0 0x7fca6c121840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.794+0000 7fca6a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca6c0a0a30 0x7fca6c120dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38200/0 (socket says 172.21.15.156:38200) 2023-09-30T22:23:28.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.794+0000 7fca6a59c700 1 -- 172.21.15.156:0/2335361250 learned_addr learned my addr 172.21.15.156:0/2335361250 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:28.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.795+0000 7fca69d9b700 1 --2- 172.21.15.156:0/2335361250 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca6c0a1340 0x7fca6c121300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.795+0000 7fca6a59c700 1 -- 172.21.15.156:0/2335361250 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca6c1304a0 msgr2=0x7fca6c121840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.795+0000 7fca6a59c700 1 --2- 172.21.15.156:0/2335361250 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca6c1304a0 0x7fca6c121840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.795+0000 7fca6a59c700 1 -- 172.21.15.156:0/2335361250 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca6c0a1340 msgr2=0x7fca6c121300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.795+0000 7fca6a59c700 1 --2- 172.21.15.156:0/2335361250 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca6c0a1340 0x7fca6c121300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.795+0000 7fca6a59c700 1 -- 172.21.15.156:0/2335361250 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5c00b6d0 con 0x7fca6c0a0a30 2023-09-30T22:23:28.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.795+0000 7fca6a59c700 1 --2- 172.21.15.156:0/2335361250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca6c0a0a30 0x7fca6c120dc0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00ecc0 tx=0x7fca5c00d350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:28.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.795+0000 7fca5affd700 1 -- 172.21.15.156:0/2335361250 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c00de60 con 0x7fca6c0a0a30 2023-09-30T22:23:28.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.795+0000 7fca5affd700 1 -- 172.21.15.156:0/2335361250 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5c005a20 con 0x7fca6c0a0a30 2023-09-30T22:23:28.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.795+0000 7fca70bd2700 1 -- 172.21.15.156:0/2335361250 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca6000a550 con 0x7fca6c0a0a30 2023-09-30T22:23:28.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.795+0000 7fca5affd700 1 -- 172.21.15.156:0/2335361250 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c005d90 con 0x7fca6c0a0a30 2023-09-30T22:23:28.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.795+0000 7fca70bd2700 1 -- 172.21.15.156:0/2335361250 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca6c09ae00 con 0x7fca6c0a0a30 2023-09-30T22:23:28.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.796+0000 7fca5affd700 1 -- 172.21.15.156:0/2335361250 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fca5c006030 con 0x7fca6c0a0a30 2023-09-30T22:23:28.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.796+0000 7fca70bd2700 1 -- 172.21.15.156:0/2335361250 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca6c04f2a0 con 0x7fca6c0a0a30 2023-09-30T22:23:28.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.796+0000 7fca5affd700 1 -- 172.21.15.156:0/2335361250 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fca5c03fdc0 con 0x7fca6c0a0a30 2023-09-30T22:23:28.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.802+0000 7fca5affd700 1 -- 172.21.15.156:0/2335361250 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fca5c01f6c0 con 0x7fca6c0a0a30 2023-09-30T22:23:28.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.828+0000 7f10534a8700 1 Processor -- start 2023-09-30T22:23:28.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.829+0000 7f10534a8700 1 -- start start 2023-09-30T22:23:28.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.829+0000 7f10534a8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f104c0a0a30 0x7f104c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.829+0000 7f10534a8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f104c0a1340 0x7f104c12ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.829+0000 7f10534a8700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f104c0a1e70 con 0x7f104c1304a0 2023-09-30T22:23:28.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.829+0000 7f10534a8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f104c09a720 con 0x7f104c0a1340 2023-09-30T22:23:28.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.829+0000 7f10534a8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f104c09b300 con 0x7f104c0a0a30 2023-09-30T22:23:28.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.829+0000 7f1051244700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f104c0a0a30 0x7f104c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.829+0000 7f1051244700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f104c0a0a30 0x7f104c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51082/0 (socket says 172.21.15.156:51082) 2023-09-30T22:23:28.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.829+0000 7f1051244700 1 -- 172.21.15.156:0/2940999810 learned_addr learned my addr 172.21.15.156:0/2940999810 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:28.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.829+0000 7f1050a43700 1 --2- 172.21.15.156:0/2940999810 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f104c0a1340 0x7f104c12ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.830+0000 7f1051244700 1 -- 172.21.15.156:0/2940999810 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f104c0a1340 msgr2=0x7f104c12ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:28.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.830+0000 7f1051244700 1 --2- 172.21.15.156:0/2940999810 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f104c0a1340 0x7f104c12ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.830+0000 7f1051244700 1 -- 172.21.15.156:0/2940999810 >> v1:172.21.15.156:6789/0 conn(0x7f104c1304a0 legacy=0x7f104c1371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.830+0000 7f1051244700 1 -- 172.21.15.156:0/2940999810 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f104c09abc0 con 0x7f104c0a0a30 2023-09-30T22:23:28.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.830+0000 7f1051244700 1 --2- 172.21.15.156:0/2940999810 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f104c0a0a30 0x7f104c0a0e00 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f10480098f0 tx=0x7f1048009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ab917ea70be4659 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:28.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.830+0000 7f1043fff700 1 -- 172.21.15.156:0/2940999810 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1048005e30 con 0x7f104c0a0a30 2023-09-30T22:23:28.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.830+0000 7f1043fff700 1 -- 172.21.15.156:0/2940999810 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1048004030 con 0x7f104c0a0a30 2023-09-30T22:23:28.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.830+0000 7f1043fff700 1 -- 172.21.15.156:0/2940999810 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10480043e0 con 0x7f104c0a0a30 2023-09-30T22:23:28.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.831+0000 7f10534a8700 1 -- 172.21.15.156:0/2940999810 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f104c0a0a30 msgr2=0x7f104c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.831+0000 7f10534a8700 1 --2- 172.21.15.156:0/2940999810 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f104c0a0a30 0x7f104c0a0e00 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f10480098f0 tx=0x7f1048009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:28.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.831+0000 7f10534a8700 1 -- 172.21.15.156:0/2940999810 shutdown_connections 2023-09-30T22:23:28.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.831+0000 7f10534a8700 1 --2- 172.21.15.156:0/2940999810 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f104c0a0a30 0x7f104c0a0e00 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.831+0000 7f10534a8700 1 --2- 172.21.15.156:0/2940999810 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f104c0a1340 0x7f104c12ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.831+0000 7f10534a8700 1 -- 172.21.15.156:0/2940999810 >> 172.21.15.156:0/2940999810 conn(0x7f104c0a2980 msgr2=0x7f104c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:28.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.831+0000 7f10534a8700 1 -- 172.21.15.156:0/2940999810 shutdown_connections 2023-09-30T22:23:28.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.831+0000 7f10534a8700 1 -- 172.21.15.156:0/2940999810 wait complete. 2023-09-30T22:23:28.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.832+0000 7f10534a8700 1 Processor -- start 2023-09-30T22:23:28.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.833+0000 7f10534a8700 1 -- start start 2023-09-30T22:23:28.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.833+0000 7f10534a8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f104c0a0a30 0x7f104c1c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.833+0000 7f10534a8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f104c0a1340 0x7f104c1c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.833+0000 7f10534a8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f104c1304a0 0x7f104c1c9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.833+0000 7f10534a8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104c11fb50 con 0x7f104c0a0a30 2023-09-30T22:23:28.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.833+0000 7f10534a8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f104c1262b0 con 0x7f104c1304a0 2023-09-30T22:23:28.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.833+0000 7f10534a8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f104c1207e0 con 0x7f104c0a1340 2023-09-30T22:23:28.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.833+0000 7f1051244700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f104c0a0a30 0x7f104c1c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.833+0000 7f1051244700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f104c0a0a30 0x7f104c1c87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38210/0 (socket says 172.21.15.156:38210) 2023-09-30T22:23:28.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.833+0000 7f1051244700 1 -- 172.21.15.156:0/1452776277 learned_addr learned my addr 172.21.15.156:0/1452776277 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:28.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.833+0000 7f1051a45700 1 --2- 172.21.15.156:0/1452776277 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f104c1304a0 0x7f104c1c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.833+0000 7f1050a43700 1 --2- 172.21.15.156:0/1452776277 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f104c0a1340 0x7f104c1c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.834+0000 7f1051a45700 1 -- 172.21.15.156:0/1452776277 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f104c0a1340 msgr2=0x7f104c1c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.834+0000 7f1051a45700 1 --2- 172.21.15.156:0/1452776277 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f104c0a1340 0x7f104c1c8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.834+0000 7f1051a45700 1 -- 172.21.15.156:0/1452776277 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f104c0a0a30 msgr2=0x7f104c1c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.834+0000 7f1051a45700 1 --2- 172.21.15.156:0/1452776277 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f104c0a0a30 0x7f104c1c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.834+0000 7f1051a45700 1 -- 172.21.15.156:0/1452776277 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1048009500 con 0x7f104c1304a0 2023-09-30T22:23:28.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.834+0000 7f1051244700 1 --2- 172.21.15.156:0/1452776277 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f104c0a0a30 0x7f104c1c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:28.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.834+0000 7f1051a45700 1 --2- 172.21.15.156:0/1452776277 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f104c1304a0 0x7f104c1c9220 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f104400cb90 tx=0x7f104400cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:28.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.834+0000 7f1041ffb700 1 -- 172.21.15.156:0/1452776277 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1044003c00 con 0x7f104c1304a0 2023-09-30T22:23:28.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.834+0000 7f1041ffb700 1 -- 172.21.15.156:0/1452776277 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1044003d60 con 0x7f104c1304a0 2023-09-30T22:23:28.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.834+0000 7f10534a8700 1 -- 172.21.15.156:0/1452776277 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f104c1257d0 con 0x7f104c1304a0 2023-09-30T22:23:28.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.834+0000 7f1041ffb700 1 -- 172.21.15.156:0/1452776277 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104400aa80 con 0x7f104c1304a0 2023-09-30T22:23:28.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.834+0000 7f10534a8700 1 -- 172.21.15.156:0/1452776277 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f104c09e870 con 0x7f104c1304a0 2023-09-30T22:23:28.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.835+0000 7f1041ffb700 1 -- 172.21.15.156:0/1452776277 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f104400abe0 con 0x7f104c1304a0 2023-09-30T22:23:28.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.836+0000 7f1041ffb700 1 -- 172.21.15.156:0/1452776277 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1044004030 con 0x7f104c1304a0 2023-09-30T22:23:28.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.836+0000 7f10534a8700 1 -- 172.21.15.156:0/1452776277 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f104c04f2a0 con 0x7f104c1304a0 2023-09-30T22:23:28.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.845+0000 7f1041ffb700 1 -- 172.21.15.156:0/1452776277 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1044044060 con 0x7f104c1304a0 2023-09-30T22:23:28.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.886+0000 7f1e5115a700 1 Processor -- start 2023-09-30T22:23:28.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.886+0000 7f1e5115a700 1 -- start start 2023-09-30T22:23:28.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.886+0000 7f1e5115a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e4c09dec0 0x7f1e4c06b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.886+0000 7f1e5115a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1e4c136cb0 0x7f1e4c139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.886+0000 7f1e5115a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e4c06e900 con 0x7f1e4c06a770 2023-09-30T22:23:28.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.886+0000 7f1e5115a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e4c09d180 con 0x7f1e4c136cb0 2023-09-30T22:23:28.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.887+0000 7f1e5115a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c09e780 con 0x7f1e4c09dec0 2023-09-30T22:23:28.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.887+0000 7f1e4b59e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1e4c136cb0 0x7f1e4c139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.887+0000 7f1e4b59e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1e4c136cb0 0x7f1e4c139090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38218/0 (socket says 172.21.15.156:38218) 2023-09-30T22:23:28.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.887+0000 7f1e4b59e700 1 -- 172.21.15.156:0/221603198 learned_addr learned my addr 172.21.15.156:0/221603198 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:28.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.887+0000 7f1e4ad9d700 1 --1- 172.21.15.156:0/221603198 >> v1:172.21.15.156:6789/0 conn(0x7f1e4c06a770 0x7f1e4c06ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49794/0 (socket says 172.21.15.156:49794) 2023-09-30T22:23:28.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.887+0000 7f1e4a59c700 1 --2- 172.21.15.156:0/221603198 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e4c09dec0 0x7f1e4c06b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.887+0000 7f1e4b59e700 1 -- 172.21.15.156:0/221603198 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e4c09dec0 msgr2=0x7f1e4c06b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:28.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.887+0000 7f1e4b59e700 1 --2- 172.21.15.156:0/221603198 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e4c09dec0 0x7f1e4c06b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.887+0000 7f1e4b59e700 1 -- 172.21.15.156:0/221603198 >> v1:172.21.15.156:6789/0 conn(0x7f1e4c06a770 legacy=0x7f1e4c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.887+0000 7f1e49d9b700 1 -- 172.21.15.156:0/221603198 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560816219 0 0) 0x7f1e4c06e900 con 0x7f1e4c06a770 2023-09-30T22:23:28.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.887+0000 7f1e4b59e700 1 -- 172.21.15.156:0/221603198 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e4c09d3c0 con 0x7f1e4c136cb0 2023-09-30T22:23:28.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.887+0000 7f1e4b59e700 1 --2- 172.21.15.156:0/221603198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e4c136cb0 0x7f1e4c139090 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f1e44009e50 tx=0x7f1e4400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4a1134c038de1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:28.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.887+0000 7f1e49d9b700 1 -- 172.21.15.156:0/221603198 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4400e070 con 0x7f1e4c136cb0 2023-09-30T22:23:28.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.888+0000 7f1e49d9b700 1 -- 172.21.15.156:0/221603198 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4400b910 con 0x7f1e4c136cb0 2023-09-30T22:23:28.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.888+0000 7f1e49d9b700 1 -- 172.21.15.156:0/221603198 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4400bcc0 con 0x7f1e4c136cb0 2023-09-30T22:23:28.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.888+0000 7f1e5115a700 1 -- 172.21.15.156:0/221603198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e4c136cb0 msgr2=0x7f1e4c139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.888+0000 7f1e5115a700 1 --2- 172.21.15.156:0/221603198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e4c136cb0 0x7f1e4c139090 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f1e44009e50 tx=0x7f1e4400b330 comp rx=0 tx=0).stop 2023-09-30T22:23:28.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.888+0000 7f1e5115a700 1 -- 172.21.15.156:0/221603198 shutdown_connections 2023-09-30T22:23:28.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.888+0000 7f1e5115a700 1 --2- 172.21.15.156:0/221603198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e4c136cb0 0x7f1e4c139090 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.888+0000 7f1e5115a700 1 --2- 172.21.15.156:0/221603198 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e4c09dec0 0x7f1e4c06b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.888+0000 7f1e5115a700 1 -- 172.21.15.156:0/221603198 >> 172.21.15.156:0/221603198 conn(0x7f1e4c099c40 msgr2=0x7f1e4c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:28.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.888+0000 7f1e5115a700 1 -- 172.21.15.156:0/221603198 shutdown_connections 2023-09-30T22:23:28.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.889+0000 7f1e5115a700 1 -- 172.21.15.156:0/221603198 wait complete. 2023-09-30T22:23:28.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.890+0000 7f1e5115a700 1 Processor -- start 2023-09-30T22:23:28.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.890+0000 7f1e5115a700 1 -- start start 2023-09-30T22:23:28.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.891+0000 7f1e5115a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e4c06a770 0x7f1e4c09a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.891+0000 7f1e5115a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e4c09dec0 0x7f1e4c09a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.891+0000 7f1e5115a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e4c136cb0 0x7f1e4c09af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.891+0000 7f1e5115a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c12f230 con 0x7f1e4c09dec0 2023-09-30T22:23:28.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.891+0000 7f1e5115a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c071ce0 con 0x7f1e4c06a770 2023-09-30T22:23:28.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.891+0000 7f1e5115a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c09c0a0 con 0x7f1e4c136cb0 2023-09-30T22:23:28.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.891+0000 7f1e4ad9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e4c06a770 0x7f1e4c09a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.891+0000 7f1e4ad9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e4c06a770 0x7f1e4c09a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:41352/0 (socket says 172.21.15.156:41352) 2023-09-30T22:23:28.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.891+0000 7f1e4ad9d700 1 -- 172.21.15.156:0/2246725606 learned_addr learned my addr 172.21.15.156:0/2246725606 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:28.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.891+0000 7f1e4a59c700 1 --2- 172.21.15.156:0/2246725606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e4c09dec0 0x7f1e4c09a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.891+0000 7f1e4b59e700 1 --2- 172.21.15.156:0/2246725606 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e4c136cb0 0x7f1e4c09af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.891+0000 7f1e4ad9d700 1 -- 172.21.15.156:0/2246725606 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e4c136cb0 msgr2=0x7f1e4c09af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.891+0000 7f1e4ad9d700 1 --2- 172.21.15.156:0/2246725606 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e4c136cb0 0x7f1e4c09af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.892+0000 7f1e4ad9d700 1 -- 172.21.15.156:0/2246725606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e4c09dec0 msgr2=0x7f1e4c09a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.892+0000 7f1e4ad9d700 1 --2- 172.21.15.156:0/2246725606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e4c09dec0 0x7f1e4c09a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.892+0000 7f1e4ad9d700 1 -- 172.21.15.156:0/2246725606 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e44009b30 con 0x7f1e4c06a770 2023-09-30T22:23:28.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.892+0000 7f1e4ad9d700 1 --2- 172.21.15.156:0/2246725606 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e4c06a770 0x7f1e4c09a490 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c00c550 tx=0x7f1e3c00c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:28.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.892+0000 7f1e337fe700 1 -- 172.21.15.156:0/2246725606 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c004c80 con 0x7f1e4c06a770 2023-09-30T22:23:28.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.892+0000 7f1e337fe700 1 -- 172.21.15.156:0/2246725606 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3c004de0 con 0x7f1e4c06a770 2023-09-30T22:23:28.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.892+0000 7f1e5115a700 1 -- 172.21.15.156:0/2246725606 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e4c135da0 con 0x7f1e4c06a770 2023-09-30T22:23:28.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.892+0000 7f1e337fe700 1 -- 172.21.15.156:0/2246725606 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c007310 con 0x7f1e4c06a770 2023-09-30T22:23:28.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.892+0000 7f1e5115a700 1 -- 172.21.15.156:0/2246725606 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4c135a60 con 0x7f1e4c06a770 2023-09-30T22:23:28.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.893+0000 7f1e5115a700 1 -- 172.21.15.156:0/2246725606 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e4c04f2a0 con 0x7f1e4c06a770 2023-09-30T22:23:28.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.893+0000 7f1e337fe700 1 -- 172.21.15.156:0/2246725606 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e3c007470 con 0x7f1e4c06a770 2023-09-30T22:23:28.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.893+0000 7f1e337fe700 1 -- 172.21.15.156:0/2246725606 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1e3c03f280 con 0x7f1e4c06a770 2023-09-30T22:23:28.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.898+0000 7f1e337fe700 1 -- 172.21.15.156:0/2246725606 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e3c0133c0 con 0x7f1e4c06a770 2023-09-30T22:23:28.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.925+0000 7f75eae7d700 1 Processor -- start 2023-09-30T22:23:28.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.925+0000 7f75eae7d700 1 -- start start 2023-09-30T22:23:28.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.926+0000 7f75eae7d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f75e409d860 0x7f75e409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.926+0000 7f75eae7d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75e409e170 0x7f75e41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.926+0000 7f75eae7d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e409aaa0 con 0x7f75e4130ce0 2023-09-30T22:23:28.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.926+0000 7f75eae7d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e409f870 con 0x7f75e409d860 2023-09-30T22:23:28.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.926+0000 7f75eae7d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75e409b360 con 0x7f75e409e170 2023-09-30T22:23:28.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.926+0000 7f75e8c19700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f75e409d860 0x7f75e409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.926+0000 7f75e8c19700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f75e409d860 0x7f75e409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38232/0 (socket says 172.21.15.156:38232) 2023-09-30T22:23:28.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.926+0000 7f75e8c19700 1 -- 172.21.15.156:0/1467288717 learned_addr learned my addr 172.21.15.156:0/1467288717 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:28.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.926+0000 7f75e3fff700 1 --2- 172.21.15.156:0/1467288717 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75e409e170 0x7f75e41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.926+0000 7f75e37fe700 1 -- 172.21.15.156:0/1467288717 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2730481918 0 0) 0x7f75e409aaa0 con 0x7f75e4130ce0 2023-09-30T22:23:28.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.926+0000 7f75e8c19700 1 -- 172.21.15.156:0/1467288717 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75e409e170 msgr2=0x7f75e41307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:28.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.926+0000 7f75e8c19700 1 --2- 172.21.15.156:0/1467288717 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75e409e170 0x7f75e41307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.927+0000 7f75e8c19700 1 -- 172.21.15.156:0/1467288717 >> v1:172.21.15.156:6789/0 conn(0x7f75e4130ce0 legacy=0x7f75e41379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.927+0000 7f75e8c19700 1 -- 172.21.15.156:0/1467288717 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e409b620 con 0x7f75e409d860 2023-09-30T22:23:28.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.927+0000 7f75e8c19700 1 --2- 172.21.15.156:0/1467288717 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e409d860 0x7f75e409dc30 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f75d80098f0 tx=0x7f75d8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12720dbdb232890 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:28.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.927+0000 7f75e37fe700 1 -- 172.21.15.156:0/1467288717 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d8011830 con 0x7f75e409d860 2023-09-30T22:23:28.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.927+0000 7f75e37fe700 1 -- 172.21.15.156:0/1467288717 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d8011990 con 0x7f75e409d860 2023-09-30T22:23:28.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.927+0000 7f75e37fe700 1 -- 172.21.15.156:0/1467288717 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d8011d20 con 0x7f75e409d860 2023-09-30T22:23:28.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.927+0000 7f75eae7d700 1 -- 172.21.15.156:0/1467288717 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e409d860 msgr2=0x7f75e409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.927+0000 7f75eae7d700 1 --2- 172.21.15.156:0/1467288717 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e409d860 0x7f75e409dc30 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f75d80098f0 tx=0x7f75d8009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:28.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.928+0000 7f75eae7d700 1 -- 172.21.15.156:0/1467288717 shutdown_connections 2023-09-30T22:23:28.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.928+0000 7f75eae7d700 1 --2- 172.21.15.156:0/1467288717 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e409d860 0x7f75e409dc30 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.928+0000 7f75eae7d700 1 --2- 172.21.15.156:0/1467288717 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75e409e170 0x7f75e41307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.928+0000 7f75eae7d700 1 -- 172.21.15.156:0/1467288717 >> 172.21.15.156:0/1467288717 conn(0x7f75e4099c40 msgr2=0x7f75e40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:28.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.928+0000 7f75eae7d700 1 -- 172.21.15.156:0/1467288717 shutdown_connections 2023-09-30T22:23:28.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.928+0000 7f75eae7d700 1 -- 172.21.15.156:0/1467288717 wait complete. 2023-09-30T22:23:28.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.929+0000 7f75eae7d700 1 Processor -- start 2023-09-30T22:23:28.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.929+0000 7f75eae7d700 1 -- start start 2023-09-30T22:23:28.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.929+0000 7f75eae7d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e409d860 0x7f75e411e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.929+0000 7f75eae7d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75e409e170 0x7f75e411ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.929+0000 7f75eae7d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75e4130ce0 0x7f75e411ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.929+0000 7f75eae7d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e4121f80 con 0x7f75e409d860 2023-09-30T22:23:28.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.929+0000 7f75eae7d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e40a06f0 con 0x7f75e4130ce0 2023-09-30T22:23:28.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.929+0000 7f75eae7d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75e409c8b0 con 0x7f75e409e170 2023-09-30T22:23:28.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.930+0000 7f75e8c19700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e409d860 0x7f75e411e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.930+0000 7f75e8c19700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e409d860 0x7f75e411e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38246/0 (socket says 172.21.15.156:38246) 2023-09-30T22:23:28.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.930+0000 7f75e8c19700 1 -- 172.21.15.156:0/1950959092 learned_addr learned my addr 172.21.15.156:0/1950959092 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:28.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.930+0000 7f75e3fff700 1 --2- 172.21.15.156:0/1950959092 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75e409e170 0x7f75e411ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.930+0000 7f75e941a700 1 --2- 172.21.15.156:0/1950959092 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75e4130ce0 0x7f75e411ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.930+0000 7f75e3fff700 1 -- 172.21.15.156:0/1950959092 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75e4130ce0 msgr2=0x7f75e411ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.930+0000 7f75e3fff700 1 --2- 172.21.15.156:0/1950959092 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75e4130ce0 0x7f75e411ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.930+0000 7f75e3fff700 1 -- 172.21.15.156:0/1950959092 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e409d860 msgr2=0x7f75e411e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.930+0000 7f75e3fff700 1 --2- 172.21.15.156:0/1950959092 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e409d860 0x7f75e411e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.930+0000 7f75e3fff700 1 -- 172.21.15.156:0/1950959092 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d8009550 con 0x7f75e409e170 2023-09-30T22:23:28.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.930+0000 7f75e8c19700 1 --2- 172.21.15.156:0/1950959092 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e409d860 0x7f75e411e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:28.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.930+0000 7f75e3fff700 1 --2- 172.21.15.156:0/1950959092 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75e409e170 0x7f75e411ea40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f75d0010da0 tx=0x7f75d000e640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:28.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.930+0000 7f75e17fa700 1 -- 172.21.15.156:0/1950959092 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d000eda0 con 0x7f75e409e170 2023-09-30T22:23:28.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.930+0000 7f75e17fa700 1 -- 172.21.15.156:0/1950959092 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d0011450 con 0x7f75e409e170 2023-09-30T22:23:28.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.930+0000 7f75eae7d700 1 -- 172.21.15.156:0/1950959092 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e4120110 con 0x7f75e409e170 2023-09-30T22:23:28.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.930+0000 7f75e17fa700 1 -- 172.21.15.156:0/1950959092 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d00117c0 con 0x7f75e409e170 2023-09-30T22:23:28.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.930+0000 7f75eae7d700 1 -- 172.21.15.156:0/1950959092 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e4130410 con 0x7f75e409e170 2023-09-30T22:23:28.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.931+0000 7f75eae7d700 1 -- 172.21.15.156:0/1950959092 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e404f2a0 con 0x7f75e409e170 2023-09-30T22:23:28.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.932+0000 7f75e17fa700 1 -- 172.21.15.156:0/1950959092 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f75d0011920 con 0x7f75e409e170 2023-09-30T22:23:28.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.932+0000 7f75e17fa700 1 -- 172.21.15.156:0/1950959092 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f75d0041870 con 0x7f75e409e170 2023-09-30T22:23:28.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:28.936+0000 7f75e17fa700 1 -- 172.21.15.156:0/1950959092 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f75d0045060 con 0x7f75e409e170 2023-09-30T22:23:29.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.027+0000 7fca70bd2700 1 -- 172.21.15.156:0/2335361250 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fca6c130280 con 0x7fca6c0a0a30 2023-09-30T22:23:29.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.027+0000 7fca5affd700 1 -- 172.21.15.156:0/2335361250 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fca5c01f300 con 0x7fca6c0a0a30 2023-09-30T22:23:29.028 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:29.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.030+0000 7fca70bd2700 1 -- 172.21.15.156:0/2335361250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca6c0a0a30 msgr2=0x7fca6c120dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:29.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.030+0000 7fca70bd2700 1 --2- 172.21.15.156:0/2335361250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca6c0a0a30 0x7fca6c120dc0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00ecc0 tx=0x7fca5c00d350 comp rx=0 tx=0).stop 2023-09-30T22:23:29.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.031+0000 7fca70bd2700 1 -- 172.21.15.156:0/2335361250 shutdown_connections 2023-09-30T22:23:29.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.031+0000 7fca70bd2700 1 --2- 172.21.15.156:0/2335361250 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca6c1304a0 0x7fca6c121840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.031+0000 7fca70bd2700 1 --2- 172.21.15.156:0/2335361250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca6c0a0a30 0x7fca6c120dc0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.031+0000 7fca70bd2700 1 --2- 172.21.15.156:0/2335361250 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca6c0a1340 0x7fca6c121300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.031+0000 7fca70bd2700 1 -- 172.21.15.156:0/2335361250 >> 172.21.15.156:0/2335361250 conn(0x7fca6c0a2980 msgr2=0x7fca6c12e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:29.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.031+0000 7fca70bd2700 1 -- 172.21.15.156:0/2335361250 shutdown_connections 2023-09-30T22:23:29.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.031+0000 7fca70bd2700 1 -- 172.21.15.156:0/2335361250 wait complete. 2023-09-30T22:23:29.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.046+0000 7f10534a8700 1 -- 172.21.15.156:0/1452776277 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f104c12edc0 con 0x7f104c1304a0 2023-09-30T22:23:29.048 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:29.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.047+0000 7f1041ffb700 1 -- 172.21.15.156:0/1452776277 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1044032020 con 0x7f104c1304a0 2023-09-30T22:23:29.048 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:29.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.050+0000 7f10534a8700 1 -- 172.21.15.156:0/1452776277 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f104c1304a0 msgr2=0x7f104c1c9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:29.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.050+0000 7f10534a8700 1 --2- 172.21.15.156:0/1452776277 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f104c1304a0 0x7f104c1c9220 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f104400cb90 tx=0x7f104400cea0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.050+0000 7f10534a8700 1 -- 172.21.15.156:0/1452776277 shutdown_connections 2023-09-30T22:23:29.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.050+0000 7f10534a8700 1 --2- 172.21.15.156:0/1452776277 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f104c1304a0 0x7f104c1c9220 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.050+0000 7f10534a8700 1 --2- 172.21.15.156:0/1452776277 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f104c0a0a30 0x7f104c1c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.050+0000 7f10534a8700 1 --2- 172.21.15.156:0/1452776277 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f104c0a1340 0x7f104c1c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.050+0000 7f10534a8700 1 -- 172.21.15.156:0/1452776277 >> 172.21.15.156:0/1452776277 conn(0x7f104c0a2980 msgr2=0x7f104c06e450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:29.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.051+0000 7f10534a8700 1 -- 172.21.15.156:0/1452776277 shutdown_connections 2023-09-30T22:23:29.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.051+0000 7f10534a8700 1 -- 172.21.15.156:0/1452776277 wait complete. 2023-09-30T22:23:29.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:29.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.101+0000 7f1e5115a700 1 -- 172.21.15.156:0/2246725606 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1e4c136530 con 0x7f1e4c06a770 2023-09-30T22:23:29.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.101+0000 7f1e337fe700 1 -- 172.21.15.156:0/2246725606 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e3c0102c0 con 0x7f1e4c06a770 2023-09-30T22:23:29.102 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:29.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.103+0000 7f1e5115a700 1 -- 172.21.15.156:0/2246725606 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e4c06a770 msgr2=0x7f1e4c09a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:29.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.103+0000 7f1e5115a700 1 --2- 172.21.15.156:0/2246725606 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e4c06a770 0x7f1e4c09a490 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c00c550 tx=0x7f1e3c00c860 comp rx=0 tx=0).stop 2023-09-30T22:23:29.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.103+0000 7f1e5115a700 1 -- 172.21.15.156:0/2246725606 shutdown_connections 2023-09-30T22:23:29.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.103+0000 7f1e5115a700 1 --2- 172.21.15.156:0/2246725606 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e4c136cb0 0x7f1e4c09af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.103+0000 7f1e5115a700 1 --2- 172.21.15.156:0/2246725606 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e4c06a770 0x7f1e4c09a490 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.103+0000 7f1e5115a700 1 --2- 172.21.15.156:0/2246725606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e4c09dec0 0x7f1e4c09a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.103+0000 7f1e5115a700 1 -- 172.21.15.156:0/2246725606 >> 172.21.15.156:0/2246725606 conn(0x7f1e4c099c40 msgr2=0x7f1e4c0a25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:29.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.103+0000 7f1e5115a700 1 -- 172.21.15.156:0/2246725606 shutdown_connections 2023-09-30T22:23:29.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.103+0000 7f1e5115a700 1 -- 172.21.15.156:0/2246725606 wait complete. 2023-09-30T22:23:29.116 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:29.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.140+0000 7f75eae7d700 1 -- 172.21.15.156:0/1950959092 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f75e4121650 con 0x7f75e409e170 2023-09-30T22:23:29.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.141+0000 7f75e17fa700 1 -- 172.21.15.156:0/1950959092 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f75d0045070 con 0x7f75e409e170 2023-09-30T22:23:29.141 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:29.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.143+0000 7f75eae7d700 1 -- 172.21.15.156:0/1950959092 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75e409e170 msgr2=0x7f75e411ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:29.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.143+0000 7f75eae7d700 1 --2- 172.21.15.156:0/1950959092 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75e409e170 0x7f75e411ea40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f75d0010da0 tx=0x7f75d000e640 comp rx=0 tx=0).stop 2023-09-30T22:23:29.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.143+0000 7f75eae7d700 1 -- 172.21.15.156:0/1950959092 shutdown_connections 2023-09-30T22:23:29.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.143+0000 7f75eae7d700 1 --2- 172.21.15.156:0/1950959092 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75e4130ce0 0x7f75e411ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.143+0000 7f75eae7d700 1 --2- 172.21.15.156:0/1950959092 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e409d860 0x7f75e411e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.143+0000 7f75eae7d700 1 --2- 172.21.15.156:0/1950959092 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75e409e170 0x7f75e411ea40 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.143+0000 7f75eae7d700 1 -- 172.21.15.156:0/1950959092 >> 172.21.15.156:0/1950959092 conn(0x7f75e4099c40 msgr2=0x7f75e40a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:29.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.143+0000 7f75eae7d700 1 -- 172.21.15.156:0/1950959092 shutdown_connections 2023-09-30T22:23:29.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:29.143+0000 7f75eae7d700 1 -- 172.21.15.156:0/1950959092 wait complete. 2023-09-30T22:23:29.155 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:30.048 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:30.065 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:30.117 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:30.156 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:30.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.185+0000 7f9b4a25d700 1 Processor -- start 2023-09-30T22:23:30.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.185+0000 7f9b4a25d700 1 -- start start 2023-09-30T22:23:30.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.185+0000 7f9b4a25d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b4409ad40 0x7f9b44133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.185+0000 7f9b4a25d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9b441343a0 0x7f9b440a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.185+0000 7f9b4a25d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4409b110 con 0x7f9b44133f70 2023-09-30T22:23:30.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.185+0000 7f9b4a25d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b440a3b60 con 0x7f9b441343a0 2023-09-30T22:23:30.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.186+0000 7f9b4a25d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b440a2fa0 con 0x7f9b4409ad40 2023-09-30T22:23:30.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.186+0000 7f9b42ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f9b44133f70 0x7f9b440a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49810/0 (socket says 172.21.15.156:49810) 2023-09-30T22:23:30.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.186+0000 7f9b42ffd700 1 -- 172.21.15.156:0/206290455 learned_addr learned my addr 172.21.15.156:0/206290455 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:30.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.186+0000 7f9b437fe700 1 --2- 172.21.15.156:0/206290455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b4409ad40 0x7f9b44133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.186+0000 7f9b43fff700 1 --2- 172.21.15.156:0/206290455 >> v2:172.21.15.156:3300/0 conn(0x7f9b441343a0 0x7f9b440a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.186+0000 7f9b437fe700 1 -- 172.21.15.156:0/206290455 >> v2:172.21.15.156:3300/0 conn(0x7f9b441343a0 msgr2=0x7f9b440a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:30.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.186+0000 7f9b437fe700 1 --2- 172.21.15.156:0/206290455 >> v2:172.21.15.156:3300/0 conn(0x7f9b441343a0 0x7f9b440a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.186+0000 7f9b437fe700 1 -- 172.21.15.156:0/206290455 >> v1:172.21.15.156:6789/0 conn(0x7f9b44133f70 legacy=0x7f9b440a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:30.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.186+0000 7f9b437fe700 1 -- 172.21.15.156:0/206290455 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4409a280 con 0x7f9b4409ad40 2023-09-30T22:23:30.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.187+0000 7f9b437fe700 1 --2- 172.21.15.156:0/206290455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b4409ad40 0x7f9b44133a30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9b34009870 tx=0x7f9b34009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdfe14048fb2b5b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:30.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.187+0000 7f9b427fc700 1 -- 172.21.15.156:0/206290455 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b34011830 con 0x7f9b4409ad40 2023-09-30T22:23:30.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.187+0000 7f9b427fc700 1 -- 172.21.15.156:0/206290455 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b34011990 con 0x7f9b4409ad40 2023-09-30T22:23:30.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.187+0000 7f9b427fc700 1 -- 172.21.15.156:0/206290455 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b34011d20 con 0x7f9b4409ad40 2023-09-30T22:23:30.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.188+0000 7f9b4a25d700 1 -- 172.21.15.156:0/206290455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b4409ad40 msgr2=0x7f9b44133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:30.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.188+0000 7f9b4a25d700 1 --2- 172.21.15.156:0/206290455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b4409ad40 0x7f9b44133a30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9b34009870 tx=0x7f9b34009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:30.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.188+0000 7f9b4a25d700 1 -- 172.21.15.156:0/206290455 shutdown_connections 2023-09-30T22:23:30.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.188+0000 7f9b4a25d700 1 --2- 172.21.15.156:0/206290455 >> v2:172.21.15.156:3300/0 conn(0x7f9b441343a0 0x7f9b440a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.188+0000 7f9b4a25d700 1 --2- 172.21.15.156:0/206290455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b4409ad40 0x7f9b44133a30 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.188+0000 7f9b4a25d700 1 -- 172.21.15.156:0/206290455 >> 172.21.15.156:0/206290455 conn(0x7f9b44099c40 msgr2=0x7f9b4406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:30.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.188+0000 7f9b4a25d700 1 -- 172.21.15.156:0/206290455 shutdown_connections 2023-09-30T22:23:30.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.188+0000 7f9b4a25d700 1 -- 172.21.15.156:0/206290455 wait complete. 2023-09-30T22:23:30.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.189+0000 7f9b4a25d700 1 Processor -- start 2023-09-30T22:23:30.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.189+0000 7f9b4a25d700 1 -- start start 2023-09-30T22:23:30.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.189+0000 7f9b4a25d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b4409ad40 0x7f9b441223c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.189+0000 7f9b4a25d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b44133f70 0x7f9b44122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.189+0000 7f9b4a25d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b441343a0 0x7f9b44122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.189+0000 7f9b4a25d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b44124120 con 0x7f9b441343a0 2023-09-30T22:23:30.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.189+0000 7f9b4a25d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b44123f30 con 0x7f9b44133f70 2023-09-30T22:23:30.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.189+0000 7f9b4a25d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b44124e00 con 0x7f9b4409ad40 2023-09-30T22:23:30.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.190+0000 7f9b43fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b441343a0 0x7f9b44122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.190+0000 7f9b437fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b4409ad40 0x7f9b441223c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.190+0000 7f9b437fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b4409ad40 0x7f9b441223c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51122/0 (socket says 172.21.15.156:51122) 2023-09-30T22:23:30.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.190+0000 7f9b437fe700 1 -- 172.21.15.156:0/1918058996 learned_addr learned my addr 172.21.15.156:0/1918058996 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:30.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.190+0000 7f9b43fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b441343a0 0x7f9b44122e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38264/0 (socket says 172.21.15.156:38264) 2023-09-30T22:23:30.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.190+0000 7f9b42ffd700 1 --2- 172.21.15.156:0/1918058996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b44133f70 0x7f9b44122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.190+0000 7f9b437fe700 1 -- 172.21.15.156:0/1918058996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b44133f70 msgr2=0x7f9b44122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:30.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.190+0000 7f9b437fe700 1 --2- 172.21.15.156:0/1918058996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b44133f70 0x7f9b44122900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.190+0000 7f9b437fe700 1 -- 172.21.15.156:0/1918058996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b441343a0 msgr2=0x7f9b44122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:30.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.190+0000 7f9b437fe700 1 --2- 172.21.15.156:0/1918058996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b441343a0 0x7f9b44122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.190+0000 7f9b437fe700 1 -- 172.21.15.156:0/1918058996 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b340094a0 con 0x7f9b4409ad40 2023-09-30T22:23:30.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.190+0000 7f9b43fff700 1 --2- 172.21.15.156:0/1918058996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b441343a0 0x7f9b44122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:30.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.190+0000 7f9b437fe700 1 --2- 172.21.15.156:0/1918058996 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b4409ad40 0x7f9b441223c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9b340097c0 tx=0x7f9b34004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:30.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.191+0000 7f9b2bfff700 1 -- 172.21.15.156:0/1918058996 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b340036a0 con 0x7f9b4409ad40 2023-09-30T22:23:30.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.191+0000 7f9b2bfff700 1 -- 172.21.15.156:0/1918058996 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3401e070 con 0x7f9b4409ad40 2023-09-30T22:23:30.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.191+0000 7f9b2bfff700 1 -- 172.21.15.156:0/1918058996 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b34003a40 con 0x7f9b4409ad40 2023-09-30T22:23:30.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.192+0000 7f9b4a25d700 1 -- 172.21.15.156:0/1918058996 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b44125180 con 0x7f9b4409ad40 2023-09-30T22:23:30.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.192+0000 7f9b4a25d700 1 -- 172.21.15.156:0/1918058996 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b44125b60 con 0x7f9b4409ad40 2023-09-30T22:23:30.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.192+0000 7f9b2bfff700 1 -- 172.21.15.156:0/1918058996 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9b34003ba0 con 0x7f9b4409ad40 2023-09-30T22:23:30.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.192+0000 7f9b4a25d700 1 -- 172.21.15.156:0/1918058996 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b4404f2a0 con 0x7f9b4409ad40 2023-09-30T22:23:30.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.193+0000 7f9b2bfff700 1 -- 172.21.15.156:0/1918058996 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9b34020070 con 0x7f9b4409ad40 2023-09-30T22:23:30.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.198+0000 7f9b2bfff700 1 -- 172.21.15.156:0/1918058996 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9b3402e990 con 0x7f9b4409ad40 2023-09-30T22:23:30.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.226+0000 7f25f754f700 1 Processor -- start 2023-09-30T22:23:30.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.226+0000 7f25f754f700 1 -- start start 2023-09-30T22:23:30.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.226+0000 7f25f754f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25f0131980 0x7f25f0131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.226+0000 7f25f754f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f25f009c790 0x7f25f0139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.226+0000 7f25f754f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f00a1640 con 0x7f25f009bc70 2023-09-30T22:23:30.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.226+0000 7f25f754f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f006eb30 con 0x7f25f009c790 2023-09-30T22:23:30.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.226+0000 7f25f754f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25f00a22d0 con 0x7f25f0131980 2023-09-30T22:23:30.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.227+0000 7f25f52eb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25f0131980 0x7f25f0131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.227+0000 7f25f52eb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25f0131980 0x7f25f0131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51132/0 (socket says 172.21.15.156:51132) 2023-09-30T22:23:30.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.227+0000 7f25f52eb700 1 -- 172.21.15.156:0/3638276913 learned_addr learned my addr 172.21.15.156:0/3638276913 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:30.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.227+0000 7f25f4aea700 1 --1- 172.21.15.156:0/3638276913 >> v1:172.21.15.156:6789/0 conn(0x7f25f009bc70 0x7f25f009c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49820/0 (socket says 172.21.15.156:49820) 2023-09-30T22:23:30.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.227+0000 7f25f5aec700 1 --2- 172.21.15.156:0/3638276913 >> v2:172.21.15.156:3300/0 conn(0x7f25f009c790 0x7f25f0139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.227+0000 7f25f52eb700 1 -- 172.21.15.156:0/3638276913 >> v2:172.21.15.156:3300/0 conn(0x7f25f009c790 msgr2=0x7f25f0139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:30.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.227+0000 7f25f52eb700 1 --2- 172.21.15.156:0/3638276913 >> v2:172.21.15.156:3300/0 conn(0x7f25f009c790 0x7f25f0139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.227+0000 7f25f52eb700 1 -- 172.21.15.156:0/3638276913 >> v1:172.21.15.156:6789/0 conn(0x7f25f009bc70 legacy=0x7f25f009c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:30.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.227+0000 7f25f52eb700 1 -- 172.21.15.156:0/3638276913 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f0131550 con 0x7f25f0131980 2023-09-30T22:23:30.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.227+0000 7f25f52eb700 1 --2- 172.21.15.156:0/3638276913 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25f0131980 0x7f25f0131d50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f25ec006fd0 tx=0x7f25ec009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c1d7e8df84a0002 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:30.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.227+0000 7f25e7fff700 1 -- 172.21.15.156:0/3638276913 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec005e30 con 0x7f25f0131980 2023-09-30T22:23:30.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.227+0000 7f25e7fff700 1 -- 172.21.15.156:0/3638276913 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ec004030 con 0x7f25f0131980 2023-09-30T22:23:30.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.227+0000 7f25e7fff700 1 -- 172.21.15.156:0/3638276913 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec0043e0 con 0x7f25f0131980 2023-09-30T22:23:30.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.228+0000 7f25f754f700 1 -- 172.21.15.156:0/3638276913 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25f0131980 msgr2=0x7f25f0131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:30.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.228+0000 7f25f754f700 1 --2- 172.21.15.156:0/3638276913 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25f0131980 0x7f25f0131d50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f25ec006fd0 tx=0x7f25ec009bd0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.228+0000 7f25f754f700 1 -- 172.21.15.156:0/3638276913 shutdown_connections 2023-09-30T22:23:30.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.228+0000 7f25f754f700 1 --2- 172.21.15.156:0/3638276913 >> v2:172.21.15.156:3300/0 conn(0x7f25f009c790 0x7f25f0139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.228+0000 7f25f754f700 1 --2- 172.21.15.156:0/3638276913 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25f0131980 0x7f25f0131d50 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.228+0000 7f25f754f700 1 -- 172.21.15.156:0/3638276913 >> 172.21.15.156:0/3638276913 conn(0x7f25f00a2980 msgr2=0x7f25f00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:30.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.228+0000 7f25f754f700 1 -- 172.21.15.156:0/3638276913 shutdown_connections 2023-09-30T22:23:30.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.228+0000 7f25f754f700 1 -- 172.21.15.156:0/3638276913 wait complete. 2023-09-30T22:23:30.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.229+0000 7f25f754f700 1 Processor -- start 2023-09-30T22:23:30.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.229+0000 7f25f754f700 1 -- start start 2023-09-30T22:23:30.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.230+0000 7f25f754f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25f009bc70 0x7f25f0118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.230+0000 7f25f754f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25f009c790 0x7f25f0119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.230+0000 7f25f754f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25f0131980 0x7f25f0119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.230+0000 7f25f754f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f00a1c40 con 0x7f25f009c790 2023-09-30T22:23:30.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.230+0000 7f25f754f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f011c140 con 0x7f25f009bc70 2023-09-30T22:23:30.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.230+0000 7f25f754f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25f011afc0 con 0x7f25f0131980 2023-09-30T22:23:30.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.230+0000 7f25f4aea700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25f009c790 0x7f25f0119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.230+0000 7f25f4aea700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25f009c790 0x7f25f0119330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38280/0 (socket says 172.21.15.156:38280) 2023-09-30T22:23:30.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.230+0000 7f25f4aea700 1 -- 172.21.15.156:0/1081561592 learned_addr learned my addr 172.21.15.156:0/1081561592 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:30.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.230+0000 7f25f5aec700 1 --2- 172.21.15.156:0/1081561592 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25f0131980 0x7f25f0119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.230+0000 7f25f4aea700 1 -- 172.21.15.156:0/1081561592 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25f0131980 msgr2=0x7f25f0119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:30.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.230+0000 7f25f4aea700 1 --2- 172.21.15.156:0/1081561592 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25f0131980 0x7f25f0119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.230+0000 7f25f4aea700 1 -- 172.21.15.156:0/1081561592 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25f009bc70 msgr2=0x7f25f0118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:30.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.230+0000 7f25f4aea700 1 --2- 172.21.15.156:0/1081561592 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25f009bc70 0x7f25f0118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.230+0000 7f25f4aea700 1 -- 172.21.15.156:0/1081561592 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ec009500 con 0x7f25f009c790 2023-09-30T22:23:30.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.230+0000 7f25f4aea700 1 --2- 172.21.15.156:0/1081561592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25f009c790 0x7f25f0119330 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f25e000c4f0 tx=0x7f25e000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:30.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.231+0000 7f25e5ffb700 1 -- 172.21.15.156:0/1081561592 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e0005cb0 con 0x7f25f009c790 2023-09-30T22:23:30.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.231+0000 7f25f754f700 1 -- 172.21.15.156:0/1081561592 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f009fc40 con 0x7f25f009c790 2023-09-30T22:23:30.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.231+0000 7f25e5ffb700 1 -- 172.21.15.156:0/1081561592 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e0001270 con 0x7f25f009c790 2023-09-30T22:23:30.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.231+0000 7f25e5ffb700 1 -- 172.21.15.156:0/1081561592 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e00072d0 con 0x7f25f009c790 2023-09-30T22:23:30.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.231+0000 7f25f754f700 1 -- 172.21.15.156:0/1081561592 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f011acb0 con 0x7f25f009c790 2023-09-30T22:23:30.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.232+0000 7f25e5ffb700 1 -- 172.21.15.156:0/1081561592 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25e0007430 con 0x7f25f009c790 2023-09-30T22:23:30.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.232+0000 7f25e5ffb700 1 -- 172.21.15.156:0/1081561592 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f25e003eb10 con 0x7f25f009c790 2023-09-30T22:23:30.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.232+0000 7f25f754f700 1 -- 172.21.15.156:0/1081561592 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f004f2a0 con 0x7f25f009c790 2023-09-30T22:23:30.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.241+0000 7f25e5ffb700 1 -- 172.21.15.156:0/1081561592 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25e0017070 con 0x7f25f009c790 2023-09-30T22:23:30.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.281+0000 7fcf21c4e700 1 Processor -- start 2023-09-30T22:23:30.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.281+0000 7fcf21c4e700 1 -- start start 2023-09-30T22:23:30.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.281+0000 7fcf21c4e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcf1c0a0a70 0x7fcf1c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.281+0000 7fcf21c4e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf1c134120 0x7fcf1c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.281+0000 7fcf21c4e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf1c09dc00 con 0x7fcf1c0a1380 2023-09-30T22:23:30.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.281+0000 7fcf21c4e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf1c09ea90 con 0x7fcf1c0a0a70 2023-09-30T22:23:30.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.281+0000 7fcf21c4e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c09dec0 con 0x7fcf1c134120 2023-09-30T22:23:30.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.282+0000 7fcf1b7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcf1c0a0a70 0x7fcf1c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.282+0000 7fcf1affd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fcf1c0a1380 0x7fcf1c133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49834/0 (socket says 172.21.15.156:49834) 2023-09-30T22:23:30.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.282+0000 7fcf1affd700 1 -- 172.21.15.156:0/702609759 learned_addr learned my addr 172.21.15.156:0/702609759 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:30.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.282+0000 7fcf1bfff700 1 --2- 172.21.15.156:0/702609759 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf1c134120 0x7fcf1c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.282+0000 7fcf1b7fe700 1 -- 172.21.15.156:0/702609759 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf1c134120 msgr2=0x7fcf1c13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:30.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.282+0000 7fcf1b7fe700 1 --2- 172.21.15.156:0/702609759 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf1c134120 0x7fcf1c13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.282+0000 7fcf1b7fe700 1 -- 172.21.15.156:0/702609759 >> v1:172.21.15.156:6789/0 conn(0x7fcf1c0a1380 legacy=0x7fcf1c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:30.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.282+0000 7fcf1b7fe700 1 -- 172.21.15.156:0/702609759 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c09e6a0 con 0x7fcf1c0a0a70 2023-09-30T22:23:30.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.282+0000 7fcf1bfff700 1 --2- 172.21.15.156:0/702609759 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf1c134120 0x7fcf1c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:30.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.282+0000 7fcf1b7fe700 1 --2- 172.21.15.156:0/702609759 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf1c0a0a70 0x7fcf1c0a0e40 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c009840 tx=0x7fcf0c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c916fa74e2dadef server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:30.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.282+0000 7fcf1a7fc700 1 -- 172.21.15.156:0/702609759 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c011830 con 0x7fcf1c0a0a70 2023-09-30T22:23:30.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.282+0000 7fcf1a7fc700 1 -- 172.21.15.156:0/702609759 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0c011990 con 0x7fcf1c0a0a70 2023-09-30T22:23:30.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.282+0000 7fcf1a7fc700 1 -- 172.21.15.156:0/702609759 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c011d20 con 0x7fcf1c0a0a70 2023-09-30T22:23:30.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.283+0000 7fcf21c4e700 1 -- 172.21.15.156:0/702609759 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf1c0a0a70 msgr2=0x7fcf1c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:30.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.283+0000 7fcf21c4e700 1 --2- 172.21.15.156:0/702609759 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf1c0a0a70 0x7fcf1c0a0e40 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c009840 tx=0x7fcf0c009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:30.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.283+0000 7fcf21c4e700 1 -- 172.21.15.156:0/702609759 shutdown_connections 2023-09-30T22:23:30.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.283+0000 7fcf21c4e700 1 --2- 172.21.15.156:0/702609759 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf1c0a0a70 0x7fcf1c0a0e40 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.283+0000 7fcf21c4e700 1 --2- 172.21.15.156:0/702609759 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf1c134120 0x7fcf1c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.283+0000 7fcf21c4e700 1 -- 172.21.15.156:0/702609759 >> 172.21.15.156:0/702609759 conn(0x7fcf1c0a6610 msgr2=0x7fcf1c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:30.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.283+0000 7fcf21c4e700 1 -- 172.21.15.156:0/702609759 shutdown_connections 2023-09-30T22:23:30.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.283+0000 7fcf21c4e700 1 -- 172.21.15.156:0/702609759 wait complete. 2023-09-30T22:23:30.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.284+0000 7fcf21c4e700 1 Processor -- start 2023-09-30T22:23:30.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.284+0000 7fcf21c4e700 1 -- start start 2023-09-30T22:23:30.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.285+0000 7fcf21c4e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf1c0a0a70 0x7fcf1c06dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.285+0000 7fcf21c4e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf1c0a1380 0x7fcf1c06e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.285+0000 7fcf21c4e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf1c134120 0x7fcf1c1cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.285+0000 7fcf21c4e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c070fb0 con 0x7fcf1c0a0a70 2023-09-30T22:23:30.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.285+0000 7fcf21c4e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c06ef20 con 0x7fcf1c0a1380 2023-09-30T22:23:30.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.285+0000 7fcf21c4e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c070530 con 0x7fcf1c134120 2023-09-30T22:23:30.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.285+0000 7fcf1bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf1c134120 0x7fcf1c1cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.285+0000 7fcf1bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf1c134120 0x7fcf1c1cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51164/0 (socket says 172.21.15.156:51164) 2023-09-30T22:23:30.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.285+0000 7fcf1bfff700 1 -- 172.21.15.156:0/3325470853 learned_addr learned my addr 172.21.15.156:0/3325470853 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:30.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.285+0000 7fcf1b7fe700 1 --2- 172.21.15.156:0/3325470853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf1c0a0a70 0x7fcf1c06dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.285+0000 7fcf1b7fe700 1 -- 172.21.15.156:0/3325470853 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf1c134120 msgr2=0x7fcf1c1cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:30.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.285+0000 7fcf1b7fe700 1 --2- 172.21.15.156:0/3325470853 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf1c134120 0x7fcf1c1cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.285+0000 7fcf1b7fe700 1 -- 172.21.15.156:0/3325470853 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf1c0a1380 msgr2=0x7fcf1c06e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:30.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.285+0000 7fcf1b7fe700 1 --2- 172.21.15.156:0/3325470853 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf1c0a1380 0x7fcf1c06e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.285+0000 7fcf1b7fe700 1 -- 172.21.15.156:0/3325470853 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf14009a70 con 0x7fcf1c0a0a70 2023-09-30T22:23:30.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.286+0000 7fcf1b7fe700 1 --2- 172.21.15.156:0/3325470853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf1c0a0a70 0x7fcf1c06dca0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c016000 tx=0x7fcf0c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:30.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.286+0000 7fcf03fff700 1 -- 172.21.15.156:0/3325470853 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c0036a0 con 0x7fcf1c0a0a70 2023-09-30T22:23:30.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.286+0000 7fcf03fff700 1 -- 172.21.15.156:0/3325470853 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0c01f070 con 0x7fcf1c0a0a70 2023-09-30T22:23:30.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.286+0000 7fcf21c4e700 1 -- 172.21.15.156:0/3325470853 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf0c0094a0 con 0x7fcf1c0a0a70 2023-09-30T22:23:30.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.286+0000 7fcf03fff700 1 -- 172.21.15.156:0/3325470853 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c003a60 con 0x7fcf1c0a0a70 2023-09-30T22:23:30.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.286+0000 7fcf21c4e700 1 -- 172.21.15.156:0/3325470853 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1c071c60 con 0x7fcf1c0a0a70 2023-09-30T22:23:30.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.287+0000 7fcf21c4e700 1 -- 172.21.15.156:0/3325470853 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf1c04f2a0 con 0x7fcf1c0a0a70 2023-09-30T22:23:30.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.287+0000 7fcf03fff700 1 -- 172.21.15.156:0/3325470853 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf0c003bc0 con 0x7fcf1c0a0a70 2023-09-30T22:23:30.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.288+0000 7fcf03fff700 1 -- 172.21.15.156:0/3325470853 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcf0c021070 con 0x7fcf1c0a0a70 2023-09-30T22:23:30.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.296+0000 7fcf03fff700 1 -- 172.21.15.156:0/3325470853 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf0c019d40 con 0x7fcf1c0a0a70 2023-09-30T22:23:30.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.313+0000 7f2b6b7e7700 1 Processor -- start 2023-09-30T22:23:30.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.313+0000 7f2b6b7e7700 1 -- start start 2023-09-30T22:23:30.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.314+0000 7f2b6b7e7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b6409d860 0x7f2b6409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.314+0000 7f2b6b7e7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b6409e170 0x7f2b641307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.314+0000 7f2b6b7e7700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b6409aaa0 con 0x7f2b64130ce0 2023-09-30T22:23:30.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.314+0000 7f2b6b7e7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6409f870 con 0x7f2b6409d860 2023-09-30T22:23:30.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.314+0000 7f2b6b7e7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6409b360 con 0x7f2b6409e170 2023-09-30T22:23:30.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.314+0000 7f2b69583700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b6409d860 0x7f2b6409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.314+0000 7f2b68d82700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b6409e170 0x7f2b641307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.314+0000 7f2b69583700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b6409d860 0x7f2b6409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:41388/0 (socket says 172.21.15.156:41388) 2023-09-30T22:23:30.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.314+0000 7f2b68d82700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b6409e170 0x7f2b641307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:51166/0 (socket says 172.21.15.156:51166) 2023-09-30T22:23:30.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.314+0000 7f2b69583700 1 -- 172.21.15.156:0/2836046586 learned_addr learned my addr 172.21.15.156:0/2836046586 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:30.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.314+0000 7f2b5bfff700 1 -- 172.21.15.156:0/2836046586 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2688461961 0 0) 0x7f2b6409aaa0 con 0x7f2b64130ce0 2023-09-30T22:23:30.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.314+0000 7f2b69583700 1 -- 172.21.15.156:0/2836046586 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b6409e170 msgr2=0x7f2b641307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:30.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.314+0000 7f2b69583700 1 --2- 172.21.15.156:0/2836046586 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b6409e170 0x7f2b641307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.314+0000 7f2b69583700 1 -- 172.21.15.156:0/2836046586 >> v1:172.21.15.156:6789/0 conn(0x7f2b64130ce0 legacy=0x7f2b641379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:30.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.314+0000 7f2b69583700 1 -- 172.21.15.156:0/2836046586 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6409b620 con 0x7f2b6409d860 2023-09-30T22:23:30.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.315+0000 7f2b69583700 1 --2- 172.21.15.156:0/2836046586 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b6409d860 0x7f2b6409dc30 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000bbc0 tx=0x7f2b6000bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=746d34c30992c909 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:30.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.316+0000 7f2b5bfff700 1 -- 172.21.15.156:0/2836046586 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6000dd30 con 0x7f2b6409d860 2023-09-30T22:23:30.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.316+0000 7f2b5bfff700 1 -- 172.21.15.156:0/2836046586 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6000de90 con 0x7f2b6409d860 2023-09-30T22:23:30.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.316+0000 7f2b5bfff700 1 -- 172.21.15.156:0/2836046586 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b60010690 con 0x7f2b6409d860 2023-09-30T22:23:30.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.316+0000 7f2b6b7e7700 1 -- 172.21.15.156:0/2836046586 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b6409d860 msgr2=0x7f2b6409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:30.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.316+0000 7f2b6b7e7700 1 --2- 172.21.15.156:0/2836046586 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b6409d860 0x7f2b6409dc30 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000bbc0 tx=0x7f2b6000bed0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.316+0000 7f2b6b7e7700 1 -- 172.21.15.156:0/2836046586 shutdown_connections 2023-09-30T22:23:30.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.316+0000 7f2b6b7e7700 1 --2- 172.21.15.156:0/2836046586 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b6409d860 0x7f2b6409dc30 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.316+0000 7f2b6b7e7700 1 --2- 172.21.15.156:0/2836046586 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b6409e170 0x7f2b641307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.316+0000 7f2b6b7e7700 1 -- 172.21.15.156:0/2836046586 >> 172.21.15.156:0/2836046586 conn(0x7f2b64099c40 msgr2=0x7f2b640a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:30.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.316+0000 7f2b6b7e7700 1 -- 172.21.15.156:0/2836046586 shutdown_connections 2023-09-30T22:23:30.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.317+0000 7f2b6b7e7700 1 -- 172.21.15.156:0/2836046586 wait complete. 2023-09-30T22:23:30.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.318+0000 7f2b6b7e7700 1 Processor -- start 2023-09-30T22:23:30.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.318+0000 7f2b6b7e7700 1 -- start start 2023-09-30T22:23:30.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.318+0000 7f2b6b7e7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b6409d860 0x7f2b641d4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.318+0000 7f2b6b7e7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b6409e170 0x7f2b641d53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.318+0000 7f2b6b7e7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b64130ce0 0x7f2b641d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.318+0000 7f2b6b7e7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b641d4cb0 con 0x7f2b64130ce0 2023-09-30T22:23:30.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.318+0000 7f2b6b7e7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6409c8b0 con 0x7f2b6409e170 2023-09-30T22:23:30.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.318+0000 7f2b6b7e7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b641b7580 con 0x7f2b6409d860 2023-09-30T22:23:30.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.319+0000 7f2b69d84700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b64130ce0 0x7f2b641d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.319+0000 7f2b69d84700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b64130ce0 0x7f2b641d15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38314/0 (socket says 172.21.15.156:38314) 2023-09-30T22:23:30.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.319+0000 7f2b69d84700 1 -- 172.21.15.156:0/2807598964 learned_addr learned my addr 172.21.15.156:0/2807598964 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:30.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.319+0000 7f2b69583700 1 --2- 172.21.15.156:0/2807598964 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b6409d860 0x7f2b641d4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.319+0000 7f2b68d82700 1 --2- 172.21.15.156:0/2807598964 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b6409e170 0x7f2b641d53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.319+0000 7f2b69d84700 1 -- 172.21.15.156:0/2807598964 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b6409d860 msgr2=0x7f2b641d4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:30.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.319+0000 7f2b69d84700 1 --2- 172.21.15.156:0/2807598964 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b6409d860 0x7f2b641d4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.319+0000 7f2b69d84700 1 -- 172.21.15.156:0/2807598964 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b6409e170 msgr2=0x7f2b641d53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:30.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.319+0000 7f2b69d84700 1 --2- 172.21.15.156:0/2807598964 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b6409e170 0x7f2b641d53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.319+0000 7f2b69d84700 1 -- 172.21.15.156:0/2807598964 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6000b7f0 con 0x7f2b64130ce0 2023-09-30T22:23:30.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.319+0000 7f2b69d84700 1 --2- 172.21.15.156:0/2807598964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b64130ce0 0x7f2b641d15e0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c00c810 tx=0x7f2b5c00cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:30.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.319+0000 7f2b59ffb700 1 -- 172.21.15.156:0/2807598964 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c003e30 con 0x7f2b64130ce0 2023-09-30T22:23:30.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.319+0000 7f2b59ffb700 1 -- 172.21.15.156:0/2807598964 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5c005070 con 0x7f2b64130ce0 2023-09-30T22:23:30.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.319+0000 7f2b59ffb700 1 -- 172.21.15.156:0/2807598964 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c005420 con 0x7f2b64130ce0 2023-09-30T22:23:30.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.319+0000 7f2b6b7e7700 1 -- 172.21.15.156:0/2807598964 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b641b8370 con 0x7f2b64130ce0 2023-09-30T22:23:30.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.320+0000 7f2b6b7e7700 1 -- 172.21.15.156:0/2807598964 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b64130090 con 0x7f2b64130ce0 2023-09-30T22:23:30.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.321+0000 7f2b6b7e7700 1 -- 172.21.15.156:0/2807598964 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b6404f2a0 con 0x7f2b64130ce0 2023-09-30T22:23:30.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.322+0000 7f2b59ffb700 1 -- 172.21.15.156:0/2807598964 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2b5c005580 con 0x7f2b64130ce0 2023-09-30T22:23:30.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.322+0000 7f2b59ffb700 1 -- 172.21.15.156:0/2807598964 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2b5c03fe00 con 0x7f2b64130ce0 2023-09-30T22:23:30.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.326+0000 7f2b59ffb700 1 -- 172.21.15.156:0/2807598964 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b5c01a770 con 0x7f2b64130ce0 2023-09-30T22:23:30.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.434+0000 7f9b4a25d700 1 -- 172.21.15.156:0/1918058996 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9b440729d0 con 0x7f9b4409ad40 2023-09-30T22:23:30.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.434+0000 7f9b2bfff700 1 -- 172.21.15.156:0/1918058996 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9b3402a020 con 0x7f9b4409ad40 2023-09-30T22:23:30.435 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:30.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.437+0000 7f9b4a25d700 1 -- 172.21.15.156:0/1918058996 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b4409ad40 msgr2=0x7f9b441223c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:30.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.437+0000 7f9b4a25d700 1 --2- 172.21.15.156:0/1918058996 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b4409ad40 0x7f9b441223c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9b340097c0 tx=0x7f9b34004750 comp rx=0 tx=0).stop 2023-09-30T22:23:30.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.438+0000 7f9b4a25d700 1 -- 172.21.15.156:0/1918058996 shutdown_connections 2023-09-30T22:23:30.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.438+0000 7f9b4a25d700 1 --2- 172.21.15.156:0/1918058996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b441343a0 0x7f9b44122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.438+0000 7f9b4a25d700 1 --2- 172.21.15.156:0/1918058996 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9b4409ad40 0x7f9b441223c0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.438+0000 7f9b4a25d700 1 --2- 172.21.15.156:0/1918058996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9b44133f70 0x7f9b44122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.438+0000 7f9b4a25d700 1 -- 172.21.15.156:0/1918058996 >> 172.21.15.156:0/1918058996 conn(0x7f9b44099c40 msgr2=0x7f9b4409b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:30.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.439+0000 7f9b4a25d700 1 -- 172.21.15.156:0/1918058996 shutdown_connections 2023-09-30T22:23:30.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.439+0000 7f9b4a25d700 1 -- 172.21.15.156:0/1918058996 wait complete. 2023-09-30T22:23:30.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.442+0000 7f25f754f700 1 -- 172.21.15.156:0/1081561592 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f25f006bce0 con 0x7f25f009c790 2023-09-30T22:23:30.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.442+0000 7f25e5ffb700 1 -- 172.21.15.156:0/1081561592 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25e0011be0 con 0x7f25f009c790 2023-09-30T22:23:30.443 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:30.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.444+0000 7f25f754f700 1 -- 172.21.15.156:0/1081561592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25f009c790 msgr2=0x7f25f0119330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:30.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.444+0000 7f25f754f700 1 --2- 172.21.15.156:0/1081561592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25f009c790 0x7f25f0119330 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f25e000c4f0 tx=0x7f25e000c800 comp rx=0 tx=0).stop 2023-09-30T22:23:30.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.444+0000 7f25f754f700 1 -- 172.21.15.156:0/1081561592 shutdown_connections 2023-09-30T22:23:30.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.444+0000 7f25f754f700 1 --2- 172.21.15.156:0/1081561592 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25f0131980 0x7f25f0119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.444+0000 7f25f754f700 1 --2- 172.21.15.156:0/1081561592 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25f009bc70 0x7f25f0118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.444+0000 7f25f754f700 1 --2- 172.21.15.156:0/1081561592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25f009c790 0x7f25f0119330 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.444+0000 7f25f754f700 1 -- 172.21.15.156:0/1081561592 >> 172.21.15.156:0/1081561592 conn(0x7f25f00a2980 msgr2=0x7f25f006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:30.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.444+0000 7f25f754f700 1 -- 172.21.15.156:0/1081561592 shutdown_connections 2023-09-30T22:23:30.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.444+0000 7f25f754f700 1 -- 172.21.15.156:0/1081561592 wait complete. 2023-09-30T22:23:30.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:30.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:30.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.520+0000 7fcf21c4e700 1 -- 172.21.15.156:0/3325470853 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcf1c072980 con 0x7fcf1c0a0a70 2023-09-30T22:23:30.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.521+0000 7f2b6b7e7700 1 -- 172.21.15.156:0/2807598964 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2b641b8560 con 0x7f2b64130ce0 2023-09-30T22:23:30.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.521+0000 7fcf03fff700 1 -- 172.21.15.156:0/3325470853 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcf0c02b030 con 0x7fcf1c0a0a70 2023-09-30T22:23:30.522 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:30.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.521+0000 7f2b59ffb700 1 -- 172.21.15.156:0/2807598964 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2b5c029090 con 0x7f2b64130ce0 2023-09-30T22:23:30.523 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:30.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.523+0000 7fcf21c4e700 1 -- 172.21.15.156:0/3325470853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf1c0a0a70 msgr2=0x7fcf1c06dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:30.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.523+0000 7fcf21c4e700 1 --2- 172.21.15.156:0/3325470853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf1c0a0a70 0x7fcf1c06dca0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c016000 tx=0x7fcf0c004750 comp rx=0 tx=0).stop 2023-09-30T22:23:30.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.523+0000 7fcf21c4e700 1 -- 172.21.15.156:0/3325470853 shutdown_connections 2023-09-30T22:23:30.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.523+0000 7fcf21c4e700 1 --2- 172.21.15.156:0/3325470853 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf1c134120 0x7fcf1c1cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.523+0000 7fcf21c4e700 1 --2- 172.21.15.156:0/3325470853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf1c0a0a70 0x7fcf1c06dca0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.523+0000 7fcf21c4e700 1 --2- 172.21.15.156:0/3325470853 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf1c0a1380 0x7fcf1c06e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.523+0000 7fcf21c4e700 1 -- 172.21.15.156:0/3325470853 >> 172.21.15.156:0/3325470853 conn(0x7fcf1c0a6610 msgr2=0x7fcf1c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:30.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.523+0000 7f2b6b7e7700 1 -- 172.21.15.156:0/2807598964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b64130ce0 msgr2=0x7f2b641d15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:30.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.523+0000 7f2b6b7e7700 1 --2- 172.21.15.156:0/2807598964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b64130ce0 0x7f2b641d15e0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c00c810 tx=0x7f2b5c00cb20 comp rx=0 tx=0).stop 2023-09-30T22:23:30.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.523+0000 7fcf21c4e700 1 -- 172.21.15.156:0/3325470853 shutdown_connections 2023-09-30T22:23:30.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.523+0000 7fcf21c4e700 1 -- 172.21.15.156:0/3325470853 wait complete. 2023-09-30T22:23:30.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.523+0000 7f2b6b7e7700 1 -- 172.21.15.156:0/2807598964 shutdown_connections 2023-09-30T22:23:30.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.523+0000 7f2b6b7e7700 1 --2- 172.21.15.156:0/2807598964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b64130ce0 0x7f2b641d15e0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.523+0000 7f2b6b7e7700 1 --2- 172.21.15.156:0/2807598964 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b6409d860 0x7f2b641d4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.523+0000 7f2b6b7e7700 1 --2- 172.21.15.156:0/2807598964 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b6409e170 0x7f2b641d53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.523+0000 7f2b6b7e7700 1 -- 172.21.15.156:0/2807598964 >> 172.21.15.156:0/2807598964 conn(0x7f2b64099c40 msgr2=0x7f2b64070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:30.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.523+0000 7f2b6b7e7700 1 -- 172.21.15.156:0/2807598964 shutdown_connections 2023-09-30T22:23:30.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:30.523+0000 7f2b6b7e7700 1 -- 172.21.15.156:0/2807598964 wait complete. 2023-09-30T22:23:30.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:30.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:31.454 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:31.459 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:31.538 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:31.538 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:31.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.606+0000 7fb4a7190700 1 Processor -- start 2023-09-30T22:23:31.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.606+0000 7fb4a7190700 1 -- start start 2023-09-30T22:23:31.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.606+0000 7fb4a7190700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4a0133ad0 0x7fb4a0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.606+0000 7fb4a7190700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb4a01300a0 0x7fb4a01304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.607+0000 7fb4a7190700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4a01309f0 0x7fb4a013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.607+0000 7fb4a7190700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4a006b2d0 con 0x7fb4a01300a0 2023-09-30T22:23:31.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.607+0000 7fb4a7190700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a0133610 con 0x7fb4a01309f0 2023-09-30T22:23:31.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.607+0000 7fb4a7190700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a009a500 con 0x7fb4a0133ad0 2023-09-30T22:23:31.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.607+0000 7fb4a4f2c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4a0133ad0 0x7fb4a0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.607+0000 7fb4a572d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4a01309f0 0x7fb4a013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.607+0000 7fb4a572d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4a01309f0 0x7fb4a013a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52494/0 (socket says 172.21.15.156:52494) 2023-09-30T22:23:31.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.607+0000 7fb4a4f2c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4a0133ad0 0x7fb4a0133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55508/0 (socket says 172.21.15.156:55508) 2023-09-30T22:23:31.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.607+0000 7fb4a572d700 1 -- 172.21.15.156:0/1768362547 learned_addr learned my addr 172.21.15.156:0/1768362547 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:31.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.607+0000 7fb49ffff700 1 --2- 172.21.15.156:0/1768362547 >> v2:172.21.15.156:3300/0 conn(0x7fb4a01300a0 0x7fb4a01304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.607+0000 7fb4a572d700 1 -- 172.21.15.156:0/1768362547 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4a0133ad0 msgr2=0x7fb4a0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:31.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.607+0000 7fb4a572d700 1 --2- 172.21.15.156:0/1768362547 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4a0133ad0 0x7fb4a0133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.607+0000 7fb4a572d700 1 -- 172.21.15.156:0/1768362547 >> v2:172.21.15.156:3300/0 conn(0x7fb4a01300a0 msgr2=0x7fb4a01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:31.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.607+0000 7fb4a572d700 1 --2- 172.21.15.156:0/1768362547 >> v2:172.21.15.156:3300/0 conn(0x7fb4a01300a0 0x7fb4a01304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.607+0000 7fb4a572d700 1 -- 172.21.15.156:0/1768362547 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a01338b0 con 0x7fb4a01309f0 2023-09-30T22:23:31.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.607+0000 7fb4a572d700 1 --2- 172.21.15.156:0/1768362547 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4a01309f0 0x7fb4a013a980 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb498009e50 tx=0x7fb49800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1943ce15000ff4f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:31.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.607+0000 7fb49f7fe700 1 -- 172.21.15.156:0/1768362547 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49800e070 con 0x7fb4a01309f0 2023-09-30T22:23:31.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.608+0000 7fb49f7fe700 1 -- 172.21.15.156:0/1768362547 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49800b910 con 0x7fb4a01309f0 2023-09-30T22:23:31.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.608+0000 7fb49f7fe700 1 -- 172.21.15.156:0/1768362547 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49800bcc0 con 0x7fb4a01309f0 2023-09-30T22:23:31.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.608+0000 7fb4a7190700 1 -- 172.21.15.156:0/1768362547 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4a01309f0 msgr2=0x7fb4a013a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.608+0000 7fb4a7190700 1 --2- 172.21.15.156:0/1768362547 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4a01309f0 0x7fb4a013a980 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb498009e50 tx=0x7fb49800b330 comp rx=0 tx=0).stop 2023-09-30T22:23:31.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.609+0000 7fb4a7190700 1 -- 172.21.15.156:0/1768362547 shutdown_connections 2023-09-30T22:23:31.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.609+0000 7fb4a7190700 1 --2- 172.21.15.156:0/1768362547 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4a01309f0 0x7fb4a013a980 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.609+0000 7fb4a7190700 1 --2- 172.21.15.156:0/1768362547 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4a0133ad0 0x7fb4a0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.609+0000 7fb4a7190700 1 --2- 172.21.15.156:0/1768362547 >> v2:172.21.15.156:3300/0 conn(0x7fb4a01300a0 0x7fb4a01304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.609+0000 7fb4a7190700 1 -- 172.21.15.156:0/1768362547 >> 172.21.15.156:0/1768362547 conn(0x7fb4a0099c40 msgr2=0x7fb4a00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:31.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.609+0000 7fb4a7190700 1 -- 172.21.15.156:0/1768362547 shutdown_connections 2023-09-30T22:23:31.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.609+0000 7fb4a7190700 1 -- 172.21.15.156:0/1768362547 wait complete. 2023-09-30T22:23:31.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.610+0000 7fb4a7190700 1 Processor -- start 2023-09-30T22:23:31.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.610+0000 7fb4a7190700 1 -- start start 2023-09-30T22:23:31.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.611+0000 7fb4a7190700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4a01300a0 0x7fb4a00712f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.611+0000 7fb4a7190700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4a01309f0 0x7fb4a0071830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.611+0000 7fb4a7190700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4a0133ad0 0x7fb4a0071d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.611+0000 7fb4a7190700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a011e000 con 0x7fb4a0133ad0 2023-09-30T22:23:31.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.611+0000 7fb4a7190700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a0072750 con 0x7fb4a01309f0 2023-09-30T22:23:31.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.611+0000 7fb4a7190700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a011ee90 con 0x7fb4a01300a0 2023-09-30T22:23:31.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.611+0000 7fb4a4f2c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4a01300a0 0x7fb4a00712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.611+0000 7fb4a4f2c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4a01300a0 0x7fb4a00712f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55514/0 (socket says 172.21.15.156:55514) 2023-09-30T22:23:31.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.611+0000 7fb4a4f2c700 1 -- 172.21.15.156:0/1246968343 learned_addr learned my addr 172.21.15.156:0/1246968343 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:31.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.611+0000 7fb4a572d700 1 --2- 172.21.15.156:0/1246968343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4a0133ad0 0x7fb4a0071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.611+0000 7fb49ffff700 1 --2- 172.21.15.156:0/1246968343 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4a01309f0 0x7fb4a0071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.611+0000 7fb4a572d700 1 -- 172.21.15.156:0/1246968343 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4a01300a0 msgr2=0x7fb4a00712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.611+0000 7fb4a572d700 1 --2- 172.21.15.156:0/1246968343 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4a01300a0 0x7fb4a00712f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.611+0000 7fb4a572d700 1 -- 172.21.15.156:0/1246968343 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4a01309f0 msgr2=0x7fb4a0071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.611+0000 7fb4a572d700 1 --2- 172.21.15.156:0/1246968343 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4a01309f0 0x7fb4a0071830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.611+0000 7fb4a572d700 1 -- 172.21.15.156:0/1246968343 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb498009b30 con 0x7fb4a0133ad0 2023-09-30T22:23:31.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.611+0000 7fb49ffff700 1 --2- 172.21.15.156:0/1246968343 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4a01309f0 0x7fb4a0071830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:31.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.612+0000 7fb4a572d700 1 --2- 172.21.15.156:0/1246968343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4a0133ad0 0x7fb4a0071d70 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fb498015000 tx=0x7fb498004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:31.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.612+0000 7fb49d7fa700 1 -- 172.21.15.156:0/1246968343 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49800ce80 con 0x7fb4a0133ad0 2023-09-30T22:23:31.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.612+0000 7fb49d7fa700 1 -- 172.21.15.156:0/1246968343 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb498004250 con 0x7fb4a0133ad0 2023-09-30T22:23:31.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.612+0000 7fb49d7fa700 1 -- 172.21.15.156:0/1246968343 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb498004600 con 0x7fb4a0133ad0 2023-09-30T22:23:31.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.612+0000 7fb4a7190700 1 -- 172.21.15.156:0/1246968343 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a011f970 con 0x7fb4a0133ad0 2023-09-30T22:23:31.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.612+0000 7fb4a7190700 1 -- 172.21.15.156:0/1246968343 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a012dd00 con 0x7fb4a0133ad0 2023-09-30T22:23:31.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.613+0000 7fb4a7190700 1 -- 172.21.15.156:0/1246968343 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4a00a2620 con 0x7fb4a0133ad0 2023-09-30T22:23:31.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.614+0000 7fb49d7fa700 1 -- 172.21.15.156:0/1246968343 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb498004760 con 0x7fb4a0133ad0 2023-09-30T22:23:31.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.614+0000 7fb49d7fa700 1 -- 172.21.15.156:0/1246968343 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb498040e50 con 0x7fb4a0133ad0 2023-09-30T22:23:31.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.618+0000 7fb49d7fa700 1 -- 172.21.15.156:0/1246968343 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4980117a0 con 0x7fb4a0133ad0 2023-09-30T22:23:31.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.640+0000 7f49acf63700 1 Processor -- start 2023-09-30T22:23:31.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.640+0000 7f49acf63700 1 -- start start 2023-09-30T22:23:31.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.641+0000 7f49acf63700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49a8133ad0 0x7f49a8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.641+0000 7f49acf63700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49a81300a0 0x7f49a81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.641+0000 7f49acf63700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a806b2d0 con 0x7f49a81309f0 2023-09-30T22:23:31.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.641+0000 7f49acf63700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a8133610 con 0x7f49a8133ad0 2023-09-30T22:23:31.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.641+0000 7f49acf63700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49a809a500 con 0x7f49a81300a0 2023-09-30T22:23:31.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.641+0000 7f49a5d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49a81300a0 0x7f49a81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.641+0000 7f49a5d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49a81300a0 0x7f49a81304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55522/0 (socket says 172.21.15.156:55522) 2023-09-30T22:23:31.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.641+0000 7f49a5d9b700 1 -- 172.21.15.156:0/471664896 learned_addr learned my addr 172.21.15.156:0/471664896 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:31.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.641+0000 7f49a6d9d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f49a81309f0 0x7f49a813a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:54298/0 (socket says 172.21.15.156:54298) 2023-09-30T22:23:31.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.641+0000 7f49a659c700 1 --2- 172.21.15.156:0/471664896 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49a8133ad0 0x7f49a8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.641+0000 7f49a559a700 1 -- 172.21.15.156:0/471664896 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 499369885 0 0) 0x7f49a806b2d0 con 0x7f49a81309f0 2023-09-30T22:23:31.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.641+0000 7f49a559a700 1 -- 172.21.15.156:0/471664896 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49900035b0 con 0x7f49a81309f0 2023-09-30T22:23:31.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.641+0000 7f49a5d9b700 1 -- 172.21.15.156:0/471664896 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49a8133ad0 msgr2=0x7f49a8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:31.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.641+0000 7f49a5d9b700 1 --2- 172.21.15.156:0/471664896 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49a8133ad0 0x7f49a8133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.641+0000 7f49a5d9b700 1 -- 172.21.15.156:0/471664896 >> v1:172.21.15.156:6789/0 conn(0x7f49a81309f0 legacy=0x7f49a813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.641+0000 7f49a5d9b700 1 -- 172.21.15.156:0/471664896 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a81338b0 con 0x7f49a81300a0 2023-09-30T22:23:31.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.642+0000 7f49a5d9b700 1 --2- 172.21.15.156:0/471664896 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49a81300a0 0x7f49a81304b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f499c009920 tx=0x7f499c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13413e8a73dd48f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:31.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.642+0000 7f49a559a700 1 -- 172.21.15.156:0/471664896 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c011830 con 0x7f49a81300a0 2023-09-30T22:23:31.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.642+0000 7f49a559a700 1 -- 172.21.15.156:0/471664896 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499c011990 con 0x7f49a81300a0 2023-09-30T22:23:31.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.642+0000 7f49a559a700 1 -- 172.21.15.156:0/471664896 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c011d00 con 0x7f49a81300a0 2023-09-30T22:23:31.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.643+0000 7f49acf63700 1 -- 172.21.15.156:0/471664896 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49a81300a0 msgr2=0x7f49a81304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.643+0000 7f49acf63700 1 --2- 172.21.15.156:0/471664896 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49a81300a0 0x7f49a81304b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f499c009920 tx=0x7f499c009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:31.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.643+0000 7f49acf63700 1 -- 172.21.15.156:0/471664896 shutdown_connections 2023-09-30T22:23:31.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.643+0000 7f49acf63700 1 --2- 172.21.15.156:0/471664896 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49a8133ad0 0x7f49a8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.643+0000 7f49acf63700 1 --2- 172.21.15.156:0/471664896 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49a81300a0 0x7f49a81304b0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.643+0000 7f49acf63700 1 -- 172.21.15.156:0/471664896 >> 172.21.15.156:0/471664896 conn(0x7f49a8099c40 msgr2=0x7f49a80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:31.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.643+0000 7f49acf63700 1 -- 172.21.15.156:0/471664896 shutdown_connections 2023-09-30T22:23:31.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.643+0000 7f49acf63700 1 -- 172.21.15.156:0/471664896 wait complete. 2023-09-30T22:23:31.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.644+0000 7f49acf63700 1 Processor -- start 2023-09-30T22:23:31.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.645+0000 7f49acf63700 1 -- start start 2023-09-30T22:23:31.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.645+0000 7f49acf63700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49a81300a0 0x7f49a811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.645+0000 7f49acf63700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49a81309f0 0x7f49a811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.645+0000 7f49acf63700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49a8133ad0 0x7f49a811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.645+0000 7f49acf63700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a811fda0 con 0x7f49a81309f0 2023-09-30T22:23:31.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.645+0000 7f49acf63700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a812d8f0 con 0x7f49a8133ad0 2023-09-30T22:23:31.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.645+0000 7f49acf63700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49a811ffa0 con 0x7f49a81300a0 2023-09-30T22:23:31.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.645+0000 7f49a5d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49a81309f0 0x7f49a811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.645+0000 7f49a5d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49a81309f0 0x7f49a811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:57976/0 (socket says 172.21.15.156:57976) 2023-09-30T22:23:31.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.645+0000 7f49a5d9b700 1 -- 172.21.15.156:0/2001755902 learned_addr learned my addr 172.21.15.156:0/2001755902 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:31.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.646+0000 7f49a6d9d700 1 --2- 172.21.15.156:0/2001755902 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49a8133ad0 0x7f49a811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.646+0000 7f49a659c700 1 --2- 172.21.15.156:0/2001755902 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49a81300a0 0x7f49a811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.646+0000 7f49a5d9b700 1 -- 172.21.15.156:0/2001755902 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49a81300a0 msgr2=0x7f49a811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.646+0000 7f49a5d9b700 1 --2- 172.21.15.156:0/2001755902 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49a81300a0 0x7f49a811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.646+0000 7f49a5d9b700 1 -- 172.21.15.156:0/2001755902 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49a8133ad0 msgr2=0x7f49a811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.646+0000 7f49a5d9b700 1 --2- 172.21.15.156:0/2001755902 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49a8133ad0 0x7f49a811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.646+0000 7f49a5d9b700 1 -- 172.21.15.156:0/2001755902 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c009550 con 0x7f49a81309f0 2023-09-30T22:23:31.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.646+0000 7f49a5d9b700 1 --2- 172.21.15.156:0/2001755902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49a81309f0 0x7f49a811df80 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f499c0098f0 tx=0x7f499c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:31.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.646+0000 7f4996ffd700 1 -- 172.21.15.156:0/2001755902 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c004450 con 0x7f49a81309f0 2023-09-30T22:23:31.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.646+0000 7f4996ffd700 1 -- 172.21.15.156:0/2001755902 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499c01e070 con 0x7f49a81309f0 2023-09-30T22:23:31.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.647+0000 7f49acf63700 1 -- 172.21.15.156:0/2001755902 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a811fa60 con 0x7f49a81309f0 2023-09-30T22:23:31.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.647+0000 7f4996ffd700 1 -- 172.21.15.156:0/2001755902 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c0038e0 con 0x7f49a81309f0 2023-09-30T22:23:31.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.647+0000 7f49acf63700 1 -- 172.21.15.156:0/2001755902 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a8120880 con 0x7f49a81309f0 2023-09-30T22:23:31.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.648+0000 7f49acf63700 1 -- 172.21.15.156:0/2001755902 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a804f2a0 con 0x7f49a81309f0 2023-09-30T22:23:31.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.648+0000 7f4996ffd700 1 -- 172.21.15.156:0/2001755902 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f499c003a40 con 0x7f49a81309f0 2023-09-30T22:23:31.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.652+0000 7f4996ffd700 1 -- 172.21.15.156:0/2001755902 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f499c020070 con 0x7f49a81309f0 2023-09-30T22:23:31.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.657+0000 7f4996ffd700 1 -- 172.21.15.156:0/2001755902 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f499c025480 con 0x7f49a81309f0 2023-09-30T22:23:31.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.686+0000 7efc3d6b0700 1 Processor -- start 2023-09-30T22:23:31.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.686+0000 7efc3d6b0700 1 -- start start 2023-09-30T22:23:31.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.686+0000 7efc3d6b0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc3809ad40 0x7efc38133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.686+0000 7efc3d6b0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc38133f70 0x7efc381343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.686+0000 7efc3d6b0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7efc380a0a70 0x7efc380a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.686+0000 7efc3d6b0700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc380a3b60 con 0x7efc380a0a70 2023-09-30T22:23:31.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.686+0000 7efc3d6b0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc381348e0 con 0x7efc38133f70 2023-09-30T22:23:31.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.686+0000 7efc3d6b0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc3809b110 con 0x7efc3809ad40 2023-09-30T22:23:31.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.686+0000 7efc36ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc3809ad40 0x7efc38133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.686+0000 7efc377fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7efc380a0a70 0x7efc380a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.687+0000 7efc2e7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc38133f70 0x7efc381343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.687+0000 7efc36ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc3809ad40 0x7efc38133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55534/0 (socket says 172.21.15.156:55534) 2023-09-30T22:23:31.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.687+0000 7efc377fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7efc380a0a70 0x7efc380a0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:57990/0 (socket says 172.21.15.156:57990) 2023-09-30T22:23:31.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.687+0000 7efc36ffd700 1 -- 172.21.15.156:0/1256821828 learned_addr learned my addr 172.21.15.156:0/1256821828 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:31.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.687+0000 7efc2e7fc700 1 -- 172.21.15.156:0/1256821828 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc3809ad40 msgr2=0x7efc38133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:31.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.687+0000 7efc2e7fc700 1 --2- 172.21.15.156:0/1256821828 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc3809ad40 0x7efc38133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.687+0000 7efc2e7fc700 1 -- 172.21.15.156:0/1256821828 >> v2:172.21.15.156:3300/0 conn(0x7efc380a0a70 msgr2=0x7efc380a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:31.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.687+0000 7efc2e7fc700 1 --2- 172.21.15.156:0/1256821828 >> v2:172.21.15.156:3300/0 conn(0x7efc380a0a70 0x7efc380a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.687+0000 7efc2e7fc700 1 -- 172.21.15.156:0/1256821828 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc380a2fa0 con 0x7efc38133f70 2023-09-30T22:23:31.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.687+0000 7efc377fe700 1 --2- 172.21.15.156:0/1256821828 >> v2:172.21.15.156:3300/0 conn(0x7efc380a0a70 0x7efc380a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:31.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.687+0000 7efc2e7fc700 1 --2- 172.21.15.156:0/1256821828 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc38133f70 0x7efc381343a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7efc20009870 tx=0x7efc20009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=722d5b8b36f6548a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:31.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.687+0000 7efc367fc700 1 -- 172.21.15.156:0/1256821828 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc20011830 con 0x7efc38133f70 2023-09-30T22:23:31.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.687+0000 7efc367fc700 1 -- 172.21.15.156:0/1256821828 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc20011990 con 0x7efc38133f70 2023-09-30T22:23:31.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.687+0000 7efc367fc700 1 -- 172.21.15.156:0/1256821828 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc20011d20 con 0x7efc38133f70 2023-09-30T22:23:31.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.688+0000 7efc3d6b0700 1 -- 172.21.15.156:0/1256821828 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc38133f70 msgr2=0x7efc381343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.688+0000 7efc3d6b0700 1 --2- 172.21.15.156:0/1256821828 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc38133f70 0x7efc381343a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7efc20009870 tx=0x7efc20009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:31.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.688+0000 7efc3d6b0700 1 -- 172.21.15.156:0/1256821828 shutdown_connections 2023-09-30T22:23:31.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.688+0000 7efc3d6b0700 1 --2- 172.21.15.156:0/1256821828 >> v2:172.21.15.156:3300/0 conn(0x7efc380a0a70 0x7efc380a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.688+0000 7efc3d6b0700 1 --2- 172.21.15.156:0/1256821828 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc3809ad40 0x7efc38133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.688+0000 7efc3d6b0700 1 --2- 172.21.15.156:0/1256821828 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc38133f70 0x7efc381343a0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.688+0000 7efc3d6b0700 1 -- 172.21.15.156:0/1256821828 >> 172.21.15.156:0/1256821828 conn(0x7efc38099c40 msgr2=0x7efc3806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:31.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.688+0000 7efc3d6b0700 1 -- 172.21.15.156:0/1256821828 shutdown_connections 2023-09-30T22:23:31.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.688+0000 7efc3d6b0700 1 -- 172.21.15.156:0/1256821828 wait complete. 2023-09-30T22:23:31.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.689+0000 7efc3d6b0700 1 Processor -- start 2023-09-30T22:23:31.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.690+0000 7efc3d6b0700 1 -- start start 2023-09-30T22:23:31.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.690+0000 7efc3d6b0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc3809ad40 0x7efc38121360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.690+0000 7efc3d6b0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc380a0a70 0x7efc381218a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.690+0000 7efc3d6b0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc38133f70 0x7efc38121de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.690+0000 7efc3d6b0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc38124c40 con 0x7efc380a0a70 2023-09-30T22:23:31.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.690+0000 7efc3d6b0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc38122f70 con 0x7efc3809ad40 2023-09-30T22:23:31.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.690+0000 7efc3d6b0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc38123e00 con 0x7efc38133f70 2023-09-30T22:23:31.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.691+0000 7efc377fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc38133f70 0x7efc38121de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.691+0000 7efc377fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc38133f70 0x7efc38121de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55548/0 (socket says 172.21.15.156:55548) 2023-09-30T22:23:31.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.691+0000 7efc377fe700 1 -- 172.21.15.156:0/998196453 learned_addr learned my addr 172.21.15.156:0/998196453 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:31.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.691+0000 7efc2e7fc700 1 --2- 172.21.15.156:0/998196453 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc380a0a70 0x7efc381218a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.691+0000 7efc36ffd700 1 --2- 172.21.15.156:0/998196453 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc3809ad40 0x7efc38121360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.691+0000 7f817914e700 1 Processor -- start 2023-09-30T22:23:31.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.691+0000 7efc36ffd700 1 -- 172.21.15.156:0/998196453 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc38133f70 msgr2=0x7efc38121de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.691+0000 7efc36ffd700 1 --2- 172.21.15.156:0/998196453 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc38133f70 0x7efc38121de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.691+0000 7efc36ffd700 1 -- 172.21.15.156:0/998196453 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc380a0a70 msgr2=0x7efc381218a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.691+0000 7efc36ffd700 1 --2- 172.21.15.156:0/998196453 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc380a0a70 0x7efc381218a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.691+0000 7efc36ffd700 1 -- 172.21.15.156:0/998196453 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc30009a70 con 0x7efc3809ad40 2023-09-30T22:23:31.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.691+0000 7efc36ffd700 1 --2- 172.21.15.156:0/998196453 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc3809ad40 0x7efc38121360 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7efc2800e840 tx=0x7efc2800eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:31.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.691+0000 7efc2ffff700 1 -- 172.21.15.156:0/998196453 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc28013680 con 0x7efc3809ad40 2023-09-30T22:23:31.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.691+0000 7efc2ffff700 1 -- 172.21.15.156:0/998196453 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc280137e0 con 0x7efc3809ad40 2023-09-30T22:23:31.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.691+0000 7efc3d6b0700 1 -- 172.21.15.156:0/998196453 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc200094a0 con 0x7efc3809ad40 2023-09-30T22:23:31.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.691+0000 7efc2ffff700 1 -- 172.21.15.156:0/998196453 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc28013b50 con 0x7efc3809ad40 2023-09-30T22:23:31.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.692+0000 7efc3d6b0700 1 -- 172.21.15.156:0/998196453 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc3809c7e0 con 0x7efc3809ad40 2023-09-30T22:23:31.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.691+0000 7f817914e700 1 -- start start 2023-09-30T22:23:31.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.692+0000 7f817914e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8174138410 0x7f81740a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.692+0000 7f817914e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f817413dd10 0x7f81741400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.692+0000 7f817914e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81741379e0 con 0x7f8174138040 2023-09-30T22:23:31.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.692+0000 7f817914e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81740a2100 con 0x7f8174138410 2023-09-30T22:23:31.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.692+0000 7f817914e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817409b9b0 con 0x7f817413dd10 2023-09-30T22:23:31.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.692+0000 7f817359e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f817413dd10 0x7f81741400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.692+0000 7f817359e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f817413dd10 0x7f81741400f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52552/0 (socket says 172.21.15.156:52552) 2023-09-30T22:23:31.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.692+0000 7f817359e700 1 -- 172.21.15.156:0/3180190236 learned_addr learned my addr 172.21.15.156:0/3180190236 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:31.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.692+0000 7f817359e700 1 -- 172.21.15.156:0/3180190236 >> v2:172.21.15.156:3300/0 conn(0x7f8174138410 msgr2=0x7f81740a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:31.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.692+0000 7f817359e700 1 --2- 172.21.15.156:0/3180190236 >> v2:172.21.15.156:3300/0 conn(0x7f8174138410 0x7f81740a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.692+0000 7f817359e700 1 -- 172.21.15.156:0/3180190236 >> v1:172.21.15.156:6789/0 conn(0x7f8174138040 legacy=0x7f81740a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.692+0000 7f8171d9b700 1 -- 172.21.15.156:0/3180190236 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997279871 0 0) 0x7f81741379e0 con 0x7f8174138040 2023-09-30T22:23:31.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.692+0000 7f817359e700 1 -- 172.21.15.156:0/3180190236 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8174137c10 con 0x7f817413dd10 2023-09-30T22:23:31.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.693+0000 7f817359e700 1 --2- 172.21.15.156:0/3180190236 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f817413dd10 0x7f81741400f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f816c009e80 tx=0x7f816c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6500ab3009ccbbb9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:31.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.693+0000 7efc3d6b0700 1 -- 172.21.15.156:0/998196453 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc3811e060 con 0x7efc3809ad40 2023-09-30T22:23:31.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.693+0000 7f8171d9b700 1 -- 172.21.15.156:0/3180190236 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c00e070 con 0x7f817413dd10 2023-09-30T22:23:31.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.693+0000 7f8171d9b700 1 -- 172.21.15.156:0/3180190236 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816c00b980 con 0x7f817413dd10 2023-09-30T22:23:31.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.693+0000 7f8171d9b700 1 -- 172.21.15.156:0/3180190236 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c00bd30 con 0x7f817413dd10 2023-09-30T22:23:31.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.693+0000 7efc2ffff700 1 -- 172.21.15.156:0/998196453 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efc28013cb0 con 0x7efc3809ad40 2023-09-30T22:23:31.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.694+0000 7efc2ffff700 1 -- 172.21.15.156:0/998196453 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efc2803f930 con 0x7efc3809ad40 2023-09-30T22:23:31.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.694+0000 7f817914e700 1 -- 172.21.15.156:0/3180190236 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f817413dd10 msgr2=0x7f81741400f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.694+0000 7f817914e700 1 --2- 172.21.15.156:0/3180190236 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f817413dd10 0x7f81741400f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f816c009e80 tx=0x7f816c00b330 comp rx=0 tx=0).stop 2023-09-30T22:23:31.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.694+0000 7f817914e700 1 -- 172.21.15.156:0/3180190236 shutdown_connections 2023-09-30T22:23:31.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.694+0000 7f817914e700 1 --2- 172.21.15.156:0/3180190236 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f817413dd10 0x7f81741400f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.694+0000 7f817914e700 1 --2- 172.21.15.156:0/3180190236 >> v2:172.21.15.156:3300/0 conn(0x7f8174138410 0x7f81740a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.694+0000 7f817914e700 1 -- 172.21.15.156:0/3180190236 >> 172.21.15.156:0/3180190236 conn(0x7f81740a2980 msgr2=0x7f81740a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:31.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.694+0000 7f817914e700 1 -- 172.21.15.156:0/3180190236 shutdown_connections 2023-09-30T22:23:31.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.694+0000 7f817914e700 1 -- 172.21.15.156:0/3180190236 wait complete. 2023-09-30T22:23:31.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.695+0000 7f817914e700 1 Processor -- start 2023-09-30T22:23:31.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.695+0000 7f817914e700 1 -- start start 2023-09-30T22:23:31.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.696+0000 7f817914e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8174138040 0x7f8174132580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.696+0000 7f817914e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8174138410 0x7f8174132ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.696+0000 7f817914e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f817413dd10 0x7f81741356b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.696+0000 7f817914e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817412fe10 con 0x7f8174138040 2023-09-30T22:23:31.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.696+0000 7f817914e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817409a240 con 0x7f8174138410 2023-09-30T22:23:31.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.696+0000 7f817914e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f817413cda0 con 0x7f817413dd10 2023-09-30T22:23:31.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.696+0000 7f817359e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f817413dd10 0x7f81741356b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.696+0000 7f817359e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f817413dd10 0x7f81741356b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55550/0 (socket says 172.21.15.156:55550) 2023-09-30T22:23:31.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.696+0000 7f817359e700 1 -- 172.21.15.156:0/1770801285 learned_addr learned my addr 172.21.15.156:0/1770801285 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:31.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.696+0000 7f817259c700 1 --2- 172.21.15.156:0/1770801285 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8174138410 0x7f8174132ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.696+0000 7f817259c700 1 -- 172.21.15.156:0/1770801285 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f817413dd10 msgr2=0x7f81741356b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.696+0000 7f817259c700 1 --2- 172.21.15.156:0/1770801285 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f817413dd10 0x7f81741356b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.696+0000 7f817259c700 1 -- 172.21.15.156:0/1770801285 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8174138040 msgr2=0x7f8174132580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.696+0000 7f817259c700 1 --2- 172.21.15.156:0/1770801285 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8174138040 0x7f8174132580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.696+0000 7f817259c700 1 -- 172.21.15.156:0/1770801285 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f816c009b30 con 0x7f8174138410 2023-09-30T22:23:31.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.696+0000 7f817359e700 1 --2- 172.21.15.156:0/1770801285 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f817413dd10 0x7f81741356b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:31.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.697+0000 7f817259c700 1 --2- 172.21.15.156:0/1770801285 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8174138410 0x7f8174132ac0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f816800b410 tx=0x7f816800b720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:31.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.699+0000 7f815b7fe700 1 -- 172.21.15.156:0/1770801285 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8168011830 con 0x7f8174138410 2023-09-30T22:23:31.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.699+0000 7f815b7fe700 1 -- 172.21.15.156:0/1770801285 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816800be90 con 0x7f8174138410 2023-09-30T22:23:31.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.699+0000 7f815b7fe700 1 -- 172.21.15.156:0/1770801285 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8168011bd0 con 0x7f8174138410 2023-09-30T22:23:31.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.699+0000 7efc2ffff700 1 -- 172.21.15.156:0/998196453 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efc2801adc0 con 0x7efc3809ad40 2023-09-30T22:23:31.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.699+0000 7f817914e700 1 -- 172.21.15.156:0/1770801285 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f817413d850 con 0x7f8174138410 2023-09-30T22:23:31.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.699+0000 7f817914e700 1 -- 172.21.15.156:0/1770801285 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8174133000 con 0x7f8174138410 2023-09-30T22:23:31.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.700+0000 7f815b7fe700 1 -- 172.21.15.156:0/1770801285 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8168011d30 con 0x7f8174138410 2023-09-30T22:23:31.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.700+0000 7f815b7fe700 1 -- 172.21.15.156:0/1770801285 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8168017c90 con 0x7f8174138410 2023-09-30T22:23:31.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.701+0000 7f817914e700 1 -- 172.21.15.156:0/1770801285 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f817404f2a0 con 0x7f8174138410 2023-09-30T22:23:31.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.709+0000 7f815b7fe700 1 -- 172.21.15.156:0/1770801285 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8168015030 con 0x7f8174138410 2023-09-30T22:23:31.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.821+0000 7fb4a7190700 1 -- 172.21.15.156:0/1246968343 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb4a004f2a0 con 0x7fb4a0133ad0 2023-09-30T22:23:31.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.821+0000 7fb49d7fa700 1 -- 172.21.15.156:0/1246968343 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb498020070 con 0x7fb4a0133ad0 2023-09-30T22:23:31.822 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:31.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.823+0000 7fb4a7190700 1 -- 172.21.15.156:0/1246968343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4a0133ad0 msgr2=0x7fb4a0071d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.823+0000 7fb4a7190700 1 --2- 172.21.15.156:0/1246968343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4a0133ad0 0x7fb4a0071d70 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fb498015000 tx=0x7fb498004ad0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.823+0000 7fb4a7190700 1 -- 172.21.15.156:0/1246968343 shutdown_connections 2023-09-30T22:23:31.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.823+0000 7fb4a7190700 1 --2- 172.21.15.156:0/1246968343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4a0133ad0 0x7fb4a0071d70 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.823+0000 7fb4a7190700 1 --2- 172.21.15.156:0/1246968343 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb4a01300a0 0x7fb4a00712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.823+0000 7fb4a7190700 1 --2- 172.21.15.156:0/1246968343 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb4a01309f0 0x7fb4a0071830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.823+0000 7fb4a7190700 1 -- 172.21.15.156:0/1246968343 >> 172.21.15.156:0/1246968343 conn(0x7fb4a0099c40 msgr2=0x7fb4a0132bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:31.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.823+0000 7fb4a7190700 1 -- 172.21.15.156:0/1246968343 shutdown_connections 2023-09-30T22:23:31.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.823+0000 7fb4a7190700 1 -- 172.21.15.156:0/1246968343 wait complete. 2023-09-30T22:23:31.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:31.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.863+0000 7f49acf63700 1 -- 172.21.15.156:0/2001755902 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f49a811fa60 con 0x7f49a81309f0 2023-09-30T22:23:31.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.864+0000 7f4996ffd700 1 -- 172.21.15.156:0/2001755902 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f49a811fa60 con 0x7f49a81309f0 2023-09-30T22:23:31.866 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.866+0000 7f49acf63700 1 -- 172.21.15.156:0/2001755902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49a81309f0 msgr2=0x7f49a811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.866+0000 7f49acf63700 1 --2- 172.21.15.156:0/2001755902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49a81309f0 0x7f49a811df80 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f499c0098f0 tx=0x7f499c004750 comp rx=0 tx=0).stop 2023-09-30T22:23:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.866+0000 7f49acf63700 1 -- 172.21.15.156:0/2001755902 shutdown_connections 2023-09-30T22:23:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.866+0000 7f49acf63700 1 --2- 172.21.15.156:0/2001755902 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49a8133ad0 0x7f49a811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.866+0000 7f49acf63700 1 --2- 172.21.15.156:0/2001755902 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49a81300a0 0x7f49a811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.866+0000 7f49acf63700 1 --2- 172.21.15.156:0/2001755902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49a81309f0 0x7f49a811df80 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.866+0000 7f49acf63700 1 -- 172.21.15.156:0/2001755902 >> 172.21.15.156:0/2001755902 conn(0x7f49a8099c40 msgr2=0x7f49a8132040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.866+0000 7f49acf63700 1 -- 172.21.15.156:0/2001755902 shutdown_connections 2023-09-30T22:23:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.866+0000 7f49acf63700 1 -- 172.21.15.156:0/2001755902 wait complete. 2023-09-30T22:23:31.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:31.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.898+0000 7efc3d6b0700 1 -- 172.21.15.156:0/998196453 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efc3804f2a0 con 0x7efc3809ad40 2023-09-30T22:23:31.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.898+0000 7efc2ffff700 1 -- 172.21.15.156:0/998196453 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efc28017070 con 0x7efc3809ad40 2023-09-30T22:23:31.899 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:31.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.900+0000 7efc3d6b0700 1 -- 172.21.15.156:0/998196453 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc3809ad40 msgr2=0x7efc38121360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.900+0000 7efc3d6b0700 1 --2- 172.21.15.156:0/998196453 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc3809ad40 0x7efc38121360 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7efc2800e840 tx=0x7efc2800eb50 comp rx=0 tx=0).stop 2023-09-30T22:23:31.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.900+0000 7efc3d6b0700 1 -- 172.21.15.156:0/998196453 shutdown_connections 2023-09-30T22:23:31.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.900+0000 7efc3d6b0700 1 --2- 172.21.15.156:0/998196453 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc38133f70 0x7efc38121de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.900+0000 7efc3d6b0700 1 --2- 172.21.15.156:0/998196453 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc3809ad40 0x7efc38121360 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.900+0000 7efc3d6b0700 1 --2- 172.21.15.156:0/998196453 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc380a0a70 0x7efc381218a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.900+0000 7efc3d6b0700 1 -- 172.21.15.156:0/998196453 >> 172.21.15.156:0/998196453 conn(0x7efc38099c40 msgr2=0x7efc381332a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:31.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.900+0000 7efc3d6b0700 1 -- 172.21.15.156:0/998196453 shutdown_connections 2023-09-30T22:23:31.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.900+0000 7efc3d6b0700 1 -- 172.21.15.156:0/998196453 wait complete. 2023-09-30T22:23:31.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.907+0000 7f817914e700 1 -- 172.21.15.156:0/1770801285 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8174118fa0 con 0x7f8174138410 2023-09-30T22:23:31.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.908+0000 7f815b7fe700 1 -- 172.21.15.156:0/1770801285 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8168044060 con 0x7f8174138410 2023-09-30T22:23:31.908 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:31.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.910+0000 7f817914e700 1 -- 172.21.15.156:0/1770801285 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8174138410 msgr2=0x7f8174132ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.910+0000 7f817914e700 1 --2- 172.21.15.156:0/1770801285 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8174138410 0x7f8174132ac0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f816800b410 tx=0x7f816800b720 comp rx=0 tx=0).stop 2023-09-30T22:23:31.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.910+0000 7f817914e700 1 -- 172.21.15.156:0/1770801285 shutdown_connections 2023-09-30T22:23:31.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.910+0000 7f817914e700 1 --2- 172.21.15.156:0/1770801285 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f817413dd10 0x7f81741356b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.910+0000 7f817914e700 1 --2- 172.21.15.156:0/1770801285 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8174138040 0x7f8174132580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.910+0000 7f817914e700 1 --2- 172.21.15.156:0/1770801285 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8174138410 0x7f8174132ac0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.910+0000 7f817914e700 1 -- 172.21.15.156:0/1770801285 >> 172.21.15.156:0/1770801285 conn(0x7f81740a2980 msgr2=0x7f817413e580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:31.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.910+0000 7f817914e700 1 -- 172.21.15.156:0/1770801285 shutdown_connections 2023-09-30T22:23:31.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:31.910+0000 7f817914e700 1 -- 172.21.15.156:0/1770801285 wait complete. 2023-09-30T22:23:31.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:31.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:32.837 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:32.882 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:32.914 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:32.924 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:32.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.984+0000 7f7c50212700 1 Processor -- start 2023-09-30T22:23:32.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.984+0000 7f7c50212700 1 -- start start 2023-09-30T22:23:32.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.985+0000 7f7c50212700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7c48133ad0 0x7f7c48133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:32.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.985+0000 7f7c50212700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c48130bc0 0x7f7c4813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:32.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.985+0000 7f7c50212700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c4806b2d0 con 0x7f7c481300a0 2023-09-30T22:23:32.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.985+0000 7f7c50212700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c48133610 con 0x7f7c48133ad0 2023-09-30T22:23:32.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.985+0000 7f7c50212700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4809a500 con 0x7f7c48130bc0 2023-09-30T22:23:32.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.985+0000 7f7c4dfae700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7c48133ad0 0x7f7c48133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:32.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.985+0000 7f7c4d7ad700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f7c481300a0 0x7f7c481304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:54320/0 (socket says 172.21.15.156:54320) 2023-09-30T22:23:32.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.985+0000 7f7c4d7ad700 1 -- 172.21.15.156:0/3499695937 learned_addr learned my addr 172.21.15.156:0/3499695937 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:32.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.985+0000 7f7c4e7af700 1 --2- 172.21.15.156:0/3499695937 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c48130bc0 0x7f7c4813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.986+0000 7f7c4dfae700 1 -- 172.21.15.156:0/3499695937 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c48130bc0 msgr2=0x7f7c4813b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:33.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.986+0000 7f7c4dfae700 1 --2- 172.21.15.156:0/3499695937 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c48130bc0 0x7f7c4813b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.986+0000 7f7c4dfae700 1 -- 172.21.15.156:0/3499695937 >> v1:172.21.15.156:6789/0 conn(0x7f7c481300a0 legacy=0x7f7c481304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.986+0000 7f7c4dfae700 1 -- 172.21.15.156:0/3499695937 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c481338b0 con 0x7f7c48133ad0 2023-09-30T22:23:33.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.986+0000 7f7c4dfae700 1 --2- 172.21.15.156:0/3499695937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c48133ad0 0x7f7c48133ea0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009d90 tx=0x7f7c4400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=407b69994ab719f7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:33.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.986+0000 7f7c4cfac700 1 -- 172.21.15.156:0/3499695937 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4400e070 con 0x7f7c48133ad0 2023-09-30T22:23:33.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.986+0000 7f7c4cfac700 1 -- 172.21.15.156:0/3499695937 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4400bbd0 con 0x7f7c48133ad0 2023-09-30T22:23:33.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.986+0000 7f7c4cfac700 1 -- 172.21.15.156:0/3499695937 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44012430 con 0x7f7c48133ad0 2023-09-30T22:23:33.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.987+0000 7f7c50212700 1 -- 172.21.15.156:0/3499695937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c48133ad0 msgr2=0x7f7c48133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.987+0000 7f7c50212700 1 --2- 172.21.15.156:0/3499695937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c48133ad0 0x7f7c48133ea0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009d90 tx=0x7f7c4400b330 comp rx=0 tx=0).stop 2023-09-30T22:23:33.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.987+0000 7f7c50212700 1 -- 172.21.15.156:0/3499695937 shutdown_connections 2023-09-30T22:23:33.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.987+0000 7f7c50212700 1 --2- 172.21.15.156:0/3499695937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c48133ad0 0x7f7c48133ea0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.987+0000 7f7c50212700 1 --2- 172.21.15.156:0/3499695937 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c48130bc0 0x7f7c4813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.987+0000 7f7c50212700 1 -- 172.21.15.156:0/3499695937 >> 172.21.15.156:0/3499695937 conn(0x7f7c48099c40 msgr2=0x7f7c480a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:33.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.987+0000 7f7c50212700 1 -- 172.21.15.156:0/3499695937 shutdown_connections 2023-09-30T22:23:33.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.987+0000 7f7c50212700 1 -- 172.21.15.156:0/3499695937 wait complete. 2023-09-30T22:23:33.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.988+0000 7f7c50212700 1 Processor -- start 2023-09-30T22:23:33.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.989+0000 7f7c50212700 1 -- start start 2023-09-30T22:23:33.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.989+0000 7f7c50212700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c481300a0 0x7f7c4811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.989+0000 7f7c50212700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c48130bc0 0x7f7c4811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.989+0000 7f7c50212700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c48133ad0 0x7f7c4811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.989+0000 7f7c50212700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4811f080 con 0x7f7c481300a0 2023-09-30T22:23:33.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.989+0000 7f7c50212700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c481200c0 con 0x7f7c48133ad0 2023-09-30T22:23:33.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.989+0000 7f7c50212700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4811fb20 con 0x7f7c48130bc0 2023-09-30T22:23:33.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.989+0000 7f7c4dfae700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c481300a0 0x7f7c4811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.989+0000 7f7c4dfae700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c481300a0 0x7f7c4811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58030/0 (socket says 172.21.15.156:58030) 2023-09-30T22:23:33.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.989+0000 7f7c4dfae700 1 -- 172.21.15.156:0/1658494006 learned_addr learned my addr 172.21.15.156:0/1658494006 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:33.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.989+0000 7f7c4e7af700 1 --2- 172.21.15.156:0/1658494006 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c48133ad0 0x7f7c4811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.990+0000 7f7c4d7ad700 1 --2- 172.21.15.156:0/1658494006 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c48130bc0 0x7f7c4811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.990+0000 7f7c4e7af700 1 -- 172.21.15.156:0/1658494006 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c48130bc0 msgr2=0x7f7c4811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.990+0000 7f7c4e7af700 1 --2- 172.21.15.156:0/1658494006 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c48130bc0 0x7f7c4811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.990+0000 7f7c4e7af700 1 -- 172.21.15.156:0/1658494006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c481300a0 msgr2=0x7f7c4811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.990+0000 7f7c4e7af700 1 --2- 172.21.15.156:0/1658494006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c481300a0 0x7f7c4811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.990+0000 7f7c4e7af700 1 -- 172.21.15.156:0/1658494006 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c44009a70 con 0x7f7c48133ad0 2023-09-30T22:23:33.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.990+0000 7f7c4e7af700 1 --2- 172.21.15.156:0/1658494006 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c48133ad0 0x7f7c4811e4c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000e810 tx=0x7f7c4000eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:33.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.990+0000 7f7c3e7fc700 1 -- 172.21.15.156:0/1658494006 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4000c070 con 0x7f7c48133ad0 2023-09-30T22:23:33.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.990+0000 7f7c3e7fc700 1 -- 172.21.15.156:0/1658494006 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c40013610 con 0x7f7c48133ad0 2023-09-30T22:23:33.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.990+0000 7f7c3e7fc700 1 -- 172.21.15.156:0/1658494006 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c40013980 con 0x7f7c48133ad0 2023-09-30T22:23:33.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.990+0000 7f7c50212700 1 -- 172.21.15.156:0/1658494006 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c4811f850 con 0x7f7c48133ad0 2023-09-30T22:23:33.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.990+0000 7f7c50212700 1 -- 172.21.15.156:0/1658494006 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c4812dd00 con 0x7f7c48133ad0 2023-09-30T22:23:33.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.991+0000 7f7c50212700 1 -- 172.21.15.156:0/1658494006 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c4809cb20 con 0x7f7c48133ad0 2023-09-30T22:23:33.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.992+0000 7f7c3e7fc700 1 -- 172.21.15.156:0/1658494006 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c40013ae0 con 0x7f7c48133ad0 2023-09-30T22:23:33.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.992+0000 7f7c3e7fc700 1 -- 172.21.15.156:0/1658494006 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7c4003f8d0 con 0x7f7c48133ad0 2023-09-30T22:23:33.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:32.996+0000 7f7c3e7fc700 1 -- 172.21.15.156:0/1658494006 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c40024940 con 0x7f7c48133ad0 2023-09-30T22:23:33.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.024+0000 7fd6cce16700 1 Processor -- start 2023-09-30T22:23:33.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.024+0000 7fd6cce16700 1 -- start start 2023-09-30T22:23:33.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.025+0000 7fd6cce16700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6c809d860 0x7fd6c809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.025+0000 7fd6cce16700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6c809e170 0x7fd6c81307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.025+0000 7fd6cce16700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c809aaa0 con 0x7fd6c8130ce0 2023-09-30T22:23:33.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.025+0000 7fd6cce16700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c809f870 con 0x7fd6c809e170 2023-09-30T22:23:33.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.025+0000 7fd6cce16700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c809b360 con 0x7fd6c809d860 2023-09-30T22:23:33.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.026+0000 7fd6c5d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6c809e170 0x7fd6c81307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.026+0000 7fd6c5d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6c809e170 0x7fd6c81307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52586/0 (socket says 172.21.15.156:52586) 2023-09-30T22:23:33.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.026+0000 7fd6c5d9b700 1 -- 172.21.15.156:0/1111011090 learned_addr learned my addr 172.21.15.156:0/1111011090 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:33.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.026+0000 7fd6c659c700 1 --2- 172.21.15.156:0/1111011090 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6c809d860 0x7fd6c809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.026+0000 7fd6c559a700 1 -- 172.21.15.156:0/1111011090 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2682253532 0 0) 0x7fd6c809aaa0 con 0x7fd6c8130ce0 2023-09-30T22:23:33.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.026+0000 7fd6c559a700 1 -- 172.21.15.156:0/1111011090 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6b00035b0 con 0x7fd6c8130ce0 2023-09-30T22:23:33.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.026+0000 7fd6c659c700 1 -- 172.21.15.156:0/1111011090 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6c809e170 msgr2=0x7fd6c81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:33.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.026+0000 7fd6c659c700 1 --2- 172.21.15.156:0/1111011090 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6c809e170 0x7fd6c81307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.026+0000 7fd6c659c700 1 -- 172.21.15.156:0/1111011090 >> v1:172.21.15.156:6789/0 conn(0x7fd6c8130ce0 legacy=0x7fd6c81379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.026+0000 7fd6c659c700 1 -- 172.21.15.156:0/1111011090 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c809b620 con 0x7fd6c809d860 2023-09-30T22:23:33.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.026+0000 7fd6c659c700 1 --2- 172.21.15.156:0/1111011090 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6c809d860 0x7fd6c809dc30 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd6b800dfd0 tx=0x7fd6b800f330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac24e8cba5ce2b17 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:33.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.026+0000 7fd6c559a700 1 -- 172.21.15.156:0/1111011090 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8012070 con 0x7fd6c809d860 2023-09-30T22:23:33.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.026+0000 7fd6c559a700 1 -- 172.21.15.156:0/1111011090 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b8005d50 con 0x7fd6c809d860 2023-09-30T22:23:33.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.026+0000 7fd6c559a700 1 -- 172.21.15.156:0/1111011090 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b800fc30 con 0x7fd6c809d860 2023-09-30T22:23:33.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.027+0000 7fd6cce16700 1 -- 172.21.15.156:0/1111011090 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6c809d860 msgr2=0x7fd6c809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.027+0000 7fd6cce16700 1 --2- 172.21.15.156:0/1111011090 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6c809d860 0x7fd6c809dc30 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd6b800dfd0 tx=0x7fd6b800f330 comp rx=0 tx=0).stop 2023-09-30T22:23:33.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.027+0000 7fd6cce16700 1 -- 172.21.15.156:0/1111011090 shutdown_connections 2023-09-30T22:23:33.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.027+0000 7fd6cce16700 1 --2- 172.21.15.156:0/1111011090 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6c809d860 0x7fd6c809dc30 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.027+0000 7fd6cce16700 1 --2- 172.21.15.156:0/1111011090 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6c809e170 0x7fd6c81307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.027+0000 7fd6cce16700 1 -- 172.21.15.156:0/1111011090 >> 172.21.15.156:0/1111011090 conn(0x7fd6c8099c40 msgr2=0x7fd6c80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:33.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.027+0000 7fd6cce16700 1 -- 172.21.15.156:0/1111011090 shutdown_connections 2023-09-30T22:23:33.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.027+0000 7fd6cce16700 1 -- 172.21.15.156:0/1111011090 wait complete. 2023-09-30T22:23:33.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.029+0000 7fd6cce16700 1 Processor -- start 2023-09-30T22:23:33.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.029+0000 7fd6cce16700 1 -- start start 2023-09-30T22:23:33.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.029+0000 7fd6cce16700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6c809d860 0x7fd6c811e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.029+0000 7fd6cce16700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6c809e170 0x7fd6c811ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.029+0000 7fd6cce16700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6c8130ce0 0x7fd6c811f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.029+0000 7fd6cce16700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c811fb80 con 0x7fd6c809e170 2023-09-30T22:23:33.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.029+0000 7fd6cce16700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c8120870 con 0x7fd6c8130ce0 2023-09-30T22:23:33.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.029+0000 7fd6cce16700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c81203d0 con 0x7fd6c809d860 2023-09-30T22:23:33.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.030+0000 7fd6c6d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6c8130ce0 0x7fd6c811f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.030+0000 7fd6c659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6c809d860 0x7fd6c811e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.030+0000 7fd6c6d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6c8130ce0 0x7fd6c811f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52590/0 (socket says 172.21.15.156:52590) 2023-09-30T22:23:33.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.030+0000 7fd6c6d9d700 1 -- 172.21.15.156:0/189082573 learned_addr learned my addr 172.21.15.156:0/189082573 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:33.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.030+0000 7fd6c5d9b700 1 --2- 172.21.15.156:0/189082573 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6c809e170 0x7fd6c811ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.030+0000 7fd6c6d9d700 1 -- 172.21.15.156:0/189082573 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6c809d860 msgr2=0x7fd6c811e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.030+0000 7fd6c6d9d700 1 --2- 172.21.15.156:0/189082573 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6c809d860 0x7fd6c811e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.030+0000 7fd6c6d9d700 1 -- 172.21.15.156:0/189082573 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6c809e170 msgr2=0x7fd6c811ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.030+0000 7fd6c6d9d700 1 --2- 172.21.15.156:0/189082573 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6c809e170 0x7fd6c811ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.030+0000 7fd6c6d9d700 1 -- 172.21.15.156:0/189082573 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b800dc80 con 0x7fd6c8130ce0 2023-09-30T22:23:33.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.030+0000 7fd6c5d9b700 1 --2- 172.21.15.156:0/189082573 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6c809e170 0x7fd6c811ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:33.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.030+0000 7fd6c659c700 1 --2- 172.21.15.156:0/189082573 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6c809d860 0x7fd6c811e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:33.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.030+0000 7fd6c6d9d700 1 --2- 172.21.15.156:0/189082573 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6c8130ce0 0x7fd6c811f130 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fd6c000cc20 tx=0x7fd6c000cf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:33.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.030+0000 7fd6b6ffd700 1 -- 172.21.15.156:0/189082573 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0003c00 con 0x7fd6c8130ce0 2023-09-30T22:23:33.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.031+0000 7fd6b6ffd700 1 -- 172.21.15.156:0/189082573 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c0003d60 con 0x7fd6c8130ce0 2023-09-30T22:23:33.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.031+0000 7fd6cce16700 1 -- 172.21.15.156:0/189082573 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c8130610 con 0x7fd6c8130ce0 2023-09-30T22:23:33.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.031+0000 7fd6cce16700 1 -- 172.21.15.156:0/189082573 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c8120ab0 con 0x7fd6c8130ce0 2023-09-30T22:23:33.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.031+0000 7fd6b6ffd700 1 -- 172.21.15.156:0/189082573 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c000aae0 con 0x7fd6c8130ce0 2023-09-30T22:23:33.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.032+0000 7fd6b6ffd700 1 -- 172.21.15.156:0/189082573 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd6c000ac40 con 0x7fd6c8130ce0 2023-09-30T22:23:33.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.032+0000 7fd6cce16700 1 -- 172.21.15.156:0/189082573 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ac0052e0 con 0x7fd6c8130ce0 2023-09-30T22:23:33.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.032+0000 7fd6b6ffd700 1 -- 172.21.15.156:0/189082573 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd6c003f650 con 0x7fd6c8130ce0 2023-09-30T22:23:33.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.037+0000 7fd6b6ffd700 1 -- 172.21.15.156:0/189082573 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd6c00198f0 con 0x7fd6c8130ce0 2023-09-30T22:23:33.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.062+0000 7f4ee8fe8700 1 Processor -- start 2023-09-30T22:23:33.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.062+0000 7f4ee8fe8700 1 -- start start 2023-09-30T22:23:33.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.062+0000 7f4ee8fe8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ee409e870 0x7f4ee409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.062+0000 7f4ee8fe8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ee409f180 0x7f4ee4131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.062+0000 7f4ee8fe8700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee409c970 con 0x7f4ee4131d70 2023-09-30T22:23:33.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.062+0000 7f4ee8fe8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee40a0920 con 0x7f4ee409f180 2023-09-30T22:23:33.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.062+0000 7f4ee8fe8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee409f9c0 con 0x7f4ee409e870 2023-09-30T22:23:33.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.063+0000 7f4ee1d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ee409f180 0x7f4ee4131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.063+0000 7f4ee1d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ee409f180 0x7f4ee4131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52594/0 (socket says 172.21.15.156:52594) 2023-09-30T22:23:33.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.063+0000 7f4ee1d9b700 1 -- 172.21.15.156:0/3161321117 learned_addr learned my addr 172.21.15.156:0/3161321117 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:33.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.063+0000 7f4ee259c700 1 --2- 172.21.15.156:0/3161321117 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ee409e870 0x7f4ee409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.063+0000 7f4ee1d9b700 1 -- 172.21.15.156:0/3161321117 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ee409e870 msgr2=0x7f4ee409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:33.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.063+0000 7f4ee1d9b700 1 --2- 172.21.15.156:0/3161321117 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ee409e870 0x7f4ee409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.063+0000 7f4ee1d9b700 1 -- 172.21.15.156:0/3161321117 >> v1:172.21.15.156:6789/0 conn(0x7f4ee4131d70 legacy=0x7f4ee4138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.063+0000 7f4ee1d9b700 1 -- 172.21.15.156:0/3161321117 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee409bab0 con 0x7f4ee409f180 2023-09-30T22:23:33.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.063+0000 7f4ee1d9b700 1 --2- 172.21.15.156:0/3161321117 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ee409f180 0x7f4ee4131830 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009920 tx=0x7f4ed8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9587f2d74a92ddb8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:33.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.063+0000 7f4ee159a700 1 -- 172.21.15.156:0/3161321117 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8011830 con 0x7f4ee409f180 2023-09-30T22:23:33.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.063+0000 7f4ee159a700 1 -- 172.21.15.156:0/3161321117 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed8011990 con 0x7f4ee409f180 2023-09-30T22:23:33.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.063+0000 7f4ee159a700 1 -- 172.21.15.156:0/3161321117 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8011d20 con 0x7f4ee409f180 2023-09-30T22:23:33.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.064+0000 7f4ee8fe8700 1 -- 172.21.15.156:0/3161321117 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ee409f180 msgr2=0x7f4ee4131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.064+0000 7f4ee8fe8700 1 --2- 172.21.15.156:0/3161321117 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ee409f180 0x7f4ee4131830 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009920 tx=0x7f4ed8009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:33.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.064+0000 7f4ee8fe8700 1 -- 172.21.15.156:0/3161321117 shutdown_connections 2023-09-30T22:23:33.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.064+0000 7f4ee8fe8700 1 --2- 172.21.15.156:0/3161321117 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ee409e870 0x7f4ee409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.064+0000 7f4ee8fe8700 1 --2- 172.21.15.156:0/3161321117 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ee409f180 0x7f4ee4131830 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.064+0000 7f4ee8fe8700 1 -- 172.21.15.156:0/3161321117 >> 172.21.15.156:0/3161321117 conn(0x7f4ee40a4430 msgr2=0x7f4ee40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:33.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.064+0000 7f4ee8fe8700 1 -- 172.21.15.156:0/3161321117 shutdown_connections 2023-09-30T22:23:33.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.064+0000 7f4ee8fe8700 1 -- 172.21.15.156:0/3161321117 wait complete. 2023-09-30T22:23:33.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.065+0000 7f4ee8fe8700 1 Processor -- start 2023-09-30T22:23:33.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.065+0000 7f4ee8fe8700 1 -- start start 2023-09-30T22:23:33.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.066+0000 7f4ee8fe8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ee409e870 0x7f4ee406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.066+0000 7f4ee8fe8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ee409f180 0x7f4ee406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.066+0000 7f4ee8fe8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ee4131d70 0x7f4ee406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.066+0000 7f4ee8fe8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee4124a70 con 0x7f4ee4131d70 2023-09-30T22:23:33.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.066+0000 7f4ee8fe8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee406cc80 con 0x7f4ee409f180 2023-09-30T22:23:33.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.066+0000 7f4ee8fe8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee409dba0 con 0x7f4ee409e870 2023-09-30T22:23:33.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.066+0000 7f4ee1d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ee409f180 0x7f4ee406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.066+0000 7f4ee1d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ee409f180 0x7f4ee406bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52604/0 (socket says 172.21.15.156:52604) 2023-09-30T22:23:33.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.066+0000 7f4ee1d9b700 1 -- 172.21.15.156:0/1749565865 learned_addr learned my addr 172.21.15.156:0/1749565865 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:33.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.066+0000 7f4ee259c700 1 --2- 172.21.15.156:0/1749565865 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ee409e870 0x7f4ee406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.066+0000 7f4ee2d9d700 1 --2- 172.21.15.156:0/1749565865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ee4131d70 0x7f4ee406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.066+0000 7f4ee1d9b700 1 -- 172.21.15.156:0/1749565865 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ee409e870 msgr2=0x7f4ee406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.066+0000 7f4ee1d9b700 1 --2- 172.21.15.156:0/1749565865 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ee409e870 0x7f4ee406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.066+0000 7f4ee1d9b700 1 -- 172.21.15.156:0/1749565865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ee4131d70 msgr2=0x7f4ee406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.066+0000 7f4ee1d9b700 1 --2- 172.21.15.156:0/1749565865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ee4131d70 0x7f4ee406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.066+0000 7f4ee1d9b700 1 -- 172.21.15.156:0/1749565865 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed8009550 con 0x7f4ee409f180 2023-09-30T22:23:33.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.066+0000 7f4ee2d9d700 1 --2- 172.21.15.156:0/1749565865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ee4131d70 0x7f4ee406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:33.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.066+0000 7f4ee1d9b700 1 --2- 172.21.15.156:0/1749565865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ee409f180 0x7f4ee406bdf0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8013000 tx=0x7f4ed8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:33.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.067+0000 7f4ed2ffd700 1 -- 172.21.15.156:0/1749565865 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8004510 con 0x7f4ee409f180 2023-09-30T22:23:33.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.067+0000 7f4ed2ffd700 1 -- 172.21.15.156:0/1749565865 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed80036a0 con 0x7f4ee409f180 2023-09-30T22:23:33.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.067+0000 7f4ee8fe8700 1 -- 172.21.15.156:0/1749565865 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee4125940 con 0x7f4ee409f180 2023-09-30T22:23:33.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.067+0000 7f4ed2ffd700 1 -- 172.21.15.156:0/1749565865 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8003a30 con 0x7f4ee409f180 2023-09-30T22:23:33.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.067+0000 7f4ee8fe8700 1 -- 172.21.15.156:0/1749565865 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee4125ee0 con 0x7f4ee409f180 2023-09-30T22:23:33.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.068+0000 7f4ee8fe8700 1 -- 172.21.15.156:0/1749565865 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee404f2a0 con 0x7f4ee409f180 2023-09-30T22:23:33.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.068+0000 7f4ed2ffd700 1 -- 172.21.15.156:0/1749565865 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4ed8003b90 con 0x7f4ee409f180 2023-09-30T22:23:33.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.068+0000 7f4ed2ffd700 1 -- 172.21.15.156:0/1749565865 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4ed8021030 con 0x7f4ee409f180 2023-09-30T22:23:33.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.076+0000 7f4ed2ffd700 1 -- 172.21.15.156:0/1749565865 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ed801a430 con 0x7f4ee409f180 2023-09-30T22:23:33.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.080+0000 7fe177a24700 1 Processor -- start 2023-09-30T22:23:33.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.080+0000 7fe177a24700 1 -- start start 2023-09-30T22:23:33.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.081+0000 7fe177a24700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe170099e20 0x7fe17009a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.081+0000 7fe177a24700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe170130a60 0x7fe170138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.081+0000 7fe177a24700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe170099a60 con 0x7fe17009a730 2023-09-30T22:23:33.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.081+0000 7fe177a24700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17009bf50 con 0x7fe170099e20 2023-09-30T22:23:33.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.081+0000 7fe177a24700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe17009b230 con 0x7fe170130a60 2023-09-30T22:23:33.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.081+0000 7fe1757c0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe170099e20 0x7fe17009a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.081+0000 7fe174fbf700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe17009a730 0x7fe170130350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:54354/0 (socket says 172.21.15.156:54354) 2023-09-30T22:23:33.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.081+0000 7fe1757c0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe170099e20 0x7fe17009a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52610/0 (socket says 172.21.15.156:52610) 2023-09-30T22:23:33.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.081+0000 7fe1757c0700 1 -- 172.21.15.156:0/1671075320 learned_addr learned my addr 172.21.15.156:0/1671075320 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:33.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.081+0000 7fe175fc1700 1 --2- 172.21.15.156:0/1671075320 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe170130a60 0x7fe170138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.081+0000 7fe1757c0700 1 -- 172.21.15.156:0/1671075320 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe170130a60 msgr2=0x7fe170138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:33.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.081+0000 7fe1757c0700 1 --2- 172.21.15.156:0/1671075320 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe170130a60 0x7fe170138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.081+0000 7fe1757c0700 1 -- 172.21.15.156:0/1671075320 >> v1:172.21.15.156:6789/0 conn(0x7fe17009a730 legacy=0x7fe170130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.081+0000 7fe1757c0700 1 -- 172.21.15.156:0/1671075320 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17009bb90 con 0x7fe170099e20 2023-09-30T22:23:33.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.081+0000 7fe1757c0700 1 --2- 172.21.15.156:0/1671075320 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe170099e20 0x7fe17009a1f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0098f0 tx=0x7fe16c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb2cd63e2c9b08d1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:33.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.081+0000 7fe167fff700 1 -- 172.21.15.156:0/1671075320 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c005e30 con 0x7fe170099e20 2023-09-30T22:23:33.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.082+0000 7fe167fff700 1 -- 172.21.15.156:0/1671075320 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16c004030 con 0x7fe170099e20 2023-09-30T22:23:33.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.082+0000 7fe167fff700 1 -- 172.21.15.156:0/1671075320 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c0043e0 con 0x7fe170099e20 2023-09-30T22:23:33.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.082+0000 7fe177a24700 1 -- 172.21.15.156:0/1671075320 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe170099e20 msgr2=0x7fe17009a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.082+0000 7fe177a24700 1 --2- 172.21.15.156:0/1671075320 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe170099e20 0x7fe17009a1f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0098f0 tx=0x7fe16c009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:33.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.082+0000 7fe177a24700 1 -- 172.21.15.156:0/1671075320 shutdown_connections 2023-09-30T22:23:33.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.082+0000 7fe177a24700 1 --2- 172.21.15.156:0/1671075320 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe170099e20 0x7fe17009a1f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.082+0000 7fe177a24700 1 --2- 172.21.15.156:0/1671075320 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe170130a60 0x7fe170138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.082+0000 7fe177a24700 1 -- 172.21.15.156:0/1671075320 >> 172.21.15.156:0/1671075320 conn(0x7fe1700a2980 msgr2=0x7fe1700a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:33.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.082+0000 7fe177a24700 1 -- 172.21.15.156:0/1671075320 shutdown_connections 2023-09-30T22:23:33.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.082+0000 7fe177a24700 1 -- 172.21.15.156:0/1671075320 wait complete. 2023-09-30T22:23:33.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.083+0000 7fe177a24700 1 Processor -- start 2023-09-30T22:23:33.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.083+0000 7fe177a24700 1 -- start start 2023-09-30T22:23:33.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.084+0000 7fe177a24700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe170099e20 0x7fe17011a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.084+0000 7fe177a24700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe17009a730 0x7fe17011ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.084+0000 7fe177a24700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe170130a60 0x7fe17011b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.084+0000 7fe177a24700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17011c400 con 0x7fe17009a730 2023-09-30T22:23:33.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.084+0000 7fe177a24700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17011ca20 con 0x7fe170099e20 2023-09-30T22:23:33.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.084+0000 7fe177a24700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe17011d650 con 0x7fe170130a60 2023-09-30T22:23:33.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.084+0000 7fe1757c0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe170099e20 0x7fe17011a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.084+0000 7fe1757c0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe170099e20 0x7fe17011a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52612/0 (socket says 172.21.15.156:52612) 2023-09-30T22:23:33.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.084+0000 7fe1757c0700 1 -- 172.21.15.156:0/1723874551 learned_addr learned my addr 172.21.15.156:0/1723874551 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:33.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.084+0000 7fe174fbf700 1 --2- 172.21.15.156:0/1723874551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe17009a730 0x7fe17011ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.084+0000 7fe175fc1700 1 --2- 172.21.15.156:0/1723874551 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe170130a60 0x7fe17011b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.084+0000 7fe1757c0700 1 -- 172.21.15.156:0/1723874551 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe170130a60 msgr2=0x7fe17011b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.084+0000 7fe1757c0700 1 --2- 172.21.15.156:0/1723874551 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe170130a60 0x7fe17011b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.084+0000 7fe1757c0700 1 -- 172.21.15.156:0/1723874551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe17009a730 msgr2=0x7fe17011ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.084+0000 7fe1757c0700 1 --2- 172.21.15.156:0/1723874551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe17009a730 0x7fe17011ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.084+0000 7fe1757c0700 1 -- 172.21.15.156:0/1723874551 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c009500 con 0x7fe170099e20 2023-09-30T22:23:33.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.084+0000 7fe174fbf700 1 --2- 172.21.15.156:0/1723874551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe17009a730 0x7fe17011ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:33.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.084+0000 7fe1757c0700 1 --2- 172.21.15.156:0/1723874551 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe170099e20 0x7fe17011a7f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe16c000c00 tx=0x7fe16c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:33.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.085+0000 7fe165ffb700 1 -- 172.21.15.156:0/1723874551 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c006b70 con 0x7fe170099e20 2023-09-30T22:23:33.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.085+0000 7fe165ffb700 1 -- 172.21.15.156:0/1723874551 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16c003e40 con 0x7fe170099e20 2023-09-30T22:23:33.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.085+0000 7fe165ffb700 1 -- 172.21.15.156:0/1723874551 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c00b6f0 con 0x7fe170099e20 2023-09-30T22:23:33.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.085+0000 7fe177a24700 1 -- 172.21.15.156:0/1723874551 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17011e030 con 0x7fe170099e20 2023-09-30T22:23:33.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.085+0000 7fe177a24700 1 -- 172.21.15.156:0/1723874551 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17011db00 con 0x7fe170099e20 2023-09-30T22:23:33.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.086+0000 7fe177a24700 1 -- 172.21.15.156:0/1723874551 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe170072480 con 0x7fe170099e20 2023-09-30T22:23:33.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.087+0000 7fe165ffb700 1 -- 172.21.15.156:0/1723874551 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe16c018070 con 0x7fe170099e20 2023-09-30T22:23:33.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.087+0000 7fe165ffb700 1 -- 172.21.15.156:0/1723874551 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe16c03ff80 con 0x7fe170099e20 2023-09-30T22:23:33.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.092+0000 7fe165ffb700 1 -- 172.21.15.156:0/1723874551 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe170072480 con 0x7fe170099e20 2023-09-30T22:23:33.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.210+0000 7f7c50212700 1 -- 172.21.15.156:0/1658494006 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7c4812d9d0 con 0x7f7c48133ad0 2023-09-30T22:23:33.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.210+0000 7f7c3e7fc700 1 -- 172.21.15.156:0/1658494006 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c4002a030 con 0x7f7c48133ad0 2023-09-30T22:23:33.211 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:33.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.213+0000 7f7c50212700 1 -- 172.21.15.156:0/1658494006 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c48133ad0 msgr2=0x7f7c4811e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.213+0000 7f7c50212700 1 --2- 172.21.15.156:0/1658494006 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c48133ad0 0x7f7c4811e4c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000e810 tx=0x7f7c4000eb20 comp rx=0 tx=0).stop 2023-09-30T22:23:33.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.213+0000 7f7c50212700 1 -- 172.21.15.156:0/1658494006 shutdown_connections 2023-09-30T22:23:33.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.213+0000 7f7c50212700 1 --2- 172.21.15.156:0/1658494006 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c48133ad0 0x7f7c4811e4c0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.213+0000 7f7c50212700 1 --2- 172.21.15.156:0/1658494006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c481300a0 0x7f7c4811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.213+0000 7f7c50212700 1 --2- 172.21.15.156:0/1658494006 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c48130bc0 0x7f7c4811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.213+0000 7f7c50212700 1 -- 172.21.15.156:0/1658494006 >> 172.21.15.156:0/1658494006 conn(0x7f7c48099c40 msgr2=0x7f7c4812f390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:33.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.213+0000 7f7c50212700 1 -- 172.21.15.156:0/1658494006 shutdown_connections 2023-09-30T22:23:33.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.213+0000 7f7c50212700 1 -- 172.21.15.156:0/1658494006 wait complete. 2023-09-30T22:23:33.225 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:33.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.255+0000 7fd6cce16700 1 -- 172.21.15.156:0/189082573 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd6ac005590 con 0x7fd6c8130ce0 2023-09-30T22:23:33.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.255+0000 7fd6b6ffd700 1 -- 172.21.15.156:0/189082573 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd6c0019300 con 0x7fd6c8130ce0 2023-09-30T22:23:33.256 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:33.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.257+0000 7fd6cce16700 1 -- 172.21.15.156:0/189082573 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6c8130ce0 msgr2=0x7fd6c811f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.257+0000 7fd6cce16700 1 --2- 172.21.15.156:0/189082573 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6c8130ce0 0x7fd6c811f130 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fd6c000cc20 tx=0x7fd6c000cf30 comp rx=0 tx=0).stop 2023-09-30T22:23:33.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.257+0000 7fd6cce16700 1 -- 172.21.15.156:0/189082573 shutdown_connections 2023-09-30T22:23:33.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.257+0000 7fd6cce16700 1 --2- 172.21.15.156:0/189082573 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6c8130ce0 0x7fd6c811f130 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.257+0000 7fd6cce16700 1 --2- 172.21.15.156:0/189082573 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6c809d860 0x7fd6c811e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.257+0000 7fd6cce16700 1 --2- 172.21.15.156:0/189082573 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6c809e170 0x7fd6c811ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.257+0000 7fd6cce16700 1 -- 172.21.15.156:0/189082573 >> 172.21.15.156:0/189082573 conn(0x7fd6c8099c40 msgr2=0x7fd6c80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:33.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.257+0000 7fd6cce16700 1 -- 172.21.15.156:0/189082573 shutdown_connections 2023-09-30T22:23:33.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.257+0000 7fd6cce16700 1 -- 172.21.15.156:0/189082573 wait complete. 2023-09-30T22:23:33.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:33.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.289+0000 7f4ee8fe8700 1 -- 172.21.15.156:0/1749565865 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4ee4125b60 con 0x7f4ee409f180 2023-09-30T22:23:33.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.289+0000 7f4ed2ffd700 1 -- 172.21.15.156:0/1749565865 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ed802b070 con 0x7f4ee409f180 2023-09-30T22:23:33.290 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:33.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.290+0000 7fe177a24700 1 -- 172.21.15.156:0/1723874551 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe17011db00 con 0x7fe170099e20 2023-09-30T22:23:33.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.291+0000 7fe165ffb700 1 -- 172.21.15.156:0/1723874551 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe17011db00 con 0x7fe170099e20 2023-09-30T22:23:33.291 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:33.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.291+0000 7f4ee8fe8700 1 -- 172.21.15.156:0/1749565865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ee409f180 msgr2=0x7f4ee406bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.291+0000 7f4ee8fe8700 1 --2- 172.21.15.156:0/1749565865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ee409f180 0x7f4ee406bdf0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8013000 tx=0x7f4ed8004750 comp rx=0 tx=0).stop 2023-09-30T22:23:33.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.291+0000 7f4ee8fe8700 1 -- 172.21.15.156:0/1749565865 shutdown_connections 2023-09-30T22:23:33.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.291+0000 7f4ee8fe8700 1 --2- 172.21.15.156:0/1749565865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ee4131d70 0x7f4ee406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.291+0000 7f4ee8fe8700 1 --2- 172.21.15.156:0/1749565865 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ee409e870 0x7f4ee406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.291+0000 7f4ee8fe8700 1 --2- 172.21.15.156:0/1749565865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ee409f180 0x7f4ee406bdf0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.291+0000 7f4ee8fe8700 1 -- 172.21.15.156:0/1749565865 >> 172.21.15.156:0/1749565865 conn(0x7f4ee40a4430 msgr2=0x7f4ee40a2480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:33.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.291+0000 7f4ee8fe8700 1 -- 172.21.15.156:0/1749565865 shutdown_connections 2023-09-30T22:23:33.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.291+0000 7f4ee8fe8700 1 -- 172.21.15.156:0/1749565865 wait complete. 2023-09-30T22:23:33.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.293+0000 7fe177a24700 1 -- 172.21.15.156:0/1723874551 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe170099e20 msgr2=0x7fe17011a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.293+0000 7fe177a24700 1 --2- 172.21.15.156:0/1723874551 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe170099e20 0x7fe17011a7f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe16c000c00 tx=0x7fe16c004750 comp rx=0 tx=0).stop 2023-09-30T22:23:33.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.293+0000 7fe177a24700 1 -- 172.21.15.156:0/1723874551 shutdown_connections 2023-09-30T22:23:33.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.293+0000 7fe177a24700 1 --2- 172.21.15.156:0/1723874551 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe170130a60 0x7fe17011b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.293+0000 7fe177a24700 1 --2- 172.21.15.156:0/1723874551 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe170099e20 0x7fe17011a7f0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.293+0000 7fe177a24700 1 --2- 172.21.15.156:0/1723874551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe17009a730 0x7fe17011ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.293+0000 7fe177a24700 1 -- 172.21.15.156:0/1723874551 >> 172.21.15.156:0/1723874551 conn(0x7fe1700a2980 msgr2=0x7fe1701b7ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:33.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.293+0000 7fe177a24700 1 -- 172.21.15.156:0/1723874551 shutdown_connections 2023-09-30T22:23:33.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:33.293+0000 7fe177a24700 1 -- 172.21.15.156:0/1723874551 wait complete. 2023-09-30T22:23:33.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:33.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:34.226 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:34.271 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:34.306 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:34.307 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:34.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.368+0000 7f821a1eb700 1 Processor -- start 2023-09-30T22:23:34.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.368+0000 7f821a1eb700 1 -- start start 2023-09-30T22:23:34.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.368+0000 7f821a1eb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8214133900 0x7f8214133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:34.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.368+0000 7f821a1eb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8214134210 0x7f82140a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:34.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.368+0000 7f821a1eb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f82140a0ee0 0x7f82140a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:34.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.368+0000 7f821a1eb700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821409a760 con 0x7f8214133900 2023-09-30T22:23:34.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.368+0000 7f821a1eb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82141336e0 con 0x7f82140a0ee0 2023-09-30T22:23:34.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.369+0000 7f821a1eb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f821409a080 con 0x7f8214134210 2023-09-30T22:23:34.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.369+0000 7f8212ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8214134210 0x7f82140a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:34.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.369+0000 7f8212ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8214134210 0x7f82140a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55614/0 (socket says 172.21.15.156:55614) 2023-09-30T22:23:34.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.369+0000 7f8212ffd700 1 -- 172.21.15.156:0/2790572239 learned_addr learned my addr 172.21.15.156:0/2790572239 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:34.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.369+0000 7f82137fe700 1 --2- 172.21.15.156:0/2790572239 >> v2:172.21.15.156:3300/0 conn(0x7f8214133900 0x7f8214133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:34.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.369+0000 7f8213fff700 1 --2- 172.21.15.156:0/2790572239 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f82140a0ee0 0x7f82140a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:34.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.369+0000 7f8212ffd700 1 -- 172.21.15.156:0/2790572239 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f82140a0ee0 msgr2=0x7f82140a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:34.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.369+0000 7f8212ffd700 1 --2- 172.21.15.156:0/2790572239 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f82140a0ee0 0x7f82140a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.369+0000 7f8212ffd700 1 -- 172.21.15.156:0/2790572239 >> v2:172.21.15.156:3300/0 conn(0x7f8214133900 msgr2=0x7f8214133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:34.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.369+0000 7f8212ffd700 1 --2- 172.21.15.156:0/2790572239 >> v2:172.21.15.156:3300/0 conn(0x7f8214133900 0x7f8214133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.369+0000 7f8212ffd700 1 -- 172.21.15.156:0/2790572239 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82140a23e0 con 0x7f8214134210 2023-09-30T22:23:34.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.369+0000 7f8212ffd700 1 --2- 172.21.15.156:0/2790572239 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8214134210 0x7f82140a09a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f82080098f0 tx=0x7f8208009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc3b48175f0a3f46 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:34.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.369+0000 7f82127fc700 1 -- 172.21.15.156:0/2790572239 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8208011830 con 0x7f8214134210 2023-09-30T22:23:34.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.370+0000 7f82127fc700 1 -- 172.21.15.156:0/2790572239 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8208011990 con 0x7f8214134210 2023-09-30T22:23:34.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.370+0000 7f82127fc700 1 -- 172.21.15.156:0/2790572239 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8208011d20 con 0x7f8214134210 2023-09-30T22:23:34.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.370+0000 7f821a1eb700 1 -- 172.21.15.156:0/2790572239 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8214134210 msgr2=0x7f82140a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:34.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.370+0000 7f821a1eb700 1 --2- 172.21.15.156:0/2790572239 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8214134210 0x7f82140a09a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f82080098f0 tx=0x7f8208009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:34.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.370+0000 7f821a1eb700 1 -- 172.21.15.156:0/2790572239 shutdown_connections 2023-09-30T22:23:34.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.370+0000 7f821a1eb700 1 --2- 172.21.15.156:0/2790572239 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f82140a0ee0 0x7f82140a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.370+0000 7f821a1eb700 1 --2- 172.21.15.156:0/2790572239 >> v2:172.21.15.156:3300/0 conn(0x7f8214133900 0x7f8214133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.370+0000 7f821a1eb700 1 --2- 172.21.15.156:0/2790572239 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8214134210 0x7f82140a09a0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.370+0000 7f821a1eb700 1 -- 172.21.15.156:0/2790572239 >> 172.21.15.156:0/2790572239 conn(0x7f82140a2980 msgr2=0x7f82140a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:34.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.370+0000 7f821a1eb700 1 -- 172.21.15.156:0/2790572239 shutdown_connections 2023-09-30T22:23:34.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.370+0000 7f821a1eb700 1 -- 172.21.15.156:0/2790572239 wait complete. 2023-09-30T22:23:34.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.371+0000 7f821a1eb700 1 Processor -- start 2023-09-30T22:23:34.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.372+0000 7f821a1eb700 1 -- start start 2023-09-30T22:23:34.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.372+0000 7f821a1eb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82140a0ee0 0x7f821411b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:34.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.372+0000 7f821a1eb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8214133900 0x7f821411bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:34.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.372+0000 7f821a1eb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8214134210 0x7f821411c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:34.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.372+0000 7f821a1eb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821411d3d0 con 0x7f82140a0ee0 2023-09-30T22:23:34.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.372+0000 7f821a1eb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821409a2c0 con 0x7f8214134210 2023-09-30T22:23:34.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.372+0000 7f821a1eb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f821411f000 con 0x7f8214133900 2023-09-30T22:23:34.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.372+0000 7f82137fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82140a0ee0 0x7f821411b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:34.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.372+0000 7f82137fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82140a0ee0 0x7f821411b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58070/0 (socket says 172.21.15.156:58070) 2023-09-30T22:23:34.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.372+0000 7f82137fe700 1 -- 172.21.15.156:0/910598437 learned_addr learned my addr 172.21.15.156:0/910598437 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:34.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.372+0000 7f8213fff700 1 --2- 172.21.15.156:0/910598437 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8214134210 0x7f821411c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:34.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.373+0000 7f82137fe700 1 -- 172.21.15.156:0/910598437 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8214133900 msgr2=0x7f821411bd90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:23:34.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.373+0000 7f82137fe700 1 --2- 172.21.15.156:0/910598437 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8214133900 0x7f821411bd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.373+0000 7f82137fe700 1 -- 172.21.15.156:0/910598437 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8214134210 msgr2=0x7f821411c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:34.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.373+0000 7f82137fe700 1 --2- 172.21.15.156:0/910598437 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8214134210 0x7f821411c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.373+0000 7f82137fe700 1 -- 172.21.15.156:0/910598437 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8208009550 con 0x7f82140a0ee0 2023-09-30T22:23:34.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.373+0000 7f82137fe700 1 --2- 172.21.15.156:0/910598437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82140a0ee0 0x7f821411b850 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f820400e990 tx=0x7f820400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:34.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.373+0000 7f81fbfff700 1 -- 172.21.15.156:0/910598437 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820400eee0 con 0x7f82140a0ee0 2023-09-30T22:23:34.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.373+0000 7f81fbfff700 1 -- 172.21.15.156:0/910598437 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820400c850 con 0x7f82140a0ee0 2023-09-30T22:23:34.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.373+0000 7f81fbfff700 1 -- 172.21.15.156:0/910598437 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820400cbc0 con 0x7f82140a0ee0 2023-09-30T22:23:34.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.373+0000 7f821a1eb700 1 -- 172.21.15.156:0/910598437 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8214132d60 con 0x7f82140a0ee0 2023-09-30T22:23:34.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.373+0000 7f821a1eb700 1 -- 172.21.15.156:0/910598437 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821411ea70 con 0x7f82140a0ee0 2023-09-30T22:23:34.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.374+0000 7f81fbfff700 1 -- 172.21.15.156:0/910598437 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f820400cd20 con 0x7f82140a0ee0 2023-09-30T22:23:34.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.374+0000 7f821a1eb700 1 -- 172.21.15.156:0/910598437 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82141bad80 con 0x7f82140a0ee0 2023-09-30T22:23:34.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.374+0000 7f81fbfff700 1 -- 172.21.15.156:0/910598437 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f820403fad0 con 0x7f82140a0ee0 2023-09-30T22:23:34.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.383+0000 7f81fbfff700 1 -- 172.21.15.156:0/910598437 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8204021020 con 0x7f82140a0ee0 2023-09-30T22:23:34.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.413+0000 7fb7e0f22700 1 Processor -- start 2023-09-30T22:23:34.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.413+0000 7fb7e0f22700 1 -- start start 2023-09-30T22:23:34.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.414+0000 7fb7e0f22700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb7dc09e870 0x7fb7dc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:34.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.414+0000 7fb7e0f22700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7dc131f40 0x7fb7dc139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:34.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.414+0000 7fb7e0f22700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7dc09c970 con 0x7fb7dc09f180 2023-09-30T22:23:34.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.414+0000 7fb7e0f22700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7dc0a0920 con 0x7fb7dc09e870 2023-09-30T22:23:34.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.414+0000 7fb7e0f22700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc09f9c0 con 0x7fb7dc131f40 2023-09-30T22:23:34.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.414+0000 7fb7da59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb7dc09e870 0x7fb7dc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:34.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.414+0000 7fb7da59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb7dc09e870 0x7fb7dc09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58080/0 (socket says 172.21.15.156:58080) 2023-09-30T22:23:34.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.414+0000 7fb7da59c700 1 -- 172.21.15.156:0/3970153811 learned_addr learned my addr 172.21.15.156:0/3970153811 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:34.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.414+0000 7fb7d9d9b700 1 --1- 172.21.15.156:0/3970153811 >> v1:172.21.15.156:6789/0 conn(0x7fb7dc09f180 0x7fb7dc131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:54362/0 (socket says 172.21.15.156:54362) 2023-09-30T22:23:34.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.415+0000 7fb7dad9d700 1 --2- 172.21.15.156:0/3970153811 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7dc131f40 0x7fb7dc139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:34.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.415+0000 7fb7da59c700 1 -- 172.21.15.156:0/3970153811 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7dc131f40 msgr2=0x7fb7dc139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:34.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.415+0000 7fb7da59c700 1 --2- 172.21.15.156:0/3970153811 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7dc131f40 0x7fb7dc139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.415+0000 7fb7da59c700 1 -- 172.21.15.156:0/3970153811 >> v1:172.21.15.156:6789/0 conn(0x7fb7dc09f180 legacy=0x7fb7dc131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:34.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.415+0000 7fb7da59c700 1 -- 172.21.15.156:0/3970153811 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc09bab0 con 0x7fb7dc09e870 2023-09-30T22:23:34.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.415+0000 7fb7da59c700 1 --2- 172.21.15.156:0/3970153811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7dc09e870 0x7fb7dc09ec40 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc0098f0 tx=0x7fb7cc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e923e6d2c38752a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:34.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.415+0000 7fb7d959a700 1 -- 172.21.15.156:0/3970153811 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc011830 con 0x7fb7dc09e870 2023-09-30T22:23:34.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.415+0000 7fb7d959a700 1 -- 172.21.15.156:0/3970153811 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7cc011990 con 0x7fb7dc09e870 2023-09-30T22:23:34.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.415+0000 7fb7d959a700 1 -- 172.21.15.156:0/3970153811 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc011d20 con 0x7fb7dc09e870 2023-09-30T22:23:34.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.416+0000 7fb7e0f22700 1 -- 172.21.15.156:0/3970153811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7dc09e870 msgr2=0x7fb7dc09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:34.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.416+0000 7fb7e0f22700 1 --2- 172.21.15.156:0/3970153811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7dc09e870 0x7fb7dc09ec40 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc0098f0 tx=0x7fb7cc009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:34.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.416+0000 7fb7e0f22700 1 -- 172.21.15.156:0/3970153811 shutdown_connections 2023-09-30T22:23:34.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.416+0000 7fb7e0f22700 1 --2- 172.21.15.156:0/3970153811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7dc09e870 0x7fb7dc09ec40 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.416+0000 7fb7e0f22700 1 --2- 172.21.15.156:0/3970153811 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7dc131f40 0x7fb7dc139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.416+0000 7fb7e0f22700 1 -- 172.21.15.156:0/3970153811 >> 172.21.15.156:0/3970153811 conn(0x7fb7dc0a4430 msgr2=0x7fb7dc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:34.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.416+0000 7fb7e0f22700 1 -- 172.21.15.156:0/3970153811 shutdown_connections 2023-09-30T22:23:34.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.416+0000 7fb7e0f22700 1 -- 172.21.15.156:0/3970153811 wait complete. 2023-09-30T22:23:34.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.417+0000 7fb7e0f22700 1 Processor -- start 2023-09-30T22:23:34.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.417+0000 7fb7e0f22700 1 -- start start 2023-09-30T22:23:34.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.418+0000 7fb7e0f22700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7dc09e870 0x7fb7dc120290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:34.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.418+0000 7fb7e0f22700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7dc09f180 0x7fb7dc1207d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:34.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.418+0000 7fb7e0f22700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7dc131f40 0x7fb7dc120d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:34.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.418+0000 7fb7e0f22700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc0a2f60 con 0x7fb7dc09f180 2023-09-30T22:23:34.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.418+0000 7fb7e0f22700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc1226f0 con 0x7fb7dc131f40 2023-09-30T22:23:34.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.418+0000 7fb7e0f22700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc09dba0 con 0x7fb7dc09e870 2023-09-30T22:23:34.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.418+0000 7fb7dad9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7dc131f40 0x7fb7dc120d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:34.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.418+0000 7fb7dad9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7dc131f40 0x7fb7dc120d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52634/0 (socket says 172.21.15.156:52634) 2023-09-30T22:23:34.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.418+0000 7fb7dad9d700 1 -- 172.21.15.156:0/3129378005 learned_addr learned my addr 172.21.15.156:0/3129378005 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:34.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.418+0000 7fb7da59c700 1 --2- 172.21.15.156:0/3129378005 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7dc09e870 0x7fb7dc120290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:34.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.418+0000 7fb7d9d9b700 1 --2- 172.21.15.156:0/3129378005 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7dc09f180 0x7fb7dc1207d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:34.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.418+0000 7fb7da59c700 1 -- 172.21.15.156:0/3129378005 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7dc131f40 msgr2=0x7fb7dc120d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:34.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.418+0000 7fb7da59c700 1 --2- 172.21.15.156:0/3129378005 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7dc131f40 0x7fb7dc120d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.418+0000 7fb7da59c700 1 -- 172.21.15.156:0/3129378005 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7dc09f180 msgr2=0x7fb7dc1207d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:34.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.418+0000 7fb7da59c700 1 --2- 172.21.15.156:0/3129378005 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7dc09f180 0x7fb7dc1207d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.418+0000 7fb7da59c700 1 -- 172.21.15.156:0/3129378005 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7cc009550 con 0x7fb7dc09e870 2023-09-30T22:23:34.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.418+0000 7fb7dad9d700 1 --2- 172.21.15.156:0/3129378005 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7dc131f40 0x7fb7dc120d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:34.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.418+0000 7fb7d9d9b700 1 --2- 172.21.15.156:0/3129378005 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7dc09f180 0x7fb7dc1207d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:34.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.419+0000 7fb7da59c700 1 --2- 172.21.15.156:0/3129378005 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7dc09e870 0x7fb7dc120290 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc016000 tx=0x7fb7cc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:34.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.419+0000 7fb7caffd700 1 -- 172.21.15.156:0/3129378005 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc004590 con 0x7fb7dc09e870 2023-09-30T22:23:34.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.419+0000 7fb7caffd700 1 -- 172.21.15.156:0/3129378005 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7cc01e070 con 0x7fb7dc09e870 2023-09-30T22:23:34.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.419+0000 7fb7e0f22700 1 -- 172.21.15.156:0/3129378005 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7dc122cc0 con 0x7fb7dc09e870 2023-09-30T22:23:34.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.419+0000 7fb7caffd700 1 -- 172.21.15.156:0/3129378005 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc0038a0 con 0x7fb7dc09e870 2023-09-30T22:23:34.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.419+0000 7fb7e0f22700 1 -- 172.21.15.156:0/3129378005 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7dc123ad0 con 0x7fb7dc09e870 2023-09-30T22:23:34.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.420+0000 7fb7caffd700 1 -- 172.21.15.156:0/3129378005 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb7cc003a00 con 0x7fb7dc09e870 2023-09-30T22:23:34.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.420+0000 7fb7caffd700 1 -- 172.21.15.156:0/3129378005 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb7cc0404b0 con 0x7fb7dc09e870 2023-09-30T22:23:34.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.420+0000 7fb7e0f22700 1 -- 172.21.15.156:0/3129378005 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7dc06ad00 con 0x7fb7dc09e870 2023-09-30T22:23:34.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.429+0000 7fb7caffd700 1 -- 172.21.15.156:0/3129378005 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb7cc015020 con 0x7fb7dc09e870 2023-09-30T22:23:34.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.454+0000 7faac6a0b700 1 Processor -- start 2023-09-30T22:23:34.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.454+0000 7faac6a0b700 1 -- start start 2023-09-30T22:23:34.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.454+0000 7faac6a0b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faac0133ad0 0x7faac0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:34.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.454+0000 7faac6a0b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faac01300a0 0x7faac01304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:34.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.455+0000 7faac6a0b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac006b2d0 con 0x7faac01309f0 2023-09-30T22:23:34.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.455+0000 7faac6a0b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac0133610 con 0x7faac01300a0 2023-09-30T22:23:34.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.455+0000 7faac6a0b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faac009a500 con 0x7faac0133ad0 2023-09-30T22:23:34.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.455+0000 7faabffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faac0133ad0 0x7faac0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:34.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.455+0000 7faabffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faac0133ad0 0x7faac0133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55634/0 (socket says 172.21.15.156:55634) 2023-09-30T22:23:34.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.455+0000 7faabffff700 1 -- 172.21.15.156:0/2832876390 learned_addr learned my addr 172.21.15.156:0/2832876390 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:34.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.455+0000 7faabf7fe700 1 --2- 172.21.15.156:0/2832876390 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faac01300a0 0x7faac01304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:34.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.455+0000 7faabf7fe700 1 -- 172.21.15.156:0/2832876390 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faac0133ad0 msgr2=0x7faac0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:34.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.455+0000 7faabf7fe700 1 --2- 172.21.15.156:0/2832876390 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faac0133ad0 0x7faac0133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.455+0000 7faabf7fe700 1 -- 172.21.15.156:0/2832876390 >> v1:172.21.15.156:6789/0 conn(0x7faac01309f0 legacy=0x7faac013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:34.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.455+0000 7faabf7fe700 1 -- 172.21.15.156:0/2832876390 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac01338b0 con 0x7faac01300a0 2023-09-30T22:23:34.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.455+0000 7faabf7fe700 1 --2- 172.21.15.156:0/2832876390 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faac01300a0 0x7faac01304b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7faab4009870 tx=0x7faab4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a27f27c80a43728 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:34.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.455+0000 7faabeffd700 1 -- 172.21.15.156:0/2832876390 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab4011830 con 0x7faac01300a0 2023-09-30T22:23:34.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.456+0000 7faabeffd700 1 -- 172.21.15.156:0/2832876390 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab4011990 con 0x7faac01300a0 2023-09-30T22:23:34.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.456+0000 7faabeffd700 1 -- 172.21.15.156:0/2832876390 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab4011d20 con 0x7faac01300a0 2023-09-30T22:23:34.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.456+0000 7faac6a0b700 1 -- 172.21.15.156:0/2832876390 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faac01300a0 msgr2=0x7faac01304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:34.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.456+0000 7faac6a0b700 1 --2- 172.21.15.156:0/2832876390 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faac01300a0 0x7faac01304b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7faab4009870 tx=0x7faab4009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:34.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.456+0000 7faac6a0b700 1 -- 172.21.15.156:0/2832876390 shutdown_connections 2023-09-30T22:23:34.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.456+0000 7faac6a0b700 1 --2- 172.21.15.156:0/2832876390 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faac0133ad0 0x7faac0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.456+0000 7faac6a0b700 1 --2- 172.21.15.156:0/2832876390 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faac01300a0 0x7faac01304b0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.456+0000 7faac6a0b700 1 -- 172.21.15.156:0/2832876390 >> 172.21.15.156:0/2832876390 conn(0x7faac0099c40 msgr2=0x7faac00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:34.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.456+0000 7faac6a0b700 1 -- 172.21.15.156:0/2832876390 shutdown_connections 2023-09-30T22:23:34.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.456+0000 7faac6a0b700 1 -- 172.21.15.156:0/2832876390 wait complete. 2023-09-30T22:23:34.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.457+0000 7faac6a0b700 1 Processor -- start 2023-09-30T22:23:34.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.458+0000 7faac6a0b700 1 -- start start 2023-09-30T22:23:34.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.458+0000 7faac6a0b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faac01300a0 0x7faac011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:34.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.458+0000 7faac6a0b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faac01309f0 0x7faac011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:34.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.458+0000 7faac6a0b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faac0133ad0 0x7faac011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:34.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.458+0000 7faac6a0b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac012d6c0 con 0x7faac0133ad0 2023-09-30T22:23:34.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.458+0000 7faac6a0b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac0072330 con 0x7faac01300a0 2023-09-30T22:23:34.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.458+0000 7faac6a0b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faac011ff20 con 0x7faac01309f0 2023-09-30T22:23:34.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.458+0000 7faabffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faac01300a0 0x7faac011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:34.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.459+0000 7faabffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faac01300a0 0x7faac011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52648/0 (socket says 172.21.15.156:52648) 2023-09-30T22:23:34.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.459+0000 7faabffff700 1 -- 172.21.15.156:0/676387452 learned_addr learned my addr 172.21.15.156:0/676387452 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:34.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.459+0000 7faabf7fe700 1 --2- 172.21.15.156:0/676387452 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faac01309f0 0x7faac011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:34.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.459+0000 7faac4fa8700 1 --2- 172.21.15.156:0/676387452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faac0133ad0 0x7faac011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:34.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.459+0000 7faabffff700 1 -- 172.21.15.156:0/676387452 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faac01309f0 msgr2=0x7faac011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:34.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.459+0000 7faabffff700 1 --2- 172.21.15.156:0/676387452 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faac01309f0 0x7faac011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.459+0000 7faabffff700 1 -- 172.21.15.156:0/676387452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faac0133ad0 msgr2=0x7faac011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:34.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.459+0000 7faabffff700 1 --2- 172.21.15.156:0/676387452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faac0133ad0 0x7faac011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.459+0000 7faabffff700 1 -- 172.21.15.156:0/676387452 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab40094a0 con 0x7faac01300a0 2023-09-30T22:23:34.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.459+0000 7f32d7b45700 1 Processor -- start 2023-09-30T22:23:34.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.459+0000 7faabffff700 1 --2- 172.21.15.156:0/676387452 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faac01300a0 0x7faac011da40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7faab000e910 tx=0x7faab000ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:34.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.459+0000 7faabcff9700 1 -- 172.21.15.156:0/676387452 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab00096a0 con 0x7faac01300a0 2023-09-30T22:23:34.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.459+0000 7f32d7b45700 1 -- start start 2023-09-30T22:23:34.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.459+0000 7faabcff9700 1 -- 172.21.15.156:0/676387452 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab0013680 con 0x7faac01300a0 2023-09-30T22:23:34.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.459+0000 7faabcff9700 1 -- 172.21.15.156:0/676387452 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab0013a30 con 0x7faac01300a0 2023-09-30T22:23:34.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.459+0000 7faac6a0b700 1 -- 172.21.15.156:0/676387452 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac012fe10 con 0x7faac01300a0 2023-09-30T22:23:34.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.459+0000 7faac6a0b700 1 -- 172.21.15.156:0/676387452 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac0071990 con 0x7faac01300a0 2023-09-30T22:23:34.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.460+0000 7f32d7b45700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32d01335f0 0x7f32d01359d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:34.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.460+0000 7f32d7b45700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f32d0135f10 0x7f32d01382f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:34.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.460+0000 7f32d7b45700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32d009bb90 con 0x7f32d012d380 2023-09-30T22:23:34.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.460+0000 7f32d7b45700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32d009c210 con 0x7f32d0135f10 2023-09-30T22:23:34.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.460+0000 7f32d7b45700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d009ced0 con 0x7f32d01335f0 2023-09-30T22:23:34.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.460+0000 7f32d58e1700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f32d012d380 0x7f32d012d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:54382/0 (socket says 172.21.15.156:54382) 2023-09-30T22:23:34.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.460+0000 7f32d58e1700 1 -- 172.21.15.156:0/2588651580 learned_addr learned my addr 172.21.15.156:0/2588651580 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:34.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.460+0000 7f32d50e0700 1 --2- 172.21.15.156:0/2588651580 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32d01335f0 0x7f32d01359d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:34.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.461+0000 7f32d48df700 1 -- 172.21.15.156:0/2588651580 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538609145 0 0) 0x7f32d009bb90 con 0x7f32d012d380 2023-09-30T22:23:34.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.461+0000 7f32d48df700 1 -- 172.21.15.156:0/2588651580 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32bc0035b0 con 0x7f32d012d380 2023-09-30T22:23:34.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.461+0000 7f32d50e0700 1 -- 172.21.15.156:0/2588651580 >> v2:172.21.15.156:3300/0 conn(0x7f32d0135f10 msgr2=0x7f32d01382f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:23:34.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.461+0000 7f32d50e0700 1 --2- 172.21.15.156:0/2588651580 >> v2:172.21.15.156:3300/0 conn(0x7f32d0135f10 0x7f32d01382f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.461+0000 7f32d50e0700 1 -- 172.21.15.156:0/2588651580 >> v1:172.21.15.156:6789/0 conn(0x7f32d012d380 legacy=0x7f32d012d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:34.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.461+0000 7f32d50e0700 1 -- 172.21.15.156:0/2588651580 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d009ac30 con 0x7f32d01335f0 2023-09-30T22:23:34.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.461+0000 7f32d50e0700 1 --2- 172.21.15.156:0/2588651580 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32d01335f0 0x7f32d01359d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f32c8009d90 tx=0x7f32c800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4b2c73ab7a38e99 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:34.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.461+0000 7faabcff9700 1 -- 172.21.15.156:0/676387452 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faab0013b90 con 0x7faac01300a0 2023-09-30T22:23:34.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.461+0000 7f32d48df700 1 -- 172.21.15.156:0/2588651580 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c800e070 con 0x7f32d01335f0 2023-09-30T22:23:34.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.461+0000 7f32d48df700 1 -- 172.21.15.156:0/2588651580 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c800bb20 con 0x7f32d01335f0 2023-09-30T22:23:34.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.461+0000 7f32d48df700 1 -- 172.21.15.156:0/2588651580 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c8012430 con 0x7f32d01335f0 2023-09-30T22:23:34.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.461+0000 7faabcff9700 1 -- 172.21.15.156:0/676387452 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faab003fe40 con 0x7faac01300a0 2023-09-30T22:23:34.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.462+0000 7f32d7b45700 1 -- 172.21.15.156:0/2588651580 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32d01335f0 msgr2=0x7f32d01359d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:34.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.462+0000 7f32d7b45700 1 --2- 172.21.15.156:0/2588651580 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32d01335f0 0x7f32d01359d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f32c8009d90 tx=0x7f32c800b330 comp rx=0 tx=0).stop 2023-09-30T22:23:34.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.462+0000 7f32d7b45700 1 -- 172.21.15.156:0/2588651580 shutdown_connections 2023-09-30T22:23:34.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.462+0000 7f32d7b45700 1 --2- 172.21.15.156:0/2588651580 >> v2:172.21.15.156:3300/0 conn(0x7f32d0135f10 0x7f32d01382f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.462+0000 7f32d7b45700 1 --2- 172.21.15.156:0/2588651580 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32d01335f0 0x7f32d01359d0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.462+0000 7f32d7b45700 1 -- 172.21.15.156:0/2588651580 >> 172.21.15.156:0/2588651580 conn(0x7f32d00a2980 msgr2=0x7f32d00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:34.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.462+0000 7f32d7b45700 1 -- 172.21.15.156:0/2588651580 shutdown_connections 2023-09-30T22:23:34.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.462+0000 7f32d7b45700 1 -- 172.21.15.156:0/2588651580 wait complete. 2023-09-30T22:23:34.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.463+0000 7f32d7b45700 1 Processor -- start 2023-09-30T22:23:34.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.463+0000 7f32d7b45700 1 -- start start 2023-09-30T22:23:34.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.464+0000 7f32d7b45700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32d012d380 0x7f32d012c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:34.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.464+0000 7f32d7b45700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32d01335f0 0x7f32d00700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:34.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.464+0000 7f32d7b45700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32d0135f10 0x7f32d0070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:34.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.464+0000 7f32d7b45700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d00a1610 con 0x7f32d0135f10 2023-09-30T22:23:34.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.464+0000 7f32d7b45700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d0133ac0 con 0x7f32d01335f0 2023-09-30T22:23:34.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.464+0000 7f32d7b45700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32d01197b0 con 0x7f32d012d380 2023-09-30T22:23:34.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.464+0000 7f32d58e1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32d012d380 0x7f32d012c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:34.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.464+0000 7f32d60e2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32d0135f10 0x7f32d0070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:34.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.464+0000 7f32d58e1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32d012d380 0x7f32d012c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55644/0 (socket says 172.21.15.156:55644) 2023-09-30T22:23:34.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.464+0000 7f32d58e1700 1 -- 172.21.15.156:0/83338165 learned_addr learned my addr 172.21.15.156:0/83338165 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:34.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.464+0000 7f32d50e0700 1 --2- 172.21.15.156:0/83338165 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32d01335f0 0x7f32d00700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:34.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.465+0000 7f32d50e0700 1 -- 172.21.15.156:0/83338165 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32d012d380 msgr2=0x7f32d012c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:34.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.465+0000 7f32d50e0700 1 --2- 172.21.15.156:0/83338165 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32d012d380 0x7f32d012c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.465+0000 7f32d50e0700 1 -- 172.21.15.156:0/83338165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32d0135f10 msgr2=0x7f32d0070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:34.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.465+0000 7f32d50e0700 1 --2- 172.21.15.156:0/83338165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32d0135f10 0x7f32d0070600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.465+0000 7f32d50e0700 1 -- 172.21.15.156:0/83338165 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c8009a70 con 0x7f32d01335f0 2023-09-30T22:23:34.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.465+0000 7f32d50e0700 1 --2- 172.21.15.156:0/83338165 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32d01335f0 0x7f32d00700c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f32c8016000 tx=0x7f32c8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:34.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.465+0000 7f32c67fc700 1 -- 172.21.15.156:0/83338165 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c8012430 con 0x7f32d01335f0 2023-09-30T22:23:34.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.465+0000 7f32c67fc700 1 -- 172.21.15.156:0/83338165 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c8020070 con 0x7f32d01335f0 2023-09-30T22:23:34.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.465+0000 7f32d7b45700 1 -- 172.21.15.156:0/83338165 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32d012ce60 con 0x7f32d01335f0 2023-09-30T22:23:34.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.465+0000 7f32c67fc700 1 -- 172.21.15.156:0/83338165 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c8004280 con 0x7f32d01335f0 2023-09-30T22:23:34.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.465+0000 7f32d7b45700 1 -- 172.21.15.156:0/83338165 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32d011a600 con 0x7f32d01335f0 2023-09-30T22:23:34.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.466+0000 7faac6a0b700 1 -- 172.21.15.156:0/676387452 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac011fba0 con 0x7faac01300a0 2023-09-30T22:23:34.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.466+0000 7f32c67fc700 1 -- 172.21.15.156:0/83338165 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f32c80043e0 con 0x7f32d01335f0 2023-09-30T22:23:34.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.466+0000 7f32c67fc700 1 -- 172.21.15.156:0/83338165 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f32c8022070 con 0x7f32d01335f0 2023-09-30T22:23:34.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.466+0000 7f32d7b45700 1 -- 172.21.15.156:0/83338165 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32d01194d0 con 0x7f32d01335f0 2023-09-30T22:23:34.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.471+0000 7faabcff9700 1 -- 172.21.15.156:0/676387452 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faac011fba0 con 0x7faac01300a0 2023-09-30T22:23:34.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.475+0000 7f32c67fc700 1 -- 172.21.15.156:0/83338165 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f32c802c080 con 0x7f32d01335f0 2023-09-30T22:23:34.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.607+0000 7f821a1eb700 1 -- 172.21.15.156:0/910598437 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f821404f2a0 con 0x7f82140a0ee0 2023-09-30T22:23:34.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.607+0000 7f81fbfff700 1 -- 172.21.15.156:0/910598437 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8204017070 con 0x7f82140a0ee0 2023-09-30T22:23:34.608 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:34.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.610+0000 7f821a1eb700 1 -- 172.21.15.156:0/910598437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82140a0ee0 msgr2=0x7f821411b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:34.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.610+0000 7f821a1eb700 1 --2- 172.21.15.156:0/910598437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82140a0ee0 0x7f821411b850 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f820400e990 tx=0x7f820400eca0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.610+0000 7f821a1eb700 1 -- 172.21.15.156:0/910598437 shutdown_connections 2023-09-30T22:23:34.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.610+0000 7f821a1eb700 1 --2- 172.21.15.156:0/910598437 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8214134210 0x7f821411c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.610+0000 7f821a1eb700 1 --2- 172.21.15.156:0/910598437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82140a0ee0 0x7f821411b850 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.610+0000 7f821a1eb700 1 --2- 172.21.15.156:0/910598437 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8214133900 0x7f821411bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.610+0000 7f821a1eb700 1 -- 172.21.15.156:0/910598437 >> 172.21.15.156:0/910598437 conn(0x7f82140a2980 msgr2=0x7f82141307e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:34.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.611+0000 7f821a1eb700 1 -- 172.21.15.156:0/910598437 shutdown_connections 2023-09-30T22:23:34.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.611+0000 7f821a1eb700 1 -- 172.21.15.156:0/910598437 wait complete. 2023-09-30T22:23:34.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:34.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.628+0000 7fb7e0f22700 1 -- 172.21.15.156:0/3129378005 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb7dc11ce70 con 0x7fb7dc09e870 2023-09-30T22:23:34.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.629+0000 7fb7caffd700 1 -- 172.21.15.156:0/3129378005 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb7cc003cb0 con 0x7fb7dc09e870 2023-09-30T22:23:34.629 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:34.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.631+0000 7fb7e0f22700 1 -- 172.21.15.156:0/3129378005 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7dc09e870 msgr2=0x7fb7dc120290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:34.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.631+0000 7fb7e0f22700 1 --2- 172.21.15.156:0/3129378005 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7dc09e870 0x7fb7dc120290 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc016000 tx=0x7fb7cc004750 comp rx=0 tx=0).stop 2023-09-30T22:23:34.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.631+0000 7fb7e0f22700 1 -- 172.21.15.156:0/3129378005 shutdown_connections 2023-09-30T22:23:34.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.631+0000 7fb7e0f22700 1 --2- 172.21.15.156:0/3129378005 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7dc131f40 0x7fb7dc120d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.631+0000 7fb7e0f22700 1 --2- 172.21.15.156:0/3129378005 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7dc09e870 0x7fb7dc120290 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.631+0000 7fb7e0f22700 1 --2- 172.21.15.156:0/3129378005 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7dc09f180 0x7fb7dc1207d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.631+0000 7fb7e0f22700 1 -- 172.21.15.156:0/3129378005 >> 172.21.15.156:0/3129378005 conn(0x7fb7dc0a4430 msgr2=0x7fb7dc072380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:34.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.631+0000 7fb7e0f22700 1 -- 172.21.15.156:0/3129378005 shutdown_connections 2023-09-30T22:23:34.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.631+0000 7fb7e0f22700 1 -- 172.21.15.156:0/3129378005 wait complete. 2023-09-30T22:23:34.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:34.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.668+0000 7f32d7b45700 1 -- 172.21.15.156:0/83338165 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f32d009b440 con 0x7f32d01335f0 2023-09-30T22:23:34.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.668+0000 7f32c67fc700 1 -- 172.21.15.156:0/83338165 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f32c8012e40 con 0x7f32d01335f0 2023-09-30T22:23:34.669 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:34.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.671+0000 7f32d7b45700 1 -- 172.21.15.156:0/83338165 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32d01335f0 msgr2=0x7f32d00700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:34.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.671+0000 7f32d7b45700 1 --2- 172.21.15.156:0/83338165 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32d01335f0 0x7f32d00700c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f32c8016000 tx=0x7f32c8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.671+0000 7f32d7b45700 1 -- 172.21.15.156:0/83338165 shutdown_connections 2023-09-30T22:23:34.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.671+0000 7f32d7b45700 1 --2- 172.21.15.156:0/83338165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32d0135f10 0x7f32d0070600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.671+0000 7f32d7b45700 1 --2- 172.21.15.156:0/83338165 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32d012d380 0x7f32d012c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.671+0000 7f32d7b45700 1 --2- 172.21.15.156:0/83338165 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32d01335f0 0x7f32d00700c0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.671+0000 7f32d7b45700 1 -- 172.21.15.156:0/83338165 >> 172.21.15.156:0/83338165 conn(0x7f32d00a2980 msgr2=0x7f32d0132470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:34.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.671+0000 7f32d7b45700 1 -- 172.21.15.156:0/83338165 shutdown_connections 2023-09-30T22:23:34.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.671+0000 7f32d7b45700 1 -- 172.21.15.156:0/83338165 wait complete. 2023-09-30T22:23:34.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:34.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.695+0000 7faac6a0b700 1 -- 172.21.15.156:0/676387452 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faac011fba0 con 0x7faac01300a0 2023-09-30T22:23:34.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.695+0000 7faabcff9700 1 -- 172.21.15.156:0/676387452 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faac011fba0 con 0x7faac01300a0 2023-09-30T22:23:34.696 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:34.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.697+0000 7faac6a0b700 1 -- 172.21.15.156:0/676387452 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faac01300a0 msgr2=0x7faac011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:34.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.697+0000 7faac6a0b700 1 --2- 172.21.15.156:0/676387452 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faac01300a0 0x7faac011da40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7faab000e910 tx=0x7faab000ec20 comp rx=0 tx=0).stop 2023-09-30T22:23:34.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.697+0000 7faac6a0b700 1 -- 172.21.15.156:0/676387452 shutdown_connections 2023-09-30T22:23:34.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.697+0000 7faac6a0b700 1 --2- 172.21.15.156:0/676387452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faac0133ad0 0x7faac011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.697+0000 7faac6a0b700 1 --2- 172.21.15.156:0/676387452 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faac01300a0 0x7faac011da40 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.697+0000 7faac6a0b700 1 --2- 172.21.15.156:0/676387452 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faac01309f0 0x7faac011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.697+0000 7faac6a0b700 1 -- 172.21.15.156:0/676387452 >> 172.21.15.156:0/676387452 conn(0x7faac0099c40 msgr2=0x7faac00a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:34.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.698+0000 7faac6a0b700 1 -- 172.21.15.156:0/676387452 shutdown_connections 2023-09-30T22:23:34.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:34.698+0000 7faac6a0b700 1 -- 172.21.15.156:0/676387452 wait complete. 2023-09-30T22:23:34.710 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:35.628 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:35.644 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:35.684 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:35.711 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:35.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.784+0000 7f68dc6dd700 1 Processor -- start 2023-09-30T22:23:35.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.784+0000 7f68dc6dd700 1 -- start start 2023-09-30T22:23:35.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.785+0000 7f68dc6dd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f68d4133ad0 0x7f68d4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.785+0000 7f68dc6dd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68d4130bc0 0x7f68d413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.785+0000 7f68dc6dd700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d406b2d0 con 0x7f68d41300a0 2023-09-30T22:23:35.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.785+0000 7f68dc6dd700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d4133610 con 0x7f68d4133ad0 2023-09-30T22:23:35.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.785+0000 7f68dc6dd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d409a500 con 0x7f68d4130bc0 2023-09-30T22:23:35.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.785+0000 7f68da479700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f68d4133ad0 0x7f68d4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.785+0000 7f68da479700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f68d4133ad0 0x7f68d4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58124/0 (socket says 172.21.15.156:58124) 2023-09-30T22:23:35.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.785+0000 7f68da479700 1 -- 172.21.15.156:0/3966636871 learned_addr learned my addr 172.21.15.156:0/3966636871 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:35.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.785+0000 7f68dac7a700 1 --2- 172.21.15.156:0/3966636871 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68d4130bc0 0x7f68d413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.785+0000 7f68da479700 1 -- 172.21.15.156:0/3966636871 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68d4130bc0 msgr2=0x7f68d413b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:35.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.785+0000 7f68da479700 1 --2- 172.21.15.156:0/3966636871 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68d4130bc0 0x7f68d413b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.785+0000 7f68da479700 1 -- 172.21.15.156:0/3966636871 >> v1:172.21.15.156:6789/0 conn(0x7f68d41300a0 legacy=0x7f68d41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.785+0000 7f68da479700 1 -- 172.21.15.156:0/3966636871 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d41338b0 con 0x7f68d4133ad0 2023-09-30T22:23:35.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.785+0000 7f68da479700 1 --2- 172.21.15.156:0/3966636871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68d4133ad0 0x7f68d4133ea0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f68d00098f0 tx=0x7f68d0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afecf9549e191192 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:35.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.786+0000 7f68d9477700 1 -- 172.21.15.156:0/3966636871 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0011830 con 0x7f68d4133ad0 2023-09-30T22:23:35.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.786+0000 7f68d9477700 1 -- 172.21.15.156:0/3966636871 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d0011990 con 0x7f68d4133ad0 2023-09-30T22:23:35.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.786+0000 7f68d9477700 1 -- 172.21.15.156:0/3966636871 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0011d20 con 0x7f68d4133ad0 2023-09-30T22:23:35.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.786+0000 7f68dc6dd700 1 -- 172.21.15.156:0/3966636871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68d4133ad0 msgr2=0x7f68d4133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.786+0000 7f68dc6dd700 1 --2- 172.21.15.156:0/3966636871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68d4133ad0 0x7f68d4133ea0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f68d00098f0 tx=0x7f68d0009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:35.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.786+0000 7f68dc6dd700 1 -- 172.21.15.156:0/3966636871 shutdown_connections 2023-09-30T22:23:35.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.786+0000 7f68dc6dd700 1 --2- 172.21.15.156:0/3966636871 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68d4130bc0 0x7f68d413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.786+0000 7f68dc6dd700 1 --2- 172.21.15.156:0/3966636871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68d4133ad0 0x7f68d4133ea0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.786+0000 7f68dc6dd700 1 -- 172.21.15.156:0/3966636871 >> 172.21.15.156:0/3966636871 conn(0x7f68d4099c40 msgr2=0x7f68d40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:35.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.787+0000 7f68dc6dd700 1 -- 172.21.15.156:0/3966636871 shutdown_connections 2023-09-30T22:23:35.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.787+0000 7f68dc6dd700 1 -- 172.21.15.156:0/3966636871 wait complete. 2023-09-30T22:23:35.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.787+0000 7f68dc6dd700 1 Processor -- start 2023-09-30T22:23:35.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.788+0000 7f68dc6dd700 1 -- start start 2023-09-30T22:23:35.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.788+0000 7f68dc6dd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f68d41300a0 0x7f68d411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.788+0000 7f68dc6dd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68d4130bc0 0x7f68d411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.788+0000 7f68dc6dd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68d4133ad0 0x7f68d411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.788+0000 7f68dc6dd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d412da10 con 0x7f68d4133ad0 2023-09-30T22:23:35.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.788+0000 7f68dc6dd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d412dd00 con 0x7f68d4130bc0 2023-09-30T22:23:35.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.788+0000 7f68dc6dd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68d411fe50 con 0x7f68d41300a0 2023-09-30T22:23:35.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.788+0000 7f68dac7a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68d4133ad0 0x7f68d411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.788+0000 7f68dac7a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68d4133ad0 0x7f68d411e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58138/0 (socket says 172.21.15.156:58138) 2023-09-30T22:23:35.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.788+0000 7f68d9c78700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68d4130bc0 0x7f68d411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.788+0000 7f68dac7a700 1 -- 172.21.15.156:0/4123667173 learned_addr learned my addr 172.21.15.156:0/4123667173 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:35.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.789+0000 7f68dac7a700 1 -- 172.21.15.156:0/4123667173 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f68d41300a0 msgr2=0x7f68d411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.789+0000 7f68dac7a700 1 --2- 172.21.15.156:0/4123667173 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f68d41300a0 0x7f68d411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.789+0000 7f68dac7a700 1 -- 172.21.15.156:0/4123667173 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68d4130bc0 msgr2=0x7f68d411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.789+0000 7f68dac7a700 1 --2- 172.21.15.156:0/4123667173 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68d4130bc0 0x7f68d411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.789+0000 7f68dac7a700 1 -- 172.21.15.156:0/4123667173 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d0009550 con 0x7f68d4133ad0 2023-09-30T22:23:35.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.789+0000 7f68dac7a700 1 --2- 172.21.15.156:0/4123667173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68d4133ad0 0x7f68d411e4c0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f68cc00efc0 tx=0x7f68cc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:35.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.789+0000 7f68caffd700 1 -- 172.21.15.156:0/4123667173 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68cc009ea0 con 0x7f68d4133ad0 2023-09-30T22:23:35.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.789+0000 7f68caffd700 1 -- 172.21.15.156:0/4123667173 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68cc00f040 con 0x7f68d4133ad0 2023-09-30T22:23:35.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.789+0000 7f68dc6dd700 1 -- 172.21.15.156:0/4123667173 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d412fe40 con 0x7f68d4133ad0 2023-09-30T22:23:35.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.789+0000 7f68caffd700 1 -- 172.21.15.156:0/4123667173 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68cc014480 con 0x7f68d4133ad0 2023-09-30T22:23:35.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.789+0000 7f68dc6dd700 1 -- 172.21.15.156:0/4123667173 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d4120a30 con 0x7f68d4133ad0 2023-09-30T22:23:35.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.790+0000 7f68caffd700 1 -- 172.21.15.156:0/4123667173 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f68cc0145e0 con 0x7f68d4133ad0 2023-09-30T22:23:35.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.790+0000 7f68caffd700 1 -- 172.21.15.156:0/4123667173 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f68cc0418a0 con 0x7f68d4133ad0 2023-09-30T22:23:35.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.790+0000 7f68dc6dd700 1 -- 172.21.15.156:0/4123667173 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d404f2a0 con 0x7f68d4133ad0 2023-09-30T22:23:35.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.799+0000 7f68caffd700 1 -- 172.21.15.156:0/4123667173 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68cc018080 con 0x7f68d4133ad0 2023-09-30T22:23:35.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.822+0000 7f4f055b6700 1 Processor -- start 2023-09-30T22:23:35.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.822+0000 7f4f055b6700 1 -- start start 2023-09-30T22:23:35.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.822+0000 7f4f055b6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f00133a70 0x7f4f00133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.822+0000 7f4f055b6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f000a08e0 0x7f4f000a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.822+0000 7f4f055b6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4f000a1290 0x7f4f0013a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.822+0000 7f4f055b6700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f00133640 con 0x7f4f000a1290 2023-09-30T22:23:35.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.822+0000 7f4f055b6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f000a1d50 con 0x7f4f000a08e0 2023-09-30T22:23:35.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.822+0000 7f4f055b6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f000a1730 con 0x7f4f00133a70 2023-09-30T22:23:35.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.823+0000 7f4eff7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4f000a1290 0x7f4f0013a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.823+0000 7f4eff7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4f000a1290 0x7f4f0013a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58146/0 (socket says 172.21.15.156:58146) 2023-09-30T22:23:35.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.823+0000 7f4eff7fe700 1 -- 172.21.15.156:0/3682670791 learned_addr learned my addr 172.21.15.156:0/3682670791 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:35.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.823+0000 7f4efe7fc700 1 --2- 172.21.15.156:0/3682670791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f000a08e0 0x7f4f000a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.823+0000 7f4efeffd700 1 --2- 172.21.15.156:0/3682670791 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f00133a70 0x7f4f00133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.823+0000 7f4eff7fe700 1 -- 172.21.15.156:0/3682670791 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f00133a70 msgr2=0x7f4f00133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:35.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.823+0000 7f4eff7fe700 1 --2- 172.21.15.156:0/3682670791 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f00133a70 0x7f4f00133e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.823+0000 7f4eff7fe700 1 -- 172.21.15.156:0/3682670791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f000a08e0 msgr2=0x7f4f000a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:35.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.823+0000 7f4eff7fe700 1 --2- 172.21.15.156:0/3682670791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f000a08e0 0x7f4f000a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.823+0000 7f4eff7fe700 1 -- 172.21.15.156:0/3682670791 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0009b620 con 0x7f4f000a1290 2023-09-30T22:23:35.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.823+0000 7f4efe7fc700 1 --2- 172.21.15.156:0/3682670791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f000a08e0 0x7f4f000a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:35.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.823+0000 7f4eff7fe700 1 --2- 172.21.15.156:0/3682670791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f000a1290 0x7f4f0013a970 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8009e50 tx=0x7f4ef800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7acdb83544bc662d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:35.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.823+0000 7f4efdffb700 1 -- 172.21.15.156:0/3682670791 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef800e070 con 0x7f4f000a1290 2023-09-30T22:23:35.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.823+0000 7f4efdffb700 1 -- 172.21.15.156:0/3682670791 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef800b910 con 0x7f4f000a1290 2023-09-30T22:23:35.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.824+0000 7f4efdffb700 1 -- 172.21.15.156:0/3682670791 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef800bcc0 con 0x7f4f000a1290 2023-09-30T22:23:35.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.824+0000 7f4f055b6700 1 -- 172.21.15.156:0/3682670791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f000a1290 msgr2=0x7f4f0013a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.824+0000 7f4f055b6700 1 --2- 172.21.15.156:0/3682670791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f000a1290 0x7f4f0013a970 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8009e50 tx=0x7f4ef800b330 comp rx=0 tx=0).stop 2023-09-30T22:23:35.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.824+0000 7f4f055b6700 1 -- 172.21.15.156:0/3682670791 shutdown_connections 2023-09-30T22:23:35.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.824+0000 7f4f055b6700 1 --2- 172.21.15.156:0/3682670791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f000a1290 0x7f4f0013a970 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.824+0000 7f4f055b6700 1 --2- 172.21.15.156:0/3682670791 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f00133a70 0x7f4f00133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.825+0000 7f4f055b6700 1 --2- 172.21.15.156:0/3682670791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f000a08e0 0x7f4f000a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.825+0000 7f4f055b6700 1 -- 172.21.15.156:0/3682670791 >> 172.21.15.156:0/3682670791 conn(0x7f4f000a2980 msgr2=0x7f4f000a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:35.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.825+0000 7f4f055b6700 1 -- 172.21.15.156:0/3682670791 shutdown_connections 2023-09-30T22:23:35.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.825+0000 7f4f055b6700 1 -- 172.21.15.156:0/3682670791 wait complete. 2023-09-30T22:23:35.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.826+0000 7f4f055b6700 1 Processor -- start 2023-09-30T22:23:35.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.826+0000 7f4f055b6700 1 -- start start 2023-09-30T22:23:35.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.827+0000 7f4f055b6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f000a08e0 0x7f4f0011a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.827+0000 7f4f055b6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f000a1290 0x7f4f0011abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.827+0000 7f4f055b6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f00133a70 0x7f4f0011b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.827+0000 7f4f055b6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0011eb50 con 0x7f4f00133a70 2023-09-30T22:23:35.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.827+0000 7f4f055b6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0011e190 con 0x7f4f000a08e0 2023-09-30T22:23:35.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.827+0000 7f4f055b6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0011c320 con 0x7f4f000a1290 2023-09-30T22:23:35.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.827+0000 7f4efeffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f000a08e0 0x7f4f0011a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.827+0000 7f4efeffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f000a08e0 0x7f4f0011a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52706/0 (socket says 172.21.15.156:52706) 2023-09-30T22:23:35.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.827+0000 7f4efeffd700 1 -- 172.21.15.156:0/2802416574 learned_addr learned my addr 172.21.15.156:0/2802416574 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:35.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.827+0000 7f4eff7fe700 1 --2- 172.21.15.156:0/2802416574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f00133a70 0x7f4f0011b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.827+0000 7f4efe7fc700 1 --2- 172.21.15.156:0/2802416574 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f000a1290 0x7f4f0011abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.827+0000 7f4eff7fe700 1 -- 172.21.15.156:0/2802416574 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f000a1290 msgr2=0x7f4f0011abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.827+0000 7f4eff7fe700 1 --2- 172.21.15.156:0/2802416574 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f000a1290 0x7f4f0011abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.827+0000 7f4eff7fe700 1 -- 172.21.15.156:0/2802416574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f000a08e0 msgr2=0x7f4f0011a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.827+0000 7f4eff7fe700 1 --2- 172.21.15.156:0/2802416574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f000a08e0 0x7f4f0011a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.827+0000 7f4eff7fe700 1 -- 172.21.15.156:0/2802416574 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef40094a0 con 0x7f4f00133a70 2023-09-30T22:23:35.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.828+0000 7f4efeffd700 1 --2- 172.21.15.156:0/2802416574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f000a08e0 0x7f4f0011a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:35.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.828+0000 7f4eff7fe700 1 --2- 172.21.15.156:0/2802416574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f00133a70 0x7f4f0011b0f0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8015000 tx=0x7f4ef8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:35.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.828+0000 7f4ee77fe700 1 -- 172.21.15.156:0/2802416574 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef80092e0 con 0x7f4f00133a70 2023-09-30T22:23:35.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.828+0000 7f4ee77fe700 1 -- 172.21.15.156:0/2802416574 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef800ce80 con 0x7f4f00133a70 2023-09-30T22:23:35.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.828+0000 7f4f055b6700 1 -- 172.21.15.156:0/2802416574 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef8009b30 con 0x7f4f00133a70 2023-09-30T22:23:35.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.828+0000 7f4ee77fe700 1 -- 172.21.15.156:0/2802416574 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef80044b0 con 0x7f4f00133a70 2023-09-30T22:23:35.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.828+0000 7f4f055b6700 1 -- 172.21.15.156:0/2802416574 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0011d540 con 0x7f4f00133a70 2023-09-30T22:23:35.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.829+0000 7f4f055b6700 1 -- 172.21.15.156:0/2802416574 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0009e9b0 con 0x7f4f00133a70 2023-09-30T22:23:35.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.829+0000 7f4ee77fe700 1 -- 172.21.15.156:0/2802416574 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4ef8004610 con 0x7f4f00133a70 2023-09-30T22:23:35.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.830+0000 7f4ee77fe700 1 -- 172.21.15.156:0/2802416574 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4ef80408e0 con 0x7f4f00133a70 2023-09-30T22:23:35.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.834+0000 7f4ee77fe700 1 -- 172.21.15.156:0/2802416574 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ef8011c10 con 0x7f4f00133a70 2023-09-30T22:23:35.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.854+0000 7f61aefba700 1 Processor -- start 2023-09-30T22:23:35.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.854+0000 7f61aefba700 1 -- start start 2023-09-30T22:23:35.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.855+0000 7f61aefba700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f61a809a130 0x7f61a809e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.855+0000 7f61aefba700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61a809edb0 0x7f61a809f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.855+0000 7f61aefba700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a8072b30 con 0x7f61a813c410 2023-09-30T22:23:35.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.855+0000 7f61aefba700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61a809a500 con 0x7f61a809a130 2023-09-30T22:23:35.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.855+0000 7f61aefba700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61a809f720 con 0x7f61a809edb0 2023-09-30T22:23:35.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.855+0000 7f61acd56700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f61a809a130 0x7f61a809e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.855+0000 7f61ad557700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f61a813c410 0x7f61a813e7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:54400/0 (socket says 172.21.15.156:54400) 2023-09-30T22:23:35.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.855+0000 7f61ad557700 1 -- 172.21.15.156:0/2059846557 learned_addr learned my addr 172.21.15.156:0/2059846557 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:35.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.856+0000 7f61a7fff700 1 --2- 172.21.15.156:0/2059846557 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61a809edb0 0x7f61a809f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.856+0000 7f61acd56700 1 -- 172.21.15.156:0/2059846557 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61a809edb0 msgr2=0x7f61a809f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:35.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.856+0000 7f61acd56700 1 --2- 172.21.15.156:0/2059846557 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61a809edb0 0x7f61a809f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.856+0000 7f61acd56700 1 -- 172.21.15.156:0/2059846557 >> v1:172.21.15.156:6789/0 conn(0x7f61a813c410 legacy=0x7f61a813e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.856+0000 7f61acd56700 1 -- 172.21.15.156:0/2059846557 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a809fe00 con 0x7f61a809a130 2023-09-30T22:23:35.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.856+0000 7f61acd56700 1 --2- 172.21.15.156:0/2059846557 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61a809a130 0x7f61a809e870 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f619c009840 tx=0x7f619c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3069640bef1f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:35.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.856+0000 7f61a77fe700 1 -- 172.21.15.156:0/2059846557 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c011830 con 0x7f61a809a130 2023-09-30T22:23:35.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.856+0000 7f61a77fe700 1 -- 172.21.15.156:0/2059846557 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619c011990 con 0x7f61a809a130 2023-09-30T22:23:35.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.856+0000 7f61a77fe700 1 -- 172.21.15.156:0/2059846557 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c011d20 con 0x7f61a809a130 2023-09-30T22:23:35.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.857+0000 7f61aefba700 1 -- 172.21.15.156:0/2059846557 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61a809a130 msgr2=0x7f61a809e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.857+0000 7f61aefba700 1 --2- 172.21.15.156:0/2059846557 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61a809a130 0x7f61a809e870 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f619c009840 tx=0x7f619c009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:35.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.857+0000 7f61aefba700 1 -- 172.21.15.156:0/2059846557 shutdown_connections 2023-09-30T22:23:35.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.857+0000 7f61aefba700 1 --2- 172.21.15.156:0/2059846557 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61a809a130 0x7f61a809e870 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.857+0000 7f61aefba700 1 --2- 172.21.15.156:0/2059846557 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61a809edb0 0x7f61a809f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.857+0000 7f61aefba700 1 -- 172.21.15.156:0/2059846557 >> 172.21.15.156:0/2059846557 conn(0x7f61a80a4430 msgr2=0x7f61a80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:35.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.857+0000 7f61aefba700 1 -- 172.21.15.156:0/2059846557 shutdown_connections 2023-09-30T22:23:35.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.857+0000 7f61aefba700 1 -- 172.21.15.156:0/2059846557 wait complete. 2023-09-30T22:23:35.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.859+0000 7f61aefba700 1 Processor -- start 2023-09-30T22:23:35.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.859+0000 7f61aefba700 1 -- start start 2023-09-30T22:23:35.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.859+0000 7f61aefba700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61a809a130 0x7f61a811b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.859+0000 7f61aefba700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61a809edb0 0x7f61a811b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.860+0000 7f61aefba700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61a813c410 0x7f61a811bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.860+0000 7f61aefba700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a813c1a0 con 0x7f61a813c410 2023-09-30T22:23:35.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.860+0000 7f61aefba700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a811d720 con 0x7f61a809edb0 2023-09-30T22:23:35.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.860+0000 7f61aefba700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61a80a00f0 con 0x7f61a809a130 2023-09-30T22:23:35.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.860+0000 7f61ad557700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61a813c410 0x7f61a811bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.860+0000 7f61ad557700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61a813c410 0x7f61a811bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58182/0 (socket says 172.21.15.156:58182) 2023-09-30T22:23:35.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.860+0000 7f61ad557700 1 -- 172.21.15.156:0/1805352886 learned_addr learned my addr 172.21.15.156:0/1805352886 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:35.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.860+0000 7f61a7fff700 1 --2- 172.21.15.156:0/1805352886 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61a809edb0 0x7f61a811b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.860+0000 7f61acd56700 1 --2- 172.21.15.156:0/1805352886 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61a809a130 0x7f61a811b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.860+0000 7f61ad557700 1 -- 172.21.15.156:0/1805352886 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61a809a130 msgr2=0x7f61a811b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.860+0000 7f61ad557700 1 --2- 172.21.15.156:0/1805352886 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61a809a130 0x7f61a811b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.860+0000 7f61ad557700 1 -- 172.21.15.156:0/1805352886 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61a809edb0 msgr2=0x7f61a811b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.860+0000 7f61ad557700 1 --2- 172.21.15.156:0/1805352886 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61a809edb0 0x7f61a811b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.860+0000 7f61ad557700 1 -- 172.21.15.156:0/1805352886 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619c0094a0 con 0x7f61a813c410 2023-09-30T22:23:35.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.860+0000 7f61a7fff700 1 --2- 172.21.15.156:0/1805352886 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61a809edb0 0x7f61a811b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:35.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.860+0000 7f61ad557700 1 --2- 172.21.15.156:0/1805352886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61a813c410 0x7f61a811bdc0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f61a000cb10 tx=0x7f61a000ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:35.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.861+0000 7f61a57fa700 1 -- 172.21.15.156:0/1805352886 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a000a9e0 con 0x7f61a813c410 2023-09-30T22:23:35.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.861+0000 7f61a57fa700 1 -- 172.21.15.156:0/1805352886 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a000ab40 con 0x7f61a813c410 2023-09-30T22:23:35.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.861+0000 7f61a57fa700 1 -- 172.21.15.156:0/1805352886 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0012400 con 0x7f61a813c410 2023-09-30T22:23:35.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.861+0000 7f61aefba700 1 -- 172.21.15.156:0/1805352886 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a81275a0 con 0x7f61a813c410 2023-09-30T22:23:35.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.861+0000 7f61aefba700 1 -- 172.21.15.156:0/1805352886 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a811e0e0 con 0x7f61a813c410 2023-09-30T22:23:35.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.862+0000 7f61aefba700 1 -- 172.21.15.156:0/1805352886 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a811e5f0 con 0x7f61a813c410 2023-09-30T22:23:35.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.862+0000 7f61a57fa700 1 -- 172.21.15.156:0/1805352886 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f61a001b3b0 con 0x7f61a813c410 2023-09-30T22:23:35.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.863+0000 7f61a57fa700 1 -- 172.21.15.156:0/1805352886 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f61a003f740 con 0x7f61a813c410 2023-09-30T22:23:35.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.863+0000 7f4ff9c77700 1 Processor -- start 2023-09-30T22:23:35.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.863+0000 7f4ff9c77700 1 -- start start 2023-09-30T22:23:35.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.863+0000 7f4ff9c77700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ff40a0a30 0x7f4ff40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.863+0000 7f4ff9c77700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ff40a1340 0x7f4ff412ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.863+0000 7f4ff9c77700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4ff41304a0 0x7f4ff41308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.863+0000 7f4ff9c77700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff4130e30 con 0x7f4ff41304a0 2023-09-30T22:23:35.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.863+0000 7f4ff9c77700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff40a1e70 con 0x7f4ff40a0a30 2023-09-30T22:23:35.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.863+0000 7f4ff9c77700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff409a720 con 0x7f4ff40a1340 2023-09-30T22:23:35.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.864+0000 7f4ff3fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4ff41304a0 0x7f4ff41308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.864+0000 7f4ff3fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4ff41304a0 0x7f4ff41308f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58192/0 (socket says 172.21.15.156:58192) 2023-09-30T22:23:35.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.864+0000 7f4ff3fff700 1 -- 172.21.15.156:0/1892005723 learned_addr learned my addr 172.21.15.156:0/1892005723 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:35.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.864+0000 7f4ff2ffd700 1 --2- 172.21.15.156:0/1892005723 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ff40a1340 0x7f4ff412ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.864+0000 7f4ff3fff700 1 -- 172.21.15.156:0/1892005723 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ff40a1340 msgr2=0x7f4ff412ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:35.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.864+0000 7f4ff3fff700 1 --2- 172.21.15.156:0/1892005723 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ff40a1340 0x7f4ff412ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.864+0000 7f4ff3fff700 1 -- 172.21.15.156:0/1892005723 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ff40a0a30 msgr2=0x7f4ff40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:35.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.864+0000 7f4ff3fff700 1 --2- 172.21.15.156:0/1892005723 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ff40a0a30 0x7f4ff40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.864+0000 7f4ff3fff700 1 -- 172.21.15.156:0/1892005723 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff409b300 con 0x7f4ff41304a0 2023-09-30T22:23:35.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.865+0000 7f4ff3fff700 1 --2- 172.21.15.156:0/1892005723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ff41304a0 0x7f4ff41308f0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f4fec009e50 tx=0x7f4fec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f45624bcb5c122b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:35.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.868+0000 7f4ff27fc700 1 -- 172.21.15.156:0/1892005723 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec00e070 con 0x7f4ff41304a0 2023-09-30T22:23:35.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.868+0000 7f4ff27fc700 1 -- 172.21.15.156:0/1892005723 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fec00b910 con 0x7f4ff41304a0 2023-09-30T22:23:35.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.868+0000 7f4ff27fc700 1 -- 172.21.15.156:0/1892005723 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec00bcc0 con 0x7f4ff41304a0 2023-09-30T22:23:35.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.868+0000 7f61a57fa700 1 -- 172.21.15.156:0/1805352886 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f61a00192c0 con 0x7f61a813c410 2023-09-30T22:23:35.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.868+0000 7f4ff9c77700 1 -- 172.21.15.156:0/1892005723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ff41304a0 msgr2=0x7f4ff41308f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.868+0000 7f4ff9c77700 1 --2- 172.21.15.156:0/1892005723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ff41304a0 0x7f4ff41308f0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f4fec009e50 tx=0x7f4fec00b330 comp rx=0 tx=0).stop 2023-09-30T22:23:35.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.869+0000 7f4ff9c77700 1 -- 172.21.15.156:0/1892005723 shutdown_connections 2023-09-30T22:23:35.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.869+0000 7f4ff9c77700 1 --2- 172.21.15.156:0/1892005723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ff41304a0 0x7f4ff41308f0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.869+0000 7f4ff9c77700 1 --2- 172.21.15.156:0/1892005723 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ff40a0a30 0x7f4ff40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.869+0000 7f4ff9c77700 1 --2- 172.21.15.156:0/1892005723 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ff40a1340 0x7f4ff412ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.869+0000 7f4ff9c77700 1 -- 172.21.15.156:0/1892005723 >> 172.21.15.156:0/1892005723 conn(0x7f4ff40a2980 msgr2=0x7f4ff40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:35.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.869+0000 7f4ff9c77700 1 -- 172.21.15.156:0/1892005723 shutdown_connections 2023-09-30T22:23:35.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.869+0000 7f4ff9c77700 1 -- 172.21.15.156:0/1892005723 wait complete. 2023-09-30T22:23:35.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.870+0000 7f4ff9c77700 1 Processor -- start 2023-09-30T22:23:35.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.870+0000 7f4ff9c77700 1 -- start start 2023-09-30T22:23:35.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.871+0000 7f4ff9c77700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ff40a0a30 0x7f4ff4132030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.871+0000 7f4ff9c77700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ff40a1340 0x7f4ff4132570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.871+0000 7f4ff9c77700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ff41304a0 0x7f4ff4132ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.871+0000 7f4ff9c77700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff4135b50 con 0x7f4ff40a0a30 2023-09-30T22:23:35.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.871+0000 7f4ff9c77700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff4136730 con 0x7f4ff40a1340 2023-09-30T22:23:35.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.871+0000 7f4ff9c77700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff4071ce0 con 0x7f4ff41304a0 2023-09-30T22:23:35.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.871+0000 7f4ff2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ff40a1340 0x7f4ff4132570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.871+0000 7f4ff37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ff40a0a30 0x7f4ff4132030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.871+0000 7f4ff2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ff40a1340 0x7f4ff4132570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52744/0 (socket says 172.21.15.156:52744) 2023-09-30T22:23:35.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.871+0000 7f4ff2ffd700 1 -- 172.21.15.156:0/786426917 learned_addr learned my addr 172.21.15.156:0/786426917 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:35.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.871+0000 7f4ff3fff700 1 --2- 172.21.15.156:0/786426917 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ff41304a0 0x7f4ff4132ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.871+0000 7f4ff2ffd700 1 -- 172.21.15.156:0/786426917 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ff41304a0 msgr2=0x7f4ff4132ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.871+0000 7f4ff2ffd700 1 --2- 172.21.15.156:0/786426917 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ff41304a0 0x7f4ff4132ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.871+0000 7f4ff2ffd700 1 -- 172.21.15.156:0/786426917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ff40a0a30 msgr2=0x7f4ff4132030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.871+0000 7f4ff2ffd700 1 --2- 172.21.15.156:0/786426917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ff40a0a30 0x7f4ff4132030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.871+0000 7f4ff2ffd700 1 -- 172.21.15.156:0/786426917 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fec009b30 con 0x7f4ff40a1340 2023-09-30T22:23:35.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.871+0000 7f4ff2ffd700 1 --2- 172.21.15.156:0/786426917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ff40a1340 0x7f4ff4132570 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800e980 tx=0x7f4fe800ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:35.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.872+0000 7f4fdbfff700 1 -- 172.21.15.156:0/786426917 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8009710 con 0x7f4ff40a1340 2023-09-30T22:23:35.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.872+0000 7f4fdbfff700 1 -- 172.21.15.156:0/786426917 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe800eed0 con 0x7f4ff40a1340 2023-09-30T22:23:35.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.872+0000 7f4ff9c77700 1 -- 172.21.15.156:0/786426917 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff409ae60 con 0x7f4ff40a1340 2023-09-30T22:23:35.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.872+0000 7f4fdbfff700 1 -- 172.21.15.156:0/786426917 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe800ca70 con 0x7f4ff40a1340 2023-09-30T22:23:35.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.872+0000 7f4ff9c77700 1 -- 172.21.15.156:0/786426917 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff41362e0 con 0x7f4ff40a1340 2023-09-30T22:23:35.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.873+0000 7f4fdbfff700 1 -- 172.21.15.156:0/786426917 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4fe800cbd0 con 0x7f4ff40a1340 2023-09-30T22:23:35.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.873+0000 7f4ff9c77700 1 -- 172.21.15.156:0/786426917 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff404f2a0 con 0x7f4ff40a1340 2023-09-30T22:23:35.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.873+0000 7f4fdbfff700 1 -- 172.21.15.156:0/786426917 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4fe803f890 con 0x7f4ff40a1340 2023-09-30T22:23:35.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:35.882+0000 7f4fdbfff700 1 -- 172.21.15.156:0/786426917 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4fe801bc50 con 0x7f4ff40a1340 2023-09-30T22:23:36.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.000+0000 7f68dc6dd700 1 -- 172.21.15.156:0/4123667173 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f68d406c3b0 con 0x7f68d4133ad0 2023-09-30T22:23:36.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.001+0000 7f68caffd700 1 -- 172.21.15.156:0/4123667173 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f68cc045060 con 0x7f68d4133ad0 2023-09-30T22:23:36.002 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:36.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.004+0000 7f68dc6dd700 1 -- 172.21.15.156:0/4123667173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68d4133ad0 msgr2=0x7f68d411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:36.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.004+0000 7f68dc6dd700 1 --2- 172.21.15.156:0/4123667173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68d4133ad0 0x7f68d411e4c0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f68cc00efc0 tx=0x7f68cc00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.004+0000 7f68dc6dd700 1 -- 172.21.15.156:0/4123667173 shutdown_connections 2023-09-30T22:23:36.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.004+0000 7f68dc6dd700 1 --2- 172.21.15.156:0/4123667173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68d4133ad0 0x7f68d411e4c0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.004+0000 7f68dc6dd700 1 --2- 172.21.15.156:0/4123667173 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f68d41300a0 0x7f68d411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.004+0000 7f68dc6dd700 1 --2- 172.21.15.156:0/4123667173 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68d4130bc0 0x7f68d411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.004+0000 7f68dc6dd700 1 -- 172.21.15.156:0/4123667173 >> 172.21.15.156:0/4123667173 conn(0x7f68d4099c40 msgr2=0x7f68d4132170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:36.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.004+0000 7f68dc6dd700 1 -- 172.21.15.156:0/4123667173 shutdown_connections 2023-09-30T22:23:36.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.004+0000 7f68dc6dd700 1 -- 172.21.15.156:0/4123667173 wait complete. 2023-09-30T22:23:36.021 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:36.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.060+0000 7f4f055b6700 1 -- 172.21.15.156:0/2802416574 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4f0004f2a0 con 0x7f4f00133a70 2023-09-30T22:23:36.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.060+0000 7f4ee77fe700 1 -- 172.21.15.156:0/2802416574 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ef8011800 con 0x7f4f00133a70 2023-09-30T22:23:36.061 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:36.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.062+0000 7f4f055b6700 1 -- 172.21.15.156:0/2802416574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f00133a70 msgr2=0x7f4f0011b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:36.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.062+0000 7f4f055b6700 1 --2- 172.21.15.156:0/2802416574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f00133a70 0x7f4f0011b0f0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8015000 tx=0x7f4ef8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.062+0000 7f4f055b6700 1 -- 172.21.15.156:0/2802416574 shutdown_connections 2023-09-30T22:23:36.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.062+0000 7f4f055b6700 1 --2- 172.21.15.156:0/2802416574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f00133a70 0x7f4f0011b0f0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.062+0000 7f4f055b6700 1 --2- 172.21.15.156:0/2802416574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f000a08e0 0x7f4f0011a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.062+0000 7f4f055b6700 1 --2- 172.21.15.156:0/2802416574 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f000a1290 0x7f4f0011abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.062+0000 7f4f055b6700 1 -- 172.21.15.156:0/2802416574 >> 172.21.15.156:0/2802416574 conn(0x7f4f000a2980 msgr2=0x7f4f0012f740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:36.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.062+0000 7f61aefba700 1 -- 172.21.15.156:0/1805352886 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f61a804f2a0 con 0x7f61a813c410 2023-09-30T22:23:36.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.062+0000 7f4f055b6700 1 -- 172.21.15.156:0/2802416574 shutdown_connections 2023-09-30T22:23:36.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.062+0000 7f4f055b6700 1 -- 172.21.15.156:0/2802416574 wait complete. 2023-09-30T22:23:36.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.063+0000 7f61a57fa700 1 -- 172.21.15.156:0/1805352886 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f61a0017020 con 0x7f61a813c410 2023-09-30T22:23:36.065 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:36.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.066+0000 7f61aefba700 1 -- 172.21.15.156:0/1805352886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61a813c410 msgr2=0x7f61a811bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:36.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.066+0000 7f61aefba700 1 --2- 172.21.15.156:0/1805352886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61a813c410 0x7f61a811bdc0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f61a000cb10 tx=0x7f61a000ce20 comp rx=0 tx=0).stop 2023-09-30T22:23:36.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.066+0000 7f61aefba700 1 -- 172.21.15.156:0/1805352886 shutdown_connections 2023-09-30T22:23:36.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.066+0000 7f61aefba700 1 --2- 172.21.15.156:0/1805352886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61a813c410 0x7f61a811bdc0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.066+0000 7f61aefba700 1 --2- 172.21.15.156:0/1805352886 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61a809a130 0x7f61a811b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.066+0000 7f61aefba700 1 --2- 172.21.15.156:0/1805352886 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61a809edb0 0x7f61a811b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.066+0000 7f61aefba700 1 -- 172.21.15.156:0/1805352886 >> 172.21.15.156:0/1805352886 conn(0x7f61a80a4430 msgr2=0x7f61a809b620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:36.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.066+0000 7f61aefba700 1 -- 172.21.15.156:0/1805352886 shutdown_connections 2023-09-30T22:23:36.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.066+0000 7f61aefba700 1 -- 172.21.15.156:0/1805352886 wait complete. 2023-09-30T22:23:36.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:36.084 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:36.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.110+0000 7f4ff9c77700 1 -- 172.21.15.156:0/786426917 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4ff406bce0 con 0x7f4ff40a1340 2023-09-30T22:23:36.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.110+0000 7f4fdbfff700 1 -- 172.21.15.156:0/786426917 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4fe801ae40 con 0x7f4ff40a1340 2023-09-30T22:23:36.111 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:36.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.112+0000 7f4ff9c77700 1 -- 172.21.15.156:0/786426917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ff40a1340 msgr2=0x7f4ff4132570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:36.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.112+0000 7f4ff9c77700 1 --2- 172.21.15.156:0/786426917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ff40a1340 0x7f4ff4132570 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800e980 tx=0x7f4fe800ec90 comp rx=0 tx=0).stop 2023-09-30T22:23:36.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.112+0000 7f4ff9c77700 1 -- 172.21.15.156:0/786426917 shutdown_connections 2023-09-30T22:23:36.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.112+0000 7f4ff9c77700 1 --2- 172.21.15.156:0/786426917 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ff41304a0 0x7f4ff4132ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.112+0000 7f4ff9c77700 1 --2- 172.21.15.156:0/786426917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ff40a0a30 0x7f4ff4132030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.112+0000 7f4ff9c77700 1 --2- 172.21.15.156:0/786426917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ff40a1340 0x7f4ff4132570 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.112+0000 7f4ff9c77700 1 -- 172.21.15.156:0/786426917 >> 172.21.15.156:0/786426917 conn(0x7f4ff40a2980 msgr2=0x7f4ff409e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:36.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.112+0000 7f4ff9c77700 1 -- 172.21.15.156:0/786426917 shutdown_connections 2023-09-30T22:23:36.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:36.112+0000 7f4ff9c77700 1 -- 172.21.15.156:0/786426917 wait complete. 2023-09-30T22:23:36.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:37.022 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:37.078 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:37.085 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:37.126 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:37.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.176+0000 7fae4d03b700 1 Processor -- start 2023-09-30T22:23:37.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.176+0000 7fae4d03b700 1 -- start start 2023-09-30T22:23:37.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.177+0000 7fae4d03b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae48138040 0x7fae48138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.177+0000 7fae4d03b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae480a08e0 0x7fae480a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.177+0000 7fae4d03b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fae480a1230 0x7fae4813ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.177+0000 7fae4d03b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae480a2100 con 0x7fae480a1230 2023-09-30T22:23:37.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.177+0000 7fae4d03b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae48138950 con 0x7fae48138040 2023-09-30T22:23:37.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.177+0000 7fae4d03b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae481379e0 con 0x7fae480a08e0 2023-09-30T22:23:37.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.177+0000 7fae4759e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fae480a1230 0x7fae4813ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.177+0000 7fae4659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae480a08e0 0x7fae480a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.177+0000 7fae4759e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fae480a1230 0x7fae4813ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58212/0 (socket says 172.21.15.156:58212) 2023-09-30T22:23:37.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.177+0000 7fae4759e700 1 -- 172.21.15.156:0/55743567 learned_addr learned my addr 172.21.15.156:0/55743567 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:37.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.177+0000 7fae4759e700 1 -- 172.21.15.156:0/55743567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae480a08e0 msgr2=0x7fae480a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:37.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.177+0000 7fae4759e700 1 --2- 172.21.15.156:0/55743567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae480a08e0 0x7fae480a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.177+0000 7fae4759e700 1 -- 172.21.15.156:0/55743567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae48138040 msgr2=0x7fae48138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:37.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.177+0000 7fae4759e700 1 --2- 172.21.15.156:0/55743567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae48138040 0x7fae48138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.177+0000 7fae4759e700 1 -- 172.21.15.156:0/55743567 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4809b9b0 con 0x7fae480a1230 2023-09-30T22:23:37.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.178+0000 7fae4759e700 1 --2- 172.21.15.156:0/55743567 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae480a1230 0x7fae4813ed10 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fae40009eb0 tx=0x7fae4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b088ac66f8d1bf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:37.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.178+0000 7fae45d9b700 1 -- 172.21.15.156:0/55743567 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4000e070 con 0x7fae480a1230 2023-09-30T22:23:37.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.178+0000 7fae45d9b700 1 -- 172.21.15.156:0/55743567 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4000b890 con 0x7fae480a1230 2023-09-30T22:23:37.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.178+0000 7fae45d9b700 1 -- 172.21.15.156:0/55743567 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4000bc40 con 0x7fae480a1230 2023-09-30T22:23:37.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.179+0000 7fae4d03b700 1 -- 172.21.15.156:0/55743567 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae480a1230 msgr2=0x7fae4813ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.179+0000 7fae4d03b700 1 --2- 172.21.15.156:0/55743567 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae480a1230 0x7fae4813ed10 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fae40009eb0 tx=0x7fae4000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:37.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.179+0000 7fae4d03b700 1 -- 172.21.15.156:0/55743567 shutdown_connections 2023-09-30T22:23:37.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.179+0000 7fae4d03b700 1 --2- 172.21.15.156:0/55743567 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae480a1230 0x7fae4813ed10 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.179+0000 7fae4d03b700 1 --2- 172.21.15.156:0/55743567 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae48138040 0x7fae48138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.179+0000 7fae4d03b700 1 --2- 172.21.15.156:0/55743567 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae480a08e0 0x7fae480a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.179+0000 7fae4d03b700 1 -- 172.21.15.156:0/55743567 >> 172.21.15.156:0/55743567 conn(0x7fae480a2980 msgr2=0x7fae480a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:37.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.179+0000 7fae4d03b700 1 -- 172.21.15.156:0/55743567 shutdown_connections 2023-09-30T22:23:37.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.179+0000 7fae4d03b700 1 -- 172.21.15.156:0/55743567 wait complete. 2023-09-30T22:23:37.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.181+0000 7fae4d03b700 1 Processor -- start 2023-09-30T22:23:37.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.181+0000 7fae4d03b700 1 -- start start 2023-09-30T22:23:37.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.181+0000 7fae4d03b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae480a08e0 0x7fae481263e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.181+0000 7fae4d03b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae480a1230 0x7fae48126920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.181+0000 7fae4d03b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae48138040 0x7fae48126e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.181+0000 7fae4d03b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae48129b90 con 0x7fae48138040 2023-09-30T22:23:37.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.181+0000 7fae4d03b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4809c990 con 0x7fae480a08e0 2023-09-30T22:23:37.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.181+0000 7fae4d03b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae48128070 con 0x7fae480a1230 2023-09-30T22:23:37.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.182+0000 7fae4659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae480a1230 0x7fae48126920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.182+0000 7fae4659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae480a1230 0x7fae48126920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55742/0 (socket says 172.21.15.156:55742) 2023-09-30T22:23:37.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.182+0000 7fae4659c700 1 -- 172.21.15.156:0/269098623 learned_addr learned my addr 172.21.15.156:0/269098623 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:37.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.182+0000 7fae4759e700 1 --2- 172.21.15.156:0/269098623 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae48138040 0x7fae48126e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.182+0000 7fae46d9d700 1 --2- 172.21.15.156:0/269098623 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae480a08e0 0x7fae481263e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.182+0000 7fae4659c700 1 -- 172.21.15.156:0/269098623 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae480a08e0 msgr2=0x7fae481263e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.182+0000 7fae4659c700 1 --2- 172.21.15.156:0/269098623 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae480a08e0 0x7fae481263e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.182+0000 7fae4659c700 1 -- 172.21.15.156:0/269098623 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae48138040 msgr2=0x7fae48126e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.182+0000 7fae4659c700 1 --2- 172.21.15.156:0/269098623 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae48138040 0x7fae48126e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.182+0000 7fae4659c700 1 -- 172.21.15.156:0/269098623 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae40009b30 con 0x7fae480a1230 2023-09-30T22:23:37.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.182+0000 7fae46d9d700 1 --2- 172.21.15.156:0/269098623 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae480a08e0 0x7fae481263e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:37.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.182+0000 7fae4659c700 1 --2- 172.21.15.156:0/269098623 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae480a1230 0x7fae48126920 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00e870 tx=0x7fae3c00eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:37.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.183+0000 7fae2f7fe700 1 -- 172.21.15.156:0/269098623 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3c009590 con 0x7fae480a1230 2023-09-30T22:23:37.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.183+0000 7fae2f7fe700 1 -- 172.21.15.156:0/269098623 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3c013680 con 0x7fae480a1230 2023-09-30T22:23:37.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.183+0000 7fae4d03b700 1 -- 172.21.15.156:0/269098623 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae4809a240 con 0x7fae480a1230 2023-09-30T22:23:37.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.183+0000 7fae4d03b700 1 -- 172.21.15.156:0/269098623 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae48129e70 con 0x7fae480a1230 2023-09-30T22:23:37.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.183+0000 7fae2f7fe700 1 -- 172.21.15.156:0/269098623 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3c013a10 con 0x7fae480a1230 2023-09-30T22:23:37.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.184+0000 7fae2f7fe700 1 -- 172.21.15.156:0/269098623 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fae3c013bb0 con 0x7fae480a1230 2023-09-30T22:23:37.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.184+0000 7fae2f7fe700 1 -- 172.21.15.156:0/269098623 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fae3c03f900 con 0x7fae480a1230 2023-09-30T22:23:37.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.184+0000 7fae4d03b700 1 -- 172.21.15.156:0/269098623 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae280052e0 con 0x7fae480a1230 2023-09-30T22:23:37.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.192+0000 7fae2f7fe700 1 -- 172.21.15.156:0/269098623 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae3c011db0 con 0x7fae480a1230 2023-09-30T22:23:37.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.235+0000 7fbb557f0700 1 Processor -- start 2023-09-30T22:23:37.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.235+0000 7fbb557f0700 1 -- start start 2023-09-30T22:23:37.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.236+0000 7fbb557f0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbb5009ef80 0x7fbb50138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.236+0000 7fbb557f0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb5009f370 0x7fbb5013b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.236+0000 7fbb557f0700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb5009af80 con 0x7fbb5009a150 2023-09-30T22:23:37.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.236+0000 7fbb557f0700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb5009a520 con 0x7fbb5009ef80 2023-09-30T22:23:37.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.236+0000 7fbb557f0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5009fe00 con 0x7fbb5009f370 2023-09-30T22:23:37.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.236+0000 7fbb4e7fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbb5009ef80 0x7fbb50138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.236+0000 7fbb4e7fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbb5009ef80 0x7fbb50138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58232/0 (socket says 172.21.15.156:58232) 2023-09-30T22:23:37.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.236+0000 7fbb4e7fc700 1 -- 172.21.15.156:0/791497245 learned_addr learned my addr 172.21.15.156:0/791497245 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:37.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.236+0000 7fbb4f7fe700 1 --2- 172.21.15.156:0/791497245 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb5009f370 0x7fbb5013b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.237+0000 7fbb4e7fc700 1 -- 172.21.15.156:0/791497245 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb5009f370 msgr2=0x7fbb5013b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:37.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.237+0000 7fbb4e7fc700 1 --2- 172.21.15.156:0/791497245 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb5009f370 0x7fbb5013b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.237+0000 7fbb4e7fc700 1 -- 172.21.15.156:0/791497245 >> v1:172.21.15.156:6789/0 conn(0x7fbb5009a150 legacy=0x7fbb5009e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:37.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.237+0000 7fbb4e7fc700 1 -- 172.21.15.156:0/791497245 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5006bc20 con 0x7fbb5009ef80 2023-09-30T22:23:37.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.237+0000 7fbb4e7fc700 1 --2- 172.21.15.156:0/791497245 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb5009ef80 0x7fbb50138e60 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fbb440098f0 tx=0x7fbb44009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641c4d106b9f258e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:37.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.237+0000 7fbb4dffb700 1 -- 172.21.15.156:0/791497245 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb44004230 con 0x7fbb5009ef80 2023-09-30T22:23:37.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.237+0000 7fbb4dffb700 1 -- 172.21.15.156:0/791497245 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb44004390 con 0x7fbb5009ef80 2023-09-30T22:23:37.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.237+0000 7fbb4dffb700 1 -- 172.21.15.156:0/791497245 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb440036a0 con 0x7fbb5009ef80 2023-09-30T22:23:37.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.238+0000 7fbb557f0700 1 -- 172.21.15.156:0/791497245 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb5009ef80 msgr2=0x7fbb50138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.238+0000 7fbb557f0700 1 --2- 172.21.15.156:0/791497245 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb5009ef80 0x7fbb50138e60 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fbb440098f0 tx=0x7fbb44009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:37.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.238+0000 7fbb557f0700 1 -- 172.21.15.156:0/791497245 shutdown_connections 2023-09-30T22:23:37.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.238+0000 7fbb557f0700 1 --2- 172.21.15.156:0/791497245 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb5009f370 0x7fbb5013b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.238+0000 7fbb557f0700 1 --2- 172.21.15.156:0/791497245 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb5009ef80 0x7fbb50138e60 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.238+0000 7fbb557f0700 1 -- 172.21.15.156:0/791497245 >> 172.21.15.156:0/791497245 conn(0x7fbb500a4430 msgr2=0x7fbb500a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:37.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.238+0000 7fbb557f0700 1 -- 172.21.15.156:0/791497245 shutdown_connections 2023-09-30T22:23:37.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.238+0000 7fbb557f0700 1 -- 172.21.15.156:0/791497245 wait complete. 2023-09-30T22:23:37.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.239+0000 7fbb557f0700 1 Processor -- start 2023-09-30T22:23:37.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.240+0000 7fbb557f0700 1 -- start start 2023-09-30T22:23:37.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.240+0000 7fbb557f0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb5009a150 0x7fbb5011ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.240+0000 7fbb557f0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb5009ef80 0x7fbb5011f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.240+0000 7fbb557f0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb5009f370 0x7fbb5011f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.240+0000 7fbb557f0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb50121ee0 con 0x7fbb5009a150 2023-09-30T22:23:37.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.240+0000 7fbb557f0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5009bdd0 con 0x7fbb5009ef80 2023-09-30T22:23:37.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.240+0000 7fbb557f0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb500a0440 con 0x7fbb5009f370 2023-09-30T22:23:37.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.240+0000 7fbb4effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb5009a150 0x7fbb5011ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.240+0000 7fbb4effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb5009a150 0x7fbb5011ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58234/0 (socket says 172.21.15.156:58234) 2023-09-30T22:23:37.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.240+0000 7fbb4effd700 1 -- 172.21.15.156:0/2295876560 learned_addr learned my addr 172.21.15.156:0/2295876560 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:37.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.240+0000 7fbb4e7fc700 1 --2- 172.21.15.156:0/2295876560 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb5009ef80 0x7fbb5011f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.241+0000 7fbb4f7fe700 1 --2- 172.21.15.156:0/2295876560 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb5009f370 0x7fbb5011f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.241+0000 7fbb4effd700 1 -- 172.21.15.156:0/2295876560 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb5009f370 msgr2=0x7fbb5011f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.241+0000 7fbb4effd700 1 --2- 172.21.15.156:0/2295876560 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb5009f370 0x7fbb5011f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.241+0000 7fbb4effd700 1 -- 172.21.15.156:0/2295876560 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb5009ef80 msgr2=0x7fbb5011f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.241+0000 7fbb4effd700 1 --2- 172.21.15.156:0/2295876560 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb5009ef80 0x7fbb5011f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.241+0000 7fbb4effd700 1 -- 172.21.15.156:0/2295876560 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb44009550 con 0x7fbb5009a150 2023-09-30T22:23:37.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.241+0000 7fbb4effd700 1 --2- 172.21.15.156:0/2295876560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb5009a150 0x7fbb5011ead0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fbb4000b4a0 tx=0x7fbb4000b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:37.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.241+0000 7fbb377fe700 1 -- 172.21.15.156:0/2295876560 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40011830 con 0x7fbb5009a150 2023-09-30T22:23:37.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.241+0000 7fbb377fe700 1 -- 172.21.15.156:0/2295876560 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb40011990 con 0x7fbb5009a150 2023-09-30T22:23:37.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.241+0000 7fbb557f0700 1 -- 172.21.15.156:0/2295876560 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb50121b80 con 0x7fbb5009a150 2023-09-30T22:23:37.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.241+0000 7fbb377fe700 1 -- 172.21.15.156:0/2295876560 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40011d40 con 0x7fbb5009a150 2023-09-30T22:23:37.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.241+0000 7fbb557f0700 1 -- 172.21.15.156:0/2295876560 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb50122110 con 0x7fbb5009a150 2023-09-30T22:23:37.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.242+0000 7fbb377fe700 1 -- 172.21.15.156:0/2295876560 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbb4001a400 con 0x7fbb5009a150 2023-09-30T22:23:37.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.243+0000 7fbb557f0700 1 -- 172.21.15.156:0/2295876560 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb5009fa30 con 0x7fbb5009a150 2023-09-30T22:23:37.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.243+0000 7fbb377fe700 1 -- 172.21.15.156:0/2295876560 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbb4003f2b0 con 0x7fbb5009a150 2023-09-30T22:23:37.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.251+0000 7fbb377fe700 1 -- 172.21.15.156:0/2295876560 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb40015030 con 0x7fbb5009a150 2023-09-30T22:23:37.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.256+0000 7fe9acb4c700 1 Processor -- start 2023-09-30T22:23:37.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.256+0000 7fe9acb4c700 1 -- start start 2023-09-30T22:23:37.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.257+0000 7fe9acb4c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9a809d860 0x7fe9a809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.257+0000 7fe9acb4c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9a809e170 0x7fe9a81307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.257+0000 7fe9acb4c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe9a8130ce0 0x7fe9a8131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.257+0000 7fe9acb4c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a809aaa0 con 0x7fe9a8130ce0 2023-09-30T22:23:37.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.257+0000 7fe9acb4c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a809f870 con 0x7fe9a809d860 2023-09-30T22:23:37.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.257+0000 7fe9acb4c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a809b360 con 0x7fe9a809e170 2023-09-30T22:23:37.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.257+0000 7fe9a5d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9a809e170 0x7fe9a81307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.257+0000 7fe9a5d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9a809e170 0x7fe9a81307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55762/0 (socket says 172.21.15.156:55762) 2023-09-30T22:23:37.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.257+0000 7fe9a5d9b700 1 -- 172.21.15.156:0/1710549583 learned_addr learned my addr 172.21.15.156:0/1710549583 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:37.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.257+0000 7fe9a6d9d700 1 --2- 172.21.15.156:0/1710549583 >> v2:172.21.15.156:3300/0 conn(0x7fe9a8130ce0 0x7fe9a8131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.257+0000 7fe9a659c700 1 --2- 172.21.15.156:0/1710549583 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9a809d860 0x7fe9a809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.257+0000 7fe9a5d9b700 1 -- 172.21.15.156:0/1710549583 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9a809d860 msgr2=0x7fe9a809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:37.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.257+0000 7fe9a5d9b700 1 --2- 172.21.15.156:0/1710549583 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9a809d860 0x7fe9a809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.257+0000 7fe9a5d9b700 1 -- 172.21.15.156:0/1710549583 >> v2:172.21.15.156:3300/0 conn(0x7fe9a8130ce0 msgr2=0x7fe9a8131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:37.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.257+0000 7fe9a5d9b700 1 --2- 172.21.15.156:0/1710549583 >> v2:172.21.15.156:3300/0 conn(0x7fe9a8130ce0 0x7fe9a8131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.257+0000 7fe9a5d9b700 1 -- 172.21.15.156:0/1710549583 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a809b620 con 0x7fe9a809e170 2023-09-30T22:23:37.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.257+0000 7fe9a5d9b700 1 --2- 172.21.15.156:0/1710549583 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9a809e170 0x7fe9a81307a0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe99c00bb90 tx=0x7fe99c00bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=538287cdef3b07ce server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:37.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.258+0000 7fe9a559a700 1 -- 172.21.15.156:0/1710549583 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c00dd30 con 0x7fe9a809e170 2023-09-30T22:23:37.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.258+0000 7fe9a559a700 1 -- 172.21.15.156:0/1710549583 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99c00de90 con 0x7fe9a809e170 2023-09-30T22:23:37.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.258+0000 7fe9a559a700 1 -- 172.21.15.156:0/1710549583 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c010690 con 0x7fe9a809e170 2023-09-30T22:23:37.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.258+0000 7fe9acb4c700 1 -- 172.21.15.156:0/1710549583 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9a809e170 msgr2=0x7fe9a81307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.258+0000 7fe9acb4c700 1 --2- 172.21.15.156:0/1710549583 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9a809e170 0x7fe9a81307a0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe99c00bb90 tx=0x7fe99c00bea0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.259+0000 7fe9acb4c700 1 -- 172.21.15.156:0/1710549583 shutdown_connections 2023-09-30T22:23:37.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.259+0000 7fe9acb4c700 1 --2- 172.21.15.156:0/1710549583 >> v2:172.21.15.156:3300/0 conn(0x7fe9a8130ce0 0x7fe9a8131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.259+0000 7fe9acb4c700 1 --2- 172.21.15.156:0/1710549583 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9a809d860 0x7fe9a809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.259+0000 7fe9acb4c700 1 --2- 172.21.15.156:0/1710549583 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9a809e170 0x7fe9a81307a0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.259+0000 7fe9acb4c700 1 -- 172.21.15.156:0/1710549583 >> 172.21.15.156:0/1710549583 conn(0x7fe9a8099c40 msgr2=0x7fe9a80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:37.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.259+0000 7fe9acb4c700 1 -- 172.21.15.156:0/1710549583 shutdown_connections 2023-09-30T22:23:37.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.259+0000 7fe9acb4c700 1 -- 172.21.15.156:0/1710549583 wait complete. 2023-09-30T22:23:37.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.260+0000 7fe9acb4c700 1 Processor -- start 2023-09-30T22:23:37.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.260+0000 7fe9acb4c700 1 -- start start 2023-09-30T22:23:37.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.261+0000 7fe9acb4c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9a809d860 0x7fe9a811d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.261+0000 7fe9acb4c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9a809e170 0x7fe9a811d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.261+0000 7fe9acb4c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9a8130ce0 0x7fe9a811dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.261+0000 7fe9acb4c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a8120290 con 0x7fe9a809e170 2023-09-30T22:23:37.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.261+0000 7fe9acb4c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a809c8b0 con 0x7fe9a809d860 2023-09-30T22:23:37.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.261+0000 7fe9acb4c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a80a2360 con 0x7fe9a8130ce0 2023-09-30T22:23:37.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.261+0000 7fe9a6d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9a8130ce0 0x7fe9a811dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.261+0000 7fe9a6d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9a8130ce0 0x7fe9a811dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55776/0 (socket says 172.21.15.156:55776) 2023-09-30T22:23:37.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.261+0000 7fe9a6d9d700 1 -- 172.21.15.156:0/3133640139 learned_addr learned my addr 172.21.15.156:0/3133640139 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:37.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.261+0000 7fe9a5d9b700 1 --2- 172.21.15.156:0/3133640139 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9a809e170 0x7fe9a811d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.261+0000 7fe9a659c700 1 --2- 172.21.15.156:0/3133640139 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9a809d860 0x7fe9a811d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.261+0000 7fe9a659c700 1 -- 172.21.15.156:0/3133640139 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9a8130ce0 msgr2=0x7fe9a811dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.262+0000 7fe9a659c700 1 --2- 172.21.15.156:0/3133640139 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9a8130ce0 0x7fe9a811dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.262+0000 7fe9a659c700 1 -- 172.21.15.156:0/3133640139 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9a809e170 msgr2=0x7fe9a811d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.262+0000 7fe9a659c700 1 --2- 172.21.15.156:0/3133640139 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9a809e170 0x7fe9a811d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.262+0000 7fe9a659c700 1 -- 172.21.15.156:0/3133640139 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99c00b7f0 con 0x7fe9a809d860 2023-09-30T22:23:37.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.262+0000 7fe9a5d9b700 1 --2- 172.21.15.156:0/3133640139 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9a809e170 0x7fe9a811d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:37.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.262+0000 7fe9a659c700 1 --2- 172.21.15.156:0/3133640139 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9a809d860 0x7fe9a811d030 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe99800e870 tx=0x7fe99800eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:37.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.262+0000 7fe996ffd700 1 -- 172.21.15.156:0/3133640139 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe998013680 con 0x7fe9a809d860 2023-09-30T22:23:37.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.262+0000 7fe996ffd700 1 -- 172.21.15.156:0/3133640139 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9980137e0 con 0x7fe9a809d860 2023-09-30T22:23:37.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.262+0000 7fe996ffd700 1 -- 172.21.15.156:0/3133640139 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe998013b50 con 0x7fe9a809d860 2023-09-30T22:23:37.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.263+0000 7fe9acb4c700 1 -- 172.21.15.156:0/3133640139 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a811ebf0 con 0x7fe9a809d860 2023-09-30T22:23:37.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.263+0000 7fe9acb4c700 1 -- 172.21.15.156:0/3133640139 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a8121000 con 0x7fe9a809d860 2023-09-30T22:23:37.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.264+0000 7fe996ffd700 1 -- 172.21.15.156:0/3133640139 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe998013cb0 con 0x7fe9a809d860 2023-09-30T22:23:37.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.264+0000 7fe996ffd700 1 -- 172.21.15.156:0/3133640139 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe99803f740 con 0x7fe9a809d860 2023-09-30T22:23:37.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.264+0000 7fe9acb4c700 1 -- 172.21.15.156:0/3133640139 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a81206a0 con 0x7fe9a809d860 2023-09-30T22:23:37.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.269+0000 7fe996ffd700 1 -- 172.21.15.156:0/3133640139 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe99801be10 con 0x7fe9a809d860 2023-09-30T22:23:37.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.324+0000 7f910efbe700 1 Processor -- start 2023-09-30T22:23:37.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.324+0000 7f910efbe700 1 -- start start 2023-09-30T22:23:37.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.325+0000 7f910efbe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91080a0a70 0x7f91080a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.325+0000 7f910efbe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f91080a1380 0x7f9108133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.325+0000 7f910efbe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9108133f50 0x7f9108134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.325+0000 7f910efbe700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f910809e9d0 con 0x7f91080a1380 2023-09-30T22:23:37.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.325+0000 7f910efbe700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910809dc00 con 0x7f91080a0a70 2023-09-30T22:23:37.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.325+0000 7f910efbe700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f910809dec0 con 0x7f9108133f50 2023-09-30T22:23:37.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.325+0000 7f9107fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f91080a1380 0x7f9108133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.325+0000 7f910d55b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9108133f50 0x7f9108134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.325+0000 7f9107fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f91080a1380 0x7f9108133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58264/0 (socket says 172.21.15.156:58264) 2023-09-30T22:23:37.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.325+0000 7f9107fff700 1 -- 172.21.15.156:0/3331858935 learned_addr learned my addr 172.21.15.156:0/3331858935 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:37.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.325+0000 7f910cd5a700 1 --2- 172.21.15.156:0/3331858935 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91080a0a70 0x7f91080a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.325+0000 7f910d55b700 1 -- 172.21.15.156:0/3331858935 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91080a0a70 msgr2=0x7f91080a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:37.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.325+0000 7f910d55b700 1 --2- 172.21.15.156:0/3331858935 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91080a0a70 0x7f91080a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.326+0000 7f910d55b700 1 -- 172.21.15.156:0/3331858935 >> v2:172.21.15.156:3300/0 conn(0x7f91080a1380 msgr2=0x7f9108133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:37.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.326+0000 7f910d55b700 1 --2- 172.21.15.156:0/3331858935 >> v2:172.21.15.156:3300/0 conn(0x7f91080a1380 0x7f9108133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.326+0000 7f910d55b700 1 -- 172.21.15.156:0/3331858935 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910809e6a0 con 0x7f9108133f50 2023-09-30T22:23:37.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.326+0000 7f9107fff700 1 --2- 172.21.15.156:0/3331858935 >> v2:172.21.15.156:3300/0 conn(0x7f91080a1380 0x7f9108133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:37.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.326+0000 7f910d55b700 1 --2- 172.21.15.156:0/3331858935 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9108133f50 0x7f9108134380 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9100009d90 tx=0x7f910000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fb13a23f9fcf538 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:37.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.326+0000 7f91077fe700 1 -- 172.21.15.156:0/3331858935 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910000e070 con 0x7f9108133f50 2023-09-30T22:23:37.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.326+0000 7f91077fe700 1 -- 172.21.15.156:0/3331858935 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910000bb20 con 0x7f9108133f50 2023-09-30T22:23:37.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.326+0000 7f91077fe700 1 -- 172.21.15.156:0/3331858935 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9100012430 con 0x7f9108133f50 2023-09-30T22:23:37.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.326+0000 7f910efbe700 1 -- 172.21.15.156:0/3331858935 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9108133f50 msgr2=0x7f9108134380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.326+0000 7f910efbe700 1 --2- 172.21.15.156:0/3331858935 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9108133f50 0x7f9108134380 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9100009d90 tx=0x7f910000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:37.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.326+0000 7f910efbe700 1 -- 172.21.15.156:0/3331858935 shutdown_connections 2023-09-30T22:23:37.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.327+0000 7f910efbe700 1 --2- 172.21.15.156:0/3331858935 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9108133f50 0x7f9108134380 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.327+0000 7f910efbe700 1 --2- 172.21.15.156:0/3331858935 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91080a0a70 0x7f91080a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.327+0000 7f910efbe700 1 --2- 172.21.15.156:0/3331858935 >> v2:172.21.15.156:3300/0 conn(0x7f91080a1380 0x7f9108133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.327+0000 7f910efbe700 1 -- 172.21.15.156:0/3331858935 >> 172.21.15.156:0/3331858935 conn(0x7f91080a6610 msgr2=0x7f91080a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:37.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.327+0000 7f910efbe700 1 -- 172.21.15.156:0/3331858935 shutdown_connections 2023-09-30T22:23:37.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.327+0000 7f910efbe700 1 -- 172.21.15.156:0/3331858935 wait complete. 2023-09-30T22:23:37.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.328+0000 7f910efbe700 1 Processor -- start 2023-09-30T22:23:37.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.328+0000 7f910efbe700 1 -- start start 2023-09-30T22:23:37.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.329+0000 7f910efbe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91080a0a70 0x7f9108122520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.329+0000 7f910efbe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f91080a1380 0x7f9108122a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.329+0000 7f910efbe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9108133f50 0x7f9108122fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.329+0000 7f910efbe700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9108124a20 con 0x7f9108133f50 2023-09-30T22:23:37.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.329+0000 7f910efbe700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91080a03e0 con 0x7f91080a0a70 2023-09-30T22:23:37.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.329+0000 7f910efbe700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f910809d340 con 0x7f91080a1380 2023-09-30T22:23:37.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.329+0000 7f9107fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f91080a1380 0x7f9108122a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.329+0000 7f9107fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f91080a1380 0x7f9108122a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55804/0 (socket says 172.21.15.156:55804) 2023-09-30T22:23:37.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.329+0000 7f9107fff700 1 -- 172.21.15.156:0/3292139795 learned_addr learned my addr 172.21.15.156:0/3292139795 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:37.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.329+0000 7f910cd5a700 1 --2- 172.21.15.156:0/3292139795 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91080a0a70 0x7f9108122520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.329+0000 7f910d55b700 1 --2- 172.21.15.156:0/3292139795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9108133f50 0x7f9108122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.329+0000 7f9107fff700 1 -- 172.21.15.156:0/3292139795 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91080a0a70 msgr2=0x7f9108122520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.329+0000 7f9107fff700 1 --2- 172.21.15.156:0/3292139795 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91080a0a70 0x7f9108122520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.329+0000 7f9107fff700 1 -- 172.21.15.156:0/3292139795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9108133f50 msgr2=0x7f9108122fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.329+0000 7f9107fff700 1 --2- 172.21.15.156:0/3292139795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9108133f50 0x7f9108122fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.329+0000 7f9107fff700 1 -- 172.21.15.156:0/3292139795 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f4009550 con 0x7f91080a1380 2023-09-30T22:23:37.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.330+0000 7f9107fff700 1 --2- 172.21.15.156:0/3292139795 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f91080a1380 0x7f9108122a60 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f90f400ec10 tx=0x7f90f400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:37.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.330+0000 7f91057fa700 1 -- 172.21.15.156:0/3292139795 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f400c850 con 0x7f91080a1380 2023-09-30T22:23:37.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.330+0000 7f91057fa700 1 -- 172.21.15.156:0/3292139795 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f400c9b0 con 0x7f91080a1380 2023-09-30T22:23:37.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.330+0000 7f910efbe700 1 -- 172.21.15.156:0/3292139795 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9100009a70 con 0x7f91080a1380 2023-09-30T22:23:37.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.330+0000 7f91057fa700 1 -- 172.21.15.156:0/3292139795 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f400cd20 con 0x7f91080a1380 2023-09-30T22:23:37.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.330+0000 7f910efbe700 1 -- 172.21.15.156:0/3292139795 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9108124fa0 con 0x7f91080a1380 2023-09-30T22:23:37.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.331+0000 7f910efbe700 1 -- 172.21.15.156:0/3292139795 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f910811f760 con 0x7f91080a1380 2023-09-30T22:23:37.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.331+0000 7f91057fa700 1 -- 172.21.15.156:0/3292139795 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f90f4013470 con 0x7f91080a1380 2023-09-30T22:23:37.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.332+0000 7f91057fa700 1 -- 172.21.15.156:0/3292139795 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f90f4045060 con 0x7f91080a1380 2023-09-30T22:23:37.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.336+0000 7f91057fa700 1 -- 172.21.15.156:0/3292139795 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f90f40102b0 con 0x7f91080a1380 2023-09-30T22:23:37.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.392+0000 7fae4d03b700 1 -- 172.21.15.156:0/269098623 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fae28005150 con 0x7fae480a1230 2023-09-30T22:23:37.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.393+0000 7fae2f7fe700 1 -- 172.21.15.156:0/269098623 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fae3c021070 con 0x7fae480a1230 2023-09-30T22:23:37.394 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:37.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.396+0000 7fae4d03b700 1 -- 172.21.15.156:0/269098623 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae480a1230 msgr2=0x7fae48126920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.396+0000 7fae4d03b700 1 --2- 172.21.15.156:0/269098623 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae480a1230 0x7fae48126920 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00e870 tx=0x7fae3c00eb80 comp rx=0 tx=0).stop 2023-09-30T22:23:37.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.396+0000 7fae4d03b700 1 -- 172.21.15.156:0/269098623 shutdown_connections 2023-09-30T22:23:37.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.396+0000 7fae4d03b700 1 --2- 172.21.15.156:0/269098623 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae48138040 0x7fae48126e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.396+0000 7fae4d03b700 1 --2- 172.21.15.156:0/269098623 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fae480a08e0 0x7fae481263e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.396+0000 7fae4d03b700 1 --2- 172.21.15.156:0/269098623 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fae480a1230 0x7fae48126920 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.396+0000 7fae4d03b700 1 -- 172.21.15.156:0/269098623 >> 172.21.15.156:0/269098623 conn(0x7fae480a2980 msgr2=0x7fae4809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:37.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.396+0000 7fae4d03b700 1 -- 172.21.15.156:0/269098623 shutdown_connections 2023-09-30T22:23:37.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.396+0000 7fae4d03b700 1 -- 172.21.15.156:0/269098623 wait complete. 2023-09-30T22:23:37.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:37.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.449+0000 7fbb557f0700 1 -- 172.21.15.156:0/2295876560 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbb5006ad40 con 0x7fbb5009a150 2023-09-30T22:23:37.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.450+0000 7fbb377fe700 1 -- 172.21.15.156:0/2295876560 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbb5006ad40 con 0x7fbb5009a150 2023-09-30T22:23:37.450 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:37.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.452+0000 7fbb557f0700 1 -- 172.21.15.156:0/2295876560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb5009a150 msgr2=0x7fbb5011ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.452+0000 7fbb557f0700 1 --2- 172.21.15.156:0/2295876560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb5009a150 0x7fbb5011ead0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fbb4000b4a0 tx=0x7fbb4000b7b0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.452+0000 7fbb557f0700 1 -- 172.21.15.156:0/2295876560 shutdown_connections 2023-09-30T22:23:37.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.452+0000 7fbb557f0700 1 --2- 172.21.15.156:0/2295876560 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb5009f370 0x7fbb5011f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.452+0000 7fbb557f0700 1 --2- 172.21.15.156:0/2295876560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb5009a150 0x7fbb5011ead0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.452+0000 7fbb557f0700 1 --2- 172.21.15.156:0/2295876560 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb5009ef80 0x7fbb5011f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.452+0000 7fbb557f0700 1 -- 172.21.15.156:0/2295876560 >> 172.21.15.156:0/2295876560 conn(0x7fbb500a4430 msgr2=0x7fbb500a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:37.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.452+0000 7fbb557f0700 1 -- 172.21.15.156:0/2295876560 shutdown_connections 2023-09-30T22:23:37.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.452+0000 7fbb557f0700 1 -- 172.21.15.156:0/2295876560 wait complete. 2023-09-30T22:23:37.465 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:37.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.508+0000 7fe9acb4c700 1 -- 172.21.15.156:0/3133640139 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe9a804f2a0 con 0x7fe9a809d860 2023-09-30T22:23:37.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.508+0000 7fe996ffd700 1 -- 172.21.15.156:0/3133640139 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe99801b3b0 con 0x7fe9a809d860 2023-09-30T22:23:37.509 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:37.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.510+0000 7fe9acb4c700 1 -- 172.21.15.156:0/3133640139 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9a809d860 msgr2=0x7fe9a811d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.510+0000 7fe9acb4c700 1 --2- 172.21.15.156:0/3133640139 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9a809d860 0x7fe9a811d030 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe99800e870 tx=0x7fe99800eb80 comp rx=0 tx=0).stop 2023-09-30T22:23:37.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.510+0000 7fe9acb4c700 1 -- 172.21.15.156:0/3133640139 shutdown_connections 2023-09-30T22:23:37.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.510+0000 7fe9acb4c700 1 --2- 172.21.15.156:0/3133640139 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe9a8130ce0 0x7fe9a811dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.510+0000 7fe9acb4c700 1 --2- 172.21.15.156:0/3133640139 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe9a809d860 0x7fe9a811d030 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.510+0000 7fe9acb4c700 1 --2- 172.21.15.156:0/3133640139 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9a809e170 0x7fe9a811d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.510+0000 7fe9acb4c700 1 -- 172.21.15.156:0/3133640139 >> 172.21.15.156:0/3133640139 conn(0x7fe9a8099c40 msgr2=0x7fe9a812ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:37.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.510+0000 7fe9acb4c700 1 -- 172.21.15.156:0/3133640139 shutdown_connections 2023-09-30T22:23:37.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.510+0000 7fe9acb4c700 1 -- 172.21.15.156:0/3133640139 wait complete. 2023-09-30T22:23:37.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:37.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.559+0000 7f910efbe700 1 -- 172.21.15.156:0/3292139795 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9108125e80 con 0x7f91080a1380 2023-09-30T22:23:37.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.560+0000 7f91057fa700 1 -- 172.21.15.156:0/3292139795 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f90f4017070 con 0x7f91080a1380 2023-09-30T22:23:37.560 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:37.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.562+0000 7f910efbe700 1 -- 172.21.15.156:0/3292139795 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f91080a1380 msgr2=0x7f9108122a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.562+0000 7f910efbe700 1 --2- 172.21.15.156:0/3292139795 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f91080a1380 0x7f9108122a60 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f90f400ec10 tx=0x7f90f400ef20 comp rx=0 tx=0).stop 2023-09-30T22:23:37.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.562+0000 7f910efbe700 1 -- 172.21.15.156:0/3292139795 shutdown_connections 2023-09-30T22:23:37.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.562+0000 7f910efbe700 1 --2- 172.21.15.156:0/3292139795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9108133f50 0x7f9108122fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.562+0000 7f910efbe700 1 --2- 172.21.15.156:0/3292139795 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f91080a0a70 0x7f9108122520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.562+0000 7f910efbe700 1 --2- 172.21.15.156:0/3292139795 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f91080a1380 0x7f9108122a60 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.562+0000 7f910efbe700 1 -- 172.21.15.156:0/3292139795 >> 172.21.15.156:0/3292139795 conn(0x7f91080a6610 msgr2=0x7f910811c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:37.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.562+0000 7f910efbe700 1 -- 172.21.15.156:0/3292139795 shutdown_connections 2023-09-30T22:23:37.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:37.562+0000 7f910efbe700 1 -- 172.21.15.156:0/3292139795 wait complete. 2023-09-30T22:23:37.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:38.410 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:38.466 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:38.528 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:38.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.550+0000 7fa1cf9a0700 1 Processor -- start 2023-09-30T22:23:38.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.550+0000 7fa1cf9a0700 1 -- start start 2023-09-30T22:23:38.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.551+0000 7fa1cf9a0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa1c8133ad0 0x7fa1c8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.551+0000 7fa1cf9a0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1c81300a0 0x7fa1c81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.551+0000 7fa1cf9a0700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1c806b2d0 con 0x7fa1c81309f0 2023-09-30T22:23:38.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.551+0000 7fa1cf9a0700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1c8133610 con 0x7fa1c8133ad0 2023-09-30T22:23:38.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.551+0000 7fa1cf9a0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c809a500 con 0x7fa1c81300a0 2023-09-30T22:23:38.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.551+0000 7fa1ccf3b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1c81300a0 0x7fa1c81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:38.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.551+0000 7fa1ccf3b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1c81300a0 0x7fa1c81304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52828/0 (socket says 172.21.15.156:52828) 2023-09-30T22:23:38.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.551+0000 7fa1ccf3b700 1 -- 172.21.15.156:0/233100342 learned_addr learned my addr 172.21.15.156:0/233100342 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:38.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.551+0000 7fa1cd73c700 1 --2- 172.21.15.156:0/233100342 >> v2:172.21.15.156:3300/0 conn(0x7fa1c8133ad0 0x7fa1c8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:38.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.551+0000 7fa1ccf3b700 1 -- 172.21.15.156:0/233100342 >> v2:172.21.15.156:3300/0 conn(0x7fa1c8133ad0 msgr2=0x7fa1c8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:38.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.551+0000 7fa1ccf3b700 1 --2- 172.21.15.156:0/233100342 >> v2:172.21.15.156:3300/0 conn(0x7fa1c8133ad0 0x7fa1c8133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.551+0000 7fa1ccf3b700 1 -- 172.21.15.156:0/233100342 >> v1:172.21.15.156:6789/0 conn(0x7fa1c81309f0 legacy=0x7fa1c813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:38.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.552+0000 7fa1ccf3b700 1 -- 172.21.15.156:0/233100342 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c81338b0 con 0x7fa1c81300a0 2023-09-30T22:23:38.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.552+0000 7fa1cd73c700 1 --2- 172.21.15.156:0/233100342 >> v2:172.21.15.156:3300/0 conn(0x7fa1c8133ad0 0x7fa1c8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:38.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.552+0000 7fa1ccf3b700 1 --2- 172.21.15.156:0/233100342 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1c81300a0 0x7fa1c81304b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fa1b80098f0 tx=0x7fa1b8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9d2d4227982bb74 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:38.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.552+0000 7fa1bffff700 1 -- 172.21.15.156:0/233100342 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8011830 con 0x7fa1c81300a0 2023-09-30T22:23:38.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.552+0000 7fa1bffff700 1 -- 172.21.15.156:0/233100342 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b8011990 con 0x7fa1c81300a0 2023-09-30T22:23:38.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.552+0000 7fa1bffff700 1 -- 172.21.15.156:0/233100342 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8011d20 con 0x7fa1c81300a0 2023-09-30T22:23:38.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.553+0000 7fa1cf9a0700 1 -- 172.21.15.156:0/233100342 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1c81300a0 msgr2=0x7fa1c81304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:38.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.553+0000 7fa1cf9a0700 1 --2- 172.21.15.156:0/233100342 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1c81300a0 0x7fa1c81304b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fa1b80098f0 tx=0x7fa1b8009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:38.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.553+0000 7fa1cf9a0700 1 -- 172.21.15.156:0/233100342 shutdown_connections 2023-09-30T22:23:38.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.553+0000 7fa1cf9a0700 1 --2- 172.21.15.156:0/233100342 >> v2:172.21.15.156:3300/0 conn(0x7fa1c8133ad0 0x7fa1c8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.553+0000 7fa1cf9a0700 1 --2- 172.21.15.156:0/233100342 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1c81300a0 0x7fa1c81304b0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.553+0000 7fa1cf9a0700 1 -- 172.21.15.156:0/233100342 >> 172.21.15.156:0/233100342 conn(0x7fa1c8099c40 msgr2=0x7fa1c80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:38.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.553+0000 7fa1cf9a0700 1 -- 172.21.15.156:0/233100342 shutdown_connections 2023-09-30T22:23:38.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.553+0000 7fa1cf9a0700 1 -- 172.21.15.156:0/233100342 wait complete. 2023-09-30T22:23:38.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.555+0000 7fa1cf9a0700 1 Processor -- start 2023-09-30T22:23:38.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.555+0000 7fa1cf9a0700 1 -- start start 2023-09-30T22:23:38.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.555+0000 7fa1cf9a0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1c81300a0 0x7fa1c811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.555+0000 7fa1cf9a0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1c81309f0 0x7fa1c811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.555+0000 7fa1cf9a0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1c8133ad0 0x7fa1c811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.555+0000 7fa1cf9a0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c812fdf0 con 0x7fa1c81300a0 2023-09-30T22:23:38.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.555+0000 7fa1cf9a0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c812dd00 con 0x7fa1c81309f0 2023-09-30T22:23:38.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.555+0000 7fa1cf9a0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c8072380 con 0x7fa1c8133ad0 2023-09-30T22:23:38.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.555+0000 7fa1cd73c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1c81300a0 0x7fa1c811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:38.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.555+0000 7fa1cd73c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1c81300a0 0x7fa1c811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58288/0 (socket says 172.21.15.156:58288) 2023-09-30T22:23:38.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.555+0000 7fa1cd73c700 1 -- 172.21.15.156:0/2668583069 learned_addr learned my addr 172.21.15.156:0/2668583069 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:38.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.555+0000 7fa1cdf3d700 1 --2- 172.21.15.156:0/2668583069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1c8133ad0 0x7fa1c811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:38.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.556+0000 7fa1cd73c700 1 -- 172.21.15.156:0/2668583069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1c8133ad0 msgr2=0x7fa1c811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:38.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.556+0000 7fa1cd73c700 1 --2- 172.21.15.156:0/2668583069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1c8133ad0 0x7fa1c811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.556+0000 7fa1cd73c700 1 -- 172.21.15.156:0/2668583069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1c81309f0 msgr2=0x7fa1c811df80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:23:38.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.556+0000 7fa1cd73c700 1 --2- 172.21.15.156:0/2668583069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1c81309f0 0x7fa1c811df80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.556+0000 7fa1cd73c700 1 -- 172.21.15.156:0/2668583069 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c40094a0 con 0x7fa1c81300a0 2023-09-30T22:23:38.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.556+0000 7fa1cdf3d700 1 --2- 172.21.15.156:0/2668583069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1c8133ad0 0x7fa1c811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:38.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.556+0000 7fa1cd73c700 1 --2- 172.21.15.156:0/2668583069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1c81300a0 0x7fa1c811da40 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fa1c400ebe0 tx=0x7fa1c400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:38.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.556+0000 7fa1bdffb700 1 -- 172.21.15.156:0/2668583069 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4009800 con 0x7fa1c81300a0 2023-09-30T22:23:38.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.556+0000 7fa1bdffb700 1 -- 172.21.15.156:0/2668583069 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c400c910 con 0x7fa1c81300a0 2023-09-30T22:23:38.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.556+0000 7fa1bdffb700 1 -- 172.21.15.156:0/2668583069 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c400cc80 con 0x7fa1c81300a0 2023-09-30T22:23:38.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.556+0000 7fa1cf9a0700 1 -- 172.21.15.156:0/2668583069 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b8009550 con 0x7fa1c81300a0 2023-09-30T22:23:38.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.556+0000 7fa1cf9a0700 1 -- 172.21.15.156:0/2668583069 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1c811ff20 con 0x7fa1c81300a0 2023-09-30T22:23:38.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.557+0000 7fa1bdffb700 1 -- 172.21.15.156:0/2668583069 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa1c4013470 con 0x7fa1c81300a0 2023-09-30T22:23:38.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.557+0000 7fa1bdffb700 1 -- 172.21.15.156:0/2668583069 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa1c403fd50 con 0x7fa1c81300a0 2023-09-30T22:23:38.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.557+0000 7fa1cf9a0700 1 -- 172.21.15.156:0/2668583069 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1c804f2a0 con 0x7fa1c81300a0 2023-09-30T22:23:38.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.562+0000 7fa1bdffb700 1 -- 172.21.15.156:0/2668583069 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa1c4017070 con 0x7fa1c81300a0 2023-09-30T22:23:38.575 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:38.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.602+0000 7f4c2ae11700 1 Processor -- start 2023-09-30T22:23:38.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.602+0000 7f4c2ae11700 1 -- start start 2023-09-30T22:23:38.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.603+0000 7f4c2ae11700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c24138040 0x7f4c24138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.603+0000 7f4c2ae11700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4c240a08e0 0x7f4c240a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.603+0000 7f4c2ae11700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4c240a1230 0x7f4c2413ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.603+0000 7f4c2ae11700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c240a2100 con 0x7f4c240a1230 2023-09-30T22:23:38.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.603+0000 7f4c2ae11700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c24138950 con 0x7f4c24138040 2023-09-30T22:23:38.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.603+0000 7f4c2ae11700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c241379e0 con 0x7f4c240a08e0 2023-09-30T22:23:38.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.603+0000 7f4c23fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4c240a08e0 0x7f4c240a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:38.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.603+0000 7f4c23fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4c240a08e0 0x7f4c240a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55822/0 (socket says 172.21.15.156:55822) 2023-09-30T22:23:38.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.603+0000 7f4c23fff700 1 -- 172.21.15.156:0/2513340919 learned_addr learned my addr 172.21.15.156:0/2513340919 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:38.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.603+0000 7f4c23fff700 1 -- 172.21.15.156:0/2513340919 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c24138040 msgr2=0x7f4c24138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:38.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.603+0000 7f4c23fff700 1 --2- 172.21.15.156:0/2513340919 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c24138040 0x7f4c24138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.603+0000 7f4c23fff700 1 -- 172.21.15.156:0/2513340919 >> v2:172.21.15.156:3300/0 conn(0x7f4c240a1230 msgr2=0x7f4c2413ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:38.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.603+0000 7f4c23fff700 1 --2- 172.21.15.156:0/2513340919 >> v2:172.21.15.156:3300/0 conn(0x7f4c240a1230 0x7f4c2413ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.603+0000 7f4c23fff700 1 -- 172.21.15.156:0/2513340919 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2409b9b0 con 0x7f4c240a08e0 2023-09-30T22:23:38.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.604+0000 7f4c23fff700 1 --2- 172.21.15.156:0/2513340919 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4c240a08e0 0x7f4c240a0cf0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4c10009950 tx=0x7f4c10009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=530b009ea280a518 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:38.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.604+0000 7f4c237fe700 1 -- 172.21.15.156:0/2513340919 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c10009ea0 con 0x7f4c240a08e0 2023-09-30T22:23:38.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.604+0000 7f4c237fe700 1 -- 172.21.15.156:0/2513340919 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1000b9e0 con 0x7f4c240a08e0 2023-09-30T22:23:38.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.604+0000 7f4c237fe700 1 -- 172.21.15.156:0/2513340919 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1000bd70 con 0x7f4c240a08e0 2023-09-30T22:23:38.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.604+0000 7f4c2ae11700 1 -- 172.21.15.156:0/2513340919 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4c240a08e0 msgr2=0x7f4c240a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:38.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.604+0000 7f4c2ae11700 1 --2- 172.21.15.156:0/2513340919 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4c240a08e0 0x7f4c240a0cf0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4c10009950 tx=0x7f4c10009c60 comp rx=0 tx=0).stop 2023-09-30T22:23:38.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.605+0000 7f4c2ae11700 1 -- 172.21.15.156:0/2513340919 shutdown_connections 2023-09-30T22:23:38.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.605+0000 7f4c2ae11700 1 --2- 172.21.15.156:0/2513340919 >> v2:172.21.15.156:3300/0 conn(0x7f4c240a1230 0x7f4c2413ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.605+0000 7f4c2ae11700 1 --2- 172.21.15.156:0/2513340919 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c24138040 0x7f4c24138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.605+0000 7f4c2ae11700 1 --2- 172.21.15.156:0/2513340919 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4c240a08e0 0x7f4c240a0cf0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.605+0000 7f4c2ae11700 1 -- 172.21.15.156:0/2513340919 >> 172.21.15.156:0/2513340919 conn(0x7f4c240a2980 msgr2=0x7f4c240a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:38.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.605+0000 7f4c2ae11700 1 -- 172.21.15.156:0/2513340919 shutdown_connections 2023-09-30T22:23:38.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.605+0000 7f4c2ae11700 1 -- 172.21.15.156:0/2513340919 wait complete. 2023-09-30T22:23:38.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.606+0000 7f4c2ae11700 1 Processor -- start 2023-09-30T22:23:38.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.606+0000 7f4c2ae11700 1 -- start start 2023-09-30T22:23:38.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.607+0000 7f4c2ae11700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4c240a08e0 0x7f4c24137160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.607+0000 7f4c2ae11700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c240a1230 0x7f4c24135a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.607+0000 7f4c2ae11700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c24138040 0x7f4c24135f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.607+0000 7f4c2ae11700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2413e490 con 0x7f4c240a1230 2023-09-30T22:23:38.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.607+0000 7f4c2ae11700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2413e2a0 con 0x7f4c24138040 2023-09-30T22:23:38.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.607+0000 7f4c2ae11700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2411af20 con 0x7f4c240a08e0 2023-09-30T22:23:38.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.607+0000 7f4c23fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c240a1230 0x7f4c24135a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:38.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.607+0000 7f4c23fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c240a1230 0x7f4c24135a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58310/0 (socket says 172.21.15.156:58310) 2023-09-30T22:23:38.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.607+0000 7f4c23fff700 1 -- 172.21.15.156:0/1187292334 learned_addr learned my addr 172.21.15.156:0/1187292334 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:38.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.607+0000 7f4c28bad700 1 --2- 172.21.15.156:0/1187292334 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4c240a08e0 0x7f4c24137160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:38.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.607+0000 7f4c293ae700 1 --2- 172.21.15.156:0/1187292334 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c24138040 0x7f4c24135f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:38.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.608+0000 7f4c28bad700 1 -- 172.21.15.156:0/1187292334 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c24138040 msgr2=0x7f4c24135f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:38.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.608+0000 7f4c28bad700 1 --2- 172.21.15.156:0/1187292334 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c24138040 0x7f4c24135f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.608+0000 7f4c28bad700 1 -- 172.21.15.156:0/1187292334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c240a1230 msgr2=0x7f4c24135a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:38.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.608+0000 7f4c28bad700 1 --2- 172.21.15.156:0/1187292334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c240a1230 0x7f4c24135a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.608+0000 7f4c28bad700 1 -- 172.21.15.156:0/1187292334 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c10009550 con 0x7f4c240a08e0 2023-09-30T22:23:38.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.608+0000 7f4c23fff700 1 --2- 172.21.15.156:0/1187292334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c240a1230 0x7f4c24135a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:38.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.608+0000 7f4c28bad700 1 --2- 172.21.15.156:0/1187292334 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4c240a08e0 0x7f4c24137160 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4c1800b480 tx=0x7f4c1800b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:38.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.608+0000 7f4c217fa700 1 -- 172.21.15.156:0/1187292334 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c18011830 con 0x7f4c240a08e0 2023-09-30T22:23:38.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.608+0000 7f4c217fa700 1 -- 172.21.15.156:0/1187292334 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c180119b0 con 0x7f4c240a08e0 2023-09-30T22:23:38.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.608+0000 7f4c217fa700 1 -- 172.21.15.156:0/1187292334 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c18011d60 con 0x7f4c240a08e0 2023-09-30T22:23:38.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.608+0000 7f4c2ae11700 1 -- 172.21.15.156:0/1187292334 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c2409a240 con 0x7f4c240a08e0 2023-09-30T22:23:38.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.608+0000 7f4c2ae11700 1 -- 172.21.15.156:0/1187292334 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c2411a850 con 0x7f4c240a08e0 2023-09-30T22:23:38.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.609+0000 7f4c2ae11700 1 -- 172.21.15.156:0/1187292334 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c2411be30 con 0x7f4c240a08e0 2023-09-30T22:23:38.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.610+0000 7f4c217fa700 1 -- 172.21.15.156:0/1187292334 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4c1801a400 con 0x7f4c240a08e0 2023-09-30T22:23:38.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.610+0000 7f4c217fa700 1 -- 172.21.15.156:0/1187292334 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4c18040ad0 con 0x7f4c240a08e0 2023-09-30T22:23:38.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.619+0000 7f4c217fa700 1 -- 172.21.15.156:0/1187292334 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4c2411be30 con 0x7f4c240a08e0 2023-09-30T22:23:38.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.661+0000 7f3ceca13700 1 Processor -- start 2023-09-30T22:23:38.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.661+0000 7f3ceca13700 1 -- start start 2023-09-30T22:23:38.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.661+0000 7f3ceca13700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3ce809e870 0x7f3ce809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.662+0000 7f3ceca13700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce809f180 0x7f3ce8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.662+0000 7f3ceca13700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ce8131d70 0x7f3ce81321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.662+0000 7f3ceca13700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce80a0920 con 0x7f3ce809e870 2023-09-30T22:23:38.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.662+0000 7f3ceca13700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce809c970 con 0x7f3ce809f180 2023-09-30T22:23:38.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.662+0000 7f3ceca13700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce809bab0 con 0x7f3ce8131d70 2023-09-30T22:23:38.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.662+0000 7f3ce6d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ce8131d70 0x7f3ce81321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:38.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.662+0000 7f3ce6d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ce8131d70 0x7f3ce81321f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55848/0 (socket says 172.21.15.156:55848) 2023-09-30T22:23:38.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.662+0000 7f3ce6d9d700 1 -- 172.21.15.156:0/2277985176 learned_addr learned my addr 172.21.15.156:0/2277985176 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:38.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.662+0000 7f3ce659c700 1 --2- 172.21.15.156:0/2277985176 >> v2:172.21.15.156:3300/0 conn(0x7f3ce809e870 0x7f3ce809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:38.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.662+0000 7f3ce5d9b700 1 --2- 172.21.15.156:0/2277985176 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce809f180 0x7f3ce8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:38.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.662+0000 7f3ce6d9d700 1 -- 172.21.15.156:0/2277985176 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce809f180 msgr2=0x7f3ce8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:38.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.662+0000 7f3ce6d9d700 1 --2- 172.21.15.156:0/2277985176 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce809f180 0x7f3ce8131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.662+0000 7f3ce6d9d700 1 -- 172.21.15.156:0/2277985176 >> v2:172.21.15.156:3300/0 conn(0x7f3ce809e870 msgr2=0x7f3ce809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:38.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.662+0000 7f3ce6d9d700 1 --2- 172.21.15.156:0/2277985176 >> v2:172.21.15.156:3300/0 conn(0x7f3ce809e870 0x7f3ce809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.662+0000 7f3ce6d9d700 1 -- 172.21.15.156:0/2277985176 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce809f9c0 con 0x7f3ce8131d70 2023-09-30T22:23:38.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.662+0000 7f3ce659c700 1 --2- 172.21.15.156:0/2277985176 >> v2:172.21.15.156:3300/0 conn(0x7f3ce809e870 0x7f3ce809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:38.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.662+0000 7f3ce6d9d700 1 --2- 172.21.15.156:0/2277985176 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ce8131d70 0x7f3ce81321f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0009e50 tx=0x7f3ce000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ecb06f7ab43080e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:38.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.662+0000 7f3ce559a700 1 -- 172.21.15.156:0/2277985176 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce000e070 con 0x7f3ce8131d70 2023-09-30T22:23:38.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.662+0000 7f3ce559a700 1 -- 172.21.15.156:0/2277985176 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce000b910 con 0x7f3ce8131d70 2023-09-30T22:23:38.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.663+0000 7f3ce559a700 1 -- 172.21.15.156:0/2277985176 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce000bcc0 con 0x7f3ce8131d70 2023-09-30T22:23:38.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.663+0000 7f3ceca13700 1 -- 172.21.15.156:0/2277985176 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ce8131d70 msgr2=0x7f3ce81321f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:38.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.663+0000 7f3ceca13700 1 --2- 172.21.15.156:0/2277985176 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ce8131d70 0x7f3ce81321f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0009e50 tx=0x7f3ce000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:38.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.663+0000 7f3ceca13700 1 -- 172.21.15.156:0/2277985176 shutdown_connections 2023-09-30T22:23:38.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.663+0000 7f3ceca13700 1 --2- 172.21.15.156:0/2277985176 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ce8131d70 0x7f3ce81321f0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.663+0000 7f3ceca13700 1 --2- 172.21.15.156:0/2277985176 >> v2:172.21.15.156:3300/0 conn(0x7f3ce809e870 0x7f3ce809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.663+0000 7f3ceca13700 1 --2- 172.21.15.156:0/2277985176 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce809f180 0x7f3ce8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.663+0000 7f3ceca13700 1 -- 172.21.15.156:0/2277985176 >> 172.21.15.156:0/2277985176 conn(0x7f3ce80a4430 msgr2=0x7f3ce80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:38.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.663+0000 7f3ceca13700 1 -- 172.21.15.156:0/2277985176 shutdown_connections 2023-09-30T22:23:38.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.663+0000 7f3ceca13700 1 -- 172.21.15.156:0/2277985176 wait complete. 2023-09-30T22:23:38.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.664+0000 7f3ceca13700 1 Processor -- start 2023-09-30T22:23:38.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.664+0000 7f3ceca13700 1 -- start start 2023-09-30T22:23:38.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.665+0000 7f3ceca13700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ce809e870 0x7f3ce81366b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.665+0000 7f3ceca13700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce809f180 0x7f3ce8136bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.665+0000 7f3ceca13700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ce8131d70 0x7f3ce81c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.665+0000 7f3ceca13700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce812ca50 con 0x7f3ce809e870 2023-09-30T22:23:38.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.665+0000 7f3ceca13700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce809dba0 con 0x7f3ce809f180 2023-09-30T22:23:38.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.665+0000 7f3ceca13700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce8137fa0 con 0x7f3ce8131d70 2023-09-30T22:23:38.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.665+0000 7f3ce659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ce809e870 0x7f3ce81366b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:38.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.665+0000 7f3ce659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ce809e870 0x7f3ce81366b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58328/0 (socket says 172.21.15.156:58328) 2023-09-30T22:23:38.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.665+0000 7f3ce6d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ce8131d70 0x7f3ce81c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:38.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.665+0000 7f3ce659c700 1 -- 172.21.15.156:0/3388197088 learned_addr learned my addr 172.21.15.156:0/3388197088 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:38.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.665+0000 7f3ce5d9b700 1 --2- 172.21.15.156:0/3388197088 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce809f180 0x7f3ce8136bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:38.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.665+0000 7f3ce6d9d700 1 -- 172.21.15.156:0/3388197088 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce809f180 msgr2=0x7f3ce8136bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:38.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.665+0000 7f3ce6d9d700 1 --2- 172.21.15.156:0/3388197088 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce809f180 0x7f3ce8136bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.665+0000 7f3ce6d9d700 1 -- 172.21.15.156:0/3388197088 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ce809e870 msgr2=0x7f3ce81366b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:38.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.665+0000 7f3ce6d9d700 1 --2- 172.21.15.156:0/3388197088 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ce809e870 0x7f3ce81366b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.665+0000 7f3ce6d9d700 1 -- 172.21.15.156:0/3388197088 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd80094a0 con 0x7f3ce8131d70 2023-09-30T22:23:38.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.665+0000 7f3ce659c700 1 --2- 172.21.15.156:0/3388197088 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ce809e870 0x7f3ce81366b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:38.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.665+0000 7f3ce6d9d700 1 --2- 172.21.15.156:0/3388197088 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ce8131d70 0x7f3ce81c8190 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0015000 tx=0x7f3ce0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:38.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.666+0000 7f3cd6ffd700 1 -- 172.21.15.156:0/3388197088 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0004450 con 0x7f3ce8131d70 2023-09-30T22:23:38.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.666+0000 7f3cd6ffd700 1 -- 172.21.15.156:0/3388197088 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce00045d0 con 0x7f3ce8131d70 2023-09-30T22:23:38.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.666+0000 7f3cd6ffd700 1 -- 172.21.15.156:0/3388197088 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce00092e0 con 0x7f3ce8131d70 2023-09-30T22:23:38.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.666+0000 7f3ceca13700 1 -- 172.21.15.156:0/3388197088 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce0009b30 con 0x7f3ce8131d70 2023-09-30T22:23:38.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.666+0000 7f3ceca13700 1 -- 172.21.15.156:0/3388197088 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce812d1e0 con 0x7f3ce8131d70 2023-09-30T22:23:38.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.667+0000 7f3cd6ffd700 1 -- 172.21.15.156:0/3388197088 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ce0025460 con 0x7f3ce8131d70 2023-09-30T22:23:38.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.667+0000 7f3ceca13700 1 -- 172.21.15.156:0/3388197088 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce804f2a0 con 0x7f3ce8131d70 2023-09-30T22:23:38.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.667+0000 7f3cd6ffd700 1 -- 172.21.15.156:0/3388197088 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3ce00411f0 con 0x7f3ce8131d70 2023-09-30T22:23:38.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.671+0000 7f3cd6ffd700 1 -- 172.21.15.156:0/3388197088 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ce0025710 con 0x7f3ce8131d70 2023-09-30T22:23:38.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.737+0000 7f7016905700 1 Processor -- start 2023-09-30T22:23:38.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.737+0000 7f7016905700 1 -- start start 2023-09-30T22:23:38.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.737+0000 7f7016905700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7010133ad0 0x7f7010133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.737+0000 7f7016905700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f70101300a0 0x7f70101304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.737+0000 7f7016905700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70101309f0 0x7f701013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.737+0000 7f7016905700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f701006b2d0 con 0x7f70101300a0 2023-09-30T22:23:38.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.737+0000 7f7016905700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7010133610 con 0x7f7010133ad0 2023-09-30T22:23:38.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.737+0000 7f7016905700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f701009a500 con 0x7f70101309f0 2023-09-30T22:23:38.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.737+0000 7f700f7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f70101300a0 0x7f70101304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:38.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.737+0000 7f700f7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f70101300a0 0x7f70101304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58336/0 (socket says 172.21.15.156:58336) 2023-09-30T22:23:38.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.737+0000 7f700f7fe700 1 -- 172.21.15.156:0/2669406134 learned_addr learned my addr 172.21.15.156:0/2669406134 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:38.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.738+0000 7f700ffff700 1 --2- 172.21.15.156:0/2669406134 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7010133ad0 0x7f7010133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:38.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.738+0000 7f700f7fe700 1 -- 172.21.15.156:0/2669406134 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70101309f0 msgr2=0x7f701013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:38.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.738+0000 7f700f7fe700 1 --2- 172.21.15.156:0/2669406134 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70101309f0 0x7f701013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.738+0000 7f700f7fe700 1 -- 172.21.15.156:0/2669406134 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7010133ad0 msgr2=0x7f7010133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:38.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.738+0000 7f700f7fe700 1 --2- 172.21.15.156:0/2669406134 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7010133ad0 0x7f7010133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.738+0000 7f700f7fe700 1 -- 172.21.15.156:0/2669406134 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70101338b0 con 0x7f70101300a0 2023-09-30T22:23:38.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.738+0000 7f700f7fe700 1 --2- 172.21.15.156:0/2669406134 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70101300a0 0x7f70101304b0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f70040098f0 tx=0x7f7004009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76c910f939fa651 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:38.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.738+0000 7f700effd700 1 -- 172.21.15.156:0/2669406134 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7004011830 con 0x7f70101300a0 2023-09-30T22:23:38.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.738+0000 7f700effd700 1 -- 172.21.15.156:0/2669406134 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7004011990 con 0x7f70101300a0 2023-09-30T22:23:38.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.738+0000 7f700effd700 1 -- 172.21.15.156:0/2669406134 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7004011d20 con 0x7f70101300a0 2023-09-30T22:23:38.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.739+0000 7f7016905700 1 -- 172.21.15.156:0/2669406134 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70101300a0 msgr2=0x7f70101304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:38.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.739+0000 7f7016905700 1 --2- 172.21.15.156:0/2669406134 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70101300a0 0x7f70101304b0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f70040098f0 tx=0x7f7004009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:38.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.739+0000 7f7016905700 1 -- 172.21.15.156:0/2669406134 shutdown_connections 2023-09-30T22:23:38.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.739+0000 7f7016905700 1 --2- 172.21.15.156:0/2669406134 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70101309f0 0x7f701013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.739+0000 7f7016905700 1 --2- 172.21.15.156:0/2669406134 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7010133ad0 0x7f7010133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.739+0000 7f7016905700 1 --2- 172.21.15.156:0/2669406134 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70101300a0 0x7f70101304b0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.739+0000 7f7016905700 1 -- 172.21.15.156:0/2669406134 >> 172.21.15.156:0/2669406134 conn(0x7f7010099c40 msgr2=0x7f70100a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:38.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.739+0000 7f7016905700 1 -- 172.21.15.156:0/2669406134 shutdown_connections 2023-09-30T22:23:38.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.739+0000 7f7016905700 1 -- 172.21.15.156:0/2669406134 wait complete. 2023-09-30T22:23:38.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.740+0000 7f7016905700 1 Processor -- start 2023-09-30T22:23:38.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.740+0000 7f7016905700 1 -- start start 2023-09-30T22:23:38.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.740+0000 7f7016905700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70101300a0 0x7f701011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.741+0000 7f7016905700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70101309f0 0x7f701011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.741+0000 7f7016905700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7010133ad0 0x7f701011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.741+0000 7f7016905700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701011fe10 con 0x7f7010133ad0 2023-09-30T22:23:38.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.741+0000 7f7016905700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7010120010 con 0x7f70101300a0 2023-09-30T22:23:38.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.741+0000 7f7016905700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f701011eaf0 con 0x7f70101309f0 2023-09-30T22:23:38.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.741+0000 7f700ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70101300a0 0x7f701011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:38.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.741+0000 7f700ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70101300a0 0x7f701011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52890/0 (socket says 172.21.15.156:52890) 2023-09-30T22:23:38.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.741+0000 7f700ffff700 1 -- 172.21.15.156:0/3567465950 learned_addr learned my addr 172.21.15.156:0/3567465950 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:38.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.741+0000 7f7014ea2700 1 --2- 172.21.15.156:0/3567465950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7010133ad0 0x7f701011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:38.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.741+0000 7f700f7fe700 1 --2- 172.21.15.156:0/3567465950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70101309f0 0x7f701011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:38.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.741+0000 7f700f7fe700 1 -- 172.21.15.156:0/3567465950 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70101300a0 msgr2=0x7f701011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:38.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.741+0000 7f700f7fe700 1 --2- 172.21.15.156:0/3567465950 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70101300a0 0x7f701011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.741+0000 7f700f7fe700 1 -- 172.21.15.156:0/3567465950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7010133ad0 msgr2=0x7f701011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:38.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.741+0000 7f700f7fe700 1 --2- 172.21.15.156:0/3567465950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7010133ad0 0x7f701011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.741+0000 7f700f7fe700 1 -- 172.21.15.156:0/3567465950 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7004009550 con 0x7f70101309f0 2023-09-30T22:23:38.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.741+0000 7f700f7fe700 1 --2- 172.21.15.156:0/3567465950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70101309f0 0x7f701011df80 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f701006e4e0 tx=0x7f7004004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:38.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.741+0000 7f700cff9700 1 -- 172.21.15.156:0/3567465950 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7004004240 con 0x7f70101309f0 2023-09-30T22:23:38.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.742+0000 7f700cff9700 1 -- 172.21.15.156:0/3567465950 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700401f070 con 0x7f70101309f0 2023-09-30T22:23:38.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.742+0000 7f700cff9700 1 -- 172.21.15.156:0/3567465950 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70040045e0 con 0x7f70101309f0 2023-09-30T22:23:38.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.742+0000 7f7016905700 1 -- 172.21.15.156:0/3567465950 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f701012dd00 con 0x7f70101309f0 2023-09-30T22:23:38.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.742+0000 7f7016905700 1 -- 172.21.15.156:0/3567465950 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70101208f0 con 0x7f70101309f0 2023-09-30T22:23:38.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.743+0000 7f700cff9700 1 -- 172.21.15.156:0/3567465950 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7004021030 con 0x7f70101309f0 2023-09-30T22:23:38.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.743+0000 7f700cff9700 1 -- 172.21.15.156:0/3567465950 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7004040590 con 0x7f70101309f0 2023-09-30T22:23:38.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.743+0000 7f7016905700 1 -- 172.21.15.156:0/3567465950 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f701011fc50 con 0x7f70101309f0 2023-09-30T22:23:38.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.752+0000 7f700cff9700 1 -- 172.21.15.156:0/3567465950 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7004029020 con 0x7f70101309f0 2023-09-30T22:23:38.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.762+0000 7fa1cf9a0700 1 -- 172.21.15.156:0/2668583069 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa1c806c3b0 con 0x7fa1c81300a0 2023-09-30T22:23:38.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.763+0000 7fa1bdffb700 1 -- 172.21.15.156:0/2668583069 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa1c4013720 con 0x7fa1c81300a0 2023-09-30T22:23:38.763 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:38.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.765+0000 7fa1cf9a0700 1 -- 172.21.15.156:0/2668583069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1c81300a0 msgr2=0x7fa1c811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:38.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.765+0000 7fa1cf9a0700 1 --2- 172.21.15.156:0/2668583069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1c81300a0 0x7fa1c811da40 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fa1c400ebe0 tx=0x7fa1c400eef0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.765+0000 7fa1cf9a0700 1 -- 172.21.15.156:0/2668583069 shutdown_connections 2023-09-30T22:23:38.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.765+0000 7fa1cf9a0700 1 --2- 172.21.15.156:0/2668583069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa1c8133ad0 0x7fa1c811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.765+0000 7fa1cf9a0700 1 --2- 172.21.15.156:0/2668583069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1c81300a0 0x7fa1c811da40 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.765+0000 7fa1cf9a0700 1 --2- 172.21.15.156:0/2668583069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa1c81309f0 0x7fa1c811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.765+0000 7fa1cf9a0700 1 -- 172.21.15.156:0/2668583069 >> 172.21.15.156:0/2668583069 conn(0x7fa1c8099c40 msgr2=0x7fa1c8131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:38.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.765+0000 7fa1cf9a0700 1 -- 172.21.15.156:0/2668583069 shutdown_connections 2023-09-30T22:23:38.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.765+0000 7fa1cf9a0700 1 -- 172.21.15.156:0/2668583069 wait complete. 2023-09-30T22:23:38.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:38.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.856+0000 7f4c2ae11700 1 -- 172.21.15.156:0/1187292334 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4c2411be30 con 0x7f4c240a08e0 2023-09-30T22:23:38.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.857+0000 7f4c217fa700 1 -- 172.21.15.156:0/1187292334 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4c2411be30 con 0x7f4c240a08e0 2023-09-30T22:23:38.857 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:38.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.859+0000 7f4c2ae11700 1 -- 172.21.15.156:0/1187292334 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4c240a08e0 msgr2=0x7f4c24137160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:38.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.859+0000 7f4c2ae11700 1 --2- 172.21.15.156:0/1187292334 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4c240a08e0 0x7f4c24137160 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4c1800b480 tx=0x7f4c1800b790 comp rx=0 tx=0).stop 2023-09-30T22:23:38.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.859+0000 7f4c2ae11700 1 -- 172.21.15.156:0/1187292334 shutdown_connections 2023-09-30T22:23:38.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.859+0000 7f4c2ae11700 1 --2- 172.21.15.156:0/1187292334 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4c24138040 0x7f4c24135f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.859+0000 7f4c2ae11700 1 --2- 172.21.15.156:0/1187292334 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4c240a08e0 0x7f4c24137160 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.859+0000 7f4c2ae11700 1 --2- 172.21.15.156:0/1187292334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c240a1230 0x7f4c24135a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.859+0000 7f4c2ae11700 1 -- 172.21.15.156:0/1187292334 >> 172.21.15.156:0/1187292334 conn(0x7f4c240a2980 msgr2=0x7f4c2406e230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:38.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.859+0000 7f4c2ae11700 1 -- 172.21.15.156:0/1187292334 shutdown_connections 2023-09-30T22:23:38.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.859+0000 7f4c2ae11700 1 -- 172.21.15.156:0/1187292334 wait complete. 2023-09-30T22:23:38.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:38.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.902+0000 7f3ceca13700 1 -- 172.21.15.156:0/3388197088 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3ce812c3f0 con 0x7f3ce8131d70 2023-09-30T22:23:38.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.902+0000 7f3cd6ffd700 1 -- 172.21.15.156:0/3388197088 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ce812c3f0 con 0x7f3ce8131d70 2023-09-30T22:23:38.903 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:38.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.904+0000 7f3ceca13700 1 -- 172.21.15.156:0/3388197088 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ce8131d70 msgr2=0x7f3ce81c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:38.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.904+0000 7f3ceca13700 1 --2- 172.21.15.156:0/3388197088 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ce8131d70 0x7f3ce81c8190 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0015000 tx=0x7f3ce0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.904+0000 7f3ceca13700 1 -- 172.21.15.156:0/3388197088 shutdown_connections 2023-09-30T22:23:38.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.904+0000 7f3ceca13700 1 --2- 172.21.15.156:0/3388197088 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ce8131d70 0x7f3ce81c8190 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.904+0000 7f3ceca13700 1 --2- 172.21.15.156:0/3388197088 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ce809e870 0x7f3ce81366b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.904+0000 7f3ceca13700 1 --2- 172.21.15.156:0/3388197088 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce809f180 0x7f3ce8136bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.904+0000 7f3ceca13700 1 -- 172.21.15.156:0/3388197088 >> 172.21.15.156:0/3388197088 conn(0x7f3ce80a4430 msgr2=0x7f3ce806ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:38.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.904+0000 7f3ceca13700 1 -- 172.21.15.156:0/3388197088 shutdown_connections 2023-09-30T22:23:38.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.904+0000 7f3ceca13700 1 -- 172.21.15.156:0/3388197088 wait complete. 2023-09-30T22:23:38.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:38.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.979+0000 7f7016905700 1 -- 172.21.15.156:0/3567465950 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f701004f2a0 con 0x7f70101309f0 2023-09-30T22:23:38.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.979+0000 7f700cff9700 1 -- 172.21.15.156:0/3567465950 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7004015070 con 0x7f70101309f0 2023-09-30T22:23:38.980 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:38.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.981+0000 7f7016905700 1 -- 172.21.15.156:0/3567465950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70101309f0 msgr2=0x7f701011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:38.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.981+0000 7f7016905700 1 --2- 172.21.15.156:0/3567465950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70101309f0 0x7f701011df80 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f701006e4e0 tx=0x7f7004004750 comp rx=0 tx=0).stop 2023-09-30T22:23:38.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.981+0000 7f7016905700 1 -- 172.21.15.156:0/3567465950 shutdown_connections 2023-09-30T22:23:38.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.981+0000 7f7016905700 1 --2- 172.21.15.156:0/3567465950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7010133ad0 0x7f701011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.981+0000 7f7016905700 1 --2- 172.21.15.156:0/3567465950 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70101300a0 0x7f701011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.981+0000 7f7016905700 1 --2- 172.21.15.156:0/3567465950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f70101309f0 0x7f701011df80 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.981+0000 7f7016905700 1 -- 172.21.15.156:0/3567465950 >> 172.21.15.156:0/3567465950 conn(0x7f7010099c40 msgr2=0x7f7010132050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:38.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.981+0000 7f7016905700 1 -- 172.21.15.156:0/3567465950 shutdown_connections 2023-09-30T22:23:38.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:38.981+0000 7f7016905700 1 -- 172.21.15.156:0/3567465950 wait complete. 2023-09-30T22:23:38.994 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:39.779 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:39.873 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:39.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.912+0000 7f4348ce1700 1 Processor -- start 2023-09-30T22:23:39.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.912+0000 7f4348ce1700 1 -- start start 2023-09-30T22:23:39.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.912+0000 7f4348ce1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4344134140 0x7f4344138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:39.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.912+0000 7f4348ce1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43441345a0 0x7f434413b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:39.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.912+0000 7f4348ce1700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f434409b110 con 0x7f434409ad40 2023-09-30T22:23:39.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.912+0000 7f4348ce1700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43440a3b60 con 0x7f4344134140 2023-09-30T22:23:39.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.912+0000 7f4348ce1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43440a1a80 con 0x7f43441345a0 2023-09-30T22:23:39.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.913+0000 7f4342d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43441345a0 0x7f434413b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:39.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.913+0000 7f4342d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43441345a0 0x7f434413b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52892/0 (socket says 172.21.15.156:52892) 2023-09-30T22:23:39.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.913+0000 7f4342d9d700 1 -- 172.21.15.156:0/4121909780 learned_addr learned my addr 172.21.15.156:0/4121909780 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:39.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.913+0000 7f4341d9b700 1 --2- 172.21.15.156:0/4121909780 >> v2:172.21.15.156:3300/0 conn(0x7f4344134140 0x7f4344138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:39.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.913+0000 7f4342d9d700 1 -- 172.21.15.156:0/4121909780 >> v2:172.21.15.156:3300/0 conn(0x7f4344134140 msgr2=0x7f4344138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:39.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.913+0000 7f4342d9d700 1 --2- 172.21.15.156:0/4121909780 >> v2:172.21.15.156:3300/0 conn(0x7f4344134140 0x7f4344138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.913+0000 7f4342d9d700 1 -- 172.21.15.156:0/4121909780 >> v1:172.21.15.156:6789/0 conn(0x7f434409ad40 legacy=0x7f4344133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:39.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.913+0000 7f4342d9d700 1 -- 172.21.15.156:0/4121909780 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43440a2fa0 con 0x7f43441345a0 2023-09-30T22:23:39.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.913+0000 7f4341d9b700 1 --2- 172.21.15.156:0/4121909780 >> v2:172.21.15.156:3300/0 conn(0x7f4344134140 0x7f4344138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:39.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.913+0000 7f4342d9d700 1 --2- 172.21.15.156:0/4121909780 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43441345a0 0x7f434413b3d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f433c009e50 tx=0x7f433c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=508cc4455121a5d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:39.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.913+0000 7f434159a700 1 -- 172.21.15.156:0/4121909780 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c00e070 con 0x7f43441345a0 2023-09-30T22:23:39.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.913+0000 7f434159a700 1 -- 172.21.15.156:0/4121909780 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433c00b910 con 0x7f43441345a0 2023-09-30T22:23:39.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.913+0000 7f434159a700 1 -- 172.21.15.156:0/4121909780 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c00bcc0 con 0x7f43441345a0 2023-09-30T22:23:39.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.914+0000 7f4348ce1700 1 -- 172.21.15.156:0/4121909780 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43441345a0 msgr2=0x7f434413b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:39.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.914+0000 7f4348ce1700 1 --2- 172.21.15.156:0/4121909780 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43441345a0 0x7f434413b3d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f433c009e50 tx=0x7f433c00b330 comp rx=0 tx=0).stop 2023-09-30T22:23:39.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.914+0000 7f4348ce1700 1 -- 172.21.15.156:0/4121909780 shutdown_connections 2023-09-30T22:23:39.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.914+0000 7f4348ce1700 1 --2- 172.21.15.156:0/4121909780 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43441345a0 0x7f434413b3d0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.914+0000 7f4348ce1700 1 --2- 172.21.15.156:0/4121909780 >> v2:172.21.15.156:3300/0 conn(0x7f4344134140 0x7f4344138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.914+0000 7f4348ce1700 1 -- 172.21.15.156:0/4121909780 >> 172.21.15.156:0/4121909780 conn(0x7f4344099c40 msgr2=0x7f434406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:39.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.914+0000 7f4348ce1700 1 -- 172.21.15.156:0/4121909780 shutdown_connections 2023-09-30T22:23:39.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.914+0000 7f4348ce1700 1 -- 172.21.15.156:0/4121909780 wait complete. 2023-09-30T22:23:39.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.915+0000 7f4348ce1700 1 Processor -- start 2023-09-30T22:23:39.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.915+0000 7f4348ce1700 1 -- start start 2023-09-30T22:23:39.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.915+0000 7f4348ce1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f434409ad40 0x7f434411c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:39.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.916+0000 7f4348ce1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4344134140 0x7f434411ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:39.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.916+0000 7f4348ce1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43441345a0 0x7f434411d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:39.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.916+0000 7f4348ce1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434411ebd0 con 0x7f43441345a0 2023-09-30T22:23:39.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.916+0000 7f4348ce1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f434411eeb0 con 0x7f434409ad40 2023-09-30T22:23:39.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.916+0000 7f4348ce1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43440a4110 con 0x7f4344134140 2023-09-30T22:23:39.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.916+0000 7f434259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f434409ad40 0x7f434411c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:39.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.916+0000 7f4341d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4344134140 0x7f434411ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:39.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.916+0000 7f434259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f434409ad40 0x7f434411c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52908/0 (socket says 172.21.15.156:52908) 2023-09-30T22:23:39.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.916+0000 7f434259c700 1 -- 172.21.15.156:0/758785941 learned_addr learned my addr 172.21.15.156:0/758785941 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:39.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.916+0000 7f4342d9d700 1 --2- 172.21.15.156:0/758785941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43441345a0 0x7f434411d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:39.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.916+0000 7f4341d9b700 1 -- 172.21.15.156:0/758785941 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f434409ad40 msgr2=0x7f434411c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:39.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.916+0000 7f4341d9b700 1 --2- 172.21.15.156:0/758785941 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f434409ad40 0x7f434411c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.916+0000 7f4341d9b700 1 -- 172.21.15.156:0/758785941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43441345a0 msgr2=0x7f434411d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:39.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.916+0000 7f4341d9b700 1 --2- 172.21.15.156:0/758785941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43441345a0 0x7f434411d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.916+0000 7f4341d9b700 1 -- 172.21.15.156:0/758785941 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43380094a0 con 0x7f4344134140 2023-09-30T22:23:39.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.916+0000 7f434259c700 1 --2- 172.21.15.156:0/758785941 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f434409ad40 0x7f434411c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:39.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.916+0000 7f4341d9b700 1 --2- 172.21.15.156:0/758785941 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4344134140 0x7f434411ce00 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f433800e900 tx=0x7f433800ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:39.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.916+0000 7f4332ffd700 1 -- 172.21.15.156:0/758785941 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4338013680 con 0x7f4344134140 2023-09-30T22:23:39.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.916+0000 7f4332ffd700 1 -- 172.21.15.156:0/758785941 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43380137e0 con 0x7f4344134140 2023-09-30T22:23:39.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.916+0000 7f4332ffd700 1 -- 172.21.15.156:0/758785941 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4338013b70 con 0x7f4344134140 2023-09-30T22:23:39.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.916+0000 7f4348ce1700 1 -- 172.21.15.156:0/758785941 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f433c009b30 con 0x7f4344134140 2023-09-30T22:23:39.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.916+0000 7f4348ce1700 1 -- 172.21.15.156:0/758785941 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f434411dc10 con 0x7f4344134140 2023-09-30T22:23:39.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.917+0000 7f4332ffd700 1 -- 172.21.15.156:0/758785941 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4338013cd0 con 0x7f4344134140 2023-09-30T22:23:39.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.917+0000 7f4332ffd700 1 -- 172.21.15.156:0/758785941 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f433803f9e0 con 0x7f4344134140 2023-09-30T22:23:39.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.918+0000 7f4348ce1700 1 -- 172.21.15.156:0/758785941 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f434404f2a0 con 0x7f4344134140 2023-09-30T22:23:39.921 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:39.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:39.922+0000 7f4332ffd700 1 -- 172.21.15.156:0/758785941 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4338017080 con 0x7f4344134140 2023-09-30T22:23:39.994 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:40.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.001+0000 7fd2dbaf9700 1 Processor -- start 2023-09-30T22:23:40.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.001+0000 7fd2dbaf9700 1 -- start start 2023-09-30T22:23:40.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.002+0000 7fd2dbaf9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2d4099e20 0x7fd2d409a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.002+0000 7fd2dbaf9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2d409a730 0x7fd2d4130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.002+0000 7fd2dbaf9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd2d4130890 0x7fd2d4130d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.002+0000 7fd2dbaf9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d409bf50 con 0x7fd2d4130890 2023-09-30T22:23:40.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.002+0000 7fd2dbaf9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d4099a60 con 0x7fd2d409a730 2023-09-30T22:23:40.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.002+0000 7fd2dbaf9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d409b230 con 0x7fd2d4099e20 2023-09-30T22:23:40.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.002+0000 7fd2d9895700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2d4099e20 0x7fd2d409a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.002+0000 7fd2d9895700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2d4099e20 0x7fd2d409a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55902/0 (socket says 172.21.15.156:55902) 2023-09-30T22:23:40.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.002+0000 7fd2d9094700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2d409a730 0x7fd2d4130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.002+0000 7fd2d9895700 1 -- 172.21.15.156:0/3475610705 learned_addr learned my addr 172.21.15.156:0/3475610705 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:40.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.002+0000 7fd2da096700 1 --2- 172.21.15.156:0/3475610705 >> v2:172.21.15.156:3300/0 conn(0x7fd2d4130890 0x7fd2d4130d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.002+0000 7fd2d9094700 1 -- 172.21.15.156:0/3475610705 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2d4099e20 msgr2=0x7fd2d409a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:40.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.002+0000 7fd2d9094700 1 --2- 172.21.15.156:0/3475610705 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2d4099e20 0x7fd2d409a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.002+0000 7fd2d9094700 1 -- 172.21.15.156:0/3475610705 >> v2:172.21.15.156:3300/0 conn(0x7fd2d4130890 msgr2=0x7fd2d4130d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:40.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.002+0000 7fd2d9094700 1 --2- 172.21.15.156:0/3475610705 >> v2:172.21.15.156:3300/0 conn(0x7fd2d4130890 0x7fd2d4130d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.002+0000 7fd2d9094700 1 -- 172.21.15.156:0/3475610705 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d409bb90 con 0x7fd2d409a730 2023-09-30T22:23:40.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.003+0000 7fd2d9094700 1 --2- 172.21.15.156:0/3475610705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2d409a730 0x7fd2d4130350 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd2c400dc60 tx=0x7fd2c400df70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ce7b4324c320887 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:40.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.003+0000 7fd2d8893700 1 -- 172.21.15.156:0/3475610705 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c400b070 con 0x7fd2d409a730 2023-09-30T22:23:40.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.003+0000 7fd2d8893700 1 -- 172.21.15.156:0/3475610705 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c4008a30 con 0x7fd2d409a730 2023-09-30T22:23:40.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.003+0000 7fd2d8893700 1 -- 172.21.15.156:0/3475610705 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c4008de0 con 0x7fd2d409a730 2023-09-30T22:23:40.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.003+0000 7fd2dbaf9700 1 -- 172.21.15.156:0/3475610705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2d409a730 msgr2=0x7fd2d4130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.003+0000 7fd2dbaf9700 1 --2- 172.21.15.156:0/3475610705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2d409a730 0x7fd2d4130350 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd2c400dc60 tx=0x7fd2c400df70 comp rx=0 tx=0).stop 2023-09-30T22:23:40.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.004+0000 7fd2dbaf9700 1 -- 172.21.15.156:0/3475610705 shutdown_connections 2023-09-30T22:23:40.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.004+0000 7fd2dbaf9700 1 --2- 172.21.15.156:0/3475610705 >> v2:172.21.15.156:3300/0 conn(0x7fd2d4130890 0x7fd2d4130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.004+0000 7fd2dbaf9700 1 --2- 172.21.15.156:0/3475610705 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2d4099e20 0x7fd2d409a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.004+0000 7fd2dbaf9700 1 --2- 172.21.15.156:0/3475610705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2d409a730 0x7fd2d4130350 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.004+0000 7fd2dbaf9700 1 -- 172.21.15.156:0/3475610705 >> 172.21.15.156:0/3475610705 conn(0x7fd2d40a2980 msgr2=0x7fd2d40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:40.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.004+0000 7fd2dbaf9700 1 -- 172.21.15.156:0/3475610705 shutdown_connections 2023-09-30T22:23:40.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.004+0000 7fd2dbaf9700 1 -- 172.21.15.156:0/3475610705 wait complete. 2023-09-30T22:23:40.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.005+0000 7fd2dbaf9700 1 Processor -- start 2023-09-30T22:23:40.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.005+0000 7fd2dbaf9700 1 -- start start 2023-09-30T22:23:40.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.005+0000 7fd2dbaf9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2d4099e20 0x7fd2d411b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.005+0000 7fd2dbaf9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2d409a730 0x7fd2d411bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.005+0000 7fd2dbaf9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2d4130890 0x7fd2d411c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.005+0000 7fd2dbaf9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d411d990 con 0x7fd2d409a730 2023-09-30T22:23:40.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.005+0000 7fd2dbaf9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d40a11b0 con 0x7fd2d4099e20 2023-09-30T22:23:40.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.005+0000 7fd2dbaf9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d409b470 con 0x7fd2d4130890 2023-09-30T22:23:40.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.005+0000 7fd2d9895700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2d4099e20 0x7fd2d411b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.005+0000 7fd2d9895700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2d4099e20 0x7fd2d411b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52920/0 (socket says 172.21.15.156:52920) 2023-09-30T22:23:40.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.005+0000 7fd2d9895700 1 -- 172.21.15.156:0/2238536214 learned_addr learned my addr 172.21.15.156:0/2238536214 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:40.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.006+0000 7fd2d9895700 1 -- 172.21.15.156:0/2238536214 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2d4130890 msgr2=0x7fd2d411c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.006+0000 7fd2d9895700 1 --2- 172.21.15.156:0/2238536214 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2d4130890 0x7fd2d411c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.006+0000 7fd2d9895700 1 -- 172.21.15.156:0/2238536214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2d409a730 msgr2=0x7fd2d411bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.006+0000 7fd2d9895700 1 --2- 172.21.15.156:0/2238536214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2d409a730 0x7fd2d411bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.006+0000 7fd2d9895700 1 -- 172.21.15.156:0/2238536214 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c400d940 con 0x7fd2d4099e20 2023-09-30T22:23:40.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.006+0000 7fd2d9895700 1 --2- 172.21.15.156:0/2238536214 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2d4099e20 0x7fd2d411b840 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000fb00 tx=0x7fd2d000fec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:40.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.006+0000 7fd2ca7fc700 1 -- 172.21.15.156:0/2238536214 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d000dd70 con 0x7fd2d4099e20 2023-09-30T22:23:40.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.006+0000 7fd2ca7fc700 1 -- 172.21.15.156:0/2238536214 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d0018440 con 0x7fd2d4099e20 2023-09-30T22:23:40.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.006+0000 7fd2dbaf9700 1 -- 172.21.15.156:0/2238536214 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d411ea80 con 0x7fd2d4099e20 2023-09-30T22:23:40.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.006+0000 7fd2ca7fc700 1 -- 172.21.15.156:0/2238536214 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d00187f0 con 0x7fd2d4099e20 2023-09-30T22:23:40.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.006+0000 7fd2dbaf9700 1 -- 172.21.15.156:0/2238536214 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d411f7f0 con 0x7fd2d4099e20 2023-09-30T22:23:40.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.007+0000 7fd2ca7fc700 1 -- 172.21.15.156:0/2238536214 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd2d0018950 con 0x7fd2d4099e20 2023-09-30T22:23:40.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.007+0000 7fd2ca7fc700 1 -- 172.21.15.156:0/2238536214 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd2d003fdc0 con 0x7fd2d4099e20 2023-09-30T22:23:40.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.008+0000 7fd2dbaf9700 1 -- 172.21.15.156:0/2238536214 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d4071740 con 0x7fd2d4099e20 2023-09-30T22:23:40.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.013+0000 7fd2ca7fc700 1 -- 172.21.15.156:0/2238536214 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd2d001d020 con 0x7fd2d4099e20 2023-09-30T22:23:40.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.057+0000 7fa1a2777700 1 Processor -- start 2023-09-30T22:23:40.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.058+0000 7fa1a2777700 1 -- start start 2023-09-30T22:23:40.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.058+0000 7fa1a2777700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa19c09e870 0x7fa19c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.058+0000 7fa1a2777700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa19c09f180 0x7fa19c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.058+0000 7fa1a2777700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa19c131d70 0x7fa19c1321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.058+0000 7fa1a2777700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa19c0a0920 con 0x7fa19c09e870 2023-09-30T22:23:40.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.058+0000 7fa1a2777700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c09c970 con 0x7fa19c09f180 2023-09-30T22:23:40.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.058+0000 7fa1a2777700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c09bab0 con 0x7fa19c131d70 2023-09-30T22:23:40.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.058+0000 7fa19bfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa19c09e870 0x7fa19c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.059+0000 7fa19bfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa19c09e870 0x7fa19c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58400/0 (socket says 172.21.15.156:58400) 2023-09-30T22:23:40.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.059+0000 7fa19bfff700 1 -- 172.21.15.156:0/1708128515 learned_addr learned my addr 172.21.15.156:0/1708128515 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:40.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.059+0000 7fa19b7fe700 1 --2- 172.21.15.156:0/1708128515 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa19c09f180 0x7fa19c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.059+0000 7fa1a0d14700 1 --2- 172.21.15.156:0/1708128515 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa19c131d70 0x7fa19c1321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.059+0000 7fa19bfff700 1 -- 172.21.15.156:0/1708128515 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa19c131d70 msgr2=0x7fa19c1321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:40.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.059+0000 7fa19bfff700 1 --2- 172.21.15.156:0/1708128515 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa19c131d70 0x7fa19c1321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.059+0000 7fa19bfff700 1 -- 172.21.15.156:0/1708128515 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa19c09f180 msgr2=0x7fa19c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:40.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.059+0000 7fa19bfff700 1 --2- 172.21.15.156:0/1708128515 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa19c09f180 0x7fa19c131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.059+0000 7fa19bfff700 1 -- 172.21.15.156:0/1708128515 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19c09f9c0 con 0x7fa19c09e870 2023-09-30T22:23:40.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.059+0000 7fa19b7fe700 1 --2- 172.21.15.156:0/1708128515 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa19c09f180 0x7fa19c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:40.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.059+0000 7fa19bfff700 1 --2- 172.21.15.156:0/1708128515 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa19c09e870 0x7fa19c09ec40 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fa18c009920 tx=0x7fa18c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc00c115fb3e582 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:40.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.059+0000 7fa19affd700 1 -- 172.21.15.156:0/1708128515 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c011830 con 0x7fa19c09e870 2023-09-30T22:23:40.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.059+0000 7fa19affd700 1 -- 172.21.15.156:0/1708128515 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18c011990 con 0x7fa19c09e870 2023-09-30T22:23:40.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.059+0000 7fa19affd700 1 -- 172.21.15.156:0/1708128515 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c011d20 con 0x7fa19c09e870 2023-09-30T22:23:40.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.060+0000 7fa1a2777700 1 -- 172.21.15.156:0/1708128515 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa19c09e870 msgr2=0x7fa19c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.060+0000 7fa1a2777700 1 --2- 172.21.15.156:0/1708128515 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa19c09e870 0x7fa19c09ec40 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fa18c009920 tx=0x7fa18c009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:40.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.060+0000 7fa1a2777700 1 -- 172.21.15.156:0/1708128515 shutdown_connections 2023-09-30T22:23:40.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.060+0000 7fa1a2777700 1 --2- 172.21.15.156:0/1708128515 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa19c131d70 0x7fa19c1321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.060+0000 7fa1a2777700 1 --2- 172.21.15.156:0/1708128515 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa19c09e870 0x7fa19c09ec40 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.060+0000 7fa1a2777700 1 --2- 172.21.15.156:0/1708128515 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa19c09f180 0x7fa19c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.060+0000 7fa1a2777700 1 -- 172.21.15.156:0/1708128515 >> 172.21.15.156:0/1708128515 conn(0x7fa19c0a4430 msgr2=0x7fa19c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:40.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.060+0000 7fa1a2777700 1 -- 172.21.15.156:0/1708128515 shutdown_connections 2023-09-30T22:23:40.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.060+0000 7fa1a2777700 1 -- 172.21.15.156:0/1708128515 wait complete. 2023-09-30T22:23:40.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.062+0000 7fa1a2777700 1 Processor -- start 2023-09-30T22:23:40.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.062+0000 7fa1a2777700 1 -- start start 2023-09-30T22:23:40.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.063+0000 7fa1a2777700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa19c09e870 0x7fa19c12e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.063+0000 7fa1a2777700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa19c09f180 0x7fa19c11ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.063+0000 7fa1a2777700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa19c131d70 0x7fa19c11b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.063+0000 7fa1a2777700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c11e380 con 0x7fa19c131d70 2023-09-30T22:23:40.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.063+0000 7fa1a2777700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c11cb90 con 0x7fa19c09e870 2023-09-30T22:23:40.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.063+0000 7fa1a2777700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c09dba0 con 0x7fa19c09f180 2023-09-30T22:23:40.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.063+0000 7fa19bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa19c09e870 0x7fa19c12e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.063+0000 7fa19bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa19c09e870 0x7fa19c12e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:52940/0 (socket says 172.21.15.156:52940) 2023-09-30T22:23:40.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.063+0000 7fa19bfff700 1 -- 172.21.15.156:0/3420981859 learned_addr learned my addr 172.21.15.156:0/3420981859 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:40.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.063+0000 7fa19b7fe700 1 --2- 172.21.15.156:0/3420981859 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa19c09f180 0x7fa19c11ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.063+0000 7fa1a0d14700 1 --2- 172.21.15.156:0/3420981859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa19c131d70 0x7fa19c11b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.063+0000 7fa19bfff700 1 -- 172.21.15.156:0/3420981859 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa19c09f180 msgr2=0x7fa19c11ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.063+0000 7fa19bfff700 1 --2- 172.21.15.156:0/3420981859 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa19c09f180 0x7fa19c11ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.063+0000 7fa19bfff700 1 -- 172.21.15.156:0/3420981859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa19c131d70 msgr2=0x7fa19c11b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.063+0000 7fa19bfff700 1 --2- 172.21.15.156:0/3420981859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa19c131d70 0x7fa19c11b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.063+0000 7fa19bfff700 1 -- 172.21.15.156:0/3420981859 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19000f610 con 0x7fa19c09e870 2023-09-30T22:23:40.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.063+0000 7fa1a0d14700 1 --2- 172.21.15.156:0/3420981859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa19c131d70 0x7fa19c11b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:40.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.063+0000 7fa19bfff700 1 --2- 172.21.15.156:0/3420981859 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa19c09e870 0x7fa19c12e490 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa18c000c00 tx=0x7fa18c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:40.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.063+0000 7fa198ff9700 1 -- 172.21.15.156:0/3420981859 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c004300 con 0x7fa19c09e870 2023-09-30T22:23:40.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.064+0000 7fa198ff9700 1 -- 172.21.15.156:0/3420981859 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18c01f070 con 0x7fa19c09e870 2023-09-30T22:23:40.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.064+0000 7fa1a2777700 1 -- 172.21.15.156:0/3420981859 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa18c009550 con 0x7fa19c09e870 2023-09-30T22:23:40.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.064+0000 7fa198ff9700 1 -- 172.21.15.156:0/3420981859 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c0036a0 con 0x7fa19c09e870 2023-09-30T22:23:40.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.064+0000 7fa1a2777700 1 -- 172.21.15.156:0/3420981859 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19c11e640 con 0x7fa19c09e870 2023-09-30T22:23:40.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.065+0000 7fa1a2777700 1 -- 172.21.15.156:0/3420981859 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa19c11e830 con 0x7fa19c09e870 2023-09-30T22:23:40.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.065+0000 7fa198ff9700 1 -- 172.21.15.156:0/3420981859 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa18c021030 con 0x7fa19c09e870 2023-09-30T22:23:40.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.065+0000 7fa198ff9700 1 -- 172.21.15.156:0/3420981859 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa18c040950 con 0x7fa19c09e870 2023-09-30T22:23:40.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.074+0000 7fa198ff9700 1 -- 172.21.15.156:0/3420981859 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa18c0239c0 con 0x7fa19c09e870 2023-09-30T22:23:40.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.124+0000 7f4348ce1700 1 -- 172.21.15.156:0/758785941 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f434411de50 con 0x7f4344134140 2023-09-30T22:23:40.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.125+0000 7f4332ffd700 1 -- 172.21.15.156:0/758785941 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4338021020 con 0x7f4344134140 2023-09-30T22:23:40.125 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:40.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.127+0000 7f4348ce1700 1 -- 172.21.15.156:0/758785941 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4344134140 msgr2=0x7f434411ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.127+0000 7f4348ce1700 1 --2- 172.21.15.156:0/758785941 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4344134140 0x7f434411ce00 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f433800e900 tx=0x7f433800ec10 comp rx=0 tx=0).stop 2023-09-30T22:23:40.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.127+0000 7f4348ce1700 1 -- 172.21.15.156:0/758785941 shutdown_connections 2023-09-30T22:23:40.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.127+0000 7f4348ce1700 1 --2- 172.21.15.156:0/758785941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43441345a0 0x7f434411d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.127+0000 7f4348ce1700 1 --2- 172.21.15.156:0/758785941 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f434409ad40 0x7f434411c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.127+0000 7f4348ce1700 1 --2- 172.21.15.156:0/758785941 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4344134140 0x7f434411ce00 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.127+0000 7f4348ce1700 1 -- 172.21.15.156:0/758785941 >> 172.21.15.156:0/758785941 conn(0x7f4344099c40 msgr2=0x7f434409f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:40.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.127+0000 7f4348ce1700 1 -- 172.21.15.156:0/758785941 shutdown_connections 2023-09-30T22:23:40.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.127+0000 7f4348ce1700 1 -- 172.21.15.156:0/758785941 wait complete. 2023-09-30T22:23:40.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.135+0000 7f9ef7ab4700 1 Processor -- start 2023-09-30T22:23:40.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.136+0000 7f9ef7ab4700 1 -- start start 2023-09-30T22:23:40.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.136+0000 7f9ef7ab4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ef0133c80 0x7f9ef0134050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.136+0000 7f9ef7ab4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ef00a08e0 0x7f9ef00a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.137+0000 7f9ef7ab4700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef00a1710 con 0x7f9ef00a1290 2023-09-30T22:23:40.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.137+0000 7f9ef7ab4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef0133a60 con 0x7f9ef0133c80 2023-09-30T22:23:40.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.137+0000 7f9ef7ab4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef009a360 con 0x7f9ef00a08e0 2023-09-30T22:23:40.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.137+0000 7f9ef504f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ef00a08e0 0x7f9ef00a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.137+0000 7f9ef504f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ef00a08e0 0x7f9ef00a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55940/0 (socket says 172.21.15.156:55940) 2023-09-30T22:23:40.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.137+0000 7f9ef504f700 1 -- 172.21.15.156:0/2280943751 learned_addr learned my addr 172.21.15.156:0/2280943751 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:40.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.137+0000 7f9ef6051700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f9ef00a1290 0x7f9ef013aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:54432/0 (socket says 172.21.15.156:54432) 2023-09-30T22:23:40.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.137+0000 7f9ef5850700 1 --2- 172.21.15.156:0/2280943751 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ef0133c80 0x7f9ef0134050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.137+0000 7f9ef504f700 1 -- 172.21.15.156:0/2280943751 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ef0133c80 msgr2=0x7f9ef0134050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:40.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.137+0000 7f9ef504f700 1 --2- 172.21.15.156:0/2280943751 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ef0133c80 0x7f9ef0134050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.137+0000 7f9ef484e700 1 -- 172.21.15.156:0/2280943751 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3763283357 0 0) 0x7f9ef00a1710 con 0x7f9ef00a1290 2023-09-30T22:23:40.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.137+0000 7f9ef504f700 1 -- 172.21.15.156:0/2280943751 >> v1:172.21.15.156:6789/0 conn(0x7f9ef00a1290 legacy=0x7f9ef013aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.137+0000 7f9ef504f700 1 -- 172.21.15.156:0/2280943751 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef009a880 con 0x7f9ef00a08e0 2023-09-30T22:23:40.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.137+0000 7f9ef504f700 1 --2- 172.21.15.156:0/2280943751 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ef00a08e0 0x7f9ef00a0d50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009920 tx=0x7f9ee0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=377c40749eec5f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:40.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.137+0000 7f9ef484e700 1 -- 172.21.15.156:0/2280943751 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0011830 con 0x7f9ef00a08e0 2023-09-30T22:23:40.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.138+0000 7f9ef484e700 1 -- 172.21.15.156:0/2280943751 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee0011990 con 0x7f9ef00a08e0 2023-09-30T22:23:40.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.138+0000 7f9ef484e700 1 -- 172.21.15.156:0/2280943751 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0011d20 con 0x7f9ef00a08e0 2023-09-30T22:23:40.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.138+0000 7f9ef7ab4700 1 -- 172.21.15.156:0/2280943751 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ef00a08e0 msgr2=0x7f9ef00a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.138+0000 7f9ef7ab4700 1 --2- 172.21.15.156:0/2280943751 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ef00a08e0 0x7f9ef00a0d50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009920 tx=0x7f9ee0009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:40.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.139+0000 7f9ef7ab4700 1 -- 172.21.15.156:0/2280943751 shutdown_connections 2023-09-30T22:23:40.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.139+0000 7f9ef7ab4700 1 --2- 172.21.15.156:0/2280943751 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ef0133c80 0x7f9ef0134050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.139+0000 7f9ef7ab4700 1 --2- 172.21.15.156:0/2280943751 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ef00a08e0 0x7f9ef00a0d50 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.139+0000 7f9ef7ab4700 1 -- 172.21.15.156:0/2280943751 >> 172.21.15.156:0/2280943751 conn(0x7f9ef00a2980 msgr2=0x7f9ef00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:40.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.139+0000 7f9ef7ab4700 1 -- 172.21.15.156:0/2280943751 shutdown_connections 2023-09-30T22:23:40.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.139+0000 7f9ef7ab4700 1 -- 172.21.15.156:0/2280943751 wait complete. 2023-09-30T22:23:40.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.140+0000 7f9ef7ab4700 1 Processor -- start 2023-09-30T22:23:40.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.140+0000 7f9ef7ab4700 1 -- start start 2023-09-30T22:23:40.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.141+0000 7f9ef7ab4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ef00a08e0 0x7f9ef006df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.141+0000 7f9ef7ab4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ef00a1290 0x7f9ef006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.141+0000 7f9ef7ab4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ef0133c80 0x7f9ef006ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.141+0000 7f9ef7ab4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef00718b0 con 0x7f9ef00a08e0 2023-09-30T22:23:40.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.141+0000 7f9ef7ab4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef006fba0 con 0x7f9ef0133c80 2023-09-30T22:23:40.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.141+0000 7f9ef7ab4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef0122d50 con 0x7f9ef00a1290 2023-09-30T22:23:40.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.141+0000 7f9ef5850700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ef00a08e0 0x7f9ef006df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.141+0000 7f9ef5850700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ef00a08e0 0x7f9ef006df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58420/0 (socket says 172.21.15.156:58420) 2023-09-30T22:23:40.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.141+0000 7f9ef5850700 1 -- 172.21.15.156:0/1275316219 learned_addr learned my addr 172.21.15.156:0/1275316219 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:40.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.141+0000 7f9ef6051700 1 --2- 172.21.15.156:0/1275316219 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ef0133c80 0x7f9ef006ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:40.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.141+0000 7f9ef5850700 1 -- 172.21.15.156:0/1275316219 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ef00a1290 msgr2=0x7f9ef006e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.141+0000 7f9ef5850700 1 --2- 172.21.15.156:0/1275316219 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ef00a1290 0x7f9ef006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.141+0000 7f9ef5850700 1 -- 172.21.15.156:0/1275316219 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ef0133c80 msgr2=0x7f9ef006ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.141+0000 7f9ef5850700 1 --2- 172.21.15.156:0/1275316219 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ef0133c80 0x7f9ef006ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.141+0000 7f9ef5850700 1 -- 172.21.15.156:0/1275316219 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee0009550 con 0x7f9ef00a08e0 2023-09-30T22:23:40.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.141+0000 7f9ef6051700 1 --2- 172.21.15.156:0/1275316219 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ef0133c80 0x7f9ef006ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:40.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.141+0000 7f9ef5850700 1 --2- 172.21.15.156:0/1275316219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ef00a08e0 0x7f9ef006df90 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00e9b0 tx=0x7f9eec00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:40.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.142+0000 7f9ee67fc700 1 -- 172.21.15.156:0/1275316219 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec009710 con 0x7f9ef00a08e0 2023-09-30T22:23:40.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.142+0000 7f9ee67fc700 1 -- 172.21.15.156:0/1275316219 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eec00c850 con 0x7f9ef00a08e0 2023-09-30T22:23:40.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.142+0000 7f9ef7ab4700 1 -- 172.21.15.156:0/1275316219 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef009c2e0 con 0x7f9ef00a08e0 2023-09-30T22:23:40.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.142+0000 7f9ee67fc700 1 -- 172.21.15.156:0/1275316219 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec00cbc0 con 0x7f9ef00a08e0 2023-09-30T22:23:40.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.142+0000 7f9ef7ab4700 1 -- 172.21.15.156:0/1275316219 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef006ef50 con 0x7f9ef00a08e0 2023-09-30T22:23:40.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.143+0000 7f9ef7ab4700 1 -- 172.21.15.156:0/1275316219 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef009e790 con 0x7f9ef00a08e0 2023-09-30T22:23:40.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.143+0000 7f9ee67fc700 1 -- 172.21.15.156:0/1275316219 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9eec00cd20 con 0x7f9ef00a08e0 2023-09-30T22:23:40.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.144+0000 7f9ee67fc700 1 -- 172.21.15.156:0/1275316219 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9eec040000 con 0x7f9ef00a08e0 2023-09-30T22:23:40.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.148+0000 7f9ee67fc700 1 -- 172.21.15.156:0/1275316219 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9eec01a360 con 0x7f9ef00a08e0 2023-09-30T22:23:40.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.218+0000 7fd2dbaf9700 1 -- 172.21.15.156:0/2238536214 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd2d411e630 con 0x7fd2d4099e20 2023-09-30T22:23:40.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.218+0000 7fd2ca7fc700 1 -- 172.21.15.156:0/2238536214 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd2d0022e60 con 0x7fd2d4099e20 2023-09-30T22:23:40.219 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:40.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.221+0000 7fd2dbaf9700 1 -- 172.21.15.156:0/2238536214 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2d4099e20 msgr2=0x7fd2d411b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.221+0000 7fd2dbaf9700 1 --2- 172.21.15.156:0/2238536214 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2d4099e20 0x7fd2d411b840 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000fb00 tx=0x7fd2d000fec0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.221+0000 7fd2dbaf9700 1 -- 172.21.15.156:0/2238536214 shutdown_connections 2023-09-30T22:23:40.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.221+0000 7fd2dbaf9700 1 --2- 172.21.15.156:0/2238536214 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd2d4130890 0x7fd2d411c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.221+0000 7fd2dbaf9700 1 --2- 172.21.15.156:0/2238536214 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2d4099e20 0x7fd2d411b840 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.221+0000 7fd2dbaf9700 1 --2- 172.21.15.156:0/2238536214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2d409a730 0x7fd2d411bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.221+0000 7fd2dbaf9700 1 -- 172.21.15.156:0/2238536214 >> 172.21.15.156:0/2238536214 conn(0x7fd2d40a2980 msgr2=0x7fd2d409fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:40.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.221+0000 7fd2dbaf9700 1 -- 172.21.15.156:0/2238536214 shutdown_connections 2023-09-30T22:23:40.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.221+0000 7fd2dbaf9700 1 -- 172.21.15.156:0/2238536214 wait complete. 2023-09-30T22:23:40.233 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:40.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.278+0000 7fa1a2777700 1 -- 172.21.15.156:0/3420981859 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa19c04f2a0 con 0x7fa19c09e870 2023-09-30T22:23:40.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.279+0000 7fa198ff9700 1 -- 172.21.15.156:0/3420981859 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa18c015030 con 0x7fa19c09e870 2023-09-30T22:23:40.279 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:40.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.281+0000 7fa1a2777700 1 -- 172.21.15.156:0/3420981859 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa19c09e870 msgr2=0x7fa19c12e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.281+0000 7fa1a2777700 1 --2- 172.21.15.156:0/3420981859 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa19c09e870 0x7fa19c12e490 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa18c000c00 tx=0x7fa18c004750 comp rx=0 tx=0).stop 2023-09-30T22:23:40.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.281+0000 7fa1a2777700 1 -- 172.21.15.156:0/3420981859 shutdown_connections 2023-09-30T22:23:40.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.281+0000 7fa1a2777700 1 --2- 172.21.15.156:0/3420981859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa19c131d70 0x7fa19c11b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.281+0000 7fa1a2777700 1 --2- 172.21.15.156:0/3420981859 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa19c09e870 0x7fa19c12e490 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.281+0000 7fa1a2777700 1 --2- 172.21.15.156:0/3420981859 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa19c09f180 0x7fa19c11ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.281+0000 7fa1a2777700 1 -- 172.21.15.156:0/3420981859 >> 172.21.15.156:0/3420981859 conn(0x7fa19c0a4430 msgr2=0x7fa19c130060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:40.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.281+0000 7fa1a2777700 1 -- 172.21.15.156:0/3420981859 shutdown_connections 2023-09-30T22:23:40.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.281+0000 7fa1a2777700 1 -- 172.21.15.156:0/3420981859 wait complete. 2023-09-30T22:23:40.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:40.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.343+0000 7f9ef7ab4700 1 -- 172.21.15.156:0/1275316219 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9ef004f2a0 con 0x7f9ef00a08e0 2023-09-30T22:23:40.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.343+0000 7f9ee67fc700 1 -- 172.21.15.156:0/1275316219 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9eec017070 con 0x7f9ef00a08e0 2023-09-30T22:23:40.344 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:40.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.345+0000 7f9ef7ab4700 1 -- 172.21.15.156:0/1275316219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ef00a08e0 msgr2=0x7f9ef006df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.345+0000 7f9ef7ab4700 1 --2- 172.21.15.156:0/1275316219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ef00a08e0 0x7f9ef006df90 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00e9b0 tx=0x7f9eec00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.345+0000 7f9ef7ab4700 1 -- 172.21.15.156:0/1275316219 shutdown_connections 2023-09-30T22:23:40.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.345+0000 7f9ef7ab4700 1 --2- 172.21.15.156:0/1275316219 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ef0133c80 0x7f9ef006ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.345+0000 7f9ef7ab4700 1 --2- 172.21.15.156:0/1275316219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ef00a08e0 0x7f9ef006df90 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.345+0000 7f9ef7ab4700 1 --2- 172.21.15.156:0/1275316219 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ef00a1290 0x7f9ef006e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.345+0000 7f9ef7ab4700 1 -- 172.21.15.156:0/1275316219 >> 172.21.15.156:0/1275316219 conn(0x7f9ef00a2980 msgr2=0x7f9ef01badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:40.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.345+0000 7f9ef7ab4700 1 -- 172.21.15.156:0/1275316219 shutdown_connections 2023-09-30T22:23:40.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:40.345+0000 7f9ef7ab4700 1 -- 172.21.15.156:0/1275316219 wait complete. 2023-09-30T22:23:40.358 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:41.145 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:41.234 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:41.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.282+0000 7f0f4aef7700 1 Processor -- start 2023-09-30T22:23:41.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.282+0000 7f0f4aef7700 1 -- start start 2023-09-30T22:23:41.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.283+0000 7f0f4aef7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0f440a0a70 0x7f0f440a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.283+0000 7f0f4aef7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f440a1380 0x7f0f44133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.283+0000 7f0f4aef7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f44133f50 0x7f0f441343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.283+0000 7f0f4aef7700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f4409e9d0 con 0x7f0f440a0a70 2023-09-30T22:23:41.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.283+0000 7f0f4aef7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4409dc00 con 0x7f0f440a1380 2023-09-30T22:23:41.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.283+0000 7f0f4aef7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4409dec0 con 0x7f0f44133f50 2023-09-30T22:23:41.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.283+0000 7f0f43fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f440a1380 0x7f0f44133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.283+0000 7f0f48c93700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0f440a0a70 0x7f0f440a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.283+0000 7f0f43fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f440a1380 0x7f0f44133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33388/0 (socket says 172.21.15.156:33388) 2023-09-30T22:23:41.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.283+0000 7f0f43fff700 1 -- 172.21.15.156:0/4051745928 learned_addr learned my addr 172.21.15.156:0/4051745928 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:41.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.283+0000 7f0f49494700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f44133f50 0x7f0f441343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.283+0000 7f0f43fff700 1 -- 172.21.15.156:0/4051745928 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f44133f50 msgr2=0x7f0f441343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:41.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.283+0000 7f0f43fff700 1 --2- 172.21.15.156:0/4051745928 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f44133f50 0x7f0f441343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.283+0000 7f0f43fff700 1 -- 172.21.15.156:0/4051745928 >> v2:172.21.15.156:3300/0 conn(0x7f0f440a0a70 msgr2=0x7f0f440a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:41.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.283+0000 7f0f43fff700 1 --2- 172.21.15.156:0/4051745928 >> v2:172.21.15.156:3300/0 conn(0x7f0f440a0a70 0x7f0f440a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.283+0000 7f0f43fff700 1 -- 172.21.15.156:0/4051745928 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4409e6a0 con 0x7f0f440a1380 2023-09-30T22:23:41.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.283+0000 7f0f48c93700 1 --2- 172.21.15.156:0/4051745928 >> v2:172.21.15.156:3300/0 conn(0x7f0f440a0a70 0x7f0f440a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:41.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.283+0000 7f0f43fff700 1 --2- 172.21.15.156:0/4051745928 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f440a1380 0x7f0f44133a10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0f300098f0 tx=0x7f0f30009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60a57ebb9fb24014 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:41.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.283+0000 7f0f437fe700 1 -- 172.21.15.156:0/4051745928 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f30011830 con 0x7f0f440a1380 2023-09-30T22:23:41.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.284+0000 7f0f437fe700 1 -- 172.21.15.156:0/4051745928 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f30011990 con 0x7f0f440a1380 2023-09-30T22:23:41.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.284+0000 7f0f437fe700 1 -- 172.21.15.156:0/4051745928 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f30011d20 con 0x7f0f440a1380 2023-09-30T22:23:41.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.284+0000 7f0f4aef7700 1 -- 172.21.15.156:0/4051745928 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f440a1380 msgr2=0x7f0f44133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.284+0000 7f0f4aef7700 1 --2- 172.21.15.156:0/4051745928 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f440a1380 0x7f0f44133a10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0f300098f0 tx=0x7f0f30009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:41.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.284+0000 7f0f4aef7700 1 -- 172.21.15.156:0/4051745928 shutdown_connections 2023-09-30T22:23:41.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.284+0000 7f0f4aef7700 1 --2- 172.21.15.156:0/4051745928 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f44133f50 0x7f0f441343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.284+0000 7f0f4aef7700 1 --2- 172.21.15.156:0/4051745928 >> v2:172.21.15.156:3300/0 conn(0x7f0f440a0a70 0x7f0f440a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.284+0000 7f0f4aef7700 1 --2- 172.21.15.156:0/4051745928 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f440a1380 0x7f0f44133a10 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.284+0000 7f0f4aef7700 1 -- 172.21.15.156:0/4051745928 >> 172.21.15.156:0/4051745928 conn(0x7f0f440a6610 msgr2=0x7f0f440a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:41.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.284+0000 7f0f4aef7700 1 -- 172.21.15.156:0/4051745928 shutdown_connections 2023-09-30T22:23:41.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.285+0000 7f0f4aef7700 1 -- 172.21.15.156:0/4051745928 wait complete. 2023-09-30T22:23:41.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.286+0000 7f0f4aef7700 1 Processor -- start 2023-09-30T22:23:41.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.286+0000 7f0f4aef7700 1 -- start start 2023-09-30T22:23:41.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.287+0000 7f0f4aef7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f440a0a70 0x7f0f441223b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.287+0000 7f0f4aef7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f440a1380 0x7f0f441228f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.287+0000 7f0f4aef7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f44133f50 0x7f0f44122e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.287+0000 7f0f4aef7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f44125180 con 0x7f0f44133f50 2023-09-30T22:23:41.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.287+0000 7f0f4aef7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f44124dc0 con 0x7f0f440a0a70 2023-09-30T22:23:41.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.287+0000 7f0f4aef7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f440a03e0 con 0x7f0f440a1380 2023-09-30T22:23:41.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.287+0000 7f0f49494700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f44133f50 0x7f0f44122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.287+0000 7f0f43fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f440a1380 0x7f0f441228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.287+0000 7f0f49494700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f44133f50 0x7f0f44122e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54340/0 (socket says 172.21.15.156:54340) 2023-09-30T22:23:41.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.287+0000 7f0f43fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f440a1380 0x7f0f441228f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33624/0 (socket says 172.21.15.156:33624) 2023-09-30T22:23:41.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.287+0000 7f0f49494700 1 -- 172.21.15.156:0/2768468801 learned_addr learned my addr 172.21.15.156:0/2768468801 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:41.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.287+0000 7f0f48c93700 1 --2- 172.21.15.156:0/2768468801 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f440a0a70 0x7f0f441223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.287+0000 7f0f49494700 1 -- 172.21.15.156:0/2768468801 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f440a1380 msgr2=0x7f0f441228f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.287+0000 7f0f49494700 1 --2- 172.21.15.156:0/2768468801 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f440a1380 0x7f0f441228f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.287+0000 7f0f49494700 1 -- 172.21.15.156:0/2768468801 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f440a0a70 msgr2=0x7f0f441223b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.287+0000 7f0f49494700 1 --2- 172.21.15.156:0/2768468801 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f440a0a70 0x7f0f441223b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.287+0000 7f0f49494700 1 -- 172.21.15.156:0/2768468801 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f380094a0 con 0x7f0f44133f50 2023-09-30T22:23:41.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.287+0000 7f0f43fff700 1 --2- 172.21.15.156:0/2768468801 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f440a1380 0x7f0f441228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:41.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.287+0000 7f0f49494700 1 --2- 172.21.15.156:0/2768468801 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f44133f50 0x7f0f44122e30 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c00efc0 tx=0x7f0f3c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:41.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.287+0000 7f0f417fa700 1 -- 172.21.15.156:0/2768468801 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c009ea0 con 0x7f0f44133f50 2023-09-30T22:23:41.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.288+0000 7f0f417fa700 1 -- 172.21.15.156:0/2768468801 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f3c00f040 con 0x7f0f44133f50 2023-09-30T22:23:41.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.288+0000 7f0f4aef7700 1 -- 172.21.15.156:0/2768468801 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f30009550 con 0x7f0f44133f50 2023-09-30T22:23:41.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.288+0000 7f0f417fa700 1 -- 172.21.15.156:0/2768468801 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c00ced0 con 0x7f0f44133f50 2023-09-30T22:23:41.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.288+0000 7f0f4aef7700 1 -- 172.21.15.156:0/2768468801 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f44125e40 con 0x7f0f44133f50 2023-09-30T22:23:41.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.288+0000 7f0f417fa700 1 -- 172.21.15.156:0/2768468801 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f3c014480 con 0x7f0f44133f50 2023-09-30T22:23:41.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.289+0000 7f0f4aef7700 1 -- 172.21.15.156:0/2768468801 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f4411f760 con 0x7f0f44133f50 2023-09-30T22:23:41.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.289+0000 7f0f417fa700 1 -- 172.21.15.156:0/2768468801 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0f3c03fe50 con 0x7f0f44133f50 2023-09-30T22:23:41.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.293+0000 7f0f417fa700 1 -- 172.21.15.156:0/2768468801 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f3c01a8b0 con 0x7f0f44133f50 2023-09-30T22:23:41.295 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:41.359 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:41.366 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.366+0000 7fd48d1f5700 1 Processor -- start 2023-09-30T22:23:41.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.366+0000 7fd48d1f5700 1 -- start start 2023-09-30T22:23:41.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.366+0000 7fd48d1f5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd48809d860 0x7fd48809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.366+0000 7fd48d1f5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd48809e170 0x7fd4881307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.366+0000 7fd48d1f5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48809aaa0 con 0x7fd488130ce0 2023-09-30T22:23:41.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.366+0000 7fd48d1f5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48809f870 con 0x7fd48809d860 2023-09-30T22:23:41.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.366+0000 7fd48d1f5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd48809b360 con 0x7fd48809e170 2023-09-30T22:23:41.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.367+0000 7fd48659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd48809e170 0x7fd4881307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.367+0000 7fd48759e700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fd488130ce0 0x7fd4881379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53580/0 (socket says 172.21.15.156:53580) 2023-09-30T22:23:41.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.367+0000 7fd48759e700 1 -- 172.21.15.156:0/553574155 learned_addr learned my addr 172.21.15.156:0/553574155 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:41.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.367+0000 7fd486d9d700 1 --2- 172.21.15.156:0/553574155 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd48809d860 0x7fd48809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.367+0000 7fd48659c700 1 -- 172.21.15.156:0/553574155 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd48809d860 msgr2=0x7fd48809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:41.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.367+0000 7fd48659c700 1 --2- 172.21.15.156:0/553574155 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd48809d860 0x7fd48809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.367+0000 7fd48659c700 1 -- 172.21.15.156:0/553574155 >> v1:172.21.15.156:6789/0 conn(0x7fd488130ce0 legacy=0x7fd4881379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.367+0000 7fd485d9b700 1 -- 172.21.15.156:0/553574155 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082305441 0 0) 0x7fd48809aaa0 con 0x7fd488130ce0 2023-09-30T22:23:41.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.367+0000 7fd48659c700 1 -- 172.21.15.156:0/553574155 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48809b620 con 0x7fd48809e170 2023-09-30T22:23:41.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.367+0000 7fd48659c700 1 --2- 172.21.15.156:0/553574155 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd48809e170 0x7fd4881307a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd47c00bb10 tx=0x7fd47c00be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3b84bbd020b054b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:41.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.368+0000 7fd485d9b700 1 -- 172.21.15.156:0/553574155 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c00dc70 con 0x7fd48809e170 2023-09-30T22:23:41.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.368+0000 7fd485d9b700 1 -- 172.21.15.156:0/553574155 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47c00ddd0 con 0x7fd48809e170 2023-09-30T22:23:41.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.368+0000 7fd485d9b700 1 -- 172.21.15.156:0/553574155 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c010690 con 0x7fd48809e170 2023-09-30T22:23:41.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.369+0000 7fd48d1f5700 1 -- 172.21.15.156:0/553574155 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd48809e170 msgr2=0x7fd4881307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.369+0000 7fd48d1f5700 1 --2- 172.21.15.156:0/553574155 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd48809e170 0x7fd4881307a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd47c00bb10 tx=0x7fd47c00be20 comp rx=0 tx=0).stop 2023-09-30T22:23:41.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.369+0000 7fd48d1f5700 1 -- 172.21.15.156:0/553574155 shutdown_connections 2023-09-30T22:23:41.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.369+0000 7fd48d1f5700 1 --2- 172.21.15.156:0/553574155 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd48809d860 0x7fd48809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.369+0000 7fd48d1f5700 1 --2- 172.21.15.156:0/553574155 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd48809e170 0x7fd4881307a0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.369+0000 7fd48d1f5700 1 -- 172.21.15.156:0/553574155 >> 172.21.15.156:0/553574155 conn(0x7fd488099c40 msgr2=0x7fd4880a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:41.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.369+0000 7fd48d1f5700 1 -- 172.21.15.156:0/553574155 shutdown_connections 2023-09-30T22:23:41.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.369+0000 7fd48d1f5700 1 -- 172.21.15.156:0/553574155 wait complete. 2023-09-30T22:23:41.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.370+0000 7fd48d1f5700 1 Processor -- start 2023-09-30T22:23:41.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.370+0000 7fd48d1f5700 1 -- start start 2023-09-30T22:23:41.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.371+0000 7fd48d1f5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd48809d860 0x7fd48811e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.371+0000 7fd48d1f5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd48809e170 0x7fd48811ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.371+0000 7fd48d1f5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd488130ce0 0x7fd48811efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.371+0000 7fd48d1f5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd488121af0 con 0x7fd488130ce0 2023-09-30T22:23:41.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.371+0000 7fd48d1f5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd488121cd0 con 0x7fd48809e170 2023-09-30T22:23:41.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.371+0000 7fd48d1f5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd48809c8b0 con 0x7fd48809d860 2023-09-30T22:23:41.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.371+0000 7fd48659c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd48809e170 0x7fd48811ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.371+0000 7fd486d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd48809d860 0x7fd48811e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.371+0000 7fd486d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd48809d860 0x7fd48811e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33630/0 (socket says 172.21.15.156:33630) 2023-09-30T22:23:41.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.371+0000 7fd48659c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd48809e170 0x7fd48811ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33418/0 (socket says 172.21.15.156:33418) 2023-09-30T22:23:41.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.371+0000 7fd486d9d700 1 -- 172.21.15.156:0/2130331576 learned_addr learned my addr 172.21.15.156:0/2130331576 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:41.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.371+0000 7fd48759e700 1 --2- 172.21.15.156:0/2130331576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd488130ce0 0x7fd48811efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.372+0000 7fd48659c700 1 -- 172.21.15.156:0/2130331576 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd48809d860 msgr2=0x7fd48811e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.372+0000 7fd48659c700 1 --2- 172.21.15.156:0/2130331576 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd48809d860 0x7fd48811e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.372+0000 7fd48659c700 1 -- 172.21.15.156:0/2130331576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd488130ce0 msgr2=0x7fd48811efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.372+0000 7fd48659c700 1 --2- 172.21.15.156:0/2130331576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd488130ce0 0x7fd48811efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.372+0000 7fd48659c700 1 -- 172.21.15.156:0/2130331576 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47c00b740 con 0x7fd48809e170 2023-09-30T22:23:41.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.372+0000 7fd48659c700 1 --2- 172.21.15.156:0/2130331576 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd48809e170 0x7fd48811ea80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd48809ee50 tx=0x7fd47c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:41.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.372+0000 7fd46f7fe700 1 -- 172.21.15.156:0/2130331576 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c025ae0 con 0x7fd48809e170 2023-09-30T22:23:41.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.372+0000 7fd46f7fe700 1 -- 172.21.15.156:0/2130331576 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47c025c40 con 0x7fd48809e170 2023-09-30T22:23:41.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.372+0000 7fd48d1f5700 1 -- 172.21.15.156:0/2130331576 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd488120650 con 0x7fd48809e170 2023-09-30T22:23:41.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.372+0000 7fd46f7fe700 1 -- 172.21.15.156:0/2130331576 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c0036a0 con 0x7fd48809e170 2023-09-30T22:23:41.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.372+0000 7fd48d1f5700 1 -- 172.21.15.156:0/2130331576 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd488122740 con 0x7fd48809e170 2023-09-30T22:23:41.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.373+0000 7fd46f7fe700 1 -- 172.21.15.156:0/2130331576 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd47c003800 con 0x7fd48809e170 2023-09-30T22:23:41.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.373+0000 7fd46f7fe700 1 -- 172.21.15.156:0/2130331576 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd47c00f5c0 con 0x7fd48809e170 2023-09-30T22:23:41.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.373+0000 7fd48d1f5700 1 -- 172.21.15.156:0/2130331576 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd48804f2a0 con 0x7fd48809e170 2023-09-30T22:23:41.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.382+0000 7fd46f7fe700 1 -- 172.21.15.156:0/2130331576 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd47c010470 con 0x7fd48809e170 2023-09-30T22:23:41.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.440+0000 7f2de99f5700 1 Processor -- start 2023-09-30T22:23:41.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.440+0000 7f2de99f5700 1 -- start start 2023-09-30T22:23:41.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.441+0000 7f2de99f5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2de40a1510 0x7f2de41351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.441+0000 7f2de99f5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2de41356e0 0x7f2de4137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.441+0000 7f2de99f5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de40a1e70 con 0x7f2de40a0a30 2023-09-30T22:23:41.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.441+0000 7f2de99f5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de409a720 con 0x7f2de41356e0 2023-09-30T22:23:41.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.441+0000 7f2de99f5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de409b300 con 0x7f2de40a1510 2023-09-30T22:23:41.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.441+0000 7f2de27fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2de40a1510 0x7f2de41351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.441+0000 7f2de27fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2de40a1510 0x7f2de41351a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33422/0 (socket says 172.21.15.156:33422) 2023-09-30T22:23:41.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.441+0000 7f2de27fc700 1 -- 172.21.15.156:0/3484804597 learned_addr learned my addr 172.21.15.156:0/3484804597 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:41.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.441+0000 7f2de37fe700 1 --2- 172.21.15.156:0/3484804597 >> v2:172.21.15.156:3300/0 conn(0x7f2de41356e0 0x7f2de4137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.442+0000 7f2de1ffb700 1 -- 172.21.15.156:0/3484804597 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1681921530 0 0) 0x7f2de40a1e70 con 0x7f2de40a0a30 2023-09-30T22:23:41.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.442+0000 7f2de1ffb700 1 -- 172.21.15.156:0/3484804597 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dcc0035b0 con 0x7f2de40a0a30 2023-09-30T22:23:41.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.442+0000 7f2de37fe700 1 -- 172.21.15.156:0/3484804597 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2de40a1510 msgr2=0x7f2de41351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:41.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.442+0000 7f2de37fe700 1 --2- 172.21.15.156:0/3484804597 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2de40a1510 0x7f2de41351a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.442+0000 7f2de37fe700 1 -- 172.21.15.156:0/3484804597 >> v1:172.21.15.156:6789/0 conn(0x7f2de40a0a30 legacy=0x7f2de40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.442+0000 7f2de37fe700 1 -- 172.21.15.156:0/3484804597 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de409abc0 con 0x7f2de41356e0 2023-09-30T22:23:41.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.442+0000 7f2de27fc700 1 --2- 172.21.15.156:0/3484804597 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2de40a1510 0x7f2de41351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:41.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.442+0000 7f2de37fe700 1 --2- 172.21.15.156:0/3484804597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2de41356e0 0x7f2de4137ac0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00aea0 tx=0x7f2ddc00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea6907dc8165ddd2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:41.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.442+0000 7f2de1ffb700 1 -- 172.21.15.156:0/3484804597 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc00f070 con 0x7f2de41356e0 2023-09-30T22:23:41.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.442+0000 7f2de1ffb700 1 -- 172.21.15.156:0/3484804597 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ddc00a2e0 con 0x7f2de41356e0 2023-09-30T22:23:41.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.442+0000 7f2de1ffb700 1 -- 172.21.15.156:0/3484804597 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc00cb50 con 0x7f2de41356e0 2023-09-30T22:23:41.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.443+0000 7f2de99f5700 1 -- 172.21.15.156:0/3484804597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2de41356e0 msgr2=0x7f2de4137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.443+0000 7f2de99f5700 1 --2- 172.21.15.156:0/3484804597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2de41356e0 0x7f2de4137ac0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00aea0 tx=0x7f2ddc00c330 comp rx=0 tx=0).stop 2023-09-30T22:23:41.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.443+0000 7f2de99f5700 1 -- 172.21.15.156:0/3484804597 shutdown_connections 2023-09-30T22:23:41.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.443+0000 7f2de99f5700 1 --2- 172.21.15.156:0/3484804597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2de41356e0 0x7f2de4137ac0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.443+0000 7f2de99f5700 1 --2- 172.21.15.156:0/3484804597 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2de40a1510 0x7f2de41351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.443+0000 7f2de99f5700 1 -- 172.21.15.156:0/3484804597 >> 172.21.15.156:0/3484804597 conn(0x7f2de40a2980 msgr2=0x7f2de40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:41.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.443+0000 7f2de99f5700 1 -- 172.21.15.156:0/3484804597 shutdown_connections 2023-09-30T22:23:41.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.443+0000 7f2de99f5700 1 -- 172.21.15.156:0/3484804597 wait complete. 2023-09-30T22:23:41.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.445+0000 7f2de99f5700 1 Processor -- start 2023-09-30T22:23:41.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.445+0000 7f2de99f5700 1 -- start start 2023-09-30T22:23:41.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.445+0000 7f2de99f5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2de40a0a30 0x7f2de406ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.445+0000 7f2de99f5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2de40a1510 0x7f2de406f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.446+0000 7f2de99f5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2de41356e0 0x7f2de406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.446+0000 7f2de99f5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de4071c10 con 0x7f2de40a0a30 2023-09-30T22:23:41.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.446+0000 7f2de99f5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de4070ce0 con 0x7f2de41356e0 2023-09-30T22:23:41.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.446+0000 7f2de99f5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2de411d670 con 0x7f2de40a1510 2023-09-30T22:23:41.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.446+0000 7f2de2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2de40a0a30 0x7f2de406ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.446+0000 7f2de2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2de40a0a30 0x7f2de406ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54372/0 (socket says 172.21.15.156:54372) 2023-09-30T22:23:41.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.446+0000 7f2de2ffd700 1 -- 172.21.15.156:0/3308503261 learned_addr learned my addr 172.21.15.156:0/3308503261 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:41.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.446+0000 7f2de27fc700 1 --2- 172.21.15.156:0/3308503261 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2de40a1510 0x7f2de406f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.446+0000 7f2de37fe700 1 --2- 172.21.15.156:0/3308503261 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2de41356e0 0x7f2de406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.446+0000 7f2de2ffd700 1 -- 172.21.15.156:0/3308503261 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2de40a1510 msgr2=0x7f2de406f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.446+0000 7f2de2ffd700 1 --2- 172.21.15.156:0/3308503261 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2de40a1510 0x7f2de406f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.446+0000 7f2de2ffd700 1 -- 172.21.15.156:0/3308503261 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2de41356e0 msgr2=0x7f2de406f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.446+0000 7f2de2ffd700 1 --2- 172.21.15.156:0/3308503261 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2de41356e0 0x7f2de406f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.446+0000 7f2de2ffd700 1 -- 172.21.15.156:0/3308503261 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd8009550 con 0x7f2de40a0a30 2023-09-30T22:23:41.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.446+0000 7f2de37fe700 1 --2- 172.21.15.156:0/3308503261 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2de41356e0 0x7f2de406f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:41.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.446+0000 7f2de2ffd700 1 --2- 172.21.15.156:0/3308503261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2de40a0a30 0x7f2de406ec30 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400c760 tx=0x7f2dd400ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:41.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.446+0000 7f2dcbfff700 1 -- 172.21.15.156:0/3308503261 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd40054e0 con 0x7f2de40a0a30 2023-09-30T22:23:41.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.447+0000 7f2dcbfff700 1 -- 172.21.15.156:0/3308503261 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd40036a0 con 0x7f2de40a0a30 2023-09-30T22:23:41.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.447+0000 7f2de99f5700 1 -- 172.21.15.156:0/3308503261 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ddc00ab80 con 0x7f2de40a0a30 2023-09-30T22:23:41.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.447+0000 7f2dcbfff700 1 -- 172.21.15.156:0/3308503261 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4003a10 con 0x7f2de40a0a30 2023-09-30T22:23:41.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.447+0000 7f2de99f5700 1 -- 172.21.15.156:0/3308503261 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de406fee0 con 0x7f2de40a0a30 2023-09-30T22:23:41.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.448+0000 7f2dcbfff700 1 -- 172.21.15.156:0/3308503261 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2dd4003b70 con 0x7f2de40a0a30 2023-09-30T22:23:41.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.448+0000 7f2de99f5700 1 -- 172.21.15.156:0/3308503261 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de4071a50 con 0x7f2de40a0a30 2023-09-30T22:23:41.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.448+0000 7f2dcbfff700 1 -- 172.21.15.156:0/3308503261 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2dd403ea30 con 0x7f2de40a0a30 2023-09-30T22:23:41.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.457+0000 7f2dcbfff700 1 -- 172.21.15.156:0/3308503261 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2de4071a50 con 0x7f2de40a0a30 2023-09-30T22:23:41.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.487+0000 7f9ff4581700 1 Processor -- start 2023-09-30T22:23:41.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.487+0000 7f9ff4581700 1 -- start start 2023-09-30T22:23:41.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.488+0000 7f9ff4581700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fec09e870 0x7f9fec09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.488+0000 7f9ff4581700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fec09f180 0x7f9fec131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.488+0000 7f9ff4581700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9fec131d70 0x7f9fec132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.488+0000 7f9ff4581700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fec0a0920 con 0x7f9fec131d70 2023-09-30T22:23:41.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.488+0000 7f9ff4581700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec09c970 con 0x7f9fec09f180 2023-09-30T22:23:41.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.488+0000 7f9ff4581700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec09bab0 con 0x7f9fec09e870 2023-09-30T22:23:41.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.488+0000 7f9ff1b1c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fec09f180 0x7f9fec131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.488+0000 7f9ff1b1c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fec09f180 0x7f9fec131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33436/0 (socket says 172.21.15.156:33436) 2023-09-30T22:23:41.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.488+0000 7f9ff1b1c700 1 -- 172.21.15.156:0/2684966060 learned_addr learned my addr 172.21.15.156:0/2684966060 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:41.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.488+0000 7f9ff231d700 1 --2- 172.21.15.156:0/2684966060 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fec09e870 0x7f9fec09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.488+0000 7f9ff2b1e700 1 --2- 172.21.15.156:0/2684966060 >> v2:172.21.15.156:3300/0 conn(0x7f9fec131d70 0x7f9fec132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.488+0000 7f9ff1b1c700 1 -- 172.21.15.156:0/2684966060 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fec09e870 msgr2=0x7f9fec09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:41.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.488+0000 7f9ff1b1c700 1 --2- 172.21.15.156:0/2684966060 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fec09e870 0x7f9fec09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.488+0000 7f9ff1b1c700 1 -- 172.21.15.156:0/2684966060 >> v2:172.21.15.156:3300/0 conn(0x7f9fec131d70 msgr2=0x7f9fec132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:41.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.488+0000 7f9ff1b1c700 1 --2- 172.21.15.156:0/2684966060 >> v2:172.21.15.156:3300/0 conn(0x7f9fec131d70 0x7f9fec132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.488+0000 7f9ff1b1c700 1 -- 172.21.15.156:0/2684966060 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec09f9c0 con 0x7f9fec09f180 2023-09-30T22:23:41.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.488+0000 7f9ff231d700 1 --2- 172.21.15.156:0/2684966060 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fec09e870 0x7f9fec09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:41.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.488+0000 7f9ff1b1c700 1 --2- 172.21.15.156:0/2684966060 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fec09f180 0x7f9fec131830 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0098f0 tx=0x7f9fdc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24a1c8ce60861e6b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:41.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.489+0000 7f9ff131b700 1 -- 172.21.15.156:0/2684966060 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc011830 con 0x7f9fec09f180 2023-09-30T22:23:41.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.489+0000 7f9ff131b700 1 -- 172.21.15.156:0/2684966060 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fdc011990 con 0x7f9fec09f180 2023-09-30T22:23:41.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.489+0000 7f9ff131b700 1 -- 172.21.15.156:0/2684966060 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc011d20 con 0x7f9fec09f180 2023-09-30T22:23:41.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.489+0000 7f9ff4581700 1 -- 172.21.15.156:0/2684966060 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fec09f180 msgr2=0x7f9fec131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.489+0000 7f9ff4581700 1 --2- 172.21.15.156:0/2684966060 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fec09f180 0x7f9fec131830 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0098f0 tx=0x7f9fdc009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:41.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.489+0000 7f9ff4581700 1 -- 172.21.15.156:0/2684966060 shutdown_connections 2023-09-30T22:23:41.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.489+0000 7f9ff4581700 1 --2- 172.21.15.156:0/2684966060 >> v2:172.21.15.156:3300/0 conn(0x7f9fec131d70 0x7f9fec132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.489+0000 7f9ff4581700 1 --2- 172.21.15.156:0/2684966060 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fec09e870 0x7f9fec09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.489+0000 7f9ff4581700 1 --2- 172.21.15.156:0/2684966060 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fec09f180 0x7f9fec131830 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.489+0000 7f9ff4581700 1 -- 172.21.15.156:0/2684966060 >> 172.21.15.156:0/2684966060 conn(0x7f9fec0a4430 msgr2=0x7f9fec0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:41.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.489+0000 7f9ff4581700 1 -- 172.21.15.156:0/2684966060 shutdown_connections 2023-09-30T22:23:41.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.489+0000 7f9ff4581700 1 -- 172.21.15.156:0/2684966060 wait complete. 2023-09-30T22:23:41.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.491+0000 7f9ff4581700 1 Processor -- start 2023-09-30T22:23:41.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.491+0000 7f9ff4581700 1 -- start start 2023-09-30T22:23:41.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.491+0000 7f9ff4581700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fec09e870 0x7f9fec1359a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.491+0000 7f9ff4581700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fec09f180 0x7f9fec135ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.491+0000 7f9ff4581700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fec131d70 0x7f9fec136420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.491+0000 7f9ff4581700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec11c8c0 con 0x7f9fec131d70 2023-09-30T22:23:41.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.491+0000 7f9ff4581700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec11bf00 con 0x7f9fec09f180 2023-09-30T22:23:41.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.491+0000 7f9ff4581700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec1375b0 con 0x7f9fec09e870 2023-09-30T22:23:41.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.491+0000 7f9ff1b1c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fec09f180 0x7f9fec135ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.492+0000 7f9ff1b1c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fec09f180 0x7f9fec135ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33446/0 (socket says 172.21.15.156:33446) 2023-09-30T22:23:41.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.492+0000 7f9ff1b1c700 1 -- 172.21.15.156:0/2776644164 learned_addr learned my addr 172.21.15.156:0/2776644164 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:41.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.492+0000 7f9ff2b1e700 1 --2- 172.21.15.156:0/2776644164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fec131d70 0x7f9fec136420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.492+0000 7f9ff231d700 1 --2- 172.21.15.156:0/2776644164 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fec09e870 0x7f9fec1359a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.492+0000 7f9ff1b1c700 1 -- 172.21.15.156:0/2776644164 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fec09e870 msgr2=0x7f9fec1359a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.492+0000 7f9ff1b1c700 1 --2- 172.21.15.156:0/2776644164 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fec09e870 0x7f9fec1359a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.492+0000 7f9ff1b1c700 1 -- 172.21.15.156:0/2776644164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fec131d70 msgr2=0x7f9fec136420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.492+0000 7f9ff1b1c700 1 --2- 172.21.15.156:0/2776644164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fec131d70 0x7f9fec136420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.492+0000 7f9ff1b1c700 1 -- 172.21.15.156:0/2776644164 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe80094a0 con 0x7f9fec09f180 2023-09-30T22:23:41.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.492+0000 7f9ff2b1e700 1 --2- 172.21.15.156:0/2776644164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fec131d70 0x7f9fec136420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:41.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.492+0000 7f9ff1b1c700 1 --2- 172.21.15.156:0/2776644164 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fec09f180 0x7f9fec135ee0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc009c40 tx=0x7f9fdc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:41.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.492+0000 7f9fe2ffd700 1 -- 172.21.15.156:0/2776644164 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc004300 con 0x7f9fec09f180 2023-09-30T22:23:41.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.492+0000 7f9fe2ffd700 1 -- 172.21.15.156:0/2776644164 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fdc01f070 con 0x7f9fec09f180 2023-09-30T22:23:41.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.492+0000 7f9ff4581700 1 -- 172.21.15.156:0/2776644164 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fdc009550 con 0x7f9fec09f180 2023-09-30T22:23:41.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.492+0000 7f9fe2ffd700 1 -- 172.21.15.156:0/2776644164 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc0036a0 con 0x7f9fec09f180 2023-09-30T22:23:41.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.492+0000 7f9ff4581700 1 -- 172.21.15.156:0/2776644164 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fec11b960 con 0x7f9fec09f180 2023-09-30T22:23:41.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.493+0000 7f9ff4581700 1 -- 172.21.15.156:0/2776644164 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fec04f2a0 con 0x7f9fec09f180 2023-09-30T22:23:41.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.493+0000 7f9fe2ffd700 1 -- 172.21.15.156:0/2776644164 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9fdc021030 con 0x7f9fec09f180 2023-09-30T22:23:41.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.493+0000 7f9fe2ffd700 1 -- 172.21.15.156:0/2776644164 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9fdc041880 con 0x7f9fec09f180 2023-09-30T22:23:41.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.502+0000 7f9fe2ffd700 1 -- 172.21.15.156:0/2776644164 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9fdc0199a0 con 0x7f9fec09f180 2023-09-30T22:23:41.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.506+0000 7f0f4aef7700 1 -- 172.21.15.156:0/2768468801 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0f4404f2a0 con 0x7f0f44133f50 2023-09-30T22:23:41.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.506+0000 7f0f417fa700 1 -- 172.21.15.156:0/2768468801 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f3c018030 con 0x7f0f44133f50 2023-09-30T22:23:41.507 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:41.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.509+0000 7f0f4aef7700 1 -- 172.21.15.156:0/2768468801 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f44133f50 msgr2=0x7f0f44122e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.509+0000 7f0f4aef7700 1 --2- 172.21.15.156:0/2768468801 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f44133f50 0x7f0f44122e30 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c00efc0 tx=0x7f0f3c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.509+0000 7f0f4aef7700 1 -- 172.21.15.156:0/2768468801 shutdown_connections 2023-09-30T22:23:41.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.509+0000 7f0f4aef7700 1 --2- 172.21.15.156:0/2768468801 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f44133f50 0x7f0f44122e30 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.509+0000 7f0f4aef7700 1 --2- 172.21.15.156:0/2768468801 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f440a0a70 0x7f0f441223b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.509+0000 7f0f4aef7700 1 --2- 172.21.15.156:0/2768468801 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f440a1380 0x7f0f441228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.509+0000 7f0f4aef7700 1 -- 172.21.15.156:0/2768468801 >> 172.21.15.156:0/2768468801 conn(0x7f0f440a6610 msgr2=0x7f0f4411c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:41.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.509+0000 7f0f4aef7700 1 -- 172.21.15.156:0/2768468801 shutdown_connections 2023-09-30T22:23:41.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.509+0000 7f0f4aef7700 1 -- 172.21.15.156:0/2768468801 wait complete. 2023-09-30T22:23:41.523 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:41.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.603+0000 7fd48d1f5700 1 -- 172.21.15.156:0/2130331576 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd48806c3b0 con 0x7fd48809e170 2023-09-30T22:23:41.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.603+0000 7fd46f7fe700 1 -- 172.21.15.156:0/2130331576 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd47c00eb50 con 0x7fd48809e170 2023-09-30T22:23:41.604 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:41.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.605+0000 7fd48d1f5700 1 -- 172.21.15.156:0/2130331576 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd48809e170 msgr2=0x7fd48811ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.605+0000 7fd48d1f5700 1 --2- 172.21.15.156:0/2130331576 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd48809e170 0x7fd48811ea80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd48809ee50 tx=0x7fd47c004750 comp rx=0 tx=0).stop 2023-09-30T22:23:41.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.605+0000 7fd48d1f5700 1 -- 172.21.15.156:0/2130331576 shutdown_connections 2023-09-30T22:23:41.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.605+0000 7fd48d1f5700 1 --2- 172.21.15.156:0/2130331576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd488130ce0 0x7fd48811efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.605+0000 7fd48d1f5700 1 --2- 172.21.15.156:0/2130331576 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd48809d860 0x7fd48811e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.605+0000 7fd48d1f5700 1 --2- 172.21.15.156:0/2130331576 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd48809e170 0x7fd48811ea80 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.605+0000 7fd48d1f5700 1 -- 172.21.15.156:0/2130331576 >> 172.21.15.156:0/2130331576 conn(0x7fd488099c40 msgr2=0x7fd4880a2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:41.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.605+0000 7fd48d1f5700 1 -- 172.21.15.156:0/2130331576 shutdown_connections 2023-09-30T22:23:41.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.605+0000 7fd48d1f5700 1 -- 172.21.15.156:0/2130331576 wait complete. 2023-09-30T22:23:41.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:41.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.653+0000 7f2de99f5700 1 -- 172.21.15.156:0/3308503261 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2de4071a50 con 0x7f2de40a0a30 2023-09-30T22:23:41.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.653+0000 7f2dcbfff700 1 -- 172.21.15.156:0/3308503261 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2de4071a50 con 0x7f2de40a0a30 2023-09-30T22:23:41.654 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:41.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.655+0000 7f2de99f5700 1 -- 172.21.15.156:0/3308503261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2de40a0a30 msgr2=0x7f2de406ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.655+0000 7f2de99f5700 1 --2- 172.21.15.156:0/3308503261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2de40a0a30 0x7f2de406ec30 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400c760 tx=0x7f2dd400ca70 comp rx=0 tx=0).stop 2023-09-30T22:23:41.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.655+0000 7f2de99f5700 1 -- 172.21.15.156:0/3308503261 shutdown_connections 2023-09-30T22:23:41.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.655+0000 7f2de99f5700 1 --2- 172.21.15.156:0/3308503261 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2de41356e0 0x7f2de406f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.655+0000 7f2de99f5700 1 --2- 172.21.15.156:0/3308503261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2de40a0a30 0x7f2de406ec30 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.655+0000 7f2de99f5700 1 --2- 172.21.15.156:0/3308503261 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2de40a1510 0x7f2de406f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.655+0000 7f2de99f5700 1 -- 172.21.15.156:0/3308503261 >> 172.21.15.156:0/3308503261 conn(0x7f2de40a2980 msgr2=0x7f2de4130fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:41.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.656+0000 7f2de99f5700 1 -- 172.21.15.156:0/3308503261 shutdown_connections 2023-09-30T22:23:41.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.656+0000 7f2de99f5700 1 -- 172.21.15.156:0/3308503261 wait complete. 2023-09-30T22:23:41.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:41.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.703+0000 7f9ff4581700 1 -- 172.21.15.156:0/2776644164 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9fec09f660 con 0x7f9fec09f180 2023-09-30T22:23:41.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.703+0000 7f9fe2ffd700 1 -- 172.21.15.156:0/2776644164 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9fdc0193b0 con 0x7f9fec09f180 2023-09-30T22:23:41.704 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:41.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.705+0000 7f9ff4581700 1 -- 172.21.15.156:0/2776644164 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fec09f180 msgr2=0x7f9fec135ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.705+0000 7f9ff4581700 1 --2- 172.21.15.156:0/2776644164 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fec09f180 0x7f9fec135ee0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc009c40 tx=0x7f9fdc004750 comp rx=0 tx=0).stop 2023-09-30T22:23:41.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.705+0000 7f9ff4581700 1 -- 172.21.15.156:0/2776644164 shutdown_connections 2023-09-30T22:23:41.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.705+0000 7f9ff4581700 1 --2- 172.21.15.156:0/2776644164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fec131d70 0x7f9fec136420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.705+0000 7f9ff4581700 1 --2- 172.21.15.156:0/2776644164 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fec09e870 0x7f9fec1359a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.705+0000 7f9ff4581700 1 --2- 172.21.15.156:0/2776644164 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fec09f180 0x7f9fec135ee0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.705+0000 7f9ff4581700 1 -- 172.21.15.156:0/2776644164 >> 172.21.15.156:0/2776644164 conn(0x7f9fec0a4430 msgr2=0x7f9fec09cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:41.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.705+0000 7f9ff4581700 1 -- 172.21.15.156:0/2776644164 shutdown_connections 2023-09-30T22:23:41.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:41.705+0000 7f9ff4581700 1 -- 172.21.15.156:0/2776644164 wait complete. 2023-09-30T22:23:41.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:42.524 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:42.623 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:42.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.659+0000 7f1cf7740700 1 Processor -- start 2023-09-30T22:23:42.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.659+0000 7f1cf7740700 1 -- start start 2023-09-30T22:23:42.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.659+0000 7f1cf7740700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1cf009e870 0x7f1cf009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.659+0000 7f1cf7740700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1cf009f180 0x7f1cf0131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.660+0000 7f1cf7740700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1cf0131d70 0x7f1cf01321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.660+0000 7f1cf7740700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf00a0920 con 0x7f1cf009e870 2023-09-30T22:23:42.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.660+0000 7f1cf7740700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf009c970 con 0x7f1cf0131d70 2023-09-30T22:23:42.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.660+0000 7f1cf7740700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf009bab0 con 0x7f1cf009f180 2023-09-30T22:23:42.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.660+0000 7f1cf54dc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1cf009e870 0x7f1cf009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.660+0000 7f1cf4cdb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1cf009f180 0x7f1cf0131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.660+0000 7f1cf54dc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1cf009e870 0x7f1cf009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54410/0 (socket says 172.21.15.156:54410) 2023-09-30T22:23:42.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.660+0000 7f1cf54dc700 1 -- 172.21.15.156:0/3941393359 learned_addr learned my addr 172.21.15.156:0/3941393359 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:42.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.660+0000 7f1cf5cdd700 1 --2- 172.21.15.156:0/3941393359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1cf0131d70 0x7f1cf01321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.660+0000 7f1cf54dc700 1 -- 172.21.15.156:0/3941393359 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1cf009f180 msgr2=0x7f1cf0131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:42.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.660+0000 7f1cf54dc700 1 --2- 172.21.15.156:0/3941393359 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1cf009f180 0x7f1cf0131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.660+0000 7f1cf54dc700 1 -- 172.21.15.156:0/3941393359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1cf0131d70 msgr2=0x7f1cf01321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:42.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.660+0000 7f1cf54dc700 1 --2- 172.21.15.156:0/3941393359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1cf0131d70 0x7f1cf01321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.660+0000 7f1cf54dc700 1 -- 172.21.15.156:0/3941393359 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf009f9c0 con 0x7f1cf009e870 2023-09-30T22:23:42.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.660+0000 7f1cf4cdb700 1 --2- 172.21.15.156:0/3941393359 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1cf009f180 0x7f1cf0131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:42.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.660+0000 7f1cf5cdd700 1 --2- 172.21.15.156:0/3941393359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1cf0131d70 0x7f1cf01321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:42.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.660+0000 7f1cf54dc700 1 --2- 172.21.15.156:0/3941393359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cf009e870 0x7f1cf009ec40 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f1cec009920 tx=0x7f1cec009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=542d7b8c9b5ff90e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:42.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.660+0000 7f1ce7fff700 1 -- 172.21.15.156:0/3941393359 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec011830 con 0x7f1cf009e870 2023-09-30T22:23:42.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.660+0000 7f1ce7fff700 1 -- 172.21.15.156:0/3941393359 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cec011990 con 0x7f1cf009e870 2023-09-30T22:23:42.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.660+0000 7f1ce7fff700 1 -- 172.21.15.156:0/3941393359 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec011d20 con 0x7f1cf009e870 2023-09-30T22:23:42.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.661+0000 7f1cf7740700 1 -- 172.21.15.156:0/3941393359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cf009e870 msgr2=0x7f1cf009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:42.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.661+0000 7f1cf7740700 1 --2- 172.21.15.156:0/3941393359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cf009e870 0x7f1cf009ec40 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f1cec009920 tx=0x7f1cec009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:42.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.661+0000 7f1cf7740700 1 -- 172.21.15.156:0/3941393359 shutdown_connections 2023-09-30T22:23:42.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.661+0000 7f1cf7740700 1 --2- 172.21.15.156:0/3941393359 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1cf0131d70 0x7f1cf01321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.661+0000 7f1cf7740700 1 --2- 172.21.15.156:0/3941393359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cf009e870 0x7f1cf009ec40 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.661+0000 7f1cf7740700 1 --2- 172.21.15.156:0/3941393359 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1cf009f180 0x7f1cf0131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.661+0000 7f1cf7740700 1 -- 172.21.15.156:0/3941393359 >> 172.21.15.156:0/3941393359 conn(0x7f1cf00a4430 msgr2=0x7f1cf00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:42.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.661+0000 7f1cf7740700 1 -- 172.21.15.156:0/3941393359 shutdown_connections 2023-09-30T22:23:42.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.661+0000 7f1cf7740700 1 -- 172.21.15.156:0/3941393359 wait complete. 2023-09-30T22:23:42.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.662+0000 7f1cf7740700 1 Processor -- start 2023-09-30T22:23:42.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.662+0000 7f1cf7740700 1 -- start start 2023-09-30T22:23:42.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.662+0000 7f1cf7740700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1cf009e870 0x7f1cf011d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.662+0000 7f1cf7740700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1cf009f180 0x7f1cf011d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.663+0000 7f1cf7740700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cf0131d70 0x7f1cf011db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.663+0000 7f1cf7740700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf01208e0 con 0x7f1cf0131d70 2023-09-30T22:23:42.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.663+0000 7f1cf7740700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf009dba0 con 0x7f1cf009e870 2023-09-30T22:23:42.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.663+0000 7f1cf7740700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf011edc0 con 0x7f1cf009f180 2023-09-30T22:23:42.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.663+0000 7f1cf4cdb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1cf009f180 0x7f1cf011d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.663+0000 7f1cf4cdb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1cf009f180 0x7f1cf011d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33656/0 (socket says 172.21.15.156:33656) 2023-09-30T22:23:42.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.663+0000 7f1cf5cdd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cf0131d70 0x7f1cf011db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.663+0000 7f1cf4cdb700 1 -- 172.21.15.156:0/874001278 learned_addr learned my addr 172.21.15.156:0/874001278 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:42.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.663+0000 7f1cf54dc700 1 --2- 172.21.15.156:0/874001278 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1cf009e870 0x7f1cf011d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.663+0000 7f1cf4cdb700 1 -- 172.21.15.156:0/874001278 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1cf009e870 msgr2=0x7f1cf011d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:42.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.663+0000 7f1cf4cdb700 1 --2- 172.21.15.156:0/874001278 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1cf009e870 0x7f1cf011d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.663+0000 7f1cf4cdb700 1 -- 172.21.15.156:0/874001278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cf0131d70 msgr2=0x7f1cf011db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:42.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.663+0000 7f1cf4cdb700 1 --2- 172.21.15.156:0/874001278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cf0131d70 0x7f1cf011db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.663+0000 7f1cf4cdb700 1 -- 172.21.15.156:0/874001278 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce00094a0 con 0x7f1cf009f180 2023-09-30T22:23:42.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.663+0000 7f1cf5cdd700 1 --2- 172.21.15.156:0/874001278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cf0131d70 0x7f1cf011db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:42.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.663+0000 7f1cf54dc700 1 --2- 172.21.15.156:0/874001278 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1cf009e870 0x7f1cf011d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:42.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.663+0000 7f1cf4cdb700 1 --2- 172.21.15.156:0/874001278 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1cf009f180 0x7f1cf011d5e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000ebe0 tx=0x7f1ce000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:42.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.663+0000 7f1ce5ffb700 1 -- 172.21.15.156:0/874001278 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0009780 con 0x7f1cf009f180 2023-09-30T22:23:42.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.663+0000 7f1ce5ffb700 1 -- 172.21.15.156:0/874001278 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce000c7f0 con 0x7f1cf009f180 2023-09-30T22:23:42.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.663+0000 7f1cf7740700 1 -- 172.21.15.156:0/874001278 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce8009a70 con 0x7f1cf009f180 2023-09-30T22:23:42.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.663+0000 7f1ce5ffb700 1 -- 172.21.15.156:0/874001278 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce000cb80 con 0x7f1cf009f180 2023-09-30T22:23:42.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.664+0000 7f1cf7740700 1 -- 172.21.15.156:0/874001278 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cec009550 con 0x7f1cf009f180 2023-09-30T22:23:42.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.664+0000 7f1ce5ffb700 1 -- 172.21.15.156:0/874001278 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1ce000cce0 con 0x7f1cf009f180 2023-09-30T22:23:42.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.664+0000 7f1cf7740700 1 -- 172.21.15.156:0/874001278 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf004f2a0 con 0x7f1cf009f180 2023-09-30T22:23:42.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.665+0000 7f1ce5ffb700 1 -- 172.21.15.156:0/874001278 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1ce003fa80 con 0x7f1cf009f180 2023-09-30T22:23:42.670 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:42.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.669+0000 7f1ce5ffb700 1 -- 172.21.15.156:0/874001278 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1ce0017020 con 0x7f1cf009f180 2023-09-30T22:23:42.718 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:42.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.755+0000 7f8047a82700 1 Processor -- start 2023-09-30T22:23:42.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.755+0000 7f8047a82700 1 -- start start 2023-09-30T22:23:42.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.756+0000 7f8047a82700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8040099e20 0x7f804009a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.756+0000 7f8047a82700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f804009a730 0x7f8040130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.756+0000 7f8047a82700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8040099a60 con 0x7f8040130890 2023-09-30T22:23:42.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.756+0000 7f8047a82700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f804009bf50 con 0x7f8040099e20 2023-09-30T22:23:42.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.756+0000 7f8047a82700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804009b230 con 0x7f804009a730 2023-09-30T22:23:42.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.756+0000 7f804501d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f804009a730 0x7f8040130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.756+0000 7f804581e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8040099e20 0x7f804009a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.756+0000 7f804501d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f804009a730 0x7f8040130350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33474/0 (socket says 172.21.15.156:33474) 2023-09-30T22:23:42.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.756+0000 7f804501d700 1 -- 172.21.15.156:0/1962576550 learned_addr learned my addr 172.21.15.156:0/1962576550 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:42.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.756+0000 7f804501d700 1 -- 172.21.15.156:0/1962576550 >> v2:172.21.15.156:3300/0 conn(0x7f8040099e20 msgr2=0x7f804009a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:42.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.756+0000 7f804501d700 1 --2- 172.21.15.156:0/1962576550 >> v2:172.21.15.156:3300/0 conn(0x7f8040099e20 0x7f804009a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.756+0000 7f804501d700 1 -- 172.21.15.156:0/1962576550 >> v1:172.21.15.156:6789/0 conn(0x7f8040130890 legacy=0x7f8040137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:42.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.756+0000 7f804501d700 1 -- 172.21.15.156:0/1962576550 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804009bb90 con 0x7f804009a730 2023-09-30T22:23:42.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.756+0000 7f804501d700 1 --2- 172.21.15.156:0/1962576550 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f804009a730 0x7f8040130350 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f80300098f0 tx=0x7f8030009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b2f3b02a6db0c69 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:42.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.757+0000 7f804481c700 1 -- 172.21.15.156:0/1962576550 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8030011830 con 0x7f804009a730 2023-09-30T22:23:42.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.757+0000 7f804481c700 1 -- 172.21.15.156:0/1962576550 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8030011990 con 0x7f804009a730 2023-09-30T22:23:42.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.757+0000 7f804481c700 1 -- 172.21.15.156:0/1962576550 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8030011d20 con 0x7f804009a730 2023-09-30T22:23:42.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.757+0000 7f8047a82700 1 -- 172.21.15.156:0/1962576550 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f804009a730 msgr2=0x7f8040130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:42.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.757+0000 7f8047a82700 1 --2- 172.21.15.156:0/1962576550 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f804009a730 0x7f8040130350 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f80300098f0 tx=0x7f8030009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:42.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.757+0000 7f8047a82700 1 -- 172.21.15.156:0/1962576550 shutdown_connections 2023-09-30T22:23:42.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.757+0000 7f8047a82700 1 --2- 172.21.15.156:0/1962576550 >> v2:172.21.15.156:3300/0 conn(0x7f8040099e20 0x7f804009a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.757+0000 7f8047a82700 1 --2- 172.21.15.156:0/1962576550 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f804009a730 0x7f8040130350 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.757+0000 7f8047a82700 1 -- 172.21.15.156:0/1962576550 >> 172.21.15.156:0/1962576550 conn(0x7f80400a2980 msgr2=0x7f80400a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:42.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.757+0000 7f8047a82700 1 -- 172.21.15.156:0/1962576550 shutdown_connections 2023-09-30T22:23:42.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.757+0000 7f8047a82700 1 -- 172.21.15.156:0/1962576550 wait complete. 2023-09-30T22:23:42.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.758+0000 7f8047a82700 1 Processor -- start 2023-09-30T22:23:42.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.758+0000 7f8047a82700 1 -- start start 2023-09-30T22:23:42.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.759+0000 7f8047a82700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8040099e20 0x7f80401c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.759+0000 7f8047a82700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f804009a730 0x7f80401c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.759+0000 7f8047a82700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8040130890 0x7f80401c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.759+0000 7f8047a82700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804012bae0 con 0x7f8040130890 2023-09-30T22:23:42.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.759+0000 7f8047a82700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8040129aa0 con 0x7f804009a730 2023-09-30T22:23:42.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.759+0000 7f8047a82700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8040128490 con 0x7f8040099e20 2023-09-30T22:23:42.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.759+0000 7f804501d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f804009a730 0x7f80401c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.759+0000 7f804501d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f804009a730 0x7f80401c66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33482/0 (socket says 172.21.15.156:33482) 2023-09-30T22:23:42.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.759+0000 7f804501d700 1 -- 172.21.15.156:0/1898281258 learned_addr learned my addr 172.21.15.156:0/1898281258 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:42.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.759+0000 7f804601f700 1 --2- 172.21.15.156:0/1898281258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8040130890 0x7f80401c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.759+0000 7f804501d700 1 -- 172.21.15.156:0/1898281258 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8040099e20 msgr2=0x7f80401c6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:42.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.759+0000 7f804501d700 1 --2- 172.21.15.156:0/1898281258 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8040099e20 0x7f80401c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.759+0000 7f804501d700 1 -- 172.21.15.156:0/1898281258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8040130890 msgr2=0x7f80401c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:42.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.759+0000 7f804501d700 1 --2- 172.21.15.156:0/1898281258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8040130890 0x7f80401c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.759+0000 7f804501d700 1 -- 172.21.15.156:0/1898281258 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8030009550 con 0x7f804009a730 2023-09-30T22:23:42.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.759+0000 7f804601f700 1 --2- 172.21.15.156:0/1898281258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8040130890 0x7f80401c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:42.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.760+0000 7f804501d700 1 --2- 172.21.15.156:0/1898281258 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f804009a730 0x7f80401c66c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8030000c00 tx=0x7f8030004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:42.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.760+0000 7f80367fc700 1 -- 172.21.15.156:0/1898281258 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80300036a0 con 0x7f804009a730 2023-09-30T22:23:42.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.760+0000 7f80367fc700 1 -- 172.21.15.156:0/1898281258 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8030003800 con 0x7f804009a730 2023-09-30T22:23:42.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.760+0000 7f8047a82700 1 -- 172.21.15.156:0/1898281258 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80401399f0 con 0x7f804009a730 2023-09-30T22:23:42.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.760+0000 7f80367fc700 1 -- 172.21.15.156:0/1898281258 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8030003bb0 con 0x7f804009a730 2023-09-30T22:23:42.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.760+0000 7f8047a82700 1 -- 172.21.15.156:0/1898281258 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8040129e40 con 0x7f804009a730 2023-09-30T22:23:42.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.761+0000 7f80367fc700 1 -- 172.21.15.156:0/1898281258 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8030021070 con 0x7f804009a730 2023-09-30T22:23:42.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.761+0000 7f8047a82700 1 -- 172.21.15.156:0/1898281258 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8040072480 con 0x7f804009a730 2023-09-30T22:23:42.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.761+0000 7f80367fc700 1 -- 172.21.15.156:0/1898281258 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8030040c20 con 0x7f804009a730 2023-09-30T22:23:42.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.766+0000 7f80367fc700 1 -- 172.21.15.156:0/1898281258 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8040072480 con 0x7f804009a730 2023-09-30T22:23:42.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.807+0000 7f1e8eb12700 1 Processor -- start 2023-09-30T22:23:42.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.807+0000 7f1e8eb12700 1 -- start start 2023-09-30T22:23:42.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.807+0000 7f1e8eb12700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1e8809d8f0 0x7f1e8809dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.807+0000 7f1e8eb12700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e8809e200 0x7f1e881380b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.807+0000 7f1e8eb12700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e881385f0 0x7f1e88138a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.807+0000 7f1e8eb12700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e88138f80 con 0x7f1e8809d8f0 2023-09-30T22:23:42.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.807+0000 7f1e8eb12700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e88098680 con 0x7f1e881385f0 2023-09-30T22:23:42.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.807+0000 7f1e8eb12700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e88099560 con 0x7f1e8809e200 2023-09-30T22:23:42.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.808+0000 7f1e87fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e8809e200 0x7f1e881380b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.808+0000 7f1e87fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e8809e200 0x7f1e881380b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33672/0 (socket says 172.21.15.156:33672) 2023-09-30T22:23:42.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.808+0000 7f1e87fff700 1 -- 172.21.15.156:0/3512581645 learned_addr learned my addr 172.21.15.156:0/3512581645 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:42.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.808+0000 7f1e8d0af700 1 --2- 172.21.15.156:0/3512581645 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e881385f0 0x7f1e88138a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.808+0000 7f1e8c8ae700 1 --2- 172.21.15.156:0/3512581645 >> v2:172.21.15.156:3300/0 conn(0x7f1e8809d8f0 0x7f1e8809dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.808+0000 7f1e8d0af700 1 -- 172.21.15.156:0/3512581645 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e8809e200 msgr2=0x7f1e881380b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:42.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.808+0000 7f1e8d0af700 1 --2- 172.21.15.156:0/3512581645 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e8809e200 0x7f1e881380b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.808+0000 7f1e8d0af700 1 -- 172.21.15.156:0/3512581645 >> v2:172.21.15.156:3300/0 conn(0x7f1e8809d8f0 msgr2=0x7f1e8809dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:42.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.808+0000 7f1e8d0af700 1 --2- 172.21.15.156:0/3512581645 >> v2:172.21.15.156:3300/0 conn(0x7f1e8809d8f0 0x7f1e8809dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.808+0000 7f1e8d0af700 1 -- 172.21.15.156:0/3512581645 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e88098bb0 con 0x7f1e881385f0 2023-09-30T22:23:42.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.808+0000 7f1e8d0af700 1 --2- 172.21.15.156:0/3512581645 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e881385f0 0x7f1e88138a40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1e80009d90 tx=0x7f1e8000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99578b609fa355e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:42.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.808+0000 7f1e877fe700 1 -- 172.21.15.156:0/3512581645 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8000e070 con 0x7f1e881385f0 2023-09-30T22:23:42.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.808+0000 7f1e877fe700 1 -- 172.21.15.156:0/3512581645 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8000bb20 con 0x7f1e881385f0 2023-09-30T22:23:42.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.809+0000 7f1e877fe700 1 -- 172.21.15.156:0/3512581645 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e80012430 con 0x7f1e881385f0 2023-09-30T22:23:42.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.809+0000 7f1e8eb12700 1 -- 172.21.15.156:0/3512581645 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e881385f0 msgr2=0x7f1e88138a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:42.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.809+0000 7f1e8eb12700 1 --2- 172.21.15.156:0/3512581645 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e881385f0 0x7f1e88138a40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1e80009d90 tx=0x7f1e8000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:42.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.809+0000 7f1e8eb12700 1 -- 172.21.15.156:0/3512581645 shutdown_connections 2023-09-30T22:23:42.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.809+0000 7f1e8eb12700 1 --2- 172.21.15.156:0/3512581645 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e881385f0 0x7f1e88138a40 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.809+0000 7f1e8eb12700 1 --2- 172.21.15.156:0/3512581645 >> v2:172.21.15.156:3300/0 conn(0x7f1e8809d8f0 0x7f1e8809dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.809+0000 7f1e8eb12700 1 --2- 172.21.15.156:0/3512581645 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e8809e200 0x7f1e881380b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.809+0000 7f1e8eb12700 1 -- 172.21.15.156:0/3512581645 >> 172.21.15.156:0/3512581645 conn(0x7f1e880a2b30 msgr2=0x7f1e8809e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:42.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.809+0000 7f1e8eb12700 1 -- 172.21.15.156:0/3512581645 shutdown_connections 2023-09-30T22:23:42.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.809+0000 7f1e8eb12700 1 -- 172.21.15.156:0/3512581645 wait complete. 2023-09-30T22:23:42.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.810+0000 7f1e8eb12700 1 Processor -- start 2023-09-30T22:23:42.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.810+0000 7f1e8eb12700 1 -- start start 2023-09-30T22:23:42.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.811+0000 7f1e8eb12700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e8809d8f0 0x7f1e88137c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.811+0000 7f1e8eb12700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e8809e200 0x7f1e881390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.811+0000 7f1e8eb12700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e881385f0 0x7f1e88139600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.811+0000 7f1e8eb12700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8813af00 con 0x7f1e8809d8f0 2023-09-30T22:23:42.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.811+0000 7f1e8eb12700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8813b600 con 0x7f1e881385f0 2023-09-30T22:23:42.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.811+0000 7f1e8eb12700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8813a5e0 con 0x7f1e8809e200 2023-09-30T22:23:42.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.811+0000 7f1e8d0af700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e881385f0 0x7f1e88139600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.811+0000 7f1e8d0af700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e881385f0 0x7f1e88139600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33500/0 (socket says 172.21.15.156:33500) 2023-09-30T22:23:42.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.811+0000 7f1e8d0af700 1 -- 172.21.15.156:0/585200018 learned_addr learned my addr 172.21.15.156:0/585200018 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:42.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.811+0000 7f1e87fff700 1 --2- 172.21.15.156:0/585200018 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e8809e200 0x7f1e881390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.811+0000 7f1e8c8ae700 1 --2- 172.21.15.156:0/585200018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e8809d8f0 0x7f1e88137c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.811+0000 7f1e8d0af700 1 -- 172.21.15.156:0/585200018 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e8809e200 msgr2=0x7f1e881390c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:42.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.811+0000 7f1e8d0af700 1 --2- 172.21.15.156:0/585200018 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e8809e200 0x7f1e881390c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.811+0000 7f1e8d0af700 1 -- 172.21.15.156:0/585200018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e8809d8f0 msgr2=0x7f1e88137c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:42.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.811+0000 7f1e8d0af700 1 --2- 172.21.15.156:0/585200018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e8809d8f0 0x7f1e88137c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.811+0000 7f1e8d0af700 1 -- 172.21.15.156:0/585200018 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e80009a70 con 0x7f1e881385f0 2023-09-30T22:23:42.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.812+0000 7f1e8d0af700 1 --2- 172.21.15.156:0/585200018 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e881385f0 0x7f1e88139600 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1e880987c0 tx=0x7f1e80004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:42.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.812+0000 7f1e857fa700 1 -- 172.21.15.156:0/585200018 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e80012430 con 0x7f1e881385f0 2023-09-30T22:23:42.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.812+0000 7f1e857fa700 1 -- 172.21.15.156:0/585200018 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e80020070 con 0x7f1e881385f0 2023-09-30T22:23:42.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.812+0000 7f1e857fa700 1 -- 172.21.15.156:0/585200018 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e80003ea0 con 0x7f1e881385f0 2023-09-30T22:23:42.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.812+0000 7f1e8eb12700 1 -- 172.21.15.156:0/585200018 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e8813c370 con 0x7f1e881385f0 2023-09-30T22:23:42.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.813+0000 7f1e8eb12700 1 -- 172.21.15.156:0/585200018 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e8809b090 con 0x7f1e881385f0 2023-09-30T22:23:42.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.813+0000 7f1e857fa700 1 -- 172.21.15.156:0/585200018 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e80004280 con 0x7f1e881385f0 2023-09-30T22:23:42.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.813+0000 7f1e857fa700 1 -- 172.21.15.156:0/585200018 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1e80022070 con 0x7f1e881385f0 2023-09-30T22:23:42.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.814+0000 7f1e8eb12700 1 -- 172.21.15.156:0/585200018 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e88097f20 con 0x7f1e881385f0 2023-09-30T22:23:42.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.822+0000 7f1e857fa700 1 -- 172.21.15.156:0/585200018 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e80012e10 con 0x7f1e881385f0 2023-09-30T22:23:42.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.856+0000 7fdaa3cf5700 1 Processor -- start 2023-09-30T22:23:42.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.856+0000 7fdaa3cf5700 1 -- start start 2023-09-30T22:23:42.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.856+0000 7fdaa3cf5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda9c0a0a30 0x7fda9c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.857+0000 7fdaa3cf5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fda9c130670 0x7fda9c1381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.857+0000 7fdaa3cf5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9c0a1e70 con 0x7fda9c0a1340 2023-09-30T22:23:42.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.857+0000 7fdaa3cf5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9c09a720 con 0x7fda9c130670 2023-09-30T22:23:42.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.857+0000 7fdaa3cf5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c09b300 con 0x7fda9c0a0a30 2023-09-30T22:23:42.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.857+0000 7fdaa1290700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fda9c0a1340 0x7fda9c12ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53616/0 (socket says 172.21.15.156:53616) 2023-09-30T22:23:42.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.857+0000 7fdaa1290700 1 -- 172.21.15.156:0/1264846249 learned_addr learned my addr 172.21.15.156:0/1264846249 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:42.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.857+0000 7fdaa1a91700 1 --2- 172.21.15.156:0/1264846249 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda9c0a0a30 0x7fda9c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.857+0000 7fdaa2292700 1 --2- 172.21.15.156:0/1264846249 >> v2:172.21.15.156:3300/0 conn(0x7fda9c130670 0x7fda9c1381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.857+0000 7fdaa0a8f700 1 -- 172.21.15.156:0/1264846249 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1007805313 0 0) 0x7fda9c0a1e70 con 0x7fda9c0a1340 2023-09-30T22:23:42.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.857+0000 7fdaa0a8f700 1 -- 172.21.15.156:0/1264846249 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda880035b0 con 0x7fda9c0a1340 2023-09-30T22:23:42.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.857+0000 7fdaa1a91700 1 -- 172.21.15.156:0/1264846249 >> v2:172.21.15.156:3300/0 conn(0x7fda9c130670 msgr2=0x7fda9c1381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:42.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.857+0000 7fdaa1a91700 1 --2- 172.21.15.156:0/1264846249 >> v2:172.21.15.156:3300/0 conn(0x7fda9c130670 0x7fda9c1381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.857+0000 7fdaa1a91700 1 -- 172.21.15.156:0/1264846249 >> v1:172.21.15.156:6789/0 conn(0x7fda9c0a1340 legacy=0x7fda9c12ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:42.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.857+0000 7fdaa1a91700 1 -- 172.21.15.156:0/1264846249 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c09abc0 con 0x7fda9c0a0a30 2023-09-30T22:23:42.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.857+0000 7fdaa1a91700 1 --2- 172.21.15.156:0/1264846249 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda9c0a0a30 0x7fda9c0a0e00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fda98009820 tx=0x7fda98009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0069c4ec3e85d96 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:42.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.858+0000 7fdaa0a8f700 1 -- 172.21.15.156:0/1264846249 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda98005e30 con 0x7fda9c0a0a30 2023-09-30T22:23:42.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.858+0000 7fdaa0a8f700 1 -- 172.21.15.156:0/1264846249 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda98006030 con 0x7fda9c0a0a30 2023-09-30T22:23:42.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.858+0000 7fdaa0a8f700 1 -- 172.21.15.156:0/1264846249 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda980063c0 con 0x7fda9c0a0a30 2023-09-30T22:23:42.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.858+0000 7fdaa3cf5700 1 -- 172.21.15.156:0/1264846249 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda9c0a0a30 msgr2=0x7fda9c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:42.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.858+0000 7fdaa3cf5700 1 --2- 172.21.15.156:0/1264846249 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda9c0a0a30 0x7fda9c0a0e00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fda98009820 tx=0x7fda98009b30 comp rx=0 tx=0).stop 2023-09-30T22:23:42.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.858+0000 7fdaa3cf5700 1 -- 172.21.15.156:0/1264846249 shutdown_connections 2023-09-30T22:23:42.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.858+0000 7fdaa3cf5700 1 --2- 172.21.15.156:0/1264846249 >> v2:172.21.15.156:3300/0 conn(0x7fda9c130670 0x7fda9c1381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.858+0000 7fdaa3cf5700 1 --2- 172.21.15.156:0/1264846249 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda9c0a0a30 0x7fda9c0a0e00 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.858+0000 7fdaa3cf5700 1 -- 172.21.15.156:0/1264846249 >> 172.21.15.156:0/1264846249 conn(0x7fda9c0a2980 msgr2=0x7fda9c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:42.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.858+0000 7fdaa3cf5700 1 -- 172.21.15.156:0/1264846249 shutdown_connections 2023-09-30T22:23:42.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.858+0000 7fdaa3cf5700 1 -- 172.21.15.156:0/1264846249 wait complete. 2023-09-30T22:23:42.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.859+0000 7fdaa3cf5700 1 Processor -- start 2023-09-30T22:23:42.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.859+0000 7fdaa3cf5700 1 -- start start 2023-09-30T22:23:42.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.860+0000 7fdaa3cf5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda9c0a0a30 0x7fda9c1c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.860+0000 7fdaa3cf5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fda9c0a1340 0x7fda9c1c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.860+0000 7fdaa3cf5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda9c130670 0x7fda9c1c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.860+0000 7fdaa3cf5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c1b7f90 con 0x7fda9c0a0a30 2023-09-30T22:23:42.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.860+0000 7fdaa3cf5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c11ecc0 con 0x7fda9c0a1340 2023-09-30T22:23:42.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.860+0000 7fdaa3cf5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c11d200 con 0x7fda9c130670 2023-09-30T22:23:42.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.860+0000 7fdaa2292700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda9c130670 0x7fda9c1c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.860+0000 7fdaa2292700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda9c130670 0x7fda9c1c8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33690/0 (socket says 172.21.15.156:33690) 2023-09-30T22:23:42.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.860+0000 7fdaa2292700 1 -- 172.21.15.156:0/2787664568 learned_addr learned my addr 172.21.15.156:0/2787664568 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:42.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.860+0000 7fdaa1a91700 1 --2- 172.21.15.156:0/2787664568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda9c0a0a30 0x7fda9c1c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.860+0000 7fdaa1290700 1 --2- 172.21.15.156:0/2787664568 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fda9c0a1340 0x7fda9c1c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.860+0000 7fdaa2292700 1 -- 172.21.15.156:0/2787664568 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fda9c0a1340 msgr2=0x7fda9c1c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:42.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.860+0000 7fdaa2292700 1 --2- 172.21.15.156:0/2787664568 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fda9c0a1340 0x7fda9c1c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.860+0000 7fdaa2292700 1 -- 172.21.15.156:0/2787664568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda9c0a0a30 msgr2=0x7fda9c1c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:42.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.860+0000 7fdaa2292700 1 --2- 172.21.15.156:0/2787664568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda9c0a0a30 0x7fda9c1c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.860+0000 7fdaa2292700 1 -- 172.21.15.156:0/2787664568 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda98009430 con 0x7fda9c130670 2023-09-30T22:23:42.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.860+0000 7fdaa1290700 1 --2- 172.21.15.156:0/2787664568 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fda9c0a1340 0x7fda9c1c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:23:42.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.861+0000 7fdaa2292700 1 --2- 172.21.15.156:0/2787664568 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda9c130670 0x7fda9c1c8b80 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fda94009dd0 tx=0x7fda9400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:42.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.861+0000 7fda927fc700 1 -- 172.21.15.156:0/2787664568 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda94009c40 con 0x7fda9c130670 2023-09-30T22:23:42.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.861+0000 7fda927fc700 1 -- 172.21.15.156:0/2787664568 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9400f040 con 0x7fda9c130670 2023-09-30T22:23:42.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.861+0000 7fdaa3cf5700 1 -- 172.21.15.156:0/2787664568 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9c09f6a0 con 0x7fda9c130670 2023-09-30T22:23:42.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.861+0000 7fda927fc700 1 -- 172.21.15.156:0/2787664568 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda94014480 con 0x7fda9c130670 2023-09-30T22:23:42.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.861+0000 7fdaa3cf5700 1 -- 172.21.15.156:0/2787664568 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9c09ae60 con 0x7fda9c130670 2023-09-30T22:23:42.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.862+0000 7fda927fc700 1 -- 172.21.15.156:0/2787664568 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fda940145e0 con 0x7fda9c130670 2023-09-30T22:23:42.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.862+0000 7fdaa3cf5700 1 -- 172.21.15.156:0/2787664568 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9c11eb20 con 0x7fda9c130670 2023-09-30T22:23:42.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.862+0000 7fda927fc700 1 -- 172.21.15.156:0/2787664568 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fda94040400 con 0x7fda9c130670 2023-09-30T22:23:42.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.867+0000 7fda927fc700 1 -- 172.21.15.156:0/2787664568 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fda9c11eb20 con 0x7fda9c130670 2023-09-30T22:23:42.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.883+0000 7f1cf7740700 1 -- 172.21.15.156:0/874001278 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1cf006b2a0 con 0x7f1cf009f180 2023-09-30T22:23:42.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.884+0000 7f1ce5ffb700 1 -- 172.21.15.156:0/874001278 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1ce001b3b0 con 0x7f1cf009f180 2023-09-30T22:23:42.884 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:42.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.886+0000 7f1cf7740700 1 -- 172.21.15.156:0/874001278 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1cf009f180 msgr2=0x7f1cf011d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:42.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.886+0000 7f1cf7740700 1 --2- 172.21.15.156:0/874001278 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1cf009f180 0x7f1cf011d5e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000ebe0 tx=0x7f1ce000eef0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.886+0000 7f1cf7740700 1 -- 172.21.15.156:0/874001278 shutdown_connections 2023-09-30T22:23:42.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.886+0000 7f1cf7740700 1 --2- 172.21.15.156:0/874001278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cf0131d70 0x7f1cf011db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.886+0000 7f1cf7740700 1 --2- 172.21.15.156:0/874001278 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1cf009e870 0x7f1cf011d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.886+0000 7f1cf7740700 1 --2- 172.21.15.156:0/874001278 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1cf009f180 0x7f1cf011d5e0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.886+0000 7f1cf7740700 1 -- 172.21.15.156:0/874001278 >> 172.21.15.156:0/874001278 conn(0x7f1cf00a4430 msgr2=0x7f1cf009cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:42.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.886+0000 7f1cf7740700 1 -- 172.21.15.156:0/874001278 shutdown_connections 2023-09-30T22:23:42.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.886+0000 7f1cf7740700 1 -- 172.21.15.156:0/874001278 wait complete. 2023-09-30T22:23:42.899 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:42.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.993+0000 7f8047a82700 1 -- 172.21.15.156:0/1898281258 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8040072480 con 0x7f804009a730 2023-09-30T22:23:42.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.994+0000 7f80367fc700 1 -- 172.21.15.156:0/1898281258 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8040072480 con 0x7f804009a730 2023-09-30T22:23:42.994 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:42.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.996+0000 7f8047a82700 1 -- 172.21.15.156:0/1898281258 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f804009a730 msgr2=0x7f80401c66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:42.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.996+0000 7f8047a82700 1 --2- 172.21.15.156:0/1898281258 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f804009a730 0x7f80401c66c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8030000c00 tx=0x7f8030004750 comp rx=0 tx=0).stop 2023-09-30T22:23:42.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.996+0000 7f8047a82700 1 -- 172.21.15.156:0/1898281258 shutdown_connections 2023-09-30T22:23:42.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.996+0000 7f8047a82700 1 --2- 172.21.15.156:0/1898281258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8040130890 0x7f80401c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.996+0000 7f8047a82700 1 --2- 172.21.15.156:0/1898281258 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8040099e20 0x7f80401c6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.996+0000 7f8047a82700 1 --2- 172.21.15.156:0/1898281258 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f804009a730 0x7f80401c66c0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.996+0000 7f8047a82700 1 -- 172.21.15.156:0/1898281258 >> 172.21.15.156:0/1898281258 conn(0x7f80400a2980 msgr2=0x7f8040127040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:42.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.996+0000 7f8047a82700 1 -- 172.21.15.156:0/1898281258 shutdown_connections 2023-09-30T22:23:42.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:42.996+0000 7f8047a82700 1 -- 172.21.15.156:0/1898281258 wait complete. 2023-09-30T22:23:43.009 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:43.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:43.020+0000 7f1e8eb12700 1 -- 172.21.15.156:0/585200018 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1e8806ee50 con 0x7f1e881385f0 2023-09-30T22:23:43.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:43.021+0000 7f1e857fa700 1 -- 172.21.15.156:0/585200018 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e8001a380 con 0x7f1e881385f0 2023-09-30T22:23:43.021 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:43.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:43.023+0000 7f1e8eb12700 1 -- 172.21.15.156:0/585200018 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e881385f0 msgr2=0x7f1e88139600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:43.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:43.023+0000 7f1e8eb12700 1 --2- 172.21.15.156:0/585200018 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e881385f0 0x7f1e88139600 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1e880987c0 tx=0x7f1e80004ad0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:43.023+0000 7f1e8eb12700 1 -- 172.21.15.156:0/585200018 shutdown_connections 2023-09-30T22:23:43.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:43.023+0000 7f1e8eb12700 1 --2- 172.21.15.156:0/585200018 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e881385f0 0x7f1e88139600 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:43.023+0000 7f1e8eb12700 1 --2- 172.21.15.156:0/585200018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e8809d8f0 0x7f1e88137c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:43.023+0000 7f1e8eb12700 1 --2- 172.21.15.156:0/585200018 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e8809e200 0x7f1e881390c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:43.023+0000 7f1e8eb12700 1 -- 172.21.15.156:0/585200018 >> 172.21.15.156:0/585200018 conn(0x7f1e880a2b30 msgr2=0x7f1e8808e800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:43.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:43.023+0000 7f1e8eb12700 1 -- 172.21.15.156:0/585200018 shutdown_connections 2023-09-30T22:23:43.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:43.023+0000 7f1e8eb12700 1 -- 172.21.15.156:0/585200018 wait complete. 2023-09-30T22:23:43.036 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:43.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:43.086+0000 7fdaa3cf5700 1 -- 172.21.15.156:0/2787664568 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fda9c11eb20 con 0x7fda9c130670 2023-09-30T22:23:43.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:43.086+0000 7fda927fc700 1 -- 172.21.15.156:0/2787664568 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fda9c11eb20 con 0x7fda9c130670 2023-09-30T22:23:43.087 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:43.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:43.088+0000 7fdaa3cf5700 1 -- 172.21.15.156:0/2787664568 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda9c130670 msgr2=0x7fda9c1c8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:43.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:43.088+0000 7fdaa3cf5700 1 --2- 172.21.15.156:0/2787664568 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda9c130670 0x7fda9c1c8b80 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fda94009dd0 tx=0x7fda9400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:43.089+0000 7fdaa3cf5700 1 -- 172.21.15.156:0/2787664568 shutdown_connections 2023-09-30T22:23:43.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:43.089+0000 7fdaa3cf5700 1 --2- 172.21.15.156:0/2787664568 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fda9c130670 0x7fda9c1c8b80 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:43.089+0000 7fdaa3cf5700 1 --2- 172.21.15.156:0/2787664568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda9c0a0a30 0x7fda9c1c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:43.089+0000 7fdaa3cf5700 1 --2- 172.21.15.156:0/2787664568 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fda9c0a1340 0x7fda9c1c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:43.089+0000 7fdaa3cf5700 1 -- 172.21.15.156:0/2787664568 >> 172.21.15.156:0/2787664568 conn(0x7fda9c0a2980 msgr2=0x7fda9c1bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:43.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:43.089+0000 7fdaa3cf5700 1 -- 172.21.15.156:0/2787664568 shutdown_connections 2023-09-30T22:23:43.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:43.089+0000 7fdaa3cf5700 1 -- 172.21.15.156:0/2787664568 wait complete. 2023-09-30T22:23:43.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:43.900 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:44.009 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:44.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.033+0000 7f7c82282700 1 Processor -- start 2023-09-30T22:23:44.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.033+0000 7f7c82282700 1 -- start start 2023-09-30T22:23:44.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.034+0000 7f7c82282700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7c7c09d860 0x7f7c7c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.034+0000 7f7c82282700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c7c130eb0 0x7f7c7c138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.034+0000 7f7c82282700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7c09aaa0 con 0x7f7c7c09e170 2023-09-30T22:23:44.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.034+0000 7f7c82282700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7c09f870 con 0x7f7c7c09d860 2023-09-30T22:23:44.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.034+0000 7f7c82282700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c09b360 con 0x7f7c7c130eb0 2023-09-30T22:23:44.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.034+0000 7f7c8081f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c7c130eb0 0x7f7c7c138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.034+0000 7f7c7bfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7c7c09d860 0x7f7c7c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.034+0000 7f7c8081f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c7c130eb0 0x7f7c7c138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33524/0 (socket says 172.21.15.156:33524) 2023-09-30T22:23:44.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.034+0000 7f7c7bfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7c7c09d860 0x7f7c7c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54472/0 (socket says 172.21.15.156:54472) 2023-09-30T22:23:44.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.034+0000 7f7c7b7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f7c7c09e170 0x7f7c7c1307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53620/0 (socket says 172.21.15.156:53620) 2023-09-30T22:23:44.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.034+0000 7f7c8081f700 1 -- 172.21.15.156:0/3184298296 learned_addr learned my addr 172.21.15.156:0/3184298296 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:44.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.034+0000 7f7c7bfff700 1 -- 172.21.15.156:0/3184298296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c7c130eb0 msgr2=0x7f7c7c138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:44.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.034+0000 7f7c7bfff700 1 --2- 172.21.15.156:0/3184298296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c7c130eb0 0x7f7c7c138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.034+0000 7f7c7bfff700 1 -- 172.21.15.156:0/3184298296 >> v1:172.21.15.156:6789/0 conn(0x7f7c7c09e170 legacy=0x7f7c7c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.034+0000 7f7c7bfff700 1 -- 172.21.15.156:0/3184298296 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7c09b620 con 0x7f7c7c09d860 2023-09-30T22:23:44.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.034+0000 7f7c8081f700 1 --2- 172.21.15.156:0/3184298296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c7c130eb0 0x7f7c7c138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:44.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.035+0000 7f7c7bfff700 1 --2- 172.21.15.156:0/3184298296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c7c09d860 0x7f7c7c09dc30 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00bae0 tx=0x7f7c6c00bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328b79c67ba27e06 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:44.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.035+0000 7f7c7affd700 1 -- 172.21.15.156:0/3184298296 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c00dc70 con 0x7f7c7c09d860 2023-09-30T22:23:44.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.035+0000 7f7c7affd700 1 -- 172.21.15.156:0/3184298296 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6c00ddd0 con 0x7f7c7c09d860 2023-09-30T22:23:44.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.035+0000 7f7c7affd700 1 -- 172.21.15.156:0/3184298296 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c010690 con 0x7f7c7c09d860 2023-09-30T22:23:44.037 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:44.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.036+0000 7f7c82282700 1 -- 172.21.15.156:0/3184298296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c7c09d860 msgr2=0x7f7c7c09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.036+0000 7f7c82282700 1 --2- 172.21.15.156:0/3184298296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c7c09d860 0x7f7c7c09dc30 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00bae0 tx=0x7f7c6c00bdf0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.036+0000 7f7c82282700 1 -- 172.21.15.156:0/3184298296 shutdown_connections 2023-09-30T22:23:44.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.036+0000 7f7c82282700 1 --2- 172.21.15.156:0/3184298296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c7c130eb0 0x7f7c7c138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.036+0000 7f7c82282700 1 --2- 172.21.15.156:0/3184298296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c7c09d860 0x7f7c7c09dc30 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.036+0000 7f7c82282700 1 -- 172.21.15.156:0/3184298296 >> 172.21.15.156:0/3184298296 conn(0x7f7c7c099c40 msgr2=0x7f7c7c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:44.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.036+0000 7f7c82282700 1 -- 172.21.15.156:0/3184298296 shutdown_connections 2023-09-30T22:23:44.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.036+0000 7f7c82282700 1 -- 172.21.15.156:0/3184298296 wait complete. 2023-09-30T22:23:44.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.037+0000 7f7c82282700 1 Processor -- start 2023-09-30T22:23:44.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.037+0000 7f7c82282700 1 -- start start 2023-09-30T22:23:44.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.038+0000 7f7c82282700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c7c09d860 0x7f7c7c11e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.038+0000 7f7c82282700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c7c09e170 0x7f7c7c11eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.038+0000 7f7c82282700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c7c130eb0 0x7f7c7c11f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.038+0000 7f7c82282700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c1220d0 con 0x7f7c7c09e170 2023-09-30T22:23:44.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.038+0000 7f7c82282700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c11fa40 con 0x7f7c7c09d860 2023-09-30T22:23:44.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.038+0000 7f7c82282700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c1201c0 con 0x7f7c7c130eb0 2023-09-30T22:23:44.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.038+0000 7f7c7bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c7c09d860 0x7f7c7c11e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.038+0000 7f7c7b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c7c09e170 0x7f7c7c11eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.038+0000 7f7c8081f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c7c130eb0 0x7f7c7c11f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.038+0000 7f7c7b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c7c09e170 0x7f7c7c11eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54480/0 (socket says 172.21.15.156:54480) 2023-09-30T22:23:44.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.038+0000 7f7c7bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c7c09d860 0x7f7c7c11e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33526/0 (socket says 172.21.15.156:33526) 2023-09-30T22:23:44.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.038+0000 7f7c7b7fe700 1 -- 172.21.15.156:0/1818728436 learned_addr learned my addr 172.21.15.156:0/1818728436 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:44.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.039+0000 7f7c7b7fe700 1 -- 172.21.15.156:0/1818728436 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c7c130eb0 msgr2=0x7f7c7c11f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.039+0000 7f7c7b7fe700 1 --2- 172.21.15.156:0/1818728436 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c7c130eb0 0x7f7c7c11f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.039+0000 7f7c7b7fe700 1 -- 172.21.15.156:0/1818728436 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c7c09d860 msgr2=0x7f7c7c11e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.039+0000 7f7c7b7fe700 1 --2- 172.21.15.156:0/1818728436 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c7c09d860 0x7f7c7c11e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.039+0000 7f7c7b7fe700 1 -- 172.21.15.156:0/1818728436 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c74009b30 con 0x7f7c7c09e170 2023-09-30T22:23:44.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.039+0000 7f7c7bfff700 1 --2- 172.21.15.156:0/1818728436 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c7c09d860 0x7f7c7c11e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:44.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.039+0000 7f7c8081f700 1 --2- 172.21.15.156:0/1818728436 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c7c130eb0 0x7f7c7c11f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:44.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.039+0000 7f7c7b7fe700 1 --2- 172.21.15.156:0/1818728436 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c7c09e170 0x7f7c7c11eb40 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000c520 tx=0x7f7c7000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:44.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.039+0000 7f7c78ff9700 1 -- 172.21.15.156:0/1818728436 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c70005cb0 con 0x7f7c7c09e170 2023-09-30T22:23:44.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.039+0000 7f7c78ff9700 1 -- 172.21.15.156:0/1818728436 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c70005e10 con 0x7f7c7c09e170 2023-09-30T22:23:44.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.039+0000 7f7c78ff9700 1 -- 172.21.15.156:0/1818728436 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c700072d0 con 0x7f7c7c09e170 2023-09-30T22:23:44.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.039+0000 7f7c82282700 1 -- 172.21.15.156:0/1818728436 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6c00b740 con 0x7f7c7c09e170 2023-09-30T22:23:44.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.039+0000 7f7c82282700 1 -- 172.21.15.156:0/1818728436 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7c121b30 con 0x7f7c7c09e170 2023-09-30T22:23:44.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.040+0000 7f7c78ff9700 1 -- 172.21.15.156:0/1818728436 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c70007430 con 0x7f7c7c09e170 2023-09-30T22:23:44.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.040+0000 7f7c78ff9700 1 -- 172.21.15.156:0/1818728436 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7c7003ea00 con 0x7f7c7c09e170 2023-09-30T22:23:44.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.040+0000 7f7c82282700 1 -- 172.21.15.156:0/1818728436 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7c04f2a0 con 0x7f7c7c09e170 2023-09-30T22:23:44.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.045+0000 7f7c78ff9700 1 -- 172.21.15.156:0/1818728436 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c70017080 con 0x7f7c7c09e170 2023-09-30T22:23:44.102 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:44.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.140+0000 7f77b8c42700 1 Processor -- start 2023-09-30T22:23:44.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.140+0000 7f77b8c42700 1 -- start start 2023-09-30T22:23:44.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.141+0000 7f77b8c42700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77b4099e20 0x7f77b409a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.141+0000 7f77b8c42700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f77b409a730 0x7f77b4130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.141+0000 7f77b8c42700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f77b4130890 0x7f77b4130d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.141+0000 7f77b8c42700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b409bf50 con 0x7f77b4130890 2023-09-30T22:23:44.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.141+0000 7f77b8c42700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b4099a60 con 0x7f77b4099e20 2023-09-30T22:23:44.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.141+0000 7f77b8c42700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77b409b230 con 0x7f77b409a730 2023-09-30T22:23:44.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.141+0000 7f77b1d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f77b409a730 0x7f77b4130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.141+0000 7f77b259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77b4099e20 0x7f77b409a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.141+0000 7f77b1d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f77b409a730 0x7f77b4130350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33706/0 (socket says 172.21.15.156:33706) 2023-09-30T22:23:44.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.141+0000 7f77b1d9b700 1 -- 172.21.15.156:0/3843001226 learned_addr learned my addr 172.21.15.156:0/3843001226 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:44.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.141+0000 7f77b2d9d700 1 --2- 172.21.15.156:0/3843001226 >> v2:172.21.15.156:3300/0 conn(0x7f77b4130890 0x7f77b4130d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.141+0000 7f77b259c700 1 -- 172.21.15.156:0/3843001226 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f77b409a730 msgr2=0x7f77b4130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:44.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.141+0000 7f77b259c700 1 --2- 172.21.15.156:0/3843001226 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f77b409a730 0x7f77b4130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.141+0000 7f77b259c700 1 -- 172.21.15.156:0/3843001226 >> v2:172.21.15.156:3300/0 conn(0x7f77b4130890 msgr2=0x7f77b4130d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:44.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.141+0000 7f77b259c700 1 --2- 172.21.15.156:0/3843001226 >> v2:172.21.15.156:3300/0 conn(0x7f77b4130890 0x7f77b4130d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.141+0000 7f77b259c700 1 -- 172.21.15.156:0/3843001226 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b409bb90 con 0x7f77b4099e20 2023-09-30T22:23:44.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.141+0000 7f77b259c700 1 --2- 172.21.15.156:0/3843001226 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77b4099e20 0x7f77b409a1f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f77a4009820 tx=0x7f77a4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2ef66edfae2f3a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:44.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.142+0000 7f77b159a700 1 -- 172.21.15.156:0/3843001226 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a4005e30 con 0x7f77b4099e20 2023-09-30T22:23:44.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.142+0000 7f77b159a700 1 -- 172.21.15.156:0/3843001226 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a4006030 con 0x7f77b4099e20 2023-09-30T22:23:44.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.142+0000 7f77b159a700 1 -- 172.21.15.156:0/3843001226 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a40063c0 con 0x7f77b4099e20 2023-09-30T22:23:44.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.142+0000 7f77b8c42700 1 -- 172.21.15.156:0/3843001226 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77b4099e20 msgr2=0x7f77b409a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.142+0000 7f77b8c42700 1 --2- 172.21.15.156:0/3843001226 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77b4099e20 0x7f77b409a1f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f77a4009820 tx=0x7f77a4009b30 comp rx=0 tx=0).stop 2023-09-30T22:23:44.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.142+0000 7f77b8c42700 1 -- 172.21.15.156:0/3843001226 shutdown_connections 2023-09-30T22:23:44.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.142+0000 7f77b8c42700 1 --2- 172.21.15.156:0/3843001226 >> v2:172.21.15.156:3300/0 conn(0x7f77b4130890 0x7f77b4130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.142+0000 7f77b8c42700 1 --2- 172.21.15.156:0/3843001226 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77b4099e20 0x7f77b409a1f0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.142+0000 7f77b8c42700 1 --2- 172.21.15.156:0/3843001226 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f77b409a730 0x7f77b4130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.142+0000 7f77b8c42700 1 -- 172.21.15.156:0/3843001226 >> 172.21.15.156:0/3843001226 conn(0x7f77b40a2980 msgr2=0x7f77b40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:44.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.143+0000 7f77b8c42700 1 -- 172.21.15.156:0/3843001226 shutdown_connections 2023-09-30T22:23:44.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.143+0000 7f77b8c42700 1 -- 172.21.15.156:0/3843001226 wait complete. 2023-09-30T22:23:44.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.144+0000 7f77b8c42700 1 Processor -- start 2023-09-30T22:23:44.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.144+0000 7f77b8c42700 1 -- start start 2023-09-30T22:23:44.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.145+0000 7f77b8c42700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77b4099e20 0x7f77b4118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.145+0000 7f77b8c42700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f77b409a730 0x7f77b4119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.145+0000 7f77b8c42700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77b4130890 0x7f77b4119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.145+0000 7f77b8c42700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b409d9e0 con 0x7f77b4099e20 2023-09-30T22:23:44.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.145+0000 7f77b8c42700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b411cb50 con 0x7f77b4130890 2023-09-30T22:23:44.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.145+0000 7f77b8c42700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77b411bbf0 con 0x7f77b409a730 2023-09-30T22:23:44.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.145+0000 7f77b2d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77b4130890 0x7f77b4119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.145+0000 7f77b2d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77b4130890 0x7f77b4119870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33538/0 (socket says 172.21.15.156:33538) 2023-09-30T22:23:44.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.145+0000 7f77b2d9d700 1 -- 172.21.15.156:0/2793493413 learned_addr learned my addr 172.21.15.156:0/2793493413 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:44.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.145+0000 7f77b1d9b700 1 --2- 172.21.15.156:0/2793493413 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f77b409a730 0x7f77b4119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.145+0000 7f77b259c700 1 --2- 172.21.15.156:0/2793493413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77b4099e20 0x7f77b4118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.145+0000 7f77b1d9b700 1 -- 172.21.15.156:0/2793493413 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77b4130890 msgr2=0x7f77b4119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.145+0000 7f77b1d9b700 1 --2- 172.21.15.156:0/2793493413 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77b4130890 0x7f77b4119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.145+0000 7f77b1d9b700 1 -- 172.21.15.156:0/2793493413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77b4099e20 msgr2=0x7f77b4118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.145+0000 7f77b1d9b700 1 --2- 172.21.15.156:0/2793493413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77b4099e20 0x7f77b4118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.145+0000 7f77b1d9b700 1 -- 172.21.15.156:0/2793493413 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a4009430 con 0x7f77b409a730 2023-09-30T22:23:44.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.146+0000 7f77b2d9d700 1 --2- 172.21.15.156:0/2793493413 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77b4130890 0x7f77b4119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:44.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.146+0000 7f77b259c700 1 --2- 172.21.15.156:0/2793493413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77b4099e20 0x7f77b4118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:44.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.146+0000 7f77b1d9b700 1 --2- 172.21.15.156:0/2793493413 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f77b409a730 0x7f77b4119330 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f77a800e8e0 tx=0x7f77a800ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:44.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.146+0000 7f77a2ffd700 1 -- 172.21.15.156:0/2793493413 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a8011780 con 0x7f77b409a730 2023-09-30T22:23:44.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.146+0000 7f77a2ffd700 1 -- 172.21.15.156:0/2793493413 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a80118e0 con 0x7f77b409a730 2023-09-30T22:23:44.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.146+0000 7f77a2ffd700 1 -- 172.21.15.156:0/2793493413 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a8011c50 con 0x7f77b409a730 2023-09-30T22:23:44.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.146+0000 7f77b8c42700 1 -- 172.21.15.156:0/2793493413 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b411b540 con 0x7f77b409a730 2023-09-30T22:23:44.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.146+0000 7f77b8c42700 1 -- 172.21.15.156:0/2793493413 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b411b080 con 0x7f77b409a730 2023-09-30T22:23:44.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.147+0000 7f77a2ffd700 1 -- 172.21.15.156:0/2793493413 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f77a8019440 con 0x7f77b409a730 2023-09-30T22:23:44.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.147+0000 7f77a2ffd700 1 -- 172.21.15.156:0/2793493413 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f77a80412b0 con 0x7f77b409a730 2023-09-30T22:23:44.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.147+0000 7f77b8c42700 1 -- 172.21.15.156:0/2793493413 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b411bd30 con 0x7f77b409a730 2023-09-30T22:23:44.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.152+0000 7f77a2ffd700 1 -- 172.21.15.156:0/2793493413 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f77a801e070 con 0x7f77b409a730 2023-09-30T22:23:44.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.169+0000 7f49037fb700 1 Processor -- start 2023-09-30T22:23:44.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.169+0000 7f49037fb700 1 -- start start 2023-09-30T22:23:44.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.169+0000 7f49037fb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48fc133900 0x7f48fc133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.169+0000 7f49037fb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48fc134210 0x7f48fc0a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.169+0000 7f49037fb700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48fc09a760 con 0x7f48fc0a0ee0 2023-09-30T22:23:44.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.169+0000 7f49037fb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc1336e0 con 0x7f48fc134210 2023-09-30T22:23:44.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.169+0000 7f49037fb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc09a080 con 0x7f48fc133900 2023-09-30T22:23:44.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.170+0000 7f4900d96700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48fc134210 0x7f48fc0a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.170+0000 7f4901d98700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f48fc0a0ee0 0x7f48fc13a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53626/0 (socket says 172.21.15.156:53626) 2023-09-30T22:23:44.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.170+0000 7f4901d98700 1 -- 172.21.15.156:0/2715324625 learned_addr learned my addr 172.21.15.156:0/2715324625 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:44.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.170+0000 7f4901597700 1 --2- 172.21.15.156:0/2715324625 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48fc133900 0x7f48fc133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.170+0000 7f48f3fff700 1 -- 172.21.15.156:0/2715324625 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541114538 0 0) 0x7f48fc09a760 con 0x7f48fc0a0ee0 2023-09-30T22:23:44.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.170+0000 7f4901597700 1 -- 172.21.15.156:0/2715324625 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48fc134210 msgr2=0x7f48fc0a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:44.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.170+0000 7f4901597700 1 --2- 172.21.15.156:0/2715324625 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48fc134210 0x7f48fc0a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.170+0000 7f4901597700 1 -- 172.21.15.156:0/2715324625 >> v1:172.21.15.156:6789/0 conn(0x7f48fc0a0ee0 legacy=0x7f48fc13a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.170+0000 7f4901597700 1 -- 172.21.15.156:0/2715324625 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc0a23e0 con 0x7f48fc133900 2023-09-30T22:23:44.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.170+0000 7f4900d96700 1 --2- 172.21.15.156:0/2715324625 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48fc134210 0x7f48fc0a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:44.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.170+0000 7f4901597700 1 --2- 172.21.15.156:0/2715324625 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48fc133900 0x7f48fc133cd0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f48f8009850 tx=0x7f48f8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a8eec387031e0c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:44.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.171+0000 7f48f3fff700 1 -- 172.21.15.156:0/2715324625 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f8005e30 con 0x7f48fc133900 2023-09-30T22:23:44.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.171+0000 7f48f3fff700 1 -- 172.21.15.156:0/2715324625 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f8006030 con 0x7f48fc133900 2023-09-30T22:23:44.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.171+0000 7f48f3fff700 1 -- 172.21.15.156:0/2715324625 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f80063e0 con 0x7f48fc133900 2023-09-30T22:23:44.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.171+0000 7f49037fb700 1 -- 172.21.15.156:0/2715324625 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48fc133900 msgr2=0x7f48fc133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.171+0000 7f49037fb700 1 --2- 172.21.15.156:0/2715324625 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48fc133900 0x7f48fc133cd0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f48f8009850 tx=0x7f48f8009b60 comp rx=0 tx=0).stop 2023-09-30T22:23:44.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.171+0000 7f49037fb700 1 -- 172.21.15.156:0/2715324625 shutdown_connections 2023-09-30T22:23:44.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.171+0000 7f49037fb700 1 --2- 172.21.15.156:0/2715324625 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48fc133900 0x7f48fc133cd0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.171+0000 7f49037fb700 1 --2- 172.21.15.156:0/2715324625 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48fc134210 0x7f48fc0a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.171+0000 7f49037fb700 1 -- 172.21.15.156:0/2715324625 >> 172.21.15.156:0/2715324625 conn(0x7f48fc0a2980 msgr2=0x7f48fc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:44.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.171+0000 7f49037fb700 1 -- 172.21.15.156:0/2715324625 shutdown_connections 2023-09-30T22:23:44.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.171+0000 7f49037fb700 1 -- 172.21.15.156:0/2715324625 wait complete. 2023-09-30T22:23:44.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.172+0000 7f49037fb700 1 Processor -- start 2023-09-30T22:23:44.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.172+0000 7f49037fb700 1 -- start start 2023-09-30T22:23:44.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.173+0000 7f49037fb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48fc0a0ee0 0x7f48fc11d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.173+0000 7f49037fb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48fc133900 0x7f48fc11dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.173+0000 7f49037fb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48fc134210 0x7f48fc11e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.173+0000 7f49037fb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc11ec70 con 0x7f48fc0a0ee0 2023-09-30T22:23:44.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.173+0000 7f49037fb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc11f3f0 con 0x7f48fc133900 2023-09-30T22:23:44.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.173+0000 7f49037fb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc11fa10 con 0x7f48fc134210 2023-09-30T22:23:44.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.173+0000 7f4901d98700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48fc134210 0x7f48fc11e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.173+0000 7f4901d98700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48fc134210 0x7f48fc11e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33716/0 (socket says 172.21.15.156:33716) 2023-09-30T22:23:44.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.173+0000 7f4901d98700 1 -- 172.21.15.156:0/3443706586 learned_addr learned my addr 172.21.15.156:0/3443706586 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:44.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.173+0000 7f4900d96700 1 --2- 172.21.15.156:0/3443706586 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48fc133900 0x7f48fc11dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.173+0000 7f4901597700 1 --2- 172.21.15.156:0/3443706586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48fc0a0ee0 0x7f48fc11d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.173+0000 7f4901d98700 1 -- 172.21.15.156:0/3443706586 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48fc133900 msgr2=0x7f48fc11dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.173+0000 7f4901d98700 1 --2- 172.21.15.156:0/3443706586 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48fc133900 0x7f48fc11dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.173+0000 7f4901d98700 1 -- 172.21.15.156:0/3443706586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48fc0a0ee0 msgr2=0x7f48fc11d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.173+0000 7f4901d98700 1 --2- 172.21.15.156:0/3443706586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48fc0a0ee0 0x7f48fc11d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.173+0000 7f4901d98700 1 -- 172.21.15.156:0/3443706586 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ec0094a0 con 0x7f48fc134210 2023-09-30T22:23:44.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.174+0000 7f4901d98700 1 --2- 172.21.15.156:0/3443706586 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48fc134210 0x7f48fc11e260 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f48f400cc70 tx=0x7f48f400cf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:44.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.174+0000 7f48f1ffb700 1 -- 172.21.15.156:0/3443706586 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f400ab70 con 0x7f48fc134210 2023-09-30T22:23:44.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.174+0000 7f49037fb700 1 -- 172.21.15.156:0/3443706586 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f8009430 con 0x7f48fc134210 2023-09-30T22:23:44.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.174+0000 7f48f1ffb700 1 -- 172.21.15.156:0/3443706586 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f400acf0 con 0x7f48fc134210 2023-09-30T22:23:44.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.174+0000 7f48f1ffb700 1 -- 172.21.15.156:0/3443706586 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f4007310 con 0x7f48fc134210 2023-09-30T22:23:44.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.174+0000 7f49037fb700 1 -- 172.21.15.156:0/3443706586 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48fc132bd0 con 0x7f48fc134210 2023-09-30T22:23:44.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.175+0000 7f48f1ffb700 1 -- 172.21.15.156:0/3443706586 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f48f4007470 con 0x7f48fc134210 2023-09-30T22:23:44.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.175+0000 7f49037fb700 1 -- 172.21.15.156:0/3443706586 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48fc09a320 con 0x7f48fc134210 2023-09-30T22:23:44.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.175+0000 7f48f1ffb700 1 -- 172.21.15.156:0/3443706586 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f48f403f570 con 0x7f48fc134210 2023-09-30T22:23:44.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.184+0000 7f48f1ffb700 1 -- 172.21.15.156:0/3443706586 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f48f400ae60 con 0x7f48fc134210 2023-09-30T22:23:44.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.235+0000 7f5ac76e5700 1 Processor -- start 2023-09-30T22:23:44.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.235+0000 7f5ac76e5700 1 -- start start 2023-09-30T22:23:44.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.235+0000 7f5ac76e5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5ac009d860 0x7f5ac009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.236+0000 7f5ac76e5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ac0130eb0 0x7f5ac0138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.236+0000 7f5ac76e5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ac009aaa0 con 0x7f5ac009e170 2023-09-30T22:23:44.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.236+0000 7f5ac76e5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac009f870 con 0x7f5ac009d860 2023-09-30T22:23:44.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.236+0000 7f5ac76e5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac009b360 con 0x7f5ac0130eb0 2023-09-30T22:23:44.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.236+0000 7f5ac5481700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5ac009d860 0x7f5ac009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.236+0000 7f5ac4c80700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f5ac009e170 0x7f5ac01307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53630/0 (socket says 172.21.15.156:53630) 2023-09-30T22:23:44.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.236+0000 7f5ac5481700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5ac009d860 0x7f5ac009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54526/0 (socket says 172.21.15.156:54526) 2023-09-30T22:23:44.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.236+0000 7f5ac4c80700 1 -- 172.21.15.156:0/2165698438 learned_addr learned my addr 172.21.15.156:0/2165698438 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:44.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.236+0000 7f5ac5c82700 1 --2- 172.21.15.156:0/2165698438 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ac0130eb0 0x7f5ac0138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.236+0000 7f5ac5c82700 1 -- 172.21.15.156:0/2165698438 >> v2:172.21.15.156:3300/0 conn(0x7f5ac009d860 msgr2=0x7f5ac009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:44.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.236+0000 7f5ac5c82700 1 --2- 172.21.15.156:0/2165698438 >> v2:172.21.15.156:3300/0 conn(0x7f5ac009d860 0x7f5ac009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.236+0000 7f5ac5c82700 1 -- 172.21.15.156:0/2165698438 >> v1:172.21.15.156:6789/0 conn(0x7f5ac009e170 legacy=0x7f5ac01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.236+0000 7f5ac5c82700 1 -- 172.21.15.156:0/2165698438 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac009b620 con 0x7f5ac0130eb0 2023-09-30T22:23:44.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.236+0000 7f5ac5481700 1 --2- 172.21.15.156:0/2165698438 >> v2:172.21.15.156:3300/0 conn(0x7f5ac009d860 0x7f5ac009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:44.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.236+0000 7f5ac5c82700 1 --2- 172.21.15.156:0/2165698438 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ac0130eb0 0x7f5ac0138a00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5ab800f370 tx=0x7f5ab800f680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41afda1ff974b73a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:44.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.236+0000 7f5ab7fff700 1 -- 172.21.15.156:0/2165698438 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8012070 con 0x7f5ac0130eb0 2023-09-30T22:23:44.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.237+0000 7f5ab7fff700 1 -- 172.21.15.156:0/2165698438 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab800fe70 con 0x7f5ac0130eb0 2023-09-30T22:23:44.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.237+0000 7f5ab7fff700 1 -- 172.21.15.156:0/2165698438 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab800d2f0 con 0x7f5ac0130eb0 2023-09-30T22:23:44.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.237+0000 7f5ac76e5700 1 -- 172.21.15.156:0/2165698438 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ac0130eb0 msgr2=0x7f5ac0138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.237+0000 7f5ac76e5700 1 --2- 172.21.15.156:0/2165698438 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ac0130eb0 0x7f5ac0138a00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5ab800f370 tx=0x7f5ab800f680 comp rx=0 tx=0).stop 2023-09-30T22:23:44.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.237+0000 7f5ac76e5700 1 -- 172.21.15.156:0/2165698438 shutdown_connections 2023-09-30T22:23:44.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.237+0000 7f5ac76e5700 1 --2- 172.21.15.156:0/2165698438 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ac0130eb0 0x7f5ac0138a00 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.237+0000 7f5ac76e5700 1 --2- 172.21.15.156:0/2165698438 >> v2:172.21.15.156:3300/0 conn(0x7f5ac009d860 0x7f5ac009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.237+0000 7f5ac76e5700 1 -- 172.21.15.156:0/2165698438 >> 172.21.15.156:0/2165698438 conn(0x7f5ac0099c40 msgr2=0x7f5ac00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:44.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.237+0000 7f5ac76e5700 1 -- 172.21.15.156:0/2165698438 shutdown_connections 2023-09-30T22:23:44.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.237+0000 7f5ac76e5700 1 -- 172.21.15.156:0/2165698438 wait complete. 2023-09-30T22:23:44.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.238+0000 7f5ac76e5700 1 Processor -- start 2023-09-30T22:23:44.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.238+0000 7f5ac76e5700 1 -- start start 2023-09-30T22:23:44.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.239+0000 7f5ac76e5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ac009d860 0x7f5ac011e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.239+0000 7f5ac76e5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ac009e170 0x7f5ac011eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.239+0000 7f5ac76e5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ac0130eb0 0x7f5ac011f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.239+0000 7f5ac76e5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac011fb20 con 0x7f5ac0130eb0 2023-09-30T22:23:44.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.239+0000 7f5ac76e5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac0121cb0 con 0x7f5ac009d860 2023-09-30T22:23:44.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.239+0000 7f5ac76e5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac0121e90 con 0x7f5ac009e170 2023-09-30T22:23:44.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.239+0000 7f5ac5481700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ac009d860 0x7f5ac011e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.239+0000 7f5ac5481700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ac009d860 0x7f5ac011e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33564/0 (socket says 172.21.15.156:33564) 2023-09-30T22:23:44.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.239+0000 7f5ac5481700 1 -- 172.21.15.156:0/1001193319 learned_addr learned my addr 172.21.15.156:0/1001193319 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:44.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.239+0000 7f5ac4c80700 1 --2- 172.21.15.156:0/1001193319 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ac009e170 0x7f5ac011eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.239+0000 7f5ac5c82700 1 --2- 172.21.15.156:0/1001193319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ac0130eb0 0x7f5ac011f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.239+0000 7f5ac5481700 1 -- 172.21.15.156:0/1001193319 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ac009e170 msgr2=0x7f5ac011eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.239+0000 7f5ac5481700 1 --2- 172.21.15.156:0/1001193319 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ac009e170 0x7f5ac011eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.239+0000 7f5ac5481700 1 -- 172.21.15.156:0/1001193319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ac0130eb0 msgr2=0x7f5ac011f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.239+0000 7f5ac5481700 1 --2- 172.21.15.156:0/1001193319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ac0130eb0 0x7f5ac011f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.239+0000 7f5ac5481700 1 -- 172.21.15.156:0/1001193319 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5abc0094a0 con 0x7f5ac009d860 2023-09-30T22:23:44.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.239+0000 7f5ac5c82700 1 --2- 172.21.15.156:0/1001193319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ac0130eb0 0x7f5ac011f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:23:44.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.239+0000 7f5ac5481700 1 --2- 172.21.15.156:0/1001193319 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ac009d860 0x7f5ac011e650 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5abc00ebe0 tx=0x7f5abc009ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:44.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.239+0000 7f5ab5ffb700 1 -- 172.21.15.156:0/1001193319 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc00c910 con 0x7f5ac009d860 2023-09-30T22:23:44.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.240+0000 7f5ab5ffb700 1 -- 172.21.15.156:0/1001193319 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5abc00ca70 con 0x7f5ac009d860 2023-09-30T22:23:44.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.240+0000 7f5ac76e5700 1 -- 172.21.15.156:0/1001193319 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab800f050 con 0x7f5ac009d860 2023-09-30T22:23:44.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.240+0000 7f5ab5ffb700 1 -- 172.21.15.156:0/1001193319 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc00cde0 con 0x7f5ac009d860 2023-09-30T22:23:44.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.240+0000 7f5ac76e5700 1 -- 172.21.15.156:0/1001193319 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac0120a50 con 0x7f5ac009d860 2023-09-30T22:23:44.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.241+0000 7f5ab5ffb700 1 -- 172.21.15.156:0/1001193319 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5abc013470 con 0x7f5ac009d860 2023-09-30T22:23:44.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.241+0000 7f5ac76e5700 1 -- 172.21.15.156:0/1001193319 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac004f2a0 con 0x7f5ac009d860 2023-09-30T22:23:44.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.241+0000 7f5ab5ffb700 1 -- 172.21.15.156:0/1001193319 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5abc03f930 con 0x7f5ac009d860 2023-09-30T22:23:44.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.245+0000 7f5ab5ffb700 1 -- 172.21.15.156:0/1001193319 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5abc0232f0 con 0x7f5ac009d860 2023-09-30T22:23:44.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.247+0000 7f7c82282700 1 -- 172.21.15.156:0/1818728436 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7c7c120710 con 0x7f7c7c09e170 2023-09-30T22:23:44.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.248+0000 7f7c78ff9700 1 -- 172.21.15.156:0/1818728436 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c7001b3b0 con 0x7f7c7c09e170 2023-09-30T22:23:44.248 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:44.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.251+0000 7f7c82282700 1 -- 172.21.15.156:0/1818728436 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c7c09e170 msgr2=0x7f7c7c11eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.251+0000 7f7c82282700 1 --2- 172.21.15.156:0/1818728436 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c7c09e170 0x7f7c7c11eb40 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000c520 tx=0x7f7c7000c830 comp rx=0 tx=0).stop 2023-09-30T22:23:44.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.251+0000 7f7c82282700 1 -- 172.21.15.156:0/1818728436 shutdown_connections 2023-09-30T22:23:44.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.251+0000 7f7c82282700 1 --2- 172.21.15.156:0/1818728436 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c7c130eb0 0x7f7c7c11f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.251+0000 7f7c82282700 1 --2- 172.21.15.156:0/1818728436 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c7c09d860 0x7f7c7c11e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.251+0000 7f7c82282700 1 --2- 172.21.15.156:0/1818728436 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c7c09e170 0x7f7c7c11eb40 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.251+0000 7f7c82282700 1 -- 172.21.15.156:0/1818728436 >> 172.21.15.156:0/1818728436 conn(0x7f7c7c099c40 msgr2=0x7f7c7c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:44.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.251+0000 7f7c82282700 1 -- 172.21.15.156:0/1818728436 shutdown_connections 2023-09-30T22:23:44.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.251+0000 7f7c82282700 1 -- 172.21.15.156:0/1818728436 wait complete. 2023-09-30T22:23:44.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:44.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.353+0000 7f77b8c42700 1 -- 172.21.15.156:0/2793493413 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f77b404f2a0 con 0x7f77b409a730 2023-09-30T22:23:44.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.354+0000 7f77a2ffd700 1 -- 172.21.15.156:0/2793493413 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f77a8011db0 con 0x7f77b409a730 2023-09-30T22:23:44.354 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:44.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.355+0000 7f77b8c42700 1 -- 172.21.15.156:0/2793493413 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f77b409a730 msgr2=0x7f77b4119330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.355+0000 7f77b8c42700 1 --2- 172.21.15.156:0/2793493413 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f77b409a730 0x7f77b4119330 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f77a800e8e0 tx=0x7f77a800ebf0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.356+0000 7f77b8c42700 1 -- 172.21.15.156:0/2793493413 shutdown_connections 2023-09-30T22:23:44.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.356+0000 7f77b8c42700 1 --2- 172.21.15.156:0/2793493413 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77b4130890 0x7f77b4119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.356+0000 7f77b8c42700 1 --2- 172.21.15.156:0/2793493413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77b4099e20 0x7f77b4118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.356+0000 7f77b8c42700 1 --2- 172.21.15.156:0/2793493413 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f77b409a730 0x7f77b4119330 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.356+0000 7f77b8c42700 1 -- 172.21.15.156:0/2793493413 >> 172.21.15.156:0/2793493413 conn(0x7f77b40a2980 msgr2=0x7f77b412d790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:44.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.356+0000 7f77b8c42700 1 -- 172.21.15.156:0/2793493413 shutdown_connections 2023-09-30T22:23:44.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.356+0000 7f77b8c42700 1 -- 172.21.15.156:0/2793493413 wait complete. 2023-09-30T22:23:44.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:44.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.381+0000 7f49037fb700 1 -- 172.21.15.156:0/3443706586 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f48fc11a590 con 0x7f48fc134210 2023-09-30T22:23:44.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.382+0000 7f48f1ffb700 1 -- 172.21.15.156:0/3443706586 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f48f4018030 con 0x7f48fc134210 2023-09-30T22:23:44.382 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:44.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.384+0000 7f49037fb700 1 -- 172.21.15.156:0/3443706586 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48fc134210 msgr2=0x7f48fc11e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.384+0000 7f49037fb700 1 --2- 172.21.15.156:0/3443706586 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48fc134210 0x7f48fc11e260 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f48f400cc70 tx=0x7f48f400cf80 comp rx=0 tx=0).stop 2023-09-30T22:23:44.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.384+0000 7f49037fb700 1 -- 172.21.15.156:0/3443706586 shutdown_connections 2023-09-30T22:23:44.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.384+0000 7f49037fb700 1 --2- 172.21.15.156:0/3443706586 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f48fc134210 0x7f48fc11e260 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.384+0000 7f49037fb700 1 --2- 172.21.15.156:0/3443706586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48fc0a0ee0 0x7f48fc11d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.384+0000 7f49037fb700 1 --2- 172.21.15.156:0/3443706586 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48fc133900 0x7f48fc11dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.384+0000 7f49037fb700 1 -- 172.21.15.156:0/3443706586 >> 172.21.15.156:0/3443706586 conn(0x7f48fc0a2980 msgr2=0x7f48fc1bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:44.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.384+0000 7f49037fb700 1 -- 172.21.15.156:0/3443706586 shutdown_connections 2023-09-30T22:23:44.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.384+0000 7f49037fb700 1 -- 172.21.15.156:0/3443706586 wait complete. 2023-09-30T22:23:44.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:44.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.443+0000 7f5ac76e5700 1 -- 172.21.15.156:0/1001193319 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5ac009cce0 con 0x7f5ac009d860 2023-09-30T22:23:44.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.443+0000 7f5ab5ffb700 1 -- 172.21.15.156:0/1001193319 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5abc021020 con 0x7f5ac009d860 2023-09-30T22:23:44.444 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:44.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.446+0000 7f5ac76e5700 1 -- 172.21.15.156:0/1001193319 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ac009d860 msgr2=0x7f5ac011e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.446+0000 7f5ac76e5700 1 --2- 172.21.15.156:0/1001193319 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ac009d860 0x7f5ac011e650 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5abc00ebe0 tx=0x7f5abc009ec0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.446+0000 7f5ac76e5700 1 -- 172.21.15.156:0/1001193319 shutdown_connections 2023-09-30T22:23:44.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.446+0000 7f5ac76e5700 1 --2- 172.21.15.156:0/1001193319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ac0130eb0 0x7f5ac011f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.446+0000 7f5ac76e5700 1 --2- 172.21.15.156:0/1001193319 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ac009d860 0x7f5ac011e650 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.446+0000 7f5ac76e5700 1 --2- 172.21.15.156:0/1001193319 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ac009e170 0x7f5ac011eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.446+0000 7f5ac76e5700 1 -- 172.21.15.156:0/1001193319 >> 172.21.15.156:0/1001193319 conn(0x7f5ac0099c40 msgr2=0x7f5ac00a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:44.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.446+0000 7f5ac76e5700 1 -- 172.21.15.156:0/1001193319 shutdown_connections 2023-09-30T22:23:44.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:44.446+0000 7f5ac76e5700 1 -- 172.21.15.156:0/1001193319 wait complete. 2023-09-30T22:23:44.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:45.265 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:45.370 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:45.398 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:45.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.402+0000 7f0c9173f700 1 Processor -- start 2023-09-30T22:23:45.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.402+0000 7f0c9173f700 1 -- start start 2023-09-30T22:23:45.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.402+0000 7f0c9173f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0c8c0a0b50 0x7f0c8c0a0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.403+0000 7f0c9173f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c8c0a2e10 0x7f0c8c0a1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.403+0000 7f0c9173f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c8c0a1e60 con 0x7f0c8c133ad0 2023-09-30T22:23:45.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.403+0000 7f0c9173f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c8c09aa00 con 0x7f0c8c0a0b50 2023-09-30T22:23:45.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.403+0000 7f0c9173f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c0a19a0 con 0x7f0c8c0a2e10 2023-09-30T22:23:45.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.403+0000 7f0c8affd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0c8c0a0b50 0x7f0c8c0a0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.403+0000 7f0c8a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c8c0a2e10 0x7f0c8c0a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.403+0000 7f0c8affd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0c8c0a0b50 0x7f0c8c0a0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54556/0 (socket says 172.21.15.156:54556) 2023-09-30T22:23:45.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.403+0000 7f0c8a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c8c0a2e10 0x7f0c8c0a1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33728/0 (socket says 172.21.15.156:33728) 2023-09-30T22:23:45.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.403+0000 7f0c8affd700 1 -- 172.21.15.156:0/975865944 learned_addr learned my addr 172.21.15.156:0/975865944 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:45.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.403+0000 7f0c8affd700 1 -- 172.21.15.156:0/975865944 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c8c0a2e10 msgr2=0x7f0c8c0a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:45.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.403+0000 7f0c8affd700 1 --2- 172.21.15.156:0/975865944 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c8c0a2e10 0x7f0c8c0a1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.403+0000 7f0c8affd700 1 -- 172.21.15.156:0/975865944 >> v1:172.21.15.156:6789/0 conn(0x7f0c8c133ad0 legacy=0x7f0c8c133f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:45.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.403+0000 7f0c8affd700 1 -- 172.21.15.156:0/975865944 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c09a5b0 con 0x7f0c8c0a0b50 2023-09-30T22:23:45.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.403+0000 7f0c8a7fc700 1 --2- 172.21.15.156:0/975865944 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c8c0a2e10 0x7f0c8c0a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:45.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.403+0000 7f0c8affd700 1 --2- 172.21.15.156:0/975865944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c8c0a0b50 0x7f0c8c0a0f20 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0098f0 tx=0x7f0c7c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aced260f5709ad8d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:45.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.403+0000 7f0c89ffb700 1 -- 172.21.15.156:0/975865944 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c011830 con 0x7f0c8c0a0b50 2023-09-30T22:23:45.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.403+0000 7f0c89ffb700 1 -- 172.21.15.156:0/975865944 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7c011990 con 0x7f0c8c0a0b50 2023-09-30T22:23:45.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.403+0000 7f0c89ffb700 1 -- 172.21.15.156:0/975865944 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c011d20 con 0x7f0c8c0a0b50 2023-09-30T22:23:45.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.404+0000 7f0c9173f700 1 -- 172.21.15.156:0/975865944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c8c0a0b50 msgr2=0x7f0c8c0a0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:45.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.404+0000 7f0c9173f700 1 --2- 172.21.15.156:0/975865944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c8c0a0b50 0x7f0c8c0a0f20 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0098f0 tx=0x7f0c7c009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:45.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.404+0000 7f0c9173f700 1 -- 172.21.15.156:0/975865944 shutdown_connections 2023-09-30T22:23:45.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.404+0000 7f0c9173f700 1 --2- 172.21.15.156:0/975865944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c8c0a0b50 0x7f0c8c0a0f20 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.404+0000 7f0c9173f700 1 --2- 172.21.15.156:0/975865944 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c8c0a2e10 0x7f0c8c0a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.404+0000 7f0c9173f700 1 -- 172.21.15.156:0/975865944 >> 172.21.15.156:0/975865944 conn(0x7f0c8c06c780 msgr2=0x7f0c8c06cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:45.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.405+0000 7f0c9173f700 1 -- 172.21.15.156:0/975865944 shutdown_connections 2023-09-30T22:23:45.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.405+0000 7f0c9173f700 1 -- 172.21.15.156:0/975865944 wait complete. 2023-09-30T22:23:45.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.406+0000 7f0c9173f700 1 Processor -- start 2023-09-30T22:23:45.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.406+0000 7f0c9173f700 1 -- start start 2023-09-30T22:23:45.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.407+0000 7f0c9173f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c8c0a0b50 0x7f0c8c1c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.407+0000 7f0c9173f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c8c0a2e10 0x7f0c8c1c5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.407+0000 7f0c9173f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c8c133ad0 0x7f0c8c1c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.407+0000 7f0c9173f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c121d10 con 0x7f0c8c133ad0 2023-09-30T22:23:45.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.407+0000 7f0c9173f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c121990 con 0x7f0c8c0a0b50 2023-09-30T22:23:45.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.407+0000 7f0c9173f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c1c5d70 con 0x7f0c8c0a2e10 2023-09-30T22:23:45.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.407+0000 7f0c8b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c8c133ad0 0x7f0c8c1c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.407+0000 7f0c8b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c8c133ad0 0x7f0c8c1c8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54572/0 (socket says 172.21.15.156:54572) 2023-09-30T22:23:45.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.407+0000 7f0c8b7fe700 1 -- 172.21.15.156:0/1593059768 learned_addr learned my addr 172.21.15.156:0/1593059768 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:45.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.407+0000 7f0c8a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c8c0a2e10 0x7f0c8c1c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.407+0000 7f0c8affd700 1 --2- 172.21.15.156:0/1593059768 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c8c0a0b50 0x7f0c8c1c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.407+0000 7f0c8a7fc700 1 -- 172.21.15.156:0/1593059768 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c8c0a0b50 msgr2=0x7f0c8c1c52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:45.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.407+0000 7f0c8a7fc700 1 --2- 172.21.15.156:0/1593059768 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c8c0a0b50 0x7f0c8c1c52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.407+0000 7f0c8a7fc700 1 -- 172.21.15.156:0/1593059768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c8c133ad0 msgr2=0x7f0c8c1c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:45.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.407+0000 7f0c8a7fc700 1 --2- 172.21.15.156:0/1593059768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c8c133ad0 0x7f0c8c1c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.407+0000 7f0c8a7fc700 1 -- 172.21.15.156:0/1593059768 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c800094a0 con 0x7f0c8c0a2e10 2023-09-30T22:23:45.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.407+0000 7f0c8affd700 1 --2- 172.21.15.156:0/1593059768 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c8c0a0b50 0x7f0c8c1c52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:45.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.408+0000 7f0c8a7fc700 1 --2- 172.21.15.156:0/1593059768 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c8c0a2e10 0x7f0c8c1c5830 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0c8000e9b0 tx=0x7f0c8000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:45.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.408+0000 7f0c737fe700 1 -- 172.21.15.156:0/1593059768 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8000ee50 con 0x7f0c8c0a2e10 2023-09-30T22:23:45.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.408+0000 7f0c737fe700 1 -- 172.21.15.156:0/1593059768 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8000c850 con 0x7f0c8c0a2e10 2023-09-30T22:23:45.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.408+0000 7f0c9173f700 1 -- 172.21.15.156:0/1593059768 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c7c009550 con 0x7f0c8c0a2e10 2023-09-30T22:23:45.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.408+0000 7f0c737fe700 1 -- 172.21.15.156:0/1593059768 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8000cc00 con 0x7f0c8c0a2e10 2023-09-30T22:23:45.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.408+0000 7f0c9173f700 1 -- 172.21.15.156:0/1593059768 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c8c09c730 con 0x7f0c8c0a2e10 2023-09-30T22:23:45.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.409+0000 7f0c737fe700 1 -- 172.21.15.156:0/1593059768 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c80013470 con 0x7f0c8c0a2e10 2023-09-30T22:23:45.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.409+0000 7f0c737fe700 1 -- 172.21.15.156:0/1593059768 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0c8003f710 con 0x7f0c8c0a2e10 2023-09-30T22:23:45.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.409+0000 7f0c9173f700 1 -- 172.21.15.156:0/1593059768 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c8c0a4440 con 0x7f0c8c0a2e10 2023-09-30T22:23:45.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.414+0000 7f0c737fe700 1 -- 172.21.15.156:0/1593059768 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c80017080 con 0x7f0c8c0a2e10 2023-09-30T22:23:45.458 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:45.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.515+0000 7f5a28dd4700 1 Processor -- start 2023-09-30T22:23:45.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.515+0000 7f5a28dd4700 1 -- start start 2023-09-30T22:23:45.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.516+0000 7f5a28dd4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a2406a770 0x7f5a2406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.516+0000 7f5a28dd4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5a24136cb0 0x7f5a24139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.516+0000 7f5a28dd4700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a2406e900 con 0x7f5a2409dec0 2023-09-30T22:23:45.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.516+0000 7f5a28dd4700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a2409d180 con 0x7f5a24136cb0 2023-09-30T22:23:45.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.516+0000 7f5a28dd4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2409e780 con 0x7f5a2406a770 2023-09-30T22:23:45.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.516+0000 7f5a21d9b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f5a2409dec0 0x7f5a2406b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53662/0 (socket says 172.21.15.156:53662) 2023-09-30T22:23:45.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.516+0000 7f5a21d9b700 1 -- 172.21.15.156:0/2657351959 learned_addr learned my addr 172.21.15.156:0/2657351959 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:45.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.516+0000 7f5a2259c700 1 --2- 172.21.15.156:0/2657351959 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a2406a770 0x7f5a2406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.516+0000 7f5a22d9d700 1 --2- 172.21.15.156:0/2657351959 >> v2:172.21.15.156:3300/0 conn(0x7f5a24136cb0 0x7f5a24139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.516+0000 7f5a2259c700 1 -- 172.21.15.156:0/2657351959 >> v2:172.21.15.156:3300/0 conn(0x7f5a24136cb0 msgr2=0x7f5a24139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:45.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.516+0000 7f5a2259c700 1 --2- 172.21.15.156:0/2657351959 >> v2:172.21.15.156:3300/0 conn(0x7f5a24136cb0 0x7f5a24139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.516+0000 7f5a2259c700 1 -- 172.21.15.156:0/2657351959 >> v1:172.21.15.156:6789/0 conn(0x7f5a2409dec0 legacy=0x7f5a2406b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:45.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.516+0000 7f5a2259c700 1 -- 172.21.15.156:0/2657351959 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2409d3c0 con 0x7f5a2406a770 2023-09-30T22:23:45.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.516+0000 7f5a2259c700 1 --2- 172.21.15.156:0/2657351959 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a2406a770 0x7f5a2406ab40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5a14009840 tx=0x7f5a14009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6524ddc41a2516a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:45.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.517+0000 7f5a2159a700 1 -- 172.21.15.156:0/2657351959 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a14011830 con 0x7f5a2406a770 2023-09-30T22:23:45.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.517+0000 7f5a2159a700 1 -- 172.21.15.156:0/2657351959 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a14011990 con 0x7f5a2406a770 2023-09-30T22:23:45.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.517+0000 7f5a2159a700 1 -- 172.21.15.156:0/2657351959 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a14011d20 con 0x7f5a2406a770 2023-09-30T22:23:45.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.517+0000 7f5a28dd4700 1 -- 172.21.15.156:0/2657351959 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a2406a770 msgr2=0x7f5a2406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:45.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.517+0000 7f5a28dd4700 1 --2- 172.21.15.156:0/2657351959 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a2406a770 0x7f5a2406ab40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5a14009840 tx=0x7f5a14009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:45.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.517+0000 7f5a28dd4700 1 -- 172.21.15.156:0/2657351959 shutdown_connections 2023-09-30T22:23:45.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.517+0000 7f5a28dd4700 1 --2- 172.21.15.156:0/2657351959 >> v2:172.21.15.156:3300/0 conn(0x7f5a24136cb0 0x7f5a24139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.517+0000 7f5a28dd4700 1 --2- 172.21.15.156:0/2657351959 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a2406a770 0x7f5a2406ab40 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.517+0000 7f5a28dd4700 1 -- 172.21.15.156:0/2657351959 >> 172.21.15.156:0/2657351959 conn(0x7f5a24099c40 msgr2=0x7f5a240a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:45.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.517+0000 7f5a28dd4700 1 -- 172.21.15.156:0/2657351959 shutdown_connections 2023-09-30T22:23:45.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.517+0000 7f5a28dd4700 1 -- 172.21.15.156:0/2657351959 wait complete. 2023-09-30T22:23:45.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.518+0000 7f5a28dd4700 1 Processor -- start 2023-09-30T22:23:45.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.519+0000 7f5a28dd4700 1 -- start start 2023-09-30T22:23:45.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.519+0000 7f5a28dd4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a2406a770 0x7f5a241c4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.519+0000 7f5a28dd4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a2409dec0 0x7f5a241c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.519+0000 7f5a28dd4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a24136cb0 0x7f5a241c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.519+0000 7f5a28dd4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a24136630 con 0x7f5a24136cb0 2023-09-30T22:23:45.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.519+0000 7f5a28dd4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a24136820 con 0x7f5a2406a770 2023-09-30T22:23:45.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.519+0000 7f5a28dd4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a24134410 con 0x7f5a2409dec0 2023-09-30T22:23:45.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.519+0000 7f5a2259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a2406a770 0x7f5a241c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.519+0000 7f5a2259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a2406a770 0x7f5a241c4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33592/0 (socket says 172.21.15.156:33592) 2023-09-30T22:23:45.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.519+0000 7f5a2259c700 1 -- 172.21.15.156:0/3070781917 learned_addr learned my addr 172.21.15.156:0/3070781917 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:45.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.519+0000 7f5a22d9d700 1 --2- 172.21.15.156:0/3070781917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a24136cb0 0x7f5a241c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.519+0000 7f5a21d9b700 1 --2- 172.21.15.156:0/3070781917 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a2409dec0 0x7f5a241c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.519+0000 7f5a22d9d700 1 -- 172.21.15.156:0/3070781917 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a2409dec0 msgr2=0x7f5a241c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:45.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.519+0000 7f5a22d9d700 1 --2- 172.21.15.156:0/3070781917 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a2409dec0 0x7f5a241c4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.520+0000 7f5a22d9d700 1 -- 172.21.15.156:0/3070781917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a2406a770 msgr2=0x7f5a241c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:45.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.520+0000 7f5a22d9d700 1 --2- 172.21.15.156:0/3070781917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a2406a770 0x7f5a241c4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.520+0000 7f5a22d9d700 1 -- 172.21.15.156:0/3070781917 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a140094a0 con 0x7f5a24136cb0 2023-09-30T22:23:45.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.520+0000 7f5a2259c700 1 --2- 172.21.15.156:0/3070781917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a2406a770 0x7f5a241c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:45.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.520+0000 7f5a22d9d700 1 --2- 172.21.15.156:0/3070781917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a24136cb0 0x7f5a241c4c80 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c012420 tx=0x7f5a1c012730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:45.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.520+0000 7f5a12ffd700 1 -- 172.21.15.156:0/3070781917 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c00d0d0 con 0x7f5a24136cb0 2023-09-30T22:23:45.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.520+0000 7f5a12ffd700 1 -- 172.21.15.156:0/3070781917 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1c013040 con 0x7f5a24136cb0 2023-09-30T22:23:45.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.520+0000 7f5a28dd4700 1 -- 172.21.15.156:0/3070781917 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a240a3400 con 0x7f5a24136cb0 2023-09-30T22:23:45.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.520+0000 7f5a12ffd700 1 -- 172.21.15.156:0/3070781917 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c00d470 con 0x7f5a24136cb0 2023-09-30T22:23:45.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.520+0000 7f5a28dd4700 1 -- 172.21.15.156:0/3070781917 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a24071d40 con 0x7f5a24136cb0 2023-09-30T22:23:45.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.521+0000 7f5a12ffd700 1 -- 172.21.15.156:0/3070781917 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5a1c00b740 con 0x7f5a24136cb0 2023-09-30T22:23:45.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.521+0000 7f5a12ffd700 1 -- 172.21.15.156:0/3070781917 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5a1c043fa0 con 0x7f5a24136cb0 2023-09-30T22:23:45.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.521+0000 7f5a28dd4700 1 -- 172.21.15.156:0/3070781917 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a241351b0 con 0x7f5a24136cb0 2023-09-30T22:23:45.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.526+0000 7f5a12ffd700 1 -- 172.21.15.156:0/3070781917 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5a1c018480 con 0x7f5a24136cb0 2023-09-30T22:23:45.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.540+0000 7f889bf50700 1 Processor -- start 2023-09-30T22:23:45.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.540+0000 7f889bf50700 1 -- start start 2023-09-30T22:23:45.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.541+0000 7f889bf50700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f889409e870 0x7f889409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.541+0000 7f889bf50700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f889409f180 0x7f8894133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.541+0000 7f889bf50700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8894134160 0x7f8894134600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.541+0000 7f889bf50700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88940a0370 con 0x7f889409f180 2023-09-30T22:23:45.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.541+0000 7f889bf50700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889409fa00 con 0x7f8894134160 2023-09-30T22:23:45.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.541+0000 7f889bf50700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f889409ada0 con 0x7f889409e870 2023-09-30T22:23:45.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.541+0000 7f88994eb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f889409f180 0x7f8894133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.541+0000 7f88994eb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f889409f180 0x7f8894133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54598/0 (socket says 172.21.15.156:54598) 2023-09-30T22:23:45.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.541+0000 7f88994eb700 1 -- 172.21.15.156:0/2652075804 learned_addr learned my addr 172.21.15.156:0/2652075804 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:45.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.541+0000 7f8899cec700 1 --2- 172.21.15.156:0/2652075804 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f889409e870 0x7f889409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.541+0000 7f889a4ed700 1 --2- 172.21.15.156:0/2652075804 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8894134160 0x7f8894134600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.541+0000 7f8899cec700 1 -- 172.21.15.156:0/2652075804 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8894134160 msgr2=0x7f8894134600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:45.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.541+0000 7f8899cec700 1 --2- 172.21.15.156:0/2652075804 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8894134160 0x7f8894134600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.541+0000 7f8899cec700 1 -- 172.21.15.156:0/2652075804 >> v2:172.21.15.156:3300/0 conn(0x7f889409f180 msgr2=0x7f8894133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:45.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.541+0000 7f8899cec700 1 --2- 172.21.15.156:0/2652075804 >> v2:172.21.15.156:3300/0 conn(0x7f889409f180 0x7f8894133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.541+0000 7f8899cec700 1 -- 172.21.15.156:0/2652075804 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889406bec0 con 0x7f889409e870 2023-09-30T22:23:45.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.541+0000 7f8899cec700 1 --2- 172.21.15.156:0/2652075804 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f889409e870 0x7f889409ec40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8890009870 tx=0x7f8890009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b3c745fef0879fe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:45.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.542+0000 7f8898cea700 1 -- 172.21.15.156:0/2652075804 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890011830 con 0x7f889409e870 2023-09-30T22:23:45.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.542+0000 7f8898cea700 1 -- 172.21.15.156:0/2652075804 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8890011990 con 0x7f889409e870 2023-09-30T22:23:45.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.542+0000 7f8898cea700 1 -- 172.21.15.156:0/2652075804 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890011d20 con 0x7f889409e870 2023-09-30T22:23:45.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.542+0000 7f889bf50700 1 -- 172.21.15.156:0/2652075804 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f889409e870 msgr2=0x7f889409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:45.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.542+0000 7f889bf50700 1 --2- 172.21.15.156:0/2652075804 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f889409e870 0x7f889409ec40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8890009870 tx=0x7f8890009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:45.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.542+0000 7f889bf50700 1 -- 172.21.15.156:0/2652075804 shutdown_connections 2023-09-30T22:23:45.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.542+0000 7f889bf50700 1 --2- 172.21.15.156:0/2652075804 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8894134160 0x7f8894134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.542+0000 7f889bf50700 1 --2- 172.21.15.156:0/2652075804 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f889409e870 0x7f889409ec40 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.542+0000 7f889bf50700 1 --2- 172.21.15.156:0/2652075804 >> v2:172.21.15.156:3300/0 conn(0x7f889409f180 0x7f8894133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.542+0000 7f889bf50700 1 -- 172.21.15.156:0/2652075804 >> 172.21.15.156:0/2652075804 conn(0x7f88940a4430 msgr2=0x7f88940a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:45.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.543+0000 7f889bf50700 1 -- 172.21.15.156:0/2652075804 shutdown_connections 2023-09-30T22:23:45.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.543+0000 7f889bf50700 1 -- 172.21.15.156:0/2652075804 wait complete. 2023-09-30T22:23:45.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.544+0000 7f889bf50700 1 Processor -- start 2023-09-30T22:23:45.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.544+0000 7f889bf50700 1 -- start start 2023-09-30T22:23:45.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.545+0000 7f889bf50700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f889409e870 0x7f889411f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.545+0000 7f889bf50700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f889409f180 0x7f889411f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.545+0000 7f889bf50700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8894134160 0x7f88941c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.545+0000 7f889bf50700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8894134000 con 0x7f8894134160 2023-09-30T22:23:45.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.545+0000 7f889bf50700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8894120f70 con 0x7f889409e870 2023-09-30T22:23:45.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.545+0000 7f889bf50700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f889411ec90 con 0x7f889409f180 2023-09-30T22:23:45.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.545+0000 7f88994eb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f889409f180 0x7f889411f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.545+0000 7f8899cec700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f889409e870 0x7f889411f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.545+0000 7f88994eb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f889409f180 0x7f889411f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33766/0 (socket says 172.21.15.156:33766) 2023-09-30T22:23:45.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.545+0000 7f88994eb700 1 -- 172.21.15.156:0/1529609878 learned_addr learned my addr 172.21.15.156:0/1529609878 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:45.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.545+0000 7f889a4ed700 1 --2- 172.21.15.156:0/1529609878 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8894134160 0x7f88941c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.545+0000 7f88994eb700 1 -- 172.21.15.156:0/1529609878 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f889409e870 msgr2=0x7f889411f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:45.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.545+0000 7f88994eb700 1 --2- 172.21.15.156:0/1529609878 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f889409e870 0x7f889411f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.545+0000 7f88994eb700 1 -- 172.21.15.156:0/1529609878 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8894134160 msgr2=0x7f88941c3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:45.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.545+0000 7f88994eb700 1 --2- 172.21.15.156:0/1529609878 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8894134160 0x7f88941c3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.545+0000 7f88994eb700 1 -- 172.21.15.156:0/1529609878 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88900094a0 con 0x7f889409f180 2023-09-30T22:23:45.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.545+0000 7f88994eb700 1 --2- 172.21.15.156:0/1529609878 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f889409f180 0x7f889411f6b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f888400e910 tx=0x7f888400ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:45.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.546+0000 7f888a7fc700 1 -- 172.21.15.156:0/1529609878 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8884013680 con 0x7f889409f180 2023-09-30T22:23:45.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.546+0000 7f888a7fc700 1 -- 172.21.15.156:0/1529609878 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88840137e0 con 0x7f889409f180 2023-09-30T22:23:45.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.546+0000 7f889bf50700 1 -- 172.21.15.156:0/1529609878 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88941213a0 con 0x7f889409f180 2023-09-30T22:23:45.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.546+0000 7f888a7fc700 1 -- 172.21.15.156:0/1529609878 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8884013b50 con 0x7f889409f180 2023-09-30T22:23:45.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.546+0000 7f889bf50700 1 -- 172.21.15.156:0/1529609878 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8894121ea0 con 0x7f889409f180 2023-09-30T22:23:45.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.546+0000 7f888a7fc700 1 -- 172.21.15.156:0/1529609878 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8884013cb0 con 0x7f889409f180 2023-09-30T22:23:45.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.547+0000 7f888a7fc700 1 -- 172.21.15.156:0/1529609878 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f888403f580 con 0x7f889409f180 2023-09-30T22:23:45.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.547+0000 7f889bf50700 1 -- 172.21.15.156:0/1529609878 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f889404f2a0 con 0x7f889409f180 2023-09-30T22:23:45.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.552+0000 7f888a7fc700 1 -- 172.21.15.156:0/1529609878 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f888401bc30 con 0x7f889409f180 2023-09-30T22:23:45.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.601+0000 7fbf87d41700 1 Processor -- start 2023-09-30T22:23:45.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.601+0000 7fbf87d41700 1 -- start start 2023-09-30T22:23:45.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.602+0000 7fbf87d41700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf8006a770 0x7fbf8006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.602+0000 7fbf87d41700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbf80131ec0 0x7fbf80139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.602+0000 7fbf87d41700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8009da80 con 0x7fbf8006b080 2023-09-30T22:23:45.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.602+0000 7fbf87d41700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf8009dce0 con 0x7fbf80131ec0 2023-09-30T22:23:45.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.602+0000 7fbf87d41700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8009eb20 con 0x7fbf8006a770 2023-09-30T22:23:45.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.602+0000 7fbf85add700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf8006a770 0x7fbf8006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.602+0000 7fbf85add700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf8006a770 0x7fbf8006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33616/0 (socket says 172.21.15.156:33616) 2023-09-30T22:23:45.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.602+0000 7fbf85add700 1 -- 172.21.15.156:0/4130224372 learned_addr learned my addr 172.21.15.156:0/4130224372 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:45.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.602+0000 7fbf862de700 1 --2- 172.21.15.156:0/4130224372 >> v2:172.21.15.156:3300/0 conn(0x7fbf80131ec0 0x7fbf80139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.602+0000 7fbf85add700 1 -- 172.21.15.156:0/4130224372 >> v2:172.21.15.156:3300/0 conn(0x7fbf80131ec0 msgr2=0x7fbf80139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:45.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.602+0000 7fbf85add700 1 --2- 172.21.15.156:0/4130224372 >> v2:172.21.15.156:3300/0 conn(0x7fbf80131ec0 0x7fbf80139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.602+0000 7fbf85add700 1 -- 172.21.15.156:0/4130224372 >> v1:172.21.15.156:6789/0 conn(0x7fbf8006b080 legacy=0x7fbf801317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:45.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.602+0000 7fbf85add700 1 -- 172.21.15.156:0/4130224372 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8009d860 con 0x7fbf8006a770 2023-09-30T22:23:45.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.602+0000 7fbf85add700 1 --2- 172.21.15.156:0/4130224372 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf8006a770 0x7fbf8006ab40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c0098f0 tx=0x7fbf7c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec3ea540d8afcc41 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:45.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.603+0000 7fbf84adb700 1 -- 172.21.15.156:0/4130224372 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c011830 con 0x7fbf8006a770 2023-09-30T22:23:45.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.603+0000 7fbf84adb700 1 -- 172.21.15.156:0/4130224372 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7c011990 con 0x7fbf8006a770 2023-09-30T22:23:45.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.603+0000 7fbf84adb700 1 -- 172.21.15.156:0/4130224372 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c011d20 con 0x7fbf8006a770 2023-09-30T22:23:45.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.603+0000 7fbf87d41700 1 -- 172.21.15.156:0/4130224372 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf8006a770 msgr2=0x7fbf8006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:45.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.603+0000 7fbf87d41700 1 --2- 172.21.15.156:0/4130224372 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf8006a770 0x7fbf8006ab40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c0098f0 tx=0x7fbf7c009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:45.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.603+0000 7fbf87d41700 1 -- 172.21.15.156:0/4130224372 shutdown_connections 2023-09-30T22:23:45.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.603+0000 7fbf87d41700 1 --2- 172.21.15.156:0/4130224372 >> v2:172.21.15.156:3300/0 conn(0x7fbf80131ec0 0x7fbf80139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.604+0000 7fbf87d41700 1 --2- 172.21.15.156:0/4130224372 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf8006a770 0x7fbf8006ab40 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.604+0000 7fbf87d41700 1 -- 172.21.15.156:0/4130224372 >> 172.21.15.156:0/4130224372 conn(0x7fbf80099c40 msgr2=0x7fbf800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:45.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.604+0000 7fbf87d41700 1 -- 172.21.15.156:0/4130224372 shutdown_connections 2023-09-30T22:23:45.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.604+0000 7fbf87d41700 1 -- 172.21.15.156:0/4130224372 wait complete. 2023-09-30T22:23:45.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.605+0000 7fbf87d41700 1 Processor -- start 2023-09-30T22:23:45.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.605+0000 7fbf87d41700 1 -- start start 2023-09-30T22:23:45.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.606+0000 7fbf87d41700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf8006a770 0x7fbf8009a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.606+0000 7fbf87d41700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf8006b080 0x7fbf8009a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.606+0000 7fbf87d41700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbf80131ec0 0x7fbf8009af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.606+0000 7fbf87d41700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf80122510 con 0x7fbf8006b080 2023-09-30T22:23:45.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.606+0000 7fbf87d41700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8012e5d0 con 0x7fbf8006a770 2023-09-30T22:23:45.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.606+0000 7fbf87d41700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf801229c0 con 0x7fbf80131ec0 2023-09-30T22:23:45.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.606+0000 7fbf85add700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf8006a770 0x7fbf8009a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.606+0000 7fbf85add700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf8006a770 0x7fbf8009a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33628/0 (socket says 172.21.15.156:33628) 2023-09-30T22:23:45.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.606+0000 7fbf85add700 1 -- 172.21.15.156:0/18809693 learned_addr learned my addr 172.21.15.156:0/18809693 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:45.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.606+0000 7fbf852dc700 1 --2- 172.21.15.156:0/18809693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf8006b080 0x7fbf8009a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.606+0000 7fbf85add700 1 -- 172.21.15.156:0/18809693 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbf80131ec0 msgr2=0x7fbf8009af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:45.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.606+0000 7fbf85add700 1 --2- 172.21.15.156:0/18809693 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbf80131ec0 0x7fbf8009af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.606+0000 7fbf85add700 1 -- 172.21.15.156:0/18809693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf8006b080 msgr2=0x7fbf8009a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:45.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.606+0000 7fbf85add700 1 --2- 172.21.15.156:0/18809693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf8006b080 0x7fbf8009a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.606+0000 7fbf85add700 1 -- 172.21.15.156:0/18809693 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7c009550 con 0x7fbf8006a770 2023-09-30T22:23:45.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.606+0000 7fbf852dc700 1 --2- 172.21.15.156:0/18809693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf8006b080 0x7fbf8009a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:45.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.606+0000 7fbf85add700 1 --2- 172.21.15.156:0/18809693 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf8006a770 0x7fbf8009a490 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c009c40 tx=0x7fbf7c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:45.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.607+0000 7fbf767fc700 1 -- 172.21.15.156:0/18809693 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c004240 con 0x7fbf8006a770 2023-09-30T22:23:45.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.607+0000 7fbf767fc700 1 -- 172.21.15.156:0/18809693 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7c0043a0 con 0x7fbf8006a770 2023-09-30T22:23:45.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.607+0000 7fbf767fc700 1 -- 172.21.15.156:0/18809693 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c0036a0 con 0x7fbf8006a770 2023-09-30T22:23:45.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.607+0000 7fbf87d41700 1 -- 172.21.15.156:0/18809693 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf800a3450 con 0x7fbf8006a770 2023-09-30T22:23:45.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.607+0000 7fbf87d41700 1 -- 172.21.15.156:0/18809693 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf80122700 con 0x7fbf8006a770 2023-09-30T22:23:45.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.608+0000 7fbf767fc700 1 -- 172.21.15.156:0/18809693 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbf7c003800 con 0x7fbf8006a770 2023-09-30T22:23:45.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.609+0000 7fbf767fc700 1 -- 172.21.15.156:0/18809693 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbf7c048bc0 con 0x7fbf8006a770 2023-09-30T22:23:45.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.609+0000 7fbf87d41700 1 -- 172.21.15.156:0/18809693 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf801234f0 con 0x7fbf8006a770 2023-09-30T22:23:45.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.613+0000 7fbf767fc700 1 -- 172.21.15.156:0/18809693 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf7c015080 con 0x7fbf8006a770 2023-09-30T22:23:45.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.655+0000 7f0c9173f700 1 -- 172.21.15.156:0/1593059768 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0c8c1217d0 con 0x7f0c8c0a2e10 2023-09-30T22:23:45.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.656+0000 7f0c737fe700 1 -- 172.21.15.156:0/1593059768 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c80013720 con 0x7f0c8c0a2e10 2023-09-30T22:23:45.657 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:45.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.658+0000 7f0c9173f700 1 -- 172.21.15.156:0/1593059768 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c8c0a2e10 msgr2=0x7f0c8c1c5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:45.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.658+0000 7f0c9173f700 1 --2- 172.21.15.156:0/1593059768 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c8c0a2e10 0x7f0c8c1c5830 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0c8000e9b0 tx=0x7f0c8000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.658+0000 7f0c9173f700 1 -- 172.21.15.156:0/1593059768 shutdown_connections 2023-09-30T22:23:45.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.658+0000 7f0c9173f700 1 --2- 172.21.15.156:0/1593059768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c8c133ad0 0x7f0c8c1c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.658+0000 7f0c9173f700 1 --2- 172.21.15.156:0/1593059768 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c8c0a0b50 0x7f0c8c1c52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.658+0000 7f0c9173f700 1 --2- 172.21.15.156:0/1593059768 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c8c0a2e10 0x7f0c8c1c5830 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.658+0000 7f0c9173f700 1 -- 172.21.15.156:0/1593059768 >> 172.21.15.156:0/1593059768 conn(0x7f0c8c06c780 msgr2=0x7f0c8c133090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:45.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.658+0000 7f0c9173f700 1 -- 172.21.15.156:0/1593059768 shutdown_connections 2023-09-30T22:23:45.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.658+0000 7f0c9173f700 1 -- 172.21.15.156:0/1593059768 wait complete. 2023-09-30T22:23:45.671 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:45.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.729+0000 7f5a28dd4700 1 -- 172.21.15.156:0/3070781917 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5a2404f2a0 con 0x7f5a24136cb0 2023-09-30T22:23:45.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.729+0000 7f5a12ffd700 1 -- 172.21.15.156:0/3070781917 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5a1c016340 con 0x7f5a24136cb0 2023-09-30T22:23:45.730 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:45.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.732+0000 7f5a28dd4700 1 -- 172.21.15.156:0/3070781917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a24136cb0 msgr2=0x7f5a241c4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:45.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.732+0000 7f5a28dd4700 1 --2- 172.21.15.156:0/3070781917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a24136cb0 0x7f5a241c4c80 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c012420 tx=0x7f5a1c012730 comp rx=0 tx=0).stop 2023-09-30T22:23:45.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.732+0000 7f5a28dd4700 1 -- 172.21.15.156:0/3070781917 shutdown_connections 2023-09-30T22:23:45.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.732+0000 7f5a28dd4700 1 --2- 172.21.15.156:0/3070781917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a24136cb0 0x7f5a241c4c80 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.732+0000 7f5a28dd4700 1 --2- 172.21.15.156:0/3070781917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a2406a770 0x7f5a241c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.732+0000 7f5a28dd4700 1 --2- 172.21.15.156:0/3070781917 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a2409dec0 0x7f5a241c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.732+0000 7f5a28dd4700 1 -- 172.21.15.156:0/3070781917 >> 172.21.15.156:0/3070781917 conn(0x7f5a24099c40 msgr2=0x7f5a2412e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:45.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.732+0000 7f5a28dd4700 1 -- 172.21.15.156:0/3070781917 shutdown_connections 2023-09-30T22:23:45.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.732+0000 7f5a28dd4700 1 -- 172.21.15.156:0/3070781917 wait complete. 2023-09-30T22:23:45.749 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:45.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.775+0000 7f889bf50700 1 -- 172.21.15.156:0/1529609878 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8894072d60 con 0x7f889409f180 2023-09-30T22:23:45.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.776+0000 7f888a7fc700 1 -- 172.21.15.156:0/1529609878 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8884021030 con 0x7f889409f180 2023-09-30T22:23:45.778 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:45.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.778+0000 7f889bf50700 1 -- 172.21.15.156:0/1529609878 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f889409f180 msgr2=0x7f889411f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:45.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.778+0000 7f889bf50700 1 --2- 172.21.15.156:0/1529609878 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f889409f180 0x7f889411f6b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f888400e910 tx=0x7f888400ec20 comp rx=0 tx=0).stop 2023-09-30T22:23:45.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.778+0000 7f889bf50700 1 -- 172.21.15.156:0/1529609878 shutdown_connections 2023-09-30T22:23:45.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.778+0000 7f889bf50700 1 --2- 172.21.15.156:0/1529609878 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8894134160 0x7f88941c3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.778+0000 7f889bf50700 1 --2- 172.21.15.156:0/1529609878 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f889409e870 0x7f889411f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.778+0000 7f889bf50700 1 --2- 172.21.15.156:0/1529609878 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f889409f180 0x7f889411f6b0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.778+0000 7f889bf50700 1 -- 172.21.15.156:0/1529609878 >> 172.21.15.156:0/1529609878 conn(0x7f88940a4430 msgr2=0x7f88940a1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:45.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.778+0000 7f889bf50700 1 -- 172.21.15.156:0/1529609878 shutdown_connections 2023-09-30T22:23:45.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.778+0000 7f889bf50700 1 -- 172.21.15.156:0/1529609878 wait complete. 2023-09-30T22:23:45.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:45.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.809+0000 7fbf87d41700 1 -- 172.21.15.156:0/18809693 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbf8004f2a0 con 0x7fbf8006a770 2023-09-30T22:23:45.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.809+0000 7fbf767fc700 1 -- 172.21.15.156:0/18809693 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbf7c02f020 con 0x7fbf8006a770 2023-09-30T22:23:45.810 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:45.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.811+0000 7fbf87d41700 1 -- 172.21.15.156:0/18809693 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf8006a770 msgr2=0x7fbf8009a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:45.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.811+0000 7fbf87d41700 1 --2- 172.21.15.156:0/18809693 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf8006a770 0x7fbf8009a490 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c009c40 tx=0x7fbf7c004750 comp rx=0 tx=0).stop 2023-09-30T22:23:45.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.811+0000 7fbf87d41700 1 -- 172.21.15.156:0/18809693 shutdown_connections 2023-09-30T22:23:45.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.811+0000 7fbf87d41700 1 --2- 172.21.15.156:0/18809693 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbf80131ec0 0x7fbf8009af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.811+0000 7fbf87d41700 1 --2- 172.21.15.156:0/18809693 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf8006a770 0x7fbf8009a490 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.811+0000 7fbf87d41700 1 --2- 172.21.15.156:0/18809693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf8006b080 0x7fbf8009a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.811+0000 7fbf87d41700 1 -- 172.21.15.156:0/18809693 >> 172.21.15.156:0/18809693 conn(0x7fbf80099c40 msgr2=0x7fbf8012e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:45.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.811+0000 7fbf87d41700 1 -- 172.21.15.156:0/18809693 shutdown_connections 2023-09-30T22:23:45.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:45.811+0000 7fbf87d41700 1 -- 172.21.15.156:0/18809693 wait complete. 2023-09-30T22:23:45.824 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:46.672 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:46.750 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:46.791 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:46.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.811+0000 7f3717341700 1 Processor -- start 2023-09-30T22:23:46.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.811+0000 7f3717341700 1 -- start start 2023-09-30T22:23:46.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.812+0000 7f3717341700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f371009d860 0x7f371009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.812+0000 7f3717341700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f371009e170 0x7f37101307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.812+0000 7f3717341700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f371009aaa0 con 0x7f3710130ce0 2023-09-30T22:23:46.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.812+0000 7f3717341700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371009f870 con 0x7f371009d860 2023-09-30T22:23:46.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.812+0000 7f3717341700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f371009b360 con 0x7f371009e170 2023-09-30T22:23:46.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.812+0000 7f37150dd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f371009d860 0x7f371009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.812+0000 7f37148dc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f371009e170 0x7f37101307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.812+0000 7f37150dd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f371009d860 0x7f371009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33644/0 (socket says 172.21.15.156:33644) 2023-09-30T22:23:46.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.812+0000 7f37150dd700 1 -- 172.21.15.156:0/916761716 learned_addr learned my addr 172.21.15.156:0/916761716 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:46.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.813+0000 7f37150dd700 1 -- 172.21.15.156:0/916761716 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f371009e170 msgr2=0x7f37101307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:46.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.813+0000 7f37150dd700 1 --2- 172.21.15.156:0/916761716 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f371009e170 0x7f37101307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.813+0000 7f3707fff700 1 -- 172.21.15.156:0/916761716 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 51511722 0 0) 0x7f371009aaa0 con 0x7f3710130ce0 2023-09-30T22:23:46.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.813+0000 7f37150dd700 1 -- 172.21.15.156:0/916761716 >> v1:172.21.15.156:6789/0 conn(0x7f3710130ce0 legacy=0x7f37101379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.813+0000 7f37150dd700 1 -- 172.21.15.156:0/916761716 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371009b620 con 0x7f371009d860 2023-09-30T22:23:46.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.813+0000 7f37150dd700 1 --2- 172.21.15.156:0/916761716 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f371009d860 0x7f371009dc30 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f370c00bbc0 tx=0x7f370c00bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdc3e43e186ec569 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:46.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.813+0000 7f3707fff700 1 -- 172.21.15.156:0/916761716 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c00dd30 con 0x7f371009d860 2023-09-30T22:23:46.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.813+0000 7f3707fff700 1 -- 172.21.15.156:0/916761716 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370c00de90 con 0x7f371009d860 2023-09-30T22:23:46.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.813+0000 7f3707fff700 1 -- 172.21.15.156:0/916761716 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c010690 con 0x7f371009d860 2023-09-30T22:23:46.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.814+0000 7f3717341700 1 -- 172.21.15.156:0/916761716 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f371009d860 msgr2=0x7f371009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.814+0000 7f3717341700 1 --2- 172.21.15.156:0/916761716 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f371009d860 0x7f371009dc30 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f370c00bbc0 tx=0x7f370c00bed0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.814+0000 7f3717341700 1 -- 172.21.15.156:0/916761716 shutdown_connections 2023-09-30T22:23:46.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.814+0000 7f3717341700 1 --2- 172.21.15.156:0/916761716 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f371009d860 0x7f371009dc30 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.814+0000 7f3717341700 1 --2- 172.21.15.156:0/916761716 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f371009e170 0x7f37101307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.814+0000 7f3717341700 1 -- 172.21.15.156:0/916761716 >> 172.21.15.156:0/916761716 conn(0x7f3710099c40 msgr2=0x7f37100a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:46.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.814+0000 7f3717341700 1 -- 172.21.15.156:0/916761716 shutdown_connections 2023-09-30T22:23:46.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.814+0000 7f3717341700 1 -- 172.21.15.156:0/916761716 wait complete. 2023-09-30T22:23:46.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.815+0000 7f3717341700 1 Processor -- start 2023-09-30T22:23:46.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.815+0000 7f3717341700 1 -- start start 2023-09-30T22:23:46.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.816+0000 7f3717341700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f371009d860 0x7f371011e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.816+0000 7f3717341700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f371009e170 0x7f371011e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.816+0000 7f3717341700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3710130ce0 0x7f371011eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.816+0000 7f3717341700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3710121640 con 0x7f371009d860 2023-09-30T22:23:46.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.816+0000 7f3717341700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3710120050 con 0x7f371009e170 2023-09-30T22:23:46.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.816+0000 7f3717341700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3710121f60 con 0x7f3710130ce0 2023-09-30T22:23:46.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.816+0000 7f37150dd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f371009d860 0x7f371011e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.816+0000 7f37150dd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f371009d860 0x7f371011e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54622/0 (socket says 172.21.15.156:54622) 2023-09-30T22:23:46.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.816+0000 7f37158de700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3710130ce0 0x7f371011eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.816+0000 7f37150dd700 1 -- 172.21.15.156:0/463377661 learned_addr learned my addr 172.21.15.156:0/463377661 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:46.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.816+0000 7f37148dc700 1 --2- 172.21.15.156:0/463377661 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f371009e170 0x7f371011e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.816+0000 7f37150dd700 1 -- 172.21.15.156:0/463377661 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3710130ce0 msgr2=0x7f371011eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.816+0000 7f37150dd700 1 --2- 172.21.15.156:0/463377661 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3710130ce0 0x7f371011eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.816+0000 7f37150dd700 1 -- 172.21.15.156:0/463377661 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f371009e170 msgr2=0x7f371011e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.816+0000 7f37150dd700 1 --2- 172.21.15.156:0/463377661 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f371009e170 0x7f371011e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.816+0000 7f37150dd700 1 -- 172.21.15.156:0/463377661 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370c00b7f0 con 0x7f371009d860 2023-09-30T22:23:46.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.816+0000 7f37148dc700 1 --2- 172.21.15.156:0/463377661 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f371009e170 0x7f371011e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:23:46.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.816+0000 7f37158de700 1 --2- 172.21.15.156:0/463377661 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3710130ce0 0x7f371011eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:46.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.817+0000 7f37150dd700 1 --2- 172.21.15.156:0/463377661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f371009d860 0x7f371011e440 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f371009fa00 tx=0x7f370c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:46.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.817+0000 7f3705ffb700 1 -- 172.21.15.156:0/463377661 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c01f070 con 0x7f371009d860 2023-09-30T22:23:46.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.817+0000 7f3705ffb700 1 -- 172.21.15.156:0/463377661 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370c003970 con 0x7f371009d860 2023-09-30T22:23:46.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.817+0000 7f3717341700 1 -- 172.21.15.156:0/463377661 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3710071fc0 con 0x7f371009d860 2023-09-30T22:23:46.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.817+0000 7f3705ffb700 1 -- 172.21.15.156:0/463377661 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c003ce0 con 0x7f371009d860 2023-09-30T22:23:46.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.817+0000 7f3717341700 1 -- 172.21.15.156:0/463377661 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3710121c80 con 0x7f371009d860 2023-09-30T22:23:46.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.818+0000 7f3705ffb700 1 -- 172.21.15.156:0/463377661 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f370c019400 con 0x7f371009d860 2023-09-30T22:23:46.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.818+0000 7f3705ffb700 1 -- 172.21.15.156:0/463377661 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f370c042b00 con 0x7f371009d860 2023-09-30T22:23:46.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.818+0000 7f3717341700 1 -- 172.21.15.156:0/463377661 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f371004f2a0 con 0x7f371009d860 2023-09-30T22:23:46.824 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:46.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.824+0000 7f3705ffb700 1 -- 172.21.15.156:0/463377661 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f370c003e40 con 0x7f371009d860 2023-09-30T22:23:46.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.887+0000 7ff8395cc700 1 Processor -- start 2023-09-30T22:23:46.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.888+0000 7ff8395cc700 1 -- start start 2023-09-30T22:23:46.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.888+0000 7ff8395cc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff834099eb0 0x7ff83409a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.888+0000 7ff8395cc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff834130a60 0x7ff834138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.888+0000 7ff8395cc700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83409b930 con 0x7ff83409a7c0 2023-09-30T22:23:46.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.888+0000 7ff8395cc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff834072410 con 0x7ff834130a60 2023-09-30T22:23:46.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.888+0000 7ff8395cc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff83409cd30 con 0x7ff834099eb0 2023-09-30T22:23:46.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.888+0000 7ff8327fc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff83409a7c0 0x7ff834130350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53706/0 (socket says 172.21.15.156:53706) 2023-09-30T22:23:46.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.888+0000 7ff8327fc700 1 -- 172.21.15.156:0/4144072857 learned_addr learned my addr 172.21.15.156:0/4144072857 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:46.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.888+0000 7ff832ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff834099eb0 0x7ff83409a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.889+0000 7ff8337fe700 1 --2- 172.21.15.156:0/4144072857 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff834130a60 0x7ff834138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.889+0000 7ff832ffd700 1 -- 172.21.15.156:0/4144072857 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff834130a60 msgr2=0x7ff834138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:46.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.889+0000 7ff832ffd700 1 --2- 172.21.15.156:0/4144072857 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff834130a60 0x7ff834138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.889+0000 7ff832ffd700 1 -- 172.21.15.156:0/4144072857 >> v1:172.21.15.156:6789/0 conn(0x7ff83409a7c0 legacy=0x7ff834130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.889+0000 7ff832ffd700 1 -- 172.21.15.156:0/4144072857 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff834099a60 con 0x7ff834099eb0 2023-09-30T22:23:46.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.889+0000 7ff832ffd700 1 --2- 172.21.15.156:0/4144072857 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff834099eb0 0x7ff83409a280 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff824009850 tx=0x7ff824009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b3fca8e8517d64b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:46.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.889+0000 7ff831ffb700 1 -- 172.21.15.156:0/4144072857 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff824005e30 con 0x7ff834099eb0 2023-09-30T22:23:46.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.889+0000 7ff831ffb700 1 -- 172.21.15.156:0/4144072857 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff824006030 con 0x7ff834099eb0 2023-09-30T22:23:46.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.889+0000 7ff831ffb700 1 -- 172.21.15.156:0/4144072857 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8240063e0 con 0x7ff834099eb0 2023-09-30T22:23:46.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.890+0000 7ff8395cc700 1 -- 172.21.15.156:0/4144072857 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff834099eb0 msgr2=0x7ff83409a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.890+0000 7ff8395cc700 1 --2- 172.21.15.156:0/4144072857 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff834099eb0 0x7ff83409a280 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff824009850 tx=0x7ff824009b60 comp rx=0 tx=0).stop 2023-09-30T22:23:46.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.890+0000 7ff8395cc700 1 -- 172.21.15.156:0/4144072857 shutdown_connections 2023-09-30T22:23:46.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.890+0000 7ff8395cc700 1 --2- 172.21.15.156:0/4144072857 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff834130a60 0x7ff834138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.890+0000 7ff8395cc700 1 --2- 172.21.15.156:0/4144072857 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff834099eb0 0x7ff83409a280 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.890+0000 7ff8395cc700 1 -- 172.21.15.156:0/4144072857 >> 172.21.15.156:0/4144072857 conn(0x7ff8340a2980 msgr2=0x7ff8340a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:46.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.890+0000 7ff8395cc700 1 -- 172.21.15.156:0/4144072857 shutdown_connections 2023-09-30T22:23:46.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.890+0000 7ff8395cc700 1 -- 172.21.15.156:0/4144072857 wait complete. 2023-09-30T22:23:46.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.892+0000 7ff8395cc700 1 Processor -- start 2023-09-30T22:23:46.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.892+0000 7ff8395cc700 1 -- start start 2023-09-30T22:23:46.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.892+0000 7ff8395cc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff834099eb0 0x7ff83413c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.892+0000 7ff8395cc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff83409a7c0 0x7ff83413ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.892+0000 7ff8395cc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff834130a60 0x7ff83413d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.892+0000 7ff8395cc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff834119430 con 0x7ff834099eb0 2023-09-30T22:23:46.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.892+0000 7ff8395cc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83409b490 con 0x7ff83409a7c0 2023-09-30T22:23:46.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.892+0000 7ff8395cc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8340a10b0 con 0x7ff834130a60 2023-09-30T22:23:46.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.893+0000 7ff8327fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff83409a7c0 0x7ff83413ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.893+0000 7ff8327fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff83409a7c0 0x7ff83413ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33670/0 (socket says 172.21.15.156:33670) 2023-09-30T22:23:46.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.893+0000 7ff8327fc700 1 -- 172.21.15.156:0/1132961786 learned_addr learned my addr 172.21.15.156:0/1132961786 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:46.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.893+0000 7ff8337fe700 1 --2- 172.21.15.156:0/1132961786 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff834130a60 0x7ff83413d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.893+0000 7ff832ffd700 1 --2- 172.21.15.156:0/1132961786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff834099eb0 0x7ff83413c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.893+0000 7ff8327fc700 1 -- 172.21.15.156:0/1132961786 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff834130a60 msgr2=0x7ff83413d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.893+0000 7ff8327fc700 1 --2- 172.21.15.156:0/1132961786 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff834130a60 0x7ff83413d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.893+0000 7ff8327fc700 1 -- 172.21.15.156:0/1132961786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff834099eb0 msgr2=0x7ff83413c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.893+0000 7ff8327fc700 1 --2- 172.21.15.156:0/1132961786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff834099eb0 0x7ff83413c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.893+0000 7ff8327fc700 1 -- 172.21.15.156:0/1132961786 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff824009430 con 0x7ff83409a7c0 2023-09-30T22:23:46.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.893+0000 7ff8327fc700 1 --2- 172.21.15.156:0/1132961786 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff83409a7c0 0x7ff83413ce20 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff82800c530 tx=0x7ff82800c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:46.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.894+0000 7ff81b7fe700 1 -- 172.21.15.156:0/1132961786 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82800cea0 con 0x7ff83409a7c0 2023-09-30T22:23:46.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.894+0000 7ff81b7fe700 1 -- 172.21.15.156:0/1132961786 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff828005d70 con 0x7ff83409a7c0 2023-09-30T22:23:46.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.894+0000 7ff8395cc700 1 -- 172.21.15.156:0/1132961786 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83413fb90 con 0x7ff83409a7c0 2023-09-30T22:23:46.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.894+0000 7ff81b7fe700 1 -- 172.21.15.156:0/1132961786 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8280072d0 con 0x7ff83409a7c0 2023-09-30T22:23:46.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.894+0000 7ff8395cc700 1 -- 172.21.15.156:0/1132961786 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83413eca0 con 0x7ff83409a7c0 2023-09-30T22:23:46.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.895+0000 7ff8395cc700 1 -- 172.21.15.156:0/1132961786 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8140052e0 con 0x7ff83409a7c0 2023-09-30T22:23:46.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.895+0000 7ff81b7fe700 1 -- 172.21.15.156:0/1132961786 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff828007430 con 0x7ff83409a7c0 2023-09-30T22:23:46.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.895+0000 7ff81b7fe700 1 -- 172.21.15.156:0/1132961786 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff82803e990 con 0x7ff83409a7c0 2023-09-30T22:23:46.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.900+0000 7ff81b7fe700 1 -- 172.21.15.156:0/1132961786 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff8280076e0 con 0x7ff83409a7c0 2023-09-30T22:23:46.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.927+0000 7f864e7eb700 1 Processor -- start 2023-09-30T22:23:46.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.927+0000 7f864e7eb700 1 -- start start 2023-09-30T22:23:46.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.927+0000 7f864e7eb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8648133ad0 0x7f8648133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.927+0000 7f864e7eb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8648130bc0 0x7f864813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.927+0000 7f864e7eb700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f864806b2d0 con 0x7f86481300a0 2023-09-30T22:23:46.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.927+0000 7f864e7eb700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8648133610 con 0x7f8648133ad0 2023-09-30T22:23:46.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.927+0000 7f864e7eb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f864809a500 con 0x7f8648130bc0 2023-09-30T22:23:46.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.928+0000 7f8647fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8648133ad0 0x7f8648133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.928+0000 7f8647fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8648133ad0 0x7f8648133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54634/0 (socket says 172.21.15.156:54634) 2023-09-30T22:23:46.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.928+0000 7f8647fff700 1 -- 172.21.15.156:0/3123898777 learned_addr learned my addr 172.21.15.156:0/3123898777 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:46.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.928+0000 7f864cd88700 1 --2- 172.21.15.156:0/3123898777 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8648130bc0 0x7f864813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.928+0000 7f8647fff700 1 -- 172.21.15.156:0/3123898777 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8648130bc0 msgr2=0x7f864813b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:46.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.928+0000 7f8647fff700 1 --2- 172.21.15.156:0/3123898777 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8648130bc0 0x7f864813b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.928+0000 7f8647fff700 1 -- 172.21.15.156:0/3123898777 >> v1:172.21.15.156:6789/0 conn(0x7f86481300a0 legacy=0x7f86481304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.928+0000 7f8646ffd700 1 -- 172.21.15.156:0/3123898777 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998142820 0 0) 0x7f864806b2d0 con 0x7f86481300a0 2023-09-30T22:23:46.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.928+0000 7f8647fff700 1 -- 172.21.15.156:0/3123898777 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86481338b0 con 0x7f8648133ad0 2023-09-30T22:23:46.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.928+0000 7f8647fff700 1 --2- 172.21.15.156:0/3123898777 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8648133ad0 0x7f8648133ea0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f86380098f0 tx=0x7f8638009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da4505ce6a09b1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:46.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.928+0000 7f8646ffd700 1 -- 172.21.15.156:0/3123898777 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8638011830 con 0x7f8648133ad0 2023-09-30T22:23:46.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.929+0000 7f8646ffd700 1 -- 172.21.15.156:0/3123898777 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8638011990 con 0x7f8648133ad0 2023-09-30T22:23:46.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.929+0000 7f8646ffd700 1 -- 172.21.15.156:0/3123898777 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8638011d20 con 0x7f8648133ad0 2023-09-30T22:23:46.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.929+0000 7f864e7eb700 1 -- 172.21.15.156:0/3123898777 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8648133ad0 msgr2=0x7f8648133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.929+0000 7f864e7eb700 1 --2- 172.21.15.156:0/3123898777 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8648133ad0 0x7f8648133ea0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f86380098f0 tx=0x7f8638009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:46.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.929+0000 7f864e7eb700 1 -- 172.21.15.156:0/3123898777 shutdown_connections 2023-09-30T22:23:46.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.929+0000 7f864e7eb700 1 --2- 172.21.15.156:0/3123898777 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8648133ad0 0x7f8648133ea0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.929+0000 7f864e7eb700 1 --2- 172.21.15.156:0/3123898777 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8648130bc0 0x7f864813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.929+0000 7f864e7eb700 1 -- 172.21.15.156:0/3123898777 >> 172.21.15.156:0/3123898777 conn(0x7f8648099c40 msgr2=0x7f86480a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:46.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.929+0000 7f864e7eb700 1 -- 172.21.15.156:0/3123898777 shutdown_connections 2023-09-30T22:23:46.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.929+0000 7f864e7eb700 1 -- 172.21.15.156:0/3123898777 wait complete. 2023-09-30T22:23:46.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.930+0000 7f864e7eb700 1 Processor -- start 2023-09-30T22:23:46.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.930+0000 7f864e7eb700 1 -- start start 2023-09-30T22:23:46.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.931+0000 7f864e7eb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86481300a0 0x7f86480712f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.931+0000 7f864e7eb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8648130bc0 0x7f8648071830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.931+0000 7f864e7eb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8648133ad0 0x7f8648071d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.931+0000 7f864e7eb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864811ff30 con 0x7f86481300a0 2023-09-30T22:23:46.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.931+0000 7f864e7eb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864811ee10 con 0x7f8648130bc0 2023-09-30T22:23:46.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.931+0000 7f864e7eb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f864811e100 con 0x7f8648133ad0 2023-09-30T22:23:46.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.931+0000 7f86477fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8648130bc0 0x7f8648071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.931+0000 7f8647fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86481300a0 0x7f86480712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.931+0000 7f86477fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8648130bc0 0x7f8648071830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33682/0 (socket says 172.21.15.156:33682) 2023-09-30T22:23:46.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.931+0000 7f8647fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86481300a0 0x7f86480712f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54648/0 (socket says 172.21.15.156:54648) 2023-09-30T22:23:46.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.931+0000 7f86477fe700 1 -- 172.21.15.156:0/1262928073 learned_addr learned my addr 172.21.15.156:0/1262928073 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:46.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.931+0000 7f864cd88700 1 --2- 172.21.15.156:0/1262928073 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8648133ad0 0x7f8648071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.932+0000 7f86477fe700 1 -- 172.21.15.156:0/1262928073 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8648133ad0 msgr2=0x7f8648071d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.932+0000 7f86477fe700 1 --2- 172.21.15.156:0/1262928073 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8648133ad0 0x7f8648071d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.932+0000 7f86477fe700 1 -- 172.21.15.156:0/1262928073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86481300a0 msgr2=0x7f86480712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.932+0000 7f86477fe700 1 --2- 172.21.15.156:0/1262928073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86481300a0 0x7f86480712f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.932+0000 7f86477fe700 1 -- 172.21.15.156:0/1262928073 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8638009550 con 0x7f8648130bc0 2023-09-30T22:23:46.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.932+0000 7f8647fff700 1 --2- 172.21.15.156:0/1262928073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86481300a0 0x7f86480712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:46.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.932+0000 7f86477fe700 1 --2- 172.21.15.156:0/1262928073 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8648130bc0 0x7f8648071830 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f863c00c750 tx=0x7f863c00ca60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:46.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.932+0000 7f8644ff9700 1 -- 172.21.15.156:0/1262928073 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c0054e0 con 0x7f8648130bc0 2023-09-30T22:23:46.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.932+0000 7f8644ff9700 1 -- 172.21.15.156:0/1262928073 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c003680 con 0x7f8648130bc0 2023-09-30T22:23:46.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.932+0000 7f8644ff9700 1 -- 172.21.15.156:0/1262928073 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c003a30 con 0x7f8648130bc0 2023-09-30T22:23:46.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.933+0000 7f864e7eb700 1 -- 172.21.15.156:0/1262928073 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f864811f8f0 con 0x7f8648130bc0 2023-09-30T22:23:46.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.933+0000 7f864e7eb700 1 -- 172.21.15.156:0/1262928073 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f864812dd00 con 0x7f8648130bc0 2023-09-30T22:23:46.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.934+0000 7f8644ff9700 1 -- 172.21.15.156:0/1262928073 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f863c003b90 con 0x7f8648130bc0 2023-09-30T22:23:46.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.934+0000 7f864e7eb700 1 -- 172.21.15.156:0/1262928073 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86480a2620 con 0x7f8648130bc0 2023-09-30T22:23:46.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.934+0000 7f8644ff9700 1 -- 172.21.15.156:0/1262928073 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f863c03ec00 con 0x7f8648130bc0 2023-09-30T22:23:46.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.943+0000 7f8644ff9700 1 -- 172.21.15.156:0/1262928073 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f863c003e40 con 0x7f8648130bc0 2023-09-30T22:23:46.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.964+0000 7efda9039700 1 Processor -- start 2023-09-30T22:23:46.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.964+0000 7efda9039700 1 -- start start 2023-09-30T22:23:46.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.965+0000 7efda9039700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efda41346e0 0x7efda4136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.965+0000 7efda9039700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7efda4137000 0x7efda41393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.965+0000 7efda9039700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda40a1640 con 0x7efda4131980 2023-09-30T22:23:46.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.965+0000 7efda9039700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda406eb30 con 0x7efda4137000 2023-09-30T22:23:46.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.965+0000 7efda9039700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda40a22d0 con 0x7efda41346e0 2023-09-30T22:23:46.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.965+0000 7efda2d9d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7efda4131980 0x7efda4131d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53732/0 (socket says 172.21.15.156:53732) 2023-09-30T22:23:46.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.965+0000 7efda2d9d700 1 -- 172.21.15.156:0/1944892367 learned_addr learned my addr 172.21.15.156:0/1944892367 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:46.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.965+0000 7efda259c700 1 --2- 172.21.15.156:0/1944892367 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efda41346e0 0x7efda4136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.965+0000 7efda359e700 1 --2- 172.21.15.156:0/1944892367 >> v2:172.21.15.156:3300/0 conn(0x7efda4137000 0x7efda41393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.965+0000 7efda359e700 1 -- 172.21.15.156:0/1944892367 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efda41346e0 msgr2=0x7efda4136ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:46.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.965+0000 7efda359e700 1 --2- 172.21.15.156:0/1944892367 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efda41346e0 0x7efda4136ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.965+0000 7efda359e700 1 -- 172.21.15.156:0/1944892367 >> v1:172.21.15.156:6789/0 conn(0x7efda4131980 legacy=0x7efda4131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.965+0000 7efda1d9b700 1 -- 172.21.15.156:0/1944892367 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3229711136 0 0) 0x7efda40a1640 con 0x7efda4131980 2023-09-30T22:23:46.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.965+0000 7efda359e700 1 -- 172.21.15.156:0/1944892367 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda4131550 con 0x7efda4137000 2023-09-30T22:23:46.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.965+0000 7efda359e700 1 --2- 172.21.15.156:0/1944892367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efda4137000 0x7efda41393e0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009d90 tx=0x7efd9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85288d06bde56b82 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:46.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.966+0000 7efda1d9b700 1 -- 172.21.15.156:0/1944892367 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c00e070 con 0x7efda4137000 2023-09-30T22:23:46.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.966+0000 7efda1d9b700 1 -- 172.21.15.156:0/1944892367 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9c00bb20 con 0x7efda4137000 2023-09-30T22:23:46.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.966+0000 7efda1d9b700 1 -- 172.21.15.156:0/1944892367 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c012430 con 0x7efda4137000 2023-09-30T22:23:46.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.966+0000 7efda9039700 1 -- 172.21.15.156:0/1944892367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efda4137000 msgr2=0x7efda41393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.966+0000 7efda9039700 1 --2- 172.21.15.156:0/1944892367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efda4137000 0x7efda41393e0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009d90 tx=0x7efd9c00b330 comp rx=0 tx=0).stop 2023-09-30T22:23:46.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.967+0000 7efda9039700 1 -- 172.21.15.156:0/1944892367 shutdown_connections 2023-09-30T22:23:46.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.967+0000 7efda9039700 1 --2- 172.21.15.156:0/1944892367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efda4137000 0x7efda41393e0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.967+0000 7efda9039700 1 --2- 172.21.15.156:0/1944892367 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efda41346e0 0x7efda4136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.967+0000 7efda9039700 1 -- 172.21.15.156:0/1944892367 >> 172.21.15.156:0/1944892367 conn(0x7efda40a2980 msgr2=0x7efda40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:46.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.967+0000 7efda9039700 1 -- 172.21.15.156:0/1944892367 shutdown_connections 2023-09-30T22:23:46.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.967+0000 7efda9039700 1 -- 172.21.15.156:0/1944892367 wait complete. 2023-09-30T22:23:46.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.968+0000 7efda9039700 1 Processor -- start 2023-09-30T22:23:46.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.968+0000 7efda9039700 1 -- start start 2023-09-30T22:23:46.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.969+0000 7efda9039700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efda4131980 0x7efda4099a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.969+0000 7efda9039700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efda41346e0 0x7efda4099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.969+0000 7efda9039700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efda4137000 0x7efda409a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.969+0000 7efda9039700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda4136cf0 con 0x7efda4131980 2023-09-30T22:23:46.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.969+0000 7efda9039700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda411e840 con 0x7efda4137000 2023-09-30T22:23:46.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.969+0000 7efda9039700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efda412ef80 con 0x7efda41346e0 2023-09-30T22:23:46.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.969+0000 7efda359e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efda4137000 0x7efda409a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.969+0000 7efda359e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efda4137000 0x7efda409a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33698/0 (socket says 172.21.15.156:33698) 2023-09-30T22:23:46.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.969+0000 7efda359e700 1 -- 172.21.15.156:0/719148991 learned_addr learned my addr 172.21.15.156:0/719148991 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:46.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.969+0000 7efda2d9d700 1 --2- 172.21.15.156:0/719148991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efda4131980 0x7efda4099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.969+0000 7efda259c700 1 --2- 172.21.15.156:0/719148991 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efda41346e0 0x7efda4099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.970+0000 7efda359e700 1 -- 172.21.15.156:0/719148991 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efda41346e0 msgr2=0x7efda4099fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.970+0000 7efda359e700 1 --2- 172.21.15.156:0/719148991 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efda41346e0 0x7efda4099fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.970+0000 7efda359e700 1 -- 172.21.15.156:0/719148991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efda4131980 msgr2=0x7efda4099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.970+0000 7efda359e700 1 --2- 172.21.15.156:0/719148991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efda4131980 0x7efda4099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.970+0000 7efda359e700 1 -- 172.21.15.156:0/719148991 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9c009a70 con 0x7efda4137000 2023-09-30T22:23:46.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.970+0000 7efda359e700 1 --2- 172.21.15.156:0/719148991 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efda4137000 0x7efda409a4e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7efd9c014040 tx=0x7efd9c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:46.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.970+0000 7efd8b7fe700 1 -- 172.21.15.156:0/719148991 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c012430 con 0x7efda4137000 2023-09-30T22:23:46.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.971+0000 7efd8b7fe700 1 -- 172.21.15.156:0/719148991 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9c020070 con 0x7efda4137000 2023-09-30T22:23:46.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.971+0000 7efda9039700 1 -- 172.21.15.156:0/719148991 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda412eb50 con 0x7efda4137000 2023-09-30T22:23:46.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.971+0000 7efd8b7fe700 1 -- 172.21.15.156:0/719148991 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c01bbd0 con 0x7efda4137000 2023-09-30T22:23:46.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.971+0000 7efda9039700 1 -- 172.21.15.156:0/719148991 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda411d3b0 con 0x7efda4137000 2023-09-30T22:23:46.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.972+0000 7efda9039700 1 -- 172.21.15.156:0/719148991 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda411e980 con 0x7efda4137000 2023-09-30T22:23:46.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.972+0000 7efd8b7fe700 1 -- 172.21.15.156:0/719148991 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efd9c01bd30 con 0x7efda4137000 2023-09-30T22:23:46.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.972+0000 7efd8b7fe700 1 -- 172.21.15.156:0/719148991 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efd9c0412c0 con 0x7efda4137000 2023-09-30T22:23:46.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:46.981+0000 7efd8b7fe700 1 -- 172.21.15.156:0/719148991 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efda411e980 con 0x7efda4137000 2023-09-30T22:23:47.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.029+0000 7f3717341700 1 -- 172.21.15.156:0/463377661 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f371006c3b0 con 0x7f371009d860 2023-09-30T22:23:47.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.030+0000 7f3705ffb700 1 -- 172.21.15.156:0/463377661 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f370c029030 con 0x7f371009d860 2023-09-30T22:23:47.031 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:47.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.032+0000 7f3717341700 1 -- 172.21.15.156:0/463377661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f371009d860 msgr2=0x7f371011e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:47.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.032+0000 7f3717341700 1 --2- 172.21.15.156:0/463377661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f371009d860 0x7f371011e440 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f371009fa00 tx=0x7f370c004750 comp rx=0 tx=0).stop 2023-09-30T22:23:47.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.032+0000 7f3717341700 1 -- 172.21.15.156:0/463377661 shutdown_connections 2023-09-30T22:23:47.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.032+0000 7f3717341700 1 --2- 172.21.15.156:0/463377661 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3710130ce0 0x7f371011eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.032+0000 7f3717341700 1 --2- 172.21.15.156:0/463377661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f371009d860 0x7f371011e440 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.032+0000 7f3717341700 1 --2- 172.21.15.156:0/463377661 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f371009e170 0x7f371011e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.032+0000 7f3717341700 1 -- 172.21.15.156:0/463377661 >> 172.21.15.156:0/463377661 conn(0x7f3710099c40 msgr2=0x7f37100721d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:47.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.032+0000 7f3717341700 1 -- 172.21.15.156:0/463377661 shutdown_connections 2023-09-30T22:23:47.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.032+0000 7f3717341700 1 -- 172.21.15.156:0/463377661 wait complete. 2023-09-30T22:23:47.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:47.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.110+0000 7ff8395cc700 1 -- 172.21.15.156:0/1132961786 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff814005590 con 0x7ff83409a7c0 2023-09-30T22:23:47.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.111+0000 7ff81b7fe700 1 -- 172.21.15.156:0/1132961786 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff828017030 con 0x7ff83409a7c0 2023-09-30T22:23:47.112 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:47.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.113+0000 7ff8395cc700 1 -- 172.21.15.156:0/1132961786 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff83409a7c0 msgr2=0x7ff83413ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:47.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.113+0000 7ff8395cc700 1 --2- 172.21.15.156:0/1132961786 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff83409a7c0 0x7ff83413ce20 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff82800c530 tx=0x7ff82800c840 comp rx=0 tx=0).stop 2023-09-30T22:23:47.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.113+0000 7ff8395cc700 1 -- 172.21.15.156:0/1132961786 shutdown_connections 2023-09-30T22:23:47.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.113+0000 7ff8395cc700 1 --2- 172.21.15.156:0/1132961786 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff834130a60 0x7ff83413d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.113+0000 7ff8395cc700 1 --2- 172.21.15.156:0/1132961786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff834099eb0 0x7ff83413c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.113+0000 7ff8395cc700 1 --2- 172.21.15.156:0/1132961786 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff83409a7c0 0x7ff83413ce20 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.113+0000 7ff8395cc700 1 -- 172.21.15.156:0/1132961786 >> 172.21.15.156:0/1132961786 conn(0x7ff8340a2980 msgr2=0x7ff83413b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:47.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.113+0000 7ff8395cc700 1 -- 172.21.15.156:0/1132961786 shutdown_connections 2023-09-30T22:23:47.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.113+0000 7ff8395cc700 1 -- 172.21.15.156:0/1132961786 wait complete. 2023-09-30T22:23:47.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:47.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.143+0000 7f864e7eb700 1 -- 172.21.15.156:0/1262928073 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f864804f2a0 con 0x7f8648130bc0 2023-09-30T22:23:47.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.143+0000 7f8644ff9700 1 -- 172.21.15.156:0/1262928073 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f863c017020 con 0x7f8648130bc0 2023-09-30T22:23:47.144 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:47.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.145+0000 7f864e7eb700 1 -- 172.21.15.156:0/1262928073 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8648130bc0 msgr2=0x7f8648071830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:47.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.145+0000 7f864e7eb700 1 --2- 172.21.15.156:0/1262928073 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8648130bc0 0x7f8648071830 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f863c00c750 tx=0x7f863c00ca60 comp rx=0 tx=0).stop 2023-09-30T22:23:47.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.145+0000 7f864e7eb700 1 -- 172.21.15.156:0/1262928073 shutdown_connections 2023-09-30T22:23:47.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.145+0000 7f864e7eb700 1 --2- 172.21.15.156:0/1262928073 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8648133ad0 0x7f8648071d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.145+0000 7f864e7eb700 1 --2- 172.21.15.156:0/1262928073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86481300a0 0x7f86480712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.145+0000 7f864e7eb700 1 --2- 172.21.15.156:0/1262928073 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8648130bc0 0x7f8648071830 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.145+0000 7f864e7eb700 1 -- 172.21.15.156:0/1262928073 >> 172.21.15.156:0/1262928073 conn(0x7f8648099c40 msgr2=0x7f86481329d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:47.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.146+0000 7f864e7eb700 1 -- 172.21.15.156:0/1262928073 shutdown_connections 2023-09-30T22:23:47.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.146+0000 7f864e7eb700 1 -- 172.21.15.156:0/1262928073 wait complete. 2023-09-30T22:23:47.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:47.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.176+0000 7efda9039700 1 -- 172.21.15.156:0/719148991 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efda411e980 con 0x7efda4137000 2023-09-30T22:23:47.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.177+0000 7efd8b7fe700 1 -- 172.21.15.156:0/719148991 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efda411e980 con 0x7efda4137000 2023-09-30T22:23:47.177 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:47.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.179+0000 7efda9039700 1 -- 172.21.15.156:0/719148991 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efda4137000 msgr2=0x7efda409a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:47.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.179+0000 7efda9039700 1 --2- 172.21.15.156:0/719148991 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efda4137000 0x7efda409a4e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7efd9c014040 tx=0x7efd9c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.179+0000 7efda9039700 1 -- 172.21.15.156:0/719148991 shutdown_connections 2023-09-30T22:23:47.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.179+0000 7efda9039700 1 --2- 172.21.15.156:0/719148991 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efda4137000 0x7efda409a4e0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.179+0000 7efda9039700 1 --2- 172.21.15.156:0/719148991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efda4131980 0x7efda4099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.179+0000 7efda9039700 1 --2- 172.21.15.156:0/719148991 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efda41346e0 0x7efda4099fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.179+0000 7efda9039700 1 -- 172.21.15.156:0/719148991 >> 172.21.15.156:0/719148991 conn(0x7efda40a2980 msgr2=0x7efda4133560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:47.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.179+0000 7efda9039700 1 -- 172.21.15.156:0/719148991 shutdown_connections 2023-09-30T22:23:47.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:47.179+0000 7efda9039700 1 -- 172.21.15.156:0/719148991 wait complete. 2023-09-30T22:23:47.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:48.047 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:48.126 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:48.160 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:48.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.185+0000 7f8d28646700 1 Processor -- start 2023-09-30T22:23:48.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.185+0000 7f8d28646700 1 -- start start 2023-09-30T22:23:48.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.186+0000 7f8d28646700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d20136960 0x7f8d20138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.186+0000 7f8d28646700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8d20139280 0x7f8d2013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.186+0000 7f8d28646700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d2006b2d0 con 0x7f8d20133ad0 2023-09-30T22:23:48.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.186+0000 7f8d28646700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d201345b0 con 0x7f8d20139280 2023-09-30T22:23:48.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.186+0000 7f8d28646700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d20133610 con 0x7f8d20136960 2023-09-30T22:23:48.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.186+0000 7f8d263e2700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f8d20133ad0 0x7f8d20133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53740/0 (socket says 172.21.15.156:53740) 2023-09-30T22:23:48.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.186+0000 7f8d263e2700 1 -- 172.21.15.156:0/3211769025 learned_addr learned my addr 172.21.15.156:0/3211769025 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:48.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.186+0000 7f8d26be3700 1 --2- 172.21.15.156:0/3211769025 >> v2:172.21.15.156:3300/0 conn(0x7f8d20139280 0x7f8d2013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.186+0000 7f8d25be1700 1 --2- 172.21.15.156:0/3211769025 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d20136960 0x7f8d20138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.187+0000 7f8d26be3700 1 -- 172.21.15.156:0/3211769025 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d20136960 msgr2=0x7f8d20138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:48.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.187+0000 7f8d26be3700 1 --2- 172.21.15.156:0/3211769025 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d20136960 0x7f8d20138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.187+0000 7f8d26be3700 1 -- 172.21.15.156:0/3211769025 >> v1:172.21.15.156:6789/0 conn(0x7f8d20133ad0 legacy=0x7f8d20133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.187+0000 7f8d253e0700 1 -- 172.21.15.156:0/3211769025 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3281834451 0 0) 0x7f8d2006b2d0 con 0x7f8d20133ad0 2023-09-30T22:23:48.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.187+0000 7f8d26be3700 1 -- 172.21.15.156:0/3211769025 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2009a500 con 0x7f8d20139280 2023-09-30T22:23:48.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.187+0000 7f8d26be3700 1 --2- 172.21.15.156:0/3211769025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d20139280 0x7f8d2013b660 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f8d18009dc0 tx=0x7f8d1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c39e6ce69e9bf1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:48.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.187+0000 7f8d253e0700 1 -- 172.21.15.156:0/3211769025 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1800e070 con 0x7f8d20139280 2023-09-30T22:23:48.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.187+0000 7f8d253e0700 1 -- 172.21.15.156:0/3211769025 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1800bb90 con 0x7f8d20139280 2023-09-30T22:23:48.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.187+0000 7f8d253e0700 1 -- 172.21.15.156:0/3211769025 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d18012430 con 0x7f8d20139280 2023-09-30T22:23:48.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.188+0000 7f8d28646700 1 -- 172.21.15.156:0/3211769025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d20139280 msgr2=0x7f8d2013b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.188+0000 7f8d28646700 1 --2- 172.21.15.156:0/3211769025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d20139280 0x7f8d2013b660 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f8d18009dc0 tx=0x7f8d1800b330 comp rx=0 tx=0).stop 2023-09-30T22:23:48.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.188+0000 7f8d28646700 1 -- 172.21.15.156:0/3211769025 shutdown_connections 2023-09-30T22:23:48.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.188+0000 7f8d28646700 1 --2- 172.21.15.156:0/3211769025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d20139280 0x7f8d2013b660 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.188+0000 7f8d28646700 1 --2- 172.21.15.156:0/3211769025 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d20136960 0x7f8d20138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.188+0000 7f8d28646700 1 -- 172.21.15.156:0/3211769025 >> 172.21.15.156:0/3211769025 conn(0x7f8d20099c40 msgr2=0x7f8d200a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:48.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.188+0000 7f8d28646700 1 -- 172.21.15.156:0/3211769025 shutdown_connections 2023-09-30T22:23:48.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.188+0000 7f8d28646700 1 -- 172.21.15.156:0/3211769025 wait complete. 2023-09-30T22:23:48.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.189+0000 7f8d28646700 1 Processor -- start 2023-09-30T22:23:48.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.189+0000 7f8d28646700 1 -- start start 2023-09-30T22:23:48.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.190+0000 7f8d28646700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d20133ad0 0x7f8d200710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.190+0000 7f8d28646700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d20136960 0x7f8d20071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.190+0000 7f8d28646700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d20139280 0x7f8d20071b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.190+0000 7f8d28646700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2006f720 con 0x7f8d20133ad0 2023-09-30T22:23:48.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.190+0000 7f8d28646700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d20070300 con 0x7f8d20139280 2023-09-30T22:23:48.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.190+0000 7f8d28646700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2009f390 con 0x7f8d20136960 2023-09-30T22:23:48.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.190+0000 7f8d263e2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d20133ad0 0x7f8d200710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.190+0000 7f8d25be1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d20136960 0x7f8d20071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.190+0000 7f8d26be3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d20139280 0x7f8d20071b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.190+0000 7f8d263e2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d20133ad0 0x7f8d200710e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54692/0 (socket says 172.21.15.156:54692) 2023-09-30T22:23:48.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.190+0000 7f8d263e2700 1 -- 172.21.15.156:0/3854274987 learned_addr learned my addr 172.21.15.156:0/3854274987 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:48.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.190+0000 7f8d26be3700 1 -- 172.21.15.156:0/3854274987 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d20136960 msgr2=0x7f8d20071620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.190+0000 7f8d26be3700 1 --2- 172.21.15.156:0/3854274987 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d20136960 0x7f8d20071620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.190+0000 7f8d26be3700 1 -- 172.21.15.156:0/3854274987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d20133ad0 msgr2=0x7f8d200710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.190+0000 7f8d26be3700 1 --2- 172.21.15.156:0/3854274987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d20133ad0 0x7f8d200710e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.190+0000 7f8d26be3700 1 -- 172.21.15.156:0/3854274987 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d18009a70 con 0x7f8d20139280 2023-09-30T22:23:48.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.190+0000 7f8d263e2700 1 --2- 172.21.15.156:0/3854274987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d20133ad0 0x7f8d200710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:48.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.190+0000 7f8d26be3700 1 --2- 172.21.15.156:0/3854274987 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d20139280 0x7f8d20071b60 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8d18016000 tx=0x7f8d18004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:48.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.191+0000 7f8d16ffd700 1 -- 172.21.15.156:0/3854274987 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d18012430 con 0x7f8d20139280 2023-09-30T22:23:48.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.191+0000 7f8d16ffd700 1 -- 172.21.15.156:0/3854274987 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d18020070 con 0x7f8d20139280 2023-09-30T22:23:48.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.191+0000 7f8d16ffd700 1 -- 172.21.15.156:0/3854274987 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d18004280 con 0x7f8d20139280 2023-09-30T22:23:48.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.191+0000 7f8d28646700 1 -- 172.21.15.156:0/3854274987 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d20070700 con 0x7f8d20139280 2023-09-30T22:23:48.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.191+0000 7f8d28646700 1 -- 172.21.15.156:0/3854274987 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d20070c90 con 0x7f8d20139280 2023-09-30T22:23:48.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.191+0000 7f8d16ffd700 1 -- 172.21.15.156:0/3854274987 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d180043e0 con 0x7f8d20139280 2023-09-30T22:23:48.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.192+0000 7f8d16ffd700 1 -- 172.21.15.156:0/3854274987 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8d18022070 con 0x7f8d20139280 2023-09-30T22:23:48.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.192+0000 7f8d28646700 1 -- 172.21.15.156:0/3854274987 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d2004f2a0 con 0x7f8d20139280 2023-09-30T22:23:48.195 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:48.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.197+0000 7f8d16ffd700 1 -- 172.21.15.156:0/3854274987 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d1801b400 con 0x7f8d20139280 2023-09-30T22:23:48.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.272+0000 7fdd9b220700 1 Processor -- start 2023-09-30T22:23:48.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.272+0000 7fdd9b220700 1 -- start start 2023-09-30T22:23:48.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.273+0000 7fdd9b220700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdd94134140 0x7fdd94138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.273+0000 7fdd9b220700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdd941345a0 0x7fdd9413b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.273+0000 7fdd9b220700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd9409b110 con 0x7fdd9409ad40 2023-09-30T22:23:48.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.273+0000 7fdd9b220700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd940a3b60 con 0x7fdd94134140 2023-09-30T22:23:48.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.273+0000 7fdd9b220700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd940a1a80 con 0x7fdd941345a0 2023-09-30T22:23:48.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.273+0000 7fdd93fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdd94134140 0x7fdd94138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.273+0000 7fdd98fbc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fdd9409ad40 0x7fdd94133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53748/0 (socket says 172.21.15.156:53748) 2023-09-30T22:23:48.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.273+0000 7fdd98fbc700 1 -- 172.21.15.156:0/3876301528 learned_addr learned my addr 172.21.15.156:0/3876301528 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:48.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.273+0000 7fdd997bd700 1 --2- 172.21.15.156:0/3876301528 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdd941345a0 0x7fdd9413b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.273+0000 7fdd937fe700 1 -- 172.21.15.156:0/3876301528 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3209166184 0 0) 0x7fdd9409b110 con 0x7fdd9409ad40 2023-09-30T22:23:48.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.273+0000 7fdd937fe700 1 -- 172.21.15.156:0/3876301528 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd840035b0 con 0x7fdd9409ad40 2023-09-30T22:23:48.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.273+0000 7fdd997bd700 1 -- 172.21.15.156:0/3876301528 >> v2:172.21.15.156:3300/0 conn(0x7fdd94134140 msgr2=0x7fdd94138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:48.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.273+0000 7fdd997bd700 1 --2- 172.21.15.156:0/3876301528 >> v2:172.21.15.156:3300/0 conn(0x7fdd94134140 0x7fdd94138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.273+0000 7fdd997bd700 1 -- 172.21.15.156:0/3876301528 >> v1:172.21.15.156:6789/0 conn(0x7fdd9409ad40 legacy=0x7fdd94133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.273+0000 7fdd997bd700 1 -- 172.21.15.156:0/3876301528 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd940a2fa0 con 0x7fdd941345a0 2023-09-30T22:23:48.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.274+0000 7fdd997bd700 1 --2- 172.21.15.156:0/3876301528 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdd941345a0 0x7fdd9413b3d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c009d90 tx=0x7fdd8c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=894aa2c060dde584 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:48.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.274+0000 7fdd937fe700 1 -- 172.21.15.156:0/3876301528 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c00e070 con 0x7fdd941345a0 2023-09-30T22:23:48.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.274+0000 7fdd937fe700 1 -- 172.21.15.156:0/3876301528 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c00bb20 con 0x7fdd941345a0 2023-09-30T22:23:48.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.274+0000 7fdd937fe700 1 -- 172.21.15.156:0/3876301528 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c00be90 con 0x7fdd941345a0 2023-09-30T22:23:48.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.274+0000 7fdd9b220700 1 -- 172.21.15.156:0/3876301528 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdd941345a0 msgr2=0x7fdd9413b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.274+0000 7fdd9b220700 1 --2- 172.21.15.156:0/3876301528 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdd941345a0 0x7fdd9413b3d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c009d90 tx=0x7fdd8c00b330 comp rx=0 tx=0).stop 2023-09-30T22:23:48.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.274+0000 7fdd9b220700 1 -- 172.21.15.156:0/3876301528 shutdown_connections 2023-09-30T22:23:48.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.274+0000 7fdd9b220700 1 --2- 172.21.15.156:0/3876301528 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdd941345a0 0x7fdd9413b3d0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.274+0000 7fdd9b220700 1 --2- 172.21.15.156:0/3876301528 >> v2:172.21.15.156:3300/0 conn(0x7fdd94134140 0x7fdd94138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.274+0000 7fdd9b220700 1 -- 172.21.15.156:0/3876301528 >> 172.21.15.156:0/3876301528 conn(0x7fdd94099c40 msgr2=0x7fdd9406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:48.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.275+0000 7fdd9b220700 1 -- 172.21.15.156:0/3876301528 shutdown_connections 2023-09-30T22:23:48.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.275+0000 7fdd9b220700 1 -- 172.21.15.156:0/3876301528 wait complete. 2023-09-30T22:23:48.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.276+0000 7fdd9b220700 1 Processor -- start 2023-09-30T22:23:48.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.276+0000 7fdd9b220700 1 -- start start 2023-09-30T22:23:48.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.277+0000 7fdd9b220700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd9409ad40 0x7fdd941392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.277+0000 7fdd9b220700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd94134140 0x7fdd94139810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.277+0000 7fdd9b220700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdd941345a0 0x7fdd94139d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.277+0000 7fdd9b220700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9411e6b0 con 0x7fdd94134140 2023-09-30T22:23:48.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.277+0000 7fdd9b220700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd940a6f40 con 0x7fdd9409ad40 2023-09-30T22:23:48.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.277+0000 7fdd9b220700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9411f5c0 con 0x7fdd941345a0 2023-09-30T22:23:48.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.277+0000 7fdd93fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd94134140 0x7fdd94139810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.277+0000 7fdd93fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd94134140 0x7fdd94139810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54716/0 (socket says 172.21.15.156:54716) 2023-09-30T22:23:48.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.277+0000 7fdd93fff700 1 -- 172.21.15.156:0/3555072813 learned_addr learned my addr 172.21.15.156:0/3555072813 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:48.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.277+0000 7fdd997bd700 1 --2- 172.21.15.156:0/3555072813 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdd941345a0 0x7fdd94139d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.277+0000 7fdd93fff700 1 -- 172.21.15.156:0/3555072813 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdd941345a0 msgr2=0x7fdd94139d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.277+0000 7fdd93fff700 1 --2- 172.21.15.156:0/3555072813 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdd941345a0 0x7fdd94139d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.277+0000 7fdd93fff700 1 -- 172.21.15.156:0/3555072813 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd9409ad40 msgr2=0x7fdd941392d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.277+0000 7fdd93fff700 1 --2- 172.21.15.156:0/3555072813 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd9409ad40 0x7fdd941392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.277+0000 7fdd93fff700 1 -- 172.21.15.156:0/3555072813 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c009a70 con 0x7fdd94134140 2023-09-30T22:23:48.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.278+0000 7fdd93fff700 1 --2- 172.21.15.156:0/3555072813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd94134140 0x7fdd94139810 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fdd8000e9b0 tx=0x7fdd8000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:48.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.278+0000 7fdd917fa700 1 -- 172.21.15.156:0/3555072813 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd80009710 con 0x7fdd94134140 2023-09-30T22:23:48.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.278+0000 7fdd917fa700 1 -- 172.21.15.156:0/3555072813 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8000c850 con 0x7fdd94134140 2023-09-30T22:23:48.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.278+0000 7fdd917fa700 1 -- 172.21.15.156:0/3555072813 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8000cbc0 con 0x7fdd94134140 2023-09-30T22:23:48.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.278+0000 7fdd9b220700 1 -- 172.21.15.156:0/3555072813 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd9411ce50 con 0x7fdd94134140 2023-09-30T22:23:48.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.278+0000 7fdd9b220700 1 -- 172.21.15.156:0/3555072813 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd9411d4d0 con 0x7fdd94134140 2023-09-30T22:23:48.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.279+0000 7fdd917fa700 1 -- 172.21.15.156:0/3555072813 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdd8000cd20 con 0x7fdd94134140 2023-09-30T22:23:48.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.279+0000 7fdd9b220700 1 -- 172.21.15.156:0/3555072813 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd9411db30 con 0x7fdd94134140 2023-09-30T22:23:48.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.279+0000 7fdd917fa700 1 -- 172.21.15.156:0/3555072813 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdd8003fbb0 con 0x7fdd94134140 2023-09-30T22:23:48.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.288+0000 7fdd917fa700 1 -- 172.21.15.156:0/3555072813 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdd8001ad70 con 0x7fdd94134140 2023-09-30T22:23:48.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.309+0000 7f25c6a35700 1 Processor -- start 2023-09-30T22:23:48.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.309+0000 7f25c6a35700 1 -- start start 2023-09-30T22:23:48.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.309+0000 7f25c6a35700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25c0138040 0x7f25c0138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.309+0000 7f25c6a35700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f25c00a1400 0x7f25c013fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.309+0000 7f25c6a35700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c01379e0 con 0x7f25c00a08e0 2023-09-30T22:23:48.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.309+0000 7f25c6a35700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c00a2100 con 0x7f25c00a1400 2023-09-30T22:23:48.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.309+0000 7f25c6a35700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c0138950 con 0x7f25c0138040 2023-09-30T22:23:48.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.309+0000 7f25bffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25c0138040 0x7f25c0138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.310+0000 7f25bffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25c0138040 0x7f25c0138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33740/0 (socket says 172.21.15.156:33740) 2023-09-30T22:23:48.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.310+0000 7f25bffff700 1 -- 172.21.15.156:0/54581477 learned_addr learned my addr 172.21.15.156:0/54581477 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:48.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.310+0000 7f25c4fd2700 1 --2- 172.21.15.156:0/54581477 >> v2:172.21.15.156:3300/0 conn(0x7f25c00a1400 0x7f25c013fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.310+0000 7f25bffff700 1 -- 172.21.15.156:0/54581477 >> v2:172.21.15.156:3300/0 conn(0x7f25c00a1400 msgr2=0x7f25c013fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:48.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.310+0000 7f25bffff700 1 --2- 172.21.15.156:0/54581477 >> v2:172.21.15.156:3300/0 conn(0x7f25c00a1400 0x7f25c013fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.310+0000 7f25bffff700 1 -- 172.21.15.156:0/54581477 >> v1:172.21.15.156:6789/0 conn(0x7f25c00a08e0 legacy=0x7f25c00a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.310+0000 7f25bffff700 1 -- 172.21.15.156:0/54581477 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c009b9b0 con 0x7f25c0138040 2023-09-30T22:23:48.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.310+0000 7f25bffff700 1 --2- 172.21.15.156:0/54581477 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25c0138040 0x7f25c0138410 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f25b00098f0 tx=0x7f25b0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=564ab0b02a02c3a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:48.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.310+0000 7f25beffd700 1 -- 172.21.15.156:0/54581477 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b0005e30 con 0x7f25c0138040 2023-09-30T22:23:48.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.310+0000 7f25beffd700 1 -- 172.21.15.156:0/54581477 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b0004030 con 0x7f25c0138040 2023-09-30T22:23:48.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.310+0000 7f25beffd700 1 -- 172.21.15.156:0/54581477 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b00043e0 con 0x7f25c0138040 2023-09-30T22:23:48.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.311+0000 7f25c6a35700 1 -- 172.21.15.156:0/54581477 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25c0138040 msgr2=0x7f25c0138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.311+0000 7f25c6a35700 1 --2- 172.21.15.156:0/54581477 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25c0138040 0x7f25c0138410 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f25b00098f0 tx=0x7f25b0009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:48.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.311+0000 7f25c6a35700 1 -- 172.21.15.156:0/54581477 shutdown_connections 2023-09-30T22:23:48.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.311+0000 7f25c6a35700 1 --2- 172.21.15.156:0/54581477 >> v2:172.21.15.156:3300/0 conn(0x7f25c00a1400 0x7f25c013fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.311+0000 7f25c6a35700 1 --2- 172.21.15.156:0/54581477 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25c0138040 0x7f25c0138410 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.311+0000 7f25c6a35700 1 -- 172.21.15.156:0/54581477 >> 172.21.15.156:0/54581477 conn(0x7f25c00a2980 msgr2=0x7f25c00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:48.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.311+0000 7f25c6a35700 1 -- 172.21.15.156:0/54581477 shutdown_connections 2023-09-30T22:23:48.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.311+0000 7f25c6a35700 1 -- 172.21.15.156:0/54581477 wait complete. 2023-09-30T22:23:48.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.312+0000 7f25c6a35700 1 Processor -- start 2023-09-30T22:23:48.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.312+0000 7f25c6a35700 1 -- start start 2023-09-30T22:23:48.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.313+0000 7f25c6a35700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25c00a08e0 0x7f25c013e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.313+0000 7f25c6a35700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25c00a1400 0x7f25c0135b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.313+0000 7f25c6a35700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25c0138040 0x7f25c0136050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.313+0000 7f25c6a35700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c013f5a0 con 0x7f25c00a1400 2023-09-30T22:23:48.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.313+0000 7f25c6a35700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c013f3b0 con 0x7f25c0138040 2023-09-30T22:23:48.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.313+0000 7f25c6a35700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25c009c890 con 0x7f25c00a08e0 2023-09-30T22:23:48.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.313+0000 7f25bffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25c00a08e0 0x7f25c013e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.313+0000 7f25bffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25c00a08e0 0x7f25c013e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33872/0 (socket says 172.21.15.156:33872) 2023-09-30T22:23:48.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.313+0000 7f25bffff700 1 -- 172.21.15.156:0/3777124111 learned_addr learned my addr 172.21.15.156:0/3777124111 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:48.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.313+0000 7f25c4fd2700 1 --2- 172.21.15.156:0/3777124111 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25c0138040 0x7f25c0136050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.313+0000 7f25c4fd2700 1 -- 172.21.15.156:0/3777124111 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25c00a08e0 msgr2=0x7f25c013e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.313+0000 7f25c4fd2700 1 --2- 172.21.15.156:0/3777124111 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25c00a08e0 0x7f25c013e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.313+0000 7f25c4fd2700 1 -- 172.21.15.156:0/3777124111 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25c00a1400 msgr2=0x7f25c0135b10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:23:48.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.313+0000 7f25c4fd2700 1 --2- 172.21.15.156:0/3777124111 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25c00a1400 0x7f25c0135b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.313+0000 7f25c4fd2700 1 -- 172.21.15.156:0/3777124111 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b0009500 con 0x7f25c0138040 2023-09-30T22:23:48.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.313+0000 7f25bffff700 1 --2- 172.21.15.156:0/3777124111 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25c00a08e0 0x7f25c013e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:48.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.313+0000 7f25c4fd2700 1 --2- 172.21.15.156:0/3777124111 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25c0138040 0x7f25c0136050 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f25b800eba0 tx=0x7f25b800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:48.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.313+0000 7f25bcff9700 1 -- 172.21.15.156:0/3777124111 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b800ca30 con 0x7f25c0138040 2023-09-30T22:23:48.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.313+0000 7f25bcff9700 1 -- 172.21.15.156:0/3777124111 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b800f040 con 0x7f25c0138040 2023-09-30T22:23:48.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.313+0000 7f25c6a35700 1 -- 172.21.15.156:0/3777124111 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c0140ae0 con 0x7f25c0138040 2023-09-30T22:23:48.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.313+0000 7f25bcff9700 1 -- 172.21.15.156:0/3777124111 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b800cdd0 con 0x7f25c0138040 2023-09-30T22:23:48.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.314+0000 7f25c6a35700 1 -- 172.21.15.156:0/3777124111 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c01194f0 con 0x7f25c0138040 2023-09-30T22:23:48.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.314+0000 7f25bcff9700 1 -- 172.21.15.156:0/3777124111 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25b8014480 con 0x7f25c0138040 2023-09-30T22:23:48.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.315+0000 7f25bcff9700 1 -- 172.21.15.156:0/3777124111 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f25b803ff40 con 0x7f25c0138040 2023-09-30T22:23:48.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.315+0000 7f25c6a35700 1 -- 172.21.15.156:0/3777124111 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c01194f0 con 0x7f25c0138040 2023-09-30T22:23:48.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.324+0000 7f25bcff9700 1 -- 172.21.15.156:0/3777124111 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25c01194f0 con 0x7f25c0138040 2023-09-30T22:23:48.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.338+0000 7f752b843700 1 Processor -- start 2023-09-30T22:23:48.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.339+0000 7f752b843700 1 -- start start 2023-09-30T22:23:48.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.339+0000 7f752b843700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75240a0a70 0x7f75240a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.339+0000 7f752b843700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f75240a1380 0x7f7524133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.339+0000 7f752b843700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f752409dc00 con 0x7f7524133f50 2023-09-30T22:23:48.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.339+0000 7f752b843700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752409ea60 con 0x7f75240a1380 2023-09-30T22:23:48.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.339+0000 7f752b843700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752409dec0 con 0x7f75240a0a70 2023-09-30T22:23:48.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.340+0000 7f7528dde700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f75240a1380 0x7f7524133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.340+0000 7f7528dde700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f75240a1380 0x7f7524133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54736/0 (socket says 172.21.15.156:54736) 2023-09-30T22:23:48.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.340+0000 7f7528dde700 1 -- 172.21.15.156:0/4082372302 learned_addr learned my addr 172.21.15.156:0/4082372302 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:48.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.340+0000 7f75295df700 1 --2- 172.21.15.156:0/4082372302 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75240a0a70 0x7f75240a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.340+0000 7f7528dde700 1 -- 172.21.15.156:0/4082372302 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75240a0a70 msgr2=0x7f75240a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:48.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.340+0000 7f7528dde700 1 --2- 172.21.15.156:0/4082372302 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75240a0a70 0x7f75240a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.340+0000 7f7528dde700 1 -- 172.21.15.156:0/4082372302 >> v1:172.21.15.156:6789/0 conn(0x7f7524133f50 legacy=0x7f752413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.340+0000 7f7528dde700 1 -- 172.21.15.156:0/4082372302 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752409e6a0 con 0x7f75240a1380 2023-09-30T22:23:48.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.340+0000 7f7528dde700 1 --2- 172.21.15.156:0/4082372302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75240a1380 0x7f7524133a10 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f75140098f0 tx=0x7f7514009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75cb4b9094708a57 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:48.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.341+0000 7f751bfff700 1 -- 172.21.15.156:0/4082372302 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7514011830 con 0x7f75240a1380 2023-09-30T22:23:48.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.341+0000 7f751bfff700 1 -- 172.21.15.156:0/4082372302 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7514011990 con 0x7f75240a1380 2023-09-30T22:23:48.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.341+0000 7f751bfff700 1 -- 172.21.15.156:0/4082372302 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7514011d20 con 0x7f75240a1380 2023-09-30T22:23:48.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.341+0000 7f752b843700 1 -- 172.21.15.156:0/4082372302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75240a1380 msgr2=0x7f7524133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.341+0000 7f752b843700 1 --2- 172.21.15.156:0/4082372302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75240a1380 0x7f7524133a10 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f75140098f0 tx=0x7f7514009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:48.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.341+0000 7f752b843700 1 -- 172.21.15.156:0/4082372302 shutdown_connections 2023-09-30T22:23:48.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.341+0000 7f752b843700 1 --2- 172.21.15.156:0/4082372302 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75240a0a70 0x7f75240a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.341+0000 7f752b843700 1 --2- 172.21.15.156:0/4082372302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75240a1380 0x7f7524133a10 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.341+0000 7f752b843700 1 -- 172.21.15.156:0/4082372302 >> 172.21.15.156:0/4082372302 conn(0x7f75240a6610 msgr2=0x7f75240a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:48.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.342+0000 7f752b843700 1 -- 172.21.15.156:0/4082372302 shutdown_connections 2023-09-30T22:23:48.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.342+0000 7f752b843700 1 -- 172.21.15.156:0/4082372302 wait complete. 2023-09-30T22:23:48.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.343+0000 7f752b843700 1 Processor -- start 2023-09-30T22:23:48.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.343+0000 7f752b843700 1 -- start start 2023-09-30T22:23:48.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.343+0000 7f752b843700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75240a0a70 0x7f75241c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.343+0000 7f752b843700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75240a1380 0x7f75241c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.343+0000 7f752b843700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7524133f50 0x7f75241c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.343+0000 7f752b843700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75241253f0 con 0x7f7524133f50 2023-09-30T22:23:48.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.343+0000 7f752b843700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7524124680 con 0x7f75240a1380 2023-09-30T22:23:48.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.343+0000 7f752b843700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7524122f50 con 0x7f75240a0a70 2023-09-30T22:23:48.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.344+0000 7f7529de0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7524133f50 0x7f75241c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.344+0000 7f7529de0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7524133f50 0x7f75241c8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54752/0 (socket says 172.21.15.156:54752) 2023-09-30T22:23:48.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.344+0000 7f7529de0700 1 -- 172.21.15.156:0/2257229531 learned_addr learned my addr 172.21.15.156:0/2257229531 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:48.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.344+0000 7f7528dde700 1 --2- 172.21.15.156:0/2257229531 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75240a1380 0x7f75241c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.344+0000 7f7529de0700 1 -- 172.21.15.156:0/2257229531 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75240a0a70 msgr2=0x7f75241c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.344+0000 7f7529de0700 1 --2- 172.21.15.156:0/2257229531 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75240a0a70 0x7f75241c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.344+0000 7f7529de0700 1 -- 172.21.15.156:0/2257229531 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75240a1380 msgr2=0x7f75241c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.344+0000 7f7529de0700 1 --2- 172.21.15.156:0/2257229531 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75240a1380 0x7f75241c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.344+0000 7f7529de0700 1 -- 172.21.15.156:0/2257229531 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7514009550 con 0x7f7524133f50 2023-09-30T22:23:48.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.344+0000 7f7529de0700 1 --2- 172.21.15.156:0/2257229531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7524133f50 0x7f75241c8cf0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f751c00cc80 tx=0x7f751c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:48.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.344+0000 7f7519ffb700 1 -- 172.21.15.156:0/2257229531 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c003c00 con 0x7f7524133f50 2023-09-30T22:23:48.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.344+0000 7f7519ffb700 1 -- 172.21.15.156:0/2257229531 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751c003d60 con 0x7f7524133f50 2023-09-30T22:23:48.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.344+0000 7f752b843700 1 -- 172.21.15.156:0/2257229531 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75240a0450 con 0x7f7524133f50 2023-09-30T22:23:48.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.344+0000 7f7519ffb700 1 -- 172.21.15.156:0/2257229531 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c00aaf0 con 0x7f7524133f50 2023-09-30T22:23:48.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.345+0000 7f752b843700 1 -- 172.21.15.156:0/2257229531 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7524126d20 con 0x7f7524133f50 2023-09-30T22:23:48.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.346+0000 7f752b843700 1 -- 172.21.15.156:0/2257229531 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752404f2a0 con 0x7f7524133f50 2023-09-30T22:23:48.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.346+0000 7f7519ffb700 1 -- 172.21.15.156:0/2257229531 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f751c00ac50 con 0x7f7524133f50 2023-09-30T22:23:48.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.348+0000 7f7519ffb700 1 -- 172.21.15.156:0/2257229531 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f751c005880 con 0x7f7524133f50 2023-09-30T22:23:48.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.355+0000 7f7519ffb700 1 -- 172.21.15.156:0/2257229531 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f751c025430 con 0x7f7524133f50 2023-09-30T22:23:48.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.408+0000 7f8d28646700 1 -- 172.21.15.156:0/3854274987 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8d2009f0f0 con 0x7f8d20139280 2023-09-30T22:23:48.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.408+0000 7f8d16ffd700 1 -- 172.21.15.156:0/3854274987 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8d1802c020 con 0x7f8d20139280 2023-09-30T22:23:48.409 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:48.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.410+0000 7f8d28646700 1 -- 172.21.15.156:0/3854274987 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d20139280 msgr2=0x7f8d20071b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.410+0000 7f8d28646700 1 --2- 172.21.15.156:0/3854274987 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d20139280 0x7f8d20071b60 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8d18016000 tx=0x7f8d18004ad0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.410+0000 7f8d28646700 1 -- 172.21.15.156:0/3854274987 shutdown_connections 2023-09-30T22:23:48.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.411+0000 7f8d28646700 1 --2- 172.21.15.156:0/3854274987 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d20139280 0x7f8d20071b60 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.411+0000 7f8d28646700 1 --2- 172.21.15.156:0/3854274987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d20133ad0 0x7f8d200710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.411+0000 7f8d28646700 1 --2- 172.21.15.156:0/3854274987 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d20136960 0x7f8d20071620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.411+0000 7f8d28646700 1 -- 172.21.15.156:0/3854274987 >> 172.21.15.156:0/3854274987 conn(0x7f8d20099c40 msgr2=0x7f8d20134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:48.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.412+0000 7f8d28646700 1 -- 172.21.15.156:0/3854274987 shutdown_connections 2023-09-30T22:23:48.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.412+0000 7f8d28646700 1 -- 172.21.15.156:0/3854274987 wait complete. 2023-09-30T22:23:48.425 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:48.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.512+0000 7fdd9b220700 1 -- 172.21.15.156:0/3555072813 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdd9404f2a0 con 0x7fdd94134140 2023-09-30T22:23:48.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.512+0000 7fdd917fa700 1 -- 172.21.15.156:0/3555072813 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdd80017030 con 0x7fdd94134140 2023-09-30T22:23:48.513 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:48.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.515+0000 7fdd9b220700 1 -- 172.21.15.156:0/3555072813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd94134140 msgr2=0x7fdd94139810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.515+0000 7fdd9b220700 1 --2- 172.21.15.156:0/3555072813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd94134140 0x7fdd94139810 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fdd8000e9b0 tx=0x7fdd8000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.515+0000 7fdd9b220700 1 -- 172.21.15.156:0/3555072813 shutdown_connections 2023-09-30T22:23:48.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.515+0000 7fdd9b220700 1 --2- 172.21.15.156:0/3555072813 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdd941345a0 0x7fdd94139d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.515+0000 7fdd9b220700 1 --2- 172.21.15.156:0/3555072813 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd9409ad40 0x7fdd941392d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.515+0000 7fdd9b220700 1 --2- 172.21.15.156:0/3555072813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd94134140 0x7fdd94139810 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.515+0000 7fdd9b220700 1 -- 172.21.15.156:0/3555072813 >> 172.21.15.156:0/3555072813 conn(0x7fdd94099c40 msgr2=0x7fdd940a4110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:48.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.515+0000 7fdd9b220700 1 -- 172.21.15.156:0/3555072813 shutdown_connections 2023-09-30T22:23:48.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.515+0000 7fdd9b220700 1 -- 172.21.15.156:0/3555072813 wait complete. 2023-09-30T22:23:48.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.523+0000 7f25c6a35700 1 -- 172.21.15.156:0/3777124111 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f25c0118e60 con 0x7f25c0138040 2023-09-30T22:23:48.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.524+0000 7f25bcff9700 1 -- 172.21.15.156:0/3777124111 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25c0118e60 con 0x7f25c0138040 2023-09-30T22:23:48.524 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:48.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.527+0000 7f25c6a35700 1 -- 172.21.15.156:0/3777124111 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25c0138040 msgr2=0x7f25c0136050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.527+0000 7f25c6a35700 1 --2- 172.21.15.156:0/3777124111 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25c0138040 0x7f25c0136050 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f25b800eba0 tx=0x7f25b800eeb0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.527+0000 7f25c6a35700 1 -- 172.21.15.156:0/3777124111 shutdown_connections 2023-09-30T22:23:48.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.527+0000 7f25c6a35700 1 --2- 172.21.15.156:0/3777124111 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25c0138040 0x7f25c0136050 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.527+0000 7f25c6a35700 1 --2- 172.21.15.156:0/3777124111 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25c00a08e0 0x7f25c013e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.527+0000 7f25c6a35700 1 --2- 172.21.15.156:0/3777124111 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25c00a1400 0x7f25c0135b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.527+0000 7f25c6a35700 1 -- 172.21.15.156:0/3777124111 >> 172.21.15.156:0/3777124111 conn(0x7f25c00a2980 msgr2=0x7f25c009f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:48.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.528+0000 7f25c6a35700 1 -- 172.21.15.156:0/3777124111 shutdown_connections 2023-09-30T22:23:48.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.528+0000 7f25c6a35700 1 -- 172.21.15.156:0/3777124111 wait complete. 2023-09-30T22:23:48.532 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:48.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:48.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.550+0000 7f752b843700 1 -- 172.21.15.156:0/2257229531 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f75240a0450 con 0x7f7524133f50 2023-09-30T22:23:48.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.551+0000 7f7519ffb700 1 -- 172.21.15.156:0/2257229531 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f75240a0450 con 0x7f7524133f50 2023-09-30T22:23:48.551 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:48.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.553+0000 7f752b843700 1 -- 172.21.15.156:0/2257229531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7524133f50 msgr2=0x7f75241c8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.553+0000 7f752b843700 1 --2- 172.21.15.156:0/2257229531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7524133f50 0x7f75241c8cf0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f751c00cc80 tx=0x7f751c00cf90 comp rx=0 tx=0).stop 2023-09-30T22:23:48.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.553+0000 7f752b843700 1 -- 172.21.15.156:0/2257229531 shutdown_connections 2023-09-30T22:23:48.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.553+0000 7f752b843700 1 --2- 172.21.15.156:0/2257229531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7524133f50 0x7f75241c8cf0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.553+0000 7f752b843700 1 --2- 172.21.15.156:0/2257229531 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75240a0a70 0x7f75241c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.553+0000 7f752b843700 1 --2- 172.21.15.156:0/2257229531 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75240a1380 0x7f75241c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.553+0000 7f752b843700 1 -- 172.21.15.156:0/2257229531 >> 172.21.15.156:0/2257229531 conn(0x7f75240a6610 msgr2=0x7f75240a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:48.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.553+0000 7f752b843700 1 -- 172.21.15.156:0/2257229531 shutdown_connections 2023-09-30T22:23:48.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:48.553+0000 7f752b843700 1 -- 172.21.15.156:0/2257229531 wait complete. 2023-09-30T22:23:48.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:49.426 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:49.533 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:49.542 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:49.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.554+0000 7fe890517700 1 Processor -- start 2023-09-30T22:23:49.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.554+0000 7fe890517700 1 -- start start 2023-09-30T22:23:49.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.554+0000 7fe890517700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe888133a70 0x7fe888133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:49.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.554+0000 7fe890517700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe8880a08e0 0x7fe8880a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:49.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.554+0000 7fe890517700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe888133640 con 0x7fe8880a1290 2023-09-30T22:23:49.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.554+0000 7fe890517700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8880a1d50 con 0x7fe888133a70 2023-09-30T22:23:49.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.554+0000 7fe890517700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8880a1710 con 0x7fe8880a08e0 2023-09-30T22:23:49.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.555+0000 7fe88e2b3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe888133a70 0x7fe888133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:49.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.555+0000 7fe88dab2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe8880a08e0 0x7fe8880a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:49.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.555+0000 7fe88eab4700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe8880a1290 0x7fe88813a970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53774/0 (socket says 172.21.15.156:53774) 2023-09-30T22:23:49.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.555+0000 7fe88eab4700 1 -- 172.21.15.156:0/3895719130 learned_addr learned my addr 172.21.15.156:0/3895719130 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:49.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.555+0000 7fe88dab2700 1 -- 172.21.15.156:0/3895719130 >> v2:172.21.15.156:3300/0 conn(0x7fe888133a70 msgr2=0x7fe888133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:49.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.555+0000 7fe88dab2700 1 --2- 172.21.15.156:0/3895719130 >> v2:172.21.15.156:3300/0 conn(0x7fe888133a70 0x7fe888133e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.555+0000 7fe88dab2700 1 -- 172.21.15.156:0/3895719130 >> v1:172.21.15.156:6789/0 conn(0x7fe8880a1290 legacy=0x7fe88813a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:49.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.555+0000 7fe88dab2700 1 -- 172.21.15.156:0/3895719130 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88809b620 con 0x7fe8880a08e0 2023-09-30T22:23:49.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.555+0000 7fe88dab2700 1 --2- 172.21.15.156:0/3895719130 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe8880a08e0 0x7fe8880a0d50 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe878009840 tx=0x7fe878009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=669634148413c04 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:49.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.555+0000 7fe88d2b1700 1 -- 172.21.15.156:0/3895719130 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe878011830 con 0x7fe8880a08e0 2023-09-30T22:23:49.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.555+0000 7fe88d2b1700 1 -- 172.21.15.156:0/3895719130 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe878011990 con 0x7fe8880a08e0 2023-09-30T22:23:49.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.555+0000 7fe88d2b1700 1 -- 172.21.15.156:0/3895719130 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe878011d20 con 0x7fe8880a08e0 2023-09-30T22:23:49.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.556+0000 7fe890517700 1 -- 172.21.15.156:0/3895719130 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe8880a08e0 msgr2=0x7fe8880a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:49.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.556+0000 7fe890517700 1 --2- 172.21.15.156:0/3895719130 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe8880a08e0 0x7fe8880a0d50 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe878009840 tx=0x7fe878009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:49.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.556+0000 7fe890517700 1 -- 172.21.15.156:0/3895719130 shutdown_connections 2023-09-30T22:23:49.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.556+0000 7fe890517700 1 --2- 172.21.15.156:0/3895719130 >> v2:172.21.15.156:3300/0 conn(0x7fe888133a70 0x7fe888133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.556+0000 7fe890517700 1 --2- 172.21.15.156:0/3895719130 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe8880a08e0 0x7fe8880a0d50 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.556+0000 7fe890517700 1 -- 172.21.15.156:0/3895719130 >> 172.21.15.156:0/3895719130 conn(0x7fe8880a2980 msgr2=0x7fe8880a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:49.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.556+0000 7fe890517700 1 -- 172.21.15.156:0/3895719130 shutdown_connections 2023-09-30T22:23:49.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.556+0000 7fe890517700 1 -- 172.21.15.156:0/3895719130 wait complete. 2023-09-30T22:23:49.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.557+0000 7fe890517700 1 Processor -- start 2023-09-30T22:23:49.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.557+0000 7fe890517700 1 -- start start 2023-09-30T22:23:49.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.558+0000 7fe890517700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe8880a08e0 0x7fe888119820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:49.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.558+0000 7fe890517700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8880a1290 0x7fe888119d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:49.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.558+0000 7fe890517700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe888133a70 0x7fe88811a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:49.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.558+0000 7fe890517700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88811acd0 con 0x7fe8880a1290 2023-09-30T22:23:49.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.558+0000 7fe890517700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88811d260 con 0x7fe888133a70 2023-09-30T22:23:49.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.558+0000 7fe890517700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe88811c610 con 0x7fe8880a08e0 2023-09-30T22:23:49.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.558+0000 7fe88e2b3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe8880a08e0 0x7fe888119820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:49.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.558+0000 7fe88e2b3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe8880a08e0 0x7fe888119820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33892/0 (socket says 172.21.15.156:33892) 2023-09-30T22:23:49.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.558+0000 7fe88e2b3700 1 -- 172.21.15.156:0/3935888724 learned_addr learned my addr 172.21.15.156:0/3935888724 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:49.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.558+0000 7fe88eab4700 1 --2- 172.21.15.156:0/3935888724 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe888133a70 0x7fe88811a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:49.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.558+0000 7fe88dab2700 1 --2- 172.21.15.156:0/3935888724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8880a1290 0x7fe888119d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:49.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.558+0000 7fe88e2b3700 1 -- 172.21.15.156:0/3935888724 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe888133a70 msgr2=0x7fe88811a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:49.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.558+0000 7fe88e2b3700 1 --2- 172.21.15.156:0/3935888724 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe888133a70 0x7fe88811a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.558+0000 7fe88e2b3700 1 -- 172.21.15.156:0/3935888724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8880a1290 msgr2=0x7fe888119d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:49.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.558+0000 7fe88e2b3700 1 --2- 172.21.15.156:0/3935888724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8880a1290 0x7fe888119d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.558+0000 7fe88e2b3700 1 -- 172.21.15.156:0/3935888724 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8780094a0 con 0x7fe8880a08e0 2023-09-30T22:23:49.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.558+0000 7fe88eab4700 1 --2- 172.21.15.156:0/3935888724 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe888133a70 0x7fe88811a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:49.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.558+0000 7fe88e2b3700 1 --2- 172.21.15.156:0/3935888724 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe8880a08e0 0x7fe888119820 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fe88400e990 tx=0x7fe88400eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:49.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.559+0000 7fe87effd700 1 -- 172.21.15.156:0/3935888724 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8840096f0 con 0x7fe8880a08e0 2023-09-30T22:23:49.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.559+0000 7fe87effd700 1 -- 172.21.15.156:0/3935888724 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88400c690 con 0x7fe8880a08e0 2023-09-30T22:23:49.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.559+0000 7fe890517700 1 -- 172.21.15.156:0/3935888724 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe88811b450 con 0x7fe8880a08e0 2023-09-30T22:23:49.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.559+0000 7fe87effd700 1 -- 172.21.15.156:0/3935888724 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88400ca00 con 0x7fe8880a08e0 2023-09-30T22:23:49.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.559+0000 7fe890517700 1 -- 172.21.15.156:0/3935888724 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe88811c150 con 0x7fe8880a08e0 2023-09-30T22:23:49.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.560+0000 7fe87effd700 1 -- 172.21.15.156:0/3935888724 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe88400cb60 con 0x7fe8880a08e0 2023-09-30T22:23:49.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.560+0000 7fe87effd700 1 -- 172.21.15.156:0/3935888724 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe88403f920 con 0x7fe8880a08e0 2023-09-30T22:23:49.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.560+0000 7fe890517700 1 -- 172.21.15.156:0/3935888724 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe88804f2a0 con 0x7fe8880a08e0 2023-09-30T22:23:49.566 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:49.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.566+0000 7fe87effd700 1 -- 172.21.15.156:0/3935888724 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe884017080 con 0x7fe8880a08e0 2023-09-30T22:23:49.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.663+0000 7f70889c5700 1 Processor -- start 2023-09-30T22:23:49.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.663+0000 7f70889c5700 1 -- start start 2023-09-30T22:23:49.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.664+0000 7f70889c5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7084130350 0x7f7084130720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:49.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.664+0000 7f70889c5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7084130c60 0x7f708412cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:49.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.664+0000 7f70889c5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f708412d470 0x7f708412d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:49.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.664+0000 7f70889c5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7084072520 con 0x7f708412d470 2023-09-30T22:23:49.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.664+0000 7f70889c5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70840a24b0 con 0x7f7084130350 2023-09-30T22:23:49.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.664+0000 7f70889c5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f708409bbb0 con 0x7f7084130c60 2023-09-30T22:23:49.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.664+0000 7f7082d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f708412d470 0x7f708412d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:49.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.664+0000 7f7081d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7084130c60 0x7f708412cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:49.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.664+0000 7f7082d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f708412d470 0x7f708412d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54782/0 (socket says 172.21.15.156:54782) 2023-09-30T22:23:49.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.664+0000 7f7082d9d700 1 -- 172.21.15.156:0/3445138262 learned_addr learned my addr 172.21.15.156:0/3445138262 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:49.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.664+0000 7f708259c700 1 --2- 172.21.15.156:0/3445138262 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7084130350 0x7f7084130720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:49.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.664+0000 7f7081d9b700 1 -- 172.21.15.156:0/3445138262 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7084130350 msgr2=0x7f7084130720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:49.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.664+0000 7f7081d9b700 1 --2- 172.21.15.156:0/3445138262 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7084130350 0x7f7084130720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.664+0000 7f7081d9b700 1 -- 172.21.15.156:0/3445138262 >> v2:172.21.15.156:3300/0 conn(0x7f708412d470 msgr2=0x7f708412d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:49.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.664+0000 7f7081d9b700 1 --2- 172.21.15.156:0/3445138262 >> v2:172.21.15.156:3300/0 conn(0x7f708412d470 0x7f708412d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.664+0000 7f7081d9b700 1 -- 172.21.15.156:0/3445138262 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708409cd30 con 0x7f7084130c60 2023-09-30T22:23:49.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.664+0000 7f708259c700 1 --2- 172.21.15.156:0/3445138262 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7084130350 0x7f7084130720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:49.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.664+0000 7f7082d9d700 1 --2- 172.21.15.156:0/3445138262 >> v2:172.21.15.156:3300/0 conn(0x7f708412d470 0x7f708412d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:49.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.665+0000 7f7081d9b700 1 --2- 172.21.15.156:0/3445138262 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7084130c60 0x7f708412cf30 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f70780098a0 tx=0x7f7078009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=104f9c78741536b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:49.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.665+0000 7f708159a700 1 -- 172.21.15.156:0/3445138262 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7078011830 con 0x7f7084130c60 2023-09-30T22:23:49.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.665+0000 7f708159a700 1 -- 172.21.15.156:0/3445138262 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7078011990 con 0x7f7084130c60 2023-09-30T22:23:49.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.665+0000 7f708159a700 1 -- 172.21.15.156:0/3445138262 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7078011d20 con 0x7f7084130c60 2023-09-30T22:23:49.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.666+0000 7f70889c5700 1 -- 172.21.15.156:0/3445138262 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7084130c60 msgr2=0x7f708412cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:49.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.666+0000 7f70889c5700 1 --2- 172.21.15.156:0/3445138262 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7084130c60 0x7f708412cf30 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f70780098a0 tx=0x7f7078009bb0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.666+0000 7f70889c5700 1 -- 172.21.15.156:0/3445138262 shutdown_connections 2023-09-30T22:23:49.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.666+0000 7f70889c5700 1 --2- 172.21.15.156:0/3445138262 >> v2:172.21.15.156:3300/0 conn(0x7f708412d470 0x7f708412d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.666+0000 7f70889c5700 1 --2- 172.21.15.156:0/3445138262 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7084130350 0x7f7084130720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.666+0000 7f70889c5700 1 --2- 172.21.15.156:0/3445138262 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7084130c60 0x7f708412cf30 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.666+0000 7f70889c5700 1 -- 172.21.15.156:0/3445138262 >> 172.21.15.156:0/3445138262 conn(0x7f70840a2980 msgr2=0x7f70840a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:49.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.666+0000 7f70889c5700 1 -- 172.21.15.156:0/3445138262 shutdown_connections 2023-09-30T22:23:49.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.666+0000 7f70889c5700 1 -- 172.21.15.156:0/3445138262 wait complete. 2023-09-30T22:23:49.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.667+0000 7f70889c5700 1 Processor -- start 2023-09-30T22:23:49.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.667+0000 7f70889c5700 1 -- start start 2023-09-30T22:23:49.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.667+0000 7f70889c5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f708412d470 0x7f70841375d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:49.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.667+0000 7f70889c5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7084130350 0x7f7084137b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:49.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.668+0000 7f70889c5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7084130c60 0x7f7084138050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:49.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.668+0000 7f70889c5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70841353d0 con 0x7f7084130c60 2023-09-30T22:23:49.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.668+0000 7f70889c5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7084136180 con 0x7f7084130350 2023-09-30T22:23:49.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.668+0000 7f70889c5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f708409b490 con 0x7f708412d470 2023-09-30T22:23:49.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.668+0000 7f7081d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7084130350 0x7f7084137b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:49.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.668+0000 7f7081d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7084130350 0x7f7084137b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33780/0 (socket says 172.21.15.156:33780) 2023-09-30T22:23:49.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.668+0000 7f7081d9b700 1 -- 172.21.15.156:0/2428518315 learned_addr learned my addr 172.21.15.156:0/2428518315 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:49.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.668+0000 7f7082d9d700 1 --2- 172.21.15.156:0/2428518315 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7084130c60 0x7f7084138050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:49.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.668+0000 7f708259c700 1 --2- 172.21.15.156:0/2428518315 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f708412d470 0x7f70841375d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:49.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.668+0000 7f7082d9d700 1 -- 172.21.15.156:0/2428518315 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f708412d470 msgr2=0x7f70841375d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:49.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.668+0000 7f7082d9d700 1 --2- 172.21.15.156:0/2428518315 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f708412d470 0x7f70841375d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.668+0000 7f7082d9d700 1 -- 172.21.15.156:0/2428518315 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7084130350 msgr2=0x7f7084137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:49.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.668+0000 7f7082d9d700 1 --2- 172.21.15.156:0/2428518315 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7084130350 0x7f7084137b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.668+0000 7f7082d9d700 1 -- 172.21.15.156:0/2428518315 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707c009b30 con 0x7f7084130c60 2023-09-30T22:23:49.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.668+0000 7f7082d9d700 1 --2- 172.21.15.156:0/2428518315 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7084130c60 0x7f7084138050 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f707c00efc0 tx=0x7f707c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:49.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.669+0000 7f7072ffd700 1 -- 172.21.15.156:0/2428518315 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c018070 con 0x7f7084130c60 2023-09-30T22:23:49.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.669+0000 7f7072ffd700 1 -- 172.21.15.156:0/2428518315 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707c00f040 con 0x7f7084130c60 2023-09-30T22:23:49.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.669+0000 7f7072ffd700 1 -- 172.21.15.156:0/2428518315 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c003c60 con 0x7f7084130c60 2023-09-30T22:23:49.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.669+0000 7f70889c5700 1 -- 172.21.15.156:0/2428518315 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7074009430 con 0x7f7084130c60 2023-09-30T22:23:49.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.669+0000 7f70889c5700 1 -- 172.21.15.156:0/2428518315 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70780094a0 con 0x7f7084130c60 2023-09-30T22:23:49.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.670+0000 7f7072ffd700 1 -- 172.21.15.156:0/2428518315 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f707c00c880 con 0x7f7084130c60 2023-09-30T22:23:49.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.670+0000 7f70889c5700 1 -- 172.21.15.156:0/2428518315 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f708404f2a0 con 0x7f7084130c60 2023-09-30T22:23:49.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.670+0000 7f7072ffd700 1 -- 172.21.15.156:0/2428518315 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f707c03f8c0 con 0x7f7084130c60 2023-09-30T22:23:49.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.679+0000 7f7072ffd700 1 -- 172.21.15.156:0/2428518315 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f707c01cd90 con 0x7f7084130c60 2023-09-30T22:23:49.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.688+0000 7ffb88716700 1 Processor -- start 2023-09-30T22:23:49.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.688+0000 7ffb88716700 1 -- start start 2023-09-30T22:23:49.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.689+0000 7ffb88716700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ffb80136960 0x7ffb80138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:49.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.689+0000 7ffb88716700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffb80139280 0x7ffb8013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:49.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.689+0000 7ffb88716700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8006b2d0 con 0x7ffb80133ad0 2023-09-30T22:23:49.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.689+0000 7ffb88716700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb801345b0 con 0x7ffb80136960 2023-09-30T22:23:49.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.689+0000 7ffb88716700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb80133610 con 0x7ffb80139280 2023-09-30T22:23:49.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.689+0000 7ffb85cb1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ffb80136960 0x7ffb80138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:49.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.689+0000 7ffb86cb3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffb80139280 0x7ffb8013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:49.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.689+0000 7ffb85cb1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ffb80136960 0x7ffb80138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54790/0 (socket says 172.21.15.156:54790) 2023-09-30T22:23:49.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.689+0000 7ffb85cb1700 1 -- 172.21.15.156:0/2011953634 learned_addr learned my addr 172.21.15.156:0/2011953634 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:49.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.689+0000 7ffb85cb1700 1 -- 172.21.15.156:0/2011953634 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffb80139280 msgr2=0x7ffb8013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:49.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.689+0000 7ffb85cb1700 1 --2- 172.21.15.156:0/2011953634 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffb80139280 0x7ffb8013b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.689+0000 7ffb85cb1700 1 -- 172.21.15.156:0/2011953634 >> v1:172.21.15.156:6789/0 conn(0x7ffb80133ad0 legacy=0x7ffb80133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:49.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.689+0000 7ffb85cb1700 1 -- 172.21.15.156:0/2011953634 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8009a500 con 0x7ffb80136960 2023-09-30T22:23:49.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.690+0000 7ffb85cb1700 1 --2- 172.21.15.156:0/2011953634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb80136960 0x7ffb80138d40 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7ffb700098f0 tx=0x7ffb70009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dab5773c1490a36 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:49.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.690+0000 7ffb854b0700 1 -- 172.21.15.156:0/2011953634 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7000b8a0 con 0x7ffb80136960 2023-09-30T22:23:49.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.690+0000 7ffb854b0700 1 -- 172.21.15.156:0/2011953634 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7000ba00 con 0x7ffb80136960 2023-09-30T22:23:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.690+0000 7ffb854b0700 1 -- 172.21.15.156:0/2011953634 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7000bd90 con 0x7ffb80136960 2023-09-30T22:23:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.690+0000 7ffb88716700 1 -- 172.21.15.156:0/2011953634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb80136960 msgr2=0x7ffb80138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.690+0000 7ffb88716700 1 --2- 172.21.15.156:0/2011953634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb80136960 0x7ffb80138d40 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7ffb700098f0 tx=0x7ffb70009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.690+0000 7ffb88716700 1 -- 172.21.15.156:0/2011953634 shutdown_connections 2023-09-30T22:23:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.690+0000 7ffb88716700 1 --2- 172.21.15.156:0/2011953634 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffb80139280 0x7ffb8013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.690+0000 7ffb88716700 1 --2- 172.21.15.156:0/2011953634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb80136960 0x7ffb80138d40 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.690+0000 7ffb88716700 1 -- 172.21.15.156:0/2011953634 >> 172.21.15.156:0/2011953634 conn(0x7ffb80099c40 msgr2=0x7ffb800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.691+0000 7ffb88716700 1 -- 172.21.15.156:0/2011953634 shutdown_connections 2023-09-30T22:23:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.691+0000 7ffb88716700 1 -- 172.21.15.156:0/2011953634 wait complete. 2023-09-30T22:23:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.692+0000 7ffb88716700 1 Processor -- start 2023-09-30T22:23:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.692+0000 7ffb88716700 1 -- start start 2023-09-30T22:23:49.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.693+0000 7ffb88716700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffb80133ad0 0x7ffb80071700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:49.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.693+0000 7ffb88716700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb80136960 0x7ffb80071c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:49.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.693+0000 7ffb88716700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffb80139280 0x7ffb801c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:49.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.693+0000 7ffb88716700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb80070390 con 0x7ffb80136960 2023-09-30T22:23:49.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.693+0000 7ffb88716700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb80070570 con 0x7ffb80139280 2023-09-30T22:23:49.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.693+0000 7ffb88716700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb80130450 con 0x7ffb80133ad0 2023-09-30T22:23:49.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.693+0000 7ffb864b2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffb80133ad0 0x7ffb80071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:49.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.693+0000 7ffb85cb1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb80136960 0x7ffb80071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:49.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.693+0000 7ffb864b2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffb80133ad0 0x7ffb80071700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33924/0 (socket says 172.21.15.156:33924) 2023-09-30T22:23:49.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.693+0000 7ffb864b2700 1 -- 172.21.15.156:0/2752136556 learned_addr learned my addr 172.21.15.156:0/2752136556 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:49.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.693+0000 7ffb86cb3700 1 --2- 172.21.15.156:0/2752136556 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffb80139280 0x7ffb801c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:49.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.693+0000 7ffb85cb1700 1 -- 172.21.15.156:0/2752136556 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffb80133ad0 msgr2=0x7ffb80071700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:49.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.693+0000 7ffb85cb1700 1 --2- 172.21.15.156:0/2752136556 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffb80133ad0 0x7ffb80071700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.693+0000 7ffb85cb1700 1 -- 172.21.15.156:0/2752136556 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffb80139280 msgr2=0x7ffb801c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:49.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.693+0000 7ffb85cb1700 1 --2- 172.21.15.156:0/2752136556 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffb80139280 0x7ffb801c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.693+0000 7ffb85cb1700 1 -- 172.21.15.156:0/2752136556 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb70009550 con 0x7ffb80136960 2023-09-30T22:23:49.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.693+0000 7ffb86cb3700 1 --2- 172.21.15.156:0/2752136556 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffb80139280 0x7ffb801c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:49.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.693+0000 7ffb85cb1700 1 --2- 172.21.15.156:0/2752136556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb80136960 0x7ffb80071c40 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7ffb70016000 tx=0x7ffb70004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:49.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.694+0000 7ffb76ffd700 1 -- 172.21.15.156:0/2752136556 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb70004590 con 0x7ffb80136960 2023-09-30T22:23:49.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.694+0000 7ffb76ffd700 1 -- 172.21.15.156:0/2752136556 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb700036a0 con 0x7ffb80136960 2023-09-30T22:23:49.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.694+0000 7ffb88716700 1 -- 172.21.15.156:0/2752136556 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb80131700 con 0x7ffb80136960 2023-09-30T22:23:49.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.694+0000 7ffb76ffd700 1 -- 172.21.15.156:0/2752136556 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb70003a10 con 0x7ffb80136960 2023-09-30T22:23:49.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.694+0000 7ffb88716700 1 -- 172.21.15.156:0/2752136556 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb80130c00 con 0x7ffb80136960 2023-09-30T22:23:49.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.695+0000 7ffb76ffd700 1 -- 172.21.15.156:0/2752136556 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb70021070 con 0x7ffb80136960 2023-09-30T22:23:49.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.695+0000 7ffb88716700 1 -- 172.21.15.156:0/2752136556 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb8004f2a0 con 0x7ffb80136960 2023-09-30T22:23:49.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.695+0000 7ffb76ffd700 1 -- 172.21.15.156:0/2752136556 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffb70040bb0 con 0x7ffb80136960 2023-09-30T22:23:49.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.696+0000 7ffac98de700 1 Processor -- start 2023-09-30T22:23:49.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.696+0000 7ffac98de700 1 -- start start 2023-09-30T22:23:49.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.697+0000 7ffac98de700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ffac406a770 0x7ffac41349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:49.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.697+0000 7ffac98de700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffac4134f00 0x7ffac409d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:49.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.697+0000 7ffac98de700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffac409dea0 0x7ffac409e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:49.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.697+0000 7ffac98de700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffac406b2e0 con 0x7ffac406a770 2023-09-30T22:23:49.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.697+0000 7ffac98de700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac409eca0 con 0x7ffac409dea0 2023-09-30T22:23:49.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.697+0000 7ffac98de700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffac409f720 con 0x7ffac4134f00 2023-09-30T22:23:49.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.697+0000 7ffac27fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffac4134f00 0x7ffac409d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:49.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.697+0000 7ffac37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffac409dea0 0x7ffac409e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:49.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.697+0000 7ffac27fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffac4134f00 0x7ffac409d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33932/0 (socket says 172.21.15.156:33932) 2023-09-30T22:23:49.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.697+0000 7ffac27fc700 1 -- 172.21.15.156:0/4183284236 learned_addr learned my addr 172.21.15.156:0/4183284236 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:49.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.697+0000 7ffac37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffac409dea0 0x7ffac409e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33816/0 (socket says 172.21.15.156:33816) 2023-09-30T22:23:49.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.697+0000 7ffac37fe700 1 -- 172.21.15.156:0/4183284236 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffac4134f00 msgr2=0x7ffac409d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:49.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.697+0000 7ffac37fe700 1 --2- 172.21.15.156:0/4183284236 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffac4134f00 0x7ffac409d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.697+0000 7ffac37fe700 1 -- 172.21.15.156:0/4183284236 >> v2:172.21.15.156:3300/0 conn(0x7ffac406a770 msgr2=0x7ffac41349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:49.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.697+0000 7ffac37fe700 1 --2- 172.21.15.156:0/4183284236 >> v2:172.21.15.156:3300/0 conn(0x7ffac406a770 0x7ffac41349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.698+0000 7ffac37fe700 1 -- 172.21.15.156:0/4183284236 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac406b480 con 0x7ffac409dea0 2023-09-30T22:23:49.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.698+0000 7ffac27fc700 1 --2- 172.21.15.156:0/4183284236 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffac4134f00 0x7ffac409d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:49.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.698+0000 7ffac37fe700 1 --2- 172.21.15.156:0/4183284236 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffac409dea0 0x7ffac409e320 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009d90 tx=0x7ffabc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=792431d689f8f002 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:49.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.698+0000 7ffac1ffb700 1 -- 172.21.15.156:0/4183284236 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc00e070 con 0x7ffac409dea0 2023-09-30T22:23:49.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.698+0000 7ffac1ffb700 1 -- 172.21.15.156:0/4183284236 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffabc00bb20 con 0x7ffac409dea0 2023-09-30T22:23:49.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.698+0000 7ffac1ffb700 1 -- 172.21.15.156:0/4183284236 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc012430 con 0x7ffac409dea0 2023-09-30T22:23:49.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.699+0000 7ffac98de700 1 -- 172.21.15.156:0/4183284236 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffac409dea0 msgr2=0x7ffac409e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:49.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.699+0000 7ffac98de700 1 --2- 172.21.15.156:0/4183284236 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffac409dea0 0x7ffac409e320 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009d90 tx=0x7ffabc00b330 comp rx=0 tx=0).stop 2023-09-30T22:23:49.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.699+0000 7ffac98de700 1 -- 172.21.15.156:0/4183284236 shutdown_connections 2023-09-30T22:23:49.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.699+0000 7ffac98de700 1 --2- 172.21.15.156:0/4183284236 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffac409dea0 0x7ffac409e320 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.699+0000 7ffac98de700 1 --2- 172.21.15.156:0/4183284236 >> v2:172.21.15.156:3300/0 conn(0x7ffac406a770 0x7ffac41349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.699+0000 7ffac98de700 1 --2- 172.21.15.156:0/4183284236 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffac4134f00 0x7ffac409d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.699+0000 7ffac98de700 1 -- 172.21.15.156:0/4183284236 >> 172.21.15.156:0/4183284236 conn(0x7ffac4099c40 msgr2=0x7ffac40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:49.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.699+0000 7ffac98de700 1 -- 172.21.15.156:0/4183284236 shutdown_connections 2023-09-30T22:23:49.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.699+0000 7ffac98de700 1 -- 172.21.15.156:0/4183284236 wait complete. 2023-09-30T22:23:49.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.700+0000 7ffac98de700 1 Processor -- start 2023-09-30T22:23:49.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.701+0000 7ffac98de700 1 -- start start 2023-09-30T22:23:49.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.701+0000 7ffb76ffd700 1 -- 172.21.15.156:0/2752136556 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb70015080 con 0x7ffb80136960 2023-09-30T22:23:49.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.701+0000 7ffac98de700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffac406a770 0x7ffac411a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:49.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.701+0000 7ffac98de700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffac409dea0 0x7ffac411ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:49.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.701+0000 7ffac98de700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffac4134f00 0x7ffac411b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:49.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.701+0000 7ffac98de700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac4126360 con 0x7ffac409dea0 2023-09-30T22:23:49.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.701+0000 7ffac98de700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac411bae0 con 0x7ffac406a770 2023-09-30T22:23:49.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.701+0000 7ffac98de700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffac409f220 con 0x7ffac4134f00 2023-09-30T22:23:49.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.701+0000 7ffac2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffac406a770 0x7ffac411a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:49.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.701+0000 7ffac2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffac406a770 0x7ffac411a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33818/0 (socket says 172.21.15.156:33818) 2023-09-30T22:23:49.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.701+0000 7ffac2ffd700 1 -- 172.21.15.156:0/2135084673 learned_addr learned my addr 172.21.15.156:0/2135084673 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:49.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.701+0000 7ffac37fe700 1 --2- 172.21.15.156:0/2135084673 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffac4134f00 0x7ffac411b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:49.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.702+0000 7ffac27fc700 1 --2- 172.21.15.156:0/2135084673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffac409dea0 0x7ffac411ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:49.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.702+0000 7ffac2ffd700 1 -- 172.21.15.156:0/2135084673 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffac4134f00 msgr2=0x7ffac411b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:49.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.702+0000 7ffac2ffd700 1 --2- 172.21.15.156:0/2135084673 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffac4134f00 0x7ffac411b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.702+0000 7ffac2ffd700 1 -- 172.21.15.156:0/2135084673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffac409dea0 msgr2=0x7ffac411ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:49.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.702+0000 7ffac2ffd700 1 --2- 172.21.15.156:0/2135084673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffac409dea0 0x7ffac411ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.702+0000 7ffac2ffd700 1 -- 172.21.15.156:0/2135084673 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab8009550 con 0x7ffac406a770 2023-09-30T22:23:49.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.702+0000 7ffac37fe700 1 --2- 172.21.15.156:0/2135084673 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffac4134f00 0x7ffac411b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:49.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.702+0000 7ffac27fc700 1 --2- 172.21.15.156:0/2135084673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffac409dea0 0x7ffac411ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:49.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.702+0000 7ffac2ffd700 1 --2- 172.21.15.156:0/2135084673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffac406a770 0x7ffac411a6f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ffab400b4a0 tx=0x7ffab400b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:49.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.702+0000 7ffaabfff700 1 -- 172.21.15.156:0/2135084673 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab4011830 con 0x7ffac406a770 2023-09-30T22:23:49.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.702+0000 7ffaabfff700 1 -- 172.21.15.156:0/2135084673 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab4011990 con 0x7ffac406a770 2023-09-30T22:23:49.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.702+0000 7ffac98de700 1 -- 172.21.15.156:0/2135084673 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffabc009a70 con 0x7ffac406a770 2023-09-30T22:23:49.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.702+0000 7ffaabfff700 1 -- 172.21.15.156:0/2135084673 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab4011d40 con 0x7ffac406a770 2023-09-30T22:23:49.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.702+0000 7ffac98de700 1 -- 172.21.15.156:0/2135084673 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac4126870 con 0x7ffac406a770 2023-09-30T22:23:49.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.704+0000 7ffaabfff700 1 -- 172.21.15.156:0/2135084673 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffab401a400 con 0x7ffac406a770 2023-09-30T22:23:49.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.704+0000 7ffac98de700 1 -- 172.21.15.156:0/2135084673 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac404f2a0 con 0x7ffac406a770 2023-09-30T22:23:49.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.704+0000 7ffaabfff700 1 -- 172.21.15.156:0/2135084673 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffab403f500 con 0x7ffac406a770 2023-09-30T22:23:49.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.713+0000 7ffaabfff700 1 -- 172.21.15.156:0/2135084673 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffab4021cd0 con 0x7ffac406a770 2023-09-30T22:23:49.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.782+0000 7fe890517700 1 -- 172.21.15.156:0/3935888724 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe88811b3f0 con 0x7fe8880a08e0 2023-09-30T22:23:49.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.782+0000 7fe87effd700 1 -- 172.21.15.156:0/3935888724 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe884021020 con 0x7fe8880a08e0 2023-09-30T22:23:49.783 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:49.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.784+0000 7fe890517700 1 -- 172.21.15.156:0/3935888724 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe8880a08e0 msgr2=0x7fe888119820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:49.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.784+0000 7fe890517700 1 --2- 172.21.15.156:0/3935888724 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe8880a08e0 0x7fe888119820 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fe88400e990 tx=0x7fe88400eca0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.785+0000 7fe890517700 1 -- 172.21.15.156:0/3935888724 shutdown_connections 2023-09-30T22:23:49.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.785+0000 7fe890517700 1 --2- 172.21.15.156:0/3935888724 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe888133a70 0x7fe88811a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.785+0000 7fe890517700 1 --2- 172.21.15.156:0/3935888724 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe8880a08e0 0x7fe888119820 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.785+0000 7fe890517700 1 --2- 172.21.15.156:0/3935888724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8880a1290 0x7fe888119d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.785+0000 7fe890517700 1 -- 172.21.15.156:0/3935888724 >> 172.21.15.156:0/3935888724 conn(0x7fe8880a2980 msgr2=0x7fe88812f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:49.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.785+0000 7fe890517700 1 -- 172.21.15.156:0/3935888724 shutdown_connections 2023-09-30T22:23:49.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.785+0000 7fe890517700 1 -- 172.21.15.156:0/3935888724 wait complete. 2023-09-30T22:23:49.798 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:49.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.899+0000 7f70889c5700 1 -- 172.21.15.156:0/2428518315 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7084136a90 con 0x7f7084130c60 2023-09-30T22:23:49.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.899+0000 7f7072ffd700 1 -- 172.21.15.156:0/2428518315 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f707c01de00 con 0x7f7084130c60 2023-09-30T22:23:49.900 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:49.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.900+0000 7ffb88716700 1 -- 172.21.15.156:0/2752136556 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffb8009f0f0 con 0x7ffb80136960 2023-09-30T22:23:49.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.900+0000 7ffb76ffd700 1 -- 172.21.15.156:0/2752136556 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb70024470 con 0x7ffb80136960 2023-09-30T22:23:49.901 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:49.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.902+0000 7ffb88716700 1 -- 172.21.15.156:0/2752136556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb80136960 msgr2=0x7ffb80071c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:49.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.902+0000 7ffb88716700 1 --2- 172.21.15.156:0/2752136556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb80136960 0x7ffb80071c40 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7ffb70016000 tx=0x7ffb70004750 comp rx=0 tx=0).stop 2023-09-30T22:23:49.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.902+0000 7ffb88716700 1 -- 172.21.15.156:0/2752136556 shutdown_connections 2023-09-30T22:23:49.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.902+0000 7ffb88716700 1 --2- 172.21.15.156:0/2752136556 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffb80139280 0x7ffb801c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.902+0000 7ffb88716700 1 --2- 172.21.15.156:0/2752136556 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffb80133ad0 0x7ffb80071700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.902+0000 7ffb88716700 1 --2- 172.21.15.156:0/2752136556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb80136960 0x7ffb80071c40 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.902+0000 7ffb88716700 1 -- 172.21.15.156:0/2752136556 >> 172.21.15.156:0/2752136556 conn(0x7ffb80099c40 msgr2=0x7ffb80134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:49.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.902+0000 7ffb88716700 1 -- 172.21.15.156:0/2752136556 shutdown_connections 2023-09-30T22:23:49.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.902+0000 7ffb88716700 1 -- 172.21.15.156:0/2752136556 wait complete. 2023-09-30T22:23:49.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.903+0000 7f70889c5700 1 -- 172.21.15.156:0/2428518315 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7084130c60 msgr2=0x7f7084138050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:49.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.903+0000 7f70889c5700 1 --2- 172.21.15.156:0/2428518315 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7084130c60 0x7f7084138050 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f707c00efc0 tx=0x7f707c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.903+0000 7f70889c5700 1 -- 172.21.15.156:0/2428518315 shutdown_connections 2023-09-30T22:23:49.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.903+0000 7f70889c5700 1 --2- 172.21.15.156:0/2428518315 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7084130c60 0x7f7084138050 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.903+0000 7f70889c5700 1 --2- 172.21.15.156:0/2428518315 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f708412d470 0x7f70841375d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.903+0000 7f70889c5700 1 --2- 172.21.15.156:0/2428518315 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7084130350 0x7f7084137b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.903+0000 7f70889c5700 1 -- 172.21.15.156:0/2428518315 >> 172.21.15.156:0/2428518315 conn(0x7f70840a2980 msgr2=0x7f708409fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:49.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.903+0000 7f70889c5700 1 -- 172.21.15.156:0/2428518315 shutdown_connections 2023-09-30T22:23:49.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.903+0000 7f70889c5700 1 -- 172.21.15.156:0/2428518315 wait complete. 2023-09-30T22:23:49.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:49.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:49.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.937+0000 7ffac98de700 1 -- 172.21.15.156:0/2135084673 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffac4126870 con 0x7ffac406a770 2023-09-30T22:23:49.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.937+0000 7ffaabfff700 1 -- 172.21.15.156:0/2135084673 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffac4126870 con 0x7ffac406a770 2023-09-30T22:23:49.938 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:49.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.939+0000 7ffac98de700 1 -- 172.21.15.156:0/2135084673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffac406a770 msgr2=0x7ffac411a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:49.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.939+0000 7ffac98de700 1 --2- 172.21.15.156:0/2135084673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffac406a770 0x7ffac411a6f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ffab400b4a0 tx=0x7ffab400b7b0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.939+0000 7ffac98de700 1 -- 172.21.15.156:0/2135084673 shutdown_connections 2023-09-30T22:23:49.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.939+0000 7ffac98de700 1 --2- 172.21.15.156:0/2135084673 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ffac4134f00 0x7ffac411b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.939+0000 7ffac98de700 1 --2- 172.21.15.156:0/2135084673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ffac406a770 0x7ffac411a6f0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.940+0000 7ffac98de700 1 --2- 172.21.15.156:0/2135084673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffac409dea0 0x7ffac411ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.940+0000 7ffac98de700 1 -- 172.21.15.156:0/2135084673 >> 172.21.15.156:0/2135084673 conn(0x7ffac4099c40 msgr2=0x7ffac40a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:49.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.940+0000 7ffac98de700 1 -- 172.21.15.156:0/2135084673 shutdown_connections 2023-09-30T22:23:49.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:49.940+0000 7ffac98de700 1 -- 172.21.15.156:0/2135084673 wait complete. 2023-09-30T22:23:49.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:50.800 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:50.917 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:50.923 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:50.952 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:51.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.044+0000 7f2ccc87b700 1 Processor -- start 2023-09-30T22:23:51.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.044+0000 7f2ccc87b700 1 -- start start 2023-09-30T22:23:51.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.045+0000 7f2ccc87b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2cc8133ad0 0x7f2cc8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.045+0000 7f2ccc87b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2cc81300a0 0x7f2cc81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.045+0000 7f2ccc87b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc806b2d0 con 0x7f2cc81309f0 2023-09-30T22:23:51.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.045+0000 7f2ccc87b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc8133610 con 0x7f2cc81300a0 2023-09-30T22:23:51.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.045+0000 7f2ccc87b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc809a500 con 0x7f2cc8133ad0 2023-09-30T22:23:51.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.045+0000 7f2cc5d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2cc81300a0 0x7f2cc81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.045+0000 7f2cc659c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2cc8133ad0 0x7f2cc8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.045+0000 7f2cc5d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2cc81300a0 0x7f2cc81304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54816/0 (socket says 172.21.15.156:54816) 2023-09-30T22:23:51.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.045+0000 7f2cc659c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2cc8133ad0 0x7f2cc8133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33820/0 (socket says 172.21.15.156:33820) 2023-09-30T22:23:51.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.045+0000 7f2cc5d9b700 1 -- 172.21.15.156:0/2674832070 learned_addr learned my addr 172.21.15.156:0/2674832070 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:51.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.045+0000 7f2cc6d9d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f2cc81309f0 0x7f2cc813a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53786/0 (socket says 172.21.15.156:53786) 2023-09-30T22:23:51.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.045+0000 7f2cc659c700 1 -- 172.21.15.156:0/2674832070 >> v2:172.21.15.156:3300/0 conn(0x7f2cc81300a0 msgr2=0x7f2cc81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:51.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.045+0000 7f2cc659c700 1 --2- 172.21.15.156:0/2674832070 >> v2:172.21.15.156:3300/0 conn(0x7f2cc81300a0 0x7f2cc81304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.045+0000 7f2cc659c700 1 -- 172.21.15.156:0/2674832070 >> v1:172.21.15.156:6789/0 conn(0x7f2cc81309f0 legacy=0x7f2cc813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.045+0000 7f2cc559a700 1 -- 172.21.15.156:0/2674832070 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 337129668 0 0) 0x7f2cc806b2d0 con 0x7f2cc81309f0 2023-09-30T22:23:51.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.045+0000 7f2cc659c700 1 -- 172.21.15.156:0/2674832070 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc81338b0 con 0x7f2cc8133ad0 2023-09-30T22:23:51.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.045+0000 7f2cc5d9b700 1 --2- 172.21.15.156:0/2674832070 >> v2:172.21.15.156:3300/0 conn(0x7f2cc81300a0 0x7f2cc81304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:51.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.045+0000 7f2cc659c700 1 --2- 172.21.15.156:0/2674832070 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2cc8133ad0 0x7f2cc8133ea0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc009840 tx=0x7f2cbc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b69df4bb9dede27 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:51.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.046+0000 7f2cc559a700 1 -- 172.21.15.156:0/2674832070 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc011830 con 0x7f2cc8133ad0 2023-09-30T22:23:51.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.046+0000 7f2cc559a700 1 -- 172.21.15.156:0/2674832070 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cbc011990 con 0x7f2cc8133ad0 2023-09-30T22:23:51.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.046+0000 7f2cc559a700 1 -- 172.21.15.156:0/2674832070 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc011d20 con 0x7f2cc8133ad0 2023-09-30T22:23:51.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.046+0000 7f2ccc87b700 1 -- 172.21.15.156:0/2674832070 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2cc8133ad0 msgr2=0x7f2cc8133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.046+0000 7f2ccc87b700 1 --2- 172.21.15.156:0/2674832070 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2cc8133ad0 0x7f2cc8133ea0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc009840 tx=0x7f2cbc009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:51.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.046+0000 7f2ccc87b700 1 -- 172.21.15.156:0/2674832070 shutdown_connections 2023-09-30T22:23:51.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.046+0000 7f2ccc87b700 1 --2- 172.21.15.156:0/2674832070 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2cc8133ad0 0x7f2cc8133ea0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.046+0000 7f2ccc87b700 1 --2- 172.21.15.156:0/2674832070 >> v2:172.21.15.156:3300/0 conn(0x7f2cc81300a0 0x7f2cc81304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.046+0000 7f2ccc87b700 1 -- 172.21.15.156:0/2674832070 >> 172.21.15.156:0/2674832070 conn(0x7f2cc8099c40 msgr2=0x7f2cc80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:51.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.046+0000 7f2ccc87b700 1 -- 172.21.15.156:0/2674832070 shutdown_connections 2023-09-30T22:23:51.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.046+0000 7f2ccc87b700 1 -- 172.21.15.156:0/2674832070 wait complete. 2023-09-30T22:23:51.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.047+0000 7f2ccc87b700 1 Processor -- start 2023-09-30T22:23:51.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.047+0000 7f2ccc87b700 1 -- start start 2023-09-30T22:23:51.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.048+0000 7f2ccc87b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2cc81300a0 0x7f2cc80712f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.048+0000 7f2ccc87b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cc81309f0 0x7f2cc8071830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.048+0000 7f2ccc87b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2cc8133ad0 0x7f2cc8071d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.048+0000 7f2ccc87b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc811fe60 con 0x7f2cc81309f0 2023-09-30T22:23:51.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.048+0000 7f2ccc87b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc811f950 con 0x7f2cc81300a0 2023-09-30T22:23:51.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.048+0000 7f2ccc87b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc811f5f0 con 0x7f2cc8133ad0 2023-09-30T22:23:51.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.048+0000 7f2cc5d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cc81309f0 0x7f2cc8071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.048+0000 7f2cc6d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2cc8133ad0 0x7f2cc8071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.048+0000 7f2cc5d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cc81309f0 0x7f2cc8071830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54828/0 (socket says 172.21.15.156:54828) 2023-09-30T22:23:51.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.048+0000 7f2cc659c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2cc81300a0 0x7f2cc80712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.048+0000 7f2cc5d9b700 1 -- 172.21.15.156:0/1580285633 learned_addr learned my addr 172.21.15.156:0/1580285633 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:51.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.048+0000 7f2cc5d9b700 1 -- 172.21.15.156:0/1580285633 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2cc8133ad0 msgr2=0x7f2cc8071d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.048+0000 7f2cc5d9b700 1 --2- 172.21.15.156:0/1580285633 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2cc8133ad0 0x7f2cc8071d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.048+0000 7f2cc5d9b700 1 -- 172.21.15.156:0/1580285633 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2cc81300a0 msgr2=0x7f2cc80712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.048+0000 7f2cc5d9b700 1 --2- 172.21.15.156:0/1580285633 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2cc81300a0 0x7f2cc80712f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.048+0000 7f2cc5d9b700 1 -- 172.21.15.156:0/1580285633 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb8009550 con 0x7f2cc81309f0 2023-09-30T22:23:51.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.048+0000 7f2cc659c700 1 --2- 172.21.15.156:0/1580285633 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2cc81300a0 0x7f2cc80712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:51.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.048+0000 7f2cc5d9b700 1 --2- 172.21.15.156:0/1580285633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cc81309f0 0x7f2cc8071830 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f2cb800ebe0 tx=0x7f2cb800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:51.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.048+0000 7f2cb6ffd700 1 -- 172.21.15.156:0/1580285633 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb800c850 con 0x7f2cc81309f0 2023-09-30T22:23:51.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.048+0000 7f2cb6ffd700 1 -- 172.21.15.156:0/1580285633 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb800c9b0 con 0x7f2cc81309f0 2023-09-30T22:23:51.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.048+0000 7f2cb6ffd700 1 -- 172.21.15.156:0/1580285633 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb800cd60 con 0x7f2cc81309f0 2023-09-30T22:23:51.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.048+0000 7f2ccc87b700 1 -- 172.21.15.156:0/1580285633 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cbc0094a0 con 0x7f2cc81309f0 2023-09-30T22:23:51.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.049+0000 7f2ccc87b700 1 -- 172.21.15.156:0/1580285633 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc812dd00 con 0x7f2cc81309f0 2023-09-30T22:23:51.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.049+0000 7f2cb6ffd700 1 -- 172.21.15.156:0/1580285633 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2cb8013470 con 0x7f2cc81309f0 2023-09-30T22:23:51.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.049+0000 7f2cb6ffd700 1 -- 172.21.15.156:0/1580285633 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2cb803fb10 con 0x7f2cc81309f0 2023-09-30T22:23:51.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.049+0000 7f2ccc87b700 1 -- 172.21.15.156:0/1580285633 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc80a2620 con 0x7f2cc81309f0 2023-09-30T22:23:51.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.055+0000 7f2cb6ffd700 1 -- 172.21.15.156:0/1580285633 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2cb8017080 con 0x7f2cc81309f0 2023-09-30T22:23:51.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.193+0000 7f0a433da700 1 Processor -- start 2023-09-30T22:23:51.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.194+0000 7f0aa2c5c700 1 Processor -- start 2023-09-30T22:23:51.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.194+0000 7f0aa2c5c700 1 -- start start 2023-09-30T22:23:51.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.194+0000 7f0aa2c5c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a9c09ad40 0x7f0a9c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.194+0000 7f0aa2c5c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0a9c133f70 0x7f0a9c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.194+0000 7f0aa2c5c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a9c09b110 con 0x7f0a9c0a0a70 2023-09-30T22:23:51.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.194+0000 7f0aa2c5c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9c0a3b60 con 0x7f0a9c133f70 2023-09-30T22:23:51.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.194+0000 7f0aa2c5c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c1348e0 con 0x7f0a9c09ad40 2023-09-30T22:23:51.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.194+0000 7f0a433da700 1 -- start start 2023-09-30T22:23:51.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.194+0000 7f0a433da700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a3c0a0a70 0x7f0a3c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.194+0000 7f0a433da700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a3c0a1380 0x7f0a3c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.194+0000 7f0a433da700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a3c09dc00 con 0x7f0a3c133f50 2023-09-30T22:23:51.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.194+0000 7f0a433da700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c09ea60 con 0x7f0a3c0a0a70 2023-09-30T22:23:51.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.194+0000 7f0a433da700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c09dec0 con 0x7f0a3c0a1380 2023-09-30T22:23:51.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.194+0000 7f0aa11f9700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f0a9c0a0a70 0x7f0a9c0a0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53788/0 (socket says 172.21.15.156:53788) 2023-09-30T22:23:51.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.194+0000 7f0aa11f9700 1 -- 172.21.15.156:0/2411701333 learned_addr learned my addr 172.21.15.156:0/2411701333 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:51.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.194+0000 7f0a9bfff700 1 --2- 172.21.15.156:0/2411701333 >> v2:172.21.15.156:3300/0 conn(0x7f0a9c133f70 0x7f0a9c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.194+0000 7f0aa09f8700 1 --2- 172.21.15.156:0/2411701333 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a9c09ad40 0x7f0a9c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.195+0000 7f0a41176700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a3c0a0a70 0x7f0a3c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.195+0000 7f0a41176700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a3c0a0a70 0x7f0a3c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:33840/0 (socket says 172.21.15.156:33840) 2023-09-30T22:23:51.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.195+0000 7f0a41176700 1 -- 172.21.15.156:0/2132672507 learned_addr learned my addr 172.21.15.156:0/2132672507 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:51.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.195+0000 7f0a9bfff700 1 -- 172.21.15.156:0/2411701333 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a9c09ad40 msgr2=0x7f0a9c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:51.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.195+0000 7f0a9bfff700 1 --2- 172.21.15.156:0/2411701333 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a9c09ad40 0x7f0a9c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.195+0000 7f0a9bfff700 1 -- 172.21.15.156:0/2411701333 >> v1:172.21.15.156:6789/0 conn(0x7f0a9c0a0a70 legacy=0x7f0a9c0a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.195+0000 7f0a9bfff700 1 -- 172.21.15.156:0/2411701333 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9c0a2fa0 con 0x7f0a9c133f70 2023-09-30T22:23:51.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.195+0000 7f0a41176700 1 -- 172.21.15.156:0/2132672507 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a3c0a1380 msgr2=0x7f0a3c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:51.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.195+0000 7f0a41176700 1 --2- 172.21.15.156:0/2132672507 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a3c0a1380 0x7f0a3c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.195+0000 7f0a41176700 1 -- 172.21.15.156:0/2132672507 >> v1:172.21.15.156:6789/0 conn(0x7f0a3c133f50 legacy=0x7f0a3c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.195+0000 7f0a41176700 1 -- 172.21.15.156:0/2132672507 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c09e6a0 con 0x7f0a3c0a0a70 2023-09-30T22:23:51.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.195+0000 7f0a9bfff700 1 --2- 172.21.15.156:0/2411701333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a9c133f70 0x7f0a9c1343a0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f0a88009840 tx=0x7f0a88009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966ef4bb4351168d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:51.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.195+0000 7f0a41176700 1 --2- 172.21.15.156:0/2132672507 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a3c0a0a70 0x7f0a3c0a0e40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009920 tx=0x7f0a38009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5ee3cb9fff38392 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:51.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.195+0000 7f0a9b7fe700 1 -- 172.21.15.156:0/2411701333 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a88011830 con 0x7f0a9c133f70 2023-09-30T22:23:51.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.195+0000 7f0a9b7fe700 1 -- 172.21.15.156:0/2411701333 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a88011990 con 0x7f0a9c133f70 2023-09-30T22:23:51.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.195+0000 7f0a9b7fe700 1 -- 172.21.15.156:0/2411701333 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a88011d20 con 0x7f0a9c133f70 2023-09-30T22:23:51.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.195+0000 7f0a33fff700 1 -- 172.21.15.156:0/2132672507 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3800ba60 con 0x7f0a3c0a0a70 2023-09-30T22:23:51.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.195+0000 7f0a33fff700 1 -- 172.21.15.156:0/2132672507 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3800bbc0 con 0x7f0a3c0a0a70 2023-09-30T22:23:51.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.195+0000 7f0a33fff700 1 -- 172.21.15.156:0/2132672507 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a38009e70 con 0x7f0a3c0a0a70 2023-09-30T22:23:51.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.196+0000 7f0aa2c5c700 1 -- 172.21.15.156:0/2411701333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a9c133f70 msgr2=0x7f0a9c1343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.196+0000 7f0aa2c5c700 1 --2- 172.21.15.156:0/2411701333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a9c133f70 0x7f0a9c1343a0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f0a88009840 tx=0x7f0a88009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:51.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.196+0000 7f0aa2c5c700 1 -- 172.21.15.156:0/2411701333 shutdown_connections 2023-09-30T22:23:51.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.196+0000 7f0aa2c5c700 1 --2- 172.21.15.156:0/2411701333 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a9c09ad40 0x7f0a9c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.196+0000 7f0aa2c5c700 1 --2- 172.21.15.156:0/2411701333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a9c133f70 0x7f0a9c1343a0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.196+0000 7f0aa2c5c700 1 -- 172.21.15.156:0/2411701333 >> 172.21.15.156:0/2411701333 conn(0x7f0a9c099c40 msgr2=0x7f0a9c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:51.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.196+0000 7f0a433da700 1 -- 172.21.15.156:0/2132672507 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a3c0a0a70 msgr2=0x7f0a3c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.196+0000 7f0a433da700 1 --2- 172.21.15.156:0/2132672507 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a3c0a0a70 0x7f0a3c0a0e40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009920 tx=0x7f0a38009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:51.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.196+0000 7f0aa2c5c700 1 -- 172.21.15.156:0/2411701333 shutdown_connections 2023-09-30T22:23:51.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.196+0000 7f0aa2c5c700 1 -- 172.21.15.156:0/2411701333 wait complete. 2023-09-30T22:23:51.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.196+0000 7f0a433da700 1 -- 172.21.15.156:0/2132672507 shutdown_connections 2023-09-30T22:23:51.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.196+0000 7f0a433da700 1 --2- 172.21.15.156:0/2132672507 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a3c0a0a70 0x7f0a3c0a0e40 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.196+0000 7f0a433da700 1 --2- 172.21.15.156:0/2132672507 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a3c0a1380 0x7f0a3c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.196+0000 7f0a433da700 1 -- 172.21.15.156:0/2132672507 >> 172.21.15.156:0/2132672507 conn(0x7f0a3c0a6610 msgr2=0x7f0a3c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:51.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.196+0000 7f0a433da700 1 -- 172.21.15.156:0/2132672507 shutdown_connections 2023-09-30T22:23:51.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.196+0000 7f0a433da700 1 -- 172.21.15.156:0/2132672507 wait complete. 2023-09-30T22:23:51.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.197+0000 7f0aa2c5c700 1 Processor -- start 2023-09-30T22:23:51.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.197+0000 7f0a433da700 1 Processor -- start 2023-09-30T22:23:51.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.197+0000 7f0a433da700 1 -- start start 2023-09-30T22:23:51.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.198+0000 7f0a433da700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a3c0a0a70 0x7f0a3c11e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.197+0000 7f0aa2c5c700 1 -- start start 2023-09-30T22:23:51.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.198+0000 7f0aa2c5c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a9c09ad40 0x7f0a9c06da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.198+0000 7f0aa2c5c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a9c0a0a70 0x7f0a9c06dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.198+0000 7f0aa2c5c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a9c133f70 0x7f0a9c06e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.198+0000 7f0aa2c5c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c06faa0 con 0x7f0a9c09ad40 2023-09-30T22:23:51.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.198+0000 7f0aa2c5c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c0708c0 con 0x7f0a9c0a0a70 2023-09-30T22:23:51.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.198+0000 7f0aa2c5c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c06ebd0 con 0x7f0a9c133f70 2023-09-30T22:23:51.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.198+0000 7f0a433da700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a3c0a1380 0x7f0a3c11edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.198+0000 7f0a433da700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a3c133f50 0x7f0a3c11f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.198+0000 7f0a433da700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c122190 con 0x7f0a3c133f50 2023-09-30T22:23:51.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.198+0000 7f0a433da700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c133910 con 0x7f0a3c0a1380 2023-09-30T22:23:51.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.198+0000 7f0a433da700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c120a30 con 0x7f0a3c0a0a70 2023-09-30T22:23:51.206 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.198+0000 7f0aa09f8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a9c09ad40 0x7f0a9c06da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.206 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.198+0000 7f0aa09f8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a9c09ad40 0x7f0a9c06da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:54846/0 (socket says 172.21.15.156:54846) 2023-09-30T22:23:51.206 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.198+0000 7f0aa09f8700 1 -- 172.21.15.156:0/2689614038 learned_addr learned my addr 172.21.15.156:0/2689614038 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:51.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.198+0000 7f0a9bfff700 1 --2- 172.21.15.156:0/2689614038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a9c0a0a70 0x7f0a9c06dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.198+0000 7f0aa11f9700 1 --2- 172.21.15.156:0/2689614038 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a9c133f70 0x7f0a9c06e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.198+0000 7f0aa09f8700 1 -- 172.21.15.156:0/2689614038 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a9c133f70 msgr2=0x7f0a9c06e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.198+0000 7f0aa09f8700 1 --2- 172.21.15.156:0/2689614038 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a9c133f70 0x7f0a9c06e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.198+0000 7f0aa09f8700 1 -- 172.21.15.156:0/2689614038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a9c0a0a70 msgr2=0x7f0a9c06dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.198+0000 7f0aa09f8700 1 --2- 172.21.15.156:0/2689614038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a9c0a0a70 0x7f0a9c06dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.198+0000 7f0aa09f8700 1 -- 172.21.15.156:0/2689614038 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a880094a0 con 0x7f0a9c09ad40 2023-09-30T22:23:51.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.198+0000 7f0a9bfff700 1 --2- 172.21.15.156:0/2689614038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a9c0a0a70 0x7f0a9c06dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:51.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.198+0000 7f0aa11f9700 1 --2- 172.21.15.156:0/2689614038 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a9c133f70 0x7f0a9c06e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:51.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.199+0000 7f0a41176700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a3c0a0a70 0x7f0a3c11e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.199+0000 7f0a41176700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a3c0a0a70 0x7f0a3c11e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33972/0 (socket says 172.21.15.156:33972) 2023-09-30T22:23:51.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.199+0000 7f0a41176700 1 -- 172.21.15.156:0/498583504 learned_addr learned my addr 172.21.15.156:0/498583504 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:51.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.199+0000 7f0aa09f8700 1 --2- 172.21.15.156:0/2689614038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a9c09ad40 0x7f0a9c06da90 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000e8a0 tx=0x7f0a9000ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:51.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.199+0000 7f0a997fa700 1 -- 172.21.15.156:0/2689614038 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a90009590 con 0x7f0a9c09ad40 2023-09-30T22:23:51.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.199+0000 7f0a997fa700 1 -- 172.21.15.156:0/2689614038 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a90013680 con 0x7f0a9c09ad40 2023-09-30T22:23:51.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.199+0000 7f0a997fa700 1 -- 172.21.15.156:0/2689614038 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a900139f0 con 0x7f0a9c09ad40 2023-09-30T22:23:51.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.199+0000 7f0aa2c5c700 1 -- 172.21.15.156:0/2689614038 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a9c070ac0 con 0x7f0a9c09ad40 2023-09-30T22:23:51.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.199+0000 7f0aa2c5c700 1 -- 172.21.15.156:0/2689614038 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a9c09c7e0 con 0x7f0a9c09ad40 2023-09-30T22:23:51.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.199+0000 7f0a41176700 1 -- 172.21.15.156:0/498583504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a3c0a1380 msgr2=0x7f0a3c11edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.199+0000 7f0a41176700 1 --2- 172.21.15.156:0/498583504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a3c0a1380 0x7f0a3c11edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.199+0000 7f0a41176700 1 -- 172.21.15.156:0/498583504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a3c133f50 msgr2=0x7f0a3c11f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.199+0000 7f0a41176700 1 --2- 172.21.15.156:0/498583504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a3c133f50 0x7f0a3c11f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.199+0000 7f0a41176700 1 -- 172.21.15.156:0/498583504 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a38009550 con 0x7f0a3c0a0a70 2023-09-30T22:23:51.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.199+0000 7f0a41176700 1 --2- 172.21.15.156:0/498583504 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a3c0a0a70 0x7f0a3c11e870 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0a38000c00 tx=0x7f0a38004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:51.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.200+0000 7f0aa2c5c700 1 -- 172.21.15.156:0/2689614038 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a9c04f2a0 con 0x7f0a9c09ad40 2023-09-30T22:23:51.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.200+0000 7f0a997fa700 1 -- 172.21.15.156:0/2689614038 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0a90013b50 con 0x7f0a9c09ad40 2023-09-30T22:23:51.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.201+0000 7f0a997fa700 1 -- 172.21.15.156:0/2689614038 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0a9003fd50 con 0x7f0a9c09ad40 2023-09-30T22:23:51.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.206+0000 7f0a31ffb700 1 -- 172.21.15.156:0/498583504 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a380036a0 con 0x7f0a3c0a0a70 2023-09-30T22:23:51.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.206+0000 7f0a31ffb700 1 -- 172.21.15.156:0/498583504 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3801f070 con 0x7f0a3c0a0a70 2023-09-30T22:23:51.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.206+0000 7f0a433da700 1 -- 172.21.15.156:0/498583504 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a3c0a03e0 con 0x7f0a3c0a0a70 2023-09-30T22:23:51.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.206+0000 7f0a31ffb700 1 -- 172.21.15.156:0/498583504 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a38003a60 con 0x7f0a3c0a0a70 2023-09-30T22:23:51.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.206+0000 7f0a433da700 1 -- 172.21.15.156:0/498583504 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a3c122a90 con 0x7f0a3c0a0a70 2023-09-30T22:23:51.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.206+0000 7fc94abfd700 1 Processor -- start 2023-09-30T22:23:51.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.207+0000 7fc94abfd700 1 -- start start 2023-09-30T22:23:51.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.207+0000 7f0a433da700 1 -- 172.21.15.156:0/498583504 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a3c04f2a0 con 0x7f0a3c0a0a70 2023-09-30T22:23:51.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.207+0000 7fc94abfd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc94409d860 0x7fc94409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.207+0000 7fc94abfd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc944130eb0 0x7fc944138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.207+0000 7fc94abfd700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94409aaa0 con 0x7fc94409e170 2023-09-30T22:23:51.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.207+0000 7fc94abfd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94409f870 con 0x7fc944130eb0 2023-09-30T22:23:51.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.207+0000 7fc94abfd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc94409b360 con 0x7fc94409d860 2023-09-30T22:23:51.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.207+0000 7fc948999700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc94409d860 0x7fc94409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.207+0000 7fc948999700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc94409d860 0x7fc94409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33976/0 (socket says 172.21.15.156:33976) 2023-09-30T22:23:51.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.207+0000 7fc948999700 1 -- 172.21.15.156:0/1671297752 learned_addr learned my addr 172.21.15.156:0/1671297752 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:51.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.207+0000 7fc94919a700 1 --2- 172.21.15.156:0/1671297752 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc944130eb0 0x7fc944138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.208+0000 7fc948999700 1 -- 172.21.15.156:0/1671297752 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc944130eb0 msgr2=0x7fc944138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:51.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.208+0000 7fc948999700 1 --2- 172.21.15.156:0/1671297752 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc944130eb0 0x7fc944138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.208+0000 7fc948999700 1 -- 172.21.15.156:0/1671297752 >> v1:172.21.15.156:6789/0 conn(0x7fc94409e170 legacy=0x7fc9441307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.208+0000 7fc948999700 1 -- 172.21.15.156:0/1671297752 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94409b620 con 0x7fc94409d860 2023-09-30T22:23:51.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.208+0000 7fc94919a700 1 --2- 172.21.15.156:0/1671297752 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc944130eb0 0x7fc944138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:51.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.208+0000 7fc948999700 1 --2- 172.21.15.156:0/1671297752 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc94409d860 0x7fc94409dc30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc93400bbc0 tx=0x7fc93400bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f553ff7ae61ce13 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:51.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.209+0000 7fc9437fe700 1 -- 172.21.15.156:0/1671297752 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93400dd30 con 0x7fc94409d860 2023-09-30T22:23:51.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.209+0000 7fc9437fe700 1 -- 172.21.15.156:0/1671297752 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93400de90 con 0x7fc94409d860 2023-09-30T22:23:51.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.209+0000 7fc9437fe700 1 -- 172.21.15.156:0/1671297752 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc934010690 con 0x7fc94409d860 2023-09-30T22:23:51.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.209+0000 7f0a31ffb700 1 -- 172.21.15.156:0/498583504 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0a38003bc0 con 0x7f0a3c0a0a70 2023-09-30T22:23:51.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.209+0000 7f0a31ffb700 1 -- 172.21.15.156:0/498583504 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0a38021070 con 0x7f0a3c0a0a70 2023-09-30T22:23:51.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.210+0000 7f0a997fa700 1 -- 172.21.15.156:0/2689614038 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0a900253d0 con 0x7f0a9c09ad40 2023-09-30T22:23:51.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.210+0000 7fc94abfd700 1 -- 172.21.15.156:0/1671297752 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc94409d860 msgr2=0x7fc94409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.210+0000 7fc94abfd700 1 --2- 172.21.15.156:0/1671297752 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc94409d860 0x7fc94409dc30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc93400bbc0 tx=0x7fc93400bed0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.211+0000 7fc94abfd700 1 -- 172.21.15.156:0/1671297752 shutdown_connections 2023-09-30T22:23:51.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.211+0000 7fc94abfd700 1 --2- 172.21.15.156:0/1671297752 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc944130eb0 0x7fc944138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.211+0000 7fc94abfd700 1 --2- 172.21.15.156:0/1671297752 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc94409d860 0x7fc94409dc30 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.211+0000 7fc94abfd700 1 -- 172.21.15.156:0/1671297752 >> 172.21.15.156:0/1671297752 conn(0x7fc944099c40 msgr2=0x7fc9440a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:51.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.211+0000 7fc94abfd700 1 -- 172.21.15.156:0/1671297752 shutdown_connections 2023-09-30T22:23:51.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.211+0000 7fc94abfd700 1 -- 172.21.15.156:0/1671297752 wait complete. 2023-09-30T22:23:51.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.211+0000 7fc94abfd700 1 Processor -- start 2023-09-30T22:23:51.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.212+0000 7fc94abfd700 1 -- start start 2023-09-30T22:23:51.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.212+0000 7fc94abfd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc94409d860 0x7fc944123260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.212+0000 7fc94abfd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc94409e170 0x7fc9441237a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.212+0000 7fc94abfd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc944130eb0 0x7fc9441c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.212+0000 7fc94abfd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc944124540 con 0x7fc94409e170 2023-09-30T22:23:51.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.212+0000 7fc94abfd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc944124b60 con 0x7fc944130eb0 2023-09-30T22:23:51.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.212+0000 7fc94abfd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9440a21d0 con 0x7fc94409d860 2023-09-30T22:23:51.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.212+0000 7fc948999700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc94409d860 0x7fc944123260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.212+0000 7fc948999700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc94409d860 0x7fc944123260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:33984/0 (socket says 172.21.15.156:33984) 2023-09-30T22:23:51.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.212+0000 7fc948999700 1 -- 172.21.15.156:0/2254245607 learned_addr learned my addr 172.21.15.156:0/2254245607 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:51.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.212+0000 7fc943fff700 1 --2- 172.21.15.156:0/2254245607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc94409e170 0x7fc9441237a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.212+0000 7fc94919a700 1 --2- 172.21.15.156:0/2254245607 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc944130eb0 0x7fc9441c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.213+0000 7fc943fff700 1 -- 172.21.15.156:0/2254245607 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc94409d860 msgr2=0x7fc944123260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.213+0000 7fc943fff700 1 --2- 172.21.15.156:0/2254245607 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc94409d860 0x7fc944123260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.213+0000 7fc943fff700 1 -- 172.21.15.156:0/2254245607 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc944130eb0 msgr2=0x7fc9441c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.213+0000 7fc943fff700 1 --2- 172.21.15.156:0/2254245607 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc944130eb0 0x7fc9441c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.213+0000 7fc943fff700 1 -- 172.21.15.156:0/2254245607 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c009a70 con 0x7fc94409e170 2023-09-30T22:23:51.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.213+0000 7fc948999700 1 --2- 172.21.15.156:0/2254245607 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc94409d860 0x7fc944123260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:51.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.213+0000 7fc943fff700 1 --2- 172.21.15.156:0/2254245607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc94409e170 0x7fc9441237a0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fc94409a100 tx=0x7fc93800c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:51.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.213+0000 7fc9417fa700 1 -- 172.21.15.156:0/2254245607 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9380052d0 con 0x7fc94409e170 2023-09-30T22:23:51.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.213+0000 7fc94abfd700 1 -- 172.21.15.156:0/2254245607 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc93400b7f0 con 0x7fc94409e170 2023-09-30T22:23:51.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.213+0000 7fc9417fa700 1 -- 172.21.15.156:0/2254245607 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc938005430 con 0x7fc94409e170 2023-09-30T22:23:51.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.213+0000 7fc9417fa700 1 -- 172.21.15.156:0/2254245607 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9380038c0 con 0x7fc94409e170 2023-09-30T22:23:51.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.213+0000 7fc94abfd700 1 -- 172.21.15.156:0/2254245607 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc944124d30 con 0x7fc94409e170 2023-09-30T22:23:51.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.214+0000 7fc9417fa700 1 -- 172.21.15.156:0/2254245607 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc938003c30 con 0x7fc94409e170 2023-09-30T22:23:51.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.214+0000 7fc9417fa700 1 -- 172.21.15.156:0/2254245607 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc93803eba0 con 0x7fc94409e170 2023-09-30T22:23:51.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.215+0000 7fc94abfd700 1 -- 172.21.15.156:0/2254245607 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc944125e10 con 0x7fc94409e170 2023-09-30T22:23:51.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.217+0000 7f0a31ffb700 1 -- 172.21.15.156:0/498583504 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0a380197c0 con 0x7f0a3c0a0a70 2023-09-30T22:23:51.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.224+0000 7fc9417fa700 1 -- 172.21.15.156:0/2254245607 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc944125e10 con 0x7fc94409e170 2023-09-30T22:23:51.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.271+0000 7f2ccc87b700 1 -- 172.21.15.156:0/1580285633 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2cc811dfb0 con 0x7f2cc81309f0 2023-09-30T22:23:51.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.272+0000 7f2cb6ffd700 1 -- 172.21.15.156:0/1580285633 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2cb801b3b0 con 0x7f2cc81309f0 2023-09-30T22:23:51.272 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:51.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.274+0000 7f2ccc87b700 1 -- 172.21.15.156:0/1580285633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cc81309f0 msgr2=0x7f2cc8071830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.274+0000 7f2ccc87b700 1 --2- 172.21.15.156:0/1580285633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cc81309f0 0x7f2cc8071830 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f2cb800ebe0 tx=0x7f2cb800eef0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.274+0000 7f2ccc87b700 1 -- 172.21.15.156:0/1580285633 shutdown_connections 2023-09-30T22:23:51.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.274+0000 7f2ccc87b700 1 --2- 172.21.15.156:0/1580285633 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2cc8133ad0 0x7f2cc8071d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.274+0000 7f2ccc87b700 1 --2- 172.21.15.156:0/1580285633 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2cc81300a0 0x7f2cc80712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.274+0000 7f2ccc87b700 1 --2- 172.21.15.156:0/1580285633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cc81309f0 0x7f2cc8071830 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.274+0000 7f2ccc87b700 1 -- 172.21.15.156:0/1580285633 >> 172.21.15.156:0/1580285633 conn(0x7f2cc8099c40 msgr2=0x7f2cc8132930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:51.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.274+0000 7f2ccc87b700 1 -- 172.21.15.156:0/1580285633 shutdown_connections 2023-09-30T22:23:51.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.274+0000 7f2ccc87b700 1 -- 172.21.15.156:0/1580285633 wait complete. 2023-09-30T22:23:51.287 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:51.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.408+0000 7f0aa2c5c700 1 -- 172.21.15.156:0/2689614038 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0a9c070720 con 0x7f0a9c09ad40 2023-09-30T22:23:51.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.409+0000 7f0a997fa700 1 -- 172.21.15.156:0/2689614038 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0a9c070720 con 0x7f0a9c09ad40 2023-09-30T22:23:51.481 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:51.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.411+0000 7f0aa2c5c700 1 -- 172.21.15.156:0/2689614038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a9c09ad40 msgr2=0x7f0a9c06da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.411+0000 7f0aa2c5c700 1 --2- 172.21.15.156:0/2689614038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a9c09ad40 0x7f0a9c06da90 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000e8a0 tx=0x7f0a9000ebb0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.411+0000 7f0aa2c5c700 1 -- 172.21.15.156:0/2689614038 shutdown_connections 2023-09-30T22:23:51.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.411+0000 7f0aa2c5c700 1 --2- 172.21.15.156:0/2689614038 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a9c133f70 0x7f0a9c06e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.411+0000 7f0aa2c5c700 1 --2- 172.21.15.156:0/2689614038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a9c09ad40 0x7f0a9c06da90 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.411+0000 7f0aa2c5c700 1 --2- 172.21.15.156:0/2689614038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a9c0a0a70 0x7f0a9c06dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.411+0000 7f0aa2c5c700 1 -- 172.21.15.156:0/2689614038 >> 172.21.15.156:0/2689614038 conn(0x7f0a9c099c40 msgr2=0x7f0a9c12faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:51.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.411+0000 7f0aa2c5c700 1 -- 172.21.15.156:0/2689614038 shutdown_connections 2023-09-30T22:23:51.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.411+0000 7f0aa2c5c700 1 -- 172.21.15.156:0/2689614038 wait complete. 2023-09-30T22:23:51.483 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:51.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.449+0000 7f0a433da700 1 -- 172.21.15.156:0/498583504 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0a3c072980 con 0x7f0a3c0a0a70 2023-09-30T22:23:51.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.450+0000 7f0a31ffb700 1 -- 172.21.15.156:0/498583504 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0a38015020 con 0x7f0a3c0a0a70 2023-09-30T22:23:51.484 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:51.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.452+0000 7f0a433da700 1 -- 172.21.15.156:0/498583504 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a3c0a0a70 msgr2=0x7f0a3c11e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.452+0000 7f0a433da700 1 --2- 172.21.15.156:0/498583504 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a3c0a0a70 0x7f0a3c11e870 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0a38000c00 tx=0x7f0a38004750 comp rx=0 tx=0).stop 2023-09-30T22:23:51.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.452+0000 7f0a433da700 1 -- 172.21.15.156:0/498583504 shutdown_connections 2023-09-30T22:23:51.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.452+0000 7f0a433da700 1 --2- 172.21.15.156:0/498583504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a3c133f50 0x7f0a3c11f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.452+0000 7f0a433da700 1 --2- 172.21.15.156:0/498583504 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a3c0a0a70 0x7f0a3c11e870 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.452+0000 7f0a433da700 1 --2- 172.21.15.156:0/498583504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a3c0a1380 0x7f0a3c11edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.452+0000 7f0a433da700 1 -- 172.21.15.156:0/498583504 >> 172.21.15.156:0/498583504 conn(0x7f0a3c0a6610 msgr2=0x7f0a3c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:51.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.452+0000 7f0a433da700 1 -- 172.21.15.156:0/498583504 shutdown_connections 2023-09-30T22:23:51.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.452+0000 7f0a433da700 1 -- 172.21.15.156:0/498583504 wait complete. 2023-09-30T22:23:51.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.455+0000 7fc94abfd700 1 -- 172.21.15.156:0/2254245607 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc944125fd0 con 0x7fc94409e170 2023-09-30T22:23:51.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.456+0000 7fc9417fa700 1 -- 172.21.15.156:0/2254245607 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc944125fd0 con 0x7fc94409e170 2023-09-30T22:23:51.487 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:51.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.458+0000 7fc94abfd700 1 -- 172.21.15.156:0/2254245607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc94409e170 msgr2=0x7fc9441237a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.458+0000 7fc94abfd700 1 --2- 172.21.15.156:0/2254245607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc94409e170 0x7fc9441237a0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fc94409a100 tx=0x7fc93800c730 comp rx=0 tx=0).stop 2023-09-30T22:23:51.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.458+0000 7fc94abfd700 1 -- 172.21.15.156:0/2254245607 shutdown_connections 2023-09-30T22:23:51.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.458+0000 7fc94abfd700 1 --2- 172.21.15.156:0/2254245607 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc944130eb0 0x7fc9441c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.458+0000 7fc94abfd700 1 --2- 172.21.15.156:0/2254245607 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc94409d860 0x7fc944123260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.458+0000 7fc94abfd700 1 --2- 172.21.15.156:0/2254245607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc94409e170 0x7fc9441237a0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.458+0000 7fc94abfd700 1 -- 172.21.15.156:0/2254245607 >> 172.21.15.156:0/2254245607 conn(0x7fc944099c40 msgr2=0x7fc9440a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:51.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.458+0000 7fc94abfd700 1 -- 172.21.15.156:0/2254245607 shutdown_connections 2023-09-30T22:23:51.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:51.458+0000 7fc94abfd700 1 -- 172.21.15.156:0/2254245607 wait complete. 2023-09-30T22:23:51.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:51.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:52.287 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:52.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.420+0000 7f37a487f700 1 Processor -- start 2023-09-30T22:23:52.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.420+0000 7f37a487f700 1 -- start start 2023-09-30T22:23:52.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.420+0000 7f37a487f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f37a0133ad0 0x7f37a0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:52.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.420+0000 7f37a487f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f37a01300a0 0x7f37a01304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:52.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.420+0000 7f37a487f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a006b2d0 con 0x7f37a01309f0 2023-09-30T22:23:52.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.420+0000 7f37a487f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a0133610 con 0x7f37a0133ad0 2023-09-30T22:23:52.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.420+0000 7f37a487f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37a009a500 con 0x7f37a01300a0 2023-09-30T22:23:52.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.421+0000 7f379e59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f37a0133ad0 0x7f37a0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:52.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.421+0000 7f379dd9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f37a01300a0 0x7f37a01304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:52.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.421+0000 7f379e59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f37a0133ad0 0x7f37a0133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44478/0 (socket says 172.21.15.156:44478) 2023-09-30T22:23:52.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.421+0000 7f379e59c700 1 -- 172.21.15.156:0/3130514303 learned_addr learned my addr 172.21.15.156:0/3130514303 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:52.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.421+0000 7f379dd9b700 1 --2- 172.21.15.156:0/3130514303 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f37a01300a0 0x7f37a01304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:42640/0 (socket says 172.21.15.156:42640) 2023-09-30T22:23:52.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.421+0000 7f379ed9d700 1 --1- 172.21.15.156:0/3130514303 >> v1:172.21.15.156:6789/0 conn(0x7f37a01309f0 0x7f37a013a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49060/0 (socket says 172.21.15.156:49060) 2023-09-30T22:23:52.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.421+0000 7f379e59c700 1 -- 172.21.15.156:0/3130514303 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f37a01300a0 msgr2=0x7f37a01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:52.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.421+0000 7f379e59c700 1 --2- 172.21.15.156:0/3130514303 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f37a01300a0 0x7f37a01304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.421+0000 7f379e59c700 1 -- 172.21.15.156:0/3130514303 >> v1:172.21.15.156:6789/0 conn(0x7f37a01309f0 legacy=0x7f37a013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:52.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.421+0000 7f379e59c700 1 -- 172.21.15.156:0/3130514303 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a01338b0 con 0x7f37a0133ad0 2023-09-30T22:23:52.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.421+0000 7f379d59a700 1 -- 172.21.15.156:0/3130514303 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2807496229 0 0) 0x7f37a006b2d0 con 0x7f37a01309f0 2023-09-30T22:23:52.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.421+0000 7f379dd9b700 1 --2- 172.21.15.156:0/3130514303 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f37a01300a0 0x7f37a01304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:52.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.421+0000 7f379e59c700 1 --2- 172.21.15.156:0/3130514303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37a0133ad0 0x7f37a0133ea0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f37900098f0 tx=0x7f3790009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60fe5ebe3404071 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:52.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.421+0000 7f379d59a700 1 -- 172.21.15.156:0/3130514303 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3790011830 con 0x7f37a0133ad0 2023-09-30T22:23:52.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.421+0000 7f379d59a700 1 -- 172.21.15.156:0/3130514303 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3790011990 con 0x7f37a0133ad0 2023-09-30T22:23:52.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.421+0000 7f379d59a700 1 -- 172.21.15.156:0/3130514303 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3790011d20 con 0x7f37a0133ad0 2023-09-30T22:23:52.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.422+0000 7f37a487f700 1 -- 172.21.15.156:0/3130514303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37a0133ad0 msgr2=0x7f37a0133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:52.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.422+0000 7f37a487f700 1 --2- 172.21.15.156:0/3130514303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37a0133ad0 0x7f37a0133ea0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f37900098f0 tx=0x7f3790009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:52.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.422+0000 7f37a487f700 1 -- 172.21.15.156:0/3130514303 shutdown_connections 2023-09-30T22:23:52.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.422+0000 7f37a487f700 1 --2- 172.21.15.156:0/3130514303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37a0133ad0 0x7f37a0133ea0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.422+0000 7f37a487f700 1 --2- 172.21.15.156:0/3130514303 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f37a01300a0 0x7f37a01304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.422+0000 7f37a487f700 1 -- 172.21.15.156:0/3130514303 >> 172.21.15.156:0/3130514303 conn(0x7f37a0099c40 msgr2=0x7f37a00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:52.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.422+0000 7f37a487f700 1 -- 172.21.15.156:0/3130514303 shutdown_connections 2023-09-30T22:23:52.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.422+0000 7f37a487f700 1 -- 172.21.15.156:0/3130514303 wait complete. 2023-09-30T22:23:52.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.423+0000 7f37a487f700 1 Processor -- start 2023-09-30T22:23:52.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.423+0000 7f37a487f700 1 -- start start 2023-09-30T22:23:52.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.423+0000 7f37a487f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37a01300a0 0x7f37a011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:52.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.423+0000 7f37a487f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f37a01309f0 0x7f37a011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:52.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.423+0000 7f37a487f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f37a0133ad0 0x7f37a011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:52.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.423+0000 7f37a487f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a011fd70 con 0x7f37a01300a0 2023-09-30T22:23:52.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.423+0000 7f37a487f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a011f080 con 0x7f37a01309f0 2023-09-30T22:23:52.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.423+0000 7f37a487f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37a0120050 con 0x7f37a0133ad0 2023-09-30T22:23:52.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.423+0000 7f379dd9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f37a01309f0 0x7f37a011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:52.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.423+0000 7f379ed9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f37a0133ad0 0x7f37a011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:52.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.423+0000 7f379e59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37a01300a0 0x7f37a011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:52.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.423+0000 7f379dd9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f37a01309f0 0x7f37a011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45992/0 (socket says 172.21.15.156:45992) 2023-09-30T22:23:52.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.423+0000 7f379ed9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f37a0133ad0 0x7f37a011e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:42644/0 (socket says 172.21.15.156:42644) 2023-09-30T22:23:52.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.423+0000 7f379e59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37a01300a0 0x7f37a011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44492/0 (socket says 172.21.15.156:44492) 2023-09-30T22:23:52.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.423+0000 7f379dd9b700 1 -- 172.21.15.156:0/4291577820 learned_addr learned my addr 172.21.15.156:0/4291577820 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:52.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.424+0000 7f379e59c700 1 -- 172.21.15.156:0/4291577820 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f37a0133ad0 msgr2=0x7f37a011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:52.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.424+0000 7f379e59c700 1 --2- 172.21.15.156:0/4291577820 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f37a0133ad0 0x7f37a011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.424+0000 7f379e59c700 1 -- 172.21.15.156:0/4291577820 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f37a01309f0 msgr2=0x7f37a011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:52.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.424+0000 7f379e59c700 1 --2- 172.21.15.156:0/4291577820 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f37a01309f0 0x7f37a011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.424+0000 7f379e59c700 1 -- 172.21.15.156:0/4291577820 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37940094a0 con 0x7f37a01300a0 2023-09-30T22:23:52.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.424+0000 7f379e59c700 1 --2- 172.21.15.156:0/4291577820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37a01300a0 0x7f37a011da40 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f3790016000 tx=0x7f3790004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:52.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.424+0000 7f378effd700 1 -- 172.21.15.156:0/4291577820 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3790004510 con 0x7f37a01300a0 2023-09-30T22:23:52.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.424+0000 7f378effd700 1 -- 172.21.15.156:0/4291577820 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37900036a0 con 0x7f37a01300a0 2023-09-30T22:23:52.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.424+0000 7f37a487f700 1 -- 172.21.15.156:0/4291577820 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3790009550 con 0x7f37a01300a0 2023-09-30T22:23:52.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.424+0000 7f378effd700 1 -- 172.21.15.156:0/4291577820 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3790003a30 con 0x7f37a01300a0 2023-09-30T22:23:52.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.424+0000 7f37a487f700 1 -- 172.21.15.156:0/4291577820 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a00a3350 con 0x7f37a01300a0 2023-09-30T22:23:52.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.425+0000 7f378effd700 1 -- 172.21.15.156:0/4291577820 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3790021070 con 0x7f37a01300a0 2023-09-30T22:23:52.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.425+0000 7f378effd700 1 -- 172.21.15.156:0/4291577820 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3790040a50 con 0x7f37a01300a0 2023-09-30T22:23:52.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.425+0000 7f37a487f700 1 -- 172.21.15.156:0/4291577820 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a012dd00 con 0x7f37a01300a0 2023-09-30T22:23:52.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.430+0000 7f378effd700 1 -- 172.21.15.156:0/4291577820 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3790015080 con 0x7f37a01300a0 2023-09-30T22:23:52.484 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:52.490 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:52.490 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:52.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.622+0000 7f1d1e5b9700 1 Processor -- start 2023-09-30T22:23:52.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.623+0000 7f1d1e5b9700 1 -- start start 2023-09-30T22:23:52.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.623+0000 7f1d1e5b9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1d180a1550 0x7f1d18138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:52.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.623+0000 7f1d1e5b9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d18139200 0x7f1d1813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:52.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.623+0000 7f1d1e5b9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d1809e9d0 con 0x7f1d180a0a70 2023-09-30T22:23:52.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.623+0000 7f1d1e5b9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d1809dc00 con 0x7f1d180a1550 2023-09-30T22:23:52.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.623+0000 7f1d1e5b9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1809dec0 con 0x7f1d18139200 2023-09-30T22:23:52.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.623+0000 7f1d177fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1d180a1550 0x7f1d18138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:52.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.623+0000 7f1d177fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1d180a1550 0x7f1d18138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44506/0 (socket says 172.21.15.156:44506) 2023-09-30T22:23:52.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.624+0000 7f1d177fe700 1 -- 172.21.15.156:0/2465345945 learned_addr learned my addr 172.21.15.156:0/2465345945 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:52.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.624+0000 7f1d1cb56700 1 --2- 172.21.15.156:0/2465345945 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d18139200 0x7f1d1813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:52.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.624+0000 7f1d1cb56700 1 -- 172.21.15.156:0/2465345945 >> v2:172.21.15.156:3300/0 conn(0x7f1d180a1550 msgr2=0x7f1d18138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:52.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.624+0000 7f1d1cb56700 1 --2- 172.21.15.156:0/2465345945 >> v2:172.21.15.156:3300/0 conn(0x7f1d180a1550 0x7f1d18138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.624+0000 7f1d1cb56700 1 -- 172.21.15.156:0/2465345945 >> v1:172.21.15.156:6789/0 conn(0x7f1d180a0a70 legacy=0x7f1d180a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:52.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.624+0000 7f1d1cb56700 1 -- 172.21.15.156:0/2465345945 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1809e6a0 con 0x7f1d18139200 2023-09-30T22:23:52.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.624+0000 7f1d1cb56700 1 --2- 172.21.15.156:0/2465345945 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d18139200 0x7f1d1813b5e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1d10009d90 tx=0x7f1d1000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=509b17c429ff83ef server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:52.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.624+0000 7f1d16ffd700 1 -- 172.21.15.156:0/2465345945 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1000e070 con 0x7f1d18139200 2023-09-30T22:23:52.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.624+0000 7f1d16ffd700 1 -- 172.21.15.156:0/2465345945 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1000bae0 con 0x7f1d18139200 2023-09-30T22:23:52.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.624+0000 7f1d16ffd700 1 -- 172.21.15.156:0/2465345945 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1000be90 con 0x7f1d18139200 2023-09-30T22:23:52.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.625+0000 7f1d1e5b9700 1 -- 172.21.15.156:0/2465345945 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d18139200 msgr2=0x7f1d1813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:52.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.625+0000 7f1d1e5b9700 1 --2- 172.21.15.156:0/2465345945 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d18139200 0x7f1d1813b5e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1d10009d90 tx=0x7f1d1000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:52.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.625+0000 7f1d1e5b9700 1 -- 172.21.15.156:0/2465345945 shutdown_connections 2023-09-30T22:23:52.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.625+0000 7f1d1e5b9700 1 --2- 172.21.15.156:0/2465345945 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d18139200 0x7f1d1813b5e0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.625+0000 7f1d1e5b9700 1 --2- 172.21.15.156:0/2465345945 >> v2:172.21.15.156:3300/0 conn(0x7f1d180a1550 0x7f1d18138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.625+0000 7f1d1e5b9700 1 -- 172.21.15.156:0/2465345945 >> 172.21.15.156:0/2465345945 conn(0x7f1d180a6610 msgr2=0x7f1d180a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:52.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.625+0000 7f1d1e5b9700 1 -- 172.21.15.156:0/2465345945 shutdown_connections 2023-09-30T22:23:52.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.625+0000 7f1d1e5b9700 1 -- 172.21.15.156:0/2465345945 wait complete. 2023-09-30T22:23:52.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.626+0000 7f37a487f700 1 -- 172.21.15.156:0/4291577820 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f37a004f2a0 con 0x7f37a01300a0 2023-09-30T22:23:52.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.626+0000 7f378effd700 1 -- 172.21.15.156:0/4291577820 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f379001b430 con 0x7f37a01300a0 2023-09-30T22:23:52.629 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:52.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.626+0000 7f1d1e5b9700 1 Processor -- start 2023-09-30T22:23:52.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.627+0000 7f1d1e5b9700 1 -- start start 2023-09-30T22:23:52.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.627+0000 7f1d1e5b9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d180a0a70 0x7f1d1811e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:52.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.627+0000 7f1d1e5b9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d180a1550 0x7f1d1811edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:52.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.627+0000 7f1d1e5b9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d18139200 0x7f1d1811f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:52.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.627+0000 7f1d1e5b9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d180a03e0 con 0x7f1d180a0a70 2023-09-30T22:23:52.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.627+0000 7f1d1e5b9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d18122020 con 0x7f1d180a1550 2023-09-30T22:23:52.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.627+0000 7f1d1e5b9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d18120500 con 0x7f1d18139200 2023-09-30T22:23:52.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.628+0000 7f1d17fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d180a0a70 0x7f1d1811e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:52.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.628+0000 7f1d177fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d180a1550 0x7f1d1811edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:52.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.628+0000 7f1d1cb56700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d18139200 0x7f1d1811f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:52.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.628+0000 7f1d177fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d180a1550 0x7f1d1811edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:45994/0 (socket says 172.21.15.156:45994) 2023-09-30T22:23:52.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.628+0000 7f1d1cb56700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d18139200 0x7f1d1811f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:42664/0 (socket says 172.21.15.156:42664) 2023-09-30T22:23:52.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.628+0000 7f1d17fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d180a0a70 0x7f1d1811e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44516/0 (socket says 172.21.15.156:44516) 2023-09-30T22:23:52.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.628+0000 7f1d177fe700 1 -- 172.21.15.156:0/1728093863 learned_addr learned my addr 172.21.15.156:0/1728093863 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:52.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.628+0000 7f1d1cb56700 1 -- 172.21.15.156:0/1728093863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d180a1550 msgr2=0x7f1d1811edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:52.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.628+0000 7f1d1cb56700 1 --2- 172.21.15.156:0/1728093863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d180a1550 0x7f1d1811edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.628+0000 7f1d1cb56700 1 -- 172.21.15.156:0/1728093863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d180a0a70 msgr2=0x7f1d1811e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:52.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.628+0000 7f1d1cb56700 1 --2- 172.21.15.156:0/1728093863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d180a0a70 0x7f1d1811e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.628+0000 7f1d1cb56700 1 -- 172.21.15.156:0/1728093863 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d10009a70 con 0x7f1d18139200 2023-09-30T22:23:52.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.628+0000 7f1d17fff700 1 --2- 172.21.15.156:0/1728093863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d180a0a70 0x7f1d1811e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:52.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.628+0000 7f1d1cb56700 1 --2- 172.21.15.156:0/1728093863 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d18139200 0x7f1d1811f300 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1d10015000 tx=0x7f1d10004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:52.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.628+0000 7f1d14ff9700 1 -- 172.21.15.156:0/1728093863 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d10021ea0 con 0x7f1d18139200 2023-09-30T22:23:52.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.629+0000 7f1d14ff9700 1 -- 172.21.15.156:0/1728093863 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d10004030 con 0x7f1d18139200 2023-09-30T22:23:52.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.629+0000 7f1d1e5b9700 1 -- 172.21.15.156:0/1728093863 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d180a5200 con 0x7f1d18139200 2023-09-30T22:23:52.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.629+0000 7f1d14ff9700 1 -- 172.21.15.156:0/1728093863 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d10026070 con 0x7f1d18139200 2023-09-30T22:23:52.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.629+0000 7f1d1e5b9700 1 -- 172.21.15.156:0/1728093863 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d18122a90 con 0x7f1d18139200 2023-09-30T22:23:52.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.630+0000 7f1d14ff9700 1 -- 172.21.15.156:0/1728093863 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1d10004400 con 0x7f1d18139200 2023-09-30T22:23:52.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.630+0000 7f1d14ff9700 1 -- 172.21.15.156:0/1728093863 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1d10048670 con 0x7f1d18139200 2023-09-30T22:23:52.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.630+0000 7f1d1e5b9700 1 -- 172.21.15.156:0/1728093863 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d1804f2a0 con 0x7f1d18139200 2023-09-30T22:23:52.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.631+0000 7f37a487f700 1 -- 172.21.15.156:0/4291577820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37a01300a0 msgr2=0x7f37a011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:52.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.631+0000 7f37a487f700 1 --2- 172.21.15.156:0/4291577820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37a01300a0 0x7f37a011da40 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f3790016000 tx=0x7f3790004750 comp rx=0 tx=0).stop 2023-09-30T22:23:52.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.631+0000 7f37a487f700 1 -- 172.21.15.156:0/4291577820 shutdown_connections 2023-09-30T22:23:52.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.631+0000 7f37a487f700 1 --2- 172.21.15.156:0/4291577820 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f37a0133ad0 0x7f37a011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.631+0000 7f37a487f700 1 --2- 172.21.15.156:0/4291577820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37a01300a0 0x7f37a011da40 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.631+0000 7f37a487f700 1 --2- 172.21.15.156:0/4291577820 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f37a01309f0 0x7f37a011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.631+0000 7f37a487f700 1 -- 172.21.15.156:0/4291577820 >> 172.21.15.156:0/4291577820 conn(0x7f37a0099c40 msgr2=0x7f37a012e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:52.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.631+0000 7f37a487f700 1 -- 172.21.15.156:0/4291577820 shutdown_connections 2023-09-30T22:23:52.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.631+0000 7f37a487f700 1 -- 172.21.15.156:0/4291577820 wait complete. 2023-09-30T22:23:52.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.639+0000 7f1d14ff9700 1 -- 172.21.15.156:0/1728093863 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d10012430 con 0x7f1d18139200 2023-09-30T22:23:52.645 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:52.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.663+0000 7f995dd99700 1 Processor -- start 2023-09-30T22:23:52.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.663+0000 7f995dd99700 1 -- start start 2023-09-30T22:23:52.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.664+0000 7f995dd99700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f995809ad40 0x7f9958133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:52.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.664+0000 7f995dd99700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9958133f70 0x7f99581343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:52.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.664+0000 7f995dd99700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f995809b110 con 0x7f99580a0a70 2023-09-30T22:23:52.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.664+0000 7f995dd99700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99580a3b60 con 0x7f995809ad40 2023-09-30T22:23:52.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.664+0000 7f995dd99700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99581348e0 con 0x7f9958133f70 2023-09-30T22:23:52.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.664+0000 7f9956ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9958133f70 0x7f99581343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:52.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.664+0000 7f99577fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f995809ad40 0x7f9958133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:52.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.664+0000 7f9956ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9958133f70 0x7f99581343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:42676/0 (socket says 172.21.15.156:42676) 2023-09-30T22:23:52.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.664+0000 7f99577fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f995809ad40 0x7f9958133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44532/0 (socket says 172.21.15.156:44532) 2023-09-30T22:23:52.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.664+0000 7f9956ffd700 1 -- 172.21.15.156:0/2650823127 learned_addr learned my addr 172.21.15.156:0/2650823127 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:52.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.664+0000 7f9957fff700 1 --1- 172.21.15.156:0/2650823127 >> v1:172.21.15.156:6789/0 conn(0x7f99580a0a70 0x7f99580a0ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49072/0 (socket says 172.21.15.156:49072) 2023-09-30T22:23:52.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.664+0000 7f9956ffd700 1 -- 172.21.15.156:0/2650823127 >> v2:172.21.15.156:3300/0 conn(0x7f995809ad40 msgr2=0x7f9958133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:52.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.664+0000 7f9956ffd700 1 --2- 172.21.15.156:0/2650823127 >> v2:172.21.15.156:3300/0 conn(0x7f995809ad40 0x7f9958133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.664+0000 7f9956ffd700 1 -- 172.21.15.156:0/2650823127 >> v1:172.21.15.156:6789/0 conn(0x7f99580a0a70 legacy=0x7f99580a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:52.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.664+0000 7f9956ffd700 1 -- 172.21.15.156:0/2650823127 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99580a2fa0 con 0x7f9958133f70 2023-09-30T22:23:52.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.664+0000 7f99577fe700 1 --2- 172.21.15.156:0/2650823127 >> v2:172.21.15.156:3300/0 conn(0x7f995809ad40 0x7f9958133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:52.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.664+0000 7f9956ffd700 1 --2- 172.21.15.156:0/2650823127 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9958133f70 0x7f99581343a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f99400098f0 tx=0x7f9940009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f72e9a0e4c51c360 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:52.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.664+0000 7f99567fc700 1 -- 172.21.15.156:0/2650823127 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9940011830 con 0x7f9958133f70 2023-09-30T22:23:52.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.664+0000 7f99567fc700 1 -- 172.21.15.156:0/2650823127 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9940011990 con 0x7f9958133f70 2023-09-30T22:23:52.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.665+0000 7f99567fc700 1 -- 172.21.15.156:0/2650823127 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9940011d20 con 0x7f9958133f70 2023-09-30T22:23:52.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.665+0000 7f995dd99700 1 -- 172.21.15.156:0/2650823127 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9958133f70 msgr2=0x7f99581343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:52.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.665+0000 7f995dd99700 1 --2- 172.21.15.156:0/2650823127 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9958133f70 0x7f99581343a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f99400098f0 tx=0x7f9940009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:52.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.665+0000 7f995dd99700 1 -- 172.21.15.156:0/2650823127 shutdown_connections 2023-09-30T22:23:52.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.665+0000 7f995dd99700 1 --2- 172.21.15.156:0/2650823127 >> v2:172.21.15.156:3300/0 conn(0x7f995809ad40 0x7f9958133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.665+0000 7f995dd99700 1 --2- 172.21.15.156:0/2650823127 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9958133f70 0x7f99581343a0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.665+0000 7f995dd99700 1 -- 172.21.15.156:0/2650823127 >> 172.21.15.156:0/2650823127 conn(0x7f9958099c40 msgr2=0x7f995806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:52.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.665+0000 7f995dd99700 1 -- 172.21.15.156:0/2650823127 shutdown_connections 2023-09-30T22:23:52.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.665+0000 7f995dd99700 1 -- 172.21.15.156:0/2650823127 wait complete. 2023-09-30T22:23:52.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.666+0000 7f995dd99700 1 Processor -- start 2023-09-30T22:23:52.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.666+0000 7f995dd99700 1 -- start start 2023-09-30T22:23:52.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.667+0000 7f995dd99700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f995809ad40 0x7f995811e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:52.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.667+0000 7f995dd99700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99580a0a70 0x7f995811e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:52.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.667+0000 7f995dd99700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9958133f70 0x7f995811ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:52.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.667+0000 7f995dd99700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995811f670 con 0x7f995809ad40 2023-09-30T22:23:52.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.667+0000 7f995dd99700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995811fd80 con 0x7f9958133f70 2023-09-30T22:23:52.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.667+0000 7f995dd99700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9958120fd0 con 0x7f99580a0a70 2023-09-30T22:23:52.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.667+0000 7f9956ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99580a0a70 0x7f995811e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:52.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.667+0000 7f9956ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99580a0a70 0x7f995811e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:42682/0 (socket says 172.21.15.156:42682) 2023-09-30T22:23:52.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.667+0000 7f9956ffd700 1 -- 172.21.15.156:0/1096735236 learned_addr learned my addr 172.21.15.156:0/1096735236 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:52.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.667+0000 7f99577fe700 1 --2- 172.21.15.156:0/1096735236 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f995809ad40 0x7f995811e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:52.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.667+0000 7f9957fff700 1 --2- 172.21.15.156:0/1096735236 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9958133f70 0x7f995811ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:52.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.667+0000 7f9956ffd700 1 -- 172.21.15.156:0/1096735236 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9958133f70 msgr2=0x7f995811ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:52.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.667+0000 7f9956ffd700 1 --2- 172.21.15.156:0/1096735236 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9958133f70 0x7f995811ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.667+0000 7f9956ffd700 1 -- 172.21.15.156:0/1096735236 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f995809ad40 msgr2=0x7f995811e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:52.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.667+0000 7f9956ffd700 1 --2- 172.21.15.156:0/1096735236 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f995809ad40 0x7f995811e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.667+0000 7f9956ffd700 1 -- 172.21.15.156:0/1096735236 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99500094a0 con 0x7f99580a0a70 2023-09-30T22:23:52.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.667+0000 7f99577fe700 1 --2- 172.21.15.156:0/1096735236 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f995809ad40 0x7f995811e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:52.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.667+0000 7f9957fff700 1 --2- 172.21.15.156:0/1096735236 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9958133f70 0x7f995811ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:52.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.667+0000 7f9956ffd700 1 --2- 172.21.15.156:0/1096735236 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99580a0a70 0x7f995811e700 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f99580a2420 tx=0x7f9940004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:52.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.668+0000 7f994ffff700 1 -- 172.21.15.156:0/1096735236 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9940004510 con 0x7f99580a0a70 2023-09-30T22:23:52.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.668+0000 7f994ffff700 1 -- 172.21.15.156:0/1096735236 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99400036a0 con 0x7f99580a0a70 2023-09-30T22:23:52.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.668+0000 7f995dd99700 1 -- 172.21.15.156:0/1096735236 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9940009550 con 0x7f99580a0a70 2023-09-30T22:23:52.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.668+0000 7f994ffff700 1 -- 172.21.15.156:0/1096735236 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9940003a50 con 0x7f99580a0a70 2023-09-30T22:23:52.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.668+0000 7f995dd99700 1 -- 172.21.15.156:0/1096735236 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f995809bb50 con 0x7f99580a0a70 2023-09-30T22:23:52.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.669+0000 7f995dd99700 1 -- 172.21.15.156:0/1096735236 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f995809ed10 con 0x7f99580a0a70 2023-09-30T22:23:52.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.669+0000 7f994ffff700 1 -- 172.21.15.156:0/1096735236 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9940003bb0 con 0x7f99580a0a70 2023-09-30T22:23:52.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.669+0000 7f994ffff700 1 -- 172.21.15.156:0/1096735236 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9940040bb0 con 0x7f99580a0a70 2023-09-30T22:23:52.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.674+0000 7f994ffff700 1 -- 172.21.15.156:0/1096735236 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f994001a420 con 0x7f99580a0a70 2023-09-30T22:23:52.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.679+0000 7f8ddb2ef700 1 Processor -- start 2023-09-30T22:23:52.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.679+0000 7f8ddb2ef700 1 -- start start 2023-09-30T22:23:52.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.679+0000 7f8ddb2ef700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8dd406a770 0x7f8dd406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:52.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.679+0000 7f8ddb2ef700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8dd409dec0 0x7f8dd406b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:52.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.679+0000 7f8ddb2ef700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8dd4131a00 0x7f8dd4131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:52.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.679+0000 7f8ddb2ef700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd406b5c0 con 0x7f8dd409dec0 2023-09-30T22:23:52.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.680+0000 7f8ddb2ef700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd406e900 con 0x7f8dd4131a00 2023-09-30T22:23:52.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.680+0000 7f8ddb2ef700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd409d180 con 0x7f8dd406a770 2023-09-30T22:23:52.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.680+0000 7f8dd988c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8dd4131a00 0x7f8dd4131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:52.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.680+0000 7f8dd988c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8dd4131a00 0x7f8dd4131e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46020/0 (socket says 172.21.15.156:46020) 2023-09-30T22:23:52.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.680+0000 7f8dd988c700 1 -- 172.21.15.156:0/1508477809 learned_addr learned my addr 172.21.15.156:0/1508477809 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:52.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.680+0000 7f8dd908b700 1 --2- 172.21.15.156:0/1508477809 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8dd406a770 0x7f8dd406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:52.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.680+0000 7f8dd888a700 1 --2- 172.21.15.156:0/1508477809 >> v2:172.21.15.156:3300/0 conn(0x7f8dd409dec0 0x7f8dd406b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:52.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.680+0000 7f8dd988c700 1 -- 172.21.15.156:0/1508477809 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8dd406a770 msgr2=0x7f8dd406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:52.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.680+0000 7f8dd988c700 1 --2- 172.21.15.156:0/1508477809 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8dd406a770 0x7f8dd406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.680+0000 7f8dd988c700 1 -- 172.21.15.156:0/1508477809 >> v2:172.21.15.156:3300/0 conn(0x7f8dd409dec0 msgr2=0x7f8dd406b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:52.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.680+0000 7f8dd988c700 1 --2- 172.21.15.156:0/1508477809 >> v2:172.21.15.156:3300/0 conn(0x7f8dd409dec0 0x7f8dd406b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.680+0000 7f8dd988c700 1 -- 172.21.15.156:0/1508477809 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd409e780 con 0x7f8dd4131a00 2023-09-30T22:23:52.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.680+0000 7f8dd908b700 1 --2- 172.21.15.156:0/1508477809 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8dd406a770 0x7f8dd406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:52.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.680+0000 7f8dd988c700 1 --2- 172.21.15.156:0/1508477809 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8dd4131a00 0x7f8dd4131e60 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc009e50 tx=0x7f8dcc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=716cc9827491c3d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:52.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.681+0000 7f8dcbfff700 1 -- 172.21.15.156:0/1508477809 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc00e070 con 0x7f8dd4131a00 2023-09-30T22:23:52.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.681+0000 7f8dcbfff700 1 -- 172.21.15.156:0/1508477809 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dcc00b910 con 0x7f8dd4131a00 2023-09-30T22:23:52.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.681+0000 7f8dcbfff700 1 -- 172.21.15.156:0/1508477809 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc00bcc0 con 0x7f8dd4131a00 2023-09-30T22:23:52.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.681+0000 7f8ddb2ef700 1 -- 172.21.15.156:0/1508477809 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8dd4131a00 msgr2=0x7f8dd4131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:52.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.681+0000 7f8ddb2ef700 1 --2- 172.21.15.156:0/1508477809 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8dd4131a00 0x7f8dd4131e60 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc009e50 tx=0x7f8dcc00b330 comp rx=0 tx=0).stop 2023-09-30T22:23:52.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.682+0000 7f8ddb2ef700 1 -- 172.21.15.156:0/1508477809 shutdown_connections 2023-09-30T22:23:52.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.682+0000 7f8ddb2ef700 1 --2- 172.21.15.156:0/1508477809 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8dd4131a00 0x7f8dd4131e60 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.682+0000 7f8ddb2ef700 1 --2- 172.21.15.156:0/1508477809 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8dd406a770 0x7f8dd406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.682+0000 7f8ddb2ef700 1 --2- 172.21.15.156:0/1508477809 >> v2:172.21.15.156:3300/0 conn(0x7f8dd409dec0 0x7f8dd406b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.682+0000 7f8ddb2ef700 1 -- 172.21.15.156:0/1508477809 >> 172.21.15.156:0/1508477809 conn(0x7f8dd4099c40 msgr2=0x7f8dd40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:52.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.682+0000 7f8ddb2ef700 1 -- 172.21.15.156:0/1508477809 shutdown_connections 2023-09-30T22:23:52.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.682+0000 7f8ddb2ef700 1 -- 172.21.15.156:0/1508477809 wait complete. 2023-09-30T22:23:52.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.683+0000 7f8ddb2ef700 1 Processor -- start 2023-09-30T22:23:52.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.683+0000 7f8ddb2ef700 1 -- start start 2023-09-30T22:23:52.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.684+0000 7f8ddb2ef700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8dd406a770 0x7f8dd4119e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:52.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.684+0000 7f8ddb2ef700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8dd409dec0 0x7f8dd411a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:52.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.684+0000 7f8ddb2ef700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8dd4131a00 0x7f8dd411a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:52.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.684+0000 7f8ddb2ef700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd411c0b0 con 0x7f8dd409dec0 2023-09-30T22:23:52.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.684+0000 7f8ddb2ef700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd411e330 con 0x7f8dd4131a00 2023-09-30T22:23:52.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.684+0000 7f8ddb2ef700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd411d970 con 0x7f8dd406a770 2023-09-30T22:23:52.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.684+0000 7f8dd988c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8dd4131a00 0x7f8dd411a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:52.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.684+0000 7f8dd908b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8dd406a770 0x7f8dd4119e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:52.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.684+0000 7f8dd988c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8dd4131a00 0x7f8dd411a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46030/0 (socket says 172.21.15.156:46030) 2023-09-30T22:23:52.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.684+0000 7f8dd988c700 1 -- 172.21.15.156:0/772816792 learned_addr learned my addr 172.21.15.156:0/772816792 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:52.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.684+0000 7f8dd888a700 1 --2- 172.21.15.156:0/772816792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8dd409dec0 0x7f8dd411a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:52.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.684+0000 7f8dd908b700 1 -- 172.21.15.156:0/772816792 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8dd4131a00 msgr2=0x7f8dd411a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:52.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.684+0000 7f8dd908b700 1 --2- 172.21.15.156:0/772816792 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8dd4131a00 0x7f8dd411a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.684+0000 7f8dd908b700 1 -- 172.21.15.156:0/772816792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8dd409dec0 msgr2=0x7f8dd411a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:52.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.684+0000 7f8dd908b700 1 --2- 172.21.15.156:0/772816792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8dd409dec0 0x7f8dd411a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.684+0000 7f8dd908b700 1 -- 172.21.15.156:0/772816792 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd00094a0 con 0x7f8dd406a770 2023-09-30T22:23:52.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.684+0000 7f8dd988c700 1 --2- 172.21.15.156:0/772816792 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8dd4131a00 0x7f8dd411a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:52.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.684+0000 7f8dd908b700 1 --2- 172.21.15.156:0/772816792 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8dd406a770 0x7f8dd4119e50 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0009fa0 tx=0x7f8dd000ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:52.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.685+0000 7f8dc9ffb700 1 -- 172.21.15.156:0/772816792 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd0013980 con 0x7f8dd406a770 2023-09-30T22:23:52.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.685+0000 7f8ddb2ef700 1 -- 172.21.15.156:0/772816792 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dcc009b30 con 0x7f8dd406a770 2023-09-30T22:23:52.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.685+0000 7f8ddb2ef700 1 -- 172.21.15.156:0/772816792 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd4071ce0 con 0x7f8dd406a770 2023-09-30T22:23:52.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.685+0000 7f8dc9ffb700 1 -- 172.21.15.156:0/772816792 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd0013ae0 con 0x7f8dd406a770 2023-09-30T22:23:52.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.685+0000 7f8dc9ffb700 1 -- 172.21.15.156:0/772816792 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd0013e50 con 0x7f8dd406a770 2023-09-30T22:23:52.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.686+0000 7f8dc9ffb700 1 -- 172.21.15.156:0/772816792 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8dd0004030 con 0x7f8dd406a770 2023-09-30T22:23:52.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.686+0000 7f8dc9ffb700 1 -- 172.21.15.156:0/772816792 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8dd0043400 con 0x7f8dd406a770 2023-09-30T22:23:52.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.686+0000 7f8ddb2ef700 1 -- 172.21.15.156:0/772816792 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db40052e0 con 0x7f8dd406a770 2023-09-30T22:23:52.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.691+0000 7f8dc9ffb700 1 -- 172.21.15.156:0/772816792 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8dd0022ce0 con 0x7f8dd406a770 2023-09-30T22:23:52.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.867+0000 7f1d1e5b9700 1 -- 172.21.15.156:0/1728093863 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1d18072980 con 0x7f1d18139200 2023-09-30T22:23:52.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.867+0000 7f1d14ff9700 1 -- 172.21.15.156:0/1728093863 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1d1002f020 con 0x7f1d18139200 2023-09-30T22:23:52.867 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:52.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.869+0000 7f1d1e5b9700 1 -- 172.21.15.156:0/1728093863 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d18139200 msgr2=0x7f1d1811f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:52.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.869+0000 7f1d1e5b9700 1 --2- 172.21.15.156:0/1728093863 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d18139200 0x7f1d1811f300 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1d10015000 tx=0x7f1d10004ad0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.869+0000 7f1d1e5b9700 1 -- 172.21.15.156:0/1728093863 shutdown_connections 2023-09-30T22:23:52.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.869+0000 7f1d1e5b9700 1 --2- 172.21.15.156:0/1728093863 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d18139200 0x7f1d1811f300 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.869+0000 7f1d1e5b9700 1 --2- 172.21.15.156:0/1728093863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d180a0a70 0x7f1d1811e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.869+0000 7f1d1e5b9700 1 --2- 172.21.15.156:0/1728093863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d180a1550 0x7f1d1811edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.869+0000 7f1d1e5b9700 1 -- 172.21.15.156:0/1728093863 >> 172.21.15.156:0/1728093863 conn(0x7f1d180a6610 msgr2=0x7f1d18137e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:52.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.870+0000 7f1d1e5b9700 1 -- 172.21.15.156:0/1728093863 shutdown_connections 2023-09-30T22:23:52.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.870+0000 7f1d1e5b9700 1 -- 172.21.15.156:0/1728093863 wait complete. 2023-09-30T22:23:52.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.873+0000 7f995dd99700 1 -- 172.21.15.156:0/1096735236 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f995809c7e0 con 0x7f99580a0a70 2023-09-30T22:23:52.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.874+0000 7f994ffff700 1 -- 172.21.15.156:0/1096735236 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9940015030 con 0x7f99580a0a70 2023-09-30T22:23:52.873 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:52.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.876+0000 7f995dd99700 1 -- 172.21.15.156:0/1096735236 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99580a0a70 msgr2=0x7f995811e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:52.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.876+0000 7f995dd99700 1 --2- 172.21.15.156:0/1096735236 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99580a0a70 0x7f995811e700 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f99580a2420 tx=0x7f9940004750 comp rx=0 tx=0).stop 2023-09-30T22:23:52.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.876+0000 7f995dd99700 1 -- 172.21.15.156:0/1096735236 shutdown_connections 2023-09-30T22:23:52.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.876+0000 7f995dd99700 1 --2- 172.21.15.156:0/1096735236 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9958133f70 0x7f995811ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.876+0000 7f995dd99700 1 --2- 172.21.15.156:0/1096735236 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f995809ad40 0x7f995811e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.876+0000 7f995dd99700 1 --2- 172.21.15.156:0/1096735236 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99580a0a70 0x7f995811e700 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.876+0000 7f995dd99700 1 -- 172.21.15.156:0/1096735236 >> 172.21.15.156:0/1096735236 conn(0x7f9958099c40 msgr2=0x7f9958133110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:52.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.876+0000 7f995dd99700 1 -- 172.21.15.156:0/1096735236 shutdown_connections 2023-09-30T22:23:52.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.876+0000 7f995dd99700 1 -- 172.21.15.156:0/1096735236 wait complete. 2023-09-30T22:23:52.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:52.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:52.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.901+0000 7f8ddb2ef700 1 -- 172.21.15.156:0/772816792 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8db4005590 con 0x7f8dd406a770 2023-09-30T22:23:52.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.901+0000 7f8dc9ffb700 1 -- 172.21.15.156:0/772816792 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8dd0023360 con 0x7f8dd406a770 2023-09-30T22:23:52.901 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:52.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.904+0000 7f8ddb2ef700 1 -- 172.21.15.156:0/772816792 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8dd406a770 msgr2=0x7f8dd4119e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:52.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.904+0000 7f8ddb2ef700 1 --2- 172.21.15.156:0/772816792 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8dd406a770 0x7f8dd4119e50 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0009fa0 tx=0x7f8dd000ec90 comp rx=0 tx=0).stop 2023-09-30T22:23:52.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.904+0000 7f8ddb2ef700 1 -- 172.21.15.156:0/772816792 shutdown_connections 2023-09-30T22:23:52.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.904+0000 7f8ddb2ef700 1 --2- 172.21.15.156:0/772816792 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8dd4131a00 0x7f8dd411a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.904+0000 7f8ddb2ef700 1 --2- 172.21.15.156:0/772816792 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8dd406a770 0x7f8dd4119e50 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.904+0000 7f8ddb2ef700 1 --2- 172.21.15.156:0/772816792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8dd409dec0 0x7f8dd411a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.904+0000 7f8ddb2ef700 1 -- 172.21.15.156:0/772816792 >> 172.21.15.156:0/772816792 conn(0x7f8dd4099c40 msgr2=0x7f8dd412eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:52.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.904+0000 7f8ddb2ef700 1 -- 172.21.15.156:0/772816792 shutdown_connections 2023-09-30T22:23:52.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:52.904+0000 7f8ddb2ef700 1 -- 172.21.15.156:0/772816792 wait complete. 2023-09-30T22:23:52.915 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:53.645 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:53.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.778+0000 7fa47c2f4700 1 Processor -- start 2023-09-30T22:23:53.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.778+0000 7fa47c2f4700 1 -- start start 2023-09-30T22:23:53.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.778+0000 7fa47c2f4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa47409e870 0x7fa47409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:53.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.778+0000 7fa47c2f4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa47409f180 0x7fa474131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:53.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.778+0000 7fa47c2f4700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa47409c970 con 0x7fa474131d70 2023-09-30T22:23:53.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.778+0000 7fa47c2f4700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4740a0920 con 0x7fa47409e870 2023-09-30T22:23:53.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.778+0000 7fa47c2f4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa47409f9c0 con 0x7fa47409f180 2023-09-30T22:23:53.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.778+0000 7fa47a090700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa47409e870 0x7fa47409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:53.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.778+0000 7fa47988f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa47409f180 0x7fa474131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:53.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.778+0000 7fa47988f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa47409f180 0x7fa474131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46046/0 (socket says 172.21.15.156:46046) 2023-09-30T22:23:53.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.778+0000 7fa47a090700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa47409e870 0x7fa47409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44576/0 (socket says 172.21.15.156:44576) 2023-09-30T22:23:53.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.778+0000 7fa47988f700 1 -- 172.21.15.156:0/1024702607 learned_addr learned my addr 172.21.15.156:0/1024702607 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:53.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.778+0000 7fa47a891700 1 --1- 172.21.15.156:0/1024702607 >> v1:172.21.15.156:6789/0 conn(0x7fa474131d70 0x7fa474138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49080/0 (socket says 172.21.15.156:49080) 2023-09-30T22:23:53.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.779+0000 7fa47a090700 1 -- 172.21.15.156:0/1024702607 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa47409f180 msgr2=0x7fa474131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:53.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.779+0000 7fa47a090700 1 --2- 172.21.15.156:0/1024702607 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa47409f180 0x7fa474131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.779+0000 7fa47a090700 1 -- 172.21.15.156:0/1024702607 >> v1:172.21.15.156:6789/0 conn(0x7fa474131d70 legacy=0x7fa474138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:53.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.779+0000 7fa47a090700 1 -- 172.21.15.156:0/1024702607 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47409bab0 con 0x7fa47409e870 2023-09-30T22:23:53.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.779+0000 7fa47908e700 1 -- 172.21.15.156:0/1024702607 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2740663315 0 0) 0x7fa47409c970 con 0x7fa474131d70 2023-09-30T22:23:53.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.779+0000 7fa47988f700 1 --2- 172.21.15.156:0/1024702607 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa47409f180 0x7fa474131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:53.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.779+0000 7fa47a090700 1 --2- 172.21.15.156:0/1024702607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa47409e870 0x7fa47409ec40 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fa464009840 tx=0x7fa464009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d905f349c73aa07e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:53.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.779+0000 7fa47908e700 1 -- 172.21.15.156:0/1024702607 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa464011830 con 0x7fa47409e870 2023-09-30T22:23:53.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.779+0000 7fa47908e700 1 -- 172.21.15.156:0/1024702607 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa464011990 con 0x7fa47409e870 2023-09-30T22:23:53.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.779+0000 7fa47908e700 1 -- 172.21.15.156:0/1024702607 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa464011d20 con 0x7fa47409e870 2023-09-30T22:23:53.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.780+0000 7fa47c2f4700 1 -- 172.21.15.156:0/1024702607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa47409e870 msgr2=0x7fa47409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:53.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.780+0000 7fa47c2f4700 1 --2- 172.21.15.156:0/1024702607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa47409e870 0x7fa47409ec40 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fa464009840 tx=0x7fa464009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:53.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.780+0000 7fa47c2f4700 1 -- 172.21.15.156:0/1024702607 shutdown_connections 2023-09-30T22:23:53.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.780+0000 7fa47c2f4700 1 --2- 172.21.15.156:0/1024702607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa47409e870 0x7fa47409ec40 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.780+0000 7fa47c2f4700 1 --2- 172.21.15.156:0/1024702607 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa47409f180 0x7fa474131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.780+0000 7fa47c2f4700 1 -- 172.21.15.156:0/1024702607 >> 172.21.15.156:0/1024702607 conn(0x7fa4740a4430 msgr2=0x7fa4740a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:53.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.780+0000 7fa47c2f4700 1 -- 172.21.15.156:0/1024702607 shutdown_connections 2023-09-30T22:23:53.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.780+0000 7fa47c2f4700 1 -- 172.21.15.156:0/1024702607 wait complete. 2023-09-30T22:23:53.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.781+0000 7fa47c2f4700 1 Processor -- start 2023-09-30T22:23:53.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.781+0000 7fa47c2f4700 1 -- start start 2023-09-30T22:23:53.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.781+0000 7fa47c2f4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa47409e870 0x7fa47411f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:53.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.781+0000 7fa47c2f4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa47409f180 0x7fa47411f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:53.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.781+0000 7fa47c2f4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa474131d70 0x7fa47411fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:53.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.781+0000 7fa47c2f4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4741206e0 con 0x7fa474131d70 2023-09-30T22:23:53.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.781+0000 7fa47c2f4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4741305e0 con 0x7fa47409e870 2023-09-30T22:23:53.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.781+0000 7fa47c2f4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa474121cb0 con 0x7fa47409f180 2023-09-30T22:23:53.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.781+0000 7fa47a090700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa47409e870 0x7fa47411f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:53.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.781+0000 7fa47a891700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa474131d70 0x7fa47411fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:53.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.781+0000 7fa47a090700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa47409e870 0x7fa47411f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46048/0 (socket says 172.21.15.156:46048) 2023-09-30T22:23:53.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.781+0000 7fa47988f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa47409f180 0x7fa47411f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:53.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.781+0000 7fa47a090700 1 -- 172.21.15.156:0/3732968472 learned_addr learned my addr 172.21.15.156:0/3732968472 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:53.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.781+0000 7fa47a891700 1 -- 172.21.15.156:0/3732968472 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa47409f180 msgr2=0x7fa47411f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:53.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.781+0000 7fa47a891700 1 --2- 172.21.15.156:0/3732968472 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa47409f180 0x7fa47411f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.781+0000 7fa47a891700 1 -- 172.21.15.156:0/3732968472 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa47409e870 msgr2=0x7fa47411f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:53.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.781+0000 7fa47a891700 1 --2- 172.21.15.156:0/3732968472 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa47409e870 0x7fa47411f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.781+0000 7fa47a891700 1 -- 172.21.15.156:0/3732968472 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa470009550 con 0x7fa474131d70 2023-09-30T22:23:53.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.781+0000 7fa47a090700 1 --2- 172.21.15.156:0/3732968472 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa47409e870 0x7fa47411f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:53.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.782+0000 7fa47a891700 1 --2- 172.21.15.156:0/3732968472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa474131d70 0x7fa47411fc90 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fa46c00cc10 tx=0x7fa46c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:53.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.782+0000 7fa46affd700 1 -- 172.21.15.156:0/3732968472 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c00aa00 con 0x7fa474131d70 2023-09-30T22:23:53.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.782+0000 7fa46affd700 1 -- 172.21.15.156:0/3732968472 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46c00ab80 con 0x7fa474131d70 2023-09-30T22:23:53.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.782+0000 7fa47c2f4700 1 -- 172.21.15.156:0/3732968472 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4640094a0 con 0x7fa474131d70 2023-09-30T22:23:53.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.782+0000 7fa46affd700 1 -- 172.21.15.156:0/3732968472 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c0070d0 con 0x7fa474131d70 2023-09-30T22:23:53.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.782+0000 7fa47c2f4700 1 -- 172.21.15.156:0/3732968472 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa474122510 con 0x7fa474131d70 2023-09-30T22:23:53.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.782+0000 7fa46affd700 1 -- 172.21.15.156:0/3732968472 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa46c007230 con 0x7fa474131d70 2023-09-30T22:23:53.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.783+0000 7fa47c2f4700 1 -- 172.21.15.156:0/3732968472 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa474122070 con 0x7fa474131d70 2023-09-30T22:23:53.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.783+0000 7fa46affd700 1 -- 172.21.15.156:0/3732968472 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa46c03f420 con 0x7fa474131d70 2023-09-30T22:23:53.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.787+0000 7fa46affd700 1 -- 172.21.15.156:0/3732968472 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa46c007720 con 0x7fa474131d70 2023-09-30T22:23:53.883 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:53.890 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:53.916 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:53.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.983+0000 7fa47c2f4700 1 -- 172.21.15.156:0/3732968472 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa47411be60 con 0x7fa474131d70 2023-09-30T22:23:53.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.983+0000 7fa46affd700 1 -- 172.21.15.156:0/3732968472 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa46c018030 con 0x7fa474131d70 2023-09-30T22:23:53.983 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:53.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.987+0000 7fa47c2f4700 1 -- 172.21.15.156:0/3732968472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa474131d70 msgr2=0x7fa47411fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:53.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.987+0000 7fa47c2f4700 1 --2- 172.21.15.156:0/3732968472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa474131d70 0x7fa47411fc90 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fa46c00cc10 tx=0x7fa46c00cf20 comp rx=0 tx=0).stop 2023-09-30T22:23:53.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.987+0000 7fa47c2f4700 1 -- 172.21.15.156:0/3732968472 shutdown_connections 2023-09-30T22:23:53.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.987+0000 7fa47c2f4700 1 --2- 172.21.15.156:0/3732968472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa474131d70 0x7fa47411fc90 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.987+0000 7fa47c2f4700 1 --2- 172.21.15.156:0/3732968472 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa47409e870 0x7fa47411f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.987+0000 7fa47c2f4700 1 --2- 172.21.15.156:0/3732968472 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa47409f180 0x7fa47411f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.987+0000 7fa47c2f4700 1 -- 172.21.15.156:0/3732968472 >> 172.21.15.156:0/3732968472 conn(0x7fa4740a4430 msgr2=0x7fa474131140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:53.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.987+0000 7fa47c2f4700 1 -- 172.21.15.156:0/3732968472 shutdown_connections 2023-09-30T22:23:53.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:53.987+0000 7fa47c2f4700 1 -- 172.21.15.156:0/3732968472 wait complete. 2023-09-30T22:23:54.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:54.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.016+0000 7f1e7a069700 1 Processor -- start 2023-09-30T22:23:54.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.016+0000 7f1e7a069700 1 -- start start 2023-09-30T22:23:54.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.016+0000 7f1e7a069700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e74134140 0x7f1e74138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.016+0000 7f1e7a069700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e74134570 0x7f1e7413b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.016+0000 7f1e7a069700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e7409b110 con 0x7f1e7409ad40 2023-09-30T22:23:54.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.016+0000 7f1e7a069700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e740a3b60 con 0x7f1e74134140 2023-09-30T22:23:54.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.016+0000 7f1e7a069700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e740a1a80 con 0x7f1e74134570 2023-09-30T22:23:54.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.017+0000 7f1e73fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e74134570 0x7f1e7413b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.017+0000 7f1e72ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e74134140 0x7f1e74138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.017+0000 7f1e737fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f1e7409ad40 0x7f1e74133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49082/0 (socket says 172.21.15.156:49082) 2023-09-30T22:23:54.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.017+0000 7f1e737fe700 1 -- 172.21.15.156:0/2186358102 learned_addr learned my addr 172.21.15.156:0/2186358102 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:54.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.017+0000 7f1e73fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e74134570 0x7f1e7413b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:42738/0 (socket says 172.21.15.156:42738) 2023-09-30T22:23:54.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.017+0000 7f1e73fff700 1 -- 172.21.15.156:0/2186358102 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e74134140 msgr2=0x7f1e74138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:54.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.017+0000 7f1e73fff700 1 --2- 172.21.15.156:0/2186358102 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e74134140 0x7f1e74138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.017+0000 7f1e73fff700 1 -- 172.21.15.156:0/2186358102 >> v1:172.21.15.156:6789/0 conn(0x7f1e7409ad40 legacy=0x7f1e74133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.017+0000 7f1e73fff700 1 -- 172.21.15.156:0/2186358102 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e740a2fa0 con 0x7f1e74134570 2023-09-30T22:23:54.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.017+0000 7f1e72ffd700 1 --2- 172.21.15.156:0/2186358102 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e74134140 0x7f1e74138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:54.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.017+0000 7f1e73fff700 1 --2- 172.21.15.156:0/2186358102 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e74134570 0x7f1e7413b3d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1e64009dc0 tx=0x7f1e6400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74fb19b44ebe8bea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:54.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.017+0000 7f1e727fc700 1 -- 172.21.15.156:0/2186358102 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6400e070 con 0x7f1e74134570 2023-09-30T22:23:54.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.017+0000 7f1e727fc700 1 -- 172.21.15.156:0/2186358102 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6400bb20 con 0x7f1e74134570 2023-09-30T22:23:54.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.017+0000 7f1e727fc700 1 -- 172.21.15.156:0/2186358102 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e64012430 con 0x7f1e74134570 2023-09-30T22:23:54.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.018+0000 7f1e7a069700 1 -- 172.21.15.156:0/2186358102 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e74134570 msgr2=0x7f1e7413b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.018+0000 7f1e7a069700 1 --2- 172.21.15.156:0/2186358102 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e74134570 0x7f1e7413b3d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1e64009dc0 tx=0x7f1e6400b330 comp rx=0 tx=0).stop 2023-09-30T22:23:54.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.018+0000 7f1e7a069700 1 -- 172.21.15.156:0/2186358102 shutdown_connections 2023-09-30T22:23:54.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.018+0000 7f1e7a069700 1 --2- 172.21.15.156:0/2186358102 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e74134570 0x7f1e7413b3d0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.018+0000 7f1e7a069700 1 --2- 172.21.15.156:0/2186358102 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e74134140 0x7f1e74138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.018+0000 7f1e7a069700 1 -- 172.21.15.156:0/2186358102 >> 172.21.15.156:0/2186358102 conn(0x7f1e74099c40 msgr2=0x7f1e7406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:54.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.018+0000 7f1e7a069700 1 -- 172.21.15.156:0/2186358102 shutdown_connections 2023-09-30T22:23:54.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.018+0000 7f1e7a069700 1 -- 172.21.15.156:0/2186358102 wait complete. 2023-09-30T22:23:54.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.019+0000 7f1e7a069700 1 Processor -- start 2023-09-30T22:23:54.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.019+0000 7f1e7a069700 1 -- start start 2023-09-30T22:23:54.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.020+0000 7f1e7a069700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e7409ad40 0x7f1e7411c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.020+0000 7f1e7a069700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e74134140 0x7f1e7411ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.020+0000 7f1e7a069700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e74134570 0x7f1e7411d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.020+0000 7f1e7a069700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7411dcf0 con 0x7f1e74134140 2023-09-30T22:23:54.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.020+0000 7f1e7a069700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7411ebd0 con 0x7f1e7409ad40 2023-09-30T22:23:54.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.020+0000 7f1e7a069700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7409c7e0 con 0x7f1e74134570 2023-09-30T22:23:54.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.020+0000 7f1e73fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e74134570 0x7f1e7411d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.020+0000 7f1e72ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e74134140 0x7f1e7411ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.020+0000 7f1e72ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e74134140 0x7f1e7411ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44594/0 (socket says 172.21.15.156:44594) 2023-09-30T22:23:54.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.020+0000 7f1e72ffd700 1 -- 172.21.15.156:0/3353938659 learned_addr learned my addr 172.21.15.156:0/3353938659 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:54.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.020+0000 7f1e737fe700 1 --2- 172.21.15.156:0/3353938659 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e7409ad40 0x7f1e7411c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.020+0000 7f1e73fff700 1 -- 172.21.15.156:0/3353938659 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e7409ad40 msgr2=0x7f1e7411c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.020+0000 7f1e73fff700 1 --2- 172.21.15.156:0/3353938659 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e7409ad40 0x7f1e7411c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.020+0000 7f1e73fff700 1 -- 172.21.15.156:0/3353938659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e74134140 msgr2=0x7f1e7411ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.020+0000 7f1e73fff700 1 --2- 172.21.15.156:0/3353938659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e74134140 0x7f1e7411ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.020+0000 7f1e73fff700 1 -- 172.21.15.156:0/3353938659 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e5c0094a0 con 0x7f1e74134570 2023-09-30T22:23:54.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.020+0000 7f1e72ffd700 1 --2- 172.21.15.156:0/3353938659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e74134140 0x7f1e7411ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:54.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.020+0000 7f1e73fff700 1 --2- 172.21.15.156:0/3353938659 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e74134570 0x7f1e7411d340 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1e74134a10 tx=0x7f1e64004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:54.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.021+0000 7f1e6bfff700 1 -- 172.21.15.156:0/3353938659 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e64012430 con 0x7f1e74134570 2023-09-30T22:23:54.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.021+0000 7f1e6bfff700 1 -- 172.21.15.156:0/3353938659 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e64020070 con 0x7f1e74134570 2023-09-30T22:23:54.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.021+0000 7f1e6bfff700 1 -- 172.21.15.156:0/3353938659 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e64004280 con 0x7f1e74134570 2023-09-30T22:23:54.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.021+0000 7f1e7a069700 1 -- 172.21.15.156:0/3353938659 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e64009a70 con 0x7f1e74134570 2023-09-30T22:23:54.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.021+0000 7f1e7a069700 1 -- 172.21.15.156:0/3353938659 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e7411e910 con 0x7f1e74134570 2023-09-30T22:23:54.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.021+0000 7f1e6bfff700 1 -- 172.21.15.156:0/3353938659 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e640043e0 con 0x7f1e74134570 2023-09-30T22:23:54.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.021+0000 7f1e6bfff700 1 -- 172.21.15.156:0/3353938659 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1e64022070 con 0x7f1e74134570 2023-09-30T22:23:54.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.022+0000 7f1e7a069700 1 -- 172.21.15.156:0/3353938659 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e7404f2a0 con 0x7f1e74134570 2023-09-30T22:23:54.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.027+0000 7f1e6bfff700 1 -- 172.21.15.156:0/3353938659 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e6402c020 con 0x7f1e74134570 2023-09-30T22:23:54.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.058+0000 7f2874b8d700 1 Processor -- start 2023-09-30T22:23:54.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.058+0000 7f2874b8d700 1 -- start start 2023-09-30T22:23:54.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.059+0000 7f2874b8d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2870133ad0 0x7f2870133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.059+0000 7f2874b8d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2870130bc0 0x7f287013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.059+0000 7f2874b8d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287006b2d0 con 0x7f28701300a0 2023-09-30T22:23:54.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.059+0000 7f2874b8d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2870133610 con 0x7f2870130bc0 2023-09-30T22:23:54.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.059+0000 7f2874b8d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f287009a500 con 0x7f2870133ad0 2023-09-30T22:23:54.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.060+0000 7f286ed9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2870130bc0 0x7f287013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.060+0000 7f286dd9b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f28701300a0 0x7f28701304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49088/0 (socket says 172.21.15.156:49088) 2023-09-30T22:23:54.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.060+0000 7f286dd9b700 1 -- 172.21.15.156:0/1804964447 learned_addr learned my addr 172.21.15.156:0/1804964447 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:54.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.060+0000 7f286e59c700 1 --2- 172.21.15.156:0/1804964447 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2870133ad0 0x7f2870133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.060+0000 7f286ed9d700 1 -- 172.21.15.156:0/1804964447 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2870133ad0 msgr2=0x7f2870133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:54.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.060+0000 7f286ed9d700 1 --2- 172.21.15.156:0/1804964447 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2870133ad0 0x7f2870133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.060+0000 7f286ed9d700 1 -- 172.21.15.156:0/1804964447 >> v1:172.21.15.156:6789/0 conn(0x7f28701300a0 legacy=0x7f28701304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.060+0000 7f286ed9d700 1 -- 172.21.15.156:0/1804964447 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28701338b0 con 0x7f2870130bc0 2023-09-30T22:23:54.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.060+0000 7f286d59a700 1 -- 172.21.15.156:0/1804964447 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543701728 0 0) 0x7f287006b2d0 con 0x7f28701300a0 2023-09-30T22:23:54.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.060+0000 7f286ed9d700 1 --2- 172.21.15.156:0/1804964447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2870130bc0 0x7f287013b990 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f2868009d90 tx=0x7f286800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449e5423dad3c9be server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:54.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.060+0000 7f286d59a700 1 -- 172.21.15.156:0/1804964447 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286800e070 con 0x7f2870130bc0 2023-09-30T22:23:54.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.060+0000 7f286d59a700 1 -- 172.21.15.156:0/1804964447 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286800bb20 con 0x7f2870130bc0 2023-09-30T22:23:54.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.060+0000 7f286d59a700 1 -- 172.21.15.156:0/1804964447 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2868012430 con 0x7f2870130bc0 2023-09-30T22:23:54.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.061+0000 7f2874b8d700 1 -- 172.21.15.156:0/1804964447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2870130bc0 msgr2=0x7f287013b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.061+0000 7f2874b8d700 1 --2- 172.21.15.156:0/1804964447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2870130bc0 0x7f287013b990 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f2868009d90 tx=0x7f286800b330 comp rx=0 tx=0).stop 2023-09-30T22:23:54.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.061+0000 7f2874b8d700 1 -- 172.21.15.156:0/1804964447 shutdown_connections 2023-09-30T22:23:54.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.061+0000 7f2874b8d700 1 --2- 172.21.15.156:0/1804964447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2870130bc0 0x7f287013b990 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.061+0000 7f2874b8d700 1 --2- 172.21.15.156:0/1804964447 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2870133ad0 0x7f2870133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.061+0000 7f2874b8d700 1 -- 172.21.15.156:0/1804964447 >> 172.21.15.156:0/1804964447 conn(0x7f2870099c40 msgr2=0x7f28700a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:54.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.061+0000 7f2874b8d700 1 -- 172.21.15.156:0/1804964447 shutdown_connections 2023-09-30T22:23:54.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.061+0000 7f2874b8d700 1 -- 172.21.15.156:0/1804964447 wait complete. 2023-09-30T22:23:54.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.062+0000 7f2874b8d700 1 Processor -- start 2023-09-30T22:23:54.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.062+0000 7f2874b8d700 1 -- start start 2023-09-30T22:23:54.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.063+0000 7f2874b8d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28701300a0 0x7f287011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.063+0000 7f2874b8d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2870130bc0 0x7f287011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.063+0000 7f2874b8d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2870133ad0 0x7f287011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.063+0000 7f2874b8d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28701208e0 con 0x7f28701300a0 2023-09-30T22:23:54.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.063+0000 7f2874b8d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287011f9d0 con 0x7f2870133ad0 2023-09-30T22:23:54.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.063+0000 7f2874b8d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2870120070 con 0x7f2870130bc0 2023-09-30T22:23:54.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.063+0000 7f286dd9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2870130bc0 0x7f287011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.063+0000 7f286e59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28701300a0 0x7f287011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.063+0000 7f286e59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28701300a0 0x7f287011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44614/0 (socket says 172.21.15.156:44614) 2023-09-30T22:23:54.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.063+0000 7f286dd9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2870130bc0 0x7f287011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:42758/0 (socket says 172.21.15.156:42758) 2023-09-30T22:23:54.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.063+0000 7f286e59c700 1 -- 172.21.15.156:0/2131126357 learned_addr learned my addr 172.21.15.156:0/2131126357 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:54.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.063+0000 7f286ed9d700 1 --2- 172.21.15.156:0/2131126357 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2870133ad0 0x7f287011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.063+0000 7f286e59c700 1 -- 172.21.15.156:0/2131126357 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2870130bc0 msgr2=0x7f287011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.063+0000 7f286e59c700 1 --2- 172.21.15.156:0/2131126357 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2870130bc0 0x7f287011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.063+0000 7f286e59c700 1 -- 172.21.15.156:0/2131126357 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2870133ad0 msgr2=0x7f287011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.063+0000 7f286e59c700 1 --2- 172.21.15.156:0/2131126357 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2870133ad0 0x7f287011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.063+0000 7f286e59c700 1 -- 172.21.15.156:0/2131126357 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2868009a70 con 0x7f28701300a0 2023-09-30T22:23:54.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.063+0000 7f286dd9b700 1 --2- 172.21.15.156:0/2131126357 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2870130bc0 0x7f287011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:54.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.063+0000 7f286e59c700 1 --2- 172.21.15.156:0/2131126357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28701300a0 0x7f287011da40 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f286000e9b0 tx=0x7f286000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:54.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.063+0000 7f285effd700 1 -- 172.21.15.156:0/2131126357 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860009710 con 0x7f28701300a0 2023-09-30T22:23:54.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.063+0000 7f2874b8d700 1 -- 172.21.15.156:0/2131126357 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287011ee50 con 0x7f28701300a0 2023-09-30T22:23:54.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.064+0000 7f2874b8d700 1 -- 172.21.15.156:0/2131126357 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28700a34a0 con 0x7f28701300a0 2023-09-30T22:23:54.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.064+0000 7f285effd700 1 -- 172.21.15.156:0/2131126357 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286000ee50 con 0x7f28701300a0 2023-09-30T22:23:54.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.064+0000 7f285effd700 1 -- 172.21.15.156:0/2131126357 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286000ca50 con 0x7f28701300a0 2023-09-30T22:23:54.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.065+0000 7fe66a09e700 1 Processor -- start 2023-09-30T22:23:54.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.065+0000 7fe66a09e700 1 -- start start 2023-09-30T22:23:54.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.065+0000 7f2874b8d700 1 -- 172.21.15.156:0/2131126357 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28540052e0 con 0x7f28701300a0 2023-09-30T22:23:54.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.065+0000 7f285effd700 1 -- 172.21.15.156:0/2131126357 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f286000cbb0 con 0x7f28701300a0 2023-09-30T22:23:54.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.065+0000 7f285effd700 1 -- 172.21.15.156:0/2131126357 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f286003f7d0 con 0x7f28701300a0 2023-09-30T22:23:54.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.065+0000 7fe66a09e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6640a0a70 0x7fe6640a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.065+0000 7fe66a09e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe6640a1380 0x7fe664133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.065+0000 7fe66a09e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe66409dc00 con 0x7fe664133f50 2023-09-30T22:23:54.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.065+0000 7fe66a09e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66409ea60 con 0x7fe6640a0a70 2023-09-30T22:23:54.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.065+0000 7fe66a09e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe66409dec0 con 0x7fe6640a1380 2023-09-30T22:23:54.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.065+0000 7fe662ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe6640a1380 0x7fe664133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.065+0000 7fe6637fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6640a0a70 0x7fe6640a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.065+0000 7fe662ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe6640a1380 0x7fe664133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:42766/0 (socket says 172.21.15.156:42766) 2023-09-30T22:23:54.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.065+0000 7fe662ffd700 1 -- 172.21.15.156:0/3860640070 learned_addr learned my addr 172.21.15.156:0/3860640070 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:54.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.066+0000 7fe662ffd700 1 -- 172.21.15.156:0/3860640070 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6640a0a70 msgr2=0x7fe6640a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:54.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.066+0000 7fe662ffd700 1 --2- 172.21.15.156:0/3860640070 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6640a0a70 0x7fe6640a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.066+0000 7fe662ffd700 1 -- 172.21.15.156:0/3860640070 >> v1:172.21.15.156:6789/0 conn(0x7fe664133f50 legacy=0x7fe66413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.066+0000 7fe662ffd700 1 -- 172.21.15.156:0/3860640070 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66409e6a0 con 0x7fe6640a1380 2023-09-30T22:23:54.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.066+0000 7fe6637fe700 1 --2- 172.21.15.156:0/3860640070 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6640a0a70 0x7fe6640a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:54.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.066+0000 7fe662ffd700 1 --2- 172.21.15.156:0/3860640070 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe6640a1380 0x7fe664133a10 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe654009920 tx=0x7fe654009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb3804c228a4697d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:54.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.066+0000 7fe6627fc700 1 -- 172.21.15.156:0/3860640070 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe654011830 con 0x7fe6640a1380 2023-09-30T22:23:54.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.066+0000 7fe6627fc700 1 -- 172.21.15.156:0/3860640070 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe654011990 con 0x7fe6640a1380 2023-09-30T22:23:54.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.066+0000 7fe6627fc700 1 -- 172.21.15.156:0/3860640070 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe654011d20 con 0x7fe6640a1380 2023-09-30T22:23:54.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.067+0000 7fe66a09e700 1 -- 172.21.15.156:0/3860640070 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe6640a1380 msgr2=0x7fe664133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.067+0000 7fe66a09e700 1 --2- 172.21.15.156:0/3860640070 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe6640a1380 0x7fe664133a10 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe654009920 tx=0x7fe654009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:54.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.067+0000 7fe66a09e700 1 -- 172.21.15.156:0/3860640070 shutdown_connections 2023-09-30T22:23:54.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.067+0000 7fe66a09e700 1 --2- 172.21.15.156:0/3860640070 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6640a0a70 0x7fe6640a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.067+0000 7fe66a09e700 1 --2- 172.21.15.156:0/3860640070 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe6640a1380 0x7fe664133a10 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.067+0000 7fe66a09e700 1 -- 172.21.15.156:0/3860640070 >> 172.21.15.156:0/3860640070 conn(0x7fe6640a6610 msgr2=0x7fe6640a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:54.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.067+0000 7fe66a09e700 1 -- 172.21.15.156:0/3860640070 shutdown_connections 2023-09-30T22:23:54.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.067+0000 7fe66a09e700 1 -- 172.21.15.156:0/3860640070 wait complete. 2023-09-30T22:23:54.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.068+0000 7fe66a09e700 1 Processor -- start 2023-09-30T22:23:54.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.068+0000 7fe66a09e700 1 -- start start 2023-09-30T22:23:54.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.068+0000 7fe66a09e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6640a0a70 0x7fe66411e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.068+0000 7fe66a09e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe6640a1380 0x7fe66411ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.068+0000 7fe66a09e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe664133f50 0x7fe66411f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.068+0000 7fe66a09e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6641222c0 con 0x7fe664133f50 2023-09-30T22:23:54.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.068+0000 7fe66a09e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6641203b0 con 0x7fe6640a0a70 2023-09-30T22:23:54.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.068+0000 7fe66a09e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe664133aa0 con 0x7fe6640a1380 2023-09-30T22:23:54.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.068+0000 7fe6637fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6640a0a70 0x7fe66411e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.068+0000 7fe663fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe664133f50 0x7fe66411f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.068+0000 7fe6637fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6640a0a70 0x7fe66411e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46102/0 (socket says 172.21.15.156:46102) 2023-09-30T22:23:54.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.069+0000 7fe6637fe700 1 -- 172.21.15.156:0/1368646736 learned_addr learned my addr 172.21.15.156:0/1368646736 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:54.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.069+0000 7fe662ffd700 1 --2- 172.21.15.156:0/1368646736 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe6640a1380 0x7fe66411ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.069+0000 7fe6637fe700 1 -- 172.21.15.156:0/1368646736 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe6640a1380 msgr2=0x7fe66411ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.069+0000 7fe6637fe700 1 --2- 172.21.15.156:0/1368646736 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe6640a1380 0x7fe66411ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.069+0000 7fe6637fe700 1 -- 172.21.15.156:0/1368646736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe664133f50 msgr2=0x7fe66411f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.069+0000 7fe6637fe700 1 --2- 172.21.15.156:0/1368646736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe664133f50 0x7fe66411f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.069+0000 7fe6637fe700 1 -- 172.21.15.156:0/1368646736 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6580094a0 con 0x7fe6640a0a70 2023-09-30T22:23:54.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.069+0000 7fe6637fe700 1 --2- 172.21.15.156:0/1368646736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6640a0a70 0x7fe66411e7a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe65800ebe0 tx=0x7fe65800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:54.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.069+0000 7fe64bfff700 1 -- 172.21.15.156:0/1368646736 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65800c850 con 0x7fe6640a0a70 2023-09-30T22:23:54.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.069+0000 7fe64bfff700 1 -- 172.21.15.156:0/1368646736 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65800c9b0 con 0x7fe6640a0a70 2023-09-30T22:23:54.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.069+0000 7fe66a09e700 1 -- 172.21.15.156:0/1368646736 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe654009550 con 0x7fe6640a0a70 2023-09-30T22:23:54.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.069+0000 7fe64bfff700 1 -- 172.21.15.156:0/1368646736 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65800cd20 con 0x7fe6640a0a70 2023-09-30T22:23:54.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.069+0000 7fe66a09e700 1 -- 172.21.15.156:0/1368646736 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe664121d20 con 0x7fe6640a0a70 2023-09-30T22:23:54.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.070+0000 7fe64bfff700 1 -- 172.21.15.156:0/1368646736 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe658013470 con 0x7fe6640a0a70 2023-09-30T22:23:54.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.070+0000 7fe64bfff700 1 -- 172.21.15.156:0/1368646736 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe65803f7c0 con 0x7fe6640a0a70 2023-09-30T22:23:54.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.070+0000 7fe66a09e700 1 -- 172.21.15.156:0/1368646736 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe66404f2a0 con 0x7fe6640a0a70 2023-09-30T22:23:54.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.071+0000 7f285effd700 1 -- 172.21.15.156:0/2131126357 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f28600232f0 con 0x7f28701300a0 2023-09-30T22:23:54.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.075+0000 7fe64bfff700 1 -- 172.21.15.156:0/1368646736 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe658021070 con 0x7fe6640a0a70 2023-09-30T22:23:54.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.238+0000 7f1e7a069700 1 -- 172.21.15.156:0/3353938659 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1e7411de50 con 0x7f1e74134570 2023-09-30T22:23:54.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.238+0000 7f1e6bfff700 1 -- 172.21.15.156:0/3353938659 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e64027480 con 0x7f1e74134570 2023-09-30T22:23:54.238 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:54.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.240+0000 7f1e7a069700 1 -- 172.21.15.156:0/3353938659 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e74134570 msgr2=0x7f1e7411d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.240+0000 7f1e7a069700 1 --2- 172.21.15.156:0/3353938659 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e74134570 0x7f1e7411d340 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1e74134a10 tx=0x7f1e64004ad0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.240+0000 7f1e7a069700 1 -- 172.21.15.156:0/3353938659 shutdown_connections 2023-09-30T22:23:54.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.240+0000 7f1e7a069700 1 --2- 172.21.15.156:0/3353938659 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e74134570 0x7f1e7411d340 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.240+0000 7f1e7a069700 1 --2- 172.21.15.156:0/3353938659 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e7409ad40 0x7f1e7411c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.240+0000 7f1e7a069700 1 --2- 172.21.15.156:0/3353938659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e74134140 0x7f1e7411ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.240+0000 7f1e7a069700 1 -- 172.21.15.156:0/3353938659 >> 172.21.15.156:0/3353938659 conn(0x7f1e74099c40 msgr2=0x7f1e740a6120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:54.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.240+0000 7f1e7a069700 1 -- 172.21.15.156:0/3353938659 shutdown_connections 2023-09-30T22:23:54.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.240+0000 7f1e7a069700 1 -- 172.21.15.156:0/3353938659 wait complete. 2023-09-30T22:23:54.252 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:54.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.264+0000 7f2874b8d700 1 -- 172.21.15.156:0/2131126357 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2854005590 con 0x7f28701300a0 2023-09-30T22:23:54.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.264+0000 7f285effd700 1 -- 172.21.15.156:0/2131126357 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2860017020 con 0x7f28701300a0 2023-09-30T22:23:54.264 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:54.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.266+0000 7f2874b8d700 1 -- 172.21.15.156:0/2131126357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28701300a0 msgr2=0x7f287011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.266+0000 7f2874b8d700 1 --2- 172.21.15.156:0/2131126357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28701300a0 0x7f287011da40 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f286000e9b0 tx=0x7f286000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.267+0000 7f2874b8d700 1 -- 172.21.15.156:0/2131126357 shutdown_connections 2023-09-30T22:23:54.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.267+0000 7f2874b8d700 1 --2- 172.21.15.156:0/2131126357 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2870133ad0 0x7f287011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.267+0000 7f2874b8d700 1 --2- 172.21.15.156:0/2131126357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28701300a0 0x7f287011da40 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.267+0000 7f2874b8d700 1 --2- 172.21.15.156:0/2131126357 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2870130bc0 0x7f287011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.267+0000 7f2874b8d700 1 -- 172.21.15.156:0/2131126357 >> 172.21.15.156:0/2131126357 conn(0x7f2870099c40 msgr2=0x7f2870132950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:54.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.267+0000 7f2874b8d700 1 -- 172.21.15.156:0/2131126357 shutdown_connections 2023-09-30T22:23:54.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.267+0000 7f2874b8d700 1 -- 172.21.15.156:0/2131126357 wait complete. 2023-09-30T22:23:54.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:54.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.285+0000 7fe66a09e700 1 -- 172.21.15.156:0/1368646736 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe664120b70 con 0x7fe6640a0a70 2023-09-30T22:23:54.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.286+0000 7fe64bfff700 1 -- 172.21.15.156:0/1368646736 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe658013720 con 0x7fe6640a0a70 2023-09-30T22:23:54.285 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:54.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.288+0000 7fe66a09e700 1 -- 172.21.15.156:0/1368646736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6640a0a70 msgr2=0x7fe66411e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.288+0000 7fe66a09e700 1 --2- 172.21.15.156:0/1368646736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6640a0a70 0x7fe66411e7a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe65800ebe0 tx=0x7fe65800eef0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.288+0000 7fe66a09e700 1 -- 172.21.15.156:0/1368646736 shutdown_connections 2023-09-30T22:23:54.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.288+0000 7fe66a09e700 1 --2- 172.21.15.156:0/1368646736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe664133f50 0x7fe66411f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.288+0000 7fe66a09e700 1 --2- 172.21.15.156:0/1368646736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6640a0a70 0x7fe66411e7a0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.288+0000 7fe66a09e700 1 --2- 172.21.15.156:0/1368646736 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe6640a1380 0x7fe66411ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.288+0000 7fe66a09e700 1 -- 172.21.15.156:0/1368646736 >> 172.21.15.156:0/1368646736 conn(0x7fe6640a6610 msgr2=0x7fe6640a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:54.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.288+0000 7fe66a09e700 1 -- 172.21.15.156:0/1368646736 shutdown_connections 2023-09-30T22:23:54.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:54.288+0000 7fe66a09e700 1 -- 172.21.15.156:0/1368646736 wait complete. 2023-09-30T22:23:54.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:55.006 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:55.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.135+0000 7f2c4b830700 1 Processor -- start 2023-09-30T22:23:55.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.135+0000 7f2c4b830700 1 -- start start 2023-09-30T22:23:55.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.136+0000 7f2c4b830700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2c4409d860 0x7f2c4409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.136+0000 7f2c4b830700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2c4409e170 0x7f2c441307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.136+0000 7f2c4b830700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2c44130ce0 0x7f2c44131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.136+0000 7f2c4b830700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c4409aaa0 con 0x7f2c4409e170 2023-09-30T22:23:55.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.136+0000 7f2c4b830700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4409f870 con 0x7f2c4409d860 2023-09-30T22:23:55.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.136+0000 7f2c4b830700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4409b360 con 0x7f2c44130ce0 2023-09-30T22:23:55.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.136+0000 7f2c49dcd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2c44130ce0 0x7f2c44131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.136+0000 7f2c48dcb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2c4409e170 0x7f2c441307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.136+0000 7f2c495cc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2c4409d860 0x7f2c4409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.136+0000 7f2c48dcb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2c4409e170 0x7f2c441307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44646/0 (socket says 172.21.15.156:44646) 2023-09-30T22:23:55.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.136+0000 7f2c49dcd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2c44130ce0 0x7f2c44131180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:42790/0 (socket says 172.21.15.156:42790) 2023-09-30T22:23:55.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.136+0000 7f2c495cc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2c4409d860 0x7f2c4409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46106/0 (socket says 172.21.15.156:46106) 2023-09-30T22:23:55.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.136+0000 7f2c48dcb700 1 -- 172.21.15.156:0/1717840870 learned_addr learned my addr 172.21.15.156:0/1717840870 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:55.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.136+0000 7f2c48dcb700 1 -- 172.21.15.156:0/1717840870 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2c44130ce0 msgr2=0x7f2c44131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:55.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.136+0000 7f2c48dcb700 1 --2- 172.21.15.156:0/1717840870 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2c44130ce0 0x7f2c44131180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.136+0000 7f2c48dcb700 1 -- 172.21.15.156:0/1717840870 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2c4409d860 msgr2=0x7f2c4409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:55.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.136+0000 7f2c48dcb700 1 --2- 172.21.15.156:0/1717840870 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2c4409d860 0x7f2c4409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.136+0000 7f2c48dcb700 1 -- 172.21.15.156:0/1717840870 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4409b620 con 0x7f2c4409e170 2023-09-30T22:23:55.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.136+0000 7f2c495cc700 1 --2- 172.21.15.156:0/1717840870 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2c4409d860 0x7f2c4409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:55.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.136+0000 7f2c49dcd700 1 --2- 172.21.15.156:0/1717840870 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2c44130ce0 0x7f2c44131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:55.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.136+0000 7f2c48dcb700 1 --2- 172.21.15.156:0/1717840870 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c4409e170 0x7f2c441307a0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000bb90 tx=0x7f2c4000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85bccd0945813453 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:55.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.136+0000 7f2c3bfff700 1 -- 172.21.15.156:0/1717840870 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4000dd30 con 0x7f2c4409e170 2023-09-30T22:23:55.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.136+0000 7f2c3bfff700 1 -- 172.21.15.156:0/1717840870 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4000de90 con 0x7f2c4409e170 2023-09-30T22:23:55.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.136+0000 7f2c3bfff700 1 -- 172.21.15.156:0/1717840870 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c40010690 con 0x7f2c4409e170 2023-09-30T22:23:55.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.137+0000 7f2c4b830700 1 -- 172.21.15.156:0/1717840870 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c4409e170 msgr2=0x7f2c441307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.137+0000 7f2c4b830700 1 --2- 172.21.15.156:0/1717840870 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c4409e170 0x7f2c441307a0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000bb90 tx=0x7f2c4000bea0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.137+0000 7f2c4b830700 1 -- 172.21.15.156:0/1717840870 shutdown_connections 2023-09-30T22:23:55.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.137+0000 7f2c4b830700 1 --2- 172.21.15.156:0/1717840870 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2c44130ce0 0x7f2c44131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.137+0000 7f2c4b830700 1 --2- 172.21.15.156:0/1717840870 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2c4409d860 0x7f2c4409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.137+0000 7f2c4b830700 1 --2- 172.21.15.156:0/1717840870 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c4409e170 0x7f2c441307a0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.137+0000 7f2c4b830700 1 -- 172.21.15.156:0/1717840870 >> 172.21.15.156:0/1717840870 conn(0x7f2c44099c40 msgr2=0x7f2c440a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:55.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.137+0000 7f2c4b830700 1 -- 172.21.15.156:0/1717840870 shutdown_connections 2023-09-30T22:23:55.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.137+0000 7f2c4b830700 1 -- 172.21.15.156:0/1717840870 wait complete. 2023-09-30T22:23:55.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.138+0000 7f2c4b830700 1 Processor -- start 2023-09-30T22:23:55.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.138+0000 7f2c4b830700 1 -- start start 2023-09-30T22:23:55.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.138+0000 7f2c4b830700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2c4409d860 0x7f2c441203b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.138+0000 7f2c4b830700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2c4409e170 0x7f2c441208f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.138+0000 7f2c4b830700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c44130ce0 0x7f2c44120e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.139+0000 7f2c4b830700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c44121fc0 con 0x7f2c44130ce0 2023-09-30T22:23:55.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.139+0000 7f2c4b830700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c441225e0 con 0x7f2c4409d860 2023-09-30T22:23:55.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.139+0000 7f2c4b830700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c44123bf0 con 0x7f2c4409e170 2023-09-30T22:23:55.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.139+0000 7f2c495cc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2c4409d860 0x7f2c441203b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.139+0000 7f2c495cc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2c4409d860 0x7f2c441203b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46112/0 (socket says 172.21.15.156:46112) 2023-09-30T22:23:55.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.139+0000 7f2c495cc700 1 -- 172.21.15.156:0/1073941482 learned_addr learned my addr 172.21.15.156:0/1073941482 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:55.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.139+0000 7f2c48dcb700 1 --2- 172.21.15.156:0/1073941482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2c4409e170 0x7f2c441208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.139+0000 7f2c49dcd700 1 --2- 172.21.15.156:0/1073941482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c44130ce0 0x7f2c44120e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.139+0000 7f2c495cc700 1 -- 172.21.15.156:0/1073941482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2c4409e170 msgr2=0x7f2c441208f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.139+0000 7f2c495cc700 1 --2- 172.21.15.156:0/1073941482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2c4409e170 0x7f2c441208f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.139+0000 7f2c495cc700 1 -- 172.21.15.156:0/1073941482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c44130ce0 msgr2=0x7f2c44120e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.139+0000 7f2c495cc700 1 --2- 172.21.15.156:0/1073941482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c44130ce0 0x7f2c44120e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.139+0000 7f2c495cc700 1 -- 172.21.15.156:0/1073941482 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c340094a0 con 0x7f2c4409d860 2023-09-30T22:23:55.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.139+0000 7f2c48dcb700 1 --2- 172.21.15.156:0/1073941482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2c4409e170 0x7f2c441208f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:55.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.139+0000 7f2c495cc700 1 --2- 172.21.15.156:0/1073941482 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2c4409d860 0x7f2c441203b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2c3400ebe0 tx=0x7f2c3400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:55.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.139+0000 7f2c39ffb700 1 -- 172.21.15.156:0/1073941482 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c34009780 con 0x7f2c4409d860 2023-09-30T22:23:55.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.139+0000 7f2c39ffb700 1 -- 172.21.15.156:0/1073941482 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3400c850 con 0x7f2c4409d860 2023-09-30T22:23:55.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.139+0000 7f2c4b830700 1 -- 172.21.15.156:0/1073941482 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c3c009a70 con 0x7f2c4409d860 2023-09-30T22:23:55.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.139+0000 7f2c39ffb700 1 -- 172.21.15.156:0/1073941482 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3400cbe0 con 0x7f2c4409d860 2023-09-30T22:23:55.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.139+0000 7f2c4b830700 1 -- 172.21.15.156:0/1073941482 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c4000b7f0 con 0x7f2c4409d860 2023-09-30T22:23:55.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.140+0000 7f2c39ffb700 1 -- 172.21.15.156:0/1073941482 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c3400cd40 con 0x7f2c4409d860 2023-09-30T22:23:55.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.140+0000 7f2c39ffb700 1 -- 172.21.15.156:0/1073941482 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2c3403fae0 con 0x7f2c4409d860 2023-09-30T22:23:55.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.140+0000 7f2c4b830700 1 -- 172.21.15.156:0/1073941482 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c4404f2a0 con 0x7f2c4409d860 2023-09-30T22:23:55.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.145+0000 7f2c39ffb700 1 -- 172.21.15.156:0/1073941482 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c34011b00 con 0x7f2c4409d860 2023-09-30T22:23:55.253 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:55.279 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:55.300 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:55.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.348+0000 7f2c4b830700 1 -- 172.21.15.156:0/1073941482 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2c441227b0 con 0x7f2c4409d860 2023-09-30T22:23:55.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.349+0000 7f2c39ffb700 1 -- 172.21.15.156:0/1073941482 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2c34021020 con 0x7f2c4409d860 2023-09-30T22:23:55.348 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:55.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.351+0000 7f2c4b830700 1 -- 172.21.15.156:0/1073941482 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2c4409d860 msgr2=0x7f2c441203b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.351+0000 7f2c4b830700 1 --2- 172.21.15.156:0/1073941482 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2c4409d860 0x7f2c441203b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2c3400ebe0 tx=0x7f2c3400eef0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.351+0000 7f2c4b830700 1 -- 172.21.15.156:0/1073941482 shutdown_connections 2023-09-30T22:23:55.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.351+0000 7f2c4b830700 1 --2- 172.21.15.156:0/1073941482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c44130ce0 0x7f2c44120e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.351+0000 7f2c4b830700 1 --2- 172.21.15.156:0/1073941482 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2c4409d860 0x7f2c441203b0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.351+0000 7f2c4b830700 1 --2- 172.21.15.156:0/1073941482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2c4409e170 0x7f2c441208f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.351+0000 7f2c4b830700 1 -- 172.21.15.156:0/1073941482 >> 172.21.15.156:0/1073941482 conn(0x7f2c44099c40 msgr2=0x7f2c440a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:55.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.352+0000 7f2c4b830700 1 -- 172.21.15.156:0/1073941482 shutdown_connections 2023-09-30T22:23:55.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.352+0000 7f2c4b830700 1 -- 172.21.15.156:0/1073941482 wait complete. 2023-09-30T22:23:55.366 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:55.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.385+0000 7f75f3849700 1 Processor -- start 2023-09-30T22:23:55.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.385+0000 7f75f3849700 1 -- start start 2023-09-30T22:23:55.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.386+0000 7f75f3849700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75ec09e870 0x7f75ec09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.386+0000 7f75f3849700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f75ec09f180 0x7f75ec131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.386+0000 7f75f3849700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75ec09c970 con 0x7f75ec131d70 2023-09-30T22:23:55.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.386+0000 7f75f3849700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75ec0a0920 con 0x7f75ec09f180 2023-09-30T22:23:55.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.386+0000 7f75f3849700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec09f9c0 con 0x7f75ec09e870 2023-09-30T22:23:55.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.386+0000 7f75f15e5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75ec09e870 0x7f75ec09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.386+0000 7f75f15e5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75ec09e870 0x7f75ec09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46116/0 (socket says 172.21.15.156:46116) 2023-09-30T22:23:55.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.386+0000 7f75f15e5700 1 -- 172.21.15.156:0/1379175095 learned_addr learned my addr 172.21.15.156:0/1379175095 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:55.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.386+0000 7f75f0de4700 1 --2- 172.21.15.156:0/1379175095 >> v2:172.21.15.156:3300/0 conn(0x7f75ec09f180 0x7f75ec131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.386+0000 7f75f15e5700 1 -- 172.21.15.156:0/1379175095 >> v2:172.21.15.156:3300/0 conn(0x7f75ec09f180 msgr2=0x7f75ec131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:55.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.386+0000 7f75f15e5700 1 --2- 172.21.15.156:0/1379175095 >> v2:172.21.15.156:3300/0 conn(0x7f75ec09f180 0x7f75ec131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.386+0000 7f75f15e5700 1 -- 172.21.15.156:0/1379175095 >> v1:172.21.15.156:6789/0 conn(0x7f75ec131d70 legacy=0x7f75ec138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.386+0000 7f75f15e5700 1 -- 172.21.15.156:0/1379175095 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ec09bab0 con 0x7f75ec09e870 2023-09-30T22:23:55.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.387+0000 7f75f15e5700 1 --2- 172.21.15.156:0/1379175095 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75ec09e870 0x7f75ec09ec40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f75e800f9b0 tx=0x7f75e800fcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c42873d566fad444 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:55.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.387+0000 7f75e3fff700 1 -- 172.21.15.156:0/1379175095 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e800f460 con 0x7f75ec09e870 2023-09-30T22:23:55.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.387+0000 7f75e3fff700 1 -- 172.21.15.156:0/1379175095 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e800fe50 con 0x7f75ec09e870 2023-09-30T22:23:55.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.387+0000 7f75e3fff700 1 -- 172.21.15.156:0/1379175095 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e8009bc0 con 0x7f75ec09e870 2023-09-30T22:23:55.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.387+0000 7f75f3849700 1 -- 172.21.15.156:0/1379175095 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75ec09e870 msgr2=0x7f75ec09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.387+0000 7f75f3849700 1 --2- 172.21.15.156:0/1379175095 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75ec09e870 0x7f75ec09ec40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f75e800f9b0 tx=0x7f75e800fcc0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.387+0000 7f75f3849700 1 -- 172.21.15.156:0/1379175095 shutdown_connections 2023-09-30T22:23:55.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.387+0000 7f75f3849700 1 --2- 172.21.15.156:0/1379175095 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75ec09e870 0x7f75ec09ec40 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.387+0000 7f75f3849700 1 --2- 172.21.15.156:0/1379175095 >> v2:172.21.15.156:3300/0 conn(0x7f75ec09f180 0x7f75ec131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.387+0000 7f75f3849700 1 -- 172.21.15.156:0/1379175095 >> 172.21.15.156:0/1379175095 conn(0x7f75ec0a4430 msgr2=0x7f75ec0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:55.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.388+0000 7f75f3849700 1 -- 172.21.15.156:0/1379175095 shutdown_connections 2023-09-30T22:23:55.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.388+0000 7f75f3849700 1 -- 172.21.15.156:0/1379175095 wait complete. 2023-09-30T22:23:55.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.388+0000 7f75f3849700 1 Processor -- start 2023-09-30T22:23:55.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.389+0000 7f75f3849700 1 -- start start 2023-09-30T22:23:55.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.389+0000 7f75f3849700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75ec09e870 0x7f75ec11c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.389+0000 7f75f3849700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75ec09f180 0x7f75ec11c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.389+0000 7f75f3849700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75ec131d70 0x7f75ec11cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.389+0000 7f75f3849700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec11d4f0 con 0x7f75ec09e870 2023-09-30T22:23:55.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.389+0000 7f75f3849700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec11dc50 con 0x7f75ec131d70 2023-09-30T22:23:55.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.389+0000 7f75f3849700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec11eea0 con 0x7f75ec09f180 2023-09-30T22:23:55.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.389+0000 7f75f0de4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75ec09f180 0x7f75ec11c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.389+0000 7f75f0de4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75ec09f180 0x7f75ec11c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:42808/0 (socket says 172.21.15.156:42808) 2023-09-30T22:23:55.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.389+0000 7f75f0de4700 1 -- 172.21.15.156:0/949973861 learned_addr learned my addr 172.21.15.156:0/949973861 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:55.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.389+0000 7f75f1de6700 1 --2- 172.21.15.156:0/949973861 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75ec131d70 0x7f75ec11cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.389+0000 7f75f15e5700 1 --2- 172.21.15.156:0/949973861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75ec09e870 0x7f75ec11c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.389+0000 7f75f0de4700 1 -- 172.21.15.156:0/949973861 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75ec131d70 msgr2=0x7f75ec11cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.389+0000 7f75f0de4700 1 --2- 172.21.15.156:0/949973861 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75ec131d70 0x7f75ec11cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.389+0000 7f75f0de4700 1 -- 172.21.15.156:0/949973861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75ec09e870 msgr2=0x7f75ec11c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.389+0000 7f75f0de4700 1 --2- 172.21.15.156:0/949973861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75ec09e870 0x7f75ec11c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.389+0000 7f75f0de4700 1 -- 172.21.15.156:0/949973861 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e800f610 con 0x7f75ec09f180 2023-09-30T22:23:55.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.390+0000 7f75f0de4700 1 --2- 172.21.15.156:0/949973861 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75ec09f180 0x7f75ec11c580 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f75dc00e9b0 tx=0x7f75dc00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:55.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.390+0000 7f75e1ffb700 1 -- 172.21.15.156:0/949973861 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc009710 con 0x7f75ec09f180 2023-09-30T22:23:55.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.390+0000 7f75e1ffb700 1 -- 172.21.15.156:0/949973861 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75dc00ee50 con 0x7f75ec09f180 2023-09-30T22:23:55.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.390+0000 7f75f3849700 1 -- 172.21.15.156:0/949973861 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ec11f880 con 0x7f75ec09f180 2023-09-30T22:23:55.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.390+0000 7f75e1ffb700 1 -- 172.21.15.156:0/949973861 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc00ca70 con 0x7f75ec09f180 2023-09-30T22:23:55.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.390+0000 7f75f3849700 1 -- 172.21.15.156:0/949973861 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ec09dba0 con 0x7f75ec09f180 2023-09-30T22:23:55.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.391+0000 7f75e1ffb700 1 -- 172.21.15.156:0/949973861 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f75dc00cbd0 con 0x7f75ec09f180 2023-09-30T22:23:55.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.391+0000 7f75e1ffb700 1 -- 172.21.15.156:0/949973861 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f75dc03f7b0 con 0x7f75ec09f180 2023-09-30T22:23:55.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.391+0000 7f75f3849700 1 -- 172.21.15.156:0/949973861 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75ec071090 con 0x7f75ec09f180 2023-09-30T22:23:55.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.396+0000 7f75e1ffb700 1 -- 172.21.15.156:0/949973861 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f75dc0232f0 con 0x7f75ec09f180 2023-09-30T22:23:55.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.429+0000 7f67bab86700 1 Processor -- start 2023-09-30T22:23:55.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.429+0000 7f67bab86700 1 -- start start 2023-09-30T22:23:55.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.430+0000 7f67bab86700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67b40a1550 0x7f67b4138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.430+0000 7f67bab86700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f67b4139200 0x7f67b413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.430+0000 7f67bab86700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67b409e9d0 con 0x7f67b40a0a70 2023-09-30T22:23:55.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.430+0000 7f67bab86700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67b409dc00 con 0x7f67b4139200 2023-09-30T22:23:55.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.430+0000 7f67bab86700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67b409dec0 con 0x7f67b40a1550 2023-09-30T22:23:55.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.430+0000 7f67b8922700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f67b40a0a70 0x7f67b40a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49116/0 (socket says 172.21.15.156:49116) 2023-09-30T22:23:55.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.430+0000 7f67b8922700 1 -- 172.21.15.156:0/1555505369 learned_addr learned my addr 172.21.15.156:0/1555505369 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:55.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.430+0000 7f67b9123700 1 --2- 172.21.15.156:0/1555505369 >> v2:172.21.15.156:3300/0 conn(0x7f67b4139200 0x7f67b413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.430+0000 7f67b3fff700 1 --2- 172.21.15.156:0/1555505369 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67b40a1550 0x7f67b4138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.430+0000 7f67b37fe700 1 -- 172.21.15.156:0/1555505369 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54558904 0 0) 0x7f67b409e9d0 con 0x7f67b40a0a70 2023-09-30T22:23:55.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.430+0000 7f67b37fe700 1 -- 172.21.15.156:0/1555505369 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67a40035b0 con 0x7f67b40a0a70 2023-09-30T22:23:55.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.430+0000 7f67b3fff700 1 -- 172.21.15.156:0/1555505369 >> v2:172.21.15.156:3300/0 conn(0x7f67b4139200 msgr2=0x7f67b413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:55.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.430+0000 7f67b3fff700 1 --2- 172.21.15.156:0/1555505369 >> v2:172.21.15.156:3300/0 conn(0x7f67b4139200 0x7f67b413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.430+0000 7f67b3fff700 1 -- 172.21.15.156:0/1555505369 >> v1:172.21.15.156:6789/0 conn(0x7f67b40a0a70 legacy=0x7f67b40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.430+0000 7f67b3fff700 1 -- 172.21.15.156:0/1555505369 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b409e6a0 con 0x7f67b40a1550 2023-09-30T22:23:55.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.430+0000 7f67b9123700 1 --2- 172.21.15.156:0/1555505369 >> v2:172.21.15.156:3300/0 conn(0x7f67b4139200 0x7f67b413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:55.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.431+0000 7f67b3fff700 1 --2- 172.21.15.156:0/1555505369 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67b40a1550 0x7f67b4138cc0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f67a0009840 tx=0x7f67a0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f91c9ac9a58e994 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:55.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.431+0000 7f67b37fe700 1 -- 172.21.15.156:0/1555505369 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a0011830 con 0x7f67b40a1550 2023-09-30T22:23:55.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.431+0000 7f67b37fe700 1 -- 172.21.15.156:0/1555505369 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a0011990 con 0x7f67b40a1550 2023-09-30T22:23:55.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.431+0000 7f67b37fe700 1 -- 172.21.15.156:0/1555505369 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a0011d20 con 0x7f67b40a1550 2023-09-30T22:23:55.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.431+0000 7f67bab86700 1 -- 172.21.15.156:0/1555505369 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67b40a1550 msgr2=0x7f67b4138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.431+0000 7f67bab86700 1 --2- 172.21.15.156:0/1555505369 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67b40a1550 0x7f67b4138cc0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f67a0009840 tx=0x7f67a0009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:55.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.431+0000 7f67bab86700 1 -- 172.21.15.156:0/1555505369 shutdown_connections 2023-09-30T22:23:55.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.431+0000 7f67bab86700 1 --2- 172.21.15.156:0/1555505369 >> v2:172.21.15.156:3300/0 conn(0x7f67b4139200 0x7f67b413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.431+0000 7f67bab86700 1 --2- 172.21.15.156:0/1555505369 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67b40a1550 0x7f67b4138cc0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.431+0000 7f67bab86700 1 -- 172.21.15.156:0/1555505369 >> 172.21.15.156:0/1555505369 conn(0x7f67b40a6610 msgr2=0x7f67b40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:55.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.431+0000 7f67bab86700 1 -- 172.21.15.156:0/1555505369 shutdown_connections 2023-09-30T22:23:55.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.431+0000 7f67bab86700 1 -- 172.21.15.156:0/1555505369 wait complete. 2023-09-30T22:23:55.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.432+0000 7f67bab86700 1 Processor -- start 2023-09-30T22:23:55.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.432+0000 7f67bab86700 1 -- start start 2023-09-30T22:23:55.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.433+0000 7f67bab86700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67b40a0a70 0x7f67b41206e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.433+0000 7f67bab86700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67b40a1550 0x7f67b4120c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.433+0000 7f67bab86700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67b4139200 0x7f67b4121160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.433+0000 7f67bab86700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b4136010 con 0x7f67b4139200 2023-09-30T22:23:55.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.433+0000 7f67bab86700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b41365d0 con 0x7f67b40a1550 2023-09-30T22:23:55.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.433+0000 7f67bab86700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67b4124200 con 0x7f67b40a0a70 2023-09-30T22:23:55.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.433+0000 7f67b8922700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67b40a0a70 0x7f67b41206e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.433+0000 7f67b8922700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67b40a0a70 0x7f67b41206e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:42836/0 (socket says 172.21.15.156:42836) 2023-09-30T22:23:55.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.433+0000 7f67b8922700 1 -- 172.21.15.156:0/1920396948 learned_addr learned my addr 172.21.15.156:0/1920396948 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:55.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.433+0000 7f67b9123700 1 --2- 172.21.15.156:0/1920396948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67b4139200 0x7f67b4121160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.433+0000 7f67b3fff700 1 --2- 172.21.15.156:0/1920396948 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67b40a1550 0x7f67b4120c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.433+0000 7f67b9123700 1 -- 172.21.15.156:0/1920396948 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67b40a0a70 msgr2=0x7f67b41206e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.433+0000 7f67b9123700 1 --2- 172.21.15.156:0/1920396948 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67b40a0a70 0x7f67b41206e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.433+0000 7f67b9123700 1 -- 172.21.15.156:0/1920396948 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67b40a1550 msgr2=0x7f67b4120c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.433+0000 7f67b9123700 1 --2- 172.21.15.156:0/1920396948 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67b40a1550 0x7f67b4120c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.433+0000 7f67b9123700 1 -- 172.21.15.156:0/1920396948 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ac009a70 con 0x7f67b4139200 2023-09-30T22:23:55.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.433+0000 7f67b8922700 1 --2- 172.21.15.156:0/1920396948 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67b40a0a70 0x7f67b41206e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:55.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.433+0000 7f67b3fff700 1 --2- 172.21.15.156:0/1920396948 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67b40a1550 0x7f67b4120c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:55.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.434+0000 7f67b9123700 1 --2- 172.21.15.156:0/1920396948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67b4139200 0x7f67b4121160 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f67ac00efc0 tx=0x7f67ac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:55.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.434+0000 7f67b17fa700 1 -- 172.21.15.156:0/1920396948 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ac00ca90 con 0x7f67b4139200 2023-09-30T22:23:55.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.434+0000 7f67b17fa700 1 -- 172.21.15.156:0/1920396948 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ac00f040 con 0x7f67b4139200 2023-09-30T22:23:55.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.434+0000 7f67bab86700 1 -- 172.21.15.156:0/1920396948 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67a00094a0 con 0x7f67b4139200 2023-09-30T22:23:55.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.434+0000 7f67b17fa700 1 -- 172.21.15.156:0/1920396948 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ac00ce30 con 0x7f67b4139200 2023-09-30T22:23:55.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.434+0000 7f67bab86700 1 -- 172.21.15.156:0/1920396948 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67b40a03e0 con 0x7f67b4139200 2023-09-30T22:23:55.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.435+0000 7f67b17fa700 1 -- 172.21.15.156:0/1920396948 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f67ac014480 con 0x7f67b4139200 2023-09-30T22:23:55.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.435+0000 7f67b17fa700 1 -- 172.21.15.156:0/1920396948 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f67ac03fcd0 con 0x7f67b4139200 2023-09-30T22:23:55.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.435+0000 7f67bab86700 1 -- 172.21.15.156:0/1920396948 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67b4122b50 con 0x7f67b4139200 2023-09-30T22:23:55.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.440+0000 7f67b17fa700 1 -- 172.21.15.156:0/1920396948 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f67ac012910 con 0x7f67b4139200 2023-09-30T22:23:55.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.498+0000 7f6f65fdd700 1 Processor -- start 2023-09-30T22:23:55.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.498+0000 7f6f65fdd700 1 -- start start 2023-09-30T22:23:55.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.498+0000 7f6f65fdd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6f600a0a70 0x7f6f600a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.498+0000 7f6f65fdd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f600a1380 0x7f6f60133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.498+0000 7f6f65fdd700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f6009dc00 con 0x7f6f60133f50 2023-09-30T22:23:55.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.498+0000 7f6f65fdd700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f6009ea60 con 0x7f6f600a0a70 2023-09-30T22:23:55.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.498+0000 7f6f65fdd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6009dec0 con 0x7f6f600a1380 2023-09-30T22:23:55.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.498+0000 7f6f5f7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6f600a0a70 0x7f6f600a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.499+0000 7f6f5f7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6f600a0a70 0x7f6f600a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44698/0 (socket says 172.21.15.156:44698) 2023-09-30T22:23:55.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.499+0000 7f6f5f7fe700 1 -- 172.21.15.156:0/2866059486 learned_addr learned my addr 172.21.15.156:0/2866059486 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:55.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.499+0000 7f6f57fff700 1 --2- 172.21.15.156:0/2866059486 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f600a1380 0x7f6f60133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.499+0000 7f6f5f7fe700 1 -- 172.21.15.156:0/2866059486 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f600a1380 msgr2=0x7f6f60133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:55.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.499+0000 7f6f5f7fe700 1 --2- 172.21.15.156:0/2866059486 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f600a1380 0x7f6f60133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.499+0000 7f6f5f7fe700 1 -- 172.21.15.156:0/2866059486 >> v1:172.21.15.156:6789/0 conn(0x7f6f60133f50 legacy=0x7f6f6013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.499+0000 7f6f5f7fe700 1 -- 172.21.15.156:0/2866059486 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6009e6a0 con 0x7f6f600a0a70 2023-09-30T22:23:55.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.499+0000 7f6f5effd700 1 -- 172.21.15.156:0/2866059486 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3864623725 0 0) 0x7f6f6009dc00 con 0x7f6f60133f50 2023-09-30T22:23:55.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.499+0000 7f6f57fff700 1 --2- 172.21.15.156:0/2866059486 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f600a1380 0x7f6f60133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:55.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.499+0000 7f6f5f7fe700 1 --2- 172.21.15.156:0/2866059486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f600a0a70 0x7f6f600a0e40 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f6f500098f0 tx=0x7f6f50009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f83d7dfc39427142 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:55.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.499+0000 7f6f5effd700 1 -- 172.21.15.156:0/2866059486 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f50011830 con 0x7f6f600a0a70 2023-09-30T22:23:55.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.499+0000 7f6f5effd700 1 -- 172.21.15.156:0/2866059486 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f50011990 con 0x7f6f600a0a70 2023-09-30T22:23:55.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.499+0000 7f6f5effd700 1 -- 172.21.15.156:0/2866059486 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f50011d20 con 0x7f6f600a0a70 2023-09-30T22:23:55.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.500+0000 7f6f65fdd700 1 -- 172.21.15.156:0/2866059486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f600a0a70 msgr2=0x7f6f600a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.500+0000 7f6f65fdd700 1 --2- 172.21.15.156:0/2866059486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f600a0a70 0x7f6f600a0e40 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f6f500098f0 tx=0x7f6f50009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:55.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.500+0000 7f6f65fdd700 1 -- 172.21.15.156:0/2866059486 shutdown_connections 2023-09-30T22:23:55.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.500+0000 7f6f65fdd700 1 --2- 172.21.15.156:0/2866059486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f600a0a70 0x7f6f600a0e40 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.500+0000 7f6f65fdd700 1 --2- 172.21.15.156:0/2866059486 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f600a1380 0x7f6f60133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.500+0000 7f6f65fdd700 1 -- 172.21.15.156:0/2866059486 >> 172.21.15.156:0/2866059486 conn(0x7f6f600a6610 msgr2=0x7f6f600a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:55.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.500+0000 7f6f65fdd700 1 -- 172.21.15.156:0/2866059486 shutdown_connections 2023-09-30T22:23:55.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.500+0000 7f6f65fdd700 1 -- 172.21.15.156:0/2866059486 wait complete. 2023-09-30T22:23:55.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.501+0000 7f6f65fdd700 1 Processor -- start 2023-09-30T22:23:55.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.501+0000 7f6f65fdd700 1 -- start start 2023-09-30T22:23:55.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.502+0000 7f6f65fdd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f600a0a70 0x7f6f60122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.502+0000 7f6f65fdd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f600a1380 0x7f6f60122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.502+0000 7f6f65fdd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f60133f50 0x7f6f601232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.502+0000 7f6f65fdd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f60133ad0 con 0x7f6f600a1380 2023-09-30T22:23:55.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.502+0000 7f6f65fdd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f60125de0 con 0x7f6f600a0a70 2023-09-30T22:23:55.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.502+0000 7f6f65fdd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f60124510 con 0x7f6f60133f50 2023-09-30T22:23:55.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.502+0000 7f6f57fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f600a1380 0x7f6f60122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.502+0000 7f6f57fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f600a1380 0x7f6f60122da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44714/0 (socket says 172.21.15.156:44714) 2023-09-30T22:23:55.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.502+0000 7f6f57fff700 1 -- 172.21.15.156:0/1655037336 learned_addr learned my addr 172.21.15.156:0/1655037336 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:55.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.502+0000 7f6f5ffff700 1 --2- 172.21.15.156:0/1655037336 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f60133f50 0x7f6f601232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.502+0000 7f6f57fff700 1 -- 172.21.15.156:0/1655037336 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f60133f50 msgr2=0x7f6f601232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.502+0000 7f6f57fff700 1 --2- 172.21.15.156:0/1655037336 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f60133f50 0x7f6f601232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.503+0000 7f6f57fff700 1 -- 172.21.15.156:0/1655037336 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f600a0a70 msgr2=0x7f6f60122860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.503+0000 7f6f57fff700 1 --2- 172.21.15.156:0/1655037336 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f600a0a70 0x7f6f60122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.503+0000 7f6f57fff700 1 -- 172.21.15.156:0/1655037336 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f480094a0 con 0x7f6f600a1380 2023-09-30T22:23:55.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.503+0000 7f6f57fff700 1 --2- 172.21.15.156:0/1655037336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f600a1380 0x7f6f60122da0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f6f4800ebe0 tx=0x7f6f4800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:55.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.503+0000 7f6f5cff9700 1 -- 172.21.15.156:0/1655037336 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f48009800 con 0x7f6f600a1380 2023-09-30T22:23:55.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.503+0000 7f6f5cff9700 1 -- 172.21.15.156:0/1655037336 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4800c910 con 0x7f6f600a1380 2023-09-30T22:23:55.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.503+0000 7f6f65fdd700 1 -- 172.21.15.156:0/1655037336 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f50009550 con 0x7f6f600a1380 2023-09-30T22:23:55.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.503+0000 7f6f5cff9700 1 -- 172.21.15.156:0/1655037336 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4800cc80 con 0x7f6f600a1380 2023-09-30T22:23:55.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.504+0000 7f6f5cff9700 1 -- 172.21.15.156:0/1655037336 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f48013470 con 0x7f6f600a1380 2023-09-30T22:23:55.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.504+0000 7f6f65fdd700 1 -- 172.21.15.156:0/1655037336 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f600a0430 con 0x7f6f600a1380 2023-09-30T22:23:55.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.504+0000 7f6f5cff9700 1 -- 172.21.15.156:0/1655037336 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6f4801bd40 con 0x7f6f600a1380 2023-09-30T22:23:55.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.505+0000 7f6f65fdd700 1 -- 172.21.15.156:0/1655037336 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f6004f2a0 con 0x7f6f600a1380 2023-09-30T22:23:55.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.509+0000 7f6f5cff9700 1 -- 172.21.15.156:0/1655037336 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f48017070 con 0x7f6f600a1380 2023-09-30T22:23:55.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.627+0000 7f75f3849700 1 -- 172.21.15.156:0/949973861 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f75ec04f2a0 con 0x7f75ec09f180 2023-09-30T22:23:55.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.627+0000 7f75e1ffb700 1 -- 172.21.15.156:0/949973861 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f75dc01bba0 con 0x7f75ec09f180 2023-09-30T22:23:55.627 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:55.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.629+0000 7f75f3849700 1 -- 172.21.15.156:0/949973861 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75ec09f180 msgr2=0x7f75ec11c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.629+0000 7f75f3849700 1 --2- 172.21.15.156:0/949973861 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75ec09f180 0x7f75ec11c580 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f75dc00e9b0 tx=0x7f75dc00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.629+0000 7f75f3849700 1 -- 172.21.15.156:0/949973861 shutdown_connections 2023-09-30T22:23:55.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.629+0000 7f75f3849700 1 --2- 172.21.15.156:0/949973861 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75ec131d70 0x7f75ec11cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.629+0000 7f75f3849700 1 --2- 172.21.15.156:0/949973861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75ec09e870 0x7f75ec11c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.629+0000 7f75f3849700 1 --2- 172.21.15.156:0/949973861 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f75ec09f180 0x7f75ec11c580 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.629+0000 7f75f3849700 1 -- 172.21.15.156:0/949973861 >> 172.21.15.156:0/949973861 conn(0x7f75ec0a4430 msgr2=0x7f75ec131080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:55.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.629+0000 7f75f3849700 1 -- 172.21.15.156:0/949973861 shutdown_connections 2023-09-30T22:23:55.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.629+0000 7f75f3849700 1 -- 172.21.15.156:0/949973861 wait complete. 2023-09-30T22:23:55.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.636+0000 7f67bab86700 1 -- 172.21.15.156:0/1920396948 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f67b404f2a0 con 0x7f67b4139200 2023-09-30T22:23:55.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.636+0000 7f67b17fa700 1 -- 172.21.15.156:0/1920396948 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f67ac012340 con 0x7f67b4139200 2023-09-30T22:23:55.636 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:55.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.638+0000 7f67bab86700 1 -- 172.21.15.156:0/1920396948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67b4139200 msgr2=0x7f67b4121160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.638+0000 7f67bab86700 1 --2- 172.21.15.156:0/1920396948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67b4139200 0x7f67b4121160 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f67ac00efc0 tx=0x7f67ac00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.638+0000 7f67bab86700 1 -- 172.21.15.156:0/1920396948 shutdown_connections 2023-09-30T22:23:55.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.638+0000 7f67bab86700 1 --2- 172.21.15.156:0/1920396948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67b4139200 0x7f67b4121160 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.638+0000 7f67bab86700 1 --2- 172.21.15.156:0/1920396948 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67b40a0a70 0x7f67b41206e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.638+0000 7f67bab86700 1 --2- 172.21.15.156:0/1920396948 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67b40a1550 0x7f67b4120c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.638+0000 7f67bab86700 1 -- 172.21.15.156:0/1920396948 >> 172.21.15.156:0/1920396948 conn(0x7f67b40a6610 msgr2=0x7f67b40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:55.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.639+0000 7f67bab86700 1 -- 172.21.15.156:0/1920396948 shutdown_connections 2023-09-30T22:23:55.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.639+0000 7f67bab86700 1 -- 172.21.15.156:0/1920396948 wait complete. 2023-09-30T22:23:55.641 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:55.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:55.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.701+0000 7f6f65fdd700 1 -- 172.21.15.156:0/1655037336 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6f60126440 con 0x7f6f600a1380 2023-09-30T22:23:55.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.702+0000 7f6f5cff9700 1 -- 172.21.15.156:0/1655037336 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f48024020 con 0x7f6f600a1380 2023-09-30T22:23:55.702 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:55.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.704+0000 7f6f65fdd700 1 -- 172.21.15.156:0/1655037336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f600a1380 msgr2=0x7f6f60122da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.704+0000 7f6f65fdd700 1 --2- 172.21.15.156:0/1655037336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f600a1380 0x7f6f60122da0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f6f4800ebe0 tx=0x7f6f4800eef0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.704+0000 7f6f65fdd700 1 -- 172.21.15.156:0/1655037336 shutdown_connections 2023-09-30T22:23:55.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.704+0000 7f6f65fdd700 1 --2- 172.21.15.156:0/1655037336 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f60133f50 0x7f6f601232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.704+0000 7f6f65fdd700 1 --2- 172.21.15.156:0/1655037336 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f600a0a70 0x7f6f60122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.704+0000 7f6f65fdd700 1 --2- 172.21.15.156:0/1655037336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f600a1380 0x7f6f60122da0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.704+0000 7f6f65fdd700 1 -- 172.21.15.156:0/1655037336 >> 172.21.15.156:0/1655037336 conn(0x7f6f600a6610 msgr2=0x7f6f6009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:55.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.704+0000 7f6f65fdd700 1 -- 172.21.15.156:0/1655037336 shutdown_connections 2023-09-30T22:23:55.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:55.704+0000 7f6f65fdd700 1 -- 172.21.15.156:0/1655037336 wait complete. 2023-09-30T22:23:55.716 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:56.367 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:56.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.499+0000 7fc65e518700 1 Processor -- start 2023-09-30T22:23:56.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.499+0000 7fc65e518700 1 -- start start 2023-09-30T22:23:56.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.499+0000 7fc65e518700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc65809d860 0x7fc65809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:56.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.499+0000 7fc65e518700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc658130eb0 0x7fc658138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:56.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.499+0000 7fc65e518700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc65809aaa0 con 0x7fc65809e170 2023-09-30T22:23:56.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.499+0000 7fc65e518700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc65809f870 con 0x7fc658130eb0 2023-09-30T22:23:56.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.499+0000 7fc65e518700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65809b360 con 0x7fc65809d860 2023-09-30T22:23:56.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.499+0000 7fc65cab5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc658130eb0 0x7fc658138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:56.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.499+0000 7fc657fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc65809d860 0x7fc65809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:56.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.499+0000 7fc6577fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc65809e170 0x7fc6581307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49144/0 (socket says 172.21.15.156:49144) 2023-09-30T22:23:56.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.499+0000 7fc6577fe700 1 -- 172.21.15.156:0/1313401790 learned_addr learned my addr 172.21.15.156:0/1313401790 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:56.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.499+0000 7fc65cab5700 1 -- 172.21.15.156:0/1313401790 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc65809d860 msgr2=0x7fc65809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:56.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.499+0000 7fc65cab5700 1 --2- 172.21.15.156:0/1313401790 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc65809d860 0x7fc65809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.500+0000 7fc65cab5700 1 -- 172.21.15.156:0/1313401790 >> v1:172.21.15.156:6789/0 conn(0x7fc65809e170 legacy=0x7fc6581307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:56.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.500+0000 7fc65cab5700 1 -- 172.21.15.156:0/1313401790 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc65809b620 con 0x7fc658130eb0 2023-09-30T22:23:56.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.500+0000 7fc657fff700 1 --2- 172.21.15.156:0/1313401790 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc65809d860 0x7fc65809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:56.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.500+0000 7fc656ffd700 1 -- 172.21.15.156:0/1313401790 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215430194 0 0) 0x7fc65809aaa0 con 0x7fc65809e170 2023-09-30T22:23:56.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.500+0000 7fc65cab5700 1 --2- 172.21.15.156:0/1313401790 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc658130eb0 0x7fc658138a00 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fc65000bfa0 tx=0x7fc65000d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08b5830966bb5ec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:56.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.500+0000 7fc656ffd700 1 -- 172.21.15.156:0/1313401790 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc650010070 con 0x7fc658130eb0 2023-09-30T22:23:56.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.500+0000 7fc656ffd700 1 -- 172.21.15.156:0/1313401790 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65000b2e0 con 0x7fc658130eb0 2023-09-30T22:23:56.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.500+0000 7fc656ffd700 1 -- 172.21.15.156:0/1313401790 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65000dc40 con 0x7fc658130eb0 2023-09-30T22:23:56.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.500+0000 7fc65e518700 1 -- 172.21.15.156:0/1313401790 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc658130eb0 msgr2=0x7fc658138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:56.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.500+0000 7fc65e518700 1 --2- 172.21.15.156:0/1313401790 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc658130eb0 0x7fc658138a00 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fc65000bfa0 tx=0x7fc65000d330 comp rx=0 tx=0).stop 2023-09-30T22:23:56.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.500+0000 7fc65e518700 1 -- 172.21.15.156:0/1313401790 shutdown_connections 2023-09-30T22:23:56.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.500+0000 7fc65e518700 1 --2- 172.21.15.156:0/1313401790 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc658130eb0 0x7fc658138a00 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.500+0000 7fc65e518700 1 --2- 172.21.15.156:0/1313401790 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc65809d860 0x7fc65809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.500+0000 7fc65e518700 1 -- 172.21.15.156:0/1313401790 >> 172.21.15.156:0/1313401790 conn(0x7fc658099c40 msgr2=0x7fc6580a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:56.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.500+0000 7fc65e518700 1 -- 172.21.15.156:0/1313401790 shutdown_connections 2023-09-30T22:23:56.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.500+0000 7fc65e518700 1 -- 172.21.15.156:0/1313401790 wait complete. 2023-09-30T22:23:56.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.501+0000 7fc65e518700 1 Processor -- start 2023-09-30T22:23:56.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.501+0000 7fc65e518700 1 -- start start 2023-09-30T22:23:56.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.502+0000 7fc65e518700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc65809d860 0x7fc658122800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:56.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.502+0000 7fc65e518700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc65809e170 0x7fc658122d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:56.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.502+0000 7fc65e518700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc658130eb0 0x7fc658123280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:56.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.502+0000 7fc65e518700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc658124450 con 0x7fc658130eb0 2023-09-30T22:23:56.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.502+0000 7fc65e518700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc658124b50 con 0x7fc65809e170 2023-09-30T22:23:56.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.502+0000 7fc65e518700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc658126200 con 0x7fc65809d860 2023-09-30T22:23:56.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.502+0000 7fc657fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc65809d860 0x7fc658122800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:56.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.502+0000 7fc6577fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc65809e170 0x7fc658122d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:56.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.502+0000 7fc657fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc65809d860 0x7fc658122800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:42866/0 (socket says 172.21.15.156:42866) 2023-09-30T22:23:56.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.502+0000 7fc657fff700 1 -- 172.21.15.156:0/3168811606 learned_addr learned my addr 172.21.15.156:0/3168811606 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:56.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.502+0000 7fc65cab5700 1 --2- 172.21.15.156:0/3168811606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc658130eb0 0x7fc658123280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:56.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.502+0000 7fc657fff700 1 -- 172.21.15.156:0/3168811606 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc65809e170 msgr2=0x7fc658122d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:56.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.502+0000 7fc657fff700 1 --2- 172.21.15.156:0/3168811606 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc65809e170 0x7fc658122d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.502+0000 7fc657fff700 1 -- 172.21.15.156:0/3168811606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc658130eb0 msgr2=0x7fc658123280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:56.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.502+0000 7fc657fff700 1 --2- 172.21.15.156:0/3168811606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc658130eb0 0x7fc658123280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.502+0000 7fc657fff700 1 -- 172.21.15.156:0/3168811606 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6480094a0 con 0x7fc65809d860 2023-09-30T22:23:56.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.502+0000 7fc65cab5700 1 --2- 172.21.15.156:0/3168811606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc658130eb0 0x7fc658123280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:56.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.502+0000 7fc657fff700 1 --2- 172.21.15.156:0/3168811606 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc65809d860 0x7fc658122800 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc64800ec10 tx=0x7fc64800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:56.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.503+0000 7fc654ff9700 1 -- 172.21.15.156:0/3168811606 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64800c850 con 0x7fc65809d860 2023-09-30T22:23:56.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.503+0000 7fc654ff9700 1 -- 172.21.15.156:0/3168811606 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64800c9b0 con 0x7fc65809d860 2023-09-30T22:23:56.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.503+0000 7fc65e518700 1 -- 172.21.15.156:0/3168811606 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc65000bc80 con 0x7fc65809d860 2023-09-30T22:23:56.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.503+0000 7fc654ff9700 1 -- 172.21.15.156:0/3168811606 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64800cd20 con 0x7fc65809d860 2023-09-30T22:23:56.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.503+0000 7fc65e518700 1 -- 172.21.15.156:0/3168811606 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc65809c8b0 con 0x7fc65809d860 2023-09-30T22:23:56.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.504+0000 7fc65e518700 1 -- 172.21.15.156:0/3168811606 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc65804f2a0 con 0x7fc65809d860 2023-09-30T22:23:56.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.504+0000 7fc654ff9700 1 -- 172.21.15.156:0/3168811606 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc648013470 con 0x7fc65809d860 2023-09-30T22:23:56.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.504+0000 7fc654ff9700 1 -- 172.21.15.156:0/3168811606 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc64803ffa0 con 0x7fc65809d860 2023-09-30T22:23:56.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.508+0000 7fc654ff9700 1 -- 172.21.15.156:0/3168811606 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc648013720 con 0x7fc65809d860 2023-09-30T22:23:56.642 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:56.652 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:56.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.697+0000 7fc65e518700 1 -- 172.21.15.156:0/3168811606 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc658125f80 con 0x7fc65809d860 2023-09-30T22:23:56.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.697+0000 7fc654ff9700 1 -- 172.21.15.156:0/3168811606 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc64802a090 con 0x7fc65809d860 2023-09-30T22:23:56.697 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:56.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.700+0000 7fc65e518700 1 -- 172.21.15.156:0/3168811606 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc65809d860 msgr2=0x7fc658122800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:56.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.700+0000 7fc65e518700 1 --2- 172.21.15.156:0/3168811606 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc65809d860 0x7fc658122800 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc64800ec10 tx=0x7fc64800ef20 comp rx=0 tx=0).stop 2023-09-30T22:23:56.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.700+0000 7fc65e518700 1 -- 172.21.15.156:0/3168811606 shutdown_connections 2023-09-30T22:23:56.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.700+0000 7fc65e518700 1 --2- 172.21.15.156:0/3168811606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc658130eb0 0x7fc658123280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.700+0000 7fc65e518700 1 --2- 172.21.15.156:0/3168811606 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc65809d860 0x7fc658122800 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.700+0000 7fc65e518700 1 --2- 172.21.15.156:0/3168811606 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc65809e170 0x7fc658122d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.700+0000 7fc65e518700 1 -- 172.21.15.156:0/3168811606 >> 172.21.15.156:0/3168811606 conn(0x7fc658099c40 msgr2=0x7fc6580a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:56.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.700+0000 7fc65e518700 1 -- 172.21.15.156:0/3168811606 shutdown_connections 2023-09-30T22:23:56.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.700+0000 7fc65e518700 1 -- 172.21.15.156:0/3168811606 wait complete. 2023-09-30T22:23:56.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:56.717 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:56.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.770+0000 7f1e6d2a3700 1 Processor -- start 2023-09-30T22:23:56.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.770+0000 7f1e6d2a3700 1 -- start start 2023-09-30T22:23:56.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.770+0000 7f1e6d2a3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1e68133660 0x7f1e68135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:56.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.770+0000 7f1e6d2a3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e68135f80 0x7f1e68138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:56.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.770+0000 7f1e6d2a3700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e68099a60 con 0x7f1e68099e20 2023-09-30T22:23:56.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.770+0000 7f1e6d2a3700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6809bf50 con 0x7f1e68133660 2023-09-30T22:23:56.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.770+0000 7f1e6d2a3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6809b230 con 0x7f1e68135f80 2023-09-30T22:23:56.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.771+0000 7f1e66ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f1e68099e20 0x7f1e6809a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49160/0 (socket says 172.21.15.156:49160) 2023-09-30T22:23:56.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.771+0000 7f1e667fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1e68133660 0x7f1e68135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:56.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.771+0000 7f1e66ffd700 1 -- 172.21.15.156:0/3996881026 learned_addr learned my addr 172.21.15.156:0/3996881026 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:56.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.771+0000 7f1e677fe700 1 --2- 172.21.15.156:0/3996881026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e68135f80 0x7f1e68138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:56.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.771+0000 7f1e667fc700 1 -- 172.21.15.156:0/3996881026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e68135f80 msgr2=0x7f1e68138360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:56.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.771+0000 7f1e667fc700 1 --2- 172.21.15.156:0/3996881026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e68135f80 0x7f1e68138360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.771+0000 7f1e667fc700 1 -- 172.21.15.156:0/3996881026 >> v1:172.21.15.156:6789/0 conn(0x7f1e68099e20 legacy=0x7f1e6809a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:56.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.771+0000 7f1e667fc700 1 -- 172.21.15.156:0/3996881026 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6809bb90 con 0x7f1e68133660 2023-09-30T22:23:56.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.771+0000 7f1e65ffb700 1 -- 172.21.15.156:0/3996881026 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3810568277 0 0) 0x7f1e68099a60 con 0x7f1e68099e20 2023-09-30T22:23:56.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.771+0000 7f1e677fe700 1 --2- 172.21.15.156:0/3996881026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e68135f80 0x7f1e68138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:56.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.771+0000 7f1e667fc700 1 --2- 172.21.15.156:0/3996881026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e68133660 0x7f1e68135a40 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c009840 tx=0x7f1e5c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=768ff3c3ef5b8484 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:56.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.771+0000 7f1e65ffb700 1 -- 172.21.15.156:0/3996881026 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c011830 con 0x7f1e68133660 2023-09-30T22:23:56.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.771+0000 7f1e65ffb700 1 -- 172.21.15.156:0/3996881026 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5c011990 con 0x7f1e68133660 2023-09-30T22:23:56.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.771+0000 7f1e65ffb700 1 -- 172.21.15.156:0/3996881026 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c011d20 con 0x7f1e68133660 2023-09-30T22:23:56.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.772+0000 7f1e6d2a3700 1 -- 172.21.15.156:0/3996881026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e68133660 msgr2=0x7f1e68135a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:56.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.772+0000 7f1e6d2a3700 1 --2- 172.21.15.156:0/3996881026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e68133660 0x7f1e68135a40 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c009840 tx=0x7f1e5c009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:56.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.772+0000 7f1e6d2a3700 1 -- 172.21.15.156:0/3996881026 shutdown_connections 2023-09-30T22:23:56.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.772+0000 7f1e6d2a3700 1 --2- 172.21.15.156:0/3996881026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e68135f80 0x7f1e68138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.772+0000 7f1e6d2a3700 1 --2- 172.21.15.156:0/3996881026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e68133660 0x7f1e68135a40 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.772+0000 7f1e6d2a3700 1 -- 172.21.15.156:0/3996881026 >> 172.21.15.156:0/3996881026 conn(0x7f1e680a2980 msgr2=0x7f1e680a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:56.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.772+0000 7f1e6d2a3700 1 -- 172.21.15.156:0/3996881026 shutdown_connections 2023-09-30T22:23:56.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.772+0000 7f1e6d2a3700 1 -- 172.21.15.156:0/3996881026 wait complete. 2023-09-30T22:23:56.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.773+0000 7f1e6d2a3700 1 Processor -- start 2023-09-30T22:23:56.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.774+0000 7f1e6d2a3700 1 -- start start 2023-09-30T22:23:56.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.774+0000 7f1e6d2a3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e68099e20 0x7f1e68070840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:56.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.774+0000 7f1e6d2a3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e68133660 0x7f1e68070d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:56.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.774+0000 7f1e6d2a3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e68135f80 0x7f1e681c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:56.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.774+0000 7f1e6d2a3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6812dcc0 con 0x7f1e68135f80 2023-09-30T22:23:56.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.774+0000 7f1e6d2a3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e68071cf0 con 0x7f1e68133660 2023-09-30T22:23:56.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.774+0000 7f1e6d2a3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6811e9d0 con 0x7f1e68099e20 2023-09-30T22:23:56.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.774+0000 7f1e66ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e68099e20 0x7f1e68070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:56.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.774+0000 7f1e677fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e68135f80 0x7f1e681c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:56.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.774+0000 7f1e66ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e68099e20 0x7f1e68070840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:42892/0 (socket says 172.21.15.156:42892) 2023-09-30T22:23:56.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.774+0000 7f1e66ffd700 1 -- 172.21.15.156:0/341726957 learned_addr learned my addr 172.21.15.156:0/341726957 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:56.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.774+0000 7f1e677fe700 1 -- 172.21.15.156:0/341726957 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e68099e20 msgr2=0x7f1e68070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:56.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.774+0000 7f1e677fe700 1 --2- 172.21.15.156:0/341726957 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e68099e20 0x7f1e68070840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.774+0000 7f1e677fe700 1 -- 172.21.15.156:0/341726957 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e68133660 msgr2=0x7f1e68070d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:56.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.774+0000 7f1e677fe700 1 --2- 172.21.15.156:0/341726957 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e68133660 0x7f1e68070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.774+0000 7f1e677fe700 1 -- 172.21.15.156:0/341726957 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e60009a70 con 0x7f1e68135f80 2023-09-30T22:23:56.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.774+0000 7f1e66ffd700 1 --2- 172.21.15.156:0/341726957 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e68099e20 0x7f1e68070840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:56.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.775+0000 7f1e677fe700 1 --2- 172.21.15.156:0/341726957 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e68135f80 0x7f1e681c81a0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f1e6000ef90 tx=0x7f1e6000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:56.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.775+0000 7f1e4f7fe700 1 -- 172.21.15.156:0/341726957 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6000cd40 con 0x7f1e68135f80 2023-09-30T22:23:56.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.775+0000 7f1e4f7fe700 1 -- 172.21.15.156:0/341726957 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6000f040 con 0x7f1e68135f80 2023-09-30T22:23:56.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.775+0000 7f1e4f7fe700 1 -- 172.21.15.156:0/341726957 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e600146c0 con 0x7f1e68135f80 2023-09-30T22:23:56.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.775+0000 7f1e6d2a3700 1 -- 172.21.15.156:0/341726957 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e5c0094a0 con 0x7f1e68135f80 2023-09-30T22:23:56.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.775+0000 7f1e6d2a3700 1 -- 172.21.15.156:0/341726957 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e6811e700 con 0x7f1e68135f80 2023-09-30T22:23:56.779 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.776+0000 7f1e4f7fe700 1 -- 172.21.15.156:0/341726957 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e60014820 con 0x7f1e68135f80 2023-09-30T22:23:56.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.776+0000 7f1e6d2a3700 1 -- 172.21.15.156:0/341726957 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e68072480 con 0x7f1e68135f80 2023-09-30T22:23:56.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.776+0000 7f1e4f7fe700 1 -- 172.21.15.156:0/341726957 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1e600400d0 con 0x7f1e68135f80 2023-09-30T22:23:56.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.781+0000 7f1e4f7fe700 1 -- 172.21.15.156:0/341726957 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e68072480 con 0x7f1e68135f80 2023-09-30T22:23:56.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.817+0000 7f130293a700 1 Processor -- start 2023-09-30T22:23:56.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.817+0000 7f130293a700 1 -- start start 2023-09-30T22:23:56.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.818+0000 7f130293a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12fc09d860 0x7f12fc09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:56.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.818+0000 7f130293a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f12fc130eb0 0x7f12fc138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:56.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.818+0000 7f130293a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12fc09aaa0 con 0x7f12fc09e170 2023-09-30T22:23:56.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.818+0000 7f130293a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12fc09f870 con 0x7f12fc130eb0 2023-09-30T22:23:56.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.818+0000 7f130293a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc09b360 con 0x7f12fc09d860 2023-09-30T22:23:56.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.818+0000 7f1300ed7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f12fc130eb0 0x7f12fc138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:56.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.818+0000 7f1300ed7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f12fc130eb0 0x7f12fc138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44766/0 (socket says 172.21.15.156:44766) 2023-09-30T22:23:56.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.818+0000 7f1300ed7700 1 -- 172.21.15.156:0/838024873 learned_addr learned my addr 172.21.15.156:0/838024873 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:56.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.818+0000 7f12fbfff700 1 --2- 172.21.15.156:0/838024873 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12fc09d860 0x7f12fc09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:56.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.818+0000 7f1300ed7700 1 -- 172.21.15.156:0/838024873 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12fc09d860 msgr2=0x7f12fc09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:56.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.818+0000 7f1300ed7700 1 --2- 172.21.15.156:0/838024873 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12fc09d860 0x7f12fc09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.818+0000 7f1300ed7700 1 -- 172.21.15.156:0/838024873 >> v1:172.21.15.156:6789/0 conn(0x7f12fc09e170 legacy=0x7f12fc1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:56.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.818+0000 7f1300ed7700 1 -- 172.21.15.156:0/838024873 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12fc09b620 con 0x7f12fc130eb0 2023-09-30T22:23:56.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.819+0000 7f1300ed7700 1 --2- 172.21.15.156:0/838024873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12fc130eb0 0x7f12fc138a00 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f12f4009e50 tx=0x7f12f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f273b2f14a071924 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:56.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.819+0000 7f12faffd700 1 -- 172.21.15.156:0/838024873 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f400bb10 con 0x7f12fc130eb0 2023-09-30T22:23:56.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.819+0000 7f12faffd700 1 -- 172.21.15.156:0/838024873 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f400bc70 con 0x7f12fc130eb0 2023-09-30T22:23:56.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.819+0000 7f12faffd700 1 -- 172.21.15.156:0/838024873 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f40104d0 con 0x7f12fc130eb0 2023-09-30T22:23:56.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.820+0000 7f130293a700 1 -- 172.21.15.156:0/838024873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12fc130eb0 msgr2=0x7f12fc138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:56.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.820+0000 7f130293a700 1 --2- 172.21.15.156:0/838024873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12fc130eb0 0x7f12fc138a00 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f12f4009e50 tx=0x7f12f400b330 comp rx=0 tx=0).stop 2023-09-30T22:23:56.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.820+0000 7f130293a700 1 -- 172.21.15.156:0/838024873 shutdown_connections 2023-09-30T22:23:56.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.820+0000 7f130293a700 1 --2- 172.21.15.156:0/838024873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12fc130eb0 0x7f12fc138a00 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.820+0000 7f130293a700 1 --2- 172.21.15.156:0/838024873 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12fc09d860 0x7f12fc09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.820+0000 7f130293a700 1 -- 172.21.15.156:0/838024873 >> 172.21.15.156:0/838024873 conn(0x7f12fc099c40 msgr2=0x7f12fc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:56.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.820+0000 7f130293a700 1 -- 172.21.15.156:0/838024873 shutdown_connections 2023-09-30T22:23:56.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.820+0000 7f130293a700 1 -- 172.21.15.156:0/838024873 wait complete. 2023-09-30T22:23:56.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.821+0000 7f130293a700 1 Processor -- start 2023-09-30T22:23:56.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.821+0000 7f130293a700 1 -- start start 2023-09-30T22:23:56.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.822+0000 7f130293a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12fc09d860 0x7f12fc11e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:56.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.822+0000 7f130293a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12fc09e170 0x7f12fc11ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:56.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.822+0000 7f130293a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12fc130eb0 0x7f12fc11f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:56.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.822+0000 7f130293a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc122e10 con 0x7f12fc09d860 2023-09-30T22:23:56.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.822+0000 7f130293a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc122450 con 0x7f12fc130eb0 2023-09-30T22:23:56.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.822+0000 7f130293a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc121f50 con 0x7f12fc09e170 2023-09-30T22:23:56.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.822+0000 7f12fb7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12fc09e170 0x7f12fc11ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:56.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.822+0000 7f12fb7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12fc09e170 0x7f12fc11ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:42902/0 (socket says 172.21.15.156:42902) 2023-09-30T22:23:56.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.822+0000 7f12fb7fe700 1 -- 172.21.15.156:0/3515398246 learned_addr learned my addr 172.21.15.156:0/3515398246 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:56.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.822+0000 7f1300ed7700 1 --2- 172.21.15.156:0/3515398246 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12fc130eb0 0x7f12fc11f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:56.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.822+0000 7f12fbfff700 1 --2- 172.21.15.156:0/3515398246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12fc09d860 0x7f12fc11e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:56.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.823+0000 7f12fb7fe700 1 -- 172.21.15.156:0/3515398246 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12fc130eb0 msgr2=0x7f12fc11f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:56.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.823+0000 7f12fb7fe700 1 --2- 172.21.15.156:0/3515398246 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12fc130eb0 0x7f12fc11f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.823+0000 7f12fb7fe700 1 -- 172.21.15.156:0/3515398246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12fc09d860 msgr2=0x7f12fc11e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:56.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.823+0000 7f12fb7fe700 1 --2- 172.21.15.156:0/3515398246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12fc09d860 0x7f12fc11e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.823+0000 7f12fb7fe700 1 -- 172.21.15.156:0/3515398246 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f4009b30 con 0x7f12fc09e170 2023-09-30T22:23:56.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.823+0000 7f1300ed7700 1 --2- 172.21.15.156:0/3515398246 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12fc130eb0 0x7f12fc11f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:56.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.823+0000 7f12fb7fe700 1 --2- 172.21.15.156:0/3515398246 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12fc09e170 0x7f12fc11ed80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f12f000c4b0 tx=0x7f12f000c7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:56.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.823+0000 7f12f8ff9700 1 -- 172.21.15.156:0/3515398246 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f00052d0 con 0x7f12fc09e170 2023-09-30T22:23:56.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.823+0000 7f12f8ff9700 1 -- 172.21.15.156:0/3515398246 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f0005430 con 0x7f12fc09e170 2023-09-30T22:23:56.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.823+0000 7f130293a700 1 -- 172.21.15.156:0/3515398246 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12fc120320 con 0x7f12fc09e170 2023-09-30T22:23:56.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.823+0000 7f12f8ff9700 1 -- 172.21.15.156:0/3515398246 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f00038c0 con 0x7f12fc09e170 2023-09-30T22:23:56.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.823+0000 7f130293a700 1 -- 172.21.15.156:0/3515398246 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12fc120890 con 0x7f12fc09e170 2023-09-30T22:23:56.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.824+0000 7f12f8ff9700 1 -- 172.21.15.156:0/3515398246 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f12f0003a20 con 0x7f12fc09e170 2023-09-30T22:23:56.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.824+0000 7f130293a700 1 -- 172.21.15.156:0/3515398246 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12fc04f2a0 con 0x7f12fc09e170 2023-09-30T22:23:56.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.824+0000 7f12f8ff9700 1 -- 172.21.15.156:0/3515398246 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f12f003ea50 con 0x7f12fc09e170 2023-09-30T22:23:56.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.829+0000 7f12f8ff9700 1 -- 172.21.15.156:0/3515398246 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f12f0017080 con 0x7f12fc09e170 2023-09-30T22:23:56.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.886+0000 7f310f8bf700 1 Processor -- start 2023-09-30T22:23:56.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.886+0000 7f310f8bf700 1 -- start start 2023-09-30T22:23:56.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.886+0000 7f310f8bf700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f31080a0a70 0x7f31080a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:56.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.886+0000 7f310f8bf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3108134120 0x7f310813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:56.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.886+0000 7f310f8bf700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f310809dc00 con 0x7f31080a1380 2023-09-30T22:23:56.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.886+0000 7f310f8bf700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f310809ea90 con 0x7f31080a0a70 2023-09-30T22:23:56.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.886+0000 7f310f8bf700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f310809dec0 con 0x7f3108134120 2023-09-30T22:23:56.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.887+0000 7f310ce5a700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f31080a1380 0x7f3108133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49176/0 (socket says 172.21.15.156:49176) 2023-09-30T22:23:56.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.887+0000 7f310de5c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3108134120 0x7f310813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:56.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.887+0000 7f310ce5a700 1 -- 172.21.15.156:0/4134633685 learned_addr learned my addr 172.21.15.156:0/4134633685 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:56.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.887+0000 7f310d65b700 1 --2- 172.21.15.156:0/4134633685 >> v2:172.21.15.156:3300/0 conn(0x7f31080a0a70 0x7f31080a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:56.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.887+0000 7f310de5c700 1 -- 172.21.15.156:0/4134633685 >> v2:172.21.15.156:3300/0 conn(0x7f31080a0a70 msgr2=0x7f31080a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:56.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.887+0000 7f310de5c700 1 --2- 172.21.15.156:0/4134633685 >> v2:172.21.15.156:3300/0 conn(0x7f31080a0a70 0x7f31080a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.887+0000 7f310de5c700 1 -- 172.21.15.156:0/4134633685 >> v1:172.21.15.156:6789/0 conn(0x7f31080a1380 legacy=0x7f3108133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:56.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.887+0000 7f30fffff700 1 -- 172.21.15.156:0/4134633685 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897308862 0 0) 0x7f310809dc00 con 0x7f31080a1380 2023-09-30T22:23:56.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.887+0000 7f310de5c700 1 -- 172.21.15.156:0/4134633685 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310809e6a0 con 0x7f3108134120 2023-09-30T22:23:56.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.887+0000 7f310d65b700 1 --2- 172.21.15.156:0/4134633685 >> v2:172.21.15.156:3300/0 conn(0x7f31080a0a70 0x7f31080a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:56.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.887+0000 7f310de5c700 1 --2- 172.21.15.156:0/4134633685 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3108134120 0x7f310813bce0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3100009d90 tx=0x7f310000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d91fac497854d8f3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:56.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.887+0000 7f30fffff700 1 -- 172.21.15.156:0/4134633685 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310000e070 con 0x7f3108134120 2023-09-30T22:23:56.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.887+0000 7f30fffff700 1 -- 172.21.15.156:0/4134633685 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310000bb20 con 0x7f3108134120 2023-09-30T22:23:56.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.887+0000 7f30fffff700 1 -- 172.21.15.156:0/4134633685 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3100012430 con 0x7f3108134120 2023-09-30T22:23:56.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.888+0000 7f310f8bf700 1 -- 172.21.15.156:0/4134633685 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3108134120 msgr2=0x7f310813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:56.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.888+0000 7f310f8bf700 1 --2- 172.21.15.156:0/4134633685 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3108134120 0x7f310813bce0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3100009d90 tx=0x7f310000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:56.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.888+0000 7f310f8bf700 1 -- 172.21.15.156:0/4134633685 shutdown_connections 2023-09-30T22:23:56.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.888+0000 7f310f8bf700 1 --2- 172.21.15.156:0/4134633685 >> v2:172.21.15.156:3300/0 conn(0x7f31080a0a70 0x7f31080a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.888+0000 7f310f8bf700 1 --2- 172.21.15.156:0/4134633685 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3108134120 0x7f310813bce0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.888+0000 7f310f8bf700 1 -- 172.21.15.156:0/4134633685 >> 172.21.15.156:0/4134633685 conn(0x7f31080a6610 msgr2=0x7f31080a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:56.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.888+0000 7f310f8bf700 1 -- 172.21.15.156:0/4134633685 shutdown_connections 2023-09-30T22:23:56.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.888+0000 7f310f8bf700 1 -- 172.21.15.156:0/4134633685 wait complete. 2023-09-30T22:23:56.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.890+0000 7f310f8bf700 1 Processor -- start 2023-09-30T22:23:56.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.890+0000 7f310f8bf700 1 -- start start 2023-09-30T22:23:56.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.890+0000 7f310f8bf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31080a0a70 0x7f3108122880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:56.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.890+0000 7f310f8bf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31080a1380 0x7f3108122dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:56.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.890+0000 7f310f8bf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3108134120 0x7f3108123300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:56.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.890+0000 7f310f8bf700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31081260c0 con 0x7f3108134120 2023-09-30T22:23:56.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.890+0000 7f310f8bf700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31081245a0 con 0x7f31080a1380 2023-09-30T22:23:56.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.890+0000 7f310f8bf700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31080a5640 con 0x7f31080a0a70 2023-09-30T22:23:56.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.890+0000 7f310d65b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31080a0a70 0x7f3108122880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:56.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.890+0000 7f310d65b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31080a0a70 0x7f3108122880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:42934/0 (socket says 172.21.15.156:42934) 2023-09-30T22:23:56.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.890+0000 7f310d65b700 1 -- 172.21.15.156:0/2960913287 learned_addr learned my addr 172.21.15.156:0/2960913287 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:56.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.890+0000 7f310ce5a700 1 --2- 172.21.15.156:0/2960913287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31080a1380 0x7f3108122dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:56.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.890+0000 7f310de5c700 1 --2- 172.21.15.156:0/2960913287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3108134120 0x7f3108123300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:56.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.891+0000 7f310d65b700 1 -- 172.21.15.156:0/2960913287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31080a1380 msgr2=0x7f3108122dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:56.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.891+0000 7f310d65b700 1 --2- 172.21.15.156:0/2960913287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31080a1380 0x7f3108122dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.891+0000 7f310d65b700 1 -- 172.21.15.156:0/2960913287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3108134120 msgr2=0x7f3108123300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:56.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.891+0000 7f310d65b700 1 --2- 172.21.15.156:0/2960913287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3108134120 0x7f3108123300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.891+0000 7f310d65b700 1 -- 172.21.15.156:0/2960913287 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31040094a0 con 0x7f31080a0a70 2023-09-30T22:23:56.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.891+0000 7f310d65b700 1 --2- 172.21.15.156:0/2960913287 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31080a0a70 0x7f3108122880 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f310400ec10 tx=0x7f310400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:56.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.891+0000 7f30fdffb700 1 -- 172.21.15.156:0/2960913287 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310400c850 con 0x7f31080a0a70 2023-09-30T22:23:56.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.891+0000 7f30fdffb700 1 -- 172.21.15.156:0/2960913287 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310400c9b0 con 0x7f31080a0a70 2023-09-30T22:23:56.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.891+0000 7f310f8bf700 1 -- 172.21.15.156:0/2960913287 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3100009a70 con 0x7f31080a0a70 2023-09-30T22:23:56.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.891+0000 7f30fdffb700 1 -- 172.21.15.156:0/2960913287 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310400cd20 con 0x7f31080a0a70 2023-09-30T22:23:56.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.891+0000 7f310f8bf700 1 -- 172.21.15.156:0/2960913287 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31080a0430 con 0x7f31080a0a70 2023-09-30T22:23:56.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.892+0000 7f310f8bf700 1 -- 172.21.15.156:0/2960913287 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f310806ccf0 con 0x7f31080a0a70 2023-09-30T22:23:56.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.892+0000 7f30fdffb700 1 -- 172.21.15.156:0/2960913287 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3104013470 con 0x7f31080a0a70 2023-09-30T22:23:56.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.893+0000 7f30fdffb700 1 -- 172.21.15.156:0/2960913287 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f310403f7c0 con 0x7f31080a0a70 2023-09-30T22:23:56.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.897+0000 7f30fdffb700 1 -- 172.21.15.156:0/2960913287 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3104013720 con 0x7f31080a0a70 2023-09-30T22:23:56.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.980+0000 7f1e6d2a3700 1 -- 172.21.15.156:0/341726957 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1e68072480 con 0x7f1e68135f80 2023-09-30T22:23:56.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.980+0000 7f1e4f7fe700 1 -- 172.21.15.156:0/341726957 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e68072480 con 0x7f1e68135f80 2023-09-30T22:23:56.980 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:56.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.983+0000 7f1e6d2a3700 1 -- 172.21.15.156:0/341726957 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e68135f80 msgr2=0x7f1e681c81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:56.983 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.983+0000 7f1e6d2a3700 1 --2- 172.21.15.156:0/341726957 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e68135f80 0x7f1e681c81a0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f1e6000ef90 tx=0x7f1e6000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.983+0000 7f1e6d2a3700 1 -- 172.21.15.156:0/341726957 shutdown_connections 2023-09-30T22:23:56.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.983+0000 7f1e6d2a3700 1 --2- 172.21.15.156:0/341726957 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e68135f80 0x7f1e681c81a0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.983+0000 7f1e6d2a3700 1 --2- 172.21.15.156:0/341726957 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e68099e20 0x7f1e68070840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.983+0000 7f1e6d2a3700 1 --2- 172.21.15.156:0/341726957 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e68133660 0x7f1e68070d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.983+0000 7f1e6d2a3700 1 -- 172.21.15.156:0/341726957 >> 172.21.15.156:0/341726957 conn(0x7f1e680a2980 msgr2=0x7f1e681324e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:56.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.984+0000 7f1e6d2a3700 1 -- 172.21.15.156:0/341726957 shutdown_connections 2023-09-30T22:23:56.984 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:56.984+0000 7f1e6d2a3700 1 -- 172.21.15.156:0/341726957 wait complete. 2023-09-30T22:23:56.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:57.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.023+0000 7f130293a700 1 -- 172.21.15.156:0/3515398246 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f12fc071da0 con 0x7f12fc09e170 2023-09-30T22:23:57.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.024+0000 7f12f8ff9700 1 -- 172.21.15.156:0/3515398246 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f12f0019e60 con 0x7f12fc09e170 2023-09-30T22:23:57.023 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:57.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.026+0000 7f130293a700 1 -- 172.21.15.156:0/3515398246 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12fc09e170 msgr2=0x7f12fc11ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:57.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.026+0000 7f130293a700 1 --2- 172.21.15.156:0/3515398246 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12fc09e170 0x7f12fc11ed80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f12f000c4b0 tx=0x7f12f000c7c0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.026+0000 7f130293a700 1 -- 172.21.15.156:0/3515398246 shutdown_connections 2023-09-30T22:23:57.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.026+0000 7f130293a700 1 --2- 172.21.15.156:0/3515398246 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f12fc130eb0 0x7f12fc11f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.026+0000 7f130293a700 1 --2- 172.21.15.156:0/3515398246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f12fc09d860 0x7f12fc11e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.026+0000 7f130293a700 1 --2- 172.21.15.156:0/3515398246 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f12fc09e170 0x7f12fc11ed80 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.026+0000 7f130293a700 1 -- 172.21.15.156:0/3515398246 >> 172.21.15.156:0/3515398246 conn(0x7f12fc099c40 msgr2=0x7f12fc070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:57.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.026+0000 7f130293a700 1 -- 172.21.15.156:0/3515398246 shutdown_connections 2023-09-30T22:23:57.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.026+0000 7f130293a700 1 -- 172.21.15.156:0/3515398246 wait complete. 2023-09-30T22:23:57.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:57.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.093+0000 7f310f8bf700 1 -- 172.21.15.156:0/2960913287 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f310804f2a0 con 0x7f31080a0a70 2023-09-30T22:23:57.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.093+0000 7f30fdffb700 1 -- 172.21.15.156:0/2960913287 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3104021030 con 0x7f31080a0a70 2023-09-30T22:23:57.093 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:57.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.095+0000 7f310f8bf700 1 -- 172.21.15.156:0/2960913287 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31080a0a70 msgr2=0x7f3108122880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:57.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.095+0000 7f310f8bf700 1 --2- 172.21.15.156:0/2960913287 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31080a0a70 0x7f3108122880 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f310400ec10 tx=0x7f310400ef20 comp rx=0 tx=0).stop 2023-09-30T22:23:57.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.095+0000 7f310f8bf700 1 -- 172.21.15.156:0/2960913287 shutdown_connections 2023-09-30T22:23:57.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.095+0000 7f310f8bf700 1 --2- 172.21.15.156:0/2960913287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3108134120 0x7f3108123300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.095+0000 7f310f8bf700 1 --2- 172.21.15.156:0/2960913287 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31080a0a70 0x7f3108122880 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.095+0000 7f310f8bf700 1 --2- 172.21.15.156:0/2960913287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31080a1380 0x7f3108122dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.095+0000 7f310f8bf700 1 -- 172.21.15.156:0/2960913287 >> 172.21.15.156:0/2960913287 conn(0x7f31080a6610 msgr2=0x7f31080a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:57.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.095+0000 7f310f8bf700 1 -- 172.21.15.156:0/2960913287 shutdown_connections 2023-09-30T22:23:57.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.095+0000 7f310f8bf700 1 -- 172.21.15.156:0/2960913287 wait complete. 2023-09-30T22:23:57.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:57.715 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:57.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.848+0000 7fa43655d700 1 Processor -- start 2023-09-30T22:23:57.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.848+0000 7fa43655d700 1 -- start start 2023-09-30T22:23:57.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.848+0000 7fa43655d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa43009d860 0x7fa43009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:57.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.848+0000 7fa43655d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa430130eb0 0x7fa430138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:57.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.849+0000 7fa43655d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa43009aaa0 con 0x7fa43009e170 2023-09-30T22:23:57.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.849+0000 7fa43655d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43009f870 con 0x7fa430130eb0 2023-09-30T22:23:57.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.849+0000 7fa43655d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa43009b360 con 0x7fa43009d860 2023-09-30T22:23:57.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.849+0000 7fa42ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa43009d860 0x7fa43009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:57.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.849+0000 7fa434afa700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa430130eb0 0x7fa430138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:57.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.849+0000 7fa42f7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fa43009e170 0x7fa4301307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49188/0 (socket says 172.21.15.156:49188) 2023-09-30T22:23:57.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.849+0000 7fa42f7fe700 1 -- 172.21.15.156:0/3497698832 learned_addr learned my addr 172.21.15.156:0/3497698832 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:57.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.849+0000 7fa42ffff700 1 -- 172.21.15.156:0/3497698832 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa430130eb0 msgr2=0x7fa430138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:57.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.849+0000 7fa42ffff700 1 --2- 172.21.15.156:0/3497698832 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa430130eb0 0x7fa430138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.849+0000 7fa42effd700 1 -- 172.21.15.156:0/3497698832 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2047792960 0 0) 0x7fa43009aaa0 con 0x7fa43009e170 2023-09-30T22:23:57.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.849+0000 7fa42ffff700 1 -- 172.21.15.156:0/3497698832 >> v1:172.21.15.156:6789/0 conn(0x7fa43009e170 legacy=0x7fa4301307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:57.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.849+0000 7fa42ffff700 1 -- 172.21.15.156:0/3497698832 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43009b620 con 0x7fa43009d860 2023-09-30T22:23:57.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.849+0000 7fa434afa700 1 --2- 172.21.15.156:0/3497698832 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa430130eb0 0x7fa430138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:57.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.849+0000 7fa42ffff700 1 --2- 172.21.15.156:0/3497698832 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa43009d860 0x7fa43009dc30 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa424009870 tx=0x7fa424009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f44674ffaa405d0e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:57.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.849+0000 7fa42effd700 1 -- 172.21.15.156:0/3497698832 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42400f8a0 con 0x7fa43009d860 2023-09-30T22:23:57.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.849+0000 7fa42effd700 1 -- 172.21.15.156:0/3497698832 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42400fa00 con 0x7fa43009d860 2023-09-30T22:23:57.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.849+0000 7fa42effd700 1 -- 172.21.15.156:0/3497698832 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42400fd90 con 0x7fa43009d860 2023-09-30T22:23:57.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.850+0000 7fa43655d700 1 -- 172.21.15.156:0/3497698832 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa43009d860 msgr2=0x7fa43009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:57.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.850+0000 7fa43655d700 1 --2- 172.21.15.156:0/3497698832 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa43009d860 0x7fa43009dc30 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa424009870 tx=0x7fa424009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:57.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.850+0000 7fa43655d700 1 -- 172.21.15.156:0/3497698832 shutdown_connections 2023-09-30T22:23:57.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.850+0000 7fa43655d700 1 --2- 172.21.15.156:0/3497698832 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa430130eb0 0x7fa430138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.850+0000 7fa43655d700 1 --2- 172.21.15.156:0/3497698832 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa43009d860 0x7fa43009dc30 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.850+0000 7fa43655d700 1 -- 172.21.15.156:0/3497698832 >> 172.21.15.156:0/3497698832 conn(0x7fa430099c40 msgr2=0x7fa4300a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:57.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.850+0000 7fa43655d700 1 -- 172.21.15.156:0/3497698832 shutdown_connections 2023-09-30T22:23:57.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.850+0000 7fa43655d700 1 -- 172.21.15.156:0/3497698832 wait complete. 2023-09-30T22:23:57.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.851+0000 7fa43655d700 1 Processor -- start 2023-09-30T22:23:57.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.851+0000 7fa43655d700 1 -- start start 2023-09-30T22:23:57.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.851+0000 7fa43655d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa43009d860 0x7fa430122780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:57.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.851+0000 7fa43655d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa43009e170 0x7fa430122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:57.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.851+0000 7fa43655d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa430130eb0 0x7fa430123200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:57.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.851+0000 7fa43655d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa430123c50 con 0x7fa43009e170 2023-09-30T22:23:57.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.851+0000 7fa43655d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa430124390 con 0x7fa430130eb0 2023-09-30T22:23:57.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.851+0000 7fa43655d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4301262a0 con 0x7fa43009d860 2023-09-30T22:23:57.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.851+0000 7fa42f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa43009e170 0x7fa430122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:57.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.851+0000 7fa42ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa43009d860 0x7fa430122780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:57.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.851+0000 7fa42f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa43009e170 0x7fa430122cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44806/0 (socket says 172.21.15.156:44806) 2023-09-30T22:23:57.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.851+0000 7fa42f7fe700 1 -- 172.21.15.156:0/3972219444 learned_addr learned my addr 172.21.15.156:0/3972219444 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:57.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.851+0000 7fa434afa700 1 --2- 172.21.15.156:0/3972219444 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa430130eb0 0x7fa430123200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:57.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.852+0000 7fa42ffff700 1 -- 172.21.15.156:0/3972219444 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa430130eb0 msgr2=0x7fa430123200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:57.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.852+0000 7fa42ffff700 1 --2- 172.21.15.156:0/3972219444 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa430130eb0 0x7fa430123200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.852+0000 7fa42ffff700 1 -- 172.21.15.156:0/3972219444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa43009e170 msgr2=0x7fa430122cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:57.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.852+0000 7fa42ffff700 1 --2- 172.21.15.156:0/3972219444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa43009e170 0x7fa430122cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.852+0000 7fa42ffff700 1 -- 172.21.15.156:0/3972219444 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa428009a70 con 0x7fa43009d860 2023-09-30T22:23:57.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.852+0000 7fa42f7fe700 1 --2- 172.21.15.156:0/3972219444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa43009e170 0x7fa430122cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:57.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.852+0000 7fa42ffff700 1 --2- 172.21.15.156:0/3972219444 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa43009d860 0x7fa430122780 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fa424018000 tx=0x7fa424004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:57.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.852+0000 7fa42cff9700 1 -- 172.21.15.156:0/3972219444 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4240038a0 con 0x7fa43009d860 2023-09-30T22:23:57.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.852+0000 7fa42cff9700 1 -- 172.21.15.156:0/3972219444 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa424003a00 con 0x7fa43009d860 2023-09-30T22:23:57.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.852+0000 7fa42cff9700 1 -- 172.21.15.156:0/3972219444 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424003d90 con 0x7fa43009d860 2023-09-30T22:23:57.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.852+0000 7fa43655d700 1 -- 172.21.15.156:0/3972219444 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4240094a0 con 0x7fa43009d860 2023-09-30T22:23:57.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.852+0000 7fa43655d700 1 -- 172.21.15.156:0/3972219444 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa430125fc0 con 0x7fa43009d860 2023-09-30T22:23:57.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.853+0000 7fa42cff9700 1 -- 172.21.15.156:0/3972219444 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa42402c430 con 0x7fa43009d860 2023-09-30T22:23:57.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.853+0000 7fa42cff9700 1 -- 172.21.15.156:0/3972219444 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa424040930 con 0x7fa43009d860 2023-09-30T22:23:57.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.853+0000 7fa43655d700 1 -- 172.21.15.156:0/3972219444 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa43004f2a0 con 0x7fa43009d860 2023-09-30T22:23:57.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:57.858+0000 7fa42cff9700 1 -- 172.21.15.156:0/3972219444 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4240178f0 con 0x7fa43009d860 2023-09-30T22:23:57.996 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:58.039 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:58.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.042+0000 7fa43655d700 1 -- 172.21.15.156:0/3972219444 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa430125d90 con 0x7fa43009d860 2023-09-30T22:23:58.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.043+0000 7fa42cff9700 1 -- 172.21.15.156:0/3972219444 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa424017300 con 0x7fa43009d860 2023-09-30T22:23:58.042 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:58.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.045+0000 7fa43655d700 1 -- 172.21.15.156:0/3972219444 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa43009d860 msgr2=0x7fa430122780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.045+0000 7fa43655d700 1 --2- 172.21.15.156:0/3972219444 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa43009d860 0x7fa430122780 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fa424018000 tx=0x7fa424004750 comp rx=0 tx=0).stop 2023-09-30T22:23:58.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.045+0000 7fa43655d700 1 -- 172.21.15.156:0/3972219444 shutdown_connections 2023-09-30T22:23:58.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.045+0000 7fa43655d700 1 --2- 172.21.15.156:0/3972219444 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa430130eb0 0x7fa430123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.045+0000 7fa43655d700 1 --2- 172.21.15.156:0/3972219444 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa43009d860 0x7fa430122780 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.045+0000 7fa43655d700 1 --2- 172.21.15.156:0/3972219444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa43009e170 0x7fa430122cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.045+0000 7fa43655d700 1 -- 172.21.15.156:0/3972219444 >> 172.21.15.156:0/3972219444 conn(0x7fa430099c40 msgr2=0x7fa4300a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:58.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.045+0000 7fa43655d700 1 -- 172.21.15.156:0/3972219444 shutdown_connections 2023-09-30T22:23:58.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.045+0000 7fa43655d700 1 -- 172.21.15.156:0/3972219444 wait complete. 2023-09-30T22:23:58.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:58.107 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:58.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.124+0000 7ff97ff3c700 1 Processor -- start 2023-09-30T22:23:58.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.125+0000 7ff97ff3c700 1 -- start start 2023-09-30T22:23:58.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.125+0000 7ff97ff3c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff97806a770 0x7ff9781349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.125+0000 7ff97ff3c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff97809e070 0x7ff97813fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.125+0000 7ff97ff3c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff97809eca0 con 0x7ff978134f00 2023-09-30T22:23:58.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.125+0000 7ff97ff3c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97806b2e0 con 0x7ff97809e070 2023-09-30T22:23:58.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.125+0000 7ff97ff3c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff97809f720 con 0x7ff97806a770 2023-09-30T22:23:58.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.125+0000 7ff97dcd8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff97806a770 0x7ff9781349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.125+0000 7ff97d4d7700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff978134f00 0x7ff97809d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49192/0 (socket says 172.21.15.156:49192) 2023-09-30T22:23:58.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.125+0000 7ff97d4d7700 1 -- 172.21.15.156:0/3544567110 learned_addr learned my addr 172.21.15.156:0/3544567110 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:58.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.125+0000 7ff97e4d9700 1 --2- 172.21.15.156:0/3544567110 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff97809e070 0x7ff97813fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.126+0000 7ff97ccd6700 1 -- 172.21.15.156:0/3544567110 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2386199469 0 0) 0x7ff97809eca0 con 0x7ff978134f00 2023-09-30T22:23:58.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.126+0000 7ff97dcd8700 1 -- 172.21.15.156:0/3544567110 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff97809e070 msgr2=0x7ff97813fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:58.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.126+0000 7ff97dcd8700 1 --2- 172.21.15.156:0/3544567110 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff97809e070 0x7ff97813fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.126+0000 7ff97dcd8700 1 -- 172.21.15.156:0/3544567110 >> v1:172.21.15.156:6789/0 conn(0x7ff978134f00 legacy=0x7ff97809d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.126+0000 7ff97dcd8700 1 -- 172.21.15.156:0/3544567110 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97806b480 con 0x7ff97806a770 2023-09-30T22:23:58.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.126+0000 7ff97dcd8700 1 --2- 172.21.15.156:0/3544567110 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff97806a770 0x7ff9781349c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff974009870 tx=0x7ff974009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67c280c0061d2a2d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:58.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.126+0000 7ff97ccd6700 1 -- 172.21.15.156:0/3544567110 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff974011830 con 0x7ff97806a770 2023-09-30T22:23:58.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.126+0000 7ff97ccd6700 1 -- 172.21.15.156:0/3544567110 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff974011990 con 0x7ff97806a770 2023-09-30T22:23:58.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.126+0000 7ff97ccd6700 1 -- 172.21.15.156:0/3544567110 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff974011d20 con 0x7ff97806a770 2023-09-30T22:23:58.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.127+0000 7ff97ff3c700 1 -- 172.21.15.156:0/3544567110 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff97806a770 msgr2=0x7ff9781349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.127+0000 7ff97ff3c700 1 --2- 172.21.15.156:0/3544567110 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff97806a770 0x7ff9781349c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff974009870 tx=0x7ff974009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:58.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.127+0000 7ff97ff3c700 1 -- 172.21.15.156:0/3544567110 shutdown_connections 2023-09-30T22:23:58.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.127+0000 7ff97ff3c700 1 --2- 172.21.15.156:0/3544567110 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff97809e070 0x7ff97813fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.127+0000 7ff97ff3c700 1 --2- 172.21.15.156:0/3544567110 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff97806a770 0x7ff9781349c0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.127+0000 7ff97ff3c700 1 -- 172.21.15.156:0/3544567110 >> 172.21.15.156:0/3544567110 conn(0x7ff978099c40 msgr2=0x7ff9780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:58.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.127+0000 7ff97ff3c700 1 -- 172.21.15.156:0/3544567110 shutdown_connections 2023-09-30T22:23:58.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.127+0000 7ff97ff3c700 1 -- 172.21.15.156:0/3544567110 wait complete. 2023-09-30T22:23:58.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.128+0000 7ff97ff3c700 1 Processor -- start 2023-09-30T22:23:58.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.128+0000 7ff97ff3c700 1 -- start start 2023-09-30T22:23:58.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.129+0000 7ff97ff3c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff97806a770 0x7ff978135850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.129+0000 7ff97ff3c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff97809e070 0x7ff978135d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.129+0000 7ff97ff3c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff978134f00 0x7ff9781362d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.129+0000 7ff97ff3c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff978139690 con 0x7ff97809e070 2023-09-30T22:23:58.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.129+0000 7ff97ff3c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff978138730 con 0x7ff978134f00 2023-09-30T22:23:58.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.129+0000 7ff97ff3c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff978138080 con 0x7ff97806a770 2023-09-30T22:23:58.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.129+0000 7ff97dcd8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff97806a770 0x7ff978135850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.129+0000 7ff97dcd8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff97806a770 0x7ff978135850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:42960/0 (socket says 172.21.15.156:42960) 2023-09-30T22:23:58.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.129+0000 7ff97dcd8700 1 -- 172.21.15.156:0/3993005219 learned_addr learned my addr 172.21.15.156:0/3993005219 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:58.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.129+0000 7ff97d4d7700 1 --2- 172.21.15.156:0/3993005219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff97809e070 0x7ff978135d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.129+0000 7ff97e4d9700 1 --2- 172.21.15.156:0/3993005219 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff978134f00 0x7ff9781362d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.129+0000 7ff97dcd8700 1 -- 172.21.15.156:0/3993005219 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff978134f00 msgr2=0x7ff9781362d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.129+0000 7ff97dcd8700 1 --2- 172.21.15.156:0/3993005219 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff978134f00 0x7ff9781362d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.129+0000 7ff97dcd8700 1 -- 172.21.15.156:0/3993005219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff97809e070 msgr2=0x7ff978135d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.129+0000 7ff97dcd8700 1 --2- 172.21.15.156:0/3993005219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff97809e070 0x7ff978135d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.129+0000 7ff97dcd8700 1 -- 172.21.15.156:0/3993005219 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9740094a0 con 0x7ff97806a770 2023-09-30T22:23:58.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.130+0000 7ff97dcd8700 1 --2- 172.21.15.156:0/3993005219 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff97806a770 0x7ff978135850 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff9740090b0 tx=0x7ff974004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:58.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.130+0000 7ff96e7fc700 1 -- 172.21.15.156:0/3993005219 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff974004510 con 0x7ff97806a770 2023-09-30T22:23:58.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.130+0000 7ff96e7fc700 1 -- 172.21.15.156:0/3993005219 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97401e070 con 0x7ff97806a770 2023-09-30T22:23:58.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.130+0000 7ff97ff3c700 1 -- 172.21.15.156:0/3993005219 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9781389f0 con 0x7ff97806a770 2023-09-30T22:23:58.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.130+0000 7ff96e7fc700 1 -- 172.21.15.156:0/3993005219 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9740038c0 con 0x7ff97806a770 2023-09-30T22:23:58.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.130+0000 7ff97ff3c700 1 -- 172.21.15.156:0/3993005219 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff978137bc0 con 0x7ff97806a770 2023-09-30T22:23:58.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.131+0000 7ff96e7fc700 1 -- 172.21.15.156:0/3993005219 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff974003a20 con 0x7ff97806a770 2023-09-30T22:23:58.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.131+0000 7ff96e7fc700 1 -- 172.21.15.156:0/3993005219 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff974040550 con 0x7ff97806a770 2023-09-30T22:23:58.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.131+0000 7ff97ff3c700 1 -- 172.21.15.156:0/3993005219 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff978138d60 con 0x7ff97806a770 2023-09-30T22:23:58.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.136+0000 7ff96e7fc700 1 -- 172.21.15.156:0/3993005219 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff974015070 con 0x7ff97806a770 2023-09-30T22:23:58.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.169+0000 7fefa1892700 1 Processor -- start 2023-09-30T22:23:58.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.169+0000 7fefa1892700 1 -- start start 2023-09-30T22:23:58.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.169+0000 7fefa1892700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef9c09e340 0x7fef9c1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.169+0000 7fefa1892700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef9c135f20 0x7fef9c138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.169+0000 7fefa1892700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c09aaa0 con 0x7fef9c09d860 2023-09-30T22:23:58.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.169+0000 7fefa1892700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c09e730 con 0x7fef9c135f20 2023-09-30T22:23:58.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.169+0000 7fefa1892700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c09f870 con 0x7fef9c09e340 2023-09-30T22:23:58.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.169+0000 7fef9b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef9c135f20 0x7fef9c138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.169+0000 7fef9affd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fef9c09d860 0x7fef9c09dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49204/0 (socket says 172.21.15.156:49204) 2023-09-30T22:23:58.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.170+0000 7fef9affd700 1 -- 172.21.15.156:0/4112787392 learned_addr learned my addr 172.21.15.156:0/4112787392 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:58.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.170+0000 7fef9a7fc700 1 --2- 172.21.15.156:0/4112787392 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef9c09e340 0x7fef9c1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.170+0000 7fef9b7fe700 1 -- 172.21.15.156:0/4112787392 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef9c09e340 msgr2=0x7fef9c1359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:58.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.170+0000 7fef9b7fe700 1 --2- 172.21.15.156:0/4112787392 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef9c09e340 0x7fef9c1359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.170+0000 7fef9b7fe700 1 -- 172.21.15.156:0/4112787392 >> v1:172.21.15.156:6789/0 conn(0x7fef9c09d860 legacy=0x7fef9c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.170+0000 7fef9b7fe700 1 -- 172.21.15.156:0/4112787392 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c09b360 con 0x7fef9c135f20 2023-09-30T22:23:58.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.170+0000 7fef9b7fe700 1 --2- 172.21.15.156:0/4112787392 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef9c135f20 0x7fef9c138300 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fef94009e40 tx=0x7fef9400d540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edb2523575a0e9eb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:58.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.170+0000 7fef99ffb700 1 -- 172.21.15.156:0/4112787392 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9400de30 con 0x7fef9c135f20 2023-09-30T22:23:58.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.170+0000 7fef99ffb700 1 -- 172.21.15.156:0/4112787392 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef94003a20 con 0x7fef9c135f20 2023-09-30T22:23:58.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.170+0000 7fef99ffb700 1 -- 172.21.15.156:0/4112787392 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef94003dd0 con 0x7fef9c135f20 2023-09-30T22:23:58.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.171+0000 7fefa1892700 1 -- 172.21.15.156:0/4112787392 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef9c135f20 msgr2=0x7fef9c138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.171+0000 7fefa1892700 1 --2- 172.21.15.156:0/4112787392 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef9c135f20 0x7fef9c138300 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fef94009e40 tx=0x7fef9400d540 comp rx=0 tx=0).stop 2023-09-30T22:23:58.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.171+0000 7fefa1892700 1 -- 172.21.15.156:0/4112787392 shutdown_connections 2023-09-30T22:23:58.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.171+0000 7fefa1892700 1 --2- 172.21.15.156:0/4112787392 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef9c135f20 0x7fef9c138300 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.171+0000 7fefa1892700 1 --2- 172.21.15.156:0/4112787392 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef9c09e340 0x7fef9c1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.171+0000 7fefa1892700 1 -- 172.21.15.156:0/4112787392 >> 172.21.15.156:0/4112787392 conn(0x7fef9c099c40 msgr2=0x7fef9c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:58.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.171+0000 7fefa1892700 1 -- 172.21.15.156:0/4112787392 shutdown_connections 2023-09-30T22:23:58.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.171+0000 7fefa1892700 1 -- 172.21.15.156:0/4112787392 wait complete. 2023-09-30T22:23:58.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.172+0000 7fefa1892700 1 Processor -- start 2023-09-30T22:23:58.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.172+0000 7fefa1892700 1 -- start start 2023-09-30T22:23:58.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.173+0000 7fefa1892700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef9c09d860 0x7fef9c1c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.173+0000 7fefa1892700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef9c09e340 0x7fef9c1c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.173+0000 7fefa1892700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef9c135f20 0x7fef9c1c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.173+0000 7fefa1892700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c11fcb0 con 0x7fef9c135f20 2023-09-30T22:23:58.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.173+0000 7fefa1892700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c121410 con 0x7fef9c09d860 2023-09-30T22:23:58.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.173+0000 7fefa1892700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c122d80 con 0x7fef9c09e340 2023-09-30T22:23:58.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.173+0000 7fef9affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef9c09d860 0x7fef9c1c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.173+0000 7fef9a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef9c09e340 0x7fef9c1c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.173+0000 7fef9affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef9c09d860 0x7fef9c1c81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46250/0 (socket says 172.21.15.156:46250) 2023-09-30T22:23:58.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.173+0000 7fef9affd700 1 -- 172.21.15.156:0/2448500464 learned_addr learned my addr 172.21.15.156:0/2448500464 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:58.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.173+0000 7fef9b7fe700 1 --2- 172.21.15.156:0/2448500464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef9c135f20 0x7fef9c1c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.174+0000 7fef9a7fc700 1 -- 172.21.15.156:0/2448500464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef9c09d860 msgr2=0x7fef9c1c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.174+0000 7fef9a7fc700 1 --2- 172.21.15.156:0/2448500464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef9c09d860 0x7fef9c1c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.174+0000 7fef9a7fc700 1 -- 172.21.15.156:0/2448500464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef9c135f20 msgr2=0x7fef9c1c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.174+0000 7fef9a7fc700 1 --2- 172.21.15.156:0/2448500464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef9c135f20 0x7fef9c1c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.174+0000 7fef9a7fc700 1 -- 172.21.15.156:0/2448500464 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef94009a70 con 0x7fef9c09e340 2023-09-30T22:23:58.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.174+0000 7fef9b7fe700 1 --2- 172.21.15.156:0/2448500464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef9c135f20 0x7fef9c1c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:58.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.174+0000 7fef9affd700 1 --2- 172.21.15.156:0/2448500464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef9c09d860 0x7fef9c1c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:58.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.174+0000 7fef9a7fc700 1 --2- 172.21.15.156:0/2448500464 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef9c09e340 0x7fef9c1c86f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fef9000e900 tx=0x7fef9000ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:58.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.174+0000 7fef83fff700 1 -- 172.21.15.156:0/2448500464 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef90013680 con 0x7fef9c09e340 2023-09-30T22:23:58.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.174+0000 7fef83fff700 1 -- 172.21.15.156:0/2448500464 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef900137e0 con 0x7fef9c09e340 2023-09-30T22:23:58.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.174+0000 7fefa1892700 1 -- 172.21.15.156:0/2448500464 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef9c123400 con 0x7fef9c09e340 2023-09-30T22:23:58.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.174+0000 7fef83fff700 1 -- 172.21.15.156:0/2448500464 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef90013b50 con 0x7fef9c09e340 2023-09-30T22:23:58.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.174+0000 7fefa1892700 1 -- 172.21.15.156:0/2448500464 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef9c122080 con 0x7fef9c09e340 2023-09-30T22:23:58.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.175+0000 7fef83fff700 1 -- 172.21.15.156:0/2448500464 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef90013cb0 con 0x7fef9c09e340 2023-09-30T22:23:58.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.175+0000 7fef83fff700 1 -- 172.21.15.156:0/2448500464 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fef9003f7f0 con 0x7fef9c09e340 2023-09-30T22:23:58.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.175+0000 7fefa1892700 1 -- 172.21.15.156:0/2448500464 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9c123260 con 0x7fef9c09e340 2023-09-30T22:23:58.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.184+0000 7fef83fff700 1 -- 172.21.15.156:0/2448500464 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef9c123260 con 0x7fef9c09e340 2023-09-30T22:23:58.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.236+0000 7f07dd7a1700 1 Processor -- start 2023-09-30T22:23:58.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.236+0000 7f07dd7a1700 1 -- start start 2023-09-30T22:23:58.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.236+0000 7f07dd7a1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f07d806a770 0x7f07d812ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.236+0000 7f07dd7a1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07d8130520 0x7f07d8130990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.236+0000 7f07dd7a1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07d8133470 0x7f07d81338c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.236+0000 7f07dd7a1700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d809af90 con 0x7f07d806a770 2023-09-30T22:23:58.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.236+0000 7f07dd7a1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d809f590 con 0x7f07d8130520 2023-09-30T22:23:58.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.236+0000 7f07dd7a1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07d8130ed0 con 0x7f07d8133470 2023-09-30T22:23:58.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.237+0000 7f07d7fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f07d806a770 0x7f07d812ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.237+0000 7f07d7fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f07d806a770 0x7f07d812ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44826/0 (socket says 172.21.15.156:44826) 2023-09-30T22:23:58.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.237+0000 7f07d7fff700 1 -- 172.21.15.156:0/3486574410 learned_addr learned my addr 172.21.15.156:0/3486574410 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:58.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.237+0000 7f07dcfa0700 1 --2- 172.21.15.156:0/3486574410 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07d8133470 0x7f07d81338c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.237+0000 7f07d77fe700 1 --2- 172.21.15.156:0/3486574410 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07d8130520 0x7f07d8130990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.237+0000 7f07d7fff700 1 -- 172.21.15.156:0/3486574410 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07d8133470 msgr2=0x7f07d81338c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:58.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.237+0000 7f07d7fff700 1 --2- 172.21.15.156:0/3486574410 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07d8133470 0x7f07d81338c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.237+0000 7f07d7fff700 1 -- 172.21.15.156:0/3486574410 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07d8130520 msgr2=0x7f07d8130990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:58.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.237+0000 7f07d7fff700 1 --2- 172.21.15.156:0/3486574410 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07d8130520 0x7f07d8130990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.237+0000 7f07d7fff700 1 -- 172.21.15.156:0/3486574410 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d809a5d0 con 0x7f07d806a770 2023-09-30T22:23:58.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.237+0000 7f07d7fff700 1 --2- 172.21.15.156:0/3486574410 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07d806a770 0x7f07d812ff00 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f07c8009950 tx=0x7f07c8009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f6ed317cc19327 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:58.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.237+0000 7f07d6ffd700 1 -- 172.21.15.156:0/3486574410 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c8011830 con 0x7f07d806a770 2023-09-30T22:23:58.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.237+0000 7f07d6ffd700 1 -- 172.21.15.156:0/3486574410 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c8011990 con 0x7f07d806a770 2023-09-30T22:23:58.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.237+0000 7f07d6ffd700 1 -- 172.21.15.156:0/3486574410 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c8011d40 con 0x7f07d806a770 2023-09-30T22:23:58.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.238+0000 7f07dd7a1700 1 -- 172.21.15.156:0/3486574410 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07d806a770 msgr2=0x7f07d812ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.238+0000 7f07dd7a1700 1 --2- 172.21.15.156:0/3486574410 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07d806a770 0x7f07d812ff00 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f07c8009950 tx=0x7f07c8009c60 comp rx=0 tx=0).stop 2023-09-30T22:23:58.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.238+0000 7f07dd7a1700 1 -- 172.21.15.156:0/3486574410 shutdown_connections 2023-09-30T22:23:58.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.238+0000 7f07dd7a1700 1 --2- 172.21.15.156:0/3486574410 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07d8133470 0x7f07d81338c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.238+0000 7f07dd7a1700 1 --2- 172.21.15.156:0/3486574410 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07d806a770 0x7f07d812ff00 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.238+0000 7f07dd7a1700 1 --2- 172.21.15.156:0/3486574410 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07d8130520 0x7f07d8130990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.238+0000 7f07dd7a1700 1 -- 172.21.15.156:0/3486574410 >> 172.21.15.156:0/3486574410 conn(0x7f07d80a2d80 msgr2=0x7f07d80a3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:58.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.238+0000 7f07dd7a1700 1 -- 172.21.15.156:0/3486574410 shutdown_connections 2023-09-30T22:23:58.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.238+0000 7f07dd7a1700 1 -- 172.21.15.156:0/3486574410 wait complete. 2023-09-30T22:23:58.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.239+0000 7f07dd7a1700 1 Processor -- start 2023-09-30T22:23:58.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.239+0000 7f07dd7a1700 1 -- start start 2023-09-30T22:23:58.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.239+0000 7f07dd7a1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07d806a770 0x7f07d81c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.239+0000 7f07dd7a1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07d8130520 0x7f07d81c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.239+0000 7f07dd7a1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07d8133470 0x7f07d81c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.239+0000 7f07dd7a1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d8071950 con 0x7f07d8130520 2023-09-30T22:23:58.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.240+0000 7f07dd7a1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d812db70 con 0x7f07d8133470 2023-09-30T22:23:58.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.240+0000 7f07dd7a1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07d8072640 con 0x7f07d806a770 2023-09-30T22:23:58.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.240+0000 7f07d77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07d8130520 0x7f07d81c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.240+0000 7f07d77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07d8130520 0x7f07d81c8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44838/0 (socket says 172.21.15.156:44838) 2023-09-30T22:23:58.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.240+0000 7f07d77fe700 1 -- 172.21.15.156:0/864548126 learned_addr learned my addr 172.21.15.156:0/864548126 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:58.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.240+0000 7f07dcfa0700 1 --2- 172.21.15.156:0/864548126 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07d8133470 0x7f07d81c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.240+0000 7f07d7fff700 1 --2- 172.21.15.156:0/864548126 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07d806a770 0x7f07d81c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.240+0000 7f07d77fe700 1 -- 172.21.15.156:0/864548126 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07d806a770 msgr2=0x7f07d81c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.240+0000 7f07d77fe700 1 --2- 172.21.15.156:0/864548126 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07d806a770 0x7f07d81c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.240+0000 7f07d77fe700 1 -- 172.21.15.156:0/864548126 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07d8133470 msgr2=0x7f07d81c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.240+0000 7f07d77fe700 1 --2- 172.21.15.156:0/864548126 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07d8133470 0x7f07d81c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.240+0000 7f07d77fe700 1 -- 172.21.15.156:0/864548126 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c8009550 con 0x7f07d8130520 2023-09-30T22:23:58.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.240+0000 7f07dcfa0700 1 --2- 172.21.15.156:0/864548126 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07d8133470 0x7f07d81c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:58.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.240+0000 7f07d77fe700 1 --2- 172.21.15.156:0/864548126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07d8130520 0x7f07d81c8ab0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f07cc00e9b0 tx=0x7f07cc00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:58.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.240+0000 7f07d4ff9700 1 -- 172.21.15.156:0/864548126 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc009710 con 0x7f07d8130520 2023-09-30T22:23:58.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.240+0000 7f07d4ff9700 1 -- 172.21.15.156:0/864548126 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07cc00ee50 con 0x7f07d8130520 2023-09-30T22:23:58.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.240+0000 7f07dd7a1700 1 -- 172.21.15.156:0/864548126 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d8071ba0 con 0x7f07d8130520 2023-09-30T22:23:58.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.240+0000 7f07d4ff9700 1 -- 172.21.15.156:0/864548126 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc00ca50 con 0x7f07d8130520 2023-09-30T22:23:58.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.240+0000 7f07dd7a1700 1 -- 172.21.15.156:0/864548126 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d806e730 con 0x7f07d8130520 2023-09-30T22:23:58.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.241+0000 7f07d4ff9700 1 -- 172.21.15.156:0/864548126 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f07cc00cbb0 con 0x7f07d8130520 2023-09-30T22:23:58.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.241+0000 7f07d4ff9700 1 -- 172.21.15.156:0/864548126 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f07cc03fab0 con 0x7f07d8130520 2023-09-30T22:23:58.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.242+0000 7f07dd7a1700 1 -- 172.21.15.156:0/864548126 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d804f2a0 con 0x7f07d8130520 2023-09-30T22:23:58.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.247+0000 7f07d4ff9700 1 -- 172.21.15.156:0/864548126 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f07cc01b3b0 con 0x7f07d8130520 2023-09-30T22:23:58.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.340+0000 7ff97ff3c700 1 -- 172.21.15.156:0/3993005219 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff97804f2a0 con 0x7ff97806a770 2023-09-30T22:23:58.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.341+0000 7ff96e7fc700 1 -- 172.21.15.156:0/3993005219 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff974035070 con 0x7ff97806a770 2023-09-30T22:23:58.341 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:58.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.344+0000 7ff97ff3c700 1 -- 172.21.15.156:0/3993005219 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff97806a770 msgr2=0x7ff978135850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.344+0000 7ff97ff3c700 1 --2- 172.21.15.156:0/3993005219 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff97806a770 0x7ff978135850 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff9740090b0 tx=0x7ff974004750 comp rx=0 tx=0).stop 2023-09-30T22:23:58.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.344+0000 7ff97ff3c700 1 -- 172.21.15.156:0/3993005219 shutdown_connections 2023-09-30T22:23:58.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.344+0000 7ff97ff3c700 1 --2- 172.21.15.156:0/3993005219 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff978134f00 0x7ff9781362d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.344+0000 7ff97ff3c700 1 --2- 172.21.15.156:0/3993005219 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff97806a770 0x7ff978135850 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.344+0000 7ff97ff3c700 1 --2- 172.21.15.156:0/3993005219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff97809e070 0x7ff978135d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.344+0000 7ff97ff3c700 1 -- 172.21.15.156:0/3993005219 >> 172.21.15.156:0/3993005219 conn(0x7ff978099c40 msgr2=0x7ff978072070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:58.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.344+0000 7ff97ff3c700 1 -- 172.21.15.156:0/3993005219 shutdown_connections 2023-09-30T22:23:58.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.344+0000 7ff97ff3c700 1 -- 172.21.15.156:0/3993005219 wait complete. 2023-09-30T22:23:58.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:58.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.388+0000 7fefa1892700 1 -- 172.21.15.156:0/2448500464 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fef9c123260 con 0x7fef9c09e340 2023-09-30T22:23:58.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.388+0000 7fef83fff700 1 -- 172.21.15.156:0/2448500464 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef9c123260 con 0x7fef9c09e340 2023-09-30T22:23:58.388 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:58.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.390+0000 7fefa1892700 1 -- 172.21.15.156:0/2448500464 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef9c09e340 msgr2=0x7fef9c1c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.390+0000 7fefa1892700 1 --2- 172.21.15.156:0/2448500464 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef9c09e340 0x7fef9c1c86f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fef9000e900 tx=0x7fef9000ec10 comp rx=0 tx=0).stop 2023-09-30T22:23:58.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.390+0000 7fefa1892700 1 -- 172.21.15.156:0/2448500464 shutdown_connections 2023-09-30T22:23:58.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.390+0000 7fefa1892700 1 --2- 172.21.15.156:0/2448500464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef9c135f20 0x7fef9c1c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.390+0000 7fefa1892700 1 --2- 172.21.15.156:0/2448500464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef9c09d860 0x7fef9c1c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.390+0000 7fefa1892700 1 --2- 172.21.15.156:0/2448500464 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef9c09e340 0x7fef9c1c86f0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.390+0000 7fefa1892700 1 -- 172.21.15.156:0/2448500464 >> 172.21.15.156:0/2448500464 conn(0x7fef9c099c40 msgr2=0x7fef9c132830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:58.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.391+0000 7fefa1892700 1 -- 172.21.15.156:0/2448500464 shutdown_connections 2023-09-30T22:23:58.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.391+0000 7fefa1892700 1 -- 172.21.15.156:0/2448500464 wait complete. 2023-09-30T22:23:58.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:58.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.440+0000 7f07dd7a1700 1 -- 172.21.15.156:0/864548126 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f07d8071dc0 con 0x7f07d8130520 2023-09-30T22:23:58.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.440+0000 7f07d4ff9700 1 -- 172.21.15.156:0/864548126 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f07cc017020 con 0x7f07d8130520 2023-09-30T22:23:58.440 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:58.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.442+0000 7f07dd7a1700 1 -- 172.21.15.156:0/864548126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07d8130520 msgr2=0x7f07d81c8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.442+0000 7f07dd7a1700 1 --2- 172.21.15.156:0/864548126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07d8130520 0x7f07d81c8ab0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f07cc00e9b0 tx=0x7f07cc00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.442+0000 7f07dd7a1700 1 -- 172.21.15.156:0/864548126 shutdown_connections 2023-09-30T22:23:58.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.442+0000 7f07dd7a1700 1 --2- 172.21.15.156:0/864548126 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07d8133470 0x7f07d81c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.442+0000 7f07dd7a1700 1 --2- 172.21.15.156:0/864548126 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07d806a770 0x7f07d81c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.442+0000 7f07dd7a1700 1 --2- 172.21.15.156:0/864548126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07d8130520 0x7f07d81c8ab0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.442+0000 7f07dd7a1700 1 -- 172.21.15.156:0/864548126 >> 172.21.15.156:0/864548126 conn(0x7f07d80a2d80 msgr2=0x7f07d80a11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:58.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.443+0000 7f07dd7a1700 1 -- 172.21.15.156:0/864548126 shutdown_connections 2023-09-30T22:23:58.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:58.443+0000 7f07dd7a1700 1 -- 172.21.15.156:0/864548126 wait complete. 2023-09-30T22:23:58.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:23:59.059 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:59.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.189+0000 7f88ec7c7700 1 Processor -- start 2023-09-30T22:23:59.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.189+0000 7f88ec7c7700 1 -- start start 2023-09-30T22:23:59.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.190+0000 7f88ec7c7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88e409dec0 0x7f88e406b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.190+0000 7f88ec7c7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88e4136cb0 0x7f88e4139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.190+0000 7f88ec7c7700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e406e900 con 0x7f88e406a770 2023-09-30T22:23:59.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.190+0000 7f88ec7c7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e409d180 con 0x7f88e4136cb0 2023-09-30T22:23:59.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.190+0000 7f88ec7c7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88e409e780 con 0x7f88e409dec0 2023-09-30T22:23:59.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.190+0000 7f88e9d62700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88e409dec0 0x7f88e406b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:59.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.190+0000 7f88ead64700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88e4136cb0 0x7f88e4139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:59.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.190+0000 7f88ea563700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f88e406a770 0x7f88e406ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49206/0 (socket says 172.21.15.156:49206) 2023-09-30T22:23:59.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.190+0000 7f88ea563700 1 -- 172.21.15.156:0/4127585735 learned_addr learned my addr 172.21.15.156:0/4127585735 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:59.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.190+0000 7f88e9561700 1 -- 172.21.15.156:0/4127585735 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611839610 0 0) 0x7f88e406e900 con 0x7f88e406a770 2023-09-30T22:23:59.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.190+0000 7f88ead64700 1 -- 172.21.15.156:0/4127585735 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88e409dec0 msgr2=0x7f88e406b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:59.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.190+0000 7f88ead64700 1 --2- 172.21.15.156:0/4127585735 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88e409dec0 0x7f88e406b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.190+0000 7f88ead64700 1 -- 172.21.15.156:0/4127585735 >> v1:172.21.15.156:6789/0 conn(0x7f88e406a770 legacy=0x7f88e406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:59.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.190+0000 7f88ead64700 1 -- 172.21.15.156:0/4127585735 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e409d3c0 con 0x7f88e4136cb0 2023-09-30T22:23:59.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.190+0000 7f88e9d62700 1 --2- 172.21.15.156:0/4127585735 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88e409dec0 0x7f88e406b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:59.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.191+0000 7f88ead64700 1 --2- 172.21.15.156:0/4127585735 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88e4136cb0 0x7f88e4139090 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f88dc009dc0 tx=0x7f88dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c19fc660bac5b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:59.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.191+0000 7f88e9561700 1 -- 172.21.15.156:0/4127585735 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc00e070 con 0x7f88e4136cb0 2023-09-30T22:23:59.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.191+0000 7f88e9561700 1 -- 172.21.15.156:0/4127585735 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88dc00bb20 con 0x7f88e4136cb0 2023-09-30T22:23:59.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.191+0000 7f88e9561700 1 -- 172.21.15.156:0/4127585735 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc012430 con 0x7f88e4136cb0 2023-09-30T22:23:59.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.191+0000 7f88ec7c7700 1 -- 172.21.15.156:0/4127585735 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88e4136cb0 msgr2=0x7f88e4139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:59.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.191+0000 7f88ec7c7700 1 --2- 172.21.15.156:0/4127585735 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88e4136cb0 0x7f88e4139090 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f88dc009dc0 tx=0x7f88dc00b330 comp rx=0 tx=0).stop 2023-09-30T22:23:59.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.191+0000 7f88ec7c7700 1 -- 172.21.15.156:0/4127585735 shutdown_connections 2023-09-30T22:23:59.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.191+0000 7f88ec7c7700 1 --2- 172.21.15.156:0/4127585735 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88e4136cb0 0x7f88e4139090 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.191+0000 7f88ec7c7700 1 --2- 172.21.15.156:0/4127585735 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88e409dec0 0x7f88e406b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.191+0000 7f88ec7c7700 1 -- 172.21.15.156:0/4127585735 >> 172.21.15.156:0/4127585735 conn(0x7f88e4099c40 msgr2=0x7f88e40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:59.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.191+0000 7f88ec7c7700 1 -- 172.21.15.156:0/4127585735 shutdown_connections 2023-09-30T22:23:59.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.191+0000 7f88ec7c7700 1 -- 172.21.15.156:0/4127585735 wait complete. 2023-09-30T22:23:59.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.192+0000 7f88ec7c7700 1 Processor -- start 2023-09-30T22:23:59.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.192+0000 7f88ec7c7700 1 -- start start 2023-09-30T22:23:59.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.193+0000 7f88ec7c7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88e406a770 0x7f88e4134500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.193+0000 7f88ec7c7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88e409dec0 0x7f88e4134a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.193+0000 7f88ec7c7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88e4136cb0 0x7f88e4134f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.193+0000 7f88ec7c7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e411ab70 con 0x7f88e4136cb0 2023-09-30T22:23:59.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.193+0000 7f88ec7c7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e4136090 con 0x7f88e406a770 2023-09-30T22:23:59.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.193+0000 7f88ec7c7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88e411a7b0 con 0x7f88e409dec0 2023-09-30T22:23:59.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.193+0000 7f88ea563700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88e406a770 0x7f88e4134500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:59.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.193+0000 7f88e9d62700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88e409dec0 0x7f88e4134a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:59.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.193+0000 7f88ea563700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88e406a770 0x7f88e4134500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46290/0 (socket says 172.21.15.156:46290) 2023-09-30T22:23:59.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.193+0000 7f88e9d62700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88e409dec0 0x7f88e4134a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43016/0 (socket says 172.21.15.156:43016) 2023-09-30T22:23:59.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.193+0000 7f88ea563700 1 -- 172.21.15.156:0/4017167730 learned_addr learned my addr 172.21.15.156:0/4017167730 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:59.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.193+0000 7f88ead64700 1 --2- 172.21.15.156:0/4017167730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88e4136cb0 0x7f88e4134f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:59.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.193+0000 7f88ea563700 1 -- 172.21.15.156:0/4017167730 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88e409dec0 msgr2=0x7f88e4134a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:59.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.193+0000 7f88ea563700 1 --2- 172.21.15.156:0/4017167730 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88e409dec0 0x7f88e4134a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.193+0000 7f88ea563700 1 -- 172.21.15.156:0/4017167730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88e4136cb0 msgr2=0x7f88e4134f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:59.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.193+0000 7f88ea563700 1 --2- 172.21.15.156:0/4017167730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88e4136cb0 0x7f88e4134f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.193+0000 7f88ea563700 1 -- 172.21.15.156:0/4017167730 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e00094a0 con 0x7f88e406a770 2023-09-30T22:23:59.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.193+0000 7f88e9d62700 1 --2- 172.21.15.156:0/4017167730 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88e409dec0 0x7f88e4134a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:59.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.193+0000 7f88ead64700 1 --2- 172.21.15.156:0/4017167730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88e4136cb0 0x7f88e4134f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:59.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.193+0000 7f88ea563700 1 --2- 172.21.15.156:0/4017167730 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88e406a770 0x7f88e4134500 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f88d400c520 tx=0x7f88d400c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:59.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.193+0000 7f88daffd700 1 -- 172.21.15.156:0/4017167730 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d4004c80 con 0x7f88e406a770 2023-09-30T22:23:59.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.193+0000 7f88daffd700 1 -- 172.21.15.156:0/4017167730 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d4004e00 con 0x7f88e406a770 2023-09-30T22:23:59.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.193+0000 7f88ec7c7700 1 -- 172.21.15.156:0/4017167730 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88dc009a70 con 0x7f88e406a770 2023-09-30T22:23:59.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.193+0000 7f88daffd700 1 -- 172.21.15.156:0/4017167730 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d4007310 con 0x7f88e406a770 2023-09-30T22:23:59.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.193+0000 7f88ec7c7700 1 -- 172.21.15.156:0/4017167730 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e40a1130 con 0x7f88e406a770 2023-09-30T22:23:59.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.194+0000 7f88daffd700 1 -- 172.21.15.156:0/4017167730 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f88d4007470 con 0x7f88e406a770 2023-09-30T22:23:59.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.194+0000 7f88daffd700 1 -- 172.21.15.156:0/4017167730 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f88d403f310 con 0x7f88e406a770 2023-09-30T22:23:59.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.194+0000 7f88ec7c7700 1 -- 172.21.15.156:0/4017167730 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e41368f0 con 0x7f88e406a770 2023-09-30T22:23:59.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.199+0000 7f88daffd700 1 -- 172.21.15.156:0/4017167730 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f88d40123b0 con 0x7f88e406a770 2023-09-30T22:23:59.362 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:59.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.386+0000 7f88ec7c7700 1 -- 172.21.15.156:0/4017167730 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f88e404f2a0 con 0x7f88e406a770 2023-09-30T22:23:59.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.387+0000 7f88daffd700 1 -- 172.21.15.156:0/4017167730 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f88d4011360 con 0x7f88e406a770 2023-09-30T22:23:59.386 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:23:59.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.389+0000 7f88ec7c7700 1 -- 172.21.15.156:0/4017167730 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88e406a770 msgr2=0x7f88e4134500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:59.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.389+0000 7f88ec7c7700 1 --2- 172.21.15.156:0/4017167730 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88e406a770 0x7f88e4134500 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f88d400c520 tx=0x7f88d400c830 comp rx=0 tx=0).stop 2023-09-30T22:23:59.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.389+0000 7f88ec7c7700 1 -- 172.21.15.156:0/4017167730 shutdown_connections 2023-09-30T22:23:59.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.389+0000 7f88ec7c7700 1 --2- 172.21.15.156:0/4017167730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88e4136cb0 0x7f88e4134f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.389+0000 7f88ec7c7700 1 --2- 172.21.15.156:0/4017167730 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88e406a770 0x7f88e4134500 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.389+0000 7f88ec7c7700 1 --2- 172.21.15.156:0/4017167730 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f88e409dec0 0x7f88e4134a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.389+0000 7f88ec7c7700 1 -- 172.21.15.156:0/4017167730 >> 172.21.15.156:0/4017167730 conn(0x7f88e4099c40 msgr2=0x7f88e412f890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:59.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.389+0000 7f88ec7c7700 1 -- 172.21.15.156:0/4017167730 shutdown_connections 2023-09-30T22:23:59.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.389+0000 7f88ec7c7700 1 -- 172.21.15.156:0/4017167730 wait complete. 2023-09-30T22:23:59.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:23:59.403 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:59.455 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:59.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.487+0000 7feda7b2d700 1 Processor -- start 2023-09-30T22:23:59.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.488+0000 7feda7b2d700 1 -- start start 2023-09-30T22:23:59.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.488+0000 7feda7b2d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7feda009d860 0x7feda009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.488+0000 7feda7b2d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feda009e170 0x7feda01307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.488+0000 7feda7b2d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda009aaa0 con 0x7feda0130ce0 2023-09-30T22:23:59.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.488+0000 7feda7b2d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feda009f870 con 0x7feda009d860 2023-09-30T22:23:59.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.488+0000 7feda7b2d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda009b360 con 0x7feda009e170 2023-09-30T22:23:59.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.488+0000 7feda50c8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feda009e170 0x7feda01307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:59.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.488+0000 7feda50c8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feda009e170 0x7feda01307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46298/0 (socket says 172.21.15.156:46298) 2023-09-30T22:23:59.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.488+0000 7feda50c8700 1 -- 172.21.15.156:0/3809099996 learned_addr learned my addr 172.21.15.156:0/3809099996 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:59.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.488+0000 7feda58c9700 1 --2- 172.21.15.156:0/3809099996 >> v2:172.21.15.156:3300/0 conn(0x7feda009d860 0x7feda009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:59.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.489+0000 7feda48c7700 1 -- 172.21.15.156:0/3809099996 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 688236269 0 0) 0x7feda009aaa0 con 0x7feda0130ce0 2023-09-30T22:23:59.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.489+0000 7feda50c8700 1 -- 172.21.15.156:0/3809099996 >> v2:172.21.15.156:3300/0 conn(0x7feda009d860 msgr2=0x7feda009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:59.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.489+0000 7feda50c8700 1 --2- 172.21.15.156:0/3809099996 >> v2:172.21.15.156:3300/0 conn(0x7feda009d860 0x7feda009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.489+0000 7feda50c8700 1 -- 172.21.15.156:0/3809099996 >> v1:172.21.15.156:6789/0 conn(0x7feda0130ce0 legacy=0x7feda01379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:59.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.489+0000 7feda50c8700 1 -- 172.21.15.156:0/3809099996 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda009b620 con 0x7feda009e170 2023-09-30T22:23:59.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.489+0000 7feda50c8700 1 --2- 172.21.15.156:0/3809099996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feda009e170 0x7feda01307a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fed900098f0 tx=0x7fed90009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2495aa28a9569208 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:59.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.489+0000 7feda48c7700 1 -- 172.21.15.156:0/3809099996 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed90011830 con 0x7feda009e170 2023-09-30T22:23:59.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.489+0000 7feda48c7700 1 -- 172.21.15.156:0/3809099996 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed90011990 con 0x7feda009e170 2023-09-30T22:23:59.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.489+0000 7feda48c7700 1 -- 172.21.15.156:0/3809099996 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed90011d20 con 0x7feda009e170 2023-09-30T22:23:59.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.490+0000 7feda7b2d700 1 -- 172.21.15.156:0/3809099996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feda009e170 msgr2=0x7feda01307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:59.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.490+0000 7feda7b2d700 1 --2- 172.21.15.156:0/3809099996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feda009e170 0x7feda01307a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fed900098f0 tx=0x7fed90009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:59.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.490+0000 7feda7b2d700 1 -- 172.21.15.156:0/3809099996 shutdown_connections 2023-09-30T22:23:59.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.490+0000 7feda7b2d700 1 --2- 172.21.15.156:0/3809099996 >> v2:172.21.15.156:3300/0 conn(0x7feda009d860 0x7feda009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.490+0000 7feda7b2d700 1 --2- 172.21.15.156:0/3809099996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feda009e170 0x7feda01307a0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.490+0000 7feda7b2d700 1 -- 172.21.15.156:0/3809099996 >> 172.21.15.156:0/3809099996 conn(0x7feda0099c40 msgr2=0x7feda00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:59.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.490+0000 7feda7b2d700 1 -- 172.21.15.156:0/3809099996 shutdown_connections 2023-09-30T22:23:59.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.490+0000 7feda7b2d700 1 -- 172.21.15.156:0/3809099996 wait complete. 2023-09-30T22:23:59.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.491+0000 7feda7b2d700 1 Processor -- start 2023-09-30T22:23:59.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.491+0000 7feda7b2d700 1 -- start start 2023-09-30T22:23:59.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.491+0000 7feda7b2d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feda009d860 0x7feda012fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.491+0000 7feda7b2d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feda009e170 0x7feda0130110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.491+0000 7feda7b2d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feda0130ce0 0x7feda0130650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.491+0000 7feda7b2d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda013be00 con 0x7feda0130ce0 2023-09-30T22:23:59.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.491+0000 7feda7b2d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda0136890 con 0x7feda009d860 2023-09-30T22:23:59.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.491+0000 7feda7b2d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feda009c8b0 con 0x7feda009e170 2023-09-30T22:23:59.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.491+0000 7feda50c8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feda009e170 0x7feda0130110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:59.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.491+0000 7feda50c8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feda009e170 0x7feda0130110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43022/0 (socket says 172.21.15.156:43022) 2023-09-30T22:23:59.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.491+0000 7feda50c8700 1 -- 172.21.15.156:0/1467624503 learned_addr learned my addr 172.21.15.156:0/1467624503 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:59.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.491+0000 7feda60ca700 1 --2- 172.21.15.156:0/1467624503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feda0130ce0 0x7feda0130650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:59.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.492+0000 7feda58c9700 1 --2- 172.21.15.156:0/1467624503 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feda009d860 0x7feda012fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:59.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.492+0000 7feda58c9700 1 -- 172.21.15.156:0/1467624503 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feda009e170 msgr2=0x7feda0130110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:59.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.492+0000 7feda58c9700 1 --2- 172.21.15.156:0/1467624503 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feda009e170 0x7feda0130110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.492+0000 7feda58c9700 1 -- 172.21.15.156:0/1467624503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feda0130ce0 msgr2=0x7feda0130650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:59.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.492+0000 7feda58c9700 1 --2- 172.21.15.156:0/1467624503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feda0130ce0 0x7feda0130650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.492+0000 7feda58c9700 1 -- 172.21.15.156:0/1467624503 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed90009550 con 0x7feda009d860 2023-09-30T22:23:59.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.492+0000 7feda50c8700 1 --2- 172.21.15.156:0/1467624503 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feda009e170 0x7feda0130110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:59.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.492+0000 7feda58c9700 1 --2- 172.21.15.156:0/1467624503 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feda009d860 0x7feda012fbd0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fed9c00e900 tx=0x7fed9c00ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:59.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.492+0000 7fed967fc700 1 -- 172.21.15.156:0/1467624503 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c013680 con 0x7feda009d860 2023-09-30T22:23:59.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.492+0000 7fed967fc700 1 -- 172.21.15.156:0/1467624503 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9c0137e0 con 0x7feda009d860 2023-09-30T22:23:59.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.492+0000 7feda7b2d700 1 -- 172.21.15.156:0/1467624503 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda0135490 con 0x7feda009d860 2023-09-30T22:23:59.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.492+0000 7fed967fc700 1 -- 172.21.15.156:0/1467624503 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c013b50 con 0x7feda009d860 2023-09-30T22:23:59.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.492+0000 7feda7b2d700 1 -- 172.21.15.156:0/1467624503 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda0137a10 con 0x7feda009d860 2023-09-30T22:23:59.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.493+0000 7fed967fc700 1 -- 172.21.15.156:0/1467624503 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fed9c013cb0 con 0x7feda009d860 2023-09-30T22:23:59.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.493+0000 7fed967fc700 1 -- 172.21.15.156:0/1467624503 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fed9c03f7b0 con 0x7feda009d860 2023-09-30T22:23:59.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.493+0000 7feda7b2d700 1 -- 172.21.15.156:0/1467624503 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feda004f2a0 con 0x7feda009d860 2023-09-30T22:23:59.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.498+0000 7fed967fc700 1 -- 172.21.15.156:0/1467624503 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fed9c01be10 con 0x7feda009d860 2023-09-30T22:23:59.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.572+0000 7fd9d8fa3700 1 Processor -- start 2023-09-30T22:23:59.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.572+0000 7fd9d8fa3700 1 -- start start 2023-09-30T22:23:59.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.573+0000 7fd9d8fa3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd9d40a0a70 0x7fd9d40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.573+0000 7fd9d8fa3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9d40a1380 0x7fd9d4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.573+0000 7fd9d8fa3700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d409dc00 con 0x7fd9d4133f50 2023-09-30T22:23:59.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.573+0000 7fd9d8fa3700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d409ea60 con 0x7fd9d40a0a70 2023-09-30T22:23:59.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.573+0000 7fd9d8fa3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d409dec0 con 0x7fd9d40a1380 2023-09-30T22:23:59.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.573+0000 7fd9d2d9d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fd9d4133f50 0x7fd9d413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49224/0 (socket says 172.21.15.156:49224) 2023-09-30T22:23:59.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.573+0000 7fd9d259c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd9d40a0a70 0x7fd9d40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:59.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.573+0000 7fd9d1d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9d40a1380 0x7fd9d4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:59.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.573+0000 7fd9d2d9d700 1 -- 172.21.15.156:0/2394583575 learned_addr learned my addr 172.21.15.156:0/2394583575 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:23:59.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.573+0000 7fd9d259c700 1 -- 172.21.15.156:0/2394583575 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9d40a1380 msgr2=0x7fd9d4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:59.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.573+0000 7fd9d259c700 1 --2- 172.21.15.156:0/2394583575 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9d40a1380 0x7fd9d4133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.573+0000 7fd9d259c700 1 -- 172.21.15.156:0/2394583575 >> v1:172.21.15.156:6789/0 conn(0x7fd9d4133f50 legacy=0x7fd9d413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:59.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.573+0000 7fd9d259c700 1 -- 172.21.15.156:0/2394583575 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d409e6a0 con 0x7fd9d40a0a70 2023-09-30T22:23:59.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.573+0000 7fd9d159a700 1 -- 172.21.15.156:0/2394583575 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1213139102 0 0) 0x7fd9d409dc00 con 0x7fd9d4133f50 2023-09-30T22:23:59.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.573+0000 7fd9d1d9b700 1 --2- 172.21.15.156:0/2394583575 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9d40a1380 0x7fd9d4133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:59.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.573+0000 7fd9d259c700 1 --2- 172.21.15.156:0/2394583575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9d40a0a70 0x7fd9d40a0e40 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4009840 tx=0x7fd9c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6faae4d5ba812100 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:59.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.573+0000 7fd9d159a700 1 -- 172.21.15.156:0/2394583575 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4011830 con 0x7fd9d40a0a70 2023-09-30T22:23:59.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.574+0000 7fd9d159a700 1 -- 172.21.15.156:0/2394583575 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c4011990 con 0x7fd9d40a0a70 2023-09-30T22:23:59.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.574+0000 7fd9d159a700 1 -- 172.21.15.156:0/2394583575 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4011d20 con 0x7fd9d40a0a70 2023-09-30T22:23:59.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.574+0000 7fd9d8fa3700 1 -- 172.21.15.156:0/2394583575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9d40a0a70 msgr2=0x7fd9d40a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:59.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.574+0000 7fd9d8fa3700 1 --2- 172.21.15.156:0/2394583575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9d40a0a70 0x7fd9d40a0e40 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4009840 tx=0x7fd9c4009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:59.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.574+0000 7fd9d8fa3700 1 -- 172.21.15.156:0/2394583575 shutdown_connections 2023-09-30T22:23:59.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.574+0000 7fd9d8fa3700 1 --2- 172.21.15.156:0/2394583575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9d40a0a70 0x7fd9d40a0e40 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.574+0000 7fd9d8fa3700 1 --2- 172.21.15.156:0/2394583575 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9d40a1380 0x7fd9d4133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.574+0000 7fd9d8fa3700 1 -- 172.21.15.156:0/2394583575 >> 172.21.15.156:0/2394583575 conn(0x7fd9d40a6610 msgr2=0x7fd9d40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:59.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.575+0000 7fd9d8fa3700 1 -- 172.21.15.156:0/2394583575 shutdown_connections 2023-09-30T22:23:59.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.575+0000 7fd9d8fa3700 1 -- 172.21.15.156:0/2394583575 wait complete. 2023-09-30T22:23:59.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.576+0000 7fd9d8fa3700 1 Processor -- start 2023-09-30T22:23:59.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.576+0000 7fd9d8fa3700 1 -- start start 2023-09-30T22:23:59.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.577+0000 7fd9d8fa3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9d40a0a70 0x7fd9d4122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.577+0000 7fd9d8fa3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9d40a1380 0x7fd9d4122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.577+0000 7fd9d8fa3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd9d4133f50 0x7fd9d41232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.577+0000 7fd9d8fa3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d4133ad0 con 0x7fd9d40a1380 2023-09-30T22:23:59.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.577+0000 7fd9d8fa3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d4125de0 con 0x7fd9d40a0a70 2023-09-30T22:23:59.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.577+0000 7fd9d8fa3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d4124510 con 0x7fd9d4133f50 2023-09-30T22:23:59.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.577+0000 7fd9d259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9d40a0a70 0x7fd9d4122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:59.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.577+0000 7fd9d259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9d40a0a70 0x7fd9d4122860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46326/0 (socket says 172.21.15.156:46326) 2023-09-30T22:23:59.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.577+0000 7fd9d259c700 1 -- 172.21.15.156:0/905319534 learned_addr learned my addr 172.21.15.156:0/905319534 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:59.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.577+0000 7fd9d2d9d700 1 --2- 172.21.15.156:0/905319534 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd9d4133f50 0x7fd9d41232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:59.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.577+0000 7fd9d1d9b700 1 --2- 172.21.15.156:0/905319534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9d40a1380 0x7fd9d4122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:59.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.577+0000 7fd9d259c700 1 -- 172.21.15.156:0/905319534 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd9d4133f50 msgr2=0x7fd9d41232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:59.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.577+0000 7fd9d259c700 1 --2- 172.21.15.156:0/905319534 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd9d4133f50 0x7fd9d41232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.577+0000 7fd9d259c700 1 -- 172.21.15.156:0/905319534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9d40a1380 msgr2=0x7fd9d4122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:59.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.577+0000 7fd9d259c700 1 --2- 172.21.15.156:0/905319534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9d40a1380 0x7fd9d4122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.577+0000 7fd9d259c700 1 -- 172.21.15.156:0/905319534 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c80094a0 con 0x7fd9d40a0a70 2023-09-30T22:23:59.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.577+0000 7fd9d259c700 1 --2- 172.21.15.156:0/905319534 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9d40a0a70 0x7fd9d4122860 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd9c40090b0 tx=0x7fd9c4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:59.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.578+0000 7fd9c2ffd700 1 -- 172.21.15.156:0/905319534 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4004400 con 0x7fd9d40a0a70 2023-09-30T22:23:59.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.578+0000 7fd9c2ffd700 1 -- 172.21.15.156:0/905319534 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c401f070 con 0x7fd9d40a0a70 2023-09-30T22:23:59.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.578+0000 7fd9c2ffd700 1 -- 172.21.15.156:0/905319534 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c40038e0 con 0x7fd9d40a0a70 2023-09-30T22:23:59.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.578+0000 7fd9d8fa3700 1 -- 172.21.15.156:0/905319534 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c40094a0 con 0x7fd9d40a0a70 2023-09-30T22:23:59.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.578+0000 7fd9d8fa3700 1 -- 172.21.15.156:0/905319534 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d4133380 con 0x7fd9d40a0a70 2023-09-30T22:23:59.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.579+0000 7fd9c2ffd700 1 -- 172.21.15.156:0/905319534 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd9c4021030 con 0x7fd9d40a0a70 2023-09-30T22:23:59.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.579+0000 7fd9d8fa3700 1 -- 172.21.15.156:0/905319534 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d404f2a0 con 0x7fd9d40a0a70 2023-09-30T22:23:59.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.579+0000 7fd9c2ffd700 1 -- 172.21.15.156:0/905319534 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd9c4040810 con 0x7fd9d40a0a70 2023-09-30T22:23:59.583 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.583+0000 7fd9c2ffd700 1 -- 172.21.15.156:0/905319534 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd9c40199a0 con 0x7fd9d40a0a70 2023-09-30T22:23:59.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.621+0000 7f50fbfc1700 1 Processor -- start 2023-09-30T22:23:59.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.622+0000 7f50fbfc1700 1 -- start start 2023-09-30T22:23:59.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.622+0000 7f50fbfc1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f50f409e950 0x7f50f409ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.622+0000 7f50fbfc1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50f409f260 0x7f50f4137ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.622+0000 7f50fbfc1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50f41381e0 0x7f50f413a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.622+0000 7f50fbfc1700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f40a06c0 con 0x7f50f409e950 2023-09-30T22:23:59.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.622+0000 7f50fbfc1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f409ae90 con 0x7f50f41381e0 2023-09-30T22:23:59.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.622+0000 7f50fbfc1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50f409ac20 con 0x7f50f409f260 2023-09-30T22:23:59.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.622+0000 7f50f9d5d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f50f409e950 0x7f50f409ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:59.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.622+0000 7f50fa55e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50f41381e0 0x7f50f413a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:59.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.622+0000 7f50f955c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50f409f260 0x7f50f4137ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:59.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.622+0000 7f50f9d5d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f50f409e950 0x7f50f409ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44906/0 (socket says 172.21.15.156:44906) 2023-09-30T22:23:59.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.622+0000 7f50f9d5d700 1 -- 172.21.15.156:0/3833495751 learned_addr learned my addr 172.21.15.156:0/3833495751 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:59.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.623+0000 7f50f955c700 1 -- 172.21.15.156:0/3833495751 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50f41381e0 msgr2=0x7f50f413a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:59.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.623+0000 7f50f955c700 1 --2- 172.21.15.156:0/3833495751 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50f41381e0 0x7f50f413a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.623+0000 7f50f955c700 1 -- 172.21.15.156:0/3833495751 >> v2:172.21.15.156:3300/0 conn(0x7f50f409e950 msgr2=0x7f50f409ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:59.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.623+0000 7f50f955c700 1 --2- 172.21.15.156:0/3833495751 >> v2:172.21.15.156:3300/0 conn(0x7f50f409e950 0x7f50f409ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.623+0000 7f50f955c700 1 -- 172.21.15.156:0/3833495751 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f406ba00 con 0x7f50f409f260 2023-09-30T22:23:59.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.623+0000 7f50fa55e700 1 --2- 172.21.15.156:0/3833495751 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50f41381e0 0x7f50f413a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:59.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.623+0000 7f50f955c700 1 --2- 172.21.15.156:0/3833495751 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50f409f260 0x7f50f4137ca0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f50e4009870 tx=0x7f50e4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b91c632708f46957 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:59.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.623+0000 7f50f8d5b700 1 -- 172.21.15.156:0/3833495751 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e4011830 con 0x7f50f409f260 2023-09-30T22:23:59.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.623+0000 7f50f8d5b700 1 -- 172.21.15.156:0/3833495751 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e4011990 con 0x7f50f409f260 2023-09-30T22:23:59.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.623+0000 7f50f8d5b700 1 -- 172.21.15.156:0/3833495751 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e4011d20 con 0x7f50f409f260 2023-09-30T22:23:59.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.624+0000 7f50fbfc1700 1 -- 172.21.15.156:0/3833495751 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50f409f260 msgr2=0x7f50f4137ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:59.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.624+0000 7f50fbfc1700 1 --2- 172.21.15.156:0/3833495751 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50f409f260 0x7f50f4137ca0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f50e4009870 tx=0x7f50e4009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:59.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.624+0000 7f50fbfc1700 1 -- 172.21.15.156:0/3833495751 shutdown_connections 2023-09-30T22:23:59.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.624+0000 7f50fbfc1700 1 --2- 172.21.15.156:0/3833495751 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50f41381e0 0x7f50f413a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.624+0000 7f50fbfc1700 1 --2- 172.21.15.156:0/3833495751 >> v2:172.21.15.156:3300/0 conn(0x7f50f409e950 0x7f50f409ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.624+0000 7f50fbfc1700 1 --2- 172.21.15.156:0/3833495751 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50f409f260 0x7f50f4137ca0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.624+0000 7f50fbfc1700 1 -- 172.21.15.156:0/3833495751 >> 172.21.15.156:0/3833495751 conn(0x7f50f40a0f70 msgr2=0x7f50f40a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:59.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.624+0000 7f50fbfc1700 1 -- 172.21.15.156:0/3833495751 shutdown_connections 2023-09-30T22:23:59.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.624+0000 7f50fbfc1700 1 -- 172.21.15.156:0/3833495751 wait complete. 2023-09-30T22:23:59.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.625+0000 7f50fbfc1700 1 Processor -- start 2023-09-30T22:23:59.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.625+0000 7f50fbfc1700 1 -- start start 2023-09-30T22:23:59.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.625+0000 7f50fbfc1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50f409e950 0x7f50f4122a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.625+0000 7f50fbfc1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50f409f260 0x7f50f4122f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.625+0000 7f50fbfc1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50f41381e0 0x7f50f41234b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.625+0000 7f50fbfc1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f4124640 con 0x7f50f41381e0 2023-09-30T22:23:59.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.625+0000 7f50fbfc1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f41379c0 con 0x7f50f409e950 2023-09-30T22:23:59.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.625+0000 7f50fbfc1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50f4126550 con 0x7f50f409f260 2023-09-30T22:23:59.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.625+0000 7f50f9d5d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50f409e950 0x7f50f4122a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:59.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.625+0000 7f50f955c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50f409f260 0x7f50f4122f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:59.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.625+0000 7f50f9d5d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50f409e950 0x7f50f4122a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46340/0 (socket says 172.21.15.156:46340) 2023-09-30T22:23:59.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.625+0000 7f50f9d5d700 1 -- 172.21.15.156:0/4080327126 learned_addr learned my addr 172.21.15.156:0/4080327126 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:23:59.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.625+0000 7f50fa55e700 1 --2- 172.21.15.156:0/4080327126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50f41381e0 0x7f50f41234b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:59.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.625+0000 7f50f955c700 1 -- 172.21.15.156:0/4080327126 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50f409e950 msgr2=0x7f50f4122a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:59.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.625+0000 7f50f955c700 1 --2- 172.21.15.156:0/4080327126 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50f409e950 0x7f50f4122a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.626+0000 7f50f955c700 1 -- 172.21.15.156:0/4080327126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50f41381e0 msgr2=0x7f50f41234b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:59.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.626+0000 7f50f955c700 1 --2- 172.21.15.156:0/4080327126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50f41381e0 0x7f50f41234b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.626+0000 7f50f955c700 1 -- 172.21.15.156:0/4080327126 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ec009a70 con 0x7f50f409f260 2023-09-30T22:23:59.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.626+0000 7f50f9d5d700 1 --2- 172.21.15.156:0/4080327126 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50f409e950 0x7f50f4122a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:59.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.626+0000 7f50f955c700 1 --2- 172.21.15.156:0/4080327126 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50f409f260 0x7f50f4122f70 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f50e4016000 tx=0x7f50e4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:59.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.626+0000 7f50ea7fc700 1 -- 172.21.15.156:0/4080327126 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e4004450 con 0x7f50f409f260 2023-09-30T22:23:59.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.626+0000 7f50ea7fc700 1 -- 172.21.15.156:0/4080327126 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e401f070 con 0x7f50f409f260 2023-09-30T22:23:59.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.626+0000 7f50ea7fc700 1 -- 172.21.15.156:0/4080327126 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e40038c0 con 0x7f50f409f260 2023-09-30T22:23:59.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.626+0000 7f50fbfc1700 1 -- 172.21.15.156:0/4080327126 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e40094a0 con 0x7f50f409f260 2023-09-30T22:23:59.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.626+0000 7f50fbfc1700 1 -- 172.21.15.156:0/4080327126 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f409e290 con 0x7f50f409f260 2023-09-30T22:23:59.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.627+0000 7f50ea7fc700 1 -- 172.21.15.156:0/4080327126 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f50e4003a20 con 0x7f50f409f260 2023-09-30T22:23:59.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.627+0000 7f50ea7fc700 1 -- 172.21.15.156:0/4080327126 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f50e4021070 con 0x7f50f409f260 2023-09-30T22:23:59.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.627+0000 7f50fbfc1700 1 -- 172.21.15.156:0/4080327126 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f404f2a0 con 0x7f50f409f260 2023-09-30T22:23:59.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.632+0000 7f50ea7fc700 1 -- 172.21.15.156:0/4080327126 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f50e4015080 con 0x7f50f409f260 2023-09-30T22:23:59.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.697+0000 7feda7b2d700 1 -- 172.21.15.156:0/1467624503 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7feda006c3b0 con 0x7feda009d860 2023-09-30T22:23:59.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.697+0000 7fed967fc700 1 -- 172.21.15.156:0/1467624503 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fed9c02a090 con 0x7feda009d860 2023-09-30T22:23:59.697 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:23:59.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.700+0000 7feda7b2d700 1 -- 172.21.15.156:0/1467624503 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feda009d860 msgr2=0x7feda012fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:59.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.700+0000 7feda7b2d700 1 --2- 172.21.15.156:0/1467624503 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feda009d860 0x7feda012fbd0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fed9c00e900 tx=0x7fed9c00ec10 comp rx=0 tx=0).stop 2023-09-30T22:23:59.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.700+0000 7feda7b2d700 1 -- 172.21.15.156:0/1467624503 shutdown_connections 2023-09-30T22:23:59.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.700+0000 7feda7b2d700 1 --2- 172.21.15.156:0/1467624503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feda0130ce0 0x7feda0130650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.700+0000 7feda7b2d700 1 --2- 172.21.15.156:0/1467624503 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feda009d860 0x7feda012fbd0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.700+0000 7feda7b2d700 1 --2- 172.21.15.156:0/1467624503 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feda009e170 0x7feda0130110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.700+0000 7feda7b2d700 1 -- 172.21.15.156:0/1467624503 >> 172.21.15.156:0/1467624503 conn(0x7feda0099c40 msgr2=0x7feda01393f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:59.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.700+0000 7feda7b2d700 1 -- 172.21.15.156:0/1467624503 shutdown_connections 2023-09-30T22:23:59.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.700+0000 7feda7b2d700 1 -- 172.21.15.156:0/1467624503 wait complete. 2023-09-30T22:23:59.712 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:23:59.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.807+0000 7fd9d8fa3700 1 -- 172.21.15.156:0/905319534 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd9d4072980 con 0x7fd9d40a0a70 2023-09-30T22:23:59.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.808+0000 7fd9c2ffd700 1 -- 172.21.15.156:0/905319534 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd9c4015070 con 0x7fd9d40a0a70 2023-09-30T22:23:59.808 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:23:59.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.810+0000 7fd9d8fa3700 1 -- 172.21.15.156:0/905319534 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9d40a0a70 msgr2=0x7fd9d4122860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:59.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.810+0000 7fd9d8fa3700 1 --2- 172.21.15.156:0/905319534 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9d40a0a70 0x7fd9d4122860 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd9c40090b0 tx=0x7fd9c4004750 comp rx=0 tx=0).stop 2023-09-30T22:23:59.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.810+0000 7fd9d8fa3700 1 -- 172.21.15.156:0/905319534 shutdown_connections 2023-09-30T22:23:59.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.810+0000 7fd9d8fa3700 1 --2- 172.21.15.156:0/905319534 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd9d4133f50 0x7fd9d41232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.810+0000 7fd9d8fa3700 1 --2- 172.21.15.156:0/905319534 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd9d40a0a70 0x7fd9d4122860 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.810+0000 7fd9d8fa3700 1 --2- 172.21.15.156:0/905319534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9d40a1380 0x7fd9d4122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.810+0000 7fd9d8fa3700 1 -- 172.21.15.156:0/905319534 >> 172.21.15.156:0/905319534 conn(0x7fd9d40a6610 msgr2=0x7fd9d409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:59.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.810+0000 7fd9d8fa3700 1 -- 172.21.15.156:0/905319534 shutdown_connections 2023-09-30T22:23:59.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.810+0000 7fd9d8fa3700 1 -- 172.21.15.156:0/905319534 wait complete. 2023-09-30T22:23:59.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:23:59.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.844+0000 7f50fbfc1700 1 -- 172.21.15.156:0/4080327126 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f50f4126330 con 0x7f50f409f260 2023-09-30T22:23:59.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.845+0000 7f50ea7fc700 1 -- 172.21.15.156:0/4080327126 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f50e402b020 con 0x7f50f409f260 2023-09-30T22:23:59.844 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:23:59.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.847+0000 7f50fbfc1700 1 -- 172.21.15.156:0/4080327126 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50f409f260 msgr2=0x7f50f4122f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:59.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.847+0000 7f50fbfc1700 1 --2- 172.21.15.156:0/4080327126 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50f409f260 0x7f50f4122f70 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f50e4016000 tx=0x7f50e4004750 comp rx=0 tx=0).stop 2023-09-30T22:23:59.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.847+0000 7f50fbfc1700 1 -- 172.21.15.156:0/4080327126 shutdown_connections 2023-09-30T22:23:59.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.847+0000 7f50fbfc1700 1 --2- 172.21.15.156:0/4080327126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50f41381e0 0x7f50f41234b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.847+0000 7f50fbfc1700 1 --2- 172.21.15.156:0/4080327126 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50f409e950 0x7f50f4122a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.847+0000 7f50fbfc1700 1 --2- 172.21.15.156:0/4080327126 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50f409f260 0x7f50f4122f70 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.847+0000 7f50fbfc1700 1 -- 172.21.15.156:0/4080327126 >> 172.21.15.156:0/4080327126 conn(0x7f50f40a0f70 msgr2=0x7f50f4071110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:59.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.847+0000 7f50fbfc1700 1 -- 172.21.15.156:0/4080327126 shutdown_connections 2023-09-30T22:23:59.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:23:59.847+0000 7f50fbfc1700 1 -- 172.21.15.156:0/4080327126 wait complete. 2023-09-30T22:23:59.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:00.403 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:00.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.530+0000 7fc9b99ef700 1 Processor -- start 2023-09-30T22:24:00.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.530+0000 7fc9b99ef700 1 -- start start 2023-09-30T22:24:00.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.531+0000 7fc9b99ef700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc9b409dec0 0x7fc9b406b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.531+0000 7fc9b99ef700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9b4136cb0 0x7fc9b4139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.531+0000 7fc9b99ef700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b406e900 con 0x7fc9b406a770 2023-09-30T22:24:00.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.531+0000 7fc9b99ef700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b409d180 con 0x7fc9b409dec0 2023-09-30T22:24:00.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.531+0000 7fc9b99ef700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b409e780 con 0x7fc9b4136cb0 2023-09-30T22:24:00.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.531+0000 7fc9b37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9b4136cb0 0x7fc9b4139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.531+0000 7fc9b2ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc9b406a770 0x7fc9b406ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49226/0 (socket says 172.21.15.156:49226) 2023-09-30T22:24:00.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.531+0000 7fc9b27fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc9b409dec0 0x7fc9b406b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.531+0000 7fc9b2ffd700 1 -- 172.21.15.156:0/2123930823 learned_addr learned my addr 172.21.15.156:0/2123930823 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:00.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.531+0000 7fc9b37fe700 1 -- 172.21.15.156:0/2123930823 >> v2:172.21.15.156:3300/0 conn(0x7fc9b409dec0 msgr2=0x7fc9b406b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:00.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.531+0000 7fc9b37fe700 1 --2- 172.21.15.156:0/2123930823 >> v2:172.21.15.156:3300/0 conn(0x7fc9b409dec0 0x7fc9b406b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.531+0000 7fc9b37fe700 1 -- 172.21.15.156:0/2123930823 >> v1:172.21.15.156:6789/0 conn(0x7fc9b406a770 legacy=0x7fc9b406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:00.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.531+0000 7fc9b1ffb700 1 -- 172.21.15.156:0/2123930823 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902417274 0 0) 0x7fc9b406e900 con 0x7fc9b406a770 2023-09-30T22:24:00.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.531+0000 7fc9b37fe700 1 -- 172.21.15.156:0/2123930823 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b409d3c0 con 0x7fc9b4136cb0 2023-09-30T22:24:00.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.531+0000 7fc9b27fc700 1 --2- 172.21.15.156:0/2123930823 >> v2:172.21.15.156:3300/0 conn(0x7fc9b409dec0 0x7fc9b406b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:00.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.531+0000 7fc9b37fe700 1 --2- 172.21.15.156:0/2123930823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9b4136cb0 0x7fc9b4139090 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009d90 tx=0x7fc9ac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea4fb1c1830328ea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:00.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.531+0000 7fc9b1ffb700 1 -- 172.21.15.156:0/2123930823 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac00e070 con 0x7fc9b4136cb0 2023-09-30T22:24:00.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.531+0000 7fc9b1ffb700 1 -- 172.21.15.156:0/2123930823 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ac00bb20 con 0x7fc9b4136cb0 2023-09-30T22:24:00.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.531+0000 7fc9b1ffb700 1 -- 172.21.15.156:0/2123930823 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac012430 con 0x7fc9b4136cb0 2023-09-30T22:24:00.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.532+0000 7fc9b99ef700 1 -- 172.21.15.156:0/2123930823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9b4136cb0 msgr2=0x7fc9b4139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:00.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.532+0000 7fc9b99ef700 1 --2- 172.21.15.156:0/2123930823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9b4136cb0 0x7fc9b4139090 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009d90 tx=0x7fc9ac00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:00.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.532+0000 7fc9b99ef700 1 -- 172.21.15.156:0/2123930823 shutdown_connections 2023-09-30T22:24:00.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.532+0000 7fc9b99ef700 1 --2- 172.21.15.156:0/2123930823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9b4136cb0 0x7fc9b4139090 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.532+0000 7fc9b99ef700 1 --2- 172.21.15.156:0/2123930823 >> v2:172.21.15.156:3300/0 conn(0x7fc9b409dec0 0x7fc9b406b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.532+0000 7fc9b99ef700 1 -- 172.21.15.156:0/2123930823 >> 172.21.15.156:0/2123930823 conn(0x7fc9b4099c40 msgr2=0x7fc9b40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:00.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.532+0000 7fc9b99ef700 1 -- 172.21.15.156:0/2123930823 shutdown_connections 2023-09-30T22:24:00.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.532+0000 7fc9b99ef700 1 -- 172.21.15.156:0/2123930823 wait complete. 2023-09-30T22:24:00.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.533+0000 7fc9b99ef700 1 Processor -- start 2023-09-30T22:24:00.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.533+0000 7fc9b99ef700 1 -- start start 2023-09-30T22:24:00.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.533+0000 7fc9b99ef700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9b406a770 0x7fc9b409a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.533+0000 7fc9b99ef700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9b409dec0 0x7fc9b409a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.534+0000 7fc9b99ef700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9b4136cb0 0x7fc9b409af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.534+0000 7fc9b99ef700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b4135360 con 0x7fc9b4136cb0 2023-09-30T22:24:00.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.534+0000 7fc9b99ef700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b41391c0 con 0x7fc9b409dec0 2023-09-30T22:24:00.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.534+0000 7fc9b99ef700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b4135630 con 0x7fc9b406a770 2023-09-30T22:24:00.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.534+0000 7fc9b2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9b406a770 0x7fc9b409a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.534+0000 7fc9b27fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9b409dec0 0x7fc9b409a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.534+0000 7fc9b2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9b406a770 0x7fc9b409a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43062/0 (socket says 172.21.15.156:43062) 2023-09-30T22:24:00.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.534+0000 7fc9b27fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9b409dec0 0x7fc9b409a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46356/0 (socket says 172.21.15.156:46356) 2023-09-30T22:24:00.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.534+0000 7fc9b2ffd700 1 -- 172.21.15.156:0/3363090661 learned_addr learned my addr 172.21.15.156:0/3363090661 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:00.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.534+0000 7fc9b37fe700 1 --2- 172.21.15.156:0/3363090661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9b4136cb0 0x7fc9b409af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.534+0000 7fc9b2ffd700 1 -- 172.21.15.156:0/3363090661 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9b409dec0 msgr2=0x7fc9b409a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:00.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.534+0000 7fc9b2ffd700 1 --2- 172.21.15.156:0/3363090661 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9b409dec0 0x7fc9b409a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.534+0000 7fc9b2ffd700 1 -- 172.21.15.156:0/3363090661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9b4136cb0 msgr2=0x7fc9b409af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:00.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.534+0000 7fc9b2ffd700 1 --2- 172.21.15.156:0/3363090661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9b4136cb0 0x7fc9b409af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.534+0000 7fc9b2ffd700 1 -- 172.21.15.156:0/3363090661 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a40094a0 con 0x7fc9b406a770 2023-09-30T22:24:00.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.534+0000 7fc9b2ffd700 1 --2- 172.21.15.156:0/3363090661 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9b406a770 0x7fc9b409a490 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc9a800c520 tx=0x7fc9a800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:00.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.534+0000 7fc99bfff700 1 -- 172.21.15.156:0/3363090661 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8004c80 con 0x7fc9b406a770 2023-09-30T22:24:00.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.534+0000 7fc99bfff700 1 -- 172.21.15.156:0/3363090661 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a8004e00 con 0x7fc9b406a770 2023-09-30T22:24:00.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.534+0000 7fc9b99ef700 1 -- 172.21.15.156:0/3363090661 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ac009a70 con 0x7fc9b406a770 2023-09-30T22:24:00.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.534+0000 7fc99bfff700 1 -- 172.21.15.156:0/3363090661 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8007310 con 0x7fc9b406a770 2023-09-30T22:24:00.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.534+0000 7fc9b99ef700 1 -- 172.21.15.156:0/3363090661 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b4134f10 con 0x7fc9b406a770 2023-09-30T22:24:00.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.535+0000 7fc99bfff700 1 -- 172.21.15.156:0/3363090661 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc9a8007470 con 0x7fc9b406a770 2023-09-30T22:24:00.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.535+0000 7fc99bfff700 1 -- 172.21.15.156:0/3363090661 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc9a803f310 con 0x7fc9b406a770 2023-09-30T22:24:00.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.535+0000 7fc9b99ef700 1 -- 172.21.15.156:0/3363090661 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b404f2a0 con 0x7fc9b406a770 2023-09-30T22:24:00.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.540+0000 7fc99bfff700 1 -- 172.21.15.156:0/3363090661 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc9a80123b0 con 0x7fc9b406a770 2023-09-30T22:24:00.713 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:00.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.725+0000 7fc9b99ef700 1 -- 172.21.15.156:0/3363090661 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc9b41344b0 con 0x7fc9b406a770 2023-09-30T22:24:00.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.725+0000 7fc99bfff700 1 -- 172.21.15.156:0/3363090661 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc9a8011360 con 0x7fc9b406a770 2023-09-30T22:24:00.725 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:00.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.727+0000 7fc9b99ef700 1 -- 172.21.15.156:0/3363090661 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9b406a770 msgr2=0x7fc9b409a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:00.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.727+0000 7fc9b99ef700 1 --2- 172.21.15.156:0/3363090661 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9b406a770 0x7fc9b409a490 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc9a800c520 tx=0x7fc9a800c830 comp rx=0 tx=0).stop 2023-09-30T22:24:00.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.727+0000 7fc9b99ef700 1 -- 172.21.15.156:0/3363090661 shutdown_connections 2023-09-30T22:24:00.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.727+0000 7fc9b99ef700 1 --2- 172.21.15.156:0/3363090661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9b4136cb0 0x7fc9b409af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.727+0000 7fc9b99ef700 1 --2- 172.21.15.156:0/3363090661 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9b406a770 0x7fc9b409a490 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.727+0000 7fc9b99ef700 1 --2- 172.21.15.156:0/3363090661 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9b409dec0 0x7fc9b409a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.727+0000 7fc9b99ef700 1 -- 172.21.15.156:0/3363090661 >> 172.21.15.156:0/3363090661 conn(0x7fc9b4099c40 msgr2=0x7fc9b40a2800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:00.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.727+0000 7fc9b99ef700 1 -- 172.21.15.156:0/3363090661 shutdown_connections 2023-09-30T22:24:00.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.727+0000 7fc9b99ef700 1 -- 172.21.15.156:0/3363090661 wait complete. 2023-09-30T22:24:00.739 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:00.823 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:00.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.838+0000 7f665bcd0700 1 Processor -- start 2023-09-30T22:24:00.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.839+0000 7f665bcd0700 1 -- start start 2023-09-30T22:24:00.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.839+0000 7f665bcd0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f66540a1570 0x7f6654138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.839+0000 7f665bcd0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66541393c0 0x7f665413b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.839+0000 7f665bcd0700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66540a1fe0 con 0x7f66540a0a90 2023-09-30T22:24:00.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.839+0000 7f665bcd0700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66540a3aa0 con 0x7f66540a1570 2023-09-30T22:24:00.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.839+0000 7f665bcd0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665409a540 con 0x7f66541393c0 2023-09-30T22:24:00.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.839+0000 7f665a26d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66541393c0 0x7f665413b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.839+0000 7f665926b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f66540a1570 0x7f6654138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.839+0000 7f665a26d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66541393c0 0x7f665413b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46364/0 (socket says 172.21.15.156:46364) 2023-09-30T22:24:00.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.839+0000 7f665a26d700 1 -- 172.21.15.156:0/2499379990 learned_addr learned my addr 172.21.15.156:0/2499379990 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:00.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.840+0000 7f665926b700 1 -- 172.21.15.156:0/2499379990 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66541393c0 msgr2=0x7f665413b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:00.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.840+0000 7f665926b700 1 --2- 172.21.15.156:0/2499379990 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66541393c0 0x7f665413b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.840+0000 7f665926b700 1 -- 172.21.15.156:0/2499379990 >> v1:172.21.15.156:6789/0 conn(0x7f66540a0a90 legacy=0x7f66540a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:00.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.840+0000 7f665926b700 1 -- 172.21.15.156:0/2499379990 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665409a280 con 0x7f66540a1570 2023-09-30T22:24:00.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.840+0000 7f6658a6a700 1 -- 172.21.15.156:0/2499379990 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693524497 0 0) 0x7f66540a1fe0 con 0x7f66540a0a90 2023-09-30T22:24:00.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.840+0000 7f665a26d700 1 --2- 172.21.15.156:0/2499379990 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66541393c0 0x7f665413b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:00.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.840+0000 7f665926b700 1 --2- 172.21.15.156:0/2499379990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66540a1570 0x7f6654138e80 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f6644009840 tx=0x7f6644009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc5400fbecf3477 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:00.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.840+0000 7f6658a6a700 1 -- 172.21.15.156:0/2499379990 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6644011830 con 0x7f66540a1570 2023-09-30T22:24:00.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.840+0000 7f6658a6a700 1 -- 172.21.15.156:0/2499379990 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6644011990 con 0x7f66540a1570 2023-09-30T22:24:00.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.840+0000 7f6658a6a700 1 -- 172.21.15.156:0/2499379990 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6644011d20 con 0x7f66540a1570 2023-09-30T22:24:00.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.841+0000 7f665bcd0700 1 -- 172.21.15.156:0/2499379990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66540a1570 msgr2=0x7f6654138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:00.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.841+0000 7f665bcd0700 1 --2- 172.21.15.156:0/2499379990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66540a1570 0x7f6654138e80 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f6644009840 tx=0x7f6644009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:00.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.841+0000 7f665bcd0700 1 -- 172.21.15.156:0/2499379990 shutdown_connections 2023-09-30T22:24:00.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.841+0000 7f665bcd0700 1 --2- 172.21.15.156:0/2499379990 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66541393c0 0x7f665413b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.841+0000 7f665bcd0700 1 --2- 172.21.15.156:0/2499379990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66540a1570 0x7f6654138e80 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.841+0000 7f665bcd0700 1 -- 172.21.15.156:0/2499379990 >> 172.21.15.156:0/2499379990 conn(0x7f6654099c40 msgr2=0x7f665406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:00.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.841+0000 7f665bcd0700 1 -- 172.21.15.156:0/2499379990 shutdown_connections 2023-09-30T22:24:00.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.841+0000 7f665bcd0700 1 -- 172.21.15.156:0/2499379990 wait complete. 2023-09-30T22:24:00.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.842+0000 7f665bcd0700 1 Processor -- start 2023-09-30T22:24:00.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.842+0000 7f665bcd0700 1 -- start start 2023-09-30T22:24:00.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.842+0000 7f665bcd0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f66540a0a90 0x7f66541228e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.842+0000 7f665bcd0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66540a1570 0x7f6654122e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.842+0000 7f665bcd0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66541393c0 0x7f6654123360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.842+0000 7f665bcd0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66541261b0 con 0x7f66540a1570 2023-09-30T22:24:00.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.842+0000 7f665bcd0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6654126f90 con 0x7f66541393c0 2023-09-30T22:24:00.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.842+0000 7f665bcd0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f665409c7e0 con 0x7f66540a0a90 2023-09-30T22:24:00.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.842+0000 7f665926b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66540a1570 0x7f6654122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.842+0000 7f665a26d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66541393c0 0x7f6654123360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.842+0000 7f665926b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66540a1570 0x7f6654122e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44944/0 (socket says 172.21.15.156:44944) 2023-09-30T22:24:00.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.842+0000 7f665a26d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66541393c0 0x7f6654123360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46380/0 (socket says 172.21.15.156:46380) 2023-09-30T22:24:00.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.842+0000 7f665926b700 1 -- 172.21.15.156:0/687431823 learned_addr learned my addr 172.21.15.156:0/687431823 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:00.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.843+0000 7f665a26d700 1 -- 172.21.15.156:0/687431823 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f66540a0a90 msgr2=0x7f66541228e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:00.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.843+0000 7f665a26d700 1 --2- 172.21.15.156:0/687431823 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f66540a0a90 0x7f66541228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.843+0000 7f665a26d700 1 -- 172.21.15.156:0/687431823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66540a1570 msgr2=0x7f6654122e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:00.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.843+0000 7f665a26d700 1 --2- 172.21.15.156:0/687431823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66540a1570 0x7f6654122e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.843+0000 7f665a26d700 1 -- 172.21.15.156:0/687431823 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f664c009b30 con 0x7f66541393c0 2023-09-30T22:24:00.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.843+0000 7f665926b700 1 --2- 172.21.15.156:0/687431823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66540a1570 0x7f6654122e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:00.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.843+0000 7f665a26d700 1 --2- 172.21.15.156:0/687431823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66541393c0 0x7f6654123360 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f664c00efc0 tx=0x7f664c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:00.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.843+0000 7f664a7fc700 1 -- 172.21.15.156:0/687431823 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c018070 con 0x7f66541393c0 2023-09-30T22:24:00.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.843+0000 7f664a7fc700 1 -- 172.21.15.156:0/687431823 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664c00f040 con 0x7f66541393c0 2023-09-30T22:24:00.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.843+0000 7f665bcd0700 1 -- 172.21.15.156:0/687431823 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66440094a0 con 0x7f66541393c0 2023-09-30T22:24:00.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.843+0000 7f664a7fc700 1 -- 172.21.15.156:0/687431823 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c003c60 con 0x7f66541393c0 2023-09-30T22:24:00.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.843+0000 7f665bcd0700 1 -- 172.21.15.156:0/687431823 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f665409b130 con 0x7f66541393c0 2023-09-30T22:24:00.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.844+0000 7f664a7fc700 1 -- 172.21.15.156:0/687431823 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f664c00c930 con 0x7f66541393c0 2023-09-30T22:24:00.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.844+0000 7f665bcd0700 1 -- 172.21.15.156:0/687431823 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f665404f2a0 con 0x7f66541393c0 2023-09-30T22:24:00.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.844+0000 7f664a7fc700 1 -- 172.21.15.156:0/687431823 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f664c03f820 con 0x7f66541393c0 2023-09-30T22:24:00.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.849+0000 7f664a7fc700 1 -- 172.21.15.156:0/687431823 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f664c06d750 con 0x7f66541393c0 2023-09-30T22:24:00.860 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:00.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.962+0000 7fa4f08e1700 1 Processor -- start 2023-09-30T22:24:00.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.962+0000 7fa4f08e1700 1 -- start start 2023-09-30T22:24:00.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.963+0000 7fa4f08e1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4ec0a0a70 0x7fa4ec0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.963+0000 7fa4f08e1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa4ec0a1380 0x7fa4ec133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.963+0000 7fa4f08e1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4ec133f50 0x7fa4ec134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.963+0000 7fa4f08e1700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4ec09e9d0 con 0x7fa4ec0a1380 2023-09-30T22:24:00.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.963+0000 7fa4f08e1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec09dc00 con 0x7fa4ec133f50 2023-09-30T22:24:00.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.963+0000 7fa4f08e1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec09dec0 con 0x7fa4ec0a0a70 2023-09-30T22:24:00.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.963+0000 7fa4e9d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa4ec0a1380 0x7fa4ec133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.963+0000 7fa4ead9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4ec133f50 0x7fa4ec134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.963+0000 7fa4ead9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4ec133f50 0x7fa4ec134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46394/0 (socket says 172.21.15.156:46394) 2023-09-30T22:24:00.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.963+0000 7fa4e9d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa4ec0a1380 0x7fa4ec133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44960/0 (socket says 172.21.15.156:44960) 2023-09-30T22:24:00.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.963+0000 7fa4ead9d700 1 -- 172.21.15.156:0/3379319071 learned_addr learned my addr 172.21.15.156:0/3379319071 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:00.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.963+0000 7fa4ea59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4ec0a0a70 0x7fa4ec0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.964+0000 7fa4ead9d700 1 -- 172.21.15.156:0/3379319071 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4ec0a0a70 msgr2=0x7fa4ec0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:00.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.964+0000 7fa4ead9d700 1 --2- 172.21.15.156:0/3379319071 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4ec0a0a70 0x7fa4ec0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.964+0000 7fa4ead9d700 1 -- 172.21.15.156:0/3379319071 >> v2:172.21.15.156:3300/0 conn(0x7fa4ec0a1380 msgr2=0x7fa4ec133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:00.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.964+0000 7fa4ead9d700 1 --2- 172.21.15.156:0/3379319071 >> v2:172.21.15.156:3300/0 conn(0x7fa4ec0a1380 0x7fa4ec133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.964+0000 7fa4ead9d700 1 -- 172.21.15.156:0/3379319071 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ec09e6a0 con 0x7fa4ec133f50 2023-09-30T22:24:00.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.964+0000 7fa4e9d9b700 1 --2- 172.21.15.156:0/3379319071 >> v2:172.21.15.156:3300/0 conn(0x7fa4ec0a1380 0x7fa4ec133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:00.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.964+0000 7fa4ead9d700 1 --2- 172.21.15.156:0/3379319071 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4ec133f50 0x7fa4ec134380 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4009e50 tx=0x7fa4e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aee17fa1718149c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:00.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.964+0000 7fa4e959a700 1 -- 172.21.15.156:0/3379319071 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e400e070 con 0x7fa4ec133f50 2023-09-30T22:24:00.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.964+0000 7fa4e959a700 1 -- 172.21.15.156:0/3379319071 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e400b910 con 0x7fa4ec133f50 2023-09-30T22:24:00.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.964+0000 7fa4e959a700 1 -- 172.21.15.156:0/3379319071 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e400bcc0 con 0x7fa4ec133f50 2023-09-30T22:24:00.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.964+0000 7fa4f08e1700 1 -- 172.21.15.156:0/3379319071 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4ec133f50 msgr2=0x7fa4ec134380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:00.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.964+0000 7fa4f08e1700 1 --2- 172.21.15.156:0/3379319071 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4ec133f50 0x7fa4ec134380 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4009e50 tx=0x7fa4e400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:00.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.965+0000 7fa4f08e1700 1 -- 172.21.15.156:0/3379319071 shutdown_connections 2023-09-30T22:24:00.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.965+0000 7fa4f08e1700 1 --2- 172.21.15.156:0/3379319071 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4ec133f50 0x7fa4ec134380 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.965+0000 7fa4f08e1700 1 --2- 172.21.15.156:0/3379319071 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4ec0a0a70 0x7fa4ec0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.965+0000 7fa4f08e1700 1 --2- 172.21.15.156:0/3379319071 >> v2:172.21.15.156:3300/0 conn(0x7fa4ec0a1380 0x7fa4ec133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.965+0000 7fa4f08e1700 1 -- 172.21.15.156:0/3379319071 >> 172.21.15.156:0/3379319071 conn(0x7fa4ec0a6610 msgr2=0x7fa4ec0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:00.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.965+0000 7fa4f08e1700 1 -- 172.21.15.156:0/3379319071 shutdown_connections 2023-09-30T22:24:00.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.965+0000 7fa4f08e1700 1 -- 172.21.15.156:0/3379319071 wait complete. 2023-09-30T22:24:00.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.966+0000 7fa4f08e1700 1 Processor -- start 2023-09-30T22:24:00.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.966+0000 7fa4f08e1700 1 -- start start 2023-09-30T22:24:00.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.966+0000 7fa4f08e1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4ec0a0a70 0x7fa4ec122520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.966+0000 7fa4f08e1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4ec0a1380 0x7fa4ec122a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.966+0000 7fa4f08e1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4ec133f50 0x7fa4ec122fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.966+0000 7fa4f08e1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec124a20 con 0x7fa4ec133f50 2023-09-30T22:24:00.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.966+0000 7fa4f08e1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec0a03e0 con 0x7fa4ec0a1380 2023-09-30T22:24:00.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.966+0000 7fa4f08e1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec09d340 con 0x7fa4ec0a0a70 2023-09-30T22:24:00.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.966+0000 7fa4ea59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4ec0a0a70 0x7fa4ec122520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.966+0000 7fa4ead9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4ec133f50 0x7fa4ec122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.966+0000 7fa4ea59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4ec0a0a70 0x7fa4ec122520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43084/0 (socket says 172.21.15.156:43084) 2023-09-30T22:24:00.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.966+0000 7fa4ea59c700 1 -- 172.21.15.156:0/377869943 learned_addr learned my addr 172.21.15.156:0/377869943 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:00.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.966+0000 7fa4ead9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4ec133f50 0x7fa4ec122fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:44964/0 (socket says 172.21.15.156:44964) 2023-09-30T22:24:00.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.966+0000 7fa4e9d9b700 1 --2- 172.21.15.156:0/377869943 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4ec0a1380 0x7fa4ec122a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.967+0000 7fa4ea59c700 1 -- 172.21.15.156:0/377869943 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4ec0a1380 msgr2=0x7fa4ec122a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:00.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.967+0000 7fa4ea59c700 1 --2- 172.21.15.156:0/377869943 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4ec0a1380 0x7fa4ec122a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.967+0000 7fa4ea59c700 1 -- 172.21.15.156:0/377869943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4ec133f50 msgr2=0x7fa4ec122fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:00.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.967+0000 7fa4ea59c700 1 --2- 172.21.15.156:0/377869943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4ec133f50 0x7fa4ec122fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.967+0000 7fa4ea59c700 1 -- 172.21.15.156:0/377869943 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e00094a0 con 0x7fa4ec0a0a70 2023-09-30T22:24:00.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.967+0000 7fa4ead9d700 1 --2- 172.21.15.156:0/377869943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4ec133f50 0x7fa4ec122fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:00.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.967+0000 7fa4ea59c700 1 --2- 172.21.15.156:0/377869943 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4ec0a0a70 0x7fa4ec122520 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc00e8a0 tx=0x7fa4dc00ebb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:00.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.967+0000 7fa4daffd700 1 -- 172.21.15.156:0/377869943 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc013680 con 0x7fa4ec0a0a70 2023-09-30T22:24:00.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.967+0000 7fa4daffd700 1 -- 172.21.15.156:0/377869943 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4dc0137e0 con 0x7fa4ec0a0a70 2023-09-30T22:24:00.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.967+0000 7fa4f08e1700 1 -- 172.21.15.156:0/377869943 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e4009b30 con 0x7fa4ec0a0a70 2023-09-30T22:24:00.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.967+0000 7fa4daffd700 1 -- 172.21.15.156:0/377869943 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc013b90 con 0x7fa4ec0a0a70 2023-09-30T22:24:00.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.967+0000 7fa4f08e1700 1 -- 172.21.15.156:0/377869943 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4ec124fa0 con 0x7fa4ec0a0a70 2023-09-30T22:24:00.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.968+0000 7fa4daffd700 1 -- 172.21.15.156:0/377869943 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa4dc013cf0 con 0x7fa4ec0a0a70 2023-09-30T22:24:00.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.968+0000 7fa4daffd700 1 -- 172.21.15.156:0/377869943 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa4dc03f630 con 0x7fa4ec0a0a70 2023-09-30T22:24:00.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.968+0000 7fa4f08e1700 1 -- 172.21.15.156:0/377869943 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4ec11f760 con 0x7fa4ec0a0a70 2023-09-30T22:24:00.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:00.973+0000 7fa4daffd700 1 -- 172.21.15.156:0/377869943 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4dc01be10 con 0x7fa4ec0a0a70 2023-09-30T22:24:01.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.006+0000 7fa951ddb700 1 Processor -- start 2023-09-30T22:24:01.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.006+0000 7fa951ddb700 1 -- start start 2023-09-30T22:24:01.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.007+0000 7fa951ddb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa94c09e870 0x7fa94c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.007+0000 7fa951ddb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa94c131f40 0x7fa94c139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.007+0000 7fa951ddb700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa94c09c970 con 0x7fa94c09f180 2023-09-30T22:24:01.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.007+0000 7fa951ddb700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa94c0a0920 con 0x7fa94c131f40 2023-09-30T22:24:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.007+0000 7fa951ddb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c09f9c0 con 0x7fa94c09e870 2023-09-30T22:24:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.007+0000 7fa94b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa94c09e870 0x7fa94c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.007+0000 7fa94b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa94c09e870 0x7fa94c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:46416/0 (socket says 172.21.15.156:46416) 2023-09-30T22:24:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.007+0000 7fa94b7fe700 1 -- 172.21.15.156:0/3592429824 learned_addr learned my addr 172.21.15.156:0/3592429824 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.007+0000 7fa94bfff700 1 --2- 172.21.15.156:0/3592429824 >> v2:172.21.15.156:3300/0 conn(0x7fa94c131f40 0x7fa94c139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.007+0000 7fa94b7fe700 1 -- 172.21.15.156:0/3592429824 >> v2:172.21.15.156:3300/0 conn(0x7fa94c131f40 msgr2=0x7fa94c139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.007+0000 7fa94b7fe700 1 --2- 172.21.15.156:0/3592429824 >> v2:172.21.15.156:3300/0 conn(0x7fa94c131f40 0x7fa94c139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.007+0000 7fa94b7fe700 1 -- 172.21.15.156:0/3592429824 >> v1:172.21.15.156:6789/0 conn(0x7fa94c09f180 legacy=0x7fa94c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.007+0000 7fa94b7fe700 1 -- 172.21.15.156:0/3592429824 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94c09bab0 con 0x7fa94c09e870 2023-09-30T22:24:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.007+0000 7fa94b7fe700 1 --2- 172.21.15.156:0/3592429824 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa94c09e870 0x7fa94c09ec40 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa93c0098f0 tx=0x7fa93c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=213b84f4903e3190 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.008+0000 7fa94a7fc700 1 -- 172.21.15.156:0/3592429824 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c011830 con 0x7fa94c09e870 2023-09-30T22:24:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.008+0000 7fa94a7fc700 1 -- 172.21.15.156:0/3592429824 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93c011990 con 0x7fa94c09e870 2023-09-30T22:24:01.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.008+0000 7fa94a7fc700 1 -- 172.21.15.156:0/3592429824 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c011d20 con 0x7fa94c09e870 2023-09-30T22:24:01.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.008+0000 7fa951ddb700 1 -- 172.21.15.156:0/3592429824 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa94c09e870 msgr2=0x7fa94c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.008+0000 7fa951ddb700 1 --2- 172.21.15.156:0/3592429824 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa94c09e870 0x7fa94c09ec40 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa93c0098f0 tx=0x7fa93c009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:01.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.008+0000 7fa951ddb700 1 -- 172.21.15.156:0/3592429824 shutdown_connections 2023-09-30T22:24:01.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.008+0000 7fa951ddb700 1 --2- 172.21.15.156:0/3592429824 >> v2:172.21.15.156:3300/0 conn(0x7fa94c131f40 0x7fa94c139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.008+0000 7fa951ddb700 1 --2- 172.21.15.156:0/3592429824 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa94c09e870 0x7fa94c09ec40 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.008+0000 7fa951ddb700 1 -- 172.21.15.156:0/3592429824 >> 172.21.15.156:0/3592429824 conn(0x7fa94c0a4430 msgr2=0x7fa94c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:01.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.008+0000 7fa951ddb700 1 -- 172.21.15.156:0/3592429824 shutdown_connections 2023-09-30T22:24:01.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.008+0000 7fa951ddb700 1 -- 172.21.15.156:0/3592429824 wait complete. 2023-09-30T22:24:01.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.009+0000 7fa951ddb700 1 Processor -- start 2023-09-30T22:24:01.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.010+0000 7fa951ddb700 1 -- start start 2023-09-30T22:24:01.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.010+0000 7fa951ddb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa94c09e870 0x7fa94c06b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.010+0000 7fa951ddb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa94c09f180 0x7fa94c06bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.010+0000 7fa951ddb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa94c131f40 0x7fa94c06c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.010+0000 7fa951ddb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c06d610 con 0x7fa94c09f180 2023-09-30T22:24:01.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.010+0000 7fa951ddb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c06d420 con 0x7fa94c131f40 2023-09-30T22:24:01.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.010+0000 7fa951ddb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c124bb0 con 0x7fa94c09e870 2023-09-30T22:24:01.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.010+0000 7fa94b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa94c09e870 0x7fa94c06b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.010+0000 7fa94b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa94c09e870 0x7fa94c06b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43086/0 (socket says 172.21.15.156:43086) 2023-09-30T22:24:01.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.010+0000 7fa94b7fe700 1 -- 172.21.15.156:0/2823743365 learned_addr learned my addr 172.21.15.156:0/2823743365 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:01.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.010+0000 7fa94bfff700 1 --2- 172.21.15.156:0/2823743365 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa94c131f40 0x7fa94c06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.010+0000 7fa94affd700 1 --2- 172.21.15.156:0/2823743365 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa94c09f180 0x7fa94c06bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.010+0000 7fa94b7fe700 1 -- 172.21.15.156:0/2823743365 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa94c131f40 msgr2=0x7fa94c06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.010+0000 7fa94b7fe700 1 --2- 172.21.15.156:0/2823743365 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa94c131f40 0x7fa94c06c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.010+0000 7fa94b7fe700 1 -- 172.21.15.156:0/2823743365 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa94c09f180 msgr2=0x7fa94c06bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.010+0000 7fa94b7fe700 1 --2- 172.21.15.156:0/2823743365 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa94c09f180 0x7fa94c06bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.010+0000 7fa94b7fe700 1 -- 172.21.15.156:0/2823743365 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93c009550 con 0x7fa94c09e870 2023-09-30T22:24:01.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.011+0000 7fa94b7fe700 1 --2- 172.21.15.156:0/2823743365 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa94c09e870 0x7fa94c06b880 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa93c014040 tx=0x7fa93c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:01.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.011+0000 7fa933fff700 1 -- 172.21.15.156:0/2823743365 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c004510 con 0x7fa94c09e870 2023-09-30T22:24:01.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.011+0000 7fa933fff700 1 -- 172.21.15.156:0/2823743365 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93c01e070 con 0x7fa94c09e870 2023-09-30T22:24:01.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.011+0000 7fa933fff700 1 -- 172.21.15.156:0/2823743365 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c0038e0 con 0x7fa94c09e870 2023-09-30T22:24:01.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.011+0000 7fa951ddb700 1 -- 172.21.15.156:0/2823743365 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94c125fe0 con 0x7fa94c09e870 2023-09-30T22:24:01.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.011+0000 7fa951ddb700 1 -- 172.21.15.156:0/2823743365 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94c09dba0 con 0x7fa94c09e870 2023-09-30T22:24:01.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.012+0000 7fa951ddb700 1 -- 172.21.15.156:0/2823743365 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa94c04f2a0 con 0x7fa94c09e870 2023-09-30T22:24:01.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.012+0000 7fa933fff700 1 -- 172.21.15.156:0/2823743365 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa93c003a40 con 0x7fa94c09e870 2023-09-30T22:24:01.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.013+0000 7fa933fff700 1 -- 172.21.15.156:0/2823743365 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa93c040b10 con 0x7fa94c09e870 2023-09-30T22:24:01.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.017+0000 7fa933fff700 1 -- 172.21.15.156:0/2823743365 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa93c003cf0 con 0x7fa94c09e870 2023-09-30T22:24:01.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.051+0000 7f665bcd0700 1 -- 172.21.15.156:0/687431823 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6654125d70 con 0x7f66541393c0 2023-09-30T22:24:01.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.052+0000 7f664a7fc700 1 -- 172.21.15.156:0/687431823 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f664c003dc0 con 0x7f66541393c0 2023-09-30T22:24:01.052 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:01.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.055+0000 7f665bcd0700 1 -- 172.21.15.156:0/687431823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66541393c0 msgr2=0x7f6654123360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.055+0000 7f665bcd0700 1 --2- 172.21.15.156:0/687431823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66541393c0 0x7f6654123360 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f664c00efc0 tx=0x7f664c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.055+0000 7f665bcd0700 1 -- 172.21.15.156:0/687431823 shutdown_connections 2023-09-30T22:24:01.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.055+0000 7f665bcd0700 1 --2- 172.21.15.156:0/687431823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66541393c0 0x7f6654123360 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.055+0000 7f665bcd0700 1 --2- 172.21.15.156:0/687431823 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f66540a0a90 0x7f66541228e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.055+0000 7f665bcd0700 1 --2- 172.21.15.156:0/687431823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66540a1570 0x7f6654122e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.055+0000 7f665bcd0700 1 -- 172.21.15.156:0/687431823 >> 172.21.15.156:0/687431823 conn(0x7f6654099c40 msgr2=0x7f665411c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:01.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.055+0000 7f665bcd0700 1 -- 172.21.15.156:0/687431823 shutdown_connections 2023-09-30T22:24:01.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.055+0000 7f665bcd0700 1 -- 172.21.15.156:0/687431823 wait complete. 2023-09-30T22:24:01.072 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:01.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.187+0000 7fa4f08e1700 1 -- 172.21.15.156:0/377869943 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa4ec125e80 con 0x7fa4ec0a0a70 2023-09-30T22:24:01.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.187+0000 7fa4daffd700 1 -- 172.21.15.156:0/377869943 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa4dc02a090 con 0x7fa4ec0a0a70 2023-09-30T22:24:01.187 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:01.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.189+0000 7fa4f08e1700 1 -- 172.21.15.156:0/377869943 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4ec0a0a70 msgr2=0x7fa4ec122520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.189+0000 7fa4f08e1700 1 --2- 172.21.15.156:0/377869943 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4ec0a0a70 0x7fa4ec122520 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc00e8a0 tx=0x7fa4dc00ebb0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.189+0000 7fa4f08e1700 1 -- 172.21.15.156:0/377869943 shutdown_connections 2023-09-30T22:24:01.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.189+0000 7fa4f08e1700 1 --2- 172.21.15.156:0/377869943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4ec133f50 0x7fa4ec122fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.189+0000 7fa4f08e1700 1 --2- 172.21.15.156:0/377869943 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4ec0a0a70 0x7fa4ec122520 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.189+0000 7fa4f08e1700 1 --2- 172.21.15.156:0/377869943 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4ec0a1380 0x7fa4ec122a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.189+0000 7fa4f08e1700 1 -- 172.21.15.156:0/377869943 >> 172.21.15.156:0/377869943 conn(0x7fa4ec0a6610 msgr2=0x7fa4ec11c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:01.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.189+0000 7fa4f08e1700 1 -- 172.21.15.156:0/377869943 shutdown_connections 2023-09-30T22:24:01.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.189+0000 7fa4f08e1700 1 -- 172.21.15.156:0/377869943 wait complete. 2023-09-30T22:24:01.201 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:01.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.209+0000 7fa951ddb700 1 -- 172.21.15.156:0/2823743365 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa94c125d60 con 0x7fa94c09e870 2023-09-30T22:24:01.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.210+0000 7fa933fff700 1 -- 172.21.15.156:0/2823743365 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa93c015030 con 0x7fa94c09e870 2023-09-30T22:24:01.209 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:01.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.212+0000 7fa951ddb700 1 -- 172.21.15.156:0/2823743365 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa94c09e870 msgr2=0x7fa94c06b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.212+0000 7fa951ddb700 1 --2- 172.21.15.156:0/2823743365 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa94c09e870 0x7fa94c06b880 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa93c014040 tx=0x7fa93c004750 comp rx=0 tx=0).stop 2023-09-30T22:24:01.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.212+0000 7fa951ddb700 1 -- 172.21.15.156:0/2823743365 shutdown_connections 2023-09-30T22:24:01.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.212+0000 7fa951ddb700 1 --2- 172.21.15.156:0/2823743365 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa94c131f40 0x7fa94c06c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.212+0000 7fa951ddb700 1 --2- 172.21.15.156:0/2823743365 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa94c09e870 0x7fa94c06b880 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.212+0000 7fa951ddb700 1 --2- 172.21.15.156:0/2823743365 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa94c09f180 0x7fa94c06bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.212+0000 7fa951ddb700 1 -- 172.21.15.156:0/2823743365 >> 172.21.15.156:0/2823743365 conn(0x7fa94c0a4430 msgr2=0x7fa94c11a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:01.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.212+0000 7fa951ddb700 1 -- 172.21.15.156:0/2823743365 shutdown_connections 2023-09-30T22:24:01.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.212+0000 7fa951ddb700 1 -- 172.21.15.156:0/2823743365 wait complete. 2023-09-30T22:24:01.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:01.740 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:01.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.866+0000 7f5c228d1700 1 Processor -- start 2023-09-30T22:24:01.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.866+0000 7f5c228d1700 1 -- start start 2023-09-30T22:24:01.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.867+0000 7f5c228d1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c1c133ad0 0x7f5c1c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.867+0000 7f5c228d1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c1c130bc0 0x7f5c1c13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.867+0000 7f5c228d1700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c1c06b2d0 con 0x7f5c1c1300a0 2023-09-30T22:24:01.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.867+0000 7f5c228d1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c133610 con 0x7f5c1c130bc0 2023-09-30T22:24:01.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.867+0000 7f5c228d1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c09a500 con 0x7f5c1c133ad0 2023-09-30T22:24:01.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.867+0000 7f5c1bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c1c133ad0 0x7f5c1c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.867+0000 7f5c20e6e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c1c130bc0 0x7f5c1c13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.867+0000 7f5c1bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c1c133ad0 0x7f5c1c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44252/0 (socket says 172.21.15.156:44252) 2023-09-30T22:24:01.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.867+0000 7f5c1b7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f5c1c1300a0 0x7f5c1c1304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48656/0 (socket says 172.21.15.156:48656) 2023-09-30T22:24:01.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.867+0000 7f5c1bfff700 1 -- 172.21.15.156:0/1602911961 learned_addr learned my addr 172.21.15.156:0/1602911961 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:01.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.867+0000 7f5c20e6e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c1c130bc0 0x7f5c1c13b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59294/0 (socket says 172.21.15.156:59294) 2023-09-30T22:24:01.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.867+0000 7f5c1affd700 1 -- 172.21.15.156:0/1602911961 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629417178 0 0) 0x7f5c1c06b2d0 con 0x7f5c1c1300a0 2023-09-30T22:24:01.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.867+0000 7f5c20e6e700 1 -- 172.21.15.156:0/1602911961 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c1c133ad0 msgr2=0x7f5c1c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:01.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.867+0000 7f5c20e6e700 1 --2- 172.21.15.156:0/1602911961 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c1c133ad0 0x7f5c1c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.867+0000 7f5c20e6e700 1 -- 172.21.15.156:0/1602911961 >> v1:172.21.15.156:6789/0 conn(0x7f5c1c1300a0 legacy=0x7f5c1c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.867+0000 7f5c20e6e700 1 -- 172.21.15.156:0/1602911961 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c1c1338b0 con 0x7f5c1c130bc0 2023-09-30T22:24:01.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.867+0000 7f5c1bfff700 1 --2- 172.21.15.156:0/1602911961 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c1c133ad0 0x7f5c1c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:01.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.868+0000 7f5c20e6e700 1 --2- 172.21.15.156:0/1602911961 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c1c130bc0 0x7f5c1c13b990 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5c14009dc0 tx=0x7f5c1400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c6bab66efd6f83b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:01.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.868+0000 7f5c1affd700 1 -- 172.21.15.156:0/1602911961 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1400e070 con 0x7f5c1c130bc0 2023-09-30T22:24:01.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.868+0000 7f5c1affd700 1 -- 172.21.15.156:0/1602911961 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c1400bb20 con 0x7f5c1c130bc0 2023-09-30T22:24:01.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.868+0000 7f5c1affd700 1 -- 172.21.15.156:0/1602911961 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c14012430 con 0x7f5c1c130bc0 2023-09-30T22:24:01.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.868+0000 7f5c228d1700 1 -- 172.21.15.156:0/1602911961 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c1c130bc0 msgr2=0x7f5c1c13b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.868+0000 7f5c228d1700 1 --2- 172.21.15.156:0/1602911961 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c1c130bc0 0x7f5c1c13b990 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5c14009dc0 tx=0x7f5c1400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:01.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.868+0000 7f5c228d1700 1 -- 172.21.15.156:0/1602911961 shutdown_connections 2023-09-30T22:24:01.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.868+0000 7f5c228d1700 1 --2- 172.21.15.156:0/1602911961 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c1c130bc0 0x7f5c1c13b990 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.868+0000 7f5c228d1700 1 --2- 172.21.15.156:0/1602911961 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c1c133ad0 0x7f5c1c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.868+0000 7f5c228d1700 1 -- 172.21.15.156:0/1602911961 >> 172.21.15.156:0/1602911961 conn(0x7f5c1c099c40 msgr2=0x7f5c1c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:01.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.868+0000 7f5c228d1700 1 -- 172.21.15.156:0/1602911961 shutdown_connections 2023-09-30T22:24:01.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.868+0000 7f5c228d1700 1 -- 172.21.15.156:0/1602911961 wait complete. 2023-09-30T22:24:01.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.869+0000 7f5c228d1700 1 Processor -- start 2023-09-30T22:24:01.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.869+0000 7f5c228d1700 1 -- start start 2023-09-30T22:24:01.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.870+0000 7f5c228d1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c1c1300a0 0x7f5c1c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.870+0000 7f5c228d1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c1c130bc0 0x7f5c1c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.870+0000 7f5c228d1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c1c133ad0 0x7f5c1c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.870+0000 7f5c228d1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c12d890 con 0x7f5c1c133ad0 2023-09-30T22:24:01.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.870+0000 7f5c228d1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c11fab0 con 0x7f5c1c1300a0 2023-09-30T22:24:01.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.870+0000 7f5c228d1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c120950 con 0x7f5c1c130bc0 2023-09-30T22:24:01.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.870+0000 7f5c1bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c1c1300a0 0x7f5c1c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.870+0000 7f5c1bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c1c1300a0 0x7f5c1c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59300/0 (socket says 172.21.15.156:59300) 2023-09-30T22:24:01.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.870+0000 7f5c1bfff700 1 -- 172.21.15.156:0/2642407536 learned_addr learned my addr 172.21.15.156:0/2642407536 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:01.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.870+0000 7f5c1b7fe700 1 --2- 172.21.15.156:0/2642407536 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c1c130bc0 0x7f5c1c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.870+0000 7f5c20e6e700 1 --2- 172.21.15.156:0/2642407536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c1c133ad0 0x7f5c1c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.870+0000 7f5c1bfff700 1 -- 172.21.15.156:0/2642407536 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c1c130bc0 msgr2=0x7f5c1c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.870+0000 7f5c1bfff700 1 --2- 172.21.15.156:0/2642407536 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c1c130bc0 0x7f5c1c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.870+0000 7f5c1bfff700 1 -- 172.21.15.156:0/2642407536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c1c133ad0 msgr2=0x7f5c1c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.870+0000 7f5c1bfff700 1 --2- 172.21.15.156:0/2642407536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c1c133ad0 0x7f5c1c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.870+0000 7f5c1bfff700 1 -- 172.21.15.156:0/2642407536 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0c009550 con 0x7f5c1c1300a0 2023-09-30T22:24:01.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.870+0000 7f5c1bfff700 1 --2- 172.21.15.156:0/2642407536 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c1c1300a0 0x7f5c1c11da40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00ec10 tx=0x7f5c0c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:01.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.870+0000 7f5c18ff9700 1 -- 172.21.15.156:0/2642407536 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c00c850 con 0x7f5c1c1300a0 2023-09-30T22:24:01.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.870+0000 7f5c18ff9700 1 -- 172.21.15.156:0/2642407536 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0c00c9b0 con 0x7f5c1c1300a0 2023-09-30T22:24:01.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.871+0000 7f5c18ff9700 1 -- 172.21.15.156:0/2642407536 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c00cd20 con 0x7f5c1c1300a0 2023-09-30T22:24:01.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.871+0000 7f5c228d1700 1 -- 172.21.15.156:0/2642407536 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c14009a70 con 0x7f5c1c1300a0 2023-09-30T22:24:01.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.871+0000 7f5c228d1700 1 -- 172.21.15.156:0/2642407536 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c1c12dd00 con 0x7f5c1c1300a0 2023-09-30T22:24:01.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.871+0000 7f5c18ff9700 1 -- 172.21.15.156:0/2642407536 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c0c013470 con 0x7f5c1c1300a0 2023-09-30T22:24:01.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.871+0000 7f5c18ff9700 1 -- 172.21.15.156:0/2642407536 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5c0c03f810 con 0x7f5c1c1300a0 2023-09-30T22:24:01.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.872+0000 7f5c228d1700 1 -- 172.21.15.156:0/2642407536 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c1c06be10 con 0x7f5c1c1300a0 2023-09-30T22:24:01.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:01.876+0000 7f5c18ff9700 1 -- 172.21.15.156:0/2642407536 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c0c013720 con 0x7f5c1c1300a0 2023-09-30T22:24:02.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.061+0000 7f5c228d1700 1 -- 172.21.15.156:0/2642407536 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5c1c04f2a0 con 0x7f5c1c1300a0 2023-09-30T22:24:02.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.062+0000 7f5c18ff9700 1 -- 172.21.15.156:0/2642407536 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c0c021030 con 0x7f5c1c1300a0 2023-09-30T22:24:02.062 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:02.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.064+0000 7f5c228d1700 1 -- 172.21.15.156:0/2642407536 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c1c1300a0 msgr2=0x7f5c1c11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.064+0000 7f5c228d1700 1 --2- 172.21.15.156:0/2642407536 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c1c1300a0 0x7f5c1c11da40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00ec10 tx=0x7f5c0c00ef20 comp rx=0 tx=0).stop 2023-09-30T22:24:02.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.064+0000 7f5c228d1700 1 -- 172.21.15.156:0/2642407536 shutdown_connections 2023-09-30T22:24:02.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.064+0000 7f5c228d1700 1 --2- 172.21.15.156:0/2642407536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c1c133ad0 0x7f5c1c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.064+0000 7f5c228d1700 1 --2- 172.21.15.156:0/2642407536 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c1c1300a0 0x7f5c1c11da40 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.064+0000 7f5c228d1700 1 --2- 172.21.15.156:0/2642407536 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c1c130bc0 0x7f5c1c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.064+0000 7f5c228d1700 1 -- 172.21.15.156:0/2642407536 >> 172.21.15.156:0/2642407536 conn(0x7f5c1c099c40 msgr2=0x7f5c1c132bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:02.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.064+0000 7f5c228d1700 1 -- 172.21.15.156:0/2642407536 shutdown_connections 2023-09-30T22:24:02.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.064+0000 7f5c228d1700 1 -- 172.21.15.156:0/2642407536 wait complete. 2023-09-30T22:24:02.073 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:02.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:02.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.196+0000 7f5db1d62700 1 Processor -- start 2023-09-30T22:24:02.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.196+0000 7f5db1d62700 1 -- start start 2023-09-30T22:24:02.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.196+0000 7f5db1d62700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dac09f430 0x7f5dac138c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.196+0000 7f5db1d62700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5dac139190 0x7f5dac13b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.196+0000 7f5db1d62700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dac06caa0 con 0x7f5dac09e950 2023-09-30T22:24:02.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.196+0000 7f5db1d62700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dac09f820 con 0x7f5dac139190 2023-09-30T22:24:02.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.196+0000 7f5db1d62700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac0a00b0 con 0x7f5dac09f430 2023-09-30T22:24:02.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.196+0000 7f5dabfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5dac139190 0x7f5dac13b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.196+0000 7f5daaffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dac09f430 0x7f5dac138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.196+0000 7f5dab7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f5dac09e950 0x7f5dac09ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48662/0 (socket says 172.21.15.156:48662) 2023-09-30T22:24:02.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.196+0000 7f5dabfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5dac139190 0x7f5dac13b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40972/0 (socket says 172.21.15.156:40972) 2023-09-30T22:24:02.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.196+0000 7f5dab7fe700 1 -- 172.21.15.156:0/138668621 learned_addr learned my addr 172.21.15.156:0/138668621 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:02.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.197+0000 7f5daaffd700 1 -- 172.21.15.156:0/138668621 >> v2:172.21.15.156:3300/0 conn(0x7f5dac139190 msgr2=0x7f5dac13b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:02.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.197+0000 7f5daaffd700 1 --2- 172.21.15.156:0/138668621 >> v2:172.21.15.156:3300/0 conn(0x7f5dac139190 0x7f5dac13b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.197+0000 7f5daaffd700 1 -- 172.21.15.156:0/138668621 >> v1:172.21.15.156:6789/0 conn(0x7f5dac09e950 legacy=0x7f5dac09ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.197+0000 7f5daaffd700 1 -- 172.21.15.156:0/138668621 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dac0a0950 con 0x7f5dac09f430 2023-09-30T22:24:02.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.197+0000 7f5daa7fc700 1 -- 172.21.15.156:0/138668621 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054201459 0 0) 0x7f5dac06caa0 con 0x7f5dac09e950 2023-09-30T22:24:02.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.197+0000 7f5dabfff700 1 --2- 172.21.15.156:0/138668621 >> v2:172.21.15.156:3300/0 conn(0x7f5dac139190 0x7f5dac13b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:02.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.197+0000 7f5daaffd700 1 --2- 172.21.15.156:0/138668621 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dac09f430 0x7f5dac138c50 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5da0009820 tx=0x7f5da0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4e6bcee3d6423ba server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:02.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.197+0000 7f5daa7fc700 1 -- 172.21.15.156:0/138668621 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da0005e30 con 0x7f5dac09f430 2023-09-30T22:24:02.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.197+0000 7f5daa7fc700 1 -- 172.21.15.156:0/138668621 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da0006030 con 0x7f5dac09f430 2023-09-30T22:24:02.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.197+0000 7f5daa7fc700 1 -- 172.21.15.156:0/138668621 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da00063c0 con 0x7f5dac09f430 2023-09-30T22:24:02.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.198+0000 7f5db1d62700 1 -- 172.21.15.156:0/138668621 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dac09f430 msgr2=0x7f5dac138c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.198+0000 7f5db1d62700 1 --2- 172.21.15.156:0/138668621 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dac09f430 0x7f5dac138c50 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5da0009820 tx=0x7f5da0009b30 comp rx=0 tx=0).stop 2023-09-30T22:24:02.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.198+0000 7f5db1d62700 1 -- 172.21.15.156:0/138668621 shutdown_connections 2023-09-30T22:24:02.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.198+0000 7f5db1d62700 1 --2- 172.21.15.156:0/138668621 >> v2:172.21.15.156:3300/0 conn(0x7f5dac139190 0x7f5dac13b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.198+0000 7f5db1d62700 1 --2- 172.21.15.156:0/138668621 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dac09f430 0x7f5dac138c50 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.198+0000 7f5db1d62700 1 -- 172.21.15.156:0/138668621 >> 172.21.15.156:0/138668621 conn(0x7f5dac0a4470 msgr2=0x7f5dac0a4870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:02.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.198+0000 7f5db1d62700 1 -- 172.21.15.156:0/138668621 shutdown_connections 2023-09-30T22:24:02.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.198+0000 7f5db1d62700 1 -- 172.21.15.156:0/138668621 wait complete. 2023-09-30T22:24:02.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.199+0000 7f5db1d62700 1 Processor -- start 2023-09-30T22:24:02.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.199+0000 7f5db1d62700 1 -- start start 2023-09-30T22:24:02.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.200+0000 7f5db1d62700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5dac09e950 0x7f5dac1219e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.200+0000 7f5db1d62700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5dac09f430 0x7f5dac121f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.200+0000 7f5db1d62700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dac139190 0x7f5dac122460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.200+0000 7f5db1d62700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac125510 con 0x7f5dac09f430 2023-09-30T22:24:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.200+0000 7f5db1d62700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac06ccc0 con 0x7f5dac139190 2023-09-30T22:24:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.200+0000 7f5db1d62700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac0a15b0 con 0x7f5dac09e950 2023-09-30T22:24:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.200+0000 7f5daaffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5dac09f430 0x7f5dac121f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.200+0000 7f5dabfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dac139190 0x7f5dac122460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.200+0000 7f5dab7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5dac09e950 0x7f5dac1219e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.200+0000 7f5daaffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5dac09f430 0x7f5dac121f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:40986/0 (socket says 172.21.15.156:40986) 2023-09-30T22:24:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.200+0000 7f5daaffd700 1 -- 172.21.15.156:0/2681343910 learned_addr learned my addr 172.21.15.156:0/2681343910 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.200+0000 7f5daaffd700 1 -- 172.21.15.156:0/2681343910 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5dac09e950 msgr2=0x7f5dac1219e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.200+0000 7f5daaffd700 1 --2- 172.21.15.156:0/2681343910 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5dac09e950 0x7f5dac1219e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.200+0000 7f5daaffd700 1 -- 172.21.15.156:0/2681343910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dac139190 msgr2=0x7f5dac122460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.200+0000 7f5daaffd700 1 --2- 172.21.15.156:0/2681343910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dac139190 0x7f5dac122460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.200+0000 7f5daaffd700 1 -- 172.21.15.156:0/2681343910 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da4009a70 con 0x7f5dac09f430 2023-09-30T22:24:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.200+0000 7f5daaffd700 1 --2- 172.21.15.156:0/2681343910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5dac09f430 0x7f5dac121f20 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f5dac06cc30 tx=0x7f5da0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.200+0000 7f5d93fff700 1 -- 172.21.15.156:0/2681343910 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da00068c0 con 0x7f5dac09f430 2023-09-30T22:24:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.200+0000 7f5d93fff700 1 -- 172.21.15.156:0/2681343910 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da0020070 con 0x7f5dac09f430 2023-09-30T22:24:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.200+0000 7f5db1d62700 1 -- 172.21.15.156:0/2681343910 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da0009430 con 0x7f5dac09f430 2023-09-30T22:24:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.200+0000 7f5d93fff700 1 -- 172.21.15.156:0/2681343910 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da0004280 con 0x7f5dac09f430 2023-09-30T22:24:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.200+0000 7f5db1d62700 1 -- 172.21.15.156:0/2681343910 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dac125190 con 0x7f5dac09f430 2023-09-30T22:24:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.201+0000 7f5d93fff700 1 -- 172.21.15.156:0/2681343910 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5da0022030 con 0x7f5dac09f430 2023-09-30T22:24:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.201+0000 7f5d93fff700 1 -- 172.21.15.156:0/2681343910 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5da0040ae0 con 0x7f5dac09f430 2023-09-30T22:24:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.201+0000 7f5db1d62700 1 -- 172.21.15.156:0/2681343910 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dac04f2a0 con 0x7f5dac09f430 2023-09-30T22:24:02.205 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:02.206 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.206+0000 7f5d93fff700 1 -- 172.21.15.156:0/2681343910 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5da002e440 con 0x7f5dac09f430 2023-09-30T22:24:02.224 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:02.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.333+0000 7f6edac72700 1 Processor -- start 2023-09-30T22:24:02.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.333+0000 7f6edac72700 1 -- start start 2023-09-30T22:24:02.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.333+0000 7f6edac72700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ed406a770 0x7f6ed406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.333+0000 7f6edac72700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ed406b080 0x7f6ed41317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.333+0000 7f6edac72700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed409da80 con 0x7f6ed4131cf0 2023-09-30T22:24:02.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.333+0000 7f6edac72700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed409dce0 con 0x7f6ed406b080 2023-09-30T22:24:02.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.333+0000 7f6edac72700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed409eb20 con 0x7f6ed406a770 2023-09-30T22:24:02.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.333+0000 7f6ed8a0e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ed406a770 0x7f6ed406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.333+0000 7f6ed8a0e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ed406a770 0x7f6ed406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44278/0 (socket says 172.21.15.156:44278) 2023-09-30T22:24:02.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.333+0000 7f6ed920f700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6ed4131cf0 0x7f6ed4138c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48664/0 (socket says 172.21.15.156:48664) 2023-09-30T22:24:02.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.333+0000 7f6ed3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ed406b080 0x7f6ed41317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.333+0000 7f6ed8a0e700 1 -- 172.21.15.156:0/3772538869 learned_addr learned my addr 172.21.15.156:0/3772538869 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:02.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.334+0000 7f6ed37fe700 1 -- 172.21.15.156:0/3772538869 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122748849 0 0) 0x7f6ed409da80 con 0x7f6ed4131cf0 2023-09-30T22:24:02.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.334+0000 7f6ed8a0e700 1 -- 172.21.15.156:0/3772538869 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ed406b080 msgr2=0x7f6ed41317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:02.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.334+0000 7f6ed8a0e700 1 --2- 172.21.15.156:0/3772538869 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ed406b080 0x7f6ed41317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.334+0000 7f6ed8a0e700 1 -- 172.21.15.156:0/3772538869 >> v1:172.21.15.156:6789/0 conn(0x7f6ed4131cf0 legacy=0x7f6ed4138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.334+0000 7f6ed8a0e700 1 -- 172.21.15.156:0/3772538869 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed409d860 con 0x7f6ed406a770 2023-09-30T22:24:02.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.334+0000 7f6ed3fff700 1 --2- 172.21.15.156:0/3772538869 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ed406b080 0x7f6ed41317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:02.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.334+0000 7f6ed8a0e700 1 --2- 172.21.15.156:0/3772538869 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ed406a770 0x7f6ed406ab40 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8009950 tx=0x7f6ec8009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5019f22cee6e60c5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:02.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.334+0000 7f6ed37fe700 1 -- 172.21.15.156:0/3772538869 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8011830 con 0x7f6ed406a770 2023-09-30T22:24:02.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.334+0000 7f6ed37fe700 1 -- 172.21.15.156:0/3772538869 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec8011990 con 0x7f6ed406a770 2023-09-30T22:24:02.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.334+0000 7f6ed37fe700 1 -- 172.21.15.156:0/3772538869 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8011d40 con 0x7f6ed406a770 2023-09-30T22:24:02.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.335+0000 7f6edac72700 1 -- 172.21.15.156:0/3772538869 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ed406a770 msgr2=0x7f6ed406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.335+0000 7f6edac72700 1 --2- 172.21.15.156:0/3772538869 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ed406a770 0x7f6ed406ab40 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8009950 tx=0x7f6ec8009c60 comp rx=0 tx=0).stop 2023-09-30T22:24:02.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.335+0000 7f6edac72700 1 -- 172.21.15.156:0/3772538869 shutdown_connections 2023-09-30T22:24:02.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.335+0000 7f6edac72700 1 --2- 172.21.15.156:0/3772538869 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ed406a770 0x7f6ed406ab40 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.335+0000 7f6edac72700 1 --2- 172.21.15.156:0/3772538869 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ed406b080 0x7f6ed41317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.335+0000 7f6edac72700 1 -- 172.21.15.156:0/3772538869 >> 172.21.15.156:0/3772538869 conn(0x7f6ed4099c40 msgr2=0x7f6ed40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:02.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.335+0000 7f6edac72700 1 -- 172.21.15.156:0/3772538869 shutdown_connections 2023-09-30T22:24:02.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.335+0000 7f6edac72700 1 -- 172.21.15.156:0/3772538869 wait complete. 2023-09-30T22:24:02.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.336+0000 7f6edac72700 1 Processor -- start 2023-09-30T22:24:02.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.336+0000 7f6edac72700 1 -- start start 2023-09-30T22:24:02.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.336+0000 7f6edac72700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ed406a770 0x7f6ed41c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.336+0000 7f6edac72700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ed406b080 0x7f6ed41c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.336+0000 7f6edac72700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ed4131cf0 0x7f6ed41c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.336+0000 7f6edac72700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed4071e10 con 0x7f6ed406b080 2023-09-30T22:24:02.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.336+0000 7f6edac72700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed4120480 con 0x7f6ed406a770 2023-09-30T22:24:02.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.336+0000 7f6edac72700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed4120680 con 0x7f6ed4131cf0 2023-09-30T22:24:02.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.337+0000 7f6ed8a0e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ed406a770 0x7f6ed41c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.337+0000 7f6ed8a0e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ed406a770 0x7f6ed41c7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59352/0 (socket says 172.21.15.156:59352) 2023-09-30T22:24:02.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.337+0000 7f6ed8a0e700 1 -- 172.21.15.156:0/1152699181 learned_addr learned my addr 172.21.15.156:0/1152699181 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:02.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.337+0000 7f6ed3fff700 1 --2- 172.21.15.156:0/1152699181 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ed406b080 0x7f6ed41c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.337+0000 7f6ed920f700 1 --2- 172.21.15.156:0/1152699181 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ed4131cf0 0x7f6ed41c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.337+0000 7f6ed8a0e700 1 -- 172.21.15.156:0/1152699181 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ed4131cf0 msgr2=0x7f6ed41c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.337+0000 7f6ed8a0e700 1 --2- 172.21.15.156:0/1152699181 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ed4131cf0 0x7f6ed41c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.337+0000 7f6ed8a0e700 1 -- 172.21.15.156:0/1152699181 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ed406b080 msgr2=0x7f6ed41c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.337+0000 7f6ed8a0e700 1 --2- 172.21.15.156:0/1152699181 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ed406b080 0x7f6ed41c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.337+0000 7f6ed8a0e700 1 -- 172.21.15.156:0/1152699181 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec00094a0 con 0x7f6ed406a770 2023-09-30T22:24:02.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.337+0000 7f6ed8a0e700 1 --2- 172.21.15.156:0/1152699181 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ed406a770 0x7f6ed41c7fa0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8009130 tx=0x7f6ec8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:02.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.337+0000 7f6ed17fa700 1 -- 172.21.15.156:0/1152699181 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec801a840 con 0x7f6ed406a770 2023-09-30T22:24:02.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.337+0000 7f6ed17fa700 1 -- 172.21.15.156:0/1152699181 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec801f070 con 0x7f6ed406a770 2023-09-30T22:24:02.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.337+0000 7f6edac72700 1 -- 172.21.15.156:0/1152699181 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec8009550 con 0x7f6ed406a770 2023-09-30T22:24:02.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.337+0000 7f6ed17fa700 1 -- 172.21.15.156:0/1152699181 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec801abe0 con 0x7f6ed406a770 2023-09-30T22:24:02.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.337+0000 7f6edac72700 1 -- 172.21.15.156:0/1152699181 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed411da90 con 0x7f6ed406a770 2023-09-30T22:24:02.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.338+0000 7f6ed17fa700 1 -- 172.21.15.156:0/1152699181 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6ec801ad40 con 0x7f6ed406a770 2023-09-30T22:24:02.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.338+0000 7f6ed17fa700 1 -- 172.21.15.156:0/1152699181 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6ec8021070 con 0x7f6ed406a770 2023-09-30T22:24:02.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.339+0000 7f6edac72700 1 -- 172.21.15.156:0/1152699181 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ed40717c0 con 0x7f6ed406a770 2023-09-30T22:24:02.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.347+0000 7f6ed17fa700 1 -- 172.21.15.156:0/1152699181 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ec802b080 con 0x7f6ed406a770 2023-09-30T22:24:02.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.376+0000 7fccb036a700 1 Processor -- start 2023-09-30T22:24:02.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.376+0000 7fccb036a700 1 -- start start 2023-09-30T22:24:02.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.377+0000 7fccb036a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcca809d860 0x7fcca809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.377+0000 7fccb036a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcca809e170 0x7fcca81307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.377+0000 7fccb036a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcca8130ce0 0x7fcca8131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.377+0000 7fccb036a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca809aaa0 con 0x7fcca8130ce0 2023-09-30T22:24:02.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.377+0000 7fccb036a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca809f870 con 0x7fcca809d860 2023-09-30T22:24:02.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.377+0000 7fccb036a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcca809b360 con 0x7fcca809e170 2023-09-30T22:24:02.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.377+0000 7fccad905700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcca809e170 0x7fcca81307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.377+0000 7fccae106700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcca809d860 0x7fcca809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.377+0000 7fccad905700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcca809e170 0x7fcca81307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44300/0 (socket says 172.21.15.156:44300) 2023-09-30T22:24:02.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.377+0000 7fccae106700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcca809d860 0x7fcca809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59354/0 (socket says 172.21.15.156:59354) 2023-09-30T22:24:02.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.377+0000 7fccad905700 1 -- 172.21.15.156:0/2024047101 learned_addr learned my addr 172.21.15.156:0/2024047101 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:02.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.377+0000 7fccae907700 1 --2- 172.21.15.156:0/2024047101 >> v2:172.21.15.156:3300/0 conn(0x7fcca8130ce0 0x7fcca8131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.377+0000 7fccad905700 1 -- 172.21.15.156:0/2024047101 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcca809d860 msgr2=0x7fcca809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:02.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.377+0000 7fccad905700 1 --2- 172.21.15.156:0/2024047101 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcca809d860 0x7fcca809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.377+0000 7fccad905700 1 -- 172.21.15.156:0/2024047101 >> v2:172.21.15.156:3300/0 conn(0x7fcca8130ce0 msgr2=0x7fcca8131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:02.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.377+0000 7fccad905700 1 --2- 172.21.15.156:0/2024047101 >> v2:172.21.15.156:3300/0 conn(0x7fcca8130ce0 0x7fcca8131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.377+0000 7fccad905700 1 -- 172.21.15.156:0/2024047101 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca809b620 con 0x7fcca809e170 2023-09-30T22:24:02.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.378+0000 7fccad905700 1 --2- 172.21.15.156:0/2024047101 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcca809e170 0x7fcca81307a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fcc980098f0 tx=0x7fcc98009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f76fd72c4173c84f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:02.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.378+0000 7fccad104700 1 -- 172.21.15.156:0/2024047101 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98011830 con 0x7fcca809e170 2023-09-30T22:24:02.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.378+0000 7fccad104700 1 -- 172.21.15.156:0/2024047101 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc98011990 con 0x7fcca809e170 2023-09-30T22:24:02.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.378+0000 7fccad104700 1 -- 172.21.15.156:0/2024047101 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98011d20 con 0x7fcca809e170 2023-09-30T22:24:02.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.378+0000 7fccb036a700 1 -- 172.21.15.156:0/2024047101 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcca809e170 msgr2=0x7fcca81307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.378+0000 7fccb036a700 1 --2- 172.21.15.156:0/2024047101 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcca809e170 0x7fcca81307a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fcc980098f0 tx=0x7fcc98009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:02.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.378+0000 7fccb036a700 1 -- 172.21.15.156:0/2024047101 shutdown_connections 2023-09-30T22:24:02.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.378+0000 7fccb036a700 1 --2- 172.21.15.156:0/2024047101 >> v2:172.21.15.156:3300/0 conn(0x7fcca8130ce0 0x7fcca8131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.378+0000 7fccb036a700 1 --2- 172.21.15.156:0/2024047101 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcca809d860 0x7fcca809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.378+0000 7fccb036a700 1 --2- 172.21.15.156:0/2024047101 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcca809e170 0x7fcca81307a0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.378+0000 7fccb036a700 1 -- 172.21.15.156:0/2024047101 >> 172.21.15.156:0/2024047101 conn(0x7fcca8099c40 msgr2=0x7fcca80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:02.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.378+0000 7fccb036a700 1 -- 172.21.15.156:0/2024047101 shutdown_connections 2023-09-30T22:24:02.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.378+0000 7fccb036a700 1 -- 172.21.15.156:0/2024047101 wait complete. 2023-09-30T22:24:02.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.380+0000 7fccb036a700 1 Processor -- start 2023-09-30T22:24:02.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.380+0000 7fccb036a700 1 -- start start 2023-09-30T22:24:02.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.380+0000 7fccb036a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcca809d860 0x7fcca811d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.380+0000 7fccb036a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcca809e170 0x7fcca811d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.380+0000 7fccb036a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcca8130ce0 0x7fcca811dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.380+0000 7fccb036a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca8120290 con 0x7fcca8130ce0 2023-09-30T22:24:02.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.380+0000 7fccb036a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca809c8b0 con 0x7fcca809e170 2023-09-30T22:24:02.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.380+0000 7fccb036a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcca80a2360 con 0x7fcca809d860 2023-09-30T22:24:02.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.380+0000 7fccae106700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcca809d860 0x7fcca811d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.380+0000 7fccae106700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcca809d860 0x7fcca811d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44306/0 (socket says 172.21.15.156:44306) 2023-09-30T22:24:02.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.380+0000 7fccae106700 1 -- 172.21.15.156:0/2910690813 learned_addr learned my addr 172.21.15.156:0/2910690813 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:02.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.380+0000 7fccad905700 1 --2- 172.21.15.156:0/2910690813 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcca809e170 0x7fcca811d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.381+0000 7fccae907700 1 --2- 172.21.15.156:0/2910690813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcca8130ce0 0x7fcca811dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.381+0000 7fccad905700 1 -- 172.21.15.156:0/2910690813 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcca809d860 msgr2=0x7fcca811d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.381+0000 7fccad905700 1 --2- 172.21.15.156:0/2910690813 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcca809d860 0x7fcca811d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.381+0000 7fccad905700 1 -- 172.21.15.156:0/2910690813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcca8130ce0 msgr2=0x7fcca811dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.381+0000 7fccad905700 1 --2- 172.21.15.156:0/2910690813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcca8130ce0 0x7fcca811dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.381+0000 7fccad905700 1 -- 172.21.15.156:0/2910690813 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc98009550 con 0x7fcca809e170 2023-09-30T22:24:02.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.381+0000 7fccae907700 1 --2- 172.21.15.156:0/2910690813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcca8130ce0 0x7fcca811dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:02.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.381+0000 7fccad905700 1 --2- 172.21.15.156:0/2910690813 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcca809e170 0x7fcca811d570 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fcc98016000 tx=0x7fcc98004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:02.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.381+0000 7fcc9effd700 1 -- 172.21.15.156:0/2910690813 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98004450 con 0x7fcca809e170 2023-09-30T22:24:02.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.381+0000 7fcc9effd700 1 -- 172.21.15.156:0/2910690813 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc980045b0 con 0x7fcca809e170 2023-09-30T22:24:02.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.381+0000 7fccb036a700 1 -- 172.21.15.156:0/2910690813 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca811ebf0 con 0x7fcca809e170 2023-09-30T22:24:02.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.381+0000 7fcc9effd700 1 -- 172.21.15.156:0/2910690813 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc980038e0 con 0x7fcca809e170 2023-09-30T22:24:02.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.381+0000 7fccb036a700 1 -- 172.21.15.156:0/2910690813 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca8121000 con 0x7fcca809e170 2023-09-30T22:24:02.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.382+0000 7fcc9effd700 1 -- 172.21.15.156:0/2910690813 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcc98021070 con 0x7fcca809e170 2023-09-30T22:24:02.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.382+0000 7fcc9effd700 1 -- 172.21.15.156:0/2910690813 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcc98040ba0 con 0x7fcca809e170 2023-09-30T22:24:02.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.382+0000 7fccb036a700 1 -- 172.21.15.156:0/2910690813 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca81204c0 con 0x7fcca809e170 2023-09-30T22:24:02.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.387+0000 7fcc9effd700 1 -- 172.21.15.156:0/2910690813 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcca81204c0 con 0x7fcca809e170 2023-09-30T22:24:02.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.406+0000 7f5db1d62700 1 -- 172.21.15.156:0/2681343910 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5dac06bb20 con 0x7f5dac09f430 2023-09-30T22:24:02.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.406+0000 7f5d93fff700 1 -- 172.21.15.156:0/2681343910 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5da001b410 con 0x7f5dac09f430 2023-09-30T22:24:02.406 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:02.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.408+0000 7f5db1d62700 1 -- 172.21.15.156:0/2681343910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5dac09f430 msgr2=0x7f5dac121f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.408+0000 7f5db1d62700 1 --2- 172.21.15.156:0/2681343910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5dac09f430 0x7f5dac121f20 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f5dac06cc30 tx=0x7f5da0004750 comp rx=0 tx=0).stop 2023-09-30T22:24:02.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.408+0000 7f5db1d62700 1 -- 172.21.15.156:0/2681343910 shutdown_connections 2023-09-30T22:24:02.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.408+0000 7f5db1d62700 1 --2- 172.21.15.156:0/2681343910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5dac139190 0x7f5dac122460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.408+0000 7f5db1d62700 1 --2- 172.21.15.156:0/2681343910 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5dac09e950 0x7f5dac1219e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.408+0000 7f5db1d62700 1 --2- 172.21.15.156:0/2681343910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5dac09f430 0x7f5dac121f20 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.408+0000 7f5db1d62700 1 -- 172.21.15.156:0/2681343910 >> 172.21.15.156:0/2681343910 conn(0x7f5dac0a4470 msgr2=0x7f5dac071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:02.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.408+0000 7f5db1d62700 1 -- 172.21.15.156:0/2681343910 shutdown_connections 2023-09-30T22:24:02.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.408+0000 7f5db1d62700 1 -- 172.21.15.156:0/2681343910 wait complete. 2023-09-30T22:24:02.420 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:02.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.539+0000 7f6edac72700 1 -- 172.21.15.156:0/1152699181 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6ed404f2a0 con 0x7f6ed406a770 2023-09-30T22:24:02.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.540+0000 7f6ed17fa700 1 -- 172.21.15.156:0/1152699181 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ec8035090 con 0x7f6ed406a770 2023-09-30T22:24:02.539 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:02.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.542+0000 7f6edac72700 1 -- 172.21.15.156:0/1152699181 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ed406a770 msgr2=0x7f6ed41c7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.542+0000 7f6edac72700 1 --2- 172.21.15.156:0/1152699181 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ed406a770 0x7f6ed41c7fa0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8009130 tx=0x7f6ec8004750 comp rx=0 tx=0).stop 2023-09-30T22:24:02.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.542+0000 7f6edac72700 1 -- 172.21.15.156:0/1152699181 shutdown_connections 2023-09-30T22:24:02.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.542+0000 7f6edac72700 1 --2- 172.21.15.156:0/1152699181 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ed4131cf0 0x7f6ed41c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.542+0000 7f6edac72700 1 --2- 172.21.15.156:0/1152699181 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ed406a770 0x7f6ed41c7fa0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.542+0000 7f6edac72700 1 --2- 172.21.15.156:0/1152699181 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ed406b080 0x7f6ed41c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.542+0000 7f6edac72700 1 -- 172.21.15.156:0/1152699181 >> 172.21.15.156:0/1152699181 conn(0x7f6ed4099c40 msgr2=0x7f6ed41bbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:02.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.542+0000 7f6edac72700 1 -- 172.21.15.156:0/1152699181 shutdown_connections 2023-09-30T22:24:02.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.542+0000 7f6edac72700 1 -- 172.21.15.156:0/1152699181 wait complete. 2023-09-30T22:24:02.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:02.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.582+0000 7fccb036a700 1 -- 172.21.15.156:0/2910690813 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcca81204c0 con 0x7fcca809e170 2023-09-30T22:24:02.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.583+0000 7fcc9effd700 1 -- 172.21.15.156:0/2910690813 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcca81204c0 con 0x7fcca809e170 2023-09-30T22:24:02.582 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:02.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.585+0000 7fccb036a700 1 -- 172.21.15.156:0/2910690813 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcca809e170 msgr2=0x7fcca811d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.585+0000 7fccb036a700 1 --2- 172.21.15.156:0/2910690813 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcca809e170 0x7fcca811d570 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fcc98016000 tx=0x7fcc98004750 comp rx=0 tx=0).stop 2023-09-30T22:24:02.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.585+0000 7fccb036a700 1 -- 172.21.15.156:0/2910690813 shutdown_connections 2023-09-30T22:24:02.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.585+0000 7fccb036a700 1 --2- 172.21.15.156:0/2910690813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcca8130ce0 0x7fcca811dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.585+0000 7fccb036a700 1 --2- 172.21.15.156:0/2910690813 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcca809d860 0x7fcca811d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.585+0000 7fccb036a700 1 --2- 172.21.15.156:0/2910690813 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcca809e170 0x7fcca811d570 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.585+0000 7fccb036a700 1 -- 172.21.15.156:0/2910690813 >> 172.21.15.156:0/2910690813 conn(0x7fcca8099c40 msgr2=0x7fcca812ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:02.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.585+0000 7fccb036a700 1 -- 172.21.15.156:0/2910690813 shutdown_connections 2023-09-30T22:24:02.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:02.585+0000 7fccb036a700 1 -- 172.21.15.156:0/2910690813 wait complete. 2023-09-30T22:24:02.596 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:03.077 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:03.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.205+0000 7fc62c50c700 1 Processor -- start 2023-09-30T22:24:03.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.205+0000 7fc62c50c700 1 -- start start 2023-09-30T22:24:03.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.205+0000 7fc62c50c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc624133ad0 0x7fc624133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:03.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.205+0000 7fc62c50c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6241300a0 0x7fc6241304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:03.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.205+0000 7fc62c50c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc6241309f0 0x7fc62413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:03.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.205+0000 7fc62c50c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc62406b2d0 con 0x7fc624133ad0 2023-09-30T22:24:03.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.205+0000 7fc62c50c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc624133610 con 0x7fc6241300a0 2023-09-30T22:24:03.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.205+0000 7fc62c50c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc62409a500 con 0x7fc6241309f0 2023-09-30T22:24:03.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.205+0000 7fc62a2a8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc624133ad0 0x7fc624133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:03.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.205+0000 7fc62aaa9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc6241309f0 0x7fc62413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:03.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.205+0000 7fc629aa7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6241300a0 0x7fc6241304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:03.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.205+0000 7fc62a2a8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc624133ad0 0x7fc624133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41024/0 (socket says 172.21.15.156:41024) 2023-09-30T22:24:03.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.205+0000 7fc629aa7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6241300a0 0x7fc6241304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59370/0 (socket says 172.21.15.156:59370) 2023-09-30T22:24:03.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.205+0000 7fc62a2a8700 1 -- 172.21.15.156:0/1249521765 learned_addr learned my addr 172.21.15.156:0/1249521765 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:03.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.205+0000 7fc62aaa9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc6241309f0 0x7fc62413a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44322/0 (socket says 172.21.15.156:44322) 2023-09-30T22:24:03.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.206+0000 7fc62aaa9700 1 -- 172.21.15.156:0/1249521765 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6241300a0 msgr2=0x7fc6241304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:03.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.206+0000 7fc62aaa9700 1 --2- 172.21.15.156:0/1249521765 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6241300a0 0x7fc6241304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.206+0000 7fc62aaa9700 1 -- 172.21.15.156:0/1249521765 >> v2:172.21.15.156:3300/0 conn(0x7fc624133ad0 msgr2=0x7fc624133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:03.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.206+0000 7fc62aaa9700 1 --2- 172.21.15.156:0/1249521765 >> v2:172.21.15.156:3300/0 conn(0x7fc624133ad0 0x7fc624133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.206+0000 7fc62aaa9700 1 -- 172.21.15.156:0/1249521765 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6241338b0 con 0x7fc6241309f0 2023-09-30T22:24:03.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.206+0000 7fc62a2a8700 1 --2- 172.21.15.156:0/1249521765 >> v2:172.21.15.156:3300/0 conn(0x7fc624133ad0 0x7fc624133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:03.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.206+0000 7fc629aa7700 1 --2- 172.21.15.156:0/1249521765 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6241300a0 0x7fc6241304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:03.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.206+0000 7fc62aaa9700 1 --2- 172.21.15.156:0/1249521765 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc6241309f0 0x7fc62413a980 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc61c009d90 tx=0x7fc61c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74b81c54f3b96f8a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:03.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.206+0000 7fc6292a6700 1 -- 172.21.15.156:0/1249521765 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c00e070 con 0x7fc6241309f0 2023-09-30T22:24:03.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.206+0000 7fc6292a6700 1 -- 172.21.15.156:0/1249521765 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c00bb20 con 0x7fc6241309f0 2023-09-30T22:24:03.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.206+0000 7fc6292a6700 1 -- 172.21.15.156:0/1249521765 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c012430 con 0x7fc6241309f0 2023-09-30T22:24:03.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.206+0000 7fc62c50c700 1 -- 172.21.15.156:0/1249521765 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc6241309f0 msgr2=0x7fc62413a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:03.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.206+0000 7fc62c50c700 1 --2- 172.21.15.156:0/1249521765 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc6241309f0 0x7fc62413a980 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc61c009d90 tx=0x7fc61c00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:03.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.207+0000 7fc62c50c700 1 -- 172.21.15.156:0/1249521765 shutdown_connections 2023-09-30T22:24:03.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.207+0000 7fc62c50c700 1 --2- 172.21.15.156:0/1249521765 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc6241309f0 0x7fc62413a980 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.207+0000 7fc62c50c700 1 --2- 172.21.15.156:0/1249521765 >> v2:172.21.15.156:3300/0 conn(0x7fc624133ad0 0x7fc624133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.207+0000 7fc62c50c700 1 --2- 172.21.15.156:0/1249521765 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6241300a0 0x7fc6241304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.207+0000 7fc62c50c700 1 -- 172.21.15.156:0/1249521765 >> 172.21.15.156:0/1249521765 conn(0x7fc624099c40 msgr2=0x7fc6240a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:03.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.207+0000 7fc62c50c700 1 -- 172.21.15.156:0/1249521765 shutdown_connections 2023-09-30T22:24:03.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.207+0000 7fc62c50c700 1 -- 172.21.15.156:0/1249521765 wait complete. 2023-09-30T22:24:03.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.208+0000 7fc62c50c700 1 Processor -- start 2023-09-30T22:24:03.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.208+0000 7fc62c50c700 1 -- start start 2023-09-30T22:24:03.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.208+0000 7fc62c50c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6241300a0 0x7fc624071320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:03.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.208+0000 7fc62c50c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6241309f0 0x7fc624071860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:03.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.209+0000 7fc62c50c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc624133ad0 0x7fc624071da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:03.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.209+0000 7fc62c50c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240727f0 con 0x7fc6241309f0 2023-09-30T22:24:03.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.209+0000 7fc62c50c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62411ff50 con 0x7fc6241300a0 2023-09-30T22:24:03.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.209+0000 7fc62c50c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc62411eef0 con 0x7fc624133ad0 2023-09-30T22:24:03.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.209+0000 7fc62aaa9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc624133ad0 0x7fc624071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:03.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.209+0000 7fc629aa7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6241309f0 0x7fc624071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:03.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.209+0000 7fc62aaa9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc624133ad0 0x7fc624071da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44332/0 (socket says 172.21.15.156:44332) 2023-09-30T22:24:03.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.209+0000 7fc62aaa9700 1 -- 172.21.15.156:0/593732790 learned_addr learned my addr 172.21.15.156:0/593732790 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:03.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.209+0000 7fc62a2a8700 1 --2- 172.21.15.156:0/593732790 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6241300a0 0x7fc624071320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:03.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.209+0000 7fc62aaa9700 1 -- 172.21.15.156:0/593732790 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6241300a0 msgr2=0x7fc624071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:03.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.209+0000 7fc62aaa9700 1 --2- 172.21.15.156:0/593732790 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6241300a0 0x7fc624071320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.209+0000 7fc62aaa9700 1 -- 172.21.15.156:0/593732790 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6241309f0 msgr2=0x7fc624071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:03.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.209+0000 7fc62aaa9700 1 --2- 172.21.15.156:0/593732790 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6241309f0 0x7fc624071860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.209+0000 7fc62aaa9700 1 -- 172.21.15.156:0/593732790 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6200094a0 con 0x7fc624133ad0 2023-09-30T22:24:03.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.209+0000 7fc629aa7700 1 --2- 172.21.15.156:0/593732790 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6241309f0 0x7fc624071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:03.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.209+0000 7fc62aaa9700 1 --2- 172.21.15.156:0/593732790 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc624133ad0 0x7fc624071da0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fc62409a640 tx=0x7fc61c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:03.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.209+0000 7fc61affd700 1 -- 172.21.15.156:0/593732790 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c012a40 con 0x7fc624133ad0 2023-09-30T22:24:03.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.209+0000 7fc61affd700 1 -- 172.21.15.156:0/593732790 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c020070 con 0x7fc624133ad0 2023-09-30T22:24:03.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.209+0000 7fc62c50c700 1 -- 172.21.15.156:0/593732790 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc614009550 con 0x7fc624133ad0 2023-09-30T22:24:03.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.209+0000 7fc61affd700 1 -- 172.21.15.156:0/593732790 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c012e20 con 0x7fc624133ad0 2023-09-30T22:24:03.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.209+0000 7fc62c50c700 1 -- 172.21.15.156:0/593732790 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc61c009a70 con 0x7fc624133ad0 2023-09-30T22:24:03.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.210+0000 7fc61affd700 1 -- 172.21.15.156:0/593732790 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc61c004040 con 0x7fc624133ad0 2023-09-30T22:24:03.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.210+0000 7fc61affd700 1 -- 172.21.15.156:0/593732790 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc61c022070 con 0x7fc624133ad0 2023-09-30T22:24:03.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.210+0000 7fc62c50c700 1 -- 172.21.15.156:0/593732790 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc62409cb20 con 0x7fc624133ad0 2023-09-30T22:24:03.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.215+0000 7fc61affd700 1 -- 172.21.15.156:0/593732790 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc61c0044d0 con 0x7fc624133ad0 2023-09-30T22:24:03.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.399+0000 7fc62c50c700 1 -- 172.21.15.156:0/593732790 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc62412dd00 con 0x7fc624133ad0 2023-09-30T22:24:03.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.399+0000 7fc61affd700 1 -- 172.21.15.156:0/593732790 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc61c011390 con 0x7fc624133ad0 2023-09-30T22:24:03.399 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:03.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.401+0000 7fc62c50c700 1 -- 172.21.15.156:0/593732790 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc624133ad0 msgr2=0x7fc624071da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:03.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.401+0000 7fc62c50c700 1 --2- 172.21.15.156:0/593732790 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc624133ad0 0x7fc624071da0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fc62409a640 tx=0x7fc61c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.401+0000 7fc62c50c700 1 -- 172.21.15.156:0/593732790 shutdown_connections 2023-09-30T22:24:03.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.401+0000 7fc62c50c700 1 --2- 172.21.15.156:0/593732790 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc624133ad0 0x7fc624071da0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.401+0000 7fc62c50c700 1 --2- 172.21.15.156:0/593732790 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6241300a0 0x7fc624071320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.401+0000 7fc62c50c700 1 --2- 172.21.15.156:0/593732790 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6241309f0 0x7fc624071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.401+0000 7fc62c50c700 1 -- 172.21.15.156:0/593732790 >> 172.21.15.156:0/593732790 conn(0x7fc624099c40 msgr2=0x7fc624132ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:03.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.402+0000 7fc62c50c700 1 -- 172.21.15.156:0/593732790 shutdown_connections 2023-09-30T22:24:03.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.402+0000 7fc62c50c700 1 -- 172.21.15.156:0/593732790 wait complete. 2023-09-30T22:24:03.413 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:03.421 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:03.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.543+0000 7f38b5e46700 1 Processor -- start 2023-09-30T22:24:03.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.543+0000 7f38b5e46700 1 -- start start 2023-09-30T22:24:03.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.543+0000 7f38b5e46700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f38b0131980 0x7f38b0131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:03.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.543+0000 7f38b5e46700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38b009c790 0x7f38b0139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:03.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.543+0000 7f38b5e46700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38b00a1640 con 0x7f38b009bc70 2023-09-30T22:24:03.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.543+0000 7f38b5e46700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38b006eb30 con 0x7f38b0131980 2023-09-30T22:24:03.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.543+0000 7f38b5e46700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b00a22d0 con 0x7f38b009c790 2023-09-30T22:24:03.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.543+0000 7f38af7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f38b0131980 0x7f38b0131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:03.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.543+0000 7f38affff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38b009c790 0x7f38b0139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:03.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.543+0000 7f38aeffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f38b009bc70 0x7f38b009c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48674/0 (socket says 172.21.15.156:48674) 2023-09-30T22:24:03.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.543+0000 7f38aeffd700 1 -- 172.21.15.156:0/2427801770 learned_addr learned my addr 172.21.15.156:0/2427801770 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:03.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.544+0000 7f38af7fe700 1 -- 172.21.15.156:0/2427801770 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38b009c790 msgr2=0x7f38b0139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:03.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.544+0000 7f38af7fe700 1 --2- 172.21.15.156:0/2427801770 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38b009c790 0x7f38b0139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.544+0000 7f38af7fe700 1 -- 172.21.15.156:0/2427801770 >> v1:172.21.15.156:6789/0 conn(0x7f38b009bc70 legacy=0x7f38b009c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:03.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.544+0000 7f38af7fe700 1 -- 172.21.15.156:0/2427801770 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b0131550 con 0x7f38b0131980 2023-09-30T22:24:03.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.544+0000 7f38ae7fc700 1 -- 172.21.15.156:0/2427801770 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 438234171 0 0) 0x7f38b00a1640 con 0x7f38b009bc70 2023-09-30T22:24:03.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.544+0000 7f38affff700 1 --2- 172.21.15.156:0/2427801770 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38b009c790 0x7f38b0139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:03.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.544+0000 7f38af7fe700 1 --2- 172.21.15.156:0/2427801770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38b0131980 0x7f38b0131d50 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f38a0009820 tx=0x7f38a0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43aa9ea65e8219fd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:03.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.544+0000 7f38ae7fc700 1 -- 172.21.15.156:0/2427801770 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0005e30 con 0x7f38b0131980 2023-09-30T22:24:03.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.544+0000 7f38ae7fc700 1 -- 172.21.15.156:0/2427801770 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a0006030 con 0x7f38b0131980 2023-09-30T22:24:03.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.544+0000 7f38ae7fc700 1 -- 172.21.15.156:0/2427801770 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a00063c0 con 0x7f38b0131980 2023-09-30T22:24:03.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.545+0000 7f38b5e46700 1 -- 172.21.15.156:0/2427801770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38b0131980 msgr2=0x7f38b0131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:03.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.545+0000 7f38b5e46700 1 --2- 172.21.15.156:0/2427801770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38b0131980 0x7f38b0131d50 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f38a0009820 tx=0x7f38a0009b30 comp rx=0 tx=0).stop 2023-09-30T22:24:03.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.545+0000 7f38b5e46700 1 -- 172.21.15.156:0/2427801770 shutdown_connections 2023-09-30T22:24:03.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.545+0000 7f38b5e46700 1 --2- 172.21.15.156:0/2427801770 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38b009c790 0x7f38b0139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.545+0000 7f38b5e46700 1 --2- 172.21.15.156:0/2427801770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38b0131980 0x7f38b0131d50 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.545+0000 7f38b5e46700 1 -- 172.21.15.156:0/2427801770 >> 172.21.15.156:0/2427801770 conn(0x7f38b00a2980 msgr2=0x7f38b00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:03.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.545+0000 7f38b5e46700 1 -- 172.21.15.156:0/2427801770 shutdown_connections 2023-09-30T22:24:03.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.545+0000 7f38b5e46700 1 -- 172.21.15.156:0/2427801770 wait complete. 2023-09-30T22:24:03.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.546+0000 7f38b5e46700 1 Processor -- start 2023-09-30T22:24:03.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.546+0000 7f38b5e46700 1 -- start start 2023-09-30T22:24:03.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.546+0000 7f38b5e46700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38b009bc70 0x7f38b011b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:03.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.546+0000 7f38b5e46700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38b009c790 0x7f38b011bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:03.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.546+0000 7f38b5e46700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38b0131980 0x7f38b011c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:03.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.546+0000 7f38b5e46700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b011ee60 con 0x7f38b0131980 2023-09-30T22:24:03.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.546+0000 7f38b5e46700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b0130940 con 0x7f38b009c790 2023-09-30T22:24:03.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.546+0000 7f38b5e46700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38b011d340 con 0x7f38b009bc70 2023-09-30T22:24:03.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.546+0000 7f38aeffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38b009c790 0x7f38b011bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:03.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.546+0000 7f38aeffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38b009c790 0x7f38b011bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59404/0 (socket says 172.21.15.156:59404) 2023-09-30T22:24:03.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.546+0000 7f38affff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38b0131980 0x7f38b011c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:03.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.546+0000 7f38aeffd700 1 -- 172.21.15.156:0/2962896052 learned_addr learned my addr 172.21.15.156:0/2962896052 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:03.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.546+0000 7f38af7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38b009bc70 0x7f38b011b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:03.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.547+0000 7f38aeffd700 1 -- 172.21.15.156:0/2962896052 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38b009bc70 msgr2=0x7f38b011b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:03.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.547+0000 7f38aeffd700 1 --2- 172.21.15.156:0/2962896052 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38b009bc70 0x7f38b011b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.547+0000 7f38aeffd700 1 -- 172.21.15.156:0/2962896052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38b0131980 msgr2=0x7f38b011c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:03.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.547+0000 7f38aeffd700 1 --2- 172.21.15.156:0/2962896052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38b0131980 0x7f38b011c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.547+0000 7f38aeffd700 1 -- 172.21.15.156:0/2962896052 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a8009a70 con 0x7f38b009c790 2023-09-30T22:24:03.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.547+0000 7f38affff700 1 --2- 172.21.15.156:0/2962896052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38b0131980 0x7f38b011c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:03.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.547+0000 7f38aeffd700 1 --2- 172.21.15.156:0/2962896052 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38b009c790 0x7f38b011bcc0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f38a400c550 tx=0x7f38a400c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:03.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.547+0000 7f3897fff700 1 -- 172.21.15.156:0/2962896052 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a4004c80 con 0x7f38b009c790 2023-09-30T22:24:03.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.547+0000 7f3897fff700 1 -- 172.21.15.156:0/2962896052 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a4004e00 con 0x7f38b009c790 2023-09-30T22:24:03.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.547+0000 7f38b5e46700 1 -- 172.21.15.156:0/2962896052 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a0009430 con 0x7f38b009c790 2023-09-30T22:24:03.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.547+0000 7f3897fff700 1 -- 172.21.15.156:0/2962896052 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a4007310 con 0x7f38b009c790 2023-09-30T22:24:03.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.547+0000 7f38b5e46700 1 -- 172.21.15.156:0/2962896052 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b011e480 con 0x7f38b009c790 2023-09-30T22:24:03.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.548+0000 7f3897fff700 1 -- 172.21.15.156:0/2962896052 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f38a4007470 con 0x7f38b009c790 2023-09-30T22:24:03.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.548+0000 7f3897fff700 1 -- 172.21.15.156:0/2962896052 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f38a403f300 con 0x7f38b009c790 2023-09-30T22:24:03.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.548+0000 7f38b5e46700 1 -- 172.21.15.156:0/2962896052 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38b004f2a0 con 0x7f38b009c790 2023-09-30T22:24:03.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.555+0000 7f3897fff700 1 -- 172.21.15.156:0/2962896052 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f38a40123b0 con 0x7f38b009c790 2023-09-30T22:24:03.556 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:03.597 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:03.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.683+0000 7f23eeb59700 1 Processor -- start 2023-09-30T22:24:03.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.683+0000 7f23eeb59700 1 -- start start 2023-09-30T22:24:03.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.683+0000 7f23eeb59700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f23e809ad40 0x7f23e8133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:03.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.683+0000 7f23eeb59700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23e81343d0 0x7f23e80a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:03.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.683+0000 7f23eeb59700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e809b110 con 0x7f23e8133f70 2023-09-30T22:24:03.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.683+0000 7f23eeb59700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e80a3b60 con 0x7f23e809ad40 2023-09-30T22:24:03.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.684+0000 7f23eeb59700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23e8134850 con 0x7f23e81343d0 2023-09-30T22:24:03.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.684+0000 7f23ec8f5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f23e809ad40 0x7f23e8133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:03.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.684+0000 7f23ec8f5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f23e809ad40 0x7f23e8133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41060/0 (socket says 172.21.15.156:41060) 2023-09-30T22:24:03.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.684+0000 7f23ec8f5700 1 -- 172.21.15.156:0/1044165104 learned_addr learned my addr 172.21.15.156:0/1044165104 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:03.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.684+0000 7f23e7fff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f23e8133f70 0x7f23e80a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48690/0 (socket says 172.21.15.156:48690) 2023-09-30T22:24:03.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.684+0000 7f23ed0f6700 1 --2- 172.21.15.156:0/1044165104 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23e81343d0 0x7f23e80a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:03.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.684+0000 7f23e77fe700 1 -- 172.21.15.156:0/1044165104 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3914701073 0 0) 0x7f23e809b110 con 0x7f23e8133f70 2023-09-30T22:24:03.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.684+0000 7f23e77fe700 1 -- 172.21.15.156:0/1044165104 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23d80035b0 con 0x7f23e8133f70 2023-09-30T22:24:03.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.684+0000 7f23ec8f5700 1 -- 172.21.15.156:0/1044165104 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23e81343d0 msgr2=0x7f23e80a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:03.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.684+0000 7f23ec8f5700 1 --2- 172.21.15.156:0/1044165104 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23e81343d0 0x7f23e80a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.684+0000 7f23ec8f5700 1 -- 172.21.15.156:0/1044165104 >> v1:172.21.15.156:6789/0 conn(0x7f23e8133f70 legacy=0x7f23e80a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:03.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.684+0000 7f23ec8f5700 1 -- 172.21.15.156:0/1044165104 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e80a2fa0 con 0x7f23e809ad40 2023-09-30T22:24:03.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.684+0000 7f23ec8f5700 1 --2- 172.21.15.156:0/1044165104 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23e809ad40 0x7f23e8133a30 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f23dc0098f0 tx=0x7f23dc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa6746e81b3e915 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:03.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.684+0000 7f23e77fe700 1 -- 172.21.15.156:0/1044165104 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc011830 con 0x7f23e809ad40 2023-09-30T22:24:03.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.684+0000 7f23e77fe700 1 -- 172.21.15.156:0/1044165104 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23dc011990 con 0x7f23e809ad40 2023-09-30T22:24:03.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.684+0000 7f23e77fe700 1 -- 172.21.15.156:0/1044165104 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc011d20 con 0x7f23e809ad40 2023-09-30T22:24:03.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.685+0000 7f23eeb59700 1 -- 172.21.15.156:0/1044165104 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23e809ad40 msgr2=0x7f23e8133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:03.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.685+0000 7f23eeb59700 1 --2- 172.21.15.156:0/1044165104 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23e809ad40 0x7f23e8133a30 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f23dc0098f0 tx=0x7f23dc009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:03.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.685+0000 7f23eeb59700 1 -- 172.21.15.156:0/1044165104 shutdown_connections 2023-09-30T22:24:03.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.685+0000 7f23eeb59700 1 --2- 172.21.15.156:0/1044165104 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23e809ad40 0x7f23e8133a30 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.685+0000 7f23eeb59700 1 --2- 172.21.15.156:0/1044165104 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23e81343d0 0x7f23e80a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.685+0000 7f23eeb59700 1 -- 172.21.15.156:0/1044165104 >> 172.21.15.156:0/1044165104 conn(0x7f23e8099c40 msgr2=0x7f23e806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:03.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.685+0000 7f23eeb59700 1 -- 172.21.15.156:0/1044165104 shutdown_connections 2023-09-30T22:24:03.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.685+0000 7f23eeb59700 1 -- 172.21.15.156:0/1044165104 wait complete. 2023-09-30T22:24:03.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.686+0000 7f23eeb59700 1 Processor -- start 2023-09-30T22:24:03.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.686+0000 7f23eeb59700 1 -- start start 2023-09-30T22:24:03.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.687+0000 7f23eeb59700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23e809ad40 0x7f23e811f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:03.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.687+0000 7f23eeb59700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23e8133f70 0x7f23e811fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:03.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.687+0000 7f23eeb59700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23e81343d0 0x7f23e81c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:03.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.687+0000 7f23eeb59700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e8122510 con 0x7f23e8133f70 2023-09-30T22:24:03.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.687+0000 7f23eeb59700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e8133580 con 0x7f23e81343d0 2023-09-30T22:24:03.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.687+0000 7f23eeb59700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23e811f0b0 con 0x7f23e809ad40 2023-09-30T22:24:03.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.687+0000 7f23ec8f5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23e809ad40 0x7f23e811f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:03.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.687+0000 7f23ec8f5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23e809ad40 0x7f23e811f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44350/0 (socket says 172.21.15.156:44350) 2023-09-30T22:24:03.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.687+0000 7f23ec8f5700 1 -- 172.21.15.156:0/546010323 learned_addr learned my addr 172.21.15.156:0/546010323 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:03.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.687+0000 7f23ed0f6700 1 --2- 172.21.15.156:0/546010323 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23e81343d0 0x7f23e81c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:03.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.687+0000 7f23e7fff700 1 --2- 172.21.15.156:0/546010323 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23e8133f70 0x7f23e811fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:03.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.687+0000 7f23ec8f5700 1 -- 172.21.15.156:0/546010323 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23e81343d0 msgr2=0x7f23e81c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:03.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.687+0000 7f23ec8f5700 1 --2- 172.21.15.156:0/546010323 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23e81343d0 0x7f23e81c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.687+0000 7f23ec8f5700 1 -- 172.21.15.156:0/546010323 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23e8133f70 msgr2=0x7f23e811fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:03.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.687+0000 7f23ec8f5700 1 --2- 172.21.15.156:0/546010323 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23e8133f70 0x7f23e811fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.687+0000 7f23ec8f5700 1 -- 172.21.15.156:0/546010323 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23dc009550 con 0x7f23e809ad40 2023-09-30T22:24:03.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.687+0000 7f23ec8f5700 1 --2- 172.21.15.156:0/546010323 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23e809ad40 0x7f23e811f550 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f23dc009c40 tx=0x7f23dc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:03.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.687+0000 7f23e57fa700 1 -- 172.21.15.156:0/546010323 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc004300 con 0x7f23e809ad40 2023-09-30T22:24:03.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.688+0000 7f23e57fa700 1 -- 172.21.15.156:0/546010323 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23dc01e070 con 0x7f23e809ad40 2023-09-30T22:24:03.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.688+0000 7f23eeb59700 1 -- 172.21.15.156:0/546010323 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e8122770 con 0x7f23e809ad40 2023-09-30T22:24:03.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.688+0000 7f23e57fa700 1 -- 172.21.15.156:0/546010323 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc0036a0 con 0x7f23e809ad40 2023-09-30T22:24:03.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.688+0000 7f23eeb59700 1 -- 172.21.15.156:0/546010323 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e80a4230 con 0x7f23e809ad40 2023-09-30T22:24:03.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.688+0000 7f23e57fa700 1 -- 172.21.15.156:0/546010323 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f23dc020030 con 0x7f23e809ad40 2023-09-30T22:24:03.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.689+0000 7f23eeb59700 1 -- 172.21.15.156:0/546010323 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e804f2a0 con 0x7f23e809ad40 2023-09-30T22:24:03.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.689+0000 7f23e57fa700 1 -- 172.21.15.156:0/546010323 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f23dc040450 con 0x7f23e809ad40 2023-09-30T22:24:03.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.698+0000 7f23e57fa700 1 -- 172.21.15.156:0/546010323 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23dc00b9b0 con 0x7f23e809ad40 2023-09-30T22:24:03.725 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.725+0000 7fa670a84700 1 Processor -- start 2023-09-30T22:24:03.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.725+0000 7fa670a84700 1 -- start start 2023-09-30T22:24:03.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.726+0000 7fa670a84700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa66c09e950 0x7fa66c09ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:03.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.726+0000 7fa670a84700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa66c09f260 0x7fa66c137ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:03.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.726+0000 7fa670a84700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66c09ac20 con 0x7fa66c1381e0 2023-09-30T22:24:03.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.726+0000 7fa670a84700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa66c0a06c0 con 0x7fa66c09e950 2023-09-30T22:24:03.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.726+0000 7fa670a84700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c09ae90 con 0x7fa66c09f260 2023-09-30T22:24:03.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.726+0000 7fa66a59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa66c09e950 0x7fa66c09ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:03.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.727+0000 7fa66ad9d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fa66c1381e0 0x7fa66c13a5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48700/0 (socket says 172.21.15.156:48700) 2023-09-30T22:24:03.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.727+0000 7fa66a59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa66c09e950 0x7fa66c09ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41084/0 (socket says 172.21.15.156:41084) 2023-09-30T22:24:03.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.727+0000 7fa66ad9d700 1 -- 172.21.15.156:0/538004940 learned_addr learned my addr 172.21.15.156:0/538004940 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:03.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.727+0000 7fa669d9b700 1 --2- 172.21.15.156:0/538004940 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa66c09f260 0x7fa66c137ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:03.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.727+0000 7fa66a59c700 1 -- 172.21.15.156:0/538004940 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa66c09f260 msgr2=0x7fa66c137ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:03.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.727+0000 7fa66a59c700 1 --2- 172.21.15.156:0/538004940 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa66c09f260 0x7fa66c137ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.727+0000 7fa66a59c700 1 -- 172.21.15.156:0/538004940 >> v1:172.21.15.156:6789/0 conn(0x7fa66c1381e0 legacy=0x7fa66c13a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:03.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.727+0000 7fa66a59c700 1 -- 172.21.15.156:0/538004940 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c06ba00 con 0x7fa66c09e950 2023-09-30T22:24:03.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.727+0000 7fa669d9b700 1 --2- 172.21.15.156:0/538004940 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa66c09f260 0x7fa66c137ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:03.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.727+0000 7fa66a59c700 1 --2- 172.21.15.156:0/538004940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa66c09e950 0x7fa66c09ed20 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fa65c009820 tx=0x7fa65c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7646e4b477883b3e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:03.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.727+0000 7fa66959a700 1 -- 172.21.15.156:0/538004940 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c005e30 con 0x7fa66c09e950 2023-09-30T22:24:03.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.727+0000 7fa66959a700 1 -- 172.21.15.156:0/538004940 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65c006030 con 0x7fa66c09e950 2023-09-30T22:24:03.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.727+0000 7fa66959a700 1 -- 172.21.15.156:0/538004940 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c0063c0 con 0x7fa66c09e950 2023-09-30T22:24:03.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.728+0000 7fa670a84700 1 -- 172.21.15.156:0/538004940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa66c09e950 msgr2=0x7fa66c09ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:03.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.728+0000 7fa670a84700 1 --2- 172.21.15.156:0/538004940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa66c09e950 0x7fa66c09ed20 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fa65c009820 tx=0x7fa65c009b30 comp rx=0 tx=0).stop 2023-09-30T22:24:03.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.728+0000 7fa670a84700 1 -- 172.21.15.156:0/538004940 shutdown_connections 2023-09-30T22:24:03.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.728+0000 7fa670a84700 1 --2- 172.21.15.156:0/538004940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa66c09e950 0x7fa66c09ed20 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.728+0000 7fa670a84700 1 --2- 172.21.15.156:0/538004940 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa66c09f260 0x7fa66c137ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.728+0000 7fa670a84700 1 -- 172.21.15.156:0/538004940 >> 172.21.15.156:0/538004940 conn(0x7fa66c0a0f70 msgr2=0x7fa66c0a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:03.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.728+0000 7fa670a84700 1 -- 172.21.15.156:0/538004940 shutdown_connections 2023-09-30T22:24:03.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.728+0000 7fa670a84700 1 -- 172.21.15.156:0/538004940 wait complete. 2023-09-30T22:24:03.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.729+0000 7fa670a84700 1 Processor -- start 2023-09-30T22:24:03.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.729+0000 7fa670a84700 1 -- start start 2023-09-30T22:24:03.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.729+0000 7fa670a84700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa66c09e950 0x7fa66c122b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:03.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.729+0000 7fa670a84700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa66c09f260 0x7fa66c123060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:03.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.729+0000 7fa670a84700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa66c1381e0 0x7fa66c1235a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:03.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.729+0000 7fa670a84700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c123ff0 con 0x7fa66c09e950 2023-09-30T22:24:03.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.729+0000 7fa670a84700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c1265f0 con 0x7fa66c1381e0 2023-09-30T22:24:03.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.729+0000 7fa670a84700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c1246e0 con 0x7fa66c09f260 2023-09-30T22:24:03.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.730+0000 7fa66a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa66c09e950 0x7fa66c122b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:03.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.730+0000 7fa669d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa66c09f260 0x7fa66c123060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:03.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.730+0000 7fa66a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa66c09e950 0x7fa66c122b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41100/0 (socket says 172.21.15.156:41100) 2023-09-30T22:24:03.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.730+0000 7fa66a59c700 1 -- 172.21.15.156:0/447428930 learned_addr learned my addr 172.21.15.156:0/447428930 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:03.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.730+0000 7fa66ad9d700 1 --2- 172.21.15.156:0/447428930 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa66c1381e0 0x7fa66c1235a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:03.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.730+0000 7fa66a59c700 1 -- 172.21.15.156:0/447428930 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa66c09f260 msgr2=0x7fa66c123060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:03.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.730+0000 7fa66a59c700 1 --2- 172.21.15.156:0/447428930 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa66c09f260 0x7fa66c123060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.730+0000 7fa66a59c700 1 -- 172.21.15.156:0/447428930 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa66c1381e0 msgr2=0x7fa66c1235a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:03.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.730+0000 7fa66a59c700 1 --2- 172.21.15.156:0/447428930 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa66c1381e0 0x7fa66c1235a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.730+0000 7fa66a59c700 1 -- 172.21.15.156:0/447428930 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6600094a0 con 0x7fa66c09e950 2023-09-30T22:24:03.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.730+0000 7fa66a59c700 1 --2- 172.21.15.156:0/447428930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa66c09e950 0x7fa66c122b20 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fa66c06d870 tx=0x7fa65c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:03.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.730+0000 7fa65affd700 1 -- 172.21.15.156:0/447428930 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c0061a0 con 0x7fa66c09e950 2023-09-30T22:24:03.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.730+0000 7fa65affd700 1 -- 172.21.15.156:0/447428930 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65c020070 con 0x7fa66c09e950 2023-09-30T22:24:03.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.730+0000 7fa65affd700 1 -- 172.21.15.156:0/447428930 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c006540 con 0x7fa66c09e950 2023-09-30T22:24:03.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.730+0000 7fa670a84700 1 -- 172.21.15.156:0/447428930 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa65c009430 con 0x7fa66c09e950 2023-09-30T22:24:03.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.730+0000 7fa670a84700 1 -- 172.21.15.156:0/447428930 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa66c126050 con 0x7fa66c09e950 2023-09-30T22:24:03.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.731+0000 7fa65affd700 1 -- 172.21.15.156:0/447428930 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa65c022030 con 0x7fa66c09e950 2023-09-30T22:24:03.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.731+0000 7fa65affd700 1 -- 172.21.15.156:0/447428930 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa65c040de0 con 0x7fa66c09e950 2023-09-30T22:24:03.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.732+0000 7fa670a84700 1 -- 172.21.15.156:0/447428930 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa66c04f2a0 con 0x7fa66c09e950 2023-09-30T22:24:03.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.736+0000 7fa65affd700 1 -- 172.21.15.156:0/447428930 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa65c0066a0 con 0x7fa66c09e950 2023-09-30T22:24:03.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.761+0000 7f38b5e46700 1 -- 172.21.15.156:0/2962896052 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f38b006bce0 con 0x7f38b009c790 2023-09-30T22:24:03.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.762+0000 7f3897fff700 1 -- 172.21.15.156:0/2962896052 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f38a4011360 con 0x7f38b009c790 2023-09-30T22:24:03.793 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:03.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.764+0000 7f38b5e46700 1 -- 172.21.15.156:0/2962896052 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38b009c790 msgr2=0x7f38b011bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:03.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.764+0000 7f38b5e46700 1 --2- 172.21.15.156:0/2962896052 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38b009c790 0x7f38b011bcc0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f38a400c550 tx=0x7f38a400c860 comp rx=0 tx=0).stop 2023-09-30T22:24:03.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.764+0000 7f38b5e46700 1 -- 172.21.15.156:0/2962896052 shutdown_connections 2023-09-30T22:24:03.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.764+0000 7f38b5e46700 1 --2- 172.21.15.156:0/2962896052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38b0131980 0x7f38b011c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.764+0000 7f38b5e46700 1 --2- 172.21.15.156:0/2962896052 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38b009bc70 0x7f38b011b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.764+0000 7f38b5e46700 1 --2- 172.21.15.156:0/2962896052 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38b009c790 0x7f38b011bcc0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.764+0000 7f38b5e46700 1 -- 172.21.15.156:0/2962896052 >> 172.21.15.156:0/2962896052 conn(0x7f38b00a2980 msgr2=0x7f38b01b8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:03.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.764+0000 7f38b5e46700 1 -- 172.21.15.156:0/2962896052 shutdown_connections 2023-09-30T22:24:03.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.764+0000 7f38b5e46700 1 -- 172.21.15.156:0/2962896052 wait complete. 2023-09-30T22:24:03.795 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:03.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.893+0000 7f23eeb59700 1 -- 172.21.15.156:0/546010323 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f23e80a4f40 con 0x7f23e809ad40 2023-09-30T22:24:03.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.893+0000 7f23e57fa700 1 -- 172.21.15.156:0/546010323 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f23dc015020 con 0x7f23e809ad40 2023-09-30T22:24:03.893 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:03.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.895+0000 7f23eeb59700 1 -- 172.21.15.156:0/546010323 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23e809ad40 msgr2=0x7f23e811f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:03.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.895+0000 7f23eeb59700 1 --2- 172.21.15.156:0/546010323 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23e809ad40 0x7f23e811f550 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f23dc009c40 tx=0x7f23dc004750 comp rx=0 tx=0).stop 2023-09-30T22:24:03.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.895+0000 7f23eeb59700 1 -- 172.21.15.156:0/546010323 shutdown_connections 2023-09-30T22:24:03.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.895+0000 7f23eeb59700 1 --2- 172.21.15.156:0/546010323 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f23e81343d0 0x7f23e81c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.895+0000 7f23eeb59700 1 --2- 172.21.15.156:0/546010323 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f23e809ad40 0x7f23e811f550 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.895+0000 7f23eeb59700 1 --2- 172.21.15.156:0/546010323 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23e8133f70 0x7f23e811fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.895+0000 7f23eeb59700 1 -- 172.21.15.156:0/546010323 >> 172.21.15.156:0/546010323 conn(0x7f23e8099c40 msgr2=0x7f23e81bbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:03.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.895+0000 7f23eeb59700 1 -- 172.21.15.156:0/546010323 shutdown_connections 2023-09-30T22:24:03.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.895+0000 7f23eeb59700 1 -- 172.21.15.156:0/546010323 wait complete. 2023-09-30T22:24:03.907 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:03.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.929+0000 7fa670a84700 1 -- 172.21.15.156:0/447428930 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa66c09e2d0 con 0x7fa66c09e950 2023-09-30T22:24:03.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.930+0000 7fa65affd700 1 -- 172.21.15.156:0/447428930 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa65c01b410 con 0x7fa66c09e950 2023-09-30T22:24:03.929 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:03.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.932+0000 7fa670a84700 1 -- 172.21.15.156:0/447428930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa66c09e950 msgr2=0x7fa66c122b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:03.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.932+0000 7fa670a84700 1 --2- 172.21.15.156:0/447428930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa66c09e950 0x7fa66c122b20 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fa66c06d870 tx=0x7fa65c004750 comp rx=0 tx=0).stop 2023-09-30T22:24:03.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.932+0000 7fa670a84700 1 -- 172.21.15.156:0/447428930 shutdown_connections 2023-09-30T22:24:03.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.932+0000 7fa670a84700 1 --2- 172.21.15.156:0/447428930 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa66c1381e0 0x7fa66c1235a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.932+0000 7fa670a84700 1 --2- 172.21.15.156:0/447428930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa66c09e950 0x7fa66c122b20 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.932+0000 7fa670a84700 1 --2- 172.21.15.156:0/447428930 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa66c09f260 0x7fa66c123060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.932+0000 7fa670a84700 1 -- 172.21.15.156:0/447428930 >> 172.21.15.156:0/447428930 conn(0x7fa66c0a0f70 msgr2=0x7fa66c09c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:03.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.932+0000 7fa670a84700 1 -- 172.21.15.156:0/447428930 shutdown_connections 2023-09-30T22:24:03.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:03.932+0000 7fa670a84700 1 -- 172.21.15.156:0/447428930 wait complete. 2023-09-30T22:24:03.943 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:04.414 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:04.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.539+0000 7fe76302d700 1 Processor -- start 2023-09-30T22:24:04.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.539+0000 7fe76302d700 1 -- start start 2023-09-30T22:24:04.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.540+0000 7fe76302d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe75c133ad0 0x7fe75c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.540+0000 7fe76302d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe75c130bc0 0x7fe75c13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.540+0000 7fe76302d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe75c06b2d0 con 0x7fe75c1300a0 2023-09-30T22:24:04.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.540+0000 7fe76302d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe75c133610 con 0x7fe75c133ad0 2023-09-30T22:24:04.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.540+0000 7fe76302d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c09a500 con 0x7fe75c130bc0 2023-09-30T22:24:04.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.540+0000 7fe760dc9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe75c133ad0 0x7fe75c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.540+0000 7fe7615ca700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe75c130bc0 0x7fe75c13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.540+0000 7fe75bfff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe75c1300a0 0x7fe75c1304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48716/0 (socket says 172.21.15.156:48716) 2023-09-30T22:24:04.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.540+0000 7fe760dc9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe75c133ad0 0x7fe75c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41116/0 (socket says 172.21.15.156:41116) 2023-09-30T22:24:04.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.540+0000 7fe75bfff700 1 -- 172.21.15.156:0/1234618427 learned_addr learned my addr 172.21.15.156:0/1234618427 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:04.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.540+0000 7fe760dc9700 1 -- 172.21.15.156:0/1234618427 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe75c130bc0 msgr2=0x7fe75c13b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:04.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.540+0000 7fe760dc9700 1 --2- 172.21.15.156:0/1234618427 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe75c130bc0 0x7fe75c13b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.540+0000 7fe760dc9700 1 -- 172.21.15.156:0/1234618427 >> v1:172.21.15.156:6789/0 conn(0x7fe75c1300a0 legacy=0x7fe75c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:04.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.540+0000 7fe760dc9700 1 -- 172.21.15.156:0/1234618427 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75c1338b0 con 0x7fe75c133ad0 2023-09-30T22:24:04.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.540+0000 7fe75b7fe700 1 -- 172.21.15.156:0/1234618427 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 157416200 0 0) 0x7fe75c06b2d0 con 0x7fe75c1300a0 2023-09-30T22:24:04.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.540+0000 7fe7615ca700 1 --2- 172.21.15.156:0/1234618427 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe75c130bc0 0x7fe75c13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:04.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.540+0000 7fe760dc9700 1 --2- 172.21.15.156:0/1234618427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe75c133ad0 0x7fe75c133ea0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fe750009840 tx=0x7fe750009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2774c43c285edf9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:04.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.540+0000 7fe75b7fe700 1 -- 172.21.15.156:0/1234618427 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe750011830 con 0x7fe75c133ad0 2023-09-30T22:24:04.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.541+0000 7fe75b7fe700 1 -- 172.21.15.156:0/1234618427 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe750011990 con 0x7fe75c133ad0 2023-09-30T22:24:04.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.541+0000 7fe75b7fe700 1 -- 172.21.15.156:0/1234618427 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe750011d20 con 0x7fe75c133ad0 2023-09-30T22:24:04.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.541+0000 7fe76302d700 1 -- 172.21.15.156:0/1234618427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe75c133ad0 msgr2=0x7fe75c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:04.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.541+0000 7fe76302d700 1 --2- 172.21.15.156:0/1234618427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe75c133ad0 0x7fe75c133ea0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fe750009840 tx=0x7fe750009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:04.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.541+0000 7fe76302d700 1 -- 172.21.15.156:0/1234618427 shutdown_connections 2023-09-30T22:24:04.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.541+0000 7fe76302d700 1 --2- 172.21.15.156:0/1234618427 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe75c130bc0 0x7fe75c13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.541+0000 7fe76302d700 1 --2- 172.21.15.156:0/1234618427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe75c133ad0 0x7fe75c133ea0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.541+0000 7fe76302d700 1 -- 172.21.15.156:0/1234618427 >> 172.21.15.156:0/1234618427 conn(0x7fe75c099c40 msgr2=0x7fe75c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:04.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.541+0000 7fe76302d700 1 -- 172.21.15.156:0/1234618427 shutdown_connections 2023-09-30T22:24:04.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.541+0000 7fe76302d700 1 -- 172.21.15.156:0/1234618427 wait complete. 2023-09-30T22:24:04.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.542+0000 7fe76302d700 1 Processor -- start 2023-09-30T22:24:04.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.542+0000 7fe76302d700 1 -- start start 2023-09-30T22:24:04.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.543+0000 7fe76302d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe75c1300a0 0x7fe75c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.543+0000 7fe76302d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe75c130bc0 0x7fe75c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.543+0000 7fe76302d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe75c133ad0 0x7fe75c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.543+0000 7fe76302d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c11fd00 con 0x7fe75c130bc0 2023-09-30T22:24:04.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.543+0000 7fe76302d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c12dd00 con 0x7fe75c1300a0 2023-09-30T22:24:04.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.543+0000 7fe76302d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c0720a0 con 0x7fe75c133ad0 2023-09-30T22:24:04.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.543+0000 7fe760dc9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe75c1300a0 0x7fe75c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.543+0000 7fe75bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe75c130bc0 0x7fe75c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.543+0000 7fe760dc9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe75c1300a0 0x7fe75c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59434/0 (socket says 172.21.15.156:59434) 2023-09-30T22:24:04.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.543+0000 7fe760dc9700 1 -- 172.21.15.156:0/1691418640 learned_addr learned my addr 172.21.15.156:0/1691418640 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:04.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.543+0000 7fe7615ca700 1 --2- 172.21.15.156:0/1691418640 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe75c133ad0 0x7fe75c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.543+0000 7fe760dc9700 1 -- 172.21.15.156:0/1691418640 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe75c133ad0 msgr2=0x7fe75c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:04.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.543+0000 7fe760dc9700 1 --2- 172.21.15.156:0/1691418640 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe75c133ad0 0x7fe75c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.543+0000 7fe760dc9700 1 -- 172.21.15.156:0/1691418640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe75c130bc0 msgr2=0x7fe75c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:04.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.543+0000 7fe760dc9700 1 --2- 172.21.15.156:0/1691418640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe75c130bc0 0x7fe75c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.543+0000 7fe760dc9700 1 -- 172.21.15.156:0/1691418640 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe754009a70 con 0x7fe75c1300a0 2023-09-30T22:24:04.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.543+0000 7fe75bfff700 1 --2- 172.21.15.156:0/1691418640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe75c130bc0 0x7fe75c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:04.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.543+0000 7fe760dc9700 1 --2- 172.21.15.156:0/1691418640 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe75c1300a0 0x7fe75c11da40 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fe750009fd0 tx=0x7fe750004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:04.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.543+0000 7fe7597fa700 1 -- 172.21.15.156:0/1691418640 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7500043c0 con 0x7fe75c1300a0 2023-09-30T22:24:04.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.543+0000 7fe7597fa700 1 -- 172.21.15.156:0/1691418640 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75001f070 con 0x7fe75c1300a0 2023-09-30T22:24:04.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.543+0000 7fe76302d700 1 -- 172.21.15.156:0/1691418640 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7500094a0 con 0x7fe75c1300a0 2023-09-30T22:24:04.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.543+0000 7fe7597fa700 1 -- 172.21.15.156:0/1691418640 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7500036a0 con 0x7fe75c1300a0 2023-09-30T22:24:04.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.543+0000 7fe76302d700 1 -- 172.21.15.156:0/1691418640 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75c11ffe0 con 0x7fe75c1300a0 2023-09-30T22:24:04.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.544+0000 7fe7597fa700 1 -- 172.21.15.156:0/1691418640 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe750021030 con 0x7fe75c1300a0 2023-09-30T22:24:04.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.544+0000 7fe7597fa700 1 -- 172.21.15.156:0/1691418640 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe750040790 con 0x7fe75c1300a0 2023-09-30T22:24:04.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.544+0000 7fe76302d700 1 -- 172.21.15.156:0/1691418640 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe75c09cb20 con 0x7fe75c1300a0 2023-09-30T22:24:04.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.549+0000 7fe7597fa700 1 -- 172.21.15.156:0/1691418640 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe7500199a0 con 0x7fe75c1300a0 2023-09-30T22:24:04.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.733+0000 7fe76302d700 1 -- 172.21.15.156:0/1691418640 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe75c04f2a0 con 0x7fe75c1300a0 2023-09-30T22:24:04.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.734+0000 7fe7597fa700 1 -- 172.21.15.156:0/1691418640 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe750015020 con 0x7fe75c1300a0 2023-09-30T22:24:04.734 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:04.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.736+0000 7fe76302d700 1 -- 172.21.15.156:0/1691418640 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe75c1300a0 msgr2=0x7fe75c11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:04.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.736+0000 7fe76302d700 1 --2- 172.21.15.156:0/1691418640 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe75c1300a0 0x7fe75c11da40 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fe750009fd0 tx=0x7fe750004750 comp rx=0 tx=0).stop 2023-09-30T22:24:04.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.736+0000 7fe76302d700 1 -- 172.21.15.156:0/1691418640 shutdown_connections 2023-09-30T22:24:04.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.736+0000 7fe76302d700 1 --2- 172.21.15.156:0/1691418640 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe75c133ad0 0x7fe75c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.736+0000 7fe76302d700 1 --2- 172.21.15.156:0/1691418640 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe75c1300a0 0x7fe75c11da40 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.736+0000 7fe76302d700 1 --2- 172.21.15.156:0/1691418640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe75c130bc0 0x7fe75c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.736+0000 7fe76302d700 1 -- 172.21.15.156:0/1691418640 >> 172.21.15.156:0/1691418640 conn(0x7fe75c099c40 msgr2=0x7fe75c132bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:04.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.736+0000 7fe76302d700 1 -- 172.21.15.156:0/1691418640 shutdown_connections 2023-09-30T22:24:04.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.736+0000 7fe76302d700 1 -- 172.21.15.156:0/1691418640 wait complete. 2023-09-30T22:24:04.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:04.795 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:04.907 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:04.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.918+0000 7ff767130700 1 Processor -- start 2023-09-30T22:24:04.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.918+0000 7ff767130700 1 -- start start 2023-09-30T22:24:04.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.918+0000 7ff767130700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff760133ad0 0x7ff760133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.918+0000 7ff767130700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7601300a0 0x7ff7601304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.918+0000 7ff767130700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff7601309f0 0x7ff76013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.919+0000 7ff767130700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff76006b2d0 con 0x7ff7601309f0 2023-09-30T22:24:04.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.919+0000 7ff767130700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff760133610 con 0x7ff7601300a0 2023-09-30T22:24:04.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.919+0000 7ff767130700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff76009a500 con 0x7ff760133ad0 2023-09-30T22:24:04.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.919+0000 7ff764ecc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff760133ad0 0x7ff760133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.919+0000 7ff7656cd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff7601309f0 0x7ff76013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.919+0000 7ff7656cd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff7601309f0 0x7ff76013a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41140/0 (socket says 172.21.15.156:41140) 2023-09-30T22:24:04.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.919+0000 7ff764ecc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff760133ad0 0x7ff760133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44368/0 (socket says 172.21.15.156:44368) 2023-09-30T22:24:04.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.919+0000 7ff7656cd700 1 -- 172.21.15.156:0/2919325284 learned_addr learned my addr 172.21.15.156:0/2919325284 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:04.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.919+0000 7ff75ffff700 1 --2- 172.21.15.156:0/2919325284 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7601300a0 0x7ff7601304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.919+0000 7ff7656cd700 1 -- 172.21.15.156:0/2919325284 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff760133ad0 msgr2=0x7ff760133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:04.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.919+0000 7ff7656cd700 1 --2- 172.21.15.156:0/2919325284 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff760133ad0 0x7ff760133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.919+0000 7ff7656cd700 1 -- 172.21.15.156:0/2919325284 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7601300a0 msgr2=0x7ff7601304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:04.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.919+0000 7ff7656cd700 1 --2- 172.21.15.156:0/2919325284 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7601300a0 0x7ff7601304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.919+0000 7ff7656cd700 1 -- 172.21.15.156:0/2919325284 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7601338b0 con 0x7ff7601309f0 2023-09-30T22:24:04.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.919+0000 7ff764ecc700 1 --2- 172.21.15.156:0/2919325284 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff760133ad0 0x7ff760133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:04.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.919+0000 7ff75ffff700 1 --2- 172.21.15.156:0/2919325284 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7601300a0 0x7ff7601304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:04.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.919+0000 7ff7656cd700 1 --2- 172.21.15.156:0/2919325284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7601309f0 0x7ff76013a980 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7ff758009e50 tx=0x7ff75800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47dd0c886350c945 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:04.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.919+0000 7ff75f7fe700 1 -- 172.21.15.156:0/2919325284 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75800e070 con 0x7ff7601309f0 2023-09-30T22:24:04.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.919+0000 7ff75f7fe700 1 -- 172.21.15.156:0/2919325284 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75800b910 con 0x7ff7601309f0 2023-09-30T22:24:04.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.919+0000 7ff75f7fe700 1 -- 172.21.15.156:0/2919325284 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75800bcc0 con 0x7ff7601309f0 2023-09-30T22:24:04.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.920+0000 7ff767130700 1 -- 172.21.15.156:0/2919325284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7601309f0 msgr2=0x7ff76013a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:04.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.920+0000 7ff767130700 1 --2- 172.21.15.156:0/2919325284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7601309f0 0x7ff76013a980 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7ff758009e50 tx=0x7ff75800b330 comp rx=0 tx=0).stop 2023-09-30T22:24:04.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.920+0000 7ff767130700 1 -- 172.21.15.156:0/2919325284 shutdown_connections 2023-09-30T22:24:04.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.920+0000 7ff767130700 1 --2- 172.21.15.156:0/2919325284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7601309f0 0x7ff76013a980 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.920+0000 7ff767130700 1 --2- 172.21.15.156:0/2919325284 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff760133ad0 0x7ff760133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.920+0000 7ff767130700 1 --2- 172.21.15.156:0/2919325284 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7601300a0 0x7ff7601304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.920+0000 7ff767130700 1 -- 172.21.15.156:0/2919325284 >> 172.21.15.156:0/2919325284 conn(0x7ff760099c40 msgr2=0x7ff7600a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:04.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.920+0000 7ff767130700 1 -- 172.21.15.156:0/2919325284 shutdown_connections 2023-09-30T22:24:04.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.920+0000 7ff767130700 1 -- 172.21.15.156:0/2919325284 wait complete. 2023-09-30T22:24:04.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.921+0000 7ff767130700 1 Processor -- start 2023-09-30T22:24:04.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.921+0000 7ff767130700 1 -- start start 2023-09-30T22:24:04.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.922+0000 7ff767130700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7601300a0 0x7ff76011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.922+0000 7ff767130700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7601309f0 0x7ff76011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.922+0000 7ff767130700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff760133ad0 0x7ff76011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.922+0000 7ff767130700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7601200c0 con 0x7ff7601309f0 2023-09-30T22:24:04.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.922+0000 7ff767130700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76011f040 con 0x7ff7601300a0 2023-09-30T22:24:04.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.922+0000 7ff767130700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff76011fb20 con 0x7ff760133ad0 2023-09-30T22:24:04.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.922+0000 7ff75ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7601309f0 0x7ff76011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.922+0000 7ff7656cd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff760133ad0 0x7ff76011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.922+0000 7ff75ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7601309f0 0x7ff76011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41150/0 (socket says 172.21.15.156:41150) 2023-09-30T22:24:04.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.922+0000 7ff75ffff700 1 -- 172.21.15.156:0/1689007896 learned_addr learned my addr 172.21.15.156:0/1689007896 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:04.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.922+0000 7ff764ecc700 1 --2- 172.21.15.156:0/1689007896 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7601300a0 0x7ff76011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.922+0000 7ff75ffff700 1 -- 172.21.15.156:0/1689007896 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff760133ad0 msgr2=0x7ff76011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:04.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.922+0000 7ff75ffff700 1 --2- 172.21.15.156:0/1689007896 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff760133ad0 0x7ff76011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.922+0000 7ff75ffff700 1 -- 172.21.15.156:0/1689007896 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7601300a0 msgr2=0x7ff76011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:04.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.922+0000 7ff75ffff700 1 --2- 172.21.15.156:0/1689007896 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7601300a0 0x7ff76011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.922+0000 7ff75ffff700 1 -- 172.21.15.156:0/1689007896 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74c0094a0 con 0x7ff7601309f0 2023-09-30T22:24:04.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.922+0000 7ff764ecc700 1 --2- 172.21.15.156:0/1689007896 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7601300a0 0x7ff76011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:04.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.922+0000 7ff7656cd700 1 --2- 172.21.15.156:0/1689007896 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff760133ad0 0x7ff76011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:04.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.922+0000 7ff75ffff700 1 --2- 172.21.15.156:0/1689007896 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7601309f0 0x7ff76011df80 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7ff74c00ebe0 tx=0x7ff74c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:04.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.922+0000 7ff75d7fa700 1 -- 172.21.15.156:0/1689007896 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c00c850 con 0x7ff7601309f0 2023-09-30T22:24:04.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.922+0000 7ff75d7fa700 1 -- 172.21.15.156:0/1689007896 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff74c00c9b0 con 0x7ff7601309f0 2023-09-30T22:24:04.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.922+0000 7ff767130700 1 -- 172.21.15.156:0/1689007896 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7540094a0 con 0x7ff7601309f0 2023-09-30T22:24:04.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.922+0000 7ff75d7fa700 1 -- 172.21.15.156:0/1689007896 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c00cd40 con 0x7ff7601309f0 2023-09-30T22:24:04.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.923+0000 7ff767130700 1 -- 172.21.15.156:0/1689007896 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff758009b30 con 0x7ff7601309f0 2023-09-30T22:24:04.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.923+0000 7ff75d7fa700 1 -- 172.21.15.156:0/1689007896 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff74c013470 con 0x7ff7601309f0 2023-09-30T22:24:04.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.923+0000 7ff75d7fa700 1 -- 172.21.15.156:0/1689007896 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff74c03f6e0 con 0x7ff7601309f0 2023-09-30T22:24:04.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.923+0000 7ff767130700 1 -- 172.21.15.156:0/1689007896 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff76012dd00 con 0x7ff7601309f0 2023-09-30T22:24:04.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:04.928+0000 7ff75d7fa700 1 -- 172.21.15.156:0/1689007896 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff74c013720 con 0x7ff7601309f0 2023-09-30T22:24:04.944 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:05.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.035+0000 7fa97c46d700 1 Processor -- start 2023-09-30T22:24:05.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.035+0000 7fa97c46d700 1 -- start start 2023-09-30T22:24:05.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.035+0000 7fa97c46d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa974133ad0 0x7fa974133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.035+0000 7fa97c46d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa9741300a0 0x7fa9741304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.035+0000 7fa97c46d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa9741309f0 0x7fa97413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.035+0000 7fa97c46d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa97406b2d0 con 0x7fa9741300a0 2023-09-30T22:24:05.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.035+0000 7fa97c46d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa974133610 con 0x7fa9741309f0 2023-09-30T22:24:05.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.035+0000 7fa97c46d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa97409a500 con 0x7fa974133ad0 2023-09-30T22:24:05.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.036+0000 7fa97a209700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa974133ad0 0x7fa974133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.036+0000 7fa97aa0a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa9741309f0 0x7fa97413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.036+0000 7fa97a209700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa974133ad0 0x7fa974133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44380/0 (socket says 172.21.15.156:44380) 2023-09-30T22:24:05.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.036+0000 7fa97a209700 1 -- 172.21.15.156:0/3128633975 learned_addr learned my addr 172.21.15.156:0/3128633975 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:05.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.036+0000 7fa97aa0a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa9741309f0 0x7fa97413a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59466/0 (socket says 172.21.15.156:59466) 2023-09-30T22:24:05.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.036+0000 7fa979a08700 1 --2- 172.21.15.156:0/3128633975 >> v2:172.21.15.156:3300/0 conn(0x7fa9741300a0 0x7fa9741304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.036+0000 7fa97aa0a700 1 -- 172.21.15.156:0/3128633975 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa974133ad0 msgr2=0x7fa974133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:05.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.036+0000 7fa97aa0a700 1 --2- 172.21.15.156:0/3128633975 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa974133ad0 0x7fa974133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.036+0000 7fa97aa0a700 1 -- 172.21.15.156:0/3128633975 >> v2:172.21.15.156:3300/0 conn(0x7fa9741300a0 msgr2=0x7fa9741304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:05.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.036+0000 7fa97aa0a700 1 --2- 172.21.15.156:0/3128633975 >> v2:172.21.15.156:3300/0 conn(0x7fa9741300a0 0x7fa9741304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.036+0000 7fa97aa0a700 1 -- 172.21.15.156:0/3128633975 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9741338b0 con 0x7fa9741309f0 2023-09-30T22:24:05.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.036+0000 7fa97a209700 1 --2- 172.21.15.156:0/3128633975 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa974133ad0 0x7fa974133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:05.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.036+0000 7fa979a08700 1 --2- 172.21.15.156:0/3128633975 >> v2:172.21.15.156:3300/0 conn(0x7fa9741300a0 0x7fa9741304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:05.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.036+0000 7fa97aa0a700 1 --2- 172.21.15.156:0/3128633975 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa9741309f0 0x7fa97413a980 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa96c009d90 tx=0x7fa96c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9a23cfe8e1f9eda server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:05.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.036+0000 7fa979207700 1 -- 172.21.15.156:0/3128633975 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c00e070 con 0x7fa9741309f0 2023-09-30T22:24:05.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.036+0000 7fa979207700 1 -- 172.21.15.156:0/3128633975 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96c00bb20 con 0x7fa9741309f0 2023-09-30T22:24:05.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.036+0000 7fa979207700 1 -- 172.21.15.156:0/3128633975 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c012430 con 0x7fa9741309f0 2023-09-30T22:24:05.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.037+0000 7fa97c46d700 1 -- 172.21.15.156:0/3128633975 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa9741309f0 msgr2=0x7fa97413a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.037+0000 7fa97c46d700 1 --2- 172.21.15.156:0/3128633975 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa9741309f0 0x7fa97413a980 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa96c009d90 tx=0x7fa96c00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:05.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.037+0000 7fa97c46d700 1 -- 172.21.15.156:0/3128633975 shutdown_connections 2023-09-30T22:24:05.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.037+0000 7fa97c46d700 1 --2- 172.21.15.156:0/3128633975 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa9741309f0 0x7fa97413a980 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.037+0000 7fa97c46d700 1 --2- 172.21.15.156:0/3128633975 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa974133ad0 0x7fa974133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.037+0000 7fa97c46d700 1 --2- 172.21.15.156:0/3128633975 >> v2:172.21.15.156:3300/0 conn(0x7fa9741300a0 0x7fa9741304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.037+0000 7fa97c46d700 1 -- 172.21.15.156:0/3128633975 >> 172.21.15.156:0/3128633975 conn(0x7fa974099c40 msgr2=0x7fa9740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:05.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.037+0000 7fa97c46d700 1 -- 172.21.15.156:0/3128633975 shutdown_connections 2023-09-30T22:24:05.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.037+0000 7fa97c46d700 1 -- 172.21.15.156:0/3128633975 wait complete. 2023-09-30T22:24:05.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.038+0000 7fa97c46d700 1 Processor -- start 2023-09-30T22:24:05.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.038+0000 7fa97c46d700 1 -- start start 2023-09-30T22:24:05.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.039+0000 7fa97c46d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa9741300a0 0x7fa97411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.039+0000 7fa97c46d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa9741309f0 0x7fa97411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.039+0000 7fa97c46d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa974133ad0 0x7fa97411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.039+0000 7fa97c46d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97411f020 con 0x7fa974133ad0 2023-09-30T22:24:05.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.039+0000 7fa97c46d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97412de80 con 0x7fa9741300a0 2023-09-30T22:24:05.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.039+0000 7fa97c46d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9740a33e0 con 0x7fa9741309f0 2023-09-30T22:24:05.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.039+0000 7fa97a209700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa9741300a0 0x7fa97411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.039+0000 7fa97a209700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa9741300a0 0x7fa97411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59474/0 (socket says 172.21.15.156:59474) 2023-09-30T22:24:05.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.039+0000 7fa97a209700 1 -- 172.21.15.156:0/379182472 learned_addr learned my addr 172.21.15.156:0/379182472 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:05.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.039+0000 7fa979a08700 1 --2- 172.21.15.156:0/379182472 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa9741309f0 0x7fa97411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.039+0000 7fa97aa0a700 1 --2- 172.21.15.156:0/379182472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa974133ad0 0x7fa97411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.040+0000 7fa97a209700 1 -- 172.21.15.156:0/379182472 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa9741309f0 msgr2=0x7fa97411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.040+0000 7fa97a209700 1 --2- 172.21.15.156:0/379182472 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa9741309f0 0x7fa97411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.040+0000 7fa97a209700 1 -- 172.21.15.156:0/379182472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa974133ad0 msgr2=0x7fa97411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.040+0000 7fa97a209700 1 --2- 172.21.15.156:0/379182472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa974133ad0 0x7fa97411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.040+0000 7fa97a209700 1 -- 172.21.15.156:0/379182472 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9640094a0 con 0x7fa9741300a0 2023-09-30T22:24:05.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.040+0000 7fa97a209700 1 --2- 172.21.15.156:0/379182472 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa9741300a0 0x7fa97411da40 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa97000ebe0 tx=0x7fa97000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:05.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.040+0000 7fa96affd700 1 -- 172.21.15.156:0/379182472 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97000c850 con 0x7fa9741300a0 2023-09-30T22:24:05.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.040+0000 7fa96affd700 1 -- 172.21.15.156:0/379182472 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97000c9b0 con 0x7fa9741300a0 2023-09-30T22:24:05.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.040+0000 7fa96affd700 1 -- 172.21.15.156:0/379182472 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97000cd20 con 0x7fa9741300a0 2023-09-30T22:24:05.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.040+0000 7fa97c46d700 1 -- 172.21.15.156:0/379182472 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa970009550 con 0x7fa9741300a0 2023-09-30T22:24:05.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.040+0000 7fa97c46d700 1 -- 172.21.15.156:0/379182472 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa96c009a70 con 0x7fa9741300a0 2023-09-30T22:24:05.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.041+0000 7fa97c46d700 1 -- 172.21.15.156:0/379182472 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa97411fd00 con 0x7fa9741300a0 2023-09-30T22:24:05.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.042+0000 7fa96affd700 1 -- 172.21.15.156:0/379182472 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa970004020 con 0x7fa9741300a0 2023-09-30T22:24:05.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.042+0000 7fa96affd700 1 -- 172.21.15.156:0/379182472 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa97003ffc0 con 0x7fa9741300a0 2023-09-30T22:24:05.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.050+0000 7fa96affd700 1 -- 172.21.15.156:0/379182472 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa97001adc0 con 0x7fa9741300a0 2023-09-30T22:24:05.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.074+0000 7f5f79676700 1 Processor -- start 2023-09-30T22:24:05.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.074+0000 7f5f79676700 1 -- start start 2023-09-30T22:24:05.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.074+0000 7f5f79676700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f740a0a70 0x7f5f740a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.074+0000 7f5f79676700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f74134120 0x7f5f7413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.074+0000 7f5f79676700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7409dc00 con 0x7f5f740a1380 2023-09-30T22:24:05.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.074+0000 7f5f79676700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7409ea90 con 0x7f5f74134120 2023-09-30T22:24:05.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.074+0000 7f5f79676700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7409dec0 con 0x7f5f740a0a70 2023-09-30T22:24:05.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.074+0000 7f5f72ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f740a0a70 0x7f5f740a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.074+0000 7f5f727fc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f5f740a1380 0x7f5f74133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48724/0 (socket says 172.21.15.156:48724) 2023-09-30T22:24:05.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.074+0000 7f5f727fc700 1 -- 172.21.15.156:0/1459140729 learned_addr learned my addr 172.21.15.156:0/1459140729 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:05.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.074+0000 7f5f737fe700 1 --2- 172.21.15.156:0/1459140729 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f74134120 0x7f5f7413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.075+0000 7f5f72ffd700 1 -- 172.21.15.156:0/1459140729 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f74134120 msgr2=0x7f5f7413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:05.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.075+0000 7f5f72ffd700 1 --2- 172.21.15.156:0/1459140729 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f74134120 0x7f5f7413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.075+0000 7f5f72ffd700 1 -- 172.21.15.156:0/1459140729 >> v1:172.21.15.156:6789/0 conn(0x7f5f740a1380 legacy=0x7f5f74133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.075+0000 7f5f71ffb700 1 -- 172.21.15.156:0/1459140729 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2395580575 0 0) 0x7f5f7409dc00 con 0x7f5f740a1380 2023-09-30T22:24:05.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.075+0000 7f5f72ffd700 1 -- 172.21.15.156:0/1459140729 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7409e6a0 con 0x7f5f740a0a70 2023-09-30T22:24:05.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.075+0000 7f5f737fe700 1 --2- 172.21.15.156:0/1459140729 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f74134120 0x7f5f7413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:05.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.075+0000 7f5f72ffd700 1 --2- 172.21.15.156:0/1459140729 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f740a0a70 0x7f5f740a0e40 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5f64009870 tx=0x7f5f64009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38cf7040926831b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:05.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.075+0000 7f5f71ffb700 1 -- 172.21.15.156:0/1459140729 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f64011830 con 0x7f5f740a0a70 2023-09-30T22:24:05.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.075+0000 7f5f71ffb700 1 -- 172.21.15.156:0/1459140729 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f64011990 con 0x7f5f740a0a70 2023-09-30T22:24:05.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.075+0000 7f5f71ffb700 1 -- 172.21.15.156:0/1459140729 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f64011d20 con 0x7f5f740a0a70 2023-09-30T22:24:05.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.076+0000 7f5f79676700 1 -- 172.21.15.156:0/1459140729 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f740a0a70 msgr2=0x7f5f740a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.076+0000 7f5f79676700 1 --2- 172.21.15.156:0/1459140729 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f740a0a70 0x7f5f740a0e40 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5f64009870 tx=0x7f5f64009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:05.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.076+0000 7f5f79676700 1 -- 172.21.15.156:0/1459140729 shutdown_connections 2023-09-30T22:24:05.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.076+0000 7f5f79676700 1 --2- 172.21.15.156:0/1459140729 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f74134120 0x7f5f7413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.076+0000 7f5f79676700 1 --2- 172.21.15.156:0/1459140729 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f740a0a70 0x7f5f740a0e40 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.076+0000 7f5f79676700 1 -- 172.21.15.156:0/1459140729 >> 172.21.15.156:0/1459140729 conn(0x7f5f740a6610 msgr2=0x7f5f740a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:05.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.076+0000 7f5f79676700 1 -- 172.21.15.156:0/1459140729 shutdown_connections 2023-09-30T22:24:05.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.076+0000 7f5f79676700 1 -- 172.21.15.156:0/1459140729 wait complete. 2023-09-30T22:24:05.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.077+0000 7f5f79676700 1 Processor -- start 2023-09-30T22:24:05.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.077+0000 7f5f79676700 1 -- start start 2023-09-30T22:24:05.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.077+0000 7f5f79676700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f740a0a70 0x7f5f74122780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.077+0000 7f5f79676700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f740a1380 0x7f5f74122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.077+0000 7f5f79676700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f74134120 0x7f5f74123200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.077+0000 7f5f79676700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f74124390 con 0x7f5f740a0a70 2023-09-30T22:24:05.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.077+0000 7f5f79676700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f74133310 con 0x7f5f74134120 2023-09-30T22:24:05.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.077+0000 7f5f79676700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f74125d00 con 0x7f5f740a1380 2023-09-30T22:24:05.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.077+0000 7f5f727fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f740a1380 0x7f5f74122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.077+0000 7f5f727fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f740a1380 0x7f5f74122cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44412/0 (socket says 172.21.15.156:44412) 2023-09-30T22:24:05.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.077+0000 7f5f727fc700 1 -- 172.21.15.156:0/231686522 learned_addr learned my addr 172.21.15.156:0/231686522 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:05.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.077+0000 7f5f72ffd700 1 --2- 172.21.15.156:0/231686522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f740a0a70 0x7f5f74122780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.077+0000 7f5f737fe700 1 --2- 172.21.15.156:0/231686522 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f74134120 0x7f5f74123200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.078+0000 7f5f727fc700 1 -- 172.21.15.156:0/231686522 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f74134120 msgr2=0x7f5f74123200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.078+0000 7f5f727fc700 1 --2- 172.21.15.156:0/231686522 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f74134120 0x7f5f74123200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.078+0000 7f5f727fc700 1 -- 172.21.15.156:0/231686522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f740a0a70 msgr2=0x7f5f74122780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.078+0000 7f5f727fc700 1 --2- 172.21.15.156:0/231686522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f740a0a70 0x7f5f74122780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.078+0000 7f5f727fc700 1 -- 172.21.15.156:0/231686522 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6c009a70 con 0x7f5f740a1380 2023-09-30T22:24:05.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.078+0000 7f5f727fc700 1 --2- 172.21.15.156:0/231686522 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f740a1380 0x7f5f74122cc0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f5f6800c520 tx=0x7f5f6800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:05.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.078+0000 7f5f5b7fe700 1 -- 172.21.15.156:0/231686522 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f68004c80 con 0x7f5f740a1380 2023-09-30T22:24:05.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.078+0000 7f5f5b7fe700 1 -- 172.21.15.156:0/231686522 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f68004de0 con 0x7f5f740a1380 2023-09-30T22:24:05.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.078+0000 7f5f5b7fe700 1 -- 172.21.15.156:0/231686522 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f680072f0 con 0x7f5f740a1380 2023-09-30T22:24:05.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.078+0000 7f5f79676700 1 -- 172.21.15.156:0/231686522 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f640094a0 con 0x7f5f740a1380 2023-09-30T22:24:05.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.078+0000 7f5f79676700 1 -- 172.21.15.156:0/231686522 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f740a03e0 con 0x7f5f740a1380 2023-09-30T22:24:05.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.079+0000 7f5f5b7fe700 1 -- 172.21.15.156:0/231686522 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f68007450 con 0x7f5f740a1380 2023-09-30T22:24:05.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.079+0000 7f5f5b7fe700 1 -- 172.21.15.156:0/231686522 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5f6803f360 con 0x7f5f740a1380 2023-09-30T22:24:05.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.080+0000 7f5f79676700 1 -- 172.21.15.156:0/231686522 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f7404f2a0 con 0x7f5f740a1380 2023-09-30T22:24:05.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.088+0000 7f5f5b7fe700 1 -- 172.21.15.156:0/231686522 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f68007700 con 0x7f5f740a1380 2023-09-30T22:24:05.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.130+0000 7ff767130700 1 -- 172.21.15.156:0/1689007896 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff76004f2a0 con 0x7ff7601309f0 2023-09-30T22:24:05.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.131+0000 7ff75d7fa700 1 -- 172.21.15.156:0/1689007896 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff74c021020 con 0x7ff7601309f0 2023-09-30T22:24:05.130 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:05.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.133+0000 7ff767130700 1 -- 172.21.15.156:0/1689007896 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7601309f0 msgr2=0x7ff76011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.133+0000 7ff767130700 1 --2- 172.21.15.156:0/1689007896 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7601309f0 0x7ff76011df80 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7ff74c00ebe0 tx=0x7ff74c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.133+0000 7ff767130700 1 -- 172.21.15.156:0/1689007896 shutdown_connections 2023-09-30T22:24:05.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.133+0000 7ff767130700 1 --2- 172.21.15.156:0/1689007896 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff760133ad0 0x7ff76011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.133+0000 7ff767130700 1 --2- 172.21.15.156:0/1689007896 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7601300a0 0x7ff76011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.133+0000 7ff767130700 1 --2- 172.21.15.156:0/1689007896 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7601309f0 0x7ff76011df80 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.133+0000 7ff767130700 1 -- 172.21.15.156:0/1689007896 >> 172.21.15.156:0/1689007896 conn(0x7ff760099c40 msgr2=0x7ff760131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:05.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.133+0000 7ff767130700 1 -- 172.21.15.156:0/1689007896 shutdown_connections 2023-09-30T22:24:05.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.133+0000 7ff767130700 1 -- 172.21.15.156:0/1689007896 wait complete. 2023-09-30T22:24:05.145 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:05.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.244+0000 7fa97c46d700 1 -- 172.21.15.156:0/379182472 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa97404f2a0 con 0x7fa9741300a0 2023-09-30T22:24:05.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.244+0000 7fa96affd700 1 -- 172.21.15.156:0/379182472 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa970017020 con 0x7fa9741300a0 2023-09-30T22:24:05.244 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:05.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.246+0000 7fa97c46d700 1 -- 172.21.15.156:0/379182472 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa9741300a0 msgr2=0x7fa97411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.246+0000 7fa97c46d700 1 --2- 172.21.15.156:0/379182472 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa9741300a0 0x7fa97411da40 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa97000ebe0 tx=0x7fa97000eef0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.247+0000 7fa97c46d700 1 -- 172.21.15.156:0/379182472 shutdown_connections 2023-09-30T22:24:05.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.247+0000 7fa97c46d700 1 --2- 172.21.15.156:0/379182472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa974133ad0 0x7fa97411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.247+0000 7fa97c46d700 1 --2- 172.21.15.156:0/379182472 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa9741300a0 0x7fa97411da40 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.247+0000 7fa97c46d700 1 --2- 172.21.15.156:0/379182472 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa9741309f0 0x7fa97411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.247+0000 7fa97c46d700 1 -- 172.21.15.156:0/379182472 >> 172.21.15.156:0/379182472 conn(0x7fa974099c40 msgr2=0x7fa974132b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:05.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.247+0000 7fa97c46d700 1 -- 172.21.15.156:0/379182472 shutdown_connections 2023-09-30T22:24:05.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.247+0000 7fa97c46d700 1 -- 172.21.15.156:0/379182472 wait complete. 2023-09-30T22:24:05.259 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:05.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.284+0000 7f5f79676700 1 -- 172.21.15.156:0/231686522 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5f74072980 con 0x7f5f740a1380 2023-09-30T22:24:05.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.284+0000 7f5f5b7fe700 1 -- 172.21.15.156:0/231686522 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f68011e80 con 0x7f5f740a1380 2023-09-30T22:24:05.283 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:05.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.286+0000 7f5f79676700 1 -- 172.21.15.156:0/231686522 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f740a1380 msgr2=0x7f5f74122cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.286+0000 7f5f79676700 1 --2- 172.21.15.156:0/231686522 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f740a1380 0x7f5f74122cc0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f5f6800c520 tx=0x7f5f6800c830 comp rx=0 tx=0).stop 2023-09-30T22:24:05.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.286+0000 7f5f79676700 1 -- 172.21.15.156:0/231686522 shutdown_connections 2023-09-30T22:24:05.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.286+0000 7f5f79676700 1 --2- 172.21.15.156:0/231686522 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f74134120 0x7f5f74123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.286+0000 7f5f79676700 1 --2- 172.21.15.156:0/231686522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f740a0a70 0x7f5f74122780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.286+0000 7f5f79676700 1 --2- 172.21.15.156:0/231686522 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f740a1380 0x7f5f74122cc0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.286+0000 7f5f79676700 1 -- 172.21.15.156:0/231686522 >> 172.21.15.156:0/231686522 conn(0x7f5f740a6610 msgr2=0x7f5f740a4980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:05.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.286+0000 7f5f79676700 1 -- 172.21.15.156:0/231686522 shutdown_connections 2023-09-30T22:24:05.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.286+0000 7f5f79676700 1 -- 172.21.15.156:0/231686522 wait complete. 2023-09-30T22:24:05.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:05.748 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:05.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.873+0000 7f484730b700 1 Processor -- start 2023-09-30T22:24:05.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.874+0000 7f484730b700 1 -- start start 2023-09-30T22:24:05.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.874+0000 7f484730b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f484009e870 0x7f484009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.874+0000 7f484730b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f484009f180 0x7f4840131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.874+0000 7f484730b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4840131d70 0x7f4840132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.874+0000 7f484730b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48400a0920 con 0x7f4840131d70 2023-09-30T22:24:05.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.874+0000 7f484730b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484009c970 con 0x7f484009e870 2023-09-30T22:24:05.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.874+0000 7f484730b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f484009bab0 con 0x7f484009f180 2023-09-30T22:24:05.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.874+0000 7f48448a6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f484009f180 0x7f4840131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.874+0000 7f48458a8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4840131d70 0x7f4840132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.874+0000 7f48448a6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f484009f180 0x7f4840131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44418/0 (socket says 172.21.15.156:44418) 2023-09-30T22:24:05.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.874+0000 7f48458a8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4840131d70 0x7f4840132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41188/0 (socket says 172.21.15.156:41188) 2023-09-30T22:24:05.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.874+0000 7f48448a6700 1 -- 172.21.15.156:0/117284226 learned_addr learned my addr 172.21.15.156:0/117284226 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:05.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.874+0000 7f48450a7700 1 --2- 172.21.15.156:0/117284226 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f484009e870 0x7f484009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.874+0000 7f48458a8700 1 -- 172.21.15.156:0/117284226 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f484009f180 msgr2=0x7f4840131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:05.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.874+0000 7f48458a8700 1 --2- 172.21.15.156:0/117284226 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f484009f180 0x7f4840131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.874+0000 7f48458a8700 1 -- 172.21.15.156:0/117284226 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f484009e870 msgr2=0x7f484009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:05.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.874+0000 7f48458a8700 1 --2- 172.21.15.156:0/117284226 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f484009e870 0x7f484009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.875+0000 7f48458a8700 1 -- 172.21.15.156:0/117284226 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484009f9c0 con 0x7f4840131d70 2023-09-30T22:24:05.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.875+0000 7f48448a6700 1 --2- 172.21.15.156:0/117284226 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f484009f180 0x7f4840131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:05.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.875+0000 7f48450a7700 1 --2- 172.21.15.156:0/117284226 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f484009e870 0x7f484009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:05.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.875+0000 7f48458a8700 1 --2- 172.21.15.156:0/117284226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4840131d70 0x7f4840132210 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f4838009d90 tx=0x7f483800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=691b628ae559513d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:05.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.875+0000 7f4837fff700 1 -- 172.21.15.156:0/117284226 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483800e070 con 0x7f4840131d70 2023-09-30T22:24:05.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.875+0000 7f4837fff700 1 -- 172.21.15.156:0/117284226 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483800bb20 con 0x7f4840131d70 2023-09-30T22:24:05.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.875+0000 7f4837fff700 1 -- 172.21.15.156:0/117284226 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4838012430 con 0x7f4840131d70 2023-09-30T22:24:05.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.875+0000 7f484730b700 1 -- 172.21.15.156:0/117284226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4840131d70 msgr2=0x7f4840132210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.875+0000 7f484730b700 1 --2- 172.21.15.156:0/117284226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4840131d70 0x7f4840132210 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f4838009d90 tx=0x7f483800b330 comp rx=0 tx=0).stop 2023-09-30T22:24:05.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.875+0000 7f484730b700 1 -- 172.21.15.156:0/117284226 shutdown_connections 2023-09-30T22:24:05.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.875+0000 7f484730b700 1 --2- 172.21.15.156:0/117284226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4840131d70 0x7f4840132210 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.875+0000 7f484730b700 1 --2- 172.21.15.156:0/117284226 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f484009e870 0x7f484009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.875+0000 7f484730b700 1 --2- 172.21.15.156:0/117284226 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f484009f180 0x7f4840131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.875+0000 7f484730b700 1 -- 172.21.15.156:0/117284226 >> 172.21.15.156:0/117284226 conn(0x7f48400a4430 msgr2=0x7f48400a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:05.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.875+0000 7f484730b700 1 -- 172.21.15.156:0/117284226 shutdown_connections 2023-09-30T22:24:05.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.876+0000 7f484730b700 1 -- 172.21.15.156:0/117284226 wait complete. 2023-09-30T22:24:05.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.876+0000 7f484730b700 1 Processor -- start 2023-09-30T22:24:05.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.876+0000 7f484730b700 1 -- start start 2023-09-30T22:24:05.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.877+0000 7f484730b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f484009e870 0x7f484006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.877+0000 7f484730b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f484009f180 0x7f484006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.877+0000 7f484730b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4840131d70 0x7f484006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.877+0000 7f484730b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48401248b0 con 0x7f484009f180 2023-09-30T22:24:05.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.877+0000 7f484730b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4840130670 con 0x7f4840131d70 2023-09-30T22:24:05.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.877+0000 7f484730b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4840123770 con 0x7f484009e870 2023-09-30T22:24:05.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.877+0000 7f48450a7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f484009e870 0x7f484006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.877+0000 7f48458a8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4840131d70 0x7f484006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.877+0000 7f48448a6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f484009f180 0x7f484006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.877+0000 7f48450a7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f484009e870 0x7f484006b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44426/0 (socket says 172.21.15.156:44426) 2023-09-30T22:24:05.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.877+0000 7f48450a7700 1 -- 172.21.15.156:0/3906427104 learned_addr learned my addr 172.21.15.156:0/3906427104 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:05.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.877+0000 7f48458a8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4840131d70 0x7f484006c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59516/0 (socket says 172.21.15.156:59516) 2023-09-30T22:24:05.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.877+0000 7f48450a7700 1 -- 172.21.15.156:0/3906427104 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4840131d70 msgr2=0x7f484006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.877+0000 7f48450a7700 1 --2- 172.21.15.156:0/3906427104 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4840131d70 0x7f484006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.877+0000 7f48450a7700 1 -- 172.21.15.156:0/3906427104 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f484009f180 msgr2=0x7f484006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.877+0000 7f48450a7700 1 --2- 172.21.15.156:0/3906427104 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f484009f180 0x7f484006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.877+0000 7f48450a7700 1 -- 172.21.15.156:0/3906427104 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48300094a0 con 0x7f484009e870 2023-09-30T22:24:05.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.877+0000 7f48458a8700 1 --2- 172.21.15.156:0/3906427104 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4840131d70 0x7f484006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:05.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.877+0000 7f48448a6700 1 --2- 172.21.15.156:0/3906427104 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f484009f180 0x7f484006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:05.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.877+0000 7f48450a7700 1 --2- 172.21.15.156:0/3906427104 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f484009e870 0x7f484006b8b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f483000ec10 tx=0x7f483000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:05.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.877+0000 7f4835ffb700 1 -- 172.21.15.156:0/3906427104 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4830009780 con 0x7f484009e870 2023-09-30T22:24:05.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.877+0000 7f4835ffb700 1 -- 172.21.15.156:0/3906427104 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483000c850 con 0x7f484009e870 2023-09-30T22:24:05.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.878+0000 7f484730b700 1 -- 172.21.15.156:0/3906427104 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f483c009550 con 0x7f484009e870 2023-09-30T22:24:05.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.878+0000 7f4835ffb700 1 -- 172.21.15.156:0/3906427104 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483000cbe0 con 0x7f484009e870 2023-09-30T22:24:05.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.878+0000 7f484730b700 1 -- 172.21.15.156:0/3906427104 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4838009a70 con 0x7f484009e870 2023-09-30T22:24:05.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.878+0000 7f4835ffb700 1 -- 172.21.15.156:0/3906427104 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f483000cd40 con 0x7f484009e870 2023-09-30T22:24:05.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.879+0000 7f4835ffb700 1 -- 172.21.15.156:0/3906427104 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f483003faf0 con 0x7f484009e870 2023-09-30T22:24:05.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.879+0000 7f484730b700 1 -- 172.21.15.156:0/3906427104 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f484011be60 con 0x7f484009e870 2023-09-30T22:24:05.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:05.883+0000 7f4835ffb700 1 -- 172.21.15.156:0/3906427104 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f483003de60 con 0x7f484009e870 2023-09-30T22:24:06.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.065+0000 7f484730b700 1 -- 172.21.15.156:0/3906427104 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f48400a0210 con 0x7f484009e870 2023-09-30T22:24:06.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.066+0000 7f4835ffb700 1 -- 172.21.15.156:0/3906427104 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4830021020 con 0x7f484009e870 2023-09-30T22:24:06.065 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:06.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.068+0000 7f484730b700 1 -- 172.21.15.156:0/3906427104 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f484009e870 msgr2=0x7f484006b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.068+0000 7f484730b700 1 --2- 172.21.15.156:0/3906427104 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f484009e870 0x7f484006b8b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f483000ec10 tx=0x7f483000ef20 comp rx=0 tx=0).stop 2023-09-30T22:24:06.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.068+0000 7f484730b700 1 -- 172.21.15.156:0/3906427104 shutdown_connections 2023-09-30T22:24:06.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.068+0000 7f484730b700 1 --2- 172.21.15.156:0/3906427104 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4840131d70 0x7f484006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.068+0000 7f484730b700 1 --2- 172.21.15.156:0/3906427104 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f484009e870 0x7f484006b8b0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.068+0000 7f484730b700 1 --2- 172.21.15.156:0/3906427104 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f484009f180 0x7f484006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.068+0000 7f484730b700 1 -- 172.21.15.156:0/3906427104 >> 172.21.15.156:0/3906427104 conn(0x7f48400a4430 msgr2=0x7f48401310a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:06.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.068+0000 7f484730b700 1 -- 172.21.15.156:0/3906427104 shutdown_connections 2023-09-30T22:24:06.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.068+0000 7f484730b700 1 -- 172.21.15.156:0/3906427104 wait complete. 2023-09-30T22:24:06.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:06.146 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:06.259 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:06.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.269+0000 7f6a3bba8700 1 Processor -- start 2023-09-30T22:24:06.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.269+0000 7f6a3bba8700 1 -- start start 2023-09-30T22:24:06.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.270+0000 7f6a3bba8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6a34099a60 0x7f6a341388f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.270+0000 7f6a3bba8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a34138e30 0x7f6a3413b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.270+0000 7f6a3bba8700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3409aa00 con 0x7f6a34133b80 2023-09-30T22:24:06.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.270+0000 7f6a3bba8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3409a080 con 0x7f6a34138e30 2023-09-30T22:24:06.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.270+0000 7f6a3bba8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a34133750 con 0x7f6a34099a60 2023-09-30T22:24:06.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.270+0000 7f6a39143700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6a34099a60 0x7f6a341388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.270+0000 7f6a39944700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6a34133b80 0x7f6a34133f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48732/0 (socket says 172.21.15.156:48732) 2023-09-30T22:24:06.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.270+0000 7f6a39944700 1 -- 172.21.15.156:0/1355938167 learned_addr learned my addr 172.21.15.156:0/1355938167 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:06.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.270+0000 7f6a3a145700 1 --2- 172.21.15.156:0/1355938167 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a34138e30 0x7f6a3413b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.270+0000 7f6a39143700 1 -- 172.21.15.156:0/1355938167 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a34138e30 msgr2=0x7f6a3413b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:06.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.270+0000 7f6a38942700 1 -- 172.21.15.156:0/1355938167 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3010790824 0 0) 0x7f6a3409aa00 con 0x7f6a34133b80 2023-09-30T22:24:06.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.270+0000 7f6a39143700 1 --2- 172.21.15.156:0/1355938167 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a34138e30 0x7f6a3413b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.270+0000 7f6a39143700 1 -- 172.21.15.156:0/1355938167 >> v1:172.21.15.156:6789/0 conn(0x7f6a34133b80 legacy=0x7f6a34133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.270+0000 7f6a39143700 1 -- 172.21.15.156:0/1355938167 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3409a760 con 0x7f6a34099a60 2023-09-30T22:24:06.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.270+0000 7f6a3a145700 1 --2- 172.21.15.156:0/1355938167 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a34138e30 0x7f6a3413b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:06.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.271+0000 7f6a39143700 1 --2- 172.21.15.156:0/1355938167 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6a34099a60 0x7f6a341388f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6a24009870 tx=0x7f6a24009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fa280bf2cdd5316 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:06.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.271+0000 7f6a38942700 1 -- 172.21.15.156:0/1355938167 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a24011830 con 0x7f6a34099a60 2023-09-30T22:24:06.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.271+0000 7f6a38942700 1 -- 172.21.15.156:0/1355938167 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a24011990 con 0x7f6a34099a60 2023-09-30T22:24:06.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.271+0000 7f6a38942700 1 -- 172.21.15.156:0/1355938167 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a24011d20 con 0x7f6a34099a60 2023-09-30T22:24:06.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.271+0000 7f6a3bba8700 1 -- 172.21.15.156:0/1355938167 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6a34099a60 msgr2=0x7f6a341388f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.271+0000 7f6a3bba8700 1 --2- 172.21.15.156:0/1355938167 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6a34099a60 0x7f6a341388f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6a24009870 tx=0x7f6a24009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:06.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.271+0000 7f6a3bba8700 1 -- 172.21.15.156:0/1355938167 shutdown_connections 2023-09-30T22:24:06.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.271+0000 7f6a3bba8700 1 --2- 172.21.15.156:0/1355938167 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a34138e30 0x7f6a3413b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.271+0000 7f6a3bba8700 1 --2- 172.21.15.156:0/1355938167 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6a34099a60 0x7f6a341388f0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.271+0000 7f6a3bba8700 1 -- 172.21.15.156:0/1355938167 >> 172.21.15.156:0/1355938167 conn(0x7f6a340a2980 msgr2=0x7f6a340a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:06.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.271+0000 7f6a3bba8700 1 -- 172.21.15.156:0/1355938167 shutdown_connections 2023-09-30T22:24:06.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.271+0000 7f6a3bba8700 1 -- 172.21.15.156:0/1355938167 wait complete. 2023-09-30T22:24:06.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.273+0000 7f6a3bba8700 1 Processor -- start 2023-09-30T22:24:06.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.273+0000 7f6a3bba8700 1 -- start start 2023-09-30T22:24:06.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.273+0000 7f6a3bba8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a34099a60 0x7f6a34118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.273+0000 7f6a3bba8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6a34133b80 0x7f6a34119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.273+0000 7f6a3bba8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a34138e30 0x7f6a34119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.273+0000 7f6a3bba8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3411c310 con 0x7f6a34099a60 2023-09-30T22:24:06.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.273+0000 7f6a3bba8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3411a630 con 0x7f6a34138e30 2023-09-30T22:24:06.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.273+0000 7f6a3bba8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3411c510 con 0x7f6a34133b80 2023-09-30T22:24:06.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.273+0000 7f6a39944700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a34099a60 0x7f6a34118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.274+0000 7f6a39944700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a34099a60 0x7f6a34118df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41208/0 (socket says 172.21.15.156:41208) 2023-09-30T22:24:06.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.274+0000 7f6a39944700 1 -- 172.21.15.156:0/736161688 learned_addr learned my addr 172.21.15.156:0/736161688 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:06.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.274+0000 7f6a39143700 1 --2- 172.21.15.156:0/736161688 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6a34133b80 0x7f6a34119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.274+0000 7f6a3a145700 1 --2- 172.21.15.156:0/736161688 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a34138e30 0x7f6a34119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.274+0000 7f6a3a145700 1 -- 172.21.15.156:0/736161688 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6a34133b80 msgr2=0x7f6a34119330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.274+0000 7f6a3a145700 1 --2- 172.21.15.156:0/736161688 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6a34133b80 0x7f6a34119330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.274+0000 7f6a3a145700 1 -- 172.21.15.156:0/736161688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a34099a60 msgr2=0x7f6a34118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.274+0000 7f6a3a145700 1 --2- 172.21.15.156:0/736161688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a34099a60 0x7f6a34118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.274+0000 7f6a3a145700 1 -- 172.21.15.156:0/736161688 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c009a70 con 0x7f6a34138e30 2023-09-30T22:24:06.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.274+0000 7f6a3a145700 1 --2- 172.21.15.156:0/736161688 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a34138e30 0x7f6a34119870 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c00ef90 tx=0x7f6a2c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:06.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.274+0000 7f6a2a7fc700 1 -- 172.21.15.156:0/736161688 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c00cc90 con 0x7f6a34138e30 2023-09-30T22:24:06.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.274+0000 7f6a2a7fc700 1 -- 172.21.15.156:0/736161688 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c00f040 con 0x7f6a34138e30 2023-09-30T22:24:06.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.274+0000 7f6a3bba8700 1 -- 172.21.15.156:0/736161688 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a240094a0 con 0x7f6a34138e30 2023-09-30T22:24:06.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.274+0000 7f6a2a7fc700 1 -- 172.21.15.156:0/736161688 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c014480 con 0x7f6a34138e30 2023-09-30T22:24:06.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.274+0000 7f6a3bba8700 1 -- 172.21.15.156:0/736161688 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a340a2490 con 0x7f6a34138e30 2023-09-30T22:24:06.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.275+0000 7f6a2a7fc700 1 -- 172.21.15.156:0/736161688 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a2c014600 con 0x7f6a34138e30 2023-09-30T22:24:06.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.275+0000 7f6a2a7fc700 1 -- 172.21.15.156:0/736161688 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6a2c040060 con 0x7f6a34138e30 2023-09-30T22:24:06.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.275+0000 7f6a3bba8700 1 -- 172.21.15.156:0/736161688 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a3404f2a0 con 0x7f6a34138e30 2023-09-30T22:24:06.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.280+0000 7f6a2a7fc700 1 -- 172.21.15.156:0/736161688 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a2c0248f0 con 0x7f6a34138e30 2023-09-30T22:24:06.298 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:06.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.386+0000 7efd85fd2700 1 Processor -- start 2023-09-30T22:24:06.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.386+0000 7efd85fd2700 1 -- start start 2023-09-30T22:24:06.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.387+0000 7efd85fd2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd8009ad40 0x7efd80133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.387+0000 7efd85fd2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efd80133f70 0x7efd801343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.387+0000 7efd85fd2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7efd800a0a70 0x7efd800a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.387+0000 7efd85fd2700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd800a3b60 con 0x7efd800a0a70 2023-09-30T22:24:06.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.387+0000 7efd85fd2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd801348e0 con 0x7efd8009ad40 2023-09-30T22:24:06.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.387+0000 7efd85fd2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd8009b110 con 0x7efd80133f70 2023-09-30T22:24:06.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.387+0000 7efd7f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd8009ad40 0x7efd80133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.387+0000 7efd7effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efd80133f70 0x7efd801343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.387+0000 7efd7f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd8009ad40 0x7efd80133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59540/0 (socket says 172.21.15.156:59540) 2023-09-30T22:24:06.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.387+0000 7efd7f7fe700 1 -- 172.21.15.156:0/555766132 learned_addr learned my addr 172.21.15.156:0/555766132 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:06.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.387+0000 7efd7ffff700 1 --2- 172.21.15.156:0/555766132 >> v2:172.21.15.156:3300/0 conn(0x7efd800a0a70 0x7efd800a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.387+0000 7efd7f7fe700 1 -- 172.21.15.156:0/555766132 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efd80133f70 msgr2=0x7efd801343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:06.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.387+0000 7efd7f7fe700 1 --2- 172.21.15.156:0/555766132 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efd80133f70 0x7efd801343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.387+0000 7efd7f7fe700 1 -- 172.21.15.156:0/555766132 >> v2:172.21.15.156:3300/0 conn(0x7efd800a0a70 msgr2=0x7efd800a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:06.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.387+0000 7efd7f7fe700 1 --2- 172.21.15.156:0/555766132 >> v2:172.21.15.156:3300/0 conn(0x7efd800a0a70 0x7efd800a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.387+0000 7efd7f7fe700 1 -- 172.21.15.156:0/555766132 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd800a2fa0 con 0x7efd8009ad40 2023-09-30T22:24:06.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.388+0000 7efd7ffff700 1 --2- 172.21.15.156:0/555766132 >> v2:172.21.15.156:3300/0 conn(0x7efd800a0a70 0x7efd800a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:06.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.388+0000 7efd7f7fe700 1 --2- 172.21.15.156:0/555766132 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd8009ad40 0x7efd80133a30 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7efd70009920 tx=0x7efd70009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69cf9e495404d0e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:06.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.388+0000 7efd7e7fc700 1 -- 172.21.15.156:0/555766132 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd70011830 con 0x7efd8009ad40 2023-09-30T22:24:06.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.388+0000 7efd7e7fc700 1 -- 172.21.15.156:0/555766132 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd70011990 con 0x7efd8009ad40 2023-09-30T22:24:06.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.388+0000 7efd7e7fc700 1 -- 172.21.15.156:0/555766132 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd70011d20 con 0x7efd8009ad40 2023-09-30T22:24:06.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.389+0000 7efd85fd2700 1 -- 172.21.15.156:0/555766132 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd8009ad40 msgr2=0x7efd80133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.389+0000 7efd85fd2700 1 --2- 172.21.15.156:0/555766132 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd8009ad40 0x7efd80133a30 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7efd70009920 tx=0x7efd70009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:06.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.389+0000 7efd85fd2700 1 -- 172.21.15.156:0/555766132 shutdown_connections 2023-09-30T22:24:06.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.389+0000 7efd85fd2700 1 --2- 172.21.15.156:0/555766132 >> v2:172.21.15.156:3300/0 conn(0x7efd800a0a70 0x7efd800a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.389+0000 7efd85fd2700 1 --2- 172.21.15.156:0/555766132 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd8009ad40 0x7efd80133a30 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.389+0000 7efd85fd2700 1 --2- 172.21.15.156:0/555766132 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efd80133f70 0x7efd801343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.389+0000 7efd85fd2700 1 -- 172.21.15.156:0/555766132 >> 172.21.15.156:0/555766132 conn(0x7efd80099c40 msgr2=0x7efd8006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:06.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.389+0000 7efd85fd2700 1 -- 172.21.15.156:0/555766132 shutdown_connections 2023-09-30T22:24:06.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.389+0000 7efd85fd2700 1 -- 172.21.15.156:0/555766132 wait complete. 2023-09-30T22:24:06.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.390+0000 7efd85fd2700 1 Processor -- start 2023-09-30T22:24:06.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.390+0000 7efd85fd2700 1 -- start start 2023-09-30T22:24:06.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.390+0000 7efd85fd2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd8009ad40 0x7efd80121390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.390+0000 7efd85fd2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efd800a0a70 0x7efd801218d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.390+0000 7efd85fd2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd80133f70 0x7efd80121e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.390+0000 7efd85fd2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd80124980 con 0x7efd80133f70 2023-09-30T22:24:06.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.390+0000 7efd85fd2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd80124c70 con 0x7efd8009ad40 2023-09-30T22:24:06.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.390+0000 7efd85fd2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd80122fa0 con 0x7efd800a0a70 2023-09-30T22:24:06.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.390+0000 7efd7f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd8009ad40 0x7efd80121390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.390+0000 7efd7f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd8009ad40 0x7efd80121390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59546/0 (socket says 172.21.15.156:59546) 2023-09-30T22:24:06.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.390+0000 7efd7f7fe700 1 -- 172.21.15.156:0/3176862852 learned_addr learned my addr 172.21.15.156:0/3176862852 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:06.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.390+0000 7efd7effd700 1 --2- 172.21.15.156:0/3176862852 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efd800a0a70 0x7efd801218d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.390+0000 7efd7ffff700 1 --2- 172.21.15.156:0/3176862852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd80133f70 0x7efd80121e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.391+0000 7efd7f7fe700 1 -- 172.21.15.156:0/3176862852 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efd800a0a70 msgr2=0x7efd801218d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.391+0000 7efd7f7fe700 1 --2- 172.21.15.156:0/3176862852 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efd800a0a70 0x7efd801218d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.391+0000 7efd7f7fe700 1 -- 172.21.15.156:0/3176862852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd80133f70 msgr2=0x7efd80121e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.391+0000 7efd7f7fe700 1 --2- 172.21.15.156:0/3176862852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd80133f70 0x7efd80121e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.391+0000 7efd7f7fe700 1 -- 172.21.15.156:0/3176862852 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd78009a70 con 0x7efd8009ad40 2023-09-30T22:24:06.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.391+0000 7efd7f7fe700 1 --2- 172.21.15.156:0/3176862852 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd8009ad40 0x7efd80121390 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7efd70009c70 tx=0x7efd70004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:06.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.391+0000 7efd67fff700 1 -- 172.21.15.156:0/3176862852 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd70004450 con 0x7efd8009ad40 2023-09-30T22:24:06.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.391+0000 7efd67fff700 1 -- 172.21.15.156:0/3176862852 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7001e070 con 0x7efd8009ad40 2023-09-30T22:24:06.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.391+0000 7efd67fff700 1 -- 172.21.15.156:0/3176862852 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd700038e0 con 0x7efd8009ad40 2023-09-30T22:24:06.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.391+0000 7efd85fd2700 1 -- 172.21.15.156:0/3176862852 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd70009550 con 0x7efd8009ad40 2023-09-30T22:24:06.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.391+0000 7efd85fd2700 1 -- 172.21.15.156:0/3176862852 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd8009bee0 con 0x7efd8009ad40 2023-09-30T22:24:06.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.392+0000 7efd67fff700 1 -- 172.21.15.156:0/3176862852 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efd70003a40 con 0x7efd8009ad40 2023-09-30T22:24:06.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.392+0000 7efd67fff700 1 -- 172.21.15.156:0/3176862852 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efd700403c0 con 0x7efd8009ad40 2023-09-30T22:24:06.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.392+0000 7efd85fd2700 1 -- 172.21.15.156:0/3176862852 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd801241f0 con 0x7efd8009ad40 2023-09-30T22:24:06.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.397+0000 7efd67fff700 1 -- 172.21.15.156:0/3176862852 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efd7002d7d0 con 0x7efd8009ad40 2023-09-30T22:24:06.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.425+0000 7f9a5f562700 1 Processor -- start 2023-09-30T22:24:06.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.425+0000 7f9a5f562700 1 -- start start 2023-09-30T22:24:06.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.425+0000 7f9a5f562700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a580a0a70 0x7f9a580a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.425+0000 7f9a5f562700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9a58134120 0x7f9a5813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.425+0000 7f9a5f562700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5809dc00 con 0x7f9a580a1380 2023-09-30T22:24:06.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.425+0000 7f9a5f562700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5809ea90 con 0x7f9a580a0a70 2023-09-30T22:24:06.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.425+0000 7f9a5f562700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5809dec0 con 0x7f9a58134120 2023-09-30T22:24:06.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.426+0000 7f9a5cafd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f9a580a1380 0x7f9a58133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48742/0 (socket says 172.21.15.156:48742) 2023-09-30T22:24:06.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.426+0000 7f9a5cafd700 1 -- 172.21.15.156:0/303354317 learned_addr learned my addr 172.21.15.156:0/303354317 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:06.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.426+0000 7f9a5d2fe700 1 --2- 172.21.15.156:0/303354317 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a580a0a70 0x7f9a580a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.426+0000 7f9a5daff700 1 --2- 172.21.15.156:0/303354317 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9a58134120 0x7f9a5813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.426+0000 7f9a4ffff700 1 -- 172.21.15.156:0/303354317 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3261517756 0 0) 0x7f9a5809dc00 con 0x7f9a580a1380 2023-09-30T22:24:06.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.426+0000 7f9a4ffff700 1 -- 172.21.15.156:0/303354317 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a440035b0 con 0x7f9a580a1380 2023-09-30T22:24:06.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.426+0000 7f9a5daff700 1 -- 172.21.15.156:0/303354317 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a580a0a70 msgr2=0x7f9a580a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:06.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.426+0000 7f9a5daff700 1 --2- 172.21.15.156:0/303354317 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a580a0a70 0x7f9a580a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.426+0000 7f9a5daff700 1 -- 172.21.15.156:0/303354317 >> v1:172.21.15.156:6789/0 conn(0x7f9a580a1380 legacy=0x7f9a58133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.426+0000 7f9a5daff700 1 -- 172.21.15.156:0/303354317 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5809e6a0 con 0x7f9a58134120 2023-09-30T22:24:06.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.426+0000 7f9a5daff700 1 --2- 172.21.15.156:0/303354317 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9a58134120 0x7f9a5813bce0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f9a50009dc0 tx=0x7f9a5000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b690147e00252ee0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:06.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.426+0000 7f9a4ffff700 1 -- 172.21.15.156:0/303354317 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5000e070 con 0x7f9a58134120 2023-09-30T22:24:06.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.426+0000 7f9a4ffff700 1 -- 172.21.15.156:0/303354317 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5000bb20 con 0x7f9a58134120 2023-09-30T22:24:06.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.426+0000 7f9a4ffff700 1 -- 172.21.15.156:0/303354317 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a50012430 con 0x7f9a58134120 2023-09-30T22:24:06.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.427+0000 7f9a5f562700 1 -- 172.21.15.156:0/303354317 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9a58134120 msgr2=0x7f9a5813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.427+0000 7f9a5f562700 1 --2- 172.21.15.156:0/303354317 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9a58134120 0x7f9a5813bce0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f9a50009dc0 tx=0x7f9a5000b330 comp rx=0 tx=0).stop 2023-09-30T22:24:06.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.427+0000 7f9a5f562700 1 -- 172.21.15.156:0/303354317 shutdown_connections 2023-09-30T22:24:06.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.427+0000 7f9a5f562700 1 --2- 172.21.15.156:0/303354317 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a580a0a70 0x7f9a580a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.427+0000 7f9a5f562700 1 --2- 172.21.15.156:0/303354317 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9a58134120 0x7f9a5813bce0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.427+0000 7f9a5f562700 1 -- 172.21.15.156:0/303354317 >> 172.21.15.156:0/303354317 conn(0x7f9a580a6610 msgr2=0x7f9a580a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:06.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.427+0000 7f9a5f562700 1 -- 172.21.15.156:0/303354317 shutdown_connections 2023-09-30T22:24:06.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.427+0000 7f9a5f562700 1 -- 172.21.15.156:0/303354317 wait complete. 2023-09-30T22:24:06.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.428+0000 7f9a5f562700 1 Processor -- start 2023-09-30T22:24:06.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.428+0000 7f9a5f562700 1 -- start start 2023-09-30T22:24:06.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.429+0000 7f9a5f562700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9a580a0a70 0x7f9a58122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.429+0000 7f9a5f562700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a580a1380 0x7f9a58122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.429+0000 7f9a5f562700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a58134120 0x7f9a58123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.429+0000 7f9a5f562700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a58123bd0 con 0x7f9a580a1380 2023-09-30T22:24:06.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.429+0000 7f9a5f562700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a581262b0 con 0x7f9a58134120 2023-09-30T22:24:06.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.429+0000 7f9a5f562700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a58125920 con 0x7f9a580a0a70 2023-09-30T22:24:06.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.429+0000 7f9a5cafd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a580a1380 0x7f9a58122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.429+0000 7f9a5cafd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a580a1380 0x7f9a58122c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41244/0 (socket says 172.21.15.156:41244) 2023-09-30T22:24:06.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.429+0000 7f9a5cafd700 1 -- 172.21.15.156:0/1316772672 learned_addr learned my addr 172.21.15.156:0/1316772672 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:06.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.429+0000 7f9a5daff700 1 --2- 172.21.15.156:0/1316772672 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a58134120 0x7f9a58123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.429+0000 7f9a5d2fe700 1 --2- 172.21.15.156:0/1316772672 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9a580a0a70 0x7f9a58122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.430+0000 7f9a5daff700 1 -- 172.21.15.156:0/1316772672 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9a580a0a70 msgr2=0x7f9a58122700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.430+0000 7f9a5daff700 1 --2- 172.21.15.156:0/1316772672 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9a580a0a70 0x7f9a58122700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.430+0000 7f9a5daff700 1 -- 172.21.15.156:0/1316772672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a580a1380 msgr2=0x7f9a58122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.430+0000 7f9a5daff700 1 --2- 172.21.15.156:0/1316772672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a580a1380 0x7f9a58122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.430+0000 7f9a5daff700 1 -- 172.21.15.156:0/1316772672 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a50009a70 con 0x7f9a58134120 2023-09-30T22:24:06.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.430+0000 7f9a5cafd700 1 --2- 172.21.15.156:0/1316772672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a580a1380 0x7f9a58122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:06.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.430+0000 7f9a5d2fe700 1 --2- 172.21.15.156:0/1316772672 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9a580a0a70 0x7f9a58122700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:06.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.430+0000 7f9a5daff700 1 --2- 172.21.15.156:0/1316772672 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a58134120 0x7f9a58123180 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9a50016000 tx=0x7f9a50004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:06.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.430+0000 7f9a4dffb700 1 -- 172.21.15.156:0/1316772672 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a50004800 con 0x7f9a58134120 2023-09-30T22:24:06.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.430+0000 7f9a4dffb700 1 -- 172.21.15.156:0/1316772672 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a50020070 con 0x7f9a58134120 2023-09-30T22:24:06.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.430+0000 7f9a5f562700 1 -- 172.21.15.156:0/1316772672 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a580a03e0 con 0x7f9a58134120 2023-09-30T22:24:06.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.430+0000 7f9a4dffb700 1 -- 172.21.15.156:0/1316772672 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a500276c0 con 0x7f9a58134120 2023-09-30T22:24:06.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.430+0000 7f9a5f562700 1 -- 172.21.15.156:0/1316772672 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a58133990 con 0x7f9a58134120 2023-09-30T22:24:06.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.431+0000 7f9a4dffb700 1 -- 172.21.15.156:0/1316772672 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9a50012430 con 0x7f9a58134120 2023-09-30T22:24:06.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.431+0000 7f9a4dffb700 1 -- 172.21.15.156:0/1316772672 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9a50022070 con 0x7f9a58134120 2023-09-30T22:24:06.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.431+0000 7f9a5f562700 1 -- 172.21.15.156:0/1316772672 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a581260d0 con 0x7f9a58134120 2023-09-30T22:24:06.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.436+0000 7f9a4dffb700 1 -- 172.21.15.156:0/1316772672 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9a50003e30 con 0x7f9a58134120 2023-09-30T22:24:06.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.496+0000 7f6a3bba8700 1 -- 172.21.15.156:0/736161688 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6a3411b390 con 0x7f6a34138e30 2023-09-30T22:24:06.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.497+0000 7f6a2a7fc700 1 -- 172.21.15.156:0/736161688 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6a2c024300 con 0x7f6a34138e30 2023-09-30T22:24:06.497 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:06.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.499+0000 7f6a3bba8700 1 -- 172.21.15.156:0/736161688 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a34138e30 msgr2=0x7f6a34119870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.499+0000 7f6a3bba8700 1 --2- 172.21.15.156:0/736161688 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a34138e30 0x7f6a34119870 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c00ef90 tx=0x7f6a2c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.499+0000 7f6a3bba8700 1 -- 172.21.15.156:0/736161688 shutdown_connections 2023-09-30T22:24:06.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.499+0000 7f6a3bba8700 1 --2- 172.21.15.156:0/736161688 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6a34138e30 0x7f6a34119870 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.499+0000 7f6a3bba8700 1 --2- 172.21.15.156:0/736161688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a34099a60 0x7f6a34118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.499+0000 7f6a3bba8700 1 --2- 172.21.15.156:0/736161688 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6a34133b80 0x7f6a34119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.499+0000 7f6a3bba8700 1 -- 172.21.15.156:0/736161688 >> 172.21.15.156:0/736161688 conn(0x7f6a340a2980 msgr2=0x7f6a34139880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:06.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.499+0000 7f6a3bba8700 1 -- 172.21.15.156:0/736161688 shutdown_connections 2023-09-30T22:24:06.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.499+0000 7f6a3bba8700 1 -- 172.21.15.156:0/736161688 wait complete. 2023-09-30T22:24:06.511 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:06.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.613+0000 7efd85fd2700 1 -- 172.21.15.156:0/3176862852 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efd8011e060 con 0x7efd8009ad40 2023-09-30T22:24:06.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.613+0000 7efd67fff700 1 -- 172.21.15.156:0/3176862852 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efd70023ba0 con 0x7efd8009ad40 2023-09-30T22:24:06.614 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:06.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.617+0000 7efd85fd2700 1 -- 172.21.15.156:0/3176862852 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd8009ad40 msgr2=0x7efd80121390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.617+0000 7efd85fd2700 1 --2- 172.21.15.156:0/3176862852 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd8009ad40 0x7efd80121390 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7efd70009c70 tx=0x7efd70004750 comp rx=0 tx=0).stop 2023-09-30T22:24:06.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.617+0000 7efd85fd2700 1 -- 172.21.15.156:0/3176862852 shutdown_connections 2023-09-30T22:24:06.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.617+0000 7efd85fd2700 1 --2- 172.21.15.156:0/3176862852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd80133f70 0x7efd80121e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.617+0000 7efd85fd2700 1 --2- 172.21.15.156:0/3176862852 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efd8009ad40 0x7efd80121390 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.617+0000 7efd85fd2700 1 --2- 172.21.15.156:0/3176862852 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efd800a0a70 0x7efd801218d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.617+0000 7efd85fd2700 1 -- 172.21.15.156:0/3176862852 >> 172.21.15.156:0/3176862852 conn(0x7efd80099c40 msgr2=0x7efd801332a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:06.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.617+0000 7efd85fd2700 1 -- 172.21.15.156:0/3176862852 shutdown_connections 2023-09-30T22:24:06.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.617+0000 7efd85fd2700 1 -- 172.21.15.156:0/3176862852 wait complete. 2023-09-30T22:24:06.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:06.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.637+0000 7f9a5f562700 1 -- 172.21.15.156:0/1316772672 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9a5804f2a0 con 0x7f9a58134120 2023-09-30T22:24:06.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.637+0000 7f9a4dffb700 1 -- 172.21.15.156:0/1316772672 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9a5001ab70 con 0x7f9a58134120 2023-09-30T22:24:06.637 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:06.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.640+0000 7f9a5f562700 1 -- 172.21.15.156:0/1316772672 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a58134120 msgr2=0x7f9a58123180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.640+0000 7f9a5f562700 1 --2- 172.21.15.156:0/1316772672 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a58134120 0x7f9a58123180 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9a50016000 tx=0x7f9a50004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.640+0000 7f9a5f562700 1 -- 172.21.15.156:0/1316772672 shutdown_connections 2023-09-30T22:24:06.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.640+0000 7f9a5f562700 1 --2- 172.21.15.156:0/1316772672 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a58134120 0x7f9a58123180 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.640+0000 7f9a5f562700 1 --2- 172.21.15.156:0/1316772672 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9a580a0a70 0x7f9a58122700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.640+0000 7f9a5f562700 1 --2- 172.21.15.156:0/1316772672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a580a1380 0x7f9a58122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.640+0000 7f9a5f562700 1 -- 172.21.15.156:0/1316772672 >> 172.21.15.156:0/1316772672 conn(0x7f9a580a6610 msgr2=0x7f9a5809ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:06.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.640+0000 7f9a5f562700 1 -- 172.21.15.156:0/1316772672 shutdown_connections 2023-09-30T22:24:06.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:06.640+0000 7f9a5f562700 1 -- 172.21.15.156:0/1316772672 wait complete. 2023-09-30T22:24:06.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:07.081 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:07.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.207+0000 7fa337286700 1 Processor -- start 2023-09-30T22:24:07.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.208+0000 7fa337286700 1 -- start start 2023-09-30T22:24:07.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.208+0000 7fa337286700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa330133900 0x7fa330133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:07.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.208+0000 7fa337286700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa3300a10b0 0x7fa33013b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:07.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.208+0000 7fa337286700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33009a760 con 0x7fa330134210 2023-09-30T22:24:07.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.208+0000 7fa337286700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3301336e0 con 0x7fa3300a10b0 2023-09-30T22:24:07.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.208+0000 7fa337286700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33009a080 con 0x7fa330133900 2023-09-30T22:24:07.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.208+0000 7fa335823700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa3300a10b0 0x7fa33013b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:07.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.208+0000 7fa335823700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa3300a10b0 0x7fa33013b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41250/0 (socket says 172.21.15.156:41250) 2023-09-30T22:24:07.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.208+0000 7fa335823700 1 -- 172.21.15.156:0/115269598 learned_addr learned my addr 172.21.15.156:0/115269598 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:07.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.208+0000 7fa334821700 1 --1- 172.21.15.156:0/115269598 >> v1:172.21.15.156:6789/0 conn(0x7fa330134210 0x7fa3300a09a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48752/0 (socket says 172.21.15.156:48752) 2023-09-30T22:24:07.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.208+0000 7fa335022700 1 --2- 172.21.15.156:0/115269598 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa330133900 0x7fa330133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:07.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.209+0000 7fa335022700 1 -- 172.21.15.156:0/115269598 >> v2:172.21.15.156:3300/0 conn(0x7fa3300a10b0 msgr2=0x7fa33013b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:07.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.209+0000 7fa335022700 1 --2- 172.21.15.156:0/115269598 >> v2:172.21.15.156:3300/0 conn(0x7fa3300a10b0 0x7fa33013b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.209+0000 7fa335022700 1 -- 172.21.15.156:0/115269598 >> v1:172.21.15.156:6789/0 conn(0x7fa330134210 legacy=0x7fa3300a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:07.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.209+0000 7fa335022700 1 -- 172.21.15.156:0/115269598 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3300a23e0 con 0x7fa330133900 2023-09-30T22:24:07.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.209+0000 7fa327fff700 1 -- 172.21.15.156:0/115269598 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 15332626 0 0) 0x7fa33009a760 con 0x7fa330134210 2023-09-30T22:24:07.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.209+0000 7fa335823700 1 --2- 172.21.15.156:0/115269598 >> v2:172.21.15.156:3300/0 conn(0x7fa3300a10b0 0x7fa33013b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:07.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.209+0000 7fa335022700 1 --2- 172.21.15.156:0/115269598 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa330133900 0x7fa330133cd0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa320009820 tx=0x7fa320009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f26242065857146 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:07.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.209+0000 7fa327fff700 1 -- 172.21.15.156:0/115269598 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa320005e30 con 0x7fa330133900 2023-09-30T22:24:07.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.209+0000 7fa327fff700 1 -- 172.21.15.156:0/115269598 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa320006030 con 0x7fa330133900 2023-09-30T22:24:07.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.209+0000 7fa327fff700 1 -- 172.21.15.156:0/115269598 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3200063c0 con 0x7fa330133900 2023-09-30T22:24:07.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.209+0000 7fa337286700 1 -- 172.21.15.156:0/115269598 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa330133900 msgr2=0x7fa330133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:07.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.209+0000 7fa337286700 1 --2- 172.21.15.156:0/115269598 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa330133900 0x7fa330133cd0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa320009820 tx=0x7fa320009b30 comp rx=0 tx=0).stop 2023-09-30T22:24:07.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.209+0000 7fa337286700 1 -- 172.21.15.156:0/115269598 shutdown_connections 2023-09-30T22:24:07.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.209+0000 7fa337286700 1 --2- 172.21.15.156:0/115269598 >> v2:172.21.15.156:3300/0 conn(0x7fa3300a10b0 0x7fa33013b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.209+0000 7fa337286700 1 --2- 172.21.15.156:0/115269598 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa330133900 0x7fa330133cd0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.209+0000 7fa337286700 1 -- 172.21.15.156:0/115269598 >> 172.21.15.156:0/115269598 conn(0x7fa3300a2980 msgr2=0x7fa3300a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:07.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.210+0000 7fa337286700 1 -- 172.21.15.156:0/115269598 shutdown_connections 2023-09-30T22:24:07.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.210+0000 7fa337286700 1 -- 172.21.15.156:0/115269598 wait complete. 2023-09-30T22:24:07.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.210+0000 7fa337286700 1 Processor -- start 2023-09-30T22:24:07.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.210+0000 7fa337286700 1 -- start start 2023-09-30T22:24:07.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.211+0000 7fa337286700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3300a10b0 0x7fa33011d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:07.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.211+0000 7fa337286700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa330133900 0x7fa33011dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:07.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.211+0000 7fa337286700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa330134210 0x7fa33011e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:07.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.211+0000 7fa337286700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa330121bc0 con 0x7fa3300a10b0 2023-09-30T22:24:07.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.211+0000 7fa337286700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa330121200 con 0x7fa330134210 2023-09-30T22:24:07.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.211+0000 7fa337286700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3301205b0 con 0x7fa330133900 2023-09-30T22:24:07.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.211+0000 7fa335022700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3300a10b0 0x7fa33011d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:07.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.211+0000 7fa335823700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa330134210 0x7fa33011e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:07.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.211+0000 7fa335022700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3300a10b0 0x7fa33011d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41254/0 (socket says 172.21.15.156:41254) 2023-09-30T22:24:07.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.211+0000 7fa335022700 1 -- 172.21.15.156:0/1961109502 learned_addr learned my addr 172.21.15.156:0/1961109502 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:07.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.211+0000 7fa334821700 1 --2- 172.21.15.156:0/1961109502 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa330133900 0x7fa33011dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:07.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.211+0000 7fa335022700 1 -- 172.21.15.156:0/1961109502 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa330133900 msgr2=0x7fa33011dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:07.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.211+0000 7fa335022700 1 --2- 172.21.15.156:0/1961109502 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa330133900 0x7fa33011dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.211+0000 7fa335022700 1 -- 172.21.15.156:0/1961109502 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa330134210 msgr2=0x7fa33011e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:07.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.211+0000 7fa335022700 1 --2- 172.21.15.156:0/1961109502 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa330134210 0x7fa33011e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.211+0000 7fa335022700 1 -- 172.21.15.156:0/1961109502 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa328009b30 con 0x7fa3300a10b0 2023-09-30T22:24:07.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.211+0000 7fa335823700 1 --2- 172.21.15.156:0/1961109502 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa330134210 0x7fa33011e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:07.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.211+0000 7fa335022700 1 --2- 172.21.15.156:0/1961109502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3300a10b0 0x7fa33011d780 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fa33009a1c0 tx=0x7fa320004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:07.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.212+0000 7fa325ffb700 1 -- 172.21.15.156:0/1961109502 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3200061a0 con 0x7fa3300a10b0 2023-09-30T22:24:07.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.212+0000 7fa325ffb700 1 -- 172.21.15.156:0/1961109502 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa320020070 con 0x7fa3300a10b0 2023-09-30T22:24:07.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.212+0000 7fa325ffb700 1 -- 172.21.15.156:0/1961109502 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa320006540 con 0x7fa3300a10b0 2023-09-30T22:24:07.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.212+0000 7fa337286700 1 -- 172.21.15.156:0/1961109502 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa320009430 con 0x7fa3300a10b0 2023-09-30T22:24:07.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.212+0000 7fa337286700 1 -- 172.21.15.156:0/1961109502 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa33009a2c0 con 0x7fa3300a10b0 2023-09-30T22:24:07.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.212+0000 7fa325ffb700 1 -- 172.21.15.156:0/1961109502 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa320022030 con 0x7fa3300a10b0 2023-09-30T22:24:07.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.213+0000 7fa325ffb700 1 -- 172.21.15.156:0/1961109502 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa320040c90 con 0x7fa3300a10b0 2023-09-30T22:24:07.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.213+0000 7fa337286700 1 -- 172.21.15.156:0/1961109502 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa33011a590 con 0x7fa3300a10b0 2023-09-30T22:24:07.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.217+0000 7fa325ffb700 1 -- 172.21.15.156:0/1961109502 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa3200247e0 con 0x7fa3300a10b0 2023-09-30T22:24:07.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.401+0000 7fa337286700 1 -- 172.21.15.156:0/1961109502 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa33011f390 con 0x7fa3300a10b0 2023-09-30T22:24:07.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.402+0000 7fa325ffb700 1 -- 172.21.15.156:0/1961109502 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa32001b410 con 0x7fa3300a10b0 2023-09-30T22:24:07.402 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:07.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.404+0000 7fa337286700 1 -- 172.21.15.156:0/1961109502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3300a10b0 msgr2=0x7fa33011d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:07.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.404+0000 7fa337286700 1 --2- 172.21.15.156:0/1961109502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3300a10b0 0x7fa33011d780 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fa33009a1c0 tx=0x7fa320004750 comp rx=0 tx=0).stop 2023-09-30T22:24:07.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.404+0000 7fa337286700 1 -- 172.21.15.156:0/1961109502 shutdown_connections 2023-09-30T22:24:07.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.404+0000 7fa337286700 1 --2- 172.21.15.156:0/1961109502 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa330134210 0x7fa33011e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.404+0000 7fa337286700 1 --2- 172.21.15.156:0/1961109502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3300a10b0 0x7fa33011d780 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.404+0000 7fa337286700 1 --2- 172.21.15.156:0/1961109502 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa330133900 0x7fa33011dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.404+0000 7fa337286700 1 -- 172.21.15.156:0/1961109502 >> 172.21.15.156:0/1961109502 conn(0x7fa3300a2980 msgr2=0x7fa3301bab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:07.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.404+0000 7fa337286700 1 -- 172.21.15.156:0/1961109502 shutdown_connections 2023-09-30T22:24:07.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.404+0000 7fa337286700 1 -- 172.21.15.156:0/1961109502 wait complete. 2023-09-30T22:24:07.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:07.512 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:07.632 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:07.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.635+0000 7f814ea33700 1 Processor -- start 2023-09-30T22:24:07.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.636+0000 7f814ea33700 1 -- start start 2023-09-30T22:24:07.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.636+0000 7f814ea33700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8148133ad0 0x7f8148133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:07.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.636+0000 7f814ea33700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81481300a0 0x7f81481304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:07.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.636+0000 7f814ea33700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f81481309f0 0x7f814813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:07.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.636+0000 7f814ea33700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f814806b2d0 con 0x7f81481309f0 2023-09-30T22:24:07.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.636+0000 7f814ea33700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8148133610 con 0x7f81481300a0 2023-09-30T22:24:07.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.636+0000 7f814ea33700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f814809a500 con 0x7f8148133ad0 2023-09-30T22:24:07.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.636+0000 7f81477fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81481300a0 0x7f81481304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:07.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.636+0000 7f814cfd0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f81481309f0 0x7f814813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:07.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.636+0000 7f81477fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81481300a0 0x7f81481304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59586/0 (socket says 172.21.15.156:59586) 2023-09-30T22:24:07.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.636+0000 7f814cfd0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f81481309f0 0x7f814813a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41264/0 (socket says 172.21.15.156:41264) 2023-09-30T22:24:07.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.636+0000 7f81477fe700 1 -- 172.21.15.156:0/786592802 learned_addr learned my addr 172.21.15.156:0/786592802 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:07.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.636+0000 7f8147fff700 1 --2- 172.21.15.156:0/786592802 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8148133ad0 0x7f8148133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:07.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.636+0000 7f814cfd0700 1 -- 172.21.15.156:0/786592802 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8148133ad0 msgr2=0x7f8148133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:07.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.636+0000 7f814cfd0700 1 --2- 172.21.15.156:0/786592802 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8148133ad0 0x7f8148133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.636+0000 7f814cfd0700 1 -- 172.21.15.156:0/786592802 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81481300a0 msgr2=0x7f81481304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:07.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.636+0000 7f814cfd0700 1 --2- 172.21.15.156:0/786592802 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81481300a0 0x7f81481304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.636+0000 7f814cfd0700 1 -- 172.21.15.156:0/786592802 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81481338b0 con 0x7f81481309f0 2023-09-30T22:24:07.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.636+0000 7f8147fff700 1 --2- 172.21.15.156:0/786592802 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8148133ad0 0x7f8148133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:07.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.637+0000 7f814cfd0700 1 --2- 172.21.15.156:0/786592802 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81481309f0 0x7f814813a980 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f8140009d90 tx=0x7f814000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44c3d9b2193ec87 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:07.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.637+0000 7f8146ffd700 1 -- 172.21.15.156:0/786592802 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814000e070 con 0x7f81481309f0 2023-09-30T22:24:07.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.637+0000 7f8146ffd700 1 -- 172.21.15.156:0/786592802 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814000bb20 con 0x7f81481309f0 2023-09-30T22:24:07.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.637+0000 7f8146ffd700 1 -- 172.21.15.156:0/786592802 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8140012430 con 0x7f81481309f0 2023-09-30T22:24:07.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.637+0000 7f814ea33700 1 -- 172.21.15.156:0/786592802 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81481309f0 msgr2=0x7f814813a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:07.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.637+0000 7f814ea33700 1 --2- 172.21.15.156:0/786592802 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81481309f0 0x7f814813a980 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f8140009d90 tx=0x7f814000b330 comp rx=0 tx=0).stop 2023-09-30T22:24:07.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.637+0000 7f814ea33700 1 -- 172.21.15.156:0/786592802 shutdown_connections 2023-09-30T22:24:07.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.637+0000 7f814ea33700 1 --2- 172.21.15.156:0/786592802 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81481309f0 0x7f814813a980 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.637+0000 7f814ea33700 1 --2- 172.21.15.156:0/786592802 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8148133ad0 0x7f8148133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.637+0000 7f814ea33700 1 --2- 172.21.15.156:0/786592802 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81481300a0 0x7f81481304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.638+0000 7f814ea33700 1 -- 172.21.15.156:0/786592802 >> 172.21.15.156:0/786592802 conn(0x7f8148099c40 msgr2=0x7f81480a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:07.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.638+0000 7f814ea33700 1 -- 172.21.15.156:0/786592802 shutdown_connections 2023-09-30T22:24:07.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.638+0000 7f814ea33700 1 -- 172.21.15.156:0/786592802 wait complete. 2023-09-30T22:24:07.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.638+0000 7f814ea33700 1 Processor -- start 2023-09-30T22:24:07.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.639+0000 7f814ea33700 1 -- start start 2023-09-30T22:24:07.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.639+0000 7f814ea33700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81481300a0 0x7f814811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:07.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.639+0000 7f814ea33700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81481309f0 0x7f814811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:07.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.639+0000 7f814ea33700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8148133ad0 0x7f814811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:07.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.639+0000 7f814ea33700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814812fbd0 con 0x7f81481309f0 2023-09-30T22:24:07.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.639+0000 7f814ea33700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f814812dd00 con 0x7f8148133ad0 2023-09-30T22:24:07.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.639+0000 7f814ea33700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f814811fbf0 con 0x7f81481300a0 2023-09-30T22:24:07.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.639+0000 7f81477fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81481309f0 0x7f814811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:07.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.639+0000 7f8147fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81481300a0 0x7f814811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:07.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.639+0000 7f81477fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81481309f0 0x7f814811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41280/0 (socket says 172.21.15.156:41280) 2023-09-30T22:24:07.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.639+0000 7f81477fe700 1 -- 172.21.15.156:0/2844745854 learned_addr learned my addr 172.21.15.156:0/2844745854 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:07.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.639+0000 7f814cfd0700 1 --2- 172.21.15.156:0/2844745854 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8148133ad0 0x7f814811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:07.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.639+0000 7f81477fe700 1 -- 172.21.15.156:0/2844745854 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81481300a0 msgr2=0x7f814811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:07.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.639+0000 7f81477fe700 1 --2- 172.21.15.156:0/2844745854 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81481300a0 0x7f814811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.639+0000 7f81477fe700 1 -- 172.21.15.156:0/2844745854 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8148133ad0 msgr2=0x7f814811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:07.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.639+0000 7f81477fe700 1 --2- 172.21.15.156:0/2844745854 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8148133ad0 0x7f814811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.640+0000 7f81477fe700 1 -- 172.21.15.156:0/2844745854 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81380094a0 con 0x7f81481309f0 2023-09-30T22:24:07.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.640+0000 7f814cfd0700 1 --2- 172.21.15.156:0/2844745854 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8148133ad0 0x7f814811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:07.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.640+0000 7f8147fff700 1 --2- 172.21.15.156:0/2844745854 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81481300a0 0x7f814811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:07.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.640+0000 7f81477fe700 1 --2- 172.21.15.156:0/2844745854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81481309f0 0x7f814811df80 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f813c00e800 tx=0x7f813c00eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:07.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.640+0000 7f8144ff9700 1 -- 172.21.15.156:0/2844745854 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c013680 con 0x7f81481309f0 2023-09-30T22:24:07.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.640+0000 7f8144ff9700 1 -- 172.21.15.156:0/2844745854 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813c0137e0 con 0x7f81481309f0 2023-09-30T22:24:07.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.640+0000 7f814ea33700 1 -- 172.21.15.156:0/2844745854 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8140009a70 con 0x7f81481309f0 2023-09-30T22:24:07.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.640+0000 7f8144ff9700 1 -- 172.21.15.156:0/2844745854 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c013b70 con 0x7f81481309f0 2023-09-30T22:24:07.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.640+0000 7f814ea33700 1 -- 172.21.15.156:0/2844745854 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f814811feb0 con 0x7f81481309f0 2023-09-30T22:24:07.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.641+0000 7f8144ff9700 1 -- 172.21.15.156:0/2844745854 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f813c013cd0 con 0x7f81481309f0 2023-09-30T22:24:07.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.641+0000 7f814ea33700 1 -- 172.21.15.156:0/2844745854 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f814804f2a0 con 0x7f81481309f0 2023-09-30T22:24:07.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.641+0000 7f8144ff9700 1 -- 172.21.15.156:0/2844745854 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f813c03f580 con 0x7f81481309f0 2023-09-30T22:24:07.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.646+0000 7f8144ff9700 1 -- 172.21.15.156:0/2844745854 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f813c01be10 con 0x7f81481309f0 2023-09-30T22:24:07.652 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:07.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.760+0000 7f9df16dd700 1 Processor -- start 2023-09-30T22:24:07.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.760+0000 7f9df16dd700 1 -- start start 2023-09-30T22:24:07.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.760+0000 7f9df16dd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9dec12d2f0 0x7f9dec12d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:07.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.760+0000 7f9df16dd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9dec130e70 0x7f9dec138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:07.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.760+0000 7f9df16dd700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dec0a24b0 con 0x7f9dec130350 2023-09-30T22:24:07.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.761+0000 7f9df16dd700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dec072520 con 0x7f9dec130e70 2023-09-30T22:24:07.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.761+0000 7f9df16dd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec09cd30 con 0x7f9dec12d2f0 2023-09-30T22:24:07.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.761+0000 7f9deaffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9dec12d2f0 0x7f9dec12d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:07.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.761+0000 7f9deb7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9dec130e70 0x7f9dec138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:07.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.761+0000 7f9deaffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9dec12d2f0 0x7f9dec12d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44510/0 (socket says 172.21.15.156:44510) 2023-09-30T22:24:07.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.761+0000 7f9deaffd700 1 -- 172.21.15.156:0/1870924383 learned_addr learned my addr 172.21.15.156:0/1870924383 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:07.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.761+0000 7f9deaffd700 1 -- 172.21.15.156:0/1870924383 >> v2:172.21.15.156:3300/0 conn(0x7f9dec130e70 msgr2=0x7f9dec138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:07.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.761+0000 7f9deaffd700 1 --2- 172.21.15.156:0/1870924383 >> v2:172.21.15.156:3300/0 conn(0x7f9dec130e70 0x7f9dec138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.761+0000 7f9deaffd700 1 -- 172.21.15.156:0/1870924383 >> v1:172.21.15.156:6789/0 conn(0x7f9dec130350 legacy=0x7f9dec130760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:07.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.761+0000 7f9deaffd700 1 -- 172.21.15.156:0/1870924383 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec09bbb0 con 0x7f9dec12d2f0 2023-09-30T22:24:07.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.761+0000 7f9deb7fe700 1 --2- 172.21.15.156:0/1870924383 >> v2:172.21.15.156:3300/0 conn(0x7f9dec130e70 0x7f9dec138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:07.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.761+0000 7f9deaffd700 1 --2- 172.21.15.156:0/1870924383 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9dec12d2f0 0x7f9dec12d6c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc006fd0 tx=0x7f9ddc00bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8a4095e5038db67 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:07.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.761+0000 7f9de9ffb700 1 -- 172.21.15.156:0/1870924383 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc005e30 con 0x7f9dec12d2f0 2023-09-30T22:24:07.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.761+0000 7f9de9ffb700 1 -- 172.21.15.156:0/1870924383 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ddc004030 con 0x7f9dec12d2f0 2023-09-30T22:24:07.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.761+0000 7f9de9ffb700 1 -- 172.21.15.156:0/1870924383 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc0043e0 con 0x7f9dec12d2f0 2023-09-30T22:24:07.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.762+0000 7f9df16dd700 1 -- 172.21.15.156:0/1870924383 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9dec12d2f0 msgr2=0x7f9dec12d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:07.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.762+0000 7f9df16dd700 1 --2- 172.21.15.156:0/1870924383 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9dec12d2f0 0x7f9dec12d6c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc006fd0 tx=0x7f9ddc00bc80 comp rx=0 tx=0).stop 2023-09-30T22:24:07.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.762+0000 7f9df16dd700 1 -- 172.21.15.156:0/1870924383 shutdown_connections 2023-09-30T22:24:07.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.762+0000 7f9df16dd700 1 --2- 172.21.15.156:0/1870924383 >> v2:172.21.15.156:3300/0 conn(0x7f9dec130e70 0x7f9dec138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.762+0000 7f9df16dd700 1 --2- 172.21.15.156:0/1870924383 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9dec12d2f0 0x7f9dec12d6c0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.762+0000 7f9df16dd700 1 -- 172.21.15.156:0/1870924383 >> 172.21.15.156:0/1870924383 conn(0x7f9dec0a2980 msgr2=0x7f9dec0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:07.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.762+0000 7f9df16dd700 1 -- 172.21.15.156:0/1870924383 shutdown_connections 2023-09-30T22:24:07.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.762+0000 7f9df16dd700 1 -- 172.21.15.156:0/1870924383 wait complete. 2023-09-30T22:24:07.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.763+0000 7f9df16dd700 1 Processor -- start 2023-09-30T22:24:07.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.763+0000 7f9df16dd700 1 -- start start 2023-09-30T22:24:07.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.764+0000 7f9df16dd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9dec12d2f0 0x7f9dec11aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:07.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.764+0000 7f9df16dd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9dec130350 0x7f9dec11b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:07.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.764+0000 7f9df16dd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9dec130e70 0x7f9dec11b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:07.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.764+0000 7f9df16dd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec11e510 con 0x7f9dec130350 2023-09-30T22:24:07.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.764+0000 7f9df16dd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec12ecd0 con 0x7f9dec130e70 2023-09-30T22:24:07.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.764+0000 7f9df16dd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec09b490 con 0x7f9dec12d2f0 2023-09-30T22:24:07.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.764+0000 7f9deaffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9dec12d2f0 0x7f9dec11aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:07.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.764+0000 7f9deaffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9dec12d2f0 0x7f9dec11aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44518/0 (socket says 172.21.15.156:44518) 2023-09-30T22:24:07.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.764+0000 7f9deaffd700 1 -- 172.21.15.156:0/1520521726 learned_addr learned my addr 172.21.15.156:0/1520521726 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:07.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.764+0000 7f9dea7fc700 1 --2- 172.21.15.156:0/1520521726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9dec130350 0x7f9dec11b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:07.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.764+0000 7f9deb7fe700 1 --2- 172.21.15.156:0/1520521726 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9dec130e70 0x7f9dec11b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:07.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.765+0000 7f9deaffd700 1 -- 172.21.15.156:0/1520521726 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9dec130e70 msgr2=0x7f9dec11b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:07.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.765+0000 7f9deaffd700 1 --2- 172.21.15.156:0/1520521726 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9dec130e70 0x7f9dec11b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.765+0000 7f9deaffd700 1 -- 172.21.15.156:0/1520521726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9dec130350 msgr2=0x7f9dec11b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:07.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.765+0000 7f9deaffd700 1 --2- 172.21.15.156:0/1520521726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9dec130350 0x7f9dec11b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.765+0000 7f9deaffd700 1 -- 172.21.15.156:0/1520521726 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de400f050 con 0x7f9dec12d2f0 2023-09-30T22:24:07.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.765+0000 7f9deaffd700 1 --2- 172.21.15.156:0/1520521726 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9dec12d2f0 0x7f9dec11aad0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9dec09ce70 tx=0x7f9ddc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:07.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.765+0000 7f9dd37fe700 1 -- 172.21.15.156:0/1520521726 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc00c860 con 0x7f9dec12d2f0 2023-09-30T22:24:07.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.765+0000 7f9dd37fe700 1 -- 172.21.15.156:0/1520521726 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ddc00c9c0 con 0x7f9dec12d2f0 2023-09-30T22:24:07.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.765+0000 7f9dd37fe700 1 -- 172.21.15.156:0/1520521726 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc00cd50 con 0x7f9dec12d2f0 2023-09-30T22:24:07.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.765+0000 7f9df16dd700 1 -- 172.21.15.156:0/1520521726 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ddc00b5b0 con 0x7f9dec12d2f0 2023-09-30T22:24:07.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.765+0000 7f9df16dd700 1 -- 172.21.15.156:0/1520521726 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dec11dca0 con 0x7f9dec12d2f0 2023-09-30T22:24:07.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.766+0000 7f9dd37fe700 1 -- 172.21.15.156:0/1520521726 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9ddc00f460 con 0x7f9dec12d2f0 2023-09-30T22:24:07.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.766+0000 7f9df16dd700 1 -- 172.21.15.156:0/1520521726 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dec11d8e0 con 0x7f9dec12d2f0 2023-09-30T22:24:07.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.766+0000 7f9dd37fe700 1 -- 172.21.15.156:0/1520521726 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9ddc0419b0 con 0x7f9dec12d2f0 2023-09-30T22:24:07.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.771+0000 7f9dd37fe700 1 -- 172.21.15.156:0/1520521726 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9ddc02d980 con 0x7f9dec12d2f0 2023-09-30T22:24:07.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.780+0000 7f5141101700 1 Processor -- start 2023-09-30T22:24:07.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.780+0000 7f5141101700 1 -- start start 2023-09-30T22:24:07.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.780+0000 7f5141101700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f513c0a1550 0x7f513c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:07.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.780+0000 7f5141101700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f513c139200 0x7f513c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:07.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.780+0000 7f5141101700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f513c09e9d0 con 0x7f513c0a0a70 2023-09-30T22:24:07.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.780+0000 7f5141101700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f513c09dc00 con 0x7f513c139200 2023-09-30T22:24:07.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.780+0000 7f5141101700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f513c09dec0 con 0x7f513c0a1550 2023-09-30T22:24:07.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.780+0000 7f513a59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f513c0a1550 0x7f513c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:07.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.780+0000 7f513ad9d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f513c0a0a70 0x7f513c0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48776/0 (socket says 172.21.15.156:48776) 2023-09-30T22:24:07.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.781+0000 7f513ad9d700 1 -- 172.21.15.156:0/3119253704 learned_addr learned my addr 172.21.15.156:0/3119253704 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:07.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.781+0000 7f513b59e700 1 --2- 172.21.15.156:0/3119253704 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f513c139200 0x7f513c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:07.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.781+0000 7f5139d9b700 1 -- 172.21.15.156:0/3119253704 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 162151015 0 0) 0x7f513c09e9d0 con 0x7f513c0a0a70 2023-09-30T22:24:07.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.781+0000 7f5139d9b700 1 -- 172.21.15.156:0/3119253704 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51240035b0 con 0x7f513c0a0a70 2023-09-30T22:24:07.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.781+0000 7f513b59e700 1 -- 172.21.15.156:0/3119253704 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f513c0a1550 msgr2=0x7f513c138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:07.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.781+0000 7f513b59e700 1 --2- 172.21.15.156:0/3119253704 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f513c0a1550 0x7f513c138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.781+0000 7f513b59e700 1 -- 172.21.15.156:0/3119253704 >> v1:172.21.15.156:6789/0 conn(0x7f513c0a0a70 legacy=0x7f513c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:07.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.781+0000 7f513b59e700 1 -- 172.21.15.156:0/3119253704 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513c09e6a0 con 0x7f513c139200 2023-09-30T22:24:07.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.781+0000 7f513b59e700 1 --2- 172.21.15.156:0/3119253704 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f513c139200 0x7f513c13b5e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f5134009dc0 tx=0x7f513400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cfe7dbefbee449 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:07.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.781+0000 7f5139d9b700 1 -- 172.21.15.156:0/3119253704 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513400e070 con 0x7f513c139200 2023-09-30T22:24:07.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.781+0000 7f5139d9b700 1 -- 172.21.15.156:0/3119253704 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513400bb20 con 0x7f513c139200 2023-09-30T22:24:07.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.781+0000 7f5139d9b700 1 -- 172.21.15.156:0/3119253704 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5134012430 con 0x7f513c139200 2023-09-30T22:24:07.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.782+0000 7f5141101700 1 -- 172.21.15.156:0/3119253704 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f513c139200 msgr2=0x7f513c13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:07.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.782+0000 7f5141101700 1 --2- 172.21.15.156:0/3119253704 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f513c139200 0x7f513c13b5e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f5134009dc0 tx=0x7f513400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:07.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.782+0000 7f5141101700 1 -- 172.21.15.156:0/3119253704 shutdown_connections 2023-09-30T22:24:07.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.782+0000 7f5141101700 1 --2- 172.21.15.156:0/3119253704 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f513c139200 0x7f513c13b5e0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.782+0000 7f5141101700 1 --2- 172.21.15.156:0/3119253704 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f513c0a1550 0x7f513c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.782+0000 7f5141101700 1 -- 172.21.15.156:0/3119253704 >> 172.21.15.156:0/3119253704 conn(0x7f513c0a6610 msgr2=0x7f513c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:07.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.782+0000 7f5141101700 1 -- 172.21.15.156:0/3119253704 shutdown_connections 2023-09-30T22:24:07.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.782+0000 7f5141101700 1 -- 172.21.15.156:0/3119253704 wait complete. 2023-09-30T22:24:07.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.783+0000 7f5141101700 1 Processor -- start 2023-09-30T22:24:07.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.783+0000 7f5141101700 1 -- start start 2023-09-30T22:24:07.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.783+0000 7f5141101700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f513c0a0a70 0x7f513c120610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:07.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.784+0000 7f5141101700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f513c0a1550 0x7f513c120b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:07.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.784+0000 7f5141101700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f513c139200 0x7f513c121090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:07.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.784+0000 7f5141101700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513c124130 con 0x7f513c0a1550 2023-09-30T22:24:07.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.784+0000 7f5141101700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f513c122840 con 0x7f513c139200 2023-09-30T22:24:07.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.784+0000 7f5141101700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f513c09cb80 con 0x7f513c0a0a70 2023-09-30T22:24:07.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.784+0000 7f513ad9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f513c0a0a70 0x7f513c120610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:07.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.784+0000 7f513a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f513c0a1550 0x7f513c120b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:07.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.784+0000 7f513ad9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f513c0a0a70 0x7f513c120610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44534/0 (socket says 172.21.15.156:44534) 2023-09-30T22:24:07.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.784+0000 7f513a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f513c0a1550 0x7f513c120b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41310/0 (socket says 172.21.15.156:41310) 2023-09-30T22:24:07.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.784+0000 7f513ad9d700 1 -- 172.21.15.156:0/2140073803 learned_addr learned my addr 172.21.15.156:0/2140073803 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:07.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.784+0000 7f513b59e700 1 --2- 172.21.15.156:0/2140073803 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f513c139200 0x7f513c121090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:07.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.784+0000 7f513a59c700 1 -- 172.21.15.156:0/2140073803 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f513c0a0a70 msgr2=0x7f513c120610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:07.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.784+0000 7f513a59c700 1 --2- 172.21.15.156:0/2140073803 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f513c0a0a70 0x7f513c120610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.784+0000 7f513a59c700 1 -- 172.21.15.156:0/2140073803 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f513c139200 msgr2=0x7f513c121090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:07.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.784+0000 7f513a59c700 1 --2- 172.21.15.156:0/2140073803 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f513c139200 0x7f513c121090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.784+0000 7f513a59c700 1 -- 172.21.15.156:0/2140073803 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5134009a70 con 0x7f513c0a1550 2023-09-30T22:24:07.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.784+0000 7f513a59c700 1 --2- 172.21.15.156:0/2140073803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f513c0a1550 0x7f513c120b50 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f513000e900 tx=0x7f513000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:07.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.784+0000 7f51237fe700 1 -- 172.21.15.156:0/2140073803 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5130013680 con 0x7f513c0a1550 2023-09-30T22:24:07.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.784+0000 7f51237fe700 1 -- 172.21.15.156:0/2140073803 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51300137e0 con 0x7f513c0a1550 2023-09-30T22:24:07.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.785+0000 7f5141101700 1 -- 172.21.15.156:0/2140073803 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f513c122220 con 0x7f513c0a1550 2023-09-30T22:24:07.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.785+0000 7f51237fe700 1 -- 172.21.15.156:0/2140073803 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5130013b50 con 0x7f513c0a1550 2023-09-30T22:24:07.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.785+0000 7f5141101700 1 -- 172.21.15.156:0/2140073803 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f513c122a10 con 0x7f513c0a1550 2023-09-30T22:24:07.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.785+0000 7f5141101700 1 -- 172.21.15.156:0/2140073803 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f513c04f2a0 con 0x7f513c0a1550 2023-09-30T22:24:07.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.786+0000 7f51237fe700 1 -- 172.21.15.156:0/2140073803 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5130013cb0 con 0x7f513c0a1550 2023-09-30T22:24:07.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.786+0000 7f51237fe700 1 -- 172.21.15.156:0/2140073803 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f51300473b0 con 0x7f513c0a1550 2023-09-30T22:24:07.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.791+0000 7f51237fe700 1 -- 172.21.15.156:0/2140073803 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f513001be10 con 0x7f513c0a1550 2023-09-30T22:24:07.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.844+0000 7f814ea33700 1 -- 172.21.15.156:0/2844745854 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f81480727b0 con 0x7f81481309f0 2023-09-30T22:24:07.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.844+0000 7f8144ff9700 1 -- 172.21.15.156:0/2844745854 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f813c021070 con 0x7f81481309f0 2023-09-30T22:24:07.845 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:07.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.846+0000 7f814ea33700 1 -- 172.21.15.156:0/2844745854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81481309f0 msgr2=0x7f814811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:07.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.846+0000 7f814ea33700 1 --2- 172.21.15.156:0/2844745854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81481309f0 0x7f814811df80 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f813c00e800 tx=0x7f813c00eb10 comp rx=0 tx=0).stop 2023-09-30T22:24:07.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.846+0000 7f814ea33700 1 -- 172.21.15.156:0/2844745854 shutdown_connections 2023-09-30T22:24:07.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.846+0000 7f814ea33700 1 --2- 172.21.15.156:0/2844745854 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8148133ad0 0x7f814811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.846+0000 7f814ea33700 1 --2- 172.21.15.156:0/2844745854 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81481300a0 0x7f814811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.846+0000 7f814ea33700 1 --2- 172.21.15.156:0/2844745854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81481309f0 0x7f814811df80 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.846+0000 7f814ea33700 1 -- 172.21.15.156:0/2844745854 >> 172.21.15.156:0/2844745854 conn(0x7f8148099c40 msgr2=0x7f814812e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:07.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.847+0000 7f814ea33700 1 -- 172.21.15.156:0/2844745854 shutdown_connections 2023-09-30T22:24:07.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.847+0000 7f814ea33700 1 -- 172.21.15.156:0/2844745854 wait complete. 2023-09-30T22:24:07.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:07.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.966+0000 7f9df16dd700 1 -- 172.21.15.156:0/1520521726 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9dec09cf30 con 0x7f9dec12d2f0 2023-09-30T22:24:07.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.966+0000 7f9dd37fe700 1 -- 172.21.15.156:0/1520521726 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9dec09cf30 con 0x7f9dec12d2f0 2023-09-30T22:24:07.967 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:07.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.968+0000 7f9df16dd700 1 -- 172.21.15.156:0/1520521726 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9dec12d2f0 msgr2=0x7f9dec11aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:07.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.968+0000 7f9df16dd700 1 --2- 172.21.15.156:0/1520521726 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9dec12d2f0 0x7f9dec11aad0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9dec09ce70 tx=0x7f9ddc004750 comp rx=0 tx=0).stop 2023-09-30T22:24:07.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.968+0000 7f9df16dd700 1 -- 172.21.15.156:0/1520521726 shutdown_connections 2023-09-30T22:24:07.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.968+0000 7f9df16dd700 1 --2- 172.21.15.156:0/1520521726 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9dec130e70 0x7f9dec11b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.968+0000 7f9df16dd700 1 --2- 172.21.15.156:0/1520521726 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9dec12d2f0 0x7f9dec11aad0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.968+0000 7f9df16dd700 1 --2- 172.21.15.156:0/1520521726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9dec130350 0x7f9dec11b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.968+0000 7f9df16dd700 1 -- 172.21.15.156:0/1520521726 >> 172.21.15.156:0/1520521726 conn(0x7f9dec0a2980 msgr2=0x7f9dec099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:07.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.968+0000 7f9df16dd700 1 -- 172.21.15.156:0/1520521726 shutdown_connections 2023-09-30T22:24:07.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.969+0000 7f9df16dd700 1 -- 172.21.15.156:0/1520521726 wait complete. 2023-09-30T22:24:07.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:07.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.988+0000 7f5141101700 1 -- 172.21.15.156:0/2140073803 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f513c072980 con 0x7f513c0a1550 2023-09-30T22:24:07.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.989+0000 7f51237fe700 1 -- 172.21.15.156:0/2140073803 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5130017070 con 0x7f513c0a1550 2023-09-30T22:24:07.989 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:07.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.991+0000 7f5141101700 1 -- 172.21.15.156:0/2140073803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f513c0a1550 msgr2=0x7f513c120b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:07.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.991+0000 7f5141101700 1 --2- 172.21.15.156:0/2140073803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f513c0a1550 0x7f513c120b50 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f513000e900 tx=0x7f513000ec10 comp rx=0 tx=0).stop 2023-09-30T22:24:07.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.991+0000 7f5141101700 1 -- 172.21.15.156:0/2140073803 shutdown_connections 2023-09-30T22:24:07.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.991+0000 7f5141101700 1 --2- 172.21.15.156:0/2140073803 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f513c139200 0x7f513c121090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.991+0000 7f5141101700 1 --2- 172.21.15.156:0/2140073803 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f513c0a0a70 0x7f513c120610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.991+0000 7f5141101700 1 --2- 172.21.15.156:0/2140073803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f513c0a1550 0x7f513c120b50 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.991+0000 7f5141101700 1 -- 172.21.15.156:0/2140073803 >> 172.21.15.156:0/2140073803 conn(0x7f513c0a6610 msgr2=0x7f513c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:07.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.991+0000 7f5141101700 1 -- 172.21.15.156:0/2140073803 shutdown_connections 2023-09-30T22:24:07.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:07.991+0000 7f5141101700 1 -- 172.21.15.156:0/2140073803 wait complete. 2023-09-30T22:24:08.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:08.416 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:08.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.540+0000 7fb1faec6700 1 Processor -- start 2023-09-30T22:24:08.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.540+0000 7fb1faec6700 1 -- start start 2023-09-30T22:24:08.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.540+0000 7fb1faec6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb1f4133ad0 0x7fb1f4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.540+0000 7fb1faec6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb1f4130bc0 0x7fb1f413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.540+0000 7fb1faec6700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f406b2d0 con 0x7fb1f41300a0 2023-09-30T22:24:08.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.540+0000 7fb1faec6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f4133610 con 0x7fb1f4133ad0 2023-09-30T22:24:08.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.540+0000 7fb1faec6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f409a500 con 0x7fb1f4130bc0 2023-09-30T22:24:08.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.541+0000 7fb1f8c62700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb1f4133ad0 0x7fb1f4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.541+0000 7fb1f9463700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb1f4130bc0 0x7fb1f413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.541+0000 7fb1f3fff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb1f41300a0 0x7fb1f41304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48790/0 (socket says 172.21.15.156:48790) 2023-09-30T22:24:08.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.541+0000 7fb1f3fff700 1 -- 172.21.15.156:0/1799955830 learned_addr learned my addr 172.21.15.156:0/1799955830 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:08.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.541+0000 7fb1f9463700 1 -- 172.21.15.156:0/1799955830 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb1f4133ad0 msgr2=0x7fb1f4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:08.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.541+0000 7fb1f9463700 1 --2- 172.21.15.156:0/1799955830 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb1f4133ad0 0x7fb1f4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.541+0000 7fb1f9463700 1 -- 172.21.15.156:0/1799955830 >> v1:172.21.15.156:6789/0 conn(0x7fb1f41300a0 legacy=0x7fb1f41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.541+0000 7fb1f9463700 1 -- 172.21.15.156:0/1799955830 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f41338b0 con 0x7fb1f4130bc0 2023-09-30T22:24:08.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.541+0000 7fb1f37fe700 1 -- 172.21.15.156:0/1799955830 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2128521821 0 0) 0x7fb1f406b2d0 con 0x7fb1f41300a0 2023-09-30T22:24:08.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.541+0000 7fb1f9463700 1 --2- 172.21.15.156:0/1799955830 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb1f4130bc0 0x7fb1f413b990 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec009dc0 tx=0x7fb1ec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45b4911f0c761e0f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:08.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.541+0000 7fb1f37fe700 1 -- 172.21.15.156:0/1799955830 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec00e070 con 0x7fb1f4130bc0 2023-09-30T22:24:08.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.541+0000 7fb1f37fe700 1 -- 172.21.15.156:0/1799955830 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ec00bb20 con 0x7fb1f4130bc0 2023-09-30T22:24:08.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.541+0000 7fb1f37fe700 1 -- 172.21.15.156:0/1799955830 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec012430 con 0x7fb1f4130bc0 2023-09-30T22:24:08.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.542+0000 7fb1faec6700 1 -- 172.21.15.156:0/1799955830 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb1f4130bc0 msgr2=0x7fb1f413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.542+0000 7fb1faec6700 1 --2- 172.21.15.156:0/1799955830 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb1f4130bc0 0x7fb1f413b990 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec009dc0 tx=0x7fb1ec00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:08.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.542+0000 7fb1faec6700 1 -- 172.21.15.156:0/1799955830 shutdown_connections 2023-09-30T22:24:08.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.542+0000 7fb1faec6700 1 --2- 172.21.15.156:0/1799955830 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb1f4133ad0 0x7fb1f4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.542+0000 7fb1faec6700 1 --2- 172.21.15.156:0/1799955830 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb1f4130bc0 0x7fb1f413b990 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.542+0000 7fb1faec6700 1 -- 172.21.15.156:0/1799955830 >> 172.21.15.156:0/1799955830 conn(0x7fb1f4099c40 msgr2=0x7fb1f40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:08.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.542+0000 7fb1faec6700 1 -- 172.21.15.156:0/1799955830 shutdown_connections 2023-09-30T22:24:08.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.542+0000 7fb1faec6700 1 -- 172.21.15.156:0/1799955830 wait complete. 2023-09-30T22:24:08.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.543+0000 7fb1faec6700 1 Processor -- start 2023-09-30T22:24:08.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.543+0000 7fb1faec6700 1 -- start start 2023-09-30T22:24:08.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.543+0000 7fb1faec6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb1f41300a0 0x7fb1f40713a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.543+0000 7fb1faec6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb1f4130bc0 0x7fb1f40718e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.543+0000 7fb1faec6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb1f4133ad0 0x7fb1f4071e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.543+0000 7fb1faec6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f4072870 con 0x7fb1f4133ad0 2023-09-30T22:24:08.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.543+0000 7fb1faec6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f411fd00 con 0x7fb1f4130bc0 2023-09-30T22:24:08.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.543+0000 7fb1faec6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f411f960 con 0x7fb1f41300a0 2023-09-30T22:24:08.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.543+0000 7fb1f8c62700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb1f41300a0 0x7fb1f40713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.543+0000 7fb1f8c62700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb1f41300a0 0x7fb1f40713a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44558/0 (socket says 172.21.15.156:44558) 2023-09-30T22:24:08.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.543+0000 7fb1f8c62700 1 -- 172.21.15.156:0/661264415 learned_addr learned my addr 172.21.15.156:0/661264415 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:08.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.543+0000 7fb1f9463700 1 --2- 172.21.15.156:0/661264415 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb1f4133ad0 0x7fb1f4071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.543+0000 7fb1f3fff700 1 --2- 172.21.15.156:0/661264415 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb1f4130bc0 0x7fb1f40718e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.544+0000 7fb1f8c62700 1 -- 172.21.15.156:0/661264415 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb1f4130bc0 msgr2=0x7fb1f40718e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.544+0000 7fb1f8c62700 1 --2- 172.21.15.156:0/661264415 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb1f4130bc0 0x7fb1f40718e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.544+0000 7fb1f8c62700 1 -- 172.21.15.156:0/661264415 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb1f4133ad0 msgr2=0x7fb1f4071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.544+0000 7fb1f8c62700 1 --2- 172.21.15.156:0/661264415 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb1f4133ad0 0x7fb1f4071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.544+0000 7fb1f8c62700 1 -- 172.21.15.156:0/661264415 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ec009a70 con 0x7fb1f41300a0 2023-09-30T22:24:08.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.544+0000 7fb1f9463700 1 --2- 172.21.15.156:0/661264415 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb1f4133ad0 0x7fb1f4071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:08.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.544+0000 7fb1f8c62700 1 --2- 172.21.15.156:0/661264415 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb1f41300a0 0x7fb1f40713a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800e9e0 tx=0x7fb1e800ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:08.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.544+0000 7fb1f17fa700 1 -- 172.21.15.156:0/661264415 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8009710 con 0x7fb1f41300a0 2023-09-30T22:24:08.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.544+0000 7fb1f17fa700 1 -- 172.21.15.156:0/661264415 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e800ee80 con 0x7fb1f41300a0 2023-09-30T22:24:08.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.544+0000 7fb1faec6700 1 -- 172.21.15.156:0/661264415 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f411ee50 con 0x7fb1f41300a0 2023-09-30T22:24:08.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.544+0000 7fb1f17fa700 1 -- 172.21.15.156:0/661264415 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e800ca50 con 0x7fb1f41300a0 2023-09-30T22:24:08.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.544+0000 7fb1faec6700 1 -- 172.21.15.156:0/661264415 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f411e090 con 0x7fb1f41300a0 2023-09-30T22:24:08.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.545+0000 7fb1f17fa700 1 -- 172.21.15.156:0/661264415 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb1e800cbb0 con 0x7fb1f41300a0 2023-09-30T22:24:08.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.545+0000 7fb1f17fa700 1 -- 172.21.15.156:0/661264415 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb1e803f580 con 0x7fb1f41300a0 2023-09-30T22:24:08.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.545+0000 7fb1faec6700 1 -- 172.21.15.156:0/661264415 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f406be10 con 0x7fb1f41300a0 2023-09-30T22:24:08.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.550+0000 7fb1f17fa700 1 -- 172.21.15.156:0/661264415 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb1e8021070 con 0x7fb1f41300a0 2023-09-30T22:24:08.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.735+0000 7fb1faec6700 1 -- 172.21.15.156:0/661264415 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb1f409cb20 con 0x7fb1f41300a0 2023-09-30T22:24:08.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.735+0000 7fb1f17fa700 1 -- 172.21.15.156:0/661264415 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb1e8013470 con 0x7fb1f41300a0 2023-09-30T22:24:08.735 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:08.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.737+0000 7fb1faec6700 1 -- 172.21.15.156:0/661264415 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb1f41300a0 msgr2=0x7fb1f40713a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.737+0000 7fb1faec6700 1 --2- 172.21.15.156:0/661264415 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb1f41300a0 0x7fb1f40713a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800e9e0 tx=0x7fb1e800ecf0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.737+0000 7fb1faec6700 1 -- 172.21.15.156:0/661264415 shutdown_connections 2023-09-30T22:24:08.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.737+0000 7fb1faec6700 1 --2- 172.21.15.156:0/661264415 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb1f4133ad0 0x7fb1f4071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.737+0000 7fb1faec6700 1 --2- 172.21.15.156:0/661264415 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb1f41300a0 0x7fb1f40713a0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.737+0000 7fb1faec6700 1 --2- 172.21.15.156:0/661264415 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb1f4130bc0 0x7fb1f40718e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.737+0000 7fb1faec6700 1 -- 172.21.15.156:0/661264415 >> 172.21.15.156:0/661264415 conn(0x7fb1f4099c40 msgr2=0x7fb1f4132ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:08.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.737+0000 7fb1faec6700 1 -- 172.21.15.156:0/661264415 shutdown_connections 2023-09-30T22:24:08.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.737+0000 7fb1faec6700 1 -- 172.21.15.156:0/661264415 wait complete. 2023-09-30T22:24:08.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:08.860 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:08.981 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:08.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.983+0000 7f7045b81700 1 Processor -- start 2023-09-30T22:24:08.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.983+0000 7f7045b81700 1 -- start start 2023-09-30T22:24:08.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.983+0000 7f7045b81700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f704009f350 0x7f7040136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.983+0000 7f7045b81700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70401371c0 0x7f70401395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.983+0000 7f7045b81700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f704009c970 con 0x7f704009e870 2023-09-30T22:24:08.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.983+0000 7f7045b81700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70400a0920 con 0x7f70401371c0 2023-09-30T22:24:08.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.983+0000 7f7045b81700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f704009f9c0 con 0x7f704009f350 2023-09-30T22:24:08.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.983+0000 7f703effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f704009f350 0x7f7040136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.984+0000 7f703f7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f704009e870 0x7f704009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48802/0 (socket says 172.21.15.156:48802) 2023-09-30T22:24:08.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.984+0000 7f703f7fe700 1 -- 172.21.15.156:0/2262580110 learned_addr learned my addr 172.21.15.156:0/2262580110 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:08.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.984+0000 7f703ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70401371c0 0x7f70401395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.985 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.984+0000 7f703effd700 1 -- 172.21.15.156:0/2262580110 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70401371c0 msgr2=0x7f70401395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:08.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.984+0000 7f703effd700 1 --2- 172.21.15.156:0/2262580110 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70401371c0 0x7f70401395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.984+0000 7f703e7fc700 1 -- 172.21.15.156:0/2262580110 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3076626495 0 0) 0x7f704009c970 con 0x7f704009e870 2023-09-30T22:24:08.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.984+0000 7f703effd700 1 -- 172.21.15.156:0/2262580110 >> v1:172.21.15.156:6789/0 conn(0x7f704009e870 legacy=0x7f704009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.984+0000 7f703effd700 1 -- 172.21.15.156:0/2262580110 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704009bab0 con 0x7f704009f350 2023-09-30T22:24:08.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.984+0000 7f703ffff700 1 --2- 172.21.15.156:0/2262580110 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70401371c0 0x7f70401395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:08.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.984+0000 7f703effd700 1 --2- 172.21.15.156:0/2262580110 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f704009f350 0x7f7040136c80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f7034009870 tx=0x7f7034009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d389cd3aa9ddabe2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:08.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.984+0000 7f703e7fc700 1 -- 172.21.15.156:0/2262580110 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7034011830 con 0x7f704009f350 2023-09-30T22:24:08.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.984+0000 7f703e7fc700 1 -- 172.21.15.156:0/2262580110 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7034011990 con 0x7f704009f350 2023-09-30T22:24:08.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.984+0000 7f703e7fc700 1 -- 172.21.15.156:0/2262580110 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7034011d20 con 0x7f704009f350 2023-09-30T22:24:08.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.985+0000 7f7045b81700 1 -- 172.21.15.156:0/2262580110 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f704009f350 msgr2=0x7f7040136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.985+0000 7f7045b81700 1 --2- 172.21.15.156:0/2262580110 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f704009f350 0x7f7040136c80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f7034009870 tx=0x7f7034009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:08.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.985+0000 7f7045b81700 1 -- 172.21.15.156:0/2262580110 shutdown_connections 2023-09-30T22:24:08.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.985+0000 7f7045b81700 1 --2- 172.21.15.156:0/2262580110 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70401371c0 0x7f70401395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.985+0000 7f7045b81700 1 --2- 172.21.15.156:0/2262580110 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f704009f350 0x7f7040136c80 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.985+0000 7f7045b81700 1 -- 172.21.15.156:0/2262580110 >> 172.21.15.156:0/2262580110 conn(0x7f70400a4430 msgr2=0x7f70400a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:08.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.985+0000 7f7045b81700 1 -- 172.21.15.156:0/2262580110 shutdown_connections 2023-09-30T22:24:08.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.985+0000 7f7045b81700 1 -- 172.21.15.156:0/2262580110 wait complete. 2023-09-30T22:24:08.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.986+0000 7f7045b81700 1 Processor -- start 2023-09-30T22:24:08.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.986+0000 7f7045b81700 1 -- start start 2023-09-30T22:24:08.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.986+0000 7f7045b81700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f704009e870 0x7f704011e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.986+0000 7f7045b81700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f704009f350 0x7f704011ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.986+0000 7f7045b81700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70401371c0 0x7f704011f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.986+0000 7f7045b81700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7040121e90 con 0x7f704009f350 2023-09-30T22:24:08.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.986+0000 7f7045b81700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704009dba0 con 0x7f70401371c0 2023-09-30T22:24:08.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.986+0000 7f7045b81700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7040120370 con 0x7f704009e870 2023-09-30T22:24:08.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.986+0000 7f703effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f704009f350 0x7f704011ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.986+0000 7f703f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f704009e870 0x7f704011e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.986+0000 7f703effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f704009f350 0x7f704011ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41338/0 (socket says 172.21.15.156:41338) 2023-09-30T22:24:08.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.986+0000 7f703effd700 1 -- 172.21.15.156:0/1496721333 learned_addr learned my addr 172.21.15.156:0/1496721333 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:08.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.986+0000 7f703ffff700 1 --2- 172.21.15.156:0/1496721333 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70401371c0 0x7f704011f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.987+0000 7f703f7fe700 1 -- 172.21.15.156:0/1496721333 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70401371c0 msgr2=0x7f704011f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.987+0000 7f703f7fe700 1 --2- 172.21.15.156:0/1496721333 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70401371c0 0x7f704011f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.987+0000 7f703f7fe700 1 -- 172.21.15.156:0/1496721333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f704009f350 msgr2=0x7f704011ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.987+0000 7f703f7fe700 1 --2- 172.21.15.156:0/1496721333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f704009f350 0x7f704011ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.987+0000 7f703f7fe700 1 -- 172.21.15.156:0/1496721333 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7038009a70 con 0x7f704009e870 2023-09-30T22:24:08.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.987+0000 7f703f7fe700 1 --2- 172.21.15.156:0/1496721333 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f704009e870 0x7f704011e6d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f703000c3f0 tx=0x7f703000c700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:08.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.987+0000 7f7027fff700 1 -- 172.21.15.156:0/1496721333 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7030004a70 con 0x7f704009e870 2023-09-30T22:24:08.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.987+0000 7f7027fff700 1 -- 172.21.15.156:0/1496721333 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7030004bd0 con 0x7f704009e870 2023-09-30T22:24:08.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.987+0000 7f7045b81700 1 -- 172.21.15.156:0/1496721333 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70340094a0 con 0x7f704009e870 2023-09-30T22:24:08.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.987+0000 7f7027fff700 1 -- 172.21.15.156:0/1496721333 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70300070d0 con 0x7f704009e870 2023-09-30T22:24:08.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.987+0000 7f7045b81700 1 -- 172.21.15.156:0/1496721333 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7040120870 con 0x7f704009e870 2023-09-30T22:24:08.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.988+0000 7f7027fff700 1 -- 172.21.15.156:0/1496721333 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7030007230 con 0x7f704009e870 2023-09-30T22:24:08.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.988+0000 7f7027fff700 1 -- 172.21.15.156:0/1496721333 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f703003f040 con 0x7f704009e870 2023-09-30T22:24:08.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.988+0000 7f7045b81700 1 -- 172.21.15.156:0/1496721333 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7040122290 con 0x7f704009e870 2023-09-30T22:24:08.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:08.993+0000 7f7027fff700 1 -- 172.21.15.156:0/1496721333 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f703001bda0 con 0x7f704009e870 2023-09-30T22:24:09.004 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:09.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.108+0000 7ff37d7ce700 1 Processor -- start 2023-09-30T22:24:09.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.108+0000 7ff37d7ce700 1 -- start start 2023-09-30T22:24:09.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.109+0000 7ff37d7ce700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff37809d860 0x7ff37809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.109+0000 7ff37d7ce700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff37809e170 0x7ff3781307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.109+0000 7ff37d7ce700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff378130ce0 0x7ff378131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.109+0000 7ff37d7ce700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff37809aaa0 con 0x7ff378130ce0 2023-09-30T22:24:09.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.109+0000 7ff37d7ce700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37809f870 con 0x7ff37809e170 2023-09-30T22:24:09.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.109+0000 7ff37d7ce700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff37809b360 con 0x7ff37809d860 2023-09-30T22:24:09.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.109+0000 7ff376ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff37809d860 0x7ff37809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.109+0000 7ff376ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff37809d860 0x7ff37809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44584/0 (socket says 172.21.15.156:44584) 2023-09-30T22:24:09.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.109+0000 7ff376ffd700 1 -- 172.21.15.156:0/3618664424 learned_addr learned my addr 172.21.15.156:0/3618664424 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:09.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.109+0000 7ff3767fc700 1 --2- 172.21.15.156:0/3618664424 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff37809e170 0x7ff3781307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.109+0000 7ff3777fe700 1 --2- 172.21.15.156:0/3618664424 >> v2:172.21.15.156:3300/0 conn(0x7ff378130ce0 0x7ff378131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.109+0000 7ff3777fe700 1 -- 172.21.15.156:0/3618664424 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff37809d860 msgr2=0x7ff37809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:09.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.109+0000 7ff3777fe700 1 --2- 172.21.15.156:0/3618664424 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff37809d860 0x7ff37809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.109+0000 7ff3777fe700 1 -- 172.21.15.156:0/3618664424 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff37809e170 msgr2=0x7ff3781307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:09.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.109+0000 7ff3777fe700 1 --2- 172.21.15.156:0/3618664424 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff37809e170 0x7ff3781307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.109+0000 7ff3777fe700 1 -- 172.21.15.156:0/3618664424 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37809b620 con 0x7ff378130ce0 2023-09-30T22:24:09.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.109+0000 7ff376ffd700 1 --2- 172.21.15.156:0/3618664424 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff37809d860 0x7ff37809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:09.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.109+0000 7ff3767fc700 1 --2- 172.21.15.156:0/3618664424 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff37809e170 0x7ff3781307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:09.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.109+0000 7ff3777fe700 1 --2- 172.21.15.156:0/3618664424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff378130ce0 0x7ff378131150 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7ff370009d90 tx=0x7ff37000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f4780880172173b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:09.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.110+0000 7ff375ffb700 1 -- 172.21.15.156:0/3618664424 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37000e070 con 0x7ff378130ce0 2023-09-30T22:24:09.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.110+0000 7ff375ffb700 1 -- 172.21.15.156:0/3618664424 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37000bb20 con 0x7ff378130ce0 2023-09-30T22:24:09.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.110+0000 7ff375ffb700 1 -- 172.21.15.156:0/3618664424 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff370012430 con 0x7ff378130ce0 2023-09-30T22:24:09.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.111+0000 7ff37d7ce700 1 -- 172.21.15.156:0/3618664424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff378130ce0 msgr2=0x7ff378131150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.111+0000 7ff37d7ce700 1 --2- 172.21.15.156:0/3618664424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff378130ce0 0x7ff378131150 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7ff370009d90 tx=0x7ff37000b330 comp rx=0 tx=0).stop 2023-09-30T22:24:09.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.111+0000 7ff37d7ce700 1 -- 172.21.15.156:0/3618664424 shutdown_connections 2023-09-30T22:24:09.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.111+0000 7ff37d7ce700 1 --2- 172.21.15.156:0/3618664424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff378130ce0 0x7ff378131150 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.111+0000 7ff37d7ce700 1 --2- 172.21.15.156:0/3618664424 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff37809d860 0x7ff37809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.111+0000 7ff37d7ce700 1 --2- 172.21.15.156:0/3618664424 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff37809e170 0x7ff3781307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.111+0000 7ff37d7ce700 1 -- 172.21.15.156:0/3618664424 >> 172.21.15.156:0/3618664424 conn(0x7ff378099c40 msgr2=0x7ff3780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:09.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.111+0000 7ff37d7ce700 1 -- 172.21.15.156:0/3618664424 shutdown_connections 2023-09-30T22:24:09.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.111+0000 7ff37d7ce700 1 -- 172.21.15.156:0/3618664424 wait complete. 2023-09-30T22:24:09.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.112+0000 7ff37d7ce700 1 Processor -- start 2023-09-30T22:24:09.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.112+0000 7ff37d7ce700 1 -- start start 2023-09-30T22:24:09.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.113+0000 7ff37d7ce700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff37809d860 0x7ff37811cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.113+0000 7ff37d7ce700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff37809e170 0x7ff37811d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.113+0000 7ff37d7ce700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff378130ce0 0x7ff37811d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.113+0000 7ff37d7ce700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37811ead0 con 0x7ff378130ce0 2023-09-30T22:24:09.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.113+0000 7ff37d7ce700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37811fd20 con 0x7ff37809d860 2023-09-30T22:24:09.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.113+0000 7ff37d7ce700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff378120700 con 0x7ff37809e170 2023-09-30T22:24:09.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.113+0000 7ff3777fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff378130ce0 0x7ff37811d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.113+0000 7ff3777fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff378130ce0 0x7ff37811d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41350/0 (socket says 172.21.15.156:41350) 2023-09-30T22:24:09.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.113+0000 7ff3777fe700 1 -- 172.21.15.156:0/4176770791 learned_addr learned my addr 172.21.15.156:0/4176770791 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:09.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.113+0000 7ff3767fc700 1 --2- 172.21.15.156:0/4176770791 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff37809e170 0x7ff37811d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.113+0000 7ff376ffd700 1 --2- 172.21.15.156:0/4176770791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff37809d860 0x7ff37811cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.113+0000 7ff3767fc700 1 -- 172.21.15.156:0/4176770791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff37809d860 msgr2=0x7ff37811cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.113+0000 7ff3767fc700 1 --2- 172.21.15.156:0/4176770791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff37809d860 0x7ff37811cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.113+0000 7ff3767fc700 1 -- 172.21.15.156:0/4176770791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff378130ce0 msgr2=0x7ff37811d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.113+0000 7ff3767fc700 1 --2- 172.21.15.156:0/4176770791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff378130ce0 0x7ff37811d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.113+0000 7ff3767fc700 1 -- 172.21.15.156:0/4176770791 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36800da00 con 0x7ff37809e170 2023-09-30T22:24:09.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.113+0000 7ff3777fe700 1 --2- 172.21.15.156:0/4176770791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff378130ce0 0x7ff37811d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:09.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.113+0000 7ff3767fc700 1 --2- 172.21.15.156:0/4176770791 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff37809e170 0x7ff37811d400 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00e9b0 tx=0x7ff36c00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:09.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.114+0000 7ff35f7fe700 1 -- 172.21.15.156:0/4176770791 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c00c850 con 0x7ff37809e170 2023-09-30T22:24:09.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.114+0000 7ff35f7fe700 1 -- 172.21.15.156:0/4176770791 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36c00c9b0 con 0x7ff37809e170 2023-09-30T22:24:09.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.114+0000 7ff35f7fe700 1 -- 172.21.15.156:0/4176770791 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c00cd40 con 0x7ff37809e170 2023-09-30T22:24:09.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.114+0000 7ff37d7ce700 1 -- 172.21.15.156:0/4176770791 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff36c0094a0 con 0x7ff37809e170 2023-09-30T22:24:09.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.114+0000 7ff37d7ce700 1 -- 172.21.15.156:0/4176770791 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff370009a70 con 0x7ff37809e170 2023-09-30T22:24:09.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.115+0000 7ff35f7fe700 1 -- 172.21.15.156:0/4176770791 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff36c013470 con 0x7ff37809e170 2023-09-30T22:24:09.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.115+0000 7ff35f7fe700 1 -- 172.21.15.156:0/4176770791 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff36c03fac0 con 0x7ff37809e170 2023-09-30T22:24:09.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.115+0000 7ff37d7ce700 1 -- 172.21.15.156:0/4176770791 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff378071a10 con 0x7ff37809e170 2023-09-30T22:24:09.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.120+0000 7ff35f7fe700 1 -- 172.21.15.156:0/4176770791 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff36c021080 con 0x7ff37809e170 2023-09-30T22:24:09.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.131+0000 7fca45146700 1 Processor -- start 2023-09-30T22:24:09.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.131+0000 7fca45146700 1 -- start start 2023-09-30T22:24:09.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.132+0000 7fca45146700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fca4009e950 0x7fca4009ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.132+0000 7fca45146700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca4009f260 0x7fca40131890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.132+0000 7fca45146700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca4009afb0 con 0x7fca40131dd0 2023-09-30T22:24:09.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.132+0000 7fca45146700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca400a0970 con 0x7fca4009e950 2023-09-30T22:24:09.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.132+0000 7fca45146700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca400a0320 con 0x7fca4009f260 2023-09-30T22:24:09.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.132+0000 7fca3ed9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fca4009e950 0x7fca4009ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.132+0000 7fca3ed9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fca4009e950 0x7fca4009ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41366/0 (socket says 172.21.15.156:41366) 2023-09-30T22:24:09.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.132+0000 7fca3ed9d700 1 -- 172.21.15.156:0/3581567373 learned_addr learned my addr 172.21.15.156:0/3581567373 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:09.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.132+0000 7fca3e59c700 1 --2- 172.21.15.156:0/3581567373 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca4009f260 0x7fca40131890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.132+0000 7fca3ed9d700 1 -- 172.21.15.156:0/3581567373 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca4009f260 msgr2=0x7fca40131890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:09.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.132+0000 7fca3ed9d700 1 --2- 172.21.15.156:0/3581567373 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca4009f260 0x7fca40131890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.132+0000 7fca3ed9d700 1 -- 172.21.15.156:0/3581567373 >> v1:172.21.15.156:6789/0 conn(0x7fca40131dd0 legacy=0x7fca40138ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.132+0000 7fca3ed9d700 1 -- 172.21.15.156:0/3581567373 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca400a0750 con 0x7fca4009e950 2023-09-30T22:24:09.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.132+0000 7fca3ed9d700 1 --2- 172.21.15.156:0/3581567373 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca4009e950 0x7fca4009ed20 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fca30006fd0 tx=0x7fca30009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede157c2930fabdd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:09.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.133+0000 7fca3dd9b700 1 -- 172.21.15.156:0/3581567373 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca30005e30 con 0x7fca4009e950 2023-09-30T22:24:09.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.133+0000 7fca3dd9b700 1 -- 172.21.15.156:0/3581567373 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca30004030 con 0x7fca4009e950 2023-09-30T22:24:09.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.133+0000 7fca3dd9b700 1 -- 172.21.15.156:0/3581567373 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca300043e0 con 0x7fca4009e950 2023-09-30T22:24:09.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.133+0000 7fca45146700 1 -- 172.21.15.156:0/3581567373 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca4009e950 msgr2=0x7fca4009ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.133+0000 7fca45146700 1 --2- 172.21.15.156:0/3581567373 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca4009e950 0x7fca4009ed20 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fca30006fd0 tx=0x7fca30009bd0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.133+0000 7fca45146700 1 -- 172.21.15.156:0/3581567373 shutdown_connections 2023-09-30T22:24:09.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.133+0000 7fca45146700 1 --2- 172.21.15.156:0/3581567373 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca4009e950 0x7fca4009ed20 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.133+0000 7fca45146700 1 --2- 172.21.15.156:0/3581567373 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca4009f260 0x7fca40131890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.133+0000 7fca45146700 1 -- 172.21.15.156:0/3581567373 >> 172.21.15.156:0/3581567373 conn(0x7fca400a0f70 msgr2=0x7fca400a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:09.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.133+0000 7fca45146700 1 -- 172.21.15.156:0/3581567373 shutdown_connections 2023-09-30T22:24:09.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.133+0000 7fca45146700 1 -- 172.21.15.156:0/3581567373 wait complete. 2023-09-30T22:24:09.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.135+0000 7fca45146700 1 Processor -- start 2023-09-30T22:24:09.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.135+0000 7fca45146700 1 -- start start 2023-09-30T22:24:09.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.135+0000 7fca45146700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca4009e950 0x7fca40120830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.135+0000 7fca45146700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca4009f260 0x7fca40120d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.135+0000 7fca45146700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca40131dd0 0x7fca401212b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.135+0000 7fca45146700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca40131940 con 0x7fca40131dd0 2023-09-30T22:24:09.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.135+0000 7fca45146700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca40131710 con 0x7fca4009f260 2023-09-30T22:24:09.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.135+0000 7fca45146700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca40123d40 con 0x7fca4009e950 2023-09-30T22:24:09.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.136+0000 7fca3e59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca4009f260 0x7fca40120d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.136+0000 7fca3f59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca40131dd0 0x7fca401212b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.136+0000 7fca3e59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca4009f260 0x7fca40120d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59676/0 (socket says 172.21.15.156:59676) 2023-09-30T22:24:09.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.136+0000 7fca3e59c700 1 -- 172.21.15.156:0/1180356867 learned_addr learned my addr 172.21.15.156:0/1180356867 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:09.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.136+0000 7fca3f59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca40131dd0 0x7fca401212b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41374/0 (socket says 172.21.15.156:41374) 2023-09-30T22:24:09.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.136+0000 7fca3ed9d700 1 --2- 172.21.15.156:0/1180356867 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca4009e950 0x7fca40120830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.136+0000 7fca3f59e700 1 -- 172.21.15.156:0/1180356867 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca4009e950 msgr2=0x7fca40120830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.136+0000 7fca3f59e700 1 --2- 172.21.15.156:0/1180356867 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca4009e950 0x7fca40120830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.136+0000 7fca3f59e700 1 -- 172.21.15.156:0/1180356867 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca4009f260 msgr2=0x7fca40120d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.136+0000 7fca3f59e700 1 --2- 172.21.15.156:0/1180356867 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca4009f260 0x7fca40120d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.136+0000 7fca3f59e700 1 -- 172.21.15.156:0/1180356867 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca30009500 con 0x7fca40131dd0 2023-09-30T22:24:09.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.136+0000 7fca3e59c700 1 --2- 172.21.15.156:0/1180356867 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca4009f260 0x7fca40120d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:09.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.136+0000 7fca3f59e700 1 --2- 172.21.15.156:0/1180356867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca40131dd0 0x7fca401212b0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fca3800cb90 tx=0x7fca3800cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:09.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.136+0000 7fca277fe700 1 -- 172.21.15.156:0/1180356867 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca38003c00 con 0x7fca40131dd0 2023-09-30T22:24:09.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.136+0000 7fca277fe700 1 -- 172.21.15.156:0/1180356867 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca38003d60 con 0x7fca40131dd0 2023-09-30T22:24:09.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.136+0000 7fca45146700 1 -- 172.21.15.156:0/1180356867 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca4009da40 con 0x7fca40131dd0 2023-09-30T22:24:09.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.136+0000 7fca277fe700 1 -- 172.21.15.156:0/1180356867 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3800aa80 con 0x7fca40131dd0 2023-09-30T22:24:09.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.136+0000 7fca45146700 1 -- 172.21.15.156:0/1180356867 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca401228e0 con 0x7fca40131dd0 2023-09-30T22:24:09.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.137+0000 7fca277fe700 1 -- 172.21.15.156:0/1180356867 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fca3800abe0 con 0x7fca40131dd0 2023-09-30T22:24:09.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.137+0000 7fca277fe700 1 -- 172.21.15.156:0/1180356867 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fca3803f5c0 con 0x7fca40131dd0 2023-09-30T22:24:09.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.137+0000 7fca45146700 1 -- 172.21.15.156:0/1180356867 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca4004f2a0 con 0x7fca40131dd0 2023-09-30T22:24:09.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.142+0000 7fca277fe700 1 -- 172.21.15.156:0/1180356867 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fca380198f0 con 0x7fca40131dd0 2023-09-30T22:24:09.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.191+0000 7f7045b81700 1 -- 172.21.15.156:0/1496721333 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7040120810 con 0x7f704009e870 2023-09-30T22:24:09.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.192+0000 7f7027fff700 1 -- 172.21.15.156:0/1496721333 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f703001b340 con 0x7f704009e870 2023-09-30T22:24:09.192 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:09.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.194+0000 7f7045b81700 1 -- 172.21.15.156:0/1496721333 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f704009e870 msgr2=0x7f704011e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.194+0000 7f7045b81700 1 --2- 172.21.15.156:0/1496721333 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f704009e870 0x7f704011e6d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f703000c3f0 tx=0x7f703000c700 comp rx=0 tx=0).stop 2023-09-30T22:24:09.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.194+0000 7f7045b81700 1 -- 172.21.15.156:0/1496721333 shutdown_connections 2023-09-30T22:24:09.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.194+0000 7f7045b81700 1 --2- 172.21.15.156:0/1496721333 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f70401371c0 0x7f704011f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.194+0000 7f7045b81700 1 --2- 172.21.15.156:0/1496721333 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f704009e870 0x7f704011e6d0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.194+0000 7f7045b81700 1 --2- 172.21.15.156:0/1496721333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f704009f350 0x7f704011ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.194+0000 7f7045b81700 1 -- 172.21.15.156:0/1496721333 >> 172.21.15.156:0/1496721333 conn(0x7f70400a4430 msgr2=0x7f704009c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:09.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.194+0000 7f7045b81700 1 -- 172.21.15.156:0/1496721333 shutdown_connections 2023-09-30T22:24:09.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.194+0000 7f7045b81700 1 -- 172.21.15.156:0/1496721333 wait complete. 2023-09-30T22:24:09.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:09.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.313+0000 7ff37d7ce700 1 -- 172.21.15.156:0/4176770791 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff37809c8b0 con 0x7ff37809e170 2023-09-30T22:24:09.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.314+0000 7ff35f7fe700 1 -- 172.21.15.156:0/4176770791 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff36c017020 con 0x7ff37809e170 2023-09-30T22:24:09.314 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:09.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.316+0000 7ff37d7ce700 1 -- 172.21.15.156:0/4176770791 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff37809e170 msgr2=0x7ff37811d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.316+0000 7ff37d7ce700 1 --2- 172.21.15.156:0/4176770791 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff37809e170 0x7ff37811d400 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00e9b0 tx=0x7ff36c00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.316+0000 7ff37d7ce700 1 -- 172.21.15.156:0/4176770791 shutdown_connections 2023-09-30T22:24:09.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.316+0000 7ff37d7ce700 1 --2- 172.21.15.156:0/4176770791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff378130ce0 0x7ff37811d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.316+0000 7ff37d7ce700 1 --2- 172.21.15.156:0/4176770791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff37809d860 0x7ff37811cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.316+0000 7ff37d7ce700 1 --2- 172.21.15.156:0/4176770791 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff37809e170 0x7ff37811d400 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.316+0000 7ff37d7ce700 1 -- 172.21.15.156:0/4176770791 >> 172.21.15.156:0/4176770791 conn(0x7ff378099c40 msgr2=0x7ff37812fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:09.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.316+0000 7ff37d7ce700 1 -- 172.21.15.156:0/4176770791 shutdown_connections 2023-09-30T22:24:09.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.316+0000 7ff37d7ce700 1 -- 172.21.15.156:0/4176770791 wait complete. 2023-09-30T22:24:09.328 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:09.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.335+0000 7fca45146700 1 -- 172.21.15.156:0/1180356867 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fca4006b250 con 0x7fca40131dd0 2023-09-30T22:24:09.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.335+0000 7fca277fe700 1 -- 172.21.15.156:0/1180356867 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fca38019300 con 0x7fca40131dd0 2023-09-30T22:24:09.335 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:09.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.337+0000 7fca45146700 1 -- 172.21.15.156:0/1180356867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca40131dd0 msgr2=0x7fca401212b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.337+0000 7fca45146700 1 --2- 172.21.15.156:0/1180356867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca40131dd0 0x7fca401212b0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fca3800cb90 tx=0x7fca3800cea0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.337+0000 7fca45146700 1 -- 172.21.15.156:0/1180356867 shutdown_connections 2023-09-30T22:24:09.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.337+0000 7fca45146700 1 --2- 172.21.15.156:0/1180356867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca40131dd0 0x7fca401212b0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.337+0000 7fca45146700 1 --2- 172.21.15.156:0/1180356867 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca4009e950 0x7fca40120830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.337+0000 7fca45146700 1 --2- 172.21.15.156:0/1180356867 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca4009f260 0x7fca40120d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.337+0000 7fca45146700 1 -- 172.21.15.156:0/1180356867 >> 172.21.15.156:0/1180356867 conn(0x7fca400a0f70 msgr2=0x7fca4011a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:09.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.338+0000 7fca45146700 1 -- 172.21.15.156:0/1180356867 shutdown_connections 2023-09-30T22:24:09.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.338+0000 7fca45146700 1 -- 172.21.15.156:0/1180356867 wait complete. 2023-09-30T22:24:09.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:09.751 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:09.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.875+0000 7f50f892d700 1 Processor -- start 2023-09-30T22:24:09.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.875+0000 7f50f892d700 1 -- start start 2023-09-30T22:24:09.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.875+0000 7f50f892d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50f406b250 0x7f50f4136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.875+0000 7f50f892d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50f4137140 0x7f50f4139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.875+0000 7f50f892d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f409da80 con 0x7f50f406a770 2023-09-30T22:24:09.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.875+0000 7f50f892d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f409dce0 con 0x7f50f406b250 2023-09-30T22:24:09.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.875+0000 7f50f892d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50f406b620 con 0x7f50f4137140 2023-09-30T22:24:09.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.876+0000 7f50f259c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f50f406a770 0x7f50f406ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48812/0 (socket says 172.21.15.156:48812) 2023-09-30T22:24:09.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.876+0000 7f50f1d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50f406b250 0x7f50f4136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.876+0000 7f50f2d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50f4137140 0x7f50f4139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.876+0000 7f50f259c700 1 -- 172.21.15.156:0/3043725543 learned_addr learned my addr 172.21.15.156:0/3043725543 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:09.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.876+0000 7f50f2d9d700 1 -- 172.21.15.156:0/3043725543 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50f406b250 msgr2=0x7f50f4136c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:09.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.876+0000 7f50f2d9d700 1 --2- 172.21.15.156:0/3043725543 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50f406b250 0x7f50f4136c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.876+0000 7f50f2d9d700 1 -- 172.21.15.156:0/3043725543 >> v1:172.21.15.156:6789/0 conn(0x7f50f406a770 legacy=0x7f50f406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.876+0000 7f50f159a700 1 -- 172.21.15.156:0/3043725543 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1071234719 0 0) 0x7f50f409da80 con 0x7f50f406a770 2023-09-30T22:24:09.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.876+0000 7f50f2d9d700 1 -- 172.21.15.156:0/3043725543 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f409eb20 con 0x7f50f4137140 2023-09-30T22:24:09.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.876+0000 7f50f1d9b700 1 --2- 172.21.15.156:0/3043725543 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50f406b250 0x7f50f4136c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:09.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.876+0000 7f50f2d9d700 1 --2- 172.21.15.156:0/3043725543 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50f4137140 0x7f50f4139520 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f50ec009dc0 tx=0x7f50ec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba11d1d6e78a7933 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:09.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.876+0000 7f50f159a700 1 -- 172.21.15.156:0/3043725543 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec00e070 con 0x7f50f4137140 2023-09-30T22:24:09.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.876+0000 7f50f159a700 1 -- 172.21.15.156:0/3043725543 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ec00bb20 con 0x7f50f4137140 2023-09-30T22:24:09.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.876+0000 7f50f159a700 1 -- 172.21.15.156:0/3043725543 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec012430 con 0x7f50f4137140 2023-09-30T22:24:09.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.877+0000 7f50f892d700 1 -- 172.21.15.156:0/3043725543 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50f4137140 msgr2=0x7f50f4139520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.877+0000 7f50f892d700 1 --2- 172.21.15.156:0/3043725543 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50f4137140 0x7f50f4139520 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f50ec009dc0 tx=0x7f50ec00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:09.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.877+0000 7f50f892d700 1 -- 172.21.15.156:0/3043725543 shutdown_connections 2023-09-30T22:24:09.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.877+0000 7f50f892d700 1 --2- 172.21.15.156:0/3043725543 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50f4137140 0x7f50f4139520 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.877+0000 7f50f892d700 1 --2- 172.21.15.156:0/3043725543 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50f406b250 0x7f50f4136c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.877+0000 7f50f892d700 1 -- 172.21.15.156:0/3043725543 >> 172.21.15.156:0/3043725543 conn(0x7f50f4099c40 msgr2=0x7f50f40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:09.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.877+0000 7f50f892d700 1 -- 172.21.15.156:0/3043725543 shutdown_connections 2023-09-30T22:24:09.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.877+0000 7f50f892d700 1 -- 172.21.15.156:0/3043725543 wait complete. 2023-09-30T22:24:09.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.878+0000 7f50f892d700 1 Processor -- start 2023-09-30T22:24:09.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.878+0000 7f50f892d700 1 -- start start 2023-09-30T22:24:09.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.878+0000 7f50f892d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50f406a770 0x7f50f4120580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.878+0000 7f50f892d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50f406b250 0x7f50f4120ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.878+0000 7f50f892d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50f4137140 0x7f50f4121000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.878+0000 7f50f892d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f4122f90 con 0x7f50f406b250 2023-09-30T22:24:09.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.878+0000 7f50f892d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f4122190 con 0x7f50f406a770 2023-09-30T22:24:09.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.878+0000 7f50f892d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50f41234e0 con 0x7f50f4137140 2023-09-30T22:24:09.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.878+0000 7f50f259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50f406a770 0x7f50f4120580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.878+0000 7f50f1d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50f406b250 0x7f50f4120ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.878+0000 7f50f259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50f406a770 0x7f50f4120580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59700/0 (socket says 172.21.15.156:59700) 2023-09-30T22:24:09.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.878+0000 7f50f259c700 1 -- 172.21.15.156:0/2414899200 learned_addr learned my addr 172.21.15.156:0/2414899200 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:09.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.878+0000 7f50f2d9d700 1 --2- 172.21.15.156:0/2414899200 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50f4137140 0x7f50f4121000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.879+0000 7f50f259c700 1 -- 172.21.15.156:0/2414899200 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50f4137140 msgr2=0x7f50f4121000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.879+0000 7f50f259c700 1 --2- 172.21.15.156:0/2414899200 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50f4137140 0x7f50f4121000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.879+0000 7f50f259c700 1 -- 172.21.15.156:0/2414899200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50f406b250 msgr2=0x7f50f4120ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.879+0000 7f50f259c700 1 --2- 172.21.15.156:0/2414899200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50f406b250 0x7f50f4120ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.879+0000 7f50f259c700 1 -- 172.21.15.156:0/2414899200 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e80094a0 con 0x7f50f406a770 2023-09-30T22:24:09.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.879+0000 7f50f1d9b700 1 --2- 172.21.15.156:0/2414899200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50f406b250 0x7f50f4120ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:09.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.879+0000 7f50f259c700 1 --2- 172.21.15.156:0/2414899200 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50f406a770 0x7f50f4120580 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f50e400c520 tx=0x7f50e400c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:09.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.879+0000 7f50e2ffd700 1 -- 172.21.15.156:0/2414899200 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e4004c80 con 0x7f50f406a770 2023-09-30T22:24:09.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.879+0000 7f50e2ffd700 1 -- 172.21.15.156:0/2414899200 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e4004e00 con 0x7f50f406a770 2023-09-30T22:24:09.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.879+0000 7f50f892d700 1 -- 172.21.15.156:0/2414899200 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50ec009a70 con 0x7f50f406a770 2023-09-30T22:24:09.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.879+0000 7f50e2ffd700 1 -- 172.21.15.156:0/2414899200 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e4007310 con 0x7f50f406a770 2023-09-30T22:24:09.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.879+0000 7f50f892d700 1 -- 172.21.15.156:0/2414899200 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f4071e10 con 0x7f50f406a770 2023-09-30T22:24:09.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.880+0000 7f50f892d700 1 -- 172.21.15.156:0/2414899200 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f404f2a0 con 0x7f50f406a770 2023-09-30T22:24:09.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.880+0000 7f50e2ffd700 1 -- 172.21.15.156:0/2414899200 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f50e4007470 con 0x7f50f406a770 2023-09-30T22:24:09.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.880+0000 7f50e2ffd700 1 -- 172.21.15.156:0/2414899200 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f50e403f920 con 0x7f50f406a770 2023-09-30T22:24:09.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:09.885+0000 7f50e2ffd700 1 -- 172.21.15.156:0/2414899200 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f50e40133c0 con 0x7f50f406a770 2023-09-30T22:24:10.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.067+0000 7f50f892d700 1 -- 172.21.15.156:0/2414899200 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f50f40a3e00 con 0x7f50f406a770 2023-09-30T22:24:10.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.068+0000 7f50e2ffd700 1 -- 172.21.15.156:0/2414899200 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f50e4011360 con 0x7f50f406a770 2023-09-30T22:24:10.068 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:10.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.070+0000 7f50f892d700 1 -- 172.21.15.156:0/2414899200 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50f406a770 msgr2=0x7f50f4120580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:10.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.070+0000 7f50f892d700 1 --2- 172.21.15.156:0/2414899200 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50f406a770 0x7f50f4120580 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f50e400c520 tx=0x7f50e400c830 comp rx=0 tx=0).stop 2023-09-30T22:24:10.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.070+0000 7f50f892d700 1 -- 172.21.15.156:0/2414899200 shutdown_connections 2023-09-30T22:24:10.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.070+0000 7f50f892d700 1 --2- 172.21.15.156:0/2414899200 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50f4137140 0x7f50f4121000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.070+0000 7f50f892d700 1 --2- 172.21.15.156:0/2414899200 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50f406a770 0x7f50f4120580 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.070+0000 7f50f892d700 1 --2- 172.21.15.156:0/2414899200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50f406b250 0x7f50f4120ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.070+0000 7f50f892d700 1 -- 172.21.15.156:0/2414899200 >> 172.21.15.156:0/2414899200 conn(0x7f50f4099c40 msgr2=0x7f50f406fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:10.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.070+0000 7f50f892d700 1 -- 172.21.15.156:0/2414899200 shutdown_connections 2023-09-30T22:24:10.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.070+0000 7f50f892d700 1 -- 172.21.15.156:0/2414899200 wait complete. 2023-09-30T22:24:10.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:10.208 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:10.329 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:10.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.331+0000 7fd342361700 1 Processor -- start 2023-09-30T22:24:10.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.331+0000 7fd342361700 1 -- start start 2023-09-30T22:24:10.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.331+0000 7fd342361700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd33c06a770 0x7fd33c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:10.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.331+0000 7fd342361700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd33c06b080 0x7fd33c1317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:10.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.331+0000 7fd342361700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd33c131cf0 0x7fd33c132190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:10.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.331+0000 7fd342361700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd33c09f770 con 0x7fd33c131cf0 2023-09-30T22:24:10.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.331+0000 7fd342361700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c09dce0 con 0x7fd33c06a770 2023-09-30T22:24:10.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.331+0000 7fd342361700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c09da80 con 0x7fd33c06b080 2023-09-30T22:24:10.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.331+0000 7fd3408fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd33c131cf0 0x7fd33c132190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:10.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.331+0000 7fd33b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd33c06b080 0x7fd33c1317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:10.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.331+0000 7fd33bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd33c06a770 0x7fd33c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:10.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.331+0000 7fd33b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd33c06b080 0x7fd33c1317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44624/0 (socket says 172.21.15.156:44624) 2023-09-30T22:24:10.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.331+0000 7fd33bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd33c06a770 0x7fd33c06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59708/0 (socket says 172.21.15.156:59708) 2023-09-30T22:24:10.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.331+0000 7fd3408fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd33c131cf0 0x7fd33c132190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41378/0 (socket says 172.21.15.156:41378) 2023-09-30T22:24:10.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.331+0000 7fd33b7fe700 1 -- 172.21.15.156:0/1126030892 learned_addr learned my addr 172.21.15.156:0/1126030892 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:10.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.332+0000 7fd33b7fe700 1 -- 172.21.15.156:0/1126030892 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd33c06a770 msgr2=0x7fd33c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:10.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.332+0000 7fd33b7fe700 1 --2- 172.21.15.156:0/1126030892 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd33c06a770 0x7fd33c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.332+0000 7fd33b7fe700 1 -- 172.21.15.156:0/1126030892 >> v2:172.21.15.156:3300/0 conn(0x7fd33c131cf0 msgr2=0x7fd33c132190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:10.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.332+0000 7fd33b7fe700 1 --2- 172.21.15.156:0/1126030892 >> v2:172.21.15.156:3300/0 conn(0x7fd33c131cf0 0x7fd33c132190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.332+0000 7fd33b7fe700 1 -- 172.21.15.156:0/1126030892 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c09eb20 con 0x7fd33c06b080 2023-09-30T22:24:10.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.332+0000 7fd33bfff700 1 --2- 172.21.15.156:0/1126030892 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd33c06a770 0x7fd33c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:10.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.332+0000 7fd3408fe700 1 --2- 172.21.15.156:0/1126030892 >> v2:172.21.15.156:3300/0 conn(0x7fd33c131cf0 0x7fd33c132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:10.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.332+0000 7fd33b7fe700 1 --2- 172.21.15.156:0/1126030892 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd33c06b080 0x7fd33c1317b0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd330009920 tx=0x7fd330009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9522ac2e5a23f576 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:10.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.332+0000 7fd33affd700 1 -- 172.21.15.156:0/1126030892 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd330011830 con 0x7fd33c06b080 2023-09-30T22:24:10.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.332+0000 7fd33affd700 1 -- 172.21.15.156:0/1126030892 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd330011990 con 0x7fd33c06b080 2023-09-30T22:24:10.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.332+0000 7fd33affd700 1 -- 172.21.15.156:0/1126030892 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd330011d20 con 0x7fd33c06b080 2023-09-30T22:24:10.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.333+0000 7fd342361700 1 -- 172.21.15.156:0/1126030892 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd33c06b080 msgr2=0x7fd33c1317b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:10.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.333+0000 7fd342361700 1 --2- 172.21.15.156:0/1126030892 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd33c06b080 0x7fd33c1317b0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd330009920 tx=0x7fd330009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:10.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.333+0000 7fd342361700 1 -- 172.21.15.156:0/1126030892 shutdown_connections 2023-09-30T22:24:10.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.333+0000 7fd342361700 1 --2- 172.21.15.156:0/1126030892 >> v2:172.21.15.156:3300/0 conn(0x7fd33c131cf0 0x7fd33c132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.333+0000 7fd342361700 1 --2- 172.21.15.156:0/1126030892 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd33c06a770 0x7fd33c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.333+0000 7fd342361700 1 --2- 172.21.15.156:0/1126030892 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd33c06b080 0x7fd33c1317b0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.333+0000 7fd342361700 1 -- 172.21.15.156:0/1126030892 >> 172.21.15.156:0/1126030892 conn(0x7fd33c099c40 msgr2=0x7fd33c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:10.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.333+0000 7fd342361700 1 -- 172.21.15.156:0/1126030892 shutdown_connections 2023-09-30T22:24:10.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.333+0000 7fd342361700 1 -- 172.21.15.156:0/1126030892 wait complete. 2023-09-30T22:24:10.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.334+0000 7fd342361700 1 Processor -- start 2023-09-30T22:24:10.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.334+0000 7fd342361700 1 -- start start 2023-09-30T22:24:10.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.334+0000 7fd342361700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd33c06a770 0x7fd33c1c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:10.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.334+0000 7fd342361700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd33c06b080 0x7fd33c1c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:10.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.334+0000 7fd342361700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd33c131cf0 0x7fd33c1c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:10.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.334+0000 7fd342361700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c11d630 con 0x7fd33c06a770 2023-09-30T22:24:10.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.334+0000 7fd342361700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c11d440 con 0x7fd33c06b080 2023-09-30T22:24:10.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.334+0000 7fd342361700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c11f350 con 0x7fd33c131cf0 2023-09-30T22:24:10.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.334+0000 7fd3408fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd33c131cf0 0x7fd33c1c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:10.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.334+0000 7fd3408fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd33c131cf0 0x7fd33c1c6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44628/0 (socket says 172.21.15.156:44628) 2023-09-30T22:24:10.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.334+0000 7fd3408fe700 1 -- 172.21.15.156:0/3674690418 learned_addr learned my addr 172.21.15.156:0/3674690418 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:10.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.335+0000 7fd33b7fe700 1 --2- 172.21.15.156:0/3674690418 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd33c06b080 0x7fd33c1c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:10.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.334+0000 7fd33bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd33c06a770 0x7fd33c1c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:10.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.335+0000 7fd3408fe700 1 -- 172.21.15.156:0/3674690418 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd33c06b080 msgr2=0x7fd33c1c6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:10.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.335+0000 7fd3408fe700 1 --2- 172.21.15.156:0/3674690418 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd33c06b080 0x7fd33c1c6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.335+0000 7fd3408fe700 1 -- 172.21.15.156:0/3674690418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd33c06a770 msgr2=0x7fd33c1c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:10.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.335+0000 7fd3408fe700 1 --2- 172.21.15.156:0/3674690418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd33c06a770 0x7fd33c1c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.335+0000 7fd3408fe700 1 -- 172.21.15.156:0/3674690418 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32c0094a0 con 0x7fd33c131cf0 2023-09-30T22:24:10.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.335+0000 7fd33b7fe700 1 --2- 172.21.15.156:0/3674690418 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd33c06b080 0x7fd33c1c6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:10.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.335+0000 7fd3408fe700 1 --2- 172.21.15.156:0/3674690418 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd33c131cf0 0x7fd33c1c6990 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd33400efc0 tx=0x7fd33400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:10.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.335+0000 7fd338ff9700 1 -- 172.21.15.156:0/3674690418 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33400ca90 con 0x7fd33c131cf0 2023-09-30T22:24:10.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.335+0000 7fd338ff9700 1 -- 172.21.15.156:0/3674690418 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33400f040 con 0x7fd33c131cf0 2023-09-30T22:24:10.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.335+0000 7fd342361700 1 -- 172.21.15.156:0/3674690418 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd334009a70 con 0x7fd33c131cf0 2023-09-30T22:24:10.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.335+0000 7fd338ff9700 1 -- 172.21.15.156:0/3674690418 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33400ce10 con 0x7fd33c131cf0 2023-09-30T22:24:10.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.335+0000 7fd342361700 1 -- 172.21.15.156:0/3674690418 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd330009550 con 0x7fd33c131cf0 2023-09-30T22:24:10.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.336+0000 7fd338ff9700 1 -- 172.21.15.156:0/3674690418 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd334014480 con 0x7fd33c131cf0 2023-09-30T22:24:10.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.336+0000 7fd338ff9700 1 -- 172.21.15.156:0/3674690418 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd33403fc60 con 0x7fd33c131cf0 2023-09-30T22:24:10.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.337+0000 7fd342361700 1 -- 172.21.15.156:0/3674690418 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd33c11ed10 con 0x7fd33c131cf0 2023-09-30T22:24:10.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.341+0000 7fd338ff9700 1 -- 172.21.15.156:0/3674690418 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd33c11ed10 con 0x7fd33c131cf0 2023-09-30T22:24:10.350 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:10.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.458+0000 7ff4ef739700 1 Processor -- start 2023-09-30T22:24:10.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.458+0000 7ff4ef739700 1 -- start start 2023-09-30T22:24:10.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.459+0000 7ff4ef739700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4e809dec0 0x7ff4e806b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:10.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.459+0000 7ff4ef739700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4e8136cb0 0x7ff4e8139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:10.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.459+0000 7ff4ef739700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4e806e900 con 0x7ff4e806a770 2023-09-30T22:24:10.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.459+0000 7ff4ef739700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e809d180 con 0x7ff4e8136cb0 2023-09-30T22:24:10.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.459+0000 7ff4ef739700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e809e780 con 0x7ff4e809dec0 2023-09-30T22:24:10.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.459+0000 7ff4eccd4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4e809dec0 0x7ff4e806b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:10.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.459+0000 7ff4eccd4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4e809dec0 0x7ff4e806b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44630/0 (socket says 172.21.15.156:44630) 2023-09-30T22:24:10.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.459+0000 7ff4eccd4700 1 -- 172.21.15.156:0/2220710331 learned_addr learned my addr 172.21.15.156:0/2220710331 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:10.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.459+0000 7ff4edcd6700 1 --2- 172.21.15.156:0/2220710331 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4e8136cb0 0x7ff4e8139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:10.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.460+0000 7ff4dffff700 1 -- 172.21.15.156:0/2220710331 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707342024 0 0) 0x7ff4e806e900 con 0x7ff4e806a770 2023-09-30T22:24:10.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.460+0000 7ff4dffff700 1 -- 172.21.15.156:0/2220710331 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4d40035b0 con 0x7ff4e806a770 2023-09-30T22:24:10.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.460+0000 7ff4eccd4700 1 -- 172.21.15.156:0/2220710331 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4e8136cb0 msgr2=0x7ff4e8139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:10.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.460+0000 7ff4eccd4700 1 --2- 172.21.15.156:0/2220710331 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4e8136cb0 0x7ff4e8139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.460+0000 7ff4eccd4700 1 -- 172.21.15.156:0/2220710331 >> v1:172.21.15.156:6789/0 conn(0x7ff4e806a770 legacy=0x7ff4e806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:10.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.460+0000 7ff4eccd4700 1 -- 172.21.15.156:0/2220710331 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e809d3c0 con 0x7ff4e809dec0 2023-09-30T22:24:10.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.460+0000 7ff4edcd6700 1 --2- 172.21.15.156:0/2220710331 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4e8136cb0 0x7ff4e8139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:10.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.460+0000 7ff4eccd4700 1 --2- 172.21.15.156:0/2220710331 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4e809dec0 0x7ff4e806b250 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8009920 tx=0x7ff4d8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=816f4b92ddda2028 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:10.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.460+0000 7ff4dffff700 1 -- 172.21.15.156:0/2220710331 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d8011830 con 0x7ff4e809dec0 2023-09-30T22:24:10.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.460+0000 7ff4dffff700 1 -- 172.21.15.156:0/2220710331 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d8011990 con 0x7ff4e809dec0 2023-09-30T22:24:10.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.460+0000 7ff4dffff700 1 -- 172.21.15.156:0/2220710331 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d8011d00 con 0x7ff4e809dec0 2023-09-30T22:24:10.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.461+0000 7ff4ef739700 1 -- 172.21.15.156:0/2220710331 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4e809dec0 msgr2=0x7ff4e806b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:10.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.461+0000 7ff4ef739700 1 --2- 172.21.15.156:0/2220710331 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4e809dec0 0x7ff4e806b250 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8009920 tx=0x7ff4d8009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:10.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.461+0000 7ff4ef739700 1 -- 172.21.15.156:0/2220710331 shutdown_connections 2023-09-30T22:24:10.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.461+0000 7ff4ef739700 1 --2- 172.21.15.156:0/2220710331 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4e8136cb0 0x7ff4e8139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.461+0000 7ff4ef739700 1 --2- 172.21.15.156:0/2220710331 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4e809dec0 0x7ff4e806b250 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.461+0000 7ff4ef739700 1 -- 172.21.15.156:0/2220710331 >> 172.21.15.156:0/2220710331 conn(0x7ff4e8099c40 msgr2=0x7ff4e80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:10.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.461+0000 7ff4ef739700 1 -- 172.21.15.156:0/2220710331 shutdown_connections 2023-09-30T22:24:10.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.461+0000 7ff4ef739700 1 -- 172.21.15.156:0/2220710331 wait complete. 2023-09-30T22:24:10.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.462+0000 7ff4ef739700 1 Processor -- start 2023-09-30T22:24:10.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.463+0000 7ff4ef739700 1 -- start start 2023-09-30T22:24:10.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.463+0000 7ff4ef739700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4e806a770 0x7ff4e809a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:10.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.463+0000 7ff4ef739700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4e809dec0 0x7ff4e809a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:10.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.463+0000 7ff4ef739700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4e8136cb0 0x7ff4e809aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:10.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.463+0000 7ff4ef739700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e8135210 con 0x7ff4e809dec0 2023-09-30T22:24:10.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.463+0000 7ff4ef739700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e8134340 con 0x7ff4e806a770 2023-09-30T22:24:10.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.463+0000 7ff4ef739700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e8071ce0 con 0x7ff4e8136cb0 2023-09-30T22:24:10.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.463+0000 7ff4ed4d5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4e806a770 0x7ff4e809a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:10.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.463+0000 7ff4edcd6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4e8136cb0 0x7ff4e809aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:10.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.463+0000 7ff4ed4d5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4e806a770 0x7ff4e809a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:59750/0 (socket says 172.21.15.156:59750) 2023-09-30T22:24:10.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.463+0000 7ff4ed4d5700 1 -- 172.21.15.156:0/4011191574 learned_addr learned my addr 172.21.15.156:0/4011191574 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:10.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.463+0000 7ff4eccd4700 1 --2- 172.21.15.156:0/4011191574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4e809dec0 0x7ff4e809a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:10.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.464+0000 7ff4ed4d5700 1 -- 172.21.15.156:0/4011191574 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4e8136cb0 msgr2=0x7ff4e809aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:10.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.464+0000 7ff4ed4d5700 1 --2- 172.21.15.156:0/4011191574 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4e8136cb0 0x7ff4e809aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.464+0000 7ff4ed4d5700 1 -- 172.21.15.156:0/4011191574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4e809dec0 msgr2=0x7ff4e809a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:10.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.464+0000 7ff4ed4d5700 1 --2- 172.21.15.156:0/4011191574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4e809dec0 0x7ff4e809a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.464+0000 7ff4ed4d5700 1 -- 172.21.15.156:0/4011191574 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e0009a70 con 0x7ff4e806a770 2023-09-30T22:24:10.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.464+0000 7ff4edcd6700 1 --2- 172.21.15.156:0/4011191574 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4e8136cb0 0x7ff4e809aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:10.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.464+0000 7ff4ed4d5700 1 --2- 172.21.15.156:0/4011191574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4e806a770 0x7ff4e809a420 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400c550 tx=0x7ff4e400c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:10.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.464+0000 7ff4ddffb700 1 -- 172.21.15.156:0/4011191574 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e40052d0 con 0x7ff4e806a770 2023-09-30T22:24:10.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.464+0000 7ff4ddffb700 1 -- 172.21.15.156:0/4011191574 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e4005430 con 0x7ff4e806a770 2023-09-30T22:24:10.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.464+0000 7ff4ef739700 1 -- 172.21.15.156:0/4011191574 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d8009550 con 0x7ff4e806a770 2023-09-30T22:24:10.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.464+0000 7ff4ddffb700 1 -- 172.21.15.156:0/4011191574 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e40038c0 con 0x7ff4e806a770 2023-09-30T22:24:10.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.464+0000 7ff4ef739700 1 -- 172.21.15.156:0/4011191574 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e8134af0 con 0x7ff4e806a770 2023-09-30T22:24:10.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.465+0000 7ff4ddffb700 1 -- 172.21.15.156:0/4011191574 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff4e4003a20 con 0x7ff4e806a770 2023-09-30T22:24:10.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.465+0000 7ff4ef739700 1 -- 172.21.15.156:0/4011191574 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4e804f2a0 con 0x7ff4e806a770 2023-09-30T22:24:10.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.465+0000 7ff4ddffb700 1 -- 172.21.15.156:0/4011191574 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff4e4010e00 con 0x7ff4e806a770 2023-09-30T22:24:10.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.474+0000 7ff4ddffb700 1 -- 172.21.15.156:0/4011191574 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff4e4044060 con 0x7ff4e806a770 2023-09-30T22:24:10.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.482+0000 7f06ac6c5700 1 Processor -- start 2023-09-30T22:24:10.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.482+0000 7f06ac6c5700 1 -- start start 2023-09-30T22:24:10.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.483+0000 7f06ac6c5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06a409e340 0x7f06a41359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:10.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.483+0000 7f06ac6c5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f06a4135f20 0x7f06a4138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:10.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.483+0000 7f06ac6c5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a409aaa0 con 0x7f06a409d860 2023-09-30T22:24:10.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.483+0000 7f06ac6c5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06a409e730 con 0x7f06a4135f20 2023-09-30T22:24:10.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.483+0000 7f06ac6c5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a409f870 con 0x7f06a409e340 2023-09-30T22:24:10.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.483+0000 7f06aac62700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f06a4135f20 0x7f06a4138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:10.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.483+0000 7f06aa461700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f06a409d860 0x7f06a409dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48826/0 (socket says 172.21.15.156:48826) 2023-09-30T22:24:10.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.483+0000 7f06a9c60700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06a409e340 0x7f06a41359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:10.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.483+0000 7f06aac62700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f06a4135f20 0x7f06a4138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41412/0 (socket says 172.21.15.156:41412) 2023-09-30T22:24:10.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.483+0000 7f06aa461700 1 -- 172.21.15.156:0/1151117804 learned_addr learned my addr 172.21.15.156:0/1151117804 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:10.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.483+0000 7f06aac62700 1 -- 172.21.15.156:0/1151117804 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06a409e340 msgr2=0x7f06a41359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:10.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.483+0000 7f06aac62700 1 --2- 172.21.15.156:0/1151117804 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06a409e340 0x7f06a41359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.483+0000 7f06aac62700 1 -- 172.21.15.156:0/1151117804 >> v1:172.21.15.156:6789/0 conn(0x7f06a409d860 legacy=0x7f06a409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:10.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.483+0000 7f06aac62700 1 -- 172.21.15.156:0/1151117804 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a409b360 con 0x7f06a4135f20 2023-09-30T22:24:10.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.483+0000 7f06aac62700 1 --2- 172.21.15.156:0/1151117804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06a4135f20 0x7f06a4138300 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f069c00bfa0 tx=0x7f069c00d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84c5470554606a2d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:10.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.483+0000 7f06a945f700 1 -- 172.21.15.156:0/1151117804 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c010070 con 0x7f06a4135f20 2023-09-30T22:24:10.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.484+0000 7f06a945f700 1 -- 172.21.15.156:0/1151117804 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069c00b2e0 con 0x7f06a4135f20 2023-09-30T22:24:10.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.484+0000 7f06a945f700 1 -- 172.21.15.156:0/1151117804 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c00dc40 con 0x7f06a4135f20 2023-09-30T22:24:10.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.484+0000 7f06ac6c5700 1 -- 172.21.15.156:0/1151117804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06a4135f20 msgr2=0x7f06a4138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:10.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.484+0000 7f06ac6c5700 1 --2- 172.21.15.156:0/1151117804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06a4135f20 0x7f06a4138300 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f069c00bfa0 tx=0x7f069c00d330 comp rx=0 tx=0).stop 2023-09-30T22:24:10.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.484+0000 7f06ac6c5700 1 -- 172.21.15.156:0/1151117804 shutdown_connections 2023-09-30T22:24:10.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.484+0000 7f06ac6c5700 1 --2- 172.21.15.156:0/1151117804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06a4135f20 0x7f06a4138300 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.484+0000 7f06ac6c5700 1 --2- 172.21.15.156:0/1151117804 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06a409e340 0x7f06a41359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.484+0000 7f06ac6c5700 1 -- 172.21.15.156:0/1151117804 >> 172.21.15.156:0/1151117804 conn(0x7f06a4099c40 msgr2=0x7f06a40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:10.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.484+0000 7f06ac6c5700 1 -- 172.21.15.156:0/1151117804 shutdown_connections 2023-09-30T22:24:10.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.484+0000 7f06ac6c5700 1 -- 172.21.15.156:0/1151117804 wait complete. 2023-09-30T22:24:10.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.485+0000 7f06ac6c5700 1 Processor -- start 2023-09-30T22:24:10.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.486+0000 7f06ac6c5700 1 -- start start 2023-09-30T22:24:10.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.486+0000 7f06ac6c5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06a409d860 0x7f06a411c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:10.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.486+0000 7f06ac6c5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06a409e340 0x7f06a411c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:10.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.486+0000 7f06ac6c5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06a4135f20 0x7f06a411ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:10.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.486+0000 7f06ac6c5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a411f1d0 con 0x7f06a409e340 2023-09-30T22:24:10.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.486+0000 7f06ac6c5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a411d7f0 con 0x7f06a4135f20 2023-09-30T22:24:10.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.486+0000 7f06ac6c5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06a409c8b0 con 0x7f06a409d860 2023-09-30T22:24:10.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.486+0000 7f06aa461700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06a409d860 0x7f06a411c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:10.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.486+0000 7f06aa461700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06a409d860 0x7f06a411c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44650/0 (socket says 172.21.15.156:44650) 2023-09-30T22:24:10.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.486+0000 7f06aa461700 1 -- 172.21.15.156:0/758040094 learned_addr learned my addr 172.21.15.156:0/758040094 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:10.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.486+0000 7f06aac62700 1 --2- 172.21.15.156:0/758040094 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06a4135f20 0x7f06a411ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:10.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.486+0000 7f06a9c60700 1 --2- 172.21.15.156:0/758040094 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06a409e340 0x7f06a411c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:10.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.487+0000 7f06aa461700 1 -- 172.21.15.156:0/758040094 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06a4135f20 msgr2=0x7f06a411ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:10.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.487+0000 7f06aa461700 1 --2- 172.21.15.156:0/758040094 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06a4135f20 0x7f06a411ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.487+0000 7f06aa461700 1 -- 172.21.15.156:0/758040094 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06a409e340 msgr2=0x7f06a411c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:10.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.487+0000 7f06aa461700 1 --2- 172.21.15.156:0/758040094 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06a409e340 0x7f06a411c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.487+0000 7f06aa461700 1 -- 172.21.15.156:0/758040094 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069c00bc80 con 0x7f06a409d860 2023-09-30T22:24:10.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.487+0000 7f06aac62700 1 --2- 172.21.15.156:0/758040094 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06a4135f20 0x7f06a411ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:10.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.487+0000 7f06aa461700 1 --2- 172.21.15.156:0/758040094 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06a409d860 0x7f06a411c3b0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f06a000c550 tx=0x7f06a000c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:10.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.487+0000 7f069affd700 1 -- 172.21.15.156:0/758040094 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a0005d70 con 0x7f06a409d860 2023-09-30T22:24:10.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.487+0000 7f069affd700 1 -- 172.21.15.156:0/758040094 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a00070d0 con 0x7f06a409d860 2023-09-30T22:24:10.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.487+0000 7f069affd700 1 -- 172.21.15.156:0/758040094 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a0007440 con 0x7f06a409d860 2023-09-30T22:24:10.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.487+0000 7f06ac6c5700 1 -- 172.21.15.156:0/758040094 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06a411e7e0 con 0x7f06a409d860 2023-09-30T22:24:10.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.487+0000 7f06ac6c5700 1 -- 172.21.15.156:0/758040094 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a411f620 con 0x7f06a409d860 2023-09-30T22:24:10.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.488+0000 7f069affd700 1 -- 172.21.15.156:0/758040094 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f06a00075a0 con 0x7f06a409d860 2023-09-30T22:24:10.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.488+0000 7f06ac6c5700 1 -- 172.21.15.156:0/758040094 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06a404f2a0 con 0x7f06a409d860 2023-09-30T22:24:10.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.488+0000 7f069affd700 1 -- 172.21.15.156:0/758040094 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f06a003ea70 con 0x7f06a409d860 2023-09-30T22:24:10.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.493+0000 7f069affd700 1 -- 172.21.15.156:0/758040094 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f06a0040e60 con 0x7f06a409d860 2023-09-30T22:24:10.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.541+0000 7fd342361700 1 -- 172.21.15.156:0/3674690418 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd33c11ed10 con 0x7fd33c131cf0 2023-09-30T22:24:10.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.542+0000 7fd338ff9700 1 -- 172.21.15.156:0/3674690418 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd33c11ed10 con 0x7fd33c131cf0 2023-09-30T22:24:10.542 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:10.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.544+0000 7fd342361700 1 -- 172.21.15.156:0/3674690418 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd33c131cf0 msgr2=0x7fd33c1c6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:10.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.544+0000 7fd342361700 1 --2- 172.21.15.156:0/3674690418 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd33c131cf0 0x7fd33c1c6990 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd33400efc0 tx=0x7fd33400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.544+0000 7fd342361700 1 -- 172.21.15.156:0/3674690418 shutdown_connections 2023-09-30T22:24:10.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.544+0000 7fd342361700 1 --2- 172.21.15.156:0/3674690418 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd33c131cf0 0x7fd33c1c6990 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.544+0000 7fd342361700 1 --2- 172.21.15.156:0/3674690418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd33c06a770 0x7fd33c1c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.544+0000 7fd342361700 1 --2- 172.21.15.156:0/3674690418 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd33c06b080 0x7fd33c1c6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.544+0000 7fd342361700 1 -- 172.21.15.156:0/3674690418 >> 172.21.15.156:0/3674690418 conn(0x7fd33c099c40 msgr2=0x7fd33c0a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:10.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.544+0000 7fd342361700 1 -- 172.21.15.156:0/3674690418 shutdown_connections 2023-09-30T22:24:10.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.544+0000 7fd342361700 1 -- 172.21.15.156:0/3674690418 wait complete. 2023-09-30T22:24:10.558 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:10.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.669+0000 7ff4ef739700 1 -- 172.21.15.156:0/4011191574 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff4e809e380 con 0x7ff4e806a770 2023-09-30T22:24:10.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.670+0000 7ff4ddffb700 1 -- 172.21.15.156:0/4011191574 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff4e4017030 con 0x7ff4e806a770 2023-09-30T22:24:10.671 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:10.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.672+0000 7ff4ef739700 1 -- 172.21.15.156:0/4011191574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4e806a770 msgr2=0x7ff4e809a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:10.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.672+0000 7ff4ef739700 1 --2- 172.21.15.156:0/4011191574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4e806a770 0x7ff4e809a420 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400c550 tx=0x7ff4e400c860 comp rx=0 tx=0).stop 2023-09-30T22:24:10.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.672+0000 7ff4ef739700 1 -- 172.21.15.156:0/4011191574 shutdown_connections 2023-09-30T22:24:10.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.672+0000 7ff4ef739700 1 --2- 172.21.15.156:0/4011191574 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4e8136cb0 0x7ff4e809aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.672+0000 7ff4ef739700 1 --2- 172.21.15.156:0/4011191574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4e806a770 0x7ff4e809a420 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.672+0000 7ff4ef739700 1 --2- 172.21.15.156:0/4011191574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4e809dec0 0x7ff4e809a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.672+0000 7ff4ef739700 1 -- 172.21.15.156:0/4011191574 >> 172.21.15.156:0/4011191574 conn(0x7ff4e8099c40 msgr2=0x7ff4e8070910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:10.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.672+0000 7ff4ef739700 1 -- 172.21.15.156:0/4011191574 shutdown_connections 2023-09-30T22:24:10.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.672+0000 7ff4ef739700 1 -- 172.21.15.156:0/4011191574 wait complete. 2023-09-30T22:24:10.684 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:10.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.686+0000 7f06ac6c5700 1 -- 172.21.15.156:0/758040094 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f06a411fc70 con 0x7f06a409d860 2023-09-30T22:24:10.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.687+0000 7f069affd700 1 -- 172.21.15.156:0/758040094 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f06a0017070 con 0x7f06a409d860 2023-09-30T22:24:10.687 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:10.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.689+0000 7f06ac6c5700 1 -- 172.21.15.156:0/758040094 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06a409d860 msgr2=0x7f06a411c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:10.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.689+0000 7f06ac6c5700 1 --2- 172.21.15.156:0/758040094 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06a409d860 0x7f06a411c3b0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f06a000c550 tx=0x7f06a000c860 comp rx=0 tx=0).stop 2023-09-30T22:24:10.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.689+0000 7f06ac6c5700 1 -- 172.21.15.156:0/758040094 shutdown_connections 2023-09-30T22:24:10.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.689+0000 7f06ac6c5700 1 --2- 172.21.15.156:0/758040094 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06a4135f20 0x7f06a411ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.689+0000 7f06ac6c5700 1 --2- 172.21.15.156:0/758040094 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06a409d860 0x7f06a411c3b0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.689+0000 7f06ac6c5700 1 --2- 172.21.15.156:0/758040094 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06a409e340 0x7f06a411c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.689+0000 7f06ac6c5700 1 -- 172.21.15.156:0/758040094 >> 172.21.15.156:0/758040094 conn(0x7f06a4099c40 msgr2=0x7f06a406ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:10.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.689+0000 7f06ac6c5700 1 -- 172.21.15.156:0/758040094 shutdown_connections 2023-09-30T22:24:10.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:10.689+0000 7f06ac6c5700 1 -- 172.21.15.156:0/758040094 wait complete. 2023-09-30T22:24:10.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:11.083 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:11.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.207+0000 7f8ded908700 1 Processor -- start 2023-09-30T22:24:11.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.207+0000 7f8ded908700 1 -- start start 2023-09-30T22:24:11.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.208+0000 7f8ded908700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8de8131980 0x7f8de8131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.208+0000 7f8ded908700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8de809c790 0x7f8de8139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.208+0000 7f8ded908700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8de80a1640 con 0x7f8de809bc70 2023-09-30T22:24:11.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.208+0000 7f8ded908700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8de806eb30 con 0x7f8de8131980 2023-09-30T22:24:11.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.208+0000 7f8ded908700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8de80a22d0 con 0x7f8de809c790 2023-09-30T22:24:11.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.208+0000 7f8de77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8de809c790 0x7f8de8139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.208+0000 7f8de6ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8de8131980 0x7f8de8131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.208+0000 7f8de77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8de809c790 0x7f8de8139710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44652/0 (socket says 172.21.15.156:44652) 2023-09-30T22:24:11.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.208+0000 7f8de67fc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f8de809bc70 0x7f8de809c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:48834/0 (socket says 172.21.15.156:48834) 2023-09-30T22:24:11.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.208+0000 7f8de77fe700 1 -- 172.21.15.156:0/1713659489 learned_addr learned my addr 172.21.15.156:0/1713659489 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:11.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.208+0000 7f8de6ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8de8131980 0x7f8de8131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:41432/0 (socket says 172.21.15.156:41432) 2023-09-30T22:24:11.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.208+0000 7f8de77fe700 1 -- 172.21.15.156:0/1713659489 >> v2:172.21.15.156:3300/0 conn(0x7f8de8131980 msgr2=0x7f8de8131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:11.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.208+0000 7f8de77fe700 1 --2- 172.21.15.156:0/1713659489 >> v2:172.21.15.156:3300/0 conn(0x7f8de8131980 0x7f8de8131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.208+0000 7f8de77fe700 1 -- 172.21.15.156:0/1713659489 >> v1:172.21.15.156:6789/0 conn(0x7f8de809bc70 legacy=0x7f8de809c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.208+0000 7f8de77fe700 1 -- 172.21.15.156:0/1713659489 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de8131550 con 0x7f8de809c790 2023-09-30T22:24:11.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.208+0000 7f8de6ffd700 1 --2- 172.21.15.156:0/1713659489 >> v2:172.21.15.156:3300/0 conn(0x7f8de8131980 0x7f8de8131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:11.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.208+0000 7f8de77fe700 1 --2- 172.21.15.156:0/1713659489 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8de809c790 0x7f8de8139710 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f8de0009e50 tx=0x7f8de000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49ab089950d81963 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:11.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.208+0000 7f8de5ffb700 1 -- 172.21.15.156:0/1713659489 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de000e070 con 0x7f8de809c790 2023-09-30T22:24:11.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.208+0000 7f8de5ffb700 1 -- 172.21.15.156:0/1713659489 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de000b910 con 0x7f8de809c790 2023-09-30T22:24:11.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.208+0000 7f8de5ffb700 1 -- 172.21.15.156:0/1713659489 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de000bcc0 con 0x7f8de809c790 2023-09-30T22:24:11.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.209+0000 7f8ded908700 1 -- 172.21.15.156:0/1713659489 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8de809c790 msgr2=0x7f8de8139710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.209+0000 7f8ded908700 1 --2- 172.21.15.156:0/1713659489 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8de809c790 0x7f8de8139710 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f8de0009e50 tx=0x7f8de000b330 comp rx=0 tx=0).stop 2023-09-30T22:24:11.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.209+0000 7f8ded908700 1 -- 172.21.15.156:0/1713659489 shutdown_connections 2023-09-30T22:24:11.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.209+0000 7f8ded908700 1 --2- 172.21.15.156:0/1713659489 >> v2:172.21.15.156:3300/0 conn(0x7f8de8131980 0x7f8de8131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.209+0000 7f8ded908700 1 --2- 172.21.15.156:0/1713659489 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8de809c790 0x7f8de8139710 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.209+0000 7f8ded908700 1 -- 172.21.15.156:0/1713659489 >> 172.21.15.156:0/1713659489 conn(0x7f8de80a2980 msgr2=0x7f8de80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:11.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.209+0000 7f8ded908700 1 -- 172.21.15.156:0/1713659489 shutdown_connections 2023-09-30T22:24:11.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.209+0000 7f8ded908700 1 -- 172.21.15.156:0/1713659489 wait complete. 2023-09-30T22:24:11.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.210+0000 7f8ded908700 1 Processor -- start 2023-09-30T22:24:11.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.210+0000 7f8ded908700 1 -- start start 2023-09-30T22:24:11.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.210+0000 7f8ded908700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8de809bc70 0x7f8de811b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.210+0000 7f8ded908700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8de809c790 0x7f8de811bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.210+0000 7f8ded908700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8de8131980 0x7f8de811c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.210+0000 7f8ded908700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de811ea70 con 0x7f8de8131980 2023-09-30T22:24:11.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.210+0000 7f8ded908700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de811d390 con 0x7f8de809bc70 2023-09-30T22:24:11.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.210+0000 7f8ded908700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8de811ef20 con 0x7f8de809c790 2023-09-30T22:24:11.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.211+0000 7f8de67fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8de809c790 0x7f8de811bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.211+0000 7f8de77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8de8131980 0x7f8de811c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.211+0000 7f8de6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8de809bc70 0x7f8de811b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.211+0000 7f8de67fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8de809c790 0x7f8de811bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:44662/0 (socket says 172.21.15.156:44662) 2023-09-30T22:24:11.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.211+0000 7f8de67fc700 1 -- 172.21.15.156:0/1733471038 learned_addr learned my addr 172.21.15.156:0/1733471038 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:11.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.211+0000 7f8de77fe700 1 -- 172.21.15.156:0/1733471038 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8de809c790 msgr2=0x7f8de811bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.211+0000 7f8de77fe700 1 --2- 172.21.15.156:0/1733471038 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8de809c790 0x7f8de811bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.211+0000 7f8de77fe700 1 -- 172.21.15.156:0/1733471038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8de809bc70 msgr2=0x7f8de811b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.211+0000 7f8de77fe700 1 --2- 172.21.15.156:0/1733471038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8de809bc70 0x7f8de811b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.211+0000 7f8de77fe700 1 -- 172.21.15.156:0/1733471038 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ddc00d8d0 con 0x7f8de8131980 2023-09-30T22:24:11.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.211+0000 7f8de77fe700 1 --2- 172.21.15.156:0/1733471038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8de8131980 0x7f8de811c1f0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f8de0015000 tx=0x7f8de0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:11.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.211+0000 7f8dcffff700 1 -- 172.21.15.156:0/1733471038 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de0004800 con 0x7f8de8131980 2023-09-30T22:24:11.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.211+0000 7f8dcffff700 1 -- 172.21.15.156:0/1733471038 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de0004960 con 0x7f8de8131980 2023-09-30T22:24:11.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.211+0000 7f8ded908700 1 -- 172.21.15.156:0/1733471038 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de0009b30 con 0x7f8de8131980 2023-09-30T22:24:11.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.211+0000 7f8dcffff700 1 -- 172.21.15.156:0/1733471038 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de001c680 con 0x7f8de8131980 2023-09-30T22:24:11.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.211+0000 7f8ded908700 1 -- 172.21.15.156:0/1733471038 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de811e540 con 0x7f8de8131980 2023-09-30T22:24:11.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.212+0000 7f8ded908700 1 -- 172.21.15.156:0/1733471038 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de809f9c0 con 0x7f8de8131980 2023-09-30T22:24:11.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.212+0000 7f8dcffff700 1 -- 172.21.15.156:0/1733471038 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8de001c7e0 con 0x7f8de8131980 2023-09-30T22:24:11.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.213+0000 7f8dcffff700 1 -- 172.21.15.156:0/1733471038 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8de0041630 con 0x7f8de8131980 2023-09-30T22:24:11.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.217+0000 7f8dcffff700 1 -- 172.21.15.156:0/1733471038 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8de0023950 con 0x7f8de8131980 2023-09-30T22:24:11.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.399+0000 7f8ded908700 1 -- 172.21.15.156:0/1733471038 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8de804f2a0 con 0x7f8de8131980 2023-09-30T22:24:11.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.399+0000 7f8dcffff700 1 -- 172.21.15.156:0/1733471038 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8de0033090 con 0x7f8de8131980 2023-09-30T22:24:11.400 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:11.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.401+0000 7f8ded908700 1 -- 172.21.15.156:0/1733471038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8de8131980 msgr2=0x7f8de811c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.401+0000 7f8ded908700 1 --2- 172.21.15.156:0/1733471038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8de8131980 0x7f8de811c1f0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f8de0015000 tx=0x7f8de0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.401+0000 7f8ded908700 1 -- 172.21.15.156:0/1733471038 shutdown_connections 2023-09-30T22:24:11.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.401+0000 7f8ded908700 1 --2- 172.21.15.156:0/1733471038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8de8131980 0x7f8de811c1f0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.401+0000 7f8ded908700 1 --2- 172.21.15.156:0/1733471038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8de809bc70 0x7f8de811b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.401+0000 7f8ded908700 1 --2- 172.21.15.156:0/1733471038 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8de809c790 0x7f8de811bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.401+0000 7f8ded908700 1 -- 172.21.15.156:0/1733471038 >> 172.21.15.156:0/1733471038 conn(0x7f8de80a2980 msgr2=0x7f8de8071670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:11.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.401+0000 7f8ded908700 1 -- 172.21.15.156:0/1733471038 shutdown_connections 2023-09-30T22:24:11.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.401+0000 7f8ded908700 1 -- 172.21.15.156:0/1733471038 wait complete. 2023-09-30T22:24:11.414 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:11.559 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:11.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.681+0000 7f89bb2e1700 1 Processor -- start 2023-09-30T22:24:11.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.681+0000 7f89bb2e1700 1 -- start start 2023-09-30T22:24:11.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.681+0000 7f89bb2e1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f89b4133ad0 0x7f89b4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.681+0000 7f89bb2e1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89b41300a0 0x7f89b41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.681+0000 7f89bb2e1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89b41309f0 0x7f89b413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.681+0000 7f89bb2e1700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b406b2d0 con 0x7f89b4133ad0 2023-09-30T22:24:11.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.681+0000 7f89bb2e1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b4133610 con 0x7f89b41309f0 2023-09-30T22:24:11.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.681+0000 7f89bb2e1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89b409a500 con 0x7f89b41300a0 2023-09-30T22:24:11.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.681+0000 7f89b887c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89b41300a0 0x7f89b41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.681+0000 7f89b907d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f89b4133ad0 0x7f89b4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.681+0000 7f89b987e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89b41309f0 0x7f89b413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.681+0000 7f89b907d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f89b4133ad0 0x7f89b4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60398/0 (socket says 172.21.15.156:60398) 2023-09-30T22:24:11.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.681+0000 7f89b887c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89b41300a0 0x7f89b41304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52352/0 (socket says 172.21.15.156:52352) 2023-09-30T22:24:11.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.681+0000 7f89b987e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89b41309f0 0x7f89b413a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53402/0 (socket says 172.21.15.156:53402) 2023-09-30T22:24:11.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.681+0000 7f89b907d700 1 -- 172.21.15.156:0/147904700 learned_addr learned my addr 172.21.15.156:0/147904700 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:11.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.682+0000 7f89b887c700 1 -- 172.21.15.156:0/147904700 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89b41309f0 msgr2=0x7f89b413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:11.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.682+0000 7f89b887c700 1 --2- 172.21.15.156:0/147904700 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89b41309f0 0x7f89b413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.682+0000 7f89b887c700 1 -- 172.21.15.156:0/147904700 >> v2:172.21.15.156:3300/0 conn(0x7f89b4133ad0 msgr2=0x7f89b4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:11.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.682+0000 7f89b887c700 1 --2- 172.21.15.156:0/147904700 >> v2:172.21.15.156:3300/0 conn(0x7f89b4133ad0 0x7f89b4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.682+0000 7f89b887c700 1 -- 172.21.15.156:0/147904700 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b41338b0 con 0x7f89b41300a0 2023-09-30T22:24:11.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.682+0000 7f89b907d700 1 --2- 172.21.15.156:0/147904700 >> v2:172.21.15.156:3300/0 conn(0x7f89b4133ad0 0x7f89b4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:11.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.682+0000 7f89b987e700 1 --2- 172.21.15.156:0/147904700 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89b41309f0 0x7f89b413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:11.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.682+0000 7f89b887c700 1 --2- 172.21.15.156:0/147904700 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89b41300a0 0x7f89b41304b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f89b0009840 tx=0x7f89b0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f695e2d9fa6cf016 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:11.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.682+0000 7f89abfff700 1 -- 172.21.15.156:0/147904700 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b0011830 con 0x7f89b41300a0 2023-09-30T22:24:11.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.682+0000 7f89abfff700 1 -- 172.21.15.156:0/147904700 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b0011990 con 0x7f89b41300a0 2023-09-30T22:24:11.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.682+0000 7f89abfff700 1 -- 172.21.15.156:0/147904700 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b0011d20 con 0x7f89b41300a0 2023-09-30T22:24:11.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.683+0000 7f89bb2e1700 1 -- 172.21.15.156:0/147904700 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89b41300a0 msgr2=0x7f89b41304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.683+0000 7f89bb2e1700 1 --2- 172.21.15.156:0/147904700 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89b41300a0 0x7f89b41304b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f89b0009840 tx=0x7f89b0009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:11.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.683+0000 7f89bb2e1700 1 -- 172.21.15.156:0/147904700 shutdown_connections 2023-09-30T22:24:11.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.683+0000 7f89bb2e1700 1 --2- 172.21.15.156:0/147904700 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89b41309f0 0x7f89b413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.683+0000 7f89bb2e1700 1 --2- 172.21.15.156:0/147904700 >> v2:172.21.15.156:3300/0 conn(0x7f89b4133ad0 0x7f89b4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.683+0000 7f89bb2e1700 1 --2- 172.21.15.156:0/147904700 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89b41300a0 0x7f89b41304b0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.683+0000 7f89bb2e1700 1 -- 172.21.15.156:0/147904700 >> 172.21.15.156:0/147904700 conn(0x7f89b4099c40 msgr2=0x7f89b40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:11.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.683+0000 7f89bb2e1700 1 -- 172.21.15.156:0/147904700 shutdown_connections 2023-09-30T22:24:11.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.683+0000 7f89bb2e1700 1 -- 172.21.15.156:0/147904700 wait complete. 2023-09-30T22:24:11.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.684+0000 7f89bb2e1700 1 Processor -- start 2023-09-30T22:24:11.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.684+0000 7f89bb2e1700 1 -- start start 2023-09-30T22:24:11.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.684+0000 7f89bb2e1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89b41300a0 0x7f89b411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.684+0000 7f89bb2e1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89b41309f0 0x7f89b411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.684+0000 7f89bb2e1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89b4133ad0 0x7f89b411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.684+0000 7f89bb2e1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b41209f0 con 0x7f89b41309f0 2023-09-30T22:24:11.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.684+0000 7f89bb2e1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b412f920 con 0x7f89b4133ad0 2023-09-30T22:24:11.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.684+0000 7f89bb2e1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89b412d8c0 con 0x7f89b41300a0 2023-09-30T22:24:11.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.684+0000 7f89b907d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89b41300a0 0x7f89b411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.684+0000 7f89b887c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89b41309f0 0x7f89b411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.684+0000 7f89b907d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89b41300a0 0x7f89b411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52364/0 (socket says 172.21.15.156:52364) 2023-09-30T22:24:11.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.684+0000 7f89b907d700 1 -- 172.21.15.156:0/2070233933 learned_addr learned my addr 172.21.15.156:0/2070233933 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:11.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.684+0000 7f89b987e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89b4133ad0 0x7f89b411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.684+0000 7f89b907d700 1 -- 172.21.15.156:0/2070233933 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89b4133ad0 msgr2=0x7f89b411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.684+0000 7f89b907d700 1 --2- 172.21.15.156:0/2070233933 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89b4133ad0 0x7f89b411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.684+0000 7f89b907d700 1 -- 172.21.15.156:0/2070233933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89b41309f0 msgr2=0x7f89b411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.684+0000 7f89b907d700 1 --2- 172.21.15.156:0/2070233933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89b41309f0 0x7f89b411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.684+0000 7f89b907d700 1 -- 172.21.15.156:0/2070233933 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ac009a70 con 0x7f89b41300a0 2023-09-30T22:24:11.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.685+0000 7f89b907d700 1 --2- 172.21.15.156:0/2070233933 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89b41300a0 0x7f89b411da40 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f89a400ec10 tx=0x7f89a400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:11.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.685+0000 7f89a9ffb700 1 -- 172.21.15.156:0/2070233933 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a400c850 con 0x7f89b41300a0 2023-09-30T22:24:11.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.685+0000 7f89a9ffb700 1 -- 172.21.15.156:0/2070233933 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a400c9b0 con 0x7f89b41300a0 2023-09-30T22:24:11.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.685+0000 7f89a9ffb700 1 -- 172.21.15.156:0/2070233933 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a400cd20 con 0x7f89b41300a0 2023-09-30T22:24:11.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.685+0000 7f89bb2e1700 1 -- 172.21.15.156:0/2070233933 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a4009550 con 0x7f89b41300a0 2023-09-30T22:24:11.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.685+0000 7f89bb2e1700 1 -- 172.21.15.156:0/2070233933 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b00094a0 con 0x7f89b41300a0 2023-09-30T22:24:11.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.686+0000 7f89bb2e1700 1 -- 172.21.15.156:0/2070233933 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b411f370 con 0x7f89b41300a0 2023-09-30T22:24:11.692 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:11.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.686+0000 7f89a9ffb700 1 -- 172.21.15.156:0/2070233933 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f89a4013470 con 0x7f89b41300a0 2023-09-30T22:24:11.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.686+0000 7f89a9ffb700 1 -- 172.21.15.156:0/2070233933 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f89a403ff00 con 0x7f89b41300a0 2023-09-30T22:24:11.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.690+0000 7f89a9ffb700 1 -- 172.21.15.156:0/2070233933 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f89a4013720 con 0x7f89b41300a0 2023-09-30T22:24:11.703 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:11.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.819+0000 7fdc2da45700 1 Processor -- start 2023-09-30T22:24:11.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.819+0000 7fdc2da45700 1 -- start start 2023-09-30T22:24:11.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.820+0000 7fdc2da45700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdc28136960 0x7fdc28138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.820+0000 7fdc2da45700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc28139280 0x7fdc2813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.820+0000 7fdc2da45700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc2806b2d0 con 0x7fdc28133ad0 2023-09-30T22:24:11.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.820+0000 7fdc2da45700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc281345b0 con 0x7fdc28136960 2023-09-30T22:24:11.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.820+0000 7fdc2da45700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc28133610 con 0x7fdc28139280 2023-09-30T22:24:11.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.820+0000 7fdc267fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdc28136960 0x7fdc28138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.820+0000 7fdc277fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc28139280 0x7fdc2813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.820+0000 7fdc267fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdc28136960 0x7fdc28138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60420/0 (socket says 172.21.15.156:60420) 2023-09-30T22:24:11.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.820+0000 7fdc277fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc28139280 0x7fdc2813b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52378/0 (socket says 172.21.15.156:52378) 2023-09-30T22:24:11.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.820+0000 7fdc267fc700 1 -- 172.21.15.156:0/994035273 learned_addr learned my addr 172.21.15.156:0/994035273 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:11.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.820+0000 7fdc267fc700 1 -- 172.21.15.156:0/994035273 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc28139280 msgr2=0x7fdc2813b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:11.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.820+0000 7fdc267fc700 1 --2- 172.21.15.156:0/994035273 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc28139280 0x7fdc2813b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.820+0000 7fdc267fc700 1 -- 172.21.15.156:0/994035273 >> v1:172.21.15.156:6789/0 conn(0x7fdc28133ad0 legacy=0x7fdc28133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.820+0000 7fdc25ffb700 1 -- 172.21.15.156:0/994035273 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840439840 0 0) 0x7fdc2806b2d0 con 0x7fdc28133ad0 2023-09-30T22:24:11.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.820+0000 7fdc267fc700 1 -- 172.21.15.156:0/994035273 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2809a500 con 0x7fdc28136960 2023-09-30T22:24:11.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.820+0000 7fdc267fc700 1 --2- 172.21.15.156:0/994035273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc28136960 0x7fdc28138d40 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c0098f0 tx=0x7fdc1c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f42293824389805 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:11.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.821+0000 7fdc25ffb700 1 -- 172.21.15.156:0/994035273 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c00b8a0 con 0x7fdc28136960 2023-09-30T22:24:11.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.821+0000 7fdc25ffb700 1 -- 172.21.15.156:0/994035273 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1c00ba00 con 0x7fdc28136960 2023-09-30T22:24:11.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.821+0000 7fdc25ffb700 1 -- 172.21.15.156:0/994035273 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c00bd90 con 0x7fdc28136960 2023-09-30T22:24:11.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.821+0000 7fdc2da45700 1 -- 172.21.15.156:0/994035273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc28136960 msgr2=0x7fdc28138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.821+0000 7fdc2da45700 1 --2- 172.21.15.156:0/994035273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc28136960 0x7fdc28138d40 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c0098f0 tx=0x7fdc1c009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:11.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.821+0000 7fdc2da45700 1 -- 172.21.15.156:0/994035273 shutdown_connections 2023-09-30T22:24:11.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.821+0000 7fdc2da45700 1 --2- 172.21.15.156:0/994035273 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc28139280 0x7fdc2813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.821+0000 7fdc2da45700 1 --2- 172.21.15.156:0/994035273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc28136960 0x7fdc28138d40 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.821+0000 7fdc2da45700 1 -- 172.21.15.156:0/994035273 >> 172.21.15.156:0/994035273 conn(0x7fdc28099c40 msgr2=0x7fdc280a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:11.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.821+0000 7fdc2da45700 1 -- 172.21.15.156:0/994035273 shutdown_connections 2023-09-30T22:24:11.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.821+0000 7fdc2da45700 1 -- 172.21.15.156:0/994035273 wait complete. 2023-09-30T22:24:11.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.823+0000 7fdc2da45700 1 Processor -- start 2023-09-30T22:24:11.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.823+0000 7fdc2da45700 1 -- start start 2023-09-30T22:24:11.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.824+0000 7fdc2da45700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc28133ad0 0x7fdc28071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.824+0000 7fdc2da45700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc28136960 0x7fdc28071690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.824+0000 7fdc2da45700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc28139280 0x7fdc28071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.824+0000 7fdc2da45700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2806ec30 con 0x7fdc28136960 2023-09-30T22:24:11.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.824+0000 7fdc2da45700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc28072200 con 0x7fdc28133ad0 2023-09-30T22:24:11.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.824+0000 7fdc2da45700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc281317a0 con 0x7fdc28139280 2023-09-30T22:24:11.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.824+0000 7fdc26ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc28133ad0 0x7fdc28071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.824+0000 7fdc26ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc28133ad0 0x7fdc28071150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53420/0 (socket says 172.21.15.156:53420) 2023-09-30T22:24:11.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.824+0000 7fdc26ffd700 1 -- 172.21.15.156:0/3090563041 learned_addr learned my addr 172.21.15.156:0/3090563041 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:11.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.824+0000 7fdc277fe700 1 --2- 172.21.15.156:0/3090563041 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc28139280 0x7fdc28071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.824+0000 7fdc267fc700 1 --2- 172.21.15.156:0/3090563041 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc28136960 0x7fdc28071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.824+0000 7fdc267fc700 1 -- 172.21.15.156:0/3090563041 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc28139280 msgr2=0x7fdc28071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.824+0000 7fdc267fc700 1 --2- 172.21.15.156:0/3090563041 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc28139280 0x7fdc28071bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.824+0000 7fdc267fc700 1 -- 172.21.15.156:0/3090563041 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc28133ad0 msgr2=0x7fdc28071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.824+0000 7fdc267fc700 1 --2- 172.21.15.156:0/3090563041 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc28133ad0 0x7fdc28071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.824+0000 7fdc267fc700 1 -- 172.21.15.156:0/3090563041 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1c009550 con 0x7fdc28136960 2023-09-30T22:24:11.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.824+0000 7fdc26ffd700 1 --2- 172.21.15.156:0/3090563041 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc28133ad0 0x7fdc28071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:11.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.824+0000 7fdc277fe700 1 --2- 172.21.15.156:0/3090563041 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc28139280 0x7fdc28071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:11.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.824+0000 7fdc267fc700 1 --2- 172.21.15.156:0/3090563041 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc28136960 0x7fdc28071690 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c016000 tx=0x7fdc1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:11.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.825+0000 7fdc0ffff700 1 -- 172.21.15.156:0/3090563041 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c004450 con 0x7fdc28136960 2023-09-30T22:24:11.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.825+0000 7fdc0ffff700 1 -- 172.21.15.156:0/3090563041 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1c0045b0 con 0x7fdc28136960 2023-09-30T22:24:11.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.825+0000 7fdc0ffff700 1 -- 172.21.15.156:0/3090563041 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c0038a0 con 0x7fdc28136960 2023-09-30T22:24:11.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.825+0000 7fdc2da45700 1 -- 172.21.15.156:0/3090563041 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc28070290 con 0x7fdc28136960 2023-09-30T22:24:11.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.825+0000 7fdc2da45700 1 -- 172.21.15.156:0/3090563041 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc28070d00 con 0x7fdc28136960 2023-09-30T22:24:11.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.826+0000 7fdc0ffff700 1 -- 172.21.15.156:0/3090563041 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc1c021070 con 0x7fdc28136960 2023-09-30T22:24:11.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.826+0000 7fdc2da45700 1 -- 172.21.15.156:0/3090563041 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc2804f2a0 con 0x7fdc28136960 2023-09-30T22:24:11.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.826+0000 7fdc0ffff700 1 -- 172.21.15.156:0/3090563041 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdc1c0409b0 con 0x7fdc28136960 2023-09-30T22:24:11.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.834+0000 7fdc0ffff700 1 -- 172.21.15.156:0/3090563041 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc1c02e9e0 con 0x7fdc28136960 2023-09-30T22:24:11.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.865+0000 7f2ed9842700 1 Processor -- start 2023-09-30T22:24:11.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.865+0000 7f2ed9842700 1 -- start start 2023-09-30T22:24:11.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.866+0000 7f2ed9842700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2ed4099a60 0x7f2ed41388f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.866+0000 7f2ed9842700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2ed4138e30 0x7f2ed413b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.866+0000 7f2ed9842700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed409aa00 con 0x7f2ed4133b80 2023-09-30T22:24:11.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.866+0000 7f2ed9842700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed409a080 con 0x7f2ed4099a60 2023-09-30T22:24:11.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.866+0000 7f2ed9842700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed4133750 con 0x7f2ed4138e30 2023-09-30T22:24:11.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.866+0000 7f2ed27fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2ed4099a60 0x7f2ed41388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.866+0000 7f2ed2ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f2ed4133b80 0x7f2ed4133f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49294/0 (socket says 172.21.15.156:49294) 2023-09-30T22:24:11.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.866+0000 7f2ed37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2ed4138e30 0x7f2ed413b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.866+0000 7f2ed2ffd700 1 -- 172.21.15.156:0/22982466 learned_addr learned my addr 172.21.15.156:0/22982466 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:11.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.867+0000 7f2ed37fe700 1 -- 172.21.15.156:0/22982466 >> v2:172.21.15.156:3300/0 conn(0x7f2ed4099a60 msgr2=0x7f2ed41388f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:11.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.867+0000 7f2ed37fe700 1 --2- 172.21.15.156:0/22982466 >> v2:172.21.15.156:3300/0 conn(0x7f2ed4099a60 0x7f2ed41388f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.867+0000 7f2ed37fe700 1 -- 172.21.15.156:0/22982466 >> v1:172.21.15.156:6789/0 conn(0x7f2ed4133b80 legacy=0x7f2ed4133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.867+0000 7f2ed37fe700 1 -- 172.21.15.156:0/22982466 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed409a760 con 0x7f2ed4138e30 2023-09-30T22:24:11.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.867+0000 7f2ed1ffb700 1 -- 172.21.15.156:0/22982466 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4228296482 0 0) 0x7f2ed409aa00 con 0x7f2ed4133b80 2023-09-30T22:24:11.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.867+0000 7f2ed37fe700 1 --2- 172.21.15.156:0/22982466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2ed4138e30 0x7f2ed413b210 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc009d90 tx=0x7f2ecc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d56f869bc4222884 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:11.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.867+0000 7f2ed1ffb700 1 -- 172.21.15.156:0/22982466 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc00e070 con 0x7f2ed4138e30 2023-09-30T22:24:11.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.867+0000 7f2ed1ffb700 1 -- 172.21.15.156:0/22982466 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ecc00bb20 con 0x7f2ed4138e30 2023-09-30T22:24:11.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.867+0000 7f2ed1ffb700 1 -- 172.21.15.156:0/22982466 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc012430 con 0x7f2ed4138e30 2023-09-30T22:24:11.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.868+0000 7f2ed9842700 1 -- 172.21.15.156:0/22982466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2ed4138e30 msgr2=0x7f2ed413b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.868+0000 7f2ed9842700 1 --2- 172.21.15.156:0/22982466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2ed4138e30 0x7f2ed413b210 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc009d90 tx=0x7f2ecc00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:11.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.868+0000 7f2ed9842700 1 -- 172.21.15.156:0/22982466 shutdown_connections 2023-09-30T22:24:11.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.868+0000 7f2ed9842700 1 --2- 172.21.15.156:0/22982466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2ed4138e30 0x7f2ed413b210 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.868+0000 7f2ed9842700 1 --2- 172.21.15.156:0/22982466 >> v2:172.21.15.156:3300/0 conn(0x7f2ed4099a60 0x7f2ed41388f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.868+0000 7f2ed9842700 1 -- 172.21.15.156:0/22982466 >> 172.21.15.156:0/22982466 conn(0x7f2ed40a2980 msgr2=0x7f2ed40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:11.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.868+0000 7f2ed9842700 1 -- 172.21.15.156:0/22982466 shutdown_connections 2023-09-30T22:24:11.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.868+0000 7f2ed9842700 1 -- 172.21.15.156:0/22982466 wait complete. 2023-09-30T22:24:11.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.869+0000 7f2ed9842700 1 Processor -- start 2023-09-30T22:24:11.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.869+0000 7f2ed9842700 1 -- start start 2023-09-30T22:24:11.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.869+0000 7f2ed9842700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2ed4099a60 0x7f2ed4118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.869+0000 7f2ed9842700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ed4133b80 0x7f2ed4119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.869+0000 7f2ed9842700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2ed4138e30 0x7f2ed4119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.869+0000 7f2ed9842700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed411c000 con 0x7f2ed4133b80 2023-09-30T22:24:11.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.869+0000 7f2ed9842700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed411b7a0 con 0x7f2ed4099a60 2023-09-30T22:24:11.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.869+0000 7f2ed9842700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed409a2c0 con 0x7f2ed4138e30 2023-09-30T22:24:11.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.869+0000 7f2ed2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2ed4099a60 0x7f2ed4118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.869+0000 7f2ed2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2ed4099a60 0x7f2ed4118df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53432/0 (socket says 172.21.15.156:53432) 2023-09-30T22:24:11.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.869+0000 7f2ed2ffd700 1 -- 172.21.15.156:0/200004746 learned_addr learned my addr 172.21.15.156:0/200004746 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:11.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.869+0000 7f2ed37fe700 1 --2- 172.21.15.156:0/200004746 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2ed4138e30 0x7f2ed4119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.869+0000 7f2ed27fc700 1 --2- 172.21.15.156:0/200004746 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ed4133b80 0x7f2ed4119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.870+0000 7f2ed2ffd700 1 -- 172.21.15.156:0/200004746 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2ed4138e30 msgr2=0x7f2ed4119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.870+0000 7f2ed2ffd700 1 --2- 172.21.15.156:0/200004746 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2ed4138e30 0x7f2ed4119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.870+0000 7f2ed2ffd700 1 -- 172.21.15.156:0/200004746 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ed4133b80 msgr2=0x7f2ed4119330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.870+0000 7f2ed2ffd700 1 --2- 172.21.15.156:0/200004746 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ed4133b80 0x7f2ed4119330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.870+0000 7f2ed2ffd700 1 -- 172.21.15.156:0/200004746 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ecc009a70 con 0x7f2ed4099a60 2023-09-30T22:24:11.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.870+0000 7f2ed2ffd700 1 --2- 172.21.15.156:0/200004746 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2ed4099a60 0x7f2ed4118df0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f2ec400c6d0 tx=0x7f2ec400c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:11.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.870+0000 7f2ebbfff700 1 -- 172.21.15.156:0/200004746 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec40074e0 con 0x7f2ed4099a60 2023-09-30T22:24:11.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.870+0000 7f2ebbfff700 1 -- 172.21.15.156:0/200004746 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec4007640 con 0x7f2ed4099a60 2023-09-30T22:24:11.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.870+0000 7f2ebbfff700 1 -- 172.21.15.156:0/200004746 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4005a70 con 0x7f2ed4099a60 2023-09-30T22:24:11.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.870+0000 7f2ed9842700 1 -- 172.21.15.156:0/200004746 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed411ae40 con 0x7f2ed4099a60 2023-09-30T22:24:11.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.870+0000 7f2ed9842700 1 -- 172.21.15.156:0/200004746 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed411b0f0 con 0x7f2ed4099a60 2023-09-30T22:24:11.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.871+0000 7f2ebbfff700 1 -- 172.21.15.156:0/200004746 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2ec4005bd0 con 0x7f2ed4099a60 2023-09-30T22:24:11.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.871+0000 7f2ebbfff700 1 -- 172.21.15.156:0/200004746 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2ec403ead0 con 0x7f2ed4099a60 2023-09-30T22:24:11.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.871+0000 7f2ed9842700 1 -- 172.21.15.156:0/200004746 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed404f2a0 con 0x7f2ed4099a60 2023-09-30T22:24:11.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.876+0000 7f2ebbfff700 1 -- 172.21.15.156:0/200004746 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2ec4017020 con 0x7f2ed4099a60 2023-09-30T22:24:11.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.891+0000 7f89bb2e1700 1 -- 172.21.15.156:0/2070233933 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f89b409cb20 con 0x7f89b41300a0 2023-09-30T22:24:11.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.891+0000 7f89a9ffb700 1 -- 172.21.15.156:0/2070233933 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f89a4021070 con 0x7f89b41300a0 2023-09-30T22:24:11.892 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:11.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.893+0000 7f89bb2e1700 1 -- 172.21.15.156:0/2070233933 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89b41300a0 msgr2=0x7f89b411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.893+0000 7f89bb2e1700 1 --2- 172.21.15.156:0/2070233933 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89b41300a0 0x7f89b411da40 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f89a400ec10 tx=0x7f89a400ef20 comp rx=0 tx=0).stop 2023-09-30T22:24:11.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.894+0000 7f89bb2e1700 1 -- 172.21.15.156:0/2070233933 shutdown_connections 2023-09-30T22:24:11.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.894+0000 7f89bb2e1700 1 --2- 172.21.15.156:0/2070233933 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f89b4133ad0 0x7f89b411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.894+0000 7f89bb2e1700 1 --2- 172.21.15.156:0/2070233933 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f89b41300a0 0x7f89b411da40 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.894+0000 7f89bb2e1700 1 --2- 172.21.15.156:0/2070233933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89b41309f0 0x7f89b411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.894+0000 7f89bb2e1700 1 -- 172.21.15.156:0/2070233933 >> 172.21.15.156:0/2070233933 conn(0x7f89b4099c40 msgr2=0x7f89b4132ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:11.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.894+0000 7f89bb2e1700 1 -- 172.21.15.156:0/2070233933 shutdown_connections 2023-09-30T22:24:11.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:11.894+0000 7f89bb2e1700 1 -- 172.21.15.156:0/2070233933 wait complete. 2023-09-30T22:24:11.907 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:12.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.027+0000 7fdc2da45700 1 -- 172.21.15.156:0/3090563041 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdc2809f0f0 con 0x7fdc28136960 2023-09-30T22:24:12.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.027+0000 7fdc0ffff700 1 -- 172.21.15.156:0/3090563041 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdc1c029030 con 0x7fdc28136960 2023-09-30T22:24:12.028 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:12.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.029+0000 7fdc2da45700 1 -- 172.21.15.156:0/3090563041 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc28136960 msgr2=0x7fdc28071690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:12.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.029+0000 7fdc2da45700 1 --2- 172.21.15.156:0/3090563041 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc28136960 0x7fdc28071690 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c016000 tx=0x7fdc1c004750 comp rx=0 tx=0).stop 2023-09-30T22:24:12.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.029+0000 7fdc2da45700 1 -- 172.21.15.156:0/3090563041 shutdown_connections 2023-09-30T22:24:12.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.029+0000 7fdc2da45700 1 --2- 172.21.15.156:0/3090563041 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc28139280 0x7fdc28071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.029+0000 7fdc2da45700 1 --2- 172.21.15.156:0/3090563041 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc28133ad0 0x7fdc28071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.029+0000 7fdc2da45700 1 --2- 172.21.15.156:0/3090563041 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc28136960 0x7fdc28071690 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.029+0000 7fdc2da45700 1 -- 172.21.15.156:0/3090563041 >> 172.21.15.156:0/3090563041 conn(0x7fdc28099c40 msgr2=0x7fdc280a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:12.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.030+0000 7fdc2da45700 1 -- 172.21.15.156:0/3090563041 shutdown_connections 2023-09-30T22:24:12.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.030+0000 7fdc2da45700 1 -- 172.21.15.156:0/3090563041 wait complete. 2023-09-30T22:24:12.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:12.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.065+0000 7f2ed9842700 1 -- 172.21.15.156:0/200004746 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2ed406bce0 con 0x7f2ed4099a60 2023-09-30T22:24:12.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.065+0000 7f2ebbfff700 1 -- 172.21.15.156:0/200004746 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2ec401bb10 con 0x7f2ed4099a60 2023-09-30T22:24:12.066 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:12.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.067+0000 7f2ed9842700 1 -- 172.21.15.156:0/200004746 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2ed4099a60 msgr2=0x7f2ed4118df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:12.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.067+0000 7f2ed9842700 1 --2- 172.21.15.156:0/200004746 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2ed4099a60 0x7f2ed4118df0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f2ec400c6d0 tx=0x7f2ec400c9e0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.067+0000 7f2ed9842700 1 -- 172.21.15.156:0/200004746 shutdown_connections 2023-09-30T22:24:12.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.067+0000 7f2ed9842700 1 --2- 172.21.15.156:0/200004746 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2ed4138e30 0x7f2ed4119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.067+0000 7f2ed9842700 1 --2- 172.21.15.156:0/200004746 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2ed4099a60 0x7f2ed4118df0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.067+0000 7f2ed9842700 1 --2- 172.21.15.156:0/200004746 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ed4133b80 0x7f2ed4119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.067+0000 7f2ed9842700 1 -- 172.21.15.156:0/200004746 >> 172.21.15.156:0/200004746 conn(0x7f2ed40a2980 msgr2=0x7f2ed41300d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:12.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.067+0000 7f2ed9842700 1 -- 172.21.15.156:0/200004746 shutdown_connections 2023-09-30T22:24:12.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.067+0000 7f2ed9842700 1 -- 172.21.15.156:0/200004746 wait complete. 2023-09-30T22:24:12.080 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:12.415 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:12.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.538+0000 7fe9a3d15700 1 Processor -- start 2023-09-30T22:24:12.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.538+0000 7fe9a3d15700 1 -- start start 2023-09-30T22:24:12.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.539+0000 7fe9a3d15700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe99c133ad0 0x7fe99c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:12.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.539+0000 7fe9a3d15700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe99c1300a0 0x7fe99c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:12.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.539+0000 7fe9a3d15700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe99c1309f0 0x7fe99c13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:12.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.539+0000 7fe9a3d15700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe99c06b2d0 con 0x7fe99c1309f0 2023-09-30T22:24:12.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.539+0000 7fe9a3d15700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c133610 con 0x7fe99c133ad0 2023-09-30T22:24:12.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.539+0000 7fe9a3d15700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c09a500 con 0x7fe99c1300a0 2023-09-30T22:24:12.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.539+0000 7fe9a1ab1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe99c133ad0 0x7fe99c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:12.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.539+0000 7fe9a12b0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe99c1300a0 0x7fe99c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:12.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.539+0000 7fe9a22b2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe99c1309f0 0x7fe99c13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:12.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.539+0000 7fe9a12b0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe99c1300a0 0x7fe99c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52392/0 (socket says 172.21.15.156:52392) 2023-09-30T22:24:12.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.539+0000 7fe9a1ab1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe99c133ad0 0x7fe99c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53446/0 (socket says 172.21.15.156:53446) 2023-09-30T22:24:12.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.539+0000 7fe9a12b0700 1 -- 172.21.15.156:0/3744029574 learned_addr learned my addr 172.21.15.156:0/3744029574 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:12.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.539+0000 7fe9a22b2700 1 -- 172.21.15.156:0/3744029574 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe99c1300a0 msgr2=0x7fe99c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:12.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.539+0000 7fe9a22b2700 1 --2- 172.21.15.156:0/3744029574 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe99c1300a0 0x7fe99c1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.539+0000 7fe9a22b2700 1 -- 172.21.15.156:0/3744029574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe99c133ad0 msgr2=0x7fe99c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:12.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.539+0000 7fe9a22b2700 1 --2- 172.21.15.156:0/3744029574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe99c133ad0 0x7fe99c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.539+0000 7fe9a22b2700 1 -- 172.21.15.156:0/3744029574 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99c1338b0 con 0x7fe99c1309f0 2023-09-30T22:24:12.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.539+0000 7fe9a1ab1700 1 --2- 172.21.15.156:0/3744029574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe99c133ad0 0x7fe99c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:12.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.539+0000 7fe9a12b0700 1 --2- 172.21.15.156:0/3744029574 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe99c1300a0 0x7fe99c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:12.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.539+0000 7fe9a22b2700 1 --2- 172.21.15.156:0/3744029574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe99c1309f0 0x7fe99c13a980 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fe994009d90 tx=0x7fe99400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d3887ecc0087f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:12.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.540+0000 7fe9a0aaf700 1 -- 172.21.15.156:0/3744029574 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99400e070 con 0x7fe99c1309f0 2023-09-30T22:24:12.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.540+0000 7fe9a0aaf700 1 -- 172.21.15.156:0/3744029574 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99400bb20 con 0x7fe99c1309f0 2023-09-30T22:24:12.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.540+0000 7fe9a0aaf700 1 -- 172.21.15.156:0/3744029574 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe994012430 con 0x7fe99c1309f0 2023-09-30T22:24:12.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.541+0000 7fe9a3d15700 1 -- 172.21.15.156:0/3744029574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe99c1309f0 msgr2=0x7fe99c13a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:12.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.541+0000 7fe9a3d15700 1 --2- 172.21.15.156:0/3744029574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe99c1309f0 0x7fe99c13a980 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fe994009d90 tx=0x7fe99400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:12.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.541+0000 7fe9a3d15700 1 -- 172.21.15.156:0/3744029574 shutdown_connections 2023-09-30T22:24:12.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.541+0000 7fe9a3d15700 1 --2- 172.21.15.156:0/3744029574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe99c1309f0 0x7fe99c13a980 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.541+0000 7fe9a3d15700 1 --2- 172.21.15.156:0/3744029574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe99c133ad0 0x7fe99c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.541+0000 7fe9a3d15700 1 --2- 172.21.15.156:0/3744029574 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe99c1300a0 0x7fe99c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.541+0000 7fe9a3d15700 1 -- 172.21.15.156:0/3744029574 >> 172.21.15.156:0/3744029574 conn(0x7fe99c099c40 msgr2=0x7fe99c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:12.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.542+0000 7fe9a3d15700 1 -- 172.21.15.156:0/3744029574 shutdown_connections 2023-09-30T22:24:12.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.542+0000 7fe9a3d15700 1 -- 172.21.15.156:0/3744029574 wait complete. 2023-09-30T22:24:12.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.543+0000 7fe9a3d15700 1 Processor -- start 2023-09-30T22:24:12.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.543+0000 7fe9a3d15700 1 -- start start 2023-09-30T22:24:12.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.543+0000 7fe9a3d15700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe99c1300a0 0x7fe99c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:12.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.543+0000 7fe9a3d15700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe99c1309f0 0x7fe99c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:12.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.543+0000 7fe9a3d15700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe99c133ad0 0x7fe99c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:12.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.543+0000 7fe9a3d15700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c120050 con 0x7fe99c1300a0 2023-09-30T22:24:12.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.543+0000 7fe9a3d15700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c12d990 con 0x7fe99c133ad0 2023-09-30T22:24:12.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.543+0000 7fe9a3d15700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c11f060 con 0x7fe99c1309f0 2023-09-30T22:24:12.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.543+0000 7fe9a1ab1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe99c1300a0 0x7fe99c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:12.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.544+0000 7fe9a12b0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe99c1309f0 0x7fe99c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:12.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.544+0000 7fe9a22b2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe99c133ad0 0x7fe99c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:12.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.544+0000 7fe9a1ab1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe99c1300a0 0x7fe99c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60456/0 (socket says 172.21.15.156:60456) 2023-09-30T22:24:12.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.544+0000 7fe9a1ab1700 1 -- 172.21.15.156:0/1904872135 learned_addr learned my addr 172.21.15.156:0/1904872135 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:12.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.544+0000 7fe9a1ab1700 1 -- 172.21.15.156:0/1904872135 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe99c1309f0 msgr2=0x7fe99c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:12.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.544+0000 7fe9a1ab1700 1 --2- 172.21.15.156:0/1904872135 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe99c1309f0 0x7fe99c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.544+0000 7fe9a1ab1700 1 -- 172.21.15.156:0/1904872135 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe99c133ad0 msgr2=0x7fe99c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:12.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.544+0000 7fe9a1ab1700 1 --2- 172.21.15.156:0/1904872135 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe99c133ad0 0x7fe99c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.544+0000 7fe9a1ab1700 1 -- 172.21.15.156:0/1904872135 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe998009550 con 0x7fe99c1300a0 2023-09-30T22:24:12.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.544+0000 7fe9a12b0700 1 --2- 172.21.15.156:0/1904872135 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe99c1309f0 0x7fe99c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:12.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.544+0000 7fe9a1ab1700 1 --2- 172.21.15.156:0/1904872135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe99c1300a0 0x7fe99c11da40 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fe98c00ec10 tx=0x7fe98c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:12.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.544+0000 7fe9927fc700 1 -- 172.21.15.156:0/1904872135 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c00c850 con 0x7fe99c1300a0 2023-09-30T22:24:12.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.544+0000 7fe9927fc700 1 -- 172.21.15.156:0/1904872135 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98c00c9b0 con 0x7fe99c1300a0 2023-09-30T22:24:12.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.544+0000 7fe9a3d15700 1 -- 172.21.15.156:0/1904872135 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe98c0094a0 con 0x7fe99c1300a0 2023-09-30T22:24:12.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.544+0000 7fe9927fc700 1 -- 172.21.15.156:0/1904872135 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c00cd20 con 0x7fe99c1300a0 2023-09-30T22:24:12.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.544+0000 7fe9a3d15700 1 -- 172.21.15.156:0/1904872135 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe994009a70 con 0x7fe99c1300a0 2023-09-30T22:24:12.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.545+0000 7fe9927fc700 1 -- 172.21.15.156:0/1904872135 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe98c013470 con 0x7fe99c1300a0 2023-09-30T22:24:12.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.545+0000 7fe9927fc700 1 -- 172.21.15.156:0/1904872135 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe98c03fb10 con 0x7fe99c1300a0 2023-09-30T22:24:12.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.545+0000 7fe9a3d15700 1 -- 172.21.15.156:0/1904872135 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99c11edb0 con 0x7fe99c1300a0 2023-09-30T22:24:12.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.550+0000 7fe9927fc700 1 -- 172.21.15.156:0/1904872135 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe98c013720 con 0x7fe99c1300a0 2023-09-30T22:24:12.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.736+0000 7fe9a3d15700 1 -- 172.21.15.156:0/1904872135 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe99c12dd60 con 0x7fe99c1300a0 2023-09-30T22:24:12.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.736+0000 7fe9927fc700 1 -- 172.21.15.156:0/1904872135 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe98c011b40 con 0x7fe99c1300a0 2023-09-30T22:24:12.738 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:12.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.739+0000 7fe9a3d15700 1 -- 172.21.15.156:0/1904872135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe99c1300a0 msgr2=0x7fe99c11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:12.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.739+0000 7fe9a3d15700 1 --2- 172.21.15.156:0/1904872135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe99c1300a0 0x7fe99c11da40 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fe98c00ec10 tx=0x7fe98c00ef20 comp rx=0 tx=0).stop 2023-09-30T22:24:12.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.739+0000 7fe9a3d15700 1 -- 172.21.15.156:0/1904872135 shutdown_connections 2023-09-30T22:24:12.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.739+0000 7fe9a3d15700 1 --2- 172.21.15.156:0/1904872135 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe99c133ad0 0x7fe99c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.739+0000 7fe9a3d15700 1 --2- 172.21.15.156:0/1904872135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe99c1300a0 0x7fe99c11da40 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.739+0000 7fe9a3d15700 1 --2- 172.21.15.156:0/1904872135 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe99c1309f0 0x7fe99c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.739+0000 7fe9a3d15700 1 -- 172.21.15.156:0/1904872135 >> 172.21.15.156:0/1904872135 conn(0x7fe99c099c40 msgr2=0x7fe99c131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:12.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.739+0000 7fe9a3d15700 1 -- 172.21.15.156:0/1904872135 shutdown_connections 2023-09-30T22:24:12.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:12.739+0000 7fe9a3d15700 1 -- 172.21.15.156:0/1904872135 wait complete. 2023-09-30T22:24:12.751 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:12.907 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:13.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.030+0000 7f8a3274d700 1 Processor -- start 2023-09-30T22:24:13.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.030+0000 7f8a3274d700 1 -- start start 2023-09-30T22:24:13.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.030+0000 7f8a3274d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a2c099e20 0x7f8a2c09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.030+0000 7f8a3274d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a2c09a730 0x7f8a2c130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.030+0000 7f8a3274d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a2c099a60 con 0x7f8a2c130890 2023-09-30T22:24:13.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.030+0000 7f8a3274d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c09bf50 con 0x7f8a2c099e20 2023-09-30T22:24:13.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.030+0000 7f8a3274d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c09b230 con 0x7f8a2c09a730 2023-09-30T22:24:13.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.030+0000 7f8a2b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a2c09a730 0x7f8a2c130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.030+0000 7f8a2bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a2c099e20 0x7f8a2c09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.030+0000 7f8a2bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a2c099e20 0x7f8a2c09a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53454/0 (socket says 172.21.15.156:53454) 2023-09-30T22:24:13.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.030+0000 7f8a30cea700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f8a2c130890 0x7f8a2c137680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49298/0 (socket says 172.21.15.156:49298) 2023-09-30T22:24:13.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.030+0000 7f8a2bfff700 1 -- 172.21.15.156:0/3078645551 learned_addr learned my addr 172.21.15.156:0/3078645551 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:13.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.030+0000 7f8a2b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a2c09a730 0x7f8a2c130350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52412/0 (socket says 172.21.15.156:52412) 2023-09-30T22:24:13.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.031+0000 7f8a2bfff700 1 -- 172.21.15.156:0/3078645551 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a2c09a730 msgr2=0x7f8a2c130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:13.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.031+0000 7f8a2affd700 1 -- 172.21.15.156:0/3078645551 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3285568517 0 0) 0x7f8a2c099a60 con 0x7f8a2c130890 2023-09-30T22:24:13.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.031+0000 7f8a2bfff700 1 --2- 172.21.15.156:0/3078645551 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a2c09a730 0x7f8a2c130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.031+0000 7f8a2bfff700 1 -- 172.21.15.156:0/3078645551 >> v1:172.21.15.156:6789/0 conn(0x7f8a2c130890 legacy=0x7f8a2c137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.031+0000 7f8a2bfff700 1 -- 172.21.15.156:0/3078645551 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2c09bb90 con 0x7f8a2c099e20 2023-09-30T22:24:13.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.031+0000 7f8a2b7fe700 1 --2- 172.21.15.156:0/3078645551 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a2c09a730 0x7f8a2c130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:13.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.031+0000 7f8a2bfff700 1 --2- 172.21.15.156:0/3078645551 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a2c099e20 0x7f8a2c09a1f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0098f0 tx=0x7f8a1c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50d708886787aa7a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:13.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.031+0000 7f8a2affd700 1 -- 172.21.15.156:0/3078645551 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c005e30 con 0x7f8a2c099e20 2023-09-30T22:24:13.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.031+0000 7f8a2affd700 1 -- 172.21.15.156:0/3078645551 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1c004030 con 0x7f8a2c099e20 2023-09-30T22:24:13.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.031+0000 7f8a2affd700 1 -- 172.21.15.156:0/3078645551 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c0043e0 con 0x7f8a2c099e20 2023-09-30T22:24:13.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.031+0000 7f8a3274d700 1 -- 172.21.15.156:0/3078645551 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a2c099e20 msgr2=0x7f8a2c09a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.031+0000 7f8a3274d700 1 --2- 172.21.15.156:0/3078645551 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a2c099e20 0x7f8a2c09a1f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0098f0 tx=0x7f8a1c009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:13.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.032+0000 7f8a3274d700 1 -- 172.21.15.156:0/3078645551 shutdown_connections 2023-09-30T22:24:13.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.032+0000 7f8a3274d700 1 --2- 172.21.15.156:0/3078645551 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a2c099e20 0x7f8a2c09a1f0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.032+0000 7f8a3274d700 1 --2- 172.21.15.156:0/3078645551 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a2c09a730 0x7f8a2c130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.032+0000 7f8a3274d700 1 -- 172.21.15.156:0/3078645551 >> 172.21.15.156:0/3078645551 conn(0x7f8a2c0a2980 msgr2=0x7f8a2c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:13.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.032+0000 7f8a3274d700 1 -- 172.21.15.156:0/3078645551 shutdown_connections 2023-09-30T22:24:13.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.032+0000 7f8a3274d700 1 -- 172.21.15.156:0/3078645551 wait complete. 2023-09-30T22:24:13.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.032+0000 7f8a3274d700 1 Processor -- start 2023-09-30T22:24:13.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.033+0000 7f8a3274d700 1 -- start start 2023-09-30T22:24:13.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.033+0000 7f8a3274d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a2c099e20 0x7f8a2c09d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.033+0000 7f8a3274d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a2c09a730 0x7f8a2c09d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.033+0000 7f8a3274d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a2c130890 0x7f8a2c09dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.033+0000 7f8a3274d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c11ed60 con 0x7f8a2c099e20 2023-09-30T22:24:13.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.033+0000 7f8a3274d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c11e380 con 0x7f8a2c09a730 2023-09-30T22:24:13.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.033+0000 7f8a3274d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c09fac0 con 0x7f8a2c130890 2023-09-30T22:24:13.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.033+0000 7f8a2b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a2c09a730 0x7f8a2c09d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.033+0000 7f8a30cea700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a2c130890 0x7f8a2c09dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.033+0000 7f8a2bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a2c099e20 0x7f8a2c09d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.033+0000 7f8a2b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a2c09a730 0x7f8a2c09d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53460/0 (socket says 172.21.15.156:53460) 2023-09-30T22:24:13.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.033+0000 7f8a2b7fe700 1 -- 172.21.15.156:0/2388004076 learned_addr learned my addr 172.21.15.156:0/2388004076 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:13.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.033+0000 7f8a2bfff700 1 -- 172.21.15.156:0/2388004076 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a2c130890 msgr2=0x7f8a2c09dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.033+0000 7f8a2bfff700 1 --2- 172.21.15.156:0/2388004076 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a2c130890 0x7f8a2c09dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.033+0000 7f8a2bfff700 1 -- 172.21.15.156:0/2388004076 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a2c09a730 msgr2=0x7f8a2c09d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.033+0000 7f8a2bfff700 1 --2- 172.21.15.156:0/2388004076 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a2c09a730 0x7f8a2c09d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.033+0000 7f8a2bfff700 1 -- 172.21.15.156:0/2388004076 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a200094a0 con 0x7f8a2c099e20 2023-09-30T22:24:13.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.033+0000 7f8a30cea700 1 --2- 172.21.15.156:0/2388004076 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a2c130890 0x7f8a2c09dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:13.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.034+0000 7f8a2bfff700 1 --2- 172.21.15.156:0/2388004076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a2c099e20 0x7f8a2c09d1c0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c013000 tx=0x7f8a1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:13.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.034+0000 7f8a28ff9700 1 -- 172.21.15.156:0/2388004076 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c0045e0 con 0x7f8a2c099e20 2023-09-30T22:24:13.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.034+0000 7f8a28ff9700 1 -- 172.21.15.156:0/2388004076 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1c01c420 con 0x7f8a2c099e20 2023-09-30T22:24:13.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.034+0000 7f8a3274d700 1 -- 172.21.15.156:0/2388004076 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a1c009500 con 0x7f8a2c099e20 2023-09-30T22:24:13.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.034+0000 7f8a28ff9700 1 -- 172.21.15.156:0/2388004076 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c01c7d0 con 0x7f8a2c099e20 2023-09-30T22:24:13.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.034+0000 7f8a3274d700 1 -- 172.21.15.156:0/2388004076 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2c11dde0 con 0x7f8a2c099e20 2023-09-30T22:24:13.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.034+0000 7f8a28ff9700 1 -- 172.21.15.156:0/2388004076 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8a1c01c930 con 0x7f8a2c099e20 2023-09-30T22:24:13.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.035+0000 7f8a28ff9700 1 -- 172.21.15.156:0/2388004076 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8a1c040680 con 0x7f8a2c099e20 2023-09-30T22:24:13.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.035+0000 7f8a3274d700 1 -- 172.21.15.156:0/2388004076 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a2c11dfd0 con 0x7f8a2c099e20 2023-09-30T22:24:13.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.039+0000 7f8a28ff9700 1 -- 172.21.15.156:0/2388004076 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a1c02a020 con 0x7f8a2c099e20 2023-09-30T22:24:13.043 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:13.080 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:13.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.171+0000 7fd3ed4d9700 1 Processor -- start 2023-09-30T22:24:13.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.171+0000 7fd3ed4d9700 1 -- start start 2023-09-30T22:24:13.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.171+0000 7fd3ed4d9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3e8133ad0 0x7fd3e8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.171+0000 7fd3ed4d9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd3e8130bc0 0x7fd3e813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.171+0000 7fd3ed4d9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3e806b2d0 con 0x7fd3e81300a0 2023-09-30T22:24:13.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.171+0000 7fd3ed4d9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e8133610 con 0x7fd3e8130bc0 2023-09-30T22:24:13.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.171+0000 7fd3ed4d9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e809a500 con 0x7fd3e8133ad0 2023-09-30T22:24:13.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.171+0000 7fd3e6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3e8133ad0 0x7fd3e8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.171+0000 7fd3e77fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd3e8130bc0 0x7fd3e813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.171+0000 7fd3e6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3e8133ad0 0x7fd3e8133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53472/0 (socket says 172.21.15.156:53472) 2023-09-30T22:24:13.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.171+0000 7fd3e67fc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fd3e81300a0 0x7fd3e81304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49300/0 (socket says 172.21.15.156:49300) 2023-09-30T22:24:13.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.171+0000 7fd3e6ffd700 1 -- 172.21.15.156:0/684283713 learned_addr learned my addr 172.21.15.156:0/684283713 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:13.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.172+0000 7fd3e77fe700 1 -- 172.21.15.156:0/684283713 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3e8133ad0 msgr2=0x7fd3e8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:13.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.172+0000 7fd3e77fe700 1 --2- 172.21.15.156:0/684283713 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3e8133ad0 0x7fd3e8133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.172+0000 7fd3e77fe700 1 -- 172.21.15.156:0/684283713 >> v1:172.21.15.156:6789/0 conn(0x7fd3e81300a0 legacy=0x7fd3e81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.172+0000 7fd3e77fe700 1 -- 172.21.15.156:0/684283713 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e81338b0 con 0x7fd3e8130bc0 2023-09-30T22:24:13.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.172+0000 7fd3e5ffb700 1 -- 172.21.15.156:0/684283713 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2585284456 0 0) 0x7fd3e806b2d0 con 0x7fd3e81300a0 2023-09-30T22:24:13.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.172+0000 7fd3e77fe700 1 --2- 172.21.15.156:0/684283713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3e8130bc0 0x7fd3e813b990 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0009d90 tx=0x7fd3e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dcf3b16a9254079 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:13.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.172+0000 7fd3e5ffb700 1 -- 172.21.15.156:0/684283713 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e000e070 con 0x7fd3e8130bc0 2023-09-30T22:24:13.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.172+0000 7fd3e5ffb700 1 -- 172.21.15.156:0/684283713 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e000bb20 con 0x7fd3e8130bc0 2023-09-30T22:24:13.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.172+0000 7fd3e5ffb700 1 -- 172.21.15.156:0/684283713 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e0012430 con 0x7fd3e8130bc0 2023-09-30T22:24:13.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.173+0000 7fd3ed4d9700 1 -- 172.21.15.156:0/684283713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3e8130bc0 msgr2=0x7fd3e813b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.173+0000 7fd3ed4d9700 1 --2- 172.21.15.156:0/684283713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3e8130bc0 0x7fd3e813b990 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0009d90 tx=0x7fd3e000b330 comp rx=0 tx=0).stop 2023-09-30T22:24:13.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.173+0000 7fd3ed4d9700 1 -- 172.21.15.156:0/684283713 shutdown_connections 2023-09-30T22:24:13.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.173+0000 7fd3ed4d9700 1 --2- 172.21.15.156:0/684283713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3e8130bc0 0x7fd3e813b990 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.173+0000 7fd3ed4d9700 1 --2- 172.21.15.156:0/684283713 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3e8133ad0 0x7fd3e8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.173+0000 7fd3ed4d9700 1 -- 172.21.15.156:0/684283713 >> 172.21.15.156:0/684283713 conn(0x7fd3e8099c40 msgr2=0x7fd3e80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:13.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.173+0000 7fd3ed4d9700 1 -- 172.21.15.156:0/684283713 shutdown_connections 2023-09-30T22:24:13.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.173+0000 7fd3ed4d9700 1 -- 172.21.15.156:0/684283713 wait complete. 2023-09-30T22:24:13.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.174+0000 7fd3ed4d9700 1 Processor -- start 2023-09-30T22:24:13.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.174+0000 7fd3ed4d9700 1 -- start start 2023-09-30T22:24:13.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.174+0000 7fd3ed4d9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3e81300a0 0x7fd3e811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.174+0000 7fd3ed4d9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3e8130bc0 0x7fd3e811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.174+0000 7fd3ed4d9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3e8133ad0 0x7fd3e811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.174+0000 7fd3ed4d9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e811f8e0 con 0x7fd3e8130bc0 2023-09-30T22:24:13.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.174+0000 7fd3ed4d9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e80a3420 con 0x7fd3e8133ad0 2023-09-30T22:24:13.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.174+0000 7fd3ed4d9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e812dd00 con 0x7fd3e81300a0 2023-09-30T22:24:13.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.174+0000 7fd3e67fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3e8130bc0 0x7fd3e811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.174+0000 7fd3e67fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3e8130bc0 0x7fd3e811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60480/0 (socket says 172.21.15.156:60480) 2023-09-30T22:24:13.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.174+0000 7fd3e67fc700 1 -- 172.21.15.156:0/4033243649 learned_addr learned my addr 172.21.15.156:0/4033243649 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:13.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.174+0000 7fd3e6ffd700 1 --2- 172.21.15.156:0/4033243649 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3e81300a0 0x7fd3e811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.174+0000 7fd3e77fe700 1 --2- 172.21.15.156:0/4033243649 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3e8133ad0 0x7fd3e811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.175+0000 7fd3e67fc700 1 -- 172.21.15.156:0/4033243649 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3e81300a0 msgr2=0x7fd3e811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.175+0000 7fd3e67fc700 1 --2- 172.21.15.156:0/4033243649 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3e81300a0 0x7fd3e811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.175+0000 7fd3e67fc700 1 -- 172.21.15.156:0/4033243649 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3e8133ad0 msgr2=0x7fd3e811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.175+0000 7fd3e67fc700 1 --2- 172.21.15.156:0/4033243649 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3e8133ad0 0x7fd3e811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.175+0000 7fd3e67fc700 1 -- 172.21.15.156:0/4033243649 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e0009a70 con 0x7fd3e8130bc0 2023-09-30T22:24:13.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.175+0000 7fd3e6ffd700 1 --2- 172.21.15.156:0/4033243649 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3e81300a0 0x7fd3e811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:13.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.175+0000 7fd3e67fc700 1 --2- 172.21.15.156:0/4033243649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3e8130bc0 0x7fd3e811df80 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc00c450 tx=0x7fd3dc00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:13.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.175+0000 7fd3cf7fe700 1 -- 172.21.15.156:0/4033243649 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc004c80 con 0x7fd3e8130bc0 2023-09-30T22:24:13.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.175+0000 7fd3cf7fe700 1 -- 172.21.15.156:0/4033243649 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3dc004e00 con 0x7fd3e8130bc0 2023-09-30T22:24:13.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.175+0000 7fd3ed4d9700 1 -- 172.21.15.156:0/4033243649 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e811f060 con 0x7fd3e8130bc0 2023-09-30T22:24:13.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.175+0000 7fd3cf7fe700 1 -- 172.21.15.156:0/4033243649 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc007310 con 0x7fd3e8130bc0 2023-09-30T22:24:13.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.175+0000 7fd3ed4d9700 1 -- 172.21.15.156:0/4033243649 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e811fe70 con 0x7fd3e8130bc0 2023-09-30T22:24:13.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.176+0000 7fd3cf7fe700 1 -- 172.21.15.156:0/4033243649 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd3dc007470 con 0x7fd3e8130bc0 2023-09-30T22:24:13.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.176+0000 7fd3cf7fe700 1 -- 172.21.15.156:0/4033243649 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd3dc03f270 con 0x7fd3e8130bc0 2023-09-30T22:24:13.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.176+0000 7fd3ed4d9700 1 -- 172.21.15.156:0/4033243649 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e806b2d0 con 0x7fd3e8130bc0 2023-09-30T22:24:13.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.181+0000 7fd3cf7fe700 1 -- 172.21.15.156:0/4033243649 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd3dc00ce60 con 0x7fd3e8130bc0 2023-09-30T22:24:13.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.213+0000 7fea8405c700 1 Processor -- start 2023-09-30T22:24:13.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.214+0000 7fea8405c700 1 -- start start 2023-09-30T22:24:13.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.214+0000 7fea8405c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea7c0a1550 0x7fea7c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.214+0000 7fea8405c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea7c139200 0x7fea7c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.214+0000 7fea8405c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea7c09e9d0 con 0x7fea7c0a0a70 2023-09-30T22:24:13.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.214+0000 7fea8405c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c09dc00 con 0x7fea7c0a1550 2023-09-30T22:24:13.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.214+0000 7fea8405c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c09dec0 con 0x7fea7c139200 2023-09-30T22:24:13.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.214+0000 7fea815f7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea7c0a1550 0x7fea7c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.215+0000 7fea815f7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea7c0a1550 0x7fea7c138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53494/0 (socket says 172.21.15.156:53494) 2023-09-30T22:24:13.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.215+0000 7fea81df8700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fea7c0a0a70 0x7fea7c0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49302/0 (socket says 172.21.15.156:49302) 2023-09-30T22:24:13.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.215+0000 7fea815f7700 1 -- 172.21.15.156:0/4237835676 learned_addr learned my addr 172.21.15.156:0/4237835676 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:13.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.215+0000 7fea825f9700 1 --2- 172.21.15.156:0/4237835676 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea7c139200 0x7fea7c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.215+0000 7fea825f9700 1 -- 172.21.15.156:0/4237835676 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea7c0a1550 msgr2=0x7fea7c138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:13.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.215+0000 7fea825f9700 1 --2- 172.21.15.156:0/4237835676 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea7c0a1550 0x7fea7c138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.215+0000 7fea825f9700 1 -- 172.21.15.156:0/4237835676 >> v1:172.21.15.156:6789/0 conn(0x7fea7c0a0a70 legacy=0x7fea7c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.215+0000 7fea825f9700 1 -- 172.21.15.156:0/4237835676 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea7c09e6a0 con 0x7fea7c139200 2023-09-30T22:24:13.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.215+0000 7fea815f7700 1 --2- 172.21.15.156:0/4237835676 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea7c0a1550 0x7fea7c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:13.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.215+0000 7fea825f9700 1 --2- 172.21.15.156:0/4237835676 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea7c139200 0x7fea7c13b5e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fea74009dc0 tx=0x7fea7400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ef1bfac86f8c9f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:13.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.215+0000 7fea80df6700 1 -- 172.21.15.156:0/4237835676 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7400e070 con 0x7fea7c139200 2023-09-30T22:24:13.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.215+0000 7fea80df6700 1 -- 172.21.15.156:0/4237835676 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea74003a20 con 0x7fea7c139200 2023-09-30T22:24:13.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.215+0000 7fea80df6700 1 -- 172.21.15.156:0/4237835676 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea74003dd0 con 0x7fea7c139200 2023-09-30T22:24:13.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.216+0000 7fea8405c700 1 -- 172.21.15.156:0/4237835676 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea7c139200 msgr2=0x7fea7c13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.216+0000 7fea8405c700 1 --2- 172.21.15.156:0/4237835676 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea7c139200 0x7fea7c13b5e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fea74009dc0 tx=0x7fea7400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:13.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.216+0000 7fea8405c700 1 -- 172.21.15.156:0/4237835676 shutdown_connections 2023-09-30T22:24:13.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.216+0000 7fea8405c700 1 --2- 172.21.15.156:0/4237835676 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea7c139200 0x7fea7c13b5e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.216+0000 7fea8405c700 1 --2- 172.21.15.156:0/4237835676 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea7c0a1550 0x7fea7c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.216+0000 7fea8405c700 1 -- 172.21.15.156:0/4237835676 >> 172.21.15.156:0/4237835676 conn(0x7fea7c0a6610 msgr2=0x7fea7c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:13.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.216+0000 7fea8405c700 1 -- 172.21.15.156:0/4237835676 shutdown_connections 2023-09-30T22:24:13.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.216+0000 7fea8405c700 1 -- 172.21.15.156:0/4237835676 wait complete. 2023-09-30T22:24:13.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.217+0000 7fea8405c700 1 Processor -- start 2023-09-30T22:24:13.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.217+0000 7fea8405c700 1 -- start start 2023-09-30T22:24:13.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.217+0000 7fea8405c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea7c0a0a70 0x7fea7c11e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.217+0000 7fea8405c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea7c0a1550 0x7fea7c11edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.217+0000 7fea8405c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea7c139200 0x7fea7c11f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.217+0000 7fea8405c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c120d20 con 0x7fea7c0a1550 2023-09-30T22:24:13.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.217+0000 7fea8405c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c122360 con 0x7fea7c139200 2023-09-30T22:24:13.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.217+0000 7fea8405c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c0a5290 con 0x7fea7c0a0a70 2023-09-30T22:24:13.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.217+0000 7fea81df8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea7c0a0a70 0x7fea7c11e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.218+0000 7fea81df8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea7c0a0a70 0x7fea7c11e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52424/0 (socket says 172.21.15.156:52424) 2023-09-30T22:24:13.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.218+0000 7fea81df8700 1 -- 172.21.15.156:0/181138505 learned_addr learned my addr 172.21.15.156:0/181138505 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:13.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.218+0000 7fea815f7700 1 --2- 172.21.15.156:0/181138505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea7c0a1550 0x7fea7c11edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.218+0000 7fea825f9700 1 --2- 172.21.15.156:0/181138505 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea7c139200 0x7fea7c11f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.218+0000 7fea81df8700 1 -- 172.21.15.156:0/181138505 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea7c139200 msgr2=0x7fea7c11f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.218+0000 7fea81df8700 1 --2- 172.21.15.156:0/181138505 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea7c139200 0x7fea7c11f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.218+0000 7fea81df8700 1 -- 172.21.15.156:0/181138505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea7c0a1550 msgr2=0x7fea7c11edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.218+0000 7fea81df8700 1 --2- 172.21.15.156:0/181138505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea7c0a1550 0x7fea7c11edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.218+0000 7fea81df8700 1 -- 172.21.15.156:0/181138505 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6c009550 con 0x7fea7c0a0a70 2023-09-30T22:24:13.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.218+0000 7fea825f9700 1 --2- 172.21.15.156:0/181138505 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea7c139200 0x7fea7c11f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:13.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.218+0000 7fea81df8700 1 --2- 172.21.15.156:0/181138505 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea7c0a0a70 0x7fea7c11e890 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fea7800c7b0 tx=0x7fea7800cac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:13.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.218+0000 7fea727fc700 1 -- 172.21.15.156:0/181138505 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea78004c80 con 0x7fea7c0a0a70 2023-09-30T22:24:13.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.218+0000 7fea727fc700 1 -- 172.21.15.156:0/181138505 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea78004de0 con 0x7fea7c0a0a70 2023-09-30T22:24:13.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.218+0000 7fea727fc700 1 -- 172.21.15.156:0/181138505 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea78007310 con 0x7fea7c0a0a70 2023-09-30T22:24:13.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.218+0000 7fea8405c700 1 -- 172.21.15.156:0/181138505 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea74009a70 con 0x7fea7c0a0a70 2023-09-30T22:24:13.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.218+0000 7fea8405c700 1 -- 172.21.15.156:0/181138505 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea7c0a0430 con 0x7fea7c0a0a70 2023-09-30T22:24:13.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.219+0000 7fea8405c700 1 -- 172.21.15.156:0/181138505 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea7c04f2a0 con 0x7fea7c0a0a70 2023-09-30T22:24:13.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.219+0000 7fea727fc700 1 -- 172.21.15.156:0/181138505 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fea78007470 con 0x7fea7c0a0a70 2023-09-30T22:24:13.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.220+0000 7fea727fc700 1 -- 172.21.15.156:0/181138505 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fea7803e9d0 con 0x7fea7c0a0a70 2023-09-30T22:24:13.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.224+0000 7fea727fc700 1 -- 172.21.15.156:0/181138505 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea78007720 con 0x7fea7c0a0a70 2023-09-30T22:24:13.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.244+0000 7f8a3274d700 1 -- 172.21.15.156:0/2388004076 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8a2c04f2a0 con 0x7f8a2c099e20 2023-09-30T22:24:13.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.244+0000 7f8a28ff9700 1 -- 172.21.15.156:0/2388004076 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8a1c016070 con 0x7f8a2c099e20 2023-09-30T22:24:13.245 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:13.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.246+0000 7f8a3274d700 1 -- 172.21.15.156:0/2388004076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a2c099e20 msgr2=0x7f8a2c09d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.246+0000 7f8a3274d700 1 --2- 172.21.15.156:0/2388004076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a2c099e20 0x7f8a2c09d1c0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c013000 tx=0x7f8a1c004750 comp rx=0 tx=0).stop 2023-09-30T22:24:13.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.246+0000 7f8a3274d700 1 -- 172.21.15.156:0/2388004076 shutdown_connections 2023-09-30T22:24:13.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.246+0000 7f8a3274d700 1 --2- 172.21.15.156:0/2388004076 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a2c130890 0x7f8a2c09dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.246+0000 7f8a3274d700 1 --2- 172.21.15.156:0/2388004076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a2c099e20 0x7f8a2c09d1c0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.246+0000 7f8a3274d700 1 --2- 172.21.15.156:0/2388004076 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a2c09a730 0x7f8a2c09d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.246+0000 7f8a3274d700 1 -- 172.21.15.156:0/2388004076 >> 172.21.15.156:0/2388004076 conn(0x7f8a2c0a2980 msgr2=0x7f8a2c12d670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:13.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.247+0000 7f8a3274d700 1 -- 172.21.15.156:0/2388004076 shutdown_connections 2023-09-30T22:24:13.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.247+0000 7f8a3274d700 1 -- 172.21.15.156:0/2388004076 wait complete. 2023-09-30T22:24:13.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:13.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.371+0000 7fd3ed4d9700 1 -- 172.21.15.156:0/4033243649 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd3e804f2a0 con 0x7fd3e8130bc0 2023-09-30T22:24:13.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.371+0000 7fd3cf7fe700 1 -- 172.21.15.156:0/4033243649 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd3dc007720 con 0x7fd3e8130bc0 2023-09-30T22:24:13.372 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:13.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.374+0000 7fd3ed4d9700 1 -- 172.21.15.156:0/4033243649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3e8130bc0 msgr2=0x7fd3e811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.374+0000 7fd3ed4d9700 1 --2- 172.21.15.156:0/4033243649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3e8130bc0 0x7fd3e811df80 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc00c450 tx=0x7fd3dc00c760 comp rx=0 tx=0).stop 2023-09-30T22:24:13.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.374+0000 7fd3ed4d9700 1 -- 172.21.15.156:0/4033243649 shutdown_connections 2023-09-30T22:24:13.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.374+0000 7fd3ed4d9700 1 --2- 172.21.15.156:0/4033243649 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd3e8133ad0 0x7fd3e811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.374+0000 7fd3ed4d9700 1 --2- 172.21.15.156:0/4033243649 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd3e81300a0 0x7fd3e811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.374+0000 7fd3ed4d9700 1 --2- 172.21.15.156:0/4033243649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3e8130bc0 0x7fd3e811df80 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.374+0000 7fd3ed4d9700 1 -- 172.21.15.156:0/4033243649 >> 172.21.15.156:0/4033243649 conn(0x7fd3e8099c40 msgr2=0x7fd3e8131f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:13.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.374+0000 7fd3ed4d9700 1 -- 172.21.15.156:0/4033243649 shutdown_connections 2023-09-30T22:24:13.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.374+0000 7fd3ed4d9700 1 -- 172.21.15.156:0/4033243649 wait complete. 2023-09-30T22:24:13.387 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:13.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.415+0000 7fea8405c700 1 -- 172.21.15.156:0/181138505 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fea7c121af0 con 0x7fea7c0a0a70 2023-09-30T22:24:13.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.415+0000 7fea727fc700 1 -- 172.21.15.156:0/181138505 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea78018030 con 0x7fea7c0a0a70 2023-09-30T22:24:13.416 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:13.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.417+0000 7fea8405c700 1 -- 172.21.15.156:0/181138505 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea7c0a0a70 msgr2=0x7fea7c11e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.417+0000 7fea8405c700 1 --2- 172.21.15.156:0/181138505 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea7c0a0a70 0x7fea7c11e890 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fea7800c7b0 tx=0x7fea7800cac0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.417+0000 7fea8405c700 1 -- 172.21.15.156:0/181138505 shutdown_connections 2023-09-30T22:24:13.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.417+0000 7fea8405c700 1 --2- 172.21.15.156:0/181138505 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fea7c139200 0x7fea7c11f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.417+0000 7fea8405c700 1 --2- 172.21.15.156:0/181138505 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fea7c0a0a70 0x7fea7c11e890 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.417+0000 7fea8405c700 1 --2- 172.21.15.156:0/181138505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea7c0a1550 0x7fea7c11edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.417+0000 7fea8405c700 1 -- 172.21.15.156:0/181138505 >> 172.21.15.156:0/181138505 conn(0x7fea7c0a6610 msgr2=0x7fea7c09a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:13.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.417+0000 7fea8405c700 1 -- 172.21.15.156:0/181138505 shutdown_connections 2023-09-30T22:24:13.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.417+0000 7fea8405c700 1 -- 172.21.15.156:0/181138505 wait complete. 2023-09-30T22:24:13.429 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:13.752 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:13.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.878+0000 7fbec3ce9700 1 Processor -- start 2023-09-30T22:24:13.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.878+0000 7fbec3ce9700 1 -- start start 2023-09-30T22:24:13.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.878+0000 7fbec3ce9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbebc09f350 0x7fbebc136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.878+0000 7fbec3ce9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbebc1371c0 0x7fbebc1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.878+0000 7fbec3ce9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbebc09c970 con 0x7fbebc09e870 2023-09-30T22:24:13.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.878+0000 7fbec3ce9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbebc0a0920 con 0x7fbebc1371c0 2023-09-30T22:24:13.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.878+0000 7fbec3ce9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc09f9c0 con 0x7fbebc09f350 2023-09-30T22:24:13.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.878+0000 7fbec1284700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbebc09f350 0x7fbebc136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.878+0000 7fbec2286700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbebc1371c0 0x7fbebc1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.878+0000 7fbec1a85700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fbebc09e870 0x7fbebc09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49316/0 (socket says 172.21.15.156:49316) 2023-09-30T22:24:13.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.878+0000 7fbec1284700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbebc09f350 0x7fbebc136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52428/0 (socket says 172.21.15.156:52428) 2023-09-30T22:24:13.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.878+0000 7fbec2286700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbebc1371c0 0x7fbebc1395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60486/0 (socket says 172.21.15.156:60486) 2023-09-30T22:24:13.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.878+0000 7fbec1a85700 1 -- 172.21.15.156:0/3628239116 learned_addr learned my addr 172.21.15.156:0/3628239116 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:13.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.879+0000 7fbec2286700 1 -- 172.21.15.156:0/3628239116 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbebc09f350 msgr2=0x7fbebc136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:13.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.879+0000 7fbec2286700 1 --2- 172.21.15.156:0/3628239116 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbebc09f350 0x7fbebc136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.879+0000 7fbec2286700 1 -- 172.21.15.156:0/3628239116 >> v1:172.21.15.156:6789/0 conn(0x7fbebc09e870 legacy=0x7fbebc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.879+0000 7fbec0a83700 1 -- 172.21.15.156:0/3628239116 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4054649127 0 0) 0x7fbebc09c970 con 0x7fbebc09e870 2023-09-30T22:24:13.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.879+0000 7fbec2286700 1 -- 172.21.15.156:0/3628239116 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbebc09bab0 con 0x7fbebc1371c0 2023-09-30T22:24:13.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.879+0000 7fbec1284700 1 --2- 172.21.15.156:0/3628239116 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbebc09f350 0x7fbebc136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:13.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.879+0000 7fbec2286700 1 --2- 172.21.15.156:0/3628239116 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbebc1371c0 0x7fbebc1395a0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4009d90 tx=0x7fbeb400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86b6f18a8ea6087 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:13.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.879+0000 7fbec0a83700 1 -- 172.21.15.156:0/3628239116 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb400e070 con 0x7fbebc1371c0 2023-09-30T22:24:13.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.879+0000 7fbec0a83700 1 -- 172.21.15.156:0/3628239116 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb400bb20 con 0x7fbebc1371c0 2023-09-30T22:24:13.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.879+0000 7fbec0a83700 1 -- 172.21.15.156:0/3628239116 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb4012430 con 0x7fbebc1371c0 2023-09-30T22:24:13.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.880+0000 7fbec3ce9700 1 -- 172.21.15.156:0/3628239116 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbebc1371c0 msgr2=0x7fbebc1395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.880+0000 7fbec3ce9700 1 --2- 172.21.15.156:0/3628239116 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbebc1371c0 0x7fbebc1395a0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4009d90 tx=0x7fbeb400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:13.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.880+0000 7fbec3ce9700 1 -- 172.21.15.156:0/3628239116 shutdown_connections 2023-09-30T22:24:13.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.880+0000 7fbec3ce9700 1 --2- 172.21.15.156:0/3628239116 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbebc1371c0 0x7fbebc1395a0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.880+0000 7fbec3ce9700 1 --2- 172.21.15.156:0/3628239116 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbebc09f350 0x7fbebc136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.880+0000 7fbec3ce9700 1 -- 172.21.15.156:0/3628239116 >> 172.21.15.156:0/3628239116 conn(0x7fbebc0a4430 msgr2=0x7fbebc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:13.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.880+0000 7fbec3ce9700 1 -- 172.21.15.156:0/3628239116 shutdown_connections 2023-09-30T22:24:13.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.880+0000 7fbec3ce9700 1 -- 172.21.15.156:0/3628239116 wait complete. 2023-09-30T22:24:13.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.881+0000 7fbec3ce9700 1 Processor -- start 2023-09-30T22:24:13.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.881+0000 7fbec3ce9700 1 -- start start 2023-09-30T22:24:13.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.881+0000 7fbec3ce9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbebc09e870 0x7fbebc120760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.881+0000 7fbec3ce9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbebc09f350 0x7fbebc120ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.881+0000 7fbec3ce9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbebc1371c0 0x7fbebc1211e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.881+0000 7fbec3ce9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc124400 con 0x7fbebc1371c0 2023-09-30T22:24:13.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.881+0000 7fbec3ce9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc122370 con 0x7fbebc09e870 2023-09-30T22:24:13.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.881+0000 7fbec3ce9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc122990 con 0x7fbebc09f350 2023-09-30T22:24:13.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.881+0000 7fbec1284700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbebc09f350 0x7fbebc120ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.881+0000 7fbec1284700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbebc09f350 0x7fbebc120ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52430/0 (socket says 172.21.15.156:52430) 2023-09-30T22:24:13.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.881+0000 7fbec1a85700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbebc09e870 0x7fbebc120760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.881+0000 7fbec1284700 1 -- 172.21.15.156:0/4249841298 learned_addr learned my addr 172.21.15.156:0/4249841298 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:13.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.881+0000 7fbec2286700 1 --2- 172.21.15.156:0/4249841298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbebc1371c0 0x7fbebc1211e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.881+0000 7fbec1284700 1 -- 172.21.15.156:0/4249841298 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbebc09e870 msgr2=0x7fbebc120760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.881+0000 7fbec1284700 1 --2- 172.21.15.156:0/4249841298 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbebc09e870 0x7fbebc120760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.881+0000 7fbec1284700 1 -- 172.21.15.156:0/4249841298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbebc1371c0 msgr2=0x7fbebc1211e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.881+0000 7fbec1284700 1 --2- 172.21.15.156:0/4249841298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbebc1371c0 0x7fbebc1211e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.881+0000 7fbec1284700 1 -- 172.21.15.156:0/4249841298 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeac0094a0 con 0x7fbebc09f350 2023-09-30T22:24:13.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.882+0000 7fbec1284700 1 --2- 172.21.15.156:0/4249841298 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbebc09f350 0x7fbebc120ca0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fbeac00ec10 tx=0x7fbeac00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:13.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.882+0000 7fbeb27fc700 1 -- 172.21.15.156:0/4249841298 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac00c850 con 0x7fbebc09f350 2023-09-30T22:24:13.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.882+0000 7fbeb27fc700 1 -- 172.21.15.156:0/4249841298 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeac00c9b0 con 0x7fbebc09f350 2023-09-30T22:24:13.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.882+0000 7fbec3ce9700 1 -- 172.21.15.156:0/4249841298 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeb4009a70 con 0x7fbebc09f350 2023-09-30T22:24:13.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.882+0000 7fbeb27fc700 1 -- 172.21.15.156:0/4249841298 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac00cd20 con 0x7fbebc09f350 2023-09-30T22:24:13.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.882+0000 7fbec3ce9700 1 -- 172.21.15.156:0/4249841298 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbebc123ff0 con 0x7fbebc09f350 2023-09-30T22:24:13.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.882+0000 7fbeb27fc700 1 -- 172.21.15.156:0/4249841298 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbeac013470 con 0x7fbebc09f350 2023-09-30T22:24:13.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.883+0000 7fbeb27fc700 1 -- 172.21.15.156:0/4249841298 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbeac03f990 con 0x7fbebc09f350 2023-09-30T22:24:13.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.883+0000 7fbec3ce9700 1 -- 172.21.15.156:0/4249841298 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbebc123e00 con 0x7fbebc09f350 2023-09-30T22:24:13.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:13.887+0000 7fbeb27fc700 1 -- 172.21.15.156:0/4249841298 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbebc123e00 con 0x7fbebc09f350 2023-09-30T22:24:14.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.070+0000 7fbec3ce9700 1 -- 172.21.15.156:0/4249841298 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbebc123ff0 con 0x7fbebc09f350 2023-09-30T22:24:14.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.070+0000 7fbeb27fc700 1 -- 172.21.15.156:0/4249841298 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbebc123ff0 con 0x7fbebc09f350 2023-09-30T22:24:14.071 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:14.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.072+0000 7fbec3ce9700 1 -- 172.21.15.156:0/4249841298 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbebc09f350 msgr2=0x7fbebc120ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:14.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.072+0000 7fbec3ce9700 1 --2- 172.21.15.156:0/4249841298 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbebc09f350 0x7fbebc120ca0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fbeac00ec10 tx=0x7fbeac00ef20 comp rx=0 tx=0).stop 2023-09-30T22:24:14.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.072+0000 7fbec3ce9700 1 -- 172.21.15.156:0/4249841298 shutdown_connections 2023-09-30T22:24:14.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.072+0000 7fbec3ce9700 1 --2- 172.21.15.156:0/4249841298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbebc1371c0 0x7fbebc1211e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.072+0000 7fbec3ce9700 1 --2- 172.21.15.156:0/4249841298 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbebc09e870 0x7fbebc120760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.072+0000 7fbec3ce9700 1 --2- 172.21.15.156:0/4249841298 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbebc09f350 0x7fbebc120ca0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.072+0000 7fbec3ce9700 1 -- 172.21.15.156:0/4249841298 >> 172.21.15.156:0/4249841298 conn(0x7fbebc0a4430 msgr2=0x7fbebc0a28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:14.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.072+0000 7fbec3ce9700 1 -- 172.21.15.156:0/4249841298 shutdown_connections 2023-09-30T22:24:14.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.072+0000 7fbec3ce9700 1 -- 172.21.15.156:0/4249841298 wait complete. 2023-09-30T22:24:14.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:14.260 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:14.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.382+0000 7f14289b0700 1 Processor -- start 2023-09-30T22:24:14.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.383+0000 7f14289b0700 1 -- start start 2023-09-30T22:24:14.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.383+0000 7f14289b0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1424133ad0 0x7f1424133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:14.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.383+0000 7f14289b0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1424130bc0 0x7f142413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:14.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.383+0000 7f14289b0700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f142406b2d0 con 0x7f14241300a0 2023-09-30T22:24:14.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.383+0000 7f14289b0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1424133610 con 0x7f1424130bc0 2023-09-30T22:24:14.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.383+0000 7f14289b0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f142409a500 con 0x7f1424133ad0 2023-09-30T22:24:14.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.383+0000 7f1422d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1424130bc0 0x7f142413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:14.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.383+0000 7f1421d9b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f14241300a0 0x7f14241304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49332/0 (socket says 172.21.15.156:49332) 2023-09-30T22:24:14.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.383+0000 7f1421d9b700 1 -- 172.21.15.156:0/3867695617 learned_addr learned my addr 172.21.15.156:0/3867695617 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:14.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.383+0000 7f142259c700 1 --2- 172.21.15.156:0/3867695617 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1424133ad0 0x7f1424133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:14.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.384+0000 7f142159a700 1 -- 172.21.15.156:0/3867695617 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1726434708 0 0) 0x7f142406b2d0 con 0x7f14241300a0 2023-09-30T22:24:14.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.384+0000 7f142259c700 1 -- 172.21.15.156:0/3867695617 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1424130bc0 msgr2=0x7f142413b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:14.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.384+0000 7f142259c700 1 --2- 172.21.15.156:0/3867695617 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1424130bc0 0x7f142413b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.384+0000 7f142259c700 1 -- 172.21.15.156:0/3867695617 >> v1:172.21.15.156:6789/0 conn(0x7f14241300a0 legacy=0x7f14241304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:14.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.384+0000 7f142259c700 1 -- 172.21.15.156:0/3867695617 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14241338b0 con 0x7f1424133ad0 2023-09-30T22:24:14.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.384+0000 7f1422d9d700 1 --2- 172.21.15.156:0/3867695617 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1424130bc0 0x7f142413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:14.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.384+0000 7f142259c700 1 --2- 172.21.15.156:0/3867695617 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1424133ad0 0x7f1424133ea0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f140c009870 tx=0x7f140c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79a9ae1bff266d22 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:14.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.384+0000 7f142159a700 1 -- 172.21.15.156:0/3867695617 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c011830 con 0x7f1424133ad0 2023-09-30T22:24:14.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.384+0000 7f142159a700 1 -- 172.21.15.156:0/3867695617 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140c011990 con 0x7f1424133ad0 2023-09-30T22:24:14.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.384+0000 7f142159a700 1 -- 172.21.15.156:0/3867695617 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c011d20 con 0x7f1424133ad0 2023-09-30T22:24:14.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.384+0000 7f14289b0700 1 -- 172.21.15.156:0/3867695617 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1424133ad0 msgr2=0x7f1424133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:14.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.384+0000 7f14289b0700 1 --2- 172.21.15.156:0/3867695617 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1424133ad0 0x7f1424133ea0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f140c009870 tx=0x7f140c009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:14.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.385+0000 7f14289b0700 1 -- 172.21.15.156:0/3867695617 shutdown_connections 2023-09-30T22:24:14.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.385+0000 7f14289b0700 1 --2- 172.21.15.156:0/3867695617 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1424130bc0 0x7f142413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.385+0000 7f14289b0700 1 --2- 172.21.15.156:0/3867695617 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1424133ad0 0x7f1424133ea0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.385+0000 7f14289b0700 1 -- 172.21.15.156:0/3867695617 >> 172.21.15.156:0/3867695617 conn(0x7f1424099c40 msgr2=0x7f14240a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:14.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.385+0000 7f14289b0700 1 -- 172.21.15.156:0/3867695617 shutdown_connections 2023-09-30T22:24:14.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.385+0000 7f14289b0700 1 -- 172.21.15.156:0/3867695617 wait complete. 2023-09-30T22:24:14.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.386+0000 7f14289b0700 1 Processor -- start 2023-09-30T22:24:14.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.386+0000 7f14289b0700 1 -- start start 2023-09-30T22:24:14.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.387+0000 7f14289b0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f14241300a0 0x7f142411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:14.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.387+0000 7f14289b0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1424130bc0 0x7f142411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:14.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.387+0000 7f14289b0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1424133ad0 0x7f142411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:14.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.387+0000 7f14289b0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1424120950 con 0x7f1424130bc0 2023-09-30T22:24:14.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.387+0000 7f14289b0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142412d930 con 0x7f1424133ad0 2023-09-30T22:24:14.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.387+0000 7f14289b0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f142411fd00 con 0x7f14241300a0 2023-09-30T22:24:14.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.387+0000 7f142259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f14241300a0 0x7f142411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:14.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.387+0000 7f142259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f14241300a0 0x7f142411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52454/0 (socket says 172.21.15.156:52454) 2023-09-30T22:24:14.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.387+0000 7f142259c700 1 -- 172.21.15.156:0/343180148 learned_addr learned my addr 172.21.15.156:0/343180148 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:14.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.387+0000 7f1421d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1424130bc0 0x7f142411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:14.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.387+0000 7f1422d9d700 1 --2- 172.21.15.156:0/343180148 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1424133ad0 0x7f142411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:14.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.387+0000 7f142259c700 1 -- 172.21.15.156:0/343180148 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1424133ad0 msgr2=0x7f142411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:14.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.387+0000 7f142259c700 1 --2- 172.21.15.156:0/343180148 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1424133ad0 0x7f142411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.387+0000 7f142259c700 1 -- 172.21.15.156:0/343180148 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1424130bc0 msgr2=0x7f142411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:14.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.387+0000 7f142259c700 1 --2- 172.21.15.156:0/343180148 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1424130bc0 0x7f142411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.387+0000 7f142259c700 1 -- 172.21.15.156:0/343180148 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c009a70 con 0x7f14241300a0 2023-09-30T22:24:14.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.387+0000 7f1421d9b700 1 --2- 172.21.15.156:0/343180148 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1424130bc0 0x7f142411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:14.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.387+0000 7f142259c700 1 --2- 172.21.15.156:0/343180148 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f14241300a0 0x7f142411da40 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f140c009840 tx=0x7f140c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:14.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.387+0000 7f141affd700 1 -- 172.21.15.156:0/343180148 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c0044d0 con 0x7f14241300a0 2023-09-30T22:24:14.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.387+0000 7f141affd700 1 -- 172.21.15.156:0/343180148 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140c0036a0 con 0x7f14241300a0 2023-09-30T22:24:14.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.387+0000 7f14289b0700 1 -- 172.21.15.156:0/343180148 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f140c0094a0 con 0x7f14241300a0 2023-09-30T22:24:14.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.387+0000 7f141affd700 1 -- 172.21.15.156:0/343180148 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c003a30 con 0x7f14241300a0 2023-09-30T22:24:14.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.387+0000 7f14289b0700 1 -- 172.21.15.156:0/343180148 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142412dd00 con 0x7f14241300a0 2023-09-30T22:24:14.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.388+0000 7f141affd700 1 -- 172.21.15.156:0/343180148 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f140c003b90 con 0x7f14241300a0 2023-09-30T22:24:14.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.388+0000 7f141affd700 1 -- 172.21.15.156:0/343180148 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f140c040420 con 0x7f14241300a0 2023-09-30T22:24:14.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.388+0000 7f14289b0700 1 -- 172.21.15.156:0/343180148 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f142404f2a0 con 0x7f14241300a0 2023-09-30T22:24:14.395 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:14.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.393+0000 7f141affd700 1 -- 172.21.15.156:0/343180148 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f140c01a420 con 0x7f14241300a0 2023-09-30T22:24:14.430 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:14.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.520+0000 7f353c47d700 1 Processor -- start 2023-09-30T22:24:14.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.520+0000 7f353c47d700 1 -- start start 2023-09-30T22:24:14.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.521+0000 7f353c47d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f353409d860 0x7f353409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:14.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.521+0000 7f353c47d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f353409e170 0x7f35341307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:14.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.521+0000 7f353c47d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f353409aaa0 con 0x7f3534130ce0 2023-09-30T22:24:14.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.521+0000 7f353c47d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f353409f870 con 0x7f353409d860 2023-09-30T22:24:14.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.521+0000 7f353c47d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f353409b360 con 0x7f353409e170 2023-09-30T22:24:14.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.521+0000 7f353a219700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f353409d860 0x7f353409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:14.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.521+0000 7f353a219700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f353409d860 0x7f353409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60512/0 (socket says 172.21.15.156:60512) 2023-09-30T22:24:14.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.521+0000 7f353a219700 1 -- 172.21.15.156:0/3067881075 learned_addr learned my addr 172.21.15.156:0/3067881075 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:14.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.521+0000 7f353aa1a700 1 --1- 172.21.15.156:0/3067881075 >> v1:172.21.15.156:6789/0 conn(0x7f3534130ce0 0x7f35341379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49334/0 (socket says 172.21.15.156:49334) 2023-09-30T22:24:14.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.521+0000 7f3539a18700 1 --2- 172.21.15.156:0/3067881075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f353409e170 0x7f35341307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:14.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.522+0000 7f353a219700 1 -- 172.21.15.156:0/3067881075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f353409e170 msgr2=0x7f35341307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:14.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.522+0000 7f353a219700 1 --2- 172.21.15.156:0/3067881075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f353409e170 0x7f35341307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.522+0000 7f3539217700 1 -- 172.21.15.156:0/3067881075 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1554323895 0 0) 0x7f353409aaa0 con 0x7f3534130ce0 2023-09-30T22:24:14.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.522+0000 7f353a219700 1 -- 172.21.15.156:0/3067881075 >> v1:172.21.15.156:6789/0 conn(0x7f3534130ce0 legacy=0x7f35341379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:14.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.522+0000 7f353a219700 1 -- 172.21.15.156:0/3067881075 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353409b620 con 0x7f353409d860 2023-09-30T22:24:14.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.522+0000 7f353a219700 1 --2- 172.21.15.156:0/3067881075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f353409d860 0x7f353409dc30 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f35300098f0 tx=0x7f3530009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d46da20d856626 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:14.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.522+0000 7f3539217700 1 -- 172.21.15.156:0/3067881075 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3530011830 con 0x7f353409d860 2023-09-30T22:24:14.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.522+0000 7f3539217700 1 -- 172.21.15.156:0/3067881075 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3530011990 con 0x7f353409d860 2023-09-30T22:24:14.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.522+0000 7f3539217700 1 -- 172.21.15.156:0/3067881075 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3530011d20 con 0x7f353409d860 2023-09-30T22:24:14.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.523+0000 7f353c47d700 1 -- 172.21.15.156:0/3067881075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f353409d860 msgr2=0x7f353409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:14.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.523+0000 7f353c47d700 1 --2- 172.21.15.156:0/3067881075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f353409d860 0x7f353409dc30 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f35300098f0 tx=0x7f3530009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:14.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.523+0000 7f353c47d700 1 -- 172.21.15.156:0/3067881075 shutdown_connections 2023-09-30T22:24:14.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.523+0000 7f353c47d700 1 --2- 172.21.15.156:0/3067881075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f353409d860 0x7f353409dc30 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.523+0000 7f353c47d700 1 --2- 172.21.15.156:0/3067881075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f353409e170 0x7f35341307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.523+0000 7f353c47d700 1 -- 172.21.15.156:0/3067881075 >> 172.21.15.156:0/3067881075 conn(0x7f3534099c40 msgr2=0x7f35340a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:14.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.523+0000 7f353c47d700 1 -- 172.21.15.156:0/3067881075 shutdown_connections 2023-09-30T22:24:14.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.523+0000 7f353c47d700 1 -- 172.21.15.156:0/3067881075 wait complete. 2023-09-30T22:24:14.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.524+0000 7f353c47d700 1 Processor -- start 2023-09-30T22:24:14.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.524+0000 7f353c47d700 1 -- start start 2023-09-30T22:24:14.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.525+0000 7f353c47d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f353409d860 0x7f353411f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:14.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.525+0000 7f353c47d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f353409e170 0x7f353411fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:14.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.525+0000 7f353c47d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3534130ce0 0x7f353411ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:14.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.525+0000 7f353c47d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3534122770 con 0x7f3534130ce0 2023-09-30T22:24:14.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.525+0000 7f353c47d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3534123000 con 0x7f353409e170 2023-09-30T22:24:14.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.525+0000 7f353c47d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35340a0790 con 0x7f353409d860 2023-09-30T22:24:14.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.525+0000 7f3539a18700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f353409e170 0x7f353411fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:14.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.525+0000 7f353a219700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f353409d860 0x7f353411f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:14.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.525+0000 7f3539a18700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f353409e170 0x7f353411fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53546/0 (socket says 172.21.15.156:53546) 2023-09-30T22:24:14.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.525+0000 7f353a219700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f353409d860 0x7f353411f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52472/0 (socket says 172.21.15.156:52472) 2023-09-30T22:24:14.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.525+0000 7f3539a18700 1 -- 172.21.15.156:0/1712274755 learned_addr learned my addr 172.21.15.156:0/1712274755 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:14.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.525+0000 7f353aa1a700 1 --2- 172.21.15.156:0/1712274755 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3534130ce0 0x7f353411ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:14.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.525+0000 7f3539a18700 1 -- 172.21.15.156:0/1712274755 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f353409d860 msgr2=0x7f353411f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:14.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.525+0000 7f3539a18700 1 --2- 172.21.15.156:0/1712274755 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f353409d860 0x7f353411f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.525+0000 7f3539a18700 1 -- 172.21.15.156:0/1712274755 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3534130ce0 msgr2=0x7f353411ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:14.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.525+0000 7f3539a18700 1 --2- 172.21.15.156:0/1712274755 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3534130ce0 0x7f353411ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.525+0000 7f3539a18700 1 -- 172.21.15.156:0/1712274755 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3530009550 con 0x7f353409e170 2023-09-30T22:24:14.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.525+0000 7f353a219700 1 --2- 172.21.15.156:0/1712274755 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f353409d860 0x7f353411f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:14.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.526+0000 7f3539a18700 1 --2- 172.21.15.156:0/1712274755 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f353409e170 0x7f353411fa20 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f352400e9d0 tx=0x7f352400ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:14.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.526+0000 7f352affd700 1 -- 172.21.15.156:0/1712274755 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524009730 con 0x7f353409e170 2023-09-30T22:24:14.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.526+0000 7f352affd700 1 -- 172.21.15.156:0/1712274755 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352400ee70 con 0x7f353409e170 2023-09-30T22:24:14.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.526+0000 7f353c47d700 1 -- 172.21.15.156:0/1712274755 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f353409c910 con 0x7f353409e170 2023-09-30T22:24:14.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.526+0000 7f352affd700 1 -- 172.21.15.156:0/1712274755 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352400ca70 con 0x7f353409e170 2023-09-30T22:24:14.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.526+0000 7f353c47d700 1 -- 172.21.15.156:0/1712274755 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3534122d20 con 0x7f353409e170 2023-09-30T22:24:14.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.527+0000 7f352affd700 1 -- 172.21.15.156:0/1712274755 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f352400cbd0 con 0x7f353409e170 2023-09-30T22:24:14.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.527+0000 7f353c47d700 1 -- 172.21.15.156:0/1712274755 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f353404f2a0 con 0x7f353409e170 2023-09-30T22:24:14.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.527+0000 7f352affd700 1 -- 172.21.15.156:0/1712274755 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f352403f7e0 con 0x7f353409e170 2023-09-30T22:24:14.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.531+0000 7f352affd700 1 -- 172.21.15.156:0/1712274755 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3524021070 con 0x7f353409e170 2023-09-30T22:24:14.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.563+0000 7ff169ef7700 1 Processor -- start 2023-09-30T22:24:14.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.563+0000 7ff169ef7700 1 -- start start 2023-09-30T22:24:14.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.563+0000 7ff169ef7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff16409d860 0x7ff16409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:14.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.563+0000 7ff169ef7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff164130eb0 0x7ff164138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:14.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.563+0000 7ff169ef7700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16409aaa0 con 0x7ff16409e170 2023-09-30T22:24:14.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.563+0000 7ff169ef7700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff16409f870 con 0x7ff16409d860 2023-09-30T22:24:14.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.563+0000 7ff169ef7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16409b360 con 0x7ff164130eb0 2023-09-30T22:24:14.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.563+0000 7ff163fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff164130eb0 0x7ff164138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:14.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.563+0000 7ff163fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff164130eb0 0x7ff164138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53562/0 (socket says 172.21.15.156:53562) 2023-09-30T22:24:14.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.563+0000 7ff1637fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff16409d860 0x7ff16409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:14.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.563+0000 7ff163fff700 1 -- 172.21.15.156:0/1199500800 learned_addr learned my addr 172.21.15.156:0/1199500800 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:14.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.564+0000 7ff1637fe700 1 -- 172.21.15.156:0/1199500800 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff164130eb0 msgr2=0x7ff164138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:14.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.564+0000 7ff1637fe700 1 --2- 172.21.15.156:0/1199500800 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff164130eb0 0x7ff164138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.564+0000 7ff1637fe700 1 -- 172.21.15.156:0/1199500800 >> v1:172.21.15.156:6789/0 conn(0x7ff16409e170 legacy=0x7ff1641307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:14.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.564+0000 7ff1637fe700 1 -- 172.21.15.156:0/1199500800 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16409b620 con 0x7ff16409d860 2023-09-30T22:24:14.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.564+0000 7ff1627fc700 1 -- 172.21.15.156:0/1199500800 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1040365312 0 0) 0x7ff16409aaa0 con 0x7ff16409e170 2023-09-30T22:24:14.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.564+0000 7ff163fff700 1 --2- 172.21.15.156:0/1199500800 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff164130eb0 0x7ff164138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:14.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.564+0000 7ff1637fe700 1 --2- 172.21.15.156:0/1199500800 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff16409d860 0x7ff16409dc30 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7ff154009840 tx=0x7ff154009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b2faa68600f6bf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:14.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.564+0000 7ff1627fc700 1 -- 172.21.15.156:0/1199500800 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15400d980 con 0x7ff16409d860 2023-09-30T22:24:14.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.564+0000 7ff1627fc700 1 -- 172.21.15.156:0/1199500800 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15400dae0 con 0x7ff16409d860 2023-09-30T22:24:14.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.564+0000 7ff1627fc700 1 -- 172.21.15.156:0/1199500800 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15400de70 con 0x7ff16409d860 2023-09-30T22:24:14.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.565+0000 7ff169ef7700 1 -- 172.21.15.156:0/1199500800 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff16409d860 msgr2=0x7ff16409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:14.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.565+0000 7ff169ef7700 1 --2- 172.21.15.156:0/1199500800 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff16409d860 0x7ff16409dc30 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7ff154009840 tx=0x7ff154009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:14.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.565+0000 7ff169ef7700 1 -- 172.21.15.156:0/1199500800 shutdown_connections 2023-09-30T22:24:14.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.565+0000 7ff169ef7700 1 --2- 172.21.15.156:0/1199500800 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff164130eb0 0x7ff164138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.565+0000 7ff169ef7700 1 --2- 172.21.15.156:0/1199500800 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff16409d860 0x7ff16409dc30 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.565+0000 7ff169ef7700 1 -- 172.21.15.156:0/1199500800 >> 172.21.15.156:0/1199500800 conn(0x7ff164099c40 msgr2=0x7ff1640a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:14.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.565+0000 7ff169ef7700 1 -- 172.21.15.156:0/1199500800 shutdown_connections 2023-09-30T22:24:14.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.565+0000 7ff169ef7700 1 -- 172.21.15.156:0/1199500800 wait complete. 2023-09-30T22:24:14.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.566+0000 7ff169ef7700 1 Processor -- start 2023-09-30T22:24:14.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.567+0000 7ff169ef7700 1 -- start start 2023-09-30T22:24:14.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.567+0000 7ff169ef7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff16409d860 0x7ff16411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:14.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.567+0000 7ff169ef7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff16409e170 0x7ff16411ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:14.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.567+0000 7ff169ef7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff164130eb0 0x7ff16411ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:14.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.567+0000 7ff169ef7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff164121cb0 con 0x7ff16409d860 2023-09-30T22:24:14.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.567+0000 7ff169ef7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff164120190 con 0x7ff164130eb0 2023-09-30T22:24:14.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.567+0000 7ff169ef7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1640a0840 con 0x7ff16409e170 2023-09-30T22:24:14.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.567+0000 7ff1637fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff16409d860 0x7ff16411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:14.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.567+0000 7ff1637fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff16409d860 0x7ff16411e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60540/0 (socket says 172.21.15.156:60540) 2023-09-30T22:24:14.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.567+0000 7ff1637fe700 1 -- 172.21.15.156:0/4178980574 learned_addr learned my addr 172.21.15.156:0/4178980574 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:14.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.568+0000 7ff163fff700 1 --2- 172.21.15.156:0/4178980574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff164130eb0 0x7ff16411ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:14.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.568+0000 7ff162ffd700 1 --2- 172.21.15.156:0/4178980574 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff16409e170 0x7ff16411ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:14.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.568+0000 7ff1637fe700 1 -- 172.21.15.156:0/4178980574 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff16409e170 msgr2=0x7ff16411ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:14.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.568+0000 7ff1637fe700 1 --2- 172.21.15.156:0/4178980574 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff16409e170 0x7ff16411ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.568+0000 7ff1637fe700 1 -- 172.21.15.156:0/4178980574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff164130eb0 msgr2=0x7ff16411ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:14.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.568+0000 7ff1637fe700 1 --2- 172.21.15.156:0/4178980574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff164130eb0 0x7ff16411ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.568+0000 7ff1637fe700 1 -- 172.21.15.156:0/4178980574 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff15c009b30 con 0x7ff16409d860 2023-09-30T22:24:14.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.568+0000 7ff1637fe700 1 --2- 172.21.15.156:0/4178980574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff16409d860 0x7ff16411e4c0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7ff154009fd0 tx=0x7ff154004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:14.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.568+0000 7ff14bfff700 1 -- 172.21.15.156:0/4178980574 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15401d030 con 0x7ff16409d860 2023-09-30T22:24:14.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.568+0000 7ff14bfff700 1 -- 172.21.15.156:0/4178980574 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15401f070 con 0x7ff16409d860 2023-09-30T22:24:14.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.568+0000 7ff169ef7700 1 -- 172.21.15.156:0/4178980574 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1540094a0 con 0x7ff16409d860 2023-09-30T22:24:14.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.568+0000 7ff14bfff700 1 -- 172.21.15.156:0/4178980574 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1540038e0 con 0x7ff16409d860 2023-09-30T22:24:14.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.568+0000 7ff169ef7700 1 -- 172.21.15.156:0/4178980574 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff164122720 con 0x7ff16409d860 2023-09-30T22:24:14.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.569+0000 7ff14bfff700 1 -- 172.21.15.156:0/4178980574 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff154021030 con 0x7ff16409d860 2023-09-30T22:24:14.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.569+0000 7ff14bfff700 1 -- 172.21.15.156:0/4178980574 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff15401e070 con 0x7ff16409d860 2023-09-30T22:24:14.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.570+0000 7ff169ef7700 1 -- 172.21.15.156:0/4178980574 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff16404f2a0 con 0x7ff16409d860 2023-09-30T22:24:14.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.575+0000 7ff14bfff700 1 -- 172.21.15.156:0/4178980574 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff154022380 con 0x7ff16409d860 2023-09-30T22:24:14.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.604+0000 7f14289b0700 1 -- 172.21.15.156:0/343180148 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f142406c3b0 con 0x7f14241300a0 2023-09-30T22:24:14.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.604+0000 7f141affd700 1 -- 172.21.15.156:0/343180148 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f140c028070 con 0x7f14241300a0 2023-09-30T22:24:14.605 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:14.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.606+0000 7f14289b0700 1 -- 172.21.15.156:0/343180148 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f14241300a0 msgr2=0x7f142411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:14.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.606+0000 7f14289b0700 1 --2- 172.21.15.156:0/343180148 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f14241300a0 0x7f142411da40 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f140c009840 tx=0x7f140c004750 comp rx=0 tx=0).stop 2023-09-30T22:24:14.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.606+0000 7f14289b0700 1 -- 172.21.15.156:0/343180148 shutdown_connections 2023-09-30T22:24:14.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.606+0000 7f14289b0700 1 --2- 172.21.15.156:0/343180148 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1424133ad0 0x7f142411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.606+0000 7f14289b0700 1 --2- 172.21.15.156:0/343180148 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f14241300a0 0x7f142411da40 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.606+0000 7f14289b0700 1 --2- 172.21.15.156:0/343180148 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1424130bc0 0x7f142411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.606+0000 7f14289b0700 1 -- 172.21.15.156:0/343180148 >> 172.21.15.156:0/343180148 conn(0x7f1424099c40 msgr2=0x7f142412e620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:14.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.607+0000 7f14289b0700 1 -- 172.21.15.156:0/343180148 shutdown_connections 2023-09-30T22:24:14.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.607+0000 7f14289b0700 1 -- 172.21.15.156:0/343180148 wait complete. 2023-09-30T22:24:14.619 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:14.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.730+0000 7f353c47d700 1 -- 172.21.15.156:0/1712274755 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f353406c3b0 con 0x7f353409e170 2023-09-30T22:24:14.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.730+0000 7f352affd700 1 -- 172.21.15.156:0/1712274755 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f35240232f0 con 0x7f353409e170 2023-09-30T22:24:14.731 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:14.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.732+0000 7f353c47d700 1 -- 172.21.15.156:0/1712274755 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f353409e170 msgr2=0x7f353411fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:14.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.732+0000 7f353c47d700 1 --2- 172.21.15.156:0/1712274755 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f353409e170 0x7f353411fa20 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f352400e9d0 tx=0x7f352400ece0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.732+0000 7f353c47d700 1 -- 172.21.15.156:0/1712274755 shutdown_connections 2023-09-30T22:24:14.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.732+0000 7f353c47d700 1 --2- 172.21.15.156:0/1712274755 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3534130ce0 0x7f353411ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.732+0000 7f353c47d700 1 --2- 172.21.15.156:0/1712274755 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f353409d860 0x7f353411f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.732+0000 7f353c47d700 1 --2- 172.21.15.156:0/1712274755 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f353409e170 0x7f353411fa20 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.732+0000 7f353c47d700 1 -- 172.21.15.156:0/1712274755 >> 172.21.15.156:0/1712274755 conn(0x7f3534099c40 msgr2=0x7f35340a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:14.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.732+0000 7f353c47d700 1 -- 172.21.15.156:0/1712274755 shutdown_connections 2023-09-30T22:24:14.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.732+0000 7f353c47d700 1 -- 172.21.15.156:0/1712274755 wait complete. 2023-09-30T22:24:14.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:14.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.781+0000 7ff169ef7700 1 -- 172.21.15.156:0/4178980574 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff16406c3b0 con 0x7ff16409d860 2023-09-30T22:24:14.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.781+0000 7ff14bfff700 1 -- 172.21.15.156:0/4178980574 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff154032090 con 0x7ff16409d860 2023-09-30T22:24:14.782 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:14.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.783+0000 7ff169ef7700 1 -- 172.21.15.156:0/4178980574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff16409d860 msgr2=0x7ff16411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:14.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.783+0000 7ff169ef7700 1 --2- 172.21.15.156:0/4178980574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff16409d860 0x7ff16411e4c0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7ff154009fd0 tx=0x7ff154004750 comp rx=0 tx=0).stop 2023-09-30T22:24:14.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.783+0000 7ff169ef7700 1 -- 172.21.15.156:0/4178980574 shutdown_connections 2023-09-30T22:24:14.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.783+0000 7ff169ef7700 1 --2- 172.21.15.156:0/4178980574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff164130eb0 0x7ff16411ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.783+0000 7ff169ef7700 1 --2- 172.21.15.156:0/4178980574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff16409d860 0x7ff16411e4c0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.783+0000 7ff169ef7700 1 --2- 172.21.15.156:0/4178980574 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff16409e170 0x7ff16411ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.783+0000 7ff169ef7700 1 -- 172.21.15.156:0/4178980574 >> 172.21.15.156:0/4178980574 conn(0x7ff164099c40 msgr2=0x7ff1640a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:14.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.784+0000 7ff169ef7700 1 -- 172.21.15.156:0/4178980574 shutdown_connections 2023-09-30T22:24:14.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:14.784+0000 7ff169ef7700 1 -- 172.21.15.156:0/4178980574 wait complete. 2023-09-30T22:24:14.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:15.086 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:15.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.208+0000 7f3df4143700 1 Processor -- start 2023-09-30T22:24:15.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.208+0000 7f3df4143700 1 -- start start 2023-09-30T22:24:15.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.208+0000 7f3df4143700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3dec09e870 0x7f3dec09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.208+0000 7f3df4143700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3dec134330 0x7f3dec13be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.208+0000 7f3df4143700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dec09fa00 con 0x7f3dec09f180 2023-09-30T22:24:15.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.208+0000 7f3df4143700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dec0a0370 con 0x7f3dec134330 2023-09-30T22:24:15.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.208+0000 7f3df4143700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec06bec0 con 0x7f3dec09e870 2023-09-30T22:24:15.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.209+0000 7f3df1edf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3dec09e870 0x7f3dec09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.209+0000 7f3df1edf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3dec09e870 0x7f3dec09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52494/0 (socket says 172.21.15.156:52494) 2023-09-30T22:24:15.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.209+0000 7f3df1edf700 1 -- 172.21.15.156:0/1507132871 learned_addr learned my addr 172.21.15.156:0/1507132871 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:15.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.209+0000 7f3df26e0700 1 --2- 172.21.15.156:0/1507132871 >> v2:172.21.15.156:3300/0 conn(0x7f3dec134330 0x7f3dec13be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.209+0000 7f3df0edd700 1 -- 172.21.15.156:0/1507132871 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110077742 0 0) 0x7f3dec09fa00 con 0x7f3dec09f180 2023-09-30T22:24:15.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.209+0000 7f3df0edd700 1 -- 172.21.15.156:0/1507132871 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dd80035b0 con 0x7f3dec09f180 2023-09-30T22:24:15.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.209+0000 7f3df26e0700 1 -- 172.21.15.156:0/1507132871 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3dec09e870 msgr2=0x7f3dec09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:15.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.209+0000 7f3df26e0700 1 --2- 172.21.15.156:0/1507132871 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3dec09e870 0x7f3dec09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.209+0000 7f3df26e0700 1 -- 172.21.15.156:0/1507132871 >> v1:172.21.15.156:6789/0 conn(0x7f3dec09f180 legacy=0x7f3dec133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.209+0000 7f3df26e0700 1 -- 172.21.15.156:0/1507132871 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec09ada0 con 0x7f3dec134330 2023-09-30T22:24:15.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.209+0000 7f3df1edf700 1 --2- 172.21.15.156:0/1507132871 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3dec09e870 0x7f3dec09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:15.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.209+0000 7f3df26e0700 1 --2- 172.21.15.156:0/1507132871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3dec134330 0x7f3dec13be80 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f3de4009d90 tx=0x7f3de400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d899803b2b87f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:15.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.209+0000 7f3df0edd700 1 -- 172.21.15.156:0/1507132871 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de400e070 con 0x7f3dec134330 2023-09-30T22:24:15.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.209+0000 7f3df0edd700 1 -- 172.21.15.156:0/1507132871 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de400bb20 con 0x7f3dec134330 2023-09-30T22:24:15.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.209+0000 7f3df0edd700 1 -- 172.21.15.156:0/1507132871 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de4012430 con 0x7f3dec134330 2023-09-30T22:24:15.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.210+0000 7f3df4143700 1 -- 172.21.15.156:0/1507132871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3dec134330 msgr2=0x7f3dec13be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.210+0000 7f3df4143700 1 --2- 172.21.15.156:0/1507132871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3dec134330 0x7f3dec13be80 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f3de4009d90 tx=0x7f3de400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:15.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.210+0000 7f3df4143700 1 -- 172.21.15.156:0/1507132871 shutdown_connections 2023-09-30T22:24:15.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.210+0000 7f3df4143700 1 --2- 172.21.15.156:0/1507132871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3dec134330 0x7f3dec13be80 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.210+0000 7f3df4143700 1 --2- 172.21.15.156:0/1507132871 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3dec09e870 0x7f3dec09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.210+0000 7f3df4143700 1 -- 172.21.15.156:0/1507132871 >> 172.21.15.156:0/1507132871 conn(0x7f3dec0a4430 msgr2=0x7f3dec0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:15.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.210+0000 7f3df4143700 1 -- 172.21.15.156:0/1507132871 shutdown_connections 2023-09-30T22:24:15.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.210+0000 7f3df4143700 1 -- 172.21.15.156:0/1507132871 wait complete. 2023-09-30T22:24:15.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.211+0000 7f3df4143700 1 Processor -- start 2023-09-30T22:24:15.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.211+0000 7f3df4143700 1 -- start start 2023-09-30T22:24:15.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.211+0000 7f3df4143700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3dec09e870 0x7f3dec122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.211+0000 7f3df4143700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3dec09f180 0x7f3dec122e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.211+0000 7f3df4143700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3dec134330 0x7f3dec1233b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.211+0000 7f3df4143700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec124540 con 0x7f3dec09e870 2023-09-30T22:24:15.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.211+0000 7f3df4143700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec125eb0 con 0x7f3dec134330 2023-09-30T22:24:15.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.211+0000 7f3df4143700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec1334c0 con 0x7f3dec09f180 2023-09-30T22:24:15.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.211+0000 7f3df1edf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3dec09e870 0x7f3dec122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.211+0000 7f3df16de700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3dec09f180 0x7f3dec122e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.211+0000 7f3df1edf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3dec09e870 0x7f3dec122930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60564/0 (socket says 172.21.15.156:60564) 2023-09-30T22:24:15.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.211+0000 7f3df1edf700 1 -- 172.21.15.156:0/57181545 learned_addr learned my addr 172.21.15.156:0/57181545 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:15.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.211+0000 7f3df26e0700 1 --2- 172.21.15.156:0/57181545 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3dec134330 0x7f3dec1233b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.211+0000 7f3df1edf700 1 -- 172.21.15.156:0/57181545 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3dec09f180 msgr2=0x7f3dec122e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.211+0000 7f3df1edf700 1 --2- 172.21.15.156:0/57181545 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3dec09f180 0x7f3dec122e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.211+0000 7f3df1edf700 1 -- 172.21.15.156:0/57181545 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3dec134330 msgr2=0x7f3dec1233b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.211+0000 7f3df1edf700 1 --2- 172.21.15.156:0/57181545 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3dec134330 0x7f3dec1233b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.211+0000 7f3df1edf700 1 -- 172.21.15.156:0/57181545 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de8009550 con 0x7f3dec09e870 2023-09-30T22:24:15.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.212+0000 7f3df1edf700 1 --2- 172.21.15.156:0/57181545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3dec09e870 0x7f3dec122930 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f3de800ec10 tx=0x7f3de800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:15.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.212+0000 7f3de27fc700 1 -- 172.21.15.156:0/57181545 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de800c850 con 0x7f3dec09e870 2023-09-30T22:24:15.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.212+0000 7f3de27fc700 1 -- 172.21.15.156:0/57181545 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de800c9b0 con 0x7f3dec09e870 2023-09-30T22:24:15.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.212+0000 7f3df4143700 1 -- 172.21.15.156:0/57181545 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de4009a70 con 0x7f3dec09e870 2023-09-30T22:24:15.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.212+0000 7f3de27fc700 1 -- 172.21.15.156:0/57181545 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de800cd40 con 0x7f3dec09e870 2023-09-30T22:24:15.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.212+0000 7f3df4143700 1 -- 172.21.15.156:0/57181545 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dec06cfa0 con 0x7f3dec09e870 2023-09-30T22:24:15.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.213+0000 7f3de27fc700 1 -- 172.21.15.156:0/57181545 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3de8013470 con 0x7f3dec09e870 2023-09-30T22:24:15.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.213+0000 7f3de27fc700 1 -- 172.21.15.156:0/57181545 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3de803f860 con 0x7f3dec09e870 2023-09-30T22:24:15.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.213+0000 7f3df4143700 1 -- 172.21.15.156:0/57181545 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dec04f2a0 con 0x7f3dec09e870 2023-09-30T22:24:15.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.218+0000 7f3de27fc700 1 -- 172.21.15.156:0/57181545 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3de8013720 con 0x7f3dec09e870 2023-09-30T22:24:15.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.403+0000 7f3df4143700 1 -- 172.21.15.156:0/57181545 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3dec06c9d0 con 0x7f3dec09e870 2023-09-30T22:24:15.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.403+0000 7f3de27fc700 1 -- 172.21.15.156:0/57181545 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3de801bd00 con 0x7f3dec09e870 2023-09-30T22:24:15.404 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:15.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.405+0000 7f3df4143700 1 -- 172.21.15.156:0/57181545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3dec09e870 msgr2=0x7f3dec122930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.405+0000 7f3df4143700 1 --2- 172.21.15.156:0/57181545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3dec09e870 0x7f3dec122930 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f3de800ec10 tx=0x7f3de800ef20 comp rx=0 tx=0).stop 2023-09-30T22:24:15.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.405+0000 7f3df4143700 1 -- 172.21.15.156:0/57181545 shutdown_connections 2023-09-30T22:24:15.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.405+0000 7f3df4143700 1 --2- 172.21.15.156:0/57181545 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3dec134330 0x7f3dec1233b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.405+0000 7f3df4143700 1 --2- 172.21.15.156:0/57181545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3dec09e870 0x7f3dec122930 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.405+0000 7f3df4143700 1 --2- 172.21.15.156:0/57181545 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3dec09f180 0x7f3dec122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.405+0000 7f3df4143700 1 -- 172.21.15.156:0/57181545 >> 172.21.15.156:0/57181545 conn(0x7f3dec0a4430 msgr2=0x7f3dec070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:15.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.405+0000 7f3df4143700 1 -- 172.21.15.156:0/57181545 shutdown_connections 2023-09-30T22:24:15.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.405+0000 7f3df4143700 1 -- 172.21.15.156:0/57181545 wait complete. 2023-09-30T22:24:15.418 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:15.620 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:15.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.743+0000 7f4d3a88c700 1 Processor -- start 2023-09-30T22:24:15.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.743+0000 7f4d3a88c700 1 -- start start 2023-09-30T22:24:15.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.744+0000 7f4d3a88c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4d340a0a30 0x7f4d340a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.744+0000 7f4d3a88c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d340a1340 0x7f4d3412ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.744+0000 7f4d3a88c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d340a1e70 con 0x7f4d341304a0 2023-09-30T22:24:15.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.744+0000 7f4d3a88c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d3409a720 con 0x7f4d340a0a30 2023-09-30T22:24:15.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.744+0000 7f4d3a88c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3409b300 con 0x7f4d340a1340 2023-09-30T22:24:15.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.744+0000 7f4d33fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4d340a0a30 0x7f4d340a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.744+0000 7f4d337fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d340a1340 0x7f4d3412ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.744+0000 7f4d38e29700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4d341304a0 0x7f4d341371b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49354/0 (socket says 172.21.15.156:49354) 2023-09-30T22:24:15.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.744+0000 7f4d38e29700 1 -- 172.21.15.156:0/2491700117 learned_addr learned my addr 172.21.15.156:0/2491700117 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:15.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.744+0000 7f4d337fe700 1 -- 172.21.15.156:0/2491700117 >> v2:172.21.15.156:3300/0 conn(0x7f4d340a0a30 msgr2=0x7f4d340a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:15.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.744+0000 7f4d337fe700 1 --2- 172.21.15.156:0/2491700117 >> v2:172.21.15.156:3300/0 conn(0x7f4d340a0a30 0x7f4d340a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.744+0000 7f4d337fe700 1 -- 172.21.15.156:0/2491700117 >> v1:172.21.15.156:6789/0 conn(0x7f4d341304a0 legacy=0x7f4d341371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.744+0000 7f4d337fe700 1 -- 172.21.15.156:0/2491700117 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3409abc0 con 0x7f4d340a1340 2023-09-30T22:24:15.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.744+0000 7f4d32ffd700 1 -- 172.21.15.156:0/2491700117 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 255722669 0 0) 0x7f4d340a1e70 con 0x7f4d341304a0 2023-09-30T22:24:15.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.744+0000 7f4d33fff700 1 --2- 172.21.15.156:0/2491700117 >> v2:172.21.15.156:3300/0 conn(0x7f4d340a0a30 0x7f4d340a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:15.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.744+0000 7f4d337fe700 1 --2- 172.21.15.156:0/2491700117 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d340a1340 0x7f4d3412ff60 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c009840 tx=0x7f4d1c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62957c0efdebe4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:15.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.745+0000 7f4d32ffd700 1 -- 172.21.15.156:0/2491700117 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c011830 con 0x7f4d340a1340 2023-09-30T22:24:15.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.745+0000 7f4d32ffd700 1 -- 172.21.15.156:0/2491700117 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c011990 con 0x7f4d340a1340 2023-09-30T22:24:15.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.745+0000 7f4d32ffd700 1 -- 172.21.15.156:0/2491700117 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c011d20 con 0x7f4d340a1340 2023-09-30T22:24:15.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.745+0000 7f4d3a88c700 1 -- 172.21.15.156:0/2491700117 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d340a1340 msgr2=0x7f4d3412ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.745+0000 7f4d3a88c700 1 --2- 172.21.15.156:0/2491700117 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d340a1340 0x7f4d3412ff60 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c009840 tx=0x7f4d1c009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:15.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.745+0000 7f4d3a88c700 1 -- 172.21.15.156:0/2491700117 shutdown_connections 2023-09-30T22:24:15.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.745+0000 7f4d3a88c700 1 --2- 172.21.15.156:0/2491700117 >> v2:172.21.15.156:3300/0 conn(0x7f4d340a0a30 0x7f4d340a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.745+0000 7f4d3a88c700 1 --2- 172.21.15.156:0/2491700117 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d340a1340 0x7f4d3412ff60 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.745+0000 7f4d3a88c700 1 -- 172.21.15.156:0/2491700117 >> 172.21.15.156:0/2491700117 conn(0x7f4d340a2980 msgr2=0x7f4d340a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:15.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.745+0000 7f4d3a88c700 1 -- 172.21.15.156:0/2491700117 shutdown_connections 2023-09-30T22:24:15.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.745+0000 7f4d3a88c700 1 -- 172.21.15.156:0/2491700117 wait complete. 2023-09-30T22:24:15.749 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:15.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.746+0000 7f4d3a88c700 1 Processor -- start 2023-09-30T22:24:15.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.746+0000 7f4d3a88c700 1 -- start start 2023-09-30T22:24:15.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.747+0000 7f4d3a88c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d340a0a30 0x7f4d34118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.747+0000 7f4d3a88c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d340a1340 0x7f4d34119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.747+0000 7f4d3a88c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d341304a0 0x7f4d34119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.747+0000 7f4d3a88c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3411a9f0 con 0x7f4d340a1340 2023-09-30T22:24:15.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.747+0000 7f4d3a88c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3409fa90 con 0x7f4d341304a0 2023-09-30T22:24:15.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.747+0000 7f4d3a88c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3409ae00 con 0x7f4d340a0a30 2023-09-30T22:24:15.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.747+0000 7f4d337fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d340a1340 0x7f4d34119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.747+0000 7f4d33fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d340a0a30 0x7f4d34118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.747+0000 7f4d337fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d340a1340 0x7f4d34119330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60578/0 (socket says 172.21.15.156:60578) 2023-09-30T22:24:15.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.747+0000 7f4d38e29700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d341304a0 0x7f4d34119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.747+0000 7f4d337fe700 1 -- 172.21.15.156:0/971459383 learned_addr learned my addr 172.21.15.156:0/971459383 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:15.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.747+0000 7f4d337fe700 1 -- 172.21.15.156:0/971459383 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d340a0a30 msgr2=0x7f4d34118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.747+0000 7f4d337fe700 1 --2- 172.21.15.156:0/971459383 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d340a0a30 0x7f4d34118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.747+0000 7f4d337fe700 1 -- 172.21.15.156:0/971459383 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d341304a0 msgr2=0x7f4d34119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.747+0000 7f4d337fe700 1 --2- 172.21.15.156:0/971459383 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d341304a0 0x7f4d34119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.747+0000 7f4d337fe700 1 -- 172.21.15.156:0/971459383 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d24009430 con 0x7f4d340a1340 2023-09-30T22:24:15.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.747+0000 7f4d33fff700 1 --2- 172.21.15.156:0/971459383 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d340a0a30 0x7f4d34118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:15.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.747+0000 7f4d38e29700 1 --2- 172.21.15.156:0/971459383 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d341304a0 0x7f4d34119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:15.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.747+0000 7f4d337fe700 1 --2- 172.21.15.156:0/971459383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d340a1340 0x7f4d34119330 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c009fd0 tx=0x7f4d1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:15.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.747+0000 7f4d30ff9700 1 -- 172.21.15.156:0/971459383 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0036a0 con 0x7f4d340a1340 2023-09-30T22:24:15.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.747+0000 7f4d30ff9700 1 -- 172.21.15.156:0/971459383 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c01f070 con 0x7f4d340a1340 2023-09-30T22:24:15.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.747+0000 7f4d3a88c700 1 -- 172.21.15.156:0/971459383 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d1c0094a0 con 0x7f4d340a1340 2023-09-30T22:24:15.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.747+0000 7f4d30ff9700 1 -- 172.21.15.156:0/971459383 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c003a60 con 0x7f4d340a1340 2023-09-30T22:24:15.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.747+0000 7f4d3a88c700 1 -- 172.21.15.156:0/971459383 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d3411b340 con 0x7f4d340a1340 2023-09-30T22:24:15.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.748+0000 7f4d30ff9700 1 -- 172.21.15.156:0/971459383 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d1c003bc0 con 0x7f4d340a1340 2023-09-30T22:24:15.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.748+0000 7f4d30ff9700 1 -- 172.21.15.156:0/971459383 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4d1c021070 con 0x7f4d340a1340 2023-09-30T22:24:15.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.749+0000 7f4d3a88c700 1 -- 172.21.15.156:0/971459383 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d3411b180 con 0x7f4d340a1340 2023-09-30T22:24:15.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.753+0000 7f4d30ff9700 1 -- 172.21.15.156:0/971459383 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d1c0253e0 con 0x7f4d340a1340 2023-09-30T22:24:15.798 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:15.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.882+0000 7f38ca4d6700 1 Processor -- start 2023-09-30T22:24:15.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.882+0000 7f38ca4d6700 1 -- start start 2023-09-30T22:24:15.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.882+0000 7f38ca4d6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f38c409f430 0x7f38c4136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.882+0000 7f38ca4d6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38c4137010 0x7f38c41393f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.882+0000 7f38ca4d6700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c409b6d0 con 0x7f38c409e950 2023-09-30T22:24:15.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.882+0000 7f38ca4d6700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c409afb0 con 0x7f38c409f430 2023-09-30T22:24:15.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.882+0000 7f38ca4d6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c40a0970 con 0x7f38c4137010 2023-09-30T22:24:15.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.882+0000 7f38c37fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f38c409f430 0x7f38c4136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.882+0000 7f38c3fff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f38c409e950 0x7f38c409ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49358/0 (socket says 172.21.15.156:49358) 2023-09-30T22:24:15.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.882+0000 7f38c8a73700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38c4137010 0x7f38c41393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.882+0000 7f38c3fff700 1 -- 172.21.15.156:0/1925228700 learned_addr learned my addr 172.21.15.156:0/1925228700 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:15.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.883+0000 7f38c37fe700 1 -- 172.21.15.156:0/1925228700 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38c4137010 msgr2=0x7f38c41393f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:15.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.883+0000 7f38c37fe700 1 --2- 172.21.15.156:0/1925228700 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38c4137010 0x7f38c41393f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.883+0000 7f38c37fe700 1 -- 172.21.15.156:0/1925228700 >> v1:172.21.15.156:6789/0 conn(0x7f38c409e950 legacy=0x7f38c409ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.883+0000 7f38c2ffd700 1 -- 172.21.15.156:0/1925228700 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 898620487 0 0) 0x7f38c409b6d0 con 0x7f38c409e950 2023-09-30T22:24:15.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.883+0000 7f38c37fe700 1 -- 172.21.15.156:0/1925228700 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c40a0320 con 0x7f38c409f430 2023-09-30T22:24:15.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.883+0000 7f38c8a73700 1 --2- 172.21.15.156:0/1925228700 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38c4137010 0x7f38c41393f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:15.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.883+0000 7f38c37fe700 1 --2- 172.21.15.156:0/1925228700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38c409f430 0x7f38c4136ad0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f38b8009840 tx=0x7f38b8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa47df9e006c907 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:15.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.883+0000 7f38c2ffd700 1 -- 172.21.15.156:0/1925228700 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b8011830 con 0x7f38c409f430 2023-09-30T22:24:15.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.883+0000 7f38c2ffd700 1 -- 172.21.15.156:0/1925228700 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b8011990 con 0x7f38c409f430 2023-09-30T22:24:15.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.883+0000 7f38c2ffd700 1 -- 172.21.15.156:0/1925228700 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b8011d20 con 0x7f38c409f430 2023-09-30T22:24:15.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.884+0000 7f38ca4d6700 1 -- 172.21.15.156:0/1925228700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38c409f430 msgr2=0x7f38c4136ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.884+0000 7f38ca4d6700 1 --2- 172.21.15.156:0/1925228700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38c409f430 0x7f38c4136ad0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f38b8009840 tx=0x7f38b8009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:15.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.884+0000 7f38ca4d6700 1 -- 172.21.15.156:0/1925228700 shutdown_connections 2023-09-30T22:24:15.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.884+0000 7f38ca4d6700 1 --2- 172.21.15.156:0/1925228700 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38c4137010 0x7f38c41393f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.884+0000 7f38ca4d6700 1 --2- 172.21.15.156:0/1925228700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38c409f430 0x7f38c4136ad0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.884+0000 7f38ca4d6700 1 -- 172.21.15.156:0/1925228700 >> 172.21.15.156:0/1925228700 conn(0x7f38c40a0f70 msgr2=0x7f38c40a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:15.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.884+0000 7f38ca4d6700 1 -- 172.21.15.156:0/1925228700 shutdown_connections 2023-09-30T22:24:15.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.884+0000 7f38ca4d6700 1 -- 172.21.15.156:0/1925228700 wait complete. 2023-09-30T22:24:15.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.884+0000 7f38ca4d6700 1 Processor -- start 2023-09-30T22:24:15.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.885+0000 7f38ca4d6700 1 -- start start 2023-09-30T22:24:15.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.885+0000 7f38ca4d6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38c409e950 0x7f38c4122b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.885+0000 7f38ca4d6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38c409f430 0x7f38c41230d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.885+0000 7f38ca4d6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38c4137010 0x7f38c4123610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.885+0000 7f38ca4d6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c409da40 con 0x7f38c4137010 2023-09-30T22:24:15.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.885+0000 7f38ca4d6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c41248d0 con 0x7f38c409e950 2023-09-30T22:24:15.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.885+0000 7f38ca4d6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38c4124fb0 con 0x7f38c409f430 2023-09-30T22:24:15.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.885+0000 7f38c3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38c409e950 0x7f38c4122b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.885+0000 7f38c3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38c409e950 0x7f38c4122b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53610/0 (socket says 172.21.15.156:53610) 2023-09-30T22:24:15.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.885+0000 7f38c3fff700 1 -- 172.21.15.156:0/1254453565 learned_addr learned my addr 172.21.15.156:0/1254453565 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:15.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.885+0000 7f38c37fe700 1 --2- 172.21.15.156:0/1254453565 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38c409f430 0x7f38c41230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.885+0000 7f38c8a73700 1 --2- 172.21.15.156:0/1254453565 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38c4137010 0x7f38c4123610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.886+0000 7f38c3fff700 1 -- 172.21.15.156:0/1254453565 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38c409f430 msgr2=0x7f38c41230d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.886+0000 7f38c3fff700 1 --2- 172.21.15.156:0/1254453565 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38c409f430 0x7f38c41230d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.886+0000 7f38c3fff700 1 -- 172.21.15.156:0/1254453565 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38c4137010 msgr2=0x7f38c4123610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.886+0000 7f38c3fff700 1 --2- 172.21.15.156:0/1254453565 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38c4137010 0x7f38c4123610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.886+0000 7f38c3fff700 1 -- 172.21.15.156:0/1254453565 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38bc009a70 con 0x7f38c409e950 2023-09-30T22:24:15.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.886+0000 7f38c3fff700 1 --2- 172.21.15.156:0/1254453565 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38c409e950 0x7f38c4122b90 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f38b400c700 tx=0x7f38b400ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:15.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.886+0000 7f38c0ff9700 1 -- 172.21.15.156:0/1254453565 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b40074e0 con 0x7f38c409e950 2023-09-30T22:24:15.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.886+0000 7f38c0ff9700 1 -- 172.21.15.156:0/1254453565 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b4007640 con 0x7f38c409e950 2023-09-30T22:24:15.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.886+0000 7f38ca4d6700 1 -- 172.21.15.156:0/1254453565 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b80094a0 con 0x7f38c409e950 2023-09-30T22:24:15.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.886+0000 7f38c0ff9700 1 -- 172.21.15.156:0/1254453565 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b4005a70 con 0x7f38c409e950 2023-09-30T22:24:15.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.886+0000 7f38ca4d6700 1 -- 172.21.15.156:0/1254453565 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c4124cc0 con 0x7f38c409e950 2023-09-30T22:24:15.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.887+0000 7f38c0ff9700 1 -- 172.21.15.156:0/1254453565 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f38b4005bd0 con 0x7f38c409e950 2023-09-30T22:24:15.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.887+0000 7f38ca4d6700 1 -- 172.21.15.156:0/1254453565 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c4136b20 con 0x7f38c409e950 2023-09-30T22:24:15.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.887+0000 7f38c0ff9700 1 -- 172.21.15.156:0/1254453565 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f38b403eaf0 con 0x7f38c409e950 2023-09-30T22:24:15.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.892+0000 7f38c0ff9700 1 -- 172.21.15.156:0/1254453565 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f38b4019c00 con 0x7f38c409e950 2023-09-30T22:24:15.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.926+0000 7f4930707700 1 Processor -- start 2023-09-30T22:24:15.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.926+0000 7f4930707700 1 -- start start 2023-09-30T22:24:15.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.926+0000 7f4930707700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f492809e870 0x7f492809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.926+0000 7f4930707700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f492809f180 0x7f4928131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.926+0000 7f4930707700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f492809c970 con 0x7f4928131d70 2023-09-30T22:24:15.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.926+0000 7f4930707700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49280a0920 con 0x7f492809f180 2023-09-30T22:24:15.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.926+0000 7f4930707700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f492809f9c0 con 0x7f492809e870 2023-09-30T22:24:15.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.926+0000 7f492dca2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f492809f180 0x7f4928131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.926+0000 7f492eca4700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4928131d70 0x7f4928138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49368/0 (socket says 172.21.15.156:49368) 2023-09-30T22:24:15.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.927+0000 7f492eca4700 1 -- 172.21.15.156:0/339010404 learned_addr learned my addr 172.21.15.156:0/339010404 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:15.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.927+0000 7f492e4a3700 1 --2- 172.21.15.156:0/339010404 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f492809e870 0x7f492809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.927+0000 7f492dca2700 1 -- 172.21.15.156:0/339010404 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f492809e870 msgr2=0x7f492809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:15.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.927+0000 7f492dca2700 1 --2- 172.21.15.156:0/339010404 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f492809e870 0x7f492809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.927+0000 7f492dca2700 1 -- 172.21.15.156:0/339010404 >> v1:172.21.15.156:6789/0 conn(0x7f4928131d70 legacy=0x7f4928138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.927+0000 7f492d4a1700 1 -- 172.21.15.156:0/339010404 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3435883749 0 0) 0x7f492809c970 con 0x7f4928131d70 2023-09-30T22:24:15.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.927+0000 7f492dca2700 1 -- 172.21.15.156:0/339010404 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492809bab0 con 0x7f492809f180 2023-09-30T22:24:15.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.927+0000 7f492e4a3700 1 --2- 172.21.15.156:0/339010404 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f492809e870 0x7f492809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:15.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.927+0000 7f492dca2700 1 --2- 172.21.15.156:0/339010404 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f492809f180 0x7f4928131830 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4918009870 tx=0x7f4918009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=570faa662ebad37 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:15.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.927+0000 7f492d4a1700 1 -- 172.21.15.156:0/339010404 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4918011830 con 0x7f492809f180 2023-09-30T22:24:15.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.927+0000 7f492d4a1700 1 -- 172.21.15.156:0/339010404 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4918011990 con 0x7f492809f180 2023-09-30T22:24:15.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.927+0000 7f492d4a1700 1 -- 172.21.15.156:0/339010404 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4918011d20 con 0x7f492809f180 2023-09-30T22:24:15.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.928+0000 7f4930707700 1 -- 172.21.15.156:0/339010404 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f492809f180 msgr2=0x7f4928131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.928+0000 7f4930707700 1 --2- 172.21.15.156:0/339010404 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f492809f180 0x7f4928131830 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4918009870 tx=0x7f4918009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:15.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.928+0000 7f4930707700 1 -- 172.21.15.156:0/339010404 shutdown_connections 2023-09-30T22:24:15.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.928+0000 7f4930707700 1 --2- 172.21.15.156:0/339010404 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f492809e870 0x7f492809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.928+0000 7f4930707700 1 --2- 172.21.15.156:0/339010404 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f492809f180 0x7f4928131830 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.928+0000 7f4930707700 1 -- 172.21.15.156:0/339010404 >> 172.21.15.156:0/339010404 conn(0x7f49280a4430 msgr2=0x7f49280a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:15.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.928+0000 7f4930707700 1 -- 172.21.15.156:0/339010404 shutdown_connections 2023-09-30T22:24:15.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.928+0000 7f4930707700 1 -- 172.21.15.156:0/339010404 wait complete. 2023-09-30T22:24:15.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.929+0000 7f4930707700 1 Processor -- start 2023-09-30T22:24:15.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.929+0000 7f4930707700 1 -- start start 2023-09-30T22:24:15.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.929+0000 7f4930707700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f492809e870 0x7f492811f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.929+0000 7f4930707700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f492809f180 0x7f492811f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.929+0000 7f4930707700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4928131d70 0x7f492811fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.929+0000 7f4930707700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4928120cf0 con 0x7f4928131d70 2023-09-30T22:24:15.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.929+0000 7f4930707700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4928121b80 con 0x7f492809f180 2023-09-30T22:24:15.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.929+0000 7f4930707700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4928122660 con 0x7f492809e870 2023-09-30T22:24:15.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.929+0000 7f492e4a3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f492809e870 0x7f492811f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.929+0000 7f492e4a3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f492809e870 0x7f492811f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52530/0 (socket says 172.21.15.156:52530) 2023-09-30T22:24:15.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.929+0000 7f492dca2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f492809f180 0x7f492811f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.929+0000 7f492e4a3700 1 -- 172.21.15.156:0/542564166 learned_addr learned my addr 172.21.15.156:0/542564166 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:15.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.930+0000 7f492eca4700 1 --2- 172.21.15.156:0/542564166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4928131d70 0x7f492811fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.930+0000 7f492dca2700 1 -- 172.21.15.156:0/542564166 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f492809e870 msgr2=0x7f492811f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.930+0000 7f492dca2700 1 --2- 172.21.15.156:0/542564166 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f492809e870 0x7f492811f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.930+0000 7f492dca2700 1 -- 172.21.15.156:0/542564166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4928131d70 msgr2=0x7f492811fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.930+0000 7f492dca2700 1 --2- 172.21.15.156:0/542564166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4928131d70 0x7f492811fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.930+0000 7f492dca2700 1 -- 172.21.15.156:0/542564166 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49240094a0 con 0x7f492809f180 2023-09-30T22:24:15.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.930+0000 7f492dca2700 1 --2- 172.21.15.156:0/542564166 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f492809f180 0x7f492811f620 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4918016000 tx=0x7f4918004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:15.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.930+0000 7f491effd700 1 -- 172.21.15.156:0/542564166 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4918004590 con 0x7f492809f180 2023-09-30T22:24:15.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.930+0000 7f491effd700 1 -- 172.21.15.156:0/542564166 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491801f070 con 0x7f492809f180 2023-09-30T22:24:15.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.930+0000 7f491effd700 1 -- 172.21.15.156:0/542564166 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49180038e0 con 0x7f492809f180 2023-09-30T22:24:15.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.930+0000 7f4930707700 1 -- 172.21.15.156:0/542564166 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49180094a0 con 0x7f492809f180 2023-09-30T22:24:15.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.930+0000 7f4930707700 1 -- 172.21.15.156:0/542564166 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f492809dba0 con 0x7f492809f180 2023-09-30T22:24:15.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.931+0000 7f491effd700 1 -- 172.21.15.156:0/542564166 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4918003a40 con 0x7f492809f180 2023-09-30T22:24:15.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.931+0000 7f4930707700 1 -- 172.21.15.156:0/542564166 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f492811be60 con 0x7f492809f180 2023-09-30T22:24:15.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.931+0000 7f491effd700 1 -- 172.21.15.156:0/542564166 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4918021070 con 0x7f492809f180 2023-09-30T22:24:15.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.936+0000 7f491effd700 1 -- 172.21.15.156:0/542564166 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f491802f3a0 con 0x7f492809f180 2023-09-30T22:24:15.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.953+0000 7f4d3a88c700 1 -- 172.21.15.156:0/971459383 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4d3404f2a0 con 0x7f4d340a1340 2023-09-30T22:24:15.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.954+0000 7f4d30ff9700 1 -- 172.21.15.156:0/971459383 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4d1c015020 con 0x7f4d340a1340 2023-09-30T22:24:15.954 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:15.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.956+0000 7f4d3a88c700 1 -- 172.21.15.156:0/971459383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d340a1340 msgr2=0x7f4d34119330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.956+0000 7f4d3a88c700 1 --2- 172.21.15.156:0/971459383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d340a1340 0x7f4d34119330 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c009fd0 tx=0x7f4d1c004750 comp rx=0 tx=0).stop 2023-09-30T22:24:15.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.956+0000 7f4d3a88c700 1 -- 172.21.15.156:0/971459383 shutdown_connections 2023-09-30T22:24:15.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.956+0000 7f4d3a88c700 1 --2- 172.21.15.156:0/971459383 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4d341304a0 0x7f4d34119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.956+0000 7f4d3a88c700 1 --2- 172.21.15.156:0/971459383 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4d340a0a30 0x7f4d34118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.956+0000 7f4d3a88c700 1 --2- 172.21.15.156:0/971459383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d340a1340 0x7f4d34119330 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.956+0000 7f4d3a88c700 1 -- 172.21.15.156:0/971459383 >> 172.21.15.156:0/971459383 conn(0x7f4d340a2980 msgr2=0x7f4d3409e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:15.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.956+0000 7f4d3a88c700 1 -- 172.21.15.156:0/971459383 shutdown_connections 2023-09-30T22:24:15.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:15.956+0000 7f4d3a88c700 1 -- 172.21.15.156:0/971459383 wait complete. 2023-09-30T22:24:15.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:16.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.085+0000 7f38ca4d6700 1 -- 172.21.15.156:0/1254453565 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f38c404f2a0 con 0x7f38c409e950 2023-09-30T22:24:16.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.086+0000 7f38c0ff9700 1 -- 172.21.15.156:0/1254453565 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f38b400f260 con 0x7f38c409e950 2023-09-30T22:24:16.087 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:16.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.088+0000 7f38ca4d6700 1 -- 172.21.15.156:0/1254453565 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38c409e950 msgr2=0x7f38c4122b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:16.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.088+0000 7f38ca4d6700 1 --2- 172.21.15.156:0/1254453565 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38c409e950 0x7f38c4122b90 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f38b400c700 tx=0x7f38b400ca10 comp rx=0 tx=0).stop 2023-09-30T22:24:16.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.088+0000 7f38ca4d6700 1 -- 172.21.15.156:0/1254453565 shutdown_connections 2023-09-30T22:24:16.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.088+0000 7f38ca4d6700 1 --2- 172.21.15.156:0/1254453565 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38c4137010 0x7f38c4123610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.088+0000 7f38ca4d6700 1 --2- 172.21.15.156:0/1254453565 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f38c409e950 0x7f38c4122b90 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.088+0000 7f38ca4d6700 1 --2- 172.21.15.156:0/1254453565 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f38c409f430 0x7f38c41230d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.088+0000 7f38ca4d6700 1 -- 172.21.15.156:0/1254453565 >> 172.21.15.156:0/1254453565 conn(0x7f38c40a0f70 msgr2=0x7f38c40a3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:16.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.088+0000 7f38ca4d6700 1 -- 172.21.15.156:0/1254453565 shutdown_connections 2023-09-30T22:24:16.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.088+0000 7f38ca4d6700 1 -- 172.21.15.156:0/1254453565 wait complete. 2023-09-30T22:24:16.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:16.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.125+0000 7f4930707700 1 -- 172.21.15.156:0/542564166 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f492804f2a0 con 0x7f492809f180 2023-09-30T22:24:16.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.125+0000 7f491effd700 1 -- 172.21.15.156:0/542564166 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f491802b070 con 0x7f492809f180 2023-09-30T22:24:16.126 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:16.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.127+0000 7f4930707700 1 -- 172.21.15.156:0/542564166 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f492809f180 msgr2=0x7f492811f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:16.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.127+0000 7f4930707700 1 --2- 172.21.15.156:0/542564166 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f492809f180 0x7f492811f620 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4918016000 tx=0x7f4918004750 comp rx=0 tx=0).stop 2023-09-30T22:24:16.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.127+0000 7f4930707700 1 -- 172.21.15.156:0/542564166 shutdown_connections 2023-09-30T22:24:16.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.127+0000 7f4930707700 1 --2- 172.21.15.156:0/542564166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4928131d70 0x7f492811fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.127+0000 7f4930707700 1 --2- 172.21.15.156:0/542564166 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f492809e870 0x7f492811f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.127+0000 7f4930707700 1 --2- 172.21.15.156:0/542564166 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f492809f180 0x7f492811f620 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.127+0000 7f4930707700 1 -- 172.21.15.156:0/542564166 >> 172.21.15.156:0/542564166 conn(0x7f49280a4430 msgr2=0x7f4928131040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:16.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.128+0000 7f4930707700 1 -- 172.21.15.156:0/542564166 shutdown_connections 2023-09-30T22:24:16.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.128+0000 7f4930707700 1 -- 172.21.15.156:0/542564166 wait complete. 2023-09-30T22:24:16.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:16.419 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:16.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.541+0000 7f1d4dcdd700 1 Processor -- start 2023-09-30T22:24:16.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.541+0000 7f1d4dcdd700 1 -- start start 2023-09-30T22:24:16.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.541+0000 7f1d4dcdd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d4806a770 0x7f1d48130560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:16.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.541+0000 7f1d4dcdd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1d4812ffb0 0x7f1d48130aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:16.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.541+0000 7f1d4dcdd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d48133520 0x7f1d481339c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:16.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.541+0000 7f1d4dcdd700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d4806ab40 con 0x7f1d4812ffb0 2023-09-30T22:24:16.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.541+0000 7f1d4dcdd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4809b000 con 0x7f1d4806a770 2023-09-30T22:24:16.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.541+0000 7f1d4dcdd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4812da50 con 0x7f1d48133520 2023-09-30T22:24:16.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.541+0000 7f1d46ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1d4812ffb0 0x7f1d48130aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:16.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.541+0000 7f1d477fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d4806a770 0x7f1d48130560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:16.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.541+0000 7f1d47fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d48133520 0x7f1d481339c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:16.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.541+0000 7f1d46ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1d4812ffb0 0x7f1d48130aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60610/0 (socket says 172.21.15.156:60610) 2023-09-30T22:24:16.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.541+0000 7f1d46ffd700 1 -- 172.21.15.156:0/1146437022 learned_addr learned my addr 172.21.15.156:0/1146437022 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:16.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.541+0000 7f1d477fe700 1 --2- 172.21.15.156:0/1146437022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d4806a770 0x7f1d48130560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53618/0 (socket says 172.21.15.156:53618) 2023-09-30T22:24:16.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.542+0000 7f1d46ffd700 1 -- 172.21.15.156:0/1146437022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d48133520 msgr2=0x7f1d481339c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:16.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.542+0000 7f1d46ffd700 1 --2- 172.21.15.156:0/1146437022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d48133520 0x7f1d481339c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.542+0000 7f1d46ffd700 1 -- 172.21.15.156:0/1146437022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d4806a770 msgr2=0x7f1d48130560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:16.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.542+0000 7f1d46ffd700 1 --2- 172.21.15.156:0/1146437022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d4806a770 0x7f1d48130560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.542+0000 7f1d46ffd700 1 -- 172.21.15.156:0/1146437022 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4806b0a0 con 0x7f1d4812ffb0 2023-09-30T22:24:16.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.542+0000 7f1d477fe700 1 --2- 172.21.15.156:0/1146437022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d4806a770 0x7f1d48130560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:16.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.542+0000 7f1d46ffd700 1 --2- 172.21.15.156:0/1146437022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d4812ffb0 0x7f1d48130aa0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009920 tx=0x7f1d3c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42de7bc4ada69f7d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:16.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.542+0000 7f1d467fc700 1 -- 172.21.15.156:0/1146437022 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c011830 con 0x7f1d4812ffb0 2023-09-30T22:24:16.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.542+0000 7f1d467fc700 1 -- 172.21.15.156:0/1146437022 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3c011990 con 0x7f1d4812ffb0 2023-09-30T22:24:16.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.542+0000 7f1d467fc700 1 -- 172.21.15.156:0/1146437022 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c011d20 con 0x7f1d4812ffb0 2023-09-30T22:24:16.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.542+0000 7f1d4dcdd700 1 -- 172.21.15.156:0/1146437022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d4812ffb0 msgr2=0x7f1d48130aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:16.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.542+0000 7f1d4dcdd700 1 --2- 172.21.15.156:0/1146437022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d4812ffb0 0x7f1d48130aa0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009920 tx=0x7f1d3c009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:16.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.542+0000 7f1d4dcdd700 1 -- 172.21.15.156:0/1146437022 shutdown_connections 2023-09-30T22:24:16.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.542+0000 7f1d4dcdd700 1 --2- 172.21.15.156:0/1146437022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d48133520 0x7f1d481339c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.542+0000 7f1d4dcdd700 1 --2- 172.21.15.156:0/1146437022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d4806a770 0x7f1d48130560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.542+0000 7f1d4dcdd700 1 --2- 172.21.15.156:0/1146437022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d4812ffb0 0x7f1d48130aa0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.542+0000 7f1d4dcdd700 1 -- 172.21.15.156:0/1146437022 >> 172.21.15.156:0/1146437022 conn(0x7f1d480a2ef0 msgr2=0x7f1d480a32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:16.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.543+0000 7f1d4dcdd700 1 -- 172.21.15.156:0/1146437022 shutdown_connections 2023-09-30T22:24:16.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.543+0000 7f1d4dcdd700 1 -- 172.21.15.156:0/1146437022 wait complete. 2023-09-30T22:24:16.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.543+0000 7f1d4dcdd700 1 Processor -- start 2023-09-30T22:24:16.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.544+0000 7f1d4dcdd700 1 -- start start 2023-09-30T22:24:16.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.544+0000 7f1d4dcdd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d4806a770 0x7f1d4806f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:16.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.544+0000 7f1d4dcdd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d4812ffb0 0x7f1d4806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:16.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.544+0000 7f1d4dcdd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d48133520 0x7f1d4806fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:16.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.544+0000 7f1d4dcdd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d48072610 con 0x7f1d4812ffb0 2023-09-30T22:24:16.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.544+0000 7f1d4dcdd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d48071780 con 0x7f1d4806a770 2023-09-30T22:24:16.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.544+0000 7f1d4dcdd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d48070540 con 0x7f1d48133520 2023-09-30T22:24:16.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.544+0000 7f1d477fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d4806a770 0x7f1d4806f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:16.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.544+0000 7f1d46ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d4812ffb0 0x7f1d4806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:16.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.544+0000 7f1d477fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d4806a770 0x7f1d4806f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53632/0 (socket says 172.21.15.156:53632) 2023-09-30T22:24:16.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.544+0000 7f1d477fe700 1 -- 172.21.15.156:0/2333167353 learned_addr learned my addr 172.21.15.156:0/2333167353 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:16.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.544+0000 7f1d47fff700 1 --2- 172.21.15.156:0/2333167353 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d48133520 0x7f1d4806fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:16.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.544+0000 7f1d46ffd700 1 -- 172.21.15.156:0/2333167353 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d48133520 msgr2=0x7f1d4806fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:16.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.544+0000 7f1d46ffd700 1 --2- 172.21.15.156:0/2333167353 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d48133520 0x7f1d4806fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.544+0000 7f1d46ffd700 1 -- 172.21.15.156:0/2333167353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d4806a770 msgr2=0x7f1d4806f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:16.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.544+0000 7f1d46ffd700 1 --2- 172.21.15.156:0/2333167353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d4806a770 0x7f1d4806f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.544+0000 7f1d46ffd700 1 -- 172.21.15.156:0/2333167353 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d38011d40 con 0x7f1d4812ffb0 2023-09-30T22:24:16.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.544+0000 7f1d477fe700 1 --2- 172.21.15.156:0/2333167353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d4806a770 0x7f1d4806f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:16.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.545+0000 7f1d46ffd700 1 --2- 172.21.15.156:0/2333167353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d4812ffb0 0x7f1d4806f5d0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f1d4806e520 tx=0x7f1d3c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:16.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.545+0000 7f1d2ffff700 1 -- 172.21.15.156:0/2333167353 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c004450 con 0x7f1d4812ffb0 2023-09-30T22:24:16.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.545+0000 7f1d2ffff700 1 -- 172.21.15.156:0/2333167353 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3c01f070 con 0x7f1d4812ffb0 2023-09-30T22:24:16.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.545+0000 7f1d4dcdd700 1 -- 172.21.15.156:0/2333167353 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d3c009550 con 0x7f1d4812ffb0 2023-09-30T22:24:16.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.545+0000 7f1d2ffff700 1 -- 172.21.15.156:0/2333167353 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c0045f0 con 0x7f1d4812ffb0 2023-09-30T22:24:16.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.545+0000 7f1d4dcdd700 1 -- 172.21.15.156:0/2333167353 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d48071f40 con 0x7f1d4812ffb0 2023-09-30T22:24:16.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.545+0000 7f1d2ffff700 1 -- 172.21.15.156:0/2333167353 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1d3c0038e0 con 0x7f1d4812ffb0 2023-09-30T22:24:16.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.546+0000 7f1d2ffff700 1 -- 172.21.15.156:0/2333167353 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1d3c021070 con 0x7f1d4812ffb0 2023-09-30T22:24:16.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.546+0000 7f1d4dcdd700 1 -- 172.21.15.156:0/2333167353 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4804f2a0 con 0x7f1d4812ffb0 2023-09-30T22:24:16.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.550+0000 7f1d2ffff700 1 -- 172.21.15.156:0/2333167353 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d3c015030 con 0x7f1d4812ffb0 2023-09-30T22:24:16.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.736+0000 7f1d4dcdd700 1 -- 172.21.15.156:0/2333167353 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1d4806c300 con 0x7f1d4812ffb0 2023-09-30T22:24:16.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.737+0000 7f1d2ffff700 1 -- 172.21.15.156:0/2333167353 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1d3c01a7b0 con 0x7f1d4812ffb0 2023-09-30T22:24:16.738 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:16.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.739+0000 7f1d4dcdd700 1 -- 172.21.15.156:0/2333167353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d4812ffb0 msgr2=0x7f1d4806f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:16.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.739+0000 7f1d4dcdd700 1 --2- 172.21.15.156:0/2333167353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d4812ffb0 0x7f1d4806f5d0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f1d4806e520 tx=0x7f1d3c004750 comp rx=0 tx=0).stop 2023-09-30T22:24:16.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.739+0000 7f1d4dcdd700 1 -- 172.21.15.156:0/2333167353 shutdown_connections 2023-09-30T22:24:16.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.739+0000 7f1d4dcdd700 1 --2- 172.21.15.156:0/2333167353 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1d48133520 0x7f1d4806fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.739+0000 7f1d4dcdd700 1 --2- 172.21.15.156:0/2333167353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1d4806a770 0x7f1d4806f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.739+0000 7f1d4dcdd700 1 --2- 172.21.15.156:0/2333167353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d4812ffb0 0x7f1d4806f5d0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.739+0000 7f1d4dcdd700 1 -- 172.21.15.156:0/2333167353 >> 172.21.15.156:0/2333167353 conn(0x7f1d480a2ef0 msgr2=0x7f1d480a24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:16.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.739+0000 7f1d4dcdd700 1 -- 172.21.15.156:0/2333167353 shutdown_connections 2023-09-30T22:24:16.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:16.739+0000 7f1d4dcdd700 1 -- 172.21.15.156:0/2333167353 wait complete. 2023-09-30T22:24:16.752 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:16.970 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:17.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.092+0000 7fb06d998700 1 Processor -- start 2023-09-30T22:24:17.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.092+0000 7fb06d998700 1 -- start start 2023-09-30T22:24:17.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.093+0000 7fb06d998700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb068131980 0x7fb068131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:17.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.093+0000 7fb06d998700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb06809bc70 0x7fb06809c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:17.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.093+0000 7fb06d998700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0680a1640 con 0x7fb06809c5c0 2023-09-30T22:24:17.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.093+0000 7fb06d998700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb06806eb30 con 0x7fb068131980 2023-09-30T22:24:17.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.093+0000 7fb06d998700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0680a22d0 con 0x7fb06809bc70 2023-09-30T22:24:17.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.093+0000 7fb0667fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb06809bc70 0x7fb06809c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:17.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.093+0000 7fb066ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb068131980 0x7fb068131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:17.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.093+0000 7fb0677fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb06809c5c0 0x7fb068138700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49370/0 (socket says 172.21.15.156:49370) 2023-09-30T22:24:17.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.093+0000 7fb0677fe700 1 -- 172.21.15.156:0/2218478795 learned_addr learned my addr 172.21.15.156:0/2218478795 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:17.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.093+0000 7fb0667fc700 1 -- 172.21.15.156:0/2218478795 >> v2:172.21.15.156:3300/0 conn(0x7fb068131980 msgr2=0x7fb068131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:17.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.093+0000 7fb0667fc700 1 --2- 172.21.15.156:0/2218478795 >> v2:172.21.15.156:3300/0 conn(0x7fb068131980 0x7fb068131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.093+0000 7fb0667fc700 1 -- 172.21.15.156:0/2218478795 >> v1:172.21.15.156:6789/0 conn(0x7fb06809c5c0 legacy=0x7fb068138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:17.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.093+0000 7fb0667fc700 1 -- 172.21.15.156:0/2218478795 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb068131550 con 0x7fb06809bc70 2023-09-30T22:24:17.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.093+0000 7fb066ffd700 1 --2- 172.21.15.156:0/2218478795 >> v2:172.21.15.156:3300/0 conn(0x7fb068131980 0x7fb068131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:17.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.093+0000 7fb0667fc700 1 --2- 172.21.15.156:0/2218478795 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb06809bc70 0x7fb06809c080 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb058009840 tx=0x7fb058009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc2a3f208287b5b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:17.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.093+0000 7fb065ffb700 1 -- 172.21.15.156:0/2218478795 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058011830 con 0x7fb06809bc70 2023-09-30T22:24:17.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.093+0000 7fb065ffb700 1 -- 172.21.15.156:0/2218478795 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb058011990 con 0x7fb06809bc70 2023-09-30T22:24:17.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.093+0000 7fb065ffb700 1 -- 172.21.15.156:0/2218478795 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058011d20 con 0x7fb06809bc70 2023-09-30T22:24:17.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.094+0000 7fb06d998700 1 -- 172.21.15.156:0/2218478795 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb06809bc70 msgr2=0x7fb06809c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:17.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.094+0000 7fb06d998700 1 --2- 172.21.15.156:0/2218478795 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb06809bc70 0x7fb06809c080 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb058009840 tx=0x7fb058009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:17.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.094+0000 7fb06d998700 1 -- 172.21.15.156:0/2218478795 shutdown_connections 2023-09-30T22:24:17.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.094+0000 7fb06d998700 1 --2- 172.21.15.156:0/2218478795 >> v2:172.21.15.156:3300/0 conn(0x7fb068131980 0x7fb068131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.094+0000 7fb06d998700 1 --2- 172.21.15.156:0/2218478795 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb06809bc70 0x7fb06809c080 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.094+0000 7fb06d998700 1 -- 172.21.15.156:0/2218478795 >> 172.21.15.156:0/2218478795 conn(0x7fb0680a2980 msgr2=0x7fb0680a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:17.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.094+0000 7fb06d998700 1 -- 172.21.15.156:0/2218478795 shutdown_connections 2023-09-30T22:24:17.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.094+0000 7fb06d998700 1 -- 172.21.15.156:0/2218478795 wait complete. 2023-09-30T22:24:17.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.095+0000 7fb06d998700 1 Processor -- start 2023-09-30T22:24:17.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.095+0000 7fb06d998700 1 -- start start 2023-09-30T22:24:17.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.095+0000 7fb06d998700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb06809bc70 0x7fb06811b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:17.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.095+0000 7fb06d998700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb06809c5c0 0x7fb06811bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:17.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.095+0000 7fb06d998700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb068131980 0x7fb06811c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:17.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.095+0000 7fb06d998700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06811fb30 con 0x7fb068131980 2023-09-30T22:24:17.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.095+0000 7fb06d998700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06811d300 con 0x7fb06809bc70 2023-09-30T22:24:17.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.095+0000 7fb06d998700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb06811ee90 con 0x7fb06809c5c0 2023-09-30T22:24:17.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.096+0000 7fb0677fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb068131980 0x7fb06811c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:17.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.096+0000 7fb0667fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb06809c5c0 0x7fb06811bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:17.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.096+0000 7fb066ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb06809bc70 0x7fb06811b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:17.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.096+0000 7fb0667fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb06809c5c0 0x7fb06811bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52574/0 (socket says 172.21.15.156:52574) 2023-09-30T22:24:17.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.096+0000 7fb0677fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb068131980 0x7fb06811c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60630/0 (socket says 172.21.15.156:60630) 2023-09-30T22:24:17.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.096+0000 7fb0667fc700 1 -- 172.21.15.156:0/740332619 learned_addr learned my addr 172.21.15.156:0/740332619 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:17.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.096+0000 7fb066ffd700 1 -- 172.21.15.156:0/740332619 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb06809c5c0 msgr2=0x7fb06811bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:17.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.096+0000 7fb066ffd700 1 --2- 172.21.15.156:0/740332619 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb06809c5c0 0x7fb06811bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.096+0000 7fb066ffd700 1 -- 172.21.15.156:0/740332619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb068131980 msgr2=0x7fb06811c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:17.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.096+0000 7fb066ffd700 1 --2- 172.21.15.156:0/740332619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb068131980 0x7fb06811c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.096+0000 7fb066ffd700 1 -- 172.21.15.156:0/740332619 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05c009430 con 0x7fb06809bc70 2023-09-30T22:24:17.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.096+0000 7fb0677fe700 1 --2- 172.21.15.156:0/740332619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb068131980 0x7fb06811c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:17.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.096+0000 7fb0667fc700 1 --2- 172.21.15.156:0/740332619 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb06809c5c0 0x7fb06811bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:17.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.096+0000 7fb066ffd700 1 --2- 172.21.15.156:0/740332619 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb06809bc70 0x7fb06811b650 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb05c00e9b0 tx=0x7fb05c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:17.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.096+0000 7fb04ffff700 1 -- 172.21.15.156:0/740332619 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05c00ee50 con 0x7fb06809bc70 2023-09-30T22:24:17.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.096+0000 7fb04ffff700 1 -- 172.21.15.156:0/740332619 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05c005a20 con 0x7fb06809bc70 2023-09-30T22:24:17.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.096+0000 7fb04ffff700 1 -- 172.21.15.156:0/740332619 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05c005db0 con 0x7fb06809bc70 2023-09-30T22:24:17.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.096+0000 7fb06d998700 1 -- 172.21.15.156:0/740332619 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0580094a0 con 0x7fb06809bc70 2023-09-30T22:24:17.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.096+0000 7fb06d998700 1 -- 172.21.15.156:0/740332619 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb06811e4b0 con 0x7fb06809bc70 2023-09-30T22:24:17.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.097+0000 7fb04ffff700 1 -- 172.21.15.156:0/740332619 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb05c00c850 con 0x7fb06809bc70 2023-09-30T22:24:17.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.097+0000 7fb04ffff700 1 -- 172.21.15.156:0/740332619 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb05c03f9d0 con 0x7fb06809bc70 2023-09-30T22:24:17.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.097+0000 7fb06d998700 1 -- 172.21.15.156:0/740332619 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb06804f2a0 con 0x7fb06809bc70 2023-09-30T22:24:17.102 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:17.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.102+0000 7fb04ffff700 1 -- 172.21.15.156:0/740332619 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb05c020020 con 0x7fb06809bc70 2023-09-30T22:24:17.141 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:17.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.229+0000 7f25a7565700 1 Processor -- start 2023-09-30T22:24:17.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.230+0000 7f25a7565700 1 -- start start 2023-09-30T22:24:17.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.230+0000 7f25a7565700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25a00a0a70 0x7f25a00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:17.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.230+0000 7f25a7565700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f25a00a1380 0x7f25a0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:17.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.230+0000 7f25a7565700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a009dc00 con 0x7f25a0133f50 2023-09-30T22:24:17.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.230+0000 7f25a7565700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a009ea60 con 0x7f25a00a1380 2023-09-30T22:24:17.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.230+0000 7f25a7565700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25a009dec0 con 0x7f25a00a0a70 2023-09-30T22:24:17.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.230+0000 7f25a4b00700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f25a00a1380 0x7f25a0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:17.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.230+0000 7f25a5301700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25a00a0a70 0x7f25a00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:17.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.230+0000 7f25a4b00700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f25a00a1380 0x7f25a0133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60642/0 (socket says 172.21.15.156:60642) 2023-09-30T22:24:17.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.230+0000 7f25a4b00700 1 -- 172.21.15.156:0/3114573975 learned_addr learned my addr 172.21.15.156:0/3114573975 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:17.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.230+0000 7f25a5301700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25a00a0a70 0x7f25a00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52590/0 (socket says 172.21.15.156:52590) 2023-09-30T22:24:17.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.231+0000 7f25a4b00700 1 -- 172.21.15.156:0/3114573975 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25a00a0a70 msgr2=0x7f25a00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:17.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.231+0000 7f25a4b00700 1 --2- 172.21.15.156:0/3114573975 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25a00a0a70 0x7f25a00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.231+0000 7f25a4b00700 1 -- 172.21.15.156:0/3114573975 >> v1:172.21.15.156:6789/0 conn(0x7f25a0133f50 legacy=0x7f25a013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:17.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.231+0000 7f25a4b00700 1 -- 172.21.15.156:0/3114573975 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a009e6a0 con 0x7f25a00a1380 2023-09-30T22:24:17.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.231+0000 7f25a5301700 1 --2- 172.21.15.156:0/3114573975 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25a00a0a70 0x7f25a00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:17.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.231+0000 7f25a4b00700 1 --2- 172.21.15.156:0/3114573975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25a00a1380 0x7f25a0133a10 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f25900098f0 tx=0x7f2590009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19021926cd7a9594 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:17.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.231+0000 7f2597fff700 1 -- 172.21.15.156:0/3114573975 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2590011830 con 0x7f25a00a1380 2023-09-30T22:24:17.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.231+0000 7f2597fff700 1 -- 172.21.15.156:0/3114573975 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2590011990 con 0x7f25a00a1380 2023-09-30T22:24:17.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.231+0000 7f2597fff700 1 -- 172.21.15.156:0/3114573975 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2590011d20 con 0x7f25a00a1380 2023-09-30T22:24:17.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.231+0000 7f25a7565700 1 -- 172.21.15.156:0/3114573975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25a00a1380 msgr2=0x7f25a0133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:17.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.231+0000 7f25a7565700 1 --2- 172.21.15.156:0/3114573975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25a00a1380 0x7f25a0133a10 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f25900098f0 tx=0x7f2590009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:17.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.232+0000 7f25a7565700 1 -- 172.21.15.156:0/3114573975 shutdown_connections 2023-09-30T22:24:17.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.232+0000 7f25a7565700 1 --2- 172.21.15.156:0/3114573975 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25a00a0a70 0x7f25a00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.232+0000 7f25a7565700 1 --2- 172.21.15.156:0/3114573975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25a00a1380 0x7f25a0133a10 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.232+0000 7f25a7565700 1 -- 172.21.15.156:0/3114573975 >> 172.21.15.156:0/3114573975 conn(0x7f25a00a6610 msgr2=0x7f25a00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:17.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.232+0000 7f25a7565700 1 -- 172.21.15.156:0/3114573975 shutdown_connections 2023-09-30T22:24:17.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.232+0000 7f25a7565700 1 -- 172.21.15.156:0/3114573975 wait complete. 2023-09-30T22:24:17.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.232+0000 7f25a7565700 1 Processor -- start 2023-09-30T22:24:17.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.233+0000 7f25a7565700 1 -- start start 2023-09-30T22:24:17.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.233+0000 7f25a7565700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25a00a0a70 0x7f25a01c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:17.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.233+0000 7f25a7565700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25a00a1380 0x7f25a01c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:17.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.233+0000 7f25a7565700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25a0133f50 0x7f25a01c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:17.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.233+0000 7f25a7565700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a01253f0 con 0x7f25a00a0a70 2023-09-30T22:24:17.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.233+0000 7f25a5301700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25a00a0a70 0x7f25a01c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:17.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.233+0000 7f25a4b00700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25a00a1380 0x7f25a01c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:17.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.233+0000 7f25a5301700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25a00a0a70 0x7f25a01c8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60654/0 (socket says 172.21.15.156:60654) 2023-09-30T22:24:17.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.233+0000 7f25a5301700 1 -- 172.21.15.156:0/3893122639 learned_addr learned my addr 172.21.15.156:0/3893122639 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:17.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.233+0000 7f25a7565700 1 -- 172.21.15.156:0/3893122639 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a0124680 con 0x7f25a0133f50 2023-09-30T22:24:17.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.233+0000 7f25a7565700 1 -- 172.21.15.156:0/3893122639 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25a0122f50 con 0x7f25a00a1380 2023-09-30T22:24:17.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.233+0000 7f25a5b02700 1 --2- 172.21.15.156:0/3893122639 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25a0133f50 0x7f25a01c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:17.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.233+0000 7f25a4b00700 1 -- 172.21.15.156:0/3893122639 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25a0133f50 msgr2=0x7f25a01c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:17.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.233+0000 7f25a4b00700 1 --2- 172.21.15.156:0/3893122639 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25a0133f50 0x7f25a01c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.233+0000 7f25a4b00700 1 -- 172.21.15.156:0/3893122639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25a00a0a70 msgr2=0x7f25a01c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:17.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.233+0000 7f25a4b00700 1 --2- 172.21.15.156:0/3893122639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25a00a0a70 0x7f25a01c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.233+0000 7f25a4b00700 1 -- 172.21.15.156:0/3893122639 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259c0094a0 con 0x7f25a00a1380 2023-09-30T22:24:17.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.233+0000 7f25a5301700 1 --2- 172.21.15.156:0/3893122639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25a00a0a70 0x7f25a01c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:17.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.234+0000 7f25a4b00700 1 --2- 172.21.15.156:0/3893122639 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25a00a1380 0x7f25a01c87b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2590016000 tx=0x7f2590004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:17.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.234+0000 7f2595ffb700 1 -- 172.21.15.156:0/3893122639 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2590004400 con 0x7f25a00a1380 2023-09-30T22:24:17.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.234+0000 7f2595ffb700 1 -- 172.21.15.156:0/3893122639 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259001f070 con 0x7f25a00a1380 2023-09-30T22:24:17.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.234+0000 7f2595ffb700 1 -- 172.21.15.156:0/3893122639 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25900038e0 con 0x7f25a00a1380 2023-09-30T22:24:17.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.234+0000 7f25a7565700 1 -- 172.21.15.156:0/3893122639 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2590009550 con 0x7f25a00a1380 2023-09-30T22:24:17.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.234+0000 7f25a7565700 1 -- 172.21.15.156:0/3893122639 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a00a0450 con 0x7f25a00a1380 2023-09-30T22:24:17.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.235+0000 7f2595ffb700 1 -- 172.21.15.156:0/3893122639 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2590021030 con 0x7f25a00a1380 2023-09-30T22:24:17.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.235+0000 7f2595ffb700 1 -- 172.21.15.156:0/3893122639 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2590040700 con 0x7f25a00a1380 2023-09-30T22:24:17.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.235+0000 7f25a7565700 1 -- 172.21.15.156:0/3893122639 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a00a0450 con 0x7f25a00a1380 2023-09-30T22:24:17.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.240+0000 7f2595ffb700 1 -- 172.21.15.156:0/3893122639 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25a00a0450 con 0x7f25a00a1380 2023-09-30T22:24:17.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.273+0000 7f135a777700 1 Processor -- start 2023-09-30T22:24:17.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.273+0000 7f135a777700 1 -- start start 2023-09-30T22:24:17.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.273+0000 7f135a777700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13540a0a70 0x7f13540a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:17.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.273+0000 7f135a777700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1354134120 0x7f135413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:17.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.274+0000 7f135a777700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f135409dc00 con 0x7f13540a1380 2023-09-30T22:24:17.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.274+0000 7f135a777700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f135409ea60 con 0x7f1354134120 2023-09-30T22:24:17.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.274+0000 7f135a777700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135409dec0 con 0x7f13540a0a70 2023-09-30T22:24:17.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.274+0000 7f13537fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f13540a1380 0x7f1354133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49386/0 (socket says 172.21.15.156:49386) 2023-09-30T22:24:17.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.274+0000 7f1353fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13540a0a70 0x7f13540a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:17.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.274+0000 7f13537fe700 1 -- 172.21.15.156:0/3178579199 learned_addr learned my addr 172.21.15.156:0/3178579199 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:17.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.274+0000 7f1352ffd700 1 -- 172.21.15.156:0/3178579199 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 653818734 0 0) 0x7f135409dc00 con 0x7f13540a1380 2023-09-30T22:24:17.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.274+0000 7f1352ffd700 1 -- 172.21.15.156:0/3178579199 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f133c0035b0 con 0x7f13540a1380 2023-09-30T22:24:17.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.274+0000 7f1358d14700 1 --2- 172.21.15.156:0/3178579199 >> v2:172.21.15.156:3300/0 conn(0x7f1354134120 0x7f135413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:17.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.274+0000 7f1353fff700 1 -- 172.21.15.156:0/3178579199 >> v2:172.21.15.156:3300/0 conn(0x7f1354134120 msgr2=0x7f135413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:17.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.274+0000 7f1353fff700 1 --2- 172.21.15.156:0/3178579199 >> v2:172.21.15.156:3300/0 conn(0x7f1354134120 0x7f135413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.274+0000 7f1353fff700 1 -- 172.21.15.156:0/3178579199 >> v1:172.21.15.156:6789/0 conn(0x7f13540a1380 legacy=0x7f1354133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:17.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.274+0000 7f1353fff700 1 -- 172.21.15.156:0/3178579199 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135409e6a0 con 0x7f13540a0a70 2023-09-30T22:24:17.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.274+0000 7f1358d14700 1 --2- 172.21.15.156:0/3178579199 >> v2:172.21.15.156:3300/0 conn(0x7f1354134120 0x7f135413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:24:17.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.274+0000 7f1353fff700 1 --2- 172.21.15.156:0/3178579199 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13540a0a70 0x7f13540a0e40 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1344009840 tx=0x7f1344009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5948a824fd0cebe0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:17.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.274+0000 7f1352ffd700 1 -- 172.21.15.156:0/3178579199 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1344011830 con 0x7f13540a0a70 2023-09-30T22:24:17.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.274+0000 7f1352ffd700 1 -- 172.21.15.156:0/3178579199 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1344011990 con 0x7f13540a0a70 2023-09-30T22:24:17.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.275+0000 7f1352ffd700 1 -- 172.21.15.156:0/3178579199 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1344011d20 con 0x7f13540a0a70 2023-09-30T22:24:17.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.275+0000 7f135a777700 1 -- 172.21.15.156:0/3178579199 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13540a0a70 msgr2=0x7f13540a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:17.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.275+0000 7f135a777700 1 --2- 172.21.15.156:0/3178579199 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13540a0a70 0x7f13540a0e40 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1344009840 tx=0x7f1344009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:17.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.275+0000 7f135a777700 1 -- 172.21.15.156:0/3178579199 shutdown_connections 2023-09-30T22:24:17.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.275+0000 7f135a777700 1 --2- 172.21.15.156:0/3178579199 >> v2:172.21.15.156:3300/0 conn(0x7f1354134120 0x7f135413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.275+0000 7f135a777700 1 --2- 172.21.15.156:0/3178579199 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13540a0a70 0x7f13540a0e40 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.275+0000 7f135a777700 1 -- 172.21.15.156:0/3178579199 >> 172.21.15.156:0/3178579199 conn(0x7f13540a6610 msgr2=0x7f13540a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:17.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.275+0000 7f135a777700 1 -- 172.21.15.156:0/3178579199 shutdown_connections 2023-09-30T22:24:17.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.275+0000 7f135a777700 1 -- 172.21.15.156:0/3178579199 wait complete. 2023-09-30T22:24:17.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.277+0000 7f135a777700 1 Processor -- start 2023-09-30T22:24:17.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.277+0000 7f135a777700 1 -- start start 2023-09-30T22:24:17.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.278+0000 7f135a777700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13540a0a70 0x7f1354122720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:17.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.278+0000 7f135a777700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13540a1380 0x7f1354122c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:17.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.278+0000 7f135a777700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1354134120 0x7f13541231a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:17.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.278+0000 7f135a777700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1354124860 con 0x7f13540a1380 2023-09-30T22:24:17.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.278+0000 7f135a777700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1354125c20 con 0x7f1354134120 2023-09-30T22:24:17.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.278+0000 7f135a777700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13540a03e0 con 0x7f13540a0a70 2023-09-30T22:24:17.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.278+0000 7f1353fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13540a0a70 0x7f1354122720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:17.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.278+0000 7f1353fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13540a0a70 0x7f1354122720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52598/0 (socket says 172.21.15.156:52598) 2023-09-30T22:24:17.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.278+0000 7f1353fff700 1 -- 172.21.15.156:0/3111157926 learned_addr learned my addr 172.21.15.156:0/3111157926 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:17.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.278+0000 7f13537fe700 1 --2- 172.21.15.156:0/3111157926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13540a1380 0x7f1354122c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:17.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.278+0000 7f1358d14700 1 --2- 172.21.15.156:0/3111157926 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1354134120 0x7f13541231a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:17.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.278+0000 7f1353fff700 1 -- 172.21.15.156:0/3111157926 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1354134120 msgr2=0x7f13541231a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:17.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.278+0000 7f1353fff700 1 --2- 172.21.15.156:0/3111157926 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1354134120 0x7f13541231a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.278+0000 7f1353fff700 1 -- 172.21.15.156:0/3111157926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13540a1380 msgr2=0x7f1354122c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:17.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.278+0000 7f1353fff700 1 --2- 172.21.15.156:0/3111157926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13540a1380 0x7f1354122c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.278+0000 7f1353fff700 1 -- 172.21.15.156:0/3111157926 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13440094a0 con 0x7f13540a0a70 2023-09-30T22:24:17.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.278+0000 7f1353fff700 1 --2- 172.21.15.156:0/3111157926 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13540a0a70 0x7f1354122720 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1344009fd0 tx=0x7f1344004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:17.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.278+0000 7f1350ff9700 1 -- 172.21.15.156:0/3111157926 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13440036a0 con 0x7f13540a0a70 2023-09-30T22:24:17.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.279+0000 7f1350ff9700 1 -- 172.21.15.156:0/3111157926 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134401f070 con 0x7f13540a0a70 2023-09-30T22:24:17.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.279+0000 7f1350ff9700 1 -- 172.21.15.156:0/3111157926 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1344003a60 con 0x7f13540a0a70 2023-09-30T22:24:17.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.279+0000 7f135a777700 1 -- 172.21.15.156:0/3111157926 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1354126e00 con 0x7f13540a0a70 2023-09-30T22:24:17.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.279+0000 7f135a777700 1 -- 172.21.15.156:0/3111157926 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1354126950 con 0x7f13540a0a70 2023-09-30T22:24:17.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.279+0000 7f1350ff9700 1 -- 172.21.15.156:0/3111157926 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1344003bc0 con 0x7f13540a0a70 2023-09-30T22:24:17.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.279+0000 7f135a777700 1 -- 172.21.15.156:0/3111157926 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1354125d90 con 0x7f13540a0a70 2023-09-30T22:24:17.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.280+0000 7f1350ff9700 1 -- 172.21.15.156:0/3111157926 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1344021070 con 0x7f13540a0a70 2023-09-30T22:24:17.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.288+0000 7f1350ff9700 1 -- 172.21.15.156:0/3111157926 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f134402f3a0 con 0x7f13540a0a70 2023-09-30T22:24:17.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.310+0000 7fb06d998700 1 -- 172.21.15.156:0/740332619 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb06806bce0 con 0x7fb06809bc70 2023-09-30T22:24:17.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.310+0000 7fb04ffff700 1 -- 172.21.15.156:0/740332619 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb05c02a090 con 0x7fb06809bc70 2023-09-30T22:24:17.311 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:17.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.313+0000 7fb06d998700 1 -- 172.21.15.156:0/740332619 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb06809bc70 msgr2=0x7fb06811b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:17.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.313+0000 7fb06d998700 1 --2- 172.21.15.156:0/740332619 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb06809bc70 0x7fb06811b650 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb05c00e9b0 tx=0x7fb05c00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.313+0000 7fb06d998700 1 -- 172.21.15.156:0/740332619 shutdown_connections 2023-09-30T22:24:17.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.313+0000 7fb06d998700 1 --2- 172.21.15.156:0/740332619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb068131980 0x7fb06811c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.313+0000 7fb06d998700 1 --2- 172.21.15.156:0/740332619 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb06809bc70 0x7fb06811b650 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.313+0000 7fb06d998700 1 --2- 172.21.15.156:0/740332619 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb06809c5c0 0x7fb06811bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.313+0000 7fb06d998700 1 -- 172.21.15.156:0/740332619 >> 172.21.15.156:0/740332619 conn(0x7fb0680a2980 msgr2=0x7fb0680713f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:17.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.313+0000 7fb06d998700 1 -- 172.21.15.156:0/740332619 shutdown_connections 2023-09-30T22:24:17.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.313+0000 7fb06d998700 1 -- 172.21.15.156:0/740332619 wait complete. 2023-09-30T22:24:17.326 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:17.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.440+0000 7f25a7565700 1 -- 172.21.15.156:0/3893122639 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f25a00a0450 con 0x7f25a00a1380 2023-09-30T22:24:17.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.440+0000 7f2595ffb700 1 -- 172.21.15.156:0/3893122639 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25a00a0450 con 0x7f25a00a1380 2023-09-30T22:24:17.441 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:17.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.444+0000 7f25a7565700 1 -- 172.21.15.156:0/3893122639 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25a00a1380 msgr2=0x7f25a01c87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:17.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.444+0000 7f25a7565700 1 --2- 172.21.15.156:0/3893122639 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25a00a1380 0x7f25a01c87b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2590016000 tx=0x7f2590004750 comp rx=0 tx=0).stop 2023-09-30T22:24:17.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.444+0000 7f25a7565700 1 -- 172.21.15.156:0/3893122639 shutdown_connections 2023-09-30T22:24:17.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.444+0000 7f25a7565700 1 --2- 172.21.15.156:0/3893122639 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25a0133f50 0x7f25a01c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.444+0000 7f25a7565700 1 --2- 172.21.15.156:0/3893122639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25a00a0a70 0x7f25a01c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.444+0000 7f25a7565700 1 --2- 172.21.15.156:0/3893122639 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25a00a1380 0x7f25a01c87b0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.444+0000 7f25a7565700 1 -- 172.21.15.156:0/3893122639 >> 172.21.15.156:0/3893122639 conn(0x7f25a00a6610 msgr2=0x7f25a00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:17.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.444+0000 7f25a7565700 1 -- 172.21.15.156:0/3893122639 shutdown_connections 2023-09-30T22:24:17.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.444+0000 7f25a7565700 1 -- 172.21.15.156:0/3893122639 wait complete. 2023-09-30T22:24:17.460 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:17.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.490+0000 7f135a777700 1 -- 172.21.15.156:0/3111157926 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1354126de0 con 0x7f13540a0a70 2023-09-30T22:24:17.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.490+0000 7f1350ff9700 1 -- 172.21.15.156:0/3111157926 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f134402b070 con 0x7f13540a0a70 2023-09-30T22:24:17.491 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:17.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.492+0000 7f135a777700 1 -- 172.21.15.156:0/3111157926 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13540a0a70 msgr2=0x7f1354122720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:17.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.492+0000 7f135a777700 1 --2- 172.21.15.156:0/3111157926 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13540a0a70 0x7f1354122720 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1344009fd0 tx=0x7f1344004750 comp rx=0 tx=0).stop 2023-09-30T22:24:17.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.492+0000 7f135a777700 1 -- 172.21.15.156:0/3111157926 shutdown_connections 2023-09-30T22:24:17.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.492+0000 7f135a777700 1 --2- 172.21.15.156:0/3111157926 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1354134120 0x7f13541231a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.492+0000 7f135a777700 1 --2- 172.21.15.156:0/3111157926 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13540a0a70 0x7f1354122720 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.492+0000 7f135a777700 1 --2- 172.21.15.156:0/3111157926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13540a1380 0x7f1354122c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.492+0000 7f135a777700 1 -- 172.21.15.156:0/3111157926 >> 172.21.15.156:0/3111157926 conn(0x7f13540a6610 msgr2=0x7f13540a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:17.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.492+0000 7f135a777700 1 -- 172.21.15.156:0/3111157926 shutdown_connections 2023-09-30T22:24:17.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.492+0000 7f135a777700 1 -- 172.21.15.156:0/3111157926 wait complete. 2023-09-30T22:24:17.505 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:17.753 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:17.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.877+0000 7f2b04f38700 1 Processor -- start 2023-09-30T22:24:17.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.877+0000 7f2b04f38700 1 -- start start 2023-09-30T22:24:17.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.877+0000 7f2b04f38700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2b0009d860 0x7f2b0009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:17.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.877+0000 7f2b04f38700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b0009e170 0x7f2b001307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:17.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.877+0000 7f2b04f38700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0009aaa0 con 0x7f2b00130ce0 2023-09-30T22:24:17.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.877+0000 7f2b04f38700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0009f870 con 0x7f2b0009d860 2023-09-30T22:24:17.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.877+0000 7f2b04f38700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0009b360 con 0x7f2b0009e170 2023-09-30T22:24:17.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.877+0000 7f2afe59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2b0009d860 0x7f2b0009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:17.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.877+0000 7f2afdd9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b0009e170 0x7f2b001307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:17.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.877+0000 7f2afed9d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f2b00130ce0 0x7f2b001379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49390/0 (socket says 172.21.15.156:49390) 2023-09-30T22:24:17.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.877+0000 7f2afed9d700 1 -- 172.21.15.156:0/3461732983 learned_addr learned my addr 172.21.15.156:0/3461732983 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:17.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.878+0000 7f2afdd9b700 1 -- 172.21.15.156:0/3461732983 >> v2:172.21.15.156:3300/0 conn(0x7f2b0009d860 msgr2=0x7f2b0009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:17.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.878+0000 7f2afdd9b700 1 --2- 172.21.15.156:0/3461732983 >> v2:172.21.15.156:3300/0 conn(0x7f2b0009d860 0x7f2b0009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.878+0000 7f2afdd9b700 1 -- 172.21.15.156:0/3461732983 >> v1:172.21.15.156:6789/0 conn(0x7f2b00130ce0 legacy=0x7f2b001379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:17.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.878+0000 7f2afdd9b700 1 -- 172.21.15.156:0/3461732983 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0009b620 con 0x7f2b0009e170 2023-09-30T22:24:17.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.878+0000 7f2afe59c700 1 --2- 172.21.15.156:0/3461732983 >> v2:172.21.15.156:3300/0 conn(0x7f2b0009d860 0x7f2b0009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:17.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.878+0000 7f2afd59a700 1 -- 172.21.15.156:0/3461732983 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1688496014 0 0) 0x7f2b0009aaa0 con 0x7f2b00130ce0 2023-09-30T22:24:17.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.878+0000 7f2afdd9b700 1 --2- 172.21.15.156:0/3461732983 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b0009e170 0x7f2b001307a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f2af0009840 tx=0x7f2af0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e19400d7f15c9b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:17.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.878+0000 7f2afd59a700 1 -- 172.21.15.156:0/3461732983 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af0011830 con 0x7f2b0009e170 2023-09-30T22:24:17.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.878+0000 7f2afd59a700 1 -- 172.21.15.156:0/3461732983 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af0011990 con 0x7f2b0009e170 2023-09-30T22:24:17.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.878+0000 7f2afd59a700 1 -- 172.21.15.156:0/3461732983 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af0011d20 con 0x7f2b0009e170 2023-09-30T22:24:17.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.879+0000 7f2b04f38700 1 -- 172.21.15.156:0/3461732983 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b0009e170 msgr2=0x7f2b001307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:17.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.879+0000 7f2b04f38700 1 --2- 172.21.15.156:0/3461732983 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b0009e170 0x7f2b001307a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f2af0009840 tx=0x7f2af0009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:17.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.879+0000 7f2b04f38700 1 -- 172.21.15.156:0/3461732983 shutdown_connections 2023-09-30T22:24:17.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.879+0000 7f2b04f38700 1 --2- 172.21.15.156:0/3461732983 >> v2:172.21.15.156:3300/0 conn(0x7f2b0009d860 0x7f2b0009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.879+0000 7f2b04f38700 1 --2- 172.21.15.156:0/3461732983 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b0009e170 0x7f2b001307a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.879+0000 7f2b04f38700 1 -- 172.21.15.156:0/3461732983 >> 172.21.15.156:0/3461732983 conn(0x7f2b00099c40 msgr2=0x7f2b000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:17.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.879+0000 7f2b04f38700 1 -- 172.21.15.156:0/3461732983 shutdown_connections 2023-09-30T22:24:17.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.879+0000 7f2b04f38700 1 -- 172.21.15.156:0/3461732983 wait complete. 2023-09-30T22:24:17.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.880+0000 7f2b04f38700 1 Processor -- start 2023-09-30T22:24:17.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.880+0000 7f2b04f38700 1 -- start start 2023-09-30T22:24:17.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.880+0000 7f2b04f38700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b0009d860 0x7f2b001355b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:17.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.880+0000 7f2b04f38700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b0009e170 0x7f2b00135af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:17.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.880+0000 7f2b04f38700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b00130ce0 0x7f2b00136030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:17.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.880+0000 7f2b04f38700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b00072750 con 0x7f2b00130ce0 2023-09-30T22:24:17.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.880+0000 7f2b04f38700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b00138b30 con 0x7f2b0009d860 2023-09-30T22:24:17.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.880+0000 7f2b04f38700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b00138860 con 0x7f2b0009e170 2023-09-30T22:24:17.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.880+0000 7f2afe59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b0009d860 0x7f2b001355b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:17.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.880+0000 7f2afed9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b00130ce0 0x7f2b00136030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:17.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.880+0000 7f2afe59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b0009d860 0x7f2b001355b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53684/0 (socket says 172.21.15.156:53684) 2023-09-30T22:24:17.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.880+0000 7f2afe59c700 1 -- 172.21.15.156:0/3663762829 learned_addr learned my addr 172.21.15.156:0/3663762829 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:17.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.880+0000 7f2afdd9b700 1 --2- 172.21.15.156:0/3663762829 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b0009e170 0x7f2b00135af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:17.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.880+0000 7f2afed9d700 1 -- 172.21.15.156:0/3663762829 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b0009e170 msgr2=0x7f2b00135af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:17.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.881+0000 7f2afed9d700 1 --2- 172.21.15.156:0/3663762829 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b0009e170 0x7f2b00135af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.881+0000 7f2afed9d700 1 -- 172.21.15.156:0/3663762829 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b0009d860 msgr2=0x7f2b001355b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:17.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.881+0000 7f2afed9d700 1 --2- 172.21.15.156:0/3663762829 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b0009d860 0x7f2b001355b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.881+0000 7f2afed9d700 1 -- 172.21.15.156:0/3663762829 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae80094a0 con 0x7f2b00130ce0 2023-09-30T22:24:17.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.881+0000 7f2afe59c700 1 --2- 172.21.15.156:0/3663762829 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b0009d860 0x7f2b001355b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:17.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.881+0000 7f2afed9d700 1 --2- 172.21.15.156:0/3663762829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b00130ce0 0x7f2b00136030 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f2af800cbe0 tx=0x7f2af800cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:17.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.881+0000 7f2af6ffd700 1 -- 172.21.15.156:0/3663762829 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af800aa40 con 0x7f2b00130ce0 2023-09-30T22:24:17.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.881+0000 7f2b04f38700 1 -- 172.21.15.156:0/3663762829 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af00094a0 con 0x7f2b00130ce0 2023-09-30T22:24:17.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.881+0000 7f2af6ffd700 1 -- 172.21.15.156:0/3663762829 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af800aba0 con 0x7f2b00130ce0 2023-09-30T22:24:17.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.881+0000 7f2b04f38700 1 -- 172.21.15.156:0/3663762829 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b001379b0 con 0x7f2b00130ce0 2023-09-30T22:24:17.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.881+0000 7f2af6ffd700 1 -- 172.21.15.156:0/3663762829 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af80070d0 con 0x7f2b00130ce0 2023-09-30T22:24:17.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.882+0000 7f2af6ffd700 1 -- 172.21.15.156:0/3663762829 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2af8007230 con 0x7f2b00130ce0 2023-09-30T22:24:17.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.882+0000 7f2af6ffd700 1 -- 172.21.15.156:0/3663762829 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2af803f420 con 0x7f2b00130ce0 2023-09-30T22:24:17.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.882+0000 7f2b04f38700 1 -- 172.21.15.156:0/3663762829 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae40052e0 con 0x7f2b00130ce0 2023-09-30T22:24:17.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:17.887+0000 7f2af6ffd700 1 -- 172.21.15.156:0/3663762829 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2af8018020 con 0x7f2b00130ce0 2023-09-30T22:24:18.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.070+0000 7f2b04f38700 1 -- 172.21.15.156:0/3663762829 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2ae4005590 con 0x7f2b00130ce0 2023-09-30T22:24:18.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.071+0000 7f2af6ffd700 1 -- 172.21.15.156:0/3663762829 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2af801c3b0 con 0x7f2b00130ce0 2023-09-30T22:24:18.071 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:18.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.073+0000 7f2b04f38700 1 -- 172.21.15.156:0/3663762829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b00130ce0 msgr2=0x7f2b00136030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.073+0000 7f2b04f38700 1 --2- 172.21.15.156:0/3663762829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b00130ce0 0x7f2b00136030 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f2af800cbe0 tx=0x7f2af800cef0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.073+0000 7f2b04f38700 1 -- 172.21.15.156:0/3663762829 shutdown_connections 2023-09-30T22:24:18.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.073+0000 7f2b04f38700 1 --2- 172.21.15.156:0/3663762829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b00130ce0 0x7f2b00136030 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.073+0000 7f2b04f38700 1 --2- 172.21.15.156:0/3663762829 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b0009d860 0x7f2b001355b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.073+0000 7f2b04f38700 1 --2- 172.21.15.156:0/3663762829 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b0009e170 0x7f2b00135af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.073+0000 7f2b04f38700 1 -- 172.21.15.156:0/3663762829 >> 172.21.15.156:0/3663762829 conn(0x7f2b00099c40 msgr2=0x7f2b00139480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:18.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.073+0000 7f2b04f38700 1 -- 172.21.15.156:0/3663762829 shutdown_connections 2023-09-30T22:24:18.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.073+0000 7f2b04f38700 1 -- 172.21.15.156:0/3663762829 wait complete. 2023-09-30T22:24:18.086 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:18.327 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:18.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.450+0000 7fe4d27a5700 1 Processor -- start 2023-09-30T22:24:18.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.450+0000 7fe4d27a5700 1 -- start start 2023-09-30T22:24:18.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.451+0000 7fe4d27a5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe4cc099e20 0x7fe4cc09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.451+0000 7fe4d27a5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4cc09a730 0x7fe4cc130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.451+0000 7fe4d27a5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4cc130890 0x7fe4cc130ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.451+0000 7fe4d27a5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4cc09bf50 con 0x7fe4cc099e20 2023-09-30T22:24:18.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.451+0000 7fe4d27a5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc131220 con 0x7fe4cc130890 2023-09-30T22:24:18.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.451+0000 7fe4d27a5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc099a60 con 0x7fe4cc09a730 2023-09-30T22:24:18.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.451+0000 7fe4cbfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe4cc099e20 0x7fe4cc09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.451+0000 7fe4cb7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4cc09a730 0x7fe4cc130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.451+0000 7fe4cbfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe4cc099e20 0x7fe4cc09a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60700/0 (socket says 172.21.15.156:60700) 2023-09-30T22:24:18.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.451+0000 7fe4cbfff700 1 -- 172.21.15.156:0/4124421226 learned_addr learned my addr 172.21.15.156:0/4124421226 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:18.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.451+0000 7fe4d0d42700 1 --2- 172.21.15.156:0/4124421226 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4cc130890 0x7fe4cc130ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.451+0000 7fe4cb7fe700 1 -- 172.21.15.156:0/4124421226 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4cc130890 msgr2=0x7fe4cc130ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:18.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.451+0000 7fe4cb7fe700 1 --2- 172.21.15.156:0/4124421226 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4cc130890 0x7fe4cc130ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.451+0000 7fe4cb7fe700 1 -- 172.21.15.156:0/4124421226 >> v2:172.21.15.156:3300/0 conn(0x7fe4cc099e20 msgr2=0x7fe4cc09a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:18.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.451+0000 7fe4cb7fe700 1 --2- 172.21.15.156:0/4124421226 >> v2:172.21.15.156:3300/0 conn(0x7fe4cc099e20 0x7fe4cc09a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.451+0000 7fe4cb7fe700 1 -- 172.21.15.156:0/4124421226 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc09b230 con 0x7fe4cc09a730 2023-09-30T22:24:18.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.451+0000 7fe4cbfff700 1 --2- 172.21.15.156:0/4124421226 >> v2:172.21.15.156:3300/0 conn(0x7fe4cc099e20 0x7fe4cc09a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:18.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.451+0000 7fe4d0d42700 1 --2- 172.21.15.156:0/4124421226 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4cc130890 0x7fe4cc130ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:18.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.452+0000 7fe4cb7fe700 1 --2- 172.21.15.156:0/4124421226 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4cc09a730 0x7fe4cc130350 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009870 tx=0x7fe4bc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ef774b1d4409bef server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:18.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.452+0000 7fe4caffd700 1 -- 172.21.15.156:0/4124421226 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc011830 con 0x7fe4cc09a730 2023-09-30T22:24:18.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.452+0000 7fe4caffd700 1 -- 172.21.15.156:0/4124421226 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4bc011990 con 0x7fe4cc09a730 2023-09-30T22:24:18.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.452+0000 7fe4caffd700 1 -- 172.21.15.156:0/4124421226 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc011d20 con 0x7fe4cc09a730 2023-09-30T22:24:18.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.452+0000 7fe4d27a5700 1 -- 172.21.15.156:0/4124421226 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4cc09a730 msgr2=0x7fe4cc130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.452+0000 7fe4d27a5700 1 --2- 172.21.15.156:0/4124421226 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4cc09a730 0x7fe4cc130350 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009870 tx=0x7fe4bc009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:18.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.452+0000 7fe4d27a5700 1 -- 172.21.15.156:0/4124421226 shutdown_connections 2023-09-30T22:24:18.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.452+0000 7fe4d27a5700 1 --2- 172.21.15.156:0/4124421226 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4cc130890 0x7fe4cc130ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.452+0000 7fe4d27a5700 1 --2- 172.21.15.156:0/4124421226 >> v2:172.21.15.156:3300/0 conn(0x7fe4cc099e20 0x7fe4cc09a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.452+0000 7fe4d27a5700 1 --2- 172.21.15.156:0/4124421226 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4cc09a730 0x7fe4cc130350 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.452+0000 7fe4d27a5700 1 -- 172.21.15.156:0/4124421226 >> 172.21.15.156:0/4124421226 conn(0x7fe4cc0a2980 msgr2=0x7fe4cc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:18.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.452+0000 7fe4d27a5700 1 -- 172.21.15.156:0/4124421226 shutdown_connections 2023-09-30T22:24:18.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.452+0000 7fe4d27a5700 1 -- 172.21.15.156:0/4124421226 wait complete. 2023-09-30T22:24:18.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.453+0000 7fe4d27a5700 1 Processor -- start 2023-09-30T22:24:18.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.453+0000 7fe4d27a5700 1 -- start start 2023-09-30T22:24:18.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.454+0000 7fe4d27a5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4cc099e20 0x7fe4cc12d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.454+0000 7fe4d27a5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4cc09a730 0x7fe4cc12d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.454+0000 7fe4d27a5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4cc130890 0x7fe4cc134140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.454+0000 7fe4d27a5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc137c60 con 0x7fe4cc130890 2023-09-30T22:24:18.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.454+0000 7fe4d27a5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc136fa0 con 0x7fe4cc099e20 2023-09-30T22:24:18.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.454+0000 7fe4d27a5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc0a1300 con 0x7fe4cc09a730 2023-09-30T22:24:18.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.454+0000 7fe4cbfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4cc099e20 0x7fe4cc12d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.454+0000 7fe4cbfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4cc099e20 0x7fe4cc12d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53704/0 (socket says 172.21.15.156:53704) 2023-09-30T22:24:18.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.454+0000 7fe4cbfff700 1 -- 172.21.15.156:0/12206562 learned_addr learned my addr 172.21.15.156:0/12206562 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:18.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.454+0000 7fe4cb7fe700 1 --2- 172.21.15.156:0/12206562 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4cc09a730 0x7fe4cc12d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.454+0000 7fe4d0d42700 1 --2- 172.21.15.156:0/12206562 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4cc130890 0x7fe4cc134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.454+0000 7fe4cbfff700 1 -- 172.21.15.156:0/12206562 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4cc09a730 msgr2=0x7fe4cc12d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.454+0000 7fe4cbfff700 1 --2- 172.21.15.156:0/12206562 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4cc09a730 0x7fe4cc12d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.454+0000 7fe4cbfff700 1 -- 172.21.15.156:0/12206562 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4cc130890 msgr2=0x7fe4cc134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.454+0000 7fe4cbfff700 1 --2- 172.21.15.156:0/12206562 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4cc130890 0x7fe4cc134140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.454+0000 7fe4cbfff700 1 -- 172.21.15.156:0/12206562 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b4009500 con 0x7fe4cc099e20 2023-09-30T22:24:18.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.454+0000 7fe4cbfff700 1 --2- 172.21.15.156:0/12206562 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4cc099e20 0x7fe4cc12d300 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe4b400ebb0 tx=0x7fe4b400eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:18.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.455+0000 7fe4c8ff9700 1 -- 172.21.15.156:0/12206562 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4005a20 con 0x7fe4cc099e20 2023-09-30T22:24:18.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.455+0000 7fe4c8ff9700 1 -- 172.21.15.156:0/12206562 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b4005b80 con 0x7fe4cc099e20 2023-09-30T22:24:18.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.455+0000 7fe4d27a5700 1 -- 172.21.15.156:0/12206562 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c4009a70 con 0x7fe4cc099e20 2023-09-30T22:24:18.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.455+0000 7fe4c8ff9700 1 -- 172.21.15.156:0/12206562 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b400c850 con 0x7fe4cc099e20 2023-09-30T22:24:18.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.455+0000 7fe4d27a5700 1 -- 172.21.15.156:0/12206562 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4bc0094a0 con 0x7fe4cc099e20 2023-09-30T22:24:18.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.455+0000 7fe4c8ff9700 1 -- 172.21.15.156:0/12206562 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe4b400c9b0 con 0x7fe4cc099e20 2023-09-30T22:24:18.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.455+0000 7fe4c8ff9700 1 -- 172.21.15.156:0/12206562 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe4b403f990 con 0x7fe4cc099e20 2023-09-30T22:24:18.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.455+0000 7fe4d27a5700 1 -- 172.21.15.156:0/12206562 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4cc1377e0 con 0x7fe4cc099e20 2023-09-30T22:24:18.461 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:18.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.460+0000 7fe4c8ff9700 1 -- 172.21.15.156:0/12206562 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4cc1377e0 con 0x7fe4cc099e20 2023-09-30T22:24:18.506 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:18.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.590+0000 7f31ff538700 1 Processor -- start 2023-09-30T22:24:18.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.590+0000 7f31ff538700 1 -- start start 2023-09-30T22:24:18.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.590+0000 7f31ff538700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f31f8136960 0x7f31f8138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.590+0000 7f31ff538700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31f8139280 0x7f31f813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.590+0000 7f31ff538700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f806b2d0 con 0x7f31f8133ad0 2023-09-30T22:24:18.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.590+0000 7f31ff538700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f81345b0 con 0x7f31f8136960 2023-09-30T22:24:18.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.590+0000 7f31ff538700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f8133610 con 0x7f31f8139280 2023-09-30T22:24:18.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.591+0000 7f31fdad5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31f8139280 0x7f31f813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.591+0000 7f31fd2d4700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f31f8133ad0 0x7f31f8133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49396/0 (socket says 172.21.15.156:49396) 2023-09-30T22:24:18.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.591+0000 7f31fd2d4700 1 -- 172.21.15.156:0/2529980770 learned_addr learned my addr 172.21.15.156:0/2529980770 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:18.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.591+0000 7f31fcad3700 1 --2- 172.21.15.156:0/2529980770 >> v2:172.21.15.156:3300/0 conn(0x7f31f8136960 0x7f31f8138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.591+0000 7f31effff700 1 -- 172.21.15.156:0/2529980770 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623274449 0 0) 0x7f31f806b2d0 con 0x7f31f8133ad0 2023-09-30T22:24:18.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.591+0000 7f31effff700 1 -- 172.21.15.156:0/2529980770 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31e40035b0 con 0x7f31f8133ad0 2023-09-30T22:24:18.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.591+0000 7f31fdad5700 1 -- 172.21.15.156:0/2529980770 >> v2:172.21.15.156:3300/0 conn(0x7f31f8136960 msgr2=0x7f31f8138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:18.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.591+0000 7f31fdad5700 1 --2- 172.21.15.156:0/2529980770 >> v2:172.21.15.156:3300/0 conn(0x7f31f8136960 0x7f31f8138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.591+0000 7f31fdad5700 1 -- 172.21.15.156:0/2529980770 >> v1:172.21.15.156:6789/0 conn(0x7f31f8133ad0 legacy=0x7f31f8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.591+0000 7f31fdad5700 1 -- 172.21.15.156:0/2529980770 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f809a500 con 0x7f31f8139280 2023-09-30T22:24:18.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.591+0000 7f31fcad3700 1 --2- 172.21.15.156:0/2529980770 >> v2:172.21.15.156:3300/0 conn(0x7f31f8136960 0x7f31f8138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:18.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.591+0000 7f31fdad5700 1 --2- 172.21.15.156:0/2529980770 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31f8139280 0x7f31f813b660 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f31f0009d90 tx=0x7f31f000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cae914a06cf17885 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:18.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.591+0000 7f31effff700 1 -- 172.21.15.156:0/2529980770 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f000e070 con 0x7f31f8139280 2023-09-30T22:24:18.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.591+0000 7f31effff700 1 -- 172.21.15.156:0/2529980770 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f000bb20 con 0x7f31f8139280 2023-09-30T22:24:18.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.591+0000 7f31effff700 1 -- 172.21.15.156:0/2529980770 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f0012430 con 0x7f31f8139280 2023-09-30T22:24:18.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.592+0000 7f31ff538700 1 -- 172.21.15.156:0/2529980770 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31f8139280 msgr2=0x7f31f813b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.592+0000 7f31ff538700 1 --2- 172.21.15.156:0/2529980770 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31f8139280 0x7f31f813b660 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f31f0009d90 tx=0x7f31f000b330 comp rx=0 tx=0).stop 2023-09-30T22:24:18.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.592+0000 7f31ff538700 1 -- 172.21.15.156:0/2529980770 shutdown_connections 2023-09-30T22:24:18.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.592+0000 7f31ff538700 1 --2- 172.21.15.156:0/2529980770 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31f8139280 0x7f31f813b660 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.592+0000 7f31ff538700 1 --2- 172.21.15.156:0/2529980770 >> v2:172.21.15.156:3300/0 conn(0x7f31f8136960 0x7f31f8138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.592+0000 7f31ff538700 1 -- 172.21.15.156:0/2529980770 >> 172.21.15.156:0/2529980770 conn(0x7f31f8099c40 msgr2=0x7f31f80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:18.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.592+0000 7f31ff538700 1 -- 172.21.15.156:0/2529980770 shutdown_connections 2023-09-30T22:24:18.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.592+0000 7f31ff538700 1 -- 172.21.15.156:0/2529980770 wait complete. 2023-09-30T22:24:18.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.593+0000 7f31ff538700 1 Processor -- start 2023-09-30T22:24:18.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.593+0000 7f31ff538700 1 -- start start 2023-09-30T22:24:18.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.594+0000 7f31ff538700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31f8133ad0 0x7f31f812cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.594+0000 7f31ff538700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31f8136960 0x7f31f812d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.594+0000 7f31ff538700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31f8139280 0x7f31f812d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.594+0000 7f31ff538700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f806edb0 con 0x7f31f8133ad0 2023-09-30T22:24:18.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.594+0000 7f31ff538700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f80703f0 con 0x7f31f8136960 2023-09-30T22:24:18.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.594+0000 7f31ff538700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31f80726e0 con 0x7f31f8139280 2023-09-30T22:24:18.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.594+0000 7f31fcad3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31f8136960 0x7f31f812d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.594+0000 7f31fcad3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31f8136960 0x7f31f812d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53718/0 (socket says 172.21.15.156:53718) 2023-09-30T22:24:18.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.594+0000 7f31fcad3700 1 -- 172.21.15.156:0/1456795098 learned_addr learned my addr 172.21.15.156:0/1456795098 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:18.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.594+0000 7f31fd2d4700 1 --2- 172.21.15.156:0/1456795098 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31f8133ad0 0x7f31f812cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.594+0000 7f31fdad5700 1 --2- 172.21.15.156:0/1456795098 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31f8139280 0x7f31f812d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.594+0000 7f31fcad3700 1 -- 172.21.15.156:0/1456795098 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31f8139280 msgr2=0x7f31f812d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.594+0000 7f31fcad3700 1 --2- 172.21.15.156:0/1456795098 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31f8139280 0x7f31f812d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.594+0000 7f31fcad3700 1 -- 172.21.15.156:0/1456795098 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31f8133ad0 msgr2=0x7f31f812cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.594+0000 7f31fcad3700 1 --2- 172.21.15.156:0/1456795098 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31f8133ad0 0x7f31f812cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.594+0000 7f31fcad3700 1 -- 172.21.15.156:0/1456795098 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e80094a0 con 0x7f31f8136960 2023-09-30T22:24:18.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.594+0000 7f31fcad3700 1 --2- 172.21.15.156:0/1456795098 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31f8136960 0x7f31f812d070 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f31e800ebe0 tx=0x7f31e800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:18.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.594+0000 7f31edffb700 1 -- 172.21.15.156:0/1456795098 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e800c850 con 0x7f31f8136960 2023-09-30T22:24:18.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.595+0000 7f31edffb700 1 -- 172.21.15.156:0/1456795098 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e800c9b0 con 0x7f31f8136960 2023-09-30T22:24:18.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.595+0000 7f31ff538700 1 -- 172.21.15.156:0/1456795098 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f0009a70 con 0x7f31f8136960 2023-09-30T22:24:18.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.595+0000 7f31edffb700 1 -- 172.21.15.156:0/1456795098 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e800cd40 con 0x7f31f8136960 2023-09-30T22:24:18.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.595+0000 7f31ff538700 1 -- 172.21.15.156:0/1456795098 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f8070110 con 0x7f31f8136960 2023-09-30T22:24:18.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.596+0000 7f31edffb700 1 -- 172.21.15.156:0/1456795098 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f31e8013470 con 0x7f31f8136960 2023-09-30T22:24:18.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.596+0000 7f31edffb700 1 -- 172.21.15.156:0/1456795098 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f31e803fb80 con 0x7f31f8136960 2023-09-30T22:24:18.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.596+0000 7f31ff538700 1 -- 172.21.15.156:0/1456795098 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f804f2a0 con 0x7f31f8136960 2023-09-30T22:24:18.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.600+0000 7f31edffb700 1 -- 172.21.15.156:0/1456795098 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f31e8013720 con 0x7f31f8136960 2023-09-30T22:24:18.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.635+0000 7f265b142700 1 Processor -- start 2023-09-30T22:24:18.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.635+0000 7f265b142700 1 -- start start 2023-09-30T22:24:18.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.635+0000 7f265b142700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f26540a0a70 0x7f26540a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.635+0000 7f265b142700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f26540a1380 0x7f2654133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.636+0000 7f265b142700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2654133f50 0x7f2654134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.636+0000 7f265b142700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f265409e9d0 con 0x7f26540a1380 2023-09-30T22:24:18.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.636+0000 7f265b142700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265409dc00 con 0x7f2654133f50 2023-09-30T22:24:18.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.636+0000 7f265b142700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f265409dec0 con 0x7f26540a0a70 2023-09-30T22:24:18.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.636+0000 7f26596df700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2654133f50 0x7f2654134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.636+0000 7f2658ede700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f26540a0a70 0x7f26540a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.636+0000 7f2653fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f26540a1380 0x7f2654133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.636+0000 7f26596df700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2654133f50 0x7f2654134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53732/0 (socket says 172.21.15.156:53732) 2023-09-30T22:24:18.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.636+0000 7f26596df700 1 -- 172.21.15.156:0/3174552405 learned_addr learned my addr 172.21.15.156:0/3174552405 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:18.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.636+0000 7f2653fff700 1 -- 172.21.15.156:0/3174552405 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f26540a0a70 msgr2=0x7f26540a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:18.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.636+0000 7f2653fff700 1 --2- 172.21.15.156:0/3174552405 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f26540a0a70 0x7f26540a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.636+0000 7f2653fff700 1 -- 172.21.15.156:0/3174552405 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2654133f50 msgr2=0x7f2654134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:18.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.636+0000 7f2653fff700 1 --2- 172.21.15.156:0/3174552405 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2654133f50 0x7f2654134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.636+0000 7f2653fff700 1 -- 172.21.15.156:0/3174552405 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f265409e6a0 con 0x7f26540a1380 2023-09-30T22:24:18.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.636+0000 7f2658ede700 1 --2- 172.21.15.156:0/3174552405 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f26540a0a70 0x7f26540a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:18.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.636+0000 7f26596df700 1 --2- 172.21.15.156:0/3174552405 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2654133f50 0x7f2654134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:18.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.636+0000 7f2653fff700 1 --2- 172.21.15.156:0/3174552405 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26540a1380 0x7f2654133a10 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f2640009840 tx=0x7f2640009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e760fdad83f5fdb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:18.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.636+0000 7f26537fe700 1 -- 172.21.15.156:0/3174552405 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2640011830 con 0x7f26540a1380 2023-09-30T22:24:18.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.636+0000 7f26537fe700 1 -- 172.21.15.156:0/3174552405 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2640011990 con 0x7f26540a1380 2023-09-30T22:24:18.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.636+0000 7f26537fe700 1 -- 172.21.15.156:0/3174552405 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2640011d20 con 0x7f26540a1380 2023-09-30T22:24:18.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.637+0000 7f265b142700 1 -- 172.21.15.156:0/3174552405 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26540a1380 msgr2=0x7f2654133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.637+0000 7f265b142700 1 --2- 172.21.15.156:0/3174552405 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26540a1380 0x7f2654133a10 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f2640009840 tx=0x7f2640009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:18.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.637+0000 7f265b142700 1 -- 172.21.15.156:0/3174552405 shutdown_connections 2023-09-30T22:24:18.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.637+0000 7f265b142700 1 --2- 172.21.15.156:0/3174552405 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2654133f50 0x7f2654134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.637+0000 7f265b142700 1 --2- 172.21.15.156:0/3174552405 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f26540a0a70 0x7f26540a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.637+0000 7f265b142700 1 --2- 172.21.15.156:0/3174552405 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26540a1380 0x7f2654133a10 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.637+0000 7f265b142700 1 -- 172.21.15.156:0/3174552405 >> 172.21.15.156:0/3174552405 conn(0x7f26540a6610 msgr2=0x7f26540a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:18.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.637+0000 7f265b142700 1 -- 172.21.15.156:0/3174552405 shutdown_connections 2023-09-30T22:24:18.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.637+0000 7f265b142700 1 -- 172.21.15.156:0/3174552405 wait complete. 2023-09-30T22:24:18.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.638+0000 7f265b142700 1 Processor -- start 2023-09-30T22:24:18.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.638+0000 7f265b142700 1 -- start start 2023-09-30T22:24:18.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.639+0000 7f265b142700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26540a0a70 0x7f26541223f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.639+0000 7f265b142700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f26540a1380 0x7f2654122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.639+0000 7f265b142700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2654133f50 0x7f2654122e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.639+0000 7f265b142700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2654125200 con 0x7f26540a0a70 2023-09-30T22:24:18.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.639+0000 7f265b142700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2654123850 con 0x7f26540a1380 2023-09-30T22:24:18.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.639+0000 7f265b142700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2654124130 con 0x7f2654133f50 2023-09-30T22:24:18.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.639+0000 7f2653fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f26540a1380 0x7f2654122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.639+0000 7f2653fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f26540a1380 0x7f2654122930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53740/0 (socket says 172.21.15.156:53740) 2023-09-30T22:24:18.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.639+0000 7f2653fff700 1 -- 172.21.15.156:0/1584367799 learned_addr learned my addr 172.21.15.156:0/1584367799 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:18.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.639+0000 7f2658ede700 1 --2- 172.21.15.156:0/1584367799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26540a0a70 0x7f26541223f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.639+0000 7f26596df700 1 --2- 172.21.15.156:0/1584367799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2654133f50 0x7f2654122e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.639+0000 7f2653fff700 1 -- 172.21.15.156:0/1584367799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2654133f50 msgr2=0x7f2654122e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.639+0000 7f2653fff700 1 --2- 172.21.15.156:0/1584367799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2654133f50 0x7f2654122e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.639+0000 7f2653fff700 1 -- 172.21.15.156:0/1584367799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26540a0a70 msgr2=0x7f26541223f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.639+0000 7f2653fff700 1 --2- 172.21.15.156:0/1584367799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26540a0a70 0x7f26541223f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.639+0000 7f2653fff700 1 -- 172.21.15.156:0/1584367799 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26480094a0 con 0x7f26540a1380 2023-09-30T22:24:18.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.639+0000 7f26596df700 1 --2- 172.21.15.156:0/1584367799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2654133f50 0x7f2654122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:18.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.639+0000 7f2653fff700 1 --2- 172.21.15.156:0/1584367799 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f26540a1380 0x7f2654122930 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f2640000c00 tx=0x7f2640004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:18.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.639+0000 7f26517fa700 1 -- 172.21.15.156:0/1584367799 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2640004450 con 0x7f26540a1380 2023-09-30T22:24:18.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.639+0000 7f26517fa700 1 -- 172.21.15.156:0/1584367799 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264001f070 con 0x7f26540a1380 2023-09-30T22:24:18.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.639+0000 7f265b142700 1 -- 172.21.15.156:0/1584367799 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f264c009b30 con 0x7f26540a1380 2023-09-30T22:24:18.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.639+0000 7f26517fa700 1 -- 172.21.15.156:0/1584367799 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26400038e0 con 0x7f26540a1380 2023-09-30T22:24:18.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.639+0000 7f265b142700 1 -- 172.21.15.156:0/1584367799 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26400094a0 con 0x7f26540a1380 2023-09-30T22:24:18.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.640+0000 7f26517fa700 1 -- 172.21.15.156:0/1584367799 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2640003a40 con 0x7f26540a1380 2023-09-30T22:24:18.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.640+0000 7f265b142700 1 -- 172.21.15.156:0/1584367799 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f265404f2a0 con 0x7f26540a1380 2023-09-30T22:24:18.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.641+0000 7f26517fa700 1 -- 172.21.15.156:0/1584367799 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2640021070 con 0x7f26540a1380 2023-09-30T22:24:18.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.645+0000 7f26517fa700 1 -- 172.21.15.156:0/1584367799 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f264006e750 con 0x7f26540a1380 2023-09-30T22:24:18.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.661+0000 7fe4d27a5700 1 -- 172.21.15.156:0/12206562 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe4cc1377e0 con 0x7fe4cc099e20 2023-09-30T22:24:18.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.661+0000 7fe4c8ff9700 1 -- 172.21.15.156:0/12206562 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe4cc1377e0 con 0x7fe4cc099e20 2023-09-30T22:24:18.662 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:18.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.664+0000 7fe4d27a5700 1 -- 172.21.15.156:0/12206562 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4cc099e20 msgr2=0x7fe4cc12d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.664+0000 7fe4d27a5700 1 --2- 172.21.15.156:0/12206562 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4cc099e20 0x7fe4cc12d300 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe4b400ebb0 tx=0x7fe4b400eec0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.664+0000 7fe4d27a5700 1 -- 172.21.15.156:0/12206562 shutdown_connections 2023-09-30T22:24:18.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.664+0000 7fe4d27a5700 1 --2- 172.21.15.156:0/12206562 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4cc130890 0x7fe4cc134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.664+0000 7fe4d27a5700 1 --2- 172.21.15.156:0/12206562 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4cc099e20 0x7fe4cc12d300 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.664+0000 7fe4d27a5700 1 --2- 172.21.15.156:0/12206562 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4cc09a730 0x7fe4cc12d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.664+0000 7fe4d27a5700 1 -- 172.21.15.156:0/12206562 >> 172.21.15.156:0/12206562 conn(0x7fe4cc0a2980 msgr2=0x7fe4cc12f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:18.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.664+0000 7fe4d27a5700 1 -- 172.21.15.156:0/12206562 shutdown_connections 2023-09-30T22:24:18.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.664+0000 7fe4d27a5700 1 -- 172.21.15.156:0/12206562 wait complete. 2023-09-30T22:24:18.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:18.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.793+0000 7f31ff538700 1 -- 172.21.15.156:0/1456795098 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f31f809f0f0 con 0x7f31f8136960 2023-09-30T22:24:18.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.793+0000 7f31edffb700 1 -- 172.21.15.156:0/1456795098 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f31e8021030 con 0x7f31f8136960 2023-09-30T22:24:18.794 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:18.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.795+0000 7f31ff538700 1 -- 172.21.15.156:0/1456795098 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31f8136960 msgr2=0x7f31f812d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.795+0000 7f31ff538700 1 --2- 172.21.15.156:0/1456795098 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31f8136960 0x7f31f812d070 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f31e800ebe0 tx=0x7f31e800eef0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.795+0000 7f31ff538700 1 -- 172.21.15.156:0/1456795098 shutdown_connections 2023-09-30T22:24:18.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.795+0000 7f31ff538700 1 --2- 172.21.15.156:0/1456795098 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31f8139280 0x7f31f812d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.795+0000 7f31ff538700 1 --2- 172.21.15.156:0/1456795098 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31f8133ad0 0x7f31f812cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.795+0000 7f31ff538700 1 --2- 172.21.15.156:0/1456795098 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31f8136960 0x7f31f812d070 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.795+0000 7f31ff538700 1 -- 172.21.15.156:0/1456795098 >> 172.21.15.156:0/1456795098 conn(0x7f31f8099c40 msgr2=0x7f31f8134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:18.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.795+0000 7f31ff538700 1 -- 172.21.15.156:0/1456795098 shutdown_connections 2023-09-30T22:24:18.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.796+0000 7f31ff538700 1 -- 172.21.15.156:0/1456795098 wait complete. 2023-09-30T22:24:18.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:18.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.847+0000 7f265b142700 1 -- 172.21.15.156:0/1584367799 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2654072980 con 0x7f26540a1380 2023-09-30T22:24:18.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.848+0000 7f26517fa700 1 -- 172.21.15.156:0/1584367799 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2640015030 con 0x7f26540a1380 2023-09-30T22:24:18.848 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:18.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.850+0000 7f265b142700 1 -- 172.21.15.156:0/1584367799 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f26540a1380 msgr2=0x7f2654122930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.850+0000 7f265b142700 1 --2- 172.21.15.156:0/1584367799 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f26540a1380 0x7f2654122930 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f2640000c00 tx=0x7f2640004750 comp rx=0 tx=0).stop 2023-09-30T22:24:18.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.850+0000 7f265b142700 1 -- 172.21.15.156:0/1584367799 shutdown_connections 2023-09-30T22:24:18.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.850+0000 7f265b142700 1 --2- 172.21.15.156:0/1584367799 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2654133f50 0x7f2654122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.850+0000 7f265b142700 1 --2- 172.21.15.156:0/1584367799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26540a0a70 0x7f26541223f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.850+0000 7f265b142700 1 --2- 172.21.15.156:0/1584367799 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f26540a1380 0x7f2654122930 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.850+0000 7f265b142700 1 -- 172.21.15.156:0/1584367799 >> 172.21.15.156:0/1584367799 conn(0x7f26540a6610 msgr2=0x7f265409c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:18.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.850+0000 7f265b142700 1 -- 172.21.15.156:0/1584367799 shutdown_connections 2023-09-30T22:24:18.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:18.850+0000 7f265b142700 1 -- 172.21.15.156:0/1584367799 wait complete. 2023-09-30T22:24:18.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:19.086 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:19.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.209+0000 7effebb0b700 1 Processor -- start 2023-09-30T22:24:19.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.209+0000 7effebb0b700 1 -- start start 2023-09-30T22:24:19.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.210+0000 7effebb0b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7effe409e340 0x7effe41359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.210+0000 7effebb0b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7effe4135f20 0x7effe4138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.210+0000 7effebb0b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effe409aaa0 con 0x7effe409d860 2023-09-30T22:24:19.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.210+0000 7effebb0b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe409e730 con 0x7effe4135f20 2023-09-30T22:24:19.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.210+0000 7effebb0b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effe409f870 con 0x7effe409e340 2023-09-30T22:24:19.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.210+0000 7effea0a8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7effe4135f20 0x7effe4138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.210+0000 7effe98a7700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7effe409d860 0x7effe409dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49412/0 (socket says 172.21.15.156:49412) 2023-09-30T22:24:19.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.210+0000 7effe90a6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7effe409e340 0x7effe41359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.210+0000 7effe98a7700 1 -- 172.21.15.156:0/496312769 learned_addr learned my addr 172.21.15.156:0/496312769 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:19.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.210+0000 7effe90a6700 1 -- 172.21.15.156:0/496312769 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7effe4135f20 msgr2=0x7effe4138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:19.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.210+0000 7effe88a5700 1 -- 172.21.15.156:0/496312769 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 462005051 0 0) 0x7effe409aaa0 con 0x7effe409d860 2023-09-30T22:24:19.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.210+0000 7effe90a6700 1 --2- 172.21.15.156:0/496312769 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7effe4135f20 0x7effe4138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.210+0000 7effe90a6700 1 -- 172.21.15.156:0/496312769 >> v1:172.21.15.156:6789/0 conn(0x7effe409d860 legacy=0x7effe409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.210+0000 7effe90a6700 1 -- 172.21.15.156:0/496312769 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe409b360 con 0x7effe409e340 2023-09-30T22:24:19.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.210+0000 7effea0a8700 1 --2- 172.21.15.156:0/496312769 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7effe4135f20 0x7effe4138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:19.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.210+0000 7effe90a6700 1 --2- 172.21.15.156:0/496312769 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7effe409e340 0x7effe41359e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7effe00098a0 tx=0x7effe0009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e7a8409a0fbba38 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:19.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.210+0000 7effe88a5700 1 -- 172.21.15.156:0/496312769 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe0011830 con 0x7effe409e340 2023-09-30T22:24:19.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.211+0000 7effe88a5700 1 -- 172.21.15.156:0/496312769 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe0011990 con 0x7effe409e340 2023-09-30T22:24:19.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.211+0000 7effe88a5700 1 -- 172.21.15.156:0/496312769 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe0011d20 con 0x7effe409e340 2023-09-30T22:24:19.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.211+0000 7effebb0b700 1 -- 172.21.15.156:0/496312769 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7effe409e340 msgr2=0x7effe41359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.211+0000 7effebb0b700 1 --2- 172.21.15.156:0/496312769 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7effe409e340 0x7effe41359e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7effe00098a0 tx=0x7effe0009bb0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.211+0000 7effebb0b700 1 -- 172.21.15.156:0/496312769 shutdown_connections 2023-09-30T22:24:19.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.211+0000 7effebb0b700 1 --2- 172.21.15.156:0/496312769 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7effe4135f20 0x7effe4138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.211+0000 7effebb0b700 1 --2- 172.21.15.156:0/496312769 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7effe409e340 0x7effe41359e0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.211+0000 7effebb0b700 1 -- 172.21.15.156:0/496312769 >> 172.21.15.156:0/496312769 conn(0x7effe4099c40 msgr2=0x7effe40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:19.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.211+0000 7effebb0b700 1 -- 172.21.15.156:0/496312769 shutdown_connections 2023-09-30T22:24:19.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.211+0000 7effebb0b700 1 -- 172.21.15.156:0/496312769 wait complete. 2023-09-30T22:24:19.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.212+0000 7effebb0b700 1 Processor -- start 2023-09-30T22:24:19.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.212+0000 7effebb0b700 1 -- start start 2023-09-30T22:24:19.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.212+0000 7effebb0b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7effe409d860 0x7effe41c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.212+0000 7effebb0b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effe409e340 0x7effe41c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.212+0000 7effebb0b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7effe4135f20 0x7effe41207c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.212+0000 7effebb0b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe4122c40 con 0x7effe409e340 2023-09-30T22:24:19.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.212+0000 7effebb0b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe41bb000 con 0x7effe4135f20 2023-09-30T22:24:19.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.212+0000 7effebb0b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effe4124010 con 0x7effe409d860 2023-09-30T22:24:19.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.213+0000 7effe98a7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7effe409d860 0x7effe41c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.213+0000 7effea0a8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7effe4135f20 0x7effe41207c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.213+0000 7effe98a7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7effe409d860 0x7effe41c8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52648/0 (socket says 172.21.15.156:52648) 2023-09-30T22:24:19.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.213+0000 7effea0a8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7effe4135f20 0x7effe41207c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53756/0 (socket says 172.21.15.156:53756) 2023-09-30T22:24:19.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.213+0000 7effe98a7700 1 -- 172.21.15.156:0/2616802153 learned_addr learned my addr 172.21.15.156:0/2616802153 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:19.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.213+0000 7effe90a6700 1 --2- 172.21.15.156:0/2616802153 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effe409e340 0x7effe41c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.213+0000 7effe98a7700 1 -- 172.21.15.156:0/2616802153 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7effe4135f20 msgr2=0x7effe41207c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.213+0000 7effe98a7700 1 --2- 172.21.15.156:0/2616802153 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7effe4135f20 0x7effe41207c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.213+0000 7effe98a7700 1 -- 172.21.15.156:0/2616802153 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effe409e340 msgr2=0x7effe41c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.213+0000 7effe98a7700 1 --2- 172.21.15.156:0/2616802153 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effe409e340 0x7effe41c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.213+0000 7effe98a7700 1 -- 172.21.15.156:0/2616802153 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effdc009a70 con 0x7effe409d860 2023-09-30T22:24:19.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.213+0000 7effe90a6700 1 --2- 172.21.15.156:0/2616802153 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effe409e340 0x7effe41c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:19.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.213+0000 7effea0a8700 1 --2- 172.21.15.156:0/2616802153 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7effe4135f20 0x7effe41207c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:19.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.213+0000 7effe98a7700 1 --2- 172.21.15.156:0/2616802153 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7effe409d860 0x7effe41c8620 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7effd400c520 tx=0x7effd400c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:19.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.213+0000 7effda7fc700 1 -- 172.21.15.156:0/2616802153 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd4004c80 con 0x7effe409d860 2023-09-30T22:24:19.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.213+0000 7effda7fc700 1 -- 172.21.15.156:0/2616802153 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd4004de0 con 0x7effe409d860 2023-09-30T22:24:19.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.213+0000 7effebb0b700 1 -- 172.21.15.156:0/2616802153 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effe00094a0 con 0x7effe409d860 2023-09-30T22:24:19.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.213+0000 7effda7fc700 1 -- 172.21.15.156:0/2616802153 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd4007310 con 0x7effe409d860 2023-09-30T22:24:19.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.213+0000 7effebb0b700 1 -- 172.21.15.156:0/2616802153 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe40a2090 con 0x7effe409d860 2023-09-30T22:24:19.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.214+0000 7effda7fc700 1 -- 172.21.15.156:0/2616802153 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7effd4007470 con 0x7effe409d860 2023-09-30T22:24:19.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.214+0000 7effda7fc700 1 -- 172.21.15.156:0/2616802153 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7effd403f240 con 0x7effe409d860 2023-09-30T22:24:19.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.214+0000 7effebb0b700 1 -- 172.21.15.156:0/2616802153 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe404f2a0 con 0x7effe409d860 2023-09-30T22:24:19.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.219+0000 7effda7fc700 1 -- 172.21.15.156:0/2616802153 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7effd40123b0 con 0x7effe409d860 2023-09-30T22:24:19.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.403+0000 7effebb0b700 1 -- 172.21.15.156:0/2616802153 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7effe41228c0 con 0x7effe409d860 2023-09-30T22:24:19.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.403+0000 7effda7fc700 1 -- 172.21.15.156:0/2616802153 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7effd4011360 con 0x7effe409d860 2023-09-30T22:24:19.404 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:19.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.405+0000 7effebb0b700 1 -- 172.21.15.156:0/2616802153 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7effe409d860 msgr2=0x7effe41c8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.405+0000 7effebb0b700 1 --2- 172.21.15.156:0/2616802153 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7effe409d860 0x7effe41c8620 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7effd400c520 tx=0x7effd400c830 comp rx=0 tx=0).stop 2023-09-30T22:24:19.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.405+0000 7effebb0b700 1 -- 172.21.15.156:0/2616802153 shutdown_connections 2023-09-30T22:24:19.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.405+0000 7effebb0b700 1 --2- 172.21.15.156:0/2616802153 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7effe4135f20 0x7effe41207c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.405+0000 7effebb0b700 1 --2- 172.21.15.156:0/2616802153 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7effe409d860 0x7effe41c8620 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.405+0000 7effebb0b700 1 --2- 172.21.15.156:0/2616802153 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effe409e340 0x7effe41c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.405+0000 7effebb0b700 1 -- 172.21.15.156:0/2616802153 >> 172.21.15.156:0/2616802153 conn(0x7effe4099c40 msgr2=0x7effe406eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:19.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.405+0000 7effebb0b700 1 -- 172.21.15.156:0/2616802153 shutdown_connections 2023-09-30T22:24:19.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.405+0000 7effebb0b700 1 -- 172.21.15.156:0/2616802153 wait complete. 2023-09-30T22:24:19.418 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:19.683 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:19.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.806+0000 7f9ac9ebc700 1 Processor -- start 2023-09-30T22:24:19.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.806+0000 7f9ac9ebc700 1 -- start start 2023-09-30T22:24:19.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.807+0000 7f9ac9ebc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ac409e950 0x7f9ac409ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.807+0000 7f9ac9ebc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ac4134330 0x7f9ac413be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.807+0000 7f9ac9ebc700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac406d8a0 con 0x7f9ac409f260 2023-09-30T22:24:19.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.807+0000 7f9ac9ebc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40a0680 con 0x7f9ac4134330 2023-09-30T22:24:19.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.807+0000 7f9ac9ebc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac406caa0 con 0x7f9ac409e950 2023-09-30T22:24:19.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.807+0000 7f9ac37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ac409e950 0x7f9ac409ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.807+0000 7f9ac2ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f9ac409f260 0x7f9ac4133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49416/0 (socket says 172.21.15.156:49416) 2023-09-30T22:24:19.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.807+0000 7f9ac37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ac409e950 0x7f9ac409ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52650/0 (socket says 172.21.15.156:52650) 2023-09-30T22:24:19.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.807+0000 7f9ac2ffd700 1 -- 172.21.15.156:0/1184776612 learned_addr learned my addr 172.21.15.156:0/1184776612 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:19.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.807+0000 7f9ac3fff700 1 --2- 172.21.15.156:0/1184776612 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ac4134330 0x7f9ac413be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.807+0000 7f9ac37fe700 1 -- 172.21.15.156:0/1184776612 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ac4134330 msgr2=0x7f9ac413be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:19.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.807+0000 7f9ac37fe700 1 --2- 172.21.15.156:0/1184776612 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ac4134330 0x7f9ac413be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.807+0000 7f9ac27fc700 1 -- 172.21.15.156:0/1184776612 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601745533 0 0) 0x7f9ac406d8a0 con 0x7f9ac409f260 2023-09-30T22:24:19.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.807+0000 7f9ac37fe700 1 -- 172.21.15.156:0/1184776612 >> v1:172.21.15.156:6789/0 conn(0x7f9ac409f260 legacy=0x7f9ac4133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.807+0000 7f9ac37fe700 1 -- 172.21.15.156:0/1184776612 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac406b920 con 0x7f9ac409e950 2023-09-30T22:24:19.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.807+0000 7f9ac3fff700 1 --2- 172.21.15.156:0/1184776612 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ac4134330 0x7f9ac413be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:19.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.807+0000 7f9ac37fe700 1 --2- 172.21.15.156:0/1184776612 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ac409e950 0x7f9ac409ed20 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8009850 tx=0x7f9ab8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82108fd192641804 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:19.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.807+0000 7f9ac27fc700 1 -- 172.21.15.156:0/1184776612 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8005e30 con 0x7f9ac409e950 2023-09-30T22:24:19.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.807+0000 7f9ac27fc700 1 -- 172.21.15.156:0/1184776612 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab8006030 con 0x7f9ac409e950 2023-09-30T22:24:19.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.807+0000 7f9ac27fc700 1 -- 172.21.15.156:0/1184776612 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab80063e0 con 0x7f9ac409e950 2023-09-30T22:24:19.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.808+0000 7f9ac9ebc700 1 -- 172.21.15.156:0/1184776612 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ac409e950 msgr2=0x7f9ac409ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.808+0000 7f9ac9ebc700 1 --2- 172.21.15.156:0/1184776612 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ac409e950 0x7f9ac409ed20 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8009850 tx=0x7f9ab8009b60 comp rx=0 tx=0).stop 2023-09-30T22:24:19.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.808+0000 7f9ac9ebc700 1 -- 172.21.15.156:0/1184776612 shutdown_connections 2023-09-30T22:24:19.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.808+0000 7f9ac9ebc700 1 --2- 172.21.15.156:0/1184776612 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ac4134330 0x7f9ac413be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.808+0000 7f9ac9ebc700 1 --2- 172.21.15.156:0/1184776612 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ac409e950 0x7f9ac409ed20 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.808+0000 7f9ac9ebc700 1 -- 172.21.15.156:0/1184776612 >> 172.21.15.156:0/1184776612 conn(0x7f9ac40a4470 msgr2=0x7f9ac40a4870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:19.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.808+0000 7f9ac9ebc700 1 -- 172.21.15.156:0/1184776612 shutdown_connections 2023-09-30T22:24:19.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.808+0000 7f9ac9ebc700 1 -- 172.21.15.156:0/1184776612 wait complete. 2023-09-30T22:24:19.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.809+0000 7f9ac9ebc700 1 Processor -- start 2023-09-30T22:24:19.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.809+0000 7f9ac9ebc700 1 -- start start 2023-09-30T22:24:19.813 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:19.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.809+0000 7f9ac9ebc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ac409e950 0x7f9ac41229b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.809+0000 7f9ac9ebc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ac409f260 0x7f9ac4122ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.809+0000 7f9ac9ebc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ac4134330 0x7f9ac4123430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.809+0000 7f9ac9ebc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac4125b00 con 0x7f9ac4134330 2023-09-30T22:24:19.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.809+0000 7f9ac9ebc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40a3a90 con 0x7f9ac409e950 2023-09-30T22:24:19.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.809+0000 7f9ac9ebc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac406ccc0 con 0x7f9ac409f260 2023-09-30T22:24:19.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.810+0000 7f9ac2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ac409f260 0x7f9ac4122ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.810+0000 7f9ac3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ac4134330 0x7f9ac4123430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.810+0000 7f9ac37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ac409e950 0x7f9ac41229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.810+0000 7f9ac2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ac409f260 0x7f9ac4122ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52660/0 (socket says 172.21.15.156:52660) 2023-09-30T22:24:19.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.810+0000 7f9ac2ffd700 1 -- 172.21.15.156:0/2326469214 learned_addr learned my addr 172.21.15.156:0/2326469214 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:19.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.810+0000 7f9ac3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ac4134330 0x7f9ac4123430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60776/0 (socket says 172.21.15.156:60776) 2023-09-30T22:24:19.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.810+0000 7f9ac2ffd700 1 -- 172.21.15.156:0/2326469214 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ac409e950 msgr2=0x7f9ac41229b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.810+0000 7f9ac2ffd700 1 --2- 172.21.15.156:0/2326469214 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ac409e950 0x7f9ac41229b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.810+0000 7f9ac2ffd700 1 -- 172.21.15.156:0/2326469214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ac4134330 msgr2=0x7f9ac4123430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.810+0000 7f9ac2ffd700 1 --2- 172.21.15.156:0/2326469214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ac4134330 0x7f9ac4123430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.810+0000 7f9ac2ffd700 1 -- 172.21.15.156:0/2326469214 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9abc009a70 con 0x7f9ac409f260 2023-09-30T22:24:19.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.810+0000 7f9ac3fff700 1 --2- 172.21.15.156:0/2326469214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ac4134330 0x7f9ac4123430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:19.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.810+0000 7f9ac2ffd700 1 --2- 172.21.15.156:0/2326469214 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ac409f260 0x7f9ac4122ef0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f9ab400c780 tx=0x7f9ab400ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:19.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.810+0000 7f9aabfff700 1 -- 172.21.15.156:0/2326469214 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40074e0 con 0x7f9ac409f260 2023-09-30T22:24:19.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.810+0000 7f9aabfff700 1 -- 172.21.15.156:0/2326469214 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab4007640 con 0x7f9ac409f260 2023-09-30T22:24:19.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.810+0000 7f9ac9ebc700 1 -- 172.21.15.156:0/2326469214 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab8009430 con 0x7f9ac409f260 2023-09-30T22:24:19.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.810+0000 7f9aabfff700 1 -- 172.21.15.156:0/2326469214 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4005a70 con 0x7f9ac409f260 2023-09-30T22:24:19.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.810+0000 7f9ac9ebc700 1 -- 172.21.15.156:0/2326469214 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac4126190 con 0x7f9ac409f260 2023-09-30T22:24:19.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.811+0000 7f9aabfff700 1 -- 172.21.15.156:0/2326469214 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9ab4005bd0 con 0x7f9ac409f260 2023-09-30T22:24:19.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.811+0000 7f9aabfff700 1 -- 172.21.15.156:0/2326469214 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9ab403ea90 con 0x7f9ac409f260 2023-09-30T22:24:19.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.811+0000 7f9ac9ebc700 1 -- 172.21.15.156:0/2326469214 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac404f2a0 con 0x7f9ac409f260 2023-09-30T22:24:19.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.816+0000 7f9aabfff700 1 -- 172.21.15.156:0/2326469214 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9ab4017070 con 0x7f9ac409f260 2023-09-30T22:24:19.864 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:19.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.944+0000 7f2d6c183700 1 Processor -- start 2023-09-30T22:24:19.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.944+0000 7f2d6c183700 1 -- start start 2023-09-30T22:24:19.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.945+0000 7f2d6c183700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d640a0a70 0x7f2d640a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.945+0000 7f2d6c183700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d640a1380 0x7f2d64133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.945+0000 7f2d6c183700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2d64133f50 0x7f2d641343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.945+0000 7f2d6c183700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d6409e9d0 con 0x7f2d64133f50 2023-09-30T22:24:19.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.945+0000 7f2d6c183700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6409dc00 con 0x7f2d640a1380 2023-09-30T22:24:19.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.945+0000 7f2d6c183700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6409dec0 con 0x7f2d640a0a70 2023-09-30T22:24:19.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.945+0000 7f2d6971e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d640a1380 0x7f2d64133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.945+0000 7f2d69f1f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d640a0a70 0x7f2d640a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.945+0000 7f2d69f1f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d640a0a70 0x7f2d640a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:52670/0 (socket says 172.21.15.156:52670) 2023-09-30T22:24:19.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.945+0000 7f2d6971e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d640a1380 0x7f2d64133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53774/0 (socket says 172.21.15.156:53774) 2023-09-30T22:24:19.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.945+0000 7f2d69f1f700 1 -- 172.21.15.156:0/416127935 learned_addr learned my addr 172.21.15.156:0/416127935 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:19.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.945+0000 7f2d6a720700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2d64133f50 0x7f2d641343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.945+0000 7f2d6971e700 1 -- 172.21.15.156:0/416127935 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d640a0a70 msgr2=0x7f2d640a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:19.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.945+0000 7f2d6971e700 1 --2- 172.21.15.156:0/416127935 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d640a0a70 0x7f2d640a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.945+0000 7f2d6971e700 1 -- 172.21.15.156:0/416127935 >> v2:172.21.15.156:3300/0 conn(0x7f2d64133f50 msgr2=0x7f2d641343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:19.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.945+0000 7f2d6971e700 1 --2- 172.21.15.156:0/416127935 >> v2:172.21.15.156:3300/0 conn(0x7f2d64133f50 0x7f2d641343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.945+0000 7f2d6971e700 1 -- 172.21.15.156:0/416127935 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6409e6a0 con 0x7f2d640a1380 2023-09-30T22:24:19.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.945+0000 7f2d6a720700 1 --2- 172.21.15.156:0/416127935 >> v2:172.21.15.156:3300/0 conn(0x7f2d64133f50 0x7f2d641343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:19.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.946+0000 7f2d6971e700 1 --2- 172.21.15.156:0/416127935 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d640a1380 0x7f2d64133a10 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f2d54009840 tx=0x7f2d54009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42eed4e98ffe5340 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:19.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.946+0000 7f2d68f1d700 1 -- 172.21.15.156:0/416127935 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d54011830 con 0x7f2d640a1380 2023-09-30T22:24:19.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.946+0000 7f2d68f1d700 1 -- 172.21.15.156:0/416127935 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d54011990 con 0x7f2d640a1380 2023-09-30T22:24:19.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.946+0000 7f2d68f1d700 1 -- 172.21.15.156:0/416127935 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d54011d20 con 0x7f2d640a1380 2023-09-30T22:24:19.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.946+0000 7f2d6c183700 1 -- 172.21.15.156:0/416127935 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d640a1380 msgr2=0x7f2d64133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.946+0000 7f2d6c183700 1 --2- 172.21.15.156:0/416127935 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d640a1380 0x7f2d64133a10 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f2d54009840 tx=0x7f2d54009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:19.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.946+0000 7f2d6c183700 1 -- 172.21.15.156:0/416127935 shutdown_connections 2023-09-30T22:24:19.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.947+0000 7f2d6c183700 1 --2- 172.21.15.156:0/416127935 >> v2:172.21.15.156:3300/0 conn(0x7f2d64133f50 0x7f2d641343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.947+0000 7f2d6c183700 1 --2- 172.21.15.156:0/416127935 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d640a0a70 0x7f2d640a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.947+0000 7f2d6c183700 1 --2- 172.21.15.156:0/416127935 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d640a1380 0x7f2d64133a10 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.947+0000 7f2d6c183700 1 -- 172.21.15.156:0/416127935 >> 172.21.15.156:0/416127935 conn(0x7f2d640a6610 msgr2=0x7f2d640a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:19.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.947+0000 7f2d6c183700 1 -- 172.21.15.156:0/416127935 shutdown_connections 2023-09-30T22:24:19.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.947+0000 7f2d6c183700 1 -- 172.21.15.156:0/416127935 wait complete. 2023-09-30T22:24:19.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.947+0000 7f2d6c183700 1 Processor -- start 2023-09-30T22:24:19.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.948+0000 7f2d6c183700 1 -- start start 2023-09-30T22:24:19.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.948+0000 7f2d6c183700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d640a0a70 0x7f2d64121850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.948+0000 7f2d6c183700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d640a1380 0x7f2d64121d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.948+0000 7f2d6c183700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d64133f50 0x7f2d641222d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.948+0000 7f2d6c183700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d64124aa0 con 0x7f2d640a0a70 2023-09-30T22:24:19.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.948+0000 7f2d6c183700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d64133a10 con 0x7f2d640a1380 2023-09-30T22:24:19.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.948+0000 7f2d6c183700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d640a03e0 con 0x7f2d64133f50 2023-09-30T22:24:19.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.948+0000 7f2d6971e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d640a1380 0x7f2d64121d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.948+0000 7f2d6971e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d640a1380 0x7f2d64121d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53780/0 (socket says 172.21.15.156:53780) 2023-09-30T22:24:19.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.948+0000 7f2d6971e700 1 -- 172.21.15.156:0/1287590287 learned_addr learned my addr 172.21.15.156:0/1287590287 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:19.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.948+0000 7f2d69f1f700 1 --2- 172.21.15.156:0/1287590287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d640a0a70 0x7f2d64121850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.948+0000 7f2d6a720700 1 --2- 172.21.15.156:0/1287590287 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d64133f50 0x7f2d641222d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.948+0000 7f2d6971e700 1 -- 172.21.15.156:0/1287590287 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d64133f50 msgr2=0x7f2d641222d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.948+0000 7f2d6971e700 1 --2- 172.21.15.156:0/1287590287 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d64133f50 0x7f2d641222d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.948+0000 7f2d6971e700 1 -- 172.21.15.156:0/1287590287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d640a0a70 msgr2=0x7f2d64121850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.948+0000 7f2d6971e700 1 --2- 172.21.15.156:0/1287590287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d640a0a70 0x7f2d64121850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.948+0000 7f2d6971e700 1 -- 172.21.15.156:0/1287590287 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5c009a70 con 0x7f2d640a1380 2023-09-30T22:24:19.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.948+0000 7f2d69f1f700 1 --2- 172.21.15.156:0/1287590287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d640a0a70 0x7f2d64121850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:19.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.949+0000 7f2d6971e700 1 --2- 172.21.15.156:0/1287590287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d640a1380 0x7f2d64121d90 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f2d540090b0 tx=0x7f2d54004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:19.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.949+0000 7f2d5a7fc700 1 -- 172.21.15.156:0/1287590287 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d54004450 con 0x7f2d640a1380 2023-09-30T22:24:19.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.949+0000 7f2d5a7fc700 1 -- 172.21.15.156:0/1287590287 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5401f070 con 0x7f2d640a1380 2023-09-30T22:24:19.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.949+0000 7f2d6c183700 1 -- 172.21.15.156:0/1287590287 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d540094a0 con 0x7f2d640a1380 2023-09-30T22:24:19.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.949+0000 7f2d5a7fc700 1 -- 172.21.15.156:0/1287590287 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d540038e0 con 0x7f2d640a1380 2023-09-30T22:24:19.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.949+0000 7f2d6c183700 1 -- 172.21.15.156:0/1287590287 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d641250c0 con 0x7f2d640a1380 2023-09-30T22:24:19.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.950+0000 7f2d5a7fc700 1 -- 172.21.15.156:0/1287590287 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d54003a40 con 0x7f2d640a1380 2023-09-30T22:24:19.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.950+0000 7f2d6c183700 1 -- 172.21.15.156:0/1287590287 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d6409d100 con 0x7f2d640a1380 2023-09-30T22:24:19.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.950+0000 7f2d5a7fc700 1 -- 172.21.15.156:0/1287590287 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2d54021070 con 0x7f2d640a1380 2023-09-30T22:24:19.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.958+0000 7f2d5a7fc700 1 -- 172.21.15.156:0/1287590287 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d5402b020 con 0x7f2d640a1380 2023-09-30T22:24:19.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.995+0000 7f028be03700 1 Processor -- start 2023-09-30T22:24:19.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.995+0000 7f028be03700 1 -- start start 2023-09-30T22:24:19.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.996+0000 7f028be03700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02840a1550 0x7f0284138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.996+0000 7f028be03700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0284139200 0x7f028413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.996+0000 7f028be03700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f028409e9d0 con 0x7f02840a0a70 2023-09-30T22:24:19.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.996+0000 7f028be03700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f028409dc00 con 0x7f02840a1550 2023-09-30T22:24:19.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.996+0000 7f028be03700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f028409dec0 con 0x7f0284139200 2023-09-30T22:24:19.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.996+0000 7f0289b9f700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f02840a0a70 0x7f02840a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49430/0 (socket says 172.21.15.156:49430) 2023-09-30T22:24:19.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.996+0000 7f028939e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02840a1550 0x7f0284138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.996+0000 7f0289b9f700 1 -- 172.21.15.156:0/730793340 learned_addr learned my addr 172.21.15.156:0/730793340 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:20.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.996+0000 7f028a3a0700 1 --2- 172.21.15.156:0/730793340 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0284139200 0x7f028413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.996+0000 7f028a3a0700 1 -- 172.21.15.156:0/730793340 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02840a1550 msgr2=0x7f0284138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:20.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.996+0000 7f0288b9d700 1 -- 172.21.15.156:0/730793340 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 457296876 0 0) 0x7f028409e9d0 con 0x7f02840a0a70 2023-09-30T22:24:20.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.996+0000 7f028a3a0700 1 --2- 172.21.15.156:0/730793340 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02840a1550 0x7f0284138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.996+0000 7f028a3a0700 1 -- 172.21.15.156:0/730793340 >> v1:172.21.15.156:6789/0 conn(0x7f02840a0a70 legacy=0x7f02840a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.996+0000 7f028a3a0700 1 -- 172.21.15.156:0/730793340 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f028409e6a0 con 0x7f0284139200 2023-09-30T22:24:20.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.996+0000 7f028939e700 1 --2- 172.21.15.156:0/730793340 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02840a1550 0x7f0284138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:20.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.997+0000 7f028a3a0700 1 --2- 172.21.15.156:0/730793340 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0284139200 0x7f028413b5e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f027c009dc0 tx=0x7f027c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea14994eb46b3e6f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:20.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.997+0000 7f0288b9d700 1 -- 172.21.15.156:0/730793340 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c00e070 con 0x7f0284139200 2023-09-30T22:24:20.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.997+0000 7f0288b9d700 1 -- 172.21.15.156:0/730793340 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027c00bb20 con 0x7f0284139200 2023-09-30T22:24:20.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.997+0000 7f0288b9d700 1 -- 172.21.15.156:0/730793340 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c012430 con 0x7f0284139200 2023-09-30T22:24:20.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.997+0000 7f028be03700 1 -- 172.21.15.156:0/730793340 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0284139200 msgr2=0x7f028413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.997+0000 7f028be03700 1 --2- 172.21.15.156:0/730793340 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0284139200 0x7f028413b5e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f027c009dc0 tx=0x7f027c00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:20.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.997+0000 7f028be03700 1 -- 172.21.15.156:0/730793340 shutdown_connections 2023-09-30T22:24:20.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.997+0000 7f028be03700 1 --2- 172.21.15.156:0/730793340 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0284139200 0x7f028413b5e0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.997+0000 7f028be03700 1 --2- 172.21.15.156:0/730793340 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02840a1550 0x7f0284138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.997+0000 7f028be03700 1 -- 172.21.15.156:0/730793340 >> 172.21.15.156:0/730793340 conn(0x7f02840a6610 msgr2=0x7f02840a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:20.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.997+0000 7f028be03700 1 -- 172.21.15.156:0/730793340 shutdown_connections 2023-09-30T22:24:20.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.997+0000 7f028be03700 1 -- 172.21.15.156:0/730793340 wait complete. 2023-09-30T22:24:20.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.998+0000 7f028be03700 1 Processor -- start 2023-09-30T22:24:20.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.998+0000 7f028be03700 1 -- start start 2023-09-30T22:24:20.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.999+0000 7f028be03700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02840a0a70 0x7f028411e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.999+0000 7f028be03700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02840a1550 0x7f028411ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.999+0000 7f028be03700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0284139200 0x7f028411f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.999+0000 7f028be03700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0284122080 con 0x7f0284139200 2023-09-30T22:24:20.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.999+0000 7f028be03700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0284120560 con 0x7f02840a0a70 2023-09-30T22:24:20.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.999+0000 7f028be03700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f028409d340 con 0x7f02840a1550 2023-09-30T22:24:20.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.999+0000 7f0289b9f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02840a0a70 0x7f028411e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.999+0000 7f0289b9f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02840a0a70 0x7f028411e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53794/0 (socket says 172.21.15.156:53794) 2023-09-30T22:24:20.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.999+0000 7f0289b9f700 1 -- 172.21.15.156:0/3853884111 learned_addr learned my addr 172.21.15.156:0/3853884111 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:20.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.999+0000 7f028939e700 1 --2- 172.21.15.156:0/3853884111 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02840a1550 0x7f028411ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.999+0000 7f028a3a0700 1 --2- 172.21.15.156:0/3853884111 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0284139200 0x7f028411f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.999+0000 7f0289b9f700 1 -- 172.21.15.156:0/3853884111 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02840a1550 msgr2=0x7f028411ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.999+0000 7f0289b9f700 1 --2- 172.21.15.156:0/3853884111 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02840a1550 0x7f028411ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.999+0000 7f0289b9f700 1 -- 172.21.15.156:0/3853884111 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0284139200 msgr2=0x7f028411f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.999+0000 7f0289b9f700 1 --2- 172.21.15.156:0/3853884111 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0284139200 0x7f028411f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.999+0000 7f0289b9f700 1 -- 172.21.15.156:0/3853884111 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02740094a0 con 0x7f02840a0a70 2023-09-30T22:24:20.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.999+0000 7f028a3a0700 1 --2- 172.21.15.156:0/3853884111 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0284139200 0x7f028411f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:20.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.999+0000 7f0289b9f700 1 --2- 172.21.15.156:0/3853884111 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02840a0a70 0x7f028411e7a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f028000c520 tx=0x7f028000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:20.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:19.999+0000 7f027a7fc700 1 -- 172.21.15.156:0/3853884111 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0280004c80 con 0x7f02840a0a70 2023-09-30T22:24:20.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.000+0000 7f027a7fc700 1 -- 172.21.15.156:0/3853884111 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0280004de0 con 0x7f02840a0a70 2023-09-30T22:24:20.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.000+0000 7f028be03700 1 -- 172.21.15.156:0/3853884111 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f027c009a70 con 0x7f02840a0a70 2023-09-30T22:24:20.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.000+0000 7f027a7fc700 1 -- 172.21.15.156:0/3853884111 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0280007310 con 0x7f02840a0a70 2023-09-30T22:24:20.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.000+0000 7f028be03700 1 -- 172.21.15.156:0/3853884111 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0284134730 con 0x7f02840a0a70 2023-09-30T22:24:20.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.001+0000 7f028be03700 1 -- 172.21.15.156:0/3853884111 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0284122bb0 con 0x7f02840a0a70 2023-09-30T22:24:20.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.001+0000 7f027a7fc700 1 -- 172.21.15.156:0/3853884111 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0280007470 con 0x7f02840a0a70 2023-09-30T22:24:20.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.001+0000 7f027a7fc700 1 -- 172.21.15.156:0/3853884111 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f028003f3c0 con 0x7f02840a0a70 2023-09-30T22:24:20.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.006+0000 7f027a7fc700 1 -- 172.21.15.156:0/3853884111 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f02800133c0 con 0x7f02840a0a70 2023-09-30T22:24:20.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.019+0000 7f9ac9ebc700 1 -- 172.21.15.156:0/2326469214 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9ac41244b0 con 0x7f9ac409f260 2023-09-30T22:24:20.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.019+0000 7f9aabfff700 1 -- 172.21.15.156:0/2326469214 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9ab4007da0 con 0x7f9ac409f260 2023-09-30T22:24:20.020 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:20.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.022+0000 7f9ac9ebc700 1 -- 172.21.15.156:0/2326469214 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ac409f260 msgr2=0x7f9ac4122ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.022+0000 7f9ac9ebc700 1 --2- 172.21.15.156:0/2326469214 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ac409f260 0x7f9ac4122ef0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f9ab400c780 tx=0x7f9ab400ca90 comp rx=0 tx=0).stop 2023-09-30T22:24:20.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.022+0000 7f9ac9ebc700 1 -- 172.21.15.156:0/2326469214 shutdown_connections 2023-09-30T22:24:20.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.022+0000 7f9ac9ebc700 1 --2- 172.21.15.156:0/2326469214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ac4134330 0x7f9ac4123430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.022+0000 7f9ac9ebc700 1 --2- 172.21.15.156:0/2326469214 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9ac409e950 0x7f9ac41229b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.022+0000 7f9ac9ebc700 1 --2- 172.21.15.156:0/2326469214 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9ac409f260 0x7f9ac4122ef0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.022+0000 7f9ac9ebc700 1 -- 172.21.15.156:0/2326469214 >> 172.21.15.156:0/2326469214 conn(0x7f9ac40a4470 msgr2=0x7f9ac409d460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:20.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.022+0000 7f9ac9ebc700 1 -- 172.21.15.156:0/2326469214 shutdown_connections 2023-09-30T22:24:20.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.022+0000 7f9ac9ebc700 1 -- 172.21.15.156:0/2326469214 wait complete. 2023-09-30T22:24:20.035 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:20.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.152+0000 7f2d6c183700 1 -- 172.21.15.156:0/1287590287 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2d6406d3f0 con 0x7f2d640a1380 2023-09-30T22:24:20.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.153+0000 7f2d5a7fc700 1 -- 172.21.15.156:0/1287590287 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d5401a430 con 0x7f2d640a1380 2023-09-30T22:24:20.154 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:20.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.154+0000 7f2d6c183700 1 -- 172.21.15.156:0/1287590287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d640a1380 msgr2=0x7f2d64121d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.154+0000 7f2d6c183700 1 --2- 172.21.15.156:0/1287590287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d640a1380 0x7f2d64121d90 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f2d540090b0 tx=0x7f2d54004750 comp rx=0 tx=0).stop 2023-09-30T22:24:20.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.155+0000 7f2d6c183700 1 -- 172.21.15.156:0/1287590287 shutdown_connections 2023-09-30T22:24:20.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.155+0000 7f2d6c183700 1 --2- 172.21.15.156:0/1287590287 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d64133f50 0x7f2d641222d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.155+0000 7f2d6c183700 1 --2- 172.21.15.156:0/1287590287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d640a0a70 0x7f2d64121850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.155+0000 7f2d6c183700 1 --2- 172.21.15.156:0/1287590287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d640a1380 0x7f2d64121d90 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.155+0000 7f2d6c183700 1 -- 172.21.15.156:0/1287590287 >> 172.21.15.156:0/1287590287 conn(0x7f2d640a6610 msgr2=0x7f2d64133280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:20.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.155+0000 7f2d6c183700 1 -- 172.21.15.156:0/1287590287 shutdown_connections 2023-09-30T22:24:20.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.155+0000 7f2d6c183700 1 -- 172.21.15.156:0/1287590287 wait complete. 2023-09-30T22:24:20.167 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:20.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.199+0000 7f028be03700 1 -- 172.21.15.156:0/3853884111 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f028404f2a0 con 0x7f02840a0a70 2023-09-30T22:24:20.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.200+0000 7f027a7fc700 1 -- 172.21.15.156:0/3853884111 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0280011360 con 0x7f02840a0a70 2023-09-30T22:24:20.201 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:20.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.202+0000 7f028be03700 1 -- 172.21.15.156:0/3853884111 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02840a0a70 msgr2=0x7f028411e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.202+0000 7f028be03700 1 --2- 172.21.15.156:0/3853884111 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02840a0a70 0x7f028411e7a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f028000c520 tx=0x7f028000c830 comp rx=0 tx=0).stop 2023-09-30T22:24:20.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.202+0000 7f028be03700 1 -- 172.21.15.156:0/3853884111 shutdown_connections 2023-09-30T22:24:20.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.202+0000 7f028be03700 1 --2- 172.21.15.156:0/3853884111 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0284139200 0x7f028411f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.202+0000 7f028be03700 1 --2- 172.21.15.156:0/3853884111 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f02840a0a70 0x7f028411e7a0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.202+0000 7f028be03700 1 --2- 172.21.15.156:0/3853884111 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f02840a1550 0x7f028411ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.202+0000 7f028be03700 1 -- 172.21.15.156:0/3853884111 >> 172.21.15.156:0/3853884111 conn(0x7f02840a6610 msgr2=0x7f02840a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:20.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.202+0000 7f028be03700 1 -- 172.21.15.156:0/3853884111 shutdown_connections 2023-09-30T22:24:20.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.202+0000 7f028be03700 1 -- 172.21.15.156:0/3853884111 wait complete. 2023-09-30T22:24:20.214 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:20.419 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:20.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.541+0000 7f66f909b700 1 Processor -- start 2023-09-30T22:24:20.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.541+0000 7f66f909b700 1 -- start start 2023-09-30T22:24:20.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.541+0000 7f66f909b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66f4136960 0x7f66f4138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.541+0000 7f66f909b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f66f4139280 0x7f66f413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.541+0000 7f66f909b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f406b2d0 con 0x7f66f4133ad0 2023-09-30T22:24:20.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.541+0000 7f66f909b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f41345b0 con 0x7f66f4139280 2023-09-30T22:24:20.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.541+0000 7f66f909b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f4133610 con 0x7f66f4136960 2023-09-30T22:24:20.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.542+0000 7f66f259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66f4136960 0x7f66f4138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.542+0000 7f66f359e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f66f4139280 0x7f66f413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.542+0000 7f66f359e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f66f4139280 0x7f66f413b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60822/0 (socket says 172.21.15.156:60822) 2023-09-30T22:24:20.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.542+0000 7f66f259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66f4136960 0x7f66f4138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53796/0 (socket says 172.21.15.156:53796) 2023-09-30T22:24:20.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.542+0000 7f66f359e700 1 -- 172.21.15.156:0/1597088911 learned_addr learned my addr 172.21.15.156:0/1597088911 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:20.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.542+0000 7f66f2d9d700 1 --1- 172.21.15.156:0/1597088911 >> v1:172.21.15.156:6789/0 conn(0x7f66f4133ad0 0x7f66f4133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49442/0 (socket says 172.21.15.156:49442) 2023-09-30T22:24:20.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.542+0000 7f66f259c700 1 -- 172.21.15.156:0/1597088911 >> v2:172.21.15.156:3300/0 conn(0x7f66f4139280 msgr2=0x7f66f413b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:20.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.542+0000 7f66f259c700 1 --2- 172.21.15.156:0/1597088911 >> v2:172.21.15.156:3300/0 conn(0x7f66f4139280 0x7f66f413b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.542+0000 7f66f259c700 1 -- 172.21.15.156:0/1597088911 >> v1:172.21.15.156:6789/0 conn(0x7f66f4133ad0 legacy=0x7f66f4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.542+0000 7f66f259c700 1 -- 172.21.15.156:0/1597088911 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f409a500 con 0x7f66f4136960 2023-09-30T22:24:20.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.542+0000 7f66f259c700 1 --2- 172.21.15.156:0/1597088911 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66f4136960 0x7f66f4138d40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f66e4009870 tx=0x7f66e4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9876973ac1e4727 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:20.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.542+0000 7f66f1d9b700 1 -- 172.21.15.156:0/1597088911 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4011830 con 0x7f66f4136960 2023-09-30T22:24:20.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.542+0000 7f66f1d9b700 1 -- 172.21.15.156:0/1597088911 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e4011990 con 0x7f66f4136960 2023-09-30T22:24:20.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.542+0000 7f66f1d9b700 1 -- 172.21.15.156:0/1597088911 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4011d20 con 0x7f66f4136960 2023-09-30T22:24:20.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.543+0000 7f66f909b700 1 -- 172.21.15.156:0/1597088911 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66f4136960 msgr2=0x7f66f4138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.543+0000 7f66f909b700 1 --2- 172.21.15.156:0/1597088911 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66f4136960 0x7f66f4138d40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f66e4009870 tx=0x7f66e4009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:20.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.543+0000 7f66f909b700 1 -- 172.21.15.156:0/1597088911 shutdown_connections 2023-09-30T22:24:20.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.543+0000 7f66f909b700 1 --2- 172.21.15.156:0/1597088911 >> v2:172.21.15.156:3300/0 conn(0x7f66f4139280 0x7f66f413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.543+0000 7f66f909b700 1 --2- 172.21.15.156:0/1597088911 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66f4136960 0x7f66f4138d40 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.543+0000 7f66f909b700 1 -- 172.21.15.156:0/1597088911 >> 172.21.15.156:0/1597088911 conn(0x7f66f4099c40 msgr2=0x7f66f40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:20.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.543+0000 7f66f909b700 1 -- 172.21.15.156:0/1597088911 shutdown_connections 2023-09-30T22:24:20.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.543+0000 7f66f909b700 1 -- 172.21.15.156:0/1597088911 wait complete. 2023-09-30T22:24:20.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.544+0000 7f66f909b700 1 Processor -- start 2023-09-30T22:24:20.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.544+0000 7f66f909b700 1 -- start start 2023-09-30T22:24:20.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.545+0000 7f66f909b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66f4133ad0 0x7f66f41c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.545+0000 7f66f909b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66f4136960 0x7f66f41c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.545+0000 7f66f909b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f66f4139280 0x7f66f41c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.545+0000 7f66f909b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f4070530 con 0x7f66f4136960 2023-09-30T22:24:20.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.545+0000 7f66f909b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f4070730 con 0x7f66f4133ad0 2023-09-30T22:24:20.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.545+0000 7f66f909b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66f406e900 con 0x7f66f4139280 2023-09-30T22:24:20.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.545+0000 7f66f259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66f4136960 0x7f66f41c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.545+0000 7f66f259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66f4136960 0x7f66f41c8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60824/0 (socket says 172.21.15.156:60824) 2023-09-30T22:24:20.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.545+0000 7f66f259c700 1 -- 172.21.15.156:0/1319019947 learned_addr learned my addr 172.21.15.156:0/1319019947 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:20.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.545+0000 7f66f359e700 1 --2- 172.21.15.156:0/1319019947 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f66f4139280 0x7f66f41c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.545+0000 7f66f2d9d700 1 --2- 172.21.15.156:0/1319019947 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66f4133ad0 0x7f66f41c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.545+0000 7f66f259c700 1 -- 172.21.15.156:0/1319019947 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f66f4139280 msgr2=0x7f66f41c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.545+0000 7f66f259c700 1 --2- 172.21.15.156:0/1319019947 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f66f4139280 0x7f66f41c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.545+0000 7f66f259c700 1 -- 172.21.15.156:0/1319019947 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66f4133ad0 msgr2=0x7f66f41c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.545+0000 7f66f259c700 1 --2- 172.21.15.156:0/1319019947 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66f4133ad0 0x7f66f41c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.545+0000 7f66f259c700 1 -- 172.21.15.156:0/1319019947 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e40094a0 con 0x7f66f4136960 2023-09-30T22:24:20.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.545+0000 7f66f259c700 1 --2- 172.21.15.156:0/1319019947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66f4136960 0x7f66f41c8ab0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f66e4014040 tx=0x7f66e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:20.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.545+0000 7f66db7fe700 1 -- 172.21.15.156:0/1319019947 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e40036a0 con 0x7f66f4136960 2023-09-30T22:24:20.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.545+0000 7f66db7fe700 1 -- 172.21.15.156:0/1319019947 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e401e070 con 0x7f66f4136960 2023-09-30T22:24:20.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.545+0000 7f66f909b700 1 -- 172.21.15.156:0/1319019947 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f4138f50 con 0x7f66f4136960 2023-09-30T22:24:20.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.545+0000 7f66db7fe700 1 -- 172.21.15.156:0/1319019947 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4003a60 con 0x7f66f4136960 2023-09-30T22:24:20.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.545+0000 7f66f909b700 1 -- 172.21.15.156:0/1319019947 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f4070ec0 con 0x7f66f4136960 2023-09-30T22:24:20.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.546+0000 7f66db7fe700 1 -- 172.21.15.156:0/1319019947 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f66e4003bc0 con 0x7f66f4136960 2023-09-30T22:24:20.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.546+0000 7f66db7fe700 1 -- 172.21.15.156:0/1319019947 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f66e40404d0 con 0x7f66f4136960 2023-09-30T22:24:20.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.546+0000 7f66f909b700 1 -- 172.21.15.156:0/1319019947 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f404f2a0 con 0x7f66f4136960 2023-09-30T22:24:20.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.551+0000 7f66db7fe700 1 -- 172.21.15.156:0/1319019947 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66e4015020 con 0x7f66f4136960 2023-09-30T22:24:20.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.736+0000 7f66f909b700 1 -- 172.21.15.156:0/1319019947 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f66f409f390 con 0x7f66f4136960 2023-09-30T22:24:20.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.736+0000 7f66db7fe700 1 -- 172.21.15.156:0/1319019947 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f66e402d970 con 0x7f66f4136960 2023-09-30T22:24:20.737 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:20.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.738+0000 7f66f909b700 1 -- 172.21.15.156:0/1319019947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66f4136960 msgr2=0x7f66f41c8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.738+0000 7f66f909b700 1 --2- 172.21.15.156:0/1319019947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66f4136960 0x7f66f41c8ab0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f66e4014040 tx=0x7f66e4004750 comp rx=0 tx=0).stop 2023-09-30T22:24:20.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.738+0000 7f66f909b700 1 -- 172.21.15.156:0/1319019947 shutdown_connections 2023-09-30T22:24:20.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.738+0000 7f66f909b700 1 --2- 172.21.15.156:0/1319019947 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f66f4139280 0x7f66f41c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.738+0000 7f66f909b700 1 --2- 172.21.15.156:0/1319019947 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66f4133ad0 0x7f66f41c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.738+0000 7f66f909b700 1 --2- 172.21.15.156:0/1319019947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66f4136960 0x7f66f41c8ab0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.738+0000 7f66f909b700 1 -- 172.21.15.156:0/1319019947 >> 172.21.15.156:0/1319019947 conn(0x7f66f4099c40 msgr2=0x7f66f4132b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:20.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.739+0000 7f66f909b700 1 -- 172.21.15.156:0/1319019947 shutdown_connections 2023-09-30T22:24:20.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:20.739+0000 7f66f909b700 1 -- 172.21.15.156:0/1319019947 wait complete. 2023-09-30T22:24:20.755 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:21.036 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:21.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.160+0000 7f938d44e700 1 Processor -- start 2023-09-30T22:24:21.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.160+0000 7f938d44e700 1 -- start start 2023-09-30T22:24:21.162 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.160+0000 7f938d44e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f93880a1550 0x7f9388138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.160+0000 7f938d44e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9388139200 0x7f938813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.160+0000 7f938d44e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938809e9d0 con 0x7f93880a0a70 2023-09-30T22:24:21.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.160+0000 7f938d44e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f938809dc00 con 0x7f9388139200 2023-09-30T22:24:21.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.160+0000 7f938d44e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f938809dec0 con 0x7f93880a1550 2023-09-30T22:24:21.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.161+0000 7f93877fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9388139200 0x7f938813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.161+0000 7f93867fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f93880a1550 0x7f9388138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.161+0000 7f93877fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9388139200 0x7f938813b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60836/0 (socket says 172.21.15.156:60836) 2023-09-30T22:24:21.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.161+0000 7f93877fe700 1 -- 172.21.15.156:0/2829815376 learned_addr learned my addr 172.21.15.156:0/2829815376 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:21.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.161+0000 7f9386ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f93880a0a70 0x7f93880a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:49446/0 (socket says 172.21.15.156:49446) 2023-09-30T22:24:21.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.161+0000 7f93867fc700 1 -- 172.21.15.156:0/2829815376 >> v2:172.21.15.156:3300/0 conn(0x7f9388139200 msgr2=0x7f938813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:21.163 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.161+0000 7f93867fc700 1 --2- 172.21.15.156:0/2829815376 >> v2:172.21.15.156:3300/0 conn(0x7f9388139200 0x7f938813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.161+0000 7f93867fc700 1 -- 172.21.15.156:0/2829815376 >> v1:172.21.15.156:6789/0 conn(0x7f93880a0a70 legacy=0x7f93880a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.161+0000 7f9385ffb700 1 -- 172.21.15.156:0/2829815376 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4108951008 0 0) 0x7f938809e9d0 con 0x7f93880a0a70 2023-09-30T22:24:21.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.161+0000 7f93867fc700 1 -- 172.21.15.156:0/2829815376 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938809e6a0 con 0x7f93880a1550 2023-09-30T22:24:21.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.161+0000 7f93877fe700 1 --2- 172.21.15.156:0/2829815376 >> v2:172.21.15.156:3300/0 conn(0x7f9388139200 0x7f938813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:21.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.161+0000 7f93867fc700 1 --2- 172.21.15.156:0/2829815376 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f93880a1550 0x7f9388138cc0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9378009840 tx=0x7f9378009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db83efd677e18929 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:21.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.161+0000 7f9385ffb700 1 -- 172.21.15.156:0/2829815376 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9378011830 con 0x7f93880a1550 2023-09-30T22:24:21.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.161+0000 7f9385ffb700 1 -- 172.21.15.156:0/2829815376 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9378011990 con 0x7f93880a1550 2023-09-30T22:24:21.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.161+0000 7f9385ffb700 1 -- 172.21.15.156:0/2829815376 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9378011d20 con 0x7f93880a1550 2023-09-30T22:24:21.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.162+0000 7f938d44e700 1 -- 172.21.15.156:0/2829815376 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f93880a1550 msgr2=0x7f9388138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.162+0000 7f938d44e700 1 --2- 172.21.15.156:0/2829815376 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f93880a1550 0x7f9388138cc0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9378009840 tx=0x7f9378009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:21.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.162+0000 7f938d44e700 1 -- 172.21.15.156:0/2829815376 shutdown_connections 2023-09-30T22:24:21.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.162+0000 7f938d44e700 1 --2- 172.21.15.156:0/2829815376 >> v2:172.21.15.156:3300/0 conn(0x7f9388139200 0x7f938813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.162+0000 7f938d44e700 1 --2- 172.21.15.156:0/2829815376 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f93880a1550 0x7f9388138cc0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.162+0000 7f938d44e700 1 -- 172.21.15.156:0/2829815376 >> 172.21.15.156:0/2829815376 conn(0x7f93880a6610 msgr2=0x7f93880a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:21.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.162+0000 7f938d44e700 1 -- 172.21.15.156:0/2829815376 shutdown_connections 2023-09-30T22:24:21.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.162+0000 7f938d44e700 1 -- 172.21.15.156:0/2829815376 wait complete. 2023-09-30T22:24:21.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.163+0000 7f938d44e700 1 Processor -- start 2023-09-30T22:24:21.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.163+0000 7f938d44e700 1 -- start start 2023-09-30T22:24:21.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.163+0000 7f938d44e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93880a0a70 0x7f938811e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.163+0000 7f938d44e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93880a1550 0x7f938811ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.163+0000 7f938d44e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9388139200 0x7f938811f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.163+0000 7f938d44e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938809cbb0 con 0x7f93880a1550 2023-09-30T22:24:21.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.163+0000 7f938d44e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9388122370 con 0x7f93880a0a70 2023-09-30T22:24:21.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.163+0000 7f938d44e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9388121a10 con 0x7f9388139200 2023-09-30T22:24:21.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.163+0000 7f93867fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93880a1550 0x7f938811ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.163+0000 7f93867fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93880a1550 0x7f938811ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:60838/0 (socket says 172.21.15.156:60838) 2023-09-30T22:24:21.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.163+0000 7f9386ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93880a0a70 0x7f938811e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.163+0000 7f93867fc700 1 -- 172.21.15.156:0/1416688953 learned_addr learned my addr 172.21.15.156:0/1416688953 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:21.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.164+0000 7f93877fe700 1 --2- 172.21.15.156:0/1416688953 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9388139200 0x7f938811f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.164+0000 7f9386ffd700 1 -- 172.21.15.156:0/1416688953 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9388139200 msgr2=0x7f938811f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.164+0000 7f9386ffd700 1 --2- 172.21.15.156:0/1416688953 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9388139200 0x7f938811f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.164+0000 7f9386ffd700 1 -- 172.21.15.156:0/1416688953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93880a1550 msgr2=0x7f938811ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.164+0000 7f9386ffd700 1 --2- 172.21.15.156:0/1416688953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93880a1550 0x7f938811ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.164+0000 7f9386ffd700 1 -- 172.21.15.156:0/1416688953 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9380009b30 con 0x7f93880a0a70 2023-09-30T22:24:21.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.164+0000 7f93867fc700 1 --2- 172.21.15.156:0/1416688953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93880a1550 0x7f938811ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:21.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.164+0000 7f93877fe700 1 --2- 172.21.15.156:0/1416688953 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9388139200 0x7f938811f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:21.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.164+0000 7f9386ffd700 1 --2- 172.21.15.156:0/1416688953 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93880a0a70 0x7f938811e7d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f937c00c470 tx=0x7f937c00c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:21.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.164+0000 7f936f7fe700 1 -- 172.21.15.156:0/1416688953 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c004c80 con 0x7f93880a0a70 2023-09-30T22:24:21.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.164+0000 7f936f7fe700 1 -- 172.21.15.156:0/1416688953 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937c004de0 con 0x7f93880a0a70 2023-09-30T22:24:21.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.164+0000 7f938d44e700 1 -- 172.21.15.156:0/1416688953 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93780094a0 con 0x7f93880a0a70 2023-09-30T22:24:21.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.164+0000 7f936f7fe700 1 -- 172.21.15.156:0/1416688953 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c007310 con 0x7f93880a0a70 2023-09-30T22:24:21.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.164+0000 7f938d44e700 1 -- 172.21.15.156:0/1416688953 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9388120b40 con 0x7f93880a0a70 2023-09-30T22:24:21.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.165+0000 7f936f7fe700 1 -- 172.21.15.156:0/1416688953 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f937c007470 con 0x7f93880a0a70 2023-09-30T22:24:21.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.165+0000 7f938d44e700 1 -- 172.21.15.156:0/1416688953 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9388121d70 con 0x7f93880a0a70 2023-09-30T22:24:21.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.165+0000 7f936f7fe700 1 -- 172.21.15.156:0/1416688953 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f937c03f200 con 0x7f93880a0a70 2023-09-30T22:24:21.171 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:21.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.170+0000 7f936f7fe700 1 -- 172.21.15.156:0/1416688953 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f937c007720 con 0x7f93880a0a70 2023-09-30T22:24:21.215 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:21.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.300+0000 7f66223e3700 1 Processor -- start 2023-09-30T22:24:21.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.300+0000 7f66223e3700 1 -- start start 2023-09-30T22:24:21.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.301+0000 7f66223e3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f661c136960 0x7f661c138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.301+0000 7f66223e3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f661c139280 0x7f661c13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.301+0000 7f66223e3700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f661c06b2d0 con 0x7f661c133ad0 2023-09-30T22:24:21.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.301+0000 7f66223e3700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f661c1345b0 con 0x7f661c139280 2023-09-30T22:24:21.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.301+0000 7f66223e3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661c133610 con 0x7f661c136960 2023-09-30T22:24:21.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.301+0000 7f6620980700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f661c139280 0x7f661c13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.301+0000 7f661b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f661c136960 0x7f661c138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.301+0000 7f6620980700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f661c139280 0x7f661c13b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49436/0 (socket says 172.21.15.156:49436) 2023-09-30T22:24:21.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.301+0000 7f6620980700 1 -- 172.21.15.156:0/4217787627 learned_addr learned my addr 172.21.15.156:0/4217787627 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:21.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.301+0000 7f6620980700 1 -- 172.21.15.156:0/4217787627 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f661c136960 msgr2=0x7f661c138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:21.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.301+0000 7f6620980700 1 --2- 172.21.15.156:0/4217787627 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f661c136960 0x7f661c138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.301+0000 7f6620980700 1 -- 172.21.15.156:0/4217787627 >> v1:172.21.15.156:6789/0 conn(0x7f661c133ad0 legacy=0x7f661c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.301+0000 7f661affd700 1 -- 172.21.15.156:0/4217787627 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649389944 0 0) 0x7f661c06b2d0 con 0x7f661c133ad0 2023-09-30T22:24:21.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.302+0000 7f6620980700 1 -- 172.21.15.156:0/4217787627 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661c09a500 con 0x7f661c139280 2023-09-30T22:24:21.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.302+0000 7f661b7fe700 1 --2- 172.21.15.156:0/4217787627 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f661c136960 0x7f661c138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:21.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.302+0000 7f6620980700 1 --2- 172.21.15.156:0/4217787627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f661c139280 0x7f661c13b660 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f6614009e80 tx=0x7f661400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488bf3cf9638f97e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:21.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.302+0000 7f661affd700 1 -- 172.21.15.156:0/4217787627 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661400e070 con 0x7f661c139280 2023-09-30T22:24:21.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.302+0000 7f661affd700 1 -- 172.21.15.156:0/4217787627 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661400b8d0 con 0x7f661c139280 2023-09-30T22:24:21.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.302+0000 7f661affd700 1 -- 172.21.15.156:0/4217787627 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661400bc80 con 0x7f661c139280 2023-09-30T22:24:21.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.302+0000 7f66223e3700 1 -- 172.21.15.156:0/4217787627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f661c139280 msgr2=0x7f661c13b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.302+0000 7f66223e3700 1 --2- 172.21.15.156:0/4217787627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f661c139280 0x7f661c13b660 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f6614009e80 tx=0x7f661400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:21.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.303+0000 7f66223e3700 1 -- 172.21.15.156:0/4217787627 shutdown_connections 2023-09-30T22:24:21.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.303+0000 7f66223e3700 1 --2- 172.21.15.156:0/4217787627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f661c139280 0x7f661c13b660 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.303+0000 7f66223e3700 1 --2- 172.21.15.156:0/4217787627 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f661c136960 0x7f661c138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.303+0000 7f66223e3700 1 -- 172.21.15.156:0/4217787627 >> 172.21.15.156:0/4217787627 conn(0x7f661c099c40 msgr2=0x7f661c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:21.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.303+0000 7f66223e3700 1 -- 172.21.15.156:0/4217787627 shutdown_connections 2023-09-30T22:24:21.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.303+0000 7f66223e3700 1 -- 172.21.15.156:0/4217787627 wait complete. 2023-09-30T22:24:21.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.304+0000 7f66223e3700 1 Processor -- start 2023-09-30T22:24:21.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.304+0000 7f66223e3700 1 -- start start 2023-09-30T22:24:21.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.305+0000 7f66223e3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f661c133ad0 0x7f661c12ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.305+0000 7f66223e3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f661c136960 0x7f661c12d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.305+0000 7f66223e3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f661c139280 0x7f661c071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.305+0000 7f66223e3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661c06ffd0 con 0x7f661c139280 2023-09-30T22:24:21.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.305+0000 7f66223e3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661c09f390 con 0x7f661c133ad0 2023-09-30T22:24:21.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.305+0000 7f66223e3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f661c072270 con 0x7f661c136960 2023-09-30T22:24:21.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.305+0000 7f661bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f661c133ad0 0x7f661c12ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.305+0000 7f661bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f661c133ad0 0x7f661c12ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:47656/0 (socket says 172.21.15.156:47656) 2023-09-30T22:24:21.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.305+0000 7f661bfff700 1 -- 172.21.15.156:0/1728116713 learned_addr learned my addr 172.21.15.156:0/1728116713 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:21.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.305+0000 7f661b7fe700 1 --2- 172.21.15.156:0/1728116713 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f661c136960 0x7f661c12d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.305+0000 7f6620980700 1 --2- 172.21.15.156:0/1728116713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f661c139280 0x7f661c071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.305+0000 7f661bfff700 1 -- 172.21.15.156:0/1728116713 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f661c136960 msgr2=0x7f661c12d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.305+0000 7f661bfff700 1 --2- 172.21.15.156:0/1728116713 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f661c136960 0x7f661c12d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.305+0000 7f661bfff700 1 -- 172.21.15.156:0/1728116713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f661c139280 msgr2=0x7f661c071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.305+0000 7f661bfff700 1 --2- 172.21.15.156:0/1728116713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f661c139280 0x7f661c071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.305+0000 7f661bfff700 1 -- 172.21.15.156:0/1728116713 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66100094a0 con 0x7f661c133ad0 2023-09-30T22:24:21.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.305+0000 7f6620980700 1 --2- 172.21.15.156:0/1728116713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f661c139280 0x7f661c071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:21.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.305+0000 7f661b7fe700 1 --2- 172.21.15.156:0/1728116713 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f661c136960 0x7f661c12d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:21.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.305+0000 7f661bfff700 1 --2- 172.21.15.156:0/1728116713 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f661c133ad0 0x7f661c12ce80 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f660c00c450 tx=0x7f660c00c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:21.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.305+0000 7f6618ff9700 1 -- 172.21.15.156:0/1728116713 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c0054e0 con 0x7f661c133ad0 2023-09-30T22:24:21.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.306+0000 7f6618ff9700 1 -- 172.21.15.156:0/1728116713 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660c003680 con 0x7f661c133ad0 2023-09-30T22:24:21.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.306+0000 7f66223e3700 1 -- 172.21.15.156:0/1728116713 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6614009b30 con 0x7f661c133ad0 2023-09-30T22:24:21.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.306+0000 7f6618ff9700 1 -- 172.21.15.156:0/1728116713 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c003a30 con 0x7f661c133ad0 2023-09-30T22:24:21.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.306+0000 7f66223e3700 1 -- 172.21.15.156:0/1728116713 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f661c06ee50 con 0x7f661c133ad0 2023-09-30T22:24:21.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.306+0000 7f6618ff9700 1 -- 172.21.15.156:0/1728116713 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f660c003b90 con 0x7f661c133ad0 2023-09-30T22:24:21.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.307+0000 7f6618ff9700 1 -- 172.21.15.156:0/1728116713 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f660c03eba0 con 0x7f661c133ad0 2023-09-30T22:24:21.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.307+0000 7f66223e3700 1 -- 172.21.15.156:0/1728116713 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f661c0701f0 con 0x7f661c133ad0 2023-09-30T22:24:21.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.311+0000 7f6618ff9700 1 -- 172.21.15.156:0/1728116713 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f661c0701f0 con 0x7f661c133ad0 2023-09-30T22:24:21.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.341+0000 7fdc38c69700 1 Processor -- start 2023-09-30T22:24:21.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.342+0000 7fdc38c69700 1 -- start start 2023-09-30T22:24:21.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.342+0000 7fdc38c69700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc34133ad0 0x7fdc34133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.342+0000 7fdc38c69700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdc341300a0 0x7fdc341304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.342+0000 7fdc38c69700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc341309f0 0x7fdc3413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.342+0000 7fdc38c69700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc3406b2d0 con 0x7fdc341300a0 2023-09-30T22:24:21.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.342+0000 7fdc38c69700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc34133610 con 0x7fdc341309f0 2023-09-30T22:24:21.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.342+0000 7fdc38c69700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3409a500 con 0x7fdc34133ad0 2023-09-30T22:24:21.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.342+0000 7fdc31d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdc341300a0 0x7fdc341304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.342+0000 7fdc3259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc34133ad0 0x7fdc34133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.342+0000 7fdc31d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdc341300a0 0x7fdc341304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49448/0 (socket says 172.21.15.156:49448) 2023-09-30T22:24:21.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.342+0000 7fdc32d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc341309f0 0x7fdc3413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.342+0000 7fdc3259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc34133ad0 0x7fdc34133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:58290/0 (socket says 172.21.15.156:58290) 2023-09-30T22:24:21.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.342+0000 7fdc31d9b700 1 -- 172.21.15.156:0/1864267942 learned_addr learned my addr 172.21.15.156:0/1864267942 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:21.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.343+0000 7fdc32d9d700 1 -- 172.21.15.156:0/1864267942 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc34133ad0 msgr2=0x7fdc34133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:21.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.343+0000 7fdc32d9d700 1 --2- 172.21.15.156:0/1864267942 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc34133ad0 0x7fdc34133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.343+0000 7fdc32d9d700 1 -- 172.21.15.156:0/1864267942 >> v2:172.21.15.156:3300/0 conn(0x7fdc341300a0 msgr2=0x7fdc341304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:21.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.343+0000 7fdc32d9d700 1 --2- 172.21.15.156:0/1864267942 >> v2:172.21.15.156:3300/0 conn(0x7fdc341300a0 0x7fdc341304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.343+0000 7fdc32d9d700 1 -- 172.21.15.156:0/1864267942 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc341338b0 con 0x7fdc341309f0 2023-09-30T22:24:21.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.343+0000 7fdc31d9b700 1 --2- 172.21.15.156:0/1864267942 >> v2:172.21.15.156:3300/0 conn(0x7fdc341300a0 0x7fdc341304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:21.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.343+0000 7fdc3259c700 1 --2- 172.21.15.156:0/1864267942 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc34133ad0 0x7fdc34133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:21.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.343+0000 7fdc32d9d700 1 --2- 172.21.15.156:0/1864267942 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc341309f0 0x7fdc3413a980 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c009d90 tx=0x7fdc2c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9f6055dc5dfc52d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:21.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.343+0000 7fdc3159a700 1 -- 172.21.15.156:0/1864267942 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c00e070 con 0x7fdc341309f0 2023-09-30T22:24:21.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.343+0000 7fdc3159a700 1 -- 172.21.15.156:0/1864267942 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2c00bb20 con 0x7fdc341309f0 2023-09-30T22:24:21.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.343+0000 7fdc3159a700 1 -- 172.21.15.156:0/1864267942 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c012430 con 0x7fdc341309f0 2023-09-30T22:24:21.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.344+0000 7fdc38c69700 1 -- 172.21.15.156:0/1864267942 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc341309f0 msgr2=0x7fdc3413a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.344+0000 7fdc38c69700 1 --2- 172.21.15.156:0/1864267942 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc341309f0 0x7fdc3413a980 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c009d90 tx=0x7fdc2c00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:21.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.344+0000 7fdc38c69700 1 -- 172.21.15.156:0/1864267942 shutdown_connections 2023-09-30T22:24:21.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.344+0000 7fdc38c69700 1 --2- 172.21.15.156:0/1864267942 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc341309f0 0x7fdc3413a980 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.344+0000 7fdc38c69700 1 --2- 172.21.15.156:0/1864267942 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc34133ad0 0x7fdc34133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.344+0000 7fdc38c69700 1 --2- 172.21.15.156:0/1864267942 >> v2:172.21.15.156:3300/0 conn(0x7fdc341300a0 0x7fdc341304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.344+0000 7fdc38c69700 1 -- 172.21.15.156:0/1864267942 >> 172.21.15.156:0/1864267942 conn(0x7fdc34099c40 msgr2=0x7fdc340a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:21.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.344+0000 7fdc38c69700 1 -- 172.21.15.156:0/1864267942 shutdown_connections 2023-09-30T22:24:21.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.344+0000 7fdc38c69700 1 -- 172.21.15.156:0/1864267942 wait complete. 2023-09-30T22:24:21.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.345+0000 7fdc38c69700 1 Processor -- start 2023-09-30T22:24:21.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.345+0000 7fdc38c69700 1 -- start start 2023-09-30T22:24:21.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.345+0000 7fdc38c69700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc341300a0 0x7fdc340712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.345+0000 7fdc38c69700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc341309f0 0x7fdc34071810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.345+0000 7fdc38c69700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc34133ad0 0x7fdc34071d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.345+0000 7fdc38c69700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3411dfe0 con 0x7fdc341300a0 2023-09-30T22:24:21.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.345+0000 7fdc38c69700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc34072730 con 0x7fdc34133ad0 2023-09-30T22:24:21.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.345+0000 7fdc38c69700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3411ee70 con 0x7fdc341309f0 2023-09-30T22:24:21.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.345+0000 7fdc31d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc341309f0 0x7fdc34071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.345+0000 7fdc32d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc34133ad0 0x7fdc34071d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.345+0000 7fdc31d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc341309f0 0x7fdc34071810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:58294/0 (socket says 172.21.15.156:58294) 2023-09-30T22:24:21.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.345+0000 7fdc31d9b700 1 -- 172.21.15.156:0/3277144789 learned_addr learned my addr 172.21.15.156:0/3277144789 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:21.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.346+0000 7fdc3259c700 1 --2- 172.21.15.156:0/3277144789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc341300a0 0x7fdc340712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.346+0000 7fdc32d9d700 1 -- 172.21.15.156:0/3277144789 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc341309f0 msgr2=0x7fdc34071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.346+0000 7fdc32d9d700 1 --2- 172.21.15.156:0/3277144789 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc341309f0 0x7fdc34071810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.346+0000 7fdc32d9d700 1 -- 172.21.15.156:0/3277144789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc341300a0 msgr2=0x7fdc340712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.346+0000 7fdc32d9d700 1 --2- 172.21.15.156:0/3277144789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc341300a0 0x7fdc340712d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.346+0000 7fdc32d9d700 1 -- 172.21.15.156:0/3277144789 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc28009550 con 0x7fdc34133ad0 2023-09-30T22:24:21.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.346+0000 7fdc3259c700 1 --2- 172.21.15.156:0/3277144789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc341300a0 0x7fdc340712d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:21.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.346+0000 7fdc32d9d700 1 --2- 172.21.15.156:0/3277144789 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc34133ad0 0x7fdc34071d50 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c016000 tx=0x7fdc2c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:21.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.346+0000 7fdc22ffd700 1 -- 172.21.15.156:0/3277144789 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c012430 con 0x7fdc34133ad0 2023-09-30T22:24:21.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.346+0000 7fdc22ffd700 1 -- 172.21.15.156:0/3277144789 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2c020070 con 0x7fdc34133ad0 2023-09-30T22:24:21.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.346+0000 7fdc22ffd700 1 -- 172.21.15.156:0/3277144789 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c004280 con 0x7fdc34133ad0 2023-09-30T22:24:21.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.346+0000 7fdc38c69700 1 -- 172.21.15.156:0/3277144789 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc240094a0 con 0x7fdc34133ad0 2023-09-30T22:24:21.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.346+0000 7fdc38c69700 1 -- 172.21.15.156:0/3277144789 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc2c009a70 con 0x7fdc34133ad0 2023-09-30T22:24:21.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.347+0000 7fdc38c69700 1 -- 172.21.15.156:0/3277144789 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc3411f8b0 con 0x7fdc34133ad0 2023-09-30T22:24:21.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.347+0000 7fdc22ffd700 1 -- 172.21.15.156:0/3277144789 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc2c0043e0 con 0x7fdc34133ad0 2023-09-30T22:24:21.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.347+0000 7fdc22ffd700 1 -- 172.21.15.156:0/3277144789 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdc2c022070 con 0x7fdc34133ad0 2023-09-30T22:24:21.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.356+0000 7fdc22ffd700 1 -- 172.21.15.156:0/3277144789 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc2c004690 con 0x7fdc34133ad0 2023-09-30T22:24:21.369 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.369+0000 7f938d44e700 1 -- 172.21.15.156:0/1416688953 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f93880a2710 con 0x7f93880a0a70 2023-09-30T22:24:21.370 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.369+0000 7f936f7fe700 1 -- 172.21.15.156:0/1416688953 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f937c011e80 con 0x7f93880a0a70 2023-09-30T22:24:21.370 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:21.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.371+0000 7f938d44e700 1 -- 172.21.15.156:0/1416688953 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93880a0a70 msgr2=0x7f938811e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.371+0000 7f938d44e700 1 --2- 172.21.15.156:0/1416688953 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93880a0a70 0x7f938811e7d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f937c00c470 tx=0x7f937c00c780 comp rx=0 tx=0).stop 2023-09-30T22:24:21.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.371+0000 7f938d44e700 1 -- 172.21.15.156:0/1416688953 shutdown_connections 2023-09-30T22:24:21.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.371+0000 7f938d44e700 1 --2- 172.21.15.156:0/1416688953 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9388139200 0x7f938811f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.371+0000 7f938d44e700 1 --2- 172.21.15.156:0/1416688953 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f93880a0a70 0x7f938811e7d0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.371+0000 7f938d44e700 1 --2- 172.21.15.156:0/1416688953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93880a1550 0x7f938811ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.371+0000 7f938d44e700 1 -- 172.21.15.156:0/1416688953 >> 172.21.15.156:0/1416688953 conn(0x7f93880a6610 msgr2=0x7f9388138120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:21.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.372+0000 7f938d44e700 1 -- 172.21.15.156:0/1416688953 shutdown_connections 2023-09-30T22:24:21.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.372+0000 7f938d44e700 1 -- 172.21.15.156:0/1416688953 wait complete. 2023-09-30T22:24:21.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:21.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.510+0000 7f66223e3700 1 -- 172.21.15.156:0/1728116713 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f661c04f2a0 con 0x7f661c133ad0 2023-09-30T22:24:21.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.510+0000 7f6618ff9700 1 -- 172.21.15.156:0/1728116713 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f660c003e40 con 0x7f661c133ad0 2023-09-30T22:24:21.511 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:21.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.512+0000 7f66223e3700 1 -- 172.21.15.156:0/1728116713 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f661c133ad0 msgr2=0x7f661c12ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.512+0000 7f66223e3700 1 --2- 172.21.15.156:0/1728116713 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f661c133ad0 0x7f661c12ce80 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f660c00c450 tx=0x7f660c00c760 comp rx=0 tx=0).stop 2023-09-30T22:24:21.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.512+0000 7f66223e3700 1 -- 172.21.15.156:0/1728116713 shutdown_connections 2023-09-30T22:24:21.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.512+0000 7f66223e3700 1 --2- 172.21.15.156:0/1728116713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f661c139280 0x7f661c071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.512+0000 7f66223e3700 1 --2- 172.21.15.156:0/1728116713 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f661c133ad0 0x7f661c12ce80 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.512+0000 7f66223e3700 1 --2- 172.21.15.156:0/1728116713 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f661c136960 0x7f661c12d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.512+0000 7f66223e3700 1 -- 172.21.15.156:0/1728116713 >> 172.21.15.156:0/1728116713 conn(0x7f661c099c40 msgr2=0x7f661c0a30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:21.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.513+0000 7f66223e3700 1 -- 172.21.15.156:0/1728116713 shutdown_connections 2023-09-30T22:24:21.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.513+0000 7f66223e3700 1 -- 172.21.15.156:0/1728116713 wait complete. 2023-09-30T22:24:21.526 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:21.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.550+0000 7fdc38c69700 1 -- 172.21.15.156:0/3277144789 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdc3411f230 con 0x7fdc34133ad0 2023-09-30T22:24:21.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.551+0000 7fdc22ffd700 1 -- 172.21.15.156:0/3277144789 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdc2c02c030 con 0x7fdc34133ad0 2023-09-30T22:24:21.551 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:21.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.553+0000 7fdc38c69700 1 -- 172.21.15.156:0/3277144789 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc34133ad0 msgr2=0x7fdc34071d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.553+0000 7fdc38c69700 1 --2- 172.21.15.156:0/3277144789 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc34133ad0 0x7fdc34071d50 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c016000 tx=0x7fdc2c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.553+0000 7fdc38c69700 1 -- 172.21.15.156:0/3277144789 shutdown_connections 2023-09-30T22:24:21.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.553+0000 7fdc38c69700 1 --2- 172.21.15.156:0/3277144789 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc34133ad0 0x7fdc34071d50 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.553+0000 7fdc38c69700 1 --2- 172.21.15.156:0/3277144789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc341300a0 0x7fdc340712d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.553+0000 7fdc38c69700 1 --2- 172.21.15.156:0/3277144789 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc341309f0 0x7fdc34071810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.553+0000 7fdc38c69700 1 -- 172.21.15.156:0/3277144789 >> 172.21.15.156:0/3277144789 conn(0x7fdc34099c40 msgr2=0x7fdc34132b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:21.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.553+0000 7fdc38c69700 1 -- 172.21.15.156:0/3277144789 shutdown_connections 2023-09-30T22:24:21.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.553+0000 7fdc38c69700 1 -- 172.21.15.156:0/3277144789 wait complete. 2023-09-30T22:24:21.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:21.755 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:21.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.880+0000 7fd01e604700 1 Processor -- start 2023-09-30T22:24:21.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.880+0000 7fd01e604700 1 -- start start 2023-09-30T22:24:21.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.880+0000 7fd01e604700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd0180a0a70 0x7fd0180a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.880+0000 7fd01e604700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd0180a1380 0x7fd018133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.880+0000 7fd01e604700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd01809dc00 con 0x7fd018133f50 2023-09-30T22:24:21.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.880+0000 7fd01e604700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd01809ea60 con 0x7fd0180a1380 2023-09-30T22:24:21.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.880+0000 7fd01e604700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd01809dec0 con 0x7fd0180a0a70 2023-09-30T22:24:21.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.881+0000 7fd017fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd0180a0a70 0x7fd0180a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.881+0000 7fd0177fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd0180a1380 0x7fd018133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.881+0000 7fd01cba1700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fd018133f50 0x7fd01813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:57656/0 (socket says 172.21.15.156:57656) 2023-09-30T22:24:21.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.881+0000 7fd0177fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd0180a1380 0x7fd018133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49470/0 (socket says 172.21.15.156:49470) 2023-09-30T22:24:21.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.881+0000 7fd017fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd0180a0a70 0x7fd0180a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:58298/0 (socket says 172.21.15.156:58298) 2023-09-30T22:24:21.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.881+0000 7fd01cba1700 1 -- 172.21.15.156:0/2626729242 learned_addr learned my addr 172.21.15.156:0/2626729242 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:21.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.881+0000 7fd017fff700 1 -- 172.21.15.156:0/2626729242 >> v2:172.21.15.156:3300/0 conn(0x7fd0180a1380 msgr2=0x7fd018133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:21.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.881+0000 7fd017fff700 1 --2- 172.21.15.156:0/2626729242 >> v2:172.21.15.156:3300/0 conn(0x7fd0180a1380 0x7fd018133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.881+0000 7fd017fff700 1 -- 172.21.15.156:0/2626729242 >> v1:172.21.15.156:6789/0 conn(0x7fd018133f50 legacy=0x7fd01813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.881+0000 7fd017fff700 1 -- 172.21.15.156:0/2626729242 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01809e6a0 con 0x7fd0180a0a70 2023-09-30T22:24:21.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.881+0000 7fd0177fe700 1 --2- 172.21.15.156:0/2626729242 >> v2:172.21.15.156:3300/0 conn(0x7fd0180a1380 0x7fd018133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:21.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.881+0000 7fd017fff700 1 --2- 172.21.15.156:0/2626729242 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd0180a0a70 0x7fd0180a0e40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fd00c009840 tx=0x7fd00c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9af6b8c08bde53a4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:21.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.881+0000 7fd016ffd700 1 -- 172.21.15.156:0/2626729242 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c011830 con 0x7fd0180a0a70 2023-09-30T22:24:21.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.881+0000 7fd016ffd700 1 -- 172.21.15.156:0/2626729242 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00c011990 con 0x7fd0180a0a70 2023-09-30T22:24:21.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.881+0000 7fd016ffd700 1 -- 172.21.15.156:0/2626729242 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c011d20 con 0x7fd0180a0a70 2023-09-30T22:24:21.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.882+0000 7fd01e604700 1 -- 172.21.15.156:0/2626729242 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd0180a0a70 msgr2=0x7fd0180a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.882+0000 7fd01e604700 1 --2- 172.21.15.156:0/2626729242 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd0180a0a70 0x7fd0180a0e40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fd00c009840 tx=0x7fd00c009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:21.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.882+0000 7fd01e604700 1 -- 172.21.15.156:0/2626729242 shutdown_connections 2023-09-30T22:24:21.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.882+0000 7fd01e604700 1 --2- 172.21.15.156:0/2626729242 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd0180a0a70 0x7fd0180a0e40 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.882+0000 7fd01e604700 1 --2- 172.21.15.156:0/2626729242 >> v2:172.21.15.156:3300/0 conn(0x7fd0180a1380 0x7fd018133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.882+0000 7fd01e604700 1 -- 172.21.15.156:0/2626729242 >> 172.21.15.156:0/2626729242 conn(0x7fd0180a6610 msgr2=0x7fd0180a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:21.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.882+0000 7fd01e604700 1 -- 172.21.15.156:0/2626729242 shutdown_connections 2023-09-30T22:24:21.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.882+0000 7fd01e604700 1 -- 172.21.15.156:0/2626729242 wait complete. 2023-09-30T22:24:21.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.883+0000 7fd01e604700 1 Processor -- start 2023-09-30T22:24:21.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.883+0000 7fd01e604700 1 -- start start 2023-09-30T22:24:21.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.883+0000 7fd01e604700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd0180a0a70 0x7fd0181c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.883+0000 7fd01e604700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd0180a1380 0x7fd0181c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.883+0000 7fd01e604700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd018133f50 0x7fd0181c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.883+0000 7fd01e604700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0181247f0 con 0x7fd018133f50 2023-09-30T22:24:21.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.883+0000 7fd01e604700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd018124600 con 0x7fd0180a0a70 2023-09-30T22:24:21.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.883+0000 7fd01e604700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0181252e0 con 0x7fd0180a1380 2023-09-30T22:24:21.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.883+0000 7fd017fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd0180a0a70 0x7fd0181c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.883+0000 7fd0177fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd0180a1380 0x7fd0181c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.883+0000 7fd0177fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd0180a1380 0x7fd0181c8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:58304/0 (socket says 172.21.15.156:58304) 2023-09-30T22:24:21.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.883+0000 7fd017fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd0180a0a70 0x7fd0181c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:47676/0 (socket says 172.21.15.156:47676) 2023-09-30T22:24:21.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.883+0000 7fd0177fe700 1 -- 172.21.15.156:0/1475092504 learned_addr learned my addr 172.21.15.156:0/1475092504 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:21.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.883+0000 7fd01cba1700 1 --2- 172.21.15.156:0/1475092504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd018133f50 0x7fd0181c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.884+0000 7fd0177fe700 1 -- 172.21.15.156:0/1475092504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd0180a0a70 msgr2=0x7fd0181c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.884+0000 7fd0177fe700 1 --2- 172.21.15.156:0/1475092504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd0180a0a70 0x7fd0181c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.884+0000 7fd0177fe700 1 -- 172.21.15.156:0/1475092504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd018133f50 msgr2=0x7fd0181c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.884+0000 7fd0177fe700 1 --2- 172.21.15.156:0/1475092504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd018133f50 0x7fd0181c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.884+0000 7fd0177fe700 1 -- 172.21.15.156:0/1475092504 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0080094a0 con 0x7fd0180a1380 2023-09-30T22:24:21.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.884+0000 7fd0177fe700 1 --2- 172.21.15.156:0/1475092504 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd0180a1380 0x7fd0181c8740 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fd00800ebe0 tx=0x7fd00800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:21.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.884+0000 7fd014ff9700 1 -- 172.21.15.156:0/1475092504 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00800c850 con 0x7fd0180a1380 2023-09-30T22:24:21.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.884+0000 7fd014ff9700 1 -- 172.21.15.156:0/1475092504 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00800c9b0 con 0x7fd0180a1380 2023-09-30T22:24:21.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.884+0000 7fd01e604700 1 -- 172.21.15.156:0/1475092504 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd00c0094a0 con 0x7fd0180a1380 2023-09-30T22:24:21.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.884+0000 7fd014ff9700 1 -- 172.21.15.156:0/1475092504 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00800cd40 con 0x7fd0180a1380 2023-09-30T22:24:21.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.884+0000 7fd01e604700 1 -- 172.21.15.156:0/1475092504 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd018126230 con 0x7fd0180a1380 2023-09-30T22:24:21.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.885+0000 7fd014ff9700 1 -- 172.21.15.156:0/1475092504 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd008013470 con 0x7fd0180a1380 2023-09-30T22:24:21.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.885+0000 7fd014ff9700 1 -- 172.21.15.156:0/1475092504 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd00803fb30 con 0x7fd0180a1380 2023-09-30T22:24:21.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.885+0000 7fd01e604700 1 -- 172.21.15.156:0/1475092504 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd018125ed0 con 0x7fd0180a1380 2023-09-30T22:24:21.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:21.889+0000 7fd014ff9700 1 -- 172.21.15.156:0/1475092504 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd018125ed0 con 0x7fd0180a1380 2023-09-30T22:24:22.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.072+0000 7fd01e604700 1 -- 172.21.15.156:0/1475092504 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd018125ed0 con 0x7fd0180a1380 2023-09-30T22:24:22.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.072+0000 7fd014ff9700 1 -- 172.21.15.156:0/1475092504 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd018125ed0 con 0x7fd0180a1380 2023-09-30T22:24:22.073 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:22.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.074+0000 7fd01e604700 1 -- 172.21.15.156:0/1475092504 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd0180a1380 msgr2=0x7fd0181c8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.074+0000 7fd01e604700 1 --2- 172.21.15.156:0/1475092504 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd0180a1380 0x7fd0181c8740 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fd00800ebe0 tx=0x7fd00800eef0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.074+0000 7fd01e604700 1 -- 172.21.15.156:0/1475092504 shutdown_connections 2023-09-30T22:24:22.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.074+0000 7fd01e604700 1 --2- 172.21.15.156:0/1475092504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd018133f50 0x7fd0181c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.074+0000 7fd01e604700 1 --2- 172.21.15.156:0/1475092504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd0180a0a70 0x7fd0181c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.074+0000 7fd01e604700 1 --2- 172.21.15.156:0/1475092504 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd0180a1380 0x7fd0181c8740 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.074+0000 7fd01e604700 1 -- 172.21.15.156:0/1475092504 >> 172.21.15.156:0/1475092504 conn(0x7fd0180a6610 msgr2=0x7fd0180a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:22.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.074+0000 7fd01e604700 1 -- 172.21.15.156:0/1475092504 shutdown_connections 2023-09-30T22:24:22.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.074+0000 7fd01e604700 1 -- 172.21.15.156:0/1475092504 wait complete. 2023-09-30T22:24:22.087 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:22.386 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:22.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.508+0000 7fc95b15d700 1 Processor -- start 2023-09-30T22:24:22.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.508+0000 7fc95b15d700 1 -- start start 2023-09-30T22:24:22.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.509+0000 7fc95b15d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc95409e870 0x7fc95409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.509+0000 7fc95b15d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc95409f180 0x7fc954131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.509+0000 7fc95b15d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc954131d70 0x7fc954132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.509+0000 7fc95b15d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9540a0920 con 0x7fc954131d70 2023-09-30T22:24:22.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.509+0000 7fc95b15d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc95409c970 con 0x7fc95409f180 2023-09-30T22:24:22.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.509+0000 7fc95b15d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc95409bab0 con 0x7fc95409e870 2023-09-30T22:24:22.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.509+0000 7fc953fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc95409f180 0x7fc954131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.509+0000 7fc958ef9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc95409e870 0x7fc95409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.509+0000 7fc9596fa700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc954131d70 0x7fc954132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.509+0000 7fc953fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc95409f180 0x7fc954131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:47682/0 (socket says 172.21.15.156:47682) 2023-09-30T22:24:22.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.509+0000 7fc958ef9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc95409e870 0x7fc95409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:58314/0 (socket says 172.21.15.156:58314) 2023-09-30T22:24:22.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.509+0000 7fc953fff700 1 -- 172.21.15.156:0/2281386481 learned_addr learned my addr 172.21.15.156:0/2281386481 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:22.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.509+0000 7fc953fff700 1 -- 172.21.15.156:0/2281386481 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc95409e870 msgr2=0x7fc95409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:22.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.509+0000 7fc953fff700 1 --2- 172.21.15.156:0/2281386481 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc95409e870 0x7fc95409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.509+0000 7fc953fff700 1 -- 172.21.15.156:0/2281386481 >> v2:172.21.15.156:3300/0 conn(0x7fc954131d70 msgr2=0x7fc954132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:22.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.509+0000 7fc953fff700 1 --2- 172.21.15.156:0/2281386481 >> v2:172.21.15.156:3300/0 conn(0x7fc954131d70 0x7fc954132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.509+0000 7fc953fff700 1 -- 172.21.15.156:0/2281386481 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95409f9c0 con 0x7fc95409f180 2023-09-30T22:24:22.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.509+0000 7fc9596fa700 1 --2- 172.21.15.156:0/2281386481 >> v2:172.21.15.156:3300/0 conn(0x7fc954131d70 0x7fc954132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:22.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.509+0000 7fc953fff700 1 --2- 172.21.15.156:0/2281386481 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc95409f180 0x7fc954131830 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fc9400098f0 tx=0x7fc940009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd5ec18bfa720a07 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:22.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.510+0000 7fc9537fe700 1 -- 172.21.15.156:0/2281386481 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc940011830 con 0x7fc95409f180 2023-09-30T22:24:22.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.510+0000 7fc9537fe700 1 -- 172.21.15.156:0/2281386481 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc940011990 con 0x7fc95409f180 2023-09-30T22:24:22.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.510+0000 7fc9537fe700 1 -- 172.21.15.156:0/2281386481 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc940011d20 con 0x7fc95409f180 2023-09-30T22:24:22.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.510+0000 7fc95b15d700 1 -- 172.21.15.156:0/2281386481 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc95409f180 msgr2=0x7fc954131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.510+0000 7fc95b15d700 1 --2- 172.21.15.156:0/2281386481 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc95409f180 0x7fc954131830 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fc9400098f0 tx=0x7fc940009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:22.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.510+0000 7fc95b15d700 1 -- 172.21.15.156:0/2281386481 shutdown_connections 2023-09-30T22:24:22.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.510+0000 7fc95b15d700 1 --2- 172.21.15.156:0/2281386481 >> v2:172.21.15.156:3300/0 conn(0x7fc954131d70 0x7fc954132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.510+0000 7fc95b15d700 1 --2- 172.21.15.156:0/2281386481 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc95409e870 0x7fc95409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.510+0000 7fc95b15d700 1 --2- 172.21.15.156:0/2281386481 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc95409f180 0x7fc954131830 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.510+0000 7fc95b15d700 1 -- 172.21.15.156:0/2281386481 >> 172.21.15.156:0/2281386481 conn(0x7fc9540a4430 msgr2=0x7fc9540a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:22.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.510+0000 7fc95b15d700 1 -- 172.21.15.156:0/2281386481 shutdown_connections 2023-09-30T22:24:22.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.510+0000 7fc95b15d700 1 -- 172.21.15.156:0/2281386481 wait complete. 2023-09-30T22:24:22.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.511+0000 7fc95b15d700 1 Processor -- start 2023-09-30T22:24:22.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.511+0000 7fc95b15d700 1 -- start start 2023-09-30T22:24:22.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.512+0000 7fc95b15d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc95409e870 0x7fc95406c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.512+0000 7fc95b15d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc95409f180 0x7fc95406c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.512+0000 7fc95b15d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc954131d70 0x7fc9541c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.512+0000 7fc95b15d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95406be60 con 0x7fc954131d70 2023-09-30T22:24:22.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.512+0000 7fc95b15d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9540a0210 con 0x7fc95409f180 2023-09-30T22:24:22.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.512+0000 7fc95b15d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9540a2c40 con 0x7fc95409e870 2023-09-30T22:24:22.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.512+0000 7fc953fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc95409f180 0x7fc95406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.512+0000 7fc953fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc95409f180 0x7fc95406c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:47692/0 (socket says 172.21.15.156:47692) 2023-09-30T22:24:22.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.512+0000 7fc953fff700 1 -- 172.21.15.156:0/1633337593 learned_addr learned my addr 172.21.15.156:0/1633337593 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:22.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.512+0000 7fc9596fa700 1 --2- 172.21.15.156:0/1633337593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc954131d70 0x7fc9541c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.512+0000 7fc958ef9700 1 --2- 172.21.15.156:0/1633337593 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc95409e870 0x7fc95406c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.512+0000 7fc953fff700 1 -- 172.21.15.156:0/1633337593 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc95409e870 msgr2=0x7fc95406c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.512+0000 7fc953fff700 1 --2- 172.21.15.156:0/1633337593 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc95409e870 0x7fc95406c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.512+0000 7fc953fff700 1 -- 172.21.15.156:0/1633337593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc954131d70 msgr2=0x7fc9541c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.512+0000 7fc953fff700 1 --2- 172.21.15.156:0/1633337593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc954131d70 0x7fc9541c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.512+0000 7fc953fff700 1 -- 172.21.15.156:0/1633337593 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94c009a70 con 0x7fc95409f180 2023-09-30T22:24:22.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.512+0000 7fc9596fa700 1 --2- 172.21.15.156:0/1633337593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc954131d70 0x7fc9541c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:22.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.512+0000 7fc953fff700 1 --2- 172.21.15.156:0/1633337593 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc95409f180 0x7fc95406c940 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fc940000c00 tx=0x7fc940004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:22.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.512+0000 7fc9517fa700 1 -- 172.21.15.156:0/1633337593 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc940004240 con 0x7fc95409f180 2023-09-30T22:24:22.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.513+0000 7fc9517fa700 1 -- 172.21.15.156:0/1633337593 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94001f070 con 0x7fc95409f180 2023-09-30T22:24:22.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.513+0000 7fc9517fa700 1 -- 172.21.15.156:0/1633337593 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9400045c0 con 0x7fc95409f180 2023-09-30T22:24:22.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.513+0000 7fc95b15d700 1 -- 172.21.15.156:0/1633337593 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc940009550 con 0x7fc95409f180 2023-09-30T22:24:22.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.513+0000 7fc95b15d700 1 -- 172.21.15.156:0/1633337593 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc954120f30 con 0x7fc95409f180 2023-09-30T22:24:22.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.513+0000 7fc9517fa700 1 -- 172.21.15.156:0/1633337593 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc940021030 con 0x7fc95409f180 2023-09-30T22:24:22.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.513+0000 7fc9517fa700 1 -- 172.21.15.156:0/1633337593 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc940040720 con 0x7fc95409f180 2023-09-30T22:24:22.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.513+0000 7fc95b15d700 1 -- 172.21.15.156:0/1633337593 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc95404f2a0 con 0x7fc95409f180 2023-09-30T22:24:22.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.518+0000 7fc9517fa700 1 -- 172.21.15.156:0/1633337593 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc940015070 con 0x7fc95409f180 2023-09-30T22:24:22.527 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:22.567 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:22.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.655+0000 7f86f045a700 1 Processor -- start 2023-09-30T22:24:22.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.655+0000 7f86f045a700 1 -- start start 2023-09-30T22:24:22.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.656+0000 7f86f045a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86e809ad40 0x7f86e8133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.656+0000 7f86f045a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f86e8133f70 0x7f86e81343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.656+0000 7f86f045a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e809b110 con 0x7f86e80a0a70 2023-09-30T22:24:22.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.656+0000 7f86f045a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e80a3b60 con 0x7f86e8133f70 2023-09-30T22:24:22.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.656+0000 7f86f045a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e81348e0 con 0x7f86e809ad40 2023-09-30T22:24:22.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.656+0000 7f86ee1f6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86e809ad40 0x7f86e8133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.656+0000 7f86ee1f6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86e809ad40 0x7f86e8133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:47706/0 (socket says 172.21.15.156:47706) 2023-09-30T22:24:22.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.656+0000 7f86ee1f6700 1 -- 172.21.15.156:0/2932181839 learned_addr learned my addr 172.21.15.156:0/2932181839 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:22.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.656+0000 7f86ed9f5700 1 --2- 172.21.15.156:0/2932181839 >> v2:172.21.15.156:3300/0 conn(0x7f86e8133f70 0x7f86e81343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.656+0000 7f86ee1f6700 1 -- 172.21.15.156:0/2932181839 >> v2:172.21.15.156:3300/0 conn(0x7f86e8133f70 msgr2=0x7f86e81343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:22.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.656+0000 7f86ee1f6700 1 --2- 172.21.15.156:0/2932181839 >> v2:172.21.15.156:3300/0 conn(0x7f86e8133f70 0x7f86e81343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.656+0000 7f86ee1f6700 1 -- 172.21.15.156:0/2932181839 >> v1:172.21.15.156:6789/0 conn(0x7f86e80a0a70 legacy=0x7f86e80a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.656+0000 7f86ed1f4700 1 -- 172.21.15.156:0/2932181839 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176795933 0 0) 0x7f86e809b110 con 0x7f86e80a0a70 2023-09-30T22:24:22.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.657+0000 7f86ee1f6700 1 -- 172.21.15.156:0/2932181839 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e80a2fa0 con 0x7f86e809ad40 2023-09-30T22:24:22.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.657+0000 7f86ee1f6700 1 --2- 172.21.15.156:0/2932181839 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86e809ad40 0x7f86e8133a30 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f86e4009920 tx=0x7f86e4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b1af3002025ea4a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:22.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.657+0000 7f86ed1f4700 1 -- 172.21.15.156:0/2932181839 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e4011830 con 0x7f86e809ad40 2023-09-30T22:24:22.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.657+0000 7f86ed1f4700 1 -- 172.21.15.156:0/2932181839 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e4011990 con 0x7f86e809ad40 2023-09-30T22:24:22.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.657+0000 7f86ed1f4700 1 -- 172.21.15.156:0/2932181839 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e4011d20 con 0x7f86e809ad40 2023-09-30T22:24:22.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.658+0000 7f86f045a700 1 -- 172.21.15.156:0/2932181839 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86e809ad40 msgr2=0x7f86e8133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.658+0000 7f86f045a700 1 --2- 172.21.15.156:0/2932181839 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86e809ad40 0x7f86e8133a30 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f86e4009920 tx=0x7f86e4009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:22.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.658+0000 7f86f045a700 1 -- 172.21.15.156:0/2932181839 shutdown_connections 2023-09-30T22:24:22.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.658+0000 7f86f045a700 1 --2- 172.21.15.156:0/2932181839 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86e809ad40 0x7f86e8133a30 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.658+0000 7f86f045a700 1 --2- 172.21.15.156:0/2932181839 >> v2:172.21.15.156:3300/0 conn(0x7f86e8133f70 0x7f86e81343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.658+0000 7f86f045a700 1 -- 172.21.15.156:0/2932181839 >> 172.21.15.156:0/2932181839 conn(0x7f86e8099c40 msgr2=0x7f86e806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:22.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.658+0000 7f86f045a700 1 -- 172.21.15.156:0/2932181839 shutdown_connections 2023-09-30T22:24:22.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.658+0000 7f86f045a700 1 -- 172.21.15.156:0/2932181839 wait complete. 2023-09-30T22:24:22.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.659+0000 7f86f045a700 1 Processor -- start 2023-09-30T22:24:22.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.659+0000 7f86f045a700 1 -- start start 2023-09-30T22:24:22.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.659+0000 7f86f045a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f86e809ad40 0x7f86e81c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.659+0000 7f86f045a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86e80a0a70 0x7f86e81c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.659+0000 7f86f045a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86e8133f70 0x7f86e81c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.659+0000 7f86f045a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e809c7e0 con 0x7f86e80a0a70 2023-09-30T22:24:22.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.659+0000 7f86f045a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e8122390 con 0x7f86e8133f70 2023-09-30T22:24:22.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.659+0000 7f86f045a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86e8120680 con 0x7f86e809ad40 2023-09-30T22:24:22.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.659+0000 7f86ee9f7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86e8133f70 0x7f86e81c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.659+0000 7f86ed9f5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86e80a0a70 0x7f86e81c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.659+0000 7f86ee9f7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86e8133f70 0x7f86e81c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:47712/0 (socket says 172.21.15.156:47712) 2023-09-30T22:24:22.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.659+0000 7f86ee9f7700 1 -- 172.21.15.156:0/2415395514 learned_addr learned my addr 172.21.15.156:0/2415395514 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:22.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.659+0000 7f86ed9f5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86e80a0a70 0x7f86e81c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49518/0 (socket says 172.21.15.156:49518) 2023-09-30T22:24:22.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.659+0000 7f86ee1f6700 1 --2- 172.21.15.156:0/2415395514 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f86e809ad40 0x7f86e81c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.660+0000 7f86ee9f7700 1 -- 172.21.15.156:0/2415395514 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f86e809ad40 msgr2=0x7f86e81c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.660+0000 7f86ee9f7700 1 --2- 172.21.15.156:0/2415395514 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f86e809ad40 0x7f86e81c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.660+0000 7f86ee9f7700 1 -- 172.21.15.156:0/2415395514 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86e80a0a70 msgr2=0x7f86e81c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.660+0000 7f86ee9f7700 1 --2- 172.21.15.156:0/2415395514 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86e80a0a70 0x7f86e81c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.660+0000 7f86ee9f7700 1 -- 172.21.15.156:0/2415395514 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e4009550 con 0x7f86e8133f70 2023-09-30T22:24:22.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.660+0000 7f86ed9f5700 1 --2- 172.21.15.156:0/2415395514 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86e80a0a70 0x7f86e81c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:22.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.660+0000 7f86ee9f7700 1 --2- 172.21.15.156:0/2415395514 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86e8133f70 0x7f86e81c8ba0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f86e0001560 tx=0x7f86e000cb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:22.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.660+0000 7f86deffd700 1 -- 172.21.15.156:0/2415395514 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0003e30 con 0x7f86e8133f70 2023-09-30T22:24:22.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.660+0000 7f86deffd700 1 -- 172.21.15.156:0/2415395514 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e0005070 con 0x7f86e8133f70 2023-09-30T22:24:22.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.660+0000 7f86f045a700 1 -- 172.21.15.156:0/2415395514 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e80a4110 con 0x7f86e8133f70 2023-09-30T22:24:22.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.660+0000 7f86deffd700 1 -- 172.21.15.156:0/2415395514 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0005420 con 0x7f86e8133f70 2023-09-30T22:24:22.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.660+0000 7f86f045a700 1 -- 172.21.15.156:0/2415395514 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e81212f0 con 0x7f86e8133f70 2023-09-30T22:24:22.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.661+0000 7f86deffd700 1 -- 172.21.15.156:0/2415395514 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f86e0005580 con 0x7f86e8133f70 2023-09-30T22:24:22.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.661+0000 7f86deffd700 1 -- 172.21.15.156:0/2415395514 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f86e003ed30 con 0x7f86e8133f70 2023-09-30T22:24:22.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.661+0000 7f86f045a700 1 -- 172.21.15.156:0/2415395514 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e804f2a0 con 0x7f86e8133f70 2023-09-30T22:24:22.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.670+0000 7f86deffd700 1 -- 172.21.15.156:0/2415395514 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f86e0017070 con 0x7f86e8133f70 2023-09-30T22:24:22.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.699+0000 7f5744aa5700 1 Processor -- start 2023-09-30T22:24:22.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.700+0000 7f5744aa5700 1 -- start start 2023-09-30T22:24:22.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.700+0000 7f5744aa5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f574009e870 0x7f574009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.700+0000 7f5744aa5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5740131f40 0x7f5740139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.700+0000 7f5744aa5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f574009c970 con 0x7f574009f180 2023-09-30T22:24:22.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.700+0000 7f5744aa5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57400a0920 con 0x7f5740131f40 2023-09-30T22:24:22.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.700+0000 7f5744aa5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f574009f9c0 con 0x7f574009e870 2023-09-30T22:24:22.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.700+0000 7f573e59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f574009e870 0x7f574009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.700+0000 7f573ed9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5740131f40 0x7f5740139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.700+0000 7f573e59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f574009e870 0x7f574009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:58356/0 (socket says 172.21.15.156:58356) 2023-09-30T22:24:22.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.700+0000 7f573dd9b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f574009f180 0x7f5740131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:57666/0 (socket says 172.21.15.156:57666) 2023-09-30T22:24:22.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.700+0000 7f573e59c700 1 -- 172.21.15.156:0/1175109403 learned_addr learned my addr 172.21.15.156:0/1175109403 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:22.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.700+0000 7f573ed9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5740131f40 0x7f5740139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49526/0 (socket says 172.21.15.156:49526) 2023-09-30T22:24:22.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.701+0000 7f573ed9d700 1 -- 172.21.15.156:0/1175109403 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f574009e870 msgr2=0x7f574009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:22.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.701+0000 7f573ed9d700 1 --2- 172.21.15.156:0/1175109403 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f574009e870 0x7f574009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.701+0000 7f573ed9d700 1 -- 172.21.15.156:0/1175109403 >> v1:172.21.15.156:6789/0 conn(0x7f574009f180 legacy=0x7f5740131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.701+0000 7f573ed9d700 1 -- 172.21.15.156:0/1175109403 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f574009bab0 con 0x7f5740131f40 2023-09-30T22:24:22.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.701+0000 7f573d59a700 1 -- 172.21.15.156:0/1175109403 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2730432661 0 0) 0x7f574009c970 con 0x7f574009f180 2023-09-30T22:24:22.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.701+0000 7f573e59c700 1 --2- 172.21.15.156:0/1175109403 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f574009e870 0x7f574009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:22.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.701+0000 7f573ed9d700 1 --2- 172.21.15.156:0/1175109403 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5740131f40 0x7f5740139ca0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f5738009d90 tx=0x7f573800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=622a6c3295a2cb09 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:22.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.701+0000 7f573d59a700 1 -- 172.21.15.156:0/1175109403 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573800e070 con 0x7f5740131f40 2023-09-30T22:24:22.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.701+0000 7f573d59a700 1 -- 172.21.15.156:0/1175109403 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573800bb20 con 0x7f5740131f40 2023-09-30T22:24:22.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.701+0000 7f573d59a700 1 -- 172.21.15.156:0/1175109403 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5738012430 con 0x7f5740131f40 2023-09-30T22:24:22.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.702+0000 7f5744aa5700 1 -- 172.21.15.156:0/1175109403 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5740131f40 msgr2=0x7f5740139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.702+0000 7f5744aa5700 1 --2- 172.21.15.156:0/1175109403 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5740131f40 0x7f5740139ca0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f5738009d90 tx=0x7f573800b330 comp rx=0 tx=0).stop 2023-09-30T22:24:22.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.702+0000 7f5744aa5700 1 -- 172.21.15.156:0/1175109403 shutdown_connections 2023-09-30T22:24:22.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.702+0000 7f5744aa5700 1 --2- 172.21.15.156:0/1175109403 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5740131f40 0x7f5740139ca0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.702+0000 7f5744aa5700 1 --2- 172.21.15.156:0/1175109403 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f574009e870 0x7f574009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.702+0000 7f5744aa5700 1 -- 172.21.15.156:0/1175109403 >> 172.21.15.156:0/1175109403 conn(0x7f57400a4430 msgr2=0x7f57400a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:22.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.702+0000 7f5744aa5700 1 -- 172.21.15.156:0/1175109403 shutdown_connections 2023-09-30T22:24:22.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.702+0000 7f5744aa5700 1 -- 172.21.15.156:0/1175109403 wait complete. 2023-09-30T22:24:22.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.703+0000 7f5744aa5700 1 Processor -- start 2023-09-30T22:24:22.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.703+0000 7f5744aa5700 1 -- start start 2023-09-30T22:24:22.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.704+0000 7f5744aa5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f574009e870 0x7f57401200a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.704+0000 7f5744aa5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f574009f180 0x7f57401205e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.704+0000 7f5744aa5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5740131f40 0x7f5740120b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.704+0000 7f5744aa5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5740122b20 con 0x7f574009f180 2023-09-30T22:24:22.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.704+0000 7f5744aa5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5740121c20 con 0x7f574009e870 2023-09-30T22:24:22.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.704+0000 7f5744aa5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f574009dba0 con 0x7f5740131f40 2023-09-30T22:24:22.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.704+0000 7f573e59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f574009e870 0x7f57401200a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.704+0000 7f573dd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f574009f180 0x7f57401205e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.704+0000 7f573e59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f574009e870 0x7f57401200a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:47722/0 (socket says 172.21.15.156:47722) 2023-09-30T22:24:22.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.704+0000 7f573e59c700 1 -- 172.21.15.156:0/3820353851 learned_addr learned my addr 172.21.15.156:0/3820353851 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:22.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.704+0000 7f573ed9d700 1 --2- 172.21.15.156:0/3820353851 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5740131f40 0x7f5740120b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.704+0000 7f573e59c700 1 -- 172.21.15.156:0/3820353851 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5740131f40 msgr2=0x7f5740120b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.704+0000 7f573e59c700 1 --2- 172.21.15.156:0/3820353851 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5740131f40 0x7f5740120b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.704+0000 7f573e59c700 1 -- 172.21.15.156:0/3820353851 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f574009f180 msgr2=0x7f57401205e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.704+0000 7f573e59c700 1 --2- 172.21.15.156:0/3820353851 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f574009f180 0x7f57401205e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.704+0000 7f573e59c700 1 -- 172.21.15.156:0/3820353851 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5730009550 con 0x7f574009e870 2023-09-30T22:24:22.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.704+0000 7f573dd9b700 1 --2- 172.21.15.156:0/3820353851 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f574009f180 0x7f57401205e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:22.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.705+0000 7f573e59c700 1 --2- 172.21.15.156:0/3820353851 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f574009e870 0x7f57401200a0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f573000e9b0 tx=0x7f573000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:22.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.705+0000 7f572effd700 1 -- 172.21.15.156:0/3820353851 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573000ee50 con 0x7f574009e870 2023-09-30T22:24:22.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.705+0000 7f572effd700 1 -- 172.21.15.156:0/3820353851 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573000c850 con 0x7f574009e870 2023-09-30T22:24:22.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.705+0000 7f5744aa5700 1 -- 172.21.15.156:0/3820353851 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5738009a70 con 0x7f574009e870 2023-09-30T22:24:22.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.705+0000 7f572effd700 1 -- 172.21.15.156:0/3820353851 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573000cbc0 con 0x7f574009e870 2023-09-30T22:24:22.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.705+0000 7f5744aa5700 1 -- 172.21.15.156:0/3820353851 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5740123590 con 0x7f574009e870 2023-09-30T22:24:22.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.706+0000 7f5744aa5700 1 -- 172.21.15.156:0/3820353851 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f574011ce70 con 0x7f574009e870 2023-09-30T22:24:22.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.706+0000 7f572effd700 1 -- 172.21.15.156:0/3820353851 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f573000cd20 con 0x7f574009e870 2023-09-30T22:24:22.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.706+0000 7f572effd700 1 -- 172.21.15.156:0/3820353851 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f573003f720 con 0x7f574009e870 2023-09-30T22:24:22.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.711+0000 7f572effd700 1 -- 172.21.15.156:0/3820353851 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f57300232f0 con 0x7f574009e870 2023-09-30T22:24:22.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.719+0000 7fc95b15d700 1 -- 172.21.15.156:0/1633337593 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc95409f660 con 0x7fc95409f180 2023-09-30T22:24:22.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.719+0000 7fc9517fa700 1 -- 172.21.15.156:0/1633337593 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc94001a450 con 0x7fc95409f180 2023-09-30T22:24:22.720 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:22.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.721+0000 7fc95b15d700 1 -- 172.21.15.156:0/1633337593 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc95409f180 msgr2=0x7fc95406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.721+0000 7fc95b15d700 1 --2- 172.21.15.156:0/1633337593 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc95409f180 0x7fc95406c940 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fc940000c00 tx=0x7fc940004750 comp rx=0 tx=0).stop 2023-09-30T22:24:22.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.722+0000 7fc95b15d700 1 -- 172.21.15.156:0/1633337593 shutdown_connections 2023-09-30T22:24:22.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.722+0000 7fc95b15d700 1 --2- 172.21.15.156:0/1633337593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc954131d70 0x7fc9541c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.722+0000 7fc95b15d700 1 --2- 172.21.15.156:0/1633337593 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc95409e870 0x7fc95406c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.722+0000 7fc95b15d700 1 --2- 172.21.15.156:0/1633337593 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc95409f180 0x7fc95406c940 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.722+0000 7fc95b15d700 1 -- 172.21.15.156:0/1633337593 >> 172.21.15.156:0/1633337593 conn(0x7fc9540a4430 msgr2=0x7fc9541b9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:22.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.722+0000 7fc95b15d700 1 -- 172.21.15.156:0/1633337593 shutdown_connections 2023-09-30T22:24:22.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.722+0000 7fc95b15d700 1 -- 172.21.15.156:0/1633337593 wait complete. 2023-09-30T22:24:22.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:22.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.868+0000 7f86f045a700 1 -- 172.21.15.156:0/2415395514 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f86e80729d0 con 0x7f86e8133f70 2023-09-30T22:24:22.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.868+0000 7f86deffd700 1 -- 172.21.15.156:0/2415395514 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f86e000a750 con 0x7f86e8133f70 2023-09-30T22:24:22.869 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:22.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.870+0000 7f86f045a700 1 -- 172.21.15.156:0/2415395514 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86e8133f70 msgr2=0x7f86e81c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.870+0000 7f86f045a700 1 --2- 172.21.15.156:0/2415395514 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86e8133f70 0x7f86e81c8ba0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f86e0001560 tx=0x7f86e000cb50 comp rx=0 tx=0).stop 2023-09-30T22:24:22.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.870+0000 7f86f045a700 1 -- 172.21.15.156:0/2415395514 shutdown_connections 2023-09-30T22:24:22.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.870+0000 7f86f045a700 1 --2- 172.21.15.156:0/2415395514 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86e8133f70 0x7f86e81c8ba0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.870+0000 7f86f045a700 1 --2- 172.21.15.156:0/2415395514 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f86e809ad40 0x7f86e81c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.870+0000 7f86f045a700 1 --2- 172.21.15.156:0/2415395514 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86e80a0a70 0x7f86e81c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.870+0000 7f86f045a700 1 -- 172.21.15.156:0/2415395514 >> 172.21.15.156:0/2415395514 conn(0x7f86e8099c40 msgr2=0x7f86e809b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:22.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.870+0000 7f86f045a700 1 -- 172.21.15.156:0/2415395514 shutdown_connections 2023-09-30T22:24:22.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.870+0000 7f86f045a700 1 -- 172.21.15.156:0/2415395514 wait complete. 2023-09-30T22:24:22.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:22.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.905+0000 7f5744aa5700 1 -- 172.21.15.156:0/3820353851 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f574004f2a0 con 0x7f574009e870 2023-09-30T22:24:22.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.905+0000 7f572effd700 1 -- 172.21.15.156:0/3820353851 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5730021070 con 0x7f574009e870 2023-09-30T22:24:22.906 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:22.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.907+0000 7f5744aa5700 1 -- 172.21.15.156:0/3820353851 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f574009e870 msgr2=0x7f57401200a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.907+0000 7f5744aa5700 1 --2- 172.21.15.156:0/3820353851 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f574009e870 0x7f57401200a0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f573000e9b0 tx=0x7f573000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.907+0000 7f5744aa5700 1 -- 172.21.15.156:0/3820353851 shutdown_connections 2023-09-30T22:24:22.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.907+0000 7f5744aa5700 1 --2- 172.21.15.156:0/3820353851 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5740131f40 0x7f5740120b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.907+0000 7f5744aa5700 1 --2- 172.21.15.156:0/3820353851 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f574009e870 0x7f57401200a0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.907+0000 7f5744aa5700 1 --2- 172.21.15.156:0/3820353851 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f574009f180 0x7f57401205e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.907+0000 7f5744aa5700 1 -- 172.21.15.156:0/3820353851 >> 172.21.15.156:0/3820353851 conn(0x7f57400a4430 msgr2=0x7f5740072210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:22.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.907+0000 7f5744aa5700 1 -- 172.21.15.156:0/3820353851 shutdown_connections 2023-09-30T22:24:22.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:22.907+0000 7f5744aa5700 1 -- 172.21.15.156:0/3820353851 wait complete. 2023-09-30T22:24:22.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:23.088 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:23.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.210+0000 7f78be4f9700 1 Processor -- start 2023-09-30T22:24:23.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.210+0000 7f78be4f9700 1 -- start start 2023-09-30T22:24:23.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.210+0000 7f78be4f9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f78b806a770 0x7f78b806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.210+0000 7f78be4f9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f78b8131ec0 0x7f78b8139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.210+0000 7f78be4f9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b809da80 con 0x7f78b806b080 2023-09-30T22:24:23.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.210+0000 7f78be4f9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b809dce0 con 0x7f78b8131ec0 2023-09-30T22:24:23.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.210+0000 7f78be4f9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78b809eb20 con 0x7f78b806a770 2023-09-30T22:24:23.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.210+0000 7f78b7fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f78b806a770 0x7f78b806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.210+0000 7f78bca96700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f78b8131ec0 0x7f78b8139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.210+0000 7f78bca96700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f78b8131ec0 0x7f78b8139c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49552/0 (socket says 172.21.15.156:49552) 2023-09-30T22:24:23.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.210+0000 7f78b7fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f78b806a770 0x7f78b806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:58376/0 (socket says 172.21.15.156:58376) 2023-09-30T22:24:23.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.210+0000 7f78b77fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f78b806b080 0x7f78b81317b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:57668/0 (socket says 172.21.15.156:57668) 2023-09-30T22:24:23.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.210+0000 7f78bca96700 1 -- 172.21.15.156:0/2442036709 learned_addr learned my addr 172.21.15.156:0/2442036709 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:23.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.211+0000 7f78b7fff700 1 -- 172.21.15.156:0/2442036709 >> v2:172.21.15.156:3300/0 conn(0x7f78b8131ec0 msgr2=0x7f78b8139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:23.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.211+0000 7f78b7fff700 1 --2- 172.21.15.156:0/2442036709 >> v2:172.21.15.156:3300/0 conn(0x7f78b8131ec0 0x7f78b8139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.211+0000 7f78b7fff700 1 -- 172.21.15.156:0/2442036709 >> v1:172.21.15.156:6789/0 conn(0x7f78b806b080 legacy=0x7f78b81317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.211+0000 7f78b7fff700 1 -- 172.21.15.156:0/2442036709 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b809d860 con 0x7f78b806a770 2023-09-30T22:24:23.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.211+0000 7f78b6ffd700 1 -- 172.21.15.156:0/2442036709 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192633056 0 0) 0x7f78b809da80 con 0x7f78b806b080 2023-09-30T22:24:23.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.211+0000 7f78bca96700 1 --2- 172.21.15.156:0/2442036709 >> v2:172.21.15.156:3300/0 conn(0x7f78b8131ec0 0x7f78b8139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:23.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.211+0000 7f78b7fff700 1 --2- 172.21.15.156:0/2442036709 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f78b806a770 0x7f78b806ab40 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009840 tx=0x7f78ac009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb5d4488630a7656 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:23.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.211+0000 7f78b6ffd700 1 -- 172.21.15.156:0/2442036709 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac011830 con 0x7f78b806a770 2023-09-30T22:24:23.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.211+0000 7f78b6ffd700 1 -- 172.21.15.156:0/2442036709 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ac011990 con 0x7f78b806a770 2023-09-30T22:24:23.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.211+0000 7f78b6ffd700 1 -- 172.21.15.156:0/2442036709 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac011d20 con 0x7f78b806a770 2023-09-30T22:24:23.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.211+0000 7f78be4f9700 1 -- 172.21.15.156:0/2442036709 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f78b806a770 msgr2=0x7f78b806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.211+0000 7f78be4f9700 1 --2- 172.21.15.156:0/2442036709 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f78b806a770 0x7f78b806ab40 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009840 tx=0x7f78ac009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:23.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.211+0000 7f78be4f9700 1 -- 172.21.15.156:0/2442036709 shutdown_connections 2023-09-30T22:24:23.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.211+0000 7f78be4f9700 1 --2- 172.21.15.156:0/2442036709 >> v2:172.21.15.156:3300/0 conn(0x7f78b8131ec0 0x7f78b8139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.211+0000 7f78be4f9700 1 --2- 172.21.15.156:0/2442036709 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f78b806a770 0x7f78b806ab40 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.211+0000 7f78be4f9700 1 -- 172.21.15.156:0/2442036709 >> 172.21.15.156:0/2442036709 conn(0x7f78b8099c40 msgr2=0x7f78b80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:23.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.211+0000 7f78be4f9700 1 -- 172.21.15.156:0/2442036709 shutdown_connections 2023-09-30T22:24:23.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.211+0000 7f78be4f9700 1 -- 172.21.15.156:0/2442036709 wait complete. 2023-09-30T22:24:23.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.212+0000 7f78be4f9700 1 Processor -- start 2023-09-30T22:24:23.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.212+0000 7f78be4f9700 1 -- start start 2023-09-30T22:24:23.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.213+0000 7f78be4f9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f78b806a770 0x7f78b809aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.213+0000 7f78be4f9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78b806b080 0x7f78b809b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.213+0000 7f78be4f9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78b8131ec0 0x7f78b81c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.213+0000 7f78be4f9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b8121e50 con 0x7f78b806b080 2023-09-30T22:24:23.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.213+0000 7f78be4f9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b8131470 con 0x7f78b8131ec0 2023-09-30T22:24:23.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.213+0000 7f78be4f9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78b81224d0 con 0x7f78b806a770 2023-09-30T22:24:23.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.213+0000 7f78b7fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f78b806a770 0x7f78b809aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.213+0000 7f78b7fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f78b806a770 0x7f78b809aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:58382/0 (socket says 172.21.15.156:58382) 2023-09-30T22:24:23.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.213+0000 7f78b7fff700 1 -- 172.21.15.156:0/1680216259 learned_addr learned my addr 172.21.15.156:0/1680216259 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:23.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.213+0000 7f78bca96700 1 --2- 172.21.15.156:0/1680216259 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78b8131ec0 0x7f78b81c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.213+0000 7f78b77fe700 1 --2- 172.21.15.156:0/1680216259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78b806b080 0x7f78b809b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.213+0000 7f78b7fff700 1 -- 172.21.15.156:0/1680216259 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78b8131ec0 msgr2=0x7f78b81c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.213+0000 7f78b7fff700 1 --2- 172.21.15.156:0/1680216259 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78b8131ec0 0x7f78b81c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.213+0000 7f78b7fff700 1 -- 172.21.15.156:0/1680216259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78b806b080 msgr2=0x7f78b809b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.213+0000 7f78b7fff700 1 --2- 172.21.15.156:0/1680216259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78b806b080 0x7f78b809b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.213+0000 7f78b7fff700 1 -- 172.21.15.156:0/1680216259 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b0009b30 con 0x7f78b806a770 2023-09-30T22:24:23.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.213+0000 7f78b7fff700 1 --2- 172.21.15.156:0/1680216259 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f78b806a770 0x7f78b809aed0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009fd0 tx=0x7f78ac004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:23.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.214+0000 7f78b4ff9700 1 -- 172.21.15.156:0/1680216259 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac004550 con 0x7f78b806a770 2023-09-30T22:24:23.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.214+0000 7f78b4ff9700 1 -- 172.21.15.156:0/1680216259 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ac01f070 con 0x7f78b806a770 2023-09-30T22:24:23.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.214+0000 7f78be4f9700 1 -- 172.21.15.156:0/1680216259 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78ac0094a0 con 0x7f78b806a770 2023-09-30T22:24:23.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.214+0000 7f78b4ff9700 1 -- 172.21.15.156:0/1680216259 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac0038e0 con 0x7f78b806a770 2023-09-30T22:24:23.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.214+0000 7f78be4f9700 1 -- 172.21.15.156:0/1680216259 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b809aa80 con 0x7f78b806a770 2023-09-30T22:24:23.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.214+0000 7f78b4ff9700 1 -- 172.21.15.156:0/1680216259 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f78ac003a40 con 0x7f78b806a770 2023-09-30T22:24:23.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.214+0000 7f78b4ff9700 1 -- 172.21.15.156:0/1680216259 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f78ac021070 con 0x7f78b806a770 2023-09-30T22:24:23.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.215+0000 7f78be4f9700 1 -- 172.21.15.156:0/1680216259 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b804f2a0 con 0x7f78b806a770 2023-09-30T22:24:23.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.219+0000 7f78b4ff9700 1 -- 172.21.15.156:0/1680216259 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f78ac003cf0 con 0x7f78b806a770 2023-09-30T22:24:23.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.401+0000 7f78be4f9700 1 -- 172.21.15.156:0/1680216259 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f78b806c3b0 con 0x7f78b806a770 2023-09-30T22:24:23.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.401+0000 7f78b4ff9700 1 -- 172.21.15.156:0/1680216259 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f78ac02eb90 con 0x7f78b806a770 2023-09-30T22:24:23.402 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:23.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.403+0000 7f78be4f9700 1 -- 172.21.15.156:0/1680216259 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f78b806a770 msgr2=0x7f78b809aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.403+0000 7f78be4f9700 1 --2- 172.21.15.156:0/1680216259 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f78b806a770 0x7f78b809aed0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009fd0 tx=0x7f78ac004750 comp rx=0 tx=0).stop 2023-09-30T22:24:23.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.403+0000 7f78be4f9700 1 -- 172.21.15.156:0/1680216259 shutdown_connections 2023-09-30T22:24:23.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.403+0000 7f78be4f9700 1 --2- 172.21.15.156:0/1680216259 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f78b8131ec0 0x7f78b81c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.403+0000 7f78be4f9700 1 --2- 172.21.15.156:0/1680216259 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f78b806a770 0x7f78b809aed0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.403+0000 7f78be4f9700 1 --2- 172.21.15.156:0/1680216259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78b806b080 0x7f78b809b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.403+0000 7f78be4f9700 1 -- 172.21.15.156:0/1680216259 >> 172.21.15.156:0/1680216259 conn(0x7f78b8099c40 msgr2=0x7f78b81b9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:23.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.403+0000 7f78be4f9700 1 -- 172.21.15.156:0/1680216259 shutdown_connections 2023-09-30T22:24:23.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.404+0000 7f78be4f9700 1 -- 172.21.15.156:0/1680216259 wait complete. 2023-09-30T22:24:23.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:23.737 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:23.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.861+0000 7f1e8bca1700 1 Processor -- start 2023-09-30T22:24:23.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.862+0000 7f1e8bca1700 1 -- start start 2023-09-30T22:24:23.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.862+0000 7f1e8bca1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1e840a0a70 0x7f1e840a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.862+0000 7f1e8bca1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e84134120 0x7f1e8413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.862+0000 7f1e8bca1700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e8409dc00 con 0x7f1e840a1380 2023-09-30T22:24:23.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.862+0000 7f1e8bca1700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e8409ea90 con 0x7f1e840a0a70 2023-09-30T22:24:23.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.862+0000 7f1e8bca1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8409dec0 con 0x7f1e84134120 2023-09-30T22:24:23.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.862+0000 7f1e89a3d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1e840a0a70 0x7f1e840a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.862+0000 7f1e8a23e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e84134120 0x7f1e8413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.862+0000 7f1e89a3d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1e840a0a70 0x7f1e840a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49578/0 (socket says 172.21.15.156:49578) 2023-09-30T22:24:23.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.862+0000 7f1e89a3d700 1 -- 172.21.15.156:0/3722937785 learned_addr learned my addr 172.21.15.156:0/3722937785 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:23.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.863+0000 7f1e89a3d700 1 -- 172.21.15.156:0/3722937785 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e84134120 msgr2=0x7f1e8413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:23.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.863+0000 7f1e89a3d700 1 --2- 172.21.15.156:0/3722937785 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e84134120 0x7f1e8413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.863+0000 7f1e89a3d700 1 -- 172.21.15.156:0/3722937785 >> v1:172.21.15.156:6789/0 conn(0x7f1e840a1380 legacy=0x7f1e84133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.863+0000 7f1e89a3d700 1 -- 172.21.15.156:0/3722937785 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8409e6a0 con 0x7f1e840a0a70 2023-09-30T22:24:23.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.863+0000 7f1e88a3b700 1 -- 172.21.15.156:0/3722937785 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485608661 0 0) 0x7f1e8409dc00 con 0x7f1e840a1380 2023-09-30T22:24:23.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.863+0000 7f1e8a23e700 1 --2- 172.21.15.156:0/3722937785 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e84134120 0x7f1e8413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:23.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.863+0000 7f1e89a3d700 1 --2- 172.21.15.156:0/3722937785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e840a0a70 0x7f1e840a0e40 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f1e740098f0 tx=0x7f1e74009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd8dbca8d2b8db9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:23.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.863+0000 7f1e88a3b700 1 -- 172.21.15.156:0/3722937785 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e74011830 con 0x7f1e840a0a70 2023-09-30T22:24:23.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.863+0000 7f1e88a3b700 1 -- 172.21.15.156:0/3722937785 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e74011990 con 0x7f1e840a0a70 2023-09-30T22:24:23.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.863+0000 7f1e88a3b700 1 -- 172.21.15.156:0/3722937785 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e74011d20 con 0x7f1e840a0a70 2023-09-30T22:24:23.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.863+0000 7f1e8bca1700 1 -- 172.21.15.156:0/3722937785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e840a0a70 msgr2=0x7f1e840a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.863+0000 7f1e8bca1700 1 --2- 172.21.15.156:0/3722937785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e840a0a70 0x7f1e840a0e40 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f1e740098f0 tx=0x7f1e74009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:23.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.863+0000 7f1e8bca1700 1 -- 172.21.15.156:0/3722937785 shutdown_connections 2023-09-30T22:24:23.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.863+0000 7f1e8bca1700 1 --2- 172.21.15.156:0/3722937785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e840a0a70 0x7f1e840a0e40 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.863+0000 7f1e8bca1700 1 --2- 172.21.15.156:0/3722937785 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e84134120 0x7f1e8413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.863+0000 7f1e8bca1700 1 -- 172.21.15.156:0/3722937785 >> 172.21.15.156:0/3722937785 conn(0x7f1e840a6610 msgr2=0x7f1e840a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:23.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.864+0000 7f1e8bca1700 1 -- 172.21.15.156:0/3722937785 shutdown_connections 2023-09-30T22:24:23.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.864+0000 7f1e8bca1700 1 -- 172.21.15.156:0/3722937785 wait complete. 2023-09-30T22:24:23.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.865+0000 7f1e8bca1700 1 Processor -- start 2023-09-30T22:24:23.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.865+0000 7f1e8bca1700 1 -- start start 2023-09-30T22:24:23.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.865+0000 7f1e8bca1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e840a0a70 0x7f1e84122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.865+0000 7f1e8bca1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e840a1380 0x7f1e84122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.865+0000 7f1e8bca1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e84134120 0x7f1e84123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.865+0000 7f1e8bca1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e84133300 con 0x7f1e840a0a70 2023-09-30T22:24:23.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.865+0000 7f1e8bca1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e84125920 con 0x7f1e84134120 2023-09-30T22:24:23.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.865+0000 7f1e8bca1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e84124310 con 0x7f1e840a1380 2023-09-30T22:24:23.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.865+0000 7f1e89a3d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e840a0a70 0x7f1e84122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.865+0000 7f1e89a3d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e840a0a70 0x7f1e84122700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49584/0 (socket says 172.21.15.156:49584) 2023-09-30T22:24:23.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.865+0000 7f1e89a3d700 1 -- 172.21.15.156:0/553516256 learned_addr learned my addr 172.21.15.156:0/553516256 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:23.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.866+0000 7f1e8a23e700 1 --2- 172.21.15.156:0/553516256 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e84134120 0x7f1e84123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.866+0000 7f1e8923c700 1 --2- 172.21.15.156:0/553516256 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e840a1380 0x7f1e84122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.866+0000 7f1e89a3d700 1 -- 172.21.15.156:0/553516256 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e840a1380 msgr2=0x7f1e84122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.866+0000 7f1e89a3d700 1 --2- 172.21.15.156:0/553516256 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e840a1380 0x7f1e84122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.866+0000 7f1e89a3d700 1 -- 172.21.15.156:0/553516256 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e84134120 msgr2=0x7f1e84123180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.866+0000 7f1e89a3d700 1 --2- 172.21.15.156:0/553516256 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e84134120 0x7f1e84123180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.866+0000 7f1e89a3d700 1 -- 172.21.15.156:0/553516256 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7c009a70 con 0x7f1e840a0a70 2023-09-30T22:24:23.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.866+0000 7f1e8923c700 1 --2- 172.21.15.156:0/553516256 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e840a1380 0x7f1e84122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:23.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.866+0000 7f1e8a23e700 1 --2- 172.21.15.156:0/553516256 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e84134120 0x7f1e84123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:23.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.866+0000 7f1e89a3d700 1 --2- 172.21.15.156:0/553516256 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e840a0a70 0x7f1e84122700 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f1e74009c40 tx=0x7f1e74004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:23.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.866+0000 7f1e7a7fc700 1 -- 172.21.15.156:0/553516256 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e74004340 con 0x7f1e840a0a70 2023-09-30T22:24:23.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.866+0000 7f1e7a7fc700 1 -- 172.21.15.156:0/553516256 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7401f070 con 0x7f1e840a0a70 2023-09-30T22:24:23.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.866+0000 7f1e8bca1700 1 -- 172.21.15.156:0/553516256 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e74009550 con 0x7f1e840a0a70 2023-09-30T22:24:23.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.866+0000 7f1e7a7fc700 1 -- 172.21.15.156:0/553516256 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e740036a0 con 0x7f1e840a0a70 2023-09-30T22:24:23.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.866+0000 7f1e8bca1700 1 -- 172.21.15.156:0/553516256 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e84125c80 con 0x7f1e840a0a70 2023-09-30T22:24:23.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.867+0000 7f1e7a7fc700 1 -- 172.21.15.156:0/553516256 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e74021030 con 0x7f1e840a0a70 2023-09-30T22:24:23.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.867+0000 7f1e7a7fc700 1 -- 172.21.15.156:0/553516256 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1e740409e0 con 0x7f1e840a0a70 2023-09-30T22:24:23.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.867+0000 7f1e8bca1700 1 -- 172.21.15.156:0/553516256 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e8404f2a0 con 0x7f1e840a0a70 2023-09-30T22:24:23.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:23.872+0000 7f1e7a7fc700 1 -- 172.21.15.156:0/553516256 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e74015080 con 0x7f1e840a0a70 2023-09-30T22:24:23.884 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:23.921 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:24.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.017+0000 7f3ed8c96700 1 Processor -- start 2023-09-30T22:24:24.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.017+0000 7f3ed8c96700 1 -- start start 2023-09-30T22:24:24.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.018+0000 7f3ed8c96700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ed412d280 0x7f3ed412d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.018+0000 7f3ed8c96700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ed4130eb0 0x7f3ed4138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.018+0000 7f3ed8c96700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed409ae40 con 0x7f3ed4130350 2023-09-30T22:24:24.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.018+0000 7f3ed8c96700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed409b9a0 con 0x7f3ed412d280 2023-09-30T22:24:24.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.018+0000 7f3ed8c96700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed409bbb0 con 0x7f3ed4130eb0 2023-09-30T22:24:24.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.018+0000 7f3ed259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ed412d280 0x7f3ed412d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.018+0000 7f3ed259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ed412d280 0x7f3ed412d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:47748/0 (socket says 172.21.15.156:47748) 2023-09-30T22:24:24.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.018+0000 7f3ed259c700 1 -- 172.21.15.156:0/281640990 learned_addr learned my addr 172.21.15.156:0/281640990 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:24.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.018+0000 7f3ed2d9d700 1 --2- 172.21.15.156:0/281640990 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ed4130eb0 0x7f3ed4138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.018+0000 7f3ed1d9b700 1 -- 172.21.15.156:0/281640990 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3132654857 0 0) 0x7f3ed409ae40 con 0x7f3ed4130350 2023-09-30T22:24:24.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.018+0000 7f3ed259c700 1 -- 172.21.15.156:0/281640990 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ed4130eb0 msgr2=0x7f3ed4138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:24.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.018+0000 7f3ed259c700 1 --2- 172.21.15.156:0/281640990 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ed4130eb0 0x7f3ed4138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.018+0000 7f3ed259c700 1 -- 172.21.15.156:0/281640990 >> v1:172.21.15.156:6789/0 conn(0x7f3ed4130350 legacy=0x7f3ed41307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.018+0000 7f3ed259c700 1 -- 172.21.15.156:0/281640990 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed409b250 con 0x7f3ed412d280 2023-09-30T22:24:24.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.019+0000 7f3ed259c700 1 --2- 172.21.15.156:0/281640990 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ed412d280 0x7f3ed412d650 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f3ec40098f0 tx=0x7f3ec4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d0119f19298c5c5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:24.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.019+0000 7f3ed1d9b700 1 -- 172.21.15.156:0/281640990 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4005e30 con 0x7f3ed412d280 2023-09-30T22:24:24.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.019+0000 7f3ed1d9b700 1 -- 172.21.15.156:0/281640990 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec4004030 con 0x7f3ed412d280 2023-09-30T22:24:24.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.019+0000 7f3ed1d9b700 1 -- 172.21.15.156:0/281640990 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec40043e0 con 0x7f3ed412d280 2023-09-30T22:24:24.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.019+0000 7f3ed8c96700 1 -- 172.21.15.156:0/281640990 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ed412d280 msgr2=0x7f3ed412d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.019+0000 7f3ed8c96700 1 --2- 172.21.15.156:0/281640990 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ed412d280 0x7f3ed412d650 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f3ec40098f0 tx=0x7f3ec4009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:24.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.020+0000 7f3ed8c96700 1 -- 172.21.15.156:0/281640990 shutdown_connections 2023-09-30T22:24:24.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.020+0000 7f3ed8c96700 1 --2- 172.21.15.156:0/281640990 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ed412d280 0x7f3ed412d650 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.020+0000 7f3ed8c96700 1 --2- 172.21.15.156:0/281640990 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ed4130eb0 0x7f3ed4138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.020+0000 7f3ed8c96700 1 -- 172.21.15.156:0/281640990 >> 172.21.15.156:0/281640990 conn(0x7f3ed40a2980 msgr2=0x7f3ed40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:24.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.020+0000 7f3ed8c96700 1 -- 172.21.15.156:0/281640990 shutdown_connections 2023-09-30T22:24:24.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.020+0000 7f3ed8c96700 1 -- 172.21.15.156:0/281640990 wait complete. 2023-09-30T22:24:24.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.021+0000 7f3ed8c96700 1 Processor -- start 2023-09-30T22:24:24.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.021+0000 7f3ed8c96700 1 -- start start 2023-09-30T22:24:24.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.022+0000 7f3ed8c96700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ed412d280 0x7f3ed4139c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.022+0000 7f3ed8c96700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ed4130350 0x7f3ed413a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.022+0000 7f3ed8c96700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ed4130eb0 0x7f3ed413a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.022+0000 7f3ed8c96700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed413b0c0 con 0x7f3ed4130350 2023-09-30T22:24:24.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.022+0000 7f3ed8c96700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed41375b0 con 0x7f3ed412d280 2023-09-30T22:24:24.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.022+0000 7f3ed8c96700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed4138bf0 con 0x7f3ed4130eb0 2023-09-30T22:24:24.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.022+0000 7f3ed259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ed412d280 0x7f3ed4139c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.022+0000 7f3ed259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ed412d280 0x7f3ed4139c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:47764/0 (socket says 172.21.15.156:47764) 2023-09-30T22:24:24.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.022+0000 7f3ed259c700 1 -- 172.21.15.156:0/2607585286 learned_addr learned my addr 172.21.15.156:0/2607585286 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:24.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.022+0000 7f3ecbfff700 1 --2- 172.21.15.156:0/2607585286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ed4130350 0x7f3ed413a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.022+0000 7f3ed2d9d700 1 --2- 172.21.15.156:0/2607585286 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ed4130eb0 0x7f3ed413a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.022+0000 7f3ecbfff700 1 -- 172.21.15.156:0/2607585286 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ed4130eb0 msgr2=0x7f3ed413a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.022+0000 7f3ecbfff700 1 --2- 172.21.15.156:0/2607585286 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ed4130eb0 0x7f3ed413a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.022+0000 7f3ecbfff700 1 -- 172.21.15.156:0/2607585286 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ed412d280 msgr2=0x7f3ed4139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.022+0000 7f3ecbfff700 1 --2- 172.21.15.156:0/2607585286 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ed412d280 0x7f3ed4139c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.022+0000 7f3ecbfff700 1 -- 172.21.15.156:0/2607585286 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec4009500 con 0x7f3ed4130350 2023-09-30T22:24:24.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.022+0000 7f3ed259c700 1 --2- 172.21.15.156:0/2607585286 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ed412d280 0x7f3ed4139c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:24.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.023+0000 7f3ecbfff700 1 --2- 172.21.15.156:0/2607585286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ed4130350 0x7f3ed413a150 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc00c430 tx=0x7f3ebc00c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:24.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.023+0000 7f3ecaffd700 1 -- 172.21.15.156:0/2607585286 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc0052e0 con 0x7f3ed4130350 2023-09-30T22:24:24.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.023+0000 7f3ecaffd700 1 -- 172.21.15.156:0/2607585286 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ebc005460 con 0x7f3ed4130350 2023-09-30T22:24:24.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.023+0000 7f3ecaffd700 1 -- 172.21.15.156:0/2607585286 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc0038c0 con 0x7f3ed4130350 2023-09-30T22:24:24.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.023+0000 7f3ed8c96700 1 -- 172.21.15.156:0/2607585286 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed4137fc0 con 0x7f3ed4130350 2023-09-30T22:24:24.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.023+0000 7f3ed8c96700 1 -- 172.21.15.156:0/2607585286 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed409b490 con 0x7f3ed4130350 2023-09-30T22:24:24.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.024+0000 7f3ecaffd700 1 -- 172.21.15.156:0/2607585286 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ebc003a20 con 0x7f3ed4130350 2023-09-30T22:24:24.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.024+0000 7f3ecaffd700 1 -- 172.21.15.156:0/2607585286 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3ebc03e9b0 con 0x7f3ed4130350 2023-09-30T22:24:24.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.025+0000 7f3ed8c96700 1 -- 172.21.15.156:0/2607585286 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed41385b0 con 0x7f3ed4130350 2023-09-30T22:24:24.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.030+0000 7f3ecaffd700 1 -- 172.21.15.156:0/2607585286 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ed41385b0 con 0x7f3ed4130350 2023-09-30T22:24:24.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.054+0000 7f728ed02700 1 Processor -- start 2023-09-30T22:24:24.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.054+0000 7f728ed02700 1 -- start start 2023-09-30T22:24:24.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.054+0000 7f728ed02700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72880a0a70 0x7f72880a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.054+0000 7f728ed02700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f72880a1380 0x7f7288133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.054+0000 7f728ed02700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7288133f50 0x7f7288134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.054+0000 7f728ed02700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f728809e9d0 con 0x7f72880a1380 2023-09-30T22:24:24.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.054+0000 7f728ed02700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728809dc00 con 0x7f72880a0a70 2023-09-30T22:24:24.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.054+0000 7f728ed02700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f728809dec0 con 0x7f7288133f50 2023-09-30T22:24:24.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.055+0000 7f7287fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f72880a1380 0x7f7288133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.055+0000 7f7287fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f72880a1380 0x7f7288133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49606/0 (socket says 172.21.15.156:49606) 2023-09-30T22:24:24.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.055+0000 7f7287fff700 1 -- 172.21.15.156:0/530220893 learned_addr learned my addr 172.21.15.156:0/530220893 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:24.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.055+0000 7f728d29f700 1 --2- 172.21.15.156:0/530220893 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7288133f50 0x7f7288134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.055+0000 7f728ca9e700 1 --2- 172.21.15.156:0/530220893 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72880a0a70 0x7f72880a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.055+0000 7f728d29f700 1 -- 172.21.15.156:0/530220893 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72880a0a70 msgr2=0x7f72880a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:24.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.055+0000 7f728d29f700 1 --2- 172.21.15.156:0/530220893 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72880a0a70 0x7f72880a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.055+0000 7f728d29f700 1 -- 172.21.15.156:0/530220893 >> v2:172.21.15.156:3300/0 conn(0x7f72880a1380 msgr2=0x7f7288133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:24.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.055+0000 7f728d29f700 1 --2- 172.21.15.156:0/530220893 >> v2:172.21.15.156:3300/0 conn(0x7f72880a1380 0x7f7288133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.055+0000 7f728d29f700 1 -- 172.21.15.156:0/530220893 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728809e6a0 con 0x7f7288133f50 2023-09-30T22:24:24.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.055+0000 7f728ca9e700 1 --2- 172.21.15.156:0/530220893 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72880a0a70 0x7f72880a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:24.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.055+0000 7f7287fff700 1 --2- 172.21.15.156:0/530220893 >> v2:172.21.15.156:3300/0 conn(0x7f72880a1380 0x7f7288133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:24.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.055+0000 7f728d29f700 1 --2- 172.21.15.156:0/530220893 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7288133f50 0x7f7288134380 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7280009d90 tx=0x7f728000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e43350823910ea7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:24.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.055+0000 7f72877fe700 1 -- 172.21.15.156:0/530220893 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728000e070 con 0x7f7288133f50 2023-09-30T22:24:24.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.055+0000 7f72877fe700 1 -- 172.21.15.156:0/530220893 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728000bb20 con 0x7f7288133f50 2023-09-30T22:24:24.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.055+0000 7f72877fe700 1 -- 172.21.15.156:0/530220893 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7280012430 con 0x7f7288133f50 2023-09-30T22:24:24.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.056+0000 7f728ed02700 1 -- 172.21.15.156:0/530220893 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7288133f50 msgr2=0x7f7288134380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.056+0000 7f728ed02700 1 --2- 172.21.15.156:0/530220893 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7288133f50 0x7f7288134380 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7280009d90 tx=0x7f728000b330 comp rx=0 tx=0).stop 2023-09-30T22:24:24.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.056+0000 7f728ed02700 1 -- 172.21.15.156:0/530220893 shutdown_connections 2023-09-30T22:24:24.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.056+0000 7f728ed02700 1 --2- 172.21.15.156:0/530220893 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7288133f50 0x7f7288134380 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.056+0000 7f728ed02700 1 --2- 172.21.15.156:0/530220893 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72880a0a70 0x7f72880a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.056+0000 7f728ed02700 1 --2- 172.21.15.156:0/530220893 >> v2:172.21.15.156:3300/0 conn(0x7f72880a1380 0x7f7288133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.056+0000 7f728ed02700 1 -- 172.21.15.156:0/530220893 >> 172.21.15.156:0/530220893 conn(0x7f72880a6610 msgr2=0x7f72880a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:24.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.056+0000 7f728ed02700 1 -- 172.21.15.156:0/530220893 shutdown_connections 2023-09-30T22:24:24.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.056+0000 7f728ed02700 1 -- 172.21.15.156:0/530220893 wait complete. 2023-09-30T22:24:24.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.057+0000 7f728ed02700 1 Processor -- start 2023-09-30T22:24:24.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.057+0000 7f728ed02700 1 -- start start 2023-09-30T22:24:24.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.057+0000 7f728ed02700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72880a0a70 0x7f7288122520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.057+0000 7f728ed02700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72880a1380 0x7f7288122a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.057+0000 7f728ed02700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7288133f50 0x7f7288122fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.057+0000 7f728ed02700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7288125380 con 0x7f72880a0a70 2023-09-30T22:24:24.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.057+0000 7f728ed02700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7288133a70 con 0x7f7288133f50 2023-09-30T22:24:24.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.057+0000 7f728ed02700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7288124fc0 con 0x7f72880a1380 2023-09-30T22:24:24.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.058+0000 7f728ca9e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72880a0a70 0x7f7288122520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.058+0000 7f7287fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72880a1380 0x7f7288122a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.058+0000 7f728ca9e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72880a0a70 0x7f7288122520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49614/0 (socket says 172.21.15.156:49614) 2023-09-30T22:24:24.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.058+0000 7f728ca9e700 1 -- 172.21.15.156:0/4009210353 learned_addr learned my addr 172.21.15.156:0/4009210353 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:24.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.058+0000 7f728d29f700 1 --2- 172.21.15.156:0/4009210353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7288133f50 0x7f7288122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.058+0000 7f728ca9e700 1 -- 172.21.15.156:0/4009210353 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72880a1380 msgr2=0x7f7288122a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.058+0000 7f728ca9e700 1 --2- 172.21.15.156:0/4009210353 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72880a1380 0x7f7288122a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.058+0000 7f728ca9e700 1 -- 172.21.15.156:0/4009210353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7288133f50 msgr2=0x7f7288122fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.058+0000 7f728ca9e700 1 --2- 172.21.15.156:0/4009210353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7288133f50 0x7f7288122fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.058+0000 7f728ca9e700 1 -- 172.21.15.156:0/4009210353 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727c0094a0 con 0x7f72880a0a70 2023-09-30T22:24:24.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.058+0000 7f7287fff700 1 --2- 172.21.15.156:0/4009210353 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72880a1380 0x7f7288122a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:24.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.058+0000 7f728d29f700 1 --2- 172.21.15.156:0/4009210353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7288133f50 0x7f7288122fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:24.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.058+0000 7f728ca9e700 1 --2- 172.21.15.156:0/4009210353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72880a0a70 0x7f7288122520 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f727c00e9b0 tx=0x7f727c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:24.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.058+0000 7f72857fa700 1 -- 172.21.15.156:0/4009210353 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c0096e0 con 0x7f72880a0a70 2023-09-30T22:24:24.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.058+0000 7f72857fa700 1 -- 172.21.15.156:0/4009210353 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727c00ee50 con 0x7f72880a0a70 2023-09-30T22:24:24.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.058+0000 7f728ed02700 1 -- 172.21.15.156:0/4009210353 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7274009550 con 0x7f72880a0a70 2023-09-30T22:24:24.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.058+0000 7f72857fa700 1 -- 172.21.15.156:0/4009210353 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c00ca70 con 0x7f72880a0a70 2023-09-30T22:24:24.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.058+0000 7f728ed02700 1 -- 172.21.15.156:0/4009210353 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7280009a70 con 0x7f72880a0a70 2023-09-30T22:24:24.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.059+0000 7f72857fa700 1 -- 172.21.15.156:0/4009210353 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f727c00cbd0 con 0x7f72880a0a70 2023-09-30T22:24:24.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.059+0000 7f72857fa700 1 -- 172.21.15.156:0/4009210353 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f727c03f6e0 con 0x7f72880a0a70 2023-09-30T22:24:24.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.059+0000 7f728ed02700 1 -- 172.21.15.156:0/4009210353 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f728804f2a0 con 0x7f72880a0a70 2023-09-30T22:24:24.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.064+0000 7f72857fa700 1 -- 172.21.15.156:0/4009210353 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f727c0232f0 con 0x7f72880a0a70 2023-09-30T22:24:24.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.098+0000 7f1e8bca1700 1 -- 172.21.15.156:0/553516256 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1e84072980 con 0x7f1e840a0a70 2023-09-30T22:24:24.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.098+0000 7f1e7a7fc700 1 -- 172.21.15.156:0/553516256 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e740199a0 con 0x7f1e840a0a70 2023-09-30T22:24:24.099 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:24.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.100+0000 7f1e8bca1700 1 -- 172.21.15.156:0/553516256 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e840a0a70 msgr2=0x7f1e84122700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.100+0000 7f1e8bca1700 1 --2- 172.21.15.156:0/553516256 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e840a0a70 0x7f1e84122700 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f1e74009c40 tx=0x7f1e74004750 comp rx=0 tx=0).stop 2023-09-30T22:24:24.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.100+0000 7f1e8bca1700 1 -- 172.21.15.156:0/553516256 shutdown_connections 2023-09-30T22:24:24.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.100+0000 7f1e8bca1700 1 --2- 172.21.15.156:0/553516256 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1e84134120 0x7f1e84123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.100+0000 7f1e8bca1700 1 --2- 172.21.15.156:0/553516256 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e840a0a70 0x7f1e84122700 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.100+0000 7f1e8bca1700 1 --2- 172.21.15.156:0/553516256 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1e840a1380 0x7f1e84122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.100+0000 7f1e8bca1700 1 -- 172.21.15.156:0/553516256 >> 172.21.15.156:0/553516256 conn(0x7f1e840a6610 msgr2=0x7f1e840a5050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:24.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.100+0000 7f1e8bca1700 1 -- 172.21.15.156:0/553516256 shutdown_connections 2023-09-30T22:24:24.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.100+0000 7f1e8bca1700 1 -- 172.21.15.156:0/553516256 wait complete. 2023-09-30T22:24:24.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:24.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.250+0000 7f3ed8c96700 1 -- 172.21.15.156:0/2607585286 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3ed41385b0 con 0x7f3ed4130350 2023-09-30T22:24:24.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.250+0000 7f3ecaffd700 1 -- 172.21.15.156:0/2607585286 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ed41385b0 con 0x7f3ed4130350 2023-09-30T22:24:24.251 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:24.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.253+0000 7f3ed8c96700 1 -- 172.21.15.156:0/2607585286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ed4130350 msgr2=0x7f3ed413a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.253+0000 7f3ed8c96700 1 --2- 172.21.15.156:0/2607585286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ed4130350 0x7f3ed413a150 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc00c430 tx=0x7f3ebc00c740 comp rx=0 tx=0).stop 2023-09-30T22:24:24.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.253+0000 7f3ed8c96700 1 -- 172.21.15.156:0/2607585286 shutdown_connections 2023-09-30T22:24:24.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.253+0000 7f3ed8c96700 1 --2- 172.21.15.156:0/2607585286 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ed4130eb0 0x7f3ed413a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.253+0000 7f3ed8c96700 1 --2- 172.21.15.156:0/2607585286 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ed412d280 0x7f3ed4139c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.253+0000 7f3ed8c96700 1 --2- 172.21.15.156:0/2607585286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ed4130350 0x7f3ed413a150 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.253+0000 7f3ed8c96700 1 -- 172.21.15.156:0/2607585286 >> 172.21.15.156:0/2607585286 conn(0x7f3ed40a2980 msgr2=0x7f3ed409fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:24.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.253+0000 7f3ed8c96700 1 -- 172.21.15.156:0/2607585286 shutdown_connections 2023-09-30T22:24:24.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.253+0000 7f3ed8c96700 1 -- 172.21.15.156:0/2607585286 wait complete. 2023-09-30T22:24:24.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.258+0000 7f728ed02700 1 -- 172.21.15.156:0/4009210353 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f72880a4bb0 con 0x7f72880a0a70 2023-09-30T22:24:24.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.258+0000 7f72857fa700 1 -- 172.21.15.156:0/4009210353 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f727c01bb60 con 0x7f72880a0a70 2023-09-30T22:24:24.259 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:24.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.260+0000 7f728ed02700 1 -- 172.21.15.156:0/4009210353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72880a0a70 msgr2=0x7f7288122520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.261+0000 7f728ed02700 1 --2- 172.21.15.156:0/4009210353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72880a0a70 0x7f7288122520 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f727c00e9b0 tx=0x7f727c00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.261+0000 7f728ed02700 1 -- 172.21.15.156:0/4009210353 shutdown_connections 2023-09-30T22:24:24.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.261+0000 7f728ed02700 1 --2- 172.21.15.156:0/4009210353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7288133f50 0x7f7288122fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.261+0000 7f728ed02700 1 --2- 172.21.15.156:0/4009210353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72880a0a70 0x7f7288122520 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.261+0000 7f728ed02700 1 --2- 172.21.15.156:0/4009210353 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72880a1380 0x7f7288122a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.261+0000 7f728ed02700 1 -- 172.21.15.156:0/4009210353 >> 172.21.15.156:0/4009210353 conn(0x7f72880a6610 msgr2=0x7f728809b740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:24.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.261+0000 7f728ed02700 1 -- 172.21.15.156:0/4009210353 shutdown_connections 2023-09-30T22:24:24.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.261+0000 7f728ed02700 1 -- 172.21.15.156:0/4009210353 wait complete. 2023-09-30T22:24:24.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:24.274 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:24.417 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:24.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.540+0000 7f6fc6bca700 1 Processor -- start 2023-09-30T22:24:24.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.540+0000 7f6fc6bca700 1 -- start start 2023-09-30T22:24:24.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.540+0000 7f6fc6bca700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fc009d860 0x7f6fc009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.540+0000 7f6fc6bca700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fc009e170 0x7f6fc01307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.540+0000 7f6fc6bca700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6fc0130ce0 0x7f6fc0131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.540+0000 7f6fc6bca700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc009aaa0 con 0x7f6fc0130ce0 2023-09-30T22:24:24.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.540+0000 7f6fc6bca700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc009f870 con 0x7f6fc009e170 2023-09-30T22:24:24.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.540+0000 7f6fc6bca700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc009b360 con 0x7f6fc009d860 2023-09-30T22:24:24.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.540+0000 7f6fc4966700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fc009d860 0x7f6fc009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.540+0000 7f6fbffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fc009e170 0x7f6fc01307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.540+0000 7f6fc5167700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6fc0130ce0 0x7f6fc0131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.541+0000 7f6fbffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fc009e170 0x7f6fc01307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:47790/0 (socket says 172.21.15.156:47790) 2023-09-30T22:24:24.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.541+0000 7f6fc4966700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fc009d860 0x7f6fc009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:58464/0 (socket says 172.21.15.156:58464) 2023-09-30T22:24:24.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.541+0000 7f6fbffff700 1 -- 172.21.15.156:0/4001071481 learned_addr learned my addr 172.21.15.156:0/4001071481 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:24.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.541+0000 7f6fc4966700 1 -- 172.21.15.156:0/4001071481 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fc009e170 msgr2=0x7f6fc01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:24.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.541+0000 7f6fc4966700 1 --2- 172.21.15.156:0/4001071481 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fc009e170 0x7f6fc01307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.541+0000 7f6fc4966700 1 -- 172.21.15.156:0/4001071481 >> v2:172.21.15.156:3300/0 conn(0x7f6fc0130ce0 msgr2=0x7f6fc0131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:24.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.541+0000 7f6fc4966700 1 --2- 172.21.15.156:0/4001071481 >> v2:172.21.15.156:3300/0 conn(0x7f6fc0130ce0 0x7f6fc0131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.541+0000 7f6fc4966700 1 -- 172.21.15.156:0/4001071481 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc009b620 con 0x7f6fc009d860 2023-09-30T22:24:24.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.541+0000 7f6fbffff700 1 --2- 172.21.15.156:0/4001071481 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fc009e170 0x7f6fc01307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:24.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.541+0000 7f6fc5167700 1 --2- 172.21.15.156:0/4001071481 >> v2:172.21.15.156:3300/0 conn(0x7f6fc0130ce0 0x7f6fc0131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:24.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.541+0000 7f6fc4966700 1 --2- 172.21.15.156:0/4001071481 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fc009d860 0x7f6fc009dc30 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4009840 tx=0x7f6fb4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b571bc18a623afe3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:24.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.541+0000 7f6fbf7fe700 1 -- 172.21.15.156:0/4001071481 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4011830 con 0x7f6fc009d860 2023-09-30T22:24:24.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.541+0000 7f6fbf7fe700 1 -- 172.21.15.156:0/4001071481 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb4011990 con 0x7f6fc009d860 2023-09-30T22:24:24.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.541+0000 7f6fbf7fe700 1 -- 172.21.15.156:0/4001071481 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4011d20 con 0x7f6fc009d860 2023-09-30T22:24:24.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.542+0000 7f6fc6bca700 1 -- 172.21.15.156:0/4001071481 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fc009d860 msgr2=0x7f6fc009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.542+0000 7f6fc6bca700 1 --2- 172.21.15.156:0/4001071481 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fc009d860 0x7f6fc009dc30 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4009840 tx=0x7f6fb4009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:24.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.542+0000 7f6fc6bca700 1 -- 172.21.15.156:0/4001071481 shutdown_connections 2023-09-30T22:24:24.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.542+0000 7f6fc6bca700 1 --2- 172.21.15.156:0/4001071481 >> v2:172.21.15.156:3300/0 conn(0x7f6fc0130ce0 0x7f6fc0131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.542+0000 7f6fc6bca700 1 --2- 172.21.15.156:0/4001071481 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fc009d860 0x7f6fc009dc30 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.542+0000 7f6fc6bca700 1 --2- 172.21.15.156:0/4001071481 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fc009e170 0x7f6fc01307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.542+0000 7f6fc6bca700 1 -- 172.21.15.156:0/4001071481 >> 172.21.15.156:0/4001071481 conn(0x7f6fc0099c40 msgr2=0x7f6fc00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:24.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.542+0000 7f6fc6bca700 1 -- 172.21.15.156:0/4001071481 shutdown_connections 2023-09-30T22:24:24.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.542+0000 7f6fc6bca700 1 -- 172.21.15.156:0/4001071481 wait complete. 2023-09-30T22:24:24.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.543+0000 7f6fc6bca700 1 Processor -- start 2023-09-30T22:24:24.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.543+0000 7f6fc6bca700 1 -- start start 2023-09-30T22:24:24.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.544+0000 7f6fc6bca700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fc009d860 0x7f6fc01202c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.544+0000 7f6fc6bca700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fc009e170 0x7f6fc0120800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.544+0000 7f6fc6bca700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fc0130ce0 0x7f6fc0120d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.544+0000 7f6fc6bca700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc012f560 con 0x7f6fc009d860 2023-09-30T22:24:24.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.544+0000 7f6fc6bca700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc0122720 con 0x7f6fc009e170 2023-09-30T22:24:24.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.544+0000 7f6fc6bca700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc01215f0 con 0x7f6fc0130ce0 2023-09-30T22:24:24.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.544+0000 7f6fc4966700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fc009d860 0x7f6fc01202c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.544+0000 7f6fbffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fc009e170 0x7f6fc0120800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.544+0000 7f6fc4966700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fc009d860 0x7f6fc01202c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49640/0 (socket says 172.21.15.156:49640) 2023-09-30T22:24:24.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.544+0000 7f6fc4966700 1 -- 172.21.15.156:0/1351793616 learned_addr learned my addr 172.21.15.156:0/1351793616 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:24.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.544+0000 7f6fc5167700 1 --2- 172.21.15.156:0/1351793616 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fc0130ce0 0x7f6fc0120d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.544+0000 7f6fbffff700 1 -- 172.21.15.156:0/1351793616 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fc0130ce0 msgr2=0x7f6fc0120d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.544+0000 7f6fbffff700 1 --2- 172.21.15.156:0/1351793616 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fc0130ce0 0x7f6fc0120d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.544+0000 7f6fbffff700 1 -- 172.21.15.156:0/1351793616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fc009d860 msgr2=0x7f6fc01202c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.544+0000 7f6fbffff700 1 --2- 172.21.15.156:0/1351793616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fc009d860 0x7f6fc01202c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.544+0000 7f6fbffff700 1 -- 172.21.15.156:0/1351793616 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fac009550 con 0x7f6fc009e170 2023-09-30T22:24:24.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.544+0000 7f6fc4966700 1 --2- 172.21.15.156:0/1351793616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fc009d860 0x7f6fc01202c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:24.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.544+0000 7f6fbffff700 1 --2- 172.21.15.156:0/1351793616 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fc009e170 0x7f6fc0120800 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f6fc009a100 tx=0x7f6fac00ebf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:24.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.544+0000 7f6fbd7fa700 1 -- 172.21.15.156:0/1351793616 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac004240 con 0x7f6fc009e170 2023-09-30T22:24:24.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.544+0000 7f6fbd7fa700 1 -- 172.21.15.156:0/1351793616 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fac0043a0 con 0x7f6fc009e170 2023-09-30T22:24:24.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.544+0000 7f6fc6bca700 1 -- 172.21.15.156:0/1351793616 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb8009a70 con 0x7f6fc009e170 2023-09-30T22:24:24.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.544+0000 7f6fbd7fa700 1 -- 172.21.15.156:0/1351793616 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac0036a0 con 0x7f6fc009e170 2023-09-30T22:24:24.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.545+0000 7f6fc6bca700 1 -- 172.21.15.156:0/1351793616 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb40094a0 con 0x7f6fc009e170 2023-09-30T22:24:24.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.545+0000 7f6fbd7fa700 1 -- 172.21.15.156:0/1351793616 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6fac003800 con 0x7f6fc009e170 2023-09-30T22:24:24.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.546+0000 7f6fc6bca700 1 -- 172.21.15.156:0/1351793616 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc011add0 con 0x7f6fc009e170 2023-09-30T22:24:24.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.546+0000 7f6fbd7fa700 1 -- 172.21.15.156:0/1351793616 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6fac03f830 con 0x7f6fc009e170 2023-09-30T22:24:24.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.550+0000 7f6fbd7fa700 1 -- 172.21.15.156:0/1351793616 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6fac013470 con 0x7f6fc009e170 2023-09-30T22:24:24.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.735+0000 7f6fc6bca700 1 -- 172.21.15.156:0/1351793616 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6fc004f2a0 con 0x7f6fc009e170 2023-09-30T22:24:24.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.736+0000 7f6fbd7fa700 1 -- 172.21.15.156:0/1351793616 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6fac02a090 con 0x7f6fc009e170 2023-09-30T22:24:24.737 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:24.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.738+0000 7f6fc6bca700 1 -- 172.21.15.156:0/1351793616 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fc009e170 msgr2=0x7f6fc0120800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.738+0000 7f6fc6bca700 1 --2- 172.21.15.156:0/1351793616 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fc009e170 0x7f6fc0120800 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f6fc009a100 tx=0x7f6fac00ebf0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.738+0000 7f6fc6bca700 1 -- 172.21.15.156:0/1351793616 shutdown_connections 2023-09-30T22:24:24.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.738+0000 7f6fc6bca700 1 --2- 172.21.15.156:0/1351793616 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fc0130ce0 0x7f6fc0120d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.738+0000 7f6fc6bca700 1 --2- 172.21.15.156:0/1351793616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fc009d860 0x7f6fc01202c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.738+0000 7f6fc6bca700 1 --2- 172.21.15.156:0/1351793616 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fc009e170 0x7f6fc0120800 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.738+0000 7f6fc6bca700 1 -- 172.21.15.156:0/1351793616 >> 172.21.15.156:0/1351793616 conn(0x7f6fc0099c40 msgr2=0x7f6fc0130080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:24.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.738+0000 7f6fc6bca700 1 -- 172.21.15.156:0/1351793616 shutdown_connections 2023-09-30T22:24:24.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:24.738+0000 7f6fc6bca700 1 -- 172.21.15.156:0/1351793616 wait complete. 2023-09-30T22:24:24.751 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:25.120 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:25.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.243+0000 7f98ac06f700 1 Processor -- start 2023-09-30T22:24:25.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.243+0000 7f98ac06f700 1 -- start start 2023-09-30T22:24:25.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.244+0000 7f98ac06f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98a409a150 0x7f98a409e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.244+0000 7f98ac06f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98a409edb0 0x7f98a409f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.244+0000 7f98ac06f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f98a4133c20 0x7f98a41340c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.244+0000 7f98ac06f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a409a520 con 0x7f98a4133c20 2023-09-30T22:24:25.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.244+0000 7f98ac06f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a409fe00 con 0x7f98a409a150 2023-09-30T22:24:25.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.244+0000 7f98ac06f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98a406bec0 con 0x7f98a409edb0 2023-09-30T22:24:25.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.244+0000 7f98a960a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98a409edb0 0x7f98a409f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.244+0000 7f98a9e0b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98a409a150 0x7f98a409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.244+0000 7f98aa60c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f98a4133c20 0x7f98a41340c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.244+0000 7f98a960a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98a409edb0 0x7f98a409f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:58478/0 (socket says 172.21.15.156:58478) 2023-09-30T22:24:25.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.244+0000 7f98a9e0b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98a409a150 0x7f98a409e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:47814/0 (socket says 172.21.15.156:47814) 2023-09-30T22:24:25.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.244+0000 7f98a960a700 1 -- 172.21.15.156:0/3054132296 learned_addr learned my addr 172.21.15.156:0/3054132296 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:25.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.244+0000 7f98a9e0b700 1 -- 172.21.15.156:0/3054132296 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98a409edb0 msgr2=0x7f98a409f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:25.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.244+0000 7f98a9e0b700 1 --2- 172.21.15.156:0/3054132296 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98a409edb0 0x7f98a409f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.244+0000 7f98a9e0b700 1 -- 172.21.15.156:0/3054132296 >> v2:172.21.15.156:3300/0 conn(0x7f98a4133c20 msgr2=0x7f98a41340c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:25.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.244+0000 7f98a9e0b700 1 --2- 172.21.15.156:0/3054132296 >> v2:172.21.15.156:3300/0 conn(0x7f98a4133c20 0x7f98a41340c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.244+0000 7f98a9e0b700 1 -- 172.21.15.156:0/3054132296 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a409af80 con 0x7f98a409a150 2023-09-30T22:24:25.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.244+0000 7f98aa60c700 1 --2- 172.21.15.156:0/3054132296 >> v2:172.21.15.156:3300/0 conn(0x7f98a4133c20 0x7f98a41340c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:25.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.244+0000 7f98a9e0b700 1 --2- 172.21.15.156:0/3054132296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98a409a150 0x7f98a409e870 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f9894009840 tx=0x7f9894009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c51569a4ed57d74 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:25.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.245+0000 7f98a8e09700 1 -- 172.21.15.156:0/3054132296 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9894011830 con 0x7f98a409a150 2023-09-30T22:24:25.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.245+0000 7f98a8e09700 1 -- 172.21.15.156:0/3054132296 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9894011990 con 0x7f98a409a150 2023-09-30T22:24:25.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.245+0000 7f98a8e09700 1 -- 172.21.15.156:0/3054132296 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9894011d20 con 0x7f98a409a150 2023-09-30T22:24:25.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.245+0000 7f98ac06f700 1 -- 172.21.15.156:0/3054132296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98a409a150 msgr2=0x7f98a409e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.245+0000 7f98ac06f700 1 --2- 172.21.15.156:0/3054132296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98a409a150 0x7f98a409e870 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f9894009840 tx=0x7f9894009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:25.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.245+0000 7f98ac06f700 1 -- 172.21.15.156:0/3054132296 shutdown_connections 2023-09-30T22:24:25.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.245+0000 7f98ac06f700 1 --2- 172.21.15.156:0/3054132296 >> v2:172.21.15.156:3300/0 conn(0x7f98a4133c20 0x7f98a41340c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.245+0000 7f98ac06f700 1 --2- 172.21.15.156:0/3054132296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98a409a150 0x7f98a409e870 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.245+0000 7f98ac06f700 1 --2- 172.21.15.156:0/3054132296 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98a409edb0 0x7f98a409f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.245+0000 7f98ac06f700 1 -- 172.21.15.156:0/3054132296 >> 172.21.15.156:0/3054132296 conn(0x7f98a40a4430 msgr2=0x7f98a40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:25.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.245+0000 7f98ac06f700 1 -- 172.21.15.156:0/3054132296 shutdown_connections 2023-09-30T22:24:25.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.245+0000 7f98ac06f700 1 -- 172.21.15.156:0/3054132296 wait complete. 2023-09-30T22:24:25.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.246+0000 7f98ac06f700 1 Processor -- start 2023-09-30T22:24:25.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.246+0000 7f98ac06f700 1 -- start start 2023-09-30T22:24:25.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.247+0000 7f98ac06f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98a409a150 0x7f98a41c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.247+0000 7f98ac06f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98a409edb0 0x7f98a41c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.247+0000 7f98ac06f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98a4133c20 0x7f98a41c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.247+0000 7f98ac06f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a4121490 con 0x7f98a409a150 2023-09-30T22:24:25.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.247+0000 7f98ac06f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a4120ba0 con 0x7f98a4133c20 2023-09-30T22:24:25.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.247+0000 7f98ac06f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98a4122840 con 0x7f98a409edb0 2023-09-30T22:24:25.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.247+0000 7f98a9e0b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98a409a150 0x7f98a41c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.247+0000 7f98aa60c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98a4133c20 0x7f98a41c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.247+0000 7f98a9e0b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98a409a150 0x7f98a41c8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49660/0 (socket says 172.21.15.156:49660) 2023-09-30T22:24:25.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.247+0000 7f98aa60c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98a4133c20 0x7f98a41c9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:47818/0 (socket says 172.21.15.156:47818) 2023-09-30T22:24:25.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.247+0000 7f98a9e0b700 1 -- 172.21.15.156:0/2649303440 learned_addr learned my addr 172.21.15.156:0/2649303440 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:25.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.247+0000 7f98a960a700 1 --2- 172.21.15.156:0/2649303440 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98a409edb0 0x7f98a41c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.247+0000 7f98aa60c700 1 -- 172.21.15.156:0/2649303440 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98a409edb0 msgr2=0x7f98a41c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.247+0000 7f98aa60c700 1 --2- 172.21.15.156:0/2649303440 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98a409edb0 0x7f98a41c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.247+0000 7f98aa60c700 1 -- 172.21.15.156:0/2649303440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98a409a150 msgr2=0x7f98a41c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.247+0000 7f98aa60c700 1 --2- 172.21.15.156:0/2649303440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98a409a150 0x7f98a41c8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.247+0000 7f98aa60c700 1 -- 172.21.15.156:0/2649303440 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c009a70 con 0x7f98a4133c20 2023-09-30T22:24:25.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.247+0000 7f98a9e0b700 1 --2- 172.21.15.156:0/2649303440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98a409a150 0x7f98a41c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:25.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.247+0000 7f98aa60c700 1 --2- 172.21.15.156:0/2649303440 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98a4133c20 0x7f98a41c9190 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f989c009e50 tx=0x7f989c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:25.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.247+0000 7f989a7fc700 1 -- 172.21.15.156:0/2649303440 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c00ca90 con 0x7f98a4133c20 2023-09-30T22:24:25.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.247+0000 7f989a7fc700 1 -- 172.21.15.156:0/2649303440 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989c00f040 con 0x7f98a4133c20 2023-09-30T22:24:25.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.247+0000 7f98ac06f700 1 -- 172.21.15.156:0/2649303440 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98940094a0 con 0x7f98a4133c20 2023-09-30T22:24:25.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.247+0000 7f989a7fc700 1 -- 172.21.15.156:0/2649303440 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c00ce50 con 0x7f98a4133c20 2023-09-30T22:24:25.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.247+0000 7f98ac06f700 1 -- 172.21.15.156:0/2649303440 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a40a0440 con 0x7f98a4133c20 2023-09-30T22:24:25.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.248+0000 7f989a7fc700 1 -- 172.21.15.156:0/2649303440 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f989c014480 con 0x7f98a4133c20 2023-09-30T22:24:25.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.248+0000 7f989a7fc700 1 -- 172.21.15.156:0/2649303440 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f989c03fbf0 con 0x7f98a4133c20 2023-09-30T22:24:25.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.248+0000 7f98ac06f700 1 -- 172.21.15.156:0/2649303440 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a409fa30 con 0x7f98a4133c20 2023-09-30T22:24:25.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.253+0000 7f989a7fc700 1 -- 172.21.15.156:0/2649303440 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f989c012930 con 0x7f98a4133c20 2023-09-30T22:24:25.267 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:25.274 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:25.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.396+0000 7f1eb1e1c700 1 Processor -- start 2023-09-30T22:24:25.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.396+0000 7f1eb1e1c700 1 -- start start 2023-09-30T22:24:25.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.396+0000 7f1eb1e1c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1eac09f350 0x7f1eac136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.396+0000 7f1eb1e1c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1eac1371c0 0x7f1eac1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.396+0000 7f1eb1e1c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eac09c970 con 0x7f1eac09e870 2023-09-30T22:24:25.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.396+0000 7f1eb1e1c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eac0a0920 con 0x7f1eac1371c0 2023-09-30T22:24:25.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.396+0000 7f1eb1e1c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac09f9c0 con 0x7f1eac09f350 2023-09-30T22:24:25.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.396+0000 7f1eaaffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1eac09f350 0x7f1eac136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.396+0000 7f1eaaffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1eac09f350 0x7f1eac136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:58496/0 (socket says 172.21.15.156:58496) 2023-09-30T22:24:25.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.396+0000 7f1eaaffd700 1 -- 172.21.15.156:0/4004937979 learned_addr learned my addr 172.21.15.156:0/4004937979 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:25.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.396+0000 7f1eabfff700 1 --2- 172.21.15.156:0/4004937979 >> v2:172.21.15.156:3300/0 conn(0x7f1eac1371c0 0x7f1eac1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.397+0000 7f1eaaffd700 1 -- 172.21.15.156:0/4004937979 >> v2:172.21.15.156:3300/0 conn(0x7f1eac1371c0 msgr2=0x7f1eac1395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:25.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.397+0000 7f1eaaffd700 1 --2- 172.21.15.156:0/4004937979 >> v2:172.21.15.156:3300/0 conn(0x7f1eac1371c0 0x7f1eac1395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.397+0000 7f1eaa7fc700 1 -- 172.21.15.156:0/4004937979 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 849288525 0 0) 0x7f1eac09c970 con 0x7f1eac09e870 2023-09-30T22:24:25.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.397+0000 7f1eaaffd700 1 -- 172.21.15.156:0/4004937979 >> v1:172.21.15.156:6789/0 conn(0x7f1eac09e870 legacy=0x7f1eac09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.397+0000 7f1eaaffd700 1 -- 172.21.15.156:0/4004937979 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac09bab0 con 0x7f1eac09f350 2023-09-30T22:24:25.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.397+0000 7f1eaaffd700 1 --2- 172.21.15.156:0/4004937979 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1eac09f350 0x7f1eac136c80 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1ea00098f0 tx=0x7f1ea0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa75c9bd8c4b0551 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:25.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.397+0000 7f1eaa7fc700 1 -- 172.21.15.156:0/4004937979 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea0011830 con 0x7f1eac09f350 2023-09-30T22:24:25.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.397+0000 7f1eaa7fc700 1 -- 172.21.15.156:0/4004937979 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea0011990 con 0x7f1eac09f350 2023-09-30T22:24:25.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.397+0000 7f1eaa7fc700 1 -- 172.21.15.156:0/4004937979 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea0011d20 con 0x7f1eac09f350 2023-09-30T22:24:25.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.397+0000 7f1eb1e1c700 1 -- 172.21.15.156:0/4004937979 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1eac09f350 msgr2=0x7f1eac136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.397+0000 7f1eb1e1c700 1 --2- 172.21.15.156:0/4004937979 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1eac09f350 0x7f1eac136c80 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1ea00098f0 tx=0x7f1ea0009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:25.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.398+0000 7f1eb1e1c700 1 -- 172.21.15.156:0/4004937979 shutdown_connections 2023-09-30T22:24:25.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.398+0000 7f1eb1e1c700 1 --2- 172.21.15.156:0/4004937979 >> v2:172.21.15.156:3300/0 conn(0x7f1eac1371c0 0x7f1eac1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.398+0000 7f1eb1e1c700 1 --2- 172.21.15.156:0/4004937979 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1eac09f350 0x7f1eac136c80 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.398+0000 7f1eb1e1c700 1 -- 172.21.15.156:0/4004937979 >> 172.21.15.156:0/4004937979 conn(0x7f1eac0a4430 msgr2=0x7f1eac0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:25.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.398+0000 7f1eb1e1c700 1 -- 172.21.15.156:0/4004937979 shutdown_connections 2023-09-30T22:24:25.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.398+0000 7f1eb1e1c700 1 -- 172.21.15.156:0/4004937979 wait complete. 2023-09-30T22:24:25.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.398+0000 7f1eb1e1c700 1 Processor -- start 2023-09-30T22:24:25.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.399+0000 7f1eb1e1c700 1 -- start start 2023-09-30T22:24:25.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.399+0000 7f1eb1e1c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1eac09e870 0x7f1eac1208e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.399+0000 7f1eb1e1c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1eac09f350 0x7f1eac120e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.399+0000 7f1eb1e1c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1eac1371c0 0x7f1eac121360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.399+0000 7f1eb1e1c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac123af0 con 0x7f1eac09e870 2023-09-30T22:24:25.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.399+0000 7f1eb1e1c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac122c60 con 0x7f1eac1371c0 2023-09-30T22:24:25.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.399+0000 7f1eb1e1c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac072250 con 0x7f1eac09f350 2023-09-30T22:24:25.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.399+0000 7f1eab7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1eac09e870 0x7f1eac1208e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.399+0000 7f1eab7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1eac09e870 0x7f1eac1208e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49682/0 (socket says 172.21.15.156:49682) 2023-09-30T22:24:25.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.399+0000 7f1eab7fe700 1 -- 172.21.15.156:0/2335168628 learned_addr learned my addr 172.21.15.156:0/2335168628 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:25.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.400+0000 7f1eabfff700 1 --2- 172.21.15.156:0/2335168628 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1eac1371c0 0x7f1eac121360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.400+0000 7f1eaaffd700 1 --2- 172.21.15.156:0/2335168628 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1eac09f350 0x7f1eac120e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.400+0000 7f1eab7fe700 1 -- 172.21.15.156:0/2335168628 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1eac09f350 msgr2=0x7f1eac120e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.400+0000 7f1eab7fe700 1 --2- 172.21.15.156:0/2335168628 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1eac09f350 0x7f1eac120e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.400+0000 7f1eab7fe700 1 -- 172.21.15.156:0/2335168628 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1eac1371c0 msgr2=0x7f1eac121360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.400+0000 7f1eab7fe700 1 --2- 172.21.15.156:0/2335168628 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1eac1371c0 0x7f1eac121360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.400+0000 7f1eab7fe700 1 -- 172.21.15.156:0/2335168628 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea0009550 con 0x7f1eac09e870 2023-09-30T22:24:25.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.400+0000 7f1eabfff700 1 --2- 172.21.15.156:0/2335168628 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1eac1371c0 0x7f1eac121360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:25.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.400+0000 7f1eab7fe700 1 --2- 172.21.15.156:0/2335168628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1eac09e870 0x7f1eac1208e0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c00c8f0 tx=0x7f1e9c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:25.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.400+0000 7f1e93fff700 1 -- 172.21.15.156:0/2335168628 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c003e30 con 0x7f1eac09e870 2023-09-30T22:24:25.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.400+0000 7f1e93fff700 1 -- 172.21.15.156:0/2335168628 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9c005070 con 0x7f1eac09e870 2023-09-30T22:24:25.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.400+0000 7f1eb1e1c700 1 -- 172.21.15.156:0/2335168628 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eac09dba0 con 0x7f1eac09e870 2023-09-30T22:24:25.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.400+0000 7f1e93fff700 1 -- 172.21.15.156:0/2335168628 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c005420 con 0x7f1eac09e870 2023-09-30T22:24:25.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.400+0000 7f1eb1e1c700 1 -- 172.21.15.156:0/2335168628 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eac124a30 con 0x7f1eac09e870 2023-09-30T22:24:25.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.401+0000 7f1e93fff700 1 -- 172.21.15.156:0/2335168628 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e9c005580 con 0x7f1eac09e870 2023-09-30T22:24:25.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.401+0000 7f1e93fff700 1 -- 172.21.15.156:0/2335168628 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1e9c03f320 con 0x7f1eac09e870 2023-09-30T22:24:25.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.401+0000 7f1eb1e1c700 1 -- 172.21.15.156:0/2335168628 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eac06ad00 con 0x7f1eac09e870 2023-09-30T22:24:25.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.406+0000 7f1e93fff700 1 -- 172.21.15.156:0/2335168628 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e9c005830 con 0x7f1eac09e870 2023-09-30T22:24:25.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.438+0000 7efce9e48700 1 Processor -- start 2023-09-30T22:24:25.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.438+0000 7efce9e48700 1 -- start start 2023-09-30T22:24:25.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.439+0000 7efce9e48700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efce40a0a70 0x7efce40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.439+0000 7efce9e48700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efce4134120 0x7efce413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.439+0000 7efce9e48700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce409dc00 con 0x7efce40a1380 2023-09-30T22:24:25.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.439+0000 7efce9e48700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce409ea90 con 0x7efce4134120 2023-09-30T22:24:25.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.439+0000 7efce9e48700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efce409dec0 con 0x7efce40a0a70 2023-09-30T22:24:25.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.439+0000 7efce3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efce4134120 0x7efce413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.439+0000 7efce3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efce4134120 0x7efce413bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:47822/0 (socket says 172.21.15.156:47822) 2023-09-30T22:24:25.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.439+0000 7efce3fff700 1 -- 172.21.15.156:0/2463130127 learned_addr learned my addr 172.21.15.156:0/2463130127 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:25.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.439+0000 7efce37fe700 1 --2- 172.21.15.156:0/2463130127 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efce40a0a70 0x7efce40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.440+0000 7efce3fff700 1 -- 172.21.15.156:0/2463130127 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efce40a0a70 msgr2=0x7efce40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:25.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.440+0000 7efce3fff700 1 --2- 172.21.15.156:0/2463130127 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efce40a0a70 0x7efce40a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.440+0000 7efce3fff700 1 -- 172.21.15.156:0/2463130127 >> v1:172.21.15.156:6789/0 conn(0x7efce40a1380 legacy=0x7efce4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.440+0000 7efce3fff700 1 -- 172.21.15.156:0/2463130127 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce409e6a0 con 0x7efce4134120 2023-09-30T22:24:25.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.440+0000 7efce27fc700 1 -- 172.21.15.156:0/2463130127 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963642639 0 0) 0x7efce409dc00 con 0x7efce40a1380 2023-09-30T22:24:25.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.440+0000 7efce3fff700 1 --2- 172.21.15.156:0/2463130127 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efce4134120 0x7efce413bce0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7efcdc009920 tx=0x7efcdc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ace09ba6e89ff07 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:25.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.440+0000 7efce27fc700 1 -- 172.21.15.156:0/2463130127 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc011830 con 0x7efce4134120 2023-09-30T22:24:25.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.440+0000 7efce27fc700 1 -- 172.21.15.156:0/2463130127 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcdc011990 con 0x7efce4134120 2023-09-30T22:24:25.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.440+0000 7efce27fc700 1 -- 172.21.15.156:0/2463130127 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc011d20 con 0x7efce4134120 2023-09-30T22:24:25.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.441+0000 7efce9e48700 1 -- 172.21.15.156:0/2463130127 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efce4134120 msgr2=0x7efce413bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.441+0000 7efce9e48700 1 --2- 172.21.15.156:0/2463130127 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efce4134120 0x7efce413bce0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7efcdc009920 tx=0x7efcdc009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:25.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.441+0000 7efce9e48700 1 -- 172.21.15.156:0/2463130127 shutdown_connections 2023-09-30T22:24:25.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.441+0000 7efce9e48700 1 --2- 172.21.15.156:0/2463130127 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efce4134120 0x7efce413bce0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.441+0000 7efce9e48700 1 --2- 172.21.15.156:0/2463130127 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efce40a0a70 0x7efce40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.441+0000 7efce9e48700 1 -- 172.21.15.156:0/2463130127 >> 172.21.15.156:0/2463130127 conn(0x7efce40a6610 msgr2=0x7efce40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:25.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.441+0000 7efce9e48700 1 -- 172.21.15.156:0/2463130127 shutdown_connections 2023-09-30T22:24:25.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.441+0000 7efce9e48700 1 -- 172.21.15.156:0/2463130127 wait complete. 2023-09-30T22:24:25.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.442+0000 7efce9e48700 1 Processor -- start 2023-09-30T22:24:25.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.443+0000 7efce9e48700 1 -- start start 2023-09-30T22:24:25.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.443+0000 7efce9e48700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efce40a0a70 0x7efce4122710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.443+0000 7efce9e48700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efce40a1380 0x7efce4122c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.443+0000 7efce9e48700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efce4134120 0x7efce4123190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.443+0000 7efce9e48700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce41262c0 con 0x7efce40a0a70 2023-09-30T22:24:25.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.443+0000 7efce9e48700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce4125930 con 0x7efce4134120 2023-09-30T22:24:25.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.443+0000 7efce9e48700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efce4124320 con 0x7efce40a1380 2023-09-30T22:24:25.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.443+0000 7efce2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efce40a1380 0x7efce4122c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.443+0000 7efce2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efce40a1380 0x7efce4122c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:58532/0 (socket says 172.21.15.156:58532) 2023-09-30T22:24:25.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.443+0000 7efce2ffd700 1 -- 172.21.15.156:0/1426089981 learned_addr learned my addr 172.21.15.156:0/1426089981 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:25.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.443+0000 7efce37fe700 1 --2- 172.21.15.156:0/1426089981 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efce40a0a70 0x7efce4122710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.444+0000 7efce3fff700 1 --2- 172.21.15.156:0/1426089981 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efce4134120 0x7efce4123190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.444+0000 7efce2ffd700 1 -- 172.21.15.156:0/1426089981 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efce4134120 msgr2=0x7efce4123190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.444+0000 7efce2ffd700 1 --2- 172.21.15.156:0/1426089981 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efce4134120 0x7efce4123190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.444+0000 7efce2ffd700 1 -- 172.21.15.156:0/1426089981 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efce40a0a70 msgr2=0x7efce4122710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.444+0000 7efce2ffd700 1 --2- 172.21.15.156:0/1426089981 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efce40a0a70 0x7efce4122710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.444+0000 7efce2ffd700 1 -- 172.21.15.156:0/1426089981 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc009550 con 0x7efce40a1380 2023-09-30T22:24:25.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.444+0000 7efce37fe700 1 --2- 172.21.15.156:0/1426089981 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efce40a0a70 0x7efce4122710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:25.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.444+0000 7efce2ffd700 1 --2- 172.21.15.156:0/1426089981 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efce40a1380 0x7efce4122c50 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7efcd800c580 tx=0x7efcd800c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:25.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.444+0000 7efccbfff700 1 -- 172.21.15.156:0/1426089981 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd80054e0 con 0x7efce40a1380 2023-09-30T22:24:25.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.444+0000 7efccbfff700 1 -- 172.21.15.156:0/1426089981 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd8003680 con 0x7efce40a1380 2023-09-30T22:24:25.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.444+0000 7efce9e48700 1 -- 172.21.15.156:0/1426089981 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce40a0440 con 0x7efce40a1380 2023-09-30T22:24:25.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.444+0000 7efccbfff700 1 -- 172.21.15.156:0/1426089981 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd8003a30 con 0x7efce40a1380 2023-09-30T22:24:25.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.444+0000 7efce9e48700 1 -- 172.21.15.156:0/1426089981 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce41339a0 con 0x7efce40a1380 2023-09-30T22:24:25.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.445+0000 7efccbfff700 1 -- 172.21.15.156:0/1426089981 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efcd8003b90 con 0x7efce40a1380 2023-09-30T22:24:25.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.445+0000 7efccbfff700 1 -- 172.21.15.156:0/1426089981 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efcd803eaa0 con 0x7efce40a1380 2023-09-30T22:24:25.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.445+0000 7efce9e48700 1 -- 172.21.15.156:0/1426089981 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce404f2a0 con 0x7efce40a1380 2023-09-30T22:24:25.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.450+0000 7efccbfff700 1 -- 172.21.15.156:0/1426089981 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efcd8017070 con 0x7efce40a1380 2023-09-30T22:24:25.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.459+0000 7f98ac06f700 1 -- 172.21.15.156:0/2649303440 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f98a41226a0 con 0x7f98a4133c20 2023-09-30T22:24:25.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.459+0000 7f989a7fc700 1 -- 172.21.15.156:0/2649303440 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f98a41226a0 con 0x7f98a4133c20 2023-09-30T22:24:25.460 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:25.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.461+0000 7f98ac06f700 1 -- 172.21.15.156:0/2649303440 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98a4133c20 msgr2=0x7f98a41c9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.461+0000 7f98ac06f700 1 --2- 172.21.15.156:0/2649303440 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98a4133c20 0x7f98a41c9190 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f989c009e50 tx=0x7f989c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.461+0000 7f98ac06f700 1 -- 172.21.15.156:0/2649303440 shutdown_connections 2023-09-30T22:24:25.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.461+0000 7f98ac06f700 1 --2- 172.21.15.156:0/2649303440 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98a4133c20 0x7f98a41c9190 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.461+0000 7f98ac06f700 1 --2- 172.21.15.156:0/2649303440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98a409a150 0x7f98a41c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.461+0000 7f98ac06f700 1 --2- 172.21.15.156:0/2649303440 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98a409edb0 0x7f98a41c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.461+0000 7f98ac06f700 1 -- 172.21.15.156:0/2649303440 >> 172.21.15.156:0/2649303440 conn(0x7f98a40a4430 msgr2=0x7f98a41b8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:25.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.461+0000 7f98ac06f700 1 -- 172.21.15.156:0/2649303440 shutdown_connections 2023-09-30T22:24:25.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.461+0000 7f98ac06f700 1 -- 172.21.15.156:0/2649303440 wait complete. 2023-09-30T22:24:25.475 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:25.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.604+0000 7f1eb1e1c700 1 -- 172.21.15.156:0/2335168628 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1eac04f2a0 con 0x7f1eac09e870 2023-09-30T22:24:25.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.604+0000 7f1e93fff700 1 -- 172.21.15.156:0/2335168628 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e9c01a360 con 0x7f1eac09e870 2023-09-30T22:24:25.605 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:25.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.606+0000 7f1eb1e1c700 1 -- 172.21.15.156:0/2335168628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1eac09e870 msgr2=0x7f1eac1208e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.606+0000 7f1eb1e1c700 1 --2- 172.21.15.156:0/2335168628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1eac09e870 0x7f1eac1208e0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c00c8f0 tx=0x7f1e9c00cc00 comp rx=0 tx=0).stop 2023-09-30T22:24:25.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.606+0000 7f1eb1e1c700 1 -- 172.21.15.156:0/2335168628 shutdown_connections 2023-09-30T22:24:25.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.606+0000 7f1eb1e1c700 1 --2- 172.21.15.156:0/2335168628 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1eac1371c0 0x7f1eac121360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.606+0000 7f1eb1e1c700 1 --2- 172.21.15.156:0/2335168628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1eac09e870 0x7f1eac1208e0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.606+0000 7f1eb1e1c700 1 --2- 172.21.15.156:0/2335168628 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1eac09f350 0x7f1eac120e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.606+0000 7f1eb1e1c700 1 -- 172.21.15.156:0/2335168628 >> 172.21.15.156:0/2335168628 conn(0x7f1eac0a4430 msgr2=0x7f1eac09c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:25.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.606+0000 7f1eb1e1c700 1 -- 172.21.15.156:0/2335168628 shutdown_connections 2023-09-30T22:24:25.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.606+0000 7f1eb1e1c700 1 -- 172.21.15.156:0/2335168628 wait complete. 2023-09-30T22:24:25.619 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:25.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.643+0000 7efce9e48700 1 -- 172.21.15.156:0/1426089981 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efce4072980 con 0x7efce40a1380 2023-09-30T22:24:25.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.643+0000 7efccbfff700 1 -- 172.21.15.156:0/1426089981 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efcd803ce60 con 0x7efce40a1380 2023-09-30T22:24:25.644 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:25.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.646+0000 7efce9e48700 1 -- 172.21.15.156:0/1426089981 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efce40a1380 msgr2=0x7efce4122c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.646+0000 7efce9e48700 1 --2- 172.21.15.156:0/1426089981 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efce40a1380 0x7efce4122c50 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7efcd800c580 tx=0x7efcd800c890 comp rx=0 tx=0).stop 2023-09-30T22:24:25.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.646+0000 7efce9e48700 1 -- 172.21.15.156:0/1426089981 shutdown_connections 2023-09-30T22:24:25.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.646+0000 7efce9e48700 1 --2- 172.21.15.156:0/1426089981 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efce4134120 0x7efce4123190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.646+0000 7efce9e48700 1 --2- 172.21.15.156:0/1426089981 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efce40a0a70 0x7efce4122710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.646+0000 7efce9e48700 1 --2- 172.21.15.156:0/1426089981 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efce40a1380 0x7efce4122c50 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.646+0000 7efce9e48700 1 -- 172.21.15.156:0/1426089981 >> 172.21.15.156:0/1426089981 conn(0x7efce40a6610 msgr2=0x7efce411c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:25.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.646+0000 7efce9e48700 1 -- 172.21.15.156:0/1426089981 shutdown_connections 2023-09-30T22:24:25.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.646+0000 7efce9e48700 1 -- 172.21.15.156:0/1426089981 wait complete. 2023-09-30T22:24:25.658 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:25.752 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:25.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.875+0000 7f7c82747700 1 Processor -- start 2023-09-30T22:24:25.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.875+0000 7f7c82747700 1 -- start start 2023-09-30T22:24:25.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.875+0000 7f7c82747700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7c7c09d860 0x7f7c7c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.875+0000 7f7c82747700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c7c09e170 0x7f7c7c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.875+0000 7f7c82747700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c7c130ce0 0x7f7c7c131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.875+0000 7f7c82747700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7c131670 con 0x7f7c7c09d860 2023-09-30T22:24:25.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.875+0000 7f7c82747700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c09aaa0 con 0x7f7c7c130ce0 2023-09-30T22:24:25.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.875+0000 7f7c82747700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c09f870 con 0x7f7c7c09e170 2023-09-30T22:24:25.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.876+0000 7f7c80ce4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c7c130ce0 0x7f7c7c131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.876+0000 7f7c7b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c7c09e170 0x7f7c7c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.876+0000 7f7c80ce4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c7c130ce0 0x7f7c7c131130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:47840/0 (socket says 172.21.15.156:47840) 2023-09-30T22:24:25.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.876+0000 7f7c7b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c7c09e170 0x7f7c7c1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:58546/0 (socket says 172.21.15.156:58546) 2023-09-30T22:24:25.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.876+0000 7f7c80ce4700 1 -- 172.21.15.156:0/2829893015 learned_addr learned my addr 172.21.15.156:0/2829893015 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:25.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.876+0000 7f7c7bfff700 1 --2- 172.21.15.156:0/2829893015 >> v2:172.21.15.156:3300/0 conn(0x7f7c7c09d860 0x7f7c7c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.876+0000 7f7c80ce4700 1 -- 172.21.15.156:0/2829893015 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c7c09e170 msgr2=0x7f7c7c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:25.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.876+0000 7f7c80ce4700 1 --2- 172.21.15.156:0/2829893015 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c7c09e170 0x7f7c7c1307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.876+0000 7f7c80ce4700 1 -- 172.21.15.156:0/2829893015 >> v2:172.21.15.156:3300/0 conn(0x7f7c7c09d860 msgr2=0x7f7c7c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:25.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.876+0000 7f7c80ce4700 1 --2- 172.21.15.156:0/2829893015 >> v2:172.21.15.156:3300/0 conn(0x7f7c7c09d860 0x7f7c7c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.876+0000 7f7c80ce4700 1 -- 172.21.15.156:0/2829893015 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7c09b360 con 0x7f7c7c130ce0 2023-09-30T22:24:25.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.876+0000 7f7c7bfff700 1 --2- 172.21.15.156:0/2829893015 >> v2:172.21.15.156:3300/0 conn(0x7f7c7c09d860 0x7f7c7c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:25.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.876+0000 7f7c80ce4700 1 --2- 172.21.15.156:0/2829893015 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c7c130ce0 0x7f7c7c131130 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7c7400d150 tx=0x7f7c7400d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3043aaa893e44303 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:25.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.876+0000 7f7c7affd700 1 -- 172.21.15.156:0/2829893015 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c74010070 con 0x7f7c7c130ce0 2023-09-30T22:24:25.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.876+0000 7f7c7affd700 1 -- 172.21.15.156:0/2829893015 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7400dd10 con 0x7f7c7c130ce0 2023-09-30T22:24:25.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.876+0000 7f7c7affd700 1 -- 172.21.15.156:0/2829893015 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7400b310 con 0x7f7c7c130ce0 2023-09-30T22:24:25.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.877+0000 7f7c82747700 1 -- 172.21.15.156:0/2829893015 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c7c130ce0 msgr2=0x7f7c7c131130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.877+0000 7f7c82747700 1 --2- 172.21.15.156:0/2829893015 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c7c130ce0 0x7f7c7c131130 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7c7400d150 tx=0x7f7c7400d460 comp rx=0 tx=0).stop 2023-09-30T22:24:25.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.877+0000 7f7c82747700 1 -- 172.21.15.156:0/2829893015 shutdown_connections 2023-09-30T22:24:25.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.877+0000 7f7c82747700 1 --2- 172.21.15.156:0/2829893015 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c7c130ce0 0x7f7c7c131130 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.877+0000 7f7c82747700 1 --2- 172.21.15.156:0/2829893015 >> v2:172.21.15.156:3300/0 conn(0x7f7c7c09d860 0x7f7c7c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.877+0000 7f7c82747700 1 --2- 172.21.15.156:0/2829893015 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c7c09e170 0x7f7c7c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.877+0000 7f7c82747700 1 -- 172.21.15.156:0/2829893015 >> 172.21.15.156:0/2829893015 conn(0x7f7c7c099c40 msgr2=0x7f7c7c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:25.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.877+0000 7f7c82747700 1 -- 172.21.15.156:0/2829893015 shutdown_connections 2023-09-30T22:24:25.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.877+0000 7f7c82747700 1 -- 172.21.15.156:0/2829893015 wait complete. 2023-09-30T22:24:25.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.878+0000 7f7c82747700 1 Processor -- start 2023-09-30T22:24:25.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.878+0000 7f7c82747700 1 -- start start 2023-09-30T22:24:25.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.879+0000 7f7c82747700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c7c09d860 0x7f7c7c11cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.879+0000 7f7c82747700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c7c09e170 0x7f7c7c11d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.879+0000 7f7c82747700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c7c130ce0 0x7f7c7c11d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.879+0000 7f7c82747700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c121400 con 0x7f7c7c09d860 2023-09-30T22:24:25.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.879+0000 7f7c82747700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c11eb30 con 0x7f7c7c130ce0 2023-09-30T22:24:25.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.879+0000 7f7c82747700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c11f150 con 0x7f7c7c09e170 2023-09-30T22:24:25.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.879+0000 7f7c7b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c7c09e170 0x7f7c7c11d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.879+0000 7f7c80ce4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c7c130ce0 0x7f7c7c11d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.879+0000 7f7c7b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c7c09e170 0x7f7c7c11d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:58560/0 (socket says 172.21.15.156:58560) 2023-09-30T22:24:25.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.879+0000 7f7c7b7fe700 1 -- 172.21.15.156:0/3909484919 learned_addr learned my addr 172.21.15.156:0/3909484919 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:25.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.879+0000 7f7c80ce4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c7c130ce0 0x7f7c7c11d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:47852/0 (socket says 172.21.15.156:47852) 2023-09-30T22:24:25.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.879+0000 7f7c7bfff700 1 --2- 172.21.15.156:0/3909484919 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c7c09d860 0x7f7c7c11cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.879+0000 7f7c80ce4700 1 -- 172.21.15.156:0/3909484919 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c7c09e170 msgr2=0x7f7c7c11d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.879+0000 7f7c80ce4700 1 --2- 172.21.15.156:0/3909484919 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c7c09e170 0x7f7c7c11d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.879+0000 7f7c80ce4700 1 -- 172.21.15.156:0/3909484919 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c7c09d860 msgr2=0x7f7c7c11cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.879+0000 7f7c80ce4700 1 --2- 172.21.15.156:0/3909484919 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c7c09d860 0x7f7c7c11cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.879+0000 7f7c80ce4700 1 -- 172.21.15.156:0/3909484919 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c700094a0 con 0x7f7c7c130ce0 2023-09-30T22:24:25.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.879+0000 7f7c80ce4700 1 --2- 172.21.15.156:0/3909484919 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c7c130ce0 0x7f7c7c11d9f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f7c74014000 tx=0x7f7c74004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:25.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.879+0000 7f7c78ff9700 1 -- 172.21.15.156:0/3909484919 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c74009800 con 0x7f7c7c130ce0 2023-09-30T22:24:25.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.880+0000 7f7c78ff9700 1 -- 172.21.15.156:0/3909484919 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c74009960 con 0x7f7c7c130ce0 2023-09-30T22:24:25.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.880+0000 7f7c82747700 1 -- 172.21.15.156:0/3909484919 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c7400bd40 con 0x7f7c7c130ce0 2023-09-30T22:24:25.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.880+0000 7f7c78ff9700 1 -- 172.21.15.156:0/3909484919 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c74009cf0 con 0x7f7c7c130ce0 2023-09-30T22:24:25.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.880+0000 7f7c82747700 1 -- 172.21.15.156:0/3909484919 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7c0a2190 con 0x7f7c7c130ce0 2023-09-30T22:24:25.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.880+0000 7f7c78ff9700 1 -- 172.21.15.156:0/3909484919 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c74004040 con 0x7f7c7c130ce0 2023-09-30T22:24:25.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.880+0000 7f7c82747700 1 -- 172.21.15.156:0/3909484919 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7c04f2a0 con 0x7f7c7c130ce0 2023-09-30T22:24:25.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.880+0000 7f7c78ff9700 1 -- 172.21.15.156:0/3909484919 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7c74040e80 con 0x7f7c7c130ce0 2023-09-30T22:24:25.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:25.885+0000 7f7c78ff9700 1 -- 172.21.15.156:0/3909484919 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c740042f0 con 0x7f7c7c130ce0 2023-09-30T22:24:26.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.069+0000 7f7c82747700 1 -- 172.21.15.156:0/3909484919 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7c7c06c3b0 con 0x7f7c7c130ce0 2023-09-30T22:24:26.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.070+0000 7f7c78ff9700 1 -- 172.21.15.156:0/3909484919 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c74015e80 con 0x7f7c7c130ce0 2023-09-30T22:24:26.071 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:26.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.071+0000 7f7c82747700 1 -- 172.21.15.156:0/3909484919 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c7c130ce0 msgr2=0x7f7c7c11d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.071+0000 7f7c82747700 1 --2- 172.21.15.156:0/3909484919 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c7c130ce0 0x7f7c7c11d9f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f7c74014000 tx=0x7f7c74004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.072+0000 7f7c82747700 1 -- 172.21.15.156:0/3909484919 shutdown_connections 2023-09-30T22:24:26.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.072+0000 7f7c82747700 1 --2- 172.21.15.156:0/3909484919 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c7c130ce0 0x7f7c7c11d9f0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.072+0000 7f7c82747700 1 --2- 172.21.15.156:0/3909484919 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c7c09d860 0x7f7c7c11cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.072+0000 7f7c82747700 1 --2- 172.21.15.156:0/3909484919 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c7c09e170 0x7f7c7c11d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.072+0000 7f7c82747700 1 -- 172.21.15.156:0/3909484919 >> 172.21.15.156:0/3909484919 conn(0x7f7c7c099c40 msgr2=0x7f7c7c130010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:26.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.072+0000 7f7c82747700 1 -- 172.21.15.156:0/3909484919 shutdown_connections 2023-09-30T22:24:26.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.072+0000 7f7c82747700 1 -- 172.21.15.156:0/3909484919 wait complete. 2023-09-30T22:24:26.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:26.476 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:26.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.601+0000 7f888e796700 1 Processor -- start 2023-09-30T22:24:26.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.601+0000 7f888e796700 1 -- start start 2023-09-30T22:24:26.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.602+0000 7f888e796700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f888809f350 0x7f8888138f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.602+0000 7f888e796700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8888139480 0x7f888813b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.602+0000 7f888e796700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f888806bec0 con 0x7f888809e870 2023-09-30T22:24:26.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.602+0000 7f888e796700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f888806ce60 con 0x7f888809f350 2023-09-30T22:24:26.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.602+0000 7f888e796700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f888809fa00 con 0x7f8888139480 2023-09-30T22:24:26.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.602+0000 7f888cd33700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8888139480 0x7f888813b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.602+0000 7f8887fff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f888809e870 0x7f888809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:57708/0 (socket says 172.21.15.156:57708) 2023-09-30T22:24:26.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.602+0000 7f888cd33700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8888139480 0x7f888813b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:58562/0 (socket says 172.21.15.156:58562) 2023-09-30T22:24:26.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.602+0000 7f88877fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f888809f350 0x7f8888138f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.602+0000 7f8887fff700 1 -- 172.21.15.156:0/2344483172 learned_addr learned my addr 172.21.15.156:0/2344483172 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:26.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.602+0000 7f888cd33700 1 -- 172.21.15.156:0/2344483172 >> v2:172.21.15.156:3300/0 conn(0x7f888809f350 msgr2=0x7f8888138f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:26.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.602+0000 7f888cd33700 1 --2- 172.21.15.156:0/2344483172 >> v2:172.21.15.156:3300/0 conn(0x7f888809f350 0x7f8888138f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.602+0000 7f888cd33700 1 -- 172.21.15.156:0/2344483172 >> v1:172.21.15.156:6789/0 conn(0x7f888809e870 legacy=0x7f888809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.602+0000 7f888cd33700 1 -- 172.21.15.156:0/2344483172 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888809ad80 con 0x7f8888139480 2023-09-30T22:24:26.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.602+0000 7f8886ffd700 1 -- 172.21.15.156:0/2344483172 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1885249562 0 0) 0x7f888806bec0 con 0x7f888809e870 2023-09-30T22:24:26.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.602+0000 7f88877fe700 1 --2- 172.21.15.156:0/2344483172 >> v2:172.21.15.156:3300/0 conn(0x7f888809f350 0x7f8888138f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:26.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.602+0000 7f888cd33700 1 --2- 172.21.15.156:0/2344483172 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8888139480 0x7f888813b860 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8880009d90 tx=0x7f888000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2616bee526430790 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:26.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.602+0000 7f8886ffd700 1 -- 172.21.15.156:0/2344483172 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888000e070 con 0x7f8888139480 2023-09-30T22:24:26.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.602+0000 7f8886ffd700 1 -- 172.21.15.156:0/2344483172 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888000bb20 con 0x7f8888139480 2023-09-30T22:24:26.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.602+0000 7f8886ffd700 1 -- 172.21.15.156:0/2344483172 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8880012430 con 0x7f8888139480 2023-09-30T22:24:26.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.603+0000 7f888e796700 1 -- 172.21.15.156:0/2344483172 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8888139480 msgr2=0x7f888813b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.603+0000 7f888e796700 1 --2- 172.21.15.156:0/2344483172 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8888139480 0x7f888813b860 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8880009d90 tx=0x7f888000b330 comp rx=0 tx=0).stop 2023-09-30T22:24:26.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.603+0000 7f888e796700 1 -- 172.21.15.156:0/2344483172 shutdown_connections 2023-09-30T22:24:26.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.603+0000 7f888e796700 1 --2- 172.21.15.156:0/2344483172 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8888139480 0x7f888813b860 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.603+0000 7f888e796700 1 --2- 172.21.15.156:0/2344483172 >> v2:172.21.15.156:3300/0 conn(0x7f888809f350 0x7f8888138f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.603+0000 7f888e796700 1 -- 172.21.15.156:0/2344483172 >> 172.21.15.156:0/2344483172 conn(0x7f88880a4430 msgr2=0x7f88880a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:26.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.603+0000 7f888e796700 1 -- 172.21.15.156:0/2344483172 shutdown_connections 2023-09-30T22:24:26.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.603+0000 7f888e796700 1 -- 172.21.15.156:0/2344483172 wait complete. 2023-09-30T22:24:26.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.604+0000 7f888e796700 1 Processor -- start 2023-09-30T22:24:26.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.604+0000 7f888e796700 1 -- start start 2023-09-30T22:24:26.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.605+0000 7f888e796700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f888809e870 0x7f88881208a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.605+0000 7f888e796700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f888809f350 0x7f8888120de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.605+0000 7f888e796700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8888139480 0x7f8888121320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.605+0000 7f888e796700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88881224b0 con 0x7f888809e870 2023-09-30T22:24:26.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.605+0000 7f888e796700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8888122ad0 con 0x7f888809f350 2023-09-30T22:24:26.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.605+0000 7f888e796700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f888806d010 con 0x7f8888139480 2023-09-30T22:24:26.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.605+0000 7f8887fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f888809e870 0x7f88881208a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.605+0000 7f8887fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f888809e870 0x7f88881208a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49722/0 (socket says 172.21.15.156:49722) 2023-09-30T22:24:26.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.605+0000 7f88877fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f888809f350 0x7f8888120de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.605+0000 7f8887fff700 1 -- 172.21.15.156:0/2252029305 learned_addr learned my addr 172.21.15.156:0/2252029305 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:26.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.605+0000 7f888cd33700 1 --2- 172.21.15.156:0/2252029305 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8888139480 0x7f8888121320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.605+0000 7f8887fff700 1 -- 172.21.15.156:0/2252029305 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8888139480 msgr2=0x7f8888121320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.605+0000 7f8887fff700 1 --2- 172.21.15.156:0/2252029305 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8888139480 0x7f8888121320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.605+0000 7f8887fff700 1 -- 172.21.15.156:0/2252029305 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f888809f350 msgr2=0x7f8888120de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.605+0000 7f8887fff700 1 --2- 172.21.15.156:0/2252029305 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f888809f350 0x7f8888120de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.605+0000 7f8887fff700 1 -- 172.21.15.156:0/2252029305 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88780094a0 con 0x7f888809e870 2023-09-30T22:24:26.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.605+0000 7f88877fe700 1 --2- 172.21.15.156:0/2252029305 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f888809f350 0x7f8888120de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:26.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.605+0000 7f888cd33700 1 --2- 172.21.15.156:0/2252029305 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8888139480 0x7f8888121320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:26.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.606+0000 7f8887fff700 1 --2- 172.21.15.156:0/2252029305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f888809e870 0x7f88881208a0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f887000c550 tx=0x7f887000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:26.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.606+0000 7f8884ff9700 1 -- 172.21.15.156:0/2252029305 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8870004c80 con 0x7f888809e870 2023-09-30T22:24:26.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.606+0000 7f8884ff9700 1 -- 172.21.15.156:0/2252029305 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8870004e00 con 0x7f888809e870 2023-09-30T22:24:26.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.606+0000 7f8884ff9700 1 -- 172.21.15.156:0/2252029305 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8870007310 con 0x7f888809e870 2023-09-30T22:24:26.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.606+0000 7f888e796700 1 -- 172.21.15.156:0/2252029305 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8880009a70 con 0x7f888809e870 2023-09-30T22:24:26.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.606+0000 7f888e796700 1 -- 172.21.15.156:0/2252029305 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8888124130 con 0x7f888809e870 2023-09-30T22:24:26.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.606+0000 7f8884ff9700 1 -- 172.21.15.156:0/2252029305 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8870007470 con 0x7f888809e870 2023-09-30T22:24:26.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.607+0000 7f8884ff9700 1 -- 172.21.15.156:0/2252029305 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f887003f150 con 0x7f888809e870 2023-09-30T22:24:26.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.607+0000 7f888e796700 1 -- 172.21.15.156:0/2252029305 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8888136790 con 0x7f888809e870 2023-09-30T22:24:26.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.611+0000 7f8884ff9700 1 -- 172.21.15.156:0/2252029305 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f88700102c0 con 0x7f888809e870 2023-09-30T22:24:26.620 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:26.659 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:26.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.746+0000 7f363bdee700 1 Processor -- start 2023-09-30T22:24:26.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.746+0000 7f363bdee700 1 -- start start 2023-09-30T22:24:26.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.747+0000 7f363bdee700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f36341368e0 0x7f3634138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.747+0000 7f363bdee700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3634139200 0x7f363413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.747+0000 7f363bdee700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f363409a760 con 0x7f3634133900 2023-09-30T22:24:26.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.747+0000 7f363bdee700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36341336e0 con 0x7f36341368e0 2023-09-30T22:24:26.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.747+0000 7f363bdee700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f363409a080 con 0x7f3634139200 2023-09-30T22:24:26.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.747+0000 7f363a38b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3634139200 0x7f363413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.747+0000 7f3639389700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f36341368e0 0x7f3634138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.747+0000 7f3639b8a700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f3634133900 0x7f3634133cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:57718/0 (socket says 172.21.15.156:57718) 2023-09-30T22:24:26.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.747+0000 7f3639b8a700 1 -- 172.21.15.156:0/1021301005 learned_addr learned my addr 172.21.15.156:0/1021301005 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:26.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.747+0000 7f3639389700 1 -- 172.21.15.156:0/1021301005 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3634139200 msgr2=0x7f363413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:26.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.747+0000 7f3639389700 1 --2- 172.21.15.156:0/1021301005 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3634139200 0x7f363413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.747+0000 7f3639389700 1 -- 172.21.15.156:0/1021301005 >> v1:172.21.15.156:6789/0 conn(0x7f3634133900 legacy=0x7f3634133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.747+0000 7f3639389700 1 -- 172.21.15.156:0/1021301005 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36340a23e0 con 0x7f36341368e0 2023-09-30T22:24:26.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.747+0000 7f363a38b700 1 --2- 172.21.15.156:0/1021301005 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3634139200 0x7f363413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:26.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.747+0000 7f3639389700 1 --2- 172.21.15.156:0/1021301005 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36341368e0 0x7f3634138cc0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f3624009840 tx=0x7f3624009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a9d9c4018b083d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:26.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.748+0000 7f3638b88700 1 -- 172.21.15.156:0/1021301005 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624011830 con 0x7f36341368e0 2023-09-30T22:24:26.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.748+0000 7f3638b88700 1 -- 172.21.15.156:0/1021301005 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3624011990 con 0x7f36341368e0 2023-09-30T22:24:26.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.748+0000 7f3638b88700 1 -- 172.21.15.156:0/1021301005 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624011d20 con 0x7f36341368e0 2023-09-30T22:24:26.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.748+0000 7f363bdee700 1 -- 172.21.15.156:0/1021301005 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36341368e0 msgr2=0x7f3634138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.748+0000 7f363bdee700 1 --2- 172.21.15.156:0/1021301005 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36341368e0 0x7f3634138cc0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f3624009840 tx=0x7f3624009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:26.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.748+0000 7f363bdee700 1 -- 172.21.15.156:0/1021301005 shutdown_connections 2023-09-30T22:24:26.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.748+0000 7f363bdee700 1 --2- 172.21.15.156:0/1021301005 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3634139200 0x7f363413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.748+0000 7f363bdee700 1 --2- 172.21.15.156:0/1021301005 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36341368e0 0x7f3634138cc0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.748+0000 7f363bdee700 1 -- 172.21.15.156:0/1021301005 >> 172.21.15.156:0/1021301005 conn(0x7f36340a2980 msgr2=0x7f36340a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:26.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.748+0000 7f363bdee700 1 -- 172.21.15.156:0/1021301005 shutdown_connections 2023-09-30T22:24:26.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.748+0000 7f363bdee700 1 -- 172.21.15.156:0/1021301005 wait complete. 2023-09-30T22:24:26.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.749+0000 7f363bdee700 1 Processor -- start 2023-09-30T22:24:26.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.749+0000 7f363bdee700 1 -- start start 2023-09-30T22:24:26.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.750+0000 7f363bdee700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3634133900 0x7f36341c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.750+0000 7f363bdee700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f36341368e0 0x7f36341c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.750+0000 7f363bdee700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3634139200 0x7f3634119d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.750+0000 7f363bdee700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363411bac0 con 0x7f3634139200 2023-09-30T22:24:26.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.750+0000 7f363bdee700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f363411b1e0 con 0x7f36341368e0 2023-09-30T22:24:26.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.750+0000 7f363bdee700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f363411b8d0 con 0x7f3634133900 2023-09-30T22:24:26.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.750+0000 7f3639b8a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3634133900 0x7f36341c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.750+0000 7f3639b8a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3634133900 0x7f36341c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:58592/0 (socket says 172.21.15.156:58592) 2023-09-30T22:24:26.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.750+0000 7f3639b8a700 1 -- 172.21.15.156:0/875108847 learned_addr learned my addr 172.21.15.156:0/875108847 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:26.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.750+0000 7f363a38b700 1 --2- 172.21.15.156:0/875108847 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3634139200 0x7f3634119d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.750+0000 7f3639389700 1 --2- 172.21.15.156:0/875108847 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f36341368e0 0x7f36341c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.750+0000 7f3639b8a700 1 -- 172.21.15.156:0/875108847 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f36341368e0 msgr2=0x7f36341c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.750+0000 7f3639b8a700 1 --2- 172.21.15.156:0/875108847 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f36341368e0 0x7f36341c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.750+0000 7f3639b8a700 1 -- 172.21.15.156:0/875108847 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3634139200 msgr2=0x7f3634119d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.750+0000 7f3639b8a700 1 --2- 172.21.15.156:0/875108847 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3634139200 0x7f3634119d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.750+0000 7f3639b8a700 1 -- 172.21.15.156:0/875108847 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362c009a70 con 0x7f3634133900 2023-09-30T22:24:26.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.750+0000 7f363a38b700 1 --2- 172.21.15.156:0/875108847 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3634139200 0x7f3634119d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:26.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.750+0000 7f3639b8a700 1 --2- 172.21.15.156:0/875108847 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3634133900 0x7f36341c84f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f363000c730 tx=0x7f363000ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:26.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.750+0000 7f362a7fc700 1 -- 172.21.15.156:0/875108847 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36300074e0 con 0x7f3634133900 2023-09-30T22:24:26.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.751+0000 7f362a7fc700 1 -- 172.21.15.156:0/875108847 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3630007640 con 0x7f3634133900 2023-09-30T22:24:26.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.751+0000 7f363bdee700 1 -- 172.21.15.156:0/875108847 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36240094a0 con 0x7f3634133900 2023-09-30T22:24:26.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.751+0000 7f362a7fc700 1 -- 172.21.15.156:0/875108847 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3630005a30 con 0x7f3634133900 2023-09-30T22:24:26.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.751+0000 7f363bdee700 1 -- 172.21.15.156:0/875108847 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f363409a2c0 con 0x7f3634133900 2023-09-30T22:24:26.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.752+0000 7f362a7fc700 1 -- 172.21.15.156:0/875108847 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3630005b90 con 0x7f3634133900 2023-09-30T22:24:26.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.752+0000 7f363bdee700 1 -- 172.21.15.156:0/875108847 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f363411d170 con 0x7f3634133900 2023-09-30T22:24:26.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.752+0000 7f362a7fc700 1 -- 172.21.15.156:0/875108847 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f363003ea30 con 0x7f3634133900 2023-09-30T22:24:26.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.756+0000 7f362a7fc700 1 -- 172.21.15.156:0/875108847 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f363001b3b0 con 0x7f3634133900 2023-09-30T22:24:26.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.789+0000 7fb0a54a7700 1 Processor -- start 2023-09-30T22:24:26.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.789+0000 7fb0a54a7700 1 -- start start 2023-09-30T22:24:26.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.789+0000 7fb0a54a7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0a0099a60 0x7fb0a01388f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.789+0000 7fb0a54a7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0a0138e30 0x7fb0a013b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.789+0000 7fb0a54a7700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a009aa00 con 0x7fb0a0133b80 2023-09-30T22:24:26.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.789+0000 7fb0a54a7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a009a080 con 0x7fb0a0138e30 2023-09-30T22:24:26.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.789+0000 7fb0a54a7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a0133750 con 0x7fb0a0099a60 2023-09-30T22:24:26.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.789+0000 7fb09effd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb0a0133b80 0x7fb0a0133f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:57730/0 (socket says 172.21.15.156:57730) 2023-09-30T22:24:26.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.789+0000 7fb09e7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0a0099a60 0x7fb0a01388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.789+0000 7fb09effd700 1 -- 172.21.15.156:0/3288418001 learned_addr learned my addr 172.21.15.156:0/3288418001 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:26.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.789+0000 7fb09f7fe700 1 --2- 172.21.15.156:0/3288418001 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0a0138e30 0x7fb0a013b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.790+0000 7fb09e7fc700 1 -- 172.21.15.156:0/3288418001 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0a0138e30 msgr2=0x7fb0a013b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:26.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.790+0000 7fb09e7fc700 1 --2- 172.21.15.156:0/3288418001 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0a0138e30 0x7fb0a013b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.790+0000 7fb09e7fc700 1 -- 172.21.15.156:0/3288418001 >> v1:172.21.15.156:6789/0 conn(0x7fb0a0133b80 legacy=0x7fb0a0133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.790+0000 7fb09dffb700 1 -- 172.21.15.156:0/3288418001 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651346393 0 0) 0x7fb0a009aa00 con 0x7fb0a0133b80 2023-09-30T22:24:26.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.790+0000 7fb09e7fc700 1 -- 172.21.15.156:0/3288418001 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a009a760 con 0x7fb0a0099a60 2023-09-30T22:24:26.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.790+0000 7fb09e7fc700 1 --2- 172.21.15.156:0/3288418001 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0a0099a60 0x7fb0a01388f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fb094009870 tx=0x7fb094009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e235fbe783860197 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:26.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.790+0000 7fb09dffb700 1 -- 172.21.15.156:0/3288418001 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb094011830 con 0x7fb0a0099a60 2023-09-30T22:24:26.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.790+0000 7fb09dffb700 1 -- 172.21.15.156:0/3288418001 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb094011990 con 0x7fb0a0099a60 2023-09-30T22:24:26.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.790+0000 7fb09dffb700 1 -- 172.21.15.156:0/3288418001 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb094011d20 con 0x7fb0a0099a60 2023-09-30T22:24:26.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.791+0000 7fb0a54a7700 1 -- 172.21.15.156:0/3288418001 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0a0099a60 msgr2=0x7fb0a01388f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.791+0000 7fb0a54a7700 1 --2- 172.21.15.156:0/3288418001 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0a0099a60 0x7fb0a01388f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fb094009870 tx=0x7fb094009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:26.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.791+0000 7fb0a54a7700 1 -- 172.21.15.156:0/3288418001 shutdown_connections 2023-09-30T22:24:26.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.791+0000 7fb0a54a7700 1 --2- 172.21.15.156:0/3288418001 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0a0138e30 0x7fb0a013b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.791+0000 7fb0a54a7700 1 --2- 172.21.15.156:0/3288418001 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0a0099a60 0x7fb0a01388f0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.791+0000 7fb0a54a7700 1 -- 172.21.15.156:0/3288418001 >> 172.21.15.156:0/3288418001 conn(0x7fb0a00a2980 msgr2=0x7fb0a00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:26.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.791+0000 7fb0a54a7700 1 -- 172.21.15.156:0/3288418001 shutdown_connections 2023-09-30T22:24:26.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.791+0000 7fb0a54a7700 1 -- 172.21.15.156:0/3288418001 wait complete. 2023-09-30T22:24:26.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.793+0000 7fb0a54a7700 1 Processor -- start 2023-09-30T22:24:26.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.793+0000 7fb0a54a7700 1 -- start start 2023-09-30T22:24:26.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.793+0000 7fb0a54a7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0a0099a60 0x7fb0a0118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.793+0000 7fb0a54a7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0a0133b80 0x7fb0a0119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.793+0000 7fb0a54a7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0a0138e30 0x7fb0a0119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.793+0000 7fb0a54a7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a011bca0 con 0x7fb0a0138e30 2023-09-30T22:24:26.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.793+0000 7fb0a54a7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a01324e0 con 0x7fb0a0099a60 2023-09-30T22:24:26.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.793+0000 7fb0a54a7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a009a2c0 con 0x7fb0a0133b80 2023-09-30T22:24:26.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.793+0000 7fb09e7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0a0133b80 0x7fb0a0119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.793+0000 7fb09f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0a0138e30 0x7fb0a0119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.793+0000 7fb09e7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0a0133b80 0x7fb0a0119330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:58612/0 (socket says 172.21.15.156:58612) 2023-09-30T22:24:26.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.793+0000 7fb09e7fc700 1 -- 172.21.15.156:0/1864691926 learned_addr learned my addr 172.21.15.156:0/1864691926 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:26.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.793+0000 7fb09effd700 1 --2- 172.21.15.156:0/1864691926 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0a0099a60 0x7fb0a0118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.794+0000 7fb09f7fe700 1 -- 172.21.15.156:0/1864691926 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0a0133b80 msgr2=0x7fb0a0119330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.794+0000 7fb09f7fe700 1 --2- 172.21.15.156:0/1864691926 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0a0133b80 0x7fb0a0119330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.794+0000 7fb09f7fe700 1 -- 172.21.15.156:0/1864691926 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0a0099a60 msgr2=0x7fb0a0118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.794+0000 7fb09f7fe700 1 --2- 172.21.15.156:0/1864691926 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0a0099a60 0x7fb0a0118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.794+0000 7fb09f7fe700 1 -- 172.21.15.156:0/1864691926 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0940094a0 con 0x7fb0a0138e30 2023-09-30T22:24:26.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.794+0000 7fb09f7fe700 1 --2- 172.21.15.156:0/1864691926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0a0138e30 0x7fb0a0119870 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fb0a006d880 tx=0x7fb09800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:26.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.794+0000 7fb0877fe700 1 -- 172.21.15.156:0/1864691926 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09800cc20 con 0x7fb0a0138e30 2023-09-30T22:24:26.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.794+0000 7fb0877fe700 1 -- 172.21.15.156:0/1864691926 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09800f040 con 0x7fb0a0138e30 2023-09-30T22:24:26.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.794+0000 7fb0a54a7700 1 -- 172.21.15.156:0/1864691926 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a0130e30 con 0x7fb0a0138e30 2023-09-30T22:24:26.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.794+0000 7fb0877fe700 1 -- 172.21.15.156:0/1864691926 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb098009e60 con 0x7fb0a0138e30 2023-09-30T22:24:26.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.794+0000 7fb0a54a7700 1 -- 172.21.15.156:0/1864691926 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a011ca10 con 0x7fb0a0138e30 2023-09-30T22:24:26.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.795+0000 7fb0877fe700 1 -- 172.21.15.156:0/1864691926 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb098014480 con 0x7fb0a0138e30 2023-09-30T22:24:26.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.795+0000 7fb0877fe700 1 -- 172.21.15.156:0/1864691926 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb0980401d0 con 0x7fb0a0138e30 2023-09-30T22:24:26.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.795+0000 7fb0a54a7700 1 -- 172.21.15.156:0/1864691926 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a011c5a0 con 0x7fb0a0138e30 2023-09-30T22:24:26.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.800+0000 7fb0877fe700 1 -- 172.21.15.156:0/1864691926 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb0980076f0 con 0x7fb0a0138e30 2023-09-30T22:24:26.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.812+0000 7f888e796700 1 -- 172.21.15.156:0/2252029305 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8888123f40 con 0x7f888809e870 2023-09-30T22:24:26.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.812+0000 7f8884ff9700 1 -- 172.21.15.156:0/2252029305 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8888123f40 con 0x7f888809e870 2023-09-30T22:24:26.813 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:26.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.814+0000 7f888e796700 1 -- 172.21.15.156:0/2252029305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f888809e870 msgr2=0x7f88881208a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.814+0000 7f888e796700 1 --2- 172.21.15.156:0/2252029305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f888809e870 0x7f88881208a0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f887000c550 tx=0x7f887000c860 comp rx=0 tx=0).stop 2023-09-30T22:24:26.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.814+0000 7f888e796700 1 -- 172.21.15.156:0/2252029305 shutdown_connections 2023-09-30T22:24:26.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.814+0000 7f888e796700 1 --2- 172.21.15.156:0/2252029305 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8888139480 0x7f8888121320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.814+0000 7f888e796700 1 --2- 172.21.15.156:0/2252029305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f888809e870 0x7f88881208a0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.814+0000 7f888e796700 1 --2- 172.21.15.156:0/2252029305 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f888809f350 0x7f8888120de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.814+0000 7f888e796700 1 -- 172.21.15.156:0/2252029305 >> 172.21.15.156:0/2252029305 conn(0x7f88880a4430 msgr2=0x7f8888136d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:26.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.815+0000 7f888e796700 1 -- 172.21.15.156:0/2252029305 shutdown_connections 2023-09-30T22:24:26.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.815+0000 7f888e796700 1 -- 172.21.15.156:0/2252029305 wait complete. 2023-09-30T22:24:26.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:26.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.953+0000 7f363bdee700 1 -- 172.21.15.156:0/875108847 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f363404f2a0 con 0x7f3634133900 2023-09-30T22:24:26.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.953+0000 7f362a7fc700 1 -- 172.21.15.156:0/875108847 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3630017030 con 0x7f3634133900 2023-09-30T22:24:26.954 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:26.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.955+0000 7f363bdee700 1 -- 172.21.15.156:0/875108847 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3634133900 msgr2=0x7f36341c84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.955+0000 7f363bdee700 1 --2- 172.21.15.156:0/875108847 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3634133900 0x7f36341c84f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f363000c730 tx=0x7f363000ca40 comp rx=0 tx=0).stop 2023-09-30T22:24:26.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.955+0000 7f363bdee700 1 -- 172.21.15.156:0/875108847 shutdown_connections 2023-09-30T22:24:26.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.955+0000 7f363bdee700 1 --2- 172.21.15.156:0/875108847 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3634139200 0x7f3634119d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.955+0000 7f363bdee700 1 --2- 172.21.15.156:0/875108847 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3634133900 0x7f36341c84f0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.955+0000 7f363bdee700 1 --2- 172.21.15.156:0/875108847 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f36341368e0 0x7f36341c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.955+0000 7f363bdee700 1 -- 172.21.15.156:0/875108847 >> 172.21.15.156:0/875108847 conn(0x7f36340a2980 msgr2=0x7f3634135db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:26.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.955+0000 7f363bdee700 1 -- 172.21.15.156:0/875108847 shutdown_connections 2023-09-30T22:24:26.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.955+0000 7f363bdee700 1 -- 172.21.15.156:0/875108847 wait complete. 2023-09-30T22:24:26.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:26.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.993+0000 7fb0a54a7700 1 -- 172.21.15.156:0/1864691926 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb0a004f2a0 con 0x7fb0a0138e30 2023-09-30T22:24:26.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.993+0000 7fb0877fe700 1 -- 172.21.15.156:0/1864691926 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb09802a030 con 0x7fb0a0138e30 2023-09-30T22:24:26.994 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:26.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.995+0000 7fb0a54a7700 1 -- 172.21.15.156:0/1864691926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0a0138e30 msgr2=0x7fb0a0119870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.995+0000 7fb0a54a7700 1 --2- 172.21.15.156:0/1864691926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0a0138e30 0x7fb0a0119870 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fb0a006d880 tx=0x7fb09800ef90 comp rx=0 tx=0).stop 2023-09-30T22:24:26.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.995+0000 7fb0a54a7700 1 -- 172.21.15.156:0/1864691926 shutdown_connections 2023-09-30T22:24:26.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.995+0000 7fb0a54a7700 1 --2- 172.21.15.156:0/1864691926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb0a0138e30 0x7fb0a0119870 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.995+0000 7fb0a54a7700 1 --2- 172.21.15.156:0/1864691926 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb0a0099a60 0x7fb0a0118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.995+0000 7fb0a54a7700 1 --2- 172.21.15.156:0/1864691926 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb0a0133b80 0x7fb0a0119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.995+0000 7fb0a54a7700 1 -- 172.21.15.156:0/1864691926 >> 172.21.15.156:0/1864691926 conn(0x7fb0a00a2980 msgr2=0x7fb0a009f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:26.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.995+0000 7fb0a54a7700 1 -- 172.21.15.156:0/1864691926 shutdown_connections 2023-09-30T22:24:26.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:26.995+0000 7fb0a54a7700 1 -- 172.21.15.156:0/1864691926 wait complete. 2023-09-30T22:24:27.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:27.085 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:27.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.207+0000 7f7755fbb700 1 Processor -- start 2023-09-30T22:24:27.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.207+0000 7f7755fbb700 1 -- start start 2023-09-30T22:24:27.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.208+0000 7f7755fbb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f775009e870 0x7f775009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.208+0000 7f7755fbb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f775009f180 0x7f7750133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.208+0000 7f7755fbb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77501341d0 0x7f7750134650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.208+0000 7f7755fbb700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f775006ce60 con 0x7f775009e870 2023-09-30T22:24:27.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.208+0000 7f7755fbb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f775006bec0 con 0x7f77501341d0 2023-09-30T22:24:27.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.208+0000 7f7755fbb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f775009fa00 con 0x7f775009f180 2023-09-30T22:24:27.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.208+0000 7f774effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f775009f180 0x7f7750133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.208+0000 7f774f7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f775009e870 0x7f775009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.208+0000 7f774f7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f775009e870 0x7f775009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49746/0 (socket says 172.21.15.156:49746) 2023-09-30T22:24:27.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.208+0000 7f774effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f775009f180 0x7f7750133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:58616/0 (socket says 172.21.15.156:58616) 2023-09-30T22:24:27.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.208+0000 7f774f7fe700 1 -- 172.21.15.156:0/1673922682 learned_addr learned my addr 172.21.15.156:0/1673922682 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:27.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.208+0000 7f774ffff700 1 --2- 172.21.15.156:0/1673922682 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77501341d0 0x7f7750134650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.208+0000 7f774effd700 1 -- 172.21.15.156:0/1673922682 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77501341d0 msgr2=0x7f7750134650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:27.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.208+0000 7f774effd700 1 --2- 172.21.15.156:0/1673922682 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77501341d0 0x7f7750134650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.208+0000 7f774effd700 1 -- 172.21.15.156:0/1673922682 >> v2:172.21.15.156:3300/0 conn(0x7f775009e870 msgr2=0x7f775009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:27.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.208+0000 7f774effd700 1 --2- 172.21.15.156:0/1673922682 >> v2:172.21.15.156:3300/0 conn(0x7f775009e870 0x7f775009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.208+0000 7f774effd700 1 -- 172.21.15.156:0/1673922682 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f775009ad80 con 0x7f775009f180 2023-09-30T22:24:27.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.208+0000 7f774ffff700 1 --2- 172.21.15.156:0/1673922682 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77501341d0 0x7f7750134650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:27.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.208+0000 7f774f7fe700 1 --2- 172.21.15.156:0/1673922682 >> v2:172.21.15.156:3300/0 conn(0x7f775009e870 0x7f775009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:27.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.209+0000 7f774effd700 1 --2- 172.21.15.156:0/1673922682 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f775009f180 0x7f7750133c90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f7744009870 tx=0x7f7744009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b08240092c6ddfd8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:27.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.209+0000 7f774e7fc700 1 -- 172.21.15.156:0/1673922682 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7744011830 con 0x7f775009f180 2023-09-30T22:24:27.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.209+0000 7f774e7fc700 1 -- 172.21.15.156:0/1673922682 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7744011990 con 0x7f775009f180 2023-09-30T22:24:27.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.209+0000 7f774e7fc700 1 -- 172.21.15.156:0/1673922682 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7744011d20 con 0x7f775009f180 2023-09-30T22:24:27.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.209+0000 7f7755fbb700 1 -- 172.21.15.156:0/1673922682 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f775009f180 msgr2=0x7f7750133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.209+0000 7f7755fbb700 1 --2- 172.21.15.156:0/1673922682 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f775009f180 0x7f7750133c90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f7744009870 tx=0x7f7744009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:27.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.209+0000 7f7755fbb700 1 -- 172.21.15.156:0/1673922682 shutdown_connections 2023-09-30T22:24:27.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.209+0000 7f7755fbb700 1 --2- 172.21.15.156:0/1673922682 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77501341d0 0x7f7750134650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.209+0000 7f7755fbb700 1 --2- 172.21.15.156:0/1673922682 >> v2:172.21.15.156:3300/0 conn(0x7f775009e870 0x7f775009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.209+0000 7f7755fbb700 1 --2- 172.21.15.156:0/1673922682 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f775009f180 0x7f7750133c90 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.209+0000 7f7755fbb700 1 -- 172.21.15.156:0/1673922682 >> 172.21.15.156:0/1673922682 conn(0x7f77500a4430 msgr2=0x7f77500a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:27.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.209+0000 7f7755fbb700 1 -- 172.21.15.156:0/1673922682 shutdown_connections 2023-09-30T22:24:27.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.209+0000 7f7755fbb700 1 -- 172.21.15.156:0/1673922682 wait complete. 2023-09-30T22:24:27.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.210+0000 7f7755fbb700 1 Processor -- start 2023-09-30T22:24:27.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.210+0000 7f7755fbb700 1 -- start start 2023-09-30T22:24:27.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.211+0000 7f7755fbb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f775009e870 0x7f7750122530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.211+0000 7f7755fbb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f775009f180 0x7f7750122a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.211+0000 7f7755fbb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77501341d0 0x7f7750122fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.211+0000 7f7755fbb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7750125dc0 con 0x7f77501341d0 2023-09-30T22:24:27.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.211+0000 7f7755fbb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77501338b0 con 0x7f775009e870 2023-09-30T22:24:27.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.211+0000 7f7755fbb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7750125a60 con 0x7f775009f180 2023-09-30T22:24:27.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.211+0000 7f774f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f775009e870 0x7f7750122530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.211+0000 7f774effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f775009f180 0x7f7750122a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.211+0000 7f774ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77501341d0 0x7f7750122fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.211+0000 7f774f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f775009e870 0x7f7750122530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:47894/0 (socket says 172.21.15.156:47894) 2023-09-30T22:24:27.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.211+0000 7f774f7fe700 1 -- 172.21.15.156:0/419549975 learned_addr learned my addr 172.21.15.156:0/419549975 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:27.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.211+0000 7f774f7fe700 1 -- 172.21.15.156:0/419549975 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f775009f180 msgr2=0x7f7750122a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.211+0000 7f774f7fe700 1 --2- 172.21.15.156:0/419549975 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f775009f180 0x7f7750122a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.211+0000 7f774f7fe700 1 -- 172.21.15.156:0/419549975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77501341d0 msgr2=0x7f7750122fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.211+0000 7f774f7fe700 1 --2- 172.21.15.156:0/419549975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77501341d0 0x7f7750122fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.211+0000 7f774f7fe700 1 -- 172.21.15.156:0/419549975 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7740009550 con 0x7f775009e870 2023-09-30T22:24:27.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.211+0000 7f774ffff700 1 --2- 172.21.15.156:0/419549975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77501341d0 0x7f7750122fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:27.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.211+0000 7f774f7fe700 1 --2- 172.21.15.156:0/419549975 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f775009e870 0x7f7750122530 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f774000e9b0 tx=0x7f774000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:27.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.211+0000 7f7737fff700 1 -- 172.21.15.156:0/419549975 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774000ee40 con 0x7f775009e870 2023-09-30T22:24:27.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.212+0000 7f7737fff700 1 -- 172.21.15.156:0/419549975 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774000c850 con 0x7f775009e870 2023-09-30T22:24:27.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.212+0000 7f7737fff700 1 -- 172.21.15.156:0/419549975 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774000cbc0 con 0x7f775009e870 2023-09-30T22:24:27.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.212+0000 7f7755fbb700 1 -- 172.21.15.156:0/419549975 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7748009a70 con 0x7f775009e870 2023-09-30T22:24:27.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.212+0000 7f7755fbb700 1 -- 172.21.15.156:0/419549975 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77440094a0 con 0x7f775009e870 2023-09-30T22:24:27.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.212+0000 7f7737fff700 1 -- 172.21.15.156:0/419549975 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f774000cd20 con 0x7f775009e870 2023-09-30T22:24:27.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.212+0000 7f7737fff700 1 -- 172.21.15.156:0/419549975 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f774003f680 con 0x7f775009e870 2023-09-30T22:24:27.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.212+0000 7f7755fbb700 1 -- 172.21.15.156:0/419549975 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f775004f2a0 con 0x7f775009e870 2023-09-30T22:24:27.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.217+0000 7f7737fff700 1 -- 172.21.15.156:0/419549975 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f77400232f0 con 0x7f775009e870 2023-09-30T22:24:27.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.400+0000 7f7755fbb700 1 -- 172.21.15.156:0/419549975 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7750072d60 con 0x7f775009e870 2023-09-30T22:24:27.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.400+0000 7f7737fff700 1 -- 172.21.15.156:0/419549975 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7740021030 con 0x7f775009e870 2023-09-30T22:24:27.401 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:27.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.402+0000 7f7755fbb700 1 -- 172.21.15.156:0/419549975 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f775009e870 msgr2=0x7f7750122530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.402+0000 7f7755fbb700 1 --2- 172.21.15.156:0/419549975 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f775009e870 0x7f7750122530 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f774000e9b0 tx=0x7f774000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.402+0000 7f7755fbb700 1 -- 172.21.15.156:0/419549975 shutdown_connections 2023-09-30T22:24:27.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.402+0000 7f7755fbb700 1 --2- 172.21.15.156:0/419549975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77501341d0 0x7f7750122fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.402+0000 7f7755fbb700 1 --2- 172.21.15.156:0/419549975 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f775009e870 0x7f7750122530 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.402+0000 7f7755fbb700 1 --2- 172.21.15.156:0/419549975 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f775009f180 0x7f7750122a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.402+0000 7f7755fbb700 1 -- 172.21.15.156:0/419549975 >> 172.21.15.156:0/419549975 conn(0x7f77500a4430 msgr2=0x7f7750072300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:27.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.402+0000 7f7755fbb700 1 -- 172.21.15.156:0/419549975 shutdown_connections 2023-09-30T22:24:27.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.402+0000 7f7755fbb700 1 -- 172.21.15.156:0/419549975 wait complete. 2023-09-30T22:24:27.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:27.828 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:27.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.951+0000 7f4907986700 1 Processor -- start 2023-09-30T22:24:27.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.951+0000 7f4907986700 1 -- start start 2023-09-30T22:24:27.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.951+0000 7f4907986700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f490009d860 0x7f490009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.951+0000 7f4907986700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4900130eb0 0x7f4900138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.951+0000 7f4907986700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f490009aaa0 con 0x7f490009e170 2023-09-30T22:24:27.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.951+0000 7f4907986700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490009f870 con 0x7f4900130eb0 2023-09-30T22:24:27.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.951+0000 7f4907986700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f490009b360 con 0x7f490009d860 2023-09-30T22:24:27.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.951+0000 7f4905722700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f490009d860 0x7f490009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.951+0000 7f4904f21700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f490009e170 0x7f49001307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:57738/0 (socket says 172.21.15.156:57738) 2023-09-30T22:24:27.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.951+0000 7f4905f23700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4900130eb0 0x7f4900138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.951+0000 7f4904f21700 1 -- 172.21.15.156:0/319385683 learned_addr learned my addr 172.21.15.156:0/319385683 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:27.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.952+0000 7f48f7fff700 1 -- 172.21.15.156:0/319385683 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1652457041 0 0) 0x7f490009aaa0 con 0x7f490009e170 2023-09-30T22:24:27.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.952+0000 7f4905722700 1 -- 172.21.15.156:0/319385683 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4900130eb0 msgr2=0x7f4900138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:27.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.952+0000 7f4905722700 1 --2- 172.21.15.156:0/319385683 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4900130eb0 0x7f4900138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.952+0000 7f4905722700 1 -- 172.21.15.156:0/319385683 >> v1:172.21.15.156:6789/0 conn(0x7f490009e170 legacy=0x7f49001307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.952+0000 7f4905722700 1 -- 172.21.15.156:0/319385683 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f490009b620 con 0x7f490009d860 2023-09-30T22:24:27.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.952+0000 7f4905f23700 1 --2- 172.21.15.156:0/319385683 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4900130eb0 0x7f4900138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:27.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.952+0000 7f4905722700 1 --2- 172.21.15.156:0/319385683 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f490009d860 0x7f490009dc30 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f48fc009870 tx=0x7f48fc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92525d47f18d3072 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:27.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.952+0000 7f48f7fff700 1 -- 172.21.15.156:0/319385683 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc011830 con 0x7f490009d860 2023-09-30T22:24:27.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.952+0000 7f48f7fff700 1 -- 172.21.15.156:0/319385683 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48fc011990 con 0x7f490009d860 2023-09-30T22:24:27.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.952+0000 7f48f7fff700 1 -- 172.21.15.156:0/319385683 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc011d20 con 0x7f490009d860 2023-09-30T22:24:27.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.953+0000 7f4907986700 1 -- 172.21.15.156:0/319385683 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f490009d860 msgr2=0x7f490009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.953+0000 7f4907986700 1 --2- 172.21.15.156:0/319385683 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f490009d860 0x7f490009dc30 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f48fc009870 tx=0x7f48fc009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:27.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.953+0000 7f4907986700 1 -- 172.21.15.156:0/319385683 shutdown_connections 2023-09-30T22:24:27.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.953+0000 7f4907986700 1 --2- 172.21.15.156:0/319385683 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4900130eb0 0x7f4900138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.953+0000 7f4907986700 1 --2- 172.21.15.156:0/319385683 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f490009d860 0x7f490009dc30 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.953+0000 7f4907986700 1 -- 172.21.15.156:0/319385683 >> 172.21.15.156:0/319385683 conn(0x7f4900099c40 msgr2=0x7f49000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:27.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.953+0000 7f4907986700 1 -- 172.21.15.156:0/319385683 shutdown_connections 2023-09-30T22:24:27.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.953+0000 7f4907986700 1 -- 172.21.15.156:0/319385683 wait complete. 2023-09-30T22:24:27.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.954+0000 7f4907986700 1 Processor -- start 2023-09-30T22:24:27.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.954+0000 7f4907986700 1 -- start start 2023-09-30T22:24:27.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.954+0000 7f4907986700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f490009d860 0x7f490006e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.954+0000 7f4907986700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f490009e170 0x7f490006ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.954+0000 7f4907986700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4900130eb0 0x7f490006f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.954+0000 7f4907986700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4900125c50 con 0x7f490009d860 2023-09-30T22:24:27.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.954+0000 7f4907986700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490009c8b0 con 0x7f490009e170 2023-09-30T22:24:27.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.954+0000 7f4907986700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4900126dd0 con 0x7f4900130eb0 2023-09-30T22:24:27.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.954+0000 7f4904f21700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f490009e170 0x7f490006ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.954+0000 7f4905722700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f490009d860 0x7f490006e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.954+0000 7f4905f23700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4900130eb0 0x7f490006f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.954+0000 7f4904f21700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f490009e170 0x7f490006ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:47912/0 (socket says 172.21.15.156:47912) 2023-09-30T22:24:27.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.954+0000 7f4904f21700 1 -- 172.21.15.156:0/2425946001 learned_addr learned my addr 172.21.15.156:0/2425946001 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:27.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.954+0000 7f4905722700 1 -- 172.21.15.156:0/2425946001 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4900130eb0 msgr2=0x7f490006f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.954+0000 7f4905722700 1 --2- 172.21.15.156:0/2425946001 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4900130eb0 0x7f490006f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.954+0000 7f4905722700 1 -- 172.21.15.156:0/2425946001 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f490009e170 msgr2=0x7f490006ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.954+0000 7f4905722700 1 --2- 172.21.15.156:0/2425946001 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f490009e170 0x7f490006ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.954+0000 7f4905722700 1 -- 172.21.15.156:0/2425946001 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f8009a70 con 0x7f490009d860 2023-09-30T22:24:27.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.954+0000 7f4905f23700 1 --2- 172.21.15.156:0/2425946001 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4900130eb0 0x7f490006f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:27.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.954+0000 7f4904f21700 1 --2- 172.21.15.156:0/2425946001 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f490009e170 0x7f490006ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:27.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.955+0000 7f4905722700 1 --2- 172.21.15.156:0/2425946001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f490009d860 0x7f490006e930 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f48fc016000 tx=0x7f48fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:27.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.955+0000 7f48f5ffb700 1 -- 172.21.15.156:0/2425946001 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc0044d0 con 0x7f490009d860 2023-09-30T22:24:27.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.955+0000 7f48f5ffb700 1 -- 172.21.15.156:0/2425946001 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48fc01f070 con 0x7f490009d860 2023-09-30T22:24:27.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.955+0000 7f4907986700 1 -- 172.21.15.156:0/2425946001 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48fc0094a0 con 0x7f490009d860 2023-09-30T22:24:27.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.955+0000 7f48f5ffb700 1 -- 172.21.15.156:0/2425946001 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc0038a0 con 0x7f490009d860 2023-09-30T22:24:27.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.955+0000 7f4907986700 1 -- 172.21.15.156:0/2425946001 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4900130690 con 0x7f490009d860 2023-09-30T22:24:27.959 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.956+0000 7f48f5ffb700 1 -- 172.21.15.156:0/2425946001 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f48fc003a00 con 0x7f490009d860 2023-09-30T22:24:27.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.956+0000 7f48f5ffb700 1 -- 172.21.15.156:0/2425946001 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f48fc021070 con 0x7f490009d860 2023-09-30T22:24:27.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.956+0000 7f4907986700 1 -- 172.21.15.156:0/2425946001 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f490004f2a0 con 0x7f490009d860 2023-09-30T22:24:27.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:27.961+0000 7f48f5ffb700 1 -- 172.21.15.156:0/2425946001 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f48fc015080 con 0x7f490009d860 2023-09-30T22:24:27.968 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:28.009 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:28.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.095+0000 7fabdfadf700 1 Processor -- start 2023-09-30T22:24:28.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.095+0000 7fabdfadf700 1 -- start start 2023-09-30T22:24:28.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.096+0000 7fabdfadf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabd809e950 0x7fabd809ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.096+0000 7fabdfadf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabd809f260 0x7fabd8133c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.096+0000 7fabdfadf700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd806bcc0 con 0x7fabd81341c0 2023-09-30T22:24:28.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.096+0000 7fabdfadf700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd806c9a0 con 0x7fabd809f260 2023-09-30T22:24:28.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.096+0000 7fabdfadf700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabd809afe0 con 0x7fabd809e950 2023-09-30T22:24:28.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.096+0000 7fabdd07a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabd809f260 0x7fabd8133c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.096+0000 7fabdd87b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabd809e950 0x7fabd809ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.096+0000 7fabdd07a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabd809f260 0x7fabd8133c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:47922/0 (socket says 172.21.15.156:47922) 2023-09-30T22:24:28.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.096+0000 7fabdd87b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabd809e950 0x7fabd809ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:58652/0 (socket says 172.21.15.156:58652) 2023-09-30T22:24:28.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.096+0000 7fabdd07a700 1 -- 172.21.15.156:0/403816909 learned_addr learned my addr 172.21.15.156:0/403816909 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:28.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.096+0000 7fabdd87b700 1 -- 172.21.15.156:0/403816909 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabd809f260 msgr2=0x7fabd8133c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:28.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.096+0000 7fabdd87b700 1 --2- 172.21.15.156:0/403816909 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabd809f260 0x7fabd8133c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.096+0000 7fabdd87b700 1 -- 172.21.15.156:0/403816909 >> v1:172.21.15.156:6789/0 conn(0x7fabd81341c0 legacy=0x7fabd813aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.096+0000 7fabdd87b700 1 -- 172.21.15.156:0/403816909 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd806cb80 con 0x7fabd809e950 2023-09-30T22:24:28.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.096+0000 7fabdc879700 1 -- 172.21.15.156:0/403816909 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160426728 0 0) 0x7fabd806bcc0 con 0x7fabd81341c0 2023-09-30T22:24:28.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.096+0000 7fabdd07a700 1 --2- 172.21.15.156:0/403816909 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabd809f260 0x7fabd8133c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:28.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.096+0000 7fabdd87b700 1 --2- 172.21.15.156:0/403816909 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabd809e950 0x7fabd809ed20 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fabd4009850 tx=0x7fabd4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd3d1efbfa88b825 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:28.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.096+0000 7fabdc879700 1 -- 172.21.15.156:0/403816909 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd4005e30 con 0x7fabd809e950 2023-09-30T22:24:28.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.097+0000 7fabdc879700 1 -- 172.21.15.156:0/403816909 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd4006030 con 0x7fabd809e950 2023-09-30T22:24:28.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.097+0000 7fabdc879700 1 -- 172.21.15.156:0/403816909 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd40063e0 con 0x7fabd809e950 2023-09-30T22:24:28.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.097+0000 7fabdfadf700 1 -- 172.21.15.156:0/403816909 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabd809e950 msgr2=0x7fabd809ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.097+0000 7fabdfadf700 1 --2- 172.21.15.156:0/403816909 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabd809e950 0x7fabd809ed20 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fabd4009850 tx=0x7fabd4009b60 comp rx=0 tx=0).stop 2023-09-30T22:24:28.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.097+0000 7fabdfadf700 1 -- 172.21.15.156:0/403816909 shutdown_connections 2023-09-30T22:24:28.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.097+0000 7fabdfadf700 1 --2- 172.21.15.156:0/403816909 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabd809e950 0x7fabd809ed20 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.097+0000 7fabdfadf700 1 --2- 172.21.15.156:0/403816909 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabd809f260 0x7fabd8133c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.097+0000 7fabdfadf700 1 -- 172.21.15.156:0/403816909 >> 172.21.15.156:0/403816909 conn(0x7fabd80a0f70 msgr2=0x7fabd80a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:28.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.097+0000 7fabdfadf700 1 -- 172.21.15.156:0/403816909 shutdown_connections 2023-09-30T22:24:28.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.097+0000 7fabdfadf700 1 -- 172.21.15.156:0/403816909 wait complete. 2023-09-30T22:24:28.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.099+0000 7fabdfadf700 1 Processor -- start 2023-09-30T22:24:28.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.099+0000 7fabdfadf700 1 -- start start 2023-09-30T22:24:28.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.099+0000 7fabdfadf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabd809e950 0x7fabd8122b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.099+0000 7fabdfadf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabd809f260 0x7fabd8123080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.099+0000 7fabdfadf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabd81341c0 0x7fabd81235c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.099+0000 7fabdfadf700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd81265c0 con 0x7fabd809f260 2023-09-30T22:24:28.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.099+0000 7fabdfadf700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd8123fa0 con 0x7fabd81341c0 2023-09-30T22:24:28.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.099+0000 7fabdfadf700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabd81246b0 con 0x7fabd809e950 2023-09-30T22:24:28.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.100+0000 7fabdd07a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabd809f260 0x7fabd8123080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.100+0000 7fabdd87b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabd809e950 0x7fabd8122b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.100+0000 7fabdd07a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabd809f260 0x7fabd8123080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49772/0 (socket says 172.21.15.156:49772) 2023-09-30T22:24:28.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.100+0000 7fabdd87b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabd809e950 0x7fabd8122b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:58656/0 (socket says 172.21.15.156:58656) 2023-09-30T22:24:28.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.100+0000 7fabdd07a700 1 -- 172.21.15.156:0/2312183179 learned_addr learned my addr 172.21.15.156:0/2312183179 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:28.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.100+0000 7fabde07c700 1 --2- 172.21.15.156:0/2312183179 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabd81341c0 0x7fabd81235c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.100+0000 7fabdd07a700 1 -- 172.21.15.156:0/2312183179 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabd809e950 msgr2=0x7fabd8122b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.100+0000 7fabdd07a700 1 --2- 172.21.15.156:0/2312183179 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabd809e950 0x7fabd8122b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.100+0000 7fabdd07a700 1 -- 172.21.15.156:0/2312183179 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabd81341c0 msgr2=0x7fabd81235c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.100+0000 7fabdd07a700 1 --2- 172.21.15.156:0/2312183179 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabd81341c0 0x7fabd81235c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.100+0000 7fabdd07a700 1 -- 172.21.15.156:0/2312183179 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc8009550 con 0x7fabd809f260 2023-09-30T22:24:28.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.100+0000 7fabdd07a700 1 --2- 172.21.15.156:0/2312183179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabd809f260 0x7fabd8123080 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fabc800ebe0 tx=0x7fabc800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:28.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.100+0000 7fabce7fc700 1 -- 172.21.15.156:0/2312183179 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc800c850 con 0x7fabd809f260 2023-09-30T22:24:28.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.100+0000 7fabce7fc700 1 -- 172.21.15.156:0/2312183179 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc800c9b0 con 0x7fabd809f260 2023-09-30T22:24:28.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.100+0000 7fabdfadf700 1 -- 172.21.15.156:0/2312183179 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd4009430 con 0x7fabd809f260 2023-09-30T22:24:28.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.100+0000 7fabce7fc700 1 -- 172.21.15.156:0/2312183179 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc800cd40 con 0x7fabd809f260 2023-09-30T22:24:28.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.100+0000 7fabdfadf700 1 -- 172.21.15.156:0/2312183179 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd81339f0 con 0x7fabd809f260 2023-09-30T22:24:28.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.101+0000 7fabce7fc700 1 -- 172.21.15.156:0/2312183179 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fabc8013470 con 0x7fabd809f260 2023-09-30T22:24:28.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.101+0000 7fabce7fc700 1 -- 172.21.15.156:0/2312183179 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fabc803f870 con 0x7fabd809f260 2023-09-30T22:24:28.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.101+0000 7fabdfadf700 1 -- 172.21.15.156:0/2312183179 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd804f2a0 con 0x7fabd809f260 2023-09-30T22:24:28.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.106+0000 7fabce7fc700 1 -- 172.21.15.156:0/2312183179 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fabc80232f0 con 0x7fabd809f260 2023-09-30T22:24:28.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.137+0000 7fafb7a94700 1 Processor -- start 2023-09-30T22:24:28.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.138+0000 7fafb7a94700 1 -- start start 2023-09-30T22:24:28.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.138+0000 7fafb7a94700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fafb00a0a70 0x7fafb00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.138+0000 7fafb7a94700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafb00a1380 0x7fafb0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.138+0000 7fafb7a94700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb009dc00 con 0x7fafb0133f50 2023-09-30T22:24:28.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.138+0000 7fafb7a94700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb009ea60 con 0x7fafb00a0a70 2023-09-30T22:24:28.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.138+0000 7fafb7a94700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb009dec0 con 0x7fafb00a1380 2023-09-30T22:24:28.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.138+0000 7fafb6031700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fafb0133f50 0x7fafb013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:57754/0 (socket says 172.21.15.156:57754) 2023-09-30T22:24:28.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.138+0000 7fafb6031700 1 -- 172.21.15.156:0/917004456 learned_addr learned my addr 172.21.15.156:0/917004456 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:28.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.138+0000 7fafb5830700 1 --2- 172.21.15.156:0/917004456 >> v2:172.21.15.156:3300/0 conn(0x7fafb00a0a70 0x7fafb00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.138+0000 7fafb502f700 1 --2- 172.21.15.156:0/917004456 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafb00a1380 0x7fafb0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.139+0000 7fafb502f700 1 -- 172.21.15.156:0/917004456 >> v2:172.21.15.156:3300/0 conn(0x7fafb00a0a70 msgr2=0x7fafb00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:28.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.139+0000 7fafb502f700 1 --2- 172.21.15.156:0/917004456 >> v2:172.21.15.156:3300/0 conn(0x7fafb00a0a70 0x7fafb00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.139+0000 7fafb502f700 1 -- 172.21.15.156:0/917004456 >> v1:172.21.15.156:6789/0 conn(0x7fafb0133f50 legacy=0x7fafb013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.139+0000 7fafb502f700 1 -- 172.21.15.156:0/917004456 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb009e6a0 con 0x7fafb00a1380 2023-09-30T22:24:28.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.139+0000 7fafb5830700 1 --2- 172.21.15.156:0/917004456 >> v2:172.21.15.156:3300/0 conn(0x7fafb00a0a70 0x7fafb00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:28.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.139+0000 7fafb502f700 1 --2- 172.21.15.156:0/917004456 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafb00a1380 0x7fafb0133a10 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fafa0009840 tx=0x7fafa0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7815b995d47641 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:28.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.139+0000 7fafb482e700 1 -- 172.21.15.156:0/917004456 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa0011830 con 0x7fafb00a1380 2023-09-30T22:24:28.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.139+0000 7fafb482e700 1 -- 172.21.15.156:0/917004456 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa0011990 con 0x7fafb00a1380 2023-09-30T22:24:28.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.139+0000 7fafb482e700 1 -- 172.21.15.156:0/917004456 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa0011d20 con 0x7fafb00a1380 2023-09-30T22:24:28.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.140+0000 7fafb7a94700 1 -- 172.21.15.156:0/917004456 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafb00a1380 msgr2=0x7fafb0133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.140+0000 7fafb7a94700 1 --2- 172.21.15.156:0/917004456 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafb00a1380 0x7fafb0133a10 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fafa0009840 tx=0x7fafa0009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:28.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.140+0000 7fafb7a94700 1 -- 172.21.15.156:0/917004456 shutdown_connections 2023-09-30T22:24:28.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.140+0000 7fafb7a94700 1 --2- 172.21.15.156:0/917004456 >> v2:172.21.15.156:3300/0 conn(0x7fafb00a0a70 0x7fafb00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.140+0000 7fafb7a94700 1 --2- 172.21.15.156:0/917004456 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafb00a1380 0x7fafb0133a10 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.140+0000 7fafb7a94700 1 -- 172.21.15.156:0/917004456 >> 172.21.15.156:0/917004456 conn(0x7fafb00a6610 msgr2=0x7fafb00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:28.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.140+0000 7fafb7a94700 1 -- 172.21.15.156:0/917004456 shutdown_connections 2023-09-30T22:24:28.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.140+0000 7fafb7a94700 1 -- 172.21.15.156:0/917004456 wait complete. 2023-09-30T22:24:28.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.141+0000 7fafb7a94700 1 Processor -- start 2023-09-30T22:24:28.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.141+0000 7fafb7a94700 1 -- start start 2023-09-30T22:24:28.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.141+0000 7fafb7a94700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafb00a0a70 0x7fafb01c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.141+0000 7fafb7a94700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafb00a1380 0x7fafb01c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.141+0000 7fafb7a94700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fafb0133f50 0x7fafb01c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.141+0000 7fafb7a94700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb0122e90 con 0x7fafb00a0a70 2023-09-30T22:24:28.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.141+0000 7fafb7a94700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb0133a10 con 0x7fafb00a1380 2023-09-30T22:24:28.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.141+0000 7fafb7a94700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00a03e0 con 0x7fafb0133f50 2023-09-30T22:24:28.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.141+0000 7fafb502f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafb00a1380 0x7fafb01c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.141+0000 7fafb502f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafb00a1380 0x7fafb01c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:47960/0 (socket says 172.21.15.156:47960) 2023-09-30T22:24:28.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.141+0000 7fafb502f700 1 -- 172.21.15.156:0/1828983183 learned_addr learned my addr 172.21.15.156:0/1828983183 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:28.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.141+0000 7fafb5830700 1 --2- 172.21.15.156:0/1828983183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafb00a0a70 0x7fafb01c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.142+0000 7fafb6031700 1 --2- 172.21.15.156:0/1828983183 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fafb0133f50 0x7fafb01c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.142+0000 7fafb502f700 1 -- 172.21.15.156:0/1828983183 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fafb0133f50 msgr2=0x7fafb01c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.142+0000 7fafb502f700 1 --2- 172.21.15.156:0/1828983183 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fafb0133f50 0x7fafb01c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.142+0000 7fafb502f700 1 -- 172.21.15.156:0/1828983183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafb00a0a70 msgr2=0x7fafb01c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.142+0000 7fafb502f700 1 --2- 172.21.15.156:0/1828983183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafb00a0a70 0x7fafb01c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.142+0000 7fafb502f700 1 -- 172.21.15.156:0/1828983183 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac0094a0 con 0x7fafb00a1380 2023-09-30T22:24:28.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.142+0000 7fafb5830700 1 --2- 172.21.15.156:0/1828983183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafb00a0a70 0x7fafb01c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:28.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.142+0000 7fafb502f700 1 --2- 172.21.15.156:0/1828983183 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafb00a1380 0x7fafb01c8790 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fafa0009fd0 tx=0x7fafa0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:28.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.142+0000 7fafa67fc700 1 -- 172.21.15.156:0/1828983183 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa00036a0 con 0x7fafb00a1380 2023-09-30T22:24:28.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.142+0000 7fafa67fc700 1 -- 172.21.15.156:0/1828983183 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa001f070 con 0x7fafb00a1380 2023-09-30T22:24:28.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.142+0000 7fafa67fc700 1 -- 172.21.15.156:0/1828983183 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa0003a60 con 0x7fafb00a1380 2023-09-30T22:24:28.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.142+0000 7fafb7a94700 1 -- 172.21.15.156:0/1828983183 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa00094a0 con 0x7fafb00a1380 2023-09-30T22:24:28.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.142+0000 7fafb7a94700 1 -- 172.21.15.156:0/1828983183 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb01252e0 con 0x7fafb00a1380 2023-09-30T22:24:28.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.143+0000 7fafa67fc700 1 -- 172.21.15.156:0/1828983183 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fafa0003bc0 con 0x7fafb00a1380 2023-09-30T22:24:28.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.143+0000 7fafa67fc700 1 -- 172.21.15.156:0/1828983183 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fafa0021070 con 0x7fafb00a1380 2023-09-30T22:24:28.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.143+0000 7fafb7a94700 1 -- 172.21.15.156:0/1828983183 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb0126330 con 0x7fafb00a1380 2023-09-30T22:24:28.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.152+0000 7fafa67fc700 1 -- 172.21.15.156:0/1828983183 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fafa002b080 con 0x7fafb00a1380 2023-09-30T22:24:28.164 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.164+0000 7f4907986700 1 -- 172.21.15.156:0/2425946001 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4900125f60 con 0x7f490009d860 2023-09-30T22:24:28.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.164+0000 7f48f5ffb700 1 -- 172.21.15.156:0/2425946001 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f48fc02b020 con 0x7f490009d860 2023-09-30T22:24:28.165 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:28.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.167+0000 7f4907986700 1 -- 172.21.15.156:0/2425946001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f490009d860 msgr2=0x7f490006e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.167+0000 7f4907986700 1 --2- 172.21.15.156:0/2425946001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f490009d860 0x7f490006e930 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f48fc016000 tx=0x7f48fc004750 comp rx=0 tx=0).stop 2023-09-30T22:24:28.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.167+0000 7f4907986700 1 -- 172.21.15.156:0/2425946001 shutdown_connections 2023-09-30T22:24:28.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.167+0000 7f4907986700 1 --2- 172.21.15.156:0/2425946001 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4900130eb0 0x7f490006f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.167+0000 7f4907986700 1 --2- 172.21.15.156:0/2425946001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f490009d860 0x7f490006e930 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.167+0000 7f4907986700 1 --2- 172.21.15.156:0/2425946001 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f490009e170 0x7f490006ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.167+0000 7f4907986700 1 -- 172.21.15.156:0/2425946001 >> 172.21.15.156:0/2425946001 conn(0x7f4900099c40 msgr2=0x7f4900070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:28.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.167+0000 7f4907986700 1 -- 172.21.15.156:0/2425946001 shutdown_connections 2023-09-30T22:24:28.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.167+0000 7f4907986700 1 -- 172.21.15.156:0/2425946001 wait complete. 2023-09-30T22:24:28.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:28.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.307+0000 7fabdfadf700 1 -- 172.21.15.156:0/2312183179 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fabd80a0850 con 0x7fabd809f260 2023-09-30T22:24:28.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.307+0000 7fabce7fc700 1 -- 172.21.15.156:0/2312183179 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fabc8017020 con 0x7fabd809f260 2023-09-30T22:24:28.308 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:28.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.309+0000 7fabdfadf700 1 -- 172.21.15.156:0/2312183179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabd809f260 msgr2=0x7fabd8123080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.309+0000 7fabdfadf700 1 --2- 172.21.15.156:0/2312183179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabd809f260 0x7fabd8123080 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fabc800ebe0 tx=0x7fabc800eef0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.309+0000 7fabdfadf700 1 -- 172.21.15.156:0/2312183179 shutdown_connections 2023-09-30T22:24:28.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.309+0000 7fabdfadf700 1 --2- 172.21.15.156:0/2312183179 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fabd81341c0 0x7fabd81235c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.309+0000 7fabdfadf700 1 --2- 172.21.15.156:0/2312183179 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fabd809e950 0x7fabd8122b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.309+0000 7fabdfadf700 1 --2- 172.21.15.156:0/2312183179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabd809f260 0x7fabd8123080 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.309+0000 7fabdfadf700 1 -- 172.21.15.156:0/2312183179 >> 172.21.15.156:0/2312183179 conn(0x7fabd80a0f70 msgr2=0x7fabd809cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:28.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.310+0000 7fabdfadf700 1 -- 172.21.15.156:0/2312183179 shutdown_connections 2023-09-30T22:24:28.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.310+0000 7fabdfadf700 1 -- 172.21.15.156:0/2312183179 wait complete. 2023-09-30T22:24:28.322 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:28.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.346+0000 7fafb7a94700 1 -- 172.21.15.156:0/1828983183 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fafb004f2a0 con 0x7fafb00a1380 2023-09-30T22:24:28.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.346+0000 7fafa67fc700 1 -- 172.21.15.156:0/1828983183 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fafa0015020 con 0x7fafb00a1380 2023-09-30T22:24:28.347 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:28.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.348+0000 7fafb7a94700 1 -- 172.21.15.156:0/1828983183 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafb00a1380 msgr2=0x7fafb01c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.348+0000 7fafb7a94700 1 --2- 172.21.15.156:0/1828983183 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafb00a1380 0x7fafb01c8790 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fafa0009fd0 tx=0x7fafa0004750 comp rx=0 tx=0).stop 2023-09-30T22:24:28.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.348+0000 7fafb7a94700 1 -- 172.21.15.156:0/1828983183 shutdown_connections 2023-09-30T22:24:28.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.348+0000 7fafb7a94700 1 --2- 172.21.15.156:0/1828983183 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fafb0133f50 0x7fafb01c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.348+0000 7fafb7a94700 1 --2- 172.21.15.156:0/1828983183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafb00a0a70 0x7fafb01c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.348+0000 7fafb7a94700 1 --2- 172.21.15.156:0/1828983183 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fafb00a1380 0x7fafb01c8790 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.348+0000 7fafb7a94700 1 -- 172.21.15.156:0/1828983183 >> 172.21.15.156:0/1828983183 conn(0x7fafb00a6610 msgr2=0x7fafb00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:28.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.348+0000 7fafb7a94700 1 -- 172.21.15.156:0/1828983183 shutdown_connections 2023-09-30T22:24:28.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.348+0000 7fafb7a94700 1 -- 172.21.15.156:0/1828983183 wait complete. 2023-09-30T22:24:28.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:28.416 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:28.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.538+0000 7f6855663700 1 Processor -- start 2023-09-30T22:24:28.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.538+0000 7f6855663700 1 -- start start 2023-09-30T22:24:28.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.538+0000 7f6855663700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f685009da80 0x7f6850136b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.538+0000 7f6855663700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f685006b250 0x7f68501390e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.538+0000 7f6855663700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685009ec00 con 0x7f685006a770 2023-09-30T22:24:28.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.538+0000 7f6855663700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f685009f6a0 con 0x7f685009da80 2023-09-30T22:24:28.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.538+0000 7f6855663700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f685009f230 con 0x7f685006b250 2023-09-30T22:24:28.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.538+0000 7f684e7fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f685009da80 0x7f6850136b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.538+0000 7f684f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f685006b250 0x7f68501390e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.538+0000 7f684e7fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f685009da80 0x7f6850136b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49812/0 (socket says 172.21.15.156:49812) 2023-09-30T22:24:28.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.538+0000 7f684f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f685006b250 0x7f68501390e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:58678/0 (socket says 172.21.15.156:58678) 2023-09-30T22:24:28.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.538+0000 7f684e7fc700 1 -- 172.21.15.156:0/3272080618 learned_addr learned my addr 172.21.15.156:0/3272080618 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:28.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.538+0000 7f684effd700 1 --1- 172.21.15.156:0/3272080618 >> v1:172.21.15.156:6789/0 conn(0x7f685006a770 0x7f685006ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:57766/0 (socket says 172.21.15.156:57766) 2023-09-30T22:24:28.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.539+0000 7f684e7fc700 1 -- 172.21.15.156:0/3272080618 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f685006b250 msgr2=0x7f68501390e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:28.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.539+0000 7f684e7fc700 1 --2- 172.21.15.156:0/3272080618 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f685006b250 0x7f68501390e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.539+0000 7f684e7fc700 1 -- 172.21.15.156:0/3272080618 >> v1:172.21.15.156:6789/0 conn(0x7f685006a770 legacy=0x7f685006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.539+0000 7f684e7fc700 1 -- 172.21.15.156:0/3272080618 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685009c870 con 0x7f685009da80 2023-09-30T22:24:28.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.539+0000 7f684f7fe700 1 --2- 172.21.15.156:0/3272080618 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f685006b250 0x7f68501390e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:28.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.539+0000 7f684dffb700 1 -- 172.21.15.156:0/3272080618 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229787705 0 0) 0x7f685009ec00 con 0x7f685006a770 2023-09-30T22:24:28.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.539+0000 7f684e7fc700 1 --2- 172.21.15.156:0/3272080618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f685009da80 0x7f6850136b90 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f68400098f0 tx=0x7f6840009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22dc8806ed87a9a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:28.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.539+0000 7f684dffb700 1 -- 172.21.15.156:0/3272080618 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6840011830 con 0x7f685009da80 2023-09-30T22:24:28.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.539+0000 7f684dffb700 1 -- 172.21.15.156:0/3272080618 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6840011990 con 0x7f685009da80 2023-09-30T22:24:28.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.539+0000 7f684dffb700 1 -- 172.21.15.156:0/3272080618 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6840011d20 con 0x7f685009da80 2023-09-30T22:24:28.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.539+0000 7f6855663700 1 -- 172.21.15.156:0/3272080618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f685009da80 msgr2=0x7f6850136b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.539+0000 7f6855663700 1 --2- 172.21.15.156:0/3272080618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f685009da80 0x7f6850136b90 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f68400098f0 tx=0x7f6840009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:28.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.539+0000 7f6855663700 1 -- 172.21.15.156:0/3272080618 shutdown_connections 2023-09-30T22:24:28.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.539+0000 7f6855663700 1 --2- 172.21.15.156:0/3272080618 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f685006b250 0x7f68501390e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.539+0000 7f6855663700 1 --2- 172.21.15.156:0/3272080618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f685009da80 0x7f6850136b90 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.539+0000 7f6855663700 1 -- 172.21.15.156:0/3272080618 >> 172.21.15.156:0/3272080618 conn(0x7f685009f9f0 msgr2=0x7f685009fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:28.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.539+0000 7f6855663700 1 -- 172.21.15.156:0/3272080618 shutdown_connections 2023-09-30T22:24:28.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.540+0000 7f6855663700 1 -- 172.21.15.156:0/3272080618 wait complete. 2023-09-30T22:24:28.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.540+0000 7f6855663700 1 Processor -- start 2023-09-30T22:24:28.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.541+0000 7f6855663700 1 -- start start 2023-09-30T22:24:28.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.541+0000 7f6855663700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f685006a770 0x7f68501371e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.541+0000 7f6855663700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f685006b250 0x7f6850137720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.541+0000 7f6855663700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f685009da80 0x7f6850137c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.541+0000 7f6855663700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685012f6d0 con 0x7f685006b250 2023-09-30T22:24:28.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.541+0000 7f6855663700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685011a9c0 con 0x7f685009da80 2023-09-30T22:24:28.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.541+0000 7f6855663700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68500a3cf0 con 0x7f685006a770 2023-09-30T22:24:28.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.541+0000 7f684effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f685006a770 0x7f68501371e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.541+0000 7f684f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f685009da80 0x7f6850137c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.541+0000 7f684effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f685006a770 0x7f68501371e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:58694/0 (socket says 172.21.15.156:58694) 2023-09-30T22:24:28.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.541+0000 7f684f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f685009da80 0x7f6850137c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:47972/0 (socket says 172.21.15.156:47972) 2023-09-30T22:24:28.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.541+0000 7f684effd700 1 -- 172.21.15.156:0/2792490882 learned_addr learned my addr 172.21.15.156:0/2792490882 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:28.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.541+0000 7f684e7fc700 1 --2- 172.21.15.156:0/2792490882 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f685006b250 0x7f6850137720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.541+0000 7f684effd700 1 -- 172.21.15.156:0/2792490882 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f685009da80 msgr2=0x7f6850137c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.541+0000 7f684effd700 1 --2- 172.21.15.156:0/2792490882 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f685009da80 0x7f6850137c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.541+0000 7f684effd700 1 -- 172.21.15.156:0/2792490882 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f685006b250 msgr2=0x7f6850137720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.541+0000 7f684effd700 1 --2- 172.21.15.156:0/2792490882 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f685006b250 0x7f6850137720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.541+0000 7f684effd700 1 -- 172.21.15.156:0/2792490882 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6848009a70 con 0x7f685006a770 2023-09-30T22:24:28.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.541+0000 7f684e7fc700 1 --2- 172.21.15.156:0/2792490882 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f685006b250 0x7f6850137720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:28.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.541+0000 7f684effd700 1 --2- 172.21.15.156:0/2792490882 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f685006a770 0x7f68501371e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f684400c480 tx=0x7f684400c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:28.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.542+0000 7f68377fe700 1 -- 172.21.15.156:0/2792490882 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68440074e0 con 0x7f685006a770 2023-09-30T22:24:28.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.542+0000 7f68377fe700 1 -- 172.21.15.156:0/2792490882 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6844007660 con 0x7f685006a770 2023-09-30T22:24:28.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.542+0000 7f6855663700 1 -- 172.21.15.156:0/2792490882 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6840009550 con 0x7f685006a770 2023-09-30T22:24:28.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.542+0000 7f68377fe700 1 -- 172.21.15.156:0/2792490882 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6844005a70 con 0x7f685006a770 2023-09-30T22:24:28.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.542+0000 7f6855663700 1 -- 172.21.15.156:0/2792490882 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68501385b0 con 0x7f685006a770 2023-09-30T22:24:28.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.542+0000 7f68377fe700 1 -- 172.21.15.156:0/2792490882 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6844005bd0 con 0x7f685006a770 2023-09-30T22:24:28.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.543+0000 7f68377fe700 1 -- 172.21.15.156:0/2792490882 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f684403ea50 con 0x7f685006a770 2023-09-30T22:24:28.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.543+0000 7f6855663700 1 -- 172.21.15.156:0/2792490882 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f685011a530 con 0x7f685006a770 2023-09-30T22:24:28.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.547+0000 7f68377fe700 1 -- 172.21.15.156:0/2792490882 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6844017030 con 0x7f685006a770 2023-09-30T22:24:28.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.730+0000 7f6855663700 1 -- 172.21.15.156:0/2792490882 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f685004f2a0 con 0x7f685006a770 2023-09-30T22:24:28.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.731+0000 7f68377fe700 1 -- 172.21.15.156:0/2792490882 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6844019cd0 con 0x7f685006a770 2023-09-30T22:24:28.731 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:28.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.733+0000 7f6855663700 1 -- 172.21.15.156:0/2792490882 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f685006a770 msgr2=0x7f68501371e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.733+0000 7f6855663700 1 --2- 172.21.15.156:0/2792490882 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f685006a770 0x7f68501371e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f684400c480 tx=0x7f684400c790 comp rx=0 tx=0).stop 2023-09-30T22:24:28.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.733+0000 7f6855663700 1 -- 172.21.15.156:0/2792490882 shutdown_connections 2023-09-30T22:24:28.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.733+0000 7f6855663700 1 --2- 172.21.15.156:0/2792490882 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f685009da80 0x7f6850137c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.733+0000 7f6855663700 1 --2- 172.21.15.156:0/2792490882 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f685006a770 0x7f68501371e0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.733+0000 7f6855663700 1 --2- 172.21.15.156:0/2792490882 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f685006b250 0x7f6850137720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.733+0000 7f6855663700 1 -- 172.21.15.156:0/2792490882 >> 172.21.15.156:0/2792490882 conn(0x7f685009f9f0 msgr2=0x7f685006fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:28.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.733+0000 7f6855663700 1 -- 172.21.15.156:0/2792490882 shutdown_connections 2023-09-30T22:24:28.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:28.733+0000 7f6855663700 1 -- 172.21.15.156:0/2792490882 wait complete. 2023-09-30T22:24:28.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:29.181 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:29.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.309+0000 7f98d9dce700 1 Processor -- start 2023-09-30T22:24:29.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.309+0000 7f98d9dce700 1 -- start start 2023-09-30T22:24:29.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.310+0000 7f98d9dce700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98d409e870 0x7f98d409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.310+0000 7f98d9dce700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f98d4131f40 0x7f98d4139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.310+0000 7f98d9dce700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d409c970 con 0x7f98d409f180 2023-09-30T22:24:29.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.310+0000 7f98d9dce700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d40a0920 con 0x7f98d4131f40 2023-09-30T22:24:29.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.310+0000 7f98d9dce700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d409f9c0 con 0x7f98d409e870 2023-09-30T22:24:29.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.310+0000 7f98d3fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f98d4131f40 0x7f98d4139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.310+0000 7f98d37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98d409e870 0x7f98d409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.310+0000 7f98d3fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f98d4131f40 0x7f98d4139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49824/0 (socket says 172.21.15.156:49824) 2023-09-30T22:24:29.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.310+0000 7f98d3fff700 1 -- 172.21.15.156:0/2439220468 learned_addr learned my addr 172.21.15.156:0/2439220468 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:29.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.310+0000 7f98d2ffd700 1 --1- 172.21.15.156:0/2439220468 >> v1:172.21.15.156:6789/0 conn(0x7f98d409f180 0x7f98d4131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:57772/0 (socket says 172.21.15.156:57772) 2023-09-30T22:24:29.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.310+0000 7f98d37fe700 1 -- 172.21.15.156:0/2439220468 >> v2:172.21.15.156:3300/0 conn(0x7f98d4131f40 msgr2=0x7f98d4139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:29.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.310+0000 7f98d37fe700 1 --2- 172.21.15.156:0/2439220468 >> v2:172.21.15.156:3300/0 conn(0x7f98d4131f40 0x7f98d4139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.310+0000 7f98d37fe700 1 -- 172.21.15.156:0/2439220468 >> v1:172.21.15.156:6789/0 conn(0x7f98d409f180 legacy=0x7f98d4131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.310+0000 7f98d37fe700 1 -- 172.21.15.156:0/2439220468 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d409bab0 con 0x7f98d409e870 2023-09-30T22:24:29.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.310+0000 7f98d27fc700 1 -- 172.21.15.156:0/2439220468 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 841957340 0 0) 0x7f98d409c970 con 0x7f98d409f180 2023-09-30T22:24:29.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.310+0000 7f98d3fff700 1 --2- 172.21.15.156:0/2439220468 >> v2:172.21.15.156:3300/0 conn(0x7f98d4131f40 0x7f98d4139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:29.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.310+0000 7f98d37fe700 1 --2- 172.21.15.156:0/2439220468 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98d409e870 0x7f98d409ec40 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009840 tx=0x7f98c8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65ff3e0798877589 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:29.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.310+0000 7f98d27fc700 1 -- 172.21.15.156:0/2439220468 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c8011830 con 0x7f98d409e870 2023-09-30T22:24:29.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.310+0000 7f98d27fc700 1 -- 172.21.15.156:0/2439220468 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c8011990 con 0x7f98d409e870 2023-09-30T22:24:29.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.310+0000 7f98d27fc700 1 -- 172.21.15.156:0/2439220468 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c8011d20 con 0x7f98d409e870 2023-09-30T22:24:29.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.311+0000 7f98d9dce700 1 -- 172.21.15.156:0/2439220468 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98d409e870 msgr2=0x7f98d409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.311+0000 7f98d9dce700 1 --2- 172.21.15.156:0/2439220468 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98d409e870 0x7f98d409ec40 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009840 tx=0x7f98c8009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:29.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.311+0000 7f98d9dce700 1 -- 172.21.15.156:0/2439220468 shutdown_connections 2023-09-30T22:24:29.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.311+0000 7f98d9dce700 1 --2- 172.21.15.156:0/2439220468 >> v2:172.21.15.156:3300/0 conn(0x7f98d4131f40 0x7f98d4139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.311+0000 7f98d9dce700 1 --2- 172.21.15.156:0/2439220468 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98d409e870 0x7f98d409ec40 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.311+0000 7f98d9dce700 1 -- 172.21.15.156:0/2439220468 >> 172.21.15.156:0/2439220468 conn(0x7f98d40a4430 msgr2=0x7f98d40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:29.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.311+0000 7f98d9dce700 1 -- 172.21.15.156:0/2439220468 shutdown_connections 2023-09-30T22:24:29.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.311+0000 7f98d9dce700 1 -- 172.21.15.156:0/2439220468 wait complete. 2023-09-30T22:24:29.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.312+0000 7f98d9dce700 1 Processor -- start 2023-09-30T22:24:29.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.312+0000 7f98d9dce700 1 -- start start 2023-09-30T22:24:29.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.312+0000 7f98d9dce700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98d409e870 0x7f98d41c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.312+0000 7f98d9dce700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98d409f180 0x7f98d41c6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.312+0000 7f98d9dce700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98d4131f40 0x7f98d41c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.312+0000 7f98d9dce700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d411e6e0 con 0x7f98d409e870 2023-09-30T22:24:29.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.312+0000 7f98d9dce700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d411e4f0 con 0x7f98d409f180 2023-09-30T22:24:29.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.312+0000 7f98d9dce700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98d409dba0 con 0x7f98d4131f40 2023-09-30T22:24:29.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.313+0000 7f98d37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98d409e870 0x7f98d41c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.313+0000 7f98d2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98d409f180 0x7f98d41c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.313+0000 7f98d3fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98d4131f40 0x7f98d41c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.313+0000 7f98d37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98d409e870 0x7f98d41c6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49830/0 (socket says 172.21.15.156:49830) 2023-09-30T22:24:29.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.313+0000 7f98d37fe700 1 -- 172.21.15.156:0/4249816652 learned_addr learned my addr 172.21.15.156:0/4249816652 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:29.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.313+0000 7f98d3fff700 1 -- 172.21.15.156:0/4249816652 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98d409f180 msgr2=0x7f98d41c6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.313+0000 7f98d3fff700 1 --2- 172.21.15.156:0/4249816652 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98d409f180 0x7f98d41c6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.313+0000 7f98d3fff700 1 -- 172.21.15.156:0/4249816652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98d409e870 msgr2=0x7f98d41c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.313+0000 7f98d3fff700 1 --2- 172.21.15.156:0/4249816652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98d409e870 0x7f98d41c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.313+0000 7f98d3fff700 1 -- 172.21.15.156:0/4249816652 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98cc009b30 con 0x7f98d4131f40 2023-09-30T22:24:29.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.313+0000 7f98d37fe700 1 --2- 172.21.15.156:0/4249816652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98d409e870 0x7f98d41c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:29.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.313+0000 7f98d3fff700 1 --2- 172.21.15.156:0/4249816652 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98d4131f40 0x7f98d41c6b80 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f98cc00b360 tx=0x7f98cc00b670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:29.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.313+0000 7f98bbfff700 1 -- 172.21.15.156:0/4249816652 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc015070 con 0x7f98d4131f40 2023-09-30T22:24:29.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.313+0000 7f98bbfff700 1 -- 172.21.15.156:0/4249816652 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98cc00bb90 con 0x7f98d4131f40 2023-09-30T22:24:29.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.313+0000 7f98d9dce700 1 -- 172.21.15.156:0/4249816652 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c80094a0 con 0x7f98d4131f40 2023-09-30T22:24:29.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.313+0000 7f98bbfff700 1 -- 172.21.15.156:0/4249816652 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc003a20 con 0x7f98d4131f40 2023-09-30T22:24:29.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.313+0000 7f98d9dce700 1 -- 172.21.15.156:0/4249816652 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d4131830 con 0x7f98d4131f40 2023-09-30T22:24:29.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.314+0000 7f98bbfff700 1 -- 172.21.15.156:0/4249816652 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f98cc019410 con 0x7f98d4131f40 2023-09-30T22:24:29.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.314+0000 7f98bbfff700 1 -- 172.21.15.156:0/4249816652 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f98cc043580 con 0x7f98d4131f40 2023-09-30T22:24:29.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.314+0000 7f98d9dce700 1 -- 172.21.15.156:0/4249816652 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d411fdc0 con 0x7f98d4131f40 2023-09-30T22:24:29.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.319+0000 7f98bbfff700 1 -- 172.21.15.156:0/4249816652 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f98cc018960 con 0x7f98d4131f40 2023-09-30T22:24:29.323 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:29.362 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:29.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.449+0000 7f632e3d4700 1 Processor -- start 2023-09-30T22:24:29.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.449+0000 7f632e3d4700 1 -- start start 2023-09-30T22:24:29.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.449+0000 7f632e3d4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f63280a0a70 0x7f63280a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.449+0000 7f632e3d4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63280a1380 0x7f6328133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.449+0000 7f632e3d4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6328133f50 0x7f63281343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.449+0000 7f632e3d4700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f632809e9d0 con 0x7f6328133f50 2023-09-30T22:24:29.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.449+0000 7f632e3d4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632809dc00 con 0x7f63280a1380 2023-09-30T22:24:29.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.449+0000 7f632e3d4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f632809dec0 con 0x7f63280a0a70 2023-09-30T22:24:29.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.449+0000 7f632c971700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6328133f50 0x7f63281343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.449+0000 7f6327fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f63280a0a70 0x7f63280a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.449+0000 7f632c971700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6328133f50 0x7f63281343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49832/0 (socket says 172.21.15.156:49832) 2023-09-30T22:24:29.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.449+0000 7f6327fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f63280a0a70 0x7f63280a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:58714/0 (socket says 172.21.15.156:58714) 2023-09-30T22:24:29.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.449+0000 7f632c971700 1 -- 172.21.15.156:0/1319605753 learned_addr learned my addr 172.21.15.156:0/1319605753 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:29.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.449+0000 7f63277fe700 1 --2- 172.21.15.156:0/1319605753 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63280a1380 0x7f6328133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.450+0000 7f63277fe700 1 -- 172.21.15.156:0/1319605753 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f63280a0a70 msgr2=0x7f63280a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:29.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.450+0000 7f63277fe700 1 --2- 172.21.15.156:0/1319605753 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f63280a0a70 0x7f63280a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.450+0000 7f63277fe700 1 -- 172.21.15.156:0/1319605753 >> v2:172.21.15.156:3300/0 conn(0x7f6328133f50 msgr2=0x7f63281343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:29.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.450+0000 7f63277fe700 1 --2- 172.21.15.156:0/1319605753 >> v2:172.21.15.156:3300/0 conn(0x7f6328133f50 0x7f63281343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.450+0000 7f63277fe700 1 -- 172.21.15.156:0/1319605753 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632809e6a0 con 0x7f63280a1380 2023-09-30T22:24:29.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.450+0000 7f63277fe700 1 --2- 172.21.15.156:0/1319605753 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63280a1380 0x7f6328133a10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f631c009840 tx=0x7f631c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64436d577c7310e2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:29.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.450+0000 7f6326ffd700 1 -- 172.21.15.156:0/1319605753 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c011830 con 0x7f63280a1380 2023-09-30T22:24:29.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.450+0000 7f6326ffd700 1 -- 172.21.15.156:0/1319605753 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631c011990 con 0x7f63280a1380 2023-09-30T22:24:29.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.450+0000 7f6326ffd700 1 -- 172.21.15.156:0/1319605753 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c011d20 con 0x7f63280a1380 2023-09-30T22:24:29.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.451+0000 7f632e3d4700 1 -- 172.21.15.156:0/1319605753 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63280a1380 msgr2=0x7f6328133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.451+0000 7f632e3d4700 1 --2- 172.21.15.156:0/1319605753 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63280a1380 0x7f6328133a10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f631c009840 tx=0x7f631c009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:29.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.451+0000 7f632e3d4700 1 -- 172.21.15.156:0/1319605753 shutdown_connections 2023-09-30T22:24:29.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.451+0000 7f632e3d4700 1 --2- 172.21.15.156:0/1319605753 >> v2:172.21.15.156:3300/0 conn(0x7f6328133f50 0x7f63281343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.451+0000 7f632e3d4700 1 --2- 172.21.15.156:0/1319605753 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f63280a0a70 0x7f63280a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.451+0000 7f632e3d4700 1 --2- 172.21.15.156:0/1319605753 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63280a1380 0x7f6328133a10 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.451+0000 7f632e3d4700 1 -- 172.21.15.156:0/1319605753 >> 172.21.15.156:0/1319605753 conn(0x7f63280a6610 msgr2=0x7f63280a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:29.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.451+0000 7f632e3d4700 1 -- 172.21.15.156:0/1319605753 shutdown_connections 2023-09-30T22:24:29.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.451+0000 7f632e3d4700 1 -- 172.21.15.156:0/1319605753 wait complete. 2023-09-30T22:24:29.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.452+0000 7f632e3d4700 1 Processor -- start 2023-09-30T22:24:29.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.452+0000 7f632e3d4700 1 -- start start 2023-09-30T22:24:29.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.452+0000 7f632e3d4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63280a0a70 0x7f6328122620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.452+0000 7f632e3d4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63280a1380 0x7f6328122b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.452+0000 7f632e3d4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6328133f50 0x7f63281230a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.452+0000 7f632e3d4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6328125ba0 con 0x7f63280a0a70 2023-09-30T22:24:29.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.452+0000 7f632e3d4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6328125f40 con 0x7f63280a1380 2023-09-30T22:24:29.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.452+0000 7f632e3d4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6328123a80 con 0x7f6328133f50 2023-09-30T22:24:29.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.452+0000 7f63277fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63280a1380 0x7f6328122b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.452+0000 7f6327fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63280a0a70 0x7f6328122620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.452+0000 7f63277fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63280a1380 0x7f6328122b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48014/0 (socket says 172.21.15.156:48014) 2023-09-30T22:24:29.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.452+0000 7f63277fe700 1 -- 172.21.15.156:0/1309817318 learned_addr learned my addr 172.21.15.156:0/1309817318 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:29.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.452+0000 7f632c971700 1 --2- 172.21.15.156:0/1309817318 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6328133f50 0x7f63281230a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.453+0000 7f63277fe700 1 -- 172.21.15.156:0/1309817318 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6328133f50 msgr2=0x7f63281230a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.453+0000 7f63277fe700 1 --2- 172.21.15.156:0/1309817318 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6328133f50 0x7f63281230a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.453+0000 7f63277fe700 1 -- 172.21.15.156:0/1309817318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63280a0a70 msgr2=0x7f6328122620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.453+0000 7f63277fe700 1 --2- 172.21.15.156:0/1309817318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63280a0a70 0x7f6328122620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.453+0000 7f63277fe700 1 -- 172.21.15.156:0/1309817318 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631c0094a0 con 0x7f63280a1380 2023-09-30T22:24:29.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.453+0000 7f632c971700 1 --2- 172.21.15.156:0/1309817318 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6328133f50 0x7f63281230a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:29.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.453+0000 7f6327fff700 1 --2- 172.21.15.156:0/1309817318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63280a0a70 0x7f6328122620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:29.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.453+0000 7f63277fe700 1 --2- 172.21.15.156:0/1309817318 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63280a1380 0x7f6328122b60 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f631c0090b0 tx=0x7f631c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:29.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.453+0000 7f6324ff9700 1 -- 172.21.15.156:0/1309817318 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c004450 con 0x7f63280a1380 2023-09-30T22:24:29.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.453+0000 7f6324ff9700 1 -- 172.21.15.156:0/1309817318 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631c01f070 con 0x7f63280a1380 2023-09-30T22:24:29.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.453+0000 7f632e3d4700 1 -- 172.21.15.156:0/1309817318 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6328126140 con 0x7f63280a1380 2023-09-30T22:24:29.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.453+0000 7f6324ff9700 1 -- 172.21.15.156:0/1309817318 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c0038e0 con 0x7f63280a1380 2023-09-30T22:24:29.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.453+0000 7f632e3d4700 1 -- 172.21.15.156:0/1309817318 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63280a03e0 con 0x7f63280a1380 2023-09-30T22:24:29.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.454+0000 7f632e3d4700 1 -- 172.21.15.156:0/1309817318 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f632804f2a0 con 0x7f63280a1380 2023-09-30T22:24:29.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.455+0000 7f6324ff9700 1 -- 172.21.15.156:0/1309817318 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f631c003a40 con 0x7f63280a1380 2023-09-30T22:24:29.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.455+0000 7f6324ff9700 1 -- 172.21.15.156:0/1309817318 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f631c021070 con 0x7f63280a1380 2023-09-30T22:24:29.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.459+0000 7f6324ff9700 1 -- 172.21.15.156:0/1309817318 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f631c0193b0 con 0x7f63280a1380 2023-09-30T22:24:29.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.492+0000 7f50de110700 1 Processor -- start 2023-09-30T22:24:29.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.492+0000 7f50de110700 1 -- start start 2023-09-30T22:24:29.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.492+0000 7f50de110700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50d80a0a70 0x7f50d80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.492+0000 7f50de110700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f50d80a1380 0x7f50d8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.492+0000 7f50de110700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d809dc00 con 0x7f50d8133f50 2023-09-30T22:24:29.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.492+0000 7f50de110700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50d809ea60 con 0x7f50d80a1380 2023-09-30T22:24:29.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.492+0000 7f50de110700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d809dec0 con 0x7f50d80a0a70 2023-09-30T22:24:29.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.492+0000 7f50d77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50d80a0a70 0x7f50d80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.492+0000 7f50d6ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f50d80a1380 0x7f50d8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.492+0000 7f50d77fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50d80a0a70 0x7f50d80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48026/0 (socket says 172.21.15.156:48026) 2023-09-30T22:24:29.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.492+0000 7f50d77fe700 1 -- 172.21.15.156:0/1582316001 learned_addr learned my addr 172.21.15.156:0/1582316001 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:29.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.493+0000 7f50d77fe700 1 -- 172.21.15.156:0/1582316001 >> v2:172.21.15.156:3300/0 conn(0x7f50d80a1380 msgr2=0x7f50d8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:29.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.493+0000 7f50d77fe700 1 --2- 172.21.15.156:0/1582316001 >> v2:172.21.15.156:3300/0 conn(0x7f50d80a1380 0x7f50d8133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.493+0000 7f50d77fe700 1 -- 172.21.15.156:0/1582316001 >> v1:172.21.15.156:6789/0 conn(0x7f50d8133f50 legacy=0x7f50d813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.493+0000 7f50d77fe700 1 -- 172.21.15.156:0/1582316001 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d809e6a0 con 0x7f50d80a0a70 2023-09-30T22:24:29.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.493+0000 7f50d67fc700 1 -- 172.21.15.156:0/1582316001 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497184741 0 0) 0x7f50d809dc00 con 0x7f50d8133f50 2023-09-30T22:24:29.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.493+0000 7f50d6ffd700 1 --2- 172.21.15.156:0/1582316001 >> v2:172.21.15.156:3300/0 conn(0x7f50d80a1380 0x7f50d8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:29.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.493+0000 7f50d77fe700 1 --2- 172.21.15.156:0/1582316001 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50d80a0a70 0x7f50d80a0e40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f50c80098f0 tx=0x7f50c8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ac7da3e02753a3b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:29.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.493+0000 7f50d67fc700 1 -- 172.21.15.156:0/1582316001 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c8011830 con 0x7f50d80a0a70 2023-09-30T22:24:29.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.493+0000 7f50d67fc700 1 -- 172.21.15.156:0/1582316001 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c8011990 con 0x7f50d80a0a70 2023-09-30T22:24:29.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.493+0000 7f50d67fc700 1 -- 172.21.15.156:0/1582316001 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c8011d20 con 0x7f50d80a0a70 2023-09-30T22:24:29.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.494+0000 7f50de110700 1 -- 172.21.15.156:0/1582316001 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50d80a0a70 msgr2=0x7f50d80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.494+0000 7f50de110700 1 --2- 172.21.15.156:0/1582316001 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50d80a0a70 0x7f50d80a0e40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f50c80098f0 tx=0x7f50c8009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:29.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.494+0000 7f50de110700 1 -- 172.21.15.156:0/1582316001 shutdown_connections 2023-09-30T22:24:29.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.494+0000 7f50de110700 1 --2- 172.21.15.156:0/1582316001 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50d80a0a70 0x7f50d80a0e40 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.494+0000 7f50de110700 1 --2- 172.21.15.156:0/1582316001 >> v2:172.21.15.156:3300/0 conn(0x7f50d80a1380 0x7f50d8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.494+0000 7f50de110700 1 -- 172.21.15.156:0/1582316001 >> 172.21.15.156:0/1582316001 conn(0x7f50d80a6610 msgr2=0x7f50d80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:29.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.494+0000 7f50de110700 1 -- 172.21.15.156:0/1582316001 shutdown_connections 2023-09-30T22:24:29.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.494+0000 7f50de110700 1 -- 172.21.15.156:0/1582316001 wait complete. 2023-09-30T22:24:29.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.495+0000 7f50de110700 1 Processor -- start 2023-09-30T22:24:29.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.495+0000 7f50de110700 1 -- start start 2023-09-30T22:24:29.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.495+0000 7f50de110700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50d80a0a70 0x7f50d8122820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.495+0000 7f50de110700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50d80a1380 0x7f50d8122d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.495+0000 7f50de110700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50d8133f50 0x7f50d81232a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.495+0000 7f50de110700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d8126140 con 0x7f50d8133f50 2023-09-30T22:24:29.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.495+0000 7f50de110700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d81244d0 con 0x7f50d80a0a70 2023-09-30T22:24:29.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.495+0000 7f50de110700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50d8126340 con 0x7f50d80a1380 2023-09-30T22:24:29.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.495+0000 7f50d6ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50d80a1380 0x7f50d8122d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.495+0000 7f50d7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50d8133f50 0x7f50d81232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.495+0000 7f50d6ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50d80a1380 0x7f50d8122d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:58738/0 (socket says 172.21.15.156:58738) 2023-09-30T22:24:29.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.495+0000 7f50d7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50d8133f50 0x7f50d81232a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49872/0 (socket says 172.21.15.156:49872) 2023-09-30T22:24:29.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.495+0000 7f50d6ffd700 1 -- 172.21.15.156:0/1074400499 learned_addr learned my addr 172.21.15.156:0/1074400499 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:29.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.495+0000 7f50d77fe700 1 --2- 172.21.15.156:0/1074400499 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50d80a0a70 0x7f50d8122820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.496+0000 7f50d7fff700 1 -- 172.21.15.156:0/1074400499 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50d80a1380 msgr2=0x7f50d8122d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.496+0000 7f50d7fff700 1 --2- 172.21.15.156:0/1074400499 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50d80a1380 0x7f50d8122d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.496+0000 7f50d7fff700 1 -- 172.21.15.156:0/1074400499 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50d80a0a70 msgr2=0x7f50d8122820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.496+0000 7f50d7fff700 1 --2- 172.21.15.156:0/1074400499 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50d80a0a70 0x7f50d8122820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.496+0000 7f50d7fff700 1 -- 172.21.15.156:0/1074400499 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50cc0094a0 con 0x7f50d8133f50 2023-09-30T22:24:29.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.496+0000 7f50d7fff700 1 --2- 172.21.15.156:0/1074400499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50d8133f50 0x7f50d81232a0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f50d000c7f0 tx=0x7f50d000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:29.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.496+0000 7f50bffff700 1 -- 172.21.15.156:0/1074400499 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d0003e30 con 0x7f50d8133f50 2023-09-30T22:24:29.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.496+0000 7f50bffff700 1 -- 172.21.15.156:0/1074400499 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d0005070 con 0x7f50d8133f50 2023-09-30T22:24:29.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.496+0000 7f50bffff700 1 -- 172.21.15.156:0/1074400499 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d0005420 con 0x7f50d8133f50 2023-09-30T22:24:29.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.496+0000 7f50de110700 1 -- 172.21.15.156:0/1074400499 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c8009550 con 0x7f50d8133f50 2023-09-30T22:24:29.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.496+0000 7f50de110700 1 -- 172.21.15.156:0/1074400499 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d8125da0 con 0x7f50d8133f50 2023-09-30T22:24:29.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.497+0000 7f50bffff700 1 -- 172.21.15.156:0/1074400499 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f50d0005580 con 0x7f50d8133f50 2023-09-30T22:24:29.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.497+0000 7f50bffff700 1 -- 172.21.15.156:0/1074400499 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f50d003ecc0 con 0x7f50d8133f50 2023-09-30T22:24:29.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.497+0000 7f50de110700 1 -- 172.21.15.156:0/1074400499 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d804f2a0 con 0x7f50d8133f50 2023-09-30T22:24:29.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.502+0000 7f50bffff700 1 -- 172.21.15.156:0/1074400499 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f50d0017070 con 0x7f50d8133f50 2023-09-30T22:24:29.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.549+0000 7f98d9dce700 1 -- 172.21.15.156:0/4249816652 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f98d404f2a0 con 0x7f98d4131f40 2023-09-30T22:24:29.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.550+0000 7f98bbfff700 1 -- 172.21.15.156:0/4249816652 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f98cc018370 con 0x7f98d4131f40 2023-09-30T22:24:29.553 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:29.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.552+0000 7f98d9dce700 1 -- 172.21.15.156:0/4249816652 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98d4131f40 msgr2=0x7f98d41c6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.552+0000 7f98d9dce700 1 --2- 172.21.15.156:0/4249816652 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98d4131f40 0x7f98d41c6b80 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f98cc00b360 tx=0x7f98cc00b670 comp rx=0 tx=0).stop 2023-09-30T22:24:29.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.552+0000 7f98d9dce700 1 -- 172.21.15.156:0/4249816652 shutdown_connections 2023-09-30T22:24:29.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.552+0000 7f98d9dce700 1 --2- 172.21.15.156:0/4249816652 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98d4131f40 0x7f98d41c6b80 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.552+0000 7f98d9dce700 1 --2- 172.21.15.156:0/4249816652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98d409e870 0x7f98d41c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.552+0000 7f98d9dce700 1 --2- 172.21.15.156:0/4249816652 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98d409f180 0x7f98d41c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.552+0000 7f98d9dce700 1 -- 172.21.15.156:0/4249816652 >> 172.21.15.156:0/4249816652 conn(0x7f98d40a4430 msgr2=0x7f98d409c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:29.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.552+0000 7f98d9dce700 1 -- 172.21.15.156:0/4249816652 shutdown_connections 2023-09-30T22:24:29.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.552+0000 7f98d9dce700 1 -- 172.21.15.156:0/4249816652 wait complete. 2023-09-30T22:24:29.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:29.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.684+0000 7f632e3d4700 1 -- 172.21.15.156:0/1309817318 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f63280a4c20 con 0x7f63280a1380 2023-09-30T22:24:29.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.684+0000 7f6324ff9700 1 -- 172.21.15.156:0/1309817318 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f631c015030 con 0x7f63280a1380 2023-09-30T22:24:29.685 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:29.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.686+0000 7f632e3d4700 1 -- 172.21.15.156:0/1309817318 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63280a1380 msgr2=0x7f6328122b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.686+0000 7f632e3d4700 1 --2- 172.21.15.156:0/1309817318 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63280a1380 0x7f6328122b60 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f631c0090b0 tx=0x7f631c004750 comp rx=0 tx=0).stop 2023-09-30T22:24:29.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.686+0000 7f632e3d4700 1 -- 172.21.15.156:0/1309817318 shutdown_connections 2023-09-30T22:24:29.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.686+0000 7f632e3d4700 1 --2- 172.21.15.156:0/1309817318 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6328133f50 0x7f63281230a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.686+0000 7f632e3d4700 1 --2- 172.21.15.156:0/1309817318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63280a0a70 0x7f6328122620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.686+0000 7f632e3d4700 1 --2- 172.21.15.156:0/1309817318 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63280a1380 0x7f6328122b60 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.686+0000 7f632e3d4700 1 -- 172.21.15.156:0/1309817318 >> 172.21.15.156:0/1309817318 conn(0x7f63280a6610 msgr2=0x7f632809ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:29.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.686+0000 7f632e3d4700 1 -- 172.21.15.156:0/1309817318 shutdown_connections 2023-09-30T22:24:29.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.686+0000 7f632e3d4700 1 -- 172.21.15.156:0/1309817318 wait complete. 2023-09-30T22:24:29.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.697+0000 7f50de110700 1 -- 172.21.15.156:0/1074400499 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f50d81339b0 con 0x7f50d8133f50 2023-09-30T22:24:29.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.697+0000 7f50bffff700 1 -- 172.21.15.156:0/1074400499 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f50d0019910 con 0x7f50d8133f50 2023-09-30T22:24:29.698 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:29.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:29.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.700+0000 7f50de110700 1 -- 172.21.15.156:0/1074400499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50d8133f50 msgr2=0x7f50d81232a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.700+0000 7f50de110700 1 --2- 172.21.15.156:0/1074400499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50d8133f50 0x7f50d81232a0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f50d000c7f0 tx=0x7f50d000cb00 comp rx=0 tx=0).stop 2023-09-30T22:24:29.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.700+0000 7f50de110700 1 -- 172.21.15.156:0/1074400499 shutdown_connections 2023-09-30T22:24:29.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.700+0000 7f50de110700 1 --2- 172.21.15.156:0/1074400499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50d8133f50 0x7f50d81232a0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.700+0000 7f50de110700 1 --2- 172.21.15.156:0/1074400499 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f50d80a0a70 0x7f50d8122820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.700+0000 7f50de110700 1 --2- 172.21.15.156:0/1074400499 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f50d80a1380 0x7f50d8122d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.700+0000 7f50de110700 1 -- 172.21.15.156:0/1074400499 >> 172.21.15.156:0/1074400499 conn(0x7f50d80a6610 msgr2=0x7f50d80a4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:29.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.700+0000 7f50de110700 1 -- 172.21.15.156:0/1074400499 shutdown_connections 2023-09-30T22:24:29.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.700+0000 7f50de110700 1 -- 172.21.15.156:0/1074400499 wait complete. 2023-09-30T22:24:29.712 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:29.747 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:29.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.874+0000 7febe8d6a700 1 Processor -- start 2023-09-30T22:24:29.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.874+0000 7febe8d6a700 1 -- start start 2023-09-30T22:24:29.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.874+0000 7febe8d6a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febe4133ad0 0x7febe4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.874+0000 7febe8d6a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febe41300a0 0x7febe41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.874+0000 7febe8d6a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7febe41309f0 0x7febe413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.874+0000 7febe8d6a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe406b2d0 con 0x7febe41309f0 2023-09-30T22:24:29.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.874+0000 7febe8d6a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe4133610 con 0x7febe41300a0 2023-09-30T22:24:29.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.874+0000 7febe8d6a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febe409a500 con 0x7febe4133ad0 2023-09-30T22:24:29.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.874+0000 7febe1d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febe41300a0 0x7febe41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.874+0000 7febe259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febe4133ad0 0x7febe4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.874+0000 7febe2d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7febe41309f0 0x7febe413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.874+0000 7febe1d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febe41300a0 0x7febe41304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48034/0 (socket says 172.21.15.156:48034) 2023-09-30T22:24:29.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.874+0000 7febe1d9b700 1 -- 172.21.15.156:0/555351585 learned_addr learned my addr 172.21.15.156:0/555351585 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:29.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.875+0000 7febe2d9d700 1 -- 172.21.15.156:0/555351585 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febe4133ad0 msgr2=0x7febe4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:29.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.875+0000 7febe2d9d700 1 --2- 172.21.15.156:0/555351585 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febe4133ad0 0x7febe4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.875+0000 7febe2d9d700 1 -- 172.21.15.156:0/555351585 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febe41300a0 msgr2=0x7febe41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:29.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.875+0000 7febe2d9d700 1 --2- 172.21.15.156:0/555351585 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febe41300a0 0x7febe41304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.875+0000 7febe2d9d700 1 -- 172.21.15.156:0/555351585 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe41338b0 con 0x7febe41309f0 2023-09-30T22:24:29.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.875+0000 7febe1d9b700 1 --2- 172.21.15.156:0/555351585 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febe41300a0 0x7febe41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:29.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.875+0000 7febe2d9d700 1 --2- 172.21.15.156:0/555351585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febe41309f0 0x7febe413a980 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7febdc009d90 tx=0x7febdc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca7d652e3309297d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:29.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.875+0000 7febe159a700 1 -- 172.21.15.156:0/555351585 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc00e070 con 0x7febe41309f0 2023-09-30T22:24:29.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.875+0000 7febe159a700 1 -- 172.21.15.156:0/555351585 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febdc00bb20 con 0x7febe41309f0 2023-09-30T22:24:29.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.875+0000 7febe159a700 1 -- 172.21.15.156:0/555351585 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc012430 con 0x7febe41309f0 2023-09-30T22:24:29.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.876+0000 7febe8d6a700 1 -- 172.21.15.156:0/555351585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febe41309f0 msgr2=0x7febe413a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.876+0000 7febe8d6a700 1 --2- 172.21.15.156:0/555351585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febe41309f0 0x7febe413a980 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7febdc009d90 tx=0x7febdc00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:29.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.876+0000 7febe8d6a700 1 -- 172.21.15.156:0/555351585 shutdown_connections 2023-09-30T22:24:29.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.876+0000 7febe8d6a700 1 --2- 172.21.15.156:0/555351585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febe41309f0 0x7febe413a980 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.876+0000 7febe8d6a700 1 --2- 172.21.15.156:0/555351585 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febe4133ad0 0x7febe4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.876+0000 7febe8d6a700 1 --2- 172.21.15.156:0/555351585 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febe41300a0 0x7febe41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.876+0000 7febe8d6a700 1 -- 172.21.15.156:0/555351585 >> 172.21.15.156:0/555351585 conn(0x7febe4099c40 msgr2=0x7febe40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:29.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.876+0000 7febe8d6a700 1 -- 172.21.15.156:0/555351585 shutdown_connections 2023-09-30T22:24:29.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.876+0000 7febe8d6a700 1 -- 172.21.15.156:0/555351585 wait complete. 2023-09-30T22:24:29.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.877+0000 7febe8d6a700 1 Processor -- start 2023-09-30T22:24:29.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.877+0000 7febe8d6a700 1 -- start start 2023-09-30T22:24:29.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.877+0000 7febe8d6a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febe41300a0 0x7febe411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.877+0000 7febe8d6a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febe41309f0 0x7febe411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.877+0000 7febe8d6a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febe4133ad0 0x7febe411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.877+0000 7febe8d6a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe41200c0 con 0x7febe4133ad0 2023-09-30T22:24:29.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.877+0000 7febe8d6a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe411f040 con 0x7febe41309f0 2023-09-30T22:24:29.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.877+0000 7febe8d6a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febe411fb20 con 0x7febe41300a0 2023-09-30T22:24:29.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.877+0000 7febe259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febe41300a0 0x7febe411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.877+0000 7febe1d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febe41309f0 0x7febe411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.877+0000 7febe259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febe41300a0 0x7febe411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:58754/0 (socket says 172.21.15.156:58754) 2023-09-30T22:24:29.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.877+0000 7febe1d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febe41309f0 0x7febe411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48042/0 (socket says 172.21.15.156:48042) 2023-09-30T22:24:29.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.877+0000 7febe259c700 1 -- 172.21.15.156:0/2203769480 learned_addr learned my addr 172.21.15.156:0/2203769480 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:29.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.877+0000 7febe2d9d700 1 --2- 172.21.15.156:0/2203769480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febe4133ad0 0x7febe411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.878+0000 7febe259c700 1 -- 172.21.15.156:0/2203769480 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febe41309f0 msgr2=0x7febe411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.878+0000 7febe259c700 1 --2- 172.21.15.156:0/2203769480 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febe41309f0 0x7febe411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.878+0000 7febe259c700 1 -- 172.21.15.156:0/2203769480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febe4133ad0 msgr2=0x7febe411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.878+0000 7febe259c700 1 --2- 172.21.15.156:0/2203769480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febe4133ad0 0x7febe411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.878+0000 7febe259c700 1 -- 172.21.15.156:0/2203769480 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd8009550 con 0x7febe41300a0 2023-09-30T22:24:29.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.878+0000 7febe2d9d700 1 --2- 172.21.15.156:0/2203769480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febe4133ad0 0x7febe411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:29.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.878+0000 7febe259c700 1 --2- 172.21.15.156:0/2203769480 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febe41300a0 0x7febe411da40 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7febd400e9b0 tx=0x7febd400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:29.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.878+0000 7febd2ffd700 1 -- 172.21.15.156:0/2203769480 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4009710 con 0x7febe41300a0 2023-09-30T22:24:29.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.878+0000 7febd2ffd700 1 -- 172.21.15.156:0/2203769480 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd400ee50 con 0x7febe41300a0 2023-09-30T22:24:29.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.878+0000 7febe8d6a700 1 -- 172.21.15.156:0/2203769480 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febdc009a70 con 0x7febe41300a0 2023-09-30T22:24:29.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.878+0000 7febd2ffd700 1 -- 172.21.15.156:0/2203769480 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd400ca50 con 0x7febe41300a0 2023-09-30T22:24:29.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.878+0000 7febe8d6a700 1 -- 172.21.15.156:0/2203769480 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe412dd00 con 0x7febe41300a0 2023-09-30T22:24:29.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.879+0000 7febd2ffd700 1 -- 172.21.15.156:0/2203769480 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7febd400cbb0 con 0x7febe41300a0 2023-09-30T22:24:29.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.879+0000 7febd2ffd700 1 -- 172.21.15.156:0/2203769480 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7febd403f630 con 0x7febe41300a0 2023-09-30T22:24:29.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.879+0000 7febe8d6a700 1 -- 172.21.15.156:0/2203769480 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe404f2a0 con 0x7febe41300a0 2023-09-30T22:24:29.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:29.883+0000 7febd2ffd700 1 -- 172.21.15.156:0/2203769480 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7febd4013470 con 0x7febe41300a0 2023-09-30T22:24:30.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.069+0000 7febe8d6a700 1 -- 172.21.15.156:0/2203769480 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7febe412d970 con 0x7febe41300a0 2023-09-30T22:24:30.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.069+0000 7febd2ffd700 1 -- 172.21.15.156:0/2203769480 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7febd4021030 con 0x7febe41300a0 2023-09-30T22:24:30.070 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:30.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.072+0000 7febe8d6a700 1 -- 172.21.15.156:0/2203769480 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febe41300a0 msgr2=0x7febe411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.072+0000 7febe8d6a700 1 --2- 172.21.15.156:0/2203769480 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febe41300a0 0x7febe411da40 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7febd400e9b0 tx=0x7febd400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.072+0000 7febe8d6a700 1 -- 172.21.15.156:0/2203769480 shutdown_connections 2023-09-30T22:24:30.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.072+0000 7febe8d6a700 1 --2- 172.21.15.156:0/2203769480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febe4133ad0 0x7febe411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.072+0000 7febe8d6a700 1 --2- 172.21.15.156:0/2203769480 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7febe41300a0 0x7febe411da40 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.072+0000 7febe8d6a700 1 --2- 172.21.15.156:0/2203769480 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febe41309f0 0x7febe411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.072+0000 7febe8d6a700 1 -- 172.21.15.156:0/2203769480 >> 172.21.15.156:0/2203769480 conn(0x7febe4099c40 msgr2=0x7febe4131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:30.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.072+0000 7febe8d6a700 1 -- 172.21.15.156:0/2203769480 shutdown_connections 2023-09-30T22:24:30.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.072+0000 7febe8d6a700 1 -- 172.21.15.156:0/2203769480 wait complete. 2023-09-30T22:24:30.084 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:30.567 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:30.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.693+0000 7fc6b2d49700 1 Processor -- start 2023-09-30T22:24:30.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.693+0000 7fc6b2d49700 1 -- start start 2023-09-30T22:24:30.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.694+0000 7fc6b2d49700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6ac133900 0x7fc6ac133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.694+0000 7fc6b2d49700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc6ac0a10b0 0x7fc6ac13b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.694+0000 7fc6b2d49700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6ac09a760 con 0x7fc6ac134210 2023-09-30T22:24:30.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.694+0000 7fc6b2d49700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6ac1336e0 con 0x7fc6ac0a10b0 2023-09-30T22:24:30.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.694+0000 7fc6b2d49700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac09a080 con 0x7fc6ac133900 2023-09-30T22:24:30.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.694+0000 7fc6b0ae5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6ac133900 0x7fc6ac133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.694+0000 7fc6b12e6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc6ac0a10b0 0x7fc6ac13b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.694+0000 7fc6abfff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc6ac134210 0x7fc6ac0a09a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:57798/0 (socket says 172.21.15.156:57798) 2023-09-30T22:24:30.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.694+0000 7fc6abfff700 1 -- 172.21.15.156:0/1760072054 learned_addr learned my addr 172.21.15.156:0/1760072054 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:30.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.694+0000 7fc6b12e6700 1 -- 172.21.15.156:0/1760072054 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6ac133900 msgr2=0x7fc6ac133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:30.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.694+0000 7fc6b12e6700 1 --2- 172.21.15.156:0/1760072054 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6ac133900 0x7fc6ac133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.694+0000 7fc6b12e6700 1 -- 172.21.15.156:0/1760072054 >> v1:172.21.15.156:6789/0 conn(0x7fc6ac134210 legacy=0x7fc6ac0a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.694+0000 7fc6b12e6700 1 -- 172.21.15.156:0/1760072054 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ac0a23e0 con 0x7fc6ac0a10b0 2023-09-30T22:24:30.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.694+0000 7fc6ab7fe700 1 -- 172.21.15.156:0/1760072054 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1347191 0 0) 0x7fc6ac09a760 con 0x7fc6ac134210 2023-09-30T22:24:30.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.694+0000 7fc6b0ae5700 1 --2- 172.21.15.156:0/1760072054 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6ac133900 0x7fc6ac133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:30.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.694+0000 7fc6b12e6700 1 --2- 172.21.15.156:0/1760072054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6ac0a10b0 0x7fc6ac13b910 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4009d90 tx=0x7fc6a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4fd2f38e05d9ee9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:30.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.694+0000 7fc6ab7fe700 1 -- 172.21.15.156:0/1760072054 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a400e070 con 0x7fc6ac0a10b0 2023-09-30T22:24:30.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.694+0000 7fc6ab7fe700 1 -- 172.21.15.156:0/1760072054 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a400bb20 con 0x7fc6ac0a10b0 2023-09-30T22:24:30.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.694+0000 7fc6ab7fe700 1 -- 172.21.15.156:0/1760072054 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4012430 con 0x7fc6ac0a10b0 2023-09-30T22:24:30.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.695+0000 7fc6b2d49700 1 -- 172.21.15.156:0/1760072054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6ac0a10b0 msgr2=0x7fc6ac13b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.695+0000 7fc6b2d49700 1 --2- 172.21.15.156:0/1760072054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6ac0a10b0 0x7fc6ac13b910 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4009d90 tx=0x7fc6a400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:30.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.695+0000 7fc6b2d49700 1 -- 172.21.15.156:0/1760072054 shutdown_connections 2023-09-30T22:24:30.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.695+0000 7fc6b2d49700 1 --2- 172.21.15.156:0/1760072054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6ac0a10b0 0x7fc6ac13b910 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.695+0000 7fc6b2d49700 1 --2- 172.21.15.156:0/1760072054 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6ac133900 0x7fc6ac133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.695+0000 7fc6b2d49700 1 -- 172.21.15.156:0/1760072054 >> 172.21.15.156:0/1760072054 conn(0x7fc6ac0a2980 msgr2=0x7fc6ac0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:30.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.695+0000 7fc6b2d49700 1 -- 172.21.15.156:0/1760072054 shutdown_connections 2023-09-30T22:24:30.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.695+0000 7fc6b2d49700 1 -- 172.21.15.156:0/1760072054 wait complete. 2023-09-30T22:24:30.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.696+0000 7fc6b2d49700 1 Processor -- start 2023-09-30T22:24:30.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.696+0000 7fc6b2d49700 1 -- start start 2023-09-30T22:24:30.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.697+0000 7fc6b2d49700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6ac0a10b0 0x7fc6ac11d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.697+0000 7fc6b2d49700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6ac133900 0x7fc6ac11dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.697+0000 7fc6b2d49700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc6ac134210 0x7fc6ac11e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.697+0000 7fc6b2d49700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac121be0 con 0x7fc6ac133900 2023-09-30T22:24:30.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.697+0000 7fc6b2d49700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac11f310 con 0x7fc6ac0a10b0 2023-09-30T22:24:30.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.697+0000 7fc6b2d49700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac120560 con 0x7fc6ac134210 2023-09-30T22:24:30.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.697+0000 7fc6b0ae5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6ac0a10b0 0x7fc6ac11d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.697+0000 7fc6b0ae5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6ac0a10b0 0x7fc6ac11d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48058/0 (socket says 172.21.15.156:48058) 2023-09-30T22:24:30.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.697+0000 7fc6b0ae5700 1 -- 172.21.15.156:0/4113530680 learned_addr learned my addr 172.21.15.156:0/4113530680 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:30.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.697+0000 7fc6b12e6700 1 --2- 172.21.15.156:0/4113530680 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc6ac134210 0x7fc6ac11e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.697+0000 7fc6abfff700 1 --2- 172.21.15.156:0/4113530680 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6ac133900 0x7fc6ac11dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.697+0000 7fc6b0ae5700 1 -- 172.21.15.156:0/4113530680 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc6ac134210 msgr2=0x7fc6ac11e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.697+0000 7fc6b0ae5700 1 --2- 172.21.15.156:0/4113530680 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc6ac134210 0x7fc6ac11e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.697+0000 7fc6b0ae5700 1 -- 172.21.15.156:0/4113530680 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6ac133900 msgr2=0x7fc6ac11dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.697+0000 7fc6b0ae5700 1 --2- 172.21.15.156:0/4113530680 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6ac133900 0x7fc6ac11dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.697+0000 7fc6b0ae5700 1 -- 172.21.15.156:0/4113530680 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a0009430 con 0x7fc6ac0a10b0 2023-09-30T22:24:30.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.698+0000 7fc6b0ae5700 1 --2- 172.21.15.156:0/4113530680 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6ac0a10b0 0x7fc6ac11d700 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000ec10 tx=0x7fc6a000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:30.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.698+0000 7fc6a97fa700 1 -- 172.21.15.156:0/4113530680 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0005a20 con 0x7fc6ac0a10b0 2023-09-30T22:24:30.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.698+0000 7fc6a97fa700 1 -- 172.21.15.156:0/4113530680 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a0005b80 con 0x7fc6ac0a10b0 2023-09-30T22:24:30.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.698+0000 7fc6a97fa700 1 -- 172.21.15.156:0/4113530680 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a000c850 con 0x7fc6ac0a10b0 2023-09-30T22:24:30.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.698+0000 7fc6b2d49700 1 -- 172.21.15.156:0/4113530680 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a4009a70 con 0x7fc6ac0a10b0 2023-09-30T22:24:30.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.698+0000 7fc6b2d49700 1 -- 172.21.15.156:0/4113530680 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ac132b60 con 0x7fc6ac0a10b0 2023-09-30T22:24:30.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.698+0000 7fc6a97fa700 1 -- 172.21.15.156:0/4113530680 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc6a000c9b0 con 0x7fc6ac0a10b0 2023-09-30T22:24:30.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.699+0000 7fc6a97fa700 1 -- 172.21.15.156:0/4113530680 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc6a003f950 con 0x7fc6ac0a10b0 2023-09-30T22:24:30.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.699+0000 7fc6b2d49700 1 -- 172.21.15.156:0/4113530680 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6ac09a320 con 0x7fc6ac0a10b0 2023-09-30T22:24:30.703 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:30.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.703+0000 7fc6a97fa700 1 -- 172.21.15.156:0/4113530680 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6a0006030 con 0x7fc6ac0a10b0 2023-09-30T22:24:30.713 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:30.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.830+0000 7fa94faf2700 1 Processor -- start 2023-09-30T22:24:30.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.830+0000 7fa94faf2700 1 -- start start 2023-09-30T22:24:30.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.831+0000 7fa94faf2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa94809e870 0x7fa94809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.831+0000 7fa94faf2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa948131f40 0x7fa948139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.831+0000 7fa94faf2700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa94809c970 con 0x7fa94809f180 2023-09-30T22:24:30.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.831+0000 7fa94faf2700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9480a0920 con 0x7fa94809e870 2023-09-30T22:24:30.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.831+0000 7fa94faf2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa94809f9c0 con 0x7fa948131f40 2023-09-30T22:24:30.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.831+0000 7fa94d88e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa94809e870 0x7fa94809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.831+0000 7fa94d88e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa94809e870 0x7fa94809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49926/0 (socket says 172.21.15.156:49926) 2023-09-30T22:24:30.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.831+0000 7fa94d08d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fa94809f180 0x7fa948131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:57810/0 (socket says 172.21.15.156:57810) 2023-09-30T22:24:30.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.831+0000 7fa94d88e700 1 -- 172.21.15.156:0/2490702493 learned_addr learned my addr 172.21.15.156:0/2490702493 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:30.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.831+0000 7fa94e08f700 1 --2- 172.21.15.156:0/2490702493 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa948131f40 0x7fa948139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.831+0000 7fa94c88c700 1 -- 172.21.15.156:0/2490702493 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130909178 0 0) 0x7fa94809c970 con 0x7fa94809f180 2023-09-30T22:24:30.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.831+0000 7fa94c88c700 1 -- 172.21.15.156:0/2490702493 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9340035b0 con 0x7fa94809f180 2023-09-30T22:24:30.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.831+0000 7fa94d88e700 1 -- 172.21.15.156:0/2490702493 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa948131f40 msgr2=0x7fa948139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:30.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.831+0000 7fa94d88e700 1 --2- 172.21.15.156:0/2490702493 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa948131f40 0x7fa948139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.831+0000 7fa94d88e700 1 -- 172.21.15.156:0/2490702493 >> v1:172.21.15.156:6789/0 conn(0x7fa94809f180 legacy=0x7fa948131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.831+0000 7fa94d88e700 1 -- 172.21.15.156:0/2490702493 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94809bab0 con 0x7fa94809e870 2023-09-30T22:24:30.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.832+0000 7fa94e08f700 1 --2- 172.21.15.156:0/2490702493 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa948131f40 0x7fa948139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:30.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.832+0000 7fa94d88e700 1 --2- 172.21.15.156:0/2490702493 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa94809e870 0x7fa94809ec40 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fa9440098f0 tx=0x7fa944009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a1a08eabe3b8b1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:30.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.832+0000 7fa94c88c700 1 -- 172.21.15.156:0/2490702493 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa944011830 con 0x7fa94809e870 2023-09-30T22:24:30.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.832+0000 7fa94c88c700 1 -- 172.21.15.156:0/2490702493 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa944011990 con 0x7fa94809e870 2023-09-30T22:24:30.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.832+0000 7fa94c88c700 1 -- 172.21.15.156:0/2490702493 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa944011d20 con 0x7fa94809e870 2023-09-30T22:24:30.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.832+0000 7fa94faf2700 1 -- 172.21.15.156:0/2490702493 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa94809e870 msgr2=0x7fa94809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.832+0000 7fa94faf2700 1 --2- 172.21.15.156:0/2490702493 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa94809e870 0x7fa94809ec40 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fa9440098f0 tx=0x7fa944009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:30.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.832+0000 7fa94faf2700 1 -- 172.21.15.156:0/2490702493 shutdown_connections 2023-09-30T22:24:30.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.832+0000 7fa94faf2700 1 --2- 172.21.15.156:0/2490702493 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa94809e870 0x7fa94809ec40 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.832+0000 7fa94faf2700 1 --2- 172.21.15.156:0/2490702493 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa948131f40 0x7fa948139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.832+0000 7fa94faf2700 1 -- 172.21.15.156:0/2490702493 >> 172.21.15.156:0/2490702493 conn(0x7fa9480a4430 msgr2=0x7fa9480a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:30.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.832+0000 7fa94faf2700 1 -- 172.21.15.156:0/2490702493 shutdown_connections 2023-09-30T22:24:30.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.833+0000 7fa94faf2700 1 -- 172.21.15.156:0/2490702493 wait complete. 2023-09-30T22:24:30.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.833+0000 7fa94faf2700 1 Processor -- start 2023-09-30T22:24:30.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.833+0000 7fa94faf2700 1 -- start start 2023-09-30T22:24:30.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.834+0000 7fa94faf2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa94809e870 0x7fa94811d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.834+0000 7fa94faf2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa94809f180 0x7fa94811d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.834+0000 7fa94faf2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa948131f40 0x7fa94811da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.834+0000 7fa94faf2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa948120350 con 0x7fa94809e870 2023-09-30T22:24:30.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.834+0000 7fa94faf2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa948120540 con 0x7fa948131f40 2023-09-30T22:24:30.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.834+0000 7fa94faf2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa94811ec70 con 0x7fa94809f180 2023-09-30T22:24:30.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.834+0000 7fa94e08f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa948131f40 0x7fa94811da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.834+0000 7fa94e08f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa948131f40 0x7fa94811da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48070/0 (socket says 172.21.15.156:48070) 2023-09-30T22:24:30.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.834+0000 7fa94d08d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa94809f180 0x7fa94811d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.834+0000 7fa94e08f700 1 -- 172.21.15.156:0/818529839 learned_addr learned my addr 172.21.15.156:0/818529839 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:30.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.834+0000 7fa94d88e700 1 --2- 172.21.15.156:0/818529839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa94809e870 0x7fa94811d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.834+0000 7fa94e08f700 1 -- 172.21.15.156:0/818529839 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa94809f180 msgr2=0x7fa94811d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.834+0000 7fa94e08f700 1 --2- 172.21.15.156:0/818529839 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa94809f180 0x7fa94811d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.834+0000 7fa94e08f700 1 -- 172.21.15.156:0/818529839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa94809e870 msgr2=0x7fa94811d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.834+0000 7fa94e08f700 1 --2- 172.21.15.156:0/818529839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa94809e870 0x7fa94811d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.834+0000 7fa94e08f700 1 -- 172.21.15.156:0/818529839 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa940009a70 con 0x7fa948131f40 2023-09-30T22:24:30.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.835+0000 7fa94e08f700 1 --2- 172.21.15.156:0/818529839 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa948131f40 0x7fa94811da90 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa940009f00 tx=0x7fa94000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:30.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.835+0000 7fa93e7fc700 1 -- 172.21.15.156:0/818529839 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa940009d70 con 0x7fa948131f40 2023-09-30T22:24:30.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.835+0000 7fa93e7fc700 1 -- 172.21.15.156:0/818529839 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94000f040 con 0x7fa948131f40 2023-09-30T22:24:30.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.835+0000 7fa94faf2700 1 -- 172.21.15.156:0/818529839 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa944009550 con 0x7fa948131f40 2023-09-30T22:24:30.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.835+0000 7fa94faf2700 1 -- 172.21.15.156:0/818529839 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa948120800 con 0x7fa948131f40 2023-09-30T22:24:30.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.835+0000 7fa93e7fc700 1 -- 172.21.15.156:0/818529839 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94000cd70 con 0x7fa948131f40 2023-09-30T22:24:30.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.836+0000 7fa93e7fc700 1 -- 172.21.15.156:0/818529839 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa940014480 con 0x7fa948131f40 2023-09-30T22:24:30.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.836+0000 7fa93e7fc700 1 -- 172.21.15.156:0/818529839 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa94003fc80 con 0x7fa948131f40 2023-09-30T22:24:30.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.836+0000 7fa94faf2700 1 -- 172.21.15.156:0/818529839 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9300052e0 con 0x7fa948131f40 2023-09-30T22:24:30.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.840+0000 7fa93e7fc700 1 -- 172.21.15.156:0/818529839 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa940012930 con 0x7fa948131f40 2023-09-30T22:24:30.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.875+0000 7f1ef3494700 1 Processor -- start 2023-09-30T22:24:30.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.875+0000 7f1ef3494700 1 -- start start 2023-09-30T22:24:30.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.875+0000 7f1ef3494700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1eec09e950 0x7f1eec09ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.875+0000 7f1ef3494700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1eec131fa0 0x7f1eec139af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.875+0000 7f1ef3494700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eec09afb0 con 0x7f1eec09f260 2023-09-30T22:24:30.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.875+0000 7f1ef3494700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eec0a0970 con 0x7f1eec09e950 2023-09-30T22:24:30.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.875+0000 7f1ef3494700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec0a0320 con 0x7f1eec131fa0 2023-09-30T22:24:30.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.876+0000 7f1ef1230700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1eec09e950 0x7f1eec09ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.876+0000 7f1ef1a31700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1eec131fa0 0x7f1eec139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.876+0000 7f1ef0a2f700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f1eec09f260 0x7f1eec131890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:57820/0 (socket says 172.21.15.156:57820) 2023-09-30T22:24:30.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.876+0000 7f1ef1230700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1eec09e950 0x7f1eec09ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49942/0 (socket says 172.21.15.156:49942) 2023-09-30T22:24:30.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.876+0000 7f1ef0a2f700 1 -- 172.21.15.156:0/2556557456 learned_addr learned my addr 172.21.15.156:0/2556557456 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:30.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.876+0000 7f1ef1230700 1 -- 172.21.15.156:0/2556557456 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1eec131fa0 msgr2=0x7f1eec139af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:30.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.876+0000 7f1ef1230700 1 --2- 172.21.15.156:0/2556557456 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1eec131fa0 0x7f1eec139af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.876+0000 7f1ef1230700 1 -- 172.21.15.156:0/2556557456 >> v1:172.21.15.156:6789/0 conn(0x7f1eec09f260 legacy=0x7f1eec131890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.876+0000 7f1ef1230700 1 -- 172.21.15.156:0/2556557456 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eec0a0750 con 0x7f1eec09e950 2023-09-30T22:24:30.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.876+0000 7f1ee3fff700 1 -- 172.21.15.156:0/2556557456 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 958548357 0 0) 0x7f1eec09afb0 con 0x7f1eec09f260 2023-09-30T22:24:30.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.876+0000 7f1ef1230700 1 --2- 172.21.15.156:0/2556557456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1eec09e950 0x7f1eec09ed20 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8009820 tx=0x7f1ee8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5174954a369d8d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:30.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.876+0000 7f1ee3fff700 1 -- 172.21.15.156:0/2556557456 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8005e30 con 0x7f1eec09e950 2023-09-30T22:24:30.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.876+0000 7f1ee3fff700 1 -- 172.21.15.156:0/2556557456 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee8006030 con 0x7f1eec09e950 2023-09-30T22:24:30.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.876+0000 7f1ee3fff700 1 -- 172.21.15.156:0/2556557456 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee80063c0 con 0x7f1eec09e950 2023-09-30T22:24:30.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.877+0000 7f1ef3494700 1 -- 172.21.15.156:0/2556557456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1eec09e950 msgr2=0x7f1eec09ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.877+0000 7f1ef3494700 1 --2- 172.21.15.156:0/2556557456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1eec09e950 0x7f1eec09ed20 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8009820 tx=0x7f1ee8009b30 comp rx=0 tx=0).stop 2023-09-30T22:24:30.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.877+0000 7f1ef3494700 1 -- 172.21.15.156:0/2556557456 shutdown_connections 2023-09-30T22:24:30.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.877+0000 7f1ef3494700 1 --2- 172.21.15.156:0/2556557456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1eec09e950 0x7f1eec09ed20 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.877+0000 7f1ef3494700 1 --2- 172.21.15.156:0/2556557456 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1eec131fa0 0x7f1eec139af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.877+0000 7f1ef3494700 1 -- 172.21.15.156:0/2556557456 >> 172.21.15.156:0/2556557456 conn(0x7f1eec0a0f70 msgr2=0x7f1eec0a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:30.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.877+0000 7f1ef3494700 1 -- 172.21.15.156:0/2556557456 shutdown_connections 2023-09-30T22:24:30.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.877+0000 7f1ef3494700 1 -- 172.21.15.156:0/2556557456 wait complete. 2023-09-30T22:24:30.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.878+0000 7f1ef3494700 1 Processor -- start 2023-09-30T22:24:30.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.878+0000 7f1ef3494700 1 -- start start 2023-09-30T22:24:30.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.879+0000 7f1ef3494700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1eec09e950 0x7f1eec1c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.879+0000 7f1ef3494700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1eec09f260 0x7f1eec1c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.879+0000 7f1ef3494700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1eec131fa0 0x7f1eec1c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.879+0000 7f1ef3494700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec126150 con 0x7f1eec09e950 2023-09-30T22:24:30.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.879+0000 7f1ef3494700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec06d4c0 con 0x7f1eec09f260 2023-09-30T22:24:30.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.879+0000 7f1ef3494700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec131380 con 0x7f1eec131fa0 2023-09-30T22:24:30.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.879+0000 7f1ef0a2f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1eec09f260 0x7f1eec1c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.879+0000 7f1ef0a2f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1eec09f260 0x7f1eec1c87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48072/0 (socket says 172.21.15.156:48072) 2023-09-30T22:24:30.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.879+0000 7f1ef1a31700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1eec131fa0 0x7f1eec1c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.879+0000 7f1ef0a2f700 1 -- 172.21.15.156:0/1557777169 learned_addr learned my addr 172.21.15.156:0/1557777169 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:30.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.879+0000 7f1ef1230700 1 --2- 172.21.15.156:0/1557777169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1eec09e950 0x7f1eec1c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.879+0000 7f1ef1a31700 1 -- 172.21.15.156:0/1557777169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1eec09f260 msgr2=0x7f1eec1c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.879+0000 7f1ef1a31700 1 --2- 172.21.15.156:0/1557777169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1eec09f260 0x7f1eec1c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.879+0000 7f1ef1a31700 1 -- 172.21.15.156:0/1557777169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1eec09e950 msgr2=0x7f1eec1c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.879+0000 7f1ef1a31700 1 --2- 172.21.15.156:0/1557777169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1eec09e950 0x7f1eec1c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.879+0000 7f1ef1a31700 1 -- 172.21.15.156:0/1557777169 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee8009430 con 0x7f1eec131fa0 2023-09-30T22:24:30.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.879+0000 7f1ef1230700 1 --2- 172.21.15.156:0/1557777169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1eec09e950 0x7f1eec1c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:30.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.880+0000 7f1ef1a31700 1 --2- 172.21.15.156:0/1557777169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1eec131fa0 0x7f1eec1c8cf0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4009d90 tx=0x7f1ee400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:30.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.880+0000 7f1ee1ffb700 1 -- 172.21.15.156:0/1557777169 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4009c00 con 0x7f1eec131fa0 2023-09-30T22:24:30.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.880+0000 7f1ee1ffb700 1 -- 172.21.15.156:0/1557777169 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee400f040 con 0x7f1eec131fa0 2023-09-30T22:24:30.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.880+0000 7f1ef3494700 1 -- 172.21.15.156:0/1557777169 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eec09da40 con 0x7f1eec131fa0 2023-09-30T22:24:30.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.880+0000 7f1ee1ffb700 1 -- 172.21.15.156:0/1557777169 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4014480 con 0x7f1eec131fa0 2023-09-30T22:24:30.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.880+0000 7f1ef3494700 1 -- 172.21.15.156:0/1557777169 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eec0a4ba0 con 0x7f1eec131fa0 2023-09-30T22:24:30.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.881+0000 7f1ee1ffb700 1 -- 172.21.15.156:0/1557777169 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1ee40145e0 con 0x7f1eec131fa0 2023-09-30T22:24:30.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.881+0000 7f1ef3494700 1 -- 172.21.15.156:0/1557777169 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eec04f2a0 con 0x7f1eec131fa0 2023-09-30T22:24:30.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.881+0000 7f1ee1ffb700 1 -- 172.21.15.156:0/1557777169 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1ee4040310 con 0x7f1eec131fa0 2023-09-30T22:24:30.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.886+0000 7f1ee1ffb700 1 -- 172.21.15.156:0/1557777169 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1ee4012520 con 0x7f1eec131fa0 2023-09-30T22:24:30.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.909+0000 7fc6b2d49700 1 -- 172.21.15.156:0/4113530680 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc6ac11a590 con 0x7fc6ac0a10b0 2023-09-30T22:24:30.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.910+0000 7fc6a97fa700 1 -- 172.21.15.156:0/4113530680 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc6a002a090 con 0x7fc6ac0a10b0 2023-09-30T22:24:30.910 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:30.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.912+0000 7fc6b2d49700 1 -- 172.21.15.156:0/4113530680 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6ac0a10b0 msgr2=0x7fc6ac11d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.912+0000 7fc6b2d49700 1 --2- 172.21.15.156:0/4113530680 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6ac0a10b0 0x7fc6ac11d700 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000ec10 tx=0x7fc6a000ef20 comp rx=0 tx=0).stop 2023-09-30T22:24:30.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.912+0000 7fc6b2d49700 1 -- 172.21.15.156:0/4113530680 shutdown_connections 2023-09-30T22:24:30.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.912+0000 7fc6b2d49700 1 --2- 172.21.15.156:0/4113530680 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc6ac134210 0x7fc6ac11e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.912+0000 7fc6b2d49700 1 --2- 172.21.15.156:0/4113530680 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc6ac0a10b0 0x7fc6ac11d700 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.912+0000 7fc6b2d49700 1 --2- 172.21.15.156:0/4113530680 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6ac133900 0x7fc6ac11dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.912+0000 7fc6b2d49700 1 -- 172.21.15.156:0/4113530680 >> 172.21.15.156:0/4113530680 conn(0x7fc6ac0a2980 msgr2=0x7fc6ac1baca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:30.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.912+0000 7fc6b2d49700 1 -- 172.21.15.156:0/4113530680 shutdown_connections 2023-09-30T22:24:30.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:30.912+0000 7fc6b2d49700 1 -- 172.21.15.156:0/4113530680 wait complete. 2023-09-30T22:24:30.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:31.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.036+0000 7fa94faf2700 1 -- 172.21.15.156:0/818529839 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa930005590 con 0x7fa948131f40 2023-09-30T22:24:31.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.037+0000 7fa93e7fc700 1 -- 172.21.15.156:0/818529839 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa940012340 con 0x7fa948131f40 2023-09-30T22:24:31.037 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:31.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.038+0000 7fa94faf2700 1 -- 172.21.15.156:0/818529839 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa948131f40 msgr2=0x7fa94811da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.038+0000 7fa94faf2700 1 --2- 172.21.15.156:0/818529839 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa948131f40 0x7fa94811da90 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa940009f00 tx=0x7fa94000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.038+0000 7fa94faf2700 1 -- 172.21.15.156:0/818529839 shutdown_connections 2023-09-30T22:24:31.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.039+0000 7fa94faf2700 1 --2- 172.21.15.156:0/818529839 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa948131f40 0x7fa94811da90 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.039+0000 7fa94faf2700 1 --2- 172.21.15.156:0/818529839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa94809e870 0x7fa94811d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.039+0000 7fa94faf2700 1 --2- 172.21.15.156:0/818529839 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa94809f180 0x7fa94811d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.039+0000 7fa94faf2700 1 -- 172.21.15.156:0/818529839 >> 172.21.15.156:0/818529839 conn(0x7fa9480a4430 msgr2=0x7fa94809c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:31.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.039+0000 7fa94faf2700 1 -- 172.21.15.156:0/818529839 shutdown_connections 2023-09-30T22:24:31.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.039+0000 7fa94faf2700 1 -- 172.21.15.156:0/818529839 wait complete. 2023-09-30T22:24:31.051 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:31.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.079+0000 7f1ef3494700 1 -- 172.21.15.156:0/1557777169 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1eec09b8b0 con 0x7f1eec131fa0 2023-09-30T22:24:31.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.079+0000 7f1ee1ffb700 1 -- 172.21.15.156:0/1557777169 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1ee4012340 con 0x7f1eec131fa0 2023-09-30T22:24:31.080 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:31.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.082+0000 7f1ef3494700 1 -- 172.21.15.156:0/1557777169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1eec131fa0 msgr2=0x7f1eec1c8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.082+0000 7f1ef3494700 1 --2- 172.21.15.156:0/1557777169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1eec131fa0 0x7f1eec1c8cf0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4009d90 tx=0x7f1ee400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.082+0000 7f1ef3494700 1 -- 172.21.15.156:0/1557777169 shutdown_connections 2023-09-30T22:24:31.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.082+0000 7f1ef3494700 1 --2- 172.21.15.156:0/1557777169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1eec131fa0 0x7f1eec1c8cf0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.082+0000 7f1ef3494700 1 --2- 172.21.15.156:0/1557777169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1eec09e950 0x7f1eec1c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.082+0000 7f1ef3494700 1 --2- 172.21.15.156:0/1557777169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1eec09f260 0x7f1eec1c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.082+0000 7f1ef3494700 1 -- 172.21.15.156:0/1557777169 >> 172.21.15.156:0/1557777169 conn(0x7f1eec0a0f70 msgr2=0x7f1eec11a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:31.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.082+0000 7f1ef3494700 1 -- 172.21.15.156:0/1557777169 shutdown_connections 2023-09-30T22:24:31.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.082+0000 7f1ef3494700 1 -- 172.21.15.156:0/1557777169 wait complete. 2023-09-30T22:24:31.084 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:31.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:31.206 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.205+0000 7fd4cb840700 1 Processor -- start 2023-09-30T22:24:31.206 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.205+0000 7fd4cb840700 1 -- start start 2023-09-30T22:24:31.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.206+0000 7fd4cb840700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4c4133ad0 0x7fd4c4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.206+0000 7fd4cb840700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4c41300a0 0x7fd4c41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.206+0000 7fd4cb840700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c406b2d0 con 0x7fd4c41309f0 2023-09-30T22:24:31.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.206+0000 7fd4cb840700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c4133610 con 0x7fd4c4133ad0 2023-09-30T22:24:31.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.206+0000 7fd4cb840700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c409a500 con 0x7fd4c41300a0 2023-09-30T22:24:31.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.206+0000 7fd4c95dc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4c4133ad0 0x7fd4c4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.206+0000 7fd4c8ddb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4c41300a0 0x7fd4c41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.206+0000 7fd4c9ddd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fd4c41309f0 0x7fd4c413a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:57834/0 (socket says 172.21.15.156:57834) 2023-09-30T22:24:31.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.206+0000 7fd4c9ddd700 1 -- 172.21.15.156:0/1175038340 learned_addr learned my addr 172.21.15.156:0/1175038340 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:31.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.206+0000 7fd4bbfff700 1 -- 172.21.15.156:0/1175038340 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1086261939 0 0) 0x7fd4c406b2d0 con 0x7fd4c41309f0 2023-09-30T22:24:31.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.206+0000 7fd4bbfff700 1 -- 172.21.15.156:0/1175038340 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4b00035b0 con 0x7fd4c41309f0 2023-09-30T22:24:31.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.206+0000 7fd4c95dc700 1 -- 172.21.15.156:0/1175038340 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4c41300a0 msgr2=0x7fd4c41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:31.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.206+0000 7fd4c95dc700 1 --2- 172.21.15.156:0/1175038340 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4c41300a0 0x7fd4c41304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.206+0000 7fd4c95dc700 1 -- 172.21.15.156:0/1175038340 >> v1:172.21.15.156:6789/0 conn(0x7fd4c41309f0 legacy=0x7fd4c413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.206+0000 7fd4c95dc700 1 -- 172.21.15.156:0/1175038340 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c41338b0 con 0x7fd4c4133ad0 2023-09-30T22:24:31.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.206+0000 7fd4c8ddb700 1 --2- 172.21.15.156:0/1175038340 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4c41300a0 0x7fd4c41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:31.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.207+0000 7fd4c95dc700 1 --2- 172.21.15.156:0/1175038340 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4c4133ad0 0x7fd4c4133ea0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4009870 tx=0x7fd4b4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa4026350a1ae625 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:31.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.207+0000 7fd4bbfff700 1 -- 172.21.15.156:0/1175038340 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b4011830 con 0x7fd4c4133ad0 2023-09-30T22:24:31.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.207+0000 7fd4bbfff700 1 -- 172.21.15.156:0/1175038340 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b4011990 con 0x7fd4c4133ad0 2023-09-30T22:24:31.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.207+0000 7fd4bbfff700 1 -- 172.21.15.156:0/1175038340 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b4011d20 con 0x7fd4c4133ad0 2023-09-30T22:24:31.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.207+0000 7fd4cb840700 1 -- 172.21.15.156:0/1175038340 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4c4133ad0 msgr2=0x7fd4c4133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.207+0000 7fd4cb840700 1 --2- 172.21.15.156:0/1175038340 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4c4133ad0 0x7fd4c4133ea0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4009870 tx=0x7fd4b4009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:31.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.207+0000 7fd4cb840700 1 -- 172.21.15.156:0/1175038340 shutdown_connections 2023-09-30T22:24:31.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.207+0000 7fd4cb840700 1 --2- 172.21.15.156:0/1175038340 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4c4133ad0 0x7fd4c4133ea0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.207+0000 7fd4cb840700 1 --2- 172.21.15.156:0/1175038340 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4c41300a0 0x7fd4c41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.207+0000 7fd4cb840700 1 -- 172.21.15.156:0/1175038340 >> 172.21.15.156:0/1175038340 conn(0x7fd4c4099c40 msgr2=0x7fd4c40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:31.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.207+0000 7fd4cb840700 1 -- 172.21.15.156:0/1175038340 shutdown_connections 2023-09-30T22:24:31.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.207+0000 7fd4cb840700 1 -- 172.21.15.156:0/1175038340 wait complete. 2023-09-30T22:24:31.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.208+0000 7fd4cb840700 1 Processor -- start 2023-09-30T22:24:31.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.208+0000 7fd4cb840700 1 -- start start 2023-09-30T22:24:31.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.209+0000 7fd4cb840700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4c41300a0 0x7fd4c4071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.209+0000 7fd4cb840700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4c41309f0 0x7fd4c4071840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.209+0000 7fd4cb840700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4c4133ad0 0x7fd4c4071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.209+0000 7fd4cb840700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c411fd20 con 0x7fd4c4133ad0 2023-09-30T22:24:31.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.209+0000 7fd4cb840700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c411f980 con 0x7fd4c41300a0 2023-09-30T22:24:31.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.209+0000 7fd4cb840700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c411ee10 con 0x7fd4c41309f0 2023-09-30T22:24:31.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.209+0000 7fd4c95dc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4c41300a0 0x7fd4c4071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.209+0000 7fd4c9ddd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4c4133ad0 0x7fd4c4071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.214 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.209+0000 7fd4c95dc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4c41300a0 0x7fd4c4071300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48086/0 (socket says 172.21.15.156:48086) 2023-09-30T22:24:31.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.209+0000 7fd4c95dc700 1 -- 172.21.15.156:0/4195291999 learned_addr learned my addr 172.21.15.156:0/4195291999 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:31.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.209+0000 7fd4c8ddb700 1 --2- 172.21.15.156:0/4195291999 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4c41309f0 0x7fd4c4071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.209+0000 7fd4c95dc700 1 -- 172.21.15.156:0/4195291999 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4c41309f0 msgr2=0x7fd4c4071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.209+0000 7fd4c95dc700 1 --2- 172.21.15.156:0/4195291999 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4c41309f0 0x7fd4c4071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.209+0000 7fd4c95dc700 1 -- 172.21.15.156:0/4195291999 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4c4133ad0 msgr2=0x7fd4c4071d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.209+0000 7fd4c95dc700 1 --2- 172.21.15.156:0/4195291999 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4c4133ad0 0x7fd4c4071d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.209+0000 7fd4c95dc700 1 -- 172.21.15.156:0/4195291999 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c00094a0 con 0x7fd4c41300a0 2023-09-30T22:24:31.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.209+0000 7fd4c8ddb700 1 --2- 172.21.15.156:0/4195291999 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4c41309f0 0x7fd4c4071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:31.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.209+0000 7fd4c9ddd700 1 --2- 172.21.15.156:0/4195291999 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4c4133ad0 0x7fd4c4071d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:31.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.209+0000 7fd4c95dc700 1 --2- 172.21.15.156:0/4195291999 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4c41300a0 0x7fd4c4071300 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4009bc0 tx=0x7fd4b4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:31.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.209+0000 7fd4b9ffb700 1 -- 172.21.15.156:0/4195291999 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b4004450 con 0x7fd4c41300a0 2023-09-30T22:24:31.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.209+0000 7fd4b9ffb700 1 -- 172.21.15.156:0/4195291999 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b40045b0 con 0x7fd4c41300a0 2023-09-30T22:24:31.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.209+0000 7fd4cb840700 1 -- 172.21.15.156:0/4195291999 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b40094a0 con 0x7fd4c41300a0 2023-09-30T22:24:31.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.209+0000 7fd4b9ffb700 1 -- 172.21.15.156:0/4195291999 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b40038c0 con 0x7fd4c41300a0 2023-09-30T22:24:31.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.210+0000 7fd4cb840700 1 -- 172.21.15.156:0/4195291999 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c411e0b0 con 0x7fd4c41300a0 2023-09-30T22:24:31.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.210+0000 7fd4b9ffb700 1 -- 172.21.15.156:0/4195291999 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd4b4003a20 con 0x7fd4c41300a0 2023-09-30T22:24:31.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.211+0000 7fd4cb840700 1 -- 172.21.15.156:0/4195291999 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c404f2a0 con 0x7fd4c41300a0 2023-09-30T22:24:31.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.211+0000 7fd4b9ffb700 1 -- 172.21.15.156:0/4195291999 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd4b4040430 con 0x7fd4c41300a0 2023-09-30T22:24:31.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.215+0000 7fd4b9ffb700 1 -- 172.21.15.156:0/4195291999 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd4b401a420 con 0x7fd4c41300a0 2023-09-30T22:24:31.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.398+0000 7fd4cb840700 1 -- 172.21.15.156:0/4195291999 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd4c406c3b0 con 0x7fd4c41300a0 2023-09-30T22:24:31.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.398+0000 7fd4b9ffb700 1 -- 172.21.15.156:0/4195291999 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd4b4028020 con 0x7fd4c41300a0 2023-09-30T22:24:31.399 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:31.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.400+0000 7fd4cb840700 1 -- 172.21.15.156:0/4195291999 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4c41300a0 msgr2=0x7fd4c4071300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.400+0000 7fd4cb840700 1 --2- 172.21.15.156:0/4195291999 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4c41300a0 0x7fd4c4071300 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4009bc0 tx=0x7fd4b4004750 comp rx=0 tx=0).stop 2023-09-30T22:24:31.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.400+0000 7fd4cb840700 1 -- 172.21.15.156:0/4195291999 shutdown_connections 2023-09-30T22:24:31.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.400+0000 7fd4cb840700 1 --2- 172.21.15.156:0/4195291999 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4c4133ad0 0x7fd4c4071d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.400+0000 7fd4cb840700 1 --2- 172.21.15.156:0/4195291999 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd4c41300a0 0x7fd4c4071300 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.400+0000 7fd4cb840700 1 --2- 172.21.15.156:0/4195291999 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd4c41309f0 0x7fd4c4071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.400+0000 7fd4cb840700 1 -- 172.21.15.156:0/4195291999 >> 172.21.15.156:0/4195291999 conn(0x7fd4c4099c40 msgr2=0x7fd4c412e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:31.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.400+0000 7fd4cb840700 1 -- 172.21.15.156:0/4195291999 shutdown_connections 2023-09-30T22:24:31.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:31.400+0000 7fd4cb840700 1 -- 172.21.15.156:0/4195291999 wait complete. 2023-09-30T22:24:31.413 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:31.926 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:32.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.050+0000 7eff68f37700 1 Processor -- start 2023-09-30T22:24:32.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.050+0000 7eff68f37700 1 -- start start 2023-09-30T22:24:32.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.051+0000 7eff68f37700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff6409e870 0x7eff6409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.051+0000 7eff68f37700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7eff64131f40 0x7eff64139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.051+0000 7eff68f37700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff6409c970 con 0x7eff6409f180 2023-09-30T22:24:32.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.051+0000 7eff68f37700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff640a0920 con 0x7eff6409e870 2023-09-30T22:24:32.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.051+0000 7eff68f37700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff6409f9c0 con 0x7eff64131f40 2023-09-30T22:24:32.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.051+0000 7eff62d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7eff64131f40 0x7eff64139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.051+0000 7eff61d9b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7eff6409f180 0x7eff64131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53222/0 (socket says 172.21.15.156:53222) 2023-09-30T22:24:32.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.051+0000 7eff61d9b700 1 -- 172.21.15.156:0/1449441868 learned_addr learned my addr 172.21.15.156:0/1449441868 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:32.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.051+0000 7eff6259c700 1 --2- 172.21.15.156:0/1449441868 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff6409e870 0x7eff6409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.051+0000 7eff62d9d700 1 -- 172.21.15.156:0/1449441868 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff6409e870 msgr2=0x7eff6409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:32.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.051+0000 7eff62d9d700 1 --2- 172.21.15.156:0/1449441868 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff6409e870 0x7eff6409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.051+0000 7eff6159a700 1 -- 172.21.15.156:0/1449441868 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923410227 0 0) 0x7eff6409c970 con 0x7eff6409f180 2023-09-30T22:24:32.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.051+0000 7eff62d9d700 1 -- 172.21.15.156:0/1449441868 >> v1:172.21.15.156:6789/0 conn(0x7eff6409f180 legacy=0x7eff64131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.051+0000 7eff62d9d700 1 -- 172.21.15.156:0/1449441868 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6409bab0 con 0x7eff64131f40 2023-09-30T22:24:32.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.051+0000 7eff6259c700 1 --2- 172.21.15.156:0/1449441868 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff6409e870 0x7eff6409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:32.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.051+0000 7eff62d9d700 1 --2- 172.21.15.156:0/1449441868 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7eff64131f40 0x7eff64139ca0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7eff5c009dc0 tx=0x7eff5c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f41acf6ec7e98f9d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:32.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.052+0000 7eff6159a700 1 -- 172.21.15.156:0/1449441868 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c00e070 con 0x7eff64131f40 2023-09-30T22:24:32.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.052+0000 7eff6159a700 1 -- 172.21.15.156:0/1449441868 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c00bb20 con 0x7eff64131f40 2023-09-30T22:24:32.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.052+0000 7eff6159a700 1 -- 172.21.15.156:0/1449441868 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c012430 con 0x7eff64131f40 2023-09-30T22:24:32.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.052+0000 7eff68f37700 1 -- 172.21.15.156:0/1449441868 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7eff64131f40 msgr2=0x7eff64139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.052+0000 7eff68f37700 1 --2- 172.21.15.156:0/1449441868 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7eff64131f40 0x7eff64139ca0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7eff5c009dc0 tx=0x7eff5c00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:32.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.052+0000 7eff68f37700 1 -- 172.21.15.156:0/1449441868 shutdown_connections 2023-09-30T22:24:32.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.052+0000 7eff68f37700 1 --2- 172.21.15.156:0/1449441868 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff6409e870 0x7eff6409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.052+0000 7eff68f37700 1 --2- 172.21.15.156:0/1449441868 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7eff64131f40 0x7eff64139ca0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.052+0000 7eff68f37700 1 -- 172.21.15.156:0/1449441868 >> 172.21.15.156:0/1449441868 conn(0x7eff640a4430 msgr2=0x7eff640a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:32.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.052+0000 7eff68f37700 1 -- 172.21.15.156:0/1449441868 shutdown_connections 2023-09-30T22:24:32.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.052+0000 7eff68f37700 1 -- 172.21.15.156:0/1449441868 wait complete. 2023-09-30T22:24:32.056 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:32.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.053+0000 7eff68f37700 1 Processor -- start 2023-09-30T22:24:32.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.053+0000 7eff68f37700 1 -- start start 2023-09-30T22:24:32.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.054+0000 7eff68f37700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7eff6409e870 0x7eff64120120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.054+0000 7eff68f37700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff6409f180 0x7eff64120660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.054+0000 7eff68f37700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff64131f40 0x7eff64120ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.054+0000 7eff68f37700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff64123bb0 con 0x7eff64131f40 2023-09-30T22:24:32.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.054+0000 7eff68f37700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff64122b30 con 0x7eff6409f180 2023-09-30T22:24:32.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.054+0000 7eff68f37700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff6409dba0 con 0x7eff6409e870 2023-09-30T22:24:32.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.054+0000 7eff61d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff6409f180 0x7eff64120660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.054+0000 7eff62d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff64131f40 0x7eff64120ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.054+0000 7eff62d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff64131f40 0x7eff64120ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52206/0 (socket says 172.21.15.156:52206) 2023-09-30T22:24:32.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.054+0000 7eff61d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff6409f180 0x7eff64120660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48934/0 (socket says 172.21.15.156:48934) 2023-09-30T22:24:32.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.054+0000 7eff62d9d700 1 -- 172.21.15.156:0/1744584540 learned_addr learned my addr 172.21.15.156:0/1744584540 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:32.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.054+0000 7eff6259c700 1 --2- 172.21.15.156:0/1744584540 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7eff6409e870 0x7eff64120120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.054+0000 7eff62d9d700 1 -- 172.21.15.156:0/1744584540 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7eff6409e870 msgr2=0x7eff64120120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.054+0000 7eff62d9d700 1 --2- 172.21.15.156:0/1744584540 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7eff6409e870 0x7eff64120120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.054+0000 7eff62d9d700 1 -- 172.21.15.156:0/1744584540 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff6409f180 msgr2=0x7eff64120660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.054+0000 7eff62d9d700 1 --2- 172.21.15.156:0/1744584540 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff6409f180 0x7eff64120660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.054+0000 7eff62d9d700 1 -- 172.21.15.156:0/1744584540 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff580094a0 con 0x7eff64131f40 2023-09-30T22:24:32.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.054+0000 7eff61d9b700 1 --2- 172.21.15.156:0/1744584540 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff6409f180 0x7eff64120660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:32.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.054+0000 7eff62d9d700 1 --2- 172.21.15.156:0/1744584540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff64131f40 0x7eff64120ba0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7eff6409fb50 tx=0x7eff5c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:32.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.054+0000 7eff52ffd700 1 -- 172.21.15.156:0/1744584540 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c004840 con 0x7eff64131f40 2023-09-30T22:24:32.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.054+0000 7eff52ffd700 1 -- 172.21.15.156:0/1744584540 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c020070 con 0x7eff64131f40 2023-09-30T22:24:32.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.054+0000 7eff68f37700 1 -- 172.21.15.156:0/1744584540 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff5c009a70 con 0x7eff64131f40 2023-09-30T22:24:32.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.054+0000 7eff52ffd700 1 -- 172.21.15.156:0/1744584540 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c0276c0 con 0x7eff64131f40 2023-09-30T22:24:32.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.055+0000 7eff68f37700 1 -- 172.21.15.156:0/1744584540 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff64121ca0 con 0x7eff64131f40 2023-09-30T22:24:32.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.055+0000 7eff52ffd700 1 -- 172.21.15.156:0/1744584540 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7eff5c012430 con 0x7eff64131f40 2023-09-30T22:24:32.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.055+0000 7eff52ffd700 1 -- 172.21.15.156:0/1744584540 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7eff5c022070 con 0x7eff64131f40 2023-09-30T22:24:32.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.056+0000 7eff68f37700 1 -- 172.21.15.156:0/1744584540 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff6411d580 con 0x7eff64131f40 2023-09-30T22:24:32.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.060+0000 7eff52ffd700 1 -- 172.21.15.156:0/1744584540 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7eff5c01b400 con 0x7eff64131f40 2023-09-30T22:24:32.096 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:32.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.192+0000 7f05dab00700 1 Processor -- start 2023-09-30T22:24:32.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.192+0000 7f05dab00700 1 -- start start 2023-09-30T22:24:32.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.193+0000 7f05dab00700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f05d409f430 0x7f05d4138cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.193+0000 7f05dab00700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05d41391f0 0x7f05d413b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.193+0000 7f05dab00700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d409ac20 con 0x7f05d409e950 2023-09-30T22:24:32.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.193+0000 7f05dab00700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d40a06c0 con 0x7f05d409f430 2023-09-30T22:24:32.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.193+0000 7f05dab00700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05d409ae90 con 0x7f05d41391f0 2023-09-30T22:24:32.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.193+0000 7f05d889c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f05d409e950 0x7f05d409ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53234/0 (socket says 172.21.15.156:53234) 2023-09-30T22:24:32.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.193+0000 7f05d3fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f05d409f430 0x7f05d4138cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.193+0000 7f05d889c700 1 -- 172.21.15.156:0/1901738539 learned_addr learned my addr 172.21.15.156:0/1901738539 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:32.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.193+0000 7f05d909d700 1 --2- 172.21.15.156:0/1901738539 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05d41391f0 0x7f05d413b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.193+0000 7f05d909d700 1 -- 172.21.15.156:0/1901738539 >> v2:172.21.15.156:3300/0 conn(0x7f05d409f430 msgr2=0x7f05d4138cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:32.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.193+0000 7f05d909d700 1 --2- 172.21.15.156:0/1901738539 >> v2:172.21.15.156:3300/0 conn(0x7f05d409f430 0x7f05d4138cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.193+0000 7f05d909d700 1 -- 172.21.15.156:0/1901738539 >> v1:172.21.15.156:6789/0 conn(0x7f05d409e950 legacy=0x7f05d409ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.193+0000 7f05d37fe700 1 -- 172.21.15.156:0/1901738539 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1249541618 0 0) 0x7f05d409ac20 con 0x7f05d409e950 2023-09-30T22:24:32.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.193+0000 7f05d909d700 1 -- 172.21.15.156:0/1901738539 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d406ba00 con 0x7f05d41391f0 2023-09-30T22:24:32.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.193+0000 7f05d3fff700 1 --2- 172.21.15.156:0/1901738539 >> v2:172.21.15.156:3300/0 conn(0x7f05d409f430 0x7f05d4138cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:32.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.193+0000 7f05d909d700 1 --2- 172.21.15.156:0/1901738539 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05d41391f0 0x7f05d413b5d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f05cc009d90 tx=0x7f05cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa763c03c6e5df8d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:32.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.193+0000 7f05d37fe700 1 -- 172.21.15.156:0/1901738539 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc00e070 con 0x7f05d41391f0 2023-09-30T22:24:32.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.194+0000 7f05d37fe700 1 -- 172.21.15.156:0/1901738539 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05cc00bb20 con 0x7f05d41391f0 2023-09-30T22:24:32.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.194+0000 7f05d37fe700 1 -- 172.21.15.156:0/1901738539 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc012430 con 0x7f05d41391f0 2023-09-30T22:24:32.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.194+0000 7f05dab00700 1 -- 172.21.15.156:0/1901738539 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05d41391f0 msgr2=0x7f05d413b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.194+0000 7f05dab00700 1 --2- 172.21.15.156:0/1901738539 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05d41391f0 0x7f05d413b5d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f05cc009d90 tx=0x7f05cc00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:32.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.194+0000 7f05dab00700 1 -- 172.21.15.156:0/1901738539 shutdown_connections 2023-09-30T22:24:32.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.194+0000 7f05dab00700 1 --2- 172.21.15.156:0/1901738539 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05d41391f0 0x7f05d413b5d0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.194+0000 7f05dab00700 1 --2- 172.21.15.156:0/1901738539 >> v2:172.21.15.156:3300/0 conn(0x7f05d409f430 0x7f05d4138cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.194+0000 7f05dab00700 1 -- 172.21.15.156:0/1901738539 >> 172.21.15.156:0/1901738539 conn(0x7f05d40a0f70 msgr2=0x7f05d40a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:32.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.194+0000 7f05dab00700 1 -- 172.21.15.156:0/1901738539 shutdown_connections 2023-09-30T22:24:32.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.194+0000 7f05dab00700 1 -- 172.21.15.156:0/1901738539 wait complete. 2023-09-30T22:24:32.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.195+0000 7f05dab00700 1 Processor -- start 2023-09-30T22:24:32.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.195+0000 7f05dab00700 1 -- start start 2023-09-30T22:24:32.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.196+0000 7f05dab00700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05d409e950 0x7f05d4121890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.196+0000 7f05dab00700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05d409f430 0x7f05d4121dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.196+0000 7f05dab00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05d41391f0 0x7f05d4122310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.196+0000 7f05dab00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d40a08b0 con 0x7f05d41391f0 2023-09-30T22:24:32.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.196+0000 7f05dab00700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d41235b0 con 0x7f05d409e950 2023-09-30T22:24:32.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.196+0000 7f05dab00700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05d41250d0 con 0x7f05d409f430 2023-09-30T22:24:32.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.196+0000 7f05d889c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05d409e950 0x7f05d4121890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.196+0000 7f05d889c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05d409e950 0x7f05d4121890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48940/0 (socket says 172.21.15.156:48940) 2023-09-30T22:24:32.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.196+0000 7f05d889c700 1 -- 172.21.15.156:0/812264738 learned_addr learned my addr 172.21.15.156:0/812264738 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:32.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.196+0000 7f05d3fff700 1 --2- 172.21.15.156:0/812264738 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05d409f430 0x7f05d4121dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.196+0000 7f05d909d700 1 --2- 172.21.15.156:0/812264738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05d41391f0 0x7f05d4122310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.196+0000 7f05d889c700 1 -- 172.21.15.156:0/812264738 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05d409f430 msgr2=0x7f05d4121dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.196+0000 7f05d889c700 1 --2- 172.21.15.156:0/812264738 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05d409f430 0x7f05d4121dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.196+0000 7f05d889c700 1 -- 172.21.15.156:0/812264738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05d41391f0 msgr2=0x7f05d4122310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.196+0000 7f05d889c700 1 --2- 172.21.15.156:0/812264738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05d41391f0 0x7f05d4122310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.196+0000 7f05d889c700 1 -- 172.21.15.156:0/812264738 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c00094a0 con 0x7f05d409e950 2023-09-30T22:24:32.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.196+0000 7f05d889c700 1 --2- 172.21.15.156:0/812264738 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05d409e950 0x7f05d4121890 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f05c800c4a0 tx=0x7f05c800c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:32.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.197+0000 7f05d17fa700 1 -- 172.21.15.156:0/812264738 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c80074e0 con 0x7f05d409e950 2023-09-30T22:24:32.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.197+0000 7f05d17fa700 1 -- 172.21.15.156:0/812264738 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c8007640 con 0x7f05d409e950 2023-09-30T22:24:32.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.197+0000 7f05dab00700 1 -- 172.21.15.156:0/812264738 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05cc009a70 con 0x7f05d409e950 2023-09-30T22:24:32.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.197+0000 7f05d17fa700 1 -- 172.21.15.156:0/812264738 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8005a70 con 0x7f05d409e950 2023-09-30T22:24:32.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.197+0000 7f05dab00700 1 -- 172.21.15.156:0/812264738 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d4123c90 con 0x7f05d409e950 2023-09-30T22:24:32.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.198+0000 7f05d17fa700 1 -- 172.21.15.156:0/812264738 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f05c8005bd0 con 0x7f05d409e950 2023-09-30T22:24:32.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.198+0000 7f05d17fa700 1 -- 172.21.15.156:0/812264738 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f05c803ea10 con 0x7f05d409e950 2023-09-30T22:24:32.206 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.198+0000 7f05dab00700 1 -- 172.21.15.156:0/812264738 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d404f2a0 con 0x7f05d409e950 2023-09-30T22:24:32.206 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.203+0000 7f05d17fa700 1 -- 172.21.15.156:0/812264738 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f05c8017080 con 0x7f05d409e950 2023-09-30T22:24:32.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.236+0000 7f6ff94f7700 1 Processor -- start 2023-09-30T22:24:32.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.236+0000 7f6ff94f7700 1 -- start start 2023-09-30T22:24:32.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.236+0000 7f6ff94f7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ff409e870 0x7f6ff409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.237+0000 7f6ff94f7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ff4131f40 0x7f6ff4139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.237+0000 7f6ff94f7700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff409c970 con 0x7f6ff409f180 2023-09-30T22:24:32.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.237+0000 7f6ff94f7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff40a0920 con 0x7f6ff409e870 2023-09-30T22:24:32.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.237+0000 7f6ff94f7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff409f9c0 con 0x7f6ff4131f40 2023-09-30T22:24:32.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.237+0000 7f6ff37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ff4131f40 0x7f6ff4139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.237+0000 7f6ff27fc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6ff409f180 0x7f6ff4131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53240/0 (socket says 172.21.15.156:53240) 2023-09-30T22:24:32.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.237+0000 7f6ff27fc700 1 -- 172.21.15.156:0/1635781468 learned_addr learned my addr 172.21.15.156:0/1635781468 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:32.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.237+0000 7f6ff2ffd700 1 --2- 172.21.15.156:0/1635781468 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ff409e870 0x7f6ff409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.237+0000 7f6ff2ffd700 1 -- 172.21.15.156:0/1635781468 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ff4131f40 msgr2=0x7f6ff4139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:32.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.237+0000 7f6ff2ffd700 1 --2- 172.21.15.156:0/1635781468 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ff4131f40 0x7f6ff4139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.237+0000 7f6ff2ffd700 1 -- 172.21.15.156:0/1635781468 >> v1:172.21.15.156:6789/0 conn(0x7f6ff409f180 legacy=0x7f6ff4131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.237+0000 7f6ff1ffb700 1 -- 172.21.15.156:0/1635781468 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4113608192 0 0) 0x7f6ff409c970 con 0x7f6ff409f180 2023-09-30T22:24:32.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.237+0000 7f6ff2ffd700 1 -- 172.21.15.156:0/1635781468 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff409bab0 con 0x7f6ff409e870 2023-09-30T22:24:32.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.237+0000 7f6ff2ffd700 1 --2- 172.21.15.156:0/1635781468 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ff409e870 0x7f6ff409ec40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4009870 tx=0x7f6fe4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f29743338725301 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:32.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.237+0000 7f6ff1ffb700 1 -- 172.21.15.156:0/1635781468 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4011830 con 0x7f6ff409e870 2023-09-30T22:24:32.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.237+0000 7f6ff1ffb700 1 -- 172.21.15.156:0/1635781468 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe4011990 con 0x7f6ff409e870 2023-09-30T22:24:32.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.237+0000 7f6ff1ffb700 1 -- 172.21.15.156:0/1635781468 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4011d20 con 0x7f6ff409e870 2023-09-30T22:24:32.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.238+0000 7f6ff94f7700 1 -- 172.21.15.156:0/1635781468 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ff409e870 msgr2=0x7f6ff409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.238+0000 7f6ff94f7700 1 --2- 172.21.15.156:0/1635781468 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ff409e870 0x7f6ff409ec40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4009870 tx=0x7f6fe4009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:32.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.238+0000 7f6ff94f7700 1 -- 172.21.15.156:0/1635781468 shutdown_connections 2023-09-30T22:24:32.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.238+0000 7f6ff94f7700 1 --2- 172.21.15.156:0/1635781468 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ff409e870 0x7f6ff409ec40 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.238+0000 7f6ff94f7700 1 --2- 172.21.15.156:0/1635781468 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ff4131f40 0x7f6ff4139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.238+0000 7f6ff94f7700 1 -- 172.21.15.156:0/1635781468 >> 172.21.15.156:0/1635781468 conn(0x7f6ff40a4430 msgr2=0x7f6ff40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:32.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.238+0000 7f6ff94f7700 1 -- 172.21.15.156:0/1635781468 shutdown_connections 2023-09-30T22:24:32.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.238+0000 7f6ff94f7700 1 -- 172.21.15.156:0/1635781468 wait complete. 2023-09-30T22:24:32.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.239+0000 7f6ff94f7700 1 Processor -- start 2023-09-30T22:24:32.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.239+0000 7f6ff94f7700 1 -- start start 2023-09-30T22:24:32.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.240+0000 7f6ff94f7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ff409e870 0x7f6ff4122790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.240+0000 7f6ff94f7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ff409f180 0x7f6ff4122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.240+0000 7f6ff94f7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ff4131f40 0x7f6ff4123210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.240+0000 7f6ff94f7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff41259e0 con 0x7f6ff409f180 2023-09-30T22:24:32.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.240+0000 7f6ff94f7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff40a2a60 con 0x7f6ff409e870 2023-09-30T22:24:32.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.240+0000 7f6ff94f7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff409dc40 con 0x7f6ff4131f40 2023-09-30T22:24:32.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.240+0000 7f6ff2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ff409e870 0x7f6ff4122790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.240+0000 7f6ff2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ff409e870 0x7f6ff4122790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48972/0 (socket says 172.21.15.156:48972) 2023-09-30T22:24:32.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.240+0000 7f6ff2ffd700 1 -- 172.21.15.156:0/1412171913 learned_addr learned my addr 172.21.15.156:0/1412171913 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:32.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.240+0000 7f6ff27fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ff409f180 0x7f6ff4122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.240+0000 7f6ff37fe700 1 --2- 172.21.15.156:0/1412171913 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ff4131f40 0x7f6ff4123210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.240+0000 7f6ff2ffd700 1 -- 172.21.15.156:0/1412171913 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ff4131f40 msgr2=0x7f6ff4123210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.240+0000 7f6ff2ffd700 1 --2- 172.21.15.156:0/1412171913 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ff4131f40 0x7f6ff4123210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.240+0000 7f6ff2ffd700 1 -- 172.21.15.156:0/1412171913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ff409f180 msgr2=0x7f6ff4122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.240+0000 7f6ff2ffd700 1 --2- 172.21.15.156:0/1412171913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ff409f180 0x7f6ff4122cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.240+0000 7f6ff2ffd700 1 -- 172.21.15.156:0/1412171913 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe40094a0 con 0x7f6ff409e870 2023-09-30T22:24:32.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.240+0000 7f6ff27fc700 1 --2- 172.21.15.156:0/1412171913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ff409f180 0x7f6ff4122cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:32.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.240+0000 7f6ff2ffd700 1 --2- 172.21.15.156:0/1412171913 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ff409e870 0x7f6ff4122790 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4009840 tx=0x7f6fe4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:32.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.240+0000 7f6fdb7fe700 1 -- 172.21.15.156:0/1412171913 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4004550 con 0x7f6ff409e870 2023-09-30T22:24:32.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.240+0000 7f6fdb7fe700 1 -- 172.21.15.156:0/1412171913 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe401e070 con 0x7f6ff409e870 2023-09-30T22:24:32.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.240+0000 7f6fdb7fe700 1 -- 172.21.15.156:0/1412171913 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe40038e0 con 0x7f6ff409e870 2023-09-30T22:24:32.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.240+0000 7f6ff94f7700 1 -- 172.21.15.156:0/1412171913 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff4125c40 con 0x7f6ff409e870 2023-09-30T22:24:32.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.241+0000 7f6ff94f7700 1 -- 172.21.15.156:0/1412171913 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff4126970 con 0x7f6ff409e870 2023-09-30T22:24:32.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.241+0000 7f6fdb7fe700 1 -- 172.21.15.156:0/1412171913 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6fe4003a40 con 0x7f6ff409e870 2023-09-30T22:24:32.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.241+0000 7f6ff94f7700 1 -- 172.21.15.156:0/1412171913 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff4125e30 con 0x7f6ff409e870 2023-09-30T22:24:32.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.241+0000 7f6fdb7fe700 1 -- 172.21.15.156:0/1412171913 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6fe4040570 con 0x7f6ff409e870 2023-09-30T22:24:32.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.246+0000 7f6fdb7fe700 1 -- 172.21.15.156:0/1412171913 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6fe402d450 con 0x7f6ff409e870 2023-09-30T22:24:32.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.255+0000 7eff68f37700 1 -- 172.21.15.156:0/1744584540 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7eff6404f2a0 con 0x7eff64131f40 2023-09-30T22:24:32.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.255+0000 7eff52ffd700 1 -- 172.21.15.156:0/1744584540 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7eff5c025380 con 0x7eff64131f40 2023-09-30T22:24:32.256 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:32.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.258+0000 7eff68f37700 1 -- 172.21.15.156:0/1744584540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff64131f40 msgr2=0x7eff64120ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.258+0000 7eff68f37700 1 --2- 172.21.15.156:0/1744584540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff64131f40 0x7eff64120ba0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7eff6409fb50 tx=0x7eff5c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.258+0000 7eff68f37700 1 -- 172.21.15.156:0/1744584540 shutdown_connections 2023-09-30T22:24:32.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.258+0000 7eff68f37700 1 --2- 172.21.15.156:0/1744584540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff64131f40 0x7eff64120ba0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.258+0000 7eff68f37700 1 --2- 172.21.15.156:0/1744584540 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7eff6409e870 0x7eff64120120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.258+0000 7eff68f37700 1 --2- 172.21.15.156:0/1744584540 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff6409f180 0x7eff64120660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.258+0000 7eff68f37700 1 -- 172.21.15.156:0/1744584540 >> 172.21.15.156:0/1744584540 conn(0x7eff640a4430 msgr2=0x7eff6411a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:32.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.258+0000 7eff68f37700 1 -- 172.21.15.156:0/1744584540 shutdown_connections 2023-09-30T22:24:32.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.258+0000 7eff68f37700 1 -- 172.21.15.156:0/1744584540 wait complete. 2023-09-30T22:24:32.277 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:32.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.402+0000 7f05dab00700 1 -- 172.21.15.156:0/812264738 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f05d406bbe0 con 0x7f05d409e950 2023-09-30T22:24:32.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.402+0000 7f05d17fa700 1 -- 172.21.15.156:0/812264738 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f05c801bb10 con 0x7f05d409e950 2023-09-30T22:24:32.403 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:32.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.404+0000 7f05dab00700 1 -- 172.21.15.156:0/812264738 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05d409e950 msgr2=0x7f05d4121890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.404+0000 7f05dab00700 1 --2- 172.21.15.156:0/812264738 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05d409e950 0x7f05d4121890 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f05c800c4a0 tx=0x7f05c800c7b0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.404+0000 7f05dab00700 1 -- 172.21.15.156:0/812264738 shutdown_connections 2023-09-30T22:24:32.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.404+0000 7f05dab00700 1 --2- 172.21.15.156:0/812264738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05d41391f0 0x7f05d4122310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.404+0000 7f05dab00700 1 --2- 172.21.15.156:0/812264738 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f05d409e950 0x7f05d4121890 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.404+0000 7f05dab00700 1 --2- 172.21.15.156:0/812264738 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f05d409f430 0x7f05d4121dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.404+0000 7f05dab00700 1 -- 172.21.15.156:0/812264738 >> 172.21.15.156:0/812264738 conn(0x7f05d40a0f70 msgr2=0x7f05d409c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:32.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.405+0000 7f05dab00700 1 -- 172.21.15.156:0/812264738 shutdown_connections 2023-09-30T22:24:32.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.405+0000 7f05dab00700 1 -- 172.21.15.156:0/812264738 wait complete. 2023-09-30T22:24:32.414 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:32.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:32.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.455+0000 7f6ff94f7700 1 -- 172.21.15.156:0/1412171913 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6ff404f2a0 con 0x7f6ff409e870 2023-09-30T22:24:32.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.455+0000 7f6fdb7fe700 1 -- 172.21.15.156:0/1412171913 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6fe4015020 con 0x7f6ff409e870 2023-09-30T22:24:32.456 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:32.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.457+0000 7f6ff94f7700 1 -- 172.21.15.156:0/1412171913 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ff409e870 msgr2=0x7f6ff4122790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.457+0000 7f6ff94f7700 1 --2- 172.21.15.156:0/1412171913 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ff409e870 0x7f6ff4122790 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4009840 tx=0x7f6fe4004750 comp rx=0 tx=0).stop 2023-09-30T22:24:32.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.457+0000 7f6ff94f7700 1 -- 172.21.15.156:0/1412171913 shutdown_connections 2023-09-30T22:24:32.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.457+0000 7f6ff94f7700 1 --2- 172.21.15.156:0/1412171913 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6ff4131f40 0x7f6ff4123210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.457+0000 7f6ff94f7700 1 --2- 172.21.15.156:0/1412171913 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ff409e870 0x7f6ff4122790 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.457+0000 7f6ff94f7700 1 --2- 172.21.15.156:0/1412171913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ff409f180 0x7f6ff4122cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.457+0000 7f6ff94f7700 1 -- 172.21.15.156:0/1412171913 >> 172.21.15.156:0/1412171913 conn(0x7f6ff40a4430 msgr2=0x7f6ff409c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:32.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.458+0000 7f6ff94f7700 1 -- 172.21.15.156:0/1412171913 shutdown_connections 2023-09-30T22:24:32.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.458+0000 7f6ff94f7700 1 -- 172.21.15.156:0/1412171913 wait complete. 2023-09-30T22:24:32.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:32.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.538+0000 7f2541cbc700 1 Processor -- start 2023-09-30T22:24:32.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.538+0000 7f2541cbc700 1 -- start start 2023-09-30T22:24:32.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.538+0000 7f2541cbc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f253c09d860 0x7f253c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.538+0000 7f2541cbc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f253c09e170 0x7f253c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.538+0000 7f2541cbc700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253c09aaa0 con 0x7f253c130ce0 2023-09-30T22:24:32.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.538+0000 7f2541cbc700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f253c09f870 con 0x7f253c09e170 2023-09-30T22:24:32.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.538+0000 7f2541cbc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f253c09b360 con 0x7f253c09d860 2023-09-30T22:24:32.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.538+0000 7f253b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f253c09d860 0x7f253c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.538+0000 7f253affd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f253c09e170 0x7f253c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.538+0000 7f253affd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f253c09e170 0x7f253c1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52240/0 (socket says 172.21.15.156:52240) 2023-09-30T22:24:32.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.538+0000 7f253b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f253c09d860 0x7f253c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:37902/0 (socket says 172.21.15.156:37902) 2023-09-30T22:24:32.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.538+0000 7f253bfff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f253c130ce0 0x7f253c1379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53252/0 (socket says 172.21.15.156:53252) 2023-09-30T22:24:32.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.538+0000 7f253affd700 1 -- 172.21.15.156:0/2975442038 learned_addr learned my addr 172.21.15.156:0/2975442038 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:32.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.538+0000 7f253affd700 1 -- 172.21.15.156:0/2975442038 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f253c09d860 msgr2=0x7f253c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:32.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.538+0000 7f253affd700 1 --2- 172.21.15.156:0/2975442038 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f253c09d860 0x7f253c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.538+0000 7f253affd700 1 -- 172.21.15.156:0/2975442038 >> v1:172.21.15.156:6789/0 conn(0x7f253c130ce0 legacy=0x7f253c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.539+0000 7f253affd700 1 -- 172.21.15.156:0/2975442038 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253c09b620 con 0x7f253c09e170 2023-09-30T22:24:32.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.539+0000 7f253b7fe700 1 --2- 172.21.15.156:0/2975442038 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f253c09d860 0x7f253c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:32.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.539+0000 7f253affd700 1 --2- 172.21.15.156:0/2975442038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f253c09e170 0x7f253c1307a0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f25240098f0 tx=0x7f2524009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18053e7f207fa9a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:32.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.539+0000 7f253a7fc700 1 -- 172.21.15.156:0/2975442038 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524004230 con 0x7f253c09e170 2023-09-30T22:24:32.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.539+0000 7f253a7fc700 1 -- 172.21.15.156:0/2975442038 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2524004390 con 0x7f253c09e170 2023-09-30T22:24:32.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.539+0000 7f253a7fc700 1 -- 172.21.15.156:0/2975442038 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25240036a0 con 0x7f253c09e170 2023-09-30T22:24:32.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.539+0000 7f2541cbc700 1 -- 172.21.15.156:0/2975442038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f253c09e170 msgr2=0x7f253c1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.539+0000 7f2541cbc700 1 --2- 172.21.15.156:0/2975442038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f253c09e170 0x7f253c1307a0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f25240098f0 tx=0x7f2524009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:32.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.539+0000 7f2541cbc700 1 -- 172.21.15.156:0/2975442038 shutdown_connections 2023-09-30T22:24:32.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.539+0000 7f2541cbc700 1 --2- 172.21.15.156:0/2975442038 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f253c09d860 0x7f253c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.539+0000 7f2541cbc700 1 --2- 172.21.15.156:0/2975442038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f253c09e170 0x7f253c1307a0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.539+0000 7f2541cbc700 1 -- 172.21.15.156:0/2975442038 >> 172.21.15.156:0/2975442038 conn(0x7f253c099c40 msgr2=0x7f253c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:32.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.539+0000 7f2541cbc700 1 -- 172.21.15.156:0/2975442038 shutdown_connections 2023-09-30T22:24:32.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.539+0000 7f2541cbc700 1 -- 172.21.15.156:0/2975442038 wait complete. 2023-09-30T22:24:32.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.541+0000 7f2541cbc700 1 Processor -- start 2023-09-30T22:24:32.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.541+0000 7f2541cbc700 1 -- start start 2023-09-30T22:24:32.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.541+0000 7f2541cbc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f253c09d860 0x7f253c1c5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.541+0000 7f2541cbc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f253c09e170 0x7f253c1c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.541+0000 7f2541cbc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f253c130ce0 0x7f253c1c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.541+0000 7f2541cbc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253c122180 con 0x7f253c09e170 2023-09-30T22:24:32.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.541+0000 7f2541cbc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253c120470 con 0x7f253c09d860 2023-09-30T22:24:32.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.541+0000 7f2541cbc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f253c09c8b0 con 0x7f253c130ce0 2023-09-30T22:24:32.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.542+0000 7f253affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f253c09e170 0x7f253c1c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.542+0000 7f253b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f253c09d860 0x7f253c1c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.542+0000 7f253affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f253c09e170 0x7f253c1c7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52248/0 (socket says 172.21.15.156:52248) 2023-09-30T22:24:32.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.542+0000 7f253b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f253c09d860 0x7f253c1c5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48982/0 (socket says 172.21.15.156:48982) 2023-09-30T22:24:32.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.542+0000 7f253affd700 1 -- 172.21.15.156:0/2613835050 learned_addr learned my addr 172.21.15.156:0/2613835050 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:32.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.542+0000 7f253bfff700 1 --2- 172.21.15.156:0/2613835050 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f253c130ce0 0x7f253c1c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.542+0000 7f253affd700 1 -- 172.21.15.156:0/2613835050 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f253c130ce0 msgr2=0x7f253c1c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.542+0000 7f253affd700 1 --2- 172.21.15.156:0/2613835050 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f253c130ce0 0x7f253c1c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.542+0000 7f253affd700 1 -- 172.21.15.156:0/2613835050 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f253c09d860 msgr2=0x7f253c1c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.542+0000 7f253affd700 1 --2- 172.21.15.156:0/2613835050 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f253c09d860 0x7f253c1c5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.542+0000 7f253affd700 1 -- 172.21.15.156:0/2613835050 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252c00b740 con 0x7f253c09e170 2023-09-30T22:24:32.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.542+0000 7f253affd700 1 --2- 172.21.15.156:0/2613835050 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f253c09e170 0x7f253c1c7a80 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f2524009130 tx=0x7f2524004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:32.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.542+0000 7f2533fff700 1 -- 172.21.15.156:0/2613835050 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25240045d0 con 0x7f253c09e170 2023-09-30T22:24:32.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.542+0000 7f2533fff700 1 -- 172.21.15.156:0/2613835050 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2524011630 con 0x7f253c09e170 2023-09-30T22:24:32.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.542+0000 7f2541cbc700 1 -- 172.21.15.156:0/2613835050 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2524009550 con 0x7f253c09e170 2023-09-30T22:24:32.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.542+0000 7f2533fff700 1 -- 172.21.15.156:0/2613835050 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25240119a0 con 0x7f253c09e170 2023-09-30T22:24:32.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.542+0000 7f2541cbc700 1 -- 172.21.15.156:0/2613835050 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f253c0a2140 con 0x7f253c09e170 2023-09-30T22:24:32.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.543+0000 7f2533fff700 1 -- 172.21.15.156:0/2613835050 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2524022020 con 0x7f253c09e170 2023-09-30T22:24:32.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.543+0000 7f2533fff700 1 -- 172.21.15.156:0/2613835050 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2524040e70 con 0x7f253c09e170 2023-09-30T22:24:32.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.543+0000 7f2541cbc700 1 -- 172.21.15.156:0/2613835050 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f253c0a31f0 con 0x7f253c09e170 2023-09-30T22:24:32.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.548+0000 7f2533fff700 1 -- 172.21.15.156:0/2613835050 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f252402a020 con 0x7f253c09e170 2023-09-30T22:24:32.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.735+0000 7f2541cbc700 1 -- 172.21.15.156:0/2613835050 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f253c04f2a0 con 0x7f253c09e170 2023-09-30T22:24:32.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.735+0000 7f2533fff700 1 -- 172.21.15.156:0/2613835050 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2524034090 con 0x7f253c09e170 2023-09-30T22:24:32.736 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:32.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.737+0000 7f2541cbc700 1 -- 172.21.15.156:0/2613835050 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f253c09e170 msgr2=0x7f253c1c7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.737+0000 7f2541cbc700 1 --2- 172.21.15.156:0/2613835050 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f253c09e170 0x7f253c1c7a80 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f2524009130 tx=0x7f2524004750 comp rx=0 tx=0).stop 2023-09-30T22:24:32.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.737+0000 7f2541cbc700 1 -- 172.21.15.156:0/2613835050 shutdown_connections 2023-09-30T22:24:32.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.737+0000 7f2541cbc700 1 --2- 172.21.15.156:0/2613835050 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f253c130ce0 0x7f253c1c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.737+0000 7f2541cbc700 1 --2- 172.21.15.156:0/2613835050 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f253c09d860 0x7f253c1c5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.737+0000 7f2541cbc700 1 --2- 172.21.15.156:0/2613835050 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f253c09e170 0x7f253c1c7a80 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.737+0000 7f2541cbc700 1 -- 172.21.15.156:0/2613835050 >> 172.21.15.156:0/2613835050 conn(0x7f253c099c40 msgr2=0x7f253c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:32.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.738+0000 7f2541cbc700 1 -- 172.21.15.156:0/2613835050 shutdown_connections 2023-09-30T22:24:32.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:32.738+0000 7f2541cbc700 1 -- 172.21.15.156:0/2613835050 wait complete. 2023-09-30T22:24:32.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:33.278 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:33.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.402+0000 7f4502f23700 1 Processor -- start 2023-09-30T22:24:33.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.402+0000 7f4502f23700 1 -- start start 2023-09-30T22:24:33.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.403+0000 7f4502f23700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f44fc136960 0x7f44fc138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.403+0000 7f4502f23700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44fc139280 0x7f44fc13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.403+0000 7f4502f23700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44fc06b2d0 con 0x7f44fc133ad0 2023-09-30T22:24:33.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.403+0000 7f4502f23700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44fc1345b0 con 0x7f44fc136960 2023-09-30T22:24:33.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.403+0000 7f4502f23700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc133610 con 0x7f44fc139280 2023-09-30T22:24:33.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.403+0000 7f44fbfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f44fc136960 0x7f44fc138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.403+0000 7f45014c0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44fc139280 0x7f44fc13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.403+0000 7f4500cbf700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f44fc133ad0 0x7f44fc133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53266/0 (socket says 172.21.15.156:53266) 2023-09-30T22:24:33.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.403+0000 7f4500cbf700 1 -- 172.21.15.156:0/3360842200 learned_addr learned my addr 172.21.15.156:0/3360842200 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:33.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.403+0000 7f44fbfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f44fc136960 0x7f44fc138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52250/0 (socket says 172.21.15.156:52250) 2023-09-30T22:24:33.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.403+0000 7f45014c0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44fc139280 0x7f44fc13b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48986/0 (socket says 172.21.15.156:48986) 2023-09-30T22:24:33.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.403+0000 7f44fb7fe700 1 -- 172.21.15.156:0/3360842200 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820457699 0 0) 0x7f44fc06b2d0 con 0x7f44fc133ad0 2023-09-30T22:24:33.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.403+0000 7f45014c0700 1 -- 172.21.15.156:0/3360842200 >> v2:172.21.15.156:3300/0 conn(0x7f44fc136960 msgr2=0x7f44fc138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:33.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.403+0000 7f45014c0700 1 --2- 172.21.15.156:0/3360842200 >> v2:172.21.15.156:3300/0 conn(0x7f44fc136960 0x7f44fc138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.403+0000 7f45014c0700 1 -- 172.21.15.156:0/3360842200 >> v1:172.21.15.156:6789/0 conn(0x7f44fc133ad0 legacy=0x7f44fc133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.403+0000 7f45014c0700 1 -- 172.21.15.156:0/3360842200 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44fc09a500 con 0x7f44fc139280 2023-09-30T22:24:33.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.403+0000 7f44fbfff700 1 --2- 172.21.15.156:0/3360842200 >> v2:172.21.15.156:3300/0 conn(0x7f44fc136960 0x7f44fc138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:33.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.403+0000 7f45014c0700 1 --2- 172.21.15.156:0/3360842200 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44fc139280 0x7f44fc13b660 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009d90 tx=0x7f44f400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48129e60dc6e79eb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:33.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.404+0000 7f44fb7fe700 1 -- 172.21.15.156:0/3360842200 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f400e070 con 0x7f44fc139280 2023-09-30T22:24:33.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.404+0000 7f44fb7fe700 1 -- 172.21.15.156:0/3360842200 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f400bb20 con 0x7f44fc139280 2023-09-30T22:24:33.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.404+0000 7f44fb7fe700 1 -- 172.21.15.156:0/3360842200 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f4012430 con 0x7f44fc139280 2023-09-30T22:24:33.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.404+0000 7f4502f23700 1 -- 172.21.15.156:0/3360842200 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44fc139280 msgr2=0x7f44fc13b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.404+0000 7f4502f23700 1 --2- 172.21.15.156:0/3360842200 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44fc139280 0x7f44fc13b660 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009d90 tx=0x7f44f400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:33.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.404+0000 7f4502f23700 1 -- 172.21.15.156:0/3360842200 shutdown_connections 2023-09-30T22:24:33.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.404+0000 7f4502f23700 1 --2- 172.21.15.156:0/3360842200 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44fc139280 0x7f44fc13b660 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.404+0000 7f4502f23700 1 --2- 172.21.15.156:0/3360842200 >> v2:172.21.15.156:3300/0 conn(0x7f44fc136960 0x7f44fc138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.404+0000 7f4502f23700 1 -- 172.21.15.156:0/3360842200 >> 172.21.15.156:0/3360842200 conn(0x7f44fc099c40 msgr2=0x7f44fc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:33.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.404+0000 7f4502f23700 1 -- 172.21.15.156:0/3360842200 shutdown_connections 2023-09-30T22:24:33.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.404+0000 7f4502f23700 1 -- 172.21.15.156:0/3360842200 wait complete. 2023-09-30T22:24:33.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.405+0000 7f4502f23700 1 Processor -- start 2023-09-30T22:24:33.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.405+0000 7f4502f23700 1 -- start start 2023-09-30T22:24:33.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.406+0000 7f4502f23700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44fc133ad0 0x7f44fc12cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.406+0000 7f4502f23700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44fc136960 0x7f44fc12d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.406+0000 7f4502f23700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f44fc139280 0x7f44fc12d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.406+0000 7f4502f23700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc06ff00 con 0x7f44fc133ad0 2023-09-30T22:24:33.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.406+0000 7f4502f23700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc1301d0 con 0x7f44fc136960 2023-09-30T22:24:33.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.406+0000 7f4502f23700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc1317a0 con 0x7f44fc139280 2023-09-30T22:24:33.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.406+0000 7f4500cbf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44fc133ad0 0x7f44fc12cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.406+0000 7f4500cbf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44fc133ad0 0x7f44fc12cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52260/0 (socket says 172.21.15.156:52260) 2023-09-30T22:24:33.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.406+0000 7f4500cbf700 1 -- 172.21.15.156:0/93596933 learned_addr learned my addr 172.21.15.156:0/93596933 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:33.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.406+0000 7f45014c0700 1 --2- 172.21.15.156:0/93596933 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f44fc139280 0x7f44fc12d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.406+0000 7f44fbfff700 1 --2- 172.21.15.156:0/93596933 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44fc136960 0x7f44fc12d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.406+0000 7f4500cbf700 1 -- 172.21.15.156:0/93596933 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f44fc139280 msgr2=0x7f44fc12d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.406+0000 7f4500cbf700 1 --2- 172.21.15.156:0/93596933 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f44fc139280 0x7f44fc12d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.406+0000 7f4500cbf700 1 -- 172.21.15.156:0/93596933 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44fc136960 msgr2=0x7f44fc12d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.406+0000 7f4500cbf700 1 --2- 172.21.15.156:0/93596933 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44fc136960 0x7f44fc12d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.406+0000 7f4500cbf700 1 -- 172.21.15.156:0/93596933 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e80094a0 con 0x7f44fc133ad0 2023-09-30T22:24:33.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.406+0000 7f4500cbf700 1 --2- 172.21.15.156:0/93596933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44fc133ad0 0x7f44fc12cb30 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f44f000c550 tx=0x7f44f000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:33.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.406+0000 7f44f97fa700 1 -- 172.21.15.156:0/93596933 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f0004c80 con 0x7f44fc133ad0 2023-09-30T22:24:33.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.406+0000 7f44f97fa700 1 -- 172.21.15.156:0/93596933 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f0004de0 con 0x7f44fc133ad0 2023-09-30T22:24:33.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.406+0000 7f4502f23700 1 -- 172.21.15.156:0/93596933 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f4009a70 con 0x7f44fc133ad0 2023-09-30T22:24:33.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.406+0000 7f44f97fa700 1 -- 172.21.15.156:0/93596933 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f0007310 con 0x7f44fc133ad0 2023-09-30T22:24:33.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.406+0000 7f4502f23700 1 -- 172.21.15.156:0/93596933 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44fc070ba0 con 0x7f44fc133ad0 2023-09-30T22:24:33.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.407+0000 7f44f97fa700 1 -- 172.21.15.156:0/93596933 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f44f0007470 con 0x7f44fc133ad0 2023-09-30T22:24:33.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.407+0000 7f4502f23700 1 -- 172.21.15.156:0/93596933 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44fc06be10 con 0x7f44fc133ad0 2023-09-30T22:24:33.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.407+0000 7f44f97fa700 1 -- 172.21.15.156:0/93596933 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f44f003f240 con 0x7f44fc133ad0 2023-09-30T22:24:33.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.412+0000 7f44f97fa700 1 -- 172.21.15.156:0/93596933 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f44f00123b0 con 0x7f44fc133ad0 2023-09-30T22:24:33.419 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:33.471 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:33.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.543+0000 7f86f4ced700 1 Processor -- start 2023-09-30T22:24:33.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.543+0000 7f86f4ced700 1 -- start start 2023-09-30T22:24:33.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.544+0000 7f86f4ced700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86f006a770 0x7f86f006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.544+0000 7f86f4ced700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f86f006b080 0x7f86f01317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.544+0000 7f86f4ced700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f009da80 con 0x7f86f0131cf0 2023-09-30T22:24:33.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.544+0000 7f86f4ced700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f009dce0 con 0x7f86f006a770 2023-09-30T22:24:33.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.544+0000 7f86f4ced700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86f009eb20 con 0x7f86f006b080 2023-09-30T22:24:33.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.544+0000 7f86edd9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f86f006b080 0x7f86f01317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.544+0000 7f86ee59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86f006a770 0x7f86f006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.544+0000 7f86eed9d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f86f0131cf0 0x7f86f0138c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53270/0 (socket says 172.21.15.156:53270) 2023-09-30T22:24:33.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.544+0000 7f86eed9d700 1 -- 172.21.15.156:0/2222320099 learned_addr learned my addr 172.21.15.156:0/2222320099 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:33.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.544+0000 7f86ee59c700 1 -- 172.21.15.156:0/2222320099 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f86f006b080 msgr2=0x7f86f01317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:33.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.544+0000 7f86ed59a700 1 -- 172.21.15.156:0/2222320099 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 136789777 0 0) 0x7f86f009da80 con 0x7f86f0131cf0 2023-09-30T22:24:33.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.544+0000 7f86ee59c700 1 --2- 172.21.15.156:0/2222320099 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f86f006b080 0x7f86f01317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.544+0000 7f86ee59c700 1 -- 172.21.15.156:0/2222320099 >> v1:172.21.15.156:6789/0 conn(0x7f86f0131cf0 legacy=0x7f86f0138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.544+0000 7f86ee59c700 1 -- 172.21.15.156:0/2222320099 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f009d860 con 0x7f86f006a770 2023-09-30T22:24:33.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.544+0000 7f86edd9b700 1 --2- 172.21.15.156:0/2222320099 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f86f006b080 0x7f86f01317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:33.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.545+0000 7f86ee59c700 1 --2- 172.21.15.156:0/2222320099 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86f006a770 0x7f86f006ab40 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f86e00098a0 tx=0x7f86e0009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec6cbe4d7cd46f8d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:33.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.545+0000 7f86ed59a700 1 -- 172.21.15.156:0/2222320099 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0011830 con 0x7f86f006a770 2023-09-30T22:24:33.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.545+0000 7f86ed59a700 1 -- 172.21.15.156:0/2222320099 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e0011990 con 0x7f86f006a770 2023-09-30T22:24:33.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.545+0000 7f86ed59a700 1 -- 172.21.15.156:0/2222320099 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0011d20 con 0x7f86f006a770 2023-09-30T22:24:33.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.546+0000 7f86f4ced700 1 -- 172.21.15.156:0/2222320099 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86f006a770 msgr2=0x7f86f006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.546+0000 7f86f4ced700 1 --2- 172.21.15.156:0/2222320099 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86f006a770 0x7f86f006ab40 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f86e00098a0 tx=0x7f86e0009bb0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.546+0000 7f86f4ced700 1 -- 172.21.15.156:0/2222320099 shutdown_connections 2023-09-30T22:24:33.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.546+0000 7f86f4ced700 1 --2- 172.21.15.156:0/2222320099 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86f006a770 0x7f86f006ab40 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.546+0000 7f86f4ced700 1 --2- 172.21.15.156:0/2222320099 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f86f006b080 0x7f86f01317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.546+0000 7f86f4ced700 1 -- 172.21.15.156:0/2222320099 >> 172.21.15.156:0/2222320099 conn(0x7f86f0099c40 msgr2=0x7f86f00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:33.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.546+0000 7f86f4ced700 1 -- 172.21.15.156:0/2222320099 shutdown_connections 2023-09-30T22:24:33.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.546+0000 7f86f4ced700 1 -- 172.21.15.156:0/2222320099 wait complete. 2023-09-30T22:24:33.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.547+0000 7f86f4ced700 1 Processor -- start 2023-09-30T22:24:33.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.547+0000 7f86f4ced700 1 -- start start 2023-09-30T22:24:33.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.548+0000 7f86f4ced700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86f006a770 0x7f86f009abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.548+0000 7f86f4ced700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f86f006b080 0x7f86f009b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.548+0000 7f86f4ced700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86f0131cf0 0x7f86f01c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.548+0000 7f86f4ced700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f0120e50 con 0x7f86f0131cf0 2023-09-30T22:24:33.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.548+0000 7f86f4ced700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f01221b0 con 0x7f86f006a770 2023-09-30T22:24:33.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.548+0000 7f86f4ced700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86f009a9a0 con 0x7f86f006b080 2023-09-30T22:24:33.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.548+0000 7f86ee59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86f006a770 0x7f86f009abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.548+0000 7f86ee59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86f006a770 0x7f86f009abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49010/0 (socket says 172.21.15.156:49010) 2023-09-30T22:24:33.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.548+0000 7f86ee59c700 1 -- 172.21.15.156:0/4110675620 learned_addr learned my addr 172.21.15.156:0/4110675620 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:33.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.548+0000 7f86edd9b700 1 --2- 172.21.15.156:0/4110675620 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f86f006b080 0x7f86f009b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.548+0000 7f86eed9d700 1 --2- 172.21.15.156:0/4110675620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86f0131cf0 0x7f86f01c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.548+0000 7f86ee59c700 1 -- 172.21.15.156:0/4110675620 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f86f006b080 msgr2=0x7f86f009b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.549+0000 7f86ee59c700 1 --2- 172.21.15.156:0/4110675620 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f86f006b080 0x7f86f009b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.549+0000 7f86ee59c700 1 -- 172.21.15.156:0/4110675620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86f0131cf0 msgr2=0x7f86f01c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.549+0000 7f86ee59c700 1 --2- 172.21.15.156:0/4110675620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86f0131cf0 0x7f86f01c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.549+0000 7f86ee59c700 1 -- 172.21.15.156:0/4110675620 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e40094a0 con 0x7f86f006a770 2023-09-30T22:24:33.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.549+0000 7f86eed9d700 1 --2- 172.21.15.156:0/4110675620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86f0131cf0 0x7f86f01c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:33.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.549+0000 7f86ee59c700 1 --2- 172.21.15.156:0/4110675620 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86f006a770 0x7f86f009abc0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f86e00090b0 tx=0x7f86e0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:33.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.549+0000 7f86deffd700 1 -- 172.21.15.156:0/4110675620 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0004240 con 0x7f86f006a770 2023-09-30T22:24:33.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.549+0000 7f86deffd700 1 -- 172.21.15.156:0/4110675620 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e001f070 con 0x7f86f006a770 2023-09-30T22:24:33.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.549+0000 7f86f4ced700 1 -- 172.21.15.156:0/4110675620 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e00094a0 con 0x7f86f006a770 2023-09-30T22:24:33.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.549+0000 7f86deffd700 1 -- 172.21.15.156:0/4110675620 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e00045a0 con 0x7f86f006a770 2023-09-30T22:24:33.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.549+0000 7f86f4ced700 1 -- 172.21.15.156:0/4110675620 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f0131590 con 0x7f86f006a770 2023-09-30T22:24:33.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.550+0000 7f86deffd700 1 -- 172.21.15.156:0/4110675620 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f86e0021030 con 0x7f86f006a770 2023-09-30T22:24:33.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.550+0000 7f86deffd700 1 -- 172.21.15.156:0/4110675620 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f86e00406f0 con 0x7f86f006a770 2023-09-30T22:24:33.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.550+0000 7f86f4ced700 1 -- 172.21.15.156:0/4110675620 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f006be10 con 0x7f86f006a770 2023-09-30T22:24:33.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.555+0000 7f86deffd700 1 -- 172.21.15.156:0/4110675620 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f86e0015080 con 0x7f86f006a770 2023-09-30T22:24:33.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.599+0000 7fcf25586700 1 Processor -- start 2023-09-30T22:24:33.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.599+0000 7fcf25586700 1 -- start start 2023-09-30T22:24:33.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.599+0000 7fcf25586700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcf20099e20 0x7fcf2009a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.599+0000 7fcf25586700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf2009a730 0x7fcf20130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.600+0000 7fcf25586700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf20099a60 con 0x7fcf20130890 2023-09-30T22:24:33.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.600+0000 7fcf25586700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2009bf50 con 0x7fcf20099e20 2023-09-30T22:24:33.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.600+0000 7fcf25586700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2009b230 con 0x7fcf2009a730 2023-09-30T22:24:33.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.600+0000 7fcf1effd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcf20099e20 0x7fcf2009a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.600+0000 7fcf1e7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf2009a730 0x7fcf20130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.600+0000 7fcf1f7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fcf20130890 0x7fcf20137680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53272/0 (socket says 172.21.15.156:53272) 2023-09-30T22:24:33.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.600+0000 7fcf1f7fe700 1 -- 172.21.15.156:0/670812115 learned_addr learned my addr 172.21.15.156:0/670812115 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:33.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.600+0000 7fcf1e7fc700 1 -- 172.21.15.156:0/670812115 >> v2:172.21.15.156:3300/0 conn(0x7fcf20099e20 msgr2=0x7fcf2009a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:33.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.600+0000 7fcf1e7fc700 1 --2- 172.21.15.156:0/670812115 >> v2:172.21.15.156:3300/0 conn(0x7fcf20099e20 0x7fcf2009a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.600+0000 7fcf1e7fc700 1 -- 172.21.15.156:0/670812115 >> v1:172.21.15.156:6789/0 conn(0x7fcf20130890 legacy=0x7fcf20137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.600+0000 7fcf1e7fc700 1 -- 172.21.15.156:0/670812115 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2009bb90 con 0x7fcf2009a730 2023-09-30T22:24:33.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.600+0000 7fcf1effd700 1 --2- 172.21.15.156:0/670812115 >> v2:172.21.15.156:3300/0 conn(0x7fcf20099e20 0x7fcf2009a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:33.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.600+0000 7fcf1e7fc700 1 --2- 172.21.15.156:0/670812115 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf2009a730 0x7fcf20130350 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcf14009840 tx=0x7fcf14009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3785ac2ff3c11220 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:33.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.600+0000 7fcf1dffb700 1 -- 172.21.15.156:0/670812115 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf14011830 con 0x7fcf2009a730 2023-09-30T22:24:33.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.600+0000 7fcf1dffb700 1 -- 172.21.15.156:0/670812115 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf14011990 con 0x7fcf2009a730 2023-09-30T22:24:33.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.600+0000 7fcf1dffb700 1 -- 172.21.15.156:0/670812115 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf14011d20 con 0x7fcf2009a730 2023-09-30T22:24:33.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.601+0000 7fcf25586700 1 -- 172.21.15.156:0/670812115 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf2009a730 msgr2=0x7fcf20130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.601+0000 7fcf25586700 1 --2- 172.21.15.156:0/670812115 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf2009a730 0x7fcf20130350 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcf14009840 tx=0x7fcf14009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:33.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.601+0000 7fcf25586700 1 -- 172.21.15.156:0/670812115 shutdown_connections 2023-09-30T22:24:33.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.601+0000 7fcf25586700 1 --2- 172.21.15.156:0/670812115 >> v2:172.21.15.156:3300/0 conn(0x7fcf20099e20 0x7fcf2009a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.601+0000 7fcf25586700 1 --2- 172.21.15.156:0/670812115 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf2009a730 0x7fcf20130350 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.601+0000 7fcf25586700 1 -- 172.21.15.156:0/670812115 >> 172.21.15.156:0/670812115 conn(0x7fcf200a2980 msgr2=0x7fcf200a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:33.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.601+0000 7fcf25586700 1 -- 172.21.15.156:0/670812115 shutdown_connections 2023-09-30T22:24:33.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.601+0000 7fcf25586700 1 -- 172.21.15.156:0/670812115 wait complete. 2023-09-30T22:24:33.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.602+0000 7fcf25586700 1 Processor -- start 2023-09-30T22:24:33.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.602+0000 7fcf25586700 1 -- start start 2023-09-30T22:24:33.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.603+0000 7fcf25586700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf20099e20 0x7fcf2009d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.603+0000 7fcf25586700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf2009a730 0x7fcf2009d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.603+0000 7fcf25586700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf20130890 0x7fcf2009dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.603+0000 7fcf25586700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf20120620 con 0x7fcf2009a730 2023-09-30T22:24:33.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.603+0000 7fcf25586700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2009e650 con 0x7fcf20130890 2023-09-30T22:24:33.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.603+0000 7fcf25586700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2009b470 con 0x7fcf20099e20 2023-09-30T22:24:33.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.603+0000 7fcf1e7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf2009a730 0x7fcf2009d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.603+0000 7fcf1e7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf2009a730 0x7fcf2009d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52284/0 (socket says 172.21.15.156:52284) 2023-09-30T22:24:33.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.603+0000 7fcf1e7fc700 1 -- 172.21.15.156:0/3668830152 learned_addr learned my addr 172.21.15.156:0/3668830152 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:33.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.603+0000 7fcf1effd700 1 --2- 172.21.15.156:0/3668830152 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf20099e20 0x7fcf2009d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.603+0000 7fcf1f7fe700 1 --2- 172.21.15.156:0/3668830152 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf20130890 0x7fcf2009dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.603+0000 7fcf1e7fc700 1 -- 172.21.15.156:0/3668830152 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf20099e20 msgr2=0x7fcf2009d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.603+0000 7fcf1e7fc700 1 --2- 172.21.15.156:0/3668830152 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf20099e20 0x7fcf2009d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.603+0000 7fcf1e7fc700 1 -- 172.21.15.156:0/3668830152 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf20130890 msgr2=0x7fcf2009dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.603+0000 7fcf1e7fc700 1 --2- 172.21.15.156:0/3668830152 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf20130890 0x7fcf2009dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.604+0000 7fcf1e7fc700 1 -- 172.21.15.156:0/3668830152 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf10009430 con 0x7fcf2009a730 2023-09-30T22:24:33.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.604+0000 7fcf1e7fc700 1 --2- 172.21.15.156:0/3668830152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf2009a730 0x7fcf2009d730 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fcf140090b0 tx=0x7fcf14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:33.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.604+0000 7fcf077fe700 1 -- 172.21.15.156:0/3668830152 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf14004550 con 0x7fcf2009a730 2023-09-30T22:24:33.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.604+0000 7fcf077fe700 1 -- 172.21.15.156:0/3668830152 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1401f070 con 0x7fcf2009a730 2023-09-30T22:24:33.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.604+0000 7fcf25586700 1 -- 172.21.15.156:0/3668830152 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf140094a0 con 0x7fcf2009a730 2023-09-30T22:24:33.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.604+0000 7fcf077fe700 1 -- 172.21.15.156:0/3668830152 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf140038e0 con 0x7fcf2009a730 2023-09-30T22:24:33.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.604+0000 7fcf25586700 1 -- 172.21.15.156:0/3668830152 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2011fd10 con 0x7fcf2009a730 2023-09-30T22:24:33.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.605+0000 7fcf077fe700 1 -- 172.21.15.156:0/3668830152 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf14003a40 con 0x7fcf2009a730 2023-09-30T22:24:33.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.605+0000 7fcf077fe700 1 -- 172.21.15.156:0/3668830152 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcf14021070 con 0x7fcf2009a730 2023-09-30T22:24:33.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.605+0000 7fcf25586700 1 -- 172.21.15.156:0/3668830152 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf20070f60 con 0x7fcf2009a730 2023-09-30T22:24:33.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.612+0000 7f4502f23700 1 -- 172.21.15.156:0/93596933 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f44fc04f2a0 con 0x7f44fc133ad0 2023-09-30T22:24:33.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.614+0000 7f44f97fa700 1 -- 172.21.15.156:0/93596933 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f44f0011360 con 0x7f44fc133ad0 2023-09-30T22:24:33.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.614+0000 7fcf077fe700 1 -- 172.21.15.156:0/3668830152 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf1402b080 con 0x7fcf2009a730 2023-09-30T22:24:33.616 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:33.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.616+0000 7f4502f23700 1 -- 172.21.15.156:0/93596933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44fc133ad0 msgr2=0x7f44fc12cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.616+0000 7f4502f23700 1 --2- 172.21.15.156:0/93596933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44fc133ad0 0x7f44fc12cb30 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f44f000c550 tx=0x7f44f000c860 comp rx=0 tx=0).stop 2023-09-30T22:24:33.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.616+0000 7f4502f23700 1 -- 172.21.15.156:0/93596933 shutdown_connections 2023-09-30T22:24:33.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.616+0000 7f4502f23700 1 --2- 172.21.15.156:0/93596933 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f44fc139280 0x7f44fc12d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.616+0000 7f4502f23700 1 --2- 172.21.15.156:0/93596933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44fc133ad0 0x7f44fc12cb30 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.616+0000 7f4502f23700 1 --2- 172.21.15.156:0/93596933 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f44fc136960 0x7f44fc12d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.616+0000 7f4502f23700 1 -- 172.21.15.156:0/93596933 >> 172.21.15.156:0/93596933 conn(0x7f44fc099c40 msgr2=0x7f44fc0a30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:33.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.616+0000 7f4502f23700 1 -- 172.21.15.156:0/93596933 shutdown_connections 2023-09-30T22:24:33.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.616+0000 7f4502f23700 1 -- 172.21.15.156:0/93596933 wait complete. 2023-09-30T22:24:33.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:33.751 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:33.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.755+0000 7f86f4ced700 1 -- 172.21.15.156:0/4110675620 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f86f01222f0 con 0x7f86f006a770 2023-09-30T22:24:33.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.755+0000 7f86deffd700 1 -- 172.21.15.156:0/4110675620 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f86f01222f0 con 0x7f86f006a770 2023-09-30T22:24:33.756 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:33.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.757+0000 7f86f4ced700 1 -- 172.21.15.156:0/4110675620 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86f006a770 msgr2=0x7f86f009abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.757+0000 7f86f4ced700 1 --2- 172.21.15.156:0/4110675620 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86f006a770 0x7f86f009abc0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f86e00090b0 tx=0x7f86e0004750 comp rx=0 tx=0).stop 2023-09-30T22:24:33.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.757+0000 7f86f4ced700 1 -- 172.21.15.156:0/4110675620 shutdown_connections 2023-09-30T22:24:33.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.757+0000 7f86f4ced700 1 --2- 172.21.15.156:0/4110675620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86f0131cf0 0x7f86f01c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.757+0000 7f86f4ced700 1 --2- 172.21.15.156:0/4110675620 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86f006a770 0x7f86f009abc0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.757+0000 7f86f4ced700 1 --2- 172.21.15.156:0/4110675620 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f86f006b080 0x7f86f009b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.757+0000 7f86f4ced700 1 -- 172.21.15.156:0/4110675620 >> 172.21.15.156:0/4110675620 conn(0x7f86f0099c40 msgr2=0x7f86f01b99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:33.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.758+0000 7f86f4ced700 1 -- 172.21.15.156:0/4110675620 shutdown_connections 2023-09-30T22:24:33.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.758+0000 7f86f4ced700 1 -- 172.21.15.156:0/4110675620 wait complete. 2023-09-30T22:24:33.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:33.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.808+0000 7fcf25586700 1 -- 172.21.15.156:0/3668830152 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcf2004f2a0 con 0x7fcf2009a730 2023-09-30T22:24:33.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.808+0000 7fcf077fe700 1 -- 172.21.15.156:0/3668830152 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcf14015020 con 0x7fcf2009a730 2023-09-30T22:24:33.809 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:33.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.810+0000 7fcf25586700 1 -- 172.21.15.156:0/3668830152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf2009a730 msgr2=0x7fcf2009d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.810+0000 7fcf25586700 1 --2- 172.21.15.156:0/3668830152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf2009a730 0x7fcf2009d730 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fcf140090b0 tx=0x7fcf14004750 comp rx=0 tx=0).stop 2023-09-30T22:24:33.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.810+0000 7fcf25586700 1 -- 172.21.15.156:0/3668830152 shutdown_connections 2023-09-30T22:24:33.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.810+0000 7fcf25586700 1 --2- 172.21.15.156:0/3668830152 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcf20130890 0x7fcf2009dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.811 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.810+0000 7fcf25586700 1 --2- 172.21.15.156:0/3668830152 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcf20099e20 0x7fcf2009d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.810+0000 7fcf25586700 1 --2- 172.21.15.156:0/3668830152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf2009a730 0x7fcf2009d730 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.810+0000 7fcf25586700 1 -- 172.21.15.156:0/3668830152 >> 172.21.15.156:0/3668830152 conn(0x7fcf200a2980 msgr2=0x7fcf2006e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:33.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.810+0000 7fcf25586700 1 -- 172.21.15.156:0/3668830152 shutdown_connections 2023-09-30T22:24:33.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.810+0000 7fcf25586700 1 -- 172.21.15.156:0/3668830152 wait complete. 2023-09-30T22:24:33.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:33.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.877+0000 7f9a7976f700 1 Processor -- start 2023-09-30T22:24:33.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.877+0000 7f9a7976f700 1 -- start start 2023-09-30T22:24:33.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.877+0000 7f9a7976f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9a740a0a70 0x7f9a740a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.877+0000 7f9a7976f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a74134120 0x7f9a7413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.877+0000 7f9a7976f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a7409dc00 con 0x7f9a740a1380 2023-09-30T22:24:33.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.877+0000 7f9a7976f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a7409ea90 con 0x7f9a740a0a70 2023-09-30T22:24:33.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.877+0000 7f9a7976f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7409dec0 con 0x7f9a74134120 2023-09-30T22:24:33.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.878+0000 7f9a72ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9a740a0a70 0x7f9a740a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.878+0000 7f9a737fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a74134120 0x7f9a7413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.878+0000 7f9a72ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9a740a0a70 0x7f9a740a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52296/0 (socket says 172.21.15.156:52296) 2023-09-30T22:24:33.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.878+0000 7f9a72ffd700 1 -- 172.21.15.156:0/3518334438 learned_addr learned my addr 172.21.15.156:0/3518334438 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:33.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.878+0000 7f9a737fe700 1 -- 172.21.15.156:0/3518334438 >> v2:172.21.15.156:3300/0 conn(0x7f9a740a0a70 msgr2=0x7f9a740a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:33.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.878+0000 7f9a737fe700 1 --2- 172.21.15.156:0/3518334438 >> v2:172.21.15.156:3300/0 conn(0x7f9a740a0a70 0x7f9a740a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.878+0000 7f9a737fe700 1 -- 172.21.15.156:0/3518334438 >> v1:172.21.15.156:6789/0 conn(0x7f9a740a1380 legacy=0x7f9a74133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.878+0000 7f9a737fe700 1 -- 172.21.15.156:0/3518334438 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7409e6a0 con 0x7f9a74134120 2023-09-30T22:24:33.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.878+0000 7f9a71ffb700 1 -- 172.21.15.156:0/3518334438 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1200775257 0 0) 0x7f9a7409dc00 con 0x7f9a740a1380 2023-09-30T22:24:33.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.878+0000 7f9a72ffd700 1 --2- 172.21.15.156:0/3518334438 >> v2:172.21.15.156:3300/0 conn(0x7f9a740a0a70 0x7f9a740a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:33.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.878+0000 7f9a737fe700 1 --2- 172.21.15.156:0/3518334438 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a74134120 0x7f9a7413bce0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c009d90 tx=0x7f9a6c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c888532a39f9e653 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:33.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.878+0000 7f9a71ffb700 1 -- 172.21.15.156:0/3518334438 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c00e070 con 0x7f9a74134120 2023-09-30T22:24:33.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.878+0000 7f9a71ffb700 1 -- 172.21.15.156:0/3518334438 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6c00bb20 con 0x7f9a74134120 2023-09-30T22:24:33.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.878+0000 7f9a71ffb700 1 -- 172.21.15.156:0/3518334438 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c012430 con 0x7f9a74134120 2023-09-30T22:24:33.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.879+0000 7f9a7976f700 1 -- 172.21.15.156:0/3518334438 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a74134120 msgr2=0x7f9a7413bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.879+0000 7f9a7976f700 1 --2- 172.21.15.156:0/3518334438 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a74134120 0x7f9a7413bce0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c009d90 tx=0x7f9a6c00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:33.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.879+0000 7f9a7976f700 1 -- 172.21.15.156:0/3518334438 shutdown_connections 2023-09-30T22:24:33.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.879+0000 7f9a7976f700 1 --2- 172.21.15.156:0/3518334438 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a74134120 0x7f9a7413bce0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.879+0000 7f9a7976f700 1 --2- 172.21.15.156:0/3518334438 >> v2:172.21.15.156:3300/0 conn(0x7f9a740a0a70 0x7f9a740a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.879+0000 7f9a7976f700 1 -- 172.21.15.156:0/3518334438 >> 172.21.15.156:0/3518334438 conn(0x7f9a740a6610 msgr2=0x7f9a740a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:33.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.879+0000 7f9a7976f700 1 -- 172.21.15.156:0/3518334438 shutdown_connections 2023-09-30T22:24:33.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.879+0000 7f9a7976f700 1 -- 172.21.15.156:0/3518334438 wait complete. 2023-09-30T22:24:33.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.880+0000 7f9a7976f700 1 Processor -- start 2023-09-30T22:24:33.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.880+0000 7f9a7976f700 1 -- start start 2023-09-30T22:24:33.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.880+0000 7f9a7976f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9a740a0a70 0x7f9a74122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.880+0000 7f9a7976f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a740a1380 0x7f9a74122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.880+0000 7f9a7976f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a74134120 0x7f9a741231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.880+0000 7f9a7976f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a74124360 con 0x7f9a74134120 2023-09-30T22:24:33.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.880+0000 7f9a7976f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a741336a0 con 0x7f9a740a1380 2023-09-30T22:24:33.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.880+0000 7f9a7976f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a741332e0 con 0x7f9a740a0a70 2023-09-30T22:24:33.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.880+0000 7f9a727fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a740a1380 0x7f9a74122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.880+0000 7f9a72ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9a740a0a70 0x7f9a74122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.880+0000 7f9a737fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a74134120 0x7f9a741231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.880+0000 7f9a727fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a740a1380 0x7f9a74122c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49034/0 (socket says 172.21.15.156:49034) 2023-09-30T22:24:33.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.880+0000 7f9a72ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9a740a0a70 0x7f9a74122750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:37954/0 (socket says 172.21.15.156:37954) 2023-09-30T22:24:33.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.880+0000 7f9a727fc700 1 -- 172.21.15.156:0/1175977701 learned_addr learned my addr 172.21.15.156:0/1175977701 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:33.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.880+0000 7f9a737fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a74134120 0x7f9a741231d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52304/0 (socket says 172.21.15.156:52304) 2023-09-30T22:24:33.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.881+0000 7f9a737fe700 1 -- 172.21.15.156:0/1175977701 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9a740a0a70 msgr2=0x7f9a74122750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.881+0000 7f9a737fe700 1 --2- 172.21.15.156:0/1175977701 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9a740a0a70 0x7f9a74122750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.881+0000 7f9a737fe700 1 -- 172.21.15.156:0/1175977701 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a740a1380 msgr2=0x7f9a74122c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.881+0000 7f9a737fe700 1 --2- 172.21.15.156:0/1175977701 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a740a1380 0x7f9a74122c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.881+0000 7f9a737fe700 1 -- 172.21.15.156:0/1175977701 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a68009550 con 0x7f9a74134120 2023-09-30T22:24:33.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.881+0000 7f9a727fc700 1 --2- 172.21.15.156:0/1175977701 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a740a1380 0x7f9a74122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:33.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.881+0000 7f9a737fe700 1 --2- 172.21.15.156:0/1175977701 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a74134120 0x7f9a741231d0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c016000 tx=0x7f9a6c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:33.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.881+0000 7f9a5b7fe700 1 -- 172.21.15.156:0/1175977701 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c012430 con 0x7f9a74134120 2023-09-30T22:24:33.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.881+0000 7f9a5b7fe700 1 -- 172.21.15.156:0/1175977701 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6c020070 con 0x7f9a74134120 2023-09-30T22:24:33.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.881+0000 7f9a7976f700 1 -- 172.21.15.156:0/1175977701 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a6c009a70 con 0x7f9a74134120 2023-09-30T22:24:33.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.881+0000 7f9a5b7fe700 1 -- 172.21.15.156:0/1175977701 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c004280 con 0x7f9a74134120 2023-09-30T22:24:33.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.881+0000 7f9a7976f700 1 -- 172.21.15.156:0/1175977701 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a740a0440 con 0x7f9a74134120 2023-09-30T22:24:33.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.882+0000 7f9a7976f700 1 -- 172.21.15.156:0/1175977701 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a7404f2a0 con 0x7f9a74134120 2023-09-30T22:24:33.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.882+0000 7f9a5b7fe700 1 -- 172.21.15.156:0/1175977701 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9a6c0043e0 con 0x7f9a74134120 2023-09-30T22:24:33.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.882+0000 7f9a5b7fe700 1 -- 172.21.15.156:0/1175977701 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9a6c022070 con 0x7f9a74134120 2023-09-30T22:24:33.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:33.887+0000 7f9a5b7fe700 1 -- 172.21.15.156:0/1175977701 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9a6c011980 con 0x7f9a74134120 2023-09-30T22:24:34.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.072+0000 7f9a7976f700 1 -- 172.21.15.156:0/1175977701 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9a74126a60 con 0x7f9a74134120 2023-09-30T22:24:34.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.072+0000 7f9a5b7fe700 1 -- 172.21.15.156:0/1175977701 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9a6c02c020 con 0x7f9a74134120 2023-09-30T22:24:34.073 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:34.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.074+0000 7f9a7976f700 1 -- 172.21.15.156:0/1175977701 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a74134120 msgr2=0x7f9a741231d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.074+0000 7f9a7976f700 1 --2- 172.21.15.156:0/1175977701 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a74134120 0x7f9a741231d0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c016000 tx=0x7f9a6c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.074+0000 7f9a7976f700 1 -- 172.21.15.156:0/1175977701 shutdown_connections 2023-09-30T22:24:34.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.074+0000 7f9a7976f700 1 --2- 172.21.15.156:0/1175977701 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a74134120 0x7f9a741231d0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.074+0000 7f9a7976f700 1 --2- 172.21.15.156:0/1175977701 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9a740a0a70 0x7f9a74122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.074+0000 7f9a7976f700 1 --2- 172.21.15.156:0/1175977701 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9a740a1380 0x7f9a74122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.074+0000 7f9a7976f700 1 -- 172.21.15.156:0/1175977701 >> 172.21.15.156:0/1175977701 conn(0x7f9a740a6610 msgr2=0x7f9a740a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:34.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.074+0000 7f9a7976f700 1 -- 172.21.15.156:0/1175977701 shutdown_connections 2023-09-30T22:24:34.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.074+0000 7f9a7976f700 1 -- 172.21.15.156:0/1175977701 wait complete. 2023-09-30T22:24:34.087 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:34.630 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:34.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.756+0000 7f82cbd69700 1 Processor -- start 2023-09-30T22:24:34.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.757+0000 7f82cbd69700 1 -- start start 2023-09-30T22:24:34.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.757+0000 7f82cbd69700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f82c4133ad0 0x7f82c4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.757+0000 7f82cbd69700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f82c4130bc0 0x7f82c413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.757+0000 7f82cbd69700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c406b2d0 con 0x7f82c41300a0 2023-09-30T22:24:34.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.757+0000 7f82cbd69700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c4133610 con 0x7f82c4133ad0 2023-09-30T22:24:34.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.757+0000 7f82cbd69700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82c409a500 con 0x7f82c4130bc0 2023-09-30T22:24:34.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.757+0000 7f82c9b05700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f82c4133ad0 0x7f82c4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.757+0000 7f82ca306700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f82c4130bc0 0x7f82c413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.757+0000 7f82c9304700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f82c41300a0 0x7f82c41304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53292/0 (socket says 172.21.15.156:53292) 2023-09-30T22:24:34.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.757+0000 7f82c9b05700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f82c4133ad0 0x7f82c4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49036/0 (socket says 172.21.15.156:49036) 2023-09-30T22:24:34.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.757+0000 7f82c9304700 1 -- 172.21.15.156:0/3612297983 learned_addr learned my addr 172.21.15.156:0/3612297983 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:34.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.757+0000 7f82c8b03700 1 -- 172.21.15.156:0/3612297983 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 102455902 0 0) 0x7f82c406b2d0 con 0x7f82c41300a0 2023-09-30T22:24:34.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.757+0000 7f82ca306700 1 -- 172.21.15.156:0/3612297983 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f82c4133ad0 msgr2=0x7f82c4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:34.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.757+0000 7f82ca306700 1 --2- 172.21.15.156:0/3612297983 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f82c4133ad0 0x7f82c4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.758+0000 7f82ca306700 1 -- 172.21.15.156:0/3612297983 >> v1:172.21.15.156:6789/0 conn(0x7f82c41300a0 legacy=0x7f82c41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.758+0000 7f82ca306700 1 -- 172.21.15.156:0/3612297983 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c41338b0 con 0x7f82c4130bc0 2023-09-30T22:24:34.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.758+0000 7f82c9b05700 1 --2- 172.21.15.156:0/3612297983 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f82c4133ad0 0x7f82c4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:34.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.758+0000 7f82ca306700 1 --2- 172.21.15.156:0/3612297983 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f82c4130bc0 0x7f82c413b990 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f82bc009dc0 tx=0x7f82bc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4339ea5a91ab5937 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:34.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.758+0000 7f82c8b03700 1 -- 172.21.15.156:0/3612297983 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc00e070 con 0x7f82c4130bc0 2023-09-30T22:24:34.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.758+0000 7f82c8b03700 1 -- 172.21.15.156:0/3612297983 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82bc00bb20 con 0x7f82c4130bc0 2023-09-30T22:24:34.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.758+0000 7f82c8b03700 1 -- 172.21.15.156:0/3612297983 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc012430 con 0x7f82c4130bc0 2023-09-30T22:24:34.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.758+0000 7f82cbd69700 1 -- 172.21.15.156:0/3612297983 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f82c4130bc0 msgr2=0x7f82c413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.758+0000 7f82cbd69700 1 --2- 172.21.15.156:0/3612297983 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f82c4130bc0 0x7f82c413b990 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f82bc009dc0 tx=0x7f82bc00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:34.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.758+0000 7f82cbd69700 1 -- 172.21.15.156:0/3612297983 shutdown_connections 2023-09-30T22:24:34.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.758+0000 7f82cbd69700 1 --2- 172.21.15.156:0/3612297983 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f82c4133ad0 0x7f82c4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.758+0000 7f82cbd69700 1 --2- 172.21.15.156:0/3612297983 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f82c4130bc0 0x7f82c413b990 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.758+0000 7f82cbd69700 1 -- 172.21.15.156:0/3612297983 >> 172.21.15.156:0/3612297983 conn(0x7f82c4099c40 msgr2=0x7f82c40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:34.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.758+0000 7f82cbd69700 1 -- 172.21.15.156:0/3612297983 shutdown_connections 2023-09-30T22:24:34.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.758+0000 7f82cbd69700 1 -- 172.21.15.156:0/3612297983 wait complete. 2023-09-30T22:24:34.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.759+0000 7f82cbd69700 1 Processor -- start 2023-09-30T22:24:34.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.759+0000 7f82cbd69700 1 -- start start 2023-09-30T22:24:34.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.760+0000 7f82cbd69700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f82c41300a0 0x7f82c411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.760+0000 7f82cbd69700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82c4130bc0 0x7f82c411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.760+0000 7f82cbd69700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f82c4133ad0 0x7f82c411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.760+0000 7f82cbd69700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c411fd00 con 0x7f82c4130bc0 2023-09-30T22:24:34.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.760+0000 7f82cbd69700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c412dd00 con 0x7f82c41300a0 2023-09-30T22:24:34.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.760+0000 7f82cbd69700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82c4120950 con 0x7f82c4133ad0 2023-09-30T22:24:34.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.760+0000 7f82c9b05700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f82c41300a0 0x7f82c411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.760+0000 7f82c9304700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82c4130bc0 0x7f82c411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.760+0000 7f82c9b05700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f82c41300a0 0x7f82c411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49040/0 (socket says 172.21.15.156:49040) 2023-09-30T22:24:34.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.760+0000 7f82c9b05700 1 -- 172.21.15.156:0/2715151804 learned_addr learned my addr 172.21.15.156:0/2715151804 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:34.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.760+0000 7f82ca306700 1 --2- 172.21.15.156:0/2715151804 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f82c4133ad0 0x7f82c411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.760+0000 7f82c9b05700 1 -- 172.21.15.156:0/2715151804 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f82c4133ad0 msgr2=0x7f82c411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.760+0000 7f82c9b05700 1 --2- 172.21.15.156:0/2715151804 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f82c4133ad0 0x7f82c411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.760+0000 7f82c9b05700 1 -- 172.21.15.156:0/2715151804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82c4130bc0 msgr2=0x7f82c411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.760+0000 7f82c9b05700 1 --2- 172.21.15.156:0/2715151804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82c4130bc0 0x7f82c411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.760+0000 7f82c9b05700 1 -- 172.21.15.156:0/2715151804 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b40094a0 con 0x7f82c41300a0 2023-09-30T22:24:34.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.760+0000 7f82c9b05700 1 --2- 172.21.15.156:0/2715151804 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f82c41300a0 0x7f82c411da40 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f82b400ec10 tx=0x7f82b400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:34.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.760+0000 7f82ba7fc700 1 -- 172.21.15.156:0/2715151804 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b400c850 con 0x7f82c41300a0 2023-09-30T22:24:34.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.760+0000 7f82ba7fc700 1 -- 172.21.15.156:0/2715151804 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b400c9b0 con 0x7f82c41300a0 2023-09-30T22:24:34.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.760+0000 7f82ba7fc700 1 -- 172.21.15.156:0/2715151804 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b400cd20 con 0x7f82c41300a0 2023-09-30T22:24:34.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.760+0000 7f82cbd69700 1 -- 172.21.15.156:0/2715151804 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82bc009a70 con 0x7f82c41300a0 2023-09-30T22:24:34.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.761+0000 7f82cbd69700 1 -- 172.21.15.156:0/2715151804 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c411ee40 con 0x7f82c41300a0 2023-09-30T22:24:34.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.761+0000 7f82ba7fc700 1 -- 172.21.15.156:0/2715151804 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f82b4013470 con 0x7f82c41300a0 2023-09-30T22:24:34.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.761+0000 7f82ba7fc700 1 -- 172.21.15.156:0/2715151804 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f82b403fb50 con 0x7f82c41300a0 2023-09-30T22:24:34.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.761+0000 7f82cbd69700 1 -- 172.21.15.156:0/2715151804 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c409cb20 con 0x7f82c41300a0 2023-09-30T22:24:34.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.766+0000 7f82ba7fc700 1 -- 172.21.15.156:0/2715151804 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f82b4013720 con 0x7f82c41300a0 2023-09-30T22:24:34.773 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:34.825 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:34.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.904+0000 7f434c25d700 1 Processor -- start 2023-09-30T22:24:34.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.905+0000 7f434c25d700 1 -- start start 2023-09-30T22:24:34.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.905+0000 7f434c25d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f434409ad40 0x7f4344133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.905+0000 7f434c25d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4344133f70 0x7f43441343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.905+0000 7f434c25d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f43440a0a70 0x7f43440a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.905+0000 7f434c25d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43440a3b60 con 0x7f434409ad40 2023-09-30T22:24:34.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.905+0000 7f434c25d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43441348e0 con 0x7f4344133f70 2023-09-30T22:24:34.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.905+0000 7f434c25d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f434409b110 con 0x7f43440a0a70 2023-09-30T22:24:34.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.905+0000 7f43497f8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4344133f70 0x7f43441343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.905+0000 7f4349ff9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f434409ad40 0x7f4344133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.905+0000 7f434a7fa700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f43440a0a70 0x7f43440a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.905+0000 7f43497f8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4344133f70 0x7f43441343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49042/0 (socket says 172.21.15.156:49042) 2023-09-30T22:24:34.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.905+0000 7f4349ff9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f434409ad40 0x7f4344133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52328/0 (socket says 172.21.15.156:52328) 2023-09-30T22:24:34.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.905+0000 7f43497f8700 1 -- 172.21.15.156:0/727473675 learned_addr learned my addr 172.21.15.156:0/727473675 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:34.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.906+0000 7f43497f8700 1 -- 172.21.15.156:0/727473675 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f43440a0a70 msgr2=0x7f43440a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:34.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.906+0000 7f43497f8700 1 --2- 172.21.15.156:0/727473675 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f43440a0a70 0x7f43440a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.906+0000 7f43497f8700 1 -- 172.21.15.156:0/727473675 >> v2:172.21.15.156:3300/0 conn(0x7f434409ad40 msgr2=0x7f4344133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:34.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.906+0000 7f43497f8700 1 --2- 172.21.15.156:0/727473675 >> v2:172.21.15.156:3300/0 conn(0x7f434409ad40 0x7f4344133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.906+0000 7f43497f8700 1 -- 172.21.15.156:0/727473675 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43440a2fa0 con 0x7f4344133f70 2023-09-30T22:24:34.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.906+0000 7f4349ff9700 1 --2- 172.21.15.156:0/727473675 >> v2:172.21.15.156:3300/0 conn(0x7f434409ad40 0x7f4344133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:34.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.906+0000 7f434a7fa700 1 --2- 172.21.15.156:0/727473675 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f43440a0a70 0x7f43440a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:34.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.906+0000 7f43497f8700 1 --2- 172.21.15.156:0/727473675 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4344133f70 0x7f43441343a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f43340098f0 tx=0x7f4334009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c5fed6cca39c744 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:34.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.906+0000 7f4348ff7700 1 -- 172.21.15.156:0/727473675 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4334011830 con 0x7f4344133f70 2023-09-30T22:24:34.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.906+0000 7f4348ff7700 1 -- 172.21.15.156:0/727473675 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4334011990 con 0x7f4344133f70 2023-09-30T22:24:34.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.906+0000 7f4348ff7700 1 -- 172.21.15.156:0/727473675 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4334011d20 con 0x7f4344133f70 2023-09-30T22:24:34.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.907+0000 7f434c25d700 1 -- 172.21.15.156:0/727473675 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4344133f70 msgr2=0x7f43441343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.907+0000 7f434c25d700 1 --2- 172.21.15.156:0/727473675 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4344133f70 0x7f43441343a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f43340098f0 tx=0x7f4334009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:34.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.907+0000 7f434c25d700 1 -- 172.21.15.156:0/727473675 shutdown_connections 2023-09-30T22:24:34.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.907+0000 7f434c25d700 1 --2- 172.21.15.156:0/727473675 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f43440a0a70 0x7f43440a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.907+0000 7f434c25d700 1 --2- 172.21.15.156:0/727473675 >> v2:172.21.15.156:3300/0 conn(0x7f434409ad40 0x7f4344133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.907+0000 7f434c25d700 1 --2- 172.21.15.156:0/727473675 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4344133f70 0x7f43441343a0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.907+0000 7f434c25d700 1 -- 172.21.15.156:0/727473675 >> 172.21.15.156:0/727473675 conn(0x7f4344099c40 msgr2=0x7f434406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:34.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.907+0000 7f434c25d700 1 -- 172.21.15.156:0/727473675 shutdown_connections 2023-09-30T22:24:34.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.907+0000 7f434c25d700 1 -- 172.21.15.156:0/727473675 wait complete. 2023-09-30T22:24:34.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.908+0000 7f434c25d700 1 Processor -- start 2023-09-30T22:24:34.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.908+0000 7f434c25d700 1 -- start start 2023-09-30T22:24:34.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.909+0000 7f434c25d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f434409ad40 0x7f4344122480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.909+0000 7f434c25d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f43440a0a70 0x7f43441229c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.909+0000 7f434c25d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4344133f70 0x7f4344122f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.909+0000 7f434c25d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4344123950 con 0x7f4344133f70 2023-09-30T22:24:34.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.909+0000 7f434c25d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4344125f50 con 0x7f434409ad40 2023-09-30T22:24:34.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.909+0000 7f4349ff9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f434409ad40 0x7f4344122480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.909+0000 7f4349ff9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f434409ad40 0x7f4344122480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49044/0 (socket says 172.21.15.156:49044) 2023-09-30T22:24:34.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.909+0000 7f4349ff9700 1 -- 172.21.15.156:0/2261618027 learned_addr learned my addr 172.21.15.156:0/2261618027 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:34.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.909+0000 7f434c25d700 1 -- 172.21.15.156:0/2261618027 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4344124ed0 con 0x7f43440a0a70 2023-09-30T22:24:34.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.909+0000 7f434a7fa700 1 --2- 172.21.15.156:0/2261618027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4344133f70 0x7f4344122f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.909+0000 7f43497f8700 1 --2- 172.21.15.156:0/2261618027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f43440a0a70 0x7f43441229c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.909+0000 7f434a7fa700 1 -- 172.21.15.156:0/2261618027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f43440a0a70 msgr2=0x7f43441229c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.909+0000 7f434a7fa700 1 --2- 172.21.15.156:0/2261618027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f43440a0a70 0x7f43441229c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.909+0000 7f434a7fa700 1 -- 172.21.15.156:0/2261618027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f434409ad40 msgr2=0x7f4344122480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.909+0000 7f434a7fa700 1 --2- 172.21.15.156:0/2261618027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f434409ad40 0x7f4344122480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.909+0000 7f434a7fa700 1 -- 172.21.15.156:0/2261618027 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43400094a0 con 0x7f4344133f70 2023-09-30T22:24:34.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.910+0000 7f434a7fa700 1 --2- 172.21.15.156:0/2261618027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4344133f70 0x7f4344122f00 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f433c00efc0 tx=0x7f433c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:34.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.910+0000 7f433a7fc700 1 -- 172.21.15.156:0/2261618027 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c00ca90 con 0x7f4344133f70 2023-09-30T22:24:34.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.910+0000 7f433a7fc700 1 -- 172.21.15.156:0/2261618027 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433c00f040 con 0x7f4344133f70 2023-09-30T22:24:34.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.910+0000 7f433a7fc700 1 -- 172.21.15.156:0/2261618027 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c00ce30 con 0x7f4344133f70 2023-09-30T22:24:34.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.910+0000 7f434c25d700 1 -- 172.21.15.156:0/2261618027 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f433c009a70 con 0x7f4344133f70 2023-09-30T22:24:34.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.910+0000 7f434c25d700 1 -- 172.21.15.156:0/2261618027 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4334009550 con 0x7f4344133f70 2023-09-30T22:24:34.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.911+0000 7f433a7fc700 1 -- 172.21.15.156:0/2261618027 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f433c014480 con 0x7f4344133f70 2023-09-30T22:24:34.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.911+0000 7f434c25d700 1 -- 172.21.15.156:0/2261618027 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4344125a70 con 0x7f4344133f70 2023-09-30T22:24:34.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.911+0000 7f433a7fc700 1 -- 172.21.15.156:0/2261618027 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f433c03fb90 con 0x7f4344133f70 2023-09-30T22:24:34.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.920+0000 7f433a7fc700 1 -- 172.21.15.156:0/2261618027 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f433c012930 con 0x7f4344133f70 2023-09-30T22:24:34.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.961+0000 7fbfd6cae700 1 Processor -- start 2023-09-30T22:24:34.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.961+0000 7fbfd6cae700 1 -- start start 2023-09-30T22:24:34.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.962+0000 7fbfd6cae700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfd0133ad0 0x7fbfd0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.962+0000 7fbfd6cae700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbfd01300a0 0x7fbfd01304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.962+0000 7fbfd6cae700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbfd01309f0 0x7fbfd013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.962+0000 7fbfd6cae700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd006b2d0 con 0x7fbfd01300a0 2023-09-30T22:24:34.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.962+0000 7fbfd6cae700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd0133610 con 0x7fbfd0133ad0 2023-09-30T22:24:34.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.962+0000 7fbfd6cae700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd009a500 con 0x7fbfd01309f0 2023-09-30T22:24:34.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.962+0000 7fbfd4a4a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfd0133ad0 0x7fbfd0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.962+0000 7fbfcffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbfd01300a0 0x7fbfd01304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.962+0000 7fbfd4a4a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfd0133ad0 0x7fbfd0133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49050/0 (socket says 172.21.15.156:49050) 2023-09-30T22:24:34.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.962+0000 7fbfcffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbfd01300a0 0x7fbfd01304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52358/0 (socket says 172.21.15.156:52358) 2023-09-30T22:24:34.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.962+0000 7fbfd4a4a700 1 -- 172.21.15.156:0/518905710 learned_addr learned my addr 172.21.15.156:0/518905710 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:34.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.962+0000 7fbfd524b700 1 --2- 172.21.15.156:0/518905710 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbfd01309f0 0x7fbfd013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.962+0000 7fbfcffff700 1 -- 172.21.15.156:0/518905710 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbfd01309f0 msgr2=0x7fbfd013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:34.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.962+0000 7fbfcffff700 1 --2- 172.21.15.156:0/518905710 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbfd01309f0 0x7fbfd013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.962+0000 7fbfcffff700 1 -- 172.21.15.156:0/518905710 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfd0133ad0 msgr2=0x7fbfd0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:34.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.962+0000 7fbfcffff700 1 --2- 172.21.15.156:0/518905710 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfd0133ad0 0x7fbfd0133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.962+0000 7fbfcffff700 1 -- 172.21.15.156:0/518905710 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd01338b0 con 0x7fbfd01300a0 2023-09-30T22:24:34.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.962+0000 7fbfd4a4a700 1 --2- 172.21.15.156:0/518905710 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfd0133ad0 0x7fbfd0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:34.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.962+0000 7fbfcffff700 1 --2- 172.21.15.156:0/518905710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfd01300a0 0x7fbfd01304b0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc009840 tx=0x7fbfbc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4259271ccd07786 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:34.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.962+0000 7fbfcf7fe700 1 -- 172.21.15.156:0/518905710 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc011830 con 0x7fbfd01300a0 2023-09-30T22:24:34.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.963+0000 7fbfcf7fe700 1 -- 172.21.15.156:0/518905710 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfbc011990 con 0x7fbfd01300a0 2023-09-30T22:24:34.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.963+0000 7fbfcf7fe700 1 -- 172.21.15.156:0/518905710 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc011d20 con 0x7fbfd01300a0 2023-09-30T22:24:34.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.963+0000 7fbfd6cae700 1 -- 172.21.15.156:0/518905710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfd01300a0 msgr2=0x7fbfd01304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.963+0000 7fbfd6cae700 1 --2- 172.21.15.156:0/518905710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfd01300a0 0x7fbfd01304b0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc009840 tx=0x7fbfbc009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:34.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.963+0000 7fbfd6cae700 1 -- 172.21.15.156:0/518905710 shutdown_connections 2023-09-30T22:24:34.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.963+0000 7fbfd6cae700 1 --2- 172.21.15.156:0/518905710 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbfd01309f0 0x7fbfd013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.963+0000 7fbfd6cae700 1 --2- 172.21.15.156:0/518905710 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfd0133ad0 0x7fbfd0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.963+0000 7fbfd6cae700 1 --2- 172.21.15.156:0/518905710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfd01300a0 0x7fbfd01304b0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.963+0000 7fbfd6cae700 1 -- 172.21.15.156:0/518905710 >> 172.21.15.156:0/518905710 conn(0x7fbfd0099c40 msgr2=0x7fbfd00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:34.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.963+0000 7fbfd6cae700 1 -- 172.21.15.156:0/518905710 shutdown_connections 2023-09-30T22:24:34.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.963+0000 7fbfd6cae700 1 -- 172.21.15.156:0/518905710 wait complete. 2023-09-30T22:24:34.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.964+0000 7fbfd6cae700 1 Processor -- start 2023-09-30T22:24:34.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.964+0000 7fbfd6cae700 1 -- start start 2023-09-30T22:24:34.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.965+0000 7fbfd6cae700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfd01300a0 0x7fbfd011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.965+0000 7fbfd6cae700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfd01309f0 0x7fbfd011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.965+0000 7fbfd6cae700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbfd0133ad0 0x7fbfd011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.965+0000 7fbfd6cae700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd012f890 con 0x7fbfd01300a0 2023-09-30T22:24:34.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.965+0000 7fbfd6cae700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd012dd00 con 0x7fbfd01309f0 2023-09-30T22:24:34.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.965+0000 7fbfd6cae700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd0072330 con 0x7fbfd0133ad0 2023-09-30T22:24:34.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.965+0000 7fbfd4a4a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfd01300a0 0x7fbfd011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.965+0000 7fbfcffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfd01309f0 0x7fbfd011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.965+0000 7fbfcffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfd01309f0 0x7fbfd011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49056/0 (socket says 172.21.15.156:49056) 2023-09-30T22:24:34.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.965+0000 7fbfd4a4a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfd01300a0 0x7fbfd011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52360/0 (socket says 172.21.15.156:52360) 2023-09-30T22:24:34.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.965+0000 7fbfcffff700 1 -- 172.21.15.156:0/4040992852 learned_addr learned my addr 172.21.15.156:0/4040992852 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:34.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.965+0000 7fbfd524b700 1 --2- 172.21.15.156:0/4040992852 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbfd0133ad0 0x7fbfd011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.965+0000 7fbfd4a4a700 1 -- 172.21.15.156:0/4040992852 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbfd0133ad0 msgr2=0x7fbfd011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.965+0000 7fbfd4a4a700 1 --2- 172.21.15.156:0/4040992852 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbfd0133ad0 0x7fbfd011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.965+0000 7fbfd4a4a700 1 -- 172.21.15.156:0/4040992852 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfd01309f0 msgr2=0x7fbfd011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.965+0000 7fbfd4a4a700 1 --2- 172.21.15.156:0/4040992852 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfd01309f0 0x7fbfd011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.965+0000 7fbfd4a4a700 1 -- 172.21.15.156:0/4040992852 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc4009550 con 0x7fbfd01300a0 2023-09-30T22:24:34.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.965+0000 7fbfcffff700 1 --2- 172.21.15.156:0/4040992852 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfd01309f0 0x7fbfd011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:34.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.965+0000 7fbfd524b700 1 --2- 172.21.15.156:0/4040992852 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbfd0133ad0 0x7fbfd011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:34.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.965+0000 7fbfd4a4a700 1 --2- 172.21.15.156:0/4040992852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfd01300a0 0x7fbfd011da40 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fbfc400e9a0 tx=0x7fbfc400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:34.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.965+0000 7fbfcd7fa700 1 -- 172.21.15.156:0/4040992852 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4004030 con 0x7fbfd01300a0 2023-09-30T22:24:34.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.966+0000 7fbfcd7fa700 1 -- 172.21.15.156:0/4040992852 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc4004190 con 0x7fbfd01300a0 2023-09-30T22:24:34.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.966+0000 7fbfcd7fa700 1 -- 172.21.15.156:0/4040992852 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4004520 con 0x7fbfd01300a0 2023-09-30T22:24:34.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.966+0000 7fbfd6cae700 1 -- 172.21.15.156:0/4040992852 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfbc0094a0 con 0x7fbfd01300a0 2023-09-30T22:24:34.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.966+0000 7fbfd6cae700 1 -- 172.21.15.156:0/4040992852 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd012d290 con 0x7fbfd01300a0 2023-09-30T22:24:34.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.967+0000 7fbfcd7fa700 1 -- 172.21.15.156:0/4040992852 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbfc400c850 con 0x7fbfd01300a0 2023-09-30T22:24:34.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.967+0000 7fbfd6cae700 1 -- 172.21.15.156:0/4040992852 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd004f2a0 con 0x7fbfd01300a0 2023-09-30T22:24:34.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.967+0000 7fbfcd7fa700 1 -- 172.21.15.156:0/4040992852 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbfc403f540 con 0x7fbfd01300a0 2023-09-30T22:24:34.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.971+0000 7f82cbd69700 1 -- 172.21.15.156:0/2715151804 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f82c404f2a0 con 0x7f82c41300a0 2023-09-30T22:24:34.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.971+0000 7f82ba7fc700 1 -- 172.21.15.156:0/2715151804 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82b402b090 con 0x7f82c41300a0 2023-09-30T22:24:34.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.971+0000 7fbfcd7fa700 1 -- 172.21.15.156:0/4040992852 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbfc4003a20 con 0x7fbfd01300a0 2023-09-30T22:24:34.973 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:34.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.974+0000 7f82cbd69700 1 -- 172.21.15.156:0/2715151804 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f82c41300a0 msgr2=0x7f82c411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.974+0000 7f82cbd69700 1 --2- 172.21.15.156:0/2715151804 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f82c41300a0 0x7f82c411da40 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f82b400ec10 tx=0x7f82b400ef20 comp rx=0 tx=0).stop 2023-09-30T22:24:34.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.974+0000 7f82cbd69700 1 -- 172.21.15.156:0/2715151804 shutdown_connections 2023-09-30T22:24:34.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.974+0000 7f82cbd69700 1 --2- 172.21.15.156:0/2715151804 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f82c4133ad0 0x7f82c411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.974+0000 7f82cbd69700 1 --2- 172.21.15.156:0/2715151804 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f82c41300a0 0x7f82c411da40 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.974+0000 7f82cbd69700 1 --2- 172.21.15.156:0/2715151804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82c4130bc0 0x7f82c411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.974+0000 7f82cbd69700 1 -- 172.21.15.156:0/2715151804 >> 172.21.15.156:0/2715151804 conn(0x7f82c4099c40 msgr2=0x7f82c4132b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:34.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.974+0000 7f82cbd69700 1 -- 172.21.15.156:0/2715151804 shutdown_connections 2023-09-30T22:24:34.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:34.974+0000 7f82cbd69700 1 -- 172.21.15.156:0/2715151804 wait complete. 2023-09-30T22:24:34.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:35.088 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:35.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.124+0000 7f434c25d700 1 -- 172.21.15.156:0/2261618027 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f434409c7e0 con 0x7f4344133f70 2023-09-30T22:24:35.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.124+0000 7f433a7fc700 1 -- 172.21.15.156:0/2261618027 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f433c012340 con 0x7f4344133f70 2023-09-30T22:24:35.125 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:35.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.127+0000 7f434c25d700 1 -- 172.21.15.156:0/2261618027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4344133f70 msgr2=0x7f4344122f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:35.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.127+0000 7f434c25d700 1 --2- 172.21.15.156:0/2261618027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4344133f70 0x7f4344122f00 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f433c00efc0 tx=0x7f433c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.127+0000 7f434c25d700 1 -- 172.21.15.156:0/2261618027 shutdown_connections 2023-09-30T22:24:35.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.127+0000 7f434c25d700 1 --2- 172.21.15.156:0/2261618027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4344133f70 0x7f4344122f00 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.127+0000 7f434c25d700 1 --2- 172.21.15.156:0/2261618027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f434409ad40 0x7f4344122480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.127+0000 7f434c25d700 1 --2- 172.21.15.156:0/2261618027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f43440a0a70 0x7f43441229c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.127+0000 7f434c25d700 1 -- 172.21.15.156:0/2261618027 >> 172.21.15.156:0/2261618027 conn(0x7f4344099c40 msgr2=0x7f43440a41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:35.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.127+0000 7f434c25d700 1 -- 172.21.15.156:0/2261618027 shutdown_connections 2023-09-30T22:24:35.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.127+0000 7f434c25d700 1 -- 172.21.15.156:0/2261618027 wait complete. 2023-09-30T22:24:35.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:35.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.165+0000 7fbfd6cae700 1 -- 172.21.15.156:0/4040992852 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbfd012f670 con 0x7fbfd01300a0 2023-09-30T22:24:35.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.166+0000 7fbfcd7fa700 1 -- 172.21.15.156:0/4040992852 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbfc4020070 con 0x7fbfd01300a0 2023-09-30T22:24:35.166 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:35.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.168+0000 7fbfd6cae700 1 -- 172.21.15.156:0/4040992852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfd01300a0 msgr2=0x7fbfd011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:35.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.168+0000 7fbfd6cae700 1 --2- 172.21.15.156:0/4040992852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfd01300a0 0x7fbfd011da40 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fbfc400e9a0 tx=0x7fbfc400ecb0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.168+0000 7fbfd6cae700 1 -- 172.21.15.156:0/4040992852 shutdown_connections 2023-09-30T22:24:35.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.168+0000 7fbfd6cae700 1 --2- 172.21.15.156:0/4040992852 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbfd0133ad0 0x7fbfd011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.168+0000 7fbfd6cae700 1 --2- 172.21.15.156:0/4040992852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfd01300a0 0x7fbfd011da40 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.168+0000 7fbfd6cae700 1 --2- 172.21.15.156:0/4040992852 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbfd01309f0 0x7fbfd011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.168+0000 7fbfd6cae700 1 -- 172.21.15.156:0/4040992852 >> 172.21.15.156:0/4040992852 conn(0x7fbfd0099c40 msgr2=0x7fbfd012e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:35.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.168+0000 7fbfd6cae700 1 -- 172.21.15.156:0/4040992852 shutdown_connections 2023-09-30T22:24:35.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.168+0000 7fbfd6cae700 1 -- 172.21.15.156:0/4040992852 wait complete. 2023-09-30T22:24:35.181 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:35.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.214+0000 7f8462a1d700 1 Processor -- start 2023-09-30T22:24:35.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.214+0000 7f8462a1d700 1 -- start start 2023-09-30T22:24:35.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.214+0000 7f8462a1d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f845c09d860 0x7f845c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:35.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.214+0000 7f8462a1d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f845c09e170 0x7f845c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:35.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.214+0000 7f8462a1d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845c09aaa0 con 0x7f845c130ce0 2023-09-30T22:24:35.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.214+0000 7f8462a1d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845c09f870 con 0x7f845c09e170 2023-09-30T22:24:35.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.214+0000 7f8462a1d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f845c09b360 con 0x7f845c09d860 2023-09-30T22:24:35.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.215+0000 7f845b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f845c09e170 0x7f845c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:35.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.215+0000 7f8460fba700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f845c130ce0 0x7f845c1379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53296/0 (socket says 172.21.15.156:53296) 2023-09-30T22:24:35.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.215+0000 7f845bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f845c09d860 0x7f845c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:35.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.215+0000 7f8460fba700 1 -- 172.21.15.156:0/547317791 learned_addr learned my addr 172.21.15.156:0/547317791 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:35.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.215+0000 7f845b7fe700 1 -- 172.21.15.156:0/547317791 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f845c09d860 msgr2=0x7f845c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:35.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.215+0000 7f845b7fe700 1 --2- 172.21.15.156:0/547317791 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f845c09d860 0x7f845c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.215+0000 7f845affd700 1 -- 172.21.15.156:0/547317791 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942641963 0 0) 0x7f845c09aaa0 con 0x7f845c130ce0 2023-09-30T22:24:35.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.215+0000 7f845b7fe700 1 -- 172.21.15.156:0/547317791 >> v1:172.21.15.156:6789/0 conn(0x7f845c130ce0 legacy=0x7f845c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:35.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.215+0000 7f845b7fe700 1 -- 172.21.15.156:0/547317791 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845c09b620 con 0x7f845c09e170 2023-09-30T22:24:35.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.215+0000 7f845bfff700 1 --2- 172.21.15.156:0/547317791 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f845c09d860 0x7f845c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:35.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.215+0000 7f845b7fe700 1 --2- 172.21.15.156:0/547317791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f845c09e170 0x7f845c1307a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f844c009870 tx=0x7f844c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abed45581d14d0fb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:35.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.215+0000 7f845affd700 1 -- 172.21.15.156:0/547317791 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c011830 con 0x7f845c09e170 2023-09-30T22:24:35.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.215+0000 7f845affd700 1 -- 172.21.15.156:0/547317791 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844c011990 con 0x7f845c09e170 2023-09-30T22:24:35.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.215+0000 7f845affd700 1 -- 172.21.15.156:0/547317791 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c011d20 con 0x7f845c09e170 2023-09-30T22:24:35.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.216+0000 7f8462a1d700 1 -- 172.21.15.156:0/547317791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f845c09e170 msgr2=0x7f845c1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:35.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.216+0000 7f8462a1d700 1 --2- 172.21.15.156:0/547317791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f845c09e170 0x7f845c1307a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f844c009870 tx=0x7f844c009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:35.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.216+0000 7f8462a1d700 1 -- 172.21.15.156:0/547317791 shutdown_connections 2023-09-30T22:24:35.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.216+0000 7f8462a1d700 1 --2- 172.21.15.156:0/547317791 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f845c09d860 0x7f845c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.216+0000 7f8462a1d700 1 --2- 172.21.15.156:0/547317791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f845c09e170 0x7f845c1307a0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.216+0000 7f8462a1d700 1 -- 172.21.15.156:0/547317791 >> 172.21.15.156:0/547317791 conn(0x7f845c099c40 msgr2=0x7f845c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:35.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.216+0000 7f8462a1d700 1 -- 172.21.15.156:0/547317791 shutdown_connections 2023-09-30T22:24:35.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.216+0000 7f8462a1d700 1 -- 172.21.15.156:0/547317791 wait complete. 2023-09-30T22:24:35.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.217+0000 7f8462a1d700 1 Processor -- start 2023-09-30T22:24:35.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.217+0000 7f8462a1d700 1 -- start start 2023-09-30T22:24:35.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.218+0000 7f8462a1d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f845c09d860 0x7f845c11e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:35.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.218+0000 7f8462a1d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f845c09e170 0x7f845c11e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:35.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.218+0000 7f8462a1d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f845c130ce0 0x7f845c11ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:35.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.218+0000 7f8462a1d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c1206b0 con 0x7f845c130ce0 2023-09-30T22:24:35.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.218+0000 7f8462a1d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845c1303e0 con 0x7f845c09d860 2023-09-30T22:24:35.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.218+0000 7f8462a1d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f845c121fa0 con 0x7f845c09e170 2023-09-30T22:24:35.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.218+0000 7f845bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f845c09d860 0x7f845c11e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:35.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.218+0000 7f845bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f845c09d860 0x7f845c11e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49078/0 (socket says 172.21.15.156:49078) 2023-09-30T22:24:35.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.218+0000 7f8460fba700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f845c130ce0 0x7f845c11ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:35.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.218+0000 7f845bfff700 1 -- 172.21.15.156:0/500695151 learned_addr learned my addr 172.21.15.156:0/500695151 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:35.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.218+0000 7f845b7fe700 1 --2- 172.21.15.156:0/500695151 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f845c09e170 0x7f845c11e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:35.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.218+0000 7f845bfff700 1 -- 172.21.15.156:0/500695151 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f845c09e170 msgr2=0x7f845c11e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:35.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.218+0000 7f845bfff700 1 --2- 172.21.15.156:0/500695151 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f845c09e170 0x7f845c11e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.218+0000 7f845bfff700 1 -- 172.21.15.156:0/500695151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f845c130ce0 msgr2=0x7f845c11ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:35.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.218+0000 7f845bfff700 1 --2- 172.21.15.156:0/500695151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f845c130ce0 0x7f845c11ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.218+0000 7f845bfff700 1 -- 172.21.15.156:0/500695151 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84500094a0 con 0x7f845c09d860 2023-09-30T22:24:35.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.218+0000 7f8460fba700 1 --2- 172.21.15.156:0/500695151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f845c130ce0 0x7f845c11ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:35.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.218+0000 7f845bfff700 1 --2- 172.21.15.156:0/500695151 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f845c09d860 0x7f845c11e480 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f845000ebe0 tx=0x7f845000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:35.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.218+0000 7f8458ff9700 1 -- 172.21.15.156:0/500695151 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845000c850 con 0x7f845c09d860 2023-09-30T22:24:35.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.218+0000 7f8458ff9700 1 -- 172.21.15.156:0/500695151 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845000c9b0 con 0x7f845c09d860 2023-09-30T22:24:35.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.218+0000 7f8462a1d700 1 -- 172.21.15.156:0/500695151 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f844c0094a0 con 0x7f845c09d860 2023-09-30T22:24:35.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.218+0000 7f8458ff9700 1 -- 172.21.15.156:0/500695151 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845000cd40 con 0x7f845c09d860 2023-09-30T22:24:35.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.219+0000 7f8462a1d700 1 -- 172.21.15.156:0/500695151 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845c09c8b0 con 0x7f845c09d860 2023-09-30T22:24:35.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.219+0000 7f8458ff9700 1 -- 172.21.15.156:0/500695151 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8450013470 con 0x7f845c09d860 2023-09-30T22:24:35.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.219+0000 7f8462a1d700 1 -- 172.21.15.156:0/500695151 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845c04f2a0 con 0x7f845c09d860 2023-09-30T22:24:35.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.219+0000 7f8458ff9700 1 -- 172.21.15.156:0/500695151 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f845003f800 con 0x7f845c09d860 2023-09-30T22:24:35.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.224+0000 7f8458ff9700 1 -- 172.21.15.156:0/500695151 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8450013720 con 0x7f845c09d860 2023-09-30T22:24:35.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.405+0000 7f8462a1d700 1 -- 172.21.15.156:0/500695151 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f845c121d20 con 0x7f845c09d860 2023-09-30T22:24:35.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.405+0000 7f8458ff9700 1 -- 172.21.15.156:0/500695151 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f845001b9c0 con 0x7f845c09d860 2023-09-30T22:24:35.406 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:35.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.407+0000 7f8462a1d700 1 -- 172.21.15.156:0/500695151 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f845c09d860 msgr2=0x7f845c11e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:35.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.407+0000 7f8462a1d700 1 --2- 172.21.15.156:0/500695151 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f845c09d860 0x7f845c11e480 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f845000ebe0 tx=0x7f845000eef0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.407+0000 7f8462a1d700 1 -- 172.21.15.156:0/500695151 shutdown_connections 2023-09-30T22:24:35.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.407+0000 7f8462a1d700 1 --2- 172.21.15.156:0/500695151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f845c130ce0 0x7f845c11ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.407+0000 7f8462a1d700 1 --2- 172.21.15.156:0/500695151 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f845c09d860 0x7f845c11e480 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.407+0000 7f8462a1d700 1 --2- 172.21.15.156:0/500695151 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f845c09e170 0x7f845c11e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.407+0000 7f8462a1d700 1 -- 172.21.15.156:0/500695151 >> 172.21.15.156:0/500695151 conn(0x7f845c099c40 msgr2=0x7f845c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:35.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.408+0000 7f8462a1d700 1 -- 172.21.15.156:0/500695151 shutdown_connections 2023-09-30T22:24:35.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:35.408+0000 7f8462a1d700 1 -- 172.21.15.156:0/500695151 wait complete. 2023-09-30T22:24:35.420 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:35.988 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:36.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.113+0000 7fe50f823700 1 Processor -- start 2023-09-30T22:24:36.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.114+0000 7fe50f823700 1 -- start start 2023-09-30T22:24:36.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.114+0000 7fe50f823700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe50809d860 0x7fe50809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.114+0000 7fe50f823700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe50809e170 0x7fe5081307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.114+0000 7fe50f823700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe50809aaa0 con 0x7fe508130ce0 2023-09-30T22:24:36.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.114+0000 7fe50f823700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe50809f870 con 0x7fe50809d860 2023-09-30T22:24:36.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.114+0000 7fe50f823700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50809b360 con 0x7fe50809e170 2023-09-30T22:24:36.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.114+0000 7fe50d5bf700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe50809d860 0x7fe50809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.114+0000 7fe50ddc0700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe508130ce0 0x7fe5081379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53304/0 (socket says 172.21.15.156:53304) 2023-09-30T22:24:36.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.114+0000 7fe50cdbe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe50809e170 0x7fe5081307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.114+0000 7fe50ddc0700 1 -- 172.21.15.156:0/504149512 learned_addr learned my addr 172.21.15.156:0/504149512 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:36.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.114+0000 7fe50d5bf700 1 -- 172.21.15.156:0/504149512 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe50809e170 msgr2=0x7fe5081307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:36.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.114+0000 7fe50d5bf700 1 --2- 172.21.15.156:0/504149512 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe50809e170 0x7fe5081307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.114+0000 7fe50d5bf700 1 -- 172.21.15.156:0/504149512 >> v1:172.21.15.156:6789/0 conn(0x7fe508130ce0 legacy=0x7fe5081379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.114+0000 7fe50d5bf700 1 -- 172.21.15.156:0/504149512 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50809b620 con 0x7fe50809d860 2023-09-30T22:24:36.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.114+0000 7fe4fffff700 1 -- 172.21.15.156:0/504149512 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3195584757 0 0) 0x7fe50809aaa0 con 0x7fe508130ce0 2023-09-30T22:24:36.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.115+0000 7fe50d5bf700 1 --2- 172.21.15.156:0/504149512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe50809d860 0x7fe50809dc30 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8009840 tx=0x7fe4f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3730f71602ca2a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:36.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.115+0000 7fe4fffff700 1 -- 172.21.15.156:0/504149512 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f8011830 con 0x7fe50809d860 2023-09-30T22:24:36.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.115+0000 7fe4fffff700 1 -- 172.21.15.156:0/504149512 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f8011990 con 0x7fe50809d860 2023-09-30T22:24:36.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.115+0000 7fe4fffff700 1 -- 172.21.15.156:0/504149512 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f8011d20 con 0x7fe50809d860 2023-09-30T22:24:36.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.115+0000 7fe50f823700 1 -- 172.21.15.156:0/504149512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe50809d860 msgr2=0x7fe50809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.115+0000 7fe50f823700 1 --2- 172.21.15.156:0/504149512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe50809d860 0x7fe50809dc30 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8009840 tx=0x7fe4f8009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:36.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.115+0000 7fe50f823700 1 -- 172.21.15.156:0/504149512 shutdown_connections 2023-09-30T22:24:36.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.115+0000 7fe50f823700 1 --2- 172.21.15.156:0/504149512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe50809d860 0x7fe50809dc30 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.115+0000 7fe50f823700 1 --2- 172.21.15.156:0/504149512 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe50809e170 0x7fe5081307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.115+0000 7fe50f823700 1 -- 172.21.15.156:0/504149512 >> 172.21.15.156:0/504149512 conn(0x7fe508099c40 msgr2=0x7fe5080a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:36.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.115+0000 7fe50f823700 1 -- 172.21.15.156:0/504149512 shutdown_connections 2023-09-30T22:24:36.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.115+0000 7fe50f823700 1 -- 172.21.15.156:0/504149512 wait complete. 2023-09-30T22:24:36.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.117+0000 7fe50f823700 1 Processor -- start 2023-09-30T22:24:36.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.117+0000 7fe50f823700 1 -- start start 2023-09-30T22:24:36.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.117+0000 7fe50f823700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe50809d860 0x7fe50811e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.117+0000 7fe50f823700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe50809e170 0x7fe50811e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.117+0000 7fe50f823700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe508130ce0 0x7fe50811ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.117+0000 7fe50f823700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe508121bf0 con 0x7fe508130ce0 2023-09-30T22:24:36.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.117+0000 7fe50f823700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5081200d0 con 0x7fe50809d860 2023-09-30T22:24:36.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.117+0000 7fe50f823700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe50809c8b0 con 0x7fe50809e170 2023-09-30T22:24:36.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.117+0000 7fe50d5bf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe50809d860 0x7fe50811e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.117+0000 7fe50ddc0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe508130ce0 0x7fe50811ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.117+0000 7fe50d5bf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe50809d860 0x7fe50811e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49086/0 (socket says 172.21.15.156:49086) 2023-09-30T22:24:36.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.117+0000 7fe50d5bf700 1 -- 172.21.15.156:0/1918079899 learned_addr learned my addr 172.21.15.156:0/1918079899 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:36.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.117+0000 7fe50cdbe700 1 --2- 172.21.15.156:0/1918079899 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe50809e170 0x7fe50811e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.118+0000 7fe50d5bf700 1 -- 172.21.15.156:0/1918079899 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe50809e170 msgr2=0x7fe50811e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.118+0000 7fe50d5bf700 1 --2- 172.21.15.156:0/1918079899 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe50809e170 0x7fe50811e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.118+0000 7fe50d5bf700 1 -- 172.21.15.156:0/1918079899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe508130ce0 msgr2=0x7fe50811ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.118+0000 7fe50d5bf700 1 --2- 172.21.15.156:0/1918079899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe508130ce0 0x7fe50811ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.118+0000 7fe50d5bf700 1 -- 172.21.15.156:0/1918079899 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f80094a0 con 0x7fe50809d860 2023-09-30T22:24:36.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.118+0000 7fe50ddc0700 1 --2- 172.21.15.156:0/1918079899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe508130ce0 0x7fe50811ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:36.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.118+0000 7fe50d5bf700 1 --2- 172.21.15.156:0/1918079899 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe50809d860 0x7fe50811e3b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fe4f80090b0 tx=0x7fe4f8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:36.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.118+0000 7fe4fdffb700 1 -- 172.21.15.156:0/1918079899 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f8004340 con 0x7fe50809d860 2023-09-30T22:24:36.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.118+0000 7fe4fdffb700 1 -- 172.21.15.156:0/1918079899 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f801f070 con 0x7fe50809d860 2023-09-30T22:24:36.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.118+0000 7fe50f823700 1 -- 172.21.15.156:0/1918079899 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5080a06c0 con 0x7fe50809d860 2023-09-30T22:24:36.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.118+0000 7fe4fdffb700 1 -- 172.21.15.156:0/1918079899 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f80036a0 con 0x7fe50809d860 2023-09-30T22:24:36.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.118+0000 7fe50f823700 1 -- 172.21.15.156:0/1918079899 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5081205a0 con 0x7fe50809d860 2023-09-30T22:24:36.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.119+0000 7fe4fdffb700 1 -- 172.21.15.156:0/1918079899 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe4f8021030 con 0x7fe50809d860 2023-09-30T22:24:36.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.119+0000 7fe50f823700 1 -- 172.21.15.156:0/1918079899 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe508121d30 con 0x7fe50809d860 2023-09-30T22:24:36.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.119+0000 7fe4fdffb700 1 -- 172.21.15.156:0/1918079899 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe4f80407f0 con 0x7fe50809d860 2023-09-30T22:24:36.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.124+0000 7fe4fdffb700 1 -- 172.21.15.156:0/1918079899 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe508121d30 con 0x7fe50809d860 2023-09-30T22:24:36.142 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:36.181 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:36.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.266+0000 7fb34b271700 1 Processor -- start 2023-09-30T22:24:36.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.267+0000 7fb34b271700 1 -- start start 2023-09-30T22:24:36.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.267+0000 7fb34b271700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34409ad40 0x7fb344133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.267+0000 7fb34b271700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb344133f70 0x7fb3441343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.267+0000 7fb34b271700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb34409b110 con 0x7fb3440a0a70 2023-09-30T22:24:36.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.268+0000 7fb34b271700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3440a3b60 con 0x7fb344133f70 2023-09-30T22:24:36.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.268+0000 7fb34b271700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3441348e0 con 0x7fb34409ad40 2023-09-30T22:24:36.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.268+0000 7fb34900d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34409ad40 0x7fb344133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.268+0000 7fb34880c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb344133f70 0x7fb3441343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.268+0000 7fb34980e700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb3440a0a70 0x7fb3440a0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53318/0 (socket says 172.21.15.156:53318) 2023-09-30T22:24:36.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.268+0000 7fb34980e700 1 -- 172.21.15.156:0/1130573697 learned_addr learned my addr 172.21.15.156:0/1130573697 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:36.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.268+0000 7fb34880c700 1 -- 172.21.15.156:0/1130573697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34409ad40 msgr2=0x7fb344133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:36.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.268+0000 7fb34880c700 1 --2- 172.21.15.156:0/1130573697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34409ad40 0x7fb344133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.268+0000 7fb34880c700 1 -- 172.21.15.156:0/1130573697 >> v1:172.21.15.156:6789/0 conn(0x7fb3440a0a70 legacy=0x7fb3440a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.268+0000 7fb34880c700 1 -- 172.21.15.156:0/1130573697 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3440a2fa0 con 0x7fb344133f70 2023-09-30T22:24:36.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.268+0000 7fb34880c700 1 --2- 172.21.15.156:0/1130573697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb344133f70 0x7fb3441343a0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fb334009840 tx=0x7fb334009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b953642dbe614a96 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:36.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.268+0000 7fb33bfff700 1 -- 172.21.15.156:0/1130573697 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb334011830 con 0x7fb344133f70 2023-09-30T22:24:36.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.268+0000 7fb33bfff700 1 -- 172.21.15.156:0/1130573697 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb334011990 con 0x7fb344133f70 2023-09-30T22:24:36.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.268+0000 7fb33bfff700 1 -- 172.21.15.156:0/1130573697 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb334011d20 con 0x7fb344133f70 2023-09-30T22:24:36.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.269+0000 7fb34b271700 1 -- 172.21.15.156:0/1130573697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb344133f70 msgr2=0x7fb3441343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.269+0000 7fb34b271700 1 --2- 172.21.15.156:0/1130573697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb344133f70 0x7fb3441343a0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fb334009840 tx=0x7fb334009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:36.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.269+0000 7fb34b271700 1 -- 172.21.15.156:0/1130573697 shutdown_connections 2023-09-30T22:24:36.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.269+0000 7fb34b271700 1 --2- 172.21.15.156:0/1130573697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34409ad40 0x7fb344133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.269+0000 7fb34b271700 1 --2- 172.21.15.156:0/1130573697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb344133f70 0x7fb3441343a0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.269+0000 7fb34b271700 1 -- 172.21.15.156:0/1130573697 >> 172.21.15.156:0/1130573697 conn(0x7fb344099c40 msgr2=0x7fb34406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:36.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.269+0000 7fb34b271700 1 -- 172.21.15.156:0/1130573697 shutdown_connections 2023-09-30T22:24:36.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.269+0000 7fb34b271700 1 -- 172.21.15.156:0/1130573697 wait complete. 2023-09-30T22:24:36.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.270+0000 7fb34b271700 1 Processor -- start 2023-09-30T22:24:36.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.270+0000 7fb34b271700 1 -- start start 2023-09-30T22:24:36.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.271+0000 7fb34b271700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34409ad40 0x7fb34411e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.271+0000 7fb34b271700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3440a0a70 0x7fb34411e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.271+0000 7fb34b271700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb344133f70 0x7fb34411ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.271+0000 7fb34b271700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb344121a60 con 0x7fb3440a0a70 2023-09-30T22:24:36.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.271+0000 7fb34b271700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3441318d0 con 0x7fb34409ad40 2023-09-30T22:24:36.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.271+0000 7fb34b271700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb34409c7e0 con 0x7fb344133f70 2023-09-30T22:24:36.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.271+0000 7fb34880c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3440a0a70 0x7fb34411e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.271+0000 7fb34880c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3440a0a70 0x7fb34411e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52390/0 (socket says 172.21.15.156:52390) 2023-09-30T22:24:36.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.271+0000 7fb34900d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34409ad40 0x7fb34411e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.271+0000 7fb34880c700 1 -- 172.21.15.156:0/1962543418 learned_addr learned my addr 172.21.15.156:0/1962543418 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:36.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.271+0000 7fb34880c700 1 -- 172.21.15.156:0/1962543418 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb344133f70 msgr2=0x7fb34411ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.271+0000 7fb34880c700 1 --2- 172.21.15.156:0/1962543418 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb344133f70 0x7fb34411ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.271+0000 7fb34880c700 1 -- 172.21.15.156:0/1962543418 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34409ad40 msgr2=0x7fb34411e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.271+0000 7fb34880c700 1 --2- 172.21.15.156:0/1962543418 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34409ad40 0x7fb34411e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.271+0000 7fb34880c700 1 -- 172.21.15.156:0/1962543418 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3340094a0 con 0x7fb3440a0a70 2023-09-30T22:24:36.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.271+0000 7fb34900d700 1 --2- 172.21.15.156:0/1962543418 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34409ad40 0x7fb34411e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:36.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.271+0000 7fb34880c700 1 --2- 172.21.15.156:0/1962543418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3440a0a70 0x7fb34411e700 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fb3340090b0 tx=0x7fb334004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:36.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.271+0000 7fb339ffb700 1 -- 172.21.15.156:0/1962543418 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3340036a0 con 0x7fb3440a0a70 2023-09-30T22:24:36.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.271+0000 7fb339ffb700 1 -- 172.21.15.156:0/1962543418 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33401f070 con 0x7fb3440a0a70 2023-09-30T22:24:36.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.271+0000 7fb34b271700 1 -- 172.21.15.156:0/1962543418 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb344121c60 con 0x7fb3440a0a70 2023-09-30T22:24:36.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.271+0000 7fb339ffb700 1 -- 172.21.15.156:0/1962543418 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb334003a40 con 0x7fb3440a0a70 2023-09-30T22:24:36.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.272+0000 7fb34b271700 1 -- 172.21.15.156:0/1962543418 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3440a0f00 con 0x7fb3440a0a70 2023-09-30T22:24:36.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.272+0000 7fb339ffb700 1 -- 172.21.15.156:0/1962543418 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb334003ba0 con 0x7fb3440a0a70 2023-09-30T22:24:36.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.273+0000 7fb339ffb700 1 -- 172.21.15.156:0/1962543418 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb334021070 con 0x7fb3440a0a70 2023-09-30T22:24:36.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.273+0000 7fb34b271700 1 -- 172.21.15.156:0/1962543418 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb34409ed10 con 0x7fb3440a0a70 2023-09-30T22:24:36.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.278+0000 7fb339ffb700 1 -- 172.21.15.156:0/1962543418 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb334024380 con 0x7fb3440a0a70 2023-09-30T22:24:36.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.324+0000 7fe50f823700 1 -- 172.21.15.156:0/1918079899 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe508121d30 con 0x7fe50809d860 2023-09-30T22:24:36.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.324+0000 7fe4fdffb700 1 -- 172.21.15.156:0/1918079899 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe508121d30 con 0x7fe50809d860 2023-09-30T22:24:36.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.325+0000 7f2420ca2700 1 Processor -- start 2023-09-30T22:24:36.325 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:36.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.325+0000 7f2420ca2700 1 -- start start 2023-09-30T22:24:36.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.325+0000 7f2420ca2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f241c0a0a70 0x7f241c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.325+0000 7f2420ca2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f241c134120 0x7f241c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.325+0000 7f2420ca2700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f241c09dc00 con 0x7f241c0a1380 2023-09-30T22:24:36.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.325+0000 7f2420ca2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241c09ea90 con 0x7f241c134120 2023-09-30T22:24:36.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.325+0000 7f2420ca2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f241c09dec0 con 0x7f241c0a0a70 2023-09-30T22:24:36.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.325+0000 7f2419d9b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f241c0a1380 0x7f241c133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53328/0 (socket says 172.21.15.156:53328) 2023-09-30T22:24:36.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.325+0000 7f241a59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f241c0a0a70 0x7f241c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.325+0000 7f2419d9b700 1 -- 172.21.15.156:0/2107051515 learned_addr learned my addr 172.21.15.156:0/2107051515 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:36.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.326+0000 7f241ad9d700 1 --2- 172.21.15.156:0/2107051515 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f241c134120 0x7f241c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.326+0000 7f241959a700 1 -- 172.21.15.156:0/2107051515 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1957720146 0 0) 0x7f241c09dc00 con 0x7f241c0a1380 2023-09-30T22:24:36.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.326+0000 7f241959a700 1 -- 172.21.15.156:0/2107051515 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24080035b0 con 0x7f241c0a1380 2023-09-30T22:24:36.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.326+0000 7f241a59c700 1 -- 172.21.15.156:0/2107051515 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f241c134120 msgr2=0x7f241c13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:36.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.326+0000 7f241a59c700 1 --2- 172.21.15.156:0/2107051515 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f241c134120 0x7f241c13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.326+0000 7f241a59c700 1 -- 172.21.15.156:0/2107051515 >> v1:172.21.15.156:6789/0 conn(0x7f241c0a1380 legacy=0x7f241c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.326+0000 7f241a59c700 1 -- 172.21.15.156:0/2107051515 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241c09e6a0 con 0x7f241c0a0a70 2023-09-30T22:24:36.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.326+0000 7f241a59c700 1 --2- 172.21.15.156:0/2107051515 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f241c0a0a70 0x7f241c0a0e40 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f240c009870 tx=0x7f240c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c820013839e35ff4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:36.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.326+0000 7f241959a700 1 -- 172.21.15.156:0/2107051515 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240c011830 con 0x7f241c0a0a70 2023-09-30T22:24:36.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.326+0000 7f241959a700 1 -- 172.21.15.156:0/2107051515 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240c011990 con 0x7f241c0a0a70 2023-09-30T22:24:36.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.326+0000 7f241959a700 1 -- 172.21.15.156:0/2107051515 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240c011d00 con 0x7f241c0a0a70 2023-09-30T22:24:36.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.327+0000 7f2420ca2700 1 -- 172.21.15.156:0/2107051515 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f241c0a0a70 msgr2=0x7f241c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.327+0000 7f2420ca2700 1 --2- 172.21.15.156:0/2107051515 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f241c0a0a70 0x7f241c0a0e40 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f240c009870 tx=0x7f240c009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:36.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.327+0000 7fe50f823700 1 -- 172.21.15.156:0/1918079899 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe50809d860 msgr2=0x7fe50811e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.327+0000 7fe50f823700 1 --2- 172.21.15.156:0/1918079899 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe50809d860 0x7fe50811e3b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fe4f80090b0 tx=0x7fe4f8004750 comp rx=0 tx=0).stop 2023-09-30T22:24:36.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.327+0000 7fe50f823700 1 -- 172.21.15.156:0/1918079899 shutdown_connections 2023-09-30T22:24:36.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.327+0000 7f2420ca2700 1 -- 172.21.15.156:0/2107051515 shutdown_connections 2023-09-30T22:24:36.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.327+0000 7fe50f823700 1 --2- 172.21.15.156:0/1918079899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe508130ce0 0x7fe50811ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.327+0000 7fe50f823700 1 --2- 172.21.15.156:0/1918079899 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe50809d860 0x7fe50811e3b0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.327+0000 7f2420ca2700 1 --2- 172.21.15.156:0/2107051515 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f241c134120 0x7f241c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.327+0000 7f2420ca2700 1 --2- 172.21.15.156:0/2107051515 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f241c0a0a70 0x7f241c0a0e40 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.327+0000 7f2420ca2700 1 -- 172.21.15.156:0/2107051515 >> 172.21.15.156:0/2107051515 conn(0x7f241c0a6610 msgr2=0x7f241c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:36.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.327+0000 7fe50f823700 1 --2- 172.21.15.156:0/1918079899 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe50809e170 0x7fe50811e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.327+0000 7fe50f823700 1 -- 172.21.15.156:0/1918079899 >> 172.21.15.156:0/1918079899 conn(0x7fe508099c40 msgr2=0x7fe5080a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:36.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.327+0000 7f2420ca2700 1 -- 172.21.15.156:0/2107051515 shutdown_connections 2023-09-30T22:24:36.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.327+0000 7fe50f823700 1 -- 172.21.15.156:0/1918079899 shutdown_connections 2023-09-30T22:24:36.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.327+0000 7fe50f823700 1 -- 172.21.15.156:0/1918079899 wait complete. 2023-09-30T22:24:36.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.327+0000 7f2420ca2700 1 -- 172.21.15.156:0/2107051515 wait complete. 2023-09-30T22:24:36.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.328+0000 7f2420ca2700 1 Processor -- start 2023-09-30T22:24:36.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.328+0000 7f2420ca2700 1 -- start start 2023-09-30T22:24:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.329+0000 7f2420ca2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f241c0a0a70 0x7f241c122730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.329+0000 7f2420ca2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f241c0a1380 0x7f241c122c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.329+0000 7f2420ca2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f241c134120 0x7f241c1231b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.329+0000 7f2420ca2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241c124b30 con 0x7f241c134120 2023-09-30T22:24:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.329+0000 7f2420ca2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241c125e90 con 0x7f241c0a0a70 2023-09-30T22:24:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.329+0000 7f2420ca2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f241c124370 con 0x7f241c0a1380 2023-09-30T22:24:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.329+0000 7f241a59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f241c0a0a70 0x7f241c122730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.329+0000 7f2419d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f241c0a1380 0x7f241c122c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.329+0000 7f241a59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f241c0a0a70 0x7f241c122730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49118/0 (socket says 172.21.15.156:49118) 2023-09-30T22:24:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.329+0000 7f241a59c700 1 -- 172.21.15.156:0/3449485634 learned_addr learned my addr 172.21.15.156:0/3449485634 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:36.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.329+0000 7f2419d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f241c0a1380 0x7f241c122c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:38064/0 (socket says 172.21.15.156:38064) 2023-09-30T22:24:36.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.329+0000 7f241ad9d700 1 --2- 172.21.15.156:0/3449485634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f241c134120 0x7f241c1231b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.329+0000 7f2419d9b700 1 -- 172.21.15.156:0/3449485634 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f241c0a0a70 msgr2=0x7f241c122730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.329+0000 7f2419d9b700 1 --2- 172.21.15.156:0/3449485634 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f241c0a0a70 0x7f241c122730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.329+0000 7f2419d9b700 1 -- 172.21.15.156:0/3449485634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f241c134120 msgr2=0x7f241c1231b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.329+0000 7f2419d9b700 1 --2- 172.21.15.156:0/3449485634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f241c134120 0x7f241c1231b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.329+0000 7f2419d9b700 1 -- 172.21.15.156:0/3449485634 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240c0094a0 con 0x7f241c0a1380 2023-09-30T22:24:36.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.329+0000 7f241a59c700 1 --2- 172.21.15.156:0/3449485634 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f241c0a0a70 0x7f241c122730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:36.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.329+0000 7f241ad9d700 1 --2- 172.21.15.156:0/3449485634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f241c134120 0x7f241c1231b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:36.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.330+0000 7f2419d9b700 1 --2- 172.21.15.156:0/3449485634 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f241c0a1380 0x7f241c122c70 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f240400c490 tx=0x7f240400c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:36.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.330+0000 7f2412ffd700 1 -- 172.21.15.156:0/3449485634 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2404005d70 con 0x7f241c0a1380 2023-09-30T22:24:36.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.330+0000 7f2412ffd700 1 -- 172.21.15.156:0/3449485634 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24040070d0 con 0x7f241c0a1380 2023-09-30T22:24:36.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.330+0000 7f2420ca2700 1 -- 172.21.15.156:0/3449485634 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f241c0a5650 con 0x7f241c0a1380 2023-09-30T22:24:36.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.330+0000 7f2412ffd700 1 -- 172.21.15.156:0/3449485634 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2404007440 con 0x7f241c0a1380 2023-09-30T22:24:36.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.330+0000 7f2420ca2700 1 -- 172.21.15.156:0/3449485634 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f241c126900 con 0x7f241c0a1380 2023-09-30T22:24:36.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.330+0000 7f2412ffd700 1 -- 172.21.15.156:0/3449485634 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f24040075a0 con 0x7f241c0a1380 2023-09-30T22:24:36.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.331+0000 7f2412ffd700 1 -- 172.21.15.156:0/3449485634 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f240403e9d0 con 0x7f241c0a1380 2023-09-30T22:24:36.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.331+0000 7f2420ca2700 1 -- 172.21.15.156:0/3449485634 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f241c04f2a0 con 0x7f241c0a1380 2023-09-30T22:24:36.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.335+0000 7f2412ffd700 1 -- 172.21.15.156:0/3449485634 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2404019b40 con 0x7f241c0a1380 2023-09-30T22:24:36.342 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:36.421 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:36.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.493+0000 7fb34b271700 1 -- 172.21.15.156:0/1962543418 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb34411fd80 con 0x7fb3440a0a70 2023-09-30T22:24:36.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.494+0000 7fb339ffb700 1 -- 172.21.15.156:0/1962543418 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb334019b60 con 0x7fb3440a0a70 2023-09-30T22:24:36.495 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:36.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.496+0000 7fb34b271700 1 -- 172.21.15.156:0/1962543418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3440a0a70 msgr2=0x7fb34411e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.496+0000 7fb34b271700 1 --2- 172.21.15.156:0/1962543418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3440a0a70 0x7fb34411e700 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fb3340090b0 tx=0x7fb334004750 comp rx=0 tx=0).stop 2023-09-30T22:24:36.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.496+0000 7fb34b271700 1 -- 172.21.15.156:0/1962543418 shutdown_connections 2023-09-30T22:24:36.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.496+0000 7fb34b271700 1 --2- 172.21.15.156:0/1962543418 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb344133f70 0x7fb34411ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.496+0000 7fb34b271700 1 --2- 172.21.15.156:0/1962543418 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34409ad40 0x7fb34411e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.496+0000 7fb34b271700 1 --2- 172.21.15.156:0/1962543418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3440a0a70 0x7fb34411e700 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.496+0000 7fb34b271700 1 -- 172.21.15.156:0/1962543418 >> 172.21.15.156:0/1962543418 conn(0x7fb344099c40 msgr2=0x7fb344133210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:36.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.496+0000 7fb34b271700 1 -- 172.21.15.156:0/1962543418 shutdown_connections 2023-09-30T22:24:36.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.496+0000 7fb34b271700 1 -- 172.21.15.156:0/1962543418 wait complete. 2023-09-30T22:24:36.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:36.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.529+0000 7f2420ca2700 1 -- 172.21.15.156:0/3449485634 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f241c072980 con 0x7f241c0a1380 2023-09-30T22:24:36.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.530+0000 7f2412ffd700 1 -- 172.21.15.156:0/3449485634 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2404017020 con 0x7f241c0a1380 2023-09-30T22:24:36.531 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:36.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.532+0000 7f2420ca2700 1 -- 172.21.15.156:0/3449485634 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f241c0a1380 msgr2=0x7f241c122c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.532+0000 7f2420ca2700 1 --2- 172.21.15.156:0/3449485634 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f241c0a1380 0x7f241c122c70 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f240400c490 tx=0x7f240400c7a0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.532+0000 7f2420ca2700 1 -- 172.21.15.156:0/3449485634 shutdown_connections 2023-09-30T22:24:36.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.532+0000 7f2420ca2700 1 --2- 172.21.15.156:0/3449485634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f241c134120 0x7f241c1231b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.532+0000 7f2420ca2700 1 --2- 172.21.15.156:0/3449485634 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f241c0a0a70 0x7f241c122730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.532+0000 7f2420ca2700 1 --2- 172.21.15.156:0/3449485634 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f241c0a1380 0x7f241c122c70 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.532+0000 7f2420ca2700 1 -- 172.21.15.156:0/3449485634 >> 172.21.15.156:0/3449485634 conn(0x7f241c0a6610 msgr2=0x7f241c11c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:36.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.532+0000 7f2420ca2700 1 -- 172.21.15.156:0/3449485634 shutdown_connections 2023-09-30T22:24:36.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.532+0000 7f2420ca2700 1 -- 172.21.15.156:0/3449485634 wait complete. 2023-09-30T22:24:36.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:36.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.546+0000 7f25fb5f4700 1 Processor -- start 2023-09-30T22:24:36.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.546+0000 7f25fb5f4700 1 -- start start 2023-09-30T22:24:36.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.547+0000 7f25fb5f4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f25f4133ad0 0x7f25f4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.547+0000 7f25fb5f4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25f4130bc0 0x7f25f413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.547+0000 7f25fb5f4700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f406b2d0 con 0x7f25f41300a0 2023-09-30T22:24:36.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.547+0000 7f25fb5f4700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f4133610 con 0x7f25f4133ad0 2023-09-30T22:24:36.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.547+0000 7f25fb5f4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f409a500 con 0x7f25f4130bc0 2023-09-30T22:24:36.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.547+0000 7f25f9b91700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25f4130bc0 0x7f25f413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.547+0000 7f25f9390700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f25f4133ad0 0x7f25f4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.547+0000 7f25f8b8f700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f25f41300a0 0x7f25f41304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53334/0 (socket says 172.21.15.156:53334) 2023-09-30T22:24:36.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.547+0000 7f25f8b8f700 1 -- 172.21.15.156:0/3795861304 learned_addr learned my addr 172.21.15.156:0/3795861304 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:36.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.547+0000 7f25f9b91700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25f4130bc0 0x7f25f413b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49128/0 (socket says 172.21.15.156:49128) 2023-09-30T22:24:36.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.547+0000 7f25f9390700 1 -- 172.21.15.156:0/3795861304 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25f4130bc0 msgr2=0x7f25f413b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:36.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.547+0000 7f25f9390700 1 --2- 172.21.15.156:0/3795861304 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25f4130bc0 0x7f25f413b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.547+0000 7f25f9390700 1 -- 172.21.15.156:0/3795861304 >> v1:172.21.15.156:6789/0 conn(0x7f25f41300a0 legacy=0x7f25f41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.547+0000 7f25f3fff700 1 -- 172.21.15.156:0/3795861304 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2778054112 0 0) 0x7f25f406b2d0 con 0x7f25f41300a0 2023-09-30T22:24:36.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.547+0000 7f25f9390700 1 -- 172.21.15.156:0/3795861304 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f41338b0 con 0x7f25f4133ad0 2023-09-30T22:24:36.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.548+0000 7f25f9390700 1 --2- 172.21.15.156:0/3795861304 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25f4133ad0 0x7f25f4133ea0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f25ec009d90 tx=0x7f25ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45559daeda712da8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:36.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.548+0000 7f25f3fff700 1 -- 172.21.15.156:0/3795861304 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec00e070 con 0x7f25f4133ad0 2023-09-30T22:24:36.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.548+0000 7f25f3fff700 1 -- 172.21.15.156:0/3795861304 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ec00bb20 con 0x7f25f4133ad0 2023-09-30T22:24:36.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.548+0000 7f25f3fff700 1 -- 172.21.15.156:0/3795861304 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec012430 con 0x7f25f4133ad0 2023-09-30T22:24:36.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.548+0000 7f25fb5f4700 1 -- 172.21.15.156:0/3795861304 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25f4133ad0 msgr2=0x7f25f4133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.548+0000 7f25fb5f4700 1 --2- 172.21.15.156:0/3795861304 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25f4133ad0 0x7f25f4133ea0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f25ec009d90 tx=0x7f25ec00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:36.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.548+0000 7f25fb5f4700 1 -- 172.21.15.156:0/3795861304 shutdown_connections 2023-09-30T22:24:36.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.548+0000 7f25fb5f4700 1 --2- 172.21.15.156:0/3795861304 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25f4130bc0 0x7f25f413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.548+0000 7f25fb5f4700 1 --2- 172.21.15.156:0/3795861304 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25f4133ad0 0x7f25f4133ea0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.548+0000 7f25fb5f4700 1 -- 172.21.15.156:0/3795861304 >> 172.21.15.156:0/3795861304 conn(0x7f25f4099c40 msgr2=0x7f25f40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:36.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.548+0000 7f25fb5f4700 1 -- 172.21.15.156:0/3795861304 shutdown_connections 2023-09-30T22:24:36.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.548+0000 7f25fb5f4700 1 -- 172.21.15.156:0/3795861304 wait complete. 2023-09-30T22:24:36.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.549+0000 7f25fb5f4700 1 Processor -- start 2023-09-30T22:24:36.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.549+0000 7f25fb5f4700 1 -- start start 2023-09-30T22:24:36.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.550+0000 7f25fb5f4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25f41300a0 0x7f25f411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.550+0000 7f25fb5f4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25f4130bc0 0x7f25f411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.550+0000 7f25fb5f4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25f4133ad0 0x7f25f411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.550+0000 7f25fb5f4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f412dd00 con 0x7f25f41300a0 2023-09-30T22:24:36.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.550+0000 7f25fb5f4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f411eb00 con 0x7f25f4130bc0 2023-09-30T22:24:36.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.550+0000 7f25fb5f4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25f40a33c0 con 0x7f25f4133ad0 2023-09-30T22:24:36.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.550+0000 7f25f8b8f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25f4130bc0 0x7f25f411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.550+0000 7f25f8b8f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25f4130bc0 0x7f25f411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49138/0 (socket says 172.21.15.156:49138) 2023-09-30T22:24:36.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.550+0000 7f25f8b8f700 1 -- 172.21.15.156:0/606662287 learned_addr learned my addr 172.21.15.156:0/606662287 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:36.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.550+0000 7f25f9b91700 1 --2- 172.21.15.156:0/606662287 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25f4133ad0 0x7f25f411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.550+0000 7f25f9390700 1 --2- 172.21.15.156:0/606662287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25f41300a0 0x7f25f411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.550+0000 7f25f8b8f700 1 -- 172.21.15.156:0/606662287 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25f4133ad0 msgr2=0x7f25f411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.550+0000 7f25f8b8f700 1 --2- 172.21.15.156:0/606662287 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25f4133ad0 0x7f25f411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.550+0000 7f25f8b8f700 1 -- 172.21.15.156:0/606662287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25f41300a0 msgr2=0x7f25f411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.550+0000 7f25f8b8f700 1 --2- 172.21.15.156:0/606662287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25f41300a0 0x7f25f411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.550+0000 7f25f8b8f700 1 -- 172.21.15.156:0/606662287 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ec009a70 con 0x7f25f4130bc0 2023-09-30T22:24:36.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.550+0000 7f25f8b8f700 1 --2- 172.21.15.156:0/606662287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25f4130bc0 0x7f25f411df80 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f25e800c550 tx=0x7f25e800c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:36.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.550+0000 7f25f1ffb700 1 -- 172.21.15.156:0/606662287 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e8004c80 con 0x7f25f4130bc0 2023-09-30T22:24:36.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.550+0000 7f25f1ffb700 1 -- 172.21.15.156:0/606662287 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e8004de0 con 0x7f25f4130bc0 2023-09-30T22:24:36.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.550+0000 7f25fb5f4700 1 -- 172.21.15.156:0/606662287 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f40722e0 con 0x7f25f4130bc0 2023-09-30T22:24:36.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.550+0000 7f25f1ffb700 1 -- 172.21.15.156:0/606662287 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e8007310 con 0x7f25f4130bc0 2023-09-30T22:24:36.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.551+0000 7f25fb5f4700 1 -- 172.21.15.156:0/606662287 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f412d630 con 0x7f25f4130bc0 2023-09-30T22:24:36.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.552+0000 7f25fb5f4700 1 -- 172.21.15.156:0/606662287 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f409cb20 con 0x7f25f4130bc0 2023-09-30T22:24:36.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.552+0000 7f25f1ffb700 1 -- 172.21.15.156:0/606662287 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25e8007470 con 0x7f25f4130bc0 2023-09-30T22:24:36.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.552+0000 7f25f1ffb700 1 -- 172.21.15.156:0/606662287 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f25e803f240 con 0x7f25f4130bc0 2023-09-30T22:24:36.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.556+0000 7f25f1ffb700 1 -- 172.21.15.156:0/606662287 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25e80106d0 con 0x7f25f4130bc0 2023-09-30T22:24:36.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.739+0000 7f25fb5f4700 1 -- 172.21.15.156:0/606662287 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f25f404f2a0 con 0x7f25f4130bc0 2023-09-30T22:24:36.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.740+0000 7f25f1ffb700 1 -- 172.21.15.156:0/606662287 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25e8011360 con 0x7f25f4130bc0 2023-09-30T22:24:36.741 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:36.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.742+0000 7f25fb5f4700 1 -- 172.21.15.156:0/606662287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25f4130bc0 msgr2=0x7f25f411df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.742+0000 7f25fb5f4700 1 --2- 172.21.15.156:0/606662287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25f4130bc0 0x7f25f411df80 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f25e800c550 tx=0x7f25e800c860 comp rx=0 tx=0).stop 2023-09-30T22:24:36.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.742+0000 7f25fb5f4700 1 -- 172.21.15.156:0/606662287 shutdown_connections 2023-09-30T22:24:36.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.742+0000 7f25fb5f4700 1 --2- 172.21.15.156:0/606662287 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25f4133ad0 0x7f25f411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.742+0000 7f25fb5f4700 1 --2- 172.21.15.156:0/606662287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25f41300a0 0x7f25f411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.742+0000 7f25fb5f4700 1 --2- 172.21.15.156:0/606662287 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25f4130bc0 0x7f25f411df80 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.742+0000 7f25fb5f4700 1 -- 172.21.15.156:0/606662287 >> 172.21.15.156:0/606662287 conn(0x7f25f4099c40 msgr2=0x7f25f4132ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:36.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.742+0000 7f25fb5f4700 1 -- 172.21.15.156:0/606662287 shutdown_connections 2023-09-30T22:24:36.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:36.742+0000 7f25fb5f4700 1 -- 172.21.15.156:0/606662287 wait complete. 2023-09-30T22:24:36.755 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:37.342 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:37.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.470+0000 7fb3042f7700 1 Processor -- start 2023-09-30T22:24:37.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.470+0000 7fb3042f7700 1 -- start start 2023-09-30T22:24:37.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.470+0000 7fb3042f7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb2fc133660 0x7fb2fc135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.470+0000 7fb3042f7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2fc135f80 0x7fb2fc138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.470+0000 7fb3042f7700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2fc099a60 con 0x7fb2fc099e20 2023-09-30T22:24:37.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.470+0000 7fb3042f7700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2fc09bf50 con 0x7fb2fc133660 2023-09-30T22:24:37.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.470+0000 7fb3042f7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc09b230 con 0x7fb2fc135f80 2023-09-30T22:24:37.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.471+0000 7fb302894700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2fc135f80 0x7fb2fc138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.471+0000 7fb301892700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb2fc133660 0x7fb2fc135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.471+0000 7fb302894700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2fc135f80 0x7fb2fc138360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:38078/0 (socket says 172.21.15.156:38078) 2023-09-30T22:24:37.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.471+0000 7fb301892700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb2fc133660 0x7fb2fc135a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52440/0 (socket says 172.21.15.156:52440) 2023-09-30T22:24:37.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.471+0000 7fb302894700 1 -- 172.21.15.156:0/2536444375 learned_addr learned my addr 172.21.15.156:0/2536444375 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:37.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.471+0000 7fb302093700 1 --1- 172.21.15.156:0/2536444375 >> v1:172.21.15.156:6789/0 conn(0x7fb2fc099e20 0x7fb2fc09a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53344/0 (socket says 172.21.15.156:53344) 2023-09-30T22:24:37.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.471+0000 7fb301892700 1 -- 172.21.15.156:0/2536444375 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2fc135f80 msgr2=0x7fb2fc138360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:37.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.471+0000 7fb301892700 1 --2- 172.21.15.156:0/2536444375 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2fc135f80 0x7fb2fc138360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.471+0000 7fb301892700 1 -- 172.21.15.156:0/2536444375 >> v1:172.21.15.156:6789/0 conn(0x7fb2fc099e20 legacy=0x7fb2fc09a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.471+0000 7fb301892700 1 -- 172.21.15.156:0/2536444375 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc09bb90 con 0x7fb2fc133660 2023-09-30T22:24:37.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.471+0000 7fb302894700 1 --2- 172.21.15.156:0/2536444375 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2fc135f80 0x7fb2fc138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:37.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.471+0000 7fb301091700 1 -- 172.21.15.156:0/2536444375 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2270404 0 0) 0x7fb2fc099a60 con 0x7fb2fc099e20 2023-09-30T22:24:37.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.471+0000 7fb301892700 1 --2- 172.21.15.156:0/2536444375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2fc133660 0x7fb2fc135a40 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009840 tx=0x7fb2ec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8880f450724e2855 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:37.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.471+0000 7fb301091700 1 -- 172.21.15.156:0/2536444375 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec011830 con 0x7fb2fc133660 2023-09-30T22:24:37.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.471+0000 7fb301091700 1 -- 172.21.15.156:0/2536444375 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ec011990 con 0x7fb2fc133660 2023-09-30T22:24:37.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.471+0000 7fb301091700 1 -- 172.21.15.156:0/2536444375 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec011d20 con 0x7fb2fc133660 2023-09-30T22:24:37.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.472+0000 7fb3042f7700 1 -- 172.21.15.156:0/2536444375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2fc133660 msgr2=0x7fb2fc135a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.472+0000 7fb3042f7700 1 --2- 172.21.15.156:0/2536444375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2fc133660 0x7fb2fc135a40 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009840 tx=0x7fb2ec009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:37.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.472+0000 7fb3042f7700 1 -- 172.21.15.156:0/2536444375 shutdown_connections 2023-09-30T22:24:37.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.472+0000 7fb3042f7700 1 --2- 172.21.15.156:0/2536444375 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2fc135f80 0x7fb2fc138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.472+0000 7fb3042f7700 1 --2- 172.21.15.156:0/2536444375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2fc133660 0x7fb2fc135a40 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.472+0000 7fb3042f7700 1 -- 172.21.15.156:0/2536444375 >> 172.21.15.156:0/2536444375 conn(0x7fb2fc0a2980 msgr2=0x7fb2fc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:37.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.472+0000 7fb3042f7700 1 -- 172.21.15.156:0/2536444375 shutdown_connections 2023-09-30T22:24:37.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.472+0000 7fb3042f7700 1 -- 172.21.15.156:0/2536444375 wait complete. 2023-09-30T22:24:37.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.473+0000 7fb3042f7700 1 Processor -- start 2023-09-30T22:24:37.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.473+0000 7fb3042f7700 1 -- start start 2023-09-30T22:24:37.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.473+0000 7fb3042f7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2fc099e20 0x7fb2fc12cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.473+0000 7fb3042f7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2fc133660 0x7fb2fc12d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.473+0000 7fb3042f7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2fc135f80 0x7fb2fc06fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.473+0000 7fb3042f7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc071b90 con 0x7fb2fc135f80 2023-09-30T22:24:37.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.473+0000 7fb3042f7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc133a30 con 0x7fb2fc099e20 2023-09-30T22:24:37.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.473+0000 7fb3042f7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc09b470 con 0x7fb2fc133660 2023-09-30T22:24:37.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.473+0000 7fb302093700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2fc099e20 0x7fb2fc12cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.473+0000 7fb302894700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2fc135f80 0x7fb2fc06fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.473+0000 7fb301892700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2fc133660 0x7fb2fc12d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.473+0000 7fb302894700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2fc135f80 0x7fb2fc06fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52444/0 (socket says 172.21.15.156:52444) 2023-09-30T22:24:37.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.473+0000 7fb301892700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2fc133660 0x7fb2fc12d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:38084/0 (socket says 172.21.15.156:38084) 2023-09-30T22:24:37.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.473+0000 7fb302093700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2fc099e20 0x7fb2fc12cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49146/0 (socket says 172.21.15.156:49146) 2023-09-30T22:24:37.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.473+0000 7fb301892700 1 -- 172.21.15.156:0/4155034509 learned_addr learned my addr 172.21.15.156:0/4155034509 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:37.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.474+0000 7fb301892700 1 -- 172.21.15.156:0/4155034509 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2fc099e20 msgr2=0x7fb2fc12cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.474+0000 7fb301892700 1 --2- 172.21.15.156:0/4155034509 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2fc099e20 0x7fb2fc12cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.474+0000 7fb301892700 1 -- 172.21.15.156:0/4155034509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2fc135f80 msgr2=0x7fb2fc06fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.474+0000 7fb301892700 1 --2- 172.21.15.156:0/4155034509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2fc135f80 0x7fb2fc06fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.474+0000 7fb301892700 1 -- 172.21.15.156:0/4155034509 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f400bd40 con 0x7fb2fc133660 2023-09-30T22:24:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.474+0000 7fb302894700 1 --2- 172.21.15.156:0/4155034509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2fc135f80 0x7fb2fc06fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.474+0000 7fb301892700 1 --2- 172.21.15.156:0/4155034509 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2fc133660 0x7fb2fc12d2e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009fd0 tx=0x7fb2ec004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.474+0000 7fb2f2ffd700 1 -- 172.21.15.156:0/4155034509 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec0043c0 con 0x7fb2fc133660 2023-09-30T22:24:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.474+0000 7fb2f2ffd700 1 -- 172.21.15.156:0/4155034509 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ec01f070 con 0x7fb2fc133660 2023-09-30T22:24:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.474+0000 7fb2f2ffd700 1 -- 172.21.15.156:0/4155034509 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec0036a0 con 0x7fb2fc133660 2023-09-30T22:24:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.474+0000 7fb3042f7700 1 -- 172.21.15.156:0/4155034509 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2ec0094a0 con 0x7fb2fc133660 2023-09-30T22:24:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.474+0000 7fb3042f7700 1 -- 172.21.15.156:0/4155034509 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2fc11d3c0 con 0x7fb2fc133660 2023-09-30T22:24:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.475+0000 7fb3042f7700 1 -- 172.21.15.156:0/4155034509 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2fc072480 con 0x7fb2fc133660 2023-09-30T22:24:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.475+0000 7fb2f2ffd700 1 -- 172.21.15.156:0/4155034509 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb2ec021030 con 0x7fb2fc133660 2023-09-30T22:24:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.475+0000 7fb2f2ffd700 1 -- 172.21.15.156:0/4155034509 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb2ec040810 con 0x7fb2fc133660 2023-09-30T22:24:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.480+0000 7fb2f2ffd700 1 -- 172.21.15.156:0/4155034509 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2fc072480 con 0x7fb2fc133660 2023-09-30T22:24:37.510 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:37.546 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:37.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.637+0000 7f25e5f9a700 1 Processor -- start 2023-09-30T22:24:37.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.637+0000 7f25e5f9a700 1 -- start start 2023-09-30T22:24:37.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.638+0000 7f25e5f9a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25e0136960 0x7f25e0138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.638+0000 7f25e5f9a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25e0139280 0x7f25e013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.638+0000 7f25e5f9a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e006b2d0 con 0x7f25e0133ad0 2023-09-30T22:24:37.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.638+0000 7f25e5f9a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e01345b0 con 0x7f25e0136960 2023-09-30T22:24:37.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.638+0000 7f25e5f9a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25e0133610 con 0x7f25e0139280 2023-09-30T22:24:37.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.638+0000 7f25df7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f25e0133ad0 0x7f25e0133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53346/0 (socket says 172.21.15.156:53346) 2023-09-30T22:24:37.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.638+0000 7f25df7fe700 1 -- 172.21.15.156:0/2210091957 learned_addr learned my addr 172.21.15.156:0/2210091957 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:37.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.638+0000 7f25dffff700 1 --2- 172.21.15.156:0/2210091957 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25e0139280 0x7f25e013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.638+0000 7f25deffd700 1 --2- 172.21.15.156:0/2210091957 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25e0136960 0x7f25e0138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.638+0000 7f25de7fc700 1 -- 172.21.15.156:0/2210091957 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 645027150 0 0) 0x7f25e006b2d0 con 0x7f25e0133ad0 2023-09-30T22:24:37.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.638+0000 7f25de7fc700 1 -- 172.21.15.156:0/2210091957 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25c80035b0 con 0x7f25e0133ad0 2023-09-30T22:24:37.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.638+0000 7f25deffd700 1 -- 172.21.15.156:0/2210091957 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25e0139280 msgr2=0x7f25e013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:37.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.638+0000 7f25deffd700 1 --2- 172.21.15.156:0/2210091957 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25e0139280 0x7f25e013b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.638+0000 7f25deffd700 1 -- 172.21.15.156:0/2210091957 >> v1:172.21.15.156:6789/0 conn(0x7f25e0133ad0 legacy=0x7f25e0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.638+0000 7f25deffd700 1 -- 172.21.15.156:0/2210091957 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e009a500 con 0x7f25e0136960 2023-09-30T22:24:37.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.638+0000 7f25dffff700 1 --2- 172.21.15.156:0/2210091957 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25e0139280 0x7f25e013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:37.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.638+0000 7f25deffd700 1 --2- 172.21.15.156:0/2210091957 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25e0136960 0x7f25e0138d40 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f25d4009870 tx=0x7f25d4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=963c6fcc5ab05c43 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:37.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.639+0000 7f25de7fc700 1 -- 172.21.15.156:0/2210091957 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d4011830 con 0x7f25e0136960 2023-09-30T22:24:37.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.639+0000 7f25de7fc700 1 -- 172.21.15.156:0/2210091957 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d4011990 con 0x7f25e0136960 2023-09-30T22:24:37.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.639+0000 7f25de7fc700 1 -- 172.21.15.156:0/2210091957 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d4011d20 con 0x7f25e0136960 2023-09-30T22:24:37.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.639+0000 7f25e5f9a700 1 -- 172.21.15.156:0/2210091957 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25e0136960 msgr2=0x7f25e0138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.639+0000 7f25e5f9a700 1 --2- 172.21.15.156:0/2210091957 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25e0136960 0x7f25e0138d40 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f25d4009870 tx=0x7f25d4009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:37.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.639+0000 7f25e5f9a700 1 -- 172.21.15.156:0/2210091957 shutdown_connections 2023-09-30T22:24:37.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.639+0000 7f25e5f9a700 1 --2- 172.21.15.156:0/2210091957 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25e0139280 0x7f25e013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.639+0000 7f25e5f9a700 1 --2- 172.21.15.156:0/2210091957 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25e0136960 0x7f25e0138d40 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.639+0000 7f25e5f9a700 1 -- 172.21.15.156:0/2210091957 >> 172.21.15.156:0/2210091957 conn(0x7f25e0099c40 msgr2=0x7f25e00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:37.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.639+0000 7f25e5f9a700 1 -- 172.21.15.156:0/2210091957 shutdown_connections 2023-09-30T22:24:37.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.639+0000 7f25e5f9a700 1 -- 172.21.15.156:0/2210091957 wait complete. 2023-09-30T22:24:37.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.640+0000 7f25e5f9a700 1 Processor -- start 2023-09-30T22:24:37.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.640+0000 7f25e5f9a700 1 -- start start 2023-09-30T22:24:37.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.641+0000 7f25e5f9a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25e0133ad0 0x7f25e0070fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.641+0000 7f25e5f9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25e0136960 0x7f25e0071510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.641+0000 7f25e5f9a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25e0139280 0x7f25e0071a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.641+0000 7f25e5f9a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e0072080 con 0x7f25e0136960 2023-09-30T22:24:37.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.641+0000 7f25e5f9a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e00726e0 con 0x7f25e0139280 2023-09-30T22:24:37.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.641+0000 7f25e5f9a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25e009f390 con 0x7f25e0133ad0 2023-09-30T22:24:37.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.641+0000 7f25deffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25e0136960 0x7f25e0071510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.641+0000 7f25deffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25e0136960 0x7f25e0071510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52458/0 (socket says 172.21.15.156:52458) 2023-09-30T22:24:37.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.641+0000 7f25deffd700 1 -- 172.21.15.156:0/1966143018 learned_addr learned my addr 172.21.15.156:0/1966143018 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:37.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.641+0000 7f25df7fe700 1 --2- 172.21.15.156:0/1966143018 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25e0133ad0 0x7f25e0070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.641+0000 7f25dffff700 1 --2- 172.21.15.156:0/1966143018 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25e0139280 0x7f25e0071a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.641+0000 7f25deffd700 1 -- 172.21.15.156:0/1966143018 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25e0133ad0 msgr2=0x7f25e0070fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.641+0000 7f25deffd700 1 --2- 172.21.15.156:0/1966143018 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25e0133ad0 0x7f25e0070fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.641+0000 7f25deffd700 1 -- 172.21.15.156:0/1966143018 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25e0139280 msgr2=0x7f25e0071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.641+0000 7f25deffd700 1 --2- 172.21.15.156:0/1966143018 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25e0139280 0x7f25e0071a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.641+0000 7f25deffd700 1 -- 172.21.15.156:0/1966143018 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d80094a0 con 0x7f25e0136960 2023-09-30T22:24:37.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.641+0000 7f25df7fe700 1 --2- 172.21.15.156:0/1966143018 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25e0133ad0 0x7f25e0070fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:37.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.641+0000 7f25deffd700 1 --2- 172.21.15.156:0/1966143018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25e0136960 0x7f25e0071510 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f25d40090b0 tx=0x7f25d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:37.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.642+0000 7f25c7fff700 1 -- 172.21.15.156:0/1966143018 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d4004240 con 0x7f25e0136960 2023-09-30T22:24:37.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.642+0000 7f25c7fff700 1 -- 172.21.15.156:0/1966143018 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d401f070 con 0x7f25e0136960 2023-09-30T22:24:37.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.642+0000 7f25e5f9a700 1 -- 172.21.15.156:0/1966143018 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d40094a0 con 0x7f25e0136960 2023-09-30T22:24:37.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.642+0000 7f25c7fff700 1 -- 172.21.15.156:0/1966143018 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d40045c0 con 0x7f25e0136960 2023-09-30T22:24:37.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.642+0000 7f25e5f9a700 1 -- 172.21.15.156:0/1966143018 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e00703f0 con 0x7f25e0136960 2023-09-30T22:24:37.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.642+0000 7f25c7fff700 1 -- 172.21.15.156:0/1966143018 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25d4021030 con 0x7f25e0136960 2023-09-30T22:24:37.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.643+0000 7f25c7fff700 1 -- 172.21.15.156:0/1966143018 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f25d4040700 con 0x7f25e0136960 2023-09-30T22:24:37.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.643+0000 7f25e5f9a700 1 -- 172.21.15.156:0/1966143018 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e0070210 con 0x7f25e0136960 2023-09-30T22:24:37.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.651+0000 7f25c7fff700 1 -- 172.21.15.156:0/1966143018 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25d401a450 con 0x7f25e0136960 2023-09-30T22:24:37.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.681+0000 7fb3042f7700 1 -- 172.21.15.156:0/4155034509 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb2fc072480 con 0x7fb2fc133660 2023-09-30T22:24:37.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.682+0000 7fb2f2ffd700 1 -- 172.21.15.156:0/4155034509 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb2fc072480 con 0x7fb2fc133660 2023-09-30T22:24:37.683 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:37.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.684+0000 7fb3042f7700 1 -- 172.21.15.156:0/4155034509 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2fc133660 msgr2=0x7fb2fc12d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.684+0000 7fb3042f7700 1 --2- 172.21.15.156:0/4155034509 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2fc133660 0x7fb2fc12d2e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009fd0 tx=0x7fb2ec004750 comp rx=0 tx=0).stop 2023-09-30T22:24:37.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.684+0000 7fb3042f7700 1 -- 172.21.15.156:0/4155034509 shutdown_connections 2023-09-30T22:24:37.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.684+0000 7fb3042f7700 1 --2- 172.21.15.156:0/4155034509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2fc135f80 0x7fb2fc06fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.684+0000 7fb3042f7700 1 --2- 172.21.15.156:0/4155034509 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb2fc099e20 0x7fb2fc12cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.684+0000 7fb3042f7700 1 --2- 172.21.15.156:0/4155034509 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb2fc133660 0x7fb2fc12d2e0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.684+0000 7fb3042f7700 1 -- 172.21.15.156:0/4155034509 >> 172.21.15.156:0/4155034509 conn(0x7fb2fc0a2980 msgr2=0x7fb2fc1324e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:37.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.684+0000 7fb3042f7700 1 -- 172.21.15.156:0/4155034509 shutdown_connections 2023-09-30T22:24:37.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.684+0000 7fb3042f7700 1 -- 172.21.15.156:0/4155034509 wait complete. 2023-09-30T22:24:37.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.685+0000 7fd1a720f700 1 Processor -- start 2023-09-30T22:24:37.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.685+0000 7fd1a720f700 1 -- start start 2023-09-30T22:24:37.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.686+0000 7fd1a720f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd1a009e340 0x7fd1a01359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.686+0000 7fd1a720f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1a0135f20 0x7fd1a0138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.686+0000 7fd1a720f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a009aaa0 con 0x7fd1a009d860 2023-09-30T22:24:37.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.686+0000 7fd1a720f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a009e730 con 0x7fd1a009e340 2023-09-30T22:24:37.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.686+0000 7fd1a720f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a009f870 con 0x7fd1a0135f20 2023-09-30T22:24:37.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.686+0000 7fd19ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd1a009e340 0x7fd1a01359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.686+0000 7fd19ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd1a009e340 0x7fd1a01359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52464/0 (socket says 172.21.15.156:52464) 2023-09-30T22:24:37.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.686+0000 7fd19ffff700 1 -- 172.21.15.156:0/1032012549 learned_addr learned my addr 172.21.15.156:0/1032012549 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:37.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.686+0000 7fd1a57ac700 1 --2- 172.21.15.156:0/1032012549 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1a0135f20 0x7fd1a0138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.687+0000 7fd19f7fe700 1 -- 172.21.15.156:0/1032012549 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055139562 0 0) 0x7fd1a009aaa0 con 0x7fd1a009d860 2023-09-30T22:24:37.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.687+0000 7fd19ffff700 1 -- 172.21.15.156:0/1032012549 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1a0135f20 msgr2=0x7fd1a0138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:37.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.687+0000 7fd19ffff700 1 --2- 172.21.15.156:0/1032012549 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1a0135f20 0x7fd1a0138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.687+0000 7fd19ffff700 1 -- 172.21.15.156:0/1032012549 >> v1:172.21.15.156:6789/0 conn(0x7fd1a009d860 legacy=0x7fd1a009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.687+0000 7fd19ffff700 1 -- 172.21.15.156:0/1032012549 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a009b360 con 0x7fd1a009e340 2023-09-30T22:24:37.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.687+0000 7fd19ffff700 1 --2- 172.21.15.156:0/1032012549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1a009e340 0x7fd1a01359e0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0098f0 tx=0x7fd18c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a6a9b3b10426994 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:37.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.687+0000 7fd19f7fe700 1 -- 172.21.15.156:0/1032012549 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c011830 con 0x7fd1a009e340 2023-09-30T22:24:37.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.687+0000 7fd19f7fe700 1 -- 172.21.15.156:0/1032012549 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c011990 con 0x7fd1a009e340 2023-09-30T22:24:37.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.687+0000 7fd19f7fe700 1 -- 172.21.15.156:0/1032012549 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c011d20 con 0x7fd1a009e340 2023-09-30T22:24:37.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.688+0000 7fd1a720f700 1 -- 172.21.15.156:0/1032012549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1a009e340 msgr2=0x7fd1a01359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.688+0000 7fd1a720f700 1 --2- 172.21.15.156:0/1032012549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1a009e340 0x7fd1a01359e0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0098f0 tx=0x7fd18c009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:37.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.688+0000 7fd1a720f700 1 -- 172.21.15.156:0/1032012549 shutdown_connections 2023-09-30T22:24:37.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.688+0000 7fd1a720f700 1 --2- 172.21.15.156:0/1032012549 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1a0135f20 0x7fd1a0138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.688+0000 7fd1a720f700 1 --2- 172.21.15.156:0/1032012549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1a009e340 0x7fd1a01359e0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.688+0000 7fd1a720f700 1 -- 172.21.15.156:0/1032012549 >> 172.21.15.156:0/1032012549 conn(0x7fd1a0099c40 msgr2=0x7fd1a00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:37.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.688+0000 7fd1a720f700 1 -- 172.21.15.156:0/1032012549 shutdown_connections 2023-09-30T22:24:37.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.688+0000 7fd1a720f700 1 -- 172.21.15.156:0/1032012549 wait complete. 2023-09-30T22:24:37.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.689+0000 7fd1a720f700 1 Processor -- start 2023-09-30T22:24:37.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.689+0000 7fd1a720f700 1 -- start start 2023-09-30T22:24:37.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.690+0000 7fd1a720f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1a009d860 0x7fd1a01c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.690+0000 7fd1a720f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1a009e340 0x7fd1a01c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.690+0000 7fd1a720f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1a0135f20 0x7fd1a01c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.690+0000 7fd1a720f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a009a150 con 0x7fd1a0135f20 2023-09-30T22:24:37.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.690+0000 7fd1a720f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a0123220 con 0x7fd1a009e340 2023-09-30T22:24:37.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.690+0000 7fd1a720f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a0121ba0 con 0x7fd1a009d860 2023-09-30T22:24:37.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.690+0000 7fd19ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1a009e340 0x7fd1a01c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.690+0000 7fd1a4fab700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1a009d860 0x7fd1a01c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.690+0000 7fd1a57ac700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1a0135f20 0x7fd1a01c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.690+0000 7fd1a4fab700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1a009d860 0x7fd1a01c8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:38112/0 (socket says 172.21.15.156:38112) 2023-09-30T22:24:37.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.690+0000 7fd19ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1a009e340 0x7fd1a01c8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49190/0 (socket says 172.21.15.156:49190) 2023-09-30T22:24:37.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.690+0000 7fd1a4fab700 1 -- 172.21.15.156:0/1673849333 learned_addr learned my addr 172.21.15.156:0/1673849333 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:37.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.690+0000 7fd1a4fab700 1 -- 172.21.15.156:0/1673849333 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1a009e340 msgr2=0x7fd1a01c8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.690+0000 7fd1a4fab700 1 --2- 172.21.15.156:0/1673849333 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1a009e340 0x7fd1a01c8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.690+0000 7fd1a4fab700 1 -- 172.21.15.156:0/1673849333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1a0135f20 msgr2=0x7fd1a01c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.690+0000 7fd1a4fab700 1 --2- 172.21.15.156:0/1673849333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1a0135f20 0x7fd1a01c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.690+0000 7fd1a4fab700 1 -- 172.21.15.156:0/1673849333 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c009550 con 0x7fd1a009d860 2023-09-30T22:24:37.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.690+0000 7fd1a57ac700 1 --2- 172.21.15.156:0/1673849333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1a0135f20 0x7fd1a01c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:37.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.690+0000 7fd19ffff700 1 --2- 172.21.15.156:0/1673849333 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1a009e340 0x7fd1a01c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:37.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.690+0000 7fd1a4fab700 1 --2- 172.21.15.156:0/1673849333 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1a009d860 0x7fd1a01c8350 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd19400c450 tx=0x7fd19400c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:37.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.691+0000 7fd19d7fa700 1 -- 172.21.15.156:0/1673849333 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1940054e0 con 0x7fd1a009d860 2023-09-30T22:24:37.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.691+0000 7fd19d7fa700 1 -- 172.21.15.156:0/1673849333 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19400ce60 con 0x7fd1a009d860 2023-09-30T22:24:37.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.691+0000 7fd1a720f700 1 -- 172.21.15.156:0/1673849333 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a0071bb0 con 0x7fd1a009d860 2023-09-30T22:24:37.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.691+0000 7fd19d7fa700 1 -- 172.21.15.156:0/1673849333 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1940038c0 con 0x7fd1a009d860 2023-09-30T22:24:37.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.691+0000 7fd1a720f700 1 -- 172.21.15.156:0/1673849333 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a0123c90 con 0x7fd1a009d860 2023-09-30T22:24:37.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.691+0000 7fd19d7fa700 1 -- 172.21.15.156:0/1673849333 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd194003a20 con 0x7fd1a009d860 2023-09-30T22:24:37.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.692+0000 7fd19d7fa700 1 -- 172.21.15.156:0/1673849333 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd19403ea80 con 0x7fd1a009d860 2023-09-30T22:24:37.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.692+0000 7fd1a720f700 1 -- 172.21.15.156:0/1673849333 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a0123060 con 0x7fd1a009d860 2023-09-30T22:24:37.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.697+0000 7fd19d7fa700 1 -- 172.21.15.156:0/1673849333 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd194017030 con 0x7fd1a009d860 2023-09-30T22:24:37.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:37.755 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:37.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.847+0000 7f25e5f9a700 1 -- 172.21.15.156:0/1966143018 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f25e006fff0 con 0x7f25e0136960 2023-09-30T22:24:37.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.848+0000 7f25c7fff700 1 -- 172.21.15.156:0/1966143018 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25d40193b0 con 0x7f25e0136960 2023-09-30T22:24:37.849 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:37.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.851+0000 7f25e5f9a700 1 -- 172.21.15.156:0/1966143018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25e0136960 msgr2=0x7f25e0071510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.851+0000 7f25e5f9a700 1 --2- 172.21.15.156:0/1966143018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25e0136960 0x7f25e0071510 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f25d40090b0 tx=0x7f25d4004750 comp rx=0 tx=0).stop 2023-09-30T22:24:37.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.851+0000 7f25e5f9a700 1 -- 172.21.15.156:0/1966143018 shutdown_connections 2023-09-30T22:24:37.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.851+0000 7f25e5f9a700 1 --2- 172.21.15.156:0/1966143018 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25e0139280 0x7f25e0071a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.851+0000 7f25e5f9a700 1 --2- 172.21.15.156:0/1966143018 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25e0133ad0 0x7f25e0070fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.851+0000 7f25e5f9a700 1 --2- 172.21.15.156:0/1966143018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25e0136960 0x7f25e0071510 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.851+0000 7f25e5f9a700 1 -- 172.21.15.156:0/1966143018 >> 172.21.15.156:0/1966143018 conn(0x7f25e0099c40 msgr2=0x7f25e00a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:37.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.851+0000 7f25e5f9a700 1 -- 172.21.15.156:0/1966143018 shutdown_connections 2023-09-30T22:24:37.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.851+0000 7f25e5f9a700 1 -- 172.21.15.156:0/1966143018 wait complete. 2023-09-30T22:24:37.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:37.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.885+0000 7fb96272c700 1 Processor -- start 2023-09-30T22:24:37.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.885+0000 7fb96272c700 1 -- start start 2023-09-30T22:24:37.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.886+0000 7fb96272c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb95c09f350 0x7fb95c138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.886+0000 7fb96272c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb95c1393a0 0x7fb95c13b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.886+0000 7fb96272c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb95c09fa00 con 0x7fb95c09e870 2023-09-30T22:24:37.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.886+0000 7fb96272c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb95c0a0370 con 0x7fb95c1393a0 2023-09-30T22:24:37.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.886+0000 7fb96272c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c06bec0 con 0x7fb95c09f350 2023-09-30T22:24:37.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.886+0000 7fb95b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb95c09f350 0x7fb95c138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.886+0000 7fb960cc9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb95c1393a0 0x7fb95c13b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.886+0000 7fb95b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb95c09f350 0x7fb95c138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:38114/0 (socket says 172.21.15.156:38114) 2023-09-30T22:24:37.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.886+0000 7fb95b7fe700 1 -- 172.21.15.156:0/829857950 learned_addr learned my addr 172.21.15.156:0/829857950 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:37.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.886+0000 7fb95b7fe700 1 -- 172.21.15.156:0/829857950 >> v2:172.21.15.156:3300/0 conn(0x7fb95c1393a0 msgr2=0x7fb95c13b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:37.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.886+0000 7fb95b7fe700 1 --2- 172.21.15.156:0/829857950 >> v2:172.21.15.156:3300/0 conn(0x7fb95c1393a0 0x7fb95c13b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.886+0000 7fb95b7fe700 1 -- 172.21.15.156:0/829857950 >> v1:172.21.15.156:6789/0 conn(0x7fb95c09e870 legacy=0x7fb95c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.886+0000 7fb95b7fe700 1 -- 172.21.15.156:0/829857950 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95c09ada0 con 0x7fb95c09f350 2023-09-30T22:24:37.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.886+0000 7fb960cc9700 1 --2- 172.21.15.156:0/829857950 >> v2:172.21.15.156:3300/0 conn(0x7fb95c1393a0 0x7fb95c13b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:37.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.886+0000 7fb95affd700 1 -- 172.21.15.156:0/829857950 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 55008750 0 0) 0x7fb95c09fa00 con 0x7fb95c09e870 2023-09-30T22:24:37.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.886+0000 7fb95b7fe700 1 --2- 172.21.15.156:0/829857950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb95c09f350 0x7fb95c138e60 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb9500098f0 tx=0x7fb950009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31f250d2ef680c86 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:37.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.886+0000 7fb95affd700 1 -- 172.21.15.156:0/829857950 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb950011830 con 0x7fb95c09f350 2023-09-30T22:24:37.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.886+0000 7fb95affd700 1 -- 172.21.15.156:0/829857950 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb950011990 con 0x7fb95c09f350 2023-09-30T22:24:37.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.886+0000 7fb95affd700 1 -- 172.21.15.156:0/829857950 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb950011d20 con 0x7fb95c09f350 2023-09-30T22:24:37.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.887+0000 7fb96272c700 1 -- 172.21.15.156:0/829857950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb95c09f350 msgr2=0x7fb95c138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.887+0000 7fb96272c700 1 --2- 172.21.15.156:0/829857950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb95c09f350 0x7fb95c138e60 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb9500098f0 tx=0x7fb950009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:37.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.887+0000 7fb96272c700 1 -- 172.21.15.156:0/829857950 shutdown_connections 2023-09-30T22:24:37.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.887+0000 7fb96272c700 1 --2- 172.21.15.156:0/829857950 >> v2:172.21.15.156:3300/0 conn(0x7fb95c1393a0 0x7fb95c13b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.887+0000 7fb96272c700 1 --2- 172.21.15.156:0/829857950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb95c09f350 0x7fb95c138e60 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.887+0000 7fb96272c700 1 -- 172.21.15.156:0/829857950 >> 172.21.15.156:0/829857950 conn(0x7fb95c0a4430 msgr2=0x7fb95c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:37.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.887+0000 7fb96272c700 1 -- 172.21.15.156:0/829857950 shutdown_connections 2023-09-30T22:24:37.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.887+0000 7fb96272c700 1 -- 172.21.15.156:0/829857950 wait complete. 2023-09-30T22:24:37.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.888+0000 7fb96272c700 1 Processor -- start 2023-09-30T22:24:37.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.888+0000 7fb96272c700 1 -- start start 2023-09-30T22:24:37.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.888+0000 7fb96272c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb95c09e870 0x7fb95c120a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.888+0000 7fb96272c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb95c09f350 0x7fb95c120f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.888+0000 7fb96272c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb95c1393a0 0x7fb95c121480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.888+0000 7fb96272c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c122610 con 0x7fb95c09f350 2023-09-30T22:24:37.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.888+0000 7fb96272c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c122c30 con 0x7fb95c1393a0 2023-09-30T22:24:37.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.888+0000 7fb96272c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c06d010 con 0x7fb95c09e870 2023-09-30T22:24:37.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.889+0000 7fb960cc9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb95c1393a0 0x7fb95c121480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.889+0000 7fb95bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb95c09e870 0x7fb95c120a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.889+0000 7fb960cc9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb95c1393a0 0x7fb95c121480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49194/0 (socket says 172.21.15.156:49194) 2023-09-30T22:24:37.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.889+0000 7fb960cc9700 1 -- 172.21.15.156:0/4097040535 learned_addr learned my addr 172.21.15.156:0/4097040535 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:37.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.889+0000 7fb95b7fe700 1 --2- 172.21.15.156:0/4097040535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb95c09f350 0x7fb95c120f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.889+0000 7fb95bfff700 1 -- 172.21.15.156:0/4097040535 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb95c1393a0 msgr2=0x7fb95c121480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.889+0000 7fb95bfff700 1 --2- 172.21.15.156:0/4097040535 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb95c1393a0 0x7fb95c121480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.889+0000 7fb95bfff700 1 -- 172.21.15.156:0/4097040535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb95c09f350 msgr2=0x7fb95c120f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.889+0000 7fb95bfff700 1 --2- 172.21.15.156:0/4097040535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb95c09f350 0x7fb95c120f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.889+0000 7fb95bfff700 1 -- 172.21.15.156:0/4097040535 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb954009a70 con 0x7fb95c09e870 2023-09-30T22:24:37.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.889+0000 7fb95bfff700 1 --2- 172.21.15.156:0/4097040535 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb95c09e870 0x7fb95c120a00 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fb94c000f60 tx=0x7fb94c00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:37.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.889+0000 7fb958ff9700 1 -- 172.21.15.156:0/4097040535 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c0052d0 con 0x7fb95c09e870 2023-09-30T22:24:37.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.889+0000 7fb958ff9700 1 -- 172.21.15.156:0/4097040535 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94c005450 con 0x7fb95c09e870 2023-09-30T22:24:37.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.889+0000 7fb958ff9700 1 -- 172.21.15.156:0/4097040535 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c0038c0 con 0x7fb95c09e870 2023-09-30T22:24:37.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.889+0000 7fb96272c700 1 -- 172.21.15.156:0/4097040535 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb950009550 con 0x7fb95c09e870 2023-09-30T22:24:37.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.889+0000 7fb96272c700 1 -- 172.21.15.156:0/4097040535 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb95c124290 con 0x7fb95c09e870 2023-09-30T22:24:37.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.890+0000 7fb958ff9700 1 -- 172.21.15.156:0/4097040535 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb94c003a20 con 0x7fb95c09e870 2023-09-30T22:24:37.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.890+0000 7fb958ff9700 1 -- 172.21.15.156:0/4097040535 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb94c03e7d0 con 0x7fb95c09e870 2023-09-30T22:24:37.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.890+0000 7fb96272c700 1 -- 172.21.15.156:0/4097040535 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb95c124290 con 0x7fb95c09e870 2023-09-30T22:24:37.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.892+0000 7fd1a720f700 1 -- 172.21.15.156:0/1673849333 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd1a004f2a0 con 0x7fd1a009d860 2023-09-30T22:24:37.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.895+0000 7fd19d7fa700 1 -- 172.21.15.156:0/1673849333 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd194019cd0 con 0x7fd1a009d860 2023-09-30T22:24:37.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.895+0000 7fb958ff9700 1 -- 172.21.15.156:0/4097040535 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb95c124290 con 0x7fb95c09e870 2023-09-30T22:24:37.896 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:37.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.898+0000 7fd1a720f700 1 -- 172.21.15.156:0/1673849333 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1a009d860 msgr2=0x7fd1a01c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.898+0000 7fd1a720f700 1 --2- 172.21.15.156:0/1673849333 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1a009d860 0x7fd1a01c8350 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd19400c450 tx=0x7fd19400c760 comp rx=0 tx=0).stop 2023-09-30T22:24:37.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.899+0000 7fd1a720f700 1 -- 172.21.15.156:0/1673849333 shutdown_connections 2023-09-30T22:24:37.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.899+0000 7fd1a720f700 1 --2- 172.21.15.156:0/1673849333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1a0135f20 0x7fd1a01c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.899+0000 7fd1a720f700 1 --2- 172.21.15.156:0/1673849333 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd1a009d860 0x7fd1a01c8350 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.899+0000 7fd1a720f700 1 --2- 172.21.15.156:0/1673849333 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1a009e340 0x7fd1a01c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.899+0000 7fd1a720f700 1 -- 172.21.15.156:0/1673849333 >> 172.21.15.156:0/1673849333 conn(0x7fd1a0099c40 msgr2=0x7fd1a006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:37.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.899+0000 7fd1a720f700 1 -- 172.21.15.156:0/1673849333 shutdown_connections 2023-09-30T22:24:37.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:37.899+0000 7fd1a720f700 1 -- 172.21.15.156:0/1673849333 wait complete. 2023-09-30T22:24:37.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:38.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.082+0000 7fb96272c700 1 -- 172.21.15.156:0/4097040535 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb95c124290 con 0x7fb95c09e870 2023-09-30T22:24:38.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.082+0000 7fb958ff9700 1 -- 172.21.15.156:0/4097040535 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb95c124290 con 0x7fb95c09e870 2023-09-30T22:24:38.083 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:38.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.085+0000 7fb96272c700 1 -- 172.21.15.156:0/4097040535 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb95c09e870 msgr2=0x7fb95c120a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:38.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.085+0000 7fb96272c700 1 --2- 172.21.15.156:0/4097040535 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb95c09e870 0x7fb95c120a00 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fb94c000f60 tx=0x7fb94c00c6a0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.085+0000 7fb96272c700 1 -- 172.21.15.156:0/4097040535 shutdown_connections 2023-09-30T22:24:38.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.085+0000 7fb96272c700 1 --2- 172.21.15.156:0/4097040535 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb95c1393a0 0x7fb95c121480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.085+0000 7fb96272c700 1 --2- 172.21.15.156:0/4097040535 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb95c09e870 0x7fb95c120a00 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.085+0000 7fb96272c700 1 --2- 172.21.15.156:0/4097040535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb95c09f350 0x7fb95c120f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.085+0000 7fb96272c700 1 -- 172.21.15.156:0/4097040535 >> 172.21.15.156:0/4097040535 conn(0x7fb95c0a4430 msgr2=0x7fb95c070f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:38.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.085+0000 7fb96272c700 1 -- 172.21.15.156:0/4097040535 shutdown_connections 2023-09-30T22:24:38.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.085+0000 7fb96272c700 1 -- 172.21.15.156:0/4097040535 wait complete. 2023-09-30T22:24:38.098 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:38.700 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:38.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.826+0000 7fb4408ae700 1 Processor -- start 2023-09-30T22:24:38.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.826+0000 7fb4408ae700 1 -- start start 2023-09-30T22:24:38.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.827+0000 7fb4408ae700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb43c09d860 0x7fb43c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:38.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.827+0000 7fb4408ae700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb43c130eb0 0x7fb43c138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:38.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.827+0000 7fb4408ae700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb43c09aaa0 con 0x7fb43c09e170 2023-09-30T22:24:38.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.827+0000 7fb4408ae700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43c09f870 con 0x7fb43c09d860 2023-09-30T22:24:38.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.827+0000 7fb4408ae700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c09b360 con 0x7fb43c130eb0 2023-09-30T22:24:38.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.827+0000 7fb43a59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb43c09d860 0x7fb43c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:38.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.827+0000 7fb43ad9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb43c130eb0 0x7fb43c138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:38.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.827+0000 7fb43a59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb43c09d860 0x7fb43c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52502/0 (socket says 172.21.15.156:52502) 2023-09-30T22:24:38.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.827+0000 7fb439d9b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb43c09e170 0x7fb43c1307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53362/0 (socket says 172.21.15.156:53362) 2023-09-30T22:24:38.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.827+0000 7fb43a59c700 1 -- 172.21.15.156:0/3104704133 learned_addr learned my addr 172.21.15.156:0/3104704133 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:38.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.827+0000 7fb43ad9d700 1 -- 172.21.15.156:0/3104704133 >> v2:172.21.15.156:3300/0 conn(0x7fb43c09d860 msgr2=0x7fb43c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:38.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.827+0000 7fb43ad9d700 1 --2- 172.21.15.156:0/3104704133 >> v2:172.21.15.156:3300/0 conn(0x7fb43c09d860 0x7fb43c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.827+0000 7fb43ad9d700 1 -- 172.21.15.156:0/3104704133 >> v1:172.21.15.156:6789/0 conn(0x7fb43c09e170 legacy=0x7fb43c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:38.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.827+0000 7fb43ad9d700 1 -- 172.21.15.156:0/3104704133 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c09b620 con 0x7fb43c130eb0 2023-09-30T22:24:38.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.827+0000 7fb43a59c700 1 --2- 172.21.15.156:0/3104704133 >> v2:172.21.15.156:3300/0 conn(0x7fb43c09d860 0x7fb43c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:38.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.827+0000 7fb43ad9d700 1 --2- 172.21.15.156:0/3104704133 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb43c130eb0 0x7fb43c138a00 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb434009d90 tx=0x7fb43400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c84938ab5d3367f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:38.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.827+0000 7fb43959a700 1 -- 172.21.15.156:0/3104704133 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43400e070 con 0x7fb43c130eb0 2023-09-30T22:24:38.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.827+0000 7fb43959a700 1 -- 172.21.15.156:0/3104704133 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43400bb20 con 0x7fb43c130eb0 2023-09-30T22:24:38.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.827+0000 7fb43959a700 1 -- 172.21.15.156:0/3104704133 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb434012430 con 0x7fb43c130eb0 2023-09-30T22:24:38.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.828+0000 7fb4408ae700 1 -- 172.21.15.156:0/3104704133 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb43c130eb0 msgr2=0x7fb43c138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:38.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.828+0000 7fb4408ae700 1 --2- 172.21.15.156:0/3104704133 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb43c130eb0 0x7fb43c138a00 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb434009d90 tx=0x7fb43400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:38.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.828+0000 7fb4408ae700 1 -- 172.21.15.156:0/3104704133 shutdown_connections 2023-09-30T22:24:38.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.828+0000 7fb4408ae700 1 --2- 172.21.15.156:0/3104704133 >> v2:172.21.15.156:3300/0 conn(0x7fb43c09d860 0x7fb43c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.828+0000 7fb4408ae700 1 --2- 172.21.15.156:0/3104704133 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb43c130eb0 0x7fb43c138a00 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.828+0000 7fb4408ae700 1 -- 172.21.15.156:0/3104704133 >> 172.21.15.156:0/3104704133 conn(0x7fb43c099c40 msgr2=0x7fb43c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:38.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.828+0000 7fb4408ae700 1 -- 172.21.15.156:0/3104704133 shutdown_connections 2023-09-30T22:24:38.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.828+0000 7fb4408ae700 1 -- 172.21.15.156:0/3104704133 wait complete. 2023-09-30T22:24:38.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.829+0000 7fb4408ae700 1 Processor -- start 2023-09-30T22:24:38.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.829+0000 7fb4408ae700 1 -- start start 2023-09-30T22:24:38.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.829+0000 7fb4408ae700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb43c09d860 0x7fb43c11e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:38.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.829+0000 7fb4408ae700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb43c09e170 0x7fb43c11ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:38.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.829+0000 7fb4408ae700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb43c130eb0 0x7fb43c11ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:38.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.829+0000 7fb4408ae700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c1201e0 con 0x7fb43c09e170 2023-09-30T22:24:38.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.829+0000 7fb4408ae700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c11fff0 con 0x7fb43c09d860 2023-09-30T22:24:38.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.829+0000 7fb4408ae700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c0a21b0 con 0x7fb43c130eb0 2023-09-30T22:24:38.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.830+0000 7fb43a59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb43c09d860 0x7fb43c11e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:38.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.830+0000 7fb439d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb43c09e170 0x7fb43c11ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:38.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.830+0000 7fb439d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb43c09e170 0x7fb43c11ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52514/0 (socket says 172.21.15.156:52514) 2023-09-30T22:24:38.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.830+0000 7fb43a59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb43c09d860 0x7fb43c11e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49206/0 (socket says 172.21.15.156:49206) 2023-09-30T22:24:38.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.830+0000 7fb439d9b700 1 -- 172.21.15.156:0/3106290081 learned_addr learned my addr 172.21.15.156:0/3106290081 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:38.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.830+0000 7fb43ad9d700 1 --2- 172.21.15.156:0/3106290081 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb43c130eb0 0x7fb43c11ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:38.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.830+0000 7fb43ad9d700 1 -- 172.21.15.156:0/3106290081 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb43c09d860 msgr2=0x7fb43c11e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:38.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.830+0000 7fb43ad9d700 1 --2- 172.21.15.156:0/3106290081 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb43c09d860 0x7fb43c11e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.830+0000 7fb43ad9d700 1 -- 172.21.15.156:0/3106290081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb43c09e170 msgr2=0x7fb43c11ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:38.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.830+0000 7fb43ad9d700 1 --2- 172.21.15.156:0/3106290081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb43c09e170 0x7fb43c11ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.830+0000 7fb43ad9d700 1 -- 172.21.15.156:0/3106290081 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb430009550 con 0x7fb43c130eb0 2023-09-30T22:24:38.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.830+0000 7fb439d9b700 1 --2- 172.21.15.156:0/3106290081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb43c09e170 0x7fb43c11ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:38.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.830+0000 7fb43a59c700 1 --2- 172.21.15.156:0/3106290081 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb43c09d860 0x7fb43c11e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:38.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.830+0000 7fb43ad9d700 1 --2- 172.21.15.156:0/3106290081 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb43c130eb0 0x7fb43c11ef50 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb434016000 tx=0x7fb434004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:38.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.830+0000 7fb42affd700 1 -- 172.21.15.156:0/3106290081 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb434012430 con 0x7fb43c130eb0 2023-09-30T22:24:38.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.830+0000 7fb42affd700 1 -- 172.21.15.156:0/3106290081 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb434020070 con 0x7fb43c130eb0 2023-09-30T22:24:38.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.830+0000 7fb4408ae700 1 -- 172.21.15.156:0/3106290081 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb434009a70 con 0x7fb43c130eb0 2023-09-30T22:24:38.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.830+0000 7fb42affd700 1 -- 172.21.15.156:0/3106290081 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb434004280 con 0x7fb43c130eb0 2023-09-30T22:24:38.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.830+0000 7fb4408ae700 1 -- 172.21.15.156:0/3106290081 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43c121c90 con 0x7fb43c130eb0 2023-09-30T22:24:38.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.831+0000 7fb42affd700 1 -- 172.21.15.156:0/3106290081 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb4340043e0 con 0x7fb43c130eb0 2023-09-30T22:24:38.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.831+0000 7fb42affd700 1 -- 172.21.15.156:0/3106290081 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb434022070 con 0x7fb43c130eb0 2023-09-30T22:24:38.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.831+0000 7fb4408ae700 1 -- 172.21.15.156:0/3106290081 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43c04f2a0 con 0x7fb43c130eb0 2023-09-30T22:24:38.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.836+0000 7fb42affd700 1 -- 172.21.15.156:0/3106290081 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb43401c400 con 0x7fb43c130eb0 2023-09-30T22:24:38.869 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:38.912 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:39.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.999+0000 7f5af134e700 1 Processor -- start 2023-09-30T22:24:39.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.999+0000 7f5af134e700 1 -- start start 2023-09-30T22:24:39.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.999+0000 7f5af134e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5aec06a770 0x7f5aec06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:39.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.999+0000 7f5af134e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5aec06b080 0x7f5aec1317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:39.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.999+0000 7f5af134e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aec09da80 con 0x7f5aec131cf0 2023-09-30T22:24:39.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.999+0000 7f5af134e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aec09dce0 con 0x7f5aec06a770 2023-09-30T22:24:39.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:38.999+0000 7f5af134e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec09eb20 con 0x7f5aec06b080 2023-09-30T22:24:39.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.000+0000 7f5aea7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5aec06b080 0x7f5aec1317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:39.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.000+0000 7f5aea7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5aec06b080 0x7f5aec1317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49210/0 (socket says 172.21.15.156:49210) 2023-09-30T22:24:39.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.000+0000 7f5aeb7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f5aec131cf0 0x7f5aec138c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53366/0 (socket says 172.21.15.156:53366) 2023-09-30T22:24:39.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.000+0000 7f5aea7fc700 1 -- 172.21.15.156:0/3096258989 learned_addr learned my addr 172.21.15.156:0/3096258989 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:39.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.000+0000 7f5aeaffd700 1 --2- 172.21.15.156:0/3096258989 >> v2:172.21.15.156:3300/0 conn(0x7f5aec06a770 0x7f5aec06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:39.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.000+0000 7f5aea7fc700 1 -- 172.21.15.156:0/3096258989 >> v2:172.21.15.156:3300/0 conn(0x7f5aec06a770 msgr2=0x7f5aec06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:39.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.000+0000 7f5aea7fc700 1 --2- 172.21.15.156:0/3096258989 >> v2:172.21.15.156:3300/0 conn(0x7f5aec06a770 0x7f5aec06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.000+0000 7f5aea7fc700 1 -- 172.21.15.156:0/3096258989 >> v1:172.21.15.156:6789/0 conn(0x7f5aec131cf0 legacy=0x7f5aec138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:39.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.000+0000 7f5aea7fc700 1 -- 172.21.15.156:0/3096258989 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aec09d860 con 0x7f5aec06b080 2023-09-30T22:24:39.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.000+0000 7f5aeaffd700 1 --2- 172.21.15.156:0/3096258989 >> v2:172.21.15.156:3300/0 conn(0x7f5aec06a770 0x7f5aec06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:39.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.000+0000 7f5aea7fc700 1 --2- 172.21.15.156:0/3096258989 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5aec06b080 0x7f5aec1317b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f5ae00098f0 tx=0x7f5ae0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47e147268e8894f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:39.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.000+0000 7f5ae9ffb700 1 -- 172.21.15.156:0/3096258989 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0011830 con 0x7f5aec06b080 2023-09-30T22:24:39.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.000+0000 7f5ae9ffb700 1 -- 172.21.15.156:0/3096258989 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae0011990 con 0x7f5aec06b080 2023-09-30T22:24:39.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.000+0000 7f5ae9ffb700 1 -- 172.21.15.156:0/3096258989 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0011d20 con 0x7f5aec06b080 2023-09-30T22:24:39.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.001+0000 7f5af134e700 1 -- 172.21.15.156:0/3096258989 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5aec06b080 msgr2=0x7f5aec1317b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:39.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.001+0000 7f5af134e700 1 --2- 172.21.15.156:0/3096258989 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5aec06b080 0x7f5aec1317b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f5ae00098f0 tx=0x7f5ae0009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:39.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.001+0000 7f5af134e700 1 -- 172.21.15.156:0/3096258989 shutdown_connections 2023-09-30T22:24:39.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.001+0000 7f5af134e700 1 --2- 172.21.15.156:0/3096258989 >> v2:172.21.15.156:3300/0 conn(0x7f5aec06a770 0x7f5aec06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.001+0000 7f5af134e700 1 --2- 172.21.15.156:0/3096258989 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5aec06b080 0x7f5aec1317b0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.001+0000 7f5af134e700 1 -- 172.21.15.156:0/3096258989 >> 172.21.15.156:0/3096258989 conn(0x7f5aec099c40 msgr2=0x7f5aec0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:39.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.001+0000 7f5af134e700 1 -- 172.21.15.156:0/3096258989 shutdown_connections 2023-09-30T22:24:39.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.001+0000 7f5af134e700 1 -- 172.21.15.156:0/3096258989 wait complete. 2023-09-30T22:24:39.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.002+0000 7f5af134e700 1 Processor -- start 2023-09-30T22:24:39.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.003+0000 7f5af134e700 1 -- start start 2023-09-30T22:24:39.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.003+0000 7f5af134e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5aec06a770 0x7f5aec11e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:39.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.003+0000 7f5af134e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5aec06b080 0x7f5aec11e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:39.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.003+0000 7f5af134e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5aec131cf0 0x7f5aec11eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:39.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.003+0000 7f5af134e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec11fc50 con 0x7f5aec131cf0 2023-09-30T22:24:39.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.003+0000 7f5af134e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec120ae0 con 0x7f5aec06b080 2023-09-30T22:24:39.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.003+0000 7f5af134e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec1215c0 con 0x7f5aec06a770 2023-09-30T22:24:39.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.003+0000 7f5aeb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5aec131cf0 0x7f5aec11eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:39.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.003+0000 7f5aea7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5aec06b080 0x7f5aec11e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:39.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.003+0000 7f5aeb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5aec131cf0 0x7f5aec11eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52536/0 (socket says 172.21.15.156:52536) 2023-09-30T22:24:39.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.003+0000 7f5aeb7fe700 1 -- 172.21.15.156:0/2194054924 learned_addr learned my addr 172.21.15.156:0/2194054924 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:39.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.004+0000 7f5aeaffd700 1 --2- 172.21.15.156:0/2194054924 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5aec06a770 0x7f5aec11e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:39.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.004+0000 7f5aea7fc700 1 -- 172.21.15.156:0/2194054924 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5aec06a770 msgr2=0x7f5aec11e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:39.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.004+0000 7f5aea7fc700 1 --2- 172.21.15.156:0/2194054924 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5aec06a770 0x7f5aec11e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.004+0000 7f5aea7fc700 1 -- 172.21.15.156:0/2194054924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5aec131cf0 msgr2=0x7f5aec11eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:39.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.004+0000 7f5aea7fc700 1 --2- 172.21.15.156:0/2194054924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5aec131cf0 0x7f5aec11eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.004+0000 7f5aea7fc700 1 -- 172.21.15.156:0/2194054924 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5adc0094a0 con 0x7f5aec06b080 2023-09-30T22:24:39.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.004+0000 7f5aeb7fe700 1 --2- 172.21.15.156:0/2194054924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5aec131cf0 0x7f5aec11eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:39.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.004+0000 7f5aea7fc700 1 --2- 172.21.15.156:0/2194054924 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5aec06b080 0x7f5aec11e5d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0016000 tx=0x7f5ae0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:39.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.004+0000 7f5ad37fe700 1 -- 172.21.15.156:0/2194054924 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0004400 con 0x7f5aec06b080 2023-09-30T22:24:39.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.004+0000 7f5ad37fe700 1 -- 172.21.15.156:0/2194054924 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae001f070 con 0x7f5aec06b080 2023-09-30T22:24:39.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.004+0000 7f5af134e700 1 -- 172.21.15.156:0/2194054924 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae0009550 con 0x7f5aec06b080 2023-09-30T22:24:39.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.004+0000 7f5ad37fe700 1 -- 172.21.15.156:0/2194054924 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae00038e0 con 0x7f5aec06b080 2023-09-30T22:24:39.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.004+0000 7f5af134e700 1 -- 172.21.15.156:0/2194054924 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aec071e10 con 0x7f5aec06b080 2023-09-30T22:24:39.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.005+0000 7f5ad37fe700 1 -- 172.21.15.156:0/2194054924 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ae0021030 con 0x7f5aec06b080 2023-09-30T22:24:39.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.005+0000 7f5ad37fe700 1 -- 172.21.15.156:0/2194054924 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5ae0040a40 con 0x7f5aec06b080 2023-09-30T22:24:39.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.005+0000 7f5af134e700 1 -- 172.21.15.156:0/2194054924 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aec11add0 con 0x7f5aec06b080 2023-09-30T22:24:39.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.010+0000 7f5ad37fe700 1 -- 172.21.15.156:0/2194054924 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ae0004560 con 0x7f5aec06b080 2023-09-30T22:24:39.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.039+0000 7fb4408ae700 1 -- 172.21.15.156:0/3106290081 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb43c06c3b0 con 0x7fb43c130eb0 2023-09-30T22:24:39.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.040+0000 7fb42affd700 1 -- 172.21.15.156:0/3106290081 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb43401ab70 con 0x7fb43c130eb0 2023-09-30T22:24:39.041 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:39.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.040+0000 7f950cbd1700 1 Processor -- start 2023-09-30T22:24:39.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.040+0000 7f950cbd1700 1 -- start start 2023-09-30T22:24:39.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.041+0000 7f950cbd1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f95081309f0 0x7f9508130dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:39.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.041+0000 7f950cbd1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f950809d8f0 0x7f950809dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:39.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.041+0000 7f950cbd1700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f950809c1f0 con 0x7f950809e280 2023-09-30T22:24:39.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.041+0000 7f950cbd1700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f950806dc20 con 0x7f95081309f0 2023-09-30T22:24:39.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.041+0000 7f950cbd1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f950809b1f0 con 0x7f950809d8f0 2023-09-30T22:24:39.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.041+0000 7f9505d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f950809d8f0 0x7f950809dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:39.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.041+0000 7f950659c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f95081309f0 0x7f9508130dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:39.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.041+0000 7f9505d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f950809d8f0 0x7f950809dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:38154/0 (socket says 172.21.15.156:38154) 2023-09-30T22:24:39.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.041+0000 7f9505d9b700 1 -- 172.21.15.156:0/3844181106 learned_addr learned my addr 172.21.15.156:0/3844181106 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:39.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.041+0000 7f950659c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f95081309f0 0x7f9508130dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52540/0 (socket says 172.21.15.156:52540) 2023-09-30T22:24:39.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.042+0000 7f9505d9b700 1 -- 172.21.15.156:0/3844181106 >> v2:172.21.15.156:3300/0 conn(0x7f95081309f0 msgr2=0x7f9508130dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:39.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.042+0000 7f9505d9b700 1 --2- 172.21.15.156:0/3844181106 >> v2:172.21.15.156:3300/0 conn(0x7f95081309f0 0x7f9508130dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.042+0000 7f9505d9b700 1 -- 172.21.15.156:0/3844181106 >> v1:172.21.15.156:6789/0 conn(0x7f950809e280 legacy=0x7f9508137750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:39.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.042+0000 7f9505d9b700 1 -- 172.21.15.156:0/3844181106 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f950809e700 con 0x7f950809d8f0 2023-09-30T22:24:39.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.042+0000 7f9505d9b700 1 --2- 172.21.15.156:0/3844181106 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f950809d8f0 0x7f950809dd40 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f94fc00b9a0 tx=0x7f94fc00bcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58d51b0d3a731c1f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:39.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.042+0000 7f950559a700 1 -- 172.21.15.156:0/3844181106 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc00caa0 con 0x7f950809d8f0 2023-09-30T22:24:39.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.042+0000 7f950559a700 1 -- 172.21.15.156:0/3844181106 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94fc00cc00 con 0x7f950809d8f0 2023-09-30T22:24:39.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.042+0000 7f950559a700 1 -- 172.21.15.156:0/3844181106 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc00f460 con 0x7f950809d8f0 2023-09-30T22:24:39.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.042+0000 7fb4408ae700 1 -- 172.21.15.156:0/3106290081 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb43c130eb0 msgr2=0x7fb43c11ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:39.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.042+0000 7fb4408ae700 1 --2- 172.21.15.156:0/3106290081 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb43c130eb0 0x7fb43c11ef50 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb434016000 tx=0x7fb434004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.042+0000 7fb4408ae700 1 -- 172.21.15.156:0/3106290081 shutdown_connections 2023-09-30T22:24:39.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.042+0000 7fb4408ae700 1 --2- 172.21.15.156:0/3106290081 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb43c130eb0 0x7fb43c11ef50 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.042+0000 7fb4408ae700 1 --2- 172.21.15.156:0/3106290081 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb43c09d860 0x7fb43c11e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.042+0000 7fb4408ae700 1 --2- 172.21.15.156:0/3106290081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb43c09e170 0x7fb43c11ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.042+0000 7fb4408ae700 1 -- 172.21.15.156:0/3106290081 >> 172.21.15.156:0/3106290081 conn(0x7fb43c099c40 msgr2=0x7fb43c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:39.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.042+0000 7fb4408ae700 1 -- 172.21.15.156:0/3106290081 shutdown_connections 2023-09-30T22:24:39.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.042+0000 7fb4408ae700 1 -- 172.21.15.156:0/3106290081 wait complete. 2023-09-30T22:24:39.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.043+0000 7f950cbd1700 1 -- 172.21.15.156:0/3844181106 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f950809d8f0 msgr2=0x7f950809dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:39.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.043+0000 7f950cbd1700 1 --2- 172.21.15.156:0/3844181106 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f950809d8f0 0x7f950809dd40 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f94fc00b9a0 tx=0x7f94fc00bcb0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.043+0000 7f950cbd1700 1 -- 172.21.15.156:0/3844181106 shutdown_connections 2023-09-30T22:24:39.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.043+0000 7f950cbd1700 1 --2- 172.21.15.156:0/3844181106 >> v2:172.21.15.156:3300/0 conn(0x7f95081309f0 0x7f9508130dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.043+0000 7f950cbd1700 1 --2- 172.21.15.156:0/3844181106 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f950809d8f0 0x7f950809dd40 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.043+0000 7f950cbd1700 1 -- 172.21.15.156:0/3844181106 >> 172.21.15.156:0/3844181106 conn(0x7f95080a2b30 msgr2=0x7f950809e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:39.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.043+0000 7f950cbd1700 1 -- 172.21.15.156:0/3844181106 shutdown_connections 2023-09-30T22:24:39.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.043+0000 7f950cbd1700 1 -- 172.21.15.156:0/3844181106 wait complete. 2023-09-30T22:24:39.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.044+0000 7f950cbd1700 1 Processor -- start 2023-09-30T22:24:39.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.044+0000 7f950cbd1700 1 -- start start 2023-09-30T22:24:39.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.044+0000 7f950cbd1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f950809d8f0 0x7f95081c4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:39.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.044+0000 7f950cbd1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f950809e280 0x7f95081c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:39.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.044+0000 7f950cbd1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95081309f0 0x7f95081c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:39.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.044+0000 7f950cbd1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950812d9f0 con 0x7f950809d8f0 2023-09-30T22:24:39.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.044+0000 7f950cbd1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9508098bc0 con 0x7f950809e280 2023-09-30T22:24:39.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.044+0000 7f950cbd1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f950812c060 con 0x7f95081309f0 2023-09-30T22:24:39.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.045+0000 7f9505d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f950809e280 0x7f95081c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:39.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.045+0000 7f9506d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95081309f0 0x7f95081c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:39.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.045+0000 7f9505d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f950809e280 0x7f95081c4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49234/0 (socket says 172.21.15.156:49234) 2023-09-30T22:24:39.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.045+0000 7f9505d9b700 1 -- 172.21.15.156:0/231767846 learned_addr learned my addr 172.21.15.156:0/231767846 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:39.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.045+0000 7f950659c700 1 --2- 172.21.15.156:0/231767846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f950809d8f0 0x7f95081c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:39.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.045+0000 7f9506d9d700 1 -- 172.21.15.156:0/231767846 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f950809e280 msgr2=0x7f95081c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:39.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.045+0000 7f9506d9d700 1 --2- 172.21.15.156:0/231767846 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f950809e280 0x7f95081c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.045+0000 7f9506d9d700 1 -- 172.21.15.156:0/231767846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f950809d8f0 msgr2=0x7f95081c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:39.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.045+0000 7f9506d9d700 1 --2- 172.21.15.156:0/231767846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f950809d8f0 0x7f95081c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.045+0000 7f9506d9d700 1 -- 172.21.15.156:0/231767846 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94fc00b600 con 0x7f95081309f0 2023-09-30T22:24:39.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.045+0000 7f9506d9d700 1 --2- 172.21.15.156:0/231767846 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95081309f0 0x7f95081c4f90 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f950000cb10 tx=0x7f950000ce20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:39.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.045+0000 7f9505d9b700 1 --2- 172.21.15.156:0/231767846 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f950809e280 0x7f95081c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:39.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.045+0000 7f94f6ffd700 1 -- 172.21.15.156:0/231767846 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9500003c00 con 0x7f95081309f0 2023-09-30T22:24:39.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.045+0000 7f94f6ffd700 1 -- 172.21.15.156:0/231767846 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9500003d60 con 0x7f95081309f0 2023-09-30T22:24:39.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.045+0000 7f950cbd1700 1 -- 172.21.15.156:0/231767846 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95080a0970 con 0x7f95081309f0 2023-09-30T22:24:39.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.045+0000 7f94f6ffd700 1 -- 172.21.15.156:0/231767846 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950000a9c0 con 0x7f95081309f0 2023-09-30T22:24:39.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.045+0000 7f950cbd1700 1 -- 172.21.15.156:0/231767846 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f950808b100 con 0x7f95081309f0 2023-09-30T22:24:39.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.047+0000 7f950cbd1700 1 -- 172.21.15.156:0/231767846 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f950812d310 con 0x7f95081309f0 2023-09-30T22:24:39.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.047+0000 7f94f6ffd700 1 -- 172.21.15.156:0/231767846 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f950000ab20 con 0x7f95081309f0 2023-09-30T22:24:39.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.047+0000 7f94f6ffd700 1 -- 172.21.15.156:0/231767846 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f950003f4f0 con 0x7f95081309f0 2023-09-30T22:24:39.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.051+0000 7f94f6ffd700 1 -- 172.21.15.156:0/231767846 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f950000add0 con 0x7f95081309f0 2023-09-30T22:24:39.058 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:39.099 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:39.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.206+0000 7f5af134e700 1 -- 172.21.15.156:0/2194054924 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5aec04f2a0 con 0x7f5aec06b080 2023-09-30T22:24:39.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.207+0000 7f5ad37fe700 1 -- 172.21.15.156:0/2194054924 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ae0015030 con 0x7f5aec06b080 2023-09-30T22:24:39.208 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:39.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.209+0000 7f5af134e700 1 -- 172.21.15.156:0/2194054924 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5aec06b080 msgr2=0x7f5aec11e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:39.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.209+0000 7f5af134e700 1 --2- 172.21.15.156:0/2194054924 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5aec06b080 0x7f5aec11e5d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0016000 tx=0x7f5ae0004750 comp rx=0 tx=0).stop 2023-09-30T22:24:39.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.209+0000 7f5af134e700 1 -- 172.21.15.156:0/2194054924 shutdown_connections 2023-09-30T22:24:39.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.209+0000 7f5af134e700 1 --2- 172.21.15.156:0/2194054924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5aec131cf0 0x7f5aec11eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.209+0000 7f5af134e700 1 --2- 172.21.15.156:0/2194054924 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5aec06a770 0x7f5aec11e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.209+0000 7f5af134e700 1 --2- 172.21.15.156:0/2194054924 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5aec06b080 0x7f5aec11e5d0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.209+0000 7f5af134e700 1 -- 172.21.15.156:0/2194054924 >> 172.21.15.156:0/2194054924 conn(0x7f5aec099c40 msgr2=0x7f5aec12ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:39.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.209+0000 7f5af134e700 1 -- 172.21.15.156:0/2194054924 shutdown_connections 2023-09-30T22:24:39.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.209+0000 7f5af134e700 1 -- 172.21.15.156:0/2194054924 wait complete. 2023-09-30T22:24:39.222 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:39.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.223+0000 7ff6cb3f3700 1 Processor -- start 2023-09-30T22:24:39.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.223+0000 7ff6cb3f3700 1 -- start start 2023-09-30T22:24:39.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.223+0000 7ff6cb3f3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff6c412d280 0x7ff6c412d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:39.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.223+0000 7ff6cb3f3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6c4130350 0x7ff6c41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:39.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.223+0000 7ff6cb3f3700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c409ae40 con 0x7ff6c4130ce0 2023-09-30T22:24:39.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.223+0000 7ff6cb3f3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c409b9a0 con 0x7ff6c4130350 2023-09-30T22:24:39.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.223+0000 7ff6cb3f3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c409bbb0 con 0x7ff6c412d280 2023-09-30T22:24:39.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.224+0000 7ff6c918f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff6c412d280 0x7ff6c412d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:39.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.224+0000 7ff6c9990700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff6c4130ce0 0x7ff6c4137680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53382/0 (socket says 172.21.15.156:53382) 2023-09-30T22:24:39.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.224+0000 7ff6c918f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff6c412d280 0x7ff6c412d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:38176/0 (socket says 172.21.15.156:38176) 2023-09-30T22:24:39.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.224+0000 7ff6c9990700 1 -- 172.21.15.156:0/3795545258 learned_addr learned my addr 172.21.15.156:0/3795545258 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:39.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.224+0000 7ff6c898e700 1 --2- 172.21.15.156:0/3795545258 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6c4130350 0x7ff6c41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:39.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.224+0000 7ff6bbfff700 1 -- 172.21.15.156:0/3795545258 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679513685 0 0) 0x7ff6c409ae40 con 0x7ff6c4130ce0 2023-09-30T22:24:39.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.224+0000 7ff6bbfff700 1 -- 172.21.15.156:0/3795545258 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6b00035b0 con 0x7ff6c4130ce0 2023-09-30T22:24:39.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.224+0000 7ff6c898e700 1 -- 172.21.15.156:0/3795545258 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff6c412d280 msgr2=0x7ff6c412d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:39.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.224+0000 7ff6c898e700 1 --2- 172.21.15.156:0/3795545258 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff6c412d280 0x7ff6c412d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.224+0000 7ff6c898e700 1 -- 172.21.15.156:0/3795545258 >> v1:172.21.15.156:6789/0 conn(0x7ff6c4130ce0 legacy=0x7ff6c4137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:39.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.224+0000 7ff6c898e700 1 -- 172.21.15.156:0/3795545258 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c4131150 con 0x7ff6c4130350 2023-09-30T22:24:39.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.224+0000 7ff6c918f700 1 --2- 172.21.15.156:0/3795545258 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff6c412d280 0x7ff6c412d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:39.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.224+0000 7ff6c898e700 1 --2- 172.21.15.156:0/3795545258 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6c4130350 0x7ff6c41307a0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4009870 tx=0x7ff6b4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6be4a624311e2952 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:39.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.224+0000 7ff6bbfff700 1 -- 172.21.15.156:0/3795545258 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b4011830 con 0x7ff6c4130350 2023-09-30T22:24:39.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.224+0000 7ff6bbfff700 1 -- 172.21.15.156:0/3795545258 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b4011990 con 0x7ff6c4130350 2023-09-30T22:24:39.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.224+0000 7ff6bbfff700 1 -- 172.21.15.156:0/3795545258 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b4011d20 con 0x7ff6c4130350 2023-09-30T22:24:39.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.225+0000 7ff6cb3f3700 1 -- 172.21.15.156:0/3795545258 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6c4130350 msgr2=0x7ff6c41307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:39.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.225+0000 7ff6cb3f3700 1 --2- 172.21.15.156:0/3795545258 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6c4130350 0x7ff6c41307a0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4009870 tx=0x7ff6b4009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:39.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.225+0000 7ff6cb3f3700 1 -- 172.21.15.156:0/3795545258 shutdown_connections 2023-09-30T22:24:39.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.225+0000 7ff6cb3f3700 1 --2- 172.21.15.156:0/3795545258 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff6c412d280 0x7ff6c412d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.225+0000 7ff6cb3f3700 1 --2- 172.21.15.156:0/3795545258 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6c4130350 0x7ff6c41307a0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.225+0000 7ff6cb3f3700 1 -- 172.21.15.156:0/3795545258 >> 172.21.15.156:0/3795545258 conn(0x7ff6c40a2980 msgr2=0x7ff6c40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:39.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.225+0000 7ff6cb3f3700 1 -- 172.21.15.156:0/3795545258 shutdown_connections 2023-09-30T22:24:39.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.225+0000 7ff6cb3f3700 1 -- 172.21.15.156:0/3795545258 wait complete. 2023-09-30T22:24:39.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.226+0000 7ff6cb3f3700 1 Processor -- start 2023-09-30T22:24:39.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.226+0000 7ff6cb3f3700 1 -- start start 2023-09-30T22:24:39.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.226+0000 7ff6cb3f3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6c412d280 0x7ff6c411da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:39.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.226+0000 7ff6cb3f3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6c4130350 0x7ff6c411dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:39.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.226+0000 7ff6cb3f3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff6c4130ce0 0x7ff6c411e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:39.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.226+0000 7ff6cb3f3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c409b490 con 0x7ff6c412d280 2023-09-30T22:24:39.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.226+0000 7ff6cb3f3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c412e690 con 0x7ff6c4130350 2023-09-30T22:24:39.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.226+0000 7ff6cb3f3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c4120d30 con 0x7ff6c4130ce0 2023-09-30T22:24:39.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.226+0000 7ff6c918f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6c412d280 0x7ff6c411da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:39.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.227+0000 7ff6c898e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6c4130350 0x7ff6c411dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:39.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.227+0000 7ff6c918f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6c412d280 0x7ff6c411da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52554/0 (socket says 172.21.15.156:52554) 2023-09-30T22:24:39.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.227+0000 7ff6c918f700 1 -- 172.21.15.156:0/2668980054 learned_addr learned my addr 172.21.15.156:0/2668980054 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:39.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.227+0000 7ff6c9990700 1 --2- 172.21.15.156:0/2668980054 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff6c4130ce0 0x7ff6c411e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:39.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.227+0000 7ff6c918f700 1 -- 172.21.15.156:0/2668980054 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff6c4130ce0 msgr2=0x7ff6c411e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:39.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.227+0000 7ff6c918f700 1 --2- 172.21.15.156:0/2668980054 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff6c4130ce0 0x7ff6c411e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.227+0000 7ff6c918f700 1 -- 172.21.15.156:0/2668980054 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6c4130350 msgr2=0x7ff6c411dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:39.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.227+0000 7ff6c918f700 1 --2- 172.21.15.156:0/2668980054 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6c4130350 0x7ff6c411dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.227+0000 7ff6c918f700 1 -- 172.21.15.156:0/2668980054 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c000b6d0 con 0x7ff6c412d280 2023-09-30T22:24:39.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.227+0000 7ff6c898e700 1 --2- 172.21.15.156:0/2668980054 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6c4130350 0x7ff6c411dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:39.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.227+0000 7ff6c918f700 1 --2- 172.21.15.156:0/2668980054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6c412d280 0x7ff6c411da80 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7ff6c000ec90 tx=0x7ff6c000d350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:39.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.227+0000 7ff6b9ffb700 1 -- 172.21.15.156:0/2668980054 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c000dd80 con 0x7ff6c412d280 2023-09-30T22:24:39.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.227+0000 7ff6b9ffb700 1 -- 172.21.15.156:0/2668980054 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c0005a20 con 0x7ff6c412d280 2023-09-30T22:24:39.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.227+0000 7ff6cb3f3700 1 -- 172.21.15.156:0/2668980054 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b40094a0 con 0x7ff6c412d280 2023-09-30T22:24:39.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.227+0000 7ff6b9ffb700 1 -- 172.21.15.156:0/2668980054 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c0005d90 con 0x7ff6c412d280 2023-09-30T22:24:39.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.227+0000 7ff6cb3f3700 1 -- 172.21.15.156:0/2668980054 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c411fe40 con 0x7ff6c412d280 2023-09-30T22:24:39.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.228+0000 7ff6b9ffb700 1 -- 172.21.15.156:0/2668980054 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff6c0006030 con 0x7ff6c412d280 2023-09-30T22:24:39.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.228+0000 7ff6b9ffb700 1 -- 172.21.15.156:0/2668980054 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff6c003fc10 con 0x7ff6c412d280 2023-09-30T22:24:39.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.228+0000 7ff6cb3f3700 1 -- 172.21.15.156:0/2668980054 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c406f730 con 0x7ff6c412d280 2023-09-30T22:24:39.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.233+0000 7ff6b9ffb700 1 -- 172.21.15.156:0/2668980054 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff6c001d080 con 0x7ff6c412d280 2023-09-30T22:24:39.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.249+0000 7f950cbd1700 1 -- 172.21.15.156:0/231767846 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f950804f2a0 con 0x7f95081309f0 2023-09-30T22:24:39.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.249+0000 7f94f6ffd700 1 -- 172.21.15.156:0/231767846 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9500011380 con 0x7f95081309f0 2023-09-30T22:24:39.250 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:39.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.252+0000 7f950cbd1700 1 -- 172.21.15.156:0/231767846 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95081309f0 msgr2=0x7f95081c4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:39.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.252+0000 7f950cbd1700 1 --2- 172.21.15.156:0/231767846 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95081309f0 0x7f95081c4f90 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f950000cb10 tx=0x7f950000ce20 comp rx=0 tx=0).stop 2023-09-30T22:24:39.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.252+0000 7f950cbd1700 1 -- 172.21.15.156:0/231767846 shutdown_connections 2023-09-30T22:24:39.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.252+0000 7f950cbd1700 1 --2- 172.21.15.156:0/231767846 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f95081309f0 0x7f95081c4f90 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.252+0000 7f950cbd1700 1 --2- 172.21.15.156:0/231767846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f950809d8f0 0x7f95081c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.252+0000 7f950cbd1700 1 --2- 172.21.15.156:0/231767846 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f950809e280 0x7f95081c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.252+0000 7f950cbd1700 1 -- 172.21.15.156:0/231767846 >> 172.21.15.156:0/231767846 conn(0x7f95080a2b30 msgr2=0x7f95080993e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:39.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.252+0000 7f950cbd1700 1 -- 172.21.15.156:0/231767846 shutdown_connections 2023-09-30T22:24:39.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.252+0000 7f950cbd1700 1 -- 172.21.15.156:0/231767846 wait complete. 2023-09-30T22:24:39.269 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:39.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.429+0000 7ff6cb3f3700 1 -- 172.21.15.156:0/2668980054 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff6c404f2a0 con 0x7ff6c412d280 2023-09-30T22:24:39.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.429+0000 7ff6b9ffb700 1 -- 172.21.15.156:0/2668980054 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff6c001f8f0 con 0x7ff6c412d280 2023-09-30T22:24:39.430 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:39.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.431+0000 7ff6cb3f3700 1 -- 172.21.15.156:0/2668980054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6c412d280 msgr2=0x7ff6c411da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:39.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.431+0000 7ff6cb3f3700 1 --2- 172.21.15.156:0/2668980054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6c412d280 0x7ff6c411da80 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7ff6c000ec90 tx=0x7ff6c000d350 comp rx=0 tx=0).stop 2023-09-30T22:24:39.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.431+0000 7ff6cb3f3700 1 -- 172.21.15.156:0/2668980054 shutdown_connections 2023-09-30T22:24:39.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.431+0000 7ff6cb3f3700 1 --2- 172.21.15.156:0/2668980054 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff6c4130ce0 0x7ff6c411e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.431+0000 7ff6cb3f3700 1 --2- 172.21.15.156:0/2668980054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6c412d280 0x7ff6c411da80 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.431+0000 7ff6cb3f3700 1 --2- 172.21.15.156:0/2668980054 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6c4130350 0x7ff6c411dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.431+0000 7ff6cb3f3700 1 -- 172.21.15.156:0/2668980054 >> 172.21.15.156:0/2668980054 conn(0x7ff6c40a2980 msgr2=0x7ff6c412c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:39.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.431+0000 7ff6cb3f3700 1 -- 172.21.15.156:0/2668980054 shutdown_connections 2023-09-30T22:24:39.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:39.431+0000 7ff6cb3f3700 1 -- 172.21.15.156:0/2668980054 wait complete. 2023-09-30T22:24:39.444 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:40.059 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:40.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.185+0000 7f49d7889700 1 Processor -- start 2023-09-30T22:24:40.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.185+0000 7f49d7889700 1 -- start start 2023-09-30T22:24:40.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.186+0000 7f49d7889700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f49d009e870 0x7f49d009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.186+0000 7f49d7889700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49d009f180 0x7f49d0133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.186+0000 7f49d7889700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49d0134160 0x7f49d01345e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.186+0000 7f49d7889700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d00a0370 con 0x7f49d009e870 2023-09-30T22:24:40.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.186+0000 7f49d7889700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d009fa00 con 0x7f49d009f180 2023-09-30T22:24:40.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.186+0000 7f49d7889700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49d009ada0 con 0x7f49d0134160 2023-09-30T22:24:40.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.186+0000 7f49d5e26700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49d0134160 0x7f49d01345e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.186+0000 7f49d4e24700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49d009f180 0x7f49d0133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.186+0000 7f49d5625700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f49d009e870 0x7f49d009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.186+0000 7f49d4e24700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49d009f180 0x7f49d0133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49258/0 (socket says 172.21.15.156:49258) 2023-09-30T22:24:40.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.186+0000 7f49d5e26700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49d0134160 0x7f49d01345e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:38200/0 (socket says 172.21.15.156:38200) 2023-09-30T22:24:40.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.186+0000 7f49d4e24700 1 -- 172.21.15.156:0/502260937 learned_addr learned my addr 172.21.15.156:0/502260937 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:40.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.186+0000 7f49d4e24700 1 -- 172.21.15.156:0/502260937 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49d0134160 msgr2=0x7f49d01345e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:40.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.186+0000 7f49d4e24700 1 --2- 172.21.15.156:0/502260937 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49d0134160 0x7f49d01345e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.186+0000 7f49d4e24700 1 -- 172.21.15.156:0/502260937 >> v2:172.21.15.156:3300/0 conn(0x7f49d009e870 msgr2=0x7f49d009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:40.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.186+0000 7f49d4e24700 1 --2- 172.21.15.156:0/502260937 >> v2:172.21.15.156:3300/0 conn(0x7f49d009e870 0x7f49d009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.186+0000 7f49d4e24700 1 -- 172.21.15.156:0/502260937 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d006bec0 con 0x7f49d009f180 2023-09-30T22:24:40.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.186+0000 7f49d5e26700 1 --2- 172.21.15.156:0/502260937 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49d0134160 0x7f49d01345e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:40.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.186+0000 7f49d5625700 1 --2- 172.21.15.156:0/502260937 >> v2:172.21.15.156:3300/0 conn(0x7f49d009e870 0x7f49d009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:40.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.187+0000 7f49d4e24700 1 --2- 172.21.15.156:0/502260937 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49d009f180 0x7f49d0133c20 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f49cc0098f0 tx=0x7f49cc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9186ac4dfb46696 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:40.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.187+0000 7f49c7fff700 1 -- 172.21.15.156:0/502260937 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc011830 con 0x7f49d009f180 2023-09-30T22:24:40.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.187+0000 7f49c7fff700 1 -- 172.21.15.156:0/502260937 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49cc011990 con 0x7f49d009f180 2023-09-30T22:24:40.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.187+0000 7f49c7fff700 1 -- 172.21.15.156:0/502260937 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc011d20 con 0x7f49d009f180 2023-09-30T22:24:40.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.187+0000 7f49d7889700 1 -- 172.21.15.156:0/502260937 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49d009f180 msgr2=0x7f49d0133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.187+0000 7f49d7889700 1 --2- 172.21.15.156:0/502260937 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49d009f180 0x7f49d0133c20 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f49cc0098f0 tx=0x7f49cc009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:40.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.187+0000 7f49d7889700 1 -- 172.21.15.156:0/502260937 shutdown_connections 2023-09-30T22:24:40.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.187+0000 7f49d7889700 1 --2- 172.21.15.156:0/502260937 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49d0134160 0x7f49d01345e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.187+0000 7f49d7889700 1 --2- 172.21.15.156:0/502260937 >> v2:172.21.15.156:3300/0 conn(0x7f49d009e870 0x7f49d009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.187+0000 7f49d7889700 1 --2- 172.21.15.156:0/502260937 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49d009f180 0x7f49d0133c20 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.187+0000 7f49d7889700 1 -- 172.21.15.156:0/502260937 >> 172.21.15.156:0/502260937 conn(0x7f49d00a4430 msgr2=0x7f49d00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:40.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.187+0000 7f49d7889700 1 -- 172.21.15.156:0/502260937 shutdown_connections 2023-09-30T22:24:40.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.187+0000 7f49d7889700 1 -- 172.21.15.156:0/502260937 wait complete. 2023-09-30T22:24:40.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.188+0000 7f49d7889700 1 Processor -- start 2023-09-30T22:24:40.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.188+0000 7f49d7889700 1 -- start start 2023-09-30T22:24:40.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.189+0000 7f49d7889700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49d009e870 0x7f49d01224b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.189+0000 7f49d7889700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49d009f180 0x7f49d01229f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.189+0000 7f49d7889700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49d0134160 0x7f49d0122f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.189+0000 7f49d7889700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d01240c0 con 0x7f49d0134160 2023-09-30T22:24:40.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.189+0000 7f49d7889700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d0123910 con 0x7f49d009e870 2023-09-30T22:24:40.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.189+0000 7f49d7889700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49d0124f50 con 0x7f49d009f180 2023-09-30T22:24:40.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.189+0000 7f49d5625700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49d009e870 0x7f49d01224b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.189+0000 7f49d4e24700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49d009f180 0x7f49d01229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.189+0000 7f49d5625700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49d009e870 0x7f49d01224b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49272/0 (socket says 172.21.15.156:49272) 2023-09-30T22:24:40.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.189+0000 7f49d5625700 1 -- 172.21.15.156:0/3996570839 learned_addr learned my addr 172.21.15.156:0/3996570839 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:40.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.189+0000 7f49d5e26700 1 --2- 172.21.15.156:0/3996570839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49d0134160 0x7f49d0122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.189+0000 7f49d5625700 1 -- 172.21.15.156:0/3996570839 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49d009f180 msgr2=0x7f49d01229f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.189+0000 7f49d5625700 1 --2- 172.21.15.156:0/3996570839 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49d009f180 0x7f49d01229f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.189+0000 7f49d5625700 1 -- 172.21.15.156:0/3996570839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49d0134160 msgr2=0x7f49d0122f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.189+0000 7f49d5625700 1 --2- 172.21.15.156:0/3996570839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49d0134160 0x7f49d0122f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.189+0000 7f49d5625700 1 -- 172.21.15.156:0/3996570839 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c00094a0 con 0x7f49d009e870 2023-09-30T22:24:40.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.189+0000 7f49d4e24700 1 --2- 172.21.15.156:0/3996570839 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49d009f180 0x7f49d01229f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:40.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.189+0000 7f49d5625700 1 --2- 172.21.15.156:0/3996570839 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49d009e870 0x7f49d01224b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f49c000ec10 tx=0x7f49c000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:40.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.189+0000 7f49c5ffb700 1 -- 172.21.15.156:0/3996570839 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c0009760 con 0x7f49d009e870 2023-09-30T22:24:40.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.189+0000 7f49c5ffb700 1 -- 172.21.15.156:0/3996570839 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c000c850 con 0x7f49d009e870 2023-09-30T22:24:40.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.189+0000 7f49d7889700 1 -- 172.21.15.156:0/3996570839 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c8009a70 con 0x7f49d009e870 2023-09-30T22:24:40.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.189+0000 7f49c5ffb700 1 -- 172.21.15.156:0/3996570839 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c000cbe0 con 0x7f49d009e870 2023-09-30T22:24:40.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.190+0000 7f49d7889700 1 -- 172.21.15.156:0/3996570839 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49cc009550 con 0x7f49d009e870 2023-09-30T22:24:40.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.190+0000 7f49c5ffb700 1 -- 172.21.15.156:0/3996570839 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f49c000cd40 con 0x7f49d009e870 2023-09-30T22:24:40.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.190+0000 7f49c5ffb700 1 -- 172.21.15.156:0/3996570839 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f49c003fa30 con 0x7f49d009e870 2023-09-30T22:24:40.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.191+0000 7f49d7889700 1 -- 172.21.15.156:0/3996570839 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d006cfa0 con 0x7f49d009e870 2023-09-30T22:24:40.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.195+0000 7f49c5ffb700 1 -- 172.21.15.156:0/3996570839 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f49c0017080 con 0x7f49d009e870 2023-09-30T22:24:40.223 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:40.271 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:40.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.350+0000 7f971fd9a700 1 Processor -- start 2023-09-30T22:24:40.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.351+0000 7f971fd9a700 1 -- start start 2023-09-30T22:24:40.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.351+0000 7f971fd9a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f971809e340 0x7f97181359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.351+0000 7f971fd9a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9718135f20 0x7f9718138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.351+0000 7f971fd9a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f971809aaa0 con 0x7f971809d860 2023-09-30T22:24:40.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.351+0000 7f971fd9a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971809e730 con 0x7f9718135f20 2023-09-30T22:24:40.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.351+0000 7f971fd9a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f971809f870 con 0x7f971809e340 2023-09-30T22:24:40.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.351+0000 7f971e337700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9718135f20 0x7f9718138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.351+0000 7f971d335700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f971809e340 0x7f97181359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.351+0000 7f971e337700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9718135f20 0x7f9718138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49280/0 (socket says 172.21.15.156:49280) 2023-09-30T22:24:40.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.351+0000 7f971e337700 1 -- 172.21.15.156:0/252345909 learned_addr learned my addr 172.21.15.156:0/252345909 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:40.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.351+0000 7f971d335700 1 -- 172.21.15.156:0/252345909 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9718135f20 msgr2=0x7f9718138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:40.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.351+0000 7f971d335700 1 --2- 172.21.15.156:0/252345909 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9718135f20 0x7f9718138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.351+0000 7f971cb34700 1 -- 172.21.15.156:0/252345909 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1627310284 0 0) 0x7f971809aaa0 con 0x7f971809d860 2023-09-30T22:24:40.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.351+0000 7f971d335700 1 -- 172.21.15.156:0/252345909 >> v1:172.21.15.156:6789/0 conn(0x7f971809d860 legacy=0x7f971809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.351+0000 7f971d335700 1 -- 172.21.15.156:0/252345909 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971809b360 con 0x7f971809e340 2023-09-30T22:24:40.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.352+0000 7f971e337700 1 --2- 172.21.15.156:0/252345909 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9718135f20 0x7f9718138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:40.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.352+0000 7f971d335700 1 --2- 172.21.15.156:0/252345909 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f971809e340 0x7f97181359e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f97080098a0 tx=0x7f9708009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db250979cc919c8b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:40.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.352+0000 7f971cb34700 1 -- 172.21.15.156:0/252345909 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9708011830 con 0x7f971809e340 2023-09-30T22:24:40.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.352+0000 7f971cb34700 1 -- 172.21.15.156:0/252345909 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9708011990 con 0x7f971809e340 2023-09-30T22:24:40.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.352+0000 7f971cb34700 1 -- 172.21.15.156:0/252345909 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9708011d20 con 0x7f971809e340 2023-09-30T22:24:40.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.352+0000 7f971fd9a700 1 -- 172.21.15.156:0/252345909 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f971809e340 msgr2=0x7f97181359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.352+0000 7f971fd9a700 1 --2- 172.21.15.156:0/252345909 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f971809e340 0x7f97181359e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f97080098a0 tx=0x7f9708009bb0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.352+0000 7f971fd9a700 1 -- 172.21.15.156:0/252345909 shutdown_connections 2023-09-30T22:24:40.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.352+0000 7f971fd9a700 1 --2- 172.21.15.156:0/252345909 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9718135f20 0x7f9718138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.352+0000 7f971fd9a700 1 --2- 172.21.15.156:0/252345909 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f971809e340 0x7f97181359e0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.352+0000 7f971fd9a700 1 -- 172.21.15.156:0/252345909 >> 172.21.15.156:0/252345909 conn(0x7f9718099c40 msgr2=0x7f97180a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:40.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.353+0000 7f971fd9a700 1 -- 172.21.15.156:0/252345909 shutdown_connections 2023-09-30T22:24:40.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.353+0000 7f971fd9a700 1 -- 172.21.15.156:0/252345909 wait complete. 2023-09-30T22:24:40.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.353+0000 7f971fd9a700 1 Processor -- start 2023-09-30T22:24:40.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.354+0000 7f971fd9a700 1 -- start start 2023-09-30T22:24:40.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.354+0000 7f971fd9a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f971809d860 0x7f97181c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.354+0000 7f971fd9a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f971809e340 0x7f97181c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.354+0000 7f971fd9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9718135f20 0x7f97181207c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.354+0000 7f971fd9a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9718122c40 con 0x7f9718135f20 2023-09-30T22:24:40.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.354+0000 7f971fd9a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97181bb000 con 0x7f971809d860 2023-09-30T22:24:40.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.354+0000 7f971fd9a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9718124010 con 0x7f971809e340 2023-09-30T22:24:40.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.354+0000 7f971db36700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f971809d860 0x7f97181c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.354+0000 7f971db36700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f971809d860 0x7f97181c8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49282/0 (socket says 172.21.15.156:49282) 2023-09-30T22:24:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.354+0000 7f971db36700 1 -- 172.21.15.156:0/732102101 learned_addr learned my addr 172.21.15.156:0/732102101 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.354+0000 7f971d335700 1 --2- 172.21.15.156:0/732102101 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f971809e340 0x7f97181c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.354+0000 7f971e337700 1 --2- 172.21.15.156:0/732102101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9718135f20 0x7f97181207c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.354+0000 7f971db36700 1 -- 172.21.15.156:0/732102101 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f971809e340 msgr2=0x7f97181c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.354+0000 7f971db36700 1 --2- 172.21.15.156:0/732102101 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f971809e340 0x7f97181c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.354+0000 7f971db36700 1 -- 172.21.15.156:0/732102101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9718135f20 msgr2=0x7f97181207c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.354+0000 7f971db36700 1 --2- 172.21.15.156:0/732102101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9718135f20 0x7f97181207c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.354+0000 7f971db36700 1 -- 172.21.15.156:0/732102101 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9710009b30 con 0x7f971809d860 2023-09-30T22:24:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.355+0000 7f971db36700 1 --2- 172.21.15.156:0/732102101 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f971809d860 0x7f97181c8620 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f971400c450 tx=0x7f971400c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.355+0000 7f970e7fc700 1 -- 172.21.15.156:0/732102101 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97140054e0 con 0x7f971809d860 2023-09-30T22:24:40.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.355+0000 7f970e7fc700 1 -- 172.21.15.156:0/732102101 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971400ce60 con 0x7f971809d860 2023-09-30T22:24:40.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.355+0000 7f970e7fc700 1 -- 172.21.15.156:0/732102101 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97140038c0 con 0x7f971809d860 2023-09-30T22:24:40.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.355+0000 7f971fd9a700 1 -- 172.21.15.156:0/732102101 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97080094a0 con 0x7f971809d860 2023-09-30T22:24:40.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.355+0000 7f971fd9a700 1 -- 172.21.15.156:0/732102101 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97180a2090 con 0x7f971809d860 2023-09-30T22:24:40.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.356+0000 7f970e7fc700 1 -- 172.21.15.156:0/732102101 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9714003a20 con 0x7f971809d860 2023-09-30T22:24:40.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.356+0000 7f970e7fc700 1 -- 172.21.15.156:0/732102101 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f971403ea80 con 0x7f971809d860 2023-09-30T22:24:40.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.356+0000 7f971fd9a700 1 -- 172.21.15.156:0/732102101 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f971804f2a0 con 0x7f971809d860 2023-09-30T22:24:40.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.365+0000 7f970e7fc700 1 -- 172.21.15.156:0/732102101 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9714017030 con 0x7f971809d860 2023-09-30T22:24:40.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.398+0000 7f8a7e56e700 1 Processor -- start 2023-09-30T22:24:40.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.398+0000 7f8a7e56e700 1 -- start start 2023-09-30T22:24:40.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.398+0000 7f49d7889700 1 -- 172.21.15.156:0/3996570839 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f49d004f2a0 con 0x7f49d009e870 2023-09-30T22:24:40.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.398+0000 7f49c5ffb700 1 -- 172.21.15.156:0/3996570839 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f49c0021020 con 0x7f49d009e870 2023-09-30T22:24:40.400 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:40.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.399+0000 7f8a7e56e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8a780a0a70 0x7f8a780a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.399+0000 7f8a7e56e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a78134120 0x7f8a7813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.399+0000 7f8a7e56e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a7809dc00 con 0x7f8a780a1380 2023-09-30T22:24:40.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.399+0000 7f8a7e56e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a7809ea90 con 0x7f8a780a0a70 2023-09-30T22:24:40.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.399+0000 7f8a7e56e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7809dec0 con 0x7f8a78134120 2023-09-30T22:24:40.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.399+0000 7f8a777fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f8a780a1380 0x7f8a78133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53408/0 (socket says 172.21.15.156:53408) 2023-09-30T22:24:40.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.399+0000 7f8a777fe700 1 -- 172.21.15.156:0/1703997505 learned_addr learned my addr 172.21.15.156:0/1703997505 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:40.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.399+0000 7f8a77fff700 1 --2- 172.21.15.156:0/1703997505 >> v2:172.21.15.156:3300/0 conn(0x7f8a780a0a70 0x7f8a780a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.399+0000 7f8a7cb0b700 1 --2- 172.21.15.156:0/1703997505 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a78134120 0x7f8a7813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.399+0000 7f8a76ffd700 1 -- 172.21.15.156:0/1703997505 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508303213 0 0) 0x7f8a7809dc00 con 0x7f8a780a1380 2023-09-30T22:24:40.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.399+0000 7f8a76ffd700 1 -- 172.21.15.156:0/1703997505 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a600035b0 con 0x7f8a780a1380 2023-09-30T22:24:40.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.399+0000 7f8a77fff700 1 -- 172.21.15.156:0/1703997505 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a78134120 msgr2=0x7f8a7813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:40.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.399+0000 7f8a77fff700 1 --2- 172.21.15.156:0/1703997505 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a78134120 0x7f8a7813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.399+0000 7f8a77fff700 1 -- 172.21.15.156:0/1703997505 >> v1:172.21.15.156:6789/0 conn(0x7f8a780a1380 legacy=0x7f8a78133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.399+0000 7f8a77fff700 1 -- 172.21.15.156:0/1703997505 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7809e6a0 con 0x7f8a780a0a70 2023-09-30T22:24:40.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.399+0000 7f8a77fff700 1 --2- 172.21.15.156:0/1703997505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a780a0a70 0x7f8a780a0e40 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f8a68009840 tx=0x7f8a68009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2642605506a9244 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:40.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.399+0000 7f8a76ffd700 1 -- 172.21.15.156:0/1703997505 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68011830 con 0x7f8a780a0a70 2023-09-30T22:24:40.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.399+0000 7f8a76ffd700 1 -- 172.21.15.156:0/1703997505 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a68011990 con 0x7f8a780a0a70 2023-09-30T22:24:40.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.399+0000 7f8a76ffd700 1 -- 172.21.15.156:0/1703997505 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68011d00 con 0x7f8a780a0a70 2023-09-30T22:24:40.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.400+0000 7f8a7e56e700 1 -- 172.21.15.156:0/1703997505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a780a0a70 msgr2=0x7f8a780a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.400+0000 7f8a7e56e700 1 --2- 172.21.15.156:0/1703997505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a780a0a70 0x7f8a780a0e40 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f8a68009840 tx=0x7f8a68009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:40.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.400+0000 7f8a7e56e700 1 -- 172.21.15.156:0/1703997505 shutdown_connections 2023-09-30T22:24:40.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.400+0000 7f8a7e56e700 1 --2- 172.21.15.156:0/1703997505 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a78134120 0x7f8a7813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.400+0000 7f8a7e56e700 1 --2- 172.21.15.156:0/1703997505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a780a0a70 0x7f8a780a0e40 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.401+0000 7f8a7e56e700 1 -- 172.21.15.156:0/1703997505 >> 172.21.15.156:0/1703997505 conn(0x7f8a780a6610 msgr2=0x7f8a780a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:40.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.401+0000 7f8a7e56e700 1 -- 172.21.15.156:0/1703997505 shutdown_connections 2023-09-30T22:24:40.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.401+0000 7f8a7e56e700 1 -- 172.21.15.156:0/1703997505 wait complete. 2023-09-30T22:24:40.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.401+0000 7f49d7889700 1 -- 172.21.15.156:0/3996570839 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49d009e870 msgr2=0x7f49d01224b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.401+0000 7f49d7889700 1 --2- 172.21.15.156:0/3996570839 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49d009e870 0x7f49d01224b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f49c000ec10 tx=0x7f49c000ef20 comp rx=0 tx=0).stop 2023-09-30T22:24:40.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.401+0000 7f49d7889700 1 -- 172.21.15.156:0/3996570839 shutdown_connections 2023-09-30T22:24:40.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.401+0000 7f49d7889700 1 --2- 172.21.15.156:0/3996570839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49d0134160 0x7f49d0122f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.401+0000 7f49d7889700 1 --2- 172.21.15.156:0/3996570839 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f49d009e870 0x7f49d01224b0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.401+0000 7f49d7889700 1 --2- 172.21.15.156:0/3996570839 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f49d009f180 0x7f49d01229f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.401+0000 7f49d7889700 1 -- 172.21.15.156:0/3996570839 >> 172.21.15.156:0/3996570839 conn(0x7f49d00a4430 msgr2=0x7f49d00709e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:40.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.401+0000 7f8a7e56e700 1 Processor -- start 2023-09-30T22:24:40.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.402+0000 7f49d7889700 1 -- 172.21.15.156:0/3996570839 shutdown_connections 2023-09-30T22:24:40.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.402+0000 7f8a7e56e700 1 -- start start 2023-09-30T22:24:40.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.402+0000 7f8a7e56e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a780a0a70 0x7f8a78126c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.402+0000 7f8a7e56e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a780a1380 0x7f8a78127180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.402+0000 7f8a7e56e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a78134120 0x7f8a781cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.402+0000 7f8a7e56e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a781285f0 con 0x7f8a780a1380 2023-09-30T22:24:40.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.402+0000 7f8a7e56e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a78128a20 con 0x7f8a780a0a70 2023-09-30T22:24:40.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.402+0000 7f8a7e56e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a78129a50 con 0x7f8a78134120 2023-09-30T22:24:40.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.403+0000 7f8a77fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a780a0a70 0x7f8a78126c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.403+0000 7f8a777fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a780a1380 0x7f8a78127180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.403+0000 7f8a77fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a780a0a70 0x7f8a78126c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49302/0 (socket says 172.21.15.156:49302) 2023-09-30T22:24:40.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.403+0000 7f8a77fff700 1 -- 172.21.15.156:0/968467697 learned_addr learned my addr 172.21.15.156:0/968467697 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:40.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.403+0000 7f8a7cb0b700 1 --2- 172.21.15.156:0/968467697 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a78134120 0x7f8a781cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.403+0000 7f8a77fff700 1 -- 172.21.15.156:0/968467697 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a78134120 msgr2=0x7f8a781cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.403+0000 7f8a77fff700 1 --2- 172.21.15.156:0/968467697 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a78134120 0x7f8a781cc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.403+0000 7f8a77fff700 1 -- 172.21.15.156:0/968467697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a780a1380 msgr2=0x7f8a78127180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.403+0000 7f8a77fff700 1 --2- 172.21.15.156:0/968467697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a780a1380 0x7f8a78127180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.403+0000 7f8a77fff700 1 -- 172.21.15.156:0/968467697 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a680094a0 con 0x7f8a780a0a70 2023-09-30T22:24:40.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.403+0000 7f8a777fe700 1 --2- 172.21.15.156:0/968467697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a780a1380 0x7f8a78127180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:40.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.403+0000 7f8a77fff700 1 --2- 172.21.15.156:0/968467697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a780a0a70 0x7f8a78126c40 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8a68000c00 tx=0x7f8a68004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:40.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.403+0000 7f8a74ff9700 1 -- 172.21.15.156:0/968467697 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a680044d0 con 0x7f8a780a0a70 2023-09-30T22:24:40.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.403+0000 7f8a74ff9700 1 -- 172.21.15.156:0/968467697 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6801f070 con 0x7f8a780a0a70 2023-09-30T22:24:40.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.403+0000 7f8a74ff9700 1 -- 172.21.15.156:0/968467697 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a680038e0 con 0x7f8a780a0a70 2023-09-30T22:24:40.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.403+0000 7f8a7e56e700 1 -- 172.21.15.156:0/968467697 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a7812a4c0 con 0x7f8a780a0a70 2023-09-30T22:24:40.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.403+0000 7f8a7e56e700 1 -- 172.21.15.156:0/968467697 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a78127db0 con 0x7f8a780a0a70 2023-09-30T22:24:40.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.404+0000 7f8a74ff9700 1 -- 172.21.15.156:0/968467697 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8a68003a40 con 0x7f8a780a0a70 2023-09-30T22:24:40.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.404+0000 7f8a74ff9700 1 -- 172.21.15.156:0/968467697 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8a68021070 con 0x7f8a780a0a70 2023-09-30T22:24:40.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.404+0000 7f8a7e56e700 1 -- 172.21.15.156:0/968467697 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a78127fa0 con 0x7f8a780a0a70 2023-09-30T22:24:40.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.406+0000 7f49d7889700 1 -- 172.21.15.156:0/3996570839 wait complete. 2023-09-30T22:24:40.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.409+0000 7f8a74ff9700 1 -- 172.21.15.156:0/968467697 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a6802b020 con 0x7f8a780a0a70 2023-09-30T22:24:40.418 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:40.445 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:40.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.561+0000 7f971fd9a700 1 -- 172.21.15.156:0/732102101 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f97181228c0 con 0x7f971809d860 2023-09-30T22:24:40.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.561+0000 7f970e7fc700 1 -- 172.21.15.156:0/732102101 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9714019cd0 con 0x7f971809d860 2023-09-30T22:24:40.562 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:40.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.563+0000 7f971fd9a700 1 -- 172.21.15.156:0/732102101 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f971809d860 msgr2=0x7f97181c8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.563+0000 7f971fd9a700 1 --2- 172.21.15.156:0/732102101 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f971809d860 0x7f97181c8620 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f971400c450 tx=0x7f971400c760 comp rx=0 tx=0).stop 2023-09-30T22:24:40.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.564+0000 7f971fd9a700 1 -- 172.21.15.156:0/732102101 shutdown_connections 2023-09-30T22:24:40.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.564+0000 7f971fd9a700 1 --2- 172.21.15.156:0/732102101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9718135f20 0x7f97181207c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.564+0000 7f971fd9a700 1 --2- 172.21.15.156:0/732102101 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f971809d860 0x7f97181c8620 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.564+0000 7f971fd9a700 1 --2- 172.21.15.156:0/732102101 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f971809e340 0x7f97181c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.564+0000 7f971fd9a700 1 -- 172.21.15.156:0/732102101 >> 172.21.15.156:0/732102101 conn(0x7f9718099c40 msgr2=0x7f971806eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:40.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.564+0000 7f971fd9a700 1 -- 172.21.15.156:0/732102101 shutdown_connections 2023-09-30T22:24:40.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.564+0000 7f971fd9a700 1 -- 172.21.15.156:0/732102101 wait complete. 2023-09-30T22:24:40.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.570+0000 7fe57c6a6700 1 Processor -- start 2023-09-30T22:24:40.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.571+0000 7fe57c6a6700 1 -- start start 2023-09-30T22:24:40.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.571+0000 7fe57c6a6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe574133ad0 0x7fe574133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.571+0000 7fe57c6a6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5741300a0 0x7fe5741304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.571+0000 7fe57c6a6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5741309f0 0x7fe57413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.571+0000 7fe57c6a6700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe57406b2d0 con 0x7fe574133ad0 2023-09-30T22:24:40.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.571+0000 7fe57c6a6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe574133610 con 0x7fe5741309f0 2023-09-30T22:24:40.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.571+0000 7fe57c6a6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe57409a500 con 0x7fe5741300a0 2023-09-30T22:24:40.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.572+0000 7fe579c41700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5741300a0 0x7fe5741304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.572+0000 7fe579c41700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5741300a0 0x7fe5741304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:38250/0 (socket says 172.21.15.156:38250) 2023-09-30T22:24:40.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.572+0000 7fe579c41700 1 -- 172.21.15.156:0/884781664 learned_addr learned my addr 172.21.15.156:0/884781664 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:40.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.572+0000 7fe57a442700 1 --2- 172.21.15.156:0/884781664 >> v2:172.21.15.156:3300/0 conn(0x7fe574133ad0 0x7fe574133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.572+0000 7fe57ac43700 1 --2- 172.21.15.156:0/884781664 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5741309f0 0x7fe57413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.572+0000 7fe579c41700 1 -- 172.21.15.156:0/884781664 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5741309f0 msgr2=0x7fe57413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:40.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.572+0000 7fe579c41700 1 --2- 172.21.15.156:0/884781664 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5741309f0 0x7fe57413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.572+0000 7fe579c41700 1 -- 172.21.15.156:0/884781664 >> v2:172.21.15.156:3300/0 conn(0x7fe574133ad0 msgr2=0x7fe574133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:40.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.572+0000 7fe579c41700 1 --2- 172.21.15.156:0/884781664 >> v2:172.21.15.156:3300/0 conn(0x7fe574133ad0 0x7fe574133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.572+0000 7fe579c41700 1 -- 172.21.15.156:0/884781664 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5741338b0 con 0x7fe5741300a0 2023-09-30T22:24:40.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.572+0000 7fe57a442700 1 --2- 172.21.15.156:0/884781664 >> v2:172.21.15.156:3300/0 conn(0x7fe574133ad0 0x7fe574133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:40.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.572+0000 7fe579c41700 1 --2- 172.21.15.156:0/884781664 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5741300a0 0x7fe5741304b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fe5640098f0 tx=0x7fe564009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=900b1ea953e9f8cb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:40.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.572+0000 7fe579440700 1 -- 172.21.15.156:0/884781664 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe564011830 con 0x7fe5741300a0 2023-09-30T22:24:40.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.572+0000 7fe579440700 1 -- 172.21.15.156:0/884781664 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe564011990 con 0x7fe5741300a0 2023-09-30T22:24:40.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.572+0000 7fe579440700 1 -- 172.21.15.156:0/884781664 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe564011d20 con 0x7fe5741300a0 2023-09-30T22:24:40.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.573+0000 7fe57c6a6700 1 -- 172.21.15.156:0/884781664 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5741300a0 msgr2=0x7fe5741304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.573+0000 7fe57c6a6700 1 --2- 172.21.15.156:0/884781664 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5741300a0 0x7fe5741304b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fe5640098f0 tx=0x7fe564009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:40.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.573+0000 7fe57c6a6700 1 -- 172.21.15.156:0/884781664 shutdown_connections 2023-09-30T22:24:40.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.573+0000 7fe57c6a6700 1 --2- 172.21.15.156:0/884781664 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5741309f0 0x7fe57413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.573+0000 7fe57c6a6700 1 --2- 172.21.15.156:0/884781664 >> v2:172.21.15.156:3300/0 conn(0x7fe574133ad0 0x7fe574133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.573+0000 7fe57c6a6700 1 --2- 172.21.15.156:0/884781664 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5741300a0 0x7fe5741304b0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.573+0000 7fe57c6a6700 1 -- 172.21.15.156:0/884781664 >> 172.21.15.156:0/884781664 conn(0x7fe574099c40 msgr2=0x7fe5740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:40.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.574+0000 7fe57c6a6700 1 -- 172.21.15.156:0/884781664 shutdown_connections 2023-09-30T22:24:40.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.574+0000 7fe57c6a6700 1 -- 172.21.15.156:0/884781664 wait complete. 2023-09-30T22:24:40.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.575+0000 7fe57c6a6700 1 Processor -- start 2023-09-30T22:24:40.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.575+0000 7fe57c6a6700 1 -- start start 2023-09-30T22:24:40.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.575+0000 7fe57c6a6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5741300a0 0x7fe57411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.575+0000 7fe57c6a6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5741309f0 0x7fe57411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.575+0000 7fe57c6a6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe574133ad0 0x7fe57411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.575+0000 7fe57c6a6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57411fcc0 con 0x7fe574133ad0 2023-09-30T22:24:40.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.575+0000 7fe57c6a6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe574072020 con 0x7fe5741300a0 2023-09-30T22:24:40.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.576+0000 7fe57c6a6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5740a3370 con 0x7fe5741309f0 2023-09-30T22:24:40.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.576+0000 7fe57a442700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5741300a0 0x7fe57411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.576+0000 7fe57a442700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5741300a0 0x7fe57411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49322/0 (socket says 172.21.15.156:49322) 2023-09-30T22:24:40.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.576+0000 7fe57a442700 1 -- 172.21.15.156:0/1070584457 learned_addr learned my addr 172.21.15.156:0/1070584457 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:40.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.576+0000 7fe57ac43700 1 --2- 172.21.15.156:0/1070584457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe574133ad0 0x7fe57411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.576+0000 7fe57a442700 1 -- 172.21.15.156:0/1070584457 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5741309f0 msgr2=0x7fe57411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.576+0000 7fe57a442700 1 --2- 172.21.15.156:0/1070584457 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5741309f0 0x7fe57411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.576+0000 7fe57a442700 1 -- 172.21.15.156:0/1070584457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe574133ad0 msgr2=0x7fe57411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.576+0000 7fe57a442700 1 --2- 172.21.15.156:0/1070584457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe574133ad0 0x7fe57411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.576+0000 7fe57a442700 1 -- 172.21.15.156:0/1070584457 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5700094a0 con 0x7fe5741300a0 2023-09-30T22:24:40.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.576+0000 7fe57ac43700 1 --2- 172.21.15.156:0/1070584457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe574133ad0 0x7fe57411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:40.583 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:40.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.576+0000 7fe57a442700 1 --2- 172.21.15.156:0/1070584457 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5741300a0 0x7fe57411da40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fe57000ebe0 tx=0x7fe57000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:40.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.576+0000 7fe56affd700 1 -- 172.21.15.156:0/1070584457 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe570009800 con 0x7fe5741300a0 2023-09-30T22:24:40.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.576+0000 7fe56affd700 1 -- 172.21.15.156:0/1070584457 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57000c910 con 0x7fe5741300a0 2023-09-30T22:24:40.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.576+0000 7fe56affd700 1 -- 172.21.15.156:0/1070584457 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57000cc80 con 0x7fe5741300a0 2023-09-30T22:24:40.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.576+0000 7fe57c6a6700 1 -- 172.21.15.156:0/1070584457 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe564009550 con 0x7fe5741300a0 2023-09-30T22:24:40.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.576+0000 7fe57c6a6700 1 -- 172.21.15.156:0/1070584457 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe57411ffa0 con 0x7fe5741300a0 2023-09-30T22:24:40.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.577+0000 7fe56affd700 1 -- 172.21.15.156:0/1070584457 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe570013470 con 0x7fe5741300a0 2023-09-30T22:24:40.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.577+0000 7fe56affd700 1 -- 172.21.15.156:0/1070584457 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe57003fb60 con 0x7fe5741300a0 2023-09-30T22:24:40.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.578+0000 7fe57c6a6700 1 -- 172.21.15.156:0/1070584457 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe57404f2a0 con 0x7fe5741300a0 2023-09-30T22:24:40.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.582+0000 7fe56affd700 1 -- 172.21.15.156:0/1070584457 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe570013720 con 0x7fe5741300a0 2023-09-30T22:24:40.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.610+0000 7f8a7e56e700 1 -- 172.21.15.156:0/968467697 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8a781339c0 con 0x7f8a780a0a70 2023-09-30T22:24:40.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.610+0000 7f8a74ff9700 1 -- 172.21.15.156:0/968467697 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8a68034070 con 0x7f8a780a0a70 2023-09-30T22:24:40.614 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:40.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.613+0000 7f8a7e56e700 1 -- 172.21.15.156:0/968467697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a780a0a70 msgr2=0x7f8a78126c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.613+0000 7f8a7e56e700 1 --2- 172.21.15.156:0/968467697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a780a0a70 0x7f8a78126c40 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8a68000c00 tx=0x7f8a68004750 comp rx=0 tx=0).stop 2023-09-30T22:24:40.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.613+0000 7f8a7e56e700 1 -- 172.21.15.156:0/968467697 shutdown_connections 2023-09-30T22:24:40.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.613+0000 7f8a7e56e700 1 --2- 172.21.15.156:0/968467697 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8a78134120 0x7f8a781cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.613+0000 7f8a7e56e700 1 --2- 172.21.15.156:0/968467697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8a780a0a70 0x7f8a78126c40 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.613+0000 7f8a7e56e700 1 --2- 172.21.15.156:0/968467697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a780a1380 0x7f8a78127180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.613+0000 7f8a7e56e700 1 -- 172.21.15.156:0/968467697 >> 172.21.15.156:0/968467697 conn(0x7f8a780a6610 msgr2=0x7f8a780a4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:40.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.613+0000 7f8a7e56e700 1 -- 172.21.15.156:0/968467697 shutdown_connections 2023-09-30T22:24:40.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.613+0000 7f8a7e56e700 1 -- 172.21.15.156:0/968467697 wait complete. 2023-09-30T22:24:40.631 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:40.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.777+0000 7fe57c6a6700 1 -- 172.21.15.156:0/1070584457 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe57406c3b0 con 0x7fe5741300a0 2023-09-30T22:24:40.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.777+0000 7fe56affd700 1 -- 172.21.15.156:0/1070584457 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe570017020 con 0x7fe5741300a0 2023-09-30T22:24:40.778 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:40.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.779+0000 7fe57c6a6700 1 -- 172.21.15.156:0/1070584457 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5741300a0 msgr2=0x7fe57411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.779+0000 7fe57c6a6700 1 --2- 172.21.15.156:0/1070584457 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5741300a0 0x7fe57411da40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fe57000ebe0 tx=0x7fe57000eef0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.779+0000 7fe57c6a6700 1 -- 172.21.15.156:0/1070584457 shutdown_connections 2023-09-30T22:24:40.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.779+0000 7fe57c6a6700 1 --2- 172.21.15.156:0/1070584457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe574133ad0 0x7fe57411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.779+0000 7fe57c6a6700 1 --2- 172.21.15.156:0/1070584457 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5741300a0 0x7fe57411da40 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.779+0000 7fe57c6a6700 1 --2- 172.21.15.156:0/1070584457 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5741309f0 0x7fe57411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.779+0000 7fe57c6a6700 1 -- 172.21.15.156:0/1070584457 >> 172.21.15.156:0/1070584457 conn(0x7fe574099c40 msgr2=0x7fe574132050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:40.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.779+0000 7fe57c6a6700 1 -- 172.21.15.156:0/1070584457 shutdown_connections 2023-09-30T22:24:40.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:40.779+0000 7fe57c6a6700 1 -- 172.21.15.156:0/1070584457 wait complete. 2023-09-30T22:24:40.792 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:41.420 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:41.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.547+0000 7f0a46746700 1 Processor -- start 2023-09-30T22:24:41.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.547+0000 7f0a46746700 1 -- start start 2023-09-30T22:24:41.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.547+0000 7f0a46746700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a40133ad0 0x7f0a40133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.547+0000 7f0a46746700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a40130bc0 0x7f0a4013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.547+0000 7f0a46746700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a4006b2d0 con 0x7f0a401300a0 2023-09-30T22:24:41.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.547+0000 7f0a46746700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a40133610 con 0x7f0a40130bc0 2023-09-30T22:24:41.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.547+0000 7f0a46746700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4009a500 con 0x7f0a40133ad0 2023-09-30T22:24:41.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.548+0000 7f0a3f7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f0a401300a0 0x7f0a401304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37784/0 (socket says 172.21.15.156:37784) 2023-09-30T22:24:41.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.548+0000 7f0a3ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a40133ad0 0x7f0a40133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.548+0000 7f0a3f7fe700 1 -- 172.21.15.156:0/2280873982 learned_addr learned my addr 172.21.15.156:0/2280873982 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:41.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.548+0000 7f0a44ce3700 1 --2- 172.21.15.156:0/2280873982 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a40130bc0 0x7f0a4013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.548+0000 7f0a3effd700 1 -- 172.21.15.156:0/2280873982 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3425726691 0 0) 0x7f0a4006b2d0 con 0x7f0a401300a0 2023-09-30T22:24:41.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.548+0000 7f0a3effd700 1 -- 172.21.15.156:0/2280873982 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a280035b0 con 0x7f0a401300a0 2023-09-30T22:24:41.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.548+0000 7f0a44ce3700 1 -- 172.21.15.156:0/2280873982 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a40133ad0 msgr2=0x7f0a40133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:41.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.548+0000 7f0a44ce3700 1 --2- 172.21.15.156:0/2280873982 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a40133ad0 0x7f0a40133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.548+0000 7f0a44ce3700 1 -- 172.21.15.156:0/2280873982 >> v1:172.21.15.156:6789/0 conn(0x7f0a401300a0 legacy=0x7f0a401304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.548+0000 7f0a44ce3700 1 -- 172.21.15.156:0/2280873982 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a401338b0 con 0x7f0a40130bc0 2023-09-30T22:24:41.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.548+0000 7f0a3ffff700 1 --2- 172.21.15.156:0/2280873982 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a40133ad0 0x7f0a40133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:41.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.548+0000 7f0a44ce3700 1 --2- 172.21.15.156:0/2280873982 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a40130bc0 0x7f0a4013b990 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009dc0 tx=0x7f0a3800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aeef372b7a63f5b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:41.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.548+0000 7f0a3effd700 1 -- 172.21.15.156:0/2280873982 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3800e070 con 0x7f0a40130bc0 2023-09-30T22:24:41.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.548+0000 7f0a3effd700 1 -- 172.21.15.156:0/2280873982 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3800bb20 con 0x7f0a40130bc0 2023-09-30T22:24:41.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.548+0000 7f0a3effd700 1 -- 172.21.15.156:0/2280873982 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a38012430 con 0x7f0a40130bc0 2023-09-30T22:24:41.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.549+0000 7f0a46746700 1 -- 172.21.15.156:0/2280873982 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a40130bc0 msgr2=0x7f0a4013b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.549+0000 7f0a46746700 1 --2- 172.21.15.156:0/2280873982 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a40130bc0 0x7f0a4013b990 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009dc0 tx=0x7f0a3800b330 comp rx=0 tx=0).stop 2023-09-30T22:24:41.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.549+0000 7f0a46746700 1 -- 172.21.15.156:0/2280873982 shutdown_connections 2023-09-30T22:24:41.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.549+0000 7f0a46746700 1 --2- 172.21.15.156:0/2280873982 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a40130bc0 0x7f0a4013b990 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.549+0000 7f0a46746700 1 --2- 172.21.15.156:0/2280873982 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a40133ad0 0x7f0a40133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.549+0000 7f0a46746700 1 -- 172.21.15.156:0/2280873982 >> 172.21.15.156:0/2280873982 conn(0x7f0a40099c40 msgr2=0x7f0a400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:41.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.549+0000 7f0a46746700 1 -- 172.21.15.156:0/2280873982 shutdown_connections 2023-09-30T22:24:41.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.549+0000 7f0a46746700 1 -- 172.21.15.156:0/2280873982 wait complete. 2023-09-30T22:24:41.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.550+0000 7f0a46746700 1 Processor -- start 2023-09-30T22:24:41.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.550+0000 7f0a46746700 1 -- start start 2023-09-30T22:24:41.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.550+0000 7f0a46746700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a401300a0 0x7f0a4011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.550+0000 7f0a46746700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a40130bc0 0x7f0a4011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.550+0000 7f0a46746700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a40133ad0 0x7f0a4011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.550+0000 7f0a46746700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4011ee50 con 0x7f0a40133ad0 2023-09-30T22:24:41.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.550+0000 7f0a46746700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4011f9d0 con 0x7f0a40130bc0 2023-09-30T22:24:41.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.550+0000 7f0a46746700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4012f6f0 con 0x7f0a401300a0 2023-09-30T22:24:41.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.550+0000 7f0a3f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a40130bc0 0x7f0a4011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.550+0000 7f0a3ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a401300a0 0x7f0a4011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.550+0000 7f0a44ce3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a40133ad0 0x7f0a4011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.550+0000 7f0a3f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a40130bc0 0x7f0a4011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:37946/0 (socket says 172.21.15.156:37946) 2023-09-30T22:24:41.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.550+0000 7f0a3f7fe700 1 -- 172.21.15.156:0/3267925702 learned_addr learned my addr 172.21.15.156:0/3267925702 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:41.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.551+0000 7f0a3ffff700 1 -- 172.21.15.156:0/3267925702 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a40130bc0 msgr2=0x7f0a4011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.551+0000 7f0a3ffff700 1 --2- 172.21.15.156:0/3267925702 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a40130bc0 0x7f0a4011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.551+0000 7f0a3ffff700 1 -- 172.21.15.156:0/3267925702 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a40133ad0 msgr2=0x7f0a4011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.551+0000 7f0a3ffff700 1 --2- 172.21.15.156:0/3267925702 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a40133ad0 0x7f0a4011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.551+0000 7f0a3ffff700 1 -- 172.21.15.156:0/3267925702 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a300094a0 con 0x7f0a401300a0 2023-09-30T22:24:41.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.551+0000 7f0a44ce3700 1 --2- 172.21.15.156:0/3267925702 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a40133ad0 0x7f0a4011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:41.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.551+0000 7f0a3ffff700 1 --2- 172.21.15.156:0/3267925702 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a401300a0 0x7f0a4011da40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f0a3000e9b0 tx=0x7f0a3000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:41.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.551+0000 7f0a3cff9700 1 -- 172.21.15.156:0/3267925702 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3000ee50 con 0x7f0a401300a0 2023-09-30T22:24:41.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.551+0000 7f0a3cff9700 1 -- 172.21.15.156:0/3267925702 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3000c850 con 0x7f0a401300a0 2023-09-30T22:24:41.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.551+0000 7f0a46746700 1 -- 172.21.15.156:0/3267925702 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a38009a70 con 0x7f0a401300a0 2023-09-30T22:24:41.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.551+0000 7f0a3cff9700 1 -- 172.21.15.156:0/3267925702 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3000cc00 con 0x7f0a401300a0 2023-09-30T22:24:41.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.551+0000 7f0a46746700 1 -- 172.21.15.156:0/3267925702 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a40071ff0 con 0x7f0a401300a0 2023-09-30T22:24:41.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.552+0000 7f0a3cff9700 1 -- 172.21.15.156:0/3267925702 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0a30013470 con 0x7f0a401300a0 2023-09-30T22:24:41.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.552+0000 7f0a3cff9700 1 -- 172.21.15.156:0/3267925702 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0a3003f6e0 con 0x7f0a401300a0 2023-09-30T22:24:41.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.552+0000 7f0a46746700 1 -- 172.21.15.156:0/3267925702 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a400a2620 con 0x7f0a401300a0 2023-09-30T22:24:41.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.557+0000 7f0a3cff9700 1 -- 172.21.15.156:0/3267925702 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0a30013720 con 0x7f0a401300a0 2023-09-30T22:24:41.585 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:41.631 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:41.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.710+0000 7fe745c6f700 1 Processor -- start 2023-09-30T22:24:41.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.710+0000 7fe745c6f700 1 -- start start 2023-09-30T22:24:41.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.711+0000 7fe745c6f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe740133b80 0x7fe740133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.711+0000 7fe745c6f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe7400a0ff0 0x7fe74013b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.711+0000 7fe745c6f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe74009aa00 con 0x7fe740099a60 2023-09-30T22:24:41.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.711+0000 7fe745c6f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe74009a080 con 0x7fe740133b80 2023-09-30T22:24:41.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.711+0000 7fe745c6f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe740133750 con 0x7fe7400a0ff0 2023-09-30T22:24:41.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.711+0000 7fe73ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe7400a0ff0 0x7fe74013b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.711+0000 7fe73effd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe740099a60 0x7fe7400a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37798/0 (socket says 172.21.15.156:37798) 2023-09-30T22:24:41.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.711+0000 7fe73f7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe740133b80 0x7fe740133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.711+0000 7fe73effd700 1 -- 172.21.15.156:0/720871477 learned_addr learned my addr 172.21.15.156:0/720871477 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:41.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.711+0000 7fe73f7fe700 1 -- 172.21.15.156:0/720871477 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe7400a0ff0 msgr2=0x7fe74013b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:41.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.711+0000 7fe73f7fe700 1 --2- 172.21.15.156:0/720871477 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe7400a0ff0 0x7fe74013b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.711+0000 7fe73f7fe700 1 -- 172.21.15.156:0/720871477 >> v1:172.21.15.156:6789/0 conn(0x7fe740099a60 legacy=0x7fe7400a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.711+0000 7fe73e7fc700 1 -- 172.21.15.156:0/720871477 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2199031783 0 0) 0x7fe74009aa00 con 0x7fe740099a60 2023-09-30T22:24:41.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.711+0000 7fe73f7fe700 1 -- 172.21.15.156:0/720871477 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74009a760 con 0x7fe740133b80 2023-09-30T22:24:41.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.711+0000 7fe73ffff700 1 --2- 172.21.15.156:0/720871477 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe7400a0ff0 0x7fe74013b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:41.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.711+0000 7fe73f7fe700 1 --2- 172.21.15.156:0/720871477 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe740133b80 0x7fe740133f50 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fe730009820 tx=0x7fe730009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16da16e434c1e4a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:41.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.712+0000 7fe73e7fc700 1 -- 172.21.15.156:0/720871477 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe730005e30 con 0x7fe740133b80 2023-09-30T22:24:41.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.712+0000 7fe73e7fc700 1 -- 172.21.15.156:0/720871477 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe730006030 con 0x7fe740133b80 2023-09-30T22:24:41.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.712+0000 7fe73e7fc700 1 -- 172.21.15.156:0/720871477 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7300063c0 con 0x7fe740133b80 2023-09-30T22:24:41.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.712+0000 7fe745c6f700 1 -- 172.21.15.156:0/720871477 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe740133b80 msgr2=0x7fe740133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.712+0000 7fe745c6f700 1 --2- 172.21.15.156:0/720871477 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe740133b80 0x7fe740133f50 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fe730009820 tx=0x7fe730009b30 comp rx=0 tx=0).stop 2023-09-30T22:24:41.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.712+0000 7fe745c6f700 1 -- 172.21.15.156:0/720871477 shutdown_connections 2023-09-30T22:24:41.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.712+0000 7fe745c6f700 1 --2- 172.21.15.156:0/720871477 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe740133b80 0x7fe740133f50 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.712+0000 7fe745c6f700 1 --2- 172.21.15.156:0/720871477 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe7400a0ff0 0x7fe74013b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.712+0000 7fe745c6f700 1 -- 172.21.15.156:0/720871477 >> 172.21.15.156:0/720871477 conn(0x7fe7400a2980 msgr2=0x7fe7400a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:41.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.712+0000 7fe745c6f700 1 -- 172.21.15.156:0/720871477 shutdown_connections 2023-09-30T22:24:41.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.712+0000 7fe745c6f700 1 -- 172.21.15.156:0/720871477 wait complete. 2023-09-30T22:24:41.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.713+0000 7fe745c6f700 1 Processor -- start 2023-09-30T22:24:41.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.713+0000 7fe745c6f700 1 -- start start 2023-09-30T22:24:41.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.714+0000 7fe745c6f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe740099a60 0x7fe74011a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.714+0000 7fe745c6f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7400a0ff0 0x7fe74011ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.714+0000 7fe745c6f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe740133b80 0x7fe74011b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.714+0000 7fe745c6f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74011bb80 con 0x7fe7400a0ff0 2023-09-30T22:24:41.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.714+0000 7fe745c6f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74011c2e0 con 0x7fe740133b80 2023-09-30T22:24:41.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.714+0000 7fe745c6f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe74011d530 con 0x7fe740099a60 2023-09-30T22:24:41.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.714+0000 7fe73f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe740099a60 0x7fe74011a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.714+0000 7fe73f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe740099a60 0x7fe74011a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45952/0 (socket says 172.21.15.156:45952) 2023-09-30T22:24:41.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.714+0000 7fe73f7fe700 1 -- 172.21.15.156:0/2804000868 learned_addr learned my addr 172.21.15.156:0/2804000868 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:41.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.714+0000 7fe73ffff700 1 --2- 172.21.15.156:0/2804000868 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe740133b80 0x7fe74011b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.714+0000 7fe73effd700 1 --2- 172.21.15.156:0/2804000868 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7400a0ff0 0x7fe74011ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.714+0000 7fe73f7fe700 1 -- 172.21.15.156:0/2804000868 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe740133b80 msgr2=0x7fe74011b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.714+0000 7fe73f7fe700 1 --2- 172.21.15.156:0/2804000868 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe740133b80 0x7fe74011b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.714+0000 7fe73f7fe700 1 -- 172.21.15.156:0/2804000868 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7400a0ff0 msgr2=0x7fe74011ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.714+0000 7fe73f7fe700 1 --2- 172.21.15.156:0/2804000868 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7400a0ff0 0x7fe74011ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.714+0000 7fe73f7fe700 1 -- 172.21.15.156:0/2804000868 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe738009a70 con 0x7fe740099a60 2023-09-30T22:24:41.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.714+0000 7fe73ffff700 1 --2- 172.21.15.156:0/2804000868 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe740133b80 0x7fe74011b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:41.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.714+0000 7fe73effd700 1 --2- 172.21.15.156:0/2804000868 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7400a0ff0 0x7fe74011ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:41.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.714+0000 7fe73f7fe700 1 --2- 172.21.15.156:0/2804000868 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe740099a60 0x7fe74011a6d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fe74009a1c0 tx=0x7fe730004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:41.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.715+0000 7fe727fff700 1 -- 172.21.15.156:0/2804000868 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7300061a0 con 0x7fe740099a60 2023-09-30T22:24:41.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.715+0000 7fe727fff700 1 -- 172.21.15.156:0/2804000868 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe730020070 con 0x7fe740099a60 2023-09-30T22:24:41.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.715+0000 7fe745c6f700 1 -- 172.21.15.156:0/2804000868 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe730009430 con 0x7fe740099a60 2023-09-30T22:24:41.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.715+0000 7fe727fff700 1 -- 172.21.15.156:0/2804000868 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe730006560 con 0x7fe740099a60 2023-09-30T22:24:41.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.715+0000 7fe745c6f700 1 -- 172.21.15.156:0/2804000868 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74009c0f0 con 0x7fe740099a60 2023-09-30T22:24:41.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.716+0000 7fe745c6f700 1 -- 172.21.15.156:0/2804000868 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe74009e9b0 con 0x7fe740099a60 2023-09-30T22:24:41.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.716+0000 7fe727fff700 1 -- 172.21.15.156:0/2804000868 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe730022030 con 0x7fe740099a60 2023-09-30T22:24:41.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.716+0000 7fe727fff700 1 -- 172.21.15.156:0/2804000868 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe7300410b0 con 0x7fe740099a60 2023-09-30T22:24:41.725 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.724+0000 7fe727fff700 1 -- 172.21.15.156:0/2804000868 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe7300066c0 con 0x7fe740099a60 2023-09-30T22:24:41.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.758+0000 7f0a46746700 1 -- 172.21.15.156:0/3267925702 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0a4004f2a0 con 0x7f0a401300a0 2023-09-30T22:24:41.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.758+0000 7f0a3cff9700 1 -- 172.21.15.156:0/3267925702 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0a30021030 con 0x7f0a401300a0 2023-09-30T22:24:41.759 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:41.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.759+0000 7f0101457700 1 Processor -- start 2023-09-30T22:24:41.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.760+0000 7f0101457700 1 -- start start 2023-09-30T22:24:41.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.760+0000 7f0101457700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00fc09ad40 0x7f00fc133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.760+0000 7f0101457700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f00fc133f70 0x7f00fc1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.760+0000 7f0101457700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f00fc0a0a70 0x7f00fc0a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.760+0000 7f0101457700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00fc0a3b60 con 0x7f00fc0a0a70 2023-09-30T22:24:41.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.760+0000 7f0101457700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc1348e0 con 0x7f00fc09ad40 2023-09-30T22:24:41.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.760+0000 7f0101457700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc09b110 con 0x7f00fc133f70 2023-09-30T22:24:41.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.760+0000 7f00fa7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f00fc133f70 0x7f00fc1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.760+0000 7f00faffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00fc09ad40 0x7f00fc133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.760+0000 7f00fa7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f00fc133f70 0x7f00fc1343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:45962/0 (socket says 172.21.15.156:45962) 2023-09-30T22:24:41.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.760+0000 7f00fb7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f00fc0a0a70 0x7f00fc0a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.760+0000 7f00fa7fc700 1 -- 172.21.15.156:0/1315347850 learned_addr learned my addr 172.21.15.156:0/1315347850 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:41.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.761+0000 7f00fb7fe700 1 -- 172.21.15.156:0/1315347850 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f00fc133f70 msgr2=0x7f00fc1343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:41.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.761+0000 7f00fb7fe700 1 --2- 172.21.15.156:0/1315347850 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f00fc133f70 0x7f00fc1343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.761+0000 7f00fb7fe700 1 -- 172.21.15.156:0/1315347850 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00fc09ad40 msgr2=0x7f00fc133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:41.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.761+0000 7f00fb7fe700 1 --2- 172.21.15.156:0/1315347850 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00fc09ad40 0x7f00fc133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.761+0000 7f00fb7fe700 1 -- 172.21.15.156:0/1315347850 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00fc0a2fa0 con 0x7f00fc0a0a70 2023-09-30T22:24:41.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.761+0000 7f00fa7fc700 1 --2- 172.21.15.156:0/1315347850 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f00fc133f70 0x7f00fc1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:41.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.761+0000 7f00fb7fe700 1 --2- 172.21.15.156:0/1315347850 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00fc0a0a70 0x7f00fc0a0ef0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f00f4009dc0 tx=0x7f00f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1806644a372e07e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:41.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.761+0000 7f00f9ffb700 1 -- 172.21.15.156:0/1315347850 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f400e070 con 0x7f00fc0a0a70 2023-09-30T22:24:41.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.761+0000 7f00f9ffb700 1 -- 172.21.15.156:0/1315347850 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f400bae0 con 0x7f00fc0a0a70 2023-09-30T22:24:41.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.761+0000 7f00f9ffb700 1 -- 172.21.15.156:0/1315347850 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f400be90 con 0x7f00fc0a0a70 2023-09-30T22:24:41.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.761+0000 7f0a46746700 1 -- 172.21.15.156:0/3267925702 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a401300a0 msgr2=0x7f0a4011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.761+0000 7f0a46746700 1 --2- 172.21.15.156:0/3267925702 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a401300a0 0x7f0a4011da40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f0a3000e9b0 tx=0x7f0a3000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.761+0000 7f0a46746700 1 -- 172.21.15.156:0/3267925702 shutdown_connections 2023-09-30T22:24:41.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.761+0000 7f0a46746700 1 --2- 172.21.15.156:0/3267925702 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a40133ad0 0x7f0a4011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.761+0000 7f0a46746700 1 --2- 172.21.15.156:0/3267925702 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a401300a0 0x7f0a4011da40 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.761+0000 7f0a46746700 1 --2- 172.21.15.156:0/3267925702 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a40130bc0 0x7f0a4011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.761+0000 7f0a46746700 1 -- 172.21.15.156:0/3267925702 >> 172.21.15.156:0/3267925702 conn(0x7f0a40099c40 msgr2=0x7f0a40132b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:41.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.761+0000 7f0a46746700 1 -- 172.21.15.156:0/3267925702 shutdown_connections 2023-09-30T22:24:41.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.761+0000 7f0a46746700 1 -- 172.21.15.156:0/3267925702 wait complete. 2023-09-30T22:24:41.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.762+0000 7f0101457700 1 -- 172.21.15.156:0/1315347850 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00fc0a0a70 msgr2=0x7f00fc0a0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.762+0000 7f0101457700 1 --2- 172.21.15.156:0/1315347850 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00fc0a0a70 0x7f00fc0a0ef0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f00f4009dc0 tx=0x7f00f400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:41.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.762+0000 7f0101457700 1 -- 172.21.15.156:0/1315347850 shutdown_connections 2023-09-30T22:24:41.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.762+0000 7f0101457700 1 --2- 172.21.15.156:0/1315347850 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00fc0a0a70 0x7f00fc0a0ef0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.762+0000 7f0101457700 1 --2- 172.21.15.156:0/1315347850 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00fc09ad40 0x7f00fc133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.762+0000 7f0101457700 1 --2- 172.21.15.156:0/1315347850 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f00fc133f70 0x7f00fc1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.762+0000 7f0101457700 1 -- 172.21.15.156:0/1315347850 >> 172.21.15.156:0/1315347850 conn(0x7f00fc099c40 msgr2=0x7f00fc06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:41.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.762+0000 7f0101457700 1 -- 172.21.15.156:0/1315347850 shutdown_connections 2023-09-30T22:24:41.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.762+0000 7f0101457700 1 -- 172.21.15.156:0/1315347850 wait complete. 2023-09-30T22:24:41.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.763+0000 7f0101457700 1 Processor -- start 2023-09-30T22:24:41.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.763+0000 7f0101457700 1 -- start start 2023-09-30T22:24:41.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.763+0000 7f0101457700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00fc09ad40 0x7f00fc11e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.763+0000 7f0101457700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f00fc0a0a70 0x7f00fc11e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.763+0000 7f0101457700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00fc133f70 0x7f00fc11ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.763+0000 7f0101457700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc122680 con 0x7f00fc09ad40 2023-09-30T22:24:41.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.763+0000 7f0101457700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc1219e0 con 0x7f00fc133f70 2023-09-30T22:24:41.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.763+0000 7f0101457700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc11fec0 con 0x7f00fc0a0a70 2023-09-30T22:24:41.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.764+0000 7f00faffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00fc09ad40 0x7f00fc11e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.764+0000 7f00faffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00fc09ad40 0x7f00fc11e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51848/0 (socket says 172.21.15.156:51848) 2023-09-30T22:24:41.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.764+0000 7f00faffd700 1 -- 172.21.15.156:0/1183619304 learned_addr learned my addr 172.21.15.156:0/1183619304 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:41.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.764+0000 7f00fb7fe700 1 --2- 172.21.15.156:0/1183619304 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00fc133f70 0x7f00fc11ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.764+0000 7f00fa7fc700 1 --2- 172.21.15.156:0/1183619304 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f00fc0a0a70 0x7f00fc11e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.764+0000 7f00faffd700 1 -- 172.21.15.156:0/1183619304 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f00fc0a0a70 msgr2=0x7f00fc11e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.764+0000 7f00faffd700 1 --2- 172.21.15.156:0/1183619304 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f00fc0a0a70 0x7f00fc11e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.764+0000 7f00faffd700 1 -- 172.21.15.156:0/1183619304 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00fc133f70 msgr2=0x7f00fc11ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.764+0000 7f00faffd700 1 --2- 172.21.15.156:0/1183619304 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00fc133f70 0x7f00fc11ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.764+0000 7f00faffd700 1 -- 172.21.15.156:0/1183619304 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f0009550 con 0x7f00fc09ad40 2023-09-30T22:24:41.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.764+0000 7f00fa7fc700 1 --2- 172.21.15.156:0/1183619304 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f00fc0a0a70 0x7f00fc11e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:41.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.764+0000 7f00fb7fe700 1 --2- 172.21.15.156:0/1183619304 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00fc133f70 0x7f00fc11ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:41.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.764+0000 7f00faffd700 1 --2- 172.21.15.156:0/1183619304 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00fc09ad40 0x7f00fc11e1a0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f00ec00e8a0 tx=0x7f00ec00ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:41.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.764+0000 7f00e37fe700 1 -- 172.21.15.156:0/1183619304 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec013680 con 0x7f00fc09ad40 2023-09-30T22:24:41.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.764+0000 7f00e37fe700 1 -- 172.21.15.156:0/1183619304 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ec0137e0 con 0x7f00fc09ad40 2023-09-30T22:24:41.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.764+0000 7f0101457700 1 -- 172.21.15.156:0/1183619304 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f4009a70 con 0x7f00fc09ad40 2023-09-30T22:24:41.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.764+0000 7f00e37fe700 1 -- 172.21.15.156:0/1183619304 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec013b90 con 0x7f00fc09ad40 2023-09-30T22:24:41.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.764+0000 7f0101457700 1 -- 172.21.15.156:0/1183619304 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00fc121720 con 0x7f00fc09ad40 2023-09-30T22:24:41.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.765+0000 7f00e37fe700 1 -- 172.21.15.156:0/1183619304 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f00ec013cf0 con 0x7f00fc09ad40 2023-09-30T22:24:41.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.766+0000 7f00e37fe700 1 -- 172.21.15.156:0/1183619304 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f00ec03f4e0 con 0x7f00fc09ad40 2023-09-30T22:24:41.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.766+0000 7f0101457700 1 -- 172.21.15.156:0/1183619304 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00fc04f2a0 con 0x7f00fc09ad40 2023-09-30T22:24:41.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.770+0000 7f00e37fe700 1 -- 172.21.15.156:0/1183619304 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f00ec017020 con 0x7f00fc09ad40 2023-09-30T22:24:41.780 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:41.792 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:41.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.918+0000 7f4e5910a700 1 Processor -- start 2023-09-30T22:24:41.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.918+0000 7f4e5910a700 1 -- start start 2023-09-30T22:24:41.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.919+0000 7f4e5910a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e54133ad0 0x7f4e54133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.919+0000 7f4e5910a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e541300a0 0x7f4e541304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.919+0000 7f4e5910a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e5406b2d0 con 0x7f4e541309f0 2023-09-30T22:24:41.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.919+0000 7f4e5910a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e54133610 con 0x7f4e541300a0 2023-09-30T22:24:41.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.919+0000 7f4e5910a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5409a500 con 0x7f4e54133ad0 2023-09-30T22:24:41.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.919+0000 7f4e5359e700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4e541309f0 0x7f4e5413a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37814/0 (socket says 172.21.15.156:37814) 2023-09-30T22:24:41.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.919+0000 7f4e5259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e541300a0 0x7f4e541304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.919+0000 7f4e5359e700 1 -- 172.21.15.156:0/1004209969 learned_addr learned my addr 172.21.15.156:0/1004209969 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:41.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.919+0000 7f4e52d9d700 1 --2- 172.21.15.156:0/1004209969 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e54133ad0 0x7f4e54133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.919+0000 7f4e51d9b700 1 -- 172.21.15.156:0/1004209969 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2278522500 0 0) 0x7f4e5406b2d0 con 0x7f4e541309f0 2023-09-30T22:24:41.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.919+0000 7f4e52d9d700 1 -- 172.21.15.156:0/1004209969 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e541300a0 msgr2=0x7f4e541304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:41.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.919+0000 7f4e52d9d700 1 --2- 172.21.15.156:0/1004209969 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e541300a0 0x7f4e541304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.919+0000 7f4e52d9d700 1 -- 172.21.15.156:0/1004209969 >> v1:172.21.15.156:6789/0 conn(0x7f4e541309f0 legacy=0x7f4e5413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.919+0000 7f4e52d9d700 1 -- 172.21.15.156:0/1004209969 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e541338b0 con 0x7f4e54133ad0 2023-09-30T22:24:41.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.919+0000 7f4e5259c700 1 --2- 172.21.15.156:0/1004209969 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e541300a0 0x7f4e541304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:41.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.919+0000 7f4e52d9d700 1 --2- 172.21.15.156:0/1004209969 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e54133ad0 0x7f4e54133ea0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009870 tx=0x7f4e44009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78ed5f2cec534e4b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:41.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.920+0000 7f4e51d9b700 1 -- 172.21.15.156:0/1004209969 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e44011830 con 0x7f4e54133ad0 2023-09-30T22:24:41.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.920+0000 7f4e51d9b700 1 -- 172.21.15.156:0/1004209969 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e44011990 con 0x7f4e54133ad0 2023-09-30T22:24:41.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.920+0000 7f4e51d9b700 1 -- 172.21.15.156:0/1004209969 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e44011d20 con 0x7f4e54133ad0 2023-09-30T22:24:41.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.920+0000 7f4e5910a700 1 -- 172.21.15.156:0/1004209969 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e54133ad0 msgr2=0x7f4e54133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.920+0000 7f4e5910a700 1 --2- 172.21.15.156:0/1004209969 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e54133ad0 0x7f4e54133ea0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009870 tx=0x7f4e44009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:41.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.920+0000 7f4e5910a700 1 -- 172.21.15.156:0/1004209969 shutdown_connections 2023-09-30T22:24:41.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.920+0000 7f4e5910a700 1 --2- 172.21.15.156:0/1004209969 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e54133ad0 0x7f4e54133ea0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.920+0000 7f4e5910a700 1 --2- 172.21.15.156:0/1004209969 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e541300a0 0x7f4e541304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.920+0000 7f4e5910a700 1 -- 172.21.15.156:0/1004209969 >> 172.21.15.156:0/1004209969 conn(0x7f4e54099c40 msgr2=0x7f4e540a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:41.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.920+0000 7f4e5910a700 1 -- 172.21.15.156:0/1004209969 shutdown_connections 2023-09-30T22:24:41.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.920+0000 7f4e5910a700 1 -- 172.21.15.156:0/1004209969 wait complete. 2023-09-30T22:24:41.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.921+0000 7f4e5910a700 1 Processor -- start 2023-09-30T22:24:41.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.921+0000 7f4e5910a700 1 -- start start 2023-09-30T22:24:41.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.922+0000 7f4e5910a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e541300a0 0x7f4e5411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.922+0000 7f4e5910a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e541309f0 0x7f4e5411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.922+0000 7f4e5910a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e54133ad0 0x7f4e5411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.922+0000 7f4e5910a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e54072120 con 0x7f4e541300a0 2023-09-30T22:24:41.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.922+0000 7f4e5910a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e541209c0 con 0x7f4e541309f0 2023-09-30T22:24:41.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.922+0000 7f4e5910a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5411fe00 con 0x7f4e54133ad0 2023-09-30T22:24:41.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.922+0000 7f4e52d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e541300a0 0x7f4e5411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.922+0000 7f4e52d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e541300a0 0x7f4e5411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51854/0 (socket says 172.21.15.156:51854) 2023-09-30T22:24:41.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.922+0000 7f4e52d9d700 1 -- 172.21.15.156:0/858312111 learned_addr learned my addr 172.21.15.156:0/858312111 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:41.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.922+0000 7f4e5259c700 1 --2- 172.21.15.156:0/858312111 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e541309f0 0x7f4e5411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.922+0000 7f4e5359e700 1 --2- 172.21.15.156:0/858312111 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e54133ad0 0x7f4e5411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.922+0000 7f4e5359e700 1 -- 172.21.15.156:0/858312111 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e541309f0 msgr2=0x7f4e5411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.922+0000 7f4e5359e700 1 --2- 172.21.15.156:0/858312111 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e541309f0 0x7f4e5411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.922+0000 7f4e5359e700 1 -- 172.21.15.156:0/858312111 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e541300a0 msgr2=0x7f4e5411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.922+0000 7f4e5359e700 1 --2- 172.21.15.156:0/858312111 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e541300a0 0x7f4e5411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.922+0000 7f4e5359e700 1 -- 172.21.15.156:0/858312111 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e480094a0 con 0x7f4e54133ad0 2023-09-30T22:24:41.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.922+0000 7f4e52d9d700 1 --2- 172.21.15.156:0/858312111 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e541300a0 0x7f4e5411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:41.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.922+0000 7f4e5359e700 1 --2- 172.21.15.156:0/858312111 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e54133ad0 0x7f4e5411e4c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c00cc10 tx=0x7f4e4c00cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:41.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.923+0000 7f4e3b7fe700 1 -- 172.21.15.156:0/858312111 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c00aa00 con 0x7f4e54133ad0 2023-09-30T22:24:41.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.923+0000 7f4e3b7fe700 1 -- 172.21.15.156:0/858312111 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4c00ab80 con 0x7f4e54133ad0 2023-09-30T22:24:41.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.923+0000 7f4e5910a700 1 -- 172.21.15.156:0/858312111 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e440094a0 con 0x7f4e54133ad0 2023-09-30T22:24:41.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.923+0000 7f4e3b7fe700 1 -- 172.21.15.156:0/858312111 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c0070d0 con 0x7f4e54133ad0 2023-09-30T22:24:41.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.923+0000 7f4e5910a700 1 -- 172.21.15.156:0/858312111 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e5412f7c0 con 0x7f4e54133ad0 2023-09-30T22:24:41.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.924+0000 7f4e3b7fe700 1 -- 172.21.15.156:0/858312111 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4e4c007230 con 0x7f4e54133ad0 2023-09-30T22:24:41.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.924+0000 7f4e3b7fe700 1 -- 172.21.15.156:0/858312111 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4e4c03f070 con 0x7f4e54133ad0 2023-09-30T22:24:41.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.924+0000 7f4e5910a700 1 -- 172.21.15.156:0/858312111 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5412dd60 con 0x7f4e54133ad0 2023-09-30T22:24:41.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.928+0000 7f4e3b7fe700 1 -- 172.21.15.156:0/858312111 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e4c018020 con 0x7f4e54133ad0 2023-09-30T22:24:41.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.934+0000 7fe745c6f700 1 -- 172.21.15.156:0/2804000868 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe74009a2c0 con 0x7fe740099a60 2023-09-30T22:24:41.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.934+0000 7fe727fff700 1 -- 172.21.15.156:0/2804000868 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe73001b410 con 0x7fe740099a60 2023-09-30T22:24:41.935 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:41.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.936+0000 7fe745c6f700 1 -- 172.21.15.156:0/2804000868 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe740099a60 msgr2=0x7fe74011a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.936+0000 7fe745c6f700 1 --2- 172.21.15.156:0/2804000868 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe740099a60 0x7fe74011a6d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fe74009a1c0 tx=0x7fe730004750 comp rx=0 tx=0).stop 2023-09-30T22:24:41.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.936+0000 7fe745c6f700 1 -- 172.21.15.156:0/2804000868 shutdown_connections 2023-09-30T22:24:41.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.936+0000 7fe745c6f700 1 --2- 172.21.15.156:0/2804000868 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe740133b80 0x7fe74011b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.936+0000 7fe745c6f700 1 --2- 172.21.15.156:0/2804000868 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe740099a60 0x7fe74011a6d0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.936+0000 7fe745c6f700 1 --2- 172.21.15.156:0/2804000868 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7400a0ff0 0x7fe74011ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.936+0000 7fe745c6f700 1 -- 172.21.15.156:0/2804000868 >> 172.21.15.156:0/2804000868 conn(0x7fe7400a2980 msgr2=0x7fe74012f690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:41.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.936+0000 7fe745c6f700 1 -- 172.21.15.156:0/2804000868 shutdown_connections 2023-09-30T22:24:41.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.936+0000 7fe745c6f700 1 -- 172.21.15.156:0/2804000868 wait complete. 2023-09-30T22:24:41.949 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:41.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.970+0000 7f0101457700 1 -- 172.21.15.156:0/1183619304 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f00fc121b20 con 0x7f00fc09ad40 2023-09-30T22:24:41.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.970+0000 7f00e37fe700 1 -- 172.21.15.156:0/1183619304 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f00fc121b20 con 0x7f00fc09ad40 2023-09-30T22:24:41.971 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:41.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.972+0000 7f0101457700 1 -- 172.21.15.156:0/1183619304 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00fc09ad40 msgr2=0x7f00fc11e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.972+0000 7f0101457700 1 --2- 172.21.15.156:0/1183619304 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00fc09ad40 0x7f00fc11e1a0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f00ec00e8a0 tx=0x7f00ec00ebb0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.972+0000 7f0101457700 1 -- 172.21.15.156:0/1183619304 shutdown_connections 2023-09-30T22:24:41.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.972+0000 7f0101457700 1 --2- 172.21.15.156:0/1183619304 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00fc133f70 0x7f00fc11ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.972+0000 7f0101457700 1 --2- 172.21.15.156:0/1183619304 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00fc09ad40 0x7f00fc11e1a0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.972+0000 7f0101457700 1 --2- 172.21.15.156:0/1183619304 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f00fc0a0a70 0x7f00fc11e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.972+0000 7f0101457700 1 -- 172.21.15.156:0/1183619304 >> 172.21.15.156:0/1183619304 conn(0x7f00fc099c40 msgr2=0x7f00fc09e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:41.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.973+0000 7f0101457700 1 -- 172.21.15.156:0/1183619304 shutdown_connections 2023-09-30T22:24:41.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:41.973+0000 7f0101457700 1 -- 172.21.15.156:0/1183619304 wait complete. 2023-09-30T22:24:41.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:42.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.117+0000 7f4e5910a700 1 -- 172.21.15.156:0/858312111 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4e5411ff40 con 0x7f4e54133ad0 2023-09-30T22:24:42.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.118+0000 7f4e3b7fe700 1 -- 172.21.15.156:0/858312111 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e4c0074e0 con 0x7f4e54133ad0 2023-09-30T22:24:42.119 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:42.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.120+0000 7f4e5910a700 1 -- 172.21.15.156:0/858312111 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e54133ad0 msgr2=0x7f4e5411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:42.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.120+0000 7f4e5910a700 1 --2- 172.21.15.156:0/858312111 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e54133ad0 0x7f4e5411e4c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c00cc10 tx=0x7f4e4c00cf20 comp rx=0 tx=0).stop 2023-09-30T22:24:42.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.120+0000 7f4e5910a700 1 -- 172.21.15.156:0/858312111 shutdown_connections 2023-09-30T22:24:42.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.120+0000 7f4e5910a700 1 --2- 172.21.15.156:0/858312111 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4e54133ad0 0x7f4e5411e4c0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.120+0000 7f4e5910a700 1 --2- 172.21.15.156:0/858312111 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e541300a0 0x7f4e5411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.120+0000 7f4e5910a700 1 --2- 172.21.15.156:0/858312111 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4e541309f0 0x7f4e5411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.120+0000 7f4e5910a700 1 -- 172.21.15.156:0/858312111 >> 172.21.15.156:0/858312111 conn(0x7f4e54099c40 msgr2=0x7f4e54132050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:42.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.120+0000 7f4e5910a700 1 -- 172.21.15.156:0/858312111 shutdown_connections 2023-09-30T22:24:42.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.120+0000 7f4e5910a700 1 -- 172.21.15.156:0/858312111 wait complete. 2023-09-30T22:24:42.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:42.781 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:42.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.913+0000 7ff541055700 1 Processor -- start 2023-09-30T22:24:42.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.913+0000 7ff541055700 1 -- start start 2023-09-30T22:24:42.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.913+0000 7ff541055700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff53c133ad0 0x7ff53c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:42.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.913+0000 7ff541055700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff53c1300a0 0x7ff53c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:42.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.913+0000 7ff541055700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff53c1309f0 0x7ff53c13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:42.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.913+0000 7ff541055700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff53c06b2d0 con 0x7ff53c1309f0 2023-09-30T22:24:42.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.913+0000 7ff541055700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c133610 con 0x7ff53c1300a0 2023-09-30T22:24:42.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.913+0000 7ff541055700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c09a500 con 0x7ff53c133ad0 2023-09-30T22:24:42.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.913+0000 7ff53a59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff53c1300a0 0x7ff53c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:42.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.913+0000 7ff53ad9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff53c133ad0 0x7ff53c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:42.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.913+0000 7ff53b59e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff53c1309f0 0x7ff53c13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:42.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.913+0000 7ff53ad9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff53c133ad0 0x7ff53c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46008/0 (socket says 172.21.15.156:46008) 2023-09-30T22:24:42.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.913+0000 7ff53a59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff53c1300a0 0x7ff53c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38020/0 (socket says 172.21.15.156:38020) 2023-09-30T22:24:42.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.913+0000 7ff53ad9d700 1 -- 172.21.15.156:0/3831965424 learned_addr learned my addr 172.21.15.156:0/3831965424 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:42.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.913+0000 7ff53b59e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff53c1309f0 0x7ff53c13a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51856/0 (socket says 172.21.15.156:51856) 2023-09-30T22:24:42.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.914+0000 7ff53a59c700 1 -- 172.21.15.156:0/3831965424 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff53c133ad0 msgr2=0x7ff53c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:42.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.914+0000 7ff53a59c700 1 --2- 172.21.15.156:0/3831965424 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff53c133ad0 0x7ff53c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.914+0000 7ff53a59c700 1 -- 172.21.15.156:0/3831965424 >> v2:172.21.15.156:3300/0 conn(0x7ff53c1309f0 msgr2=0x7ff53c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:42.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.914+0000 7ff53a59c700 1 --2- 172.21.15.156:0/3831965424 >> v2:172.21.15.156:3300/0 conn(0x7ff53c1309f0 0x7ff53c13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.914+0000 7ff53a59c700 1 -- 172.21.15.156:0/3831965424 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c1338b0 con 0x7ff53c1300a0 2023-09-30T22:24:42.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.914+0000 7ff53ad9d700 1 --2- 172.21.15.156:0/3831965424 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff53c133ad0 0x7ff53c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:42.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.914+0000 7ff53b59e700 1 --2- 172.21.15.156:0/3831965424 >> v2:172.21.15.156:3300/0 conn(0x7ff53c1309f0 0x7ff53c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:42.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.914+0000 7ff53a59c700 1 --2- 172.21.15.156:0/3831965424 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff53c1300a0 0x7ff53c1304b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff530009840 tx=0x7ff530009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c950c43c85c70dfa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:42.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.914+0000 7ff539d9b700 1 -- 172.21.15.156:0/3831965424 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff530011830 con 0x7ff53c1300a0 2023-09-30T22:24:42.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.914+0000 7ff539d9b700 1 -- 172.21.15.156:0/3831965424 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff530011990 con 0x7ff53c1300a0 2023-09-30T22:24:42.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.914+0000 7ff539d9b700 1 -- 172.21.15.156:0/3831965424 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff530011d20 con 0x7ff53c1300a0 2023-09-30T22:24:42.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.914+0000 7ff541055700 1 -- 172.21.15.156:0/3831965424 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff53c1300a0 msgr2=0x7ff53c1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:42.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.914+0000 7ff541055700 1 --2- 172.21.15.156:0/3831965424 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff53c1300a0 0x7ff53c1304b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff530009840 tx=0x7ff530009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:42.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.915+0000 7ff541055700 1 -- 172.21.15.156:0/3831965424 shutdown_connections 2023-09-30T22:24:42.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.915+0000 7ff541055700 1 --2- 172.21.15.156:0/3831965424 >> v2:172.21.15.156:3300/0 conn(0x7ff53c1309f0 0x7ff53c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.915+0000 7ff541055700 1 --2- 172.21.15.156:0/3831965424 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff53c133ad0 0x7ff53c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.915+0000 7ff541055700 1 --2- 172.21.15.156:0/3831965424 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff53c1300a0 0x7ff53c1304b0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.915+0000 7ff541055700 1 -- 172.21.15.156:0/3831965424 >> 172.21.15.156:0/3831965424 conn(0x7ff53c099c40 msgr2=0x7ff53c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:42.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.915+0000 7ff541055700 1 -- 172.21.15.156:0/3831965424 shutdown_connections 2023-09-30T22:24:42.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.915+0000 7ff541055700 1 -- 172.21.15.156:0/3831965424 wait complete. 2023-09-30T22:24:42.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.916+0000 7ff541055700 1 Processor -- start 2023-09-30T22:24:42.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.916+0000 7ff541055700 1 -- start start 2023-09-30T22:24:42.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.916+0000 7ff541055700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff53c1300a0 0x7ff53c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:42.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.916+0000 7ff541055700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff53c1309f0 0x7ff53c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:42.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.916+0000 7ff541055700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff53c133ad0 0x7ff53c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:42.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.916+0000 7ff541055700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c120b10 con 0x7ff53c1300a0 2023-09-30T22:24:42.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.916+0000 7ff541055700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0a2ea0 con 0x7ff53c133ad0 2023-09-30T22:24:42.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.916+0000 7ff541055700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c12dd00 con 0x7ff53c1309f0 2023-09-30T22:24:42.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.916+0000 7ff53ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff53c1300a0 0x7ff53c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:42.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.916+0000 7ff53a59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff53c1309f0 0x7ff53c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:42.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.916+0000 7ff53b59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff53c133ad0 0x7ff53c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:42.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.916+0000 7ff53ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff53c1300a0 0x7ff53c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51868/0 (socket says 172.21.15.156:51868) 2023-09-30T22:24:42.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.916+0000 7ff53ad9d700 1 -- 172.21.15.156:0/3237690835 learned_addr learned my addr 172.21.15.156:0/3237690835 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:42.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.917+0000 7ff53a59c700 1 -- 172.21.15.156:0/3237690835 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff53c133ad0 msgr2=0x7ff53c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:42.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.917+0000 7ff53a59c700 1 --2- 172.21.15.156:0/3237690835 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff53c133ad0 0x7ff53c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.917+0000 7ff53a59c700 1 -- 172.21.15.156:0/3237690835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff53c1300a0 msgr2=0x7ff53c11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:42.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.917+0000 7ff53a59c700 1 --2- 172.21.15.156:0/3237690835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff53c1300a0 0x7ff53c11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.917+0000 7ff53a59c700 1 -- 172.21.15.156:0/3237690835 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff534009a70 con 0x7ff53c1309f0 2023-09-30T22:24:42.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.917+0000 7ff53b59e700 1 --2- 172.21.15.156:0/3237690835 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff53c133ad0 0x7ff53c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:42.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.917+0000 7ff53ad9d700 1 --2- 172.21.15.156:0/3237690835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff53c1300a0 0x7ff53c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:42.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.917+0000 7ff53a59c700 1 --2- 172.21.15.156:0/3237690835 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff53c1309f0 0x7ff53c11df80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ff530016000 tx=0x7ff530004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:42.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.917+0000 7ff5237fe700 1 -- 172.21.15.156:0/3237690835 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff530004450 con 0x7ff53c1309f0 2023-09-30T22:24:42.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.917+0000 7ff5237fe700 1 -- 172.21.15.156:0/3237690835 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53001e070 con 0x7ff53c1309f0 2023-09-30T22:24:42.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.917+0000 7ff541055700 1 -- 172.21.15.156:0/3237690835 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff52c009550 con 0x7ff53c1309f0 2023-09-30T22:24:42.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.917+0000 7ff5237fe700 1 -- 172.21.15.156:0/3237690835 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5300038e0 con 0x7ff53c1309f0 2023-09-30T22:24:42.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.917+0000 7ff541055700 1 -- 172.21.15.156:0/3237690835 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5300094a0 con 0x7ff53c1309f0 2023-09-30T22:24:42.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.918+0000 7ff5237fe700 1 -- 172.21.15.156:0/3237690835 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff530003a40 con 0x7ff53c1309f0 2023-09-30T22:24:42.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.918+0000 7ff5237fe700 1 -- 172.21.15.156:0/3237690835 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff530040260 con 0x7ff53c1309f0 2023-09-30T22:24:42.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.918+0000 7ff541055700 1 -- 172.21.15.156:0/3237690835 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff53c04f2a0 con 0x7ff53c1309f0 2023-09-30T22:24:42.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:42.923+0000 7ff5237fe700 1 -- 172.21.15.156:0/3237690835 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff530003cf0 con 0x7ff53c1309f0 2023-09-30T22:24:42.949 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:42.987 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:43.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.077+0000 7f9f80533700 1 Processor -- start 2023-09-30T22:24:43.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.077+0000 7f9f80533700 1 -- start start 2023-09-30T22:24:43.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.078+0000 7f9f80533700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f780a0a70 0x7f9f780a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:43.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.078+0000 7f9f80533700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9f78134120 0x7f9f7813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:43.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.078+0000 7f9f80533700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f7809dc00 con 0x7f9f780a1380 2023-09-30T22:24:43.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.078+0000 7f9f80533700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f7809ea60 con 0x7f9f78134120 2023-09-30T22:24:43.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.078+0000 7f9f80533700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7809dec0 con 0x7f9f780a0a70 2023-09-30T22:24:43.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.078+0000 7f9f7ead0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9f78134120 0x7f9f7813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:43.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.078+0000 7f9f7e2cf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f780a0a70 0x7f9f780a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:43.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.078+0000 7f9f7ead0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9f78134120 0x7f9f7813bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51880/0 (socket says 172.21.15.156:51880) 2023-09-30T22:24:43.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.078+0000 7f9f7ead0700 1 -- 172.21.15.156:0/1360833200 learned_addr learned my addr 172.21.15.156:0/1360833200 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:43.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.078+0000 7f9f7dace700 1 --1- 172.21.15.156:0/1360833200 >> v1:172.21.15.156:6789/0 conn(0x7f9f780a1380 0x7f9f78133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37828/0 (socket says 172.21.15.156:37828) 2023-09-30T22:24:43.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.078+0000 7f9f7ead0700 1 -- 172.21.15.156:0/1360833200 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f780a0a70 msgr2=0x7f9f780a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:43.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.078+0000 7f9f7ead0700 1 --2- 172.21.15.156:0/1360833200 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f780a0a70 0x7f9f780a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.078+0000 7f9f7ead0700 1 -- 172.21.15.156:0/1360833200 >> v1:172.21.15.156:6789/0 conn(0x7f9f780a1380 legacy=0x7f9f78133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:43.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.078+0000 7f9f7ead0700 1 -- 172.21.15.156:0/1360833200 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7809e6a0 con 0x7f9f78134120 2023-09-30T22:24:43.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.078+0000 7f9f7d2cd700 1 -- 172.21.15.156:0/1360833200 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4113860524 0 0) 0x7f9f7809dc00 con 0x7f9f780a1380 2023-09-30T22:24:43.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.078+0000 7f9f7ead0700 1 --2- 172.21.15.156:0/1360833200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f78134120 0x7f9f7813bce0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f9f70009e50 tx=0x7f9f7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d9da8913cd79bc7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:43.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.079+0000 7f9f7d2cd700 1 -- 172.21.15.156:0/1360833200 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7000e070 con 0x7f9f78134120 2023-09-30T22:24:43.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.079+0000 7f9f7d2cd700 1 -- 172.21.15.156:0/1360833200 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7000b910 con 0x7f9f78134120 2023-09-30T22:24:43.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.079+0000 7f9f7d2cd700 1 -- 172.21.15.156:0/1360833200 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7000bcc0 con 0x7f9f78134120 2023-09-30T22:24:43.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.079+0000 7f9f80533700 1 -- 172.21.15.156:0/1360833200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f78134120 msgr2=0x7f9f7813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:43.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.079+0000 7f9f80533700 1 --2- 172.21.15.156:0/1360833200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f78134120 0x7f9f7813bce0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f9f70009e50 tx=0x7f9f7000b330 comp rx=0 tx=0).stop 2023-09-30T22:24:43.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.079+0000 7f9f80533700 1 -- 172.21.15.156:0/1360833200 shutdown_connections 2023-09-30T22:24:43.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.079+0000 7f9f80533700 1 --2- 172.21.15.156:0/1360833200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f78134120 0x7f9f7813bce0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.079+0000 7f9f80533700 1 --2- 172.21.15.156:0/1360833200 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f780a0a70 0x7f9f780a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.079+0000 7f9f80533700 1 -- 172.21.15.156:0/1360833200 >> 172.21.15.156:0/1360833200 conn(0x7f9f780a6610 msgr2=0x7f9f780a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:43.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.079+0000 7f9f80533700 1 -- 172.21.15.156:0/1360833200 shutdown_connections 2023-09-30T22:24:43.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.079+0000 7f9f80533700 1 -- 172.21.15.156:0/1360833200 wait complete. 2023-09-30T22:24:43.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.080+0000 7f9f80533700 1 Processor -- start 2023-09-30T22:24:43.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.080+0000 7f9f80533700 1 -- start start 2023-09-30T22:24:43.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.081+0000 7f9f80533700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f780a0a70 0x7f9f78122710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:43.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.081+0000 7f9f80533700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f780a1380 0x7f9f78122c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:43.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.081+0000 7f9f80533700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f78134120 0x7f9f78123190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:43.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.081+0000 7f9f80533700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f78125ab0 con 0x7f9f780a1380 2023-09-30T22:24:43.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.081+0000 7f9f80533700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f781332b0 con 0x7f9f780a0a70 2023-09-30T22:24:43.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.081+0000 7f9f80533700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f78123b70 con 0x7f9f78134120 2023-09-30T22:24:43.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.081+0000 7f9f7ead0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f78134120 0x7f9f78123190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:43.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.081+0000 7f9f7e2cf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f780a0a70 0x7f9f78122710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:43.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.081+0000 7f9f7ead0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f78134120 0x7f9f78123190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46042/0 (socket says 172.21.15.156:46042) 2023-09-30T22:24:43.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.081+0000 7f9f7ead0700 1 -- 172.21.15.156:0/2733493552 learned_addr learned my addr 172.21.15.156:0/2733493552 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:43.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.081+0000 7f9f7dace700 1 --2- 172.21.15.156:0/2733493552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f780a1380 0x7f9f78122c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:43.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.081+0000 7f9f7ead0700 1 -- 172.21.15.156:0/2733493552 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f780a0a70 msgr2=0x7f9f78122710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:43.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.081+0000 7f9f7ead0700 1 --2- 172.21.15.156:0/2733493552 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f780a0a70 0x7f9f78122710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.081+0000 7f9f7ead0700 1 -- 172.21.15.156:0/2733493552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f780a1380 msgr2=0x7f9f78122c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:43.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.081+0000 7f9f7ead0700 1 --2- 172.21.15.156:0/2733493552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f780a1380 0x7f9f78122c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.081+0000 7f9f7ead0700 1 -- 172.21.15.156:0/2733493552 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f70009b30 con 0x7f9f78134120 2023-09-30T22:24:43.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.081+0000 7f9f7ead0700 1 --2- 172.21.15.156:0/2733493552 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f78134120 0x7f9f78123190 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f9f7000b680 tx=0x7f9f70004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:43.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.081+0000 7f9f6effd700 1 -- 172.21.15.156:0/2733493552 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f700048b0 con 0x7f9f78134120 2023-09-30T22:24:43.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.081+0000 7f9f6effd700 1 -- 172.21.15.156:0/2733493552 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f700099b0 con 0x7f9f78134120 2023-09-30T22:24:43.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.081+0000 7f9f6effd700 1 -- 172.21.15.156:0/2733493552 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7001c680 con 0x7f9f78134120 2023-09-30T22:24:43.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.081+0000 7f9f80533700 1 -- 172.21.15.156:0/2733493552 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f781336c0 con 0x7f9f78134120 2023-09-30T22:24:43.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.082+0000 7f9f80533700 1 -- 172.21.15.156:0/2733493552 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f781339a0 con 0x7f9f78134120 2023-09-30T22:24:43.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.082+0000 7f9f6effd700 1 -- 172.21.15.156:0/2733493552 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f7001c7e0 con 0x7f9f78134120 2023-09-30T22:24:43.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.082+0000 7f9f6cff9700 1 -- 172.21.15.156:0/2733493552 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f540052e0 con 0x7f9f78134120 2023-09-30T22:24:43.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.083+0000 7f9f6effd700 1 -- 172.21.15.156:0/2733493552 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9f70040f80 con 0x7f9f78134120 2023-09-30T22:24:43.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.087+0000 7f9f6effd700 1 -- 172.21.15.156:0/2733493552 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f700092e0 con 0x7f9f78134120 2023-09-30T22:24:43.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.121+0000 7f33561bf700 1 Processor -- start 2023-09-30T22:24:43.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.121+0000 7f33561bf700 1 -- start start 2023-09-30T22:24:43.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.121+0000 7f33561bf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33500a1550 0x7f3350138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:43.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.121+0000 7f33561bf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3350139200 0x7f335013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:43.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.121+0000 7f33561bf700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f335009e9d0 con 0x7f33500a0a70 2023-09-30T22:24:43.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.121+0000 7f33561bf700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335009dc00 con 0x7f33500a1550 2023-09-30T22:24:43.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.121+0000 7f33561bf700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f335009dec0 con 0x7f3350139200 2023-09-30T22:24:43.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.121+0000 7f334f7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f33500a0a70 0x7f33500a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37840/0 (socket says 172.21.15.156:37840) 2023-09-30T22:24:43.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.121+0000 7f334f7fe700 1 -- 172.21.15.156:0/3374926069 learned_addr learned my addr 172.21.15.156:0/3374926069 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:43.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.121+0000 7f334effd700 1 --2- 172.21.15.156:0/3374926069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33500a1550 0x7f3350138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:43.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.122+0000 7f334ffff700 1 --2- 172.21.15.156:0/3374926069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3350139200 0x7f335013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:43.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.122+0000 7f334effd700 1 -- 172.21.15.156:0/3374926069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3350139200 msgr2=0x7f335013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:43.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.122+0000 7f334effd700 1 --2- 172.21.15.156:0/3374926069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3350139200 0x7f335013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.122+0000 7f334effd700 1 -- 172.21.15.156:0/3374926069 >> v1:172.21.15.156:6789/0 conn(0x7f33500a0a70 legacy=0x7f33500a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:43.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.122+0000 7f334e7fc700 1 -- 172.21.15.156:0/3374926069 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3768742556 0 0) 0x7f335009e9d0 con 0x7f33500a0a70 2023-09-30T22:24:43.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.122+0000 7f334effd700 1 -- 172.21.15.156:0/3374926069 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335009e6a0 con 0x7f33500a1550 2023-09-30T22:24:43.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.122+0000 7f334ffff700 1 --2- 172.21.15.156:0/3374926069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3350139200 0x7f335013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:43.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.122+0000 7f334effd700 1 --2- 172.21.15.156:0/3374926069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33500a1550 0x7f3350138cc0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3344009870 tx=0x7f3344009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa0e124ddb71f02c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:43.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.122+0000 7f334e7fc700 1 -- 172.21.15.156:0/3374926069 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3344011830 con 0x7f33500a1550 2023-09-30T22:24:43.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.122+0000 7f334e7fc700 1 -- 172.21.15.156:0/3374926069 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3344011990 con 0x7f33500a1550 2023-09-30T22:24:43.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.122+0000 7f334e7fc700 1 -- 172.21.15.156:0/3374926069 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3344011d20 con 0x7f33500a1550 2023-09-30T22:24:43.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.122+0000 7ff541055700 1 -- 172.21.15.156:0/3237690835 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff53c06c3b0 con 0x7ff53c1309f0 2023-09-30T22:24:43.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.123+0000 7f33561bf700 1 -- 172.21.15.156:0/3374926069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33500a1550 msgr2=0x7f3350138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:43.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.123+0000 7f33561bf700 1 --2- 172.21.15.156:0/3374926069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33500a1550 0x7f3350138cc0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3344009870 tx=0x7f3344009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:43.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.123+0000 7ff5237fe700 1 -- 172.21.15.156:0/3237690835 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff530015020 con 0x7ff53c1309f0 2023-09-30T22:24:43.129 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:43.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.123+0000 7f33561bf700 1 -- 172.21.15.156:0/3374926069 shutdown_connections 2023-09-30T22:24:43.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.123+0000 7f33561bf700 1 --2- 172.21.15.156:0/3374926069 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3350139200 0x7f335013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.123+0000 7f33561bf700 1 --2- 172.21.15.156:0/3374926069 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33500a1550 0x7f3350138cc0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.123+0000 7f33561bf700 1 -- 172.21.15.156:0/3374926069 >> 172.21.15.156:0/3374926069 conn(0x7f33500a6610 msgr2=0x7f33500a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:43.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.123+0000 7f33561bf700 1 -- 172.21.15.156:0/3374926069 shutdown_connections 2023-09-30T22:24:43.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.123+0000 7f33561bf700 1 -- 172.21.15.156:0/3374926069 wait complete. 2023-09-30T22:24:43.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.124+0000 7f33561bf700 1 Processor -- start 2023-09-30T22:24:43.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.124+0000 7f33561bf700 1 -- start start 2023-09-30T22:24:43.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.124+0000 7f33561bf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33500a0a70 0x7f335011e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:43.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.124+0000 7f33561bf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33500a1550 0x7f335011ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:43.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.124+0000 7f33561bf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3350139200 0x7f335011f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:43.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.124+0000 7f33561bf700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3350120370 con 0x7f33500a0a70 2023-09-30T22:24:43.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.124+0000 7f33561bf700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3350134650 con 0x7f33500a1550 2023-09-30T22:24:43.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.124+0000 7f33561bf700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3350121fa0 con 0x7f3350139200 2023-09-30T22:24:43.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.125+0000 7f334effd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33500a1550 0x7f335011ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:43.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.125+0000 7f334ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3350139200 0x7f335011f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:43.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.125+0000 7f334f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33500a0a70 0x7f335011e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:43.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.125+0000 7f334effd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33500a1550 0x7f335011ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38040/0 (socket says 172.21.15.156:38040) 2023-09-30T22:24:43.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.125+0000 7f334ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3350139200 0x7f335011f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46060/0 (socket says 172.21.15.156:46060) 2023-09-30T22:24:43.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.125+0000 7f334effd700 1 -- 172.21.15.156:0/1516809284 learned_addr learned my addr 172.21.15.156:0/1516809284 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:43.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.125+0000 7f334ffff700 1 -- 172.21.15.156:0/1516809284 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33500a1550 msgr2=0x7f335011ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:43.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.125+0000 7f334ffff700 1 --2- 172.21.15.156:0/1516809284 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33500a1550 0x7f335011ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.125+0000 7f334ffff700 1 -- 172.21.15.156:0/1516809284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33500a0a70 msgr2=0x7f335011e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:43.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.125+0000 7f334ffff700 1 --2- 172.21.15.156:0/1516809284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33500a0a70 0x7f335011e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.125+0000 7f334ffff700 1 -- 172.21.15.156:0/1516809284 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33440094a0 con 0x7f3350139200 2023-09-30T22:24:43.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.125+0000 7f334effd700 1 --2- 172.21.15.156:0/1516809284 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33500a1550 0x7f335011ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:43.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.125+0000 7f334ffff700 1 --2- 172.21.15.156:0/1516809284 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3350139200 0x7f335011f230 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f3348007e30 tx=0x7f334800d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:43.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.125+0000 7f3337fff700 1 -- 172.21.15.156:0/1516809284 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334800dd20 con 0x7f3350139200 2023-09-30T22:24:43.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.125+0000 7f3337fff700 1 -- 172.21.15.156:0/1516809284 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334800f040 con 0x7f3350139200 2023-09-30T22:24:43.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.125+0000 7f3337fff700 1 -- 172.21.15.156:0/1516809284 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3348003c40 con 0x7f3350139200 2023-09-30T22:24:43.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.125+0000 7f33561bf700 1 -- 172.21.15.156:0/1516809284 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3350121a10 con 0x7f3350139200 2023-09-30T22:24:43.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.125+0000 7f33561bf700 1 -- 172.21.15.156:0/1516809284 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33500a5100 con 0x7f3350139200 2023-09-30T22:24:43.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.126+0000 7ff541055700 1 -- 172.21.15.156:0/3237690835 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff53c1309f0 msgr2=0x7ff53c11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:43.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.126+0000 7ff541055700 1 --2- 172.21.15.156:0/3237690835 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff53c1309f0 0x7ff53c11df80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ff530016000 tx=0x7ff530004750 comp rx=0 tx=0).stop 2023-09-30T22:24:43.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.126+0000 7ff541055700 1 -- 172.21.15.156:0/3237690835 shutdown_connections 2023-09-30T22:24:43.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.126+0000 7ff541055700 1 --2- 172.21.15.156:0/3237690835 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff53c133ad0 0x7ff53c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.126+0000 7ff541055700 1 --2- 172.21.15.156:0/3237690835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff53c1300a0 0x7ff53c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.126+0000 7ff541055700 1 --2- 172.21.15.156:0/3237690835 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff53c1309f0 0x7ff53c11df80 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.126+0000 7ff541055700 1 -- 172.21.15.156:0/3237690835 >> 172.21.15.156:0/3237690835 conn(0x7ff53c099c40 msgr2=0x7ff53c1321d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:43.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.126+0000 7ff541055700 1 -- 172.21.15.156:0/3237690835 shutdown_connections 2023-09-30T22:24:43.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.126+0000 7f3337fff700 1 -- 172.21.15.156:0/1516809284 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3348004030 con 0x7f3350139200 2023-09-30T22:24:43.138 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:43.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.126+0000 7ff541055700 1 -- 172.21.15.156:0/3237690835 wait complete. 2023-09-30T22:24:43.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.126+0000 7f3337fff700 1 -- 172.21.15.156:0/1516809284 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f334803f6e0 con 0x7f3350139200 2023-09-30T22:24:43.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.126+0000 7f33561bf700 1 -- 172.21.15.156:0/1516809284 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33500a03e0 con 0x7f3350139200 2023-09-30T22:24:43.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.131+0000 7f3337fff700 1 -- 172.21.15.156:0/1516809284 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f334801e3b0 con 0x7f3350139200 2023-09-30T22:24:43.143 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:43.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.262+0000 7fd7dba6e700 1 Processor -- start 2023-09-30T22:24:43.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.262+0000 7fd7dba6e700 1 -- start start 2023-09-30T22:24:43.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.262+0000 7fd7dba6e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd7d4133ad0 0x7fd7d4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:43.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.262+0000 7fd7dba6e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd7d4130bc0 0x7fd7d413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:43.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.262+0000 7fd7dba6e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d406b2d0 con 0x7fd7d41300a0 2023-09-30T22:24:43.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.262+0000 7fd7dba6e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d4133610 con 0x7fd7d4130bc0 2023-09-30T22:24:43.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.262+0000 7fd7dba6e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d409a500 con 0x7fd7d4133ad0 2023-09-30T22:24:43.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.263+0000 7fd7d980a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd7d4133ad0 0x7fd7d4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:43.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.263+0000 7fd7d9009700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fd7d41300a0 0x7fd7d41304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37846/0 (socket says 172.21.15.156:37846) 2023-09-30T22:24:43.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.263+0000 7fd7d9009700 1 -- 172.21.15.156:0/1308276310 learned_addr learned my addr 172.21.15.156:0/1308276310 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:43.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.263+0000 7fd7da00b700 1 --2- 172.21.15.156:0/1308276310 >> v2:172.21.15.156:3300/0 conn(0x7fd7d4130bc0 0x7fd7d413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:43.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.263+0000 7fd7da00b700 1 -- 172.21.15.156:0/1308276310 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd7d4133ad0 msgr2=0x7fd7d4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:43.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.263+0000 7fd7da00b700 1 --2- 172.21.15.156:0/1308276310 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd7d4133ad0 0x7fd7d4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.263+0000 7fd7da00b700 1 -- 172.21.15.156:0/1308276310 >> v1:172.21.15.156:6789/0 conn(0x7fd7d41300a0 legacy=0x7fd7d41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:43.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.263+0000 7fd7da00b700 1 -- 172.21.15.156:0/1308276310 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d41338b0 con 0x7fd7d4130bc0 2023-09-30T22:24:43.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.263+0000 7fd7d980a700 1 --2- 172.21.15.156:0/1308276310 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd7d4133ad0 0x7fd7d4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:43.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.263+0000 7fd7da00b700 1 --2- 172.21.15.156:0/1308276310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7d4130bc0 0x7fd7d413b990 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc009d90 tx=0x7fd7cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec035d42f1b60298 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:43.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.263+0000 7fd7d8808700 1 -- 172.21.15.156:0/1308276310 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc00e070 con 0x7fd7d4130bc0 2023-09-30T22:24:43.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.263+0000 7fd7d8808700 1 -- 172.21.15.156:0/1308276310 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7cc00bb20 con 0x7fd7d4130bc0 2023-09-30T22:24:43.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.263+0000 7fd7d8808700 1 -- 172.21.15.156:0/1308276310 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc012430 con 0x7fd7d4130bc0 2023-09-30T22:24:43.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.264+0000 7fd7dba6e700 1 -- 172.21.15.156:0/1308276310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7d4130bc0 msgr2=0x7fd7d413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:43.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.264+0000 7fd7dba6e700 1 --2- 172.21.15.156:0/1308276310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7d4130bc0 0x7fd7d413b990 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc009d90 tx=0x7fd7cc00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:43.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.264+0000 7fd7dba6e700 1 -- 172.21.15.156:0/1308276310 shutdown_connections 2023-09-30T22:24:43.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.264+0000 7fd7dba6e700 1 --2- 172.21.15.156:0/1308276310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7d4130bc0 0x7fd7d413b990 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.264+0000 7fd7dba6e700 1 --2- 172.21.15.156:0/1308276310 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd7d4133ad0 0x7fd7d4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.264+0000 7fd7dba6e700 1 -- 172.21.15.156:0/1308276310 >> 172.21.15.156:0/1308276310 conn(0x7fd7d4099c40 msgr2=0x7fd7d40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:43.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.264+0000 7fd7dba6e700 1 -- 172.21.15.156:0/1308276310 shutdown_connections 2023-09-30T22:24:43.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.264+0000 7fd7dba6e700 1 -- 172.21.15.156:0/1308276310 wait complete. 2023-09-30T22:24:43.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.265+0000 7fd7dba6e700 1 Processor -- start 2023-09-30T22:24:43.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.265+0000 7fd7dba6e700 1 -- start start 2023-09-30T22:24:43.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.266+0000 7fd7dba6e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7d41300a0 0x7fd7d411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:43.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.266+0000 7fd7dba6e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd7d4130bc0 0x7fd7d411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:43.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.266+0000 7fd7dba6e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd7d4133ad0 0x7fd7d411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:43.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.266+0000 7fd7dba6e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d411fde0 con 0x7fd7d41300a0 2023-09-30T22:24:43.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.266+0000 7fd7dba6e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d40a3450 con 0x7fd7d4130bc0 2023-09-30T22:24:43.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.266+0000 7fd7dba6e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d412dd00 con 0x7fd7d4133ad0 2023-09-30T22:24:43.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.266+0000 7fd7d980a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7d41300a0 0x7fd7d411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:43.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.266+0000 7fd7d980a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7d41300a0 0x7fd7d411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51920/0 (socket says 172.21.15.156:51920) 2023-09-30T22:24:43.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.266+0000 7fd7d980a700 1 -- 172.21.15.156:0/3014206632 learned_addr learned my addr 172.21.15.156:0/3014206632 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:43.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.266+0000 7fd7d9009700 1 --2- 172.21.15.156:0/3014206632 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd7d4130bc0 0x7fd7d411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:43.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.266+0000 7fd7da00b700 1 --2- 172.21.15.156:0/3014206632 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd7d4133ad0 0x7fd7d411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:43.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.266+0000 7fd7d980a700 1 -- 172.21.15.156:0/3014206632 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd7d4133ad0 msgr2=0x7fd7d411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:43.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.266+0000 7fd7d980a700 1 --2- 172.21.15.156:0/3014206632 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd7d4133ad0 0x7fd7d411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.266+0000 7fd7d980a700 1 -- 172.21.15.156:0/3014206632 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd7d4130bc0 msgr2=0x7fd7d411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:43.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.266+0000 7fd7d980a700 1 --2- 172.21.15.156:0/3014206632 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd7d4130bc0 0x7fd7d411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.266+0000 7fd7d980a700 1 -- 172.21.15.156:0/3014206632 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d00094a0 con 0x7fd7d41300a0 2023-09-30T22:24:43.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.267+0000 7fd7d980a700 1 --2- 172.21.15.156:0/3014206632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7d41300a0 0x7fd7d411da40 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000ebe0 tx=0x7fd7d000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:43.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.267+0000 7fd7ca7fc700 1 -- 172.21.15.156:0/3014206632 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d000c850 con 0x7fd7d41300a0 2023-09-30T22:24:43.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.267+0000 7fd7ca7fc700 1 -- 172.21.15.156:0/3014206632 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d000c9b0 con 0x7fd7d41300a0 2023-09-30T22:24:43.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.267+0000 7fd7ca7fc700 1 -- 172.21.15.156:0/3014206632 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d000cd40 con 0x7fd7d41300a0 2023-09-30T22:24:43.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.267+0000 7fd7dba6e700 1 -- 172.21.15.156:0/3014206632 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7cc009a70 con 0x7fd7d41300a0 2023-09-30T22:24:43.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.267+0000 7fd7dba6e700 1 -- 172.21.15.156:0/3014206632 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d411fb20 con 0x7fd7d41300a0 2023-09-30T22:24:43.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.268+0000 7fd7ca7fc700 1 -- 172.21.15.156:0/3014206632 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd7d0013470 con 0x7fd7d41300a0 2023-09-30T22:24:43.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.268+0000 7fd7dba6e700 1 -- 172.21.15.156:0/3014206632 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7d404f2a0 con 0x7fd7d41300a0 2023-09-30T22:24:43.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.268+0000 7fd7ca7fc700 1 -- 172.21.15.156:0/3014206632 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd7d003f800 con 0x7fd7d41300a0 2023-09-30T22:24:43.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.273+0000 7fd7ca7fc700 1 -- 172.21.15.156:0/3014206632 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd7d0013720 con 0x7fd7d41300a0 2023-09-30T22:24:43.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.284+0000 7f9f6cff9700 1 -- 172.21.15.156:0/2733493552 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9f54005590 con 0x7f9f78134120 2023-09-30T22:24:43.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.285+0000 7f9f6effd700 1 -- 172.21.15.156:0/2733493552 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f70023360 con 0x7f9f78134120 2023-09-30T22:24:43.285 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:43.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.287+0000 7f9f6cff9700 1 -- 172.21.15.156:0/2733493552 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f78134120 msgr2=0x7f9f78123190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:43.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.287+0000 7f9f6cff9700 1 --2- 172.21.15.156:0/2733493552 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f78134120 0x7f9f78123190 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f9f7000b680 tx=0x7f9f70004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.287+0000 7f9f6cff9700 1 -- 172.21.15.156:0/2733493552 shutdown_connections 2023-09-30T22:24:43.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.287+0000 7f9f6cff9700 1 --2- 172.21.15.156:0/2733493552 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f78134120 0x7f9f78123190 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.287+0000 7f9f6cff9700 1 --2- 172.21.15.156:0/2733493552 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f780a0a70 0x7f9f78122710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.287+0000 7f9f6cff9700 1 --2- 172.21.15.156:0/2733493552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f780a1380 0x7f9f78122c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.287+0000 7f9f6cff9700 1 -- 172.21.15.156:0/2733493552 >> 172.21.15.156:0/2733493552 conn(0x7f9f780a6610 msgr2=0x7f9f780a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:43.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.287+0000 7f9f6cff9700 1 -- 172.21.15.156:0/2733493552 shutdown_connections 2023-09-30T22:24:43.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.287+0000 7f9f6cff9700 1 -- 172.21.15.156:0/2733493552 wait complete. 2023-09-30T22:24:43.300 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:43.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.331+0000 7f33561bf700 1 -- 172.21.15.156:0/1516809284 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f335004f2a0 con 0x7f3350139200 2023-09-30T22:24:43.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.331+0000 7f3337fff700 1 -- 172.21.15.156:0/1516809284 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f334801a070 con 0x7f3350139200 2023-09-30T22:24:43.332 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:43.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.333+0000 7f33561bf700 1 -- 172.21.15.156:0/1516809284 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3350139200 msgr2=0x7f335011f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:43.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.333+0000 7f33561bf700 1 --2- 172.21.15.156:0/1516809284 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3350139200 0x7f335011f230 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f3348007e30 tx=0x7f334800d3b0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.333+0000 7f33561bf700 1 -- 172.21.15.156:0/1516809284 shutdown_connections 2023-09-30T22:24:43.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.333+0000 7f33561bf700 1 --2- 172.21.15.156:0/1516809284 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3350139200 0x7f335011f230 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.333+0000 7f33561bf700 1 --2- 172.21.15.156:0/1516809284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33500a0a70 0x7f335011e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.333+0000 7f33561bf700 1 --2- 172.21.15.156:0/1516809284 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33500a1550 0x7f335011ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.333+0000 7f33561bf700 1 -- 172.21.15.156:0/1516809284 >> 172.21.15.156:0/1516809284 conn(0x7f33500a6610 msgr2=0x7f33500a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:43.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.333+0000 7f33561bf700 1 -- 172.21.15.156:0/1516809284 shutdown_connections 2023-09-30T22:24:43.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.333+0000 7f33561bf700 1 -- 172.21.15.156:0/1516809284 wait complete. 2023-09-30T22:24:43.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:43.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.464+0000 7fd7dba6e700 1 -- 172.21.15.156:0/3014206632 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd7d406c3b0 con 0x7fd7d41300a0 2023-09-30T22:24:43.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.465+0000 7fd7ca7fc700 1 -- 172.21.15.156:0/3014206632 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd7d001b9c0 con 0x7fd7d41300a0 2023-09-30T22:24:43.465 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:43.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.466+0000 7fd7dba6e700 1 -- 172.21.15.156:0/3014206632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7d41300a0 msgr2=0x7fd7d411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:43.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.466+0000 7fd7dba6e700 1 --2- 172.21.15.156:0/3014206632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7d41300a0 0x7fd7d411da40 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000ebe0 tx=0x7fd7d000eef0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.466+0000 7fd7dba6e700 1 -- 172.21.15.156:0/3014206632 shutdown_connections 2023-09-30T22:24:43.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.466+0000 7fd7dba6e700 1 --2- 172.21.15.156:0/3014206632 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd7d4133ad0 0x7fd7d411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.466+0000 7fd7dba6e700 1 --2- 172.21.15.156:0/3014206632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7d41300a0 0x7fd7d411da40 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.466+0000 7fd7dba6e700 1 --2- 172.21.15.156:0/3014206632 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd7d4130bc0 0x7fd7d411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.466+0000 7fd7dba6e700 1 -- 172.21.15.156:0/3014206632 >> 172.21.15.156:0/3014206632 conn(0x7fd7d4099c40 msgr2=0x7fd7d412e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:43.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.467+0000 7fd7dba6e700 1 -- 172.21.15.156:0/3014206632 shutdown_connections 2023-09-30T22:24:43.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:43.467+0000 7fd7dba6e700 1 -- 172.21.15.156:0/3014206632 wait complete. 2023-09-30T22:24:43.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:44.144 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:44.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.268+0000 7fbd52c4a700 1 Processor -- start 2023-09-30T22:24:44.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.268+0000 7fbd52c4a700 1 -- start start 2023-09-30T22:24:44.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.269+0000 7fbd52c4a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd4c131980 0x7fbd4c131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.269+0000 7fbd52c4a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd4c09bc70 0x7fbd4c09c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.269+0000 7fbd52c4a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4c0a1640 con 0x7fbd4c09c5c0 2023-09-30T22:24:44.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.269+0000 7fbd52c4a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c06eb30 con 0x7fbd4c09bc70 2023-09-30T22:24:44.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.269+0000 7fbd52c4a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c0a22d0 con 0x7fbd4c131980 2023-09-30T22:24:44.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.269+0000 7fbd4bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd4c09bc70 0x7fbd4c09c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.269+0000 7fbd509e6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd4c131980 0x7fbd4c131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.269+0000 7fbd4bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd4c09bc70 0x7fbd4c09c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38056/0 (socket says 172.21.15.156:38056) 2023-09-30T22:24:44.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.269+0000 7fbd509e6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd4c131980 0x7fbd4c131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46088/0 (socket says 172.21.15.156:46088) 2023-09-30T22:24:44.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.269+0000 7fbd4bfff700 1 -- 172.21.15.156:0/2358338871 learned_addr learned my addr 172.21.15.156:0/2358338871 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:44.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.269+0000 7fbd509e6700 1 -- 172.21.15.156:0/2358338871 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd4c09bc70 msgr2=0x7fbd4c09c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:44.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.269+0000 7fbd509e6700 1 --2- 172.21.15.156:0/2358338871 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd4c09bc70 0x7fbd4c09c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.269+0000 7fbd509e6700 1 -- 172.21.15.156:0/2358338871 >> v1:172.21.15.156:6789/0 conn(0x7fbd4c09c5c0 legacy=0x7fbd4c138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.269+0000 7fbd509e6700 1 -- 172.21.15.156:0/2358338871 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c131550 con 0x7fbd4c131980 2023-09-30T22:24:44.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.269+0000 7fbd4b7fe700 1 -- 172.21.15.156:0/2358338871 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1096443053 0 0) 0x7fbd4c0a1640 con 0x7fbd4c09c5c0 2023-09-30T22:24:44.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.269+0000 7fbd4bfff700 1 --2- 172.21.15.156:0/2358338871 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd4c09bc70 0x7fbd4c09c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:44.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.269+0000 7fbd509e6700 1 --2- 172.21.15.156:0/2358338871 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd4c131980 0x7fbd4c131d50 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fbd4000dc80 tx=0x7fbd4000df90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbc531f8cf95fcd6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:44.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.269+0000 7fbd4b7fe700 1 -- 172.21.15.156:0/2358338871 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd40012070 con 0x7fbd4c131980 2023-09-30T22:24:44.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.270+0000 7fbd4b7fe700 1 -- 172.21.15.156:0/2358338871 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4000d2e0 con 0x7fbd4c131980 2023-09-30T22:24:44.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.270+0000 7fbd4b7fe700 1 -- 172.21.15.156:0/2358338871 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4000f8e0 con 0x7fbd4c131980 2023-09-30T22:24:44.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.270+0000 7fbd52c4a700 1 -- 172.21.15.156:0/2358338871 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd4c131980 msgr2=0x7fbd4c131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.270+0000 7fbd52c4a700 1 --2- 172.21.15.156:0/2358338871 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd4c131980 0x7fbd4c131d50 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fbd4000dc80 tx=0x7fbd4000df90 comp rx=0 tx=0).stop 2023-09-30T22:24:44.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.270+0000 7fbd52c4a700 1 -- 172.21.15.156:0/2358338871 shutdown_connections 2023-09-30T22:24:44.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.270+0000 7fbd52c4a700 1 --2- 172.21.15.156:0/2358338871 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd4c131980 0x7fbd4c131d50 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.270+0000 7fbd52c4a700 1 --2- 172.21.15.156:0/2358338871 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd4c09bc70 0x7fbd4c09c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.270+0000 7fbd52c4a700 1 -- 172.21.15.156:0/2358338871 >> 172.21.15.156:0/2358338871 conn(0x7fbd4c0a2980 msgr2=0x7fbd4c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:44.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.270+0000 7fbd52c4a700 1 -- 172.21.15.156:0/2358338871 shutdown_connections 2023-09-30T22:24:44.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.270+0000 7fbd52c4a700 1 -- 172.21.15.156:0/2358338871 wait complete. 2023-09-30T22:24:44.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.271+0000 7fbd52c4a700 1 Processor -- start 2023-09-30T22:24:44.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.271+0000 7fbd52c4a700 1 -- start start 2023-09-30T22:24:44.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.272+0000 7fbd52c4a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd4c09bc70 0x7fbd4c11b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.272+0000 7fbd52c4a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd4c09c5c0 0x7fbd4c11bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.272+0000 7fbd52c4a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd4c131980 0x7fbd4c11c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.272+0000 7fbd52c4a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c11f230 con 0x7fbd4c131980 2023-09-30T22:24:44.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.272+0000 7fbd52c4a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c11d550 con 0x7fbd4c09bc70 2023-09-30T22:24:44.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.272+0000 7fbd52c4a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c0a1c40 con 0x7fbd4c09c5c0 2023-09-30T22:24:44.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.272+0000 7fbd4bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd4c09c5c0 0x7fbd4c11bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.272+0000 7fbd509e6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd4c09bc70 0x7fbd4c11b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.272+0000 7fbd511e7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd4c131980 0x7fbd4c11c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.272+0000 7fbd4bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd4c09c5c0 0x7fbd4c11bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46094/0 (socket says 172.21.15.156:46094) 2023-09-30T22:24:44.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.272+0000 7fbd509e6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd4c09bc70 0x7fbd4c11b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38058/0 (socket says 172.21.15.156:38058) 2023-09-30T22:24:44.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.272+0000 7fbd4bfff700 1 -- 172.21.15.156:0/2481132516 learned_addr learned my addr 172.21.15.156:0/2481132516 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:44.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.272+0000 7fbd4bfff700 1 -- 172.21.15.156:0/2481132516 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd4c09bc70 msgr2=0x7fbd4c11b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.272+0000 7fbd4bfff700 1 --2- 172.21.15.156:0/2481132516 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd4c09bc70 0x7fbd4c11b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.272+0000 7fbd4bfff700 1 -- 172.21.15.156:0/2481132516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd4c131980 msgr2=0x7fbd4c11c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.272+0000 7fbd4bfff700 1 --2- 172.21.15.156:0/2481132516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd4c131980 0x7fbd4c11c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.272+0000 7fbd4bfff700 1 -- 172.21.15.156:0/2481132516 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd38009550 con 0x7fbd4c09c5c0 2023-09-30T22:24:44.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.272+0000 7fbd4bfff700 1 --2- 172.21.15.156:0/2481132516 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd4c09c5c0 0x7fbd4c11bf20 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fbd3800ec10 tx=0x7fbd3800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:44.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.272+0000 7fbd497fa700 1 -- 172.21.15.156:0/2481132516 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3800c850 con 0x7fbd4c09c5c0 2023-09-30T22:24:44.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.272+0000 7fbd497fa700 1 -- 172.21.15.156:0/2481132516 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3800c9b0 con 0x7fbd4c09c5c0 2023-09-30T22:24:44.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.272+0000 7fbd497fa700 1 -- 172.21.15.156:0/2481132516 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3800cd60 con 0x7fbd4c09c5c0 2023-09-30T22:24:44.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.272+0000 7fbd52c4a700 1 -- 172.21.15.156:0/2481132516 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd4000d8e0 con 0x7fbd4c09c5c0 2023-09-30T22:24:44.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.272+0000 7fbd52c4a700 1 -- 172.21.15.156:0/2481132516 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4c11dc40 con 0x7fbd4c09c5c0 2023-09-30T22:24:44.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.273+0000 7fbd497fa700 1 -- 172.21.15.156:0/2481132516 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbd38013470 con 0x7fbd4c09c5c0 2023-09-30T22:24:44.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.273+0000 7fbd497fa700 1 -- 172.21.15.156:0/2481132516 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbd3803fb50 con 0x7fbd4c09c5c0 2023-09-30T22:24:44.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.273+0000 7fbd52c4a700 1 -- 172.21.15.156:0/2481132516 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd4c0a2d50 con 0x7fbd4c09c5c0 2023-09-30T22:24:44.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.278+0000 7fbd497fa700 1 -- 172.21.15.156:0/2481132516 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd3801b3b0 con 0x7fbd4c09c5c0 2023-09-30T22:24:44.301 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:44.348 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:44.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.429+0000 7f114da90700 1 Processor -- start 2023-09-30T22:24:44.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.429+0000 7f114da90700 1 -- start start 2023-09-30T22:24:44.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.429+0000 7f114da90700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f114809e870 0x7f114809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.429+0000 7f114da90700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f114809f180 0x7f1148133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.429+0000 7f114da90700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1148134160 0x7f1148134600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.429+0000 7f114da90700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11480a0370 con 0x7f114809f180 2023-09-30T22:24:44.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.429+0000 7f114da90700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114809fa00 con 0x7f1148134160 2023-09-30T22:24:44.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.429+0000 7f114da90700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f114809ada0 con 0x7f114809e870 2023-09-30T22:24:44.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.430+0000 7f11477fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f114809e870 0x7f114809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.430+0000 7f1147fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1148134160 0x7f1148134600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.430+0000 7f11477fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f114809e870 0x7f114809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46108/0 (socket says 172.21.15.156:46108) 2023-09-30T22:24:44.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.430+0000 7f11477fe700 1 -- 172.21.15.156:0/983877420 learned_addr learned my addr 172.21.15.156:0/983877420 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:44.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.430+0000 7f1146ffd700 1 --2- 172.21.15.156:0/983877420 >> v2:172.21.15.156:3300/0 conn(0x7f114809f180 0x7f1148133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.430+0000 7f11477fe700 1 -- 172.21.15.156:0/983877420 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1148134160 msgr2=0x7f1148134600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:44.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.430+0000 7f11477fe700 1 --2- 172.21.15.156:0/983877420 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1148134160 0x7f1148134600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.430+0000 7f11477fe700 1 -- 172.21.15.156:0/983877420 >> v2:172.21.15.156:3300/0 conn(0x7f114809f180 msgr2=0x7f1148133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:44.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.430+0000 7f11477fe700 1 --2- 172.21.15.156:0/983877420 >> v2:172.21.15.156:3300/0 conn(0x7f114809f180 0x7f1148133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.430+0000 7f11477fe700 1 -- 172.21.15.156:0/983877420 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114806bec0 con 0x7f114809e870 2023-09-30T22:24:44.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.430+0000 7f1147fff700 1 --2- 172.21.15.156:0/983877420 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1148134160 0x7f1148134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:44.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.430+0000 7f1146ffd700 1 --2- 172.21.15.156:0/983877420 >> v2:172.21.15.156:3300/0 conn(0x7f114809f180 0x7f1148133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:44.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.430+0000 7f11477fe700 1 --2- 172.21.15.156:0/983877420 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f114809e870 0x7f114809ec40 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1138009920 tx=0x7f1138009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6401e2fddfb5049a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:44.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.430+0000 7f11467fc700 1 -- 172.21.15.156:0/983877420 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1138011830 con 0x7f114809e870 2023-09-30T22:24:44.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.430+0000 7f11467fc700 1 -- 172.21.15.156:0/983877420 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1138011990 con 0x7f114809e870 2023-09-30T22:24:44.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.430+0000 7f11467fc700 1 -- 172.21.15.156:0/983877420 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1138011d20 con 0x7f114809e870 2023-09-30T22:24:44.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.431+0000 7f114da90700 1 -- 172.21.15.156:0/983877420 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f114809e870 msgr2=0x7f114809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.431+0000 7f114da90700 1 --2- 172.21.15.156:0/983877420 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f114809e870 0x7f114809ec40 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1138009920 tx=0x7f1138009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:44.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.431+0000 7f114da90700 1 -- 172.21.15.156:0/983877420 shutdown_connections 2023-09-30T22:24:44.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.431+0000 7f114da90700 1 --2- 172.21.15.156:0/983877420 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1148134160 0x7f1148134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.431+0000 7f114da90700 1 --2- 172.21.15.156:0/983877420 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f114809e870 0x7f114809ec40 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.436 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.431+0000 7f114da90700 1 --2- 172.21.15.156:0/983877420 >> v2:172.21.15.156:3300/0 conn(0x7f114809f180 0x7f1148133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.431+0000 7f114da90700 1 -- 172.21.15.156:0/983877420 >> 172.21.15.156:0/983877420 conn(0x7f11480a4430 msgr2=0x7f11480a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:44.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.431+0000 7f114da90700 1 -- 172.21.15.156:0/983877420 shutdown_connections 2023-09-30T22:24:44.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.431+0000 7f114da90700 1 -- 172.21.15.156:0/983877420 wait complete. 2023-09-30T22:24:44.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.432+0000 7f114da90700 1 Processor -- start 2023-09-30T22:24:44.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.432+0000 7f114da90700 1 -- start start 2023-09-30T22:24:44.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.432+0000 7f114da90700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f114809e870 0x7f11481224d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.432+0000 7f114da90700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f114809f180 0x7f1148122a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.432+0000 7f114da90700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1148134160 0x7f1148122f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.432+0000 7f114da90700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1148125db0 con 0x7f1148134160 2023-09-30T22:24:44.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.433+0000 7f114da90700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11481338a0 con 0x7f114809f180 2023-09-30T22:24:44.437 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.433+0000 7f114da90700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1148125a50 con 0x7f114809e870 2023-09-30T22:24:44.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.433+0000 7f11477fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f114809e870 0x7f11481224d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.433+0000 7f11477fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f114809e870 0x7f11481224d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46118/0 (socket says 172.21.15.156:46118) 2023-09-30T22:24:44.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.433+0000 7f11477fe700 1 -- 172.21.15.156:0/3067266753 learned_addr learned my addr 172.21.15.156:0/3067266753 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:44.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.433+0000 7f1146ffd700 1 --2- 172.21.15.156:0/3067266753 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f114809f180 0x7f1148122a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.433+0000 7f1147fff700 1 --2- 172.21.15.156:0/3067266753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1148134160 0x7f1148122f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.433+0000 7f11477fe700 1 -- 172.21.15.156:0/3067266753 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f114809f180 msgr2=0x7f1148122a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.433+0000 7f11477fe700 1 --2- 172.21.15.156:0/3067266753 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f114809f180 0x7f1148122a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.433+0000 7f11477fe700 1 -- 172.21.15.156:0/3067266753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1148134160 msgr2=0x7f1148122f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.433+0000 7f11477fe700 1 --2- 172.21.15.156:0/3067266753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1148134160 0x7f1148122f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.433+0000 7f11477fe700 1 -- 172.21.15.156:0/3067266753 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f113c0094a0 con 0x7f114809e870 2023-09-30T22:24:44.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.433+0000 7f1146ffd700 1 --2- 172.21.15.156:0/3067266753 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f114809f180 0x7f1148122a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:44.438 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.433+0000 7f1147fff700 1 --2- 172.21.15.156:0/3067266753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1148134160 0x7f1148122f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:44.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.433+0000 7f11477fe700 1 --2- 172.21.15.156:0/3067266753 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f114809e870 0x7f11481224d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1138009c70 tx=0x7f1138004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:44.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.433+0000 7f112ffff700 1 -- 172.21.15.156:0/3067266753 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1138004510 con 0x7f114809e870 2023-09-30T22:24:44.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.433+0000 7f112ffff700 1 -- 172.21.15.156:0/3067266753 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113801e070 con 0x7f114809e870 2023-09-30T22:24:44.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.433+0000 7f114da90700 1 -- 172.21.15.156:0/3067266753 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1140009a70 con 0x7f114809e870 2023-09-30T22:24:44.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.433+0000 7f112ffff700 1 -- 172.21.15.156:0/3067266753 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11380038e0 con 0x7f114809e870 2023-09-30T22:24:44.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.433+0000 7f114da90700 1 -- 172.21.15.156:0/3067266753 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1138009550 con 0x7f114809e870 2023-09-30T22:24:44.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.434+0000 7f112ffff700 1 -- 172.21.15.156:0/3067266753 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1138003a40 con 0x7f114809e870 2023-09-30T22:24:44.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.434+0000 7f112ffff700 1 -- 172.21.15.156:0/3067266753 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1138040440 con 0x7f114809e870 2023-09-30T22:24:44.439 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.435+0000 7f114da90700 1 -- 172.21.15.156:0/3067266753 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f114806d000 con 0x7f114809e870 2023-09-30T22:24:44.440 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.439+0000 7f112ffff700 1 -- 172.21.15.156:0/3067266753 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f113802d7d0 con 0x7f114809e870 2023-09-30T22:24:44.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.474+0000 7fbf4f7ce700 1 Processor -- start 2023-09-30T22:24:44.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.474+0000 7fbf4f7ce700 1 -- start start 2023-09-30T22:24:44.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.474+0000 7fbf4f7ce700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf480a0a70 0x7fbf480a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.474+0000 7fbf4f7ce700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbf48134120 0x7fbf4813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.474+0000 7fbf4f7ce700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4809dc00 con 0x7fbf480a1380 2023-09-30T22:24:44.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.474+0000 7fbf4f7ce700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4809ea90 con 0x7fbf480a0a70 2023-09-30T22:24:44.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.474+0000 7fbf4f7ce700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4809dec0 con 0x7fbf48134120 2023-09-30T22:24:44.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.474+0000 7fbf4cd69700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fbf480a1380 0x7fbf48133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37872/0 (socket says 172.21.15.156:37872) 2023-09-30T22:24:44.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.474+0000 7fbf4cd69700 1 -- 172.21.15.156:0/1354290574 learned_addr learned my addr 172.21.15.156:0/1354290574 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:44.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.475+0000 7fbf4dd6b700 1 --2- 172.21.15.156:0/1354290574 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbf48134120 0x7fbf4813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.475+0000 7fbf4d56a700 1 --2- 172.21.15.156:0/1354290574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf480a0a70 0x7fbf480a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.475+0000 7fbf4d56a700 1 -- 172.21.15.156:0/1354290574 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbf48134120 msgr2=0x7fbf4813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:44.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.475+0000 7fbf4d56a700 1 --2- 172.21.15.156:0/1354290574 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbf48134120 0x7fbf4813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.475+0000 7fbf4d56a700 1 -- 172.21.15.156:0/1354290574 >> v1:172.21.15.156:6789/0 conn(0x7fbf480a1380 legacy=0x7fbf48133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.475+0000 7fbf4d56a700 1 -- 172.21.15.156:0/1354290574 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4809e6a0 con 0x7fbf480a0a70 2023-09-30T22:24:44.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.475+0000 7fbf4d56a700 1 --2- 172.21.15.156:0/1354290574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf480a0a70 0x7fbf480a0e40 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fbf44009870 tx=0x7fbf44009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d2ed5d406f70385 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:44.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.475+0000 7fbf3ffff700 1 -- 172.21.15.156:0/1354290574 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf44011830 con 0x7fbf480a0a70 2023-09-30T22:24:44.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.475+0000 7fbf3ffff700 1 -- 172.21.15.156:0/1354290574 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf44011990 con 0x7fbf480a0a70 2023-09-30T22:24:44.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.475+0000 7fbf3ffff700 1 -- 172.21.15.156:0/1354290574 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf44011d20 con 0x7fbf480a0a70 2023-09-30T22:24:44.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.476+0000 7fbf4f7ce700 1 -- 172.21.15.156:0/1354290574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf480a0a70 msgr2=0x7fbf480a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.476+0000 7fbf4f7ce700 1 --2- 172.21.15.156:0/1354290574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf480a0a70 0x7fbf480a0e40 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fbf44009870 tx=0x7fbf44009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:44.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.476+0000 7fbf4f7ce700 1 -- 172.21.15.156:0/1354290574 shutdown_connections 2023-09-30T22:24:44.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.476+0000 7fbf4f7ce700 1 --2- 172.21.15.156:0/1354290574 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf480a0a70 0x7fbf480a0e40 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.476+0000 7fbf4f7ce700 1 --2- 172.21.15.156:0/1354290574 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbf48134120 0x7fbf4813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.476+0000 7fbf4f7ce700 1 -- 172.21.15.156:0/1354290574 >> 172.21.15.156:0/1354290574 conn(0x7fbf480a6610 msgr2=0x7fbf480a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:44.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.476+0000 7fbf4f7ce700 1 -- 172.21.15.156:0/1354290574 shutdown_connections 2023-09-30T22:24:44.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.476+0000 7fbf4f7ce700 1 -- 172.21.15.156:0/1354290574 wait complete. 2023-09-30T22:24:44.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.477+0000 7fbf4f7ce700 1 Processor -- start 2023-09-30T22:24:44.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.477+0000 7fbf4f7ce700 1 -- start start 2023-09-30T22:24:44.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.477+0000 7fbf4f7ce700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf480a0a70 0x7fbf4811e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.477+0000 7fbf4f7ce700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf480a1380 0x7fbf4811ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.477+0000 7fbf4f7ce700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbf48134120 0x7fbf4811f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.477+0000 7fbf4f7ce700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf481335f0 con 0x7fbf480a1380 2023-09-30T22:24:44.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.477+0000 7fbf4f7ce700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf48133aa0 con 0x7fbf480a0a70 2023-09-30T22:24:44.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.477+0000 7fbf4f7ce700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf48122180 con 0x7fbf48134120 2023-09-30T22:24:44.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.477+0000 7fbf4d56a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf480a0a70 0x7fbf4811e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.477+0000 7fbf4d56a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf480a0a70 0x7fbf4811e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38100/0 (socket says 172.21.15.156:38100) 2023-09-30T22:24:44.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.477+0000 7fbf4d56a700 1 -- 172.21.15.156:0/213641864 learned_addr learned my addr 172.21.15.156:0/213641864 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:44.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.477+0000 7fbf4dd6b700 1 --2- 172.21.15.156:0/213641864 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbf48134120 0x7fbf4811f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.477+0000 7fbf4cd69700 1 --2- 172.21.15.156:0/213641864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf480a1380 0x7fbf4811ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.478+0000 7fbf4d56a700 1 -- 172.21.15.156:0/213641864 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbf48134120 msgr2=0x7fbf4811f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.478+0000 7fbf4d56a700 1 --2- 172.21.15.156:0/213641864 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbf48134120 0x7fbf4811f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.478+0000 7fbf4d56a700 1 -- 172.21.15.156:0/213641864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf480a1380 msgr2=0x7fbf4811ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.478+0000 7fbf4d56a700 1 --2- 172.21.15.156:0/213641864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf480a1380 0x7fbf4811ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.478+0000 7fbf4d56a700 1 -- 172.21.15.156:0/213641864 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf440094a0 con 0x7fbf480a0a70 2023-09-30T22:24:44.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.478+0000 7fbf4cd69700 1 --2- 172.21.15.156:0/213641864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf480a1380 0x7fbf4811ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:44.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.478+0000 7fbf4d56a700 1 --2- 172.21.15.156:0/213641864 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf480a0a70 0x7fbf4811e6f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fbf44009840 tx=0x7fbf44004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:44.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.478+0000 7fbf3dffb700 1 -- 172.21.15.156:0/213641864 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf44004450 con 0x7fbf480a0a70 2023-09-30T22:24:44.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.478+0000 7fbf3dffb700 1 -- 172.21.15.156:0/213641864 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4401f070 con 0x7fbf480a0a70 2023-09-30T22:24:44.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.478+0000 7fbf4f7ce700 1 -- 172.21.15.156:0/213641864 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf48120a90 con 0x7fbf480a0a70 2023-09-30T22:24:44.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.478+0000 7fbf3dffb700 1 -- 172.21.15.156:0/213641864 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf440038e0 con 0x7fbf480a0a70 2023-09-30T22:24:44.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.478+0000 7fbf4f7ce700 1 -- 172.21.15.156:0/213641864 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf48121ea0 con 0x7fbf480a0a70 2023-09-30T22:24:44.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.479+0000 7fbf3dffb700 1 -- 172.21.15.156:0/213641864 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbf44003a40 con 0x7fbf480a0a70 2023-09-30T22:24:44.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.479+0000 7fbf3dffb700 1 -- 172.21.15.156:0/213641864 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbf44021070 con 0x7fbf480a0a70 2023-09-30T22:24:44.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.479+0000 7fbf4f7ce700 1 -- 172.21.15.156:0/213641864 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf4804f2a0 con 0x7fbf480a0a70 2023-09-30T22:24:44.484 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:44.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.484+0000 7fbf3dffb700 1 -- 172.21.15.156:0/213641864 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf4402b020 con 0x7fbf480a0a70 2023-09-30T22:24:44.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.511+0000 7fbd52c4a700 1 -- 172.21.15.156:0/2481132516 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbd4c04f2a0 con 0x7fbd4c09c5c0 2023-09-30T22:24:44.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.512+0000 7fbd497fa700 1 -- 172.21.15.156:0/2481132516 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbd38011eb0 con 0x7fbd4c09c5c0 2023-09-30T22:24:44.512 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:44.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.515+0000 7fbd52c4a700 1 -- 172.21.15.156:0/2481132516 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd4c09c5c0 msgr2=0x7fbd4c11bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.515+0000 7fbd52c4a700 1 --2- 172.21.15.156:0/2481132516 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd4c09c5c0 0x7fbd4c11bf20 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fbd3800ec10 tx=0x7fbd3800ef20 comp rx=0 tx=0).stop 2023-09-30T22:24:44.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.515+0000 7fbd52c4a700 1 -- 172.21.15.156:0/2481132516 shutdown_connections 2023-09-30T22:24:44.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.515+0000 7fbd52c4a700 1 --2- 172.21.15.156:0/2481132516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd4c131980 0x7fbd4c11c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.515+0000 7fbd52c4a700 1 --2- 172.21.15.156:0/2481132516 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbd4c09bc70 0x7fbd4c11b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.515+0000 7fbd52c4a700 1 --2- 172.21.15.156:0/2481132516 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbd4c09c5c0 0x7fbd4c11bf20 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.515+0000 7fbd52c4a700 1 -- 172.21.15.156:0/2481132516 >> 172.21.15.156:0/2481132516 conn(0x7fbd4c0a2980 msgr2=0x7fbd4c070d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:44.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.515+0000 7fbd52c4a700 1 -- 172.21.15.156:0/2481132516 shutdown_connections 2023-09-30T22:24:44.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.515+0000 7fbd52c4a700 1 -- 172.21.15.156:0/2481132516 wait complete. 2023-09-30T22:24:44.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:44.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.615+0000 7f92ce166700 1 Processor -- start 2023-09-30T22:24:44.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.615+0000 7f92ce166700 1 -- start start 2023-09-30T22:24:44.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.616+0000 7f92ce166700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f92c809e870 0x7f92c809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.616+0000 7f92ce166700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92c809f180 0x7f92c8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.616+0000 7f92ce166700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92c8131d70 0x7f92c81321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.616+0000 7f92ce166700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c80a0920 con 0x7f92c809e870 2023-09-30T22:24:44.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.616+0000 7f92ce166700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c809c970 con 0x7f92c809f180 2023-09-30T22:24:44.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.616+0000 7f92ce166700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92c809bab0 con 0x7f92c8131d70 2023-09-30T22:24:44.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.616+0000 7f92c77fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f92c809e870 0x7f92c809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.616+0000 7f92c6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92c809f180 0x7f92c8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.616+0000 7f92c77fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f92c809e870 0x7f92c809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51948/0 (socket says 172.21.15.156:51948) 2023-09-30T22:24:44.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.616+0000 7f92c7fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92c8131d70 0x7f92c81321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.616+0000 7f92c6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92c809f180 0x7f92c8131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38110/0 (socket says 172.21.15.156:38110) 2023-09-30T22:24:44.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.616+0000 7f92c77fe700 1 -- 172.21.15.156:0/2346654837 learned_addr learned my addr 172.21.15.156:0/2346654837 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:44.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.616+0000 7f92c77fe700 1 -- 172.21.15.156:0/2346654837 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92c8131d70 msgr2=0x7f92c81321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:44.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.616+0000 7f92c77fe700 1 --2- 172.21.15.156:0/2346654837 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92c8131d70 0x7f92c81321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.616+0000 7f92c77fe700 1 -- 172.21.15.156:0/2346654837 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92c809f180 msgr2=0x7f92c8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:44.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.616+0000 7f92c77fe700 1 --2- 172.21.15.156:0/2346654837 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92c809f180 0x7f92c8131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.616+0000 7f92c77fe700 1 -- 172.21.15.156:0/2346654837 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c809f9c0 con 0x7f92c809e870 2023-09-30T22:24:44.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.616+0000 7f92c7fff700 1 --2- 172.21.15.156:0/2346654837 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92c8131d70 0x7f92c81321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:44.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.616+0000 7f92c6ffd700 1 --2- 172.21.15.156:0/2346654837 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92c809f180 0x7f92c8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:44.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.617+0000 7f92c77fe700 1 --2- 172.21.15.156:0/2346654837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92c809e870 0x7f92c809ec40 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009e80 tx=0x7f92b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd1b755cf725de0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:44.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.617+0000 7f92c67fc700 1 -- 172.21.15.156:0/2346654837 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b800e070 con 0x7f92c809e870 2023-09-30T22:24:44.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.617+0000 7f92c67fc700 1 -- 172.21.15.156:0/2346654837 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b800b8d0 con 0x7f92c809e870 2023-09-30T22:24:44.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.617+0000 7f92c67fc700 1 -- 172.21.15.156:0/2346654837 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b800bc80 con 0x7f92c809e870 2023-09-30T22:24:44.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.617+0000 7f92ce166700 1 -- 172.21.15.156:0/2346654837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92c809e870 msgr2=0x7f92c809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.617+0000 7f92ce166700 1 --2- 172.21.15.156:0/2346654837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92c809e870 0x7f92c809ec40 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009e80 tx=0x7f92b800b330 comp rx=0 tx=0).stop 2023-09-30T22:24:44.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.617+0000 7f92ce166700 1 -- 172.21.15.156:0/2346654837 shutdown_connections 2023-09-30T22:24:44.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.617+0000 7f92ce166700 1 --2- 172.21.15.156:0/2346654837 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92c8131d70 0x7f92c81321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.617+0000 7f92ce166700 1 --2- 172.21.15.156:0/2346654837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92c809e870 0x7f92c809ec40 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.617+0000 7f92ce166700 1 --2- 172.21.15.156:0/2346654837 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92c809f180 0x7f92c8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.617+0000 7f92ce166700 1 -- 172.21.15.156:0/2346654837 >> 172.21.15.156:0/2346654837 conn(0x7f92c80a4430 msgr2=0x7f92c80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:44.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.617+0000 7f92ce166700 1 -- 172.21.15.156:0/2346654837 shutdown_connections 2023-09-30T22:24:44.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.617+0000 7f92ce166700 1 -- 172.21.15.156:0/2346654837 wait complete. 2023-09-30T22:24:44.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.618+0000 7f92ce166700 1 Processor -- start 2023-09-30T22:24:44.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.619+0000 7f92ce166700 1 -- start start 2023-09-30T22:24:44.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.619+0000 7f92ce166700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92c809e870 0x7f92c81c0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.619+0000 7f92ce166700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92c809f180 0x7f92c81c1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.619+0000 7f92ce166700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92c8131d70 0x7f92c81c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.619+0000 7f92ce166700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c811e700 con 0x7f92c809e870 2023-09-30T22:24:44.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.619+0000 7f92ce166700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c811e8e0 con 0x7f92c809f180 2023-09-30T22:24:44.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.619+0000 7f92ce166700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92c81c18a0 con 0x7f92c8131d70 2023-09-30T22:24:44.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.619+0000 7f92c77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92c809e870 0x7f92c81c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.619+0000 7f92c77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92c809e870 0x7f92c81c0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51958/0 (socket says 172.21.15.156:51958) 2023-09-30T22:24:44.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.619+0000 7f92c77fe700 1 -- 172.21.15.156:0/1986641877 learned_addr learned my addr 172.21.15.156:0/1986641877 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:44.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.619+0000 7f92c6ffd700 1 --2- 172.21.15.156:0/1986641877 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92c809f180 0x7f92c81c1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.620+0000 7f92c7fff700 1 --2- 172.21.15.156:0/1986641877 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92c8131d70 0x7f92c81c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.620+0000 7f92c77fe700 1 -- 172.21.15.156:0/1986641877 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92c8131d70 msgr2=0x7f92c81c3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.620+0000 7f92c77fe700 1 --2- 172.21.15.156:0/1986641877 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92c8131d70 0x7f92c81c3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.620+0000 7f92c77fe700 1 -- 172.21.15.156:0/1986641877 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92c809f180 msgr2=0x7f92c81c1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.620+0000 7f92c77fe700 1 --2- 172.21.15.156:0/1986641877 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92c809f180 0x7f92c81c1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.620+0000 7f92c77fe700 1 -- 172.21.15.156:0/1986641877 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b000d940 con 0x7f92c809e870 2023-09-30T22:24:44.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.620+0000 7f92c77fe700 1 --2- 172.21.15.156:0/1986641877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92c809e870 0x7f92c81c0e20 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f92c809c8a0 tx=0x7f92b8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:44.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.620+0000 7f92bffff700 1 -- 172.21.15.156:0/1986641877 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b8004450 con 0x7f92c809e870 2023-09-30T22:24:44.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.620+0000 7f92ce166700 1 -- 172.21.15.156:0/1986641877 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c00094a0 con 0x7f92c809e870 2023-09-30T22:24:44.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.620+0000 7f92bffff700 1 -- 172.21.15.156:0/1986641877 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b8003e90 con 0x7f92c809e870 2023-09-30T22:24:44.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.620+0000 7f92bffff700 1 -- 172.21.15.156:0/1986641877 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b80047d0 con 0x7f92c809e870 2023-09-30T22:24:44.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.620+0000 7f92ce166700 1 -- 172.21.15.156:0/1986641877 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b8009b30 con 0x7f92c809e870 2023-09-30T22:24:44.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.621+0000 7f92bffff700 1 -- 172.21.15.156:0/1986641877 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f92b8025450 con 0x7f92c809e870 2023-09-30T22:24:44.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.621+0000 7f92bffff700 1 -- 172.21.15.156:0/1986641877 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f92b80410b0 con 0x7f92c809e870 2023-09-30T22:24:44.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.621+0000 7f92ce166700 1 -- 172.21.15.156:0/1986641877 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c811dc80 con 0x7f92c809e870 2023-09-30T22:24:44.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.630+0000 7f92bffff700 1 -- 172.21.15.156:0/1986641877 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92b8004930 con 0x7f92c809e870 2023-09-30T22:24:44.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.674+0000 7f114da90700 1 -- 172.21.15.156:0/3067266753 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f114804f2a0 con 0x7f114809e870 2023-09-30T22:24:44.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.675+0000 7f112ffff700 1 -- 172.21.15.156:0/3067266753 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1138023ba0 con 0x7f114809e870 2023-09-30T22:24:44.676 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:44.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.677+0000 7f114da90700 1 -- 172.21.15.156:0/3067266753 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f114809e870 msgr2=0x7f11481224d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.677+0000 7f114da90700 1 --2- 172.21.15.156:0/3067266753 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f114809e870 0x7f11481224d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1138009c70 tx=0x7f1138004750 comp rx=0 tx=0).stop 2023-09-30T22:24:44.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.677+0000 7f114da90700 1 -- 172.21.15.156:0/3067266753 shutdown_connections 2023-09-30T22:24:44.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.677+0000 7f114da90700 1 --2- 172.21.15.156:0/3067266753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1148134160 0x7f1148122f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.677+0000 7f114da90700 1 --2- 172.21.15.156:0/3067266753 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f114809e870 0x7f11481224d0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.677+0000 7f114da90700 1 --2- 172.21.15.156:0/3067266753 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f114809f180 0x7f1148122a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.677+0000 7f114da90700 1 -- 172.21.15.156:0/3067266753 >> 172.21.15.156:0/3067266753 conn(0x7f11480a4430 msgr2=0x7f1148070ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:44.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.677+0000 7f114da90700 1 -- 172.21.15.156:0/3067266753 shutdown_connections 2023-09-30T22:24:44.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.677+0000 7f114da90700 1 -- 172.21.15.156:0/3067266753 wait complete. 2023-09-30T22:24:44.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.688+0000 7fbf4f7ce700 1 -- 172.21.15.156:0/213641864 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbf48072980 con 0x7fbf480a0a70 2023-09-30T22:24:44.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.689+0000 7fbf3dffb700 1 -- 172.21.15.156:0/213641864 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbf4401a7b0 con 0x7fbf480a0a70 2023-09-30T22:24:44.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:44.690 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:44.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.691+0000 7fbf4f7ce700 1 -- 172.21.15.156:0/213641864 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf480a0a70 msgr2=0x7fbf4811e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.691+0000 7fbf4f7ce700 1 --2- 172.21.15.156:0/213641864 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf480a0a70 0x7fbf4811e6f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fbf44009840 tx=0x7fbf44004750 comp rx=0 tx=0).stop 2023-09-30T22:24:44.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.691+0000 7fbf4f7ce700 1 -- 172.21.15.156:0/213641864 shutdown_connections 2023-09-30T22:24:44.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.691+0000 7fbf4f7ce700 1 --2- 172.21.15.156:0/213641864 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbf48134120 0x7fbf4811f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.691+0000 7fbf4f7ce700 1 --2- 172.21.15.156:0/213641864 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf480a0a70 0x7fbf4811e6f0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.691+0000 7fbf4f7ce700 1 --2- 172.21.15.156:0/213641864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf480a1380 0x7fbf4811ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.691+0000 7fbf4f7ce700 1 -- 172.21.15.156:0/213641864 >> 172.21.15.156:0/213641864 conn(0x7fbf480a6610 msgr2=0x7fbf480a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:44.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.691+0000 7fbf4f7ce700 1 -- 172.21.15.156:0/213641864 shutdown_connections 2023-09-30T22:24:44.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.691+0000 7fbf4f7ce700 1 -- 172.21.15.156:0/213641864 wait complete. 2023-09-30T22:24:44.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:44.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.821+0000 7f92ce166700 1 -- 172.21.15.156:0/1986641877 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f92c804f2a0 con 0x7f92c809e870 2023-09-30T22:24:44.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.821+0000 7f92bffff700 1 -- 172.21.15.156:0/1986641877 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f92b801b3a0 con 0x7f92c809e870 2023-09-30T22:24:44.822 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:44.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.823+0000 7f92ce166700 1 -- 172.21.15.156:0/1986641877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92c809e870 msgr2=0x7f92c81c0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.823+0000 7f92ce166700 1 --2- 172.21.15.156:0/1986641877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92c809e870 0x7f92c81c0e20 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f92c809c8a0 tx=0x7f92b8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.823+0000 7f92ce166700 1 -- 172.21.15.156:0/1986641877 shutdown_connections 2023-09-30T22:24:44.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.823+0000 7f92ce166700 1 --2- 172.21.15.156:0/1986641877 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92c8131d70 0x7f92c81c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.823+0000 7f92ce166700 1 --2- 172.21.15.156:0/1986641877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92c809e870 0x7f92c81c0e20 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.823+0000 7f92ce166700 1 --2- 172.21.15.156:0/1986641877 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92c809f180 0x7f92c81c1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.823+0000 7f92ce166700 1 -- 172.21.15.156:0/1986641877 >> 172.21.15.156:0/1986641877 conn(0x7f92c80a4430 msgr2=0x7f92c812fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:44.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.823+0000 7f92ce166700 1 -- 172.21.15.156:0/1986641877 shutdown_connections 2023-09-30T22:24:44.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:44.823+0000 7f92ce166700 1 -- 172.21.15.156:0/1986641877 wait complete. 2023-09-30T22:24:44.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:45.535 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:45.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.663+0000 7ff2e3f50700 1 Processor -- start 2023-09-30T22:24:45.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.663+0000 7ff2e3f50700 1 -- start start 2023-09-30T22:24:45.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.664+0000 7ff2e3f50700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff2dc136960 0x7ff2dc138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.664+0000 7ff2e3f50700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff2dc139280 0x7ff2dc13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.664+0000 7ff2e3f50700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2dc06b2d0 con 0x7ff2dc133ad0 2023-09-30T22:24:45.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.664+0000 7ff2e3f50700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2dc1345b0 con 0x7ff2dc139280 2023-09-30T22:24:45.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.664+0000 7ff2e3f50700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc133610 con 0x7ff2dc136960 2023-09-30T22:24:45.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.664+0000 7ff2e24ed700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff2dc139280 0x7ff2dc13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.664+0000 7ff2e14eb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff2dc136960 0x7ff2dc138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.664+0000 7ff2e1cec700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff2dc133ad0 0x7ff2dc133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37874/0 (socket says 172.21.15.156:37874) 2023-09-30T22:24:45.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.664+0000 7ff2e1cec700 1 -- 172.21.15.156:0/1229608734 learned_addr learned my addr 172.21.15.156:0/1229608734 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:45.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.664+0000 7ff2e24ed700 1 -- 172.21.15.156:0/1229608734 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff2dc136960 msgr2=0x7ff2dc138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:45.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.664+0000 7ff2e24ed700 1 --2- 172.21.15.156:0/1229608734 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff2dc136960 0x7ff2dc138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.664+0000 7ff2e24ed700 1 -- 172.21.15.156:0/1229608734 >> v1:172.21.15.156:6789/0 conn(0x7ff2dc133ad0 legacy=0x7ff2dc133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.664+0000 7ff2e0cea700 1 -- 172.21.15.156:0/1229608734 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1106992513 0 0) 0x7ff2dc06b2d0 con 0x7ff2dc133ad0 2023-09-30T22:24:45.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.664+0000 7ff2e24ed700 1 -- 172.21.15.156:0/1229608734 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc09a500 con 0x7ff2dc139280 2023-09-30T22:24:45.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.664+0000 7ff2e14eb700 1 --2- 172.21.15.156:0/1229608734 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff2dc136960 0x7ff2dc138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:45.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.664+0000 7ff2e24ed700 1 --2- 172.21.15.156:0/1229608734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2dc139280 0x7ff2dc13b660 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4009dc0 tx=0x7ff2d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59942463b3731364 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:45.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.665+0000 7ff2e0cea700 1 -- 172.21.15.156:0/1229608734 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d400e070 con 0x7ff2dc139280 2023-09-30T22:24:45.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.665+0000 7ff2e0cea700 1 -- 172.21.15.156:0/1229608734 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d400bae0 con 0x7ff2dc139280 2023-09-30T22:24:45.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.665+0000 7ff2e0cea700 1 -- 172.21.15.156:0/1229608734 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d400be90 con 0x7ff2dc139280 2023-09-30T22:24:45.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.665+0000 7ff2e3f50700 1 -- 172.21.15.156:0/1229608734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2dc139280 msgr2=0x7ff2dc13b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.665+0000 7ff2e3f50700 1 --2- 172.21.15.156:0/1229608734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2dc139280 0x7ff2dc13b660 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4009dc0 tx=0x7ff2d400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:45.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.665+0000 7ff2e3f50700 1 -- 172.21.15.156:0/1229608734 shutdown_connections 2023-09-30T22:24:45.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.665+0000 7ff2e3f50700 1 --2- 172.21.15.156:0/1229608734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2dc139280 0x7ff2dc13b660 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.665+0000 7ff2e3f50700 1 --2- 172.21.15.156:0/1229608734 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff2dc136960 0x7ff2dc138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.665+0000 7ff2e3f50700 1 -- 172.21.15.156:0/1229608734 >> 172.21.15.156:0/1229608734 conn(0x7ff2dc099c40 msgr2=0x7ff2dc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:45.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.665+0000 7ff2e3f50700 1 -- 172.21.15.156:0/1229608734 shutdown_connections 2023-09-30T22:24:45.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.665+0000 7ff2e3f50700 1 -- 172.21.15.156:0/1229608734 wait complete. 2023-09-30T22:24:45.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.666+0000 7ff2e3f50700 1 Processor -- start 2023-09-30T22:24:45.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.666+0000 7ff2e3f50700 1 -- start start 2023-09-30T22:24:45.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.667+0000 7ff2e3f50700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2dc133ad0 0x7ff2dc12cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.667+0000 7ff2e3f50700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff2dc136960 0x7ff2dc12d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.667+0000 7ff2e3f50700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2dc139280 0x7ff2dc12d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.667+0000 7ff2e3f50700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc131830 con 0x7ff2dc133ad0 2023-09-30T22:24:45.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.667+0000 7ff2e3f50700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc09f390 con 0x7ff2dc139280 2023-09-30T22:24:45.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.667+0000 7ff2e3f50700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc072270 con 0x7ff2dc136960 2023-09-30T22:24:45.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.667+0000 7ff2e1cec700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2dc133ad0 0x7ff2dc12cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.667+0000 7ff2e14eb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff2dc136960 0x7ff2dc12d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.667+0000 7ff2e24ed700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2dc139280 0x7ff2dc12d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.667+0000 7ff2e14eb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff2dc136960 0x7ff2dc12d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46166/0 (socket says 172.21.15.156:46166) 2023-09-30T22:24:45.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.667+0000 7ff2e1cec700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2dc133ad0 0x7ff2dc12cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51984/0 (socket says 172.21.15.156:51984) 2023-09-30T22:24:45.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.667+0000 7ff2e14eb700 1 -- 172.21.15.156:0/106133803 learned_addr learned my addr 172.21.15.156:0/106133803 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:45.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.667+0000 7ff2e24ed700 1 -- 172.21.15.156:0/106133803 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff2dc136960 msgr2=0x7ff2dc12d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.667+0000 7ff2e24ed700 1 --2- 172.21.15.156:0/106133803 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff2dc136960 0x7ff2dc12d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.667+0000 7ff2e24ed700 1 -- 172.21.15.156:0/106133803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2dc133ad0 msgr2=0x7ff2dc12cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.667+0000 7ff2e24ed700 1 --2- 172.21.15.156:0/106133803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2dc133ad0 0x7ff2dc12cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.667+0000 7ff2e24ed700 1 -- 172.21.15.156:0/106133803 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d80094a0 con 0x7ff2dc139280 2023-09-30T22:24:45.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.667+0000 7ff2e1cec700 1 --2- 172.21.15.156:0/106133803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2dc133ad0 0x7ff2dc12cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:45.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.667+0000 7ff2e24ed700 1 --2- 172.21.15.156:0/106133803 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2dc139280 0x7ff2dc12d5b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4016000 tx=0x7ff2d4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:45.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.667+0000 7ff2d27fc700 1 -- 172.21.15.156:0/106133803 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d40045d0 con 0x7ff2dc139280 2023-09-30T22:24:45.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.667+0000 7ff2d27fc700 1 -- 172.21.15.156:0/106133803 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d4020070 con 0x7ff2dc139280 2023-09-30T22:24:45.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.667+0000 7ff2e3f50700 1 -- 172.21.15.156:0/106133803 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d4009a70 con 0x7ff2dc139280 2023-09-30T22:24:45.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.667+0000 7ff2d27fc700 1 -- 172.21.15.156:0/106133803 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4027480 con 0x7ff2dc139280 2023-09-30T22:24:45.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.667+0000 7ff2e3f50700 1 -- 172.21.15.156:0/106133803 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2dc070c90 con 0x7ff2dc139280 2023-09-30T22:24:45.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.668+0000 7ff2d27fc700 1 -- 172.21.15.156:0/106133803 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff2d4012430 con 0x7ff2dc139280 2023-09-30T22:24:45.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.668+0000 7ff2d27fc700 1 -- 172.21.15.156:0/106133803 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff2d4022070 con 0x7ff2dc139280 2023-09-30T22:24:45.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.668+0000 7ff2e3f50700 1 -- 172.21.15.156:0/106133803 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2dc06fe70 con 0x7ff2dc139280 2023-09-30T22:24:45.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.673+0000 7ff2d27fc700 1 -- 172.21.15.156:0/106133803 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff2d401b400 con 0x7ff2dc139280 2023-09-30T22:24:45.691 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:45.705 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:45.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.823+0000 7fe8e30b5700 1 Processor -- start 2023-09-30T22:24:45.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.823+0000 7fe8e30b5700 1 -- start start 2023-09-30T22:24:45.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.824+0000 7fe8e30b5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe8dc09e950 0x7fe8dc09ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.824+0000 7fe8e30b5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe8dc09f260 0x7fe8dc131890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.824+0000 7fe8e30b5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe8dc131dd0 0x7fe8dc132250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.824+0000 7fe8e30b5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8dc09b6d0 con 0x7fe8dc09e950 2023-09-30T22:24:45.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.824+0000 7fe8e30b5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc09afb0 con 0x7fe8dc09f260 2023-09-30T22:24:45.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.824+0000 7fe8e30b5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc0a0970 con 0x7fe8dc131dd0 2023-09-30T22:24:45.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.824+0000 7fe8e1652700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe8dc131dd0 0x7fe8dc132250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.824+0000 7fe8dbfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe8dc09f260 0x7fe8dc131890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.824+0000 7fe8e0e51700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe8dc09e950 0x7fe8dc09ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.824+0000 7fe8dbfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe8dc09f260 0x7fe8dc131890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38130/0 (socket says 172.21.15.156:38130) 2023-09-30T22:24:45.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.824+0000 7fe8e1652700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe8dc131dd0 0x7fe8dc132250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46172/0 (socket says 172.21.15.156:46172) 2023-09-30T22:24:45.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.824+0000 7fe8dbfff700 1 -- 172.21.15.156:0/4036039981 learned_addr learned my addr 172.21.15.156:0/4036039981 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:45.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.824+0000 7fe8e1652700 1 -- 172.21.15.156:0/4036039981 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe8dc09f260 msgr2=0x7fe8dc131890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:45.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.824+0000 7fe8e1652700 1 --2- 172.21.15.156:0/4036039981 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe8dc09f260 0x7fe8dc131890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.824+0000 7fe8e1652700 1 -- 172.21.15.156:0/4036039981 >> v2:172.21.15.156:3300/0 conn(0x7fe8dc09e950 msgr2=0x7fe8dc09ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:45.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.824+0000 7fe8e1652700 1 --2- 172.21.15.156:0/4036039981 >> v2:172.21.15.156:3300/0 conn(0x7fe8dc09e950 0x7fe8dc09ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.824+0000 7fe8e1652700 1 -- 172.21.15.156:0/4036039981 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8dc0a0320 con 0x7fe8dc131dd0 2023-09-30T22:24:45.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.824+0000 7fe8e0e51700 1 --2- 172.21.15.156:0/4036039981 >> v2:172.21.15.156:3300/0 conn(0x7fe8dc09e950 0x7fe8dc09ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:45.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.824+0000 7fe8e1652700 1 --2- 172.21.15.156:0/4036039981 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe8dc131dd0 0x7fe8dc132250 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009d90 tx=0x7fe8d400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d10c0da998946c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:45.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.825+0000 7fe8db7fe700 1 -- 172.21.15.156:0/4036039981 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d400e070 con 0x7fe8dc131dd0 2023-09-30T22:24:45.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.825+0000 7fe8db7fe700 1 -- 172.21.15.156:0/4036039981 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d400bb20 con 0x7fe8dc131dd0 2023-09-30T22:24:45.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.825+0000 7fe8db7fe700 1 -- 172.21.15.156:0/4036039981 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4012430 con 0x7fe8dc131dd0 2023-09-30T22:24:45.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.825+0000 7fe8e30b5700 1 -- 172.21.15.156:0/4036039981 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe8dc131dd0 msgr2=0x7fe8dc132250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.825+0000 7fe8e30b5700 1 --2- 172.21.15.156:0/4036039981 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe8dc131dd0 0x7fe8dc132250 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009d90 tx=0x7fe8d400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:45.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.825+0000 7fe8e30b5700 1 -- 172.21.15.156:0/4036039981 shutdown_connections 2023-09-30T22:24:45.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.825+0000 7fe8e30b5700 1 --2- 172.21.15.156:0/4036039981 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe8dc131dd0 0x7fe8dc132250 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.825+0000 7fe8e30b5700 1 --2- 172.21.15.156:0/4036039981 >> v2:172.21.15.156:3300/0 conn(0x7fe8dc09e950 0x7fe8dc09ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.825+0000 7fe8e30b5700 1 --2- 172.21.15.156:0/4036039981 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe8dc09f260 0x7fe8dc131890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.825+0000 7fe8e30b5700 1 -- 172.21.15.156:0/4036039981 >> 172.21.15.156:0/4036039981 conn(0x7fe8dc0a0f70 msgr2=0x7fe8dc0a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:45.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.825+0000 7fe8e30b5700 1 -- 172.21.15.156:0/4036039981 shutdown_connections 2023-09-30T22:24:45.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.825+0000 7fe8e30b5700 1 -- 172.21.15.156:0/4036039981 wait complete. 2023-09-30T22:24:45.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.826+0000 7fe8e30b5700 1 Processor -- start 2023-09-30T22:24:45.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.826+0000 7fe8e30b5700 1 -- start start 2023-09-30T22:24:45.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.827+0000 7fe8e30b5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe8dc09e950 0x7fe8dc1c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.827+0000 7fe8e30b5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe8dc09f260 0x7fe8dc1c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.827+0000 7fe8e30b5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8dc131dd0 0x7fe8dc1c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.827+0000 7fe8e30b5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc06d430 con 0x7fe8dc131dd0 2023-09-30T22:24:45.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.827+0000 7fe8e30b5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc1318d0 con 0x7fe8dc09e950 2023-09-30T22:24:45.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.827+0000 7fe8e30b5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc122340 con 0x7fe8dc09f260 2023-09-30T22:24:45.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.827+0000 7fe8e0e51700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe8dc09e950 0x7fe8dc1c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.827+0000 7fe8e0e51700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe8dc09e950 0x7fe8dc1c80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38132/0 (socket says 172.21.15.156:38132) 2023-09-30T22:24:45.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.827+0000 7fe8e0e51700 1 -- 172.21.15.156:0/2605154294 learned_addr learned my addr 172.21.15.156:0/2605154294 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:45.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.827+0000 7fe8e1652700 1 --2- 172.21.15.156:0/2605154294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8dc131dd0 0x7fe8dc1c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.827+0000 7fe8dbfff700 1 --2- 172.21.15.156:0/2605154294 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe8dc09f260 0x7fe8dc1c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.827+0000 7fe8e0e51700 1 -- 172.21.15.156:0/2605154294 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe8dc09f260 msgr2=0x7fe8dc1c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.827+0000 7fe8e0e51700 1 --2- 172.21.15.156:0/2605154294 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe8dc09f260 0x7fe8dc1c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.827+0000 7fe8e0e51700 1 -- 172.21.15.156:0/2605154294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8dc131dd0 msgr2=0x7fe8dc1c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.827+0000 7fe8e0e51700 1 --2- 172.21.15.156:0/2605154294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8dc131dd0 0x7fe8dc1c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.827+0000 7fe8e0e51700 1 -- 172.21.15.156:0/2605154294 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d0009430 con 0x7fe8dc09e950 2023-09-30T22:24:45.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.827+0000 7fe8e1652700 1 --2- 172.21.15.156:0/2605154294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8dc131dd0 0x7fe8dc1c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:45.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.828+0000 7fe8e0e51700 1 --2- 172.21.15.156:0/2605154294 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe8dc09e950 0x7fe8dc1c80a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000ebe0 tx=0x7fe8d000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:45.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.828+0000 7fe8d97fa700 1 -- 172.21.15.156:0/2605154294 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0005a20 con 0x7fe8dc09e950 2023-09-30T22:24:45.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.828+0000 7fe8d97fa700 1 -- 172.21.15.156:0/2605154294 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d0005b80 con 0x7fe8dc09e950 2023-09-30T22:24:45.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.828+0000 7fe8e30b5700 1 -- 172.21.15.156:0/2605154294 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d4009a70 con 0x7fe8dc09e950 2023-09-30T22:24:45.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.828+0000 7fe8d97fa700 1 -- 172.21.15.156:0/2605154294 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d000c850 con 0x7fe8dc09e950 2023-09-30T22:24:45.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.828+0000 7fe8e30b5700 1 -- 172.21.15.156:0/2605154294 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8dc09da40 con 0x7fe8dc09e950 2023-09-30T22:24:45.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.829+0000 7fe8d97fa700 1 -- 172.21.15.156:0/2605154294 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe8d000c9b0 con 0x7fe8dc09e950 2023-09-30T22:24:45.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.829+0000 7fe8d97fa700 1 -- 172.21.15.156:0/2605154294 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe8d0042220 con 0x7fe8dc09e950 2023-09-30T22:24:45.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.829+0000 7fe8e30b5700 1 -- 172.21.15.156:0/2605154294 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8dc121fe0 con 0x7fe8dc09e950 2023-09-30T22:24:45.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.834+0000 7fe8d97fa700 1 -- 172.21.15.156:0/2605154294 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe8d001a350 con 0x7fe8dc09e950 2023-09-30T22:24:45.836 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:45.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.869+0000 7f72f2022700 1 Processor -- start 2023-09-30T22:24:45.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.869+0000 7f72f2022700 1 -- start start 2023-09-30T22:24:45.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.870+0000 7f72f2022700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72ec09d860 0x7f72ec09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.870+0000 7f72f2022700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72ec09e170 0x7f72ec1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.870+0000 7f72f2022700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f72ec130ce0 0x7f72ec131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.870+0000 7f72f2022700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72ec09aaa0 con 0x7f72ec130ce0 2023-09-30T22:24:45.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.870+0000 7f72f2022700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec09f870 con 0x7f72ec09d860 2023-09-30T22:24:45.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.870+0000 7f72f2022700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec09b360 con 0x7f72ec09e170 2023-09-30T22:24:45.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.870+0000 7f72eb7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72ec09d860 0x7f72ec09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.870+0000 7f72eb7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72ec09d860 0x7f72ec09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38146/0 (socket says 172.21.15.156:38146) 2023-09-30T22:24:45.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.870+0000 7f72eb7fe700 1 -- 172.21.15.156:0/3269131223 learned_addr learned my addr 172.21.15.156:0/3269131223 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:45.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.870+0000 7f72eaffd700 1 --2- 172.21.15.156:0/3269131223 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72ec09e170 0x7f72ec1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.870+0000 7f72ebfff700 1 --2- 172.21.15.156:0/3269131223 >> v2:172.21.15.156:3300/0 conn(0x7f72ec130ce0 0x7f72ec131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.871+0000 7f72eb7fe700 1 -- 172.21.15.156:0/3269131223 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72ec09e170 msgr2=0x7f72ec1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:45.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.871+0000 7f72eb7fe700 1 --2- 172.21.15.156:0/3269131223 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72ec09e170 0x7f72ec1307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.871+0000 7f72eb7fe700 1 -- 172.21.15.156:0/3269131223 >> v2:172.21.15.156:3300/0 conn(0x7f72ec130ce0 msgr2=0x7f72ec131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:45.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.871+0000 7f72eb7fe700 1 --2- 172.21.15.156:0/3269131223 >> v2:172.21.15.156:3300/0 conn(0x7f72ec130ce0 0x7f72ec131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.871+0000 7f72eb7fe700 1 -- 172.21.15.156:0/3269131223 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ec09b620 con 0x7f72ec09d860 2023-09-30T22:24:45.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.871+0000 7f72eb7fe700 1 --2- 172.21.15.156:0/3269131223 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72ec09d860 0x7f72ec09dc30 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f72dc00bb90 tx=0x7f72dc00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6618dd99bc974bd7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:45.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.871+0000 7f72ea7fc700 1 -- 172.21.15.156:0/3269131223 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72dc00dc70 con 0x7f72ec09d860 2023-09-30T22:24:45.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.871+0000 7f72ea7fc700 1 -- 172.21.15.156:0/3269131223 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72dc00ddd0 con 0x7f72ec09d860 2023-09-30T22:24:45.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.871+0000 7f72ea7fc700 1 -- 172.21.15.156:0/3269131223 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72dc012990 con 0x7f72ec09d860 2023-09-30T22:24:45.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.872+0000 7f72f2022700 1 -- 172.21.15.156:0/3269131223 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72ec09d860 msgr2=0x7f72ec09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.872+0000 7f72f2022700 1 --2- 172.21.15.156:0/3269131223 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72ec09d860 0x7f72ec09dc30 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f72dc00bb90 tx=0x7f72dc00bea0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.872+0000 7f72f2022700 1 -- 172.21.15.156:0/3269131223 shutdown_connections 2023-09-30T22:24:45.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.872+0000 7f72f2022700 1 --2- 172.21.15.156:0/3269131223 >> v2:172.21.15.156:3300/0 conn(0x7f72ec130ce0 0x7f72ec131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.872+0000 7f72f2022700 1 --2- 172.21.15.156:0/3269131223 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72ec09d860 0x7f72ec09dc30 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.872+0000 7f72f2022700 1 --2- 172.21.15.156:0/3269131223 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72ec09e170 0x7f72ec1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.872+0000 7f72f2022700 1 -- 172.21.15.156:0/3269131223 >> 172.21.15.156:0/3269131223 conn(0x7f72ec099c40 msgr2=0x7f72ec0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:45.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.872+0000 7f72f2022700 1 -- 172.21.15.156:0/3269131223 shutdown_connections 2023-09-30T22:24:45.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.872+0000 7f72f2022700 1 -- 172.21.15.156:0/3269131223 wait complete. 2023-09-30T22:24:45.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.873+0000 7f72f2022700 1 Processor -- start 2023-09-30T22:24:45.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.873+0000 7f72f2022700 1 -- start start 2023-09-30T22:24:45.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.873+0000 7f72f2022700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72ec09d860 0x7f72ec11c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.873+0000 7f72f2022700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72ec09e170 0x7f72ec11c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.874+0000 7f72f2022700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72ec130ce0 0x7f72ec11ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.874+0000 7f72f2022700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec11d440 con 0x7f72ec130ce0 2023-09-30T22:24:45.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.874+0000 7f72f2022700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec11f800 con 0x7f72ec09e170 2023-09-30T22:24:45.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.874+0000 7f72f2022700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec0a2340 con 0x7f72ec09d860 2023-09-30T22:24:45.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.874+0000 7f72eaffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72ec09e170 0x7f72ec11c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.874+0000 7f72eaffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72ec09e170 0x7f72ec11c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38152/0 (socket says 172.21.15.156:38152) 2023-09-30T22:24:45.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.874+0000 7f72eaffd700 1 -- 172.21.15.156:0/1591499016 learned_addr learned my addr 172.21.15.156:0/1591499016 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:45.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.874+0000 7f72ebfff700 1 --2- 172.21.15.156:0/1591499016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72ec130ce0 0x7f72ec11ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.874+0000 7f72eb7fe700 1 --2- 172.21.15.156:0/1591499016 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72ec09d860 0x7f72ec11c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.874+0000 7f72eaffd700 1 -- 172.21.15.156:0/1591499016 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72ec09d860 msgr2=0x7f72ec11c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.874+0000 7f72eaffd700 1 --2- 172.21.15.156:0/1591499016 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72ec09d860 0x7f72ec11c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.874+0000 7f72eaffd700 1 -- 172.21.15.156:0/1591499016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72ec130ce0 msgr2=0x7f72ec11ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.874+0000 7f72eaffd700 1 --2- 172.21.15.156:0/1591499016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72ec130ce0 0x7f72ec11ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.874+0000 7f72eaffd700 1 -- 172.21.15.156:0/1591499016 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72dc00b7f0 con 0x7f72ec09e170 2023-09-30T22:24:45.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.874+0000 7f72eaffd700 1 --2- 172.21.15.156:0/1591499016 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72ec09e170 0x7f72ec11c540 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f72e000c480 tx=0x7f72e000c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:45.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.874+0000 7f72d3fff700 1 -- 172.21.15.156:0/1591499016 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e00161c0 con 0x7f72ec09e170 2023-09-30T22:24:45.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.874+0000 7f72d3fff700 1 -- 172.21.15.156:0/1591499016 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e0016320 con 0x7f72ec09e170 2023-09-30T22:24:45.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.874+0000 7f72f2022700 1 -- 172.21.15.156:0/1591499016 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72ec09c8b0 con 0x7f72ec09e170 2023-09-30T22:24:45.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.874+0000 7f72f2022700 1 -- 172.21.15.156:0/1591499016 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72ec11ee20 con 0x7f72ec09e170 2023-09-30T22:24:45.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.875+0000 7ff2e3f50700 1 -- 172.21.15.156:0/106133803 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff2dc04f2a0 con 0x7ff2dc139280 2023-09-30T22:24:45.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.875+0000 7f72d3fff700 1 -- 172.21.15.156:0/1591499016 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e00166d0 con 0x7f72ec09e170 2023-09-30T22:24:45.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.875+0000 7f72d3fff700 1 -- 172.21.15.156:0/1591499016 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f72e0016830 con 0x7f72ec09e170 2023-09-30T22:24:45.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.876+0000 7ff2d27fc700 1 -- 172.21.15.156:0/106133803 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff2d402c020 con 0x7ff2dc139280 2023-09-30T22:24:45.878 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:45.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.876+0000 7f72d3fff700 1 -- 172.21.15.156:0/1591499016 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f72e003ef20 con 0x7f72ec09e170 2023-09-30T22:24:45.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.876+0000 7f72f2022700 1 -- 172.21.15.156:0/1591499016 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72cc0052e0 con 0x7f72ec09e170 2023-09-30T22:24:45.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.878+0000 7ff2e3f50700 1 -- 172.21.15.156:0/106133803 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2dc139280 msgr2=0x7ff2dc12d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.878+0000 7ff2e3f50700 1 --2- 172.21.15.156:0/106133803 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2dc139280 0x7ff2dc12d5b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4016000 tx=0x7ff2d4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.878+0000 7ff2e3f50700 1 -- 172.21.15.156:0/106133803 shutdown_connections 2023-09-30T22:24:45.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.878+0000 7ff2e3f50700 1 --2- 172.21.15.156:0/106133803 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff2dc139280 0x7ff2dc12d5b0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.878+0000 7ff2e3f50700 1 --2- 172.21.15.156:0/106133803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2dc133ad0 0x7ff2dc12cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.878+0000 7ff2e3f50700 1 --2- 172.21.15.156:0/106133803 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff2dc136960 0x7ff2dc12d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.878+0000 7ff2e3f50700 1 -- 172.21.15.156:0/106133803 >> 172.21.15.156:0/106133803 conn(0x7ff2dc099c40 msgr2=0x7ff2dc1385e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:45.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.880+0000 7ff2e3f50700 1 -- 172.21.15.156:0/106133803 shutdown_connections 2023-09-30T22:24:45.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.881+0000 7ff2e3f50700 1 -- 172.21.15.156:0/106133803 wait complete. 2023-09-30T22:24:45.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.881+0000 7f72d3fff700 1 -- 172.21.15.156:0/1591499016 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f72e001c270 con 0x7f72ec09e170 2023-09-30T22:24:45.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:45.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.965+0000 7f9fc766a700 1 Processor -- start 2023-09-30T22:24:45.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.965+0000 7f9fc766a700 1 -- start start 2023-09-30T22:24:45.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.966+0000 7f9fc766a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fc009ad40 0x7f9fc0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.966+0000 7f9fc766a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fc0133f70 0x7f9fc01343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.966+0000 7f9fc766a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc009b110 con 0x7f9fc00a0a70 2023-09-30T22:24:45.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.966+0000 7f9fc766a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc00a3b60 con 0x7f9fc0133f70 2023-09-30T22:24:45.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.966+0000 7f9fc766a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc01348e0 con 0x7f9fc009ad40 2023-09-30T22:24:45.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.966+0000 7f9fc5406700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fc009ad40 0x7f9fc0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.966+0000 7f9fc4c05700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fc0133f70 0x7f9fc01343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.966+0000 7f9fc5406700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fc009ad40 0x7f9fc0133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46204/0 (socket says 172.21.15.156:46204) 2023-09-30T22:24:45.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.966+0000 7f9fc5c07700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f9fc00a0a70 0x7f9fc00a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37876/0 (socket says 172.21.15.156:37876) 2023-09-30T22:24:45.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.966+0000 7f9fc4c05700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fc0133f70 0x7f9fc01343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38162/0 (socket says 172.21.15.156:38162) 2023-09-30T22:24:45.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.966+0000 7f9fc5406700 1 -- 172.21.15.156:0/2432949463 learned_addr learned my addr 172.21.15.156:0/2432949463 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:45.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.966+0000 7f9fc5406700 1 -- 172.21.15.156:0/2432949463 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fc0133f70 msgr2=0x7f9fc01343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:45.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.966+0000 7f9fc5406700 1 --2- 172.21.15.156:0/2432949463 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fc0133f70 0x7f9fc01343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.966+0000 7f9fc5406700 1 -- 172.21.15.156:0/2432949463 >> v1:172.21.15.156:6789/0 conn(0x7f9fc00a0a70 legacy=0x7f9fc00a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.966+0000 7f9fb7fff700 1 -- 172.21.15.156:0/2432949463 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211934704 0 0) 0x7f9fc009b110 con 0x7f9fc00a0a70 2023-09-30T22:24:45.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.966+0000 7f9fc5406700 1 -- 172.21.15.156:0/2432949463 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc00a2fa0 con 0x7f9fc009ad40 2023-09-30T22:24:45.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.966+0000 7f9fc4c05700 1 --2- 172.21.15.156:0/2432949463 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fc0133f70 0x7f9fc01343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:45.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.966+0000 7f9fc5406700 1 --2- 172.21.15.156:0/2432949463 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fc009ad40 0x7f9fc0133a30 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc009920 tx=0x7f9fbc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c45fce48ca441460 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:45.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.967+0000 7f9fb7fff700 1 -- 172.21.15.156:0/2432949463 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc011830 con 0x7f9fc009ad40 2023-09-30T22:24:45.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.967+0000 7f9fb7fff700 1 -- 172.21.15.156:0/2432949463 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fbc011990 con 0x7f9fc009ad40 2023-09-30T22:24:45.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.967+0000 7f9fb7fff700 1 -- 172.21.15.156:0/2432949463 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc011d20 con 0x7f9fc009ad40 2023-09-30T22:24:45.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.967+0000 7f9fc766a700 1 -- 172.21.15.156:0/2432949463 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fc009ad40 msgr2=0x7f9fc0133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.967+0000 7f9fc766a700 1 --2- 172.21.15.156:0/2432949463 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fc009ad40 0x7f9fc0133a30 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc009920 tx=0x7f9fbc009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:45.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.967+0000 7f9fc766a700 1 -- 172.21.15.156:0/2432949463 shutdown_connections 2023-09-30T22:24:45.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.967+0000 7f9fc766a700 1 --2- 172.21.15.156:0/2432949463 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fc009ad40 0x7f9fc0133a30 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.967+0000 7f9fc766a700 1 --2- 172.21.15.156:0/2432949463 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fc0133f70 0x7f9fc01343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.967+0000 7f9fc766a700 1 -- 172.21.15.156:0/2432949463 >> 172.21.15.156:0/2432949463 conn(0x7f9fc0099c40 msgr2=0x7f9fc006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:45.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.967+0000 7f9fc766a700 1 -- 172.21.15.156:0/2432949463 shutdown_connections 2023-09-30T22:24:45.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.967+0000 7f9fc766a700 1 -- 172.21.15.156:0/2432949463 wait complete. 2023-09-30T22:24:45.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.968+0000 7f9fc766a700 1 Processor -- start 2023-09-30T22:24:45.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.968+0000 7f9fc766a700 1 -- start start 2023-09-30T22:24:45.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.969+0000 7f9fc766a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fc009ad40 0x7f9fc011f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.969+0000 7f9fc766a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fc00a0a70 0x7f9fc011fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.969+0000 7f9fc766a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fc0133f70 0x7f9fc01c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.969+0000 7f9fc766a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc0122490 con 0x7f9fc0133f70 2023-09-30T22:24:45.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.969+0000 7f9fc766a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc0122670 con 0x7f9fc00a0a70 2023-09-30T22:24:45.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.969+0000 7f9fc766a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc01334e0 con 0x7f9fc009ad40 2023-09-30T22:24:45.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.969+0000 7f9fc4c05700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fc00a0a70 0x7f9fc011fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.969+0000 7f9fc4c05700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fc00a0a70 0x7f9fc011fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38176/0 (socket says 172.21.15.156:38176) 2023-09-30T22:24:45.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.969+0000 7f9fc4c05700 1 -- 172.21.15.156:0/3403999564 learned_addr learned my addr 172.21.15.156:0/3403999564 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:45.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.969+0000 7f9fc5c07700 1 --2- 172.21.15.156:0/3403999564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fc0133f70 0x7f9fc01c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.969+0000 7f9fc5406700 1 --2- 172.21.15.156:0/3403999564 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fc009ad40 0x7f9fc011f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.969+0000 7f9fc4c05700 1 -- 172.21.15.156:0/3403999564 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fc009ad40 msgr2=0x7f9fc011f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.969+0000 7f9fc4c05700 1 --2- 172.21.15.156:0/3403999564 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fc009ad40 0x7f9fc011f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.969+0000 7f9fc4c05700 1 -- 172.21.15.156:0/3403999564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fc0133f70 msgr2=0x7f9fc01c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.969+0000 7f9fc4c05700 1 --2- 172.21.15.156:0/3403999564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fc0133f70 0x7f9fc01c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.969+0000 7f9fc4c05700 1 -- 172.21.15.156:0/3403999564 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb00094a0 con 0x7f9fc00a0a70 2023-09-30T22:24:45.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.969+0000 7f9fc5406700 1 --2- 172.21.15.156:0/3403999564 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fc009ad40 0x7f9fc011f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:45.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.969+0000 7f9fc4c05700 1 --2- 172.21.15.156:0/3403999564 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fc00a0a70 0x7f9fc011fa60 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9fb000ebb0 tx=0x7f9fb000eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:45.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.970+0000 7f9fb5ffb700 1 -- 172.21.15.156:0/3403999564 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb000c850 con 0x7f9fc00a0a70 2023-09-30T22:24:45.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.970+0000 7f9fb5ffb700 1 -- 172.21.15.156:0/3403999564 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb000c9b0 con 0x7f9fc00a0a70 2023-09-30T22:24:45.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.970+0000 7f9fc766a700 1 -- 172.21.15.156:0/3403999564 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fbc009550 con 0x7f9fc00a0a70 2023-09-30T22:24:45.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.970+0000 7f9fb5ffb700 1 -- 172.21.15.156:0/3403999564 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb000cd40 con 0x7f9fc00a0a70 2023-09-30T22:24:45.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.970+0000 7f9fc766a700 1 -- 172.21.15.156:0/3403999564 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc009c7e0 con 0x7f9fc00a0a70 2023-09-30T22:24:45.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.971+0000 7f9fb5ffb700 1 -- 172.21.15.156:0/3403999564 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9fb0013470 con 0x7f9fc00a0a70 2023-09-30T22:24:45.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.971+0000 7f9fc766a700 1 -- 172.21.15.156:0/3403999564 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc004f2a0 con 0x7f9fc00a0a70 2023-09-30T22:24:45.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.971+0000 7f9fb5ffb700 1 -- 172.21.15.156:0/3403999564 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9fb003f930 con 0x7f9fc00a0a70 2023-09-30T22:24:45.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:45.976+0000 7f9fb5ffb700 1 -- 172.21.15.156:0/3403999564 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9fb00232f0 con 0x7f9fc00a0a70 2023-09-30T22:24:46.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.038+0000 7fe8e30b5700 1 -- 172.21.15.156:0/2605154294 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe8dc04f2a0 con 0x7fe8dc09e950 2023-09-30T22:24:46.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.039+0000 7fe8d97fa700 1 -- 172.21.15.156:0/2605154294 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe8d0032090 con 0x7fe8dc09e950 2023-09-30T22:24:46.039 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:46.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.042+0000 7fe8e30b5700 1 -- 172.21.15.156:0/2605154294 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe8dc09e950 msgr2=0x7fe8dc1c80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:46.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.042+0000 7fe8e30b5700 1 --2- 172.21.15.156:0/2605154294 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe8dc09e950 0x7fe8dc1c80a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000ebe0 tx=0x7fe8d000eef0 comp rx=0 tx=0).stop 2023-09-30T22:24:46.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.042+0000 7fe8e30b5700 1 -- 172.21.15.156:0/2605154294 shutdown_connections 2023-09-30T22:24:46.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.042+0000 7fe8e30b5700 1 --2- 172.21.15.156:0/2605154294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8dc131dd0 0x7fe8dc1c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:46.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.042+0000 7fe8e30b5700 1 --2- 172.21.15.156:0/2605154294 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe8dc09e950 0x7fe8dc1c80a0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:46.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.042+0000 7fe8e30b5700 1 --2- 172.21.15.156:0/2605154294 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe8dc09f260 0x7fe8dc1c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:46.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.042+0000 7fe8e30b5700 1 -- 172.21.15.156:0/2605154294 >> 172.21.15.156:0/2605154294 conn(0x7fe8dc0a0f70 msgr2=0x7fe8dc1b99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:46.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.042+0000 7fe8e30b5700 1 -- 172.21.15.156:0/2605154294 shutdown_connections 2023-09-30T22:24:46.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.042+0000 7fe8e30b5700 1 -- 172.21.15.156:0/2605154294 wait complete. 2023-09-30T22:24:46.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:46.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.086+0000 7f72f2022700 1 -- 172.21.15.156:0/1591499016 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f72cc005590 con 0x7f72ec09e170 2023-09-30T22:24:46.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.086+0000 7f72d3fff700 1 -- 172.21.15.156:0/1591499016 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f72e0016020 con 0x7f72ec09e170 2023-09-30T22:24:46.087 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:46.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.088+0000 7f72f2022700 1 -- 172.21.15.156:0/1591499016 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72ec09e170 msgr2=0x7f72ec11c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:46.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.088+0000 7f72f2022700 1 --2- 172.21.15.156:0/1591499016 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72ec09e170 0x7f72ec11c540 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f72e000c480 tx=0x7f72e000c790 comp rx=0 tx=0).stop 2023-09-30T22:24:46.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.089+0000 7f72f2022700 1 -- 172.21.15.156:0/1591499016 shutdown_connections 2023-09-30T22:24:46.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.089+0000 7f72f2022700 1 --2- 172.21.15.156:0/1591499016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72ec130ce0 0x7f72ec11ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:46.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.089+0000 7f72f2022700 1 --2- 172.21.15.156:0/1591499016 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72ec09d860 0x7f72ec11c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:46.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.089+0000 7f72f2022700 1 --2- 172.21.15.156:0/1591499016 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72ec09e170 0x7f72ec11c540 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:46.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.089+0000 7f72f2022700 1 -- 172.21.15.156:0/1591499016 >> 172.21.15.156:0/1591499016 conn(0x7f72ec099c40 msgr2=0x7f72ec1300a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:46.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.089+0000 7f72f2022700 1 -- 172.21.15.156:0/1591499016 shutdown_connections 2023-09-30T22:24:46.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.089+0000 7f72f2022700 1 -- 172.21.15.156:0/1591499016 wait complete. 2023-09-30T22:24:46.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:46.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.166+0000 7f9fc766a700 1 -- 172.21.15.156:0/3403999564 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9fc0120f50 con 0x7f9fc00a0a70 2023-09-30T22:24:46.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.167+0000 7f9fb5ffb700 1 -- 172.21.15.156:0/3403999564 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9fb0021030 con 0x7f9fc00a0a70 2023-09-30T22:24:46.168 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:46.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.169+0000 7f9fc766a700 1 -- 172.21.15.156:0/3403999564 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fc00a0a70 msgr2=0x7f9fc011fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:46.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.169+0000 7f9fc766a700 1 --2- 172.21.15.156:0/3403999564 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fc00a0a70 0x7f9fc011fa60 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9fb000ebb0 tx=0x7f9fb000eec0 comp rx=0 tx=0).stop 2023-09-30T22:24:46.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.169+0000 7f9fc766a700 1 -- 172.21.15.156:0/3403999564 shutdown_connections 2023-09-30T22:24:46.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.169+0000 7f9fc766a700 1 --2- 172.21.15.156:0/3403999564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fc0133f70 0x7f9fc01c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:46.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.169+0000 7f9fc766a700 1 --2- 172.21.15.156:0/3403999564 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9fc009ad40 0x7f9fc011f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:46.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.169+0000 7f9fc766a700 1 --2- 172.21.15.156:0/3403999564 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9fc00a0a70 0x7f9fc011fa60 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:46.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.169+0000 7f9fc766a700 1 -- 172.21.15.156:0/3403999564 >> 172.21.15.156:0/3403999564 conn(0x7f9fc0099c40 msgr2=0x7f9fc009d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:46.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.169+0000 7f9fc766a700 1 -- 172.21.15.156:0/3403999564 shutdown_connections 2023-09-30T22:24:46.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:46.169+0000 7f9fc766a700 1 -- 172.21.15.156:0/3403999564 wait complete. 2023-09-30T22:24:46.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:46.895 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:47.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.020+0000 7f1ba229c700 1 Processor -- start 2023-09-30T22:24:47.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.020+0000 7f1ba229c700 1 -- start start 2023-09-30T22:24:47.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.020+0000 7f1ba229c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b9c09d860 0x7f1b9c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.020+0000 7f1ba229c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1b9c130eb0 0x7f1b9c138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.020+0000 7f1ba229c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b9c09aaa0 con 0x7f1b9c09e170 2023-09-30T22:24:47.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.020+0000 7f1ba229c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b9c09f870 con 0x7f1b9c130eb0 2023-09-30T22:24:47.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.020+0000 7f1ba229c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c09b360 con 0x7f1b9c09d860 2023-09-30T22:24:47.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.021+0000 7f1ba0839700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1b9c130eb0 0x7f1b9c138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.021+0000 7f1b9bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b9c09d860 0x7f1b9c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.021+0000 7f1ba0839700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1b9c130eb0 0x7f1b9c138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52028/0 (socket says 172.21.15.156:52028) 2023-09-30T22:24:47.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.021+0000 7f1ba0839700 1 -- 172.21.15.156:0/2894539395 learned_addr learned my addr 172.21.15.156:0/2894539395 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:47.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.021+0000 7f1b9bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b9c09d860 0x7f1b9c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38180/0 (socket says 172.21.15.156:38180) 2023-09-30T22:24:47.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.021+0000 7f1b9b7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f1b9c09e170 0x7f1b9c1307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37880/0 (socket says 172.21.15.156:37880) 2023-09-30T22:24:47.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.021+0000 7f1ba0839700 1 -- 172.21.15.156:0/2894539395 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b9c09d860 msgr2=0x7f1b9c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:47.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.021+0000 7f1ba0839700 1 --2- 172.21.15.156:0/2894539395 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b9c09d860 0x7f1b9c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.021+0000 7f1ba0839700 1 -- 172.21.15.156:0/2894539395 >> v1:172.21.15.156:6789/0 conn(0x7f1b9c09e170 legacy=0x7f1b9c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.021+0000 7f1ba0839700 1 -- 172.21.15.156:0/2894539395 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9c09b620 con 0x7f1b9c130eb0 2023-09-30T22:24:47.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.021+0000 7f1b9affd700 1 -- 172.21.15.156:0/2894539395 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1547389980 0 0) 0x7f1b9c09aaa0 con 0x7f1b9c09e170 2023-09-30T22:24:47.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.021+0000 7f1b9bfff700 1 --2- 172.21.15.156:0/2894539395 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b9c09d860 0x7f1b9c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:47.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.021+0000 7f1ba0839700 1 --2- 172.21.15.156:0/2894539395 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b9c130eb0 0x7f1b9c138a00 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f1b94009e50 tx=0x7f1b9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0184202d0cd5fb0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:47.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.021+0000 7f1b9affd700 1 -- 172.21.15.156:0/2894539395 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9400e070 con 0x7f1b9c130eb0 2023-09-30T22:24:47.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.021+0000 7f1b9affd700 1 -- 172.21.15.156:0/2894539395 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9400b910 con 0x7f1b9c130eb0 2023-09-30T22:24:47.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.021+0000 7f1b9affd700 1 -- 172.21.15.156:0/2894539395 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9400bcc0 con 0x7f1b9c130eb0 2023-09-30T22:24:47.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.022+0000 7f1ba229c700 1 -- 172.21.15.156:0/2894539395 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b9c130eb0 msgr2=0x7f1b9c138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.022+0000 7f1ba229c700 1 --2- 172.21.15.156:0/2894539395 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b9c130eb0 0x7f1b9c138a00 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f1b94009e50 tx=0x7f1b9400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:47.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.022+0000 7f1ba229c700 1 -- 172.21.15.156:0/2894539395 shutdown_connections 2023-09-30T22:24:47.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.022+0000 7f1ba229c700 1 --2- 172.21.15.156:0/2894539395 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b9c130eb0 0x7f1b9c138a00 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.022+0000 7f1ba229c700 1 --2- 172.21.15.156:0/2894539395 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b9c09d860 0x7f1b9c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.022+0000 7f1ba229c700 1 -- 172.21.15.156:0/2894539395 >> 172.21.15.156:0/2894539395 conn(0x7f1b9c099c40 msgr2=0x7f1b9c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:47.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.022+0000 7f1ba229c700 1 -- 172.21.15.156:0/2894539395 shutdown_connections 2023-09-30T22:24:47.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.022+0000 7f1ba229c700 1 -- 172.21.15.156:0/2894539395 wait complete. 2023-09-30T22:24:47.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.023+0000 7f1ba229c700 1 Processor -- start 2023-09-30T22:24:47.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.023+0000 7f1ba229c700 1 -- start start 2023-09-30T22:24:47.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.023+0000 7f1ba229c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b9c09d860 0x7f1b9c11e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.023+0000 7f1ba229c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b9c09e170 0x7f1b9c11e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.023+0000 7f1ba229c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b9c130eb0 0x7f1b9c11eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.023+0000 7f1ba229c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c120cf0 con 0x7f1b9c09e170 2023-09-30T22:24:47.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.023+0000 7f1ba229c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c0a07b0 con 0x7f1b9c09d860 2023-09-30T22:24:47.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.023+0000 7f1ba229c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c09c8b0 con 0x7f1b9c130eb0 2023-09-30T22:24:47.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.023+0000 7f1b9b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b9c09e170 0x7f1b9c11e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.023+0000 7f1ba0839700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b9c130eb0 0x7f1b9c11eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.023+0000 7f1b9bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b9c09d860 0x7f1b9c11e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.023+0000 7f1b9b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b9c09e170 0x7f1b9c11e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52038/0 (socket says 172.21.15.156:52038) 2023-09-30T22:24:47.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.023+0000 7f1b9b7fe700 1 -- 172.21.15.156:0/1881097536 learned_addr learned my addr 172.21.15.156:0/1881097536 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:47.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.024+0000 7f1b9b7fe700 1 -- 172.21.15.156:0/1881097536 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b9c130eb0 msgr2=0x7f1b9c11eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.024+0000 7f1b9b7fe700 1 --2- 172.21.15.156:0/1881097536 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b9c130eb0 0x7f1b9c11eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.024+0000 7f1b9b7fe700 1 -- 172.21.15.156:0/1881097536 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b9c09d860 msgr2=0x7f1b9c11e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.024+0000 7f1b9b7fe700 1 --2- 172.21.15.156:0/1881097536 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b9c09d860 0x7f1b9c11e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.024+0000 7f1b9b7fe700 1 -- 172.21.15.156:0/1881097536 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9000b740 con 0x7f1b9c09e170 2023-09-30T22:24:47.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.024+0000 7f1b9bfff700 1 --2- 172.21.15.156:0/1881097536 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b9c09d860 0x7f1b9c11e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:47.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.024+0000 7f1b9b7fe700 1 --2- 172.21.15.156:0/1881097536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b9c09e170 0x7f1b9c11e960 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c001eb0 tx=0x7f1b8c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:47.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.024+0000 7f1b98ff9700 1 -- 172.21.15.156:0/1881097536 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c004c80 con 0x7f1b9c09e170 2023-09-30T22:24:47.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.024+0000 7f1b98ff9700 1 -- 172.21.15.156:0/1881097536 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8c004de0 con 0x7f1b9c09e170 2023-09-30T22:24:47.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.024+0000 7f1ba229c700 1 -- 172.21.15.156:0/1881097536 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b94009b30 con 0x7f1b9c09e170 2023-09-30T22:24:47.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.024+0000 7f1b98ff9700 1 -- 172.21.15.156:0/1881097536 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c007310 con 0x7f1b9c09e170 2023-09-30T22:24:47.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.024+0000 7f1ba229c700 1 -- 172.21.15.156:0/1881097536 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b9c11f810 con 0x7f1b9c09e170 2023-09-30T22:24:47.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.025+0000 7f1b98ff9700 1 -- 172.21.15.156:0/1881097536 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1b8c007470 con 0x7f1b9c09e170 2023-09-30T22:24:47.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.025+0000 7f1b98ff9700 1 -- 172.21.15.156:0/1881097536 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1b8c03f290 con 0x7f1b9c09e170 2023-09-30T22:24:47.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.025+0000 7f1ba229c700 1 -- 172.21.15.156:0/1881097536 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b9c04f2a0 con 0x7f1b9c09e170 2023-09-30T22:24:47.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.030+0000 7f1b98ff9700 1 -- 172.21.15.156:0/1881097536 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1b8c0123b0 con 0x7f1b9c09e170 2023-09-30T22:24:47.060 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:47.102 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:47.183 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:47.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.186+0000 7f5c92de0700 1 Processor -- start 2023-09-30T22:24:47.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.186+0000 7f5c92de0700 1 -- start start 2023-09-30T22:24:47.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.186+0000 7f5c92de0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5c8c09e870 0x7f5c8c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.186+0000 7f5c92de0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c8c09f180 0x7f5c8c133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.186+0000 7f5c92de0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c8c134160 0x7f5c8c1345e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.186+0000 7f5c92de0700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c8c0a0370 con 0x7f5c8c09e870 2023-09-30T22:24:47.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.186+0000 7f5c92de0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c09fa00 con 0x7f5c8c09f180 2023-09-30T22:24:47.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.186+0000 7f5c92de0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c09ada0 con 0x7f5c8c134160 2023-09-30T22:24:47.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.186+0000 7f5c8bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c8c09f180 0x7f5c8c133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.186+0000 7f5c8bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c8c09f180 0x7f5c8c133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38198/0 (socket says 172.21.15.156:38198) 2023-09-30T22:24:47.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.186+0000 7f5c90b7c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5c8c09e870 0x7f5c8c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.186+0000 7f5c8bfff700 1 -- 172.21.15.156:0/318302865 learned_addr learned my addr 172.21.15.156:0/318302865 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:47.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.187+0000 7f5c9137d700 1 --2- 172.21.15.156:0/318302865 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c8c134160 0x7f5c8c1345e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.187+0000 7f5c8bfff700 1 -- 172.21.15.156:0/318302865 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c8c134160 msgr2=0x7f5c8c1345e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:47.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.187+0000 7f5c8bfff700 1 --2- 172.21.15.156:0/318302865 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c8c134160 0x7f5c8c1345e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.187+0000 7f5c8bfff700 1 -- 172.21.15.156:0/318302865 >> v2:172.21.15.156:3300/0 conn(0x7f5c8c09e870 msgr2=0x7f5c8c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:47.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.187+0000 7f5c8bfff700 1 --2- 172.21.15.156:0/318302865 >> v2:172.21.15.156:3300/0 conn(0x7f5c8c09e870 0x7f5c8c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.187+0000 7f5c8bfff700 1 -- 172.21.15.156:0/318302865 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8c06bec0 con 0x7f5c8c09f180 2023-09-30T22:24:47.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.187+0000 7f5c8bfff700 1 --2- 172.21.15.156:0/318302865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c8c09f180 0x7f5c8c133c20 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5c780098f0 tx=0x7f5c78009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fa9b5c9ff154c85 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:47.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.187+0000 7f5c8b7fe700 1 -- 172.21.15.156:0/318302865 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c78011830 con 0x7f5c8c09f180 2023-09-30T22:24:47.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.187+0000 7f5c8b7fe700 1 -- 172.21.15.156:0/318302865 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c78011990 con 0x7f5c8c09f180 2023-09-30T22:24:47.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.187+0000 7f5c8b7fe700 1 -- 172.21.15.156:0/318302865 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c78011d20 con 0x7f5c8c09f180 2023-09-30T22:24:47.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.188+0000 7f5c92de0700 1 -- 172.21.15.156:0/318302865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c8c09f180 msgr2=0x7f5c8c133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.188+0000 7f5c92de0700 1 --2- 172.21.15.156:0/318302865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c8c09f180 0x7f5c8c133c20 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5c780098f0 tx=0x7f5c78009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:47.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.188+0000 7f5c92de0700 1 -- 172.21.15.156:0/318302865 shutdown_connections 2023-09-30T22:24:47.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.188+0000 7f5c92de0700 1 --2- 172.21.15.156:0/318302865 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c8c134160 0x7f5c8c1345e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.188+0000 7f5c92de0700 1 --2- 172.21.15.156:0/318302865 >> v2:172.21.15.156:3300/0 conn(0x7f5c8c09e870 0x7f5c8c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.188+0000 7f5c92de0700 1 --2- 172.21.15.156:0/318302865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c8c09f180 0x7f5c8c133c20 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.188+0000 7f5c92de0700 1 -- 172.21.15.156:0/318302865 >> 172.21.15.156:0/318302865 conn(0x7f5c8c0a4430 msgr2=0x7f5c8c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:47.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.188+0000 7f5c92de0700 1 -- 172.21.15.156:0/318302865 shutdown_connections 2023-09-30T22:24:47.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.188+0000 7f5c92de0700 1 -- 172.21.15.156:0/318302865 wait complete. 2023-09-30T22:24:47.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.189+0000 7f5c92de0700 1 Processor -- start 2023-09-30T22:24:47.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.189+0000 7f5c92de0700 1 -- start start 2023-09-30T22:24:47.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.190+0000 7f5c92de0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c8c09e870 0x7f5c8c11f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.190+0000 7f5c92de0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c8c09f180 0x7f5c8c11fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.190+0000 7f5c92de0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c8c134160 0x7f5c8c11ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.190+0000 7f5c92de0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c122cb0 con 0x7f5c8c134160 2023-09-30T22:24:47.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.190+0000 7f5c92de0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c06cfa0 con 0x7f5c8c09e870 2023-09-30T22:24:47.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.190+0000 7f5c92de0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c121190 con 0x7f5c8c09f180 2023-09-30T22:24:47.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.190+0000 7f5c90b7c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c8c09e870 0x7f5c8c11f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.190+0000 7f5c90b7c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c8c09e870 0x7f5c8c11f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38208/0 (socket says 172.21.15.156:38208) 2023-09-30T22:24:47.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.190+0000 7f5c90b7c700 1 -- 172.21.15.156:0/2106454200 learned_addr learned my addr 172.21.15.156:0/2106454200 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:47.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.190+0000 7f5c8bfff700 1 --2- 172.21.15.156:0/2106454200 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c8c09f180 0x7f5c8c11fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.191+0000 7f5c9137d700 1 --2- 172.21.15.156:0/2106454200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c8c134160 0x7f5c8c11ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.191+0000 7f5c8bfff700 1 -- 172.21.15.156:0/2106454200 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c8c09e870 msgr2=0x7f5c8c11f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.191+0000 7f5c8bfff700 1 --2- 172.21.15.156:0/2106454200 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c8c09e870 0x7f5c8c11f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.191+0000 7f5c8bfff700 1 -- 172.21.15.156:0/2106454200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c8c134160 msgr2=0x7f5c8c11ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.191+0000 7f5c8bfff700 1 --2- 172.21.15.156:0/2106454200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c8c134160 0x7f5c8c11ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.191+0000 7f5c8bfff700 1 -- 172.21.15.156:0/2106454200 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c78009550 con 0x7f5c8c09f180 2023-09-30T22:24:47.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.191+0000 7f5c90b7c700 1 --2- 172.21.15.156:0/2106454200 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c8c09e870 0x7f5c8c11f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:47.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.191+0000 7f5c9137d700 1 --2- 172.21.15.156:0/2106454200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c8c134160 0x7f5c8c11ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:24:47.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.191+0000 7f5c8bfff700 1 --2- 172.21.15.156:0/2106454200 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c8c09f180 0x7f5c8c11fa00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5c780098f0 tx=0x7f5c78004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:47.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.191+0000 7f5c897fa700 1 -- 172.21.15.156:0/2106454200 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c78004450 con 0x7f5c8c09f180 2023-09-30T22:24:47.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.191+0000 7f5c897fa700 1 -- 172.21.15.156:0/2106454200 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7801f070 con 0x7f5c8c09f180 2023-09-30T22:24:47.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.191+0000 7f5c897fa700 1 -- 172.21.15.156:0/2106454200 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c780038c0 con 0x7f5c8c09f180 2023-09-30T22:24:47.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.191+0000 7f5c92de0700 1 -- 172.21.15.156:0/2106454200 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c8c0a3cf0 con 0x7f5c8c09f180 2023-09-30T22:24:47.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.191+0000 7f5c92de0700 1 -- 172.21.15.156:0/2106454200 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c8c123490 con 0x7f5c8c09f180 2023-09-30T22:24:47.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.192+0000 7f5c92de0700 1 -- 172.21.15.156:0/2106454200 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c8c04f2a0 con 0x7f5c8c09f180 2023-09-30T22:24:47.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.192+0000 7f5c897fa700 1 -- 172.21.15.156:0/2106454200 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c78003a20 con 0x7f5c8c09f180 2023-09-30T22:24:47.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.192+0000 7f5c897fa700 1 -- 172.21.15.156:0/2106454200 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5c78021070 con 0x7f5c8c09f180 2023-09-30T22:24:47.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.198+0000 7f5c897fa700 1 -- 172.21.15.156:0/2106454200 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c780045b0 con 0x7f5c8c09f180 2023-09-30T22:24:47.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.228+0000 7f1ba229c700 1 -- 172.21.15.156:0/1881097536 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1b9c06c3b0 con 0x7f1b9c09e170 2023-09-30T22:24:47.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.228+0000 7f1b98ff9700 1 -- 172.21.15.156:0/1881097536 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1b8c011360 con 0x7f1b9c09e170 2023-09-30T22:24:47.229 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:47.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.230+0000 7f1ba229c700 1 -- 172.21.15.156:0/1881097536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b9c09e170 msgr2=0x7f1b9c11e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.230+0000 7f1ba229c700 1 --2- 172.21.15.156:0/1881097536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b9c09e170 0x7f1b9c11e960 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c001eb0 tx=0x7f1b8c00c800 comp rx=0 tx=0).stop 2023-09-30T22:24:47.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.230+0000 7f1ba229c700 1 -- 172.21.15.156:0/1881097536 shutdown_connections 2023-09-30T22:24:47.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.230+0000 7f1ba229c700 1 --2- 172.21.15.156:0/1881097536 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b9c130eb0 0x7f1b9c11eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.230+0000 7f1ba229c700 1 --2- 172.21.15.156:0/1881097536 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b9c09d860 0x7f1b9c11e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.230+0000 7f1ba229c700 1 --2- 172.21.15.156:0/1881097536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b9c09e170 0x7f1b9c11e960 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.230+0000 7f1ba229c700 1 -- 172.21.15.156:0/1881097536 >> 172.21.15.156:0/1881097536 conn(0x7f1b9c099c40 msgr2=0x7f1b9c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:47.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.230+0000 7f1ba229c700 1 -- 172.21.15.156:0/1881097536 shutdown_connections 2023-09-30T22:24:47.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.230+0000 7f1ba229c700 1 -- 172.21.15.156:0/1881097536 wait complete. 2023-09-30T22:24:47.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.231+0000 7fa29f2b0700 1 Processor -- start 2023-09-30T22:24:47.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.232+0000 7fa29f2b0700 1 -- start start 2023-09-30T22:24:47.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.232+0000 7fa29f2b0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa2980a0a30 0x7fa2980a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.232+0000 7fa29f2b0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2980a1340 0x7fa29812ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.232+0000 7fa29f2b0700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2980a1e70 con 0x7fa2981304a0 2023-09-30T22:24:47.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.232+0000 7fa29f2b0700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29809a720 con 0x7fa2980a0a30 2023-09-30T22:24:47.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.232+0000 7fa29f2b0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29809b300 con 0x7fa2980a1340 2023-09-30T22:24:47.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.233+0000 7fa29d84d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fa2981304a0 0x7fa2981371b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37884/0 (socket says 172.21.15.156:37884) 2023-09-30T22:24:47.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.233+0000 7fa29d04c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa2980a0a30 0x7fa2980a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.233+0000 7fa29d84d700 1 -- 172.21.15.156:0/1585007740 learned_addr learned my addr 172.21.15.156:0/1585007740 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:47.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.233+0000 7fa29d04c700 1 -- 172.21.15.156:0/1585007740 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2980a1340 msgr2=0x7fa29812ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:47.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.233+0000 7fa29d04c700 1 --2- 172.21.15.156:0/1585007740 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2980a1340 0x7fa29812ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.233+0000 7fa29d04c700 1 -- 172.21.15.156:0/1585007740 >> v1:172.21.15.156:6789/0 conn(0x7fa2981304a0 legacy=0x7fa2981371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.233+0000 7fa29d04c700 1 -- 172.21.15.156:0/1585007740 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29809abc0 con 0x7fa2980a0a30 2023-09-30T22:24:47.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.233+0000 7fa29d04c700 1 --2- 172.21.15.156:0/1585007740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2980a0a30 0x7fa2980a0e00 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fa294009820 tx=0x7fa294009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de5a232e661be88 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:47.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.236+0000 7fa28ffff700 1 -- 172.21.15.156:0/1585007740 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa294005e30 con 0x7fa2980a0a30 2023-09-30T22:24:47.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.236+0000 7fa28ffff700 1 -- 172.21.15.156:0/1585007740 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa294006030 con 0x7fa2980a0a30 2023-09-30T22:24:47.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.236+0000 7fa28ffff700 1 -- 172.21.15.156:0/1585007740 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2940063e0 con 0x7fa2980a0a30 2023-09-30T22:24:47.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.236+0000 7fa29f2b0700 1 -- 172.21.15.156:0/1585007740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2980a0a30 msgr2=0x7fa2980a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.236+0000 7fa29f2b0700 1 --2- 172.21.15.156:0/1585007740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2980a0a30 0x7fa2980a0e00 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fa294009820 tx=0x7fa294009b30 comp rx=0 tx=0).stop 2023-09-30T22:24:47.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.237+0000 7fa29f2b0700 1 -- 172.21.15.156:0/1585007740 shutdown_connections 2023-09-30T22:24:47.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.237+0000 7fa29f2b0700 1 --2- 172.21.15.156:0/1585007740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2980a0a30 0x7fa2980a0e00 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.237+0000 7fa29f2b0700 1 --2- 172.21.15.156:0/1585007740 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2980a1340 0x7fa29812ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.237+0000 7fa29f2b0700 1 -- 172.21.15.156:0/1585007740 >> 172.21.15.156:0/1585007740 conn(0x7fa2980a2980 msgr2=0x7fa2980a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:47.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.237+0000 7fa29f2b0700 1 -- 172.21.15.156:0/1585007740 shutdown_connections 2023-09-30T22:24:47.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.237+0000 7fa29f2b0700 1 -- 172.21.15.156:0/1585007740 wait complete. 2023-09-30T22:24:47.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.238+0000 7fa29f2b0700 1 Processor -- start 2023-09-30T22:24:47.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.238+0000 7fa29f2b0700 1 -- start start 2023-09-30T22:24:47.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.239+0000 7fa29f2b0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2980a0a30 0x7fa29812f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.239+0000 7fa29f2b0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2980a1340 0x7fa29812fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.239+0000 7fa29f2b0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2981304a0 0x7fa298139df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.239+0000 7fa29f2b0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa298137300 con 0x7fa2980a0a30 2023-09-30T22:24:47.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.239+0000 7fa29f2b0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa298138fc0 con 0x7fa2980a1340 2023-09-30T22:24:47.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.239+0000 7fa29f2b0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa29813bda0 con 0x7fa2981304a0 2023-09-30T22:24:47.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.239+0000 7fa29d84d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2981304a0 0x7fa298139df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.239+0000 7fa29d84d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2981304a0 0x7fa298139df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46232/0 (socket says 172.21.15.156:46232) 2023-09-30T22:24:47.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.239+0000 7fa29d84d700 1 -- 172.21.15.156:0/1139647082 learned_addr learned my addr 172.21.15.156:0/1139647082 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:47.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.239+0000 7fa29d04c700 1 --2- 172.21.15.156:0/1139647082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2980a0a30 0x7fa29812f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.240+0000 7fa29d84d700 1 -- 172.21.15.156:0/1139647082 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2980a1340 msgr2=0x7fa29812fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.240+0000 7fa29d84d700 1 --2- 172.21.15.156:0/1139647082 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2980a1340 0x7fa29812fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.240+0000 7fa29d84d700 1 -- 172.21.15.156:0/1139647082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2980a0a30 msgr2=0x7fa29812f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.240+0000 7fa29d84d700 1 --2- 172.21.15.156:0/1139647082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2980a0a30 0x7fa29812f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.240+0000 7fa29d84d700 1 -- 172.21.15.156:0/1139647082 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa294009430 con 0x7fa2981304a0 2023-09-30T22:24:47.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.240+0000 7fa29d84d700 1 --2- 172.21.15.156:0/1139647082 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2981304a0 0x7fa298139df0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fa29000cbf0 tx=0x7fa29000cf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:47.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.240+0000 7fa28dffb700 1 -- 172.21.15.156:0/1139647082 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29000ab10 con 0x7fa2981304a0 2023-09-30T22:24:47.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.240+0000 7fa28dffb700 1 -- 172.21.15.156:0/1139647082 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29000ac70 con 0x7fa2981304a0 2023-09-30T22:24:47.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.240+0000 7fa29f2b0700 1 -- 172.21.15.156:0/1139647082 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29809ae00 con 0x7fa2981304a0 2023-09-30T22:24:47.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.240+0000 7fa28dffb700 1 -- 172.21.15.156:0/1139647082 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa290012400 con 0x7fa2981304a0 2023-09-30T22:24:47.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.240+0000 7fa29f2b0700 1 -- 172.21.15.156:0/1139647082 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa29813b590 con 0x7fa2981304a0 2023-09-30T22:24:47.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.241+0000 7fa29f2b0700 1 -- 172.21.15.156:0/1139647082 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29809c8d0 con 0x7fa2981304a0 2023-09-30T22:24:47.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.242+0000 7fa28dffb700 1 -- 172.21.15.156:0/1139647082 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa29001b3b0 con 0x7fa2981304a0 2023-09-30T22:24:47.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.242+0000 7fa28dffb700 1 -- 172.21.15.156:0/1139647082 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa29003f350 con 0x7fa2981304a0 2023-09-30T22:24:47.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:47.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.248+0000 7fa28dffb700 1 -- 172.21.15.156:0/1139647082 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa2900192c0 con 0x7fa2981304a0 2023-09-30T22:24:47.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.314+0000 7fd8c9241700 1 Processor -- start 2023-09-30T22:24:47.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.314+0000 7fd8c9241700 1 -- start start 2023-09-30T22:24:47.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.315+0000 7fd8c9241700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8c40a0a70 0x7fd8c40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.315+0000 7fd8c9241700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8c40a1380 0x7fd8c4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.315+0000 7fd8c9241700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c409dc00 con 0x7fd8c4133f50 2023-09-30T22:24:47.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.315+0000 7fd8c9241700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c409ea60 con 0x7fd8c40a1380 2023-09-30T22:24:47.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.315+0000 7fd8c9241700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c409dec0 con 0x7fd8c40a0a70 2023-09-30T22:24:47.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.315+0000 7fd8c259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8c40a1380 0x7fd8c4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.315+0000 7fd8c2d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8c40a0a70 0x7fd8c40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.315+0000 7fd8c359e700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fd8c4133f50 0x7fd8c413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37890/0 (socket says 172.21.15.156:37890) 2023-09-30T22:24:47.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.315+0000 7fd8c359e700 1 -- 172.21.15.156:0/985422553 learned_addr learned my addr 172.21.15.156:0/985422553 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:47.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.315+0000 7fd8c2d9d700 1 -- 172.21.15.156:0/985422553 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8c40a1380 msgr2=0x7fd8c4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:47.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.315+0000 7fd8c2d9d700 1 --2- 172.21.15.156:0/985422553 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8c40a1380 0x7fd8c4133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.315+0000 7fd8c2d9d700 1 -- 172.21.15.156:0/985422553 >> v1:172.21.15.156:6789/0 conn(0x7fd8c4133f50 legacy=0x7fd8c413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.315+0000 7fd8c2d9d700 1 -- 172.21.15.156:0/985422553 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c409e6a0 con 0x7fd8c40a0a70 2023-09-30T22:24:47.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.315+0000 7fd8c1d9b700 1 -- 172.21.15.156:0/985422553 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902387464 0 0) 0x7fd8c409dc00 con 0x7fd8c4133f50 2023-09-30T22:24:47.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.316+0000 7fd8c2d9d700 1 --2- 172.21.15.156:0/985422553 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8c40a0a70 0x7fd8c40a0e40 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4009870 tx=0x7fd8b4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=295156f61103b2ca server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:47.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.316+0000 7fd8c1d9b700 1 -- 172.21.15.156:0/985422553 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4011830 con 0x7fd8c40a0a70 2023-09-30T22:24:47.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.316+0000 7fd8c1d9b700 1 -- 172.21.15.156:0/985422553 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b4011990 con 0x7fd8c40a0a70 2023-09-30T22:24:47.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.316+0000 7fd8c1d9b700 1 -- 172.21.15.156:0/985422553 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4011d20 con 0x7fd8c40a0a70 2023-09-30T22:24:47.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.316+0000 7fd8c9241700 1 -- 172.21.15.156:0/985422553 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8c40a0a70 msgr2=0x7fd8c40a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.316+0000 7fd8c9241700 1 --2- 172.21.15.156:0/985422553 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8c40a0a70 0x7fd8c40a0e40 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4009870 tx=0x7fd8b4009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:47.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.316+0000 7fd8c9241700 1 -- 172.21.15.156:0/985422553 shutdown_connections 2023-09-30T22:24:47.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.316+0000 7fd8c9241700 1 --2- 172.21.15.156:0/985422553 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8c40a0a70 0x7fd8c40a0e40 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.316+0000 7fd8c9241700 1 --2- 172.21.15.156:0/985422553 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8c40a1380 0x7fd8c4133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.316+0000 7fd8c9241700 1 -- 172.21.15.156:0/985422553 >> 172.21.15.156:0/985422553 conn(0x7fd8c40a6610 msgr2=0x7fd8c40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:47.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.316+0000 7fd8c9241700 1 -- 172.21.15.156:0/985422553 shutdown_connections 2023-09-30T22:24:47.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.316+0000 7fd8c9241700 1 -- 172.21.15.156:0/985422553 wait complete. 2023-09-30T22:24:47.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.317+0000 7fd8c9241700 1 Processor -- start 2023-09-30T22:24:47.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.318+0000 7fd8c9241700 1 -- start start 2023-09-30T22:24:47.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.318+0000 7fd8c9241700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8c40a0a70 0x7fd8c41233d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.318+0000 7fd8c9241700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8c40a1380 0x7fd8c4123910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.318+0000 7fd8c9241700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8c4133f50 0x7fd8c41c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.318+0000 7fd8c9241700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c4124630 con 0x7fd8c40a0a70 2023-09-30T22:24:47.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.318+0000 7fd8c9241700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c41252a0 con 0x7fd8c4133f50 2023-09-30T22:24:47.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.318+0000 7fd8c9241700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c40a03e0 con 0x7fd8c40a1380 2023-09-30T22:24:47.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.318+0000 7fd8c359e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8c4133f50 0x7fd8c41c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.318+0000 7fd8c2d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8c40a0a70 0x7fd8c41233d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.318+0000 7fd8c359e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8c4133f50 0x7fd8c41c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38234/0 (socket says 172.21.15.156:38234) 2023-09-30T22:24:47.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.318+0000 7fd8c359e700 1 -- 172.21.15.156:0/3255770422 learned_addr learned my addr 172.21.15.156:0/3255770422 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:47.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.318+0000 7fd8c259c700 1 --2- 172.21.15.156:0/3255770422 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8c40a1380 0x7fd8c4123910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.318+0000 7fd8c2d9d700 1 -- 172.21.15.156:0/3255770422 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8c40a1380 msgr2=0x7fd8c4123910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.318+0000 7fd8c2d9d700 1 --2- 172.21.15.156:0/3255770422 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8c40a1380 0x7fd8c4123910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.318+0000 7fd8c2d9d700 1 -- 172.21.15.156:0/3255770422 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8c4133f50 msgr2=0x7fd8c41c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.318+0000 7fd8c2d9d700 1 --2- 172.21.15.156:0/3255770422 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8c4133f50 0x7fd8c41c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.318+0000 7fd8c2d9d700 1 -- 172.21.15.156:0/3255770422 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b40094a0 con 0x7fd8c40a0a70 2023-09-30T22:24:47.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.319+0000 7fd8c359e700 1 --2- 172.21.15.156:0/3255770422 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8c4133f50 0x7fd8c41c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:47.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.319+0000 7fd8c2d9d700 1 --2- 172.21.15.156:0/3255770422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8c40a0a70 0x7fd8c41233d0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4016000 tx=0x7fd8b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:47.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.319+0000 7fd8ab7fe700 1 -- 172.21.15.156:0/3255770422 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4004510 con 0x7fd8c40a0a70 2023-09-30T22:24:47.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.319+0000 7fd8ab7fe700 1 -- 172.21.15.156:0/3255770422 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b401f070 con 0x7fd8c40a0a70 2023-09-30T22:24:47.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.319+0000 7fd8c9241700 1 -- 172.21.15.156:0/3255770422 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c4124ba0 con 0x7fd8c40a0a70 2023-09-30T22:24:47.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.319+0000 7fd8ab7fe700 1 -- 172.21.15.156:0/3255770422 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b40038e0 con 0x7fd8c40a0a70 2023-09-30T22:24:47.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.319+0000 7fd8c9241700 1 -- 172.21.15.156:0/3255770422 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c4126cd0 con 0x7fd8c40a0a70 2023-09-30T22:24:47.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.320+0000 7fd8c9241700 1 -- 172.21.15.156:0/3255770422 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c404f2a0 con 0x7fd8c40a0a70 2023-09-30T22:24:47.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.320+0000 7fd8ab7fe700 1 -- 172.21.15.156:0/3255770422 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd8b4003a40 con 0x7fd8c40a0a70 2023-09-30T22:24:47.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.320+0000 7fd8ab7fe700 1 -- 172.21.15.156:0/3255770422 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd8b4021070 con 0x7fd8c40a0a70 2023-09-30T22:24:47.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.325+0000 7fd8ab7fe700 1 -- 172.21.15.156:0/3255770422 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd8b402f3a0 con 0x7fd8c40a0a70 2023-09-30T22:24:47.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.396+0000 7f5c92de0700 1 -- 172.21.15.156:0/2106454200 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5c8c072d60 con 0x7f5c8c09f180 2023-09-30T22:24:47.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.396+0000 7f5c897fa700 1 -- 172.21.15.156:0/2106454200 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c7802a020 con 0x7f5c8c09f180 2023-09-30T22:24:47.397 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:47.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.399+0000 7f5c92de0700 1 -- 172.21.15.156:0/2106454200 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c8c09f180 msgr2=0x7f5c8c11fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.399+0000 7f5c92de0700 1 --2- 172.21.15.156:0/2106454200 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c8c09f180 0x7f5c8c11fa00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5c780098f0 tx=0x7f5c78004750 comp rx=0 tx=0).stop 2023-09-30T22:24:47.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.399+0000 7f5c92de0700 1 -- 172.21.15.156:0/2106454200 shutdown_connections 2023-09-30T22:24:47.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.399+0000 7f5c92de0700 1 --2- 172.21.15.156:0/2106454200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c8c134160 0x7f5c8c11ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.399+0000 7f5c92de0700 1 --2- 172.21.15.156:0/2106454200 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5c8c09e870 0x7f5c8c11f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.399+0000 7f5c92de0700 1 --2- 172.21.15.156:0/2106454200 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5c8c09f180 0x7f5c8c11fa00 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.399+0000 7f5c92de0700 1 -- 172.21.15.156:0/2106454200 >> 172.21.15.156:0/2106454200 conn(0x7f5c8c0a4430 msgr2=0x7f5c8c070930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:47.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.399+0000 7f5c92de0700 1 -- 172.21.15.156:0/2106454200 shutdown_connections 2023-09-30T22:24:47.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.399+0000 7f5c92de0700 1 -- 172.21.15.156:0/2106454200 wait complete. 2023-09-30T22:24:47.412 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:47.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.444+0000 7fa29f2b0700 1 -- 172.21.15.156:0/1139647082 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa29804f2a0 con 0x7fa2981304a0 2023-09-30T22:24:47.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.445+0000 7fa28dffb700 1 -- 172.21.15.156:0/1139647082 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa290017030 con 0x7fa2981304a0 2023-09-30T22:24:47.445 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:47.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.447+0000 7fa29f2b0700 1 -- 172.21.15.156:0/1139647082 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2981304a0 msgr2=0x7fa298139df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.447+0000 7fa29f2b0700 1 --2- 172.21.15.156:0/1139647082 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2981304a0 0x7fa298139df0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fa29000cbf0 tx=0x7fa29000cf00 comp rx=0 tx=0).stop 2023-09-30T22:24:47.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.447+0000 7fa29f2b0700 1 -- 172.21.15.156:0/1139647082 shutdown_connections 2023-09-30T22:24:47.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.447+0000 7fa29f2b0700 1 --2- 172.21.15.156:0/1139647082 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa2981304a0 0x7fa298139df0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.447+0000 7fa29f2b0700 1 --2- 172.21.15.156:0/1139647082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2980a0a30 0x7fa29812f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.447+0000 7fa29f2b0700 1 --2- 172.21.15.156:0/1139647082 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2980a1340 0x7fa29812fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.447+0000 7fa29f2b0700 1 -- 172.21.15.156:0/1139647082 >> 172.21.15.156:0/1139647082 conn(0x7fa2980a2980 msgr2=0x7fa298070de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:47.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.447+0000 7fa29f2b0700 1 -- 172.21.15.156:0/1139647082 shutdown_connections 2023-09-30T22:24:47.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.447+0000 7fa29f2b0700 1 -- 172.21.15.156:0/1139647082 wait complete. 2023-09-30T22:24:47.459 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:47.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.517+0000 7fd8c9241700 1 -- 172.21.15.156:0/3255770422 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd8c409c680 con 0x7fd8c40a0a70 2023-09-30T22:24:47.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.517+0000 7fd8ab7fe700 1 -- 172.21.15.156:0/3255770422 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd8b402b030 con 0x7fd8c40a0a70 2023-09-30T22:24:47.518 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:47.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.519+0000 7fd8c9241700 1 -- 172.21.15.156:0/3255770422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8c40a0a70 msgr2=0x7fd8c41233d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.519+0000 7fd8c9241700 1 --2- 172.21.15.156:0/3255770422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8c40a0a70 0x7fd8c41233d0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4016000 tx=0x7fd8b4004750 comp rx=0 tx=0).stop 2023-09-30T22:24:47.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.519+0000 7fd8c9241700 1 -- 172.21.15.156:0/3255770422 shutdown_connections 2023-09-30T22:24:47.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.519+0000 7fd8c9241700 1 --2- 172.21.15.156:0/3255770422 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd8c4133f50 0x7fd8c41c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.519+0000 7fd8c9241700 1 --2- 172.21.15.156:0/3255770422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8c40a0a70 0x7fd8c41233d0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.519+0000 7fd8c9241700 1 --2- 172.21.15.156:0/3255770422 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd8c40a1380 0x7fd8c4123910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.519+0000 7fd8c9241700 1 -- 172.21.15.156:0/3255770422 >> 172.21.15.156:0/3255770422 conn(0x7fd8c40a6610 msgr2=0x7fd8c40a4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:47.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.519+0000 7fd8c9241700 1 -- 172.21.15.156:0/3255770422 shutdown_connections 2023-09-30T22:24:47.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:47.519+0000 7fd8c9241700 1 -- 172.21.15.156:0/3255770422 wait complete. 2023-09-30T22:24:47.532 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:48.248 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:48.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.377+0000 7f0fdf1cc700 1 Processor -- start 2023-09-30T22:24:48.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.377+0000 7f0fdf1cc700 1 -- start start 2023-09-30T22:24:48.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.377+0000 7f0fdf1cc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0fd8133ad0 0x7f0fd8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.378+0000 7f0fdf1cc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0fd81300a0 0x7f0fd81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.378+0000 7f0fdf1cc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0fd81309f0 0x7f0fd813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.378+0000 7f0fdf1cc700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd806b2d0 con 0x7f0fd8133ad0 2023-09-30T22:24:48.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.378+0000 7f0fdf1cc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd8133610 con 0x7f0fd81300a0 2023-09-30T22:24:48.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.378+0000 7f0fdf1cc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd809a500 con 0x7f0fd81309f0 2023-09-30T22:24:48.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.378+0000 7f0fdcf68700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0fd8133ad0 0x7f0fd8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.378+0000 7f0fd7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0fd81300a0 0x7f0fd81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.378+0000 7f0fdcf68700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0fd8133ad0 0x7f0fd8133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52094/0 (socket says 172.21.15.156:52094) 2023-09-30T22:24:48.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.378+0000 7f0fdd769700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0fd81309f0 0x7f0fd813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.378+0000 7f0fdcf68700 1 -- 172.21.15.156:0/2259442450 learned_addr learned my addr 172.21.15.156:0/2259442450 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:48.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.378+0000 7f0fdcf68700 1 -- 172.21.15.156:0/2259442450 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0fd81309f0 msgr2=0x7f0fd813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:48.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.378+0000 7f0fdcf68700 1 --2- 172.21.15.156:0/2259442450 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0fd81309f0 0x7f0fd813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.378+0000 7f0fdcf68700 1 -- 172.21.15.156:0/2259442450 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0fd81300a0 msgr2=0x7f0fd81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:48.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.378+0000 7f0fdcf68700 1 --2- 172.21.15.156:0/2259442450 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0fd81300a0 0x7f0fd81304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.378+0000 7f0fdcf68700 1 -- 172.21.15.156:0/2259442450 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd81338b0 con 0x7f0fd8133ad0 2023-09-30T22:24:48.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.378+0000 7f0fdd769700 1 --2- 172.21.15.156:0/2259442450 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0fd81309f0 0x7f0fd813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:48.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.378+0000 7f0fdcf68700 1 --2- 172.21.15.156:0/2259442450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fd8133ad0 0x7f0fd8133ea0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc0098f0 tx=0x7f0fcc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c43e635ea855f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:48.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.378+0000 7f0fd77fe700 1 -- 172.21.15.156:0/2259442450 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc011830 con 0x7f0fd8133ad0 2023-09-30T22:24:48.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.378+0000 7f0fd77fe700 1 -- 172.21.15.156:0/2259442450 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fcc011990 con 0x7f0fd8133ad0 2023-09-30T22:24:48.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.378+0000 7f0fd77fe700 1 -- 172.21.15.156:0/2259442450 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc011d20 con 0x7f0fd8133ad0 2023-09-30T22:24:48.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.379+0000 7f0fdf1cc700 1 -- 172.21.15.156:0/2259442450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fd8133ad0 msgr2=0x7f0fd8133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.379+0000 7f0fdf1cc700 1 --2- 172.21.15.156:0/2259442450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fd8133ad0 0x7f0fd8133ea0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc0098f0 tx=0x7f0fcc009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:48.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.379+0000 7f0fdf1cc700 1 -- 172.21.15.156:0/2259442450 shutdown_connections 2023-09-30T22:24:48.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.379+0000 7f0fdf1cc700 1 --2- 172.21.15.156:0/2259442450 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0fd81309f0 0x7f0fd813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.379+0000 7f0fdf1cc700 1 --2- 172.21.15.156:0/2259442450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fd8133ad0 0x7f0fd8133ea0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.379+0000 7f0fdf1cc700 1 --2- 172.21.15.156:0/2259442450 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0fd81300a0 0x7f0fd81304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.379+0000 7f0fdf1cc700 1 -- 172.21.15.156:0/2259442450 >> 172.21.15.156:0/2259442450 conn(0x7f0fd8099c40 msgr2=0x7f0fd80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:48.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.379+0000 7f0fdf1cc700 1 -- 172.21.15.156:0/2259442450 shutdown_connections 2023-09-30T22:24:48.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.379+0000 7f0fdf1cc700 1 -- 172.21.15.156:0/2259442450 wait complete. 2023-09-30T22:24:48.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.380+0000 7f0fdf1cc700 1 Processor -- start 2023-09-30T22:24:48.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.380+0000 7f0fdf1cc700 1 -- start start 2023-09-30T22:24:48.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.380+0000 7f0fdf1cc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fd81300a0 0x7f0fd811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.380+0000 7f0fdf1cc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0fd81309f0 0x7f0fd811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.380+0000 7f0fdf1cc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0fd8133ad0 0x7f0fd811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.380+0000 7f0fdf1cc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd811fd00 con 0x7f0fd81300a0 2023-09-30T22:24:48.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.380+0000 7f0fdf1cc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd812dd00 con 0x7f0fd81309f0 2023-09-30T22:24:48.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.380+0000 7f0fdf1cc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd8120950 con 0x7f0fd8133ad0 2023-09-30T22:24:48.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.380+0000 7f0fdcf68700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fd81300a0 0x7f0fd811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.380+0000 7f0fd7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0fd81309f0 0x7f0fd811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.380+0000 7f0fdcf68700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fd81300a0 0x7f0fd811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52102/0 (socket says 172.21.15.156:52102) 2023-09-30T22:24:48.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.380+0000 7f0fdcf68700 1 -- 172.21.15.156:0/3111516175 learned_addr learned my addr 172.21.15.156:0/3111516175 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:48.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.381+0000 7f0fdd769700 1 --2- 172.21.15.156:0/3111516175 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0fd8133ad0 0x7f0fd811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.381+0000 7f0fdcf68700 1 -- 172.21.15.156:0/3111516175 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0fd8133ad0 msgr2=0x7f0fd811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.381+0000 7f0fdcf68700 1 --2- 172.21.15.156:0/3111516175 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0fd8133ad0 0x7f0fd811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.381+0000 7f0fdcf68700 1 -- 172.21.15.156:0/3111516175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0fd81309f0 msgr2=0x7f0fd811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.381+0000 7f0fdcf68700 1 --2- 172.21.15.156:0/3111516175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0fd81309f0 0x7f0fd811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.381+0000 7f0fdcf68700 1 -- 172.21.15.156:0/3111516175 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd0009a70 con 0x7f0fd81300a0 2023-09-30T22:24:48.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.381+0000 7f0fd7fff700 1 --2- 172.21.15.156:0/3111516175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0fd81309f0 0x7f0fd811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:48.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.381+0000 7f0fdcf68700 1 --2- 172.21.15.156:0/3111516175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fd81300a0 0x7f0fd811da40 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc000c00 tx=0x7f0fcc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:48.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.381+0000 7f0fd57fa700 1 -- 172.21.15.156:0/3111516175 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc004450 con 0x7f0fd81300a0 2023-09-30T22:24:48.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.381+0000 7f0fd57fa700 1 -- 172.21.15.156:0/3111516175 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fcc0045b0 con 0x7f0fd81300a0 2023-09-30T22:24:48.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.381+0000 7f0fdf1cc700 1 -- 172.21.15.156:0/3111516175 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fcc009550 con 0x7f0fd81300a0 2023-09-30T22:24:48.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.381+0000 7f0fd57fa700 1 -- 172.21.15.156:0/3111516175 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc0038c0 con 0x7f0fd81300a0 2023-09-30T22:24:48.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.381+0000 7f0fdf1cc700 1 -- 172.21.15.156:0/3111516175 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd811ee40 con 0x7f0fd81300a0 2023-09-30T22:24:48.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.382+0000 7f0fdf1cc700 1 -- 172.21.15.156:0/3111516175 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd804f2a0 con 0x7f0fd81300a0 2023-09-30T22:24:48.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.382+0000 7f0fd57fa700 1 -- 172.21.15.156:0/3111516175 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0fcc021070 con 0x7f0fd81300a0 2023-09-30T22:24:48.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.383+0000 7f0fd57fa700 1 -- 172.21.15.156:0/3111516175 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0fcc0409a0 con 0x7f0fd81300a0 2023-09-30T22:24:48.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.387+0000 7f0fd57fa700 1 -- 172.21.15.156:0/3111516175 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0fcc00b9d0 con 0x7f0fd81300a0 2023-09-30T22:24:48.413 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:48.460 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:48.534 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:48.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.538+0000 7fb352651700 1 Processor -- start 2023-09-30T22:24:48.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.538+0000 7fb352651700 1 -- start start 2023-09-30T22:24:48.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.539+0000 7fb352651700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb34c0a0a30 0x7fb34c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.539+0000 7fb352651700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34c0a1340 0x7fb34c12ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.539+0000 7fb352651700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb34c1304a0 0x7fb34c1308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.539+0000 7fb352651700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb34c130e30 con 0x7fb34c0a0a30 2023-09-30T22:24:48.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.539+0000 7fb352651700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0a1e70 con 0x7fb34c0a1340 2023-09-30T22:24:48.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.539+0000 7fb352651700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c09a720 con 0x7fb34c1304a0 2023-09-30T22:24:48.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.539+0000 7fb350bee700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb34c1304a0 0x7fb34c1308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.539+0000 7fb34bfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb34c0a0a30 0x7fb34c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.539+0000 7fb34bfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb34c0a0a30 0x7fb34c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52110/0 (socket says 172.21.15.156:52110) 2023-09-30T22:24:48.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.539+0000 7fb350bee700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb34c1304a0 0x7fb34c1308f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46272/0 (socket says 172.21.15.156:46272) 2023-09-30T22:24:48.541 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.539+0000 7fb34bfff700 1 -- 172.21.15.156:0/92749030 learned_addr learned my addr 172.21.15.156:0/92749030 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:48.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.539+0000 7fb350bee700 1 -- 172.21.15.156:0/92749030 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34c0a1340 msgr2=0x7fb34c12ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:48.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.539+0000 7fb350bee700 1 --2- 172.21.15.156:0/92749030 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34c0a1340 0x7fb34c12ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.539+0000 7fb350bee700 1 -- 172.21.15.156:0/92749030 >> v2:172.21.15.156:3300/0 conn(0x7fb34c0a0a30 msgr2=0x7fb34c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:48.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.539+0000 7fb350bee700 1 --2- 172.21.15.156:0/92749030 >> v2:172.21.15.156:3300/0 conn(0x7fb34c0a0a30 0x7fb34c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.540+0000 7fb350bee700 1 -- 172.21.15.156:0/92749030 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c09b300 con 0x7fb34c1304a0 2023-09-30T22:24:48.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.540+0000 7fb34bfff700 1 --2- 172.21.15.156:0/92749030 >> v2:172.21.15.156:3300/0 conn(0x7fb34c0a0a30 0x7fb34c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:48.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.540+0000 7fb350bee700 1 --2- 172.21.15.156:0/92749030 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb34c1304a0 0x7fb34c1308f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb344009dc0 tx=0x7fb34400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ac9fccd7ac18f37 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:48.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.540+0000 7fb34affd700 1 -- 172.21.15.156:0/92749030 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34400bce0 con 0x7fb34c1304a0 2023-09-30T22:24:48.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.540+0000 7fb34affd700 1 -- 172.21.15.156:0/92749030 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34400be40 con 0x7fb34c1304a0 2023-09-30T22:24:48.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.540+0000 7fb34affd700 1 -- 172.21.15.156:0/92749030 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb344010710 con 0x7fb34c1304a0 2023-09-30T22:24:48.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.541+0000 7fb352651700 1 -- 172.21.15.156:0/92749030 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb34c1304a0 msgr2=0x7fb34c1308f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.541+0000 7fb352651700 1 --2- 172.21.15.156:0/92749030 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb34c1304a0 0x7fb34c1308f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb344009dc0 tx=0x7fb34400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:48.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.541+0000 7fb352651700 1 -- 172.21.15.156:0/92749030 shutdown_connections 2023-09-30T22:24:48.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.541+0000 7fb352651700 1 --2- 172.21.15.156:0/92749030 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb34c1304a0 0x7fb34c1308f0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.541+0000 7fb352651700 1 --2- 172.21.15.156:0/92749030 >> v2:172.21.15.156:3300/0 conn(0x7fb34c0a0a30 0x7fb34c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.541+0000 7fb352651700 1 --2- 172.21.15.156:0/92749030 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34c0a1340 0x7fb34c12ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.541+0000 7fb352651700 1 -- 172.21.15.156:0/92749030 >> 172.21.15.156:0/92749030 conn(0x7fb34c0a2980 msgr2=0x7fb34c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:48.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.541+0000 7fb352651700 1 -- 172.21.15.156:0/92749030 shutdown_connections 2023-09-30T22:24:48.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.541+0000 7fb352651700 1 -- 172.21.15.156:0/92749030 wait complete. 2023-09-30T22:24:48.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.542+0000 7fb352651700 1 Processor -- start 2023-09-30T22:24:48.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.543+0000 7fb352651700 1 -- start start 2023-09-30T22:24:48.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.543+0000 7fb352651700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34c0a0a30 0x7fb34c11e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.543+0000 7fb352651700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb34c0a1340 0x7fb34c11eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.543+0000 7fb352651700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb34c1304a0 0x7fb34c1c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.543+0000 7fb352651700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c071da0 con 0x7fb34c0a1340 2023-09-30T22:24:48.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.543+0000 7fb352651700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c09ae00 con 0x7fb34c0a0a30 2023-09-30T22:24:48.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.543+0000 7fb352651700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c1208b0 con 0x7fb34c1304a0 2023-09-30T22:24:48.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.543+0000 7fb34bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34c0a0a30 0x7fb34c11e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.544+0000 7fb34bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34c0a0a30 0x7fb34c11e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38282/0 (socket says 172.21.15.156:38282) 2023-09-30T22:24:48.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.544+0000 7fb34bfff700 1 -- 172.21.15.156:0/2400784276 learned_addr learned my addr 172.21.15.156:0/2400784276 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:48.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.544+0000 7fb34b7fe700 1 --2- 172.21.15.156:0/2400784276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb34c0a1340 0x7fb34c11eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.544+0000 7fb34bfff700 1 -- 172.21.15.156:0/2400784276 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb34c1304a0 msgr2=0x7fb34c1c3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.544+0000 7fb34bfff700 1 --2- 172.21.15.156:0/2400784276 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb34c1304a0 0x7fb34c1c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.544+0000 7fb34bfff700 1 -- 172.21.15.156:0/2400784276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb34c0a1340 msgr2=0x7fb34c11eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.544+0000 7fb34bfff700 1 --2- 172.21.15.156:0/2400784276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb34c0a1340 0x7fb34c11eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.544+0000 7fb34bfff700 1 -- 172.21.15.156:0/2400784276 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33c00b7a0 con 0x7fb34c0a0a30 2023-09-30T22:24:48.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.544+0000 7fb34bfff700 1 --2- 172.21.15.156:0/2400784276 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34c0a0a30 0x7fb34c11e990 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00dcf0 tx=0x7fb33c009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:48.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.544+0000 7fb348ff9700 1 -- 172.21.15.156:0/2400784276 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c009a60 con 0x7fb34c0a0a30 2023-09-30T22:24:48.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.544+0000 7fb348ff9700 1 -- 172.21.15.156:0/2400784276 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33c009bc0 con 0x7fb34c0a0a30 2023-09-30T22:24:48.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.544+0000 7fb352651700 1 -- 172.21.15.156:0/2400784276 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb344009a70 con 0x7fb34c0a0a30 2023-09-30T22:24:48.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.544+0000 7fb348ff9700 1 -- 172.21.15.156:0/2400784276 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c005a20 con 0x7fb34c0a0a30 2023-09-30T22:24:48.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.544+0000 7fb352651700 1 -- 172.21.15.156:0/2400784276 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb34c11e4a0 con 0x7fb34c0a0a30 2023-09-30T22:24:48.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.545+0000 7fb352651700 1 -- 172.21.15.156:0/2400784276 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb34c04f2a0 con 0x7fb34c0a0a30 2023-09-30T22:24:48.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.545+0000 7fb348ff9700 1 -- 172.21.15.156:0/2400784276 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb33c005b80 con 0x7fb34c0a0a30 2023-09-30T22:24:48.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.546+0000 7fb348ff9700 1 -- 172.21.15.156:0/2400784276 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb33c00b020 con 0x7fb34c0a0a30 2023-09-30T22:24:48.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.555+0000 7fb348ff9700 1 -- 172.21.15.156:0/2400784276 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb33c005e30 con 0x7fb34c0a0a30 2023-09-30T22:24:48.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.588+0000 7fa326457700 1 Processor -- start 2023-09-30T22:24:48.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.588+0000 7fa326457700 1 -- start start 2023-09-30T22:24:48.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.589+0000 7fa326457700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa32009ad40 0x7fa320133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.589+0000 7fa326457700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa320133f70 0x7fa3201343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.589+0000 7fa326457700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3200a0a70 0x7fa3200a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.589+0000 7fa326457700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3200a3b60 con 0x7fa32009ad40 2023-09-30T22:24:48.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.589+0000 7fa326457700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3201348e0 con 0x7fa3200a0a70 2023-09-30T22:24:48.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.589+0000 7fa326457700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa32009b110 con 0x7fa320133f70 2023-09-30T22:24:48.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.589+0000 7fa3249f4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3200a0a70 0x7fa3200a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.589+0000 7fa3249f4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3200a0a70 0x7fa3200a0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38298/0 (socket says 172.21.15.156:38298) 2023-09-30T22:24:48.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.589+0000 7fa3249f4700 1 -- 172.21.15.156:0/2338199026 learned_addr learned my addr 172.21.15.156:0/2338199026 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:48.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.589+0000 7fa31f7fe700 1 --2- 172.21.15.156:0/2338199026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa320133f70 0x7fa3201343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.589+0000 7fa3249f4700 1 -- 172.21.15.156:0/2338199026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa320133f70 msgr2=0x7fa3201343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:48.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.589+0000 7fa3249f4700 1 --2- 172.21.15.156:0/2338199026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa320133f70 0x7fa3201343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.589+0000 7fa31ffff700 1 --2- 172.21.15.156:0/2338199026 >> v2:172.21.15.156:3300/0 conn(0x7fa32009ad40 0x7fa320133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.589+0000 7fa3249f4700 1 -- 172.21.15.156:0/2338199026 >> v2:172.21.15.156:3300/0 conn(0x7fa32009ad40 msgr2=0x7fa320133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:48.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.589+0000 7fa3249f4700 1 --2- 172.21.15.156:0/2338199026 >> v2:172.21.15.156:3300/0 conn(0x7fa32009ad40 0x7fa320133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.589+0000 7fa3249f4700 1 -- 172.21.15.156:0/2338199026 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3200a2fa0 con 0x7fa3200a0a70 2023-09-30T22:24:48.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.589+0000 7fa31f7fe700 1 --2- 172.21.15.156:0/2338199026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa320133f70 0x7fa3201343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:48.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.589+0000 7fa31ffff700 1 --2- 172.21.15.156:0/2338199026 >> v2:172.21.15.156:3300/0 conn(0x7fa32009ad40 0x7fa320133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:24:48.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.589+0000 7fa3249f4700 1 --2- 172.21.15.156:0/2338199026 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3200a0a70 0x7fa3200a0f10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fa318009e50 tx=0x7fa31800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5507a4d47d8fc0be server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:48.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.590+0000 7fa31effd700 1 -- 172.21.15.156:0/2338199026 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31800e070 con 0x7fa3200a0a70 2023-09-30T22:24:48.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.590+0000 7fa31effd700 1 -- 172.21.15.156:0/2338199026 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31800b9c0 con 0x7fa3200a0a70 2023-09-30T22:24:48.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.590+0000 7fa31effd700 1 -- 172.21.15.156:0/2338199026 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31800bd70 con 0x7fa3200a0a70 2023-09-30T22:24:48.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.590+0000 7fa326457700 1 -- 172.21.15.156:0/2338199026 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3200a0a70 msgr2=0x7fa3200a0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.590+0000 7fa326457700 1 --2- 172.21.15.156:0/2338199026 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3200a0a70 0x7fa3200a0f10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fa318009e50 tx=0x7fa31800b330 comp rx=0 tx=0).stop 2023-09-30T22:24:48.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.590+0000 7fa326457700 1 -- 172.21.15.156:0/2338199026 shutdown_connections 2023-09-30T22:24:48.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.590+0000 7fa326457700 1 --2- 172.21.15.156:0/2338199026 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3200a0a70 0x7fa3200a0f10 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.590+0000 7fa326457700 1 --2- 172.21.15.156:0/2338199026 >> v2:172.21.15.156:3300/0 conn(0x7fa32009ad40 0x7fa320133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.590+0000 7fa326457700 1 --2- 172.21.15.156:0/2338199026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa320133f70 0x7fa3201343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.590+0000 7fa326457700 1 -- 172.21.15.156:0/2338199026 >> 172.21.15.156:0/2338199026 conn(0x7fa320099c40 msgr2=0x7fa32006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:48.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.591+0000 7fa326457700 1 -- 172.21.15.156:0/2338199026 shutdown_connections 2023-09-30T22:24:48.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.591+0000 7fa326457700 1 -- 172.21.15.156:0/2338199026 wait complete. 2023-09-30T22:24:48.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.591+0000 7fa326457700 1 Processor -- start 2023-09-30T22:24:48.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.592+0000 7fa326457700 1 -- start start 2023-09-30T22:24:48.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.592+0000 7fa326457700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa32009ad40 0x7fa3201c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.592+0000 7fa326457700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3200a0a70 0x7fa3201c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.592+0000 7fa326457700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa320133f70 0x7fa3201c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.592+0000 7fa326457700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa320120620 con 0x7fa320133f70 2023-09-30T22:24:48.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.592+0000 7fa326457700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa320122330 con 0x7fa3200a0a70 2023-09-30T22:24:48.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.592+0000 7fa326457700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3201333a0 con 0x7fa32009ad40 2023-09-30T22:24:48.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.592+0000 7fa31f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3200a0a70 0x7fa3201c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.593+0000 7fa31f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3200a0a70 0x7fa3201c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38300/0 (socket says 172.21.15.156:38300) 2023-09-30T22:24:48.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.593+0000 7fa31f7fe700 1 -- 172.21.15.156:0/588780871 learned_addr learned my addr 172.21.15.156:0/588780871 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:48.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.593+0000 7fa31ffff700 1 --2- 172.21.15.156:0/588780871 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa32009ad40 0x7fa3201c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.593+0000 7fa3249f4700 1 --2- 172.21.15.156:0/588780871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa320133f70 0x7fa3201c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.593+0000 7fa31f7fe700 1 -- 172.21.15.156:0/588780871 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa32009ad40 msgr2=0x7fa3201c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.593+0000 7fa31f7fe700 1 --2- 172.21.15.156:0/588780871 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa32009ad40 0x7fa3201c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.593+0000 7fa31f7fe700 1 -- 172.21.15.156:0/588780871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa320133f70 msgr2=0x7fa3201c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.593+0000 7fa31f7fe700 1 --2- 172.21.15.156:0/588780871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa320133f70 0x7fa3201c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.593+0000 7fa31f7fe700 1 -- 172.21.15.156:0/588780871 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa318009b30 con 0x7fa3200a0a70 2023-09-30T22:24:48.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.593+0000 7fa31ffff700 1 --2- 172.21.15.156:0/588780871 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa32009ad40 0x7fa3201c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:48.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.593+0000 7fa3249f4700 1 --2- 172.21.15.156:0/588780871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa320133f70 0x7fa3201c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:24:48.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.593+0000 7fa31f7fe700 1 --2- 172.21.15.156:0/588780871 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3200a0a70 0x7fa3201c86d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fa31400e840 tx=0x7fa31400ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:48.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.593+0000 7fa31cff9700 1 -- 172.21.15.156:0/588780871 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314004230 con 0x7fa3200a0a70 2023-09-30T22:24:48.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.593+0000 7fa31cff9700 1 -- 172.21.15.156:0/588780871 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa314004390 con 0x7fa3200a0a70 2023-09-30T22:24:48.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.593+0000 7fa326457700 1 -- 172.21.15.156:0/588780871 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa32009c7e0 con 0x7fa3200a0a70 2023-09-30T22:24:48.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.593+0000 7fa31cff9700 1 -- 172.21.15.156:0/588780871 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3140036a0 con 0x7fa3200a0a70 2023-09-30T22:24:48.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.593+0000 7fa326457700 1 -- 172.21.15.156:0/588780871 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa320122cc0 con 0x7fa3200a0a70 2023-09-30T22:24:48.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.594+0000 7fa31cff9700 1 -- 172.21.15.156:0/588780871 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa314003800 con 0x7fa3200a0a70 2023-09-30T22:24:48.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.594+0000 7f0fdf1cc700 1 -- 172.21.15.156:0/3111516175 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0fd806c3b0 con 0x7f0fd81300a0 2023-09-30T22:24:48.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.595+0000 7fa31cff9700 1 -- 172.21.15.156:0/588780871 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa31403f340 con 0x7fa3200a0a70 2023-09-30T22:24:48.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.595+0000 7fa326457700 1 -- 172.21.15.156:0/588780871 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa32004f2a0 con 0x7fa3200a0a70 2023-09-30T22:24:48.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.595+0000 7f0fd57fa700 1 -- 172.21.15.156:0/3111516175 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0fcc033020 con 0x7f0fd81300a0 2023-09-30T22:24:48.600 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:48.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.597+0000 7f0fdf1cc700 1 -- 172.21.15.156:0/3111516175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fd81300a0 msgr2=0x7f0fd811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.597+0000 7f0fdf1cc700 1 --2- 172.21.15.156:0/3111516175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fd81300a0 0x7f0fd811da40 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc000c00 tx=0x7f0fcc004750 comp rx=0 tx=0).stop 2023-09-30T22:24:48.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.597+0000 7f0fdf1cc700 1 -- 172.21.15.156:0/3111516175 shutdown_connections 2023-09-30T22:24:48.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.597+0000 7f0fdf1cc700 1 --2- 172.21.15.156:0/3111516175 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0fd8133ad0 0x7f0fd811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.597+0000 7f0fdf1cc700 1 --2- 172.21.15.156:0/3111516175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fd81300a0 0x7f0fd811da40 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.597+0000 7f0fdf1cc700 1 --2- 172.21.15.156:0/3111516175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0fd81309f0 0x7f0fd811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.597+0000 7f0fdf1cc700 1 -- 172.21.15.156:0/3111516175 >> 172.21.15.156:0/3111516175 conn(0x7f0fd8099c40 msgr2=0x7f0fd812e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:48.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.597+0000 7f0fdf1cc700 1 -- 172.21.15.156:0/3111516175 shutdown_connections 2023-09-30T22:24:48.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.597+0000 7f0fdf1cc700 1 -- 172.21.15.156:0/3111516175 wait complete. 2023-09-30T22:24:48.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.600+0000 7fa31cff9700 1 -- 172.21.15.156:0/588780871 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa3140228f0 con 0x7fa3200a0a70 2023-09-30T22:24:48.612 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:48.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.667+0000 7f24f7549700 1 Processor -- start 2023-09-30T22:24:48.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.667+0000 7f24f7549700 1 -- start start 2023-09-30T22:24:48.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.667+0000 7f24f7549700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f24f009ad40 0x7f24f0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.667+0000 7f24f7549700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24f01343d0 0x7f24f00a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.667+0000 7f24f7549700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f009b110 con 0x7f24f0133f70 2023-09-30T22:24:48.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.667+0000 7f24f7549700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24f00a3b60 con 0x7f24f009ad40 2023-09-30T22:24:48.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.667+0000 7f24f7549700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f0134850 con 0x7f24f01343d0 2023-09-30T22:24:48.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.667+0000 7f24f5ae6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24f01343d0 0x7f24f00a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.667+0000 7f24f52e5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f24f009ad40 0x7f24f0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.667+0000 7f24f4ae4700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f24f0133f70 0x7f24f00a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37906/0 (socket says 172.21.15.156:37906) 2023-09-30T22:24:48.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.667+0000 7f24f52e5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f24f009ad40 0x7f24f0133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52150/0 (socket says 172.21.15.156:52150) 2023-09-30T22:24:48.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.667+0000 7f24f5ae6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24f01343d0 0x7f24f00a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38304/0 (socket says 172.21.15.156:38304) 2023-09-30T22:24:48.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.667+0000 7f24f4ae4700 1 -- 172.21.15.156:0/4236563427 learned_addr learned my addr 172.21.15.156:0/4236563427 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:48.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.668+0000 7f24f52e5700 1 -- 172.21.15.156:0/4236563427 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24f01343d0 msgr2=0x7f24f00a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:48.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.668+0000 7f24f52e5700 1 --2- 172.21.15.156:0/4236563427 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24f01343d0 0x7f24f00a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.668+0000 7f24f52e5700 1 -- 172.21.15.156:0/4236563427 >> v1:172.21.15.156:6789/0 conn(0x7f24f0133f70 legacy=0x7f24f00a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.668+0000 7f24e7fff700 1 -- 172.21.15.156:0/4236563427 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3461819545 0 0) 0x7f24f009b110 con 0x7f24f0133f70 2023-09-30T22:24:48.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.668+0000 7f24f52e5700 1 -- 172.21.15.156:0/4236563427 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f00a2fa0 con 0x7f24f009ad40 2023-09-30T22:24:48.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.668+0000 7f24f52e5700 1 --2- 172.21.15.156:0/4236563427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f009ad40 0x7f24f0133a30 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f24ec009840 tx=0x7f24ec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53feabba997f702a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:48.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.668+0000 7f24e7fff700 1 -- 172.21.15.156:0/4236563427 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec011830 con 0x7f24f009ad40 2023-09-30T22:24:48.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.668+0000 7f24e7fff700 1 -- 172.21.15.156:0/4236563427 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ec011990 con 0x7f24f009ad40 2023-09-30T22:24:48.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.668+0000 7f24e7fff700 1 -- 172.21.15.156:0/4236563427 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec011d20 con 0x7f24f009ad40 2023-09-30T22:24:48.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.669+0000 7f24f7549700 1 -- 172.21.15.156:0/4236563427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f009ad40 msgr2=0x7f24f0133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.669+0000 7f24f7549700 1 --2- 172.21.15.156:0/4236563427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f009ad40 0x7f24f0133a30 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f24ec009840 tx=0x7f24ec009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:48.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.669+0000 7f24f7549700 1 -- 172.21.15.156:0/4236563427 shutdown_connections 2023-09-30T22:24:48.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.669+0000 7f24f7549700 1 --2- 172.21.15.156:0/4236563427 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24f01343d0 0x7f24f00a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.669+0000 7f24f7549700 1 --2- 172.21.15.156:0/4236563427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f009ad40 0x7f24f0133a30 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.669+0000 7f24f7549700 1 -- 172.21.15.156:0/4236563427 >> 172.21.15.156:0/4236563427 conn(0x7f24f0099c40 msgr2=0x7f24f006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:48.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.669+0000 7f24f7549700 1 -- 172.21.15.156:0/4236563427 shutdown_connections 2023-09-30T22:24:48.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.669+0000 7f24f7549700 1 -- 172.21.15.156:0/4236563427 wait complete. 2023-09-30T22:24:48.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.670+0000 7f24f7549700 1 Processor -- start 2023-09-30T22:24:48.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.670+0000 7f24f7549700 1 -- start start 2023-09-30T22:24:48.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.671+0000 7f24f7549700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24f009ad40 0x7f24f011e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.671+0000 7f24f7549700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24f0133f70 0x7f24f011e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.671+0000 7f24f7549700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f01343d0 0x7f24f011ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.671+0000 7f24f7549700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f0120c20 con 0x7f24f01343d0 2023-09-30T22:24:48.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.671+0000 7f24f7549700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f0121db0 con 0x7f24f009ad40 2023-09-30T22:24:48.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.671+0000 7f24f7549700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24f011fd90 con 0x7f24f0133f70 2023-09-30T22:24:48.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.671+0000 7f24f52e5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24f009ad40 0x7f24f011e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.671+0000 7f24f52e5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24f009ad40 0x7f24f011e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38318/0 (socket says 172.21.15.156:38318) 2023-09-30T22:24:48.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.671+0000 7f24f52e5700 1 -- 172.21.15.156:0/2605298299 learned_addr learned my addr 172.21.15.156:0/2605298299 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:48.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.671+0000 7f24f4ae4700 1 --2- 172.21.15.156:0/2605298299 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24f0133f70 0x7f24f011e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.671+0000 7f24f5ae6700 1 --2- 172.21.15.156:0/2605298299 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f01343d0 0x7f24f011ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.671+0000 7f24f52e5700 1 -- 172.21.15.156:0/2605298299 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24f0133f70 msgr2=0x7f24f011e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.671+0000 7f24f52e5700 1 --2- 172.21.15.156:0/2605298299 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24f0133f70 0x7f24f011e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.671+0000 7f24f52e5700 1 -- 172.21.15.156:0/2605298299 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f01343d0 msgr2=0x7f24f011ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.671+0000 7f24f52e5700 1 --2- 172.21.15.156:0/2605298299 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f01343d0 0x7f24f011ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.671+0000 7f24f52e5700 1 -- 172.21.15.156:0/2605298299 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ec0094a0 con 0x7f24f009ad40 2023-09-30T22:24:48.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.671+0000 7f24f5ae6700 1 --2- 172.21.15.156:0/2605298299 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f01343d0 0x7f24f011ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:24:48.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.672+0000 7f24f52e5700 1 --2- 172.21.15.156:0/2605298299 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24f009ad40 0x7f24f011e180 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f24ec009fd0 tx=0x7f24ec004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:48.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.672+0000 7f24e5ffb700 1 -- 172.21.15.156:0/2605298299 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec0045d0 con 0x7f24f009ad40 2023-09-30T22:24:48.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.672+0000 7f24e5ffb700 1 -- 172.21.15.156:0/2605298299 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ec01e070 con 0x7f24f009ad40 2023-09-30T22:24:48.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.672+0000 7f24e5ffb700 1 -- 172.21.15.156:0/2605298299 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec0038e0 con 0x7f24f009ad40 2023-09-30T22:24:48.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.672+0000 7f24f7549700 1 -- 172.21.15.156:0/2605298299 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f0121720 con 0x7f24f009ad40 2023-09-30T22:24:48.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.672+0000 7f24f7549700 1 -- 172.21.15.156:0/2605298299 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f01213c0 con 0x7f24f009ad40 2023-09-30T22:24:48.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.673+0000 7f24e5ffb700 1 -- 172.21.15.156:0/2605298299 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f24ec003a40 con 0x7f24f009ad40 2023-09-30T22:24:48.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.673+0000 7f24e5ffb700 1 -- 172.21.15.156:0/2605298299 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f24ec040570 con 0x7f24f009ad40 2023-09-30T22:24:48.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.673+0000 7f24f7549700 1 -- 172.21.15.156:0/2605298299 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f004f2a0 con 0x7f24f009ad40 2023-09-30T22:24:48.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.678+0000 7f24e5ffb700 1 -- 172.21.15.156:0/2605298299 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f24ec015080 con 0x7f24f009ad40 2023-09-30T22:24:48.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.757+0000 7fb352651700 1 -- 172.21.15.156:0/2400784276 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb34c06bce0 con 0x7fb34c0a0a30 2023-09-30T22:24:48.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.757+0000 7fb348ff9700 1 -- 172.21.15.156:0/2400784276 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb33c010120 con 0x7fb34c0a0a30 2023-09-30T22:24:48.758 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:48.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.759+0000 7fb352651700 1 -- 172.21.15.156:0/2400784276 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34c0a0a30 msgr2=0x7fb34c11e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.759+0000 7fb352651700 1 --2- 172.21.15.156:0/2400784276 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34c0a0a30 0x7fb34c11e990 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00dcf0 tx=0x7fb33c009120 comp rx=0 tx=0).stop 2023-09-30T22:24:48.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.760+0000 7fb352651700 1 -- 172.21.15.156:0/2400784276 shutdown_connections 2023-09-30T22:24:48.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.760+0000 7fb352651700 1 --2- 172.21.15.156:0/2400784276 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb34c1304a0 0x7fb34c1c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.760+0000 7fb352651700 1 --2- 172.21.15.156:0/2400784276 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34c0a0a30 0x7fb34c11e990 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.760+0000 7fb352651700 1 --2- 172.21.15.156:0/2400784276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb34c0a1340 0x7fb34c11eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.760+0000 7fb352651700 1 -- 172.21.15.156:0/2400784276 >> 172.21.15.156:0/2400784276 conn(0x7fb34c0a2980 msgr2=0x7fb34c09e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:48.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.760+0000 7fb352651700 1 -- 172.21.15.156:0/2400784276 shutdown_connections 2023-09-30T22:24:48.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.760+0000 7fb352651700 1 -- 172.21.15.156:0/2400784276 wait complete. 2023-09-30T22:24:48.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:48.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.797+0000 7fa326457700 1 -- 172.21.15.156:0/588780871 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa3200729d0 con 0x7fa3200a0a70 2023-09-30T22:24:48.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.797+0000 7fa31cff9700 1 -- 172.21.15.156:0/588780871 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa314022300 con 0x7fa3200a0a70 2023-09-30T22:24:48.798 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:48.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.799+0000 7fa326457700 1 -- 172.21.15.156:0/588780871 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3200a0a70 msgr2=0x7fa3201c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.799+0000 7fa326457700 1 --2- 172.21.15.156:0/588780871 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3200a0a70 0x7fa3201c86d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fa31400e840 tx=0x7fa31400ec00 comp rx=0 tx=0).stop 2023-09-30T22:24:48.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.799+0000 7fa326457700 1 -- 172.21.15.156:0/588780871 shutdown_connections 2023-09-30T22:24:48.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.799+0000 7fa326457700 1 --2- 172.21.15.156:0/588780871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa320133f70 0x7fa3201c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.799+0000 7fa326457700 1 --2- 172.21.15.156:0/588780871 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa32009ad40 0x7fa3201c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.799+0000 7fa326457700 1 --2- 172.21.15.156:0/588780871 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa3200a0a70 0x7fa3201c86d0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.799+0000 7fa326457700 1 -- 172.21.15.156:0/588780871 >> 172.21.15.156:0/588780871 conn(0x7fa320099c40 msgr2=0x7fa3201bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:48.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.799+0000 7fa326457700 1 -- 172.21.15.156:0/588780871 shutdown_connections 2023-09-30T22:24:48.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.799+0000 7fa326457700 1 -- 172.21.15.156:0/588780871 wait complete. 2023-09-30T22:24:48.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:48.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.873+0000 7f24f7549700 1 -- 172.21.15.156:0/2605298299 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f24f009a300 con 0x7f24f009ad40 2023-09-30T22:24:48.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.874+0000 7f24e5ffb700 1 -- 172.21.15.156:0/2605298299 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f24ec02d7d0 con 0x7f24f009ad40 2023-09-30T22:24:48.875 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:48.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.876+0000 7f24f7549700 1 -- 172.21.15.156:0/2605298299 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24f009ad40 msgr2=0x7f24f011e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.876+0000 7f24f7549700 1 --2- 172.21.15.156:0/2605298299 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24f009ad40 0x7f24f011e180 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f24ec009fd0 tx=0x7f24ec004750 comp rx=0 tx=0).stop 2023-09-30T22:24:48.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.876+0000 7f24f7549700 1 -- 172.21.15.156:0/2605298299 shutdown_connections 2023-09-30T22:24:48.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.876+0000 7f24f7549700 1 --2- 172.21.15.156:0/2605298299 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f01343d0 0x7f24f011ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.876+0000 7f24f7549700 1 --2- 172.21.15.156:0/2605298299 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24f009ad40 0x7f24f011e180 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.876+0000 7f24f7549700 1 --2- 172.21.15.156:0/2605298299 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f24f0133f70 0x7f24f011e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.876+0000 7f24f7549700 1 -- 172.21.15.156:0/2605298299 >> 172.21.15.156:0/2605298299 conn(0x7f24f0099c40 msgr2=0x7f24f00a4110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:48.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.876+0000 7f24f7549700 1 -- 172.21.15.156:0/2605298299 shutdown_connections 2023-09-30T22:24:48.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:48.876+0000 7f24f7549700 1 -- 172.21.15.156:0/2605298299 wait complete. 2023-09-30T22:24:48.888 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:49.613 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:49.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.738+0000 7f8985f33700 1 Processor -- start 2023-09-30T22:24:49.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.738+0000 7f8985f33700 1 -- start start 2023-09-30T22:24:49.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.738+0000 7f8985f33700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f898009d860 0x7f898009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.738+0000 7f8985f33700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f898009e170 0x7f89801307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.738+0000 7f8985f33700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8980130ce0 0x7f8980131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.738+0000 7f8985f33700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f898009aaa0 con 0x7f8980130ce0 2023-09-30T22:24:49.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.738+0000 7f8985f33700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898009f870 con 0x7f898009d860 2023-09-30T22:24:49.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.738+0000 7f8985f33700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f898009b360 con 0x7f898009e170 2023-09-30T22:24:49.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.738+0000 7f897f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f898009d860 0x7f898009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.738+0000 7f897ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8980130ce0 0x7f8980131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.738+0000 7f897effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f898009e170 0x7f89801307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.738+0000 7f897ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8980130ce0 0x7f8980131150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52164/0 (socket says 172.21.15.156:52164) 2023-09-30T22:24:49.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.738+0000 7f897effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f898009e170 0x7f89801307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46320/0 (socket says 172.21.15.156:46320) 2023-09-30T22:24:49.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.738+0000 7f897ffff700 1 -- 172.21.15.156:0/288895552 learned_addr learned my addr 172.21.15.156:0/288895552 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:49.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.738+0000 7f897f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f898009d860 0x7f898009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38326/0 (socket says 172.21.15.156:38326) 2023-09-30T22:24:49.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.739+0000 7f897ffff700 1 -- 172.21.15.156:0/288895552 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f898009e170 msgr2=0x7f89801307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:49.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.739+0000 7f897ffff700 1 --2- 172.21.15.156:0/288895552 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f898009e170 0x7f89801307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.739+0000 7f897ffff700 1 -- 172.21.15.156:0/288895552 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f898009d860 msgr2=0x7f898009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:49.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.739+0000 7f897ffff700 1 --2- 172.21.15.156:0/288895552 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f898009d860 0x7f898009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.739+0000 7f897ffff700 1 -- 172.21.15.156:0/288895552 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898009b620 con 0x7f8980130ce0 2023-09-30T22:24:49.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.739+0000 7f897effd700 1 --2- 172.21.15.156:0/288895552 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f898009e170 0x7f89801307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:49.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.739+0000 7f897f7fe700 1 --2- 172.21.15.156:0/288895552 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f898009d860 0x7f898009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:49.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.739+0000 7f897ffff700 1 --2- 172.21.15.156:0/288895552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8980130ce0 0x7f8980131150 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f8978009e50 tx=0x7f897800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8a353d39329dad server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:49.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.739+0000 7f897e7fc700 1 -- 172.21.15.156:0/288895552 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897800e070 con 0x7f8980130ce0 2023-09-30T22:24:49.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.739+0000 7f897e7fc700 1 -- 172.21.15.156:0/288895552 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897800b910 con 0x7f8980130ce0 2023-09-30T22:24:49.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.739+0000 7f897e7fc700 1 -- 172.21.15.156:0/288895552 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897800bcc0 con 0x7f8980130ce0 2023-09-30T22:24:49.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.739+0000 7f8985f33700 1 -- 172.21.15.156:0/288895552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8980130ce0 msgr2=0x7f8980131150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:49.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.739+0000 7f8985f33700 1 --2- 172.21.15.156:0/288895552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8980130ce0 0x7f8980131150 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f8978009e50 tx=0x7f897800b330 comp rx=0 tx=0).stop 2023-09-30T22:24:49.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.739+0000 7f8985f33700 1 -- 172.21.15.156:0/288895552 shutdown_connections 2023-09-30T22:24:49.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.739+0000 7f8985f33700 1 --2- 172.21.15.156:0/288895552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8980130ce0 0x7f8980131150 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.739+0000 7f8985f33700 1 --2- 172.21.15.156:0/288895552 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f898009d860 0x7f898009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.739+0000 7f8985f33700 1 --2- 172.21.15.156:0/288895552 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f898009e170 0x7f89801307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.739+0000 7f8985f33700 1 -- 172.21.15.156:0/288895552 >> 172.21.15.156:0/288895552 conn(0x7f8980099c40 msgr2=0x7f89800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:49.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.739+0000 7f8985f33700 1 -- 172.21.15.156:0/288895552 shutdown_connections 2023-09-30T22:24:49.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.740+0000 7f8985f33700 1 -- 172.21.15.156:0/288895552 wait complete. 2023-09-30T22:24:49.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.740+0000 7f8985f33700 1 Processor -- start 2023-09-30T22:24:49.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.741+0000 7f8985f33700 1 -- start start 2023-09-30T22:24:49.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.741+0000 7f8985f33700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f898009d860 0x7f898011f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.741+0000 7f8985f33700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f898009e170 0x7f898011f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.741+0000 7f8985f33700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8980130ce0 0x7f898011fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.741+0000 7f8985f33700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8980122a60 con 0x7f898009d860 2023-09-30T22:24:49.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.741+0000 7f8985f33700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8980122d40 con 0x7f898009e170 2023-09-30T22:24:49.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.741+0000 7f8985f33700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f898009a150 con 0x7f8980130ce0 2023-09-30T22:24:49.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.741+0000 7f897f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f898009d860 0x7f898011f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.741+0000 7f897effd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f898009e170 0x7f898011f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.741+0000 7f897f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f898009d860 0x7f898011f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52174/0 (socket says 172.21.15.156:52174) 2023-09-30T22:24:49.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.741+0000 7f897f7fe700 1 -- 172.21.15.156:0/2396677744 learned_addr learned my addr 172.21.15.156:0/2396677744 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:49.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.741+0000 7f897ffff700 1 --2- 172.21.15.156:0/2396677744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8980130ce0 0x7f898011fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.741+0000 7f897f7fe700 1 -- 172.21.15.156:0/2396677744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8980130ce0 msgr2=0x7f898011fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:49.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.741+0000 7f897f7fe700 1 --2- 172.21.15.156:0/2396677744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8980130ce0 0x7f898011fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.741+0000 7f897f7fe700 1 -- 172.21.15.156:0/2396677744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f898009e170 msgr2=0x7f898011f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:49.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.741+0000 7f897f7fe700 1 --2- 172.21.15.156:0/2396677744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f898009e170 0x7f898011f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.741+0000 7f897f7fe700 1 -- 172.21.15.156:0/2396677744 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89740094a0 con 0x7f898009d860 2023-09-30T22:24:49.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.741+0000 7f897effd700 1 --2- 172.21.15.156:0/2396677744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f898009e170 0x7f898011f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:49.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.742+0000 7f897f7fe700 1 --2- 172.21.15.156:0/2396677744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f898009d860 0x7f898011f2b0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f897400ebe0 tx=0x7f897400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:49.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.742+0000 7f8967fff700 1 -- 172.21.15.156:0/2396677744 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8974009780 con 0x7f898009d860 2023-09-30T22:24:49.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.742+0000 7f8967fff700 1 -- 172.21.15.156:0/2396677744 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897400c850 con 0x7f898009d860 2023-09-30T22:24:49.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.742+0000 7f8985f33700 1 -- 172.21.15.156:0/2396677744 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89700094a0 con 0x7f898009d860 2023-09-30T22:24:49.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.742+0000 7f8967fff700 1 -- 172.21.15.156:0/2396677744 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897400cbe0 con 0x7f898009d860 2023-09-30T22:24:49.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.742+0000 7f8985f33700 1 -- 172.21.15.156:0/2396677744 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8978009b30 con 0x7f898009d860 2023-09-30T22:24:49.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.742+0000 7f8967fff700 1 -- 172.21.15.156:0/2396677744 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f897400cd40 con 0x7f898009d860 2023-09-30T22:24:49.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.743+0000 7f8985f33700 1 -- 172.21.15.156:0/2396677744 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89801228c0 con 0x7f898009d860 2023-09-30T22:24:49.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.743+0000 7f8967fff700 1 -- 172.21.15.156:0/2396677744 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f897403f740 con 0x7f898009d860 2023-09-30T22:24:49.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.747+0000 7f8967fff700 1 -- 172.21.15.156:0/2396677744 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f89801228c0 con 0x7f898009d860 2023-09-30T22:24:49.773 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:49.814 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:49.889 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:49.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.907+0000 7feb1303f700 1 Processor -- start 2023-09-30T22:24:49.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.907+0000 7feb1303f700 1 -- start start 2023-09-30T22:24:49.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.908+0000 7feb1303f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb0c131980 0x7feb0c131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.908+0000 7feb1303f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb0c09bc70 0x7feb0c09c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.908+0000 7feb1303f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7feb0c09c5c0 0x7feb0c138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.908+0000 7feb1303f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb0c06eb30 con 0x7feb0c09c5c0 2023-09-30T22:24:49.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.908+0000 7feb1303f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c0a1640 con 0x7feb0c131980 2023-09-30T22:24:49.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.908+0000 7feb1303f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c0a22d0 con 0x7feb0c09bc70 2023-09-30T22:24:49.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.908+0000 7feb0bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb0c09bc70 0x7feb0c09c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.908+0000 7feb115dc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7feb0c09c5c0 0x7feb0c138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.908+0000 7feb115dc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7feb0c09c5c0 0x7feb0c138700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52188/0 (socket says 172.21.15.156:52188) 2023-09-30T22:24:49.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.908+0000 7feb0bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb0c09bc70 0x7feb0c09c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46338/0 (socket says 172.21.15.156:46338) 2023-09-30T22:24:49.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.908+0000 7feb115dc700 1 -- 172.21.15.156:0/2061854623 learned_addr learned my addr 172.21.15.156:0/2061854623 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:49.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.908+0000 7feb10ddb700 1 --2- 172.21.15.156:0/2061854623 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb0c131980 0x7feb0c131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.909+0000 7feb10ddb700 1 -- 172.21.15.156:0/2061854623 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb0c09bc70 msgr2=0x7feb0c09c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:49.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.909+0000 7feb10ddb700 1 --2- 172.21.15.156:0/2061854623 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb0c09bc70 0x7feb0c09c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.909+0000 7feb10ddb700 1 -- 172.21.15.156:0/2061854623 >> v2:172.21.15.156:3300/0 conn(0x7feb0c09c5c0 msgr2=0x7feb0c138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:49.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.909+0000 7feb10ddb700 1 --2- 172.21.15.156:0/2061854623 >> v2:172.21.15.156:3300/0 conn(0x7feb0c09c5c0 0x7feb0c138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.909+0000 7feb10ddb700 1 -- 172.21.15.156:0/2061854623 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0c131550 con 0x7feb0c131980 2023-09-30T22:24:49.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.909+0000 7feb10ddb700 1 --2- 172.21.15.156:0/2061854623 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb0c131980 0x7feb0c131d50 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7feb00009820 tx=0x7feb00009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=559c73dcce84f34c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:49.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.909+0000 7feb115dc700 1 --2- 172.21.15.156:0/2061854623 >> v2:172.21.15.156:3300/0 conn(0x7feb0c09c5c0 0x7feb0c138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:49.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.909+0000 7feb0b7fe700 1 -- 172.21.15.156:0/2061854623 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb00005e30 con 0x7feb0c131980 2023-09-30T22:24:49.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.909+0000 7feb0b7fe700 1 -- 172.21.15.156:0/2061854623 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb00006030 con 0x7feb0c131980 2023-09-30T22:24:49.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.909+0000 7feb0b7fe700 1 -- 172.21.15.156:0/2061854623 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb000063a0 con 0x7feb0c131980 2023-09-30T22:24:49.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.910+0000 7feb1303f700 1 -- 172.21.15.156:0/2061854623 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb0c131980 msgr2=0x7feb0c131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:49.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.910+0000 7feb1303f700 1 --2- 172.21.15.156:0/2061854623 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb0c131980 0x7feb0c131d50 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7feb00009820 tx=0x7feb00009b30 comp rx=0 tx=0).stop 2023-09-30T22:24:49.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.910+0000 7feb1303f700 1 -- 172.21.15.156:0/2061854623 shutdown_connections 2023-09-30T22:24:49.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.910+0000 7feb1303f700 1 --2- 172.21.15.156:0/2061854623 >> v2:172.21.15.156:3300/0 conn(0x7feb0c09c5c0 0x7feb0c138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.910+0000 7feb1303f700 1 --2- 172.21.15.156:0/2061854623 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb0c131980 0x7feb0c131d50 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.910+0000 7feb1303f700 1 --2- 172.21.15.156:0/2061854623 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb0c09bc70 0x7feb0c09c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.910+0000 7feb1303f700 1 -- 172.21.15.156:0/2061854623 >> 172.21.15.156:0/2061854623 conn(0x7feb0c0a2980 msgr2=0x7feb0c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:49.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.910+0000 7feb1303f700 1 -- 172.21.15.156:0/2061854623 shutdown_connections 2023-09-30T22:24:49.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.910+0000 7feb1303f700 1 -- 172.21.15.156:0/2061854623 wait complete. 2023-09-30T22:24:49.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.911+0000 7feb1303f700 1 Processor -- start 2023-09-30T22:24:49.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.911+0000 7feb1303f700 1 -- start start 2023-09-30T22:24:49.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.912+0000 7feb1303f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb0c09bc70 0x7feb0c1c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.912+0000 7feb1303f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb0c09c5c0 0x7feb0c1c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.912+0000 7feb1303f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb0c131980 0x7feb0c12a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.912+0000 7feb1303f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c12edb0 con 0x7feb0c09bc70 2023-09-30T22:24:49.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.912+0000 7feb1303f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c12d880 con 0x7feb0c131980 2023-09-30T22:24:49.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.912+0000 7feb1303f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c0a1c40 con 0x7feb0c09c5c0 2023-09-30T22:24:49.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.912+0000 7feb10ddb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb0c09bc70 0x7feb0c1c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.912+0000 7feb10ddb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb0c09bc70 0x7feb0c1c8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52190/0 (socket says 172.21.15.156:52190) 2023-09-30T22:24:49.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.912+0000 7feb10ddb700 1 -- 172.21.15.156:0/328048015 learned_addr learned my addr 172.21.15.156:0/328048015 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:49.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.912+0000 7feb115dc700 1 --2- 172.21.15.156:0/328048015 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb0c131980 0x7feb0c12a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.912+0000 7feb0bfff700 1 --2- 172.21.15.156:0/328048015 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb0c09c5c0 0x7feb0c1c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.913+0000 7feb115dc700 1 -- 172.21.15.156:0/328048015 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb0c09c5c0 msgr2=0x7feb0c1c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:49.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.913+0000 7feb115dc700 1 --2- 172.21.15.156:0/328048015 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb0c09c5c0 0x7feb0c1c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.913+0000 7feb115dc700 1 -- 172.21.15.156:0/328048015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb0c09bc70 msgr2=0x7feb0c1c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:49.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.913+0000 7feb115dc700 1 --2- 172.21.15.156:0/328048015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb0c09bc70 0x7feb0c1c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.913+0000 7feb115dc700 1 -- 172.21.15.156:0/328048015 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb04009b30 con 0x7feb0c131980 2023-09-30T22:24:49.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.913+0000 7feb115dc700 1 --2- 172.21.15.156:0/328048015 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb0c131980 0x7feb0c12a560 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7feb0400efc0 tx=0x7feb0400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:49.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.913+0000 7feb097fa700 1 -- 172.21.15.156:0/328048015 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0400ca80 con 0x7feb0c131980 2023-09-30T22:24:49.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.913+0000 7feb1303f700 1 -- 172.21.15.156:0/328048015 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb00009430 con 0x7feb0c131980 2023-09-30T22:24:49.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.913+0000 7feb1303f700 1 -- 172.21.15.156:0/328048015 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb0c1c8f80 con 0x7feb0c131980 2023-09-30T22:24:49.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.913+0000 7feb097fa700 1 -- 172.21.15.156:0/328048015 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0400f040 con 0x7feb0c131980 2023-09-30T22:24:49.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.913+0000 7feb097fa700 1 -- 172.21.15.156:0/328048015 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0400cde0 con 0x7feb0c131980 2023-09-30T22:24:49.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.914+0000 7feb1303f700 1 -- 172.21.15.156:0/328048015 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaec0052e0 con 0x7feb0c131980 2023-09-30T22:24:49.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.915+0000 7feb097fa700 1 -- 172.21.15.156:0/328048015 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb04014480 con 0x7feb0c131980 2023-09-30T22:24:49.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.915+0000 7feb097fa700 1 -- 172.21.15.156:0/328048015 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feb040406f0 con 0x7feb0c131980 2023-09-30T22:24:49.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.920+0000 7feb097fa700 1 -- 172.21.15.156:0/328048015 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb040135c0 con 0x7feb0c131980 2023-09-30T22:24:49.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.944+0000 7f624f33a700 1 Processor -- start 2023-09-30T22:24:49.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.945+0000 7f624f33a700 1 -- start start 2023-09-30T22:24:49.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.945+0000 7f624f33a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6248066410 0x7f62481319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.945+0000 7f624f33a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6248131f30 0x7f624809c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.945+0000 7f624f33a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62480a0f20 con 0x7f62481314b0 2023-09-30T22:24:49.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.945+0000 7f624f33a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62480667e0 con 0x7f6248066410 2023-09-30T22:24:49.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.945+0000 7f624f33a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62480a23c0 con 0x7f6248131f30 2023-09-30T22:24:49.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.946+0000 7f624d0d6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6248066410 0x7f62481319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.946+0000 7f624d8d7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6248131f30 0x7f624809c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.946+0000 7f624d0d6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6248066410 0x7f62481319f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38354/0 (socket says 172.21.15.156:38354) 2023-09-30T22:24:49.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.946+0000 7f624d0d6700 1 -- 172.21.15.156:0/3369803378 learned_addr learned my addr 172.21.15.156:0/3369803378 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:49.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.946+0000 7f624d0d6700 1 -- 172.21.15.156:0/3369803378 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6248131f30 msgr2=0x7f624809c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:49.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.946+0000 7f624d0d6700 1 --2- 172.21.15.156:0/3369803378 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6248131f30 0x7f624809c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.946+0000 7f624d0d6700 1 -- 172.21.15.156:0/3369803378 >> v1:172.21.15.156:6789/0 conn(0x7f62481314b0 legacy=0x7f624809bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:49.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.946+0000 7f624d0d6700 1 -- 172.21.15.156:0/3369803378 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62481323b0 con 0x7f6248066410 2023-09-30T22:24:49.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.946+0000 7f624d0d6700 1 --2- 172.21.15.156:0/3369803378 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6248066410 0x7f62481319f0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6244009920 tx=0x7f6244009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b228035bf967829 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:49.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.946+0000 7f623ffff700 1 -- 172.21.15.156:0/3369803378 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6244005e30 con 0x7f6248066410 2023-09-30T22:24:49.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.946+0000 7f623ffff700 1 -- 172.21.15.156:0/3369803378 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6244004030 con 0x7f6248066410 2023-09-30T22:24:49.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.946+0000 7f623ffff700 1 -- 172.21.15.156:0/3369803378 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62440043e0 con 0x7f6248066410 2023-09-30T22:24:49.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.947+0000 7f624f33a700 1 -- 172.21.15.156:0/3369803378 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6248066410 msgr2=0x7f62481319f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:49.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.947+0000 7f624f33a700 1 --2- 172.21.15.156:0/3369803378 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6248066410 0x7f62481319f0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6244009920 tx=0x7f6244009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:49.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.947+0000 7f624f33a700 1 -- 172.21.15.156:0/3369803378 shutdown_connections 2023-09-30T22:24:49.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.947+0000 7f624f33a700 1 --2- 172.21.15.156:0/3369803378 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6248066410 0x7f62481319f0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.947+0000 7f624f33a700 1 --2- 172.21.15.156:0/3369803378 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6248131f30 0x7f624809c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.947+0000 7f624f33a700 1 -- 172.21.15.156:0/3369803378 >> 172.21.15.156:0/3369803378 conn(0x7f62480a2980 msgr2=0x7f62480a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:49.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.947+0000 7f624f33a700 1 -- 172.21.15.156:0/3369803378 shutdown_connections 2023-09-30T22:24:49.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.947+0000 7f624f33a700 1 -- 172.21.15.156:0/3369803378 wait complete. 2023-09-30T22:24:49.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.948+0000 7f624f33a700 1 Processor -- start 2023-09-30T22:24:49.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.948+0000 7f624f33a700 1 -- start start 2023-09-30T22:24:49.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.949+0000 7f624f33a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6248066410 0x7f6248134540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.949+0000 7f624f33a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62481314b0 0x7f6248134a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.949+0000 7f624f33a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6248131f30 0x7f6248134fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.949+0000 7f624f33a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6248138930 con 0x7f6248066410 2023-09-30T22:24:49.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.949+0000 7f624f33a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6248135fd0 con 0x7f6248131f30 2023-09-30T22:24:49.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.949+0000 7f624f33a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6248137f50 con 0x7f62481314b0 2023-09-30T22:24:49.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.949+0000 7f624d8d7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6248131f30 0x7f6248134fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.949+0000 7f624d8d7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6248131f30 0x7f6248134fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38366/0 (socket says 172.21.15.156:38366) 2023-09-30T22:24:49.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.949+0000 7f624d8d7700 1 -- 172.21.15.156:0/1789973820 learned_addr learned my addr 172.21.15.156:0/1789973820 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:49.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.949+0000 7f624d8d7700 1 -- 172.21.15.156:0/1789973820 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62481314b0 msgr2=0x7f6248134a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:49.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.949+0000 7f624d8d7700 1 --2- 172.21.15.156:0/1789973820 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62481314b0 0x7f6248134a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.949+0000 7f624d8d7700 1 -- 172.21.15.156:0/1789973820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6248066410 msgr2=0x7f6248134540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:49.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.949+0000 7f624d8d7700 1 --2- 172.21.15.156:0/1789973820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6248066410 0x7f6248134540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.949+0000 7f624d8d7700 1 -- 172.21.15.156:0/1789973820 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6244009500 con 0x7f6248131f30 2023-09-30T22:24:49.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.949+0000 7f624d8d7700 1 --2- 172.21.15.156:0/1789973820 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6248131f30 0x7f6248134fc0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f624000efc0 tx=0x7f624000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:49.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.950+0000 7f623dffb700 1 -- 172.21.15.156:0/1789973820 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624000cd40 con 0x7f6248131f30 2023-09-30T22:24:49.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.950+0000 7f623dffb700 1 -- 172.21.15.156:0/1789973820 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624000f040 con 0x7f6248131f30 2023-09-30T22:24:49.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.950+0000 7f624f33a700 1 -- 172.21.15.156:0/1789973820 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6248138b30 con 0x7f6248131f30 2023-09-30T22:24:49.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.950+0000 7f623dffb700 1 -- 172.21.15.156:0/1789973820 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62400146c0 con 0x7f6248131f30 2023-09-30T22:24:49.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.950+0000 7f624f33a700 1 -- 172.21.15.156:0/1789973820 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f624809a2e0 con 0x7f6248131f30 2023-09-30T22:24:49.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.951+0000 7f624f33a700 1 -- 172.21.15.156:0/1789973820 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624804f2a0 con 0x7f6248131f30 2023-09-30T22:24:49.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.952+0000 7f623dffb700 1 -- 172.21.15.156:0/1789973820 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6240014820 con 0x7f6248131f30 2023-09-30T22:24:49.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.952+0000 7f623dffb700 1 -- 172.21.15.156:0/1789973820 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6240040b70 con 0x7f6248131f30 2023-09-30T22:24:49.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.956+0000 7f623dffb700 1 -- 172.21.15.156:0/1789973820 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6240012930 con 0x7f6248131f30 2023-09-30T22:24:49.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.960+0000 7f8985f33700 1 -- 172.21.15.156:0/2396677744 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f89801228c0 con 0x7f898009d860 2023-09-30T22:24:49.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.961+0000 7f8967fff700 1 -- 172.21.15.156:0/2396677744 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f89801228c0 con 0x7f898009d860 2023-09-30T22:24:49.961 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.963+0000 7f8985f33700 1 -- 172.21.15.156:0/2396677744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f898009d860 msgr2=0x7f898011f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.963+0000 7f8985f33700 1 --2- 172.21.15.156:0/2396677744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f898009d860 0x7f898011f2b0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f897400ebe0 tx=0x7f897400eef0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.963+0000 7f8985f33700 1 -- 172.21.15.156:0/2396677744 shutdown_connections 2023-09-30T22:24:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.963+0000 7f8985f33700 1 --2- 172.21.15.156:0/2396677744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8980130ce0 0x7f898011fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.963+0000 7f8985f33700 1 --2- 172.21.15.156:0/2396677744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f898009d860 0x7f898011f2b0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.963+0000 7f8985f33700 1 --2- 172.21.15.156:0/2396677744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f898009e170 0x7f898011f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.963+0000 7f8985f33700 1 -- 172.21.15.156:0/2396677744 >> 172.21.15.156:0/2396677744 conn(0x7f8980099c40 msgr2=0x7f898006f880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.963+0000 7f8985f33700 1 -- 172.21.15.156:0/2396677744 shutdown_connections 2023-09-30T22:24:49.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:49.963+0000 7f8985f33700 1 -- 172.21.15.156:0/2396677744 wait complete. 2023-09-30T22:24:49.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:50.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.020+0000 7f00b526d700 1 Processor -- start 2023-09-30T22:24:50.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.020+0000 7f00b526d700 1 -- start start 2023-09-30T22:24:50.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.021+0000 7f00b526d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00b009f350 0x7f00b0136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:50.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.021+0000 7f00b526d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f00b01371c0 0x7f00b01395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:50.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.021+0000 7f00b526d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b009c970 con 0x7f00b009e870 2023-09-30T22:24:50.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.021+0000 7f00b526d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b00a0920 con 0x7f00b01371c0 2023-09-30T22:24:50.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.021+0000 7f00b526d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b009f9c0 con 0x7f00b009f350 2023-09-30T22:24:50.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.021+0000 7f00ae7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00b009f350 0x7f00b0136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:50.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.021+0000 7f00ae7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00b009f350 0x7f00b0136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38378/0 (socket says 172.21.15.156:38378) 2023-09-30T22:24:50.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.021+0000 7f00ae7fc700 1 -- 172.21.15.156:0/3250162944 learned_addr learned my addr 172.21.15.156:0/3250162944 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:50.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.021+0000 7f00af7fe700 1 --2- 172.21.15.156:0/3250162944 >> v2:172.21.15.156:3300/0 conn(0x7f00b01371c0 0x7f00b01395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:50.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.021+0000 7f00af7fe700 1 -- 172.21.15.156:0/3250162944 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00b009f350 msgr2=0x7f00b0136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:50.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.021+0000 7f00af7fe700 1 --2- 172.21.15.156:0/3250162944 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00b009f350 0x7f00b0136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.021+0000 7f00af7fe700 1 -- 172.21.15.156:0/3250162944 >> v1:172.21.15.156:6789/0 conn(0x7f00b009e870 legacy=0x7f00b009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:50.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.021+0000 7f00adffb700 1 -- 172.21.15.156:0/3250162944 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741045778 0 0) 0x7f00b009c970 con 0x7f00b009e870 2023-09-30T22:24:50.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.021+0000 7f00af7fe700 1 -- 172.21.15.156:0/3250162944 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b009bab0 con 0x7f00b01371c0 2023-09-30T22:24:50.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.021+0000 7f00ae7fc700 1 --2- 172.21.15.156:0/3250162944 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00b009f350 0x7f00b0136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:50.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.021+0000 7f00af7fe700 1 --2- 172.21.15.156:0/3250162944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00b01371c0 0x7f00b01395a0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009d90 tx=0x7f00a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb9e6dc7cdfce80c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:50.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.022+0000 7f00adffb700 1 -- 172.21.15.156:0/3250162944 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a800e070 con 0x7f00b01371c0 2023-09-30T22:24:50.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.022+0000 7f00adffb700 1 -- 172.21.15.156:0/3250162944 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a800bb20 con 0x7f00b01371c0 2023-09-30T22:24:50.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.022+0000 7f00adffb700 1 -- 172.21.15.156:0/3250162944 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8012430 con 0x7f00b01371c0 2023-09-30T22:24:50.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.022+0000 7f00b526d700 1 -- 172.21.15.156:0/3250162944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00b01371c0 msgr2=0x7f00b01395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:50.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.022+0000 7f00b526d700 1 --2- 172.21.15.156:0/3250162944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00b01371c0 0x7f00b01395a0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009d90 tx=0x7f00a800b330 comp rx=0 tx=0).stop 2023-09-30T22:24:50.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.022+0000 7f00b526d700 1 -- 172.21.15.156:0/3250162944 shutdown_connections 2023-09-30T22:24:50.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.022+0000 7f00b526d700 1 --2- 172.21.15.156:0/3250162944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00b01371c0 0x7f00b01395a0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.022+0000 7f00b526d700 1 --2- 172.21.15.156:0/3250162944 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00b009f350 0x7f00b0136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.022+0000 7f00b526d700 1 -- 172.21.15.156:0/3250162944 >> 172.21.15.156:0/3250162944 conn(0x7f00b00a4430 msgr2=0x7f00b00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:50.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.022+0000 7f00b526d700 1 -- 172.21.15.156:0/3250162944 shutdown_connections 2023-09-30T22:24:50.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.022+0000 7f00b526d700 1 -- 172.21.15.156:0/3250162944 wait complete. 2023-09-30T22:24:50.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.024+0000 7f00b526d700 1 Processor -- start 2023-09-30T22:24:50.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.024+0000 7f00b526d700 1 -- start start 2023-09-30T22:24:50.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.024+0000 7f00b526d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00b009e870 0x7f00b0120760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:50.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.024+0000 7f00b526d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00b009f350 0x7f00b0120ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:50.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.024+0000 7f00b526d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f00b01371c0 0x7f00b01211e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:50.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.024+0000 7f00b526d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b0124400 con 0x7f00b009f350 2023-09-30T22:24:50.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.024+0000 7f00b526d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b0122370 con 0x7f00b009e870 2023-09-30T22:24:50.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.024+0000 7f00b526d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00b0122990 con 0x7f00b01371c0 2023-09-30T22:24:50.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.024+0000 7f00aeffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00b009e870 0x7f00b0120760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:50.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.024+0000 7f00aeffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00b009e870 0x7f00b0120760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38384/0 (socket says 172.21.15.156:38384) 2023-09-30T22:24:50.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.024+0000 7f00aeffd700 1 -- 172.21.15.156:0/1044988066 learned_addr learned my addr 172.21.15.156:0/1044988066 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:50.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.024+0000 7f00ae7fc700 1 --2- 172.21.15.156:0/1044988066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00b009f350 0x7f00b0120ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:50.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.024+0000 7f00af7fe700 1 --2- 172.21.15.156:0/1044988066 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f00b01371c0 0x7f00b01211e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:50.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.025+0000 7f00ae7fc700 1 -- 172.21.15.156:0/1044988066 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f00b01371c0 msgr2=0x7f00b01211e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:50.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.025+0000 7f00ae7fc700 1 --2- 172.21.15.156:0/1044988066 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f00b01371c0 0x7f00b01211e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.025+0000 7f00ae7fc700 1 -- 172.21.15.156:0/1044988066 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00b009e870 msgr2=0x7f00b0120760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:50.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.025+0000 7f00ae7fc700 1 --2- 172.21.15.156:0/1044988066 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00b009e870 0x7f00b0120760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.025+0000 7f00ae7fc700 1 -- 172.21.15.156:0/1044988066 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a4009550 con 0x7f00b009f350 2023-09-30T22:24:50.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.025+0000 7f00ae7fc700 1 --2- 172.21.15.156:0/1044988066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00b009f350 0x7f00b0120ca0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f00a400e9d0 tx=0x7f00a400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:50.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.025+0000 7f00977fe700 1 -- 172.21.15.156:0/1044988066 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a400ee70 con 0x7f00b009f350 2023-09-30T22:24:50.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.025+0000 7f00977fe700 1 -- 172.21.15.156:0/1044988066 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a4004030 con 0x7f00b009f350 2023-09-30T22:24:50.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.025+0000 7f00977fe700 1 -- 172.21.15.156:0/1044988066 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a40043c0 con 0x7f00b009f350 2023-09-30T22:24:50.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.025+0000 7f00b526d700 1 -- 172.21.15.156:0/1044988066 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a8009a70 con 0x7f00b009f350 2023-09-30T22:24:50.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.025+0000 7f00b526d700 1 -- 172.21.15.156:0/1044988066 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b0123ff0 con 0x7f00b009f350 2023-09-30T22:24:50.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.026+0000 7f00977fe700 1 -- 172.21.15.156:0/1044988066 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f00a400c850 con 0x7f00b009f350 2023-09-30T22:24:50.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.026+0000 7f00b526d700 1 -- 172.21.15.156:0/1044988066 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b0123e00 con 0x7f00b009f350 2023-09-30T22:24:50.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.026+0000 7f00977fe700 1 -- 172.21.15.156:0/1044988066 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f00a403f830 con 0x7f00b009f350 2023-09-30T22:24:50.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.031+0000 7f00977fe700 1 -- 172.21.15.156:0/1044988066 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f00b0123e00 con 0x7f00b009f350 2023-09-30T22:24:50.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.135+0000 7feb1303f700 1 -- 172.21.15.156:0/328048015 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7feaec005860 con 0x7feb0c131980 2023-09-30T22:24:50.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.136+0000 7feb097fa700 1 -- 172.21.15.156:0/328048015 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb040133e0 con 0x7feb0c131980 2023-09-30T22:24:50.136 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:50.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.138+0000 7feb1303f700 1 -- 172.21.15.156:0/328048015 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb0c131980 msgr2=0x7feb0c12a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:50.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.138+0000 7feb1303f700 1 --2- 172.21.15.156:0/328048015 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb0c131980 0x7feb0c12a560 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7feb0400efc0 tx=0x7feb0400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.138+0000 7feb1303f700 1 -- 172.21.15.156:0/328048015 shutdown_connections 2023-09-30T22:24:50.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.138+0000 7feb1303f700 1 --2- 172.21.15.156:0/328048015 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feb0c131980 0x7feb0c12a560 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.138+0000 7feb1303f700 1 --2- 172.21.15.156:0/328048015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb0c09bc70 0x7feb0c1c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.138+0000 7feb1303f700 1 --2- 172.21.15.156:0/328048015 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feb0c09c5c0 0x7feb0c1c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.138+0000 7feb1303f700 1 -- 172.21.15.156:0/328048015 >> 172.21.15.156:0/328048015 conn(0x7feb0c0a2980 msgr2=0x7feb0c129220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:50.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.138+0000 7feb1303f700 1 -- 172.21.15.156:0/328048015 shutdown_connections 2023-09-30T22:24:50.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.138+0000 7feb1303f700 1 -- 172.21.15.156:0/328048015 wait complete. 2023-09-30T22:24:50.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:50.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.167+0000 7f624f33a700 1 -- 172.21.15.156:0/1789973820 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f62480724e0 con 0x7f6248131f30 2023-09-30T22:24:50.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.167+0000 7f623dffb700 1 -- 172.21.15.156:0/1789973820 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6240012340 con 0x7f6248131f30 2023-09-30T22:24:50.167 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:50.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.169+0000 7f624f33a700 1 -- 172.21.15.156:0/1789973820 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6248131f30 msgr2=0x7f6248134fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:50.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.169+0000 7f624f33a700 1 --2- 172.21.15.156:0/1789973820 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6248131f30 0x7f6248134fc0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f624000efc0 tx=0x7f624000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.169+0000 7f624f33a700 1 -- 172.21.15.156:0/1789973820 shutdown_connections 2023-09-30T22:24:50.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.169+0000 7f624f33a700 1 --2- 172.21.15.156:0/1789973820 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6248131f30 0x7f6248134fc0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.169+0000 7f624f33a700 1 --2- 172.21.15.156:0/1789973820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6248066410 0x7f6248134540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.169+0000 7f624f33a700 1 --2- 172.21.15.156:0/1789973820 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f62481314b0 0x7f6248134a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.169+0000 7f624f33a700 1 -- 172.21.15.156:0/1789973820 >> 172.21.15.156:0/1789973820 conn(0x7f62480a2980 msgr2=0x7f6248130240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:50.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.169+0000 7f624f33a700 1 -- 172.21.15.156:0/1789973820 shutdown_connections 2023-09-30T22:24:50.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.169+0000 7f624f33a700 1 -- 172.21.15.156:0/1789973820 wait complete. 2023-09-30T22:24:50.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:50.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.227+0000 7f00b526d700 1 -- 172.21.15.156:0/1044988066 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f00b0123ff0 con 0x7f00b009f350 2023-09-30T22:24:50.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.228+0000 7f00977fe700 1 -- 172.21.15.156:0/1044988066 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f00b0123ff0 con 0x7f00b009f350 2023-09-30T22:24:50.228 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:50.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.229+0000 7f00b526d700 1 -- 172.21.15.156:0/1044988066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00b009f350 msgr2=0x7f00b0120ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:50.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.229+0000 7f00b526d700 1 --2- 172.21.15.156:0/1044988066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00b009f350 0x7f00b0120ca0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f00a400e9d0 tx=0x7f00a400ece0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.230+0000 7f00b526d700 1 -- 172.21.15.156:0/1044988066 shutdown_connections 2023-09-30T22:24:50.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.230+0000 7f00b526d700 1 --2- 172.21.15.156:0/1044988066 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f00b01371c0 0x7f00b01211e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.230+0000 7f00b526d700 1 --2- 172.21.15.156:0/1044988066 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f00b009e870 0x7f00b0120760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.230+0000 7f00b526d700 1 --2- 172.21.15.156:0/1044988066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00b009f350 0x7f00b0120ca0 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.230+0000 7f00b526d700 1 -- 172.21.15.156:0/1044988066 >> 172.21.15.156:0/1044988066 conn(0x7f00b00a4430 msgr2=0x7f00b00a28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:50.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.230+0000 7f00b526d700 1 -- 172.21.15.156:0/1044988066 shutdown_connections 2023-09-30T22:24:50.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:50.230+0000 7f00b526d700 1 -- 172.21.15.156:0/1044988066 wait complete. 2023-09-30T22:24:50.242 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:50.977 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:51.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.109+0000 7f6fd5e12700 1 Processor -- start 2023-09-30T22:24:51.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.110+0000 7f6fd5e12700 1 -- start start 2023-09-30T22:24:51.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.110+0000 7f6fd5e12700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6fd0136960 0x7f6fd0138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.110+0000 7f6fd5e12700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fd0139280 0x7f6fd013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.110+0000 7f6fd5e12700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd006b2d0 con 0x7f6fd0133ad0 2023-09-30T22:24:51.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.110+0000 7f6fd5e12700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd01345b0 con 0x7f6fd0136960 2023-09-30T22:24:51.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.110+0000 7f6fd5e12700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd0133610 con 0x7f6fd0139280 2023-09-30T22:24:51.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.110+0000 7f6fcffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fd0139280 0x7f6fd013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.110+0000 7f6fceffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6fd0136960 0x7f6fd0138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.110+0000 7f6fceffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6fd0136960 0x7f6fd0138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52228/0 (socket says 172.21.15.156:52228) 2023-09-30T22:24:51.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.110+0000 7f6fcffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fd0139280 0x7f6fd013b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46386/0 (socket says 172.21.15.156:46386) 2023-09-30T22:24:51.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.110+0000 7f6fcffff700 1 -- 172.21.15.156:0/2207231670 learned_addr learned my addr 172.21.15.156:0/2207231670 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:51.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.110+0000 7f6fcf7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6fd0133ad0 0x7f6fd0133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37928/0 (socket says 172.21.15.156:37928) 2023-09-30T22:24:51.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.110+0000 7f6fcffff700 1 -- 172.21.15.156:0/2207231670 >> v2:172.21.15.156:3300/0 conn(0x7f6fd0136960 msgr2=0x7f6fd0138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:51.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.110+0000 7f6fcffff700 1 --2- 172.21.15.156:0/2207231670 >> v2:172.21.15.156:3300/0 conn(0x7f6fd0136960 0x7f6fd0138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.110+0000 7f6fcffff700 1 -- 172.21.15.156:0/2207231670 >> v1:172.21.15.156:6789/0 conn(0x7f6fd0133ad0 legacy=0x7f6fd0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.110+0000 7f6fcffff700 1 -- 172.21.15.156:0/2207231670 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd009a500 con 0x7f6fd0139280 2023-09-30T22:24:51.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.110+0000 7f6fce7fc700 1 -- 172.21.15.156:0/2207231670 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3126712046 0 0) 0x7f6fd006b2d0 con 0x7f6fd0133ad0 2023-09-30T22:24:51.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.110+0000 7f6fceffd700 1 --2- 172.21.15.156:0/2207231670 >> v2:172.21.15.156:3300/0 conn(0x7f6fd0136960 0x7f6fd0138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:51.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.111+0000 7f6fcffff700 1 --2- 172.21.15.156:0/2207231670 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fd0139280 0x7f6fd013b660 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8009e50 tx=0x7f6fc800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6ce4e8389d358ed server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:51.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.111+0000 7f6fce7fc700 1 -- 172.21.15.156:0/2207231670 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc800e070 con 0x7f6fd0139280 2023-09-30T22:24:51.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.111+0000 7f6fce7fc700 1 -- 172.21.15.156:0/2207231670 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc800b910 con 0x7f6fd0139280 2023-09-30T22:24:51.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.111+0000 7f6fce7fc700 1 -- 172.21.15.156:0/2207231670 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc800bcc0 con 0x7f6fd0139280 2023-09-30T22:24:51.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.111+0000 7f6fd5e12700 1 -- 172.21.15.156:0/2207231670 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fd0139280 msgr2=0x7f6fd013b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.111+0000 7f6fd5e12700 1 --2- 172.21.15.156:0/2207231670 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fd0139280 0x7f6fd013b660 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8009e50 tx=0x7f6fc800b330 comp rx=0 tx=0).stop 2023-09-30T22:24:51.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.111+0000 7f6fd5e12700 1 -- 172.21.15.156:0/2207231670 shutdown_connections 2023-09-30T22:24:51.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.111+0000 7f6fd5e12700 1 --2- 172.21.15.156:0/2207231670 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fd0139280 0x7f6fd013b660 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.111+0000 7f6fd5e12700 1 --2- 172.21.15.156:0/2207231670 >> v2:172.21.15.156:3300/0 conn(0x7f6fd0136960 0x7f6fd0138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.111+0000 7f6fd5e12700 1 -- 172.21.15.156:0/2207231670 >> 172.21.15.156:0/2207231670 conn(0x7f6fd0099c40 msgr2=0x7f6fd00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:51.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.111+0000 7f6fd5e12700 1 -- 172.21.15.156:0/2207231670 shutdown_connections 2023-09-30T22:24:51.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.111+0000 7f6fd5e12700 1 -- 172.21.15.156:0/2207231670 wait complete. 2023-09-30T22:24:51.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.112+0000 7f6fd5e12700 1 Processor -- start 2023-09-30T22:24:51.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.112+0000 7f6fd5e12700 1 -- start start 2023-09-30T22:24:51.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.113+0000 7f6fd5e12700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fd0133ad0 0x7f6fd012cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.113+0000 7f6fd5e12700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fd0136960 0x7f6fd012d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.113+0000 7f6fd5e12700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fd0139280 0x7f6fd012d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.113+0000 7f6fd5e12700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd0130420 con 0x7f6fd0136960 2023-09-30T22:24:51.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.113+0000 7f6fd5e12700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd0072600 con 0x7f6fd0133ad0 2023-09-30T22:24:51.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.113+0000 7f6fd5e12700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd012dd00 con 0x7f6fd0139280 2023-09-30T22:24:51.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.113+0000 7f6fcffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fd0139280 0x7f6fd012d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.113+0000 7f6fcf7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fd0133ad0 0x7f6fd012cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.113+0000 7f6fcffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fd0139280 0x7f6fd012d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46394/0 (socket says 172.21.15.156:46394) 2023-09-30T22:24:51.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.113+0000 7f6fcffff700 1 -- 172.21.15.156:0/1890202231 learned_addr learned my addr 172.21.15.156:0/1890202231 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:51.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.113+0000 7f6fceffd700 1 --2- 172.21.15.156:0/1890202231 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fd0136960 0x7f6fd012d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.113+0000 7f6fcffff700 1 -- 172.21.15.156:0/1890202231 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fd0133ad0 msgr2=0x7f6fd012cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.113+0000 7f6fcffff700 1 --2- 172.21.15.156:0/1890202231 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fd0133ad0 0x7f6fd012cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.113+0000 7f6fcffff700 1 -- 172.21.15.156:0/1890202231 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fd0136960 msgr2=0x7f6fd012d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.113+0000 7f6fcffff700 1 --2- 172.21.15.156:0/1890202231 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fd0136960 0x7f6fd012d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.113+0000 7f6fcffff700 1 -- 172.21.15.156:0/1890202231 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc00094a0 con 0x7f6fd0139280 2023-09-30T22:24:51.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.113+0000 7f6fcf7fe700 1 --2- 172.21.15.156:0/1890202231 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fd0133ad0 0x7f6fd012cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:51.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.113+0000 7f6fceffd700 1 --2- 172.21.15.156:0/1890202231 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fd0136960 0x7f6fd012d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:51.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.113+0000 7f6fcffff700 1 --2- 172.21.15.156:0/1890202231 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fd0139280 0x7f6fd012d5b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8012000 tx=0x7f6fc8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:51.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.114+0000 7f6fc7fff700 1 -- 172.21.15.156:0/1890202231 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8003ea0 con 0x7f6fd0139280 2023-09-30T22:24:51.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.114+0000 7f6fc7fff700 1 -- 172.21.15.156:0/1890202231 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc80048e0 con 0x7f6fd0139280 2023-09-30T22:24:51.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.114+0000 7f6fd5e12700 1 -- 172.21.15.156:0/1890202231 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc8009b30 con 0x7f6fd0139280 2023-09-30T22:24:51.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.114+0000 7f6fc7fff700 1 -- 172.21.15.156:0/1890202231 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc801c650 con 0x7f6fd0139280 2023-09-30T22:24:51.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.114+0000 7f6fd5e12700 1 -- 172.21.15.156:0/1890202231 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd006fa10 con 0x7f6fd0139280 2023-09-30T22:24:51.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.114+0000 7f6fc7fff700 1 -- 172.21.15.156:0/1890202231 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6fc801c7b0 con 0x7f6fd0139280 2023-09-30T22:24:51.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.115+0000 7f6fc7fff700 1 -- 172.21.15.156:0/1890202231 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6fc8040ec0 con 0x7f6fd0139280 2023-09-30T22:24:51.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.115+0000 7f6fd5e12700 1 -- 172.21.15.156:0/1890202231 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fd004f2a0 con 0x7f6fd0139280 2023-09-30T22:24:51.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.119+0000 7f6fc7fff700 1 -- 172.21.15.156:0/1890202231 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6fc802c930 con 0x7f6fd0139280 2023-09-30T22:24:51.151 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:51.183 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:51.243 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:51.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.281+0000 7fc8f8f0e700 1 Processor -- start 2023-09-30T22:24:51.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.281+0000 7fc8f8f0e700 1 -- start start 2023-09-30T22:24:51.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.282+0000 7fc8f8f0e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8f409d860 0x7fc8f409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.282+0000 7fc8f8f0e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8f4130eb0 0x7fc8f4138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.282+0000 7fc8f8f0e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f409aaa0 con 0x7fc8f409e170 2023-09-30T22:24:51.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.282+0000 7fc8f8f0e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f409f870 con 0x7fc8f4130eb0 2023-09-30T22:24:51.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.282+0000 7fc8f8f0e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f409b360 con 0x7fc8f409d860 2023-09-30T22:24:51.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.282+0000 7fc8f259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8f409d860 0x7fc8f409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.282+0000 7fc8f259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8f409d860 0x7fc8f409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36642/0 (socket says 172.21.15.156:36642) 2023-09-30T22:24:51.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.282+0000 7fc8f259c700 1 -- 172.21.15.156:0/380344009 learned_addr learned my addr 172.21.15.156:0/380344009 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:51.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.282+0000 7fc8f2d9d700 1 --2- 172.21.15.156:0/380344009 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8f4130eb0 0x7fc8f4138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.282+0000 7fc8f259c700 1 -- 172.21.15.156:0/380344009 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8f4130eb0 msgr2=0x7fc8f4138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:51.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.282+0000 7fc8f259c700 1 --2- 172.21.15.156:0/380344009 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8f4130eb0 0x7fc8f4138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.282+0000 7fc8f259c700 1 -- 172.21.15.156:0/380344009 >> v1:172.21.15.156:6789/0 conn(0x7fc8f409e170 legacy=0x7fc8f41307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.282+0000 7fc8f259c700 1 -- 172.21.15.156:0/380344009 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f409b620 con 0x7fc8f409d860 2023-09-30T22:24:51.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.283+0000 7fc8f259c700 1 --2- 172.21.15.156:0/380344009 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8f409d860 0x7fc8f409dc30 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400bbc0 tx=0x7fc8e400bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0f70123ecff37a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:51.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.283+0000 7fc8f159a700 1 -- 172.21.15.156:0/380344009 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e400dd30 con 0x7fc8f409d860 2023-09-30T22:24:51.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.283+0000 7fc8f159a700 1 -- 172.21.15.156:0/380344009 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e400de90 con 0x7fc8f409d860 2023-09-30T22:24:51.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.283+0000 7fc8f159a700 1 -- 172.21.15.156:0/380344009 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4010690 con 0x7fc8f409d860 2023-09-30T22:24:51.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.283+0000 7fc8f8f0e700 1 -- 172.21.15.156:0/380344009 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8f409d860 msgr2=0x7fc8f409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.283+0000 7fc8f8f0e700 1 --2- 172.21.15.156:0/380344009 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8f409d860 0x7fc8f409dc30 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400bbc0 tx=0x7fc8e400bed0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.284+0000 7fc8f8f0e700 1 -- 172.21.15.156:0/380344009 shutdown_connections 2023-09-30T22:24:51.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.284+0000 7fc8f8f0e700 1 --2- 172.21.15.156:0/380344009 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8f4130eb0 0x7fc8f4138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.284+0000 7fc8f8f0e700 1 --2- 172.21.15.156:0/380344009 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8f409d860 0x7fc8f409dc30 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.284+0000 7fc8f8f0e700 1 -- 172.21.15.156:0/380344009 >> 172.21.15.156:0/380344009 conn(0x7fc8f4099c40 msgr2=0x7fc8f40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:51.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.284+0000 7fc8f8f0e700 1 -- 172.21.15.156:0/380344009 shutdown_connections 2023-09-30T22:24:51.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.284+0000 7fc8f8f0e700 1 -- 172.21.15.156:0/380344009 wait complete. 2023-09-30T22:24:51.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.285+0000 7fc8f8f0e700 1 Processor -- start 2023-09-30T22:24:51.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.285+0000 7fc8f8f0e700 1 -- start start 2023-09-30T22:24:51.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.285+0000 7fc8f8f0e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8f409d860 0x7fc8f411e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.285+0000 7fc8f8f0e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8f409e170 0x7fc8f411eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.285+0000 7fc8f8f0e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8f4130eb0 0x7fc8f411f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.285+0000 7fc8f8f0e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f4120af0 con 0x7fc8f4130eb0 2023-09-30T22:24:51.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.285+0000 7fc8f8f0e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f4120330 con 0x7fc8f409d860 2023-09-30T22:24:51.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.285+0000 7fc8f8f0e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f4121e50 con 0x7fc8f409e170 2023-09-30T22:24:51.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.286+0000 7fc8f259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8f409d860 0x7fc8f411e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.286+0000 7fc8f259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8f409d860 0x7fc8f411e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44244/0 (socket says 172.21.15.156:44244) 2023-09-30T22:24:51.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.286+0000 7fc8f259c700 1 -- 172.21.15.156:0/1476113715 learned_addr learned my addr 172.21.15.156:0/1476113715 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:51.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.286+0000 7fc8f1d9b700 1 --2- 172.21.15.156:0/1476113715 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8f409e170 0x7fc8f411eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.286+0000 7fc8f2d9d700 1 --2- 172.21.15.156:0/1476113715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8f4130eb0 0x7fc8f411f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.286+0000 7fc8f259c700 1 -- 172.21.15.156:0/1476113715 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8f409e170 msgr2=0x7fc8f411eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.286+0000 7fc8f259c700 1 --2- 172.21.15.156:0/1476113715 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8f409e170 0x7fc8f411eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.286+0000 7fc8f259c700 1 -- 172.21.15.156:0/1476113715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8f4130eb0 msgr2=0x7fc8f411f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.286+0000 7fc8f259c700 1 --2- 172.21.15.156:0/1476113715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8f4130eb0 0x7fc8f411f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.286+0000 7fc8f259c700 1 -- 172.21.15.156:0/1476113715 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e400b7f0 con 0x7fc8f409d860 2023-09-30T22:24:51.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.286+0000 7fc8f1d9b700 1 --2- 172.21.15.156:0/1476113715 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8f409e170 0x7fc8f411eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:51.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.286+0000 7fc8f2d9d700 1 --2- 172.21.15.156:0/1476113715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8f4130eb0 0x7fc8f411f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:51.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.286+0000 7fc8f259c700 1 --2- 172.21.15.156:0/1476113715 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8f409d860 0x7fc8f411e660 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc8f409fa30 tx=0x7fc8e4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:51.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.286+0000 7fc8e2ffd700 1 -- 172.21.15.156:0/1476113715 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e401f070 con 0x7fc8f409d860 2023-09-30T22:24:51.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.286+0000 7fc8e2ffd700 1 -- 172.21.15.156:0/1476113715 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e4003970 con 0x7fc8f409d860 2023-09-30T22:24:51.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.286+0000 7fc8f8f0e700 1 -- 172.21.15.156:0/1476113715 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f41207d0 con 0x7fc8f409d860 2023-09-30T22:24:51.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.286+0000 7fc8e2ffd700 1 -- 172.21.15.156:0/1476113715 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4003d00 con 0x7fc8f409d860 2023-09-30T22:24:51.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.286+0000 7fc8f8f0e700 1 -- 172.21.15.156:0/1476113715 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f4122130 con 0x7fc8f409d860 2023-09-30T22:24:51.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.287+0000 7fc8e2ffd700 1 -- 172.21.15.156:0/1476113715 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc8e4019400 con 0x7fc8f409d860 2023-09-30T22:24:51.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.287+0000 7fc8f8f0e700 1 -- 172.21.15.156:0/1476113715 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f404f2a0 con 0x7fc8f409d860 2023-09-30T22:24:51.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.288+0000 7fc8e2ffd700 1 -- 172.21.15.156:0/1476113715 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc8e4042a60 con 0x7fc8f409d860 2023-09-30T22:24:51.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.292+0000 7fc8e2ffd700 1 -- 172.21.15.156:0/1476113715 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc8e4003e60 con 0x7fc8f409d860 2023-09-30T22:24:51.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.316+0000 7f6fd5e12700 1 -- 172.21.15.156:0/1890202231 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6fd006c3b0 con 0x7f6fd0139280 2023-09-30T22:24:51.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.316+0000 7f6fc7fff700 1 -- 172.21.15.156:0/1890202231 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6fc8033090 con 0x7f6fd0139280 2023-09-30T22:24:51.317 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:51.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.318+0000 7f6fd5e12700 1 -- 172.21.15.156:0/1890202231 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fd0139280 msgr2=0x7f6fd012d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.318+0000 7f6fd5e12700 1 --2- 172.21.15.156:0/1890202231 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fd0139280 0x7f6fd012d5b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8012000 tx=0x7f6fc8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.318+0000 7f6fd5e12700 1 -- 172.21.15.156:0/1890202231 shutdown_connections 2023-09-30T22:24:51.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.318+0000 7f6fd5e12700 1 --2- 172.21.15.156:0/1890202231 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6fd0139280 0x7f6fd012d5b0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.318+0000 7f6fd5e12700 1 --2- 172.21.15.156:0/1890202231 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6fd0133ad0 0x7f6fd012cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.318+0000 7f6fd5e12700 1 --2- 172.21.15.156:0/1890202231 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fd0136960 0x7f6fd012d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.318+0000 7f6fd5e12700 1 -- 172.21.15.156:0/1890202231 >> 172.21.15.156:0/1890202231 conn(0x7f6fd0099c40 msgr2=0x7f6fd0134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:51.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.319+0000 7f6fd5e12700 1 -- 172.21.15.156:0/1890202231 shutdown_connections 2023-09-30T22:24:51.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.319+0000 7f6fd5e12700 1 -- 172.21.15.156:0/1890202231 wait complete. 2023-09-30T22:24:51.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:51.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.334+0000 7ff098d0a700 1 Processor -- start 2023-09-30T22:24:51.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.334+0000 7ff098d0a700 1 -- start start 2023-09-30T22:24:51.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.334+0000 7ff098d0a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0940a0a90 0x7ff0940a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.334+0000 7ff098d0a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0940a13a0 0x7ff094133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.334+0000 7ff098d0a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff094133f70 0x7ff094134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.334+0000 7ff098d0a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0940a3aa0 con 0x7ff094133f70 2023-09-30T22:24:51.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.334+0000 7ff098d0a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09409a540 con 0x7ff0940a13a0 2023-09-30T22:24:51.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.334+0000 7ff098d0a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0940a1fe0 con 0x7ff0940a0a90 2023-09-30T22:24:51.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.335+0000 7ff09259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0940a0a90 0x7ff0940a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.335+0000 7ff092d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff094133f70 0x7ff094134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.335+0000 7ff09259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0940a0a90 0x7ff0940a0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36658/0 (socket says 172.21.15.156:36658) 2023-09-30T22:24:51.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.335+0000 7ff09259c700 1 -- 172.21.15.156:0/3508469551 learned_addr learned my addr 172.21.15.156:0/3508469551 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:51.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.335+0000 7ff091d9b700 1 --2- 172.21.15.156:0/3508469551 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0940a13a0 0x7ff094133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.335+0000 7ff09259c700 1 -- 172.21.15.156:0/3508469551 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0940a13a0 msgr2=0x7ff094133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:51.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.335+0000 7ff09259c700 1 --2- 172.21.15.156:0/3508469551 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0940a13a0 0x7ff094133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.335+0000 7ff09259c700 1 -- 172.21.15.156:0/3508469551 >> v2:172.21.15.156:3300/0 conn(0x7ff094133f70 msgr2=0x7ff094134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:51.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.335+0000 7ff09259c700 1 --2- 172.21.15.156:0/3508469551 >> v2:172.21.15.156:3300/0 conn(0x7ff094133f70 0x7ff094134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.335+0000 7ff09259c700 1 -- 172.21.15.156:0/3508469551 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09409a280 con 0x7ff0940a0a90 2023-09-30T22:24:51.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.335+0000 7ff092d9d700 1 --2- 172.21.15.156:0/3508469551 >> v2:172.21.15.156:3300/0 conn(0x7ff094133f70 0x7ff094134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:51.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.335+0000 7ff09259c700 1 --2- 172.21.15.156:0/3508469551 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0940a0a90 0x7ff0940a0e60 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff0840098f0 tx=0x7ff084009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5fedbd9862ea13e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:51.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.335+0000 7ff09159a700 1 -- 172.21.15.156:0/3508469551 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff084011830 con 0x7ff0940a0a90 2023-09-30T22:24:51.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.335+0000 7ff09159a700 1 -- 172.21.15.156:0/3508469551 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff084011990 con 0x7ff0940a0a90 2023-09-30T22:24:51.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.335+0000 7ff09159a700 1 -- 172.21.15.156:0/3508469551 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff084011d20 con 0x7ff0940a0a90 2023-09-30T22:24:51.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.336+0000 7ff098d0a700 1 -- 172.21.15.156:0/3508469551 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0940a0a90 msgr2=0x7ff0940a0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.336+0000 7ff098d0a700 1 --2- 172.21.15.156:0/3508469551 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0940a0a90 0x7ff0940a0e60 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff0840098f0 tx=0x7ff084009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:51.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.336+0000 7ff098d0a700 1 -- 172.21.15.156:0/3508469551 shutdown_connections 2023-09-30T22:24:51.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.336+0000 7ff098d0a700 1 --2- 172.21.15.156:0/3508469551 >> v2:172.21.15.156:3300/0 conn(0x7ff094133f70 0x7ff094134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.336+0000 7ff098d0a700 1 --2- 172.21.15.156:0/3508469551 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0940a0a90 0x7ff0940a0e60 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.336+0000 7ff098d0a700 1 --2- 172.21.15.156:0/3508469551 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0940a13a0 0x7ff094133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.336+0000 7ff098d0a700 1 -- 172.21.15.156:0/3508469551 >> 172.21.15.156:0/3508469551 conn(0x7ff094099c40 msgr2=0x7ff09406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:51.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.336+0000 7ff098d0a700 1 -- 172.21.15.156:0/3508469551 shutdown_connections 2023-09-30T22:24:51.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.336+0000 7ff098d0a700 1 -- 172.21.15.156:0/3508469551 wait complete. 2023-09-30T22:24:51.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.337+0000 7ff098d0a700 1 Processor -- start 2023-09-30T22:24:51.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.337+0000 7ff098d0a700 1 -- start start 2023-09-30T22:24:51.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.338+0000 7ff098d0a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0940a0a90 0x7ff0941c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.338+0000 7ff098d0a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0940a13a0 0x7ff0941c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.338+0000 7ff098d0a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff094133f70 0x7ff0941c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.338+0000 7ff098d0a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff094121440 con 0x7ff0940a13a0 2023-09-30T22:24:51.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.338+0000 7ff098d0a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0941335d0 con 0x7ff094133f70 2023-09-30T22:24:51.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.338+0000 7ff098d0a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0941207d0 con 0x7ff0940a0a90 2023-09-30T22:24:51.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.338+0000 7ff09259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0940a0a90 0x7ff0941c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.338+0000 7ff09259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0940a0a90 0x7ff0941c8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36670/0 (socket says 172.21.15.156:36670) 2023-09-30T22:24:51.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.338+0000 7ff09259c700 1 -- 172.21.15.156:0/489631849 learned_addr learned my addr 172.21.15.156:0/489631849 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:51.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.338+0000 7ff092d9d700 1 --2- 172.21.15.156:0/489631849 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff094133f70 0x7ff0941c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.338+0000 7ff091d9b700 1 --2- 172.21.15.156:0/489631849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0940a13a0 0x7ff0941c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.338+0000 7ff09259c700 1 -- 172.21.15.156:0/489631849 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff094133f70 msgr2=0x7ff0941c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.338+0000 7ff09259c700 1 --2- 172.21.15.156:0/489631849 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff094133f70 0x7ff0941c8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.338+0000 7ff09259c700 1 -- 172.21.15.156:0/489631849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0940a13a0 msgr2=0x7ff0941c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.338+0000 7ff09259c700 1 --2- 172.21.15.156:0/489631849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0940a13a0 0x7ff0941c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.338+0000 7ff09259c700 1 -- 172.21.15.156:0/489631849 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08c009a70 con 0x7ff0940a0a90 2023-09-30T22:24:51.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.338+0000 7ff09259c700 1 --2- 172.21.15.156:0/489631849 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0940a0a90 0x7ff0941c8300 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff084000c00 tx=0x7ff084004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:51.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.338+0000 7ff082ffd700 1 -- 172.21.15.156:0/489631849 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff084004240 con 0x7ff0940a0a90 2023-09-30T22:24:51.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.339+0000 7ff098d0a700 1 -- 172.21.15.156:0/489631849 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff084009550 con 0x7ff0940a0a90 2023-09-30T22:24:51.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.339+0000 7ff082ffd700 1 -- 172.21.15.156:0/489631849 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08401f070 con 0x7ff0940a0a90 2023-09-30T22:24:51.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.339+0000 7ff082ffd700 1 -- 172.21.15.156:0/489631849 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0840036a0 con 0x7ff0940a0a90 2023-09-30T22:24:51.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.339+0000 7ff098d0a700 1 -- 172.21.15.156:0/489631849 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff094121fc0 con 0x7ff0940a0a90 2023-09-30T22:24:51.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.339+0000 7ff082ffd700 1 -- 172.21.15.156:0/489631849 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff084021030 con 0x7ff0940a0a90 2023-09-30T22:24:51.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.340+0000 7ff082ffd700 1 -- 172.21.15.156:0/489631849 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff0840407d0 con 0x7ff0940a0a90 2023-09-30T22:24:51.351 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.340+0000 7ff098d0a700 1 -- 172.21.15.156:0/489631849 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff09404f2a0 con 0x7ff0940a0a90 2023-09-30T22:24:51.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.348+0000 7ff082ffd700 1 -- 172.21.15.156:0/489631849 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0840199a0 con 0x7ff0940a0a90 2023-09-30T22:24:51.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.384+0000 7f63a23bd700 1 Processor -- start 2023-09-30T22:24:51.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.384+0000 7f63a23bd700 1 -- start start 2023-09-30T22:24:51.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.384+0000 7f63a23bd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f639c0a0a70 0x7f639c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.384+0000 7f63a23bd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f639c134120 0x7f639c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.384+0000 7f63a23bd700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f639c09dc00 con 0x7f639c0a1380 2023-09-30T22:24:51.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.384+0000 7f63a23bd700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f639c09ea60 con 0x7f639c134120 2023-09-30T22:24:51.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.384+0000 7f63a23bd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f639c09dec0 con 0x7f639c0a0a70 2023-09-30T22:24:51.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.385+0000 7f639bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f639c0a0a70 0x7f639c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.385+0000 7f63a095a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f639c134120 0x7f639c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.385+0000 7f639bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f639c0a0a70 0x7f639c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44264/0 (socket says 172.21.15.156:44264) 2023-09-30T22:24:51.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.385+0000 7f639bfff700 1 -- 172.21.15.156:0/720266082 learned_addr learned my addr 172.21.15.156:0/720266082 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:51.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.385+0000 7f639bfff700 1 -- 172.21.15.156:0/720266082 >> v2:172.21.15.156:3300/0 conn(0x7f639c134120 msgr2=0x7f639c13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:51.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.385+0000 7f639bfff700 1 --2- 172.21.15.156:0/720266082 >> v2:172.21.15.156:3300/0 conn(0x7f639c134120 0x7f639c13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.385+0000 7f639bfff700 1 -- 172.21.15.156:0/720266082 >> v1:172.21.15.156:6789/0 conn(0x7f639c0a1380 legacy=0x7f639c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.385+0000 7f639bfff700 1 -- 172.21.15.156:0/720266082 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f639c09e6a0 con 0x7f639c0a0a70 2023-09-30T22:24:51.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.385+0000 7f639bfff700 1 --2- 172.21.15.156:0/720266082 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f639c0a0a70 0x7f639c0a0e40 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f638c0098f0 tx=0x7f638c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14f43ec70aba51ab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:51.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.385+0000 7f639affd700 1 -- 172.21.15.156:0/720266082 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c011830 con 0x7f639c0a0a70 2023-09-30T22:24:51.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.385+0000 7f639affd700 1 -- 172.21.15.156:0/720266082 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638c011990 con 0x7f639c0a0a70 2023-09-30T22:24:51.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.385+0000 7f639affd700 1 -- 172.21.15.156:0/720266082 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c011d20 con 0x7f639c0a0a70 2023-09-30T22:24:51.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.386+0000 7f63a23bd700 1 -- 172.21.15.156:0/720266082 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f639c0a0a70 msgr2=0x7f639c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.386+0000 7f63a23bd700 1 --2- 172.21.15.156:0/720266082 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f639c0a0a70 0x7f639c0a0e40 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f638c0098f0 tx=0x7f638c009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:51.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.386+0000 7f63a23bd700 1 -- 172.21.15.156:0/720266082 shutdown_connections 2023-09-30T22:24:51.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.386+0000 7f63a23bd700 1 --2- 172.21.15.156:0/720266082 >> v2:172.21.15.156:3300/0 conn(0x7f639c134120 0x7f639c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.386+0000 7f63a23bd700 1 --2- 172.21.15.156:0/720266082 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f639c0a0a70 0x7f639c0a0e40 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.386+0000 7f63a23bd700 1 -- 172.21.15.156:0/720266082 >> 172.21.15.156:0/720266082 conn(0x7f639c0a6610 msgr2=0x7f639c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:51.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.386+0000 7f63a23bd700 1 -- 172.21.15.156:0/720266082 shutdown_connections 2023-09-30T22:24:51.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.386+0000 7f63a23bd700 1 -- 172.21.15.156:0/720266082 wait complete. 2023-09-30T22:24:51.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.387+0000 7f63a23bd700 1 Processor -- start 2023-09-30T22:24:51.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.387+0000 7f63a23bd700 1 -- start start 2023-09-30T22:24:51.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.388+0000 7f63a23bd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f639c0a0a70 0x7f639c1229f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.388+0000 7f63a23bd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f639c0a1380 0x7f639c122f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.388+0000 7f63a23bd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f639c134120 0x7f639c123470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.388+0000 7f63a23bd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639c126160 con 0x7f639c134120 2023-09-30T22:24:51.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.388+0000 7f63a23bd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f639c127020 con 0x7f639c0a1380 2023-09-30T22:24:51.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.388+0000 7f63a23bd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f639c123dc0 con 0x7f639c0a0a70 2023-09-30T22:24:51.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.388+0000 7f639b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f639c0a1380 0x7f639c122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.388+0000 7f639bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f639c0a0a70 0x7f639c1229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.388+0000 7f639bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f639c0a0a70 0x7f639c1229f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36676/0 (socket says 172.21.15.156:36676) 2023-09-30T22:24:51.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.388+0000 7f639b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f639c0a1380 0x7f639c122f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44280/0 (socket says 172.21.15.156:44280) 2023-09-30T22:24:51.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.388+0000 7f639bfff700 1 -- 172.21.15.156:0/2577321627 learned_addr learned my addr 172.21.15.156:0/2577321627 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:51.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.388+0000 7f63a095a700 1 --2- 172.21.15.156:0/2577321627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f639c134120 0x7f639c123470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.388+0000 7f639b7fe700 1 -- 172.21.15.156:0/2577321627 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f639c0a0a70 msgr2=0x7f639c1229f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.388+0000 7f639b7fe700 1 --2- 172.21.15.156:0/2577321627 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f639c0a0a70 0x7f639c1229f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.388+0000 7f639b7fe700 1 -- 172.21.15.156:0/2577321627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f639c134120 msgr2=0x7f639c123470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.388+0000 7f639b7fe700 1 --2- 172.21.15.156:0/2577321627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f639c134120 0x7f639c123470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.388+0000 7f639b7fe700 1 -- 172.21.15.156:0/2577321627 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638c009550 con 0x7f639c0a1380 2023-09-30T22:24:51.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.388+0000 7f639bfff700 1 --2- 172.21.15.156:0/2577321627 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f639c0a0a70 0x7f639c1229f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:51.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.388+0000 7f63a095a700 1 --2- 172.21.15.156:0/2577321627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f639c134120 0x7f639c123470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:24:51.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.389+0000 7f639b7fe700 1 --2- 172.21.15.156:0/2577321627 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f639c0a1380 0x7f639c122f30 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6390000f60 tx=0x7f639000c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:51.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.389+0000 7f6398ff9700 1 -- 172.21.15.156:0/2577321627 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63900052d0 con 0x7f639c0a1380 2023-09-30T22:24:51.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.389+0000 7f6398ff9700 1 -- 172.21.15.156:0/2577321627 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6390005430 con 0x7f639c0a1380 2023-09-30T22:24:51.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.389+0000 7f63a23bd700 1 -- 172.21.15.156:0/2577321627 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f639c0a03e0 con 0x7f639c0a1380 2023-09-30T22:24:51.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.389+0000 7f6398ff9700 1 -- 172.21.15.156:0/2577321627 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63900038c0 con 0x7f639c0a1380 2023-09-30T22:24:51.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.389+0000 7f63a23bd700 1 -- 172.21.15.156:0/2577321627 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f639c124cd0 con 0x7f639c0a1380 2023-09-30T22:24:51.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.390+0000 7f6398ff9700 1 -- 172.21.15.156:0/2577321627 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6390003a20 con 0x7f639c0a1380 2023-09-30T22:24:51.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.390+0000 7f63a23bd700 1 -- 172.21.15.156:0/2577321627 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f639c04f2a0 con 0x7f639c0a1380 2023-09-30T22:24:51.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.390+0000 7f6398ff9700 1 -- 172.21.15.156:0/2577321627 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f639003e9e0 con 0x7f639c0a1380 2023-09-30T22:24:51.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.399+0000 7f6398ff9700 1 -- 172.21.15.156:0/2577321627 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6390018260 con 0x7f639c0a1380 2023-09-30T22:24:51.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.507+0000 7fc8f8f0e700 1 -- 172.21.15.156:0/1476113715 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc8f406c3b0 con 0x7fc8f409d860 2023-09-30T22:24:51.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.507+0000 7fc8e2ffd700 1 -- 172.21.15.156:0/1476113715 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc8e4023bc0 con 0x7fc8f409d860 2023-09-30T22:24:51.509 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:51.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.509+0000 7fc8f8f0e700 1 -- 172.21.15.156:0/1476113715 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8f409d860 msgr2=0x7fc8f411e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.509+0000 7fc8f8f0e700 1 --2- 172.21.15.156:0/1476113715 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8f409d860 0x7fc8f411e660 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc8f409fa30 tx=0x7fc8e4004750 comp rx=0 tx=0).stop 2023-09-30T22:24:51.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.510+0000 7fc8f8f0e700 1 -- 172.21.15.156:0/1476113715 shutdown_connections 2023-09-30T22:24:51.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.510+0000 7fc8f8f0e700 1 --2- 172.21.15.156:0/1476113715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8f4130eb0 0x7fc8f411f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.510+0000 7fc8f8f0e700 1 --2- 172.21.15.156:0/1476113715 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8f409d860 0x7fc8f411e660 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.510+0000 7fc8f8f0e700 1 --2- 172.21.15.156:0/1476113715 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8f409e170 0x7fc8f411eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.510+0000 7fc8f8f0e700 1 -- 172.21.15.156:0/1476113715 >> 172.21.15.156:0/1476113715 conn(0x7fc8f4099c40 msgr2=0x7fc8f40a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:51.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.510+0000 7fc8f8f0e700 1 -- 172.21.15.156:0/1476113715 shutdown_connections 2023-09-30T22:24:51.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.510+0000 7fc8f8f0e700 1 -- 172.21.15.156:0/1476113715 wait complete. 2023-09-30T22:24:51.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:51.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.550+0000 7ff098d0a700 1 -- 172.21.15.156:0/489631849 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff0941221b0 con 0x7ff0940a0a90 2023-09-30T22:24:51.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.550+0000 7ff082ffd700 1 -- 172.21.15.156:0/489631849 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff0840193b0 con 0x7ff0940a0a90 2023-09-30T22:24:51.551 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:51.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.552+0000 7ff098d0a700 1 -- 172.21.15.156:0/489631849 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0940a0a90 msgr2=0x7ff0941c8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.552+0000 7ff098d0a700 1 --2- 172.21.15.156:0/489631849 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0940a0a90 0x7ff0941c8300 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff084000c00 tx=0x7ff084004750 comp rx=0 tx=0).stop 2023-09-30T22:24:51.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.552+0000 7ff098d0a700 1 -- 172.21.15.156:0/489631849 shutdown_connections 2023-09-30T22:24:51.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.552+0000 7ff098d0a700 1 --2- 172.21.15.156:0/489631849 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff094133f70 0x7ff0941c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.552+0000 7ff098d0a700 1 --2- 172.21.15.156:0/489631849 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0940a0a90 0x7ff0941c8300 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.552+0000 7ff098d0a700 1 --2- 172.21.15.156:0/489631849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0940a13a0 0x7ff0941c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.552+0000 7ff098d0a700 1 -- 172.21.15.156:0/489631849 >> 172.21.15.156:0/489631849 conn(0x7ff094099c40 msgr2=0x7ff0941bbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:51.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.552+0000 7ff098d0a700 1 -- 172.21.15.156:0/489631849 shutdown_connections 2023-09-30T22:24:51.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.552+0000 7ff098d0a700 1 -- 172.21.15.156:0/489631849 wait complete. 2023-09-30T22:24:51.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:51.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.594+0000 7f63a23bd700 1 -- 172.21.15.156:0/2577321627 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f639c072980 con 0x7f639c0a1380 2023-09-30T22:24:51.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.594+0000 7f6398ff9700 1 -- 172.21.15.156:0/2577321627 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6390017070 con 0x7f639c0a1380 2023-09-30T22:24:51.595 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:51.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.596+0000 7f63a23bd700 1 -- 172.21.15.156:0/2577321627 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f639c0a1380 msgr2=0x7f639c122f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.596+0000 7f63a23bd700 1 --2- 172.21.15.156:0/2577321627 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f639c0a1380 0x7f639c122f30 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6390000f60 tx=0x7f639000c730 comp rx=0 tx=0).stop 2023-09-30T22:24:51.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.596+0000 7f63a23bd700 1 -- 172.21.15.156:0/2577321627 shutdown_connections 2023-09-30T22:24:51.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.596+0000 7f63a23bd700 1 --2- 172.21.15.156:0/2577321627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f639c134120 0x7f639c123470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.596+0000 7f63a23bd700 1 --2- 172.21.15.156:0/2577321627 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f639c0a0a70 0x7f639c1229f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.597+0000 7f63a23bd700 1 --2- 172.21.15.156:0/2577321627 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f639c0a1380 0x7f639c122f30 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.597+0000 7f63a23bd700 1 -- 172.21.15.156:0/2577321627 >> 172.21.15.156:0/2577321627 conn(0x7f639c0a6610 msgr2=0x7f639c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:51.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.597+0000 7f63a23bd700 1 -- 172.21.15.156:0/2577321627 shutdown_connections 2023-09-30T22:24:51.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:51.597+0000 7f63a23bd700 1 -- 172.21.15.156:0/2577321627 wait complete. 2023-09-30T22:24:51.609 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:52.333 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:52.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.467+0000 7fdb239d9700 1 Processor -- start 2023-09-30T22:24:52.468 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.467+0000 7fdb239d9700 1 -- start start 2023-09-30T22:24:52.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.468+0000 7fdb239d9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb1c136960 0x7fdb1c138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.468+0000 7fdb239d9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb1c139280 0x7fdb1c13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.468+0000 7fdb239d9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb1c06b2d0 con 0x7fdb1c133ad0 2023-09-30T22:24:52.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.468+0000 7fdb239d9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c1345b0 con 0x7fdb1c139280 2023-09-30T22:24:52.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.468+0000 7fdb239d9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c133610 con 0x7fdb1c136960 2023-09-30T22:24:52.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.468+0000 7fdb21f76700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb1c139280 0x7fdb1c13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.468+0000 7fdb21775700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fdb1c133ad0 0x7fdb1c133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:44640/0 (socket says 172.21.15.156:44640) 2023-09-30T22:24:52.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.468+0000 7fdb20f74700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb1c136960 0x7fdb1c138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.468+0000 7fdb21775700 1 -- 172.21.15.156:0/2264929904 learned_addr learned my addr 172.21.15.156:0/2264929904 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:52.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.468+0000 7fdb13fff700 1 -- 172.21.15.156:0/2264929904 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3777220227 0 0) 0x7fdb1c06b2d0 con 0x7fdb1c133ad0 2023-09-30T22:24:52.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.468+0000 7fdb13fff700 1 -- 172.21.15.156:0/2264929904 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb080035b0 con 0x7fdb1c133ad0 2023-09-30T22:24:52.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.468+0000 7fdb20f74700 1 -- 172.21.15.156:0/2264929904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb1c139280 msgr2=0x7fdb1c13b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:52.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.468+0000 7fdb20f74700 1 --2- 172.21.15.156:0/2264929904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb1c139280 0x7fdb1c13b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.468+0000 7fdb20f74700 1 -- 172.21.15.156:0/2264929904 >> v1:172.21.15.156:6789/0 conn(0x7fdb1c133ad0 legacy=0x7fdb1c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.468+0000 7fdb20f74700 1 -- 172.21.15.156:0/2264929904 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1c09a500 con 0x7fdb1c136960 2023-09-30T22:24:52.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.468+0000 7fdb21f76700 1 --2- 172.21.15.156:0/2264929904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb1c139280 0x7fdb1c13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:52.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.468+0000 7fdb20f74700 1 --2- 172.21.15.156:0/2264929904 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb1c136960 0x7fdb1c138d40 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fdb18009870 tx=0x7fdb18009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48659613e92aeea4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:52.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.469+0000 7fdb13fff700 1 -- 172.21.15.156:0/2264929904 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb18011830 con 0x7fdb1c136960 2023-09-30T22:24:52.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.469+0000 7fdb13fff700 1 -- 172.21.15.156:0/2264929904 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb18011990 con 0x7fdb1c136960 2023-09-30T22:24:52.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.469+0000 7fdb13fff700 1 -- 172.21.15.156:0/2264929904 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb18011d20 con 0x7fdb1c136960 2023-09-30T22:24:52.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.469+0000 7fdb239d9700 1 -- 172.21.15.156:0/2264929904 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb1c136960 msgr2=0x7fdb1c138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.469+0000 7fdb239d9700 1 --2- 172.21.15.156:0/2264929904 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb1c136960 0x7fdb1c138d40 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fdb18009870 tx=0x7fdb18009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:52.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.469+0000 7fdb239d9700 1 -- 172.21.15.156:0/2264929904 shutdown_connections 2023-09-30T22:24:52.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.469+0000 7fdb239d9700 1 --2- 172.21.15.156:0/2264929904 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb1c139280 0x7fdb1c13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.469+0000 7fdb239d9700 1 --2- 172.21.15.156:0/2264929904 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb1c136960 0x7fdb1c138d40 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.469+0000 7fdb239d9700 1 -- 172.21.15.156:0/2264929904 >> 172.21.15.156:0/2264929904 conn(0x7fdb1c099c40 msgr2=0x7fdb1c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:52.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.469+0000 7fdb239d9700 1 -- 172.21.15.156:0/2264929904 shutdown_connections 2023-09-30T22:24:52.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.469+0000 7fdb239d9700 1 -- 172.21.15.156:0/2264929904 wait complete. 2023-09-30T22:24:52.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.470+0000 7fdb239d9700 1 Processor -- start 2023-09-30T22:24:52.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.470+0000 7fdb239d9700 1 -- start start 2023-09-30T22:24:52.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.471+0000 7fdb239d9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb1c133ad0 0x7fdb1c071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.471+0000 7fdb239d9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb1c136960 0x7fdb1c071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.471+0000 7fdb239d9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb1c139280 0x7fdb1c071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.471+0000 7fdb239d9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c06feb0 con 0x7fdb1c136960 2023-09-30T22:24:52.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.471+0000 7fdb239d9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c1316a0 con 0x7fdb1c133ad0 2023-09-30T22:24:52.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.471+0000 7fdb239d9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c0720e0 con 0x7fdb1c139280 2023-09-30T22:24:52.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.471+0000 7fdb20f74700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb1c136960 0x7fdb1c071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.471+0000 7fdb21775700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb1c133ad0 0x7fdb1c071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.471+0000 7fdb21f76700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb1c139280 0x7fdb1c071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.471+0000 7fdb20f74700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb1c136960 0x7fdb1c071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47242/0 (socket says 172.21.15.156:47242) 2023-09-30T22:24:52.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.471+0000 7fdb20f74700 1 -- 172.21.15.156:0/2802535869 learned_addr learned my addr 172.21.15.156:0/2802535869 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:52.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.471+0000 7fdb21775700 1 -- 172.21.15.156:0/2802535869 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb1c139280 msgr2=0x7fdb1c071ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.471+0000 7fdb21775700 1 --2- 172.21.15.156:0/2802535869 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb1c139280 0x7fdb1c071ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.471+0000 7fdb21775700 1 -- 172.21.15.156:0/2802535869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb1c136960 msgr2=0x7fdb1c071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.471+0000 7fdb21775700 1 --2- 172.21.15.156:0/2802535869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb1c136960 0x7fdb1c071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.471+0000 7fdb21775700 1 -- 172.21.15.156:0/2802535869 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb14009a70 con 0x7fdb1c133ad0 2023-09-30T22:24:52.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.471+0000 7fdb20f74700 1 --2- 172.21.15.156:0/2802535869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb1c136960 0x7fdb1c071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:52.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.471+0000 7fdb21f76700 1 --2- 172.21.15.156:0/2802535869 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb1c139280 0x7fdb1c071ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:52.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.471+0000 7fdb21775700 1 --2- 172.21.15.156:0/2802535869 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb1c133ad0 0x7fdb1c071030 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00c460 tx=0x7fdb0c00c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:52.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.471+0000 7fdb11ffb700 1 -- 172.21.15.156:0/2802535869 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c00cea0 con 0x7fdb1c133ad0 2023-09-30T22:24:52.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.471+0000 7fdb11ffb700 1 -- 172.21.15.156:0/2802535869 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0c005d70 con 0x7fdb1c133ad0 2023-09-30T22:24:52.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.471+0000 7fdb239d9700 1 -- 172.21.15.156:0/2802535869 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb180094a0 con 0x7fdb1c133ad0 2023-09-30T22:24:52.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.471+0000 7fdb11ffb700 1 -- 172.21.15.156:0/2802535869 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c0072f0 con 0x7fdb1c133ad0 2023-09-30T22:24:52.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.472+0000 7fdb239d9700 1 -- 172.21.15.156:0/2802535869 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb1c09f390 con 0x7fdb1c133ad0 2023-09-30T22:24:52.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.472+0000 7fdb11ffb700 1 -- 172.21.15.156:0/2802535869 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb0c007450 con 0x7fdb1c133ad0 2023-09-30T22:24:52.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.472+0000 7fdb11ffb700 1 -- 172.21.15.156:0/2802535869 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdb0c03e8d0 con 0x7fdb1c133ad0 2023-09-30T22:24:52.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.473+0000 7fdb239d9700 1 -- 172.21.15.156:0/2802535869 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb1c04f2a0 con 0x7fdb1c133ad0 2023-09-30T22:24:52.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.477+0000 7fdb11ffb700 1 -- 172.21.15.156:0/2802535869 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb0c019b40 con 0x7fdb1c133ad0 2023-09-30T22:24:52.523 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:52.567 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:52.610 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:52.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.654+0000 7f329dca9700 1 Processor -- start 2023-09-30T22:24:52.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.654+0000 7f329dca9700 1 -- start start 2023-09-30T22:24:52.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.655+0000 7f329dca9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32980a0a30 0x7f32980a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.655+0000 7f329dca9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f32980a1340 0x7f329812ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.655+0000 7f329dca9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32980a1e70 con 0x7f32981304a0 2023-09-30T22:24:52.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.655+0000 7f329dca9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f329809a720 con 0x7f32980a1340 2023-09-30T22:24:52.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.655+0000 7f329dca9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329809b300 con 0x7f32980a0a30 2023-09-30T22:24:52.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.655+0000 7f32977fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32980a0a30 0x7f32980a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.655+0000 7f32977fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32980a0a30 0x7f32980a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44314/0 (socket says 172.21.15.156:44314) 2023-09-30T22:24:52.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.655+0000 7f3297fff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f32981304a0 0x7f32981371b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:44650/0 (socket says 172.21.15.156:44650) 2023-09-30T22:24:52.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.655+0000 7f32977fe700 1 -- 172.21.15.156:0/3166005076 learned_addr learned my addr 172.21.15.156:0/3166005076 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:52.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.655+0000 7f3296ffd700 1 --2- 172.21.15.156:0/3166005076 >> v2:172.21.15.156:3300/0 conn(0x7f32980a1340 0x7f329812ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.656+0000 7f32977fe700 1 -- 172.21.15.156:0/3166005076 >> v2:172.21.15.156:3300/0 conn(0x7f32980a1340 msgr2=0x7f329812ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:52.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.656+0000 7f32977fe700 1 --2- 172.21.15.156:0/3166005076 >> v2:172.21.15.156:3300/0 conn(0x7f32980a1340 0x7f329812ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.656+0000 7f32977fe700 1 -- 172.21.15.156:0/3166005076 >> v1:172.21.15.156:6789/0 conn(0x7f32981304a0 legacy=0x7f32981371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.656+0000 7f32977fe700 1 -- 172.21.15.156:0/3166005076 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329809abc0 con 0x7f32980a0a30 2023-09-30T22:24:52.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.656+0000 7f32977fe700 1 --2- 172.21.15.156:0/3166005076 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32980a0a30 0x7f32980a0e00 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3288006fd0 tx=0x7f328800be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba10dfdaeb70925a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:52.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.656+0000 7f32967fc700 1 -- 172.21.15.156:0/3166005076 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3288005c20 con 0x7f32980a0a30 2023-09-30T22:24:52.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.656+0000 7f32967fc700 1 -- 172.21.15.156:0/3166005076 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3288005d80 con 0x7f32980a0a30 2023-09-30T22:24:52.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.656+0000 7f32967fc700 1 -- 172.21.15.156:0/3166005076 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328800db80 con 0x7f32980a0a30 2023-09-30T22:24:52.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.657+0000 7f329dca9700 1 -- 172.21.15.156:0/3166005076 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32980a0a30 msgr2=0x7f32980a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.657+0000 7f329dca9700 1 --2- 172.21.15.156:0/3166005076 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32980a0a30 0x7f32980a0e00 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3288006fd0 tx=0x7f328800be70 comp rx=0 tx=0).stop 2023-09-30T22:24:52.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.657+0000 7f329dca9700 1 -- 172.21.15.156:0/3166005076 shutdown_connections 2023-09-30T22:24:52.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.657+0000 7f329dca9700 1 --2- 172.21.15.156:0/3166005076 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32980a0a30 0x7f32980a0e00 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.657+0000 7f329dca9700 1 --2- 172.21.15.156:0/3166005076 >> v2:172.21.15.156:3300/0 conn(0x7f32980a1340 0x7f329812ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.657+0000 7f329dca9700 1 -- 172.21.15.156:0/3166005076 >> 172.21.15.156:0/3166005076 conn(0x7f32980a2980 msgr2=0x7f32980a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:52.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.657+0000 7f329dca9700 1 -- 172.21.15.156:0/3166005076 shutdown_connections 2023-09-30T22:24:52.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.657+0000 7f329dca9700 1 -- 172.21.15.156:0/3166005076 wait complete. 2023-09-30T22:24:52.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.659+0000 7f329dca9700 1 Processor -- start 2023-09-30T22:24:52.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.659+0000 7f329dca9700 1 -- start start 2023-09-30T22:24:52.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.660+0000 7f329dca9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32980a0a30 0x7f32981c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.660+0000 7f329dca9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32980a1340 0x7f32981c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.660+0000 7f329dca9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32981304a0 0x7f32981c4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.660+0000 7f329dca9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329809ae70 con 0x7f32981304a0 2023-09-30T22:24:52.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.660+0000 7f329dca9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329811beb0 con 0x7f32980a1340 2023-09-30T22:24:52.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.660+0000 7f329dca9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f329811cec0 con 0x7f32980a0a30 2023-09-30T22:24:52.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.660+0000 7f32977fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32980a0a30 0x7f32981c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.660+0000 7f32977fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32980a0a30 0x7f32981c4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36710/0 (socket says 172.21.15.156:36710) 2023-09-30T22:24:52.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.660+0000 7f32977fe700 1 -- 172.21.15.156:0/2647532531 learned_addr learned my addr 172.21.15.156:0/2647532531 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:52.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.660+0000 7f3297fff700 1 --2- 172.21.15.156:0/2647532531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32981304a0 0x7f32981c4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.660+0000 7f3296ffd700 1 --2- 172.21.15.156:0/2647532531 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32980a1340 0x7f32981c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.660+0000 7f32977fe700 1 -- 172.21.15.156:0/2647532531 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32980a1340 msgr2=0x7f32981c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.660+0000 7f32977fe700 1 --2- 172.21.15.156:0/2647532531 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32980a1340 0x7f32981c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.660+0000 7f32977fe700 1 -- 172.21.15.156:0/2647532531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32981304a0 msgr2=0x7f32981c4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.660+0000 7f32977fe700 1 --2- 172.21.15.156:0/2647532531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32981304a0 0x7f32981c4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.660+0000 7f32977fe700 1 -- 172.21.15.156:0/2647532531 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328800b7a0 con 0x7f32980a0a30 2023-09-30T22:24:52.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.660+0000 7f3297fff700 1 --2- 172.21.15.156:0/2647532531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32981304a0 0x7f32981c4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:52.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.660+0000 7f32977fe700 1 --2- 172.21.15.156:0/2647532531 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32980a0a30 0x7f32981c4070 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f329809b440 tx=0x7f3288004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:52.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.661+0000 7f327ffff700 1 -- 172.21.15.156:0/2647532531 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328800de80 con 0x7f32980a0a30 2023-09-30T22:24:52.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.661+0000 7f327ffff700 1 -- 172.21.15.156:0/2647532531 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32880036a0 con 0x7f32980a0a30 2023-09-30T22:24:52.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.661+0000 7f329dca9700 1 -- 172.21.15.156:0/2647532531 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f329811d820 con 0x7f32980a0a30 2023-09-30T22:24:52.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.661+0000 7f327ffff700 1 -- 172.21.15.156:0/2647532531 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3288003a10 con 0x7f32980a0a30 2023-09-30T22:24:52.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.661+0000 7f329dca9700 1 -- 172.21.15.156:0/2647532531 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f329812ee00 con 0x7f32980a0a30 2023-09-30T22:24:52.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.662+0000 7f327ffff700 1 -- 172.21.15.156:0/2647532531 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3288015070 con 0x7f32980a0a30 2023-09-30T22:24:52.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.662+0000 7f327ffff700 1 -- 172.21.15.156:0/2647532531 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3288044970 con 0x7f32980a0a30 2023-09-30T22:24:52.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.662+0000 7f329dca9700 1 -- 172.21.15.156:0/2647532531 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f329804f2a0 con 0x7f32980a0a30 2023-09-30T22:24:52.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.667+0000 7f327ffff700 1 -- 172.21.15.156:0/2647532531 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f328802e080 con 0x7f32980a0a30 2023-09-30T22:24:52.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.691+0000 7fdb239d9700 1 -- 172.21.15.156:0/2802535869 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdb1c09f0f0 con 0x7fdb1c133ad0 2023-09-30T22:24:52.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.691+0000 7fdb11ffb700 1 -- 172.21.15.156:0/2802535869 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb0c017020 con 0x7fdb1c133ad0 2023-09-30T22:24:52.692 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:52.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.694+0000 7fdb239d9700 1 -- 172.21.15.156:0/2802535869 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb1c133ad0 msgr2=0x7fdb1c071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.694+0000 7fdb239d9700 1 --2- 172.21.15.156:0/2802535869 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb1c133ad0 0x7fdb1c071030 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00c460 tx=0x7fdb0c00c770 comp rx=0 tx=0).stop 2023-09-30T22:24:52.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.694+0000 7fdb239d9700 1 -- 172.21.15.156:0/2802535869 shutdown_connections 2023-09-30T22:24:52.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.694+0000 7fdb239d9700 1 --2- 172.21.15.156:0/2802535869 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb1c139280 0x7fdb1c071ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.694+0000 7fdb239d9700 1 --2- 172.21.15.156:0/2802535869 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb1c133ad0 0x7fdb1c071030 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.694+0000 7fdb239d9700 1 --2- 172.21.15.156:0/2802535869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb1c136960 0x7fdb1c071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.694+0000 7fdb239d9700 1 -- 172.21.15.156:0/2802535869 >> 172.21.15.156:0/2802535869 conn(0x7fdb1c099c40 msgr2=0x7fdb1c134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:52.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.694+0000 7fdb239d9700 1 -- 172.21.15.156:0/2802535869 shutdown_connections 2023-09-30T22:24:52.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.694+0000 7fdb239d9700 1 -- 172.21.15.156:0/2802535869 wait complete. 2023-09-30T22:24:52.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:52.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.710+0000 7fcc73f8b700 1 Processor -- start 2023-09-30T22:24:52.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.710+0000 7fcc73f8b700 1 -- start start 2023-09-30T22:24:52.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.710+0000 7fcc73f8b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcc6c136960 0x7fcc6c138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.710+0000 7fcc73f8b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcc6c139280 0x7fcc6c13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.710+0000 7fcc73f8b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc6c06b2d0 con 0x7fcc6c133ad0 2023-09-30T22:24:52.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.711+0000 7fcc73f8b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc6c1345b0 con 0x7fcc6c139280 2023-09-30T22:24:52.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.711+0000 7fcc73f8b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c133610 con 0x7fcc6c136960 2023-09-30T22:24:52.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.711+0000 7fcc72528700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcc6c139280 0x7fcc6c13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.711+0000 7fcc71d27700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fcc6c133ad0 0x7fcc6c133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:44662/0 (socket says 172.21.15.156:44662) 2023-09-30T22:24:52.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.711+0000 7fcc71d27700 1 -- 172.21.15.156:0/2986899286 learned_addr learned my addr 172.21.15.156:0/2986899286 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:52.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.711+0000 7fcc71526700 1 --2- 172.21.15.156:0/2986899286 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcc6c136960 0x7fcc6c138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.711+0000 7fcc72528700 1 -- 172.21.15.156:0/2986899286 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcc6c136960 msgr2=0x7fcc6c138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:52.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.711+0000 7fcc72528700 1 --2- 172.21.15.156:0/2986899286 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcc6c136960 0x7fcc6c138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.711+0000 7fcc72528700 1 -- 172.21.15.156:0/2986899286 >> v1:172.21.15.156:6789/0 conn(0x7fcc6c133ad0 legacy=0x7fcc6c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.711+0000 7fcc72528700 1 -- 172.21.15.156:0/2986899286 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6c09a500 con 0x7fcc6c139280 2023-09-30T22:24:52.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.711+0000 7fcc72528700 1 --2- 172.21.15.156:0/2986899286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc6c139280 0x7fcc6c13b660 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fcc64009dc0 tx=0x7fcc6400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=483d30d931b07a6c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:52.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.711+0000 7fcc70d25700 1 -- 172.21.15.156:0/2986899286 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6400e070 con 0x7fcc6c139280 2023-09-30T22:24:52.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.711+0000 7fcc70d25700 1 -- 172.21.15.156:0/2986899286 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6400bae0 con 0x7fcc6c139280 2023-09-30T22:24:52.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.711+0000 7fcc70d25700 1 -- 172.21.15.156:0/2986899286 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6400be90 con 0x7fcc6c139280 2023-09-30T22:24:52.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.712+0000 7fcc73f8b700 1 -- 172.21.15.156:0/2986899286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc6c139280 msgr2=0x7fcc6c13b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.712+0000 7fcc73f8b700 1 --2- 172.21.15.156:0/2986899286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc6c139280 0x7fcc6c13b660 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fcc64009dc0 tx=0x7fcc6400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:52.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.712+0000 7fcc73f8b700 1 -- 172.21.15.156:0/2986899286 shutdown_connections 2023-09-30T22:24:52.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.712+0000 7fcc73f8b700 1 --2- 172.21.15.156:0/2986899286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc6c139280 0x7fcc6c13b660 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.712+0000 7fcc73f8b700 1 --2- 172.21.15.156:0/2986899286 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcc6c136960 0x7fcc6c138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.712+0000 7fcc73f8b700 1 -- 172.21.15.156:0/2986899286 >> 172.21.15.156:0/2986899286 conn(0x7fcc6c099c40 msgr2=0x7fcc6c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:52.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.712+0000 7fcc73f8b700 1 -- 172.21.15.156:0/2986899286 shutdown_connections 2023-09-30T22:24:52.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.712+0000 7fcc73f8b700 1 -- 172.21.15.156:0/2986899286 wait complete. 2023-09-30T22:24:52.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.713+0000 7fcc73f8b700 1 Processor -- start 2023-09-30T22:24:52.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.713+0000 7fcc73f8b700 1 -- start start 2023-09-30T22:24:52.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.713+0000 7fcc73f8b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcc6c133ad0 0x7fcc6c071880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.713+0000 7fcc73f8b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc6c136960 0x7fcc6c071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.713+0000 7fcc73f8b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcc6c139280 0x7fcc6c1c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.713+0000 7fcc73f8b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c131710 con 0x7fcc6c136960 2023-09-30T22:24:52.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.713+0000 7fcc73f8b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c09f390 con 0x7fcc6c133ad0 2023-09-30T22:24:52.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.713+0000 7fcc73f8b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c0700e0 con 0x7fcc6c139280 2023-09-30T22:24:52.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.714+0000 7fcc71d27700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcc6c133ad0 0x7fcc6c071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.714+0000 7fcc71d27700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcc6c133ad0 0x7fcc6c071880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44324/0 (socket says 172.21.15.156:44324) 2023-09-30T22:24:52.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.714+0000 7fcc71d27700 1 -- 172.21.15.156:0/156567556 learned_addr learned my addr 172.21.15.156:0/156567556 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:52.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.714+0000 7fcc71526700 1 --2- 172.21.15.156:0/156567556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc6c136960 0x7fcc6c071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.714+0000 7fcc72528700 1 --2- 172.21.15.156:0/156567556 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcc6c139280 0x7fcc6c1c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.714+0000 7fcc71d27700 1 -- 172.21.15.156:0/156567556 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcc6c139280 msgr2=0x7fcc6c1c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.714+0000 7fcc71d27700 1 --2- 172.21.15.156:0/156567556 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcc6c139280 0x7fcc6c1c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.714+0000 7fcc71d27700 1 -- 172.21.15.156:0/156567556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc6c136960 msgr2=0x7fcc6c071dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.714+0000 7fcc71d27700 1 --2- 172.21.15.156:0/156567556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc6c136960 0x7fcc6c071dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.714+0000 7fcc71d27700 1 -- 172.21.15.156:0/156567556 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc64009a70 con 0x7fcc6c133ad0 2023-09-30T22:24:52.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.714+0000 7fcc72528700 1 --2- 172.21.15.156:0/156567556 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcc6c139280 0x7fcc6c1c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:24:52.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.714+0000 7fcc71d27700 1 --2- 172.21.15.156:0/156567556 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcc6c133ad0 0x7fcc6c071880 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fcc6800c480 tx=0x7fcc6800c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:52.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.714+0000 7fcc627fc700 1 -- 172.21.15.156:0/156567556 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc68005d70 con 0x7fcc6c133ad0 2023-09-30T22:24:52.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.714+0000 7fcc627fc700 1 -- 172.21.15.156:0/156567556 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc680070d0 con 0x7fcc6c133ad0 2023-09-30T22:24:52.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.714+0000 7fcc73f8b700 1 -- 172.21.15.156:0/156567556 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc6c06e900 con 0x7fcc6c133ad0 2023-09-30T22:24:52.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.714+0000 7fcc627fc700 1 -- 172.21.15.156:0/156567556 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc68007440 con 0x7fcc6c133ad0 2023-09-30T22:24:52.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.714+0000 7fcc73f8b700 1 -- 172.21.15.156:0/156567556 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc6c070e10 con 0x7fcc6c133ad0 2023-09-30T22:24:52.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.715+0000 7fcc627fc700 1 -- 172.21.15.156:0/156567556 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcc680075a0 con 0x7fcc6c133ad0 2023-09-30T22:24:52.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.715+0000 7fcc627fc700 1 -- 172.21.15.156:0/156567556 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcc6803ea50 con 0x7fcc6c133ad0 2023-09-30T22:24:52.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.715+0000 7fcc73f8b700 1 -- 172.21.15.156:0/156567556 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc6c04f2a0 con 0x7fcc6c133ad0 2023-09-30T22:24:52.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.720+0000 7fcc627fc700 1 -- 172.21.15.156:0/156567556 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcc68017080 con 0x7fcc6c133ad0 2023-09-30T22:24:52.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.753+0000 7ff44336c700 1 Processor -- start 2023-09-30T22:24:52.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.753+0000 7ff44336c700 1 -- start start 2023-09-30T22:24:52.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.754+0000 7ff44336c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff43c0a0a70 0x7ff43c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.754+0000 7ff44336c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff43c0a1380 0x7ff43c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.754+0000 7ff44336c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff43c133f50 0x7ff43c1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.754+0000 7ff44336c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff43c09e9d0 con 0x7ff43c0a0a70 2023-09-30T22:24:52.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.754+0000 7ff44336c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c09dc00 con 0x7ff43c0a1380 2023-09-30T22:24:52.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.754+0000 7ff44336c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c09dec0 con 0x7ff43c133f50 2023-09-30T22:24:52.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.754+0000 7ff440907700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff43c0a1380 0x7ff43c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.754+0000 7ff440907700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff43c0a1380 0x7ff43c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44336/0 (socket says 172.21.15.156:44336) 2023-09-30T22:24:52.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.754+0000 7ff441108700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff43c0a0a70 0x7ff43c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.754+0000 7ff440907700 1 -- 172.21.15.156:0/3792681798 learned_addr learned my addr 172.21.15.156:0/3792681798 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:52.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.754+0000 7ff441909700 1 --2- 172.21.15.156:0/3792681798 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff43c133f50 0x7ff43c1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.754+0000 7ff441108700 1 -- 172.21.15.156:0/3792681798 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff43c133f50 msgr2=0x7ff43c1343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:52.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.754+0000 7ff441108700 1 --2- 172.21.15.156:0/3792681798 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff43c133f50 0x7ff43c1343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.754+0000 7ff441108700 1 -- 172.21.15.156:0/3792681798 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff43c0a1380 msgr2=0x7ff43c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:52.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.754+0000 7ff441108700 1 --2- 172.21.15.156:0/3792681798 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff43c0a1380 0x7ff43c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.754+0000 7ff441108700 1 -- 172.21.15.156:0/3792681798 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43c09e6a0 con 0x7ff43c0a0a70 2023-09-30T22:24:52.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.754+0000 7ff440907700 1 --2- 172.21.15.156:0/3792681798 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff43c0a1380 0x7ff43c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:52.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.754+0000 7ff441108700 1 --2- 172.21.15.156:0/3792681798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff43c0a0a70 0x7ff43c0a0e40 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7ff438009840 tx=0x7ff438009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c2ad5c1cfc4d118 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:52.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.755+0000 7ff433fff700 1 -- 172.21.15.156:0/3792681798 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff438011830 con 0x7ff43c0a0a70 2023-09-30T22:24:52.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.755+0000 7ff433fff700 1 -- 172.21.15.156:0/3792681798 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff438011990 con 0x7ff43c0a0a70 2023-09-30T22:24:52.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.755+0000 7ff433fff700 1 -- 172.21.15.156:0/3792681798 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff438011d20 con 0x7ff43c0a0a70 2023-09-30T22:24:52.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.755+0000 7ff44336c700 1 -- 172.21.15.156:0/3792681798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff43c0a0a70 msgr2=0x7ff43c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.755+0000 7ff44336c700 1 --2- 172.21.15.156:0/3792681798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff43c0a0a70 0x7ff43c0a0e40 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7ff438009840 tx=0x7ff438009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:52.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.755+0000 7ff44336c700 1 -- 172.21.15.156:0/3792681798 shutdown_connections 2023-09-30T22:24:52.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.755+0000 7ff44336c700 1 --2- 172.21.15.156:0/3792681798 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff43c133f50 0x7ff43c1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.755+0000 7ff44336c700 1 --2- 172.21.15.156:0/3792681798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff43c0a0a70 0x7ff43c0a0e40 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.755+0000 7ff44336c700 1 --2- 172.21.15.156:0/3792681798 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff43c0a1380 0x7ff43c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.755+0000 7ff44336c700 1 -- 172.21.15.156:0/3792681798 >> 172.21.15.156:0/3792681798 conn(0x7ff43c0a6610 msgr2=0x7ff43c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:52.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.755+0000 7ff44336c700 1 -- 172.21.15.156:0/3792681798 shutdown_connections 2023-09-30T22:24:52.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.755+0000 7ff44336c700 1 -- 172.21.15.156:0/3792681798 wait complete. 2023-09-30T22:24:52.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.756+0000 7ff44336c700 1 Processor -- start 2023-09-30T22:24:52.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.756+0000 7ff44336c700 1 -- start start 2023-09-30T22:24:52.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.757+0000 7ff44336c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff43c0a0a70 0x7ff43c11f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.757+0000 7ff44336c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff43c0a1380 0x7ff43c11fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.757+0000 7ff44336c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff43c133f50 0x7ff43c1c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.757+0000 7ff44336c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c1337c0 con 0x7ff43c0a1380 2023-09-30T22:24:52.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.757+0000 7ff44336c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c11f310 con 0x7ff43c0a0a70 2023-09-30T22:24:52.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.757+0000 7ff44336c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c122950 con 0x7ff43c133f50 2023-09-30T22:24:52.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.757+0000 7ff441108700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff43c0a0a70 0x7ff43c11f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.757+0000 7ff441108700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff43c0a0a70 0x7ff43c11f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44348/0 (socket says 172.21.15.156:44348) 2023-09-30T22:24:52.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.757+0000 7ff441108700 1 -- 172.21.15.156:0/1346360785 learned_addr learned my addr 172.21.15.156:0/1346360785 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:52.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.757+0000 7ff441909700 1 --2- 172.21.15.156:0/1346360785 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff43c133f50 0x7ff43c1c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.757+0000 7ff440907700 1 --2- 172.21.15.156:0/1346360785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff43c0a1380 0x7ff43c11fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.757+0000 7ff441108700 1 -- 172.21.15.156:0/1346360785 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff43c133f50 msgr2=0x7ff43c1c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.757+0000 7ff441108700 1 --2- 172.21.15.156:0/1346360785 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff43c133f50 0x7ff43c1c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.757+0000 7ff441108700 1 -- 172.21.15.156:0/1346360785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff43c0a1380 msgr2=0x7ff43c11fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.757+0000 7ff441108700 1 --2- 172.21.15.156:0/1346360785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff43c0a1380 0x7ff43c11fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.757+0000 7ff441108700 1 -- 172.21.15.156:0/1346360785 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42c009550 con 0x7ff43c0a0a70 2023-09-30T22:24:52.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.757+0000 7ff441108700 1 --2- 172.21.15.156:0/1346360785 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff43c0a0a70 0x7ff43c11f700 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7ff4380090b0 tx=0x7ff438004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:52.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.757+0000 7ff431ffb700 1 -- 172.21.15.156:0/1346360785 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff438004450 con 0x7ff43c0a0a70 2023-09-30T22:24:52.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.758+0000 7ff431ffb700 1 -- 172.21.15.156:0/1346360785 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43801f070 con 0x7ff43c0a0a70 2023-09-30T22:24:52.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.758+0000 7ff431ffb700 1 -- 172.21.15.156:0/1346360785 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4380038e0 con 0x7ff43c0a0a70 2023-09-30T22:24:52.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.758+0000 7ff44336c700 1 -- 172.21.15.156:0/1346360785 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4380094a0 con 0x7ff43c0a0a70 2023-09-30T22:24:52.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.758+0000 7ff44336c700 1 -- 172.21.15.156:0/1346360785 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43c121ae0 con 0x7ff43c0a0a70 2023-09-30T22:24:52.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.758+0000 7ff431ffb700 1 -- 172.21.15.156:0/1346360785 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff438003a40 con 0x7ff43c0a0a70 2023-09-30T22:24:52.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.759+0000 7ff431ffb700 1 -- 172.21.15.156:0/1346360785 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff438021070 con 0x7ff43c0a0a70 2023-09-30T22:24:52.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.759+0000 7ff44336c700 1 -- 172.21.15.156:0/1346360785 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff43c1225d0 con 0x7ff43c0a0a70 2023-09-30T22:24:52.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.764+0000 7ff431ffb700 1 -- 172.21.15.156:0/1346360785 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff43801a7b0 con 0x7ff43c0a0a70 2023-09-30T22:24:52.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.868+0000 7f329dca9700 1 -- 172.21.15.156:0/2647532531 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f329809f500 con 0x7f32980a0a30 2023-09-30T22:24:52.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.868+0000 7f327ffff700 1 -- 172.21.15.156:0/2647532531 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3288024070 con 0x7f32980a0a30 2023-09-30T22:24:52.869 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:52.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.870+0000 7f329dca9700 1 -- 172.21.15.156:0/2647532531 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32980a0a30 msgr2=0x7f32981c4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.870+0000 7f329dca9700 1 --2- 172.21.15.156:0/2647532531 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32980a0a30 0x7f32981c4070 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f329809b440 tx=0x7f3288004750 comp rx=0 tx=0).stop 2023-09-30T22:24:52.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.870+0000 7f329dca9700 1 -- 172.21.15.156:0/2647532531 shutdown_connections 2023-09-30T22:24:52.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.870+0000 7f329dca9700 1 --2- 172.21.15.156:0/2647532531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32981304a0 0x7f32981c4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.870+0000 7f329dca9700 1 --2- 172.21.15.156:0/2647532531 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f32980a0a30 0x7f32981c4070 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.870+0000 7f329dca9700 1 --2- 172.21.15.156:0/2647532531 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32980a1340 0x7f32981c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.870+0000 7f329dca9700 1 -- 172.21.15.156:0/2647532531 >> 172.21.15.156:0/2647532531 conn(0x7f32980a2980 msgr2=0x7f329809deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:52.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.870+0000 7f329dca9700 1 -- 172.21.15.156:0/2647532531 shutdown_connections 2023-09-30T22:24:52.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.870+0000 7f329dca9700 1 -- 172.21.15.156:0/2647532531 wait complete. 2023-09-30T22:24:52.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:52.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.943+0000 7fcc73f8b700 1 -- 172.21.15.156:0/156567556 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcc6c09f0f0 con 0x7fcc6c133ad0 2023-09-30T22:24:52.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.943+0000 7fcc627fc700 1 -- 172.21.15.156:0/156567556 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcc68011be0 con 0x7fcc6c133ad0 2023-09-30T22:24:52.944 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:52.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.945+0000 7fcc73f8b700 1 -- 172.21.15.156:0/156567556 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcc6c133ad0 msgr2=0x7fcc6c071880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.945+0000 7fcc73f8b700 1 --2- 172.21.15.156:0/156567556 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcc6c133ad0 0x7fcc6c071880 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fcc6800c480 tx=0x7fcc6800c790 comp rx=0 tx=0).stop 2023-09-30T22:24:52.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.945+0000 7fcc73f8b700 1 -- 172.21.15.156:0/156567556 shutdown_connections 2023-09-30T22:24:52.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.945+0000 7fcc73f8b700 1 --2- 172.21.15.156:0/156567556 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcc6c139280 0x7fcc6c1c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.946+0000 7fcc73f8b700 1 --2- 172.21.15.156:0/156567556 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcc6c133ad0 0x7fcc6c071880 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.946+0000 7fcc73f8b700 1 --2- 172.21.15.156:0/156567556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc6c136960 0x7fcc6c071dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.946+0000 7fcc73f8b700 1 -- 172.21.15.156:0/156567556 >> 172.21.15.156:0/156567556 conn(0x7fcc6c099c40 msgr2=0x7fcc6c134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:52.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.946+0000 7fcc73f8b700 1 -- 172.21.15.156:0/156567556 shutdown_connections 2023-09-30T22:24:52.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.946+0000 7fcc73f8b700 1 -- 172.21.15.156:0/156567556 wait complete. 2023-09-30T22:24:52.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:52.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.975+0000 7ff44336c700 1 -- 172.21.15.156:0/1346360785 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff43c099a60 con 0x7ff43c0a0a70 2023-09-30T22:24:52.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.975+0000 7ff431ffb700 1 -- 172.21.15.156:0/1346360785 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff438015030 con 0x7ff43c0a0a70 2023-09-30T22:24:52.976 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:52.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.977+0000 7ff44336c700 1 -- 172.21.15.156:0/1346360785 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff43c0a0a70 msgr2=0x7ff43c11f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.977+0000 7ff44336c700 1 --2- 172.21.15.156:0/1346360785 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff43c0a0a70 0x7ff43c11f700 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7ff4380090b0 tx=0x7ff438004750 comp rx=0 tx=0).stop 2023-09-30T22:24:52.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.977+0000 7ff44336c700 1 -- 172.21.15.156:0/1346360785 shutdown_connections 2023-09-30T22:24:52.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.977+0000 7ff44336c700 1 --2- 172.21.15.156:0/1346360785 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff43c133f50 0x7ff43c1c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.977+0000 7ff44336c700 1 --2- 172.21.15.156:0/1346360785 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff43c0a0a70 0x7ff43c11f700 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.977+0000 7ff44336c700 1 --2- 172.21.15.156:0/1346360785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff43c0a1380 0x7ff43c11fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.977+0000 7ff44336c700 1 -- 172.21.15.156:0/1346360785 >> 172.21.15.156:0/1346360785 conn(0x7ff43c0a6610 msgr2=0x7ff43c1bbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:52.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.977+0000 7ff44336c700 1 -- 172.21.15.156:0/1346360785 shutdown_connections 2023-09-30T22:24:52.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:52.977+0000 7ff44336c700 1 -- 172.21.15.156:0/1346360785 wait complete. 2023-09-30T22:24:52.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:53.710 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:53.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.837+0000 7f553d269700 1 Processor -- start 2023-09-30T22:24:53.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.837+0000 7f553d269700 1 -- start start 2023-09-30T22:24:53.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.838+0000 7f553d269700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5538136960 0x7f5538138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.838+0000 7f553d269700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5538139280 0x7f553813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.838+0000 7f553d269700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f553806b2d0 con 0x7f5538133ad0 2023-09-30T22:24:53.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.838+0000 7f553d269700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55381345b0 con 0x7f5538136960 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.838+0000 7f553d269700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5538133610 con 0x7f5538139280 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.838+0000 7f5536ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f5538133ad0 0x7f5538133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:44672/0 (socket says 172.21.15.156:44672) 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.838+0000 7f55367fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5538136960 0x7f5538138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.838+0000 7f5536ffd700 1 -- 172.21.15.156:0/596266240 learned_addr learned my addr 172.21.15.156:0/596266240 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.838+0000 7f55377fe700 1 --2- 172.21.15.156:0/596266240 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5538139280 0x7f553813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.838+0000 7f5535ffb700 1 -- 172.21.15.156:0/596266240 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 893929287 0 0) 0x7f553806b2d0 con 0x7f5538133ad0 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.838+0000 7f55367fc700 1 -- 172.21.15.156:0/596266240 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5538139280 msgr2=0x7f553813b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.838+0000 7f55367fc700 1 --2- 172.21.15.156:0/596266240 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5538139280 0x7f553813b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.838+0000 7f55367fc700 1 -- 172.21.15.156:0/596266240 >> v1:172.21.15.156:6789/0 conn(0x7f5538133ad0 legacy=0x7f5538133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.838+0000 7f55367fc700 1 -- 172.21.15.156:0/596266240 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553809a500 con 0x7f5538136960 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.838+0000 7f55377fe700 1 --2- 172.21.15.156:0/596266240 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5538139280 0x7f553813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.838+0000 7f55367fc700 1 --2- 172.21.15.156:0/596266240 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5538136960 0x7f5538138d40 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5520009870 tx=0x7f5520009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd969aaffeb42a3f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.838+0000 7f5535ffb700 1 -- 172.21.15.156:0/596266240 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5520011830 con 0x7f5538136960 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.838+0000 7f5535ffb700 1 -- 172.21.15.156:0/596266240 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5520011990 con 0x7f5538136960 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.838+0000 7f5535ffb700 1 -- 172.21.15.156:0/596266240 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5520011d20 con 0x7f5538136960 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.839+0000 7f553d269700 1 -- 172.21.15.156:0/596266240 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5538136960 msgr2=0x7f5538138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.839+0000 7f553d269700 1 --2- 172.21.15.156:0/596266240 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5538136960 0x7f5538138d40 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5520009870 tx=0x7f5520009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.839+0000 7f553d269700 1 -- 172.21.15.156:0/596266240 shutdown_connections 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.839+0000 7f553d269700 1 --2- 172.21.15.156:0/596266240 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5538139280 0x7f553813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.839+0000 7f553d269700 1 --2- 172.21.15.156:0/596266240 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5538136960 0x7f5538138d40 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.839+0000 7f553d269700 1 -- 172.21.15.156:0/596266240 >> 172.21.15.156:0/596266240 conn(0x7f5538099c40 msgr2=0x7f55380a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.839+0000 7f553d269700 1 -- 172.21.15.156:0/596266240 shutdown_connections 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.839+0000 7f553d269700 1 -- 172.21.15.156:0/596266240 wait complete. 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.840+0000 7f553d269700 1 Processor -- start 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.840+0000 7f553d269700 1 -- start start 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.840+0000 7f553d269700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5538133ad0 0x7f553812cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.840+0000 7f553d269700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5538136960 0x7f553812d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.840+0000 7f553d269700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5538139280 0x7f553812d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.840+0000 7f553d269700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55381317a0 con 0x7f5538139280 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.840+0000 7f553d269700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f553806edc0 con 0x7f5538133ad0 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.840+0000 7f553d269700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f553809f390 con 0x7f5538136960 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.841+0000 7f55367fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5538136960 0x7f553812d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.841+0000 7f5536ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5538133ad0 0x7f553812cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.841+0000 7f55367fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5538136960 0x7f553812d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36784/0 (socket says 172.21.15.156:36784) 2023-09-30T22:24:53.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.841+0000 7f55367fc700 1 -- 172.21.15.156:0/3125518381 learned_addr learned my addr 172.21.15.156:0/3125518381 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:53.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.841+0000 7f55377fe700 1 --2- 172.21.15.156:0/3125518381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5538139280 0x7f553812d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.841+0000 7f5536ffd700 1 -- 172.21.15.156:0/3125518381 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5538136960 msgr2=0x7f553812d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:53.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.841+0000 7f5536ffd700 1 --2- 172.21.15.156:0/3125518381 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5538136960 0x7f553812d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.841+0000 7f5536ffd700 1 -- 172.21.15.156:0/3125518381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5538139280 msgr2=0x7f553812d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:53.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.841+0000 7f5536ffd700 1 --2- 172.21.15.156:0/3125518381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5538139280 0x7f553812d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.841+0000 7f5536ffd700 1 -- 172.21.15.156:0/3125518381 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5528009a70 con 0x7f5538133ad0 2023-09-30T22:24:53.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.841+0000 7f55367fc700 1 --2- 172.21.15.156:0/3125518381 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5538136960 0x7f553812d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:53.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.841+0000 7f5536ffd700 1 --2- 172.21.15.156:0/3125518381 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5538133ad0 0x7f553812cb30 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f553000c3c0 tx=0x7f553000c6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:53.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.841+0000 7f552f7fe700 1 -- 172.21.15.156:0/3125518381 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5530004a70 con 0x7f5538133ad0 2023-09-30T22:24:53.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.841+0000 7f552f7fe700 1 -- 172.21.15.156:0/3125518381 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5530004c10 con 0x7f5538133ad0 2023-09-30T22:24:53.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.841+0000 7f553d269700 1 -- 172.21.15.156:0/3125518381 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55200094a0 con 0x7f5538133ad0 2023-09-30T22:24:53.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.841+0000 7f552f7fe700 1 -- 172.21.15.156:0/3125518381 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55300070d0 con 0x7f5538133ad0 2023-09-30T22:24:53.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.841+0000 7f553d269700 1 -- 172.21.15.156:0/3125518381 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55380701b0 con 0x7f5538133ad0 2023-09-30T22:24:53.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.842+0000 7f552f7fe700 1 -- 172.21.15.156:0/3125518381 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5530007230 con 0x7f5538133ad0 2023-09-30T22:24:53.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.842+0000 7f553d269700 1 -- 172.21.15.156:0/3125518381 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5538072780 con 0x7f5538133ad0 2023-09-30T22:24:53.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.842+0000 7f552f7fe700 1 -- 172.21.15.156:0/3125518381 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f553003f1e0 con 0x7f5538133ad0 2023-09-30T22:24:53.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:53.847+0000 7f552f7fe700 1 -- 172.21.15.156:0/3125518381 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f553001bda0 con 0x7f5538133ad0 2023-09-30T22:24:53.884 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:53.959 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:53.990 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:54.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.017+0000 7f72c1f2f700 1 Processor -- start 2023-09-30T22:24:54.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.017+0000 7f72c1f2f700 1 -- start start 2023-09-30T22:24:54.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.018+0000 7f72c1f2f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72bc0a1510 0x7f72bc1351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:54.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.018+0000 7f72c1f2f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72bc1356e0 0x7f72bc137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:54.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.018+0000 7f72c1f2f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72bc0a1e70 con 0x7f72bc0a0a30 2023-09-30T22:24:54.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.018+0000 7f72c1f2f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc09a720 con 0x7f72bc1356e0 2023-09-30T22:24:54.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.018+0000 7f72c1f2f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc09b300 con 0x7f72bc0a1510 2023-09-30T22:24:54.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.018+0000 7f72baffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72bc0a1510 0x7f72bc1351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:54.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.018+0000 7f72baffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72bc0a1510 0x7f72bc1351a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36788/0 (socket says 172.21.15.156:36788) 2023-09-30T22:24:54.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.018+0000 7f72baffd700 1 -- 172.21.15.156:0/2912139080 learned_addr learned my addr 172.21.15.156:0/2912139080 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:54.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.018+0000 7f72bbfff700 1 --2- 172.21.15.156:0/2912139080 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72bc1356e0 0x7f72bc137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:54.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.019+0000 7f72baffd700 1 -- 172.21.15.156:0/2912139080 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72bc1356e0 msgr2=0x7f72bc137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:54.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.019+0000 7f72baffd700 1 --2- 172.21.15.156:0/2912139080 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72bc1356e0 0x7f72bc137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.019+0000 7f72baffd700 1 -- 172.21.15.156:0/2912139080 >> v1:172.21.15.156:6789/0 conn(0x7f72bc0a0a30 legacy=0x7f72bc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:54.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.019+0000 7f72baffd700 1 -- 172.21.15.156:0/2912139080 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72bc09abc0 con 0x7f72bc0a1510 2023-09-30T22:24:54.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.019+0000 7f72baffd700 1 --2- 172.21.15.156:0/2912139080 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72bc0a1510 0x7f72bc1351a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009920 tx=0x7f72b0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38ba5802c0e7b75b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:54.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.019+0000 7f72ba7fc700 1 -- 172.21.15.156:0/2912139080 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0011830 con 0x7f72bc0a1510 2023-09-30T22:24:54.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.019+0000 7f72ba7fc700 1 -- 172.21.15.156:0/2912139080 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b0011990 con 0x7f72bc0a1510 2023-09-30T22:24:54.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.019+0000 7f72ba7fc700 1 -- 172.21.15.156:0/2912139080 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0011d20 con 0x7f72bc0a1510 2023-09-30T22:24:54.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.020+0000 7f72c1f2f700 1 -- 172.21.15.156:0/2912139080 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72bc0a1510 msgr2=0x7f72bc1351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:54.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.020+0000 7f72c1f2f700 1 --2- 172.21.15.156:0/2912139080 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72bc0a1510 0x7f72bc1351a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009920 tx=0x7f72b0009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:54.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.020+0000 7f72c1f2f700 1 -- 172.21.15.156:0/2912139080 shutdown_connections 2023-09-30T22:24:54.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.020+0000 7f72c1f2f700 1 --2- 172.21.15.156:0/2912139080 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72bc1356e0 0x7f72bc137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.020+0000 7f72c1f2f700 1 --2- 172.21.15.156:0/2912139080 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72bc0a1510 0x7f72bc1351a0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.020+0000 7f72c1f2f700 1 -- 172.21.15.156:0/2912139080 >> 172.21.15.156:0/2912139080 conn(0x7f72bc0a2980 msgr2=0x7f72bc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:54.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.020+0000 7f72c1f2f700 1 -- 172.21.15.156:0/2912139080 shutdown_connections 2023-09-30T22:24:54.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.020+0000 7f72c1f2f700 1 -- 172.21.15.156:0/2912139080 wait complete. 2023-09-30T22:24:54.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.022+0000 7f72c1f2f700 1 Processor -- start 2023-09-30T22:24:54.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.022+0000 7f72c1f2f700 1 -- start start 2023-09-30T22:24:54.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.023+0000 7f72c1f2f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72bc0a0a30 0x7f72bc1385f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:54.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.023+0000 7f72c1f2f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72bc0a1510 0x7f72bc138b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:54.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.023+0000 7f72c1f2f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72bc1356e0 0x7f72bc1c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:54.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.023+0000 7f72c1f2f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc131040 con 0x7f72bc0a0a30 2023-09-30T22:24:54.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.023+0000 7f72c1f2f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc12f9c0 con 0x7f72bc0a1510 2023-09-30T22:24:54.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.023+0000 7f72c1f2f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc09f910 con 0x7f72bc1356e0 2023-09-30T22:24:54.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.023+0000 7f72bbfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72bc1356e0 0x7f72bc1c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:54.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.023+0000 7f72bbfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72bc1356e0 0x7f72bc1c6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36792/0 (socket says 172.21.15.156:36792) 2023-09-30T22:24:54.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.023+0000 7f72bbfff700 1 -- 172.21.15.156:0/3287605025 learned_addr learned my addr 172.21.15.156:0/3287605025 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:54.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.023+0000 7f72bb7fe700 1 --2- 172.21.15.156:0/3287605025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72bc0a0a30 0x7f72bc1385f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:54.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.023+0000 7f72baffd700 1 --2- 172.21.15.156:0/3287605025 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72bc0a1510 0x7f72bc138b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:54.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.023+0000 7f72bb7fe700 1 -- 172.21.15.156:0/3287605025 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72bc1356e0 msgr2=0x7f72bc1c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:54.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.023+0000 7f72bb7fe700 1 --2- 172.21.15.156:0/3287605025 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72bc1356e0 0x7f72bc1c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.023+0000 7f72bb7fe700 1 -- 172.21.15.156:0/3287605025 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72bc0a1510 msgr2=0x7f72bc138b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:54.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.023+0000 7f72bb7fe700 1 --2- 172.21.15.156:0/3287605025 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72bc0a1510 0x7f72bc138b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.023+0000 7f72bb7fe700 1 -- 172.21.15.156:0/3287605025 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b0009550 con 0x7f72bc0a0a30 2023-09-30T22:24:54.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.023+0000 7f72bbfff700 1 --2- 172.21.15.156:0/3287605025 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72bc1356e0 0x7f72bc1c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:54.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.023+0000 7f72baffd700 1 --2- 172.21.15.156:0/3287605025 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72bc0a1510 0x7f72bc138b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:24:54.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.023+0000 7f72bb7fe700 1 --2- 172.21.15.156:0/3287605025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72bc0a0a30 0x7f72bc1385f0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f72ac000fd0 tx=0x7f72ac00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:54.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.024+0000 7f72a3fff700 1 -- 172.21.15.156:0/3287605025 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac0054e0 con 0x7f72bc0a0a30 2023-09-30T22:24:54.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.024+0000 7f72c1f2f700 1 -- 172.21.15.156:0/3287605025 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72bc1398a0 con 0x7f72bc0a0a30 2023-09-30T22:24:54.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.024+0000 7f72a3fff700 1 -- 172.21.15.156:0/3287605025 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ac003680 con 0x7f72bc0a0a30 2023-09-30T22:24:54.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.024+0000 7f72a3fff700 1 -- 172.21.15.156:0/3287605025 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac003a10 con 0x7f72bc0a0a30 2023-09-30T22:24:54.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.024+0000 7f72c1f2f700 1 -- 172.21.15.156:0/3287605025 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72bc12fc00 con 0x7f72bc0a0a30 2023-09-30T22:24:54.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.025+0000 7f72a3fff700 1 -- 172.21.15.156:0/3287605025 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f72ac017020 con 0x7f72bc0a0a30 2023-09-30T22:24:54.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.025+0000 7f72a3fff700 1 -- 172.21.15.156:0/3287605025 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f72ac042b20 con 0x7f72bc0a0a30 2023-09-30T22:24:54.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.025+0000 7f72c1f2f700 1 -- 172.21.15.156:0/3287605025 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72bc130e80 con 0x7f72bc0a0a30 2023-09-30T22:24:54.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.034+0000 7f72a3fff700 1 -- 172.21.15.156:0/3287605025 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f72ac01f080 con 0x7f72bc0a0a30 2023-09-30T22:24:54.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.045+0000 7f553d269700 1 -- 172.21.15.156:0/3125518381 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5538070ce0 con 0x7f5538133ad0 2023-09-30T22:24:54.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.045+0000 7f552f7fe700 1 -- 172.21.15.156:0/3125518381 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f553001b340 con 0x7f5538133ad0 2023-09-30T22:24:54.046 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:54.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.047+0000 7f553d269700 1 -- 172.21.15.156:0/3125518381 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5538133ad0 msgr2=0x7f553812cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:54.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.047+0000 7f553d269700 1 --2- 172.21.15.156:0/3125518381 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5538133ad0 0x7f553812cb30 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f553000c3c0 tx=0x7f553000c6d0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.048+0000 7f553d269700 1 -- 172.21.15.156:0/3125518381 shutdown_connections 2023-09-30T22:24:54.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.048+0000 7f553d269700 1 --2- 172.21.15.156:0/3125518381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5538139280 0x7f553812d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.048+0000 7f553d269700 1 --2- 172.21.15.156:0/3125518381 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5538133ad0 0x7f553812cb30 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.048+0000 7f553d269700 1 --2- 172.21.15.156:0/3125518381 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5538136960 0x7f553812d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.048+0000 7f553d269700 1 -- 172.21.15.156:0/3125518381 >> 172.21.15.156:0/3125518381 conn(0x7f5538099c40 msgr2=0x7f5538134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:54.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.048+0000 7f553d269700 1 -- 172.21.15.156:0/3125518381 shutdown_connections 2023-09-30T22:24:54.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.048+0000 7f553d269700 1 -- 172.21.15.156:0/3125518381 wait complete. 2023-09-30T22:24:54.061 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:54.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.122+0000 7f4752695700 1 Processor -- start 2023-09-30T22:24:54.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.122+0000 7f4752695700 1 -- start start 2023-09-30T22:24:54.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.123+0000 7f4752695700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f474c133ad0 0x7f474c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:54.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.123+0000 7f4752695700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f474c1300a0 0x7f474c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:54.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.123+0000 7f4752695700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f474c1309f0 0x7f474c13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:54.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.123+0000 7f4752695700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f474c06b2d0 con 0x7f474c1300a0 2023-09-30T22:24:54.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.123+0000 7f4752695700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474c133610 con 0x7f474c133ad0 2023-09-30T22:24:54.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.123+0000 7f4752695700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f474c09a500 con 0x7f474c1309f0 2023-09-30T22:24:54.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.123+0000 7f474bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f474c133ad0 0x7f474c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:54.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.123+0000 7f474b7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f474c1300a0 0x7f474c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:54.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.123+0000 7f4750c32700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f474c1309f0 0x7f474c13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:54.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.123+0000 7f474bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f474c133ad0 0x7f474c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44396/0 (socket says 172.21.15.156:44396) 2023-09-30T22:24:54.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.123+0000 7f474b7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f474c1300a0 0x7f474c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47332/0 (socket says 172.21.15.156:47332) 2023-09-30T22:24:54.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.123+0000 7f474b7fe700 1 -- 172.21.15.156:0/1365205193 learned_addr learned my addr 172.21.15.156:0/1365205193 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:54.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.124+0000 7f474b7fe700 1 -- 172.21.15.156:0/1365205193 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f474c1309f0 msgr2=0x7f474c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:54.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.124+0000 7f474b7fe700 1 --2- 172.21.15.156:0/1365205193 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f474c1309f0 0x7f474c13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.124+0000 7f474b7fe700 1 -- 172.21.15.156:0/1365205193 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f474c133ad0 msgr2=0x7f474c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:54.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.124+0000 7f474b7fe700 1 --2- 172.21.15.156:0/1365205193 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f474c133ad0 0x7f474c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.124+0000 7f474b7fe700 1 -- 172.21.15.156:0/1365205193 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474c1338b0 con 0x7f474c1300a0 2023-09-30T22:24:54.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.124+0000 7f4750c32700 1 --2- 172.21.15.156:0/1365205193 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f474c1309f0 0x7f474c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:54.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.124+0000 7f474b7fe700 1 --2- 172.21.15.156:0/1365205193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f474c1300a0 0x7f474c1304b0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f47400098f0 tx=0x7f4740009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc968750caf7465 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:54.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.124+0000 7f474affd700 1 -- 172.21.15.156:0/1365205193 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4740011830 con 0x7f474c1300a0 2023-09-30T22:24:54.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.124+0000 7f474affd700 1 -- 172.21.15.156:0/1365205193 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4740011990 con 0x7f474c1300a0 2023-09-30T22:24:54.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.124+0000 7f474affd700 1 -- 172.21.15.156:0/1365205193 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4740011d20 con 0x7f474c1300a0 2023-09-30T22:24:54.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.125+0000 7f4752695700 1 -- 172.21.15.156:0/1365205193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f474c1300a0 msgr2=0x7f474c1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:54.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.125+0000 7f4752695700 1 --2- 172.21.15.156:0/1365205193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f474c1300a0 0x7f474c1304b0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f47400098f0 tx=0x7f4740009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:54.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.125+0000 7f4752695700 1 -- 172.21.15.156:0/1365205193 shutdown_connections 2023-09-30T22:24:54.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.125+0000 7f4752695700 1 --2- 172.21.15.156:0/1365205193 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f474c1309f0 0x7f474c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.125+0000 7f4752695700 1 --2- 172.21.15.156:0/1365205193 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f474c133ad0 0x7f474c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.125+0000 7f4752695700 1 --2- 172.21.15.156:0/1365205193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f474c1300a0 0x7f474c1304b0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.125+0000 7f4752695700 1 -- 172.21.15.156:0/1365205193 >> 172.21.15.156:0/1365205193 conn(0x7f474c099c40 msgr2=0x7f474c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:54.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.125+0000 7f4752695700 1 -- 172.21.15.156:0/1365205193 shutdown_connections 2023-09-30T22:24:54.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.125+0000 7f4752695700 1 -- 172.21.15.156:0/1365205193 wait complete. 2023-09-30T22:24:54.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.126+0000 7f4752695700 1 Processor -- start 2023-09-30T22:24:54.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.126+0000 7f4752695700 1 -- start start 2023-09-30T22:24:54.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.127+0000 7f4752695700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f474c1300a0 0x7f474c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:54.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.127+0000 7f4752695700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f474c1309f0 0x7f474c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:54.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.127+0000 7f4752695700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f474c133ad0 0x7f474c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:54.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.127+0000 7f4752695700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474c11fda0 con 0x7f474c1309f0 2023-09-30T22:24:54.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.127+0000 7f4752695700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474c12d8f0 con 0x7f474c1300a0 2023-09-30T22:24:54.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.127+0000 7f4752695700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f474c11ffa0 con 0x7f474c133ad0 2023-09-30T22:24:54.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.127+0000 7f474bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f474c1300a0 0x7f474c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:54.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.127+0000 7f4750c32700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f474c133ad0 0x7f474c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:54.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.127+0000 7f474bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f474c1300a0 0x7f474c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44410/0 (socket says 172.21.15.156:44410) 2023-09-30T22:24:54.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.127+0000 7f474bfff700 1 -- 172.21.15.156:0/826819195 learned_addr learned my addr 172.21.15.156:0/826819195 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:54.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.127+0000 7f474b7fe700 1 --2- 172.21.15.156:0/826819195 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f474c1309f0 0x7f474c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:54.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.127+0000 7f4750c32700 1 -- 172.21.15.156:0/826819195 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f474c1300a0 msgr2=0x7f474c11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:54.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.127+0000 7f4750c32700 1 --2- 172.21.15.156:0/826819195 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f474c1300a0 0x7f474c11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.128+0000 7f4750c32700 1 -- 172.21.15.156:0/826819195 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f474c1309f0 msgr2=0x7f474c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:54.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.128+0000 7f4750c32700 1 --2- 172.21.15.156:0/826819195 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f474c1309f0 0x7f474c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.128+0000 7f4750c32700 1 -- 172.21.15.156:0/826819195 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4744009a70 con 0x7f474c133ad0 2023-09-30T22:24:54.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.128+0000 7f474bfff700 1 --2- 172.21.15.156:0/826819195 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f474c1300a0 0x7f474c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:54.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.128+0000 7f474b7fe700 1 --2- 172.21.15.156:0/826819195 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f474c1309f0 0x7f474c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:54.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.128+0000 7f4750c32700 1 --2- 172.21.15.156:0/826819195 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f474c133ad0 0x7f474c11e4c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f474400efc0 tx=0x7f474400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:54.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.128+0000 7f4748ff9700 1 -- 172.21.15.156:0/826819195 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474400ca90 con 0x7f474c133ad0 2023-09-30T22:24:54.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.128+0000 7f4748ff9700 1 -- 172.21.15.156:0/826819195 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474400f040 con 0x7f474c133ad0 2023-09-30T22:24:54.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.128+0000 7f4752695700 1 -- 172.21.15.156:0/826819195 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4740009550 con 0x7f474c133ad0 2023-09-30T22:24:54.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.128+0000 7f4748ff9700 1 -- 172.21.15.156:0/826819195 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474400ce30 con 0x7f474c133ad0 2023-09-30T22:24:54.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.128+0000 7f4752695700 1 -- 172.21.15.156:0/826819195 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f474c11f2e0 con 0x7f474c133ad0 2023-09-30T22:24:54.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.129+0000 7f4748ff9700 1 -- 172.21.15.156:0/826819195 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4744014480 con 0x7f474c133ad0 2023-09-30T22:24:54.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.129+0000 7f4748ff9700 1 -- 172.21.15.156:0/826819195 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f47440416e0 con 0x7f474c133ad0 2023-09-30T22:24:54.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.129+0000 7f4752695700 1 -- 172.21.15.156:0/826819195 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f474c1208e0 con 0x7f474c133ad0 2023-09-30T22:24:54.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.132+0000 7f33b6f88700 1 Processor -- start 2023-09-30T22:24:54.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.132+0000 7f33b6f88700 1 -- start start 2023-09-30T22:24:54.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.132+0000 7f33b6f88700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33b0133ad0 0x7f33b0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:54.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.132+0000 7f33b6f88700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f33b0130bc0 0x7f33b013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:54.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.132+0000 7f33b6f88700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b006b2d0 con 0x7f33b01300a0 2023-09-30T22:24:54.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.132+0000 7f33b6f88700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b0133610 con 0x7f33b0130bc0 2023-09-30T22:24:54.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.132+0000 7f33b6f88700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b009a500 con 0x7f33b0133ad0 2023-09-30T22:24:54.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.132+0000 7f33b4d24700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33b0133ad0 0x7f33b0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:54.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.132+0000 7f33b4d24700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33b0133ad0 0x7f33b0133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44418/0 (socket says 172.21.15.156:44418) 2023-09-30T22:24:54.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.132+0000 7f33affff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f33b01300a0 0x7f33b01304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:44694/0 (socket says 172.21.15.156:44694) 2023-09-30T22:24:54.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.132+0000 7f33b4d24700 1 -- 172.21.15.156:0/710484397 learned_addr learned my addr 172.21.15.156:0/710484397 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:54.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.132+0000 7f33b5525700 1 --2- 172.21.15.156:0/710484397 >> v2:172.21.15.156:3300/0 conn(0x7f33b0130bc0 0x7f33b013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:54.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.133+0000 7f33af7fe700 1 -- 172.21.15.156:0/710484397 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1930506763 0 0) 0x7f33b006b2d0 con 0x7f33b01300a0 2023-09-30T22:24:54.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.133+0000 7f33b4d24700 1 -- 172.21.15.156:0/710484397 >> v2:172.21.15.156:3300/0 conn(0x7f33b0130bc0 msgr2=0x7f33b013b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:54.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.133+0000 7f33b4d24700 1 --2- 172.21.15.156:0/710484397 >> v2:172.21.15.156:3300/0 conn(0x7f33b0130bc0 0x7f33b013b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.133+0000 7f33b4d24700 1 -- 172.21.15.156:0/710484397 >> v1:172.21.15.156:6789/0 conn(0x7f33b01300a0 legacy=0x7f33b01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:54.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.133+0000 7f33b4d24700 1 -- 172.21.15.156:0/710484397 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b01338b0 con 0x7f33b0133ad0 2023-09-30T22:24:54.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.133+0000 7f33b4d24700 1 --2- 172.21.15.156:0/710484397 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33b0133ad0 0x7f33b0133ea0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f33a40098f0 tx=0x7f33a4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa898c574e972aeb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:54.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.133+0000 7f33af7fe700 1 -- 172.21.15.156:0/710484397 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a4011830 con 0x7f33b0133ad0 2023-09-30T22:24:54.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.133+0000 7f33af7fe700 1 -- 172.21.15.156:0/710484397 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a4011990 con 0x7f33b0133ad0 2023-09-30T22:24:54.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.133+0000 7f33af7fe700 1 -- 172.21.15.156:0/710484397 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a4011d20 con 0x7f33b0133ad0 2023-09-30T22:24:54.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.134+0000 7f33b6f88700 1 -- 172.21.15.156:0/710484397 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33b0133ad0 msgr2=0x7f33b0133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:54.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.134+0000 7f33b6f88700 1 --2- 172.21.15.156:0/710484397 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33b0133ad0 0x7f33b0133ea0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f33a40098f0 tx=0x7f33a4009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:54.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.134+0000 7f33b6f88700 1 -- 172.21.15.156:0/710484397 shutdown_connections 2023-09-30T22:24:54.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.134+0000 7f33b6f88700 1 --2- 172.21.15.156:0/710484397 >> v2:172.21.15.156:3300/0 conn(0x7f33b0130bc0 0x7f33b013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.134+0000 7f33b6f88700 1 --2- 172.21.15.156:0/710484397 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33b0133ad0 0x7f33b0133ea0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.134+0000 7f33b6f88700 1 -- 172.21.15.156:0/710484397 >> 172.21.15.156:0/710484397 conn(0x7f33b0099c40 msgr2=0x7f33b00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:54.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.134+0000 7f33b6f88700 1 -- 172.21.15.156:0/710484397 shutdown_connections 2023-09-30T22:24:54.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.134+0000 7f33b6f88700 1 -- 172.21.15.156:0/710484397 wait complete. 2023-09-30T22:24:54.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.134+0000 7f4748ff9700 1 -- 172.21.15.156:0/826819195 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4744045060 con 0x7f474c133ad0 2023-09-30T22:24:54.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.135+0000 7f33b6f88700 1 Processor -- start 2023-09-30T22:24:54.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.135+0000 7f33b6f88700 1 -- start start 2023-09-30T22:24:54.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.135+0000 7f33b6f88700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33b01300a0 0x7f33b011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:54.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.135+0000 7f33b6f88700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33b0130bc0 0x7f33b011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:54.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.135+0000 7f33b6f88700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33b0133ad0 0x7f33b011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:54.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.135+0000 7f33b6f88700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b00722c0 con 0x7f33b01300a0 2023-09-30T22:24:54.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.135+0000 7f33b6f88700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b011ff90 con 0x7f33b0133ad0 2023-09-30T22:24:54.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.135+0000 7f33b6f88700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33b012dd00 con 0x7f33b0130bc0 2023-09-30T22:24:54.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.136+0000 7f33b4d24700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33b01300a0 0x7f33b011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:54.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.136+0000 7f33b4d24700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33b01300a0 0x7f33b011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47356/0 (socket says 172.21.15.156:47356) 2023-09-30T22:24:54.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.136+0000 7f33b4d24700 1 -- 172.21.15.156:0/330016013 learned_addr learned my addr 172.21.15.156:0/330016013 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:54.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.136+0000 7f33affff700 1 --2- 172.21.15.156:0/330016013 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33b0130bc0 0x7f33b011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:54.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.136+0000 7f33b5525700 1 --2- 172.21.15.156:0/330016013 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33b0133ad0 0x7f33b011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:54.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.136+0000 7f33b4d24700 1 -- 172.21.15.156:0/330016013 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33b0130bc0 msgr2=0x7f33b011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:54.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.136+0000 7f33b4d24700 1 --2- 172.21.15.156:0/330016013 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33b0130bc0 0x7f33b011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.136+0000 7f33b4d24700 1 -- 172.21.15.156:0/330016013 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33b0133ad0 msgr2=0x7f33b011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:54.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.136+0000 7f33b4d24700 1 --2- 172.21.15.156:0/330016013 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33b0133ad0 0x7f33b011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.136+0000 7f33b4d24700 1 -- 172.21.15.156:0/330016013 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a4009550 con 0x7f33b01300a0 2023-09-30T22:24:54.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.136+0000 7f33b4d24700 1 --2- 172.21.15.156:0/330016013 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33b01300a0 0x7f33b011da40 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f33a4009c40 tx=0x7f33a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:54.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.136+0000 7f33ad7fa700 1 -- 172.21.15.156:0/330016013 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a4004550 con 0x7f33b01300a0 2023-09-30T22:24:54.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.136+0000 7f33ad7fa700 1 -- 172.21.15.156:0/330016013 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a40036a0 con 0x7f33b01300a0 2023-09-30T22:24:54.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.136+0000 7f33ad7fa700 1 -- 172.21.15.156:0/330016013 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a4003a30 con 0x7f33b01300a0 2023-09-30T22:24:54.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.136+0000 7f33b6f88700 1 -- 172.21.15.156:0/330016013 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b011f910 con 0x7f33b01300a0 2023-09-30T22:24:54.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.136+0000 7f33b6f88700 1 -- 172.21.15.156:0/330016013 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b011fcd0 con 0x7f33b01300a0 2023-09-30T22:24:54.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.137+0000 7f33ad7fa700 1 -- 172.21.15.156:0/330016013 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f33a4021070 con 0x7f33b01300a0 2023-09-30T22:24:54.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.137+0000 7f33ad7fa700 1 -- 172.21.15.156:0/330016013 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f33a4040aa0 con 0x7f33b01300a0 2023-09-30T22:24:54.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.137+0000 7f33b6f88700 1 -- 172.21.15.156:0/330016013 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b01201d0 con 0x7f33b01300a0 2023-09-30T22:24:54.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.146+0000 7f33ad7fa700 1 -- 172.21.15.156:0/330016013 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f33a4029080 con 0x7f33b01300a0 2023-09-30T22:24:54.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.264+0000 7f72c1f2f700 1 -- 172.21.15.156:0/3287605025 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f72bc04f2a0 con 0x7f72bc0a0a30 2023-09-30T22:24:54.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.264+0000 7f72a3fff700 1 -- 172.21.15.156:0/3287605025 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f72ac011560 con 0x7f72bc0a0a30 2023-09-30T22:24:54.265 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:54.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.266+0000 7f72c1f2f700 1 -- 172.21.15.156:0/3287605025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72bc0a0a30 msgr2=0x7f72bc1385f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:54.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.266+0000 7f72c1f2f700 1 --2- 172.21.15.156:0/3287605025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72bc0a0a30 0x7f72bc1385f0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f72ac000fd0 tx=0x7f72ac00c7b0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.266+0000 7f72c1f2f700 1 -- 172.21.15.156:0/3287605025 shutdown_connections 2023-09-30T22:24:54.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.267+0000 7f72c1f2f700 1 --2- 172.21.15.156:0/3287605025 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72bc1356e0 0x7f72bc1c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.267+0000 7f72c1f2f700 1 --2- 172.21.15.156:0/3287605025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72bc0a0a30 0x7f72bc1385f0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.267+0000 7f72c1f2f700 1 --2- 172.21.15.156:0/3287605025 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72bc0a1510 0x7f72bc138b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.267+0000 7f72c1f2f700 1 -- 172.21.15.156:0/3287605025 >> 172.21.15.156:0/3287605025 conn(0x7f72bc0a2980 msgr2=0x7f72bc12e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:54.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.267+0000 7f72c1f2f700 1 -- 172.21.15.156:0/3287605025 shutdown_connections 2023-09-30T22:24:54.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.267+0000 7f72c1f2f700 1 -- 172.21.15.156:0/3287605025 wait complete. 2023-09-30T22:24:54.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:54.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.330+0000 7f4752695700 1 -- 172.21.15.156:0/826819195 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f474c04f2a0 con 0x7f474c133ad0 2023-09-30T22:24:54.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.330+0000 7f4748ff9700 1 -- 172.21.15.156:0/826819195 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4744012930 con 0x7f474c133ad0 2023-09-30T22:24:54.331 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:54.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.332+0000 7f4752695700 1 -- 172.21.15.156:0/826819195 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f474c133ad0 msgr2=0x7f474c11e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:54.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.332+0000 7f4752695700 1 --2- 172.21.15.156:0/826819195 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f474c133ad0 0x7f474c11e4c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f474400efc0 tx=0x7f474400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.332+0000 7f4752695700 1 -- 172.21.15.156:0/826819195 shutdown_connections 2023-09-30T22:24:54.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.332+0000 7f4752695700 1 --2- 172.21.15.156:0/826819195 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f474c133ad0 0x7f474c11e4c0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.332+0000 7f4752695700 1 --2- 172.21.15.156:0/826819195 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f474c1300a0 0x7f474c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.332+0000 7f4752695700 1 --2- 172.21.15.156:0/826819195 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f474c1309f0 0x7f474c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.332+0000 7f4752695700 1 -- 172.21.15.156:0/826819195 >> 172.21.15.156:0/826819195 conn(0x7f474c099c40 msgr2=0x7f474c12e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:54.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.332+0000 7f4752695700 1 -- 172.21.15.156:0/826819195 shutdown_connections 2023-09-30T22:24:54.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.332+0000 7f4752695700 1 -- 172.21.15.156:0/826819195 wait complete. 2023-09-30T22:24:54.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.339+0000 7f33b6f88700 1 -- 172.21.15.156:0/330016013 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f33b004f2a0 con 0x7f33b01300a0 2023-09-30T22:24:54.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.340+0000 7f33ad7fa700 1 -- 172.21.15.156:0/330016013 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f33a4015020 con 0x7f33b01300a0 2023-09-30T22:24:54.340 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:54.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.342+0000 7f33b6f88700 1 -- 172.21.15.156:0/330016013 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33b01300a0 msgr2=0x7f33b011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:54.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.342+0000 7f33b6f88700 1 --2- 172.21.15.156:0/330016013 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33b01300a0 0x7f33b011da40 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f33a4009c40 tx=0x7f33a4004750 comp rx=0 tx=0).stop 2023-09-30T22:24:54.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.342+0000 7f33b6f88700 1 -- 172.21.15.156:0/330016013 shutdown_connections 2023-09-30T22:24:54.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.342+0000 7f33b6f88700 1 --2- 172.21.15.156:0/330016013 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33b0133ad0 0x7f33b011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.342+0000 7f33b6f88700 1 --2- 172.21.15.156:0/330016013 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33b01300a0 0x7f33b011da40 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.342+0000 7f33b6f88700 1 --2- 172.21.15.156:0/330016013 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f33b0130bc0 0x7f33b011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.342+0000 7f33b6f88700 1 -- 172.21.15.156:0/330016013 >> 172.21.15.156:0/330016013 conn(0x7f33b0099c40 msgr2=0x7f33b0132b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:54.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.342+0000 7f33b6f88700 1 -- 172.21.15.156:0/330016013 shutdown_connections 2023-09-30T22:24:54.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:54.342+0000 7f33b6f88700 1 -- 172.21.15.156:0/330016013 wait complete. 2023-09-30T22:24:54.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:54.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:55.062 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:55.336 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:55.349 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:55.355 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:55.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.481+0000 7f3e52cdc700 1 Processor -- start 2023-09-30T22:24:55.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.481+0000 7f3e52cdc700 1 -- start start 2023-09-30T22:24:55.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.481+0000 7f3e52cdc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e4c06a770 0x7f3e4c1349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.481+0000 7f3e52cdc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e4c09e070 0x7f3e4c13fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.481+0000 7f3e52cdc700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4c09eca0 con 0x7f3e4c134f00 2023-09-30T22:24:55.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.481+0000 7f3e52cdc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c06b2e0 con 0x7f3e4c09e070 2023-09-30T22:24:55.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.481+0000 7f3e52cdc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c09f720 con 0x7f3e4c06a770 2023-09-30T22:24:55.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.481+0000 7f3e50a78700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e4c06a770 0x7f3e4c1349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.482+0000 7f3e4bfff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f3e4c134f00 0x7f3e4c09d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:44708/0 (socket says 172.21.15.156:44708) 2023-09-30T22:24:55.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.482+0000 7f3e4bfff700 1 -- 172.21.15.156:0/4027806270 learned_addr learned my addr 172.21.15.156:0/4027806270 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:55.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.482+0000 7f3e51279700 1 --2- 172.21.15.156:0/4027806270 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e4c09e070 0x7f3e4c13fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.482+0000 7f3e50a78700 1 -- 172.21.15.156:0/4027806270 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e4c09e070 msgr2=0x7f3e4c13fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:55.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.482+0000 7f3e50a78700 1 --2- 172.21.15.156:0/4027806270 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e4c09e070 0x7f3e4c13fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.482+0000 7f3e50a78700 1 -- 172.21.15.156:0/4027806270 >> v1:172.21.15.156:6789/0 conn(0x7f3e4c134f00 legacy=0x7f3e4c09d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.482+0000 7f3e50a78700 1 -- 172.21.15.156:0/4027806270 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c06b480 con 0x7f3e4c06a770 2023-09-30T22:24:55.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.482+0000 7f3e50a78700 1 --2- 172.21.15.156:0/4027806270 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e4c06a770 0x7f3e4c1349c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009870 tx=0x7f3e40009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f676a1fbf33d196 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:55.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.482+0000 7f3e4b7fe700 1 -- 172.21.15.156:0/4027806270 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e40011830 con 0x7f3e4c06a770 2023-09-30T22:24:55.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.482+0000 7f3e4b7fe700 1 -- 172.21.15.156:0/4027806270 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e40011990 con 0x7f3e4c06a770 2023-09-30T22:24:55.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.482+0000 7f3e4b7fe700 1 -- 172.21.15.156:0/4027806270 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e40011d20 con 0x7f3e4c06a770 2023-09-30T22:24:55.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.483+0000 7f3e52cdc700 1 -- 172.21.15.156:0/4027806270 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e4c06a770 msgr2=0x7f3e4c1349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.483+0000 7f3e52cdc700 1 --2- 172.21.15.156:0/4027806270 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e4c06a770 0x7f3e4c1349c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009870 tx=0x7f3e40009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:55.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.483+0000 7f3e52cdc700 1 -- 172.21.15.156:0/4027806270 shutdown_connections 2023-09-30T22:24:55.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.483+0000 7f3e52cdc700 1 --2- 172.21.15.156:0/4027806270 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e4c09e070 0x7f3e4c13fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.483+0000 7f3e52cdc700 1 --2- 172.21.15.156:0/4027806270 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e4c06a770 0x7f3e4c1349c0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.483+0000 7f3e52cdc700 1 -- 172.21.15.156:0/4027806270 >> 172.21.15.156:0/4027806270 conn(0x7f3e4c099c40 msgr2=0x7f3e4c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:55.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.483+0000 7f3e52cdc700 1 -- 172.21.15.156:0/4027806270 shutdown_connections 2023-09-30T22:24:55.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.483+0000 7f3e52cdc700 1 -- 172.21.15.156:0/4027806270 wait complete. 2023-09-30T22:24:55.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.484+0000 7f3e52cdc700 1 Processor -- start 2023-09-30T22:24:55.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.484+0000 7f3e52cdc700 1 -- start start 2023-09-30T22:24:55.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.485+0000 7f3e52cdc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e4c06a770 0x7f3e4c133da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.485+0000 7f3e52cdc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e4c09e070 0x7f3e4c06f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.485+0000 7f3e52cdc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e4c134f00 0x7f3e4c06fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.485+0000 7f3e52cdc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c139470 con 0x7f3e4c134f00 2023-09-30T22:24:55.607 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.485+0000 7f3e52cdc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c071510 con 0x7f3e4c06a770 2023-09-30T22:24:55.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.485+0000 7f3e52cdc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0719b0 con 0x7f3e4c09e070 2023-09-30T22:24:55.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.485+0000 7f3e4bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e4c09e070 0x7f3e4c06f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.485+0000 7f3e4bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e4c09e070 0x7f3e4c06f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36838/0 (socket says 172.21.15.156:36838) 2023-09-30T22:24:55.608 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.485+0000 7f3e4bfff700 1 -- 172.21.15.156:0/677018128 learned_addr learned my addr 172.21.15.156:0/677018128 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:55.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.485+0000 7f3e50a78700 1 --2- 172.21.15.156:0/677018128 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e4c06a770 0x7f3e4c133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.485+0000 7f3e51279700 1 --2- 172.21.15.156:0/677018128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e4c134f00 0x7f3e4c06fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.485+0000 7f3e4bfff700 1 -- 172.21.15.156:0/677018128 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e4c06a770 msgr2=0x7f3e4c133da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.485+0000 7f3e4bfff700 1 --2- 172.21.15.156:0/677018128 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e4c06a770 0x7f3e4c133da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.609 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.485+0000 7f3e4bfff700 1 -- 172.21.15.156:0/677018128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e4c134f00 msgr2=0x7f3e4c06fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.485+0000 7f3e4bfff700 1 --2- 172.21.15.156:0/677018128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e4c134f00 0x7f3e4c06fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.485+0000 7f3e4bfff700 1 -- 172.21.15.156:0/677018128 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e400094a0 con 0x7f3e4c09e070 2023-09-30T22:24:55.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.485+0000 7f3e51279700 1 --2- 172.21.15.156:0/677018128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e4c134f00 0x7f3e4c06fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:24:55.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.485+0000 7f83ca3d5700 1 Processor -- start 2023-09-30T22:24:55.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.486+0000 7f83ca3d5700 1 -- start start 2023-09-30T22:24:55.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.486+0000 7f83ca3d5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83c409e870 0x7f83c409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.486+0000 7f83ca3d5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f83c409f180 0x7f83c4131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.486+0000 7f83ca3d5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f83c4131d70 0x7f83c4132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.486+0000 7f83ca3d5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c40a0920 con 0x7f83c409f180 2023-09-30T22:24:55.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.486+0000 7f83ca3d5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c409c970 con 0x7f83c409e870 2023-09-30T22:24:55.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.486+0000 7f83ca3d5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83c409bab0 con 0x7f83c4131d70 2023-09-30T22:24:55.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.486+0000 7f83c8972700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f83c4131d70 0x7f83c4132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.486+0000 7f3e4bfff700 1 --2- 172.21.15.156:0/677018128 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e4c09e070 0x7f3e4c06f7f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f3e3800c500 tx=0x7f3e3800c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:55.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.486+0000 7f83c8972700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f83c4131d70 0x7f83c4132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36854/0 (socket says 172.21.15.156:36854) 2023-09-30T22:24:55.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.486+0000 7f83c8972700 1 -- 172.21.15.156:0/3539778834 learned_addr learned my addr 172.21.15.156:0/3539778834 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:55.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.486+0000 7f83c3fff700 1 --2- 172.21.15.156:0/3539778834 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83c409e870 0x7f83c409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.486+0000 7f83c37fe700 1 --2- 172.21.15.156:0/3539778834 >> v2:172.21.15.156:3300/0 conn(0x7f83c409f180 0x7f83c4131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.486+0000 7f3e497fa700 1 -- 172.21.15.156:0/677018128 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e38005d70 con 0x7f3e4c09e070 2023-09-30T22:24:55.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.486+0000 7f3e497fa700 1 -- 172.21.15.156:0/677018128 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e380070d0 con 0x7f3e4c09e070 2023-09-30T22:24:55.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.487+0000 7f83c8972700 1 -- 172.21.15.156:0/3539778834 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83c409e870 msgr2=0x7f83c409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:55.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.487+0000 7f83c8972700 1 --2- 172.21.15.156:0/3539778834 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83c409e870 0x7f83c409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.487+0000 7f83c8972700 1 -- 172.21.15.156:0/3539778834 >> v2:172.21.15.156:3300/0 conn(0x7f83c409f180 msgr2=0x7f83c4131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:55.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.487+0000 7f83c8972700 1 --2- 172.21.15.156:0/3539778834 >> v2:172.21.15.156:3300/0 conn(0x7f83c409f180 0x7f83c4131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.487+0000 7f83c8972700 1 -- 172.21.15.156:0/3539778834 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c409f9c0 con 0x7f83c4131d70 2023-09-30T22:24:55.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.486+0000 7f3e497fa700 1 -- 172.21.15.156:0/677018128 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e38007440 con 0x7f3e4c09e070 2023-09-30T22:24:55.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.486+0000 7f3e52cdc700 1 -- 172.21.15.156:0/677018128 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e4c0a0e80 con 0x7f3e4c09e070 2023-09-30T22:24:55.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.487+0000 7f3e52cdc700 1 -- 172.21.15.156:0/677018128 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4c0725f0 con 0x7f3e4c09e070 2023-09-30T22:24:55.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.487+0000 7f83c8972700 1 --2- 172.21.15.156:0/3539778834 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f83c4131d70 0x7f83c4132210 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f83bc009e50 tx=0x7f83bc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b887971eb9920e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:55.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.487+0000 7f83c2ffd700 1 -- 172.21.15.156:0/3539778834 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc00e070 con 0x7f83c4131d70 2023-09-30T22:24:55.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.487+0000 7f83c2ffd700 1 -- 172.21.15.156:0/3539778834 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83bc00b910 con 0x7f83c4131d70 2023-09-30T22:24:55.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.487+0000 7f83c2ffd700 1 -- 172.21.15.156:0/3539778834 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc00bcc0 con 0x7f83c4131d70 2023-09-30T22:24:55.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.488+0000 7f83ca3d5700 1 -- 172.21.15.156:0/3539778834 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f83c4131d70 msgr2=0x7f83c4132210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.488+0000 7f83ca3d5700 1 --2- 172.21.15.156:0/3539778834 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f83c4131d70 0x7f83c4132210 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f83bc009e50 tx=0x7f83bc00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:55.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.488+0000 7f83ca3d5700 1 -- 172.21.15.156:0/3539778834 shutdown_connections 2023-09-30T22:24:55.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.488+0000 7f83ca3d5700 1 --2- 172.21.15.156:0/3539778834 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f83c4131d70 0x7f83c4132210 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.488+0000 7f83ca3d5700 1 --2- 172.21.15.156:0/3539778834 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83c409e870 0x7f83c409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.488+0000 7f83ca3d5700 1 --2- 172.21.15.156:0/3539778834 >> v2:172.21.15.156:3300/0 conn(0x7f83c409f180 0x7f83c4131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.488+0000 7f83ca3d5700 1 -- 172.21.15.156:0/3539778834 >> 172.21.15.156:0/3539778834 conn(0x7f83c40a4430 msgr2=0x7f83c40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:55.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.488+0000 7f3e52cdc700 1 -- 172.21.15.156:0/677018128 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e4c04f2a0 con 0x7f3e4c09e070 2023-09-30T22:24:55.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.488+0000 7f83ca3d5700 1 -- 172.21.15.156:0/3539778834 shutdown_connections 2023-09-30T22:24:55.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.488+0000 7f83ca3d5700 1 -- 172.21.15.156:0/3539778834 wait complete. 2023-09-30T22:24:55.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.488+0000 7f3e497fa700 1 -- 172.21.15.156:0/677018128 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3e380075a0 con 0x7f3e4c09e070 2023-09-30T22:24:55.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.488+0000 7f3e497fa700 1 -- 172.21.15.156:0/677018128 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3e3803eb50 con 0x7f3e4c09e070 2023-09-30T22:24:55.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.489+0000 7f83ca3d5700 1 Processor -- start 2023-09-30T22:24:55.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.490+0000 7f83ca3d5700 1 -- start start 2023-09-30T22:24:55.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.490+0000 7f83ca3d5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83c409e870 0x7f83c406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.490+0000 7f83ca3d5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83c409f180 0x7f83c406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.490+0000 7f83ca3d5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f83c4131d70 0x7f83c406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.490+0000 7f83ca3d5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c4130100 con 0x7f83c409f180 2023-09-30T22:24:55.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.490+0000 7f83ca3d5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c4125070 con 0x7f83c409e870 2023-09-30T22:24:55.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.490+0000 7f83ca3d5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83c409b190 con 0x7f83c4131d70 2023-09-30T22:24:55.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.490+0000 7f83c3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83c409e870 0x7f83c406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.490+0000 7f83c8972700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f83c4131d70 0x7f83c406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.490+0000 7f83c3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83c409e870 0x7f83c406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44458/0 (socket says 172.21.15.156:44458) 2023-09-30T22:24:55.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.490+0000 7f83c8972700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f83c4131d70 0x7f83c406c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36856/0 (socket says 172.21.15.156:36856) 2023-09-30T22:24:55.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.490+0000 7f83c3fff700 1 -- 172.21.15.156:0/2389241286 learned_addr learned my addr 172.21.15.156:0/2389241286 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:55.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.490+0000 7f83c37fe700 1 --2- 172.21.15.156:0/2389241286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83c409f180 0x7f83c406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.491+0000 7f83c3fff700 1 -- 172.21.15.156:0/2389241286 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f83c4131d70 msgr2=0x7f83c406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.491+0000 7f83c3fff700 1 --2- 172.21.15.156:0/2389241286 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f83c4131d70 0x7f83c406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.491+0000 7f83c3fff700 1 -- 172.21.15.156:0/2389241286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83c409f180 msgr2=0x7f83c406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.491+0000 7f83c3fff700 1 --2- 172.21.15.156:0/2389241286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83c409f180 0x7f83c406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.491+0000 7f83c3fff700 1 -- 172.21.15.156:0/2389241286 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc009b30 con 0x7f83c409e870 2023-09-30T22:24:55.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.491+0000 7f83c8972700 1 --2- 172.21.15.156:0/2389241286 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f83c4131d70 0x7f83c406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:55.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.491+0000 7f83c37fe700 1 --2- 172.21.15.156:0/2389241286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83c409f180 0x7f83c406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:55.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.491+0000 7f83c3fff700 1 --2- 172.21.15.156:0/2389241286 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83c409e870 0x7f83c406b8b0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f83b400e930 tx=0x7f83b400ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:55.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.491+0000 7f83c0ff9700 1 -- 172.21.15.156:0/2389241286 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b4013680 con 0x7f83c409e870 2023-09-30T22:24:55.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.491+0000 7f83c0ff9700 1 -- 172.21.15.156:0/2389241286 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b40137e0 con 0x7f83c409e870 2023-09-30T22:24:55.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.491+0000 7f83ca3d5700 1 -- 172.21.15.156:0/2389241286 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c40a0210 con 0x7f83c409e870 2023-09-30T22:24:55.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.491+0000 7f83c0ff9700 1 -- 172.21.15.156:0/2389241286 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b4013b70 con 0x7f83c409e870 2023-09-30T22:24:55.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.491+0000 7f83ca3d5700 1 -- 172.21.15.156:0/2389241286 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c4125800 con 0x7f83c409e870 2023-09-30T22:24:55.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.493+0000 7f83ca3d5700 1 -- 172.21.15.156:0/2389241286 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c411be60 con 0x7f83c409e870 2023-09-30T22:24:55.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.494+0000 7f83c0ff9700 1 -- 172.21.15.156:0/2389241286 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f83b4013cd0 con 0x7f83c409e870 2023-09-30T22:24:55.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.494+0000 7f83c0ff9700 1 -- 172.21.15.156:0/2389241286 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f83b403fe50 con 0x7f83c409e870 2023-09-30T22:24:55.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.497+0000 7f3e497fa700 1 -- 172.21.15.156:0/677018128 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3e38019b40 con 0x7f3e4c09e070 2023-09-30T22:24:55.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.498+0000 7f83c0ff9700 1 -- 172.21.15.156:0/2389241286 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f83b400c970 con 0x7f83c409e870 2023-09-30T22:24:55.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.521+0000 7feae8a4b700 1 Processor -- start 2023-09-30T22:24:55.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.521+0000 7feae8a4b700 1 -- start start 2023-09-30T22:24:55.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.522+0000 7feae8a4b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feae409a130 0x7feae409e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.522+0000 7feae8a4b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feae409edb0 0x7feae409f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.522+0000 7feae8a4b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7feae413c410 0x7feae413e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.522+0000 7feae8a4b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae409a500 con 0x7feae413c410 2023-09-30T22:24:55.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.522+0000 7feae8a4b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae409f720 con 0x7feae409edb0 2023-09-30T22:24:55.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.522+0000 7feae8a4b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feae4072b30 con 0x7feae409a130 2023-09-30T22:24:55.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.522+0000 7feae259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feae409a130 0x7feae409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.522+0000 7feae259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feae409a130 0x7feae409e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36872/0 (socket says 172.21.15.156:36872) 2023-09-30T22:24:55.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.522+0000 7feae259c700 1 -- 172.21.15.156:0/888502466 learned_addr learned my addr 172.21.15.156:0/888502466 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:55.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.522+0000 7feae2d9d700 1 --2- 172.21.15.156:0/888502466 >> v2:172.21.15.156:3300/0 conn(0x7feae413c410 0x7feae413e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.522+0000 7feae1d9b700 1 --2- 172.21.15.156:0/888502466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feae409edb0 0x7feae409f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.522+0000 7feae2d9d700 1 -- 172.21.15.156:0/888502466 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feae409a130 msgr2=0x7feae409e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:55.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.522+0000 7feae2d9d700 1 --2- 172.21.15.156:0/888502466 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feae409a130 0x7feae409e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.522+0000 7feae2d9d700 1 -- 172.21.15.156:0/888502466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feae409edb0 msgr2=0x7feae409f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:55.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.522+0000 7feae2d9d700 1 --2- 172.21.15.156:0/888502466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feae409edb0 0x7feae409f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.522+0000 7feae2d9d700 1 -- 172.21.15.156:0/888502466 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae409fe00 con 0x7feae413c410 2023-09-30T22:24:55.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.522+0000 7feae1d9b700 1 --2- 172.21.15.156:0/888502466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feae409edb0 0x7feae409f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:55.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.523+0000 7feae2d9d700 1 --2- 172.21.15.156:0/888502466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feae413c410 0x7feae413e7f0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7feadc009dc0 tx=0x7feadc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f656019d37d7426 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:55.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.523+0000 7feae159a700 1 -- 172.21.15.156:0/888502466 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc00e070 con 0x7feae413c410 2023-09-30T22:24:55.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.523+0000 7feae159a700 1 -- 172.21.15.156:0/888502466 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feadc00bae0 con 0x7feae413c410 2023-09-30T22:24:55.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.523+0000 7feae159a700 1 -- 172.21.15.156:0/888502466 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc00be90 con 0x7feae413c410 2023-09-30T22:24:55.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.523+0000 7f2d9a65a700 1 Processor -- start 2023-09-30T22:24:55.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.523+0000 7f2d9a65a700 1 -- start start 2023-09-30T22:24:55.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.524+0000 7feae8a4b700 1 -- 172.21.15.156:0/888502466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feae413c410 msgr2=0x7feae413e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.524+0000 7feae8a4b700 1 --2- 172.21.15.156:0/888502466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feae413c410 0x7feae413e7f0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7feadc009dc0 tx=0x7feadc00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:55.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.524+0000 7feae8a4b700 1 -- 172.21.15.156:0/888502466 shutdown_connections 2023-09-30T22:24:55.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.524+0000 7feae8a4b700 1 --2- 172.21.15.156:0/888502466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feae413c410 0x7feae413e7f0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.524+0000 7feae8a4b700 1 --2- 172.21.15.156:0/888502466 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feae409a130 0x7feae409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.524+0000 7feae8a4b700 1 --2- 172.21.15.156:0/888502466 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feae409edb0 0x7feae409f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.524+0000 7feae8a4b700 1 -- 172.21.15.156:0/888502466 >> 172.21.15.156:0/888502466 conn(0x7feae40a4430 msgr2=0x7feae40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:55.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.524+0000 7f2d9a65a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2d9409ad40 0x7f2d94133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.524+0000 7f2d9a65a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d941343d0 0x7f2d940a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.524+0000 7f2d9a65a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d9409b110 con 0x7f2d94133f70 2023-09-30T22:24:55.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.524+0000 7f2d9a65a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d940a3b60 con 0x7f2d9409ad40 2023-09-30T22:24:55.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.524+0000 7f2d9a65a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d94134850 con 0x7f2d941343d0 2023-09-30T22:24:55.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.524+0000 7feae8a4b700 1 -- 172.21.15.156:0/888502466 shutdown_connections 2023-09-30T22:24:55.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.524+0000 7feae8a4b700 1 -- 172.21.15.156:0/888502466 wait complete. 2023-09-30T22:24:55.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.524+0000 7f2d937fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f2d94133f70 0x7f2d940a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:44712/0 (socket says 172.21.15.156:44712) 2023-09-30T22:24:55.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.524+0000 7f2d937fe700 1 -- 172.21.15.156:0/1955305278 learned_addr learned my addr 172.21.15.156:0/1955305278 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:55.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.524+0000 7f2d93fff700 1 --2- 172.21.15.156:0/1955305278 >> v2:172.21.15.156:3300/0 conn(0x7f2d9409ad40 0x7f2d94133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.524+0000 7f2d98bf7700 1 --2- 172.21.15.156:0/1955305278 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d941343d0 0x7f2d940a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.524+0000 7f2d92ffd700 1 -- 172.21.15.156:0/1955305278 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156598390 0 0) 0x7f2d9409b110 con 0x7f2d94133f70 2023-09-30T22:24:55.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.524+0000 7f2d92ffd700 1 -- 172.21.15.156:0/1955305278 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d7c0035b0 con 0x7f2d94133f70 2023-09-30T22:24:55.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.525+0000 7f2d93fff700 1 -- 172.21.15.156:0/1955305278 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d941343d0 msgr2=0x7f2d940a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:55.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.525+0000 7f2d93fff700 1 --2- 172.21.15.156:0/1955305278 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d941343d0 0x7f2d940a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.525+0000 7f2d93fff700 1 -- 172.21.15.156:0/1955305278 >> v1:172.21.15.156:6789/0 conn(0x7f2d94133f70 legacy=0x7f2d940a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.525+0000 7f2d93fff700 1 -- 172.21.15.156:0/1955305278 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d940a2fa0 con 0x7f2d9409ad40 2023-09-30T22:24:55.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.525+0000 7f2d93fff700 1 --2- 172.21.15.156:0/1955305278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d9409ad40 0x7f2d94133a30 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f2d84009840 tx=0x7f2d84009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a28f556c5627a927 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:55.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.525+0000 7f2d92ffd700 1 -- 172.21.15.156:0/1955305278 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d84014e90 con 0x7f2d9409ad40 2023-09-30T22:24:55.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.525+0000 7f2d92ffd700 1 -- 172.21.15.156:0/1955305278 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8401c440 con 0x7f2d9409ad40 2023-09-30T22:24:55.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.525+0000 7f2d92ffd700 1 -- 172.21.15.156:0/1955305278 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8401c7d0 con 0x7f2d9409ad40 2023-09-30T22:24:55.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.525+0000 7feae8a4b700 1 Processor -- start 2023-09-30T22:24:55.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.525+0000 7feae8a4b700 1 -- start start 2023-09-30T22:24:55.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.526+0000 7f2d9a65a700 1 -- 172.21.15.156:0/1955305278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d9409ad40 msgr2=0x7f2d94133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.526+0000 7f2d9a65a700 1 --2- 172.21.15.156:0/1955305278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d9409ad40 0x7f2d94133a30 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f2d84009840 tx=0x7f2d84009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:55.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.526+0000 7f2d9a65a700 1 -- 172.21.15.156:0/1955305278 shutdown_connections 2023-09-30T22:24:55.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.526+0000 7f2d9a65a700 1 --2- 172.21.15.156:0/1955305278 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d941343d0 0x7f2d940a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.526+0000 7f2d9a65a700 1 --2- 172.21.15.156:0/1955305278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d9409ad40 0x7f2d94133a30 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.526+0000 7f2d9a65a700 1 -- 172.21.15.156:0/1955305278 >> 172.21.15.156:0/1955305278 conn(0x7f2d94099c40 msgr2=0x7f2d9406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:55.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.526+0000 7f2d9a65a700 1 -- 172.21.15.156:0/1955305278 shutdown_connections 2023-09-30T22:24:55.636 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.526+0000 7f2d9a65a700 1 -- 172.21.15.156:0/1955305278 wait complete. 2023-09-30T22:24:55.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.526+0000 7feae8a4b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feae409a130 0x7feae411c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.526+0000 7feae8a4b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feae409edb0 0x7feae411c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.526+0000 7feae8a4b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feae413c410 0x7feae411cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.526+0000 7feae8a4b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae411d730 con 0x7feae409a130 2023-09-30T22:24:55.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.526+0000 7feae8a4b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae41286e0 con 0x7feae413c410 2023-09-30T22:24:55.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.526+0000 7feae8a4b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feae41277f0 con 0x7feae409edb0 2023-09-30T22:24:55.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.526+0000 7feae1d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feae409edb0 0x7feae411c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.526+0000 7feae1d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feae409edb0 0x7feae411c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36880/0 (socket says 172.21.15.156:36880) 2023-09-30T22:24:55.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.526+0000 7feae1d9b700 1 -- 172.21.15.156:0/1629793465 learned_addr learned my addr 172.21.15.156:0/1629793465 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:55.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.526+0000 7feae259c700 1 --2- 172.21.15.156:0/1629793465 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feae409a130 0x7feae411c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.526+0000 7feae2d9d700 1 --2- 172.21.15.156:0/1629793465 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feae413c410 0x7feae411cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.526+0000 7feae259c700 1 -- 172.21.15.156:0/1629793465 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feae409edb0 msgr2=0x7feae411c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.526+0000 7feae259c700 1 --2- 172.21.15.156:0/1629793465 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feae409edb0 0x7feae411c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.526+0000 7feae259c700 1 -- 172.21.15.156:0/1629793465 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feae413c410 msgr2=0x7feae411cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.526+0000 7feae259c700 1 --2- 172.21.15.156:0/1629793465 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feae413c410 0x7feae411cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.526+0000 7feae259c700 1 -- 172.21.15.156:0/1629793465 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead80094a0 con 0x7feae409a130 2023-09-30T22:24:55.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.526+0000 7feae2d9d700 1 --2- 172.21.15.156:0/1629793465 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feae413c410 0x7feae411cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:55.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.526+0000 7feae1d9b700 1 --2- 172.21.15.156:0/1629793465 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feae409edb0 0x7feae411c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:55.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.527+0000 7feae259c700 1 --2- 172.21.15.156:0/1629793465 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feae409a130 0x7feae411c260 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fead400e8d0 tx=0x7fead400ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:55.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.527+0000 7fead2ffd700 1 -- 172.21.15.156:0/1629793465 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead4013680 con 0x7feae409a130 2023-09-30T22:24:55.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.527+0000 7feae8a4b700 1 -- 172.21.15.156:0/1629793465 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feadc009a70 con 0x7feae409a130 2023-09-30T22:24:55.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.527+0000 7f2d9a65a700 1 Processor -- start 2023-09-30T22:24:55.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.527+0000 7f2d9a65a700 1 -- start start 2023-09-30T22:24:55.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.527+0000 7feae8a4b700 1 -- 172.21.15.156:0/1629793465 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae40a38f0 con 0x7feae409a130 2023-09-30T22:24:55.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.527+0000 7fead2ffd700 1 -- 172.21.15.156:0/1629793465 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead40137e0 con 0x7feae409a130 2023-09-30T22:24:55.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.527+0000 7fead2ffd700 1 -- 172.21.15.156:0/1629793465 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead4013b70 con 0x7feae409a130 2023-09-30T22:24:55.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.528+0000 7feae8a4b700 1 -- 172.21.15.156:0/1629793465 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feac80052e0 con 0x7feae409a130 2023-09-30T22:24:55.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.528+0000 7f2d9a65a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d9409ad40 0x7f2d9411c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.528+0000 7f2d9a65a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d94133f70 0x7f2d9411ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.528+0000 7fead2ffd700 1 -- 172.21.15.156:0/1629793465 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fead4013cd0 con 0x7feae409a130 2023-09-30T22:24:55.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.528+0000 7f2d9a65a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d941343d0 0x7f2d9411d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.528+0000 7f2d9a65a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9411f590 con 0x7f2d9409ad40 2023-09-30T22:24:55.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.528+0000 7f2d9a65a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9411da70 con 0x7f2d941343d0 2023-09-30T22:24:55.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.528+0000 7f2d9a65a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9411f020 con 0x7f2d94133f70 2023-09-30T22:24:55.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.528+0000 7f2d98bf7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d941343d0 0x7f2d9411d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.528+0000 7f2d98bf7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d941343d0 0x7f2d9411d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44500/0 (socket says 172.21.15.156:44500) 2023-09-30T22:24:55.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.528+0000 7f2d98bf7700 1 -- 172.21.15.156:0/2278244185 learned_addr learned my addr 172.21.15.156:0/2278244185 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:55.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.528+0000 7f2d93fff700 1 --2- 172.21.15.156:0/2278244185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d9409ad40 0x7f2d9411c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.528+0000 7f2d937fe700 1 --2- 172.21.15.156:0/2278244185 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d94133f70 0x7f2d9411ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.528+0000 7f2d98bf7700 1 -- 172.21.15.156:0/2278244185 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d94133f70 msgr2=0x7f2d9411ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.528+0000 7f2d98bf7700 1 --2- 172.21.15.156:0/2278244185 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d94133f70 0x7f2d9411ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.528+0000 7f2d98bf7700 1 -- 172.21.15.156:0/2278244185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d9409ad40 msgr2=0x7f2d9411c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.528+0000 7f2d98bf7700 1 --2- 172.21.15.156:0/2278244185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d9409ad40 0x7f2d9411c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.528+0000 7f2d98bf7700 1 -- 172.21.15.156:0/2278244185 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d840094a0 con 0x7f2d941343d0 2023-09-30T22:24:55.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.529+0000 7f2d93fff700 1 --2- 172.21.15.156:0/2278244185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d9409ad40 0x7f2d9411c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:55.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.529+0000 7fead2ffd700 1 -- 172.21.15.156:0/1629793465 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fead403f6a0 con 0x7feae409a130 2023-09-30T22:24:55.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.529+0000 7f2d98bf7700 1 --2- 172.21.15.156:0/2278244185 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d941343d0 0x7f2d9411d340 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c00efc0 tx=0x7f2d8c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:55.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.529+0000 7f2d90ff9700 1 -- 172.21.15.156:0/2278244185 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c009ea0 con 0x7f2d941343d0 2023-09-30T22:24:55.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.529+0000 7f2d90ff9700 1 -- 172.21.15.156:0/2278244185 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c00f040 con 0x7f2d941343d0 2023-09-30T22:24:55.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.529+0000 7f2d90ff9700 1 -- 172.21.15.156:0/2278244185 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c014480 con 0x7f2d941343d0 2023-09-30T22:24:55.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.529+0000 7f2d9a65a700 1 -- 172.21.15.156:0/2278244185 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d940a5ee0 con 0x7f2d941343d0 2023-09-30T22:24:55.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.529+0000 7f2d9a65a700 1 -- 172.21.15.156:0/2278244185 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d94071420 con 0x7f2d941343d0 2023-09-30T22:24:55.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.530+0000 7f2d90ff9700 1 -- 172.21.15.156:0/2278244185 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d8c0145e0 con 0x7f2d941343d0 2023-09-30T22:24:55.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.530+0000 7f2d90ff9700 1 -- 172.21.15.156:0/2278244185 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2d8c0400d0 con 0x7f2d941343d0 2023-09-30T22:24:55.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.530+0000 7f2d9a65a700 1 -- 172.21.15.156:0/2278244185 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d9404f2a0 con 0x7f2d941343d0 2023-09-30T22:24:55.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.535+0000 7fead2ffd700 1 -- 172.21.15.156:0/1629793465 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fead401be10 con 0x7feae409a130 2023-09-30T22:24:55.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.535+0000 7f2d90ff9700 1 -- 172.21.15.156:0/2278244185 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d8c018070 con 0x7f2d941343d0 2023-09-30T22:24:55.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.693+0000 7f3e52cdc700 1 -- 172.21.15.156:0/677018128 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3e4c06c3b0 con 0x7f3e4c09e070 2023-09-30T22:24:55.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.694+0000 7f3e497fa700 1 -- 172.21.15.156:0/677018128 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3e38017030 con 0x7f3e4c09e070 2023-09-30T22:24:55.694 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:55.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.696+0000 7f3e52cdc700 1 -- 172.21.15.156:0/677018128 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e4c09e070 msgr2=0x7f3e4c06f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.696+0000 7f3e52cdc700 1 --2- 172.21.15.156:0/677018128 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e4c09e070 0x7f3e4c06f7f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f3e3800c500 tx=0x7f3e3800c8c0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.696+0000 7f3e52cdc700 1 -- 172.21.15.156:0/677018128 shutdown_connections 2023-09-30T22:24:55.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.696+0000 7f3e52cdc700 1 --2- 172.21.15.156:0/677018128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e4c134f00 0x7f3e4c06fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.696+0000 7f3e52cdc700 1 --2- 172.21.15.156:0/677018128 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e4c06a770 0x7f3e4c133da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.696+0000 7f3e52cdc700 1 --2- 172.21.15.156:0/677018128 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3e4c09e070 0x7f3e4c06f7f0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.696+0000 7f3e52cdc700 1 -- 172.21.15.156:0/677018128 >> 172.21.15.156:0/677018128 conn(0x7f3e4c099c40 msgr2=0x7f3e4c09c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:55.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.696+0000 7f3e52cdc700 1 -- 172.21.15.156:0/677018128 shutdown_connections 2023-09-30T22:24:55.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.696+0000 7f3e52cdc700 1 -- 172.21.15.156:0/677018128 wait complete. 2023-09-30T22:24:55.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.698+0000 7f83ca3d5700 1 -- 172.21.15.156:0/2389241286 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f83c404f2a0 con 0x7f83c409e870 2023-09-30T22:24:55.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.698+0000 7f83c0ff9700 1 -- 172.21.15.156:0/2389241286 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f83b4021020 con 0x7f83c409e870 2023-09-30T22:24:55.699 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:55.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.701+0000 7f83ca3d5700 1 -- 172.21.15.156:0/2389241286 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83c409e870 msgr2=0x7f83c406b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.701+0000 7f83ca3d5700 1 --2- 172.21.15.156:0/2389241286 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83c409e870 0x7f83c406b8b0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f83b400e930 tx=0x7f83b400ec40 comp rx=0 tx=0).stop 2023-09-30T22:24:55.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.701+0000 7f83ca3d5700 1 -- 172.21.15.156:0/2389241286 shutdown_connections 2023-09-30T22:24:55.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.701+0000 7f83ca3d5700 1 --2- 172.21.15.156:0/2389241286 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f83c4131d70 0x7f83c406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.701+0000 7f83ca3d5700 1 --2- 172.21.15.156:0/2389241286 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83c409e870 0x7f83c406b8b0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.701+0000 7f83ca3d5700 1 --2- 172.21.15.156:0/2389241286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83c409f180 0x7f83c406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.701+0000 7f83ca3d5700 1 -- 172.21.15.156:0/2389241286 >> 172.21.15.156:0/2389241286 conn(0x7f83c40a4430 msgr2=0x7f83c4131110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:55.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.701+0000 7f83ca3d5700 1 -- 172.21.15.156:0/2389241286 shutdown_connections 2023-09-30T22:24:55.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.701+0000 7f83ca3d5700 1 -- 172.21.15.156:0/2389241286 wait complete. 2023-09-30T22:24:55.711 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:55.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:55.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.728+0000 7feae8a4b700 1 -- 172.21.15.156:0/1629793465 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7feac8005590 con 0x7feae409a130 2023-09-30T22:24:55.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.728+0000 7fead2ffd700 1 -- 172.21.15.156:0/1629793465 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fead401b3b0 con 0x7feae409a130 2023-09-30T22:24:55.729 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:55.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.730+0000 7feae8a4b700 1 -- 172.21.15.156:0/1629793465 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feae409a130 msgr2=0x7feae411c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.730+0000 7feae8a4b700 1 --2- 172.21.15.156:0/1629793465 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feae409a130 0x7feae411c260 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fead400e8d0 tx=0x7fead400ebe0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.730+0000 7feae8a4b700 1 -- 172.21.15.156:0/1629793465 shutdown_connections 2023-09-30T22:24:55.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.730+0000 7feae8a4b700 1 --2- 172.21.15.156:0/1629793465 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feae413c410 0x7feae411cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.730+0000 7feae8a4b700 1 --2- 172.21.15.156:0/1629793465 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feae409a130 0x7feae411c260 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.730+0000 7feae8a4b700 1 --2- 172.21.15.156:0/1629793465 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7feae409edb0 0x7feae411c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.730+0000 7feae8a4b700 1 -- 172.21.15.156:0/1629793465 >> 172.21.15.156:0/1629793465 conn(0x7feae40a4430 msgr2=0x7feae40a1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:55.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.730+0000 7feae8a4b700 1 -- 172.21.15.156:0/1629793465 shutdown_connections 2023-09-30T22:24:55.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.730+0000 7feae8a4b700 1 -- 172.21.15.156:0/1629793465 wait complete. 2023-09-30T22:24:55.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.732+0000 7f2d9a65a700 1 -- 172.21.15.156:0/2278244185 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2d9411f8d0 con 0x7f2d941343d0 2023-09-30T22:24:55.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.733+0000 7f2d90ff9700 1 -- 172.21.15.156:0/2278244185 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d8c0246c0 con 0x7f2d941343d0 2023-09-30T22:24:55.733 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:55.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.735+0000 7f2d9a65a700 1 -- 172.21.15.156:0/2278244185 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d941343d0 msgr2=0x7f2d9411d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.735+0000 7f2d9a65a700 1 --2- 172.21.15.156:0/2278244185 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d941343d0 0x7f2d9411d340 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c00efc0 tx=0x7f2d8c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.735+0000 7f2d9a65a700 1 -- 172.21.15.156:0/2278244185 shutdown_connections 2023-09-30T22:24:55.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.735+0000 7f2d9a65a700 1 --2- 172.21.15.156:0/2278244185 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2d941343d0 0x7f2d9411d340 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.735+0000 7f2d9a65a700 1 --2- 172.21.15.156:0/2278244185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d9409ad40 0x7f2d9411c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.735+0000 7f2d9a65a700 1 --2- 172.21.15.156:0/2278244185 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2d94133f70 0x7f2d9411ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.735+0000 7f2d9a65a700 1 -- 172.21.15.156:0/2278244185 >> 172.21.15.156:0/2278244185 conn(0x7f2d94099c40 msgr2=0x7f2d94132e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:55.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.735+0000 7f2d9a65a700 1 -- 172.21.15.156:0/2278244185 shutdown_connections 2023-09-30T22:24:55.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:55.735+0000 7f2d9a65a700 1 -- 172.21.15.156:0/2278244185 wait complete. 2023-09-30T22:24:55.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:55.749 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:56.712 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:56.715 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:56.746 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:56.749 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:56.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.855+0000 7f8e629b0700 1 Processor -- start 2023-09-30T22:24:56.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.855+0000 7f8e629b0700 1 -- start start 2023-09-30T22:24:56.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.856+0000 7f8e629b0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8e5c06a770 0x7f8e5c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.856+0000 7f8e629b0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8e5c09dec0 0x7f8e5c06b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.856+0000 7f8e629b0700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e5c06b5c0 con 0x7f8e5c131a00 2023-09-30T22:24:56.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.856+0000 7f8e629b0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c06e900 con 0x7f8e5c06a770 2023-09-30T22:24:56.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.856+0000 7f8e629b0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c09d180 con 0x7f8e5c09dec0 2023-09-30T22:24:56.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.856+0000 7f8e5b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8e5c09dec0 0x7f8e5c06b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.856+0000 7f8e5b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8e5c09dec0 0x7f8e5c06b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36908/0 (socket says 172.21.15.156:36908) 2023-09-30T22:24:56.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.856+0000 7f8e5b7fe700 1 -- 172.21.15.156:0/2837142774 learned_addr learned my addr 172.21.15.156:0/2837142774 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:56.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.856+0000 7f8e60f4d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f8e5c131a00 0x7f8e5c131e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:44720/0 (socket says 172.21.15.156:44720) 2023-09-30T22:24:56.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.856+0000 7f8e5b7fe700 1 -- 172.21.15.156:0/2837142774 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8e5c06a770 msgr2=0x7f8e5c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:56.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.856+0000 7f8e5b7fe700 1 --2- 172.21.15.156:0/2837142774 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8e5c06a770 0x7f8e5c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.856+0000 7f8e5b7fe700 1 -- 172.21.15.156:0/2837142774 >> v1:172.21.15.156:6789/0 conn(0x7f8e5c131a00 legacy=0x7f8e5c131e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.856+0000 7f8e5affd700 1 -- 172.21.15.156:0/2837142774 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 264940584 0 0) 0x7f8e5c06b5c0 con 0x7f8e5c131a00 2023-09-30T22:24:56.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.856+0000 7f8e5b7fe700 1 -- 172.21.15.156:0/2837142774 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5c09e780 con 0x7f8e5c09dec0 2023-09-30T22:24:56.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.856+0000 7f8e5b7fe700 1 --2- 172.21.15.156:0/2837142774 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8e5c09dec0 0x7f8e5c06b080 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f8e50009920 tx=0x7f8e50009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2af4d780350d7a5c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:56.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.857+0000 7f8e5affd700 1 -- 172.21.15.156:0/2837142774 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5000ba60 con 0x7f8e5c09dec0 2023-09-30T22:24:56.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.857+0000 7f8e5affd700 1 -- 172.21.15.156:0/2837142774 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e5000bbc0 con 0x7f8e5c09dec0 2023-09-30T22:24:56.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.857+0000 7f8e5affd700 1 -- 172.21.15.156:0/2837142774 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e50009e70 con 0x7f8e5c09dec0 2023-09-30T22:24:56.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.857+0000 7f8e629b0700 1 -- 172.21.15.156:0/2837142774 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8e5c09dec0 msgr2=0x7f8e5c06b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.857+0000 7f8e629b0700 1 --2- 172.21.15.156:0/2837142774 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8e5c09dec0 0x7f8e5c06b080 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f8e50009920 tx=0x7f8e50009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:56.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.857+0000 7f8e629b0700 1 -- 172.21.15.156:0/2837142774 shutdown_connections 2023-09-30T22:24:56.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.857+0000 7f8e629b0700 1 --2- 172.21.15.156:0/2837142774 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8e5c06a770 0x7f8e5c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.857+0000 7f8e629b0700 1 --2- 172.21.15.156:0/2837142774 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8e5c09dec0 0x7f8e5c06b080 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.857+0000 7f8e629b0700 1 -- 172.21.15.156:0/2837142774 >> 172.21.15.156:0/2837142774 conn(0x7f8e5c099c40 msgr2=0x7f8e5c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:56.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.857+0000 7f8e629b0700 1 -- 172.21.15.156:0/2837142774 shutdown_connections 2023-09-30T22:24:56.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.857+0000 7f8e629b0700 1 -- 172.21.15.156:0/2837142774 wait complete. 2023-09-30T22:24:56.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.859+0000 7f8e629b0700 1 Processor -- start 2023-09-30T22:24:56.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.859+0000 7f8e629b0700 1 -- start start 2023-09-30T22:24:56.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.860+0000 7f8e629b0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8e5c06a770 0x7f8e5c09a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.860+0000 7f8e629b0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8e5c09dec0 0x7f8e5c09a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.860+0000 7f8e629b0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e5c131a00 0x7f8e5c09af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.860+0000 7f8e629b0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c09b960 con 0x7f8e5c131a00 2023-09-30T22:24:56.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.860+0000 7f8e629b0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c11eb70 con 0x7f8e5c06a770 2023-09-30T22:24:56.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.860+0000 7f8e629b0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c12d460 con 0x7f8e5c09dec0 2023-09-30T22:24:56.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.860+0000 7f8e5bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8e5c06a770 0x7f8e5c09a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.860+0000 7f8e5bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8e5c06a770 0x7f8e5c09a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44518/0 (socket says 172.21.15.156:44518) 2023-09-30T22:24:56.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.860+0000 7f8e5bfff700 1 -- 172.21.15.156:0/3328431716 learned_addr learned my addr 172.21.15.156:0/3328431716 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:56.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.860+0000 7f8e5b7fe700 1 --2- 172.21.15.156:0/3328431716 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8e5c09dec0 0x7f8e5c09a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.860+0000 7f8e60f4d700 1 --2- 172.21.15.156:0/3328431716 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e5c131a00 0x7f8e5c09af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.860+0000 7f8e5bfff700 1 -- 172.21.15.156:0/3328431716 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8e5c09dec0 msgr2=0x7f8e5c09a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.860+0000 7f8e5bfff700 1 --2- 172.21.15.156:0/3328431716 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8e5c09dec0 0x7f8e5c09a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.860+0000 7f8e5bfff700 1 -- 172.21.15.156:0/3328431716 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e5c131a00 msgr2=0x7f8e5c09af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.860+0000 7f8e5bfff700 1 --2- 172.21.15.156:0/3328431716 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e5c131a00 0x7f8e5c09af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.860+0000 7f8e5bfff700 1 -- 172.21.15.156:0/3328431716 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e50009550 con 0x7f8e5c06a770 2023-09-30T22:24:56.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.860+0000 7f8e5bfff700 1 --2- 172.21.15.156:0/3328431716 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8e5c06a770 0x7f8e5c09a490 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00b560 tx=0x7f8e4c00b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:56.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.861+0000 7f8e58ff9700 1 -- 172.21.15.156:0/3328431716 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c011830 con 0x7f8e5c06a770 2023-09-30T22:24:56.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.861+0000 7f8e58ff9700 1 -- 172.21.15.156:0/3328431716 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4c011990 con 0x7f8e5c06a770 2023-09-30T22:24:56.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.861+0000 7f8e629b0700 1 -- 172.21.15.156:0/3328431716 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e5c11f610 con 0x7f8e5c06a770 2023-09-30T22:24:56.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.861+0000 7f8e58ff9700 1 -- 172.21.15.156:0/3328431716 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c011d40 con 0x7f8e5c06a770 2023-09-30T22:24:56.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.861+0000 7f8e629b0700 1 -- 172.21.15.156:0/3328431716 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5c071ce0 con 0x7f8e5c06a770 2023-09-30T22:24:56.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.861+0000 7f8e58ff9700 1 -- 172.21.15.156:0/3328431716 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e4c01a400 con 0x7f8e5c06a770 2023-09-30T22:24:56.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.862+0000 7f8e58ff9700 1 -- 172.21.15.156:0/3328431716 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8e4c03f5c0 con 0x7f8e5c06a770 2023-09-30T22:24:56.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.862+0000 7f8e629b0700 1 -- 172.21.15.156:0/3328431716 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e5c04f2a0 con 0x7f8e5c06a770 2023-09-30T22:24:56.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.867+0000 7f8e58ff9700 1 -- 172.21.15.156:0/3328431716 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e4c015020 con 0x7f8e5c06a770 2023-09-30T22:24:56.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.901+0000 7fc9f4cb9700 1 Processor -- start 2023-09-30T22:24:56.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.901+0000 7fc9f4cb9700 1 -- start start 2023-09-30T22:24:56.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.902+0000 7fc9f4cb9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9f0138410 0x7fc9f00a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.902+0000 7fc9f4cb9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc9f013dd10 0x7fc9f01400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.902+0000 7fc9f4cb9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f01379e0 con 0x7fc9f0138040 2023-09-30T22:24:56.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.902+0000 7fc9f4cb9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9f00a2100 con 0x7fc9f013dd10 2023-09-30T22:24:56.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.902+0000 7fc9f4cb9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f009b9b0 con 0x7fc9f0138410 2023-09-30T22:24:56.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.903+0000 7fc9ee59c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc9f0138040 0x7fc9f00a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:44722/0 (socket says 172.21.15.156:44722) 2023-09-30T22:24:56.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.903+0000 7fc9ee59c700 1 -- 172.21.15.156:0/2862181628 learned_addr learned my addr 172.21.15.156:0/2862181628 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:56.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.903+0000 7fc9edd9b700 1 --2- 172.21.15.156:0/2862181628 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9f0138410 0x7fc9f00a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.903+0000 7fc9eed9d700 1 --2- 172.21.15.156:0/2862181628 >> v2:172.21.15.156:3300/0 conn(0x7fc9f013dd10 0x7fc9f01400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.903+0000 7fc9ed59a700 1 -- 172.21.15.156:0/2862181628 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84344371 0 0) 0x7fc9f01379e0 con 0x7fc9f0138040 2023-09-30T22:24:56.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.903+0000 7fc9ed59a700 1 -- 172.21.15.156:0/2862181628 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9d80035b0 con 0x7fc9f0138040 2023-09-30T22:24:56.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.903+0000 7fc9eed9d700 1 -- 172.21.15.156:0/2862181628 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9f0138410 msgr2=0x7fc9f00a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:56.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.903+0000 7fc9eed9d700 1 --2- 172.21.15.156:0/2862181628 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9f0138410 0x7fc9f00a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.903+0000 7fc9eed9d700 1 -- 172.21.15.156:0/2862181628 >> v1:172.21.15.156:6789/0 conn(0x7fc9f0138040 legacy=0x7fc9f00a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.903+0000 7fc9eed9d700 1 -- 172.21.15.156:0/2862181628 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f0137c10 con 0x7fc9f013dd10 2023-09-30T22:24:56.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.903+0000 7fc9edd9b700 1 --2- 172.21.15.156:0/2862181628 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9f0138410 0x7fc9f00a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:56.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.903+0000 7fc9eed9d700 1 --2- 172.21.15.156:0/2862181628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9f013dd10 0x7fc9f01400f0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8009d90 tx=0x7fc9e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da38c44020e1a2e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:56.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.903+0000 7fc9ed59a700 1 -- 172.21.15.156:0/2862181628 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e800e070 con 0x7fc9f013dd10 2023-09-30T22:24:56.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.904+0000 7fc9ed59a700 1 -- 172.21.15.156:0/2862181628 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e800bb20 con 0x7fc9f013dd10 2023-09-30T22:24:56.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.904+0000 7fc9ed59a700 1 -- 172.21.15.156:0/2862181628 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8012430 con 0x7fc9f013dd10 2023-09-30T22:24:56.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.904+0000 7fc9f4cb9700 1 -- 172.21.15.156:0/2862181628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9f013dd10 msgr2=0x7fc9f01400f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.904+0000 7fc9f4cb9700 1 --2- 172.21.15.156:0/2862181628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9f013dd10 0x7fc9f01400f0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8009d90 tx=0x7fc9e800b330 comp rx=0 tx=0).stop 2023-09-30T22:24:56.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.905+0000 7fc9f4cb9700 1 -- 172.21.15.156:0/2862181628 shutdown_connections 2023-09-30T22:24:56.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.905+0000 7fc9f4cb9700 1 --2- 172.21.15.156:0/2862181628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9f013dd10 0x7fc9f01400f0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.905+0000 7fc9f4cb9700 1 --2- 172.21.15.156:0/2862181628 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9f0138410 0x7fc9f00a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.905+0000 7fc9f4cb9700 1 -- 172.21.15.156:0/2862181628 >> 172.21.15.156:0/2862181628 conn(0x7fc9f00a2980 msgr2=0x7fc9f00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:56.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.905+0000 7fc9f4cb9700 1 -- 172.21.15.156:0/2862181628 shutdown_connections 2023-09-30T22:24:56.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.905+0000 7fc9f4cb9700 1 -- 172.21.15.156:0/2862181628 wait complete. 2023-09-30T22:24:56.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.906+0000 7fc9f4cb9700 1 Processor -- start 2023-09-30T22:24:56.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.906+0000 7fc9f4cb9700 1 -- start start 2023-09-30T22:24:56.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.907+0000 7fc9f4cb9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9f0138040 0x7fc9f0121600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.907+0000 7fc9f4cb9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9f0138410 0x7fc9f0121b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.907+0000 7fc9f4cb9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9f013dd10 0x7fc9f0122080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.907+0000 7fc9f4cb9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f0124c10 con 0x7fc9f0138040 2023-09-30T22:24:56.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.907+0000 7fc9f4cb9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f01257b0 con 0x7fc9f013dd10 2023-09-30T22:24:56.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.907+0000 7fc9f4cb9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f0124df0 con 0x7fc9f0138410 2023-09-30T22:24:56.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.907+0000 7fc9eed9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9f013dd10 0x7fc9f0122080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.907+0000 7fc9ee59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9f0138040 0x7fc9f0121600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.907+0000 7fc9eed9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9f013dd10 0x7fc9f0122080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44530/0 (socket says 172.21.15.156:44530) 2023-09-30T22:24:56.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.907+0000 7fc9ee59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9f0138040 0x7fc9f0121600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47420/0 (socket says 172.21.15.156:47420) 2023-09-30T22:24:56.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.907+0000 7fc9eed9d700 1 -- 172.21.15.156:0/345320019 learned_addr learned my addr 172.21.15.156:0/345320019 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:56.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.907+0000 7fc9edd9b700 1 --2- 172.21.15.156:0/345320019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9f0138410 0x7fc9f0121b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.908+0000 7fc9eed9d700 1 -- 172.21.15.156:0/345320019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9f0138410 msgr2=0x7fc9f0121b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.908+0000 7fc9eed9d700 1 --2- 172.21.15.156:0/345320019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9f0138410 0x7fc9f0121b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.908+0000 7fc9eed9d700 1 -- 172.21.15.156:0/345320019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9f0138040 msgr2=0x7fc9f0121600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.908+0000 7fc9eed9d700 1 --2- 172.21.15.156:0/345320019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9f0138040 0x7fc9f0121600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.908+0000 7fc9eed9d700 1 -- 172.21.15.156:0/345320019 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e40094a0 con 0x7fc9f013dd10 2023-09-30T22:24:56.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.908+0000 7fc9edd9b700 1 --2- 172.21.15.156:0/345320019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9f0138410 0x7fc9f0121b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:56.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.908+0000 7fc9eed9d700 1 --2- 172.21.15.156:0/345320019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9f013dd10 0x7fc9f0122080 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8013000 tx=0x7fc9e8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:56.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.913+0000 7fc9deffd700 1 -- 172.21.15.156:0/345320019 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8012430 con 0x7fc9f013dd10 2023-09-30T22:24:56.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.913+0000 7fc9deffd700 1 -- 172.21.15.156:0/345320019 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e8020070 con 0x7fc9f013dd10 2023-09-30T22:24:56.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.913+0000 7fc9deffd700 1 -- 172.21.15.156:0/345320019 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8004280 con 0x7fc9f013dd10 2023-09-30T22:24:56.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.913+0000 7fc9f4cb9700 1 -- 172.21.15.156:0/345320019 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9e8009a70 con 0x7fc9f013dd10 2023-09-30T22:24:56.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.913+0000 7fc9f4cb9700 1 -- 172.21.15.156:0/345320019 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f009a240 con 0x7fc9f013dd10 2023-09-30T22:24:56.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.914+0000 7fc9f4cb9700 1 -- 172.21.15.156:0/345320019 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9f0123cd0 con 0x7fc9f013dd10 2023-09-30T22:24:56.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.914+0000 7fc9deffd700 1 -- 172.21.15.156:0/345320019 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc9e80043e0 con 0x7fc9f013dd10 2023-09-30T22:24:56.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.914+0000 7fc9deffd700 1 -- 172.21.15.156:0/345320019 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc9e8022070 con 0x7fc9f013dd10 2023-09-30T22:24:56.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.921+0000 7fc9deffd700 1 -- 172.21.15.156:0/345320019 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc9e8003e10 con 0x7fc9f013dd10 2023-09-30T22:24:56.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.932+0000 7f198b56b700 1 Processor -- start 2023-09-30T22:24:56.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.932+0000 7f198b56b700 1 -- start start 2023-09-30T22:24:56.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.933+0000 7f198b56b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f198409a150 0x7f198409e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.933+0000 7f198b56b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f198409edb0 0x7f198409f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.933+0000 7f198b56b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1984133c20 0x7f19841340c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.933+0000 7f198b56b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f198409a520 con 0x7f1984133c20 2023-09-30T22:24:56.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.933+0000 7f198b56b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f198409fe00 con 0x7f198409a150 2023-09-30T22:24:56.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.933+0000 7f198b56b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f198406bec0 con 0x7f198409edb0 2023-09-30T22:24:56.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.933+0000 7f1988b06700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f198409edb0 0x7f198409f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.933+0000 7f1988b06700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f198409edb0 0x7f198409f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36928/0 (socket says 172.21.15.156:36928) 2023-09-30T22:24:56.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.933+0000 7f1988b06700 1 -- 172.21.15.156:0/1591496669 learned_addr learned my addr 172.21.15.156:0/1591496669 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:56.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.933+0000 7f1989307700 1 --2- 172.21.15.156:0/1591496669 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f198409a150 0x7f198409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.934+0000 7f1989b08700 1 --2- 172.21.15.156:0/1591496669 >> v2:172.21.15.156:3300/0 conn(0x7f1984133c20 0x7f19841340c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.934+0000 7f1988b06700 1 -- 172.21.15.156:0/1591496669 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f198409a150 msgr2=0x7f198409e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:56.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.934+0000 7f1988b06700 1 --2- 172.21.15.156:0/1591496669 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f198409a150 0x7f198409e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.934+0000 7f1988b06700 1 -- 172.21.15.156:0/1591496669 >> v2:172.21.15.156:3300/0 conn(0x7f1984133c20 msgr2=0x7f19841340c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:56.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.934+0000 7f1988b06700 1 --2- 172.21.15.156:0/1591496669 >> v2:172.21.15.156:3300/0 conn(0x7f1984133c20 0x7f19841340c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.934+0000 7f1988b06700 1 -- 172.21.15.156:0/1591496669 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198409af80 con 0x7f198409edb0 2023-09-30T22:24:56.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.934+0000 7f1988b06700 1 --2- 172.21.15.156:0/1591496669 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f198409edb0 0x7f198409f1a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f1974009920 tx=0x7f1974009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcef9982b8d337dc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:56.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.934+0000 7f4a0d4af700 1 Processor -- start 2023-09-30T22:24:56.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.934+0000 7f4a0d4af700 1 -- start start 2023-09-30T22:24:56.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.934+0000 7f4a0d4af700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4a0812c930 0x7f4a0812cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.934+0000 7f4a0d4af700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4a0812f660 0x7f4a0812fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.934+0000 7f4a0d4af700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a0812fff0 0x7f4a08136990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.934+0000 7f4a0d4af700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a0809c150 con 0x7f4a0812f660 2023-09-30T22:24:56.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.934+0000 7f4a0d4af700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0809e370 con 0x7f4a0812c930 2023-09-30T22:24:56.936 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.934+0000 7f4a0d4af700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0809e010 con 0x7f4a0812fff0 2023-09-30T22:24:56.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.935+0000 7f4a077fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a0812fff0 0x7f4a08136990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.934+0000 7f197bfff700 1 -- 172.21.15.156:0/1591496669 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1974011830 con 0x7f198409edb0 2023-09-30T22:24:56.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.935+0000 7f197bfff700 1 -- 172.21.15.156:0/1591496669 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1974011990 con 0x7f198409edb0 2023-09-30T22:24:56.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.935+0000 7f197bfff700 1 -- 172.21.15.156:0/1591496669 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1974011d20 con 0x7f198409edb0 2023-09-30T22:24:56.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.935+0000 7f198b56b700 1 -- 172.21.15.156:0/1591496669 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f198409edb0 msgr2=0x7f198409f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.935+0000 7f198b56b700 1 --2- 172.21.15.156:0/1591496669 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f198409edb0 0x7f198409f1a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f1974009920 tx=0x7f1974009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:56.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.935+0000 7f4a077fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a0812fff0 0x7f4a08136990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36938/0 (socket says 172.21.15.156:36938) 2023-09-30T22:24:56.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.935+0000 7f4a077fe700 1 -- 172.21.15.156:0/471458900 learned_addr learned my addr 172.21.15.156:0/471458900 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:56.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.935+0000 7f4a077fe700 1 -- 172.21.15.156:0/471458900 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4a0812c930 msgr2=0x7f4a0812cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:56.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.935+0000 7f4a077fe700 1 --2- 172.21.15.156:0/471458900 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4a0812c930 0x7f4a0812cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.935+0000 7f4a077fe700 1 -- 172.21.15.156:0/471458900 >> v2:172.21.15.156:3300/0 conn(0x7f4a0812f660 msgr2=0x7f4a0812fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:56.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.935+0000 7f4a077fe700 1 --2- 172.21.15.156:0/471458900 >> v2:172.21.15.156:3300/0 conn(0x7f4a0812f660 0x7f4a0812fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.935+0000 7f4a077fe700 1 -- 172.21.15.156:0/471458900 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a08130490 con 0x7f4a0812fff0 2023-09-30T22:24:56.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.935+0000 7f4a077fe700 1 --2- 172.21.15.156:0/471458900 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a0812fff0 0x7f4a08136990 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f4a00009e80 tx=0x7f4a0000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7beab98d6eced2c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:56.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.935+0000 7f198b56b700 1 -- 172.21.15.156:0/1591496669 shutdown_connections 2023-09-30T22:24:56.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.935+0000 7f198b56b700 1 --2- 172.21.15.156:0/1591496669 >> v2:172.21.15.156:3300/0 conn(0x7f1984133c20 0x7f19841340c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.935+0000 7f198b56b700 1 --2- 172.21.15.156:0/1591496669 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f198409a150 0x7f198409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.935+0000 7f198b56b700 1 --2- 172.21.15.156:0/1591496669 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f198409edb0 0x7f198409f1a0 secure :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f1974009920 tx=0x7f1974009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:56.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.935+0000 7f198b56b700 1 -- 172.21.15.156:0/1591496669 >> 172.21.15.156:0/1591496669 conn(0x7f19840a4430 msgr2=0x7f19840a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:56.939 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.935+0000 7f4a05ffb700 1 -- 172.21.15.156:0/471458900 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0000e070 con 0x7f4a0812fff0 2023-09-30T22:24:56.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.935+0000 7f4a05ffb700 1 -- 172.21.15.156:0/471458900 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0000b980 con 0x7f4a0812fff0 2023-09-30T22:24:56.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.935+0000 7f4a05ffb700 1 -- 172.21.15.156:0/471458900 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0000bd30 con 0x7f4a0812fff0 2023-09-30T22:24:56.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.936+0000 7f198b56b700 1 -- 172.21.15.156:0/1591496669 shutdown_connections 2023-09-30T22:24:56.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.936+0000 7f4a0d4af700 1 -- 172.21.15.156:0/471458900 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a0812fff0 msgr2=0x7f4a08136990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.936+0000 7f4a0d4af700 1 --2- 172.21.15.156:0/471458900 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a0812fff0 0x7f4a08136990 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f4a00009e80 tx=0x7f4a0000b330 comp rx=0 tx=0).stop 2023-09-30T22:24:56.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.936+0000 7f4a0d4af700 1 -- 172.21.15.156:0/471458900 shutdown_connections 2023-09-30T22:24:56.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.936+0000 7f4a0d4af700 1 --2- 172.21.15.156:0/471458900 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a0812fff0 0x7f4a08136990 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.936+0000 7f4a0d4af700 1 --2- 172.21.15.156:0/471458900 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4a0812c930 0x7f4a0812cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.936+0000 7f4a0d4af700 1 --2- 172.21.15.156:0/471458900 >> v2:172.21.15.156:3300/0 conn(0x7f4a0812f660 0x7f4a0812fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.936+0000 7f4a0d4af700 1 -- 172.21.15.156:0/471458900 >> 172.21.15.156:0/471458900 conn(0x7f4a080a2b30 msgr2=0x7f4a0809e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:56.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.936+0000 7f4a0d4af700 1 -- 172.21.15.156:0/471458900 shutdown_connections 2023-09-30T22:24:56.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.936+0000 7f4a0d4af700 1 -- 172.21.15.156:0/471458900 wait complete. 2023-09-30T22:24:56.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.936+0000 7f198b56b700 1 -- 172.21.15.156:0/1591496669 wait complete. 2023-09-30T22:24:56.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.937+0000 7f198b56b700 1 Processor -- start 2023-09-30T22:24:56.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.937+0000 7f198b56b700 1 -- start start 2023-09-30T22:24:56.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.937+0000 7f198b56b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f198409a150 0x7f1984130260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.937+0000 7f198b56b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1984133c20 0x7f19841307a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.937+0000 7f198b56b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f19841d5210 0x7f19841d5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.937+0000 7f198b56b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19841330f0 con 0x7f198409a150 2023-09-30T22:24:56.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.937+0000 7f198b56b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19840a04d0 con 0x7f1984133c20 2023-09-30T22:24:56.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.937+0000 7f198b56b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19841332d0 con 0x7f19841d5210 2023-09-30T22:24:56.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.937+0000 7f4a0d4af700 1 Processor -- start 2023-09-30T22:24:56.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.937+0000 7f4a0d4af700 1 -- start start 2023-09-30T22:24:56.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.937+0000 7f1989b08700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f19841d5210 0x7f19841d5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.937+0000 7f1989b08700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f19841d5210 0x7f19841d5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:36948/0 (socket says 172.21.15.156:36948) 2023-09-30T22:24:56.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.937+0000 7f1989b08700 1 -- 172.21.15.156:0/1805725609 learned_addr learned my addr 172.21.15.156:0/1805725609 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:56.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.937+0000 7f1988b06700 1 --2- 172.21.15.156:0/1805725609 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1984133c20 0x7f19841307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.938+0000 7f4a0d4af700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4a0812c930 0x7f4a0808c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.938+0000 7f4a0d4af700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a0812f660 0x7f4a0808c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.938+0000 7f4a0d4af700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a0812fff0 0x7f4a0808cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.938+0000 7f4a0d4af700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a08098d20 con 0x7f4a0812fff0 2023-09-30T22:24:56.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.938+0000 7f4a0d4af700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0808d4a0 con 0x7f4a0812c930 2023-09-30T22:24:56.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.938+0000 7f4a0d4af700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0808f5a0 con 0x7f4a0812f660 2023-09-30T22:24:56.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.938+0000 7f4a06ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4a0812c930 0x7f4a0808c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.938+0000 7f1989b08700 1 -- 172.21.15.156:0/1805725609 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1984133c20 msgr2=0x7f19841307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.938+0000 7f1989b08700 1 --2- 172.21.15.156:0/1805725609 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1984133c20 0x7f19841307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.938+0000 7f1989b08700 1 -- 172.21.15.156:0/1805725609 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f198409a150 msgr2=0x7f1984130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.938+0000 7f1989b08700 1 --2- 172.21.15.156:0/1805725609 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f198409a150 0x7f1984130260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.938+0000 7f1989b08700 1 -- 172.21.15.156:0/1805725609 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1974009550 con 0x7f19841d5210 2023-09-30T22:24:56.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.938+0000 7f4a06ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4a0812c930 0x7f4a0808c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44558/0 (socket says 172.21.15.156:44558) 2023-09-30T22:24:56.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.938+0000 7f4a06ffd700 1 -- 172.21.15.156:0/2701941039 learned_addr learned my addr 172.21.15.156:0/2701941039 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:56.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.938+0000 7f4a067fc700 1 --2- 172.21.15.156:0/2701941039 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a0812f660 0x7f4a0808c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.938+0000 7f4a06ffd700 1 -- 172.21.15.156:0/2701941039 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a0812f660 msgr2=0x7f4a0808c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.938+0000 7f4a06ffd700 1 --2- 172.21.15.156:0/2701941039 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a0812f660 0x7f4a0808c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.938+0000 7f4a06ffd700 1 -- 172.21.15.156:0/2701941039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a0812fff0 msgr2=0x7f4a0808cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.938+0000 7f4a06ffd700 1 --2- 172.21.15.156:0/2701941039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a0812fff0 0x7f4a0808cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.938+0000 7f4a06ffd700 1 -- 172.21.15.156:0/2701941039 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a00009b30 con 0x7f4a0812c930 2023-09-30T22:24:56.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.938+0000 7f4a06ffd700 1 --2- 172.21.15.156:0/2701941039 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4a0812c930 0x7f4a0808c040 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f49f800b550 tx=0x7f49f800b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:56.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.938+0000 7f1989b08700 1 --2- 172.21.15.156:0/1805725609 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f19841d5210 0x7f19841d5680 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f197c009dd0 tx=0x7f197c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:56.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.939+0000 7f49ef7fe700 1 -- 172.21.15.156:0/2701941039 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f8005aa0 con 0x7f4a0812c930 2023-09-30T22:24:56.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.939+0000 7f49ef7fe700 1 -- 172.21.15.156:0/2701941039 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f8005c00 con 0x7f4a0812c930 2023-09-30T22:24:56.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.939+0000 7f4a0d4af700 1 -- 172.21.15.156:0/2701941039 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a0809aa50 con 0x7f4a0812c930 2023-09-30T22:24:56.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.939+0000 7f49ef7fe700 1 -- 172.21.15.156:0/2701941039 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f8011630 con 0x7f4a0812c930 2023-09-30T22:24:56.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.939+0000 7f4a0d4af700 1 -- 172.21.15.156:0/2701941039 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a0808ffe0 con 0x7f4a0812c930 2023-09-30T22:24:56.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.939+0000 7f1979ffb700 1 -- 172.21.15.156:0/1805725609 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c00cd40 con 0x7f19841d5210 2023-09-30T22:24:56.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.940+0000 7f4a0d4af700 1 -- 172.21.15.156:0/2701941039 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a0804f2a0 con 0x7f4a0812c930 2023-09-30T22:24:56.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.940+0000 7f1979ffb700 1 -- 172.21.15.156:0/1805725609 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197c00f040 con 0x7f19841d5210 2023-09-30T22:24:56.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.940+0000 7f1979ffb700 1 -- 172.21.15.156:0/1805725609 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c014680 con 0x7f19841d5210 2023-09-30T22:24:56.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.940+0000 7f198b56b700 1 -- 172.21.15.156:0/1805725609 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19841c9820 con 0x7f19841d5210 2023-09-30T22:24:56.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.940+0000 7f198b56b700 1 -- 172.21.15.156:0/1805725609 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198409b770 con 0x7f19841d5210 2023-09-30T22:24:56.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.940+0000 7f49ef7fe700 1 -- 172.21.15.156:0/2701941039 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f49f8011790 con 0x7f4a0812c930 2023-09-30T22:24:56.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.941+0000 7f49ef7fe700 1 -- 172.21.15.156:0/2701941039 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f49f803fb50 con 0x7f4a0812c930 2023-09-30T22:24:56.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.941+0000 7f198b56b700 1 -- 172.21.15.156:0/1805725609 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f198409fa30 con 0x7f19841d5210 2023-09-30T22:24:56.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.942+0000 7f1979ffb700 1 -- 172.21.15.156:0/1805725609 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f197c0147e0 con 0x7f19841d5210 2023-09-30T22:24:56.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.942+0000 7f1979ffb700 1 -- 172.21.15.156:0/1805725609 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f197c0407e0 con 0x7f19841d5210 2023-09-30T22:24:56.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.945+0000 7f49ef7fe700 1 -- 172.21.15.156:0/2701941039 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f49f80233e0 con 0x7f4a0812c930 2023-09-30T22:24:56.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:56.951+0000 7f1979ffb700 1 -- 172.21.15.156:0/1805725609 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f197c012910 con 0x7f19841d5210 2023-09-30T22:24:57.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.073+0000 7f8e629b0700 1 -- 172.21.15.156:0/3328431716 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8e5c09e3a0 con 0x7f8e5c06a770 2023-09-30T22:24:57.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.073+0000 7f8e58ff9700 1 -- 172.21.15.156:0/3328431716 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e4c029090 con 0x7f8e5c06a770 2023-09-30T22:24:57.074 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:57.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.075+0000 7f8e629b0700 1 -- 172.21.15.156:0/3328431716 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8e5c06a770 msgr2=0x7f8e5c09a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:57.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.075+0000 7f8e629b0700 1 --2- 172.21.15.156:0/3328431716 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8e5c06a770 0x7f8e5c09a490 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00b560 tx=0x7f8e4c00b870 comp rx=0 tx=0).stop 2023-09-30T22:24:57.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.076+0000 7f8e629b0700 1 -- 172.21.15.156:0/3328431716 shutdown_connections 2023-09-30T22:24:57.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.076+0000 7f8e629b0700 1 --2- 172.21.15.156:0/3328431716 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e5c131a00 0x7f8e5c09af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.076+0000 7f8e629b0700 1 --2- 172.21.15.156:0/3328431716 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8e5c06a770 0x7f8e5c09a490 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.076+0000 7f8e629b0700 1 --2- 172.21.15.156:0/3328431716 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8e5c09dec0 0x7f8e5c09a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.076+0000 7f8e629b0700 1 -- 172.21.15.156:0/3328431716 >> 172.21.15.156:0/3328431716 conn(0x7f8e5c099c40 msgr2=0x7f8e5c12ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:57.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.076+0000 7f8e629b0700 1 -- 172.21.15.156:0/3328431716 shutdown_connections 2023-09-30T22:24:57.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.076+0000 7f8e629b0700 1 -- 172.21.15.156:0/3328431716 wait complete. 2023-09-30T22:24:57.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:57.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.138+0000 7fc9f4cb9700 1 -- 172.21.15.156:0/345320019 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc9f004f2a0 con 0x7fc9f013dd10 2023-09-30T22:24:57.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.139+0000 7fc9deffd700 1 -- 172.21.15.156:0/345320019 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc9e801a380 con 0x7fc9f013dd10 2023-09-30T22:24:57.139 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:57.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.140+0000 7f4a0d4af700 1 -- 172.21.15.156:0/2701941039 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4a0809b110 con 0x7f4a0812c930 2023-09-30T22:24:57.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.140+0000 7f49ef7fe700 1 -- 172.21.15.156:0/2701941039 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f49f80193b0 con 0x7f4a0812c930 2023-09-30T22:24:57.141 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:57.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.141+0000 7fc9f4cb9700 1 -- 172.21.15.156:0/345320019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9f013dd10 msgr2=0x7fc9f0122080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:57.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.141+0000 7fc9f4cb9700 1 --2- 172.21.15.156:0/345320019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9f013dd10 0x7fc9f0122080 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8013000 tx=0x7fc9e8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.141+0000 7fc9f4cb9700 1 -- 172.21.15.156:0/345320019 shutdown_connections 2023-09-30T22:24:57.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.141+0000 7fc9f4cb9700 1 --2- 172.21.15.156:0/345320019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9f013dd10 0x7fc9f0122080 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.141+0000 7fc9f4cb9700 1 --2- 172.21.15.156:0/345320019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9f0138040 0x7fc9f0121600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.141+0000 7fc9f4cb9700 1 --2- 172.21.15.156:0/345320019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9f0138410 0x7fc9f0121b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.141+0000 7fc9f4cb9700 1 -- 172.21.15.156:0/345320019 >> 172.21.15.156:0/345320019 conn(0x7fc9f00a2980 msgr2=0x7fc9f009d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:57.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.141+0000 7fc9f4cb9700 1 -- 172.21.15.156:0/345320019 shutdown_connections 2023-09-30T22:24:57.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.141+0000 7fc9f4cb9700 1 -- 172.21.15.156:0/345320019 wait complete. 2023-09-30T22:24:57.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.142+0000 7f4a0d4af700 1 -- 172.21.15.156:0/2701941039 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4a0812c930 msgr2=0x7f4a0808c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:57.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.142+0000 7f4a0d4af700 1 --2- 172.21.15.156:0/2701941039 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4a0812c930 0x7f4a0808c040 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f49f800b550 tx=0x7f49f800b860 comp rx=0 tx=0).stop 2023-09-30T22:24:57.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.143+0000 7f4a0d4af700 1 -- 172.21.15.156:0/2701941039 shutdown_connections 2023-09-30T22:24:57.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.143+0000 7f4a0d4af700 1 --2- 172.21.15.156:0/2701941039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a0812fff0 0x7f4a0808cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.143+0000 7f4a0d4af700 1 --2- 172.21.15.156:0/2701941039 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4a0812c930 0x7f4a0808c040 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.143+0000 7f4a0d4af700 1 --2- 172.21.15.156:0/2701941039 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a0812f660 0x7f4a0808c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.143+0000 7f4a0d4af700 1 -- 172.21.15.156:0/2701941039 >> 172.21.15.156:0/2701941039 conn(0x7f4a080a2b30 msgr2=0x7f4a080992e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:57.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.143+0000 7f4a0d4af700 1 -- 172.21.15.156:0/2701941039 shutdown_connections 2023-09-30T22:24:57.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.143+0000 7f4a0d4af700 1 -- 172.21.15.156:0/2701941039 wait complete. 2023-09-30T22:24:57.155 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:57.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:57.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.165+0000 7f198b56b700 1 -- 172.21.15.156:0/1805725609 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1984132f50 con 0x7f19841d5210 2023-09-30T22:24:57.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.165+0000 7f1979ffb700 1 -- 172.21.15.156:0/1805725609 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1984132f50 con 0x7f19841d5210 2023-09-30T22:24:57.166 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:57.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.168+0000 7f198b56b700 1 -- 172.21.15.156:0/1805725609 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f19841d5210 msgr2=0x7f19841d5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:57.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.168+0000 7f198b56b700 1 --2- 172.21.15.156:0/1805725609 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f19841d5210 0x7f19841d5680 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f197c009dd0 tx=0x7f197c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.168+0000 7f198b56b700 1 -- 172.21.15.156:0/1805725609 shutdown_connections 2023-09-30T22:24:57.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.168+0000 7f198b56b700 1 --2- 172.21.15.156:0/1805725609 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f19841d5210 0x7f19841d5680 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.168+0000 7f198b56b700 1 --2- 172.21.15.156:0/1805725609 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f198409a150 0x7f1984130260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.168+0000 7f198b56b700 1 --2- 172.21.15.156:0/1805725609 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1984133c20 0x7f19841307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.168+0000 7f198b56b700 1 -- 172.21.15.156:0/1805725609 >> 172.21.15.156:0/1805725609 conn(0x7f19840a4430 msgr2=0x7f1984071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:57.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.168+0000 7f198b56b700 1 -- 172.21.15.156:0/1805725609 shutdown_connections 2023-09-30T22:24:57.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:57.168+0000 7f198b56b700 1 -- 172.21.15.156:0/1805725609 wait complete. 2023-09-30T22:24:57.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:58.090 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:58.157 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:58.157 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:58.181 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:58.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.232+0000 7fa9261e0700 1 Processor -- start 2023-09-30T22:24:58.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.232+0000 7fa9261e0700 1 -- start start 2023-09-30T22:24:58.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.233+0000 7fa9261e0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa9201368e0 0x7fa920138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.233+0000 7fa9261e0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa920139200 0x7fa92013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.233+0000 7fa9261e0700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa92009a760 con 0x7fa920133900 2023-09-30T22:24:58.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.233+0000 7fa9261e0700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9201336e0 con 0x7fa9201368e0 2023-09-30T22:24:58.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.233+0000 7fa9261e0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa92009a080 con 0x7fa920139200 2023-09-30T22:24:58.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.233+0000 7fa91ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa920139200 0x7fa92013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.233+0000 7fa91f7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fa920133900 0x7fa920133cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:44738/0 (socket says 172.21.15.156:44738) 2023-09-30T22:24:58.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.233+0000 7fa91effd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa9201368e0 0x7fa920138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.233+0000 7fa91f7fe700 1 -- 172.21.15.156:0/2718900591 learned_addr learned my addr 172.21.15.156:0/2718900591 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:58.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.233+0000 7fa91e7fc700 1 -- 172.21.15.156:0/2718900591 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4204426783 0 0) 0x7fa92009a760 con 0x7fa920133900 2023-09-30T22:24:58.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.234+0000 7fa91e7fc700 1 -- 172.21.15.156:0/2718900591 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9080035b0 con 0x7fa920133900 2023-09-30T22:24:58.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.234+0000 7fa91effd700 1 -- 172.21.15.156:0/2718900591 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa920139200 msgr2=0x7fa92013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:58.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.234+0000 7fa91effd700 1 --2- 172.21.15.156:0/2718900591 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa920139200 0x7fa92013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.234+0000 7fa91effd700 1 -- 172.21.15.156:0/2718900591 >> v1:172.21.15.156:6789/0 conn(0x7fa920133900 legacy=0x7fa920133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.234+0000 7fa91effd700 1 -- 172.21.15.156:0/2718900591 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9200a23e0 con 0x7fa9201368e0 2023-09-30T22:24:58.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.234+0000 7fa91effd700 1 --2- 172.21.15.156:0/2718900591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9201368e0 0x7fa920138cc0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fa914009840 tx=0x7fa914009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c958394a58e5b94 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.234+0000 7fa91e7fc700 1 -- 172.21.15.156:0/2718900591 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa914011830 con 0x7fa9201368e0 2023-09-30T22:24:58.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.234+0000 7fa91e7fc700 1 -- 172.21.15.156:0/2718900591 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa914011990 con 0x7fa9201368e0 2023-09-30T22:24:58.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.234+0000 7fa91e7fc700 1 -- 172.21.15.156:0/2718900591 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa914011d20 con 0x7fa9201368e0 2023-09-30T22:24:58.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.235+0000 7fa9261e0700 1 -- 172.21.15.156:0/2718900591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9201368e0 msgr2=0x7fa920138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.235+0000 7fa9261e0700 1 --2- 172.21.15.156:0/2718900591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9201368e0 0x7fa920138cc0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fa914009840 tx=0x7fa914009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:58.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.235+0000 7fa9261e0700 1 -- 172.21.15.156:0/2718900591 shutdown_connections 2023-09-30T22:24:58.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.235+0000 7fa9261e0700 1 --2- 172.21.15.156:0/2718900591 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa920139200 0x7fa92013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.235+0000 7fa9261e0700 1 --2- 172.21.15.156:0/2718900591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9201368e0 0x7fa920138cc0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.235+0000 7fa9261e0700 1 -- 172.21.15.156:0/2718900591 >> 172.21.15.156:0/2718900591 conn(0x7fa9200a2980 msgr2=0x7fa9200a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.235+0000 7fa9261e0700 1 -- 172.21.15.156:0/2718900591 shutdown_connections 2023-09-30T22:24:58.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.235+0000 7fa9261e0700 1 -- 172.21.15.156:0/2718900591 wait complete. 2023-09-30T22:24:58.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.236+0000 7fa9261e0700 1 Processor -- start 2023-09-30T22:24:58.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.236+0000 7fa9261e0700 1 -- start start 2023-09-30T22:24:58.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.237+0000 7fa9261e0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa920133900 0x7fa92011af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.237+0000 7fa9261e0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa9201368e0 0x7fa92011b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.237+0000 7fa9261e0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa920139200 0x7fa92011b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.237+0000 7fa9261e0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92009a350 con 0x7fa920139200 2023-09-30T22:24:58.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.237+0000 7fa9261e0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa92011cc30 con 0x7fa920133900 2023-09-30T22:24:58.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.237+0000 7fa9261e0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa92011e750 con 0x7fa9201368e0 2023-09-30T22:24:58.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.237+0000 7fa91f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa920133900 0x7fa92011af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.237+0000 7fa91f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa920133900 0x7fa92011af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44566/0 (socket says 172.21.15.156:44566) 2023-09-30T22:24:58.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.237+0000 7fa91f7fe700 1 -- 172.21.15.156:0/1599320042 learned_addr learned my addr 172.21.15.156:0/1599320042 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:58.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.237+0000 7fa91effd700 1 --2- 172.21.15.156:0/1599320042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa9201368e0 0x7fa92011b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.237+0000 7fa91ffff700 1 --2- 172.21.15.156:0/1599320042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa920139200 0x7fa92011b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.237+0000 7fa91ffff700 1 -- 172.21.15.156:0/1599320042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa9201368e0 msgr2=0x7fa92011b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.237+0000 7fa91ffff700 1 --2- 172.21.15.156:0/1599320042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa9201368e0 0x7fa92011b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.237+0000 7fa91ffff700 1 -- 172.21.15.156:0/1599320042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa920133900 msgr2=0x7fa92011af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.237+0000 7fa91ffff700 1 --2- 172.21.15.156:0/1599320042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa920133900 0x7fa92011af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.237+0000 7fa91ffff700 1 -- 172.21.15.156:0/1599320042 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9140094a0 con 0x7fa920139200 2023-09-30T22:24:58.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.237+0000 7fa91effd700 1 --2- 172.21.15.156:0/1599320042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa9201368e0 0x7fa92011b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:58.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.237+0000 7fa91ffff700 1 --2- 172.21.15.156:0/1599320042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa920139200 0x7fa92011b990 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fa918007dc0 tx=0x7fa91800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.238+0000 7fa907fff700 1 -- 172.21.15.156:0/1599320042 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa918018070 con 0x7fa920139200 2023-09-30T22:24:58.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.238+0000 7fa907fff700 1 -- 172.21.15.156:0/1599320042 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91800eb30 con 0x7fa920139200 2023-09-30T22:24:58.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.238+0000 7fa907fff700 1 -- 172.21.15.156:0/1599320042 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91800eec0 con 0x7fa920139200 2023-09-30T22:24:58.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.238+0000 7fa9261e0700 1 -- 172.21.15.156:0/1599320042 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa920138ef0 con 0x7fa920139200 2023-09-30T22:24:58.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.238+0000 7fa9261e0700 1 -- 172.21.15.156:0/1599320042 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa92011f1c0 con 0x7fa920139200 2023-09-30T22:24:58.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.239+0000 7fa907fff700 1 -- 172.21.15.156:0/1599320042 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa918003a20 con 0x7fa920139200 2023-09-30T22:24:58.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.239+0000 7fa907fff700 1 -- 172.21.15.156:0/1599320042 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa91803f610 con 0x7fa920139200 2023-09-30T22:24:58.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.239+0000 7fa9261e0700 1 -- 172.21.15.156:0/1599320042 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa92011e3c0 con 0x7fa920139200 2023-09-30T22:24:58.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.248+0000 7fa907fff700 1 -- 172.21.15.156:0/1599320042 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa918009950 con 0x7fa920139200 2023-09-30T22:24:58.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.300+0000 7fc56f41b700 1 Processor -- start 2023-09-30T22:24:58.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.300+0000 7fc56f41b700 1 -- start start 2023-09-30T22:24:58.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.300+0000 7fc56f41b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc56806a770 0x7fc5681349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.300+0000 7fc56f41b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc568134f00 0x7fc56809d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.300+0000 7fc56f41b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc56809dea0 0x7fc56809e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.300+0000 7fc56f41b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc56806b2e0 con 0x7fc56806a770 2023-09-30T22:24:58.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.300+0000 7fc56f41b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc56809eca0 con 0x7fc568134f00 2023-09-30T22:24:58.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.300+0000 7fc56f41b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc56809f720 con 0x7fc56809dea0 2023-09-30T22:24:58.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.301+0000 7fc56d1b7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc56806a770 0x7fc5681349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.301+0000 7fc56d1b7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc56806a770 0x7fc5681349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47476/0 (socket says 172.21.15.156:47476) 2023-09-30T22:24:58.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.301+0000 7fc56d1b7700 1 -- 172.21.15.156:0/4050175955 learned_addr learned my addr 172.21.15.156:0/4050175955 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:58.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.301+0000 7fc56d9b8700 1 --2- 172.21.15.156:0/4050175955 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc56809dea0 0x7fc56809e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.301+0000 7fc56c9b6700 1 --2- 172.21.15.156:0/4050175955 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc568134f00 0x7fc56809d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.301+0000 7fc56d1b7700 1 -- 172.21.15.156:0/4050175955 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc56809dea0 msgr2=0x7fc56809e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:58.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.301+0000 7fc56d1b7700 1 --2- 172.21.15.156:0/4050175955 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc56809dea0 0x7fc56809e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.301+0000 7fc56d1b7700 1 -- 172.21.15.156:0/4050175955 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc568134f00 msgr2=0x7fc56809d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:58.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.301+0000 7fc56d1b7700 1 --2- 172.21.15.156:0/4050175955 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc568134f00 0x7fc56809d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.301+0000 7fc56d1b7700 1 -- 172.21.15.156:0/4050175955 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56806b480 con 0x7fc56806a770 2023-09-30T22:24:58.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.301+0000 7fc56c9b6700 1 --2- 172.21.15.156:0/4050175955 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc568134f00 0x7fc56809d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:58.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.301+0000 7fc56d1b7700 1 --2- 172.21.15.156:0/4050175955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc56806a770 0x7fc5681349c0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fc5640098f0 tx=0x7fc564009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e79465f06113070d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.302+0000 7fc55ffff700 1 -- 172.21.15.156:0/4050175955 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc564011830 con 0x7fc56806a770 2023-09-30T22:24:58.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.302+0000 7fc55ffff700 1 -- 172.21.15.156:0/4050175955 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc564011990 con 0x7fc56806a770 2023-09-30T22:24:58.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.302+0000 7fc55ffff700 1 -- 172.21.15.156:0/4050175955 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc564011d20 con 0x7fc56806a770 2023-09-30T22:24:58.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.302+0000 7fc56f41b700 1 -- 172.21.15.156:0/4050175955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc56806a770 msgr2=0x7fc5681349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.302+0000 7fc56f41b700 1 --2- 172.21.15.156:0/4050175955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc56806a770 0x7fc5681349c0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fc5640098f0 tx=0x7fc564009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:58.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.302+0000 7fc56f41b700 1 -- 172.21.15.156:0/4050175955 shutdown_connections 2023-09-30T22:24:58.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.302+0000 7fc56f41b700 1 --2- 172.21.15.156:0/4050175955 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc56809dea0 0x7fc56809e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.302+0000 7fc56f41b700 1 --2- 172.21.15.156:0/4050175955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc56806a770 0x7fc5681349c0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.302+0000 7fc56f41b700 1 --2- 172.21.15.156:0/4050175955 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc568134f00 0x7fc56809d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.302+0000 7fc56f41b700 1 -- 172.21.15.156:0/4050175955 >> 172.21.15.156:0/4050175955 conn(0x7fc568099c40 msgr2=0x7fc5680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.303+0000 7fc56f41b700 1 -- 172.21.15.156:0/4050175955 shutdown_connections 2023-09-30T22:24:58.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.303+0000 7fc56f41b700 1 -- 172.21.15.156:0/4050175955 wait complete. 2023-09-30T22:24:58.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.303+0000 7fc56f41b700 1 Processor -- start 2023-09-30T22:24:58.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.304+0000 7fc56f41b700 1 -- start start 2023-09-30T22:24:58.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.304+0000 7fc56f41b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc56806a770 0x7fc568132e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.304+0000 7fc56f41b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc56809dea0 0x7fc568133360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.304+0000 7fc56f41b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc568134f00 0x7fc5681338a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.304+0000 7fc56f41b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5680714b0 con 0x7fc56809dea0 2023-09-30T22:24:58.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.304+0000 7fc56f41b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5681341d0 con 0x7fc56806a770 2023-09-30T22:24:58.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.304+0000 7fc56f41b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5680a0460 con 0x7fc568134f00 2023-09-30T22:24:58.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.304+0000 7fc56d1b7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc56806a770 0x7fc568132e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.304+0000 7fc56d1b7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc56806a770 0x7fc568132e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44582/0 (socket says 172.21.15.156:44582) 2023-09-30T22:24:58.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.304+0000 7fc56d1b7700 1 -- 172.21.15.156:0/242006073 learned_addr learned my addr 172.21.15.156:0/242006073 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:58.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.304+0000 7fc56d9b8700 1 --2- 172.21.15.156:0/242006073 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc568134f00 0x7fc5681338a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.304+0000 7fc56c9b6700 1 --2- 172.21.15.156:0/242006073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc56809dea0 0x7fc568133360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.304+0000 7fc56d1b7700 1 -- 172.21.15.156:0/242006073 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc568134f00 msgr2=0x7fc5681338a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.304+0000 7fc56d1b7700 1 --2- 172.21.15.156:0/242006073 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc568134f00 0x7fc5681338a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.304+0000 7fc56d1b7700 1 -- 172.21.15.156:0/242006073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc56809dea0 msgr2=0x7fc568133360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.304+0000 7fc56d1b7700 1 --2- 172.21.15.156:0/242006073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc56809dea0 0x7fc568133360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.304+0000 7fc56d1b7700 1 -- 172.21.15.156:0/242006073 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5580094a0 con 0x7fc56806a770 2023-09-30T22:24:58.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.305+0000 7fc56d1b7700 1 --2- 172.21.15.156:0/242006073 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc56806a770 0x7fc568132e20 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fc564009c40 tx=0x7fc564004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.305+0000 7fc55dffb700 1 -- 172.21.15.156:0/242006073 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc564004450 con 0x7fc56806a770 2023-09-30T22:24:58.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.305+0000 7fc55dffb700 1 -- 172.21.15.156:0/242006073 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56401e070 con 0x7fc56806a770 2023-09-30T22:24:58.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.305+0000 7fc55dffb700 1 -- 172.21.15.156:0/242006073 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5640038e0 con 0x7fc56806a770 2023-09-30T22:24:58.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.305+0000 7fc56f41b700 1 -- 172.21.15.156:0/242006073 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc564009550 con 0x7fc56806a770 2023-09-30T22:24:58.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.305+0000 7fc56f41b700 1 -- 172.21.15.156:0/242006073 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc568071b30 con 0x7fc56806a770 2023-09-30T22:24:58.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.306+0000 7fc56f41b700 1 -- 172.21.15.156:0/242006073 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc56804f2a0 con 0x7fc56806a770 2023-09-30T22:24:58.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.306+0000 7fc55dffb700 1 -- 172.21.15.156:0/242006073 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc564003a40 con 0x7fc56806a770 2023-09-30T22:24:58.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.307+0000 7fc55dffb700 1 -- 172.21.15.156:0/242006073 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc564040480 con 0x7fc56806a770 2023-09-30T22:24:58.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.307+0000 7fc78ad18700 1 Processor -- start 2023-09-30T22:24:58.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.307+0000 7fc78ad18700 1 -- start start 2023-09-30T22:24:58.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.307+0000 7fc78ad18700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc78409e340 0x7fc7841359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.307+0000 7fc78ad18700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc784135f20 0x7fc784138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.308+0000 7fc78ad18700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78409aaa0 con 0x7fc78409d860 2023-09-30T22:24:58.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.308+0000 7fc78ad18700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc78409e730 con 0x7fc78409e340 2023-09-30T22:24:58.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.308+0000 7fc78ad18700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78409f870 con 0x7fc784135f20 2023-09-30T22:24:58.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.308+0000 7fc7892b5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc784135f20 0x7fc784138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.308+0000 7fc7892b5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc784135f20 0x7fc784138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44594/0 (socket says 172.21.15.156:44594) 2023-09-30T22:24:58.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.308+0000 7fc7892b5700 1 -- 172.21.15.156:0/1679822805 learned_addr learned my addr 172.21.15.156:0/1679822805 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:58.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.308+0000 7fc7892b5700 1 -- 172.21.15.156:0/1679822805 >> v2:172.21.15.156:3300/0 conn(0x7fc78409e340 msgr2=0x7fc7841359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:58.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.308+0000 7fc7892b5700 1 --2- 172.21.15.156:0/1679822805 >> v2:172.21.15.156:3300/0 conn(0x7fc78409e340 0x7fc7841359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.308+0000 7fc7892b5700 1 -- 172.21.15.156:0/1679822805 >> v1:172.21.15.156:6789/0 conn(0x7fc78409d860 legacy=0x7fc78409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:58.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.308+0000 7fc7892b5700 1 -- 172.21.15.156:0/1679822805 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78409b360 con 0x7fc784135f20 2023-09-30T22:24:58.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.308+0000 7fc7892b5700 1 --2- 172.21.15.156:0/1679822805 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc784135f20 0x7fc784138300 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fc77c009e80 tx=0x7fc77c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b56e4616dfc0cef1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.315+0000 7fc7837fe700 1 -- 172.21.15.156:0/1679822805 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c00e070 con 0x7fc784135f20 2023-09-30T22:24:58.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.315+0000 7fc7837fe700 1 -- 172.21.15.156:0/1679822805 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77c003a20 con 0x7fc784135f20 2023-09-30T22:24:58.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.315+0000 7fc7837fe700 1 -- 172.21.15.156:0/1679822805 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c003dd0 con 0x7fc784135f20 2023-09-30T22:24:58.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.315+0000 7fc55dffb700 1 -- 172.21.15.156:0/242006073 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc564003cf0 con 0x7fc56806a770 2023-09-30T22:24:58.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.316+0000 7fc78ad18700 1 -- 172.21.15.156:0/1679822805 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc784135f20 msgr2=0x7fc784138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.316+0000 7fc78ad18700 1 --2- 172.21.15.156:0/1679822805 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc784135f20 0x7fc784138300 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fc77c009e80 tx=0x7fc77c00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:58.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.316+0000 7fc78ad18700 1 -- 172.21.15.156:0/1679822805 shutdown_connections 2023-09-30T22:24:58.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.316+0000 7fc78ad18700 1 --2- 172.21.15.156:0/1679822805 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc784135f20 0x7fc784138300 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.316+0000 7fc78ad18700 1 --2- 172.21.15.156:0/1679822805 >> v2:172.21.15.156:3300/0 conn(0x7fc78409e340 0x7fc7841359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.316+0000 7fc78ad18700 1 -- 172.21.15.156:0/1679822805 >> 172.21.15.156:0/1679822805 conn(0x7fc784099c40 msgr2=0x7fc7840a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.316+0000 7fc78ad18700 1 -- 172.21.15.156:0/1679822805 shutdown_connections 2023-09-30T22:24:58.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.316+0000 7fc78ad18700 1 -- 172.21.15.156:0/1679822805 wait complete. 2023-09-30T22:24:58.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.318+0000 7fc78ad18700 1 Processor -- start 2023-09-30T22:24:58.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.318+0000 7fc78ad18700 1 -- start start 2023-09-30T22:24:58.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.318+0000 7fc78ad18700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc78409d860 0x7fc78411b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.318+0000 7fc78ad18700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc78409e340 0x7fc78411bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.319+0000 7fc78ad18700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc784135f20 0x7fc78411c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.319+0000 7fc78ad18700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78411dba0 con 0x7fc78409e340 2023-09-30T22:24:58.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.319+0000 7fc78ad18700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78411d2d0 con 0x7fc78409d860 2023-09-30T22:24:58.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.319+0000 7fc78ad18700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc78411cb10 con 0x7fc784135f20 2023-09-30T22:24:58.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.319+0000 7fc788ab4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc78409d860 0x7fc78411b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.319+0000 7fc788ab4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc78409d860 0x7fc78411b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44608/0 (socket says 172.21.15.156:44608) 2023-09-30T22:24:58.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.319+0000 7fc788ab4700 1 -- 172.21.15.156:0/2628766866 learned_addr learned my addr 172.21.15.156:0/2628766866 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:58.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.319+0000 7fc783fff700 1 --2- 172.21.15.156:0/2628766866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc78409e340 0x7fc78411bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.319+0000 7fc7892b5700 1 --2- 172.21.15.156:0/2628766866 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc784135f20 0x7fc78411c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.319+0000 7fc783fff700 1 -- 172.21.15.156:0/2628766866 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc784135f20 msgr2=0x7fc78411c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.319+0000 7fc783fff700 1 --2- 172.21.15.156:0/2628766866 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc784135f20 0x7fc78411c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.319+0000 7fc783fff700 1 -- 172.21.15.156:0/2628766866 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc78409d860 msgr2=0x7fc78411b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.319+0000 7fc783fff700 1 --2- 172.21.15.156:0/2628766866 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc78409d860 0x7fc78411b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.319+0000 7fc783fff700 1 -- 172.21.15.156:0/2628766866 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77c009b30 con 0x7fc78409e340 2023-09-30T22:24:58.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.319+0000 7fc783fff700 1 --2- 172.21.15.156:0/2628766866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc78409e340 0x7fc78411bc80 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fc77000b450 tx=0x7fc77000b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.320+0000 7fc7817fa700 1 -- 172.21.15.156:0/2628766866 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc770011830 con 0x7fc78409e340 2023-09-30T22:24:58.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.320+0000 7fc78ad18700 1 -- 172.21.15.156:0/2628766866 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc78409c8b0 con 0x7fc78409e340 2023-09-30T22:24:58.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.320+0000 7fc7817fa700 1 -- 172.21.15.156:0/2628766866 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc770011990 con 0x7fc78409e340 2023-09-30T22:24:58.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.320+0000 7fc7817fa700 1 -- 172.21.15.156:0/2628766866 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc770011d40 con 0x7fc78409e340 2023-09-30T22:24:58.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.320+0000 7fc78ad18700 1 -- 172.21.15.156:0/2628766866 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7840a22f0 con 0x7fc78409e340 2023-09-30T22:24:58.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.321+0000 7fc7817fa700 1 -- 172.21.15.156:0/2628766866 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc77001a400 con 0x7fc78409e340 2023-09-30T22:24:58.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.321+0000 7fc78ad18700 1 -- 172.21.15.156:0/2628766866 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7840717c0 con 0x7fc78409e340 2023-09-30T22:24:58.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.322+0000 7fc7817fa700 1 -- 172.21.15.156:0/2628766866 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc77000be20 con 0x7fc78409e340 2023-09-30T22:24:58.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.326+0000 7fc7817fa700 1 -- 172.21.15.156:0/2628766866 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc770044060 con 0x7fc78409e340 2023-09-30T22:24:58.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.345+0000 7f99d80ae700 1 Processor -- start 2023-09-30T22:24:58.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.346+0000 7f99d80ae700 1 -- start start 2023-09-30T22:24:58.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.346+0000 7f99d80ae700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99d009dec0 0x7f99d006b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.346+0000 7f99d80ae700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f99d0136cb0 0x7f99d0139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.346+0000 7f99d80ae700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d006e900 con 0x7f99d006a770 2023-09-30T22:24:58.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.346+0000 7f99d80ae700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d009d180 con 0x7f99d0136cb0 2023-09-30T22:24:58.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.346+0000 7f99d80ae700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d009e780 con 0x7f99d009dec0 2023-09-30T22:24:58.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.346+0000 7f99d5649700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99d009dec0 0x7f99d006b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.346+0000 7f99d5649700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99d009dec0 0x7f99d006b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44618/0 (socket says 172.21.15.156:44618) 2023-09-30T22:24:58.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.346+0000 7f99d5649700 1 -- 172.21.15.156:0/1944371132 learned_addr learned my addr 172.21.15.156:0/1944371132 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:58.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.346+0000 7f99d664b700 1 --2- 172.21.15.156:0/1944371132 >> v2:172.21.15.156:3300/0 conn(0x7f99d0136cb0 0x7f99d0139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.347+0000 7f99d5649700 1 -- 172.21.15.156:0/1944371132 >> v2:172.21.15.156:3300/0 conn(0x7f99d0136cb0 msgr2=0x7f99d0139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:58.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.347+0000 7f99d5649700 1 --2- 172.21.15.156:0/1944371132 >> v2:172.21.15.156:3300/0 conn(0x7f99d0136cb0 0x7f99d0139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.347+0000 7f99d5649700 1 -- 172.21.15.156:0/1944371132 >> v1:172.21.15.156:6789/0 conn(0x7f99d006a770 legacy=0x7f99d006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.347+0000 7f99d5649700 1 -- 172.21.15.156:0/1944371132 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d009d3c0 con 0x7f99d009dec0 2023-09-30T22:24:58.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.347+0000 7f99d5649700 1 --2- 172.21.15.156:0/1944371132 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99d009dec0 0x7f99d006b250 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f99c00098f0 tx=0x7f99c0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db9b179bd7ed18d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.347+0000 7f99d4e48700 1 -- 172.21.15.156:0/1944371132 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c0011830 con 0x7f99d009dec0 2023-09-30T22:24:58.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.347+0000 7f99d4e48700 1 -- 172.21.15.156:0/1944371132 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c0011990 con 0x7f99d009dec0 2023-09-30T22:24:58.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.347+0000 7f99d4e48700 1 -- 172.21.15.156:0/1944371132 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c0011d20 con 0x7f99d009dec0 2023-09-30T22:24:58.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.348+0000 7f99d80ae700 1 -- 172.21.15.156:0/1944371132 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99d009dec0 msgr2=0x7f99d006b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.348+0000 7f99d80ae700 1 --2- 172.21.15.156:0/1944371132 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99d009dec0 0x7f99d006b250 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f99c00098f0 tx=0x7f99c0009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:58.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.348+0000 7f99d80ae700 1 -- 172.21.15.156:0/1944371132 shutdown_connections 2023-09-30T22:24:58.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.348+0000 7f99d80ae700 1 --2- 172.21.15.156:0/1944371132 >> v2:172.21.15.156:3300/0 conn(0x7f99d0136cb0 0x7f99d0139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.348+0000 7f99d80ae700 1 --2- 172.21.15.156:0/1944371132 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99d009dec0 0x7f99d006b250 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.348+0000 7f99d80ae700 1 -- 172.21.15.156:0/1944371132 >> 172.21.15.156:0/1944371132 conn(0x7f99d0099c40 msgr2=0x7f99d00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.348+0000 7f99d80ae700 1 -- 172.21.15.156:0/1944371132 shutdown_connections 2023-09-30T22:24:58.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.348+0000 7f99d80ae700 1 -- 172.21.15.156:0/1944371132 wait complete. 2023-09-30T22:24:58.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.350+0000 7f99d80ae700 1 Processor -- start 2023-09-30T22:24:58.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.350+0000 7f99d80ae700 1 -- start start 2023-09-30T22:24:58.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.350+0000 7f99d80ae700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99d006a770 0x7f99d01c4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.350+0000 7f99d80ae700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99d009dec0 0x7f99d01c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.350+0000 7f99d80ae700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99d0136cb0 0x7f99d01c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.350+0000 7f99d80ae700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d0135480 con 0x7f99d009dec0 2023-09-30T22:24:58.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.350+0000 7f99d80ae700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d0133770 con 0x7f99d006a770 2023-09-30T22:24:58.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.350+0000 7f99d80ae700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99d0135680 con 0x7f99d0136cb0 2023-09-30T22:24:58.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.351+0000 7f99d664b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99d0136cb0 0x7f99d01c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.351+0000 7f99d5649700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99d009dec0 0x7f99d01c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.351+0000 7f99d664b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99d0136cb0 0x7f99d01c4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:37032/0 (socket says 172.21.15.156:37032) 2023-09-30T22:24:58.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.351+0000 7f99d664b700 1 -- 172.21.15.156:0/1935549583 learned_addr learned my addr 172.21.15.156:0/1935549583 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:58.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.351+0000 7f99d5e4a700 1 --2- 172.21.15.156:0/1935549583 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99d006a770 0x7f99d01c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.351+0000 7f99d5649700 1 -- 172.21.15.156:0/1935549583 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99d0136cb0 msgr2=0x7f99d01c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.351+0000 7f99d5649700 1 --2- 172.21.15.156:0/1935549583 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99d0136cb0 0x7f99d01c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.351+0000 7f99d5649700 1 -- 172.21.15.156:0/1935549583 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99d006a770 msgr2=0x7f99d01c4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.351+0000 7f99d5649700 1 --2- 172.21.15.156:0/1935549583 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99d006a770 0x7f99d01c4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.351+0000 7f99d5649700 1 -- 172.21.15.156:0/1935549583 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c0009550 con 0x7f99d009dec0 2023-09-30T22:24:58.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.351+0000 7f99d5e4a700 1 --2- 172.21.15.156:0/1935549583 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99d006a770 0x7f99d01c4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:58.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.351+0000 7f99d5649700 1 --2- 172.21.15.156:0/1935549583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99d009dec0 0x7f99d01c45d0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f99c0016000 tx=0x7f99c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.352+0000 7f99c67fc700 1 -- 172.21.15.156:0/1935549583 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c0004480 con 0x7f99d009dec0 2023-09-30T22:24:58.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.352+0000 7f99c67fc700 1 -- 172.21.15.156:0/1935549583 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c001f070 con 0x7f99d009dec0 2023-09-30T22:24:58.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.352+0000 7f99c67fc700 1 -- 172.21.15.156:0/1935549583 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c00038e0 con 0x7f99d009dec0 2023-09-30T22:24:58.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.352+0000 7f99d80ae700 1 -- 172.21.15.156:0/1935549583 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d0136260 con 0x7f99d009dec0 2023-09-30T22:24:58.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.352+0000 7f99d80ae700 1 -- 172.21.15.156:0/1935549583 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d0133f60 con 0x7f99d009dec0 2023-09-30T22:24:58.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.353+0000 7f99d80ae700 1 -- 172.21.15.156:0/1935549583 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d004f2a0 con 0x7f99d009dec0 2023-09-30T22:24:58.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.353+0000 7f99c67fc700 1 -- 172.21.15.156:0/1935549583 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f99c0021030 con 0x7f99d009dec0 2023-09-30T22:24:58.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.353+0000 7f99c67fc700 1 -- 172.21.15.156:0/1935549583 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f99c00409c0 con 0x7f99d009dec0 2023-09-30T22:24:58.362 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.362+0000 7f99c67fc700 1 -- 172.21.15.156:0/1935549583 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f99c00199a0 con 0x7f99d009dec0 2023-09-30T22:24:58.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.457+0000 7fa9261e0700 1 -- 172.21.15.156:0/1599320042 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa92004f2a0 con 0x7fa920139200 2023-09-30T22:24:58.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.458+0000 7fa907fff700 1 -- 172.21.15.156:0/1599320042 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa91801cb20 con 0x7fa920139200 2023-09-30T22:24:58.459 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:58.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.461+0000 7fa9261e0700 1 -- 172.21.15.156:0/1599320042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa920139200 msgr2=0x7fa92011b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.461+0000 7fa9261e0700 1 --2- 172.21.15.156:0/1599320042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa920139200 0x7fa92011b990 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fa918007dc0 tx=0x7fa91800e3c0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.461+0000 7fa9261e0700 1 -- 172.21.15.156:0/1599320042 shutdown_connections 2023-09-30T22:24:58.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.461+0000 7fa9261e0700 1 --2- 172.21.15.156:0/1599320042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa920139200 0x7fa92011b990 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.461+0000 7fa9261e0700 1 --2- 172.21.15.156:0/1599320042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa920133900 0x7fa92011af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.461+0000 7fa9261e0700 1 --2- 172.21.15.156:0/1599320042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa9201368e0 0x7fa92011b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.461+0000 7fa9261e0700 1 -- 172.21.15.156:0/1599320042 >> 172.21.15.156:0/1599320042 conn(0x7fa9200a2980 msgr2=0x7fa920131a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.461+0000 7fa9261e0700 1 -- 172.21.15.156:0/1599320042 shutdown_connections 2023-09-30T22:24:58.463 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.461+0000 7fa9261e0700 1 -- 172.21.15.156:0/1599320042 wait complete. 2023-09-30T22:24:58.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:58.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.512+0000 7fc56f41b700 1 -- 172.21.15.156:0/242006073 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc5680a2110 con 0x7fc56806a770 2023-09-30T22:24:58.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.512+0000 7fc55dffb700 1 -- 172.21.15.156:0/242006073 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc564015030 con 0x7fc56806a770 2023-09-30T22:24:58.513 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:58.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.514+0000 7fc56f41b700 1 -- 172.21.15.156:0/242006073 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc56806a770 msgr2=0x7fc568132e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.514+0000 7fc56f41b700 1 --2- 172.21.15.156:0/242006073 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc56806a770 0x7fc568132e20 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fc564009c40 tx=0x7fc564004750 comp rx=0 tx=0).stop 2023-09-30T22:24:58.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.514+0000 7fc56f41b700 1 -- 172.21.15.156:0/242006073 shutdown_connections 2023-09-30T22:24:58.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.514+0000 7fc56f41b700 1 --2- 172.21.15.156:0/242006073 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc568134f00 0x7fc5681338a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.514+0000 7fc56f41b700 1 --2- 172.21.15.156:0/242006073 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc56806a770 0x7fc568132e20 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.514+0000 7fc56f41b700 1 --2- 172.21.15.156:0/242006073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc56809dea0 0x7fc568133360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.514+0000 7fc56f41b700 1 -- 172.21.15.156:0/242006073 >> 172.21.15.156:0/242006073 conn(0x7fc568099c40 msgr2=0x7fc56809c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.514+0000 7fc56f41b700 1 -- 172.21.15.156:0/242006073 shutdown_connections 2023-09-30T22:24:58.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.514+0000 7fc56f41b700 1 -- 172.21.15.156:0/242006073 wait complete. 2023-09-30T22:24:58.531 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:58.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.538+0000 7fc78ad18700 1 -- 172.21.15.156:0/2628766866 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc78404f2a0 con 0x7fc78409e340 2023-09-30T22:24:58.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.539+0000 7fc7817fa700 1 -- 172.21.15.156:0/2628766866 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc770015070 con 0x7fc78409e340 2023-09-30T22:24:58.540 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:58.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.541+0000 7fc78ad18700 1 -- 172.21.15.156:0/2628766866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc78409e340 msgr2=0x7fc78411bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.541+0000 7fc78ad18700 1 --2- 172.21.15.156:0/2628766866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc78409e340 0x7fc78411bc80 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fc77000b450 tx=0x7fc77000b760 comp rx=0 tx=0).stop 2023-09-30T22:24:58.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.541+0000 7fc78ad18700 1 -- 172.21.15.156:0/2628766866 shutdown_connections 2023-09-30T22:24:58.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.541+0000 7fc78ad18700 1 --2- 172.21.15.156:0/2628766866 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc784135f20 0x7fc78411c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.541+0000 7fc78ad18700 1 --2- 172.21.15.156:0/2628766866 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc78409d860 0x7fc78411b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.541+0000 7fc78ad18700 1 --2- 172.21.15.156:0/2628766866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc78409e340 0x7fc78411bc80 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.541+0000 7fc78ad18700 1 -- 172.21.15.156:0/2628766866 >> 172.21.15.156:0/2628766866 conn(0x7fc784099c40 msgr2=0x7fc78406e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.541+0000 7fc78ad18700 1 -- 172.21.15.156:0/2628766866 shutdown_connections 2023-09-30T22:24:58.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.541+0000 7fc78ad18700 1 -- 172.21.15.156:0/2628766866 wait complete. 2023-09-30T22:24:58.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:58.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.565+0000 7f99d80ae700 1 -- 172.21.15.156:0/1935549583 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f99d009e380 con 0x7f99d009dec0 2023-09-30T22:24:58.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.565+0000 7f99c67fc700 1 -- 172.21.15.156:0/1935549583 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f99c0015070 con 0x7f99d009dec0 2023-09-30T22:24:58.566 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:58.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.567+0000 7f99d80ae700 1 -- 172.21.15.156:0/1935549583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99d009dec0 msgr2=0x7f99d01c45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.567+0000 7f99d80ae700 1 --2- 172.21.15.156:0/1935549583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99d009dec0 0x7f99d01c45d0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f99c0016000 tx=0x7f99c0004750 comp rx=0 tx=0).stop 2023-09-30T22:24:58.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.567+0000 7f99d80ae700 1 -- 172.21.15.156:0/1935549583 shutdown_connections 2023-09-30T22:24:58.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.567+0000 7f99d80ae700 1 --2- 172.21.15.156:0/1935549583 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99d0136cb0 0x7f99d01c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.567+0000 7f99d80ae700 1 --2- 172.21.15.156:0/1935549583 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99d006a770 0x7f99d01c4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.567+0000 7f99d80ae700 1 --2- 172.21.15.156:0/1935549583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99d009dec0 0x7f99d01c45d0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.567+0000 7f99d80ae700 1 -- 172.21.15.156:0/1935549583 >> 172.21.15.156:0/1935549583 conn(0x7f99d0099c40 msgr2=0x7f99d012e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.567+0000 7f99d80ae700 1 -- 172.21.15.156:0/1935549583 shutdown_connections 2023-09-30T22:24:58.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:58.567+0000 7f99d80ae700 1 -- 172.21.15.156:0/1935549583 wait complete. 2023-09-30T22:24:58.580 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:24:59.479 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:59.533 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:59.555 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:59.581 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:59.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.624+0000 7f0ca3c22700 1 Processor -- start 2023-09-30T22:24:59.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.624+0000 7f0ca3c22700 1 -- start start 2023-09-30T22:24:59.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.624+0000 7f0ca3c22700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0c9c133900 0x7f0c9c133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.624+0000 7f0ca3c22700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c9c134210 0x7f0c9c0a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.624+0000 7f0ca3c22700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c9c0a0ee0 0x7f0c9c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.624+0000 7f0ca3c22700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c9c09a760 con 0x7f0c9c133900 2023-09-30T22:24:59.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.624+0000 7f0ca3c22700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c1336e0 con 0x7f0c9c0a0ee0 2023-09-30T22:24:59.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.624+0000 7f0ca3c22700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c09a080 con 0x7f0c9c134210 2023-09-30T22:24:59.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.625+0000 7f0ca11bd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c9c134210 0x7f0c9c0a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.625+0000 7f0ca11bd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c9c134210 0x7f0c9c0a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:37036/0 (socket says 172.21.15.156:37036) 2023-09-30T22:24:59.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.625+0000 7f0ca11bd700 1 -- 172.21.15.156:0/2492214371 learned_addr learned my addr 172.21.15.156:0/2492214371 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:59.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.625+0000 7f0ca19be700 1 --2- 172.21.15.156:0/2492214371 >> v2:172.21.15.156:3300/0 conn(0x7f0c9c133900 0x7f0c9c133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.625+0000 7f0ca21bf700 1 --2- 172.21.15.156:0/2492214371 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c9c0a0ee0 0x7f0c9c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.625+0000 7f0ca11bd700 1 -- 172.21.15.156:0/2492214371 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c9c0a0ee0 msgr2=0x7f0c9c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:59.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.625+0000 7f0ca11bd700 1 --2- 172.21.15.156:0/2492214371 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c9c0a0ee0 0x7f0c9c0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.625+0000 7f0ca11bd700 1 -- 172.21.15.156:0/2492214371 >> v2:172.21.15.156:3300/0 conn(0x7f0c9c133900 msgr2=0x7f0c9c133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:59.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.625+0000 7f0ca11bd700 1 --2- 172.21.15.156:0/2492214371 >> v2:172.21.15.156:3300/0 conn(0x7f0c9c133900 0x7f0c9c133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.625+0000 7f0ca11bd700 1 -- 172.21.15.156:0/2492214371 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9c0a23e0 con 0x7f0c9c134210 2023-09-30T22:24:59.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.625+0000 7f0ca21bf700 1 --2- 172.21.15.156:0/2492214371 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c9c0a0ee0 0x7f0c9c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:59.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.625+0000 7f0ca11bd700 1 --2- 172.21.15.156:0/2492214371 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c9c134210 0x7f0c9c0a09a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0098f0 tx=0x7f0c8c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8739605172e36c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:59.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.625+0000 7f0ca09bc700 1 -- 172.21.15.156:0/2492214371 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c011830 con 0x7f0c9c134210 2023-09-30T22:24:59.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.625+0000 7f0ca09bc700 1 -- 172.21.15.156:0/2492214371 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8c011990 con 0x7f0c9c134210 2023-09-30T22:24:59.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.626+0000 7f0ca09bc700 1 -- 172.21.15.156:0/2492214371 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c011d20 con 0x7f0c9c134210 2023-09-30T22:24:59.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.626+0000 7f0ca3c22700 1 -- 172.21.15.156:0/2492214371 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c9c134210 msgr2=0x7f0c9c0a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.626+0000 7f0ca3c22700 1 --2- 172.21.15.156:0/2492214371 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c9c134210 0x7f0c9c0a09a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0098f0 tx=0x7f0c8c009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:59.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.626+0000 7f0ca3c22700 1 -- 172.21.15.156:0/2492214371 shutdown_connections 2023-09-30T22:24:59.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.626+0000 7f0ca3c22700 1 --2- 172.21.15.156:0/2492214371 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c9c0a0ee0 0x7f0c9c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.626+0000 7f0ca3c22700 1 --2- 172.21.15.156:0/2492214371 >> v2:172.21.15.156:3300/0 conn(0x7f0c9c133900 0x7f0c9c133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.626+0000 7f0ca3c22700 1 --2- 172.21.15.156:0/2492214371 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c9c134210 0x7f0c9c0a09a0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.626+0000 7f0ca3c22700 1 -- 172.21.15.156:0/2492214371 >> 172.21.15.156:0/2492214371 conn(0x7f0c9c0a2980 msgr2=0x7f0c9c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:59.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.626+0000 7f0ca3c22700 1 -- 172.21.15.156:0/2492214371 shutdown_connections 2023-09-30T22:24:59.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.626+0000 7f0ca3c22700 1 -- 172.21.15.156:0/2492214371 wait complete. 2023-09-30T22:24:59.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.627+0000 7f0ca3c22700 1 Processor -- start 2023-09-30T22:24:59.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.627+0000 7f0ca3c22700 1 -- start start 2023-09-30T22:24:59.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.628+0000 7f0ca3c22700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c9c0a0ee0 0x7f0c9c11d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.628+0000 7f0ca3c22700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c9c133900 0x7f0c9c11dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.628+0000 7f0ca3c22700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c9c134210 0x7f0c9c11e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.628+0000 7f0ca3c22700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c1212f0 con 0x7f0c9c133900 2023-09-30T22:24:59.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.628+0000 7f0ca3c22700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c11f9c0 con 0x7f0c9c134210 2023-09-30T22:24:59.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.628+0000 7f0ca3c22700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c120a80 con 0x7f0c9c0a0ee0 2023-09-30T22:24:59.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.628+0000 7f0ca19be700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c9c0a0ee0 0x7f0c9c11d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.628+0000 7f0ca19be700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c9c0a0ee0 0x7f0c9c11d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:37044/0 (socket says 172.21.15.156:37044) 2023-09-30T22:24:59.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.628+0000 7f0ca19be700 1 -- 172.21.15.156:0/1575618409 learned_addr learned my addr 172.21.15.156:0/1575618409 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:59.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.628+0000 7f0ca19be700 1 -- 172.21.15.156:0/1575618409 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c9c134210 msgr2=0x7f0c9c11e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.628+0000 7f0ca19be700 1 --2- 172.21.15.156:0/1575618409 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c9c134210 0x7f0c9c11e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.628+0000 7f0ca19be700 1 -- 172.21.15.156:0/1575618409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c9c133900 msgr2=0x7f0c9c11dd10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:59.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.628+0000 7f0ca19be700 1 --2- 172.21.15.156:0/1575618409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c9c133900 0x7f0c9c11dd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.628+0000 7f0ca19be700 1 -- 172.21.15.156:0/1575618409 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c94009a70 con 0x7f0c9c0a0ee0 2023-09-30T22:24:59.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.628+0000 7f0ca19be700 1 --2- 172.21.15.156:0/1575618409 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c9c0a0ee0 0x7f0c9c11d7d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800e9c0 tx=0x7f0c9800ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:59.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.629+0000 7f0c927fc700 1 -- 172.21.15.156:0/1575618409 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9800c7d0 con 0x7f0c9c0a0ee0 2023-09-30T22:24:59.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.629+0000 7f0c927fc700 1 -- 172.21.15.156:0/1575618409 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9800c930 con 0x7f0c9c0a0ee0 2023-09-30T22:24:59.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.629+0000 7f0ca3c22700 1 -- 172.21.15.156:0/1575618409 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c8c009550 con 0x7f0c9c0a0ee0 2023-09-30T22:24:59.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.629+0000 7f0c927fc700 1 -- 172.21.15.156:0/1575618409 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9800cca0 con 0x7f0c9c0a0ee0 2023-09-30T22:24:59.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.629+0000 7f0ca3c22700 1 -- 172.21.15.156:0/1575618409 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c9c09a310 con 0x7f0c9c0a0ee0 2023-09-30T22:24:59.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.630+0000 7f0c927fc700 1 -- 172.21.15.156:0/1575618409 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c98013470 con 0x7f0c9c0a0ee0 2023-09-30T22:24:59.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.630+0000 7f0c927fc700 1 -- 172.21.15.156:0/1575618409 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0c9803fb10 con 0x7f0c9c0a0ee0 2023-09-30T22:24:59.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.630+0000 7f0ca3c22700 1 -- 172.21.15.156:0/1575618409 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c9c11a590 con 0x7f0c9c0a0ee0 2023-09-30T22:24:59.635 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.635+0000 7f0c927fc700 1 -- 172.21.15.156:0/1575618409 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c98017080 con 0x7f0c9c0a0ee0 2023-09-30T22:24:59.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.672+0000 7fd59d3d7700 1 Processor -- start 2023-09-30T22:24:59.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.672+0000 7fd59d3d7700 1 -- start start 2023-09-30T22:24:59.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.673+0000 7fd59d3d7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd5981346e0 0x7fd598136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.673+0000 7fd59d3d7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd598137000 0x7fd5981393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.673+0000 7fd59d3d7700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5980a1640 con 0x7fd598131980 2023-09-30T22:24:59.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.673+0000 7fd59d3d7700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd59806eb30 con 0x7fd5981346e0 2023-09-30T22:24:59.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.673+0000 7fd59d3d7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5980a22d0 con 0x7fd598137000 2023-09-30T22:24:59.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.673+0000 7fd596ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fd598131980 0x7fd598131d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:44764/0 (socket says 172.21.15.156:44764) 2023-09-30T22:24:59.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.673+0000 7fd596ffd700 1 -- 172.21.15.156:0/1868254586 learned_addr learned my addr 172.21.15.156:0/1868254586 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:24:59.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.673+0000 7fd5977fe700 1 --2- 172.21.15.156:0/1868254586 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd598137000 0x7fd5981393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.673+0000 7fd5967fc700 1 --2- 172.21.15.156:0/1868254586 >> v2:172.21.15.156:3300/0 conn(0x7fd5981346e0 0x7fd598136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.673+0000 7fd5977fe700 1 -- 172.21.15.156:0/1868254586 >> v2:172.21.15.156:3300/0 conn(0x7fd5981346e0 msgr2=0x7fd598136ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:59.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.673+0000 7fd5977fe700 1 --2- 172.21.15.156:0/1868254586 >> v2:172.21.15.156:3300/0 conn(0x7fd5981346e0 0x7fd598136ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.673+0000 7fd595ffb700 1 -- 172.21.15.156:0/1868254586 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2009224393 0 0) 0x7fd5980a1640 con 0x7fd598131980 2023-09-30T22:24:59.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.673+0000 7fd5977fe700 1 -- 172.21.15.156:0/1868254586 >> v1:172.21.15.156:6789/0 conn(0x7fd598131980 legacy=0x7fd598131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.673+0000 7fd5977fe700 1 -- 172.21.15.156:0/1868254586 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd598131550 con 0x7fd598137000 2023-09-30T22:24:59.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.674+0000 7fd5977fe700 1 --2- 172.21.15.156:0/1868254586 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd598137000 0x7fd5981393e0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fd590009d90 tx=0x7fd59000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c45fff17e34c1d36 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:59.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.674+0000 7fd595ffb700 1 -- 172.21.15.156:0/1868254586 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59000e070 con 0x7fd598137000 2023-09-30T22:24:59.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.674+0000 7fd595ffb700 1 -- 172.21.15.156:0/1868254586 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59000bb20 con 0x7fd598137000 2023-09-30T22:24:59.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.674+0000 7fd595ffb700 1 -- 172.21.15.156:0/1868254586 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd590012430 con 0x7fd598137000 2023-09-30T22:24:59.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.675+0000 7fd59d3d7700 1 -- 172.21.15.156:0/1868254586 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd598137000 msgr2=0x7fd5981393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.675+0000 7fd59d3d7700 1 --2- 172.21.15.156:0/1868254586 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd598137000 0x7fd5981393e0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fd590009d90 tx=0x7fd59000b330 comp rx=0 tx=0).stop 2023-09-30T22:24:59.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.675+0000 7fd59d3d7700 1 -- 172.21.15.156:0/1868254586 shutdown_connections 2023-09-30T22:24:59.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.675+0000 7fd59d3d7700 1 --2- 172.21.15.156:0/1868254586 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd598137000 0x7fd5981393e0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.675+0000 7fd59d3d7700 1 --2- 172.21.15.156:0/1868254586 >> v2:172.21.15.156:3300/0 conn(0x7fd5981346e0 0x7fd598136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.675+0000 7fd59d3d7700 1 -- 172.21.15.156:0/1868254586 >> 172.21.15.156:0/1868254586 conn(0x7fd5980a2980 msgr2=0x7fd5980a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:59.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.675+0000 7fd59d3d7700 1 -- 172.21.15.156:0/1868254586 shutdown_connections 2023-09-30T22:24:59.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.675+0000 7fd59d3d7700 1 -- 172.21.15.156:0/1868254586 wait complete. 2023-09-30T22:24:59.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.676+0000 7fd59d3d7700 1 Processor -- start 2023-09-30T22:24:59.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.676+0000 7fd59d3d7700 1 -- start start 2023-09-30T22:24:59.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.677+0000 7fd59d3d7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd598131980 0x7fd598118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.677+0000 7fd59d3d7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5981346e0 0x7fd598119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.677+0000 7fd59d3d7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd598137000 0x7fd598119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.677+0000 7fd59d3d7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59811c7a0 con 0x7fd5981346e0 2023-09-30T22:24:59.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.677+0000 7fd59d3d7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd598136cd0 con 0x7fd598137000 2023-09-30T22:24:59.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.677+0000 7fd59d3d7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5980a1c40 con 0x7fd598131980 2023-09-30T22:24:59.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.677+0000 7fd596ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd598131980 0x7fd598118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.677+0000 7fd596ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd598131980 0x7fd598118df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:37062/0 (socket says 172.21.15.156:37062) 2023-09-30T22:24:59.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.677+0000 7fd596ffd700 1 -- 172.21.15.156:0/1901957056 learned_addr learned my addr 172.21.15.156:0/1901957056 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:59.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.677+0000 7fd5977fe700 1 --2- 172.21.15.156:0/1901957056 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd598137000 0x7fd598119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.677+0000 7fd5967fc700 1 --2- 172.21.15.156:0/1901957056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5981346e0 0x7fd598119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.678+0000 7fd5977fe700 1 -- 172.21.15.156:0/1901957056 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd598131980 msgr2=0x7fd598118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.678+0000 7fd5977fe700 1 --2- 172.21.15.156:0/1901957056 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd598131980 0x7fd598118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.678+0000 7fd5977fe700 1 -- 172.21.15.156:0/1901957056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5981346e0 msgr2=0x7fd598119330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.678+0000 7fd5977fe700 1 --2- 172.21.15.156:0/1901957056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5981346e0 0x7fd598119330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.678+0000 7fd5977fe700 1 -- 172.21.15.156:0/1901957056 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd590009a70 con 0x7fd598137000 2023-09-30T22:24:59.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.678+0000 7fd5967fc700 1 --2- 172.21.15.156:0/1901957056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5981346e0 0x7fd598119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:59.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.678+0000 7fd5977fe700 1 --2- 172.21.15.156:0/1901957056 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd598137000 0x7fd598119870 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fd590016000 tx=0x7fd590004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:59.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.678+0000 7fd57f7fe700 1 -- 172.21.15.156:0/1901957056 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd590012430 con 0x7fd598137000 2023-09-30T22:24:59.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.678+0000 7fd59d3d7700 1 -- 172.21.15.156:0/1901957056 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd59811c100 con 0x7fd598137000 2023-09-30T22:24:59.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.678+0000 7fd59d3d7700 1 -- 172.21.15.156:0/1901957056 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd59811a740 con 0x7fd598137000 2023-09-30T22:24:59.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.678+0000 7fd57f7fe700 1 -- 172.21.15.156:0/1901957056 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd590020070 con 0x7fd598137000 2023-09-30T22:24:59.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.678+0000 7fd57f7fe700 1 -- 172.21.15.156:0/1901957056 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd590004240 con 0x7fd598137000 2023-09-30T22:24:59.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.679+0000 7fd59d3d7700 1 -- 172.21.15.156:0/1901957056 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5780052e0 con 0x7fd598137000 2023-09-30T22:24:59.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.680+0000 7fd57f7fe700 1 -- 172.21.15.156:0/1901957056 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd5900043a0 con 0x7fd598137000 2023-09-30T22:24:59.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.680+0000 7fd57f7fe700 1 -- 172.21.15.156:0/1901957056 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd590022070 con 0x7fd598137000 2023-09-30T22:24:59.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.684+0000 7fd57f7fe700 1 -- 172.21.15.156:0/1901957056 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd590004650 con 0x7fd598137000 2023-09-30T22:24:59.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.715+0000 7f07e055f700 1 Processor -- start 2023-09-30T22:24:59.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.715+0000 7f07e055f700 1 -- start start 2023-09-30T22:24:59.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.715+0000 7f07e055f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07d8133ad0 0x7f07d8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.715+0000 7f07e055f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f07d81300a0 0x7f07d81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.715+0000 7f07e055f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07d806b2d0 con 0x7f07d81309f0 2023-09-30T22:24:59.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.715+0000 7f07e055f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d8133610 con 0x7f07d81300a0 2023-09-30T22:24:59.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.715+0000 7f07e055f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07d809a500 con 0x7f07d8133ad0 2023-09-30T22:24:59.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.716+0000 7f07de2fb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07d8133ad0 0x7f07d8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.716+0000 7f07de2fb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07d8133ad0 0x7f07d8133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:37072/0 (socket says 172.21.15.156:37072) 2023-09-30T22:24:59.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.716+0000 7f07de2fb700 1 -- 172.21.15.156:0/1014399472 learned_addr learned my addr 172.21.15.156:0/1014399472 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:59.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.716+0000 7f07ddafa700 1 --2- 172.21.15.156:0/1014399472 >> v2:172.21.15.156:3300/0 conn(0x7f07d81300a0 0x7f07d81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.716+0000 7f07de2fb700 1 -- 172.21.15.156:0/1014399472 >> v2:172.21.15.156:3300/0 conn(0x7f07d81300a0 msgr2=0x7f07d81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:59.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.716+0000 7f07de2fb700 1 --2- 172.21.15.156:0/1014399472 >> v2:172.21.15.156:3300/0 conn(0x7f07d81300a0 0x7f07d81304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.716+0000 7f07de2fb700 1 -- 172.21.15.156:0/1014399472 >> v1:172.21.15.156:6789/0 conn(0x7f07d81309f0 legacy=0x7f07d813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.716+0000 7f07de2fb700 1 -- 172.21.15.156:0/1014399472 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d81338b0 con 0x7f07d8133ad0 2023-09-30T22:24:59.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.716+0000 7f07de2fb700 1 --2- 172.21.15.156:0/1014399472 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07d8133ad0 0x7f07d8133ea0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f07d40098f0 tx=0x7f07d4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5322ac58c638b89a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:59.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.716+0000 7f07dd2f9700 1 -- 172.21.15.156:0/1014399472 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d400b8a0 con 0x7f07d8133ad0 2023-09-30T22:24:59.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.716+0000 7f07dd2f9700 1 -- 172.21.15.156:0/1014399472 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d400ba00 con 0x7f07d8133ad0 2023-09-30T22:24:59.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.716+0000 7f07dd2f9700 1 -- 172.21.15.156:0/1014399472 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d400bd90 con 0x7f07d8133ad0 2023-09-30T22:24:59.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.717+0000 7f07e055f700 1 -- 172.21.15.156:0/1014399472 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07d8133ad0 msgr2=0x7f07d8133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.717+0000 7f07e055f700 1 --2- 172.21.15.156:0/1014399472 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07d8133ad0 0x7f07d8133ea0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f07d40098f0 tx=0x7f07d4009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:59.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.717+0000 7f07e055f700 1 -- 172.21.15.156:0/1014399472 shutdown_connections 2023-09-30T22:24:59.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.717+0000 7f07e055f700 1 --2- 172.21.15.156:0/1014399472 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07d8133ad0 0x7f07d8133ea0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.717+0000 7f07e055f700 1 --2- 172.21.15.156:0/1014399472 >> v2:172.21.15.156:3300/0 conn(0x7f07d81300a0 0x7f07d81304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.717+0000 7f07e055f700 1 -- 172.21.15.156:0/1014399472 >> 172.21.15.156:0/1014399472 conn(0x7f07d8099c40 msgr2=0x7f07d80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:59.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.717+0000 7f07e055f700 1 -- 172.21.15.156:0/1014399472 shutdown_connections 2023-09-30T22:24:59.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.717+0000 7f07e055f700 1 -- 172.21.15.156:0/1014399472 wait complete. 2023-09-30T22:24:59.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.718+0000 7f07e055f700 1 Processor -- start 2023-09-30T22:24:59.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.718+0000 7f07e055f700 1 -- start start 2023-09-30T22:24:59.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.719+0000 7f07e055f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07d81300a0 0x7f07d811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.719+0000 7f07e055f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07d81309f0 0x7f07d811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.719+0000 7f07e055f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07d8133ad0 0x7f07d811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.719+0000 7f07e055f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d81200c0 con 0x7f07d8133ad0 2023-09-30T22:24:59.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.719+0000 7f07e055f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d811fb20 con 0x7f07d81309f0 2023-09-30T22:24:59.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.719+0000 7f07e055f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07d811f040 con 0x7f07d81300a0 2023-09-30T22:24:59.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.719+0000 7f07de2fb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07d81300a0 0x7f07d811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.719+0000 7f07de2fb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07d81300a0 0x7f07d811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:37076/0 (socket says 172.21.15.156:37076) 2023-09-30T22:24:59.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.719+0000 7f07de2fb700 1 -- 172.21.15.156:0/2307650910 learned_addr learned my addr 172.21.15.156:0/2307650910 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:59.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.719+0000 7f07ddafa700 1 --2- 172.21.15.156:0/2307650910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07d81309f0 0x7f07d811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.719+0000 7f07de2fb700 1 -- 172.21.15.156:0/2307650910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07d81309f0 msgr2=0x7f07d811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.719+0000 7f07de2fb700 1 --2- 172.21.15.156:0/2307650910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07d81309f0 0x7f07d811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.719+0000 7f07de2fb700 1 -- 172.21.15.156:0/2307650910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07d8133ad0 msgr2=0x7f07d811e4c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:59.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.719+0000 7f07de2fb700 1 --2- 172.21.15.156:0/2307650910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07d8133ad0 0x7f07d811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.719+0000 7f07de2fb700 1 -- 172.21.15.156:0/2307650910 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d4009550 con 0x7f07d81300a0 2023-09-30T22:24:59.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.719+0000 7f07ddafa700 1 --2- 172.21.15.156:0/2307650910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07d81309f0 0x7f07d811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:59.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.720+0000 7f07de2fb700 1 --2- 172.21.15.156:0/2307650910 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07d81300a0 0x7f07d811da40 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f07d4000c00 tx=0x7f07d4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:59.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.720+0000 7f07ceffd700 1 -- 172.21.15.156:0/2307650910 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d4004480 con 0x7f07d81300a0 2023-09-30T22:24:59.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.720+0000 7f07e055f700 1 -- 172.21.15.156:0/2307650910 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d811f850 con 0x7f07d81300a0 2023-09-30T22:24:59.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.720+0000 7f07e055f700 1 -- 172.21.15.156:0/2307650910 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d812d970 con 0x7f07d81300a0 2023-09-30T22:24:59.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.720+0000 7f07ceffd700 1 -- 172.21.15.156:0/2307650910 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d401f070 con 0x7f07d81300a0 2023-09-30T22:24:59.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.720+0000 7f07ceffd700 1 -- 172.21.15.156:0/2307650910 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d40038a0 con 0x7f07d81300a0 2023-09-30T22:24:59.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.721+0000 7f07ceffd700 1 -- 172.21.15.156:0/2307650910 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f07d4021030 con 0x7f07d81300a0 2023-09-30T22:24:59.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.721+0000 7f07e055f700 1 -- 172.21.15.156:0/2307650910 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c00052e0 con 0x7f07d81300a0 2023-09-30T22:24:59.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.721+0000 7f07ceffd700 1 -- 172.21.15.156:0/2307650910 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f07d40408b0 con 0x7f07d81300a0 2023-09-30T22:24:59.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.730+0000 7f07ceffd700 1 -- 172.21.15.156:0/2307650910 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f07d4011df0 con 0x7f07d81300a0 2023-09-30T22:24:59.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.753+0000 7f2b5fd73700 1 Processor -- start 2023-09-30T22:24:59.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.753+0000 7f2b5fd73700 1 -- start start 2023-09-30T22:24:59.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.754+0000 7f2b5fd73700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2b5809e870 0x7f2b5809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.754+0000 7f2b5fd73700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b5809f180 0x7f2b58131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.754+0000 7f2b5fd73700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b58131d70 0x7f2b581321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.754+0000 7f2b5fd73700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b580a0920 con 0x7f2b5809e870 2023-09-30T22:24:59.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.754+0000 7f2b5fd73700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5809c970 con 0x7f2b58131d70 2023-09-30T22:24:59.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.754+0000 7f2b5fd73700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5809bab0 con 0x7f2b5809f180 2023-09-30T22:24:59.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.754+0000 7f2b5d30e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b5809f180 0x7f2b58131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.754+0000 7f2b5d30e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b5809f180 0x7f2b58131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:37084/0 (socket says 172.21.15.156:37084) 2023-09-30T22:24:59.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.754+0000 7f2b5d30e700 1 -- 172.21.15.156:0/1026739444 learned_addr learned my addr 172.21.15.156:0/1026739444 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:59.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.754+0000 7f2b5e310700 1 --2- 172.21.15.156:0/1026739444 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b58131d70 0x7f2b581321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.754+0000 7f2b5d30e700 1 -- 172.21.15.156:0/1026739444 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b58131d70 msgr2=0x7f2b581321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:59.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.754+0000 7f2b5d30e700 1 --2- 172.21.15.156:0/1026739444 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b58131d70 0x7f2b581321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.754+0000 7f2b5d30e700 1 -- 172.21.15.156:0/1026739444 >> v2:172.21.15.156:3300/0 conn(0x7f2b5809e870 msgr2=0x7f2b5809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:59.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.754+0000 7f2b5d30e700 1 --2- 172.21.15.156:0/1026739444 >> v2:172.21.15.156:3300/0 conn(0x7f2b5809e870 0x7f2b5809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.754+0000 7f2b5d30e700 1 -- 172.21.15.156:0/1026739444 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5809f9c0 con 0x7f2b5809f180 2023-09-30T22:24:59.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.755+0000 7f2b5d30e700 1 --2- 172.21.15.156:0/1026739444 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b5809f180 0x7f2b58131830 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f2b480098f0 tx=0x7f2b48009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2249563670513413 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:59.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.755+0000 7f2b5cb0d700 1 -- 172.21.15.156:0/1026739444 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b48011830 con 0x7f2b5809f180 2023-09-30T22:24:59.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.755+0000 7f2b5cb0d700 1 -- 172.21.15.156:0/1026739444 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b48011990 con 0x7f2b5809f180 2023-09-30T22:24:59.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.755+0000 7f2b5cb0d700 1 -- 172.21.15.156:0/1026739444 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b48011d20 con 0x7f2b5809f180 2023-09-30T22:24:59.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.755+0000 7f2b5fd73700 1 -- 172.21.15.156:0/1026739444 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b5809f180 msgr2=0x7f2b58131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.755+0000 7f2b5fd73700 1 --2- 172.21.15.156:0/1026739444 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b5809f180 0x7f2b58131830 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f2b480098f0 tx=0x7f2b48009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:59.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.755+0000 7f2b5fd73700 1 -- 172.21.15.156:0/1026739444 shutdown_connections 2023-09-30T22:24:59.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.755+0000 7f2b5fd73700 1 --2- 172.21.15.156:0/1026739444 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b58131d70 0x7f2b581321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.755+0000 7f2b5fd73700 1 --2- 172.21.15.156:0/1026739444 >> v2:172.21.15.156:3300/0 conn(0x7f2b5809e870 0x7f2b5809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.755+0000 7f2b5fd73700 1 --2- 172.21.15.156:0/1026739444 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b5809f180 0x7f2b58131830 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.755+0000 7f2b5fd73700 1 -- 172.21.15.156:0/1026739444 >> 172.21.15.156:0/1026739444 conn(0x7f2b580a4430 msgr2=0x7f2b580a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:59.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.756+0000 7f2b5fd73700 1 -- 172.21.15.156:0/1026739444 shutdown_connections 2023-09-30T22:24:59.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.756+0000 7f2b5fd73700 1 -- 172.21.15.156:0/1026739444 wait complete. 2023-09-30T22:24:59.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.756+0000 7f2b5fd73700 1 Processor -- start 2023-09-30T22:24:59.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.756+0000 7f2b5fd73700 1 -- start start 2023-09-30T22:24:59.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.757+0000 7f2b5fd73700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b5809e870 0x7f2b58122ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.757+0000 7f2b5fd73700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b5809f180 0x7f2b58123410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.757+0000 7f2b5fd73700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b58131d70 0x7f2b58123950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.757+0000 7f2b5fd73700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5812db70 con 0x7f2b5809e870 2023-09-30T22:24:59.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.757+0000 7f2b5fd73700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b581263e0 con 0x7f2b58131d70 2023-09-30T22:24:59.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.757+0000 7f2b5fd73700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b581248c0 con 0x7f2b5809f180 2023-09-30T22:24:59.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.757+0000 7f2b5d30e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b5809f180 0x7f2b58123410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.757+0000 7f2b5d30e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b5809f180 0x7f2b58123410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:37100/0 (socket says 172.21.15.156:37100) 2023-09-30T22:24:59.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.757+0000 7f2b5d30e700 1 -- 172.21.15.156:0/2427683169 learned_addr learned my addr 172.21.15.156:0/2427683169 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:24:59.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.757+0000 7f2b5e310700 1 --2- 172.21.15.156:0/2427683169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b58131d70 0x7f2b58123950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.757+0000 7f2b5db0f700 1 --2- 172.21.15.156:0/2427683169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b5809e870 0x7f2b58122ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.757+0000 7f2b5d30e700 1 -- 172.21.15.156:0/2427683169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b58131d70 msgr2=0x7f2b58123950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.757+0000 7f2b5d30e700 1 --2- 172.21.15.156:0/2427683169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b58131d70 0x7f2b58123950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.757+0000 7f2b5d30e700 1 -- 172.21.15.156:0/2427683169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b5809e870 msgr2=0x7f2b58122ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.757+0000 7f2b5d30e700 1 --2- 172.21.15.156:0/2427683169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b5809e870 0x7f2b58122ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.757+0000 7f2b5d30e700 1 -- 172.21.15.156:0/2427683169 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b48009550 con 0x7f2b5809f180 2023-09-30T22:24:59.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.758+0000 7f2b5d30e700 1 --2- 172.21.15.156:0/2427683169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b5809f180 0x7f2b58123410 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f2b48009c40 tx=0x7f2b48004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:59.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.758+0000 7f2b4e7fc700 1 -- 172.21.15.156:0/2427683169 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b48004510 con 0x7f2b5809f180 2023-09-30T22:24:59.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.758+0000 7f2b4e7fc700 1 -- 172.21.15.156:0/2427683169 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4801f070 con 0x7f2b5809f180 2023-09-30T22:24:59.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.758+0000 7f2b5fd73700 1 -- 172.21.15.156:0/2427683169 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b5812e800 con 0x7f2b5809f180 2023-09-30T22:24:59.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.758+0000 7f2b5fd73700 1 -- 172.21.15.156:0/2427683169 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b58126e50 con 0x7f2b5809f180 2023-09-30T22:24:59.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.758+0000 7f2b4e7fc700 1 -- 172.21.15.156:0/2427683169 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b480038e0 con 0x7f2b5809f180 2023-09-30T22:24:59.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.759+0000 7f2b5fd73700 1 -- 172.21.15.156:0/2427683169 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b400052e0 con 0x7f2b5809f180 2023-09-30T22:24:59.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.759+0000 7f2b4e7fc700 1 -- 172.21.15.156:0/2427683169 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2b48003a40 con 0x7f2b5809f180 2023-09-30T22:24:59.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.759+0000 7f2b4e7fc700 1 -- 172.21.15.156:0/2427683169 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2b48021070 con 0x7f2b5809f180 2023-09-30T22:24:59.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.764+0000 7f2b4e7fc700 1 -- 172.21.15.156:0/2427683169 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b4802d3a0 con 0x7f2b5809f180 2023-09-30T22:24:59.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.840+0000 7f0ca3c22700 1 -- 172.21.15.156:0/1575618409 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0c9c120e70 con 0x7f0c9c0a0ee0 2023-09-30T22:24:59.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.840+0000 7f0c927fc700 1 -- 172.21.15.156:0/1575618409 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c9c120e70 con 0x7f0c9c0a0ee0 2023-09-30T22:24:59.841 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:24:59.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.843+0000 7f0ca3c22700 1 -- 172.21.15.156:0/1575618409 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c9c0a0ee0 msgr2=0x7f0c9c11d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.843+0000 7f0ca3c22700 1 --2- 172.21.15.156:0/1575618409 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c9c0a0ee0 0x7f0c9c11d7d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800e9c0 tx=0x7f0c9800ed80 comp rx=0 tx=0).stop 2023-09-30T22:24:59.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.843+0000 7f0ca3c22700 1 -- 172.21.15.156:0/1575618409 shutdown_connections 2023-09-30T22:24:59.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.843+0000 7f0ca3c22700 1 --2- 172.21.15.156:0/1575618409 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0c9c134210 0x7f0c9c11e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.843+0000 7f0ca3c22700 1 --2- 172.21.15.156:0/1575618409 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0c9c0a0ee0 0x7f0c9c11d7d0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.843+0000 7f0ca3c22700 1 --2- 172.21.15.156:0/1575618409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c9c133900 0x7f0c9c11dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.843+0000 7f0ca3c22700 1 -- 172.21.15.156:0/1575618409 >> 172.21.15.156:0/1575618409 conn(0x7f0c9c0a2980 msgr2=0x7f0c9c1bae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:59.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.844+0000 7f0ca3c22700 1 -- 172.21.15.156:0/1575618409 shutdown_connections 2023-09-30T22:24:59.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.849+0000 7f0ca3c22700 1 -- 172.21.15.156:0/1575618409 wait complete. 2023-09-30T22:24:59.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:24:59.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.887+0000 7fd59d3d7700 1 -- 172.21.15.156:0/1901957056 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd578005860 con 0x7fd598137000 2023-09-30T22:24:59.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.887+0000 7fd57f7fe700 1 -- 172.21.15.156:0/1901957056 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd590035070 con 0x7fd598137000 2023-09-30T22:24:59.888 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:24:59.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.889+0000 7fd59d3d7700 1 -- 172.21.15.156:0/1901957056 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd598137000 msgr2=0x7fd598119870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.889+0000 7fd59d3d7700 1 --2- 172.21.15.156:0/1901957056 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd598137000 0x7fd598119870 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fd590016000 tx=0x7fd590004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.889+0000 7fd59d3d7700 1 -- 172.21.15.156:0/1901957056 shutdown_connections 2023-09-30T22:24:59.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.889+0000 7fd59d3d7700 1 --2- 172.21.15.156:0/1901957056 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd598137000 0x7fd598119870 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.889+0000 7fd59d3d7700 1 --2- 172.21.15.156:0/1901957056 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd598131980 0x7fd598118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.889+0000 7fd59d3d7700 1 --2- 172.21.15.156:0/1901957056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5981346e0 0x7fd598119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.890+0000 7fd59d3d7700 1 -- 172.21.15.156:0/1901957056 >> 172.21.15.156:0/1901957056 conn(0x7fd5980a2980 msgr2=0x7fd598133560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:59.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.891+0000 7fd59d3d7700 1 -- 172.21.15.156:0/1901957056 shutdown_connections 2023-09-30T22:24:59.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.891+0000 7fd59d3d7700 1 -- 172.21.15.156:0/1901957056 wait complete. 2023-09-30T22:24:59.904 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:24:59.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.929+0000 7f07e055f700 1 -- 172.21.15.156:0/2307650910 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f07c0005590 con 0x7f07d81300a0 2023-09-30T22:24:59.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.930+0000 7f07ceffd700 1 -- 172.21.15.156:0/2307650910 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f07d4032020 con 0x7f07d81300a0 2023-09-30T22:24:59.930 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:24:59.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.932+0000 7f07e055f700 1 -- 172.21.15.156:0/2307650910 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07d81300a0 msgr2=0x7f07d811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.932+0000 7f07e055f700 1 --2- 172.21.15.156:0/2307650910 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07d81300a0 0x7f07d811da40 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f07d4000c00 tx=0x7f07d4004750 comp rx=0 tx=0).stop 2023-09-30T22:24:59.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.932+0000 7f07e055f700 1 -- 172.21.15.156:0/2307650910 shutdown_connections 2023-09-30T22:24:59.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.932+0000 7f07e055f700 1 --2- 172.21.15.156:0/2307650910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07d8133ad0 0x7f07d811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.932+0000 7f07e055f700 1 --2- 172.21.15.156:0/2307650910 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07d81300a0 0x7f07d811da40 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.932+0000 7f07e055f700 1 --2- 172.21.15.156:0/2307650910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07d81309f0 0x7f07d811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.932+0000 7f07e055f700 1 -- 172.21.15.156:0/2307650910 >> 172.21.15.156:0/2307650910 conn(0x7f07d8099c40 msgr2=0x7f07d81320b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:59.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.932+0000 7f07e055f700 1 -- 172.21.15.156:0/2307650910 shutdown_connections 2023-09-30T22:24:59.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.932+0000 7f07e055f700 1 -- 172.21.15.156:0/2307650910 wait complete. 2023-09-30T22:24:59.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:24:59.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.960+0000 7f2b5fd73700 1 -- 172.21.15.156:0/2427683169 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2b40005590 con 0x7f2b5809f180 2023-09-30T22:24:59.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.960+0000 7f2b4e7fc700 1 -- 172.21.15.156:0/2427683169 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2b48015030 con 0x7f2b5809f180 2023-09-30T22:24:59.961 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:24:59.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.962+0000 7f2b5fd73700 1 -- 172.21.15.156:0/2427683169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b5809f180 msgr2=0x7f2b58123410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.962+0000 7f2b5fd73700 1 --2- 172.21.15.156:0/2427683169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b5809f180 0x7f2b58123410 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f2b48009c40 tx=0x7f2b48004750 comp rx=0 tx=0).stop 2023-09-30T22:24:59.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.962+0000 7f2b5fd73700 1 -- 172.21.15.156:0/2427683169 shutdown_connections 2023-09-30T22:24:59.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.962+0000 7f2b5fd73700 1 --2- 172.21.15.156:0/2427683169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b58131d70 0x7f2b58123950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.962+0000 7f2b5fd73700 1 --2- 172.21.15.156:0/2427683169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b5809e870 0x7f2b58122ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.962+0000 7f2b5fd73700 1 --2- 172.21.15.156:0/2427683169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b5809f180 0x7f2b58123410 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.962+0000 7f2b5fd73700 1 -- 172.21.15.156:0/2427683169 >> 172.21.15.156:0/2427683169 conn(0x7f2b580a4430 msgr2=0x7f2b58130ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:59.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.962+0000 7f2b5fd73700 1 -- 172.21.15.156:0/2427683169 shutdown_connections 2023-09-30T22:24:59.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:24:59.962+0000 7f2b5fd73700 1 -- 172.21.15.156:0/2427683169 wait complete. 2023-09-30T22:24:59.974 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:00.863 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:00.904 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:00.945 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:00.975 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:01.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.004+0000 7f72e5099700 1 Processor -- start 2023-09-30T22:25:01.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.004+0000 7f72e5099700 1 -- start start 2023-09-30T22:25:01.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.005+0000 7f72e5099700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72e0133ad0 0x7f72e0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.005+0000 7f72e5099700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f72e01300a0 0x7f72e01304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.005+0000 7f72e5099700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72e01309f0 0x7f72e013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.005+0000 7f72e5099700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e006b2d0 con 0x7f72e01300a0 2023-09-30T22:25:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.005+0000 7f72e5099700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e0133610 con 0x7f72e0133ad0 2023-09-30T22:25:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.005+0000 7f72e5099700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72e009a500 con 0x7f72e01309f0 2023-09-30T22:25:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.005+0000 7f72df59e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72e01309f0 0x7f72e013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.005+0000 7f72df59e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72e01309f0 0x7f72e013a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:37112/0 (socket says 172.21.15.156:37112) 2023-09-30T22:25:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.005+0000 7f72df59e700 1 -- 172.21.15.156:0/2274398547 learned_addr learned my addr 172.21.15.156:0/2274398547 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.005+0000 7f72df59e700 1 -- 172.21.15.156:0/2274398547 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72e0133ad0 msgr2=0x7f72e0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.005+0000 7f72df59e700 1 --2- 172.21.15.156:0/2274398547 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72e0133ad0 0x7f72e0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.005+0000 7f72df59e700 1 -- 172.21.15.156:0/2274398547 >> v2:172.21.15.156:3300/0 conn(0x7f72e01300a0 msgr2=0x7f72e01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:01.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.005+0000 7f72df59e700 1 --2- 172.21.15.156:0/2274398547 >> v2:172.21.15.156:3300/0 conn(0x7f72e01300a0 0x7f72e01304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.005+0000 7f72df59e700 1 -- 172.21.15.156:0/2274398547 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e01338b0 con 0x7f72e01309f0 2023-09-30T22:25:01.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.005+0000 7f72df59e700 1 --2- 172.21.15.156:0/2274398547 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72e01309f0 0x7f72e013a980 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009e50 tx=0x7f72d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2314dfd5d2939b7f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:01.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.006+0000 7f72ddd9b700 1 -- 172.21.15.156:0/2274398547 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d800e070 con 0x7f72e01309f0 2023-09-30T22:25:01.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.006+0000 7f72ddd9b700 1 -- 172.21.15.156:0/2274398547 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d800b9c0 con 0x7f72e01309f0 2023-09-30T22:25:01.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.006+0000 7f72ddd9b700 1 -- 172.21.15.156:0/2274398547 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d800bd50 con 0x7f72e01309f0 2023-09-30T22:25:01.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.006+0000 7f72e5099700 1 -- 172.21.15.156:0/2274398547 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72e01309f0 msgr2=0x7f72e013a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.006+0000 7f72e5099700 1 --2- 172.21.15.156:0/2274398547 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72e01309f0 0x7f72e013a980 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009e50 tx=0x7f72d800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:01.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.007+0000 7f72e5099700 1 -- 172.21.15.156:0/2274398547 shutdown_connections 2023-09-30T22:25:01.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.007+0000 7f72e5099700 1 --2- 172.21.15.156:0/2274398547 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72e01309f0 0x7f72e013a980 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.007+0000 7f72e5099700 1 --2- 172.21.15.156:0/2274398547 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72e0133ad0 0x7f72e0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.007+0000 7f72e5099700 1 --2- 172.21.15.156:0/2274398547 >> v2:172.21.15.156:3300/0 conn(0x7f72e01300a0 0x7f72e01304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.007+0000 7f72e5099700 1 -- 172.21.15.156:0/2274398547 >> 172.21.15.156:0/2274398547 conn(0x7f72e0099c40 msgr2=0x7f72e00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:01.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.007+0000 7f72e5099700 1 -- 172.21.15.156:0/2274398547 shutdown_connections 2023-09-30T22:25:01.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.007+0000 7f72e5099700 1 -- 172.21.15.156:0/2274398547 wait complete. 2023-09-30T22:25:01.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.008+0000 7f72e5099700 1 Processor -- start 2023-09-30T22:25:01.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.008+0000 7f72e5099700 1 -- start start 2023-09-30T22:25:01.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.009+0000 7f72e5099700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72e01300a0 0x7f72e011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.009+0000 7f72e5099700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72e01309f0 0x7f72e011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.009+0000 7f72e5099700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72e0133ad0 0x7f72e011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.009+0000 7f72e5099700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e0120290 con 0x7f72e01300a0 2023-09-30T22:25:01.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.009+0000 7f72e5099700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e0072290 con 0x7f72e0133ad0 2023-09-30T22:25:01.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.009+0000 7f72e5099700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72e0120b90 con 0x7f72e01309f0 2023-09-30T22:25:01.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.009+0000 7f72df59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72e0133ad0 0x7f72e011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.009+0000 7f72df59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72e0133ad0 0x7f72e011e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44724/0 (socket says 172.21.15.156:44724) 2023-09-30T22:25:01.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.009+0000 7f72df59e700 1 -- 172.21.15.156:0/751183774 learned_addr learned my addr 172.21.15.156:0/751183774 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:01.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.009+0000 7f72de59c700 1 --2- 172.21.15.156:0/751183774 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72e01309f0 0x7f72e011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.009+0000 7f72df59e700 1 -- 172.21.15.156:0/751183774 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72e01309f0 msgr2=0x7f72e011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.009+0000 7f72df59e700 1 --2- 172.21.15.156:0/751183774 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72e01309f0 0x7f72e011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.009+0000 7f72df59e700 1 -- 172.21.15.156:0/751183774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72e01300a0 msgr2=0x7f72e011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.009+0000 7f72df59e700 1 --2- 172.21.15.156:0/751183774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72e01300a0 0x7f72e011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.009+0000 7f72df59e700 1 -- 172.21.15.156:0/751183774 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d8009b30 con 0x7f72e0133ad0 2023-09-30T22:25:01.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.009+0000 7f72de59c700 1 --2- 172.21.15.156:0/751183774 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72e01309f0 0x7f72e011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:01.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.010+0000 7f72df59e700 1 --2- 172.21.15.156:0/751183774 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72e0133ad0 0x7f72e011e4c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f72e009a640 tx=0x7f72d8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:01.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.010+0000 7f72c77fe700 1 -- 172.21.15.156:0/751183774 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d8004250 con 0x7f72e0133ad0 2023-09-30T22:25:01.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.010+0000 7f72c77fe700 1 -- 172.21.15.156:0/751183774 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d80043b0 con 0x7f72e0133ad0 2023-09-30T22:25:01.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.010+0000 7f72c77fe700 1 -- 172.21.15.156:0/751183774 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d8004740 con 0x7f72e0133ad0 2023-09-30T22:25:01.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.010+0000 7f72e5099700 1 -- 172.21.15.156:0/751183774 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e009a150 con 0x7f72e0133ad0 2023-09-30T22:25:01.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.010+0000 7f72e5099700 1 -- 172.21.15.156:0/751183774 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e012dd60 con 0x7f72e0133ad0 2023-09-30T22:25:01.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.011+0000 7f72c77fe700 1 -- 172.21.15.156:0/751183774 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f72d801c440 con 0x7f72e0133ad0 2023-09-30T22:25:01.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.011+0000 7f72e5099700 1 -- 172.21.15.156:0/751183774 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e004f2a0 con 0x7f72e0133ad0 2023-09-30T22:25:01.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.011+0000 7f72c77fe700 1 -- 172.21.15.156:0/751183774 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f72d8040ec0 con 0x7f72e0133ad0 2023-09-30T22:25:01.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.020+0000 7f72c77fe700 1 -- 172.21.15.156:0/751183774 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f72d8011390 con 0x7f72e0133ad0 2023-09-30T22:25:01.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.045+0000 7f8d090e7700 1 Processor -- start 2023-09-30T22:25:01.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.045+0000 7f8d090e7700 1 -- start start 2023-09-30T22:25:01.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.045+0000 7f8d090e7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d040a0a30 0x7f8d040a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.045+0000 7f8d090e7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8d04130670 0x7f8d041381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.046+0000 7f8d090e7700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d040a1e70 con 0x7f8d040a1340 2023-09-30T22:25:01.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.046+0000 7f8d090e7700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d0409a720 con 0x7f8d04130670 2023-09-30T22:25:01.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.046+0000 7f8d090e7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0409b300 con 0x7f8d040a0a30 2023-09-30T22:25:01.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.046+0000 7f8d02d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d040a0a30 0x7f8d040a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.046+0000 7f8d0359e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8d04130670 0x7f8d041381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.046+0000 7f8d02d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d040a0a30 0x7f8d040a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:37128/0 (socket says 172.21.15.156:37128) 2023-09-30T22:25:01.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.046+0000 7f8d02d9d700 1 -- 172.21.15.156:0/2273148406 learned_addr learned my addr 172.21.15.156:0/2273148406 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:01.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.046+0000 7f8d02d9d700 1 -- 172.21.15.156:0/2273148406 >> v2:172.21.15.156:3300/0 conn(0x7f8d04130670 msgr2=0x7f8d041381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:01.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.046+0000 7f8d02d9d700 1 --2- 172.21.15.156:0/2273148406 >> v2:172.21.15.156:3300/0 conn(0x7f8d04130670 0x7f8d041381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.046+0000 7f8d02d9d700 1 -- 172.21.15.156:0/2273148406 >> v1:172.21.15.156:6789/0 conn(0x7f8d040a1340 legacy=0x7f8d0412ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.046+0000 7f8d02d9d700 1 -- 172.21.15.156:0/2273148406 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0409abc0 con 0x7f8d040a0a30 2023-09-30T22:25:01.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.046+0000 7f8d01d9b700 1 -- 172.21.15.156:0/2273148406 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3935861892 0 0) 0x7f8d040a1e70 con 0x7f8d040a1340 2023-09-30T22:25:01.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.046+0000 7f8d02d9d700 1 --2- 172.21.15.156:0/2273148406 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d040a0a30 0x7f8d040a0e00 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4006fd0 tx=0x7f8cf4009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e01b09fa9defc9ec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:01.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.047+0000 7f8d01d9b700 1 -- 172.21.15.156:0/2273148406 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4005e30 con 0x7f8d040a0a30 2023-09-30T22:25:01.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.047+0000 7f8d01d9b700 1 -- 172.21.15.156:0/2273148406 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf4004030 con 0x7f8d040a0a30 2023-09-30T22:25:01.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.047+0000 7f8d01d9b700 1 -- 172.21.15.156:0/2273148406 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf40043e0 con 0x7f8d040a0a30 2023-09-30T22:25:01.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.047+0000 7f8d090e7700 1 -- 172.21.15.156:0/2273148406 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d040a0a30 msgr2=0x7f8d040a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.047+0000 7f8d090e7700 1 --2- 172.21.15.156:0/2273148406 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d040a0a30 0x7f8d040a0e00 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4006fd0 tx=0x7f8cf4009bd0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.047+0000 7f8d090e7700 1 -- 172.21.15.156:0/2273148406 shutdown_connections 2023-09-30T22:25:01.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.047+0000 7f8d090e7700 1 --2- 172.21.15.156:0/2273148406 >> v2:172.21.15.156:3300/0 conn(0x7f8d04130670 0x7f8d041381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.047+0000 7f8d090e7700 1 --2- 172.21.15.156:0/2273148406 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d040a0a30 0x7f8d040a0e00 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.047+0000 7f8d090e7700 1 -- 172.21.15.156:0/2273148406 >> 172.21.15.156:0/2273148406 conn(0x7f8d040a2980 msgr2=0x7f8d040a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:01.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.047+0000 7f8d090e7700 1 -- 172.21.15.156:0/2273148406 shutdown_connections 2023-09-30T22:25:01.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.047+0000 7f8d090e7700 1 -- 172.21.15.156:0/2273148406 wait complete. 2023-09-30T22:25:01.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.049+0000 7f8d090e7700 1 Processor -- start 2023-09-30T22:25:01.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.049+0000 7f8d090e7700 1 -- start start 2023-09-30T22:25:01.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.049+0000 7f8d090e7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d040a0a30 0x7f8d041c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.049+0000 7f8d090e7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d040a1340 0x7f8d041c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.049+0000 7f8d090e7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d04130670 0x7f8d041c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.049+0000 7f8d090e7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d04120b10 con 0x7f8d040a1340 2023-09-30T22:25:01.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.049+0000 7f8d090e7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0409fb40 con 0x7f8d040a0a30 2023-09-30T22:25:01.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.049+0000 7f8d090e7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0409ae00 con 0x7f8d04130670 2023-09-30T22:25:01.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.049+0000 7f8d02d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d040a0a30 0x7f8d041c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.049+0000 7f8d02d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d040a0a30 0x7f8d041c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44740/0 (socket says 172.21.15.156:44740) 2023-09-30T22:25:01.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.049+0000 7f8d02d9d700 1 -- 172.21.15.156:0/384666439 learned_addr learned my addr 172.21.15.156:0/384666439 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:01.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.049+0000 7f8d0259c700 1 --2- 172.21.15.156:0/384666439 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d040a1340 0x7f8d041c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.050+0000 7f8d0359e700 1 --2- 172.21.15.156:0/384666439 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d04130670 0x7f8d041c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.050+0000 7f8d0259c700 1 -- 172.21.15.156:0/384666439 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d04130670 msgr2=0x7f8d041c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.050+0000 7f8d0259c700 1 --2- 172.21.15.156:0/384666439 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d04130670 0x7f8d041c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.050+0000 7f8d0259c700 1 -- 172.21.15.156:0/384666439 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d040a0a30 msgr2=0x7f8d041c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.050+0000 7f8d0259c700 1 --2- 172.21.15.156:0/384666439 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d040a0a30 0x7f8d041c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.050+0000 7f8d0259c700 1 -- 172.21.15.156:0/384666439 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf4009500 con 0x7f8d040a1340 2023-09-30T22:25:01.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.050+0000 7f8d02d9d700 1 --2- 172.21.15.156:0/384666439 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d040a0a30 0x7f8d041c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:01.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.050+0000 7f8d0259c700 1 --2- 172.21.15.156:0/384666439 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d040a1340 0x7f8d041c8740 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f8d040a2680 tx=0x7f8cf800c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:01.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.050+0000 7f8ceb7fe700 1 -- 172.21.15.156:0/384666439 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf80054e0 con 0x7f8d040a1340 2023-09-30T22:25:01.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.050+0000 7f8ceb7fe700 1 -- 172.21.15.156:0/384666439 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf800ce10 con 0x7f8d040a1340 2023-09-30T22:25:01.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.050+0000 7f8ceb7fe700 1 -- 172.21.15.156:0/384666439 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf80038c0 con 0x7f8d040a1340 2023-09-30T22:25:01.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.050+0000 7f8d090e7700 1 -- 172.21.15.156:0/384666439 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d0412fbc0 con 0x7f8d040a1340 2023-09-30T22:25:01.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.051+0000 7f8d090e7700 1 -- 172.21.15.156:0/384666439 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d041212a0 con 0x7f8d040a1340 2023-09-30T22:25:01.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.052+0000 7f8ceb7fe700 1 -- 172.21.15.156:0/384666439 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8cf8003a20 con 0x7f8d040a1340 2023-09-30T22:25:01.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.052+0000 7f8d090e7700 1 -- 172.21.15.156:0/384666439 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d0404f2a0 con 0x7f8d040a1340 2023-09-30T22:25:01.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.052+0000 7f8ceb7fe700 1 -- 172.21.15.156:0/384666439 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8cf8040a10 con 0x7f8d040a1340 2023-09-30T22:25:01.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.060+0000 7f8ceb7fe700 1 -- 172.21.15.156:0/384666439 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8cf8044060 con 0x7f8d040a1340 2023-09-30T22:25:01.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.090+0000 7f40525d7700 1 Processor -- start 2023-09-30T22:25:01.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.090+0000 7f40525d7700 1 -- start start 2023-09-30T22:25:01.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.090+0000 7f40525d7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f404c133900 0x7f404c133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.090+0000 7f40525d7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f404c134210 0x7f404c0a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.090+0000 7f40525d7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f404c0a0ee0 0x7f404c0a1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.090+0000 7f40525d7700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f404c09a760 con 0x7f404c0a0ee0 2023-09-30T22:25:01.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.090+0000 7f40525d7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404c1336e0 con 0x7f404c134210 2023-09-30T22:25:01.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.090+0000 7f40525d7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f404c09a080 con 0x7f404c133900 2023-09-30T22:25:01.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.090+0000 7f404bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f404c133900 0x7f404c133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.090+0000 7f404bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f404c133900 0x7f404c133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:37144/0 (socket says 172.21.15.156:37144) 2023-09-30T22:25:01.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.090+0000 7f404bfff700 1 -- 172.21.15.156:0/197415151 learned_addr learned my addr 172.21.15.156:0/197415151 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:01.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.090+0000 7f404b7fe700 1 --2- 172.21.15.156:0/197415151 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f404c134210 0x7f404c0a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.090+0000 7f4050b74700 1 --2- 172.21.15.156:0/197415151 >> v2:172.21.15.156:3300/0 conn(0x7f404c0a0ee0 0x7f404c0a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.091+0000 7f404b7fe700 1 -- 172.21.15.156:0/197415151 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f404c133900 msgr2=0x7f404c133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:01.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.091+0000 7f404b7fe700 1 --2- 172.21.15.156:0/197415151 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f404c133900 0x7f404c133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.091+0000 7f404b7fe700 1 -- 172.21.15.156:0/197415151 >> v2:172.21.15.156:3300/0 conn(0x7f404c0a0ee0 msgr2=0x7f404c0a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:01.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.091+0000 7f404b7fe700 1 --2- 172.21.15.156:0/197415151 >> v2:172.21.15.156:3300/0 conn(0x7f404c0a0ee0 0x7f404c0a1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.091+0000 7f404b7fe700 1 -- 172.21.15.156:0/197415151 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404c0a23e0 con 0x7f404c134210 2023-09-30T22:25:01.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.091+0000 7f404bfff700 1 --2- 172.21.15.156:0/197415151 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f404c133900 0x7f404c133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:01.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.091+0000 7f404b7fe700 1 --2- 172.21.15.156:0/197415151 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f404c134210 0x7f404c0a09a0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4040009840 tx=0x7f4040009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=360ecbf8b2a81bba server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:01.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.091+0000 7f404affd700 1 -- 172.21.15.156:0/197415151 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040011830 con 0x7f404c134210 2023-09-30T22:25:01.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.091+0000 7f404affd700 1 -- 172.21.15.156:0/197415151 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4040011990 con 0x7f404c134210 2023-09-30T22:25:01.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.091+0000 7f404affd700 1 -- 172.21.15.156:0/197415151 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040011d00 con 0x7f404c134210 2023-09-30T22:25:01.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.092+0000 7f40525d7700 1 -- 172.21.15.156:0/197415151 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f404c134210 msgr2=0x7f404c0a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.092+0000 7f40525d7700 1 --2- 172.21.15.156:0/197415151 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f404c134210 0x7f404c0a09a0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4040009840 tx=0x7f4040009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:01.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.092+0000 7f40525d7700 1 -- 172.21.15.156:0/197415151 shutdown_connections 2023-09-30T22:25:01.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.092+0000 7f40525d7700 1 --2- 172.21.15.156:0/197415151 >> v2:172.21.15.156:3300/0 conn(0x7f404c0a0ee0 0x7f404c0a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.092+0000 7f40525d7700 1 --2- 172.21.15.156:0/197415151 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f404c133900 0x7f404c133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.092+0000 7f40525d7700 1 --2- 172.21.15.156:0/197415151 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f404c134210 0x7f404c0a09a0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.092+0000 7f40525d7700 1 -- 172.21.15.156:0/197415151 >> 172.21.15.156:0/197415151 conn(0x7f404c0a2980 msgr2=0x7f404c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:01.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.092+0000 7f40525d7700 1 -- 172.21.15.156:0/197415151 shutdown_connections 2023-09-30T22:25:01.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.092+0000 7f40525d7700 1 -- 172.21.15.156:0/197415151 wait complete. 2023-09-30T22:25:01.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.094+0000 7f40525d7700 1 Processor -- start 2023-09-30T22:25:01.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.094+0000 7f40525d7700 1 -- start start 2023-09-30T22:25:01.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.094+0000 7f40525d7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f404c0a0ee0 0x7f404c11d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.094+0000 7f40525d7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f404c133900 0x7f404c11db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.095+0000 7f40525d7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f404c134210 0x7f404c11e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.095+0000 7f40525d7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404c09c2f0 con 0x7f404c133900 2023-09-30T22:25:01.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.095+0000 7f40525d7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404c1204f0 con 0x7f404c0a0ee0 2023-09-30T22:25:01.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.095+0000 7f40525d7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f404c09a2c0 con 0x7f404c134210 2023-09-30T22:25:01.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.095+0000 7f404b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f404c133900 0x7f404c11db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.095+0000 7f4050b74700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f404c134210 0x7f404c11e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.095+0000 7f404b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f404c133900 0x7f404c11db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47636/0 (socket says 172.21.15.156:47636) 2023-09-30T22:25:01.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.095+0000 7f404b7fe700 1 -- 172.21.15.156:0/4197615309 learned_addr learned my addr 172.21.15.156:0/4197615309 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:01.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.095+0000 7f404bfff700 1 --2- 172.21.15.156:0/4197615309 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f404c0a0ee0 0x7f404c11d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.095+0000 7f4050b74700 1 -- 172.21.15.156:0/4197615309 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f404c0a0ee0 msgr2=0x7f404c11d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.095+0000 7f4050b74700 1 --2- 172.21.15.156:0/4197615309 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f404c0a0ee0 0x7f404c11d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.095+0000 7f4050b74700 1 -- 172.21.15.156:0/4197615309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f404c133900 msgr2=0x7f404c11db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.095+0000 7f4050b74700 1 --2- 172.21.15.156:0/4197615309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f404c133900 0x7f404c11db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.095+0000 7f4050b74700 1 -- 172.21.15.156:0/4197615309 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f403c009500 con 0x7f404c134210 2023-09-30T22:25:01.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.095+0000 7f404b7fe700 1 --2- 172.21.15.156:0/4197615309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f404c133900 0x7f404c11db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:01.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.095+0000 7f4050b74700 1 --2- 172.21.15.156:0/4197615309 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f404c134210 0x7f404c11e0a0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f404400efc0 tx=0x7f404400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:01.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.096+0000 7f4048ff9700 1 -- 172.21.15.156:0/4197615309 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404400cc90 con 0x7f404c134210 2023-09-30T22:25:01.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.096+0000 7f4048ff9700 1 -- 172.21.15.156:0/4197615309 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404400f040 con 0x7f404c134210 2023-09-30T22:25:01.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.096+0000 7f40525d7700 1 -- 172.21.15.156:0/4197615309 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40400094a0 con 0x7f404c134210 2023-09-30T22:25:01.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.096+0000 7f4048ff9700 1 -- 172.21.15.156:0/4197615309 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40440146c0 con 0x7f404c134210 2023-09-30T22:25:01.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.096+0000 7f40525d7700 1 -- 172.21.15.156:0/4197615309 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f404c120030 con 0x7f404c134210 2023-09-30T22:25:01.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.097+0000 7f40525d7700 1 -- 172.21.15.156:0/4197615309 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f404c11a590 con 0x7f404c134210 2023-09-30T22:25:01.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.097+0000 7f4048ff9700 1 -- 172.21.15.156:0/4197615309 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4044014820 con 0x7f404c134210 2023-09-30T22:25:01.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.101+0000 7f4048ff9700 1 -- 172.21.15.156:0/4197615309 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f40440265c0 con 0x7f404c134210 2023-09-30T22:25:01.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.102+0000 7f4048ff9700 1 -- 172.21.15.156:0/4197615309 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4044014ad0 con 0x7f404c134210 2023-09-30T22:25:01.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.127+0000 7fdc16122700 1 Processor -- start 2023-09-30T22:25:01.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.127+0000 7fdc16122700 1 -- start start 2023-09-30T22:25:01.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.127+0000 7fdc16122700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc1009e870 0x7fdc1009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.127+0000 7fdc16122700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc10131f40 0x7fdc10139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.127+0000 7fdc16122700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc1009c970 con 0x7fdc1009f180 2023-09-30T22:25:01.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.127+0000 7fdc16122700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc100a0920 con 0x7fdc10131f40 2023-09-30T22:25:01.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.127+0000 7fdc16122700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1009f9c0 con 0x7fdc1009e870 2023-09-30T22:25:01.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.128+0000 7fdc0ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc10131f40 0x7fdc10139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.128+0000 7fdc0ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc10131f40 0x7fdc10139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:44764/0 (socket says 172.21.15.156:44764) 2023-09-30T22:25:01.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.128+0000 7fdc0ffff700 1 -- 172.21.15.156:0/3544424245 learned_addr learned my addr 172.21.15.156:0/3544424245 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:01.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.128+0000 7fdc0f7fe700 1 --2- 172.21.15.156:0/3544424245 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc1009e870 0x7fdc1009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.128+0000 7fdc0ffff700 1 -- 172.21.15.156:0/3544424245 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc1009e870 msgr2=0x7fdc1009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:01.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.128+0000 7fdc0ffff700 1 --2- 172.21.15.156:0/3544424245 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc1009e870 0x7fdc1009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.128+0000 7fdc0ffff700 1 -- 172.21.15.156:0/3544424245 >> v1:172.21.15.156:6789/0 conn(0x7fdc1009f180 legacy=0x7fdc10131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:01.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.128+0000 7fdc0ffff700 1 -- 172.21.15.156:0/3544424245 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1009bab0 con 0x7fdc10131f40 2023-09-30T22:25:01.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.128+0000 7fdc0ffff700 1 --2- 172.21.15.156:0/3544424245 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc10131f40 0x7fdc10139ca0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009e80 tx=0x7fdc0800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c868cafd8e482da server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:01.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.128+0000 7fdc0e7fc700 1 -- 172.21.15.156:0/3544424245 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0800e070 con 0x7fdc10131f40 2023-09-30T22:25:01.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.128+0000 7fdc0e7fc700 1 -- 172.21.15.156:0/3544424245 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc08003a20 con 0x7fdc10131f40 2023-09-30T22:25:01.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.128+0000 7fdc0e7fc700 1 -- 172.21.15.156:0/3544424245 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc08003db0 con 0x7fdc10131f40 2023-09-30T22:25:01.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.129+0000 7fdc16122700 1 -- 172.21.15.156:0/3544424245 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc10131f40 msgr2=0x7fdc10139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.129+0000 7fdc16122700 1 --2- 172.21.15.156:0/3544424245 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc10131f40 0x7fdc10139ca0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009e80 tx=0x7fdc0800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:01.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.129+0000 7fdc16122700 1 -- 172.21.15.156:0/3544424245 shutdown_connections 2023-09-30T22:25:01.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.129+0000 7fdc16122700 1 --2- 172.21.15.156:0/3544424245 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc10131f40 0x7fdc10139ca0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.129+0000 7fdc16122700 1 --2- 172.21.15.156:0/3544424245 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc1009e870 0x7fdc1009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.129+0000 7fdc16122700 1 -- 172.21.15.156:0/3544424245 >> 172.21.15.156:0/3544424245 conn(0x7fdc100a4430 msgr2=0x7fdc100a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:01.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.129+0000 7fdc16122700 1 -- 172.21.15.156:0/3544424245 shutdown_connections 2023-09-30T22:25:01.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.129+0000 7fdc16122700 1 -- 172.21.15.156:0/3544424245 wait complete. 2023-09-30T22:25:01.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.130+0000 7fdc16122700 1 Processor -- start 2023-09-30T22:25:01.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.130+0000 7fdc16122700 1 -- start start 2023-09-30T22:25:01.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.130+0000 7fdc16122700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc1009e870 0x7fdc10120140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.131+0000 7fdc16122700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc1009f180 0x7fdc10120680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.131+0000 7fdc16122700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc10131f40 0x7fdc10120bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.131+0000 7fdc16122700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc10123a80 con 0x7fdc1009e870 2023-09-30T22:25:01.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.131+0000 7fdc16122700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc10123c60 con 0x7fdc10131f40 2023-09-30T22:25:01.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.131+0000 7fdc16122700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc10124160 con 0x7fdc1009f180 2023-09-30T22:25:01.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.131+0000 7fdc0effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc1009f180 0x7fdc10120680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.131+0000 7fdc0effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc1009f180 0x7fdc10120680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:37164/0 (socket says 172.21.15.156:37164) 2023-09-30T22:25:01.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.131+0000 7fdc0effd700 1 -- 172.21.15.156:0/2802536083 learned_addr learned my addr 172.21.15.156:0/2802536083 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:01.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.131+0000 7fdc0f7fe700 1 --2- 172.21.15.156:0/2802536083 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc1009e870 0x7fdc10120140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.131+0000 7fdc0ffff700 1 --2- 172.21.15.156:0/2802536083 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc10131f40 0x7fdc10120bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.131+0000 7fdc0ffff700 1 -- 172.21.15.156:0/2802536083 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc1009f180 msgr2=0x7fdc10120680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.131+0000 7fdc0ffff700 1 --2- 172.21.15.156:0/2802536083 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc1009f180 0x7fdc10120680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.131+0000 7fdc0ffff700 1 -- 172.21.15.156:0/2802536083 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc1009e870 msgr2=0x7fdc10120140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.131+0000 7fdc0ffff700 1 --2- 172.21.15.156:0/2802536083 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc1009e870 0x7fdc10120140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.131+0000 7fdc0ffff700 1 -- 172.21.15.156:0/2802536083 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc08009b30 con 0x7fdc10131f40 2023-09-30T22:25:01.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.131+0000 7fdc0f7fe700 1 --2- 172.21.15.156:0/2802536083 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc1009e870 0x7fdc10120140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:01.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.131+0000 7fdc0effd700 1 --2- 172.21.15.156:0/2802536083 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc1009f180 0x7fdc10120680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:01.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.131+0000 7fdc0ffff700 1 --2- 172.21.15.156:0/2802536083 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc10131f40 0x7fdc10120bc0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fdc100673f0 tx=0x7fdc08004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:01.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.131+0000 7fdbf7fff700 1 -- 172.21.15.156:0/2802536083 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc08022030 con 0x7fdc10131f40 2023-09-30T22:25:01.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.132+0000 7fdbf7fff700 1 -- 172.21.15.156:0/2802536083 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc08004240 con 0x7fdc10131f40 2023-09-30T22:25:01.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.132+0000 7fdbf7fff700 1 -- 172.21.15.156:0/2802536083 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc08004610 con 0x7fdc10131f40 2023-09-30T22:25:01.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.132+0000 7fdc16122700 1 -- 172.21.15.156:0/2802536083 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc101236c0 con 0x7fdc10131f40 2023-09-30T22:25:01.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.132+0000 7fdc16122700 1 -- 172.21.15.156:0/2802536083 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc10122ff0 con 0x7fdc10131f40 2023-09-30T22:25:01.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.133+0000 7fdc16122700 1 -- 172.21.15.156:0/2802536083 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc1011d580 con 0x7fdc10131f40 2023-09-30T22:25:01.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.133+0000 7fdbf7fff700 1 -- 172.21.15.156:0/2802536083 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc08025070 con 0x7fdc10131f40 2023-09-30T22:25:01.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.134+0000 7fdbf7fff700 1 -- 172.21.15.156:0/2802536083 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdc08023070 con 0x7fdc10131f40 2023-09-30T22:25:01.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.142+0000 7fdbf7fff700 1 -- 172.21.15.156:0/2802536083 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc08030db0 con 0x7fdc10131f40 2023-09-30T22:25:01.223 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.223+0000 7f72e5099700 1 -- 172.21.15.156:0/751183774 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f72e00a3470 con 0x7f72e0133ad0 2023-09-30T22:25:01.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.223+0000 7f72c77fe700 1 -- 172.21.15.156:0/751183774 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f72d801bb50 con 0x7f72e0133ad0 2023-09-30T22:25:01.224 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:01.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.225+0000 7f72e5099700 1 -- 172.21.15.156:0/751183774 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72e0133ad0 msgr2=0x7f72e011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.225+0000 7f72e5099700 1 --2- 172.21.15.156:0/751183774 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72e0133ad0 0x7f72e011e4c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f72e009a640 tx=0x7f72d8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.225+0000 7f72e5099700 1 -- 172.21.15.156:0/751183774 shutdown_connections 2023-09-30T22:25:01.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.225+0000 7f72e5099700 1 --2- 172.21.15.156:0/751183774 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f72e0133ad0 0x7f72e011e4c0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.225+0000 7f72e5099700 1 --2- 172.21.15.156:0/751183774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72e01300a0 0x7f72e011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.225+0000 7f72e5099700 1 --2- 172.21.15.156:0/751183774 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72e01309f0 0x7f72e011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.225+0000 7f72e5099700 1 -- 172.21.15.156:0/751183774 >> 172.21.15.156:0/751183774 conn(0x7f72e0099c40 msgr2=0x7f72e012e560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:01.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.225+0000 7f72e5099700 1 -- 172.21.15.156:0/751183774 shutdown_connections 2023-09-30T22:25:01.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.225+0000 7f72e5099700 1 -- 172.21.15.156:0/751183774 wait complete. 2023-09-30T22:25:01.239 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:01.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.259+0000 7f8d090e7700 1 -- 172.21.15.156:0/384666439 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8d0406bce0 con 0x7f8d040a1340 2023-09-30T22:25:01.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.259+0000 7f8ceb7fe700 1 -- 172.21.15.156:0/384666439 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8cf8017020 con 0x7f8d040a1340 2023-09-30T22:25:01.260 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:01.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.261+0000 7f8d090e7700 1 -- 172.21.15.156:0/384666439 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d040a1340 msgr2=0x7f8d041c8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.261+0000 7f8d090e7700 1 --2- 172.21.15.156:0/384666439 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d040a1340 0x7f8d041c8740 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f8d040a2680 tx=0x7f8cf800c710 comp rx=0 tx=0).stop 2023-09-30T22:25:01.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.261+0000 7f8d090e7700 1 -- 172.21.15.156:0/384666439 shutdown_connections 2023-09-30T22:25:01.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.261+0000 7f8d090e7700 1 --2- 172.21.15.156:0/384666439 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8d04130670 0x7f8d041c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.261+0000 7f8d090e7700 1 --2- 172.21.15.156:0/384666439 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8d040a0a30 0x7f8d041c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.261+0000 7f8d090e7700 1 --2- 172.21.15.156:0/384666439 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d040a1340 0x7f8d041c8740 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.261+0000 7f8d090e7700 1 -- 172.21.15.156:0/384666439 >> 172.21.15.156:0/384666439 conn(0x7f8d040a2980 msgr2=0x7f8d041b9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:01.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.261+0000 7f8d090e7700 1 -- 172.21.15.156:0/384666439 shutdown_connections 2023-09-30T22:25:01.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.261+0000 7f8d090e7700 1 -- 172.21.15.156:0/384666439 wait complete. 2023-09-30T22:25:01.274 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:01.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.303+0000 7f40525d7700 1 -- 172.21.15.156:0/4197615309 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f404c04f2a0 con 0x7f404c134210 2023-09-30T22:25:01.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.304+0000 7f4048ff9700 1 -- 172.21.15.156:0/4197615309 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f40440263e0 con 0x7f404c134210 2023-09-30T22:25:01.304 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:01.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.306+0000 7f40525d7700 1 -- 172.21.15.156:0/4197615309 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f404c134210 msgr2=0x7f404c11e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.306+0000 7f40525d7700 1 --2- 172.21.15.156:0/4197615309 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f404c134210 0x7f404c11e0a0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f404400efc0 tx=0x7f404400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.306+0000 7f40525d7700 1 -- 172.21.15.156:0/4197615309 shutdown_connections 2023-09-30T22:25:01.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.306+0000 7f40525d7700 1 --2- 172.21.15.156:0/4197615309 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f404c134210 0x7f404c11e0a0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.306+0000 7f40525d7700 1 --2- 172.21.15.156:0/4197615309 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f404c0a0ee0 0x7f404c11d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.306+0000 7f40525d7700 1 --2- 172.21.15.156:0/4197615309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f404c133900 0x7f404c11db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.306+0000 7f40525d7700 1 -- 172.21.15.156:0/4197615309 >> 172.21.15.156:0/4197615309 conn(0x7f404c0a2980 msgr2=0x7f404c1baca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:01.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.306+0000 7f40525d7700 1 -- 172.21.15.156:0/4197615309 shutdown_connections 2023-09-30T22:25:01.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.306+0000 7f40525d7700 1 -- 172.21.15.156:0/4197615309 wait complete. 2023-09-30T22:25:01.318 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:01.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.337+0000 7fdc16122700 1 -- 172.21.15.156:0/2802536083 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdc10121db0 con 0x7fdc10131f40 2023-09-30T22:25:01.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.338+0000 7fdbf7fff700 1 -- 172.21.15.156:0/2802536083 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdc08017020 con 0x7fdc10131f40 2023-09-30T22:25:01.338 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:01.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.340+0000 7fdc16122700 1 -- 172.21.15.156:0/2802536083 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc10131f40 msgr2=0x7fdc10120bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.340+0000 7fdc16122700 1 --2- 172.21.15.156:0/2802536083 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc10131f40 0x7fdc10120bc0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fdc100673f0 tx=0x7fdc08004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.340+0000 7fdc16122700 1 -- 172.21.15.156:0/2802536083 shutdown_connections 2023-09-30T22:25:01.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.340+0000 7fdc16122700 1 --2- 172.21.15.156:0/2802536083 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc10131f40 0x7fdc10120bc0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.340+0000 7fdc16122700 1 --2- 172.21.15.156:0/2802536083 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc1009e870 0x7fdc10120140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.340+0000 7fdc16122700 1 --2- 172.21.15.156:0/2802536083 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc1009f180 0x7fdc10120680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.340+0000 7fdc16122700 1 -- 172.21.15.156:0/2802536083 >> 172.21.15.156:0/2802536083 conn(0x7fdc100a4430 msgr2=0x7fdc1011a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:01.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.340+0000 7fdc16122700 1 -- 172.21.15.156:0/2802536083 shutdown_connections 2023-09-30T22:25:01.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:01.340+0000 7fdc16122700 1 -- 172.21.15.156:0/2802536083 wait complete. 2023-09-30T22:25:01.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:02.240 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:02.274 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:02.319 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:02.353 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:02.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.383+0000 7f16760ce700 1 Processor -- start 2023-09-30T22:25:02.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.383+0000 7f16760ce700 1 -- start start 2023-09-30T22:25:02.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.383+0000 7f16760ce700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1670133ad0 0x7f1670133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.383+0000 7f16760ce700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16701300a0 0x7f16701304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.383+0000 7f16760ce700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f167006b2d0 con 0x7f16701309f0 2023-09-30T22:25:02.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.383+0000 7f16760ce700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1670133610 con 0x7f1670133ad0 2023-09-30T22:25:02.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.383+0000 7f16760ce700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167009a500 con 0x7f16701300a0 2023-09-30T22:25:02.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.383+0000 7f166effd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16701300a0 0x7f16701304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.383+0000 7f166effd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16701300a0 0x7f16701304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:50546/0 (socket says 172.21.15.156:50546) 2023-09-30T22:25:02.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.383+0000 7f166effd700 1 -- 172.21.15.156:0/3651560584 learned_addr learned my addr 172.21.15.156:0/3651560584 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:02.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.384+0000 7f166effd700 1 -- 172.21.15.156:0/3651560584 >> v2:172.21.15.156:3300/0 conn(0x7f1670133ad0 msgr2=0x7f1670133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:02.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.384+0000 7f166effd700 1 --2- 172.21.15.156:0/3651560584 >> v2:172.21.15.156:3300/0 conn(0x7f1670133ad0 0x7f1670133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.384+0000 7f166effd700 1 -- 172.21.15.156:0/3651560584 >> v1:172.21.15.156:6789/0 conn(0x7f16701309f0 legacy=0x7f167013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:02.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.384+0000 7f166effd700 1 -- 172.21.15.156:0/3651560584 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16701338b0 con 0x7f16701300a0 2023-09-30T22:25:02.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.384+0000 7f166effd700 1 --2- 172.21.15.156:0/3651560584 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16701300a0 0x7f16701304b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f16640098f0 tx=0x7f1664009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fe903d5f6540d6e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:02.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.384+0000 7f166e7fc700 1 -- 172.21.15.156:0/3651560584 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1664004230 con 0x7f16701300a0 2023-09-30T22:25:02.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.384+0000 7f166e7fc700 1 -- 172.21.15.156:0/3651560584 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1664004390 con 0x7f16701300a0 2023-09-30T22:25:02.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.384+0000 7f166e7fc700 1 -- 172.21.15.156:0/3651560584 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16640036a0 con 0x7f16701300a0 2023-09-30T22:25:02.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.385+0000 7f16760ce700 1 -- 172.21.15.156:0/3651560584 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16701300a0 msgr2=0x7f16701304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.385+0000 7f16760ce700 1 --2- 172.21.15.156:0/3651560584 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16701300a0 0x7f16701304b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f16640098f0 tx=0x7f1664009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:02.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.385+0000 7f16760ce700 1 -- 172.21.15.156:0/3651560584 shutdown_connections 2023-09-30T22:25:02.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.385+0000 7f16760ce700 1 --2- 172.21.15.156:0/3651560584 >> v2:172.21.15.156:3300/0 conn(0x7f1670133ad0 0x7f1670133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.385+0000 7f16760ce700 1 --2- 172.21.15.156:0/3651560584 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16701300a0 0x7f16701304b0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.385+0000 7f16760ce700 1 -- 172.21.15.156:0/3651560584 >> 172.21.15.156:0/3651560584 conn(0x7f1670099c40 msgr2=0x7f16700a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:02.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.386+0000 7f16760ce700 1 -- 172.21.15.156:0/3651560584 shutdown_connections 2023-09-30T22:25:02.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.386+0000 7f16760ce700 1 -- 172.21.15.156:0/3651560584 wait complete. 2023-09-30T22:25:02.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.387+0000 7f16760ce700 1 Processor -- start 2023-09-30T22:25:02.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.387+0000 7f16760ce700 1 -- start start 2023-09-30T22:25:02.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.387+0000 7f16760ce700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16701300a0 0x7f167011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.387+0000 7f16760ce700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16701309f0 0x7f167011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.387+0000 7f16760ce700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1670133ad0 0x7f167011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.387+0000 7f16760ce700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167011f9a0 con 0x7f1670133ad0 2023-09-30T22:25:02.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.387+0000 7f16760ce700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167012d3b0 con 0x7f16701300a0 2023-09-30T22:25:02.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.387+0000 7f16760ce700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1670120c70 con 0x7f16701309f0 2023-09-30T22:25:02.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.387+0000 7f166f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16701300a0 0x7f167011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.388+0000 7f166f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16701300a0 0x7f167011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:50548/0 (socket says 172.21.15.156:50548) 2023-09-30T22:25:02.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.388+0000 7f166f7fe700 1 -- 172.21.15.156:0/2837229047 learned_addr learned my addr 172.21.15.156:0/2837229047 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:02.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.388+0000 7f166ffff700 1 --2- 172.21.15.156:0/2837229047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1670133ad0 0x7f167011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.388+0000 7f166ffff700 1 -- 172.21.15.156:0/2837229047 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16701309f0 msgr2=0x7f167011df80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:02.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.388+0000 7f166ffff700 1 --2- 172.21.15.156:0/2837229047 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16701309f0 0x7f167011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.388+0000 7f166ffff700 1 -- 172.21.15.156:0/2837229047 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16701300a0 msgr2=0x7f167011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.388+0000 7f166ffff700 1 --2- 172.21.15.156:0/2837229047 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16701300a0 0x7f167011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.388+0000 7f166ffff700 1 -- 172.21.15.156:0/2837229047 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1664009550 con 0x7f1670133ad0 2023-09-30T22:25:02.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.388+0000 7f166f7fe700 1 --2- 172.21.15.156:0/2837229047 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16701300a0 0x7f167011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:02.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.388+0000 7f166ffff700 1 --2- 172.21.15.156:0/2837229047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1670133ad0 0x7f167011e4c0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f166800be50 tx=0x7f1668009ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:02.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.388+0000 7f1657fff700 1 -- 172.21.15.156:0/2837229047 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166800cc90 con 0x7f1670133ad0 2023-09-30T22:25:02.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.388+0000 7f1657fff700 1 -- 172.21.15.156:0/2837229047 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166800ce30 con 0x7f1670133ad0 2023-09-30T22:25:02.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.388+0000 7f16760ce700 1 -- 172.21.15.156:0/2837229047 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16700a2ea0 con 0x7f1670133ad0 2023-09-30T22:25:02.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.388+0000 7f1657fff700 1 -- 172.21.15.156:0/2837229047 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1668014680 con 0x7f1670133ad0 2023-09-30T22:25:02.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.389+0000 7f16760ce700 1 -- 172.21.15.156:0/2837229047 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f167012dd50 con 0x7f1670133ad0 2023-09-30T22:25:02.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.389+0000 7f1657fff700 1 -- 172.21.15.156:0/2837229047 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1668006d50 con 0x7f1670133ad0 2023-09-30T22:25:02.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.390+0000 7f1657fff700 1 -- 172.21.15.156:0/2837229047 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f166803f340 con 0x7f1670133ad0 2023-09-30T22:25:02.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.392+0000 7f16760ce700 1 -- 172.21.15.156:0/2837229047 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1670071a10 con 0x7f1670133ad0 2023-09-30T22:25:02.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.397+0000 7f1657fff700 1 -- 172.21.15.156:0/2837229047 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f166801d3b0 con 0x7f1670133ad0 2023-09-30T22:25:02.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.420+0000 7f13e612a700 1 Processor -- start 2023-09-30T22:25:02.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.422+0000 7f13e612a700 1 -- start start 2023-09-30T22:25:02.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.422+0000 7f13e612a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f13e0133b80 0x7f13e0133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.422+0000 7f13e612a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13e0099a60 0x7f13e00a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.422+0000 7f13e612a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13e00a0e20 0x7f13e00a1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.422+0000 7f13e612a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e009aa00 con 0x7f13e0133b80 2023-09-30T22:25:02.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.422+0000 7f13e612a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e009a080 con 0x7f13e0099a60 2023-09-30T22:25:02.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.422+0000 7f13e612a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13e0133750 con 0x7f13e00a0e20 2023-09-30T22:25:02.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.422+0000 7f13df7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f13e0133b80 0x7f13e0133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.422+0000 7f13df7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f13e0133b80 0x7f13e0133f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33040/0 (socket says 172.21.15.156:33040) 2023-09-30T22:25:02.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.422+0000 7f13df7fe700 1 -- 172.21.15.156:0/838336604 learned_addr learned my addr 172.21.15.156:0/838336604 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:02.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.422+0000 7f13deffd700 1 --2- 172.21.15.156:0/838336604 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13e0099a60 0x7f13e00a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.422+0000 7f13dffff700 1 --2- 172.21.15.156:0/838336604 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13e00a0e20 0x7f13e00a1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.422+0000 7f13deffd700 1 -- 172.21.15.156:0/838336604 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13e00a0e20 msgr2=0x7f13e00a1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:02.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.422+0000 7f13deffd700 1 --2- 172.21.15.156:0/838336604 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13e00a0e20 0x7f13e00a1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.422+0000 7f13deffd700 1 -- 172.21.15.156:0/838336604 >> v2:172.21.15.156:3300/0 conn(0x7f13e0133b80 msgr2=0x7f13e0133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:02.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.422+0000 7f13deffd700 1 --2- 172.21.15.156:0/838336604 >> v2:172.21.15.156:3300/0 conn(0x7f13e0133b80 0x7f13e0133f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.422+0000 7f13deffd700 1 -- 172.21.15.156:0/838336604 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e009a760 con 0x7f13e0099a60 2023-09-30T22:25:02.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.422+0000 7f13df7fe700 1 --2- 172.21.15.156:0/838336604 >> v2:172.21.15.156:3300/0 conn(0x7f13e0133b80 0x7f13e0133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:02.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.422+0000 7f13deffd700 1 --2- 172.21.15.156:0/838336604 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13e0099a60 0x7f13e00a08e0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009840 tx=0x7f13d4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea6a14088aede68b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:02.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.422+0000 7f13de7fc700 1 -- 172.21.15.156:0/838336604 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d4011830 con 0x7f13e0099a60 2023-09-30T22:25:02.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.422+0000 7f13de7fc700 1 -- 172.21.15.156:0/838336604 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d4011990 con 0x7f13e0099a60 2023-09-30T22:25:02.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.422+0000 7f13de7fc700 1 -- 172.21.15.156:0/838336604 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d4011d20 con 0x7f13e0099a60 2023-09-30T22:25:02.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.423+0000 7f13e612a700 1 -- 172.21.15.156:0/838336604 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13e0099a60 msgr2=0x7f13e00a08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.423+0000 7f13e612a700 1 --2- 172.21.15.156:0/838336604 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13e0099a60 0x7f13e00a08e0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009840 tx=0x7f13d4009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:02.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.423+0000 7f13e612a700 1 -- 172.21.15.156:0/838336604 shutdown_connections 2023-09-30T22:25:02.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.423+0000 7f13e612a700 1 --2- 172.21.15.156:0/838336604 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13e00a0e20 0x7f13e00a1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.423+0000 7f13e612a700 1 --2- 172.21.15.156:0/838336604 >> v2:172.21.15.156:3300/0 conn(0x7f13e0133b80 0x7f13e0133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.423+0000 7f13e612a700 1 --2- 172.21.15.156:0/838336604 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13e0099a60 0x7f13e00a08e0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.424+0000 7f13e612a700 1 -- 172.21.15.156:0/838336604 >> 172.21.15.156:0/838336604 conn(0x7f13e00a2980 msgr2=0x7f13e00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:02.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.424+0000 7f13e612a700 1 -- 172.21.15.156:0/838336604 shutdown_connections 2023-09-30T22:25:02.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.424+0000 7f13e612a700 1 -- 172.21.15.156:0/838336604 wait complete. 2023-09-30T22:25:02.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.426+0000 7f13e612a700 1 Processor -- start 2023-09-30T22:25:02.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.426+0000 7f13e612a700 1 -- start start 2023-09-30T22:25:02.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.427+0000 7f13e612a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13e0099a60 0x7f13e011c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.427+0000 7f13e612a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13e00a0e20 0x7f13e011ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.427+0000 7f13e612a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13e0133b80 0x7f13e011d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.427+0000 7f13e612a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e011ddd0 con 0x7f13e0099a60 2023-09-30T22:25:02.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.427+0000 7f13e612a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e012fcf0 con 0x7f13e00a0e20 2023-09-30T22:25:02.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.427+0000 7f13e612a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13e011f760 con 0x7f13e0133b80 2023-09-30T22:25:02.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.427+0000 7f13deffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13e00a0e20 0x7f13e011ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.427+0000 7f13deffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13e00a0e20 0x7f13e011ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:50568/0 (socket says 172.21.15.156:50568) 2023-09-30T22:25:02.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.427+0000 7f13deffd700 1 -- 172.21.15.156:0/514704695 learned_addr learned my addr 172.21.15.156:0/514704695 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:02.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.427+0000 7f13dffff700 1 --2- 172.21.15.156:0/514704695 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13e0133b80 0x7f13e011d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.427+0000 7f13df7fe700 1 --2- 172.21.15.156:0/514704695 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13e0099a60 0x7f13e011c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.427+0000 7f13deffd700 1 -- 172.21.15.156:0/514704695 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13e0133b80 msgr2=0x7f13e011d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.428+0000 7f13deffd700 1 --2- 172.21.15.156:0/514704695 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13e0133b80 0x7f13e011d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.428+0000 7f13deffd700 1 -- 172.21.15.156:0/514704695 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13e0099a60 msgr2=0x7f13e011c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.428+0000 7f13deffd700 1 --2- 172.21.15.156:0/514704695 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13e0099a60 0x7f13e011c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.428+0000 7f13deffd700 1 -- 172.21.15.156:0/514704695 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d0009500 con 0x7f13e00a0e20 2023-09-30T22:25:02.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.428+0000 7f13df7fe700 1 --2- 172.21.15.156:0/514704695 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13e0099a60 0x7f13e011c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:02.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.428+0000 7f13dffff700 1 --2- 172.21.15.156:0/514704695 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13e0133b80 0x7f13e011d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:02.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.428+0000 7f13deffd700 1 --2- 172.21.15.156:0/514704695 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13e00a0e20 0x7f13e011ce40 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f13d40090b0 tx=0x7f13d4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:02.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.428+0000 7f13c7fff700 1 -- 172.21.15.156:0/514704695 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d4004450 con 0x7f13e00a0e20 2023-09-30T22:25:02.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.428+0000 7f13c7fff700 1 -- 172.21.15.156:0/514704695 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d401f070 con 0x7f13e00a0e20 2023-09-30T22:25:02.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.428+0000 7f13e612a700 1 -- 172.21.15.156:0/514704695 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d40094a0 con 0x7f13e00a0e20 2023-09-30T22:25:02.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.428+0000 7f13c7fff700 1 -- 172.21.15.156:0/514704695 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d40038e0 con 0x7f13e00a0e20 2023-09-30T22:25:02.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.428+0000 7f13e612a700 1 -- 172.21.15.156:0/514704695 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e011fbb0 con 0x7f13e00a0e20 2023-09-30T22:25:02.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.430+0000 7f13c7fff700 1 -- 172.21.15.156:0/514704695 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f13d4003a40 con 0x7f13e00a0e20 2023-09-30T22:25:02.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.430+0000 7f13e612a700 1 -- 172.21.15.156:0/514704695 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13e01bb500 con 0x7f13e00a0e20 2023-09-30T22:25:02.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.430+0000 7f13c7fff700 1 -- 172.21.15.156:0/514704695 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f13d4021070 con 0x7f13e00a0e20 2023-09-30T22:25:02.434 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.435+0000 7f13c7fff700 1 -- 172.21.15.156:0/514704695 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f13d40045b0 con 0x7f13e00a0e20 2023-09-30T22:25:02.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.469+0000 7f31a17c7700 1 Processor -- start 2023-09-30T22:25:02.469 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.469+0000 7f31a17c7700 1 -- start start 2023-09-30T22:25:02.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.470+0000 7f31a17c7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f319c133ad0 0x7f319c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.470+0000 7f31a17c7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f319c1300a0 0x7f319c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.470+0000 7f31a17c7700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f319c06b2d0 con 0x7f319c1309f0 2023-09-30T22:25:02.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.470+0000 7f31a17c7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319c133610 con 0x7f319c133ad0 2023-09-30T22:25:02.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.470+0000 7f31a17c7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f319c09a500 con 0x7f319c1300a0 2023-09-30T22:25:02.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.470+0000 7f319a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f319c1300a0 0x7f319c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.470+0000 7f319affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f319c133ad0 0x7f319c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.470+0000 7f319a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f319c1300a0 0x7f319c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:60464/0 (socket says 172.21.15.156:60464) 2023-09-30T22:25:02.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.470+0000 7f319a7fc700 1 -- 172.21.15.156:0/713736003 learned_addr learned my addr 172.21.15.156:0/713736003 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:02.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.471+0000 7f319a7fc700 1 -- 172.21.15.156:0/713736003 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f319c133ad0 msgr2=0x7f319c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:02.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.471+0000 7f319a7fc700 1 --2- 172.21.15.156:0/713736003 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f319c133ad0 0x7f319c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.471+0000 7f319a7fc700 1 -- 172.21.15.156:0/713736003 >> v1:172.21.15.156:6789/0 conn(0x7f319c1309f0 legacy=0x7f319c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.471+0000 7f3199ffb700 1 -- 172.21.15.156:0/713736003 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955096570 0 0) 0x7f319c06b2d0 con 0x7f319c1309f0 2023-09-30T22:25:02.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.471+0000 7f319a7fc700 1 -- 172.21.15.156:0/713736003 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c1338b0 con 0x7f319c1300a0 2023-09-30T22:25:02.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.471+0000 7f319a7fc700 1 --2- 172.21.15.156:0/713736003 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f319c1300a0 0x7f319c1304b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3190009920 tx=0x7f3190009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c6514ef6eeefa82 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:02.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.471+0000 7f3199ffb700 1 -- 172.21.15.156:0/713736003 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3190011830 con 0x7f319c1300a0 2023-09-30T22:25:02.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.471+0000 7f3199ffb700 1 -- 172.21.15.156:0/713736003 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3190011990 con 0x7f319c1300a0 2023-09-30T22:25:02.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.471+0000 7f3199ffb700 1 -- 172.21.15.156:0/713736003 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3190011d20 con 0x7f319c1300a0 2023-09-30T22:25:02.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.472+0000 7f31a17c7700 1 -- 172.21.15.156:0/713736003 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f319c1300a0 msgr2=0x7f319c1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.472+0000 7f31a17c7700 1 --2- 172.21.15.156:0/713736003 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f319c1300a0 0x7f319c1304b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3190009920 tx=0x7f3190009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:02.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.472+0000 7f31a17c7700 1 -- 172.21.15.156:0/713736003 shutdown_connections 2023-09-30T22:25:02.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.472+0000 7f31a17c7700 1 --2- 172.21.15.156:0/713736003 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f319c133ad0 0x7f319c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.472+0000 7f31a17c7700 1 --2- 172.21.15.156:0/713736003 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f319c1300a0 0x7f319c1304b0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.472+0000 7f31a17c7700 1 -- 172.21.15.156:0/713736003 >> 172.21.15.156:0/713736003 conn(0x7f319c099c40 msgr2=0x7f319c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:02.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.472+0000 7f31a17c7700 1 -- 172.21.15.156:0/713736003 shutdown_connections 2023-09-30T22:25:02.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.472+0000 7f31a17c7700 1 -- 172.21.15.156:0/713736003 wait complete. 2023-09-30T22:25:02.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.474+0000 7f31a17c7700 1 Processor -- start 2023-09-30T22:25:02.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.474+0000 7f31a17c7700 1 -- start start 2023-09-30T22:25:02.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.475+0000 7f31a17c7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f319c1300a0 0x7f319c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.475+0000 7f31a17c7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f319c1309f0 0x7f319c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.475+0000 7f31a17c7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f319c133ad0 0x7f319c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.475+0000 7f31a17c7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c11fe10 con 0x7f319c1309f0 2023-09-30T22:25:02.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.475+0000 7f31a17c7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319c11fa70 con 0x7f319c133ad0 2023-09-30T22:25:02.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.475+0000 7f31a17c7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f319c12dd00 con 0x7f319c1300a0 2023-09-30T22:25:02.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.475+0000 7f319affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f319c1300a0 0x7f319c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.475+0000 7f319affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f319c1300a0 0x7f319c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:60474/0 (socket says 172.21.15.156:60474) 2023-09-30T22:25:02.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.475+0000 7f319affd700 1 -- 172.21.15.156:0/3669109619 learned_addr learned my addr 172.21.15.156:0/3669109619 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:02.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.475+0000 7f319b7fe700 1 --2- 172.21.15.156:0/3669109619 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f319c133ad0 0x7f319c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.475+0000 7f319a7fc700 1 --2- 172.21.15.156:0/3669109619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f319c1309f0 0x7f319c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.475+0000 7f319affd700 1 -- 172.21.15.156:0/3669109619 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f319c133ad0 msgr2=0x7f319c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.475+0000 7f319affd700 1 --2- 172.21.15.156:0/3669109619 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f319c133ad0 0x7f319c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.475+0000 7f319affd700 1 -- 172.21.15.156:0/3669109619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f319c1309f0 msgr2=0x7f319c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.475+0000 7f319affd700 1 --2- 172.21.15.156:0/3669109619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f319c1309f0 0x7f319c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.475+0000 7f319affd700 1 -- 172.21.15.156:0/3669109619 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3190009550 con 0x7f319c1300a0 2023-09-30T22:25:02.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.475+0000 7f319b7fe700 1 --2- 172.21.15.156:0/3669109619 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f319c133ad0 0x7f319c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:02.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.475+0000 7f319a7fc700 1 --2- 172.21.15.156:0/3669109619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f319c1309f0 0x7f319c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:02.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.475+0000 7f319affd700 1 --2- 172.21.15.156:0/3669109619 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f319c1300a0 0x7f319c11da40 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f318c00e9b0 tx=0x7f318c00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:02.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.476+0000 7f31837fe700 1 -- 172.21.15.156:0/3669109619 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c009710 con 0x7f319c1300a0 2023-09-30T22:25:02.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.476+0000 7f31837fe700 1 -- 172.21.15.156:0/3669109619 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318c00ee50 con 0x7f319c1300a0 2023-09-30T22:25:02.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.476+0000 7f31a17c7700 1 -- 172.21.15.156:0/3669109619 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f319c120980 con 0x7f319c1300a0 2023-09-30T22:25:02.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.476+0000 7f31837fe700 1 -- 172.21.15.156:0/3669109619 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c00ca50 con 0x7f319c1300a0 2023-09-30T22:25:02.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.476+0000 7f31a17c7700 1 -- 172.21.15.156:0/3669109619 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f319c12d950 con 0x7f319c1300a0 2023-09-30T22:25:02.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.477+0000 7f31837fe700 1 -- 172.21.15.156:0/3669109619 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f318c00cbb0 con 0x7f319c1300a0 2023-09-30T22:25:02.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.477+0000 7f31837fe700 1 -- 172.21.15.156:0/3669109619 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f318c0421c0 con 0x7f319c1300a0 2023-09-30T22:25:02.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.477+0000 7f31a17c7700 1 -- 172.21.15.156:0/3669109619 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f319c04f2a0 con 0x7f319c1300a0 2023-09-30T22:25:02.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.482+0000 7f31837fe700 1 -- 172.21.15.156:0/3669109619 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f318c017020 con 0x7f319c1300a0 2023-09-30T22:25:02.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.505+0000 7faddfb5a700 1 Processor -- start 2023-09-30T22:25:02.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.505+0000 7faddfb5a700 1 -- start start 2023-09-30T22:25:02.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.505+0000 7faddfb5a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fadd80a0a70 0x7fadd80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.505+0000 7faddfb5a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fadd8134120 0x7fadd813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.505+0000 7faddfb5a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd809dc00 con 0x7fadd80a1380 2023-09-30T22:25:02.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.505+0000 7faddfb5a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd809ea90 con 0x7fadd80a0a70 2023-09-30T22:25:02.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.505+0000 7faddfb5a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd809dec0 con 0x7fadd8134120 2023-09-30T22:25:02.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.506+0000 7fadde0f7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fadd8134120 0x7fadd813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.506+0000 7faddd0f5700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fadd80a1380 0x7fadd8133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:33590/0 (socket says 172.21.15.156:33590) 2023-09-30T22:25:02.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.506+0000 7faddd0f5700 1 -- 172.21.15.156:0/397452055 learned_addr learned my addr 172.21.15.156:0/397452055 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:02.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.506+0000 7faddd8f6700 1 --2- 172.21.15.156:0/397452055 >> v2:172.21.15.156:3300/0 conn(0x7fadd80a0a70 0x7fadd80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.506+0000 7fadde0f7700 1 -- 172.21.15.156:0/397452055 >> v2:172.21.15.156:3300/0 conn(0x7fadd80a0a70 msgr2=0x7fadd80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:02.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.506+0000 7fadde0f7700 1 --2- 172.21.15.156:0/397452055 >> v2:172.21.15.156:3300/0 conn(0x7fadd80a0a70 0x7fadd80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.506+0000 7fadde0f7700 1 -- 172.21.15.156:0/397452055 >> v1:172.21.15.156:6789/0 conn(0x7fadd80a1380 legacy=0x7fadd8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.506+0000 7fadde0f7700 1 -- 172.21.15.156:0/397452055 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd809e6a0 con 0x7fadd8134120 2023-09-30T22:25:02.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.506+0000 7faddc8f4700 1 -- 172.21.15.156:0/397452055 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 899982034 0 0) 0x7fadd809dc00 con 0x7fadd80a1380 2023-09-30T22:25:02.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.506+0000 7fadde0f7700 1 --2- 172.21.15.156:0/397452055 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fadd8134120 0x7fadd813bce0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009d90 tx=0x7fadd000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a7f72c8209486c3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:02.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.506+0000 7faddc8f4700 1 -- 172.21.15.156:0/397452055 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd000e070 con 0x7fadd8134120 2023-09-30T22:25:02.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.506+0000 7faddc8f4700 1 -- 172.21.15.156:0/397452055 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd000bb20 con 0x7fadd8134120 2023-09-30T22:25:02.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.507+0000 7faddc8f4700 1 -- 172.21.15.156:0/397452055 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd0012430 con 0x7fadd8134120 2023-09-30T22:25:02.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.507+0000 7faddfb5a700 1 -- 172.21.15.156:0/397452055 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fadd8134120 msgr2=0x7fadd813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.507+0000 7faddfb5a700 1 --2- 172.21.15.156:0/397452055 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fadd8134120 0x7fadd813bce0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009d90 tx=0x7fadd000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:02.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.507+0000 7faddfb5a700 1 -- 172.21.15.156:0/397452055 shutdown_connections 2023-09-30T22:25:02.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.507+0000 7faddfb5a700 1 --2- 172.21.15.156:0/397452055 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fadd8134120 0x7fadd813bce0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.507+0000 7faddfb5a700 1 --2- 172.21.15.156:0/397452055 >> v2:172.21.15.156:3300/0 conn(0x7fadd80a0a70 0x7fadd80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.507+0000 7faddfb5a700 1 -- 172.21.15.156:0/397452055 >> 172.21.15.156:0/397452055 conn(0x7fadd80a6610 msgr2=0x7fadd80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:02.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.507+0000 7faddfb5a700 1 -- 172.21.15.156:0/397452055 shutdown_connections 2023-09-30T22:25:02.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.507+0000 7faddfb5a700 1 -- 172.21.15.156:0/397452055 wait complete. 2023-09-30T22:25:02.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.508+0000 7faddfb5a700 1 Processor -- start 2023-09-30T22:25:02.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.508+0000 7faddfb5a700 1 -- start start 2023-09-30T22:25:02.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.508+0000 7faddfb5a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fadd80a0a70 0x7fadd81cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.509+0000 7faddfb5a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fadd80a1380 0x7fadd81cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.509+0000 7faddfb5a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fadd8134120 0x7fadd81ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.509+0000 7faddfb5a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd8127fc0 con 0x7fadd80a1380 2023-09-30T22:25:02.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.509+0000 7faddfb5a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd8129c20 con 0x7fadd8134120 2023-09-30T22:25:02.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.509+0000 7faddfb5a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fadd8129e90 con 0x7fadd80a0a70 2023-09-30T22:25:02.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.509+0000 7fadde0f7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fadd8134120 0x7fadd81ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.509+0000 7fadde0f7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fadd8134120 0x7fadd81ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:50614/0 (socket says 172.21.15.156:50614) 2023-09-30T22:25:02.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.509+0000 7fadde0f7700 1 -- 172.21.15.156:0/638503705 learned_addr learned my addr 172.21.15.156:0/638503705 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:02.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.509+0000 7faddd0f5700 1 --2- 172.21.15.156:0/638503705 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fadd80a1380 0x7fadd81cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.509+0000 7fadde0f7700 1 -- 172.21.15.156:0/638503705 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fadd80a0a70 msgr2=0x7fadd81cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.509+0000 7fadde0f7700 1 --2- 172.21.15.156:0/638503705 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fadd80a0a70 0x7fadd81cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.509+0000 7fadde0f7700 1 -- 172.21.15.156:0/638503705 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fadd80a1380 msgr2=0x7fadd81cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.509+0000 7fadde0f7700 1 --2- 172.21.15.156:0/638503705 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fadd80a1380 0x7fadd81cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.509+0000 7fadde0f7700 1 -- 172.21.15.156:0/638503705 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd0009a70 con 0x7fadd8134120 2023-09-30T22:25:02.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.509+0000 7faddd0f5700 1 --2- 172.21.15.156:0/638503705 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fadd80a1380 0x7fadd81cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:02.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.509+0000 7fadde0f7700 1 --2- 172.21.15.156:0/638503705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fadd8134120 0x7fadd81ccf90 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fadd0014040 tx=0x7fadd0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:02.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.510+0000 7fadce7fc700 1 -- 172.21.15.156:0/638503705 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd0012430 con 0x7fadd8134120 2023-09-30T22:25:02.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.510+0000 7fadce7fc700 1 -- 172.21.15.156:0/638503705 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd0020070 con 0x7fadd8134120 2023-09-30T22:25:02.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.510+0000 7fadce7fc700 1 -- 172.21.15.156:0/638503705 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd0004260 con 0x7fadd8134120 2023-09-30T22:25:02.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.510+0000 7faddfb5a700 1 -- 172.21.15.156:0/638503705 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd80a5710 con 0x7fadd8134120 2023-09-30T22:25:02.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.510+0000 7faddfb5a700 1 -- 172.21.15.156:0/638503705 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd8128770 con 0x7fadd8134120 2023-09-30T22:25:02.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.510+0000 7fadce7fc700 1 -- 172.21.15.156:0/638503705 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fadd00043c0 con 0x7fadd8134120 2023-09-30T22:25:02.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.511+0000 7fadce7fc700 1 -- 172.21.15.156:0/638503705 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fadd0022070 con 0x7fadd8134120 2023-09-30T22:25:02.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.511+0000 7faddfb5a700 1 -- 172.21.15.156:0/638503705 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd8129850 con 0x7fadd8134120 2023-09-30T22:25:02.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.520+0000 7fadce7fc700 1 -- 172.21.15.156:0/638503705 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fadd002c080 con 0x7fadd8134120 2023-09-30T22:25:02.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.637+0000 7f13e612a700 1 -- 172.21.15.156:0/514704695 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f13e0130b40 con 0x7f13e00a0e20 2023-09-30T22:25:02.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.638+0000 7f13c7fff700 1 -- 172.21.15.156:0/514704695 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f13d402b020 con 0x7f13e00a0e20 2023-09-30T22:25:02.638 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:02.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.640+0000 7f13e612a700 1 -- 172.21.15.156:0/514704695 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13e00a0e20 msgr2=0x7f13e011ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.640+0000 7f13e612a700 1 --2- 172.21.15.156:0/514704695 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13e00a0e20 0x7f13e011ce40 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f13d40090b0 tx=0x7f13d4004750 comp rx=0 tx=0).stop 2023-09-30T22:25:02.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.640+0000 7f13e612a700 1 -- 172.21.15.156:0/514704695 shutdown_connections 2023-09-30T22:25:02.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.640+0000 7f13e612a700 1 --2- 172.21.15.156:0/514704695 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13e0133b80 0x7f13e011d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.640+0000 7f13e612a700 1 --2- 172.21.15.156:0/514704695 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13e0099a60 0x7f13e011c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.640+0000 7f13e612a700 1 --2- 172.21.15.156:0/514704695 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13e00a0e20 0x7f13e011ce40 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.640+0000 7f13e612a700 1 -- 172.21.15.156:0/514704695 >> 172.21.15.156:0/514704695 conn(0x7f13e00a2980 msgr2=0x7f13e01badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:02.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.640+0000 7f13e612a700 1 -- 172.21.15.156:0/514704695 shutdown_connections 2023-09-30T22:25:02.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.640+0000 7f13e612a700 1 -- 172.21.15.156:0/514704695 wait complete. 2023-09-30T22:25:02.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.643+0000 7f16760ce700 1 -- 172.21.15.156:0/2837229047 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f167004f2a0 con 0x7f1670133ad0 2023-09-30T22:25:02.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.643+0000 7f1657fff700 1 -- 172.21.15.156:0/2837229047 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1668019020 con 0x7f1670133ad0 2023-09-30T22:25:02.643 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:02.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.646+0000 7f16760ce700 1 -- 172.21.15.156:0/2837229047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1670133ad0 msgr2=0x7f167011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.646+0000 7f16760ce700 1 --2- 172.21.15.156:0/2837229047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1670133ad0 0x7f167011e4c0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f166800be50 tx=0x7f1668009ef0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.646+0000 7f16760ce700 1 -- 172.21.15.156:0/2837229047 shutdown_connections 2023-09-30T22:25:02.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.646+0000 7f16760ce700 1 --2- 172.21.15.156:0/2837229047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1670133ad0 0x7f167011e4c0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.646+0000 7f16760ce700 1 --2- 172.21.15.156:0/2837229047 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f16701300a0 0x7f167011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.646+0000 7f16760ce700 1 --2- 172.21.15.156:0/2837229047 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f16701309f0 0x7f167011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.646+0000 7f16760ce700 1 -- 172.21.15.156:0/2837229047 >> 172.21.15.156:0/2837229047 conn(0x7f1670099c40 msgr2=0x7f16700a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:02.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.646+0000 7f16760ce700 1 -- 172.21.15.156:0/2837229047 shutdown_connections 2023-09-30T22:25:02.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.646+0000 7f16760ce700 1 -- 172.21.15.156:0/2837229047 wait complete. 2023-09-30T22:25:02.654 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:02.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:02.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.713+0000 7f31a17c7700 1 -- 172.21.15.156:0/3669109619 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f319c11f440 con 0x7f319c1300a0 2023-09-30T22:25:02.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.713+0000 7f31837fe700 1 -- 172.21.15.156:0/3669109619 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f319c11f440 con 0x7f319c1300a0 2023-09-30T22:25:02.713 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:02.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.715+0000 7f31a17c7700 1 -- 172.21.15.156:0/3669109619 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f319c1300a0 msgr2=0x7f319c11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.715+0000 7f31a17c7700 1 --2- 172.21.15.156:0/3669109619 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f319c1300a0 0x7f319c11da40 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f318c00e9b0 tx=0x7f318c00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.715+0000 7f31a17c7700 1 -- 172.21.15.156:0/3669109619 shutdown_connections 2023-09-30T22:25:02.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.715+0000 7f31a17c7700 1 --2- 172.21.15.156:0/3669109619 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f319c133ad0 0x7f319c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.715+0000 7f31a17c7700 1 --2- 172.21.15.156:0/3669109619 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f319c1300a0 0x7f319c11da40 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.715+0000 7f31a17c7700 1 --2- 172.21.15.156:0/3669109619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f319c1309f0 0x7f319c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.715+0000 7f31a17c7700 1 -- 172.21.15.156:0/3669109619 >> 172.21.15.156:0/3669109619 conn(0x7f319c099c40 msgr2=0x7f319c131fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:02.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.715+0000 7f31a17c7700 1 -- 172.21.15.156:0/3669109619 shutdown_connections 2023-09-30T22:25:02.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.715+0000 7f31a17c7700 1 -- 172.21.15.156:0/3669109619 wait complete. 2023-09-30T22:25:02.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.716+0000 7faddfb5a700 1 -- 172.21.15.156:0/638503705 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fadd804f2a0 con 0x7fadd8134120 2023-09-30T22:25:02.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.717+0000 7fadce7fc700 1 -- 172.21.15.156:0/638503705 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fadd0036090 con 0x7fadd8134120 2023-09-30T22:25:02.717 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:02.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.719+0000 7faddfb5a700 1 -- 172.21.15.156:0/638503705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fadd8134120 msgr2=0x7fadd81ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.719+0000 7faddfb5a700 1 --2- 172.21.15.156:0/638503705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fadd8134120 0x7fadd81ccf90 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fadd0014040 tx=0x7fadd0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.719+0000 7faddfb5a700 1 -- 172.21.15.156:0/638503705 shutdown_connections 2023-09-30T22:25:02.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.719+0000 7faddfb5a700 1 --2- 172.21.15.156:0/638503705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fadd8134120 0x7fadd81ccf90 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.719+0000 7faddfb5a700 1 --2- 172.21.15.156:0/638503705 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fadd80a0a70 0x7fadd81cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.719+0000 7faddfb5a700 1 --2- 172.21.15.156:0/638503705 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fadd80a1380 0x7fadd81cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.719+0000 7faddfb5a700 1 -- 172.21.15.156:0/638503705 >> 172.21.15.156:0/638503705 conn(0x7fadd80a6610 msgr2=0x7fadd80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:02.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.719+0000 7faddfb5a700 1 -- 172.21.15.156:0/638503705 shutdown_connections 2023-09-30T22:25:02.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:02.719+0000 7faddfb5a700 1 -- 172.21.15.156:0/638503705 wait complete. 2023-09-30T22:25:02.729 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:02.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:03.655 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:03.660 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:03.729 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:03.732 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:03.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.799+0000 7f5307d01700 1 Processor -- start 2023-09-30T22:25:03.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.800+0000 7f5307d01700 1 -- start start 2023-09-30T22:25:03.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.800+0000 7f5307d01700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5300136960 0x7f5300138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.800+0000 7f5307d01700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5300139280 0x7f530013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.800+0000 7f5307d01700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530006b2d0 con 0x7f5300133ad0 2023-09-30T22:25:03.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.800+0000 7f5307d01700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53001345b0 con 0x7f5300139280 2023-09-30T22:25:03.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.800+0000 7f5307d01700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5300133610 con 0x7f5300136960 2023-09-30T22:25:03.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.801+0000 7f530529c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5300136960 0x7f5300138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.801+0000 7f530529c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5300136960 0x7f5300138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:60488/0 (socket says 172.21.15.156:60488) 2023-09-30T22:25:03.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.801+0000 7f530529c700 1 -- 172.21.15.156:0/899337093 learned_addr learned my addr 172.21.15.156:0/899337093 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:03.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.801+0000 7f530629e700 1 --2- 172.21.15.156:0/899337093 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5300139280 0x7f530013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.801+0000 7f530529c700 1 -- 172.21.15.156:0/899337093 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5300139280 msgr2=0x7f530013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:03.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.801+0000 7f530529c700 1 --2- 172.21.15.156:0/899337093 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5300139280 0x7f530013b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.801+0000 7f530529c700 1 -- 172.21.15.156:0/899337093 >> v1:172.21.15.156:6789/0 conn(0x7f5300133ad0 legacy=0x7f5300133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.801+0000 7f530529c700 1 -- 172.21.15.156:0/899337093 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530009a500 con 0x7f5300136960 2023-09-30T22:25:03.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.801+0000 7f530529c700 1 --2- 172.21.15.156:0/899337093 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5300136960 0x7f5300138d40 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f52f0009920 tx=0x7f52f0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4eb82132fa70f71 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:03.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.801+0000 7f5304a9b700 1 -- 172.21.15.156:0/899337093 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f0011830 con 0x7f5300136960 2023-09-30T22:25:03.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.801+0000 7f5304a9b700 1 -- 172.21.15.156:0/899337093 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f0011990 con 0x7f5300136960 2023-09-30T22:25:03.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.801+0000 7f5304a9b700 1 -- 172.21.15.156:0/899337093 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f0011d00 con 0x7f5300136960 2023-09-30T22:25:03.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.802+0000 7f5307d01700 1 -- 172.21.15.156:0/899337093 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5300136960 msgr2=0x7f5300138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.802+0000 7f5307d01700 1 --2- 172.21.15.156:0/899337093 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5300136960 0x7f5300138d40 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f52f0009920 tx=0x7f52f0009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:03.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.802+0000 7f5307d01700 1 -- 172.21.15.156:0/899337093 shutdown_connections 2023-09-30T22:25:03.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.802+0000 7f5307d01700 1 --2- 172.21.15.156:0/899337093 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5300139280 0x7f530013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.802+0000 7f5307d01700 1 --2- 172.21.15.156:0/899337093 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5300136960 0x7f5300138d40 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.802+0000 7f5307d01700 1 -- 172.21.15.156:0/899337093 >> 172.21.15.156:0/899337093 conn(0x7f5300099c40 msgr2=0x7f53000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:03.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.802+0000 7f5307d01700 1 -- 172.21.15.156:0/899337093 shutdown_connections 2023-09-30T22:25:03.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.803+0000 7f5307d01700 1 -- 172.21.15.156:0/899337093 wait complete. 2023-09-30T22:25:03.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.804+0000 7f5307d01700 1 Processor -- start 2023-09-30T22:25:03.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.804+0000 7f5307d01700 1 -- start start 2023-09-30T22:25:03.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.804+0000 7f5307d01700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5300133ad0 0x7f530012f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.805 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.804+0000 7f5307d01700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5300136960 0x7f530012fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.804+0000 7f5307d01700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5300139280 0x7f53001c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.804+0000 7f5307d01700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5300070370 con 0x7f5300136960 2023-09-30T22:25:03.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.804+0000 7f5307d01700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5300138d50 con 0x7f5300133ad0 2023-09-30T22:25:03.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.804+0000 7f5307d01700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f530006fe40 con 0x7f5300139280 2023-09-30T22:25:03.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.805+0000 7f5305a9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5300133ad0 0x7f530012f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.805+0000 7f5305a9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5300133ad0 0x7f530012f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:50632/0 (socket says 172.21.15.156:50632) 2023-09-30T22:25:03.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.805+0000 7f5305a9d700 1 -- 172.21.15.156:0/1302558402 learned_addr learned my addr 172.21.15.156:0/1302558402 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:03.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.805+0000 7f530629e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5300139280 0x7f53001c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.805+0000 7f530529c700 1 --2- 172.21.15.156:0/1302558402 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5300136960 0x7f530012fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.805+0000 7f5305a9d700 1 -- 172.21.15.156:0/1302558402 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5300139280 msgr2=0x7f53001c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.806 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.805+0000 7f5305a9d700 1 --2- 172.21.15.156:0/1302558402 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5300139280 0x7f53001c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.805+0000 7f5305a9d700 1 -- 172.21.15.156:0/1302558402 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5300136960 msgr2=0x7f530012fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.805+0000 7f5305a9d700 1 --2- 172.21.15.156:0/1302558402 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5300136960 0x7f530012fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.805+0000 7f5305a9d700 1 -- 172.21.15.156:0/1302558402 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f0009550 con 0x7f5300133ad0 2023-09-30T22:25:03.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.805+0000 7f5305a9d700 1 --2- 172.21.15.156:0/1302558402 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5300133ad0 0x7f530012f750 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f52fc00c4b0 tx=0x7f52fc00c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:03.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.806+0000 7f52f67fc700 1 -- 172.21.15.156:0/1302558402 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc0052d0 con 0x7f5300133ad0 2023-09-30T22:25:03.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.806+0000 7f52f67fc700 1 -- 172.21.15.156:0/1302558402 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52fc005430 con 0x7f5300133ad0 2023-09-30T22:25:03.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.806+0000 7f5307d01700 1 -- 172.21.15.156:0/1302558402 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f530006ef30 con 0x7f5300133ad0 2023-09-30T22:25:03.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.806+0000 7f52f67fc700 1 -- 172.21.15.156:0/1302558402 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc0038c0 con 0x7f5300133ad0 2023-09-30T22:25:03.807 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.806+0000 7f5307d01700 1 -- 172.21.15.156:0/1302558402 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53001301d0 con 0x7f5300133ad0 2023-09-30T22:25:03.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.807+0000 7f52f67fc700 1 -- 172.21.15.156:0/1302558402 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f52fc003a20 con 0x7f5300133ad0 2023-09-30T22:25:03.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.807+0000 7f5307d01700 1 -- 172.21.15.156:0/1302558402 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53001303c0 con 0x7f5300133ad0 2023-09-30T22:25:03.808 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.807+0000 7f52f67fc700 1 -- 172.21.15.156:0/1302558402 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f52fc03e880 con 0x7f5300133ad0 2023-09-30T22:25:03.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.816+0000 7f52f67fc700 1 -- 172.21.15.156:0/1302558402 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f52fc011590 con 0x7f5300133ad0 2023-09-30T22:25:03.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.850+0000 7f6fa05f6700 1 Processor -- start 2023-09-30T22:25:03.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.851+0000 7f6fa05f6700 1 -- start start 2023-09-30T22:25:03.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.851+0000 7f6fa05f6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f9809f350 0x7f6f98136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.851+0000 7f6fa05f6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6f981371c0 0x7f6f981395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.851+0000 7f6fa05f6700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f9809c970 con 0x7f6f9809e870 2023-09-30T22:25:03.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.851+0000 7f6fa05f6700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f980a0920 con 0x7f6f981371c0 2023-09-30T22:25:03.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.851+0000 7f6fa05f6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9809f9c0 con 0x7f6f9809f350 2023-09-30T22:25:03.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.851+0000 7f6f9db91700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f9809f350 0x7f6f98136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.852+0000 7f6f9db91700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f9809f350 0x7f6f98136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:50642/0 (socket says 172.21.15.156:50642) 2023-09-30T22:25:03.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.852+0000 7f6f9db91700 1 -- 172.21.15.156:0/248724182 learned_addr learned my addr 172.21.15.156:0/248724182 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:03.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.852+0000 7f6f9e392700 1 --1- 172.21.15.156:0/248724182 >> v1:172.21.15.156:6789/0 conn(0x7f6f9809e870 0x7f6f9809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:33604/0 (socket says 172.21.15.156:33604) 2023-09-30T22:25:03.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.852+0000 7f6f9eb93700 1 --2- 172.21.15.156:0/248724182 >> v2:172.21.15.156:3300/0 conn(0x7f6f981371c0 0x7f6f981395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.852+0000 7f6f9eb93700 1 -- 172.21.15.156:0/248724182 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f9809f350 msgr2=0x7f6f98136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:03.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.852+0000 7f6f9eb93700 1 --2- 172.21.15.156:0/248724182 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f9809f350 0x7f6f98136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.852+0000 7f6f9eb93700 1 -- 172.21.15.156:0/248724182 >> v1:172.21.15.156:6789/0 conn(0x7f6f9809e870 legacy=0x7f6f9809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.852+0000 7f6f9eb93700 1 -- 172.21.15.156:0/248724182 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9809bab0 con 0x7f6f981371c0 2023-09-30T22:25:03.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.852+0000 7f6f9d390700 1 -- 172.21.15.156:0/248724182 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287114708 0 0) 0x7f6f9809c970 con 0x7f6f9809e870 2023-09-30T22:25:03.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.852+0000 7f6f9eb93700 1 --2- 172.21.15.156:0/248724182 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f981371c0 0x7f6f981395a0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009840 tx=0x7f6f88009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6570c24c0644084 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:03.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.852+0000 7f6f9d390700 1 -- 172.21.15.156:0/248724182 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f88011830 con 0x7f6f981371c0 2023-09-30T22:25:03.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.852+0000 7f6f9d390700 1 -- 172.21.15.156:0/248724182 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f88011990 con 0x7f6f981371c0 2023-09-30T22:25:03.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.852+0000 7f6f9d390700 1 -- 172.21.15.156:0/248724182 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f88011d20 con 0x7f6f981371c0 2023-09-30T22:25:03.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.853+0000 7f6fa05f6700 1 -- 172.21.15.156:0/248724182 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f981371c0 msgr2=0x7f6f981395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.853+0000 7f6fa05f6700 1 --2- 172.21.15.156:0/248724182 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f981371c0 0x7f6f981395a0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009840 tx=0x7f6f88009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:03.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.853+0000 7f6fa05f6700 1 -- 172.21.15.156:0/248724182 shutdown_connections 2023-09-30T22:25:03.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.853+0000 7f6fa05f6700 1 --2- 172.21.15.156:0/248724182 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f981371c0 0x7f6f981395a0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.853+0000 7f6fa05f6700 1 --2- 172.21.15.156:0/248724182 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f9809f350 0x7f6f98136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.853+0000 7f6fa05f6700 1 -- 172.21.15.156:0/248724182 >> 172.21.15.156:0/248724182 conn(0x7f6f980a4430 msgr2=0x7f6f980a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:03.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.853+0000 7f6fa05f6700 1 -- 172.21.15.156:0/248724182 shutdown_connections 2023-09-30T22:25:03.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.854+0000 7f6fa05f6700 1 -- 172.21.15.156:0/248724182 wait complete. 2023-09-30T22:25:03.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.855+0000 7f6fa05f6700 1 Processor -- start 2023-09-30T22:25:03.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.855+0000 7f6fa05f6700 1 -- start start 2023-09-30T22:25:03.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.855+0000 7f6fa05f6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f9809e870 0x7f6f981c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.855+0000 7f6fa05f6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f9809f350 0x7f6f981c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.855+0000 7f6fa05f6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f981371c0 0x7f6f981c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.855+0000 7f6fa05f6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f981205c0 con 0x7f6f9809f350 2023-09-30T22:25:03.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.856+0000 7f6fa05f6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f981203d0 con 0x7f6f981371c0 2023-09-30T22:25:03.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.856+0000 7f6fa05f6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f98120c60 con 0x7f6f9809e870 2023-09-30T22:25:03.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.856+0000 7f6f9db91700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f9809f350 0x7f6f981c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.856+0000 7f6f9db91700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f9809f350 0x7f6f981c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33126/0 (socket says 172.21.15.156:33126) 2023-09-30T22:25:03.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.856+0000 7f6f9db91700 1 -- 172.21.15.156:0/4127894714 learned_addr learned my addr 172.21.15.156:0/4127894714 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:03.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.856+0000 7f6f9e392700 1 --2- 172.21.15.156:0/4127894714 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f9809e870 0x7f6f981c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.856+0000 7f6f9eb93700 1 --2- 172.21.15.156:0/4127894714 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f981371c0 0x7f6f981c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.856+0000 7f6f9db91700 1 -- 172.21.15.156:0/4127894714 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f9809e870 msgr2=0x7f6f981c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.856+0000 7f6f9db91700 1 --2- 172.21.15.156:0/4127894714 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f9809e870 0x7f6f981c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.856+0000 7f6f9db91700 1 -- 172.21.15.156:0/4127894714 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f981371c0 msgr2=0x7f6f981c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.856+0000 7f6f9db91700 1 --2- 172.21.15.156:0/4127894714 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f981371c0 0x7f6f981c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.856+0000 7f6f9db91700 1 -- 172.21.15.156:0/4127894714 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f880094a0 con 0x7f6f9809f350 2023-09-30T22:25:03.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.856+0000 7f6f9eb93700 1 --2- 172.21.15.156:0/4127894714 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f981371c0 0x7f6f981c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:03.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.857+0000 7f6f9db91700 1 --2- 172.21.15.156:0/4127894714 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f9809f350 0x7f6f981c8910 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f6f9400e940 tx=0x7f6f9400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:03.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.857+0000 7f6f8effd700 1 -- 172.21.15.156:0/4127894714 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f940096a0 con 0x7f6f9809f350 2023-09-30T22:25:03.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.857+0000 7f6fa05f6700 1 -- 172.21.15.156:0/4127894714 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f98122340 con 0x7f6f9809f350 2023-09-30T22:25:03.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.857+0000 7f6f8effd700 1 -- 172.21.15.156:0/4127894714 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9400ee90 con 0x7f6f9809f350 2023-09-30T22:25:03.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.857+0000 7f6f8effd700 1 -- 172.21.15.156:0/4127894714 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f94017ea0 con 0x7f6f9809f350 2023-09-30T22:25:03.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.857+0000 7f6fa05f6700 1 -- 172.21.15.156:0/4127894714 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f9809dba0 con 0x7f6f9809f350 2023-09-30T22:25:03.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.858+0000 7f6f8effd700 1 -- 172.21.15.156:0/4127894714 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f9400c5e0 con 0x7f6f9809f350 2023-09-30T22:25:03.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.858+0000 7f6f8effd700 1 -- 172.21.15.156:0/4127894714 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6f940479f0 con 0x7f6f9809f350 2023-09-30T22:25:03.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.859+0000 7f6fa05f6700 1 -- 172.21.15.156:0/4127894714 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f9806b880 con 0x7f6f9809f350 2023-09-30T22:25:03.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.868+0000 7f6f8effd700 1 -- 172.21.15.156:0/4127894714 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f94024020 con 0x7f6f9809f350 2023-09-30T22:25:03.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.882+0000 7fbf4d212700 1 Processor -- start 2023-09-30T22:25:03.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.882+0000 7fbf4d212700 1 -- start start 2023-09-30T22:25:03.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.883+0000 7fbf4d212700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbf480a1510 0x7fbf481351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.883+0000 7fbf4d212700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbf481356e0 0x7fbf48137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.883+0000 7fbf4d212700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf480a1e70 con 0x7fbf480a0a30 2023-09-30T22:25:03.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.883+0000 7fbf4d212700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf4809a720 con 0x7fbf481356e0 2023-09-30T22:25:03.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.883+0000 7fbf4d212700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4809b300 con 0x7fbf480a1510 2023-09-30T22:25:03.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.883+0000 7fbf4759e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbf481356e0 0x7fbf48137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.883+0000 7fbf46d9d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fbf480a0a30 0x7fbf480a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:33610/0 (socket says 172.21.15.156:33610) 2023-09-30T22:25:03.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.883+0000 7fbf46d9d700 1 -- 172.21.15.156:0/562665973 learned_addr learned my addr 172.21.15.156:0/562665973 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:03.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.883+0000 7fbf4759e700 1 -- 172.21.15.156:0/562665973 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbf480a1510 msgr2=0x7fbf481351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:03.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.883+0000 7fbf4759e700 1 --2- 172.21.15.156:0/562665973 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbf480a1510 0x7fbf481351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.883+0000 7fbf4759e700 1 -- 172.21.15.156:0/562665973 >> v1:172.21.15.156:6789/0 conn(0x7fbf480a0a30 legacy=0x7fbf480a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.883+0000 7fbf4759e700 1 -- 172.21.15.156:0/562665973 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4809abc0 con 0x7fbf481356e0 2023-09-30T22:25:03.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.883+0000 7fbf4759e700 1 --2- 172.21.15.156:0/562665973 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf481356e0 0x7fbf48137ac0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fbf40009d90 tx=0x7fbf4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32173bb2de44916c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:03.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.884+0000 7fbf45d9b700 1 -- 172.21.15.156:0/562665973 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4000e070 con 0x7fbf481356e0 2023-09-30T22:25:03.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.884+0000 7fbf45d9b700 1 -- 172.21.15.156:0/562665973 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4000bbd0 con 0x7fbf481356e0 2023-09-30T22:25:03.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.884+0000 7fbf45d9b700 1 -- 172.21.15.156:0/562665973 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf40012430 con 0x7fbf481356e0 2023-09-30T22:25:03.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.884+0000 7fbf4d212700 1 -- 172.21.15.156:0/562665973 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf481356e0 msgr2=0x7fbf48137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.884+0000 7fbf4d212700 1 --2- 172.21.15.156:0/562665973 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf481356e0 0x7fbf48137ac0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fbf40009d90 tx=0x7fbf4000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:03.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.884+0000 7fbf4d212700 1 -- 172.21.15.156:0/562665973 shutdown_connections 2023-09-30T22:25:03.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.884+0000 7fbf4d212700 1 --2- 172.21.15.156:0/562665973 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf481356e0 0x7fbf48137ac0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.884+0000 7fbf4d212700 1 --2- 172.21.15.156:0/562665973 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbf480a1510 0x7fbf481351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.884+0000 7fbf4d212700 1 -- 172.21.15.156:0/562665973 >> 172.21.15.156:0/562665973 conn(0x7fbf480a2980 msgr2=0x7fbf480a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:03.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.884+0000 7fbf4d212700 1 -- 172.21.15.156:0/562665973 shutdown_connections 2023-09-30T22:25:03.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.884+0000 7fbf4d212700 1 -- 172.21.15.156:0/562665973 wait complete. 2023-09-30T22:25:03.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.886+0000 7fbf4d212700 1 Processor -- start 2023-09-30T22:25:03.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.886+0000 7fbf4d212700 1 -- start start 2023-09-30T22:25:03.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.886+0000 7fbf4d212700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf480a0a30 0x7fbf4806df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.886+0000 7fbf4d212700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf480a1510 0x7fbf4806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.886+0000 7fbf4d212700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbf481356e0 0x7fbf4806ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.886+0000 7fbf4d212700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4811ffc0 con 0x7fbf480a0a30 2023-09-30T22:25:03.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.886+0000 7fbf4d212700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4811fc10 con 0x7fbf480a1510 2023-09-30T22:25:03.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.886+0000 7fbf4d212700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4812ed40 con 0x7fbf481356e0 2023-09-30T22:25:03.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.886+0000 7fbf46d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf480a0a30 0x7fbf4806df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.886+0000 7fbf46d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf480a0a30 0x7fbf4806df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33140/0 (socket says 172.21.15.156:33140) 2023-09-30T22:25:03.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.886+0000 7fbf46d9d700 1 -- 172.21.15.156:0/2707533744 learned_addr learned my addr 172.21.15.156:0/2707533744 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:03.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.886+0000 7fbf4759e700 1 --2- 172.21.15.156:0/2707533744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbf481356e0 0x7fbf4806ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.887+0000 7fbf46d9d700 1 -- 172.21.15.156:0/2707533744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbf481356e0 msgr2=0x7fbf4806ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.887+0000 7fbf46d9d700 1 --2- 172.21.15.156:0/2707533744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbf481356e0 0x7fbf4806ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.887+0000 7fbf46d9d700 1 -- 172.21.15.156:0/2707533744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf480a1510 msgr2=0x7fbf4806e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.887+0000 7fbf46d9d700 1 --2- 172.21.15.156:0/2707533744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf480a1510 0x7fbf4806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.887+0000 7fbf46d9d700 1 -- 172.21.15.156:0/2707533744 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf40009a70 con 0x7fbf480a0a30 2023-09-30T22:25:03.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.887+0000 7fbf46d9d700 1 --2- 172.21.15.156:0/2707533744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf480a0a30 0x7fbf4806df90 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fbf3800c730 tx=0x7fbf3800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:03.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.887+0000 7fbf2f7fe700 1 -- 172.21.15.156:0/2707533744 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf380074e0 con 0x7fbf480a0a30 2023-09-30T22:25:03.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.887+0000 7fbf4d212700 1 -- 172.21.15.156:0/2707533744 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4809fed0 con 0x7fbf480a0a30 2023-09-30T22:25:03.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.887+0000 7fbf4d212700 1 -- 172.21.15.156:0/2707533744 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf481201a0 con 0x7fbf480a0a30 2023-09-30T22:25:03.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.887+0000 7fbf2f7fe700 1 -- 172.21.15.156:0/2707533744 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf38007640 con 0x7fbf480a0a30 2023-09-30T22:25:03.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.887+0000 7fbf2f7fe700 1 -- 172.21.15.156:0/2707533744 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf38005a30 con 0x7fbf480a0a30 2023-09-30T22:25:03.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.888+0000 7fbf4d212700 1 -- 172.21.15.156:0/2707533744 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf280052e0 con 0x7fbf480a0a30 2023-09-30T22:25:03.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.888+0000 7fbf2f7fe700 1 -- 172.21.15.156:0/2707533744 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbf38005b90 con 0x7fbf480a0a30 2023-09-30T22:25:03.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.888+0000 7fbf2f7fe700 1 -- 172.21.15.156:0/2707533744 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbf3803ebc0 con 0x7fbf480a0a30 2023-09-30T22:25:03.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.893+0000 7fbf2f7fe700 1 -- 172.21.15.156:0/2707533744 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf38012400 con 0x7fbf480a0a30 2023-09-30T22:25:03.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.896+0000 7fb04cccc700 1 Processor -- start 2023-09-30T22:25:03.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.896+0000 7fb04cccc700 1 -- start start 2023-09-30T22:25:03.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.897+0000 7fb04cccc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb04809e870 0x7fb04809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.897+0000 7fb04cccc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb048131f40 0x7fb048139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.897+0000 7fb04cccc700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04809c970 con 0x7fb04809f180 2023-09-30T22:25:03.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.897+0000 7fb04cccc700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0480a0920 con 0x7fb048131f40 2023-09-30T22:25:03.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.897+0000 7fb04cccc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb04809f9c0 con 0x7fb04809e870 2023-09-30T22:25:03.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.898+0000 7fb04659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb04809e870 0x7fb04809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.898+0000 7fb045d9b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb04809f180 0x7fb048131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:33626/0 (socket says 172.21.15.156:33626) 2023-09-30T22:25:03.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.898+0000 7fb045d9b700 1 -- 172.21.15.156:0/1788081623 learned_addr learned my addr 172.21.15.156:0/1788081623 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:03.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.898+0000 7fb046d9d700 1 --2- 172.21.15.156:0/1788081623 >> v2:172.21.15.156:3300/0 conn(0x7fb048131f40 0x7fb048139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.898+0000 7fb04659c700 1 -- 172.21.15.156:0/1788081623 >> v2:172.21.15.156:3300/0 conn(0x7fb048131f40 msgr2=0x7fb048139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:03.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.898+0000 7fb04659c700 1 --2- 172.21.15.156:0/1788081623 >> v2:172.21.15.156:3300/0 conn(0x7fb048131f40 0x7fb048139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.898+0000 7fb04659c700 1 -- 172.21.15.156:0/1788081623 >> v1:172.21.15.156:6789/0 conn(0x7fb04809f180 legacy=0x7fb048131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.898+0000 7fb04659c700 1 -- 172.21.15.156:0/1788081623 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04809bab0 con 0x7fb04809e870 2023-09-30T22:25:03.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.898+0000 7fb04659c700 1 --2- 172.21.15.156:0/1788081623 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb04809e870 0x7fb04809ec40 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb038009840 tx=0x7fb038009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f106455fe16bd07 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:03.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.898+0000 7fb04559a700 1 -- 172.21.15.156:0/1788081623 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb038011830 con 0x7fb04809e870 2023-09-30T22:25:03.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.898+0000 7fb04559a700 1 -- 172.21.15.156:0/1788081623 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb038011990 con 0x7fb04809e870 2023-09-30T22:25:03.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.898+0000 7fb04559a700 1 -- 172.21.15.156:0/1788081623 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb038011d20 con 0x7fb04809e870 2023-09-30T22:25:03.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.899+0000 7fb04cccc700 1 -- 172.21.15.156:0/1788081623 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb04809e870 msgr2=0x7fb04809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.899+0000 7fb04cccc700 1 --2- 172.21.15.156:0/1788081623 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb04809e870 0x7fb04809ec40 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb038009840 tx=0x7fb038009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:03.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.899+0000 7fb04cccc700 1 -- 172.21.15.156:0/1788081623 shutdown_connections 2023-09-30T22:25:03.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.899+0000 7fb04cccc700 1 --2- 172.21.15.156:0/1788081623 >> v2:172.21.15.156:3300/0 conn(0x7fb048131f40 0x7fb048139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.899+0000 7fb04cccc700 1 --2- 172.21.15.156:0/1788081623 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb04809e870 0x7fb04809ec40 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.899+0000 7fb04cccc700 1 -- 172.21.15.156:0/1788081623 >> 172.21.15.156:0/1788081623 conn(0x7fb0480a4430 msgr2=0x7fb0480a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:03.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.899+0000 7fb04cccc700 1 -- 172.21.15.156:0/1788081623 shutdown_connections 2023-09-30T22:25:03.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.899+0000 7fb04cccc700 1 -- 172.21.15.156:0/1788081623 wait complete. 2023-09-30T22:25:03.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.901+0000 7fb04cccc700 1 Processor -- start 2023-09-30T22:25:03.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.901+0000 7fb04cccc700 1 -- start start 2023-09-30T22:25:03.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.901+0000 7fb04cccc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb04809e870 0x7fb04811e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.901+0000 7fb04cccc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb04809f180 0x7fb04811e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.901+0000 7fb04cccc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb048131f40 0x7fb04811ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.901+0000 7fb04cccc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04811f730 con 0x7fb04809f180 2023-09-30T22:25:03.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.901+0000 7fb04cccc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0481315b0 con 0x7fb048131f40 2023-09-30T22:25:03.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.901+0000 7fb04cccc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0481203f0 con 0x7fb04809e870 2023-09-30T22:25:03.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.902+0000 7fb04659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb04809e870 0x7fb04811e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.902+0000 7fb04659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb04809e870 0x7fb04811e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:60554/0 (socket says 172.21.15.156:60554) 2023-09-30T22:25:03.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.902+0000 7fb04659c700 1 -- 172.21.15.156:0/2050580926 learned_addr learned my addr 172.21.15.156:0/2050580926 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:03.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.902+0000 7fb045d9b700 1 --2- 172.21.15.156:0/2050580926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb04809f180 0x7fb04811e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.902+0000 7fb046d9d700 1 --2- 172.21.15.156:0/2050580926 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb048131f40 0x7fb04811ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.902+0000 7fb04659c700 1 -- 172.21.15.156:0/2050580926 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb048131f40 msgr2=0x7fb04811ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.902+0000 7fb04659c700 1 --2- 172.21.15.156:0/2050580926 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb048131f40 0x7fb04811ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.902+0000 7fb04659c700 1 -- 172.21.15.156:0/2050580926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb04809f180 msgr2=0x7fb04811e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.902+0000 7fb04659c700 1 --2- 172.21.15.156:0/2050580926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb04809f180 0x7fb04811e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.902+0000 7fb04659c700 1 -- 172.21.15.156:0/2050580926 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0380094a0 con 0x7fb04809e870 2023-09-30T22:25:03.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.902+0000 7fb045d9b700 1 --2- 172.21.15.156:0/2050580926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb04809f180 0x7fb04811e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:03.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.902+0000 7fb04659c700 1 --2- 172.21.15.156:0/2050580926 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb04809e870 0x7fb04811e260 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fb038009b90 tx=0x7fb038004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:03.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.903+0000 7fb036ffd700 1 -- 172.21.15.156:0/2050580926 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb038004510 con 0x7fb04809e870 2023-09-30T22:25:03.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.903+0000 7fb036ffd700 1 -- 172.21.15.156:0/2050580926 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03801e070 con 0x7fb04809e870 2023-09-30T22:25:03.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.903+0000 7fb04cccc700 1 -- 172.21.15.156:0/2050580926 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb048121020 con 0x7fb04809e870 2023-09-30T22:25:03.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.903+0000 7fb04cccc700 1 -- 172.21.15.156:0/2050580926 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04809dba0 con 0x7fb04809e870 2023-09-30T22:25:03.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.903+0000 7fb036ffd700 1 -- 172.21.15.156:0/2050580926 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0380038e0 con 0x7fb04809e870 2023-09-30T22:25:03.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.904+0000 7fb036ffd700 1 -- 172.21.15.156:0/2050580926 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb038003a40 con 0x7fb04809e870 2023-09-30T22:25:03.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.904+0000 7fb04cccc700 1 -- 172.21.15.156:0/2050580926 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb048132840 con 0x7fb04809e870 2023-09-30T22:25:03.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.904+0000 7fb036ffd700 1 -- 172.21.15.156:0/2050580926 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb038040660 con 0x7fb04809e870 2023-09-30T22:25:03.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:03.913+0000 7fb036ffd700 1 -- 172.21.15.156:0/2050580926 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb038003cf0 con 0x7fb04809e870 2023-09-30T22:25:04.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.025+0000 7f5307d01700 1 -- 172.21.15.156:0/1302558402 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5300070010 con 0x7f5300133ad0 2023-09-30T22:25:04.024 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.025+0000 7f52f67fc700 1 -- 172.21.15.156:0/1302558402 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f52fc017090 con 0x7f5300133ad0 2023-09-30T22:25:04.025 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:04.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.028+0000 7f5307d01700 1 -- 172.21.15.156:0/1302558402 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5300133ad0 msgr2=0x7f530012f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:04.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.028+0000 7f5307d01700 1 --2- 172.21.15.156:0/1302558402 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5300133ad0 0x7f530012f750 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f52fc00c4b0 tx=0x7f52fc00c7c0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.028+0000 7f5307d01700 1 -- 172.21.15.156:0/1302558402 shutdown_connections 2023-09-30T22:25:04.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.028+0000 7f5307d01700 1 --2- 172.21.15.156:0/1302558402 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5300139280 0x7f53001c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.028+0000 7f5307d01700 1 --2- 172.21.15.156:0/1302558402 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5300133ad0 0x7f530012f750 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.028+0000 7f5307d01700 1 --2- 172.21.15.156:0/1302558402 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5300136960 0x7f530012fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.028+0000 7f5307d01700 1 -- 172.21.15.156:0/1302558402 >> 172.21.15.156:0/1302558402 conn(0x7f5300099c40 msgr2=0x7f5300134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:04.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.028+0000 7f5307d01700 1 -- 172.21.15.156:0/1302558402 shutdown_connections 2023-09-30T22:25:04.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.028+0000 7f5307d01700 1 -- 172.21.15.156:0/1302558402 wait complete. 2023-09-30T22:25:04.045 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:04.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.074+0000 7f6fa05f6700 1 -- 172.21.15.156:0/4127894714 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6f9804f2a0 con 0x7f6f9809f350 2023-09-30T22:25:04.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.074+0000 7f6f8effd700 1 -- 172.21.15.156:0/4127894714 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f9401e990 con 0x7f6f9809f350 2023-09-30T22:25:04.074 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:04.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.076+0000 7f6fa05f6700 1 -- 172.21.15.156:0/4127894714 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f9809f350 msgr2=0x7f6f981c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:04.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.076+0000 7f6fa05f6700 1 --2- 172.21.15.156:0/4127894714 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f9809f350 0x7f6f981c8910 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f6f9400e940 tx=0x7f6f9400ec50 comp rx=0 tx=0).stop 2023-09-30T22:25:04.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.077+0000 7f6fa05f6700 1 -- 172.21.15.156:0/4127894714 shutdown_connections 2023-09-30T22:25:04.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.077+0000 7f6fa05f6700 1 --2- 172.21.15.156:0/4127894714 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f981371c0 0x7f6f981c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.077+0000 7f6fa05f6700 1 --2- 172.21.15.156:0/4127894714 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6f9809e870 0x7f6f981c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.077+0000 7f6fa05f6700 1 --2- 172.21.15.156:0/4127894714 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f9809f350 0x7f6f981c8910 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.077+0000 7f6fa05f6700 1 -- 172.21.15.156:0/4127894714 >> 172.21.15.156:0/4127894714 conn(0x7f6f980a4430 msgr2=0x7f6f9809c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:04.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.077+0000 7f6fa05f6700 1 -- 172.21.15.156:0/4127894714 shutdown_connections 2023-09-30T22:25:04.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.077+0000 7f6fa05f6700 1 -- 172.21.15.156:0/4127894714 wait complete. 2023-09-30T22:25:04.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:04.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.095+0000 7fbf4d212700 1 -- 172.21.15.156:0/2707533744 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbf28005590 con 0x7fbf480a0a30 2023-09-30T22:25:04.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.095+0000 7fbf2f7fe700 1 -- 172.21.15.156:0/2707533744 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbf38017030 con 0x7fbf480a0a30 2023-09-30T22:25:04.095 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:04.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.097+0000 7fbf4d212700 1 -- 172.21.15.156:0/2707533744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf480a0a30 msgr2=0x7fbf4806df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:04.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.097+0000 7fbf4d212700 1 --2- 172.21.15.156:0/2707533744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf480a0a30 0x7fbf4806df90 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fbf3800c730 tx=0x7fbf3800ca40 comp rx=0 tx=0).stop 2023-09-30T22:25:04.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.097+0000 7fbf4d212700 1 -- 172.21.15.156:0/2707533744 shutdown_connections 2023-09-30T22:25:04.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.097+0000 7fbf4d212700 1 --2- 172.21.15.156:0/2707533744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbf481356e0 0x7fbf4806ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.097+0000 7fbf4d212700 1 --2- 172.21.15.156:0/2707533744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf480a0a30 0x7fbf4806df90 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.097+0000 7fbf4d212700 1 --2- 172.21.15.156:0/2707533744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbf480a1510 0x7fbf4806e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.097+0000 7fbf4d212700 1 -- 172.21.15.156:0/2707533744 >> 172.21.15.156:0/2707533744 conn(0x7fbf480a2980 msgr2=0x7fbf4809e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:04.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.097+0000 7fbf4d212700 1 -- 172.21.15.156:0/2707533744 shutdown_connections 2023-09-30T22:25:04.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.097+0000 7fbf4d212700 1 -- 172.21.15.156:0/2707533744 wait complete. 2023-09-30T22:25:04.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.108+0000 7fb04cccc700 1 -- 172.21.15.156:0/2050580926 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb04804f2a0 con 0x7fb04809e870 2023-09-30T22:25:04.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.109+0000 7fb036ffd700 1 -- 172.21.15.156:0/2050580926 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb038015030 con 0x7fb04809e870 2023-09-30T22:25:04.108 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:04.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:04.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.111+0000 7fb04cccc700 1 -- 172.21.15.156:0/2050580926 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb04809e870 msgr2=0x7fb04811e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:04.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.111+0000 7fb04cccc700 1 --2- 172.21.15.156:0/2050580926 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb04809e870 0x7fb04811e260 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fb038009b90 tx=0x7fb038004750 comp rx=0 tx=0).stop 2023-09-30T22:25:04.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.111+0000 7fb04cccc700 1 -- 172.21.15.156:0/2050580926 shutdown_connections 2023-09-30T22:25:04.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.111+0000 7fb04cccc700 1 --2- 172.21.15.156:0/2050580926 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb048131f40 0x7fb04811ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.111+0000 7fb04cccc700 1 --2- 172.21.15.156:0/2050580926 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb04809e870 0x7fb04811e260 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.111+0000 7fb04cccc700 1 --2- 172.21.15.156:0/2050580926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb04809f180 0x7fb04811e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.111+0000 7fb04cccc700 1 -- 172.21.15.156:0/2050580926 >> 172.21.15.156:0/2050580926 conn(0x7fb0480a4430 msgr2=0x7fb04806d300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:04.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.111+0000 7fb04cccc700 1 -- 172.21.15.156:0/2050580926 shutdown_connections 2023-09-30T22:25:04.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:04.111+0000 7fb04cccc700 1 -- 172.21.15.156:0/2050580926 wait complete. 2023-09-30T22:25:04.122 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:05.045 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:05.089 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:05.110 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:05.124 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:05.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.189+0000 7f7ed4737700 1 Processor -- start 2023-09-30T22:25:05.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.189+0000 7f7ed4737700 1 -- start start 2023-09-30T22:25:05.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.190+0000 7f7ed4737700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7ecc0a0a30 0x7f7ecc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.190+0000 7f7ed4737700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ecc130670 0x7f7ecc1381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.190+0000 7f7ed4737700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ecc0a1e70 con 0x7f7ecc0a1340 2023-09-30T22:25:05.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.190+0000 7f7ed4737700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ecc09a720 con 0x7f7ecc0a0a30 2023-09-30T22:25:05.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.190+0000 7f7ed4737700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc09b300 con 0x7f7ecc130670 2023-09-30T22:25:05.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.190+0000 7f7ed2cd4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ecc130670 0x7f7ecc1381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.190+0000 7f7ed1cd2700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f7ecc0a1340 0x7f7ecc12ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:33628/0 (socket says 172.21.15.156:33628) 2023-09-30T22:25:05.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.190+0000 7f7ed24d3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7ecc0a0a30 0x7f7ecc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.190+0000 7f7ed1cd2700 1 -- 172.21.15.156:0/2006261393 learned_addr learned my addr 172.21.15.156:0/2006261393 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:05.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.191+0000 7f7ed14d1700 1 -- 172.21.15.156:0/2006261393 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2077639863 0 0) 0x7f7ecc0a1e70 con 0x7f7ecc0a1340 2023-09-30T22:25:05.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.191+0000 7f7ed14d1700 1 -- 172.21.15.156:0/2006261393 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eb80035b0 con 0x7f7ecc0a1340 2023-09-30T22:25:05.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.191+0000 7f7ed24d3700 1 -- 172.21.15.156:0/2006261393 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ecc130670 msgr2=0x7f7ecc1381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:05.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.191+0000 7f7ed24d3700 1 --2- 172.21.15.156:0/2006261393 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ecc130670 0x7f7ecc1381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.191+0000 7f7ed24d3700 1 -- 172.21.15.156:0/2006261393 >> v1:172.21.15.156:6789/0 conn(0x7f7ecc0a1340 legacy=0x7f7ecc12ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.191+0000 7f7ed24d3700 1 -- 172.21.15.156:0/2006261393 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ecc09abc0 con 0x7f7ecc0a0a30 2023-09-30T22:25:05.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.191+0000 7f7ed2cd4700 1 --2- 172.21.15.156:0/2006261393 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ecc130670 0x7f7ecc1381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:05.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.191+0000 7f7ed24d3700 1 --2- 172.21.15.156:0/2006261393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ecc0a0a30 0x7f7ecc0a0e00 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f7ec800a940 tx=0x7f7ec800ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12104ac70ef9c6b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:05.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.191+0000 7f7ed14d1700 1 -- 172.21.15.156:0/2006261393 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8007030 con 0x7f7ecc0a0a30 2023-09-30T22:25:05.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.191+0000 7f7ed14d1700 1 -- 172.21.15.156:0/2006261393 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec8007190 con 0x7f7ecc0a0a30 2023-09-30T22:25:05.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.191+0000 7f7ed14d1700 1 -- 172.21.15.156:0/2006261393 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8007500 con 0x7f7ecc0a0a30 2023-09-30T22:25:05.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.192+0000 7f7ed4737700 1 -- 172.21.15.156:0/2006261393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ecc0a0a30 msgr2=0x7f7ecc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.192+0000 7f7ed4737700 1 --2- 172.21.15.156:0/2006261393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ecc0a0a30 0x7f7ecc0a0e00 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f7ec800a940 tx=0x7f7ec800ac50 comp rx=0 tx=0).stop 2023-09-30T22:25:05.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.192+0000 7f7ed4737700 1 -- 172.21.15.156:0/2006261393 shutdown_connections 2023-09-30T22:25:05.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.192+0000 7f7ed4737700 1 --2- 172.21.15.156:0/2006261393 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ecc130670 0x7f7ecc1381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.192+0000 7f7ed4737700 1 --2- 172.21.15.156:0/2006261393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ecc0a0a30 0x7f7ecc0a0e00 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.192+0000 7f7ed4737700 1 -- 172.21.15.156:0/2006261393 >> 172.21.15.156:0/2006261393 conn(0x7f7ecc0a2980 msgr2=0x7f7ecc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:05.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.192+0000 7f7ed4737700 1 -- 172.21.15.156:0/2006261393 shutdown_connections 2023-09-30T22:25:05.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.192+0000 7f7ed4737700 1 -- 172.21.15.156:0/2006261393 wait complete. 2023-09-30T22:25:05.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.193+0000 7f7ed4737700 1 Processor -- start 2023-09-30T22:25:05.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.193+0000 7f7ed4737700 1 -- start start 2023-09-30T22:25:05.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.194+0000 7f7ed4737700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7ecc0a0a30 0x7f7ecc1c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.194+0000 7f7ed4737700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ecc0a1340 0x7f7ecc1c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.194+0000 7f7ed4737700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ecc130670 0x7f7ecc1c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.194+0000 7f7ed4737700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc120f10 con 0x7f7ecc0a1340 2023-09-30T22:25:05.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.194+0000 7f7ed4737700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc122bb0 con 0x7f7ecc130670 2023-09-30T22:25:05.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.194+0000 7f7ed4737700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc09ae00 con 0x7f7ecc0a0a30 2023-09-30T22:25:05.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.194+0000 7f7ed1cd2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ecc0a1340 0x7f7ecc1c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.194+0000 7f7ed1cd2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ecc0a1340 0x7f7ecc1c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33182/0 (socket says 172.21.15.156:33182) 2023-09-30T22:25:05.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.194+0000 7f7ed1cd2700 1 -- 172.21.15.156:0/4291542528 learned_addr learned my addr 172.21.15.156:0/4291542528 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:05.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.194+0000 7f7ed2cd4700 1 --2- 172.21.15.156:0/4291542528 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ecc130670 0x7f7ecc1c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.194+0000 7f7ed1cd2700 1 -- 172.21.15.156:0/4291542528 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7ecc0a0a30 msgr2=0x7f7ecc1c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.194+0000 7f7ed1cd2700 1 --2- 172.21.15.156:0/4291542528 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7ecc0a0a30 0x7f7ecc1c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.194+0000 7f7ed1cd2700 1 -- 172.21.15.156:0/4291542528 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ecc130670 msgr2=0x7f7ecc1c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.194+0000 7f7ed1cd2700 1 --2- 172.21.15.156:0/4291542528 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ecc130670 0x7f7ecc1c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.194+0000 7f7ed1cd2700 1 -- 172.21.15.156:0/4291542528 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec4009a70 con 0x7f7ecc0a1340 2023-09-30T22:25:05.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.194+0000 7f7ed1cd2700 1 --2- 172.21.15.156:0/4291542528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ecc0a1340 0x7f7ecc1c8520 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00c700 tx=0x7f7ebc00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:05.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.195+0000 7f7ec2ffd700 1 -- 172.21.15.156:0/4291542528 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc005d70 con 0x7f7ecc0a1340 2023-09-30T22:25:05.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.195+0000 7f7ec2ffd700 1 -- 172.21.15.156:0/4291542528 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ebc0070d0 con 0x7f7ecc0a1340 2023-09-30T22:25:05.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.195+0000 7f7ed4737700 1 -- 172.21.15.156:0/4291542528 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec800a550 con 0x7f7ecc0a1340 2023-09-30T22:25:05.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.195+0000 7f7ec2ffd700 1 -- 172.21.15.156:0/4291542528 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc007460 con 0x7f7ecc0a1340 2023-09-30T22:25:05.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.195+0000 7f7ed4737700 1 -- 172.21.15.156:0/4291542528 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ecc122880 con 0x7f7ecc0a1340 2023-09-30T22:25:05.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.196+0000 7f7ec2ffd700 1 -- 172.21.15.156:0/4291542528 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ebc0075c0 con 0x7f7ecc0a1340 2023-09-30T22:25:05.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.196+0000 7f7ed4737700 1 -- 172.21.15.156:0/4291542528 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ecc04f2a0 con 0x7f7ecc0a1340 2023-09-30T22:25:05.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.196+0000 7f7ec2ffd700 1 -- 172.21.15.156:0/4291542528 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7ebc03eca0 con 0x7f7ecc0a1340 2023-09-30T22:25:05.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.205+0000 7f7ec2ffd700 1 -- 172.21.15.156:0/4291542528 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ebc043070 con 0x7f7ecc0a1340 2023-09-30T22:25:05.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.229+0000 7f18ebf98700 1 Processor -- start 2023-09-30T22:25:05.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.229+0000 7f18ebf98700 1 -- start start 2023-09-30T22:25:05.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.230+0000 7f18ebf98700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f18e4130540 0x7f18e4130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.230+0000 7f18ebf98700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18e4134050 0x7f18e413b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.230+0000 7f18ebf98700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e409fc70 con 0x7f18e4133550 2023-09-30T22:25:05.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.230+0000 7f18ebf98700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e406c5e0 con 0x7f18e4130540 2023-09-30T22:25:05.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.230+0000 7f18ebf98700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18e4134490 con 0x7f18e4134050 2023-09-30T22:25:05.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.230+0000 7f18e9d34700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f18e4130540 0x7f18e4130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.230+0000 7f18e9d34700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f18e4130540 0x7f18e4130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33186/0 (socket says 172.21.15.156:33186) 2023-09-30T22:25:05.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.230+0000 7f18e9d34700 1 -- 172.21.15.156:0/2081265055 learned_addr learned my addr 172.21.15.156:0/2081265055 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:05.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.230+0000 7f18ea535700 1 --2- 172.21.15.156:0/2081265055 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18e4134050 0x7f18e413b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.230+0000 7f18e9d34700 1 -- 172.21.15.156:0/2081265055 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18e4134050 msgr2=0x7f18e413b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:05.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.230+0000 7f18e9d34700 1 --2- 172.21.15.156:0/2081265055 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18e4134050 0x7f18e413b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.230+0000 7f18e9d34700 1 -- 172.21.15.156:0/2081265055 >> v1:172.21.15.156:6789/0 conn(0x7f18e4133550 legacy=0x7f18e4133940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.230+0000 7f18e9d34700 1 -- 172.21.15.156:0/2081265055 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e40a0040 con 0x7f18e4130540 2023-09-30T22:25:05.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.230+0000 7f18ea535700 1 --2- 172.21.15.156:0/2081265055 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18e4134050 0x7f18e413b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:05.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.230+0000 7f18e9d34700 1 --2- 172.21.15.156:0/2081265055 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e4130540 0x7f18e4130910 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f18e00098f0 tx=0x7f18e0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ab9734d3fc46b9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:05.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.230+0000 7f18e8d32700 1 -- 172.21.15.156:0/2081265055 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e0011830 con 0x7f18e4130540 2023-09-30T22:25:05.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.231+0000 7f18e8d32700 1 -- 172.21.15.156:0/2081265055 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e0011990 con 0x7f18e4130540 2023-09-30T22:25:05.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.231+0000 7f18e8d32700 1 -- 172.21.15.156:0/2081265055 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e0011d20 con 0x7f18e4130540 2023-09-30T22:25:05.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.231+0000 7f18ebf98700 1 -- 172.21.15.156:0/2081265055 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e4130540 msgr2=0x7f18e4130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.231+0000 7f18ebf98700 1 --2- 172.21.15.156:0/2081265055 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e4130540 0x7f18e4130910 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f18e00098f0 tx=0x7f18e0009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:05.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.231+0000 7f18ebf98700 1 -- 172.21.15.156:0/2081265055 shutdown_connections 2023-09-30T22:25:05.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.231+0000 7f18ebf98700 1 --2- 172.21.15.156:0/2081265055 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e4130540 0x7f18e4130910 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.231+0000 7f18ebf98700 1 --2- 172.21.15.156:0/2081265055 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18e4134050 0x7f18e413b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.231+0000 7f18ebf98700 1 -- 172.21.15.156:0/2081265055 >> 172.21.15.156:0/2081265055 conn(0x7f18e40a0b50 msgr2=0x7f18e40a0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:05.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.231+0000 7f18ebf98700 1 -- 172.21.15.156:0/2081265055 shutdown_connections 2023-09-30T22:25:05.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.231+0000 7f18ebf98700 1 -- 172.21.15.156:0/2081265055 wait complete. 2023-09-30T22:25:05.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.232+0000 7f18ebf98700 1 Processor -- start 2023-09-30T22:25:05.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.233+0000 7f18ebf98700 1 -- start start 2023-09-30T22:25:05.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.233+0000 7f18ebf98700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e4130540 0x7f18e409dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.233+0000 7f18ebf98700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18e4133550 0x7f18e409e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.233+0000 7f18ebf98700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18e4134050 0x7f18e4128310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.233+0000 7f18ebf98700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e409ceb0 con 0x7f18e4130540 2023-09-30T22:25:05.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.233+0000 7f18ebf98700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e409c350 con 0x7f18e4133550 2023-09-30T22:25:05.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.233+0000 7f18ebf98700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18e409f4b0 con 0x7f18e4134050 2023-09-30T22:25:05.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.233+0000 7f18e9533700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18e4133550 0x7f18e409e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.233+0000 7f18e9533700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18e4133550 0x7f18e409e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:50698/0 (socket says 172.21.15.156:50698) 2023-09-30T22:25:05.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.233+0000 7f18e9533700 1 -- 172.21.15.156:0/4129410526 learned_addr learned my addr 172.21.15.156:0/4129410526 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:05.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.234+0000 7f18e9533700 1 -- 172.21.15.156:0/4129410526 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18e4134050 msgr2=0x7f18e4128310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.234+0000 7f18e9533700 1 --2- 172.21.15.156:0/4129410526 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18e4134050 0x7f18e4128310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.234+0000 7f18e9533700 1 -- 172.21.15.156:0/4129410526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e4130540 msgr2=0x7f18e409dbc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:05.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.234+0000 7f18e9533700 1 --2- 172.21.15.156:0/4129410526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e4130540 0x7f18e409dbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.234+0000 7f18e9533700 1 -- 172.21.15.156:0/4129410526 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18dc009a70 con 0x7f18e4133550 2023-09-30T22:25:05.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.234+0000 7f18e9533700 1 --2- 172.21.15.156:0/4129410526 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18e4133550 0x7f18e409e100 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f18d400c4e0 tx=0x7f18d400c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:05.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.234+0000 7f18da7fc700 1 -- 172.21.15.156:0/4129410526 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d40052d0 con 0x7f18e4133550 2023-09-30T22:25:05.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.234+0000 7f18da7fc700 1 -- 172.21.15.156:0/4129410526 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d4005430 con 0x7f18e4133550 2023-09-30T22:25:05.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.234+0000 7f18da7fc700 1 -- 172.21.15.156:0/4129410526 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d40038c0 con 0x7f18e4133550 2023-09-30T22:25:05.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.235+0000 7f18ebf98700 1 -- 172.21.15.156:0/4129410526 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e0009550 con 0x7f18e4133550 2023-09-30T22:25:05.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.235+0000 7f18ebf98700 1 -- 172.21.15.156:0/4129410526 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e409d4d0 con 0x7f18e4133550 2023-09-30T22:25:05.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.236+0000 7f18da7fc700 1 -- 172.21.15.156:0/4129410526 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f18d4003a20 con 0x7f18e4133550 2023-09-30T22:25:05.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.236+0000 7f18ebf98700 1 -- 172.21.15.156:0/4129410526 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e404f2a0 con 0x7f18e4133550 2023-09-30T22:25:05.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.236+0000 7f18da7fc700 1 -- 172.21.15.156:0/4129410526 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f18d403eca0 con 0x7f18e4133550 2023-09-30T22:25:05.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.244+0000 7f18da7fc700 1 -- 172.21.15.156:0/4129410526 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f18d40011c0 con 0x7f18e4133550 2023-09-30T22:25:05.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.270+0000 7f9d2b8dd700 1 Processor -- start 2023-09-30T22:25:05.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.271+0000 7f9d2b8dd700 1 -- start start 2023-09-30T22:25:05.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.271+0000 7f9d2b8dd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d240a0a70 0x7f9d240a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.271+0000 7f9d2b8dd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9d240a1380 0x7f9d24133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.271+0000 7f9d2b8dd700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d2409dc00 con 0x7f9d24133f50 2023-09-30T22:25:05.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.271+0000 7f9d2b8dd700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d2409ea60 con 0x7f9d240a1380 2023-09-30T22:25:05.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.271+0000 7f9d2b8dd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2409dec0 con 0x7f9d240a0a70 2023-09-30T22:25:05.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.271+0000 7f9d29679700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d240a0a70 0x7f9d240a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.271+0000 7f9d29679700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d240a0a70 0x7f9d240a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:50714/0 (socket says 172.21.15.156:50714) 2023-09-30T22:25:05.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.271+0000 7f9d29679700 1 -- 172.21.15.156:0/192804875 learned_addr learned my addr 172.21.15.156:0/192804875 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:05.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.271+0000 7f9d28e78700 1 --2- 172.21.15.156:0/192804875 >> v2:172.21.15.156:3300/0 conn(0x7f9d240a1380 0x7f9d24133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.272+0000 7f9d28e78700 1 -- 172.21.15.156:0/192804875 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d240a0a70 msgr2=0x7f9d240a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:05.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.272+0000 7f9d28e78700 1 --2- 172.21.15.156:0/192804875 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d240a0a70 0x7f9d240a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.272+0000 7f9d28e78700 1 -- 172.21.15.156:0/192804875 >> v1:172.21.15.156:6789/0 conn(0x7f9d24133f50 legacy=0x7f9d2413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.272+0000 7f9d1bfff700 1 -- 172.21.15.156:0/192804875 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231536162 0 0) 0x7f9d2409dc00 con 0x7f9d24133f50 2023-09-30T22:25:05.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.272+0000 7f9d28e78700 1 -- 172.21.15.156:0/192804875 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2409e6a0 con 0x7f9d240a1380 2023-09-30T22:25:05.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.272+0000 7f9d28e78700 1 --2- 172.21.15.156:0/192804875 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d240a1380 0x7f9d24133a10 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f9d14009840 tx=0x7f9d14009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f245d47bc3f40d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:05.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.272+0000 7f9d1bfff700 1 -- 172.21.15.156:0/192804875 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d14011830 con 0x7f9d240a1380 2023-09-30T22:25:05.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.272+0000 7f9d1bfff700 1 -- 172.21.15.156:0/192804875 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d14011990 con 0x7f9d240a1380 2023-09-30T22:25:05.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.272+0000 7f9d1bfff700 1 -- 172.21.15.156:0/192804875 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d14011d20 con 0x7f9d240a1380 2023-09-30T22:25:05.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.273+0000 7f9d2b8dd700 1 -- 172.21.15.156:0/192804875 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d240a1380 msgr2=0x7f9d24133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.273+0000 7f9d2b8dd700 1 --2- 172.21.15.156:0/192804875 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d240a1380 0x7f9d24133a10 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f9d14009840 tx=0x7f9d14009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:05.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.273+0000 7f9d2b8dd700 1 -- 172.21.15.156:0/192804875 shutdown_connections 2023-09-30T22:25:05.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.273+0000 7f9d2b8dd700 1 --2- 172.21.15.156:0/192804875 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d240a0a70 0x7f9d240a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.273+0000 7f9d2b8dd700 1 --2- 172.21.15.156:0/192804875 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d240a1380 0x7f9d24133a10 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.273+0000 7f9d2b8dd700 1 -- 172.21.15.156:0/192804875 >> 172.21.15.156:0/192804875 conn(0x7f9d240a6610 msgr2=0x7f9d240a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:05.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.273+0000 7f9d2b8dd700 1 -- 172.21.15.156:0/192804875 shutdown_connections 2023-09-30T22:25:05.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.273+0000 7f9d2b8dd700 1 -- 172.21.15.156:0/192804875 wait complete. 2023-09-30T22:25:05.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.274+0000 7f9d2b8dd700 1 Processor -- start 2023-09-30T22:25:05.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.274+0000 7f9d2b8dd700 1 -- start start 2023-09-30T22:25:05.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.274+0000 7f9d2b8dd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d240a0a70 0x7f9d241229c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.274+0000 7f9d2b8dd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d240a1380 0x7f9d24122f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.274+0000 7f9d2b8dd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d24133f50 0x7f9d24123440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.274+0000 7f9d2b8dd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d24126530 con 0x7f9d24133f50 2023-09-30T22:25:05.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.274+0000 7f9d2b8dd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d240a03e0 con 0x7f9d240a1380 2023-09-30T22:25:05.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.274+0000 7f9d2b8dd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d24133990 con 0x7f9d240a0a70 2023-09-30T22:25:05.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.274+0000 7f9d28e78700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d240a1380 0x7f9d24122f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.275+0000 7f9d28e78700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d240a1380 0x7f9d24122f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:50720/0 (socket says 172.21.15.156:50720) 2023-09-30T22:25:05.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.275+0000 7f9d28e78700 1 -- 172.21.15.156:0/2017652777 learned_addr learned my addr 172.21.15.156:0/2017652777 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:05.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.275+0000 7f9d29e7a700 1 --2- 172.21.15.156:0/2017652777 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d24133f50 0x7f9d24123440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.275+0000 7f9d29679700 1 --2- 172.21.15.156:0/2017652777 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d240a0a70 0x7f9d241229c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.275+0000 7f9d28e78700 1 -- 172.21.15.156:0/2017652777 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d240a0a70 msgr2=0x7f9d241229c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.275+0000 7f9d28e78700 1 --2- 172.21.15.156:0/2017652777 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d240a0a70 0x7f9d241229c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.275+0000 7f9d28e78700 1 -- 172.21.15.156:0/2017652777 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d24133f50 msgr2=0x7f9d24123440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.275+0000 7f9d28e78700 1 --2- 172.21.15.156:0/2017652777 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d24133f50 0x7f9d24123440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.275+0000 7f9d28e78700 1 -- 172.21.15.156:0/2017652777 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d140094a0 con 0x7f9d240a1380 2023-09-30T22:25:05.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.275+0000 7f9d29e7a700 1 --2- 172.21.15.156:0/2017652777 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d24133f50 0x7f9d24123440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:05.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.275+0000 7f9d28e78700 1 --2- 172.21.15.156:0/2017652777 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d240a1380 0x7f9d24122f00 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f9d14009fd0 tx=0x7f9d14004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:05.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.275+0000 7f9d19ffb700 1 -- 172.21.15.156:0/2017652777 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d140036a0 con 0x7f9d240a1380 2023-09-30T22:25:05.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.275+0000 7f9d19ffb700 1 -- 172.21.15.156:0/2017652777 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1401f070 con 0x7f9d240a1380 2023-09-30T22:25:05.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.275+0000 7f9d19ffb700 1 -- 172.21.15.156:0/2017652777 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d14003a60 con 0x7f9d240a1380 2023-09-30T22:25:05.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.275+0000 7f9d2b8dd700 1 -- 172.21.15.156:0/2017652777 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d24133450 con 0x7f9d240a1380 2023-09-30T22:25:05.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.276+0000 7f9d2b8dd700 1 -- 172.21.15.156:0/2017652777 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d24124540 con 0x7f9d240a1380 2023-09-30T22:25:05.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.276+0000 7f9d19ffb700 1 -- 172.21.15.156:0/2017652777 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d14003bc0 con 0x7f9d240a1380 2023-09-30T22:25:05.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.276+0000 7f9d2b8dd700 1 -- 172.21.15.156:0/2017652777 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d2404f2a0 con 0x7f9d240a1380 2023-09-30T22:25:05.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.277+0000 7f9d19ffb700 1 -- 172.21.15.156:0/2017652777 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9d14021070 con 0x7f9d240a1380 2023-09-30T22:25:05.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.281+0000 7f9d19ffb700 1 -- 172.21.15.156:0/2017652777 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d140253e0 con 0x7f9d240a1380 2023-09-30T22:25:05.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.309+0000 7fa75e2f9700 1 Processor -- start 2023-09-30T22:25:05.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.309+0000 7fa75e2f9700 1 -- start start 2023-09-30T22:25:05.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.310+0000 7fa75e2f9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa758133ad0 0x7fa758133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.310+0000 7fa75e2f9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7581300a0 0x7fa7581304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.310+0000 7fa75e2f9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa7581309f0 0x7fa75813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.310+0000 7fa75e2f9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa75806b2d0 con 0x7fa7581309f0 2023-09-30T22:25:05.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.310+0000 7fa75e2f9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa758133610 con 0x7fa758133ad0 2023-09-30T22:25:05.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.310+0000 7fa75e2f9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa75809a500 con 0x7fa7581300a0 2023-09-30T22:25:05.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.310+0000 7fa75c896700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa7581309f0 0x7fa75813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.310+0000 7fa7577fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7581300a0 0x7fa7581304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.310+0000 7fa75c896700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa7581309f0 0x7fa75813a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33212/0 (socket says 172.21.15.156:33212) 2023-09-30T22:25:05.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.310+0000 7fa7577fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7581300a0 0x7fa7581304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:60590/0 (socket says 172.21.15.156:60590) 2023-09-30T22:25:05.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.310+0000 7fa75c896700 1 -- 172.21.15.156:0/1940795823 learned_addr learned my addr 172.21.15.156:0/1940795823 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:05.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.310+0000 7fa757fff700 1 --2- 172.21.15.156:0/1940795823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa758133ad0 0x7fa758133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.311+0000 7fa757fff700 1 -- 172.21.15.156:0/1940795823 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7581300a0 msgr2=0x7fa7581304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:05.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.311+0000 7fa757fff700 1 --2- 172.21.15.156:0/1940795823 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7581300a0 0x7fa7581304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.311+0000 7fa757fff700 1 -- 172.21.15.156:0/1940795823 >> v2:172.21.15.156:3300/0 conn(0x7fa7581309f0 msgr2=0x7fa75813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:05.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.311+0000 7fa757fff700 1 --2- 172.21.15.156:0/1940795823 >> v2:172.21.15.156:3300/0 conn(0x7fa7581309f0 0x7fa75813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.311+0000 7fa757fff700 1 -- 172.21.15.156:0/1940795823 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7581338b0 con 0x7fa758133ad0 2023-09-30T22:25:05.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.311+0000 7fa75c896700 1 --2- 172.21.15.156:0/1940795823 >> v2:172.21.15.156:3300/0 conn(0x7fa7581309f0 0x7fa75813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:05.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.311+0000 7fa757fff700 1 --2- 172.21.15.156:0/1940795823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa758133ad0 0x7fa758133ea0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa748009840 tx=0x7fa748009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b05760c42fc906ba server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:05.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.311+0000 7fa756ffd700 1 -- 172.21.15.156:0/1940795823 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748011830 con 0x7fa758133ad0 2023-09-30T22:25:05.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.311+0000 7fa756ffd700 1 -- 172.21.15.156:0/1940795823 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa748011990 con 0x7fa758133ad0 2023-09-30T22:25:05.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.311+0000 7fa756ffd700 1 -- 172.21.15.156:0/1940795823 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748011d20 con 0x7fa758133ad0 2023-09-30T22:25:05.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.312+0000 7fa75e2f9700 1 -- 172.21.15.156:0/1940795823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa758133ad0 msgr2=0x7fa758133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.312+0000 7fa75e2f9700 1 --2- 172.21.15.156:0/1940795823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa758133ad0 0x7fa758133ea0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa748009840 tx=0x7fa748009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:05.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.312+0000 7fa75e2f9700 1 -- 172.21.15.156:0/1940795823 shutdown_connections 2023-09-30T22:25:05.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.312+0000 7fa75e2f9700 1 --2- 172.21.15.156:0/1940795823 >> v2:172.21.15.156:3300/0 conn(0x7fa7581309f0 0x7fa75813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.312+0000 7fa75e2f9700 1 --2- 172.21.15.156:0/1940795823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa758133ad0 0x7fa758133ea0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.312+0000 7fa75e2f9700 1 --2- 172.21.15.156:0/1940795823 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7581300a0 0x7fa7581304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.312+0000 7fa75e2f9700 1 -- 172.21.15.156:0/1940795823 >> 172.21.15.156:0/1940795823 conn(0x7fa758099c40 msgr2=0x7fa7580a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:05.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.312+0000 7fa75e2f9700 1 -- 172.21.15.156:0/1940795823 shutdown_connections 2023-09-30T22:25:05.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.312+0000 7fa75e2f9700 1 -- 172.21.15.156:0/1940795823 wait complete. 2023-09-30T22:25:05.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.314+0000 7fa75e2f9700 1 Processor -- start 2023-09-30T22:25:05.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.314+0000 7fa75e2f9700 1 -- start start 2023-09-30T22:25:05.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.314+0000 7fa75e2f9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7581300a0 0x7fa75811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.314+0000 7fa75e2f9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7581309f0 0x7fa75811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.315+0000 7fa75e2f9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa758133ad0 0x7fa75811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.315+0000 7fa75e2f9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75811ed30 con 0x7fa758133ad0 2023-09-30T22:25:05.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.315+0000 7fa75e2f9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa758120ac0 con 0x7fa7581309f0 2023-09-30T22:25:05.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.315+0000 7fa75e2f9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7580a2ea0 con 0x7fa7581300a0 2023-09-30T22:25:05.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.315+0000 7fa75c896700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa758133ad0 0x7fa75811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.315+0000 7fa75c896700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa758133ad0 0x7fa75811e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33224/0 (socket says 172.21.15.156:33224) 2023-09-30T22:25:05.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.315+0000 7fa75c896700 1 -- 172.21.15.156:0/3953584266 learned_addr learned my addr 172.21.15.156:0/3953584266 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:05.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.315+0000 7fa757fff700 1 --2- 172.21.15.156:0/3953584266 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7581300a0 0x7fa75811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.315+0000 7fa7577fe700 1 --2- 172.21.15.156:0/3953584266 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7581309f0 0x7fa75811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.315+0000 7fa757fff700 1 -- 172.21.15.156:0/3953584266 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7581309f0 msgr2=0x7fa75811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.315+0000 7fa757fff700 1 --2- 172.21.15.156:0/3953584266 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7581309f0 0x7fa75811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.315+0000 7fa757fff700 1 -- 172.21.15.156:0/3953584266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa758133ad0 msgr2=0x7fa75811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.315+0000 7fa757fff700 1 --2- 172.21.15.156:0/3953584266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa758133ad0 0x7fa75811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.315+0000 7fa757fff700 1 -- 172.21.15.156:0/3953584266 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa750009b30 con 0x7fa7581300a0 2023-09-30T22:25:05.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.315+0000 7fa757fff700 1 --2- 172.21.15.156:0/3953584266 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7581300a0 0x7fa75811da40 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa748016000 tx=0x7fa748004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:05.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.315+0000 7fa754ff9700 1 -- 172.21.15.156:0/3953584266 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748004450 con 0x7fa7581300a0 2023-09-30T22:25:05.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.316+0000 7fa754ff9700 1 -- 172.21.15.156:0/3953584266 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7480036a0 con 0x7fa7581300a0 2023-09-30T22:25:05.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.316+0000 7fa75e2f9700 1 -- 172.21.15.156:0/3953584266 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7480094a0 con 0x7fa7581300a0 2023-09-30T22:25:05.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.316+0000 7fa754ff9700 1 -- 172.21.15.156:0/3953584266 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7480045f0 con 0x7fa7581300a0 2023-09-30T22:25:05.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.316+0000 7fa75e2f9700 1 -- 172.21.15.156:0/3953584266 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75811fbb0 con 0x7fa7581300a0 2023-09-30T22:25:05.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.317+0000 7fa75e2f9700 1 -- 172.21.15.156:0/3953584266 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa75804f2a0 con 0x7fa7581300a0 2023-09-30T22:25:05.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.317+0000 7fa754ff9700 1 -- 172.21.15.156:0/3953584266 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa748003a50 con 0x7fa7581300a0 2023-09-30T22:25:05.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.318+0000 7fa754ff9700 1 -- 172.21.15.156:0/3953584266 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa748040680 con 0x7fa7581300a0 2023-09-30T22:25:05.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.326+0000 7fa754ff9700 1 -- 172.21.15.156:0/3953584266 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa748003d00 con 0x7fa7581300a0 2023-09-30T22:25:05.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.445+0000 7f18ebf98700 1 -- 172.21.15.156:0/4129410526 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f18e406b1f0 con 0x7f18e4133550 2023-09-30T22:25:05.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.446+0000 7f18da7fc700 1 -- 172.21.15.156:0/4129410526 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f18d4017070 con 0x7f18e4133550 2023-09-30T22:25:05.446 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:05.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.446+0000 7f7ed4737700 1 -- 172.21.15.156:0/4291542528 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7ecc06bce0 con 0x7f7ecc0a1340 2023-09-30T22:25:05.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.447+0000 7f7ec2ffd700 1 -- 172.21.15.156:0/4291542528 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7ebc017020 con 0x7f7ecc0a1340 2023-09-30T22:25:05.447 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:05.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.449+0000 7f7ed4737700 1 -- 172.21.15.156:0/4291542528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ecc0a1340 msgr2=0x7f7ecc1c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.449+0000 7f7ed4737700 1 --2- 172.21.15.156:0/4291542528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ecc0a1340 0x7f7ecc1c8520 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00c700 tx=0x7f7ebc00cac0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.449+0000 7f7ed4737700 1 -- 172.21.15.156:0/4291542528 shutdown_connections 2023-09-30T22:25:05.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.449+0000 7f7ed4737700 1 --2- 172.21.15.156:0/4291542528 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7ecc130670 0x7f7ecc1c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.449+0000 7f7ed4737700 1 --2- 172.21.15.156:0/4291542528 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7ecc0a0a30 0x7f7ecc1c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.449+0000 7f7ed4737700 1 --2- 172.21.15.156:0/4291542528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ecc0a1340 0x7f7ecc1c8520 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.449+0000 7f7ed4737700 1 -- 172.21.15.156:0/4291542528 >> 172.21.15.156:0/4291542528 conn(0x7f7ecc0a2980 msgr2=0x7f7ecc1b7870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:05.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.449+0000 7f18ebf98700 1 -- 172.21.15.156:0/4129410526 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18e4133550 msgr2=0x7f18e409e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.449+0000 7f18ebf98700 1 --2- 172.21.15.156:0/4129410526 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18e4133550 0x7f18e409e100 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f18d400c4e0 tx=0x7f18d400c8a0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.449+0000 7f18ebf98700 1 -- 172.21.15.156:0/4129410526 shutdown_connections 2023-09-30T22:25:05.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.449+0000 7f18ebf98700 1 --2- 172.21.15.156:0/4129410526 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f18e4134050 0x7f18e4128310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.449+0000 7f18ebf98700 1 --2- 172.21.15.156:0/4129410526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e4130540 0x7f18e409dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.449+0000 7f18ebf98700 1 --2- 172.21.15.156:0/4129410526 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f18e4133550 0x7f18e409e100 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.449+0000 7f18ebf98700 1 -- 172.21.15.156:0/4129410526 >> 172.21.15.156:0/4129410526 conn(0x7f18e40a0b50 msgr2=0x7f18e406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:05.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.449+0000 7f18ebf98700 1 -- 172.21.15.156:0/4129410526 shutdown_connections 2023-09-30T22:25:05.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.449+0000 7f18ebf98700 1 -- 172.21.15.156:0/4129410526 wait complete. 2023-09-30T22:25:05.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.450+0000 7f7ed4737700 1 -- 172.21.15.156:0/4291542528 shutdown_connections 2023-09-30T22:25:05.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.450+0000 7f7ed4737700 1 -- 172.21.15.156:0/4291542528 wait complete. 2023-09-30T22:25:05.467 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:05.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:05.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.494+0000 7f9d2b8dd700 1 -- 172.21.15.156:0/2017652777 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9d24072980 con 0x7f9d240a1380 2023-09-30T22:25:05.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.495+0000 7f9d19ffb700 1 -- 172.21.15.156:0/2017652777 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d14015020 con 0x7f9d240a1380 2023-09-30T22:25:05.494 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:05.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.497+0000 7f9d2b8dd700 1 -- 172.21.15.156:0/2017652777 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d240a1380 msgr2=0x7f9d24122f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.497+0000 7f9d2b8dd700 1 --2- 172.21.15.156:0/2017652777 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d240a1380 0x7f9d24122f00 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f9d14009fd0 tx=0x7f9d14004750 comp rx=0 tx=0).stop 2023-09-30T22:25:05.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.497+0000 7f9d2b8dd700 1 -- 172.21.15.156:0/2017652777 shutdown_connections 2023-09-30T22:25:05.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.497+0000 7f9d2b8dd700 1 --2- 172.21.15.156:0/2017652777 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d24133f50 0x7f9d24123440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.497+0000 7f9d2b8dd700 1 --2- 172.21.15.156:0/2017652777 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9d240a0a70 0x7f9d241229c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.497+0000 7f9d2b8dd700 1 --2- 172.21.15.156:0/2017652777 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9d240a1380 0x7f9d24122f00 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.497+0000 7f9d2b8dd700 1 -- 172.21.15.156:0/2017652777 >> 172.21.15.156:0/2017652777 conn(0x7f9d240a6610 msgr2=0x7f9d2409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:05.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.497+0000 7f9d2b8dd700 1 -- 172.21.15.156:0/2017652777 shutdown_connections 2023-09-30T22:25:05.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.497+0000 7f9d2b8dd700 1 -- 172.21.15.156:0/2017652777 wait complete. 2023-09-30T22:25:05.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:05.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.535+0000 7fa75e2f9700 1 -- 172.21.15.156:0/3953584266 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa75811f940 con 0x7fa7581300a0 2023-09-30T22:25:05.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.536+0000 7fa754ff9700 1 -- 172.21.15.156:0/3953584266 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa748015030 con 0x7fa7581300a0 2023-09-30T22:25:05.535 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:05.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.538+0000 7fa75e2f9700 1 -- 172.21.15.156:0/3953584266 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7581300a0 msgr2=0x7fa75811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.538+0000 7fa75e2f9700 1 --2- 172.21.15.156:0/3953584266 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7581300a0 0x7fa75811da40 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa748016000 tx=0x7fa748004750 comp rx=0 tx=0).stop 2023-09-30T22:25:05.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.538+0000 7fa75e2f9700 1 -- 172.21.15.156:0/3953584266 shutdown_connections 2023-09-30T22:25:05.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.538+0000 7fa75e2f9700 1 --2- 172.21.15.156:0/3953584266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa758133ad0 0x7fa75811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.538+0000 7fa75e2f9700 1 --2- 172.21.15.156:0/3953584266 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa7581300a0 0x7fa75811da40 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.538+0000 7fa75e2f9700 1 --2- 172.21.15.156:0/3953584266 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa7581309f0 0x7fa75811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.538+0000 7fa75e2f9700 1 -- 172.21.15.156:0/3953584266 >> 172.21.15.156:0/3953584266 conn(0x7fa758099c40 msgr2=0x7fa75812f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:05.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.538+0000 7fa75e2f9700 1 -- 172.21.15.156:0/3953584266 shutdown_connections 2023-09-30T22:25:05.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:05.538+0000 7fa75e2f9700 1 -- 172.21.15.156:0/3953584266 wait complete. 2023-09-30T22:25:05.549 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:06.468 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:06.469 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:06.509 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:06.550 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:06.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.610+0000 7fb3eb973700 1 Processor -- start 2023-09-30T22:25:06.610 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.611+0000 7fb3eb973700 1 -- start start 2023-09-30T22:25:06.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.611+0000 7fd96b0a6700 1 Processor -- start 2023-09-30T22:25:06.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.611+0000 7fb3eb973700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb3e4133ad0 0x7fb3e4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.611+0000 7fb3eb973700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb3e41300a0 0x7fb3e41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.611+0000 7fb3eb973700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb3e41309f0 0x7fb3e413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.611+0000 7fb3eb973700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e406b2d0 con 0x7fb3e41309f0 2023-09-30T22:25:06.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.611+0000 7fb3eb973700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e4133610 con 0x7fb3e41300a0 2023-09-30T22:25:06.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.611+0000 7fb3eb973700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e409a500 con 0x7fb3e4133ad0 2023-09-30T22:25:06.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.611+0000 7fb3e9f10700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb3e41309f0 0x7fb3e413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.611+0000 7fb3e9f10700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb3e41309f0 0x7fb3e413a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33226/0 (socket says 172.21.15.156:33226) 2023-09-30T22:25:06.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.611+0000 7fb3e9f10700 1 -- 172.21.15.156:0/2127099202 learned_addr learned my addr 172.21.15.156:0/2127099202 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:06.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.611+0000 7fb3e970f700 1 --2- 172.21.15.156:0/2127099202 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb3e4133ad0 0x7fb3e4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.612+0000 7fb3e8f0e700 1 --2- 172.21.15.156:0/2127099202 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb3e41300a0 0x7fb3e41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.611+0000 7fd96b0a6700 1 -- start start 2023-09-30T22:25:06.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.612+0000 7fd96b0a6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd964138410 0x7fd9640a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.612+0000 7fd96b0a6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd96413dd10 0x7fd9641400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.612+0000 7fd96b0a6700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9641379e0 con 0x7fd964138040 2023-09-30T22:25:06.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.612+0000 7fd96b0a6700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9640a2100 con 0x7fd96413dd10 2023-09-30T22:25:06.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.612+0000 7fd96b0a6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd96409b9b0 con 0x7fd964138410 2023-09-30T22:25:06.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.612+0000 7fd963fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd964138410 0x7fd9640a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.612+0000 7fd963fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd964138410 0x7fd9640a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:60634/0 (socket says 172.21.15.156:60634) 2023-09-30T22:25:06.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.612+0000 7fd963fff700 1 -- 172.21.15.156:0/2418010245 learned_addr learned my addr 172.21.15.156:0/2418010245 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:06.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.612+0000 7fd963fff700 1 -- 172.21.15.156:0/2418010245 >> v2:172.21.15.156:3300/0 conn(0x7fd96413dd10 msgr2=0x7fd9641400f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:25:06.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.612+0000 7fd963fff700 1 --2- 172.21.15.156:0/2418010245 >> v2:172.21.15.156:3300/0 conn(0x7fd96413dd10 0x7fd9641400f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.612+0000 7fd963fff700 1 -- 172.21.15.156:0/2418010245 >> v1:172.21.15.156:6789/0 conn(0x7fd964138040 legacy=0x7fd9640a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.612+0000 7fd963fff700 1 -- 172.21.15.156:0/2418010245 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd964137c10 con 0x7fd964138410 2023-09-30T22:25:06.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.612+0000 7fd963fff700 1 --2- 172.21.15.156:0/2418010245 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd964138410 0x7fd9640a0ff0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd950009920 tx=0x7fd950009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2af3716efd6b4671 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:06.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.613+0000 7fd9637fe700 1 -- 172.21.15.156:0/2418010245 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95000ba20 con 0x7fd964138410 2023-09-30T22:25:06.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.613+0000 7fd9637fe700 1 -- 172.21.15.156:0/2418010245 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95000bb80 con 0x7fd964138410 2023-09-30T22:25:06.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.613+0000 7fd9637fe700 1 -- 172.21.15.156:0/2418010245 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd950009e70 con 0x7fd964138410 2023-09-30T22:25:06.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.612+0000 7fb3e9f10700 1 -- 172.21.15.156:0/2127099202 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb3e4133ad0 msgr2=0x7fb3e4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:06.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.612+0000 7fb3e9f10700 1 --2- 172.21.15.156:0/2127099202 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb3e4133ad0 0x7fb3e4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.612+0000 7fb3e9f10700 1 -- 172.21.15.156:0/2127099202 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb3e41300a0 msgr2=0x7fb3e41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:06.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.612+0000 7fb3e9f10700 1 --2- 172.21.15.156:0/2127099202 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb3e41300a0 0x7fb3e41304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.612+0000 7fb3e9f10700 1 -- 172.21.15.156:0/2127099202 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e41338b0 con 0x7fb3e41309f0 2023-09-30T22:25:06.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.612+0000 7fb3e9f10700 1 --2- 172.21.15.156:0/2127099202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3e41309f0 0x7fb3e413a980 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc009e50 tx=0x7fb3dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3219329be02f2bc8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:06.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.612+0000 7fb3dbfff700 1 -- 172.21.15.156:0/2127099202 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc00e070 con 0x7fb3e41309f0 2023-09-30T22:25:06.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.612+0000 7fb3dbfff700 1 -- 172.21.15.156:0/2127099202 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3dc00b910 con 0x7fb3e41309f0 2023-09-30T22:25:06.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.612+0000 7fb3dbfff700 1 -- 172.21.15.156:0/2127099202 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc00bcc0 con 0x7fb3e41309f0 2023-09-30T22:25:06.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.613+0000 7fb3eb973700 1 -- 172.21.15.156:0/2127099202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3e41309f0 msgr2=0x7fb3e413a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.613+0000 7fb3eb973700 1 --2- 172.21.15.156:0/2127099202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3e41309f0 0x7fb3e413a980 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc009e50 tx=0x7fb3dc00b330 comp rx=0 tx=0).stop 2023-09-30T22:25:06.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.613+0000 7fb3eb973700 1 -- 172.21.15.156:0/2127099202 shutdown_connections 2023-09-30T22:25:06.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.613+0000 7fb3eb973700 1 --2- 172.21.15.156:0/2127099202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3e41309f0 0x7fb3e413a980 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.613+0000 7fb3eb973700 1 --2- 172.21.15.156:0/2127099202 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb3e4133ad0 0x7fb3e4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.613+0000 7fb3eb973700 1 --2- 172.21.15.156:0/2127099202 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb3e41300a0 0x7fb3e41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.613+0000 7fb3eb973700 1 -- 172.21.15.156:0/2127099202 >> 172.21.15.156:0/2127099202 conn(0x7fb3e4099c40 msgr2=0x7fb3e40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:06.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.613+0000 7fb3eb973700 1 -- 172.21.15.156:0/2127099202 shutdown_connections 2023-09-30T22:25:06.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.613+0000 7fb3eb973700 1 -- 172.21.15.156:0/2127099202 wait complete. 2023-09-30T22:25:06.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.614+0000 7fd96b0a6700 1 -- 172.21.15.156:0/2418010245 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd964138410 msgr2=0x7fd9640a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.614+0000 7fd96b0a6700 1 --2- 172.21.15.156:0/2418010245 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd964138410 0x7fd9640a0ff0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd950009920 tx=0x7fd950009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:06.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.614+0000 7fb3eb973700 1 Processor -- start 2023-09-30T22:25:06.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.614+0000 7fd96b0a6700 1 -- 172.21.15.156:0/2418010245 shutdown_connections 2023-09-30T22:25:06.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.614+0000 7fd96b0a6700 1 --2- 172.21.15.156:0/2418010245 >> v2:172.21.15.156:3300/0 conn(0x7fd96413dd10 0x7fd9641400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.614+0000 7fd96b0a6700 1 --2- 172.21.15.156:0/2418010245 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd964138410 0x7fd9640a0ff0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.614+0000 7fb3eb973700 1 -- start start 2023-09-30T22:25:06.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.614+0000 7fd96b0a6700 1 -- 172.21.15.156:0/2418010245 >> 172.21.15.156:0/2418010245 conn(0x7fd9640a2980 msgr2=0x7fd9640a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:06.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.615+0000 7fb3eb973700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb3e41300a0 0x7fb3e411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.615+0000 7fb3eb973700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3e41309f0 0x7fb3e411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.615+0000 7fb3eb973700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb3e4133ad0 0x7fb3e411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.615+0000 7fb3eb973700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e411ef90 con 0x7fb3e41309f0 2023-09-30T22:25:06.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.615+0000 7fb3eb973700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e40720e0 con 0x7fb3e41300a0 2023-09-30T22:25:06.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.615+0000 7fb3eb973700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e411fd70 con 0x7fb3e4133ad0 2023-09-30T22:25:06.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.615+0000 7fb3e8f0e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3e41309f0 0x7fb3e411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.615+0000 7fb3e9f10700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb3e4133ad0 0x7fb3e411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.615+0000 7fb3e8f0e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3e41309f0 0x7fb3e411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33232/0 (socket says 172.21.15.156:33232) 2023-09-30T22:25:06.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.615+0000 7fb3e8f0e700 1 -- 172.21.15.156:0/1146602163 learned_addr learned my addr 172.21.15.156:0/1146602163 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:06.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.615+0000 7fb3e970f700 1 --2- 172.21.15.156:0/1146602163 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb3e41300a0 0x7fb3e411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.615+0000 7fb3e8f0e700 1 -- 172.21.15.156:0/1146602163 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb3e4133ad0 msgr2=0x7fb3e411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.615+0000 7fb3e8f0e700 1 --2- 172.21.15.156:0/1146602163 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb3e4133ad0 0x7fb3e411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.615+0000 7fb3e8f0e700 1 -- 172.21.15.156:0/1146602163 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb3e41300a0 msgr2=0x7fb3e411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.615+0000 7fb3e8f0e700 1 --2- 172.21.15.156:0/1146602163 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb3e41300a0 0x7fb3e411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.615+0000 7fb3e8f0e700 1 -- 172.21.15.156:0/1146602163 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc009b30 con 0x7fb3e41309f0 2023-09-30T22:25:06.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.616+0000 7fb3e8f0e700 1 --2- 172.21.15.156:0/1146602163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3e41309f0 0x7fb3e411df80 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fb3d400d800 tx=0x7fb3d400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:06.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.616+0000 7fd96b0a6700 1 -- 172.21.15.156:0/2418010245 shutdown_connections 2023-09-30T22:25:06.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.616+0000 7fd96b0a6700 1 -- 172.21.15.156:0/2418010245 wait complete. 2023-09-30T22:25:06.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.616+0000 7fb3d9ffb700 1 -- 172.21.15.156:0/1146602163 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d40125f0 con 0x7fb3e41309f0 2023-09-30T22:25:06.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.616+0000 7fb3d9ffb700 1 -- 172.21.15.156:0/1146602163 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d4012750 con 0x7fb3e41309f0 2023-09-30T22:25:06.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.616+0000 7fb3d9ffb700 1 -- 172.21.15.156:0/1146602163 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4012ac0 con 0x7fb3e41309f0 2023-09-30T22:25:06.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.617+0000 7fd96b0a6700 1 Processor -- start 2023-09-30T22:25:06.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.617+0000 7fb3eb973700 1 -- 172.21.15.156:0/1146602163 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e412f870 con 0x7fb3e41309f0 2023-09-30T22:25:06.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.617+0000 7fb3eb973700 1 -- 172.21.15.156:0/1146602163 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e412dd60 con 0x7fb3e41309f0 2023-09-30T22:25:06.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.618+0000 7fb3eb973700 1 -- 172.21.15.156:0/1146602163 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e404f2a0 con 0x7fb3e41309f0 2023-09-30T22:25:06.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.618+0000 7fb3d9ffb700 1 -- 172.21.15.156:0/1146602163 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb3d4012c20 con 0x7fb3e41309f0 2023-09-30T22:25:06.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.618+0000 7fb3d9ffb700 1 -- 172.21.15.156:0/1146602163 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb3d403f7a0 con 0x7fb3e41309f0 2023-09-30T22:25:06.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.618+0000 7fd96b0a6700 1 -- start start 2023-09-30T22:25:06.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.619+0000 7fd96b0a6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd964138040 0x7fd964137170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.619+0000 7fd96b0a6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd964138410 0x7fd964135920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.619+0000 7fd96b0a6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd96413dd10 0x7fd964135e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.619+0000 7fd96b0a6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96413b250 con 0x7fd964138040 2023-09-30T22:25:06.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.619+0000 7fd96b0a6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96413ab80 con 0x7fd96413dd10 2023-09-30T22:25:06.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.619+0000 7fd96b0a6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd964130080 con 0x7fd964138410 2023-09-30T22:25:06.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.619+0000 7fd969643700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd96413dd10 0x7fd964135e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.619+0000 7fd969643700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd96413dd10 0x7fd964135e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:50766/0 (socket says 172.21.15.156:50766) 2023-09-30T22:25:06.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.619+0000 7fd969643700 1 -- 172.21.15.156:0/1727073223 learned_addr learned my addr 172.21.15.156:0/1727073223 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:06.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.619+0000 7fd969643700 1 -- 172.21.15.156:0/1727073223 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd964138410 msgr2=0x7fd964135920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:06.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.619+0000 7fd969643700 1 --2- 172.21.15.156:0/1727073223 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd964138410 0x7fd964135920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.619+0000 7fd969643700 1 -- 172.21.15.156:0/1727073223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd964138040 msgr2=0x7fd964137170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.619+0000 7fd969643700 1 --2- 172.21.15.156:0/1727073223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd964138040 0x7fd964137170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.619+0000 7fd969643700 1 -- 172.21.15.156:0/1727073223 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd950009550 con 0x7fd96413dd10 2023-09-30T22:25:06.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.619+0000 7fd969643700 1 --2- 172.21.15.156:0/1727073223 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd96413dd10 0x7fd964135e60 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd95c00be30 tx=0x7fd95c00bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:06.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.620+0000 7fd9617fa700 1 -- 172.21.15.156:0/1727073223 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c00cd10 con 0x7fd96413dd10 2023-09-30T22:25:06.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.620+0000 7fd9617fa700 1 -- 172.21.15.156:0/1727073223 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c00ce70 con 0x7fd96413dd10 2023-09-30T22:25:06.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.620+0000 7fd96b0a6700 1 -- 172.21.15.156:0/1727073223 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96409a240 con 0x7fd96413dd10 2023-09-30T22:25:06.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.620+0000 7fd9617fa700 1 -- 172.21.15.156:0/1727073223 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c014640 con 0x7fd96413dd10 2023-09-30T22:25:06.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.620+0000 7fd96b0a6700 1 -- 172.21.15.156:0/1727073223 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96409ebf0 con 0x7fd96413dd10 2023-09-30T22:25:06.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.621+0000 7fd9617fa700 1 -- 172.21.15.156:0/1727073223 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd95c0147a0 con 0x7fd96413dd10 2023-09-30T22:25:06.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.621+0000 7fd9617fa700 1 -- 172.21.15.156:0/1727073223 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd95c03f6d0 con 0x7fd96413dd10 2023-09-30T22:25:06.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.622+0000 7fd96b0a6700 1 -- 172.21.15.156:0/1727073223 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96413ca30 con 0x7fd96413dd10 2023-09-30T22:25:06.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.624+0000 7fb3d9ffb700 1 -- 172.21.15.156:0/1146602163 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb3d400f710 con 0x7fb3e41309f0 2023-09-30T22:25:06.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.630+0000 7fd9617fa700 1 -- 172.21.15.156:0/1727073223 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd95c019080 con 0x7fd96413dd10 2023-09-30T22:25:06.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.655+0000 7fd6b7d28700 1 Processor -- start 2023-09-30T22:25:06.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.655+0000 7fd6b7d28700 1 -- start start 2023-09-30T22:25:06.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.656+0000 7fd6b7d28700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6b00a0a70 0x7fd6b00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.656+0000 7fd6b7d28700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6b00a1380 0x7fd6b0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.656+0000 7fd6b7d28700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd6b0133f50 0x7fd6b01343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.656+0000 7fd6b7d28700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b009e9d0 con 0x7fd6b0133f50 2023-09-30T22:25:06.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.656+0000 7fd6b7d28700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b009dc00 con 0x7fd6b00a0a70 2023-09-30T22:25:06.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.656+0000 7fd6b7d28700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b009dec0 con 0x7fd6b00a1380 2023-09-30T22:25:06.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.656+0000 7fd6b5ac4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6b00a0a70 0x7fd6b00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.656+0000 7fd6b5ac4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6b00a0a70 0x7fd6b00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:50770/0 (socket says 172.21.15.156:50770) 2023-09-30T22:25:06.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.656+0000 7fd6b5ac4700 1 -- 172.21.15.156:0/66143233 learned_addr learned my addr 172.21.15.156:0/66143233 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:06.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.656+0000 7fd6b52c3700 1 --2- 172.21.15.156:0/66143233 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6b00a1380 0x7fd6b0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.656+0000 7fd6b62c5700 1 --2- 172.21.15.156:0/66143233 >> v2:172.21.15.156:3300/0 conn(0x7fd6b0133f50 0x7fd6b01343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.656+0000 7fd6b52c3700 1 -- 172.21.15.156:0/66143233 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6b00a0a70 msgr2=0x7fd6b00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:06.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.657+0000 7fd6b52c3700 1 --2- 172.21.15.156:0/66143233 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6b00a0a70 0x7fd6b00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.657+0000 7fd6b52c3700 1 -- 172.21.15.156:0/66143233 >> v2:172.21.15.156:3300/0 conn(0x7fd6b0133f50 msgr2=0x7fd6b01343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:06.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.657+0000 7fd6b52c3700 1 --2- 172.21.15.156:0/66143233 >> v2:172.21.15.156:3300/0 conn(0x7fd6b0133f50 0x7fd6b01343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.657+0000 7fd6b52c3700 1 -- 172.21.15.156:0/66143233 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b009e6a0 con 0x7fd6b00a1380 2023-09-30T22:25:06.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.657+0000 7fd6b52c3700 1 --2- 172.21.15.156:0/66143233 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6b00a1380 0x7fd6b0133a10 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0009840 tx=0x7fd6a0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4982d04730906d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:06.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.657+0000 7fd6b4ac2700 1 -- 172.21.15.156:0/66143233 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a0011830 con 0x7fd6b00a1380 2023-09-30T22:25:06.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.657+0000 7fd6b4ac2700 1 -- 172.21.15.156:0/66143233 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a0011990 con 0x7fd6b00a1380 2023-09-30T22:25:06.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.657+0000 7fd6b4ac2700 1 -- 172.21.15.156:0/66143233 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a0011d20 con 0x7fd6b00a1380 2023-09-30T22:25:06.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.658+0000 7fd6b7d28700 1 -- 172.21.15.156:0/66143233 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6b00a1380 msgr2=0x7fd6b0133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.658+0000 7fd6b7d28700 1 --2- 172.21.15.156:0/66143233 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6b00a1380 0x7fd6b0133a10 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0009840 tx=0x7fd6a0009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:06.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.658+0000 7fd6b7d28700 1 -- 172.21.15.156:0/66143233 shutdown_connections 2023-09-30T22:25:06.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.658+0000 7fd6b7d28700 1 --2- 172.21.15.156:0/66143233 >> v2:172.21.15.156:3300/0 conn(0x7fd6b0133f50 0x7fd6b01343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.658+0000 7fd6b7d28700 1 --2- 172.21.15.156:0/66143233 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6b00a0a70 0x7fd6b00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.658+0000 7fd6b7d28700 1 --2- 172.21.15.156:0/66143233 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6b00a1380 0x7fd6b0133a10 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.658+0000 7fd6b7d28700 1 -- 172.21.15.156:0/66143233 >> 172.21.15.156:0/66143233 conn(0x7fd6b00a6610 msgr2=0x7fd6b00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:06.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.658+0000 7fd6b7d28700 1 -- 172.21.15.156:0/66143233 shutdown_connections 2023-09-30T22:25:06.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.658+0000 7fd6b7d28700 1 -- 172.21.15.156:0/66143233 wait complete. 2023-09-30T22:25:06.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.659+0000 7fd6b7d28700 1 Processor -- start 2023-09-30T22:25:06.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.659+0000 7fd6b7d28700 1 -- start start 2023-09-30T22:25:06.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.659+0000 7fd6b7d28700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6b00a0a70 0x7fd6b01223a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.659+0000 7fd6b7d28700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6b00a1380 0x7fd6b01228e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.659+0000 7fd6b7d28700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6b0133f50 0x7fd6b0122e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.659+0000 7fd6b7d28700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b0124e20 con 0x7fd6b00a1380 2023-09-30T22:25:06.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.659+0000 7fd6b7d28700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b0125bf0 con 0x7fd6b00a0a70 2023-09-30T22:25:06.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.659+0000 7fd6b7d28700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b01336e0 con 0x7fd6b0133f50 2023-09-30T22:25:06.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.659+0000 7fd6b5ac4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6b00a0a70 0x7fd6b01223a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.659+0000 7fd6b5ac4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6b00a0a70 0x7fd6b01223a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:50774/0 (socket says 172.21.15.156:50774) 2023-09-30T22:25:06.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.659+0000 7fd6b5ac4700 1 -- 172.21.15.156:0/2274436375 learned_addr learned my addr 172.21.15.156:0/2274436375 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:06.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.659+0000 7fd6b62c5700 1 --2- 172.21.15.156:0/2274436375 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6b0133f50 0x7fd6b0122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.659+0000 7fd6b52c3700 1 --2- 172.21.15.156:0/2274436375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6b00a1380 0x7fd6b01228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.660+0000 7fd6b62c5700 1 -- 172.21.15.156:0/2274436375 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6b00a0a70 msgr2=0x7fd6b01223a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.660+0000 7fd6b62c5700 1 --2- 172.21.15.156:0/2274436375 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6b00a0a70 0x7fd6b01223a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.660+0000 7fd6b62c5700 1 -- 172.21.15.156:0/2274436375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6b00a1380 msgr2=0x7fd6b01228e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.660+0000 7fd6b62c5700 1 --2- 172.21.15.156:0/2274436375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6b00a1380 0x7fd6b01228e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.660+0000 7fd6b62c5700 1 -- 172.21.15.156:0/2274436375 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a00094a0 con 0x7fd6b0133f50 2023-09-30T22:25:06.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.660+0000 7fd6b5ac4700 1 --2- 172.21.15.156:0/2274436375 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6b00a0a70 0x7fd6b01223a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:06.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.660+0000 7fd6b52c3700 1 --2- 172.21.15.156:0/2274436375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6b00a1380 0x7fd6b01228e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:06.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.660+0000 7fd6b62c5700 1 --2- 172.21.15.156:0/2274436375 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6b0133f50 0x7fd6b0122e20 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8007dc0 tx=0x7fd6a800e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:06.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.660+0000 7fd6a67fc700 1 -- 172.21.15.156:0/2274436375 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8018070 con 0x7fd6b0133f50 2023-09-30T22:25:06.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.660+0000 7fd6a67fc700 1 -- 172.21.15.156:0/2274436375 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a800eb30 con 0x7fd6b0133f50 2023-09-30T22:25:06.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.660+0000 7fd6a67fc700 1 -- 172.21.15.156:0/2274436375 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a800eec0 con 0x7fd6b0133f50 2023-09-30T22:25:06.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.660+0000 7fd6b7d28700 1 -- 172.21.15.156:0/2274436375 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b00a03e0 con 0x7fd6b0133f50 2023-09-30T22:25:06.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.660+0000 7fd6b7d28700 1 -- 172.21.15.156:0/2274436375 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b01255c0 con 0x7fd6b0133f50 2023-09-30T22:25:06.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.661+0000 7fd6a67fc700 1 -- 172.21.15.156:0/2274436375 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd6a8003a20 con 0x7fd6b0133f50 2023-09-30T22:25:06.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.661+0000 7fd6b7d28700 1 -- 172.21.15.156:0/2274436375 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b011f050 con 0x7fd6b0133f50 2023-09-30T22:25:06.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.662+0000 7fd6a67fc700 1 -- 172.21.15.156:0/2274436375 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd6a803f5f0 con 0x7fd6b0133f50 2023-09-30T22:25:06.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.666+0000 7fd6a67fc700 1 -- 172.21.15.156:0/2274436375 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd6a8009950 con 0x7fd6b0133f50 2023-09-30T22:25:06.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.704+0000 7f99ad4ca700 1 Processor -- start 2023-09-30T22:25:06.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.704+0000 7f99ad4ca700 1 -- start start 2023-09-30T22:25:06.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.704+0000 7f99ad4ca700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f99a80a0a70 0x7f99a80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.704+0000 7f99ad4ca700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99a80a1380 0x7f99a8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.705+0000 7f99ad4ca700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a809dc00 con 0x7f99a8133f50 2023-09-30T22:25:06.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.705+0000 7f99ad4ca700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a809ea60 con 0x7f99a80a0a70 2023-09-30T22:25:06.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.705+0000 7f99ad4ca700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a809dec0 con 0x7f99a80a1380 2023-09-30T22:25:06.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.705+0000 7f99a77fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f99a8133f50 0x7f99a813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:33662/0 (socket says 172.21.15.156:33662) 2023-09-30T22:25:06.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.705+0000 7f99a77fe700 1 -- 172.21.15.156:0/3451951404 learned_addr learned my addr 172.21.15.156:0/3451951404 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:06.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.705+0000 7f99a6ffd700 1 --2- 172.21.15.156:0/3451951404 >> v2:172.21.15.156:3300/0 conn(0x7f99a80a0a70 0x7f99a80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.705+0000 7f99a67fc700 1 --2- 172.21.15.156:0/3451951404 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99a80a1380 0x7f99a8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.705+0000 7f99a5ffb700 1 -- 172.21.15.156:0/3451951404 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055862540 0 0) 0x7f99a809dc00 con 0x7f99a8133f50 2023-09-30T22:25:06.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.705+0000 7f99a6ffd700 1 -- 172.21.15.156:0/3451951404 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99a80a1380 msgr2=0x7f99a8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:06.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.705+0000 7f99a6ffd700 1 --2- 172.21.15.156:0/3451951404 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99a80a1380 0x7f99a8133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.705+0000 7f99a6ffd700 1 -- 172.21.15.156:0/3451951404 >> v1:172.21.15.156:6789/0 conn(0x7f99a8133f50 legacy=0x7f99a813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.705+0000 7f99a6ffd700 1 -- 172.21.15.156:0/3451951404 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a809e6a0 con 0x7f99a80a0a70 2023-09-30T22:25:06.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.705+0000 7f99a6ffd700 1 --2- 172.21.15.156:0/3451951404 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99a80a0a70 0x7f99a80a0e40 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f9998009840 tx=0x7f9998009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3916b0ed1d196b03 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:06.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.705+0000 7f99a5ffb700 1 -- 172.21.15.156:0/3451951404 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9998011830 con 0x7f99a80a0a70 2023-09-30T22:25:06.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.706+0000 7f99a5ffb700 1 -- 172.21.15.156:0/3451951404 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9998011990 con 0x7f99a80a0a70 2023-09-30T22:25:06.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.706+0000 7f99a5ffb700 1 -- 172.21.15.156:0/3451951404 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9998011d20 con 0x7f99a80a0a70 2023-09-30T22:25:06.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.706+0000 7f99ad4ca700 1 -- 172.21.15.156:0/3451951404 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99a80a0a70 msgr2=0x7f99a80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.706+0000 7f99ad4ca700 1 --2- 172.21.15.156:0/3451951404 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99a80a0a70 0x7f99a80a0e40 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f9998009840 tx=0x7f9998009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:06.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.706+0000 7f99ad4ca700 1 -- 172.21.15.156:0/3451951404 shutdown_connections 2023-09-30T22:25:06.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.706+0000 7f99ad4ca700 1 --2- 172.21.15.156:0/3451951404 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99a80a0a70 0x7f99a80a0e40 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.706+0000 7f99ad4ca700 1 --2- 172.21.15.156:0/3451951404 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99a80a1380 0x7f99a8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.706+0000 7f99ad4ca700 1 -- 172.21.15.156:0/3451951404 >> 172.21.15.156:0/3451951404 conn(0x7f99a80a6610 msgr2=0x7f99a80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:06.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.706+0000 7f99ad4ca700 1 -- 172.21.15.156:0/3451951404 shutdown_connections 2023-09-30T22:25:06.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.706+0000 7f99ad4ca700 1 -- 172.21.15.156:0/3451951404 wait complete. 2023-09-30T22:25:06.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.708+0000 7f99ad4ca700 1 Processor -- start 2023-09-30T22:25:06.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.708+0000 7f99ad4ca700 1 -- start start 2023-09-30T22:25:06.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.708+0000 7f99ad4ca700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99a80a0a70 0x7f99a8122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.708+0000 7f99ad4ca700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99a80a1380 0x7f99a8122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.708+0000 7f99ad4ca700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99a8133f50 0x7f99a81232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.708+0000 7f99ad4ca700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a8133ad0 con 0x7f99a80a1380 2023-09-30T22:25:06.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.708+0000 7f99ad4ca700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a8125de0 con 0x7f99a80a0a70 2023-09-30T22:25:06.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.708+0000 7f99ad4ca700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99a8124510 con 0x7f99a8133f50 2023-09-30T22:25:06.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.709+0000 7f99a6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99a80a0a70 0x7f99a8122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.709+0000 7f99a77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99a8133f50 0x7f99a81232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.709+0000 7f99a6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99a80a0a70 0x7f99a8122860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:50782/0 (socket says 172.21.15.156:50782) 2023-09-30T22:25:06.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.709+0000 7f99a6ffd700 1 -- 172.21.15.156:0/665304751 learned_addr learned my addr 172.21.15.156:0/665304751 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:06.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.709+0000 7f99a67fc700 1 --2- 172.21.15.156:0/665304751 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99a80a1380 0x7f99a8122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.709+0000 7f99a77fe700 1 -- 172.21.15.156:0/665304751 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99a80a0a70 msgr2=0x7f99a8122860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.709+0000 7f99a77fe700 1 --2- 172.21.15.156:0/665304751 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99a80a0a70 0x7f99a8122860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.709+0000 7f99a77fe700 1 -- 172.21.15.156:0/665304751 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99a80a1380 msgr2=0x7f99a8122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.709+0000 7f99a77fe700 1 --2- 172.21.15.156:0/665304751 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99a80a1380 0x7f99a8122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.709+0000 7f99a77fe700 1 -- 172.21.15.156:0/665304751 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99980094a0 con 0x7f99a8133f50 2023-09-30T22:25:06.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.709+0000 7f99a77fe700 1 --2- 172.21.15.156:0/665304751 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99a8133f50 0x7f99a81232e0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f99a000cc10 tx=0x7f99a000cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:06.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.709+0000 7f998f7fe700 1 -- 172.21.15.156:0/665304751 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a000aa00 con 0x7f99a8133f50 2023-09-30T22:25:06.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.710+0000 7f998f7fe700 1 -- 172.21.15.156:0/665304751 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a000ab60 con 0x7f99a8133f50 2023-09-30T22:25:06.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.710+0000 7f99ad4ca700 1 -- 172.21.15.156:0/665304751 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a8126100 con 0x7f99a8133f50 2023-09-30T22:25:06.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.710+0000 7f998f7fe700 1 -- 172.21.15.156:0/665304751 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a00070d0 con 0x7f99a8133f50 2023-09-30T22:25:06.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.710+0000 7f99ad4ca700 1 -- 172.21.15.156:0/665304751 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a8126380 con 0x7f99a8133f50 2023-09-30T22:25:06.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.710+0000 7f998f7fe700 1 -- 172.21.15.156:0/665304751 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f99a0007230 con 0x7f99a8133f50 2023-09-30T22:25:06.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.711+0000 7f998f7fe700 1 -- 172.21.15.156:0/665304751 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f99a003f4a0 con 0x7f99a8133f50 2023-09-30T22:25:06.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.711+0000 7f99ad4ca700 1 -- 172.21.15.156:0/665304751 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a8133810 con 0x7f99a8133f50 2023-09-30T22:25:06.715 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.716+0000 7f998f7fe700 1 -- 172.21.15.156:0/665304751 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f99a0011950 con 0x7f99a8133f50 2023-09-30T22:25:06.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.836+0000 7fb3eb973700 1 -- 172.21.15.156:0/1146602163 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb3e406c3b0 con 0x7fb3e41309f0 2023-09-30T22:25:06.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.836+0000 7fb3d9ffb700 1 -- 172.21.15.156:0/1146602163 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb3d4011340 con 0x7fb3e41309f0 2023-09-30T22:25:06.836 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:06.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.839+0000 7fb3eb973700 1 -- 172.21.15.156:0/1146602163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3e41309f0 msgr2=0x7fb3e411df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.839+0000 7fb3eb973700 1 --2- 172.21.15.156:0/1146602163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3e41309f0 0x7fb3e411df80 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fb3d400d800 tx=0x7fb3d400db10 comp rx=0 tx=0).stop 2023-09-30T22:25:06.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.839+0000 7fb3eb973700 1 -- 172.21.15.156:0/1146602163 shutdown_connections 2023-09-30T22:25:06.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.839+0000 7fb3eb973700 1 --2- 172.21.15.156:0/1146602163 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb3e4133ad0 0x7fb3e411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.839+0000 7fb3eb973700 1 --2- 172.21.15.156:0/1146602163 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb3e41300a0 0x7fb3e411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.839+0000 7fb3eb973700 1 --2- 172.21.15.156:0/1146602163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3e41309f0 0x7fb3e411df80 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.839+0000 7fb3eb973700 1 -- 172.21.15.156:0/1146602163 >> 172.21.15.156:0/1146602163 conn(0x7fb3e4099c40 msgr2=0x7fb3e412e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:06.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.839+0000 7fb3eb973700 1 -- 172.21.15.156:0/1146602163 shutdown_connections 2023-09-30T22:25:06.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.839+0000 7fb3eb973700 1 -- 172.21.15.156:0/1146602163 wait complete. 2023-09-30T22:25:06.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:06.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.865+0000 7fd6b7d28700 1 -- 172.21.15.156:0/2274436375 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd6b0125170 con 0x7fd6b0133f50 2023-09-30T22:25:06.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.866+0000 7fd6a67fc700 1 -- 172.21.15.156:0/2274436375 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd6a801cb20 con 0x7fd6b0133f50 2023-09-30T22:25:06.866 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:06.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.868+0000 7fd6b7d28700 1 -- 172.21.15.156:0/2274436375 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6b0133f50 msgr2=0x7fd6b0122e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.868+0000 7fd6b7d28700 1 --2- 172.21.15.156:0/2274436375 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6b0133f50 0x7fd6b0122e20 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8007dc0 tx=0x7fd6a800e3c0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.868+0000 7fd6b7d28700 1 -- 172.21.15.156:0/2274436375 shutdown_connections 2023-09-30T22:25:06.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.868+0000 7fd6b7d28700 1 --2- 172.21.15.156:0/2274436375 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd6b0133f50 0x7fd6b0122e20 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.868+0000 7fd6b7d28700 1 --2- 172.21.15.156:0/2274436375 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd6b00a0a70 0x7fd6b01223a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.868+0000 7fd6b7d28700 1 --2- 172.21.15.156:0/2274436375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6b00a1380 0x7fd6b01228e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.868+0000 7fd6b7d28700 1 -- 172.21.15.156:0/2274436375 >> 172.21.15.156:0/2274436375 conn(0x7fd6b00a6610 msgr2=0x7fd6b009c680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:06.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.868+0000 7fd6b7d28700 1 -- 172.21.15.156:0/2274436375 shutdown_connections 2023-09-30T22:25:06.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.868+0000 7fd6b7d28700 1 -- 172.21.15.156:0/2274436375 wait complete. 2023-09-30T22:25:06.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.875+0000 7fd96b0a6700 1 -- 172.21.15.156:0/1727073223 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd96404f2a0 con 0x7fd96413dd10 2023-09-30T22:25:06.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.875+0000 7fd9617fa700 1 -- 172.21.15.156:0/1727073223 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd95c01b8b0 con 0x7fd96413dd10 2023-09-30T22:25:06.875 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:06.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.877+0000 7fd96b0a6700 1 -- 172.21.15.156:0/1727073223 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd96413dd10 msgr2=0x7fd964135e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.877+0000 7fd96b0a6700 1 --2- 172.21.15.156:0/1727073223 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd96413dd10 0x7fd964135e60 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd95c00be30 tx=0x7fd95c00bf10 comp rx=0 tx=0).stop 2023-09-30T22:25:06.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.877+0000 7fd96b0a6700 1 -- 172.21.15.156:0/1727073223 shutdown_connections 2023-09-30T22:25:06.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.877+0000 7fd96b0a6700 1 --2- 172.21.15.156:0/1727073223 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd96413dd10 0x7fd964135e60 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.877+0000 7fd96b0a6700 1 --2- 172.21.15.156:0/1727073223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd964138040 0x7fd964137170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.877+0000 7fd96b0a6700 1 --2- 172.21.15.156:0/1727073223 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd964138410 0x7fd964135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.877+0000 7fd96b0a6700 1 -- 172.21.15.156:0/1727073223 >> 172.21.15.156:0/1727073223 conn(0x7fd9640a2980 msgr2=0x7fd96409d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:06.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.877+0000 7fd96b0a6700 1 -- 172.21.15.156:0/1727073223 shutdown_connections 2023-09-30T22:25:06.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.878+0000 7fd96b0a6700 1 -- 172.21.15.156:0/1727073223 wait complete. 2023-09-30T22:25:06.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:06.890 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:06.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.938+0000 7f99ad4ca700 1 -- 172.21.15.156:0/665304751 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f99a804f2a0 con 0x7f99a8133f50 2023-09-30T22:25:06.938 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.938+0000 7f998f7fe700 1 -- 172.21.15.156:0/665304751 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f99a0018070 con 0x7f99a8133f50 2023-09-30T22:25:06.938 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:06.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.940+0000 7f99ad4ca700 1 -- 172.21.15.156:0/665304751 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99a8133f50 msgr2=0x7f99a81232e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.940+0000 7f99ad4ca700 1 --2- 172.21.15.156:0/665304751 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99a8133f50 0x7f99a81232e0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f99a000cc10 tx=0x7f99a000cf20 comp rx=0 tx=0).stop 2023-09-30T22:25:06.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.940+0000 7f99ad4ca700 1 -- 172.21.15.156:0/665304751 shutdown_connections 2023-09-30T22:25:06.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.940+0000 7f99ad4ca700 1 --2- 172.21.15.156:0/665304751 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99a8133f50 0x7f99a81232e0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.940+0000 7f99ad4ca700 1 --2- 172.21.15.156:0/665304751 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99a80a0a70 0x7f99a8122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.940+0000 7f99ad4ca700 1 --2- 172.21.15.156:0/665304751 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99a80a1380 0x7f99a8122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.940+0000 7f99ad4ca700 1 -- 172.21.15.156:0/665304751 >> 172.21.15.156:0/665304751 conn(0x7f99a80a6610 msgr2=0x7f99a809ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:06.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.940+0000 7f99ad4ca700 1 -- 172.21.15.156:0/665304751 shutdown_connections 2023-09-30T22:25:06.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:06.940+0000 7f99ad4ca700 1 -- 172.21.15.156:0/665304751 wait complete. 2023-09-30T22:25:06.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:07.855 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:07.881 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:07.891 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:07.953 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:08.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.012+0000 7f3631452700 1 Processor -- start 2023-09-30T22:25:08.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.012+0000 7f3631452700 1 -- start start 2023-09-30T22:25:08.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.013+0000 7f3631452700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f362c09dec0 0x7f362c06b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.013+0000 7f3631452700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f362c136cb0 0x7f362c139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.013+0000 7f3631452700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362c06e900 con 0x7f362c06a770 2023-09-30T22:25:08.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.013+0000 7f3631452700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f362c09d180 con 0x7f362c09dec0 2023-09-30T22:25:08.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.013+0000 7f3631452700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f362c09e780 con 0x7f362c136cb0 2023-09-30T22:25:08.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.013+0000 7f362a7fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f362c09dec0 0x7f362c06b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.013+0000 7f362affd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f362c06a770 0x7f362c06ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:33666/0 (socket says 172.21.15.156:33666) 2023-09-30T22:25:08.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.013+0000 7f362b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f362c136cb0 0x7f362c139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.013+0000 7f362affd700 1 -- 172.21.15.156:0/2934486892 learned_addr learned my addr 172.21.15.156:0/2934486892 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:08.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.013+0000 7f362a7fc700 1 -- 172.21.15.156:0/2934486892 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f362c136cb0 msgr2=0x7f362c139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:08.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.013+0000 7f362a7fc700 1 --2- 172.21.15.156:0/2934486892 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f362c136cb0 0x7f362c139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.013+0000 7f362a7fc700 1 -- 172.21.15.156:0/2934486892 >> v1:172.21.15.156:6789/0 conn(0x7f362c06a770 legacy=0x7f362c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.013+0000 7f362a7fc700 1 -- 172.21.15.156:0/2934486892 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362c09d3c0 con 0x7f362c09dec0 2023-09-30T22:25:08.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.013+0000 7f3629ffb700 1 -- 172.21.15.156:0/2934486892 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2105505234 0 0) 0x7f362c06e900 con 0x7f362c06a770 2023-09-30T22:25:08.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.013+0000 7f362b7fe700 1 --2- 172.21.15.156:0/2934486892 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f362c136cb0 0x7f362c139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:08.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.014+0000 7f362a7fc700 1 --2- 172.21.15.156:0/2934486892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f362c09dec0 0x7f362c06b250 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f3614009840 tx=0x7f3614009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530cdfd3184307c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:08.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.014+0000 7f3629ffb700 1 -- 172.21.15.156:0/2934486892 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3614011830 con 0x7f362c09dec0 2023-09-30T22:25:08.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.014+0000 7f3629ffb700 1 -- 172.21.15.156:0/2934486892 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3614011990 con 0x7f362c09dec0 2023-09-30T22:25:08.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.014+0000 7f3629ffb700 1 -- 172.21.15.156:0/2934486892 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3614011d20 con 0x7f362c09dec0 2023-09-30T22:25:08.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.015+0000 7f3631452700 1 -- 172.21.15.156:0/2934486892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f362c09dec0 msgr2=0x7f362c06b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.015+0000 7f3631452700 1 --2- 172.21.15.156:0/2934486892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f362c09dec0 0x7f362c06b250 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f3614009840 tx=0x7f3614009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:08.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.015+0000 7f3631452700 1 -- 172.21.15.156:0/2934486892 shutdown_connections 2023-09-30T22:25:08.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.015+0000 7f3631452700 1 --2- 172.21.15.156:0/2934486892 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f362c136cb0 0x7f362c139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.015+0000 7f3631452700 1 --2- 172.21.15.156:0/2934486892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f362c09dec0 0x7f362c06b250 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.015+0000 7f3631452700 1 -- 172.21.15.156:0/2934486892 >> 172.21.15.156:0/2934486892 conn(0x7f362c099c40 msgr2=0x7f362c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:08.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.015+0000 7f3631452700 1 -- 172.21.15.156:0/2934486892 shutdown_connections 2023-09-30T22:25:08.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.015+0000 7f3631452700 1 -- 172.21.15.156:0/2934486892 wait complete. 2023-09-30T22:25:08.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.016+0000 7f3631452700 1 Processor -- start 2023-09-30T22:25:08.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.016+0000 7f3631452700 1 -- start start 2023-09-30T22:25:08.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.016+0000 7f3631452700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f362c06a770 0x7f362c131920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.016+0000 7f3631452700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f362c09dec0 0x7f362c131e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.017+0000 7f3631452700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f362c136cb0 0x7f362c1323a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.017+0000 7f3631452700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362c134e40 con 0x7f362c136cb0 2023-09-30T22:25:08.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.017+0000 7f3631452700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f362c135e10 con 0x7f362c06a770 2023-09-30T22:25:08.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.017+0000 7f3631452700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f362c1392c0 con 0x7f362c09dec0 2023-09-30T22:25:08.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.017+0000 7f362a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f362c09dec0 0x7f362c131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.017+0000 7f362a7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f362c09dec0 0x7f362c131e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:60672/0 (socket says 172.21.15.156:60672) 2023-09-30T22:25:08.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.017+0000 7f362a7fc700 1 -- 172.21.15.156:0/2308031397 learned_addr learned my addr 172.21.15.156:0/2308031397 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:08.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.017+0000 7f362b7fe700 1 --2- 172.21.15.156:0/2308031397 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f362c136cb0 0x7f362c1323a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.017+0000 7f362affd700 1 --2- 172.21.15.156:0/2308031397 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f362c06a770 0x7f362c131920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.017+0000 7f362a7fc700 1 -- 172.21.15.156:0/2308031397 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f362c06a770 msgr2=0x7f362c131920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.017+0000 7f362a7fc700 1 --2- 172.21.15.156:0/2308031397 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f362c06a770 0x7f362c131920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.017+0000 7f362a7fc700 1 -- 172.21.15.156:0/2308031397 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f362c136cb0 msgr2=0x7f362c1323a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.017+0000 7f362a7fc700 1 --2- 172.21.15.156:0/2308031397 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f362c136cb0 0x7f362c1323a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.017+0000 7f362a7fc700 1 -- 172.21.15.156:0/2308031397 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36240094a0 con 0x7f362c09dec0 2023-09-30T22:25:08.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.017+0000 7f362a7fc700 1 --2- 172.21.15.156:0/2308031397 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f362c09dec0 0x7f362c131e60 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f36140090b0 tx=0x7f3614004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:08.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.018+0000 7f36237fe700 1 -- 172.21.15.156:0/2308031397 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36140036a0 con 0x7f362c09dec0 2023-09-30T22:25:08.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.018+0000 7f3631452700 1 -- 172.21.15.156:0/2308031397 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36140094a0 con 0x7f362c09dec0 2023-09-30T22:25:08.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.018+0000 7f36237fe700 1 -- 172.21.15.156:0/2308031397 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f361401f070 con 0x7f362c09dec0 2023-09-30T22:25:08.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.018+0000 7f36237fe700 1 -- 172.21.15.156:0/2308031397 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3614003a40 con 0x7f362c09dec0 2023-09-30T22:25:08.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.018+0000 7f3631452700 1 -- 172.21.15.156:0/2308031397 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362c1339c0 con 0x7f362c09dec0 2023-09-30T22:25:08.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.019+0000 7f36237fe700 1 -- 172.21.15.156:0/2308031397 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3614003ba0 con 0x7f362c09dec0 2023-09-30T22:25:08.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.019+0000 7f36237fe700 1 -- 172.21.15.156:0/2308031397 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3614021070 con 0x7f362c09dec0 2023-09-30T22:25:08.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.019+0000 7f3631452700 1 -- 172.21.15.156:0/2308031397 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f362c04f2a0 con 0x7f362c09dec0 2023-09-30T22:25:08.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.024+0000 7f36237fe700 1 -- 172.21.15.156:0/2308031397 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f361402b020 con 0x7f362c09dec0 2023-09-30T22:25:08.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.042+0000 7fe18e5da700 1 Processor -- start 2023-09-30T22:25:08.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.042+0000 7fe18e5da700 1 -- start start 2023-09-30T22:25:08.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.043+0000 7fe18e5da700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe18809d860 0x7fe18809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.043+0000 7fe18e5da700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe18809e170 0x7fe1881307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.043+0000 7fe18e5da700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe18809aaa0 con 0x7fe188130ce0 2023-09-30T22:25:08.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.043+0000 7fe18e5da700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18809f870 con 0x7fe18809e170 2023-09-30T22:25:08.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.043+0000 7fe18e5da700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe18809b360 con 0x7fe18809d860 2023-09-30T22:25:08.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.043+0000 7fe187fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe18809d860 0x7fe18809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.043+0000 7fe187fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe18809d860 0x7fe18809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:60686/0 (socket says 172.21.15.156:60686) 2023-09-30T22:25:08.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.043+0000 7fe187fff700 1 -- 172.21.15.156:0/2234096311 learned_addr learned my addr 172.21.15.156:0/2234096311 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:08.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.043+0000 7fe187fff700 1 -- 172.21.15.156:0/2234096311 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe18809e170 msgr2=0x7fe1881307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:08.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.043+0000 7fe187fff700 1 --2- 172.21.15.156:0/2234096311 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe18809e170 0x7fe1881307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.043+0000 7fe187fff700 1 -- 172.21.15.156:0/2234096311 >> v1:172.21.15.156:6789/0 conn(0x7fe188130ce0 legacy=0x7fe1881379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.043+0000 7fe187fff700 1 -- 172.21.15.156:0/2234096311 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18809b620 con 0x7fe18809d860 2023-09-30T22:25:08.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.044+0000 7fe187fff700 1 --2- 172.21.15.156:0/2234096311 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe18809d860 0x7fe18809dc30 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fe17800bbc0 tx=0x7fe17800bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=308cc827131e855f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:08.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.044+0000 7fe186ffd700 1 -- 172.21.15.156:0/2234096311 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17800dd90 con 0x7fe18809d860 2023-09-30T22:25:08.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.044+0000 7fe186ffd700 1 -- 172.21.15.156:0/2234096311 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe178010470 con 0x7fe18809d860 2023-09-30T22:25:08.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.044+0000 7fe186ffd700 1 -- 172.21.15.156:0/2234096311 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe178010800 con 0x7fe18809d860 2023-09-30T22:25:08.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.045+0000 7fe18e5da700 1 -- 172.21.15.156:0/2234096311 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe18809d860 msgr2=0x7fe18809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.045+0000 7fe18e5da700 1 --2- 172.21.15.156:0/2234096311 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe18809d860 0x7fe18809dc30 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fe17800bbc0 tx=0x7fe17800bed0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.045+0000 7fe18e5da700 1 -- 172.21.15.156:0/2234096311 shutdown_connections 2023-09-30T22:25:08.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.045+0000 7fe18e5da700 1 --2- 172.21.15.156:0/2234096311 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe18809d860 0x7fe18809dc30 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.045+0000 7fe18e5da700 1 --2- 172.21.15.156:0/2234096311 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe18809e170 0x7fe1881307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.045+0000 7fe18e5da700 1 -- 172.21.15.156:0/2234096311 >> 172.21.15.156:0/2234096311 conn(0x7fe188099c40 msgr2=0x7fe1880a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:08.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.045+0000 7fe18e5da700 1 -- 172.21.15.156:0/2234096311 shutdown_connections 2023-09-30T22:25:08.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.045+0000 7fe18e5da700 1 -- 172.21.15.156:0/2234096311 wait complete. 2023-09-30T22:25:08.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.046+0000 7fe18e5da700 1 Processor -- start 2023-09-30T22:25:08.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.046+0000 7fe18e5da700 1 -- start start 2023-09-30T22:25:08.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.046+0000 7f8ad5b55700 1 Processor -- start 2023-09-30T22:25:08.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.046+0000 7f8ad5b55700 1 -- start start 2023-09-30T22:25:08.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.046+0000 7fe18e5da700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe18809d860 0x7fe18811b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.046+0000 7fe18e5da700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe18809e170 0x7fe18811ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.047+0000 7fe18e5da700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe188130ce0 0x7fe18811bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.047+0000 7fe18e5da700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18811f030 con 0x7fe188130ce0 2023-09-30T22:25:08.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.047+0000 7fe18e5da700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18812fea0 con 0x7fe18809e170 2023-09-30T22:25:08.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.047+0000 7fe18e5da700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe18811d120 con 0x7fe18809d860 2023-09-30T22:25:08.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.047+0000 7fe187fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe18809d860 0x7fe18811b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.047+0000 7fe187fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe18809d860 0x7fe18811b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:60700/0 (socket says 172.21.15.156:60700) 2023-09-30T22:25:08.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.047+0000 7fe187fff700 1 -- 172.21.15.156:0/1189298625 learned_addr learned my addr 172.21.15.156:0/1189298625 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:08.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.047+0000 7fe18cb77700 1 --2- 172.21.15.156:0/1189298625 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe188130ce0 0x7fe18811bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.047+0000 7fe1877fe700 1 --2- 172.21.15.156:0/1189298625 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe18809e170 0x7fe18811ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.047+0000 7f8ad5b55700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8ad009dec0 0x7f8ad006b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.047+0000 7f8ad5b55700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ad0136cb0 0x7f8ad0139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.047+0000 7f8ad5b55700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad006e900 con 0x7f8ad006a770 2023-09-30T22:25:08.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.047+0000 7f8ad5b55700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad009d180 con 0x7f8ad009dec0 2023-09-30T22:25:08.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.047+0000 7f8ad5b55700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad009e780 con 0x7f8ad0136cb0 2023-09-30T22:25:08.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.047+0000 7fe187fff700 1 -- 172.21.15.156:0/1189298625 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe18809e170 msgr2=0x7fe18811ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.047+0000 7fe187fff700 1 --2- 172.21.15.156:0/1189298625 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe18809e170 0x7fe18811ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.047+0000 7fe187fff700 1 -- 172.21.15.156:0/1189298625 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe188130ce0 msgr2=0x7fe18811bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.047+0000 7fe187fff700 1 --2- 172.21.15.156:0/1189298625 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe188130ce0 0x7fe18811bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.047+0000 7fe187fff700 1 -- 172.21.15.156:0/1189298625 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17800b7f0 con 0x7fe18809d860 2023-09-30T22:25:08.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.047+0000 7fe18cb77700 1 --2- 172.21.15.156:0/1189298625 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe188130ce0 0x7fe18811bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:08.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.047+0000 7f8acffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ad0136cb0 0x7f8ad0139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.047+0000 7f8acffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ad0136cb0 0x7f8ad0139090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:60708/0 (socket says 172.21.15.156:60708) 2023-09-30T22:25:08.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.047+0000 7f8acffff700 1 -- 172.21.15.156:0/2668052248 learned_addr learned my addr 172.21.15.156:0/2668052248 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:08.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.047+0000 7fe187fff700 1 --2- 172.21.15.156:0/1189298625 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe18809d860 0x7fe18811b510 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe178000c00 tx=0x7fe178004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:08.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.048+0000 7f8aceffd700 1 --2- 172.21.15.156:0/2668052248 >> v2:172.21.15.156:3300/0 conn(0x7f8ad009dec0 0x7f8ad006b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.048+0000 7fe184ff9700 1 -- 172.21.15.156:0/1189298625 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe178003ab0 con 0x7fe18809d860 2023-09-30T22:25:08.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.048+0000 7fe184ff9700 1 -- 172.21.15.156:0/1189298625 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe178003c30 con 0x7fe18809d860 2023-09-30T22:25:08.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.048+0000 7fe18e5da700 1 -- 172.21.15.156:0/1189298625 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1880a1e90 con 0x7fe18809d860 2023-09-30T22:25:08.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.048+0000 7fe184ff9700 1 -- 172.21.15.156:0/1189298625 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1780105e0 con 0x7fe18809d860 2023-09-30T22:25:08.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.048+0000 7f8acffff700 1 -- 172.21.15.156:0/2668052248 >> v2:172.21.15.156:3300/0 conn(0x7f8ad009dec0 msgr2=0x7f8ad006b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:08.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.048+0000 7f8acffff700 1 --2- 172.21.15.156:0/2668052248 >> v2:172.21.15.156:3300/0 conn(0x7f8ad009dec0 0x7f8ad006b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.048+0000 7f8acffff700 1 -- 172.21.15.156:0/2668052248 >> v1:172.21.15.156:6789/0 conn(0x7f8ad006a770 legacy=0x7f8ad006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:08.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.048+0000 7f8acffff700 1 -- 172.21.15.156:0/2668052248 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad009d3c0 con 0x7f8ad0136cb0 2023-09-30T22:25:08.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.048+0000 7f8acffff700 1 --2- 172.21.15.156:0/2668052248 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ad0136cb0 0x7f8ad0139090 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8009e50 tx=0x7f8ac800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c8a7345f9047ff0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:08.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.049+0000 7f8ace7fc700 1 -- 172.21.15.156:0/2668052248 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac800e070 con 0x7f8ad0136cb0 2023-09-30T22:25:08.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.049+0000 7f8ace7fc700 1 -- 172.21.15.156:0/2668052248 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac8003a20 con 0x7f8ad0136cb0 2023-09-30T22:25:08.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.049+0000 7f8ace7fc700 1 -- 172.21.15.156:0/2668052248 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac8003dd0 con 0x7f8ad0136cb0 2023-09-30T22:25:08.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.050+0000 7f8ad5b55700 1 -- 172.21.15.156:0/2668052248 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ad0136cb0 msgr2=0x7f8ad0139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.050+0000 7f8ad5b55700 1 --2- 172.21.15.156:0/2668052248 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ad0136cb0 0x7f8ad0139090 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8009e50 tx=0x7f8ac800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:08.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.048+0000 7fe18e5da700 1 -- 172.21.15.156:0/1189298625 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe18811d8e0 con 0x7fe18809d860 2023-09-30T22:25:08.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.050+0000 7f8ad5b55700 1 -- 172.21.15.156:0/2668052248 shutdown_connections 2023-09-30T22:25:08.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.050+0000 7f8ad5b55700 1 --2- 172.21.15.156:0/2668052248 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ad0136cb0 0x7f8ad0139090 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.050+0000 7f8ad5b55700 1 --2- 172.21.15.156:0/2668052248 >> v2:172.21.15.156:3300/0 conn(0x7f8ad009dec0 0x7f8ad006b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.050+0000 7f8ad5b55700 1 -- 172.21.15.156:0/2668052248 >> 172.21.15.156:0/2668052248 conn(0x7f8ad0099c40 msgr2=0x7f8ad00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:08.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.050+0000 7fe16e7fc700 1 -- 172.21.15.156:0/1189298625 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1600052e0 con 0x7fe18809d860 2023-09-30T22:25:08.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.050+0000 7f8ad5b55700 1 -- 172.21.15.156:0/2668052248 shutdown_connections 2023-09-30T22:25:08.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.050+0000 7fe184ff9700 1 -- 172.21.15.156:0/1189298625 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe178019400 con 0x7fe18809d860 2023-09-30T22:25:08.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.051+0000 7fe184ff9700 1 -- 172.21.15.156:0/1189298625 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe1780413c0 con 0x7fe18809d860 2023-09-30T22:25:08.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.054+0000 7f8ad5b55700 1 -- 172.21.15.156:0/2668052248 wait complete. 2023-09-30T22:25:08.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.055+0000 7f8ad5b55700 1 Processor -- start 2023-09-30T22:25:08.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.055+0000 7fe184ff9700 1 -- 172.21.15.156:0/1189298625 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe17802d3d0 con 0x7fe18809d860 2023-09-30T22:25:08.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.055+0000 7f8ad5b55700 1 -- start start 2023-09-30T22:25:08.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.056+0000 7f8ad5b55700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ad006a770 0x7f8ad01345b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.056+0000 7f8ad5b55700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ad009dec0 0x7f8ad0134af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.056+0000 7f8ad5b55700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ad0136cb0 0x7f8ad0135030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.056+0000 7f8ad5b55700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad011a890 con 0x7f8ad009dec0 2023-09-30T22:25:08.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.056+0000 7f8ad5b55700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad011adf0 con 0x7f8ad0136cb0 2023-09-30T22:25:08.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.056+0000 7f8ad5b55700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad0136840 con 0x7f8ad006a770 2023-09-30T22:25:08.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.056+0000 7f8acf7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ad006a770 0x7f8ad01345b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.056+0000 7f8acffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ad0136cb0 0x7f8ad0135030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.056+0000 7f8acf7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ad006a770 0x7f8ad01345b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:60724/0 (socket says 172.21.15.156:60724) 2023-09-30T22:25:08.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.056+0000 7f8acf7fe700 1 -- 172.21.15.156:0/2467765515 learned_addr learned my addr 172.21.15.156:0/2467765515 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:08.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.056+0000 7f8aceffd700 1 --2- 172.21.15.156:0/2467765515 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ad009dec0 0x7f8ad0134af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.057+0000 7f8acffff700 1 -- 172.21.15.156:0/2467765515 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ad006a770 msgr2=0x7f8ad01345b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.057+0000 7f8acffff700 1 --2- 172.21.15.156:0/2467765515 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ad006a770 0x7f8ad01345b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.057+0000 7f8acffff700 1 -- 172.21.15.156:0/2467765515 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ad009dec0 msgr2=0x7f8ad0134af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.057+0000 7f8acffff700 1 --2- 172.21.15.156:0/2467765515 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ad009dec0 0x7f8ad0134af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.057+0000 7f8acffff700 1 -- 172.21.15.156:0/2467765515 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac8009b30 con 0x7f8ad0136cb0 2023-09-30T22:25:08.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.057+0000 7f8acffff700 1 --2- 172.21.15.156:0/2467765515 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ad0136cb0 0x7f8ad0135030 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8014000 tx=0x7f8ac8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:08.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.057+0000 7f8ab7fff700 1 -- 172.21.15.156:0/2467765515 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac8004440 con 0x7f8ad0136cb0 2023-09-30T22:25:08.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.057+0000 7f8ab7fff700 1 -- 172.21.15.156:0/2467765515 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac80092e0 con 0x7f8ad0136cb0 2023-09-30T22:25:08.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.057+0000 7f8ab7fff700 1 -- 172.21.15.156:0/2467765515 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac8004800 con 0x7f8ad0136cb0 2023-09-30T22:25:08.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.058+0000 7f8ad5b55700 1 -- 172.21.15.156:0/2467765515 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad00a2ea0 con 0x7f8ad0136cb0 2023-09-30T22:25:08.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.058+0000 7f8ad5b55700 1 -- 172.21.15.156:0/2467765515 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad0119630 con 0x7f8ad0136cb0 2023-09-30T22:25:08.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.059+0000 7f8ab7fff700 1 -- 172.21.15.156:0/2467765515 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ac8012430 con 0x7f8ad0136cb0 2023-09-30T22:25:08.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.059+0000 7f8ab7fff700 1 -- 172.21.15.156:0/2467765515 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8ac8040950 con 0x7f8ad0136cb0 2023-09-30T22:25:08.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.059+0000 7f8ad5b55700 1 -- 172.21.15.156:0/2467765515 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad0135a50 con 0x7f8ad0136cb0 2023-09-30T22:25:08.067 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.064+0000 7f8ab7fff700 1 -- 172.21.15.156:0/2467765515 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ac80126e0 con 0x7f8ad0136cb0 2023-09-30T22:25:08.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.093+0000 7f0f8ff10700 1 Processor -- start 2023-09-30T22:25:08.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.093+0000 7f0f8ff10700 1 -- start start 2023-09-30T22:25:08.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.093+0000 7f0f8ff10700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f8809e870 0x7f0f8809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.094+0000 7f0f8ff10700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f8809f180 0x7f0f88131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.094+0000 7f0f8ff10700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f8809c970 con 0x7f0f88131d70 2023-09-30T22:25:08.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.094+0000 7f0f8ff10700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f880a0920 con 0x7f0f8809f180 2023-09-30T22:25:08.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.094+0000 7f0f8ff10700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8809f9c0 con 0x7f0f8809e870 2023-09-30T22:25:08.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.094+0000 7f0f8e4ad700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f0f88131d70 0x7f0f88138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:33702/0 (socket says 172.21.15.156:33702) 2023-09-30T22:25:08.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.094+0000 7f0f8e4ad700 1 -- 172.21.15.156:0/3691619169 learned_addr learned my addr 172.21.15.156:0/3691619169 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:08.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.094+0000 7f0f8dcac700 1 --2- 172.21.15.156:0/3691619169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f8809e870 0x7f0f8809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.094+0000 7f0f8d4ab700 1 --2- 172.21.15.156:0/3691619169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f8809f180 0x7f0f88131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.094+0000 7f0f8ccaa700 1 -- 172.21.15.156:0/3691619169 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1681941400 0 0) 0x7f0f8809c970 con 0x7f0f88131d70 2023-09-30T22:25:08.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.094+0000 7f0f8ccaa700 1 -- 172.21.15.156:0/3691619169 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f740035b0 con 0x7f0f88131d70 2023-09-30T22:25:08.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.094+0000 7f0f8dcac700 1 -- 172.21.15.156:0/3691619169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f8809f180 msgr2=0x7f0f88131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:08.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.094+0000 7f0f8dcac700 1 --2- 172.21.15.156:0/3691619169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f8809f180 0x7f0f88131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.094+0000 7f0f8dcac700 1 -- 172.21.15.156:0/3691619169 >> v1:172.21.15.156:6789/0 conn(0x7f0f88131d70 legacy=0x7f0f88138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.094+0000 7f0f8dcac700 1 -- 172.21.15.156:0/3691619169 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8809bab0 con 0x7f0f8809e870 2023-09-30T22:25:08.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.094+0000 7f0f8dcac700 1 --2- 172.21.15.156:0/3691619169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f8809e870 0x7f0f8809ec40 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f0f84009870 tx=0x7f0f84009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7cf1ac8fc965904 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:08.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.095+0000 7f0f8ccaa700 1 -- 172.21.15.156:0/3691619169 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f84011830 con 0x7f0f8809e870 2023-09-30T22:25:08.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.095+0000 7f0f8ccaa700 1 -- 172.21.15.156:0/3691619169 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f84011990 con 0x7f0f8809e870 2023-09-30T22:25:08.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.095+0000 7f0f8ccaa700 1 -- 172.21.15.156:0/3691619169 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f84011d20 con 0x7f0f8809e870 2023-09-30T22:25:08.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.095+0000 7f0f8ff10700 1 -- 172.21.15.156:0/3691619169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f8809e870 msgr2=0x7f0f8809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.095+0000 7f0f8ff10700 1 --2- 172.21.15.156:0/3691619169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f8809e870 0x7f0f8809ec40 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f0f84009870 tx=0x7f0f84009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:08.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.095+0000 7f0f8ff10700 1 -- 172.21.15.156:0/3691619169 shutdown_connections 2023-09-30T22:25:08.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.095+0000 7f0f8ff10700 1 --2- 172.21.15.156:0/3691619169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f8809e870 0x7f0f8809ec40 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.095+0000 7f0f8ff10700 1 --2- 172.21.15.156:0/3691619169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f8809f180 0x7f0f88131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.095+0000 7f0f8ff10700 1 -- 172.21.15.156:0/3691619169 >> 172.21.15.156:0/3691619169 conn(0x7f0f880a4430 msgr2=0x7f0f880a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:08.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.095+0000 7f0f8ff10700 1 -- 172.21.15.156:0/3691619169 shutdown_connections 2023-09-30T22:25:08.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.095+0000 7f0f8ff10700 1 -- 172.21.15.156:0/3691619169 wait complete. 2023-09-30T22:25:08.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.097+0000 7f0f8ff10700 1 Processor -- start 2023-09-30T22:25:08.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.097+0000 7f0f8ff10700 1 -- start start 2023-09-30T22:25:08.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.097+0000 7f0f8ff10700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f8809e870 0x7f0f88120230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.097+0000 7f0f8ff10700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f8809f180 0x7f0f88120770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.097+0000 7f0f8ff10700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f88131d70 0x7f0f88120cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.097+0000 7f0f8ff10700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f88122c80 con 0x7f0f88131d70 2023-09-30T22:25:08.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.097+0000 7f0f8ff10700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f88131540 con 0x7f0f8809e870 2023-09-30T22:25:08.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.097+0000 7f0f8ff10700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f88121620 con 0x7f0f8809f180 2023-09-30T22:25:08.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.097+0000 7f0f8e4ad700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f88131d70 0x7f0f88120cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.097+0000 7f0f8e4ad700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f88131d70 0x7f0f88120cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33346/0 (socket says 172.21.15.156:33346) 2023-09-30T22:25:08.099 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.098+0000 7f0f8e4ad700 1 -- 172.21.15.156:0/2892209184 learned_addr learned my addr 172.21.15.156:0/2892209184 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:08.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.098+0000 7f0f8d4ab700 1 --2- 172.21.15.156:0/2892209184 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f8809f180 0x7f0f88120770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.098+0000 7f0f8dcac700 1 --2- 172.21.15.156:0/2892209184 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f8809e870 0x7f0f88120230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.098+0000 7f0f8e4ad700 1 -- 172.21.15.156:0/2892209184 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f8809f180 msgr2=0x7f0f88120770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.098+0000 7f0f8e4ad700 1 --2- 172.21.15.156:0/2892209184 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f8809f180 0x7f0f88120770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.098+0000 7f0f8e4ad700 1 -- 172.21.15.156:0/2892209184 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f8809e870 msgr2=0x7f0f88120230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.098+0000 7f0f8e4ad700 1 --2- 172.21.15.156:0/2892209184 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f8809e870 0x7f0f88120230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.098+0000 7f0f8e4ad700 1 -- 172.21.15.156:0/2892209184 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f840094a0 con 0x7f0f88131d70 2023-09-30T22:25:08.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.098+0000 7f0f8e4ad700 1 --2- 172.21.15.156:0/2892209184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f88131d70 0x7f0f88120cb0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f0f8000cb40 tx=0x7f0f8000ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:08.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.098+0000 7f0f7e7fc700 1 -- 172.21.15.156:0/2892209184 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8000a980 con 0x7f0f88131d70 2023-09-30T22:25:08.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.098+0000 7f0f7e7fc700 1 -- 172.21.15.156:0/2892209184 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8000aae0 con 0x7f0f88131d70 2023-09-30T22:25:08.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.098+0000 7f0f7e7fc700 1 -- 172.21.15.156:0/2892209184 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8000ae50 con 0x7f0f88131d70 2023-09-30T22:25:08.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.098+0000 7f0f8ff10700 1 -- 172.21.15.156:0/2892209184 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f8809dba0 con 0x7f0f88131d70 2023-09-30T22:25:08.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.098+0000 7f0f8ff10700 1 -- 172.21.15.156:0/2892209184 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f881236f0 con 0x7f0f88131d70 2023-09-30T22:25:08.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.099+0000 7f0f8ff10700 1 -- 172.21.15.156:0/2892209184 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f8811d580 con 0x7f0f88131d70 2023-09-30T22:25:08.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.102+0000 7f0f7e7fc700 1 -- 172.21.15.156:0/2892209184 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f8001b3b0 con 0x7f0f88131d70 2023-09-30T22:25:08.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.102+0000 7f0f7e7fc700 1 -- 172.21.15.156:0/2892209184 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0f8003f8e0 con 0x7f0f88131d70 2023-09-30T22:25:08.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.105+0000 7f0f7e7fc700 1 -- 172.21.15.156:0/2892209184 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f800192c0 con 0x7f0f88131d70 2023-09-30T22:25:08.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.239+0000 7f3631452700 1 -- 172.21.15.156:0/2308031397 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f362c135910 con 0x7f362c09dec0 2023-09-30T22:25:08.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.239+0000 7f36237fe700 1 -- 172.21.15.156:0/2308031397 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3614015070 con 0x7f362c09dec0 2023-09-30T22:25:08.239 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:08.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.241+0000 7f3631452700 1 -- 172.21.15.156:0/2308031397 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f362c09dec0 msgr2=0x7f362c131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.241+0000 7f3631452700 1 --2- 172.21.15.156:0/2308031397 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f362c09dec0 0x7f362c131e60 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f36140090b0 tx=0x7f3614004750 comp rx=0 tx=0).stop 2023-09-30T22:25:08.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.241+0000 7f3631452700 1 -- 172.21.15.156:0/2308031397 shutdown_connections 2023-09-30T22:25:08.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.241+0000 7f3631452700 1 --2- 172.21.15.156:0/2308031397 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f362c136cb0 0x7f362c1323a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.241+0000 7f3631452700 1 --2- 172.21.15.156:0/2308031397 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f362c06a770 0x7f362c131920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.241+0000 7f3631452700 1 --2- 172.21.15.156:0/2308031397 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f362c09dec0 0x7f362c131e60 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.241+0000 7f3631452700 1 -- 172.21.15.156:0/2308031397 >> 172.21.15.156:0/2308031397 conn(0x7f362c099c40 msgr2=0x7f362c09b580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:08.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.241+0000 7f3631452700 1 -- 172.21.15.156:0/2308031397 shutdown_connections 2023-09-30T22:25:08.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.241+0000 7f3631452700 1 -- 172.21.15.156:0/2308031397 wait complete. 2023-09-30T22:25:08.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.250+0000 7fe16e7fc700 1 -- 172.21.15.156:0/1189298625 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe160005860 con 0x7fe18809d860 2023-09-30T22:25:08.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.251+0000 7fe184ff9700 1 -- 172.21.15.156:0/1189298625 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe178029070 con 0x7fe18809d860 2023-09-30T22:25:08.251 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:08.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.253+0000 7fe16e7fc700 1 -- 172.21.15.156:0/1189298625 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe18809d860 msgr2=0x7fe18811b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.253+0000 7fe16e7fc700 1 --2- 172.21.15.156:0/1189298625 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe18809d860 0x7fe18811b510 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe178000c00 tx=0x7fe178004750 comp rx=0 tx=0).stop 2023-09-30T22:25:08.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.253+0000 7fe16e7fc700 1 -- 172.21.15.156:0/1189298625 shutdown_connections 2023-09-30T22:25:08.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.253+0000 7fe16e7fc700 1 --2- 172.21.15.156:0/1189298625 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe188130ce0 0x7fe18811bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.253+0000 7fe16e7fc700 1 --2- 172.21.15.156:0/1189298625 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe18809d860 0x7fe18811b510 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.253+0000 7fe16e7fc700 1 --2- 172.21.15.156:0/1189298625 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe18809e170 0x7fe18811ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.253+0000 7fe16e7fc700 1 -- 172.21.15.156:0/1189298625 >> 172.21.15.156:0/1189298625 conn(0x7fe188099c40 msgr2=0x7fe1880a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:08.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.253+0000 7fe16e7fc700 1 -- 172.21.15.156:0/1189298625 shutdown_connections 2023-09-30T22:25:08.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.253+0000 7fe16e7fc700 1 -- 172.21.15.156:0/1189298625 wait complete. 2023-09-30T22:25:08.255 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:08.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:08.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.275+0000 7f8ad5b55700 1 -- 172.21.15.156:0/2467765515 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8ad004f2a0 con 0x7f8ad0136cb0 2023-09-30T22:25:08.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.275+0000 7f8ab7fff700 1 -- 172.21.15.156:0/2467765515 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ac8017020 con 0x7f8ad0136cb0 2023-09-30T22:25:08.275 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:08.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.277+0000 7f8ad5b55700 1 -- 172.21.15.156:0/2467765515 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ad0136cb0 msgr2=0x7f8ad0135030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.277+0000 7f8ad5b55700 1 --2- 172.21.15.156:0/2467765515 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ad0136cb0 0x7f8ad0135030 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8014000 tx=0x7f8ac8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.277+0000 7f8ad5b55700 1 -- 172.21.15.156:0/2467765515 shutdown_connections 2023-09-30T22:25:08.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.277+0000 7f8ad5b55700 1 --2- 172.21.15.156:0/2467765515 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8ad0136cb0 0x7f8ad0135030 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.277+0000 7f8ad5b55700 1 --2- 172.21.15.156:0/2467765515 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8ad006a770 0x7f8ad01345b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.277+0000 7f8ad5b55700 1 --2- 172.21.15.156:0/2467765515 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ad009dec0 0x7f8ad0134af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.277+0000 7f8ad5b55700 1 -- 172.21.15.156:0/2467765515 >> 172.21.15.156:0/2467765515 conn(0x7f8ad0099c40 msgr2=0x7f8ad012f890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:08.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.278+0000 7f8ad5b55700 1 -- 172.21.15.156:0/2467765515 shutdown_connections 2023-09-30T22:25:08.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.278+0000 7f8ad5b55700 1 -- 172.21.15.156:0/2467765515 wait complete. 2023-09-30T22:25:08.289 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:08.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.301+0000 7f0f8ff10700 1 -- 172.21.15.156:0/2892209184 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0f8804f2a0 con 0x7f0f88131d70 2023-09-30T22:25:08.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.301+0000 7f0f7e7fc700 1 -- 172.21.15.156:0/2892209184 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f80017030 con 0x7f0f88131d70 2023-09-30T22:25:08.301 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:08.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.303+0000 7f0f8ff10700 1 -- 172.21.15.156:0/2892209184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f88131d70 msgr2=0x7f0f88120cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.303+0000 7f0f8ff10700 1 --2- 172.21.15.156:0/2892209184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f88131d70 0x7f0f88120cb0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f0f8000cb40 tx=0x7f0f8000ce50 comp rx=0 tx=0).stop 2023-09-30T22:25:08.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.303+0000 7f0f8ff10700 1 -- 172.21.15.156:0/2892209184 shutdown_connections 2023-09-30T22:25:08.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.303+0000 7f0f8ff10700 1 --2- 172.21.15.156:0/2892209184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f88131d70 0x7f0f88120cb0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.303+0000 7f0f8ff10700 1 --2- 172.21.15.156:0/2892209184 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0f8809e870 0x7f0f88120230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.303+0000 7f0f8ff10700 1 --2- 172.21.15.156:0/2892209184 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0f8809f180 0x7f0f88120770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.303+0000 7f0f8ff10700 1 -- 172.21.15.156:0/2892209184 >> 172.21.15.156:0/2892209184 conn(0x7f0f880a4430 msgr2=0x7f0f8811a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:08.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.303+0000 7f0f8ff10700 1 -- 172.21.15.156:0/2892209184 shutdown_connections 2023-09-30T22:25:08.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:08.303+0000 7f0f8ff10700 1 -- 172.21.15.156:0/2892209184 wait complete. 2023-09-30T22:25:08.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:09.255 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:09.266 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:09.290 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:09.315 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:09.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.399+0000 7fab9cff7700 1 Processor -- start 2023-09-30T22:25:09.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.399+0000 7fab9cff7700 1 -- start start 2023-09-30T22:25:09.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.400+0000 7fab9cff7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab98136960 0x7fab98138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.400+0000 7fab9cff7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab98139280 0x7fab9813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.400+0000 7fab9cff7700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab9806b2d0 con 0x7fab98133ad0 2023-09-30T22:25:09.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.400+0000 7fab9cff7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab981345b0 con 0x7fab98139280 2023-09-30T22:25:09.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.400+0000 7fab9cff7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab98133610 con 0x7fab98136960 2023-09-30T22:25:09.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.400+0000 7fab9659c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fab98133ad0 0x7fab98133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:33716/0 (socket says 172.21.15.156:33716) 2023-09-30T22:25:09.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.400+0000 7fab9659c700 1 -- 172.21.15.156:0/474884917 learned_addr learned my addr 172.21.15.156:0/474884917 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:09.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.400+0000 7fab96d9d700 1 --2- 172.21.15.156:0/474884917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab98139280 0x7fab9813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.400+0000 7fab95d9b700 1 --2- 172.21.15.156:0/474884917 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab98136960 0x7fab98138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.401+0000 7fab95d9b700 1 -- 172.21.15.156:0/474884917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab98139280 msgr2=0x7fab9813b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:09.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.401+0000 7fab95d9b700 1 --2- 172.21.15.156:0/474884917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab98139280 0x7fab9813b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.401+0000 7fab95d9b700 1 -- 172.21.15.156:0/474884917 >> v1:172.21.15.156:6789/0 conn(0x7fab98133ad0 legacy=0x7fab98133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.401+0000 7fab95d9b700 1 -- 172.21.15.156:0/474884917 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab9809a500 con 0x7fab98136960 2023-09-30T22:25:09.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.401+0000 7fab96d9d700 1 --2- 172.21.15.156:0/474884917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab98139280 0x7fab9813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:09.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.401+0000 7fab95d9b700 1 --2- 172.21.15.156:0/474884917 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab98136960 0x7fab98138d40 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fab8c009870 tx=0x7fab8c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd4d61d3917136c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:09.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.401+0000 7fab9559a700 1 -- 172.21.15.156:0/474884917 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c004230 con 0x7fab98136960 2023-09-30T22:25:09.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.401+0000 7fab9559a700 1 -- 172.21.15.156:0/474884917 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8c004390 con 0x7fab98136960 2023-09-30T22:25:09.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.401+0000 7fab9559a700 1 -- 172.21.15.156:0/474884917 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c0036a0 con 0x7fab98136960 2023-09-30T22:25:09.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.402+0000 7fab9cff7700 1 -- 172.21.15.156:0/474884917 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab98136960 msgr2=0x7fab98138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.402+0000 7fab9cff7700 1 --2- 172.21.15.156:0/474884917 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab98136960 0x7fab98138d40 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fab8c009870 tx=0x7fab8c009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:09.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.402+0000 7fab9cff7700 1 -- 172.21.15.156:0/474884917 shutdown_connections 2023-09-30T22:25:09.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.402+0000 7fab9cff7700 1 --2- 172.21.15.156:0/474884917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab98139280 0x7fab9813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.402+0000 7fab9cff7700 1 --2- 172.21.15.156:0/474884917 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab98136960 0x7fab98138d40 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.402+0000 7fab9cff7700 1 -- 172.21.15.156:0/474884917 >> 172.21.15.156:0/474884917 conn(0x7fab98099c40 msgr2=0x7fab980a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:09.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.402+0000 7fab9cff7700 1 -- 172.21.15.156:0/474884917 shutdown_connections 2023-09-30T22:25:09.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.402+0000 7fab9cff7700 1 -- 172.21.15.156:0/474884917 wait complete. 2023-09-30T22:25:09.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.403+0000 7fab9cff7700 1 Processor -- start 2023-09-30T22:25:09.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.403+0000 7fab9cff7700 1 -- start start 2023-09-30T22:25:09.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.404+0000 7fab9cff7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab98133ad0 0x7fab98071810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.404+0000 7fab9cff7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab98136960 0x7fab98071d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.404+0000 7fab9cff7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab98139280 0x7fab981c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.404+0000 7fab9cff7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab98070330 con 0x7fab98139280 2023-09-30T22:25:09.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.404+0000 7fab9cff7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab9806e900 con 0x7fab98136960 2023-09-30T22:25:09.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.404+0000 7fab9cff7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab9806ecb0 con 0x7fab98133ad0 2023-09-30T22:25:09.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.404+0000 7fab95d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab98136960 0x7fab98071d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.404+0000 7fab9659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab98133ad0 0x7fab98071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.404+0000 7fab95d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab98136960 0x7fab98071d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:50882/0 (socket says 172.21.15.156:50882) 2023-09-30T22:25:09.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.404+0000 7fab95d9b700 1 -- 172.21.15.156:0/390229314 learned_addr learned my addr 172.21.15.156:0/390229314 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:09.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.404+0000 7fab96d9d700 1 --2- 172.21.15.156:0/390229314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab98139280 0x7fab981c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.405+0000 7fab9659c700 1 -- 172.21.15.156:0/390229314 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab98136960 msgr2=0x7fab98071d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.405+0000 7fab9659c700 1 --2- 172.21.15.156:0/390229314 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab98136960 0x7fab98071d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.405+0000 7fab9659c700 1 -- 172.21.15.156:0/390229314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab98139280 msgr2=0x7fab981c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.405+0000 7fab9659c700 1 --2- 172.21.15.156:0/390229314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab98139280 0x7fab981c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.405+0000 7fab9659c700 1 -- 172.21.15.156:0/390229314 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab90009a70 con 0x7fab98133ad0 2023-09-30T22:25:09.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.405+0000 7fab96d9d700 1 --2- 172.21.15.156:0/390229314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab98139280 0x7fab981c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:09.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.405+0000 7fab9659c700 1 --2- 172.21.15.156:0/390229314 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab98133ad0 0x7fab98071810 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fab8800c520 tx=0x7fab8800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:09.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.405+0000 7fab86ffd700 1 -- 172.21.15.156:0/390229314 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab88004c80 con 0x7fab98133ad0 2023-09-30T22:25:09.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.405+0000 7fab86ffd700 1 -- 172.21.15.156:0/390229314 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab88004de0 con 0x7fab98133ad0 2023-09-30T22:25:09.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.405+0000 7fab86ffd700 1 -- 172.21.15.156:0/390229314 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab88007310 con 0x7fab98133ad0 2023-09-30T22:25:09.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.405+0000 7fab9cff7700 1 -- 172.21.15.156:0/390229314 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8c0094a0 con 0x7fab98133ad0 2023-09-30T22:25:09.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.405+0000 7fab9cff7700 1 -- 172.21.15.156:0/390229314 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab98070da0 con 0x7fab98133ad0 2023-09-30T22:25:09.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.406+0000 7fab86ffd700 1 -- 172.21.15.156:0/390229314 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab88007470 con 0x7fab98133ad0 2023-09-30T22:25:09.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.406+0000 7fab9cff7700 1 -- 172.21.15.156:0/390229314 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab9806fea0 con 0x7fab98133ad0 2023-09-30T22:25:09.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.406+0000 7fab86ffd700 1 -- 172.21.15.156:0/390229314 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fab8803f3b0 con 0x7fab98133ad0 2023-09-30T22:25:09.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.415+0000 7fab86ffd700 1 -- 172.21.15.156:0/390229314 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab88007720 con 0x7fab98133ad0 2023-09-30T22:25:09.441 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.442+0000 7f4ba91d5700 1 Processor -- start 2023-09-30T22:25:09.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.442+0000 7f4ba91d5700 1 -- start start 2023-09-30T22:25:09.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.442+0000 7fa5a1d5d700 1 Processor -- start 2023-09-30T22:25:09.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.442+0000 7f4ba91d5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ba409d860 0x7f4ba409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.442+0000 7f4ba91d5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ba409e170 0x7f4ba41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.442+0000 7f4ba91d5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba409aaa0 con 0x7f4ba4130ce0 2023-09-30T22:25:09.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.442+0000 7f4ba91d5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba409f870 con 0x7f4ba409e170 2023-09-30T22:25:09.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.442+0000 7f4ba91d5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba409b360 con 0x7f4ba409d860 2023-09-30T22:25:09.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.442+0000 7fa5a1d5d700 1 -- start start 2023-09-30T22:25:09.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.442+0000 7fa5a1d5d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa59c09e870 0x7fa59c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.442+0000 7fa5a1d5d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa59c09f180 0x7fa59c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.442+0000 7fa5a1d5d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa59c09c970 con 0x7fa59c131d70 2023-09-30T22:25:09.443 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.442+0000 7fa5a1d5d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa59c0a0920 con 0x7fa59c09e870 2023-09-30T22:25:09.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.442+0000 7fa5a1d5d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c09f9c0 con 0x7fa59c09f180 2023-09-30T22:25:09.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.443+0000 7f4ba359e700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4ba4130ce0 0x7f4ba41379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:33732/0 (socket says 172.21.15.156:33732) 2023-09-30T22:25:09.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.443+0000 7f4ba359e700 1 -- 172.21.15.156:0/3632697452 learned_addr learned my addr 172.21.15.156:0/3632697452 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:09.444 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.443+0000 7f4ba259c700 1 --2- 172.21.15.156:0/3632697452 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ba409e170 0x7f4ba41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.443+0000 7fa59affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa59c09f180 0x7fa59c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.443+0000 7fa59affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa59c09f180 0x7fa59c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:60780/0 (socket says 172.21.15.156:60780) 2023-09-30T22:25:09.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.443+0000 7fa59affd700 1 -- 172.21.15.156:0/672352109 learned_addr learned my addr 172.21.15.156:0/672352109 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:09.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.443+0000 7f4ba2d9d700 1 --2- 172.21.15.156:0/3632697452 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ba409d860 0x7f4ba409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.443+0000 7f4ba2d9d700 1 -- 172.21.15.156:0/3632697452 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ba409e170 msgr2=0x7f4ba41307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:09.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.443+0000 7f4ba2d9d700 1 --2- 172.21.15.156:0/3632697452 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ba409e170 0x7f4ba41307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.443+0000 7f4ba2d9d700 1 -- 172.21.15.156:0/3632697452 >> v1:172.21.15.156:6789/0 conn(0x7f4ba4130ce0 legacy=0x7f4ba41379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.443+0000 7f4ba2d9d700 1 -- 172.21.15.156:0/3632697452 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba409b620 con 0x7f4ba409d860 2023-09-30T22:25:09.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.443+0000 7fa59b7fe700 1 --2- 172.21.15.156:0/672352109 >> v2:172.21.15.156:3300/0 conn(0x7fa59c09e870 0x7fa59c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.443+0000 7fa59affd700 1 -- 172.21.15.156:0/672352109 >> v2:172.21.15.156:3300/0 conn(0x7fa59c09e870 msgr2=0x7fa59c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:09.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.443+0000 7fa59affd700 1 --2- 172.21.15.156:0/672352109 >> v2:172.21.15.156:3300/0 conn(0x7fa59c09e870 0x7fa59c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.443+0000 7fa59affd700 1 -- 172.21.15.156:0/672352109 >> v1:172.21.15.156:6789/0 conn(0x7fa59c131d70 legacy=0x7fa59c138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:09.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.443+0000 7fa59affd700 1 -- 172.21.15.156:0/672352109 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59c09bab0 con 0x7fa59c09f180 2023-09-30T22:25:09.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.443+0000 7f4ba2d9d700 1 --2- 172.21.15.156:0/3632697452 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ba409d860 0x7f4ba409dc30 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4b94009870 tx=0x7f4b94009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90d0eb0b44ad33ea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:09.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.444+0000 7fa59affd700 1 --2- 172.21.15.156:0/672352109 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa59c09f180 0x7fa59c131830 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0098f0 tx=0x7fa58c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5333b36281be9dea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:09.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.444+0000 7fa59a7fc700 1 -- 172.21.15.156:0/672352109 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c004230 con 0x7fa59c09f180 2023-09-30T22:25:09.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.444+0000 7fa59a7fc700 1 -- 172.21.15.156:0/672352109 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58c004390 con 0x7fa59c09f180 2023-09-30T22:25:09.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.444+0000 7fa59a7fc700 1 -- 172.21.15.156:0/672352109 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c0036a0 con 0x7fa59c09f180 2023-09-30T22:25:09.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.444+0000 7f4ba1d9b700 1 -- 172.21.15.156:0/3632697452 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b94011830 con 0x7f4ba409d860 2023-09-30T22:25:09.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.444+0000 7f4ba1d9b700 1 -- 172.21.15.156:0/3632697452 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b94011990 con 0x7f4ba409d860 2023-09-30T22:25:09.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.444+0000 7f4ba1d9b700 1 -- 172.21.15.156:0/3632697452 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b94011d20 con 0x7f4ba409d860 2023-09-30T22:25:09.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.445+0000 7f4ba91d5700 1 -- 172.21.15.156:0/3632697452 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ba409d860 msgr2=0x7f4ba409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.445+0000 7f4ba91d5700 1 --2- 172.21.15.156:0/3632697452 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ba409d860 0x7f4ba409dc30 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4b94009870 tx=0x7f4b94009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:09.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.445+0000 7f4ba91d5700 1 -- 172.21.15.156:0/3632697452 shutdown_connections 2023-09-30T22:25:09.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.445+0000 7f4ba91d5700 1 --2- 172.21.15.156:0/3632697452 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ba409d860 0x7f4ba409dc30 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.445+0000 7f4ba91d5700 1 --2- 172.21.15.156:0/3632697452 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ba409e170 0x7f4ba41307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.445+0000 7f4ba91d5700 1 -- 172.21.15.156:0/3632697452 >> 172.21.15.156:0/3632697452 conn(0x7f4ba4099c40 msgr2=0x7f4ba40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:09.449 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.445+0000 7f4ba91d5700 1 -- 172.21.15.156:0/3632697452 shutdown_connections 2023-09-30T22:25:09.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.445+0000 7f4ba91d5700 1 -- 172.21.15.156:0/3632697452 wait complete. 2023-09-30T22:25:09.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.445+0000 7fa5a1d5d700 1 -- 172.21.15.156:0/672352109 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa59c09f180 msgr2=0x7fa59c131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.445+0000 7fa5a1d5d700 1 --2- 172.21.15.156:0/672352109 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa59c09f180 0x7fa59c131830 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0098f0 tx=0x7fa58c009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:09.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.445+0000 7fa5a1d5d700 1 -- 172.21.15.156:0/672352109 shutdown_connections 2023-09-30T22:25:09.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.445+0000 7fa5a1d5d700 1 --2- 172.21.15.156:0/672352109 >> v2:172.21.15.156:3300/0 conn(0x7fa59c09e870 0x7fa59c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.445+0000 7fa5a1d5d700 1 --2- 172.21.15.156:0/672352109 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa59c09f180 0x7fa59c131830 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.445+0000 7fa5a1d5d700 1 -- 172.21.15.156:0/672352109 >> 172.21.15.156:0/672352109 conn(0x7fa59c0a4430 msgr2=0x7fa59c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:09.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.445+0000 7fa5a1d5d700 1 -- 172.21.15.156:0/672352109 shutdown_connections 2023-09-30T22:25:09.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.445+0000 7fa5a1d5d700 1 -- 172.21.15.156:0/672352109 wait complete. 2023-09-30T22:25:09.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.446+0000 7f4ba91d5700 1 Processor -- start 2023-09-30T22:25:09.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.446+0000 7fa5a1d5d700 1 Processor -- start 2023-09-30T22:25:09.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.447+0000 7fa5a1d5d700 1 -- start start 2023-09-30T22:25:09.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.446+0000 7f4ba91d5700 1 -- start start 2023-09-30T22:25:09.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.447+0000 7f4ba91d5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ba409d860 0x7f4ba4137df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.447+0000 7f4ba91d5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ba409e170 0x7f4ba4138330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.447+0000 7f4ba91d5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ba4130ce0 0x7f4ba4138870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.447+0000 7f4ba91d5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba4136c70 con 0x7f4ba409d860 2023-09-30T22:25:09.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.447+0000 7f4ba91d5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba4136a00 con 0x7f4ba409e170 2023-09-30T22:25:09.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.447+0000 7f4ba91d5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba4137210 con 0x7f4ba4130ce0 2023-09-30T22:25:09.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.447+0000 7f4ba359e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ba4130ce0 0x7f4ba4138870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.447+0000 7f4ba359e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ba4130ce0 0x7f4ba4138870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:60786/0 (socket says 172.21.15.156:60786) 2023-09-30T22:25:09.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.447+0000 7f4ba359e700 1 -- 172.21.15.156:0/834770457 learned_addr learned my addr 172.21.15.156:0/834770457 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:09.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.447+0000 7f4ba259c700 1 --2- 172.21.15.156:0/834770457 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ba409e170 0x7f4ba4138330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.447+0000 7f4ba2d9d700 1 --2- 172.21.15.156:0/834770457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ba409d860 0x7f4ba4137df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.447+0000 7fa5a1d5d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa59c09e870 0x7fa59c120480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.447+0000 7fa5a1d5d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa59c09f180 0x7fa59c1209c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.447+0000 7fa5a1d5d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa59c131d70 0x7fa59c120f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.447+0000 7fa5a1d5d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c123c80 con 0x7fa59c09f180 2023-09-30T22:25:09.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.447+0000 7fa5a1d5d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c09dba0 con 0x7fa59c131d70 2023-09-30T22:25:09.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.447+0000 7fa5a1d5d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c130f60 con 0x7fa59c09e870 2023-09-30T22:25:09.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.447+0000 7f4ba259c700 1 -- 172.21.15.156:0/834770457 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ba4130ce0 msgr2=0x7f4ba4138870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.447+0000 7f4ba259c700 1 --2- 172.21.15.156:0/834770457 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ba4130ce0 0x7f4ba4138870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.447+0000 7f4ba259c700 1 -- 172.21.15.156:0/834770457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ba409d860 msgr2=0x7f4ba4137df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.447+0000 7f4ba259c700 1 --2- 172.21.15.156:0/834770457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ba409d860 0x7f4ba4137df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.447+0000 7f4ba259c700 1 -- 172.21.15.156:0/834770457 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b940094a0 con 0x7f4ba409e170 2023-09-30T22:25:09.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.448+0000 7f4ba359e700 1 --2- 172.21.15.156:0/834770457 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ba4130ce0 0x7f4ba4138870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:09.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.447+0000 7fa59b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa59c09e870 0x7fa59c120480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.447+0000 7fa59b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa59c09e870 0x7fa59c120480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:60794/0 (socket says 172.21.15.156:60794) 2023-09-30T22:25:09.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.447+0000 7fa59b7fe700 1 -- 172.21.15.156:0/3467415583 learned_addr learned my addr 172.21.15.156:0/3467415583 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:09.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.447+0000 7fa59affd700 1 --2- 172.21.15.156:0/3467415583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa59c09f180 0x7fa59c1209c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.447+0000 7fa59bfff700 1 --2- 172.21.15.156:0/3467415583 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa59c131d70 0x7fa59c120f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.448+0000 7f4ba259c700 1 --2- 172.21.15.156:0/834770457 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ba409e170 0x7f4ba4138330 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f4b9800e8d0 tx=0x7f4b9800ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:09.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.448+0000 7f4ba2d9d700 1 --2- 172.21.15.156:0/834770457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ba409d860 0x7f4ba4137df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:09.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.448+0000 7fa59b7fe700 1 -- 172.21.15.156:0/3467415583 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa59c131d70 msgr2=0x7fa59c120f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.448+0000 7fa59b7fe700 1 --2- 172.21.15.156:0/3467415583 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa59c131d70 0x7fa59c120f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.448+0000 7fa59b7fe700 1 -- 172.21.15.156:0/3467415583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa59c09f180 msgr2=0x7fa59c1209c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.448+0000 7fa59b7fe700 1 --2- 172.21.15.156:0/3467415583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa59c09f180 0x7fa59c1209c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.448+0000 7fa59b7fe700 1 -- 172.21.15.156:0/3467415583 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58c009550 con 0x7fa59c09e870 2023-09-30T22:25:09.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.448+0000 7fa59b7fe700 1 --2- 172.21.15.156:0/3467415583 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa59c09e870 0x7fa59c120480 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa58400d800 tx=0x7fa58400db10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:09.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.448+0000 7fa593fff700 1 -- 172.21.15.156:0/3467415583 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5840125f0 con 0x7fa59c09e870 2023-09-30T22:25:09.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.448+0000 7fa593fff700 1 -- 172.21.15.156:0/3467415583 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa584012750 con 0x7fa59c09e870 2023-09-30T22:25:09.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.448+0000 7fa5a1d5d700 1 -- 172.21.15.156:0/3467415583 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa59c122800 con 0x7fa59c09e870 2023-09-30T22:25:09.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.448+0000 7f4b8b7fe700 1 -- 172.21.15.156:0/834770457 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b98013680 con 0x7f4ba409e170 2023-09-30T22:25:09.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.448+0000 7f4b8b7fe700 1 -- 172.21.15.156:0/834770457 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b980137e0 con 0x7f4ba409e170 2023-09-30T22:25:09.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.448+0000 7f4b8b7fe700 1 -- 172.21.15.156:0/834770457 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b98013b50 con 0x7f4ba409e170 2023-09-30T22:25:09.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.448+0000 7fa593fff700 1 -- 172.21.15.156:0/3467415583 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa584012b00 con 0x7fa59c09e870 2023-09-30T22:25:09.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.448+0000 7fa5a1d5d700 1 -- 172.21.15.156:0/3467415583 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa59c123f60 con 0x7fa59c09e870 2023-09-30T22:25:09.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.448+0000 7f4ba91d5700 1 -- 172.21.15.156:0/834770457 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba413be40 con 0x7f4ba409e170 2023-09-30T22:25:09.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.448+0000 7f4ba91d5700 1 -- 172.21.15.156:0/834770457 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba409c8b0 con 0x7f4ba409e170 2023-09-30T22:25:09.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.449+0000 7f4b8b7fe700 1 -- 172.21.15.156:0/834770457 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b98013cb0 con 0x7f4ba409e170 2023-09-30T22:25:09.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.450+0000 7f4b8b7fe700 1 -- 172.21.15.156:0/834770457 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4b9803fbc0 con 0x7f4ba409e170 2023-09-30T22:25:09.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.450+0000 7f4ba91d5700 1 -- 172.21.15.156:0/834770457 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba41328d0 con 0x7f4ba409e170 2023-09-30T22:25:09.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.449+0000 7fa5a1d5d700 1 -- 172.21.15.156:0/3467415583 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa59c04f2a0 con 0x7fa59c09e870 2023-09-30T22:25:09.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.450+0000 7fa593fff700 1 -- 172.21.15.156:0/3467415583 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa584012c60 con 0x7fa59c09e870 2023-09-30T22:25:09.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.451+0000 7fa593fff700 1 -- 172.21.15.156:0/3467415583 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa584040230 con 0x7fa59c09e870 2023-09-30T22:25:09.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.455+0000 7f4b8b7fe700 1 -- 172.21.15.156:0/834770457 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b98017070 con 0x7f4ba409e170 2023-09-30T22:25:09.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.455+0000 7fa593fff700 1 -- 172.21.15.156:0/3467415583 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa58401b770 con 0x7fa59c09e870 2023-09-30T22:25:09.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.513+0000 7fe5d97ef700 1 Processor -- start 2023-09-30T22:25:09.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.513+0000 7fe5d97ef700 1 -- start start 2023-09-30T22:25:09.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.514+0000 7fe5d97ef700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe5d40a1510 0x7fe5d41351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.514+0000 7fe5d97ef700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5d41356e0 0x7fe5d4137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.514+0000 7fe5d97ef700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5d40a1e70 con 0x7fe5d40a0a30 2023-09-30T22:25:09.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.514+0000 7fe5d97ef700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d409a720 con 0x7fe5d40a1510 2023-09-30T22:25:09.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.514+0000 7fe5d97ef700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d409b300 con 0x7fe5d41356e0 2023-09-30T22:25:09.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.514+0000 7fe5d37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5d41356e0 0x7fe5d4137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.514+0000 7fe5d2ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe5d40a0a30 0x7fe5d40a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:33744/0 (socket says 172.21.15.156:33744) 2023-09-30T22:25:09.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.514+0000 7fe5d27fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe5d40a1510 0x7fe5d41351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.514+0000 7fe5d2ffd700 1 -- 172.21.15.156:0/288848968 learned_addr learned my addr 172.21.15.156:0/288848968 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:09.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.514+0000 7fe5d1ffb700 1 -- 172.21.15.156:0/288848968 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782536872 0 0) 0x7fe5d40a1e70 con 0x7fe5d40a0a30 2023-09-30T22:25:09.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.514+0000 7fe5d1ffb700 1 -- 172.21.15.156:0/288848968 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5bc0057c0 con 0x7fe5d40a0a30 2023-09-30T22:25:09.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.514+0000 7fe5d37fe700 1 -- 172.21.15.156:0/288848968 >> v2:172.21.15.156:3300/0 conn(0x7fe5d40a1510 msgr2=0x7fe5d41351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:09.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.514+0000 7fe5d37fe700 1 --2- 172.21.15.156:0/288848968 >> v2:172.21.15.156:3300/0 conn(0x7fe5d40a1510 0x7fe5d41351a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.514+0000 7fe5d37fe700 1 -- 172.21.15.156:0/288848968 >> v1:172.21.15.156:6789/0 conn(0x7fe5d40a0a30 legacy=0x7fe5d40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.514+0000 7fe5d37fe700 1 -- 172.21.15.156:0/288848968 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d409abc0 con 0x7fe5d41356e0 2023-09-30T22:25:09.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.515+0000 7fe5d37fe700 1 --2- 172.21.15.156:0/288848968 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5d41356e0 0x7fe5d4137ac0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00aea0 tx=0x7fe5cc00c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78ad2722fd15fd25 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:09.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.515+0000 7fe5d1ffb700 1 -- 172.21.15.156:0/288848968 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc00a2d0 con 0x7fe5d41356e0 2023-09-30T22:25:09.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.515+0000 7fe5d1ffb700 1 -- 172.21.15.156:0/288848968 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5cc00c910 con 0x7fe5d41356e0 2023-09-30T22:25:09.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.515+0000 7fe5d1ffb700 1 -- 172.21.15.156:0/288848968 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc00ccc0 con 0x7fe5d41356e0 2023-09-30T22:25:09.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.516+0000 7fe5d97ef700 1 -- 172.21.15.156:0/288848968 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5d41356e0 msgr2=0x7fe5d4137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.516+0000 7fe5d97ef700 1 --2- 172.21.15.156:0/288848968 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5d41356e0 0x7fe5d4137ac0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00aea0 tx=0x7fe5cc00c330 comp rx=0 tx=0).stop 2023-09-30T22:25:09.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.516+0000 7fe5d97ef700 1 -- 172.21.15.156:0/288848968 shutdown_connections 2023-09-30T22:25:09.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.516+0000 7fe5d97ef700 1 --2- 172.21.15.156:0/288848968 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5d41356e0 0x7fe5d4137ac0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.516+0000 7fe5d97ef700 1 --2- 172.21.15.156:0/288848968 >> v2:172.21.15.156:3300/0 conn(0x7fe5d40a1510 0x7fe5d41351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.516+0000 7fe5d97ef700 1 -- 172.21.15.156:0/288848968 >> 172.21.15.156:0/288848968 conn(0x7fe5d40a2980 msgr2=0x7fe5d40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:09.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.516+0000 7fe5d97ef700 1 -- 172.21.15.156:0/288848968 shutdown_connections 2023-09-30T22:25:09.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.516+0000 7fe5d97ef700 1 -- 172.21.15.156:0/288848968 wait complete. 2023-09-30T22:25:09.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.517+0000 7fe5d97ef700 1 Processor -- start 2023-09-30T22:25:09.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.517+0000 7fe5d97ef700 1 -- start start 2023-09-30T22:25:09.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.518+0000 7fe5d97ef700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5d40a0a30 0x7fe5d41c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.518+0000 7fe5d97ef700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5d40a1510 0x7fe5d41c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.518+0000 7fe5d97ef700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5d41356e0 0x7fe5d41c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.518+0000 7fe5d97ef700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d4123590 con 0x7fe5d40a0a30 2023-09-30T22:25:09.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.518+0000 7fe5d97ef700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d4120d50 con 0x7fe5d41356e0 2023-09-30T22:25:09.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.518+0000 7fe5d97ef700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d409fbc0 con 0x7fe5d40a1510 2023-09-30T22:25:09.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.518+0000 7fe5d2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5d40a0a30 0x7fe5d41c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.518+0000 7fe5d2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5d40a0a30 0x7fe5d41c84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33400/0 (socket says 172.21.15.156:33400) 2023-09-30T22:25:09.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.518+0000 7fe5d2ffd700 1 -- 172.21.15.156:0/3717068592 learned_addr learned my addr 172.21.15.156:0/3717068592 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:09.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.518+0000 7fe5d27fc700 1 --2- 172.21.15.156:0/3717068592 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5d40a1510 0x7fe5d41c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.518+0000 7fe5d37fe700 1 --2- 172.21.15.156:0/3717068592 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5d41356e0 0x7fe5d41c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.519+0000 7fe5d37fe700 1 -- 172.21.15.156:0/3717068592 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5d40a1510 msgr2=0x7fe5d41c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.519+0000 7fe5d37fe700 1 --2- 172.21.15.156:0/3717068592 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5d40a1510 0x7fe5d41c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.519+0000 7fe5d37fe700 1 -- 172.21.15.156:0/3717068592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5d40a0a30 msgr2=0x7fe5d41c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.519+0000 7fe5d37fe700 1 --2- 172.21.15.156:0/3717068592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5d40a0a30 0x7fe5d41c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.519+0000 7fe5d37fe700 1 -- 172.21.15.156:0/3717068592 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5cc00ab80 con 0x7fe5d41356e0 2023-09-30T22:25:09.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.519+0000 7fe5d2ffd700 1 --2- 172.21.15.156:0/3717068592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5d40a0a30 0x7fe5d41c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:09.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.519+0000 7fe5d37fe700 1 --2- 172.21.15.156:0/3717068592 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5d41356e0 0x7fe5d41c4a70 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe5d409a230 tx=0x7fe5cc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:09.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.519+0000 7fe5bb7fe700 1 -- 172.21.15.156:0/3717068592 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc01f860 con 0x7fe5d41356e0 2023-09-30T22:25:09.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.519+0000 7fe5bb7fe700 1 -- 172.21.15.156:0/3717068592 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5cc01f9c0 con 0x7fe5d41356e0 2023-09-30T22:25:09.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.519+0000 7fe5d97ef700 1 -- 172.21.15.156:0/3717068592 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d4123120 con 0x7fe5d41356e0 2023-09-30T22:25:09.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.519+0000 7fe5bb7fe700 1 -- 172.21.15.156:0/3717068592 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc01fd70 con 0x7fe5d41356e0 2023-09-30T22:25:09.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.519+0000 7fe5d97ef700 1 -- 172.21.15.156:0/3717068592 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d41c8f30 con 0x7fe5d41356e0 2023-09-30T22:25:09.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.520+0000 7fe5d97ef700 1 -- 172.21.15.156:0/3717068592 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d4122d40 con 0x7fe5d41356e0 2023-09-30T22:25:09.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.520+0000 7fe5bb7fe700 1 -- 172.21.15.156:0/3717068592 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe5cc011070 con 0x7fe5d41356e0 2023-09-30T22:25:09.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.521+0000 7fe5bb7fe700 1 -- 172.21.15.156:0/3717068592 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe5cc040800 con 0x7fe5d41356e0 2023-09-30T22:25:09.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.529+0000 7fe5bb7fe700 1 -- 172.21.15.156:0/3717068592 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe5cc00a300 con 0x7fe5d41356e0 2023-09-30T22:25:09.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.647+0000 7fab9cff7700 1 -- 172.21.15.156:0/390229314 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fab9804f2a0 con 0x7fab98133ad0 2023-09-30T22:25:09.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.647+0000 7fab86ffd700 1 -- 172.21.15.156:0/390229314 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab88011360 con 0x7fab98133ad0 2023-09-30T22:25:09.647 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:09.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.649+0000 7fab9cff7700 1 -- 172.21.15.156:0/390229314 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab98133ad0 msgr2=0x7fab98071810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.649+0000 7fab9cff7700 1 --2- 172.21.15.156:0/390229314 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab98133ad0 0x7fab98071810 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fab8800c520 tx=0x7fab8800c830 comp rx=0 tx=0).stop 2023-09-30T22:25:09.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.650+0000 7fab9cff7700 1 -- 172.21.15.156:0/390229314 shutdown_connections 2023-09-30T22:25:09.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.650+0000 7fab9cff7700 1 --2- 172.21.15.156:0/390229314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab98139280 0x7fab981c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.650+0000 7fab9cff7700 1 --2- 172.21.15.156:0/390229314 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fab98133ad0 0x7fab98071810 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.650+0000 7fab9cff7700 1 --2- 172.21.15.156:0/390229314 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fab98136960 0x7fab98071d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.650+0000 7fab9cff7700 1 -- 172.21.15.156:0/390229314 >> 172.21.15.156:0/390229314 conn(0x7fab98099c40 msgr2=0x7fab98137310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:09.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.650+0000 7fab9cff7700 1 -- 172.21.15.156:0/390229314 shutdown_connections 2023-09-30T22:25:09.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.650+0000 7fab9cff7700 1 -- 172.21.15.156:0/390229314 wait complete. 2023-09-30T22:25:09.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:09.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.677+0000 7f4ba91d5700 1 -- 172.21.15.156:0/834770457 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4ba404f2a0 con 0x7f4ba409e170 2023-09-30T22:25:09.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.677+0000 7f4b8b7fe700 1 -- 172.21.15.156:0/834770457 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b9801ae60 con 0x7f4ba409e170 2023-09-30T22:25:09.677 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:09.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.678+0000 7fa5a1d5d700 1 -- 172.21.15.156:0/3467415583 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa59c123920 con 0x7fa59c09e870 2023-09-30T22:25:09.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.678+0000 7fa593fff700 1 -- 172.21.15.156:0/3467415583 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa58401b360 con 0x7fa59c09e870 2023-09-30T22:25:09.678 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:09.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.679+0000 7f4ba91d5700 1 -- 172.21.15.156:0/834770457 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ba409e170 msgr2=0x7f4ba4138330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.679+0000 7f4ba91d5700 1 --2- 172.21.15.156:0/834770457 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ba409e170 0x7f4ba4138330 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f4b9800e8d0 tx=0x7f4b9800ebe0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.679+0000 7f4ba91d5700 1 -- 172.21.15.156:0/834770457 shutdown_connections 2023-09-30T22:25:09.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.679+0000 7f4ba91d5700 1 --2- 172.21.15.156:0/834770457 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ba4130ce0 0x7f4ba4138870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.679+0000 7f4ba91d5700 1 --2- 172.21.15.156:0/834770457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ba409d860 0x7f4ba4137df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.679+0000 7f4ba91d5700 1 --2- 172.21.15.156:0/834770457 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ba409e170 0x7f4ba4138330 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.679+0000 7f4ba91d5700 1 -- 172.21.15.156:0/834770457 >> 172.21.15.156:0/834770457 conn(0x7f4ba4099c40 msgr2=0x7f4ba4139570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:09.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.680+0000 7f4ba91d5700 1 -- 172.21.15.156:0/834770457 shutdown_connections 2023-09-30T22:25:09.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.680+0000 7f4ba91d5700 1 -- 172.21.15.156:0/834770457 wait complete. 2023-09-30T22:25:09.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.680+0000 7fa5a1d5d700 1 -- 172.21.15.156:0/3467415583 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa59c09e870 msgr2=0x7fa59c120480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.680+0000 7fa5a1d5d700 1 --2- 172.21.15.156:0/3467415583 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa59c09e870 0x7fa59c120480 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa58400d800 tx=0x7fa58400db10 comp rx=0 tx=0).stop 2023-09-30T22:25:09.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.681+0000 7fa5a1d5d700 1 -- 172.21.15.156:0/3467415583 shutdown_connections 2023-09-30T22:25:09.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.681+0000 7fa5a1d5d700 1 --2- 172.21.15.156:0/3467415583 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa59c131d70 0x7fa59c120f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.681+0000 7fa5a1d5d700 1 --2- 172.21.15.156:0/3467415583 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa59c09e870 0x7fa59c120480 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.681+0000 7fa5a1d5d700 1 --2- 172.21.15.156:0/3467415583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa59c09f180 0x7fa59c1209c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.681+0000 7fa5a1d5d700 1 -- 172.21.15.156:0/3467415583 >> 172.21.15.156:0/3467415583 conn(0x7fa59c0a4430 msgr2=0x7fa59c09d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:09.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.681+0000 7fa5a1d5d700 1 -- 172.21.15.156:0/3467415583 shutdown_connections 2023-09-30T22:25:09.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.681+0000 7fa5a1d5d700 1 -- 172.21.15.156:0/3467415583 wait complete. 2023-09-30T22:25:09.693 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:09.693 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:09.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.728+0000 7fe5d97ef700 1 -- 172.21.15.156:0/3717068592 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe5d409ae00 con 0x7fe5d41356e0 2023-09-30T22:25:09.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.729+0000 7fe5bb7fe700 1 -- 172.21.15.156:0/3717068592 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe5cc018020 con 0x7fe5d41356e0 2023-09-30T22:25:09.729 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:09.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.731+0000 7fe5d97ef700 1 -- 172.21.15.156:0/3717068592 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5d41356e0 msgr2=0x7fe5d41c4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.731+0000 7fe5d97ef700 1 --2- 172.21.15.156:0/3717068592 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5d41356e0 0x7fe5d41c4a70 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe5d409a230 tx=0x7fe5cc004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.731+0000 7fe5d97ef700 1 -- 172.21.15.156:0/3717068592 shutdown_connections 2023-09-30T22:25:09.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.731+0000 7fe5d97ef700 1 --2- 172.21.15.156:0/3717068592 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5d41356e0 0x7fe5d41c4a70 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.731+0000 7fe5d97ef700 1 --2- 172.21.15.156:0/3717068592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5d40a0a30 0x7fe5d41c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.731+0000 7fe5d97ef700 1 --2- 172.21.15.156:0/3717068592 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5d40a1510 0x7fe5d41c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.731+0000 7fe5d97ef700 1 -- 172.21.15.156:0/3717068592 >> 172.21.15.156:0/3717068592 conn(0x7fe5d40a2980 msgr2=0x7fe5d41349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:09.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.731+0000 7fe5d97ef700 1 -- 172.21.15.156:0/3717068592 shutdown_connections 2023-09-30T22:25:09.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:09.731+0000 7fe5d97ef700 1 -- 172.21.15.156:0/3717068592 wait complete. 2023-09-30T22:25:09.743 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:10.663 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:10.693 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:10.694 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:10.744 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:10.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.819+0000 7f63b30c9700 1 Processor -- start 2023-09-30T22:25:10.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.819+0000 7f63b30c9700 1 -- start start 2023-09-30T22:25:10.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.820+0000 7f63b30c9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63ac06a770 0x7f63ac06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.820+0000 7f63b30c9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f63ac06b080 0x7f63ac1317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.820+0000 7f63b30c9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ac09da80 con 0x7f63ac131cf0 2023-09-30T22:25:10.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.820+0000 7f63b30c9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63ac09dce0 con 0x7f63ac06b080 2023-09-30T22:25:10.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.820+0000 7f63b30c9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac09eb20 con 0x7f63ac06a770 2023-09-30T22:25:10.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.820+0000 7f63b0e65700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63ac06a770 0x7f63ac06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.820+0000 7f63b0e65700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63ac06a770 0x7f63ac06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:50908/0 (socket says 172.21.15.156:50908) 2023-09-30T22:25:10.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.820+0000 7f63b0e65700 1 -- 172.21.15.156:0/3298297994 learned_addr learned my addr 172.21.15.156:0/3298297994 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:10.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.820+0000 7f63abfff700 1 --2- 172.21.15.156:0/3298297994 >> v2:172.21.15.156:3300/0 conn(0x7f63ac06b080 0x7f63ac1317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.820+0000 7f63b0e65700 1 -- 172.21.15.156:0/3298297994 >> v2:172.21.15.156:3300/0 conn(0x7f63ac06b080 msgr2=0x7f63ac1317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:10.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.820+0000 7f63b0e65700 1 --2- 172.21.15.156:0/3298297994 >> v2:172.21.15.156:3300/0 conn(0x7f63ac06b080 0x7f63ac1317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.820+0000 7f63b0e65700 1 -- 172.21.15.156:0/3298297994 >> v1:172.21.15.156:6789/0 conn(0x7f63ac131cf0 legacy=0x7f63ac138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.820+0000 7f63b0e65700 1 -- 172.21.15.156:0/3298297994 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ac09d860 con 0x7f63ac06a770 2023-09-30T22:25:10.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.821+0000 7f63b0e65700 1 --2- 172.21.15.156:0/3298297994 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63ac06a770 0x7f63ac06ab40 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f63a00098f0 tx=0x7f63a0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21dab69eb4ac8b57 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:10.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.821+0000 7f63ab7fe700 1 -- 172.21.15.156:0/3298297994 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a000b8a0 con 0x7f63ac06a770 2023-09-30T22:25:10.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.821+0000 7f63ab7fe700 1 -- 172.21.15.156:0/3298297994 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a000ba00 con 0x7f63ac06a770 2023-09-30T22:25:10.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.821+0000 7f63ab7fe700 1 -- 172.21.15.156:0/3298297994 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a000bd90 con 0x7f63ac06a770 2023-09-30T22:25:10.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.822+0000 7f63b30c9700 1 -- 172.21.15.156:0/3298297994 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63ac06a770 msgr2=0x7f63ac06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.822+0000 7f63b30c9700 1 --2- 172.21.15.156:0/3298297994 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63ac06a770 0x7f63ac06ab40 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f63a00098f0 tx=0x7f63a0009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:10.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.822+0000 7f63b30c9700 1 -- 172.21.15.156:0/3298297994 shutdown_connections 2023-09-30T22:25:10.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.822+0000 7f63b30c9700 1 --2- 172.21.15.156:0/3298297994 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63ac06a770 0x7f63ac06ab40 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.822+0000 7f63b30c9700 1 --2- 172.21.15.156:0/3298297994 >> v2:172.21.15.156:3300/0 conn(0x7f63ac06b080 0x7f63ac1317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.822+0000 7f63b30c9700 1 -- 172.21.15.156:0/3298297994 >> 172.21.15.156:0/3298297994 conn(0x7f63ac099c40 msgr2=0x7f63ac0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:10.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.824+0000 7f63b30c9700 1 -- 172.21.15.156:0/3298297994 shutdown_connections 2023-09-30T22:25:10.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.824+0000 7f63b30c9700 1 -- 172.21.15.156:0/3298297994 wait complete. 2023-09-30T22:25:10.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.825+0000 7f63b30c9700 1 Processor -- start 2023-09-30T22:25:10.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.825+0000 7f63b30c9700 1 -- start start 2023-09-30T22:25:10.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.826+0000 7f63b30c9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63ac06a770 0x7f63ac11c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.826+0000 7f63b30c9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f63ac06b080 0x7f63ac11c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.826+0000 7f63b30c9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63ac131cf0 0x7f63ac1c6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.826+0000 7f63b30c9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac11c040 con 0x7f63ac131cf0 2023-09-30T22:25:10.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.826+0000 7f63b30c9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac130470 con 0x7f63ac06a770 2023-09-30T22:25:10.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.826+0000 7f63b30c9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac071e10 con 0x7f63ac06b080 2023-09-30T22:25:10.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.826+0000 7f63b0e65700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63ac06a770 0x7f63ac11c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.826+0000 7f63abfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f63ac06b080 0x7f63ac11c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.826+0000 7f63b0e65700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63ac06a770 0x7f63ac11c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:50910/0 (socket says 172.21.15.156:50910) 2023-09-30T22:25:10.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.826+0000 7f63b1666700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63ac131cf0 0x7f63ac1c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.826+0000 7f63b0e65700 1 -- 172.21.15.156:0/4022510165 learned_addr learned my addr 172.21.15.156:0/4022510165 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:10.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.826+0000 7f63b0e65700 1 -- 172.21.15.156:0/4022510165 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f63ac06b080 msgr2=0x7f63ac11c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.826+0000 7f63b0e65700 1 --2- 172.21.15.156:0/4022510165 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f63ac06b080 0x7f63ac11c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.826+0000 7f63b0e65700 1 -- 172.21.15.156:0/4022510165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63ac131cf0 msgr2=0x7f63ac1c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.826+0000 7f63b0e65700 1 --2- 172.21.15.156:0/4022510165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63ac131cf0 0x7f63ac1c6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.826+0000 7f63b0e65700 1 -- 172.21.15.156:0/4022510165 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a0009550 con 0x7f63ac06a770 2023-09-30T22:25:10.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.826+0000 7f63b1666700 1 --2- 172.21.15.156:0/4022510165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63ac131cf0 0x7f63ac1c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:10.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.826+0000 7f63abfff700 1 --2- 172.21.15.156:0/4022510165 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f63ac06b080 0x7f63ac11c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:10.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.827+0000 7f63b0e65700 1 --2- 172.21.15.156:0/4022510165 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63ac06a770 0x7f63ac11c490 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f63a0000c00 tx=0x7f63a0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:10.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.827+0000 7f63a97fa700 1 -- 172.21.15.156:0/4022510165 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a0004510 con 0x7f63ac06a770 2023-09-30T22:25:10.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.827+0000 7f63a97fa700 1 -- 172.21.15.156:0/4022510165 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a00036a0 con 0x7f63ac06a770 2023-09-30T22:25:10.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.827+0000 7f63a97fa700 1 -- 172.21.15.156:0/4022510165 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a0003a30 con 0x7f63ac06a770 2023-09-30T22:25:10.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.827+0000 7f63b30c9700 1 -- 172.21.15.156:0/4022510165 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63ac0a2a90 con 0x7f63ac06a770 2023-09-30T22:25:10.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.827+0000 7f63b30c9700 1 -- 172.21.15.156:0/4022510165 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ac11e760 con 0x7f63ac06a770 2023-09-30T22:25:10.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.828+0000 7f63b30c9700 1 -- 172.21.15.156:0/4022510165 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63ac11d7b0 con 0x7f63ac06a770 2023-09-30T22:25:10.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.829+0000 7f63a97fa700 1 -- 172.21.15.156:0/4022510165 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f63a0021070 con 0x7f63ac06a770 2023-09-30T22:25:10.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.829+0000 7f63a97fa700 1 -- 172.21.15.156:0/4022510165 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f63a0040900 con 0x7f63ac06a770 2023-09-30T22:25:10.833 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.834+0000 7f63a97fa700 1 -- 172.21.15.156:0/4022510165 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f63a0019730 con 0x7f63ac06a770 2023-09-30T22:25:10.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.850+0000 7f8e33592700 1 Processor -- start 2023-09-30T22:25:10.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.851+0000 7f8e33592700 1 -- start start 2023-09-30T22:25:10.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.851+0000 7f8e33592700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8e2c133ad0 0x7f8e2c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.851+0000 7f8e33592700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8e2c1300a0 0x7f8e2c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.851+0000 7f8e33592700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e2c06b2d0 con 0x7f8e2c1309f0 2023-09-30T22:25:10.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.851+0000 7f8e33592700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2c133610 con 0x7f8e2c133ad0 2023-09-30T22:25:10.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.851+0000 7f8e33592700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c09a500 con 0x7f8e2c1300a0 2023-09-30T22:25:10.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.851+0000 7f8e3132e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8e2c133ad0 0x7f8e2c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.851+0000 7f8e3132e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8e2c133ad0 0x7f8e2c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:33426/0 (socket says 172.21.15.156:33426) 2023-09-30T22:25:10.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.851+0000 7f8e3132e700 1 -- 172.21.15.156:0/3644822712 learned_addr learned my addr 172.21.15.156:0/3644822712 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:10.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.852+0000 7f8e30b2d700 1 --2- 172.21.15.156:0/3644822712 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8e2c1300a0 0x7f8e2c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.852+0000 7f8e3132e700 1 -- 172.21.15.156:0/3644822712 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8e2c1300a0 msgr2=0x7f8e2c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:10.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.852+0000 7f8e3132e700 1 --2- 172.21.15.156:0/3644822712 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8e2c1300a0 0x7f8e2c1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.852+0000 7f8e3132e700 1 -- 172.21.15.156:0/3644822712 >> v1:172.21.15.156:6789/0 conn(0x7f8e2c1309f0 legacy=0x7f8e2c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:10.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.852+0000 7f8e3132e700 1 -- 172.21.15.156:0/3644822712 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2c1338b0 con 0x7f8e2c133ad0 2023-09-30T22:25:10.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.852+0000 7f8e3132e700 1 --2- 172.21.15.156:0/3644822712 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e2c133ad0 0x7f8e2c133ea0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f8e280098f0 tx=0x7f8e28009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca4ee85a5bb8d9ab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:10.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.852+0000 7f8e23fff700 1 -- 172.21.15.156:0/3644822712 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e28004230 con 0x7f8e2c133ad0 2023-09-30T22:25:10.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.852+0000 7f8e23fff700 1 -- 172.21.15.156:0/3644822712 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e28004390 con 0x7f8e2c133ad0 2023-09-30T22:25:10.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.852+0000 7f8e23fff700 1 -- 172.21.15.156:0/3644822712 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e280036a0 con 0x7f8e2c133ad0 2023-09-30T22:25:10.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.853+0000 7f8e33592700 1 -- 172.21.15.156:0/3644822712 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e2c133ad0 msgr2=0x7f8e2c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.853+0000 7f8e33592700 1 --2- 172.21.15.156:0/3644822712 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e2c133ad0 0x7f8e2c133ea0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f8e280098f0 tx=0x7f8e28009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:10.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.853+0000 7f8e33592700 1 -- 172.21.15.156:0/3644822712 shutdown_connections 2023-09-30T22:25:10.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.853+0000 7f8e33592700 1 --2- 172.21.15.156:0/3644822712 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e2c133ad0 0x7f8e2c133ea0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.853+0000 7f8e33592700 1 --2- 172.21.15.156:0/3644822712 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8e2c1300a0 0x7f8e2c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.853+0000 7f8e33592700 1 -- 172.21.15.156:0/3644822712 >> 172.21.15.156:0/3644822712 conn(0x7f8e2c099c40 msgr2=0x7f8e2c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:10.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.854+0000 7f8e33592700 1 -- 172.21.15.156:0/3644822712 shutdown_connections 2023-09-30T22:25:10.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.854+0000 7f8e33592700 1 -- 172.21.15.156:0/3644822712 wait complete. 2023-09-30T22:25:10.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.854+0000 7f855b8a3700 1 Processor -- start 2023-09-30T22:25:10.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.854+0000 7f855b8a3700 1 -- start start 2023-09-30T22:25:10.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.855+0000 7f855b8a3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8554131980 0x7f8554131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.855+0000 7f855b8a3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f855409bc70 0x7f855409c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.855+0000 7f855b8a3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f855409c5c0 0x7f8554138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.855+0000 7f855b8a3700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f855406eb30 con 0x7f855409c5c0 2023-09-30T22:25:10.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.855+0000 7f855b8a3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85540a1640 con 0x7f8554131980 2023-09-30T22:25:10.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.855+0000 7f855b8a3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85540a22d0 con 0x7f855409bc70 2023-09-30T22:25:10.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.855+0000 7f8558e3e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f855409bc70 0x7f855409c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.855+0000 7f8e33592700 1 Processor -- start 2023-09-30T22:25:10.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.855+0000 7f8558e3e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f855409bc70 0x7f855409c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:60820/0 (socket says 172.21.15.156:60820) 2023-09-30T22:25:10.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.855+0000 7f8558e3e700 1 -- 172.21.15.156:0/863196481 learned_addr learned my addr 172.21.15.156:0/863196481 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:10.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.855+0000 7f8e33592700 1 -- start start 2023-09-30T22:25:10.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.855+0000 7f8558e3e700 1 -- 172.21.15.156:0/863196481 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8554131980 msgr2=0x7f8554131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:10.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.855+0000 7f8558e3e700 1 --2- 172.21.15.156:0/863196481 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8554131980 0x7f8554131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.855+0000 7f8558e3e700 1 -- 172.21.15.156:0/863196481 >> v2:172.21.15.156:3300/0 conn(0x7f855409c5c0 msgr2=0x7f8554138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:10.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.855+0000 7f8558e3e700 1 --2- 172.21.15.156:0/863196481 >> v2:172.21.15.156:3300/0 conn(0x7f855409c5c0 0x7f8554138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.855+0000 7f8558e3e700 1 -- 172.21.15.156:0/863196481 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8554131550 con 0x7f855409bc70 2023-09-30T22:25:10.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.855+0000 7f8558e3e700 1 --2- 172.21.15.156:0/863196481 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f855409bc70 0x7f855409c080 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f85440098f0 tx=0x7f8544009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fba4b4b6061b81c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:10.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.855+0000 7f854bfff700 1 -- 172.21.15.156:0/863196481 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854400b8a0 con 0x7f855409bc70 2023-09-30T22:25:10.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.855+0000 7f854bfff700 1 -- 172.21.15.156:0/863196481 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854400ba00 con 0x7f855409bc70 2023-09-30T22:25:10.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.855+0000 7f854bfff700 1 -- 172.21.15.156:0/863196481 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854400bd90 con 0x7f855409bc70 2023-09-30T22:25:10.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.856+0000 7f8e33592700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8e2c1300a0 0x7f8e2c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.856+0000 7f8e33592700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e2c1309f0 0x7f8e2c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.856+0000 7f8e33592700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8e2c133ad0 0x7f8e2c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.856+0000 7f8e33592700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c0721b0 con 0x7f8e2c1309f0 2023-09-30T22:25:10.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.856+0000 7f8e33592700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c120300 con 0x7f8e2c133ad0 2023-09-30T22:25:10.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.856+0000 7f8e33592700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c12dd00 con 0x7f8e2c1300a0 2023-09-30T22:25:10.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.856+0000 7f8e3132e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8e2c1300a0 0x7f8e2c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.856+0000 7f8e3132e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8e2c1300a0 0x7f8e2c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:60824/0 (socket says 172.21.15.156:60824) 2023-09-30T22:25:10.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.856+0000 7f8e3132e700 1 -- 172.21.15.156:0/3435312892 learned_addr learned my addr 172.21.15.156:0/3435312892 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:10.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.856+0000 7f8e3132e700 1 -- 172.21.15.156:0/3435312892 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8e2c133ad0 msgr2=0x7f8e2c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.856+0000 7f8e3132e700 1 --2- 172.21.15.156:0/3435312892 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8e2c133ad0 0x7f8e2c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.856+0000 7f8e3132e700 1 -- 172.21.15.156:0/3435312892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e2c1309f0 msgr2=0x7f8e2c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.856+0000 7f8e3132e700 1 --2- 172.21.15.156:0/3435312892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e2c1309f0 0x7f8e2c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.856+0000 7f8e3132e700 1 -- 172.21.15.156:0/3435312892 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e28009550 con 0x7f8e2c1300a0 2023-09-30T22:25:10.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.856+0000 7f855b8a3700 1 -- 172.21.15.156:0/863196481 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f855409bc70 msgr2=0x7f855409c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.856+0000 7f855b8a3700 1 --2- 172.21.15.156:0/863196481 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f855409bc70 0x7f855409c080 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f85440098f0 tx=0x7f8544009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:10.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.856+0000 7f8e3132e700 1 --2- 172.21.15.156:0/3435312892 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8e2c1300a0 0x7f8e2c11da40 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f8e28009130 tx=0x7f8e28004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:10.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.856+0000 7f8e21ffb700 1 -- 172.21.15.156:0/3435312892 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e28011630 con 0x7f8e2c1300a0 2023-09-30T22:25:10.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.856+0000 7f855b8a3700 1 -- 172.21.15.156:0/863196481 shutdown_connections 2023-09-30T22:25:10.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.856+0000 7f855b8a3700 1 --2- 172.21.15.156:0/863196481 >> v2:172.21.15.156:3300/0 conn(0x7f855409c5c0 0x7f8554138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.856+0000 7f855b8a3700 1 --2- 172.21.15.156:0/863196481 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8554131980 0x7f8554131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.856+0000 7f855b8a3700 1 --2- 172.21.15.156:0/863196481 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f855409bc70 0x7f855409c080 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.856+0000 7f855b8a3700 1 -- 172.21.15.156:0/863196481 >> 172.21.15.156:0/863196481 conn(0x7f85540a2980 msgr2=0x7f85540a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:10.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.857+0000 7f8e21ffb700 1 -- 172.21.15.156:0/3435312892 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e28011790 con 0x7f8e2c1300a0 2023-09-30T22:25:10.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.857+0000 7f8e21ffb700 1 -- 172.21.15.156:0/3435312892 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e28011b00 con 0x7f8e2c1300a0 2023-09-30T22:25:10.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.857+0000 7f8e33592700 1 -- 172.21.15.156:0/3435312892 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e2c11fc80 con 0x7f8e2c1300a0 2023-09-30T22:25:10.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.857+0000 7f855b8a3700 1 -- 172.21.15.156:0/863196481 shutdown_connections 2023-09-30T22:25:10.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.857+0000 7f8e33592700 1 -- 172.21.15.156:0/3435312892 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2c11f970 con 0x7f8e2c1300a0 2023-09-30T22:25:10.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.858+0000 7f8e21ffb700 1 -- 172.21.15.156:0/3435312892 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e28021070 con 0x7f8e2c1300a0 2023-09-30T22:25:10.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.858+0000 7f8e21ffb700 1 -- 172.21.15.156:0/3435312892 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8e28040e60 con 0x7f8e2c1300a0 2023-09-30T22:25:10.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.857+0000 7f855b8a3700 1 -- 172.21.15.156:0/863196481 wait complete. 2023-09-30T22:25:10.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.858+0000 7f855b8a3700 1 Processor -- start 2023-09-30T22:25:10.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.858+0000 7f855b8a3700 1 -- start start 2023-09-30T22:25:10.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.858+0000 7f8e33592700 1 -- 172.21.15.156:0/3435312892 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2c04f2a0 con 0x7f8e2c1300a0 2023-09-30T22:25:10.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.859+0000 7f855b8a3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f855409bc70 0x7f855407a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.859+0000 7f855b8a3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f855409c5c0 0x7f855407ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.859+0000 7f855b8a3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8554131980 0x7f855412aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.859+0000 7f855b8a3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855407db30 con 0x7f855409c5c0 2023-09-30T22:25:10.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.859+0000 7f855b8a3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855408ab90 con 0x7f8554131980 2023-09-30T22:25:10.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.859+0000 7f855b8a3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f855407a4c0 con 0x7f855409bc70 2023-09-30T22:25:10.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.859+0000 7f855963f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f855409bc70 0x7f855407a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.859+0000 7f855963f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f855409bc70 0x7f855407a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:60826/0 (socket says 172.21.15.156:60826) 2023-09-30T22:25:10.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.859+0000 7f855963f700 1 -- 172.21.15.156:0/989434943 learned_addr learned my addr 172.21.15.156:0/989434943 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:10.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.859+0000 7f8558e3e700 1 --2- 172.21.15.156:0/989434943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f855409c5c0 0x7f855407ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.859+0000 7f855963f700 1 -- 172.21.15.156:0/989434943 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8554131980 msgr2=0x7f855412aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.859+0000 7f855963f700 1 --2- 172.21.15.156:0/989434943 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8554131980 0x7f855412aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.859+0000 7f855963f700 1 -- 172.21.15.156:0/989434943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f855409c5c0 msgr2=0x7f855407ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.859+0000 7f855963f700 1 --2- 172.21.15.156:0/989434943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f855409c5c0 0x7f855407ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.859+0000 7f855963f700 1 -- 172.21.15.156:0/989434943 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8544009550 con 0x7f855409bc70 2023-09-30T22:25:10.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.859+0000 7f855963f700 1 --2- 172.21.15.156:0/989434943 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f855409bc70 0x7f855407a8e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f855000b520 tx=0x7f855000b830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:10.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.867+0000 7f8549ffb700 1 -- 172.21.15.156:0/989434943 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8550005aa0 con 0x7f855409bc70 2023-09-30T22:25:10.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.867+0000 7f8549ffb700 1 -- 172.21.15.156:0/989434943 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8550005c20 con 0x7f855409bc70 2023-09-30T22:25:10.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.867+0000 7f8549ffb700 1 -- 172.21.15.156:0/989434943 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8550011630 con 0x7f855409bc70 2023-09-30T22:25:10.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.867+0000 7f8e21ffb700 1 -- 172.21.15.156:0/3435312892 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e2802d3a0 con 0x7f8e2c1300a0 2023-09-30T22:25:10.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.867+0000 7f855b8a3700 1 -- 172.21.15.156:0/989434943 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8554130cf0 con 0x7f855409bc70 2023-09-30T22:25:10.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.867+0000 7f855b8a3700 1 -- 172.21.15.156:0/989434943 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855407c1a0 con 0x7f855409bc70 2023-09-30T22:25:10.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.868+0000 7f8549ffb700 1 -- 172.21.15.156:0/989434943 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8550011790 con 0x7f855409bc70 2023-09-30T22:25:10.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.868+0000 7f8549ffb700 1 -- 172.21.15.156:0/989434943 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f855003f2f0 con 0x7f855409bc70 2023-09-30T22:25:10.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.868+0000 7f855b8a3700 1 -- 172.21.15.156:0/989434943 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855407bce0 con 0x7f855409bc70 2023-09-30T22:25:10.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.877+0000 7f8549ffb700 1 -- 172.21.15.156:0/989434943 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8550005fd0 con 0x7f855409bc70 2023-09-30T22:25:10.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.891+0000 7f1083161700 1 Processor -- start 2023-09-30T22:25:10.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.891+0000 7f1083161700 1 -- start start 2023-09-30T22:25:10.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.891+0000 7f1083161700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f107c09e870 0x7f107c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.891+0000 7f1083161700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f107c09f180 0x7f107c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.891+0000 7f1083161700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f107c131d70 0x7f107c1321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.891+0000 7f1083161700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f107c0a0920 con 0x7f107c09e870 2023-09-30T22:25:10.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.891+0000 7f1083161700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107c09c970 con 0x7f107c131d70 2023-09-30T22:25:10.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.891+0000 7f1083161700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f107c09bab0 con 0x7f107c09f180 2023-09-30T22:25:10.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.891+0000 7f10816fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f107c131d70 0x7f107c1321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.892+0000 7f10816fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f107c131d70 0x7f107c1321f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:50952/0 (socket says 172.21.15.156:50952) 2023-09-30T22:25:10.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.892+0000 7f10816fe700 1 -- 172.21.15.156:0/3588510225 learned_addr learned my addr 172.21.15.156:0/3588510225 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:10.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.892+0000 7f1080efd700 1 --2- 172.21.15.156:0/3588510225 >> v2:172.21.15.156:3300/0 conn(0x7f107c09e870 0x7f107c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.892+0000 7f107bfff700 1 --2- 172.21.15.156:0/3588510225 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f107c09f180 0x7f107c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.892+0000 7f10816fe700 1 -- 172.21.15.156:0/3588510225 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f107c09f180 msgr2=0x7f107c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:10.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.892+0000 7f10816fe700 1 --2- 172.21.15.156:0/3588510225 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f107c09f180 0x7f107c131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.892+0000 7f10816fe700 1 -- 172.21.15.156:0/3588510225 >> v2:172.21.15.156:3300/0 conn(0x7f107c09e870 msgr2=0x7f107c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:10.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.892+0000 7f10816fe700 1 --2- 172.21.15.156:0/3588510225 >> v2:172.21.15.156:3300/0 conn(0x7f107c09e870 0x7f107c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.892+0000 7f10816fe700 1 -- 172.21.15.156:0/3588510225 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107c09f9c0 con 0x7f107c131d70 2023-09-30T22:25:10.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.892+0000 7f107bfff700 1 --2- 172.21.15.156:0/3588510225 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f107c09f180 0x7f107c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:10.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.892+0000 7f1080efd700 1 --2- 172.21.15.156:0/3588510225 >> v2:172.21.15.156:3300/0 conn(0x7f107c09e870 0x7f107c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:10.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.892+0000 7f10816fe700 1 --2- 172.21.15.156:0/3588510225 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f107c131d70 0x7f107c1321f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f1074009e80 tx=0x7f107400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=996416cf8e9d2f5d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:10.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.892+0000 7f107b7fe700 1 -- 172.21.15.156:0/3588510225 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107400e070 con 0x7f107c131d70 2023-09-30T22:25:10.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.892+0000 7f107b7fe700 1 -- 172.21.15.156:0/3588510225 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107400b8d0 con 0x7f107c131d70 2023-09-30T22:25:10.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.892+0000 7f107b7fe700 1 -- 172.21.15.156:0/3588510225 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107400bc80 con 0x7f107c131d70 2023-09-30T22:25:10.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.893+0000 7f1083161700 1 -- 172.21.15.156:0/3588510225 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f107c131d70 msgr2=0x7f107c1321f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.893+0000 7f1083161700 1 --2- 172.21.15.156:0/3588510225 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f107c131d70 0x7f107c1321f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f1074009e80 tx=0x7f107400b330 comp rx=0 tx=0).stop 2023-09-30T22:25:10.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.893+0000 7f1083161700 1 -- 172.21.15.156:0/3588510225 shutdown_connections 2023-09-30T22:25:10.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.893+0000 7f1083161700 1 --2- 172.21.15.156:0/3588510225 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f107c131d70 0x7f107c1321f0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.893+0000 7f1083161700 1 --2- 172.21.15.156:0/3588510225 >> v2:172.21.15.156:3300/0 conn(0x7f107c09e870 0x7f107c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.893+0000 7f1083161700 1 --2- 172.21.15.156:0/3588510225 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f107c09f180 0x7f107c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.893+0000 7f1083161700 1 -- 172.21.15.156:0/3588510225 >> 172.21.15.156:0/3588510225 conn(0x7f107c0a4430 msgr2=0x7f107c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:10.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.893+0000 7f1083161700 1 -- 172.21.15.156:0/3588510225 shutdown_connections 2023-09-30T22:25:10.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.893+0000 7f1083161700 1 -- 172.21.15.156:0/3588510225 wait complete. 2023-09-30T22:25:10.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.894+0000 7f1083161700 1 Processor -- start 2023-09-30T22:25:10.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.894+0000 7f1083161700 1 -- start start 2023-09-30T22:25:10.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.895+0000 7f1083161700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f107c09e870 0x7f107c136960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.895+0000 7f1083161700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f107c09f180 0x7f107c136ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.895+0000 7f1083161700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f107c131d70 0x7f107c1c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.895+0000 7f1083161700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107c12ca50 con 0x7f107c09f180 2023-09-30T22:25:10.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.895+0000 7f1083161700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107c12cda0 con 0x7f107c131d70 2023-09-30T22:25:10.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.895+0000 7f1083161700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f107c0a2990 con 0x7f107c09e870 2023-09-30T22:25:10.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.895+0000 7f10816fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f107c131d70 0x7f107c1c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.896+0000 7f107bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f107c09f180 0x7f107c136ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.896+0000 7f10816fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f107c131d70 0x7f107c1c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:50956/0 (socket says 172.21.15.156:50956) 2023-09-30T22:25:10.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.896+0000 7f10816fe700 1 -- 172.21.15.156:0/3637906707 learned_addr learned my addr 172.21.15.156:0/3637906707 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:10.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.896+0000 7f1080efd700 1 --2- 172.21.15.156:0/3637906707 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f107c09e870 0x7f107c136960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.896+0000 7f10816fe700 1 -- 172.21.15.156:0/3637906707 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f107c09e870 msgr2=0x7f107c136960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.896+0000 7f10816fe700 1 --2- 172.21.15.156:0/3637906707 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f107c09e870 0x7f107c136960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.896+0000 7f10816fe700 1 -- 172.21.15.156:0/3637906707 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f107c09f180 msgr2=0x7f107c136ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.896+0000 7f10816fe700 1 --2- 172.21.15.156:0/3637906707 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f107c09f180 0x7f107c136ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.896+0000 7f10816fe700 1 -- 172.21.15.156:0/3637906707 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10700094a0 con 0x7f107c131d70 2023-09-30T22:25:10.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.896+0000 7f107bfff700 1 --2- 172.21.15.156:0/3637906707 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f107c09f180 0x7f107c136ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:10.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.896+0000 7f10816fe700 1 --2- 172.21.15.156:0/3637906707 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f107c131d70 0x7f107c1c8100 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f107c09bf00 tx=0x7f1074004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:10.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.897+0000 7f10797fa700 1 -- 172.21.15.156:0/3637906707 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1074004450 con 0x7f107c131d70 2023-09-30T22:25:10.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.897+0000 7f10797fa700 1 -- 172.21.15.156:0/3637906707 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10740045d0 con 0x7f107c131d70 2023-09-30T22:25:10.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.897+0000 7f1083161700 1 -- 172.21.15.156:0/3637906707 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1074009b30 con 0x7f107c131d70 2023-09-30T22:25:10.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.897+0000 7f10797fa700 1 -- 172.21.15.156:0/3637906707 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10740092e0 con 0x7f107c131d70 2023-09-30T22:25:10.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.897+0000 7f1083161700 1 -- 172.21.15.156:0/3637906707 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f107c138280 con 0x7f107c131d70 2023-09-30T22:25:10.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.898+0000 7f1083161700 1 -- 172.21.15.156:0/3637906707 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f107c04f2a0 con 0x7f107c131d70 2023-09-30T22:25:10.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.898+0000 7f10797fa700 1 -- 172.21.15.156:0/3637906707 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f107401c410 con 0x7f107c131d70 2023-09-30T22:25:10.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.899+0000 7f10797fa700 1 -- 172.21.15.156:0/3637906707 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f10740414b0 con 0x7f107c131d70 2023-09-30T22:25:10.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:10.902+0000 7f10797fa700 1 -- 172.21.15.156:0/3637906707 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1074011b40 con 0x7f107c131d70 2023-09-30T22:25:11.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.064+0000 7f8e33592700 1 -- 172.21.15.156:0/3435312892 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8e2c06c3b0 con 0x7f8e2c1300a0 2023-09-30T22:25:11.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.065+0000 7f8e21ffb700 1 -- 172.21.15.156:0/3435312892 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e28029020 con 0x7f8e2c1300a0 2023-09-30T22:25:11.065 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:11.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.068+0000 7f8e33592700 1 -- 172.21.15.156:0/3435312892 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8e2c1300a0 msgr2=0x7f8e2c11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:11.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.068+0000 7f8e33592700 1 --2- 172.21.15.156:0/3435312892 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8e2c1300a0 0x7f8e2c11da40 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f8e28009130 tx=0x7f8e28004750 comp rx=0 tx=0).stop 2023-09-30T22:25:11.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.068+0000 7f8e33592700 1 -- 172.21.15.156:0/3435312892 shutdown_connections 2023-09-30T22:25:11.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.068+0000 7f8e33592700 1 --2- 172.21.15.156:0/3435312892 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8e2c133ad0 0x7f8e2c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.068+0000 7f8e33592700 1 --2- 172.21.15.156:0/3435312892 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8e2c1300a0 0x7f8e2c11da40 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.068+0000 7f8e33592700 1 --2- 172.21.15.156:0/3435312892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e2c1309f0 0x7f8e2c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.068+0000 7f8e33592700 1 -- 172.21.15.156:0/3435312892 >> 172.21.15.156:0/3435312892 conn(0x7f8e2c099c40 msgr2=0x7f8e2c09d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:11.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.068+0000 7f8e33592700 1 -- 172.21.15.156:0/3435312892 shutdown_connections 2023-09-30T22:25:11.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.068+0000 7f8e33592700 1 -- 172.21.15.156:0/3435312892 wait complete. 2023-09-30T22:25:11.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.073+0000 7f855b8a3700 1 -- 172.21.15.156:0/989434943 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f855407d7b0 con 0x7f855409bc70 2023-09-30T22:25:11.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.073+0000 7f8549ffb700 1 -- 172.21.15.156:0/989434943 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f855407d7b0 con 0x7f855409bc70 2023-09-30T22:25:11.073 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:11.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.076+0000 7f855b8a3700 1 -- 172.21.15.156:0/989434943 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f855409bc70 msgr2=0x7f855407a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:11.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.076+0000 7f855b8a3700 1 --2- 172.21.15.156:0/989434943 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f855409bc70 0x7f855407a8e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f855000b520 tx=0x7f855000b830 comp rx=0 tx=0).stop 2023-09-30T22:25:11.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.076+0000 7f855b8a3700 1 -- 172.21.15.156:0/989434943 shutdown_connections 2023-09-30T22:25:11.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.076+0000 7f855b8a3700 1 --2- 172.21.15.156:0/989434943 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8554131980 0x7f855412aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.076+0000 7f855b8a3700 1 --2- 172.21.15.156:0/989434943 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f855409bc70 0x7f855407a8e0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.076+0000 7f855b8a3700 1 --2- 172.21.15.156:0/989434943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f855409c5c0 0x7f855407ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.076+0000 7f855b8a3700 1 -- 172.21.15.156:0/989434943 >> 172.21.15.156:0/989434943 conn(0x7f85540a2980 msgr2=0x7f85541b8460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:11.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.076+0000 7f855b8a3700 1 -- 172.21.15.156:0/989434943 shutdown_connections 2023-09-30T22:25:11.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.076+0000 7f855b8a3700 1 -- 172.21.15.156:0/989434943 wait complete. 2023-09-30T22:25:11.087 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:11.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:11.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.101+0000 7f63b30c9700 1 -- 172.21.15.156:0/4022510165 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f63ac04f2a0 con 0x7f63ac06a770 2023-09-30T22:25:11.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.102+0000 7f63a97fa700 1 -- 172.21.15.156:0/4022510165 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f63a0029030 con 0x7f63ac06a770 2023-09-30T22:25:11.101 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:11.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.104+0000 7f63b30c9700 1 -- 172.21.15.156:0/4022510165 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63ac06a770 msgr2=0x7f63ac11c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:11.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.104+0000 7f63b30c9700 1 --2- 172.21.15.156:0/4022510165 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63ac06a770 0x7f63ac11c490 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f63a0000c00 tx=0x7f63a0004750 comp rx=0 tx=0).stop 2023-09-30T22:25:11.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.104+0000 7f63b30c9700 1 -- 172.21.15.156:0/4022510165 shutdown_connections 2023-09-30T22:25:11.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.104+0000 7f63b30c9700 1 --2- 172.21.15.156:0/4022510165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63ac131cf0 0x7f63ac1c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.104+0000 7f63b30c9700 1 --2- 172.21.15.156:0/4022510165 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63ac06a770 0x7f63ac11c490 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.104+0000 7f63b30c9700 1 --2- 172.21.15.156:0/4022510165 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f63ac06b080 0x7f63ac11c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.104+0000 7f63b30c9700 1 -- 172.21.15.156:0/4022510165 >> 172.21.15.156:0/4022510165 conn(0x7f63ac099c40 msgr2=0x7f63ac1b9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:11.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.104+0000 7f63b30c9700 1 -- 172.21.15.156:0/4022510165 shutdown_connections 2023-09-30T22:25:11.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.104+0000 7f63b30c9700 1 -- 172.21.15.156:0/4022510165 wait complete. 2023-09-30T22:25:11.116 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:11.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.145+0000 7f1083161700 1 -- 172.21.15.156:0/3637906707 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f107c12d420 con 0x7f107c131d70 2023-09-30T22:25:11.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.145+0000 7f10797fa700 1 -- 172.21.15.156:0/3637906707 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1074033020 con 0x7f107c131d70 2023-09-30T22:25:11.145 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:11.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.147+0000 7f1083161700 1 -- 172.21.15.156:0/3637906707 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f107c131d70 msgr2=0x7f107c1c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:11.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.147+0000 7f1083161700 1 --2- 172.21.15.156:0/3637906707 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f107c131d70 0x7f107c1c8100 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f107c09bf00 tx=0x7f1074004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.148+0000 7f1083161700 1 -- 172.21.15.156:0/3637906707 shutdown_connections 2023-09-30T22:25:11.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.148+0000 7f1083161700 1 --2- 172.21.15.156:0/3637906707 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f107c131d70 0x7f107c1c8100 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.148+0000 7f1083161700 1 --2- 172.21.15.156:0/3637906707 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f107c09e870 0x7f107c136960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.148+0000 7f1083161700 1 --2- 172.21.15.156:0/3637906707 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f107c09f180 0x7f107c136ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.148+0000 7f1083161700 1 -- 172.21.15.156:0/3637906707 >> 172.21.15.156:0/3637906707 conn(0x7f107c0a4430 msgr2=0x7f107c06ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:11.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.148+0000 7f1083161700 1 -- 172.21.15.156:0/3637906707 shutdown_connections 2023-09-30T22:25:11.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:11.148+0000 7f1083161700 1 -- 172.21.15.156:0/3637906707 wait complete. 2023-09-30T22:25:11.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:12.088 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:12.089 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:12.116 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:12.160 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:12.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.231+0000 7f579a07d700 1 Processor -- start 2023-09-30T22:25:12.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.231+0000 7f579a07d700 1 -- start start 2023-09-30T22:25:12.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.232+0000 7f579a07d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f579406a770 0x7f579406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.232+0000 7f579a07d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f579409dec0 0x7f579406b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.232+0000 7f579a07d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f579406b5c0 con 0x7f5794131a00 2023-09-30T22:25:12.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.232+0000 7f579a07d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f579406e900 con 0x7f579409dec0 2023-09-30T22:25:12.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.232+0000 7f579a07d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f579409d180 con 0x7f579406a770 2023-09-30T22:25:12.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.232+0000 7f57937fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f579406a770 0x7f579406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.232+0000 7f5792ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f579409dec0 0x7f579406b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.232+0000 7f57937fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f579406a770 0x7f579406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53280/0 (socket says 172.21.15.156:53280) 2023-09-30T22:25:12.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.232+0000 7f57937fe700 1 -- 172.21.15.156:0/1913406094 learned_addr learned my addr 172.21.15.156:0/1913406094 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:12.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.232+0000 7f5792ffd700 1 -- 172.21.15.156:0/1913406094 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f579406a770 msgr2=0x7f579406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:12.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.232+0000 7f5792ffd700 1 --2- 172.21.15.156:0/1913406094 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f579406a770 0x7f579406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.233+0000 7f5792ffd700 1 -- 172.21.15.156:0/1913406094 >> v1:172.21.15.156:6789/0 conn(0x7f5794131a00 legacy=0x7f5794131e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.233+0000 7f5792ffd700 1 -- 172.21.15.156:0/1913406094 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579409e780 con 0x7f579409dec0 2023-09-30T22:25:12.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.233+0000 7f57937fe700 1 --2- 172.21.15.156:0/1913406094 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f579406a770 0x7f579406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:12.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.233+0000 7f5792ffd700 1 --2- 172.21.15.156:0/1913406094 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f579409dec0 0x7f579406b080 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f5788009840 tx=0x7f5788009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a89d2dd7abe740f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:12.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.233+0000 7f57927fc700 1 -- 172.21.15.156:0/1913406094 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788011830 con 0x7f579409dec0 2023-09-30T22:25:12.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.233+0000 7f57927fc700 1 -- 172.21.15.156:0/1913406094 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5788011990 con 0x7f579409dec0 2023-09-30T22:25:12.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.233+0000 7f57927fc700 1 -- 172.21.15.156:0/1913406094 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788011d20 con 0x7f579409dec0 2023-09-30T22:25:12.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.234+0000 7f579a07d700 1 -- 172.21.15.156:0/1913406094 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f579409dec0 msgr2=0x7f579406b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.234+0000 7f579a07d700 1 --2- 172.21.15.156:0/1913406094 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f579409dec0 0x7f579406b080 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f5788009840 tx=0x7f5788009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:12.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.234+0000 7f579a07d700 1 -- 172.21.15.156:0/1913406094 shutdown_connections 2023-09-30T22:25:12.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.234+0000 7f579a07d700 1 --2- 172.21.15.156:0/1913406094 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f579406a770 0x7f579406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.234+0000 7f579a07d700 1 --2- 172.21.15.156:0/1913406094 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f579409dec0 0x7f579406b080 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.234+0000 7f579a07d700 1 -- 172.21.15.156:0/1913406094 >> 172.21.15.156:0/1913406094 conn(0x7f5794099c40 msgr2=0x7f57940a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:12.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.234+0000 7f579a07d700 1 -- 172.21.15.156:0/1913406094 shutdown_connections 2023-09-30T22:25:12.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.234+0000 7f579a07d700 1 -- 172.21.15.156:0/1913406094 wait complete. 2023-09-30T22:25:12.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.235+0000 7f579a07d700 1 Processor -- start 2023-09-30T22:25:12.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.235+0000 7f579a07d700 1 -- start start 2023-09-30T22:25:12.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.236+0000 7f579a07d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f579406a770 0x7f579411c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.236+0000 7f579a07d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f579409dec0 0x7f579411c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.236+0000 7f579a07d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5794131a00 0x7f579411cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.236+0000 7f579a07d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579411e3b0 con 0x7f579409dec0 2023-09-30T22:25:12.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.236+0000 7f579a07d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579411fca0 con 0x7f579406a770 2023-09-30T22:25:12.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.236+0000 7f579a07d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5794071ce0 con 0x7f5794131a00 2023-09-30T22:25:12.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.236+0000 7f57937fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f579406a770 0x7f579411c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.236+0000 7f57937fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f579406a770 0x7f579411c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48284/0 (socket says 172.21.15.156:48284) 2023-09-30T22:25:12.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.236+0000 7f57937fe700 1 -- 172.21.15.156:0/2328201259 learned_addr learned my addr 172.21.15.156:0/2328201259 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:12.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.236+0000 7f5793fff700 1 --2- 172.21.15.156:0/2328201259 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5794131a00 0x7f579411cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.236+0000 7f5792ffd700 1 --2- 172.21.15.156:0/2328201259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f579409dec0 0x7f579411c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.236+0000 7f5793fff700 1 -- 172.21.15.156:0/2328201259 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f579406a770 msgr2=0x7f579411c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.236+0000 7f5793fff700 1 --2- 172.21.15.156:0/2328201259 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f579406a770 0x7f579411c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.236+0000 7f5793fff700 1 -- 172.21.15.156:0/2328201259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f579409dec0 msgr2=0x7f579411c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.236+0000 7f5793fff700 1 --2- 172.21.15.156:0/2328201259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f579409dec0 0x7f579411c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.236+0000 7f5793fff700 1 -- 172.21.15.156:0/2328201259 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578400db30 con 0x7f5794131a00 2023-09-30T22:25:12.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.236+0000 7f5792ffd700 1 --2- 172.21.15.156:0/2328201259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f579409dec0 0x7f579411c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:12.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.236+0000 7f57937fe700 1 --2- 172.21.15.156:0/2328201259 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f579406a770 0x7f579411c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:12.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.236+0000 7f5793fff700 1 --2- 172.21.15.156:0/2328201259 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5794131a00 0x7f579411cc50 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f578c00cb90 tx=0x7f578c00cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:12.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.237+0000 7f577bfff700 1 -- 172.21.15.156:0/2328201259 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c003c00 con 0x7f5794131a00 2023-09-30T22:25:12.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.237+0000 7f577bfff700 1 -- 172.21.15.156:0/2328201259 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578c003d60 con 0x7f5794131a00 2023-09-30T22:25:12.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.237+0000 7f579a07d700 1 -- 172.21.15.156:0/2328201259 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57880094a0 con 0x7f5794131a00 2023-09-30T22:25:12.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.237+0000 7f577bfff700 1 -- 172.21.15.156:0/2328201259 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c00aa80 con 0x7f5794131a00 2023-09-30T22:25:12.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.237+0000 7f579a07d700 1 -- 172.21.15.156:0/2328201259 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579412f570 con 0x7f5794131a00 2023-09-30T22:25:12.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.237+0000 7f579a07d700 1 -- 172.21.15.156:0/2328201259 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f579404f2a0 con 0x7f5794131a00 2023-09-30T22:25:12.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.238+0000 7f577bfff700 1 -- 172.21.15.156:0/2328201259 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f578c00abe0 con 0x7f5794131a00 2023-09-30T22:25:12.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.238+0000 7f577bfff700 1 -- 172.21.15.156:0/2328201259 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f578c040110 con 0x7f5794131a00 2023-09-30T22:25:12.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.241+0000 7f0a22ee3700 1 Processor -- start 2023-09-30T22:25:12.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.241+0000 7f0a22ee3700 1 -- start start 2023-09-30T22:25:12.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.242+0000 7f0a22ee3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a1c131980 0x7f0a1c131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.242+0000 7f0a22ee3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a1c09bc70 0x7f0a1c09c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.242+0000 7f0a22ee3700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a1c0a1640 con 0x7f0a1c09c5c0 2023-09-30T22:25:12.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.242+0000 7f0a22ee3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c06eb30 con 0x7f0a1c131980 2023-09-30T22:25:12.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.242+0000 7f0a22ee3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c0a22d0 con 0x7f0a1c09bc70 2023-09-30T22:25:12.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.242+0000 7f0a1bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a1c09bc70 0x7f0a1c09c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.242+0000 7f0a21480700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f0a1c09c5c0 0x7f0a1c138700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:41594/0 (socket says 172.21.15.156:41594) 2023-09-30T22:25:12.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.242+0000 7f0a21480700 1 -- 172.21.15.156:0/3119237454 learned_addr learned my addr 172.21.15.156:0/3119237454 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:12.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.242+0000 7f0a20c7f700 1 --2- 172.21.15.156:0/3119237454 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a1c131980 0x7f0a1c131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.243+0000 7f0a1bfff700 1 -- 172.21.15.156:0/3119237454 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a1c131980 msgr2=0x7f0a1c131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:12.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.243+0000 7f0a1bfff700 1 --2- 172.21.15.156:0/3119237454 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a1c131980 0x7f0a1c131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.243+0000 7f0a1b7fe700 1 -- 172.21.15.156:0/3119237454 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79151078 0 0) 0x7f0a1c0a1640 con 0x7f0a1c09c5c0 2023-09-30T22:25:12.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.243+0000 7f0a1bfff700 1 -- 172.21.15.156:0/3119237454 >> v1:172.21.15.156:6789/0 conn(0x7f0a1c09c5c0 legacy=0x7f0a1c138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.243+0000 7f0a1bfff700 1 -- 172.21.15.156:0/3119237454 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1c131550 con 0x7f0a1c09bc70 2023-09-30T22:25:12.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.243+0000 7f0a20c7f700 1 --2- 172.21.15.156:0/3119237454 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a1c131980 0x7f0a1c131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:12.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.243+0000 7f0a1bfff700 1 --2- 172.21.15.156:0/3119237454 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a1c09bc70 0x7f0a1c09c080 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f0a08009870 tx=0x7f0a08009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7085e9b70d85882 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:12.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.243+0000 7f0a1b7fe700 1 -- 172.21.15.156:0/3119237454 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a08011830 con 0x7f0a1c09bc70 2023-09-30T22:25:12.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.243+0000 7f0a1b7fe700 1 -- 172.21.15.156:0/3119237454 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a08011990 con 0x7f0a1c09bc70 2023-09-30T22:25:12.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.243+0000 7f0a1b7fe700 1 -- 172.21.15.156:0/3119237454 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a08011d20 con 0x7f0a1c09bc70 2023-09-30T22:25:12.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.243+0000 7f577bfff700 1 -- 172.21.15.156:0/2328201259 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f578c0050d0 con 0x7f5794131a00 2023-09-30T22:25:12.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.244+0000 7f0a22ee3700 1 -- 172.21.15.156:0/3119237454 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a1c09bc70 msgr2=0x7f0a1c09c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.244+0000 7f0a22ee3700 1 --2- 172.21.15.156:0/3119237454 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a1c09bc70 0x7f0a1c09c080 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f0a08009870 tx=0x7f0a08009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:12.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.245+0000 7f0a22ee3700 1 -- 172.21.15.156:0/3119237454 shutdown_connections 2023-09-30T22:25:12.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.245+0000 7f0a22ee3700 1 --2- 172.21.15.156:0/3119237454 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a1c131980 0x7f0a1c131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.245+0000 7f0a22ee3700 1 --2- 172.21.15.156:0/3119237454 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a1c09bc70 0x7f0a1c09c080 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.245+0000 7f0a22ee3700 1 -- 172.21.15.156:0/3119237454 >> 172.21.15.156:0/3119237454 conn(0x7f0a1c0a2980 msgr2=0x7f0a1c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:12.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.245+0000 7f0a22ee3700 1 -- 172.21.15.156:0/3119237454 shutdown_connections 2023-09-30T22:25:12.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.245+0000 7f0a22ee3700 1 -- 172.21.15.156:0/3119237454 wait complete. 2023-09-30T22:25:12.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.246+0000 7f0a22ee3700 1 Processor -- start 2023-09-30T22:25:12.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.246+0000 7f0a22ee3700 1 -- start start 2023-09-30T22:25:12.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.246+0000 7f0a22ee3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a1c09bc70 0x7f0a1c119680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.246+0000 7f0a22ee3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a1c09c5c0 0x7f0a1c119bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.246+0000 7f0a22ee3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a1c131980 0x7f0a1c11a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.246+0000 7f0a22ee3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c11b8e0 con 0x7f0a1c09bc70 2023-09-30T22:25:12.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.246+0000 7f0a22ee3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c11db60 con 0x7f0a1c131980 2023-09-30T22:25:12.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.246+0000 7f0a22ee3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c11d1a0 con 0x7f0a1c09c5c0 2023-09-30T22:25:12.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.246+0000 7f0a1bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a1c09c5c0 0x7f0a1c119bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.246+0000 7f0a1bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a1c09c5c0 0x7f0a1c119bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53310/0 (socket says 172.21.15.156:53310) 2023-09-30T22:25:12.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.246+0000 7f0a1bfff700 1 -- 172.21.15.156:0/2014361930 learned_addr learned my addr 172.21.15.156:0/2014361930 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:12.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.246+0000 7f0a21480700 1 --2- 172.21.15.156:0/2014361930 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a1c131980 0x7f0a1c11a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.247+0000 7f0a20c7f700 1 --2- 172.21.15.156:0/2014361930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a1c09bc70 0x7f0a1c119680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.247+0000 7f0a1bfff700 1 -- 172.21.15.156:0/2014361930 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a1c131980 msgr2=0x7f0a1c11a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.247+0000 7f0a1bfff700 1 --2- 172.21.15.156:0/2014361930 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a1c131980 0x7f0a1c11a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.247+0000 7f0a1bfff700 1 -- 172.21.15.156:0/2014361930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a1c09bc70 msgr2=0x7f0a1c119680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.247+0000 7f0a1bfff700 1 --2- 172.21.15.156:0/2014361930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a1c09bc70 0x7f0a1c119680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.247+0000 7f0a1bfff700 1 -- 172.21.15.156:0/2014361930 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a10009430 con 0x7f0a1c09c5c0 2023-09-30T22:25:12.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.247+0000 7f0a1bfff700 1 --2- 172.21.15.156:0/2014361930 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a1c09c5c0 0x7f0a1c119bc0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f0a080090b0 tx=0x7f0a08004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:12.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.247+0000 7f0a197fa700 1 -- 172.21.15.156:0/2014361930 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a08004510 con 0x7f0a1c09c5c0 2023-09-30T22:25:12.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.247+0000 7f0a197fa700 1 -- 172.21.15.156:0/2014361930 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0801f070 con 0x7f0a1c09c5c0 2023-09-30T22:25:12.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.247+0000 7f0a22ee3700 1 -- 172.21.15.156:0/2014361930 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a080094a0 con 0x7f0a1c09c5c0 2023-09-30T22:25:12.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.247+0000 7f0a197fa700 1 -- 172.21.15.156:0/2014361930 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a080038c0 con 0x7f0a1c09c5c0 2023-09-30T22:25:12.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.247+0000 7f0a22ee3700 1 -- 172.21.15.156:0/2014361930 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1c0a1c40 con 0x7f0a1c09c5c0 2023-09-30T22:25:12.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.248+0000 7f0a22ee3700 1 -- 172.21.15.156:0/2014361930 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a1c11cd20 con 0x7f0a1c09c5c0 2023-09-30T22:25:12.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.249+0000 7f0a197fa700 1 -- 172.21.15.156:0/2014361930 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0a08003a20 con 0x7f0a1c09c5c0 2023-09-30T22:25:12.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.249+0000 7f0a197fa700 1 -- 172.21.15.156:0/2014361930 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0a08021070 con 0x7f0a1c09c5c0 2023-09-30T22:25:12.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.257+0000 7f0a197fa700 1 -- 172.21.15.156:0/2014361930 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0a08010380 con 0x7f0a1c09c5c0 2023-09-30T22:25:12.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.280+0000 7f7c7229f700 1 Processor -- start 2023-09-30T22:25:12.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.280+0000 7f7c7229f700 1 -- start start 2023-09-30T22:25:12.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.281+0000 7f7c7229f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c6c09d860 0x7f7c6c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.281+0000 7f7c7229f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7c6c09e170 0x7f7c6c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.281+0000 7f7c7229f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c6c130ce0 0x7f7c6c131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.281+0000 7f7c7229f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c6c09aaa0 con 0x7f7c6c09e170 2023-09-30T22:25:12.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.281+0000 7f7c7229f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c09f870 con 0x7f7c6c130ce0 2023-09-30T22:25:12.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.281+0000 7f7c7229f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c09b360 con 0x7f7c6c09d860 2023-09-30T22:25:12.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.281+0000 7f7c7083c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c6c130ce0 0x7f7c6c131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.281+0000 7f7c7083c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c6c130ce0 0x7f7c6c131180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48316/0 (socket says 172.21.15.156:48316) 2023-09-30T22:25:12.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.281+0000 7f7c7083c700 1 -- 172.21.15.156:0/4279884411 learned_addr learned my addr 172.21.15.156:0/4279884411 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:12.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.281+0000 7f7c6b7fe700 1 --2- 172.21.15.156:0/4279884411 >> v2:172.21.15.156:3300/0 conn(0x7f7c6c09e170 0x7f7c6c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.281+0000 7f7c6bfff700 1 --2- 172.21.15.156:0/4279884411 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c6c09d860 0x7f7c6c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.281+0000 7f7c6b7fe700 1 -- 172.21.15.156:0/4279884411 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c6c09d860 msgr2=0x7f7c6c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:12.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.281+0000 7f7c6b7fe700 1 --2- 172.21.15.156:0/4279884411 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c6c09d860 0x7f7c6c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.281+0000 7f7c6b7fe700 1 -- 172.21.15.156:0/4279884411 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c6c130ce0 msgr2=0x7f7c6c131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:12.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.281+0000 7f7c6b7fe700 1 --2- 172.21.15.156:0/4279884411 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c6c130ce0 0x7f7c6c131180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.281+0000 7f7c6b7fe700 1 -- 172.21.15.156:0/4279884411 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c09b620 con 0x7f7c6c09e170 2023-09-30T22:25:12.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.281+0000 7f7c6bfff700 1 --2- 172.21.15.156:0/4279884411 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c6c09d860 0x7f7c6c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:12.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.282+0000 7f7c6b7fe700 1 --2- 172.21.15.156:0/4279884411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c6c09e170 0x7f7c6c1307a0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f7c6000bd90 tx=0x7f7c6000d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff925ac9c4c774ae server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:12.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.282+0000 7f7c6affd700 1 -- 172.21.15.156:0/4279884411 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c60005e30 con 0x7f7c6c09e170 2023-09-30T22:25:12.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.282+0000 7f7c6affd700 1 -- 172.21.15.156:0/4279884411 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6000d910 con 0x7f7c6c09e170 2023-09-30T22:25:12.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.282+0000 7f7c6affd700 1 -- 172.21.15.156:0/4279884411 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6000dcc0 con 0x7f7c6c09e170 2023-09-30T22:25:12.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.283+0000 7f7c7229f700 1 -- 172.21.15.156:0/4279884411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c6c09e170 msgr2=0x7f7c6c1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.283+0000 7f7c7229f700 1 --2- 172.21.15.156:0/4279884411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c6c09e170 0x7f7c6c1307a0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f7c6000bd90 tx=0x7f7c6000d330 comp rx=0 tx=0).stop 2023-09-30T22:25:12.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.283+0000 7f7c7229f700 1 -- 172.21.15.156:0/4279884411 shutdown_connections 2023-09-30T22:25:12.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.283+0000 7f7c7229f700 1 --2- 172.21.15.156:0/4279884411 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c6c130ce0 0x7f7c6c131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.283+0000 7f7c7229f700 1 --2- 172.21.15.156:0/4279884411 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c6c09d860 0x7f7c6c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.283+0000 7f7c7229f700 1 --2- 172.21.15.156:0/4279884411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c6c09e170 0x7f7c6c1307a0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.283+0000 7f7c7229f700 1 -- 172.21.15.156:0/4279884411 >> 172.21.15.156:0/4279884411 conn(0x7f7c6c099c40 msgr2=0x7f7c6c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:12.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.283+0000 7f7c7229f700 1 -- 172.21.15.156:0/4279884411 shutdown_connections 2023-09-30T22:25:12.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.283+0000 7f7c7229f700 1 -- 172.21.15.156:0/4279884411 wait complete. 2023-09-30T22:25:12.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.285+0000 7f7c7229f700 1 Processor -- start 2023-09-30T22:25:12.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.285+0000 7f7c7229f700 1 -- start start 2023-09-30T22:25:12.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.286+0000 7f7c7229f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c6c09d860 0x7f7c6c1c4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.286+0000 7f7c7229f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c6c09e170 0x7f7c6c1c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.286+0000 7f7c7229f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c6c130ce0 0x7f7c6c119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.286+0000 7f7c7229f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c12c5d0 con 0x7f7c6c09e170 2023-09-30T22:25:12.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.286+0000 7f7c7229f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c11b560 con 0x7f7c6c09d860 2023-09-30T22:25:12.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.286+0000 7f7c7229f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c11c990 con 0x7f7c6c130ce0 2023-09-30T22:25:12.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.286+0000 7f7c6bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c6c09d860 0x7f7c6c1c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.286+0000 7f7c6bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c6c09d860 0x7f7c6c1c4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48324/0 (socket says 172.21.15.156:48324) 2023-09-30T22:25:12.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.286+0000 7f7c6bfff700 1 -- 172.21.15.156:0/2714185575 learned_addr learned my addr 172.21.15.156:0/2714185575 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:12.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.286+0000 7f7c6b7fe700 1 --2- 172.21.15.156:0/2714185575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c6c09e170 0x7f7c6c1c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.286+0000 7f7c7083c700 1 --2- 172.21.15.156:0/2714185575 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c6c130ce0 0x7f7c6c119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.286+0000 7f7c6bfff700 1 -- 172.21.15.156:0/2714185575 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c6c130ce0 msgr2=0x7f7c6c119630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.286+0000 7f7c6bfff700 1 --2- 172.21.15.156:0/2714185575 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c6c130ce0 0x7f7c6c119630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.286+0000 7f7c6bfff700 1 -- 172.21.15.156:0/2714185575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c6c09e170 msgr2=0x7f7c6c1c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.286+0000 7f7c6bfff700 1 --2- 172.21.15.156:0/2714185575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c6c09e170 0x7f7c6c1c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.286+0000 7f7c6bfff700 1 -- 172.21.15.156:0/2714185575 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6000ba70 con 0x7f7c6c09d860 2023-09-30T22:25:12.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.286+0000 7f7c6bfff700 1 --2- 172.21.15.156:0/2714185575 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c6c09d860 0x7f7c6c1c4260 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c00c740 tx=0x7f7c5c00ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:12.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.287+0000 7f7c68ff9700 1 -- 172.21.15.156:0/2714185575 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c011800 con 0x7f7c6c09d860 2023-09-30T22:25:12.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.287+0000 7f7c68ff9700 1 -- 172.21.15.156:0/2714185575 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5c011960 con 0x7f7c6c09d860 2023-09-30T22:25:12.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.287+0000 7f7c7229f700 1 -- 172.21.15.156:0/2714185575 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6c1c3de0 con 0x7f7c6c09d860 2023-09-30T22:25:12.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.287+0000 7f7c68ff9700 1 -- 172.21.15.156:0/2714185575 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c011cd0 con 0x7f7c6c09d860 2023-09-30T22:25:12.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.287+0000 7f7c7229f700 1 -- 172.21.15.156:0/2714185575 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6c11c490 con 0x7f7c6c09d860 2023-09-30T22:25:12.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.288+0000 7f7c68ff9700 1 -- 172.21.15.156:0/2714185575 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c5c021350 con 0x7f7c6c09d860 2023-09-30T22:25:12.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.288+0000 7f7c68ff9700 1 -- 172.21.15.156:0/2714185575 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7c5c03f6d0 con 0x7f7c6c09d860 2023-09-30T22:25:12.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.289+0000 7f7c7229f700 1 -- 172.21.15.156:0/2714185575 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c6c04f2a0 con 0x7f7c6c09d860 2023-09-30T22:25:12.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.293+0000 7f7c68ff9700 1 -- 172.21.15.156:0/2714185575 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c5c018350 con 0x7f7c6c09d860 2023-09-30T22:25:12.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.315+0000 7ff45c33e700 1 Processor -- start 2023-09-30T22:25:12.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.315+0000 7ff45c33e700 1 -- start start 2023-09-30T22:25:12.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.315+0000 7ff45c33e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff45409f430 0x7ff454136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.315+0000 7ff45c33e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff454137010 0x7ff4541393f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.315+0000 7ff45c33e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff45409b6d0 con 0x7ff45409e950 2023-09-30T22:25:12.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.315+0000 7ff45c33e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff45409afb0 con 0x7ff45409f430 2023-09-30T22:25:12.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.315+0000 7ff45c33e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4540a0970 con 0x7ff454137010 2023-09-30T22:25:12.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.315+0000 7ff45a0da700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff45409e950 0x7ff45409ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:41600/0 (socket says 172.21.15.156:41600) 2023-09-30T22:25:12.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.315+0000 7ff45a0da700 1 -- 172.21.15.156:0/2135768046 learned_addr learned my addr 172.21.15.156:0/2135768046 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:12.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.316+0000 7ff4598d9700 1 --2- 172.21.15.156:0/2135768046 >> v2:172.21.15.156:3300/0 conn(0x7ff45409f430 0x7ff454136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.316+0000 7ff45a8db700 1 --2- 172.21.15.156:0/2135768046 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff454137010 0x7ff4541393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.316+0000 7ff4590d8700 1 -- 172.21.15.156:0/2135768046 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389930525 0 0) 0x7ff45409b6d0 con 0x7ff45409e950 2023-09-30T22:25:12.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.316+0000 7ff4590d8700 1 -- 172.21.15.156:0/2135768046 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4400035b0 con 0x7ff45409e950 2023-09-30T22:25:12.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.316+0000 7ff4598d9700 1 -- 172.21.15.156:0/2135768046 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff454137010 msgr2=0x7ff4541393f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:12.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.316+0000 7ff4598d9700 1 --2- 172.21.15.156:0/2135768046 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff454137010 0x7ff4541393f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.316+0000 7ff4598d9700 1 -- 172.21.15.156:0/2135768046 >> v1:172.21.15.156:6789/0 conn(0x7ff45409e950 legacy=0x7ff45409ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.316+0000 7ff4598d9700 1 -- 172.21.15.156:0/2135768046 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4540a0320 con 0x7ff45409f430 2023-09-30T22:25:12.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.316+0000 7ff4598d9700 1 --2- 172.21.15.156:0/2135768046 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff45409f430 0x7ff454136ad0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7ff444009840 tx=0x7ff444009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ec58c69dbfe60d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:12.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.316+0000 7ff4590d8700 1 -- 172.21.15.156:0/2135768046 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff444011830 con 0x7ff45409f430 2023-09-30T22:25:12.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.316+0000 7ff4590d8700 1 -- 172.21.15.156:0/2135768046 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff444011990 con 0x7ff45409f430 2023-09-30T22:25:12.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.316+0000 7ff4590d8700 1 -- 172.21.15.156:0/2135768046 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff444011d20 con 0x7ff45409f430 2023-09-30T22:25:12.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.317+0000 7ff45c33e700 1 -- 172.21.15.156:0/2135768046 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff45409f430 msgr2=0x7ff454136ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.317+0000 7ff45c33e700 1 --2- 172.21.15.156:0/2135768046 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff45409f430 0x7ff454136ad0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7ff444009840 tx=0x7ff444009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:12.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.317+0000 7ff45c33e700 1 -- 172.21.15.156:0/2135768046 shutdown_connections 2023-09-30T22:25:12.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.317+0000 7ff45c33e700 1 --2- 172.21.15.156:0/2135768046 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff454137010 0x7ff4541393f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.317+0000 7ff45c33e700 1 --2- 172.21.15.156:0/2135768046 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff45409f430 0x7ff454136ad0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.317+0000 7ff45c33e700 1 -- 172.21.15.156:0/2135768046 >> 172.21.15.156:0/2135768046 conn(0x7ff4540a0f70 msgr2=0x7ff4540a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:12.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.317+0000 7ff45c33e700 1 -- 172.21.15.156:0/2135768046 shutdown_connections 2023-09-30T22:25:12.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.317+0000 7ff45c33e700 1 -- 172.21.15.156:0/2135768046 wait complete. 2023-09-30T22:25:12.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.318+0000 7ff45c33e700 1 Processor -- start 2023-09-30T22:25:12.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.318+0000 7ff45c33e700 1 -- start start 2023-09-30T22:25:12.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.319+0000 7ff45c33e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff45409e950 0x7ff4541c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.319+0000 7ff45c33e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff45409f430 0x7ff4541c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.319+0000 7ff45c33e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff454137010 0x7ff45406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.319+0000 7ff45c33e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff454135670 con 0x7ff45409f430 2023-09-30T22:25:12.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.319+0000 7ff45c33e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45406d640 con 0x7ff454137010 2023-09-30T22:25:12.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.319+0000 7ff45c33e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff454123b60 con 0x7ff45409e950 2023-09-30T22:25:12.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.319+0000 7ff4598d9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff45409f430 0x7ff4541c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.319+0000 7ff45a0da700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff45409e950 0x7ff4541c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.319+0000 7ff45a8db700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff454137010 0x7ff45406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.319+0000 7ff4598d9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff45409f430 0x7ff4541c8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48388/0 (socket says 172.21.15.156:48388) 2023-09-30T22:25:12.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.319+0000 7ff4598d9700 1 -- 172.21.15.156:0/2095156616 learned_addr learned my addr 172.21.15.156:0/2095156616 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:12.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.319+0000 7ff45a0da700 1 -- 172.21.15.156:0/2095156616 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff454137010 msgr2=0x7ff45406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.319+0000 7ff45a0da700 1 --2- 172.21.15.156:0/2095156616 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff454137010 0x7ff45406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.319+0000 7ff45a0da700 1 -- 172.21.15.156:0/2095156616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff45409f430 msgr2=0x7ff4541c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.319+0000 7ff45a0da700 1 --2- 172.21.15.156:0/2095156616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff45409f430 0x7ff4541c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.319+0000 7ff45a0da700 1 -- 172.21.15.156:0/2095156616 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4440094a0 con 0x7ff45409e950 2023-09-30T22:25:12.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.320+0000 7ff45a0da700 1 --2- 172.21.15.156:0/2095156616 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff45409e950 0x7ff4541c8550 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ff45000c700 tx=0x7ff45000ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:12.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.320+0000 7ff44affd700 1 -- 172.21.15.156:0/2095156616 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4500074e0 con 0x7ff45409e950 2023-09-30T22:25:12.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.320+0000 7ff44affd700 1 -- 172.21.15.156:0/2095156616 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff450007640 con 0x7ff45409e950 2023-09-30T22:25:12.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.320+0000 7ff44affd700 1 -- 172.21.15.156:0/2095156616 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450005a50 con 0x7ff45409e950 2023-09-30T22:25:12.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.320+0000 7ff45c33e700 1 -- 172.21.15.156:0/2095156616 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff454125210 con 0x7ff45409e950 2023-09-30T22:25:12.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.320+0000 7ff45c33e700 1 -- 172.21.15.156:0/2095156616 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4540721b0 con 0x7ff45409e950 2023-09-30T22:25:12.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.321+0000 7ff45c33e700 1 -- 172.21.15.156:0/2095156616 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff45409da40 con 0x7ff45409e950 2023-09-30T22:25:12.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.321+0000 7ff44affd700 1 -- 172.21.15.156:0/2095156616 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff450005bb0 con 0x7ff45409e950 2023-09-30T22:25:12.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.321+0000 7ff44affd700 1 -- 172.21.15.156:0/2095156616 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff45003ea40 con 0x7ff45409e950 2023-09-30T22:25:12.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.326+0000 7ff44affd700 1 -- 172.21.15.156:0/2095156616 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff45001b3b0 con 0x7ff45409e950 2023-09-30T22:25:12.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.450+0000 7f579a07d700 1 -- 172.21.15.156:0/2328201259 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5794130d60 con 0x7f5794131a00 2023-09-30T22:25:12.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.450+0000 7f577bfff700 1 -- 172.21.15.156:0/2328201259 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f578c011380 con 0x7f5794131a00 2023-09-30T22:25:12.450 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:12.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.453+0000 7f579a07d700 1 -- 172.21.15.156:0/2328201259 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5794131a00 msgr2=0x7f579411cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.453+0000 7f579a07d700 1 --2- 172.21.15.156:0/2328201259 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5794131a00 0x7f579411cc50 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f578c00cb90 tx=0x7f578c00cea0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.453+0000 7f579a07d700 1 -- 172.21.15.156:0/2328201259 shutdown_connections 2023-09-30T22:25:12.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.453+0000 7f579a07d700 1 --2- 172.21.15.156:0/2328201259 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5794131a00 0x7f579411cc50 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.453+0000 7f579a07d700 1 --2- 172.21.15.156:0/2328201259 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f579406a770 0x7f579411c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.453+0000 7f579a07d700 1 --2- 172.21.15.156:0/2328201259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f579409dec0 0x7f579411c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.453+0000 7f579a07d700 1 -- 172.21.15.156:0/2328201259 >> 172.21.15.156:0/2328201259 conn(0x7f5794099c40 msgr2=0x7f579412f890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:12.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.453+0000 7f579a07d700 1 -- 172.21.15.156:0/2328201259 shutdown_connections 2023-09-30T22:25:12.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.453+0000 7f579a07d700 1 -- 172.21.15.156:0/2328201259 wait complete. 2023-09-30T22:25:12.465 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:12.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.501+0000 7f0a22ee3700 1 -- 172.21.15.156:0/2014361930 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0a1c11c990 con 0x7f0a1c09c5c0 2023-09-30T22:25:12.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.501+0000 7f0a197fa700 1 -- 172.21.15.156:0/2014361930 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0a1c11c990 con 0x7f0a1c09c5c0 2023-09-30T22:25:12.501 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:12.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.503+0000 7f0a22ee3700 1 -- 172.21.15.156:0/2014361930 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a1c09c5c0 msgr2=0x7f0a1c119bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.503+0000 7f0a22ee3700 1 --2- 172.21.15.156:0/2014361930 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a1c09c5c0 0x7f0a1c119bc0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f0a080090b0 tx=0x7f0a08004750 comp rx=0 tx=0).stop 2023-09-30T22:25:12.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.504+0000 7f0a22ee3700 1 -- 172.21.15.156:0/2014361930 shutdown_connections 2023-09-30T22:25:12.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.504+0000 7f0a22ee3700 1 --2- 172.21.15.156:0/2014361930 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a1c131980 0x7f0a1c11a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.504+0000 7f0a22ee3700 1 --2- 172.21.15.156:0/2014361930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a1c09bc70 0x7f0a1c119680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.504+0000 7f0a22ee3700 1 --2- 172.21.15.156:0/2014361930 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0a1c09c5c0 0x7f0a1c119bc0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.504+0000 7f0a22ee3700 1 -- 172.21.15.156:0/2014361930 >> 172.21.15.156:0/2014361930 conn(0x7f0a1c0a2980 msgr2=0x7f0a1c12e730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:12.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.504+0000 7f0a22ee3700 1 -- 172.21.15.156:0/2014361930 shutdown_connections 2023-09-30T22:25:12.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.504+0000 7f0a22ee3700 1 -- 172.21.15.156:0/2014361930 wait complete. 2023-09-30T22:25:12.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:12.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.521+0000 7ff45c33e700 1 -- 172.21.15.156:0/2095156616 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff45404f2a0 con 0x7ff45409e950 2023-09-30T22:25:12.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.522+0000 7ff44affd700 1 -- 172.21.15.156:0/2095156616 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff450017020 con 0x7ff45409e950 2023-09-30T22:25:12.522 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:12.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.524+0000 7ff45c33e700 1 -- 172.21.15.156:0/2095156616 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff45409e950 msgr2=0x7ff4541c8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.524+0000 7ff45c33e700 1 --2- 172.21.15.156:0/2095156616 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff45409e950 0x7ff4541c8550 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ff45000c700 tx=0x7ff45000ca10 comp rx=0 tx=0).stop 2023-09-30T22:25:12.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.524+0000 7ff45c33e700 1 -- 172.21.15.156:0/2095156616 shutdown_connections 2023-09-30T22:25:12.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.524+0000 7ff45c33e700 1 --2- 172.21.15.156:0/2095156616 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff454137010 0x7ff45406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.524+0000 7ff45c33e700 1 --2- 172.21.15.156:0/2095156616 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff45409e950 0x7ff4541c8550 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.524+0000 7ff45c33e700 1 --2- 172.21.15.156:0/2095156616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff45409f430 0x7ff4541c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.524+0000 7ff45c33e700 1 -- 172.21.15.156:0/2095156616 >> 172.21.15.156:0/2095156616 conn(0x7ff4540a0f70 msgr2=0x7ff4540a1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:12.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.524+0000 7ff45c33e700 1 -- 172.21.15.156:0/2095156616 shutdown_connections 2023-09-30T22:25:12.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.524+0000 7ff45c33e700 1 -- 172.21.15.156:0/2095156616 wait complete. 2023-09-30T22:25:12.535 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:12.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.536+0000 7f7c7229f700 1 -- 172.21.15.156:0/2714185575 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7c6c11bfa0 con 0x7f7c6c09d860 2023-09-30T22:25:12.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.536+0000 7f7c68ff9700 1 -- 172.21.15.156:0/2714185575 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c5c028090 con 0x7f7c6c09d860 2023-09-30T22:25:12.536 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:12.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.538+0000 7f7c7229f700 1 -- 172.21.15.156:0/2714185575 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c6c09d860 msgr2=0x7f7c6c1c4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.538+0000 7f7c7229f700 1 --2- 172.21.15.156:0/2714185575 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c6c09d860 0x7f7c6c1c4260 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c00c740 tx=0x7f7c5c00ca50 comp rx=0 tx=0).stop 2023-09-30T22:25:12.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.538+0000 7f7c7229f700 1 -- 172.21.15.156:0/2714185575 shutdown_connections 2023-09-30T22:25:12.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.538+0000 7f7c7229f700 1 --2- 172.21.15.156:0/2714185575 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7c6c130ce0 0x7f7c6c119630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.538 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.538+0000 7f7c7229f700 1 --2- 172.21.15.156:0/2714185575 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c6c09d860 0x7f7c6c1c4260 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.538+0000 7f7c7229f700 1 --2- 172.21.15.156:0/2714185575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c6c09e170 0x7f7c6c1c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.538+0000 7f7c7229f700 1 -- 172.21.15.156:0/2714185575 >> 172.21.15.156:0/2714185575 conn(0x7f7c6c099c40 msgr2=0x7f7c6c12dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:12.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.538+0000 7f7c7229f700 1 -- 172.21.15.156:0/2714185575 shutdown_connections 2023-09-30T22:25:12.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:12.538+0000 7f7c7229f700 1 -- 172.21.15.156:0/2714185575 wait complete. 2023-09-30T22:25:12.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:13.467 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:13.516 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:13.536 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:13.551 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:13.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.612+0000 7f5ec9eb4700 1 Processor -- start 2023-09-30T22:25:13.612 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.612+0000 7f5ec9eb4700 1 -- start start 2023-09-30T22:25:13.613 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.613+0000 7f5ec9eb4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ec4133ad0 0x7f5ec4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.613+0000 7f5ec9eb4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5ec41300a0 0x7f5ec41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.613+0000 7f5ec9eb4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ec41309f0 0x7f5ec413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.613+0000 7f5ec9eb4700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ec406b2d0 con 0x7f5ec41300a0 2023-09-30T22:25:13.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.613+0000 7f5ec9eb4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec4133610 con 0x7f5ec41309f0 2023-09-30T22:25:13.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.613+0000 7f5ec9eb4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec409a500 con 0x7f5ec4133ad0 2023-09-30T22:25:13.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.613+0000 7f5ec37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ec4133ad0 0x7f5ec4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.613+0000 7f5ec37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ec4133ad0 0x7f5ec4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53356/0 (socket says 172.21.15.156:53356) 2023-09-30T22:25:13.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.613+0000 7f5ec37fe700 1 -- 172.21.15.156:0/1442923022 learned_addr learned my addr 172.21.15.156:0/1442923022 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:13.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.613+0000 7f5ec2ffd700 1 --2- 172.21.15.156:0/1442923022 >> v2:172.21.15.156:3300/0 conn(0x7f5ec41300a0 0x7f5ec41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.613+0000 7f5ec3fff700 1 --2- 172.21.15.156:0/1442923022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ec41309f0 0x7f5ec413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.614+0000 7f5ec3fff700 1 -- 172.21.15.156:0/1442923022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ec4133ad0 msgr2=0x7f5ec4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:13.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.614+0000 7f5ec3fff700 1 --2- 172.21.15.156:0/1442923022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ec4133ad0 0x7f5ec4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.614+0000 7f5ec3fff700 1 -- 172.21.15.156:0/1442923022 >> v2:172.21.15.156:3300/0 conn(0x7f5ec41300a0 msgr2=0x7f5ec41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:13.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.614+0000 7f5ec3fff700 1 --2- 172.21.15.156:0/1442923022 >> v2:172.21.15.156:3300/0 conn(0x7f5ec41300a0 0x7f5ec41304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.614+0000 7f5ec3fff700 1 -- 172.21.15.156:0/1442923022 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec41338b0 con 0x7f5ec41309f0 2023-09-30T22:25:13.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.614+0000 7f5ec3fff700 1 --2- 172.21.15.156:0/1442923022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ec41309f0 0x7f5ec413a980 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009d90 tx=0x7f5ebc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91b653326b49451b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:13.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.614+0000 7f5ec27fc700 1 -- 172.21.15.156:0/1442923022 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc00e070 con 0x7f5ec41309f0 2023-09-30T22:25:13.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.614+0000 7f5ec27fc700 1 -- 172.21.15.156:0/1442923022 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ebc00bb20 con 0x7f5ec41309f0 2023-09-30T22:25:13.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.614+0000 7f5ec27fc700 1 -- 172.21.15.156:0/1442923022 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc012430 con 0x7f5ec41309f0 2023-09-30T22:25:13.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.615+0000 7f5ec9eb4700 1 -- 172.21.15.156:0/1442923022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ec41309f0 msgr2=0x7f5ec413a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.615+0000 7f5ec9eb4700 1 --2- 172.21.15.156:0/1442923022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ec41309f0 0x7f5ec413a980 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009d90 tx=0x7f5ebc00b330 comp rx=0 tx=0).stop 2023-09-30T22:25:13.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.615+0000 7f5ec9eb4700 1 -- 172.21.15.156:0/1442923022 shutdown_connections 2023-09-30T22:25:13.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.615+0000 7f5ec9eb4700 1 --2- 172.21.15.156:0/1442923022 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ec41309f0 0x7f5ec413a980 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.615+0000 7f5ec9eb4700 1 --2- 172.21.15.156:0/1442923022 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ec4133ad0 0x7f5ec4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.615+0000 7f5ec9eb4700 1 --2- 172.21.15.156:0/1442923022 >> v2:172.21.15.156:3300/0 conn(0x7f5ec41300a0 0x7f5ec41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.615+0000 7f5ec9eb4700 1 -- 172.21.15.156:0/1442923022 >> 172.21.15.156:0/1442923022 conn(0x7f5ec4099c40 msgr2=0x7f5ec40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:13.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.615+0000 7f5ec9eb4700 1 -- 172.21.15.156:0/1442923022 shutdown_connections 2023-09-30T22:25:13.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.615+0000 7f5ec9eb4700 1 -- 172.21.15.156:0/1442923022 wait complete. 2023-09-30T22:25:13.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.616+0000 7f5ec9eb4700 1 Processor -- start 2023-09-30T22:25:13.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.617+0000 7f5ec9eb4700 1 -- start start 2023-09-30T22:25:13.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.617+0000 7f5ec9eb4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ec41300a0 0x7f5ec411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.617+0000 7f5ec9eb4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ec41309f0 0x7f5ec411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.617+0000 7f5ec9eb4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ec4133ad0 0x7f5ec411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.617+0000 7f5ec9eb4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec411f020 con 0x7f5ec41300a0 2023-09-30T22:25:13.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.617+0000 7f5ec9eb4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec412de80 con 0x7f5ec4133ad0 2023-09-30T22:25:13.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.617+0000 7f5ec9eb4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec40a33e0 con 0x7f5ec41309f0 2023-09-30T22:25:13.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.618+0000 7f5ec37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ec41300a0 0x7f5ec411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.618+0000 7f5ec2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ec41309f0 0x7f5ec411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.618+0000 7f5ec37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ec41300a0 0x7f5ec411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48412/0 (socket says 172.21.15.156:48412) 2023-09-30T22:25:13.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.618+0000 7f5ec3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ec4133ad0 0x7f5ec411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.618+0000 7f5ec37fe700 1 -- 172.21.15.156:0/3450708119 learned_addr learned my addr 172.21.15.156:0/3450708119 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:13.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.618+0000 7f5ec37fe700 1 -- 172.21.15.156:0/3450708119 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ec41309f0 msgr2=0x7f5ec411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.618+0000 7f5ec37fe700 1 --2- 172.21.15.156:0/3450708119 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ec41309f0 0x7f5ec411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.618+0000 7f5ec37fe700 1 -- 172.21.15.156:0/3450708119 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ec4133ad0 msgr2=0x7f5ec411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.618+0000 7f5ec37fe700 1 --2- 172.21.15.156:0/3450708119 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ec4133ad0 0x7f5ec411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.618+0000 7f5ec37fe700 1 -- 172.21.15.156:0/3450708119 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ebc009a70 con 0x7f5ec41300a0 2023-09-30T22:25:13.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.618+0000 7f5ec3fff700 1 --2- 172.21.15.156:0/3450708119 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ec4133ad0 0x7f5ec411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:13.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.618+0000 7f5ec37fe700 1 --2- 172.21.15.156:0/3450708119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ec41300a0 0x7f5ec411da40 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400e910 tx=0x7f5eb400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:13.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.618+0000 7f5eabfff700 1 -- 172.21.15.156:0/3450708119 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb40096a0 con 0x7f5ec41300a0 2023-09-30T22:25:13.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.618+0000 7f5eabfff700 1 -- 172.21.15.156:0/3450708119 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb4013680 con 0x7f5ec41300a0 2023-09-30T22:25:13.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.618+0000 7f5ec9eb4700 1 -- 172.21.15.156:0/3450708119 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec411fb90 con 0x7f5ec41300a0 2023-09-30T22:25:13.623 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.618+0000 7f5eabfff700 1 -- 172.21.15.156:0/3450708119 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4013a30 con 0x7f5ec41300a0 2023-09-30T22:25:13.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.618+0000 7f5ec9eb4700 1 -- 172.21.15.156:0/3450708119 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec411f410 con 0x7f5ec41300a0 2023-09-30T22:25:13.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.619+0000 7f5eabfff700 1 -- 172.21.15.156:0/3450708119 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5eb4013b90 con 0x7f5ec41300a0 2023-09-30T22:25:13.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.619+0000 7f5eabfff700 1 -- 172.21.15.156:0/3450708119 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5eb403f900 con 0x7f5ec41300a0 2023-09-30T22:25:13.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.620+0000 7f5ec9eb4700 1 -- 172.21.15.156:0/3450708119 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec404f2a0 con 0x7f5ec41300a0 2023-09-30T22:25:13.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.625+0000 7f5eabfff700 1 -- 172.21.15.156:0/3450708119 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5eb4011bd0 con 0x7f5ec41300a0 2023-09-30T22:25:13.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.669+0000 7f6aa93a9700 1 Processor -- start 2023-09-30T22:25:13.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.669+0000 7f6aa93a9700 1 -- start start 2023-09-30T22:25:13.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.670+0000 7f6aa93a9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aa4133900 0x7f6aa4133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.670+0000 7f6aa93a9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6aa4134210 0x7f6aa40a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.670+0000 7f6aa93a9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aa40a0ee0 0x7f6aa40a1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.670+0000 7f6aa93a9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa409a760 con 0x7f6aa4134210 2023-09-30T22:25:13.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.670+0000 7f6aa93a9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa41336e0 con 0x7f6aa40a0ee0 2023-09-30T22:25:13.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.670+0000 7f6aa93a9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa409a080 con 0x7f6aa4133900 2023-09-30T22:25:13.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.670+0000 7f6aa37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aa40a0ee0 0x7f6aa40a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.670+0000 7f6aa2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aa4133900 0x7f6aa4133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.670+0000 7f6aa37fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aa40a0ee0 0x7f6aa40a1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48354/0 (socket says 172.21.15.156:48354) 2023-09-30T22:25:13.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.670+0000 7f6aa37fe700 1 -- 172.21.15.156:0/2721122797 learned_addr learned my addr 172.21.15.156:0/2721122797 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:13.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.670+0000 7f6aa27fc700 1 --2- 172.21.15.156:0/2721122797 >> v2:172.21.15.156:3300/0 conn(0x7f6aa4134210 0x7f6aa40a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.670+0000 7f6aa37fe700 1 -- 172.21.15.156:0/2721122797 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aa4133900 msgr2=0x7f6aa4133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:13.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.670+0000 7f6aa37fe700 1 --2- 172.21.15.156:0/2721122797 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aa4133900 0x7f6aa4133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.670+0000 7f6aa37fe700 1 -- 172.21.15.156:0/2721122797 >> v2:172.21.15.156:3300/0 conn(0x7f6aa4134210 msgr2=0x7f6aa40a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:13.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.670+0000 7f6aa37fe700 1 --2- 172.21.15.156:0/2721122797 >> v2:172.21.15.156:3300/0 conn(0x7f6aa4134210 0x7f6aa40a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.670+0000 7f6aa37fe700 1 -- 172.21.15.156:0/2721122797 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa40a23e0 con 0x7f6aa40a0ee0 2023-09-30T22:25:13.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.671+0000 7f6aa2ffd700 1 --2- 172.21.15.156:0/2721122797 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aa4133900 0x7f6aa4133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:13.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.671+0000 7f6aa37fe700 1 --2- 172.21.15.156:0/2721122797 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aa40a0ee0 0x7f6aa40a1360 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c009e50 tx=0x7f6a9c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61e8b61562730dbe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:13.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.671+0000 7f6aa1ffb700 1 -- 172.21.15.156:0/2721122797 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c00e070 con 0x7f6aa40a0ee0 2023-09-30T22:25:13.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.671+0000 7f6aa1ffb700 1 -- 172.21.15.156:0/2721122797 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9c00b910 con 0x7f6aa40a0ee0 2023-09-30T22:25:13.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.671+0000 7f6aa1ffb700 1 -- 172.21.15.156:0/2721122797 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c00bcc0 con 0x7f6aa40a0ee0 2023-09-30T22:25:13.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.672+0000 7f6aa93a9700 1 -- 172.21.15.156:0/2721122797 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aa40a0ee0 msgr2=0x7f6aa40a1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.672+0000 7f6aa93a9700 1 --2- 172.21.15.156:0/2721122797 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aa40a0ee0 0x7f6aa40a1360 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c009e50 tx=0x7f6a9c00b330 comp rx=0 tx=0).stop 2023-09-30T22:25:13.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.672+0000 7f6aa93a9700 1 -- 172.21.15.156:0/2721122797 shutdown_connections 2023-09-30T22:25:13.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.672+0000 7f6aa93a9700 1 --2- 172.21.15.156:0/2721122797 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aa40a0ee0 0x7f6aa40a1360 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.672+0000 7f6aa93a9700 1 --2- 172.21.15.156:0/2721122797 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aa4133900 0x7f6aa4133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.672+0000 7f6aa93a9700 1 --2- 172.21.15.156:0/2721122797 >> v2:172.21.15.156:3300/0 conn(0x7f6aa4134210 0x7f6aa40a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.672+0000 7f6aa93a9700 1 -- 172.21.15.156:0/2721122797 >> 172.21.15.156:0/2721122797 conn(0x7f6aa40a2980 msgr2=0x7f6aa40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:13.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.672+0000 7f6aa93a9700 1 -- 172.21.15.156:0/2721122797 shutdown_connections 2023-09-30T22:25:13.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.672+0000 7f6aa93a9700 1 -- 172.21.15.156:0/2721122797 wait complete. 2023-09-30T22:25:13.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.673+0000 7f6aa93a9700 1 Processor -- start 2023-09-30T22:25:13.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.673+0000 7f6aa93a9700 1 -- start start 2023-09-30T22:25:13.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.673+0000 7f6aa93a9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aa40a0ee0 0x7f6aa411d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.673+0000 7f6aa93a9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aa4133900 0x7f6aa411ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.673+0000 7f6aa93a9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6aa4134210 0x7f6aa411e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.673+0000 7f6aa93a9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa411ed60 con 0x7f6aa4134210 2023-09-30T22:25:13.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.673+0000 7f6aa93a9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa4130c80 con 0x7f6aa40a0ee0 2023-09-30T22:25:13.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.673+0000 7f6aa93a9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa41206f0 con 0x7f6aa4133900 2023-09-30T22:25:13.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.674+0000 7f6aa27fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aa4133900 0x7f6aa411ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.674+0000 7f6aa27fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aa4133900 0x7f6aa411ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53382/0 (socket says 172.21.15.156:53382) 2023-09-30T22:25:13.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.674+0000 7f6aa27fc700 1 -- 172.21.15.156:0/2680541387 learned_addr learned my addr 172.21.15.156:0/2680541387 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:13.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.674+0000 7f6aa37fe700 1 --2- 172.21.15.156:0/2680541387 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6aa4134210 0x7f6aa411e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.674+0000 7f6aa2ffd700 1 --2- 172.21.15.156:0/2680541387 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aa40a0ee0 0x7f6aa411d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.674+0000 7f6aa27fc700 1 -- 172.21.15.156:0/2680541387 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aa40a0ee0 msgr2=0x7f6aa411d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.674+0000 7f6aa27fc700 1 --2- 172.21.15.156:0/2680541387 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aa40a0ee0 0x7f6aa411d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.674+0000 7f6aa27fc700 1 -- 172.21.15.156:0/2680541387 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6aa4134210 msgr2=0x7f6aa411e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.674+0000 7f6aa27fc700 1 --2- 172.21.15.156:0/2680541387 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6aa4134210 0x7f6aa411e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.674+0000 7f6aa27fc700 1 -- 172.21.15.156:0/2680541387 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a94009430 con 0x7f6aa4133900 2023-09-30T22:25:13.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.674+0000 7f6aa37fe700 1 --2- 172.21.15.156:0/2680541387 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6aa4134210 0x7f6aa411e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:13.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.674+0000 7f6aa27fc700 1 --2- 172.21.15.156:0/2680541387 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aa4133900 0x7f6aa411ddd0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6a9800e9b0 tx=0x7f6a9800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:13.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.674+0000 7f6a8b7fe700 1 -- 172.21.15.156:0/2680541387 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a98009710 con 0x7f6aa4133900 2023-09-30T22:25:13.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.675+0000 7f6a8b7fe700 1 -- 172.21.15.156:0/2680541387 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9800c850 con 0x7f6aa4133900 2023-09-30T22:25:13.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.675+0000 7f6aa93a9700 1 -- 172.21.15.156:0/2680541387 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9c009b30 con 0x7f6aa4133900 2023-09-30T22:25:13.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.675+0000 7f6a8b7fe700 1 -- 172.21.15.156:0/2680541387 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9800cbe0 con 0x7f6aa4133900 2023-09-30T22:25:13.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.675+0000 7f6aa93a9700 1 -- 172.21.15.156:0/2680541387 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa4120b40 con 0x7f6aa4133900 2023-09-30T22:25:13.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.675+0000 7f6a8b7fe700 1 -- 172.21.15.156:0/2680541387 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a9800cd40 con 0x7f6aa4133900 2023-09-30T22:25:13.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.676+0000 7f6a8b7fe700 1 -- 172.21.15.156:0/2680541387 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6a9803f830 con 0x7f6aa4133900 2023-09-30T22:25:13.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.676+0000 7f6aa93a9700 1 -- 172.21.15.156:0/2680541387 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aa40a30b0 con 0x7f6aa4133900 2023-09-30T22:25:13.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.681+0000 7f6a8b7fe700 1 -- 172.21.15.156:0/2680541387 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a98021080 con 0x7f6aa4133900 2023-09-30T22:25:13.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.698+0000 7fdea5cdc700 1 Processor -- start 2023-09-30T22:25:13.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.698+0000 7fdea5cdc700 1 -- start start 2023-09-30T22:25:13.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.699+0000 7fdea5cdc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdea006a770 0x7fdea01349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.699+0000 7fdea5cdc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdea0134f00 0x7fdea009d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.699+0000 7fdea5cdc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdea009dea0 0x7fdea009e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.699+0000 7fdea5cdc700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea006b2e0 con 0x7fdea009dea0 2023-09-30T22:25:13.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.699+0000 7fdea5cdc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea009eca0 con 0x7fdea0134f00 2023-09-30T22:25:13.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.699+0000 7fdea5cdc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdea009f720 con 0x7fdea006a770 2023-09-30T22:25:13.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.699+0000 7fde9ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdea009dea0 0x7fdea009e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.699+0000 7fde9effd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdea0134f00 0x7fdea009d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.699+0000 7fde9f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdea006a770 0x7fdea01349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.699+0000 7fde9ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdea009dea0 0x7fdea009e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48438/0 (socket says 172.21.15.156:48438) 2023-09-30T22:25:13.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.699+0000 7fde9ffff700 1 -- 172.21.15.156:0/2816975833 learned_addr learned my addr 172.21.15.156:0/2816975833 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:13.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.699+0000 7fde9effd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdea0134f00 0x7fdea009d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48376/0 (socket says 172.21.15.156:48376) 2023-09-30T22:25:13.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.699+0000 7fde9f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdea006a770 0x7fdea01349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53392/0 (socket says 172.21.15.156:53392) 2023-09-30T22:25:13.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.699+0000 7fde9f7fe700 1 -- 172.21.15.156:0/2816975833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdea0134f00 msgr2=0x7fdea009d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:13.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.699+0000 7fde9f7fe700 1 --2- 172.21.15.156:0/2816975833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdea0134f00 0x7fdea009d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.699+0000 7fde9f7fe700 1 -- 172.21.15.156:0/2816975833 >> v2:172.21.15.156:3300/0 conn(0x7fdea009dea0 msgr2=0x7fdea009e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:13.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.699+0000 7fde9f7fe700 1 --2- 172.21.15.156:0/2816975833 >> v2:172.21.15.156:3300/0 conn(0x7fdea009dea0 0x7fdea009e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.699+0000 7fde9f7fe700 1 -- 172.21.15.156:0/2816975833 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea006b480 con 0x7fdea006a770 2023-09-30T22:25:13.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.700+0000 7fde9ffff700 1 --2- 172.21.15.156:0/2816975833 >> v2:172.21.15.156:3300/0 conn(0x7fdea009dea0 0x7fdea009e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:13.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.700+0000 7fde9f7fe700 1 --2- 172.21.15.156:0/2816975833 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdea006a770 0x7fdea01349c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fde90009840 tx=0x7fde90009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b2afc31397b4cdd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:13.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.700+0000 7fde9e7fc700 1 -- 172.21.15.156:0/2816975833 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde90011830 con 0x7fdea006a770 2023-09-30T22:25:13.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.700+0000 7fde9e7fc700 1 -- 172.21.15.156:0/2816975833 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde90011990 con 0x7fdea006a770 2023-09-30T22:25:13.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.700+0000 7fde9e7fc700 1 -- 172.21.15.156:0/2816975833 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde90011d20 con 0x7fdea006a770 2023-09-30T22:25:13.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.700+0000 7fdea5cdc700 1 -- 172.21.15.156:0/2816975833 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdea006a770 msgr2=0x7fdea01349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.700+0000 7fdea5cdc700 1 --2- 172.21.15.156:0/2816975833 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdea006a770 0x7fdea01349c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fde90009840 tx=0x7fde90009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:13.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.701+0000 7fdea5cdc700 1 -- 172.21.15.156:0/2816975833 shutdown_connections 2023-09-30T22:25:13.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.701+0000 7fdea5cdc700 1 --2- 172.21.15.156:0/2816975833 >> v2:172.21.15.156:3300/0 conn(0x7fdea009dea0 0x7fdea009e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.701+0000 7fdea5cdc700 1 --2- 172.21.15.156:0/2816975833 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdea006a770 0x7fdea01349c0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.701+0000 7fdea5cdc700 1 --2- 172.21.15.156:0/2816975833 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdea0134f00 0x7fdea009d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.701+0000 7fdea5cdc700 1 -- 172.21.15.156:0/2816975833 >> 172.21.15.156:0/2816975833 conn(0x7fdea0099c40 msgr2=0x7fdea00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:13.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.701+0000 7fdea5cdc700 1 -- 172.21.15.156:0/2816975833 shutdown_connections 2023-09-30T22:25:13.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.701+0000 7fdea5cdc700 1 -- 172.21.15.156:0/2816975833 wait complete. 2023-09-30T22:25:13.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.702+0000 7fdea5cdc700 1 Processor -- start 2023-09-30T22:25:13.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.702+0000 7fdea5cdc700 1 -- start start 2023-09-30T22:25:13.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.703+0000 7fdea5cdc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdea006a770 0x7fdea011aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.703+0000 7fdea5cdc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdea009dea0 0x7fdea011b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.703+0000 7fdea5cdc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdea0134f00 0x7fdea011b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.703+0000 7fdea5cdc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea011cc40 con 0x7fdea009dea0 2023-09-30T22:25:13.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.703+0000 7fdea5cdc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea011c7e0 con 0x7fdea006a770 2023-09-30T22:25:13.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.703+0000 7fdea5cdc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdea011c4c0 con 0x7fdea0134f00 2023-09-30T22:25:13.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.703+0000 7fde9f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdea006a770 0x7fdea011aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.703+0000 7fde9ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdea0134f00 0x7fdea011b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.703+0000 7fde9f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdea006a770 0x7fdea011aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48378/0 (socket says 172.21.15.156:48378) 2023-09-30T22:25:13.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.703+0000 7fde9f7fe700 1 -- 172.21.15.156:0/3908209711 learned_addr learned my addr 172.21.15.156:0/3908209711 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:13.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.703+0000 7fde9effd700 1 --2- 172.21.15.156:0/3908209711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdea009dea0 0x7fdea011b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.703+0000 7fde9f7fe700 1 -- 172.21.15.156:0/3908209711 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdea0134f00 msgr2=0x7fdea011b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.703+0000 7fde9f7fe700 1 --2- 172.21.15.156:0/3908209711 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdea0134f00 0x7fdea011b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.703+0000 7fde9f7fe700 1 -- 172.21.15.156:0/3908209711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdea009dea0 msgr2=0x7fdea011b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.703+0000 7fde9f7fe700 1 --2- 172.21.15.156:0/3908209711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdea009dea0 0x7fdea011b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.703+0000 7fde9f7fe700 1 -- 172.21.15.156:0/3908209711 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde98009b30 con 0x7fdea006a770 2023-09-30T22:25:13.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.704+0000 7fde9f7fe700 1 --2- 172.21.15.156:0/3908209711 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdea006a770 0x7fdea011aac0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fde900090b0 tx=0x7fde90004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:13.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.704+0000 7fde87fff700 1 -- 172.21.15.156:0/3908209711 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde90004450 con 0x7fdea006a770 2023-09-30T22:25:13.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.704+0000 7fde87fff700 1 -- 172.21.15.156:0/3908209711 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9001e070 con 0x7fdea006a770 2023-09-30T22:25:13.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.704+0000 7fde87fff700 1 -- 172.21.15.156:0/3908209711 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde900038e0 con 0x7fdea006a770 2023-09-30T22:25:13.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.704+0000 7fdea5cdc700 1 -- 172.21.15.156:0/3908209711 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde900094a0 con 0x7fdea006a770 2023-09-30T22:25:13.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.704+0000 7fdea5cdc700 1 -- 172.21.15.156:0/3908209711 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea00a10a0 con 0x7fdea006a770 2023-09-30T22:25:13.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.705+0000 7fdea5cdc700 1 -- 172.21.15.156:0/3908209711 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea004f2a0 con 0x7fdea006a770 2023-09-30T22:25:13.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.705+0000 7fde87fff700 1 -- 172.21.15.156:0/3908209711 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fde90003a40 con 0x7fdea006a770 2023-09-30T22:25:13.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.706+0000 7fde87fff700 1 -- 172.21.15.156:0/3908209711 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fde90020070 con 0x7fdea006a770 2023-09-30T22:25:13.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.710+0000 7fde87fff700 1 -- 172.21.15.156:0/3908209711 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fde90010970 con 0x7fdea006a770 2023-09-30T22:25:13.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.723+0000 7f9f300fc700 1 Processor -- start 2023-09-30T22:25:13.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.724+0000 7f9f300fc700 1 -- start start 2023-09-30T22:25:13.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.724+0000 7f9f300fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f28133ad0 0x7f9f28133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.724+0000 7f9f300fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f281300a0 0x7f9f281304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.724+0000 7f9f300fc700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f2806b2d0 con 0x7f9f281309f0 2023-09-30T22:25:13.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.724+0000 7f9f300fc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f28133610 con 0x7f9f281300a0 2023-09-30T22:25:13.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.724+0000 7f9f300fc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2809a500 con 0x7f9f28133ad0 2023-09-30T22:25:13.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.725+0000 7f9f2de98700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f28133ad0 0x7f9f28133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.725+0000 7f9f2e699700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f9f281309f0 0x7f9f2813a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:41616/0 (socket says 172.21.15.156:41616) 2023-09-30T22:25:13.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.725+0000 7f9f2e699700 1 -- 172.21.15.156:0/1608541122 learned_addr learned my addr 172.21.15.156:0/1608541122 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:13.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.725+0000 7f9f2d697700 1 --2- 172.21.15.156:0/1608541122 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f281300a0 0x7f9f281304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.725+0000 7f9f2ce96700 1 -- 172.21.15.156:0/1608541122 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801890537 0 0) 0x7f9f2806b2d0 con 0x7f9f281309f0 2023-09-30T22:25:13.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.725+0000 7f9f2ce96700 1 -- 172.21.15.156:0/1608541122 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f140035b0 con 0x7f9f281309f0 2023-09-30T22:25:13.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.725+0000 7f9f2de98700 1 -- 172.21.15.156:0/1608541122 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f281300a0 msgr2=0x7f9f281304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:13.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.725+0000 7f9f2de98700 1 --2- 172.21.15.156:0/1608541122 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f281300a0 0x7f9f281304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.725+0000 7f9f2de98700 1 -- 172.21.15.156:0/1608541122 >> v1:172.21.15.156:6789/0 conn(0x7f9f281309f0 legacy=0x7f9f2813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.725+0000 7f9f2de98700 1 -- 172.21.15.156:0/1608541122 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f281338b0 con 0x7f9f28133ad0 2023-09-30T22:25:13.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.725+0000 7f9f2d697700 1 --2- 172.21.15.156:0/1608541122 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f281300a0 0x7f9f281304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:13.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.725+0000 7f9f2de98700 1 --2- 172.21.15.156:0/1608541122 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f28133ad0 0x7f9f28133ea0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f9f24013180 tx=0x7f9f24013490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccf9e4af20450a54 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:13.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.725+0000 7f9f2ce96700 1 -- 172.21.15.156:0/1608541122 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f24016070 con 0x7f9f28133ad0 2023-09-30T22:25:13.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.726+0000 7f9f2ce96700 1 -- 172.21.15.156:0/1608541122 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f24013d00 con 0x7f9f28133ad0 2023-09-30T22:25:13.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.726+0000 7f9f2ce96700 1 -- 172.21.15.156:0/1608541122 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f24004250 con 0x7f9f28133ad0 2023-09-30T22:25:13.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.726+0000 7f9f300fc700 1 -- 172.21.15.156:0/1608541122 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f28133ad0 msgr2=0x7f9f28133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.726+0000 7f9f300fc700 1 --2- 172.21.15.156:0/1608541122 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f28133ad0 0x7f9f28133ea0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f9f24013180 tx=0x7f9f24013490 comp rx=0 tx=0).stop 2023-09-30T22:25:13.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.726+0000 7f9f300fc700 1 -- 172.21.15.156:0/1608541122 shutdown_connections 2023-09-30T22:25:13.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.726+0000 7f9f300fc700 1 --2- 172.21.15.156:0/1608541122 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f28133ad0 0x7f9f28133ea0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.726+0000 7f9f300fc700 1 --2- 172.21.15.156:0/1608541122 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f281300a0 0x7f9f281304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.726+0000 7f9f300fc700 1 -- 172.21.15.156:0/1608541122 >> 172.21.15.156:0/1608541122 conn(0x7f9f28099c40 msgr2=0x7f9f280a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:13.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.726+0000 7f9f300fc700 1 -- 172.21.15.156:0/1608541122 shutdown_connections 2023-09-30T22:25:13.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.726+0000 7f9f300fc700 1 -- 172.21.15.156:0/1608541122 wait complete. 2023-09-30T22:25:13.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.728+0000 7f9f300fc700 1 Processor -- start 2023-09-30T22:25:13.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.728+0000 7f9f300fc700 1 -- start start 2023-09-30T22:25:13.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.728+0000 7f9f300fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f281300a0 0x7f9f28071330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.728+0000 7f9f300fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f281309f0 0x7f9f28071870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.728+0000 7f9f300fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f28133ad0 0x7f9f28071db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.728+0000 7f9f300fc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2811bb40 con 0x7f9f281309f0 2023-09-30T22:25:13.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.728+0000 7f9f300fc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2811b2d0 con 0x7f9f281300a0 2023-09-30T22:25:13.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.728+0000 7f9f300fc700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2812dd00 con 0x7f9f28133ad0 2023-09-30T22:25:13.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.728+0000 7f9f2d697700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f281309f0 0x7f9f28071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.728+0000 7f9f2d697700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f281309f0 0x7f9f28071870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48454/0 (socket says 172.21.15.156:48454) 2023-09-30T22:25:13.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.728+0000 7f9f2d697700 1 -- 172.21.15.156:0/3094763826 learned_addr learned my addr 172.21.15.156:0/3094763826 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:13.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.728+0000 7f9f2de98700 1 --2- 172.21.15.156:0/3094763826 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f281300a0 0x7f9f28071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.728+0000 7f9f2e699700 1 --2- 172.21.15.156:0/3094763826 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f28133ad0 0x7f9f28071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.729+0000 7f9f2de98700 1 -- 172.21.15.156:0/3094763826 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f28133ad0 msgr2=0x7f9f28071db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.729+0000 7f9f2de98700 1 --2- 172.21.15.156:0/3094763826 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f28133ad0 0x7f9f28071db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.729+0000 7f9f2de98700 1 -- 172.21.15.156:0/3094763826 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f281309f0 msgr2=0x7f9f28071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.729+0000 7f9f2de98700 1 --2- 172.21.15.156:0/3094763826 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f281309f0 0x7f9f28071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.729+0000 7f9f2de98700 1 -- 172.21.15.156:0/3094763826 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f180094a0 con 0x7f9f281300a0 2023-09-30T22:25:13.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.729+0000 7f9f2d697700 1 --2- 172.21.15.156:0/3094763826 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f281309f0 0x7f9f28071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:13.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.729+0000 7f9f2de98700 1 --2- 172.21.15.156:0/3094763826 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f281300a0 0x7f9f28071330 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9f2401c000 tx=0x7f9f24004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:13.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.729+0000 7f9f1e7fc700 1 -- 172.21.15.156:0/3094763826 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2400f640 con 0x7f9f281300a0 2023-09-30T22:25:13.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.729+0000 7f9f1e7fc700 1 -- 172.21.15.156:0/3094763826 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f240110d0 con 0x7f9f281300a0 2023-09-30T22:25:13.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.729+0000 7f9f300fc700 1 -- 172.21.15.156:0/3094763826 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f24011d40 con 0x7f9f281300a0 2023-09-30T22:25:13.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.729+0000 7f9f1e7fc700 1 -- 172.21.15.156:0/3094763826 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f24011480 con 0x7f9f281300a0 2023-09-30T22:25:13.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.729+0000 7f9f300fc700 1 -- 172.21.15.156:0/3094763826 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f28119c30 con 0x7f9f281300a0 2023-09-30T22:25:13.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.730+0000 7f9f1e7fc700 1 -- 172.21.15.156:0/3094763826 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f24021070 con 0x7f9f281300a0 2023-09-30T22:25:13.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.730+0000 7f9f1e7fc700 1 -- 172.21.15.156:0/3094763826 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9f240513c0 con 0x7f9f281300a0 2023-09-30T22:25:13.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.731+0000 7f9f300fc700 1 -- 172.21.15.156:0/3094763826 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f2809cb20 con 0x7f9f281300a0 2023-09-30T22:25:13.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.735+0000 7f9f1e7fc700 1 -- 172.21.15.156:0/3094763826 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f240197a0 con 0x7f9f281300a0 2023-09-30T22:25:13.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.850+0000 7f5ec9eb4700 1 -- 172.21.15.156:0/3450708119 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5ec411fdb0 con 0x7f5ec41300a0 2023-09-30T22:25:13.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.850+0000 7f5eabfff700 1 -- 172.21.15.156:0/3450708119 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ec411fdb0 con 0x7f5ec41300a0 2023-09-30T22:25:13.850 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:13.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.852+0000 7f5ec9eb4700 1 -- 172.21.15.156:0/3450708119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ec41300a0 msgr2=0x7f5ec411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.852+0000 7f5ec9eb4700 1 --2- 172.21.15.156:0/3450708119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ec41300a0 0x7f5ec411da40 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400e910 tx=0x7f5eb400ec20 comp rx=0 tx=0).stop 2023-09-30T22:25:13.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.852+0000 7f5ec9eb4700 1 -- 172.21.15.156:0/3450708119 shutdown_connections 2023-09-30T22:25:13.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.852+0000 7f5ec9eb4700 1 --2- 172.21.15.156:0/3450708119 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5ec4133ad0 0x7f5ec411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.852+0000 7f5ec9eb4700 1 --2- 172.21.15.156:0/3450708119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ec41300a0 0x7f5ec411da40 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.852+0000 7f5ec9eb4700 1 --2- 172.21.15.156:0/3450708119 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5ec41309f0 0x7f5ec411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.852+0000 7f5ec9eb4700 1 -- 172.21.15.156:0/3450708119 >> 172.21.15.156:0/3450708119 conn(0x7f5ec4099c40 msgr2=0x7f5ec4132b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:13.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.852+0000 7f5ec9eb4700 1 -- 172.21.15.156:0/3450708119 shutdown_connections 2023-09-30T22:25:13.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.852+0000 7f5ec9eb4700 1 -- 172.21.15.156:0/3450708119 wait complete. 2023-09-30T22:25:13.864 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:13.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.879+0000 7f6aa93a9700 1 -- 172.21.15.156:0/2680541387 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6aa411a590 con 0x7f6aa4133900 2023-09-30T22:25:13.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.879+0000 7f6a8b7fe700 1 -- 172.21.15.156:0/2680541387 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6a9801be10 con 0x7f6aa4133900 2023-09-30T22:25:13.879 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:13.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.881+0000 7f6aa93a9700 1 -- 172.21.15.156:0/2680541387 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aa4133900 msgr2=0x7f6aa411ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.881+0000 7f6aa93a9700 1 --2- 172.21.15.156:0/2680541387 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aa4133900 0x7f6aa411ddd0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6a9800e9b0 tx=0x7f6a9800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.881+0000 7f6aa93a9700 1 -- 172.21.15.156:0/2680541387 shutdown_connections 2023-09-30T22:25:13.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.881+0000 7f6aa93a9700 1 --2- 172.21.15.156:0/2680541387 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6aa4134210 0x7f6aa411e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.881+0000 7f6aa93a9700 1 --2- 172.21.15.156:0/2680541387 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aa40a0ee0 0x7f6aa411d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.881+0000 7f6aa93a9700 1 --2- 172.21.15.156:0/2680541387 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aa4133900 0x7f6aa411ddd0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.881+0000 7f6aa93a9700 1 -- 172.21.15.156:0/2680541387 >> 172.21.15.156:0/2680541387 conn(0x7f6aa40a2980 msgr2=0x7f6aa41bade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:13.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.881+0000 7f6aa93a9700 1 -- 172.21.15.156:0/2680541387 shutdown_connections 2023-09-30T22:25:13.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.881+0000 7f6aa93a9700 1 -- 172.21.15.156:0/2680541387 wait complete. 2023-09-30T22:25:13.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:13.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.911+0000 7fdea5cdc700 1 -- 172.21.15.156:0/3908209711 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdea0138be0 con 0x7fdea006a770 2023-09-30T22:25:13.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.911+0000 7fde87fff700 1 -- 172.21.15.156:0/3908209711 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fde9002a070 con 0x7fdea006a770 2023-09-30T22:25:13.911 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:13.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.913+0000 7fdea5cdc700 1 -- 172.21.15.156:0/3908209711 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdea006a770 msgr2=0x7fdea011aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.913+0000 7fdea5cdc700 1 --2- 172.21.15.156:0/3908209711 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdea006a770 0x7fdea011aac0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fde900090b0 tx=0x7fde90004750 comp rx=0 tx=0).stop 2023-09-30T22:25:13.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.913+0000 7fdea5cdc700 1 -- 172.21.15.156:0/3908209711 shutdown_connections 2023-09-30T22:25:13.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.913+0000 7fdea5cdc700 1 --2- 172.21.15.156:0/3908209711 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdea0134f00 0x7fdea011b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.913+0000 7fdea5cdc700 1 --2- 172.21.15.156:0/3908209711 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdea006a770 0x7fdea011aac0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.913+0000 7fdea5cdc700 1 --2- 172.21.15.156:0/3908209711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdea009dea0 0x7fdea011b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.913+0000 7fdea5cdc700 1 -- 172.21.15.156:0/3908209711 >> 172.21.15.156:0/3908209711 conn(0x7fdea0099c40 msgr2=0x7fdea009c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:13.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.914+0000 7fdea5cdc700 1 -- 172.21.15.156:0/3908209711 shutdown_connections 2023-09-30T22:25:13.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.914+0000 7fdea5cdc700 1 -- 172.21.15.156:0/3908209711 wait complete. 2023-09-30T22:25:13.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:13.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.945+0000 7f9f300fc700 1 -- 172.21.15.156:0/3094763826 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9f2811b500 con 0x7f9f281300a0 2023-09-30T22:25:13.945 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.946+0000 7f9f1e7fc700 1 -- 172.21.15.156:0/3094763826 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f2401f020 con 0x7f9f281300a0 2023-09-30T22:25:13.945 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:13.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.948+0000 7f9f300fc700 1 -- 172.21.15.156:0/3094763826 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f281300a0 msgr2=0x7f9f28071330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.948+0000 7f9f300fc700 1 --2- 172.21.15.156:0/3094763826 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f281300a0 0x7f9f28071330 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9f2401c000 tx=0x7f9f24004750 comp rx=0 tx=0).stop 2023-09-30T22:25:13.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.948+0000 7f9f300fc700 1 -- 172.21.15.156:0/3094763826 shutdown_connections 2023-09-30T22:25:13.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.948+0000 7f9f300fc700 1 --2- 172.21.15.156:0/3094763826 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9f28133ad0 0x7f9f28071db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.948+0000 7f9f300fc700 1 --2- 172.21.15.156:0/3094763826 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9f281300a0 0x7f9f28071330 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.948+0000 7f9f300fc700 1 --2- 172.21.15.156:0/3094763826 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f281309f0 0x7f9f28071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.948+0000 7f9f300fc700 1 -- 172.21.15.156:0/3094763826 >> 172.21.15.156:0/3094763826 conn(0x7f9f28099c40 msgr2=0x7f9f2812f290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:13.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.948+0000 7f9f300fc700 1 -- 172.21.15.156:0/3094763826 shutdown_connections 2023-09-30T22:25:13.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:13.948+0000 7f9f300fc700 1 -- 172.21.15.156:0/3094763826 wait complete. 2023-09-30T22:25:13.959 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:14.865 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:14.894 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:14.926 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:14.960 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:15.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.006+0000 7ff16fb16700 1 Processor -- start 2023-09-30T22:25:15.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.006+0000 7ff16fb16700 1 -- start start 2023-09-30T22:25:15.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.007+0000 7ff16fb16700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff1680a0a30 0x7ff1680a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.007+0000 7ff16fb16700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff168130670 0x7ff1681381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.007+0000 7ff16fb16700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1680a1e70 con 0x7ff1680a1340 2023-09-30T22:25:15.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.007+0000 7ff16fb16700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff16809a720 con 0x7ff1680a0a30 2023-09-30T22:25:15.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.007+0000 7ff16fb16700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff16809b300 con 0x7ff168130670 2023-09-30T22:25:15.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.007+0000 7ff16d8b2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff1680a0a30 0x7ff1680a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.007+0000 7ff16d8b2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff1680a0a30 0x7ff1680a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48462/0 (socket says 172.21.15.156:48462) 2023-09-30T22:25:15.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.007+0000 7ff16d8b2700 1 -- 172.21.15.156:0/1874125976 learned_addr learned my addr 172.21.15.156:0/1874125976 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:15.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.007+0000 7ff16e0b3700 1 --2- 172.21.15.156:0/1874125976 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff168130670 0x7ff1681381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.007+0000 7ff16d8b2700 1 -- 172.21.15.156:0/1874125976 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff168130670 msgr2=0x7ff1681381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:15.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.007+0000 7ff16d8b2700 1 --2- 172.21.15.156:0/1874125976 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff168130670 0x7ff1681381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.007+0000 7ff16d8b2700 1 -- 172.21.15.156:0/1874125976 >> v1:172.21.15.156:6789/0 conn(0x7ff1680a1340 legacy=0x7ff16812ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.007+0000 7ff16d8b2700 1 -- 172.21.15.156:0/1874125976 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16809abc0 con 0x7ff1680a0a30 2023-09-30T22:25:15.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.007+0000 7ff16e0b3700 1 --2- 172.21.15.156:0/1874125976 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff168130670 0x7ff1681381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:15.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.008+0000 7ff16d8b2700 1 --2- 172.21.15.156:0/1874125976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1680a0a30 0x7ff1680a0e00 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7ff164006fd0 tx=0x7ff16400ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6600bedb5de2ed2d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:15.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.008+0000 7ff16c8b0700 1 -- 172.21.15.156:0/1874125976 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff164005e30 con 0x7ff1680a0a30 2023-09-30T22:25:15.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.008+0000 7ff16c8b0700 1 -- 172.21.15.156:0/1874125976 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff164004030 con 0x7ff1680a0a30 2023-09-30T22:25:15.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.008+0000 7ff16c8b0700 1 -- 172.21.15.156:0/1874125976 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1640043e0 con 0x7ff1680a0a30 2023-09-30T22:25:15.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.009+0000 7ff16fb16700 1 -- 172.21.15.156:0/1874125976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1680a0a30 msgr2=0x7ff1680a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.009+0000 7ff16fb16700 1 --2- 172.21.15.156:0/1874125976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1680a0a30 0x7ff1680a0e00 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7ff164006fd0 tx=0x7ff16400ad70 comp rx=0 tx=0).stop 2023-09-30T22:25:15.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.009+0000 7ff16fb16700 1 -- 172.21.15.156:0/1874125976 shutdown_connections 2023-09-30T22:25:15.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.009+0000 7ff16fb16700 1 --2- 172.21.15.156:0/1874125976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1680a0a30 0x7ff1680a0e00 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.009+0000 7ff16fb16700 1 --2- 172.21.15.156:0/1874125976 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff168130670 0x7ff1681381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.009+0000 7ff16fb16700 1 -- 172.21.15.156:0/1874125976 >> 172.21.15.156:0/1874125976 conn(0x7ff1680a2980 msgr2=0x7ff1680a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:15.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.009+0000 7ff16fb16700 1 -- 172.21.15.156:0/1874125976 shutdown_connections 2023-09-30T22:25:15.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.009+0000 7ff16fb16700 1 -- 172.21.15.156:0/1874125976 wait complete. 2023-09-30T22:25:15.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.010+0000 7ff16fb16700 1 Processor -- start 2023-09-30T22:25:15.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.010+0000 7ff16fb16700 1 -- start start 2023-09-30T22:25:15.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.010+0000 7ff16fb16700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff1680a0a30 0x7ff1681c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.010+0000 7ff16fb16700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1680a1340 0x7ff1681c6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.010+0000 7ff16fb16700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff168130670 0x7ff1681c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.010+0000 7ff16fb16700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16811bcb0 con 0x7ff168130670 2023-09-30T22:25:15.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.010+0000 7ff16fb16700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16811bac0 con 0x7ff1680a1340 2023-09-30T22:25:15.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.010+0000 7ff16fb16700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff16811d9d0 con 0x7ff1680a0a30 2023-09-30T22:25:15.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.011+0000 7ff16d0b1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1680a1340 0x7ff1681c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.011+0000 7ff16d0b1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1680a1340 0x7ff1681c6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48406/0 (socket says 172.21.15.156:48406) 2023-09-30T22:25:15.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.011+0000 7ff16d0b1700 1 -- 172.21.15.156:0/1326935668 learned_addr learned my addr 172.21.15.156:0/1326935668 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:15.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.011+0000 7ff16d8b2700 1 --2- 172.21.15.156:0/1326935668 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff1680a0a30 0x7ff1681c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.011+0000 7ff16e0b3700 1 --2- 172.21.15.156:0/1326935668 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff168130670 0x7ff1681c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.011+0000 7ff16d0b1700 1 -- 172.21.15.156:0/1326935668 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff1680a0a30 msgr2=0x7ff1681c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.011+0000 7ff16d0b1700 1 --2- 172.21.15.156:0/1326935668 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff1680a0a30 0x7ff1681c6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.011+0000 7ff16d0b1700 1 -- 172.21.15.156:0/1326935668 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff168130670 msgr2=0x7ff1681c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.011+0000 7ff16d0b1700 1 --2- 172.21.15.156:0/1326935668 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff168130670 0x7ff1681c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.011+0000 7ff16d0b1700 1 -- 172.21.15.156:0/1326935668 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16400a6a0 con 0x7ff1680a1340 2023-09-30T22:25:15.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.011+0000 7ff16e0b3700 1 --2- 172.21.15.156:0/1326935668 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff168130670 0x7ff1681c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:15.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.011+0000 7ff16d0b1700 1 --2- 172.21.15.156:0/1326935668 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1680a1340 0x7ff1681c6590 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ff15800c4e0 tx=0x7ff15800c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:15.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.011+0000 7ff15e7fc700 1 -- 172.21.15.156:0/1326935668 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1580052d0 con 0x7ff1680a1340 2023-09-30T22:25:15.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.011+0000 7ff15e7fc700 1 -- 172.21.15.156:0/1326935668 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff158005430 con 0x7ff1680a1340 2023-09-30T22:25:15.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.011+0000 7ff16fb16700 1 -- 172.21.15.156:0/1326935668 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff16809fd60 con 0x7ff1680a1340 2023-09-30T22:25:15.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.012+0000 7ff16fb16700 1 -- 172.21.15.156:0/1326935668 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff16811c2b0 con 0x7ff1680a1340 2023-09-30T22:25:15.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.012+0000 7ff15e7fc700 1 -- 172.21.15.156:0/1326935668 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1580038c0 con 0x7ff1680a1340 2023-09-30T22:25:15.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.012+0000 7ff15e7fc700 1 -- 172.21.15.156:0/1326935668 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff158003a20 con 0x7ff1680a1340 2023-09-30T22:25:15.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.013+0000 7ff15e7fc700 1 -- 172.21.15.156:0/1326935668 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff15803eb30 con 0x7ff1680a1340 2023-09-30T22:25:15.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.013+0000 7ff16fb16700 1 -- 172.21.15.156:0/1326935668 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1500052e0 con 0x7ff1680a1340 2023-09-30T22:25:15.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.018+0000 7ff15e7fc700 1 -- 172.21.15.156:0/1326935668 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff158018260 con 0x7ff1680a1340 2023-09-30T22:25:15.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.047+0000 7f5bceb03700 1 Processor -- start 2023-09-30T22:25:15.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.047+0000 7f5bceb03700 1 -- start start 2023-09-30T22:25:15.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.048+0000 7f5bceb03700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5bc806b250 0x7f5bc8136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.048+0000 7f5bceb03700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5bc8137140 0x7f5bc8139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.048+0000 7f5bceb03700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bc809da80 con 0x7f5bc806a770 2023-09-30T22:25:15.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.048+0000 7f5bceb03700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc809f770 con 0x7f5bc806b250 2023-09-30T22:25:15.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.048+0000 7f5bceb03700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc809dce0 con 0x7f5bc8137140 2023-09-30T22:25:15.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.048+0000 7f5bcc89f700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f5bc806a770 0x7f5bc806ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:41638/0 (socket says 172.21.15.156:41638) 2023-09-30T22:25:15.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.048+0000 7f5bcd0a0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5bc8137140 0x7f5bc8139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.048+0000 7f5bcc89f700 1 -- 172.21.15.156:0/2206863283 learned_addr learned my addr 172.21.15.156:0/2206863283 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:15.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.048+0000 7f5bc7fff700 1 --2- 172.21.15.156:0/2206863283 >> v2:172.21.15.156:3300/0 conn(0x7f5bc806b250 0x7f5bc8136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.048+0000 7f5bcd0a0700 1 -- 172.21.15.156:0/2206863283 >> v2:172.21.15.156:3300/0 conn(0x7f5bc806b250 msgr2=0x7f5bc8136c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:15.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.048+0000 7f5bcd0a0700 1 --2- 172.21.15.156:0/2206863283 >> v2:172.21.15.156:3300/0 conn(0x7f5bc806b250 0x7f5bc8136c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.048+0000 7f5bcd0a0700 1 -- 172.21.15.156:0/2206863283 >> v1:172.21.15.156:6789/0 conn(0x7f5bc806a770 legacy=0x7f5bc806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.048+0000 7f5bcd0a0700 1 -- 172.21.15.156:0/2206863283 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc809eb20 con 0x7f5bc8137140 2023-09-30T22:25:15.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.049+0000 7f5bcd0a0700 1 --2- 172.21.15.156:0/2206863283 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5bc8137140 0x7f5bc8139520 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0009d90 tx=0x7f5bc000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0d6b28d5b7075ed server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:15.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.049+0000 7f5bc77fe700 1 -- 172.21.15.156:0/2206863283 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc000e070 con 0x7f5bc8137140 2023-09-30T22:25:15.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.049+0000 7f5bc77fe700 1 -- 172.21.15.156:0/2206863283 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc000bb20 con 0x7f5bc8137140 2023-09-30T22:25:15.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.049+0000 7f5bc77fe700 1 -- 172.21.15.156:0/2206863283 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0012430 con 0x7f5bc8137140 2023-09-30T22:25:15.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.049+0000 7f5bceb03700 1 -- 172.21.15.156:0/2206863283 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5bc8137140 msgr2=0x7f5bc8139520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.049+0000 7f5bceb03700 1 --2- 172.21.15.156:0/2206863283 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5bc8137140 0x7f5bc8139520 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0009d90 tx=0x7f5bc000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:15.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.050+0000 7f5bceb03700 1 -- 172.21.15.156:0/2206863283 shutdown_connections 2023-09-30T22:25:15.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.050+0000 7f5bceb03700 1 --2- 172.21.15.156:0/2206863283 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5bc8137140 0x7f5bc8139520 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.050+0000 7f5bceb03700 1 --2- 172.21.15.156:0/2206863283 >> v2:172.21.15.156:3300/0 conn(0x7f5bc806b250 0x7f5bc8136c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.050+0000 7f5bceb03700 1 -- 172.21.15.156:0/2206863283 >> 172.21.15.156:0/2206863283 conn(0x7f5bc8099c40 msgr2=0x7f5bc80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:15.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.050+0000 7f5bceb03700 1 -- 172.21.15.156:0/2206863283 shutdown_connections 2023-09-30T22:25:15.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.050+0000 7f5bceb03700 1 -- 172.21.15.156:0/2206863283 wait complete. 2023-09-30T22:25:15.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.051+0000 7f5bceb03700 1 Processor -- start 2023-09-30T22:25:15.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.051+0000 7f5bceb03700 1 -- start start 2023-09-30T22:25:15.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.051+0000 7f5bceb03700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5bc806a770 0x7f5bc8120640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.051+0000 7f5bceb03700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5bc806b250 0x7f5bc8120b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.051+0000 7f5bceb03700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5bc8137140 0x7f5bc81210c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.051+0000 7f5bceb03700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc8122440 con 0x7f5bc806a770 2023-09-30T22:25:15.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.051+0000 7f5bceb03700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc8122250 con 0x7f5bc806b250 2023-09-30T22:25:15.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.051+0000 7f5bceb03700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc8071e10 con 0x7f5bc8137140 2023-09-30T22:25:15.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.051+0000 7f5bcc89f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5bc806a770 0x7f5bc8120640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.051+0000 7f5bcc89f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5bc806a770 0x7f5bc8120640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48476/0 (socket says 172.21.15.156:48476) 2023-09-30T22:25:15.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.051+0000 7f5bcc89f700 1 -- 172.21.15.156:0/3034672042 learned_addr learned my addr 172.21.15.156:0/3034672042 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:15.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.051+0000 7f5bc7fff700 1 --2- 172.21.15.156:0/3034672042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5bc806b250 0x7f5bc8120b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.051+0000 7f5bcd0a0700 1 --2- 172.21.15.156:0/3034672042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5bc8137140 0x7f5bc81210c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.052+0000 7f5bc7fff700 1 -- 172.21.15.156:0/3034672042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5bc8137140 msgr2=0x7f5bc81210c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.052+0000 7f5bc7fff700 1 --2- 172.21.15.156:0/3034672042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5bc8137140 0x7f5bc81210c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.052+0000 7f5bc7fff700 1 -- 172.21.15.156:0/3034672042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5bc806a770 msgr2=0x7f5bc8120640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.052+0000 7f5bc7fff700 1 --2- 172.21.15.156:0/3034672042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5bc806a770 0x7f5bc8120640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.052+0000 7f5bc7fff700 1 -- 172.21.15.156:0/3034672042 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc0009a70 con 0x7f5bc806b250 2023-09-30T22:25:15.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.052+0000 7f5bcd0a0700 1 --2- 172.21.15.156:0/3034672042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5bc8137140 0x7f5bc81210c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:15.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.052+0000 7f5bc7fff700 1 --2- 172.21.15.156:0/3034672042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5bc806b250 0x7f5bc8120b80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4009ca0 tx=0x7f5bb4010f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:15.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.052+0000 7f5bc57fa700 1 -- 172.21.15.156:0/3034672042 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4015070 con 0x7f5bc806b250 2023-09-30T22:25:15.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.052+0000 7f5bc57fa700 1 -- 172.21.15.156:0/3034672042 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb400b930 con 0x7f5bc806b250 2023-09-30T22:25:15.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.052+0000 7f5bceb03700 1 -- 172.21.15.156:0/3034672042 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc8124160 con 0x7f5bc806b250 2023-09-30T22:25:15.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.052+0000 7f5bc57fa700 1 -- 172.21.15.156:0/3034672042 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb400bca0 con 0x7f5bc806b250 2023-09-30T22:25:15.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.052+0000 7f5bceb03700 1 -- 172.21.15.156:0/3034672042 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc8122a40 con 0x7f5bc806b250 2023-09-30T22:25:15.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.053+0000 7f5bc57fa700 1 -- 172.21.15.156:0/3034672042 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5bb4019410 con 0x7f5bc806b250 2023-09-30T22:25:15.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.053+0000 7f5bc57fa700 1 -- 172.21.15.156:0/3034672042 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5bb4042f20 con 0x7f5bc806b250 2023-09-30T22:25:15.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.054+0000 7f5bceb03700 1 -- 172.21.15.156:0/3034672042 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc804f2a0 con 0x7f5bc806b250 2023-09-30T22:25:15.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.058+0000 7f5bc57fa700 1 -- 172.21.15.156:0/3034672042 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5bb401e080 con 0x7f5bc806b250 2023-09-30T22:25:15.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.123+0000 7fa4dba03700 1 Processor -- start 2023-09-30T22:25:15.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.123+0000 7fa4dba03700 1 -- start start 2023-09-30T22:25:15.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.124+0000 7fa4dba03700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4d40a0a70 0x7fa4d40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.124+0000 7fa4dba03700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4d40a1380 0x7fa4d4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.124+0000 7fa4dba03700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa4d4133f50 0x7fa4d41343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.124+0000 7fa4dba03700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d409e9d0 con 0x7fa4d4133f50 2023-09-30T22:25:15.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.124+0000 7fa4dba03700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d409dc00 con 0x7fa4d40a0a70 2023-09-30T22:25:15.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.124+0000 7fa4dba03700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d409dec0 con 0x7fa4d40a1380 2023-09-30T22:25:15.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.124+0000 7fa4d8f9e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4d40a1380 0x7fa4d4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.124+0000 7fa4d8f9e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4d40a1380 0x7fa4d4133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53468/0 (socket says 172.21.15.156:53468) 2023-09-30T22:25:15.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.124+0000 7fa4d8f9e700 1 -- 172.21.15.156:0/3373517280 learned_addr learned my addr 172.21.15.156:0/3373517280 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:15.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.124+0000 7fa4d9fa0700 1 --2- 172.21.15.156:0/3373517280 >> v2:172.21.15.156:3300/0 conn(0x7fa4d4133f50 0x7fa4d41343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.125+0000 7fa4d8f9e700 1 -- 172.21.15.156:0/3373517280 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4d40a0a70 msgr2=0x7fa4d40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:15.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.125+0000 7fa4d8f9e700 1 --2- 172.21.15.156:0/3373517280 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4d40a0a70 0x7fa4d40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.125+0000 7fa4d8f9e700 1 -- 172.21.15.156:0/3373517280 >> v2:172.21.15.156:3300/0 conn(0x7fa4d4133f50 msgr2=0x7fa4d41343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:15.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.125+0000 7fa4d8f9e700 1 --2- 172.21.15.156:0/3373517280 >> v2:172.21.15.156:3300/0 conn(0x7fa4d4133f50 0x7fa4d41343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.125+0000 7fa4d8f9e700 1 -- 172.21.15.156:0/3373517280 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d409e6a0 con 0x7fa4d40a1380 2023-09-30T22:25:15.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.125+0000 7fa4d9fa0700 1 --2- 172.21.15.156:0/3373517280 >> v2:172.21.15.156:3300/0 conn(0x7fa4d4133f50 0x7fa4d41343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:15.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.125+0000 7fa4d8f9e700 1 --2- 172.21.15.156:0/3373517280 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4d40a1380 0x7fa4d4133a10 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40098f0 tx=0x7fa4c4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8552cb09e7d6e18b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:15.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.125+0000 7fa4cbfff700 1 -- 172.21.15.156:0/3373517280 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4011830 con 0x7fa4d40a1380 2023-09-30T22:25:15.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.125+0000 7fa4cbfff700 1 -- 172.21.15.156:0/3373517280 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c4011990 con 0x7fa4d40a1380 2023-09-30T22:25:15.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.125+0000 7fa4cbfff700 1 -- 172.21.15.156:0/3373517280 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4011d20 con 0x7fa4d40a1380 2023-09-30T22:25:15.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.126+0000 7fa4dba03700 1 -- 172.21.15.156:0/3373517280 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4d40a1380 msgr2=0x7fa4d4133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.126+0000 7fa4dba03700 1 --2- 172.21.15.156:0/3373517280 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4d40a1380 0x7fa4d4133a10 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40098f0 tx=0x7fa4c4009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:15.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.126+0000 7fa4dba03700 1 -- 172.21.15.156:0/3373517280 shutdown_connections 2023-09-30T22:25:15.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.126+0000 7fa4dba03700 1 --2- 172.21.15.156:0/3373517280 >> v2:172.21.15.156:3300/0 conn(0x7fa4d4133f50 0x7fa4d41343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.126+0000 7fa4dba03700 1 --2- 172.21.15.156:0/3373517280 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4d40a0a70 0x7fa4d40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.126+0000 7fa4dba03700 1 --2- 172.21.15.156:0/3373517280 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4d40a1380 0x7fa4d4133a10 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.126+0000 7fa4dba03700 1 -- 172.21.15.156:0/3373517280 >> 172.21.15.156:0/3373517280 conn(0x7fa4d40a6610 msgr2=0x7fa4d40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:15.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.126+0000 7fa4dba03700 1 -- 172.21.15.156:0/3373517280 shutdown_connections 2023-09-30T22:25:15.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.126+0000 7fa4dba03700 1 -- 172.21.15.156:0/3373517280 wait complete. 2023-09-30T22:25:15.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.127+0000 7fa4dba03700 1 Processor -- start 2023-09-30T22:25:15.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.127+0000 7fa4dba03700 1 -- start start 2023-09-30T22:25:15.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.128+0000 7fa4dba03700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4d40a0a70 0x7fa4d411f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.128+0000 7fa4dba03700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4d40a1380 0x7fa4d411fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.128+0000 7fa4dba03700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4d4133f50 0x7fa4d411ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.128+0000 7fa4dba03700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d4122960 con 0x7fa4d40a1380 2023-09-30T22:25:15.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.128+0000 7fa4dba03700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d4133a10 con 0x7fa4d40a0a70 2023-09-30T22:25:15.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.128+0000 7fa4dba03700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d4121d80 con 0x7fa4d4133f50 2023-09-30T22:25:15.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.128+0000 7fa4d9fa0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4d4133f50 0x7fa4d411ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.128+0000 7fa4d9fa0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4d4133f50 0x7fa4d411ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53480/0 (socket says 172.21.15.156:53480) 2023-09-30T22:25:15.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.128+0000 7fa4d9fa0700 1 -- 172.21.15.156:0/2090046157 learned_addr learned my addr 172.21.15.156:0/2090046157 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:15.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.128+0000 7fa4d8f9e700 1 --2- 172.21.15.156:0/2090046157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4d40a1380 0x7fa4d411fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.128+0000 7fa4d9fa0700 1 -- 172.21.15.156:0/2090046157 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4d40a0a70 msgr2=0x7fa4d411f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.128+0000 7fa4d9fa0700 1 --2- 172.21.15.156:0/2090046157 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4d40a0a70 0x7fa4d411f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.128+0000 7fa4d9fa0700 1 -- 172.21.15.156:0/2090046157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4d40a1380 msgr2=0x7fa4d411fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.128+0000 7fa4d9fa0700 1 --2- 172.21.15.156:0/2090046157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4d40a1380 0x7fa4d411fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.128+0000 7fa4d9fa0700 1 -- 172.21.15.156:0/2090046157 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc009a70 con 0x7fa4d4133f50 2023-09-30T22:25:15.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.128+0000 7fa4d8f9e700 1 --2- 172.21.15.156:0/2090046157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4d40a1380 0x7fa4d411fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:15.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.129+0000 7fa4d9fa0700 1 --2- 172.21.15.156:0/2090046157 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4d4133f50 0x7fa4d411ffa0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00efc0 tx=0x7fa4cc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:15.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.129+0000 7fa4c9ffb700 1 -- 172.21.15.156:0/2090046157 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc00cb40 con 0x7fa4d4133f50 2023-09-30T22:25:15.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.129+0000 7fa4c9ffb700 1 -- 172.21.15.156:0/2090046157 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4cc00f040 con 0x7fa4d4133f50 2023-09-30T22:25:15.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.129+0000 7fa4c9ffb700 1 -- 172.21.15.156:0/2090046157 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc003a20 con 0x7fa4d4133f50 2023-09-30T22:25:15.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.129+0000 7fa4dba03700 1 -- 172.21.15.156:0/2090046157 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c4009550 con 0x7fa4d4133f50 2023-09-30T22:25:15.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.129+0000 7fa4dba03700 1 -- 172.21.15.156:0/2090046157 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d4121100 con 0x7fa4d4133f50 2023-09-30T22:25:15.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.130+0000 7f60cc931700 1 Processor -- start 2023-09-30T22:25:15.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.130+0000 7f60cc931700 1 -- start start 2023-09-30T22:25:15.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.130+0000 7fa4dba03700 1 -- 172.21.15.156:0/2090046157 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d409b620 con 0x7fa4d4133f50 2023-09-30T22:25:15.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.131+0000 7fa4c9ffb700 1 -- 172.21.15.156:0/2090046157 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa4cc014480 con 0x7fa4d4133f50 2023-09-30T22:25:15.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.131+0000 7f60cc931700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60c8138410 0x7f60c80a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.131+0000 7f60cc931700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f60c813dd10 0x7f60c81400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.131+0000 7f60cc931700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c81379e0 con 0x7f60c8138040 2023-09-30T22:25:15.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.131+0000 7f60cc931700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c80a2100 con 0x7f60c813dd10 2023-09-30T22:25:15.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.131+0000 7f60cc931700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60c809b9b0 con 0x7f60c8138410 2023-09-30T22:25:15.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.131+0000 7fa4c9ffb700 1 -- 172.21.15.156:0/2090046157 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa4cc040160 con 0x7fa4d4133f50 2023-09-30T22:25:15.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.131+0000 7f60c5d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60c8138410 0x7f60c80a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.131+0000 7f60c5d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60c8138410 0x7f60c80a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53482/0 (socket says 172.21.15.156:53482) 2023-09-30T22:25:15.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.131+0000 7f60c5d9b700 1 -- 172.21.15.156:0/2790927445 learned_addr learned my addr 172.21.15.156:0/2790927445 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:15.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.131+0000 7f60c6d9d700 1 --2- 172.21.15.156:0/2790927445 >> v2:172.21.15.156:3300/0 conn(0x7f60c813dd10 0x7f60c81400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.131+0000 7f60c5d9b700 1 -- 172.21.15.156:0/2790927445 >> v2:172.21.15.156:3300/0 conn(0x7f60c813dd10 msgr2=0x7f60c81400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:15.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.131+0000 7f60c5d9b700 1 --2- 172.21.15.156:0/2790927445 >> v2:172.21.15.156:3300/0 conn(0x7f60c813dd10 0x7f60c81400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.131+0000 7f60c5d9b700 1 -- 172.21.15.156:0/2790927445 >> v1:172.21.15.156:6789/0 conn(0x7f60c8138040 legacy=0x7f60c80a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:15.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.131+0000 7f60c5d9b700 1 -- 172.21.15.156:0/2790927445 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c8137c10 con 0x7f60c8138410 2023-09-30T22:25:15.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.131+0000 7f60c6d9d700 1 --2- 172.21.15.156:0/2790927445 >> v2:172.21.15.156:3300/0 conn(0x7f60c813dd10 0x7f60c81400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:15.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.131+0000 7f60c5d9b700 1 --2- 172.21.15.156:0/2790927445 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60c8138410 0x7f60c80a0ff0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f60bc009920 tx=0x7f60bc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0af9ef5f11e9789 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:15.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.139+0000 7f60c559a700 1 -- 172.21.15.156:0/2790927445 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc004230 con 0x7f60c8138410 2023-09-30T22:25:15.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.140+0000 7f60c559a700 1 -- 172.21.15.156:0/2790927445 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60bc004390 con 0x7f60c8138410 2023-09-30T22:25:15.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.140+0000 7f60c559a700 1 -- 172.21.15.156:0/2790927445 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc0036a0 con 0x7f60c8138410 2023-09-30T22:25:15.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.140+0000 7fa4c9ffb700 1 -- 172.21.15.156:0/2090046157 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4cc012930 con 0x7fa4d4133f50 2023-09-30T22:25:15.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.140+0000 7f60cc931700 1 -- 172.21.15.156:0/2790927445 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60c8138410 msgr2=0x7f60c80a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.140+0000 7f60cc931700 1 --2- 172.21.15.156:0/2790927445 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60c8138410 0x7f60c80a0ff0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f60bc009920 tx=0x7f60bc009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:15.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.140+0000 7f60cc931700 1 -- 172.21.15.156:0/2790927445 shutdown_connections 2023-09-30T22:25:15.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.140+0000 7f60cc931700 1 --2- 172.21.15.156:0/2790927445 >> v2:172.21.15.156:3300/0 conn(0x7f60c813dd10 0x7f60c81400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.140+0000 7f60cc931700 1 --2- 172.21.15.156:0/2790927445 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60c8138410 0x7f60c80a0ff0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.140+0000 7f60cc931700 1 -- 172.21.15.156:0/2790927445 >> 172.21.15.156:0/2790927445 conn(0x7f60c80a2980 msgr2=0x7f60c80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:15.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.141+0000 7f60cc931700 1 -- 172.21.15.156:0/2790927445 shutdown_connections 2023-09-30T22:25:15.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.141+0000 7f60cc931700 1 -- 172.21.15.156:0/2790927445 wait complete. 2023-09-30T22:25:15.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.142+0000 7f60cc931700 1 Processor -- start 2023-09-30T22:25:15.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.142+0000 7f60cc931700 1 -- start start 2023-09-30T22:25:15.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.142+0000 7f60cc931700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60c8138040 0x7f60c8121600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.142+0000 7f60cc931700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60c8138410 0x7f60c8121b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.142+0000 7f60cc931700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60c813dd10 0x7f60c8122080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.142+0000 7f60cc931700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c809a240 con 0x7f60c813dd10 2023-09-30T22:25:15.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.142+0000 7f60cc931700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c8123750 con 0x7f60c8138410 2023-09-30T22:25:15.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.142+0000 7f60cc931700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60c8124590 con 0x7f60c8138040 2023-09-30T22:25:15.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.142+0000 7f60c659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60c8138040 0x7f60c8121600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.142+0000 7f60c6d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60c813dd10 0x7f60c8122080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.142+0000 7f60c5d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60c8138410 0x7f60c8121b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.142+0000 7f60c659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60c8138040 0x7f60c8121600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53496/0 (socket says 172.21.15.156:53496) 2023-09-30T22:25:15.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.142+0000 7f60c659c700 1 -- 172.21.15.156:0/4274624907 learned_addr learned my addr 172.21.15.156:0/4274624907 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:15.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.143+0000 7f60c6d9d700 1 -- 172.21.15.156:0/4274624907 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60c8138040 msgr2=0x7f60c8121600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.143+0000 7f60c6d9d700 1 --2- 172.21.15.156:0/4274624907 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60c8138040 0x7f60c8121600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.143+0000 7f60c6d9d700 1 -- 172.21.15.156:0/4274624907 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60c8138410 msgr2=0x7f60c8121b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.143+0000 7f60c6d9d700 1 --2- 172.21.15.156:0/4274624907 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60c8138410 0x7f60c8121b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.143+0000 7f60c6d9d700 1 -- 172.21.15.156:0/4274624907 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c0009a70 con 0x7f60c813dd10 2023-09-30T22:25:15.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.143+0000 7f60c6d9d700 1 --2- 172.21.15.156:0/4274624907 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60c813dd10 0x7f60c8122080 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f60c8066a00 tx=0x7f60c000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:15.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.143+0000 7f60b6ffd700 1 -- 172.21.15.156:0/4274624907 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c000cc20 con 0x7f60c813dd10 2023-09-30T22:25:15.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.143+0000 7f60b6ffd700 1 -- 172.21.15.156:0/4274624907 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c000f040 con 0x7f60c813dd10 2023-09-30T22:25:15.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.143+0000 7f60cc931700 1 -- 172.21.15.156:0/4274624907 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60bc009550 con 0x7f60c813dd10 2023-09-30T22:25:15.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.143+0000 7f60b6ffd700 1 -- 172.21.15.156:0/4274624907 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c0014480 con 0x7f60c813dd10 2023-09-30T22:25:15.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.143+0000 7f60cc931700 1 -- 172.21.15.156:0/4274624907 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c8137700 con 0x7f60c813dd10 2023-09-30T22:25:15.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.144+0000 7f60cc931700 1 -- 172.21.15.156:0/4274624907 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c81247c0 con 0x7f60c813dd10 2023-09-30T22:25:15.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.145+0000 7f60b6ffd700 1 -- 172.21.15.156:0/4274624907 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f60c00145e0 con 0x7f60c813dd10 2023-09-30T22:25:15.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.145+0000 7f60b6ffd700 1 -- 172.21.15.156:0/4274624907 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f60c0040880 con 0x7f60c813dd10 2023-09-30T22:25:15.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.150+0000 7f60b6ffd700 1 -- 172.21.15.156:0/4274624907 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f60c00267f0 con 0x7f60c813dd10 2023-09-30T22:25:15.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.257+0000 7f5bceb03700 1 -- 172.21.15.156:0/3034672042 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5bc81237e0 con 0x7f5bc806b250 2023-09-30T22:25:15.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.257+0000 7f5bc57fa700 1 -- 172.21.15.156:0/3034672042 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5bb40196c0 con 0x7f5bc806b250 2023-09-30T22:25:15.257 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:15.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.259+0000 7f5bceb03700 1 -- 172.21.15.156:0/3034672042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5bc806b250 msgr2=0x7f5bc8120b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.259+0000 7f5bceb03700 1 --2- 172.21.15.156:0/3034672042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5bc806b250 0x7f5bc8120b80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4009ca0 tx=0x7f5bb4010f60 comp rx=0 tx=0).stop 2023-09-30T22:25:15.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.259+0000 7f5bceb03700 1 -- 172.21.15.156:0/3034672042 shutdown_connections 2023-09-30T22:25:15.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.260+0000 7f5bceb03700 1 --2- 172.21.15.156:0/3034672042 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5bc8137140 0x7f5bc81210c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.259 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.260+0000 7f5bceb03700 1 --2- 172.21.15.156:0/3034672042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5bc806a770 0x7f5bc8120640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.260+0000 7f5bceb03700 1 --2- 172.21.15.156:0/3034672042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5bc806b250 0x7f5bc8120b80 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.260+0000 7f5bceb03700 1 -- 172.21.15.156:0/3034672042 >> 172.21.15.156:0/3034672042 conn(0x7f5bc8099c40 msgr2=0x7f5bc80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:15.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.261+0000 7f5bceb03700 1 -- 172.21.15.156:0/3034672042 shutdown_connections 2023-09-30T22:25:15.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.261+0000 7f5bceb03700 1 -- 172.21.15.156:0/3034672042 wait complete. 2023-09-30T22:25:15.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:15.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.281+0000 7ff16fb16700 1 -- 172.21.15.156:0/1326935668 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff150005590 con 0x7ff1680a1340 2023-09-30T22:25:15.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.282+0000 7ff15e7fc700 1 -- 172.21.15.156:0/1326935668 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff158017030 con 0x7ff1680a1340 2023-09-30T22:25:15.281 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:15.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.284+0000 7ff16fb16700 1 -- 172.21.15.156:0/1326935668 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1680a1340 msgr2=0x7ff1681c6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.284+0000 7ff16fb16700 1 --2- 172.21.15.156:0/1326935668 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1680a1340 0x7ff1681c6590 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ff15800c4e0 tx=0x7ff15800c7f0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.284+0000 7ff16fb16700 1 -- 172.21.15.156:0/1326935668 shutdown_connections 2023-09-30T22:25:15.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.284+0000 7ff16fb16700 1 --2- 172.21.15.156:0/1326935668 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff168130670 0x7ff1681c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.284+0000 7ff16fb16700 1 --2- 172.21.15.156:0/1326935668 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff1680a0a30 0x7ff1681c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.284+0000 7ff16fb16700 1 --2- 172.21.15.156:0/1326935668 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff1680a1340 0x7ff1681c6590 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.284+0000 7ff16fb16700 1 -- 172.21.15.156:0/1326935668 >> 172.21.15.156:0/1326935668 conn(0x7ff1680a2980 msgr2=0x7ff168070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:15.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.284+0000 7ff16fb16700 1 -- 172.21.15.156:0/1326935668 shutdown_connections 2023-09-30T22:25:15.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.284+0000 7ff16fb16700 1 -- 172.21.15.156:0/1326935668 wait complete. 2023-09-30T22:25:15.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:15.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.345+0000 7f60cc931700 1 -- 172.21.15.156:0/4274624907 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f60c81247c0 con 0x7f60c813dd10 2023-09-30T22:25:15.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.345+0000 7f60b6ffd700 1 -- 172.21.15.156:0/4274624907 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f60c81247c0 con 0x7f60c813dd10 2023-09-30T22:25:15.345 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.347+0000 7f60cc931700 1 -- 172.21.15.156:0/4274624907 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60c813dd10 msgr2=0x7f60c8122080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.347+0000 7f60cc931700 1 --2- 172.21.15.156:0/4274624907 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60c813dd10 0x7f60c8122080 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f60c8066a00 tx=0x7f60c000ef90 comp rx=0 tx=0).stop 2023-09-30T22:25:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.347+0000 7f60cc931700 1 -- 172.21.15.156:0/4274624907 shutdown_connections 2023-09-30T22:25:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.347+0000 7f60cc931700 1 --2- 172.21.15.156:0/4274624907 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60c813dd10 0x7f60c8122080 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.347+0000 7f60cc931700 1 --2- 172.21.15.156:0/4274624907 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f60c8138040 0x7f60c8121600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.347+0000 7f60cc931700 1 --2- 172.21.15.156:0/4274624907 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f60c8138410 0x7f60c8121b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.347+0000 7f60cc931700 1 -- 172.21.15.156:0/4274624907 >> 172.21.15.156:0/4274624907 conn(0x7f60c80a2980 msgr2=0x7f60c809d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:15.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.347+0000 7f60cc931700 1 -- 172.21.15.156:0/4274624907 shutdown_connections 2023-09-30T22:25:15.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.347+0000 7f60cc931700 1 -- 172.21.15.156:0/4274624907 wait complete. 2023-09-30T22:25:15.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.355+0000 7fa4dba03700 1 -- 172.21.15.156:0/2090046157 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa4d4122ad0 con 0x7fa4d4133f50 2023-09-30T22:25:15.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.356+0000 7fa4c9ffb700 1 -- 172.21.15.156:0/2090046157 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa4cc012340 con 0x7fa4d4133f50 2023-09-30T22:25:15.355 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:15.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.358+0000 7fa4dba03700 1 -- 172.21.15.156:0/2090046157 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4d4133f50 msgr2=0x7fa4d411ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.358+0000 7fa4dba03700 1 --2- 172.21.15.156:0/2090046157 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4d4133f50 0x7fa4d411ffa0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00efc0 tx=0x7fa4cc00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.358+0000 7fa4dba03700 1 -- 172.21.15.156:0/2090046157 shutdown_connections 2023-09-30T22:25:15.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.358+0000 7fa4dba03700 1 --2- 172.21.15.156:0/2090046157 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa4d4133f50 0x7fa4d411ffa0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.358+0000 7fa4dba03700 1 --2- 172.21.15.156:0/2090046157 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa4d40a0a70 0x7fa4d411f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.358+0000 7fa4dba03700 1 --2- 172.21.15.156:0/2090046157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4d40a1380 0x7fa4d411fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.358+0000 7fa4dba03700 1 -- 172.21.15.156:0/2090046157 >> 172.21.15.156:0/2090046157 conn(0x7fa4d40a6610 msgr2=0x7fa4d40a5400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:15.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.358+0000 7fa4dba03700 1 -- 172.21.15.156:0/2090046157 shutdown_connections 2023-09-30T22:25:15.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:15.358+0000 7fa4dba03700 1 -- 172.21.15.156:0/2090046157 wait complete. 2023-09-30T22:25:15.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:15.370 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:16.275 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:16.297 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:16.360 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:16.371 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:16.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.415+0000 7fdc88587700 1 Processor -- start 2023-09-30T22:25:16.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.415+0000 7fdc88587700 1 -- start start 2023-09-30T22:25:16.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.416+0000 7fdc88587700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc80138410 0x7fdc800a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.416+0000 7fdc88587700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdc8013dd10 0x7fdc801400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.416+0000 7fdc88587700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc801379e0 con 0x7fdc80138040 2023-09-30T22:25:16.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.416+0000 7fdc88587700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc800a2100 con 0x7fdc8013dd10 2023-09-30T22:25:16.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.416+0000 7fdc88587700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8009b9b0 con 0x7fdc80138410 2023-09-30T22:25:16.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.417+0000 7fdc85b22700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc80138410 0x7fdc800a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.417+0000 7fdc85b22700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc80138410 0x7fdc800a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53504/0 (socket says 172.21.15.156:53504) 2023-09-30T22:25:16.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.417+0000 7fdc86b24700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdc8013dd10 0x7fdc801400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.417+0000 7fdc85b22700 1 -- 172.21.15.156:0/651966627 learned_addr learned my addr 172.21.15.156:0/651966627 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:16.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.417+0000 7fdc85b22700 1 -- 172.21.15.156:0/651966627 >> v2:172.21.15.156:3300/0 conn(0x7fdc8013dd10 msgr2=0x7fdc801400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:16.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.417+0000 7fdc85b22700 1 --2- 172.21.15.156:0/651966627 >> v2:172.21.15.156:3300/0 conn(0x7fdc8013dd10 0x7fdc801400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.417+0000 7fdc85b22700 1 -- 172.21.15.156:0/651966627 >> v1:172.21.15.156:6789/0 conn(0x7fdc80138040 legacy=0x7fdc800a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.417+0000 7fdc85b22700 1 -- 172.21.15.156:0/651966627 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc80137c10 con 0x7fdc80138410 2023-09-30T22:25:16.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.417+0000 7fdc86b24700 1 --2- 172.21.15.156:0/651966627 >> v2:172.21.15.156:3300/0 conn(0x7fdc8013dd10 0x7fdc801400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:16.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.417+0000 7fdc85b22700 1 --2- 172.21.15.156:0/651966627 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc80138410 0x7fdc800a0ff0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fdc70009920 tx=0x7fdc70009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=942c556004833148 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:16.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.417+0000 7fdc85321700 1 -- 172.21.15.156:0/651966627 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc70011830 con 0x7fdc80138410 2023-09-30T22:25:16.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.417+0000 7fdc85321700 1 -- 172.21.15.156:0/651966627 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc70011990 con 0x7fdc80138410 2023-09-30T22:25:16.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.417+0000 7fdc85321700 1 -- 172.21.15.156:0/651966627 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc70011d20 con 0x7fdc80138410 2023-09-30T22:25:16.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.418+0000 7fdc88587700 1 -- 172.21.15.156:0/651966627 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc80138410 msgr2=0x7fdc800a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.418+0000 7fdc88587700 1 --2- 172.21.15.156:0/651966627 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc80138410 0x7fdc800a0ff0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fdc70009920 tx=0x7fdc70009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:16.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.418+0000 7fdc88587700 1 -- 172.21.15.156:0/651966627 shutdown_connections 2023-09-30T22:25:16.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.418+0000 7fdc88587700 1 --2- 172.21.15.156:0/651966627 >> v2:172.21.15.156:3300/0 conn(0x7fdc8013dd10 0x7fdc801400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.418+0000 7fdc88587700 1 --2- 172.21.15.156:0/651966627 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc80138410 0x7fdc800a0ff0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.418+0000 7fdc88587700 1 -- 172.21.15.156:0/651966627 >> 172.21.15.156:0/651966627 conn(0x7fdc800a2980 msgr2=0x7fdc800a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:16.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.418+0000 7fdc88587700 1 -- 172.21.15.156:0/651966627 shutdown_connections 2023-09-30T22:25:16.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.418+0000 7fdc88587700 1 -- 172.21.15.156:0/651966627 wait complete. 2023-09-30T22:25:16.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.419+0000 7fdc88587700 1 Processor -- start 2023-09-30T22:25:16.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.419+0000 7fdc88587700 1 -- start start 2023-09-30T22:25:16.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.420+0000 7fdc88587700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc80138040 0x7fdc80121600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.420+0000 7fdc88587700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc80138410 0x7fdc80121b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.420+0000 7fdc88587700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc8013dd10 0x7fdc80122080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.420+0000 7fdc88587700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc801376e0 con 0x7fdc8013dd10 2023-09-30T22:25:16.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.420+0000 7fdc88587700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc80124120 con 0x7fdc80138410 2023-09-30T22:25:16.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.420+0000 7fdc88587700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc80124ba0 con 0x7fdc80138040 2023-09-30T22:25:16.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.420+0000 7fdc85b22700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc80138410 0x7fdc80121b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.420+0000 7fdc85b22700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc80138410 0x7fdc80121b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48458/0 (socket says 172.21.15.156:48458) 2023-09-30T22:25:16.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.420+0000 7fdc85b22700 1 -- 172.21.15.156:0/1548576482 learned_addr learned my addr 172.21.15.156:0/1548576482 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:16.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.420+0000 7fdc86b24700 1 --2- 172.21.15.156:0/1548576482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc8013dd10 0x7fdc80122080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.420+0000 7fdc86323700 1 --2- 172.21.15.156:0/1548576482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc80138040 0x7fdc80121600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.420+0000 7fdc86b24700 1 -- 172.21.15.156:0/1548576482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc80138040 msgr2=0x7fdc80121600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.420+0000 7fdc86b24700 1 --2- 172.21.15.156:0/1548576482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc80138040 0x7fdc80121600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.420+0000 7fdc86b24700 1 -- 172.21.15.156:0/1548576482 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc80138410 msgr2=0x7fdc80121b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.420+0000 7fdc86b24700 1 --2- 172.21.15.156:0/1548576482 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc80138410 0x7fdc80121b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.420+0000 7fdc86b24700 1 -- 172.21.15.156:0/1548576482 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc78009a70 con 0x7fdc8013dd10 2023-09-30T22:25:16.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.420+0000 7fdc85b22700 1 --2- 172.21.15.156:0/1548576482 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc80138410 0x7fdc80121b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:16.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.420+0000 7fdc86b24700 1 --2- 172.21.15.156:0/1548576482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc8013dd10 0x7fdc80122080 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fdc80099de0 tx=0x7fdc7800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:16.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.421+0000 7fdc76ffd700 1 -- 172.21.15.156:0/1548576482 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7800cb90 con 0x7fdc8013dd10 2023-09-30T22:25:16.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.421+0000 7fdc76ffd700 1 -- 172.21.15.156:0/1548576482 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7800f040 con 0x7fdc8013dd10 2023-09-30T22:25:16.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.421+0000 7fdc76ffd700 1 -- 172.21.15.156:0/1548576482 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc78014480 con 0x7fdc8013dd10 2023-09-30T22:25:16.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.421+0000 7fdc88587700 1 -- 172.21.15.156:0/1548576482 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc70009550 con 0x7fdc8013dd10 2023-09-30T22:25:16.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.421+0000 7fdc88587700 1 -- 172.21.15.156:0/1548576482 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc80123730 con 0x7fdc8013dd10 2023-09-30T22:25:16.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.422+0000 7fdc76ffd700 1 -- 172.21.15.156:0/1548576482 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc780145e0 con 0x7fdc8013dd10 2023-09-30T22:25:16.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.422+0000 7fdc76ffd700 1 -- 172.21.15.156:0/1548576482 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdc78040260 con 0x7fdc8013dd10 2023-09-30T22:25:16.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.422+0000 7fdc88587700 1 -- 172.21.15.156:0/1548576482 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc8004f2a0 con 0x7fdc8013dd10 2023-09-30T22:25:16.427 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.427+0000 7fdc76ffd700 1 -- 172.21.15.156:0/1548576482 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc78018020 con 0x7fdc8013dd10 2023-09-30T22:25:16.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.454+0000 7f437ad9f700 1 Processor -- start 2023-09-30T22:25:16.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.454+0000 7f437ad9f700 1 -- start start 2023-09-30T22:25:16.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.455+0000 7f437ad9f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4374131980 0x7f4374131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.455+0000 7f437ad9f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f437409bc70 0x7f437409c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.455+0000 7f437ad9f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f437409c5c0 0x7f4374138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.455+0000 7f437ad9f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f437406eb30 con 0x7f437409bc70 2023-09-30T22:25:16.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.455+0000 7f437ad9f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43740a1640 con 0x7f437409c5c0 2023-09-30T22:25:16.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.455+0000 7f437ad9f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43740a22d0 con 0x7f4374131980 2023-09-30T22:25:16.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.455+0000 7f4373fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f437409bc70 0x7f437409c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.455+0000 7f437933c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f437409c5c0 0x7f4374138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.455+0000 7f437933c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f437409c5c0 0x7f4374138700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48474/0 (socket says 172.21.15.156:48474) 2023-09-30T22:25:16.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.455+0000 7f4373fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f437409bc70 0x7f437409c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48558/0 (socket says 172.21.15.156:48558) 2023-09-30T22:25:16.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.455+0000 7f437933c700 1 -- 172.21.15.156:0/2490309226 learned_addr learned my addr 172.21.15.156:0/2490309226 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:16.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.455+0000 7f4378b3b700 1 --2- 172.21.15.156:0/2490309226 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4374131980 0x7f4374131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.455+0000 7f437933c700 1 -- 172.21.15.156:0/2490309226 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4374131980 msgr2=0x7f4374131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:16.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.455+0000 7f437933c700 1 --2- 172.21.15.156:0/2490309226 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4374131980 0x7f4374131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.455+0000 7f437933c700 1 -- 172.21.15.156:0/2490309226 >> v2:172.21.15.156:3300/0 conn(0x7f437409bc70 msgr2=0x7f437409c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:16.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.455+0000 7f437933c700 1 --2- 172.21.15.156:0/2490309226 >> v2:172.21.15.156:3300/0 conn(0x7f437409bc70 0x7f437409c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.455+0000 7f437933c700 1 -- 172.21.15.156:0/2490309226 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4374131550 con 0x7f437409c5c0 2023-09-30T22:25:16.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.456+0000 7f437933c700 1 --2- 172.21.15.156:0/2490309226 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f437409c5c0 0x7f4374138700 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f436c010420 tx=0x7f436c010730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2a524a405803e06 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:16.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.456+0000 7f43737fe700 1 -- 172.21.15.156:0/2490309226 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c012840 con 0x7f437409c5c0 2023-09-30T22:25:16.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.456+0000 7f43737fe700 1 -- 172.21.15.156:0/2490309226 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436c0129a0 con 0x7f437409c5c0 2023-09-30T22:25:16.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.456+0000 7f43737fe700 1 -- 172.21.15.156:0/2490309226 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c012d50 con 0x7f437409c5c0 2023-09-30T22:25:16.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.456+0000 7f437ad9f700 1 -- 172.21.15.156:0/2490309226 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f437409c5c0 msgr2=0x7f4374138700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.456+0000 7f437ad9f700 1 --2- 172.21.15.156:0/2490309226 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f437409c5c0 0x7f4374138700 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f436c010420 tx=0x7f436c010730 comp rx=0 tx=0).stop 2023-09-30T22:25:16.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.456+0000 7f437ad9f700 1 -- 172.21.15.156:0/2490309226 shutdown_connections 2023-09-30T22:25:16.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.456+0000 7f437ad9f700 1 --2- 172.21.15.156:0/2490309226 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f437409c5c0 0x7f4374138700 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.456+0000 7f437ad9f700 1 --2- 172.21.15.156:0/2490309226 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4374131980 0x7f4374131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.457+0000 7f437ad9f700 1 --2- 172.21.15.156:0/2490309226 >> v2:172.21.15.156:3300/0 conn(0x7f437409bc70 0x7f437409c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.457+0000 7f437ad9f700 1 -- 172.21.15.156:0/2490309226 >> 172.21.15.156:0/2490309226 conn(0x7f43740a2980 msgr2=0x7f43740a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:16.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.457+0000 7f437ad9f700 1 -- 172.21.15.156:0/2490309226 shutdown_connections 2023-09-30T22:25:16.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.457+0000 7f437ad9f700 1 -- 172.21.15.156:0/2490309226 wait complete. 2023-09-30T22:25:16.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.457+0000 7f437ad9f700 1 Processor -- start 2023-09-30T22:25:16.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.458+0000 7f437ad9f700 1 -- start start 2023-09-30T22:25:16.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.458+0000 7f437ad9f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f437409bc70 0x7f437411b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.458+0000 7f437ad9f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f437409c5c0 0x7f437411be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.458+0000 7f437ad9f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4374131980 0x7f437411c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.458+0000 7f437ad9f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437411d600 con 0x7f437409bc70 2023-09-30T22:25:16.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.458+0000 7f437ad9f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f437411cd70 con 0x7f4374131980 2023-09-30T22:25:16.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.458+0000 7f437ad9f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f437411e210 con 0x7f437409c5c0 2023-09-30T22:25:16.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.458+0000 7f4373fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f437409c5c0 0x7f437411be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.458+0000 7f437933c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4374131980 0x7f437411c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.458+0000 7f4373fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f437409c5c0 0x7f437411be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53528/0 (socket says 172.21.15.156:53528) 2023-09-30T22:25:16.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.458+0000 7f437933c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4374131980 0x7f437411c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48490/0 (socket says 172.21.15.156:48490) 2023-09-30T22:25:16.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.458+0000 7f4373fff700 1 -- 172.21.15.156:0/1643544994 learned_addr learned my addr 172.21.15.156:0/1643544994 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:16.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.458+0000 7f4378b3b700 1 --2- 172.21.15.156:0/1643544994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f437409bc70 0x7f437411b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.459+0000 7f437933c700 1 -- 172.21.15.156:0/1643544994 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f437409c5c0 msgr2=0x7f437411be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.459+0000 7f437933c700 1 --2- 172.21.15.156:0/1643544994 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f437409c5c0 0x7f437411be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.459+0000 7f437933c700 1 -- 172.21.15.156:0/1643544994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f437409bc70 msgr2=0x7f437411b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.459+0000 7f437933c700 1 --2- 172.21.15.156:0/1643544994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f437409bc70 0x7f437411b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.459+0000 7f437933c700 1 -- 172.21.15.156:0/1643544994 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436c00bd10 con 0x7f4374131980 2023-09-30T22:25:16.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.459+0000 7f437933c700 1 --2- 172.21.15.156:0/1643544994 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4374131980 0x7f437411c390 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f436c01a000 tx=0x7f436c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:16.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.459+0000 7f43717fa700 1 -- 172.21.15.156:0/1643544994 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c01b480 con 0x7f4374131980 2023-09-30T22:25:16.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.459+0000 7f43717fa700 1 -- 172.21.15.156:0/1643544994 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436c021040 con 0x7f4374131980 2023-09-30T22:25:16.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.459+0000 7f43717fa700 1 -- 172.21.15.156:0/1643544994 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c01b820 con 0x7f4374131980 2023-09-30T22:25:16.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.460+0000 7f437ad9f700 1 -- 172.21.15.156:0/1643544994 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f437411ed80 con 0x7f4374131980 2023-09-30T22:25:16.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.460+0000 7f437ad9f700 1 -- 172.21.15.156:0/1643544994 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43740a1c40 con 0x7f4374131980 2023-09-30T22:25:16.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.460+0000 7f437ad9f700 1 -- 172.21.15.156:0/1643544994 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4374071d50 con 0x7f4374131980 2023-09-30T22:25:16.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.461+0000 7f43717fa700 1 -- 172.21.15.156:0/1643544994 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f436c01b980 con 0x7f4374131980 2023-09-30T22:25:16.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.461+0000 7f43717fa700 1 -- 172.21.15.156:0/1643544994 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f436c016070 con 0x7f4374131980 2023-09-30T22:25:16.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.465+0000 7f43717fa700 1 -- 172.21.15.156:0/1643544994 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f436c01bc30 con 0x7f4374131980 2023-09-30T22:25:16.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.521+0000 7fb7d1352700 1 Processor -- start 2023-09-30T22:25:16.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.521+0000 7fb7d1352700 1 -- start start 2023-09-30T22:25:16.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.522+0000 7fb7d1352700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7cc0a0a30 0x7fb7cc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.522+0000 7fb7d1352700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7cc0a1340 0x7fb7cc12ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.522+0000 7fb7d1352700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb7cc1304a0 0x7fb7cc1308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.522+0000 7fb7d1352700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7cc130e30 con 0x7fb7cc1304a0 2023-09-30T22:25:16.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.522+0000 7fb7d1352700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc0a1e70 con 0x7fb7cc0a0a30 2023-09-30T22:25:16.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.522+0000 7fb7d1352700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc09a720 con 0x7fb7cc0a1340 2023-09-30T22:25:16.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.522+0000 7fb7ca7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7cc0a1340 0x7fb7cc12ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.522+0000 7fb7ca7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7cc0a1340 0x7fb7cc12ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53538/0 (socket says 172.21.15.156:53538) 2023-09-30T22:25:16.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.522+0000 7fb7ca7fc700 1 -- 172.21.15.156:0/265460798 learned_addr learned my addr 172.21.15.156:0/265460798 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:16.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.522+0000 7fb7cb7fe700 1 --2- 172.21.15.156:0/265460798 >> v2:172.21.15.156:3300/0 conn(0x7fb7cc1304a0 0x7fb7cc1308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.522+0000 7fb7caffd700 1 --2- 172.21.15.156:0/265460798 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7cc0a0a30 0x7fb7cc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.522+0000 7fb7ca7fc700 1 -- 172.21.15.156:0/265460798 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7cc0a0a30 msgr2=0x7fb7cc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:16.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.522+0000 7fb7ca7fc700 1 --2- 172.21.15.156:0/265460798 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7cc0a0a30 0x7fb7cc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.522+0000 7fb7ca7fc700 1 -- 172.21.15.156:0/265460798 >> v2:172.21.15.156:3300/0 conn(0x7fb7cc1304a0 msgr2=0x7fb7cc1308f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:16.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.522+0000 7fb7ca7fc700 1 --2- 172.21.15.156:0/265460798 >> v2:172.21.15.156:3300/0 conn(0x7fb7cc1304a0 0x7fb7cc1308f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.522+0000 7fb7ca7fc700 1 -- 172.21.15.156:0/265460798 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7cc09b300 con 0x7fb7cc0a1340 2023-09-30T22:25:16.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.523+0000 7fb7ca7fc700 1 --2- 172.21.15.156:0/265460798 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7cc0a1340 0x7fb7cc12ff60 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000aa90 tx=0x7fb7c000ada0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=678275b72df45e51 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:16.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.523+0000 7fb7c9ffb700 1 -- 172.21.15.156:0/265460798 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c000cb70 con 0x7fb7cc0a1340 2023-09-30T22:25:16.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.523+0000 7fb7c9ffb700 1 -- 172.21.15.156:0/265460798 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c000ccd0 con 0x7fb7cc0a1340 2023-09-30T22:25:16.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.523+0000 7fb7c9ffb700 1 -- 172.21.15.156:0/265460798 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c0018620 con 0x7fb7cc0a1340 2023-09-30T22:25:16.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.523+0000 7fb7d1352700 1 -- 172.21.15.156:0/265460798 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7cc0a1340 msgr2=0x7fb7cc12ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.523+0000 7fb7d1352700 1 --2- 172.21.15.156:0/265460798 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7cc0a1340 0x7fb7cc12ff60 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000aa90 tx=0x7fb7c000ada0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.523+0000 7fb7d1352700 1 -- 172.21.15.156:0/265460798 shutdown_connections 2023-09-30T22:25:16.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.523+0000 7fb7d1352700 1 --2- 172.21.15.156:0/265460798 >> v2:172.21.15.156:3300/0 conn(0x7fb7cc1304a0 0x7fb7cc1308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.523+0000 7fb7d1352700 1 --2- 172.21.15.156:0/265460798 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7cc0a0a30 0x7fb7cc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.523+0000 7fb7d1352700 1 --2- 172.21.15.156:0/265460798 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7cc0a1340 0x7fb7cc12ff60 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.523+0000 7fb7d1352700 1 -- 172.21.15.156:0/265460798 >> 172.21.15.156:0/265460798 conn(0x7fb7cc0a2980 msgr2=0x7fb7cc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:16.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.524+0000 7fb7d1352700 1 -- 172.21.15.156:0/265460798 shutdown_connections 2023-09-30T22:25:16.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.524+0000 7fb7d1352700 1 -- 172.21.15.156:0/265460798 wait complete. 2023-09-30T22:25:16.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.525+0000 7fb7d1352700 1 Processor -- start 2023-09-30T22:25:16.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.525+0000 7fb7d1352700 1 -- start start 2023-09-30T22:25:16.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.525+0000 7fb7d1352700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7cc0a0a30 0x7fb7cc1c5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.525+0000 7fb7d1352700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7cc0a1340 0x7fb7cc1c5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.525+0000 7fb7d1352700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7cc1304a0 0x7fb7cc1c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.525+0000 7fb7d1352700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc125f20 con 0x7fb7cc1304a0 2023-09-30T22:25:16.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.525+0000 7fb7d1352700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc11f680 con 0x7fb7cc0a0a30 2023-09-30T22:25:16.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.525+0000 7fb7d1352700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc126130 con 0x7fb7cc0a1340 2023-09-30T22:25:16.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.525+0000 7fb7cb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7cc1304a0 0x7fb7cc1c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.525+0000 7fb7caffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7cc0a0a30 0x7fb7cc1c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.525+0000 7fb7ca7fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7cc0a1340 0x7fb7cc1c5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.525+0000 7fb7cb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7cc1304a0 0x7fb7cc1c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48596/0 (socket says 172.21.15.156:48596) 2023-09-30T22:25:16.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.525+0000 7fb7caffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7cc0a0a30 0x7fb7cc1c5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48502/0 (socket says 172.21.15.156:48502) 2023-09-30T22:25:16.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.525+0000 7fb7cb7fe700 1 -- 172.21.15.156:0/2629520983 learned_addr learned my addr 172.21.15.156:0/2629520983 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:16.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.526+0000 7fb7cb7fe700 1 -- 172.21.15.156:0/2629520983 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7cc0a1340 msgr2=0x7fb7cc1c5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.526+0000 7fb7cb7fe700 1 --2- 172.21.15.156:0/2629520983 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7cc0a1340 0x7fb7cc1c5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.526+0000 7fb7cb7fe700 1 -- 172.21.15.156:0/2629520983 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7cc0a0a30 msgr2=0x7fb7cc1c5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.526+0000 7fb7cb7fe700 1 --2- 172.21.15.156:0/2629520983 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7cc0a0a30 0x7fb7cc1c5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.526+0000 7fb7cb7fe700 1 -- 172.21.15.156:0/2629520983 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c000a6f0 con 0x7fb7cc1304a0 2023-09-30T22:25:16.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.526+0000 7fb7ca7fc700 1 --2- 172.21.15.156:0/2629520983 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7cc0a1340 0x7fb7cc1c5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:16.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.526+0000 7fb7caffd700 1 --2- 172.21.15.156:0/2629520983 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7cc0a0a30 0x7fb7cc1c5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:16.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.526+0000 7fb7cb7fe700 1 --2- 172.21.15.156:0/2629520983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7cc1304a0 0x7fb7cc1c83e0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fb7c400efc0 tx=0x7fb7c400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:16.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.526+0000 7fb7b37fe700 1 -- 172.21.15.156:0/2629520983 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4009ea0 con 0x7fb7cc1304a0 2023-09-30T22:25:16.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.526+0000 7fb7b37fe700 1 -- 172.21.15.156:0/2629520983 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c400f040 con 0x7fb7cc1304a0 2023-09-30T22:25:16.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.526+0000 7fb7b37fe700 1 -- 172.21.15.156:0/2629520983 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c400ced0 con 0x7fb7cc1304a0 2023-09-30T22:25:16.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.526+0000 7fb7d1352700 1 -- 172.21.15.156:0/2629520983 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7cc125440 con 0x7fb7cc1304a0 2023-09-30T22:25:16.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.526+0000 7fb7d1352700 1 -- 172.21.15.156:0/2629520983 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7cc125bc0 con 0x7fb7cc1304a0 2023-09-30T22:25:16.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.527+0000 7fb7b37fe700 1 -- 172.21.15.156:0/2629520983 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb7c4014480 con 0x7fb7cc1304a0 2023-09-30T22:25:16.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.527+0000 7fb7d1352700 1 -- 172.21.15.156:0/2629520983 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7cc11fea0 con 0x7fb7cc1304a0 2023-09-30T22:25:16.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.527+0000 7fb7b37fe700 1 -- 172.21.15.156:0/2629520983 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb7c40401d0 con 0x7fb7cc1304a0 2023-09-30T22:25:16.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.536+0000 7fb7b37fe700 1 -- 172.21.15.156:0/2629520983 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb7c4007920 con 0x7fb7cc1304a0 2023-09-30T22:25:16.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.547+0000 7fbe0ed22700 1 Processor -- start 2023-09-30T22:25:16.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.547+0000 7fbe0ed22700 1 -- start start 2023-09-30T22:25:16.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.548+0000 7fbe0ed22700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe080a1550 0x7fbe08138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.548+0000 7fbe0ed22700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe08139200 0x7fbe0813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.548+0000 7fbe0ed22700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0809e9d0 con 0x7fbe080a0a70 2023-09-30T22:25:16.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.548+0000 7fbe0ed22700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0809dc00 con 0x7fbe08139200 2023-09-30T22:25:16.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.548+0000 7fbe0ed22700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0809dec0 con 0x7fbe080a1550 2023-09-30T22:25:16.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.548+0000 7fbe0cabe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fbe080a0a70 0x7fbe080a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:41662/0 (socket says 172.21.15.156:41662) 2023-09-30T22:25:16.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.548+0000 7fbe0cabe700 1 -- 172.21.15.156:0/175237010 learned_addr learned my addr 172.21.15.156:0/175237010 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:16.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.548+0000 7fbe07fff700 1 --2- 172.21.15.156:0/175237010 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe080a1550 0x7fbe08138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.549+0000 7fbe0d2bf700 1 --2- 172.21.15.156:0/175237010 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe08139200 0x7fbe0813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.549+0000 7fbe077fe700 1 -- 172.21.15.156:0/175237010 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 340664654 0 0) 0x7fbe0809e9d0 con 0x7fbe080a0a70 2023-09-30T22:25:16.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.549+0000 7fbe077fe700 1 -- 172.21.15.156:0/175237010 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdf80035b0 con 0x7fbe080a0a70 2023-09-30T22:25:16.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.549+0000 7fbe07fff700 1 -- 172.21.15.156:0/175237010 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe08139200 msgr2=0x7fbe0813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:16.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.549+0000 7fbe07fff700 1 --2- 172.21.15.156:0/175237010 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe08139200 0x7fbe0813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.549+0000 7fbe07fff700 1 -- 172.21.15.156:0/175237010 >> v1:172.21.15.156:6789/0 conn(0x7fbe080a0a70 legacy=0x7fbe080a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.549+0000 7fbe07fff700 1 -- 172.21.15.156:0/175237010 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0809e6a0 con 0x7fbe080a1550 2023-09-30T22:25:16.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.549+0000 7fbe07fff700 1 --2- 172.21.15.156:0/175237010 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe080a1550 0x7fbe08138cc0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009870 tx=0x7fbdf4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a428c54b50c11e41 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:16.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.549+0000 7fbe077fe700 1 -- 172.21.15.156:0/175237010 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4011830 con 0x7fbe080a1550 2023-09-30T22:25:16.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.549+0000 7fbe077fe700 1 -- 172.21.15.156:0/175237010 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf4011990 con 0x7fbe080a1550 2023-09-30T22:25:16.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.549+0000 7fbe077fe700 1 -- 172.21.15.156:0/175237010 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4011d00 con 0x7fbe080a1550 2023-09-30T22:25:16.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.550+0000 7fbe0ed22700 1 -- 172.21.15.156:0/175237010 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe080a1550 msgr2=0x7fbe08138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.550+0000 7fbe0ed22700 1 --2- 172.21.15.156:0/175237010 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe080a1550 0x7fbe08138cc0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009870 tx=0x7fbdf4009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:16.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.550+0000 7fbe0ed22700 1 -- 172.21.15.156:0/175237010 shutdown_connections 2023-09-30T22:25:16.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.550+0000 7fbe0ed22700 1 --2- 172.21.15.156:0/175237010 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe08139200 0x7fbe0813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.550+0000 7fbe0ed22700 1 --2- 172.21.15.156:0/175237010 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe080a1550 0x7fbe08138cc0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.550+0000 7fbe0ed22700 1 -- 172.21.15.156:0/175237010 >> 172.21.15.156:0/175237010 conn(0x7fbe080a6610 msgr2=0x7fbe080a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:16.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.550+0000 7fbe0ed22700 1 -- 172.21.15.156:0/175237010 shutdown_connections 2023-09-30T22:25:16.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.550+0000 7fbe0ed22700 1 -- 172.21.15.156:0/175237010 wait complete. 2023-09-30T22:25:16.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.551+0000 7fbe0ed22700 1 Processor -- start 2023-09-30T22:25:16.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.551+0000 7fbe0ed22700 1 -- start start 2023-09-30T22:25:16.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.552+0000 7fbe0ed22700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe080a0a70 0x7fbe08138100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.552+0000 7fbe0ed22700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe080a1550 0x7fbe08138640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.552+0000 7fbe0ed22700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe08139200 0x7fbe081cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.552+0000 7fbe0ed22700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe081251c0 con 0x7fbe08139200 2023-09-30T22:25:16.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.552+0000 7fbe0ed22700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe08126440 con 0x7fbe080a0a70 2023-09-30T22:25:16.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.552+0000 7fbe0ed22700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe08127af0 con 0x7fbe080a1550 2023-09-30T22:25:16.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.552+0000 7fbe0cabe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe080a0a70 0x7fbe08138100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.552+0000 7fbe0cabe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe080a0a70 0x7fbe08138100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48534/0 (socket says 172.21.15.156:48534) 2023-09-30T22:25:16.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.552+0000 7fbe0cabe700 1 -- 172.21.15.156:0/1911976894 learned_addr learned my addr 172.21.15.156:0/1911976894 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:16.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.553+0000 7fbe0d2bf700 1 --2- 172.21.15.156:0/1911976894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe08139200 0x7fbe081cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.553+0000 7fbe0cabe700 1 -- 172.21.15.156:0/1911976894 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe080a1550 msgr2=0x7fbe08138640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.553+0000 7fbe0cabe700 1 --2- 172.21.15.156:0/1911976894 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe080a1550 0x7fbe08138640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.553+0000 7fbe0cabe700 1 -- 172.21.15.156:0/1911976894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe08139200 msgr2=0x7fbe081cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.553+0000 7fbe0cabe700 1 --2- 172.21.15.156:0/1911976894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe08139200 0x7fbe081cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.553+0000 7fbe0cabe700 1 -- 172.21.15.156:0/1911976894 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf40094a0 con 0x7fbe080a0a70 2023-09-30T22:25:16.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.553+0000 7fbe0cabe700 1 --2- 172.21.15.156:0/1911976894 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe080a0a70 0x7fbe08138100 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00c700 tx=0x7fbdfc00ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:16.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.553+0000 7fbe057fa700 1 -- 172.21.15.156:0/1911976894 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc005d70 con 0x7fbe080a0a70 2023-09-30T22:25:16.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.553+0000 7fbe057fa700 1 -- 172.21.15.156:0/1911976894 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc0070d0 con 0x7fbe080a0a70 2023-09-30T22:25:16.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.553+0000 7fbe0ed22700 1 -- 172.21.15.156:0/1911976894 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe081266b0 con 0x7fbe080a0a70 2023-09-30T22:25:16.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.553+0000 7fbe057fa700 1 -- 172.21.15.156:0/1911976894 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc007460 con 0x7fbe080a0a70 2023-09-30T22:25:16.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.553+0000 7fbe0ed22700 1 -- 172.21.15.156:0/1911976894 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe08070f90 con 0x7fbe080a0a70 2023-09-30T22:25:16.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.554+0000 7fbe0ed22700 1 -- 172.21.15.156:0/1911976894 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe08127930 con 0x7fbe080a0a70 2023-09-30T22:25:16.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.555+0000 7fbe057fa700 1 -- 172.21.15.156:0/1911976894 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbdfc0075c0 con 0x7fbe080a0a70 2023-09-30T22:25:16.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.555+0000 7fbe057fa700 1 -- 172.21.15.156:0/1911976894 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbdfc03f080 con 0x7fbe080a0a70 2023-09-30T22:25:16.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.559+0000 7fbe057fa700 1 -- 172.21.15.156:0/1911976894 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbdfc01bb10 con 0x7fbe080a0a70 2023-09-30T22:25:16.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.660+0000 7fdc88587700 1 -- 172.21.15.156:0/1548576482 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdc8006bce0 con 0x7fdc8013dd10 2023-09-30T22:25:16.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.660+0000 7fdc76ffd700 1 -- 172.21.15.156:0/1548576482 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdc780076f0 con 0x7fdc8013dd10 2023-09-30T22:25:16.660 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:16.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.663+0000 7fdc88587700 1 -- 172.21.15.156:0/1548576482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc8013dd10 msgr2=0x7fdc80122080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.663+0000 7fdc88587700 1 --2- 172.21.15.156:0/1548576482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc8013dd10 0x7fdc80122080 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fdc80099de0 tx=0x7fdc7800ef90 comp rx=0 tx=0).stop 2023-09-30T22:25:16.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.663+0000 7fdc88587700 1 -- 172.21.15.156:0/1548576482 shutdown_connections 2023-09-30T22:25:16.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.663+0000 7fdc88587700 1 --2- 172.21.15.156:0/1548576482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc8013dd10 0x7fdc80122080 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.663+0000 7fdc88587700 1 --2- 172.21.15.156:0/1548576482 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc80138040 0x7fdc80121600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.663+0000 7fdc88587700 1 --2- 172.21.15.156:0/1548576482 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc80138410 0x7fdc80121b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.663+0000 7fdc88587700 1 -- 172.21.15.156:0/1548576482 >> 172.21.15.156:0/1548576482 conn(0x7fdc800a2980 msgr2=0x7fdc8009d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:16.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.664+0000 7fdc88587700 1 -- 172.21.15.156:0/1548576482 shutdown_connections 2023-09-30T22:25:16.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.664+0000 7fdc88587700 1 -- 172.21.15.156:0/1548576482 wait complete. 2023-09-30T22:25:16.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.670+0000 7f437ad9f700 1 -- 172.21.15.156:0/1643544994 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f437404f2a0 con 0x7f4374131980 2023-09-30T22:25:16.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.671+0000 7f43717fa700 1 -- 172.21.15.156:0/1643544994 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f436c0113c0 con 0x7f4374131980 2023-09-30T22:25:16.671 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:16.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.674+0000 7f437ad9f700 1 -- 172.21.15.156:0/1643544994 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4374131980 msgr2=0x7f437411c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.674+0000 7f437ad9f700 1 --2- 172.21.15.156:0/1643544994 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4374131980 0x7f437411c390 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f436c01a000 tx=0x7f436c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.674+0000 7f437ad9f700 1 -- 172.21.15.156:0/1643544994 shutdown_connections 2023-09-30T22:25:16.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.674+0000 7f437ad9f700 1 --2- 172.21.15.156:0/1643544994 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4374131980 0x7f437411c390 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.674+0000 7f437ad9f700 1 --2- 172.21.15.156:0/1643544994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f437409bc70 0x7f437411b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.674+0000 7f437ad9f700 1 --2- 172.21.15.156:0/1643544994 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f437409c5c0 0x7f437411be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.674+0000 7f437ad9f700 1 -- 172.21.15.156:0/1643544994 >> 172.21.15.156:0/1643544994 conn(0x7f43740a2980 msgr2=0x7f437406ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:16.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.674+0000 7f437ad9f700 1 -- 172.21.15.156:0/1643544994 shutdown_connections 2023-09-30T22:25:16.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.674+0000 7f437ad9f700 1 -- 172.21.15.156:0/1643544994 wait complete. 2023-09-30T22:25:16.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:16.691 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:16.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.765+0000 7fb7d1352700 1 -- 172.21.15.156:0/2629520983 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb7cc125d50 con 0x7fb7cc1304a0 2023-09-30T22:25:16.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.766+0000 7fb7b37fe700 1 -- 172.21.15.156:0/2629520983 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb7c4007330 con 0x7fb7cc1304a0 2023-09-30T22:25:16.765 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:16.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.768+0000 7fb7d1352700 1 -- 172.21.15.156:0/2629520983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7cc1304a0 msgr2=0x7fb7cc1c83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.768+0000 7fb7d1352700 1 --2- 172.21.15.156:0/2629520983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7cc1304a0 0x7fb7cc1c83e0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fb7c400efc0 tx=0x7fb7c400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.768+0000 7fb7d1352700 1 -- 172.21.15.156:0/2629520983 shutdown_connections 2023-09-30T22:25:16.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.768+0000 7fb7d1352700 1 --2- 172.21.15.156:0/2629520983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7cc1304a0 0x7fb7cc1c83e0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.768+0000 7fb7d1352700 1 --2- 172.21.15.156:0/2629520983 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7cc0a0a30 0x7fb7cc1c5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.768+0000 7fb7d1352700 1 --2- 172.21.15.156:0/2629520983 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb7cc0a1340 0x7fb7cc1c5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.768+0000 7fb7d1352700 1 -- 172.21.15.156:0/2629520983 >> 172.21.15.156:0/2629520983 conn(0x7fb7cc0a2980 msgr2=0x7fb7cc09deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:16.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.768+0000 7fb7d1352700 1 -- 172.21.15.156:0/2629520983 shutdown_connections 2023-09-30T22:25:16.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.768+0000 7fb7d1352700 1 -- 172.21.15.156:0/2629520983 wait complete. 2023-09-30T22:25:16.779 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:16.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.780+0000 7fbe0ed22700 1 -- 172.21.15.156:0/1911976894 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbe0809ea80 con 0x7fbe080a0a70 2023-09-30T22:25:16.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.781+0000 7fbe057fa700 1 -- 172.21.15.156:0/1911976894 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbdfc017030 con 0x7fbe080a0a70 2023-09-30T22:25:16.780 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:16.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.783+0000 7fbe0ed22700 1 -- 172.21.15.156:0/1911976894 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe080a0a70 msgr2=0x7fbe08138100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.783+0000 7fbe0ed22700 1 --2- 172.21.15.156:0/1911976894 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe080a0a70 0x7fbe08138100 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00c700 tx=0x7fbdfc00ca10 comp rx=0 tx=0).stop 2023-09-30T22:25:16.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.783+0000 7fbe0ed22700 1 -- 172.21.15.156:0/1911976894 shutdown_connections 2023-09-30T22:25:16.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.783+0000 7fbe0ed22700 1 --2- 172.21.15.156:0/1911976894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe08139200 0x7fbe081cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.783+0000 7fbe0ed22700 1 --2- 172.21.15.156:0/1911976894 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe080a0a70 0x7fbe08138100 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.783+0000 7fbe0ed22700 1 --2- 172.21.15.156:0/1911976894 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe080a1550 0x7fbe08138640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.783+0000 7fbe0ed22700 1 -- 172.21.15.156:0/1911976894 >> 172.21.15.156:0/1911976894 conn(0x7fbe080a6610 msgr2=0x7fbe0809a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:16.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.783+0000 7fbe0ed22700 1 -- 172.21.15.156:0/1911976894 shutdown_connections 2023-09-30T22:25:16.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:16.783+0000 7fbe0ed22700 1 -- 172.21.15.156:0/1911976894 wait complete. 2023-09-30T22:25:16.794 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:17.677 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:17.691 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:17.780 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:17.795 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:17.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.818+0000 7f633d0d7700 1 Processor -- start 2023-09-30T22:25:17.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.818+0000 7f633d0d7700 1 -- start start 2023-09-30T22:25:17.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.819+0000 7f633d0d7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f633812d380 0x7f633812d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.819+0000 7f633d0d7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6338099a60 0x7f6338099e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.819+0000 7f633d0d7700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f633809bb90 con 0x7f633809a3d0 2023-09-30T22:25:17.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.819+0000 7f633d0d7700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633809c210 con 0x7f6338099a60 2023-09-30T22:25:17.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.819+0000 7f633d0d7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f633809ced0 con 0x7f633812d380 2023-09-30T22:25:17.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.819+0000 7f633659c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6338099a60 0x7f6338099e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.819+0000 7f6336d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f633812d380 0x7f633812d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.819+0000 7f633759e700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f633809a3d0 0x7f6338137610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:41670/0 (socket says 172.21.15.156:41670) 2023-09-30T22:25:17.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.819+0000 7f633659c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6338099a60 0x7f6338099e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48622/0 (socket says 172.21.15.156:48622) 2023-09-30T22:25:17.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.819+0000 7f633759e700 1 -- 172.21.15.156:0/681773952 learned_addr learned my addr 172.21.15.156:0/681773952 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:17.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.820+0000 7f6336d9d700 1 -- 172.21.15.156:0/681773952 >> v2:172.21.15.156:3300/0 conn(0x7f6338099a60 msgr2=0x7f6338099e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:17.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.820+0000 7f6336d9d700 1 --2- 172.21.15.156:0/681773952 >> v2:172.21.15.156:3300/0 conn(0x7f6338099a60 0x7f6338099e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.820+0000 7f6336d9d700 1 -- 172.21.15.156:0/681773952 >> v1:172.21.15.156:6789/0 conn(0x7f633809a3d0 legacy=0x7f6338137610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.820+0000 7f6336d9d700 1 -- 172.21.15.156:0/681773952 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633809ac30 con 0x7f633812d380 2023-09-30T22:25:17.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.820+0000 7f6336d9d700 1 --2- 172.21.15.156:0/681773952 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f633812d380 0x7f633812d750 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f632800b8d0 tx=0x7f632800bbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f813eae3e71d919 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:17.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.820+0000 7f6335d9b700 1 -- 172.21.15.156:0/681773952 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6328005e30 con 0x7f633812d380 2023-09-30T22:25:17.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.820+0000 7f6335d9b700 1 -- 172.21.15.156:0/681773952 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632800c5e0 con 0x7f633812d380 2023-09-30T22:25:17.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.820+0000 7f6335d9b700 1 -- 172.21.15.156:0/681773952 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632800c990 con 0x7f633812d380 2023-09-30T22:25:17.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.821+0000 7f633d0d7700 1 -- 172.21.15.156:0/681773952 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f633812d380 msgr2=0x7f633812d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.821+0000 7f633d0d7700 1 --2- 172.21.15.156:0/681773952 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f633812d380 0x7f633812d750 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f632800b8d0 tx=0x7f632800bbe0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.821+0000 7f633d0d7700 1 -- 172.21.15.156:0/681773952 shutdown_connections 2023-09-30T22:25:17.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.821+0000 7f633d0d7700 1 --2- 172.21.15.156:0/681773952 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f633812d380 0x7f633812d750 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.821+0000 7f633d0d7700 1 --2- 172.21.15.156:0/681773952 >> v2:172.21.15.156:3300/0 conn(0x7f6338099a60 0x7f6338099e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.821+0000 7f633d0d7700 1 -- 172.21.15.156:0/681773952 >> 172.21.15.156:0/681773952 conn(0x7f63380a2980 msgr2=0x7f63380a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:17.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.821+0000 7f633d0d7700 1 -- 172.21.15.156:0/681773952 shutdown_connections 2023-09-30T22:25:17.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.821+0000 7f633d0d7700 1 -- 172.21.15.156:0/681773952 wait complete. 2023-09-30T22:25:17.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.823+0000 7f633d0d7700 1 Processor -- start 2023-09-30T22:25:17.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.823+0000 7f633d0d7700 1 -- start start 2023-09-30T22:25:17.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.823+0000 7f633d0d7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6338099a60 0x7f633811aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.823+0000 7f633d0d7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f633809a3d0 0x7f633811b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.823+0000 7f633d0d7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f633812d380 0x7f633811b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.823+0000 7f633d0d7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633811e290 con 0x7f633812d380 2023-09-30T22:25:17.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.823+0000 7f633d0d7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633811cf30 con 0x7f6338099a60 2023-09-30T22:25:17.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.823+0000 7f633d0d7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63380a1330 con 0x7f633809a3d0 2023-09-30T22:25:17.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.823+0000 7f633759e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f633812d380 0x7f633811b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.823+0000 7f633659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f633809a3d0 0x7f633811b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.823+0000 7f633759e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f633812d380 0x7f633811b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48632/0 (socket says 172.21.15.156:48632) 2023-09-30T22:25:17.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.823+0000 7f633759e700 1 -- 172.21.15.156:0/2191813678 learned_addr learned my addr 172.21.15.156:0/2191813678 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:17.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.824+0000 7f6336d9d700 1 --2- 172.21.15.156:0/2191813678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6338099a60 0x7f633811aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.824+0000 7f633659c700 1 -- 172.21.15.156:0/2191813678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6338099a60 msgr2=0x7f633811aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.824+0000 7f633659c700 1 --2- 172.21.15.156:0/2191813678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6338099a60 0x7f633811aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.824+0000 7f633659c700 1 -- 172.21.15.156:0/2191813678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f633812d380 msgr2=0x7f633811b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.824+0000 7f633659c700 1 --2- 172.21.15.156:0/2191813678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f633812d380 0x7f633811b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.824+0000 7f633659c700 1 -- 172.21.15.156:0/2191813678 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632800b4e0 con 0x7f633809a3d0 2023-09-30T22:25:17.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.824+0000 7f6336d9d700 1 --2- 172.21.15.156:0/2191813678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6338099a60 0x7f633811aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:17.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.824+0000 7f633659c700 1 --2- 172.21.15.156:0/2191813678 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f633809a3d0 0x7f633811b030 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f632c012ad0 tx=0x7f632c012de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:17.826 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.824+0000 7f631f7fe700 1 -- 172.21.15.156:0/2191813678 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c010870 con 0x7f633809a3d0 2023-09-30T22:25:17.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.824+0000 7f631f7fe700 1 -- 172.21.15.156:0/2191813678 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632c013040 con 0x7f633809a3d0 2023-09-30T22:25:17.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.824+0000 7f631f7fe700 1 -- 172.21.15.156:0/2191813678 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c010bd0 con 0x7f633809a3d0 2023-09-30T22:25:17.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.824+0000 7f633d0d7700 1 -- 172.21.15.156:0/2191813678 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633811cc10 con 0x7f633809a3d0 2023-09-30T22:25:17.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.824+0000 7f633d0d7700 1 -- 172.21.15.156:0/2191813678 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f633809b430 con 0x7f633809a3d0 2023-09-30T22:25:17.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.825+0000 7f631f7fe700 1 -- 172.21.15.156:0/2191813678 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f632c010d30 con 0x7f633809a3d0 2023-09-30T22:25:17.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.825+0000 7f633d0d7700 1 -- 172.21.15.156:0/2191813678 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f633811ddc0 con 0x7f633809a3d0 2023-09-30T22:25:17.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.825+0000 7f631f7fe700 1 -- 172.21.15.156:0/2191813678 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f632c043420 con 0x7f633809a3d0 2023-09-30T22:25:17.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.831+0000 7f631f7fe700 1 -- 172.21.15.156:0/2191813678 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f632c016750 con 0x7f633809a3d0 2023-09-30T22:25:17.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.859+0000 7fcebce0c700 1 Processor -- start 2023-09-30T22:25:17.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.859+0000 7fcebce0c700 1 -- start start 2023-09-30T22:25:17.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.859+0000 7fcebce0c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fceb8131980 0x7fceb8131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.859+0000 7fcebce0c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fceb809bc70 0x7fceb809c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.860+0000 7fcebce0c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fceb809c5c0 0x7fceb8138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.860+0000 7fcebce0c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb806eb30 con 0x7fceb809bc70 2023-09-30T22:25:17.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.860+0000 7fcebce0c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb80a1640 con 0x7fceb809c5c0 2023-09-30T22:25:17.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.860+0000 7fcebce0c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fceb80a22d0 con 0x7fceb8131980 2023-09-30T22:25:17.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.860+0000 7fceb659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fceb8131980 0x7fceb8131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.860+0000 7fceb659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fceb8131980 0x7fceb8131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53596/0 (socket says 172.21.15.156:53596) 2023-09-30T22:25:17.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.860+0000 7fceb659c700 1 -- 172.21.15.156:0/980377738 learned_addr learned my addr 172.21.15.156:0/980377738 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:17.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.860+0000 7fceb5d9b700 1 --2- 172.21.15.156:0/980377738 >> v2:172.21.15.156:3300/0 conn(0x7fceb809bc70 0x7fceb809c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.860+0000 7fceb6d9d700 1 --2- 172.21.15.156:0/980377738 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fceb809c5c0 0x7fceb8138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.860+0000 7fceb5d9b700 1 -- 172.21.15.156:0/980377738 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fceb8131980 msgr2=0x7fceb8131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:17.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.860+0000 7fceb5d9b700 1 --2- 172.21.15.156:0/980377738 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fceb8131980 0x7fceb8131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.860+0000 7fceb5d9b700 1 -- 172.21.15.156:0/980377738 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fceb809c5c0 msgr2=0x7fceb8138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:17.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.860+0000 7fceb5d9b700 1 --2- 172.21.15.156:0/980377738 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fceb809c5c0 0x7fceb8138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.860+0000 7fceb5d9b700 1 -- 172.21.15.156:0/980377738 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb8131550 con 0x7fceb809bc70 2023-09-30T22:25:17.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.860+0000 7fceb5d9b700 1 --2- 172.21.15.156:0/980377738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fceb809bc70 0x7fceb809c080 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7fceac009870 tx=0x7fceac009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb6c3f7111c9de server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:17.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.861+0000 7fceb559a700 1 -- 172.21.15.156:0/980377738 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac011830 con 0x7fceb809bc70 2023-09-30T22:25:17.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.861+0000 7fceb559a700 1 -- 172.21.15.156:0/980377738 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac011990 con 0x7fceb809bc70 2023-09-30T22:25:17.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.861+0000 7fceb559a700 1 -- 172.21.15.156:0/980377738 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac011d20 con 0x7fceb809bc70 2023-09-30T22:25:17.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.861+0000 7fcebce0c700 1 -- 172.21.15.156:0/980377738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fceb809bc70 msgr2=0x7fceb809c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.861+0000 7fcebce0c700 1 --2- 172.21.15.156:0/980377738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fceb809bc70 0x7fceb809c080 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7fceac009870 tx=0x7fceac009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:17.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.861+0000 7fcebce0c700 1 -- 172.21.15.156:0/980377738 shutdown_connections 2023-09-30T22:25:17.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.861+0000 7fcebce0c700 1 --2- 172.21.15.156:0/980377738 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fceb809c5c0 0x7fceb8138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.861+0000 7fcebce0c700 1 --2- 172.21.15.156:0/980377738 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fceb8131980 0x7fceb8131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.861+0000 7fcebce0c700 1 --2- 172.21.15.156:0/980377738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fceb809bc70 0x7fceb809c080 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.861+0000 7fcebce0c700 1 -- 172.21.15.156:0/980377738 >> 172.21.15.156:0/980377738 conn(0x7fceb80a2980 msgr2=0x7fceb80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:17.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.862+0000 7fcebce0c700 1 -- 172.21.15.156:0/980377738 shutdown_connections 2023-09-30T22:25:17.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.862+0000 7fcebce0c700 1 -- 172.21.15.156:0/980377738 wait complete. 2023-09-30T22:25:17.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.863+0000 7fcebce0c700 1 Processor -- start 2023-09-30T22:25:17.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.863+0000 7fcebce0c700 1 -- start start 2023-09-30T22:25:17.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.863+0000 7fcebce0c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fceb809bc70 0x7fceb811ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.863+0000 7fcebce0c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fceb809c5c0 0x7fceb811f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.863+0000 7fcebce0c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fceb8131980 0x7fceb811fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.863+0000 7fcebce0c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb8122500 con 0x7fceb809c5c0 2023-09-30T22:25:17.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.863+0000 7fcebce0c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb81228a0 con 0x7fceb8131980 2023-09-30T22:25:17.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.863+0000 7fcebce0c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fceb8120b90 con 0x7fceb809bc70 2023-09-30T22:25:17.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.863+0000 7fceb659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fceb809bc70 0x7fceb811ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.863+0000 7fceb659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fceb809bc70 0x7fceb811ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53600/0 (socket says 172.21.15.156:53600) 2023-09-30T22:25:17.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.863+0000 7fceb659c700 1 -- 172.21.15.156:0/3852327911 learned_addr learned my addr 172.21.15.156:0/3852327911 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:17.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.863+0000 7fceb5d9b700 1 --2- 172.21.15.156:0/3852327911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fceb809c5c0 0x7fceb811f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.863+0000 7fceb6d9d700 1 --2- 172.21.15.156:0/3852327911 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fceb8131980 0x7fceb811fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.864+0000 7fceb5d9b700 1 -- 172.21.15.156:0/3852327911 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fceb809bc70 msgr2=0x7fceb811ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.864+0000 7fceb5d9b700 1 --2- 172.21.15.156:0/3852327911 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fceb809bc70 0x7fceb811ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.864+0000 7fceb5d9b700 1 -- 172.21.15.156:0/3852327911 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fceb8131980 msgr2=0x7fceb811fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.864+0000 7fceb5d9b700 1 --2- 172.21.15.156:0/3852327911 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fceb8131980 0x7fceb811fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.864+0000 7fceb5d9b700 1 -- 172.21.15.156:0/3852327911 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac0094a0 con 0x7fceb809c5c0 2023-09-30T22:25:17.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.864+0000 7fceb5d9b700 1 --2- 172.21.15.156:0/3852327911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fceb809c5c0 0x7fceb811f4c0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fceac016000 tx=0x7fceac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:17.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.864+0000 7fcea6ffd700 1 -- 172.21.15.156:0/3852327911 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac004240 con 0x7fceb809c5c0 2023-09-30T22:25:17.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.864+0000 7fcea6ffd700 1 -- 172.21.15.156:0/3852327911 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac01f070 con 0x7fceb809c5c0 2023-09-30T22:25:17.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.864+0000 7fcebce0c700 1 -- 172.21.15.156:0/3852327911 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb80a1c40 con 0x7fceb809c5c0 2023-09-30T22:25:17.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.864+0000 7fcea6ffd700 1 -- 172.21.15.156:0/3852327911 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac0045a0 con 0x7fceb809c5c0 2023-09-30T22:25:17.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.864+0000 7fcebce0c700 1 -- 172.21.15.156:0/3852327911 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb8123340 con 0x7fceb809c5c0 2023-09-30T22:25:17.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.865+0000 7fcea6ffd700 1 -- 172.21.15.156:0/3852327911 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fceac021030 con 0x7fceb809c5c0 2023-09-30T22:25:17.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.865+0000 7fcea6ffd700 1 -- 172.21.15.156:0/3852327911 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fceac040530 con 0x7fceb809c5c0 2023-09-30T22:25:17.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.865+0000 7fcebce0c700 1 -- 172.21.15.156:0/3852327911 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb812deb0 con 0x7fceb809c5c0 2023-09-30T22:25:17.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.875+0000 7fcea6ffd700 1 -- 172.21.15.156:0/3852327911 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fceac01a450 con 0x7fceb809c5c0 2023-09-30T22:25:17.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.913+0000 7fa29afab700 1 Processor -- start 2023-09-30T22:25:17.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.913+0000 7fa29afab700 1 -- start start 2023-09-30T22:25:17.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.914+0000 7fa29afab700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa29409e870 0x7fa29409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.914+0000 7fa29afab700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa29409f180 0x7fa294131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.914+0000 7fa29afab700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa294131d70 0x7fa294132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.914+0000 7fa29afab700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2940a0920 con 0x7fa29409f180 2023-09-30T22:25:17.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.914+0000 7fa29afab700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29409c970 con 0x7fa29409e870 2023-09-30T22:25:17.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.914+0000 7fa29afab700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa29409bab0 con 0x7fa294131d70 2023-09-30T22:25:17.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.914+0000 7fa298d47700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa29409e870 0x7fa29409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.914+0000 7fa298d47700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa29409e870 0x7fa29409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48570/0 (socket says 172.21.15.156:48570) 2023-09-30T22:25:17.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.914+0000 7fa298d47700 1 -- 172.21.15.156:0/2631224596 learned_addr learned my addr 172.21.15.156:0/2631224596 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:17.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.914+0000 7fa299548700 1 --2- 172.21.15.156:0/2631224596 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa294131d70 0x7fa294132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.914+0000 7fa293fff700 1 --2- 172.21.15.156:0/2631224596 >> v2:172.21.15.156:3300/0 conn(0x7fa29409f180 0x7fa294131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.914+0000 7fa299548700 1 -- 172.21.15.156:0/2631224596 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa29409e870 msgr2=0x7fa29409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:17.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.914+0000 7fa299548700 1 --2- 172.21.15.156:0/2631224596 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa29409e870 0x7fa29409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.914+0000 7fa299548700 1 -- 172.21.15.156:0/2631224596 >> v2:172.21.15.156:3300/0 conn(0x7fa29409f180 msgr2=0x7fa294131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:17.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.914+0000 7fa299548700 1 --2- 172.21.15.156:0/2631224596 >> v2:172.21.15.156:3300/0 conn(0x7fa29409f180 0x7fa294131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.915+0000 7fa299548700 1 -- 172.21.15.156:0/2631224596 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29409f9c0 con 0x7fa294131d70 2023-09-30T22:25:17.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.915+0000 7fa299548700 1 --2- 172.21.15.156:0/2631224596 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa294131d70 0x7fa294132210 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa28c009d90 tx=0x7fa28c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a480b095e79241a4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:17.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.915+0000 7fa2937fe700 1 -- 172.21.15.156:0/2631224596 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c00bd20 con 0x7fa294131d70 2023-09-30T22:25:17.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.915+0000 7fa2937fe700 1 -- 172.21.15.156:0/2631224596 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c00be80 con 0x7fa294131d70 2023-09-30T22:25:17.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.915+0000 7fa2937fe700 1 -- 172.21.15.156:0/2631224596 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c010710 con 0x7fa294131d70 2023-09-30T22:25:17.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.916+0000 7fa29afab700 1 -- 172.21.15.156:0/2631224596 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa294131d70 msgr2=0x7fa294132210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.916+0000 7fa29afab700 1 --2- 172.21.15.156:0/2631224596 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa294131d70 0x7fa294132210 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa28c009d90 tx=0x7fa28c00b330 comp rx=0 tx=0).stop 2023-09-30T22:25:17.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.916+0000 7fa29afab700 1 -- 172.21.15.156:0/2631224596 shutdown_connections 2023-09-30T22:25:17.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.916+0000 7fa29afab700 1 --2- 172.21.15.156:0/2631224596 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa294131d70 0x7fa294132210 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.916+0000 7fa29afab700 1 --2- 172.21.15.156:0/2631224596 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa29409e870 0x7fa29409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.916+0000 7fa29afab700 1 --2- 172.21.15.156:0/2631224596 >> v2:172.21.15.156:3300/0 conn(0x7fa29409f180 0x7fa294131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.916+0000 7fa29afab700 1 -- 172.21.15.156:0/2631224596 >> 172.21.15.156:0/2631224596 conn(0x7fa2940a4430 msgr2=0x7fa2940a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:17.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.916+0000 7fa29afab700 1 -- 172.21.15.156:0/2631224596 shutdown_connections 2023-09-30T22:25:17.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.916+0000 7fa29afab700 1 -- 172.21.15.156:0/2631224596 wait complete. 2023-09-30T22:25:17.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.917+0000 7fa29afab700 1 Processor -- start 2023-09-30T22:25:17.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.917+0000 7fa29afab700 1 -- start start 2023-09-30T22:25:17.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.918+0000 7fa29afab700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa29409e870 0x7fa29411b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.918+0000 7fa29afab700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa29409f180 0x7fa29411b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.918+0000 7fa29afab700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa294131d70 0x7fa29411bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.918+0000 7fa29afab700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29411c640 con 0x7fa29409f180 2023-09-30T22:25:17.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.918+0000 7fa29afab700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29412e560 con 0x7fa294131d70 2023-09-30T22:25:17.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.918+0000 7fa29afab700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa29411d3a0 con 0x7fa29409e870 2023-09-30T22:25:17.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.918+0000 7fa298d47700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa29409e870 0x7fa29411b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.918+0000 7fa298d47700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa29409e870 0x7fa29411b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53612/0 (socket says 172.21.15.156:53612) 2023-09-30T22:25:17.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.918+0000 7fa298d47700 1 -- 172.21.15.156:0/2398450390 learned_addr learned my addr 172.21.15.156:0/2398450390 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:17.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.918+0000 7fa299548700 1 --2- 172.21.15.156:0/2398450390 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa294131d70 0x7fa29411bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.918+0000 7fa293fff700 1 --2- 172.21.15.156:0/2398450390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa29409f180 0x7fa29411b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.918+0000 7fa298d47700 1 -- 172.21.15.156:0/2398450390 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa294131d70 msgr2=0x7fa29411bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.918+0000 7fa298d47700 1 --2- 172.21.15.156:0/2398450390 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa294131d70 0x7fa29411bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.918+0000 7fa298d47700 1 -- 172.21.15.156:0/2398450390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa29409f180 msgr2=0x7fa29411b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.918+0000 7fa298d47700 1 --2- 172.21.15.156:0/2398450390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa29409f180 0x7fa29411b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.918+0000 7fa298d47700 1 -- 172.21.15.156:0/2398450390 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28c009a70 con 0x7fa29409e870 2023-09-30T22:25:17.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.918+0000 7fa293fff700 1 --2- 172.21.15.156:0/2398450390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa29409f180 0x7fa29411b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:17.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.919+0000 7fa298d47700 1 --2- 172.21.15.156:0/2398450390 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa29409e870 0x7fa29411b170 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fa28800e990 tx=0x7fa28800ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:17.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.919+0000 7fa2917fa700 1 -- 172.21.15.156:0/2398450390 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28800c850 con 0x7fa29409e870 2023-09-30T22:25:17.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.919+0000 7fa2917fa700 1 -- 172.21.15.156:0/2398450390 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28800c9b0 con 0x7fa29409e870 2023-09-30T22:25:17.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.919+0000 7fa29afab700 1 -- 172.21.15.156:0/2398450390 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29411dfd0 con 0x7fa29409e870 2023-09-30T22:25:17.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.919+0000 7fa2917fa700 1 -- 172.21.15.156:0/2398450390 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28800cd20 con 0x7fa29409e870 2023-09-30T22:25:17.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.919+0000 7fa29afab700 1 -- 172.21.15.156:0/2398450390 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2940a2a80 con 0x7fa29409e870 2023-09-30T22:25:17.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.920+0000 7fa2917fa700 1 -- 172.21.15.156:0/2398450390 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa288013470 con 0x7fa29409e870 2023-09-30T22:25:17.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.920+0000 7fa29afab700 1 -- 172.21.15.156:0/2398450390 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29404f2a0 con 0x7fa29409e870 2023-09-30T22:25:17.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.920+0000 7fa2917fa700 1 -- 172.21.15.156:0/2398450390 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa28803f7b0 con 0x7fa29409e870 2023-09-30T22:25:17.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.929+0000 7fa2917fa700 1 -- 172.21.15.156:0/2398450390 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa288013720 con 0x7fa29409e870 2023-09-30T22:25:17.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.953+0000 7f98c9536700 1 Processor -- start 2023-09-30T22:25:17.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.953+0000 7f98c9536700 1 -- start start 2023-09-30T22:25:17.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.953+0000 7f98c9536700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98c40a1510 0x7f98c41351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.953+0000 7f98c9536700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f98c41356e0 0x7f98c4137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.953+0000 7f98c9536700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c40a1e70 con 0x7f98c40a0a30 2023-09-30T22:25:17.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.953+0000 7f98c9536700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c409a720 con 0x7f98c41356e0 2023-09-30T22:25:17.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.953+0000 7f98c9536700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98c409b300 con 0x7f98c40a1510 2023-09-30T22:25:17.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.954+0000 7f98c27fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98c40a1510 0x7f98c41351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.954+0000 7f98c27fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98c40a1510 0x7f98c41351a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53622/0 (socket says 172.21.15.156:53622) 2023-09-30T22:25:17.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.954+0000 7f98c27fc700 1 -- 172.21.15.156:0/3804317703 learned_addr learned my addr 172.21.15.156:0/3804317703 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:17.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.954+0000 7f98c2ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f98c40a0a30 0x7f98c40a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:41682/0 (socket says 172.21.15.156:41682) 2023-09-30T22:25:17.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.954+0000 7f98c37fe700 1 --2- 172.21.15.156:0/3804317703 >> v2:172.21.15.156:3300/0 conn(0x7f98c41356e0 0x7f98c4137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.954+0000 7f98c27fc700 1 -- 172.21.15.156:0/3804317703 >> v2:172.21.15.156:3300/0 conn(0x7f98c41356e0 msgr2=0x7f98c4137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:17.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.954+0000 7f98c27fc700 1 --2- 172.21.15.156:0/3804317703 >> v2:172.21.15.156:3300/0 conn(0x7f98c41356e0 0x7f98c4137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.954+0000 7f98c27fc700 1 -- 172.21.15.156:0/3804317703 >> v1:172.21.15.156:6789/0 conn(0x7f98c40a0a30 legacy=0x7f98c40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.954+0000 7f98c27fc700 1 -- 172.21.15.156:0/3804317703 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c409abc0 con 0x7f98c40a1510 2023-09-30T22:25:17.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.954+0000 7f98c37fe700 1 --2- 172.21.15.156:0/3804317703 >> v2:172.21.15.156:3300/0 conn(0x7f98c41356e0 0x7f98c4137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:17.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.954+0000 7f98c27fc700 1 --2- 172.21.15.156:0/3804317703 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98c40a1510 0x7f98c41351a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f98b80098f0 tx=0x7f98b8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c020fb886a42a2e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:17.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.954+0000 7f98c1ffb700 1 -- 172.21.15.156:0/3804317703 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b8004230 con 0x7f98c40a1510 2023-09-30T22:25:17.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.954+0000 7f98c1ffb700 1 -- 172.21.15.156:0/3804317703 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b8004390 con 0x7f98c40a1510 2023-09-30T22:25:17.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.954+0000 7f98c1ffb700 1 -- 172.21.15.156:0/3804317703 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b80036a0 con 0x7f98c40a1510 2023-09-30T22:25:17.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.955+0000 7f98c9536700 1 -- 172.21.15.156:0/3804317703 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98c40a1510 msgr2=0x7f98c41351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.955+0000 7f98c9536700 1 --2- 172.21.15.156:0/3804317703 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98c40a1510 0x7f98c41351a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f98b80098f0 tx=0x7f98b8009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:17.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.955+0000 7f98c9536700 1 -- 172.21.15.156:0/3804317703 shutdown_connections 2023-09-30T22:25:17.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.955+0000 7f98c9536700 1 --2- 172.21.15.156:0/3804317703 >> v2:172.21.15.156:3300/0 conn(0x7f98c41356e0 0x7f98c4137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.955+0000 7f98c9536700 1 --2- 172.21.15.156:0/3804317703 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98c40a1510 0x7f98c41351a0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.955+0000 7f98c9536700 1 -- 172.21.15.156:0/3804317703 >> 172.21.15.156:0/3804317703 conn(0x7f98c40a2980 msgr2=0x7f98c40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:17.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.955+0000 7f98c9536700 1 -- 172.21.15.156:0/3804317703 shutdown_connections 2023-09-30T22:25:17.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.955+0000 7f98c9536700 1 -- 172.21.15.156:0/3804317703 wait complete. 2023-09-30T22:25:17.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.957+0000 7f98c9536700 1 Processor -- start 2023-09-30T22:25:17.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.957+0000 7f98c9536700 1 -- start start 2023-09-30T22:25:17.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.957+0000 7f98c9536700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98c40a0a30 0x7f98c411f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.957+0000 7f98c9536700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98c40a1510 0x7f98c411f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.960 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.957+0000 7f98c9536700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98c41356e0 0x7f98c411fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.957+0000 7f98c9536700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c4121330 con 0x7f98c41356e0 2023-09-30T22:25:17.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.957+0000 7f98c9536700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c409ae70 con 0x7f98c40a0a30 2023-09-30T22:25:17.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.957+0000 7f98c9536700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98c409fec0 con 0x7f98c40a1510 2023-09-30T22:25:17.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.958+0000 7f98c27fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98c40a1510 0x7f98c411f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.958+0000 7f98c27fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98c40a1510 0x7f98c411f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53632/0 (socket says 172.21.15.156:53632) 2023-09-30T22:25:17.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.958+0000 7f98c27fc700 1 -- 172.21.15.156:0/1423225782 learned_addr learned my addr 172.21.15.156:0/1423225782 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:17.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.958+0000 7f98c2ffd700 1 --2- 172.21.15.156:0/1423225782 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98c40a0a30 0x7f98c411f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.958+0000 7f98c37fe700 1 --2- 172.21.15.156:0/1423225782 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98c41356e0 0x7f98c411fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.958+0000 7f98c27fc700 1 -- 172.21.15.156:0/1423225782 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98c40a0a30 msgr2=0x7f98c411f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.958+0000 7f98c27fc700 1 --2- 172.21.15.156:0/1423225782 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98c40a0a30 0x7f98c411f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.958+0000 7f98c27fc700 1 -- 172.21.15.156:0/1423225782 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98c41356e0 msgr2=0x7f98c411fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.958+0000 7f98c27fc700 1 --2- 172.21.15.156:0/1423225782 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98c41356e0 0x7f98c411fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.958+0000 7f98c27fc700 1 -- 172.21.15.156:0/1423225782 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98bc009a70 con 0x7f98c40a1510 2023-09-30T22:25:17.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.958+0000 7f98c37fe700 1 --2- 172.21.15.156:0/1423225782 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98c41356e0 0x7f98c411fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:17.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.958+0000 7f98c2ffd700 1 --2- 172.21.15.156:0/1423225782 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98c40a0a30 0x7f98c411f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:17.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.958+0000 7f98c27fc700 1 --2- 172.21.15.156:0/1423225782 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98c40a1510 0x7f98c411f6d0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f98b8009130 tx=0x7f98b8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:17.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.958+0000 7f98ab7fe700 1 -- 172.21.15.156:0/1423225782 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b8011830 con 0x7f98c40a1510 2023-09-30T22:25:17.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.958+0000 7f98ab7fe700 1 -- 172.21.15.156:0/1423225782 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b80119b0 con 0x7f98c40a1510 2023-09-30T22:25:17.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.958+0000 7f98c9536700 1 -- 172.21.15.156:0/1423225782 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b8009550 con 0x7f98c40a1510 2023-09-30T22:25:17.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.958+0000 7f98ab7fe700 1 -- 172.21.15.156:0/1423225782 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b8011d60 con 0x7f98c40a1510 2023-09-30T22:25:17.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.958+0000 7f98c9536700 1 -- 172.21.15.156:0/1423225782 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c41223b0 con 0x7f98c40a1510 2023-09-30T22:25:17.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.960+0000 7f98c9536700 1 -- 172.21.15.156:0/1423225782 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c4074f10 con 0x7f98c40a1510 2023-09-30T22:25:17.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.960+0000 7f98ab7fe700 1 -- 172.21.15.156:0/1423225782 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f98b8022070 con 0x7f98c40a1510 2023-09-30T22:25:17.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.961+0000 7f98ab7fe700 1 -- 172.21.15.156:0/1423225782 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f98b8041390 con 0x7f98c40a1510 2023-09-30T22:25:17.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:17.964+0000 7f98ab7fe700 1 -- 172.21.15.156:0/1423225782 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f98b8003e40 con 0x7f98c40a1510 2023-09-30T22:25:18.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.040+0000 7f633d0d7700 1 -- 172.21.15.156:0/2191813678 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f633804f2a0 con 0x7f633809a3d0 2023-09-30T22:25:18.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.040+0000 7f631f7fe700 1 -- 172.21.15.156:0/2191813678 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f632c020370 con 0x7f633809a3d0 2023-09-30T22:25:18.040 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:18.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.042+0000 7f633d0d7700 1 -- 172.21.15.156:0/2191813678 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f633809a3d0 msgr2=0x7f633811b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:18.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.042+0000 7f633d0d7700 1 --2- 172.21.15.156:0/2191813678 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f633809a3d0 0x7f633811b030 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f632c012ad0 tx=0x7f632c012de0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.042+0000 7f633d0d7700 1 -- 172.21.15.156:0/2191813678 shutdown_connections 2023-09-30T22:25:18.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.042+0000 7f633d0d7700 1 --2- 172.21.15.156:0/2191813678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f633812d380 0x7f633811b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.042+0000 7f633d0d7700 1 --2- 172.21.15.156:0/2191813678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6338099a60 0x7f633811aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.042+0000 7f633d0d7700 1 --2- 172.21.15.156:0/2191813678 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f633809a3d0 0x7f633811b030 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.042+0000 7f633d0d7700 1 -- 172.21.15.156:0/2191813678 >> 172.21.15.156:0/2191813678 conn(0x7f63380a2980 msgr2=0x7f633809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:18.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.043+0000 7f633d0d7700 1 -- 172.21.15.156:0/2191813678 shutdown_connections 2023-09-30T22:25:18.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.043+0000 7f633d0d7700 1 -- 172.21.15.156:0/2191813678 wait complete. 2023-09-30T22:25:18.055 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:18.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.093+0000 7fcebce0c700 1 -- 172.21.15.156:0/3852327911 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fceb804f2a0 con 0x7fceb809c5c0 2023-09-30T22:25:18.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.093+0000 7fcea6ffd700 1 -- 172.21.15.156:0/3852327911 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fceac015030 con 0x7fceb809c5c0 2023-09-30T22:25:18.093 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:18.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.095+0000 7fcebce0c700 1 -- 172.21.15.156:0/3852327911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fceb809c5c0 msgr2=0x7fceb811f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:18.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.095+0000 7fcebce0c700 1 --2- 172.21.15.156:0/3852327911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fceb809c5c0 0x7fceb811f4c0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fceac016000 tx=0x7fceac004750 comp rx=0 tx=0).stop 2023-09-30T22:25:18.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.095+0000 7fcebce0c700 1 -- 172.21.15.156:0/3852327911 shutdown_connections 2023-09-30T22:25:18.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.095+0000 7fcebce0c700 1 --2- 172.21.15.156:0/3852327911 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fceb8131980 0x7fceb811fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.095+0000 7fcebce0c700 1 --2- 172.21.15.156:0/3852327911 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fceb809bc70 0x7fceb811ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.095+0000 7fcebce0c700 1 --2- 172.21.15.156:0/3852327911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fceb809c5c0 0x7fceb811f4c0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.095+0000 7fcebce0c700 1 -- 172.21.15.156:0/3852327911 >> 172.21.15.156:0/3852327911 conn(0x7fceb80a2980 msgr2=0x7fceb8099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:18.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.095+0000 7fcebce0c700 1 -- 172.21.15.156:0/3852327911 shutdown_connections 2023-09-30T22:25:18.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.095+0000 7fcebce0c700 1 -- 172.21.15.156:0/3852327911 wait complete. 2023-09-30T22:25:18.108 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:18.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.126+0000 7fa29afab700 1 -- 172.21.15.156:0/2398450390 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa29409a920 con 0x7fa29409e870 2023-09-30T22:25:18.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.126+0000 7fa2917fa700 1 -- 172.21.15.156:0/2398450390 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa288021020 con 0x7fa29409e870 2023-09-30T22:25:18.126 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:18.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.128+0000 7fa29afab700 1 -- 172.21.15.156:0/2398450390 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa29409e870 msgr2=0x7fa29411b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:18.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.128+0000 7fa29afab700 1 --2- 172.21.15.156:0/2398450390 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa29409e870 0x7fa29411b170 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fa28800e990 tx=0x7fa28800ed50 comp rx=0 tx=0).stop 2023-09-30T22:25:18.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.128+0000 7fa29afab700 1 -- 172.21.15.156:0/2398450390 shutdown_connections 2023-09-30T22:25:18.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.128+0000 7fa29afab700 1 --2- 172.21.15.156:0/2398450390 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa294131d70 0x7fa29411bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.128+0000 7fa29afab700 1 --2- 172.21.15.156:0/2398450390 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa29409e870 0x7fa29411b170 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.128+0000 7fa29afab700 1 --2- 172.21.15.156:0/2398450390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa29409f180 0x7fa29411b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.128+0000 7fa29afab700 1 -- 172.21.15.156:0/2398450390 >> 172.21.15.156:0/2398450390 conn(0x7fa2940a4430 msgr2=0x7fa29412fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:18.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.128+0000 7fa29afab700 1 -- 172.21.15.156:0/2398450390 shutdown_connections 2023-09-30T22:25:18.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.128+0000 7fa29afab700 1 -- 172.21.15.156:0/2398450390 wait complete. 2023-09-30T22:25:18.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:18.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.173+0000 7f98c9536700 1 -- 172.21.15.156:0/1423225782 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f98c4099ac0 con 0x7f98c40a1510 2023-09-30T22:25:18.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.173+0000 7f98ab7fe700 1 -- 172.21.15.156:0/1423225782 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f98b8033020 con 0x7f98c40a1510 2023-09-30T22:25:18.173 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:18.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.175+0000 7f98c9536700 1 -- 172.21.15.156:0/1423225782 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98c40a1510 msgr2=0x7f98c411f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:18.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.175+0000 7f98c9536700 1 --2- 172.21.15.156:0/1423225782 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98c40a1510 0x7f98c411f6d0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f98b8009130 tx=0x7f98b8004750 comp rx=0 tx=0).stop 2023-09-30T22:25:18.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.175+0000 7f98c9536700 1 -- 172.21.15.156:0/1423225782 shutdown_connections 2023-09-30T22:25:18.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.175+0000 7f98c9536700 1 --2- 172.21.15.156:0/1423225782 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98c41356e0 0x7f98c411fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.175+0000 7f98c9536700 1 --2- 172.21.15.156:0/1423225782 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98c40a0a30 0x7f98c411f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.175+0000 7f98c9536700 1 --2- 172.21.15.156:0/1423225782 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98c40a1510 0x7f98c411f6d0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.175+0000 7f98c9536700 1 -- 172.21.15.156:0/1423225782 >> 172.21.15.156:0/1423225782 conn(0x7f98c40a2980 msgr2=0x7f98c409e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:18.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.175+0000 7f98c9536700 1 -- 172.21.15.156:0/1423225782 shutdown_connections 2023-09-30T22:25:18.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:18.175+0000 7f98c9536700 1 -- 172.21.15.156:0/1423225782 wait complete. 2023-09-30T22:25:18.187 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:19.056 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:19.108 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:19.141 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:19.187 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:19.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.192+0000 7f5d94837700 1 Processor -- start 2023-09-30T22:25:19.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.192+0000 7f5d94837700 1 -- start start 2023-09-30T22:25:19.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.193+0000 7f5d94837700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d9009e340 0x7f5d901359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.193+0000 7f5d94837700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d90135f20 0x7f5d90138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.193+0000 7f5d94837700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d9009aaa0 con 0x7f5d9009d860 2023-09-30T22:25:19.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.193+0000 7f5d94837700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9009e730 con 0x7f5d90135f20 2023-09-30T22:25:19.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.193+0000 7f5d94837700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9009f870 con 0x7f5d9009e340 2023-09-30T22:25:19.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.193+0000 7f5d8ed9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d90135f20 0x7f5d90138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.193+0000 7f5d8e59c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f5d9009d860 0x7f5d9009dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:41694/0 (socket says 172.21.15.156:41694) 2023-09-30T22:25:19.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.193+0000 7f5d8e59c700 1 -- 172.21.15.156:0/1288662570 learned_addr learned my addr 172.21.15.156:0/1288662570 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:19.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.193+0000 7f5d87fff700 1 --2- 172.21.15.156:0/1288662570 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d9009e340 0x7f5d901359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.193+0000 7f5d8dd9b700 1 -- 172.21.15.156:0/1288662570 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1171244494 0 0) 0x7f5d9009aaa0 con 0x7f5d9009d860 2023-09-30T22:25:19.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.193+0000 7f5d8dd9b700 1 -- 172.21.15.156:0/1288662570 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d7c0035b0 con 0x7f5d9009d860 2023-09-30T22:25:19.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.193+0000 7f5d8ed9d700 1 -- 172.21.15.156:0/1288662570 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d9009e340 msgr2=0x7f5d901359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:19.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.193+0000 7f5d8ed9d700 1 --2- 172.21.15.156:0/1288662570 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d9009e340 0x7f5d901359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.193+0000 7f5d8ed9d700 1 -- 172.21.15.156:0/1288662570 >> v1:172.21.15.156:6789/0 conn(0x7f5d9009d860 legacy=0x7f5d9009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.193+0000 7f5d8ed9d700 1 -- 172.21.15.156:0/1288662570 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9009b360 con 0x7f5d90135f20 2023-09-30T22:25:19.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.193+0000 7f5d87fff700 1 --2- 172.21.15.156:0/1288662570 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d9009e340 0x7f5d901359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:19.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.194+0000 7f5d8ed9d700 1 --2- 172.21.15.156:0/1288662570 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d90135f20 0x7f5d90138300 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f5d88009dc0 tx=0x7f5d8800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=817c0bc3e7e2c15f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:19.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.194+0000 7f5d8dd9b700 1 -- 172.21.15.156:0/1288662570 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8800e070 con 0x7f5d90135f20 2023-09-30T22:25:19.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.194+0000 7f5d8dd9b700 1 -- 172.21.15.156:0/1288662570 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8800bb20 con 0x7f5d90135f20 2023-09-30T22:25:19.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.194+0000 7f5d8dd9b700 1 -- 172.21.15.156:0/1288662570 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8800be90 con 0x7f5d90135f20 2023-09-30T22:25:19.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.194+0000 7f5d94837700 1 -- 172.21.15.156:0/1288662570 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d90135f20 msgr2=0x7f5d90138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.194+0000 7f5d94837700 1 --2- 172.21.15.156:0/1288662570 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d90135f20 0x7f5d90138300 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f5d88009dc0 tx=0x7f5d8800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:19.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.195+0000 7f5d94837700 1 -- 172.21.15.156:0/1288662570 shutdown_connections 2023-09-30T22:25:19.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.195+0000 7f5d94837700 1 --2- 172.21.15.156:0/1288662570 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d90135f20 0x7f5d90138300 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.195+0000 7f5d94837700 1 --2- 172.21.15.156:0/1288662570 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d9009e340 0x7f5d901359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.195+0000 7f5d94837700 1 -- 172.21.15.156:0/1288662570 >> 172.21.15.156:0/1288662570 conn(0x7f5d90099c40 msgr2=0x7f5d900a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:19.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.195+0000 7f5d94837700 1 -- 172.21.15.156:0/1288662570 shutdown_connections 2023-09-30T22:25:19.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.195+0000 7f5d94837700 1 -- 172.21.15.156:0/1288662570 wait complete. 2023-09-30T22:25:19.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.196+0000 7f5d94837700 1 Processor -- start 2023-09-30T22:25:19.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.196+0000 7f5d94837700 1 -- start start 2023-09-30T22:25:19.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.196+0000 7f5d94837700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d9009d860 0x7f5d9011e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.196+0000 7f5d94837700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d9009e340 0x7f5d9011ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.196+0000 7f5d94837700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d90135f20 0x7f5d9011f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.196+0000 7f5d94837700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d90120d40 con 0x7f5d90135f20 2023-09-30T22:25:19.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.196+0000 7f5d94837700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d901223f0 con 0x7f5d9009d860 2023-09-30T22:25:19.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.196+0000 7f5d94837700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9009c8b0 con 0x7f5d9009e340 2023-09-30T22:25:19.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.196+0000 7f5d8e59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d9009d860 0x7f5d9011e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.196+0000 7f5d8e59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d9009d860 0x7f5d9011e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48616/0 (socket says 172.21.15.156:48616) 2023-09-30T22:25:19.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.196+0000 7f5d8e59c700 1 -- 172.21.15.156:0/3398737269 learned_addr learned my addr 172.21.15.156:0/3398737269 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:19.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.196+0000 7f5d8ed9d700 1 --2- 172.21.15.156:0/3398737269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d90135f20 0x7f5d9011f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.197+0000 7f5d87fff700 1 --2- 172.21.15.156:0/3398737269 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d9009e340 0x7f5d9011ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.197+0000 7f5d8ed9d700 1 -- 172.21.15.156:0/3398737269 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d9009e340 msgr2=0x7f5d9011ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.197+0000 7f5d8ed9d700 1 --2- 172.21.15.156:0/3398737269 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d9009e340 0x7f5d9011ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.197+0000 7f5d8ed9d700 1 -- 172.21.15.156:0/3398737269 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d9009d860 msgr2=0x7f5d9011e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.197+0000 7f5d8ed9d700 1 --2- 172.21.15.156:0/3398737269 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d9009d860 0x7f5d9011e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.197+0000 7f5d8ed9d700 1 -- 172.21.15.156:0/3398737269 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d780094a0 con 0x7f5d90135f20 2023-09-30T22:25:19.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.197+0000 7f5d8e59c700 1 --2- 172.21.15.156:0/3398737269 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d9009d860 0x7f5d9011e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:19.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.197+0000 7f5d8ed9d700 1 --2- 172.21.15.156:0/3398737269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d90135f20 0x7f5d9011f350 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f5d88009dc0 tx=0x7f5d88004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:19.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.197+0000 7f5d86ffd700 1 -- 172.21.15.156:0/3398737269 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d88004880 con 0x7f5d90135f20 2023-09-30T22:25:19.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.197+0000 7f5d94837700 1 -- 172.21.15.156:0/3398737269 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d88009a70 con 0x7f5d90135f20 2023-09-30T22:25:19.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.197+0000 7f5d86ffd700 1 -- 172.21.15.156:0/3398737269 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d88020070 con 0x7f5d90135f20 2023-09-30T22:25:19.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.197+0000 7f5d86ffd700 1 -- 172.21.15.156:0/3398737269 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d880276c0 con 0x7f5d90135f20 2023-09-30T22:25:19.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.197+0000 7f5d94837700 1 -- 172.21.15.156:0/3398737269 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d90071fa0 con 0x7f5d90135f20 2023-09-30T22:25:19.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.198+0000 7f5d86ffd700 1 -- 172.21.15.156:0/3398737269 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5d88012430 con 0x7f5d90135f20 2023-09-30T22:25:19.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.198+0000 7f5d86ffd700 1 -- 172.21.15.156:0/3398737269 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5d88022070 con 0x7f5d90135f20 2023-09-30T22:25:19.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.199+0000 7f5d94837700 1 -- 172.21.15.156:0/3398737269 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d9004f2a0 con 0x7f5d90135f20 2023-09-30T22:25:19.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.204+0000 7f5d86ffd700 1 -- 172.21.15.156:0/3398737269 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5d8802c020 con 0x7f5d90135f20 2023-09-30T22:25:19.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.255+0000 7f21565bb700 1 Processor -- start 2023-09-30T22:25:19.255 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.255+0000 7f21565bb700 1 -- start start 2023-09-30T22:25:19.256 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.256+0000 7f21565bb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f21500a0a30 0x7f21500a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.256+0000 7f21565bb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f21500a1340 0x7f215012ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.256+0000 7f21565bb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f21501304a0 0x7f2150130940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.256+0000 7f21565bb700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21500a1e70 con 0x7f21500a1340 2023-09-30T22:25:19.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.256+0000 7f21565bb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215009a720 con 0x7f21500a0a30 2023-09-30T22:25:19.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.256+0000 7f21565bb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f215009b300 con 0x7f21501304a0 2023-09-30T22:25:19.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.256+0000 7f214f7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f21500a1340 0x7f215012ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.256+0000 7f214f7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f21500a1340 0x7f215012ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48700/0 (socket says 172.21.15.156:48700) 2023-09-30T22:25:19.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.256+0000 7f214f7fe700 1 -- 172.21.15.156:0/4254205871 learned_addr learned my addr 172.21.15.156:0/4254205871 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:19.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.256+0000 7f214ffff700 1 --2- 172.21.15.156:0/4254205871 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f21500a0a30 0x7f21500a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.257 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.256+0000 7f2154b58700 1 --2- 172.21.15.156:0/4254205871 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f21501304a0 0x7f2150130940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.257+0000 7f214ffff700 1 -- 172.21.15.156:0/4254205871 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f21501304a0 msgr2=0x7f2150130940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:19.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.257+0000 7f214ffff700 1 --2- 172.21.15.156:0/4254205871 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f21501304a0 0x7f2150130940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.257+0000 7f214ffff700 1 -- 172.21.15.156:0/4254205871 >> v2:172.21.15.156:3300/0 conn(0x7f21500a1340 msgr2=0x7f215012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:19.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.257+0000 7f214ffff700 1 --2- 172.21.15.156:0/4254205871 >> v2:172.21.15.156:3300/0 conn(0x7f21500a1340 0x7f215012ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.257+0000 7f214ffff700 1 -- 172.21.15.156:0/4254205871 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f215009abc0 con 0x7f21500a0a30 2023-09-30T22:25:19.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.257+0000 7f214ffff700 1 --2- 172.21.15.156:0/4254205871 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f21500a0a30 0x7f21500a0e00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f214000b8d0 tx=0x7f214000bbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c22ba4e1760023b2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:19.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.257+0000 7f214effd700 1 -- 172.21.15.156:0/4254205871 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2140009070 con 0x7f21500a0a30 2023-09-30T22:25:19.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.257+0000 7f214effd700 1 -- 172.21.15.156:0/4254205871 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2140005e30 con 0x7f21500a0a30 2023-09-30T22:25:19.258 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.257+0000 7f214effd700 1 -- 172.21.15.156:0/4254205871 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214000c900 con 0x7f21500a0a30 2023-09-30T22:25:19.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.258+0000 7f21565bb700 1 -- 172.21.15.156:0/4254205871 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f21500a0a30 msgr2=0x7f21500a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.258+0000 7f21565bb700 1 --2- 172.21.15.156:0/4254205871 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f21500a0a30 0x7f21500a0e00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f214000b8d0 tx=0x7f214000bbe0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.258+0000 7f21565bb700 1 -- 172.21.15.156:0/4254205871 shutdown_connections 2023-09-30T22:25:19.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.258+0000 7f21565bb700 1 --2- 172.21.15.156:0/4254205871 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f21501304a0 0x7f2150130940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.258+0000 7f21565bb700 1 --2- 172.21.15.156:0/4254205871 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f21500a0a30 0x7f21500a0e00 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.258+0000 7f21565bb700 1 --2- 172.21.15.156:0/4254205871 >> v2:172.21.15.156:3300/0 conn(0x7f21500a1340 0x7f215012ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.258+0000 7f21565bb700 1 -- 172.21.15.156:0/4254205871 >> 172.21.15.156:0/4254205871 conn(0x7f21500a2980 msgr2=0x7f21500a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:19.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.258+0000 7f21565bb700 1 -- 172.21.15.156:0/4254205871 shutdown_connections 2023-09-30T22:25:19.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.258+0000 7f21565bb700 1 -- 172.21.15.156:0/4254205871 wait complete. 2023-09-30T22:25:19.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.259+0000 7f21565bb700 1 Processor -- start 2023-09-30T22:25:19.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.259+0000 7f21565bb700 1 -- start start 2023-09-30T22:25:19.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.260+0000 7f21565bb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f21500a0a30 0x7f21501c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.260+0000 7f21565bb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f21500a1340 0x7f21501c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.260+0000 7f21565bb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21501304a0 0x7f21501c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.260+0000 7f21565bb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215011d020 con 0x7f21501304a0 2023-09-30T22:25:19.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.260+0000 7f21565bb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215011ce30 con 0x7f21500a0a30 2023-09-30T22:25:19.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.260+0000 7f21565bb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f215011d6b0 con 0x7f21500a1340 2023-09-30T22:25:19.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.260+0000 7f214ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f21500a0a30 0x7f21501c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.260+0000 7f214ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f21500a0a30 0x7f21501c3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48626/0 (socket says 172.21.15.156:48626) 2023-09-30T22:25:19.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.260+0000 7f214ffff700 1 -- 172.21.15.156:0/3601328865 learned_addr learned my addr 172.21.15.156:0/3601328865 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:19.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.260+0000 7f2154b58700 1 --2- 172.21.15.156:0/3601328865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21501304a0 0x7f21501c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.260+0000 7f214f7fe700 1 --2- 172.21.15.156:0/3601328865 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f21500a1340 0x7f21501c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.260+0000 7f214ffff700 1 -- 172.21.15.156:0/3601328865 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f21500a1340 msgr2=0x7f21501c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.260+0000 7f214ffff700 1 --2- 172.21.15.156:0/3601328865 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f21500a1340 0x7f21501c44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.260+0000 7f214ffff700 1 -- 172.21.15.156:0/3601328865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21501304a0 msgr2=0x7f21501c4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.260+0000 7f214ffff700 1 --2- 172.21.15.156:0/3601328865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21501304a0 0x7f21501c4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.260+0000 7f214ffff700 1 -- 172.21.15.156:0/3601328865 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214000b4e0 con 0x7f21500a0a30 2023-09-30T22:25:19.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.260+0000 7f214ffff700 1 --2- 172.21.15.156:0/3601328865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f21500a0a30 0x7f21501c3fb0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f214000bc20 tx=0x7f2140004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:19.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.261+0000 7f214cff9700 1 -- 172.21.15.156:0/3601328865 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214000d660 con 0x7f21500a0a30 2023-09-30T22:25:19.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.261+0000 7f214cff9700 1 -- 172.21.15.156:0/3601328865 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214000d7c0 con 0x7f21500a0a30 2023-09-30T22:25:19.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.261+0000 7f21565bb700 1 -- 172.21.15.156:0/3601328865 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f215009fb10 con 0x7f21500a0a30 2023-09-30T22:25:19.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.261+0000 7f214cff9700 1 -- 172.21.15.156:0/3601328865 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214000db70 con 0x7f21500a0a30 2023-09-30T22:25:19.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.261+0000 7f21565bb700 1 -- 172.21.15.156:0/3601328865 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f215009ae50 con 0x7f21500a0a30 2023-09-30T22:25:19.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.262+0000 7f21565bb700 1 -- 172.21.15.156:0/3601328865 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f215004f2a0 con 0x7f21500a0a30 2023-09-30T22:25:19.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.262+0000 7f214cff9700 1 -- 172.21.15.156:0/3601328865 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f214000dcd0 con 0x7f21500a0a30 2023-09-30T22:25:19.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.262+0000 7f214cff9700 1 -- 172.21.15.156:0/3601328865 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2140040d70 con 0x7f21500a0a30 2023-09-30T22:25:19.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.270+0000 7f214cff9700 1 -- 172.21.15.156:0/3601328865 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f21400147b0 con 0x7f21500a0a30 2023-09-30T22:25:19.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.287+0000 7f81ba8ab700 1 Processor -- start 2023-09-30T22:25:19.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.287+0000 7f81ba8ab700 1 -- start start 2023-09-30T22:25:19.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.288+0000 7f81ba8ab700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81b409e870 0x7f81b409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.288+0000 7f81ba8ab700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81b409f180 0x7f81b4131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.288+0000 7f81ba8ab700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f81b4131d70 0x7f81b4132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.288+0000 7f81ba8ab700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81b40a0920 con 0x7f81b4131d70 2023-09-30T22:25:19.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.288+0000 7f81ba8ab700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b409c970 con 0x7f81b409f180 2023-09-30T22:25:19.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.288+0000 7f81ba8ab700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81b409bab0 con 0x7f81b409e870 2023-09-30T22:25:19.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.288+0000 7f81abfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81b409f180 0x7f81b4131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.288+0000 7f81abfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81b409f180 0x7f81b4131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48630/0 (socket says 172.21.15.156:48630) 2023-09-30T22:25:19.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.288+0000 7f81abfff700 1 -- 172.21.15.156:0/2447619239 learned_addr learned my addr 172.21.15.156:0/2447619239 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:19.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.288+0000 7f81b3fff700 1 --2- 172.21.15.156:0/2447619239 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81b409e870 0x7f81b409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.288+0000 7f81b8e48700 1 --2- 172.21.15.156:0/2447619239 >> v2:172.21.15.156:3300/0 conn(0x7f81b4131d70 0x7f81b4132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.288+0000 7f81abfff700 1 -- 172.21.15.156:0/2447619239 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81b409e870 msgr2=0x7f81b409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:19.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.288+0000 7f81abfff700 1 --2- 172.21.15.156:0/2447619239 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81b409e870 0x7f81b409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.288+0000 7f81abfff700 1 -- 172.21.15.156:0/2447619239 >> v2:172.21.15.156:3300/0 conn(0x7f81b4131d70 msgr2=0x7f81b4132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:19.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.288+0000 7f81abfff700 1 --2- 172.21.15.156:0/2447619239 >> v2:172.21.15.156:3300/0 conn(0x7f81b4131d70 0x7f81b4132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.288+0000 7f81abfff700 1 -- 172.21.15.156:0/2447619239 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b409f9c0 con 0x7f81b409f180 2023-09-30T22:25:19.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.288+0000 7f81abfff700 1 --2- 172.21.15.156:0/2447619239 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81b409f180 0x7f81b4131830 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f819c0098f0 tx=0x7f819c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=376e389eecd6771e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:19.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.289+0000 7f81b37fe700 1 -- 172.21.15.156:0/2447619239 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c011830 con 0x7f81b409f180 2023-09-30T22:25:19.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.289+0000 7f81b37fe700 1 -- 172.21.15.156:0/2447619239 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819c011990 con 0x7f81b409f180 2023-09-30T22:25:19.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.289+0000 7f81b37fe700 1 -- 172.21.15.156:0/2447619239 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c011d20 con 0x7f81b409f180 2023-09-30T22:25:19.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.289+0000 7f81ba8ab700 1 -- 172.21.15.156:0/2447619239 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81b409f180 msgr2=0x7f81b4131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.289+0000 7f81ba8ab700 1 --2- 172.21.15.156:0/2447619239 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81b409f180 0x7f81b4131830 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f819c0098f0 tx=0x7f819c009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:19.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.289+0000 7f81ba8ab700 1 -- 172.21.15.156:0/2447619239 shutdown_connections 2023-09-30T22:25:19.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.289+0000 7f81ba8ab700 1 --2- 172.21.15.156:0/2447619239 >> v2:172.21.15.156:3300/0 conn(0x7f81b4131d70 0x7f81b4132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.289+0000 7f81ba8ab700 1 --2- 172.21.15.156:0/2447619239 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81b409e870 0x7f81b409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.289+0000 7f81ba8ab700 1 --2- 172.21.15.156:0/2447619239 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81b409f180 0x7f81b4131830 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.289+0000 7f81ba8ab700 1 -- 172.21.15.156:0/2447619239 >> 172.21.15.156:0/2447619239 conn(0x7f81b40a4430 msgr2=0x7f81b40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:19.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.289+0000 7f81ba8ab700 1 -- 172.21.15.156:0/2447619239 shutdown_connections 2023-09-30T22:25:19.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.289+0000 7f81ba8ab700 1 -- 172.21.15.156:0/2447619239 wait complete. 2023-09-30T22:25:19.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.290+0000 7f81ba8ab700 1 Processor -- start 2023-09-30T22:25:19.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.290+0000 7f81ba8ab700 1 -- start start 2023-09-30T22:25:19.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.291+0000 7f81ba8ab700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81b409e870 0x7f81b406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.291+0000 7f81ba8ab700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81b409f180 0x7f81b406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.291+0000 7f81ba8ab700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81b4131d70 0x7f81b406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.291+0000 7f81ba8ab700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b4125d80 con 0x7f81b4131d70 2023-09-30T22:25:19.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.291+0000 7f81ba8ab700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b4131610 con 0x7f81b409e870 2023-09-30T22:25:19.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.291+0000 7f81ba8ab700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81b40a2bf0 con 0x7f81b409f180 2023-09-30T22:25:19.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.291+0000 7f81b8e48700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81b4131d70 0x7f81b406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.291+0000 7f81b3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81b409e870 0x7f81b406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.291+0000 7f81b8e48700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81b4131d70 0x7f81b406c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48728/0 (socket says 172.21.15.156:48728) 2023-09-30T22:25:19.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.291+0000 7f81b8e48700 1 -- 172.21.15.156:0/299152670 learned_addr learned my addr 172.21.15.156:0/299152670 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:19.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.291+0000 7f81abfff700 1 --2- 172.21.15.156:0/299152670 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81b409f180 0x7f81b406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.291+0000 7f81b8e48700 1 -- 172.21.15.156:0/299152670 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81b409f180 msgr2=0x7f81b406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.291+0000 7f81b8e48700 1 --2- 172.21.15.156:0/299152670 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81b409f180 0x7f81b406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.291+0000 7f81b8e48700 1 -- 172.21.15.156:0/299152670 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81b409e870 msgr2=0x7f81b406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.291+0000 7f81b8e48700 1 --2- 172.21.15.156:0/299152670 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81b409e870 0x7f81b406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.291+0000 7f81b8e48700 1 -- 172.21.15.156:0/299152670 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c009550 con 0x7f81b4131d70 2023-09-30T22:25:19.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.291+0000 7f81abfff700 1 --2- 172.21.15.156:0/299152670 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81b409f180 0x7f81b406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:19.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.291+0000 7f81b3fff700 1 --2- 172.21.15.156:0/299152670 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81b409e870 0x7f81b406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:19.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.291+0000 7f81b8e48700 1 --2- 172.21.15.156:0/299152670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81b4131d70 0x7f81b406c330 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f81ac00efc0 tx=0x7f81ac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:19.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.292+0000 7f81b17fa700 1 -- 172.21.15.156:0/299152670 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac009ea0 con 0x7f81b4131d70 2023-09-30T22:25:19.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.292+0000 7f81b17fa700 1 -- 172.21.15.156:0/299152670 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ac00f040 con 0x7f81b4131d70 2023-09-30T22:25:19.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.292+0000 7f81ba8ab700 1 -- 172.21.15.156:0/299152670 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b41246d0 con 0x7f81b4131d70 2023-09-30T22:25:19.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.292+0000 7f81b17fa700 1 -- 172.21.15.156:0/299152670 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac014480 con 0x7f81b4131d70 2023-09-30T22:25:19.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.292+0000 7f81ba8ab700 1 -- 172.21.15.156:0/299152670 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b40a0210 con 0x7f81b4131d70 2023-09-30T22:25:19.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.293+0000 7f81ba8ab700 1 -- 172.21.15.156:0/299152670 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b411d580 con 0x7f81b4131d70 2023-09-30T22:25:19.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.293+0000 7f81b17fa700 1 -- 172.21.15.156:0/299152670 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81ac0145e0 con 0x7f81b4131d70 2023-09-30T22:25:19.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.293+0000 7f81b17fa700 1 -- 172.21.15.156:0/299152670 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f81ac014890 con 0x7f81b4131d70 2023-09-30T22:25:19.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.302+0000 7f81b17fa700 1 -- 172.21.15.156:0/299152670 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81ac045060 con 0x7f81b4131d70 2023-09-30T22:25:19.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.339+0000 7f07c65ac700 1 Processor -- start 2023-09-30T22:25:19.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.340+0000 7f07c65ac700 1 -- start start 2023-09-30T22:25:19.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.340+0000 7f07c65ac700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f07c009e340 0x7f07c01359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.340+0000 7f07c65ac700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07c0135f20 0x7f07c0138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.340+0000 7f07c65ac700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c009aaa0 con 0x7f07c009d860 2023-09-30T22:25:19.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.340+0000 7f07c65ac700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c009e730 con 0x7f07c009e340 2023-09-30T22:25:19.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.340+0000 7f07c65ac700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c009f870 con 0x7f07c0135f20 2023-09-30T22:25:19.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.340+0000 7f07bf7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f07c009e340 0x7f07c01359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.341+0000 7f07bffff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f07c009d860 0x7f07c009dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:41704/0 (socket says 172.21.15.156:41704) 2023-09-30T22:25:19.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.341+0000 7f07bffff700 1 -- 172.21.15.156:0/1845281979 learned_addr learned my addr 172.21.15.156:0/1845281979 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:19.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.341+0000 7f07c4b49700 1 --2- 172.21.15.156:0/1845281979 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07c0135f20 0x7f07c0138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.341+0000 7f07bf7fe700 1 -- 172.21.15.156:0/1845281979 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07c0135f20 msgr2=0x7f07c0138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:19.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.341+0000 7f07bf7fe700 1 --2- 172.21.15.156:0/1845281979 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07c0135f20 0x7f07c0138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.341+0000 7f07bf7fe700 1 -- 172.21.15.156:0/1845281979 >> v1:172.21.15.156:6789/0 conn(0x7f07c009d860 legacy=0x7f07c009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.341+0000 7f07bf7fe700 1 -- 172.21.15.156:0/1845281979 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c009b360 con 0x7f07c009e340 2023-09-30T22:25:19.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.341+0000 7f07beffd700 1 -- 172.21.15.156:0/1845281979 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889384023 0 0) 0x7f07c009aaa0 con 0x7f07c009d860 2023-09-30T22:25:19.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.341+0000 7f07bf7fe700 1 --2- 172.21.15.156:0/1845281979 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07c009e340 0x7f07c01359e0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009840 tx=0x7f07b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f55ba9c4d82de server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:19.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.341+0000 7f07beffd700 1 -- 172.21.15.156:0/1845281979 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b4011830 con 0x7f07c009e340 2023-09-30T22:25:19.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.341+0000 7f07beffd700 1 -- 172.21.15.156:0/1845281979 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b4011990 con 0x7f07c009e340 2023-09-30T22:25:19.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.341+0000 7f07beffd700 1 -- 172.21.15.156:0/1845281979 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b4011d20 con 0x7f07c009e340 2023-09-30T22:25:19.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.342+0000 7f07c65ac700 1 -- 172.21.15.156:0/1845281979 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07c009e340 msgr2=0x7f07c01359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.342+0000 7f07c65ac700 1 --2- 172.21.15.156:0/1845281979 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07c009e340 0x7f07c01359e0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009840 tx=0x7f07b4009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:19.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.342+0000 7f07c65ac700 1 -- 172.21.15.156:0/1845281979 shutdown_connections 2023-09-30T22:25:19.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.342+0000 7f07c65ac700 1 --2- 172.21.15.156:0/1845281979 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07c0135f20 0x7f07c0138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.342+0000 7f07c65ac700 1 --2- 172.21.15.156:0/1845281979 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07c009e340 0x7f07c01359e0 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.342+0000 7f07c65ac700 1 -- 172.21.15.156:0/1845281979 >> 172.21.15.156:0/1845281979 conn(0x7f07c0099c40 msgr2=0x7f07c00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:19.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.342+0000 7f07c65ac700 1 -- 172.21.15.156:0/1845281979 shutdown_connections 2023-09-30T22:25:19.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.342+0000 7f07c65ac700 1 -- 172.21.15.156:0/1845281979 wait complete. 2023-09-30T22:25:19.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.343+0000 7f07c65ac700 1 Processor -- start 2023-09-30T22:25:19.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.343+0000 7f07c65ac700 1 -- start start 2023-09-30T22:25:19.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.344+0000 7f07c65ac700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07c009d860 0x7f07c011b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.344+0000 7f07c65ac700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07c009e340 0x7f07c011bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.344+0000 7f07c65ac700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07c0135f20 0x7f07c011c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.344+0000 7f07c65ac700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c011d420 con 0x7f07c009d860 2023-09-30T22:25:19.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.344+0000 7f07c65ac700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c011d880 con 0x7f07c009e340 2023-09-30T22:25:19.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.344+0000 7f07c65ac700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07c0131580 con 0x7f07c0135f20 2023-09-30T22:25:19.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.344+0000 7f07bffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07c009d860 0x7f07c011b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.344+0000 7f07bffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07c009d860 0x7f07c011b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48744/0 (socket says 172.21.15.156:48744) 2023-09-30T22:25:19.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.344+0000 7f07bffff700 1 -- 172.21.15.156:0/2134053897 learned_addr learned my addr 172.21.15.156:0/2134053897 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:19.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.344+0000 7f07c4b49700 1 --2- 172.21.15.156:0/2134053897 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07c0135f20 0x7f07c011c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.344+0000 7f07bf7fe700 1 --2- 172.21.15.156:0/2134053897 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07c009e340 0x7f07c011bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.344+0000 7f07bffff700 1 -- 172.21.15.156:0/2134053897 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07c0135f20 msgr2=0x7f07c011c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.344+0000 7f07bffff700 1 --2- 172.21.15.156:0/2134053897 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07c0135f20 0x7f07c011c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.344+0000 7f07bffff700 1 -- 172.21.15.156:0/2134053897 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07c009e340 msgr2=0x7f07c011bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.344+0000 7f07bffff700 1 --2- 172.21.15.156:0/2134053897 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07c009e340 0x7f07c011bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.344+0000 7f07bffff700 1 -- 172.21.15.156:0/2134053897 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b40094a0 con 0x7f07c009d860 2023-09-30T22:25:19.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.344+0000 7f07bffff700 1 --2- 172.21.15.156:0/2134053897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07c009d860 0x7f07c011b6d0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f07b000c550 tx=0x7f07b000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:19.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.345+0000 7f07bcff9700 1 -- 172.21.15.156:0/2134053897 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b0004c80 con 0x7f07c009d860 2023-09-30T22:25:19.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.345+0000 7f07c65ac700 1 -- 172.21.15.156:0/2134053897 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c009a150 con 0x7f07c009d860 2023-09-30T22:25:19.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.345+0000 7f07bcff9700 1 -- 172.21.15.156:0/2134053897 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b0004de0 con 0x7f07c009d860 2023-09-30T22:25:19.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.345+0000 7f07bcff9700 1 -- 172.21.15.156:0/2134053897 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b0007310 con 0x7f07c009d860 2023-09-30T22:25:19.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.345+0000 7f07c65ac700 1 -- 172.21.15.156:0/2134053897 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c011da90 con 0x7f07c009d860 2023-09-30T22:25:19.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.346+0000 7f07bcff9700 1 -- 172.21.15.156:0/2134053897 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f07b0007470 con 0x7f07c009d860 2023-09-30T22:25:19.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.346+0000 7f07c65ac700 1 -- 172.21.15.156:0/2134053897 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c004f2a0 con 0x7f07c009d860 2023-09-30T22:25:19.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.346+0000 7f07bcff9700 1 -- 172.21.15.156:0/2134053897 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f07b003f350 con 0x7f07c009d860 2023-09-30T22:25:19.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.355+0000 7f07bcff9700 1 -- 172.21.15.156:0/2134053897 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f07b00123b0 con 0x7f07c009d860 2023-09-30T22:25:19.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.425+0000 7f5d94837700 1 -- 172.21.15.156:0/3398737269 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5d9006c3b0 con 0x7f5d90135f20 2023-09-30T22:25:19.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.426+0000 7f5d86ffd700 1 -- 172.21.15.156:0/3398737269 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5d880267d0 con 0x7f5d90135f20 2023-09-30T22:25:19.426 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:19.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.428+0000 7f5d94837700 1 -- 172.21.15.156:0/3398737269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d90135f20 msgr2=0x7f5d9011f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.428+0000 7f5d94837700 1 --2- 172.21.15.156:0/3398737269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d90135f20 0x7f5d9011f350 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f5d88009dc0 tx=0x7f5d88004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.428+0000 7f5d94837700 1 -- 172.21.15.156:0/3398737269 shutdown_connections 2023-09-30T22:25:19.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.428+0000 7f5d94837700 1 --2- 172.21.15.156:0/3398737269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d90135f20 0x7f5d9011f350 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.428+0000 7f5d94837700 1 --2- 172.21.15.156:0/3398737269 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5d9009d860 0x7f5d9011e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.428+0000 7f5d94837700 1 --2- 172.21.15.156:0/3398737269 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5d9009e340 0x7f5d9011ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.428+0000 7f5d94837700 1 -- 172.21.15.156:0/3398737269 >> 172.21.15.156:0/3398737269 conn(0x7f5d90099c40 msgr2=0x7f5d900a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:19.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.428+0000 7f5d94837700 1 -- 172.21.15.156:0/3398737269 shutdown_connections 2023-09-30T22:25:19.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.428+0000 7f5d94837700 1 -- 172.21.15.156:0/3398737269 wait complete. 2023-09-30T22:25:19.440 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:19.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.495+0000 7f21565bb700 1 -- 172.21.15.156:0/3601328865 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f215004f2a0 con 0x7f21500a0a30 2023-09-30T22:25:19.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.495+0000 7f214cff9700 1 -- 172.21.15.156:0/3601328865 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2140015400 con 0x7f21500a0a30 2023-09-30T22:25:19.495 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:19.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.497+0000 7f21565bb700 1 -- 172.21.15.156:0/3601328865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f21500a0a30 msgr2=0x7f21501c3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.497+0000 7f21565bb700 1 --2- 172.21.15.156:0/3601328865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f21500a0a30 0x7f21501c3fb0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f214000bc20 tx=0x7f2140004750 comp rx=0 tx=0).stop 2023-09-30T22:25:19.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.497+0000 7f21565bb700 1 -- 172.21.15.156:0/3601328865 shutdown_connections 2023-09-30T22:25:19.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.497+0000 7f21565bb700 1 --2- 172.21.15.156:0/3601328865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21501304a0 0x7f21501c4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.497+0000 7f21565bb700 1 --2- 172.21.15.156:0/3601328865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f21500a0a30 0x7f21501c3fb0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.497+0000 7f21565bb700 1 --2- 172.21.15.156:0/3601328865 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f21500a1340 0x7f21501c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.497+0000 7f21565bb700 1 -- 172.21.15.156:0/3601328865 >> 172.21.15.156:0/3601328865 conn(0x7f21500a2980 msgr2=0x7f21501b7870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:19.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.497+0000 7f21565bb700 1 -- 172.21.15.156:0/3601328865 shutdown_connections 2023-09-30T22:25:19.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.497+0000 7f21565bb700 1 -- 172.21.15.156:0/3601328865 wait complete. 2023-09-30T22:25:19.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.497+0000 7f81ba8ab700 1 -- 172.21.15.156:0/299152670 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f81b404f2a0 con 0x7f81b4131d70 2023-09-30T22:25:19.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.498+0000 7f81b17fa700 1 -- 172.21.15.156:0/299152670 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f81ac018090 con 0x7f81b4131d70 2023-09-30T22:25:19.499 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:19.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.500+0000 7f81ba8ab700 1 -- 172.21.15.156:0/299152670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81b4131d70 msgr2=0x7f81b406c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.500+0000 7f81ba8ab700 1 --2- 172.21.15.156:0/299152670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81b4131d70 0x7f81b406c330 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f81ac00efc0 tx=0x7f81ac00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.500+0000 7f81ba8ab700 1 -- 172.21.15.156:0/299152670 shutdown_connections 2023-09-30T22:25:19.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.500+0000 7f81ba8ab700 1 --2- 172.21.15.156:0/299152670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81b4131d70 0x7f81b406c330 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.500+0000 7f81ba8ab700 1 --2- 172.21.15.156:0/299152670 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f81b409e870 0x7f81b406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.500+0000 7f81ba8ab700 1 --2- 172.21.15.156:0/299152670 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f81b409f180 0x7f81b406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.500+0000 7f81ba8ab700 1 -- 172.21.15.156:0/299152670 >> 172.21.15.156:0/299152670 conn(0x7f81b40a4430 msgr2=0x7f81b411a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:19.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.500+0000 7f81ba8ab700 1 -- 172.21.15.156:0/299152670 shutdown_connections 2023-09-30T22:25:19.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.500+0000 7f81ba8ab700 1 -- 172.21.15.156:0/299152670 wait complete. 2023-09-30T22:25:19.511 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:19.512 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:19.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.549+0000 7f07c65ac700 1 -- 172.21.15.156:0/2134053897 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f07c006ecd0 con 0x7f07c009d860 2023-09-30T22:25:19.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.549+0000 7f07bcff9700 1 -- 172.21.15.156:0/2134053897 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f07b0011360 con 0x7f07c009d860 2023-09-30T22:25:19.549 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:19.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.552+0000 7f07c65ac700 1 -- 172.21.15.156:0/2134053897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07c009d860 msgr2=0x7f07c011b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.552+0000 7f07c65ac700 1 --2- 172.21.15.156:0/2134053897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07c009d860 0x7f07c011b6d0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f07b000c550 tx=0x7f07b000c860 comp rx=0 tx=0).stop 2023-09-30T22:25:19.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.552+0000 7f07c65ac700 1 -- 172.21.15.156:0/2134053897 shutdown_connections 2023-09-30T22:25:19.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.552+0000 7f07c65ac700 1 --2- 172.21.15.156:0/2134053897 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07c0135f20 0x7f07c011c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.552+0000 7f07c65ac700 1 --2- 172.21.15.156:0/2134053897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07c009d860 0x7f07c011b6d0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.552+0000 7f07c65ac700 1 --2- 172.21.15.156:0/2134053897 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07c009e340 0x7f07c011bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.552+0000 7f07c65ac700 1 -- 172.21.15.156:0/2134053897 >> 172.21.15.156:0/2134053897 conn(0x7f07c0099c40 msgr2=0x7f07c0134f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:19.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.552+0000 7f07c65ac700 1 -- 172.21.15.156:0/2134053897 shutdown_connections 2023-09-30T22:25:19.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:19.552+0000 7f07c65ac700 1 -- 172.21.15.156:0/2134053897 wait complete. 2023-09-30T22:25:19.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:20.441 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:20.512 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:20.513 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:20.566 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:20.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.584+0000 7f142e1f5700 1 Processor -- start 2023-09-30T22:25:20.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.584+0000 7f142e1f5700 1 -- start start 2023-09-30T22:25:20.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.585+0000 7f142e1f5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f142806a770 0x7f142806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.585+0000 7f142e1f5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1428136cb0 0x7f1428139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.585+0000 7f142e1f5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f142806e900 con 0x7f142809dec0 2023-09-30T22:25:20.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.585+0000 7f142e1f5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142809d180 con 0x7f1428136cb0 2023-09-30T22:25:20.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.585+0000 7f142e1f5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f142809e780 con 0x7f142806a770 2023-09-30T22:25:20.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.585+0000 7f1427fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1428136cb0 0x7f1428139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.585+0000 7f14277fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f142806a770 0x7f142806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.585+0000 7f1427fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1428136cb0 0x7f1428139090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48648/0 (socket says 172.21.15.156:48648) 2023-09-30T22:25:20.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.585+0000 7f14277fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f142806a770 0x7f142806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53708/0 (socket says 172.21.15.156:53708) 2023-09-30T22:25:20.586 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.585+0000 7f1427fff700 1 -- 172.21.15.156:0/1152390330 learned_addr learned my addr 172.21.15.156:0/1152390330 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:20.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.585+0000 7f14277fe700 1 -- 172.21.15.156:0/1152390330 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1428136cb0 msgr2=0x7f1428139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:20.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.585+0000 7f14277fe700 1 --2- 172.21.15.156:0/1152390330 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1428136cb0 0x7f1428139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.585+0000 7f14277fe700 1 -- 172.21.15.156:0/1152390330 >> v1:172.21.15.156:6789/0 conn(0x7f142809dec0 legacy=0x7f142806b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.585+0000 7f14277fe700 1 -- 172.21.15.156:0/1152390330 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142809d3c0 con 0x7f142806a770 2023-09-30T22:25:20.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.585+0000 7f1427fff700 1 --2- 172.21.15.156:0/1152390330 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1428136cb0 0x7f1428139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:20.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.586+0000 7f14277fe700 1 --2- 172.21.15.156:0/1152390330 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f142806a770 0x7f142806ab40 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f1418009870 tx=0x7f1418009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8332cc66eb74f03 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:20.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.586+0000 7f14267fc700 1 -- 172.21.15.156:0/1152390330 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1418011830 con 0x7f142806a770 2023-09-30T22:25:20.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.586+0000 7f14267fc700 1 -- 172.21.15.156:0/1152390330 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1418011990 con 0x7f142806a770 2023-09-30T22:25:20.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.586+0000 7f14267fc700 1 -- 172.21.15.156:0/1152390330 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1418011d20 con 0x7f142806a770 2023-09-30T22:25:20.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.587+0000 7f142e1f5700 1 -- 172.21.15.156:0/1152390330 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f142806a770 msgr2=0x7f142806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.587+0000 7f142e1f5700 1 --2- 172.21.15.156:0/1152390330 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f142806a770 0x7f142806ab40 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f1418009870 tx=0x7f1418009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:20.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.587+0000 7f142e1f5700 1 -- 172.21.15.156:0/1152390330 shutdown_connections 2023-09-30T22:25:20.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.587+0000 7f142e1f5700 1 --2- 172.21.15.156:0/1152390330 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1428136cb0 0x7f1428139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.587+0000 7f142e1f5700 1 --2- 172.21.15.156:0/1152390330 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f142806a770 0x7f142806ab40 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.589 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.587+0000 7f142e1f5700 1 -- 172.21.15.156:0/1152390330 >> 172.21.15.156:0/1152390330 conn(0x7f1428099c40 msgr2=0x7f14280a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:20.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.590+0000 7f142e1f5700 1 -- 172.21.15.156:0/1152390330 shutdown_connections 2023-09-30T22:25:20.591 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.590+0000 7f142e1f5700 1 -- 172.21.15.156:0/1152390330 wait complete. 2023-09-30T22:25:20.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.592+0000 7f142e1f5700 1 Processor -- start 2023-09-30T22:25:20.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.592+0000 7f142e1f5700 1 -- start start 2023-09-30T22:25:20.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.593+0000 7f142e1f5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f142806a770 0x7f1428131b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.593+0000 7f142e1f5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f142809dec0 0x7f14281320c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.593+0000 7f142e1f5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1428136cb0 0x7f1428132600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.593+0000 7f142e1f5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1428132fe0 con 0x7f142806a770 2023-09-30T22:25:20.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.593+0000 7f142e1f5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14281354f0 con 0x7f1428136cb0 2023-09-30T22:25:20.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.593+0000 7f142e1f5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14280a2c00 con 0x7f142809dec0 2023-09-30T22:25:20.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.593+0000 7f14277fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f142806a770 0x7f1428131b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.593+0000 7f1427fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1428136cb0 0x7f1428132600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.593+0000 7f14277fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f142806a770 0x7f1428131b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48760/0 (socket says 172.21.15.156:48760) 2023-09-30T22:25:20.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.593+0000 7f14277fe700 1 -- 172.21.15.156:0/2802151366 learned_addr learned my addr 172.21.15.156:0/2802151366 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:20.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.593+0000 7f1426ffd700 1 --2- 172.21.15.156:0/2802151366 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f142809dec0 0x7f14281320c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.593+0000 7f14277fe700 1 -- 172.21.15.156:0/2802151366 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f142809dec0 msgr2=0x7f14281320c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.593+0000 7f14277fe700 1 --2- 172.21.15.156:0/2802151366 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f142809dec0 0x7f14281320c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.593+0000 7f14277fe700 1 -- 172.21.15.156:0/2802151366 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1428136cb0 msgr2=0x7f1428132600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.593+0000 7f14277fe700 1 --2- 172.21.15.156:0/2802151366 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1428136cb0 0x7f1428132600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.593+0000 7f14277fe700 1 -- 172.21.15.156:0/2802151366 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1420009b30 con 0x7f142806a770 2023-09-30T22:25:20.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.593+0000 7f1427fff700 1 --2- 172.21.15.156:0/2802151366 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1428136cb0 0x7f1428132600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:20.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.594+0000 7f14277fe700 1 --2- 172.21.15.156:0/2802151366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f142806a770 0x7f1428131b80 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f1418009840 tx=0x7f1418004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:20.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.594+0000 7f140ffff700 1 -- 172.21.15.156:0/2802151366 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1418004510 con 0x7f142806a770 2023-09-30T22:25:20.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.594+0000 7f140ffff700 1 -- 172.21.15.156:0/2802151366 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141801f070 con 0x7f142806a770 2023-09-30T22:25:20.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.594+0000 7f142e1f5700 1 -- 172.21.15.156:0/2802151366 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14180094a0 con 0x7f142806a770 2023-09-30T22:25:20.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.594+0000 7f140ffff700 1 -- 172.21.15.156:0/2802151366 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14180038e0 con 0x7f142806a770 2023-09-30T22:25:20.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.594+0000 7f142e1f5700 1 -- 172.21.15.156:0/2802151366 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1428071ce0 con 0x7f142806a770 2023-09-30T22:25:20.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.595+0000 7f140ffff700 1 -- 172.21.15.156:0/2802151366 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1418003a40 con 0x7f142806a770 2023-09-30T22:25:20.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.595+0000 7f142e1f5700 1 -- 172.21.15.156:0/2802151366 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f142804f2a0 con 0x7f142806a770 2023-09-30T22:25:20.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.595+0000 7f140ffff700 1 -- 172.21.15.156:0/2802151366 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1418021070 con 0x7f142806a770 2023-09-30T22:25:20.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.604+0000 7f140ffff700 1 -- 172.21.15.156:0/2802151366 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f141802f3a0 con 0x7f142806a770 2023-09-30T22:25:20.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.649+0000 7fd72d3d5700 1 Processor -- start 2023-09-30T22:25:20.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.649+0000 7fd72d3d5700 1 -- start start 2023-09-30T22:25:20.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.649+0000 7f82471f3700 1 Processor -- start 2023-09-30T22:25:20.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.649+0000 7f82471f3700 1 -- start start 2023-09-30T22:25:20.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.649+0000 7fd72d3d5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd72812cef0 0x7fd72812d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.649+0000 7fd72d3d5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd728133540 0x7fd728133910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.649+0000 7fd72d3d5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd728133e50 0x7fd72813a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.649+0000 7fd72d3d5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd72809ac40 con 0x7fd728133540 2023-09-30T22:25:20.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.649+0000 7fd72d3d5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72809a740 con 0x7fd72812cef0 2023-09-30T22:25:20.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.649+0000 7fd72d3d5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd72809f3a0 con 0x7fd728133e50 2023-09-30T22:25:20.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.649+0000 7fd726ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd72812cef0 0x7fd72812d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.649+0000 7fd726ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd72812cef0 0x7fd72812d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48664/0 (socket says 172.21.15.156:48664) 2023-09-30T22:25:20.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.649+0000 7fd726ffd700 1 -- 172.21.15.156:0/2843129318 learned_addr learned my addr 172.21.15.156:0/2843129318 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:20.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.649+0000 7f82471f3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8240099e20 0x7f824009a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.650+0000 7f82471f3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f824009a730 0x7f8240130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.652 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.649+0000 7fd7267fc700 1 --2- 172.21.15.156:0/2843129318 >> v2:172.21.15.156:3300/0 conn(0x7fd728133540 0x7fd728133910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.650+0000 7f82471f3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8240130890 0x7f8240130ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.650+0000 7f82471f3700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f824009bf50 con 0x7f8240099e20 2023-09-30T22:25:20.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.650+0000 7f82471f3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8240131220 con 0x7f824009a730 2023-09-30T22:25:20.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.650+0000 7f82471f3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8240099a60 con 0x7f8240130890 2023-09-30T22:25:20.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.650+0000 7f8244f8f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8240099e20 0x7f824009a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.650+0000 7f8245790700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8240130890 0x7f8240130ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.650+0000 7f8244f8f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8240099e20 0x7f824009a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48770/0 (socket says 172.21.15.156:48770) 2023-09-30T22:25:20.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.650+0000 7f8244f8f700 1 -- 172.21.15.156:0/1837427019 learned_addr learned my addr 172.21.15.156:0/1837427019 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:20.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.650+0000 7f8245790700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8240130890 0x7f8240130ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53734/0 (socket says 172.21.15.156:53734) 2023-09-30T22:25:20.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.650+0000 7f823ffff700 1 --2- 172.21.15.156:0/1837427019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f824009a730 0x7f8240130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.650+0000 7fd7277fe700 1 --2- 172.21.15.156:0/2843129318 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd728133e50 0x7fd72813a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.650+0000 7fd726ffd700 1 -- 172.21.15.156:0/2843129318 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd728133e50 msgr2=0x7fd72813a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:20.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.650+0000 7fd726ffd700 1 --2- 172.21.15.156:0/2843129318 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd728133e50 0x7fd72813a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.650+0000 7fd726ffd700 1 -- 172.21.15.156:0/2843129318 >> v2:172.21.15.156:3300/0 conn(0x7fd728133540 msgr2=0x7fd728133910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:20.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.650+0000 7fd726ffd700 1 --2- 172.21.15.156:0/2843129318 >> v2:172.21.15.156:3300/0 conn(0x7fd728133540 0x7fd728133910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.650+0000 7fd726ffd700 1 -- 172.21.15.156:0/2843129318 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72809b010 con 0x7fd72812cef0 2023-09-30T22:25:20.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.650+0000 7f823ffff700 1 -- 172.21.15.156:0/1837427019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8240130890 msgr2=0x7f8240130ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:20.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.650+0000 7f823ffff700 1 --2- 172.21.15.156:0/1837427019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8240130890 0x7f8240130ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.650+0000 7f823ffff700 1 -- 172.21.15.156:0/1837427019 >> v2:172.21.15.156:3300/0 conn(0x7f8240099e20 msgr2=0x7f824009a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:20.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.650+0000 7f823ffff700 1 --2- 172.21.15.156:0/1837427019 >> v2:172.21.15.156:3300/0 conn(0x7f8240099e20 0x7f824009a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.650+0000 7f823ffff700 1 -- 172.21.15.156:0/1837427019 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824009b230 con 0x7f824009a730 2023-09-30T22:25:20.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.650+0000 7fd726ffd700 1 --2- 172.21.15.156:0/2843129318 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd72812cef0 0x7fd72812d2c0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd7180098f0 tx=0x7fd718009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b56073cec9272e13 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:20.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.650+0000 7f823ffff700 1 --2- 172.21.15.156:0/1837427019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f824009a730 0x7f8240130350 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f822c00bb10 tx=0x7f822c00be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=effe36dd7592fcd6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:20.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.650+0000 7f823f7fe700 1 -- 172.21.15.156:0/1837427019 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822c00dc30 con 0x7f824009a730 2023-09-30T22:25:20.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.651+0000 7f823f7fe700 1 -- 172.21.15.156:0/1837427019 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822c00dd90 con 0x7f824009a730 2023-09-30T22:25:20.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.651+0000 7f823f7fe700 1 -- 172.21.15.156:0/1837427019 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822c012990 con 0x7f824009a730 2023-09-30T22:25:20.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.651+0000 7fd725ffb700 1 -- 172.21.15.156:0/2843129318 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71800b8a0 con 0x7fd72812cef0 2023-09-30T22:25:20.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.651+0000 7fd725ffb700 1 -- 172.21.15.156:0/2843129318 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71800ba00 con 0x7fd72812cef0 2023-09-30T22:25:20.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.651+0000 7fd725ffb700 1 -- 172.21.15.156:0/2843129318 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71800bd90 con 0x7fd72812cef0 2023-09-30T22:25:20.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.651+0000 7f82471f3700 1 -- 172.21.15.156:0/1837427019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f824009a730 msgr2=0x7f8240130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.651+0000 7f82471f3700 1 --2- 172.21.15.156:0/1837427019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f824009a730 0x7f8240130350 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f822c00bb10 tx=0x7f822c00be20 comp rx=0 tx=0).stop 2023-09-30T22:25:20.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.651+0000 7f82471f3700 1 -- 172.21.15.156:0/1837427019 shutdown_connections 2023-09-30T22:25:20.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.651+0000 7f82471f3700 1 --2- 172.21.15.156:0/1837427019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8240130890 0x7f8240130ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.651+0000 7f82471f3700 1 --2- 172.21.15.156:0/1837427019 >> v2:172.21.15.156:3300/0 conn(0x7f8240099e20 0x7f824009a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.651+0000 7f82471f3700 1 --2- 172.21.15.156:0/1837427019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f824009a730 0x7f8240130350 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.651+0000 7f82471f3700 1 -- 172.21.15.156:0/1837427019 >> 172.21.15.156:0/1837427019 conn(0x7f82400a2980 msgr2=0x7f82400a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:20.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.651+0000 7f82471f3700 1 -- 172.21.15.156:0/1837427019 shutdown_connections 2023-09-30T22:25:20.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.651+0000 7fd72d3d5700 1 -- 172.21.15.156:0/2843129318 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd72812cef0 msgr2=0x7fd72812d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.651+0000 7fd72d3d5700 1 --2- 172.21.15.156:0/2843129318 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd72812cef0 0x7fd72812d2c0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd7180098f0 tx=0x7fd718009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:20.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.651+0000 7f82471f3700 1 -- 172.21.15.156:0/1837427019 wait complete. 2023-09-30T22:25:20.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.651+0000 7fd72d3d5700 1 -- 172.21.15.156:0/2843129318 shutdown_connections 2023-09-30T22:25:20.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.651+0000 7fd72d3d5700 1 --2- 172.21.15.156:0/2843129318 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd728133e50 0x7fd72813a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.651+0000 7fd72d3d5700 1 --2- 172.21.15.156:0/2843129318 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd72812cef0 0x7fd72812d2c0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.651+0000 7fd72d3d5700 1 --2- 172.21.15.156:0/2843129318 >> v2:172.21.15.156:3300/0 conn(0x7fd728133540 0x7fd728133910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.651+0000 7fd72d3d5700 1 -- 172.21.15.156:0/2843129318 >> 172.21.15.156:0/2843129318 conn(0x7fd728099c40 msgr2=0x7fd7280a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:20.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.652+0000 7fd72d3d5700 1 -- 172.21.15.156:0/2843129318 shutdown_connections 2023-09-30T22:25:20.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.652+0000 7fd72d3d5700 1 -- 172.21.15.156:0/2843129318 wait complete. 2023-09-30T22:25:20.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.653+0000 7fd72d3d5700 1 Processor -- start 2023-09-30T22:25:20.660 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.653+0000 7f82471f3700 1 Processor -- start 2023-09-30T22:25:20.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.653+0000 7fd72d3d5700 1 -- start start 2023-09-30T22:25:20.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.653+0000 7fd72d3d5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd72812cef0 0x7fd728119c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.653+0000 7fd72d3d5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd728133540 0x7fd72811a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.661 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.653+0000 7fd72d3d5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd728133e50 0x7fd72811b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.653+0000 7fd72d3d5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72811aee0 con 0x7fd728133e50 2023-09-30T22:25:20.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.653+0000 7fd72d3d5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72809c530 con 0x7fd728133540 2023-09-30T22:25:20.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.653+0000 7fd72d3d5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd72811a7f0 con 0x7fd72812cef0 2023-09-30T22:25:20.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.653+0000 7fd726ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd72812cef0 0x7fd728119c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.653+0000 7fd726ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd72812cef0 0x7fd728119c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53748/0 (socket says 172.21.15.156:53748) 2023-09-30T22:25:20.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.653+0000 7fd726ffd700 1 -- 172.21.15.156:0/2319921932 learned_addr learned my addr 172.21.15.156:0/2319921932 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:20.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.653+0000 7fd726ffd700 1 -- 172.21.15.156:0/2319921932 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd728133540 msgr2=0x7fd72811a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.653+0000 7fd726ffd700 1 --2- 172.21.15.156:0/2319921932 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd728133540 0x7fd72811a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.662 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.654+0000 7fd726ffd700 1 -- 172.21.15.156:0/2319921932 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd728133e50 msgr2=0x7fd72811b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.653+0000 7f82471f3700 1 -- start start 2023-09-30T22:25:20.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.654+0000 7fd726ffd700 1 --2- 172.21.15.156:0/2319921932 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd728133e50 0x7fd72811b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.654+0000 7fd726ffd700 1 -- 172.21.15.156:0/2319921932 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd718009550 con 0x7fd72812cef0 2023-09-30T22:25:20.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.653+0000 7f82471f3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8240099e20 0x7f82401cc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.653+0000 7f82471f3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f824009a730 0x7f82401cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.654+0000 7f82471f3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8240130890 0x7f82401ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.654+0000 7f82471f3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8240125de0 con 0x7f8240099e20 2023-09-30T22:25:20.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.654+0000 7f82471f3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8240125bf0 con 0x7f824009a730 2023-09-30T22:25:20.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.654+0000 7f82471f3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8240126240 con 0x7f8240130890 2023-09-30T22:25:20.664 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.654+0000 7fd726ffd700 1 --2- 172.21.15.156:0/2319921932 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd72812cef0 0x7fd728119c70 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fd718000c00 tx=0x7fd718004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:20.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.654+0000 7f8245790700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8240130890 0x7f82401ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.654+0000 7f8245790700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8240130890 0x7f82401ccfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53750/0 (socket says 172.21.15.156:53750) 2023-09-30T22:25:20.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.654+0000 7f8245790700 1 -- 172.21.15.156:0/2459515638 learned_addr learned my addr 172.21.15.156:0/2459515638 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:20.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.654+0000 7f8244f8f700 1 --2- 172.21.15.156:0/2459515638 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8240099e20 0x7f82401cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.654+0000 7fd70f7fe700 1 -- 172.21.15.156:0/2319921932 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd718004590 con 0x7fd72812cef0 2023-09-30T22:25:20.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.654+0000 7f823ffff700 1 --2- 172.21.15.156:0/2459515638 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f824009a730 0x7f82401cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.654+0000 7f8245790700 1 -- 172.21.15.156:0/2459515638 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f824009a730 msgr2=0x7f82401cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.654+0000 7f8245790700 1 --2- 172.21.15.156:0/2459515638 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f824009a730 0x7f82401cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.654+0000 7f8245790700 1 -- 172.21.15.156:0/2459515638 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8240099e20 msgr2=0x7f82401cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.654+0000 7f8245790700 1 --2- 172.21.15.156:0/2459515638 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8240099e20 0x7f82401cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.654+0000 7f8245790700 1 -- 172.21.15.156:0/2459515638 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822c00b740 con 0x7f8240130890 2023-09-30T22:25:20.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.654+0000 7f823ffff700 1 --2- 172.21.15.156:0/2459515638 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f824009a730 0x7f82401cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:20.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.654+0000 7f8245790700 1 --2- 172.21.15.156:0/2459515638 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8240130890 0x7f82401ccfb0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f8238009dd0 tx=0x7f823800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:20.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.655+0000 7f823d7fa700 1 -- 172.21.15.156:0/2459515638 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8238009c40 con 0x7f8240130890 2023-09-30T22:25:20.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.655+0000 7f823d7fa700 1 -- 172.21.15.156:0/2459515638 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823800f040 con 0x7f8240130890 2023-09-30T22:25:20.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.655+0000 7f823d7fa700 1 -- 172.21.15.156:0/2459515638 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8238014480 con 0x7f8240130890 2023-09-30T22:25:20.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.654+0000 7fd70f7fe700 1 -- 172.21.15.156:0/2319921932 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7180036a0 con 0x7fd72812cef0 2023-09-30T22:25:20.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.654+0000 7fd72d3d5700 1 -- 172.21.15.156:0/2319921932 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd72812dbb0 con 0x7fd72812cef0 2023-09-30T22:25:20.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.654+0000 7fd72d3d5700 1 -- 172.21.15.156:0/2319921932 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd728072180 con 0x7fd72812cef0 2023-09-30T22:25:20.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.654+0000 7fd70f7fe700 1 -- 172.21.15.156:0/2319921932 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd718003a50 con 0x7fd72812cef0 2023-09-30T22:25:20.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.655+0000 7fd72d3d5700 1 -- 172.21.15.156:0/2319921932 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7080052e0 con 0x7fd72812cef0 2023-09-30T22:25:20.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.655+0000 7fd70f7fe700 1 -- 172.21.15.156:0/2319921932 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd718003bb0 con 0x7fd72812cef0 2023-09-30T22:25:20.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.656+0000 7f82471f3700 1 -- 172.21.15.156:0/2459515638 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82400a1390 con 0x7f8240130890 2023-09-30T22:25:20.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.656+0000 7f82471f3700 1 -- 172.21.15.156:0/2459515638 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8240127820 con 0x7f8240130890 2023-09-30T22:25:20.668 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.656+0000 7fd70f7fe700 1 -- 172.21.15.156:0/2319921932 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd718021030 con 0x7fd72812cef0 2023-09-30T22:25:20.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.656+0000 7f82471f3700 1 -- 172.21.15.156:0/2459515638 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8240126440 con 0x7f8240130890 2023-09-30T22:25:20.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.660+0000 7fd70f7fe700 1 -- 172.21.15.156:0/2319921932 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd71801a430 con 0x7fd72812cef0 2023-09-30T22:25:20.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.661+0000 7f823d7fa700 1 -- 172.21.15.156:0/2459515638 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f82380145e0 con 0x7f8240130890 2023-09-30T22:25:20.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.661+0000 7f823d7fa700 1 -- 172.21.15.156:0/2459515638 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8238040770 con 0x7f8240130890 2023-09-30T22:25:20.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.665+0000 7f823d7fa700 1 -- 172.21.15.156:0/2459515638 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8238012930 con 0x7f8240130890 2023-09-30T22:25:20.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.732+0000 7f58b0283700 1 Processor -- start 2023-09-30T22:25:20.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.733+0000 7f58b0283700 1 -- start start 2023-09-30T22:25:20.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.733+0000 7f58b0283700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f58a80a1550 0x7f58a8138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.733+0000 7f58b0283700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58a8139200 0x7f58a813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.733+0000 7f58b0283700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a809e9d0 con 0x7f58a80a0a70 2023-09-30T22:25:20.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.733+0000 7f58b0283700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a809dc00 con 0x7f58a8139200 2023-09-30T22:25:20.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.733+0000 7f58b0283700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58a809dec0 con 0x7f58a80a1550 2023-09-30T22:25:20.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.734+0000 7f58ad81e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f58a80a1550 0x7f58a8138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.734+0000 7f58ad81e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f58a80a1550 0x7f58a8138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:53752/0 (socket says 172.21.15.156:53752) 2023-09-30T22:25:20.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.734+0000 7f58ad81e700 1 -- 172.21.15.156:0/689784601 learned_addr learned my addr 172.21.15.156:0/689784601 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:20.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.734+0000 7f58ae820700 1 --2- 172.21.15.156:0/689784601 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58a8139200 0x7f58a813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.734+0000 7f58ae820700 1 -- 172.21.15.156:0/689784601 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f58a80a1550 msgr2=0x7f58a8138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:20.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.734+0000 7f58ae820700 1 --2- 172.21.15.156:0/689784601 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f58a80a1550 0x7f58a8138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.734+0000 7f58ae820700 1 -- 172.21.15.156:0/689784601 >> v1:172.21.15.156:6789/0 conn(0x7f58a80a0a70 legacy=0x7f58a80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.734+0000 7f58ae820700 1 -- 172.21.15.156:0/689784601 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a809e6a0 con 0x7f58a8139200 2023-09-30T22:25:20.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.734+0000 7f58ae820700 1 --2- 172.21.15.156:0/689784601 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58a8139200 0x7f58a813b5e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f58a0009dc0 tx=0x7f58a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f36abd887bdb6ec7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:20.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.734+0000 7f58ad01d700 1 -- 172.21.15.156:0/689784601 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a000e070 con 0x7f58a8139200 2023-09-30T22:25:20.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.734+0000 7f58ad01d700 1 -- 172.21.15.156:0/689784601 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a000bb20 con 0x7f58a8139200 2023-09-30T22:25:20.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.735+0000 7f58ad01d700 1 -- 172.21.15.156:0/689784601 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a0012430 con 0x7f58a8139200 2023-09-30T22:25:20.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.735+0000 7f58b0283700 1 -- 172.21.15.156:0/689784601 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58a8139200 msgr2=0x7f58a813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.735+0000 7f58b0283700 1 --2- 172.21.15.156:0/689784601 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58a8139200 0x7f58a813b5e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f58a0009dc0 tx=0x7f58a000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:20.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.735+0000 7f58b0283700 1 -- 172.21.15.156:0/689784601 shutdown_connections 2023-09-30T22:25:20.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.735+0000 7f58b0283700 1 --2- 172.21.15.156:0/689784601 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58a8139200 0x7f58a813b5e0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.735+0000 7f58b0283700 1 --2- 172.21.15.156:0/689784601 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f58a80a1550 0x7f58a8138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.735+0000 7f58b0283700 1 -- 172.21.15.156:0/689784601 >> 172.21.15.156:0/689784601 conn(0x7f58a80a6610 msgr2=0x7f58a80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:20.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.736+0000 7f58b0283700 1 -- 172.21.15.156:0/689784601 shutdown_connections 2023-09-30T22:25:20.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.736+0000 7f58b0283700 1 -- 172.21.15.156:0/689784601 wait complete. 2023-09-30T22:25:20.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.737+0000 7f58b0283700 1 Processor -- start 2023-09-30T22:25:20.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.737+0000 7f58b0283700 1 -- start start 2023-09-30T22:25:20.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.737+0000 7f58b0283700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f58a80a0a70 0x7f58a811e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.737+0000 7f58b0283700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58a80a1550 0x7f58a811ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.737+0000 7f58b0283700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58a8139200 0x7f58a811f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.737+0000 7f58b0283700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a8134100 con 0x7f58a80a1550 2023-09-30T22:25:20.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.737+0000 7f58b0283700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a8122310 con 0x7f58a8139200 2023-09-30T22:25:20.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.737+0000 7f58b0283700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58a80a03e0 con 0x7f58a80a0a70 2023-09-30T22:25:20.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.738+0000 7f58ae820700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58a8139200 0x7f58a811f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.738+0000 7f58ad81e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58a80a1550 0x7f58a811ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.738+0000 7f58ae820700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58a8139200 0x7f58a811f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48712/0 (socket says 172.21.15.156:48712) 2023-09-30T22:25:20.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.738+0000 7f58ae820700 1 -- 172.21.15.156:0/322435019 learned_addr learned my addr 172.21.15.156:0/322435019 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:20.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.738+0000 7f58ad81e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58a80a1550 0x7f58a811ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:48796/0 (socket says 172.21.15.156:48796) 2023-09-30T22:25:20.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.738+0000 7f58ae01f700 1 --2- 172.21.15.156:0/322435019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f58a80a0a70 0x7f58a811e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.738+0000 7f58ae01f700 1 -- 172.21.15.156:0/322435019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58a8139200 msgr2=0x7f58a811f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.738+0000 7f58ae01f700 1 --2- 172.21.15.156:0/322435019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58a8139200 0x7f58a811f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.738+0000 7f58ae01f700 1 -- 172.21.15.156:0/322435019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58a80a1550 msgr2=0x7f58a811ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.738+0000 7f58ae01f700 1 --2- 172.21.15.156:0/322435019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58a80a1550 0x7f58a811ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.738+0000 7f58ae01f700 1 -- 172.21.15.156:0/322435019 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a0009a70 con 0x7f58a80a0a70 2023-09-30T22:25:20.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.738+0000 7f58ae01f700 1 --2- 172.21.15.156:0/322435019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f58a80a0a70 0x7f58a811e7f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f58a4000f60 tx=0x7f58a400c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:20.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.738+0000 7f589effd700 1 -- 172.21.15.156:0/322435019 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a40052d0 con 0x7f58a80a0a70 2023-09-30T22:25:20.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.738+0000 7f589effd700 1 -- 172.21.15.156:0/322435019 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a4005430 con 0x7f58a80a0a70 2023-09-30T22:25:20.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.738+0000 7f58b0283700 1 -- 172.21.15.156:0/322435019 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a8120400 con 0x7f58a80a0a70 2023-09-30T22:25:20.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.738+0000 7f589effd700 1 -- 172.21.15.156:0/322435019 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a40038a0 con 0x7f58a80a0a70 2023-09-30T22:25:20.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.739+0000 7f58b0283700 1 -- 172.21.15.156:0/322435019 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a8120bf0 con 0x7f58a80a0a70 2023-09-30T22:25:20.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.739+0000 7f58b0283700 1 -- 172.21.15.156:0/322435019 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a804f2a0 con 0x7f58a80a0a70 2023-09-30T22:25:20.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.740+0000 7f589effd700 1 -- 172.21.15.156:0/322435019 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f58a4003a00 con 0x7f58a80a0a70 2023-09-30T22:25:20.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.741+0000 7f589effd700 1 -- 172.21.15.156:0/322435019 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f58a403ec10 con 0x7f58a80a0a70 2023-09-30T22:25:20.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.744+0000 7f589effd700 1 -- 172.21.15.156:0/322435019 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f58a4003cb0 con 0x7f58a80a0a70 2023-09-30T22:25:20.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.844+0000 7f142e1f5700 1 -- 172.21.15.156:0/2802151366 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f142809e3a0 con 0x7f142806a770 2023-09-30T22:25:20.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.845+0000 7f140ffff700 1 -- 172.21.15.156:0/2802151366 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f141802b070 con 0x7f142806a770 2023-09-30T22:25:20.845 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:20.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.847+0000 7f142e1f5700 1 -- 172.21.15.156:0/2802151366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f142806a770 msgr2=0x7f1428131b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.847+0000 7f142e1f5700 1 --2- 172.21.15.156:0/2802151366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f142806a770 0x7f1428131b80 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f1418009840 tx=0x7f1418004750 comp rx=0 tx=0).stop 2023-09-30T22:25:20.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.847+0000 7f142e1f5700 1 -- 172.21.15.156:0/2802151366 shutdown_connections 2023-09-30T22:25:20.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.847+0000 7f142e1f5700 1 --2- 172.21.15.156:0/2802151366 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1428136cb0 0x7f1428132600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.847+0000 7f142e1f5700 1 --2- 172.21.15.156:0/2802151366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f142806a770 0x7f1428131b80 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.847+0000 7f142e1f5700 1 --2- 172.21.15.156:0/2802151366 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f142809dec0 0x7f14281320c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.847+0000 7f142e1f5700 1 -- 172.21.15.156:0/2802151366 >> 172.21.15.156:0/2802151366 conn(0x7f1428099c40 msgr2=0x7f14280a18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:20.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.847+0000 7f142e1f5700 1 -- 172.21.15.156:0/2802151366 shutdown_connections 2023-09-30T22:25:20.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.847+0000 7f142e1f5700 1 -- 172.21.15.156:0/2802151366 wait complete. 2023-09-30T22:25:20.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.858+0000 7fd72d3d5700 1 -- 172.21.15.156:0/2319921932 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd708005590 con 0x7fd72812cef0 2023-09-30T22:25:20.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.858+0000 7fd70f7fe700 1 -- 172.21.15.156:0/2319921932 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd718015020 con 0x7fd72812cef0 2023-09-30T22:25:20.859 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:20.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.860+0000 7fd72d3d5700 1 -- 172.21.15.156:0/2319921932 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd72812cef0 msgr2=0x7fd728119c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.860+0000 7fd72d3d5700 1 --2- 172.21.15.156:0/2319921932 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd72812cef0 0x7fd728119c70 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fd718000c00 tx=0x7fd718004750 comp rx=0 tx=0).stop 2023-09-30T22:25:20.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.861+0000 7fd72d3d5700 1 -- 172.21.15.156:0/2319921932 shutdown_connections 2023-09-30T22:25:20.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.861+0000 7fd72d3d5700 1 --2- 172.21.15.156:0/2319921932 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd728133e50 0x7fd72811b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.861+0000 7fd72d3d5700 1 --2- 172.21.15.156:0/2319921932 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd72812cef0 0x7fd728119c70 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.861+0000 7fd72d3d5700 1 --2- 172.21.15.156:0/2319921932 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd728133540 0x7fd72811a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.861+0000 7fd72d3d5700 1 -- 172.21.15.156:0/2319921932 >> 172.21.15.156:0/2319921932 conn(0x7fd728099c40 msgr2=0x7fd7280a30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:20.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.861+0000 7fd72d3d5700 1 -- 172.21.15.156:0/2319921932 shutdown_connections 2023-09-30T22:25:20.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.861+0000 7fd72d3d5700 1 -- 172.21.15.156:0/2319921932 wait complete. 2023-09-30T22:25:20.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:20.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.865+0000 7f82471f3700 1 -- 172.21.15.156:0/2459515638 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f824004f2a0 con 0x7f8240130890 2023-09-30T22:25:20.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.866+0000 7f823d7fa700 1 -- 172.21.15.156:0/2459515638 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8238012340 con 0x7f8240130890 2023-09-30T22:25:20.866 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:20.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.869+0000 7f82471f3700 1 -- 172.21.15.156:0/2459515638 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8240130890 msgr2=0x7f82401ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.869+0000 7f82471f3700 1 --2- 172.21.15.156:0/2459515638 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8240130890 0x7f82401ccfb0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f8238009dd0 tx=0x7f823800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.869+0000 7f82471f3700 1 -- 172.21.15.156:0/2459515638 shutdown_connections 2023-09-30T22:25:20.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.869+0000 7f82471f3700 1 --2- 172.21.15.156:0/2459515638 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8240130890 0x7f82401ccfb0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.869+0000 7f82471f3700 1 --2- 172.21.15.156:0/2459515638 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8240099e20 0x7f82401cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.869+0000 7f82471f3700 1 --2- 172.21.15.156:0/2459515638 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f824009a730 0x7f82401cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.869+0000 7f82471f3700 1 -- 172.21.15.156:0/2459515638 >> 172.21.15.156:0/2459515638 conn(0x7f82400a2980 msgr2=0x7f824009fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:20.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.869+0000 7f82471f3700 1 -- 172.21.15.156:0/2459515638 shutdown_connections 2023-09-30T22:25:20.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.869+0000 7f82471f3700 1 -- 172.21.15.156:0/2459515638 wait complete. 2023-09-30T22:25:20.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:20.886 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:20.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.949+0000 7f58b0283700 1 -- 172.21.15.156:0/322435019 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f58a8072980 con 0x7f58a80a0a70 2023-09-30T22:25:20.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.950+0000 7f589effd700 1 -- 172.21.15.156:0/322435019 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f58a4017070 con 0x7f58a80a0a70 2023-09-30T22:25:20.951 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:20.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.952+0000 7f58b0283700 1 -- 172.21.15.156:0/322435019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f58a80a0a70 msgr2=0x7f58a811e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.952+0000 7f58b0283700 1 --2- 172.21.15.156:0/322435019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f58a80a0a70 0x7f58a811e7f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f58a4000f60 tx=0x7f58a400c730 comp rx=0 tx=0).stop 2023-09-30T22:25:20.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.952+0000 7f58b0283700 1 -- 172.21.15.156:0/322435019 shutdown_connections 2023-09-30T22:25:20.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.952+0000 7f58b0283700 1 --2- 172.21.15.156:0/322435019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58a8139200 0x7f58a811f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.952+0000 7f58b0283700 1 --2- 172.21.15.156:0/322435019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f58a80a0a70 0x7f58a811e7f0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.952+0000 7f58b0283700 1 --2- 172.21.15.156:0/322435019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58a80a1550 0x7f58a811ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.952+0000 7f58b0283700 1 -- 172.21.15.156:0/322435019 >> 172.21.15.156:0/322435019 conn(0x7f58a80a6610 msgr2=0x7f58a8138120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:20.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.952+0000 7f58b0283700 1 -- 172.21.15.156:0/322435019 shutdown_connections 2023-09-30T22:25:20.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:20.952+0000 7f58b0283700 1 -- 172.21.15.156:0/322435019 wait complete. 2023-09-30T22:25:20.965 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:21.863 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:21.876 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:21.887 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:21.966 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:22.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.007+0000 7f6e4d22d700 1 Processor -- start 2023-09-30T22:25:22.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.007+0000 7f6e4d22d700 1 -- start start 2023-09-30T22:25:22.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.008+0000 7f6e4d22d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e4806a770 0x7f6e4806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.008+0000 7f6e4d22d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6e4809dec0 0x7f6e4806b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.008+0000 7f6e4d22d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e4806b5c0 con 0x7f6e48131a00 2023-09-30T22:25:22.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.008+0000 7f6e4d22d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e4806e900 con 0x7f6e4809dec0 2023-09-30T22:25:22.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.008+0000 7f6e4d22d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4809d180 con 0x7f6e4806a770 2023-09-30T22:25:22.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.008+0000 7f6e4759e700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6e48131a00 0x7f6e48131e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47206/0 (socket says 172.21.15.156:47206) 2023-09-30T22:25:22.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.008+0000 7f6e4759e700 1 -- 172.21.15.156:0/1502022639 learned_addr learned my addr 172.21.15.156:0/1502022639 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:22.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.008+0000 7f6e46d9d700 1 --2- 172.21.15.156:0/1502022639 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e4806a770 0x7f6e4806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.008+0000 7f6e4659c700 1 --2- 172.21.15.156:0/1502022639 >> v2:172.21.15.156:3300/0 conn(0x7f6e4809dec0 0x7f6e4806b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.008+0000 7f6e45d9b700 1 -- 172.21.15.156:0/1502022639 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3919443345 0 0) 0x7f6e4806b5c0 con 0x7f6e48131a00 2023-09-30T22:25:22.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.008+0000 7f6e45d9b700 1 -- 172.21.15.156:0/1502022639 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e300035b0 con 0x7f6e48131a00 2023-09-30T22:25:22.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.008+0000 7f6e46d9d700 1 -- 172.21.15.156:0/1502022639 >> v2:172.21.15.156:3300/0 conn(0x7f6e4809dec0 msgr2=0x7f6e4806b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:22.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.008+0000 7f6e46d9d700 1 --2- 172.21.15.156:0/1502022639 >> v2:172.21.15.156:3300/0 conn(0x7f6e4809dec0 0x7f6e4806b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.008+0000 7f6e46d9d700 1 -- 172.21.15.156:0/1502022639 >> v1:172.21.15.156:6789/0 conn(0x7f6e48131a00 legacy=0x7f6e48131e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.008+0000 7f6e46d9d700 1 -- 172.21.15.156:0/1502022639 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4809e780 con 0x7f6e4806a770 2023-09-30T22:25:22.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.009+0000 7f6e46d9d700 1 --2- 172.21.15.156:0/1502022639 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e4806a770 0x7f6e4806ab40 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f6e38009840 tx=0x7f6e38009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a70a1f4276ef8e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:22.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.009+0000 7f6e45d9b700 1 -- 172.21.15.156:0/1502022639 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e38011830 con 0x7f6e4806a770 2023-09-30T22:25:22.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.009+0000 7f6e45d9b700 1 -- 172.21.15.156:0/1502022639 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e38011990 con 0x7f6e4806a770 2023-09-30T22:25:22.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.009+0000 7f6e45d9b700 1 -- 172.21.15.156:0/1502022639 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e38011d20 con 0x7f6e4806a770 2023-09-30T22:25:22.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.010+0000 7f6e4d22d700 1 -- 172.21.15.156:0/1502022639 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e4806a770 msgr2=0x7f6e4806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.010+0000 7f6e4d22d700 1 --2- 172.21.15.156:0/1502022639 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e4806a770 0x7f6e4806ab40 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f6e38009840 tx=0x7f6e38009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:22.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.010+0000 7f6e4d22d700 1 -- 172.21.15.156:0/1502022639 shutdown_connections 2023-09-30T22:25:22.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.010+0000 7f6e4d22d700 1 --2- 172.21.15.156:0/1502022639 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e4806a770 0x7f6e4806ab40 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.010+0000 7f6e4d22d700 1 --2- 172.21.15.156:0/1502022639 >> v2:172.21.15.156:3300/0 conn(0x7f6e4809dec0 0x7f6e4806b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.010+0000 7f6e4d22d700 1 -- 172.21.15.156:0/1502022639 >> 172.21.15.156:0/1502022639 conn(0x7f6e48099c40 msgr2=0x7f6e480a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:22.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.010+0000 7f6e4d22d700 1 -- 172.21.15.156:0/1502022639 shutdown_connections 2023-09-30T22:25:22.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.010+0000 7f6e4d22d700 1 -- 172.21.15.156:0/1502022639 wait complete. 2023-09-30T22:25:22.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.011+0000 7f6e4d22d700 1 Processor -- start 2023-09-30T22:25:22.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.011+0000 7f6e4d22d700 1 -- start start 2023-09-30T22:25:22.014 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.012+0000 7f6e4d22d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e4806a770 0x7f6e48119f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.012+0000 7f6e4d22d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e4809dec0 0x7f6e4811a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.012+0000 7f6e4d22d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e48131a00 0x7f6e4811a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.012+0000 7f6e4d22d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4811c5e0 con 0x7f6e4809dec0 2023-09-30T22:25:22.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.012+0000 7f6e4d22d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4811da30 con 0x7f6e48131a00 2023-09-30T22:25:22.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.012+0000 7f6e4d22d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e48130aa0 con 0x7f6e4806a770 2023-09-30T22:25:22.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.012+0000 7f6e46d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e4806a770 0x7f6e48119f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.012+0000 7f6e4659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e4809dec0 0x7f6e4811a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.012+0000 7f6e46d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e4806a770 0x7f6e48119f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34682/0 (socket says 172.21.15.156:34682) 2023-09-30T22:25:22.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.012+0000 7f6e4659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e4809dec0 0x7f6e4811a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47246/0 (socket says 172.21.15.156:47246) 2023-09-30T22:25:22.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.012+0000 7f6e46d9d700 1 -- 172.21.15.156:0/661000771 learned_addr learned my addr 172.21.15.156:0/661000771 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:22.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.012+0000 7f6e4759e700 1 --2- 172.21.15.156:0/661000771 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e48131a00 0x7f6e4811a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.013+0000 7f6e46d9d700 1 -- 172.21.15.156:0/661000771 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e48131a00 msgr2=0x7f6e4811a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.013+0000 7f6e46d9d700 1 --2- 172.21.15.156:0/661000771 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e48131a00 0x7f6e4811a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.013+0000 7f6e46d9d700 1 -- 172.21.15.156:0/661000771 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e4809dec0 msgr2=0x7f6e4811a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.013+0000 7f6e46d9d700 1 --2- 172.21.15.156:0/661000771 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e4809dec0 0x7f6e4811a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.013+0000 7f6e46d9d700 1 -- 172.21.15.156:0/661000771 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e380094a0 con 0x7f6e4806a770 2023-09-30T22:25:22.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.013+0000 7f6e46d9d700 1 --2- 172.21.15.156:0/661000771 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e4806a770 0x7f6e48119f60 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f6e380090b0 tx=0x7f6e38004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:22.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.013+0000 7f6e2f7fe700 1 -- 172.21.15.156:0/661000771 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e38004590 con 0x7f6e4806a770 2023-09-30T22:25:22.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.013+0000 7f6e2f7fe700 1 -- 172.21.15.156:0/661000771 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3801f070 con 0x7f6e4806a770 2023-09-30T22:25:22.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.013+0000 7f6e4d22d700 1 -- 172.21.15.156:0/661000771 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e4811d1c0 con 0x7f6e4806a770 2023-09-30T22:25:22.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.013+0000 7f6e2f7fe700 1 -- 172.21.15.156:0/661000771 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e380038e0 con 0x7f6e4806a770 2023-09-30T22:25:22.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.013+0000 7f6e4d22d700 1 -- 172.21.15.156:0/661000771 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4811cd70 con 0x7f6e4806a770 2023-09-30T22:25:22.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.014+0000 7f6e2f7fe700 1 -- 172.21.15.156:0/661000771 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6e38003a40 con 0x7f6e4806a770 2023-09-30T22:25:22.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.014+0000 7f6e4d22d700 1 -- 172.21.15.156:0/661000771 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e4804f2a0 con 0x7f6e4806a770 2023-09-30T22:25:22.017 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.014+0000 7f6e2f7fe700 1 -- 172.21.15.156:0/661000771 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6e38021070 con 0x7f6e4806a770 2023-09-30T22:25:22.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.023+0000 7f6e2f7fe700 1 -- 172.21.15.156:0/661000771 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6e380253e0 con 0x7f6e4806a770 2023-09-30T22:25:22.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.045+0000 7ff6e7fa6700 1 Processor -- start 2023-09-30T22:25:22.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.045+0000 7ff6e7fa6700 1 -- start start 2023-09-30T22:25:22.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.046+0000 7ff6e7fa6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6e0133900 0x7ff6e0133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.046+0000 7ff6e7fa6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff6e00a10b0 0x7ff6e013b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.046+0000 7ff6e7fa6700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e009a760 con 0x7ff6e0134210 2023-09-30T22:25:22.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.046+0000 7ff6e7fa6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e01336e0 con 0x7ff6e0133900 2023-09-30T22:25:22.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.046+0000 7ff6e7fa6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e009a080 con 0x7ff6e00a10b0 2023-09-30T22:25:22.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.046+0000 7ff6e6543700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff6e00a10b0 0x7ff6e013b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.046+0000 7ff6e5d42700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6e0133900 0x7ff6e0133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.046+0000 7ff6e6543700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff6e00a10b0 0x7ff6e013b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34684/0 (socket says 172.21.15.156:34684) 2023-09-30T22:25:22.047 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.046+0000 7ff6e6543700 1 -- 172.21.15.156:0/1338222801 learned_addr learned my addr 172.21.15.156:0/1338222801 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:22.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.046+0000 7ff6e5d42700 1 -- 172.21.15.156:0/1338222801 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff6e00a10b0 msgr2=0x7ff6e013b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:22.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.046+0000 7ff6e5d42700 1 --2- 172.21.15.156:0/1338222801 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff6e00a10b0 0x7ff6e013b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.046+0000 7ff6e5d42700 1 -- 172.21.15.156:0/1338222801 >> v1:172.21.15.156:6789/0 conn(0x7ff6e0134210 legacy=0x7ff6e00a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.046+0000 7ff6e5d42700 1 -- 172.21.15.156:0/1338222801 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e00a23e0 con 0x7ff6e0133900 2023-09-30T22:25:22.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.046+0000 7ff6e5d42700 1 --2- 172.21.15.156:0/1338222801 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6e0133900 0x7ff6e0133cd0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc009850 tx=0x7ff6dc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c773979ece034c64 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:22.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.046+0000 7ff6e4d40700 1 -- 172.21.15.156:0/1338222801 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc005e30 con 0x7ff6e0133900 2023-09-30T22:25:22.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.047+0000 7ff6e4d40700 1 -- 172.21.15.156:0/1338222801 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6dc006030 con 0x7ff6e0133900 2023-09-30T22:25:22.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.047+0000 7ff6e4d40700 1 -- 172.21.15.156:0/1338222801 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc0063c0 con 0x7ff6e0133900 2023-09-30T22:25:22.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.047+0000 7ff6e7fa6700 1 -- 172.21.15.156:0/1338222801 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6e0133900 msgr2=0x7ff6e0133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.047+0000 7ff6e7fa6700 1 --2- 172.21.15.156:0/1338222801 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6e0133900 0x7ff6e0133cd0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc009850 tx=0x7ff6dc009b60 comp rx=0 tx=0).stop 2023-09-30T22:25:22.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.047+0000 7ff6e7fa6700 1 -- 172.21.15.156:0/1338222801 shutdown_connections 2023-09-30T22:25:22.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.047+0000 7ff6e7fa6700 1 --2- 172.21.15.156:0/1338222801 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6e0133900 0x7ff6e0133cd0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.047+0000 7ff6e7fa6700 1 --2- 172.21.15.156:0/1338222801 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff6e00a10b0 0x7ff6e013b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.047+0000 7ff6e7fa6700 1 -- 172.21.15.156:0/1338222801 >> 172.21.15.156:0/1338222801 conn(0x7ff6e00a2980 msgr2=0x7ff6e00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:22.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.048+0000 7ff6e7fa6700 1 -- 172.21.15.156:0/1338222801 shutdown_connections 2023-09-30T22:25:22.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.048+0000 7ff6e7fa6700 1 -- 172.21.15.156:0/1338222801 wait complete. 2023-09-30T22:25:22.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.048+0000 7f9304918700 1 Processor -- start 2023-09-30T22:25:22.050 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.048+0000 7f9304918700 1 -- start start 2023-09-30T22:25:22.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.049+0000 7ff6e7fa6700 1 Processor -- start 2023-09-30T22:25:22.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.049+0000 7ff6e7fa6700 1 -- start start 2023-09-30T22:25:22.051 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.049+0000 7f9304918700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9300136960 0x7f9300138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.049+0000 7f9304918700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9300139280 0x7f930013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.049+0000 7f9304918700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f930006b2d0 con 0x7f9300133ad0 2023-09-30T22:25:22.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.049+0000 7f9304918700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93001345b0 con 0x7f9300139280 2023-09-30T22:25:22.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.049+0000 7f9304918700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9300133610 con 0x7f9300136960 2023-09-30T22:25:22.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.049+0000 7f92fe59c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f9300133ad0 0x7f9300133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47220/0 (socket says 172.21.15.156:47220) 2023-09-30T22:25:22.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.049+0000 7f92fe59c700 1 -- 172.21.15.156:0/3938911085 learned_addr learned my addr 172.21.15.156:0/3938911085 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:22.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.049+0000 7f92fdd9b700 1 --2- 172.21.15.156:0/3938911085 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9300136960 0x7f9300138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.050+0000 7f92fd59a700 1 -- 172.21.15.156:0/3938911085 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1064810770 0 0) 0x7f930006b2d0 con 0x7f9300133ad0 2023-09-30T22:25:22.052 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.050+0000 7f92fd59a700 1 -- 172.21.15.156:0/3938911085 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92e80035b0 con 0x7f9300133ad0 2023-09-30T22:25:22.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.050+0000 7ff6e7fa6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff6e00a10b0 0x7ff6e011c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.050+0000 7ff6e7fa6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6e0133900 0x7ff6e011cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.050+0000 7ff6e7fa6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6e0134210 0x7ff6e011d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.050+0000 7ff6e7fa6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e01200d0 con 0x7ff6e0133900 2023-09-30T22:25:22.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.050+0000 7ff6e7fa6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e011ea30 con 0x7ff6e0134210 2023-09-30T22:25:22.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.050+0000 7ff6e7fa6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e012fbe0 con 0x7ff6e00a10b0 2023-09-30T22:25:22.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.050+0000 7ff6e5541700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6e0133900 0x7ff6e011cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.050+0000 7ff6e5541700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6e0133900 0x7ff6e011cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47270/0 (socket says 172.21.15.156:47270) 2023-09-30T22:25:22.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.050+0000 7ff6e5541700 1 -- 172.21.15.156:0/2592300933 learned_addr learned my addr 172.21.15.156:0/2592300933 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:22.053 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.050+0000 7ff6e6543700 1 --2- 172.21.15.156:0/2592300933 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6e0134210 0x7ff6e011d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.050+0000 7f92fdd9b700 1 -- 172.21.15.156:0/3938911085 >> v2:172.21.15.156:3300/0 conn(0x7f9300139280 msgr2=0x7f930013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:22.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.050+0000 7f92fd59a700 1 -- 172.21.15.156:0/3938911085 <== mon.0 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 368083832 0 0) 0x7f92e80035b0 con 0x7f9300133ad0 2023-09-30T22:25:22.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.050+0000 7f92fdd9b700 1 --2- 172.21.15.156:0/3938911085 >> v2:172.21.15.156:3300/0 conn(0x7f9300139280 0x7f930013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.050+0000 7f92fdd9b700 1 -- 172.21.15.156:0/3938911085 >> v1:172.21.15.156:6789/0 conn(0x7f9300133ad0 legacy=0x7f9300133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.050+0000 7f92fdd9b700 1 -- 172.21.15.156:0/3938911085 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930009a500 con 0x7f9300136960 2023-09-30T22:25:22.054 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.050+0000 7ff6e5d42700 1 --2- 172.21.15.156:0/2592300933 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff6e00a10b0 0x7ff6e011c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.050+0000 7ff6e6543700 1 -- 172.21.15.156:0/2592300933 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff6e00a10b0 msgr2=0x7ff6e011c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.050+0000 7ff6e6543700 1 --2- 172.21.15.156:0/2592300933 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff6e00a10b0 0x7ff6e011c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.050+0000 7ff6e6543700 1 -- 172.21.15.156:0/2592300933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6e0133900 msgr2=0x7ff6e011cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.050+0000 7ff6e6543700 1 --2- 172.21.15.156:0/2592300933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6e0133900 0x7ff6e011cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.050+0000 7ff6e6543700 1 -- 172.21.15.156:0/2592300933 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6dc009430 con 0x7ff6e0134210 2023-09-30T22:25:22.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.050+0000 7f92fdd9b700 1 --2- 172.21.15.156:0/3938911085 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9300136960 0x7f9300138d40 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f92f4009870 tx=0x7f92f4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75684b124e91eb86 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:22.055 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.050+0000 7ff6e6543700 1 --2- 172.21.15.156:0/2592300933 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6e0134210 0x7ff6e011d2b0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8007a70 tx=0x7ff6d8007d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:22.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.051+0000 7f92fd59a700 1 -- 172.21.15.156:0/3938911085 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f0001670 con 0x7f9300136960 2023-09-30T22:25:22.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.051+0000 7f92fd59a700 1 -- 172.21.15.156:0/3938911085 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f4004030 con 0x7f9300136960 2023-09-30T22:25:22.056 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.051+0000 7ff6d67fc700 1 -- 172.21.15.156:0/2592300933 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d800d9d0 con 0x7ff6e0134210 2023-09-30T22:25:22.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.051+0000 7f92fd59a700 1 -- 172.21.15.156:0/3938911085 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f40043c0 con 0x7f9300136960 2023-09-30T22:25:22.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.051+0000 7ff6d67fc700 1 -- 172.21.15.156:0/2592300933 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d800f040 con 0x7ff6e0134210 2023-09-30T22:25:22.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.051+0000 7ff6e7fa6700 1 -- 172.21.15.156:0/2592300933 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e01330c0 con 0x7ff6e0134210 2023-09-30T22:25:22.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.051+0000 7ff6d67fc700 1 -- 172.21.15.156:0/2592300933 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d800dd70 con 0x7ff6e0134210 2023-09-30T22:25:22.057 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.051+0000 7ff6e7fa6700 1 -- 172.21.15.156:0/2592300933 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e011faa0 con 0x7ff6e0134210 2023-09-30T22:25:22.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.052+0000 7f9304918700 1 -- 172.21.15.156:0/3938911085 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9300136960 msgr2=0x7f9300138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.052+0000 7f9304918700 1 --2- 172.21.15.156:0/3938911085 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9300136960 0x7f9300138d40 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f92f4009870 tx=0x7f92f4009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:22.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.052+0000 7f9304918700 1 -- 172.21.15.156:0/3938911085 shutdown_connections 2023-09-30T22:25:22.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.052+0000 7f9304918700 1 --2- 172.21.15.156:0/3938911085 >> v2:172.21.15.156:3300/0 conn(0x7f9300139280 0x7f930013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.052+0000 7f9304918700 1 --2- 172.21.15.156:0/3938911085 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9300136960 0x7f9300138d40 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.058 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.052+0000 7f9304918700 1 -- 172.21.15.156:0/3938911085 >> 172.21.15.156:0/3938911085 conn(0x7f9300099c40 msgr2=0x7f93000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:22.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.052+0000 7ff6d67fc700 1 -- 172.21.15.156:0/2592300933 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff6d801e3b0 con 0x7ff6e0134210 2023-09-30T22:25:22.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.052+0000 7ff6d67fc700 1 -- 172.21.15.156:0/2592300933 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff6d8043310 con 0x7ff6e0134210 2023-09-30T22:25:22.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.052+0000 7f9304918700 1 -- 172.21.15.156:0/3938911085 shutdown_connections 2023-09-30T22:25:22.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.052+0000 7f9304918700 1 -- 172.21.15.156:0/3938911085 wait complete. 2023-09-30T22:25:22.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.053+0000 7f9304918700 1 Processor -- start 2023-09-30T22:25:22.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.053+0000 7f9304918700 1 -- start start 2023-09-30T22:25:22.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.054+0000 7ff6e7fa6700 1 -- 172.21.15.156:0/2592300933 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e004f2a0 con 0x7ff6e0134210 2023-09-30T22:25:22.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.054+0000 7f9304918700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9300133ad0 0x7f93001ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.054+0000 7f9304918700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9300136960 0x7f93001cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.054+0000 7f9304918700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9300139280 0x7f930012ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.054+0000 7f9304918700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93001cc8a0 con 0x7f9300139280 2023-09-30T22:25:22.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.054+0000 7f9304918700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930011afd0 con 0x7f9300133ad0 2023-09-30T22:25:22.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.054+0000 7f9304918700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93001300c0 con 0x7f9300136960 2023-09-30T22:25:22.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.054+0000 7f92fe59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9300133ad0 0x7f93001ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.054+0000 7f92fe59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9300133ad0 0x7f93001ccc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48886/0 (socket says 172.21.15.156:48886) 2023-09-30T22:25:22.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.054+0000 7f92fe59c700 1 -- 172.21.15.156:0/2603173117 learned_addr learned my addr 172.21.15.156:0/2603173117 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:22.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.054+0000 7f92fed9d700 1 --2- 172.21.15.156:0/2603173117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9300139280 0x7f930012ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.054+0000 7f92fdd9b700 1 --2- 172.21.15.156:0/2603173117 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9300136960 0x7f93001cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.055+0000 7f92fe59c700 1 -- 172.21.15.156:0/2603173117 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9300136960 msgr2=0x7f93001cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.055+0000 7f92fe59c700 1 --2- 172.21.15.156:0/2603173117 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9300136960 0x7f93001cd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.055+0000 7f92fe59c700 1 -- 172.21.15.156:0/2603173117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9300139280 msgr2=0x7f930012ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.055+0000 7f92fe59c700 1 --2- 172.21.15.156:0/2603173117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9300139280 0x7f930012ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.055+0000 7f92fe59c700 1 -- 172.21.15.156:0/2603173117 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f40094a0 con 0x7f9300133ad0 2023-09-30T22:25:22.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.055+0000 7f92fe59c700 1 --2- 172.21.15.156:0/2603173117 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9300133ad0 0x7f93001ccc20 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f92f000c520 tx=0x7f92f000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:22.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.059+0000 7ff6d67fc700 1 -- 172.21.15.156:0/2592300933 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff6d801a020 con 0x7ff6e0134210 2023-09-30T22:25:22.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.059+0000 7f92eeffd700 1 -- 172.21.15.156:0/2603173117 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f0004c80 con 0x7f9300133ad0 2023-09-30T22:25:22.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.059+0000 7f92eeffd700 1 -- 172.21.15.156:0/2603173117 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f0004de0 con 0x7f9300133ad0 2023-09-30T22:25:22.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.059+0000 7f9304918700 1 -- 172.21.15.156:0/2603173117 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f930011a660 con 0x7f9300133ad0 2023-09-30T22:25:22.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.059+0000 7f92eeffd700 1 -- 172.21.15.156:0/2603173117 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f00072d0 con 0x7f9300133ad0 2023-09-30T22:25:22.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.059+0000 7f9304918700 1 -- 172.21.15.156:0/2603173117 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f930009f390 con 0x7f9300133ad0 2023-09-30T22:25:22.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.060+0000 7f9304918700 1 -- 172.21.15.156:0/2603173117 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93001308a0 con 0x7f9300133ad0 2023-09-30T22:25:22.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.060+0000 7f92eeffd700 1 -- 172.21.15.156:0/2603173117 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f92f0007430 con 0x7f9300133ad0 2023-09-30T22:25:22.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.060+0000 7f92eeffd700 1 -- 172.21.15.156:0/2603173117 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f92f003f550 con 0x7f9300133ad0 2023-09-30T22:25:22.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.065+0000 7f92eeffd700 1 -- 172.21.15.156:0/2603173117 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92f00076e0 con 0x7f9300133ad0 2023-09-30T22:25:22.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.128+0000 7f5361628700 1 Processor -- start 2023-09-30T22:25:22.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.128+0000 7f5361628700 1 -- start start 2023-09-30T22:25:22.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.129+0000 7f5361628700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f535c09e870 0x7f535c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.129+0000 7f5361628700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f535c09f180 0x7f535c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.129+0000 7f5361628700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f535c131d70 0x7f535c132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.129+0000 7f5361628700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f535c0a0920 con 0x7f535c131d70 2023-09-30T22:25:22.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.129+0000 7f5361628700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535c09c970 con 0x7f535c09f180 2023-09-30T22:25:22.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.129+0000 7f5361628700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f535c09bab0 con 0x7f535c09e870 2023-09-30T22:25:22.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.129+0000 7f535a7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f535c09f180 0x7f535c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.129+0000 7f535a7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f535c09f180 0x7f535c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48894/0 (socket says 172.21.15.156:48894) 2023-09-30T22:25:22.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.129+0000 7f535a7fc700 1 -- 172.21.15.156:0/2318851322 learned_addr learned my addr 172.21.15.156:0/2318851322 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:22.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.129+0000 7f535affd700 1 --2- 172.21.15.156:0/2318851322 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f535c09e870 0x7f535c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.129+0000 7f535b7fe700 1 --2- 172.21.15.156:0/2318851322 >> v2:172.21.15.156:3300/0 conn(0x7f535c131d70 0x7f535c132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.129+0000 7f535a7fc700 1 -- 172.21.15.156:0/2318851322 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f535c09e870 msgr2=0x7f535c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:22.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.129+0000 7f535a7fc700 1 --2- 172.21.15.156:0/2318851322 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f535c09e870 0x7f535c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.129+0000 7f535a7fc700 1 -- 172.21.15.156:0/2318851322 >> v2:172.21.15.156:3300/0 conn(0x7f535c131d70 msgr2=0x7f535c132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:22.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.129+0000 7f535a7fc700 1 --2- 172.21.15.156:0/2318851322 >> v2:172.21.15.156:3300/0 conn(0x7f535c131d70 0x7f535c132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.129+0000 7f535a7fc700 1 -- 172.21.15.156:0/2318851322 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535c09f9c0 con 0x7f535c09f180 2023-09-30T22:25:22.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.130+0000 7f535a7fc700 1 --2- 172.21.15.156:0/2318851322 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f535c09f180 0x7f535c131830 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f53500098f0 tx=0x7f5350009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f264dd2bae58fbd8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:22.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.130+0000 7f5359ffb700 1 -- 172.21.15.156:0/2318851322 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5350011830 con 0x7f535c09f180 2023-09-30T22:25:22.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.130+0000 7f5359ffb700 1 -- 172.21.15.156:0/2318851322 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5350011990 con 0x7f535c09f180 2023-09-30T22:25:22.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.130+0000 7f5359ffb700 1 -- 172.21.15.156:0/2318851322 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5350011d20 con 0x7f535c09f180 2023-09-30T22:25:22.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.130+0000 7f5361628700 1 -- 172.21.15.156:0/2318851322 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f535c09f180 msgr2=0x7f535c131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.130+0000 7f5361628700 1 --2- 172.21.15.156:0/2318851322 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f535c09f180 0x7f535c131830 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f53500098f0 tx=0x7f5350009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:22.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.130+0000 7f5361628700 1 -- 172.21.15.156:0/2318851322 shutdown_connections 2023-09-30T22:25:22.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.130+0000 7f5361628700 1 --2- 172.21.15.156:0/2318851322 >> v2:172.21.15.156:3300/0 conn(0x7f535c131d70 0x7f535c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.130+0000 7f5361628700 1 --2- 172.21.15.156:0/2318851322 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f535c09e870 0x7f535c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.130+0000 7f5361628700 1 --2- 172.21.15.156:0/2318851322 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f535c09f180 0x7f535c131830 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.130+0000 7f5361628700 1 -- 172.21.15.156:0/2318851322 >> 172.21.15.156:0/2318851322 conn(0x7f535c0a4430 msgr2=0x7f535c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:22.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.131+0000 7f5361628700 1 -- 172.21.15.156:0/2318851322 shutdown_connections 2023-09-30T22:25:22.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.131+0000 7f5361628700 1 -- 172.21.15.156:0/2318851322 wait complete. 2023-09-30T22:25:22.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.132+0000 7f5361628700 1 Processor -- start 2023-09-30T22:25:22.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.132+0000 7f5361628700 1 -- start start 2023-09-30T22:25:22.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.133+0000 7f5361628700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f535c09e870 0x7f535c11d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.133+0000 7f5361628700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f535c09f180 0x7f535c11d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.133+0000 7f5361628700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f535c131d70 0x7f535c11daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.133+0000 7f5361628700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535c0a2c60 con 0x7f535c131d70 2023-09-30T22:25:22.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.133+0000 7f5361628700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535c11edb0 con 0x7f535c09e870 2023-09-30T22:25:22.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.133+0000 7f5361628700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f535c11fe80 con 0x7f535c09f180 2023-09-30T22:25:22.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.133+0000 7f535affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f535c09e870 0x7f535c11d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.133+0000 7f535affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f535c09e870 0x7f535c11d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48900/0 (socket says 172.21.15.156:48900) 2023-09-30T22:25:22.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.133+0000 7f535affd700 1 -- 172.21.15.156:0/2036048389 learned_addr learned my addr 172.21.15.156:0/2036048389 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:22.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.133+0000 7f535a7fc700 1 --2- 172.21.15.156:0/2036048389 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f535c09f180 0x7f535c11d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.133+0000 7f535b7fe700 1 --2- 172.21.15.156:0/2036048389 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f535c131d70 0x7f535c11daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.133+0000 7f535affd700 1 -- 172.21.15.156:0/2036048389 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f535c09f180 msgr2=0x7f535c11d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.133+0000 7f535affd700 1 --2- 172.21.15.156:0/2036048389 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f535c09f180 0x7f535c11d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.133+0000 7f535affd700 1 -- 172.21.15.156:0/2036048389 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f535c131d70 msgr2=0x7f535c11daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.133+0000 7f535affd700 1 --2- 172.21.15.156:0/2036048389 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f535c131d70 0x7f535c11daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.133+0000 7f535affd700 1 -- 172.21.15.156:0/2036048389 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5350009550 con 0x7f535c09e870 2023-09-30T22:25:22.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.133+0000 7f535affd700 1 --2- 172.21.15.156:0/2036048389 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f535c09e870 0x7f535c11d020 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f534c00e930 tx=0x7f534c00ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:22.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.134+0000 7f53437fe700 1 -- 172.21.15.156:0/2036048389 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c024690 con 0x7f535c09e870 2023-09-30T22:25:22.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.134+0000 7f53437fe700 1 -- 172.21.15.156:0/2036048389 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534c0247f0 con 0x7f535c09e870 2023-09-30T22:25:22.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.134+0000 7f53437fe700 1 -- 172.21.15.156:0/2036048389 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c024b60 con 0x7f535c09e870 2023-09-30T22:25:22.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.134+0000 7f5361628700 1 -- 172.21.15.156:0/2036048389 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f535c120b40 con 0x7f535c09e870 2023-09-30T22:25:22.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.134+0000 7f5361628700 1 -- 172.21.15.156:0/2036048389 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f535c1205a0 con 0x7f535c09e870 2023-09-30T22:25:22.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.134+0000 7f53437fe700 1 -- 172.21.15.156:0/2036048389 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f534c024cc0 con 0x7f535c09e870 2023-09-30T22:25:22.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.135+0000 7f53437fe700 1 -- 172.21.15.156:0/2036048389 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f534c0531c0 con 0x7f535c09e870 2023-09-30T22:25:22.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.135+0000 7f5361628700 1 -- 172.21.15.156:0/2036048389 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f535c1202d0 con 0x7f535c09e870 2023-09-30T22:25:22.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.144+0000 7f53437fe700 1 -- 172.21.15.156:0/2036048389 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f534c028020 con 0x7f535c09e870 2023-09-30T22:25:22.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.224+0000 7f6e4d22d700 1 -- 172.21.15.156:0/661000771 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6e4809e380 con 0x7f6e4806a770 2023-09-30T22:25:22.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.225+0000 7f6e2f7fe700 1 -- 172.21.15.156:0/661000771 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6e38015070 con 0x7f6e4806a770 2023-09-30T22:25:22.226 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:22.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.227+0000 7f6e4d22d700 1 -- 172.21.15.156:0/661000771 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e4806a770 msgr2=0x7f6e48119f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.227+0000 7f6e4d22d700 1 --2- 172.21.15.156:0/661000771 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e4806a770 0x7f6e48119f60 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f6e380090b0 tx=0x7f6e38004750 comp rx=0 tx=0).stop 2023-09-30T22:25:22.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.227+0000 7f6e4d22d700 1 -- 172.21.15.156:0/661000771 shutdown_connections 2023-09-30T22:25:22.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.227+0000 7f6e4d22d700 1 --2- 172.21.15.156:0/661000771 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6e48131a00 0x7f6e4811a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.227+0000 7f6e4d22d700 1 --2- 172.21.15.156:0/661000771 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6e4806a770 0x7f6e48119f60 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.227+0000 7f6e4d22d700 1 --2- 172.21.15.156:0/661000771 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e4809dec0 0x7f6e4811a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.227+0000 7f6e4d22d700 1 -- 172.21.15.156:0/661000771 >> 172.21.15.156:0/661000771 conn(0x7f6e48099c40 msgr2=0x7f6e4812ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:22.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.227+0000 7f6e4d22d700 1 -- 172.21.15.156:0/661000771 shutdown_connections 2023-09-30T22:25:22.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.227+0000 7f6e4d22d700 1 -- 172.21.15.156:0/661000771 wait complete. 2023-09-30T22:25:22.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:22.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.261+0000 7f9304918700 1 -- 172.21.15.156:0/2603173117 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f930004f2a0 con 0x7f9300133ad0 2023-09-30T22:25:22.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.262+0000 7f92eeffd700 1 -- 172.21.15.156:0/2603173117 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f92f001bb30 con 0x7f9300133ad0 2023-09-30T22:25:22.262 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:22.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.264+0000 7f9304918700 1 -- 172.21.15.156:0/2603173117 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9300133ad0 msgr2=0x7f93001ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.264+0000 7f9304918700 1 --2- 172.21.15.156:0/2603173117 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9300133ad0 0x7f93001ccc20 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f92f000c520 tx=0x7f92f000c830 comp rx=0 tx=0).stop 2023-09-30T22:25:22.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.264+0000 7f9304918700 1 -- 172.21.15.156:0/2603173117 shutdown_connections 2023-09-30T22:25:22.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.264+0000 7f9304918700 1 --2- 172.21.15.156:0/2603173117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9300139280 0x7f930012ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.264+0000 7f9304918700 1 --2- 172.21.15.156:0/2603173117 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9300133ad0 0x7f93001ccc20 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.264+0000 7f9304918700 1 --2- 172.21.15.156:0/2603173117 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9300136960 0x7f93001cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.264+0000 7f9304918700 1 -- 172.21.15.156:0/2603173117 >> 172.21.15.156:0/2603173117 conn(0x7f9300099c40 msgr2=0x7f9300134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:22.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.264+0000 7f9304918700 1 -- 172.21.15.156:0/2603173117 shutdown_connections 2023-09-30T22:25:22.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.264+0000 7f9304918700 1 -- 172.21.15.156:0/2603173117 wait complete. 2023-09-30T22:25:22.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:22.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.301+0000 7ff6e7fa6700 1 -- 172.21.15.156:0/2592300933 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff6e006bce0 con 0x7ff6e0134210 2023-09-30T22:25:22.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.302+0000 7ff6d67fc700 1 -- 172.21.15.156:0/2592300933 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff6d8042030 con 0x7ff6e0134210 2023-09-30T22:25:22.303 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:22.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.304+0000 7ff6e7fa6700 1 -- 172.21.15.156:0/2592300933 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6e0134210 msgr2=0x7ff6e011d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.304+0000 7ff6e7fa6700 1 --2- 172.21.15.156:0/2592300933 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6e0134210 0x7ff6e011d2b0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8007a70 tx=0x7ff6d8007d80 comp rx=0 tx=0).stop 2023-09-30T22:25:22.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.304+0000 7ff6e7fa6700 1 -- 172.21.15.156:0/2592300933 shutdown_connections 2023-09-30T22:25:22.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.304+0000 7ff6e7fa6700 1 --2- 172.21.15.156:0/2592300933 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff6e0134210 0x7ff6e011d2b0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.304+0000 7ff6e7fa6700 1 --2- 172.21.15.156:0/2592300933 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff6e00a10b0 0x7ff6e011c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.304+0000 7ff6e7fa6700 1 --2- 172.21.15.156:0/2592300933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6e0133900 0x7ff6e011cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.304+0000 7ff6e7fa6700 1 -- 172.21.15.156:0/2592300933 >> 172.21.15.156:0/2592300933 conn(0x7ff6e00a2980 msgr2=0x7ff6e01314d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:22.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.304+0000 7ff6e7fa6700 1 -- 172.21.15.156:0/2592300933 shutdown_connections 2023-09-30T22:25:22.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.304+0000 7ff6e7fa6700 1 -- 172.21.15.156:0/2592300933 wait complete. 2023-09-30T22:25:22.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:22.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.356+0000 7f5361628700 1 -- 172.21.15.156:0/2036048389 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f535c0727b0 con 0x7f535c09e870 2023-09-30T22:25:22.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.356+0000 7f53437fe700 1 -- 172.21.15.156:0/2036048389 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f534c055060 con 0x7f535c09e870 2023-09-30T22:25:22.357 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:22.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.358+0000 7f5361628700 1 -- 172.21.15.156:0/2036048389 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f535c09e870 msgr2=0x7f535c11d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.358+0000 7f5361628700 1 --2- 172.21.15.156:0/2036048389 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f535c09e870 0x7f535c11d020 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f534c00e930 tx=0x7f534c00ec40 comp rx=0 tx=0).stop 2023-09-30T22:25:22.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.358+0000 7f5361628700 1 -- 172.21.15.156:0/2036048389 shutdown_connections 2023-09-30T22:25:22.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.358+0000 7f5361628700 1 --2- 172.21.15.156:0/2036048389 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f535c131d70 0x7f535c11daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.358+0000 7f5361628700 1 --2- 172.21.15.156:0/2036048389 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f535c09e870 0x7f535c11d020 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.358+0000 7f5361628700 1 --2- 172.21.15.156:0/2036048389 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f535c09f180 0x7f535c11d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.358+0000 7f5361628700 1 -- 172.21.15.156:0/2036048389 >> 172.21.15.156:0/2036048389 conn(0x7f535c0a4430 msgr2=0x7f535c06f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:22.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.358+0000 7f5361628700 1 -- 172.21.15.156:0/2036048389 shutdown_connections 2023-09-30T22:25:22.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:22.358+0000 7f5361628700 1 -- 172.21.15.156:0/2036048389 wait complete. 2023-09-30T22:25:22.371 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:23.241 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:23.277 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:23.318 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:23.372 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:23.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.384+0000 7fb99f761700 1 Processor -- start 2023-09-30T22:25:23.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.385+0000 7fb99f761700 1 -- start start 2023-09-30T22:25:23.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.385+0000 7fb99f761700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb99809d860 0x7fb99809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.385+0000 7fb99f761700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb99809e170 0x7fb9981307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.385+0000 7fb99f761700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb998130ce0 0x7fb998131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.385+0000 7fb99f761700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb99809aaa0 con 0x7fb998130ce0 2023-09-30T22:25:23.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.385+0000 7fb99f761700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb99809f870 con 0x7fb99809d860 2023-09-30T22:25:23.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.385+0000 7fb99f761700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb99809b360 con 0x7fb99809e170 2023-09-30T22:25:23.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.385+0000 7fb99dcfe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb998130ce0 0x7fb998131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.385+0000 7fb99dcfe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb998130ce0 0x7fb998131150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47308/0 (socket says 172.21.15.156:47308) 2023-09-30T22:25:23.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.385+0000 7fb99dcfe700 1 -- 172.21.15.156:0/1232856446 learned_addr learned my addr 172.21.15.156:0/1232856446 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:23.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.385+0000 7fb99ccfc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb99809e170 0x7fb9981307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.386+0000 7fb99d4fd700 1 --2- 172.21.15.156:0/1232856446 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb99809d860 0x7fb99809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.386+0000 7fb99ccfc700 1 -- 172.21.15.156:0/1232856446 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb99809d860 msgr2=0x7fb99809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:23.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.386+0000 7fb99ccfc700 1 --2- 172.21.15.156:0/1232856446 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb99809d860 0x7fb99809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.386+0000 7fb99ccfc700 1 -- 172.21.15.156:0/1232856446 >> v2:172.21.15.156:3300/0 conn(0x7fb998130ce0 msgr2=0x7fb998131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:23.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.386+0000 7fb99ccfc700 1 --2- 172.21.15.156:0/1232856446 >> v2:172.21.15.156:3300/0 conn(0x7fb998130ce0 0x7fb998131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.386+0000 7fb99ccfc700 1 -- 172.21.15.156:0/1232856446 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb99809b620 con 0x7fb99809e170 2023-09-30T22:25:23.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.386+0000 7fb99d4fd700 1 --2- 172.21.15.156:0/1232856446 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb99809d860 0x7fb99809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:23.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.386+0000 7fb99ccfc700 1 --2- 172.21.15.156:0/1232856446 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb99809e170 0x7fb9981307a0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb988009840 tx=0x7fb988009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44dafce576b7d811 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:23.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.386+0000 7fb98ffff700 1 -- 172.21.15.156:0/1232856446 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb988011830 con 0x7fb99809e170 2023-09-30T22:25:23.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.386+0000 7fb98ffff700 1 -- 172.21.15.156:0/1232856446 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb988011990 con 0x7fb99809e170 2023-09-30T22:25:23.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.386+0000 7fb98ffff700 1 -- 172.21.15.156:0/1232856446 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb988011d20 con 0x7fb99809e170 2023-09-30T22:25:23.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.387+0000 7fb99f761700 1 -- 172.21.15.156:0/1232856446 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb99809e170 msgr2=0x7fb9981307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.387+0000 7fb99f761700 1 --2- 172.21.15.156:0/1232856446 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb99809e170 0x7fb9981307a0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb988009840 tx=0x7fb988009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:23.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.387+0000 7fb99f761700 1 -- 172.21.15.156:0/1232856446 shutdown_connections 2023-09-30T22:25:23.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.387+0000 7fb99f761700 1 --2- 172.21.15.156:0/1232856446 >> v2:172.21.15.156:3300/0 conn(0x7fb998130ce0 0x7fb998131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.387+0000 7fb99f761700 1 --2- 172.21.15.156:0/1232856446 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb99809d860 0x7fb99809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.387+0000 7fb99f761700 1 --2- 172.21.15.156:0/1232856446 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb99809e170 0x7fb9981307a0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.387+0000 7fb99f761700 1 -- 172.21.15.156:0/1232856446 >> 172.21.15.156:0/1232856446 conn(0x7fb998099c40 msgr2=0x7fb9980a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:23.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.388+0000 7fb99f761700 1 -- 172.21.15.156:0/1232856446 shutdown_connections 2023-09-30T22:25:23.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.388+0000 7fb99f761700 1 -- 172.21.15.156:0/1232856446 wait complete. 2023-09-30T22:25:23.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.388+0000 7fb99f761700 1 Processor -- start 2023-09-30T22:25:23.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.389+0000 7fb99f761700 1 -- start start 2023-09-30T22:25:23.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.389+0000 7fb99f761700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb99809d860 0x7fb9981264b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.389+0000 7fb99f761700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb99809e170 0x7fb9981269f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.389+0000 7fb99f761700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb998130ce0 0x7fb998126f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.389+0000 7fb99f761700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb998127fc0 con 0x7fb99809e170 2023-09-30T22:25:23.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.389+0000 7fb99f761700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9981285e0 con 0x7fb99809d860 2023-09-30T22:25:23.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.389+0000 7fb99f761700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb998130290 con 0x7fb998130ce0 2023-09-30T22:25:23.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.389+0000 7fb99ccfc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb99809e170 0x7fb9981269f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.389+0000 7fb99ccfc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb99809e170 0x7fb9981269f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47320/0 (socket says 172.21.15.156:47320) 2023-09-30T22:25:23.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.389+0000 7fb99ccfc700 1 -- 172.21.15.156:0/3315715531 learned_addr learned my addr 172.21.15.156:0/3315715531 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:23.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.389+0000 7fb99d4fd700 1 --2- 172.21.15.156:0/3315715531 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb99809d860 0x7fb9981264b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.390+0000 7fb99d4fd700 1 -- 172.21.15.156:0/3315715531 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb998130ce0 msgr2=0x7fb998126f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.390+0000 7fb99d4fd700 1 --2- 172.21.15.156:0/3315715531 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb998130ce0 0x7fb998126f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.390+0000 7fb99d4fd700 1 -- 172.21.15.156:0/3315715531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb99809e170 msgr2=0x7fb9981269f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.390+0000 7fb99d4fd700 1 --2- 172.21.15.156:0/3315715531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb99809e170 0x7fb9981269f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.390+0000 7fb99d4fd700 1 -- 172.21.15.156:0/3315715531 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9940094a0 con 0x7fb99809d860 2023-09-30T22:25:23.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.390+0000 7fb99d4fd700 1 --2- 172.21.15.156:0/3315715531 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb99809d860 0x7fb9981264b0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb99400e980 tx=0x7fb99400ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:23.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.390+0000 7fb98dffb700 1 -- 172.21.15.156:0/3315715531 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99400eed0 con 0x7fb99809d860 2023-09-30T22:25:23.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.390+0000 7fb98dffb700 1 -- 172.21.15.156:0/3315715531 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb994004030 con 0x7fb99809d860 2023-09-30T22:25:23.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.390+0000 7fb98dffb700 1 -- 172.21.15.156:0/3315715531 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9940043c0 con 0x7fb99809d860 2023-09-30T22:25:23.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.390+0000 7fb99f761700 1 -- 172.21.15.156:0/3315715531 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9880094a0 con 0x7fb99809d860 2023-09-30T22:25:23.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.390+0000 7fb99f761700 1 -- 172.21.15.156:0/3315715531 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb998071ac0 con 0x7fb99809d860 2023-09-30T22:25:23.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.391+0000 7fb98dffb700 1 -- 172.21.15.156:0/3315715531 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb99400c770 con 0x7fb99809d860 2023-09-30T22:25:23.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.392+0000 7fb98dffb700 1 -- 172.21.15.156:0/3315715531 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb99403f4f0 con 0x7fb99809d860 2023-09-30T22:25:23.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.392+0000 7fb99f761700 1 -- 172.21.15.156:0/3315715531 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb99804f2a0 con 0x7fb99809d860 2023-09-30T22:25:23.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.400+0000 7fb98dffb700 1 -- 172.21.15.156:0/3315715531 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb994019950 con 0x7fb99809d860 2023-09-30T22:25:23.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.422+0000 7f06cfde0700 1 Processor -- start 2023-09-30T22:25:23.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.422+0000 7f06cfde0700 1 -- start start 2023-09-30T22:25:23.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.423+0000 7f06cfde0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f06c8134140 0x7f06c8138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.423+0000 7f06cfde0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06c81345a0 0x7f06c813b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.423+0000 7f06cfde0700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c809b110 con 0x7f06c809ad40 2023-09-30T22:25:23.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.423+0000 7f06cfde0700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c80a3b60 con 0x7f06c8134140 2023-09-30T22:25:23.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.423+0000 7f06cfde0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06c80a1a80 con 0x7f06c81345a0 2023-09-30T22:25:23.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.423+0000 7f06ce37d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06c81345a0 0x7f06c813b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.423+0000 7f06ce37d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06c81345a0 0x7f06c813b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34758/0 (socket says 172.21.15.156:34758) 2023-09-30T22:25:23.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.423+0000 7f06ce37d700 1 -- 172.21.15.156:0/3471257410 learned_addr learned my addr 172.21.15.156:0/3471257410 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:23.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.423+0000 7f06ce37d700 1 -- 172.21.15.156:0/3471257410 >> v2:172.21.15.156:3300/0 conn(0x7f06c8134140 msgr2=0x7f06c8138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:23.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.423+0000 7f06ce37d700 1 --2- 172.21.15.156:0/3471257410 >> v2:172.21.15.156:3300/0 conn(0x7f06c8134140 0x7f06c8138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.423+0000 7f06ce37d700 1 -- 172.21.15.156:0/3471257410 >> v1:172.21.15.156:6789/0 conn(0x7f06c809ad40 legacy=0x7f06c8133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:23.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.423+0000 7f06ce37d700 1 -- 172.21.15.156:0/3471257410 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c80a2fa0 con 0x7f06c81345a0 2023-09-30T22:25:23.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.424+0000 7f06ce37d700 1 --2- 172.21.15.156:0/3471257410 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06c81345a0 0x7f06c813b3d0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f06c0009e50 tx=0x7f06c000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=433b90caea50c598 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:23.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.424+0000 7f06ccb7a700 1 -- 172.21.15.156:0/3471257410 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c000e070 con 0x7f06c81345a0 2023-09-30T22:25:23.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.424+0000 7f06ccb7a700 1 -- 172.21.15.156:0/3471257410 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c0003a20 con 0x7f06c81345a0 2023-09-30T22:25:23.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.424+0000 7f06ccb7a700 1 -- 172.21.15.156:0/3471257410 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c0003dd0 con 0x7f06c81345a0 2023-09-30T22:25:23.428 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.424+0000 7f06cfde0700 1 -- 172.21.15.156:0/3471257410 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06c81345a0 msgr2=0x7f06c813b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.424+0000 7f06cfde0700 1 --2- 172.21.15.156:0/3471257410 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06c81345a0 0x7f06c813b3d0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f06c0009e50 tx=0x7f06c000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:23.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.424+0000 7f06cfde0700 1 -- 172.21.15.156:0/3471257410 shutdown_connections 2023-09-30T22:25:23.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.424+0000 7f06cfde0700 1 --2- 172.21.15.156:0/3471257410 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06c81345a0 0x7f06c813b3d0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.424+0000 7f06cfde0700 1 --2- 172.21.15.156:0/3471257410 >> v2:172.21.15.156:3300/0 conn(0x7f06c8134140 0x7f06c8138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.424+0000 7f06cfde0700 1 -- 172.21.15.156:0/3471257410 >> 172.21.15.156:0/3471257410 conn(0x7f06c8099c40 msgr2=0x7f06c806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:23.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.425+0000 7f06cfde0700 1 -- 172.21.15.156:0/3471257410 shutdown_connections 2023-09-30T22:25:23.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.425+0000 7f06cfde0700 1 -- 172.21.15.156:0/3471257410 wait complete. 2023-09-30T22:25:23.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.425+0000 7f06cfde0700 1 Processor -- start 2023-09-30T22:25:23.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.426+0000 7f06cfde0700 1 -- start start 2023-09-30T22:25:23.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.426+0000 7f06cfde0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06c809ad40 0x7f06c811c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.429 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.426+0000 7f06cfde0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06c8134140 0x7f06c811ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.426+0000 7f06cfde0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06c81345a0 0x7f06c811d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.426+0000 7f06cfde0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c811dc50 con 0x7f06c809ad40 2023-09-30T22:25:23.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.426+0000 7f06cfde0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c813a3d0 con 0x7f06c8134140 2023-09-30T22:25:23.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.426+0000 7f06cfde0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06c811e3c0 con 0x7f06c81345a0 2023-09-30T22:25:23.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.426+0000 7f06cd37b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06c8134140 0x7f06c811ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.426+0000 7f06cd37b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06c8134140 0x7f06c811ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48924/0 (socket says 172.21.15.156:48924) 2023-09-30T22:25:23.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.426+0000 7f06cd37b700 1 -- 172.21.15.156:0/2467229656 learned_addr learned my addr 172.21.15.156:0/2467229656 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:23.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.426+0000 7f06ce37d700 1 --2- 172.21.15.156:0/2467229656 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06c81345a0 0x7f06c811d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.426+0000 7f06cdb7c700 1 --2- 172.21.15.156:0/2467229656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06c809ad40 0x7f06c811c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.427+0000 7f06ce37d700 1 -- 172.21.15.156:0/2467229656 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06c8134140 msgr2=0x7f06c811ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.430 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.427+0000 7f06ce37d700 1 --2- 172.21.15.156:0/2467229656 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06c8134140 0x7f06c811ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.427+0000 7f06ce37d700 1 -- 172.21.15.156:0/2467229656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06c809ad40 msgr2=0x7f06c811c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.427+0000 7f06ce37d700 1 --2- 172.21.15.156:0/2467229656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06c809ad40 0x7f06c811c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.427+0000 7f06ce37d700 1 -- 172.21.15.156:0/2467229656 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c0009b30 con 0x7f06c81345a0 2023-09-30T22:25:23.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.427+0000 7f06cd37b700 1 --2- 172.21.15.156:0/2467229656 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06c8134140 0x7f06c811ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:23.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.427+0000 7f06ce37d700 1 --2- 172.21.15.156:0/2467229656 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06c81345a0 0x7f06c811d340 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f06c80a0830 tx=0x7f06c0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:23.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.427+0000 7f06be7fc700 1 -- 172.21.15.156:0/2467229656 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c0004440 con 0x7f06c81345a0 2023-09-30T22:25:23.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.427+0000 7f06be7fc700 1 -- 172.21.15.156:0/2467229656 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c00045a0 con 0x7f06c81345a0 2023-09-30T22:25:23.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.427+0000 7f06cfde0700 1 -- 172.21.15.156:0/2467229656 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c811f9f0 con 0x7f06c81345a0 2023-09-30T22:25:23.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.427+0000 7f06be7fc700 1 -- 172.21.15.156:0/2467229656 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c0004910 con 0x7f06c81345a0 2023-09-30T22:25:23.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.427+0000 7f06cfde0700 1 -- 172.21.15.156:0/2467229656 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c80a4110 con 0x7f06c81345a0 2023-09-30T22:25:23.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.428+0000 7f06be7fc700 1 -- 172.21.15.156:0/2467229656 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f06c0012430 con 0x7f06c81345a0 2023-09-30T22:25:23.431 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.428+0000 7f06be7fc700 1 -- 172.21.15.156:0/2467229656 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f06c0040e70 con 0x7f06c81345a0 2023-09-30T22:25:23.432 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.428+0000 7f06abfff700 1 -- 172.21.15.156:0/2467229656 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06a40052e0 con 0x7f06c81345a0 2023-09-30T22:25:23.433 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.433+0000 7f06be7fc700 1 -- 172.21.15.156:0/2467229656 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f06c0021020 con 0x7f06c81345a0 2023-09-30T22:25:23.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.492+0000 7f581653e700 1 Processor -- start 2023-09-30T22:25:23.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.492+0000 7f581653e700 1 -- start start 2023-09-30T22:25:23.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.493+0000 7f581653e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5810131980 0x7f5810131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.493+0000 7f581653e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f581009bc70 0x7f581009c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.493+0000 7f581653e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58100a1640 con 0x7f581009c5c0 2023-09-30T22:25:23.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.493+0000 7f581653e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f581006eb30 con 0x7f581009bc70 2023-09-30T22:25:23.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.493+0000 7f581653e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58100a22d0 con 0x7f5810131980 2023-09-30T22:25:23.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.493+0000 7f580f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f581009bc70 0x7f581009c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.493+0000 7f580f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f581009bc70 0x7f581009c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48936/0 (socket says 172.21.15.156:48936) 2023-09-30T22:25:23.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.493+0000 7f580f7fe700 1 -- 172.21.15.156:0/854791446 learned_addr learned my addr 172.21.15.156:0/854791446 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:23.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.493+0000 7f580ffff700 1 --2- 172.21.15.156:0/854791446 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5810131980 0x7f5810131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.493+0000 7f580f7fe700 1 -- 172.21.15.156:0/854791446 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5810131980 msgr2=0x7f5810131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:23.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.493+0000 7f580f7fe700 1 --2- 172.21.15.156:0/854791446 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5810131980 0x7f5810131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.493+0000 7f580f7fe700 1 -- 172.21.15.156:0/854791446 >> v1:172.21.15.156:6789/0 conn(0x7f581009c5c0 legacy=0x7f5810138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.493+0000 7f580f7fe700 1 -- 172.21.15.156:0/854791446 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5810131550 con 0x7f581009bc70 2023-09-30T22:25:23.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.494+0000 7f580f7fe700 1 --2- 172.21.15.156:0/854791446 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f581009bc70 0x7f581009c080 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5804009920 tx=0x7f5804009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d97b6e99076b8c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:23.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.494+0000 7f580effd700 1 -- 172.21.15.156:0/854791446 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5804011830 con 0x7f581009bc70 2023-09-30T22:25:23.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.494+0000 7f580effd700 1 -- 172.21.15.156:0/854791446 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5804011990 con 0x7f581009bc70 2023-09-30T22:25:23.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.494+0000 7f580effd700 1 -- 172.21.15.156:0/854791446 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5804011d20 con 0x7f581009bc70 2023-09-30T22:25:23.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.495+0000 7f581653e700 1 -- 172.21.15.156:0/854791446 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f581009bc70 msgr2=0x7f581009c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.495+0000 7f581653e700 1 --2- 172.21.15.156:0/854791446 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f581009bc70 0x7f581009c080 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5804009920 tx=0x7f5804009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:23.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.495+0000 7f581653e700 1 -- 172.21.15.156:0/854791446 shutdown_connections 2023-09-30T22:25:23.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.495+0000 7f581653e700 1 --2- 172.21.15.156:0/854791446 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5810131980 0x7f5810131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.495+0000 7f581653e700 1 --2- 172.21.15.156:0/854791446 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f581009bc70 0x7f581009c080 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.495+0000 7f581653e700 1 -- 172.21.15.156:0/854791446 >> 172.21.15.156:0/854791446 conn(0x7f58100a2980 msgr2=0x7f58100a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:23.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.495+0000 7f581653e700 1 -- 172.21.15.156:0/854791446 shutdown_connections 2023-09-30T22:25:23.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.495+0000 7f581653e700 1 -- 172.21.15.156:0/854791446 wait complete. 2023-09-30T22:25:23.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.496+0000 7f581653e700 1 Processor -- start 2023-09-30T22:25:23.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.496+0000 7f581653e700 1 -- start start 2023-09-30T22:25:23.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.497+0000 7f581653e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f581009bc70 0x7f581011dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.497+0000 7f581653e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f581009c5c0 0x7f581011e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.497+0000 7f581653e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5810131980 0x7f581011e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.497+0000 7f581653e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58101214f0 con 0x7f581009bc70 2023-09-30T22:25:23.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.497+0000 7f581653e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5810130ef0 con 0x7f581009c5c0 2023-09-30T22:25:23.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.497+0000 7f581653e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f581011f770 con 0x7f5810131980 2023-09-30T22:25:23.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.497+0000 7f5814adb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5810131980 0x7f581011e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.497+0000 7f5814adb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5810131980 0x7f581011e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34772/0 (socket says 172.21.15.156:34772) 2023-09-30T22:25:23.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.497+0000 7f580ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f581009bc70 0x7f581011dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.497+0000 7f5814adb700 1 -- 172.21.15.156:0/2595841784 learned_addr learned my addr 172.21.15.156:0/2595841784 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:23.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.497+0000 7f580f7fe700 1 --2- 172.21.15.156:0/2595841784 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f581009c5c0 0x7f581011e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.497+0000 7f5814adb700 1 -- 172.21.15.156:0/2595841784 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f581009c5c0 msgr2=0x7f581011e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.497+0000 7f5814adb700 1 --2- 172.21.15.156:0/2595841784 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f581009c5c0 0x7f581011e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.497+0000 7f5814adb700 1 -- 172.21.15.156:0/2595841784 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f581009bc70 msgr2=0x7f581011dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.497+0000 7f5814adb700 1 --2- 172.21.15.156:0/2595841784 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f581009bc70 0x7f581011dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.497+0000 7f5814adb700 1 -- 172.21.15.156:0/2595841784 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5804009550 con 0x7f5810131980 2023-09-30T22:25:23.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.497+0000 7f580ffff700 1 --2- 172.21.15.156:0/2595841784 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f581009bc70 0x7f581011dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:23.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.498+0000 7f5814adb700 1 --2- 172.21.15.156:0/2595841784 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5810131980 0x7f581011e760 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f580800cbf0 tx=0x7f580800cf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:23.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.498+0000 7f580cff9700 1 -- 172.21.15.156:0/2595841784 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5808003c00 con 0x7f5810131980 2023-09-30T22:25:23.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.498+0000 7f580cff9700 1 -- 172.21.15.156:0/2595841784 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5808003d60 con 0x7f5810131980 2023-09-30T22:25:23.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.498+0000 7f581653e700 1 -- 172.21.15.156:0/2595841784 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f581011fd20 con 0x7f5810131980 2023-09-30T22:25:23.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.498+0000 7f580cff9700 1 -- 172.21.15.156:0/2595841784 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580800aaa0 con 0x7f5810131980 2023-09-30T22:25:23.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.498+0000 7f581653e700 1 -- 172.21.15.156:0/2595841784 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58101216f0 con 0x7f5810131980 2023-09-30T22:25:23.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.499+0000 7f580cff9700 1 -- 172.21.15.156:0/2595841784 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f580800ac00 con 0x7f5810131980 2023-09-30T22:25:23.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.499+0000 7f580cff9700 1 -- 172.21.15.156:0/2595841784 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f580803f5f0 con 0x7f5810131980 2023-09-30T22:25:23.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.499+0000 7f581653e700 1 -- 172.21.15.156:0/2595841784 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f581004f2a0 con 0x7f5810131980 2023-09-30T22:25:23.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.504+0000 7f580cff9700 1 -- 172.21.15.156:0/2595841784 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f58080198f0 con 0x7f5810131980 2023-09-30T22:25:23.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.508+0000 7faff5527700 1 Processor -- start 2023-09-30T22:25:23.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.508+0000 7faff5527700 1 -- start start 2023-09-30T22:25:23.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.509+0000 7faff5527700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7faff0133900 0x7faff0133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.509+0000 7faff5527700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faff00a10b0 0x7faff013b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.509+0000 7faff5527700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff009a760 con 0x7faff0134210 2023-09-30T22:25:23.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.509+0000 7faff5527700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff01336e0 con 0x7faff0133900 2023-09-30T22:25:23.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.509+0000 7faff5527700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faff009a080 con 0x7faff00a10b0 2023-09-30T22:25:23.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.509+0000 7fafef7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faff00a10b0 0x7faff013b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.509+0000 7fafef7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faff00a10b0 0x7faff013b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34788/0 (socket says 172.21.15.156:34788) 2023-09-30T22:25:23.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.509+0000 7fafef7fe700 1 -- 172.21.15.156:0/398291074 learned_addr learned my addr 172.21.15.156:0/398291074 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:23.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.509+0000 7fafef7fe700 1 -- 172.21.15.156:0/398291074 >> v2:172.21.15.156:3300/0 conn(0x7faff0133900 msgr2=0x7faff0133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:23.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.509+0000 7fafef7fe700 1 --2- 172.21.15.156:0/398291074 >> v2:172.21.15.156:3300/0 conn(0x7faff0133900 0x7faff0133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.509+0000 7fafef7fe700 1 -- 172.21.15.156:0/398291074 >> v1:172.21.15.156:6789/0 conn(0x7faff0134210 legacy=0x7faff00a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:23.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.509+0000 7fafef7fe700 1 -- 172.21.15.156:0/398291074 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff00a23e0 con 0x7faff00a10b0 2023-09-30T22:25:23.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.509+0000 7fafef7fe700 1 --2- 172.21.15.156:0/398291074 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faff00a10b0 0x7faff013b910 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fafe8009e50 tx=0x7fafe800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce14297c6312175d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:23.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.510+0000 7fafedffb700 1 -- 172.21.15.156:0/398291074 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe800e070 con 0x7faff00a10b0 2023-09-30T22:25:23.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.510+0000 7fafedffb700 1 -- 172.21.15.156:0/398291074 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe8003a20 con 0x7faff00a10b0 2023-09-30T22:25:23.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.510+0000 7fafedffb700 1 -- 172.21.15.156:0/398291074 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe8003dd0 con 0x7faff00a10b0 2023-09-30T22:25:23.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.510+0000 7faff5527700 1 -- 172.21.15.156:0/398291074 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faff00a10b0 msgr2=0x7faff013b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.510+0000 7faff5527700 1 --2- 172.21.15.156:0/398291074 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faff00a10b0 0x7faff013b910 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fafe8009e50 tx=0x7fafe800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:23.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.510+0000 7faff5527700 1 -- 172.21.15.156:0/398291074 shutdown_connections 2023-09-30T22:25:23.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.510+0000 7faff5527700 1 --2- 172.21.15.156:0/398291074 >> v2:172.21.15.156:3300/0 conn(0x7faff0133900 0x7faff0133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.510+0000 7faff5527700 1 --2- 172.21.15.156:0/398291074 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faff00a10b0 0x7faff013b910 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.510+0000 7faff5527700 1 -- 172.21.15.156:0/398291074 >> 172.21.15.156:0/398291074 conn(0x7faff00a2980 msgr2=0x7faff00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:23.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.510+0000 7faff5527700 1 -- 172.21.15.156:0/398291074 shutdown_connections 2023-09-30T22:25:23.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.510+0000 7faff5527700 1 -- 172.21.15.156:0/398291074 wait complete. 2023-09-30T22:25:23.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.511+0000 7faff5527700 1 Processor -- start 2023-09-30T22:25:23.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.511+0000 7faff5527700 1 -- start start 2023-09-30T22:25:23.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.512+0000 7faff5527700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faff00a10b0 0x7faff011c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.512+0000 7faff5527700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faff0133900 0x7faff011cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.512+0000 7faff5527700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faff0134210 0x7faff011d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.515 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.512+0000 7faff5527700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff0120090 con 0x7faff0133900 2023-09-30T22:25:23.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.512+0000 7faff5527700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff01202e0 con 0x7faff00a10b0 2023-09-30T22:25:23.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.512+0000 7faff5527700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faff011dbd0 con 0x7faff0134210 2023-09-30T22:25:23.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.512+0000 7fafef7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faff0134210 0x7faff011d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.512+0000 7fafef7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faff0134210 0x7faff011d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34796/0 (socket says 172.21.15.156:34796) 2023-09-30T22:25:23.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.512+0000 7fafef7fe700 1 -- 172.21.15.156:0/3835331019 learned_addr learned my addr 172.21.15.156:0/3835331019 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:23.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.512+0000 7fafeeffd700 1 --2- 172.21.15.156:0/3835331019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faff00a10b0 0x7faff011c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.512+0000 7fafef7fe700 1 -- 172.21.15.156:0/3835331019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faff00a10b0 msgr2=0x7faff011c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.512+0000 7fafef7fe700 1 --2- 172.21.15.156:0/3835331019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faff00a10b0 0x7faff011c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.512+0000 7fafef7fe700 1 -- 172.21.15.156:0/3835331019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faff0133900 msgr2=0x7faff011cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.512+0000 7fafef7fe700 1 --2- 172.21.15.156:0/3835331019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faff0133900 0x7faff011cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.512+0000 7fafef7fe700 1 -- 172.21.15.156:0/3835331019 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe8009b30 con 0x7faff0134210 2023-09-30T22:25:23.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.513+0000 7fafef7fe700 1 --2- 172.21.15.156:0/3835331019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faff0134210 0x7faff011d280 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7faff009a1c0 tx=0x7fafe8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:23.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.513+0000 7fafd77fe700 1 -- 172.21.15.156:0/3835331019 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe8004440 con 0x7faff0134210 2023-09-30T22:25:23.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.513+0000 7fafd77fe700 1 -- 172.21.15.156:0/3835331019 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe80045c0 con 0x7faff0134210 2023-09-30T22:25:23.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.513+0000 7fafd77fe700 1 -- 172.21.15.156:0/3835331019 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe8004970 con 0x7faff0134210 2023-09-30T22:25:23.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.513+0000 7faff5527700 1 -- 172.21.15.156:0/3835331019 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff011f1d0 con 0x7faff0134210 2023-09-30T22:25:23.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.513+0000 7faff5527700 1 -- 172.21.15.156:0/3835331019 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff011e470 con 0x7faff0134210 2023-09-30T22:25:23.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.514+0000 7fafd77fe700 1 -- 172.21.15.156:0/3835331019 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fafe8012430 con 0x7faff0134210 2023-09-30T22:25:23.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.514+0000 7fafd77fe700 1 -- 172.21.15.156:0/3835331019 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fafe8040b60 con 0x7faff0134210 2023-09-30T22:25:23.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.514+0000 7faff5527700 1 -- 172.21.15.156:0/3835331019 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff004f2a0 con 0x7faff0134210 2023-09-30T22:25:23.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.519+0000 7fafd77fe700 1 -- 172.21.15.156:0/3835331019 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fafe80117a0 con 0x7faff0134210 2023-09-30T22:25:23.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.628+0000 7f06abfff700 1 -- 172.21.15.156:0/2467229656 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f06a4005590 con 0x7f06c81345a0 2023-09-30T22:25:23.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.628+0000 7f06be7fc700 1 -- 172.21.15.156:0/2467229656 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f06c0034090 con 0x7f06c81345a0 2023-09-30T22:25:23.629 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:23.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.630+0000 7f06abfff700 1 -- 172.21.15.156:0/2467229656 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06c81345a0 msgr2=0x7f06c811d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.630+0000 7f06abfff700 1 --2- 172.21.15.156:0/2467229656 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06c81345a0 0x7f06c811d340 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f06c80a0830 tx=0x7f06c0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.630+0000 7f06abfff700 1 -- 172.21.15.156:0/2467229656 shutdown_connections 2023-09-30T22:25:23.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.630+0000 7f06abfff700 1 --2- 172.21.15.156:0/2467229656 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f06c81345a0 0x7f06c811d340 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.630+0000 7f06abfff700 1 --2- 172.21.15.156:0/2467229656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06c809ad40 0x7f06c811c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.630+0000 7f06abfff700 1 --2- 172.21.15.156:0/2467229656 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06c8134140 0x7f06c811ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.631+0000 7f06abfff700 1 -- 172.21.15.156:0/2467229656 >> 172.21.15.156:0/2467229656 conn(0x7f06c8099c40 msgr2=0x7f06c80a61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:23.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.632+0000 7f06abfff700 1 -- 172.21.15.156:0/2467229656 shutdown_connections 2023-09-30T22:25:23.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.634+0000 7f06abfff700 1 -- 172.21.15.156:0/2467229656 wait complete. 2023-09-30T22:25:23.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:23.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.665+0000 7fb99f761700 1 -- 172.21.15.156:0/3315715531 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb9981287b0 con 0x7fb99809d860 2023-09-30T22:25:23.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.666+0000 7fb98dffb700 1 -- 172.21.15.156:0/3315715531 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb994019300 con 0x7fb99809d860 2023-09-30T22:25:23.666 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:23.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.668+0000 7fb99f761700 1 -- 172.21.15.156:0/3315715531 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb99809d860 msgr2=0x7fb9981264b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.668+0000 7fb99f761700 1 --2- 172.21.15.156:0/3315715531 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb99809d860 0x7fb9981264b0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb99400e980 tx=0x7fb99400ec90 comp rx=0 tx=0).stop 2023-09-30T22:25:23.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.668+0000 7fb99f761700 1 -- 172.21.15.156:0/3315715531 shutdown_connections 2023-09-30T22:25:23.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.668+0000 7fb99f761700 1 --2- 172.21.15.156:0/3315715531 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb998130ce0 0x7fb998126f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.668+0000 7fb99f761700 1 --2- 172.21.15.156:0/3315715531 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb99809d860 0x7fb9981264b0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.668+0000 7fb99f761700 1 --2- 172.21.15.156:0/3315715531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb99809e170 0x7fb9981269f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.668+0000 7fb99f761700 1 -- 172.21.15.156:0/3315715531 >> 172.21.15.156:0/3315715531 conn(0x7fb998099c40 msgr2=0x7fb9980a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:23.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.668+0000 7fb99f761700 1 -- 172.21.15.156:0/3315715531 shutdown_connections 2023-09-30T22:25:23.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.668+0000 7fb99f761700 1 -- 172.21.15.156:0/3315715531 wait complete. 2023-09-30T22:25:23.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:23.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.712+0000 7faff5527700 1 -- 172.21.15.156:0/3835331019 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faff011fca0 con 0x7faff0134210 2023-09-30T22:25:23.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.713+0000 7fafd77fe700 1 -- 172.21.15.156:0/3835331019 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fafe8017030 con 0x7faff0134210 2023-09-30T22:25:23.714 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:23.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.715+0000 7faff5527700 1 -- 172.21.15.156:0/3835331019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faff0134210 msgr2=0x7faff011d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.715+0000 7faff5527700 1 --2- 172.21.15.156:0/3835331019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faff0134210 0x7faff011d280 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7faff009a1c0 tx=0x7fafe8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.715+0000 7faff5527700 1 -- 172.21.15.156:0/3835331019 shutdown_connections 2023-09-30T22:25:23.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.715+0000 7faff5527700 1 --2- 172.21.15.156:0/3835331019 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faff0134210 0x7faff011d280 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.715+0000 7faff5527700 1 --2- 172.21.15.156:0/3835331019 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faff00a10b0 0x7faff011c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.715+0000 7faff5527700 1 --2- 172.21.15.156:0/3835331019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faff0133900 0x7faff011cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.715+0000 7faff5527700 1 -- 172.21.15.156:0/3835331019 >> 172.21.15.156:0/3835331019 conn(0x7faff00a2980 msgr2=0x7faff01baf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:23.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.715+0000 7faff5527700 1 -- 172.21.15.156:0/3835331019 shutdown_connections 2023-09-30T22:25:23.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.715+0000 7faff5527700 1 -- 172.21.15.156:0/3835331019 wait complete. 2023-09-30T22:25:23.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.726+0000 7f581653e700 1 -- 172.21.15.156:0/2595841784 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f58100a1c40 con 0x7f5810131980 2023-09-30T22:25:23.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.727+0000 7f580cff9700 1 -- 172.21.15.156:0/2595841784 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5808019300 con 0x7f5810131980 2023-09-30T22:25:23.727 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:23.728 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:23.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.729+0000 7f581653e700 1 -- 172.21.15.156:0/2595841784 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5810131980 msgr2=0x7f581011e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.729+0000 7f581653e700 1 --2- 172.21.15.156:0/2595841784 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5810131980 0x7f581011e760 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f580800cbf0 tx=0x7f580800cf00 comp rx=0 tx=0).stop 2023-09-30T22:25:23.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.729+0000 7f581653e700 1 -- 172.21.15.156:0/2595841784 shutdown_connections 2023-09-30T22:25:23.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.729+0000 7f581653e700 1 --2- 172.21.15.156:0/2595841784 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5810131980 0x7f581011e760 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.729+0000 7f581653e700 1 --2- 172.21.15.156:0/2595841784 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f581009bc70 0x7f581011dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.729+0000 7f581653e700 1 --2- 172.21.15.156:0/2595841784 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f581009c5c0 0x7f581011e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.729+0000 7f581653e700 1 -- 172.21.15.156:0/2595841784 >> 172.21.15.156:0/2595841784 conn(0x7f58100a2980 msgr2=0x7f581006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:23.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.729+0000 7f581653e700 1 -- 172.21.15.156:0/2595841784 shutdown_connections 2023-09-30T22:25:23.731 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:23.729+0000 7f581653e700 1 -- 172.21.15.156:0/2595841784 wait complete. 2023-09-30T22:25:23.741 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:24.647 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:24.682 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:24.729 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:24.742 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:24.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.785+0000 7f99c7607700 1 Processor -- start 2023-09-30T22:25:24.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.786+0000 7f99c7607700 1 -- start start 2023-09-30T22:25:24.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.786+0000 7f99c7607700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99c0133900 0x7f99c0133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.786+0000 7f99c7607700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99c00a10b0 0x7f99c013b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.786+0000 7f99c7607700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c009a760 con 0x7f99c0134210 2023-09-30T22:25:24.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.786+0000 7f99c7607700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c01336e0 con 0x7f99c0133900 2023-09-30T22:25:24.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.786+0000 7f99c7607700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99c009a080 con 0x7f99c00a10b0 2023-09-30T22:25:24.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.786+0000 7f99c4ba2700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f99c0134210 0x7f99c00a09a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47248/0 (socket says 172.21.15.156:47248) 2023-09-30T22:25:24.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.786+0000 7f99c4ba2700 1 -- 172.21.15.156:0/4046035255 learned_addr learned my addr 172.21.15.156:0/4046035255 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:24.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.786+0000 7f99c5ba4700 1 --2- 172.21.15.156:0/4046035255 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99c00a10b0 0x7f99c013b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.786+0000 7f99c53a3700 1 --2- 172.21.15.156:0/4046035255 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99c0133900 0x7f99c0133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.787+0000 7f99b7fff700 1 -- 172.21.15.156:0/4046035255 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 626443985 0 0) 0x7f99c009a760 con 0x7f99c0134210 2023-09-30T22:25:24.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.787+0000 7f99b7fff700 1 -- 172.21.15.156:0/4046035255 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99ac0035b0 con 0x7f99c0134210 2023-09-30T22:25:24.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.787+0000 7f99c5ba4700 1 -- 172.21.15.156:0/4046035255 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99c0133900 msgr2=0x7f99c0133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:24.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.787+0000 7f99c5ba4700 1 --2- 172.21.15.156:0/4046035255 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99c0133900 0x7f99c0133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.787+0000 7f99c5ba4700 1 -- 172.21.15.156:0/4046035255 >> v1:172.21.15.156:6789/0 conn(0x7f99c0134210 legacy=0x7f99c00a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.787+0000 7f99c5ba4700 1 -- 172.21.15.156:0/4046035255 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c00a23e0 con 0x7f99c00a10b0 2023-09-30T22:25:24.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.787+0000 7f99c53a3700 1 --2- 172.21.15.156:0/4046035255 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99c0133900 0x7f99c0133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:24.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.787+0000 7f99c5ba4700 1 --2- 172.21.15.156:0/4046035255 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99c00a10b0 0x7f99c013b910 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009dc0 tx=0x7f99b800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a8ee3ae0bd1a041 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:24.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.787+0000 7f99b7fff700 1 -- 172.21.15.156:0/4046035255 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b800e070 con 0x7f99c00a10b0 2023-09-30T22:25:24.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.787+0000 7f99b7fff700 1 -- 172.21.15.156:0/4046035255 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b800bb20 con 0x7f99c00a10b0 2023-09-30T22:25:24.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.787+0000 7f99b7fff700 1 -- 172.21.15.156:0/4046035255 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b8012430 con 0x7f99c00a10b0 2023-09-30T22:25:24.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.788+0000 7f99c7607700 1 -- 172.21.15.156:0/4046035255 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99c00a10b0 msgr2=0x7f99c013b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.788+0000 7f99c7607700 1 --2- 172.21.15.156:0/4046035255 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99c00a10b0 0x7f99c013b910 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009dc0 tx=0x7f99b800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:24.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.788+0000 7f99c7607700 1 -- 172.21.15.156:0/4046035255 shutdown_connections 2023-09-30T22:25:24.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.788+0000 7f99c7607700 1 --2- 172.21.15.156:0/4046035255 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99c0133900 0x7f99c0133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.788+0000 7f99c7607700 1 --2- 172.21.15.156:0/4046035255 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99c00a10b0 0x7f99c013b910 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.788+0000 7f99c7607700 1 -- 172.21.15.156:0/4046035255 >> 172.21.15.156:0/4046035255 conn(0x7f99c00a2980 msgr2=0x7f99c00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:24.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.788+0000 7f99c7607700 1 -- 172.21.15.156:0/4046035255 shutdown_connections 2023-09-30T22:25:24.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.788+0000 7f99c7607700 1 -- 172.21.15.156:0/4046035255 wait complete. 2023-09-30T22:25:24.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.789+0000 7f99c7607700 1 Processor -- start 2023-09-30T22:25:24.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.789+0000 7f99c7607700 1 -- start start 2023-09-30T22:25:24.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.790+0000 7f99c7607700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99c00a10b0 0x7f99c011b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.790+0000 7f99c7607700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99c0133900 0x7f99c011bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.790+0000 7f99c7607700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99c0134210 0x7f99c011c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.790+0000 7f99c7607700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c011cbb0 con 0x7f99c0133900 2023-09-30T22:25:24.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.790+0000 7f99c7607700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c011d310 con 0x7f99c00a10b0 2023-09-30T22:25:24.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.790+0000 7f99c7607700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99c011e560 con 0x7f99c0134210 2023-09-30T22:25:24.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.790+0000 7f99c53a3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99c00a10b0 0x7f99c011b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.790+0000 7f99c53a3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99c00a10b0 0x7f99c011b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48974/0 (socket says 172.21.15.156:48974) 2023-09-30T22:25:24.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.790+0000 7f99c53a3700 1 -- 172.21.15.156:0/2432365815 learned_addr learned my addr 172.21.15.156:0/2432365815 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:24.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.790+0000 7f99c53a3700 1 -- 172.21.15.156:0/2432365815 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99c0134210 msgr2=0x7f99c011c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.790+0000 7f99c53a3700 1 --2- 172.21.15.156:0/2432365815 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99c0134210 0x7f99c011c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.790+0000 7f99c53a3700 1 -- 172.21.15.156:0/2432365815 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99c0133900 msgr2=0x7f99c011bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.790+0000 7f99c53a3700 1 --2- 172.21.15.156:0/2432365815 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99c0133900 0x7f99c011bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.790+0000 7f99c53a3700 1 -- 172.21.15.156:0/2432365815 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc013a10 con 0x7f99c00a10b0 2023-09-30T22:25:24.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.790+0000 7f99c53a3700 1 --2- 172.21.15.156:0/2432365815 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99c00a10b0 0x7f99c011b700 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f99bc017380 tx=0x7f99bc017740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:24.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.791+0000 7f99b5ffb700 1 -- 172.21.15.156:0/2432365815 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc004230 con 0x7f99c00a10b0 2023-09-30T22:25:24.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.791+0000 7f99b5ffb700 1 -- 172.21.15.156:0/2432365815 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99bc019040 con 0x7f99c00a10b0 2023-09-30T22:25:24.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.791+0000 7f99b5ffb700 1 -- 172.21.15.156:0/2432365815 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc013e40 con 0x7f99c00a10b0 2023-09-30T22:25:24.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.791+0000 7f99c7607700 1 -- 172.21.15.156:0/2432365815 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b8009a70 con 0x7f99c00a10b0 2023-09-30T22:25:24.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.792+0000 7f99c7607700 1 -- 172.21.15.156:0/2432365815 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c011db40 con 0x7f99c00a10b0 2023-09-30T22:25:24.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.792+0000 7f99b5ffb700 1 -- 172.21.15.156:0/2432365815 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f99bc0036a0 con 0x7f99c00a10b0 2023-09-30T22:25:24.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.793+0000 7f99b5ffb700 1 -- 172.21.15.156:0/2432365815 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f99bc0476b0 con 0x7f99c00a10b0 2023-09-30T22:25:24.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.793+0000 7f99c7607700 1 -- 172.21.15.156:0/2432365815 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99c0071740 con 0x7f99c00a10b0 2023-09-30T22:25:24.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.798+0000 7f99b5ffb700 1 -- 172.21.15.156:0/2432365815 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f99bc024070 con 0x7f99c00a10b0 2023-09-30T22:25:24.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.834+0000 7efc92700700 1 Processor -- start 2023-09-30T22:25:24.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.835+0000 7efc92700700 1 -- start start 2023-09-30T22:25:24.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.835+0000 7efc92700700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc8c0a0a70 0x7efc8c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.835+0000 7efc92700700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc8c134120 0x7efc8c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.835+0000 7efc92700700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc8c09dc00 con 0x7efc8c0a1380 2023-09-30T22:25:24.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.835+0000 7efc92700700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c09ea90 con 0x7efc8c134120 2023-09-30T22:25:24.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.835+0000 7efc92700700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c09dec0 con 0x7efc8c0a0a70 2023-09-30T22:25:24.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.836+0000 7efc8bfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc8c0a0a70 0x7efc8c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.836+0000 7efc90c9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc8c134120 0x7efc8c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.836+0000 7efc90c9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc8c134120 0x7efc8c13bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:48984/0 (socket says 172.21.15.156:48984) 2023-09-30T22:25:24.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.836+0000 7efc90c9d700 1 -- 172.21.15.156:0/3626633181 learned_addr learned my addr 172.21.15.156:0/3626633181 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:24.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.836+0000 7efc8bfff700 1 --2- 172.21.15.156:0/3626633181 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc8c0a0a70 0x7efc8c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34808/0 (socket says 172.21.15.156:34808) 2023-09-30T22:25:24.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.836+0000 7efc90c9d700 1 -- 172.21.15.156:0/3626633181 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc8c0a0a70 msgr2=0x7efc8c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:24.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.836+0000 7efc90c9d700 1 --2- 172.21.15.156:0/3626633181 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc8c0a0a70 0x7efc8c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.836+0000 7efc90c9d700 1 -- 172.21.15.156:0/3626633181 >> v1:172.21.15.156:6789/0 conn(0x7efc8c0a1380 legacy=0x7efc8c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:24.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.836+0000 7efc90c9d700 1 -- 172.21.15.156:0/3626633181 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8c09e6a0 con 0x7efc8c134120 2023-09-30T22:25:24.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.836+0000 7efc8bfff700 1 --2- 172.21.15.156:0/3626633181 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc8c0a0a70 0x7efc8c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:24.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.836+0000 7efc90c9d700 1 --2- 172.21.15.156:0/3626633181 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc8c134120 0x7efc8c13bce0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7efc84009e80 tx=0x7efc8400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71fb0f046b43e55 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:24.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.836+0000 7efc8affd700 1 -- 172.21.15.156:0/3626633181 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8400e070 con 0x7efc8c134120 2023-09-30T22:25:24.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.836+0000 7efc8affd700 1 -- 172.21.15.156:0/3626633181 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc84003a20 con 0x7efc8c134120 2023-09-30T22:25:24.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.836+0000 7efc8affd700 1 -- 172.21.15.156:0/3626633181 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc84003dd0 con 0x7efc8c134120 2023-09-30T22:25:24.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.837+0000 7efc92700700 1 -- 172.21.15.156:0/3626633181 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc8c134120 msgr2=0x7efc8c13bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.837+0000 7efc92700700 1 --2- 172.21.15.156:0/3626633181 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc8c134120 0x7efc8c13bce0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7efc84009e80 tx=0x7efc8400b330 comp rx=0 tx=0).stop 2023-09-30T22:25:24.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.837+0000 7efc92700700 1 -- 172.21.15.156:0/3626633181 shutdown_connections 2023-09-30T22:25:24.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.837+0000 7efc92700700 1 --2- 172.21.15.156:0/3626633181 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc8c134120 0x7efc8c13bce0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.837+0000 7efc92700700 1 --2- 172.21.15.156:0/3626633181 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc8c0a0a70 0x7efc8c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.837+0000 7efc92700700 1 -- 172.21.15.156:0/3626633181 >> 172.21.15.156:0/3626633181 conn(0x7efc8c0a6610 msgr2=0x7efc8c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:24.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.837+0000 7efc92700700 1 -- 172.21.15.156:0/3626633181 shutdown_connections 2023-09-30T22:25:24.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.837+0000 7efc92700700 1 -- 172.21.15.156:0/3626633181 wait complete. 2023-09-30T22:25:24.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.838+0000 7efc92700700 1 Processor -- start 2023-09-30T22:25:24.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.839+0000 7efc92700700 1 -- start start 2023-09-30T22:25:24.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.839+0000 7efc92700700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc8c0a0a70 0x7efc8c1229c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.839+0000 7efc92700700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc8c0a1380 0x7efc8c122f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.839+0000 7efc92700700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc8c134120 0x7efc8c123440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.839+0000 7efc92700700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c123e90 con 0x7efc8c0a0a70 2023-09-30T22:25:24.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.839+0000 7efc92700700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c133450 con 0x7efc8c0a1380 2023-09-30T22:25:24.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.839+0000 7efc92700700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c124650 con 0x7efc8c134120 2023-09-30T22:25:24.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.839+0000 7efc8bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc8c0a0a70 0x7efc8c1229c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.839+0000 7efc8bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc8c0a0a70 0x7efc8c1229c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47368/0 (socket says 172.21.15.156:47368) 2023-09-30T22:25:24.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.839+0000 7efc8bfff700 1 -- 172.21.15.156:0/4082462444 learned_addr learned my addr 172.21.15.156:0/4082462444 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:24.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.840+0000 7efc90c9d700 1 --2- 172.21.15.156:0/4082462444 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc8c134120 0x7efc8c123440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.840+0000 7efc8b7fe700 1 --2- 172.21.15.156:0/4082462444 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc8c0a1380 0x7efc8c122f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.840+0000 7efc90c9d700 1 -- 172.21.15.156:0/4082462444 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc8c0a1380 msgr2=0x7efc8c122f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.840+0000 7efc90c9d700 1 --2- 172.21.15.156:0/4082462444 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc8c0a1380 0x7efc8c122f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.840+0000 7efc90c9d700 1 -- 172.21.15.156:0/4082462444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc8c0a0a70 msgr2=0x7efc8c1229c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.840+0000 7efc90c9d700 1 --2- 172.21.15.156:0/4082462444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc8c0a0a70 0x7efc8c1229c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.840+0000 7efc90c9d700 1 -- 172.21.15.156:0/4082462444 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7c0094a0 con 0x7efc8c134120 2023-09-30T22:25:24.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.840+0000 7efc8bfff700 1 --2- 172.21.15.156:0/4082462444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc8c0a0a70 0x7efc8c1229c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:24.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.840+0000 7efc90c9d700 1 --2- 172.21.15.156:0/4082462444 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc8c134120 0x7efc8c123440 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7efc84014000 tx=0x7efc84004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:24.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.840+0000 7efc88ff9700 1 -- 172.21.15.156:0/4082462444 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc840094d0 con 0x7efc8c134120 2023-09-30T22:25:24.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.840+0000 7efc88ff9700 1 -- 172.21.15.156:0/4082462444 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc84004240 con 0x7efc8c134120 2023-09-30T22:25:24.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.840+0000 7efc92700700 1 -- 172.21.15.156:0/4082462444 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc84009b30 con 0x7efc8c134120 2023-09-30T22:25:24.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.840+0000 7efc88ff9700 1 -- 172.21.15.156:0/4082462444 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc840045f0 con 0x7efc8c134120 2023-09-30T22:25:24.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.841+0000 7efc92700700 1 -- 172.21.15.156:0/4082462444 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc8c126170 con 0x7efc8c134120 2023-09-30T22:25:24.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.841+0000 7efc88ff9700 1 -- 172.21.15.156:0/4082462444 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efc84019070 con 0x7efc8c134120 2023-09-30T22:25:24.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.841+0000 7efc88ff9700 1 -- 172.21.15.156:0/4082462444 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efc84041bd0 con 0x7efc8c134120 2023-09-30T22:25:24.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.842+0000 7efc92700700 1 -- 172.21.15.156:0/4082462444 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc8c04f2a0 con 0x7efc8c134120 2023-09-30T22:25:24.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.850+0000 7efc88ff9700 1 -- 172.21.15.156:0/4082462444 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efc84045060 con 0x7efc8c134120 2023-09-30T22:25:24.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.887+0000 7f2051cbe700 1 Processor -- start 2023-09-30T22:25:24.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.887+0000 7f2051cbe700 1 -- start start 2023-09-30T22:25:24.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.887+0000 7f2051cbe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f204c0a0a70 0x7f204c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.887+0000 7f2051cbe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f204c0a1380 0x7f204c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.887+0000 7f2051cbe700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f204c09dc00 con 0x7f204c133f50 2023-09-30T22:25:24.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.887+0000 7f2051cbe700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204c09ea60 con 0x7f204c0a1380 2023-09-30T22:25:24.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.887+0000 7f2051cbe700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f204c09dec0 con 0x7f204c0a0a70 2023-09-30T22:25:24.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.887+0000 7f204b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f204c0a0a70 0x7f204c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.888+0000 7f204b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f204c0a0a70 0x7f204c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34828/0 (socket says 172.21.15.156:34828) 2023-09-30T22:25:24.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.888+0000 7f204b7fe700 1 -- 172.21.15.156:0/3181288688 learned_addr learned my addr 172.21.15.156:0/3181288688 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:24.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.888+0000 7f204affd700 1 --2- 172.21.15.156:0/3181288688 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f204c0a1380 0x7f204c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.888+0000 7f204b7fe700 1 -- 172.21.15.156:0/3181288688 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f204c0a1380 msgr2=0x7f204c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:24.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.888+0000 7f204b7fe700 1 --2- 172.21.15.156:0/3181288688 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f204c0a1380 0x7f204c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.888+0000 7f204b7fe700 1 -- 172.21.15.156:0/3181288688 >> v1:172.21.15.156:6789/0 conn(0x7f204c133f50 legacy=0x7f204c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.888+0000 7f204b7fe700 1 -- 172.21.15.156:0/3181288688 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204c09e6a0 con 0x7f204c0a0a70 2023-09-30T22:25:24.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.888+0000 7f204b7fe700 1 --2- 172.21.15.156:0/3181288688 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f204c0a0a70 0x7f204c0a0e40 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f203c009920 tx=0x7f203c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=923b2e820dea591e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:24.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.888+0000 7f204a7fc700 1 -- 172.21.15.156:0/3181288688 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c00ba60 con 0x7f204c0a0a70 2023-09-30T22:25:24.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.888+0000 7f204a7fc700 1 -- 172.21.15.156:0/3181288688 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203c00bbc0 con 0x7f204c0a0a70 2023-09-30T22:25:24.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.888+0000 7f204a7fc700 1 -- 172.21.15.156:0/3181288688 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c009e70 con 0x7f204c0a0a70 2023-09-30T22:25:24.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.889+0000 7f2051cbe700 1 -- 172.21.15.156:0/3181288688 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f204c0a0a70 msgr2=0x7f204c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.889+0000 7f2051cbe700 1 --2- 172.21.15.156:0/3181288688 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f204c0a0a70 0x7f204c0a0e40 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f203c009920 tx=0x7f203c009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:24.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.889+0000 7f2051cbe700 1 -- 172.21.15.156:0/3181288688 shutdown_connections 2023-09-30T22:25:24.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.889+0000 7f2051cbe700 1 --2- 172.21.15.156:0/3181288688 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f204c0a0a70 0x7f204c0a0e40 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.889+0000 7f2051cbe700 1 --2- 172.21.15.156:0/3181288688 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f204c0a1380 0x7f204c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.889+0000 7f2051cbe700 1 -- 172.21.15.156:0/3181288688 >> 172.21.15.156:0/3181288688 conn(0x7f204c0a6610 msgr2=0x7f204c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:24.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.889+0000 7f2051cbe700 1 -- 172.21.15.156:0/3181288688 shutdown_connections 2023-09-30T22:25:24.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.889+0000 7f2051cbe700 1 -- 172.21.15.156:0/3181288688 wait complete. 2023-09-30T22:25:24.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.890+0000 7f2051cbe700 1 Processor -- start 2023-09-30T22:25:24.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.891+0000 7f2051cbe700 1 -- start start 2023-09-30T22:25:24.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.891+0000 7f2051cbe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f204c0a0a70 0x7f204c1c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.891+0000 7f2051cbe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f204c0a1380 0x7f204c1c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.891+0000 7f2051cbe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f204c133f50 0x7f204c11e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.891+0000 7f2051cbe700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c1337e0 con 0x7f204c133f50 2023-09-30T22:25:24.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.891+0000 7f2051cbe700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204c122090 con 0x7f204c0a1380 2023-09-30T22:25:24.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.891+0000 7f2051cbe700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f204c121dd0 con 0x7f204c0a0a70 2023-09-30T22:25:24.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.891+0000 7f204affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f204c0a1380 0x7f204c1c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.891+0000 7f204b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f204c0a0a70 0x7f204c1c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.891+0000 7f204b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f204c0a0a70 0x7f204c1c88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34838/0 (socket says 172.21.15.156:34838) 2023-09-30T22:25:24.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.891+0000 7f204affd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f204c0a1380 0x7f204c1c8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49008/0 (socket says 172.21.15.156:49008) 2023-09-30T22:25:24.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.891+0000 7f204b7fe700 1 -- 172.21.15.156:0/1675028643 learned_addr learned my addr 172.21.15.156:0/1675028643 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:24.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.892+0000 7f204b7fe700 1 -- 172.21.15.156:0/1675028643 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f204c0a1380 msgr2=0x7f204c1c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.892+0000 7f204b7fe700 1 --2- 172.21.15.156:0/1675028643 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f204c0a1380 0x7f204c1c8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.892+0000 7f204b7fe700 1 -- 172.21.15.156:0/1675028643 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f204c133f50 msgr2=0x7f204c11e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.892+0000 7f204b7fe700 1 --2- 172.21.15.156:0/1675028643 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f204c133f50 0x7f204c11e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.892+0000 7f204b7fe700 1 -- 172.21.15.156:0/1675028643 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203c009550 con 0x7f204c0a0a70 2023-09-30T22:25:24.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.892+0000 7f204b7fe700 1 --2- 172.21.15.156:0/1675028643 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f204c0a0a70 0x7f204c1c88b0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f203c00c010 tx=0x7f203c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:24.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.892+0000 7f2033fff700 1 -- 172.21.15.156:0/1675028643 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c004300 con 0x7f204c0a0a70 2023-09-30T22:25:24.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.892+0000 7f2033fff700 1 -- 172.21.15.156:0/1675028643 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203c01f070 con 0x7f204c0a0a70 2023-09-30T22:25:24.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.892+0000 7f2033fff700 1 -- 172.21.15.156:0/1675028643 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c0036a0 con 0x7f204c0a0a70 2023-09-30T22:25:24.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.892+0000 7f2051cbe700 1 -- 172.21.15.156:0/1675028643 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f204c133a10 con 0x7f204c0a0a70 2023-09-30T22:25:24.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.892+0000 7f2051cbe700 1 -- 172.21.15.156:0/1675028643 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f204c120c60 con 0x7f204c0a0a70 2023-09-30T22:25:24.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.894+0000 7f2033fff700 1 -- 172.21.15.156:0/1675028643 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f203c021030 con 0x7f204c0a0a70 2023-09-30T22:25:24.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.894+0000 7f2033fff700 1 -- 172.21.15.156:0/1675028643 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f203c040690 con 0x7f204c0a0a70 2023-09-30T22:25:24.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.895+0000 7f2051cbe700 1 -- 172.21.15.156:0/1675028643 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f204c1222d0 con 0x7f204c0a0a70 2023-09-30T22:25:24.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.899+0000 7f2033fff700 1 -- 172.21.15.156:0/1675028643 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f203c01a450 con 0x7f204c0a0a70 2023-09-30T22:25:24.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.921+0000 7f720d5a1700 1 Processor -- start 2023-09-30T22:25:24.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.921+0000 7f720d5a1700 1 -- start start 2023-09-30T22:25:24.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.922+0000 7f720d5a1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f720806fb90 0x7f7208136580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.922+0000 7f720d5a1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7208136ac0 0x7f7208138ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.922+0000 7f720d5a1700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f720809c5c0 con 0x7f7208099f50 2023-09-30T22:25:24.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.922+0000 7f720d5a1700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f720809ae10 con 0x7f720806fb90 2023-09-30T22:25:24.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.922+0000 7f720d5a1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f720809aa30 con 0x7f7208136ac0 2023-09-30T22:25:24.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.922+0000 7f720cda0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7208136ac0 0x7f7208138ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.922+0000 7f720cda0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7208136ac0 0x7f7208138ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49012/0 (socket says 172.21.15.156:49012) 2023-09-30T22:25:24.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.922+0000 7f720cda0700 1 -- 172.21.15.156:0/2155584248 learned_addr learned my addr 172.21.15.156:0/2155584248 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:24.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.922+0000 7f72077fe700 1 --2- 172.21.15.156:0/2155584248 >> v2:172.21.15.156:3300/0 conn(0x7f720806fb90 0x7f7208136580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.922+0000 7f720cda0700 1 -- 172.21.15.156:0/2155584248 >> v2:172.21.15.156:3300/0 conn(0x7f720806fb90 msgr2=0x7f7208136580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:24.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.922+0000 7f720cda0700 1 --2- 172.21.15.156:0/2155584248 >> v2:172.21.15.156:3300/0 conn(0x7f720806fb90 0x7f7208136580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.922+0000 7f720cda0700 1 -- 172.21.15.156:0/2155584248 >> v1:172.21.15.156:6789/0 conn(0x7f7208099f50 legacy=0x7f720809a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:24.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.922+0000 7f720cda0700 1 -- 172.21.15.156:0/2155584248 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720809b950 con 0x7f7208136ac0 2023-09-30T22:25:24.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.923+0000 7f720cda0700 1 --2- 172.21.15.156:0/2155584248 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7208136ac0 0x7f7208138ea0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f7200009e80 tx=0x7f720000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=572040f0308f36fd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:24.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.923+0000 7f7206ffd700 1 -- 172.21.15.156:0/2155584248 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720000e070 con 0x7f7208136ac0 2023-09-30T22:25:24.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.923+0000 7f7206ffd700 1 -- 172.21.15.156:0/2155584248 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7200003a20 con 0x7f7208136ac0 2023-09-30T22:25:24.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.923+0000 7f7206ffd700 1 -- 172.21.15.156:0/2155584248 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7200003dd0 con 0x7f7208136ac0 2023-09-30T22:25:24.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.923+0000 7f720d5a1700 1 -- 172.21.15.156:0/2155584248 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7208136ac0 msgr2=0x7f7208138ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.923+0000 7f720d5a1700 1 --2- 172.21.15.156:0/2155584248 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7208136ac0 0x7f7208138ea0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f7200009e80 tx=0x7f720000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:24.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.924+0000 7f720d5a1700 1 -- 172.21.15.156:0/2155584248 shutdown_connections 2023-09-30T22:25:24.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.924+0000 7f720d5a1700 1 --2- 172.21.15.156:0/2155584248 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7208136ac0 0x7f7208138ea0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.924+0000 7f720d5a1700 1 --2- 172.21.15.156:0/2155584248 >> v2:172.21.15.156:3300/0 conn(0x7f720806fb90 0x7f7208136580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.924+0000 7f720d5a1700 1 -- 172.21.15.156:0/2155584248 >> 172.21.15.156:0/2155584248 conn(0x7f72080a27a0 msgr2=0x7f72080a2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:24.926 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.924+0000 7f720d5a1700 1 -- 172.21.15.156:0/2155584248 shutdown_connections 2023-09-30T22:25:24.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.924+0000 7f720d5a1700 1 -- 172.21.15.156:0/2155584248 wait complete. 2023-09-30T22:25:24.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.924+0000 7f720d5a1700 1 Processor -- start 2023-09-30T22:25:24.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.925+0000 7f720d5a1700 1 -- start start 2023-09-30T22:25:24.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.925+0000 7f720d5a1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f720806fb90 0x7f720812d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.925+0000 7f720d5a1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7208099f50 0x7f720812dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.925+0000 7f720d5a1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7208136ac0 0x7f7208134220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.925+0000 7f720d5a1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720811d130 con 0x7f720806fb90 2023-09-30T22:25:24.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.925+0000 7f720d5a1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7208136e90 con 0x7f7208099f50 2023-09-30T22:25:24.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.925+0000 7f720d5a1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f720809b050 con 0x7f7208136ac0 2023-09-30T22:25:24.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.925+0000 7f7207fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f720806fb90 0x7f720812d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.925+0000 7f720cda0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7208136ac0 0x7f7208134220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.925+0000 7f7207fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f720806fb90 0x7f720812d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47388/0 (socket says 172.21.15.156:47388) 2023-09-30T22:25:24.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.925+0000 7f720cda0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7208136ac0 0x7f7208134220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34852/0 (socket says 172.21.15.156:34852) 2023-09-30T22:25:24.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.925+0000 7f7207fff700 1 -- 172.21.15.156:0/1540535545 learned_addr learned my addr 172.21.15.156:0/1540535545 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:24.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.925+0000 7f72077fe700 1 --2- 172.21.15.156:0/1540535545 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7208099f50 0x7f720812dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.926+0000 7f720cda0700 1 -- 172.21.15.156:0/1540535545 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7208099f50 msgr2=0x7f720812dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.926+0000 7f720cda0700 1 --2- 172.21.15.156:0/1540535545 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7208099f50 0x7f720812dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.926+0000 7f720cda0700 1 -- 172.21.15.156:0/1540535545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f720806fb90 msgr2=0x7f720812d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.926+0000 7f720cda0700 1 --2- 172.21.15.156:0/1540535545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f720806fb90 0x7f720812d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.926+0000 7f720cda0700 1 -- 172.21.15.156:0/1540535545 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7200009b30 con 0x7f7208136ac0 2023-09-30T22:25:24.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.926+0000 7f72077fe700 1 --2- 172.21.15.156:0/1540535545 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7208099f50 0x7f720812dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:24.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.926+0000 7f7207fff700 1 --2- 172.21.15.156:0/1540535545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f720806fb90 0x7f720812d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:24.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.926+0000 7f720cda0700 1 --2- 172.21.15.156:0/1540535545 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7208136ac0 0x7f7208134220 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f720806ffa0 tx=0x7f7200004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:24.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.926+0000 7f7204ff9700 1 -- 172.21.15.156:0/1540535545 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72000094f0 con 0x7f7208136ac0 2023-09-30T22:25:24.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.926+0000 7f7204ff9700 1 -- 172.21.15.156:0/1540535545 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7200004240 con 0x7f7208136ac0 2023-09-30T22:25:24.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.926+0000 7f7204ff9700 1 -- 172.21.15.156:0/1540535545 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72000045f0 con 0x7f7208136ac0 2023-09-30T22:25:24.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.926+0000 7f720d5a1700 1 -- 172.21.15.156:0/1540535545 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f720812eb20 con 0x7f7208136ac0 2023-09-30T22:25:24.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.926+0000 7f720d5a1700 1 -- 172.21.15.156:0/1540535545 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7208071740 con 0x7f7208136ac0 2023-09-30T22:25:24.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.927+0000 7f7204ff9700 1 -- 172.21.15.156:0/1540535545 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7200019070 con 0x7f7208136ac0 2023-09-30T22:25:24.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.928+0000 7f7204ff9700 1 -- 172.21.15.156:0/1540535545 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7200040390 con 0x7f7208136ac0 2023-09-30T22:25:24.932 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.928+0000 7f720d5a1700 1 -- 172.21.15.156:0/1540535545 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f720804f2a0 con 0x7f7208136ac0 2023-09-30T22:25:24.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:24.932+0000 7f7204ff9700 1 -- 172.21.15.156:0/1540535545 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7200017080 con 0x7f7208136ac0 2023-09-30T22:25:25.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.011+0000 7f99c7607700 1 -- 172.21.15.156:0/2432365815 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f99c0132950 con 0x7f99c00a10b0 2023-09-30T22:25:25.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.011+0000 7f99b5ffb700 1 -- 172.21.15.156:0/2432365815 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f99bc027950 con 0x7f99c00a10b0 2023-09-30T22:25:25.012 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:25.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.014+0000 7f99c7607700 1 -- 172.21.15.156:0/2432365815 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99c00a10b0 msgr2=0x7f99c011b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:25.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.014+0000 7f99c7607700 1 --2- 172.21.15.156:0/2432365815 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99c00a10b0 0x7f99c011b700 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f99bc017380 tx=0x7f99bc017740 comp rx=0 tx=0).stop 2023-09-30T22:25:25.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.014+0000 7f99c7607700 1 -- 172.21.15.156:0/2432365815 shutdown_connections 2023-09-30T22:25:25.015 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.014+0000 7f99c7607700 1 --2- 172.21.15.156:0/2432365815 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f99c0134210 0x7f99c011c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.014+0000 7f99c7607700 1 --2- 172.21.15.156:0/2432365815 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f99c00a10b0 0x7f99c011b700 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.014+0000 7f99c7607700 1 --2- 172.21.15.156:0/2432365815 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99c0133900 0x7f99c011bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.014+0000 7f99c7607700 1 -- 172.21.15.156:0/2432365815 >> 172.21.15.156:0/2432365815 conn(0x7f99c00a2980 msgr2=0x7f99c009f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:25.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.015+0000 7f99c7607700 1 -- 172.21.15.156:0/2432365815 shutdown_connections 2023-09-30T22:25:25.016 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.015+0000 7f99c7607700 1 -- 172.21.15.156:0/2432365815 wait complete. 2023-09-30T22:25:25.032 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:25.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.060+0000 7efc92700700 1 -- 172.21.15.156:0/4082462444 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efc8c124d30 con 0x7efc8c134120 2023-09-30T22:25:25.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.061+0000 7efc88ff9700 1 -- 172.21.15.156:0/4082462444 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efc84011980 con 0x7efc8c134120 2023-09-30T22:25:25.061 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:25.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.063+0000 7efc92700700 1 -- 172.21.15.156:0/4082462444 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc8c134120 msgr2=0x7efc8c123440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:25.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.063+0000 7efc92700700 1 --2- 172.21.15.156:0/4082462444 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc8c134120 0x7efc8c123440 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7efc84014000 tx=0x7efc84004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.065 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.063+0000 7efc92700700 1 -- 172.21.15.156:0/4082462444 shutdown_connections 2023-09-30T22:25:25.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.063+0000 7efc92700700 1 --2- 172.21.15.156:0/4082462444 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc8c134120 0x7efc8c123440 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.063+0000 7efc92700700 1 --2- 172.21.15.156:0/4082462444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc8c0a0a70 0x7efc8c1229c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.063+0000 7efc92700700 1 --2- 172.21.15.156:0/4082462444 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc8c0a1380 0x7efc8c122f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.063+0000 7efc92700700 1 -- 172.21.15.156:0/4082462444 >> 172.21.15.156:0/4082462444 conn(0x7efc8c0a6610 msgr2=0x7efc8c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:25.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.064+0000 7efc92700700 1 -- 172.21.15.156:0/4082462444 shutdown_connections 2023-09-30T22:25:25.066 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.064+0000 7efc92700700 1 -- 172.21.15.156:0/4082462444 wait complete. 2023-09-30T22:25:25.081 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:25.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.110+0000 7f2051cbe700 1 -- 172.21.15.156:0/1675028643 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f204c04f2a0 con 0x7f204c0a0a70 2023-09-30T22:25:25.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.110+0000 7f2033fff700 1 -- 172.21.15.156:0/1675028643 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f203c029070 con 0x7f204c0a0a70 2023-09-30T22:25:25.111 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:25.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.112+0000 7f2051cbe700 1 -- 172.21.15.156:0/1675028643 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f204c0a0a70 msgr2=0x7f204c1c88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:25.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.112+0000 7f2051cbe700 1 --2- 172.21.15.156:0/1675028643 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f204c0a0a70 0x7f204c1c88b0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f203c00c010 tx=0x7f203c004750 comp rx=0 tx=0).stop 2023-09-30T22:25:25.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.113+0000 7f2051cbe700 1 -- 172.21.15.156:0/1675028643 shutdown_connections 2023-09-30T22:25:25.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.113+0000 7f2051cbe700 1 --2- 172.21.15.156:0/1675028643 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f204c133f50 0x7f204c11e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.113+0000 7f2051cbe700 1 --2- 172.21.15.156:0/1675028643 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f204c0a0a70 0x7f204c1c88b0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.113+0000 7f2051cbe700 1 --2- 172.21.15.156:0/1675028643 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f204c0a1380 0x7f204c1c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.113+0000 7f2051cbe700 1 -- 172.21.15.156:0/1675028643 >> 172.21.15.156:0/1675028643 conn(0x7f204c0a6610 msgr2=0x7f204c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:25.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.113+0000 7f2051cbe700 1 -- 172.21.15.156:0/1675028643 shutdown_connections 2023-09-30T22:25:25.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.113+0000 7f2051cbe700 1 -- 172.21.15.156:0/1675028643 wait complete. 2023-09-30T22:25:25.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:25.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.127+0000 7f720d5a1700 1 -- 172.21.15.156:0/1540535545 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f720809f840 con 0x7f7208136ac0 2023-09-30T22:25:25.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.128+0000 7f7204ff9700 1 -- 172.21.15.156:0/1540535545 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7200020030 con 0x7f7208136ac0 2023-09-30T22:25:25.128 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:25.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.130+0000 7f720d5a1700 1 -- 172.21.15.156:0/1540535545 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7208136ac0 msgr2=0x7f7208134220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:25.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.130+0000 7f720d5a1700 1 --2- 172.21.15.156:0/1540535545 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7208136ac0 0x7f7208134220 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f720806ffa0 tx=0x7f7200004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.130+0000 7f720d5a1700 1 -- 172.21.15.156:0/1540535545 shutdown_connections 2023-09-30T22:25:25.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.130+0000 7f720d5a1700 1 --2- 172.21.15.156:0/1540535545 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7208136ac0 0x7f7208134220 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.130+0000 7f720d5a1700 1 --2- 172.21.15.156:0/1540535545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f720806fb90 0x7f720812d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.130+0000 7f720d5a1700 1 --2- 172.21.15.156:0/1540535545 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7208099f50 0x7f720812dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.130+0000 7f720d5a1700 1 -- 172.21.15.156:0/1540535545 >> 172.21.15.156:0/1540535545 conn(0x7f72080a27a0 msgr2=0x7f72080a1350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:25.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.130+0000 7f720d5a1700 1 -- 172.21.15.156:0/1540535545 shutdown_connections 2023-09-30T22:25:25.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:25.130+0000 7f720d5a1700 1 -- 172.21.15.156:0/1540535545 wait complete. 2023-09-30T22:25:25.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:26.032 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:26.082 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:26.126 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:26.143 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:26.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.174+0000 7f7966225700 1 Processor -- start 2023-09-30T22:25:26.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.174+0000 7f7966225700 1 -- start start 2023-09-30T22:25:26.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.174+0000 7f7966225700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f796009a130 0x7f796009e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.174+0000 7f7966225700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f796009edb0 0x7f796009f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.174+0000 7f7966225700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7960072b30 con 0x7f796013c410 2023-09-30T22:25:26.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.174+0000 7f7966225700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796009a500 con 0x7f796009a130 2023-09-30T22:25:26.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.174+0000 7f7966225700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f796009f720 con 0x7f796009edb0 2023-09-30T22:25:26.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.174+0000 7f795effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f796009edb0 0x7f796009f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.174+0000 7f795f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f796009a130 0x7f796009e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.174+0000 7f795f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f796009a130 0x7f796009e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49024/0 (socket says 172.21.15.156:49024) 2023-09-30T22:25:26.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.174+0000 7f795effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f796009edb0 0x7f796009f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34868/0 (socket says 172.21.15.156:34868) 2023-09-30T22:25:26.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.174+0000 7f795f7fe700 1 -- 172.21.15.156:0/2687570891 learned_addr learned my addr 172.21.15.156:0/2687570891 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:26.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.175+0000 7f795f7fe700 1 -- 172.21.15.156:0/2687570891 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f796009edb0 msgr2=0x7f796009f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:26.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.175+0000 7f795f7fe700 1 --2- 172.21.15.156:0/2687570891 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f796009edb0 0x7f796009f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.175+0000 7f795f7fe700 1 -- 172.21.15.156:0/2687570891 >> v1:172.21.15.156:6789/0 conn(0x7f796013c410 legacy=0x7f796013e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.175+0000 7f795f7fe700 1 -- 172.21.15.156:0/2687570891 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796009fe00 con 0x7f796009a130 2023-09-30T22:25:26.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.175+0000 7f795f7fe700 1 --2- 172.21.15.156:0/2687570891 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f796009a130 0x7f796009e870 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f7950009920 tx=0x7f7950009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7848b013f746a4f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:26.177 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.175+0000 7f795e7fc700 1 -- 172.21.15.156:0/2687570891 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7950011830 con 0x7f796009a130 2023-09-30T22:25:26.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.175+0000 7f795e7fc700 1 -- 172.21.15.156:0/2687570891 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7950011990 con 0x7f796009a130 2023-09-30T22:25:26.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.175+0000 7f795e7fc700 1 -- 172.21.15.156:0/2687570891 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7950011d00 con 0x7f796009a130 2023-09-30T22:25:26.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.176+0000 7f7966225700 1 -- 172.21.15.156:0/2687570891 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f796009a130 msgr2=0x7f796009e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.176+0000 7f7966225700 1 --2- 172.21.15.156:0/2687570891 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f796009a130 0x7f796009e870 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f7950009920 tx=0x7f7950009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:26.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.176+0000 7f7966225700 1 -- 172.21.15.156:0/2687570891 shutdown_connections 2023-09-30T22:25:26.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.176+0000 7f7966225700 1 --2- 172.21.15.156:0/2687570891 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f796009a130 0x7f796009e870 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.176+0000 7f7966225700 1 --2- 172.21.15.156:0/2687570891 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f796009edb0 0x7f796009f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.176+0000 7f7966225700 1 -- 172.21.15.156:0/2687570891 >> 172.21.15.156:0/2687570891 conn(0x7f79600a4430 msgr2=0x7f79600a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:26.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.176+0000 7f7966225700 1 -- 172.21.15.156:0/2687570891 shutdown_connections 2023-09-30T22:25:26.178 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.176+0000 7f7966225700 1 -- 172.21.15.156:0/2687570891 wait complete. 2023-09-30T22:25:26.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.177+0000 7f7966225700 1 Processor -- start 2023-09-30T22:25:26.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.177+0000 7f7966225700 1 -- start start 2023-09-30T22:25:26.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.178+0000 7f7966225700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f796009edb0 0x7f796013ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.178+0000 7f7966225700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f796013c410 0x7f796013b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.178+0000 7f7966225700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f796013bec0 0x7f796013b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.178+0000 7f7966225700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79601352e0 con 0x7f796013bec0 2023-09-30T22:25:26.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.178+0000 7f7966225700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796011de30 con 0x7f796013c410 2023-09-30T22:25:26.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.178+0000 7f7966225700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f796011d450 con 0x7f796009edb0 2023-09-30T22:25:26.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.178+0000 7f795f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f796009edb0 0x7f796013ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.178+0000 7f795f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f796009edb0 0x7f796013ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34884/0 (socket says 172.21.15.156:34884) 2023-09-30T22:25:26.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.178+0000 7f795f7fe700 1 -- 172.21.15.156:0/3611998120 learned_addr learned my addr 172.21.15.156:0/3611998120 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:26.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.178+0000 7f795ffff700 1 --2- 172.21.15.156:0/3611998120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f796013bec0 0x7f796013b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.178+0000 7f795effd700 1 --2- 172.21.15.156:0/3611998120 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f796013c410 0x7f796013b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.178+0000 7f795ffff700 1 -- 172.21.15.156:0/3611998120 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f796009edb0 msgr2=0x7f796013ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.178+0000 7f795ffff700 1 --2- 172.21.15.156:0/3611998120 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f796009edb0 0x7f796013ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.178+0000 7f795ffff700 1 -- 172.21.15.156:0/3611998120 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f796013c410 msgr2=0x7f796013b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.178+0000 7f795ffff700 1 --2- 172.21.15.156:0/3611998120 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f796013c410 0x7f796013b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.178+0000 7f795ffff700 1 -- 172.21.15.156:0/3611998120 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7950009550 con 0x7f796013bec0 2023-09-30T22:25:26.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.178+0000 7f795ffff700 1 --2- 172.21.15.156:0/3611998120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f796013bec0 0x7f796013b600 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f795800cb90 tx=0x7f795800cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:26.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.179+0000 7f7947fff700 1 -- 172.21.15.156:0/3611998120 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7958003c00 con 0x7f796013bec0 2023-09-30T22:25:26.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.179+0000 7f7947fff700 1 -- 172.21.15.156:0/3611998120 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7958003d60 con 0x7f796013bec0 2023-09-30T22:25:26.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.179+0000 7f7947fff700 1 -- 172.21.15.156:0/3611998120 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795800aa80 con 0x7f796013bec0 2023-09-30T22:25:26.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.180+0000 7f7966225700 1 -- 172.21.15.156:0/3611998120 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796011c310 con 0x7f796013bec0 2023-09-30T22:25:26.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.180+0000 7f7966225700 1 -- 172.21.15.156:0/3611998120 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79600a00f0 con 0x7f796013bec0 2023-09-30T22:25:26.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.180+0000 7f7947fff700 1 -- 172.21.15.156:0/3611998120 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f795800abe0 con 0x7f796013bec0 2023-09-30T22:25:26.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.180+0000 7f7947fff700 1 -- 172.21.15.156:0/3611998120 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f795803f500 con 0x7f796013bec0 2023-09-30T22:25:26.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.181+0000 7f7966225700 1 -- 172.21.15.156:0/3611998120 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f796004f2a0 con 0x7f796013bec0 2023-09-30T22:25:26.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.187+0000 7f7947fff700 1 -- 172.21.15.156:0/3611998120 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f79580050d0 con 0x7f796013bec0 2023-09-30T22:25:26.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.235+0000 7f03af72f700 1 Processor -- start 2023-09-30T22:25:26.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.235+0000 7f03af72f700 1 -- start start 2023-09-30T22:25:26.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.236+0000 7f03af72f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f03a8136ae0 0x7f03a8138ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.236+0000 7f03af72f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f03a8139400 0x7f03a813b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.236+0000 7f03af72f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a809a8e0 con 0x7f03a809bd20 2023-09-30T22:25:26.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.236+0000 7f03af72f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a809ad30 con 0x7f03a8136ae0 2023-09-30T22:25:26.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.236+0000 7f03af72f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03a809c800 con 0x7f03a8139400 2023-09-30T22:25:26.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.236+0000 7f03accca700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f03a8136ae0 0x7f03a8138ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.236+0000 7f03adccc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f03a8139400 0x7f03a813b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.236+0000 7f03accca700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f03a8136ae0 0x7f03a8138ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47394/0 (socket says 172.21.15.156:47394) 2023-09-30T22:25:26.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.236+0000 7f03accca700 1 -- 172.21.15.156:0/2471649295 learned_addr learned my addr 172.21.15.156:0/2471649295 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:26.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.237+0000 7f03adccc700 1 -- 172.21.15.156:0/2471649295 >> v2:172.21.15.156:3300/0 conn(0x7f03a8136ae0 msgr2=0x7f03a8138ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:26.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.237+0000 7f03adccc700 1 --2- 172.21.15.156:0/2471649295 >> v2:172.21.15.156:3300/0 conn(0x7f03a8136ae0 0x7f03a8138ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.237+0000 7f03adccc700 1 -- 172.21.15.156:0/2471649295 >> v1:172.21.15.156:6789/0 conn(0x7f03a809bd20 legacy=0x7f03a809c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.237+0000 7f03adccc700 1 -- 172.21.15.156:0/2471649295 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a809a620 con 0x7f03a8139400 2023-09-30T22:25:26.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.237+0000 7f03accca700 1 --2- 172.21.15.156:0/2471649295 >> v2:172.21.15.156:3300/0 conn(0x7f03a8136ae0 0x7f03a8138ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:26.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.237+0000 7f03adccc700 1 --2- 172.21.15.156:0/2471649295 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f03a8139400 0x7f03a813b7e0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f03a0009d90 tx=0x7f03a000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e278b5673bbbdf36 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:26.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.237+0000 7f039ffff700 1 -- 172.21.15.156:0/2471649295 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a000e070 con 0x7f03a8139400 2023-09-30T22:25:26.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.237+0000 7f039ffff700 1 -- 172.21.15.156:0/2471649295 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a000bb20 con 0x7f03a8139400 2023-09-30T22:25:26.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.237+0000 7f039ffff700 1 -- 172.21.15.156:0/2471649295 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a0012430 con 0x7f03a8139400 2023-09-30T22:25:26.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.238+0000 7f03af72f700 1 -- 172.21.15.156:0/2471649295 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f03a8139400 msgr2=0x7f03a813b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.238+0000 7f03af72f700 1 --2- 172.21.15.156:0/2471649295 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f03a8139400 0x7f03a813b7e0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f03a0009d90 tx=0x7f03a000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:26.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.238+0000 7f03af72f700 1 -- 172.21.15.156:0/2471649295 shutdown_connections 2023-09-30T22:25:26.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.238+0000 7f03af72f700 1 --2- 172.21.15.156:0/2471649295 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f03a8139400 0x7f03a813b7e0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.238+0000 7f03af72f700 1 --2- 172.21.15.156:0/2471649295 >> v2:172.21.15.156:3300/0 conn(0x7f03a8136ae0 0x7f03a8138ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.238+0000 7f03af72f700 1 -- 172.21.15.156:0/2471649295 >> 172.21.15.156:0/2471649295 conn(0x7f03a809f9f0 msgr2=0x7f03a809fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:26.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.238+0000 7f03af72f700 1 -- 172.21.15.156:0/2471649295 shutdown_connections 2023-09-30T22:25:26.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.238+0000 7f03af72f700 1 -- 172.21.15.156:0/2471649295 wait complete. 2023-09-30T22:25:26.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.239+0000 7f03af72f700 1 Processor -- start 2023-09-30T22:25:26.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.239+0000 7f03af72f700 1 -- start start 2023-09-30T22:25:26.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.240+0000 7f03af72f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f03a809bd20 0x7f03a811e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.240+0000 7f03af72f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f03a8136ae0 0x7f03a811eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.240+0000 7f03af72f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f03a8139400 0x7f03a811f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.240+0000 7f03af72f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a809e6b0 con 0x7f03a8139400 2023-09-30T22:25:26.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.240+0000 7f03af72f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a8133f20 con 0x7f03a8136ae0 2023-09-30T22:25:26.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.240+0000 7f03af72f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03a8122220 con 0x7f03a809bd20 2023-09-30T22:25:26.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.240+0000 7f03ad4cb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f03a809bd20 0x7f03a811e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.240+0000 7f03accca700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f03a8136ae0 0x7f03a811eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.240+0000 7f03ad4cb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f03a809bd20 0x7f03a811e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34894/0 (socket says 172.21.15.156:34894) 2023-09-30T22:25:26.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.240+0000 7f03ad4cb700 1 -- 172.21.15.156:0/2841394078 learned_addr learned my addr 172.21.15.156:0/2841394078 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:26.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.240+0000 7f03adccc700 1 --2- 172.21.15.156:0/2841394078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f03a8139400 0x7f03a811f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.240+0000 7f03ad4cb700 1 -- 172.21.15.156:0/2841394078 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f03a8136ae0 msgr2=0x7f03a811eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.240+0000 7f03ad4cb700 1 --2- 172.21.15.156:0/2841394078 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f03a8136ae0 0x7f03a811eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.240+0000 7f03ad4cb700 1 -- 172.21.15.156:0/2841394078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f03a8139400 msgr2=0x7f03a811f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.240+0000 7f03ad4cb700 1 --2- 172.21.15.156:0/2841394078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f03a8139400 0x7f03a811f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.240+0000 7f03ad4cb700 1 -- 172.21.15.156:0/2841394078 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0398009550 con 0x7f03a809bd20 2023-09-30T22:25:26.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.241+0000 7f03ad4cb700 1 --2- 172.21.15.156:0/2841394078 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f03a809bd20 0x7f03a811e5f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f03a400c4d0 tx=0x7f03a400c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:26.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.241+0000 7f039dffb700 1 -- 172.21.15.156:0/2841394078 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a40054e0 con 0x7f03a809bd20 2023-09-30T22:25:26.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.241+0000 7f039dffb700 1 -- 172.21.15.156:0/2841394078 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a4003680 con 0x7f03a809bd20 2023-09-30T22:25:26.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.241+0000 7f03af72f700 1 -- 172.21.15.156:0/2841394078 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a0009a70 con 0x7f03a809bd20 2023-09-30T22:25:26.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.241+0000 7f039dffb700 1 -- 172.21.15.156:0/2841394078 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a4003a30 con 0x7f03a809bd20 2023-09-30T22:25:26.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.241+0000 7f03af72f700 1 -- 172.21.15.156:0/2841394078 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a8121e30 con 0x7f03a809bd20 2023-09-30T22:25:26.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.242+0000 7f039dffb700 1 -- 172.21.15.156:0/2841394078 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f03a4003b90 con 0x7f03a809bd20 2023-09-30T22:25:26.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.242+0000 7f039dffb700 1 -- 172.21.15.156:0/2841394078 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f03a403eb70 con 0x7f03a809bd20 2023-09-30T22:25:26.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.242+0000 7f03af72f700 1 -- 172.21.15.156:0/2841394078 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a81207b0 con 0x7f03a809bd20 2023-09-30T22:25:26.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.247+0000 7f039dffb700 1 -- 172.21.15.156:0/2841394078 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f03a4017020 con 0x7f03a809bd20 2023-09-30T22:25:26.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.262+0000 7efc91143700 1 Processor -- start 2023-09-30T22:25:26.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.262+0000 7efc91143700 1 -- start start 2023-09-30T22:25:26.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.263+0000 7efc91143700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc8c09e870 0x7efc8c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.263+0000 7efc91143700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc8c131f40 0x7efc8c139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.263+0000 7efc91143700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc8c09c970 con 0x7efc8c09f180 2023-09-30T22:25:26.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.263+0000 7efc91143700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c0a0920 con 0x7efc8c09e870 2023-09-30T22:25:26.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.263+0000 7efc91143700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c09f9c0 con 0x7efc8c131f40 2023-09-30T22:25:26.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.263+0000 7efc8a59c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7efc8c09f180 0x7efc8c131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47306/0 (socket says 172.21.15.156:47306) 2023-09-30T22:25:26.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.263+0000 7efc8a59c700 1 -- 172.21.15.156:0/2678366424 learned_addr learned my addr 172.21.15.156:0/2678366424 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:26.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.263+0000 7efc8ad9d700 1 --2- 172.21.15.156:0/2678366424 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc8c09e870 0x7efc8c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.263+0000 7efc8b59e700 1 --2- 172.21.15.156:0/2678366424 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc8c131f40 0x7efc8c139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.263+0000 7efc89d9b700 1 -- 172.21.15.156:0/2678366424 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936474820 0 0) 0x7efc8c09c970 con 0x7efc8c09f180 2023-09-30T22:25:26.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.263+0000 7efc89d9b700 1 -- 172.21.15.156:0/2678366424 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc740035b0 con 0x7efc8c09f180 2023-09-30T22:25:26.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.263+0000 7efc8ad9d700 1 -- 172.21.15.156:0/2678366424 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc8c131f40 msgr2=0x7efc8c139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:26.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.263+0000 7efc8ad9d700 1 --2- 172.21.15.156:0/2678366424 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc8c131f40 0x7efc8c139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.263+0000 7efc8ad9d700 1 -- 172.21.15.156:0/2678366424 >> v1:172.21.15.156:6789/0 conn(0x7efc8c09f180 legacy=0x7efc8c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.263+0000 7efc8ad9d700 1 -- 172.21.15.156:0/2678366424 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8c09bab0 con 0x7efc8c09e870 2023-09-30T22:25:26.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.264+0000 7efc8ad9d700 1 --2- 172.21.15.156:0/2678366424 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc8c09e870 0x7efc8c09ec40 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009870 tx=0x7efc7c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ee7cf672e2562c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:26.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.264+0000 7efc89d9b700 1 -- 172.21.15.156:0/2678366424 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c011830 con 0x7efc8c09e870 2023-09-30T22:25:26.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.264+0000 7efc89d9b700 1 -- 172.21.15.156:0/2678366424 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7c011990 con 0x7efc8c09e870 2023-09-30T22:25:26.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.264+0000 7efc89d9b700 1 -- 172.21.15.156:0/2678366424 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c011d20 con 0x7efc8c09e870 2023-09-30T22:25:26.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.265+0000 7efc91143700 1 -- 172.21.15.156:0/2678366424 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc8c09e870 msgr2=0x7efc8c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.265+0000 7efc91143700 1 --2- 172.21.15.156:0/2678366424 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc8c09e870 0x7efc8c09ec40 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009870 tx=0x7efc7c009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:26.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.265+0000 7efc91143700 1 -- 172.21.15.156:0/2678366424 shutdown_connections 2023-09-30T22:25:26.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.265+0000 7efc91143700 1 --2- 172.21.15.156:0/2678366424 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc8c09e870 0x7efc8c09ec40 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.265+0000 7efc91143700 1 --2- 172.21.15.156:0/2678366424 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc8c131f40 0x7efc8c139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.265+0000 7efc91143700 1 -- 172.21.15.156:0/2678366424 >> 172.21.15.156:0/2678366424 conn(0x7efc8c0a4430 msgr2=0x7efc8c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:26.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.265+0000 7efc91143700 1 -- 172.21.15.156:0/2678366424 shutdown_connections 2023-09-30T22:25:26.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.265+0000 7efc91143700 1 -- 172.21.15.156:0/2678366424 wait complete. 2023-09-30T22:25:26.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.266+0000 7efc91143700 1 Processor -- start 2023-09-30T22:25:26.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.267+0000 7efc91143700 1 -- start start 2023-09-30T22:25:26.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.267+0000 7efc91143700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc8c09e870 0x7efc8c130920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.267+0000 7efc91143700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc8c09f180 0x7efc8c130e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.267+0000 7efc91143700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc8c131f40 0x7efc8c1313a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.267+0000 7efc91143700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c138bb0 con 0x7efc8c09f180 2023-09-30T22:25:26.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.267+0000 7efc91143700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c1380d0 con 0x7efc8c09e870 2023-09-30T22:25:26.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.267+0000 7efc91143700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c0a25c0 con 0x7efc8c131f40 2023-09-30T22:25:26.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.267+0000 7efc8ad9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc8c09e870 0x7efc8c130920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.267+0000 7efc8ad9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc8c09e870 0x7efc8c130920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49060/0 (socket says 172.21.15.156:49060) 2023-09-30T22:25:26.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.267+0000 7efc8ad9d700 1 -- 172.21.15.156:0/915807758 learned_addr learned my addr 172.21.15.156:0/915807758 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:26.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.267+0000 7efc8b59e700 1 --2- 172.21.15.156:0/915807758 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc8c131f40 0x7efc8c1313a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.267+0000 7efc8a59c700 1 --2- 172.21.15.156:0/915807758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc8c09f180 0x7efc8c130e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.268+0000 7efc8ad9d700 1 -- 172.21.15.156:0/915807758 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc8c131f40 msgr2=0x7efc8c1313a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.268+0000 7efc8ad9d700 1 --2- 172.21.15.156:0/915807758 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc8c131f40 0x7efc8c1313a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.268+0000 7efc8ad9d700 1 -- 172.21.15.156:0/915807758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc8c09f180 msgr2=0x7efc8c130e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.268+0000 7efc8ad9d700 1 --2- 172.21.15.156:0/915807758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc8c09f180 0x7efc8c130e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.268+0000 7efc8ad9d700 1 -- 172.21.15.156:0/915807758 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7c0094a0 con 0x7efc8c09e870 2023-09-30T22:25:26.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.268+0000 7efc8a59c700 1 --2- 172.21.15.156:0/915807758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc8c09f180 0x7efc8c130e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:26.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.268+0000 7efc8ad9d700 1 --2- 172.21.15.156:0/915807758 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc8c09e870 0x7efc8c130920 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009840 tx=0x7efc7c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:26.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.268+0000 7efc737fe700 1 -- 172.21.15.156:0/915807758 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c004510 con 0x7efc8c09e870 2023-09-30T22:25:26.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.268+0000 7efc737fe700 1 -- 172.21.15.156:0/915807758 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7c01e070 con 0x7efc8c09e870 2023-09-30T22:25:26.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.268+0000 7efc91143700 1 -- 172.21.15.156:0/915807758 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc8c137840 con 0x7efc8c09e870 2023-09-30T22:25:26.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.268+0000 7efc737fe700 1 -- 172.21.15.156:0/915807758 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c0038e0 con 0x7efc8c09e870 2023-09-30T22:25:26.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.268+0000 7efc91143700 1 -- 172.21.15.156:0/915807758 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc8c13a330 con 0x7efc8c09e870 2023-09-30T22:25:26.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.269+0000 7efc91143700 1 -- 172.21.15.156:0/915807758 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc8c138540 con 0x7efc8c09e870 2023-09-30T22:25:26.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.269+0000 7efc737fe700 1 -- 172.21.15.156:0/915807758 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efc7c003a40 con 0x7efc8c09e870 2023-09-30T22:25:26.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.269+0000 7efc737fe700 1 -- 172.21.15.156:0/915807758 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efc7c040370 con 0x7efc8c09e870 2023-09-30T22:25:26.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.274+0000 7efc737fe700 1 -- 172.21.15.156:0/915807758 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efc7c02d450 con 0x7efc8c09e870 2023-09-30T22:25:26.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.315+0000 7fcc592b4700 1 Processor -- start 2023-09-30T22:25:26.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.315+0000 7fcc592b4700 1 -- start start 2023-09-30T22:25:26.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.316+0000 7fcc592b4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcc5406a770 0x7fcc5406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.316+0000 7fcc592b4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcc54131ec0 0x7fcc54139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.316+0000 7fcc592b4700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc5409da80 con 0x7fcc5406b080 2023-09-30T22:25:26.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.316+0000 7fcc592b4700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc5409dce0 con 0x7fcc5406a770 2023-09-30T22:25:26.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.316+0000 7fcc592b4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5409eb20 con 0x7fcc54131ec0 2023-09-30T22:25:26.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.316+0000 7fcc52ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcc5406a770 0x7fcc5406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.316+0000 7fcc52ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcc5406a770 0x7fcc5406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47422/0 (socket says 172.21.15.156:47422) 2023-09-30T22:25:26.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.316+0000 7fcc52ffd700 1 -- 172.21.15.156:0/2543823416 learned_addr learned my addr 172.21.15.156:0/2543823416 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:26.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.316+0000 7fcc52ffd700 1 -- 172.21.15.156:0/2543823416 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcc54131ec0 msgr2=0x7fcc54139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:26.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.316+0000 7fcc52ffd700 1 --2- 172.21.15.156:0/2543823416 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcc54131ec0 0x7fcc54139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.316+0000 7fcc52ffd700 1 -- 172.21.15.156:0/2543823416 >> v1:172.21.15.156:6789/0 conn(0x7fcc5406b080 legacy=0x7fcc541317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.316+0000 7fcc52ffd700 1 -- 172.21.15.156:0/2543823416 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5409d860 con 0x7fcc5406a770 2023-09-30T22:25:26.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.317+0000 7fcc52ffd700 1 --2- 172.21.15.156:0/2543823416 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc5406a770 0x7fcc5406ab40 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fcc440098f0 tx=0x7fcc44009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5068832b39564481 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:26.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.317+0000 7fcc51ffb700 1 -- 172.21.15.156:0/2543823416 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4400b8a0 con 0x7fcc5406a770 2023-09-30T22:25:26.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.317+0000 7fcc51ffb700 1 -- 172.21.15.156:0/2543823416 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4400ba00 con 0x7fcc5406a770 2023-09-30T22:25:26.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.317+0000 7fcc51ffb700 1 -- 172.21.15.156:0/2543823416 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4400bd90 con 0x7fcc5406a770 2023-09-30T22:25:26.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.317+0000 7fcc592b4700 1 -- 172.21.15.156:0/2543823416 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc5406a770 msgr2=0x7fcc5406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.317+0000 7fcc592b4700 1 --2- 172.21.15.156:0/2543823416 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc5406a770 0x7fcc5406ab40 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fcc440098f0 tx=0x7fcc44009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:26.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.318+0000 7fcc592b4700 1 -- 172.21.15.156:0/2543823416 shutdown_connections 2023-09-30T22:25:26.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.318+0000 7fcc592b4700 1 --2- 172.21.15.156:0/2543823416 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc5406a770 0x7fcc5406ab40 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.318+0000 7fcc592b4700 1 --2- 172.21.15.156:0/2543823416 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcc54131ec0 0x7fcc54139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.318+0000 7fcc592b4700 1 -- 172.21.15.156:0/2543823416 >> 172.21.15.156:0/2543823416 conn(0x7fcc54099c40 msgr2=0x7fcc540a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:26.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.318+0000 7fcc592b4700 1 -- 172.21.15.156:0/2543823416 shutdown_connections 2023-09-30T22:25:26.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.318+0000 7fcc592b4700 1 -- 172.21.15.156:0/2543823416 wait complete. 2023-09-30T22:25:26.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.319+0000 7fcc592b4700 1 Processor -- start 2023-09-30T22:25:26.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.319+0000 7fcc592b4700 1 -- start start 2023-09-30T22:25:26.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.319+0000 7fcc592b4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcc5406a770 0x7fcc54121800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.319+0000 7fcc592b4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcc5406b080 0x7fcc54121d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.319+0000 7fcc592b4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc54131ec0 0x7fcc54122280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.319+0000 7fcc592b4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc54125040 con 0x7fcc54131ec0 2023-09-30T22:25:26.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.319+0000 7fcc592b4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc54123520 con 0x7fcc5406a770 2023-09-30T22:25:26.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.319+0000 7fcc592b4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc541317b0 con 0x7fcc5406b080 2023-09-30T22:25:26.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.319+0000 7fcc537fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc54131ec0 0x7fcc54122280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.319+0000 7fcc52ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcc5406a770 0x7fcc54121800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.319+0000 7fcc537fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc54131ec0 0x7fcc54122280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47424/0 (socket says 172.21.15.156:47424) 2023-09-30T22:25:26.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.319+0000 7fcc537fe700 1 -- 172.21.15.156:0/1212711481 learned_addr learned my addr 172.21.15.156:0/1212711481 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:26.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.320+0000 7fcc527fc700 1 --2- 172.21.15.156:0/1212711481 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcc5406b080 0x7fcc54121d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.320+0000 7fcc537fe700 1 -- 172.21.15.156:0/1212711481 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcc5406b080 msgr2=0x7fcc54121d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.320+0000 7fcc537fe700 1 --2- 172.21.15.156:0/1212711481 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcc5406b080 0x7fcc54121d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.320+0000 7fcc537fe700 1 -- 172.21.15.156:0/1212711481 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcc5406a770 msgr2=0x7fcc54121800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.320+0000 7fcc537fe700 1 --2- 172.21.15.156:0/1212711481 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcc5406a770 0x7fcc54121800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.320+0000 7fcc537fe700 1 -- 172.21.15.156:0/1212711481 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc44009550 con 0x7fcc54131ec0 2023-09-30T22:25:26.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.320+0000 7fcc537fe700 1 --2- 172.21.15.156:0/1212711481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc54131ec0 0x7fcc54122280 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c00b970 tx=0x7fcc4c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:26.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.320+0000 7fcc3b7fe700 1 -- 172.21.15.156:0/1212711481 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c00c930 con 0x7fcc54131ec0 2023-09-30T22:25:26.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.320+0000 7fcc592b4700 1 -- 172.21.15.156:0/1212711481 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc54071e10 con 0x7fcc54131ec0 2023-09-30T22:25:26.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.320+0000 7fcc592b4700 1 -- 172.21.15.156:0/1212711481 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc54125ab0 con 0x7fcc54131ec0 2023-09-30T22:25:26.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.320+0000 7fcc3b7fe700 1 -- 172.21.15.156:0/1212711481 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4c00cab0 con 0x7fcc54131ec0 2023-09-30T22:25:26.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.320+0000 7fcc3b7fe700 1 -- 172.21.15.156:0/1212711481 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c00ce60 con 0x7fcc54131ec0 2023-09-30T22:25:26.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.321+0000 7fcc3b7fe700 1 -- 172.21.15.156:0/1212711481 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcc4c01d3b0 con 0x7fcc54131ec0 2023-09-30T22:25:26.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.322+0000 7fcc3b7fe700 1 -- 172.21.15.156:0/1212711481 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcc4c006e40 con 0x7fcc54131ec0 2023-09-30T22:25:26.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.322+0000 7fcc592b4700 1 -- 172.21.15.156:0/1212711481 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc340052e0 con 0x7fcc54131ec0 2023-09-30T22:25:26.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.327+0000 7fcc3b7fe700 1 -- 172.21.15.156:0/1212711481 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcc4c019080 con 0x7fcc54131ec0 2023-09-30T22:25:26.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.415+0000 7f7966225700 1 -- 172.21.15.156:0/3611998120 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f796006be20 con 0x7f796013bec0 2023-09-30T22:25:26.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.415+0000 7f7947fff700 1 -- 172.21.15.156:0/3611998120 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7958011380 con 0x7f796013bec0 2023-09-30T22:25:26.416 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:26.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.417+0000 7f7966225700 1 -- 172.21.15.156:0/3611998120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f796013bec0 msgr2=0x7f796013b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.417+0000 7f7966225700 1 --2- 172.21.15.156:0/3611998120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f796013bec0 0x7f796013b600 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f795800cb90 tx=0x7f795800cea0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.417+0000 7f7966225700 1 -- 172.21.15.156:0/3611998120 shutdown_connections 2023-09-30T22:25:26.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.417+0000 7f7966225700 1 --2- 172.21.15.156:0/3611998120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f796013bec0 0x7f796013b600 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.417+0000 7f7966225700 1 --2- 172.21.15.156:0/3611998120 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f796009edb0 0x7f796013ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.417+0000 7f7966225700 1 --2- 172.21.15.156:0/3611998120 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f796013c410 0x7f796013b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.417+0000 7f7966225700 1 -- 172.21.15.156:0/3611998120 >> 172.21.15.156:0/3611998120 conn(0x7f79600a4430 msgr2=0x7f79600a2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:26.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.418+0000 7f7966225700 1 -- 172.21.15.156:0/3611998120 shutdown_connections 2023-09-30T22:25:26.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.418+0000 7f7966225700 1 -- 172.21.15.156:0/3611998120 wait complete. 2023-09-30T22:25:26.435 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:26.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.456+0000 7f03af72f700 1 -- 172.21.15.156:0/2841394078 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f03a804f2a0 con 0x7f03a809bd20 2023-09-30T22:25:26.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.456+0000 7f039dffb700 1 -- 172.21.15.156:0/2841394078 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f03a4003e40 con 0x7f03a809bd20 2023-09-30T22:25:26.457 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:26.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.458+0000 7f03af72f700 1 -- 172.21.15.156:0/2841394078 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f03a809bd20 msgr2=0x7f03a811e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.458+0000 7f03af72f700 1 --2- 172.21.15.156:0/2841394078 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f03a809bd20 0x7f03a811e5f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f03a400c4d0 tx=0x7f03a400c7e0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.458+0000 7f03af72f700 1 -- 172.21.15.156:0/2841394078 shutdown_connections 2023-09-30T22:25:26.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.458+0000 7f03af72f700 1 --2- 172.21.15.156:0/2841394078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f03a8139400 0x7f03a811f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.458+0000 7f03af72f700 1 --2- 172.21.15.156:0/2841394078 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f03a809bd20 0x7f03a811e5f0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.458+0000 7f03af72f700 1 --2- 172.21.15.156:0/2841394078 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f03a8136ae0 0x7f03a811eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.458+0000 7f03af72f700 1 -- 172.21.15.156:0/2841394078 >> 172.21.15.156:0/2841394078 conn(0x7f03a809f9f0 msgr2=0x7f03a8135960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:26.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.458+0000 7f03af72f700 1 -- 172.21.15.156:0/2841394078 shutdown_connections 2023-09-30T22:25:26.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.458+0000 7f03af72f700 1 -- 172.21.15.156:0/2841394078 wait complete. 2023-09-30T22:25:26.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:26.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.504+0000 7efc91143700 1 -- 172.21.15.156:0/915807758 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efc8c04f2a0 con 0x7efc8c09e870 2023-09-30T22:25:26.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.504+0000 7efc737fe700 1 -- 172.21.15.156:0/915807758 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efc7c015030 con 0x7efc8c09e870 2023-09-30T22:25:26.505 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:26.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.506+0000 7efc91143700 1 -- 172.21.15.156:0/915807758 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc8c09e870 msgr2=0x7efc8c130920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.506+0000 7efc91143700 1 --2- 172.21.15.156:0/915807758 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc8c09e870 0x7efc8c130920 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009840 tx=0x7efc7c004750 comp rx=0 tx=0).stop 2023-09-30T22:25:26.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.506+0000 7efc91143700 1 -- 172.21.15.156:0/915807758 shutdown_connections 2023-09-30T22:25:26.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.506+0000 7efc91143700 1 --2- 172.21.15.156:0/915807758 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efc8c131f40 0x7efc8c1313a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.506+0000 7efc91143700 1 --2- 172.21.15.156:0/915807758 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efc8c09e870 0x7efc8c130920 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.506+0000 7efc91143700 1 --2- 172.21.15.156:0/915807758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc8c09f180 0x7efc8c130e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.506+0000 7efc91143700 1 -- 172.21.15.156:0/915807758 >> 172.21.15.156:0/915807758 conn(0x7efc8c0a4430 msgr2=0x7efc8c06d340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:26.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.506+0000 7efc91143700 1 -- 172.21.15.156:0/915807758 shutdown_connections 2023-09-30T22:25:26.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.506+0000 7efc91143700 1 -- 172.21.15.156:0/915807758 wait complete. 2023-09-30T22:25:26.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:26.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.549+0000 7fcc592b4700 1 -- 172.21.15.156:0/1212711481 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcc34005590 con 0x7fcc54131ec0 2023-09-30T22:25:26.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.549+0000 7fcc3b7fe700 1 -- 172.21.15.156:0/1212711481 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcc4c007370 con 0x7fcc54131ec0 2023-09-30T22:25:26.550 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:26.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.551+0000 7fcc592b4700 1 -- 172.21.15.156:0/1212711481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc54131ec0 msgr2=0x7fcc54122280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.551+0000 7fcc592b4700 1 --2- 172.21.15.156:0/1212711481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc54131ec0 0x7fcc54122280 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c00b970 tx=0x7fcc4c00bc80 comp rx=0 tx=0).stop 2023-09-30T22:25:26.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.551+0000 7fcc592b4700 1 -- 172.21.15.156:0/1212711481 shutdown_connections 2023-09-30T22:25:26.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.551+0000 7fcc592b4700 1 --2- 172.21.15.156:0/1212711481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc54131ec0 0x7fcc54122280 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.551+0000 7fcc592b4700 1 --2- 172.21.15.156:0/1212711481 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcc5406a770 0x7fcc54121800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.551+0000 7fcc592b4700 1 --2- 172.21.15.156:0/1212711481 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcc5406b080 0x7fcc54121d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.551+0000 7fcc592b4700 1 -- 172.21.15.156:0/1212711481 >> 172.21.15.156:0/1212711481 conn(0x7fcc54099c40 msgr2=0x7fcc5409a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:26.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.551+0000 7fcc592b4700 1 -- 172.21.15.156:0/1212711481 shutdown_connections 2023-09-30T22:25:26.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:26.551+0000 7fcc592b4700 1 -- 172.21.15.156:0/1212711481 wait complete. 2023-09-30T22:25:26.564 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:27.435 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:27.472 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:27.520 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:27.564 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:27.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.568+0000 7f5f64bce700 1 Processor -- start 2023-09-30T22:25:27.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.568+0000 7f5f64bce700 1 -- start start 2023-09-30T22:25:27.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.569+0000 7f5f64bce700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f6009d860 0x7f5f6009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.569+0000 7f5f64bce700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5f6009e170 0x7f5f601307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.569+0000 7f5f64bce700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f60130ce0 0x7f5f60131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.569+0000 7f5f64bce700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f6009aaa0 con 0x7f5f6009e170 2023-09-30T22:25:27.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.569+0000 7f5f64bce700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6009f870 con 0x7f5f60130ce0 2023-09-30T22:25:27.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.569+0000 7f5f64bce700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6009b360 con 0x7f5f6009d860 2023-09-30T22:25:27.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.569+0000 7f5f5e59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f6009d860 0x7f5f6009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.569+0000 7f5f5e59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f6009d860 0x7f5f6009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:34962/0 (socket says 172.21.15.156:34962) 2023-09-30T22:25:27.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.569+0000 7f5f5e59c700 1 -- 172.21.15.156:0/3651590772 learned_addr learned my addr 172.21.15.156:0/3651590772 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:27.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.569+0000 7f5f5ed9d700 1 --2- 172.21.15.156:0/3651590772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f60130ce0 0x7f5f60131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.569+0000 7f5f5dd9b700 1 --2- 172.21.15.156:0/3651590772 >> v2:172.21.15.156:3300/0 conn(0x7f5f6009e170 0x7f5f601307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.569+0000 7f5f5dd9b700 1 -- 172.21.15.156:0/3651590772 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f6009d860 msgr2=0x7f5f6009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:27.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.569+0000 7f5f5dd9b700 1 --2- 172.21.15.156:0/3651590772 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f6009d860 0x7f5f6009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.569+0000 7f5f5dd9b700 1 -- 172.21.15.156:0/3651590772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f60130ce0 msgr2=0x7f5f60131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:27.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.569+0000 7f5f5dd9b700 1 --2- 172.21.15.156:0/3651590772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f60130ce0 0x7f5f60131180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.569+0000 7f5f5dd9b700 1 -- 172.21.15.156:0/3651590772 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6009b620 con 0x7f5f6009e170 2023-09-30T22:25:27.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.569+0000 7f5f5ed9d700 1 --2- 172.21.15.156:0/3651590772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f60130ce0 0x7f5f60131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:27.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.570+0000 7f5f5dd9b700 1 --2- 172.21.15.156:0/3651590772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f6009e170 0x7f5f601307a0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f5f54009840 tx=0x7f5f54009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf39eba72a81108 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:27.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.570+0000 7f5f5d59a700 1 -- 172.21.15.156:0/3651590772 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f54011830 con 0x7f5f6009e170 2023-09-30T22:25:27.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.570+0000 7f5f5d59a700 1 -- 172.21.15.156:0/3651590772 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f54011990 con 0x7f5f6009e170 2023-09-30T22:25:27.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.570+0000 7f5f5d59a700 1 -- 172.21.15.156:0/3651590772 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f54011d20 con 0x7f5f6009e170 2023-09-30T22:25:27.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.571+0000 7f5f64bce700 1 -- 172.21.15.156:0/3651590772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f6009e170 msgr2=0x7f5f601307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.571+0000 7f5f64bce700 1 --2- 172.21.15.156:0/3651590772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f6009e170 0x7f5f601307a0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f5f54009840 tx=0x7f5f54009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:27.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.571+0000 7f5f64bce700 1 -- 172.21.15.156:0/3651590772 shutdown_connections 2023-09-30T22:25:27.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.571+0000 7f5f64bce700 1 --2- 172.21.15.156:0/3651590772 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f60130ce0 0x7f5f60131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.571+0000 7f5f64bce700 1 --2- 172.21.15.156:0/3651590772 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f6009d860 0x7f5f6009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.571+0000 7f5f64bce700 1 --2- 172.21.15.156:0/3651590772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f6009e170 0x7f5f601307a0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.571+0000 7f5f64bce700 1 -- 172.21.15.156:0/3651590772 >> 172.21.15.156:0/3651590772 conn(0x7f5f60099c40 msgr2=0x7f5f600a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:27.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.571+0000 7f5f64bce700 1 -- 172.21.15.156:0/3651590772 shutdown_connections 2023-09-30T22:25:27.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.571+0000 7f5f64bce700 1 -- 172.21.15.156:0/3651590772 wait complete. 2023-09-30T22:25:27.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.572+0000 7f5f64bce700 1 Processor -- start 2023-09-30T22:25:27.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.572+0000 7f5f64bce700 1 -- start start 2023-09-30T22:25:27.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.573+0000 7f5f64bce700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f6009d860 0x7f5f6011d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.573+0000 7f5f64bce700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f6009e170 0x7f5f6011d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.573+0000 7f5f64bce700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f60130ce0 0x7f5f6011daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.573+0000 7f5f64bce700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6011ec40 con 0x7f5f6009e170 2023-09-30T22:25:27.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.573+0000 7f5f64bce700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6009c8b0 con 0x7f5f60130ce0 2023-09-30T22:25:27.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.573+0000 7f5f64bce700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f60120870 con 0x7f5f6009d860 2023-09-30T22:25:27.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.573+0000 7f5f5ed9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f60130ce0 0x7f5f6011daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.573+0000 7f5f5ed9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f60130ce0 0x7f5f6011daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49088/0 (socket says 172.21.15.156:49088) 2023-09-30T22:25:27.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.573+0000 7f5f5ed9d700 1 -- 172.21.15.156:0/3199345996 learned_addr learned my addr 172.21.15.156:0/3199345996 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:27.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.573+0000 7f5f5dd9b700 1 --2- 172.21.15.156:0/3199345996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f6009e170 0x7f5f6011d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.574+0000 7f5f5ed9d700 1 -- 172.21.15.156:0/3199345996 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f6009d860 msgr2=0x7f5f6011d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.574+0000 7f5f5ed9d700 1 --2- 172.21.15.156:0/3199345996 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f6009d860 0x7f5f6011d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.574+0000 7f5f5ed9d700 1 -- 172.21.15.156:0/3199345996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f6009e170 msgr2=0x7f5f6011d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.574+0000 7f5f5ed9d700 1 --2- 172.21.15.156:0/3199345996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f6009e170 0x7f5f6011d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.574+0000 7f5f5ed9d700 1 -- 172.21.15.156:0/3199345996 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f58009a70 con 0x7f5f60130ce0 2023-09-30T22:25:27.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.574+0000 7f5f5ed9d700 1 --2- 172.21.15.156:0/3199345996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f60130ce0 0x7f5f6011daf0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800efc0 tx=0x7f5f5800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:27.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.574+0000 7f5f4effd700 1 -- 172.21.15.156:0/3199345996 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5800cb40 con 0x7f5f60130ce0 2023-09-30T22:25:27.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.574+0000 7f5f4effd700 1 -- 172.21.15.156:0/3199345996 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5800f040 con 0x7f5f60130ce0 2023-09-30T22:25:27.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.574+0000 7f5f4effd700 1 -- 172.21.15.156:0/3199345996 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5800cea0 con 0x7f5f60130ce0 2023-09-30T22:25:27.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.574+0000 7f5f64bce700 1 -- 172.21.15.156:0/3199345996 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f540094a0 con 0x7f5f60130ce0 2023-09-30T22:25:27.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.574+0000 7f5f64bce700 1 -- 172.21.15.156:0/3199345996 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6011fe90 con 0x7f5f60130ce0 2023-09-30T22:25:27.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.575+0000 7f5f64bce700 1 -- 172.21.15.156:0/3199345996 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f6004f2a0 con 0x7f5f60130ce0 2023-09-30T22:25:27.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.576+0000 7f5f4effd700 1 -- 172.21.15.156:0/3199345996 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f58003a20 con 0x7f5f60130ce0 2023-09-30T22:25:27.582 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.576+0000 7f5f4effd700 1 -- 172.21.15.156:0/3199345996 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5f58040970 con 0x7f5f60130ce0 2023-09-30T22:25:27.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.584+0000 7f5f4effd700 1 -- 172.21.15.156:0/3199345996 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f58013bd0 con 0x7f5f60130ce0 2023-09-30T22:25:27.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.623+0000 7fcfeacd9700 1 Processor -- start 2023-09-30T22:25:27.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.623+0000 7fcfeacd9700 1 -- start start 2023-09-30T22:25:27.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.624+0000 7fcfeacd9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcfe409e870 0x7fcfe409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.624+0000 7fcfeacd9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcfe409f180 0x7fcfe4131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.624+0000 7fcfeacd9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe409c970 con 0x7fcfe4131d70 2023-09-30T22:25:27.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.624+0000 7fcfeacd9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe40a0920 con 0x7fcfe409f180 2023-09-30T22:25:27.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.624+0000 7fcfeacd9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe409f9c0 con 0x7fcfe409e870 2023-09-30T22:25:27.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.624+0000 7fcfe9276700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fcfe4131d70 0x7fcfe4138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47324/0 (socket says 172.21.15.156:47324) 2023-09-30T22:25:27.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.624+0000 7fcfe9276700 1 -- 172.21.15.156:0/3774727116 learned_addr learned my addr 172.21.15.156:0/3774727116 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:27.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.624+0000 7fcfe3fff700 1 --2- 172.21.15.156:0/3774727116 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcfe409f180 0x7fcfe4131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.625+0000 7fcfe8a75700 1 --2- 172.21.15.156:0/3774727116 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcfe409e870 0x7fcfe409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.625+0000 7fcfe37fe700 1 -- 172.21.15.156:0/3774727116 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1329568533 0 0) 0x7fcfe409c970 con 0x7fcfe4131d70 2023-09-30T22:25:27.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.625+0000 7fcfe37fe700 1 -- 172.21.15.156:0/3774727116 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfd40035b0 con 0x7fcfe4131d70 2023-09-30T22:25:27.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.625+0000 7fcfe8a75700 1 -- 172.21.15.156:0/3774727116 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcfe409f180 msgr2=0x7fcfe4131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:27.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.625+0000 7fcfe8a75700 1 --2- 172.21.15.156:0/3774727116 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcfe409f180 0x7fcfe4131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.625+0000 7fcfe8a75700 1 -- 172.21.15.156:0/3774727116 >> v1:172.21.15.156:6789/0 conn(0x7fcfe4131d70 legacy=0x7fcfe4138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.625+0000 7fcfe8a75700 1 -- 172.21.15.156:0/3774727116 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe409bab0 con 0x7fcfe409e870 2023-09-30T22:25:27.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.625+0000 7fcfe8a75700 1 --2- 172.21.15.156:0/3774727116 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcfe409e870 0x7fcfe409ec40 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8009870 tx=0x7fcfd8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13dd187ee17267bd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:27.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.625+0000 7fcfe37fe700 1 -- 172.21.15.156:0/3774727116 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8011830 con 0x7fcfe409e870 2023-09-30T22:25:27.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.625+0000 7fcfe37fe700 1 -- 172.21.15.156:0/3774727116 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd8011990 con 0x7fcfe409e870 2023-09-30T22:25:27.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.625+0000 7fcfe37fe700 1 -- 172.21.15.156:0/3774727116 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8011d20 con 0x7fcfe409e870 2023-09-30T22:25:27.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.626+0000 7fcfeacd9700 1 -- 172.21.15.156:0/3774727116 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcfe409e870 msgr2=0x7fcfe409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.626+0000 7fcfeacd9700 1 --2- 172.21.15.156:0/3774727116 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcfe409e870 0x7fcfe409ec40 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8009870 tx=0x7fcfd8009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:27.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.626+0000 7fcfeacd9700 1 -- 172.21.15.156:0/3774727116 shutdown_connections 2023-09-30T22:25:27.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.626+0000 7fcfeacd9700 1 --2- 172.21.15.156:0/3774727116 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcfe409e870 0x7fcfe409ec40 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.626+0000 7fcfeacd9700 1 --2- 172.21.15.156:0/3774727116 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcfe409f180 0x7fcfe4131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.626+0000 7fcfeacd9700 1 -- 172.21.15.156:0/3774727116 >> 172.21.15.156:0/3774727116 conn(0x7fcfe40a4430 msgr2=0x7fcfe40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:27.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.626+0000 7fcfeacd9700 1 -- 172.21.15.156:0/3774727116 shutdown_connections 2023-09-30T22:25:27.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.626+0000 7fcfeacd9700 1 -- 172.21.15.156:0/3774727116 wait complete. 2023-09-30T22:25:27.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.628+0000 7fcfeacd9700 1 Processor -- start 2023-09-30T22:25:27.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.628+0000 7fcfeacd9700 1 -- start start 2023-09-30T22:25:27.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.629+0000 7fcfeacd9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfe409e870 0x7fcfe406b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.629+0000 7fcfeacd9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcfe409f180 0x7fcfe406bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.629+0000 7fcfeacd9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcfe4131d70 0x7fcfe406c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.629+0000 7fcfeacd9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe41252d0 con 0x7fcfe409e870 2023-09-30T22:25:27.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.629+0000 7fcfeacd9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe4125640 con 0x7fcfe409f180 2023-09-30T22:25:27.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.629+0000 7fcfeacd9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe409dba0 con 0x7fcfe4131d70 2023-09-30T22:25:27.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.629+0000 7fcfe3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcfe409f180 0x7fcfe406bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.629+0000 7fcfe9276700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcfe4131d70 0x7fcfe406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.629+0000 7fcfe3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcfe409f180 0x7fcfe406bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49108/0 (socket says 172.21.15.156:49108) 2023-09-30T22:25:27.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.629+0000 7fcfe3fff700 1 -- 172.21.15.156:0/321857613 learned_addr learned my addr 172.21.15.156:0/321857613 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:27.631 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.629+0000 7fcfe8a75700 1 --2- 172.21.15.156:0/321857613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfe409e870 0x7fcfe406b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.632 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.629+0000 7fcfe3fff700 1 -- 172.21.15.156:0/321857613 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcfe4131d70 msgr2=0x7fcfe406c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.629+0000 7fcfe3fff700 1 --2- 172.21.15.156:0/321857613 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcfe4131d70 0x7fcfe406c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.629+0000 7fcfe3fff700 1 -- 172.21.15.156:0/321857613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfe409e870 msgr2=0x7fcfe406b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.629+0000 7fcfe3fff700 1 --2- 172.21.15.156:0/321857613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfe409e870 0x7fcfe406b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.629+0000 7fcfe3fff700 1 -- 172.21.15.156:0/321857613 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd80094a0 con 0x7fcfe409f180 2023-09-30T22:25:27.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.629+0000 7fcfe8a75700 1 --2- 172.21.15.156:0/321857613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfe409e870 0x7fcfe406b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:27.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.630+0000 7fcfe3fff700 1 --2- 172.21.15.156:0/321857613 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcfe409f180 0x7fcfe406bdc0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fcfd000e980 tx=0x7fcfd000ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:27.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.630+0000 7fcfe17fa700 1 -- 172.21.15.156:0/321857613 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0009710 con 0x7fcfe409f180 2023-09-30T22:25:27.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.630+0000 7fcfe17fa700 1 -- 172.21.15.156:0/321857613 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd000c690 con 0x7fcfe409f180 2023-09-30T22:25:27.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.630+0000 7fcfe17fa700 1 -- 172.21.15.156:0/321857613 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd000ca20 con 0x7fcfe409f180 2023-09-30T22:25:27.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.630+0000 7fcfeacd9700 1 -- 172.21.15.156:0/321857613 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe409b160 con 0x7fcfe409f180 2023-09-30T22:25:27.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.630+0000 7fcfeacd9700 1 -- 172.21.15.156:0/321857613 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe4124900 con 0x7fcfe409f180 2023-09-30T22:25:27.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.631+0000 7fcfe17fa700 1 -- 172.21.15.156:0/321857613 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcfd000cb80 con 0x7fcfe409f180 2023-09-30T22:25:27.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.632+0000 7fcfe17fa700 1 -- 172.21.15.156:0/321857613 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcfd003f770 con 0x7fcfe409f180 2023-09-30T22:25:27.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.632+0000 7fcfeacd9700 1 -- 172.21.15.156:0/321857613 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe404f2a0 con 0x7fcfe409f180 2023-09-30T22:25:27.637 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.637+0000 7fcfe17fa700 1 -- 172.21.15.156:0/321857613 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcfd0017080 con 0x7fcfe409f180 2023-09-30T22:25:27.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.674+0000 7fdb1b7fd700 1 Processor -- start 2023-09-30T22:25:27.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.675+0000 7fdb1b7fd700 1 -- start start 2023-09-30T22:25:27.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.675+0000 7fdb1b7fd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb1409d860 0x7fdb1409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.675+0000 7fdb1b7fd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb14130eb0 0x7fdb14138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.675+0000 7fdb1b7fd700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb1409aaa0 con 0x7fdb1409e170 2023-09-30T22:25:27.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.675+0000 7fdb1b7fd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1409f870 con 0x7fdb14130eb0 2023-09-30T22:25:27.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.675+0000 7fdb1b7fd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1409b360 con 0x7fdb1409d860 2023-09-30T22:25:27.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.676+0000 7fdb19599700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb1409d860 0x7fdb1409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.676+0000 7fdb18d98700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fdb1409e170 0x7fdb141307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47340/0 (socket says 172.21.15.156:47340) 2023-09-30T22:25:27.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.676+0000 7fdb18d98700 1 -- 172.21.15.156:0/2205105658 learned_addr learned my addr 172.21.15.156:0/2205105658 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:27.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.676+0000 7fdb19d9a700 1 --2- 172.21.15.156:0/2205105658 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb14130eb0 0x7fdb14138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.676+0000 7fdb19599700 1 -- 172.21.15.156:0/2205105658 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb14130eb0 msgr2=0x7fdb14138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:27.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.676+0000 7fdb19599700 1 --2- 172.21.15.156:0/2205105658 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb14130eb0 0x7fdb14138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.676+0000 7fdb19599700 1 -- 172.21.15.156:0/2205105658 >> v1:172.21.15.156:6789/0 conn(0x7fdb1409e170 legacy=0x7fdb141307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.676+0000 7fdb19599700 1 -- 172.21.15.156:0/2205105658 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1409b620 con 0x7fdb1409d860 2023-09-30T22:25:27.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.676+0000 7fdb19599700 1 --2- 172.21.15.156:0/2205105658 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb1409d860 0x7fdb1409dc30 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fdb10009870 tx=0x7fdb10009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e4e9a30bba06860 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:27.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.676+0000 7fdb0bfff700 1 -- 172.21.15.156:0/2205105658 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb10011830 con 0x7fdb1409d860 2023-09-30T22:25:27.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.676+0000 7fdb0bfff700 1 -- 172.21.15.156:0/2205105658 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb10011990 con 0x7fdb1409d860 2023-09-30T22:25:27.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.676+0000 7fdb0bfff700 1 -- 172.21.15.156:0/2205105658 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb10011d20 con 0x7fdb1409d860 2023-09-30T22:25:27.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.677+0000 7fdb1b7fd700 1 -- 172.21.15.156:0/2205105658 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb1409d860 msgr2=0x7fdb1409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.677+0000 7fdb1b7fd700 1 --2- 172.21.15.156:0/2205105658 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb1409d860 0x7fdb1409dc30 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fdb10009870 tx=0x7fdb10009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:27.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.677+0000 7fdb1b7fd700 1 -- 172.21.15.156:0/2205105658 shutdown_connections 2023-09-30T22:25:27.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.677+0000 7fdb1b7fd700 1 --2- 172.21.15.156:0/2205105658 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb14130eb0 0x7fdb14138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.677+0000 7fdb1b7fd700 1 --2- 172.21.15.156:0/2205105658 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb1409d860 0x7fdb1409dc30 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.677+0000 7fdb1b7fd700 1 -- 172.21.15.156:0/2205105658 >> 172.21.15.156:0/2205105658 conn(0x7fdb14099c40 msgr2=0x7fdb140a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:27.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.677+0000 7fdb1b7fd700 1 -- 172.21.15.156:0/2205105658 shutdown_connections 2023-09-30T22:25:27.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.677+0000 7fdb1b7fd700 1 -- 172.21.15.156:0/2205105658 wait complete. 2023-09-30T22:25:27.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.678+0000 7fdb1b7fd700 1 Processor -- start 2023-09-30T22:25:27.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.679+0000 7fdb1b7fd700 1 -- start start 2023-09-30T22:25:27.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.679+0000 7fdb1b7fd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb1409d860 0x7fdb1411e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.679+0000 7fdb1b7fd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb1409e170 0x7fdb1411e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.679+0000 7fdb1b7fd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb14130eb0 0x7fdb1411ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.679+0000 7fdb1b7fd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1409c8b0 con 0x7fdb1409d860 2023-09-30T22:25:27.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.679+0000 7fdb1b7fd700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb14121cc0 con 0x7fdb14130eb0 2023-09-30T22:25:27.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.679+0000 7fdb1b7fd700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb141201a0 con 0x7fdb1409e170 2023-09-30T22:25:27.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.679+0000 7fdb18d98700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb1409e170 0x7fdb1411e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.679+0000 7fdb18d98700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb1409e170 0x7fdb1411e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:35016/0 (socket says 172.21.15.156:35016) 2023-09-30T22:25:27.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.679+0000 7fdb18d98700 1 -- 172.21.15.156:0/4075802618 learned_addr learned my addr 172.21.15.156:0/4075802618 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:27.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.679+0000 7fdb19d9a700 1 --2- 172.21.15.156:0/4075802618 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb14130eb0 0x7fdb1411ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.680+0000 7fdb18d98700 1 -- 172.21.15.156:0/4075802618 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb14130eb0 msgr2=0x7fdb1411ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.680+0000 7fdb18d98700 1 --2- 172.21.15.156:0/4075802618 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb14130eb0 0x7fdb1411ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.680+0000 7fdb18d98700 1 -- 172.21.15.156:0/4075802618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb1409d860 msgr2=0x7fdb1411e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.680+0000 7fdb18d98700 1 --2- 172.21.15.156:0/4075802618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb1409d860 0x7fdb1411e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.680+0000 7fdb18d98700 1 -- 172.21.15.156:0/4075802618 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb100094a0 con 0x7fdb1409e170 2023-09-30T22:25:27.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.680+0000 7fdb19d9a700 1 --2- 172.21.15.156:0/4075802618 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb14130eb0 0x7fdb1411ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:27.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.680+0000 7fdb18d98700 1 --2- 172.21.15.156:0/4075802618 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb1409e170 0x7fdb1411e9c0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400c530 tx=0x7fdb0400c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:27.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.680+0000 7fdb09ffb700 1 -- 172.21.15.156:0/4075802618 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb04005d70 con 0x7fdb1409e170 2023-09-30T22:25:27.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.680+0000 7fdb09ffb700 1 -- 172.21.15.156:0/4075802618 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb040070d0 con 0x7fdb1409e170 2023-09-30T22:25:27.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.680+0000 7fdb1b7fd700 1 -- 172.21.15.156:0/4075802618 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb14120640 con 0x7fdb1409e170 2023-09-30T22:25:27.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.680+0000 7fdb09ffb700 1 -- 172.21.15.156:0/4075802618 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb04007440 con 0x7fdb1409e170 2023-09-30T22:25:27.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.680+0000 7fdb1b7fd700 1 -- 172.21.15.156:0/4075802618 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb141226a0 con 0x7fdb1409e170 2023-09-30T22:25:27.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.681+0000 7fdb09ffb700 1 -- 172.21.15.156:0/4075802618 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb040075a0 con 0x7fdb1409e170 2023-09-30T22:25:27.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.681+0000 7fdb1b7fd700 1 -- 172.21.15.156:0/4075802618 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb1404f2a0 con 0x7fdb1409e170 2023-09-30T22:25:27.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.682+0000 7fdb09ffb700 1 -- 172.21.15.156:0/4075802618 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdb0403eaa0 con 0x7fdb1409e170 2023-09-30T22:25:27.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.686+0000 7fdb09ffb700 1 -- 172.21.15.156:0/4075802618 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb0401b3b0 con 0x7fdb1409e170 2023-09-30T22:25:27.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.704+0000 7f8241f37700 1 Processor -- start 2023-09-30T22:25:27.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.704+0000 7f8241f37700 1 -- start start 2023-09-30T22:25:27.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.704+0000 7f8241f37700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f823c09f430 0x7f823c136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.704+0000 7f8241f37700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f823c137010 0x7f823c1393f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.704+0000 7f8241f37700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f823c09b6d0 con 0x7f823c09e950 2023-09-30T22:25:27.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.704+0000 7f8241f37700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f823c09afb0 con 0x7f823c137010 2023-09-30T22:25:27.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.704+0000 7f8241f37700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f823c0a0970 con 0x7f823c09f430 2023-09-30T22:25:27.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.705+0000 7f823bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f823c137010 0x7f823c1393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.705+0000 7f823affd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f823c09f430 0x7f823c136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.705+0000 7f823bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f823c137010 0x7f823c1393f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49128/0 (socket says 172.21.15.156:49128) 2023-09-30T22:25:27.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.705+0000 7f823b7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f823c09e950 0x7f823c09ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47348/0 (socket says 172.21.15.156:47348) 2023-09-30T22:25:27.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.705+0000 7f823bfff700 1 -- 172.21.15.156:0/3059200760 learned_addr learned my addr 172.21.15.156:0/3059200760 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:27.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.705+0000 7f823a7fc700 1 -- 172.21.15.156:0/3059200760 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 843744147 0 0) 0x7f823c09b6d0 con 0x7f823c09e950 2023-09-30T22:25:27.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.705+0000 7f823bfff700 1 -- 172.21.15.156:0/3059200760 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f823c09f430 msgr2=0x7f823c136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:27.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.705+0000 7f823bfff700 1 --2- 172.21.15.156:0/3059200760 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f823c09f430 0x7f823c136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.705+0000 7f823bfff700 1 -- 172.21.15.156:0/3059200760 >> v1:172.21.15.156:6789/0 conn(0x7f823c09e950 legacy=0x7f823c09ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.705+0000 7f823bfff700 1 -- 172.21.15.156:0/3059200760 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823c0a0320 con 0x7f823c137010 2023-09-30T22:25:27.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.705+0000 7f823affd700 1 --2- 172.21.15.156:0/3059200760 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f823c09f430 0x7f823c136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:27.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.705+0000 7f823bfff700 1 --2- 172.21.15.156:0/3059200760 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f823c137010 0x7f823c1393f0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f8234009e80 tx=0x7f823400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=477daeb2fabb68ac server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:27.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.706+0000 7f823a7fc700 1 -- 172.21.15.156:0/3059200760 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823400e070 con 0x7f823c137010 2023-09-30T22:25:27.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.706+0000 7f823a7fc700 1 -- 172.21.15.156:0/3059200760 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823400b910 con 0x7f823c137010 2023-09-30T22:25:27.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.706+0000 7f823a7fc700 1 -- 172.21.15.156:0/3059200760 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823400bcc0 con 0x7f823c137010 2023-09-30T22:25:27.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.706+0000 7f8241f37700 1 -- 172.21.15.156:0/3059200760 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f823c137010 msgr2=0x7f823c1393f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.706+0000 7f8241f37700 1 --2- 172.21.15.156:0/3059200760 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f823c137010 0x7f823c1393f0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f8234009e80 tx=0x7f823400b330 comp rx=0 tx=0).stop 2023-09-30T22:25:27.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.706+0000 7f8241f37700 1 -- 172.21.15.156:0/3059200760 shutdown_connections 2023-09-30T22:25:27.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.706+0000 7f8241f37700 1 --2- 172.21.15.156:0/3059200760 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f823c137010 0x7f823c1393f0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.706+0000 7f8241f37700 1 --2- 172.21.15.156:0/3059200760 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f823c09f430 0x7f823c136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.706+0000 7f8241f37700 1 -- 172.21.15.156:0/3059200760 >> 172.21.15.156:0/3059200760 conn(0x7f823c0a0f70 msgr2=0x7f823c0a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:27.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.706+0000 7f8241f37700 1 -- 172.21.15.156:0/3059200760 shutdown_connections 2023-09-30T22:25:27.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.706+0000 7f8241f37700 1 -- 172.21.15.156:0/3059200760 wait complete. 2023-09-30T22:25:27.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.707+0000 7f8241f37700 1 Processor -- start 2023-09-30T22:25:27.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.707+0000 7f8241f37700 1 -- start start 2023-09-30T22:25:27.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.708+0000 7f8241f37700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f823c09e950 0x7f823c11f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.708+0000 7f8241f37700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f823c09f430 0x7f823c11fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.708+0000 7f8241f37700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f823c137010 0x7f823c120010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.708+0000 7f8241f37700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823c0a4620 con 0x7f823c09e950 2023-09-30T22:25:27.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.708+0000 7f8241f37700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f823c09da40 con 0x7f823c137010 2023-09-30T22:25:27.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.708+0000 7f8241f37700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f823c1227f0 con 0x7f823c09f430 2023-09-30T22:25:27.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.708+0000 7f823bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f823c137010 0x7f823c120010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.708+0000 7f823b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f823c09e950 0x7f823c11f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.708+0000 7f823bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f823c137010 0x7f823c120010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49130/0 (socket says 172.21.15.156:49130) 2023-09-30T22:25:27.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.708+0000 7f823bfff700 1 -- 172.21.15.156:0/1352599589 learned_addr learned my addr 172.21.15.156:0/1352599589 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:27.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.708+0000 7f823affd700 1 --2- 172.21.15.156:0/1352599589 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f823c09f430 0x7f823c11fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.708+0000 7f823bfff700 1 -- 172.21.15.156:0/1352599589 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f823c09f430 msgr2=0x7f823c11fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.708+0000 7f823bfff700 1 --2- 172.21.15.156:0/1352599589 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f823c09f430 0x7f823c11fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.708+0000 7f823bfff700 1 -- 172.21.15.156:0/1352599589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f823c09e950 msgr2=0x7f823c11f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.708+0000 7f823bfff700 1 --2- 172.21.15.156:0/1352599589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f823c09e950 0x7f823c11f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.708+0000 7f823bfff700 1 -- 172.21.15.156:0/1352599589 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82300094a0 con 0x7f823c137010 2023-09-30T22:25:27.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.708+0000 7f823b7fe700 1 --2- 172.21.15.156:0/1352599589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f823c09e950 0x7f823c11f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:27.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.708+0000 7f823affd700 1 --2- 172.21.15.156:0/1352599589 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f823c09f430 0x7f823c11fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:27.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.709+0000 7f823bfff700 1 --2- 172.21.15.156:0/1352599589 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f823c137010 0x7f823c120010 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f8234012000 tx=0x7f8234004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:27.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.709+0000 7f8223fff700 1 -- 172.21.15.156:0/1352599589 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82340092e0 con 0x7f823c137010 2023-09-30T22:25:27.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.709+0000 7f8223fff700 1 -- 172.21.15.156:0/1352599589 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823401c410 con 0x7f823c137010 2023-09-30T22:25:27.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.709+0000 7f8241f37700 1 -- 172.21.15.156:0/1352599589 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8234009b30 con 0x7f823c137010 2023-09-30T22:25:27.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.709+0000 7f8223fff700 1 -- 172.21.15.156:0/1352599589 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823401c7c0 con 0x7f823c137010 2023-09-30T22:25:27.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.709+0000 7f8241f37700 1 -- 172.21.15.156:0/1352599589 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f823c121940 con 0x7f823c137010 2023-09-30T22:25:27.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.710+0000 7f8241f37700 1 -- 172.21.15.156:0/1352599589 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f823c04f2a0 con 0x7f823c137010 2023-09-30T22:25:27.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.711+0000 7f8223fff700 1 -- 172.21.15.156:0/1352599589 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f823401c920 con 0x7f823c137010 2023-09-30T22:25:27.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.711+0000 7f8223fff700 1 -- 172.21.15.156:0/1352599589 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8234041610 con 0x7f823c137010 2023-09-30T22:25:27.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.715+0000 7f8223fff700 1 -- 172.21.15.156:0/1352599589 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8234024400 con 0x7f823c137010 2023-09-30T22:25:27.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.824+0000 7f5f64bce700 1 -- 172.21.15.156:0/3199345996 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5f6006c3b0 con 0x7f5f60130ce0 2023-09-30T22:25:27.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.824+0000 7f5f4effd700 1 -- 172.21.15.156:0/3199345996 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f5802b090 con 0x7f5f60130ce0 2023-09-30T22:25:27.825 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:27.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.827+0000 7f5f64bce700 1 -- 172.21.15.156:0/3199345996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f60130ce0 msgr2=0x7f5f6011daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.827+0000 7f5f64bce700 1 --2- 172.21.15.156:0/3199345996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f60130ce0 0x7f5f6011daf0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800efc0 tx=0x7f5f5800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.827+0000 7f5f64bce700 1 -- 172.21.15.156:0/3199345996 shutdown_connections 2023-09-30T22:25:27.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.827+0000 7f5f64bce700 1 --2- 172.21.15.156:0/3199345996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5f60130ce0 0x7f5f6011daf0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.827+0000 7f5f64bce700 1 --2- 172.21.15.156:0/3199345996 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5f6009d860 0x7f5f6011d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.827+0000 7f5f64bce700 1 --2- 172.21.15.156:0/3199345996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f6009e170 0x7f5f6011d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.827+0000 7f5f64bce700 1 -- 172.21.15.156:0/3199345996 >> 172.21.15.156:0/3199345996 conn(0x7f5f60099c40 msgr2=0x7f5f60130010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:27.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.829+0000 7f5f64bce700 1 -- 172.21.15.156:0/3199345996 shutdown_connections 2023-09-30T22:25:27.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.830+0000 7f5f64bce700 1 -- 172.21.15.156:0/3199345996 wait complete. 2023-09-30T22:25:27.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:27.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.852+0000 7fcfeacd9700 1 -- 172.21.15.156:0/321857613 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcfe4131b50 con 0x7fcfe409f180 2023-09-30T22:25:27.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.852+0000 7fcfe17fa700 1 -- 172.21.15.156:0/321857613 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcfd0021020 con 0x7fcfe409f180 2023-09-30T22:25:27.853 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:27.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.855+0000 7fcfeacd9700 1 -- 172.21.15.156:0/321857613 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcfe409f180 msgr2=0x7fcfe406bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.855+0000 7fcfeacd9700 1 --2- 172.21.15.156:0/321857613 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcfe409f180 0x7fcfe406bdc0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fcfd000e980 tx=0x7fcfd000ec90 comp rx=0 tx=0).stop 2023-09-30T22:25:27.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.856+0000 7fcfeacd9700 1 -- 172.21.15.156:0/321857613 shutdown_connections 2023-09-30T22:25:27.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.856+0000 7fcfeacd9700 1 --2- 172.21.15.156:0/321857613 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcfe4131d70 0x7fcfe406c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.856+0000 7fcfeacd9700 1 --2- 172.21.15.156:0/321857613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfe409e870 0x7fcfe406b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.856+0000 7fcfeacd9700 1 --2- 172.21.15.156:0/321857613 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcfe409f180 0x7fcfe406bdc0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.856+0000 7fcfeacd9700 1 -- 172.21.15.156:0/321857613 >> 172.21.15.156:0/321857613 conn(0x7fcfe40a4430 msgr2=0x7fcfe406f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:27.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.856+0000 7fcfeacd9700 1 -- 172.21.15.156:0/321857613 shutdown_connections 2023-09-30T22:25:27.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.856+0000 7fcfeacd9700 1 -- 172.21.15.156:0/321857613 wait complete. 2023-09-30T22:25:27.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:27.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.893+0000 7fdb1b7fd700 1 -- 172.21.15.156:0/4075802618 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdb14121e00 con 0x7fdb1409e170 2023-09-30T22:25:27.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.893+0000 7fdb09ffb700 1 -- 172.21.15.156:0/4075802618 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb14121e00 con 0x7fdb1409e170 2023-09-30T22:25:27.894 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:27.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.895+0000 7fdb1b7fd700 1 -- 172.21.15.156:0/4075802618 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb1409e170 msgr2=0x7fdb1411e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.895+0000 7fdb1b7fd700 1 --2- 172.21.15.156:0/4075802618 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb1409e170 0x7fdb1411e9c0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400c530 tx=0x7fdb0400c840 comp rx=0 tx=0).stop 2023-09-30T22:25:27.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.895+0000 7fdb1b7fd700 1 -- 172.21.15.156:0/4075802618 shutdown_connections 2023-09-30T22:25:27.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.895+0000 7fdb1b7fd700 1 --2- 172.21.15.156:0/4075802618 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdb14130eb0 0x7fdb1411ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.895+0000 7fdb1b7fd700 1 --2- 172.21.15.156:0/4075802618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb1409d860 0x7fdb1411e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.895+0000 7fdb1b7fd700 1 --2- 172.21.15.156:0/4075802618 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdb1409e170 0x7fdb1411e9c0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.895+0000 7fdb1b7fd700 1 -- 172.21.15.156:0/4075802618 >> 172.21.15.156:0/4075802618 conn(0x7fdb14099c40 msgr2=0x7fdb14070fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:27.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.895+0000 7fdb1b7fd700 1 -- 172.21.15.156:0/4075802618 shutdown_connections 2023-09-30T22:25:27.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.895+0000 7fdb1b7fd700 1 -- 172.21.15.156:0/4075802618 wait complete. 2023-09-30T22:25:27.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:27.940 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.940+0000 7f8241f37700 1 -- 172.21.15.156:0/1352599589 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f823c09b8b0 con 0x7f823c137010 2023-09-30T22:25:27.941 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.940+0000 7f8223fff700 1 -- 172.21.15.156:0/1352599589 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8234029070 con 0x7f823c137010 2023-09-30T22:25:27.941 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:27.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.942+0000 7f8241f37700 1 -- 172.21.15.156:0/1352599589 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f823c137010 msgr2=0x7f823c120010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.943 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.942+0000 7f8241f37700 1 --2- 172.21.15.156:0/1352599589 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f823c137010 0x7f823c120010 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f8234012000 tx=0x7f8234004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.942+0000 7f8241f37700 1 -- 172.21.15.156:0/1352599589 shutdown_connections 2023-09-30T22:25:27.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.942+0000 7f8241f37700 1 --2- 172.21.15.156:0/1352599589 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f823c137010 0x7f823c120010 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.942+0000 7f8241f37700 1 --2- 172.21.15.156:0/1352599589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f823c09e950 0x7f823c11f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.942+0000 7f8241f37700 1 --2- 172.21.15.156:0/1352599589 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f823c09f430 0x7f823c11fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.942+0000 7f8241f37700 1 -- 172.21.15.156:0/1352599589 >> 172.21.15.156:0/1352599589 conn(0x7f823c0a0f70 msgr2=0x7f823c135c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:27.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.943+0000 7f8241f37700 1 -- 172.21.15.156:0/1352599589 shutdown_connections 2023-09-30T22:25:27.944 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:27.943+0000 7f8241f37700 1 -- 172.21.15.156:0/1352599589 wait complete. 2023-09-30T22:25:27.955 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:28.848 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:28.869 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:28.909 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:28.956 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:28.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.989+0000 7fdc57c30700 1 Processor -- start 2023-09-30T22:25:28.990 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.989+0000 7fdc57c30700 1 -- start start 2023-09-30T22:25:28.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.990+0000 7fdc57c30700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc50133660 0x7fdc50135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.990+0000 7fdc57c30700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdc50135f80 0x7fdc50138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.990+0000 7fdc57c30700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc50099a60 con 0x7fdc50099e20 2023-09-30T22:25:28.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.990+0000 7fdc57c30700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc5009bf50 con 0x7fdc50135f80 2023-09-30T22:25:28.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.990+0000 7fdc57c30700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5009b230 con 0x7fdc50133660 2023-09-30T22:25:28.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.990+0000 7fdc551cb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc50133660 0x7fdc50135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.990+0000 7fdc551cb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc50133660 0x7fdc50135a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49134/0 (socket says 172.21.15.156:49134) 2023-09-30T22:25:28.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.990+0000 7fdc551cb700 1 -- 172.21.15.156:0/1527888535 learned_addr learned my addr 172.21.15.156:0/1527888535 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:28.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.990+0000 7fdc551cb700 1 -- 172.21.15.156:0/1527888535 >> v2:172.21.15.156:3300/0 conn(0x7fdc50135f80 msgr2=0x7fdc50138360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:28.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.990+0000 7fdc551cb700 1 --2- 172.21.15.156:0/1527888535 >> v2:172.21.15.156:3300/0 conn(0x7fdc50135f80 0x7fdc50138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.990+0000 7fdc551cb700 1 -- 172.21.15.156:0/1527888535 >> v1:172.21.15.156:6789/0 conn(0x7fdc50099e20 legacy=0x7fdc5009a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:28.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.990+0000 7fdc551cb700 1 -- 172.21.15.156:0/1527888535 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5009bb90 con 0x7fdc50133660 2023-09-30T22:25:28.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.991+0000 7fdc551cb700 1 --2- 172.21.15.156:0/1527888535 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc50133660 0x7fdc50135a40 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009920 tx=0x7fdc40009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba9df00a437f8f26 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:28.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.991+0000 7fdc549ca700 1 -- 172.21.15.156:0/1527888535 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40004230 con 0x7fdc50133660 2023-09-30T22:25:28.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.991+0000 7fdc549ca700 1 -- 172.21.15.156:0/1527888535 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc40004390 con 0x7fdc50133660 2023-09-30T22:25:28.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.991+0000 7fdc549ca700 1 -- 172.21.15.156:0/1527888535 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40009e70 con 0x7fdc50133660 2023-09-30T22:25:28.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.992+0000 7fdc57c30700 1 -- 172.21.15.156:0/1527888535 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc50133660 msgr2=0x7fdc50135a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.992+0000 7fdc57c30700 1 --2- 172.21.15.156:0/1527888535 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc50133660 0x7fdc50135a40 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009920 tx=0x7fdc40009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:28.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.992+0000 7fdc57c30700 1 -- 172.21.15.156:0/1527888535 shutdown_connections 2023-09-30T22:25:28.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.992+0000 7fdc57c30700 1 --2- 172.21.15.156:0/1527888535 >> v2:172.21.15.156:3300/0 conn(0x7fdc50135f80 0x7fdc50138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.992+0000 7fdc57c30700 1 --2- 172.21.15.156:0/1527888535 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc50133660 0x7fdc50135a40 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.992+0000 7fdc57c30700 1 -- 172.21.15.156:0/1527888535 >> 172.21.15.156:0/1527888535 conn(0x7fdc500a2980 msgr2=0x7fdc500a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:28.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.992+0000 7fdc57c30700 1 -- 172.21.15.156:0/1527888535 shutdown_connections 2023-09-30T22:25:28.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.992+0000 7fdc57c30700 1 -- 172.21.15.156:0/1527888535 wait complete. 2023-09-30T22:25:28.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.993+0000 7fdc57c30700 1 Processor -- start 2023-09-30T22:25:28.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.993+0000 7fdc57c30700 1 -- start start 2023-09-30T22:25:28.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.993+0000 7fdc57c30700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc50099e20 0x7fdc501c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.993+0000 7fdc57c30700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc50133660 0x7fdc501c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.993+0000 7fdc57c30700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc50135f80 0x7fdc501c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.996 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.993+0000 7fdc57c30700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc50072720 con 0x7fdc50099e20 2023-09-30T22:25:28.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.993+0000 7fdc57c30700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5011eab0 con 0x7fdc50135f80 2023-09-30T22:25:28.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.993+0000 7fdc57c30700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc50135710 con 0x7fdc50133660 2023-09-30T22:25:28.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.993+0000 7fdc551cb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc50133660 0x7fdc501c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.993+0000 7fdc559cc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc50099e20 0x7fdc501c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.993+0000 7fdc551cb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc50133660 0x7fdc501c88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:35044/0 (socket says 172.21.15.156:35044) 2023-09-30T22:25:28.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.993+0000 7fdc559cc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc50099e20 0x7fdc501c83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47484/0 (socket says 172.21.15.156:47484) 2023-09-30T22:25:28.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.993+0000 7fdc551cb700 1 -- 172.21.15.156:0/2551850077 learned_addr learned my addr 172.21.15.156:0/2551850077 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:28.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.994+0000 7fdc561cd700 1 --2- 172.21.15.156:0/2551850077 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc50135f80 0x7fdc501c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.994+0000 7fdc559cc700 1 -- 172.21.15.156:0/2551850077 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc50133660 msgr2=0x7fdc501c88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.994+0000 7fdc559cc700 1 --2- 172.21.15.156:0/2551850077 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc50133660 0x7fdc501c88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.997 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.994+0000 7fdc559cc700 1 -- 172.21.15.156:0/2551850077 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc50135f80 msgr2=0x7fdc501c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.994+0000 7fdc559cc700 1 --2- 172.21.15.156:0/2551850077 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc50135f80 0x7fdc501c8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.994+0000 7fdc559cc700 1 -- 172.21.15.156:0/2551850077 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc40009550 con 0x7fdc50099e20 2023-09-30T22:25:28.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.994+0000 7fdc551cb700 1 --2- 172.21.15.156:0/2551850077 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc50133660 0x7fdc501c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:28.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.994+0000 7fdc559cc700 1 --2- 172.21.15.156:0/2551850077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc50099e20 0x7fdc501c83b0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c00c3e0 tx=0x7fdc4c00c6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:28.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.994+0000 7fdc467fc700 1 -- 172.21.15.156:0/2551850077 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c0052d0 con 0x7fdc50099e20 2023-09-30T22:25:28.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.994+0000 7fdc467fc700 1 -- 172.21.15.156:0/2551850077 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4c005450 con 0x7fdc50099e20 2023-09-30T22:25:28.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.994+0000 7fdc57c30700 1 -- 172.21.15.156:0/2551850077 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc5011e7d0 con 0x7fdc50099e20 2023-09-30T22:25:28.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.994+0000 7fdc467fc700 1 -- 172.21.15.156:0/2551850077 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c0038c0 con 0x7fdc50099e20 2023-09-30T22:25:28.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.994+0000 7fdc57c30700 1 -- 172.21.15.156:0/2551850077 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5011d400 con 0x7fdc50099e20 2023-09-30T22:25:28.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.995+0000 7fdc467fc700 1 -- 172.21.15.156:0/2551850077 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc4c003a20 con 0x7fdc50099e20 2023-09-30T22:25:28.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.995+0000 7fdc57c30700 1 -- 172.21.15.156:0/2551850077 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc5011f390 con 0x7fdc50099e20 2023-09-30T22:25:28.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:28.996+0000 7fdc467fc700 1 -- 172.21.15.156:0/2551850077 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdc4c040a30 con 0x7fdc50099e20 2023-09-30T22:25:29.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.001+0000 7fdc467fc700 1 -- 172.21.15.156:0/2551850077 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc4c044060 con 0x7fdc50099e20 2023-09-30T22:25:29.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.032+0000 7f0b2986c700 1 Processor -- start 2023-09-30T22:25:29.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.032+0000 7f0b2986c700 1 -- start start 2023-09-30T22:25:29.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.033+0000 7f0b2986c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b24131980 0x7f0b24131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.033+0000 7f0b2986c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0b2409c790 0x7f0b24139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.033+0000 7f0b2986c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b240a1640 con 0x7f0b2409bc70 2023-09-30T22:25:29.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.033+0000 7f0b2986c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b2406eb30 con 0x7f0b2409c790 2023-09-30T22:25:29.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.033+0000 7f0b2986c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b240a22d0 con 0x7f0b24131980 2023-09-30T22:25:29.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.033+0000 7f0b22ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b24131980 0x7f0b24131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.033+0000 7f0b22ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b24131980 0x7f0b24131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49154/0 (socket says 172.21.15.156:49154) 2023-09-30T22:25:29.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.033+0000 7f0b22ffd700 1 -- 172.21.15.156:0/2991604123 learned_addr learned my addr 172.21.15.156:0/2991604123 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:29.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.033+0000 7f0b237fe700 1 --2- 172.21.15.156:0/2991604123 >> v2:172.21.15.156:3300/0 conn(0x7f0b2409c790 0x7f0b24139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.033+0000 7f0b22ffd700 1 -- 172.21.15.156:0/2991604123 >> v2:172.21.15.156:3300/0 conn(0x7f0b2409c790 msgr2=0x7f0b24139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:29.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.033+0000 7f0b22ffd700 1 --2- 172.21.15.156:0/2991604123 >> v2:172.21.15.156:3300/0 conn(0x7f0b2409c790 0x7f0b24139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.033+0000 7f0b22ffd700 1 -- 172.21.15.156:0/2991604123 >> v1:172.21.15.156:6789/0 conn(0x7f0b2409bc70 legacy=0x7f0b2409c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.033+0000 7f0b22ffd700 1 -- 172.21.15.156:0/2991604123 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b24131550 con 0x7f0b24131980 2023-09-30T22:25:29.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.033+0000 7f0b22ffd700 1 --2- 172.21.15.156:0/2991604123 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b24131980 0x7f0b24131d50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f0b14006fd0 tx=0x7f0b1400f050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=318b89f5b9ef793b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:29.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.034+0000 7f0b21ffb700 1 -- 172.21.15.156:0/2991604123 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b14012070 con 0x7f0b24131980 2023-09-30T22:25:29.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.034+0000 7f0b21ffb700 1 -- 172.21.15.156:0/2991604123 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b14005a20 con 0x7f0b24131980 2023-09-30T22:25:29.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.034+0000 7f0b21ffb700 1 -- 172.21.15.156:0/2991604123 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b14005dd0 con 0x7f0b24131980 2023-09-30T22:25:29.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.034+0000 7f0b2986c700 1 -- 172.21.15.156:0/2991604123 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b24131980 msgr2=0x7f0b24131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.034+0000 7f0b2986c700 1 --2- 172.21.15.156:0/2991604123 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b24131980 0x7f0b24131d50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f0b14006fd0 tx=0x7f0b1400f050 comp rx=0 tx=0).stop 2023-09-30T22:25:29.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.034+0000 7f0b2986c700 1 -- 172.21.15.156:0/2991604123 shutdown_connections 2023-09-30T22:25:29.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.034+0000 7f0b2986c700 1 --2- 172.21.15.156:0/2991604123 >> v2:172.21.15.156:3300/0 conn(0x7f0b2409c790 0x7f0b24139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.034+0000 7f0b2986c700 1 --2- 172.21.15.156:0/2991604123 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b24131980 0x7f0b24131d50 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.034+0000 7f0b2986c700 1 -- 172.21.15.156:0/2991604123 >> 172.21.15.156:0/2991604123 conn(0x7f0b240a2980 msgr2=0x7f0b240a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:29.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.034+0000 7f0b2986c700 1 -- 172.21.15.156:0/2991604123 shutdown_connections 2023-09-30T22:25:29.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.034+0000 7f0b2986c700 1 -- 172.21.15.156:0/2991604123 wait complete. 2023-09-30T22:25:29.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.035+0000 7f0b2986c700 1 Processor -- start 2023-09-30T22:25:29.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.035+0000 7f0b2986c700 1 -- start start 2023-09-30T22:25:29.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.036+0000 7f0b2986c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b2409bc70 0x7f0b2411b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.036+0000 7f0b2986c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b2409c790 0x7f0b2411bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.036+0000 7f0b2986c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b24131980 0x7f0b2411bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.036+0000 7f0b2986c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2411d180 con 0x7f0b2409bc70 2023-09-30T22:25:29.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.036+0000 7f0b2986c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2411e3d0 con 0x7f0b24131980 2023-09-30T22:25:29.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.036+0000 7f0b2986c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2412ee00 con 0x7f0b2409c790 2023-09-30T22:25:29.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.036+0000 7f0b237fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b24131980 0x7f0b2411bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.036+0000 7f0b237fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b24131980 0x7f0b2411bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49164/0 (socket says 172.21.15.156:49164) 2023-09-30T22:25:29.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.036+0000 7f0b237fe700 1 -- 172.21.15.156:0/1992319946 learned_addr learned my addr 172.21.15.156:0/1992319946 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:29.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.036+0000 7f0b22ffd700 1 --2- 172.21.15.156:0/1992319946 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b2409bc70 0x7f0b2411b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.036+0000 7f0b227fc700 1 --2- 172.21.15.156:0/1992319946 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b2409c790 0x7f0b2411bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.036+0000 7f0b237fe700 1 -- 172.21.15.156:0/1992319946 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b2409c790 msgr2=0x7f0b2411bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.036+0000 7f0b237fe700 1 --2- 172.21.15.156:0/1992319946 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b2409c790 0x7f0b2411bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.036+0000 7f0b237fe700 1 -- 172.21.15.156:0/1992319946 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b2409bc70 msgr2=0x7f0b2411b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.036+0000 7f0b237fe700 1 --2- 172.21.15.156:0/1992319946 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b2409bc70 0x7f0b2411b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.036+0000 7f0b237fe700 1 -- 172.21.15.156:0/1992319946 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b1400d9a0 con 0x7f0b24131980 2023-09-30T22:25:29.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.037+0000 7f0b22ffd700 1 --2- 172.21.15.156:0/1992319946 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b2409bc70 0x7f0b2411b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:29.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.037+0000 7f0b237fe700 1 --2- 172.21.15.156:0/1992319946 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b24131980 0x7f0b2411bff0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c00efc0 tx=0x7f0b1c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:29.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.037+0000 7f0b0bfff700 1 -- 172.21.15.156:0/1992319946 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c009ea0 con 0x7f0b24131980 2023-09-30T22:25:29.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.037+0000 7f0b0bfff700 1 -- 172.21.15.156:0/1992319946 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1c00f040 con 0x7f0b24131980 2023-09-30T22:25:29.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.037+0000 7f0b2986c700 1 -- 172.21.15.156:0/1992319946 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b2411d770 con 0x7f0b24131980 2023-09-30T22:25:29.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.037+0000 7f0b0bfff700 1 -- 172.21.15.156:0/1992319946 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c014480 con 0x7f0b24131980 2023-09-30T22:25:29.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.037+0000 7f0b2986c700 1 -- 172.21.15.156:0/1992319946 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b240a1c40 con 0x7f0b24131980 2023-09-30T22:25:29.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.038+0000 7f0b0bfff700 1 -- 172.21.15.156:0/1992319946 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b1c0145e0 con 0x7f0b24131980 2023-09-30T22:25:29.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.038+0000 7f0b0bfff700 1 -- 172.21.15.156:0/1992319946 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0b1c03ffc0 con 0x7f0b24131980 2023-09-30T22:25:29.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.039+0000 7f0b2986c700 1 -- 172.21.15.156:0/1992319946 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b2409f9c0 con 0x7f0b24131980 2023-09-30T22:25:29.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.043+0000 7f0b0bfff700 1 -- 172.21.15.156:0/1992319946 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b1c018020 con 0x7f0b24131980 2023-09-30T22:25:29.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.084+0000 7f1374683700 1 Processor -- start 2023-09-30T22:25:29.085 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.084+0000 7f1374683700 1 -- start start 2023-09-30T22:25:29.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.085+0000 7f1374683700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f136c0a1510 0x7f136c1351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.085+0000 7f1374683700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f136c1356e0 0x7f136c137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.085+0000 7f1374683700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136c0a1e70 con 0x7f136c0a0a30 2023-09-30T22:25:29.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.085+0000 7f1374683700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136c09a720 con 0x7f136c1356e0 2023-09-30T22:25:29.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.085+0000 7f1374683700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f136c09b300 con 0x7f136c0a1510 2023-09-30T22:25:29.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.085+0000 7f1372c20700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f136c1356e0 0x7f136c137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.085+0000 7f1372c20700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f136c1356e0 0x7f136c137ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49170/0 (socket says 172.21.15.156:49170) 2023-09-30T22:25:29.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.085+0000 7f1372c20700 1 -- 172.21.15.156:0/2282630038 learned_addr learned my addr 172.21.15.156:0/2282630038 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:29.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.086+0000 7f1372c20700 1 -- 172.21.15.156:0/2282630038 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f136c0a1510 msgr2=0x7f136c1351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:29.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.086+0000 7f1372c20700 1 --2- 172.21.15.156:0/2282630038 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f136c0a1510 0x7f136c1351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.086+0000 7f1372c20700 1 -- 172.21.15.156:0/2282630038 >> v1:172.21.15.156:6789/0 conn(0x7f136c0a0a30 legacy=0x7f136c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.086+0000 7f1372c20700 1 -- 172.21.15.156:0/2282630038 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c09abc0 con 0x7f136c1356e0 2023-09-30T22:25:29.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.086+0000 7f137141d700 1 -- 172.21.15.156:0/2282630038 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 996918413 0 0) 0x7f136c0a1e70 con 0x7f136c0a0a30 2023-09-30T22:25:29.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.086+0000 7f1372c20700 1 --2- 172.21.15.156:0/2282630038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f136c1356e0 0x7f136c137ac0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f1364009e80 tx=0x7f136400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35022e58f059aa66 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:29.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.086+0000 7f137141d700 1 -- 172.21.15.156:0/2282630038 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136400b9c0 con 0x7f136c1356e0 2023-09-30T22:25:29.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.086+0000 7f137141d700 1 -- 172.21.15.156:0/2282630038 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136400bb20 con 0x7f136c1356e0 2023-09-30T22:25:29.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.086+0000 7f137141d700 1 -- 172.21.15.156:0/2282630038 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1364011400 con 0x7f136c1356e0 2023-09-30T22:25:29.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.087+0000 7f1374683700 1 -- 172.21.15.156:0/2282630038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f136c1356e0 msgr2=0x7f136c137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.087+0000 7f1374683700 1 --2- 172.21.15.156:0/2282630038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f136c1356e0 0x7f136c137ac0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f1364009e80 tx=0x7f136400b330 comp rx=0 tx=0).stop 2023-09-30T22:25:29.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.087+0000 7f1374683700 1 -- 172.21.15.156:0/2282630038 shutdown_connections 2023-09-30T22:25:29.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.087+0000 7f1374683700 1 --2- 172.21.15.156:0/2282630038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f136c1356e0 0x7f136c137ac0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.087+0000 7f1374683700 1 --2- 172.21.15.156:0/2282630038 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f136c0a1510 0x7f136c1351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.087+0000 7f1374683700 1 -- 172.21.15.156:0/2282630038 >> 172.21.15.156:0/2282630038 conn(0x7f136c0a2980 msgr2=0x7f136c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:29.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.087+0000 7f1374683700 1 -- 172.21.15.156:0/2282630038 shutdown_connections 2023-09-30T22:25:29.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.087+0000 7f1374683700 1 -- 172.21.15.156:0/2282630038 wait complete. 2023-09-30T22:25:29.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.089+0000 7f1374683700 1 Processor -- start 2023-09-30T22:25:29.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.089+0000 7f1374683700 1 -- start start 2023-09-30T22:25:29.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.089+0000 7f1374683700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f136c0a0a30 0x7f136c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.089+0000 7f1374683700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f136c0a1510 0x7f136c06f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.089+0000 7f1374683700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f136c1356e0 0x7f136c06f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.089+0000 7f1374683700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c11ecc0 con 0x7f136c1356e0 2023-09-30T22:25:29.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.089+0000 7f1374683700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136c120300 con 0x7f136c0a0a30 2023-09-30T22:25:29.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.089+0000 7f1374683700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f136c09fcc0 con 0x7f136c0a1510 2023-09-30T22:25:29.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.089+0000 7f137241f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f136c0a0a30 0x7f136c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.089+0000 7f137241f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f136c0a0a30 0x7f136c06ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49180/0 (socket says 172.21.15.156:49180) 2023-09-30T22:25:29.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.089+0000 7f137241f700 1 -- 172.21.15.156:0/3261716789 learned_addr learned my addr 172.21.15.156:0/3261716789 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:29.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.090+0000 7f1371c1e700 1 --2- 172.21.15.156:0/3261716789 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f136c0a1510 0x7f136c06f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.090+0000 7f1372c20700 1 --2- 172.21.15.156:0/3261716789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f136c1356e0 0x7f136c06f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.090+0000 7f137241f700 1 -- 172.21.15.156:0/3261716789 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f136c0a1510 msgr2=0x7f136c06f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.090+0000 7f137241f700 1 --2- 172.21.15.156:0/3261716789 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f136c0a1510 0x7f136c06f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.090+0000 7f137241f700 1 -- 172.21.15.156:0/3261716789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f136c1356e0 msgr2=0x7f136c06f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.090+0000 7f137241f700 1 --2- 172.21.15.156:0/3261716789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f136c1356e0 0x7f136c06f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.090+0000 7f137241f700 1 -- 172.21.15.156:0/3261716789 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1364009b30 con 0x7f136c0a0a30 2023-09-30T22:25:29.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.090+0000 7f137241f700 1 --2- 172.21.15.156:0/3261716789 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f136c0a0a30 0x7f136c06ed10 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f136800c550 tx=0x7f136800c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:29.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.090+0000 7f1362ffd700 1 -- 172.21.15.156:0/3261716789 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13680054e0 con 0x7f136c0a0a30 2023-09-30T22:25:29.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.090+0000 7f1362ffd700 1 -- 172.21.15.156:0/3261716789 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1368003680 con 0x7f136c0a0a30 2023-09-30T22:25:29.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.090+0000 7f1362ffd700 1 -- 172.21.15.156:0/3261716789 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1368003a30 con 0x7f136c0a0a30 2023-09-30T22:25:29.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.090+0000 7f1374683700 1 -- 172.21.15.156:0/3261716789 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136c09ae00 con 0x7f136c0a0a30 2023-09-30T22:25:29.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.090+0000 7f1374683700 1 -- 172.21.15.156:0/3261716789 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136c11f640 con 0x7f136c0a0a30 2023-09-30T22:25:29.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.091+0000 7f1362ffd700 1 -- 172.21.15.156:0/3261716789 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1368003b90 con 0x7f136c0a0a30 2023-09-30T22:25:29.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.091+0000 7f1362ffd700 1 -- 172.21.15.156:0/3261716789 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f136803eaa0 con 0x7f136c0a0a30 2023-09-30T22:25:29.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.092+0000 7f1374683700 1 -- 172.21.15.156:0/3261716789 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f136c133bc0 con 0x7f136c0a0a30 2023-09-30T22:25:29.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.100+0000 7f1362ffd700 1 -- 172.21.15.156:0/3261716789 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1368017080 con 0x7f136c0a0a30 2023-09-30T22:25:29.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.133+0000 7f31ba342700 1 Processor -- start 2023-09-30T22:25:29.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.133+0000 7f31ba342700 1 -- start start 2023-09-30T22:25:29.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.133+0000 7f31ba342700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31b4136960 0x7f31b4138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.133+0000 7f31ba342700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31b4139280 0x7f31b413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.133+0000 7f31ba342700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b406b2d0 con 0x7f31b4133ad0 2023-09-30T22:25:29.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.133+0000 7f31ba342700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b41345b0 con 0x7f31b4139280 2023-09-30T22:25:29.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.133+0000 7f31ba342700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31b4133610 con 0x7f31b4136960 2023-09-30T22:25:29.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.134+0000 7f31b3fff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f31b4133ad0 0x7f31b4133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:47380/0 (socket says 172.21.15.156:47380) 2023-09-30T22:25:29.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.134+0000 7f31b3fff700 1 -- 172.21.15.156:0/2142152321 learned_addr learned my addr 172.21.15.156:0/2142152321 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:29.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.134+0000 7f31b88df700 1 --2- 172.21.15.156:0/2142152321 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31b4139280 0x7f31b413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.134+0000 7f31b37fe700 1 --2- 172.21.15.156:0/2142152321 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31b4136960 0x7f31b4138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.134+0000 7f31b2ffd700 1 -- 172.21.15.156:0/2142152321 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952311857 0 0) 0x7f31b406b2d0 con 0x7f31b4133ad0 2023-09-30T22:25:29.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.134+0000 7f31b2ffd700 1 -- 172.21.15.156:0/2142152321 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f319c0035b0 con 0x7f31b4133ad0 2023-09-30T22:25:29.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.134+0000 7f31b37fe700 1 -- 172.21.15.156:0/2142152321 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31b4139280 msgr2=0x7f31b413b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:29.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.134+0000 7f31b37fe700 1 --2- 172.21.15.156:0/2142152321 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31b4139280 0x7f31b413b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.134+0000 7f31b37fe700 1 -- 172.21.15.156:0/2142152321 >> v1:172.21.15.156:6789/0 conn(0x7f31b4133ad0 legacy=0x7f31b4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.134+0000 7f31b37fe700 1 -- 172.21.15.156:0/2142152321 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b409a500 con 0x7f31b4136960 2023-09-30T22:25:29.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.134+0000 7f31b37fe700 1 --2- 172.21.15.156:0/2142152321 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31b4136960 0x7f31b4138d40 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f31a8009870 tx=0x7f31a8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ff4a3d40c8e925d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:29.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.134+0000 7f31b2ffd700 1 -- 172.21.15.156:0/2142152321 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a8011830 con 0x7f31b4136960 2023-09-30T22:25:29.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.134+0000 7f31b2ffd700 1 -- 172.21.15.156:0/2142152321 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a8011990 con 0x7f31b4136960 2023-09-30T22:25:29.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.135+0000 7f31b2ffd700 1 -- 172.21.15.156:0/2142152321 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a8011d20 con 0x7f31b4136960 2023-09-30T22:25:29.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.135+0000 7f31ba342700 1 -- 172.21.15.156:0/2142152321 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31b4136960 msgr2=0x7f31b4138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.135+0000 7f31ba342700 1 --2- 172.21.15.156:0/2142152321 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31b4136960 0x7f31b4138d40 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f31a8009870 tx=0x7f31a8009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:29.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.135+0000 7f31ba342700 1 -- 172.21.15.156:0/2142152321 shutdown_connections 2023-09-30T22:25:29.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.135+0000 7f31ba342700 1 --2- 172.21.15.156:0/2142152321 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31b4139280 0x7f31b413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.135+0000 7f31ba342700 1 --2- 172.21.15.156:0/2142152321 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31b4136960 0x7f31b4138d40 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.135+0000 7f31ba342700 1 -- 172.21.15.156:0/2142152321 >> 172.21.15.156:0/2142152321 conn(0x7f31b4099c40 msgr2=0x7f31b40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:29.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.135+0000 7f31ba342700 1 -- 172.21.15.156:0/2142152321 shutdown_connections 2023-09-30T22:25:29.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.135+0000 7f31ba342700 1 -- 172.21.15.156:0/2142152321 wait complete. 2023-09-30T22:25:29.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.136+0000 7f31ba342700 1 Processor -- start 2023-09-30T22:25:29.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.137+0000 7f31ba342700 1 -- start start 2023-09-30T22:25:29.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.137+0000 7f31ba342700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31b4133ad0 0x7f31b412ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.137+0000 7f31ba342700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31b4136960 0x7f31b412d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.137+0000 7f31ba342700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31b4139280 0x7f31b4071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.137+0000 7f31ba342700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b406ee10 con 0x7f31b4133ad0 2023-09-30T22:25:29.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.137+0000 7f31ba342700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b4131610 con 0x7f31b4136960 2023-09-30T22:25:29.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.137+0000 7f31ba342700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31b409f390 con 0x7f31b4139280 2023-09-30T22:25:29.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.138+0000 7f31b3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31b4133ad0 0x7f31b412ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.138+0000 7f31b3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31b4133ad0 0x7f31b412ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47544/0 (socket says 172.21.15.156:47544) 2023-09-30T22:25:29.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.138+0000 7f31b3fff700 1 -- 172.21.15.156:0/233531222 learned_addr learned my addr 172.21.15.156:0/233531222 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:29.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.138+0000 7f31b88df700 1 --2- 172.21.15.156:0/233531222 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31b4139280 0x7f31b4071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.138+0000 7f31b37fe700 1 --2- 172.21.15.156:0/233531222 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31b4136960 0x7f31b412d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.138+0000 7f31b88df700 1 -- 172.21.15.156:0/233531222 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31b4136960 msgr2=0x7f31b412d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.138+0000 7f31b88df700 1 --2- 172.21.15.156:0/233531222 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31b4136960 0x7f31b412d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.138+0000 7f31b88df700 1 -- 172.21.15.156:0/233531222 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31b4133ad0 msgr2=0x7f31b412ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.138+0000 7f31b88df700 1 --2- 172.21.15.156:0/233531222 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31b4133ad0 0x7f31b412ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.138+0000 7f31b88df700 1 -- 172.21.15.156:0/233531222 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a80094a0 con 0x7f31b4139280 2023-09-30T22:25:29.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.138+0000 7f31b88df700 1 --2- 172.21.15.156:0/233531222 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31b4139280 0x7f31b4071030 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f31ac00efc0 tx=0x7f31ac00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:29.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.138+0000 7f31b0ff9700 1 -- 172.21.15.156:0/233531222 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac00cc90 con 0x7f31b4139280 2023-09-30T22:25:29.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.138+0000 7f31b0ff9700 1 -- 172.21.15.156:0/233531222 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ac00f040 con 0x7f31b4139280 2023-09-30T22:25:29.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.138+0000 7f31ba342700 1 -- 172.21.15.156:0/233531222 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b406feb0 con 0x7f31b4139280 2023-09-30T22:25:29.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.138+0000 7f31b0ff9700 1 -- 172.21.15.156:0/233531222 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac0146c0 con 0x7f31b4139280 2023-09-30T22:25:29.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.138+0000 7f31ba342700 1 -- 172.21.15.156:0/233531222 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b4130ab0 con 0x7f31b4139280 2023-09-30T22:25:29.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.139+0000 7f31b0ff9700 1 -- 172.21.15.156:0/233531222 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f31ac014820 con 0x7f31b4139280 2023-09-30T22:25:29.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.139+0000 7f31b0ff9700 1 -- 172.21.15.156:0/233531222 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f31ac040270 con 0x7f31b4139280 2023-09-30T22:25:29.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.140+0000 7f31ba342700 1 -- 172.21.15.156:0/233531222 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b4070ca0 con 0x7f31b4139280 2023-09-30T22:25:29.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.144+0000 7f31b0ff9700 1 -- 172.21.15.156:0/233531222 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f31ac018020 con 0x7f31b4139280 2023-09-30T22:25:29.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.242+0000 7fdc57c30700 1 -- 172.21.15.156:0/2551850077 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdc50072480 con 0x7fdc50099e20 2023-09-30T22:25:29.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.243+0000 7fdc467fc700 1 -- 172.21.15.156:0/2551850077 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdc50072480 con 0x7fdc50099e20 2023-09-30T22:25:29.243 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:29.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.245+0000 7fdc57c30700 1 -- 172.21.15.156:0/2551850077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc50099e20 msgr2=0x7fdc501c83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.245+0000 7fdc57c30700 1 --2- 172.21.15.156:0/2551850077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc50099e20 0x7fdc501c83b0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c00c3e0 tx=0x7fdc4c00c6f0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.245+0000 7fdc57c30700 1 -- 172.21.15.156:0/2551850077 shutdown_connections 2023-09-30T22:25:29.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.245+0000 7fdc57c30700 1 --2- 172.21.15.156:0/2551850077 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdc50135f80 0x7fdc501c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.245+0000 7fdc57c30700 1 --2- 172.21.15.156:0/2551850077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc50099e20 0x7fdc501c83b0 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.245+0000 7fdc57c30700 1 --2- 172.21.15.156:0/2551850077 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fdc50133660 0x7fdc501c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.245+0000 7fdc57c30700 1 -- 172.21.15.156:0/2551850077 >> 172.21.15.156:0/2551850077 conn(0x7fdc500a2980 msgr2=0x7fdc50130260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:29.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.245+0000 7fdc57c30700 1 -- 172.21.15.156:0/2551850077 shutdown_connections 2023-09-30T22:25:29.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.245+0000 7fdc57c30700 1 -- 172.21.15.156:0/2551850077 wait complete. 2023-09-30T22:25:29.258 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:29.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.274+0000 7f0b2986c700 1 -- 172.21.15.156:0/1992319946 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0b24132240 con 0x7f0b24131980 2023-09-30T22:25:29.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.274+0000 7f0b0bfff700 1 -- 172.21.15.156:0/1992319946 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0b1c01a4a0 con 0x7f0b24131980 2023-09-30T22:25:29.275 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:29.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.276+0000 7f0b2986c700 1 -- 172.21.15.156:0/1992319946 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b24131980 msgr2=0x7f0b2411bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.276+0000 7f0b2986c700 1 --2- 172.21.15.156:0/1992319946 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b24131980 0x7f0b2411bff0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c00efc0 tx=0x7f0b1c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.277+0000 7f0b2986c700 1 -- 172.21.15.156:0/1992319946 shutdown_connections 2023-09-30T22:25:29.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.277+0000 7f0b2986c700 1 --2- 172.21.15.156:0/1992319946 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0b24131980 0x7f0b2411bff0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.277+0000 7f0b2986c700 1 --2- 172.21.15.156:0/1992319946 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b2409bc70 0x7f0b2411b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.277+0000 7f0b2986c700 1 --2- 172.21.15.156:0/1992319946 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0b2409c790 0x7f0b2411bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.277+0000 7f0b2986c700 1 -- 172.21.15.156:0/1992319946 >> 172.21.15.156:0/1992319946 conn(0x7f0b240a2980 msgr2=0x7f0b240712e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:29.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.277+0000 7f0b2986c700 1 -- 172.21.15.156:0/1992319946 shutdown_connections 2023-09-30T22:25:29.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.277+0000 7f0b2986c700 1 -- 172.21.15.156:0/1992319946 wait complete. 2023-09-30T22:25:29.289 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:29.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.325+0000 7f1374683700 1 -- 172.21.15.156:0/3261716789 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f136c04f2a0 con 0x7f136c0a0a30 2023-09-30T22:25:29.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.325+0000 7f1362ffd700 1 -- 172.21.15.156:0/3261716789 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f136803ce60 con 0x7f136c0a0a30 2023-09-30T22:25:29.326 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:29.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.327+0000 7f1374683700 1 -- 172.21.15.156:0/3261716789 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f136c0a0a30 msgr2=0x7f136c06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.327+0000 7f1374683700 1 --2- 172.21.15.156:0/3261716789 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f136c0a0a30 0x7f136c06ed10 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f136800c550 tx=0x7f136800c860 comp rx=0 tx=0).stop 2023-09-30T22:25:29.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.327+0000 7f1374683700 1 -- 172.21.15.156:0/3261716789 shutdown_connections 2023-09-30T22:25:29.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.327+0000 7f1374683700 1 --2- 172.21.15.156:0/3261716789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f136c1356e0 0x7f136c06f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.327+0000 7f1374683700 1 --2- 172.21.15.156:0/3261716789 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f136c0a0a30 0x7f136c06ed10 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.327+0000 7f1374683700 1 --2- 172.21.15.156:0/3261716789 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f136c0a1510 0x7f136c06f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.327+0000 7f1374683700 1 -- 172.21.15.156:0/3261716789 >> 172.21.15.156:0/3261716789 conn(0x7f136c0a2980 msgr2=0x7f136c09e970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:29.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.328+0000 7f1374683700 1 -- 172.21.15.156:0/3261716789 shutdown_connections 2023-09-30T22:25:29.330 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.328+0000 7f1374683700 1 -- 172.21.15.156:0/3261716789 wait complete. 2023-09-30T22:25:29.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:29.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.349+0000 7f31ba342700 1 -- 172.21.15.156:0/233531222 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f31b404f2a0 con 0x7f31b4139280 2023-09-30T22:25:29.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.349+0000 7f31b0ff9700 1 -- 172.21.15.156:0/233531222 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f31ac02b090 con 0x7f31b4139280 2023-09-30T22:25:29.350 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:29.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.352+0000 7f31ba342700 1 -- 172.21.15.156:0/233531222 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31b4139280 msgr2=0x7f31b4071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.352+0000 7f31ba342700 1 --2- 172.21.15.156:0/233531222 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31b4139280 0x7f31b4071030 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f31ac00efc0 tx=0x7f31ac00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.352+0000 7f31ba342700 1 -- 172.21.15.156:0/233531222 shutdown_connections 2023-09-30T22:25:29.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.352+0000 7f31ba342700 1 --2- 172.21.15.156:0/233531222 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f31b4139280 0x7f31b4071030 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.352+0000 7f31ba342700 1 --2- 172.21.15.156:0/233531222 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31b4133ad0 0x7f31b412ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.352+0000 7f31ba342700 1 --2- 172.21.15.156:0/233531222 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f31b4136960 0x7f31b412d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.352+0000 7f31ba342700 1 -- 172.21.15.156:0/233531222 >> 172.21.15.156:0/233531222 conn(0x7f31b4099c40 msgr2=0x7f31b40a30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:29.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.352+0000 7f31ba342700 1 -- 172.21.15.156:0/233531222 shutdown_connections 2023-09-30T22:25:29.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:29.352+0000 7f31ba342700 1 -- 172.21.15.156:0/233531222 wait complete. 2023-09-30T22:25:29.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:30.259 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:30.290 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:30.341 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:30.365 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:30.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.404+0000 7fd91c506700 1 Processor -- start 2023-09-30T22:25:30.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.404+0000 7fd91c506700 1 -- start start 2023-09-30T22:25:30.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.405+0000 7fd91c506700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd91409d860 0x7fd91409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.405+0000 7fd91c506700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd91409e170 0x7fd9141307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.405+0000 7fd91c506700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd914130ce0 0x7fd914131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.405+0000 7fd91c506700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd91409aaa0 con 0x7fd914130ce0 2023-09-30T22:25:30.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.405+0000 7fd91c506700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91409f870 con 0x7fd91409e170 2023-09-30T22:25:30.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.405+0000 7fd91c506700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd91409b360 con 0x7fd91409d860 2023-09-30T22:25:30.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.405+0000 7fd91aaa3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd914130ce0 0x7fd914131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.405+0000 7fd91aaa3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd914130ce0 0x7fd914131150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47550/0 (socket says 172.21.15.156:47550) 2023-09-30T22:25:30.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.405+0000 7fd91aaa3700 1 -- 172.21.15.156:0/225733446 learned_addr learned my addr 172.21.15.156:0/225733446 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:30.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.405+0000 7fd91a2a2700 1 --2- 172.21.15.156:0/225733446 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd91409d860 0x7fd91409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.405+0000 7fd91aaa3700 1 -- 172.21.15.156:0/225733446 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd91409d860 msgr2=0x7fd91409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:30.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.405+0000 7fd91aaa3700 1 --2- 172.21.15.156:0/225733446 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd91409d860 0x7fd91409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.405+0000 7fd91aaa3700 1 -- 172.21.15.156:0/225733446 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd91409e170 msgr2=0x7fd9141307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:30.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.405+0000 7fd91aaa3700 1 --2- 172.21.15.156:0/225733446 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd91409e170 0x7fd9141307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.405+0000 7fd91aaa3700 1 -- 172.21.15.156:0/225733446 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91409b620 con 0x7fd914130ce0 2023-09-30T22:25:30.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.405+0000 7fd91a2a2700 1 --2- 172.21.15.156:0/225733446 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd91409d860 0x7fd91409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:30.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.406+0000 7fd91aaa3700 1 --2- 172.21.15.156:0/225733446 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd914130ce0 0x7fd914131150 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fd90c009e50 tx=0x7fd90c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8137cce8e837f61 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:30.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.406+0000 7fd9192a0700 1 -- 172.21.15.156:0/225733446 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c00e070 con 0x7fd914130ce0 2023-09-30T22:25:30.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.406+0000 7fd9192a0700 1 -- 172.21.15.156:0/225733446 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c00b9c0 con 0x7fd914130ce0 2023-09-30T22:25:30.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.406+0000 7fd9192a0700 1 -- 172.21.15.156:0/225733446 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c00bd70 con 0x7fd914130ce0 2023-09-30T22:25:30.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.407+0000 7fd91c506700 1 -- 172.21.15.156:0/225733446 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd914130ce0 msgr2=0x7fd914131150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.407+0000 7fd91c506700 1 --2- 172.21.15.156:0/225733446 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd914130ce0 0x7fd914131150 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fd90c009e50 tx=0x7fd90c00b330 comp rx=0 tx=0).stop 2023-09-30T22:25:30.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.407+0000 7fd91c506700 1 -- 172.21.15.156:0/225733446 shutdown_connections 2023-09-30T22:25:30.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.407+0000 7fd91c506700 1 --2- 172.21.15.156:0/225733446 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd914130ce0 0x7fd914131150 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.407+0000 7fd91c506700 1 --2- 172.21.15.156:0/225733446 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd91409d860 0x7fd91409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.407+0000 7fd91c506700 1 --2- 172.21.15.156:0/225733446 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd91409e170 0x7fd9141307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.407+0000 7fd91c506700 1 -- 172.21.15.156:0/225733446 >> 172.21.15.156:0/225733446 conn(0x7fd914099c40 msgr2=0x7fd9140a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:30.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.407+0000 7fd91c506700 1 -- 172.21.15.156:0/225733446 shutdown_connections 2023-09-30T22:25:30.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.407+0000 7fd91c506700 1 -- 172.21.15.156:0/225733446 wait complete. 2023-09-30T22:25:30.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.408+0000 7fd91c506700 1 Processor -- start 2023-09-30T22:25:30.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.409+0000 7fd91c506700 1 -- start start 2023-09-30T22:25:30.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.409+0000 7fd91c506700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd91409d860 0x7fd9141c2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.409+0000 7fd91c506700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd91409e170 0x7fd9141c3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.409+0000 7fd91c506700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd914130ce0 0x7fd9141c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.409+0000 7fd91c506700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91409c950 con 0x7fd91409e170 2023-09-30T22:25:30.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.409+0000 7fd91c506700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91411b560 con 0x7fd91409d860 2023-09-30T22:25:30.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.409+0000 7fd91c506700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd91411b0a0 con 0x7fd914130ce0 2023-09-30T22:25:30.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.409+0000 7fd91a2a2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd91409d860 0x7fd9141c2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.409+0000 7fd91a2a2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd91409d860 0x7fd9141c2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49228/0 (socket says 172.21.15.156:49228) 2023-09-30T22:25:30.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.409+0000 7fd91a2a2700 1 -- 172.21.15.156:0/1054360785 learned_addr learned my addr 172.21.15.156:0/1054360785 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:30.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.409+0000 7fd91aaa3700 1 --2- 172.21.15.156:0/1054360785 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd914130ce0 0x7fd9141c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.409+0000 7fd919aa1700 1 --2- 172.21.15.156:0/1054360785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd91409e170 0x7fd9141c3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.410+0000 7fd91aaa3700 1 -- 172.21.15.156:0/1054360785 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd91409d860 msgr2=0x7fd9141c2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.410+0000 7fd91aaa3700 1 --2- 172.21.15.156:0/1054360785 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd91409d860 0x7fd9141c2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.410+0000 7fd91aaa3700 1 -- 172.21.15.156:0/1054360785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd91409e170 msgr2=0x7fd9141c3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.410+0000 7fd91aaa3700 1 --2- 172.21.15.156:0/1054360785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd91409e170 0x7fd9141c3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.410+0000 7fd91aaa3700 1 -- 172.21.15.156:0/1054360785 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90c009b30 con 0x7fd914130ce0 2023-09-30T22:25:30.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.410+0000 7fd91aaa3700 1 --2- 172.21.15.156:0/1054360785 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd914130ce0 0x7fd9141c5fc0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fd90c015000 tx=0x7fd90c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:30.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.410+0000 7fd90affd700 1 -- 172.21.15.156:0/1054360785 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c01f9b0 con 0x7fd914130ce0 2023-09-30T22:25:30.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.410+0000 7fd90affd700 1 -- 172.21.15.156:0/1054360785 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c023070 con 0x7fd914130ce0 2023-09-30T22:25:30.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.410+0000 7fd91c506700 1 -- 172.21.15.156:0/1054360785 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91411b7c0 con 0x7fd914130ce0 2023-09-30T22:25:30.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.410+0000 7fd90affd700 1 -- 172.21.15.156:0/1054360785 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c01fd70 con 0x7fd914130ce0 2023-09-30T22:25:30.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.410+0000 7fd91c506700 1 -- 172.21.15.156:0/1054360785 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9141c2a50 con 0x7fd914130ce0 2023-09-30T22:25:30.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.411+0000 7fd90affd700 1 -- 172.21.15.156:0/1054360785 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd90c025030 con 0x7fd914130ce0 2023-09-30T22:25:30.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.411+0000 7fd90affd700 1 -- 172.21.15.156:0/1054360785 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd90c046840 con 0x7fd914130ce0 2023-09-30T22:25:30.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.412+0000 7fd91c506700 1 -- 172.21.15.156:0/1054360785 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91411b950 con 0x7fd914130ce0 2023-09-30T22:25:30.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.416+0000 7fd90affd700 1 -- 172.21.15.156:0/1054360785 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd91411b950 con 0x7fd914130ce0 2023-09-30T22:25:30.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.455+0000 7f3fb6a93700 1 Processor -- start 2023-09-30T22:25:30.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.455+0000 7f3fb6a93700 1 -- start start 2023-09-30T22:25:30.458 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.456+0000 7f3fb6a93700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fb009a150 0x7f3fb009e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.456+0000 7f3fb6a93700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fb009edb0 0x7f3fb009f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.456+0000 7f3fb6a93700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3fb0133c20 0x7f3fb01340c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.456+0000 7f3fb6a93700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb009a520 con 0x7f3fb0133c20 2023-09-30T22:25:30.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.456+0000 7f3fb6a93700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb009fe00 con 0x7f3fb009a150 2023-09-30T22:25:30.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.456+0000 7f3fb6a93700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb006bec0 con 0x7f3fb009edb0 2023-09-30T22:25:30.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.456+0000 7f3faffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fb009edb0 0x7f3fb009f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.456+0000 7f3fb5030700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3fb0133c20 0x7f3fb01340c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.456+0000 7f3faffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fb009edb0 0x7f3fb009f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:35122/0 (socket says 172.21.15.156:35122) 2023-09-30T22:25:30.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.456+0000 7f3faffff700 1 -- 172.21.15.156:0/921172342 learned_addr learned my addr 172.21.15.156:0/921172342 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:30.459 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.456+0000 7f3fb482f700 1 --2- 172.21.15.156:0/921172342 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fb009a150 0x7f3fb009e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.456+0000 7f3faffff700 1 -- 172.21.15.156:0/921172342 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fb009a150 msgr2=0x7f3fb009e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:30.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.456+0000 7f3faffff700 1 --2- 172.21.15.156:0/921172342 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fb009a150 0x7f3fb009e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.456+0000 7f3faffff700 1 -- 172.21.15.156:0/921172342 >> v2:172.21.15.156:3300/0 conn(0x7f3fb0133c20 msgr2=0x7f3fb01340c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:30.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.456+0000 7f3faffff700 1 --2- 172.21.15.156:0/921172342 >> v2:172.21.15.156:3300/0 conn(0x7f3fb0133c20 0x7f3fb01340c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.456+0000 7f3faffff700 1 -- 172.21.15.156:0/921172342 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb009af80 con 0x7f3fb009edb0 2023-09-30T22:25:30.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.456+0000 7f3fb5030700 1 --2- 172.21.15.156:0/921172342 >> v2:172.21.15.156:3300/0 conn(0x7f3fb0133c20 0x7f3fb01340c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:30.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.456+0000 7f3fb482f700 1 --2- 172.21.15.156:0/921172342 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fb009a150 0x7f3fb009e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:30.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.457+0000 7f3faffff700 1 --2- 172.21.15.156:0/921172342 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fb009edb0 0x7f3fb009f1a0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c009920 tx=0x7f3f9c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92fb9cdb3e020c43 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:30.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.457+0000 7f3faf7fe700 1 -- 172.21.15.156:0/921172342 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c00ba20 con 0x7f3fb009edb0 2023-09-30T22:25:30.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.457+0000 7f3faf7fe700 1 -- 172.21.15.156:0/921172342 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9c00bb80 con 0x7f3fb009edb0 2023-09-30T22:25:30.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.457+0000 7f3faf7fe700 1 -- 172.21.15.156:0/921172342 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c009e70 con 0x7f3fb009edb0 2023-09-30T22:25:30.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.458+0000 7f3fb6a93700 1 -- 172.21.15.156:0/921172342 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fb009edb0 msgr2=0x7f3fb009f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.458+0000 7f3fb6a93700 1 --2- 172.21.15.156:0/921172342 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fb009edb0 0x7f3fb009f1a0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c009920 tx=0x7f3f9c009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:30.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.458+0000 7f3fb6a93700 1 -- 172.21.15.156:0/921172342 shutdown_connections 2023-09-30T22:25:30.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.458+0000 7f3fb6a93700 1 --2- 172.21.15.156:0/921172342 >> v2:172.21.15.156:3300/0 conn(0x7f3fb0133c20 0x7f3fb01340c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.458+0000 7f3fb6a93700 1 --2- 172.21.15.156:0/921172342 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fb009a150 0x7f3fb009e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.458+0000 7f3fb6a93700 1 --2- 172.21.15.156:0/921172342 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fb009edb0 0x7f3fb009f1a0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.458+0000 7f3fb6a93700 1 -- 172.21.15.156:0/921172342 >> 172.21.15.156:0/921172342 conn(0x7f3fb00a4430 msgr2=0x7f3fb00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:30.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.458+0000 7f3fb6a93700 1 -- 172.21.15.156:0/921172342 shutdown_connections 2023-09-30T22:25:30.462 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.458+0000 7f3fb6a93700 1 -- 172.21.15.156:0/921172342 wait complete. 2023-09-30T22:25:30.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.459+0000 7f3fb6a93700 1 Processor -- start 2023-09-30T22:25:30.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.459+0000 7f3fb6a93700 1 -- start start 2023-09-30T22:25:30.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.460+0000 7f3fb6a93700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fb009a150 0x7f3fb011ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.460+0000 7f3fb6a93700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fb009edb0 0x7f3fb011f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.460+0000 7f3fb6a93700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fb0133c20 0x7f3fb011f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.460+0000 7f3fb6a93700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb009b470 con 0x7f3fb009a150 2023-09-30T22:25:30.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.460+0000 7f3fb6a93700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb0122280 con 0x7f3fb0133c20 2023-09-30T22:25:30.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.460+0000 7f3fb6a93700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb01339d0 con 0x7f3fb009edb0 2023-09-30T22:25:30.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.460+0000 7f3fb482f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fb009a150 0x7f3fb011ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.460+0000 7f3fb482f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fb009a150 0x7f3fb011ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47568/0 (socket says 172.21.15.156:47568) 2023-09-30T22:25:30.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.460+0000 7f3fb482f700 1 -- 172.21.15.156:0/3641249284 learned_addr learned my addr 172.21.15.156:0/3641249284 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:30.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.460+0000 7f3faffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fb009edb0 0x7f3fb011f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.460+0000 7f3fb5030700 1 --2- 172.21.15.156:0/3641249284 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fb0133c20 0x7f3fb011f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.460+0000 7f3faffff700 1 -- 172.21.15.156:0/3641249284 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fb0133c20 msgr2=0x7f3fb011f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.460+0000 7f3faffff700 1 --2- 172.21.15.156:0/3641249284 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fb0133c20 0x7f3fb011f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.460+0000 7f3faffff700 1 -- 172.21.15.156:0/3641249284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fb009a150 msgr2=0x7f3fb011ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.460+0000 7f3faffff700 1 --2- 172.21.15.156:0/3641249284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fb009a150 0x7f3fb011ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.460+0000 7f3faffff700 1 -- 172.21.15.156:0/3641249284 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9c009550 con 0x7f3fb009edb0 2023-09-30T22:25:30.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.460+0000 7f3fb482f700 1 --2- 172.21.15.156:0/3641249284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fb009a150 0x7f3fb011ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:30.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.461+0000 7f3faffff700 1 --2- 172.21.15.156:0/3641249284 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fb009edb0 0x7f3fb011f010 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f3fb009b130 tx=0x7f3f9c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:30.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.461+0000 7f3fad7fa700 1 -- 172.21.15.156:0/3641249284 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c004300 con 0x7f3fb009edb0 2023-09-30T22:25:30.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.461+0000 7f3fad7fa700 1 -- 172.21.15.156:0/3641249284 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9c01f070 con 0x7f3fb009edb0 2023-09-30T22:25:30.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.461+0000 7f3fad7fa700 1 -- 172.21.15.156:0/3641249284 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c0036a0 con 0x7f3fb009edb0 2023-09-30T22:25:30.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.461+0000 7f3fb6a93700 1 -- 172.21.15.156:0/3641249284 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb0120c00 con 0x7f3fb009edb0 2023-09-30T22:25:30.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.461+0000 7f3fb6a93700 1 -- 172.21.15.156:0/3641249284 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb0120e40 con 0x7f3fb009edb0 2023-09-30T22:25:30.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.462+0000 7f3fad7fa700 1 -- 172.21.15.156:0/3641249284 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f9c021030 con 0x7f3fb009edb0 2023-09-30T22:25:30.466 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.462+0000 7f3fad7fa700 1 -- 172.21.15.156:0/3641249284 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3f9c040b30 con 0x7f3fb009edb0 2023-09-30T22:25:30.467 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.462+0000 7f3fb6a93700 1 -- 172.21.15.156:0/3641249284 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb009fa30 con 0x7f3fb009edb0 2023-09-30T22:25:30.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.471+0000 7f3fad7fa700 1 -- 172.21.15.156:0/3641249284 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f9c015080 con 0x7f3fb009edb0 2023-09-30T22:25:30.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.497+0000 7f2b6936e700 1 Processor -- start 2023-09-30T22:25:30.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.497+0000 7f2b6936e700 1 -- start start 2023-09-30T22:25:30.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.498+0000 7f2b6936e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b64133ad0 0x7f2b64133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.498+0000 7f2b6936e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2b641300a0 0x7f2b641304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.498+0000 7f2b6936e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b641309f0 0x7f2b6413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.498+0000 7f2b6936e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b6406b2d0 con 0x7f2b641300a0 2023-09-30T22:25:30.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.498+0000 7f2b6936e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b64133610 con 0x7f2b64133ad0 2023-09-30T22:25:30.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.498+0000 7f2b6936e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6409a500 con 0x7f2b641309f0 2023-09-30T22:25:30.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.498+0000 7f2b62ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b64133ad0 0x7f2b64133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.498+0000 7f2b62ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b64133ad0 0x7f2b64133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49244/0 (socket says 172.21.15.156:49244) 2023-09-30T22:25:30.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.498+0000 7f2b62ffd700 1 -- 172.21.15.156:0/1283852946 learned_addr learned my addr 172.21.15.156:0/1283852946 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:30.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.498+0000 7f2b637fe700 1 --2- 172.21.15.156:0/1283852946 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b641309f0 0x7f2b6413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.499+0000 7f2b627fc700 1 --2- 172.21.15.156:0/1283852946 >> v2:172.21.15.156:3300/0 conn(0x7f2b641300a0 0x7f2b641304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.499+0000 7f2b62ffd700 1 -- 172.21.15.156:0/1283852946 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b641309f0 msgr2=0x7f2b6413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:30.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.499+0000 7f2b62ffd700 1 --2- 172.21.15.156:0/1283852946 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b641309f0 0x7f2b6413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.499+0000 7f2b62ffd700 1 -- 172.21.15.156:0/1283852946 >> v2:172.21.15.156:3300/0 conn(0x7f2b641300a0 msgr2=0x7f2b641304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:30.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.499+0000 7f2b62ffd700 1 --2- 172.21.15.156:0/1283852946 >> v2:172.21.15.156:3300/0 conn(0x7f2b641300a0 0x7f2b641304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.499+0000 7f2b62ffd700 1 -- 172.21.15.156:0/1283852946 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b641338b0 con 0x7f2b64133ad0 2023-09-30T22:25:30.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.499+0000 7f2b627fc700 1 --2- 172.21.15.156:0/1283852946 >> v2:172.21.15.156:3300/0 conn(0x7f2b641300a0 0x7f2b641304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:30.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.499+0000 7f2b62ffd700 1 --2- 172.21.15.156:0/1283852946 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b64133ad0 0x7f2b64133ea0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f2b540098f0 tx=0x7f2b54009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d4514a38f88a58e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:30.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.499+0000 7f2b61ffb700 1 -- 172.21.15.156:0/1283852946 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b54011830 con 0x7f2b64133ad0 2023-09-30T22:25:30.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.499+0000 7f2b61ffb700 1 -- 172.21.15.156:0/1283852946 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b54011990 con 0x7f2b64133ad0 2023-09-30T22:25:30.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.499+0000 7f2b61ffb700 1 -- 172.21.15.156:0/1283852946 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b54011d20 con 0x7f2b64133ad0 2023-09-30T22:25:30.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.500+0000 7f2b6936e700 1 -- 172.21.15.156:0/1283852946 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b64133ad0 msgr2=0x7f2b64133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.500+0000 7f2b6936e700 1 --2- 172.21.15.156:0/1283852946 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b64133ad0 0x7f2b64133ea0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f2b540098f0 tx=0x7f2b54009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:30.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.500+0000 7f2b6936e700 1 -- 172.21.15.156:0/1283852946 shutdown_connections 2023-09-30T22:25:30.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.500+0000 7f2b6936e700 1 --2- 172.21.15.156:0/1283852946 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b641309f0 0x7f2b6413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.500+0000 7f2b6936e700 1 --2- 172.21.15.156:0/1283852946 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b64133ad0 0x7f2b64133ea0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.500+0000 7f2b6936e700 1 --2- 172.21.15.156:0/1283852946 >> v2:172.21.15.156:3300/0 conn(0x7f2b641300a0 0x7f2b641304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.500+0000 7f2b6936e700 1 -- 172.21.15.156:0/1283852946 >> 172.21.15.156:0/1283852946 conn(0x7f2b64099c40 msgr2=0x7f2b640a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:30.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.500+0000 7f2b6936e700 1 -- 172.21.15.156:0/1283852946 shutdown_connections 2023-09-30T22:25:30.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.500+0000 7f2b6936e700 1 -- 172.21.15.156:0/1283852946 wait complete. 2023-09-30T22:25:30.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.502+0000 7f2b6936e700 1 Processor -- start 2023-09-30T22:25:30.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.502+0000 7f2b6936e700 1 -- start start 2023-09-30T22:25:30.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.503+0000 7f2b6936e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b641300a0 0x7f2b6411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.503+0000 7f2b6936e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b641309f0 0x7f2b6411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.503+0000 7f2b6936e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b64133ad0 0x7f2b6411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.503+0000 7f2b6936e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b641200c0 con 0x7f2b641309f0 2023-09-30T22:25:30.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.503+0000 7f2b6936e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6411f040 con 0x7f2b64133ad0 2023-09-30T22:25:30.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.503+0000 7f2b6936e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6411fb20 con 0x7f2b641300a0 2023-09-30T22:25:30.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.503+0000 7f2b62ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b641300a0 0x7f2b6411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.503+0000 7f2b62ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b641300a0 0x7f2b6411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:35146/0 (socket says 172.21.15.156:35146) 2023-09-30T22:25:30.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.503+0000 7f2b62ffd700 1 -- 172.21.15.156:0/2866671817 learned_addr learned my addr 172.21.15.156:0/2866671817 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:30.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.503+0000 7f2b627fc700 1 --2- 172.21.15.156:0/2866671817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b641309f0 0x7f2b6411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.503+0000 7f2b637fe700 1 --2- 172.21.15.156:0/2866671817 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b64133ad0 0x7f2b6411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.503+0000 7f2b62ffd700 1 -- 172.21.15.156:0/2866671817 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b64133ad0 msgr2=0x7f2b6411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.503+0000 7f2b62ffd700 1 --2- 172.21.15.156:0/2866671817 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b64133ad0 0x7f2b6411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.503+0000 7f2b62ffd700 1 -- 172.21.15.156:0/2866671817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b641309f0 msgr2=0x7f2b6411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.503+0000 7f2b62ffd700 1 --2- 172.21.15.156:0/2866671817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b641309f0 0x7f2b6411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.503+0000 7f2b62ffd700 1 -- 172.21.15.156:0/2866671817 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b54009550 con 0x7f2b641300a0 2023-09-30T22:25:30.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.503+0000 7f2b627fc700 1 --2- 172.21.15.156:0/2866671817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b641309f0 0x7f2b6411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:30.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.503+0000 7f2b62ffd700 1 --2- 172.21.15.156:0/2866671817 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b641300a0 0x7f2b6411da40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f2b54009c40 tx=0x7f2b54004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:30.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.504+0000 7f2b4b7fe700 1 -- 172.21.15.156:0/2866671817 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b54004590 con 0x7f2b641300a0 2023-09-30T22:25:30.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.504+0000 7f2b4b7fe700 1 -- 172.21.15.156:0/2866671817 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b540036a0 con 0x7f2b641300a0 2023-09-30T22:25:30.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.504+0000 7f2b4b7fe700 1 -- 172.21.15.156:0/2866671817 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b54003a50 con 0x7f2b641300a0 2023-09-30T22:25:30.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.504+0000 7f2b6936e700 1 -- 172.21.15.156:0/2866671817 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b6411f850 con 0x7f2b641300a0 2023-09-30T22:25:30.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.504+0000 7f2b6936e700 1 -- 172.21.15.156:0/2866671817 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b640a3440 con 0x7f2b641300a0 2023-09-30T22:25:30.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.505+0000 7f2b4b7fe700 1 -- 172.21.15.156:0/2866671817 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2b54003bb0 con 0x7f2b641300a0 2023-09-30T22:25:30.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.505+0000 7f2b4b7fe700 1 -- 172.21.15.156:0/2866671817 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2b540408f0 con 0x7f2b641300a0 2023-09-30T22:25:30.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.505+0000 7f2b6936e700 1 -- 172.21.15.156:0/2866671817 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b640a2620 con 0x7f2b641300a0 2023-09-30T22:25:30.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.510+0000 7f2b4b7fe700 1 -- 172.21.15.156:0/2866671817 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b54028080 con 0x7f2b641300a0 2023-09-30T22:25:30.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.527+0000 7f672e579700 1 Processor -- start 2023-09-30T22:25:30.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.527+0000 7f672e579700 1 -- start start 2023-09-30T22:25:30.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.528+0000 7f672e579700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f672809e340 0x7f67281359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.528+0000 7f672e579700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6728135f20 0x7f6728138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.528+0000 7f672e579700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f672809aaa0 con 0x7f672809d860 2023-09-30T22:25:30.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.528+0000 7f672e579700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f672809e730 con 0x7f672809e340 2023-09-30T22:25:30.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.528+0000 7f672e579700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f672809f870 con 0x7f6728135f20 2023-09-30T22:25:30.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.528+0000 7f67277fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f672809e340 0x7f67281359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.528+0000 7f67277fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f672809e340 0x7f67281359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49266/0 (socket says 172.21.15.156:49266) 2023-09-30T22:25:30.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.528+0000 7f67277fe700 1 -- 172.21.15.156:0/1911811557 learned_addr learned my addr 172.21.15.156:0/1911811557 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:30.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.528+0000 7f672cb16700 1 --2- 172.21.15.156:0/1911811557 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6728135f20 0x7f6728138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.528+0000 7f67277fe700 1 -- 172.21.15.156:0/1911811557 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6728135f20 msgr2=0x7f6728138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:30.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.528+0000 7f67277fe700 1 --2- 172.21.15.156:0/1911811557 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6728135f20 0x7f6728138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.528+0000 7f67277fe700 1 -- 172.21.15.156:0/1911811557 >> v1:172.21.15.156:6789/0 conn(0x7f672809d860 legacy=0x7f672809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.528+0000 7f67277fe700 1 -- 172.21.15.156:0/1911811557 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672809b360 con 0x7f672809e340 2023-09-30T22:25:30.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.528+0000 7f672cb16700 1 --2- 172.21.15.156:0/1911811557 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6728135f20 0x7f6728138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:30.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.528+0000 7f67277fe700 1 --2- 172.21.15.156:0/1911811557 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f672809e340 0x7f67281359e0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f671c009920 tx=0x7f671c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd57643ab3909d96 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:30.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.529+0000 7f6726ffd700 1 -- 172.21.15.156:0/1911811557 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c011830 con 0x7f672809e340 2023-09-30T22:25:30.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.529+0000 7f6726ffd700 1 -- 172.21.15.156:0/1911811557 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671c011990 con 0x7f672809e340 2023-09-30T22:25:30.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.529+0000 7f6726ffd700 1 -- 172.21.15.156:0/1911811557 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c011d20 con 0x7f672809e340 2023-09-30T22:25:30.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.529+0000 7f672e579700 1 -- 172.21.15.156:0/1911811557 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f672809e340 msgr2=0x7f67281359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.529+0000 7f672e579700 1 --2- 172.21.15.156:0/1911811557 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f672809e340 0x7f67281359e0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f671c009920 tx=0x7f671c009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:30.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.529+0000 7f672e579700 1 -- 172.21.15.156:0/1911811557 shutdown_connections 2023-09-30T22:25:30.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.529+0000 7f672e579700 1 --2- 172.21.15.156:0/1911811557 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6728135f20 0x7f6728138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.529+0000 7f672e579700 1 --2- 172.21.15.156:0/1911811557 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f672809e340 0x7f67281359e0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.529+0000 7f672e579700 1 -- 172.21.15.156:0/1911811557 >> 172.21.15.156:0/1911811557 conn(0x7f6728099c40 msgr2=0x7f67280a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:30.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.529+0000 7f672e579700 1 -- 172.21.15.156:0/1911811557 shutdown_connections 2023-09-30T22:25:30.532 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.529+0000 7f672e579700 1 -- 172.21.15.156:0/1911811557 wait complete. 2023-09-30T22:25:30.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.531+0000 7f672e579700 1 Processor -- start 2023-09-30T22:25:30.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.531+0000 7f672e579700 1 -- start start 2023-09-30T22:25:30.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.532+0000 7f672e579700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f672809d860 0x7f672811a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.532+0000 7f672e579700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f672809e340 0x7f672811a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.532+0000 7f672e579700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6728135f20 0x7f67281c4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.532+0000 7f672e579700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672811d380 con 0x7f6728135f20 2023-09-30T22:25:30.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.532+0000 7f672e579700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f672811d000 con 0x7f672809e340 2023-09-30T22:25:30.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.532+0000 7f672e579700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6728119d40 con 0x7f672809d860 2023-09-30T22:25:30.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.532+0000 7f67277fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f672809e340 0x7f672811a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.532+0000 7f6727fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f672809d860 0x7f672811a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.532+0000 7f67277fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f672809e340 0x7f672811a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:49274/0 (socket says 172.21.15.156:49274) 2023-09-30T22:25:30.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.532+0000 7f67277fe700 1 -- 172.21.15.156:0/2894540640 learned_addr learned my addr 172.21.15.156:0/2894540640 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:30.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.532+0000 7f672cb16700 1 --2- 172.21.15.156:0/2894540640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6728135f20 0x7f67281c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.532+0000 7f67277fe700 1 -- 172.21.15.156:0/2894540640 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f672809d860 msgr2=0x7f672811a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.532+0000 7f67277fe700 1 --2- 172.21.15.156:0/2894540640 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f672809d860 0x7f672811a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.532+0000 7f67277fe700 1 -- 172.21.15.156:0/2894540640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6728135f20 msgr2=0x7f67281c4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.532+0000 7f67277fe700 1 --2- 172.21.15.156:0/2894540640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6728135f20 0x7f67281c4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.532+0000 7f67277fe700 1 -- 172.21.15.156:0/2894540640 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6720009a70 con 0x7f672809e340 2023-09-30T22:25:30.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.532+0000 7f672cb16700 1 --2- 172.21.15.156:0/2894540640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6728135f20 0x7f67281c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:30.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.532+0000 7f67277fe700 1 --2- 172.21.15.156:0/2894540640 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f672809e340 0x7f672811a8d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f671c0098f0 tx=0x7f671c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:30.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.532+0000 7f6724ff9700 1 -- 172.21.15.156:0/2894540640 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c004510 con 0x7f672809e340 2023-09-30T22:25:30.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.532+0000 7f6724ff9700 1 -- 172.21.15.156:0/2894540640 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671c0036a0 con 0x7f672809e340 2023-09-30T22:25:30.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.532+0000 7f6724ff9700 1 -- 172.21.15.156:0/2894540640 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c003a10 con 0x7f672809e340 2023-09-30T22:25:30.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.533+0000 7f672e579700 1 -- 172.21.15.156:0/2894540640 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f671c009550 con 0x7f672809e340 2023-09-30T22:25:30.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.533+0000 7f672e579700 1 -- 172.21.15.156:0/2894540640 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67280a2390 con 0x7f672809e340 2023-09-30T22:25:30.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.534+0000 7f672e579700 1 -- 172.21.15.156:0/2894540640 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f672809c910 con 0x7f672809e340 2023-09-30T22:25:30.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.534+0000 7f6724ff9700 1 -- 172.21.15.156:0/2894540640 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f671c021070 con 0x7f672809e340 2023-09-30T22:25:30.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.535+0000 7f6724ff9700 1 -- 172.21.15.156:0/2894540640 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f671c040d80 con 0x7f672809e340 2023-09-30T22:25:30.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.538+0000 7f6724ff9700 1 -- 172.21.15.156:0/2894540640 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f671c02d760 con 0x7f672809e340 2023-09-30T22:25:30.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.623+0000 7fd91c506700 1 -- 172.21.15.156:0/1054360785 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd91411b950 con 0x7fd914130ce0 2023-09-30T22:25:30.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.623+0000 7fd90affd700 1 -- 172.21.15.156:0/1054360785 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd90c04a060 con 0x7fd914130ce0 2023-09-30T22:25:30.624 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:30.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.626+0000 7fd91c506700 1 -- 172.21.15.156:0/1054360785 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd914130ce0 msgr2=0x7fd9141c5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.626+0000 7fd91c506700 1 --2- 172.21.15.156:0/1054360785 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd914130ce0 0x7fd9141c5fc0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fd90c015000 tx=0x7fd90c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.627+0000 7fd91c506700 1 -- 172.21.15.156:0/1054360785 shutdown_connections 2023-09-30T22:25:30.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.627+0000 7fd91c506700 1 --2- 172.21.15.156:0/1054360785 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd914130ce0 0x7fd9141c5fc0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.627+0000 7fd91c506700 1 --2- 172.21.15.156:0/1054360785 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd91409d860 0x7fd9141c2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.627+0000 7fd91c506700 1 --2- 172.21.15.156:0/1054360785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd91409e170 0x7fd9141c3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.627+0000 7fd91c506700 1 -- 172.21.15.156:0/1054360785 >> 172.21.15.156:0/1054360785 conn(0x7fd914099c40 msgr2=0x7fd9140a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:30.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.627+0000 7fd91c506700 1 -- 172.21.15.156:0/1054360785 shutdown_connections 2023-09-30T22:25:30.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.627+0000 7fd91c506700 1 -- 172.21.15.156:0/1054360785 wait complete. 2023-09-30T22:25:30.644 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:30.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.706+0000 7f3fb6a93700 1 -- 172.21.15.156:0/3641249284 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3fb0121f20 con 0x7f3fb009edb0 2023-09-30T22:25:30.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.706+0000 7f3fad7fa700 1 -- 172.21.15.156:0/3641249284 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3fb0121f20 con 0x7f3fb009edb0 2023-09-30T22:25:30.707 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:30.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.708+0000 7f3fb6a93700 1 -- 172.21.15.156:0/3641249284 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fb009edb0 msgr2=0x7f3fb011f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.708+0000 7f3fb6a93700 1 --2- 172.21.15.156:0/3641249284 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fb009edb0 0x7f3fb011f010 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f3fb009b130 tx=0x7f3f9c004750 comp rx=0 tx=0).stop 2023-09-30T22:25:30.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.708+0000 7f3fb6a93700 1 -- 172.21.15.156:0/3641249284 shutdown_connections 2023-09-30T22:25:30.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.708+0000 7f3fb6a93700 1 --2- 172.21.15.156:0/3641249284 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3fb0133c20 0x7f3fb011f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.708+0000 7f3fb6a93700 1 --2- 172.21.15.156:0/3641249284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fb009a150 0x7f3fb011ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.708+0000 7f3fb6a93700 1 --2- 172.21.15.156:0/3641249284 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3fb009edb0 0x7f3fb011f010 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.708+0000 7f3fb6a93700 1 -- 172.21.15.156:0/3641249284 >> 172.21.15.156:0/3641249284 conn(0x7f3fb00a4430 msgr2=0x7f3fb01b8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:30.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.709+0000 7f3fb6a93700 1 -- 172.21.15.156:0/3641249284 shutdown_connections 2023-09-30T22:25:30.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.709+0000 7f3fb6a93700 1 -- 172.21.15.156:0/3641249284 wait complete. 2023-09-30T22:25:30.721 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:30.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.739+0000 7f2b6936e700 1 -- 172.21.15.156:0/2866671817 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2b641331c0 con 0x7f2b641300a0 2023-09-30T22:25:30.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.739+0000 7f2b4b7fe700 1 -- 172.21.15.156:0/2866671817 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2b54015020 con 0x7f2b641300a0 2023-09-30T22:25:30.740 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:30.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.741+0000 7f2b6936e700 1 -- 172.21.15.156:0/2866671817 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b641300a0 msgr2=0x7f2b6411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.741+0000 7f2b6936e700 1 --2- 172.21.15.156:0/2866671817 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b641300a0 0x7f2b6411da40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f2b54009c40 tx=0x7f2b54004750 comp rx=0 tx=0).stop 2023-09-30T22:25:30.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.741+0000 7f2b6936e700 1 -- 172.21.15.156:0/2866671817 shutdown_connections 2023-09-30T22:25:30.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.741+0000 7f2b6936e700 1 --2- 172.21.15.156:0/2866671817 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b64133ad0 0x7f2b6411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.741+0000 7f2b6936e700 1 --2- 172.21.15.156:0/2866671817 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2b641300a0 0x7f2b6411da40 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.741+0000 7f2b6936e700 1 --2- 172.21.15.156:0/2866671817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b641309f0 0x7f2b6411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.741+0000 7f2b6936e700 1 -- 172.21.15.156:0/2866671817 >> 172.21.15.156:0/2866671817 conn(0x7f2b64099c40 msgr2=0x7f2b64132ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:30.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.741+0000 7f2b6936e700 1 -- 172.21.15.156:0/2866671817 shutdown_connections 2023-09-30T22:25:30.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.741+0000 7f2b6936e700 1 -- 172.21.15.156:0/2866671817 wait complete. 2023-09-30T22:25:30.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.742+0000 7f672e579700 1 -- 172.21.15.156:0/2894540640 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f672804f2a0 con 0x7f672809e340 2023-09-30T22:25:30.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.742+0000 7f6724ff9700 1 -- 172.21.15.156:0/2894540640 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f671c032020 con 0x7f672809e340 2023-09-30T22:25:30.746 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:30.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.744+0000 7f672e579700 1 -- 172.21.15.156:0/2894540640 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f672809e340 msgr2=0x7f672811a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.744+0000 7f672e579700 1 --2- 172.21.15.156:0/2894540640 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f672809e340 0x7f672811a8d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f671c0098f0 tx=0x7f671c004750 comp rx=0 tx=0).stop 2023-09-30T22:25:30.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.744+0000 7f672e579700 1 -- 172.21.15.156:0/2894540640 shutdown_connections 2023-09-30T22:25:30.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.744+0000 7f672e579700 1 --2- 172.21.15.156:0/2894540640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6728135f20 0x7f67281c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.744+0000 7f672e579700 1 --2- 172.21.15.156:0/2894540640 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f672809d860 0x7f672811a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.744+0000 7f672e579700 1 --2- 172.21.15.156:0/2894540640 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f672809e340 0x7f672811a8d0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.744+0000 7f672e579700 1 -- 172.21.15.156:0/2894540640 >> 172.21.15.156:0/2894540640 conn(0x7f6728099c40 msgr2=0x7f6728132af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:30.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.745+0000 7f672e579700 1 -- 172.21.15.156:0/2894540640 shutdown_connections 2023-09-30T22:25:30.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:30.745+0000 7f672e579700 1 -- 172.21.15.156:0/2894540640 wait complete. 2023-09-30T22:25:30.756 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:30.758 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:31.644 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:31.722 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:31.757 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:31.758 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:31.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.780+0000 7fcdb6da1700 1 Processor -- start 2023-09-30T22:25:31.780 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.780+0000 7fcdb6da1700 1 -- start start 2023-09-30T22:25:31.781 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.780+0000 7fcdb6da1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcdb0130c30 0x7fcdb012ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.780+0000 7fcdb6da1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcdb0138790 0x7fcdb013ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.780+0000 7fcdb6da1700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb009f590 con 0x7fcdb006a770 2023-09-30T22:25:31.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.781+0000 7fcdb6da1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb009af90 con 0x7fcdb0138790 2023-09-30T22:25:31.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.781+0000 7fcdb6da1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb009a5d0 con 0x7fcdb0130c30 2023-09-30T22:25:31.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.781+0000 7fcdb5d9f700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fcdb006a770 0x7fcdb0130520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:59194/0 (socket says 172.21.15.156:59194) 2023-09-30T22:25:31.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.781+0000 7fcdb5d9f700 1 -- 172.21.15.156:0/1823878923 learned_addr learned my addr 172.21.15.156:0/1823878923 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:31.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.781+0000 7fcdb559e700 1 --2- 172.21.15.156:0/1823878923 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcdb0130c30 0x7fcdb012ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.781+0000 7fcdb65a0700 1 --2- 172.21.15.156:0/1823878923 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcdb0138790 0x7fcdb013ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.781+0000 7fcdb559e700 1 -- 172.21.15.156:0/1823878923 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcdb0138790 msgr2=0x7fcdb013ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:31.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.781+0000 7fcdb559e700 1 --2- 172.21.15.156:0/1823878923 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcdb0138790 0x7fcdb013ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.781+0000 7fcdb559e700 1 -- 172.21.15.156:0/1823878923 >> v1:172.21.15.156:6789/0 conn(0x7fcdb006a770 legacy=0x7fcdb0130520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.781+0000 7fcdb559e700 1 -- 172.21.15.156:0/1823878923 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb009ed60 con 0x7fcdb0130c30 2023-09-30T22:25:31.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.782+0000 7fcdb559e700 1 --2- 172.21.15.156:0/1823878923 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcdb0130c30 0x7fcdb012ff00 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009870 tx=0x7fcda0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfd147be2a385c94 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:31.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.782+0000 7fcdb4d9d700 1 -- 172.21.15.156:0/1823878923 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0011830 con 0x7fcdb0130c30 2023-09-30T22:25:31.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.782+0000 7fcdb4d9d700 1 -- 172.21.15.156:0/1823878923 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda0011990 con 0x7fcdb0130c30 2023-09-30T22:25:31.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.782+0000 7fcdb4d9d700 1 -- 172.21.15.156:0/1823878923 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0011d20 con 0x7fcdb0130c30 2023-09-30T22:25:31.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.783+0000 7fcdb6da1700 1 -- 172.21.15.156:0/1823878923 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcdb0130c30 msgr2=0x7fcdb012ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.783+0000 7fcdb6da1700 1 --2- 172.21.15.156:0/1823878923 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcdb0130c30 0x7fcdb012ff00 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009870 tx=0x7fcda0009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:31.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.783+0000 7fcdb6da1700 1 -- 172.21.15.156:0/1823878923 shutdown_connections 2023-09-30T22:25:31.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.783+0000 7fcdb6da1700 1 --2- 172.21.15.156:0/1823878923 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcdb0138790 0x7fcdb013ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.783+0000 7fcdb6da1700 1 --2- 172.21.15.156:0/1823878923 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcdb0130c30 0x7fcdb012ff00 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.783+0000 7fcdb6da1700 1 -- 172.21.15.156:0/1823878923 >> 172.21.15.156:0/1823878923 conn(0x7fcdb00a2d80 msgr2=0x7fcdb00a3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:31.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.783+0000 7fcdb6da1700 1 -- 172.21.15.156:0/1823878923 shutdown_connections 2023-09-30T22:25:31.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.783+0000 7fcdb6da1700 1 -- 172.21.15.156:0/1823878923 wait complete. 2023-09-30T22:25:31.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.784+0000 7fcdb6da1700 1 Processor -- start 2023-09-30T22:25:31.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.784+0000 7fcdb6da1700 1 -- start start 2023-09-30T22:25:31.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.785+0000 7fcdb6da1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcdb006a770 0x7fcdb01347e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.785+0000 7fcdb6da1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdb0130c30 0x7fcdb0134d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.785+0000 7fcdb6da1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcdb0138790 0x7fcdb0135260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.785+0000 7fcdb6da1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb009e160 con 0x7fcdb0130c30 2023-09-30T22:25:31.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.785+0000 7fcdb6da1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb0137bc0 con 0x7fcdb0138790 2023-09-30T22:25:31.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.785+0000 7fcdb6da1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb006eaa0 con 0x7fcdb006a770 2023-09-30T22:25:31.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.785+0000 7fcdb5d9f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcdb006a770 0x7fcdb01347e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.785+0000 7fcdb5d9f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcdb006a770 0x7fcdb01347e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56154/0 (socket says 172.21.15.156:56154) 2023-09-30T22:25:31.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.785+0000 7fcdb5d9f700 1 -- 172.21.15.156:0/4180048267 learned_addr learned my addr 172.21.15.156:0/4180048267 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:31.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.785+0000 7fcdb559e700 1 --2- 172.21.15.156:0/4180048267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdb0130c30 0x7fcdb0134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.787 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.785+0000 7fcdb65a0700 1 --2- 172.21.15.156:0/4180048267 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcdb0138790 0x7fcdb0135260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.786+0000 7fcdb5d9f700 1 -- 172.21.15.156:0/4180048267 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcdb0138790 msgr2=0x7fcdb0135260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.786+0000 7fcdb5d9f700 1 --2- 172.21.15.156:0/4180048267 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcdb0138790 0x7fcdb0135260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.786+0000 7fcdb5d9f700 1 -- 172.21.15.156:0/4180048267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdb0130c30 msgr2=0x7fcdb0134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.786+0000 7fcdb5d9f700 1 --2- 172.21.15.156:0/4180048267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdb0130c30 0x7fcdb0134d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.786+0000 7fcdb5d9f700 1 -- 172.21.15.156:0/4180048267 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda00094a0 con 0x7fcdb006a770 2023-09-30T22:25:31.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.786+0000 7fcdb65a0700 1 --2- 172.21.15.156:0/4180048267 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcdb0138790 0x7fcdb0135260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:31.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.786+0000 7fcdb5d9f700 1 --2- 172.21.15.156:0/4180048267 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcdb006a770 0x7fcdb01347e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fcdac00c520 tx=0x7fcdac00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:31.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.786+0000 7fcda67fc700 1 -- 172.21.15.156:0/4180048267 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac005d70 con 0x7fcdb006a770 2023-09-30T22:25:31.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.786+0000 7fcda67fc700 1 -- 172.21.15.156:0/4180048267 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdac0070d0 con 0x7fcdb006a770 2023-09-30T22:25:31.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.786+0000 7fcda67fc700 1 -- 172.21.15.156:0/4180048267 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac007440 con 0x7fcdb006a770 2023-09-30T22:25:31.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.786+0000 7fcdb6da1700 1 -- 172.21.15.156:0/4180048267 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb0138160 con 0x7fcdb006a770 2023-09-30T22:25:31.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.786+0000 7fcdb6da1700 1 -- 172.21.15.156:0/4180048267 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb01363c0 con 0x7fcdb006a770 2023-09-30T22:25:31.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.788+0000 7fcdb6da1700 1 -- 172.21.15.156:0/4180048267 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb004f2a0 con 0x7fcdb006a770 2023-09-30T22:25:31.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.788+0000 7fcda67fc700 1 -- 172.21.15.156:0/4180048267 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcdac0075a0 con 0x7fcdb006a770 2023-09-30T22:25:31.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.788+0000 7fcda67fc700 1 -- 172.21.15.156:0/4180048267 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcdac03e870 con 0x7fcdb006a770 2023-09-30T22:25:31.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.794+0000 7fcda67fc700 1 -- 172.21.15.156:0/4180048267 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcdac01b3b0 con 0x7fcdb006a770 2023-09-30T22:25:31.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.859+0000 7f007b4e9700 1 Processor -- start 2023-09-30T22:25:31.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.859+0000 7f007b4e9700 1 -- start start 2023-09-30T22:25:31.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.860+0000 7f007b4e9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f007409e340 0x7f00741359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.860 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.860+0000 7f007b4e9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0074135f20 0x7f0074138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.860+0000 7f007b4e9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f007409aaa0 con 0x7f007409d860 2023-09-30T22:25:31.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.860+0000 7f007b4e9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007409e730 con 0x7f007409e340 2023-09-30T22:25:31.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.860+0000 7f007b4e9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f007409f870 con 0x7f0074135f20 2023-09-30T22:25:31.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.860+0000 7f0078a84700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f007409e340 0x7f00741359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.860+0000 7f0078a84700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f007409e340 0x7f00741359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51078/0 (socket says 172.21.15.156:51078) 2023-09-30T22:25:31.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.860+0000 7f0078a84700 1 -- 172.21.15.156:0/903592945 learned_addr learned my addr 172.21.15.156:0/903592945 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:31.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.860+0000 7f0079a86700 1 --2- 172.21.15.156:0/903592945 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0074135f20 0x7f0074138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.860+0000 7f0078a84700 1 -- 172.21.15.156:0/903592945 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0074135f20 msgr2=0x7f0074138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:31.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.860+0000 7f0078a84700 1 --2- 172.21.15.156:0/903592945 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0074135f20 0x7f0074138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.860+0000 7f0078a84700 1 -- 172.21.15.156:0/903592945 >> v1:172.21.15.156:6789/0 conn(0x7f007409d860 legacy=0x7f007409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.860+0000 7f0078a84700 1 -- 172.21.15.156:0/903592945 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007409b360 con 0x7f007409e340 2023-09-30T22:25:31.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.860+0000 7f0078a84700 1 --2- 172.21.15.156:0/903592945 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f007409e340 0x7f00741359e0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f0064009920 tx=0x7f0064009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1844a7542578f679 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:31.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.861+0000 7f006bfff700 1 -- 172.21.15.156:0/903592945 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0064011830 con 0x7f007409e340 2023-09-30T22:25:31.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.861+0000 7f006bfff700 1 -- 172.21.15.156:0/903592945 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0064011990 con 0x7f007409e340 2023-09-30T22:25:31.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.861+0000 7f006bfff700 1 -- 172.21.15.156:0/903592945 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0064011d20 con 0x7f007409e340 2023-09-30T22:25:31.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.861+0000 7f007b4e9700 1 -- 172.21.15.156:0/903592945 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f007409e340 msgr2=0x7f00741359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.861+0000 7f007b4e9700 1 --2- 172.21.15.156:0/903592945 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f007409e340 0x7f00741359e0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f0064009920 tx=0x7f0064009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:31.863 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.861+0000 7f007b4e9700 1 -- 172.21.15.156:0/903592945 shutdown_connections 2023-09-30T22:25:31.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.861+0000 7f007b4e9700 1 --2- 172.21.15.156:0/903592945 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0074135f20 0x7f0074138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.861+0000 7f007b4e9700 1 --2- 172.21.15.156:0/903592945 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f007409e340 0x7f00741359e0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.861+0000 7f007b4e9700 1 -- 172.21.15.156:0/903592945 >> 172.21.15.156:0/903592945 conn(0x7f0074099c40 msgr2=0x7f00740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:31.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.862+0000 7f007b4e9700 1 -- 172.21.15.156:0/903592945 shutdown_connections 2023-09-30T22:25:31.864 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.862+0000 7f007b4e9700 1 -- 172.21.15.156:0/903592945 wait complete. 2023-09-30T22:25:31.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.862+0000 7f007b4e9700 1 Processor -- start 2023-09-30T22:25:31.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.863+0000 7f007b4e9700 1 -- start start 2023-09-30T22:25:31.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.863+0000 7f007b4e9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f007409d860 0x7f00741340a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.863+0000 7f007b4e9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f007409e340 0x7f00741345e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.863+0000 7f007b4e9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0074135f20 0x7f0074134b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.863+0000 7f007b4e9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007411aa00 con 0x7f007409d860 2023-09-30T22:25:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.863+0000 7f007b4e9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007411da00 con 0x7f0074135f20 2023-09-30T22:25:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.863+0000 7f007b4e9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f007413b460 con 0x7f007409e340 2023-09-30T22:25:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.863+0000 7f0079a86700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0074135f20 0x7f0074134b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.863+0000 7f0079a86700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0074135f20 0x7f0074134b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51084/0 (socket says 172.21.15.156:51084) 2023-09-30T22:25:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.863+0000 7f0079a86700 1 -- 172.21.15.156:0/694508038 learned_addr learned my addr 172.21.15.156:0/694508038 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.863+0000 7f0079285700 1 --2- 172.21.15.156:0/694508038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f007409d860 0x7f00741340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.863+0000 7f0079a86700 1 -- 172.21.15.156:0/694508038 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f007409e340 msgr2=0x7f00741345e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.864+0000 7f0078a84700 1 --2- 172.21.15.156:0/694508038 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f007409e340 0x7f00741345e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.864+0000 7f0079a86700 1 --2- 172.21.15.156:0/694508038 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f007409e340 0x7f00741345e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.864+0000 7f0079a86700 1 -- 172.21.15.156:0/694508038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f007409d860 msgr2=0x7f00741340a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.864+0000 7f0079a86700 1 --2- 172.21.15.156:0/694508038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f007409d860 0x7f00741340a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.864+0000 7f0079a86700 1 -- 172.21.15.156:0/694508038 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0064009550 con 0x7f0074135f20 2023-09-30T22:25:31.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.864+0000 7f0079285700 1 --2- 172.21.15.156:0/694508038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f007409d860 0x7f00741340a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:31.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.864+0000 7f0078a84700 1 --2- 172.21.15.156:0/694508038 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f007409e340 0x7f00741345e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:31.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.864+0000 7f0079a86700 1 --2- 172.21.15.156:0/694508038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0074135f20 0x7f0074134b20 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f006c00efc0 tx=0x7f006c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:31.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.864+0000 7f0069ffb700 1 -- 172.21.15.156:0/694508038 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c009ea0 con 0x7f0074135f20 2023-09-30T22:25:31.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.864+0000 7f0069ffb700 1 -- 172.21.15.156:0/694508038 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c00f040 con 0x7f0074135f20 2023-09-30T22:25:31.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.864+0000 7f0069ffb700 1 -- 172.21.15.156:0/694508038 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c014480 con 0x7f0074135f20 2023-09-30T22:25:31.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.864+0000 7f007b4e9700 1 -- 172.21.15.156:0/694508038 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007409c8b0 con 0x7f0074135f20 2023-09-30T22:25:31.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.864+0000 7f007b4e9700 1 -- 172.21.15.156:0/694508038 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007411cd60 con 0x7f0074135f20 2023-09-30T22:25:31.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.865+0000 7f0069ffb700 1 -- 172.21.15.156:0/694508038 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f006c0145e0 con 0x7f0074135f20 2023-09-30T22:25:31.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.866+0000 7f0069ffb700 1 -- 172.21.15.156:0/694508038 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f006c040290 con 0x7f0074135f20 2023-09-30T22:25:31.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.866+0000 7f007b4e9700 1 -- 172.21.15.156:0/694508038 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f007411c9b0 con 0x7f0074135f20 2023-09-30T22:25:31.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.875+0000 7f0069ffb700 1 -- 172.21.15.156:0/694508038 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f006c007920 con 0x7f0074135f20 2023-09-30T22:25:31.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.903+0000 7fb6e54c1700 1 Processor -- start 2023-09-30T22:25:31.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.903+0000 7fb6e54c1700 1 -- start start 2023-09-30T22:25:31.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.904+0000 7fb6e54c1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb6e00a1550 0x7fb6e0138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.904+0000 7fb6e54c1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6e0139200 0x7fb6e013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.904+0000 7fb6e54c1700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6e009e9d0 con 0x7fb6e00a0a70 2023-09-30T22:25:31.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.904+0000 7fb6e54c1700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6e009dc00 con 0x7fb6e00a1550 2023-09-30T22:25:31.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.904+0000 7fb6e54c1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e009dec0 con 0x7fb6e0139200 2023-09-30T22:25:31.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.904+0000 7fb6df7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6e0139200 0x7fb6e013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.904+0000 7fb6de7fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb6e00a1550 0x7fb6e0138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.904+0000 7fb6df7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6e0139200 0x7fb6e013b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51088/0 (socket says 172.21.15.156:51088) 2023-09-30T22:25:31.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.904+0000 7fb6df7fe700 1 -- 172.21.15.156:0/4267751193 learned_addr learned my addr 172.21.15.156:0/4267751193 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:31.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.905+0000 7fb6de7fc700 1 -- 172.21.15.156:0/4267751193 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6e0139200 msgr2=0x7fb6e013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:31.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.905+0000 7fb6de7fc700 1 --2- 172.21.15.156:0/4267751193 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6e0139200 0x7fb6e013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.905+0000 7fb6de7fc700 1 -- 172.21.15.156:0/4267751193 >> v1:172.21.15.156:6789/0 conn(0x7fb6e00a0a70 legacy=0x7fb6e00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:31.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.905+0000 7fb6de7fc700 1 -- 172.21.15.156:0/4267751193 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e009e6a0 con 0x7fb6e00a1550 2023-09-30T22:25:31.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.905+0000 7fb6df7fe700 1 --2- 172.21.15.156:0/4267751193 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6e0139200 0x7fb6e013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:31.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.905+0000 7fb6de7fc700 1 --2- 172.21.15.156:0/4267751193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6e00a1550 0x7fb6e0138cc0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4009840 tx=0x7fb6d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df5fa9b78583acce server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:31.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.905+0000 7fb6ddffb700 1 -- 172.21.15.156:0/4267751193 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d4004230 con 0x7fb6e00a1550 2023-09-30T22:25:31.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.905+0000 7fb6ddffb700 1 -- 172.21.15.156:0/4267751193 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d4004390 con 0x7fb6e00a1550 2023-09-30T22:25:31.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.905+0000 7fb6ddffb700 1 -- 172.21.15.156:0/4267751193 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d40036a0 con 0x7fb6e00a1550 2023-09-30T22:25:31.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.906+0000 7fb6e54c1700 1 -- 172.21.15.156:0/4267751193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6e00a1550 msgr2=0x7fb6e0138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.906+0000 7fb6e54c1700 1 --2- 172.21.15.156:0/4267751193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6e00a1550 0x7fb6e0138cc0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4009840 tx=0x7fb6d4009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:31.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.906+0000 7fb6e54c1700 1 -- 172.21.15.156:0/4267751193 shutdown_connections 2023-09-30T22:25:31.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.906+0000 7fb6e54c1700 1 --2- 172.21.15.156:0/4267751193 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6e0139200 0x7fb6e013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.906+0000 7fb6e54c1700 1 --2- 172.21.15.156:0/4267751193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6e00a1550 0x7fb6e0138cc0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.906+0000 7fb6e54c1700 1 -- 172.21.15.156:0/4267751193 >> 172.21.15.156:0/4267751193 conn(0x7fb6e00a6610 msgr2=0x7fb6e00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:31.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.906+0000 7fb6e54c1700 1 -- 172.21.15.156:0/4267751193 shutdown_connections 2023-09-30T22:25:31.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.906+0000 7fb6e54c1700 1 -- 172.21.15.156:0/4267751193 wait complete. 2023-09-30T22:25:31.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.907+0000 7fb6e54c1700 1 Processor -- start 2023-09-30T22:25:31.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.907+0000 7fb6e54c1700 1 -- start start 2023-09-30T22:25:31.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.907+0000 7fb6e54c1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6e00a0a70 0x7fb6e01c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.907+0000 7fb6e54c1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb6e00a1550 0x7fb6e01c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.907+0000 7fb6e54c1700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6e0139200 0x7fb6e01c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.907+0000 7fb6e54c1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e0124ac0 con 0x7fb6e00a0a70 2023-09-30T22:25:31.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.907+0000 7fb6e54c1700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e01248d0 con 0x7fb6e0139200 2023-09-30T22:25:31.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.907+0000 7fb6e54c1700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e00a0410 con 0x7fb6e00a1550 2023-09-30T22:25:31.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.907+0000 7fa5d131e700 1 Processor -- start 2023-09-30T22:25:31.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.908+0000 7fa5d131e700 1 -- start start 2023-09-30T22:25:31.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.907+0000 7fb6deffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6e00a0a70 0x7fb6e01c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.907+0000 7fb6deffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6e00a0a70 0x7fb6e01c8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34152/0 (socket says 172.21.15.156:34152) 2023-09-30T22:25:31.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.907+0000 7fb6deffd700 1 -- 172.21.15.156:0/985260585 learned_addr learned my addr 172.21.15.156:0/985260585 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:31.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.907+0000 7fb6de7fc700 1 --2- 172.21.15.156:0/985260585 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb6e00a1550 0x7fb6e01c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.908+0000 7fb6df7fe700 1 --2- 172.21.15.156:0/985260585 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6e0139200 0x7fb6e01c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.908+0000 7fb6deffd700 1 -- 172.21.15.156:0/985260585 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb6e00a1550 msgr2=0x7fb6e01c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.908+0000 7fb6deffd700 1 --2- 172.21.15.156:0/985260585 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb6e00a1550 0x7fb6e01c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.908+0000 7fb6deffd700 1 -- 172.21.15.156:0/985260585 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6e0139200 msgr2=0x7fb6e01c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.908+0000 7fb6deffd700 1 --2- 172.21.15.156:0/985260585 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6e0139200 0x7fb6e01c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.908+0000 7fb6deffd700 1 -- 172.21.15.156:0/985260585 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d8009b30 con 0x7fb6e00a0a70 2023-09-30T22:25:31.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.908+0000 7fb6deffd700 1 --2- 172.21.15.156:0/985260585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6e00a0a70 0x7fb6e01c8600 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fb6d000c4a0 tx=0x7fb6d000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:31.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.908+0000 7fa5d131e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa5cc133a70 0x7fa5cc133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.908+0000 7fb6c77fe700 1 -- 172.21.15.156:0/985260585 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d00054e0 con 0x7fb6e00a0a70 2023-09-30T22:25:31.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.909+0000 7fb6e54c1700 1 -- 172.21.15.156:0/985260585 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d40094a0 con 0x7fb6e00a0a70 2023-09-30T22:25:31.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.908+0000 7fa5d131e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5cc0a08e0 0x7fa5cc0a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.908+0000 7fa5d131e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa5cc0a1290 0x7fa5cc13a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.908+0000 7fa5d131e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5cc133640 con 0x7fa5cc133a70 2023-09-30T22:25:31.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.908+0000 7fa5d131e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc0a1d50 con 0x7fa5cc0a08e0 2023-09-30T22:25:31.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.908+0000 7fa5d131e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc0a1710 con 0x7fa5cc0a1290 2023-09-30T22:25:31.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.908+0000 7fa5caffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa5cc133a70 0x7fa5cc133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.908+0000 7fa5caffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa5cc133a70 0x7fa5cc133e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34156/0 (socket says 172.21.15.156:34156) 2023-09-30T22:25:31.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.908+0000 7fa5caffd700 1 -- 172.21.15.156:0/2970307843 learned_addr learned my addr 172.21.15.156:0/2970307843 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:31.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.908+0000 7fa5ca7fc700 1 --2- 172.21.15.156:0/2970307843 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5cc0a08e0 0x7fa5cc0a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.909+0000 7fa5cb7fe700 1 --2- 172.21.15.156:0/2970307843 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa5cc0a1290 0x7fa5cc13a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.909+0000 7fa5caffd700 1 -- 172.21.15.156:0/2970307843 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa5cc0a1290 msgr2=0x7fa5cc13a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:31.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.909+0000 7fa5caffd700 1 --2- 172.21.15.156:0/2970307843 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa5cc0a1290 0x7fa5cc13a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.909+0000 7fa5caffd700 1 -- 172.21.15.156:0/2970307843 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5cc0a08e0 msgr2=0x7fa5cc0a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:31.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.909+0000 7fa5caffd700 1 --2- 172.21.15.156:0/2970307843 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5cc0a08e0 0x7fa5cc0a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.909+0000 7fa5caffd700 1 -- 172.21.15.156:0/2970307843 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5cc09b620 con 0x7fa5cc133a70 2023-09-30T22:25:31.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.909+0000 7fb6e54c1700 1 -- 172.21.15.156:0/985260585 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e0126500 con 0x7fb6e00a0a70 2023-09-30T22:25:31.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.909+0000 7fa5caffd700 1 --2- 172.21.15.156:0/2970307843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5cc133a70 0x7fa5cc133e40 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc006fd0 tx=0x7fa5bc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67ec8ac815a05ee server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:31.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.909+0000 7fb6c77fe700 1 -- 172.21.15.156:0/985260585 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d00011e0 con 0x7fb6e00a0a70 2023-09-30T22:25:31.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.909+0000 7fb6c77fe700 1 -- 172.21.15.156:0/985260585 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d0003880 con 0x7fb6e00a0a70 2023-09-30T22:25:31.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.910+0000 7fb6c77fe700 1 -- 172.21.15.156:0/985260585 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb6d00039e0 con 0x7fb6e00a0a70 2023-09-30T22:25:31.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.910+0000 7fb6c77fe700 1 -- 172.21.15.156:0/985260585 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb6d003eb90 con 0x7fb6e00a0a70 2023-09-30T22:25:31.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.910+0000 7fb6e54c1700 1 -- 172.21.15.156:0/985260585 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c00052e0 con 0x7fb6e00a0a70 2023-09-30T22:25:31.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.910+0000 7fa5c9ffb700 1 -- 172.21.15.156:0/2970307843 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc005e30 con 0x7fa5cc133a70 2023-09-30T22:25:31.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.910+0000 7fa5c9ffb700 1 -- 172.21.15.156:0/2970307843 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5bc004030 con 0x7fa5cc133a70 2023-09-30T22:25:31.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.910+0000 7fa5c9ffb700 1 -- 172.21.15.156:0/2970307843 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc0043a0 con 0x7fa5cc133a70 2023-09-30T22:25:31.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.911+0000 7fa5d131e700 1 -- 172.21.15.156:0/2970307843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5cc133a70 msgr2=0x7fa5cc133e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.919 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.911+0000 7fa5d131e700 1 --2- 172.21.15.156:0/2970307843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5cc133a70 0x7fa5cc133e40 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc006fd0 tx=0x7fa5bc009bd0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.911+0000 7fa5d131e700 1 -- 172.21.15.156:0/2970307843 shutdown_connections 2023-09-30T22:25:31.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.911+0000 7fa5d131e700 1 --2- 172.21.15.156:0/2970307843 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa5cc0a1290 0x7fa5cc13a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.911+0000 7fa5d131e700 1 --2- 172.21.15.156:0/2970307843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5cc133a70 0x7fa5cc133e40 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.911+0000 7fa5d131e700 1 --2- 172.21.15.156:0/2970307843 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5cc0a08e0 0x7fa5cc0a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.911+0000 7fa5d131e700 1 -- 172.21.15.156:0/2970307843 >> 172.21.15.156:0/2970307843 conn(0x7fa5cc0a2980 msgr2=0x7fa5cc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:31.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.911+0000 7fa5d131e700 1 -- 172.21.15.156:0/2970307843 shutdown_connections 2023-09-30T22:25:31.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.911+0000 7fa5d131e700 1 -- 172.21.15.156:0/2970307843 wait complete. 2023-09-30T22:25:31.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.912+0000 7fa5d131e700 1 Processor -- start 2023-09-30T22:25:31.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.912+0000 7fa5d131e700 1 -- start start 2023-09-30T22:25:31.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.913+0000 7fa5d131e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa5cc0a08e0 0x7fa5cc11f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.920 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.913+0000 7fa5d131e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5cc0a1290 0x7fa5cc11ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.913+0000 7fa5d131e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5cc133a70 0x7fa5cc120460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.913+0000 7fa5d131e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc1227b0 con 0x7fa5cc0a1290 2023-09-30T22:25:31.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.913+0000 7fa5d131e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc1216e0 con 0x7fa5cc133a70 2023-09-30T22:25:31.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.913+0000 7fa5d131e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc1223f0 con 0x7fa5cc0a08e0 2023-09-30T22:25:31.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.913+0000 7fa5caffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa5cc0a08e0 0x7fa5cc11f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.913+0000 7fa5caffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa5cc0a08e0 0x7fa5cc11f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56204/0 (socket says 172.21.15.156:56204) 2023-09-30T22:25:31.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.913+0000 7fa5caffd700 1 -- 172.21.15.156:0/3615517641 learned_addr learned my addr 172.21.15.156:0/3615517641 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:31.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.913+0000 7fa5cb7fe700 1 --2- 172.21.15.156:0/3615517641 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5cc133a70 0x7fa5cc120460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.913+0000 7fa5caffd700 1 -- 172.21.15.156:0/3615517641 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5cc133a70 msgr2=0x7fa5cc120460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.913+0000 7fa5caffd700 1 --2- 172.21.15.156:0/3615517641 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5cc133a70 0x7fa5cc120460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.913+0000 7fa5caffd700 1 -- 172.21.15.156:0/3615517641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5cc0a1290 msgr2=0x7fa5cc11ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.913+0000 7fa5caffd700 1 --2- 172.21.15.156:0/3615517641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5cc0a1290 0x7fa5cc11ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.913+0000 7fa5caffd700 1 -- 172.21.15.156:0/3615517641 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc009500 con 0x7fa5cc0a08e0 2023-09-30T22:25:31.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.914+0000 7fa5caffd700 1 --2- 172.21.15.156:0/3615517641 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa5cc0a08e0 0x7fa5cc11f9e0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc009130 tx=0x7fa5bc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:31.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.914+0000 7fa5b37fe700 1 -- 172.21.15.156:0/3615517641 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc011420 con 0x7fa5cc0a08e0 2023-09-30T22:25:31.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.914+0000 7fa5b37fe700 1 -- 172.21.15.156:0/3615517641 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5bc0115a0 con 0x7fa5cc0a08e0 2023-09-30T22:25:31.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.914+0000 7fa5d131e700 1 -- 172.21.15.156:0/3615517641 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5cc09a350 con 0x7fa5cc0a08e0 2023-09-30T22:25:31.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.914+0000 7fa5b37fe700 1 -- 172.21.15.156:0/3615517641 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc011950 con 0x7fa5cc0a08e0 2023-09-30T22:25:31.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.914+0000 7fa5d131e700 1 -- 172.21.15.156:0/3615517641 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5cc123190 con 0x7fa5cc0a08e0 2023-09-30T22:25:31.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.915+0000 7fa5b37fe700 1 -- 172.21.15.156:0/3615517641 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa5bc011ab0 con 0x7fa5cc0a08e0 2023-09-30T22:25:31.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.915+0000 7fa5b37fe700 1 -- 172.21.15.156:0/3615517641 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa5bc0407c0 con 0x7fa5cc0a08e0 2023-09-30T22:25:31.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.915+0000 7fa5d131e700 1 -- 172.21.15.156:0/3615517641 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5cc04f2a0 con 0x7fa5cc0a08e0 2023-09-30T22:25:31.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.919+0000 7fb6c77fe700 1 -- 172.21.15.156:0/985260585 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb6d0017070 con 0x7fb6e00a0a70 2023-09-30T22:25:31.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:31.919+0000 7fa5b37fe700 1 -- 172.21.15.156:0/3615517641 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa5bc020080 con 0x7fa5cc0a08e0 2023-09-30T22:25:32.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.006+0000 7fcdb6da1700 1 -- 172.21.15.156:0/4180048267 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcdb0137d80 con 0x7fcdb006a770 2023-09-30T22:25:32.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.006+0000 7fcda67fc700 1 -- 172.21.15.156:0/4180048267 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcdac017030 con 0x7fcdb006a770 2023-09-30T22:25:32.007 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:32.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.008+0000 7fcdb6da1700 1 -- 172.21.15.156:0/4180048267 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcdb006a770 msgr2=0x7fcdb01347e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:32.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.009+0000 7fcdb6da1700 1 --2- 172.21.15.156:0/4180048267 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcdb006a770 0x7fcdb01347e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fcdac00c520 tx=0x7fcdac00c830 comp rx=0 tx=0).stop 2023-09-30T22:25:32.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.009+0000 7fcdb6da1700 1 -- 172.21.15.156:0/4180048267 shutdown_connections 2023-09-30T22:25:32.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.009+0000 7fcdb6da1700 1 --2- 172.21.15.156:0/4180048267 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcdb0138790 0x7fcdb0135260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.009+0000 7fcdb6da1700 1 --2- 172.21.15.156:0/4180048267 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fcdb006a770 0x7fcdb01347e0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.009+0000 7fcdb6da1700 1 --2- 172.21.15.156:0/4180048267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdb0130c30 0x7fcdb0134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.009+0000 7fcdb6da1700 1 -- 172.21.15.156:0/4180048267 >> 172.21.15.156:0/4180048267 conn(0x7fcdb00a2d80 msgr2=0x7fcdb009f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:32.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.009+0000 7fcdb6da1700 1 -- 172.21.15.156:0/4180048267 shutdown_connections 2023-09-30T22:25:32.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.009+0000 7fcdb6da1700 1 -- 172.21.15.156:0/4180048267 wait complete. 2023-09-30T22:25:32.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:32.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.075+0000 7f007b4e9700 1 -- 172.21.15.156:0/694508038 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f007404f2a0 con 0x7f0074135f20 2023-09-30T22:25:32.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.075+0000 7f0069ffb700 1 -- 172.21.15.156:0/694508038 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f006c02c090 con 0x7f0074135f20 2023-09-30T22:25:32.076 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:32.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.078+0000 7f007b4e9700 1 -- 172.21.15.156:0/694508038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0074135f20 msgr2=0x7f0074134b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:32.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.078+0000 7f007b4e9700 1 --2- 172.21.15.156:0/694508038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0074135f20 0x7f0074134b20 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f006c00efc0 tx=0x7f006c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.078+0000 7f007b4e9700 1 -- 172.21.15.156:0/694508038 shutdown_connections 2023-09-30T22:25:32.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.078+0000 7f007b4e9700 1 --2- 172.21.15.156:0/694508038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0074135f20 0x7f0074134b20 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.078+0000 7f007b4e9700 1 --2- 172.21.15.156:0/694508038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f007409d860 0x7f00741340a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.078+0000 7f007b4e9700 1 --2- 172.21.15.156:0/694508038 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f007409e340 0x7f00741345e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.078+0000 7f007b4e9700 1 -- 172.21.15.156:0/694508038 >> 172.21.15.156:0/694508038 conn(0x7f0074099c40 msgr2=0x7f00740a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:32.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.078+0000 7f007b4e9700 1 -- 172.21.15.156:0/694508038 shutdown_connections 2023-09-30T22:25:32.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.078+0000 7f007b4e9700 1 -- 172.21.15.156:0/694508038 wait complete. 2023-09-30T22:25:32.091 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:32.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.134+0000 7fa5d131e700 1 -- 172.21.15.156:0/3615517641 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa5cc06bce0 con 0x7fa5cc0a08e0 2023-09-30T22:25:32.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.134+0000 7fa5b37fe700 1 -- 172.21.15.156:0/3615517641 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa5bc016020 con 0x7fa5cc0a08e0 2023-09-30T22:25:32.135 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:32.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.134+0000 7fb6e54c1700 1 -- 172.21.15.156:0/985260585 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb6c0005590 con 0x7fb6e00a0a70 2023-09-30T22:25:32.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.135+0000 7fb6c77fe700 1 -- 172.21.15.156:0/985260585 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb6d0010770 con 0x7fb6e00a0a70 2023-09-30T22:25:32.136 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:32.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.137+0000 7fa5d131e700 1 -- 172.21.15.156:0/3615517641 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa5cc0a08e0 msgr2=0x7fa5cc11f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:32.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.137+0000 7fa5d131e700 1 --2- 172.21.15.156:0/3615517641 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa5cc0a08e0 0x7fa5cc11f9e0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc009130 tx=0x7fa5bc004750 comp rx=0 tx=0).stop 2023-09-30T22:25:32.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.137+0000 7fb6e54c1700 1 -- 172.21.15.156:0/985260585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6e00a0a70 msgr2=0x7fb6e01c8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:32.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.137+0000 7fb6e54c1700 1 --2- 172.21.15.156:0/985260585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6e00a0a70 0x7fb6e01c8600 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fb6d000c4a0 tx=0x7fb6d000c7b0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.137+0000 7fa5d131e700 1 -- 172.21.15.156:0/3615517641 shutdown_connections 2023-09-30T22:25:32.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.137+0000 7fa5d131e700 1 --2- 172.21.15.156:0/3615517641 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5cc133a70 0x7fa5cc120460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.137+0000 7fa5d131e700 1 --2- 172.21.15.156:0/3615517641 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fa5cc0a08e0 0x7fa5cc11f9e0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.137+0000 7fa5d131e700 1 --2- 172.21.15.156:0/3615517641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5cc0a1290 0x7fa5cc11ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.137+0000 7fa5d131e700 1 -- 172.21.15.156:0/3615517641 >> 172.21.15.156:0/3615517641 conn(0x7fa5cc0a2980 msgr2=0x7fa5cc09e220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:32.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.137+0000 7fb6e54c1700 1 -- 172.21.15.156:0/985260585 shutdown_connections 2023-09-30T22:25:32.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.137+0000 7fb6e54c1700 1 --2- 172.21.15.156:0/985260585 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb6e0139200 0x7fb6e01c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.137+0000 7fb6e54c1700 1 --2- 172.21.15.156:0/985260585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6e00a0a70 0x7fb6e01c8600 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.137+0000 7fb6e54c1700 1 --2- 172.21.15.156:0/985260585 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb6e00a1550 0x7fb6e01c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.137+0000 7fb6e54c1700 1 -- 172.21.15.156:0/985260585 >> 172.21.15.156:0/985260585 conn(0x7fb6e00a6610 msgr2=0x7fb6e009bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:32.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.137+0000 7fb6e54c1700 1 -- 172.21.15.156:0/985260585 shutdown_connections 2023-09-30T22:25:32.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.137+0000 7fb6e54c1700 1 -- 172.21.15.156:0/985260585 wait complete. 2023-09-30T22:25:32.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.137+0000 7fa5d131e700 1 -- 172.21.15.156:0/3615517641 shutdown_connections 2023-09-30T22:25:32.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:32.137+0000 7fa5d131e700 1 -- 172.21.15.156:0/3615517641 wait complete. 2023-09-30T22:25:32.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:32.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:33.023 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:33.092 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:33.153 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:33.153 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:33.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.165+0000 7f8189769700 1 Processor -- start 2023-09-30T22:25:33.165 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.165+0000 7f8189769700 1 -- start start 2023-09-30T22:25:33.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.165+0000 7f8189769700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f818406a770 0x7f81841349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.165+0000 7f8189769700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8184134f00 0x7f818409d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.165+0000 7f8189769700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818409eca0 con 0x7f818409dea0 2023-09-30T22:25:33.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.165+0000 7f8189769700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818406b2e0 con 0x7f818406a770 2023-09-30T22:25:33.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.165+0000 7f8189769700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f818409f720 con 0x7f8184134f00 2023-09-30T22:25:33.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.166+0000 7f81827fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8184134f00 0x7f818409d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.166+0000 7f8182ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f818406a770 0x7f81841349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.166+0000 7f81827fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8184134f00 0x7f818409d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56218/0 (socket says 172.21.15.156:56218) 2023-09-30T22:25:33.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.166+0000 7f81827fc700 1 -- 172.21.15.156:0/4098010868 learned_addr learned my addr 172.21.15.156:0/4098010868 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:33.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.166+0000 7f81827fc700 1 -- 172.21.15.156:0/4098010868 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f818406a770 msgr2=0x7f81841349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:33.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.166+0000 7f81827fc700 1 --2- 172.21.15.156:0/4098010868 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f818406a770 0x7f81841349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.166+0000 7f81827fc700 1 -- 172.21.15.156:0/4098010868 >> v1:172.21.15.156:6789/0 conn(0x7f818409dea0 legacy=0x7f818413ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.166+0000 7f81827fc700 1 -- 172.21.15.156:0/4098010868 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818406b480 con 0x7f8184134f00 2023-09-30T22:25:33.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.166+0000 7f81827fc700 1 --2- 172.21.15.156:0/4098010868 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8184134f00 0x7f818409d960 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f8178009920 tx=0x7f8178009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b20ad756035604ad server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:33.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.166+0000 7f8181ffb700 1 -- 172.21.15.156:0/4098010868 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8178011830 con 0x7f8184134f00 2023-09-30T22:25:33.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.166+0000 7f8181ffb700 1 -- 172.21.15.156:0/4098010868 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8178011990 con 0x7f8184134f00 2023-09-30T22:25:33.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.166+0000 7f8181ffb700 1 -- 172.21.15.156:0/4098010868 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8178011d20 con 0x7f8184134f00 2023-09-30T22:25:33.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.167+0000 7f8189769700 1 -- 172.21.15.156:0/4098010868 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8184134f00 msgr2=0x7f818409d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.167+0000 7f8189769700 1 --2- 172.21.15.156:0/4098010868 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8184134f00 0x7f818409d960 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f8178009920 tx=0x7f8178009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:33.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.167+0000 7f8189769700 1 -- 172.21.15.156:0/4098010868 shutdown_connections 2023-09-30T22:25:33.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.167+0000 7f8189769700 1 --2- 172.21.15.156:0/4098010868 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f818406a770 0x7f81841349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.167+0000 7f8189769700 1 --2- 172.21.15.156:0/4098010868 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8184134f00 0x7f818409d960 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.167+0000 7f8189769700 1 -- 172.21.15.156:0/4098010868 >> 172.21.15.156:0/4098010868 conn(0x7f8184099c40 msgr2=0x7f81840a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:33.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.167+0000 7f8189769700 1 -- 172.21.15.156:0/4098010868 shutdown_connections 2023-09-30T22:25:33.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.167+0000 7f8189769700 1 -- 172.21.15.156:0/4098010868 wait complete. 2023-09-30T22:25:33.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.169+0000 7f8189769700 1 Processor -- start 2023-09-30T22:25:33.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.169+0000 7f8189769700 1 -- start start 2023-09-30T22:25:33.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.170+0000 7f8189769700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f818406a770 0x7f818411a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.170+0000 7f8189769700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f818409dea0 0x7f818411ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.170+0000 7f8189769700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8184134f00 0x7f818411b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.170+0000 7f8189769700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8184126d50 con 0x7f8184134f00 2023-09-30T22:25:33.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.170+0000 7f8189769700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818411c860 con 0x7f818409dea0 2023-09-30T22:25:33.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.170+0000 7f8189769700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81841340b0 con 0x7f818406a770 2023-09-30T22:25:33.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.170+0000 7f8182ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f818406a770 0x7f818411a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.170+0000 7f8182ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f818406a770 0x7f818411a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56222/0 (socket says 172.21.15.156:56222) 2023-09-30T22:25:33.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.170+0000 7f8182ffd700 1 -- 172.21.15.156:0/2591205126 learned_addr learned my addr 172.21.15.156:0/2591205126 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:33.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.170+0000 7f81837fe700 1 --2- 172.21.15.156:0/2591205126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8184134f00 0x7f818411b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.172 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.170+0000 7f81827fc700 1 --2- 172.21.15.156:0/2591205126 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f818409dea0 0x7f818411ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.170+0000 7f8182ffd700 1 -- 172.21.15.156:0/2591205126 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f818409dea0 msgr2=0x7f818411ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.170+0000 7f8182ffd700 1 --2- 172.21.15.156:0/2591205126 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f818409dea0 0x7f818411ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.170+0000 7f8182ffd700 1 -- 172.21.15.156:0/2591205126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8184134f00 msgr2=0x7f818411b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.170+0000 7f8182ffd700 1 --2- 172.21.15.156:0/2591205126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8184134f00 0x7f818411b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.170+0000 7f8182ffd700 1 -- 172.21.15.156:0/2591205126 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8178009550 con 0x7f818406a770 2023-09-30T22:25:33.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.170+0000 7f81837fe700 1 --2- 172.21.15.156:0/2591205126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8184134f00 0x7f818411b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:33.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.170+0000 7f8182ffd700 1 --2- 172.21.15.156:0/2591205126 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f818406a770 0x7f818411a950 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f817400e870 tx=0x7f817400ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:33.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.171+0000 7f816b7fe700 1 -- 172.21.15.156:0/2591205126 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8174009590 con 0x7f818406a770 2023-09-30T22:25:33.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.171+0000 7f816b7fe700 1 -- 172.21.15.156:0/2591205126 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817400ee70 con 0x7f818406a770 2023-09-30T22:25:33.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.171+0000 7f816b7fe700 1 -- 172.21.15.156:0/2591205126 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817400ca50 con 0x7f818406a770 2023-09-30T22:25:33.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.171+0000 7f8189769700 1 -- 172.21.15.156:0/2591205126 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81840a01b0 con 0x7f818406a770 2023-09-30T22:25:33.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.171+0000 7f8189769700 1 -- 172.21.15.156:0/2591205126 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f818409f220 con 0x7f818406a770 2023-09-30T22:25:33.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.172+0000 7f816b7fe700 1 -- 172.21.15.156:0/2591205126 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f817400cbb0 con 0x7f818406a770 2023-09-30T22:25:33.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.172+0000 7f816b7fe700 1 -- 172.21.15.156:0/2591205126 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f817403fab0 con 0x7f818406a770 2023-09-30T22:25:33.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.172+0000 7f8189769700 1 -- 172.21.15.156:0/2591205126 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8184126b40 con 0x7f818406a770 2023-09-30T22:25:33.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.180+0000 7f816b7fe700 1 -- 172.21.15.156:0/2591205126 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8174021080 con 0x7f818406a770 2023-09-30T22:25:33.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.226+0000 7f92c52f6700 1 Processor -- start 2023-09-30T22:25:33.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.226+0000 7f92c52f6700 1 -- start start 2023-09-30T22:25:33.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.227+0000 7f92c52f6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f92c0136960 0x7f92c0138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.227+0000 7f92c52f6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92c0139280 0x7f92c013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.227+0000 7f92c52f6700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c006b2d0 con 0x7f92c0133ad0 2023-09-30T22:25:33.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.227+0000 7f92c52f6700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c01345b0 con 0x7f92c0136960 2023-09-30T22:25:33.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.227+0000 7f92c52f6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c0133610 con 0x7f92c0139280 2023-09-30T22:25:33.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.227+0000 7f92be7fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f92c0136960 0x7f92c0138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.227+0000 7f92beffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f92c0133ad0 0x7f92c0133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:59248/0 (socket says 172.21.15.156:59248) 2023-09-30T22:25:33.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.227+0000 7f92beffd700 1 -- 172.21.15.156:0/821168308 learned_addr learned my addr 172.21.15.156:0/821168308 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:33.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.227+0000 7f92bf7fe700 1 --2- 172.21.15.156:0/821168308 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92c0139280 0x7f92c013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.227+0000 7f92be7fc700 1 -- 172.21.15.156:0/821168308 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92c0139280 msgr2=0x7f92c013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:33.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.227+0000 7f92be7fc700 1 --2- 172.21.15.156:0/821168308 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92c0139280 0x7f92c013b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.227+0000 7f92be7fc700 1 -- 172.21.15.156:0/821168308 >> v1:172.21.15.156:6789/0 conn(0x7f92c0133ad0 legacy=0x7f92c0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.227+0000 7f92be7fc700 1 -- 172.21.15.156:0/821168308 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c009a500 con 0x7f92c0136960 2023-09-30T22:25:33.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.228+0000 7f92be7fc700 1 --2- 172.21.15.156:0/821168308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92c0136960 0x7f92c0138d40 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f92b4009840 tx=0x7f92b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d3c3a24a5685d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:33.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.228+0000 7f92bdffb700 1 -- 172.21.15.156:0/821168308 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b4011830 con 0x7f92c0136960 2023-09-30T22:25:33.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.228+0000 7f92bdffb700 1 -- 172.21.15.156:0/821168308 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b4011990 con 0x7f92c0136960 2023-09-30T22:25:33.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.228+0000 7f92bdffb700 1 -- 172.21.15.156:0/821168308 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b4011d20 con 0x7f92c0136960 2023-09-30T22:25:33.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.229+0000 7f92c52f6700 1 -- 172.21.15.156:0/821168308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92c0136960 msgr2=0x7f92c0138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.229+0000 7f92c52f6700 1 --2- 172.21.15.156:0/821168308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92c0136960 0x7f92c0138d40 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f92b4009840 tx=0x7f92b4009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:33.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.229+0000 7f92c52f6700 1 -- 172.21.15.156:0/821168308 shutdown_connections 2023-09-30T22:25:33.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.229+0000 7f92c52f6700 1 --2- 172.21.15.156:0/821168308 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92c0139280 0x7f92c013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.229+0000 7f92c52f6700 1 --2- 172.21.15.156:0/821168308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92c0136960 0x7f92c0138d40 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.229+0000 7f92c52f6700 1 -- 172.21.15.156:0/821168308 >> 172.21.15.156:0/821168308 conn(0x7f92c0099c40 msgr2=0x7f92c00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:33.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.229+0000 7f92c52f6700 1 -- 172.21.15.156:0/821168308 shutdown_connections 2023-09-30T22:25:33.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.229+0000 7f92c52f6700 1 -- 172.21.15.156:0/821168308 wait complete. 2023-09-30T22:25:33.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.230+0000 7f92c52f6700 1 Processor -- start 2023-09-30T22:25:33.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.230+0000 7f92c52f6700 1 -- start start 2023-09-30T22:25:33.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.231+0000 7f92c52f6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92c0133ad0 0x7f92c012cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.231+0000 7f92c52f6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92c0136960 0x7f92c012d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.231+0000 7f92c52f6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92c0139280 0x7f92c012d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.231+0000 7f92c52f6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c0072350 con 0x7f92c0136960 2023-09-30T22:25:33.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.231+0000 7f92c52f6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c0138d50 con 0x7f92c0133ad0 2023-09-30T22:25:33.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.231+0000 7f92c52f6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92c00700b0 con 0x7f92c0139280 2023-09-30T22:25:33.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.231+0000 7f92bf7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92c0139280 0x7f92c012d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.231+0000 7f92bf7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92c0139280 0x7f92c012d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56238/0 (socket says 172.21.15.156:56238) 2023-09-30T22:25:33.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.231+0000 7f92bf7fe700 1 -- 172.21.15.156:0/3025929762 learned_addr learned my addr 172.21.15.156:0/3025929762 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:33.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.231+0000 7f92be7fc700 1 --2- 172.21.15.156:0/3025929762 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92c0136960 0x7f92c012d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.232+0000 7f92beffd700 1 --2- 172.21.15.156:0/3025929762 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92c0133ad0 0x7f92c012cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.232+0000 7f92bf7fe700 1 -- 172.21.15.156:0/3025929762 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92c0133ad0 msgr2=0x7f92c012cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.232+0000 7f92bf7fe700 1 --2- 172.21.15.156:0/3025929762 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92c0133ad0 0x7f92c012cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.232+0000 7f92bf7fe700 1 -- 172.21.15.156:0/3025929762 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92c0136960 msgr2=0x7f92c012d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.232+0000 7f92bf7fe700 1 --2- 172.21.15.156:0/3025929762 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92c0136960 0x7f92c012d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.232+0000 7f92bf7fe700 1 -- 172.21.15.156:0/3025929762 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b40094a0 con 0x7f92c0139280 2023-09-30T22:25:33.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.232+0000 7f92bf7fe700 1 --2- 172.21.15.156:0/3025929762 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92c0139280 0x7f92c012d5b0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f92b8007de0 tx=0x7f92b800e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:33.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.232+0000 7f92a77fe700 1 -- 172.21.15.156:0/3025929762 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b800ed30 con 0x7f92c0139280 2023-09-30T22:25:33.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.232+0000 7f92a77fe700 1 -- 172.21.15.156:0/3025929762 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b8014420 con 0x7f92c0139280 2023-09-30T22:25:33.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.232+0000 7f92c52f6700 1 -- 172.21.15.156:0/3025929762 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c0070370 con 0x7f92c0139280 2023-09-30T22:25:33.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.232+0000 7f92a77fe700 1 -- 172.21.15.156:0/3025929762 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b80147d0 con 0x7f92c0139280 2023-09-30T22:25:33.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.232+0000 7f92c52f6700 1 -- 172.21.15.156:0/3025929762 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c006eee0 con 0x7f92c0139280 2023-09-30T22:25:33.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.233+0000 7f92a77fe700 1 -- 172.21.15.156:0/3025929762 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f92b8014930 con 0x7f92c0139280 2023-09-30T22:25:33.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.234+0000 7f92a77fe700 1 -- 172.21.15.156:0/3025929762 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f92b803fdf0 con 0x7f92c0139280 2023-09-30T22:25:33.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.234+0000 7f92c52f6700 1 -- 172.21.15.156:0/3025929762 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c006f130 con 0x7f92c0139280 2023-09-30T22:25:33.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.242+0000 7f92a77fe700 1 -- 172.21.15.156:0/3025929762 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92b8014be0 con 0x7f92c0139280 2023-09-30T22:25:33.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.296+0000 7fcaa31c3700 1 Processor -- start 2023-09-30T22:25:33.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.296+0000 7f7aa338e700 1 Processor -- start 2023-09-30T22:25:33.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.297+0000 7f7aa338e700 1 -- start start 2023-09-30T22:25:33.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.297+0000 7fcaa31c3700 1 -- start start 2023-09-30T22:25:33.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.297+0000 7f7aa338e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a9c09d860 0x7f7a9c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.297+0000 7f7aa338e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7a9c130eb0 0x7f7a9c138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.297+0000 7f7aa338e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a9c09aaa0 con 0x7f7a9c09e170 2023-09-30T22:25:33.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.297+0000 7f7aa338e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a9c09f870 con 0x7f7a9c130eb0 2023-09-30T22:25:33.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.297+0000 7f7aa338e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9c09b360 con 0x7f7a9c09d860 2023-09-30T22:25:33.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.297+0000 7f7aa112a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a9c09d860 0x7f7a9c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.297+0000 7f7aa112a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a9c09d860 0x7f7a9c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51146/0 (socket says 172.21.15.156:51146) 2023-09-30T22:25:33.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.297+0000 7f7aa112a700 1 -- 172.21.15.156:0/194589112 learned_addr learned my addr 172.21.15.156:0/194589112 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:33.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.297+0000 7fcaa31c3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca9c136960 0x7fca9c138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.297+0000 7fcaa31c3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fca9c139280 0x7fca9c13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.297+0000 7fcaa31c3700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca9c06b2d0 con 0x7fca9c133ad0 2023-09-30T22:25:33.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.297+0000 7fcaa31c3700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9c1345b0 con 0x7fca9c139280 2023-09-30T22:25:33.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.297+0000 7fcaa31c3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c133610 con 0x7fca9c136960 2023-09-30T22:25:33.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.298+0000 7fcaa1760700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fca9c139280 0x7fca9c13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.298+0000 7fcaa1760700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fca9c139280 0x7fca9c13b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34206/0 (socket says 172.21.15.156:34206) 2023-09-30T22:25:33.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.298+0000 7fcaa1760700 1 -- 172.21.15.156:0/3188991392 learned_addr learned my addr 172.21.15.156:0/3188991392 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:33.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.298+0000 7f7aa192b700 1 --2- 172.21.15.156:0/194589112 >> v2:172.21.15.156:3300/0 conn(0x7f7a9c130eb0 0x7f7a9c138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.298+0000 7fca9bfff700 1 --2- 172.21.15.156:0/3188991392 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca9c136960 0x7fca9c138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.298+0000 7fcaa1760700 1 -- 172.21.15.156:0/3188991392 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca9c136960 msgr2=0x7fca9c138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:33.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.298+0000 7fcaa1760700 1 --2- 172.21.15.156:0/3188991392 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca9c136960 0x7fca9c138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.298+0000 7fcaa1760700 1 -- 172.21.15.156:0/3188991392 >> v1:172.21.15.156:6789/0 conn(0x7fca9c133ad0 legacy=0x7fca9c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.298+0000 7fcaa1760700 1 -- 172.21.15.156:0/3188991392 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c09a500 con 0x7fca9c139280 2023-09-30T22:25:33.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.298+0000 7f7aa112a700 1 -- 172.21.15.156:0/194589112 >> v2:172.21.15.156:3300/0 conn(0x7f7a9c130eb0 msgr2=0x7f7a9c138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:33.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.298+0000 7f7aa112a700 1 --2- 172.21.15.156:0/194589112 >> v2:172.21.15.156:3300/0 conn(0x7f7a9c130eb0 0x7f7a9c138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.298+0000 7f7a93fff700 1 -- 172.21.15.156:0/194589112 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 916727941 0 0) 0x7f7a9c09aaa0 con 0x7f7a9c09e170 2023-09-30T22:25:33.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.298+0000 7f7aa112a700 1 -- 172.21.15.156:0/194589112 >> v1:172.21.15.156:6789/0 conn(0x7f7a9c09e170 legacy=0x7f7a9c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.298+0000 7f7aa112a700 1 -- 172.21.15.156:0/194589112 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a9c09b620 con 0x7f7a9c09d860 2023-09-30T22:25:33.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.298+0000 7fcaa1760700 1 --2- 172.21.15.156:0/3188991392 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca9c139280 0x7fca9c13b660 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fca94009e80 tx=0x7fca9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e33aab42b4a164f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:33.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.298+0000 7fca9b7fe700 1 -- 172.21.15.156:0/3188991392 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9400e070 con 0x7fca9c139280 2023-09-30T22:25:33.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.298+0000 7fca9b7fe700 1 -- 172.21.15.156:0/3188991392 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9400b980 con 0x7fca9c139280 2023-09-30T22:25:33.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.298+0000 7fca9b7fe700 1 -- 172.21.15.156:0/3188991392 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9400bd30 con 0x7fca9c139280 2023-09-30T22:25:33.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.298+0000 7f7aa112a700 1 --2- 172.21.15.156:0/194589112 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a9c09d860 0x7f7a9c09dc30 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f7a980098f0 tx=0x7f7a98009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=763060c96b84d839 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:33.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.299+0000 7f7a93fff700 1 -- 172.21.15.156:0/194589112 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9800f8a0 con 0x7f7a9c09d860 2023-09-30T22:25:33.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.299+0000 7f7a93fff700 1 -- 172.21.15.156:0/194589112 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9800fa00 con 0x7f7a9c09d860 2023-09-30T22:25:33.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.299+0000 7f7a93fff700 1 -- 172.21.15.156:0/194589112 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9800fd90 con 0x7f7a9c09d860 2023-09-30T22:25:33.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.299+0000 7f7aa338e700 1 -- 172.21.15.156:0/194589112 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a9c09d860 msgr2=0x7f7a9c09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.299+0000 7f7aa338e700 1 --2- 172.21.15.156:0/194589112 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a9c09d860 0x7f7a9c09dc30 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f7a980098f0 tx=0x7f7a98009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:33.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.299+0000 7fcaa31c3700 1 -- 172.21.15.156:0/3188991392 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca9c139280 msgr2=0x7fca9c13b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.299+0000 7fcaa31c3700 1 --2- 172.21.15.156:0/3188991392 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca9c139280 0x7fca9c13b660 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fca94009e80 tx=0x7fca9400b330 comp rx=0 tx=0).stop 2023-09-30T22:25:33.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.300+0000 7fcaa31c3700 1 -- 172.21.15.156:0/3188991392 shutdown_connections 2023-09-30T22:25:33.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.300+0000 7fcaa31c3700 1 --2- 172.21.15.156:0/3188991392 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca9c139280 0x7fca9c13b660 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.300+0000 7fcaa31c3700 1 --2- 172.21.15.156:0/3188991392 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca9c136960 0x7fca9c138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.300+0000 7fcaa31c3700 1 -- 172.21.15.156:0/3188991392 >> 172.21.15.156:0/3188991392 conn(0x7fca9c099c40 msgr2=0x7fca9c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:33.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.300+0000 7fcaa31c3700 1 -- 172.21.15.156:0/3188991392 shutdown_connections 2023-09-30T22:25:33.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.300+0000 7f7aa338e700 1 -- 172.21.15.156:0/194589112 shutdown_connections 2023-09-30T22:25:33.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.300+0000 7f7aa338e700 1 --2- 172.21.15.156:0/194589112 >> v2:172.21.15.156:3300/0 conn(0x7f7a9c130eb0 0x7f7a9c138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.300+0000 7f7aa338e700 1 --2- 172.21.15.156:0/194589112 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a9c09d860 0x7f7a9c09dc30 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.300+0000 7f7aa338e700 1 -- 172.21.15.156:0/194589112 >> 172.21.15.156:0/194589112 conn(0x7f7a9c099c40 msgr2=0x7f7a9c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:33.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.300+0000 7fcaa31c3700 1 -- 172.21.15.156:0/3188991392 wait complete. 2023-09-30T22:25:33.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.300+0000 7f7aa338e700 1 -- 172.21.15.156:0/194589112 shutdown_connections 2023-09-30T22:25:33.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.300+0000 7f7aa338e700 1 -- 172.21.15.156:0/194589112 wait complete. 2023-09-30T22:25:33.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.301+0000 7fcaa31c3700 1 Processor -- start 2023-09-30T22:25:33.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.301+0000 7f7aa338e700 1 Processor -- start 2023-09-30T22:25:33.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.301+0000 7f7aa338e700 1 -- start start 2023-09-30T22:25:33.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.301+0000 7fcaa31c3700 1 -- start start 2023-09-30T22:25:33.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.302+0000 7fcaa31c3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca9c133ad0 0x7fca9c12fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.302+0000 7fcaa31c3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca9c136960 0x7fca9c11bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.302+0000 7fcaa31c3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca9c139280 0x7fca9c11c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.302+0000 7fcaa31c3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c1308b0 con 0x7fca9c133ad0 2023-09-30T22:25:33.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.302+0000 7fcaa31c3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c11a280 con 0x7fca9c139280 2023-09-30T22:25:33.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.302+0000 7fcaa31c3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c09f390 con 0x7fca9c136960 2023-09-30T22:25:33.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.302+0000 7f7aa338e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a9c09d860 0x7f7a9c1226c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.302+0000 7f7aa338e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a9c09e170 0x7f7a9c122c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.302+0000 7f7aa338e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a9c130eb0 0x7f7a9c123140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.302+0000 7f7aa338e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9c1306c0 con 0x7f7a9c130eb0 2023-09-30T22:25:33.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.302+0000 7f7aa338e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9c124370 con 0x7f7a9c09e170 2023-09-30T22:25:33.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.302+0000 7f7aa338e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9c0a2190 con 0x7f7a9c09d860 2023-09-30T22:25:33.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.302+0000 7f7aa112a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a9c09d860 0x7f7a9c1226c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.302+0000 7f7aa112a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a9c09d860 0x7f7a9c1226c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56256/0 (socket says 172.21.15.156:56256) 2023-09-30T22:25:33.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.302+0000 7f7aa112a700 1 -- 172.21.15.156:0/1863924562 learned_addr learned my addr 172.21.15.156:0/1863924562 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:33.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.302+0000 7fcaa1760700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca9c139280 0x7fca9c11c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.302+0000 7fcaa0f5f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca9c133ad0 0x7fca9c12fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.302+0000 7fcaa1760700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca9c139280 0x7fca9c11c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51162/0 (socket says 172.21.15.156:51162) 2023-09-30T22:25:33.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.302+0000 7fcaa1760700 1 -- 172.21.15.156:0/1494037827 learned_addr learned my addr 172.21.15.156:0/1494037827 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:33.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.302+0000 7fca9bfff700 1 --2- 172.21.15.156:0/1494037827 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca9c136960 0x7fca9c11bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.302+0000 7f7aa0929700 1 --2- 172.21.15.156:0/1863924562 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a9c09e170 0x7f7a9c122c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.303+0000 7f7aa112a700 1 -- 172.21.15.156:0/1863924562 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a9c09e170 msgr2=0x7f7a9c122c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.303+0000 7f7aa192b700 1 --2- 172.21.15.156:0/1863924562 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a9c130eb0 0x7f7a9c123140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.303+0000 7f7aa112a700 1 --2- 172.21.15.156:0/1863924562 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a9c09e170 0x7f7a9c122c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.303+0000 7f7aa112a700 1 -- 172.21.15.156:0/1863924562 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a9c130eb0 msgr2=0x7f7a9c123140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.303+0000 7f7aa112a700 1 --2- 172.21.15.156:0/1863924562 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a9c130eb0 0x7f7a9c123140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.303+0000 7f7aa112a700 1 -- 172.21.15.156:0/1863924562 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a98009550 con 0x7f7a9c09d860 2023-09-30T22:25:33.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.303+0000 7f7aa0929700 1 --2- 172.21.15.156:0/1863924562 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a9c09e170 0x7f7a9c122c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:33.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.303+0000 7fca9bfff700 1 -- 172.21.15.156:0/1494037827 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca9c139280 msgr2=0x7fca9c11c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.303+0000 7fca9bfff700 1 --2- 172.21.15.156:0/1494037827 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca9c139280 0x7fca9c11c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.303+0000 7fca9bfff700 1 -- 172.21.15.156:0/1494037827 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca9c133ad0 msgr2=0x7fca9c12fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.303+0000 7fca9bfff700 1 --2- 172.21.15.156:0/1494037827 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca9c133ad0 0x7fca9c12fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.303+0000 7fca9bfff700 1 -- 172.21.15.156:0/1494037827 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca94009b30 con 0x7fca9c136960 2023-09-30T22:25:33.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.303+0000 7f7aa192b700 1 --2- 172.21.15.156:0/1863924562 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a9c130eb0 0x7f7a9c123140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:33.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.303+0000 7f7aa112a700 1 --2- 172.21.15.156:0/1863924562 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a9c09d860 0x7f7a9c1226c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f7a98009c40 tx=0x7f7a98004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:33.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.303+0000 7f7a91ffb700 1 -- 172.21.15.156:0/1863924562 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9801d040 con 0x7f7a9c09d860 2023-09-30T22:25:33.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.303+0000 7fca9bfff700 1 --2- 172.21.15.156:0/1494037827 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca9c136960 0x7fca9c11bac0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fca8800d5f0 tx=0x7fca8800d900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:33.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.303+0000 7f7aa338e700 1 -- 172.21.15.156:0/1863924562 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a9c125f00 con 0x7f7a9c09d860 2023-09-30T22:25:33.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.303+0000 7fca997fa700 1 -- 172.21.15.156:0/1494037827 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca880125f0 con 0x7fca9c136960 2023-09-30T22:25:33.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.303+0000 7fca997fa700 1 -- 172.21.15.156:0/1494037827 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca88012750 con 0x7fca9c136960 2023-09-30T22:25:33.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.303+0000 7fca997fa700 1 -- 172.21.15.156:0/1494037827 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88012ae0 con 0x7fca9c136960 2023-09-30T22:25:33.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.303+0000 7f7aa338e700 1 -- 172.21.15.156:0/1863924562 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a9c126970 con 0x7f7a9c09d860 2023-09-30T22:25:33.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.303+0000 7f7a91ffb700 1 -- 172.21.15.156:0/1863924562 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a98004590 con 0x7f7a9c09d860 2023-09-30T22:25:33.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.303+0000 7f7a91ffb700 1 -- 172.21.15.156:0/1863924562 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a98003cb0 con 0x7f7a9c09d860 2023-09-30T22:25:33.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.304+0000 7fcaa31c3700 1 -- 172.21.15.156:0/1494037827 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca9c12d830 con 0x7fca9c136960 2023-09-30T22:25:33.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.304+0000 7fcaa31c3700 1 -- 172.21.15.156:0/1494037827 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9c11ac00 con 0x7fca9c136960 2023-09-30T22:25:33.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.304+0000 7f7aa338e700 1 -- 172.21.15.156:0/1863924562 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a7c0052e0 con 0x7f7a9c09d860 2023-09-30T22:25:33.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.305+0000 7f7a91ffb700 1 -- 172.21.15.156:0/1863924562 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7a98022480 con 0x7f7a9c09d860 2023-09-30T22:25:33.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.305+0000 7fca997fa700 1 -- 172.21.15.156:0/1494037827 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fca88012c40 con 0x7fca9c136960 2023-09-30T22:25:33.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.305+0000 7f7a91ffb700 1 -- 172.21.15.156:0/1863924562 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7a98040910 con 0x7f7a9c09d860 2023-09-30T22:25:33.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.305+0000 7fca997fa700 1 -- 172.21.15.156:0/1494037827 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fca8803f7b0 con 0x7fca9c136960 2023-09-30T22:25:33.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.306+0000 7fcaa31c3700 1 -- 172.21.15.156:0/1494037827 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca9c11b730 con 0x7fca9c136960 2023-09-30T22:25:33.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.309+0000 7f7a91ffb700 1 -- 172.21.15.156:0/1863924562 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7a98022730 con 0x7f7a9c09d860 2023-09-30T22:25:33.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.314+0000 7fca997fa700 1 -- 172.21.15.156:0/1494037827 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fca8801d460 con 0x7fca9c136960 2023-09-30T22:25:33.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.407+0000 7f8189769700 1 -- 172.21.15.156:0/2591205126 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f818404f2a0 con 0x7f818406a770 2023-09-30T22:25:33.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.408+0000 7f816b7fe700 1 -- 172.21.15.156:0/2591205126 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8174017020 con 0x7f818406a770 2023-09-30T22:25:33.409 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:33.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.410+0000 7f8189769700 1 -- 172.21.15.156:0/2591205126 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f818406a770 msgr2=0x7f818411a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.410+0000 7f8189769700 1 --2- 172.21.15.156:0/2591205126 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f818406a770 0x7f818411a950 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f817400e870 tx=0x7f817400ec30 comp rx=0 tx=0).stop 2023-09-30T22:25:33.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.410+0000 7f8189769700 1 -- 172.21.15.156:0/2591205126 shutdown_connections 2023-09-30T22:25:33.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.410+0000 7f8189769700 1 --2- 172.21.15.156:0/2591205126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8184134f00 0x7f818411b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.410+0000 7f8189769700 1 --2- 172.21.15.156:0/2591205126 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f818406a770 0x7f818411a950 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.410+0000 7f8189769700 1 --2- 172.21.15.156:0/2591205126 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f818409dea0 0x7f818411ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.410+0000 7f8189769700 1 -- 172.21.15.156:0/2591205126 >> 172.21.15.156:0/2591205126 conn(0x7f8184099c40 msgr2=0x7f818409c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:33.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.411+0000 7f8189769700 1 -- 172.21.15.156:0/2591205126 shutdown_connections 2023-09-30T22:25:33.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.411+0000 7f8189769700 1 -- 172.21.15.156:0/2591205126 wait complete. 2023-09-30T22:25:33.428 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:33.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.456+0000 7f92c52f6700 1 -- 172.21.15.156:0/3025929762 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f92c004f2a0 con 0x7f92c0139280 2023-09-30T22:25:33.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.457+0000 7f92a77fe700 1 -- 172.21.15.156:0/3025929762 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f92b801bb00 con 0x7f92c0139280 2023-09-30T22:25:33.457 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:33.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.460+0000 7f92c52f6700 1 -- 172.21.15.156:0/3025929762 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92c0139280 msgr2=0x7f92c012d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.460+0000 7f92c52f6700 1 --2- 172.21.15.156:0/3025929762 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92c0139280 0x7f92c012d5b0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f92b8007de0 tx=0x7f92b800e3c0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.460+0000 7f92c52f6700 1 -- 172.21.15.156:0/3025929762 shutdown_connections 2023-09-30T22:25:33.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.460+0000 7f92c52f6700 1 --2- 172.21.15.156:0/3025929762 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f92c0139280 0x7f92c012d5b0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.460+0000 7f92c52f6700 1 --2- 172.21.15.156:0/3025929762 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f92c0133ad0 0x7f92c012cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.460+0000 7f92c52f6700 1 --2- 172.21.15.156:0/3025929762 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92c0136960 0x7f92c012d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.460+0000 7f92c52f6700 1 -- 172.21.15.156:0/3025929762 >> 172.21.15.156:0/3025929762 conn(0x7f92c0099c40 msgr2=0x7f92c0134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:33.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.460+0000 7f92c52f6700 1 -- 172.21.15.156:0/3025929762 shutdown_connections 2023-09-30T22:25:33.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.460+0000 7f92c52f6700 1 -- 172.21.15.156:0/3025929762 wait complete. 2023-09-30T22:25:33.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:33.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.503+0000 7f7aa338e700 1 -- 172.21.15.156:0/1863924562 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7a7c005590 con 0x7f7a9c09d860 2023-09-30T22:25:33.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.503+0000 7f7a91ffb700 1 -- 172.21.15.156:0/1863924562 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7a98027070 con 0x7f7a9c09d860 2023-09-30T22:25:33.504 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:33.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.505+0000 7f7aa338e700 1 -- 172.21.15.156:0/1863924562 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a9c09d860 msgr2=0x7f7a9c1226c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.505+0000 7f7aa338e700 1 --2- 172.21.15.156:0/1863924562 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a9c09d860 0x7f7a9c1226c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f7a98009c40 tx=0x7f7a98004750 comp rx=0 tx=0).stop 2023-09-30T22:25:33.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.505+0000 7f7aa338e700 1 -- 172.21.15.156:0/1863924562 shutdown_connections 2023-09-30T22:25:33.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.505+0000 7f7aa338e700 1 --2- 172.21.15.156:0/1863924562 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a9c130eb0 0x7f7a9c123140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.505+0000 7f7aa338e700 1 --2- 172.21.15.156:0/1863924562 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a9c09d860 0x7f7a9c1226c0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.505+0000 7f7aa338e700 1 --2- 172.21.15.156:0/1863924562 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a9c09e170 0x7f7a9c122c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.505+0000 7f7aa338e700 1 -- 172.21.15.156:0/1863924562 >> 172.21.15.156:0/1863924562 conn(0x7f7a9c099c40 msgr2=0x7f7a9c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:33.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.505+0000 7f7aa338e700 1 -- 172.21.15.156:0/1863924562 shutdown_connections 2023-09-30T22:25:33.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.505+0000 7f7aa338e700 1 -- 172.21.15.156:0/1863924562 wait complete. 2023-09-30T22:25:33.518 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:33.539 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.539+0000 7fcaa31c3700 1 -- 172.21.15.156:0/1494037827 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fca9c04f2a0 con 0x7fca9c136960 2023-09-30T22:25:33.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.539+0000 7fca997fa700 1 -- 172.21.15.156:0/1494037827 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fca8801a310 con 0x7fca9c136960 2023-09-30T22:25:33.540 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:33.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.541+0000 7fcaa31c3700 1 -- 172.21.15.156:0/1494037827 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca9c136960 msgr2=0x7fca9c11bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.541+0000 7fcaa31c3700 1 --2- 172.21.15.156:0/1494037827 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca9c136960 0x7fca9c11bac0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fca8800d5f0 tx=0x7fca8800d900 comp rx=0 tx=0).stop 2023-09-30T22:25:33.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.542+0000 7fcaa31c3700 1 -- 172.21.15.156:0/1494037827 shutdown_connections 2023-09-30T22:25:33.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.542+0000 7fcaa31c3700 1 --2- 172.21.15.156:0/1494037827 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca9c139280 0x7fca9c11c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.542+0000 7fcaa31c3700 1 --2- 172.21.15.156:0/1494037827 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca9c133ad0 0x7fca9c12fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.542+0000 7fcaa31c3700 1 --2- 172.21.15.156:0/1494037827 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca9c136960 0x7fca9c11bac0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.542+0000 7fcaa31c3700 1 -- 172.21.15.156:0/1494037827 >> 172.21.15.156:0/1494037827 conn(0x7fca9c099c40 msgr2=0x7fca9c134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:33.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.542+0000 7fcaa31c3700 1 -- 172.21.15.156:0/1494037827 shutdown_connections 2023-09-30T22:25:33.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:33.542+0000 7fcaa31c3700 1 -- 172.21.15.156:0/1494037827 wait complete. 2023-09-30T22:25:33.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:34.429 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:34.473 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:34.519 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:34.555 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:34.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.572+0000 7fc8c195f700 1 Processor -- start 2023-09-30T22:25:34.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.572+0000 7fc8c195f700 1 -- start start 2023-09-30T22:25:34.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.572+0000 7fc8c195f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8bc133b80 0x7fc8bc133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.572+0000 7fc8c195f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8bc099a60 0x7fc8bc0a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.572+0000 7fc8c195f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8bc09aa00 con 0x7fc8bc0a0e20 2023-09-30T22:25:34.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.572+0000 7fc8c195f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc09a080 con 0x7fc8bc133b80 2023-09-30T22:25:34.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.572+0000 7fc8c195f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc133750 con 0x7fc8bc099a60 2023-09-30T22:25:34.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.572+0000 7fc8bb7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc8bc0a0e20 0x7fc8bc13a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:59282/0 (socket says 172.21.15.156:59282) 2023-09-30T22:25:34.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.572+0000 7fc8bb7fe700 1 -- 172.21.15.156:0/1371491389 learned_addr learned my addr 172.21.15.156:0/1371491389 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:34.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.573+0000 7fc8ba7fc700 1 --2- 172.21.15.156:0/1371491389 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8bc099a60 0x7fc8bc0a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.573+0000 7fc8baffd700 1 --2- 172.21.15.156:0/1371491389 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8bc133b80 0x7fc8bc133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.573+0000 7fc8ba7fc700 1 -- 172.21.15.156:0/1371491389 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8bc133b80 msgr2=0x7fc8bc133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:34.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.573+0000 7fc8ba7fc700 1 --2- 172.21.15.156:0/1371491389 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8bc133b80 0x7fc8bc133f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.573+0000 7fc8ba7fc700 1 -- 172.21.15.156:0/1371491389 >> v1:172.21.15.156:6789/0 conn(0x7fc8bc0a0e20 legacy=0x7fc8bc13a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.573+0000 7fc8ba7fc700 1 -- 172.21.15.156:0/1371491389 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc09a760 con 0x7fc8bc099a60 2023-09-30T22:25:34.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.573+0000 7fc8ba7fc700 1 --2- 172.21.15.156:0/1371491389 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8bc099a60 0x7fc8bc0a08e0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0009870 tx=0x7fc8b0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd80e93f5ea24e24 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:34.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.573+0000 7fc8b9ffb700 1 -- 172.21.15.156:0/1371491389 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0011830 con 0x7fc8bc099a60 2023-09-30T22:25:34.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.573+0000 7fc8b9ffb700 1 -- 172.21.15.156:0/1371491389 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b0011990 con 0x7fc8bc099a60 2023-09-30T22:25:34.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.573+0000 7fc8b9ffb700 1 -- 172.21.15.156:0/1371491389 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0011d20 con 0x7fc8bc099a60 2023-09-30T22:25:34.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.574+0000 7fc8c195f700 1 -- 172.21.15.156:0/1371491389 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8bc099a60 msgr2=0x7fc8bc0a08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.574+0000 7fc8c195f700 1 --2- 172.21.15.156:0/1371491389 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8bc099a60 0x7fc8bc0a08e0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0009870 tx=0x7fc8b0009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:34.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.574+0000 7fc8c195f700 1 -- 172.21.15.156:0/1371491389 shutdown_connections 2023-09-30T22:25:34.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.574+0000 7fc8c195f700 1 --2- 172.21.15.156:0/1371491389 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8bc133b80 0x7fc8bc133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.574+0000 7fc8c195f700 1 --2- 172.21.15.156:0/1371491389 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8bc099a60 0x7fc8bc0a08e0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.574+0000 7fc8c195f700 1 -- 172.21.15.156:0/1371491389 >> 172.21.15.156:0/1371491389 conn(0x7fc8bc0a2980 msgr2=0x7fc8bc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:34.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.574+0000 7fc8c195f700 1 -- 172.21.15.156:0/1371491389 shutdown_connections 2023-09-30T22:25:34.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.574+0000 7fc8c195f700 1 -- 172.21.15.156:0/1371491389 wait complete. 2023-09-30T22:25:34.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.575+0000 7fc8c195f700 1 Processor -- start 2023-09-30T22:25:34.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.575+0000 7fc8c195f700 1 -- start start 2023-09-30T22:25:34.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.576+0000 7fc8c195f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8bc099a60 0x7fc8bc1ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.576+0000 7fc8c195f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8bc0a0e20 0x7fc8bc1cd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.576+0000 7fc8c195f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8bc133b80 0x7fc8bc06df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.576+0000 7fc8c195f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc071a00 con 0x7fc8bc133b80 2023-09-30T22:25:34.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.576+0000 7fc8c195f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc12f8d0 con 0x7fc8bc0a0e20 2023-09-30T22:25:34.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.576+0000 7fc8c195f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc09c4e0 con 0x7fc8bc099a60 2023-09-30T22:25:34.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.576+0000 7fc8baffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8bc099a60 0x7fc8bc1ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.576+0000 7fc8baffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8bc099a60 0x7fc8bc1ccbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56278/0 (socket says 172.21.15.156:56278) 2023-09-30T22:25:34.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.576+0000 7fc8baffd700 1 -- 172.21.15.156:0/1552068189 learned_addr learned my addr 172.21.15.156:0/1552068189 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:34.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.576+0000 7fc8bb7fe700 1 --2- 172.21.15.156:0/1552068189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8bc133b80 0x7fc8bc06df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.576+0000 7fc8ba7fc700 1 --2- 172.21.15.156:0/1552068189 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8bc0a0e20 0x7fc8bc1cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.576+0000 7fc8baffd700 1 -- 172.21.15.156:0/1552068189 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8bc0a0e20 msgr2=0x7fc8bc1cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.576+0000 7fc8baffd700 1 --2- 172.21.15.156:0/1552068189 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8bc0a0e20 0x7fc8bc1cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.576+0000 7fc8baffd700 1 -- 172.21.15.156:0/1552068189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8bc133b80 msgr2=0x7fc8bc06df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.576+0000 7fc8baffd700 1 --2- 172.21.15.156:0/1552068189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8bc133b80 0x7fc8bc06df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.576+0000 7fc8baffd700 1 -- 172.21.15.156:0/1552068189 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b00094a0 con 0x7fc8bc099a60 2023-09-30T22:25:34.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.576+0000 7fc8bb7fe700 1 --2- 172.21.15.156:0/1552068189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8bc133b80 0x7fc8bc06df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:34.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.577+0000 7fc8baffd700 1 --2- 172.21.15.156:0/1552068189 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8bc099a60 0x7fc8bc1ccbe0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00e990 tx=0x7fc8ac00eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:34.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.577+0000 7fc8a3fff700 1 -- 172.21.15.156:0/1552068189 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac0096f0 con 0x7fc8bc099a60 2023-09-30T22:25:34.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.577+0000 7fc8a3fff700 1 -- 172.21.15.156:0/1552068189 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ac013680 con 0x7fc8bc099a60 2023-09-30T22:25:34.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.577+0000 7fc8c195f700 1 -- 172.21.15.156:0/1552068189 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8bc06faf0 con 0x7fc8bc099a60 2023-09-30T22:25:34.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.577+0000 7fc8a3fff700 1 -- 172.21.15.156:0/1552068189 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac0139f0 con 0x7fc8bc099a60 2023-09-30T22:25:34.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.577+0000 7fc8c195f700 1 -- 172.21.15.156:0/1552068189 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8bc09a310 con 0x7fc8bc099a60 2023-09-30T22:25:34.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.578+0000 7fc8a3fff700 1 -- 172.21.15.156:0/1552068189 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc8ac013b50 con 0x7fc8bc099a60 2023-09-30T22:25:34.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.578+0000 7fc8a3fff700 1 -- 172.21.15.156:0/1552068189 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc8ac0421c0 con 0x7fc8bc099a60 2023-09-30T22:25:34.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.578+0000 7fc8c195f700 1 -- 172.21.15.156:0/1552068189 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8bc04f2a0 con 0x7fc8bc099a60 2023-09-30T22:25:34.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.583+0000 7fc8a3fff700 1 -- 172.21.15.156:0/1552068189 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc8ac017070 con 0x7fc8bc099a60 2023-09-30T22:25:34.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.617+0000 7f09cb814700 1 Processor -- start 2023-09-30T22:25:34.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.617+0000 7f09cb814700 1 -- start start 2023-09-30T22:25:34.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.618+0000 7f09cb814700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09c409a150 0x7f09c409e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.618+0000 7f09cb814700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f09c409edb0 0x7f09c409f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.618+0000 7f09cb814700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09c409af80 con 0x7f09c4133c20 2023-09-30T22:25:34.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.618+0000 7f09cb814700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09c409fe00 con 0x7f09c409edb0 2023-09-30T22:25:34.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.618+0000 7f09cb814700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c406bec0 con 0x7f09c409a150 2023-09-30T22:25:34.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.618+0000 7f09c8daf700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f09c409edb0 0x7f09c409f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.618+0000 7f09c95b0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09c409a150 0x7f09c409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.618+0000 7f09c9db1700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f09c4133c20 0x7f09c4134070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:59288/0 (socket says 172.21.15.156:59288) 2023-09-30T22:25:34.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.618+0000 7f09c9db1700 1 -- 172.21.15.156:0/1693438830 learned_addr learned my addr 172.21.15.156:0/1693438830 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:34.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.618+0000 7f09c8daf700 1 --2- 172.21.15.156:0/1693438830 >> v2:172.21.15.156:3300/0 conn(0x7f09c409edb0 0x7f09c409f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34262/0 (socket says 172.21.15.156:34262) 2023-09-30T22:25:34.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.619+0000 7f09c95b0700 1 -- 172.21.15.156:0/1693438830 >> v2:172.21.15.156:3300/0 conn(0x7f09c409edb0 msgr2=0x7f09c409f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:34.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.619+0000 7f09c95b0700 1 --2- 172.21.15.156:0/1693438830 >> v2:172.21.15.156:3300/0 conn(0x7f09c409edb0 0x7f09c409f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.619+0000 7f09c95b0700 1 -- 172.21.15.156:0/1693438830 >> v1:172.21.15.156:6789/0 conn(0x7f09c4133c20 legacy=0x7f09c4134070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.619+0000 7f09c95b0700 1 -- 172.21.15.156:0/1693438830 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c409f6e0 con 0x7f09c409a150 2023-09-30T22:25:34.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.619+0000 7f09c8daf700 1 --2- 172.21.15.156:0/1693438830 >> v2:172.21.15.156:3300/0 conn(0x7f09c409edb0 0x7f09c409f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:34.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.619+0000 7f09c95b0700 1 --2- 172.21.15.156:0/1693438830 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09c409a150 0x7f09c409e870 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f09c0009870 tx=0x7f09c0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cba4bdd0aac3f125 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:34.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.619+0000 7f09bbfff700 1 -- 172.21.15.156:0/1693438830 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c0011830 con 0x7f09c409a150 2023-09-30T22:25:34.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.619+0000 7f09bbfff700 1 -- 172.21.15.156:0/1693438830 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c0011990 con 0x7f09c409a150 2023-09-30T22:25:34.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.619+0000 7f09bbfff700 1 -- 172.21.15.156:0/1693438830 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c0011d20 con 0x7f09c409a150 2023-09-30T22:25:34.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.620+0000 7f09cb814700 1 -- 172.21.15.156:0/1693438830 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09c409a150 msgr2=0x7f09c409e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.620+0000 7f09cb814700 1 --2- 172.21.15.156:0/1693438830 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09c409a150 0x7f09c409e870 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f09c0009870 tx=0x7f09c0009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:34.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.620+0000 7f09cb814700 1 -- 172.21.15.156:0/1693438830 shutdown_connections 2023-09-30T22:25:34.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.620+0000 7f09cb814700 1 --2- 172.21.15.156:0/1693438830 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09c409a150 0x7f09c409e870 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.620+0000 7f09cb814700 1 --2- 172.21.15.156:0/1693438830 >> v2:172.21.15.156:3300/0 conn(0x7f09c409edb0 0x7f09c409f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.620+0000 7f09cb814700 1 -- 172.21.15.156:0/1693438830 >> 172.21.15.156:0/1693438830 conn(0x7f09c40a4430 msgr2=0x7f09c40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:34.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.620+0000 7f09cb814700 1 -- 172.21.15.156:0/1693438830 shutdown_connections 2023-09-30T22:25:34.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.620+0000 7f09cb814700 1 -- 172.21.15.156:0/1693438830 wait complete. 2023-09-30T22:25:34.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.621+0000 7f09cb814700 1 Processor -- start 2023-09-30T22:25:34.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.621+0000 7f09cb814700 1 -- start start 2023-09-30T22:25:34.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.622+0000 7f09cb814700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09c409a150 0x7f09c4122850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.622+0000 7f09cb814700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f09c409edb0 0x7f09c4122d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.622+0000 7f09cb814700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09c4133c20 0x7f09c41232d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.622+0000 7f09cb814700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c40a0440 con 0x7f09c409a150 2023-09-30T22:25:34.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.622+0000 7f09cb814700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c4126040 con 0x7f09c4133c20 2023-09-30T22:25:34.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.622+0000 7f09cb814700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09c40a3700 con 0x7f09c409edb0 2023-09-30T22:25:34.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.622+0000 7f09c8daf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f09c409edb0 0x7f09c4122d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.622+0000 7f09c8daf700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f09c409edb0 0x7f09c4122d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56282/0 (socket says 172.21.15.156:56282) 2023-09-30T22:25:34.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.622+0000 7f09c8daf700 1 -- 172.21.15.156:0/2123845541 learned_addr learned my addr 172.21.15.156:0/2123845541 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:34.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.622+0000 7f09c95b0700 1 --2- 172.21.15.156:0/2123845541 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09c409a150 0x7f09c4122850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.622+0000 7f09c9db1700 1 --2- 172.21.15.156:0/2123845541 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09c4133c20 0x7f09c41232d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.623+0000 7f09c8daf700 1 -- 172.21.15.156:0/2123845541 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09c4133c20 msgr2=0x7f09c41232d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.623+0000 7f09c8daf700 1 --2- 172.21.15.156:0/2123845541 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09c4133c20 0x7f09c41232d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.623+0000 7f09c8daf700 1 -- 172.21.15.156:0/2123845541 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09c409a150 msgr2=0x7f09c4122850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.623+0000 7f09c8daf700 1 --2- 172.21.15.156:0/2123845541 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09c409a150 0x7f09c4122850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.623+0000 7f09c8daf700 1 -- 172.21.15.156:0/2123845541 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b40094a0 con 0x7f09c409edb0 2023-09-30T22:25:34.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.623+0000 7f09c95b0700 1 --2- 172.21.15.156:0/2123845541 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09c409a150 0x7f09c4122850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:34.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.623+0000 7f09c8daf700 1 --2- 172.21.15.156:0/2123845541 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f09c409edb0 0x7f09c4122d90 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f09b400ebe0 tx=0x7f09b400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:34.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.623+0000 7f09b9ffb700 1 -- 172.21.15.156:0/2123845541 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b400c850 con 0x7f09c409edb0 2023-09-30T22:25:34.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.623+0000 7f09cb814700 1 -- 172.21.15.156:0/2123845541 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c00094a0 con 0x7f09c409edb0 2023-09-30T22:25:34.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.623+0000 7f09cb814700 1 -- 172.21.15.156:0/2123845541 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c4133320 con 0x7f09c409edb0 2023-09-30T22:25:34.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.623+0000 7f09b9ffb700 1 -- 172.21.15.156:0/2123845541 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b400c9b0 con 0x7f09c409edb0 2023-09-30T22:25:34.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.623+0000 7f09b9ffb700 1 -- 172.21.15.156:0/2123845541 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b400cd20 con 0x7f09c409edb0 2023-09-30T22:25:34.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.625+0000 7f09cb814700 1 -- 172.21.15.156:0/2123845541 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a40052e0 con 0x7f09c409edb0 2023-09-30T22:25:34.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.625+0000 7f09b9ffb700 1 -- 172.21.15.156:0/2123845541 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f09b4013470 con 0x7f09c409edb0 2023-09-30T22:25:34.627 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.625+0000 7f09b9ffb700 1 -- 172.21.15.156:0/2123845541 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f09b403fdd0 con 0x7f09c409edb0 2023-09-30T22:25:34.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.634+0000 7f09b9ffb700 1 -- 172.21.15.156:0/2123845541 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09b4013720 con 0x7f09c409edb0 2023-09-30T22:25:34.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.664+0000 7fca7ba7c700 1 Processor -- start 2023-09-30T22:25:34.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.665+0000 7fca7ba7c700 1 -- start start 2023-09-30T22:25:34.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.665+0000 7fca7ba7c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fca7406a770 0x7fca741349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.665+0000 7fca7ba7c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca74134f00 0x7fca7409d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.665+0000 7fca7ba7c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca7409dea0 0x7fca7409e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.665+0000 7fca7ba7c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca7406b2e0 con 0x7fca7406a770 2023-09-30T22:25:34.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.665+0000 7fca7ba7c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7409eca0 con 0x7fca74134f00 2023-09-30T22:25:34.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.665+0000 7fca7ba7c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca7409f720 con 0x7fca7409dea0 2023-09-30T22:25:34.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.665+0000 7fca79818700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fca7406a770 0x7fca741349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.665+0000 7fca79017700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca74134f00 0x7fca7409d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.665+0000 7fca79017700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca74134f00 0x7fca7409d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51210/0 (socket says 172.21.15.156:51210) 2023-09-30T22:25:34.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.665+0000 7fca79818700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fca7406a770 0x7fca741349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34280/0 (socket says 172.21.15.156:34280) 2023-09-30T22:25:34.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.665+0000 7fca79017700 1 -- 172.21.15.156:0/4178659348 learned_addr learned my addr 172.21.15.156:0/4178659348 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:34.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.665+0000 7fca7a019700 1 --2- 172.21.15.156:0/4178659348 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca7409dea0 0x7fca7409e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.666+0000 7fca79017700 1 -- 172.21.15.156:0/4178659348 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca7409dea0 msgr2=0x7fca7409e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:34.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.666+0000 7fca79017700 1 --2- 172.21.15.156:0/4178659348 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca7409dea0 0x7fca7409e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.666+0000 7fca79017700 1 -- 172.21.15.156:0/4178659348 >> v2:172.21.15.156:3300/0 conn(0x7fca7406a770 msgr2=0x7fca741349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:34.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.666+0000 7fca79017700 1 --2- 172.21.15.156:0/4178659348 >> v2:172.21.15.156:3300/0 conn(0x7fca7406a770 0x7fca741349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.666+0000 7fca79017700 1 -- 172.21.15.156:0/4178659348 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7406b480 con 0x7fca74134f00 2023-09-30T22:25:34.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.666+0000 7fca79017700 1 --2- 172.21.15.156:0/4178659348 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca74134f00 0x7fca7409d960 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fca640098f0 tx=0x7fca64009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91185cae687a7651 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:34.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.666+0000 7fca78816700 1 -- 172.21.15.156:0/4178659348 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca64011830 con 0x7fca74134f00 2023-09-30T22:25:34.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.666+0000 7fca78816700 1 -- 172.21.15.156:0/4178659348 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca64011990 con 0x7fca74134f00 2023-09-30T22:25:34.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.666+0000 7fca78816700 1 -- 172.21.15.156:0/4178659348 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca64011d20 con 0x7fca74134f00 2023-09-30T22:25:34.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.667+0000 7fca7ba7c700 1 -- 172.21.15.156:0/4178659348 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca74134f00 msgr2=0x7fca7409d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.667+0000 7fca7ba7c700 1 --2- 172.21.15.156:0/4178659348 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca74134f00 0x7fca7409d960 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fca640098f0 tx=0x7fca64009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:34.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.667+0000 7fca7ba7c700 1 -- 172.21.15.156:0/4178659348 shutdown_connections 2023-09-30T22:25:34.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.667+0000 7fca7ba7c700 1 --2- 172.21.15.156:0/4178659348 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca7409dea0 0x7fca7409e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.667+0000 7fca7ba7c700 1 --2- 172.21.15.156:0/4178659348 >> v2:172.21.15.156:3300/0 conn(0x7fca7406a770 0x7fca741349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.667+0000 7fca7ba7c700 1 --2- 172.21.15.156:0/4178659348 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca74134f00 0x7fca7409d960 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.667+0000 7fca7ba7c700 1 -- 172.21.15.156:0/4178659348 >> 172.21.15.156:0/4178659348 conn(0x7fca74099c40 msgr2=0x7fca740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:34.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.667+0000 7fca7ba7c700 1 -- 172.21.15.156:0/4178659348 shutdown_connections 2023-09-30T22:25:34.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.667+0000 7fca7ba7c700 1 -- 172.21.15.156:0/4178659348 wait complete. 2023-09-30T22:25:34.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.668+0000 7fca7ba7c700 1 Processor -- start 2023-09-30T22:25:34.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.668+0000 7fca7ba7c700 1 -- start start 2023-09-30T22:25:34.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.668+0000 7fca7ba7c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca7406a770 0x7fca7411a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.668+0000 7fca7ba7c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca7409dea0 0x7fca7411ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.668+0000 7fca7ba7c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca74134f00 0x7fca7411b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.668+0000 7fca7ba7c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7411bb30 con 0x7fca74134f00 2023-09-30T22:25:34.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.668+0000 7fca7ba7c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca74138c60 con 0x7fca7409dea0 2023-09-30T22:25:34.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.668+0000 7fca7ba7c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca7411c630 con 0x7fca7406a770 2023-09-30T22:25:34.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.669+0000 7fca79017700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca7409dea0 0x7fca7411ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.669+0000 7fca79017700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca7409dea0 0x7fca7411ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51218/0 (socket says 172.21.15.156:51218) 2023-09-30T22:25:34.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.669+0000 7fca79017700 1 -- 172.21.15.156:0/4078377088 learned_addr learned my addr 172.21.15.156:0/4078377088 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:34.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.669+0000 7fca79818700 1 --2- 172.21.15.156:0/4078377088 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca7406a770 0x7fca7411a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.669+0000 7fca7a019700 1 --2- 172.21.15.156:0/4078377088 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca74134f00 0x7fca7411b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.669+0000 7fca79017700 1 -- 172.21.15.156:0/4078377088 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca7406a770 msgr2=0x7fca7411a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.669+0000 7fca79017700 1 --2- 172.21.15.156:0/4078377088 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca7406a770 0x7fca7411a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.669+0000 7fca79017700 1 -- 172.21.15.156:0/4078377088 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca74134f00 msgr2=0x7fca7411b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.669+0000 7fca79017700 1 --2- 172.21.15.156:0/4078377088 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca74134f00 0x7fca7411b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.669+0000 7fca79017700 1 -- 172.21.15.156:0/4078377088 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca64009550 con 0x7fca7409dea0 2023-09-30T22:25:34.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.669+0000 7fca79017700 1 --2- 172.21.15.156:0/4078377088 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca7409dea0 0x7fca7411ac10 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fca64009c40 tx=0x7fca64004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:34.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.669+0000 7fca6a7fc700 1 -- 172.21.15.156:0/4078377088 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca64004510 con 0x7fca7409dea0 2023-09-30T22:25:34.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.669+0000 7fca6a7fc700 1 -- 172.21.15.156:0/4078377088 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca640036a0 con 0x7fca7409dea0 2023-09-30T22:25:34.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.669+0000 7fca7ba7c700 1 -- 172.21.15.156:0/4078377088 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca741341b0 con 0x7fca7409dea0 2023-09-30T22:25:34.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.669+0000 7fca7ba7c700 1 -- 172.21.15.156:0/4078377088 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca74139150 con 0x7fca7409dea0 2023-09-30T22:25:34.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.669+0000 7fca6a7fc700 1 -- 172.21.15.156:0/4078377088 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca64003a50 con 0x7fca7409dea0 2023-09-30T22:25:34.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.670+0000 7fca7ba7c700 1 -- 172.21.15.156:0/4078377088 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca5c0052e0 con 0x7fca7409dea0 2023-09-30T22:25:34.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.671+0000 7fca6a7fc700 1 -- 172.21.15.156:0/4078377088 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fca64003bb0 con 0x7fca7409dea0 2023-09-30T22:25:34.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.671+0000 7fca6a7fc700 1 -- 172.21.15.156:0/4078377088 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fca640199d0 con 0x7fca7409dea0 2023-09-30T22:25:34.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.680+0000 7fca6a7fc700 1 -- 172.21.15.156:0/4078377088 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fca64075750 con 0x7fca7409dea0 2023-09-30T22:25:34.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.702+0000 7f3ce9a32700 1 Processor -- start 2023-09-30T22:25:34.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.702+0000 7f3ce9a32700 1 -- start start 2023-09-30T22:25:34.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.702+0000 7f3ce9a32700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3ce4133ad0 0x7f3ce4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.702+0000 7f3ce9a32700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ce41300a0 0x7f3ce41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.702+0000 7f3ce9a32700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce41309f0 0x7f3ce413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.702+0000 7f3ce9a32700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce406b2d0 con 0x7f3ce4133ad0 2023-09-30T22:25:34.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.702+0000 7f3ce9a32700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce4133610 con 0x7f3ce41309f0 2023-09-30T22:25:34.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.702+0000 7f3ce9a32700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce409a500 con 0x7f3ce41300a0 2023-09-30T22:25:34.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.702+0000 7f3ce27fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ce41300a0 0x7f3ce41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.702+0000 7f3ce2ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3ce4133ad0 0x7f3ce4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.703+0000 7f3ce27fc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ce41300a0 0x7f3ce41304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56316/0 (socket says 172.21.15.156:56316) 2023-09-30T22:25:34.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.703+0000 7f3ce27fc700 1 -- 172.21.15.156:0/1218407134 learned_addr learned my addr 172.21.15.156:0/1218407134 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:34.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.703+0000 7f3ce37fe700 1 --2- 172.21.15.156:0/1218407134 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce41309f0 0x7f3ce413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.703+0000 7f3ce27fc700 1 -- 172.21.15.156:0/1218407134 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce41309f0 msgr2=0x7f3ce413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:34.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.703+0000 7f3ce27fc700 1 --2- 172.21.15.156:0/1218407134 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce41309f0 0x7f3ce413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.703+0000 7f3ce27fc700 1 -- 172.21.15.156:0/1218407134 >> v2:172.21.15.156:3300/0 conn(0x7f3ce4133ad0 msgr2=0x7f3ce4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:34.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.703+0000 7f3ce27fc700 1 --2- 172.21.15.156:0/1218407134 >> v2:172.21.15.156:3300/0 conn(0x7f3ce4133ad0 0x7f3ce4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.703+0000 7f3ce27fc700 1 -- 172.21.15.156:0/1218407134 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce41338b0 con 0x7f3ce41300a0 2023-09-30T22:25:34.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.703+0000 7f3ce2ffd700 1 --2- 172.21.15.156:0/1218407134 >> v2:172.21.15.156:3300/0 conn(0x7f3ce4133ad0 0x7f3ce4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:34.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.703+0000 7f3ce27fc700 1 --2- 172.21.15.156:0/1218407134 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ce41300a0 0x7f3ce41304b0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f3cd80098f0 tx=0x7f3cd8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1faf379852197dbc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:34.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.703+0000 7f3ce1ffb700 1 -- 172.21.15.156:0/1218407134 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8011830 con 0x7f3ce41300a0 2023-09-30T22:25:34.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.703+0000 7f3ce1ffb700 1 -- 172.21.15.156:0/1218407134 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd8011990 con 0x7f3ce41300a0 2023-09-30T22:25:34.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.703+0000 7f3ce1ffb700 1 -- 172.21.15.156:0/1218407134 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8011d20 con 0x7f3ce41300a0 2023-09-30T22:25:34.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.704+0000 7f3ce9a32700 1 -- 172.21.15.156:0/1218407134 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ce41300a0 msgr2=0x7f3ce41304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.704+0000 7f3ce9a32700 1 --2- 172.21.15.156:0/1218407134 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ce41300a0 0x7f3ce41304b0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f3cd80098f0 tx=0x7f3cd8009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:34.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.704+0000 7f3ce9a32700 1 -- 172.21.15.156:0/1218407134 shutdown_connections 2023-09-30T22:25:34.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.704+0000 7f3ce9a32700 1 --2- 172.21.15.156:0/1218407134 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce41309f0 0x7f3ce413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.704+0000 7f3ce9a32700 1 --2- 172.21.15.156:0/1218407134 >> v2:172.21.15.156:3300/0 conn(0x7f3ce4133ad0 0x7f3ce4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.704+0000 7f3ce9a32700 1 --2- 172.21.15.156:0/1218407134 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ce41300a0 0x7f3ce41304b0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.704+0000 7f3ce9a32700 1 -- 172.21.15.156:0/1218407134 >> 172.21.15.156:0/1218407134 conn(0x7f3ce4099c40 msgr2=0x7f3ce40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:34.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.704+0000 7f3ce9a32700 1 -- 172.21.15.156:0/1218407134 shutdown_connections 2023-09-30T22:25:34.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.704+0000 7f3ce9a32700 1 -- 172.21.15.156:0/1218407134 wait complete. 2023-09-30T22:25:34.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.706+0000 7f3ce9a32700 1 Processor -- start 2023-09-30T22:25:34.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.706+0000 7f3ce9a32700 1 -- start start 2023-09-30T22:25:34.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.706+0000 7f3ce9a32700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ce41300a0 0x7f3ce411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.707+0000 7f3ce9a32700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce41309f0 0x7f3ce411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.707+0000 7f3ce9a32700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ce4133ad0 0x7f3ce411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.707+0000 7f3ce9a32700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce4120050 con 0x7f3ce4133ad0 2023-09-30T22:25:34.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.707+0000 7f3ce9a32700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce411eff0 con 0x7f3ce41309f0 2023-09-30T22:25:34.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.707+0000 7f3ce9a32700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce411fb40 con 0x7f3ce41300a0 2023-09-30T22:25:34.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.707+0000 7f3ce2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ce41300a0 0x7f3ce411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.707+0000 7f3ce37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ce4133ad0 0x7f3ce411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.707+0000 7f3ce2ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ce41300a0 0x7f3ce411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56322/0 (socket says 172.21.15.156:56322) 2023-09-30T22:25:34.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.707+0000 7f3ce2ffd700 1 -- 172.21.15.156:0/2210949402 learned_addr learned my addr 172.21.15.156:0/2210949402 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:34.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.707+0000 7f3ce27fc700 1 --2- 172.21.15.156:0/2210949402 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce41309f0 0x7f3ce411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.707+0000 7f3ce2ffd700 1 -- 172.21.15.156:0/2210949402 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce41309f0 msgr2=0x7f3ce411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.707+0000 7f3ce2ffd700 1 --2- 172.21.15.156:0/2210949402 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce41309f0 0x7f3ce411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.707+0000 7f3ce2ffd700 1 -- 172.21.15.156:0/2210949402 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ce4133ad0 msgr2=0x7f3ce411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.707+0000 7f3ce2ffd700 1 --2- 172.21.15.156:0/2210949402 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ce4133ad0 0x7f3ce411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.707+0000 7f3ce2ffd700 1 -- 172.21.15.156:0/2210949402 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd40094a0 con 0x7f3ce41300a0 2023-09-30T22:25:34.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.707+0000 7f3ce2ffd700 1 --2- 172.21.15.156:0/2210949402 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ce41300a0 0x7f3ce411da40 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f3cd400ebe0 tx=0x7f3cd400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:34.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.707+0000 7f3ccbfff700 1 -- 172.21.15.156:0/2210949402 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4009800 con 0x7f3ce41300a0 2023-09-30T22:25:34.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.708+0000 7f3ce9a32700 1 -- 172.21.15.156:0/2210949402 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd8009550 con 0x7f3ce41300a0 2023-09-30T22:25:34.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.708+0000 7f3ccbfff700 1 -- 172.21.15.156:0/2210949402 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd400c910 con 0x7f3ce41300a0 2023-09-30T22:25:34.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.708+0000 7f3ccbfff700 1 -- 172.21.15.156:0/2210949402 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd400cc80 con 0x7f3ce41300a0 2023-09-30T22:25:34.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.708+0000 7f3ce9a32700 1 -- 172.21.15.156:0/2210949402 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce412dd00 con 0x7f3ce41300a0 2023-09-30T22:25:34.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.709+0000 7f3ccbfff700 1 -- 172.21.15.156:0/2210949402 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3cd4013470 con 0x7f3ce41300a0 2023-09-30T22:25:34.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.709+0000 7f3ce9a32700 1 -- 172.21.15.156:0/2210949402 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce404f2a0 con 0x7f3ce41300a0 2023-09-30T22:25:34.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.709+0000 7f3ccbfff700 1 -- 172.21.15.156:0/2210949402 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3cd4011e00 con 0x7f3ce41300a0 2023-09-30T22:25:34.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.713+0000 7f3ccbfff700 1 -- 172.21.15.156:0/2210949402 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3cd4017070 con 0x7f3ce41300a0 2023-09-30T22:25:34.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.793+0000 7fc8c195f700 1 -- 172.21.15.156:0/1552068189 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc8bc06bce0 con 0x7fc8bc099a60 2023-09-30T22:25:34.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.794+0000 7fc8a3fff700 1 -- 172.21.15.156:0/1552068189 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc8ac017020 con 0x7fc8bc099a60 2023-09-30T22:25:34.795 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:34.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.796+0000 7fc8c195f700 1 -- 172.21.15.156:0/1552068189 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8bc099a60 msgr2=0x7fc8bc1ccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.796+0000 7fc8c195f700 1 --2- 172.21.15.156:0/1552068189 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8bc099a60 0x7fc8bc1ccbe0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00e990 tx=0x7fc8ac00eca0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.796+0000 7fc8c195f700 1 -- 172.21.15.156:0/1552068189 shutdown_connections 2023-09-30T22:25:34.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.796+0000 7fc8c195f700 1 --2- 172.21.15.156:0/1552068189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8bc133b80 0x7fc8bc06df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.796+0000 7fc8c195f700 1 --2- 172.21.15.156:0/1552068189 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc8bc099a60 0x7fc8bc1ccbe0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.796+0000 7fc8c195f700 1 --2- 172.21.15.156:0/1552068189 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc8bc0a0e20 0x7fc8bc1cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.796+0000 7fc8c195f700 1 -- 172.21.15.156:0/1552068189 >> 172.21.15.156:0/1552068189 conn(0x7fc8bc0a2980 msgr2=0x7fc8bc130060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:34.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.796+0000 7fc8c195f700 1 -- 172.21.15.156:0/1552068189 shutdown_connections 2023-09-30T22:25:34.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.796+0000 7fc8c195f700 1 -- 172.21.15.156:0/1552068189 wait complete. 2023-09-30T22:25:34.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:34.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.835+0000 7f09cb814700 1 -- 172.21.15.156:0/2123845541 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f09a4005590 con 0x7f09c409edb0 2023-09-30T22:25:34.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.835+0000 7f09b9ffb700 1 -- 172.21.15.156:0/2123845541 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f09b4017030 con 0x7f09c409edb0 2023-09-30T22:25:34.836 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:34.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.837+0000 7f09cb814700 1 -- 172.21.15.156:0/2123845541 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f09c409edb0 msgr2=0x7f09c4122d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.837+0000 7f09cb814700 1 --2- 172.21.15.156:0/2123845541 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f09c409edb0 0x7f09c4122d90 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f09b400ebe0 tx=0x7f09b400eef0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.837+0000 7f09cb814700 1 -- 172.21.15.156:0/2123845541 shutdown_connections 2023-09-30T22:25:34.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.837+0000 7f09cb814700 1 --2- 172.21.15.156:0/2123845541 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09c4133c20 0x7f09c41232d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.837+0000 7f09cb814700 1 --2- 172.21.15.156:0/2123845541 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09c409a150 0x7f09c4122850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.837+0000 7f09cb814700 1 --2- 172.21.15.156:0/2123845541 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f09c409edb0 0x7f09c4122d90 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.837+0000 7f09cb814700 1 -- 172.21.15.156:0/2123845541 >> 172.21.15.156:0/2123845541 conn(0x7f09c40a4430 msgr2=0x7f09c4071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:34.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.837+0000 7f09cb814700 1 -- 172.21.15.156:0/2123845541 shutdown_connections 2023-09-30T22:25:34.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.837+0000 7f09cb814700 1 -- 172.21.15.156:0/2123845541 wait complete. 2023-09-30T22:25:34.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:34.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.878+0000 7fca7ba7c700 1 -- 172.21.15.156:0/4078377088 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fca5c005150 con 0x7fca7409dea0 2023-09-30T22:25:34.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.878+0000 7fca6a7fc700 1 -- 172.21.15.156:0/4078377088 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fca64015070 con 0x7fca7409dea0 2023-09-30T22:25:34.879 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:34.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.881+0000 7fca7ba7c700 1 -- 172.21.15.156:0/4078377088 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca7409dea0 msgr2=0x7fca7411ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.881+0000 7fca7ba7c700 1 --2- 172.21.15.156:0/4078377088 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca7409dea0 0x7fca7411ac10 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fca64009c40 tx=0x7fca64004750 comp rx=0 tx=0).stop 2023-09-30T22:25:34.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.881+0000 7fca7ba7c700 1 -- 172.21.15.156:0/4078377088 shutdown_connections 2023-09-30T22:25:34.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.881+0000 7fca7ba7c700 1 --2- 172.21.15.156:0/4078377088 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca74134f00 0x7fca7411b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.881+0000 7fca7ba7c700 1 --2- 172.21.15.156:0/4078377088 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca7406a770 0x7fca7411a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.881+0000 7fca7ba7c700 1 --2- 172.21.15.156:0/4078377088 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca7409dea0 0x7fca7411ac10 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.881+0000 7fca7ba7c700 1 -- 172.21.15.156:0/4078377088 >> 172.21.15.156:0/4078377088 conn(0x7fca74099c40 msgr2=0x7fca7409c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:34.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.881+0000 7fca7ba7c700 1 -- 172.21.15.156:0/4078377088 shutdown_connections 2023-09-30T22:25:34.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.881+0000 7fca7ba7c700 1 -- 172.21.15.156:0/4078377088 wait complete. 2023-09-30T22:25:34.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:34.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.911+0000 7f3ce9a32700 1 -- 172.21.15.156:0/2210949402 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3ce412d900 con 0x7f3ce41300a0 2023-09-30T22:25:34.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.912+0000 7f3ccbfff700 1 -- 172.21.15.156:0/2210949402 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3cd4017020 con 0x7f3ce41300a0 2023-09-30T22:25:34.912 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:34.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.914+0000 7f3ce9a32700 1 -- 172.21.15.156:0/2210949402 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ce41300a0 msgr2=0x7f3ce411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.914+0000 7f3ce9a32700 1 --2- 172.21.15.156:0/2210949402 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ce41300a0 0x7f3ce411da40 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f3cd400ebe0 tx=0x7f3cd400eef0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.914+0000 7f3ce9a32700 1 -- 172.21.15.156:0/2210949402 shutdown_connections 2023-09-30T22:25:34.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.914+0000 7f3ce9a32700 1 --2- 172.21.15.156:0/2210949402 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ce4133ad0 0x7f3ce411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.914+0000 7f3ce9a32700 1 --2- 172.21.15.156:0/2210949402 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3ce41300a0 0x7f3ce411da40 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.914+0000 7f3ce9a32700 1 --2- 172.21.15.156:0/2210949402 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3ce41309f0 0x7f3ce411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.914+0000 7f3ce9a32700 1 -- 172.21.15.156:0/2210949402 >> 172.21.15.156:0/2210949402 conn(0x7f3ce4099c40 msgr2=0x7f3ce409f900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:34.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.914+0000 7f3ce9a32700 1 -- 172.21.15.156:0/2210949402 shutdown_connections 2023-09-30T22:25:34.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:34.914+0000 7f3ce9a32700 1 -- 172.21.15.156:0/2210949402 wait complete. 2023-09-30T22:25:34.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:35.810 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:35.853 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:35.894 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:35.955 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:35.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.947+0000 7fc99a3c4700 1 Processor -- start 2023-09-30T22:25:35.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.947+0000 7fc99a3c4700 1 -- start start 2023-09-30T22:25:35.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.948+0000 7fc99a3c4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc9940a1550 0x7fc994138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.948+0000 7fc99a3c4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc994139200 0x7fc99413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.948+0000 7fc99a3c4700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc99409e9d0 con 0x7fc9940a0a70 2023-09-30T22:25:35.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.948+0000 7fc99a3c4700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc99409dc00 con 0x7fc9940a1550 2023-09-30T22:25:35.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.948+0000 7fc99a3c4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc99409dec0 con 0x7fc994139200 2023-09-30T22:25:35.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.948+0000 7fc998961700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc994139200 0x7fc99413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.948+0000 7fc9937fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc9940a1550 0x7fc994138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.948+0000 7fc998961700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc994139200 0x7fc99413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51228/0 (socket says 172.21.15.156:51228) 2023-09-30T22:25:35.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.948+0000 7fc993fff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc9940a0a70 0x7fc9940a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:59300/0 (socket says 172.21.15.156:59300) 2023-09-30T22:25:35.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.948+0000 7fc998961700 1 -- 172.21.15.156:0/3545949113 learned_addr learned my addr 172.21.15.156:0/3545949113 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:35.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.948+0000 7fc9937fe700 1 -- 172.21.15.156:0/3545949113 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc994139200 msgr2=0x7fc99413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:35.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.948+0000 7fc9937fe700 1 --2- 172.21.15.156:0/3545949113 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc994139200 0x7fc99413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.948+0000 7fc9937fe700 1 -- 172.21.15.156:0/3545949113 >> v1:172.21.15.156:6789/0 conn(0x7fc9940a0a70 legacy=0x7fc9940a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.948+0000 7fc9937fe700 1 -- 172.21.15.156:0/3545949113 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99409e6a0 con 0x7fc9940a1550 2023-09-30T22:25:35.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.948+0000 7fc992ffd700 1 -- 172.21.15.156:0/3545949113 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2754178210 0 0) 0x7fc99409e9d0 con 0x7fc9940a0a70 2023-09-30T22:25:35.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.948+0000 7fc998961700 1 --2- 172.21.15.156:0/3545949113 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc994139200 0x7fc99413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:35.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.948+0000 7fc9937fe700 1 --2- 172.21.15.156:0/3545949113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9940a1550 0x7fc994138cc0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fc988009840 tx=0x7fc988009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edb8725f19db7270 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:35.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.949+0000 7fc992ffd700 1 -- 172.21.15.156:0/3545949113 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc988011830 con 0x7fc9940a1550 2023-09-30T22:25:35.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.949+0000 7fc992ffd700 1 -- 172.21.15.156:0/3545949113 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc988011990 con 0x7fc9940a1550 2023-09-30T22:25:35.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.949+0000 7fc992ffd700 1 -- 172.21.15.156:0/3545949113 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc988011d20 con 0x7fc9940a1550 2023-09-30T22:25:35.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.949+0000 7fc99a3c4700 1 -- 172.21.15.156:0/3545949113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9940a1550 msgr2=0x7fc994138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.949+0000 7fc99a3c4700 1 --2- 172.21.15.156:0/3545949113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9940a1550 0x7fc994138cc0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fc988009840 tx=0x7fc988009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:35.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.949+0000 7fc99a3c4700 1 -- 172.21.15.156:0/3545949113 shutdown_connections 2023-09-30T22:25:35.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.949+0000 7fc99a3c4700 1 --2- 172.21.15.156:0/3545949113 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc994139200 0x7fc99413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.949+0000 7fc99a3c4700 1 --2- 172.21.15.156:0/3545949113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9940a1550 0x7fc994138cc0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.949+0000 7fc99a3c4700 1 -- 172.21.15.156:0/3545949113 >> 172.21.15.156:0/3545949113 conn(0x7fc9940a6610 msgr2=0x7fc9940a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:35.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.949+0000 7fc99a3c4700 1 -- 172.21.15.156:0/3545949113 shutdown_connections 2023-09-30T22:25:35.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.949+0000 7fc99a3c4700 1 -- 172.21.15.156:0/3545949113 wait complete. 2023-09-30T22:25:35.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.950+0000 7fc99a3c4700 1 Processor -- start 2023-09-30T22:25:35.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.950+0000 7fc99a3c4700 1 -- start start 2023-09-30T22:25:35.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.951+0000 7fc99a3c4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9940a0a70 0x7fc99411e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.951+0000 7fc99a3c4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9940a1550 0x7fc99411ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.951+0000 7fc99a3c4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc994139200 0x7fc99411f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.951+0000 7fc99a3c4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9941219d0 con 0x7fc994139200 2023-09-30T22:25:35.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.951+0000 7fc99a3c4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9940a5100 con 0x7fc9940a1550 2023-09-30T22:25:35.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.951+0000 7fc99a3c4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9940a03e0 con 0x7fc9940a0a70 2023-09-30T22:25:35.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.951+0000 7fc9937fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9940a1550 0x7fc99411ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.951+0000 7fc9937fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9940a1550 0x7fc99411ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51234/0 (socket says 172.21.15.156:51234) 2023-09-30T22:25:35.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.951+0000 7fc9937fe700 1 -- 172.21.15.156:0/3174840990 learned_addr learned my addr 172.21.15.156:0/3174840990 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:35.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.951+0000 7fc998961700 1 --2- 172.21.15.156:0/3174840990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc994139200 0x7fc99411f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.951+0000 7fc993fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9940a0a70 0x7fc99411e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.951+0000 7fc9937fe700 1 -- 172.21.15.156:0/3174840990 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9940a0a70 msgr2=0x7fc99411e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.951+0000 7fc9937fe700 1 --2- 172.21.15.156:0/3174840990 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9940a0a70 0x7fc99411e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.951+0000 7fc9937fe700 1 -- 172.21.15.156:0/3174840990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc994139200 msgr2=0x7fc99411f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.951+0000 7fc9937fe700 1 --2- 172.21.15.156:0/3174840990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc994139200 0x7fc99411f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.951+0000 7fc9937fe700 1 -- 172.21.15.156:0/3174840990 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98c009b30 con 0x7fc9940a1550 2023-09-30T22:25:35.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.951+0000 7fc9937fe700 1 --2- 172.21.15.156:0/3174840990 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9940a1550 0x7fc99411ecb0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fc988009fd0 tx=0x7fc988004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:35.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.952+0000 7fc990ff9700 1 -- 172.21.15.156:0/3174840990 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc988004550 con 0x7fc9940a1550 2023-09-30T22:25:35.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.952+0000 7fc990ff9700 1 -- 172.21.15.156:0/3174840990 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98801f070 con 0x7fc9940a1550 2023-09-30T22:25:35.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.952+0000 7fc990ff9700 1 -- 172.21.15.156:0/3174840990 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9880038e0 con 0x7fc9940a1550 2023-09-30T22:25:35.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.952+0000 7fc99a3c4700 1 -- 172.21.15.156:0/3174840990 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9880094a0 con 0x7fc9940a1550 2023-09-30T22:25:35.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.952+0000 7fc99a3c4700 1 -- 172.21.15.156:0/3174840990 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc994120ae0 con 0x7fc9940a1550 2023-09-30T22:25:35.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.953+0000 7fc990ff9700 1 -- 172.21.15.156:0/3174840990 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc988003a40 con 0x7fc9940a1550 2023-09-30T22:25:35.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.953+0000 7fc99a3c4700 1 -- 172.21.15.156:0/3174840990 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc994134610 con 0x7fc9940a1550 2023-09-30T22:25:35.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.953+0000 7fc990ff9700 1 -- 172.21.15.156:0/3174840990 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc988021070 con 0x7fc9940a1550 2023-09-30T22:25:35.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.957+0000 7fc990ff9700 1 -- 172.21.15.156:0/3174840990 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc98802f3a0 con 0x7fc9940a1550 2023-09-30T22:25:35.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.989+0000 7f6125daa700 1 Processor -- start 2023-09-30T22:25:35.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.989+0000 7f6125daa700 1 -- start start 2023-09-30T22:25:35.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.990+0000 7f6125daa700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f612009d860 0x7f612009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.990+0000 7f6125daa700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f612009e170 0x7f61201307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.991 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.990+0000 7f6125daa700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612009aaa0 con 0x7f6120130ce0 2023-09-30T22:25:35.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.990+0000 7f6125daa700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f612009f870 con 0x7f612009e170 2023-09-30T22:25:35.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.990+0000 7f6125daa700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f612009b360 con 0x7f612009d860 2023-09-30T22:25:35.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.990+0000 7f611f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f612009d860 0x7f612009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.990+0000 7f611f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f612009d860 0x7f612009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56328/0 (socket says 172.21.15.156:56328) 2023-09-30T22:25:35.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.990+0000 7f611f7fe700 1 -- 172.21.15.156:0/675783944 learned_addr learned my addr 172.21.15.156:0/675783944 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:35.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.990+0000 7f611f7fe700 1 -- 172.21.15.156:0/675783944 >> v2:172.21.15.156:3300/0 conn(0x7f612009e170 msgr2=0x7f61201307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:35.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.990+0000 7f611f7fe700 1 --2- 172.21.15.156:0/675783944 >> v2:172.21.15.156:3300/0 conn(0x7f612009e170 0x7f61201307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.990+0000 7f611f7fe700 1 -- 172.21.15.156:0/675783944 >> v1:172.21.15.156:6789/0 conn(0x7f6120130ce0 legacy=0x7f61201379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:35.993 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.990+0000 7f611f7fe700 1 -- 172.21.15.156:0/675783944 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612009b620 con 0x7f612009d860 2023-09-30T22:25:35.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.991+0000 7f611f7fe700 1 --2- 172.21.15.156:0/675783944 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f612009d860 0x7f612009dc30 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f61100098f0 tx=0x7f6110009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f727e3e75b2b2713 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:35.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.991+0000 7f611e7fc700 1 -- 172.21.15.156:0/675783944 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6110004230 con 0x7f612009d860 2023-09-30T22:25:35.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.991+0000 7f611e7fc700 1 -- 172.21.15.156:0/675783944 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6110004390 con 0x7f612009d860 2023-09-30T22:25:35.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.991+0000 7f611e7fc700 1 -- 172.21.15.156:0/675783944 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61100036a0 con 0x7f612009d860 2023-09-30T22:25:35.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.992+0000 7f6125daa700 1 -- 172.21.15.156:0/675783944 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f612009d860 msgr2=0x7f612009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.994 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.992+0000 7f6125daa700 1 --2- 172.21.15.156:0/675783944 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f612009d860 0x7f612009dc30 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f61100098f0 tx=0x7f6110009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:35.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.992+0000 7f6125daa700 1 -- 172.21.15.156:0/675783944 shutdown_connections 2023-09-30T22:25:35.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.992+0000 7f6125daa700 1 --2- 172.21.15.156:0/675783944 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f612009d860 0x7f612009dc30 secure :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f61100098f0 tx=0x7f6110009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:35.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.992+0000 7f6125daa700 1 --2- 172.21.15.156:0/675783944 >> v2:172.21.15.156:3300/0 conn(0x7f612009e170 0x7f61201307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.992+0000 7f6125daa700 1 -- 172.21.15.156:0/675783944 >> 172.21.15.156:0/675783944 conn(0x7f6120099c40 msgr2=0x7f61200a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:35.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.993+0000 7f6125daa700 1 -- 172.21.15.156:0/675783944 shutdown_connections 2023-09-30T22:25:35.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.993+0000 7f6125daa700 1 -- 172.21.15.156:0/675783944 wait complete. 2023-09-30T22:25:35.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.994+0000 7f6125daa700 1 Processor -- start 2023-09-30T22:25:35.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.994+0000 7f6125daa700 1 -- start start 2023-09-30T22:25:35.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.994+0000 7f6125daa700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f612009e170 0x7f6120138430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.995+0000 7f6125daa700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6120130ce0 0x7f6120138970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.995+0000 7f6125daa700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61201c8430 0x7f61201c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.995+0000 7f6125daa700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6120136d00 con 0x7f6120130ce0 2023-09-30T22:25:35.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.995+0000 7f6125daa700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612009c8b0 con 0x7f612009e170 2023-09-30T22:25:35.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.995+0000 7f6125daa700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6120136000 con 0x7f61201c8430 2023-09-30T22:25:35.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.995+0000 7f611ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61201c8430 0x7f61201c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.995+0000 7f611f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f612009e170 0x7f6120138430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.995+0000 7f611f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f612009e170 0x7f6120138430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51236/0 (socket says 172.21.15.156:51236) 2023-09-30T22:25:35.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.995+0000 7f611f7fe700 1 -- 172.21.15.156:0/2639557299 learned_addr learned my addr 172.21.15.156:0/2639557299 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:36.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.995+0000 7f611ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61201c8430 0x7f61201c88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56330/0 (socket says 172.21.15.156:56330) 2023-09-30T22:25:36.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.995+0000 7f611effd700 1 --2- 172.21.15.156:0/2639557299 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6120130ce0 0x7f6120138970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:36.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.995+0000 7f611ffff700 1 -- 172.21.15.156:0/2639557299 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f612009e170 msgr2=0x7f6120138430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:36.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.995+0000 7f611ffff700 1 --2- 172.21.15.156:0/2639557299 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f612009e170 0x7f6120138430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.995+0000 7f611ffff700 1 -- 172.21.15.156:0/2639557299 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6120130ce0 msgr2=0x7f6120138970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:36.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.995+0000 7f611ffff700 1 --2- 172.21.15.156:0/2639557299 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6120130ce0 0x7f6120138970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.995+0000 7f611ffff700 1 -- 172.21.15.156:0/2639557299 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6110009550 con 0x7f61201c8430 2023-09-30T22:25:36.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.995+0000 7f611ffff700 1 --2- 172.21.15.156:0/2639557299 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61201c8430 0x7f61201c88d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f611800c780 tx=0x7f611800ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:36.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.995+0000 7f6107fff700 1 -- 172.21.15.156:0/2639557299 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118003e10 con 0x7f61201c8430 2023-09-30T22:25:36.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.996+0000 7f6125daa700 1 -- 172.21.15.156:0/2639557299 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6120137a30 con 0x7f61201c8430 2023-09-30T22:25:36.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.996+0000 7f6125daa700 1 -- 172.21.15.156:0/2639557299 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612013bd60 con 0x7f61201c8430 2023-09-30T22:25:36.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.996+0000 7f6107fff700 1 -- 172.21.15.156:0/2639557299 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61180050d0 con 0x7f61201c8430 2023-09-30T22:25:36.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.996+0000 7f6107fff700 1 -- 172.21.15.156:0/2639557299 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118005440 con 0x7f61201c8430 2023-09-30T22:25:36.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.997+0000 7f6125daa700 1 -- 172.21.15.156:0/2639557299 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61000052e0 con 0x7f61201c8430 2023-09-30T22:25:36.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.997+0000 7f6107fff700 1 -- 172.21.15.156:0/2639557299 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f61180055a0 con 0x7f61201c8430 2023-09-30T22:25:36.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:35.997+0000 7f6107fff700 1 -- 172.21.15.156:0/2639557299 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f611803ec10 con 0x7f61201c8430 2023-09-30T22:25:36.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.002+0000 7f6107fff700 1 -- 172.21.15.156:0/2639557299 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f611801b3b0 con 0x7f61201c8430 2023-09-30T22:25:36.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.099+0000 7f4a605fa700 1 Processor -- start 2023-09-30T22:25:36.100 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.100+0000 7f4a605fa700 1 -- start start 2023-09-30T22:25:36.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.100+0000 7f45889f3700 1 Processor -- start 2023-09-30T22:25:36.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.100+0000 7f45889f3700 1 -- start start 2023-09-30T22:25:36.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.100+0000 7f4a605fa700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a580a0a70 0x7f4a580a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:36.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.100+0000 7f4a605fa700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4a58134120 0x7f4a5813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:36.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.100+0000 7f4a605fa700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a5809dc00 con 0x7f4a580a1380 2023-09-30T22:25:36.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.100+0000 7f4a605fa700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5809ea90 con 0x7f4a58134120 2023-09-30T22:25:36.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.100+0000 7f4a605fa700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5809dec0 con 0x7f4a580a0a70 2023-09-30T22:25:36.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.101+0000 7f4a5db95700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4a580a1380 0x7f4a58133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:59328/0 (socket says 172.21.15.156:59328) 2023-09-30T22:25:36.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.101+0000 7f4a5e396700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a580a0a70 0x7f4a580a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:36.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.101+0000 7f4a5db95700 1 -- 172.21.15.156:0/2512347928 learned_addr learned my addr 172.21.15.156:0/2512347928 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:36.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.101+0000 7f4a5eb97700 1 --2- 172.21.15.156:0/2512347928 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4a58134120 0x7f4a5813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:36.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.101+0000 7f45889f3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4584099a60 0x7f45841388f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:36.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.101+0000 7f45889f3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4584138e30 0x7f458413b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:36.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.101+0000 7f45889f3700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f458409aa00 con 0x7f4584133b80 2023-09-30T22:25:36.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.101+0000 7f45889f3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f458409a080 con 0x7f4584138e30 2023-09-30T22:25:36.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.101+0000 7f45889f3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4584133750 con 0x7f4584099a60 2023-09-30T22:25:36.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.101+0000 7f4a5d394700 1 -- 172.21.15.156:0/2512347928 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2092449075 0 0) 0x7f4a5809dc00 con 0x7f4a580a1380 2023-09-30T22:25:36.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.101+0000 7f4a5d394700 1 -- 172.21.15.156:0/2512347928 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a440035b0 con 0x7f4a580a1380 2023-09-30T22:25:36.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.101+0000 7f4582d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4584138e30 0x7f458413b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:36.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.101+0000 7f4582d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4584138e30 0x7f458413b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51266/0 (socket says 172.21.15.156:51266) 2023-09-30T22:25:36.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.101+0000 7f458259c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4584133b80 0x7f4584133f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:59336/0 (socket says 172.21.15.156:59336) 2023-09-30T22:25:36.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.101+0000 7f4582d9d700 1 -- 172.21.15.156:0/1591173536 learned_addr learned my addr 172.21.15.156:0/1591173536 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:36.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.101+0000 7f4a5e396700 1 -- 172.21.15.156:0/2512347928 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4a58134120 msgr2=0x7f4a5813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:36.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.101+0000 7f4a5e396700 1 --2- 172.21.15.156:0/2512347928 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4a58134120 0x7f4a5813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.101+0000 7f4a5e396700 1 -- 172.21.15.156:0/2512347928 >> v1:172.21.15.156:6789/0 conn(0x7f4a580a1380 legacy=0x7f4a58133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:36.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.101+0000 7f4a5e396700 1 -- 172.21.15.156:0/2512347928 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5809e6a0 con 0x7f4a580a0a70 2023-09-30T22:25:36.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.101+0000 7f4a5e396700 1 --2- 172.21.15.156:0/2512347928 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a580a0a70 0x7f4a580a0e40 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f4a54009870 tx=0x7f4a54009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6011f7b276f35a3d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:36.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.102+0000 7f4a5d394700 1 -- 172.21.15.156:0/2512347928 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a54011830 con 0x7f4a580a0a70 2023-09-30T22:25:36.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.102+0000 7f4581d9b700 1 --2- 172.21.15.156:0/1591173536 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4584099a60 0x7f45841388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:36.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.102+0000 7f458159a700 1 -- 172.21.15.156:0/1591173536 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 995160906 0 0) 0x7f458409aa00 con 0x7f4584133b80 2023-09-30T22:25:36.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.102+0000 7f458159a700 1 -- 172.21.15.156:0/1591173536 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f456c0035b0 con 0x7f4584133b80 2023-09-30T22:25:36.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.102+0000 7f4582d9d700 1 -- 172.21.15.156:0/1591173536 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4584099a60 msgr2=0x7f45841388f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:36.108 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.102+0000 7f4582d9d700 1 --2- 172.21.15.156:0/1591173536 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4584099a60 0x7f45841388f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.102+0000 7f4a5d394700 1 -- 172.21.15.156:0/2512347928 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a54011990 con 0x7f4a580a0a70 2023-09-30T22:25:36.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.102+0000 7f4a5d394700 1 -- 172.21.15.156:0/2512347928 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a54011d00 con 0x7f4a580a0a70 2023-09-30T22:25:36.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.102+0000 7f4582d9d700 1 -- 172.21.15.156:0/1591173536 >> v1:172.21.15.156:6789/0 conn(0x7f4584133b80 legacy=0x7f4584133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:36.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.102+0000 7f4582d9d700 1 -- 172.21.15.156:0/1591173536 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458409a760 con 0x7f4584138e30 2023-09-30T22:25:36.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.102+0000 7f4582d9d700 1 --2- 172.21.15.156:0/1591173536 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4584138e30 0x7f458413b210 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f457c009e80 tx=0x7f457c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=382c1477cb380f9b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:36.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.102+0000 7f458159a700 1 -- 172.21.15.156:0/1591173536 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c00e070 con 0x7f4584138e30 2023-09-30T22:25:36.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.102+0000 7f458159a700 1 -- 172.21.15.156:0/1591173536 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457c00b910 con 0x7f4584138e30 2023-09-30T22:25:36.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.102+0000 7f458159a700 1 -- 172.21.15.156:0/1591173536 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c00bcc0 con 0x7f4584138e30 2023-09-30T22:25:36.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.103+0000 7f4a605fa700 1 -- 172.21.15.156:0/2512347928 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a580a0a70 msgr2=0x7f4a580a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:36.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.103+0000 7f4a605fa700 1 --2- 172.21.15.156:0/2512347928 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a580a0a70 0x7f4a580a0e40 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f4a54009870 tx=0x7f4a54009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:36.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.103+0000 7f4a605fa700 1 -- 172.21.15.156:0/2512347928 shutdown_connections 2023-09-30T22:25:36.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.103+0000 7f4a605fa700 1 --2- 172.21.15.156:0/2512347928 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4a58134120 0x7f4a5813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.103+0000 7f4a605fa700 1 --2- 172.21.15.156:0/2512347928 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a580a0a70 0x7f4a580a0e40 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.103+0000 7f4a605fa700 1 -- 172.21.15.156:0/2512347928 >> 172.21.15.156:0/2512347928 conn(0x7f4a580a6610 msgr2=0x7f4a580a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:36.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.103+0000 7f45889f3700 1 -- 172.21.15.156:0/1591173536 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4584138e30 msgr2=0x7f458413b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:36.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.103+0000 7f45889f3700 1 --2- 172.21.15.156:0/1591173536 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4584138e30 0x7f458413b210 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f457c009e80 tx=0x7f457c00b330 comp rx=0 tx=0).stop 2023-09-30T22:25:36.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.103+0000 7f4a605fa700 1 -- 172.21.15.156:0/2512347928 shutdown_connections 2023-09-30T22:25:36.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.103+0000 7f4a605fa700 1 -- 172.21.15.156:0/2512347928 wait complete. 2023-09-30T22:25:36.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.103+0000 7f45889f3700 1 -- 172.21.15.156:0/1591173536 shutdown_connections 2023-09-30T22:25:36.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.103+0000 7f45889f3700 1 --2- 172.21.15.156:0/1591173536 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4584138e30 0x7f458413b210 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.103+0000 7f45889f3700 1 --2- 172.21.15.156:0/1591173536 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4584099a60 0x7f45841388f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.103+0000 7f45889f3700 1 -- 172.21.15.156:0/1591173536 >> 172.21.15.156:0/1591173536 conn(0x7f45840a2980 msgr2=0x7f45840a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:36.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.103+0000 7f45889f3700 1 -- 172.21.15.156:0/1591173536 shutdown_connections 2023-09-30T22:25:36.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.104+0000 7f45889f3700 1 -- 172.21.15.156:0/1591173536 wait complete. 2023-09-30T22:25:36.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.104+0000 7f4a605fa700 1 Processor -- start 2023-09-30T22:25:36.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.104+0000 7f4a605fa700 1 -- start start 2023-09-30T22:25:36.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.105+0000 7f4a605fa700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4a580a0a70 0x7f4a5811e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:36.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.105+0000 7f4a605fa700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a580a1380 0x7f4a5811ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:36.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.105+0000 7f4a605fa700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a58134120 0x7f4a5811efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:36.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.105+0000 7f4a605fa700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a580a03e0 con 0x7f4a58134120 2023-09-30T22:25:36.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.105+0000 7f45889f3700 1 Processor -- start 2023-09-30T22:25:36.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.105+0000 7f4a605fa700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5811f8f0 con 0x7f4a580a0a70 2023-09-30T22:25:36.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.105+0000 7f4a605fa700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a58120000 con 0x7f4a580a1380 2023-09-30T22:25:36.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.105+0000 7f4a5e396700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4a580a0a70 0x7f4a5811e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:36.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.105+0000 7f4a5e396700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4a580a0a70 0x7f4a5811e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51272/0 (socket says 172.21.15.156:51272) 2023-09-30T22:25:36.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.105+0000 7f4a5e396700 1 -- 172.21.15.156:0/1202603956 learned_addr learned my addr 172.21.15.156:0/1202603956 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:36.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.105+0000 7f4a5eb97700 1 --2- 172.21.15.156:0/1202603956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a58134120 0x7f4a5811efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:36.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.106+0000 7f4a5e396700 1 -- 172.21.15.156:0/1202603956 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a580a1380 msgr2=0x7f4a5811ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:36.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.106+0000 7f4a5e396700 1 --2- 172.21.15.156:0/1202603956 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a580a1380 0x7f4a5811ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.106+0000 7f4a5e396700 1 -- 172.21.15.156:0/1202603956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a58134120 msgr2=0x7f4a5811efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:36.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.106+0000 7f4a5e396700 1 --2- 172.21.15.156:0/1202603956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a58134120 0x7f4a5811efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.106+0000 7f4a5e396700 1 -- 172.21.15.156:0/1202603956 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a540094a0 con 0x7f4a580a0a70 2023-09-30T22:25:36.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.106+0000 7f4a5e396700 1 --2- 172.21.15.156:0/1202603956 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4a580a0a70 0x7f4a5811e520 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f4a54000c00 tx=0x7f4a54004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:36.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.106+0000 7f4a4effd700 1 -- 172.21.15.156:0/1202603956 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a54004510 con 0x7f4a580a0a70 2023-09-30T22:25:36.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.106+0000 7f4a4effd700 1 -- 172.21.15.156:0/1202603956 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5401f070 con 0x7f4a580a0a70 2023-09-30T22:25:36.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.106+0000 7f4a4effd700 1 -- 172.21.15.156:0/1202603956 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a540038e0 con 0x7f4a580a0a70 2023-09-30T22:25:36.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.105+0000 7f45889f3700 1 -- start start 2023-09-30T22:25:36.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.106+0000 7f45889f3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4584099a60 0x7f4584118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:36.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.106+0000 7f45889f3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4584133b80 0x7f4584119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:36.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.106+0000 7f45889f3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4584138e30 0x7f4584119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:36.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.106+0000 7f45889f3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458412fd90 con 0x7f4584138e30 2023-09-30T22:25:36.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.106+0000 7f45889f3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f458411a7b0 con 0x7f4584133b80 2023-09-30T22:25:36.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.106+0000 7f45889f3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f458411bde0 con 0x7f4584099a60 2023-09-30T22:25:36.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.106+0000 7f458259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4584099a60 0x7f4584118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:36.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.106+0000 7f4581d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4584133b80 0x7f4584119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:36.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.106+0000 7f458259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4584099a60 0x7f4584118df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56372/0 (socket says 172.21.15.156:56372) 2023-09-30T22:25:36.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.106+0000 7f458259c700 1 -- 172.21.15.156:0/2299255628 learned_addr learned my addr 172.21.15.156:0/2299255628 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:36.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.106+0000 7f4582d9d700 1 --2- 172.21.15.156:0/2299255628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4584138e30 0x7f4584119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:36.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.107+0000 7f4581d9b700 1 -- 172.21.15.156:0/2299255628 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4584099a60 msgr2=0x7f4584118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:36.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.107+0000 7f4581d9b700 1 --2- 172.21.15.156:0/2299255628 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4584099a60 0x7f4584118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.107+0000 7f4581d9b700 1 -- 172.21.15.156:0/2299255628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4584138e30 msgr2=0x7f4584119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:36.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.107+0000 7f4581d9b700 1 --2- 172.21.15.156:0/2299255628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4584138e30 0x7f4584119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.107+0000 7f4581d9b700 1 -- 172.21.15.156:0/2299255628 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457c009b30 con 0x7f4584133b80 2023-09-30T22:25:36.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.107+0000 7f4581d9b700 1 --2- 172.21.15.156:0/2299255628 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4584133b80 0x7f4584119330 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f457800e930 tx=0x7f457800ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:36.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.107+0000 7f4a605fa700 1 -- 172.21.15.156:0/1202603956 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a581219e0 con 0x7f4a580a0a70 2023-09-30T22:25:36.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.107+0000 7f4572ffd700 1 -- 172.21.15.156:0/2299255628 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4578013680 con 0x7f4584133b80 2023-09-30T22:25:36.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.107+0000 7f4a605fa700 1 -- 172.21.15.156:0/1202603956 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a581207f0 con 0x7f4a580a0a70 2023-09-30T22:25:36.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.108+0000 7f4a4effd700 1 -- 172.21.15.156:0/1202603956 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4a54003a40 con 0x7f4a580a0a70 2023-09-30T22:25:36.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.108+0000 7f4a4effd700 1 -- 172.21.15.156:0/1202603956 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4a54021070 con 0x7f4a580a0a70 2023-09-30T22:25:36.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.107+0000 7f4572ffd700 1 -- 172.21.15.156:0/2299255628 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45780137e0 con 0x7f4584133b80 2023-09-30T22:25:36.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.107+0000 7f4572ffd700 1 -- 172.21.15.156:0/2299255628 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4578013b50 con 0x7f4584133b80 2023-09-30T22:25:36.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.108+0000 7f45889f3700 1 -- 172.21.15.156:0/2299255628 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4584138410 con 0x7f4584133b80 2023-09-30T22:25:36.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.108+0000 7f45889f3700 1 -- 172.21.15.156:0/2299255628 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f458409a2c0 con 0x7f4584133b80 2023-09-30T22:25:36.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.108+0000 7f4a605fa700 1 -- 172.21.15.156:0/1202603956 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a58121d10 con 0x7f4a580a0a70 2023-09-30T22:25:36.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.109+0000 7f45889f3700 1 -- 172.21.15.156:0/2299255628 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f458404f2a0 con 0x7f4584133b80 2023-09-30T22:25:36.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.110+0000 7f4572ffd700 1 -- 172.21.15.156:0/2299255628 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4578013cb0 con 0x7f4584133b80 2023-09-30T22:25:36.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.113+0000 7f4572ffd700 1 -- 172.21.15.156:0/2299255628 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4578026950 con 0x7f4584133b80 2023-09-30T22:25:36.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.113+0000 7f4a4effd700 1 -- 172.21.15.156:0/1202603956 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4a54015080 con 0x7f4a580a0a70 2023-09-30T22:25:36.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.117+0000 7f4572ffd700 1 -- 172.21.15.156:0/2299255628 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4578011350 con 0x7f4584133b80 2023-09-30T22:25:36.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.165+0000 7fc99a3c4700 1 -- 172.21.15.156:0/3174840990 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc99404f2a0 con 0x7fc9940a1550 2023-09-30T22:25:36.166 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.166+0000 7fc990ff9700 1 -- 172.21.15.156:0/3174840990 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc98802b030 con 0x7fc9940a1550 2023-09-30T22:25:36.167 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:36.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.169+0000 7fc99a3c4700 1 -- 172.21.15.156:0/3174840990 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9940a1550 msgr2=0x7fc99411ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:36.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.169+0000 7fc99a3c4700 1 --2- 172.21.15.156:0/3174840990 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9940a1550 0x7fc99411ecb0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fc988009fd0 tx=0x7fc988004750 comp rx=0 tx=0).stop 2023-09-30T22:25:36.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.169+0000 7fc99a3c4700 1 -- 172.21.15.156:0/3174840990 shutdown_connections 2023-09-30T22:25:36.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.169+0000 7fc99a3c4700 1 --2- 172.21.15.156:0/3174840990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc994139200 0x7fc99411f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.169+0000 7fc99a3c4700 1 --2- 172.21.15.156:0/3174840990 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc9940a0a70 0x7fc99411e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.169+0000 7fc99a3c4700 1 --2- 172.21.15.156:0/3174840990 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc9940a1550 0x7fc99411ecb0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.169+0000 7fc99a3c4700 1 -- 172.21.15.156:0/3174840990 >> 172.21.15.156:0/3174840990 conn(0x7fc9940a6610 msgr2=0x7fc9940a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:36.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.169+0000 7fc99a3c4700 1 -- 172.21.15.156:0/3174840990 shutdown_connections 2023-09-30T22:25:36.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.169+0000 7fc99a3c4700 1 -- 172.21.15.156:0/3174840990 wait complete. 2023-09-30T22:25:36.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:36.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.224+0000 7f6125daa700 1 -- 172.21.15.156:0/2639557299 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6100005590 con 0x7f61201c8430 2023-09-30T22:25:36.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.225+0000 7f6107fff700 1 -- 172.21.15.156:0/2639557299 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6118017070 con 0x7f61201c8430 2023-09-30T22:25:36.225 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:36.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.228+0000 7f6125daa700 1 -- 172.21.15.156:0/2639557299 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61201c8430 msgr2=0x7f61201c88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:36.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.228+0000 7f6125daa700 1 --2- 172.21.15.156:0/2639557299 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61201c8430 0x7f61201c88d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f611800c780 tx=0x7f611800ca90 comp rx=0 tx=0).stop 2023-09-30T22:25:36.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.228+0000 7f6125daa700 1 -- 172.21.15.156:0/2639557299 shutdown_connections 2023-09-30T22:25:36.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.228+0000 7f6125daa700 1 --2- 172.21.15.156:0/2639557299 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f61201c8430 0x7f61201c88d0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.228+0000 7f6125daa700 1 --2- 172.21.15.156:0/2639557299 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f612009e170 0x7f6120138430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.228+0000 7f6125daa700 1 --2- 172.21.15.156:0/2639557299 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6120130ce0 0x7f6120138970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.228+0000 7f6125daa700 1 -- 172.21.15.156:0/2639557299 >> 172.21.15.156:0/2639557299 conn(0x7f6120099c40 msgr2=0x7f6120139710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:36.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.228+0000 7f6125daa700 1 -- 172.21.15.156:0/2639557299 shutdown_connections 2023-09-30T22:25:36.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.228+0000 7f6125daa700 1 -- 172.21.15.156:0/2639557299 wait complete. 2023-09-30T22:25:36.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:36.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.313+0000 7f45889f3700 1 -- 172.21.15.156:0/2299255628 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f458411b0d0 con 0x7f4584133b80 2023-09-30T22:25:36.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.313+0000 7f4572ffd700 1 -- 172.21.15.156:0/2299255628 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4578021070 con 0x7f4584133b80 2023-09-30T22:25:36.314 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:36.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.315+0000 7f45889f3700 1 -- 172.21.15.156:0/2299255628 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4584133b80 msgr2=0x7f4584119330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:36.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.315+0000 7f45889f3700 1 --2- 172.21.15.156:0/2299255628 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4584133b80 0x7f4584119330 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f457800e930 tx=0x7f457800ec40 comp rx=0 tx=0).stop 2023-09-30T22:25:36.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.315+0000 7f45889f3700 1 -- 172.21.15.156:0/2299255628 shutdown_connections 2023-09-30T22:25:36.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.315+0000 7f45889f3700 1 --2- 172.21.15.156:0/2299255628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4584138e30 0x7f4584119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.315+0000 7f45889f3700 1 --2- 172.21.15.156:0/2299255628 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4584099a60 0x7f4584118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.315+0000 7f45889f3700 1 --2- 172.21.15.156:0/2299255628 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4584133b80 0x7f4584119330 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.315+0000 7f45889f3700 1 -- 172.21.15.156:0/2299255628 >> 172.21.15.156:0/2299255628 conn(0x7f45840a2980 msgr2=0x7f458409b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:36.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.315+0000 7f45889f3700 1 -- 172.21.15.156:0/2299255628 shutdown_connections 2023-09-30T22:25:36.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.315+0000 7f45889f3700 1 -- 172.21.15.156:0/2299255628 wait complete. 2023-09-30T22:25:36.328 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:36.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.340+0000 7f4a605fa700 1 -- 172.21.15.156:0/1202603956 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4a5804f2a0 con 0x7f4a580a0a70 2023-09-30T22:25:36.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.340+0000 7f4a4effd700 1 -- 172.21.15.156:0/1202603956 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4a54010380 con 0x7f4a580a0a70 2023-09-30T22:25:36.341 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:36.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.342+0000 7f4a605fa700 1 -- 172.21.15.156:0/1202603956 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4a580a0a70 msgr2=0x7f4a5811e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:36.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.343+0000 7f4a605fa700 1 --2- 172.21.15.156:0/1202603956 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4a580a0a70 0x7f4a5811e520 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f4a54000c00 tx=0x7f4a54004750 comp rx=0 tx=0).stop 2023-09-30T22:25:36.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.343+0000 7f4a605fa700 1 -- 172.21.15.156:0/1202603956 shutdown_connections 2023-09-30T22:25:36.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.343+0000 7f4a605fa700 1 --2- 172.21.15.156:0/1202603956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a58134120 0x7f4a5811efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.343+0000 7f4a605fa700 1 --2- 172.21.15.156:0/1202603956 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4a580a0a70 0x7f4a5811e520 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.343+0000 7f4a605fa700 1 --2- 172.21.15.156:0/1202603956 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a580a1380 0x7f4a5811ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.343+0000 7f4a605fa700 1 -- 172.21.15.156:0/1202603956 >> 172.21.15.156:0/1202603956 conn(0x7f4a580a6610 msgr2=0x7f4a5809bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:36.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.343+0000 7f4a605fa700 1 -- 172.21.15.156:0/1202603956 shutdown_connections 2023-09-30T22:25:36.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:36.343+0000 7f4a605fa700 1 -- 172.21.15.156:0/1202603956 wait complete. 2023-09-30T22:25:36.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:37.188 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:37.242 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:37.328 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:37.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.328+0000 7faf13c8e700 1 Processor -- start 2023-09-30T22:25:37.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.328+0000 7faf13c8e700 1 -- start start 2023-09-30T22:25:37.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.329+0000 7faf13c8e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7faf0c133ad0 0x7faf0c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.329+0000 7faf13c8e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faf0c130bc0 0x7faf0c13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.329+0000 7faf13c8e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf0c06b2d0 con 0x7faf0c1300a0 2023-09-30T22:25:37.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.329+0000 7faf13c8e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf0c133610 con 0x7faf0c133ad0 2023-09-30T22:25:37.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.329+0000 7faf13c8e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c09a500 con 0x7faf0c130bc0 2023-09-30T22:25:37.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.329+0000 7faf11a2a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7faf0c133ad0 0x7faf0c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.329+0000 7faf1222b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faf0c130bc0 0x7faf0c13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.329+0000 7faf11a2a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7faf0c133ad0 0x7faf0c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34378/0 (socket says 172.21.15.156:34378) 2023-09-30T22:25:37.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.329+0000 7faf1222b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faf0c130bc0 0x7faf0c13b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56374/0 (socket says 172.21.15.156:56374) 2023-09-30T22:25:37.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.329+0000 7faf11a2a700 1 -- 172.21.15.156:0/875435895 learned_addr learned my addr 172.21.15.156:0/875435895 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:37.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.329+0000 7faf11229700 1 --1- 172.21.15.156:0/875435895 >> v1:172.21.15.156:6789/0 conn(0x7faf0c1300a0 0x7faf0c1304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:59352/0 (socket says 172.21.15.156:59352) 2023-09-30T22:25:37.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.329+0000 7faf1222b700 1 -- 172.21.15.156:0/875435895 >> v2:172.21.15.156:3300/0 conn(0x7faf0c133ad0 msgr2=0x7faf0c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:37.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.329+0000 7faf1222b700 1 --2- 172.21.15.156:0/875435895 >> v2:172.21.15.156:3300/0 conn(0x7faf0c133ad0 0x7faf0c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.329+0000 7faf1222b700 1 -- 172.21.15.156:0/875435895 >> v1:172.21.15.156:6789/0 conn(0x7faf0c1300a0 legacy=0x7faf0c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.329+0000 7faf1222b700 1 -- 172.21.15.156:0/875435895 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0c1338b0 con 0x7faf0c130bc0 2023-09-30T22:25:37.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.329+0000 7faf10a28700 1 -- 172.21.15.156:0/875435895 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 656121961 0 0) 0x7faf0c06b2d0 con 0x7faf0c1300a0 2023-09-30T22:25:37.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.329+0000 7faf11a2a700 1 --2- 172.21.15.156:0/875435895 >> v2:172.21.15.156:3300/0 conn(0x7faf0c133ad0 0x7faf0c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:37.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.329+0000 7faf1222b700 1 --2- 172.21.15.156:0/875435895 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faf0c130bc0 0x7faf0c13b990 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7faf04009d90 tx=0x7faf0400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dced0c5fa9de26db server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:37.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.330+0000 7faf10a28700 1 -- 172.21.15.156:0/875435895 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0400e070 con 0x7faf0c130bc0 2023-09-30T22:25:37.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.330+0000 7faf10a28700 1 -- 172.21.15.156:0/875435895 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0400bb20 con 0x7faf0c130bc0 2023-09-30T22:25:37.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.330+0000 7faf10a28700 1 -- 172.21.15.156:0/875435895 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf04012430 con 0x7faf0c130bc0 2023-09-30T22:25:37.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.330+0000 7faf13c8e700 1 -- 172.21.15.156:0/875435895 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faf0c130bc0 msgr2=0x7faf0c13b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.330+0000 7faf13c8e700 1 --2- 172.21.15.156:0/875435895 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faf0c130bc0 0x7faf0c13b990 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7faf04009d90 tx=0x7faf0400b330 comp rx=0 tx=0).stop 2023-09-30T22:25:37.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.330+0000 7faf13c8e700 1 -- 172.21.15.156:0/875435895 shutdown_connections 2023-09-30T22:25:37.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.330+0000 7faf13c8e700 1 --2- 172.21.15.156:0/875435895 >> v2:172.21.15.156:3300/0 conn(0x7faf0c133ad0 0x7faf0c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.330+0000 7faf13c8e700 1 --2- 172.21.15.156:0/875435895 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faf0c130bc0 0x7faf0c13b990 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.330+0000 7faf13c8e700 1 -- 172.21.15.156:0/875435895 >> 172.21.15.156:0/875435895 conn(0x7faf0c099c40 msgr2=0x7faf0c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:37.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.330+0000 7faf13c8e700 1 -- 172.21.15.156:0/875435895 shutdown_connections 2023-09-30T22:25:37.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.330+0000 7faf13c8e700 1 -- 172.21.15.156:0/875435895 wait complete. 2023-09-30T22:25:37.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.331+0000 7faf13c8e700 1 Processor -- start 2023-09-30T22:25:37.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.331+0000 7faf13c8e700 1 -- start start 2023-09-30T22:25:37.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.332+0000 7faf13c8e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf0c1300a0 0x7faf0c071370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.332+0000 7faf13c8e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faf0c130bc0 0x7faf0c0718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.332+0000 7faf13c8e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf0c133ad0 0x7faf0c071df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.332+0000 7faf13c8e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c11e100 con 0x7faf0c133ad0 2023-09-30T22:25:37.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.332+0000 7faf13c8e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c12f6f0 con 0x7faf0c1300a0 2023-09-30T22:25:37.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.332+0000 7faf13c8e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c12dd00 con 0x7faf0c130bc0 2023-09-30T22:25:37.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.332+0000 7faf11229700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faf0c130bc0 0x7faf0c0718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.332+0000 7faf11229700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faf0c130bc0 0x7faf0c0718b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56380/0 (socket says 172.21.15.156:56380) 2023-09-30T22:25:37.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.332+0000 7faf11229700 1 -- 172.21.15.156:0/3607134928 learned_addr learned my addr 172.21.15.156:0/3607134928 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:37.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.332+0000 7faf11a2a700 1 --2- 172.21.15.156:0/3607134928 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf0c1300a0 0x7faf0c071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.332+0000 7faf11229700 1 -- 172.21.15.156:0/3607134928 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf0c1300a0 msgr2=0x7faf0c071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.332+0000 7faf11229700 1 --2- 172.21.15.156:0/3607134928 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf0c1300a0 0x7faf0c071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.332+0000 7faf11229700 1 -- 172.21.15.156:0/3607134928 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf0c133ad0 msgr2=0x7faf0c071df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.332+0000 7faf11229700 1 --2- 172.21.15.156:0/3607134928 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf0c133ad0 0x7faf0c071df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.332+0000 7faf11229700 1 -- 172.21.15.156:0/3607134928 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf08009550 con 0x7faf0c130bc0 2023-09-30T22:25:37.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.332+0000 7faf11a2a700 1 --2- 172.21.15.156:0/3607134928 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf0c1300a0 0x7faf0c071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:37.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.332+0000 7faf11229700 1 --2- 172.21.15.156:0/3607134928 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faf0c130bc0 0x7faf0c0718b0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7faefc00c520 tx=0x7faefc00c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:37.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.333+0000 7faf027fc700 1 -- 172.21.15.156:0/3607134928 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc004c80 con 0x7faf0c130bc0 2023-09-30T22:25:37.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.333+0000 7faf027fc700 1 -- 172.21.15.156:0/3607134928 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc004e20 con 0x7faf0c130bc0 2023-09-30T22:25:37.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.333+0000 7faf13c8e700 1 -- 172.21.15.156:0/3607134928 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf04009a70 con 0x7faf0c130bc0 2023-09-30T22:25:37.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.333+0000 7faf027fc700 1 -- 172.21.15.156:0/3607134928 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc007310 con 0x7faf0c130bc0 2023-09-30T22:25:37.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.333+0000 7faf13c8e700 1 -- 172.21.15.156:0/3607134928 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0c11f960 con 0x7faf0c130bc0 2023-09-30T22:25:37.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.334+0000 7faf027fc700 1 -- 172.21.15.156:0/3607134928 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faefc007470 con 0x7faf0c130bc0 2023-09-30T22:25:37.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.334+0000 7faf13c8e700 1 -- 172.21.15.156:0/3607134928 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf0c09cb20 con 0x7faf0c130bc0 2023-09-30T22:25:37.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.334+0000 7faf027fc700 1 -- 172.21.15.156:0/3607134928 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faefc03f390 con 0x7faf0c130bc0 2023-09-30T22:25:37.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.339+0000 7faf027fc700 1 -- 172.21.15.156:0/3607134928 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faefc0123b0 con 0x7faf0c130bc0 2023-09-30T22:25:37.356 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:37.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.378+0000 7fbadde9d700 1 Processor -- start 2023-09-30T22:25:37.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.378+0000 7fbadde9d700 1 -- start start 2023-09-30T22:25:37.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.379+0000 7fbadde9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbad8136950 0x7fbad8138d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.379+0000 7fbadde9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbad8139270 0x7fbad813b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.379+0000 7fbadde9d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad8133640 con 0x7fbad8133a70 2023-09-30T22:25:37.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.379+0000 7fbadde9d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad80a1d50 con 0x7fbad8136950 2023-09-30T22:25:37.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.379+0000 7fbadde9d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad8134550 con 0x7fbad8139270 2023-09-30T22:25:37.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.379+0000 7fbad7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbad8139270 0x7fbad813b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.379+0000 7fbad6ffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbad8136950 0x7fbad8138d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.379+0000 7fbad77fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fbad8133a70 0x7fbad8133e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:59354/0 (socket says 172.21.15.156:59354) 2023-09-30T22:25:37.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.379+0000 7fbad77fe700 1 -- 172.21.15.156:0/739498511 learned_addr learned my addr 172.21.15.156:0/739498511 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:37.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.380+0000 7fbad7fff700 1 -- 172.21.15.156:0/739498511 >> v2:172.21.15.156:3300/0 conn(0x7fbad8136950 msgr2=0x7fbad8138d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:37.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.380+0000 7fbad7fff700 1 --2- 172.21.15.156:0/739498511 >> v2:172.21.15.156:3300/0 conn(0x7fbad8136950 0x7fbad8138d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.380+0000 7fbad7fff700 1 -- 172.21.15.156:0/739498511 >> v1:172.21.15.156:6789/0 conn(0x7fbad8133a70 legacy=0x7fbad8133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.380+0000 7fbad7fff700 1 -- 172.21.15.156:0/739498511 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad809b620 con 0x7fbad8139270 2023-09-30T22:25:37.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.380+0000 7fbad67fc700 1 -- 172.21.15.156:0/739498511 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551541200 0 0) 0x7fbad8133640 con 0x7fbad8133a70 2023-09-30T22:25:37.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.380+0000 7fbad7fff700 1 --2- 172.21.15.156:0/739498511 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbad8139270 0x7fbad813b650 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fbad0009d90 tx=0x7fbad000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=224b1205d3ecac90 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:37.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.380+0000 7fbad67fc700 1 -- 172.21.15.156:0/739498511 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad000e070 con 0x7fbad8139270 2023-09-30T22:25:37.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.380+0000 7fbad67fc700 1 -- 172.21.15.156:0/739498511 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad000bb20 con 0x7fbad8139270 2023-09-30T22:25:37.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.380+0000 7fbad67fc700 1 -- 172.21.15.156:0/739498511 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad0012430 con 0x7fbad8139270 2023-09-30T22:25:37.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.381+0000 7fbadde9d700 1 -- 172.21.15.156:0/739498511 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbad8139270 msgr2=0x7fbad813b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.381+0000 7fbadde9d700 1 --2- 172.21.15.156:0/739498511 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbad8139270 0x7fbad813b650 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fbad0009d90 tx=0x7fbad000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:37.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.381+0000 7fbadde9d700 1 -- 172.21.15.156:0/739498511 shutdown_connections 2023-09-30T22:25:37.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.381+0000 7fbadde9d700 1 --2- 172.21.15.156:0/739498511 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbad8139270 0x7fbad813b650 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.381+0000 7fbadde9d700 1 --2- 172.21.15.156:0/739498511 >> v2:172.21.15.156:3300/0 conn(0x7fbad8136950 0x7fbad8138d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.381+0000 7fbadde9d700 1 -- 172.21.15.156:0/739498511 >> 172.21.15.156:0/739498511 conn(0x7fbad80a2980 msgr2=0x7fbad80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:37.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.381+0000 7fbadde9d700 1 -- 172.21.15.156:0/739498511 shutdown_connections 2023-09-30T22:25:37.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.381+0000 7fbadde9d700 1 -- 172.21.15.156:0/739498511 wait complete. 2023-09-30T22:25:37.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.382+0000 7fbadde9d700 1 Processor -- start 2023-09-30T22:25:37.384 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.382+0000 7fbadde9d700 1 -- start start 2023-09-30T22:25:37.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.383+0000 7fbadde9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbad8133a70 0x7fbad8119c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.383+0000 7fbadde9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbad8136950 0x7fbad811a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.383+0000 7fbadde9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbad8139270 0x7fbad811a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.383+0000 7fbadde9d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad811d650 con 0x7fbad8133a70 2023-09-30T22:25:37.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.383+0000 7fbadde9d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad8133210 con 0x7fbad8136950 2023-09-30T22:25:37.385 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.383+0000 7fbadde9d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbad811aff0 con 0x7fbad8139270 2023-09-30T22:25:37.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.383+0000 7fbad6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbad8136950 0x7fbad811a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.383+0000 7fbad6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbad8136950 0x7fbad811a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51308/0 (socket says 172.21.15.156:51308) 2023-09-30T22:25:37.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.383+0000 7fbad6ffd700 1 -- 172.21.15.156:0/2481828984 learned_addr learned my addr 172.21.15.156:0/2481828984 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:37.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.383+0000 7fbad77fe700 1 --2- 172.21.15.156:0/2481828984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbad8133a70 0x7fbad8119c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.383+0000 7fbad7fff700 1 --2- 172.21.15.156:0/2481828984 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbad8139270 0x7fbad811a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.384+0000 7fbad6ffd700 1 -- 172.21.15.156:0/2481828984 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbad8139270 msgr2=0x7fbad811a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.384+0000 7fbad6ffd700 1 --2- 172.21.15.156:0/2481828984 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbad8139270 0x7fbad811a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.384+0000 7fbad6ffd700 1 -- 172.21.15.156:0/2481828984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbad8133a70 msgr2=0x7fbad8119c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.384+0000 7fbad6ffd700 1 --2- 172.21.15.156:0/2481828984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbad8133a70 0x7fbad8119c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.384+0000 7fbad6ffd700 1 -- 172.21.15.156:0/2481828984 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad0009a70 con 0x7fbad8136950 2023-09-30T22:25:37.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.384+0000 7fbad77fe700 1 --2- 172.21.15.156:0/2481828984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbad8133a70 0x7fbad8119c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:37.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.384+0000 7fbad6ffd700 1 --2- 172.21.15.156:0/2481828984 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbad8136950 0x7fbad811a140 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fbacc00e9b0 tx=0x7fbacc00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:37.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.384+0000 7fbabffff700 1 -- 172.21.15.156:0/2481828984 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc009710 con 0x7fbad8136950 2023-09-30T22:25:37.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.384+0000 7fbabffff700 1 -- 172.21.15.156:0/2481828984 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbacc00ee50 con 0x7fbad8136950 2023-09-30T22:25:37.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.384+0000 7fbabffff700 1 -- 172.21.15.156:0/2481828984 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc00ca50 con 0x7fbad8136950 2023-09-30T22:25:37.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.384+0000 7fbadde9d700 1 -- 172.21.15.156:0/2481828984 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad809a350 con 0x7fbad8136950 2023-09-30T22:25:37.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.384+0000 7fbadde9d700 1 -- 172.21.15.156:0/2481828984 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad811bf30 con 0x7fbad8136950 2023-09-30T22:25:37.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.385+0000 7fbabffff700 1 -- 172.21.15.156:0/2481828984 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbacc00cbb0 con 0x7fbad8136950 2023-09-30T22:25:37.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.386+0000 7fbabffff700 1 -- 172.21.15.156:0/2481828984 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbacc042220 con 0x7fbad8136950 2023-09-30T22:25:37.388 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.388+0000 7fbadde9d700 1 -- 172.21.15.156:0/2481828984 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad804f2a0 con 0x7fbad8136950 2023-09-30T22:25:37.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.393+0000 7fbabffff700 1 -- 172.21.15.156:0/2481828984 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbacc017020 con 0x7fbad8136950 2023-09-30T22:25:37.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.473+0000 7f8fb4703700 1 Processor -- start 2023-09-30T22:25:37.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.473+0000 7f8fb4703700 1 -- start start 2023-09-30T22:25:37.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.473+0000 7f8fb4703700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8fac133b80 0x7f8fac133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.473+0000 7f8fb4703700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8fac0a0ff0 0x7f8fac13b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.473+0000 7f8fb4703700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fac09aa00 con 0x7f8fac099a60 2023-09-30T22:25:37.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.473+0000 7f8fb4703700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac09a080 con 0x7f8fac0a0ff0 2023-09-30T22:25:37.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.473+0000 7f8fb4703700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac133750 con 0x7f8fac133b80 2023-09-30T22:25:37.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.474+0000 7f8fb249f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8fac133b80 0x7f8fac133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.474+0000 7f8fb249f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8fac133b80 0x7f8fac133f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56406/0 (socket says 172.21.15.156:56406) 2023-09-30T22:25:37.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.474+0000 7f8fb249f700 1 -- 172.21.15.156:0/1028977855 learned_addr learned my addr 172.21.15.156:0/1028977855 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:37.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.474+0000 7f8fb2ca0700 1 --2- 172.21.15.156:0/1028977855 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8fac0a0ff0 0x7f8fac13b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.474+0000 7f8fb249f700 1 -- 172.21.15.156:0/1028977855 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8fac0a0ff0 msgr2=0x7f8fac13b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:37.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.474+0000 7f8fb249f700 1 --2- 172.21.15.156:0/1028977855 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8fac0a0ff0 0x7f8fac13b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.474+0000 7f8fb249f700 1 -- 172.21.15.156:0/1028977855 >> v1:172.21.15.156:6789/0 conn(0x7f8fac099a60 legacy=0x7f8fac0a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.474+0000 7f8fb249f700 1 -- 172.21.15.156:0/1028977855 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fac09a760 con 0x7f8fac133b80 2023-09-30T22:25:37.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.474+0000 7f8fb249f700 1 --2- 172.21.15.156:0/1028977855 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8fac133b80 0x7f8fac133f50 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f8fa80098f0 tx=0x7f8fa8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c988f1a4d5406643 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:37.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.474+0000 7f8fb149d700 1 -- 172.21.15.156:0/1028977855 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8005e30 con 0x7f8fac133b80 2023-09-30T22:25:37.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.474+0000 7f8fb149d700 1 -- 172.21.15.156:0/1028977855 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa8004030 con 0x7f8fac133b80 2023-09-30T22:25:37.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.474+0000 7f8fb149d700 1 -- 172.21.15.156:0/1028977855 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa80043e0 con 0x7f8fac133b80 2023-09-30T22:25:37.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.475+0000 7f8fb4703700 1 -- 172.21.15.156:0/1028977855 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8fac133b80 msgr2=0x7f8fac133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.475+0000 7f8fb4703700 1 --2- 172.21.15.156:0/1028977855 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8fac133b80 0x7f8fac133f50 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f8fa80098f0 tx=0x7f8fa8009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:37.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.475+0000 7f8fb4703700 1 -- 172.21.15.156:0/1028977855 shutdown_connections 2023-09-30T22:25:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.475+0000 7f8fb4703700 1 --2- 172.21.15.156:0/1028977855 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8fac0a0ff0 0x7f8fac13b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.475+0000 7f8fb4703700 1 --2- 172.21.15.156:0/1028977855 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8fac133b80 0x7f8fac133f50 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.475+0000 7f8fb4703700 1 -- 172.21.15.156:0/1028977855 >> 172.21.15.156:0/1028977855 conn(0x7f8fac0a2980 msgr2=0x7f8fac0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.475+0000 7f8fb4703700 1 -- 172.21.15.156:0/1028977855 shutdown_connections 2023-09-30T22:25:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.475+0000 7f8fb4703700 1 -- 172.21.15.156:0/1028977855 wait complete. 2023-09-30T22:25:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.476+0000 7f8fb4703700 1 Processor -- start 2023-09-30T22:25:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.476+0000 7f8fb4703700 1 -- start start 2023-09-30T22:25:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.476+0000 7f8fb4703700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8fac099a60 0x7f8fac11b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.476+0000 7f8fb4703700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8fac0a0ff0 0x7f8fac11bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.476+0000 7f8fb4703700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8fac133b80 0x7f8fac11c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.476+0000 7f8fb4703700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac11d380 con 0x7f8fac133b80 2023-09-30T22:25:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.476+0000 7f8fb4703700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac11e5d0 con 0x7f8fac099a60 2023-09-30T22:25:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.476+0000 7f8fb4703700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac11d960 con 0x7f8fac0a0ff0 2023-09-30T22:25:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.477+0000 7f8fb1c9e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8fac0a0ff0 0x7f8fac11bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.477+0000 7f8fb249f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8fac099a60 0x7f8fac11b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.477+0000 7f8fb1c9e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8fac0a0ff0 0x7f8fac11bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56410/0 (socket says 172.21.15.156:56410) 2023-09-30T22:25:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.477+0000 7f8fb1c9e700 1 -- 172.21.15.156:0/220709704 learned_addr learned my addr 172.21.15.156:0/220709704 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.477+0000 7f8fb2ca0700 1 --2- 172.21.15.156:0/220709704 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8fac133b80 0x7f8fac11c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.477+0000 7f8fb249f700 1 -- 172.21.15.156:0/220709704 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8fac0a0ff0 msgr2=0x7f8fac11bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.477+0000 7f8fb249f700 1 --2- 172.21.15.156:0/220709704 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8fac0a0ff0 0x7f8fac11bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.477+0000 7f8fb249f700 1 -- 172.21.15.156:0/220709704 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8fac133b80 msgr2=0x7f8fac11c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.477+0000 7f8fb249f700 1 --2- 172.21.15.156:0/220709704 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8fac133b80 0x7f8fac11c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.477+0000 7f8fb249f700 1 -- 172.21.15.156:0/220709704 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa8009500 con 0x7f8fac099a60 2023-09-30T22:25:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.477+0000 7f8fb2ca0700 1 --2- 172.21.15.156:0/220709704 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8fac133b80 0x7f8fac11c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.477+0000 7f8fb1c9e700 1 --2- 172.21.15.156:0/220709704 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8fac0a0ff0 0x7f8fac11bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:37.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.477+0000 7f8fb249f700 1 --2- 172.21.15.156:0/220709704 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8fac099a60 0x7f8fac11b810 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8013000 tx=0x7f8fa8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:37.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.477+0000 7f8fa2ffd700 1 -- 172.21.15.156:0/220709704 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa80045d0 con 0x7f8fac099a60 2023-09-30T22:25:37.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.478+0000 7f8fa2ffd700 1 -- 172.21.15.156:0/220709704 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa80038b0 con 0x7f8fac099a60 2023-09-30T22:25:37.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.478+0000 7f8fa2ffd700 1 -- 172.21.15.156:0/220709704 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8003c40 con 0x7f8fac099a60 2023-09-30T22:25:37.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.478+0000 7f8fb4703700 1 -- 172.21.15.156:0/220709704 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fac11efb0 con 0x7f8fac099a60 2023-09-30T22:25:37.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.478+0000 7f8fb4703700 1 -- 172.21.15.156:0/220709704 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fac11ea80 con 0x7f8fac099a60 2023-09-30T22:25:37.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.479+0000 7f8fa2ffd700 1 -- 172.21.15.156:0/220709704 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8fa8018070 con 0x7f8fac099a60 2023-09-30T22:25:37.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.479+0000 7f8fb4703700 1 -- 172.21.15.156:0/220709704 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fac09a320 con 0x7f8fac099a60 2023-09-30T22:25:37.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.479+0000 7f8fa2ffd700 1 -- 172.21.15.156:0/220709704 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8fa803fc70 con 0x7f8fac099a60 2023-09-30T22:25:37.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.487+0000 7f8fa2ffd700 1 -- 172.21.15.156:0/220709704 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8fa8006030 con 0x7f8fac099a60 2023-09-30T22:25:37.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.491+0000 7f68f5c60700 1 Processor -- start 2023-09-30T22:25:37.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.491+0000 7f68f5c60700 1 -- start start 2023-09-30T22:25:37.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.492+0000 7f68f5c60700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f68f009ad40 0x7f68f0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.492+0000 7f68f5c60700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68f01343d0 0x7f68f00a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.492+0000 7f68f5c60700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f009b110 con 0x7f68f0133f70 2023-09-30T22:25:37.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.492+0000 7f68f5c60700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f00a3b60 con 0x7f68f009ad40 2023-09-30T22:25:37.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.492+0000 7f68f5c60700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f0134850 con 0x7f68f01343d0 2023-09-30T22:25:37.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.492+0000 7f68ef7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f68f009ad40 0x7f68f0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.492+0000 7f68eeffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f68f0133f70 0x7f68f00a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:59364/0 (socket says 172.21.15.156:59364) 2023-09-30T22:25:37.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.492+0000 7f68eeffd700 1 -- 172.21.15.156:0/1847379597 learned_addr learned my addr 172.21.15.156:0/1847379597 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:37.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.492+0000 7f68effff700 1 --2- 172.21.15.156:0/1847379597 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68f01343d0 0x7f68f00a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.492+0000 7f68ef7fe700 1 -- 172.21.15.156:0/1847379597 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68f01343d0 msgr2=0x7f68f00a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:37.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.492+0000 7f68ef7fe700 1 --2- 172.21.15.156:0/1847379597 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68f01343d0 0x7f68f00a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.492+0000 7f68ef7fe700 1 -- 172.21.15.156:0/1847379597 >> v1:172.21.15.156:6789/0 conn(0x7f68f0133f70 legacy=0x7f68f00a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.492+0000 7f68ee7fc700 1 -- 172.21.15.156:0/1847379597 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3826906757 0 0) 0x7f68f009b110 con 0x7f68f0133f70 2023-09-30T22:25:37.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.492+0000 7f68ef7fe700 1 -- 172.21.15.156:0/1847379597 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f00a2fa0 con 0x7f68f009ad40 2023-09-30T22:25:37.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.492+0000 7f68effff700 1 --2- 172.21.15.156:0/1847379597 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68f01343d0 0x7f68f00a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:37.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.493+0000 7f68ef7fe700 1 --2- 172.21.15.156:0/1847379597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68f009ad40 0x7f68f0133a30 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f68e0009840 tx=0x7f68e0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32351c48b0d3fd41 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:37.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.493+0000 7f68ee7fc700 1 -- 172.21.15.156:0/1847379597 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0011830 con 0x7f68f009ad40 2023-09-30T22:25:37.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.493+0000 7f68ee7fc700 1 -- 172.21.15.156:0/1847379597 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e0011990 con 0x7f68f009ad40 2023-09-30T22:25:37.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.493+0000 7f68ee7fc700 1 -- 172.21.15.156:0/1847379597 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0011d20 con 0x7f68f009ad40 2023-09-30T22:25:37.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.493+0000 7f68f5c60700 1 -- 172.21.15.156:0/1847379597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68f009ad40 msgr2=0x7f68f0133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.493+0000 7f68f5c60700 1 --2- 172.21.15.156:0/1847379597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68f009ad40 0x7f68f0133a30 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f68e0009840 tx=0x7f68e0009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:37.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.494+0000 7f68f5c60700 1 -- 172.21.15.156:0/1847379597 shutdown_connections 2023-09-30T22:25:37.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.494+0000 7f68f5c60700 1 --2- 172.21.15.156:0/1847379597 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68f01343d0 0x7f68f00a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.494+0000 7f68f5c60700 1 --2- 172.21.15.156:0/1847379597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68f009ad40 0x7f68f0133a30 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.494+0000 7f68f5c60700 1 -- 172.21.15.156:0/1847379597 >> 172.21.15.156:0/1847379597 conn(0x7f68f0099c40 msgr2=0x7f68f006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:37.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.494+0000 7f68f5c60700 1 -- 172.21.15.156:0/1847379597 shutdown_connections 2023-09-30T22:25:37.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.494+0000 7f68f5c60700 1 -- 172.21.15.156:0/1847379597 wait complete. 2023-09-30T22:25:37.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.494+0000 7f68f5c60700 1 Processor -- start 2023-09-30T22:25:37.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.495+0000 7f68f5c60700 1 -- start start 2023-09-30T22:25:37.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.495+0000 7f68f5c60700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f68f009ad40 0x7f68f0121400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.495+0000 7f68f5c60700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68f0133f70 0x7f68f0121940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.495+0000 7f68f5c60700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68f01343d0 0x7f68f0121e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.495+0000 7f68f5c60700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f0123e50 con 0x7f68f0133f70 2023-09-30T22:25:37.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.495+0000 7f68f5c60700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f0132710 con 0x7f68f01343d0 2023-09-30T22:25:37.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.495+0000 7f68f5c60700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68f01227f0 con 0x7f68f009ad40 2023-09-30T22:25:37.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.495+0000 7f68eeffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68f0133f70 0x7f68f0121940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.495+0000 7f68eeffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68f0133f70 0x7f68f0121940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34446/0 (socket says 172.21.15.156:34446) 2023-09-30T22:25:37.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.495+0000 7f68eeffd700 1 -- 172.21.15.156:0/587628427 learned_addr learned my addr 172.21.15.156:0/587628427 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:37.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.495+0000 7f68effff700 1 --2- 172.21.15.156:0/587628427 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68f01343d0 0x7f68f0121e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.496+0000 7f68ef7fe700 1 --2- 172.21.15.156:0/587628427 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f68f009ad40 0x7f68f0121400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.496+0000 7f68eeffd700 1 -- 172.21.15.156:0/587628427 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f68f009ad40 msgr2=0x7f68f0121400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.496+0000 7f68eeffd700 1 --2- 172.21.15.156:0/587628427 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f68f009ad40 0x7f68f0121400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.496+0000 7f68eeffd700 1 -- 172.21.15.156:0/587628427 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68f01343d0 msgr2=0x7f68f0121e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.496+0000 7f68eeffd700 1 --2- 172.21.15.156:0/587628427 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68f01343d0 0x7f68f0121e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.496+0000 7f68eeffd700 1 -- 172.21.15.156:0/587628427 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e8009a70 con 0x7f68f0133f70 2023-09-30T22:25:37.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.496+0000 7f68ef7fe700 1 --2- 172.21.15.156:0/587628427 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f68f009ad40 0x7f68f0121400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:37.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.496+0000 7f68eeffd700 1 --2- 172.21.15.156:0/587628427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68f0133f70 0x7f68f0121940 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f68e400c550 tx=0x7f68e400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:37.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.496+0000 7f68d7fff700 1 -- 172.21.15.156:0/587628427 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e4004c80 con 0x7f68f0133f70 2023-09-30T22:25:37.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.496+0000 7f68f5c60700 1 -- 172.21.15.156:0/587628427 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68e00094a0 con 0x7f68f0133f70 2023-09-30T22:25:37.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.496+0000 7f68d7fff700 1 -- 172.21.15.156:0/587628427 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e4004e00 con 0x7f68f0133f70 2023-09-30T22:25:37.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.496+0000 7f68d7fff700 1 -- 172.21.15.156:0/587628427 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e4007310 con 0x7f68f0133f70 2023-09-30T22:25:37.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.496+0000 7f68f5c60700 1 -- 172.21.15.156:0/587628427 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f009d360 con 0x7f68f0133f70 2023-09-30T22:25:37.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.497+0000 7f68d7fff700 1 -- 172.21.15.156:0/587628427 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f68e4007470 con 0x7f68f0133f70 2023-09-30T22:25:37.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.497+0000 7f68d7fff700 1 -- 172.21.15.156:0/587628427 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f68e403f3b0 con 0x7f68f0133f70 2023-09-30T22:25:37.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.498+0000 7f68f5c60700 1 -- 172.21.15.156:0/587628427 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f011e060 con 0x7f68f0133f70 2023-09-30T22:25:37.507 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.506+0000 7f68d7fff700 1 -- 172.21.15.156:0/587628427 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68e40123b0 con 0x7f68f0133f70 2023-09-30T22:25:37.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.589+0000 7faf13c8e700 1 -- 172.21.15.156:0/3607134928 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faf0c04f2a0 con 0x7faf0c130bc0 2023-09-30T22:25:37.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.589+0000 7faf027fc700 1 -- 172.21.15.156:0/3607134928 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faefc011360 con 0x7faf0c130bc0 2023-09-30T22:25:37.590 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:37.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.592+0000 7faf13c8e700 1 -- 172.21.15.156:0/3607134928 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faf0c130bc0 msgr2=0x7faf0c0718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.592+0000 7faf13c8e700 1 --2- 172.21.15.156:0/3607134928 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faf0c130bc0 0x7faf0c0718b0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7faefc00c520 tx=0x7faefc00c8e0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.592+0000 7faf13c8e700 1 -- 172.21.15.156:0/3607134928 shutdown_connections 2023-09-30T22:25:37.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.592+0000 7faf13c8e700 1 --2- 172.21.15.156:0/3607134928 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf0c133ad0 0x7faf0c071df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.592+0000 7faf13c8e700 1 --2- 172.21.15.156:0/3607134928 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf0c1300a0 0x7faf0c071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.592+0000 7faf13c8e700 1 --2- 172.21.15.156:0/3607134928 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faf0c130bc0 0x7faf0c0718b0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.592+0000 7faf13c8e700 1 -- 172.21.15.156:0/3607134928 >> 172.21.15.156:0/3607134928 conn(0x7faf0c099c40 msgr2=0x7faf0c132a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:37.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.592+0000 7faf13c8e700 1 -- 172.21.15.156:0/3607134928 shutdown_connections 2023-09-30T22:25:37.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.592+0000 7faf13c8e700 1 -- 172.21.15.156:0/3607134928 wait complete. 2023-09-30T22:25:37.605 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:37.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.670+0000 7fbadde9d700 1 -- 172.21.15.156:0/2481828984 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbad806bce0 con 0x7fbad8136950 2023-09-30T22:25:37.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.671+0000 7fbabffff700 1 -- 172.21.15.156:0/2481828984 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbacc0102b0 con 0x7fbad8136950 2023-09-30T22:25:37.672 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:37.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.673+0000 7fbadde9d700 1 -- 172.21.15.156:0/2481828984 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbad8136950 msgr2=0x7fbad811a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.673+0000 7fbadde9d700 1 --2- 172.21.15.156:0/2481828984 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbad8136950 0x7fbad811a140 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fbacc00e9b0 tx=0x7fbacc00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.673+0000 7fbadde9d700 1 -- 172.21.15.156:0/2481828984 shutdown_connections 2023-09-30T22:25:37.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.673+0000 7fbadde9d700 1 --2- 172.21.15.156:0/2481828984 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbad8139270 0x7fbad811a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.673+0000 7fbadde9d700 1 --2- 172.21.15.156:0/2481828984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbad8133a70 0x7fbad8119c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.673+0000 7fbadde9d700 1 --2- 172.21.15.156:0/2481828984 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbad8136950 0x7fbad811a140 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.673+0000 7fbadde9d700 1 -- 172.21.15.156:0/2481828984 >> 172.21.15.156:0/2481828984 conn(0x7fbad80a2980 msgr2=0x7fbad8134730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:37.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.673+0000 7fbadde9d700 1 -- 172.21.15.156:0/2481828984 shutdown_connections 2023-09-30T22:25:37.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.673+0000 7fbadde9d700 1 -- 172.21.15.156:0/2481828984 wait complete. 2023-09-30T22:25:37.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:37.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.740+0000 7f68f5c60700 1 -- 172.21.15.156:0/587628427 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f68f01241a0 con 0x7f68f0133f70 2023-09-30T22:25:37.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.741+0000 7f68d7fff700 1 -- 172.21.15.156:0/587628427 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f68e401b340 con 0x7f68f0133f70 2023-09-30T22:25:37.742 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:37.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.743+0000 7f68f5c60700 1 -- 172.21.15.156:0/587628427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68f0133f70 msgr2=0x7f68f0121940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.743+0000 7f68f5c60700 1 --2- 172.21.15.156:0/587628427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68f0133f70 0x7f68f0121940 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f68e400c550 tx=0x7f68e400c910 comp rx=0 tx=0).stop 2023-09-30T22:25:37.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.743+0000 7f68f5c60700 1 -- 172.21.15.156:0/587628427 shutdown_connections 2023-09-30T22:25:37.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.743+0000 7f68f5c60700 1 --2- 172.21.15.156:0/587628427 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68f01343d0 0x7f68f0121e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.743+0000 7f68f5c60700 1 --2- 172.21.15.156:0/587628427 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f68f009ad40 0x7f68f0121400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.743+0000 7f68f5c60700 1 --2- 172.21.15.156:0/587628427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68f0133f70 0x7f68f0121940 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.743+0000 7f68f5c60700 1 -- 172.21.15.156:0/587628427 >> 172.21.15.156:0/587628427 conn(0x7f68f0099c40 msgr2=0x7f68f00a6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:37.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.743+0000 7f68f5c60700 1 -- 172.21.15.156:0/587628427 shutdown_connections 2023-09-30T22:25:37.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.743+0000 7f68f5c60700 1 -- 172.21.15.156:0/587628427 wait complete. 2023-09-30T22:25:37.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.750+0000 7f8fb4703700 1 -- 172.21.15.156:0/220709704 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8fac11ea80 con 0x7f8fac099a60 2023-09-30T22:25:37.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.751+0000 7f8fa2ffd700 1 -- 172.21.15.156:0/220709704 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8fac11ea80 con 0x7f8fac099a60 2023-09-30T22:25:37.752 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:37.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.753+0000 7f8fb4703700 1 -- 172.21.15.156:0/220709704 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8fac099a60 msgr2=0x7f8fac11b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.753+0000 7f8fb4703700 1 --2- 172.21.15.156:0/220709704 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8fac099a60 0x7f8fac11b810 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8013000 tx=0x7f8fa8004750 comp rx=0 tx=0).stop 2023-09-30T22:25:37.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.753+0000 7f8fb4703700 1 -- 172.21.15.156:0/220709704 shutdown_connections 2023-09-30T22:25:37.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.753+0000 7f8fb4703700 1 --2- 172.21.15.156:0/220709704 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8fac133b80 0x7f8fac11c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.753+0000 7f8fb4703700 1 --2- 172.21.15.156:0/220709704 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8fac099a60 0x7f8fac11b810 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.753+0000 7f8fb4703700 1 --2- 172.21.15.156:0/220709704 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8fac0a0ff0 0x7f8fac11bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.753+0000 7f8fb4703700 1 -- 172.21.15.156:0/220709704 >> 172.21.15.156:0/220709704 conn(0x7f8fac0a2980 msgr2=0x7f8fac1bb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:37.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.753+0000 7f8fb4703700 1 -- 172.21.15.156:0/220709704 shutdown_connections 2023-09-30T22:25:37.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:37.753+0000 7f8fb4703700 1 -- 172.21.15.156:0/220709704 wait complete. 2023-09-30T22:25:37.756 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:37.766 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:38.606 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:38.687 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:38.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.745+0000 7f2198747700 1 Processor -- start 2023-09-30T22:25:38.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.745+0000 7f2198747700 1 -- start start 2023-09-30T22:25:38.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.746+0000 7f2198747700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f21900a0a70 0x7f21900a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.746+0000 7f2198747700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f21900a1380 0x7f2190133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.746+0000 7f2198747700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2190133f50 0x7f21901343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.746+0000 7f2198747700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f219009e9d0 con 0x7f21900a0a70 2023-09-30T22:25:38.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.746+0000 7f2198747700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219009dc00 con 0x7f2190133f50 2023-09-30T22:25:38.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.746+0000 7f2198747700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f219009dec0 con 0x7f21900a1380 2023-09-30T22:25:38.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.746+0000 7f2195ce2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f21900a1380 0x7f2190133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.746+0000 7f21964e3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f21900a0a70 0x7f21900a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.746+0000 7f2196ce4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2190133f50 0x7f21901343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.746+0000 7f21964e3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f21900a0a70 0x7f21900a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34448/0 (socket says 172.21.15.156:34448) 2023-09-30T22:25:38.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.746+0000 7f2195ce2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f21900a1380 0x7f2190133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56428/0 (socket says 172.21.15.156:56428) 2023-09-30T22:25:38.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.746+0000 7f21964e3700 1 -- 172.21.15.156:0/4210602691 learned_addr learned my addr 172.21.15.156:0/4210602691 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:38.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.746+0000 7f2195ce2700 1 -- 172.21.15.156:0/4210602691 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2190133f50 msgr2=0x7f21901343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:38.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.746+0000 7f2195ce2700 1 --2- 172.21.15.156:0/4210602691 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2190133f50 0x7f21901343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.746+0000 7f2195ce2700 1 -- 172.21.15.156:0/4210602691 >> v2:172.21.15.156:3300/0 conn(0x7f21900a0a70 msgr2=0x7f21900a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:38.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.746+0000 7f2195ce2700 1 --2- 172.21.15.156:0/4210602691 >> v2:172.21.15.156:3300/0 conn(0x7f21900a0a70 0x7f21900a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.746+0000 7f2195ce2700 1 -- 172.21.15.156:0/4210602691 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219009e6a0 con 0x7f21900a1380 2023-09-30T22:25:38.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.746+0000 7f21964e3700 1 --2- 172.21.15.156:0/4210602691 >> v2:172.21.15.156:3300/0 conn(0x7f21900a0a70 0x7f21900a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:38.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.746+0000 7f2195ce2700 1 --2- 172.21.15.156:0/4210602691 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f21900a1380 0x7f2190133a10 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f2180009840 tx=0x7f2180009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dabf8eb0c1674309 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:38.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.747+0000 7f21954e1700 1 -- 172.21.15.156:0/4210602691 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2180011830 con 0x7f21900a1380 2023-09-30T22:25:38.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.747+0000 7f21954e1700 1 -- 172.21.15.156:0/4210602691 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2180011990 con 0x7f21900a1380 2023-09-30T22:25:38.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.747+0000 7f21954e1700 1 -- 172.21.15.156:0/4210602691 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2180011d20 con 0x7f21900a1380 2023-09-30T22:25:38.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.747+0000 7f2198747700 1 -- 172.21.15.156:0/4210602691 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f21900a1380 msgr2=0x7f2190133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.747+0000 7f2198747700 1 --2- 172.21.15.156:0/4210602691 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f21900a1380 0x7f2190133a10 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f2180009840 tx=0x7f2180009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:38.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.747+0000 7f2198747700 1 -- 172.21.15.156:0/4210602691 shutdown_connections 2023-09-30T22:25:38.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.747+0000 7f2198747700 1 --2- 172.21.15.156:0/4210602691 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2190133f50 0x7f21901343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.747+0000 7f2198747700 1 --2- 172.21.15.156:0/4210602691 >> v2:172.21.15.156:3300/0 conn(0x7f21900a0a70 0x7f21900a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.747+0000 7f2198747700 1 --2- 172.21.15.156:0/4210602691 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f21900a1380 0x7f2190133a10 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.747+0000 7f2198747700 1 -- 172.21.15.156:0/4210602691 >> 172.21.15.156:0/4210602691 conn(0x7f21900a6610 msgr2=0x7f21900a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:38.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.747+0000 7f2198747700 1 -- 172.21.15.156:0/4210602691 shutdown_connections 2023-09-30T22:25:38.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.747+0000 7f2198747700 1 -- 172.21.15.156:0/4210602691 wait complete. 2023-09-30T22:25:38.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.748+0000 7f2198747700 1 Processor -- start 2023-09-30T22:25:38.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.748+0000 7f2198747700 1 -- start start 2023-09-30T22:25:38.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.749+0000 7f2198747700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f21900a0a70 0x7f21901223b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.749+0000 7f2198747700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21900a1380 0x7f21901228f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.749+0000 7f2198747700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2190133f50 0x7f2190122e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.749+0000 7f2198747700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2190125180 con 0x7f21900a1380 2023-09-30T22:25:38.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.749+0000 7f2198747700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2190124dc0 con 0x7f21900a0a70 2023-09-30T22:25:38.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.749+0000 7f2198747700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21900a03e0 con 0x7f2190133f50 2023-09-30T22:25:38.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.749+0000 7f2195ce2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21900a1380 0x7f21901228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.749+0000 7f2196ce4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2190133f50 0x7f2190122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.749+0000 7f2195ce2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21900a1380 0x7f21901228f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34462/0 (socket says 172.21.15.156:34462) 2023-09-30T22:25:38.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.749+0000 7f2195ce2700 1 -- 172.21.15.156:0/1506487639 learned_addr learned my addr 172.21.15.156:0/1506487639 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:38.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.749+0000 7f21964e3700 1 --2- 172.21.15.156:0/1506487639 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f21900a0a70 0x7f21901223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.749+0000 7f2195ce2700 1 -- 172.21.15.156:0/1506487639 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2190133f50 msgr2=0x7f2190122e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.749+0000 7f2195ce2700 1 --2- 172.21.15.156:0/1506487639 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2190133f50 0x7f2190122e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.749+0000 7f2195ce2700 1 -- 172.21.15.156:0/1506487639 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f21900a0a70 msgr2=0x7f21901223b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.749+0000 7f2195ce2700 1 --2- 172.21.15.156:0/1506487639 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f21900a0a70 0x7f21901223b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.749+0000 7f2195ce2700 1 -- 172.21.15.156:0/1506487639 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218c009550 con 0x7f21900a1380 2023-09-30T22:25:38.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.749+0000 7f2196ce4700 1 --2- 172.21.15.156:0/1506487639 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2190133f50 0x7f2190122e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:38.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.749+0000 7f21964e3700 1 --2- 172.21.15.156:0/1506487639 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f21900a0a70 0x7f21901223b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:38.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.749+0000 7f2195ce2700 1 --2- 172.21.15.156:0/1506487639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21900a1380 0x7f21901228f0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f21800090b0 tx=0x7f2180004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:38.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.749+0000 7f2186ffd700 1 -- 172.21.15.156:0/1506487639 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2180004450 con 0x7f21900a1380 2023-09-30T22:25:38.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.749+0000 7f2186ffd700 1 -- 172.21.15.156:0/1506487639 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218001f070 con 0x7f21900a1380 2023-09-30T22:25:38.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.749+0000 7f2198747700 1 -- 172.21.15.156:0/1506487639 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21800094a0 con 0x7f21900a1380 2023-09-30T22:25:38.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.749+0000 7f2186ffd700 1 -- 172.21.15.156:0/1506487639 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21800038e0 con 0x7f21900a1380 2023-09-30T22:25:38.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.750+0000 7f2198747700 1 -- 172.21.15.156:0/1506487639 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2190125900 con 0x7f21900a1380 2023-09-30T22:25:38.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.751+0000 7f2198747700 1 -- 172.21.15.156:0/1506487639 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f219011f760 con 0x7f21900a1380 2023-09-30T22:25:38.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.751+0000 7f2186ffd700 1 -- 172.21.15.156:0/1506487639 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2180003a40 con 0x7f21900a1380 2023-09-30T22:25:38.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.751+0000 7f2186ffd700 1 -- 172.21.15.156:0/1506487639 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2180021070 con 0x7f21900a1380 2023-09-30T22:25:38.761 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:38.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.756+0000 7f2186ffd700 1 -- 172.21.15.156:0/1506487639 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f21800253e0 con 0x7f21900a1380 2023-09-30T22:25:38.767 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:38.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.839+0000 7fe86e506700 1 Processor -- start 2023-09-30T22:25:38.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.839+0000 7fe86e506700 1 -- start start 2023-09-30T22:25:38.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.840+0000 7fe86e506700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe868131980 0x7fe868131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.840+0000 7fe86e506700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe86809c790 0x7fe868139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.840+0000 7fe86e506700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8680a1640 con 0x7fe86809bc70 2023-09-30T22:25:38.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.840+0000 7fe86e506700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe86806eb30 con 0x7fe868131980 2023-09-30T22:25:38.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.840+0000 7fe86e506700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8680a22d0 con 0x7fe86809c790 2023-09-30T22:25:38.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.840+0000 7fe867fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe868131980 0x7fe868131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.840+0000 7fe8677fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe86809bc70 0x7fe86809c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:59366/0 (socket says 172.21.15.156:59366) 2023-09-30T22:25:38.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.840+0000 7fe8677fe700 1 -- 172.21.15.156:0/2060873945 learned_addr learned my addr 172.21.15.156:0/2060873945 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:38.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.840+0000 7fe86caa3700 1 --2- 172.21.15.156:0/2060873945 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe86809c790 0x7fe868139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.840+0000 7fe867fff700 1 -- 172.21.15.156:0/2060873945 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe86809c790 msgr2=0x7fe868139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:38.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.840+0000 7fe867fff700 1 --2- 172.21.15.156:0/2060873945 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe86809c790 0x7fe868139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.840+0000 7fe867fff700 1 -- 172.21.15.156:0/2060873945 >> v1:172.21.15.156:6789/0 conn(0x7fe86809bc70 legacy=0x7fe86809c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.840+0000 7fe867fff700 1 -- 172.21.15.156:0/2060873945 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe868131550 con 0x7fe868131980 2023-09-30T22:25:38.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.840+0000 7fe86caa3700 1 --2- 172.21.15.156:0/2060873945 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe86809c790 0x7fe868139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:38.847 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.840+0000 7fe867fff700 1 --2- 172.21.15.156:0/2060873945 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe868131980 0x7fe868131d50 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fe858009820 tx=0x7fe858009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6e89845c54fbdb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:38.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.841+0000 7fe866ffd700 1 -- 172.21.15.156:0/2060873945 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe858005e30 con 0x7fe868131980 2023-09-30T22:25:38.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.841+0000 7fe866ffd700 1 -- 172.21.15.156:0/2060873945 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe858006030 con 0x7fe868131980 2023-09-30T22:25:38.848 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.841+0000 7fe866ffd700 1 -- 172.21.15.156:0/2060873945 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8580063c0 con 0x7fe868131980 2023-09-30T22:25:38.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.842+0000 7fe86e506700 1 -- 172.21.15.156:0/2060873945 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe868131980 msgr2=0x7fe868131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.842+0000 7fe86e506700 1 --2- 172.21.15.156:0/2060873945 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe868131980 0x7fe868131d50 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fe858009820 tx=0x7fe858009b30 comp rx=0 tx=0).stop 2023-09-30T22:25:38.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.842+0000 7fe86e506700 1 -- 172.21.15.156:0/2060873945 shutdown_connections 2023-09-30T22:25:38.849 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.842+0000 7fe86e506700 1 --2- 172.21.15.156:0/2060873945 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe86809c790 0x7fe868139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.842+0000 7fe86e506700 1 --2- 172.21.15.156:0/2060873945 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe868131980 0x7fe868131d50 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.842+0000 7fe86e506700 1 -- 172.21.15.156:0/2060873945 >> 172.21.15.156:0/2060873945 conn(0x7fe8680a2980 msgr2=0x7fe8680a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:38.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.842+0000 7fe86e506700 1 -- 172.21.15.156:0/2060873945 shutdown_connections 2023-09-30T22:25:38.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.842+0000 7fe86e506700 1 -- 172.21.15.156:0/2060873945 wait complete. 2023-09-30T22:25:38.850 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.843+0000 7fe86e506700 1 Processor -- start 2023-09-30T22:25:38.851 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.843+0000 7fe86e506700 1 -- start start 2023-09-30T22:25:38.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.844+0000 7fe86e506700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe86809bc70 0x7fe86811b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.853 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.844+0000 7fe86e506700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe86809c790 0x7fe86811bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.844+0000 7fe86e506700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe868131980 0x7fe86811c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.844+0000 7fe86e506700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86811f170 con 0x7fe86809c790 2023-09-30T22:25:38.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.844+0000 7fe86e506700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe86811fb10 con 0x7fe868131980 2023-09-30T22:25:38.854 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.844+0000 7fe86e506700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe868130d80 con 0x7fe86809bc70 2023-09-30T22:25:38.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.844+0000 7fe86caa3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe868131980 0x7fe86811c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.844+0000 7fe86caa3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe868131980 0x7fe86811c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51366/0 (socket says 172.21.15.156:51366) 2023-09-30T22:25:38.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.844+0000 7fe86caa3700 1 -- 172.21.15.156:0/3659019103 learned_addr learned my addr 172.21.15.156:0/3659019103 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:38.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.844+0000 7fe867fff700 1 --2- 172.21.15.156:0/3659019103 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe86809bc70 0x7fe86811b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.844+0000 7fe8677fe700 1 --2- 172.21.15.156:0/3659019103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe86809c790 0x7fe86811bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.845+0000 7fe867fff700 1 -- 172.21.15.156:0/3659019103 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe868131980 msgr2=0x7fe86811c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.845+0000 7fe867fff700 1 --2- 172.21.15.156:0/3659019103 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe868131980 0x7fe86811c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.845+0000 7fe867fff700 1 -- 172.21.15.156:0/3659019103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe86809c790 msgr2=0x7fe86811bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.845+0000 7fe867fff700 1 --2- 172.21.15.156:0/3659019103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe86809c790 0x7fe86811bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.845+0000 7fe867fff700 1 -- 172.21.15.156:0/3659019103 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe860009a70 con 0x7fe86809bc70 2023-09-30T22:25:38.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.845+0000 7fe867fff700 1 --2- 172.21.15.156:0/3659019103 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe86809bc70 0x7fe86811b650 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe858015000 tx=0x7fe858004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:38.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.845+0000 7fe864ff9700 1 -- 172.21.15.156:0/3659019103 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8580068c0 con 0x7fe86809bc70 2023-09-30T22:25:38.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.845+0000 7fe864ff9700 1 -- 172.21.15.156:0/3659019103 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe858020070 con 0x7fe86809bc70 2023-09-30T22:25:38.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.845+0000 7fe864ff9700 1 -- 172.21.15.156:0/3659019103 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe858004280 con 0x7fe86809bc70 2023-09-30T22:25:38.857 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.845+0000 7fe86e506700 1 -- 172.21.15.156:0/3659019103 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe858009430 con 0x7fe86809bc70 2023-09-30T22:25:38.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.845+0000 7fe86e506700 1 -- 172.21.15.156:0/3659019103 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8680a1c40 con 0x7fe86809bc70 2023-09-30T22:25:38.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.847+0000 7fe86e506700 1 -- 172.21.15.156:0/3659019103 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe86811eb30 con 0x7fe86809bc70 2023-09-30T22:25:38.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.847+0000 7fe864ff9700 1 -- 172.21.15.156:0/3659019103 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe858022030 con 0x7fe86809bc70 2023-09-30T22:25:38.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.847+0000 7fe864ff9700 1 -- 172.21.15.156:0/3659019103 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe858040ac0 con 0x7fe86809bc70 2023-09-30T22:25:38.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.852+0000 7fe864ff9700 1 -- 172.21.15.156:0/3659019103 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe86811eb30 con 0x7fe86809bc70 2023-09-30T22:25:38.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.898+0000 7f1dfc9c0700 1 Processor -- start 2023-09-30T22:25:38.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.898+0000 7f1dfc9c0700 1 -- start start 2023-09-30T22:25:38.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.898+0000 7f1dfc9c0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1df809a130 0x7f1df809e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.898+0000 7f1dfc9c0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1df809edb0 0x7f1df809f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.899+0000 7f1dfc9c0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1df813c410 0x7f1df813e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.899+0000 7f1dfc9c0700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1df809a500 con 0x7f1df809edb0 2023-09-30T22:25:38.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.899+0000 7f1dfc9c0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df809f720 con 0x7f1df813c410 2023-09-30T22:25:38.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.899+0000 7f1dfc9c0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1df8072b30 con 0x7f1df809a130 2023-09-30T22:25:38.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.899+0000 7f1df5d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1df809edb0 0x7f1df809f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.899+0000 7f1df5d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1df809edb0 0x7f1df809f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34484/0 (socket says 172.21.15.156:34484) 2023-09-30T22:25:38.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.899+0000 7f1df5d9b700 1 -- 172.21.15.156:0/3948009309 learned_addr learned my addr 172.21.15.156:0/3948009309 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:38.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.899+0000 7f1df659c700 1 --2- 172.21.15.156:0/3948009309 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1df809a130 0x7f1df809e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.899+0000 7f1df6d9d700 1 --2- 172.21.15.156:0/3948009309 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1df813c410 0x7f1df813e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.899+0000 7f1df5d9b700 1 -- 172.21.15.156:0/3948009309 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1df809a130 msgr2=0x7f1df809e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:38.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.899+0000 7f1df5d9b700 1 --2- 172.21.15.156:0/3948009309 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1df809a130 0x7f1df809e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.899+0000 7f1df5d9b700 1 -- 172.21.15.156:0/3948009309 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1df813c410 msgr2=0x7f1df813e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:38.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.899+0000 7f1df5d9b700 1 --2- 172.21.15.156:0/3948009309 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1df813c410 0x7f1df813e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.899+0000 7f1df5d9b700 1 -- 172.21.15.156:0/3948009309 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df809fe00 con 0x7f1df809edb0 2023-09-30T22:25:38.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.899+0000 7f1df5d9b700 1 --2- 172.21.15.156:0/3948009309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1df809edb0 0x7f1df809f1e0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f1dec0098f0 tx=0x7f1dec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=166a18ad454c434c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:38.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.899+0000 7f1df559a700 1 -- 172.21.15.156:0/3948009309 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec011830 con 0x7f1df809edb0 2023-09-30T22:25:38.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.899+0000 7f1df559a700 1 -- 172.21.15.156:0/3948009309 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dec011990 con 0x7f1df809edb0 2023-09-30T22:25:38.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.900+0000 7f1df559a700 1 -- 172.21.15.156:0/3948009309 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec011d00 con 0x7f1df809edb0 2023-09-30T22:25:38.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.900+0000 7f1dfc9c0700 1 -- 172.21.15.156:0/3948009309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1df809edb0 msgr2=0x7f1df809f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.900+0000 7f1dfc9c0700 1 --2- 172.21.15.156:0/3948009309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1df809edb0 0x7f1df809f1e0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f1dec0098f0 tx=0x7f1dec009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:38.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.900+0000 7f1dfc9c0700 1 -- 172.21.15.156:0/3948009309 shutdown_connections 2023-09-30T22:25:38.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.900+0000 7f1dfc9c0700 1 --2- 172.21.15.156:0/3948009309 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1df813c410 0x7f1df813e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.900+0000 7f1dfc9c0700 1 --2- 172.21.15.156:0/3948009309 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1df809a130 0x7f1df809e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.900+0000 7f1dfc9c0700 1 --2- 172.21.15.156:0/3948009309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1df809edb0 0x7f1df809f1e0 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.900+0000 7f1dfc9c0700 1 -- 172.21.15.156:0/3948009309 >> 172.21.15.156:0/3948009309 conn(0x7f1df80a4430 msgr2=0x7f1df80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:38.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.900+0000 7f1dfc9c0700 1 -- 172.21.15.156:0/3948009309 shutdown_connections 2023-09-30T22:25:38.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.900+0000 7f1dfc9c0700 1 -- 172.21.15.156:0/3948009309 wait complete. 2023-09-30T22:25:38.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.902+0000 7f1dfc9c0700 1 Processor -- start 2023-09-30T22:25:38.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.902+0000 7f1dfc9c0700 1 -- start start 2023-09-30T22:25:38.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.902+0000 7f1dfc9c0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1df809a130 0x7f1df811c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.902+0000 7f1dfc9c0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1df809edb0 0x7f1df811c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.902+0000 7f1dfc9c0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1df813c410 0x7f1df811ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.902+0000 7f1dfc9c0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df8128500 con 0x7f1df809edb0 2023-09-30T22:25:38.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.902+0000 7f1dfc9c0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df81286e0 con 0x7f1df813c410 2023-09-30T22:25:38.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.902+0000 7f1dfc9c0700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1df811e040 con 0x7f1df809a130 2023-09-30T22:25:38.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.903+0000 7f1df6d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1df813c410 0x7f1df811ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.903+0000 7f1df6d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1df813c410 0x7f1df811ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51382/0 (socket says 172.21.15.156:51382) 2023-09-30T22:25:38.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.903+0000 7f1df6d9d700 1 -- 172.21.15.156:0/2371007691 learned_addr learned my addr 172.21.15.156:0/2371007691 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:38.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.903+0000 7f1df659c700 1 --2- 172.21.15.156:0/2371007691 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1df809a130 0x7f1df811c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.903+0000 7f1df5d9b700 1 --2- 172.21.15.156:0/2371007691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1df809edb0 0x7f1df811c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.903+0000 7f1df659c700 1 -- 172.21.15.156:0/2371007691 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1df813c410 msgr2=0x7f1df811ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.903+0000 7f1df659c700 1 --2- 172.21.15.156:0/2371007691 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1df813c410 0x7f1df811ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.903+0000 7f1df659c700 1 -- 172.21.15.156:0/2371007691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1df809edb0 msgr2=0x7f1df811c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.903+0000 7f1df659c700 1 --2- 172.21.15.156:0/2371007691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1df809edb0 0x7f1df811c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.903+0000 7f1df659c700 1 -- 172.21.15.156:0/2371007691 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dec009550 con 0x7f1df809a130 2023-09-30T22:25:38.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.903+0000 7f1df659c700 1 --2- 172.21.15.156:0/2371007691 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1df809a130 0x7f1df811c400 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f1de800e870 tx=0x7f1de800eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:38.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.903+0000 7f1df6d9d700 1 --2- 172.21.15.156:0/2371007691 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1df813c410 0x7f1df811ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:38.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.903+0000 7f1de6ffd700 1 -- 172.21.15.156:0/2371007691 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de8013680 con 0x7f1df809a130 2023-09-30T22:25:38.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.904+0000 7f1de6ffd700 1 -- 172.21.15.156:0/2371007691 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de80137e0 con 0x7f1df809a130 2023-09-30T22:25:38.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.904+0000 7f1dfc9c0700 1 -- 172.21.15.156:0/2371007691 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df80a00f0 con 0x7f1df809a130 2023-09-30T22:25:38.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.904+0000 7f1de6ffd700 1 -- 172.21.15.156:0/2371007691 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de8013b70 con 0x7f1df809a130 2023-09-30T22:25:38.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.904+0000 7f1dfc9c0700 1 -- 172.21.15.156:0/2371007691 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df8129150 con 0x7f1df809a130 2023-09-30T22:25:38.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.905+0000 7f1dfc9c0700 1 -- 172.21.15.156:0/2371007691 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df804f2a0 con 0x7f1df809a130 2023-09-30T22:25:38.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.905+0000 7f1de6ffd700 1 -- 172.21.15.156:0/2371007691 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1de8013cd0 con 0x7f1df809a130 2023-09-30T22:25:38.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.905+0000 7f1de6ffd700 1 -- 172.21.15.156:0/2371007691 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1de803f4c0 con 0x7f1df809a130 2023-09-30T22:25:38.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.909+0000 7f1de6ffd700 1 -- 172.21.15.156:0/2371007691 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1de801be10 con 0x7f1df809a130 2023-09-30T22:25:38.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.941+0000 7fb99d026700 1 Processor -- start 2023-09-30T22:25:38.942 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.941+0000 7fb99d026700 1 -- start start 2023-09-30T22:25:38.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.942+0000 7fb99d026700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb998133ad0 0x7fb998133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.942+0000 7fb99d026700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb9981300a0 0x7fb9981304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.942+0000 7fb99d026700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb9981309f0 0x7fb99813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.942+0000 7fb99d026700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb99806b2d0 con 0x7fb998133ad0 2023-09-30T22:25:38.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.942+0000 7fb99d026700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb998133610 con 0x7fb9981309f0 2023-09-30T22:25:38.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.942+0000 7fb99d026700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb99809a500 con 0x7fb9981300a0 2023-09-30T22:25:38.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.942+0000 7fb99659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb9981300a0 0x7fb9981304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.942+0000 7fb99659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb9981300a0 0x7fb9981304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56488/0 (socket says 172.21.15.156:56488) 2023-09-30T22:25:38.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.942+0000 7fb99659c700 1 -- 172.21.15.156:0/268044111 learned_addr learned my addr 172.21.15.156:0/268044111 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:38.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.942+0000 7fb996d9d700 1 --2- 172.21.15.156:0/268044111 >> v2:172.21.15.156:3300/0 conn(0x7fb998133ad0 0x7fb998133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.942+0000 7fb99759e700 1 --2- 172.21.15.156:0/268044111 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb9981309f0 0x7fb99813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.942+0000 7fb99659c700 1 -- 172.21.15.156:0/268044111 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb9981309f0 msgr2=0x7fb99813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:38.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.942+0000 7fb99659c700 1 --2- 172.21.15.156:0/268044111 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb9981309f0 0x7fb99813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.942+0000 7fb99659c700 1 -- 172.21.15.156:0/268044111 >> v2:172.21.15.156:3300/0 conn(0x7fb998133ad0 msgr2=0x7fb998133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:38.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.942+0000 7fb99659c700 1 --2- 172.21.15.156:0/268044111 >> v2:172.21.15.156:3300/0 conn(0x7fb998133ad0 0x7fb998133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.942+0000 7fb99659c700 1 -- 172.21.15.156:0/268044111 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9981338b0 con 0x7fb9981300a0 2023-09-30T22:25:38.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.942+0000 7fb99759e700 1 --2- 172.21.15.156:0/268044111 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb9981309f0 0x7fb99813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:38.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.943+0000 7fb99659c700 1 --2- 172.21.15.156:0/268044111 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb9981300a0 0x7fb9981304b0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0098f0 tx=0x7fb98c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd9314cb902c3d36 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:38.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.943+0000 7fb995d9b700 1 -- 172.21.15.156:0/268044111 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c011830 con 0x7fb9981300a0 2023-09-30T22:25:38.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.943+0000 7fb995d9b700 1 -- 172.21.15.156:0/268044111 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98c011990 con 0x7fb9981300a0 2023-09-30T22:25:38.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.943+0000 7fb995d9b700 1 -- 172.21.15.156:0/268044111 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c011d20 con 0x7fb9981300a0 2023-09-30T22:25:38.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.944+0000 7fb99d026700 1 -- 172.21.15.156:0/268044111 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb9981300a0 msgr2=0x7fb9981304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.944+0000 7fb99d026700 1 --2- 172.21.15.156:0/268044111 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb9981300a0 0x7fb9981304b0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0098f0 tx=0x7fb98c009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:38.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.944+0000 7fb99d026700 1 -- 172.21.15.156:0/268044111 shutdown_connections 2023-09-30T22:25:38.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.944+0000 7fb99d026700 1 --2- 172.21.15.156:0/268044111 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb9981309f0 0x7fb99813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.944+0000 7fb99d026700 1 --2- 172.21.15.156:0/268044111 >> v2:172.21.15.156:3300/0 conn(0x7fb998133ad0 0x7fb998133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.944+0000 7fb99d026700 1 --2- 172.21.15.156:0/268044111 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb9981300a0 0x7fb9981304b0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.944+0000 7fb99d026700 1 -- 172.21.15.156:0/268044111 >> 172.21.15.156:0/268044111 conn(0x7fb998099c40 msgr2=0x7fb9980a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:38.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.944+0000 7fb99d026700 1 -- 172.21.15.156:0/268044111 shutdown_connections 2023-09-30T22:25:38.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.944+0000 7fb99d026700 1 -- 172.21.15.156:0/268044111 wait complete. 2023-09-30T22:25:38.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.945+0000 7fb99d026700 1 Processor -- start 2023-09-30T22:25:38.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.946+0000 7fb99d026700 1 -- start start 2023-09-30T22:25:38.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.946+0000 7fb99d026700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb9981300a0 0x7fb99811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.946+0000 7fb99d026700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9981309f0 0x7fb99811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.946+0000 7fb99d026700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb998133ad0 0x7fb99811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.946+0000 7fb99d026700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9981209f0 con 0x7fb9981309f0 2023-09-30T22:25:38.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.946+0000 7fb99d026700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb99812f920 con 0x7fb998133ad0 2023-09-30T22:25:38.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.946+0000 7fb99d026700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb99812d8c0 con 0x7fb9981300a0 2023-09-30T22:25:38.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.946+0000 7fb996d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb9981300a0 0x7fb99811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.946+0000 7fb996d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb9981300a0 0x7fb99811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56496/0 (socket says 172.21.15.156:56496) 2023-09-30T22:25:38.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.946+0000 7fb996d9d700 1 -- 172.21.15.156:0/641202171 learned_addr learned my addr 172.21.15.156:0/641202171 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:38.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.946+0000 7fb99759e700 1 --2- 172.21.15.156:0/641202171 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb998133ad0 0x7fb99811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.947+0000 7fb99659c700 1 --2- 172.21.15.156:0/641202171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9981309f0 0x7fb99811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.947+0000 7fb996d9d700 1 -- 172.21.15.156:0/641202171 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb998133ad0 msgr2=0x7fb99811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.947+0000 7fb996d9d700 1 --2- 172.21.15.156:0/641202171 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb998133ad0 0x7fb99811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.947+0000 7fb996d9d700 1 -- 172.21.15.156:0/641202171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9981309f0 msgr2=0x7fb99811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.947+0000 7fb996d9d700 1 --2- 172.21.15.156:0/641202171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9981309f0 0x7fb99811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.947+0000 7fb996d9d700 1 -- 172.21.15.156:0/641202171 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb98c009550 con 0x7fb9981300a0 2023-09-30T22:25:38.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.947+0000 7fb99659c700 1 --2- 172.21.15.156:0/641202171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9981309f0 0x7fb99811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:38.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.947+0000 7fb996d9d700 1 --2- 172.21.15.156:0/641202171 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb9981300a0 0x7fb99811da40 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fb98800e9e0 tx=0x7fb98800ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:38.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.947+0000 7fb97f7fe700 1 -- 172.21.15.156:0/641202171 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb988009710 con 0x7fb9981300a0 2023-09-30T22:25:38.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.947+0000 7fb99d026700 1 -- 172.21.15.156:0/641202171 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb99811fa70 con 0x7fb9981300a0 2023-09-30T22:25:38.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.947+0000 7fb99d026700 1 -- 172.21.15.156:0/641202171 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb99812dd00 con 0x7fb9981300a0 2023-09-30T22:25:38.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.947+0000 7fb97f7fe700 1 -- 172.21.15.156:0/641202171 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98800c850 con 0x7fb9981300a0 2023-09-30T22:25:38.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.947+0000 7fb97f7fe700 1 -- 172.21.15.156:0/641202171 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98800cbc0 con 0x7fb9981300a0 2023-09-30T22:25:38.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.948+0000 7fb97f7fe700 1 -- 172.21.15.156:0/641202171 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb98800cd20 con 0x7fb9981300a0 2023-09-30T22:25:38.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.948+0000 7fb97f7fe700 1 -- 172.21.15.156:0/641202171 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb98803f9e0 con 0x7fb9981300a0 2023-09-30T22:25:38.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.949+0000 7fb99d026700 1 -- 172.21.15.156:0/641202171 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9780052e0 con 0x7fb9981300a0 2023-09-30T22:25:38.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.958+0000 7fb97f7fe700 1 -- 172.21.15.156:0/641202171 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb988017080 con 0x7fb9981300a0 2023-09-30T22:25:38.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.971+0000 7f2198747700 1 -- 172.21.15.156:0/1506487639 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f219004f2a0 con 0x7f21900a1380 2023-09-30T22:25:38.972 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.971+0000 7f2186ffd700 1 -- 172.21.15.156:0/1506487639 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2180015070 con 0x7f21900a1380 2023-09-30T22:25:38.972 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:38.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.974+0000 7f2198747700 1 -- 172.21.15.156:0/1506487639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21900a1380 msgr2=0x7f21901228f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.974+0000 7f2198747700 1 --2- 172.21.15.156:0/1506487639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21900a1380 0x7f21901228f0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f21800090b0 tx=0x7f2180004750 comp rx=0 tx=0).stop 2023-09-30T22:25:38.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.974+0000 7f2198747700 1 -- 172.21.15.156:0/1506487639 shutdown_connections 2023-09-30T22:25:38.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.974+0000 7f2198747700 1 --2- 172.21.15.156:0/1506487639 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2190133f50 0x7f2190122e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.974+0000 7f2198747700 1 --2- 172.21.15.156:0/1506487639 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f21900a0a70 0x7f21901223b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.974+0000 7f2198747700 1 --2- 172.21.15.156:0/1506487639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21900a1380 0x7f21901228f0 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.974+0000 7f2198747700 1 -- 172.21.15.156:0/1506487639 >> 172.21.15.156:0/1506487639 conn(0x7f21900a6610 msgr2=0x7f219011c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:38.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.975+0000 7f2198747700 1 -- 172.21.15.156:0/1506487639 shutdown_connections 2023-09-30T22:25:38.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:38.976+0000 7f2198747700 1 -- 172.21.15.156:0/1506487639 wait complete. 2023-09-30T22:25:38.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:39.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.059+0000 7fe86e506700 1 -- 172.21.15.156:0/3659019103 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe86811eb30 con 0x7fe86809bc70 2023-09-30T22:25:39.060 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.059+0000 7fe864ff9700 1 -- 172.21.15.156:0/3659019103 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe86811eb30 con 0x7fe86809bc70 2023-09-30T22:25:39.060 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:39.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.061+0000 7fe86e506700 1 -- 172.21.15.156:0/3659019103 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe86809bc70 msgr2=0x7fe86811b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.062 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.061+0000 7fe86e506700 1 --2- 172.21.15.156:0/3659019103 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe86809bc70 0x7fe86811b650 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe858015000 tx=0x7fe858004750 comp rx=0 tx=0).stop 2023-09-30T22:25:39.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.061+0000 7fe86e506700 1 -- 172.21.15.156:0/3659019103 shutdown_connections 2023-09-30T22:25:39.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.061+0000 7fe86e506700 1 --2- 172.21.15.156:0/3659019103 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe868131980 0x7fe86811c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.061+0000 7fe86e506700 1 --2- 172.21.15.156:0/3659019103 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe86809bc70 0x7fe86811b650 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.061+0000 7fe86e506700 1 --2- 172.21.15.156:0/3659019103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe86809c790 0x7fe86811bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.061+0000 7fe86e506700 1 -- 172.21.15.156:0/3659019103 >> 172.21.15.156:0/3659019103 conn(0x7fe8680a2980 msgr2=0x7fe86809fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:39.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.062+0000 7fe86e506700 1 -- 172.21.15.156:0/3659019103 shutdown_connections 2023-09-30T22:25:39.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.062+0000 7fe86e506700 1 -- 172.21.15.156:0/3659019103 wait complete. 2023-09-30T22:25:39.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:39.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.109+0000 7f1dfc9c0700 1 -- 172.21.15.156:0/2371007691 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1df80a3940 con 0x7f1df809a130 2023-09-30T22:25:39.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.109+0000 7f1de6ffd700 1 -- 172.21.15.156:0/2371007691 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1de8017070 con 0x7f1df809a130 2023-09-30T22:25:39.110 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:39.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.111+0000 7f1dfc9c0700 1 -- 172.21.15.156:0/2371007691 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1df809a130 msgr2=0x7f1df811c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.111+0000 7f1dfc9c0700 1 --2- 172.21.15.156:0/2371007691 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1df809a130 0x7f1df811c400 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f1de800e870 tx=0x7f1de800eb80 comp rx=0 tx=0).stop 2023-09-30T22:25:39.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.111+0000 7f1dfc9c0700 1 -- 172.21.15.156:0/2371007691 shutdown_connections 2023-09-30T22:25:39.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.111+0000 7f1dfc9c0700 1 --2- 172.21.15.156:0/2371007691 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1df813c410 0x7f1df811ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.111+0000 7f1dfc9c0700 1 --2- 172.21.15.156:0/2371007691 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1df809a130 0x7f1df811c400 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.111+0000 7f1dfc9c0700 1 --2- 172.21.15.156:0/2371007691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1df809edb0 0x7f1df811c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.111+0000 7f1dfc9c0700 1 -- 172.21.15.156:0/2371007691 >> 172.21.15.156:0/2371007691 conn(0x7f1df80a4430 msgr2=0x7f1df80a1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:39.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.111+0000 7f1dfc9c0700 1 -- 172.21.15.156:0/2371007691 shutdown_connections 2023-09-30T22:25:39.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.111+0000 7f1dfc9c0700 1 -- 172.21.15.156:0/2371007691 wait complete. 2023-09-30T22:25:39.124 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:39.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.155+0000 7fb99d026700 1 -- 172.21.15.156:0/641202171 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb978005590 con 0x7fb9981300a0 2023-09-30T22:25:39.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.156+0000 7fb97f7fe700 1 -- 172.21.15.156:0/641202171 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb988021020 con 0x7fb9981300a0 2023-09-30T22:25:39.157 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:39.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.158+0000 7fb99d026700 1 -- 172.21.15.156:0/641202171 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb9981300a0 msgr2=0x7fb99811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.158+0000 7fb99d026700 1 --2- 172.21.15.156:0/641202171 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb9981300a0 0x7fb99811da40 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fb98800e9e0 tx=0x7fb98800ecf0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.158+0000 7fb99d026700 1 -- 172.21.15.156:0/641202171 shutdown_connections 2023-09-30T22:25:39.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.158+0000 7fb99d026700 1 --2- 172.21.15.156:0/641202171 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb998133ad0 0x7fb99811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.158+0000 7fb99d026700 1 --2- 172.21.15.156:0/641202171 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb9981300a0 0x7fb99811da40 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.158+0000 7fb99d026700 1 --2- 172.21.15.156:0/641202171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9981309f0 0x7fb99811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.158+0000 7fb99d026700 1 -- 172.21.15.156:0/641202171 >> 172.21.15.156:0/641202171 conn(0x7fb998099c40 msgr2=0x7fb998132ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:39.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.158+0000 7fb99d026700 1 -- 172.21.15.156:0/641202171 shutdown_connections 2023-09-30T22:25:39.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:39.158+0000 7fb99d026700 1 -- 172.21.15.156:0/641202171 wait complete. 2023-09-30T22:25:39.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:39.989 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:40.075 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:40.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.121+0000 7f094be89700 1 Processor -- start 2023-09-30T22:25:40.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.121+0000 7f094be89700 1 -- start start 2023-09-30T22:25:40.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.122+0000 7f094be89700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f09440a1550 0x7f0944138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:40.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.122+0000 7f094be89700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0944139200 0x7f094413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:40.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.122+0000 7f094be89700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f094409e9d0 con 0x7f09440a0a70 2023-09-30T22:25:40.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.122+0000 7f094be89700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f094409dc00 con 0x7f09440a1550 2023-09-30T22:25:40.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.122+0000 7f094be89700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094409dec0 con 0x7f0944139200 2023-09-30T22:25:40.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.122+0000 7f094a426700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0944139200 0x7f094413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:40.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.122+0000 7f0949424700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f09440a1550 0x7f0944138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:40.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.122+0000 7f0949424700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f09440a1550 0x7f0944138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34522/0 (socket says 172.21.15.156:34522) 2023-09-30T22:25:40.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.122+0000 7f094a426700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0944139200 0x7f094413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51404/0 (socket says 172.21.15.156:51404) 2023-09-30T22:25:40.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.122+0000 7f0949424700 1 -- 172.21.15.156:0/602574902 learned_addr learned my addr 172.21.15.156:0/602574902 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:40.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.122+0000 7f094a426700 1 -- 172.21.15.156:0/602574902 >> v2:172.21.15.156:3300/0 conn(0x7f09440a1550 msgr2=0x7f0944138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:40.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.122+0000 7f094a426700 1 --2- 172.21.15.156:0/602574902 >> v2:172.21.15.156:3300/0 conn(0x7f09440a1550 0x7f0944138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.122+0000 7f094a426700 1 -- 172.21.15.156:0/602574902 >> v1:172.21.15.156:6789/0 conn(0x7f09440a0a70 legacy=0x7f09440a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:40.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.122+0000 7f094a426700 1 -- 172.21.15.156:0/602574902 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094409e6a0 con 0x7f0944139200 2023-09-30T22:25:40.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.122+0000 7f0949424700 1 --2- 172.21.15.156:0/602574902 >> v2:172.21.15.156:3300/0 conn(0x7f09440a1550 0x7f0944138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:40.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.123+0000 7f094a426700 1 --2- 172.21.15.156:0/602574902 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0944139200 0x7f094413b5e0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f093c009d90 tx=0x7f093c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c29d3dfeb853a11 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:40.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.123+0000 7f0948c23700 1 -- 172.21.15.156:0/602574902 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c00e070 con 0x7f0944139200 2023-09-30T22:25:40.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.123+0000 7f0948c23700 1 -- 172.21.15.156:0/602574902 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093c00bb20 con 0x7f0944139200 2023-09-30T22:25:40.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.123+0000 7f0948c23700 1 -- 172.21.15.156:0/602574902 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c012430 con 0x7f0944139200 2023-09-30T22:25:40.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.123+0000 7f094be89700 1 -- 172.21.15.156:0/602574902 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0944139200 msgr2=0x7f094413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:40.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.123+0000 7f094be89700 1 --2- 172.21.15.156:0/602574902 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0944139200 0x7f094413b5e0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f093c009d90 tx=0x7f093c00b330 comp rx=0 tx=0).stop 2023-09-30T22:25:40.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.123+0000 7f094be89700 1 -- 172.21.15.156:0/602574902 shutdown_connections 2023-09-30T22:25:40.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.123+0000 7f094be89700 1 --2- 172.21.15.156:0/602574902 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0944139200 0x7f094413b5e0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.123+0000 7f094be89700 1 --2- 172.21.15.156:0/602574902 >> v2:172.21.15.156:3300/0 conn(0x7f09440a1550 0x7f0944138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.123+0000 7f094be89700 1 -- 172.21.15.156:0/602574902 >> 172.21.15.156:0/602574902 conn(0x7f09440a6610 msgr2=0x7f09440a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:40.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.123+0000 7f094be89700 1 -- 172.21.15.156:0/602574902 shutdown_connections 2023-09-30T22:25:40.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.123+0000 7f094be89700 1 -- 172.21.15.156:0/602574902 wait complete. 2023-09-30T22:25:40.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.124+0000 7f094be89700 1 Processor -- start 2023-09-30T22:25:40.128 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.124+0000 7f094be89700 1 -- start start 2023-09-30T22:25:40.128 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:40.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.125+0000 7f094be89700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09440a0a70 0x7f094411e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:40.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.125+0000 7f094be89700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09440a1550 0x7f094411ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:40.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.125+0000 7f094be89700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0944139200 0x7f094411f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:40.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.125+0000 7f094be89700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09440a0470 con 0x7f09440a1550 2023-09-30T22:25:40.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.125+0000 7f094be89700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0944122050 con 0x7f09440a0a70 2023-09-30T22:25:40.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.125+0000 7f094be89700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0944121aa0 con 0x7f0944139200 2023-09-30T22:25:40.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.125+0000 7f0949c25700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09440a0a70 0x7f094411e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:40.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.125+0000 7f0949c25700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09440a0a70 0x7f094411e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:51410/0 (socket says 172.21.15.156:51410) 2023-09-30T22:25:40.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.125+0000 7f0949424700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09440a1550 0x7f094411ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:40.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.125+0000 7f0949c25700 1 -- 172.21.15.156:0/845842409 learned_addr learned my addr 172.21.15.156:0/845842409 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:40.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.125+0000 7f094a426700 1 --2- 172.21.15.156:0/845842409 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0944139200 0x7f094411f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:40.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.125+0000 7f0949c25700 1 -- 172.21.15.156:0/845842409 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0944139200 msgr2=0x7f094411f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:40.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.125+0000 7f0949c25700 1 --2- 172.21.15.156:0/845842409 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0944139200 0x7f094411f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.125+0000 7f0949c25700 1 -- 172.21.15.156:0/845842409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09440a1550 msgr2=0x7f094411ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:40.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.125+0000 7f0949c25700 1 --2- 172.21.15.156:0/845842409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09440a1550 0x7f094411ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.125+0000 7f0949c25700 1 -- 172.21.15.156:0/845842409 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0934009550 con 0x7f09440a0a70 2023-09-30T22:25:40.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.125+0000 7f094a426700 1 --2- 172.21.15.156:0/845842409 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0944139200 0x7f094411f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:40.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.125+0000 7f0949424700 1 --2- 172.21.15.156:0/845842409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09440a1550 0x7f094411ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:40.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.125+0000 7f0949c25700 1 --2- 172.21.15.156:0/845842409 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09440a0a70 0x7f094411e8a0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f094000c510 tx=0x7f094000c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:40.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.125+0000 7f093a7fc700 1 -- 172.21.15.156:0/845842409 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09400052d0 con 0x7f09440a0a70 2023-09-30T22:25:40.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.125+0000 7f093a7fc700 1 -- 172.21.15.156:0/845842409 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0940005430 con 0x7f09440a0a70 2023-09-30T22:25:40.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.126+0000 7f094be89700 1 -- 172.21.15.156:0/845842409 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f093c009a70 con 0x7f09440a0a70 2023-09-30T22:25:40.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.126+0000 7f093a7fc700 1 -- 172.21.15.156:0/845842409 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09400038c0 con 0x7f09440a0a70 2023-09-30T22:25:40.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.126+0000 7f094be89700 1 -- 172.21.15.156:0/845842409 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0944120530 con 0x7f09440a0a70 2023-09-30T22:25:40.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.126+0000 7f094be89700 1 -- 172.21.15.156:0/845842409 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f094404f2a0 con 0x7f09440a0a70 2023-09-30T22:25:40.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.127+0000 7f093a7fc700 1 -- 172.21.15.156:0/845842409 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0940003a20 con 0x7f09440a0a70 2023-09-30T22:25:40.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.127+0000 7f093a7fc700 1 -- 172.21.15.156:0/845842409 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f094003eef0 con 0x7f09440a0a70 2023-09-30T22:25:40.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.131+0000 7f093a7fc700 1 -- 172.21.15.156:0/845842409 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0940018260 con 0x7f09440a0a70 2023-09-30T22:25:40.171 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:40.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.210+0000 7f1a703db700 1 Processor -- start 2023-09-30T22:25:40.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.210+0000 7f1a703db700 1 -- start start 2023-09-30T22:25:40.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.210+0000 7f1a703db700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a68136960 0x7f1a68138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:40.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.210+0000 7f1a703db700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1a68139280 0x7f1a6813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:40.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.210+0000 7f1a703db700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a6806b2d0 con 0x7f1a68133ad0 2023-09-30T22:25:40.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.210+0000 7f1a703db700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a681345b0 con 0x7f1a68136960 2023-09-30T22:25:40.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.210+0000 7f1a703db700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a68133610 con 0x7f1a68139280 2023-09-30T22:25:40.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.210+0000 7f1a6e177700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f1a68133ad0 0x7f1a68133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:59384/0 (socket says 172.21.15.156:59384) 2023-09-30T22:25:40.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.210+0000 7f1a6e177700 1 -- 172.21.15.156:0/3019221891 learned_addr learned my addr 172.21.15.156:0/3019221891 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:40.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.210+0000 7f1a6e978700 1 --2- 172.21.15.156:0/3019221891 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1a68139280 0x7f1a6813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:40.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.211+0000 7f1a6d976700 1 --2- 172.21.15.156:0/3019221891 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a68136960 0x7f1a68138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:40.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.211+0000 7f1a6e978700 1 -- 172.21.15.156:0/3019221891 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a68136960 msgr2=0x7f1a68138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:40.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.211+0000 7f1a6e978700 1 --2- 172.21.15.156:0/3019221891 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a68136960 0x7f1a68138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.211+0000 7f1a6e978700 1 -- 172.21.15.156:0/3019221891 >> v1:172.21.15.156:6789/0 conn(0x7f1a68133ad0 legacy=0x7f1a68133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:40.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.211+0000 7f1a6e978700 1 -- 172.21.15.156:0/3019221891 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6809a500 con 0x7f1a68139280 2023-09-30T22:25:40.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.211+0000 7f1a6d175700 1 -- 172.21.15.156:0/3019221891 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4096221271 0 0) 0x7f1a6806b2d0 con 0x7f1a68133ad0 2023-09-30T22:25:40.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.211+0000 7f1a6e978700 1 --2- 172.21.15.156:0/3019221891 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1a68139280 0x7f1a6813b660 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009dc0 tx=0x7f1a6000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e4977871967a6dc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:40.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.211+0000 7f1a6d175700 1 -- 172.21.15.156:0/3019221891 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6000e070 con 0x7f1a68139280 2023-09-30T22:25:40.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.211+0000 7f1a6d175700 1 -- 172.21.15.156:0/3019221891 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6000bb20 con 0x7f1a68139280 2023-09-30T22:25:40.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.211+0000 7f1a6d175700 1 -- 172.21.15.156:0/3019221891 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a60012430 con 0x7f1a68139280 2023-09-30T22:25:40.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.212+0000 7f1a703db700 1 -- 172.21.15.156:0/3019221891 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1a68139280 msgr2=0x7f1a6813b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:40.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.212+0000 7f1a703db700 1 --2- 172.21.15.156:0/3019221891 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1a68139280 0x7f1a6813b660 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009dc0 tx=0x7f1a6000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:40.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.212+0000 7f1a703db700 1 -- 172.21.15.156:0/3019221891 shutdown_connections 2023-09-30T22:25:40.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.212+0000 7f1a703db700 1 --2- 172.21.15.156:0/3019221891 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1a68139280 0x7f1a6813b660 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.212+0000 7f1a703db700 1 --2- 172.21.15.156:0/3019221891 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a68136960 0x7f1a68138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.216 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.212+0000 7f1a703db700 1 -- 172.21.15.156:0/3019221891 >> 172.21.15.156:0/3019221891 conn(0x7f1a68099c40 msgr2=0x7f1a680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:40.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.212+0000 7f1a703db700 1 -- 172.21.15.156:0/3019221891 shutdown_connections 2023-09-30T22:25:40.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.212+0000 7f1a703db700 1 -- 172.21.15.156:0/3019221891 wait complete. 2023-09-30T22:25:40.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.213+0000 7f1a703db700 1 Processor -- start 2023-09-30T22:25:40.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.213+0000 7f1a703db700 1 -- start start 2023-09-30T22:25:40.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.213+0000 7f1a703db700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a68133ad0 0x7f1a6812cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:40.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.213+0000 7f1a703db700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1a68136960 0x7f1a6812d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:40.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.213+0000 7f1a703db700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a68139280 0x7f1a6812d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:40.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.213+0000 7f1a703db700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6806fe90 con 0x7f1a68139280 2023-09-30T22:25:40.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.213+0000 7f1a703db700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a68072720 con 0x7f1a68133ad0 2023-09-30T22:25:40.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.213+0000 7f1a703db700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6809f390 con 0x7f1a68136960 2023-09-30T22:25:40.217 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.214+0000 7f1a6e978700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a68139280 0x7f1a6812d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:40.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.214+0000 7f1a6e978700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a68139280 0x7f1a6812d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34530/0 (socket says 172.21.15.156:34530) 2023-09-30T22:25:40.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.214+0000 7f1a6e978700 1 -- 172.21.15.156:0/940845319 learned_addr learned my addr 172.21.15.156:0/940845319 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:40.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.214+0000 7f1a6d976700 1 --2- 172.21.15.156:0/940845319 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1a68136960 0x7f1a6812d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:40.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.214+0000 7f1a6e177700 1 --2- 172.21.15.156:0/940845319 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a68133ad0 0x7f1a6812cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:40.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.214+0000 7f1a6e978700 1 -- 172.21.15.156:0/940845319 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1a68136960 msgr2=0x7f1a6812d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:40.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.214+0000 7f1a6e978700 1 --2- 172.21.15.156:0/940845319 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1a68136960 0x7f1a6812d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.214+0000 7f1a6e978700 1 -- 172.21.15.156:0/940845319 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a68133ad0 msgr2=0x7f1a6812cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:40.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.214+0000 7f1a6e978700 1 --2- 172.21.15.156:0/940845319 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a68133ad0 0x7f1a6812cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.214+0000 7f1a6e978700 1 -- 172.21.15.156:0/940845319 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a60009a70 con 0x7f1a68139280 2023-09-30T22:25:40.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.214+0000 7f1a6e177700 1 --2- 172.21.15.156:0/940845319 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a68133ad0 0x7f1a6812cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:40.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.214+0000 7f1a6e978700 1 --2- 172.21.15.156:0/940845319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a68139280 0x7f1a6812d5b0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f1a60014040 tx=0x7f1a60004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:40.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.214+0000 7f1a5effd700 1 -- 172.21.15.156:0/940845319 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a60012430 con 0x7f1a68139280 2023-09-30T22:25:40.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.214+0000 7f1a5effd700 1 -- 172.21.15.156:0/940845319 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a60020070 con 0x7f1a68139280 2023-09-30T22:25:40.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.214+0000 7f1a703db700 1 -- 172.21.15.156:0/940845319 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a681309f0 con 0x7f1a68139280 2023-09-30T22:25:40.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.215+0000 7f1a5effd700 1 -- 172.21.15.156:0/940845319 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a60003ea0 con 0x7f1a68139280 2023-09-30T22:25:40.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.215+0000 7f1a703db700 1 -- 172.21.15.156:0/940845319 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a68070430 con 0x7f1a68139280 2023-09-30T22:25:40.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.215+0000 7f1a5effd700 1 -- 172.21.15.156:0/940845319 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a60004280 con 0x7f1a68139280 2023-09-30T22:25:40.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.216+0000 7f1a5effd700 1 -- 172.21.15.156:0/940845319 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1a60022070 con 0x7f1a68139280 2023-09-30T22:25:40.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.216+0000 7f1a703db700 1 -- 172.21.15.156:0/940845319 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a6804f2a0 con 0x7f1a68139280 2023-09-30T22:25:40.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.225+0000 7f1a5effd700 1 -- 172.21.15.156:0/940845319 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a6001a970 con 0x7f1a68139280 2023-09-30T22:25:40.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.263+0000 7f232be99700 1 Processor -- start 2023-09-30T22:25:40.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.263+0000 7f232be99700 1 -- start start 2023-09-30T22:25:40.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.264+0000 7f232be99700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f232409e950 0x7f232409ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:40.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.264+0000 7f232be99700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f232409f260 0x7f2324133c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:40.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.264+0000 7f232be99700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f232406bcc0 con 0x7f23241341c0 2023-09-30T22:25:40.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.264+0000 7f232be99700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f232406c9a0 con 0x7f232409e950 2023-09-30T22:25:40.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.264+0000 7f232be99700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f232409afe0 con 0x7f232409f260 2023-09-30T22:25:40.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.264+0000 7f232a436700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f23241341c0 0x7f232413aed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:59386/0 (socket says 172.21.15.156:59386) 2023-09-30T22:25:40.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.264+0000 7f232a436700 1 -- 172.21.15.156:0/1972380595 learned_addr learned my addr 172.21.15.156:0/1972380595 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:40.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.264+0000 7f2329c35700 1 --2- 172.21.15.156:0/1972380595 >> v2:172.21.15.156:3300/0 conn(0x7f232409e950 0x7f232409ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:40.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.264+0000 7f2329434700 1 --2- 172.21.15.156:0/1972380595 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f232409f260 0x7f2324133c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:40.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.264+0000 7f2329434700 1 -- 172.21.15.156:0/1972380595 >> v2:172.21.15.156:3300/0 conn(0x7f232409e950 msgr2=0x7f232409ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:40.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.264+0000 7f2329434700 1 --2- 172.21.15.156:0/1972380595 >> v2:172.21.15.156:3300/0 conn(0x7f232409e950 0x7f232409ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.264+0000 7f2329434700 1 -- 172.21.15.156:0/1972380595 >> v1:172.21.15.156:6789/0 conn(0x7f23241341c0 legacy=0x7f232413aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:40.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.264+0000 7f2329434700 1 -- 172.21.15.156:0/1972380595 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232406cb80 con 0x7f232409f260 2023-09-30T22:25:40.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.264+0000 7f2329c35700 1 --2- 172.21.15.156:0/1972380595 >> v2:172.21.15.156:3300/0 conn(0x7f232409e950 0x7f232409ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:40.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.265+0000 7f2329434700 1 --2- 172.21.15.156:0/1972380595 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f232409f260 0x7f2324133c80 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f2314009840 tx=0x7f2314009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e26dc80ea11efa16 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:40.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.265+0000 7f2328c33700 1 -- 172.21.15.156:0/1972380595 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2314011830 con 0x7f232409f260 2023-09-30T22:25:40.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.265+0000 7f2328c33700 1 -- 172.21.15.156:0/1972380595 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2314011990 con 0x7f232409f260 2023-09-30T22:25:40.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.265+0000 7f2328c33700 1 -- 172.21.15.156:0/1972380595 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2314011d20 con 0x7f232409f260 2023-09-30T22:25:40.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.265+0000 7f232be99700 1 -- 172.21.15.156:0/1972380595 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f232409f260 msgr2=0x7f2324133c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:40.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.265+0000 7f232be99700 1 --2- 172.21.15.156:0/1972380595 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f232409f260 0x7f2324133c80 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f2314009840 tx=0x7f2314009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:40.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.265+0000 7f232be99700 1 -- 172.21.15.156:0/1972380595 shutdown_connections 2023-09-30T22:25:40.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.265+0000 7f232be99700 1 --2- 172.21.15.156:0/1972380595 >> v2:172.21.15.156:3300/0 conn(0x7f232409e950 0x7f232409ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.265+0000 7f232be99700 1 --2- 172.21.15.156:0/1972380595 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f232409f260 0x7f2324133c80 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.265+0000 7f232be99700 1 -- 172.21.15.156:0/1972380595 >> 172.21.15.156:0/1972380595 conn(0x7f23240a0f70 msgr2=0x7f23240a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:40.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.266+0000 7f232be99700 1 -- 172.21.15.156:0/1972380595 shutdown_connections 2023-09-30T22:25:40.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.266+0000 7f232be99700 1 -- 172.21.15.156:0/1972380595 wait complete. 2023-09-30T22:25:40.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.267+0000 7f232be99700 1 Processor -- start 2023-09-30T22:25:40.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.267+0000 7f232be99700 1 -- start start 2023-09-30T22:25:40.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.267+0000 7f232be99700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f232409e950 0x7f23241c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:40.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.267+0000 7f232be99700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f232409f260 0x7f23241c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:40.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.267+0000 7f232be99700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23241341c0 0x7f23241c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:40.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.267+0000 7f232be99700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2324124160 con 0x7f23241341c0 2023-09-30T22:25:40.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.267+0000 7f232be99700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23241255b0 con 0x7f232409f260 2023-09-30T22:25:40.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.267+0000 7f232be99700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2324124a50 con 0x7f232409e950 2023-09-30T22:25:40.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.268+0000 7f2329c35700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f232409e950 0x7f23241c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:40.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.268+0000 7f232a436700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23241341c0 0x7f23241c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:40.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.268+0000 7f2329c35700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f232409e950 0x7f23241c84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56552/0 (socket says 172.21.15.156:56552) 2023-09-30T22:25:40.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.268+0000 7f2329c35700 1 -- 172.21.15.156:0/3574589193 learned_addr learned my addr 172.21.15.156:0/3574589193 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:40.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.268+0000 7f2329434700 1 --2- 172.21.15.156:0/3574589193 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f232409f260 0x7f23241c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:40.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.268+0000 7f2329c35700 1 -- 172.21.15.156:0/3574589193 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f232409f260 msgr2=0x7f23241c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:40.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.268+0000 7f2329c35700 1 --2- 172.21.15.156:0/3574589193 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f232409f260 0x7f23241c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.268+0000 7f2329c35700 1 -- 172.21.15.156:0/3574589193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23241341c0 msgr2=0x7f23241c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:40.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.268+0000 7f2329c35700 1 --2- 172.21.15.156:0/3574589193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23241341c0 0x7f23241c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.268+0000 7f2329c35700 1 -- 172.21.15.156:0/3574589193 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2320009430 con 0x7f232409e950 2023-09-30T22:25:40.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.268+0000 7f2329c35700 1 --2- 172.21.15.156:0/3574589193 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f232409e950 0x7f23241c84e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f232000ebb0 tx=0x7f232000eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:40.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.269+0000 7f231a7fc700 1 -- 172.21.15.156:0/3574589193 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2320005a20 con 0x7f232409e950 2023-09-30T22:25:40.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.269+0000 7f232be99700 1 -- 172.21.15.156:0/3574589193 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23140094a0 con 0x7f232409e950 2023-09-30T22:25:40.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.269+0000 7f232be99700 1 -- 172.21.15.156:0/3574589193 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2324126240 con 0x7f232409e950 2023-09-30T22:25:40.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.269+0000 7f231a7fc700 1 -- 172.21.15.156:0/3574589193 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2320005b80 con 0x7f232409e950 2023-09-30T22:25:40.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.269+0000 7f231a7fc700 1 -- 172.21.15.156:0/3574589193 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232000c850 con 0x7f232409e950 2023-09-30T22:25:40.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.270+0000 7f231a7fc700 1 -- 172.21.15.156:0/3574589193 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f232000c9b0 con 0x7f232409e950 2023-09-30T22:25:40.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.270+0000 7f232be99700 1 -- 172.21.15.156:0/3574589193 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2324126430 con 0x7f232409e950 2023-09-30T22:25:40.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.270+0000 7f231a7fc700 1 -- 172.21.15.156:0/3574589193 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f232003f9f0 con 0x7f232409e950 2023-09-30T22:25:40.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.278+0000 7f231a7fc700 1 -- 172.21.15.156:0/3574589193 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2320041e60 con 0x7f232409e950 2023-09-30T22:25:40.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.310+0000 7fe630523700 1 Processor -- start 2023-09-30T22:25:40.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.310+0000 7fe630523700 1 -- start start 2023-09-30T22:25:40.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.311+0000 7fe630523700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe62809a090 0x7fe62809e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:40.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.311+0000 7fe630523700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe62809f2a0 0x7fe62813fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:40.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.311+0000 7fe630523700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe62806bc80 con 0x7fe62809ee90 2023-09-30T22:25:40.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.311+0000 7fe630523700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62809a460 con 0x7fe62809a090 2023-09-30T22:25:40.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.311+0000 7fe630523700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe62806c0f0 con 0x7fe62809f2a0 2023-09-30T22:25:40.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.311+0000 7fe62eac0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe62809f2a0 0x7fe62813fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:40.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.311+0000 7fe62eac0700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe62809f2a0 0x7fe62813fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56558/0 (socket says 172.21.15.156:56558) 2023-09-30T22:25:40.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.311+0000 7fe62eac0700 1 -- 172.21.15.156:0/2047653789 learned_addr learned my addr 172.21.15.156:0/2047653789 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:40.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.311+0000 7fe62dabe700 1 --1- 172.21.15.156:0/2047653789 >> v1:172.21.15.156:6789/0 conn(0x7fe62809ee90 0x7fe62813c470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:59398/0 (socket says 172.21.15.156:59398) 2023-09-30T22:25:40.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.311+0000 7fe62e2bf700 1 --2- 172.21.15.156:0/2047653789 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe62809a090 0x7fe62809e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:40.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.312+0000 7fe62e2bf700 1 -- 172.21.15.156:0/2047653789 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe62809f2a0 msgr2=0x7fe62813fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:40.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.312+0000 7fe62e2bf700 1 --2- 172.21.15.156:0/2047653789 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe62809f2a0 0x7fe62813fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.312+0000 7fe62e2bf700 1 -- 172.21.15.156:0/2047653789 >> v1:172.21.15.156:6789/0 conn(0x7fe62809ee90 legacy=0x7fe62813c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:40.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.312+0000 7fe62e2bf700 1 -- 172.21.15.156:0/2047653789 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe62806d8f0 con 0x7fe62809a090 2023-09-30T22:25:40.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.312+0000 7fe62eac0700 1 --2- 172.21.15.156:0/2047653789 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe62809f2a0 0x7fe62813fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:40.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.312+0000 7fe62e2bf700 1 --2- 172.21.15.156:0/2047653789 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe62809a090 0x7fe62809e950 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe624009880 tx=0x7fe624009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b92deac406711b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:40.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.312+0000 7fe62d2bd700 1 -- 172.21.15.156:0/2047653789 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe624005e30 con 0x7fe62809a090 2023-09-30T22:25:40.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.312+0000 7fe62d2bd700 1 -- 172.21.15.156:0/2047653789 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe624006030 con 0x7fe62809a090 2023-09-30T22:25:40.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.312+0000 7fe62d2bd700 1 -- 172.21.15.156:0/2047653789 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6240063c0 con 0x7fe62809a090 2023-09-30T22:25:40.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.313+0000 7fe630523700 1 -- 172.21.15.156:0/2047653789 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe62809a090 msgr2=0x7fe62809e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:40.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.313+0000 7fe630523700 1 --2- 172.21.15.156:0/2047653789 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe62809a090 0x7fe62809e950 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe624009880 tx=0x7fe624009b90 comp rx=0 tx=0).stop 2023-09-30T22:25:40.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.313+0000 7fe630523700 1 -- 172.21.15.156:0/2047653789 shutdown_connections 2023-09-30T22:25:40.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.313+0000 7fe630523700 1 --2- 172.21.15.156:0/2047653789 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe62809a090 0x7fe62809e950 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.313+0000 7fe630523700 1 --2- 172.21.15.156:0/2047653789 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe62809f2a0 0x7fe62813fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.313+0000 7fe630523700 1 -- 172.21.15.156:0/2047653789 >> 172.21.15.156:0/2047653789 conn(0x7fe6280a0f70 msgr2=0x7fe6280a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:40.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.313+0000 7fe630523700 1 -- 172.21.15.156:0/2047653789 shutdown_connections 2023-09-30T22:25:40.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.313+0000 7fe630523700 1 -- 172.21.15.156:0/2047653789 wait complete. 2023-09-30T22:25:40.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.314+0000 7fe630523700 1 Processor -- start 2023-09-30T22:25:40.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.314+0000 7fe630523700 1 -- start start 2023-09-30T22:25:40.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.314+0000 7fe630523700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe62809a090 0x7fe6281bcea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:40.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.314+0000 7fe630523700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe62809ee90 0x7fe6281bd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:40.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.314+0000 7fe630523700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe62809f2a0 0x7fe6281cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:40.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.314+0000 7fe630523700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6281acec0 con 0x7fe62809f2a0 2023-09-30T22:25:40.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.314+0000 7fe630523700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6280a1fe0 con 0x7fe62809a090 2023-09-30T22:25:40.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.314+0000 7fe630523700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6281ac200 con 0x7fe62809ee90 2023-09-30T22:25:40.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.314+0000 7fe62eac0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe62809f2a0 0x7fe6281cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:40.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.314+0000 7fe62eac0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe62809f2a0 0x7fe6281cc720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34560/0 (socket says 172.21.15.156:34560) 2023-09-30T22:25:40.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.314+0000 7fe62dabe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe62809ee90 0x7fe6281bd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:40.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.314+0000 7fe62eac0700 1 -- 172.21.15.156:0/3681666631 learned_addr learned my addr 172.21.15.156:0/3681666631 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:40.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.315+0000 7fe62eac0700 1 -- 172.21.15.156:0/3681666631 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe62809ee90 msgr2=0x7fe6281bd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:40.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.315+0000 7fe62eac0700 1 --2- 172.21.15.156:0/3681666631 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe62809ee90 0x7fe6281bd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.315+0000 7fe62eac0700 1 -- 172.21.15.156:0/3681666631 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe62809a090 msgr2=0x7fe6281bcea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:40.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.315+0000 7fe62eac0700 1 --2- 172.21.15.156:0/3681666631 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe62809a090 0x7fe6281bcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.315+0000 7fe62eac0700 1 -- 172.21.15.156:0/3681666631 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe620009b30 con 0x7fe62809f2a0 2023-09-30T22:25:40.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.315+0000 7fe62eac0700 1 --2- 172.21.15.156:0/3681666631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe62809f2a0 0x7fe6281cc720 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fe62000efc0 tx=0x7fe62000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:40.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.315+0000 7fe61effd700 1 -- 172.21.15.156:0/3681666631 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe620018070 con 0x7fe62809f2a0 2023-09-30T22:25:40.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.315+0000 7fe61effd700 1 -- 172.21.15.156:0/3681666631 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62000f040 con 0x7fe62809f2a0 2023-09-30T22:25:40.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.315+0000 7fe61effd700 1 -- 172.21.15.156:0/3681666631 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe620003c20 con 0x7fe62809f2a0 2023-09-30T22:25:40.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.316+0000 7fe630523700 1 -- 172.21.15.156:0/3681666631 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe624009430 con 0x7fe62809f2a0 2023-09-30T22:25:40.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.316+0000 7fe630523700 1 -- 172.21.15.156:0/3681666631 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe62811db90 con 0x7fe62809f2a0 2023-09-30T22:25:40.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.316+0000 7fe630523700 1 -- 172.21.15.156:0/3681666631 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe62804f2a0 con 0x7fe62809f2a0 2023-09-30T22:25:40.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.317+0000 7fe61effd700 1 -- 172.21.15.156:0/3681666631 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe62000c8d0 con 0x7fe62809f2a0 2023-09-30T22:25:40.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.317+0000 7fe61effd700 1 -- 172.21.15.156:0/3681666631 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe62003f640 con 0x7fe62809f2a0 2023-09-30T22:25:40.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.326+0000 7fe61effd700 1 -- 172.21.15.156:0/3681666631 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe62001cdd0 con 0x7fe62809f2a0 2023-09-30T22:25:40.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.356+0000 7f094be89700 1 -- 172.21.15.156:0/845842409 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0944120c10 con 0x7f09440a0a70 2023-09-30T22:25:40.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.356+0000 7f093a7fc700 1 -- 172.21.15.156:0/845842409 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0940017030 con 0x7f09440a0a70 2023-09-30T22:25:40.357 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:40.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.359+0000 7f094be89700 1 -- 172.21.15.156:0/845842409 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09440a0a70 msgr2=0x7f094411e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:40.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.359+0000 7f094be89700 1 --2- 172.21.15.156:0/845842409 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09440a0a70 0x7f094411e8a0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f094000c510 tx=0x7f094000c820 comp rx=0 tx=0).stop 2023-09-30T22:25:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.359+0000 7f094be89700 1 -- 172.21.15.156:0/845842409 shutdown_connections 2023-09-30T22:25:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.359+0000 7f094be89700 1 --2- 172.21.15.156:0/845842409 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0944139200 0x7f094411f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.359+0000 7f094be89700 1 --2- 172.21.15.156:0/845842409 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09440a0a70 0x7f094411e8a0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.359+0000 7f094be89700 1 --2- 172.21.15.156:0/845842409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09440a1550 0x7f094411ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.359+0000 7f094be89700 1 -- 172.21.15.156:0/845842409 >> 172.21.15.156:0/845842409 conn(0x7f09440a6610 msgr2=0x7f0944138120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.359+0000 7f094be89700 1 -- 172.21.15.156:0/845842409 shutdown_connections 2023-09-30T22:25:40.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.359+0000 7f094be89700 1 -- 172.21.15.156:0/845842409 wait complete. 2023-09-30T22:25:40.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:40.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.446+0000 7f1a703db700 1 -- 172.21.15.156:0/940845319 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1a6809f0f0 con 0x7f1a68139280 2023-09-30T22:25:40.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.447+0000 7f1a5effd700 1 -- 172.21.15.156:0/940845319 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a60035090 con 0x7f1a68139280 2023-09-30T22:25:40.448 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:40.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.449+0000 7f1a703db700 1 -- 172.21.15.156:0/940845319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a68139280 msgr2=0x7f1a6812d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:40.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.449+0000 7f1a703db700 1 --2- 172.21.15.156:0/940845319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a68139280 0x7f1a6812d5b0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f1a60014040 tx=0x7f1a60004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.449+0000 7f1a703db700 1 -- 172.21.15.156:0/940845319 shutdown_connections 2023-09-30T22:25:40.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.449+0000 7f1a703db700 1 --2- 172.21.15.156:0/940845319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a68139280 0x7f1a6812d5b0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.449+0000 7f1a703db700 1 --2- 172.21.15.156:0/940845319 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1a68133ad0 0x7f1a6812cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.449+0000 7f1a703db700 1 --2- 172.21.15.156:0/940845319 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1a68136960 0x7f1a6812d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.449+0000 7f1a703db700 1 -- 172.21.15.156:0/940845319 >> 172.21.15.156:0/940845319 conn(0x7f1a68099c40 msgr2=0x7f1a680a30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:40.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.449+0000 7f1a703db700 1 -- 172.21.15.156:0/940845319 shutdown_connections 2023-09-30T22:25:40.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.449+0000 7f1a703db700 1 -- 172.21.15.156:0/940845319 wait complete. 2023-09-30T22:25:40.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:40.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.476+0000 7f232be99700 1 -- 172.21.15.156:0/3574589193 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f232404f2a0 con 0x7f232409e950 2023-09-30T22:25:40.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.476+0000 7f231a7fc700 1 -- 172.21.15.156:0/3574589193 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2320020030 con 0x7f232409e950 2023-09-30T22:25:40.477 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:40.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.478+0000 7f232be99700 1 -- 172.21.15.156:0/3574589193 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f232409e950 msgr2=0x7f23241c84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:40.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.478+0000 7f232be99700 1 --2- 172.21.15.156:0/3574589193 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f232409e950 0x7f23241c84e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f232000ebb0 tx=0x7f232000eec0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.479+0000 7f232be99700 1 -- 172.21.15.156:0/3574589193 shutdown_connections 2023-09-30T22:25:40.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.479+0000 7f232be99700 1 --2- 172.21.15.156:0/3574589193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f23241341c0 0x7f23241c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.479+0000 7f232be99700 1 --2- 172.21.15.156:0/3574589193 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f232409e950 0x7f23241c84e0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.479+0000 7f232be99700 1 --2- 172.21.15.156:0/3574589193 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f232409f260 0x7f23241c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.479+0000 7f232be99700 1 -- 172.21.15.156:0/3574589193 >> 172.21.15.156:0/3574589193 conn(0x7f23240a0f70 msgr2=0x7f23240a3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:40.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.479+0000 7f232be99700 1 -- 172.21.15.156:0/3574589193 shutdown_connections 2023-09-30T22:25:40.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.479+0000 7f232be99700 1 -- 172.21.15.156:0/3574589193 wait complete. 2023-09-30T22:25:40.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:40.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.522+0000 7fe630523700 1 -- 172.21.15.156:0/3681666631 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe62811db70 con 0x7fe62809f2a0 2023-09-30T22:25:40.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.522+0000 7fe61effd700 1 -- 172.21.15.156:0/3681666631 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe62001c370 con 0x7fe62809f2a0 2023-09-30T22:25:40.523 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:40.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.524+0000 7fe630523700 1 -- 172.21.15.156:0/3681666631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe62809f2a0 msgr2=0x7fe6281cc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:40.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.524+0000 7fe630523700 1 --2- 172.21.15.156:0/3681666631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe62809f2a0 0x7fe6281cc720 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fe62000efc0 tx=0x7fe62000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.524+0000 7fe630523700 1 -- 172.21.15.156:0/3681666631 shutdown_connections 2023-09-30T22:25:40.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.524+0000 7fe630523700 1 --2- 172.21.15.156:0/3681666631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe62809f2a0 0x7fe6281cc720 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.524+0000 7fe630523700 1 --2- 172.21.15.156:0/3681666631 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe62809a090 0x7fe6281bcea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.524+0000 7fe630523700 1 --2- 172.21.15.156:0/3681666631 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe62809ee90 0x7fe6281bd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.524+0000 7fe630523700 1 -- 172.21.15.156:0/3681666631 >> 172.21.15.156:0/3681666631 conn(0x7fe6280a0f70 msgr2=0x7fe62809c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:40.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.524+0000 7fe630523700 1 -- 172.21.15.156:0/3681666631 shutdown_connections 2023-09-30T22:25:40.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:40.524+0000 7fe630523700 1 -- 172.21.15.156:0/3681666631 wait complete. 2023-09-30T22:25:40.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:41.373 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:41.463 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:41.492 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:41.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.507+0000 7fe5cfbba700 1 Processor -- start 2023-09-30T22:25:41.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.508+0000 7fe5cfbba700 1 -- start start 2023-09-30T22:25:41.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.508+0000 7fe5cfbba700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe5c809e870 0x7fe5c809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.508+0000 7fe5cfbba700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5c809f180 0x7fe5c8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.508+0000 7fe5cfbba700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c809c970 con 0x7fe5c8131d70 2023-09-30T22:25:41.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.508+0000 7fe5cfbba700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c80a0920 con 0x7fe5c809e870 2023-09-30T22:25:41.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.508+0000 7fe5cfbba700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c809f9c0 con 0x7fe5c809f180 2023-09-30T22:25:41.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.508+0000 7fe5cd956700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe5c809e870 0x7fe5c809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.508+0000 7fe5cd155700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5c809f180 0x7fe5c8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.508+0000 7fe5ce157700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe5c8131d70 0x7fe5c8138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:43792/0 (socket says 172.21.15.156:43792) 2023-09-30T22:25:41.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.508+0000 7fe5ce157700 1 -- 172.21.15.156:0/2581773995 learned_addr learned my addr 172.21.15.156:0/2581773995 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:41.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.508+0000 7fe5cd956700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe5c809e870 0x7fe5c809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:55834/0 (socket says 172.21.15.156:55834) 2023-09-30T22:25:41.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.509+0000 7fe5cd155700 1 -- 172.21.15.156:0/2581773995 >> v2:172.21.15.156:3300/0 conn(0x7fe5c809e870 msgr2=0x7fe5c809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:41.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.509+0000 7fe5cd155700 1 --2- 172.21.15.156:0/2581773995 >> v2:172.21.15.156:3300/0 conn(0x7fe5c809e870 0x7fe5c809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.509+0000 7fe5cd155700 1 -- 172.21.15.156:0/2581773995 >> v1:172.21.15.156:6789/0 conn(0x7fe5c8131d70 legacy=0x7fe5c8138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.509+0000 7fe5cc954700 1 -- 172.21.15.156:0/2581773995 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182839507 0 0) 0x7fe5c809c970 con 0x7fe5c8131d70 2023-09-30T22:25:41.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.509+0000 7fe5cd155700 1 -- 172.21.15.156:0/2581773995 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c809bab0 con 0x7fe5c809f180 2023-09-30T22:25:41.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.509+0000 7fe5cd956700 1 --2- 172.21.15.156:0/2581773995 >> v2:172.21.15.156:3300/0 conn(0x7fe5c809e870 0x7fe5c809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:41.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.509+0000 7fe5cd155700 1 --2- 172.21.15.156:0/2581773995 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5c809f180 0x7fe5c8131830 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009840 tx=0x7fe5b8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a7b360b7446411c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:41.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.509+0000 7fe5cc954700 1 -- 172.21.15.156:0/2581773995 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8011830 con 0x7fe5c809f180 2023-09-30T22:25:41.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.509+0000 7fe5cc954700 1 -- 172.21.15.156:0/2581773995 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b8011990 con 0x7fe5c809f180 2023-09-30T22:25:41.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.509+0000 7fe5cc954700 1 -- 172.21.15.156:0/2581773995 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8011d20 con 0x7fe5c809f180 2023-09-30T22:25:41.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.510+0000 7fe5cfbba700 1 -- 172.21.15.156:0/2581773995 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5c809f180 msgr2=0x7fe5c8131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.510+0000 7fe5cfbba700 1 --2- 172.21.15.156:0/2581773995 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5c809f180 0x7fe5c8131830 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009840 tx=0x7fe5b8009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:41.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.510+0000 7fe5cfbba700 1 -- 172.21.15.156:0/2581773995 shutdown_connections 2023-09-30T22:25:41.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.510+0000 7fe5cfbba700 1 --2- 172.21.15.156:0/2581773995 >> v2:172.21.15.156:3300/0 conn(0x7fe5c809e870 0x7fe5c809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.510+0000 7fe5cfbba700 1 --2- 172.21.15.156:0/2581773995 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5c809f180 0x7fe5c8131830 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.510+0000 7fe5cfbba700 1 -- 172.21.15.156:0/2581773995 >> 172.21.15.156:0/2581773995 conn(0x7fe5c80a4430 msgr2=0x7fe5c80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:41.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.510+0000 7fe5cfbba700 1 -- 172.21.15.156:0/2581773995 shutdown_connections 2023-09-30T22:25:41.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.510+0000 7fe5cfbba700 1 -- 172.21.15.156:0/2581773995 wait complete. 2023-09-30T22:25:41.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.511+0000 7fe5cfbba700 1 Processor -- start 2023-09-30T22:25:41.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.511+0000 7fe5cfbba700 1 -- start start 2023-09-30T22:25:41.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.511+0000 7fe5cfbba700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5c809e870 0x7fe5c8120010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.511+0000 7fe5cfbba700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5c809f180 0x7fe5c8120550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.511+0000 7fe5cfbba700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5c8131d70 0x7fe5c8120a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.511+0000 7fe5cfbba700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c8123310 con 0x7fe5c809e870 2023-09-30T22:25:41.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.511+0000 7fe5cfbba700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c8121c30 con 0x7fe5c809f180 2023-09-30T22:25:41.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.511+0000 7fe5cfbba700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c81237c0 con 0x7fe5c8131d70 2023-09-30T22:25:41.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.511+0000 7fe5cd155700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5c809f180 0x7fe5c8120550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.511+0000 7fe5cd956700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5c809e870 0x7fe5c8120010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.511+0000 7fe5cd155700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5c809f180 0x7fe5c8120550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40040/0 (socket says 172.21.15.156:40040) 2023-09-30T22:25:41.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.511+0000 7fe5cd155700 1 -- 172.21.15.156:0/2131706681 learned_addr learned my addr 172.21.15.156:0/2131706681 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:41.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.511+0000 7fe5ce157700 1 --2- 172.21.15.156:0/2131706681 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5c8131d70 0x7fe5c8120a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.519 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.512+0000 7fe5cd155700 1 -- 172.21.15.156:0/2131706681 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5c8131d70 msgr2=0x7fe5c8120a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.512+0000 7fe5cd155700 1 --2- 172.21.15.156:0/2131706681 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5c8131d70 0x7fe5c8120a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.512+0000 7fe5cd155700 1 -- 172.21.15.156:0/2131706681 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5c809e870 msgr2=0x7fe5c8120010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.512+0000 7fe5cd155700 1 --2- 172.21.15.156:0/2131706681 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5c809e870 0x7fe5c8120010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.512+0000 7fe5cd155700 1 -- 172.21.15.156:0/2131706681 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c40094a0 con 0x7fe5c809f180 2023-09-30T22:25:41.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.512+0000 7fe5cd956700 1 --2- 172.21.15.156:0/2131706681 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5c809e870 0x7fe5c8120010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:41.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.512+0000 7fe5cd155700 1 --2- 172.21.15.156:0/2131706681 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5c809f180 0x7fe5c8120550 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009fd0 tx=0x7fe5b8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:41.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.512+0000 7fe5be7fc700 1 -- 172.21.15.156:0/2131706681 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b80036a0 con 0x7fe5c809f180 2023-09-30T22:25:41.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.512+0000 7fe5be7fc700 1 -- 172.21.15.156:0/2131706681 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b801f070 con 0x7fe5c809f180 2023-09-30T22:25:41.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.512+0000 7fe5be7fc700 1 -- 172.21.15.156:0/2131706681 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8003a60 con 0x7fe5c809f180 2023-09-30T22:25:41.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.512+0000 7fe5cfbba700 1 -- 172.21.15.156:0/2131706681 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b80094a0 con 0x7fe5c809f180 2023-09-30T22:25:41.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.512+0000 7fe5cfbba700 1 -- 172.21.15.156:0/2131706681 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c8123500 con 0x7fe5c809f180 2023-09-30T22:25:41.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.513+0000 7fe5be7fc700 1 -- 172.21.15.156:0/2131706681 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe5b8003bc0 con 0x7fe5c809f180 2023-09-30T22:25:41.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.513+0000 7fe5be7fc700 1 -- 172.21.15.156:0/2131706681 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe5b8021070 con 0x7fe5c809f180 2023-09-30T22:25:41.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.513+0000 7fe5cfbba700 1 -- 172.21.15.156:0/2131706681 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c811ce70 con 0x7fe5c809f180 2023-09-30T22:25:41.521 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.518+0000 7fe5be7fc700 1 -- 172.21.15.156:0/2131706681 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe5b8015020 con 0x7fe5c809f180 2023-09-30T22:25:41.538 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:41.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.595+0000 7fbb5865a700 1 Processor -- start 2023-09-30T22:25:41.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.595+0000 7fbb5865a700 1 -- start start 2023-09-30T22:25:41.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.596+0000 7fbb5865a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbb5009ad40 0x7fbb50133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.596+0000 7fbb5865a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb50133f70 0x7fbb501343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.596+0000 7fbb5865a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb500a0a70 0x7fbb500a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.596+0000 7fbb5865a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb500a3b60 con 0x7fbb5009ad40 2023-09-30T22:25:41.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.596+0000 7fbb5865a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb501348e0 con 0x7fbb50133f70 2023-09-30T22:25:41.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.596+0000 7fbb5865a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5009b110 con 0x7fbb500a0a70 2023-09-30T22:25:41.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.596+0000 7fbb56bf7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb500a0a70 0x7fbb500a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.596+0000 7fbb55bf5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb50133f70 0x7fbb501343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.596+0000 7fbb55bf5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb50133f70 0x7fbb501343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40044/0 (socket says 172.21.15.156:40044) 2023-09-30T22:25:41.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.596+0000 7fbb56bf7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb500a0a70 0x7fbb500a0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46048/0 (socket says 172.21.15.156:46048) 2023-09-30T22:25:41.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.596+0000 7fbb55bf5700 1 -- 172.21.15.156:0/1736382245 learned_addr learned my addr 172.21.15.156:0/1736382245 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:41.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.596+0000 7fbb563f6700 1 --2- 172.21.15.156:0/1736382245 >> v2:172.21.15.156:3300/0 conn(0x7fbb5009ad40 0x7fbb50133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.597+0000 7fbb55bf5700 1 -- 172.21.15.156:0/1736382245 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb500a0a70 msgr2=0x7fbb500a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:41.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.597+0000 7fbb55bf5700 1 --2- 172.21.15.156:0/1736382245 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb500a0a70 0x7fbb500a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.597+0000 7fbb55bf5700 1 -- 172.21.15.156:0/1736382245 >> v2:172.21.15.156:3300/0 conn(0x7fbb5009ad40 msgr2=0x7fbb50133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:41.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.597+0000 7fbb55bf5700 1 --2- 172.21.15.156:0/1736382245 >> v2:172.21.15.156:3300/0 conn(0x7fbb5009ad40 0x7fbb50133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.597+0000 7fbb55bf5700 1 -- 172.21.15.156:0/1736382245 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb500a2fa0 con 0x7fbb50133f70 2023-09-30T22:25:41.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.597+0000 7fbb55bf5700 1 --2- 172.21.15.156:0/1736382245 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb50133f70 0x7fbb501343a0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fbb400098f0 tx=0x7fbb40009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b8f359a5fd544bc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:41.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.597+0000 7fbb553f4700 1 -- 172.21.15.156:0/1736382245 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40011830 con 0x7fbb50133f70 2023-09-30T22:25:41.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.597+0000 7fbb553f4700 1 -- 172.21.15.156:0/1736382245 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb40011990 con 0x7fbb50133f70 2023-09-30T22:25:41.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.597+0000 7fbb553f4700 1 -- 172.21.15.156:0/1736382245 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40011d20 con 0x7fbb50133f70 2023-09-30T22:25:41.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.598+0000 7fbb5865a700 1 -- 172.21.15.156:0/1736382245 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb50133f70 msgr2=0x7fbb501343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.598+0000 7fbb5865a700 1 --2- 172.21.15.156:0/1736382245 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb50133f70 0x7fbb501343a0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fbb400098f0 tx=0x7fbb40009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:41.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.598+0000 7fbb5865a700 1 -- 172.21.15.156:0/1736382245 shutdown_connections 2023-09-30T22:25:41.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.598+0000 7fbb5865a700 1 --2- 172.21.15.156:0/1736382245 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb500a0a70 0x7fbb500a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.598+0000 7fbb5865a700 1 --2- 172.21.15.156:0/1736382245 >> v2:172.21.15.156:3300/0 conn(0x7fbb5009ad40 0x7fbb50133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.598+0000 7fbb5865a700 1 --2- 172.21.15.156:0/1736382245 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb50133f70 0x7fbb501343a0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.598+0000 7fbb5865a700 1 -- 172.21.15.156:0/1736382245 >> 172.21.15.156:0/1736382245 conn(0x7fbb50099c40 msgr2=0x7fbb5006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:41.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.598+0000 7fbb5865a700 1 -- 172.21.15.156:0/1736382245 shutdown_connections 2023-09-30T22:25:41.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.598+0000 7fbb5865a700 1 -- 172.21.15.156:0/1736382245 wait complete. 2023-09-30T22:25:41.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.599+0000 7fbb5865a700 1 Processor -- start 2023-09-30T22:25:41.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.599+0000 7fbb5865a700 1 -- start start 2023-09-30T22:25:41.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.599+0000 7fbb5865a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb5009ad40 0x7fbb501c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.599+0000 7fbb5865a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb500a0a70 0x7fbb501c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.599+0000 7fbb5865a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb50133f70 0x7fbb501c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.599+0000 7fbb5865a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb50121330 con 0x7fbb5009ad40 2023-09-30T22:25:41.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.599+0000 7fbb5865a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5011f670 con 0x7fbb500a0a70 2023-09-30T22:25:41.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.599+0000 7fbb5865a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5009bf50 con 0x7fbb50133f70 2023-09-30T22:25:41.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.599+0000 7fbb55bf5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb500a0a70 0x7fbb501c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.599+0000 7fbb55bf5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb500a0a70 0x7fbb501c87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40046/0 (socket says 172.21.15.156:40046) 2023-09-30T22:25:41.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.599+0000 7fbb55bf5700 1 -- 172.21.15.156:0/4147552863 learned_addr learned my addr 172.21.15.156:0/4147552863 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:41.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.599+0000 7fbb563f6700 1 --2- 172.21.15.156:0/4147552863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb5009ad40 0x7fbb501c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.600+0000 7fbb56bf7700 1 --2- 172.21.15.156:0/4147552863 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb50133f70 0x7fbb501c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.600+0000 7fbb563f6700 1 -- 172.21.15.156:0/4147552863 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb50133f70 msgr2=0x7fbb501c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.600+0000 7fbb563f6700 1 --2- 172.21.15.156:0/4147552863 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb50133f70 0x7fbb501c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.600+0000 7fbb563f6700 1 -- 172.21.15.156:0/4147552863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb500a0a70 msgr2=0x7fbb501c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.600+0000 7fbb563f6700 1 --2- 172.21.15.156:0/4147552863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb500a0a70 0x7fbb501c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.600+0000 7fbb563f6700 1 -- 172.21.15.156:0/4147552863 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb40009550 con 0x7fbb5009ad40 2023-09-30T22:25:41.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.600+0000 7fbb563f6700 1 --2- 172.21.15.156:0/4147552863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb5009ad40 0x7fbb501c8270 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c00e870 tx=0x7fbb4c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:41.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.600+0000 7fbb46ffd700 1 -- 172.21.15.156:0/4147552863 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c013680 con 0x7fbb5009ad40 2023-09-30T22:25:41.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.600+0000 7fbb46ffd700 1 -- 172.21.15.156:0/4147552863 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4c0137e0 con 0x7fbb5009ad40 2023-09-30T22:25:41.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.600+0000 7fbb5865a700 1 -- 172.21.15.156:0/4147552863 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb5009c7e0 con 0x7fbb5009ad40 2023-09-30T22:25:41.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.600+0000 7fbb46ffd700 1 -- 172.21.15.156:0/4147552863 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c013b50 con 0x7fbb5009ad40 2023-09-30T22:25:41.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.600+0000 7fbb5865a700 1 -- 172.21.15.156:0/4147552863 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb501202e0 con 0x7fbb5009ad40 2023-09-30T22:25:41.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.601+0000 7fbb46ffd700 1 -- 172.21.15.156:0/4147552863 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbb4c013cb0 con 0x7fbb5009ad40 2023-09-30T22:25:41.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.601+0000 7fbb5865a700 1 -- 172.21.15.156:0/4147552863 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb5004f2a0 con 0x7fbb5009ad40 2023-09-30T22:25:41.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.602+0000 7fbb46ffd700 1 -- 172.21.15.156:0/4147552863 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbb4c03f440 con 0x7fbb5009ad40 2023-09-30T22:25:41.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.610+0000 7fbb46ffd700 1 -- 172.21.15.156:0/4147552863 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb4c021080 con 0x7fbb5009ad40 2023-09-30T22:25:41.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.640+0000 7fb71f792700 1 Processor -- start 2023-09-30T22:25:41.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.640+0000 7fb71f792700 1 -- start start 2023-09-30T22:25:41.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.641+0000 7fb71f792700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb71809f350 0x7fb718136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.641+0000 7fb71f792700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7181371c0 0x7fb7181395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.641+0000 7fb71f792700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb71809c970 con 0x7fb71809e870 2023-09-30T22:25:41.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.641+0000 7fb71f792700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7180a0920 con 0x7fb7181371c0 2023-09-30T22:25:41.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.641+0000 7fb71f792700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb71809f9c0 con 0x7fb71809f350 2023-09-30T22:25:41.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.641+0000 7fb71d52e700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb71809e870 0x7fb71809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:43808/0 (socket says 172.21.15.156:43808) 2023-09-30T22:25:41.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.641+0000 7fb71d52e700 1 -- 172.21.15.156:0/3043956923 learned_addr learned my addr 172.21.15.156:0/3043956923 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:41.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.641+0000 7fb71dd2f700 1 --2- 172.21.15.156:0/3043956923 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7181371c0 0x7fb7181395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.641+0000 7fb71cd2d700 1 --2- 172.21.15.156:0/3043956923 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb71809f350 0x7fb718136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.641+0000 7fb70ffff700 1 -- 172.21.15.156:0/3043956923 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370281805 0 0) 0x7fb71809c970 con 0x7fb71809e870 2023-09-30T22:25:41.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.642+0000 7fb70ffff700 1 -- 172.21.15.156:0/3043956923 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7040035b0 con 0x7fb71809e870 2023-09-30T22:25:41.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.642+0000 7fb71dd2f700 1 -- 172.21.15.156:0/3043956923 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb71809f350 msgr2=0x7fb718136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:41.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.642+0000 7fb71dd2f700 1 --2- 172.21.15.156:0/3043956923 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb71809f350 0x7fb718136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.642+0000 7fb71dd2f700 1 -- 172.21.15.156:0/3043956923 >> v1:172.21.15.156:6789/0 conn(0x7fb71809e870 legacy=0x7fb71809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.642+0000 7fb71dd2f700 1 -- 172.21.15.156:0/3043956923 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71809bab0 con 0x7fb7181371c0 2023-09-30T22:25:41.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.642+0000 7fb71dd2f700 1 --2- 172.21.15.156:0/3043956923 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7181371c0 0x7fb7181395a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb710009dc0 tx=0x7fb71000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fe711f616fcc78b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:41.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.642+0000 7fb70ffff700 1 -- 172.21.15.156:0/3043956923 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71000e070 con 0x7fb7181371c0 2023-09-30T22:25:41.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.642+0000 7fb70ffff700 1 -- 172.21.15.156:0/3043956923 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71000bb20 con 0x7fb7181371c0 2023-09-30T22:25:41.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.642+0000 7fb70ffff700 1 -- 172.21.15.156:0/3043956923 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb710012430 con 0x7fb7181371c0 2023-09-30T22:25:41.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.643+0000 7fb71f792700 1 -- 172.21.15.156:0/3043956923 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7181371c0 msgr2=0x7fb7181395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.643+0000 7fb71f792700 1 --2- 172.21.15.156:0/3043956923 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7181371c0 0x7fb7181395a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb710009dc0 tx=0x7fb71000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:41.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.643+0000 7fb71f792700 1 -- 172.21.15.156:0/3043956923 shutdown_connections 2023-09-30T22:25:41.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.643+0000 7fb71f792700 1 --2- 172.21.15.156:0/3043956923 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7181371c0 0x7fb7181395a0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.643+0000 7fb71f792700 1 --2- 172.21.15.156:0/3043956923 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb71809f350 0x7fb718136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.643+0000 7fb71f792700 1 -- 172.21.15.156:0/3043956923 >> 172.21.15.156:0/3043956923 conn(0x7fb7180a4430 msgr2=0x7fb7180a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:41.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.643+0000 7fb71f792700 1 -- 172.21.15.156:0/3043956923 shutdown_connections 2023-09-30T22:25:41.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.643+0000 7fb71f792700 1 -- 172.21.15.156:0/3043956923 wait complete. 2023-09-30T22:25:41.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.645+0000 7fb71f792700 1 Processor -- start 2023-09-30T22:25:41.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.645+0000 7fb71f792700 1 -- start start 2023-09-30T22:25:41.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.645+0000 7fb71f792700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb71809e870 0x7fb71811e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.645+0000 7fb71f792700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb71809f350 0x7fb71811eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.645+0000 7fb71f792700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7181371c0 0x7fb71811f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.645+0000 7fb71f792700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7181216d0 con 0x7fb7181371c0 2023-09-30T22:25:41.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.645+0000 7fb71f792700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71811fd50 con 0x7fb71809f350 2023-09-30T22:25:41.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.645+0000 7fb71f792700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb71809dba0 con 0x7fb71809e870 2023-09-30T22:25:41.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.645+0000 7fb71cd2d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb71809f350 0x7fb71811eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.645+0000 7fb71d52e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb71809e870 0x7fb71811e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.646+0000 7fb71cd2d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb71809f350 0x7fb71811eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40062/0 (socket says 172.21.15.156:40062) 2023-09-30T22:25:41.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.646+0000 7fb71d52e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb71809e870 0x7fb71811e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46090/0 (socket says 172.21.15.156:46090) 2023-09-30T22:25:41.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.646+0000 7fb71cd2d700 1 -- 172.21.15.156:0/3546413994 learned_addr learned my addr 172.21.15.156:0/3546413994 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:41.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.646+0000 7fb71dd2f700 1 --2- 172.21.15.156:0/3546413994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7181371c0 0x7fb71811f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.646+0000 7fb71d52e700 1 -- 172.21.15.156:0/3546413994 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb71809f350 msgr2=0x7fb71811eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.646+0000 7fb71d52e700 1 --2- 172.21.15.156:0/3546413994 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb71809f350 0x7fb71811eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.646+0000 7fb71d52e700 1 -- 172.21.15.156:0/3546413994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7181371c0 msgr2=0x7fb71811f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.646+0000 7fb71d52e700 1 --2- 172.21.15.156:0/3546413994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7181371c0 0x7fb71811f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.646+0000 7fb71d52e700 1 -- 172.21.15.156:0/3546413994 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb710009a70 con 0x7fb71809e870 2023-09-30T22:25:41.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.646+0000 7fb71d52e700 1 --2- 172.21.15.156:0/3546413994 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb71809e870 0x7fb71811e980 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fb71400c490 tx=0x7fb71400c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:41.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.646+0000 7fb70dffb700 1 -- 172.21.15.156:0/3546413994 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb714005d70 con 0x7fb71809e870 2023-09-30T22:25:41.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.646+0000 7fb70dffb700 1 -- 172.21.15.156:0/3546413994 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7140070d0 con 0x7fb71809e870 2023-09-30T22:25:41.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.646+0000 7fb70dffb700 1 -- 172.21.15.156:0/3546413994 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb714007440 con 0x7fb71809e870 2023-09-30T22:25:41.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.646+0000 7fb71f792700 1 -- 172.21.15.156:0/3546413994 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb718120ce0 con 0x7fb71809e870 2023-09-30T22:25:41.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.647+0000 7fb71f792700 1 -- 172.21.15.156:0/3546413994 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb718121b20 con 0x7fb71809e870 2023-09-30T22:25:41.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.647+0000 7fb71f792700 1 -- 172.21.15.156:0/3546413994 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71809fea0 con 0x7fb71809e870 2023-09-30T22:25:41.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.648+0000 7fb70dffb700 1 -- 172.21.15.156:0/3546413994 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb7140075a0 con 0x7fb71809e870 2023-09-30T22:25:41.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.648+0000 7fb70dffb700 1 -- 172.21.15.156:0/3546413994 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb71403ec40 con 0x7fb71809e870 2023-09-30T22:25:41.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.656+0000 7fb70dffb700 1 -- 172.21.15.156:0/3546413994 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb714018af0 con 0x7fb71809e870 2023-09-30T22:25:41.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.671+0000 7f2fbfa4b700 1 Processor -- start 2023-09-30T22:25:41.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.671+0000 7f2fbfa4b700 1 -- start start 2023-09-30T22:25:41.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.672+0000 7f2fbfa4b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2fb80a0a30 0x7f2fb80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.672+0000 7f2fbfa4b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2fb8130670 0x7f2fb81381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.672+0000 7f2fbfa4b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb80a1e70 con 0x7f2fb80a1340 2023-09-30T22:25:41.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.672+0000 7f2fbfa4b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb809a720 con 0x7f2fb80a0a30 2023-09-30T22:25:41.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.672+0000 7f2fbfa4b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb809b300 con 0x7f2fb8130670 2023-09-30T22:25:41.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.672+0000 7f2fbd7e7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2fb80a0a30 0x7f2fb80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.672+0000 7f2fbd7e7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2fb80a0a30 0x7f2fb80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:55890/0 (socket says 172.21.15.156:55890) 2023-09-30T22:25:41.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.672+0000 7f2fbd7e7700 1 -- 172.21.15.156:0/882841718 learned_addr learned my addr 172.21.15.156:0/882841718 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:41.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.672+0000 7f2fbdfe8700 1 --2- 172.21.15.156:0/882841718 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2fb8130670 0x7f2fb81381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.672+0000 7f2fbd7e7700 1 -- 172.21.15.156:0/882841718 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2fb8130670 msgr2=0x7f2fb81381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:41.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.672+0000 7f2fbd7e7700 1 --2- 172.21.15.156:0/882841718 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2fb8130670 0x7f2fb81381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.672+0000 7f2fbd7e7700 1 -- 172.21.15.156:0/882841718 >> v1:172.21.15.156:6789/0 conn(0x7f2fb80a1340 legacy=0x7f2fb812ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.672+0000 7f2faffff700 1 -- 172.21.15.156:0/882841718 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751736330 0 0) 0x7f2fb80a1e70 con 0x7f2fb80a1340 2023-09-30T22:25:41.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.672+0000 7f2fbd7e7700 1 -- 172.21.15.156:0/882841718 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb809abc0 con 0x7f2fb80a0a30 2023-09-30T22:25:41.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.672+0000 7f2fbdfe8700 1 --2- 172.21.15.156:0/882841718 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2fb8130670 0x7f2fb81381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:41.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.673+0000 7f2fbd7e7700 1 --2- 172.21.15.156:0/882841718 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2fb80a0a30 0x7f2fb80a0e00 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4006fd0 tx=0x7f2fb4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7451094f173532e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:41.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.673+0000 7f2faffff700 1 -- 172.21.15.156:0/882841718 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4005e30 con 0x7f2fb80a0a30 2023-09-30T22:25:41.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.673+0000 7f2faffff700 1 -- 172.21.15.156:0/882841718 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb4004030 con 0x7f2fb80a0a30 2023-09-30T22:25:41.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.673+0000 7f2faffff700 1 -- 172.21.15.156:0/882841718 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb40043e0 con 0x7f2fb80a0a30 2023-09-30T22:25:41.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.674+0000 7f2fbfa4b700 1 -- 172.21.15.156:0/882841718 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2fb80a0a30 msgr2=0x7f2fb80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.674+0000 7f2fbfa4b700 1 --2- 172.21.15.156:0/882841718 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2fb80a0a30 0x7f2fb80a0e00 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4006fd0 tx=0x7f2fb4009bd0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.674+0000 7f2fbfa4b700 1 -- 172.21.15.156:0/882841718 shutdown_connections 2023-09-30T22:25:41.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.674+0000 7f2fbfa4b700 1 --2- 172.21.15.156:0/882841718 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2fb8130670 0x7f2fb81381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.674+0000 7f2fbfa4b700 1 --2- 172.21.15.156:0/882841718 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2fb80a0a30 0x7f2fb80a0e00 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.674+0000 7f2fbfa4b700 1 -- 172.21.15.156:0/882841718 >> 172.21.15.156:0/882841718 conn(0x7f2fb80a2980 msgr2=0x7f2fb80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:41.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.674+0000 7f2fbfa4b700 1 -- 172.21.15.156:0/882841718 shutdown_connections 2023-09-30T22:25:41.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.674+0000 7f2fbfa4b700 1 -- 172.21.15.156:0/882841718 wait complete. 2023-09-30T22:25:41.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.675+0000 7f2fbfa4b700 1 Processor -- start 2023-09-30T22:25:41.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.675+0000 7f2fbfa4b700 1 -- start start 2023-09-30T22:25:41.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.675+0000 7f2fbfa4b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2fb80a0a30 0x7f2fb813e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.675+0000 7f2fbfa4b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2fb80a1340 0x7f2fb813ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.675+0000 7f2fbfa4b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2fb8130670 0x7f2fb813f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.675+0000 7f2fbfa4b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb8119d80 con 0x7f2fb80a0a30 2023-09-30T22:25:41.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.675+0000 7f2fbfa4b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb8119320 con 0x7f2fb80a1340 2023-09-30T22:25:41.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.675+0000 7f2fbfa4b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb8140350 con 0x7f2fb8130670 2023-09-30T22:25:41.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.675+0000 7f2fbdfe8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2fb8130670 0x7f2fb813f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.675+0000 7f2fbd7e7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2fb80a0a30 0x7f2fb813e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.675+0000 7f2fbdfe8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2fb8130670 0x7f2fb813f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46092/0 (socket says 172.21.15.156:46092) 2023-09-30T22:25:41.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.675+0000 7f2fbdfe8700 1 -- 172.21.15.156:0/2572969223 learned_addr learned my addr 172.21.15.156:0/2572969223 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:41.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.675+0000 7f2fbcfe6700 1 --2- 172.21.15.156:0/2572969223 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2fb80a1340 0x7f2fb813ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.676+0000 7f2fbdfe8700 1 -- 172.21.15.156:0/2572969223 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2fb80a1340 msgr2=0x7f2fb813ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.676+0000 7f2fbdfe8700 1 --2- 172.21.15.156:0/2572969223 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2fb80a1340 0x7f2fb813ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.676+0000 7f2fbdfe8700 1 -- 172.21.15.156:0/2572969223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2fb80a0a30 msgr2=0x7f2fb813e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.676+0000 7f2fbdfe8700 1 --2- 172.21.15.156:0/2572969223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2fb80a0a30 0x7f2fb813e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.676+0000 7f2fbdfe8700 1 -- 172.21.15.156:0/2572969223 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb4009500 con 0x7f2fb8130670 2023-09-30T22:25:41.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.676+0000 7f2fbdfe8700 1 --2- 172.21.15.156:0/2572969223 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2fb8130670 0x7f2fb813f200 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0007f20 tx=0x7f2fb000d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:41.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.676+0000 7f2fadffb700 1 -- 172.21.15.156:0/2572969223 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb000dd80 con 0x7f2fb8130670 2023-09-30T22:25:41.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.676+0000 7f2fadffb700 1 -- 172.21.15.156:0/2572969223 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb000f040 con 0x7f2fb8130670 2023-09-30T22:25:41.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.676+0000 7f2fbfa4b700 1 -- 172.21.15.156:0/2572969223 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb809f920 con 0x7f2fb8130670 2023-09-30T22:25:41.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.676+0000 7f2fadffb700 1 -- 172.21.15.156:0/2572969223 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb000dee0 con 0x7f2fb8130670 2023-09-30T22:25:41.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.676+0000 7f2fbfa4b700 1 -- 172.21.15.156:0/2572969223 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb811a0f0 con 0x7f2fb8130670 2023-09-30T22:25:41.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.678+0000 7f2fbfa4b700 1 -- 172.21.15.156:0/2572969223 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb804f2a0 con 0x7f2fb8130670 2023-09-30T22:25:41.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.678+0000 7f2fadffb700 1 -- 172.21.15.156:0/2572969223 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2fb0003c40 con 0x7f2fb8130670 2023-09-30T22:25:41.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.678+0000 7f2fadffb700 1 -- 172.21.15.156:0/2572969223 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2fb003f7f0 con 0x7f2fb8130670 2023-09-30T22:25:41.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.683+0000 7f2fadffb700 1 -- 172.21.15.156:0/2572969223 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2fb00143a0 con 0x7f2fb8130670 2023-09-30T22:25:41.725 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.725+0000 7fe5cfbba700 1 -- 172.21.15.156:0/2131706681 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe5c8122de0 con 0x7fe5c809f180 2023-09-30T22:25:41.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.725+0000 7fe5be7fc700 1 -- 172.21.15.156:0/2131706681 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe5b80253e0 con 0x7fe5c809f180 2023-09-30T22:25:41.726 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:41.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.728+0000 7fe5cfbba700 1 -- 172.21.15.156:0/2131706681 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5c809f180 msgr2=0x7fe5c8120550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.728+0000 7fe5cfbba700 1 --2- 172.21.15.156:0/2131706681 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5c809f180 0x7fe5c8120550 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009fd0 tx=0x7fe5b8004750 comp rx=0 tx=0).stop 2023-09-30T22:25:41.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.729+0000 7fe5cfbba700 1 -- 172.21.15.156:0/2131706681 shutdown_connections 2023-09-30T22:25:41.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.729+0000 7fe5cfbba700 1 --2- 172.21.15.156:0/2131706681 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe5c8131d70 0x7fe5c8120a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.729+0000 7fe5cfbba700 1 --2- 172.21.15.156:0/2131706681 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5c809e870 0x7fe5c8120010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.729+0000 7fe5cfbba700 1 --2- 172.21.15.156:0/2131706681 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5c809f180 0x7fe5c8120550 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.729+0000 7fe5cfbba700 1 -- 172.21.15.156:0/2131706681 >> 172.21.15.156:0/2131706681 conn(0x7fe5c80a4430 msgr2=0x7fe5c8072130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:41.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.729+0000 7fe5cfbba700 1 -- 172.21.15.156:0/2131706681 shutdown_connections 2023-09-30T22:25:41.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.729+0000 7fe5cfbba700 1 -- 172.21.15.156:0/2131706681 wait complete. 2023-09-30T22:25:41.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:41.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.811+0000 7fbb5865a700 1 -- 172.21.15.156:0/4147552863 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbb500729d0 con 0x7fbb5009ad40 2023-09-30T22:25:41.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.811+0000 7fbb46ffd700 1 -- 172.21.15.156:0/4147552863 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbb4c017020 con 0x7fbb5009ad40 2023-09-30T22:25:41.812 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:41.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.814+0000 7fbb5865a700 1 -- 172.21.15.156:0/4147552863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb5009ad40 msgr2=0x7fbb501c8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.814+0000 7fbb5865a700 1 --2- 172.21.15.156:0/4147552863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb5009ad40 0x7fbb501c8270 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c00e870 tx=0x7fbb4c00eb80 comp rx=0 tx=0).stop 2023-09-30T22:25:41.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.815+0000 7fbb5865a700 1 -- 172.21.15.156:0/4147552863 shutdown_connections 2023-09-30T22:25:41.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.815+0000 7fbb5865a700 1 --2- 172.21.15.156:0/4147552863 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbb50133f70 0x7fbb501c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.815+0000 7fbb5865a700 1 --2- 172.21.15.156:0/4147552863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb5009ad40 0x7fbb501c8270 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.815+0000 7fbb5865a700 1 --2- 172.21.15.156:0/4147552863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb500a0a70 0x7fbb501c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.815+0000 7fbb5865a700 1 -- 172.21.15.156:0/4147552863 >> 172.21.15.156:0/4147552863 conn(0x7fbb50099c40 msgr2=0x7fbb500a4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:41.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.815+0000 7fbb5865a700 1 -- 172.21.15.156:0/4147552863 shutdown_connections 2023-09-30T22:25:41.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.815+0000 7fbb5865a700 1 -- 172.21.15.156:0/4147552863 wait complete. 2023-09-30T22:25:41.827 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:41.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.852+0000 7fb71f792700 1 -- 172.21.15.156:0/3546413994 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb71804f2a0 con 0x7fb71809e870 2023-09-30T22:25:41.852 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.852+0000 7fb70dffb700 1 -- 172.21.15.156:0/3546413994 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb714017070 con 0x7fb71809e870 2023-09-30T22:25:41.853 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:41.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.854+0000 7fb71f792700 1 -- 172.21.15.156:0/3546413994 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb71809e870 msgr2=0x7fb71811e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.854+0000 7fb71f792700 1 --2- 172.21.15.156:0/3546413994 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb71809e870 0x7fb71811e980 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fb71400c490 tx=0x7fb71400c7a0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.854+0000 7fb71f792700 1 -- 172.21.15.156:0/3546413994 shutdown_connections 2023-09-30T22:25:41.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.854+0000 7fb71f792700 1 --2- 172.21.15.156:0/3546413994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7181371c0 0x7fb71811f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.854+0000 7fb71f792700 1 --2- 172.21.15.156:0/3546413994 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb71809e870 0x7fb71811e980 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.854+0000 7fb71f792700 1 --2- 172.21.15.156:0/3546413994 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb71809f350 0x7fb71811eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.855 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.854+0000 7fb71f792700 1 -- 172.21.15.156:0/3546413994 >> 172.21.15.156:0/3546413994 conn(0x7fb7180a4430 msgr2=0x7fb718071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:41.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.854+0000 7fb71f792700 1 -- 172.21.15.156:0/3546413994 shutdown_connections 2023-09-30T22:25:41.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.854+0000 7fb71f792700 1 -- 172.21.15.156:0/3546413994 wait complete. 2023-09-30T22:25:41.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:41.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.879+0000 7f2fbfa4b700 1 -- 172.21.15.156:0/2572969223 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2fb806bce0 con 0x7f2fb8130670 2023-09-30T22:25:41.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.880+0000 7f2fadffb700 1 -- 172.21.15.156:0/2572969223 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2fb001a020 con 0x7f2fb8130670 2023-09-30T22:25:41.880 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:41.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.882+0000 7f2fbfa4b700 1 -- 172.21.15.156:0/2572969223 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2fb8130670 msgr2=0x7f2fb813f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.882+0000 7f2fbfa4b700 1 --2- 172.21.15.156:0/2572969223 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2fb8130670 0x7f2fb813f200 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0007f20 tx=0x7f2fb000d3b0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.882+0000 7f2fbfa4b700 1 -- 172.21.15.156:0/2572969223 shutdown_connections 2023-09-30T22:25:41.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.882+0000 7f2fbfa4b700 1 --2- 172.21.15.156:0/2572969223 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f2fb8130670 0x7f2fb813f200 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.882+0000 7f2fbfa4b700 1 --2- 172.21.15.156:0/2572969223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2fb80a0a30 0x7f2fb813e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.882+0000 7f2fbfa4b700 1 --2- 172.21.15.156:0/2572969223 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2fb80a1340 0x7f2fb813ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.882+0000 7f2fbfa4b700 1 -- 172.21.15.156:0/2572969223 >> 172.21.15.156:0/2572969223 conn(0x7f2fb80a2980 msgr2=0x7f2fb809deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:41.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.882+0000 7f2fbfa4b700 1 -- 172.21.15.156:0/2572969223 shutdown_connections 2023-09-30T22:25:41.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:41.882+0000 7f2fbfa4b700 1 -- 172.21.15.156:0/2572969223 wait complete. 2023-09-30T22:25:41.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:42.743 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:42.829 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:42.868 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:42.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.871+0000 7f7dddb19700 1 Processor -- start 2023-09-30T22:25:42.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.871+0000 7f7dddb19700 1 -- start start 2023-09-30T22:25:42.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.872+0000 7f7dddb19700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7dd809e870 0x7f7dd809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.872+0000 7f7dddb19700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7dd8131f40 0x7f7dd8139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.872+0000 7f7dddb19700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd809c970 con 0x7f7dd809f180 2023-09-30T22:25:42.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.872+0000 7f7dddb19700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd80a0920 con 0x7f7dd8131f40 2023-09-30T22:25:42.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.872+0000 7f7dddb19700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd809f9c0 con 0x7f7dd809e870 2023-09-30T22:25:42.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.872+0000 7f7dd77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7dd809e870 0x7f7dd809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.872+0000 7f7dd7fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7dd8131f40 0x7f7dd8139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.872+0000 7f7dd6ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f7dd809f180 0x7f7dd8131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:43826/0 (socket says 172.21.15.156:43826) 2023-09-30T22:25:42.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.872+0000 7f7dd6ffd700 1 -- 172.21.15.156:0/225630294 learned_addr learned my addr 172.21.15.156:0/225630294 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:42.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.872+0000 7f7dd7fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7dd8131f40 0x7f7dd8139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:55908/0 (socket says 172.21.15.156:55908) 2023-09-30T22:25:42.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.872+0000 7f7dd77fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7dd809e870 0x7f7dd809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46104/0 (socket says 172.21.15.156:46104) 2023-09-30T22:25:42.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.872+0000 7f7dd7fff700 1 -- 172.21.15.156:0/225630294 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7dd809e870 msgr2=0x7f7dd809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:42.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.872+0000 7f7dd7fff700 1 --2- 172.21.15.156:0/225630294 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7dd809e870 0x7f7dd809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.872+0000 7f7dd7fff700 1 -- 172.21.15.156:0/225630294 >> v1:172.21.15.156:6789/0 conn(0x7f7dd809f180 legacy=0x7f7dd8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.872+0000 7f7dd7fff700 1 -- 172.21.15.156:0/225630294 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd809bab0 con 0x7f7dd8131f40 2023-09-30T22:25:42.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.872+0000 7f7dd67fc700 1 -- 172.21.15.156:0/225630294 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 15387795 0 0) 0x7f7dd809c970 con 0x7f7dd809f180 2023-09-30T22:25:42.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.872+0000 7f7dd77fe700 1 --2- 172.21.15.156:0/225630294 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7dd809e870 0x7f7dd809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:42.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.873+0000 7f7dd7fff700 1 --2- 172.21.15.156:0/225630294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dd8131f40 0x7f7dd8139ca0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0009840 tx=0x7f7dd0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c13f575b48863b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:42.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.873+0000 7f7dd67fc700 1 -- 172.21.15.156:0/225630294 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0011830 con 0x7f7dd8131f40 2023-09-30T22:25:42.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.873+0000 7f7dd67fc700 1 -- 172.21.15.156:0/225630294 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd0011990 con 0x7f7dd8131f40 2023-09-30T22:25:42.877 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.873+0000 7f7dd67fc700 1 -- 172.21.15.156:0/225630294 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0011d20 con 0x7f7dd8131f40 2023-09-30T22:25:42.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.873+0000 7f7dddb19700 1 -- 172.21.15.156:0/225630294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dd8131f40 msgr2=0x7f7dd8139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.873+0000 7f7dddb19700 1 --2- 172.21.15.156:0/225630294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dd8131f40 0x7f7dd8139ca0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0009840 tx=0x7f7dd0009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:42.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.874+0000 7f7dddb19700 1 -- 172.21.15.156:0/225630294 shutdown_connections 2023-09-30T22:25:42.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.874+0000 7f7dddb19700 1 --2- 172.21.15.156:0/225630294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dd8131f40 0x7f7dd8139ca0 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.874+0000 7f7dddb19700 1 --2- 172.21.15.156:0/225630294 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7dd809e870 0x7f7dd809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.874+0000 7f7dddb19700 1 -- 172.21.15.156:0/225630294 >> 172.21.15.156:0/225630294 conn(0x7f7dd80a4430 msgr2=0x7f7dd80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:42.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.874+0000 7f7dddb19700 1 -- 172.21.15.156:0/225630294 shutdown_connections 2023-09-30T22:25:42.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.874+0000 7f7dddb19700 1 -- 172.21.15.156:0/225630294 wait complete. 2023-09-30T22:25:42.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.875+0000 7f7dddb19700 1 Processor -- start 2023-09-30T22:25:42.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.875+0000 7f7dddb19700 1 -- start start 2023-09-30T22:25:42.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.875+0000 7f7dddb19700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dd809e870 0x7f7dd806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.875+0000 7f7dddb19700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7dd809f180 0x7f7dd806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.875+0000 7f7dddb19700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7dd8131f40 0x7f7dd806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.875+0000 7f7dddb19700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd8125530 con 0x7f7dd809e870 2023-09-30T22:25:42.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.875+0000 7f7dddb19700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd8131660 con 0x7f7dd8131f40 2023-09-30T22:25:42.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.875+0000 7f7dddb19700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd806cca0 con 0x7f7dd809f180 2023-09-30T22:25:42.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.875+0000 7f7dd6ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7dd809f180 0x7f7dd806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.875+0000 7f7dd77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dd809e870 0x7f7dd806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.875+0000 7f7dd77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dd809e870 0x7f7dd806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:55922/0 (socket says 172.21.15.156:55922) 2023-09-30T22:25:42.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.875+0000 7f7dd6ffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7dd809f180 0x7f7dd806bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46106/0 (socket says 172.21.15.156:46106) 2023-09-30T22:25:42.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.875+0000 7f7dd77fe700 1 -- 172.21.15.156:0/1038564823 learned_addr learned my addr 172.21.15.156:0/1038564823 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:42.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.875+0000 7f7dd7fff700 1 --2- 172.21.15.156:0/1038564823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7dd8131f40 0x7f7dd806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.876+0000 7f7dd6ffd700 1 -- 172.21.15.156:0/1038564823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7dd8131f40 msgr2=0x7f7dd806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.876+0000 7f7dd6ffd700 1 --2- 172.21.15.156:0/1038564823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7dd8131f40 0x7f7dd806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.876+0000 7f7dd6ffd700 1 -- 172.21.15.156:0/1038564823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dd809e870 msgr2=0x7f7dd806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.876+0000 7f7dd6ffd700 1 --2- 172.21.15.156:0/1038564823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dd809e870 0x7f7dd806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.876+0000 7f7dd6ffd700 1 -- 172.21.15.156:0/1038564823 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc8009a70 con 0x7f7dd809f180 2023-09-30T22:25:42.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.876+0000 7f7dd77fe700 1 --2- 172.21.15.156:0/1038564823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dd809e870 0x7f7dd806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:42.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.876+0000 7f7dd6ffd700 1 --2- 172.21.15.156:0/1038564823 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7dd809f180 0x7f7dd806bdf0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f7dc000c470 tx=0x7f7dc000c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:42.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.876+0000 7f7dcffff700 1 -- 172.21.15.156:0/1038564823 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0004c80 con 0x7f7dd809f180 2023-09-30T22:25:42.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.876+0000 7f7dcffff700 1 -- 172.21.15.156:0/1038564823 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc0004de0 con 0x7f7dd809f180 2023-09-30T22:25:42.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.876+0000 7f7dddb19700 1 -- 172.21.15.156:0/1038564823 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd00094a0 con 0x7f7dd809f180 2023-09-30T22:25:42.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.876+0000 7f7dcffff700 1 -- 172.21.15.156:0/1038564823 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0007310 con 0x7f7dd809f180 2023-09-30T22:25:42.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.876+0000 7f7dddb19700 1 -- 172.21.15.156:0/1038564823 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd8125790 con 0x7f7dd809f180 2023-09-30T22:25:42.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.877+0000 7f7dcffff700 1 -- 172.21.15.156:0/1038564823 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7dc0007470 con 0x7f7dd809f180 2023-09-30T22:25:42.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.877+0000 7f7dcffff700 1 -- 172.21.15.156:0/1038564823 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7dc003f220 con 0x7f7dd809f180 2023-09-30T22:25:42.881 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.877+0000 7f7dddb19700 1 -- 172.21.15.156:0/1038564823 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd804f2a0 con 0x7f7dd809f180 2023-09-30T22:25:42.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.882+0000 7f7dcffff700 1 -- 172.21.15.156:0/1038564823 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7dc000ce40 con 0x7f7dd809f180 2023-09-30T22:25:42.895 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:42.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.961+0000 7f5b18891700 1 Processor -- start 2023-09-30T22:25:42.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.961+0000 7f5b18891700 1 -- start start 2023-09-30T22:25:42.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.962+0000 7f5b18891700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b14136960 0x7f5b14138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.962+0000 7f5b18891700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b14139280 0x7f5b1413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.962+0000 7f5b18891700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b1406b2d0 con 0x7f5b14133ad0 2023-09-30T22:25:42.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.962+0000 7f5b18891700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b141345b0 con 0x7f5b14139280 2023-09-30T22:25:42.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.962+0000 7f5b18891700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b14133610 con 0x7f5b14136960 2023-09-30T22:25:42.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.962+0000 7f5b11d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b14136960 0x7f5b14138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.962+0000 7f5b11d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b14136960 0x7f5b14138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46114/0 (socket says 172.21.15.156:46114) 2023-09-30T22:25:42.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.962+0000 7f5b11d9b700 1 -- 172.21.15.156:0/1878518451 learned_addr learned my addr 172.21.15.156:0/1878518451 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:42.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.963+0000 7f5b12d9d700 1 --2- 172.21.15.156:0/1878518451 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b14139280 0x7f5b1413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.963+0000 7f5b1159a700 1 -- 172.21.15.156:0/1878518451 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4019456939 0 0) 0x7f5b1406b2d0 con 0x7f5b14133ad0 2023-09-30T22:25:42.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.963+0000 7f5b1159a700 1 -- 172.21.15.156:0/1878518451 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5afc0035b0 con 0x7f5b14133ad0 2023-09-30T22:25:42.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.963+0000 7f5b11d9b700 1 -- 172.21.15.156:0/1878518451 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b14139280 msgr2=0x7f5b1413b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:42.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.963+0000 7f5b11d9b700 1 --2- 172.21.15.156:0/1878518451 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b14139280 0x7f5b1413b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.963+0000 7f5b11d9b700 1 -- 172.21.15.156:0/1878518451 >> v1:172.21.15.156:6789/0 conn(0x7f5b14133ad0 legacy=0x7f5b14133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.963+0000 7f5b11d9b700 1 -- 172.21.15.156:0/1878518451 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1409a500 con 0x7f5b14136960 2023-09-30T22:25:42.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.963+0000 7f5b12d9d700 1 --2- 172.21.15.156:0/1878518451 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b14139280 0x7f5b1413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:42.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.963+0000 7f5b11d9b700 1 --2- 172.21.15.156:0/1878518451 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b14136960 0x7f5b14138d40 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f5b08009920 tx=0x7f5b08009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b99a4a1b9a8eb34 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:42.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.963+0000 7f5b1159a700 1 -- 172.21.15.156:0/1878518451 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b08011830 con 0x7f5b14136960 2023-09-30T22:25:42.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.963+0000 7f5b1159a700 1 -- 172.21.15.156:0/1878518451 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b08011990 con 0x7f5b14136960 2023-09-30T22:25:42.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.963+0000 7f5b1159a700 1 -- 172.21.15.156:0/1878518451 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b08011d00 con 0x7f5b14136960 2023-09-30T22:25:42.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.964+0000 7f5b18891700 1 -- 172.21.15.156:0/1878518451 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b14136960 msgr2=0x7f5b14138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.964+0000 7f5b18891700 1 --2- 172.21.15.156:0/1878518451 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b14136960 0x7f5b14138d40 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f5b08009920 tx=0x7f5b08009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:42.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.964+0000 7f5b18891700 1 -- 172.21.15.156:0/1878518451 shutdown_connections 2023-09-30T22:25:42.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.964+0000 7f5b18891700 1 --2- 172.21.15.156:0/1878518451 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b14139280 0x7f5b1413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.964+0000 7f5b18891700 1 --2- 172.21.15.156:0/1878518451 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b14136960 0x7f5b14138d40 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.964+0000 7f5b18891700 1 -- 172.21.15.156:0/1878518451 >> 172.21.15.156:0/1878518451 conn(0x7f5b14099c40 msgr2=0x7f5b140a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:42.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.964+0000 7f5b18891700 1 -- 172.21.15.156:0/1878518451 shutdown_connections 2023-09-30T22:25:42.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.964+0000 7f5b18891700 1 -- 172.21.15.156:0/1878518451 wait complete. 2023-09-30T22:25:42.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.965+0000 7f5b18891700 1 Processor -- start 2023-09-30T22:25:42.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.966+0000 7f5b18891700 1 -- start start 2023-09-30T22:25:42.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.966+0000 7f5b18891700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b14133ad0 0x7f5b14070e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.966+0000 7f5b18891700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b14136960 0x7f5b140713a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.966+0000 7f5b18891700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b14139280 0x7f5b140718e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.966+0000 7f5b18891700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b14072570 con 0x7f5b14133ad0 2023-09-30T22:25:42.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.966+0000 7f5b18891700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1406fce0 con 0x7f5b14136960 2023-09-30T22:25:42.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.966+0000 7f5b18891700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1412dd00 con 0x7f5b14139280 2023-09-30T22:25:42.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.966+0000 7f5b1259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b14133ad0 0x7f5b14070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.966+0000 7f5b1259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b14133ad0 0x7f5b14070e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:55932/0 (socket says 172.21.15.156:55932) 2023-09-30T22:25:42.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.966+0000 7f5b1259c700 1 -- 172.21.15.156:0/2374067221 learned_addr learned my addr 172.21.15.156:0/2374067221 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:42.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.966+0000 7f5b12d9d700 1 --2- 172.21.15.156:0/2374067221 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b14139280 0x7f5b140718e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.966+0000 7f5b11d9b700 1 --2- 172.21.15.156:0/2374067221 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b14136960 0x7f5b140713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.967+0000 7f5b1259c700 1 -- 172.21.15.156:0/2374067221 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b14139280 msgr2=0x7f5b140718e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.967+0000 7f5b1259c700 1 --2- 172.21.15.156:0/2374067221 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b14139280 0x7f5b140718e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.967+0000 7f5b1259c700 1 -- 172.21.15.156:0/2374067221 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b14136960 msgr2=0x7f5b140713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.967+0000 7f5b1259c700 1 --2- 172.21.15.156:0/2374067221 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b14136960 0x7f5b140713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.967+0000 7f5b1259c700 1 -- 172.21.15.156:0/2374067221 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b08009550 con 0x7f5b14133ad0 2023-09-30T22:25:42.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.967+0000 7f5b1259c700 1 --2- 172.21.15.156:0/2374067221 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b14133ad0 0x7f5b14070e60 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f5b0400c500 tx=0x7f5b0400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:42.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.967+0000 7f5b02ffd700 1 -- 172.21.15.156:0/2374067221 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b040052d0 con 0x7f5b14133ad0 2023-09-30T22:25:42.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.967+0000 7f5b02ffd700 1 -- 172.21.15.156:0/2374067221 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b04005450 con 0x7f5b14133ad0 2023-09-30T22:25:42.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.967+0000 7f5b02ffd700 1 -- 172.21.15.156:0/2374067221 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b040038c0 con 0x7f5b14133ad0 2023-09-30T22:25:42.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.967+0000 7f5b18891700 1 -- 172.21.15.156:0/2374067221 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b14070a10 con 0x7f5b14133ad0 2023-09-30T22:25:42.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.967+0000 7f5b18891700 1 -- 172.21.15.156:0/2374067221 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b14130a20 con 0x7f5b14133ad0 2023-09-30T22:25:42.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.968+0000 7f5b18891700 1 -- 172.21.15.156:0/2374067221 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b14130c10 con 0x7f5b14133ad0 2023-09-30T22:25:42.971 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.968+0000 7f5b02ffd700 1 -- 172.21.15.156:0/2374067221 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5b04003a20 con 0x7f5b14133ad0 2023-09-30T22:25:42.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.969+0000 7f5b02ffd700 1 -- 172.21.15.156:0/2374067221 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5b04040b10 con 0x7f5b14133ad0 2023-09-30T22:25:42.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:42.973+0000 7f5b02ffd700 1 -- 172.21.15.156:0/2374067221 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5b04044060 con 0x7f5b14133ad0 2023-09-30T22:25:43.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.001+0000 7fb002d6a700 1 Processor -- start 2023-09-30T22:25:43.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.001+0000 7fb002d6a700 1 -- start start 2023-09-30T22:25:43.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.001+0000 7fb002d6a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faffc099e20 0x7faffc09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.001+0000 7fb002d6a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faffc09a730 0x7faffc130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.001+0000 7fb002d6a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7faffc130890 0x7faffc130d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.001+0000 7fb002d6a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faffc09bf50 con 0x7faffc130890 2023-09-30T22:25:43.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.001+0000 7fb002d6a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faffc099a60 con 0x7faffc09a730 2023-09-30T22:25:43.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.001+0000 7fb002d6a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faffc09b230 con 0x7faffc099e20 2023-09-30T22:25:43.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.002+0000 7faffbfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faffc09a730 0x7faffc130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.002+0000 7faffbfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faffc09a730 0x7faffc130350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40114/0 (socket says 172.21.15.156:40114) 2023-09-30T22:25:43.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.002+0000 7faffbfff700 1 -- 172.21.15.156:0/2347507395 learned_addr learned my addr 172.21.15.156:0/2347507395 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:43.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.002+0000 7fb000b06700 1 --2- 172.21.15.156:0/2347507395 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faffc099e20 0x7faffc09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.002+0000 7fb001307700 1 --2- 172.21.15.156:0/2347507395 >> v2:172.21.15.156:3300/0 conn(0x7faffc130890 0x7faffc130d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.002+0000 7fb000b06700 1 -- 172.21.15.156:0/2347507395 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faffc09a730 msgr2=0x7faffc130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:43.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.002+0000 7fb000b06700 1 --2- 172.21.15.156:0/2347507395 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faffc09a730 0x7faffc130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.002+0000 7fb000b06700 1 -- 172.21.15.156:0/2347507395 >> v2:172.21.15.156:3300/0 conn(0x7faffc130890 msgr2=0x7faffc130d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:43.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.002+0000 7fb000b06700 1 --2- 172.21.15.156:0/2347507395 >> v2:172.21.15.156:3300/0 conn(0x7faffc130890 0x7faffc130d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.002+0000 7fb000b06700 1 -- 172.21.15.156:0/2347507395 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faffc09bb90 con 0x7faffc099e20 2023-09-30T22:25:43.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.002+0000 7faffbfff700 1 --2- 172.21.15.156:0/2347507395 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faffc09a730 0x7faffc130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:43.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.002+0000 7fb000b06700 1 --2- 172.21.15.156:0/2347507395 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faffc099e20 0x7faffc09a1f0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7faff0009820 tx=0x7faff0009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d783377c71562d0a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:43.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.002+0000 7faffb7fe700 1 -- 172.21.15.156:0/2347507395 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff0005e30 con 0x7faffc099e20 2023-09-30T22:25:43.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.003+0000 7faffb7fe700 1 -- 172.21.15.156:0/2347507395 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff0010680 con 0x7faffc099e20 2023-09-30T22:25:43.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.003+0000 7faffb7fe700 1 -- 172.21.15.156:0/2347507395 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff0010a10 con 0x7faffc099e20 2023-09-30T22:25:43.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.003+0000 7fb002d6a700 1 -- 172.21.15.156:0/2347507395 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faffc099e20 msgr2=0x7faffc09a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:43.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.003+0000 7fb002d6a700 1 --2- 172.21.15.156:0/2347507395 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faffc099e20 0x7faffc09a1f0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7faff0009820 tx=0x7faff0009b30 comp rx=0 tx=0).stop 2023-09-30T22:25:43.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.003+0000 7fb002d6a700 1 -- 172.21.15.156:0/2347507395 shutdown_connections 2023-09-30T22:25:43.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.003+0000 7fb002d6a700 1 --2- 172.21.15.156:0/2347507395 >> v2:172.21.15.156:3300/0 conn(0x7faffc130890 0x7faffc130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.003+0000 7fb002d6a700 1 --2- 172.21.15.156:0/2347507395 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faffc099e20 0x7faffc09a1f0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.003+0000 7fb002d6a700 1 --2- 172.21.15.156:0/2347507395 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faffc09a730 0x7faffc130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.004+0000 7fb002d6a700 1 -- 172.21.15.156:0/2347507395 >> 172.21.15.156:0/2347507395 conn(0x7faffc0a2980 msgr2=0x7faffc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:43.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.004+0000 7fb002d6a700 1 -- 172.21.15.156:0/2347507395 shutdown_connections 2023-09-30T22:25:43.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.004+0000 7fb002d6a700 1 -- 172.21.15.156:0/2347507395 wait complete. 2023-09-30T22:25:43.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.005+0000 7fb002d6a700 1 Processor -- start 2023-09-30T22:25:43.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.005+0000 7fb002d6a700 1 -- start start 2023-09-30T22:25:43.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.006+0000 7fb002d6a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faffc099e20 0x7faffc118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.006+0000 7fb002d6a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faffc09a730 0x7faffc119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.006+0000 7fb002d6a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faffc130890 0x7faffc119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.006+0000 7fb002d6a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faffc11cb10 con 0x7faffc099e20 2023-09-30T22:25:43.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.006+0000 7fb002d6a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faffc11c150 con 0x7faffc130890 2023-09-30T22:25:43.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.006+0000 7fb002d6a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faffc09b470 con 0x7faffc09a730 2023-09-30T22:25:43.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.006+0000 7fb000b06700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faffc099e20 0x7faffc118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.006+0000 7faffbfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faffc09a730 0x7faffc119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.006+0000 7fb000b06700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faffc099e20 0x7faffc118df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:55948/0 (socket says 172.21.15.156:55948) 2023-09-30T22:25:43.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.006+0000 7fb000b06700 1 -- 172.21.15.156:0/2764632152 learned_addr learned my addr 172.21.15.156:0/2764632152 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:43.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.006+0000 7fb001307700 1 --2- 172.21.15.156:0/2764632152 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faffc130890 0x7faffc119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.006+0000 7faffbfff700 1 -- 172.21.15.156:0/2764632152 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faffc130890 msgr2=0x7faffc119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:43.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.006+0000 7faffbfff700 1 --2- 172.21.15.156:0/2764632152 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faffc130890 0x7faffc119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.006+0000 7faffbfff700 1 -- 172.21.15.156:0/2764632152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faffc099e20 msgr2=0x7faffc118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:43.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.006+0000 7faffbfff700 1 --2- 172.21.15.156:0/2764632152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faffc099e20 0x7faffc118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.006+0000 7faffbfff700 1 -- 172.21.15.156:0/2764632152 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe800b7f0 con 0x7faffc09a730 2023-09-30T22:25:43.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.007+0000 7fb000b06700 1 --2- 172.21.15.156:0/2764632152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faffc099e20 0x7faffc118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:43.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.007+0000 7faffbfff700 1 --2- 172.21.15.156:0/2764632152 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faffc09a730 0x7faffc119330 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fafe800ed40 tx=0x7fafe800d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:43.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.007+0000 7faff97fa700 1 -- 172.21.15.156:0/2764632152 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe800dd90 con 0x7faffc09a730 2023-09-30T22:25:43.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.007+0000 7faff97fa700 1 -- 172.21.15.156:0/2764632152 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe8004030 con 0x7faffc09a730 2023-09-30T22:25:43.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.007+0000 7faff97fa700 1 -- 172.21.15.156:0/2764632152 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe80043a0 con 0x7faffc09a730 2023-09-30T22:25:43.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.007+0000 7fb002d6a700 1 -- 172.21.15.156:0/2764632152 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff0009430 con 0x7faffc09a730 2023-09-30T22:25:43.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.007+0000 7fb002d6a700 1 -- 172.21.15.156:0/2764632152 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faffc0a1210 con 0x7faffc09a730 2023-09-30T22:25:43.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.008+0000 7faff97fa700 1 -- 172.21.15.156:0/2764632152 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fafe80036a0 con 0x7faffc09a730 2023-09-30T22:25:43.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.008+0000 7faff97fa700 1 -- 172.21.15.156:0/2764632152 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fafe803fd10 con 0x7faffc09a730 2023-09-30T22:25:43.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.008+0000 7fb002d6a700 1 -- 172.21.15.156:0/2764632152 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faffc04f2a0 con 0x7faffc09a730 2023-09-30T22:25:43.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.013+0000 7faff97fa700 1 -- 172.21.15.156:0/2764632152 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fafe8014020 con 0x7faffc09a730 2023-09-30T22:25:43.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.026+0000 7f6df2832700 1 Processor -- start 2023-09-30T22:25:43.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.026+0000 7f6df2832700 1 -- start start 2023-09-30T22:25:43.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.026+0000 7f6df2832700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6dec09a130 0x7f6dec09e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.026+0000 7f6df2832700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6dec09f1e0 0x7f6dec13fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.026+0000 7f6df2832700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dec072b30 con 0x7f6dec09edb0 2023-09-30T22:25:43.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.027+0000 7f6df2832700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dec09a500 con 0x7f6dec09f1e0 2023-09-30T22:25:43.028 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.027+0000 7f6df2832700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec09ada0 con 0x7f6dec09a130 2023-09-30T22:25:43.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.027+0000 7f6debfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6dec09a130 0x7f6dec09e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.027+0000 7f6debfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6dec09a130 0x7f6dec09e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46134/0 (socket says 172.21.15.156:46134) 2023-09-30T22:25:43.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.027+0000 7f6debfff700 1 -- 172.21.15.156:0/1661027074 learned_addr learned my addr 172.21.15.156:0/1661027074 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:43.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.027+0000 7f6df0dcf700 1 --2- 172.21.15.156:0/1661027074 >> v2:172.21.15.156:3300/0 conn(0x7f6dec09f1e0 0x7f6dec13fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.027+0000 7f6debfff700 1 -- 172.21.15.156:0/1661027074 >> v2:172.21.15.156:3300/0 conn(0x7f6dec09f1e0 msgr2=0x7f6dec13fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:43.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.027+0000 7f6debfff700 1 --2- 172.21.15.156:0/1661027074 >> v2:172.21.15.156:3300/0 conn(0x7f6dec09f1e0 0x7f6dec13fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.027+0000 7f6debfff700 1 -- 172.21.15.156:0/1661027074 >> v1:172.21.15.156:6789/0 conn(0x7f6dec09edb0 legacy=0x7f6dec13c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:43.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.027+0000 7f6debfff700 1 -- 172.21.15.156:0/1661027074 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dec09fe00 con 0x7f6dec09a130 2023-09-30T22:25:43.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.027+0000 7f6debfff700 1 --2- 172.21.15.156:0/1661027074 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6dec09a130 0x7f6dec09e870 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc0098f0 tx=0x7f6ddc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d92981cc836e99db server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:43.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.028+0000 7f6deaffd700 1 -- 172.21.15.156:0/1661027074 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc00b8a0 con 0x7f6dec09a130 2023-09-30T22:25:43.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.028+0000 7f6deaffd700 1 -- 172.21.15.156:0/1661027074 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ddc00ba00 con 0x7f6dec09a130 2023-09-30T22:25:43.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.028+0000 7f6deaffd700 1 -- 172.21.15.156:0/1661027074 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc00bd90 con 0x7f6dec09a130 2023-09-30T22:25:43.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.028+0000 7f6df2832700 1 -- 172.21.15.156:0/1661027074 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6dec09a130 msgr2=0x7f6dec09e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:43.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.028+0000 7f6df2832700 1 --2- 172.21.15.156:0/1661027074 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6dec09a130 0x7f6dec09e870 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc0098f0 tx=0x7f6ddc009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:43.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.028+0000 7f6df2832700 1 -- 172.21.15.156:0/1661027074 shutdown_connections 2023-09-30T22:25:43.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.028+0000 7f6df2832700 1 --2- 172.21.15.156:0/1661027074 >> v2:172.21.15.156:3300/0 conn(0x7f6dec09f1e0 0x7f6dec13fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.028+0000 7f6df2832700 1 --2- 172.21.15.156:0/1661027074 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6dec09a130 0x7f6dec09e870 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.028+0000 7f6df2832700 1 -- 172.21.15.156:0/1661027074 >> 172.21.15.156:0/1661027074 conn(0x7f6dec0a4430 msgr2=0x7f6dec0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:43.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.028+0000 7f6df2832700 1 -- 172.21.15.156:0/1661027074 shutdown_connections 2023-09-30T22:25:43.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.028+0000 7f6df2832700 1 -- 172.21.15.156:0/1661027074 wait complete. 2023-09-30T22:25:43.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.029+0000 7f6df2832700 1 Processor -- start 2023-09-30T22:25:43.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.030+0000 7f6df2832700 1 -- start start 2023-09-30T22:25:43.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.030+0000 7f6df2832700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6dec09a130 0x7f6dec11c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.030+0000 7f6df2832700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dec09edb0 0x7f6dec11cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.030+0000 7f6df2832700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6dec09f1e0 0x7f6dec11d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.030+0000 7f6df2832700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec11d7f0 con 0x7f6dec09edb0 2023-09-30T22:25:43.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.030+0000 7f6df2832700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec13f0e0 con 0x7f6dec09a130 2023-09-30T22:25:43.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.030+0000 7f6df2832700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec09b470 con 0x7f6dec09f1e0 2023-09-30T22:25:43.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.030+0000 7f6debfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6dec09a130 0x7f6dec11c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.030+0000 7f6debfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6dec09a130 0x7f6dec11c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40122/0 (socket says 172.21.15.156:40122) 2023-09-30T22:25:43.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.030+0000 7f6debfff700 1 -- 172.21.15.156:0/4108635841 learned_addr learned my addr 172.21.15.156:0/4108635841 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:43.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.030+0000 7f6deb7fe700 1 --2- 172.21.15.156:0/4108635841 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dec09edb0 0x7f6dec11cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.030+0000 7f6df0dcf700 1 --2- 172.21.15.156:0/4108635841 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6dec09f1e0 0x7f6dec11d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.031+0000 7f6debfff700 1 -- 172.21.15.156:0/4108635841 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6dec09f1e0 msgr2=0x7f6dec11d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:43.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.031+0000 7f6debfff700 1 --2- 172.21.15.156:0/4108635841 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6dec09f1e0 0x7f6dec11d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.031+0000 7f6debfff700 1 -- 172.21.15.156:0/4108635841 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dec09edb0 msgr2=0x7f6dec11cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:43.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.031+0000 7f6debfff700 1 --2- 172.21.15.156:0/4108635841 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dec09edb0 0x7f6dec11cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.031+0000 7f6debfff700 1 -- 172.21.15.156:0/4108635841 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ddc009550 con 0x7f6dec09a130 2023-09-30T22:25:43.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.031+0000 7f6df0dcf700 1 --2- 172.21.15.156:0/4108635841 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6dec09f1e0 0x7f6dec11d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:43.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.031+0000 7f6debfff700 1 --2- 172.21.15.156:0/4108635841 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6dec09a130 0x7f6dec11c700 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc009c40 tx=0x7f6ddc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:43.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.031+0000 7f6de8ff9700 1 -- 172.21.15.156:0/4108635841 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc0044d0 con 0x7f6dec09a130 2023-09-30T22:25:43.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.031+0000 7f6de8ff9700 1 -- 172.21.15.156:0/4108635841 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ddc01e070 con 0x7f6dec09a130 2023-09-30T22:25:43.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.031+0000 7f6de8ff9700 1 -- 172.21.15.156:0/4108635841 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc0038e0 con 0x7f6dec09a130 2023-09-30T22:25:43.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.032+0000 7f6df2832700 1 -- 172.21.15.156:0/4108635841 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dec0a00f0 con 0x7f6dec09a130 2023-09-30T22:25:43.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.032+0000 7f6df2832700 1 -- 172.21.15.156:0/4108635841 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dec11b2b0 con 0x7f6dec09a130 2023-09-30T22:25:43.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.032+0000 7f6df2832700 1 -- 172.21.15.156:0/4108635841 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dec04f2a0 con 0x7f6dec09a130 2023-09-30T22:25:43.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.033+0000 7f6de8ff9700 1 -- 172.21.15.156:0/4108635841 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6ddc003a40 con 0x7f6dec09a130 2023-09-30T22:25:43.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.033+0000 7f6de8ff9700 1 -- 172.21.15.156:0/4108635841 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6ddc020070 con 0x7f6dec09a130 2023-09-30T22:25:43.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.042+0000 7f6de8ff9700 1 -- 172.21.15.156:0/4108635841 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ddc02e3a0 con 0x7f6dec09a130 2023-09-30T22:25:43.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.088+0000 7f7dddb19700 1 -- 172.21.15.156:0/1038564823 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7dd806b2a0 con 0x7f7dd809f180 2023-09-30T22:25:43.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.088+0000 7f7dcffff700 1 -- 172.21.15.156:0/1038564823 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7dc001b340 con 0x7f7dd809f180 2023-09-30T22:25:43.089 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:43.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.091+0000 7f7dddb19700 1 -- 172.21.15.156:0/1038564823 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7dd809f180 msgr2=0x7f7dd806bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:43.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.091+0000 7f7dddb19700 1 --2- 172.21.15.156:0/1038564823 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7dd809f180 0x7f7dd806bdf0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f7dc000c470 tx=0x7f7dc000c780 comp rx=0 tx=0).stop 2023-09-30T22:25:43.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.091+0000 7f7dddb19700 1 -- 172.21.15.156:0/1038564823 shutdown_connections 2023-09-30T22:25:43.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.091+0000 7f7dddb19700 1 --2- 172.21.15.156:0/1038564823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7dd8131f40 0x7f7dd806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.091+0000 7f7dddb19700 1 --2- 172.21.15.156:0/1038564823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dd809e870 0x7f7dd806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.091+0000 7f7dddb19700 1 --2- 172.21.15.156:0/1038564823 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7dd809f180 0x7f7dd806bdf0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.091+0000 7f7dddb19700 1 -- 172.21.15.156:0/1038564823 >> 172.21.15.156:0/1038564823 conn(0x7f7dd80a4430 msgr2=0x7f7dd8072210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:43.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.091+0000 7f7dddb19700 1 -- 172.21.15.156:0/1038564823 shutdown_connections 2023-09-30T22:25:43.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.091+0000 7f7dddb19700 1 -- 172.21.15.156:0/1038564823 wait complete. 2023-09-30T22:25:43.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:43.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.178+0000 7f5b18891700 1 -- 172.21.15.156:0/2374067221 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5b1404f2a0 con 0x7f5b14133ad0 2023-09-30T22:25:43.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.179+0000 7f5b02ffd700 1 -- 172.21.15.156:0/2374067221 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5b04044070 con 0x7f5b14133ad0 2023-09-30T22:25:43.179 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:43.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.181+0000 7f5b18891700 1 -- 172.21.15.156:0/2374067221 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b14133ad0 msgr2=0x7f5b14070e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:43.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.181+0000 7f5b18891700 1 --2- 172.21.15.156:0/2374067221 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b14133ad0 0x7f5b14070e60 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f5b0400c500 tx=0x7f5b0400c810 comp rx=0 tx=0).stop 2023-09-30T22:25:43.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.181+0000 7f5b18891700 1 -- 172.21.15.156:0/2374067221 shutdown_connections 2023-09-30T22:25:43.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.181+0000 7f5b18891700 1 --2- 172.21.15.156:0/2374067221 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5b14139280 0x7f5b140718e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.181+0000 7f5b18891700 1 --2- 172.21.15.156:0/2374067221 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b14133ad0 0x7f5b14070e60 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.181+0000 7f5b18891700 1 --2- 172.21.15.156:0/2374067221 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5b14136960 0x7f5b140713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.181+0000 7f5b18891700 1 -- 172.21.15.156:0/2374067221 >> 172.21.15.156:0/2374067221 conn(0x7f5b14099c40 msgr2=0x7f5b14134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:43.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.181+0000 7f5b18891700 1 -- 172.21.15.156:0/2374067221 shutdown_connections 2023-09-30T22:25:43.182 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.181+0000 7f5b18891700 1 -- 172.21.15.156:0/2374067221 wait complete. 2023-09-30T22:25:43.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:43.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.209+0000 7fb002d6a700 1 -- 172.21.15.156:0/2764632152 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faffc12bcc0 con 0x7faffc09a730 2023-09-30T22:25:43.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.209+0000 7faff97fa700 1 -- 172.21.15.156:0/2764632152 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fafe8028090 con 0x7faffc09a730 2023-09-30T22:25:43.210 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:43.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.211+0000 7fb002d6a700 1 -- 172.21.15.156:0/2764632152 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faffc09a730 msgr2=0x7faffc119330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:43.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.211+0000 7fb002d6a700 1 --2- 172.21.15.156:0/2764632152 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faffc09a730 0x7faffc119330 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fafe800ed40 tx=0x7fafe800d630 comp rx=0 tx=0).stop 2023-09-30T22:25:43.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.211+0000 7fb002d6a700 1 -- 172.21.15.156:0/2764632152 shutdown_connections 2023-09-30T22:25:43.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.211+0000 7fb002d6a700 1 --2- 172.21.15.156:0/2764632152 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faffc130890 0x7faffc119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.211+0000 7fb002d6a700 1 --2- 172.21.15.156:0/2764632152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faffc099e20 0x7faffc118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.211+0000 7fb002d6a700 1 --2- 172.21.15.156:0/2764632152 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7faffc09a730 0x7faffc119330 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.212 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.211+0000 7fb002d6a700 1 -- 172.21.15.156:0/2764632152 >> 172.21.15.156:0/2764632152 conn(0x7faffc0a2980 msgr2=0x7faffc12d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:43.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.211+0000 7fb002d6a700 1 -- 172.21.15.156:0/2764632152 shutdown_connections 2023-09-30T22:25:43.213 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.211+0000 7fb002d6a700 1 -- 172.21.15.156:0/2764632152 wait complete. 2023-09-30T22:25:43.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:43.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.238+0000 7f6df2832700 1 -- 172.21.15.156:0/4108635841 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6dec06be20 con 0x7f6dec09a130 2023-09-30T22:25:43.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.239+0000 7f6de8ff9700 1 -- 172.21.15.156:0/4108635841 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ddc02a030 con 0x7f6dec09a130 2023-09-30T22:25:43.239 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:43.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.241+0000 7f6df2832700 1 -- 172.21.15.156:0/4108635841 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6dec09a130 msgr2=0x7f6dec11c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:43.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.241+0000 7f6df2832700 1 --2- 172.21.15.156:0/4108635841 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6dec09a130 0x7f6dec11c700 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc009c40 tx=0x7f6ddc004750 comp rx=0 tx=0).stop 2023-09-30T22:25:43.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.241+0000 7f6df2832700 1 -- 172.21.15.156:0/4108635841 shutdown_connections 2023-09-30T22:25:43.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.241+0000 7f6df2832700 1 --2- 172.21.15.156:0/4108635841 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6dec09f1e0 0x7f6dec11d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.241+0000 7f6df2832700 1 --2- 172.21.15.156:0/4108635841 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6dec09a130 0x7f6dec11c700 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.241+0000 7f6df2832700 1 --2- 172.21.15.156:0/4108635841 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dec09edb0 0x7f6dec11cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.241+0000 7f6df2832700 1 -- 172.21.15.156:0/4108635841 >> 172.21.15.156:0/4108635841 conn(0x7f6dec0a4430 msgr2=0x7f6dec13b620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:43.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.241+0000 7f6df2832700 1 -- 172.21.15.156:0/4108635841 shutdown_connections 2023-09-30T22:25:43.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:43.241+0000 7f6df2832700 1 -- 172.21.15.156:0/4108635841 wait complete. 2023-09-30T22:25:43.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:44.106 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:44.194 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:44.225 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:44.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.231+0000 7f0ce0d7f700 1 Processor -- start 2023-09-30T22:25:44.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.231+0000 7f0ce0d7f700 1 -- start start 2023-09-30T22:25:44.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.232+0000 7f0ce0d7f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0cdc0a0a70 0x7f0cdc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.232+0000 7f0ce0d7f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0cdc134120 0x7f0cdc13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.232+0000 7f0ce0d7f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cdc09dc00 con 0x7f0cdc0a1380 2023-09-30T22:25:44.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.232+0000 7f0ce0d7f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc09ea90 con 0x7f0cdc134120 2023-09-30T22:25:44.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.232+0000 7f0ce0d7f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc09dec0 con 0x7f0cdc0a0a70 2023-09-30T22:25:44.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.232+0000 7f0cda59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0cdc0a0a70 0x7f0cdc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.232+0000 7f0cdad9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0cdc134120 0x7f0cdc13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.232+0000 7f0cda59c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0cdc0a0a70 0x7f0cdc0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46160/0 (socket says 172.21.15.156:46160) 2023-09-30T22:25:44.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.232+0000 7f0cda59c700 1 -- 172.21.15.156:0/3012690075 learned_addr learned my addr 172.21.15.156:0/3012690075 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:44.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.233+0000 7f0cda59c700 1 -- 172.21.15.156:0/3012690075 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0cdc134120 msgr2=0x7f0cdc13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:44.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.233+0000 7f0cda59c700 1 --2- 172.21.15.156:0/3012690075 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0cdc134120 0x7f0cdc13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.233+0000 7f0cda59c700 1 -- 172.21.15.156:0/3012690075 >> v1:172.21.15.156:6789/0 conn(0x7f0cdc0a1380 legacy=0x7f0cdc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.233+0000 7f0cda59c700 1 -- 172.21.15.156:0/3012690075 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc09e6a0 con 0x7f0cdc0a0a70 2023-09-30T22:25:44.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.233+0000 7f0cd959a700 1 -- 172.21.15.156:0/3012690075 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3621106167 0 0) 0x7f0cdc09dc00 con 0x7f0cdc0a1380 2023-09-30T22:25:44.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.233+0000 7f0cdad9d700 1 --2- 172.21.15.156:0/3012690075 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0cdc134120 0x7f0cdc13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:44.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.233+0000 7f0cda59c700 1 --2- 172.21.15.156:0/3012690075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0cdc0a0a70 0x7f0cdc0a0e40 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc009920 tx=0x7f0ccc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc1d7b01967ab4cb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:44.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.233+0000 7f0cd959a700 1 -- 172.21.15.156:0/3012690075 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc011830 con 0x7f0cdc0a0a70 2023-09-30T22:25:44.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.233+0000 7f0cd959a700 1 -- 172.21.15.156:0/3012690075 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ccc011990 con 0x7f0cdc0a0a70 2023-09-30T22:25:44.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.233+0000 7f0cd959a700 1 -- 172.21.15.156:0/3012690075 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc011d00 con 0x7f0cdc0a0a70 2023-09-30T22:25:44.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.233+0000 7f0ce0d7f700 1 -- 172.21.15.156:0/3012690075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0cdc0a0a70 msgr2=0x7f0cdc0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.233+0000 7f0ce0d7f700 1 --2- 172.21.15.156:0/3012690075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0cdc0a0a70 0x7f0cdc0a0e40 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc009920 tx=0x7f0ccc009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:44.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.234+0000 7f0ce0d7f700 1 -- 172.21.15.156:0/3012690075 shutdown_connections 2023-09-30T22:25:44.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.234+0000 7f0ce0d7f700 1 --2- 172.21.15.156:0/3012690075 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0cdc134120 0x7f0cdc13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.234+0000 7f0ce0d7f700 1 --2- 172.21.15.156:0/3012690075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0cdc0a0a70 0x7f0cdc0a0e40 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.234+0000 7f0ce0d7f700 1 -- 172.21.15.156:0/3012690075 >> 172.21.15.156:0/3012690075 conn(0x7f0cdc0a6610 msgr2=0x7f0cdc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:44.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.234+0000 7f0ce0d7f700 1 -- 172.21.15.156:0/3012690075 shutdown_connections 2023-09-30T22:25:44.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.234+0000 7f0ce0d7f700 1 -- 172.21.15.156:0/3012690075 wait complete. 2023-09-30T22:25:44.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.235+0000 7f0ce0d7f700 1 Processor -- start 2023-09-30T22:25:44.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.235+0000 7f0ce0d7f700 1 -- start start 2023-09-30T22:25:44.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.235+0000 7f0ce0d7f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0cdc0a0a70 0x7f0cdc1227b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.235+0000 7f0ce0d7f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0cdc0a1380 0x7f0cdc122cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.235+0000 7f0ce0d7f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0cdc134120 0x7f0cdc123230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.235+0000 7f0ce0d7f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc1260d0 con 0x7f0cdc0a1380 2023-09-30T22:25:44.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.235+0000 7f0ce0d7f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc123c10 con 0x7f0cdc134120 2023-09-30T22:25:44.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.235+0000 7f0ce0d7f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc1243c0 con 0x7f0cdc0a0a70 2023-09-30T22:25:44.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.235+0000 7f0cd9d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0cdc0a1380 0x7f0cdc122cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.235+0000 7f0cdad9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0cdc134120 0x7f0cdc123230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.235+0000 7f0cd9d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0cdc0a1380 0x7f0cdc122cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:55974/0 (socket says 172.21.15.156:55974) 2023-09-30T22:25:44.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.235+0000 7f0cd9d9b700 1 -- 172.21.15.156:0/3231783710 learned_addr learned my addr 172.21.15.156:0/3231783710 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:44.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.236+0000 7f0cda59c700 1 --2- 172.21.15.156:0/3231783710 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0cdc0a0a70 0x7f0cdc1227b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.236+0000 7f0cd9d9b700 1 -- 172.21.15.156:0/3231783710 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0cdc0a0a70 msgr2=0x7f0cdc1227b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.236+0000 7f0cd9d9b700 1 --2- 172.21.15.156:0/3231783710 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0cdc0a0a70 0x7f0cdc1227b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.236+0000 7f0cd9d9b700 1 -- 172.21.15.156:0/3231783710 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0cdc134120 msgr2=0x7f0cdc123230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.236+0000 7f0cd9d9b700 1 --2- 172.21.15.156:0/3231783710 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0cdc134120 0x7f0cdc123230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.236+0000 7f0cd9d9b700 1 -- 172.21.15.156:0/3231783710 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd4009a70 con 0x7f0cdc0a1380 2023-09-30T22:25:44.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.236+0000 7f0cda59c700 1 --2- 172.21.15.156:0/3231783710 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0cdc0a0a70 0x7f0cdc1227b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:44.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.236+0000 7f0cdad9d700 1 --2- 172.21.15.156:0/3231783710 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0cdc134120 0x7f0cdc123230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:44.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.236+0000 7f0cd9d9b700 1 --2- 172.21.15.156:0/3231783710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0cdc0a1380 0x7f0cdc122cf0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f0cd000c550 tx=0x7f0cd000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:44.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.236+0000 7f0ccaffd700 1 -- 172.21.15.156:0/3231783710 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00054e0 con 0x7f0cdc0a1380 2023-09-30T22:25:44.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.236+0000 7f0ccaffd700 1 -- 172.21.15.156:0/3231783710 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd0003680 con 0x7f0cdc0a1380 2023-09-30T22:25:44.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.236+0000 7f0ce0d7f700 1 -- 172.21.15.156:0/3231783710 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ccc009550 con 0x7f0cdc0a1380 2023-09-30T22:25:44.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.236+0000 7f0ccaffd700 1 -- 172.21.15.156:0/3231783710 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0003a30 con 0x7f0cdc0a1380 2023-09-30T22:25:44.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.236+0000 7f0ce0d7f700 1 -- 172.21.15.156:0/3231783710 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cdc1339a0 con 0x7f0cdc0a1380 2023-09-30T22:25:44.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.237+0000 7f0ce0d7f700 1 -- 172.21.15.156:0/3231783710 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cdc133330 con 0x7f0cdc0a1380 2023-09-30T22:25:44.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.238+0000 7f0ccaffd700 1 -- 172.21.15.156:0/3231783710 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0cd0003b90 con 0x7f0cdc0a1380 2023-09-30T22:25:44.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.238+0000 7f0ccaffd700 1 -- 172.21.15.156:0/3231783710 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0cd003ed90 con 0x7f0cdc0a1380 2023-09-30T22:25:44.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.242+0000 7f0ccaffd700 1 -- 172.21.15.156:0/3231783710 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0cd001b3b0 con 0x7f0cdc0a1380 2023-09-30T22:25:44.254 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:44.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.326+0000 7ff595637700 1 Processor -- start 2023-09-30T22:25:44.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.326+0000 7ff595637700 1 -- start start 2023-09-30T22:25:44.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.326+0000 7ff595637700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff590133ad0 0x7ff590133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.326+0000 7ff595637700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff590130bc0 0x7ff59013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.326+0000 7ff595637700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff59006b2d0 con 0x7ff5901300a0 2023-09-30T22:25:44.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.326+0000 7ff595637700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff590133610 con 0x7ff590130bc0 2023-09-30T22:25:44.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.326+0000 7ff595637700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff59009a500 con 0x7ff590133ad0 2023-09-30T22:25:44.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.326+0000 7ff58effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff590133ad0 0x7ff590133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.328 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.326+0000 7ff58e7fc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff5901300a0 0x7ff5901304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:43844/0 (socket says 172.21.15.156:43844) 2023-09-30T22:25:44.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.326+0000 7ff58e7fc700 1 -- 172.21.15.156:0/878461176 learned_addr learned my addr 172.21.15.156:0/878461176 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:44.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.326+0000 7ff58f7fe700 1 --2- 172.21.15.156:0/878461176 >> v2:172.21.15.156:3300/0 conn(0x7ff590130bc0 0x7ff59013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.327+0000 7ff58effd700 1 -- 172.21.15.156:0/878461176 >> v2:172.21.15.156:3300/0 conn(0x7ff590130bc0 msgr2=0x7ff59013b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:44.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.327+0000 7ff58dffb700 1 -- 172.21.15.156:0/878461176 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3850391120 0 0) 0x7ff59006b2d0 con 0x7ff5901300a0 2023-09-30T22:25:44.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.327+0000 7ff58effd700 1 --2- 172.21.15.156:0/878461176 >> v2:172.21.15.156:3300/0 conn(0x7ff590130bc0 0x7ff59013b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.327+0000 7ff58effd700 1 -- 172.21.15.156:0/878461176 >> v1:172.21.15.156:6789/0 conn(0x7ff5901300a0 legacy=0x7ff5901304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.327+0000 7ff58effd700 1 -- 172.21.15.156:0/878461176 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5901338b0 con 0x7ff590133ad0 2023-09-30T22:25:44.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.327+0000 7ff58f7fe700 1 --2- 172.21.15.156:0/878461176 >> v2:172.21.15.156:3300/0 conn(0x7ff590130bc0 0x7ff59013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:44.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.327+0000 7ff58effd700 1 --2- 172.21.15.156:0/878461176 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff590133ad0 0x7ff590133ea0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7ff580009840 tx=0x7ff580009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40f04777ba081840 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:44.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.327+0000 7ff58dffb700 1 -- 172.21.15.156:0/878461176 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff580011830 con 0x7ff590133ad0 2023-09-30T22:25:44.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.327+0000 7ff58dffb700 1 -- 172.21.15.156:0/878461176 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff580011990 con 0x7ff590133ad0 2023-09-30T22:25:44.329 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.327+0000 7ff58dffb700 1 -- 172.21.15.156:0/878461176 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff580011d20 con 0x7ff590133ad0 2023-09-30T22:25:44.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.328+0000 7ff595637700 1 -- 172.21.15.156:0/878461176 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff590133ad0 msgr2=0x7ff590133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.331 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.328+0000 7ff595637700 1 --2- 172.21.15.156:0/878461176 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff590133ad0 0x7ff590133ea0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7ff580009840 tx=0x7ff580009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:44.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.328+0000 7ff595637700 1 -- 172.21.15.156:0/878461176 shutdown_connections 2023-09-30T22:25:44.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.328+0000 7ff595637700 1 --2- 172.21.15.156:0/878461176 >> v2:172.21.15.156:3300/0 conn(0x7ff590130bc0 0x7ff59013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.328+0000 7ff595637700 1 --2- 172.21.15.156:0/878461176 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff590133ad0 0x7ff590133ea0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.328+0000 7ff595637700 1 -- 172.21.15.156:0/878461176 >> 172.21.15.156:0/878461176 conn(0x7ff590099c40 msgr2=0x7ff5900a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:44.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.328+0000 7ff595637700 1 -- 172.21.15.156:0/878461176 shutdown_connections 2023-09-30T22:25:44.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.328+0000 7ff595637700 1 -- 172.21.15.156:0/878461176 wait complete. 2023-09-30T22:25:44.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.329+0000 7ff595637700 1 Processor -- start 2023-09-30T22:25:44.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.329+0000 7ff595637700 1 -- start start 2023-09-30T22:25:44.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.329+0000 7ff595637700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5901300a0 0x7ff590071260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.329+0000 7ff595637700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff590130bc0 0x7ff5900717a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.330+0000 7ff595637700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff590133ad0 0x7ff590071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.332 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.330+0000 7ff595637700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59011f8f0 con 0x7ff590130bc0 2023-09-30T22:25:44.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.330+0000 7ff595637700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5900a3330 con 0x7ff590133ad0 2023-09-30T22:25:44.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.330+0000 7ff595637700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff59012dd00 con 0x7ff5901300a0 2023-09-30T22:25:44.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.330+0000 7ff58effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5901300a0 0x7ff590071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.330+0000 7ff58effd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5901300a0 0x7ff590071260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46198/0 (socket says 172.21.15.156:46198) 2023-09-30T22:25:44.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.330+0000 7ff58effd700 1 -- 172.21.15.156:0/1534939600 learned_addr learned my addr 172.21.15.156:0/1534939600 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:44.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.330+0000 7ff58e7fc700 1 --2- 172.21.15.156:0/1534939600 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff590130bc0 0x7ff5900717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.330+0000 7ff58effd700 1 -- 172.21.15.156:0/1534939600 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff590133ad0 msgr2=0x7ff590071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.330+0000 7ff58effd700 1 --2- 172.21.15.156:0/1534939600 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff590133ad0 0x7ff590071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.330+0000 7ff58effd700 1 -- 172.21.15.156:0/1534939600 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff590130bc0 msgr2=0x7ff5900717a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.330+0000 7ff58effd700 1 --2- 172.21.15.156:0/1534939600 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff590130bc0 0x7ff5900717a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.330+0000 7ff58effd700 1 -- 172.21.15.156:0/1534939600 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5800094a0 con 0x7ff5901300a0 2023-09-30T22:25:44.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.330+0000 7ff58effd700 1 --2- 172.21.15.156:0/1534939600 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5901300a0 0x7ff590071260 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7ff5800090b0 tx=0x7ff580004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:44.333 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.330+0000 7ff5777fe700 1 -- 172.21.15.156:0/1534939600 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5800044b0 con 0x7ff5901300a0 2023-09-30T22:25:44.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.330+0000 7ff5777fe700 1 -- 172.21.15.156:0/1534939600 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58001f070 con 0x7ff5901300a0 2023-09-30T22:25:44.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.330+0000 7ff595637700 1 -- 172.21.15.156:0/1534939600 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff59011e020 con 0x7ff5901300a0 2023-09-30T22:25:44.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.330+0000 7ff5777fe700 1 -- 172.21.15.156:0/1534939600 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5800038e0 con 0x7ff5901300a0 2023-09-30T22:25:44.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.330+0000 7ff595637700 1 -- 172.21.15.156:0/1534939600 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff590120390 con 0x7ff5901300a0 2023-09-30T22:25:44.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.332+0000 7ff595637700 1 -- 172.21.15.156:0/1534939600 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5900a2620 con 0x7ff5901300a0 2023-09-30T22:25:44.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.332+0000 7ff5777fe700 1 -- 172.21.15.156:0/1534939600 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff580021030 con 0x7ff5901300a0 2023-09-30T22:25:44.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.332+0000 7ff5777fe700 1 -- 172.21.15.156:0/1534939600 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff580040d40 con 0x7ff5901300a0 2023-09-30T22:25:44.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.341+0000 7ff5777fe700 1 -- 172.21.15.156:0/1534939600 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff580047080 con 0x7ff5901300a0 2023-09-30T22:25:44.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.374+0000 7f46c627a700 1 Processor -- start 2023-09-30T22:25:44.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.374+0000 7f46c627a700 1 -- start start 2023-09-30T22:25:44.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.374+0000 7f46c627a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46c0133ad0 0x7f46c0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.374+0000 7f46c627a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f46c0130bc0 0x7f46c013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.374+0000 7f46c627a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c006b2d0 con 0x7f46c01300a0 2023-09-30T22:25:44.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.374+0000 7f46c627a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c0133610 con 0x7f46c0130bc0 2023-09-30T22:25:44.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.374+0000 7f46c627a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c009a500 con 0x7f46c0133ad0 2023-09-30T22:25:44.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.375+0000 7f46bffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46c0133ad0 0x7f46c0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.375+0000 7f46c4817700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f46c0130bc0 0x7f46c013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.375+0000 7f46bffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46c0133ad0 0x7f46c0133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40160/0 (socket says 172.21.15.156:40160) 2023-09-30T22:25:44.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.375+0000 7f46bffff700 1 -- 172.21.15.156:0/1687219594 learned_addr learned my addr 172.21.15.156:0/1687219594 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:44.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.375+0000 7f46bffff700 1 -- 172.21.15.156:0/1687219594 >> v2:172.21.15.156:3300/0 conn(0x7f46c0130bc0 msgr2=0x7f46c013b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:44.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.375+0000 7f46bffff700 1 --2- 172.21.15.156:0/1687219594 >> v2:172.21.15.156:3300/0 conn(0x7f46c0130bc0 0x7f46c013b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.375+0000 7f46bffff700 1 -- 172.21.15.156:0/1687219594 >> v1:172.21.15.156:6789/0 conn(0x7f46c01300a0 legacy=0x7f46c01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.375+0000 7f46bffff700 1 -- 172.21.15.156:0/1687219594 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c01338b0 con 0x7f46c0133ad0 2023-09-30T22:25:44.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.375+0000 7f46c4817700 1 --2- 172.21.15.156:0/1687219594 >> v2:172.21.15.156:3300/0 conn(0x7f46c0130bc0 0x7f46c013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:44.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.375+0000 7f46bffff700 1 --2- 172.21.15.156:0/1687219594 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46c0133ad0 0x7f46c0133ea0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f46b00098f0 tx=0x7f46b0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be84d80a0cf6a327 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:44.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.375+0000 7f46beffd700 1 -- 172.21.15.156:0/1687219594 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0011830 con 0x7f46c0133ad0 2023-09-30T22:25:44.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.375+0000 7f46beffd700 1 -- 172.21.15.156:0/1687219594 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b0011990 con 0x7f46c0133ad0 2023-09-30T22:25:44.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.375+0000 7f46beffd700 1 -- 172.21.15.156:0/1687219594 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0011d20 con 0x7f46c0133ad0 2023-09-30T22:25:44.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.376+0000 7f46c627a700 1 -- 172.21.15.156:0/1687219594 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46c0133ad0 msgr2=0x7f46c0133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.376+0000 7f46c627a700 1 --2- 172.21.15.156:0/1687219594 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46c0133ad0 0x7f46c0133ea0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f46b00098f0 tx=0x7f46b0009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:44.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.376+0000 7f46c627a700 1 -- 172.21.15.156:0/1687219594 shutdown_connections 2023-09-30T22:25:44.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.376+0000 7f46c627a700 1 --2- 172.21.15.156:0/1687219594 >> v2:172.21.15.156:3300/0 conn(0x7f46c0130bc0 0x7f46c013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.376+0000 7f46c627a700 1 --2- 172.21.15.156:0/1687219594 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46c0133ad0 0x7f46c0133ea0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.376+0000 7f46c627a700 1 -- 172.21.15.156:0/1687219594 >> 172.21.15.156:0/1687219594 conn(0x7f46c0099c40 msgr2=0x7f46c00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:44.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.376+0000 7f46c627a700 1 -- 172.21.15.156:0/1687219594 shutdown_connections 2023-09-30T22:25:44.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.376+0000 7f46c627a700 1 -- 172.21.15.156:0/1687219594 wait complete. 2023-09-30T22:25:44.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.377+0000 7f46c627a700 1 Processor -- start 2023-09-30T22:25:44.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.378+0000 7f46c627a700 1 -- start start 2023-09-30T22:25:44.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.378+0000 7f46c627a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46c01300a0 0x7f46c011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.378+0000 7f46c627a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46c0130bc0 0x7f46c011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.378+0000 7f46c627a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46c0133ad0 0x7f46c011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.378+0000 7f46c627a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c012fbb0 con 0x7f46c01300a0 2023-09-30T22:25:44.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.378+0000 7f46c627a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c0120b90 con 0x7f46c0130bc0 2023-09-30T22:25:44.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.378+0000 7f46c627a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46c012d220 con 0x7f46c0133ad0 2023-09-30T22:25:44.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.379+0000 7f46bffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46c01300a0 0x7f46c011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.379+0000 7f46bffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46c01300a0 0x7f46c011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:56034/0 (socket says 172.21.15.156:56034) 2023-09-30T22:25:44.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.379+0000 7f46bffff700 1 -- 172.21.15.156:0/2395032606 learned_addr learned my addr 172.21.15.156:0/2395032606 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:44.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.379+0000 7f46c4817700 1 --2- 172.21.15.156:0/2395032606 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46c0133ad0 0x7f46c011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.379+0000 7f46bf7fe700 1 --2- 172.21.15.156:0/2395032606 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46c0130bc0 0x7f46c011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.379+0000 7f46bffff700 1 -- 172.21.15.156:0/2395032606 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46c0133ad0 msgr2=0x7f46c011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.379+0000 7f46bffff700 1 --2- 172.21.15.156:0/2395032606 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46c0133ad0 0x7f46c011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.379+0000 7f46bffff700 1 -- 172.21.15.156:0/2395032606 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46c0130bc0 msgr2=0x7f46c011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.379+0000 7f46bffff700 1 --2- 172.21.15.156:0/2395032606 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46c0130bc0 0x7f46c011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.379+0000 7f46bffff700 1 -- 172.21.15.156:0/2395032606 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b8009a70 con 0x7f46c01300a0 2023-09-30T22:25:44.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.379+0000 7f46bffff700 1 --2- 172.21.15.156:0/2395032606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46c01300a0 0x7f46c011da40 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f46b0009c40 tx=0x7f46b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:44.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.379+0000 7f46bcff9700 1 -- 172.21.15.156:0/2395032606 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b00036a0 con 0x7f46c01300a0 2023-09-30T22:25:44.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.379+0000 7f46bcff9700 1 -- 172.21.15.156:0/2395032606 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b0003800 con 0x7f46c01300a0 2023-09-30T22:25:44.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.379+0000 7f46bcff9700 1 -- 172.21.15.156:0/2395032606 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0003b90 con 0x7f46c01300a0 2023-09-30T22:25:44.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.379+0000 7f46c627a700 1 -- 172.21.15.156:0/2395032606 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b0009550 con 0x7f46c01300a0 2023-09-30T22:25:44.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.380+0000 7f46c627a700 1 -- 172.21.15.156:0/2395032606 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c012dd00 con 0x7f46c01300a0 2023-09-30T22:25:44.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.381+0000 7f46bcff9700 1 -- 172.21.15.156:0/2395032606 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f46b0021070 con 0x7f46c01300a0 2023-09-30T22:25:44.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.381+0000 7f46c627a700 1 -- 172.21.15.156:0/2395032606 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c0072800 con 0x7f46c01300a0 2023-09-30T22:25:44.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.381+0000 7f46bcff9700 1 -- 172.21.15.156:0/2395032606 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f46b0040d70 con 0x7f46c01300a0 2023-09-30T22:25:44.386 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.386+0000 7f46bcff9700 1 -- 172.21.15.156:0/2395032606 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f46b002d3a0 con 0x7f46c01300a0 2023-09-30T22:25:44.387 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.387+0000 7efdccf54700 1 Processor -- start 2023-09-30T22:25:44.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.387+0000 7efdccf54700 1 -- start start 2023-09-30T22:25:44.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.388+0000 7efdccf54700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7efdc809d860 0x7efdc809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.388+0000 7efdccf54700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efdc809e170 0x7efdc81307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.389 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.388+0000 7efdccf54700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efdc8130ce0 0x7efdc8131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.388+0000 7efdccf54700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc8131670 con 0x7efdc809d860 2023-09-30T22:25:44.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.388+0000 7efdccf54700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc809aaa0 con 0x7efdc8130ce0 2023-09-30T22:25:44.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.388+0000 7efdccf54700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efdc809f870 con 0x7efdc809e170 2023-09-30T22:25:44.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.388+0000 7efdc5d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efdc809e170 0x7efdc81307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.388+0000 7efdc5d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efdc809e170 0x7efdc81307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46214/0 (socket says 172.21.15.156:46214) 2023-09-30T22:25:44.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.388+0000 7efdc5d9b700 1 -- 172.21.15.156:0/167028027 learned_addr learned my addr 172.21.15.156:0/167028027 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:44.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.388+0000 7efdc659c700 1 --2- 172.21.15.156:0/167028027 >> v2:172.21.15.156:3300/0 conn(0x7efdc809d860 0x7efdc809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.388+0000 7efdc5d9b700 1 -- 172.21.15.156:0/167028027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efdc8130ce0 msgr2=0x7efdc8131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:44.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.388+0000 7efdc5d9b700 1 --2- 172.21.15.156:0/167028027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efdc8130ce0 0x7efdc8131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.388+0000 7efdc5d9b700 1 -- 172.21.15.156:0/167028027 >> v2:172.21.15.156:3300/0 conn(0x7efdc809d860 msgr2=0x7efdc809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:44.390 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.389+0000 7efdc5d9b700 1 --2- 172.21.15.156:0/167028027 >> v2:172.21.15.156:3300/0 conn(0x7efdc809d860 0x7efdc809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.389+0000 7efdc5d9b700 1 -- 172.21.15.156:0/167028027 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc809b360 con 0x7efdc809e170 2023-09-30T22:25:44.391 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.389+0000 7efdc5d9b700 1 --2- 172.21.15.156:0/167028027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efdc809e170 0x7efdc81307a0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00bbc0 tx=0x7efdbc00bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5eb1e22ee62ad651 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:44.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.389+0000 7efdc559a700 1 -- 172.21.15.156:0/167028027 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc00dd50 con 0x7efdc809e170 2023-09-30T22:25:44.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.389+0000 7efdc559a700 1 -- 172.21.15.156:0/167028027 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdbc010470 con 0x7efdc809e170 2023-09-30T22:25:44.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.389+0000 7efdc559a700 1 -- 172.21.15.156:0/167028027 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc010800 con 0x7efdc809e170 2023-09-30T22:25:44.392 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.390+0000 7efdccf54700 1 -- 172.21.15.156:0/167028027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efdc809e170 msgr2=0x7efdc81307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.390+0000 7efdccf54700 1 --2- 172.21.15.156:0/167028027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efdc809e170 0x7efdc81307a0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00bbc0 tx=0x7efdbc00bed0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.390+0000 7efdccf54700 1 -- 172.21.15.156:0/167028027 shutdown_connections 2023-09-30T22:25:44.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.390+0000 7efdccf54700 1 --2- 172.21.15.156:0/167028027 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efdc8130ce0 0x7efdc8131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.390+0000 7efdccf54700 1 --2- 172.21.15.156:0/167028027 >> v2:172.21.15.156:3300/0 conn(0x7efdc809d860 0x7efdc809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.390+0000 7efdccf54700 1 --2- 172.21.15.156:0/167028027 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efdc809e170 0x7efdc81307a0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.390+0000 7efdccf54700 1 -- 172.21.15.156:0/167028027 >> 172.21.15.156:0/167028027 conn(0x7efdc8099c40 msgr2=0x7efdc80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:44.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.390+0000 7efdccf54700 1 -- 172.21.15.156:0/167028027 shutdown_connections 2023-09-30T22:25:44.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.390+0000 7efdccf54700 1 -- 172.21.15.156:0/167028027 wait complete. 2023-09-30T22:25:44.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.391+0000 7efdccf54700 1 Processor -- start 2023-09-30T22:25:44.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.391+0000 7efdccf54700 1 -- start start 2023-09-30T22:25:44.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.391+0000 7efdccf54700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efdc809d860 0x7efdc8126120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.393 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.391+0000 7efdccf54700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efdc809e170 0x7efdc8126660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.391+0000 7efdccf54700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efdc8130ce0 0x7efdc8126ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.391+0000 7efdccf54700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc8127560 con 0x7efdc8130ce0 2023-09-30T22:25:44.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.391+0000 7efdccf54700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc80a22d0 con 0x7efdc809d860 2023-09-30T22:25:44.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.391+0000 7efdccf54700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efdc81297d0 con 0x7efdc809e170 2023-09-30T22:25:44.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.392+0000 7efdc5d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efdc809e170 0x7efdc8126660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.392+0000 7efdc5d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efdc809e170 0x7efdc8126660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46226/0 (socket says 172.21.15.156:46226) 2023-09-30T22:25:44.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.392+0000 7efdc5d9b700 1 -- 172.21.15.156:0/2109748009 learned_addr learned my addr 172.21.15.156:0/2109748009 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:44.394 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.392+0000 7efdc6d9d700 1 --2- 172.21.15.156:0/2109748009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efdc8130ce0 0x7efdc8126ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.392+0000 7efdc5d9b700 1 -- 172.21.15.156:0/2109748009 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efdc809d860 msgr2=0x7efdc8126120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.392+0000 7efdc5d9b700 1 --2- 172.21.15.156:0/2109748009 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efdc809d860 0x7efdc8126120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.392+0000 7efdc5d9b700 1 -- 172.21.15.156:0/2109748009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efdc8130ce0 msgr2=0x7efdc8126ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.392+0000 7efdc5d9b700 1 --2- 172.21.15.156:0/2109748009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efdc8130ce0 0x7efdc8126ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.392+0000 7efdc5d9b700 1 -- 172.21.15.156:0/2109748009 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdbc00b7f0 con 0x7efdc809e170 2023-09-30T22:25:44.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.392+0000 7efdc5d9b700 1 --2- 172.21.15.156:0/2109748009 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efdc809e170 0x7efdc8126660 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7efdc809fa00 tx=0x7efdbc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:44.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.393+0000 7efdb6ffd700 1 -- 172.21.15.156:0/2109748009 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc003bb0 con 0x7efdc809e170 2023-09-30T22:25:44.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.393+0000 7efdb6ffd700 1 -- 172.21.15.156:0/2109748009 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdbc003d10 con 0x7efdc809e170 2023-09-30T22:25:44.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.393+0000 7efdccf54700 1 -- 172.21.15.156:0/2109748009 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc812fdc0 con 0x7efdc809e170 2023-09-30T22:25:44.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.393+0000 7efdb6ffd700 1 -- 172.21.15.156:0/2109748009 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc010820 con 0x7efdc809e170 2023-09-30T22:25:44.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.393+0000 7efdccf54700 1 -- 172.21.15.156:0/2109748009 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc8128440 con 0x7efdc809e170 2023-09-30T22:25:44.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.394+0000 7efdccf54700 1 -- 172.21.15.156:0/2109748009 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc8129910 con 0x7efdc809e170 2023-09-30T22:25:44.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.394+0000 7efdb6ffd700 1 -- 172.21.15.156:0/2109748009 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efdbc010980 con 0x7efdc809e170 2023-09-30T22:25:44.396 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.394+0000 7efdb6ffd700 1 -- 172.21.15.156:0/2109748009 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efdbc040990 con 0x7efdc809e170 2023-09-30T22:25:44.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.403+0000 7efdb6ffd700 1 -- 172.21.15.156:0/2109748009 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efdc8129910 con 0x7efdc809e170 2023-09-30T22:25:44.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.456+0000 7f0ce0d7f700 1 -- 172.21.15.156:0/3231783710 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0cdc133980 con 0x7f0cdc0a1380 2023-09-30T22:25:44.457 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.456+0000 7f0ccaffd700 1 -- 172.21.15.156:0/3231783710 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0cd0017030 con 0x7f0cdc0a1380 2023-09-30T22:25:44.457 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:44.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.459+0000 7f0ce0d7f700 1 -- 172.21.15.156:0/3231783710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0cdc0a1380 msgr2=0x7f0cdc122cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.459+0000 7f0ce0d7f700 1 --2- 172.21.15.156:0/3231783710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0cdc0a1380 0x7f0cdc122cf0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f0cd000c550 tx=0x7f0cd000c910 comp rx=0 tx=0).stop 2023-09-30T22:25:44.460 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.459+0000 7f0ce0d7f700 1 -- 172.21.15.156:0/3231783710 shutdown_connections 2023-09-30T22:25:44.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.459+0000 7f0ce0d7f700 1 --2- 172.21.15.156:0/3231783710 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0cdc134120 0x7f0cdc123230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.459+0000 7f0ce0d7f700 1 --2- 172.21.15.156:0/3231783710 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0cdc0a0a70 0x7f0cdc1227b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.459+0000 7f0ce0d7f700 1 --2- 172.21.15.156:0/3231783710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0cdc0a1380 0x7f0cdc122cf0 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.459+0000 7f0ce0d7f700 1 -- 172.21.15.156:0/3231783710 >> 172.21.15.156:0/3231783710 conn(0x7f0cdc0a6610 msgr2=0x7f0cdc09a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:44.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.460+0000 7f0ce0d7f700 1 -- 172.21.15.156:0/3231783710 shutdown_connections 2023-09-30T22:25:44.461 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.460+0000 7f0ce0d7f700 1 -- 172.21.15.156:0/3231783710 wait complete. 2023-09-30T22:25:44.477 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:44.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.581+0000 7ff595637700 1 -- 172.21.15.156:0/1534939600 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff59004f2a0 con 0x7ff5901300a0 2023-09-30T22:25:44.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.581+0000 7ff5777fe700 1 -- 172.21.15.156:0/1534939600 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff580015020 con 0x7ff5901300a0 2023-09-30T22:25:44.582 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:44.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.583+0000 7ff595637700 1 -- 172.21.15.156:0/1534939600 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5901300a0 msgr2=0x7ff590071260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.583+0000 7ff595637700 1 --2- 172.21.15.156:0/1534939600 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5901300a0 0x7ff590071260 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7ff5800090b0 tx=0x7ff580004750 comp rx=0 tx=0).stop 2023-09-30T22:25:44.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.583+0000 7ff595637700 1 -- 172.21.15.156:0/1534939600 shutdown_connections 2023-09-30T22:25:44.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.583+0000 7ff595637700 1 --2- 172.21.15.156:0/1534939600 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff590133ad0 0x7ff590071ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.583+0000 7ff595637700 1 --2- 172.21.15.156:0/1534939600 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff5901300a0 0x7ff590071260 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.583+0000 7ff595637700 1 --2- 172.21.15.156:0/1534939600 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff590130bc0 0x7ff5900717a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.583+0000 7ff595637700 1 -- 172.21.15.156:0/1534939600 >> 172.21.15.156:0/1534939600 conn(0x7ff590099c40 msgr2=0x7ff590132a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:44.584 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.583+0000 7ff595637700 1 -- 172.21.15.156:0/1534939600 shutdown_connections 2023-09-30T22:25:44.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.583+0000 7ff595637700 1 -- 172.21.15.156:0/1534939600 wait complete. 2023-09-30T22:25:44.595 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:44.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.599+0000 7efdccf54700 1 -- 172.21.15.156:0/2109748009 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efdc8129910 con 0x7efdc809e170 2023-09-30T22:25:44.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.599+0000 7efdb6ffd700 1 -- 172.21.15.156:0/2109748009 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efdc8129910 con 0x7efdc809e170 2023-09-30T22:25:44.600 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:44.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.601+0000 7efdccf54700 1 -- 172.21.15.156:0/2109748009 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efdc809e170 msgr2=0x7efdc8126660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.601+0000 7efdccf54700 1 --2- 172.21.15.156:0/2109748009 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efdc809e170 0x7efdc8126660 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7efdc809fa00 tx=0x7efdbc004750 comp rx=0 tx=0).stop 2023-09-30T22:25:44.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.601+0000 7efdccf54700 1 -- 172.21.15.156:0/2109748009 shutdown_connections 2023-09-30T22:25:44.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.601+0000 7efdccf54700 1 --2- 172.21.15.156:0/2109748009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efdc8130ce0 0x7efdc8126ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.601+0000 7efdccf54700 1 --2- 172.21.15.156:0/2109748009 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efdc809d860 0x7efdc8126120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.601+0000 7efdccf54700 1 --2- 172.21.15.156:0/2109748009 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efdc809e170 0x7efdc8126660 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.601+0000 7efdccf54700 1 -- 172.21.15.156:0/2109748009 >> 172.21.15.156:0/2109748009 conn(0x7efdc8099c40 msgr2=0x7efdc80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:44.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.601+0000 7efdccf54700 1 -- 172.21.15.156:0/2109748009 shutdown_connections 2023-09-30T22:25:44.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.601+0000 7efdccf54700 1 -- 172.21.15.156:0/2109748009 wait complete. 2023-09-30T22:25:44.614 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:44.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.621+0000 7f46c627a700 1 -- 172.21.15.156:0/2395032606 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f46c004f2a0 con 0x7f46c01300a0 2023-09-30T22:25:44.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.621+0000 7f46bcff9700 1 -- 172.21.15.156:0/2395032606 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f46b0029070 con 0x7f46c01300a0 2023-09-30T22:25:44.623 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:44.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.623+0000 7f46c627a700 1 -- 172.21.15.156:0/2395032606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46c01300a0 msgr2=0x7f46c011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.623+0000 7f46c627a700 1 --2- 172.21.15.156:0/2395032606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46c01300a0 0x7f46c011da40 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f46b0009c40 tx=0x7f46b0004750 comp rx=0 tx=0).stop 2023-09-30T22:25:44.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.623+0000 7f46c627a700 1 -- 172.21.15.156:0/2395032606 shutdown_connections 2023-09-30T22:25:44.624 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.623+0000 7f46c627a700 1 --2- 172.21.15.156:0/2395032606 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f46c0133ad0 0x7f46c011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.623+0000 7f46c627a700 1 --2- 172.21.15.156:0/2395032606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46c01300a0 0x7f46c011da40 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.623+0000 7f46c627a700 1 --2- 172.21.15.156:0/2395032606 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f46c0130bc0 0x7f46c011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.623+0000 7f46c627a700 1 -- 172.21.15.156:0/2395032606 >> 172.21.15.156:0/2395032606 conn(0x7f46c0099c40 msgr2=0x7f46c012e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:44.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.624+0000 7f46c627a700 1 -- 172.21.15.156:0/2395032606 shutdown_connections 2023-09-30T22:25:44.625 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:44.624+0000 7f46c627a700 1 -- 172.21.15.156:0/2395032606 wait complete. 2023-09-30T22:25:44.636 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:45.478 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:45.596 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:45.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.611+0000 7ff103076700 1 Processor -- start 2023-09-30T22:25:45.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.611+0000 7ff103076700 1 -- start start 2023-09-30T22:25:45.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.611+0000 7ff103076700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff0fc133ad0 0x7ff0fc133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.611+0000 7ff103076700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0fc1300a0 0x7ff0fc1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.611+0000 7ff103076700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0fc06b2d0 con 0x7ff0fc1309f0 2023-09-30T22:25:45.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.611+0000 7ff103076700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0fc133610 con 0x7ff0fc133ad0 2023-09-30T22:25:45.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.611+0000 7ff103076700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc09a500 con 0x7ff0fc1300a0 2023-09-30T22:25:45.614 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.611+0000 7ff100e12700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff0fc133ad0 0x7ff0fc133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.611+0000 7ff0fbfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0fc1300a0 0x7ff0fc1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.611+0000 7ff100e12700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff0fc133ad0 0x7ff0fc133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:56060/0 (socket says 172.21.15.156:56060) 2023-09-30T22:25:45.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.611+0000 7ff101613700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff0fc1309f0 0x7ff0fc13a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:43852/0 (socket says 172.21.15.156:43852) 2023-09-30T22:25:45.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.611+0000 7ff100e12700 1 -- 172.21.15.156:0/244670814 learned_addr learned my addr 172.21.15.156:0/244670814 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:45.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.611+0000 7ff0fbfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0fc1300a0 0x7ff0fc1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46228/0 (socket says 172.21.15.156:46228) 2023-09-30T22:25:45.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.612+0000 7ff0fbfff700 1 -- 172.21.15.156:0/244670814 >> v2:172.21.15.156:3300/0 conn(0x7ff0fc133ad0 msgr2=0x7ff0fc133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:45.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.612+0000 7ff0fbfff700 1 --2- 172.21.15.156:0/244670814 >> v2:172.21.15.156:3300/0 conn(0x7ff0fc133ad0 0x7ff0fc133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.612+0000 7ff0fbfff700 1 -- 172.21.15.156:0/244670814 >> v1:172.21.15.156:6789/0 conn(0x7ff0fc1309f0 legacy=0x7ff0fc13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.612+0000 7ff0fbfff700 1 -- 172.21.15.156:0/244670814 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc1338b0 con 0x7ff0fc1300a0 2023-09-30T22:25:45.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.612+0000 7ff0fb7fe700 1 -- 172.21.15.156:0/244670814 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3332692952 0 0) 0x7ff0fc06b2d0 con 0x7ff0fc1309f0 2023-09-30T22:25:45.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.612+0000 7ff100e12700 1 --2- 172.21.15.156:0/244670814 >> v2:172.21.15.156:3300/0 conn(0x7ff0fc133ad0 0x7ff0fc133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:45.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.612+0000 7ff0fbfff700 1 --2- 172.21.15.156:0/244670814 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0fc1300a0 0x7ff0fc1304b0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8009840 tx=0x7ff0e8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=799da116d104702 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:45.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.612+0000 7ff0fb7fe700 1 -- 172.21.15.156:0/244670814 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8011830 con 0x7ff0fc1300a0 2023-09-30T22:25:45.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.612+0000 7ff0fb7fe700 1 -- 172.21.15.156:0/244670814 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e8011990 con 0x7ff0fc1300a0 2023-09-30T22:25:45.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.612+0000 7ff0fb7fe700 1 -- 172.21.15.156:0/244670814 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8011d20 con 0x7ff0fc1300a0 2023-09-30T22:25:45.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.613+0000 7ff103076700 1 -- 172.21.15.156:0/244670814 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0fc1300a0 msgr2=0x7ff0fc1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.613+0000 7ff103076700 1 --2- 172.21.15.156:0/244670814 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0fc1300a0 0x7ff0fc1304b0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8009840 tx=0x7ff0e8009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:45.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.613+0000 7ff103076700 1 -- 172.21.15.156:0/244670814 shutdown_connections 2023-09-30T22:25:45.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.613+0000 7ff103076700 1 --2- 172.21.15.156:0/244670814 >> v2:172.21.15.156:3300/0 conn(0x7ff0fc133ad0 0x7ff0fc133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.613+0000 7ff103076700 1 --2- 172.21.15.156:0/244670814 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0fc1300a0 0x7ff0fc1304b0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.616 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.613+0000 7ff103076700 1 -- 172.21.15.156:0/244670814 >> 172.21.15.156:0/244670814 conn(0x7ff0fc099c40 msgr2=0x7ff0fc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:45.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.613+0000 7ff103076700 1 -- 172.21.15.156:0/244670814 shutdown_connections 2023-09-30T22:25:45.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.613+0000 7ff103076700 1 -- 172.21.15.156:0/244670814 wait complete. 2023-09-30T22:25:45.617 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:45.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.614+0000 7ff103076700 1 Processor -- start 2023-09-30T22:25:45.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.614+0000 7ff103076700 1 -- start start 2023-09-30T22:25:45.619 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.615+0000 7ff103076700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0fc1300a0 0x7ff0fc1c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.615+0000 7ff103076700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0fc1309f0 0x7ff0fc1c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.615+0000 7ff103076700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0fc133ad0 0x7ff0fc1c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.615+0000 7ff103076700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc0721a0 con 0x7ff0fc1300a0 2023-09-30T22:25:45.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.615+0000 7ff103076700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc11fc80 con 0x7ff0fc133ad0 2023-09-30T22:25:45.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.615+0000 7ff103076700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc0a3400 con 0x7ff0fc1309f0 2023-09-30T22:25:45.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.615+0000 7ff0fbfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0fc1309f0 0x7ff0fc1c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.615+0000 7ff101613700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0fc133ad0 0x7ff0fc1c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.615+0000 7ff0fbfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0fc1309f0 0x7ff0fc1c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46234/0 (socket says 172.21.15.156:46234) 2023-09-30T22:25:45.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.615+0000 7ff0fbfff700 1 -- 172.21.15.156:0/3625248383 learned_addr learned my addr 172.21.15.156:0/3625248383 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:45.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.615+0000 7ff100e12700 1 --2- 172.21.15.156:0/3625248383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0fc1300a0 0x7ff0fc1c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.615+0000 7ff101613700 1 -- 172.21.15.156:0/3625248383 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0fc1309f0 msgr2=0x7ff0fc1c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.620 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.615+0000 7ff101613700 1 --2- 172.21.15.156:0/3625248383 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0fc1309f0 0x7ff0fc1c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.615+0000 7ff101613700 1 -- 172.21.15.156:0/3625248383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0fc1300a0 msgr2=0x7ff0fc1c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.615+0000 7ff101613700 1 --2- 172.21.15.156:0/3625248383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0fc1300a0 0x7ff0fc1c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.615+0000 7ff101613700 1 -- 172.21.15.156:0/3625248383 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f0009550 con 0x7ff0fc133ad0 2023-09-30T22:25:45.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.615+0000 7ff100e12700 1 --2- 172.21.15.156:0/3625248383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0fc1300a0 0x7ff0fc1c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:45.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.615+0000 7ff0fbfff700 1 --2- 172.21.15.156:0/3625248383 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0fc1309f0 0x7ff0fc1c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:45.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.616+0000 7ff101613700 1 --2- 172.21.15.156:0/3625248383 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0fc133ad0 0x7ff0fc1c91d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7ff0f400cbe0 tx=0x7ff0f400cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:45.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.616+0000 7ff0f97fa700 1 -- 172.21.15.156:0/3625248383 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f400aa40 con 0x7ff0fc133ad0 2023-09-30T22:25:45.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.616+0000 7ff0f97fa700 1 -- 172.21.15.156:0/3625248383 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f400abc0 con 0x7ff0fc133ad0 2023-09-30T22:25:45.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.616+0000 7ff0f97fa700 1 -- 172.21.15.156:0/3625248383 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f40070d0 con 0x7ff0fc133ad0 2023-09-30T22:25:45.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.616+0000 7ff103076700 1 -- 172.21.15.156:0/3625248383 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e80094a0 con 0x7ff0fc133ad0 2023-09-30T22:25:45.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.616+0000 7ff103076700 1 -- 172.21.15.156:0/3625248383 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0fc11ff40 con 0x7ff0fc133ad0 2023-09-30T22:25:45.621 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.617+0000 7ff0f97fa700 1 -- 172.21.15.156:0/3625248383 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff0f4007230 con 0x7ff0fc133ad0 2023-09-30T22:25:45.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.617+0000 7ff103076700 1 -- 172.21.15.156:0/3625248383 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0fc04f2a0 con 0x7ff0fc133ad0 2023-09-30T22:25:45.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.617+0000 7ff0f97fa700 1 -- 172.21.15.156:0/3625248383 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff0f403f060 con 0x7ff0fc133ad0 2023-09-30T22:25:45.622 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.622+0000 7ff0f97fa700 1 -- 172.21.15.156:0/3625248383 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0f40074e0 con 0x7ff0fc133ad0 2023-09-30T22:25:45.637 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:45.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.726+0000 7f4ab7431700 1 Processor -- start 2023-09-30T22:25:45.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.726+0000 7f4ab7431700 1 -- start start 2023-09-30T22:25:45.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.727+0000 7f4ab7431700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ab0133ad0 0x7f4ab0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.727+0000 7f4ab7431700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ab0130bc0 0x7f4ab013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.727+0000 7f4ab7431700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab006b2d0 con 0x7f4ab01300a0 2023-09-30T22:25:45.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.727+0000 7f4ab7431700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab0133610 con 0x7f4ab0130bc0 2023-09-30T22:25:45.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.727+0000 7f4ab7431700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab009a500 con 0x7f4ab0133ad0 2023-09-30T22:25:45.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.727+0000 7f4ab49cc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4ab01300a0 0x7f4ab01304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:43866/0 (socket says 172.21.15.156:43866) 2023-09-30T22:25:45.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.727+0000 7f4ab49cc700 1 -- 172.21.15.156:0/3764134212 learned_addr learned my addr 172.21.15.156:0/3764134212 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:45.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.727+0000 7f4ab59ce700 1 --2- 172.21.15.156:0/3764134212 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ab0130bc0 0x7f4ab013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.727+0000 7f4ab51cd700 1 --2- 172.21.15.156:0/3764134212 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ab0133ad0 0x7f4ab0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.727+0000 7f4aa7fff700 1 -- 172.21.15.156:0/3764134212 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431346315 0 0) 0x7f4ab006b2d0 con 0x7f4ab01300a0 2023-09-30T22:25:45.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.727+0000 7f4ab59ce700 1 -- 172.21.15.156:0/3764134212 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ab0133ad0 msgr2=0x7f4ab0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:45.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.727+0000 7f4ab59ce700 1 --2- 172.21.15.156:0/3764134212 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ab0133ad0 0x7f4ab0133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.727+0000 7f4ab59ce700 1 -- 172.21.15.156:0/3764134212 >> v1:172.21.15.156:6789/0 conn(0x7f4ab01300a0 legacy=0x7f4ab01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.728+0000 7f4ab59ce700 1 -- 172.21.15.156:0/3764134212 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab01338b0 con 0x7f4ab0130bc0 2023-09-30T22:25:45.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.728+0000 7f4ab59ce700 1 --2- 172.21.15.156:0/3764134212 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ab0130bc0 0x7f4ab013b990 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8009dc0 tx=0x7f4aa800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d8183c5cde0d657 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:45.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.728+0000 7f4aa7fff700 1 -- 172.21.15.156:0/3764134212 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa800e070 con 0x7f4ab0130bc0 2023-09-30T22:25:45.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.728+0000 7f4aa7fff700 1 -- 172.21.15.156:0/3764134212 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa800bb20 con 0x7f4ab0130bc0 2023-09-30T22:25:45.730 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.728+0000 7f4aa7fff700 1 -- 172.21.15.156:0/3764134212 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8012430 con 0x7f4ab0130bc0 2023-09-30T22:25:45.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.729+0000 7f4ab7431700 1 -- 172.21.15.156:0/3764134212 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ab0130bc0 msgr2=0x7f4ab013b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.729+0000 7f4ab7431700 1 --2- 172.21.15.156:0/3764134212 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ab0130bc0 0x7f4ab013b990 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8009dc0 tx=0x7f4aa800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:45.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.729+0000 7f4ab7431700 1 -- 172.21.15.156:0/3764134212 shutdown_connections 2023-09-30T22:25:45.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.729+0000 7f4ab7431700 1 --2- 172.21.15.156:0/3764134212 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ab0130bc0 0x7f4ab013b990 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.729+0000 7f4ab7431700 1 --2- 172.21.15.156:0/3764134212 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ab0133ad0 0x7f4ab0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.729+0000 7f4ab7431700 1 -- 172.21.15.156:0/3764134212 >> 172.21.15.156:0/3764134212 conn(0x7f4ab0099c40 msgr2=0x7f4ab00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:45.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.729+0000 7f4ab7431700 1 -- 172.21.15.156:0/3764134212 shutdown_connections 2023-09-30T22:25:45.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.729+0000 7f4ab7431700 1 -- 172.21.15.156:0/3764134212 wait complete. 2023-09-30T22:25:45.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.730+0000 7f4ab7431700 1 Processor -- start 2023-09-30T22:25:45.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.730+0000 7f4ab7431700 1 -- start start 2023-09-30T22:25:45.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.731+0000 7f4ab7431700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ab01300a0 0x7f4ab011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.731+0000 7f4ab7431700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ab0130bc0 0x7f4ab011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.731+0000 7f4ab7431700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ab0133ad0 0x7f4ab011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.731+0000 7f4ab7431700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab0120bb0 con 0x7f4ab0133ad0 2023-09-30T22:25:45.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.731+0000 7f4ab7431700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab00721f0 con 0x7f4ab01300a0 2023-09-30T22:25:45.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.731+0000 7f4ab7431700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab011fc10 con 0x7f4ab0130bc0 2023-09-30T22:25:45.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.731+0000 7f4ab51cd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ab01300a0 0x7f4ab011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.731+0000 7f4ab51cd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ab01300a0 0x7f4ab011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40240/0 (socket says 172.21.15.156:40240) 2023-09-30T22:25:45.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.731+0000 7f4ab51cd700 1 -- 172.21.15.156:0/825415293 learned_addr learned my addr 172.21.15.156:0/825415293 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:45.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.731+0000 7f4ab59ce700 1 --2- 172.21.15.156:0/825415293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ab0133ad0 0x7f4ab011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.731+0000 7f4ab49cc700 1 --2- 172.21.15.156:0/825415293 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ab0130bc0 0x7f4ab011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.731+0000 7f4ab51cd700 1 -- 172.21.15.156:0/825415293 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ab0130bc0 msgr2=0x7f4ab011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.731+0000 7f4ab51cd700 1 --2- 172.21.15.156:0/825415293 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ab0130bc0 0x7f4ab011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.731+0000 7f4ab51cd700 1 -- 172.21.15.156:0/825415293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ab0133ad0 msgr2=0x7f4ab011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.731+0000 7f4ab51cd700 1 --2- 172.21.15.156:0/825415293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ab0133ad0 0x7f4ab011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.731+0000 7f4ab51cd700 1 -- 172.21.15.156:0/825415293 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa8009a70 con 0x7f4ab01300a0 2023-09-30T22:25:45.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.732+0000 7f4ab51cd700 1 --2- 172.21.15.156:0/825415293 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ab01300a0 0x7f4ab011da40 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f4aac00e9b0 tx=0x7f4aac00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:45.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.732+0000 7f4aa5ffb700 1 -- 172.21.15.156:0/825415293 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac009710 con 0x7f4ab01300a0 2023-09-30T22:25:45.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.732+0000 7f4ab7431700 1 -- 172.21.15.156:0/825415293 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab012d220 con 0x7f4ab01300a0 2023-09-30T22:25:45.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.732+0000 7f4aa5ffb700 1 -- 172.21.15.156:0/825415293 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aac00ee50 con 0x7f4ab01300a0 2023-09-30T22:25:45.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.732+0000 7f4aa5ffb700 1 -- 172.21.15.156:0/825415293 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac00ca50 con 0x7f4ab01300a0 2023-09-30T22:25:45.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.732+0000 7f4ab7431700 1 -- 172.21.15.156:0/825415293 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab012f6f0 con 0x7f4ab01300a0 2023-09-30T22:25:45.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.733+0000 7f4aa5ffb700 1 -- 172.21.15.156:0/825415293 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4aac00cbb0 con 0x7f4ab01300a0 2023-09-30T22:25:45.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.733+0000 7f4ab7431700 1 -- 172.21.15.156:0/825415293 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab006be10 con 0x7f4ab01300a0 2023-09-30T22:25:45.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.733+0000 7f4aa5ffb700 1 -- 172.21.15.156:0/825415293 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4aac013990 con 0x7f4ab01300a0 2023-09-30T22:25:45.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.742+0000 7f4aa5ffb700 1 -- 172.21.15.156:0/825415293 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4aac0102b0 con 0x7f4ab01300a0 2023-09-30T22:25:45.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.748+0000 7f6026314700 1 Processor -- start 2023-09-30T22:25:45.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.748+0000 7f6026314700 1 -- start start 2023-09-30T22:25:45.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.748+0000 7f6026314700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f602009e340 0x7f60201359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.748+0000 7f6026314700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6020135f20 0x7f6020138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.748+0000 7f6026314700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602009aaa0 con 0x7f602009d860 2023-09-30T22:25:45.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.748+0000 7f6026314700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602009e730 con 0x7f602009e340 2023-09-30T22:25:45.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.748+0000 7f6026314700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f602009f870 con 0x7f6020135f20 2023-09-30T22:25:45.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.748+0000 7f601f7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f602009e340 0x7f60201359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.748+0000 7f601ffff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f602009d860 0x7f602009dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:43876/0 (socket says 172.21.15.156:43876) 2023-09-30T22:25:45.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.748+0000 7f601ffff700 1 -- 172.21.15.156:0/3054091993 learned_addr learned my addr 172.21.15.156:0/3054091993 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:45.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.748+0000 7f60248b1700 1 --2- 172.21.15.156:0/3054091993 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6020135f20 0x7f6020138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.749+0000 7f601effd700 1 -- 172.21.15.156:0/3054091993 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913022781 0 0) 0x7f602009aaa0 con 0x7f602009d860 2023-09-30T22:25:45.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.749+0000 7f601f7fe700 1 -- 172.21.15.156:0/3054091993 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6020135f20 msgr2=0x7f6020138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:45.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.749+0000 7f601f7fe700 1 --2- 172.21.15.156:0/3054091993 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6020135f20 0x7f6020138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.749+0000 7f601f7fe700 1 -- 172.21.15.156:0/3054091993 >> v1:172.21.15.156:6789/0 conn(0x7f602009d860 legacy=0x7f602009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.749+0000 7f601f7fe700 1 -- 172.21.15.156:0/3054091993 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602009b360 con 0x7f602009e340 2023-09-30T22:25:45.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.749+0000 7f601f7fe700 1 --2- 172.21.15.156:0/3054091993 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f602009e340 0x7f60201359e0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f6014009840 tx=0x7f6014009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af9ef41b1af52ff server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:45.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.749+0000 7f601effd700 1 -- 172.21.15.156:0/3054091993 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014011830 con 0x7f602009e340 2023-09-30T22:25:45.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.749+0000 7f601effd700 1 -- 172.21.15.156:0/3054091993 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6014011990 con 0x7f602009e340 2023-09-30T22:25:45.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.749+0000 7f601effd700 1 -- 172.21.15.156:0/3054091993 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014011d20 con 0x7f602009e340 2023-09-30T22:25:45.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.750+0000 7f6026314700 1 -- 172.21.15.156:0/3054091993 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f602009e340 msgr2=0x7f60201359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.750+0000 7f6026314700 1 --2- 172.21.15.156:0/3054091993 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f602009e340 0x7f60201359e0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f6014009840 tx=0x7f6014009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:45.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.750+0000 7f6026314700 1 -- 172.21.15.156:0/3054091993 shutdown_connections 2023-09-30T22:25:45.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.750+0000 7f6026314700 1 --2- 172.21.15.156:0/3054091993 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6020135f20 0x7f6020138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.750+0000 7f6026314700 1 --2- 172.21.15.156:0/3054091993 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f602009e340 0x7f60201359e0 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.750+0000 7f6026314700 1 -- 172.21.15.156:0/3054091993 >> 172.21.15.156:0/3054091993 conn(0x7f6020099c40 msgr2=0x7f60200a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:45.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.750+0000 7f6026314700 1 -- 172.21.15.156:0/3054091993 shutdown_connections 2023-09-30T22:25:45.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.750+0000 7f6026314700 1 -- 172.21.15.156:0/3054091993 wait complete. 2023-09-30T22:25:45.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.752+0000 7f6026314700 1 Processor -- start 2023-09-30T22:25:45.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.752+0000 7f6026314700 1 -- start start 2023-09-30T22:25:45.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.753+0000 7f6026314700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f602009d860 0x7f602011b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.753+0000 7f6026314700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f602009e340 0x7f602011bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.753+0000 7f6026314700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6020135f20 0x7f602011c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.753+0000 7f6026314700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6020130e80 con 0x7f6020135f20 2023-09-30T22:25:45.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.753+0000 7f6026314700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602011d790 con 0x7f602009d860 2023-09-30T22:25:45.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.753+0000 7f6026314700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f602011d270 con 0x7f602009e340 2023-09-30T22:25:45.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.753+0000 7f60248b1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6020135f20 0x7f602011c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.753+0000 7f60248b1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6020135f20 0x7f602011c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:56106/0 (socket says 172.21.15.156:56106) 2023-09-30T22:25:45.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.753+0000 7f60248b1700 1 -- 172.21.15.156:0/1679691086 learned_addr learned my addr 172.21.15.156:0/1679691086 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:45.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.753+0000 7f601f7fe700 1 --2- 172.21.15.156:0/1679691086 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f602009e340 0x7f602011bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.753+0000 7f60248b1700 1 -- 172.21.15.156:0/1679691086 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f602009e340 msgr2=0x7f602011bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.753+0000 7f60248b1700 1 --2- 172.21.15.156:0/1679691086 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f602009e340 0x7f602011bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.753+0000 7f60248b1700 1 -- 172.21.15.156:0/1679691086 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f602009d860 msgr2=0x7f602011b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.753+0000 7f60248b1700 1 --2- 172.21.15.156:0/1679691086 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f602009d860 0x7f602011b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.753+0000 7f60248b1700 1 -- 172.21.15.156:0/1679691086 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60140094a0 con 0x7f6020135f20 2023-09-30T22:25:45.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.754+0000 7f60248b1700 1 --2- 172.21.15.156:0/1679691086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6020135f20 0x7f602011c070 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f601800efc0 tx=0x7f601800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:45.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.754+0000 7f601cff9700 1 -- 172.21.15.156:0/1679691086 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601800cce0 con 0x7f6020135f20 2023-09-30T22:25:45.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.754+0000 7f601cff9700 1 -- 172.21.15.156:0/1679691086 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601800f040 con 0x7f6020135f20 2023-09-30T22:25:45.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.754+0000 7f601cff9700 1 -- 172.21.15.156:0/1679691086 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018014480 con 0x7f6020135f20 2023-09-30T22:25:45.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.754+0000 7f6026314700 1 -- 172.21.15.156:0/1679691086 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602011ed90 con 0x7f6020135f20 2023-09-30T22:25:45.757 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.754+0000 7f6026314700 1 -- 172.21.15.156:0/1679691086 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f602011d950 con 0x7f6020135f20 2023-09-30T22:25:45.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.755+0000 7f601cff9700 1 -- 172.21.15.156:0/1679691086 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f60180145e0 con 0x7f6020135f20 2023-09-30T22:25:45.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.755+0000 7f6026314700 1 -- 172.21.15.156:0/1679691086 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602011f8c0 con 0x7f6020135f20 2023-09-30T22:25:45.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.755+0000 7f601cff9700 1 -- 172.21.15.156:0/1679691086 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6018040350 con 0x7f6020135f20 2023-09-30T22:25:45.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.760+0000 7f601cff9700 1 -- 172.21.15.156:0/1679691086 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6018018020 con 0x7f6020135f20 2023-09-30T22:25:45.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.792+0000 7fe435067700 1 Processor -- start 2023-09-30T22:25:45.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.792+0000 7fe435067700 1 -- start start 2023-09-30T22:25:45.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.793+0000 7fe435067700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe4300a0a70 0x7fe4300a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.793+0000 7fe435067700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4300a1380 0x7fe430133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.793+0000 7fe435067700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe430133f50 0x7fe4301343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.793+0000 7fe435067700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe43009e9d0 con 0x7fe4300a0a70 2023-09-30T22:25:45.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.793+0000 7fe435067700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43009dc00 con 0x7fe430133f50 2023-09-30T22:25:45.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.793+0000 7fe435067700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe43009dec0 con 0x7fe4300a1380 2023-09-30T22:25:45.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.793+0000 7fe42ed9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe4300a0a70 0x7fe4300a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.793+0000 7fe42f59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe430133f50 0x7fe4301343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.793+0000 7fe42ed9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe4300a0a70 0x7fe4300a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:56112/0 (socket says 172.21.15.156:56112) 2023-09-30T22:25:45.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.793+0000 7fe42ed9d700 1 -- 172.21.15.156:0/600262909 learned_addr learned my addr 172.21.15.156:0/600262909 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:45.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.793+0000 7fe42f59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe430133f50 0x7fe4301343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40268/0 (socket says 172.21.15.156:40268) 2023-09-30T22:25:45.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.793+0000 7fe42f59e700 1 -- 172.21.15.156:0/600262909 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4300a1380 msgr2=0x7fe430133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:45.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.793+0000 7fe42f59e700 1 --2- 172.21.15.156:0/600262909 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4300a1380 0x7fe430133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.793+0000 7fe42f59e700 1 -- 172.21.15.156:0/600262909 >> v2:172.21.15.156:3300/0 conn(0x7fe4300a0a70 msgr2=0x7fe4300a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:45.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.793+0000 7fe42f59e700 1 --2- 172.21.15.156:0/600262909 >> v2:172.21.15.156:3300/0 conn(0x7fe4300a0a70 0x7fe4300a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.793+0000 7fe42f59e700 1 -- 172.21.15.156:0/600262909 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43009e6a0 con 0x7fe430133f50 2023-09-30T22:25:45.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.793+0000 7fe42ed9d700 1 --2- 172.21.15.156:0/600262909 >> v2:172.21.15.156:3300/0 conn(0x7fe4300a0a70 0x7fe4300a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:45.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.793+0000 7fe42f59e700 1 --2- 172.21.15.156:0/600262909 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe430133f50 0x7fe4301343b0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fe428009d90 tx=0x7fe42800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfb87c23f2ddb3f7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:45.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.794+0000 7fe42dd9b700 1 -- 172.21.15.156:0/600262909 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42800e070 con 0x7fe430133f50 2023-09-30T22:25:45.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.794+0000 7fe42dd9b700 1 -- 172.21.15.156:0/600262909 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42800bb20 con 0x7fe430133f50 2023-09-30T22:25:45.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.794+0000 7fe42dd9b700 1 -- 172.21.15.156:0/600262909 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe428012430 con 0x7fe430133f50 2023-09-30T22:25:45.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.794+0000 7fe435067700 1 -- 172.21.15.156:0/600262909 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe430133f50 msgr2=0x7fe4301343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.794+0000 7fe435067700 1 --2- 172.21.15.156:0/600262909 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe430133f50 0x7fe4301343b0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fe428009d90 tx=0x7fe42800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:45.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.794+0000 7fe435067700 1 -- 172.21.15.156:0/600262909 shutdown_connections 2023-09-30T22:25:45.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.794+0000 7fe435067700 1 --2- 172.21.15.156:0/600262909 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe430133f50 0x7fe4301343b0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.794+0000 7fe435067700 1 --2- 172.21.15.156:0/600262909 >> v2:172.21.15.156:3300/0 conn(0x7fe4300a0a70 0x7fe4300a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.794+0000 7fe435067700 1 --2- 172.21.15.156:0/600262909 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe4300a1380 0x7fe430133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.794+0000 7fe435067700 1 -- 172.21.15.156:0/600262909 >> 172.21.15.156:0/600262909 conn(0x7fe4300a6610 msgr2=0x7fe4300a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:45.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.794+0000 7fe435067700 1 -- 172.21.15.156:0/600262909 shutdown_connections 2023-09-30T22:25:45.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.794+0000 7fe435067700 1 -- 172.21.15.156:0/600262909 wait complete. 2023-09-30T22:25:45.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.795+0000 7fe435067700 1 Processor -- start 2023-09-30T22:25:45.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.796+0000 7fe435067700 1 -- start start 2023-09-30T22:25:45.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.796+0000 7fe435067700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4300a0a70 0x7fe43011f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.796+0000 7fe435067700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4300a1380 0x7fe43011fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.796+0000 7fe435067700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe430133f50 0x7fe430120210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.796+0000 7fe435067700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe430123100 con 0x7fe4300a0a70 2023-09-30T22:25:45.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.796+0000 7fe435067700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe430121a80 con 0x7fe4300a1380 2023-09-30T22:25:45.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.796+0000 7fe435067700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe430121210 con 0x7fe430133f50 2023-09-30T22:25:45.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.796+0000 7fe42e59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4300a1380 0x7fe43011fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.796+0000 7fe42e59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4300a1380 0x7fe43011fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40278/0 (socket says 172.21.15.156:40278) 2023-09-30T22:25:45.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.796+0000 7fe42e59c700 1 -- 172.21.15.156:0/2149776282 learned_addr learned my addr 172.21.15.156:0/2149776282 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:45.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.796+0000 7fe42ed9d700 1 --2- 172.21.15.156:0/2149776282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4300a0a70 0x7fe43011f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.796+0000 7fe42f59e700 1 --2- 172.21.15.156:0/2149776282 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe430133f50 0x7fe430120210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.796+0000 7fe42ed9d700 1 -- 172.21.15.156:0/2149776282 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe430133f50 msgr2=0x7fe430120210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.796+0000 7fe42ed9d700 1 --2- 172.21.15.156:0/2149776282 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe430133f50 0x7fe430120210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.796+0000 7fe42ed9d700 1 -- 172.21.15.156:0/2149776282 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4300a1380 msgr2=0x7fe43011fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.796+0000 7fe42ed9d700 1 --2- 172.21.15.156:0/2149776282 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4300a1380 0x7fe43011fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.796+0000 7fe42ed9d700 1 -- 172.21.15.156:0/2149776282 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe420009550 con 0x7fe4300a0a70 2023-09-30T22:25:45.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.797+0000 7fe42ed9d700 1 --2- 172.21.15.156:0/2149776282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4300a0a70 0x7fe43011f790 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fe42000e9a0 tx=0x7fe42000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:45.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.797+0000 7fe4177fe700 1 -- 172.21.15.156:0/2149776282 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe420004030 con 0x7fe4300a0a70 2023-09-30T22:25:45.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.797+0000 7fe4177fe700 1 -- 172.21.15.156:0/2149776282 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe420004190 con 0x7fe4300a0a70 2023-09-30T22:25:45.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.797+0000 7fe435067700 1 -- 172.21.15.156:0/2149776282 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe428009a70 con 0x7fe4300a0a70 2023-09-30T22:25:45.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.797+0000 7fe4177fe700 1 -- 172.21.15.156:0/2149776282 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe420004500 con 0x7fe4300a0a70 2023-09-30T22:25:45.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.797+0000 7fe435067700 1 -- 172.21.15.156:0/2149776282 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe430130530 con 0x7fe4300a0a70 2023-09-30T22:25:45.803 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.798+0000 7fe435067700 1 -- 172.21.15.156:0/2149776282 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4300a43a0 con 0x7fe4300a0a70 2023-09-30T22:25:45.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.798+0000 7fe4177fe700 1 -- 172.21.15.156:0/2149776282 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe42000c7f0 con 0x7fe4300a0a70 2023-09-30T22:25:45.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.798+0000 7fe4177fe700 1 -- 172.21.15.156:0/2149776282 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe42003f660 con 0x7fe4300a0a70 2023-09-30T22:25:45.804 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.803+0000 7fe4177fe700 1 -- 172.21.15.156:0/2149776282 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4200036a0 con 0x7fe4300a0a70 2023-09-30T22:25:45.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.837+0000 7ff103076700 1 -- 172.21.15.156:0/3625248383 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff0fc12f540 con 0x7ff0fc133ad0 2023-09-30T22:25:45.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.837+0000 7ff0f97fa700 1 -- 172.21.15.156:0/3625248383 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff0f4018020 con 0x7ff0fc133ad0 2023-09-30T22:25:45.838 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:45.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.840+0000 7ff103076700 1 -- 172.21.15.156:0/3625248383 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0fc133ad0 msgr2=0x7ff0fc1c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.840+0000 7ff103076700 1 --2- 172.21.15.156:0/3625248383 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0fc133ad0 0x7ff0fc1c91d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7ff0f400cbe0 tx=0x7ff0f400cef0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.840+0000 7ff103076700 1 -- 172.21.15.156:0/3625248383 shutdown_connections 2023-09-30T22:25:45.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.840+0000 7ff103076700 1 --2- 172.21.15.156:0/3625248383 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff0fc133ad0 0x7ff0fc1c91d0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.840+0000 7ff103076700 1 --2- 172.21.15.156:0/3625248383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0fc1300a0 0x7ff0fc1c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.840+0000 7ff103076700 1 --2- 172.21.15.156:0/3625248383 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff0fc1309f0 0x7ff0fc1c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.840+0000 7ff103076700 1 -- 172.21.15.156:0/3625248383 >> 172.21.15.156:0/3625248383 conn(0x7ff0fc099c40 msgr2=0x7ff0fc132a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:45.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.840+0000 7ff103076700 1 -- 172.21.15.156:0/3625248383 shutdown_connections 2023-09-30T22:25:45.841 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.840+0000 7ff103076700 1 -- 172.21.15.156:0/3625248383 wait complete. 2023-09-30T22:25:45.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:45.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.973+0000 7f4ab7431700 1 -- 172.21.15.156:0/825415293 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4ab012dd60 con 0x7f4ab01300a0 2023-09-30T22:25:45.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.974+0000 7f4aa5ffb700 1 -- 172.21.15.156:0/825415293 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4aac01ae80 con 0x7f4ab01300a0 2023-09-30T22:25:45.975 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:45.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.976+0000 7f4ab7431700 1 -- 172.21.15.156:0/825415293 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ab01300a0 msgr2=0x7f4ab011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.976+0000 7f4ab7431700 1 --2- 172.21.15.156:0/825415293 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ab01300a0 0x7f4ab011da40 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f4aac00e9b0 tx=0x7f4aac00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.976+0000 7f4ab7431700 1 -- 172.21.15.156:0/825415293 shutdown_connections 2023-09-30T22:25:45.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.976+0000 7f4ab7431700 1 --2- 172.21.15.156:0/825415293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ab0133ad0 0x7f4ab011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.976+0000 7f4ab7431700 1 --2- 172.21.15.156:0/825415293 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ab01300a0 0x7f4ab011da40 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.976+0000 7f4ab7431700 1 --2- 172.21.15.156:0/825415293 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ab0130bc0 0x7f4ab011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.976+0000 7f4ab7431700 1 -- 172.21.15.156:0/825415293 >> 172.21.15.156:0/825415293 conn(0x7f4ab0099c40 msgr2=0x7f4ab012e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:45.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.976+0000 7f4ab7431700 1 -- 172.21.15.156:0/825415293 shutdown_connections 2023-09-30T22:25:45.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.976+0000 7f4ab7431700 1 -- 172.21.15.156:0/825415293 wait complete. 2023-09-30T22:25:45.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:45.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.988+0000 7f6026314700 1 -- 172.21.15.156:0/1679691086 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f602011ea00 con 0x7f6020135f20 2023-09-30T22:25:45.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.989+0000 7f601cff9700 1 -- 172.21.15.156:0/1679691086 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f601802b090 con 0x7f6020135f20 2023-09-30T22:25:45.989 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:45.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.991+0000 7f6026314700 1 -- 172.21.15.156:0/1679691086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6020135f20 msgr2=0x7f602011c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.991+0000 7f6026314700 1 --2- 172.21.15.156:0/1679691086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6020135f20 0x7f602011c070 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f601800efc0 tx=0x7f601800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.991+0000 7f6026314700 1 -- 172.21.15.156:0/1679691086 shutdown_connections 2023-09-30T22:25:45.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.991+0000 7f6026314700 1 --2- 172.21.15.156:0/1679691086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6020135f20 0x7f602011c070 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.991+0000 7f6026314700 1 --2- 172.21.15.156:0/1679691086 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f602009d860 0x7f602011b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.991+0000 7f6026314700 1 --2- 172.21.15.156:0/1679691086 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f602009e340 0x7f602011bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.991+0000 7f6026314700 1 -- 172.21.15.156:0/1679691086 >> 172.21.15.156:0/1679691086 conn(0x7f6020099c40 msgr2=0x7f6020133940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:45.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.991+0000 7f6026314700 1 -- 172.21.15.156:0/1679691086 shutdown_connections 2023-09-30T22:25:45.992 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:45.991+0000 7f6026314700 1 -- 172.21.15.156:0/1679691086 wait complete. 2023-09-30T22:25:46.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:46.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.006+0000 7fe435067700 1 -- 172.21.15.156:0/2149776282 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe43004f2a0 con 0x7fe4300a0a70 2023-09-30T22:25:46.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.006+0000 7fe4177fe700 1 -- 172.21.15.156:0/2149776282 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe420013e60 con 0x7fe4300a0a70 2023-09-30T22:25:46.007 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:46.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.008+0000 7fe435067700 1 -- 172.21.15.156:0/2149776282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4300a0a70 msgr2=0x7fe43011f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.008+0000 7fe435067700 1 --2- 172.21.15.156:0/2149776282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4300a0a70 0x7fe43011f790 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fe42000e9a0 tx=0x7fe42000ecb0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.008+0000 7fe435067700 1 -- 172.21.15.156:0/2149776282 shutdown_connections 2023-09-30T22:25:46.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.008+0000 7fe435067700 1 --2- 172.21.15.156:0/2149776282 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe430133f50 0x7fe430120210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.008+0000 7fe435067700 1 --2- 172.21.15.156:0/2149776282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4300a0a70 0x7fe43011f790 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.008+0000 7fe435067700 1 --2- 172.21.15.156:0/2149776282 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe4300a1380 0x7fe43011fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.008+0000 7fe435067700 1 -- 172.21.15.156:0/2149776282 >> 172.21.15.156:0/2149776282 conn(0x7fe4300a6610 msgr2=0x7fe43009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:46.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.008+0000 7fe435067700 1 -- 172.21.15.156:0/2149776282 shutdown_connections 2023-09-30T22:25:46.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.008+0000 7fe435067700 1 -- 172.21.15.156:0/2149776282 wait complete. 2023-09-30T22:25:46.021 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:46.859 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:46.990 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:46.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.994+0000 7fc7d0328700 1 Processor -- start 2023-09-30T22:25:46.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.995+0000 7fc7d0328700 1 -- start start 2023-09-30T22:25:46.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.995+0000 7fc7d0328700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc7c809d860 0x7fc7c809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.996+0000 7fc7d0328700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7c8130eb0 0x7fc7c8138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.996+0000 7fc7d0328700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c809aaa0 con 0x7fc7c809e170 2023-09-30T22:25:46.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.996+0000 7fc7d0328700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c809f870 con 0x7fc7c809d860 2023-09-30T22:25:46.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.996+0000 7fc7d0328700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c809b360 con 0x7fc7c8130eb0 2023-09-30T22:25:46.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.996+0000 7fc7ce8c5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7c8130eb0 0x7fc7c8138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.996+0000 7fc7ce0c4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc7c809d860 0x7fc7c809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.996+0000 7fc7cd8c3700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc7c809e170 0x7fc7c81307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:43886/0 (socket says 172.21.15.156:43886) 2023-09-30T22:25:46.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.996+0000 7fc7ce8c5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7c8130eb0 0x7fc7c8138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46306/0 (socket says 172.21.15.156:46306) 2023-09-30T22:25:46.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.996+0000 7fc7cd8c3700 1 -- 172.21.15.156:0/4274274713 learned_addr learned my addr 172.21.15.156:0/4274274713 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:46.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.996+0000 7fc7cd0c2700 1 -- 172.21.15.156:0/4274274713 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161401258 0 0) 0x7fc7c809aaa0 con 0x7fc7c809e170 2023-09-30T22:25:46.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.996+0000 7fc7cd0c2700 1 -- 172.21.15.156:0/4274274713 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7b40035b0 con 0x7fc7c809e170 2023-09-30T22:25:46.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.996+0000 7fc7ce0c4700 1 -- 172.21.15.156:0/4274274713 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7c8130eb0 msgr2=0x7fc7c8138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:46.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.996+0000 7fc7ce0c4700 1 --2- 172.21.15.156:0/4274274713 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7c8130eb0 0x7fc7c8138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.996+0000 7fc7ce0c4700 1 -- 172.21.15.156:0/4274274713 >> v1:172.21.15.156:6789/0 conn(0x7fc7c809e170 legacy=0x7fc7c81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.996+0000 7fc7ce0c4700 1 -- 172.21.15.156:0/4274274713 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c809b620 con 0x7fc7c809d860 2023-09-30T22:25:46.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.996+0000 7fc7ce8c5700 1 --2- 172.21.15.156:0/4274274713 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7c8130eb0 0x7fc7c8138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:46.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.996+0000 7fc7ce0c4700 1 --2- 172.21.15.156:0/4274274713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7c809d860 0x7fc7c809dc30 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009840 tx=0x7fc7c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd5286e1f4e4794f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:46.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.996+0000 7fc7cd0c2700 1 -- 172.21.15.156:0/4274274713 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4011830 con 0x7fc7c809d860 2023-09-30T22:25:47.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.996+0000 7fc7cd0c2700 1 -- 172.21.15.156:0/4274274713 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c4011990 con 0x7fc7c809d860 2023-09-30T22:25:47.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.996+0000 7fc7cd0c2700 1 -- 172.21.15.156:0/4274274713 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4011d20 con 0x7fc7c809d860 2023-09-30T22:25:47.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.997+0000 7fc7d0328700 1 -- 172.21.15.156:0/4274274713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7c809d860 msgr2=0x7fc7c809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:47.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.997+0000 7fc7d0328700 1 --2- 172.21.15.156:0/4274274713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7c809d860 0x7fc7c809dc30 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009840 tx=0x7fc7c4009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:47.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.997+0000 7fc7d0328700 1 -- 172.21.15.156:0/4274274713 shutdown_connections 2023-09-30T22:25:47.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.997+0000 7fc7d0328700 1 --2- 172.21.15.156:0/4274274713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7c809d860 0x7fc7c809dc30 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.997+0000 7fc7d0328700 1 --2- 172.21.15.156:0/4274274713 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7c8130eb0 0x7fc7c8138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.997+0000 7fc7d0328700 1 -- 172.21.15.156:0/4274274713 >> 172.21.15.156:0/4274274713 conn(0x7fc7c8099c40 msgr2=0x7fc7c80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:47.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.997+0000 7fc7d0328700 1 -- 172.21.15.156:0/4274274713 shutdown_connections 2023-09-30T22:25:47.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.997+0000 7fc7d0328700 1 -- 172.21.15.156:0/4274274713 wait complete. 2023-09-30T22:25:47.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.998+0000 7fc7d0328700 1 Processor -- start 2023-09-30T22:25:47.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.999+0000 7fc7d0328700 1 -- start start 2023-09-30T22:25:47.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.999+0000 7fc7d0328700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7c809d860 0x7fc7c811e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:47.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.999+0000 7fc7d0328700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7c809e170 0x7fc7c811e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:47.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.999+0000 7fc7d0328700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7c8130eb0 0x7fc7c811ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:47.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.999+0000 7fc7d0328700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c8120470 con 0x7fc7c809d860 2023-09-30T22:25:47.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.999+0000 7fc7d0328700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c8072820 con 0x7fc7c8130eb0 2023-09-30T22:25:47.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.999+0000 7fc7d0328700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c8121560 con 0x7fc7c809e170 2023-09-30T22:25:47.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.999+0000 7fc7ce0c4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7c809d860 0x7fc7c811e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:47.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.999+0000 7fc7ce8c5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7c8130eb0 0x7fc7c811ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:47.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.999+0000 7fc7ce0c4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7c809d860 0x7fc7c811e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:56128/0 (socket says 172.21.15.156:56128) 2023-09-30T22:25:47.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.999+0000 7fc7ce0c4700 1 -- 172.21.15.156:0/1383037213 learned_addr learned my addr 172.21.15.156:0/1383037213 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:47.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.999+0000 7fc7ce8c5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7c8130eb0 0x7fc7c811ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40288/0 (socket says 172.21.15.156:40288) 2023-09-30T22:25:47.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:46.999+0000 7fc7cd8c3700 1 --2- 172.21.15.156:0/1383037213 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7c809e170 0x7fc7c811e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:47.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.000+0000 7fc7ce0c4700 1 -- 172.21.15.156:0/1383037213 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7c809e170 msgr2=0x7fc7c811e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:47.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.000+0000 7fc7ce0c4700 1 --2- 172.21.15.156:0/1383037213 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7c809e170 0x7fc7c811e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.000+0000 7fc7ce0c4700 1 -- 172.21.15.156:0/1383037213 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7c8130eb0 msgr2=0x7fc7c811ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:47.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.000+0000 7fc7ce0c4700 1 --2- 172.21.15.156:0/1383037213 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7c8130eb0 0x7fc7c811ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.000+0000 7fc7ce0c4700 1 -- 172.21.15.156:0/1383037213 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c000bc80 con 0x7fc7c809d860 2023-09-30T22:25:47.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.000+0000 7fc7ce0c4700 1 --2- 172.21.15.156:0/1383037213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7c809d860 0x7fc7c811e2b0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7fc7c40090b0 tx=0x7fc7c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:47.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.000+0000 7fc7beffd700 1 -- 172.21.15.156:0/1383037213 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4004550 con 0x7fc7c809d860 2023-09-30T22:25:47.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.000+0000 7fc7beffd700 1 -- 172.21.15.156:0/1383037213 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c401f070 con 0x7fc7c809d860 2023-09-30T22:25:47.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.000+0000 7fc7beffd700 1 -- 172.21.15.156:0/1383037213 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c40038e0 con 0x7fc7c809d860 2023-09-30T22:25:47.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.000+0000 7fc7d0328700 1 -- 172.21.15.156:0/1383037213 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c40094a0 con 0x7fc7c809d860 2023-09-30T22:25:47.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.000+0000 7fc7d0328700 1 -- 172.21.15.156:0/1383037213 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c8122560 con 0x7fc7c809d860 2023-09-30T22:25:47.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.001+0000 7fc7d0328700 1 -- 172.21.15.156:0/1383037213 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c8121730 con 0x7fc7c809d860 2023-09-30T22:25:47.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.002+0000 7fc7beffd700 1 -- 172.21.15.156:0/1383037213 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc7c4003a40 con 0x7fc7c809d860 2023-09-30T22:25:47.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.002+0000 7fc7beffd700 1 -- 172.21.15.156:0/1383037213 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc7c4021070 con 0x7fc7c809d860 2023-09-30T22:25:47.005 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:47.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.007+0000 7fc7beffd700 1 -- 172.21.15.156:0/1383037213 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc7c40193b0 con 0x7fc7c809d860 2023-09-30T22:25:47.021 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:47.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.122+0000 7f640ae61700 1 Processor -- start 2023-09-30T22:25:47.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.122+0000 7f640ae61700 1 -- start start 2023-09-30T22:25:47.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.123+0000 7f640ae61700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6404133660 0x7f6404135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:47.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.123+0000 7f640ae61700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6404135f80 0x7f6404138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:47.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.123+0000 7f640ae61700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6404099a60 con 0x7f6404099e20 2023-09-30T22:25:47.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.123+0000 7f640ae61700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f640409bf50 con 0x7f6404135f80 2023-09-30T22:25:47.124 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.123+0000 7f640ae61700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640409b230 con 0x7f6404133660 2023-09-30T22:25:47.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.123+0000 7f6403fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6404133660 0x7f6404135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:47.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.123+0000 7f6403fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6404133660 0x7f6404135a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40302/0 (socket says 172.21.15.156:40302) 2023-09-30T22:25:47.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.123+0000 7f6403fff700 1 -- 172.21.15.156:0/108210179 learned_addr learned my addr 172.21.15.156:0/108210179 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:47.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.123+0000 7f64093fe700 1 --2- 172.21.15.156:0/108210179 >> v2:172.21.15.156:3300/0 conn(0x7f6404135f80 0x7f6404138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:47.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.123+0000 7f6403fff700 1 -- 172.21.15.156:0/108210179 >> v2:172.21.15.156:3300/0 conn(0x7f6404135f80 msgr2=0x7f6404138360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:47.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.123+0000 7f6403fff700 1 --2- 172.21.15.156:0/108210179 >> v2:172.21.15.156:3300/0 conn(0x7f6404135f80 0x7f6404138360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.123+0000 7f6403fff700 1 -- 172.21.15.156:0/108210179 >> v1:172.21.15.156:6789/0 conn(0x7f6404099e20 legacy=0x7f640409a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:47.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.124+0000 7f6403fff700 1 -- 172.21.15.156:0/108210179 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640409bb90 con 0x7f6404133660 2023-09-30T22:25:47.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.124+0000 7f6403fff700 1 --2- 172.21.15.156:0/108210179 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6404133660 0x7f6404135a40 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f63f000bbc0 tx=0x7f63f000bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b67c2456c67dce86 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:47.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.124+0000 7f64037fe700 1 -- 172.21.15.156:0/108210179 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f000dc30 con 0x7f6404133660 2023-09-30T22:25:47.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.124+0000 7f64037fe700 1 -- 172.21.15.156:0/108210179 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f000dd90 con 0x7f6404133660 2023-09-30T22:25:47.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.124+0000 7f64037fe700 1 -- 172.21.15.156:0/108210179 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f0004250 con 0x7f6404133660 2023-09-30T22:25:47.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.125+0000 7f640ae61700 1 -- 172.21.15.156:0/108210179 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6404133660 msgr2=0x7f6404135a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:47.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.125+0000 7f640ae61700 1 --2- 172.21.15.156:0/108210179 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6404133660 0x7f6404135a40 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f63f000bbc0 tx=0x7f63f000bed0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.125+0000 7f640ae61700 1 -- 172.21.15.156:0/108210179 shutdown_connections 2023-09-30T22:25:47.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.125+0000 7f640ae61700 1 --2- 172.21.15.156:0/108210179 >> v2:172.21.15.156:3300/0 conn(0x7f6404135f80 0x7f6404138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.125+0000 7f640ae61700 1 --2- 172.21.15.156:0/108210179 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6404133660 0x7f6404135a40 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.125+0000 7f640ae61700 1 -- 172.21.15.156:0/108210179 >> 172.21.15.156:0/108210179 conn(0x7f64040a2980 msgr2=0x7f64040a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:47.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.125+0000 7f640ae61700 1 -- 172.21.15.156:0/108210179 shutdown_connections 2023-09-30T22:25:47.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.125+0000 7f640ae61700 1 -- 172.21.15.156:0/108210179 wait complete. 2023-09-30T22:25:47.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.126+0000 7f640ae61700 1 Processor -- start 2023-09-30T22:25:47.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.126+0000 7f640ae61700 1 -- start start 2023-09-30T22:25:47.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.127+0000 7f640ae61700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6404099e20 0x7f640406ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:47.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.127+0000 7f640ae61700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6404133660 0x7f6404070510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:47.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.127+0000 7f640ae61700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6404135f80 0x7f6404070a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:47.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.127+0000 7f640ae61700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6404119870 con 0x7f6404135f80 2023-09-30T22:25:47.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.127+0000 7f640ae61700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640412d600 con 0x7f6404099e20 2023-09-30T22:25:47.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.127+0000 7f640ae61700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f640411a590 con 0x7f6404133660 2023-09-30T22:25:47.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.127+0000 7f6408bfd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6404099e20 0x7f640406ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:47.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.127+0000 7f6408bfd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6404099e20 0x7f640406ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40310/0 (socket says 172.21.15.156:40310) 2023-09-30T22:25:47.129 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.127+0000 7f6408bfd700 1 -- 172.21.15.156:0/741328612 learned_addr learned my addr 172.21.15.156:0/741328612 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:47.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.127+0000 7f64093fe700 1 --2- 172.21.15.156:0/741328612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6404135f80 0x7f6404070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:47.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.127+0000 7f6408bfd700 1 -- 172.21.15.156:0/741328612 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6404133660 msgr2=0x7f6404070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:47.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.127+0000 7f6408bfd700 1 --2- 172.21.15.156:0/741328612 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6404133660 0x7f6404070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.127+0000 7f6408bfd700 1 -- 172.21.15.156:0/741328612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6404135f80 msgr2=0x7f6404070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:47.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.127+0000 7f6408bfd700 1 --2- 172.21.15.156:0/741328612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6404135f80 0x7f6404070a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.127+0000 7f6408bfd700 1 -- 172.21.15.156:0/741328612 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f000b7f0 con 0x7f6404099e20 2023-09-30T22:25:47.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.128+0000 7f6408bfd700 1 --2- 172.21.15.156:0/741328612 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6404099e20 0x7f640406ffd0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f63f800c7e0 tx=0x7f63f800cba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:47.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.128+0000 7f64017fa700 1 -- 172.21.15.156:0/741328612 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f8005480 con 0x7f6404099e20 2023-09-30T22:25:47.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.128+0000 7f64017fa700 1 -- 172.21.15.156:0/741328612 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f8003680 con 0x7f6404099e20 2023-09-30T22:25:47.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.128+0000 7f64017fa700 1 -- 172.21.15.156:0/741328612 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f8003a30 con 0x7f6404099e20 2023-09-30T22:25:47.130 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.128+0000 7f640ae61700 1 -- 172.21.15.156:0/741328612 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6404135780 con 0x7f6404099e20 2023-09-30T22:25:47.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.128+0000 7f640ae61700 1 -- 172.21.15.156:0/741328612 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f640411b000 con 0x7f6404099e20 2023-09-30T22:25:47.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.129+0000 7f64017fa700 1 -- 172.21.15.156:0/741328612 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f63f8003b90 con 0x7f6404099e20 2023-09-30T22:25:47.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.129+0000 7f64017fa700 1 -- 172.21.15.156:0/741328612 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f63f803ebe0 con 0x7f6404099e20 2023-09-30T22:25:47.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.129+0000 7f640ae61700 1 -- 172.21.15.156:0/741328612 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6404072480 con 0x7f6404099e20 2023-09-30T22:25:47.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.134+0000 7f59def80700 1 Processor -- start 2023-09-30T22:25:47.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.134+0000 7f59def80700 1 -- start start 2023-09-30T22:25:47.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.134+0000 7f64017fa700 1 -- 172.21.15.156:0/741328612 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6404072480 con 0x7f6404099e20 2023-09-30T22:25:47.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.135+0000 7f59def80700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f59d81335f0 0x7f59d81359d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:47.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.135+0000 7f59def80700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f59d8135f10 0x7f59d81382f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:47.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.135+0000 7f59def80700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d809bb90 con 0x7f59d812d380 2023-09-30T22:25:47.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.135+0000 7f59def80700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d809c210 con 0x7f59d81335f0 2023-09-30T22:25:47.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.135+0000 7f59def80700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59d809ced0 con 0x7f59d8135f10 2023-09-30T22:25:47.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.135+0000 7f59d7fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f59d81335f0 0x7f59d81359d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:47.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.135+0000 7f59d7fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f59d81335f0 0x7f59d81359d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:56158/0 (socket says 172.21.15.156:56158) 2023-09-30T22:25:47.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.135+0000 7f59d7fff700 1 -- 172.21.15.156:0/3842738597 learned_addr learned my addr 172.21.15.156:0/3842738597 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:47.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.135+0000 7f59d7fff700 1 -- 172.21.15.156:0/3842738597 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f59d8135f10 msgr2=0x7f59d81382f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:47.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.135+0000 7f59d7fff700 1 --2- 172.21.15.156:0/3842738597 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f59d8135f10 0x7f59d81382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.135+0000 7f59d7fff700 1 -- 172.21.15.156:0/3842738597 >> v1:172.21.15.156:6789/0 conn(0x7f59d812d380 legacy=0x7f59d812d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:47.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.135+0000 7f59d7fff700 1 -- 172.21.15.156:0/3842738597 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d809ac30 con 0x7f59d81335f0 2023-09-30T22:25:47.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.136+0000 7f59d7fff700 1 --2- 172.21.15.156:0/3842738597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59d81335f0 0x7f59d81359d0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f59c400bb90 tx=0x7f59c400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80cdd0010cf0f2f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:47.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.136+0000 7f59d77fe700 1 -- 172.21.15.156:0/3842738597 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c400dd50 con 0x7f59d81335f0 2023-09-30T22:25:47.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.136+0000 7f59d77fe700 1 -- 172.21.15.156:0/3842738597 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c4010470 con 0x7f59d81335f0 2023-09-30T22:25:47.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.136+0000 7f59d77fe700 1 -- 172.21.15.156:0/3842738597 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4010800 con 0x7f59d81335f0 2023-09-30T22:25:47.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.137+0000 7f59def80700 1 -- 172.21.15.156:0/3842738597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59d81335f0 msgr2=0x7f59d81359d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:47.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.137+0000 7f59def80700 1 --2- 172.21.15.156:0/3842738597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59d81335f0 0x7f59d81359d0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f59c400bb90 tx=0x7f59c400bea0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.137+0000 7f59def80700 1 -- 172.21.15.156:0/3842738597 shutdown_connections 2023-09-30T22:25:47.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.137+0000 7f59def80700 1 --2- 172.21.15.156:0/3842738597 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f59d8135f10 0x7f59d81382f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.137+0000 7f59def80700 1 --2- 172.21.15.156:0/3842738597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59d81335f0 0x7f59d81359d0 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.137+0000 7f59def80700 1 -- 172.21.15.156:0/3842738597 >> 172.21.15.156:0/3842738597 conn(0x7f59d80a2980 msgr2=0x7f59d80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:47.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.137+0000 7f59def80700 1 -- 172.21.15.156:0/3842738597 shutdown_connections 2023-09-30T22:25:47.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.137+0000 7f59def80700 1 -- 172.21.15.156:0/3842738597 wait complete. 2023-09-30T22:25:47.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.138+0000 7f59def80700 1 Processor -- start 2023-09-30T22:25:47.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.138+0000 7f59def80700 1 -- start start 2023-09-30T22:25:47.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.139+0000 7f59def80700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f59d812d380 0x7f59d81c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:47.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.139+0000 7f59def80700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f59d81335f0 0x7f59d81c4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:47.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.139+0000 7f59def80700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59d8135f10 0x7f59d81c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:47.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.139+0000 7f59def80700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d81199f0 con 0x7f59d8135f10 2023-09-30T22:25:47.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.139+0000 7f59def80700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d8119e30 con 0x7f59d81335f0 2023-09-30T22:25:47.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.139+0000 7f59def80700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59d8131370 con 0x7f59d812d380 2023-09-30T22:25:47.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.139+0000 7f59d7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f59d81335f0 0x7f59d81c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:47.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.139+0000 7f59d7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f59d81335f0 0x7f59d81c4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40322/0 (socket says 172.21.15.156:40322) 2023-09-30T22:25:47.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.139+0000 7f59d7fff700 1 -- 172.21.15.156:0/1305218637 learned_addr learned my addr 172.21.15.156:0/1305218637 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:47.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.139+0000 7f59dcd1c700 1 --2- 172.21.15.156:0/1305218637 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f59d812d380 0x7f59d81c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:47.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.139+0000 7f59dd51d700 1 --2- 172.21.15.156:0/1305218637 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59d8135f10 0x7f59d81c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:47.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.140+0000 7f59dcd1c700 1 -- 172.21.15.156:0/1305218637 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f59d81335f0 msgr2=0x7f59d81c4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:47.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.140+0000 7f59dcd1c700 1 --2- 172.21.15.156:0/1305218637 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f59d81335f0 0x7f59d81c4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.140+0000 7f59dcd1c700 1 -- 172.21.15.156:0/1305218637 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59d8135f10 msgr2=0x7f59d81c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:47.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.140+0000 7f59dcd1c700 1 --2- 172.21.15.156:0/1305218637 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59d8135f10 0x7f59d81c4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.140+0000 7f59dcd1c700 1 -- 172.21.15.156:0/1305218637 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c400b7f0 con 0x7f59d812d380 2023-09-30T22:25:47.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.140+0000 7f59d7fff700 1 --2- 172.21.15.156:0/1305218637 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f59d81335f0 0x7f59d81c4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:47.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.140+0000 7f59dcd1c700 1 --2- 172.21.15.156:0/1305218637 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f59d812d380 0x7f59d81c41f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f59cc00c400 tx=0x7f59cc00c710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:47.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.140+0000 7f59d57fa700 1 -- 172.21.15.156:0/1305218637 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59cc0052d0 con 0x7f59d812d380 2023-09-30T22:25:47.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.140+0000 7f59d57fa700 1 -- 172.21.15.156:0/1305218637 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59cc005430 con 0x7f59d812d380 2023-09-30T22:25:47.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.140+0000 7f59def80700 1 -- 172.21.15.156:0/1305218637 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d81317a0 con 0x7f59d812d380 2023-09-30T22:25:47.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.140+0000 7f59def80700 1 -- 172.21.15.156:0/1305218637 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d811a380 con 0x7f59d812d380 2023-09-30T22:25:47.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.140+0000 7f59d57fa700 1 -- 172.21.15.156:0/1305218637 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59cc0038a0 con 0x7f59d812d380 2023-09-30T22:25:47.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.141+0000 7f59d57fa700 1 -- 172.21.15.156:0/1305218637 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f59cc003a00 con 0x7f59d812d380 2023-09-30T22:25:47.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.141+0000 7f59def80700 1 -- 172.21.15.156:0/1305218637 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b80052e0 con 0x7f59d812d380 2023-09-30T22:25:47.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.141+0000 7f59d57fa700 1 -- 172.21.15.156:0/1305218637 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f59cc03e900 con 0x7f59d812d380 2023-09-30T22:25:47.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.150+0000 7f59d57fa700 1 -- 172.21.15.156:0/1305218637 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f59cc06c750 con 0x7f59d812d380 2023-09-30T22:25:47.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.193+0000 7f3512b21700 1 Processor -- start 2023-09-30T22:25:47.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.193+0000 7f3512b21700 1 -- start start 2023-09-30T22:25:47.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.194+0000 7f3512b21700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350c0a1550 0x7f350c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:47.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.194+0000 7f3512b21700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f350c139200 0x7f350c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:47.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.194+0000 7f3512b21700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f350c09e9d0 con 0x7f350c0a0a70 2023-09-30T22:25:47.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.194+0000 7f3512b21700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f350c09dc00 con 0x7f350c139200 2023-09-30T22:25:47.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.194+0000 7f3512b21700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350c09dec0 con 0x7f350c0a1550 2023-09-30T22:25:47.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.194+0000 7f35108bd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f350c0a0a70 0x7f350c0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:43932/0 (socket says 172.21.15.156:43932) 2023-09-30T22:25:47.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.194+0000 7f35108bd700 1 -- 172.21.15.156:0/493850990 learned_addr learned my addr 172.21.15.156:0/493850990 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:47.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.194+0000 7f35110be700 1 --2- 172.21.15.156:0/493850990 >> v2:172.21.15.156:3300/0 conn(0x7f350c139200 0x7f350c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:47.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.194+0000 7f350bfff700 1 --2- 172.21.15.156:0/493850990 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350c0a1550 0x7f350c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:47.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.195+0000 7f350b7fe700 1 -- 172.21.15.156:0/493850990 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3547606141 0 0) 0x7f350c09e9d0 con 0x7f350c0a0a70 2023-09-30T22:25:47.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.195+0000 7f350b7fe700 1 -- 172.21.15.156:0/493850990 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34fc0035b0 con 0x7f350c0a0a70 2023-09-30T22:25:47.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.195+0000 7f35110be700 1 -- 172.21.15.156:0/493850990 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350c0a1550 msgr2=0x7f350c138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:47.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.195+0000 7f35110be700 1 --2- 172.21.15.156:0/493850990 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350c0a1550 0x7f350c138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.195+0000 7f35110be700 1 -- 172.21.15.156:0/493850990 >> v1:172.21.15.156:6789/0 conn(0x7f350c0a0a70 legacy=0x7f350c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:47.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.195+0000 7f35110be700 1 -- 172.21.15.156:0/493850990 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c09e6a0 con 0x7f350c139200 2023-09-30T22:25:47.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.195+0000 7f35110be700 1 --2- 172.21.15.156:0/493850990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f350c139200 0x7f350c13b5e0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f3504009d90 tx=0x7f350400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf91667447780cde server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:47.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.195+0000 7f350b7fe700 1 -- 172.21.15.156:0/493850990 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350400e070 con 0x7f350c139200 2023-09-30T22:25:47.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.195+0000 7f350b7fe700 1 -- 172.21.15.156:0/493850990 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350400bb20 con 0x7f350c139200 2023-09-30T22:25:47.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.195+0000 7f350b7fe700 1 -- 172.21.15.156:0/493850990 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350400be90 con 0x7f350c139200 2023-09-30T22:25:47.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.196+0000 7f3512b21700 1 -- 172.21.15.156:0/493850990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f350c139200 msgr2=0x7f350c13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:47.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.196+0000 7f3512b21700 1 --2- 172.21.15.156:0/493850990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f350c139200 0x7f350c13b5e0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f3504009d90 tx=0x7f350400b330 comp rx=0 tx=0).stop 2023-09-30T22:25:47.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.196+0000 7f3512b21700 1 -- 172.21.15.156:0/493850990 shutdown_connections 2023-09-30T22:25:47.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.196+0000 7f3512b21700 1 --2- 172.21.15.156:0/493850990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f350c139200 0x7f350c13b5e0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.196+0000 7f3512b21700 1 --2- 172.21.15.156:0/493850990 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350c0a1550 0x7f350c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.196+0000 7f3512b21700 1 -- 172.21.15.156:0/493850990 >> 172.21.15.156:0/493850990 conn(0x7f350c0a6610 msgr2=0x7f350c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:47.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.196+0000 7f3512b21700 1 -- 172.21.15.156:0/493850990 shutdown_connections 2023-09-30T22:25:47.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.196+0000 7f3512b21700 1 -- 172.21.15.156:0/493850990 wait complete. 2023-09-30T22:25:47.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.198+0000 7f3512b21700 1 Processor -- start 2023-09-30T22:25:47.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.198+0000 7f3512b21700 1 -- start start 2023-09-30T22:25:47.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.199+0000 7f3512b21700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f350c0a0a70 0x7f350c120700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:47.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.199+0000 7f3512b21700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f350c0a1550 0x7f350c120c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:47.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.199+0000 7f3512b21700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350c139200 0x7f350c121180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:47.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.199+0000 7f3512b21700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350c1241a0 con 0x7f350c0a1550 2023-09-30T22:25:47.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.199+0000 7f3512b21700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350c123c00 con 0x7f350c139200 2023-09-30T22:25:47.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.199+0000 7f3512b21700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f350c122220 con 0x7f350c0a0a70 2023-09-30T22:25:47.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.199+0000 7f350bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f350c0a1550 0x7f350c120c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:47.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.199+0000 7f350bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f350c0a1550 0x7f350c120c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:56194/0 (socket says 172.21.15.156:56194) 2023-09-30T22:25:47.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.199+0000 7f35110be700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350c139200 0x7f350c121180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:47.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.199+0000 7f350bfff700 1 -- 172.21.15.156:0/1805302899 learned_addr learned my addr 172.21.15.156:0/1805302899 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:47.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.199+0000 7f35108bd700 1 --2- 172.21.15.156:0/1805302899 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f350c0a0a70 0x7f350c120700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:47.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.199+0000 7f35110be700 1 -- 172.21.15.156:0/1805302899 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f350c0a0a70 msgr2=0x7f350c120700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:47.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.199+0000 7f35110be700 1 --2- 172.21.15.156:0/1805302899 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f350c0a0a70 0x7f350c120700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.199+0000 7f35110be700 1 -- 172.21.15.156:0/1805302899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f350c0a1550 msgr2=0x7f350c120c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:47.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.199+0000 7f35110be700 1 --2- 172.21.15.156:0/1805302899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f350c0a1550 0x7f350c120c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.199+0000 7f35110be700 1 -- 172.21.15.156:0/1805302899 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3504009a70 con 0x7f350c139200 2023-09-30T22:25:47.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.199+0000 7f350bfff700 1 --2- 172.21.15.156:0/1805302899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f350c0a1550 0x7f350c120c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:47.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.199+0000 7f35110be700 1 --2- 172.21.15.156:0/1805302899 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350c139200 0x7f350c121180 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f3504016000 tx=0x7f3504004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:47.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.200+0000 7f35097fa700 1 -- 172.21.15.156:0/1805302899 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3504004880 con 0x7f350c139200 2023-09-30T22:25:47.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.200+0000 7f3512b21700 1 -- 172.21.15.156:0/1805302899 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f350c09c510 con 0x7f350c139200 2023-09-30T22:25:47.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.200+0000 7f35097fa700 1 -- 172.21.15.156:0/1805302899 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3504020070 con 0x7f350c139200 2023-09-30T22:25:47.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.200+0000 7f35097fa700 1 -- 172.21.15.156:0/1805302899 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35040276c0 con 0x7f350c139200 2023-09-30T22:25:47.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.200+0000 7f3512b21700 1 -- 172.21.15.156:0/1805302899 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f350c124930 con 0x7f350c139200 2023-09-30T22:25:47.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.201+0000 7f35097fa700 1 -- 172.21.15.156:0/1805302899 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3504012430 con 0x7f350c139200 2023-09-30T22:25:47.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.201+0000 7f35097fa700 1 -- 172.21.15.156:0/1805302899 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3504022070 con 0x7f350c139200 2023-09-30T22:25:47.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.201+0000 7f3512b21700 1 -- 172.21.15.156:0/1805302899 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f350c04f2a0 con 0x7f350c139200 2023-09-30T22:25:47.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.210+0000 7f35097fa700 1 -- 172.21.15.156:0/1805302899 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3504003e30 con 0x7f350c139200 2023-09-30T22:25:47.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.215+0000 7fc7d0328700 1 -- 172.21.15.156:0/1383037213 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc7c804f2a0 con 0x7fc7c809d860 2023-09-30T22:25:47.215 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.215+0000 7fc7beffd700 1 -- 172.21.15.156:0/1383037213 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc7c4034090 con 0x7fc7c809d860 2023-09-30T22:25:47.216 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:47.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.217+0000 7fc7d0328700 1 -- 172.21.15.156:0/1383037213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7c809d860 msgr2=0x7fc7c811e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:47.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.217+0000 7fc7d0328700 1 --2- 172.21.15.156:0/1383037213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7c809d860 0x7fc7c811e2b0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7fc7c40090b0 tx=0x7fc7c4004750 comp rx=0 tx=0).stop 2023-09-30T22:25:47.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.217+0000 7fc7d0328700 1 -- 172.21.15.156:0/1383037213 shutdown_connections 2023-09-30T22:25:47.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.217+0000 7fc7d0328700 1 --2- 172.21.15.156:0/1383037213 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7c8130eb0 0x7fc7c811ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.217+0000 7fc7d0328700 1 --2- 172.21.15.156:0/1383037213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7c809d860 0x7fc7c811e2b0 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.217+0000 7fc7d0328700 1 --2- 172.21.15.156:0/1383037213 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc7c809e170 0x7fc7c811e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.217+0000 7fc7d0328700 1 -- 172.21.15.156:0/1383037213 >> 172.21.15.156:0/1383037213 conn(0x7fc7c8099c40 msgr2=0x7fc7c80a20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:47.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.217+0000 7fc7d0328700 1 -- 172.21.15.156:0/1383037213 shutdown_connections 2023-09-30T22:25:47.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.217+0000 7fc7d0328700 1 -- 172.21.15.156:0/1383037213 wait complete. 2023-09-30T22:25:47.230 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:47.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.339+0000 7f640ae61700 1 -- 172.21.15.156:0/741328612 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6404072480 con 0x7f6404099e20 2023-09-30T22:25:47.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.339+0000 7f64017fa700 1 -- 172.21.15.156:0/741328612 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6404072480 con 0x7f6404099e20 2023-09-30T22:25:47.341 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:47.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.341+0000 7f640ae61700 1 -- 172.21.15.156:0/741328612 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6404099e20 msgr2=0x7f640406ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:47.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.341+0000 7f640ae61700 1 --2- 172.21.15.156:0/741328612 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6404099e20 0x7f640406ffd0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f63f800c7e0 tx=0x7f63f800cba0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.341+0000 7f640ae61700 1 -- 172.21.15.156:0/741328612 shutdown_connections 2023-09-30T22:25:47.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.341+0000 7f640ae61700 1 --2- 172.21.15.156:0/741328612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6404135f80 0x7f6404070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.341+0000 7f640ae61700 1 --2- 172.21.15.156:0/741328612 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6404099e20 0x7f640406ffd0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.341+0000 7f640ae61700 1 --2- 172.21.15.156:0/741328612 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6404133660 0x7f6404070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.341+0000 7f640ae61700 1 -- 172.21.15.156:0/741328612 >> 172.21.15.156:0/741328612 conn(0x7f64040a2980 msgr2=0x7f6404133a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:47.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.342+0000 7f640ae61700 1 -- 172.21.15.156:0/741328612 shutdown_connections 2023-09-30T22:25:47.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.342+0000 7f640ae61700 1 -- 172.21.15.156:0/741328612 wait complete. 2023-09-30T22:25:47.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:47.379 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.379+0000 7f59def80700 1 -- 172.21.15.156:0/1305218637 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f59b8005590 con 0x7f59d812d380 2023-09-30T22:25:47.380 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.379+0000 7f59d57fa700 1 -- 172.21.15.156:0/1305218637 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f59cc017020 con 0x7f59d812d380 2023-09-30T22:25:47.380 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:47.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.381+0000 7f59def80700 1 -- 172.21.15.156:0/1305218637 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f59d812d380 msgr2=0x7f59d81c41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:47.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.381+0000 7f59def80700 1 --2- 172.21.15.156:0/1305218637 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f59d812d380 0x7f59d81c41f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f59cc00c400 tx=0x7f59cc00c710 comp rx=0 tx=0).stop 2023-09-30T22:25:47.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.381+0000 7f59def80700 1 -- 172.21.15.156:0/1305218637 shutdown_connections 2023-09-30T22:25:47.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.381+0000 7f59def80700 1 --2- 172.21.15.156:0/1305218637 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59d8135f10 0x7f59d81c4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.381+0000 7f59def80700 1 --2- 172.21.15.156:0/1305218637 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f59d812d380 0x7f59d81c41f0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.381+0000 7f59def80700 1 --2- 172.21.15.156:0/1305218637 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f59d81335f0 0x7f59d81c4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.381+0000 7f59def80700 1 -- 172.21.15.156:0/1305218637 >> 172.21.15.156:0/1305218637 conn(0x7f59d80a2980 msgr2=0x7f59d809f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:47.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.382+0000 7f59def80700 1 -- 172.21.15.156:0/1305218637 shutdown_connections 2023-09-30T22:25:47.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.382+0000 7f59def80700 1 -- 172.21.15.156:0/1305218637 wait complete. 2023-09-30T22:25:47.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:47.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.416+0000 7f3512b21700 1 -- 172.21.15.156:0/1805302899 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f350c072980 con 0x7f350c139200 2023-09-30T22:25:47.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.416+0000 7f35097fa700 1 -- 172.21.15.156:0/1805302899 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3504011390 con 0x7f350c139200 2023-09-30T22:25:47.417 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:47.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.418+0000 7f3512b21700 1 -- 172.21.15.156:0/1805302899 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350c139200 msgr2=0x7f350c121180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:47.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.418+0000 7f3512b21700 1 --2- 172.21.15.156:0/1805302899 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350c139200 0x7f350c121180 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f3504016000 tx=0x7f3504004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.419+0000 7f3512b21700 1 -- 172.21.15.156:0/1805302899 shutdown_connections 2023-09-30T22:25:47.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.419+0000 7f3512b21700 1 --2- 172.21.15.156:0/1805302899 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f350c139200 0x7f350c121180 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.419+0000 7f3512b21700 1 --2- 172.21.15.156:0/1805302899 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f350c0a0a70 0x7f350c120700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.419+0000 7f3512b21700 1 --2- 172.21.15.156:0/1805302899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f350c0a1550 0x7f350c120c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.419+0000 7f3512b21700 1 -- 172.21.15.156:0/1805302899 >> 172.21.15.156:0/1805302899 conn(0x7f350c0a6610 msgr2=0x7f350c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:47.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.419+0000 7f3512b21700 1 -- 172.21.15.156:0/1805302899 shutdown_connections 2023-09-30T22:25:47.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:47.419+0000 7f3512b21700 1 -- 172.21.15.156:0/1805302899 wait complete. 2023-09-30T22:25:47.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:48.231 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:48.355 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:48.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.367+0000 7fd04635e700 1 Processor -- start 2023-09-30T22:25:48.368 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.367+0000 7fd04635e700 1 -- start start 2023-09-30T22:25:48.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.368+0000 7fd04635e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd04009e340 0x7fd0401359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.368+0000 7fd04635e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd040135f20 0x7fd040138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.368+0000 7fd04635e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd04009aaa0 con 0x7fd04009d860 2023-09-30T22:25:48.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.368+0000 7fd04635e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd04009e730 con 0x7fd040135f20 2023-09-30T22:25:48.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.368+0000 7fd04635e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd04009f870 con 0x7fd04009e340 2023-09-30T22:25:48.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.368+0000 7fd03f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd04009e340 0x7fd0401359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.368+0000 7fd0448fb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd040135f20 0x7fd040138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.368+0000 7fd03f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd04009e340 0x7fd0401359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46364/0 (socket says 172.21.15.156:46364) 2023-09-30T22:25:48.373 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.368+0000 7fd03f7fe700 1 -- 172.21.15.156:0/3616586708 learned_addr learned my addr 172.21.15.156:0/3616586708 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:48.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.368+0000 7fd03ffff700 1 --1- 172.21.15.156:0/3616586708 >> v1:172.21.15.156:6789/0 conn(0x7fd04009d860 0x7fd04009dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:43940/0 (socket says 172.21.15.156:43940) 2023-09-30T22:25:48.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.368+0000 7fd03f7fe700 1 -- 172.21.15.156:0/3616586708 >> v2:172.21.15.156:3300/0 conn(0x7fd040135f20 msgr2=0x7fd040138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:48.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.368+0000 7fd03f7fe700 1 --2- 172.21.15.156:0/3616586708 >> v2:172.21.15.156:3300/0 conn(0x7fd040135f20 0x7fd040138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.368+0000 7fd03f7fe700 1 -- 172.21.15.156:0/3616586708 >> v1:172.21.15.156:6789/0 conn(0x7fd04009d860 legacy=0x7fd04009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.368+0000 7fd03f7fe700 1 -- 172.21.15.156:0/3616586708 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04009b360 con 0x7fd04009e340 2023-09-30T22:25:48.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.368+0000 7fd0448fb700 1 --2- 172.21.15.156:0/3616586708 >> v2:172.21.15.156:3300/0 conn(0x7fd040135f20 0x7fd040138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:48.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.369+0000 7fd03f7fe700 1 --2- 172.21.15.156:0/3616586708 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd04009e340 0x7fd0401359e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fd0340098f0 tx=0x7fd034009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54efe15fcdaca379 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:48.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.369+0000 7fd03effd700 1 -- 172.21.15.156:0/3616586708 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034011830 con 0x7fd04009e340 2023-09-30T22:25:48.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.369+0000 7fd03effd700 1 -- 172.21.15.156:0/3616586708 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd034011990 con 0x7fd04009e340 2023-09-30T22:25:48.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.369+0000 7fd03effd700 1 -- 172.21.15.156:0/3616586708 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034011d20 con 0x7fd04009e340 2023-09-30T22:25:48.374 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.369+0000 7fd04635e700 1 -- 172.21.15.156:0/3616586708 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd04009e340 msgr2=0x7fd0401359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.369+0000 7fd04635e700 1 --2- 172.21.15.156:0/3616586708 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd04009e340 0x7fd0401359e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fd0340098f0 tx=0x7fd034009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:48.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.369+0000 7fd04635e700 1 -- 172.21.15.156:0/3616586708 shutdown_connections 2023-09-30T22:25:48.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.369+0000 7fd04635e700 1 --2- 172.21.15.156:0/3616586708 >> v2:172.21.15.156:3300/0 conn(0x7fd040135f20 0x7fd040138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.369+0000 7fd04635e700 1 --2- 172.21.15.156:0/3616586708 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd04009e340 0x7fd0401359e0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.369+0000 7fd04635e700 1 -- 172.21.15.156:0/3616586708 >> 172.21.15.156:0/3616586708 conn(0x7fd040099c40 msgr2=0x7fd0400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:48.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.369+0000 7fd04635e700 1 -- 172.21.15.156:0/3616586708 shutdown_connections 2023-09-30T22:25:48.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.369+0000 7fd04635e700 1 -- 172.21.15.156:0/3616586708 wait complete. 2023-09-30T22:25:48.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.370+0000 7fd04635e700 1 Processor -- start 2023-09-30T22:25:48.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.371+0000 7fd04635e700 1 -- start start 2023-09-30T22:25:48.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.371+0000 7fd04635e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd04009d860 0x7fd0401c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.371+0000 7fd04635e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd04009e340 0x7fd0401c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.371+0000 7fd04635e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd040135f20 0x7fd0401c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.371+0000 7fd04635e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0400a2230 con 0x7fd040135f20 2023-09-30T22:25:48.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.371+0000 7fd04635e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd040122da0 con 0x7fd04009e340 2023-09-30T22:25:48.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.371+0000 7fd04635e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0401220a0 con 0x7fd04009d860 2023-09-30T22:25:48.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.371+0000 7fd03f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd04009e340 0x7fd0401c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.371+0000 7fd0448fb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd040135f20 0x7fd0401c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.371+0000 7fd03ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd04009d860 0x7fd0401c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.371+0000 7fd03f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd04009e340 0x7fd0401c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40342/0 (socket says 172.21.15.156:40342) 2023-09-30T22:25:48.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.371+0000 7fd03f7fe700 1 -- 172.21.15.156:0/3029100255 learned_addr learned my addr 172.21.15.156:0/3029100255 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:48.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.372+0000 7fd0448fb700 1 -- 172.21.15.156:0/3029100255 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd04009d860 msgr2=0x7fd0401c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.372+0000 7fd0448fb700 1 --2- 172.21.15.156:0/3029100255 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd04009d860 0x7fd0401c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.372+0000 7fd0448fb700 1 -- 172.21.15.156:0/3029100255 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd04009e340 msgr2=0x7fd0401c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.372+0000 7fd0448fb700 1 --2- 172.21.15.156:0/3029100255 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd04009e340 0x7fd0401c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.372+0000 7fd0448fb700 1 -- 172.21.15.156:0/3029100255 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd038009a70 con 0x7fd040135f20 2023-09-30T22:25:48.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.372+0000 7fd03f7fe700 1 --2- 172.21.15.156:0/3029100255 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd04009e340 0x7fd0401c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:48.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.372+0000 7fd03ffff700 1 --2- 172.21.15.156:0/3029100255 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd04009d860 0x7fd0401c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:48.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.372+0000 7fd0448fb700 1 --2- 172.21.15.156:0/3029100255 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd040135f20 0x7fd0401c8c30 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fd03800efc0 tx=0x7fd03800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:48.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.372+0000 7fd03cff9700 1 -- 172.21.15.156:0/3029100255 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03800ca90 con 0x7fd040135f20 2023-09-30T22:25:48.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.372+0000 7fd03cff9700 1 -- 172.21.15.156:0/3029100255 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03800f040 con 0x7fd040135f20 2023-09-30T22:25:48.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.372+0000 7fd04635e700 1 -- 172.21.15.156:0/3029100255 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd034009550 con 0x7fd040135f20 2023-09-30T22:25:48.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.372+0000 7fd03cff9700 1 -- 172.21.15.156:0/3029100255 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03800ce30 con 0x7fd040135f20 2023-09-30T22:25:48.377 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.372+0000 7fd04635e700 1 -- 172.21.15.156:0/3029100255 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd040070540 con 0x7fd040135f20 2023-09-30T22:25:48.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.373+0000 7fd03cff9700 1 -- 172.21.15.156:0/3029100255 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd038014480 con 0x7fd040135f20 2023-09-30T22:25:48.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.373+0000 7fd03cff9700 1 -- 172.21.15.156:0/3029100255 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd03803fbf0 con 0x7fd040135f20 2023-09-30T22:25:48.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.373+0000 7fd04635e700 1 -- 172.21.15.156:0/3029100255 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd04004f2a0 con 0x7fd040135f20 2023-09-30T22:25:48.378 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.378+0000 7fd03cff9700 1 -- 172.21.15.156:0/3029100255 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd038012930 con 0x7fd040135f20 2023-09-30T22:25:48.395 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:48.433 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:48.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.485+0000 7f44233bb700 1 Processor -- start 2023-09-30T22:25:48.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.485+0000 7f44233bb700 1 -- start start 2023-09-30T22:25:48.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.486+0000 7f44233bb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f441c09ef80 0x7f441c13d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.486+0000 7f44233bb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f441c09f3b0 0x7f441c13f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.486+0000 7f44233bb700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f441c072b30 con 0x7f441c09a130 2023-09-30T22:25:48.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.486+0000 7f44233bb700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f441c09a500 con 0x7f441c09f3b0 2023-09-30T22:25:48.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.486+0000 7f44233bb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441c09ada0 con 0x7f441c09ef80 2023-09-30T22:25:48.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.486+0000 7f4420956700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f441c09ef80 0x7f441c13d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.486+0000 7f4420956700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f441c09ef80 0x7f441c13d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40350/0 (socket says 172.21.15.156:40350) 2023-09-30T22:25:48.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.486+0000 7f4420956700 1 -- 172.21.15.156:0/1474404750 learned_addr learned my addr 172.21.15.156:0/1474404750 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:48.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.486+0000 7f4421958700 1 --2- 172.21.15.156:0/1474404750 >> v2:172.21.15.156:3300/0 conn(0x7f441c09f3b0 0x7f441c13f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.486+0000 7f4420956700 1 -- 172.21.15.156:0/1474404750 >> v2:172.21.15.156:3300/0 conn(0x7f441c09f3b0 msgr2=0x7f441c13f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:48.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.486+0000 7f4420956700 1 --2- 172.21.15.156:0/1474404750 >> v2:172.21.15.156:3300/0 conn(0x7f441c09f3b0 0x7f441c13f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.486+0000 7f4420956700 1 -- 172.21.15.156:0/1474404750 >> v1:172.21.15.156:6789/0 conn(0x7f441c09a130 legacy=0x7f441c09e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.486+0000 7f4420956700 1 -- 172.21.15.156:0/1474404750 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441c09fe00 con 0x7f441c09ef80 2023-09-30T22:25:48.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.487+0000 7f4420956700 1 --2- 172.21.15.156:0/1474404750 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f441c09ef80 0x7f441c13d420 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f440c0098f0 tx=0x7f440c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f19cae07045bacfe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:48.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.487+0000 7f4413fff700 1 -- 172.21.15.156:0/1474404750 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c011830 con 0x7f441c09ef80 2023-09-30T22:25:48.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.487+0000 7f4413fff700 1 -- 172.21.15.156:0/1474404750 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440c011990 con 0x7f441c09ef80 2023-09-30T22:25:48.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.487+0000 7f4413fff700 1 -- 172.21.15.156:0/1474404750 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c011d20 con 0x7f441c09ef80 2023-09-30T22:25:48.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.488+0000 7f44233bb700 1 -- 172.21.15.156:0/1474404750 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f441c09ef80 msgr2=0x7f441c13d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.488+0000 7f44233bb700 1 --2- 172.21.15.156:0/1474404750 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f441c09ef80 0x7f441c13d420 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f440c0098f0 tx=0x7f440c009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:48.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.488+0000 7f44233bb700 1 -- 172.21.15.156:0/1474404750 shutdown_connections 2023-09-30T22:25:48.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.488+0000 7f44233bb700 1 --2- 172.21.15.156:0/1474404750 >> v2:172.21.15.156:3300/0 conn(0x7f441c09f3b0 0x7f441c13f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.488+0000 7f44233bb700 1 --2- 172.21.15.156:0/1474404750 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f441c09ef80 0x7f441c13d420 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.488+0000 7f44233bb700 1 -- 172.21.15.156:0/1474404750 >> 172.21.15.156:0/1474404750 conn(0x7f441c0a4430 msgr2=0x7f441c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:48.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.488+0000 7f44233bb700 1 -- 172.21.15.156:0/1474404750 shutdown_connections 2023-09-30T22:25:48.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.488+0000 7f44233bb700 1 -- 172.21.15.156:0/1474404750 wait complete. 2023-09-30T22:25:48.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.489+0000 7f44233bb700 1 Processor -- start 2023-09-30T22:25:48.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.490+0000 7f44233bb700 1 -- start start 2023-09-30T22:25:48.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.490+0000 7f44233bb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f441c09a130 0x7f441c1cd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.490+0000 7f44233bb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f441c09ef80 0x7f441c1cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.490+0000 7f44233bb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f441c09f3b0 0x7f441c11a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.490+0000 7f44233bb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c11dd00 con 0x7f441c09f3b0 2023-09-30T22:25:48.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.490+0000 7f44233bb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441c11c950 con 0x7f441c09a130 2023-09-30T22:25:48.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.490+0000 7f44233bb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f441c11e610 con 0x7f441c09ef80 2023-09-30T22:25:48.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.490+0000 7f4421958700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f441c09f3b0 0x7f441c11a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.490+0000 7f4421958700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f441c09f3b0 0x7f441c11a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:56240/0 (socket says 172.21.15.156:56240) 2023-09-30T22:25:48.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.490+0000 7f4421958700 1 -- 172.21.15.156:0/2203616055 learned_addr learned my addr 172.21.15.156:0/2203616055 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:48.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.490+0000 7f4421157700 1 --2- 172.21.15.156:0/2203616055 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f441c09a130 0x7f441c1cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.491+0000 7f4420956700 1 --2- 172.21.15.156:0/2203616055 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f441c09ef80 0x7f441c1cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.491+0000 7f4421958700 1 -- 172.21.15.156:0/2203616055 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f441c09ef80 msgr2=0x7f441c1cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.491+0000 7f4421958700 1 --2- 172.21.15.156:0/2203616055 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f441c09ef80 0x7f441c1cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.491+0000 7f4421958700 1 -- 172.21.15.156:0/2203616055 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f441c09a130 msgr2=0x7f441c1cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.491+0000 7f4421958700 1 --2- 172.21.15.156:0/2203616055 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f441c09a130 0x7f441c1cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.491+0000 7f4421958700 1 -- 172.21.15.156:0/2203616055 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f440c009550 con 0x7f441c09f3b0 2023-09-30T22:25:48.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.491+0000 7f4421958700 1 --2- 172.21.15.156:0/2203616055 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f441c09f3b0 0x7f441c11a6c0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f441400efc0 tx=0x7f441400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:48.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.491+0000 7f4411ffb700 1 -- 172.21.15.156:0/2203616055 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4414009ea0 con 0x7f441c09f3b0 2023-09-30T22:25:48.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.491+0000 7f4411ffb700 1 -- 172.21.15.156:0/2203616055 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441400f040 con 0x7f441c09f3b0 2023-09-30T22:25:48.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.491+0000 7f44233bb700 1 -- 172.21.15.156:0/2203616055 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f441c09e230 con 0x7f441c09f3b0 2023-09-30T22:25:48.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.491+0000 7f4411ffb700 1 -- 172.21.15.156:0/2203616055 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441400ced0 con 0x7f441c09f3b0 2023-09-30T22:25:48.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.492+0000 7f44233bb700 1 -- 172.21.15.156:0/2203616055 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441c11dfe0 con 0x7f441c09f3b0 2023-09-30T22:25:48.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.493+0000 7f4411ffb700 1 -- 172.21.15.156:0/2203616055 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4414014480 con 0x7f441c09f3b0 2023-09-30T22:25:48.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.493+0000 7f44233bb700 1 -- 172.21.15.156:0/2203616055 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f441c04f2a0 con 0x7f441c09f3b0 2023-09-30T22:25:48.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.493+0000 7f4411ffb700 1 -- 172.21.15.156:0/2203616055 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f441403fe50 con 0x7f441c09f3b0 2023-09-30T22:25:48.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.498+0000 7f4411ffb700 1 -- 172.21.15.156:0/2203616055 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4414018070 con 0x7f441c09f3b0 2023-09-30T22:25:48.525 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.525+0000 7fad47a7f700 1 Processor -- start 2023-09-30T22:25:48.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.525+0000 7fad47a7f700 1 -- start start 2023-09-30T22:25:48.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.525+0000 7fad47a7f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fad4009d860 0x7fad4009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.525+0000 7fad47a7f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad4009e170 0x7fad401307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.525+0000 7fad47a7f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad40130ce0 0x7fad40131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.525+0000 7fad47a7f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad40131670 con 0x7fad4009d860 2023-09-30T22:25:48.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.525+0000 7fad47a7f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4009aaa0 con 0x7fad40130ce0 2023-09-30T22:25:48.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.525+0000 7fad47a7f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad4009f870 con 0x7fad4009e170 2023-09-30T22:25:48.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.525+0000 7fad4601c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad40130ce0 0x7fad40131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.525+0000 7fad4601c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad40130ce0 0x7fad40131130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40372/0 (socket says 172.21.15.156:40372) 2023-09-30T22:25:48.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.525+0000 7fad4581b700 1 --2- 172.21.15.156:0/2630285724 >> v2:172.21.15.156:3300/0 conn(0x7fad4009d860 0x7fad4009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.526+0000 7fad4601c700 1 -- 172.21.15.156:0/2630285724 learned_addr learned my addr 172.21.15.156:0/2630285724 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:48.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.526+0000 7fad4501a700 1 --2- 172.21.15.156:0/2630285724 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad4009e170 0x7fad401307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.526+0000 7fad4601c700 1 -- 172.21.15.156:0/2630285724 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad4009e170 msgr2=0x7fad401307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:48.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.526+0000 7fad4601c700 1 --2- 172.21.15.156:0/2630285724 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad4009e170 0x7fad401307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.526+0000 7fad4601c700 1 -- 172.21.15.156:0/2630285724 >> v2:172.21.15.156:3300/0 conn(0x7fad4009d860 msgr2=0x7fad4009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:48.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.526+0000 7fad4601c700 1 --2- 172.21.15.156:0/2630285724 >> v2:172.21.15.156:3300/0 conn(0x7fad4009d860 0x7fad4009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.526+0000 7fad4601c700 1 -- 172.21.15.156:0/2630285724 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4009b360 con 0x7fad40130ce0 2023-09-30T22:25:48.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.526+0000 7fad4581b700 1 --2- 172.21.15.156:0/2630285724 >> v2:172.21.15.156:3300/0 conn(0x7fad4009d860 0x7fad4009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:48.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.526+0000 7fad4601c700 1 --2- 172.21.15.156:0/2630285724 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad40130ce0 0x7fad40131130 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fad3800bef0 tx=0x7fad380093b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c01895421b7f409c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:48.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.526+0000 7fad44819700 1 -- 172.21.15.156:0/2630285724 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3800b4e0 con 0x7fad40130ce0 2023-09-30T22:25:48.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.526+0000 7fad44819700 1 -- 172.21.15.156:0/2630285724 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3800c950 con 0x7fad40130ce0 2023-09-30T22:25:48.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.526+0000 7fad44819700 1 -- 172.21.15.156:0/2630285724 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3800cd00 con 0x7fad40130ce0 2023-09-30T22:25:48.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.527+0000 7fad47a7f700 1 -- 172.21.15.156:0/2630285724 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad40130ce0 msgr2=0x7fad40131130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.527+0000 7fad47a7f700 1 --2- 172.21.15.156:0/2630285724 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad40130ce0 0x7fad40131130 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fad3800bef0 tx=0x7fad380093b0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.527+0000 7fad47a7f700 1 -- 172.21.15.156:0/2630285724 shutdown_connections 2023-09-30T22:25:48.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.527+0000 7fad47a7f700 1 --2- 172.21.15.156:0/2630285724 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad40130ce0 0x7fad40131130 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.527+0000 7fad47a7f700 1 --2- 172.21.15.156:0/2630285724 >> v2:172.21.15.156:3300/0 conn(0x7fad4009d860 0x7fad4009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.527+0000 7fad47a7f700 1 --2- 172.21.15.156:0/2630285724 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad4009e170 0x7fad401307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.527+0000 7fad47a7f700 1 -- 172.21.15.156:0/2630285724 >> 172.21.15.156:0/2630285724 conn(0x7fad40099c40 msgr2=0x7fad400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:48.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.527+0000 7fad47a7f700 1 -- 172.21.15.156:0/2630285724 shutdown_connections 2023-09-30T22:25:48.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.527+0000 7fad47a7f700 1 -- 172.21.15.156:0/2630285724 wait complete. 2023-09-30T22:25:48.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.528+0000 7fad47a7f700 1 Processor -- start 2023-09-30T22:25:48.530 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.528+0000 7fad47a7f700 1 -- start start 2023-09-30T22:25:48.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.528+0000 7fad47a7f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad4009d860 0x7fad4011cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.528+0000 7fad47a7f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad4009e170 0x7fad4011d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.528+0000 7fad47a7f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad40130ce0 0x7fad4011d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.528+0000 7fad47a7f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad401212d0 con 0x7fad4009d860 2023-09-30T22:25:48.533 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.528+0000 7fad47a7f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4011ea00 con 0x7fad40130ce0 2023-09-30T22:25:48.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.528+0000 7fad47a7f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad4011f020 con 0x7fad4009e170 2023-09-30T22:25:48.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.529+0000 7fad4601c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad40130ce0 0x7fad4011d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.529+0000 7fad4601c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad40130ce0 0x7fad4011d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40374/0 (socket says 172.21.15.156:40374) 2023-09-30T22:25:48.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.529+0000 7fad4601c700 1 -- 172.21.15.156:0/2989217831 learned_addr learned my addr 172.21.15.156:0/2989217831 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:48.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.529+0000 7fad4501a700 1 --2- 172.21.15.156:0/2989217831 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad4009e170 0x7fad4011d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.534 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.529+0000 7fad4581b700 1 --2- 172.21.15.156:0/2989217831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad4009d860 0x7fad4011cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.529+0000 7fad4601c700 1 -- 172.21.15.156:0/2989217831 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad4009e170 msgr2=0x7fad4011d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.529+0000 7fad4601c700 1 --2- 172.21.15.156:0/2989217831 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad4009e170 0x7fad4011d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.529+0000 7fad4601c700 1 -- 172.21.15.156:0/2989217831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad4009d860 msgr2=0x7fad4011cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.529+0000 7fad4601c700 1 --2- 172.21.15.156:0/2989217831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad4009d860 0x7fad4011cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.535 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.529+0000 7fad4601c700 1 -- 172.21.15.156:0/2989217831 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3c00d940 con 0x7fad40130ce0 2023-09-30T22:25:48.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.529+0000 7fad4601c700 1 --2- 172.21.15.156:0/2989217831 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad40130ce0 0x7fad4011d870 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fad38009e70 tx=0x7fad38004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:48.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.529+0000 7fad367fc700 1 -- 172.21.15.156:0/2989217831 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3800b4e0 con 0x7fad40130ce0 2023-09-30T22:25:48.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.529+0000 7fad367fc700 1 -- 172.21.15.156:0/2989217831 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3800ccd0 con 0x7fad40130ce0 2023-09-30T22:25:48.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.529+0000 7fad367fc700 1 -- 172.21.15.156:0/2989217831 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3801d610 con 0x7fad40130ce0 2023-09-30T22:25:48.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.529+0000 7fad47a7f700 1 -- 172.21.15.156:0/2989217831 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad3800bb50 con 0x7fad40130ce0 2023-09-30T22:25:48.536 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.530+0000 7fad47a7f700 1 -- 172.21.15.156:0/2989217831 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad400a2120 con 0x7fad40130ce0 2023-09-30T22:25:48.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.530+0000 7fad367fc700 1 -- 172.21.15.156:0/2989217831 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad3801a070 con 0x7fad40130ce0 2023-09-30T22:25:48.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.531+0000 7fad367fc700 1 -- 172.21.15.156:0/2989217831 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fad380410f0 con 0x7fad40130ce0 2023-09-30T22:25:48.537 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.531+0000 7fad47a7f700 1 -- 172.21.15.156:0/2989217831 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad4009c910 con 0x7fad40130ce0 2023-09-30T22:25:48.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.540+0000 7fad367fc700 1 -- 172.21.15.156:0/2989217831 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad3801d770 con 0x7fad40130ce0 2023-09-30T22:25:48.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.570+0000 7f1b6c1a9700 1 Processor -- start 2023-09-30T22:25:48.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.570+0000 7f1b6c1a9700 1 -- start start 2023-09-30T22:25:48.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.570+0000 7f1b6c1a9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b6406a770 0x7f1b6406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.570+0000 7f1b6c1a9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1b6406b080 0x7f1b641317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.570+0000 7f1b6c1a9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b6409da80 con 0x7f1b64131cf0 2023-09-30T22:25:48.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.570+0000 7f1b6c1a9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6409dce0 con 0x7f1b6406b080 2023-09-30T22:25:48.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.570+0000 7f1b6c1a9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6409eb20 con 0x7f1b6406a770 2023-09-30T22:25:48.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.571+0000 7f1b69f45700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b6406a770 0x7f1b6406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.571+0000 7f1b6a746700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f1b64131cf0 0x7f1b64138c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:43956/0 (socket says 172.21.15.156:43956) 2023-09-30T22:25:48.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.571+0000 7f1b6a746700 1 -- 172.21.15.156:0/1534705678 learned_addr learned my addr 172.21.15.156:0/1534705678 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:48.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.571+0000 7f1b69f45700 1 --2- 172.21.15.156:0/1534705678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b6406a770 0x7f1b6406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40388/0 (socket says 172.21.15.156:40388) 2023-09-30T22:25:48.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.571+0000 7f1b69744700 1 --2- 172.21.15.156:0/1534705678 >> v2:172.21.15.156:3300/0 conn(0x7f1b6406b080 0x7f1b641317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.571+0000 7f1b68f43700 1 -- 172.21.15.156:0/1534705678 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 668512280 0 0) 0x7f1b6409da80 con 0x7f1b64131cf0 2023-09-30T22:25:48.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.571+0000 7f1b68f43700 1 -- 172.21.15.156:0/1534705678 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b500035b0 con 0x7f1b64131cf0 2023-09-30T22:25:48.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.571+0000 7f1b69744700 1 -- 172.21.15.156:0/1534705678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b6406a770 msgr2=0x7f1b6406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:48.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.571+0000 7f1b69744700 1 --2- 172.21.15.156:0/1534705678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b6406a770 0x7f1b6406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.571+0000 7f1b69744700 1 -- 172.21.15.156:0/1534705678 >> v1:172.21.15.156:6789/0 conn(0x7f1b64131cf0 legacy=0x7f1b64138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.571+0000 7f1b69744700 1 -- 172.21.15.156:0/1534705678 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6409d860 con 0x7f1b6406b080 2023-09-30T22:25:48.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.571+0000 7f1b69744700 1 --2- 172.21.15.156:0/1534705678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b6406b080 0x7f1b641317b0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f1b54009840 tx=0x7f1b54009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f22c9d7ad5d52a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:48.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.571+0000 7f1b68f43700 1 -- 172.21.15.156:0/1534705678 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b54011830 con 0x7f1b6406b080 2023-09-30T22:25:48.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.572+0000 7f1b68f43700 1 -- 172.21.15.156:0/1534705678 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b54011990 con 0x7f1b6406b080 2023-09-30T22:25:48.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.572+0000 7f1b68f43700 1 -- 172.21.15.156:0/1534705678 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b54011d00 con 0x7f1b6406b080 2023-09-30T22:25:48.576 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.572+0000 7f1b6c1a9700 1 -- 172.21.15.156:0/1534705678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b6406b080 msgr2=0x7f1b641317b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.572+0000 7f1b6c1a9700 1 --2- 172.21.15.156:0/1534705678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b6406b080 0x7f1b641317b0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f1b54009840 tx=0x7f1b54009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:48.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.572+0000 7f1b6c1a9700 1 -- 172.21.15.156:0/1534705678 shutdown_connections 2023-09-30T22:25:48.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.572+0000 7f1b6c1a9700 1 --2- 172.21.15.156:0/1534705678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b6406a770 0x7f1b6406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.572+0000 7f1b6c1a9700 1 --2- 172.21.15.156:0/1534705678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b6406b080 0x7f1b641317b0 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.572+0000 7f1b6c1a9700 1 -- 172.21.15.156:0/1534705678 >> 172.21.15.156:0/1534705678 conn(0x7f1b64099c40 msgr2=0x7f1b640a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:48.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.572+0000 7f1b6c1a9700 1 -- 172.21.15.156:0/1534705678 shutdown_connections 2023-09-30T22:25:48.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.572+0000 7f1b6c1a9700 1 -- 172.21.15.156:0/1534705678 wait complete. 2023-09-30T22:25:48.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.573+0000 7f1b6c1a9700 1 Processor -- start 2023-09-30T22:25:48.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.573+0000 7f1b6c1a9700 1 -- start start 2023-09-30T22:25:48.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.574+0000 7f1b6c1a9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b6406a770 0x7f1b6411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.577 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.574+0000 7f1b6c1a9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b6406b080 0x7f1b6411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.574+0000 7f1b6c1a9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b64131cf0 0x7f1b6411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.574+0000 7f1b6c1a9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b64071850 con 0x7f1b64131cf0 2023-09-30T22:25:48.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.574+0000 7f1b6c1a9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b64120120 con 0x7f1b6406a770 2023-09-30T22:25:48.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.574+0000 7f1b6c1a9700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b640a2320 con 0x7f1b6406b080 2023-09-30T22:25:48.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.574+0000 7f1b6a746700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b64131cf0 0x7f1b6411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.574+0000 7f1b6a746700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b64131cf0 0x7f1b6411e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:56282/0 (socket says 172.21.15.156:56282) 2023-09-30T22:25:48.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.574+0000 7f1b6a746700 1 -- 172.21.15.156:0/1103645527 learned_addr learned my addr 172.21.15.156:0/1103645527 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:48.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.574+0000 7f1b69f45700 1 --2- 172.21.15.156:0/1103645527 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b6406a770 0x7f1b6411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.574+0000 7f1b6a746700 1 -- 172.21.15.156:0/1103645527 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b6406b080 msgr2=0x7f1b6411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.578 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.574+0000 7f1b6a746700 1 --2- 172.21.15.156:0/1103645527 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b6406b080 0x7f1b6411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.574+0000 7f1b6a746700 1 -- 172.21.15.156:0/1103645527 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b6406a770 msgr2=0x7f1b6411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.574+0000 7f1b6a746700 1 --2- 172.21.15.156:0/1103645527 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b6406a770 0x7f1b6411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.574+0000 7f1b6a746700 1 -- 172.21.15.156:0/1103645527 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b540094a0 con 0x7f1b64131cf0 2023-09-30T22:25:48.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.574+0000 7f1b6a746700 1 --2- 172.21.15.156:0/1103645527 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b64131cf0 0x7f1b6411e4c0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00cb40 tx=0x7f1b5c00ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:48.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.575+0000 7f1b5a7fc700 1 -- 172.21.15.156:0/1103645527 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c00aaa0 con 0x7f1b64131cf0 2023-09-30T22:25:48.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.575+0000 7f1b5a7fc700 1 -- 172.21.15.156:0/1103645527 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c00ac00 con 0x7f1b64131cf0 2023-09-30T22:25:48.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.575+0000 7f1b6c1a9700 1 -- 172.21.15.156:0/1103645527 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b6411f050 con 0x7f1b64131cf0 2023-09-30T22:25:48.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.575+0000 7f1b5a7fc700 1 -- 172.21.15.156:0/1103645527 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c012400 con 0x7f1b64131cf0 2023-09-30T22:25:48.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.575+0000 7f1b6c1a9700 1 -- 172.21.15.156:0/1103645527 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b64070db0 con 0x7f1b64131cf0 2023-09-30T22:25:48.579 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.576+0000 7f1b6c1a9700 1 -- 172.21.15.156:0/1103645527 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b6404f2a0 con 0x7f1b64131cf0 2023-09-30T22:25:48.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.577+0000 7f1b5a7fc700 1 -- 172.21.15.156:0/1103645527 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1b5c0113a0 con 0x7f1b64131cf0 2023-09-30T22:25:48.580 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.577+0000 7f1b5a7fc700 1 -- 172.21.15.156:0/1103645527 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1b5c03f920 con 0x7f1b64131cf0 2023-09-30T22:25:48.581 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.581+0000 7f1b5a7fc700 1 -- 172.21.15.156:0/1103645527 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1b5c007070 con 0x7f1b64131cf0 2023-09-30T22:25:48.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.584+0000 7fd04635e700 1 -- 172.21.15.156:0/3029100255 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd04006c3b0 con 0x7fd040135f20 2023-09-30T22:25:48.585 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.585+0000 7fd03cff9700 1 -- 172.21.15.156:0/3029100255 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd038012340 con 0x7fd040135f20 2023-09-30T22:25:48.585 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:48.587 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.587+0000 7fd04635e700 1 -- 172.21.15.156:0/3029100255 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd040135f20 msgr2=0x7fd0401c8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.587+0000 7fd04635e700 1 --2- 172.21.15.156:0/3029100255 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd040135f20 0x7fd0401c8c30 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fd03800efc0 tx=0x7fd03800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.587+0000 7fd04635e700 1 -- 172.21.15.156:0/3029100255 shutdown_connections 2023-09-30T22:25:48.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.587+0000 7fd04635e700 1 --2- 172.21.15.156:0/3029100255 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd040135f20 0x7fd0401c8c30 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.587+0000 7fd04635e700 1 --2- 172.21.15.156:0/3029100255 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd04009d860 0x7fd0401c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.587+0000 7fd04635e700 1 --2- 172.21.15.156:0/3029100255 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd04009e340 0x7fd0401c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.587+0000 7fd04635e700 1 -- 172.21.15.156:0/3029100255 >> 172.21.15.156:0/3029100255 conn(0x7fd040099c40 msgr2=0x7fd04006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:48.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.588+0000 7fd04635e700 1 -- 172.21.15.156:0/3029100255 shutdown_connections 2023-09-30T22:25:48.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.590+0000 7fd04635e700 1 -- 172.21.15.156:0/3029100255 wait complete. 2023-09-30T22:25:48.603 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:48.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.722+0000 7f44233bb700 1 -- 172.21.15.156:0/2203616055 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f441c06be20 con 0x7f441c09f3b0 2023-09-30T22:25:48.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.722+0000 7f4411ffb700 1 -- 172.21.15.156:0/2203616055 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f441401a8b0 con 0x7f441c09f3b0 2023-09-30T22:25:48.723 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:48.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.725+0000 7f44233bb700 1 -- 172.21.15.156:0/2203616055 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f441c09f3b0 msgr2=0x7f441c11a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.725+0000 7f44233bb700 1 --2- 172.21.15.156:0/2203616055 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f441c09f3b0 0x7f441c11a6c0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f441400efc0 tx=0x7f441400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.725+0000 7f44233bb700 1 -- 172.21.15.156:0/2203616055 shutdown_connections 2023-09-30T22:25:48.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.725+0000 7f44233bb700 1 --2- 172.21.15.156:0/2203616055 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f441c09f3b0 0x7f441c11a6c0 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.725+0000 7f44233bb700 1 --2- 172.21.15.156:0/2203616055 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f441c09a130 0x7f441c1cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.725+0000 7f44233bb700 1 --2- 172.21.15.156:0/2203616055 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f441c09ef80 0x7f441c1cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.725+0000 7f44233bb700 1 -- 172.21.15.156:0/2203616055 >> 172.21.15.156:0/2203616055 conn(0x7f441c0a4430 msgr2=0x7f441c0a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:48.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.725+0000 7f44233bb700 1 -- 172.21.15.156:0/2203616055 shutdown_connections 2023-09-30T22:25:48.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.725+0000 7f44233bb700 1 -- 172.21.15.156:0/2203616055 wait complete. 2023-09-30T22:25:48.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.737+0000 7fad47a7f700 1 -- 172.21.15.156:0/2989217831 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fad4004f2a0 con 0x7fad40130ce0 2023-09-30T22:25:48.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.737+0000 7fad367fc700 1 -- 172.21.15.156:0/2989217831 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad38018020 con 0x7fad40130ce0 2023-09-30T22:25:48.738 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:48.739 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:48.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.739+0000 7fad47a7f700 1 -- 172.21.15.156:0/2989217831 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad40130ce0 msgr2=0x7fad4011d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.739+0000 7fad47a7f700 1 --2- 172.21.15.156:0/2989217831 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad40130ce0 0x7fad4011d870 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fad38009e70 tx=0x7fad38004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.739+0000 7fad47a7f700 1 -- 172.21.15.156:0/2989217831 shutdown_connections 2023-09-30T22:25:48.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.739+0000 7fad47a7f700 1 --2- 172.21.15.156:0/2989217831 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad40130ce0 0x7fad4011d870 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.739+0000 7fad47a7f700 1 --2- 172.21.15.156:0/2989217831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad4009d860 0x7fad4011cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.739+0000 7fad47a7f700 1 --2- 172.21.15.156:0/2989217831 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fad4009e170 0x7fad4011d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.739+0000 7fad47a7f700 1 -- 172.21.15.156:0/2989217831 >> 172.21.15.156:0/2989217831 conn(0x7fad40099c40 msgr2=0x7fad4012fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:48.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.740+0000 7fad47a7f700 1 -- 172.21.15.156:0/2989217831 shutdown_connections 2023-09-30T22:25:48.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.740+0000 7fad47a7f700 1 -- 172.21.15.156:0/2989217831 wait complete. 2023-09-30T22:25:48.752 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:48.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.797+0000 7f1b6c1a9700 1 -- 172.21.15.156:0/1103645527 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1b6406c3b0 con 0x7f1b64131cf0 2023-09-30T22:25:48.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.797+0000 7f1b5a7fc700 1 -- 172.21.15.156:0/1103645527 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1b5c017030 con 0x7f1b64131cf0 2023-09-30T22:25:48.798 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:48.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.799+0000 7f1b6c1a9700 1 -- 172.21.15.156:0/1103645527 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b64131cf0 msgr2=0x7f1b6411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.799+0000 7f1b6c1a9700 1 --2- 172.21.15.156:0/1103645527 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b64131cf0 0x7f1b6411e4c0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00cb40 tx=0x7f1b5c00ce50 comp rx=0 tx=0).stop 2023-09-30T22:25:48.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.800+0000 7f1b6c1a9700 1 -- 172.21.15.156:0/1103645527 shutdown_connections 2023-09-30T22:25:48.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.800+0000 7f1b6c1a9700 1 --2- 172.21.15.156:0/1103645527 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b64131cf0 0x7f1b6411e4c0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.800+0000 7f1b6c1a9700 1 --2- 172.21.15.156:0/1103645527 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b6406a770 0x7f1b6411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.800+0000 7f1b6c1a9700 1 --2- 172.21.15.156:0/1103645527 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1b6406b080 0x7f1b6411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.800+0000 7f1b6c1a9700 1 -- 172.21.15.156:0/1103645527 >> 172.21.15.156:0/1103645527 conn(0x7f1b64099c40 msgr2=0x7f1b641bbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:48.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.800+0000 7f1b6c1a9700 1 -- 172.21.15.156:0/1103645527 shutdown_connections 2023-09-30T22:25:48.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:48.800+0000 7f1b6c1a9700 1 -- 172.21.15.156:0/1103645527 wait complete. 2023-09-30T22:25:48.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:49.604 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:49.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.733+0000 7f071cd60700 1 Processor -- start 2023-09-30T22:25:49.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.733+0000 7f071cd60700 1 -- start start 2023-09-30T22:25:49.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.733+0000 7f071cd60700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0718136960 0x7f0718138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.733+0000 7f071cd60700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0718139280 0x7f071813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.733+0000 7f071cd60700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f071806b2d0 con 0x7f0718133ad0 2023-09-30T22:25:49.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.733+0000 7f071cd60700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07181345b0 con 0x7f0718139280 2023-09-30T22:25:49.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.733+0000 7f071cd60700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0718133610 con 0x7f0718136960 2023-09-30T22:25:49.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.734+0000 7f0716d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0718139280 0x7f071813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.734+0000 7f0715d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0718136960 0x7f0718138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.734+0000 7f0716d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0718139280 0x7f071813b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:56294/0 (socket says 172.21.15.156:56294) 2023-09-30T22:25:49.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.734+0000 7f0715d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0718136960 0x7f0718138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46432/0 (socket says 172.21.15.156:46432) 2023-09-30T22:25:49.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.734+0000 7f0716d9d700 1 -- 172.21.15.156:0/1074777410 learned_addr learned my addr 172.21.15.156:0/1074777410 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:49.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.734+0000 7f0716d9d700 1 -- 172.21.15.156:0/1074777410 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0718136960 msgr2=0x7f0718138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:49.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.734+0000 7f0716d9d700 1 --2- 172.21.15.156:0/1074777410 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0718136960 0x7f0718138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.734+0000 7f0716d9d700 1 -- 172.21.15.156:0/1074777410 >> v1:172.21.15.156:6789/0 conn(0x7f0718133ad0 legacy=0x7f0718133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.734+0000 7f0716d9d700 1 -- 172.21.15.156:0/1074777410 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071809a500 con 0x7f0718139280 2023-09-30T22:25:49.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.734+0000 7f071559a700 1 -- 172.21.15.156:0/1074777410 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 18564138 0 0) 0x7f071806b2d0 con 0x7f0718133ad0 2023-09-30T22:25:49.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.734+0000 7f0715d9b700 1 --2- 172.21.15.156:0/1074777410 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0718136960 0x7f0718138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:49.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.734+0000 7f0716d9d700 1 --2- 172.21.15.156:0/1074777410 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0718139280 0x7f071813b660 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f0710009e80 tx=0x7f071000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0b1a8dbdcd6c0d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:49.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.734+0000 7f071559a700 1 -- 172.21.15.156:0/1074777410 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071000e070 con 0x7f0718139280 2023-09-30T22:25:49.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.734+0000 7f071559a700 1 -- 172.21.15.156:0/1074777410 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071000b8d0 con 0x7f0718139280 2023-09-30T22:25:49.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.734+0000 7f071559a700 1 -- 172.21.15.156:0/1074777410 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071000bc80 con 0x7f0718139280 2023-09-30T22:25:49.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.735+0000 7f071cd60700 1 -- 172.21.15.156:0/1074777410 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0718139280 msgr2=0x7f071813b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.735+0000 7f071cd60700 1 --2- 172.21.15.156:0/1074777410 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0718139280 0x7f071813b660 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f0710009e80 tx=0x7f071000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:49.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.735+0000 7f071cd60700 1 -- 172.21.15.156:0/1074777410 shutdown_connections 2023-09-30T22:25:49.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.735+0000 7f071cd60700 1 --2- 172.21.15.156:0/1074777410 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0718139280 0x7f071813b660 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.735+0000 7f071cd60700 1 --2- 172.21.15.156:0/1074777410 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0718136960 0x7f0718138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.735+0000 7f071cd60700 1 -- 172.21.15.156:0/1074777410 >> 172.21.15.156:0/1074777410 conn(0x7f0718099c40 msgr2=0x7f07180a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:49.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.735+0000 7f071cd60700 1 -- 172.21.15.156:0/1074777410 shutdown_connections 2023-09-30T22:25:49.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.735+0000 7f071cd60700 1 -- 172.21.15.156:0/1074777410 wait complete. 2023-09-30T22:25:49.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.736+0000 7f071cd60700 1 Processor -- start 2023-09-30T22:25:49.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.736+0000 7f071cd60700 1 -- start start 2023-09-30T22:25:49.740 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:49.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.736+0000 7f071cd60700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0718133ad0 0x7f071812cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.736+0000 7f071cd60700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0718136960 0x7f071812d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.736+0000 7f071cd60700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0718139280 0x7f071812d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.736+0000 7f071cd60700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0718131830 con 0x7f0718139280 2023-09-30T22:25:49.742 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.736+0000 7f071cd60700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071809f390 con 0x7f0718133ad0 2023-09-30T22:25:49.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.736+0000 7f071cd60700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0718072270 con 0x7f0718136960 2023-09-30T22:25:49.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.736+0000 7f0715d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0718136960 0x7f071812d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.736+0000 7f0715d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0718136960 0x7f071812d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46442/0 (socket says 172.21.15.156:46442) 2023-09-30T22:25:49.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.737+0000 7f0715d9b700 1 -- 172.21.15.156:0/1780984804 learned_addr learned my addr 172.21.15.156:0/1780984804 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:49.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.737+0000 7f0716d9d700 1 --2- 172.21.15.156:0/1780984804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0718139280 0x7f071812d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.737+0000 7f071659c700 1 --2- 172.21.15.156:0/1780984804 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0718133ad0 0x7f071812cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.737+0000 7f0715d9b700 1 -- 172.21.15.156:0/1780984804 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0718133ad0 msgr2=0x7f071812cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.737+0000 7f0715d9b700 1 --2- 172.21.15.156:0/1780984804 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0718133ad0 0x7f071812cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.737+0000 7f0715d9b700 1 -- 172.21.15.156:0/1780984804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0718139280 msgr2=0x7f071812d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.737+0000 7f0715d9b700 1 --2- 172.21.15.156:0/1780984804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0718139280 0x7f071812d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.737+0000 7f0715d9b700 1 -- 172.21.15.156:0/1780984804 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070c0094a0 con 0x7f0718136960 2023-09-30T22:25:49.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.737+0000 7f0716d9d700 1 --2- 172.21.15.156:0/1780984804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0718139280 0x7f071812d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:49.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.737+0000 7f0715d9b700 1 --2- 172.21.15.156:0/1780984804 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0718136960 0x7f071812d070 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f070c00ebe0 tx=0x7f070c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:49.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.737+0000 7f0706ffd700 1 -- 172.21.15.156:0/1780984804 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c009760 con 0x7f0718136960 2023-09-30T22:25:49.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.737+0000 7f0706ffd700 1 -- 172.21.15.156:0/1780984804 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070c00c850 con 0x7f0718136960 2023-09-30T22:25:49.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.737+0000 7f071cd60700 1 -- 172.21.15.156:0/1780984804 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0710009b30 con 0x7f0718136960 2023-09-30T22:25:49.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.737+0000 7f0706ffd700 1 -- 172.21.15.156:0/1780984804 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c00cbe0 con 0x7f0718136960 2023-09-30T22:25:49.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.737+0000 7f071cd60700 1 -- 172.21.15.156:0/1780984804 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0718070c90 con 0x7f0718136960 2023-09-30T22:25:49.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.738+0000 7f0706ffd700 1 -- 172.21.15.156:0/1780984804 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f070c00cd40 con 0x7f0718136960 2023-09-30T22:25:49.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.738+0000 7f0706ffd700 1 -- 172.21.15.156:0/1780984804 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f070c03f730 con 0x7f0718136960 2023-09-30T22:25:49.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.738+0000 7f071cd60700 1 -- 172.21.15.156:0/1780984804 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f071804f2a0 con 0x7f0718136960 2023-09-30T22:25:49.745 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.743+0000 7f0706ffd700 1 -- 172.21.15.156:0/1780984804 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f070c0232f0 con 0x7f0718136960 2023-09-30T22:25:49.752 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:49.813 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:49.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.882+0000 7fca12a73700 1 Processor -- start 2023-09-30T22:25:49.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.882+0000 7fca12a73700 1 -- start start 2023-09-30T22:25:49.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.883+0000 7fca12a73700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca0c136960 0x7fca0c138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.883+0000 7fca12a73700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca0c139280 0x7fca0c13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.883+0000 7fca12a73700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca0c06b2d0 con 0x7fca0c133ad0 2023-09-30T22:25:49.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.883+0000 7fca12a73700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c1345b0 con 0x7fca0c136960 2023-09-30T22:25:49.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.883+0000 7fca12a73700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c133610 con 0x7fca0c139280 2023-09-30T22:25:49.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.883+0000 7fca0bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca0c136960 0x7fca0c138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.883+0000 7fca0bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca0c136960 0x7fca0c138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40404/0 (socket says 172.21.15.156:40404) 2023-09-30T22:25:49.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.883+0000 7fca0bfff700 1 -- 172.21.15.156:0/2852964906 learned_addr learned my addr 172.21.15.156:0/2852964906 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:49.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.883+0000 7fca11010700 1 --2- 172.21.15.156:0/2852964906 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca0c139280 0x7fca0c13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.883+0000 7fca0bfff700 1 -- 172.21.15.156:0/2852964906 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca0c139280 msgr2=0x7fca0c13b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:49.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.883+0000 7fca0bfff700 1 --2- 172.21.15.156:0/2852964906 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca0c139280 0x7fca0c13b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.883+0000 7fca0bfff700 1 -- 172.21.15.156:0/2852964906 >> v1:172.21.15.156:6789/0 conn(0x7fca0c133ad0 legacy=0x7fca0c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.883+0000 7fca0bfff700 1 -- 172.21.15.156:0/2852964906 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0c09a500 con 0x7fca0c136960 2023-09-30T22:25:49.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.883+0000 7fca0bfff700 1 --2- 172.21.15.156:0/2852964906 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca0c136960 0x7fca0c138d40 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8009920 tx=0x7fc9f8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5d4ba5eeadf442a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:49.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.884+0000 7fca0b7fe700 1 -- 172.21.15.156:0/2852964906 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f800ba60 con 0x7fca0c136960 2023-09-30T22:25:49.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.884+0000 7fca0b7fe700 1 -- 172.21.15.156:0/2852964906 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f800bbc0 con 0x7fca0c136960 2023-09-30T22:25:49.885 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.884+0000 7fca0b7fe700 1 -- 172.21.15.156:0/2852964906 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f8009e70 con 0x7fca0c136960 2023-09-30T22:25:49.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.885+0000 7fca12a73700 1 -- 172.21.15.156:0/2852964906 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca0c136960 msgr2=0x7fca0c138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.886 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.885+0000 7fca12a73700 1 --2- 172.21.15.156:0/2852964906 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca0c136960 0x7fca0c138d40 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8009920 tx=0x7fc9f8009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:49.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.885+0000 7fca12a73700 1 -- 172.21.15.156:0/2852964906 shutdown_connections 2023-09-30T22:25:49.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.885+0000 7fca12a73700 1 --2- 172.21.15.156:0/2852964906 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca0c139280 0x7fca0c13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.885+0000 7fca12a73700 1 --2- 172.21.15.156:0/2852964906 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca0c136960 0x7fca0c138d40 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.885+0000 7fca12a73700 1 -- 172.21.15.156:0/2852964906 >> 172.21.15.156:0/2852964906 conn(0x7fca0c099c40 msgr2=0x7fca0c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:49.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.885+0000 7fca12a73700 1 -- 172.21.15.156:0/2852964906 shutdown_connections 2023-09-30T22:25:49.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.885+0000 7fca12a73700 1 -- 172.21.15.156:0/2852964906 wait complete. 2023-09-30T22:25:49.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.886+0000 7fca12a73700 1 Processor -- start 2023-09-30T22:25:49.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.886+0000 7fca12a73700 1 -- start start 2023-09-30T22:25:49.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.887+0000 7fca12a73700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca0c133ad0 0x7fca0c071770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.887+0000 7fca12a73700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca0c136960 0x7fca0c071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.887+0000 7fca12a73700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca0c139280 0x7fca0c1c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.887+0000 7fca12a73700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c138fc0 con 0x7fca0c139280 2023-09-30T22:25:49.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.887+0000 7fca12a73700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c130b00 con 0x7fca0c136960 2023-09-30T22:25:49.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.887+0000 7fca12a73700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c06eec0 con 0x7fca0c133ad0 2023-09-30T22:25:49.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.887+0000 7fca1080f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca0c133ad0 0x7fca0c071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.887+0000 7fca1080f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca0c133ad0 0x7fca0c071770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46456/0 (socket says 172.21.15.156:46456) 2023-09-30T22:25:49.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.887+0000 7fca1080f700 1 -- 172.21.15.156:0/3032204999 learned_addr learned my addr 172.21.15.156:0/3032204999 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:49.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.887+0000 7fca0bfff700 1 --2- 172.21.15.156:0/3032204999 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca0c136960 0x7fca0c071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.887+0000 7fca11010700 1 --2- 172.21.15.156:0/3032204999 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca0c139280 0x7fca0c1c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.887+0000 7fca1080f700 1 -- 172.21.15.156:0/3032204999 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca0c136960 msgr2=0x7fca0c071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.887+0000 7fca1080f700 1 --2- 172.21.15.156:0/3032204999 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca0c136960 0x7fca0c071cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.887+0000 7fca1080f700 1 -- 172.21.15.156:0/3032204999 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca0c139280 msgr2=0x7fca0c1c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.887+0000 7fca1080f700 1 --2- 172.21.15.156:0/3032204999 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca0c139280 0x7fca0c1c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.887+0000 7fca1080f700 1 -- 172.21.15.156:0/3032204999 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f8009550 con 0x7fca0c133ad0 2023-09-30T22:25:49.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.887+0000 7fca1080f700 1 --2- 172.21.15.156:0/3032204999 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca0c133ad0 0x7fca0c071770 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fca0000c450 tx=0x7fca0000c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:49.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.888+0000 7fca097fa700 1 -- 172.21.15.156:0/3032204999 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca000052d0 con 0x7fca0c133ad0 2023-09-30T22:25:49.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.888+0000 7fca097fa700 1 -- 172.21.15.156:0/3032204999 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca00005430 con 0x7fca0c133ad0 2023-09-30T22:25:49.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.888+0000 7fca097fa700 1 -- 172.21.15.156:0/3032204999 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca000038c0 con 0x7fca0c133ad0 2023-09-30T22:25:49.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.888+0000 7fca12a73700 1 -- 172.21.15.156:0/3032204999 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca0c070300 con 0x7fca0c133ad0 2023-09-30T22:25:49.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.888+0000 7fca12a73700 1 -- 172.21.15.156:0/3032204999 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0c070d70 con 0x7fca0c133ad0 2023-09-30T22:25:49.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.889+0000 7fca12a73700 1 -- 172.21.15.156:0/3032204999 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca0c070140 con 0x7fca0c133ad0 2023-09-30T22:25:49.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.890+0000 7fca097fa700 1 -- 172.21.15.156:0/3032204999 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fca00003a20 con 0x7fca0c133ad0 2023-09-30T22:25:49.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.890+0000 7fca097fa700 1 -- 172.21.15.156:0/3032204999 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fca0003ed60 con 0x7fca0c133ad0 2023-09-30T22:25:49.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.894+0000 7fca097fa700 1 -- 172.21.15.156:0/3032204999 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fca00011590 con 0x7fca0c133ad0 2023-09-30T22:25:49.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.921+0000 7f1debc19700 1 Processor -- start 2023-09-30T22:25:49.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.922+0000 7f1debc19700 1 -- start start 2023-09-30T22:25:49.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.922+0000 7f1debc19700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1de4133b80 0x7f1de4133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.922+0000 7f1debc19700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1de4099a60 0x7f1de40a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.922+0000 7f1debc19700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1de40a0e20 0x7f1de40a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.922+0000 7f1debc19700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de409aa00 con 0x7f1de4099a60 2023-09-30T22:25:49.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.922+0000 7f1debc19700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de409a080 con 0x7f1de4133b80 2023-09-30T22:25:49.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.922+0000 7f1debc19700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1de4133750 con 0x7f1de40a0e20 2023-09-30T22:25:49.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.922+0000 7f1de91b4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1de4099a60 0x7f1de40a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.922+0000 7f1de99b5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1de4133b80 0x7f1de4133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.922+0000 7f1de91b4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1de4099a60 0x7f1de40a08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:56316/0 (socket says 172.21.15.156:56316) 2023-09-30T22:25:49.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.922+0000 7f1de91b4700 1 -- 172.21.15.156:0/2874771510 learned_addr learned my addr 172.21.15.156:0/2874771510 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:49.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.922+0000 7f1dea1b6700 1 --2- 172.21.15.156:0/2874771510 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1de40a0e20 0x7f1de40a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.923+0000 7f1de91b4700 1 -- 172.21.15.156:0/2874771510 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1de40a0e20 msgr2=0x7f1de40a12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:49.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.923+0000 7f1de91b4700 1 --2- 172.21.15.156:0/2874771510 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1de40a0e20 0x7f1de40a12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.923+0000 7f1de91b4700 1 -- 172.21.15.156:0/2874771510 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1de4133b80 msgr2=0x7f1de4133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:49.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.923+0000 7f1de91b4700 1 --2- 172.21.15.156:0/2874771510 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1de4133b80 0x7f1de4133f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.923+0000 7f1de91b4700 1 -- 172.21.15.156:0/2874771510 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de409a760 con 0x7f1de4099a60 2023-09-30T22:25:49.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.923+0000 7f1de91b4700 1 --2- 172.21.15.156:0/2874771510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1de4099a60 0x7f1de40a08e0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40098f0 tx=0x7f1dd4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa925095cd8be085 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:49.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.923+0000 7f1de89b3700 1 -- 172.21.15.156:0/2874771510 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4011830 con 0x7f1de4099a60 2023-09-30T22:25:49.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.923+0000 7f1de89b3700 1 -- 172.21.15.156:0/2874771510 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd4011990 con 0x7f1de4099a60 2023-09-30T22:25:49.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.923+0000 7f1de89b3700 1 -- 172.21.15.156:0/2874771510 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4011d20 con 0x7f1de4099a60 2023-09-30T22:25:49.927 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.924+0000 7f1debc19700 1 -- 172.21.15.156:0/2874771510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1de4099a60 msgr2=0x7f1de40a08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.924+0000 7f1debc19700 1 --2- 172.21.15.156:0/2874771510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1de4099a60 0x7f1de40a08e0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40098f0 tx=0x7f1dd4009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:49.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.924+0000 7f1debc19700 1 -- 172.21.15.156:0/2874771510 shutdown_connections 2023-09-30T22:25:49.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.924+0000 7f1debc19700 1 --2- 172.21.15.156:0/2874771510 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1de40a0e20 0x7f1de40a12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.924+0000 7f1debc19700 1 --2- 172.21.15.156:0/2874771510 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1de4133b80 0x7f1de4133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.924+0000 7f1debc19700 1 --2- 172.21.15.156:0/2874771510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1de4099a60 0x7f1de40a08e0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.924+0000 7f1debc19700 1 -- 172.21.15.156:0/2874771510 >> 172.21.15.156:0/2874771510 conn(0x7f1de40a2980 msgr2=0x7f1de40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:49.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.924+0000 7f1debc19700 1 -- 172.21.15.156:0/2874771510 shutdown_connections 2023-09-30T22:25:49.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.924+0000 7f1debc19700 1 -- 172.21.15.156:0/2874771510 wait complete. 2023-09-30T22:25:49.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.925+0000 7f1debc19700 1 Processor -- start 2023-09-30T22:25:49.928 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.925+0000 7f1debc19700 1 -- start start 2023-09-30T22:25:49.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.926+0000 7f1debc19700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1de4099a60 0x7f1de411a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.926+0000 7f1debc19700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1de40a0e20 0x7f1de411ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.926+0000 7f1debc19700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1de4133b80 0x7f1de411b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.926+0000 7f1debc19700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de411e180 con 0x7f1de4133b80 2023-09-30T22:25:49.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.926+0000 7f1debc19700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de412dc90 con 0x7f1de4099a60 2023-09-30T22:25:49.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.926+0000 7f1debc19700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1de411d700 con 0x7f1de40a0e20 2023-09-30T22:25:49.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.926+0000 7f1de99b5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1de4099a60 0x7f1de411a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.926+0000 7f1de99b5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1de4099a60 0x7f1de411a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:40432/0 (socket says 172.21.15.156:40432) 2023-09-30T22:25:49.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.926+0000 7f1de99b5700 1 -- 172.21.15.156:0/4211144641 learned_addr learned my addr 172.21.15.156:0/4211144641 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:49.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.926+0000 7f1dea1b6700 1 --2- 172.21.15.156:0/4211144641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1de4133b80 0x7f1de411b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.926+0000 7f1de91b4700 1 --2- 172.21.15.156:0/4211144641 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1de40a0e20 0x7f1de411ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.926+0000 7f1de99b5700 1 -- 172.21.15.156:0/4211144641 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1de40a0e20 msgr2=0x7f1de411ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.929 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.926+0000 7f1de99b5700 1 --2- 172.21.15.156:0/4211144641 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1de40a0e20 0x7f1de411ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.926+0000 7f1de99b5700 1 -- 172.21.15.156:0/4211144641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1de4133b80 msgr2=0x7f1de411b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.926+0000 7f1de99b5700 1 --2- 172.21.15.156:0/4211144641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1de4133b80 0x7f1de411b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.926+0000 7f1de99b5700 1 -- 172.21.15.156:0/4211144641 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd4009550 con 0x7f1de4099a60 2023-09-30T22:25:49.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.926+0000 7f1de99b5700 1 --2- 172.21.15.156:0/4211144641 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1de4099a60 0x7f1de411a8a0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f1de000e990 tx=0x7f1de000eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:49.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.926+0000 7f1dda7fc700 1 -- 172.21.15.156:0/4211144641 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de00096f0 con 0x7f1de4099a60 2023-09-30T22:25:49.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.927+0000 7f1dda7fc700 1 -- 172.21.15.156:0/4211144641 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de000c850 con 0x7f1de4099a60 2023-09-30T22:25:49.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.927+0000 7f1dda7fc700 1 -- 172.21.15.156:0/4211144641 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de000cbc0 con 0x7f1de4099a60 2023-09-30T22:25:49.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.927+0000 7f1debc19700 1 -- 172.21.15.156:0/4211144641 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de411db50 con 0x7f1de4099a60 2023-09-30T22:25:49.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.927+0000 7f1debc19700 1 -- 172.21.15.156:0/4211144641 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de409a2c0 con 0x7f1de4099a60 2023-09-30T22:25:49.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.928+0000 7f1dda7fc700 1 -- 172.21.15.156:0/4211144641 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1de000cd20 con 0x7f1de4099a60 2023-09-30T22:25:49.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.928+0000 7f1debc19700 1 -- 172.21.15.156:0/4211144641 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de409e9b0 con 0x7f1de4099a60 2023-09-30T22:25:49.931 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.928+0000 7f1dda7fc700 1 -- 172.21.15.156:0/4211144641 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1de003fad0 con 0x7f1de4099a60 2023-09-30T22:25:49.937 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.937+0000 7f1dda7fc700 1 -- 172.21.15.156:0/4211144641 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1de001ada0 con 0x7f1de4099a60 2023-09-30T22:25:49.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.951+0000 7f071cd60700 1 -- 172.21.15.156:0/1780984804 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f071806fec0 con 0x7f0718136960 2023-09-30T22:25:49.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.952+0000 7f0706ffd700 1 -- 172.21.15.156:0/1780984804 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f070c021030 con 0x7f0718136960 2023-09-30T22:25:49.952 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:49.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.956+0000 7f071cd60700 1 -- 172.21.15.156:0/1780984804 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0718136960 msgr2=0x7f071812d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.956+0000 7f071cd60700 1 --2- 172.21.15.156:0/1780984804 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0718136960 0x7f071812d070 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f070c00ebe0 tx=0x7f070c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.957+0000 7f071cd60700 1 -- 172.21.15.156:0/1780984804 shutdown_connections 2023-09-30T22:25:49.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.957+0000 7f071cd60700 1 --2- 172.21.15.156:0/1780984804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0718139280 0x7f071812d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.957+0000 7f071cd60700 1 --2- 172.21.15.156:0/1780984804 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0718133ad0 0x7f071812cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.957+0000 7f071cd60700 1 --2- 172.21.15.156:0/1780984804 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0718136960 0x7f071812d070 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.957+0000 7f071cd60700 1 -- 172.21.15.156:0/1780984804 >> 172.21.15.156:0/1780984804 conn(0x7f0718099c40 msgr2=0x7f07181385e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:49.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.957+0000 7f071cd60700 1 -- 172.21.15.156:0/1780984804 shutdown_connections 2023-09-30T22:25:49.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.957+0000 7f071cd60700 1 -- 172.21.15.156:0/1780984804 wait complete. 2023-09-30T22:25:49.972 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:49.973 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.971+0000 7f13b8493700 1 Processor -- start 2023-09-30T22:25:49.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.971+0000 7f13b8493700 1 -- start start 2023-09-30T22:25:49.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.972+0000 7f13b8493700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f13b009d860 0x7f13b009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.972+0000 7f13b8493700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13b0130eb0 0x7f13b0138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.972+0000 7f13b8493700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b009aaa0 con 0x7f13b009e170 2023-09-30T22:25:49.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.972+0000 7f13b8493700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b009f870 con 0x7f13b009d860 2023-09-30T22:25:49.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.972+0000 7f13b8493700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b009b360 con 0x7f13b0130eb0 2023-09-30T22:25:49.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.972+0000 7f13b5a2e700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f13b009e170 0x7f13b01307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:43972/0 (socket says 172.21.15.156:43972) 2023-09-30T22:25:49.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.972+0000 7f13b6a30700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13b0130eb0 0x7f13b0138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.974 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.972+0000 7f13b5a2e700 1 -- 172.21.15.156:0/2382206791 learned_addr learned my addr 172.21.15.156:0/2382206791 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:49.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.972+0000 7f13b622f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f13b009d860 0x7f13b009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.972+0000 7f13b522d700 1 -- 172.21.15.156:0/2382206791 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4122120404 0 0) 0x7f13b009aaa0 con 0x7f13b009e170 2023-09-30T22:25:49.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.972+0000 7f13b522d700 1 -- 172.21.15.156:0/2382206791 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f139c0035b0 con 0x7f13b009e170 2023-09-30T22:25:49.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.972+0000 7f13b622f700 1 -- 172.21.15.156:0/2382206791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13b0130eb0 msgr2=0x7f13b0138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:49.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.972+0000 7f13b622f700 1 --2- 172.21.15.156:0/2382206791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13b0130eb0 0x7f13b0138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.972+0000 7f13b622f700 1 -- 172.21.15.156:0/2382206791 >> v1:172.21.15.156:6789/0 conn(0x7f13b009e170 legacy=0x7f13b01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.972+0000 7f13b622f700 1 -- 172.21.15.156:0/2382206791 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b009b620 con 0x7f13b009d860 2023-09-30T22:25:49.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.972+0000 7f13b6a30700 1 --2- 172.21.15.156:0/2382206791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13b0130eb0 0x7f13b0138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:49.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.973+0000 7f13b622f700 1 --2- 172.21.15.156:0/2382206791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13b009d860 0x7f13b009dc30 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f13ac009840 tx=0x7f13ac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3607df97a5e7fee server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:49.975 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.973+0000 7f13b522d700 1 -- 172.21.15.156:0/2382206791 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac011830 con 0x7f13b009d860 2023-09-30T22:25:49.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.973+0000 7f13b522d700 1 -- 172.21.15.156:0/2382206791 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13ac011990 con 0x7f13b009d860 2023-09-30T22:25:49.976 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.973+0000 7f13b522d700 1 -- 172.21.15.156:0/2382206791 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac011d00 con 0x7f13b009d860 2023-09-30T22:25:49.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.973+0000 7f13b8493700 1 -- 172.21.15.156:0/2382206791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13b009d860 msgr2=0x7f13b009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.973+0000 7f13b8493700 1 --2- 172.21.15.156:0/2382206791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13b009d860 0x7f13b009dc30 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f13ac009840 tx=0x7f13ac009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:49.978 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.973+0000 7f13b8493700 1 -- 172.21.15.156:0/2382206791 shutdown_connections 2023-09-30T22:25:49.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.973+0000 7f13b8493700 1 --2- 172.21.15.156:0/2382206791 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13b0130eb0 0x7f13b0138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.973+0000 7f13b8493700 1 --2- 172.21.15.156:0/2382206791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13b009d860 0x7f13b009dc30 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.974+0000 7f13b8493700 1 -- 172.21.15.156:0/2382206791 >> 172.21.15.156:0/2382206791 conn(0x7f13b0099c40 msgr2=0x7f13b00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:49.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.974+0000 7f13b8493700 1 -- 172.21.15.156:0/2382206791 shutdown_connections 2023-09-30T22:25:49.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.974+0000 7f13b8493700 1 -- 172.21.15.156:0/2382206791 wait complete. 2023-09-30T22:25:49.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.974+0000 7f13b8493700 1 Processor -- start 2023-09-30T22:25:49.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.974+0000 7f13b8493700 1 -- start start 2023-09-30T22:25:49.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.975+0000 7f13b8493700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13b009d860 0x7f13b01c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.975+0000 7f13b8493700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13b009e170 0x7f13b01c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.979 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.975+0000 7f13b8493700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13b0130eb0 0x7f13b01c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.975+0000 7f13b8493700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b0137570 con 0x7f13b009d860 2023-09-30T22:25:49.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.975+0000 7f13b8493700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b0137b60 con 0x7f13b009e170 2023-09-30T22:25:49.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.975+0000 7f13b8493700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13b0139410 con 0x7f13b0130eb0 2023-09-30T22:25:49.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.975+0000 7f13b622f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13b009d860 0x7f13b01c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.975+0000 7f13b622f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13b009d860 0x7f13b01c82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:56336/0 (socket says 172.21.15.156:56336) 2023-09-30T22:25:49.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.975+0000 7f13b622f700 1 -- 172.21.15.156:0/3349030661 learned_addr learned my addr 172.21.15.156:0/3349030661 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:49.980 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.975+0000 7f13b5a2e700 1 --2- 172.21.15.156:0/3349030661 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13b009e170 0x7f13b01c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.975+0000 7f13b6a30700 1 --2- 172.21.15.156:0/3349030661 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13b0130eb0 0x7f13b01c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.975+0000 7f13b5a2e700 1 -- 172.21.15.156:0/3349030661 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13b0130eb0 msgr2=0x7f13b01c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.975+0000 7f13b5a2e700 1 --2- 172.21.15.156:0/3349030661 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13b0130eb0 0x7f13b01c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.975+0000 7f13b5a2e700 1 -- 172.21.15.156:0/3349030661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13b009d860 msgr2=0x7f13b01c82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.975+0000 7f13b5a2e700 1 --2- 172.21.15.156:0/3349030661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13b009d860 0x7f13b01c82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.975+0000 7f13b5a2e700 1 -- 172.21.15.156:0/3349030661 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a8009a70 con 0x7f13b009e170 2023-09-30T22:25:49.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.975+0000 7f13b622f700 1 --2- 172.21.15.156:0/3349030661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13b009d860 0x7f13b01c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:49.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.975+0000 7f13b5a2e700 1 --2- 172.21.15.156:0/3349030661 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13b009e170 0x7f13b01c87f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f13a000c490 tx=0x7f13a000c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:49.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.976+0000 7f13a6ffd700 1 -- 172.21.15.156:0/3349030661 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a0005d70 con 0x7f13b009e170 2023-09-30T22:25:49.981 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.976+0000 7f13a6ffd700 1 -- 172.21.15.156:0/3349030661 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a00070d0 con 0x7f13b009e170 2023-09-30T22:25:49.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.976+0000 7f13b8493700 1 -- 172.21.15.156:0/3349030661 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13ac0094a0 con 0x7f13b009e170 2023-09-30T22:25:49.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.976+0000 7f13a6ffd700 1 -- 172.21.15.156:0/3349030661 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a0007440 con 0x7f13b009e170 2023-09-30T22:25:49.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.976+0000 7f13b8493700 1 -- 172.21.15.156:0/3349030661 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b0139130 con 0x7f13b009e170 2023-09-30T22:25:49.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.976+0000 7f13a6ffd700 1 -- 172.21.15.156:0/3349030661 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f13a00075a0 con 0x7f13b009e170 2023-09-30T22:25:49.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.977+0000 7f13a6ffd700 1 -- 172.21.15.156:0/3349030661 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f13a003eb40 con 0x7f13b009e170 2023-09-30T22:25:49.982 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.977+0000 7f13b8493700 1 -- 172.21.15.156:0/3349030661 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b004f2a0 con 0x7f13b009e170 2023-09-30T22:25:49.987 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:49.986+0000 7f13a6ffd700 1 -- 172.21.15.156:0/3349030661 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f13a001bb10 con 0x7f13b009e170 2023-09-30T22:25:50.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.094+0000 7fca12a73700 1 -- 172.21.15.156:0/3032204999 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fca0c06ffa0 con 0x7fca0c133ad0 2023-09-30T22:25:50.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.094+0000 7fca097fa700 1 -- 172.21.15.156:0/3032204999 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fca0c06ffa0 con 0x7fca0c133ad0 2023-09-30T22:25:50.095 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:50.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.096+0000 7fca12a73700 1 -- 172.21.15.156:0/3032204999 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca0c133ad0 msgr2=0x7fca0c071770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:50.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.096+0000 7fca12a73700 1 --2- 172.21.15.156:0/3032204999 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca0c133ad0 0x7fca0c071770 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fca0000c450 tx=0x7fca0000c760 comp rx=0 tx=0).stop 2023-09-30T22:25:50.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.096+0000 7fca12a73700 1 -- 172.21.15.156:0/3032204999 shutdown_connections 2023-09-30T22:25:50.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.096+0000 7fca12a73700 1 --2- 172.21.15.156:0/3032204999 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca0c139280 0x7fca0c1c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.096+0000 7fca12a73700 1 --2- 172.21.15.156:0/3032204999 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fca0c133ad0 0x7fca0c071770 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.096+0000 7fca12a73700 1 --2- 172.21.15.156:0/3032204999 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fca0c136960 0x7fca0c071cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.096+0000 7fca12a73700 1 -- 172.21.15.156:0/3032204999 >> 172.21.15.156:0/3032204999 conn(0x7fca0c099c40 msgr2=0x7fca0c134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:50.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.097+0000 7fca12a73700 1 -- 172.21.15.156:0/3032204999 shutdown_connections 2023-09-30T22:25:50.098 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.097+0000 7fca12a73700 1 -- 172.21.15.156:0/3032204999 wait complete. 2023-09-30T22:25:50.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:50.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.140+0000 7f1debc19700 1 -- 172.21.15.156:0/4211144641 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1de409b0e0 con 0x7f1de4099a60 2023-09-30T22:25:50.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.141+0000 7f1dda7fc700 1 -- 172.21.15.156:0/4211144641 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1de0017020 con 0x7f1de4099a60 2023-09-30T22:25:50.142 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:50.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.143+0000 7f1debc19700 1 -- 172.21.15.156:0/4211144641 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1de4099a60 msgr2=0x7f1de411a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:50.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.143+0000 7f1debc19700 1 --2- 172.21.15.156:0/4211144641 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1de4099a60 0x7f1de411a8a0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f1de000e990 tx=0x7f1de000eca0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.143+0000 7f1debc19700 1 -- 172.21.15.156:0/4211144641 shutdown_connections 2023-09-30T22:25:50.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.143+0000 7f1debc19700 1 --2- 172.21.15.156:0/4211144641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1de4133b80 0x7f1de411b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.143+0000 7f1debc19700 1 --2- 172.21.15.156:0/4211144641 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1de4099a60 0x7f1de411a8a0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.143+0000 7f1debc19700 1 --2- 172.21.15.156:0/4211144641 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1de40a0e20 0x7f1de411ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.143+0000 7f1debc19700 1 -- 172.21.15.156:0/4211144641 >> 172.21.15.156:0/4211144641 conn(0x7f1de40a2980 msgr2=0x7f1de412f740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:50.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.143+0000 7f1debc19700 1 -- 172.21.15.156:0/4211144641 shutdown_connections 2023-09-30T22:25:50.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.143+0000 7f1debc19700 1 -- 172.21.15.156:0/4211144641 wait complete. 2023-09-30T22:25:50.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:50.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.180+0000 7f13b8493700 1 -- 172.21.15.156:0/3349030661 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f13b0137cf0 con 0x7f13b009e170 2023-09-30T22:25:50.181 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.180+0000 7f13a6ffd700 1 -- 172.21.15.156:0/3349030661 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f13a00192c0 con 0x7f13b009e170 2023-09-30T22:25:50.181 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:50.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.182+0000 7f13b8493700 1 -- 172.21.15.156:0/3349030661 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13b009e170 msgr2=0x7f13b01c87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:50.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.182+0000 7f13b8493700 1 --2- 172.21.15.156:0/3349030661 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13b009e170 0x7f13b01c87f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f13a000c490 tx=0x7f13a000c7a0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.182+0000 7f13b8493700 1 -- 172.21.15.156:0/3349030661 shutdown_connections 2023-09-30T22:25:50.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.182+0000 7f13b8493700 1 --2- 172.21.15.156:0/3349030661 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f13b0130eb0 0x7f13b01c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.182+0000 7f13b8493700 1 --2- 172.21.15.156:0/3349030661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13b009d860 0x7f13b01c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.182+0000 7f13b8493700 1 --2- 172.21.15.156:0/3349030661 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f13b009e170 0x7f13b01c87f0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.182+0000 7f13b8493700 1 -- 172.21.15.156:0/3349030661 >> 172.21.15.156:0/3349030661 conn(0x7f13b0099c40 msgr2=0x7f13b013b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:50.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.182+0000 7f13b8493700 1 -- 172.21.15.156:0/3349030661 shutdown_connections 2023-09-30T22:25:50.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:50.182+0000 7f13b8493700 1 -- 172.21.15.156:0/3349030661 wait complete. 2023-09-30T22:25:50.195 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:50.973 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:51.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.107+0000 7f977a541700 1 Processor -- start 2023-09-30T22:25:51.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.107+0000 7f977a541700 1 -- start start 2023-09-30T22:25:51.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.108+0000 7f977a541700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f977409ad40 0x7f9774133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.108+0000 7f977a541700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f97741343a0 0x7f97740a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.108+0000 7f977a541700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f977409b110 con 0x7f9774133f70 2023-09-30T22:25:51.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.108+0000 7f977a541700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97740a3b60 con 0x7f97741343a0 2023-09-30T22:25:51.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.108+0000 7f977a541700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97740a2fa0 con 0x7f977409ad40 2023-09-30T22:25:51.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.108+0000 7f9773fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f977409ad40 0x7f9774133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.108+0000 7f97737fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f9774133f70 0x7f97740a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:43984/0 (socket says 172.21.15.156:43984) 2023-09-30T22:25:51.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.108+0000 7f9778ade700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f97741343a0 0x7f97740a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.108+0000 7f97737fe700 1 -- 172.21.15.156:0/2045602753 learned_addr learned my addr 172.21.15.156:0/2045602753 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:51.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.108+0000 7f9773fff700 1 -- 172.21.15.156:0/2045602753 >> v2:172.21.15.156:3300/0 conn(0x7f97741343a0 msgr2=0x7f97740a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:51.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.108+0000 7f9773fff700 1 --2- 172.21.15.156:0/2045602753 >> v2:172.21.15.156:3300/0 conn(0x7f97741343a0 0x7f97740a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.108+0000 7f9773fff700 1 -- 172.21.15.156:0/2045602753 >> v1:172.21.15.156:6789/0 conn(0x7f9774133f70 legacy=0x7f97740a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.108+0000 7f9773fff700 1 -- 172.21.15.156:0/2045602753 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977409a280 con 0x7f977409ad40 2023-09-30T22:25:51.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.108+0000 7f9778ade700 1 --2- 172.21.15.156:0/2045602753 >> v2:172.21.15.156:3300/0 conn(0x7f97741343a0 0x7f97740a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:51.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.109+0000 7f9773fff700 1 --2- 172.21.15.156:0/2045602753 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f977409ad40 0x7f9774133a30 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f9764009870 tx=0x7f9764009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dfb14be4631eb62 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:51.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.109+0000 7f9772ffd700 1 -- 172.21.15.156:0/2045602753 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9764011830 con 0x7f977409ad40 2023-09-30T22:25:51.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.109+0000 7f9772ffd700 1 -- 172.21.15.156:0/2045602753 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9764011990 con 0x7f977409ad40 2023-09-30T22:25:51.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.109+0000 7f9772ffd700 1 -- 172.21.15.156:0/2045602753 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9764011d20 con 0x7f977409ad40 2023-09-30T22:25:51.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.109+0000 7f977a541700 1 -- 172.21.15.156:0/2045602753 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f977409ad40 msgr2=0x7f9774133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.109+0000 7f977a541700 1 --2- 172.21.15.156:0/2045602753 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f977409ad40 0x7f9774133a30 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f9764009870 tx=0x7f9764009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:51.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.109+0000 7f977a541700 1 -- 172.21.15.156:0/2045602753 shutdown_connections 2023-09-30T22:25:51.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.109+0000 7f977a541700 1 --2- 172.21.15.156:0/2045602753 >> v2:172.21.15.156:3300/0 conn(0x7f97741343a0 0x7f97740a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.109+0000 7f977a541700 1 --2- 172.21.15.156:0/2045602753 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f977409ad40 0x7f9774133a30 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.109+0000 7f977a541700 1 -- 172.21.15.156:0/2045602753 >> 172.21.15.156:0/2045602753 conn(0x7f9774099c40 msgr2=0x7f977406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:51.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.109+0000 7f977a541700 1 -- 172.21.15.156:0/2045602753 shutdown_connections 2023-09-30T22:25:51.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.109+0000 7f977a541700 1 -- 172.21.15.156:0/2045602753 wait complete. 2023-09-30T22:25:51.113 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:51.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.110+0000 7f977a541700 1 Processor -- start 2023-09-30T22:25:51.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.110+0000 7f977a541700 1 -- start start 2023-09-30T22:25:51.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.111+0000 7f977a541700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f977409ad40 0x7f9774121500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.111+0000 7f977a541700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9774133f70 0x7f9774121a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.111+0000 7f977a541700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97741343a0 0x7f9774121f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.111+0000 7f977a541700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97741328d0 con 0x7f97741343a0 2023-09-30T22:25:51.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.111+0000 7f977a541700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9774122960 con 0x7f977409ad40 2023-09-30T22:25:51.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.111+0000 7f977a541700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9774123fa0 con 0x7f9774133f70 2023-09-30T22:25:51.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.111+0000 7f97737fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9774133f70 0x7f9774121a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.111+0000 7f9773fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f977409ad40 0x7f9774121500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.111+0000 7f9778ade700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97741343a0 0x7f9774121f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.111+0000 7f97737fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9774133f70 0x7f9774121a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:46518/0 (socket says 172.21.15.156:46518) 2023-09-30T22:25:51.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.111+0000 7f97737fe700 1 -- 172.21.15.156:0/1996155072 learned_addr learned my addr 172.21.15.156:0/1996155072 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:51.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.111+0000 7f97737fe700 1 -- 172.21.15.156:0/1996155072 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f977409ad40 msgr2=0x7f9774121500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.111+0000 7f97737fe700 1 --2- 172.21.15.156:0/1996155072 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f977409ad40 0x7f9774121500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.111+0000 7f97737fe700 1 -- 172.21.15.156:0/1996155072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97741343a0 msgr2=0x7f9774121f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.111+0000 7f97737fe700 1 --2- 172.21.15.156:0/1996155072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97741343a0 0x7f9774121f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.111+0000 7f97737fe700 1 -- 172.21.15.156:0/1996155072 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c009a70 con 0x7f9774133f70 2023-09-30T22:25:51.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.111+0000 7f97737fe700 1 --2- 172.21.15.156:0/1996155072 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9774133f70 0x7f9774121a40 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f975c00c500 tx=0x7f975c00c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:51.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.111+0000 7f9770ff9700 1 -- 172.21.15.156:0/1996155072 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c005d70 con 0x7f9774133f70 2023-09-30T22:25:51.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.111+0000 7f9770ff9700 1 -- 172.21.15.156:0/1996155072 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975c0070d0 con 0x7f9774133f70 2023-09-30T22:25:51.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.111+0000 7f977a541700 1 -- 172.21.15.156:0/1996155072 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97640094a0 con 0x7f9774133f70 2023-09-30T22:25:51.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.111+0000 7f9770ff9700 1 -- 172.21.15.156:0/1996155072 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c007440 con 0x7f9774133f70 2023-09-30T22:25:51.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.112+0000 7f977a541700 1 -- 172.21.15.156:0/1996155072 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97741247b0 con 0x7f9774133f70 2023-09-30T22:25:51.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.112+0000 7f977a541700 1 -- 172.21.15.156:0/1996155072 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97740a4d40 con 0x7f9774133f70 2023-09-30T22:25:51.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.113+0000 7f9770ff9700 1 -- 172.21.15.156:0/1996155072 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f975c0075a0 con 0x7f9774133f70 2023-09-30T22:25:51.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.113+0000 7f9770ff9700 1 -- 172.21.15.156:0/1996155072 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f975c03eec0 con 0x7f9774133f70 2023-09-30T22:25:51.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.117+0000 7f9770ff9700 1 -- 172.21.15.156:0/1996155072 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f975c019b40 con 0x7f9774133f70 2023-09-30T22:25:51.156 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:51.195 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:51.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.259+0000 7f4a62464700 1 Processor -- start 2023-09-30T22:25:51.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.259+0000 7f4a62464700 1 -- start start 2023-09-30T22:25:51.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.260+0000 7f4a62464700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a5c09f350 0x7f4a5c136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.260+0000 7f4a62464700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4a5c1371c0 0x7f4a5c1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.260+0000 7f4a62464700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a5c09c970 con 0x7f4a5c09e870 2023-09-30T22:25:51.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.260+0000 7f4a62464700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a5c0a0920 con 0x7f4a5c1371c0 2023-09-30T22:25:51.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.260+0000 7f4a62464700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c09f9c0 con 0x7f4a5c09f350 2023-09-30T22:25:51.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.260+0000 7f4a5b7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a5c09f350 0x7f4a5c136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.260+0000 7f4a5bfff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4a5c09e870 0x7f4a5c09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38458/0 (socket says 172.21.15.156:38458) 2023-09-30T22:25:51.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.260+0000 7f4a5bfff700 1 -- 172.21.15.156:0/677715064 learned_addr learned my addr 172.21.15.156:0/677715064 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:51.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.260+0000 7f4a60a01700 1 --2- 172.21.15.156:0/677715064 >> v2:172.21.15.156:3300/0 conn(0x7f4a5c1371c0 0x7f4a5c1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.261+0000 7f4a5b7fe700 1 -- 172.21.15.156:0/677715064 >> v2:172.21.15.156:3300/0 conn(0x7f4a5c1371c0 msgr2=0x7f4a5c1395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:51.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.261+0000 7f4a5b7fe700 1 --2- 172.21.15.156:0/677715064 >> v2:172.21.15.156:3300/0 conn(0x7f4a5c1371c0 0x7f4a5c1395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.261+0000 7f4a5b7fe700 1 -- 172.21.15.156:0/677715064 >> v1:172.21.15.156:6789/0 conn(0x7f4a5c09e870 legacy=0x7f4a5c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.261+0000 7f4a5affd700 1 -- 172.21.15.156:0/677715064 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 914644626 0 0) 0x7f4a5c09c970 con 0x7f4a5c09e870 2023-09-30T22:25:51.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.261+0000 7f4a5b7fe700 1 -- 172.21.15.156:0/677715064 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5c09bab0 con 0x7f4a5c09f350 2023-09-30T22:25:51.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.261+0000 7f4a60a01700 1 --2- 172.21.15.156:0/677715064 >> v2:172.21.15.156:3300/0 conn(0x7f4a5c1371c0 0x7f4a5c1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:51.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.261+0000 7f4a5b7fe700 1 --2- 172.21.15.156:0/677715064 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a5c09f350 0x7f4a5c136c80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f4a50009840 tx=0x7f4a50009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=741cd96d539ba180 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:51.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.261+0000 7f4a5affd700 1 -- 172.21.15.156:0/677715064 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a50011830 con 0x7f4a5c09f350 2023-09-30T22:25:51.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.261+0000 7f4a5affd700 1 -- 172.21.15.156:0/677715064 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50011990 con 0x7f4a5c09f350 2023-09-30T22:25:51.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.261+0000 7f4a5affd700 1 -- 172.21.15.156:0/677715064 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a50011d20 con 0x7f4a5c09f350 2023-09-30T22:25:51.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.262+0000 7f4a62464700 1 -- 172.21.15.156:0/677715064 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a5c09f350 msgr2=0x7f4a5c136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.262+0000 7f4a62464700 1 --2- 172.21.15.156:0/677715064 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a5c09f350 0x7f4a5c136c80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f4a50009840 tx=0x7f4a50009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:51.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.262+0000 7f4a62464700 1 -- 172.21.15.156:0/677715064 shutdown_connections 2023-09-30T22:25:51.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.262+0000 7f4a62464700 1 --2- 172.21.15.156:0/677715064 >> v2:172.21.15.156:3300/0 conn(0x7f4a5c1371c0 0x7f4a5c1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.262+0000 7f4a62464700 1 --2- 172.21.15.156:0/677715064 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a5c09f350 0x7f4a5c136c80 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.262+0000 7f4a62464700 1 -- 172.21.15.156:0/677715064 >> 172.21.15.156:0/677715064 conn(0x7f4a5c0a4430 msgr2=0x7f4a5c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:51.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.262+0000 7f4a62464700 1 -- 172.21.15.156:0/677715064 shutdown_connections 2023-09-30T22:25:51.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.262+0000 7f4a62464700 1 -- 172.21.15.156:0/677715064 wait complete. 2023-09-30T22:25:51.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.263+0000 7f4a62464700 1 Processor -- start 2023-09-30T22:25:51.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.263+0000 7f4a62464700 1 -- start start 2023-09-30T22:25:51.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.264+0000 7f4a62464700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a5c09e870 0x7f4a5c120820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.264+0000 7f4a62464700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4a5c09f350 0x7f4a5c120d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.264+0000 7f4a62464700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a5c1371c0 0x7f4a5c1212a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.264+0000 7f4a62464700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c122cc0 con 0x7f4a5c09e870 2023-09-30T22:25:51.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.264+0000 7f4a62464700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c136110 con 0x7f4a5c09f350 2023-09-30T22:25:51.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.264+0000 7f4a62464700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c0722e0 con 0x7f4a5c1371c0 2023-09-30T22:25:51.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.264+0000 7f4a5bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a5c09e870 0x7f4a5c120820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.264+0000 7f4a5bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a5c09e870 0x7f4a5c120820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49790/0 (socket says 172.21.15.156:49790) 2023-09-30T22:25:51.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.264+0000 7f4a5bfff700 1 -- 172.21.15.156:0/3675789905 learned_addr learned my addr 172.21.15.156:0/3675789905 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:51.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.264+0000 7f4a60a01700 1 --2- 172.21.15.156:0/3675789905 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a5c1371c0 0x7f4a5c1212a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.264+0000 7f4a5b7fe700 1 --2- 172.21.15.156:0/3675789905 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4a5c09f350 0x7f4a5c120d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.264+0000 7f4a5bfff700 1 -- 172.21.15.156:0/3675789905 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a5c1371c0 msgr2=0x7f4a5c1212a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.264+0000 7f4a5bfff700 1 --2- 172.21.15.156:0/3675789905 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a5c1371c0 0x7f4a5c1212a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.264+0000 7f4a5bfff700 1 -- 172.21.15.156:0/3675789905 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4a5c09f350 msgr2=0x7f4a5c120d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.264+0000 7f4a5bfff700 1 --2- 172.21.15.156:0/3675789905 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4a5c09f350 0x7f4a5c120d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.264+0000 7f4a5bfff700 1 -- 172.21.15.156:0/3675789905 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a500094a0 con 0x7f4a5c09e870 2023-09-30T22:25:51.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.265+0000 7f4a5bfff700 1 --2- 172.21.15.156:0/3675789905 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a5c09e870 0x7f4a5c120820 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00c520 tx=0x7f4a4c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:51.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.265+0000 7f4a58ff9700 1 -- 172.21.15.156:0/3675789905 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c004c80 con 0x7f4a5c09e870 2023-09-30T22:25:51.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.265+0000 7f4a62464700 1 -- 172.21.15.156:0/3675789905 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5c1366d0 con 0x7f4a5c09e870 2023-09-30T22:25:51.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.265+0000 7f4a58ff9700 1 -- 172.21.15.156:0/3675789905 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4c004e00 con 0x7f4a5c09e870 2023-09-30T22:25:51.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.265+0000 7f4a58ff9700 1 -- 172.21.15.156:0/3675789905 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c007310 con 0x7f4a5c09e870 2023-09-30T22:25:51.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.265+0000 7f4a62464700 1 -- 172.21.15.156:0/3675789905 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5c123db0 con 0x7f4a5c09e870 2023-09-30T22:25:51.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.266+0000 7f4a62464700 1 -- 172.21.15.156:0/3675789905 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a5c04f2a0 con 0x7f4a5c09e870 2023-09-30T22:25:51.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.266+0000 7f4a58ff9700 1 -- 172.21.15.156:0/3675789905 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4a4c007470 con 0x7f4a5c09e870 2023-09-30T22:25:51.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.268+0000 7f4a58ff9700 1 -- 172.21.15.156:0/3675789905 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4a4c040d30 con 0x7f4a5c09e870 2023-09-30T22:25:51.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.271+0000 7f4a58ff9700 1 -- 172.21.15.156:0/3675789905 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4a4c044060 con 0x7f4a5c09e870 2023-09-30T22:25:51.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.292+0000 7f89922a2700 1 Processor -- start 2023-09-30T22:25:51.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.292+0000 7f89922a2700 1 -- start start 2023-09-30T22:25:51.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.293+0000 7f89922a2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f898c09e870 0x7f898c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.293+0000 7f89922a2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f898c09f180 0x7f898c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.293+0000 7f89922a2700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f898c09c970 con 0x7f898c131d70 2023-09-30T22:25:51.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.293+0000 7f89922a2700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f898c0a0920 con 0x7f898c09e870 2023-09-30T22:25:51.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.293+0000 7f89922a2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898c09f9c0 con 0x7f898c09f180 2023-09-30T22:25:51.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.293+0000 7f898bfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f898c09e870 0x7f898c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.293+0000 7f898b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f898c09f180 0x7f898c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.293+0000 7f898bfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f898c09e870 0x7f898c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49794/0 (socket says 172.21.15.156:49794) 2023-09-30T22:25:51.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.293+0000 7f898bfff700 1 -- 172.21.15.156:0/2473990442 learned_addr learned my addr 172.21.15.156:0/2473990442 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:51.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.293+0000 7f899083f700 1 --1- 172.21.15.156:0/2473990442 >> v1:172.21.15.156:6789/0 conn(0x7f898c131d70 0x7f898c138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38466/0 (socket says 172.21.15.156:38466) 2023-09-30T22:25:51.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.294+0000 7f898b7fe700 1 -- 172.21.15.156:0/2473990442 >> v2:172.21.15.156:3300/0 conn(0x7f898c09e870 msgr2=0x7f898c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:51.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.294+0000 7f898b7fe700 1 --2- 172.21.15.156:0/2473990442 >> v2:172.21.15.156:3300/0 conn(0x7f898c09e870 0x7f898c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.294+0000 7f898b7fe700 1 -- 172.21.15.156:0/2473990442 >> v1:172.21.15.156:6789/0 conn(0x7f898c131d70 legacy=0x7f898c138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.294+0000 7f898b7fe700 1 -- 172.21.15.156:0/2473990442 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898c09bab0 con 0x7f898c09f180 2023-09-30T22:25:51.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.294+0000 7f898affd700 1 -- 172.21.15.156:0/2473990442 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1958158665 0 0) 0x7f898c09c970 con 0x7f898c131d70 2023-09-30T22:25:51.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.294+0000 7f898bfff700 1 --2- 172.21.15.156:0/2473990442 >> v2:172.21.15.156:3300/0 conn(0x7f898c09e870 0x7f898c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:51.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.294+0000 7f898b7fe700 1 --2- 172.21.15.156:0/2473990442 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f898c09f180 0x7f898c131830 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f8980009840 tx=0x7f8980009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15897aab93838fd1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:51.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.294+0000 7f898affd700 1 -- 172.21.15.156:0/2473990442 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8980011830 con 0x7f898c09f180 2023-09-30T22:25:51.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.294+0000 7f898affd700 1 -- 172.21.15.156:0/2473990442 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8980011990 con 0x7f898c09f180 2023-09-30T22:25:51.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.294+0000 7f898affd700 1 -- 172.21.15.156:0/2473990442 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8980011d20 con 0x7f898c09f180 2023-09-30T22:25:51.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.295+0000 7f89922a2700 1 -- 172.21.15.156:0/2473990442 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f898c09f180 msgr2=0x7f898c131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.295+0000 7f89922a2700 1 --2- 172.21.15.156:0/2473990442 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f898c09f180 0x7f898c131830 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f8980009840 tx=0x7f8980009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:51.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.295+0000 7f89922a2700 1 -- 172.21.15.156:0/2473990442 shutdown_connections 2023-09-30T22:25:51.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.295+0000 7f89922a2700 1 --2- 172.21.15.156:0/2473990442 >> v2:172.21.15.156:3300/0 conn(0x7f898c09e870 0x7f898c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.295+0000 7f89922a2700 1 --2- 172.21.15.156:0/2473990442 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f898c09f180 0x7f898c131830 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.295+0000 7f89922a2700 1 -- 172.21.15.156:0/2473990442 >> 172.21.15.156:0/2473990442 conn(0x7f898c0a4430 msgr2=0x7f898c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:51.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.295+0000 7f89922a2700 1 -- 172.21.15.156:0/2473990442 shutdown_connections 2023-09-30T22:25:51.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.295+0000 7f89922a2700 1 -- 172.21.15.156:0/2473990442 wait complete. 2023-09-30T22:25:51.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.296+0000 7f89922a2700 1 Processor -- start 2023-09-30T22:25:51.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.296+0000 7f89922a2700 1 -- start start 2023-09-30T22:25:51.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.296+0000 7f89922a2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f898c09e870 0x7f898c11efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.296+0000 7f89922a2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f898c09f180 0x7f898c11f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.296+0000 7f89922a2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f898c131d70 0x7f898c11fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.296+0000 7f89922a2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898c121aa0 con 0x7f898c131d70 2023-09-30T22:25:51.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.296+0000 7f89922a2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898c122ae0 con 0x7f898c09e870 2023-09-30T22:25:51.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.296+0000 7f89922a2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f898c122270 con 0x7f898c09f180 2023-09-30T22:25:51.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.296+0000 7f898bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f898c09e870 0x7f898c11efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.296+0000 7f898bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f898c09e870 0x7f898c11efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54182/0 (socket says 172.21.15.156:54182) 2023-09-30T22:25:51.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.296+0000 7f898bfff700 1 -- 172.21.15.156:0/1649324780 learned_addr learned my addr 172.21.15.156:0/1649324780 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:51.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.296+0000 7f899083f700 1 --2- 172.21.15.156:0/1649324780 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f898c131d70 0x7f898c11fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.297+0000 7f898b7fe700 1 --2- 172.21.15.156:0/1649324780 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f898c09f180 0x7f898c11f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.297+0000 7f898bfff700 1 -- 172.21.15.156:0/1649324780 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f898c09f180 msgr2=0x7f898c11f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.297+0000 7f898bfff700 1 --2- 172.21.15.156:0/1649324780 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f898c09f180 0x7f898c11f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.297+0000 7f898bfff700 1 -- 172.21.15.156:0/1649324780 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f898c131d70 msgr2=0x7f898c11fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.297+0000 7f898bfff700 1 --2- 172.21.15.156:0/1649324780 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f898c131d70 0x7f898c11fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.297+0000 7f898bfff700 1 -- 172.21.15.156:0/1649324780 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f897c009550 con 0x7f898c09e870 2023-09-30T22:25:51.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.297+0000 7f898b7fe700 1 --2- 172.21.15.156:0/1649324780 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f898c09f180 0x7f898c11f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:51.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.297+0000 7f898bfff700 1 --2- 172.21.15.156:0/1649324780 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f898c09e870 0x7f898c11efc0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f897c00e9b0 tx=0x7f897c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:51.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.297+0000 7f8988ff9700 1 -- 172.21.15.156:0/1649324780 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c00c850 con 0x7f898c09e870 2023-09-30T22:25:51.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.297+0000 7f8988ff9700 1 -- 172.21.15.156:0/1649324780 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897c00c9b0 con 0x7f898c09e870 2023-09-30T22:25:51.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.297+0000 7f8988ff9700 1 -- 172.21.15.156:0/1649324780 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c00cd20 con 0x7f898c09e870 2023-09-30T22:25:51.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.297+0000 7f89922a2700 1 -- 172.21.15.156:0/1649324780 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89800094a0 con 0x7f898c09e870 2023-09-30T22:25:51.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.297+0000 7f89922a2700 1 -- 172.21.15.156:0/1649324780 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f898c09dba0 con 0x7f898c09e870 2023-09-30T22:25:51.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.298+0000 7f8988ff9700 1 -- 172.21.15.156:0/1649324780 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f897c013470 con 0x7f898c09e870 2023-09-30T22:25:51.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.298+0000 7f89922a2700 1 -- 172.21.15.156:0/1649324780 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f898c11be60 con 0x7f898c09e870 2023-09-30T22:25:51.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.298+0000 7f8988ff9700 1 -- 172.21.15.156:0/1649324780 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f897c03fb50 con 0x7f898c09e870 2023-09-30T22:25:51.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.303+0000 7f8988ff9700 1 -- 172.21.15.156:0/1649324780 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f897c01b3b0 con 0x7f898c09e870 2023-09-30T22:25:51.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.336+0000 7f34957d7700 1 Processor -- start 2023-09-30T22:25:51.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.336+0000 7f34957d7700 1 -- start start 2023-09-30T22:25:51.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.336+0000 7f34957d7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f349012d380 0x7f349012d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.336+0000 7f34957d7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3490099a60 0x7f3490099e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.338 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.336+0000 7f34957d7700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f349009bb90 con 0x7f349009a3d0 2023-09-30T22:25:51.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.336+0000 7f34957d7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349009c210 con 0x7f3490099a60 2023-09-30T22:25:51.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.336+0000 7f34957d7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f349009a870 con 0x7f349012d380 2023-09-30T22:25:51.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.337+0000 7f348e7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3490099a60 0x7f3490099e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.337+0000 7f348e7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3490099a60 0x7f3490099e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54190/0 (socket says 172.21.15.156:54190) 2023-09-30T22:25:51.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.337+0000 7f348e7fc700 1 -- 172.21.15.156:0/496945243 learned_addr learned my addr 172.21.15.156:0/496945243 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:51.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.337+0000 7f348effd700 1 --2- 172.21.15.156:0/496945243 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f349012d380 0x7f349012d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.337+0000 7f348effd700 1 -- 172.21.15.156:0/496945243 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3490099a60 msgr2=0x7f3490099e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:51.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.337+0000 7f348effd700 1 --2- 172.21.15.156:0/496945243 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3490099a60 0x7f3490099e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.337+0000 7f348dffb700 1 -- 172.21.15.156:0/496945243 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3299853783 0 0) 0x7f349009bb90 con 0x7f349009a3d0 2023-09-30T22:25:51.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.337+0000 7f348effd700 1 -- 172.21.15.156:0/496945243 >> v1:172.21.15.156:6789/0 conn(0x7f349009a3d0 legacy=0x7f3490137610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.337+0000 7f348effd700 1 -- 172.21.15.156:0/496945243 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349009ced0 con 0x7f349012d380 2023-09-30T22:25:51.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.337+0000 7f348e7fc700 1 --2- 172.21.15.156:0/496945243 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3490099a60 0x7f3490099e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:51.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.337+0000 7f348effd700 1 --2- 172.21.15.156:0/496945243 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f349012d380 0x7f349012d750 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f3480009850 tx=0x7f3480009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd41ef1d126e586a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:51.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.337+0000 7f348dffb700 1 -- 172.21.15.156:0/496945243 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3480005e30 con 0x7f349012d380 2023-09-30T22:25:51.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.337+0000 7f348dffb700 1 -- 172.21.15.156:0/496945243 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3480006030 con 0x7f349012d380 2023-09-30T22:25:51.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.337+0000 7f348dffb700 1 -- 172.21.15.156:0/496945243 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34800063e0 con 0x7f349012d380 2023-09-30T22:25:51.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.338+0000 7f34957d7700 1 -- 172.21.15.156:0/496945243 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f349012d380 msgr2=0x7f349012d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.338+0000 7f34957d7700 1 --2- 172.21.15.156:0/496945243 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f349012d380 0x7f349012d750 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f3480009850 tx=0x7f3480009b60 comp rx=0 tx=0).stop 2023-09-30T22:25:51.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.338+0000 7f34957d7700 1 -- 172.21.15.156:0/496945243 shutdown_connections 2023-09-30T22:25:51.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.338+0000 7f34957d7700 1 --2- 172.21.15.156:0/496945243 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f349012d380 0x7f349012d750 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.338+0000 7f34957d7700 1 --2- 172.21.15.156:0/496945243 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3490099a60 0x7f3490099e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.338+0000 7f34957d7700 1 -- 172.21.15.156:0/496945243 >> 172.21.15.156:0/496945243 conn(0x7f34900a2980 msgr2=0x7f34900a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:51.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.338+0000 7f34957d7700 1 -- 172.21.15.156:0/496945243 shutdown_connections 2023-09-30T22:25:51.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.338+0000 7f34957d7700 1 -- 172.21.15.156:0/496945243 wait complete. 2023-09-30T22:25:51.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.339+0000 7f34957d7700 1 Processor -- start 2023-09-30T22:25:51.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.339+0000 7f34957d7700 1 -- start start 2023-09-30T22:25:51.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.340+0000 7f34957d7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3490099a60 0x7f349012b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.340+0000 7f34957d7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f349009a3d0 0x7f349012bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.340+0000 7f34957d7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f349012d380 0x7f349012c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.340+0000 7f34957d7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349013be10 con 0x7f349012d380 2023-09-30T22:25:51.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.340+0000 7f34957d7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349013afd0 con 0x7f349009a3d0 2023-09-30T22:25:51.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.340+0000 7f34957d7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f349009af90 con 0x7f3490099a60 2023-09-30T22:25:51.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.340+0000 7f348f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f349012d380 0x7f349012c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.340+0000 7f348f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f349012d380 0x7f349012c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49802/0 (socket says 172.21.15.156:49802) 2023-09-30T22:25:51.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.340+0000 7f348f7fe700 1 -- 172.21.15.156:0/4019723394 learned_addr learned my addr 172.21.15.156:0/4019723394 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:51.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.340+0000 7f348e7fc700 1 --2- 172.21.15.156:0/4019723394 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f349009a3d0 0x7f349012bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.340+0000 7f348effd700 1 --2- 172.21.15.156:0/4019723394 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3490099a60 0x7f349012b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.340+0000 7f348f7fe700 1 -- 172.21.15.156:0/4019723394 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3490099a60 msgr2=0x7f349012b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.340+0000 7f348f7fe700 1 --2- 172.21.15.156:0/4019723394 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3490099a60 0x7f349012b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.340+0000 7f348f7fe700 1 -- 172.21.15.156:0/4019723394 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f349009a3d0 msgr2=0x7f349012bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.340+0000 7f348f7fe700 1 --2- 172.21.15.156:0/4019723394 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f349009a3d0 0x7f349012bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.340+0000 7f348f7fe700 1 -- 172.21.15.156:0/4019723394 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3484009550 con 0x7f349012d380 2023-09-30T22:25:51.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.340+0000 7f348effd700 1 --2- 172.21.15.156:0/4019723394 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3490099a60 0x7f349012b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:51.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.340+0000 7f348f7fe700 1 --2- 172.21.15.156:0/4019723394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f349012d380 0x7f349012c190 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f348800c840 tx=0x7f348800cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:51.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.341+0000 7f34777fe700 1 -- 172.21.15.156:0/4019723394 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3488003e30 con 0x7f349012d380 2023-09-30T22:25:51.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.341+0000 7f34777fe700 1 -- 172.21.15.156:0/4019723394 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3488005070 con 0x7f349012d380 2023-09-30T22:25:51.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.341+0000 7f34957d7700 1 -- 172.21.15.156:0/4019723394 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3480009430 con 0x7f349012d380 2023-09-30T22:25:51.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.341+0000 7f34777fe700 1 -- 172.21.15.156:0/4019723394 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34880053e0 con 0x7f349012d380 2023-09-30T22:25:51.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.341+0000 7f34957d7700 1 -- 172.21.15.156:0/4019723394 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34900a2f30 con 0x7f349012d380 2023-09-30T22:25:51.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.342+0000 7f34957d7700 1 -- 172.21.15.156:0/4019723394 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349004f2a0 con 0x7f349012d380 2023-09-30T22:25:51.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.342+0000 7f34777fe700 1 -- 172.21.15.156:0/4019723394 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3488005540 con 0x7f349012d380 2023-09-30T22:25:51.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.342+0000 7f34777fe700 1 -- 172.21.15.156:0/4019723394 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f348803ff10 con 0x7f349012d380 2023-09-30T22:25:51.347 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.347+0000 7f34777fe700 1 -- 172.21.15.156:0/4019723394 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f348800a770 con 0x7f349012d380 2023-09-30T22:25:51.371 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.370+0000 7f977a541700 1 -- 172.21.15.156:0/1996155072 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f977409c7e0 con 0x7f9774133f70 2023-09-30T22:25:51.372 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.371+0000 7f9770ff9700 1 -- 172.21.15.156:0/1996155072 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f975c017070 con 0x7f9774133f70 2023-09-30T22:25:51.372 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:51.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.373+0000 7f977a541700 1 -- 172.21.15.156:0/1996155072 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9774133f70 msgr2=0x7f9774121a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.373+0000 7f977a541700 1 --2- 172.21.15.156:0/1996155072 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9774133f70 0x7f9774121a40 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f975c00c500 tx=0x7f975c00c810 comp rx=0 tx=0).stop 2023-09-30T22:25:51.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.373+0000 7f977a541700 1 -- 172.21.15.156:0/1996155072 shutdown_connections 2023-09-30T22:25:51.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.373+0000 7f977a541700 1 --2- 172.21.15.156:0/1996155072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97741343a0 0x7f9774121f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.373+0000 7f977a541700 1 --2- 172.21.15.156:0/1996155072 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f977409ad40 0x7f9774121500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.375 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.373+0000 7f977a541700 1 --2- 172.21.15.156:0/1996155072 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9774133f70 0x7f9774121a40 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.373+0000 7f977a541700 1 -- 172.21.15.156:0/1996155072 >> 172.21.15.156:0/1996155072 conn(0x7f9774099c40 msgr2=0x7f977409b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:51.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.374+0000 7f977a541700 1 -- 172.21.15.156:0/1996155072 shutdown_connections 2023-09-30T22:25:51.376 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.374+0000 7f977a541700 1 -- 172.21.15.156:0/1996155072 wait complete. 2023-09-30T22:25:51.387 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:51.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.497+0000 7f89922a2700 1 -- 172.21.15.156:0/1649324780 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f898c04f2a0 con 0x7f898c09e870 2023-09-30T22:25:51.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.497+0000 7f8988ff9700 1 -- 172.21.15.156:0/1649324780 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f897c01acb0 con 0x7f898c09e870 2023-09-30T22:25:51.498 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:51.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.499+0000 7f89922a2700 1 -- 172.21.15.156:0/1649324780 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f898c09e870 msgr2=0x7f898c11efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.499+0000 7f89922a2700 1 --2- 172.21.15.156:0/1649324780 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f898c09e870 0x7f898c11efc0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f897c00e9b0 tx=0x7f897c00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.499+0000 7f89922a2700 1 -- 172.21.15.156:0/1649324780 shutdown_connections 2023-09-30T22:25:51.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.499+0000 7f89922a2700 1 --2- 172.21.15.156:0/1649324780 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f898c131d70 0x7f898c11fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.499+0000 7f89922a2700 1 --2- 172.21.15.156:0/1649324780 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f898c09e870 0x7f898c11efc0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.499+0000 7f89922a2700 1 --2- 172.21.15.156:0/1649324780 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f898c09f180 0x7f898c11f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.499+0000 7f89922a2700 1 -- 172.21.15.156:0/1649324780 >> 172.21.15.156:0/1649324780 conn(0x7f898c0a4430 msgr2=0x7f898c131110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:51.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.499+0000 7f89922a2700 1 -- 172.21.15.156:0/1649324780 shutdown_connections 2023-09-30T22:25:51.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.499+0000 7f89922a2700 1 -- 172.21.15.156:0/1649324780 wait complete. 2023-09-30T22:25:51.512 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:51.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.512+0000 7f4a62464700 1 -- 172.21.15.156:0/3675789905 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4a5c06b2a0 con 0x7f4a5c09e870 2023-09-30T22:25:51.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.513+0000 7f4a58ff9700 1 -- 172.21.15.156:0/3675789905 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4a4c044030 con 0x7f4a5c09e870 2023-09-30T22:25:51.514 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:51.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.515+0000 7f4a62464700 1 -- 172.21.15.156:0/3675789905 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a5c09e870 msgr2=0x7f4a5c120820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.515+0000 7f4a62464700 1 --2- 172.21.15.156:0/3675789905 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a5c09e870 0x7f4a5c120820 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00c520 tx=0x7f4a4c00c830 comp rx=0 tx=0).stop 2023-09-30T22:25:51.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.515+0000 7f4a62464700 1 -- 172.21.15.156:0/3675789905 shutdown_connections 2023-09-30T22:25:51.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.515+0000 7f4a62464700 1 --2- 172.21.15.156:0/3675789905 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4a5c1371c0 0x7f4a5c1212a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.515+0000 7f4a62464700 1 --2- 172.21.15.156:0/3675789905 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a5c09e870 0x7f4a5c120820 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.516 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.515+0000 7f4a62464700 1 --2- 172.21.15.156:0/3675789905 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4a5c09f350 0x7f4a5c120d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.515+0000 7f4a62464700 1 -- 172.21.15.156:0/3675789905 >> 172.21.15.156:0/3675789905 conn(0x7f4a5c0a4430 msgr2=0x7f4a5c09c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:51.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.515+0000 7f4a62464700 1 -- 172.21.15.156:0/3675789905 shutdown_connections 2023-09-30T22:25:51.517 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.515+0000 7f4a62464700 1 -- 172.21.15.156:0/3675789905 wait complete. 2023-09-30T22:25:51.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:51.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.539+0000 7f34957d7700 1 -- 172.21.15.156:0/4019723394 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f349012dd20 con 0x7f349012d380 2023-09-30T22:25:51.540 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.540+0000 7f34777fe700 1 -- 172.21.15.156:0/4019723394 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f34880113a0 con 0x7f349012d380 2023-09-30T22:25:51.541 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:51.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.542+0000 7f34957d7700 1 -- 172.21.15.156:0/4019723394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f349012d380 msgr2=0x7f349012c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.542+0000 7f34957d7700 1 --2- 172.21.15.156:0/4019723394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f349012d380 0x7f349012c190 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f348800c840 tx=0x7f348800cb50 comp rx=0 tx=0).stop 2023-09-30T22:25:51.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.542+0000 7f34957d7700 1 -- 172.21.15.156:0/4019723394 shutdown_connections 2023-09-30T22:25:51.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.542+0000 7f34957d7700 1 --2- 172.21.15.156:0/4019723394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f349012d380 0x7f349012c190 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.542+0000 7f34957d7700 1 --2- 172.21.15.156:0/4019723394 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3490099a60 0x7f349012b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.542+0000 7f34957d7700 1 --2- 172.21.15.156:0/4019723394 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f349009a3d0 0x7f349012bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.542+0000 7f34957d7700 1 -- 172.21.15.156:0/4019723394 >> 172.21.15.156:0/4019723394 conn(0x7f34900a2980 msgr2=0x7f3490130300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:51.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.542+0000 7f34957d7700 1 -- 172.21.15.156:0/4019723394 shutdown_connections 2023-09-30T22:25:51.544 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:51.542+0000 7f34957d7700 1 -- 172.21.15.156:0/4019723394 wait complete. 2023-09-30T22:25:51.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:52.389 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:52.513 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:52.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.519+0000 7f15b5c55700 1 Processor -- start 2023-09-30T22:25:52.520 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.519+0000 7f15b5c55700 1 -- start start 2023-09-30T22:25:52.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.520+0000 7f15b5c55700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15b012cb80 0x7f15b012cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.520+0000 7f15b5c55700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15b012fab0 0x7f15b012ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.520+0000 7f15b5c55700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b009b700 con 0x7f15b0130460 2023-09-30T22:25:52.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.520+0000 7f15b5c55700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b009c350 con 0x7f15b012fab0 2023-09-30T22:25:52.522 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.520+0000 7f15b5c55700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15b01308d0 con 0x7f15b012cb80 2023-09-30T22:25:52.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.520+0000 7f15af7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15b012cb80 0x7f15b012cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.520+0000 7f15a6ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15b012fab0 0x7f15b012ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.520+0000 7f15af7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15b012cb80 0x7f15b012cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43376/0 (socket says 172.21.15.156:43376) 2023-09-30T22:25:52.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.520+0000 7f15af7fe700 1 -- 172.21.15.156:0/598979051 learned_addr learned my addr 172.21.15.156:0/598979051 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:52.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.520+0000 7f15a6ffd700 1 -- 172.21.15.156:0/598979051 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15b012cb80 msgr2=0x7f15b012cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:52.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.520+0000 7f15a6ffd700 1 --2- 172.21.15.156:0/598979051 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15b012cb80 0x7f15b012cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.520+0000 7f15a6ffd700 1 -- 172.21.15.156:0/598979051 >> v1:172.21.15.156:6789/0 conn(0x7f15b0130460 legacy=0x7f15b0136de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.520+0000 7f15a6ffd700 1 -- 172.21.15.156:0/598979051 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b009abf0 con 0x7f15b012fab0 2023-09-30T22:25:52.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.520+0000 7f15aeffd700 1 -- 172.21.15.156:0/598979051 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163752283 0 0) 0x7f15b009b700 con 0x7f15b0130460 2023-09-30T22:25:52.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.520+0000 7f15af7fe700 1 --2- 172.21.15.156:0/598979051 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15b012cb80 0x7f15b012cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:52.523 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.520+0000 7f15a6ffd700 1 --2- 172.21.15.156:0/598979051 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15b012fab0 0x7f15b012ff20 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f1598009870 tx=0x7f1598009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79adadb98c1be92d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:52.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.521+0000 7f15aeffd700 1 -- 172.21.15.156:0/598979051 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1598011830 con 0x7f15b012fab0 2023-09-30T22:25:52.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.521+0000 7f15aeffd700 1 -- 172.21.15.156:0/598979051 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1598011990 con 0x7f15b012fab0 2023-09-30T22:25:52.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.521+0000 7f15aeffd700 1 -- 172.21.15.156:0/598979051 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1598011d20 con 0x7f15b012fab0 2023-09-30T22:25:52.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.521+0000 7f15b5c55700 1 -- 172.21.15.156:0/598979051 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15b012fab0 msgr2=0x7f15b012ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.521+0000 7f15b5c55700 1 --2- 172.21.15.156:0/598979051 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15b012fab0 0x7f15b012ff20 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f1598009870 tx=0x7f1598009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:52.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.521+0000 7f15b5c55700 1 -- 172.21.15.156:0/598979051 shutdown_connections 2023-09-30T22:25:52.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.521+0000 7f15b5c55700 1 --2- 172.21.15.156:0/598979051 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15b012cb80 0x7f15b012cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.521+0000 7f15b5c55700 1 --2- 172.21.15.156:0/598979051 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15b012fab0 0x7f15b012ff20 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.521+0000 7f15b5c55700 1 -- 172.21.15.156:0/598979051 >> 172.21.15.156:0/598979051 conn(0x7f15b00a2eb0 msgr2=0x7f15b009eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:52.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.521+0000 7f15b5c55700 1 -- 172.21.15.156:0/598979051 shutdown_connections 2023-09-30T22:25:52.524 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.521+0000 7f15b5c55700 1 -- 172.21.15.156:0/598979051 wait complete. 2023-09-30T22:25:52.526 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.522+0000 7f15b5c55700 1 Processor -- start 2023-09-30T22:25:52.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.523+0000 7f15b5c55700 1 -- start start 2023-09-30T22:25:52.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.523+0000 7f15b5c55700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15b012cb80 0x7f15b00715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.523+0000 7f15b5c55700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15b0130460 0x7f15b0071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.523+0000 7f15b5c55700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15b0129b20 0x7f15b0072020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.523+0000 7f15b5c55700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b0127900 con 0x7f15b0130460 2023-09-30T22:25:52.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.523+0000 7f15b5c55700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b0127710 con 0x7f15b012cb80 2023-09-30T22:25:52.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.523+0000 7f15b5c55700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15b0128890 con 0x7f15b0129b20 2023-09-30T22:25:52.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.523+0000 7f15af7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15b012cb80 0x7f15b00715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.523+0000 7f15a6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15b0130460 0x7f15b0071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.523+0000 7f15af7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15b012cb80 0x7f15b00715a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54204/0 (socket says 172.21.15.156:54204) 2023-09-30T22:25:52.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.523+0000 7f15af7fe700 1 -- 172.21.15.156:0/3333140026 learned_addr learned my addr 172.21.15.156:0/3333140026 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:52.527 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.523+0000 7f15affff700 1 --2- 172.21.15.156:0/3333140026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15b0129b20 0x7f15b0072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.523+0000 7f15af7fe700 1 -- 172.21.15.156:0/3333140026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15b0129b20 msgr2=0x7f15b0072020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.523+0000 7f15af7fe700 1 --2- 172.21.15.156:0/3333140026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15b0129b20 0x7f15b0072020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.523+0000 7f15af7fe700 1 -- 172.21.15.156:0/3333140026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15b0130460 msgr2=0x7f15b0071ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.523+0000 7f15af7fe700 1 --2- 172.21.15.156:0/3333140026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15b0130460 0x7f15b0071ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.523+0000 7f15af7fe700 1 -- 172.21.15.156:0/3333140026 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a000a6f0 con 0x7f15b012cb80 2023-09-30T22:25:52.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.523+0000 7f15a6ffd700 1 --2- 172.21.15.156:0/3333140026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15b0130460 0x7f15b0071ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:52.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.524+0000 7f15af7fe700 1 --2- 172.21.15.156:0/3333140026 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15b012cb80 0x7f15b00715a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f15a000e8e0 tx=0x7f15a000ebf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:52.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.524+0000 7f15acff9700 1 -- 172.21.15.156:0/3333140026 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a0004230 con 0x7f15b012cb80 2023-09-30T22:25:52.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.524+0000 7f15acff9700 1 -- 172.21.15.156:0/3333140026 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a0004390 con 0x7f15b012cb80 2023-09-30T22:25:52.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.524+0000 7f15b5c55700 1 -- 172.21.15.156:0/3333140026 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15980094a0 con 0x7f15b012cb80 2023-09-30T22:25:52.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.524+0000 7f15acff9700 1 -- 172.21.15.156:0/3333140026 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a000c6e0 con 0x7f15b012cb80 2023-09-30T22:25:52.528 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.524+0000 7f15b5c55700 1 -- 172.21.15.156:0/3333140026 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b012d510 con 0x7f15b012cb80 2023-09-30T22:25:52.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.525+0000 7f15b5c55700 1 -- 172.21.15.156:0/3333140026 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b004f2a0 con 0x7f15b012cb80 2023-09-30T22:25:52.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.525+0000 7f15acff9700 1 -- 172.21.15.156:0/3333140026 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f15a0017030 con 0x7f15b012cb80 2023-09-30T22:25:52.529 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.525+0000 7f15acff9700 1 -- 172.21.15.156:0/3333140026 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f15a0015070 con 0x7f15b012cb80 2023-09-30T22:25:52.529 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:52.531 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.530+0000 7f15acff9700 1 -- 172.21.15.156:0/3333140026 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f15a00036a0 con 0x7f15b012cb80 2023-09-30T22:25:52.557 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:52.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.644+0000 7f1f7ba20700 1 Processor -- start 2023-09-30T22:25:52.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.645+0000 7f1f7ba20700 1 -- start start 2023-09-30T22:25:52.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.645+0000 7f1f7ba20700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1f7409d860 0x7f1f7409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.645+0000 7f1f7ba20700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f7409e170 0x7f1f741307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.645+0000 7f1f7ba20700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f7409aaa0 con 0x7f1f74130ce0 2023-09-30T22:25:52.646 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.645+0000 7f1f7ba20700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f7409f870 con 0x7f1f7409d860 2023-09-30T22:25:52.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.645+0000 7f1f7ba20700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7409b360 con 0x7f1f7409e170 2023-09-30T22:25:52.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.645+0000 7f1f78fbb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f7409e170 0x7f1f741307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.645+0000 7f1f797bc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1f7409d860 0x7f1f7409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.645+0000 7f1f78fbb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f7409e170 0x7f1f741307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54220/0 (socket says 172.21.15.156:54220) 2023-09-30T22:25:52.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.645+0000 7f1f78fbb700 1 -- 172.21.15.156:0/3494948723 learned_addr learned my addr 172.21.15.156:0/3494948723 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:52.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.645+0000 7f1f79fbd700 1 --1- 172.21.15.156:0/3494948723 >> v1:172.21.15.156:6789/0 conn(0x7f1f74130ce0 0x7f1f741379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38498/0 (socket says 172.21.15.156:38498) 2023-09-30T22:25:52.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.646+0000 7f1f78fbb700 1 -- 172.21.15.156:0/3494948723 >> v2:172.21.15.156:3300/0 conn(0x7f1f7409d860 msgr2=0x7f1f7409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:52.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.646+0000 7f1f78fbb700 1 --2- 172.21.15.156:0/3494948723 >> v2:172.21.15.156:3300/0 conn(0x7f1f7409d860 0x7f1f7409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.646+0000 7f1f78fbb700 1 -- 172.21.15.156:0/3494948723 >> v1:172.21.15.156:6789/0 conn(0x7f1f74130ce0 legacy=0x7f1f741379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.646+0000 7f1f78fbb700 1 -- 172.21.15.156:0/3494948723 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7409b620 con 0x7f1f7409e170 2023-09-30T22:25:52.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.646+0000 7f1f78fbb700 1 --2- 172.21.15.156:0/3494948723 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f7409e170 0x7f1f741307a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f1f640098f0 tx=0x7f1f64009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6074a55e1258925b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:52.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.646+0000 7f1f6bfff700 1 -- 172.21.15.156:0/3494948723 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f64011830 con 0x7f1f7409e170 2023-09-30T22:25:52.653 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.646+0000 7f1f6bfff700 1 -- 172.21.15.156:0/3494948723 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f64011990 con 0x7f1f7409e170 2023-09-30T22:25:52.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.646+0000 7f1f6bfff700 1 -- 172.21.15.156:0/3494948723 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f64011d20 con 0x7f1f7409e170 2023-09-30T22:25:52.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.647+0000 7f1f7ba20700 1 -- 172.21.15.156:0/3494948723 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f7409e170 msgr2=0x7f1f741307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.647+0000 7f1f7ba20700 1 --2- 172.21.15.156:0/3494948723 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f7409e170 0x7f1f741307a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f1f640098f0 tx=0x7f1f64009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:52.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.647+0000 7f1f7ba20700 1 -- 172.21.15.156:0/3494948723 shutdown_connections 2023-09-30T22:25:52.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.647+0000 7f1f7ba20700 1 --2- 172.21.15.156:0/3494948723 >> v2:172.21.15.156:3300/0 conn(0x7f1f7409d860 0x7f1f7409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.647+0000 7f1f7ba20700 1 --2- 172.21.15.156:0/3494948723 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f7409e170 0x7f1f741307a0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.647+0000 7f1f7ba20700 1 -- 172.21.15.156:0/3494948723 >> 172.21.15.156:0/3494948723 conn(0x7f1f74099c40 msgr2=0x7f1f740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:52.654 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.647+0000 7f1f7ba20700 1 -- 172.21.15.156:0/3494948723 shutdown_connections 2023-09-30T22:25:52.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.647+0000 7f1f7ba20700 1 -- 172.21.15.156:0/3494948723 wait complete. 2023-09-30T22:25:52.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.648+0000 7f1f7ba20700 1 Processor -- start 2023-09-30T22:25:52.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.648+0000 7f1f7ba20700 1 -- start start 2023-09-30T22:25:52.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.648+0000 7f1f7ba20700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f7409d860 0x7f1f741c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.648+0000 7f1f7ba20700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f7409e170 0x7f1f741c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.655 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.648+0000 7f1f7ba20700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f74130ce0 0x7f1f741c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.648+0000 7f1f7ba20700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f74070540 con 0x7f1f7409d860 2023-09-30T22:25:52.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.648+0000 7f1f7ba20700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f74120f90 con 0x7f1f74130ce0 2023-09-30T22:25:52.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.648+0000 7f1f7ba20700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f74130290 con 0x7f1f7409e170 2023-09-30T22:25:52.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.649+0000 7f1f79fbd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f74130ce0 0x7f1f741c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.649+0000 7f1f79fbd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f74130ce0 0x7f1f741c8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54226/0 (socket says 172.21.15.156:54226) 2023-09-30T22:25:52.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.649+0000 7f1f79fbd700 1 -- 172.21.15.156:0/3978626546 learned_addr learned my addr 172.21.15.156:0/3978626546 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:52.656 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.649+0000 7f1f797bc700 1 --2- 172.21.15.156:0/3978626546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f7409d860 0x7f1f741c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.649+0000 7f1f79fbd700 1 -- 172.21.15.156:0/3978626546 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f7409e170 msgr2=0x7f1f741c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.649+0000 7f1f79fbd700 1 --2- 172.21.15.156:0/3978626546 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f7409e170 0x7f1f741c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.649+0000 7f1f79fbd700 1 -- 172.21.15.156:0/3978626546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f7409d860 msgr2=0x7f1f741c81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.649+0000 7f1f79fbd700 1 --2- 172.21.15.156:0/3978626546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f7409d860 0x7f1f741c81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.649+0000 7f1f79fbd700 1 -- 172.21.15.156:0/3978626546 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f64009550 con 0x7f1f74130ce0 2023-09-30T22:25:52.657 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.649+0000 7f1f79fbd700 1 --2- 172.21.15.156:0/3978626546 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f74130ce0 0x7f1f741c8c70 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c00cbd0 tx=0x7f1f6c00cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:52.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.649+0000 7f1f69ffb700 1 -- 172.21.15.156:0/3978626546 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c00abb0 con 0x7f1f74130ce0 2023-09-30T22:25:52.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.649+0000 7f1f69ffb700 1 -- 172.21.15.156:0/3978626546 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6c00ad10 con 0x7f1f74130ce0 2023-09-30T22:25:52.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.649+0000 7f1f7ba20700 1 -- 172.21.15.156:0/3978626546 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f74120cd0 con 0x7f1f74130ce0 2023-09-30T22:25:52.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.649+0000 7f1f69ffb700 1 -- 172.21.15.156:0/3978626546 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c007270 con 0x7f1f74130ce0 2023-09-30T22:25:52.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.650+0000 7f1f7ba20700 1 -- 172.21.15.156:0/3978626546 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f74121a00 con 0x7f1f74130ce0 2023-09-30T22:25:52.658 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.651+0000 7f1f5f7fe700 1 -- 172.21.15.156:0/3978626546 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f7404f2a0 con 0x7f1f74130ce0 2023-09-30T22:25:52.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.651+0000 7f1f69ffb700 1 -- 172.21.15.156:0/3978626546 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f6c0073d0 con 0x7f1f74130ce0 2023-09-30T22:25:52.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.651+0000 7f1f69ffb700 1 -- 172.21.15.156:0/3978626546 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1f6c040560 con 0x7f1f74130ce0 2023-09-30T22:25:52.659 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.656+0000 7f1f69ffb700 1 -- 172.21.15.156:0/3978626546 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f6c0196d0 con 0x7f1f74130ce0 2023-09-30T22:25:52.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.663+0000 7f0825f0a700 1 Processor -- start 2023-09-30T22:25:52.663 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.663+0000 7f0825f0a700 1 -- start start 2023-09-30T22:25:52.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.663+0000 7f0825f0a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f08201350d0 0x7f082013ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.663+0000 7f0825f0a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f082013d210 0x7f082013f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.663+0000 7f0825f0a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f082009eca0 con 0x7f082006a770 2023-09-30T22:25:52.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.663+0000 7f0825f0a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f082006b2e0 con 0x7f08201350d0 2023-09-30T22:25:52.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.663+0000 7f0825f0a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f082009f720 con 0x7f082013d210 2023-09-30T22:25:52.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.663+0000 7f081ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f082013d210 0x7f082013f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.663+0000 7f081ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f082013d210 0x7f082013f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43418/0 (socket says 172.21.15.156:43418) 2023-09-30T22:25:52.671 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.663+0000 7f081ffff700 1 -- 172.21.15.156:0/2666490039 learned_addr learned my addr 172.21.15.156:0/2666490039 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:52.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.663+0000 7f081effd700 1 --2- 172.21.15.156:0/2666490039 >> v2:172.21.15.156:3300/0 conn(0x7f08201350d0 0x7f082013ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.664+0000 7f081effd700 1 -- 172.21.15.156:0/2666490039 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f082013d210 msgr2=0x7f082013f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:52.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.664+0000 7f081effd700 1 --2- 172.21.15.156:0/2666490039 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f082013d210 0x7f082013f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.664+0000 7f081effd700 1 -- 172.21.15.156:0/2666490039 >> v1:172.21.15.156:6789/0 conn(0x7f082006a770 legacy=0x7f08201349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.664+0000 7f081effd700 1 -- 172.21.15.156:0/2666490039 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f082006b480 con 0x7f08201350d0 2023-09-30T22:25:52.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.664+0000 7f081ffff700 1 --2- 172.21.15.156:0/2666490039 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f082013d210 0x7f082013f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:52.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.664+0000 7f081effd700 1 --2- 172.21.15.156:0/2666490039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08201350d0 0x7f082013ccd0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f0814009840 tx=0x7f0814009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d30ad5db8f03f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:52.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.664+0000 7f081e7fc700 1 -- 172.21.15.156:0/2666490039 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0814011830 con 0x7f08201350d0 2023-09-30T22:25:52.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.664+0000 7f081e7fc700 1 -- 172.21.15.156:0/2666490039 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0814011990 con 0x7f08201350d0 2023-09-30T22:25:52.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.664+0000 7f081e7fc700 1 -- 172.21.15.156:0/2666490039 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0814011d20 con 0x7f08201350d0 2023-09-30T22:25:52.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.665+0000 7f0825f0a700 1 -- 172.21.15.156:0/2666490039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08201350d0 msgr2=0x7f082013ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.665+0000 7f0825f0a700 1 --2- 172.21.15.156:0/2666490039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08201350d0 0x7f082013ccd0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f0814009840 tx=0x7f0814009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:52.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.665+0000 7f0825f0a700 1 -- 172.21.15.156:0/2666490039 shutdown_connections 2023-09-30T22:25:52.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.665+0000 7f0825f0a700 1 --2- 172.21.15.156:0/2666490039 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f082013d210 0x7f082013f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.665+0000 7f0825f0a700 1 --2- 172.21.15.156:0/2666490039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08201350d0 0x7f082013ccd0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.665+0000 7f0825f0a700 1 -- 172.21.15.156:0/2666490039 >> 172.21.15.156:0/2666490039 conn(0x7f0820099c40 msgr2=0x7f08200a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:52.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.665+0000 7f0825f0a700 1 -- 172.21.15.156:0/2666490039 shutdown_connections 2023-09-30T22:25:52.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.665+0000 7f0825f0a700 1 -- 172.21.15.156:0/2666490039 wait complete. 2023-09-30T22:25:52.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.666+0000 7f0825f0a700 1 Processor -- start 2023-09-30T22:25:52.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.666+0000 7f0825f0a700 1 -- start start 2023-09-30T22:25:52.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.666+0000 7f0825f0a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f082006a770 0x7f082011bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.666+0000 7f0825f0a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f08201350d0 0x7f082011c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.666+0000 7f0825f0a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f082013d210 0x7f082011c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.666+0000 7f0825f0a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082009f220 con 0x7f082006a770 2023-09-30T22:25:52.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.666+0000 7f0825f0a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0820071df0 con 0x7f08201350d0 2023-09-30T22:25:52.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.666+0000 7f0825f0a700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f082011a930 con 0x7f082013d210 2023-09-30T22:25:52.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.666+0000 7f081f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f082006a770 0x7f082011bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.666+0000 7f081f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f082006a770 0x7f082011bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49854/0 (socket says 172.21.15.156:49854) 2023-09-30T22:25:52.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.666+0000 7f081effd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f08201350d0 0x7f082011c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.666+0000 7f081f7fe700 1 -- 172.21.15.156:0/2290926228 learned_addr learned my addr 172.21.15.156:0/2290926228 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:52.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.667+0000 7f081ffff700 1 --2- 172.21.15.156:0/2290926228 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f082013d210 0x7f082011c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.667+0000 7f081f7fe700 1 -- 172.21.15.156:0/2290926228 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f082013d210 msgr2=0x7f082011c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.667+0000 7f081f7fe700 1 --2- 172.21.15.156:0/2290926228 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f082013d210 0x7f082011c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.667+0000 7f081f7fe700 1 -- 172.21.15.156:0/2290926228 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f08201350d0 msgr2=0x7f082011c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.667+0000 7f081f7fe700 1 --2- 172.21.15.156:0/2290926228 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f08201350d0 0x7f082011c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.667+0000 7f081f7fe700 1 -- 172.21.15.156:0/2290926228 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0818009b30 con 0x7f082006a770 2023-09-30T22:25:52.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.667+0000 7f081effd700 1 --2- 172.21.15.156:0/2290926228 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f08201350d0 0x7f082011c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:52.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.667+0000 7f081ffff700 1 --2- 172.21.15.156:0/2290926228 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f082013d210 0x7f082011c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:52.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.667+0000 7f081f7fe700 1 --2- 172.21.15.156:0/2290926228 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f082006a770 0x7f082011bda0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f081000c450 tx=0x7f081000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:52.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.667+0000 7f0807fff700 1 -- 172.21.15.156:0/2290926228 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08100052d0 con 0x7f082006a770 2023-09-30T22:25:52.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.667+0000 7f0807fff700 1 -- 172.21.15.156:0/2290926228 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0810005430 con 0x7f082006a770 2023-09-30T22:25:52.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.667+0000 7f0825f0a700 1 -- 172.21.15.156:0/2290926228 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08140094a0 con 0x7f082006a770 2023-09-30T22:25:52.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.667+0000 7f0807fff700 1 -- 172.21.15.156:0/2290926228 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08100038c0 con 0x7f082006a770 2023-09-30T22:25:52.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.667+0000 7f0825f0a700 1 -- 172.21.15.156:0/2290926228 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f082011aee0 con 0x7f082006a770 2023-09-30T22:25:52.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.668+0000 7f0807fff700 1 -- 172.21.15.156:0/2290926228 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0810003a20 con 0x7f082006a770 2023-09-30T22:25:52.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.668+0000 7f0807fff700 1 -- 172.21.15.156:0/2290926228 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f081003e9c0 con 0x7f082006a770 2023-09-30T22:25:52.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.668+0000 7f0825f0a700 1 -- 172.21.15.156:0/2290926228 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f082011b0d0 con 0x7f082006a770 2023-09-30T22:25:52.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.673+0000 7f0807fff700 1 -- 172.21.15.156:0/2290926228 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0810017080 con 0x7f082006a770 2023-09-30T22:25:52.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.717+0000 7fbe2bd23700 1 Processor -- start 2023-09-30T22:25:52.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.717+0000 7fbe2bd23700 1 -- start start 2023-09-30T22:25:52.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.718+0000 7fbe2bd23700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe2409f350 0x7fbe24136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.718+0000 7fbe2bd23700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe241371c0 0x7fbe241395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.718+0000 7fbe2bd23700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe2409c970 con 0x7fbe2409e870 2023-09-30T22:25:52.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.718+0000 7fbe2bd23700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe240a0920 con 0x7fbe2409f350 2023-09-30T22:25:52.719 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.718+0000 7fbe2bd23700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2409f9c0 con 0x7fbe241371c0 2023-09-30T22:25:52.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.718+0000 7fbe292be700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe2409f350 0x7fbe24136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.718+0000 7fbe29abf700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fbe2409e870 0x7fbe2409ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38528/0 (socket says 172.21.15.156:38528) 2023-09-30T22:25:52.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.718+0000 7fbe29abf700 1 -- 172.21.15.156:0/2063794718 learned_addr learned my addr 172.21.15.156:0/2063794718 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:52.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.718+0000 7fbe2a2c0700 1 --2- 172.21.15.156:0/2063794718 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe241371c0 0x7fbe241395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.718+0000 7fbe292be700 1 -- 172.21.15.156:0/2063794718 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe241371c0 msgr2=0x7fbe241395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:52.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.718+0000 7fbe292be700 1 --2- 172.21.15.156:0/2063794718 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe241371c0 0x7fbe241395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.719+0000 7fbe292be700 1 -- 172.21.15.156:0/2063794718 >> v1:172.21.15.156:6789/0 conn(0x7fbe2409e870 legacy=0x7fbe2409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.718+0000 7fbe28abd700 1 -- 172.21.15.156:0/2063794718 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4164660861 0 0) 0x7fbe2409c970 con 0x7fbe2409e870 2023-09-30T22:25:52.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.719+0000 7fbe292be700 1 -- 172.21.15.156:0/2063794718 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe2409bab0 con 0x7fbe2409f350 2023-09-30T22:25:52.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.719+0000 7fbe292be700 1 --2- 172.21.15.156:0/2063794718 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe2409f350 0x7fbe24136c80 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fbe14009870 tx=0x7fbe14009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cec1c0c669aab173 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:52.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.719+0000 7fbe28abd700 1 -- 172.21.15.156:0/2063794718 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe14011830 con 0x7fbe2409f350 2023-09-30T22:25:52.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.719+0000 7fbe28abd700 1 -- 172.21.15.156:0/2063794718 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe14011990 con 0x7fbe2409f350 2023-09-30T22:25:52.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.719+0000 7fbe28abd700 1 -- 172.21.15.156:0/2063794718 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe14011d20 con 0x7fbe2409f350 2023-09-30T22:25:52.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.719+0000 7fbe2bd23700 1 -- 172.21.15.156:0/2063794718 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe2409f350 msgr2=0x7fbe24136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.719+0000 7fbe2bd23700 1 --2- 172.21.15.156:0/2063794718 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe2409f350 0x7fbe24136c80 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fbe14009870 tx=0x7fbe14009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:52.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.720+0000 7fbe2bd23700 1 -- 172.21.15.156:0/2063794718 shutdown_connections 2023-09-30T22:25:52.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.720+0000 7fbe2bd23700 1 --2- 172.21.15.156:0/2063794718 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe241371c0 0x7fbe241395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.720+0000 7fbe2bd23700 1 --2- 172.21.15.156:0/2063794718 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe2409f350 0x7fbe24136c80 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.720+0000 7fbe2bd23700 1 -- 172.21.15.156:0/2063794718 >> 172.21.15.156:0/2063794718 conn(0x7fbe240a4430 msgr2=0x7fbe240a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:52.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.720+0000 7fbe2bd23700 1 -- 172.21.15.156:0/2063794718 shutdown_connections 2023-09-30T22:25:52.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.720+0000 7fbe2bd23700 1 -- 172.21.15.156:0/2063794718 wait complete. 2023-09-30T22:25:52.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.721+0000 7fbe2bd23700 1 Processor -- start 2023-09-30T22:25:52.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.721+0000 7fbe2bd23700 1 -- start start 2023-09-30T22:25:52.724 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.722+0000 7fbe2bd23700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe2409e870 0x7fbe241c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.725 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.722+0000 7fbe2bd23700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe2409f350 0x7fbe241c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.725 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.722+0000 7fbe2bd23700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe241371c0 0x7fbe2406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.725 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.722+0000 7fbe2bd23700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2406d420 con 0x7fbe241371c0 2023-09-30T22:25:52.725 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.722+0000 7fbe2bd23700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe241352b0 con 0x7fbe2409e870 2023-09-30T22:25:52.725 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.722+0000 7fbe2bd23700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe24124f40 con 0x7fbe2409f350 2023-09-30T22:25:52.725 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.722+0000 7fbe29abf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe2409e870 0x7fbe241c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.725 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.722+0000 7fbe29abf700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe2409e870 0x7fbe241c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54238/0 (socket says 172.21.15.156:54238) 2023-09-30T22:25:52.725 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.722+0000 7fbe29abf700 1 -- 172.21.15.156:0/607189240 learned_addr learned my addr 172.21.15.156:0/607189240 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:52.725 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.722+0000 7fbe2a2c0700 1 --2- 172.21.15.156:0/607189240 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe241371c0 0x7fbe2406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.725 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.722+0000 7fbe292be700 1 --2- 172.21.15.156:0/607189240 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe2409f350 0x7fbe241c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.725 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.722+0000 7fbe29abf700 1 -- 172.21.15.156:0/607189240 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe2409f350 msgr2=0x7fbe241c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.722+0000 7fbe29abf700 1 --2- 172.21.15.156:0/607189240 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe2409f350 0x7fbe241c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.722+0000 7fbe29abf700 1 -- 172.21.15.156:0/607189240 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe241371c0 msgr2=0x7fbe2406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.722+0000 7fbe29abf700 1 --2- 172.21.15.156:0/607189240 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe241371c0 0x7fbe2406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.722+0000 7fbe29abf700 1 -- 172.21.15.156:0/607189240 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe140094a0 con 0x7fbe2409e870 2023-09-30T22:25:52.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.722+0000 7fbe29abf700 1 --2- 172.21.15.156:0/607189240 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe2409e870 0x7fbe241c8700 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fbe2000c520 tx=0x7fbe2000c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:52.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.722+0000 7fbe1a7fc700 1 -- 172.21.15.156:0/607189240 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe20004c80 con 0x7fbe2409e870 2023-09-30T22:25:52.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.722+0000 7fbe1a7fc700 1 -- 172.21.15.156:0/607189240 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe20004e00 con 0x7fbe2409e870 2023-09-30T22:25:52.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.722+0000 7fbe1a7fc700 1 -- 172.21.15.156:0/607189240 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe20007310 con 0x7fbe2409e870 2023-09-30T22:25:52.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.722+0000 7fbe2bd23700 1 -- 172.21.15.156:0/607189240 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe24124c80 con 0x7fbe2409e870 2023-09-30T22:25:52.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.723+0000 7fbe2bd23700 1 -- 172.21.15.156:0/607189240 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe241259b0 con 0x7fbe2409e870 2023-09-30T22:25:52.726 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.724+0000 7fbe2bd23700 1 -- 172.21.15.156:0/607189240 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe2406cd90 con 0x7fbe2409e870 2023-09-30T22:25:52.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.724+0000 7fbe1a7fc700 1 -- 172.21.15.156:0/607189240 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe20007470 con 0x7fbe2409e870 2023-09-30T22:25:52.727 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.724+0000 7fbe1a7fc700 1 -- 172.21.15.156:0/607189240 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbe2003f480 con 0x7fbe2409e870 2023-09-30T22:25:52.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.733+0000 7fbe1a7fc700 1 -- 172.21.15.156:0/607189240 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe200133c0 con 0x7fbe2409e870 2023-09-30T22:25:52.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.739+0000 7f15b5c55700 1 -- 172.21.15.156:0/3333140026 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f15b012f3b0 con 0x7f15b012cb80 2023-09-30T22:25:52.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.739+0000 7f15acff9700 1 -- 172.21.15.156:0/3333140026 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f15a0022350 con 0x7f15b012cb80 2023-09-30T22:25:52.740 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:52.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.743+0000 7f15b5c55700 1 -- 172.21.15.156:0/3333140026 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15b012cb80 msgr2=0x7f15b00715a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.743+0000 7f15b5c55700 1 --2- 172.21.15.156:0/3333140026 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15b012cb80 0x7f15b00715a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f15a000e8e0 tx=0x7f15a000ebf0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.743+0000 7f15b5c55700 1 -- 172.21.15.156:0/3333140026 shutdown_connections 2023-09-30T22:25:52.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.743+0000 7f15b5c55700 1 --2- 172.21.15.156:0/3333140026 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f15b0129b20 0x7f15b0072020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.743+0000 7f15b5c55700 1 --2- 172.21.15.156:0/3333140026 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f15b012cb80 0x7f15b00715a0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.743+0000 7f15b5c55700 1 --2- 172.21.15.156:0/3333140026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15b0130460 0x7f15b0071ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.743+0000 7f15b5c55700 1 -- 172.21.15.156:0/3333140026 >> 172.21.15.156:0/3333140026 conn(0x7f15b00a2eb0 msgr2=0x7f15b01b7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:52.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.743+0000 7f15b5c55700 1 -- 172.21.15.156:0/3333140026 shutdown_connections 2023-09-30T22:25:52.744 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.743+0000 7f15b5c55700 1 -- 172.21.15.156:0/3333140026 wait complete. 2023-09-30T22:25:52.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:52.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.872+0000 7f0825f0a700 1 -- 172.21.15.156:0/2290926228 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f082004f2a0 con 0x7f082006a770 2023-09-30T22:25:52.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.873+0000 7f0807fff700 1 -- 172.21.15.156:0/2290926228 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0810011590 con 0x7f082006a770 2023-09-30T22:25:52.873 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:52.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.875+0000 7f0825f0a700 1 -- 172.21.15.156:0/2290926228 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f082006a770 msgr2=0x7f082011bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.875+0000 7f0825f0a700 1 --2- 172.21.15.156:0/2290926228 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f082006a770 0x7f082011bda0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f081000c450 tx=0x7f081000c760 comp rx=0 tx=0).stop 2023-09-30T22:25:52.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.875+0000 7f0825f0a700 1 -- 172.21.15.156:0/2290926228 shutdown_connections 2023-09-30T22:25:52.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.875+0000 7f0825f0a700 1 --2- 172.21.15.156:0/2290926228 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f082013d210 0x7f082011c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.875+0000 7f0825f0a700 1 --2- 172.21.15.156:0/2290926228 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f082006a770 0x7f082011bda0 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.875+0000 7f0825f0a700 1 --2- 172.21.15.156:0/2290926228 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f08201350d0 0x7f082011c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.875+0000 7f0825f0a700 1 -- 172.21.15.156:0/2290926228 >> 172.21.15.156:0/2290926228 conn(0x7f0820099c40 msgr2=0x7f082013d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:52.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.875+0000 7f0825f0a700 1 -- 172.21.15.156:0/2290926228 shutdown_connections 2023-09-30T22:25:52.876 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.875+0000 7f0825f0a700 1 -- 172.21.15.156:0/2290926228 wait complete. 2023-09-30T22:25:52.888 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:52.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.887+0000 7f1f5f7fe700 1 -- 172.21.15.156:0/3978626546 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1f7406c3b0 con 0x7f1f74130ce0 2023-09-30T22:25:52.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.887+0000 7f1f69ffb700 1 -- 172.21.15.156:0/3978626546 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f6c01a360 con 0x7f1f74130ce0 2023-09-30T22:25:52.889 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:52.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.889+0000 7f1f5f7fe700 1 -- 172.21.15.156:0/3978626546 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f74130ce0 msgr2=0x7f1f741c8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.889+0000 7f1f5f7fe700 1 --2- 172.21.15.156:0/3978626546 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f74130ce0 0x7f1f741c8c70 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c00cbd0 tx=0x7f1f6c00cf90 comp rx=0 tx=0).stop 2023-09-30T22:25:52.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.889+0000 7f1f5f7fe700 1 -- 172.21.15.156:0/3978626546 shutdown_connections 2023-09-30T22:25:52.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.889+0000 7f1f5f7fe700 1 --2- 172.21.15.156:0/3978626546 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1f74130ce0 0x7f1f741c8c70 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.889+0000 7f1f5f7fe700 1 --2- 172.21.15.156:0/3978626546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f7409d860 0x7f1f741c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.889+0000 7f1f5f7fe700 1 --2- 172.21.15.156:0/3978626546 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f1f7409e170 0x7f1f741c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.889+0000 7f1f5f7fe700 1 -- 172.21.15.156:0/3978626546 >> 172.21.15.156:0/3978626546 conn(0x7f1f74099c40 msgr2=0x7f1f7406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:52.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.890+0000 7f1f5f7fe700 1 -- 172.21.15.156:0/3978626546 shutdown_connections 2023-09-30T22:25:52.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.890+0000 7f1f5f7fe700 1 -- 172.21.15.156:0/3978626546 wait complete. 2023-09-30T22:25:52.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:52.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.929+0000 7fbe2bd23700 1 -- 172.21.15.156:0/607189240 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbe2404f2a0 con 0x7fbe2409e870 2023-09-30T22:25:52.930 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.930+0000 7fbe1a7fc700 1 -- 172.21.15.156:0/607189240 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbe20011360 con 0x7fbe2409e870 2023-09-30T22:25:52.930 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:52.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.932+0000 7fbe2bd23700 1 -- 172.21.15.156:0/607189240 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe2409e870 msgr2=0x7fbe241c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.932+0000 7fbe2bd23700 1 --2- 172.21.15.156:0/607189240 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe2409e870 0x7fbe241c8700 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fbe2000c520 tx=0x7fbe2000c8e0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.932+0000 7fbe2bd23700 1 -- 172.21.15.156:0/607189240 shutdown_connections 2023-09-30T22:25:52.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.932+0000 7fbe2bd23700 1 --2- 172.21.15.156:0/607189240 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe241371c0 0x7fbe2406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.932+0000 7fbe2bd23700 1 --2- 172.21.15.156:0/607189240 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe2409e870 0x7fbe241c8700 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.932+0000 7fbe2bd23700 1 --2- 172.21.15.156:0/607189240 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fbe2409f350 0x7fbe241c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.932+0000 7fbe2bd23700 1 -- 172.21.15.156:0/607189240 >> 172.21.15.156:0/607189240 conn(0x7fbe240a4430 msgr2=0x7fbe2409c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:52.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.932+0000 7fbe2bd23700 1 -- 172.21.15.156:0/607189240 shutdown_connections 2023-09-30T22:25:52.933 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:52.932+0000 7fbe2bd23700 1 -- 172.21.15.156:0/607189240 wait complete. 2023-09-30T22:25:52.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:53.762 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:53.888 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:53.890 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.888+0000 7f4f48f25700 1 Processor -- start 2023-09-30T22:25:53.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.888+0000 7f4f48f25700 1 -- start start 2023-09-30T22:25:53.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.889+0000 7f4f48f25700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f441368e0 0x7f4f44138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.889+0000 7f4f48f25700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f44139200 0x7f4f4413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.889+0000 7f4f48f25700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f4409a760 con 0x7f4f44133900 2023-09-30T22:25:53.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.889+0000 7f4f48f25700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f441336e0 con 0x7f4f441368e0 2023-09-30T22:25:53.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.889+0000 7f4f48f25700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4409a080 con 0x7f4f44139200 2023-09-30T22:25:53.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.889+0000 7f4f42d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f44139200 0x7f4f4413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.889+0000 7f4f4259c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4f44133900 0x7f4f44133cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38542/0 (socket says 172.21.15.156:38542) 2023-09-30T22:25:53.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.889+0000 7f4f4259c700 1 -- 172.21.15.156:0/1365807056 learned_addr learned my addr 172.21.15.156:0/1365807056 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:53.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.889+0000 7f4f41d9b700 1 --2- 172.21.15.156:0/1365807056 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f441368e0 0x7f4f44138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.889+0000 7f4f4159a700 1 -- 172.21.15.156:0/1365807056 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3492887105 0 0) 0x7f4f4409a760 con 0x7f4f44133900 2023-09-30T22:25:53.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.889+0000 7f4f41d9b700 1 -- 172.21.15.156:0/1365807056 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f44139200 msgr2=0x7f4f4413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:53.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.889+0000 7f4f41d9b700 1 --2- 172.21.15.156:0/1365807056 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f44139200 0x7f4f4413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.889+0000 7f4f41d9b700 1 -- 172.21.15.156:0/1365807056 >> v1:172.21.15.156:6789/0 conn(0x7f4f44133900 legacy=0x7f4f44133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.889+0000 7f4f41d9b700 1 -- 172.21.15.156:0/1365807056 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f440a23e0 con 0x7f4f441368e0 2023-09-30T22:25:53.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.889+0000 7f4f42d9d700 1 --2- 172.21.15.156:0/1365807056 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f44139200 0x7f4f4413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:53.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.889+0000 7f4f41d9b700 1 --2- 172.21.15.156:0/1365807056 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f441368e0 0x7f4f44138cc0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f4f34009870 tx=0x7f4f34009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb225f520eba4707 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:53.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.889+0000 7f4f4159a700 1 -- 172.21.15.156:0/1365807056 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f34011830 con 0x7f4f441368e0 2023-09-30T22:25:53.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.889+0000 7f4f4159a700 1 -- 172.21.15.156:0/1365807056 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f34011990 con 0x7f4f441368e0 2023-09-30T22:25:53.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.889+0000 7f4f4159a700 1 -- 172.21.15.156:0/1365807056 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f34011d20 con 0x7f4f441368e0 2023-09-30T22:25:53.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.890+0000 7f4f48f25700 1 -- 172.21.15.156:0/1365807056 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f441368e0 msgr2=0x7f4f44138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.890+0000 7f4f48f25700 1 --2- 172.21.15.156:0/1365807056 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f441368e0 0x7f4f44138cc0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f4f34009870 tx=0x7f4f34009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:53.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.890+0000 7f4f48f25700 1 -- 172.21.15.156:0/1365807056 shutdown_connections 2023-09-30T22:25:53.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.890+0000 7f4f48f25700 1 --2- 172.21.15.156:0/1365807056 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f44139200 0x7f4f4413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.890+0000 7f4f48f25700 1 --2- 172.21.15.156:0/1365807056 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f441368e0 0x7f4f44138cc0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.890+0000 7f4f48f25700 1 -- 172.21.15.156:0/1365807056 >> 172.21.15.156:0/1365807056 conn(0x7f4f440a2980 msgr2=0x7f4f440a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:53.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.890+0000 7f4f48f25700 1 -- 172.21.15.156:0/1365807056 shutdown_connections 2023-09-30T22:25:53.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.890+0000 7f4f48f25700 1 -- 172.21.15.156:0/1365807056 wait complete. 2023-09-30T22:25:53.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.891+0000 7f4f48f25700 1 Processor -- start 2023-09-30T22:25:53.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.891+0000 7f4f48f25700 1 -- start start 2023-09-30T22:25:53.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.891+0000 7f4f48f25700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f44133900 0x7f4f44119da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.891+0000 7f4f48f25700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f441368e0 0x7f4f4411a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.892+0000 7f4f48f25700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f44139200 0x7f4f4411a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.892+0000 7f4f48f25700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4411b9b0 con 0x7f4f441368e0 2023-09-30T22:25:53.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.892+0000 7f4f48f25700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4412fc90 con 0x7f4f44133900 2023-09-30T22:25:53.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.892+0000 7f4f48f25700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4411d5e0 con 0x7f4f44139200 2023-09-30T22:25:53.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.892+0000 7f4f4259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f44133900 0x7f4f44119da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.892+0000 7f4f41d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f441368e0 0x7f4f4411a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.892+0000 7f4f4259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f44133900 0x7f4f44119da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54256/0 (socket says 172.21.15.156:54256) 2023-09-30T22:25:53.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.892+0000 7f4f41d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f441368e0 0x7f4f4411a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49872/0 (socket says 172.21.15.156:49872) 2023-09-30T22:25:53.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.892+0000 7f4f4259c700 1 -- 172.21.15.156:0/3971823557 learned_addr learned my addr 172.21.15.156:0/3971823557 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:53.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.892+0000 7f4f42d9d700 1 --2- 172.21.15.156:0/3971823557 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f44139200 0x7f4f4411a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.892+0000 7f4f4259c700 1 -- 172.21.15.156:0/3971823557 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f44139200 msgr2=0x7f4f4411a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.892+0000 7f4f4259c700 1 --2- 172.21.15.156:0/3971823557 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f44139200 0x7f4f4411a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.892+0000 7f4f4259c700 1 -- 172.21.15.156:0/3971823557 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f441368e0 msgr2=0x7f4f4411a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.892+0000 7f4f4259c700 1 --2- 172.21.15.156:0/3971823557 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f441368e0 0x7f4f4411a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.892+0000 7f4f4259c700 1 -- 172.21.15.156:0/3971823557 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c009a70 con 0x7f4f44133900 2023-09-30T22:25:53.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.892+0000 7f4f41d9b700 1 --2- 172.21.15.156:0/3971823557 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f441368e0 0x7f4f4411a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:53.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.892+0000 7f4f42d9d700 1 --2- 172.21.15.156:0/3971823557 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f44139200 0x7f4f4411a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:53.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.892+0000 7f4f4259c700 1 --2- 172.21.15.156:0/3971823557 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f44133900 0x7f4f44119da0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00c6d0 tx=0x7f4f2c00c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:53.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.892+0000 7f4f3affd700 1 -- 172.21.15.156:0/3971823557 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c0074e0 con 0x7f4f44133900 2023-09-30T22:25:53.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.892+0000 7f4f3affd700 1 -- 172.21.15.156:0/3971823557 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c007640 con 0x7f4f44133900 2023-09-30T22:25:53.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.892+0000 7f4f48f25700 1 -- 172.21.15.156:0/3971823557 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f340094a0 con 0x7f4f44133900 2023-09-30T22:25:53.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.892+0000 7f4f3affd700 1 -- 172.21.15.156:0/3971823557 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c005a70 con 0x7f4f44133900 2023-09-30T22:25:53.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.892+0000 7f4f48f25700 1 -- 172.21.15.156:0/3971823557 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f4409a2c0 con 0x7f4f44133900 2023-09-30T22:25:53.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.893+0000 7f4f3affd700 1 -- 172.21.15.156:0/3971823557 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4f2c005bd0 con 0x7f4f44133900 2023-09-30T22:25:53.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.893+0000 7f4f3affd700 1 -- 172.21.15.156:0/3971823557 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4f2c03ea40 con 0x7f4f44133900 2023-09-30T22:25:53.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.893+0000 7f4f48f25700 1 -- 172.21.15.156:0/3971823557 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f4404f2a0 con 0x7f4f44133900 2023-09-30T22:25:53.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:53.898+0000 7f4f3affd700 1 -- 172.21.15.156:0/3971823557 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4f2c018260 con 0x7f4f44133900 2023-09-30T22:25:53.903 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:53.946 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:54.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.029+0000 7f07cd7b3700 1 Processor -- start 2023-09-30T22:25:54.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.029+0000 7f07cd7b3700 1 -- start start 2023-09-30T22:25:54.030 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.029+0000 7f07cd7b3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07c809f350 0x7f07c8136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:54.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.029+0000 7f07cd7b3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07c81371c0 0x7f07c81395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:54.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.029+0000 7f07cd7b3700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c809c970 con 0x7f07c809e870 2023-09-30T22:25:54.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.029+0000 7f07cd7b3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c80a0920 con 0x7f07c81371c0 2023-09-30T22:25:54.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.029+0000 7f07cd7b3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07c809f9c0 con 0x7f07c809f350 2023-09-30T22:25:54.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.030+0000 7f07c6ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f07c809e870 0x7f07c809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38544/0 (socket says 172.21.15.156:38544) 2023-09-30T22:25:54.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.030+0000 7f07c6ffd700 1 -- 172.21.15.156:0/4019944917 learned_addr learned my addr 172.21.15.156:0/4019944917 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:54.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.030+0000 7f07c77fe700 1 --2- 172.21.15.156:0/4019944917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07c81371c0 0x7f07c81395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:54.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.030+0000 7f07bffff700 1 --2- 172.21.15.156:0/4019944917 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07c809f350 0x7f07c8136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:54.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.030+0000 7f07bffff700 1 -- 172.21.15.156:0/4019944917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07c81371c0 msgr2=0x7f07c81395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:54.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.030+0000 7f07bffff700 1 --2- 172.21.15.156:0/4019944917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07c81371c0 0x7f07c81395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.031 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.030+0000 7f07bffff700 1 -- 172.21.15.156:0/4019944917 >> v1:172.21.15.156:6789/0 conn(0x7f07c809e870 legacy=0x7f07c809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:54.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.030+0000 7f07bffff700 1 -- 172.21.15.156:0/4019944917 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c809bab0 con 0x7f07c809f350 2023-09-30T22:25:54.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.030+0000 7f07c67fc700 1 -- 172.21.15.156:0/4019944917 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 95555510 0 0) 0x7f07c809c970 con 0x7f07c809e870 2023-09-30T22:25:54.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.030+0000 7f07c77fe700 1 --2- 172.21.15.156:0/4019944917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07c81371c0 0x7f07c81395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:54.032 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.030+0000 7f07bffff700 1 --2- 172.21.15.156:0/4019944917 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07c809f350 0x7f07c8136c80 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009870 tx=0x7f07b0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=238be5bedd018c53 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:54.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.030+0000 7f07c67fc700 1 -- 172.21.15.156:0/4019944917 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b0011830 con 0x7f07c809f350 2023-09-30T22:25:54.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.030+0000 7f07c67fc700 1 -- 172.21.15.156:0/4019944917 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b0011990 con 0x7f07c809f350 2023-09-30T22:25:54.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.030+0000 7f07c67fc700 1 -- 172.21.15.156:0/4019944917 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b0011d20 con 0x7f07c809f350 2023-09-30T22:25:54.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.031+0000 7f07cd7b3700 1 -- 172.21.15.156:0/4019944917 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07c809f350 msgr2=0x7f07c8136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:54.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.031+0000 7f07cd7b3700 1 --2- 172.21.15.156:0/4019944917 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07c809f350 0x7f07c8136c80 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009870 tx=0x7f07b0009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:54.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.031+0000 7f07cd7b3700 1 -- 172.21.15.156:0/4019944917 shutdown_connections 2023-09-30T22:25:54.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.031+0000 7f07cd7b3700 1 --2- 172.21.15.156:0/4019944917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07c81371c0 0x7f07c81395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.031+0000 7f07cd7b3700 1 --2- 172.21.15.156:0/4019944917 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07c809f350 0x7f07c8136c80 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.031+0000 7f07cd7b3700 1 -- 172.21.15.156:0/4019944917 >> 172.21.15.156:0/4019944917 conn(0x7f07c80a4430 msgr2=0x7f07c80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:54.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.032+0000 7f07cd7b3700 1 -- 172.21.15.156:0/4019944917 shutdown_connections 2023-09-30T22:25:54.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.032+0000 7f07cd7b3700 1 -- 172.21.15.156:0/4019944917 wait complete. 2023-09-30T22:25:54.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.033+0000 7f07cd7b3700 1 Processor -- start 2023-09-30T22:25:54.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.033+0000 7f07cd7b3700 1 -- start start 2023-09-30T22:25:54.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.033+0000 7f07cd7b3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07c809e870 0x7f07c81c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:54.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.033+0000 7f07cd7b3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07c809f350 0x7f07c81c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:54.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.033+0000 7f07cd7b3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07c81371c0 0x7f07c806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:54.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.033+0000 7f07cd7b3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c806d470 con 0x7f07c81371c0 2023-09-30T22:25:54.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.033+0000 7f07cd7b3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c8126170 con 0x7f07c809f350 2023-09-30T22:25:54.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.033+0000 7f07cd7b3700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07c8136510 con 0x7f07c809e870 2023-09-30T22:25:54.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.034+0000 7f07bffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07c809f350 0x7f07c81c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:54.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.034+0000 7f07bffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07c809f350 0x7f07c81c8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54272/0 (socket says 172.21.15.156:54272) 2023-09-30T22:25:54.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.034+0000 7f07bffff700 1 -- 172.21.15.156:0/3564861267 learned_addr learned my addr 172.21.15.156:0/3564861267 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:54.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.034+0000 7f07c6ffd700 1 --2- 172.21.15.156:0/3564861267 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07c809e870 0x7f07c81c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:54.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.034+0000 7f07bffff700 1 -- 172.21.15.156:0/3564861267 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07c809e870 msgr2=0x7f07c81c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:54.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.034+0000 7f07bffff700 1 --2- 172.21.15.156:0/3564861267 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07c809e870 0x7f07c81c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.034+0000 7f07bffff700 1 -- 172.21.15.156:0/3564861267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07c81371c0 msgr2=0x7f07c806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:54.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.034+0000 7f07bffff700 1 --2- 172.21.15.156:0/3564861267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07c81371c0 0x7f07c806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.034+0000 7f07bffff700 1 -- 172.21.15.156:0/3564861267 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c0009a70 con 0x7f07c809f350 2023-09-30T22:25:54.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.034+0000 7f07bffff700 1 --2- 172.21.15.156:0/3564861267 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07c809f350 0x7f07c81c8b10 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f07b0000c00 tx=0x7f07b0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:54.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.034+0000 7f07bf7fe700 1 -- 172.21.15.156:0/3564861267 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b0004590 con 0x7f07c809f350 2023-09-30T22:25:54.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.034+0000 7f07bf7fe700 1 -- 172.21.15.156:0/3564861267 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b001f070 con 0x7f07c809f350 2023-09-30T22:25:54.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.034+0000 7f07cd7b3700 1 -- 172.21.15.156:0/3564861267 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b00094a0 con 0x7f07c809f350 2023-09-30T22:25:54.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.034+0000 7f07bf7fe700 1 -- 172.21.15.156:0/3564861267 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b00038e0 con 0x7f07c809f350 2023-09-30T22:25:54.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.034+0000 7f07cd7b3700 1 -- 172.21.15.156:0/3564861267 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c8124d30 con 0x7f07c809f350 2023-09-30T22:25:54.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.035+0000 7f07bf7fe700 1 -- 172.21.15.156:0/3564861267 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f07b0003a40 con 0x7f07c809f350 2023-09-30T22:25:54.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.035+0000 7f07bf7fe700 1 -- 172.21.15.156:0/3564861267 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f07b0021070 con 0x7f07c809f350 2023-09-30T22:25:54.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.036+0000 7f07cd7b3700 1 -- 172.21.15.156:0/3564861267 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c804f2a0 con 0x7f07c809f350 2023-09-30T22:25:54.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.037+0000 7fd760e31700 1 Processor -- start 2023-09-30T22:25:54.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.037+0000 7fd760e31700 1 -- start start 2023-09-30T22:25:54.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.038+0000 7fd760e31700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd75c09f350 0x7fd75c136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:54.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.038+0000 7fd760e31700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd75c1371c0 0x7fd75c1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:54.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.038+0000 7fd760e31700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd75c09c970 con 0x7fd75c09e870 2023-09-30T22:25:54.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.038+0000 7fd760e31700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd75c0a0920 con 0x7fd75c09f350 2023-09-30T22:25:54.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.038+0000 7fd760e31700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c09f9c0 con 0x7fd75c1371c0 2023-09-30T22:25:54.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.038+0000 7fd75a59c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fd75c09e870 0x7fd75c09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38548/0 (socket says 172.21.15.156:38548) 2023-09-30T22:25:54.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.038+0000 7fd75a59c700 1 -- 172.21.15.156:0/3221641827 learned_addr learned my addr 172.21.15.156:0/3221641827 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:54.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.038+0000 7fd75ad9d700 1 --2- 172.21.15.156:0/3221641827 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd75c1371c0 0x7fd75c1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:54.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.038+0000 7fd75ad9d700 1 -- 172.21.15.156:0/3221641827 >> v2:172.21.15.156:3300/0 conn(0x7fd75c09f350 msgr2=0x7fd75c136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:54.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.038+0000 7fd75ad9d700 1 --2- 172.21.15.156:0/3221641827 >> v2:172.21.15.156:3300/0 conn(0x7fd75c09f350 0x7fd75c136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.038+0000 7fd75ad9d700 1 -- 172.21.15.156:0/3221641827 >> v1:172.21.15.156:6789/0 conn(0x7fd75c09e870 legacy=0x7fd75c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:54.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.038+0000 7fd75ad9d700 1 -- 172.21.15.156:0/3221641827 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c09bab0 con 0x7fd75c1371c0 2023-09-30T22:25:54.040 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.038+0000 7fd75959a700 1 -- 172.21.15.156:0/3221641827 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1709263563 0 0) 0x7fd75c09c970 con 0x7fd75c09e870 2023-09-30T22:25:54.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.038+0000 7fd75ad9d700 1 --2- 172.21.15.156:0/3221641827 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd75c1371c0 0x7fd75c1395a0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fd754009d90 tx=0x7fd75400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebba3a65efbad76b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:54.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.039+0000 7fd75959a700 1 -- 172.21.15.156:0/3221641827 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75400e070 con 0x7fd75c1371c0 2023-09-30T22:25:54.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.039+0000 7fd75959a700 1 -- 172.21.15.156:0/3221641827 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75400bbd0 con 0x7fd75c1371c0 2023-09-30T22:25:54.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.039+0000 7fd75959a700 1 -- 172.21.15.156:0/3221641827 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd754012430 con 0x7fd75c1371c0 2023-09-30T22:25:54.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.039+0000 7fd760e31700 1 -- 172.21.15.156:0/3221641827 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd75c1371c0 msgr2=0x7fd75c1395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:54.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.039+0000 7fd760e31700 1 --2- 172.21.15.156:0/3221641827 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd75c1371c0 0x7fd75c1395a0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fd754009d90 tx=0x7fd75400b330 comp rx=0 tx=0).stop 2023-09-30T22:25:54.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.039+0000 7fd760e31700 1 -- 172.21.15.156:0/3221641827 shutdown_connections 2023-09-30T22:25:54.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.039+0000 7fd760e31700 1 --2- 172.21.15.156:0/3221641827 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd75c1371c0 0x7fd75c1395a0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.039+0000 7fd760e31700 1 --2- 172.21.15.156:0/3221641827 >> v2:172.21.15.156:3300/0 conn(0x7fd75c09f350 0x7fd75c136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.039+0000 7fd760e31700 1 -- 172.21.15.156:0/3221641827 >> 172.21.15.156:0/3221641827 conn(0x7fd75c0a4430 msgr2=0x7fd75c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:54.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.040+0000 7fd760e31700 1 -- 172.21.15.156:0/3221641827 shutdown_connections 2023-09-30T22:25:54.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.040+0000 7fd760e31700 1 -- 172.21.15.156:0/3221641827 wait complete. 2023-09-30T22:25:54.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.041+0000 7fd760e31700 1 Processor -- start 2023-09-30T22:25:54.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.041+0000 7fd760e31700 1 -- start start 2023-09-30T22:25:54.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.041+0000 7fd760e31700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd75c09e870 0x7fd75c1c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:54.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.041+0000 7fd760e31700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd75c09f350 0x7fd75c1c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:54.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.041+0000 7fd760e31700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd75c1371c0 0x7fd75c132a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:54.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.041+0000 7fd760e31700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c134d20 con 0x7fd75c1371c0 2023-09-30T22:25:54.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.041+0000 7fd760e31700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c09b160 con 0x7fd75c09e870 2023-09-30T22:25:54.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.041+0000 7fd760e31700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c09dba0 con 0x7fd75c09f350 2023-09-30T22:25:54.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.041+0000 7fd759d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd75c09f350 0x7fd75c1c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:54.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.041+0000 7fd759d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd75c09f350 0x7fd75c1c9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43492/0 (socket says 172.21.15.156:43492) 2023-09-30T22:25:54.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.041+0000 7fd759d9b700 1 -- 172.21.15.156:0/758600025 learned_addr learned my addr 172.21.15.156:0/758600025 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:54.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.042+0000 7fd75a59c700 1 --2- 172.21.15.156:0/758600025 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd75c09e870 0x7fd75c1c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:54.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.042+0000 7fd75ad9d700 1 --2- 172.21.15.156:0/758600025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd75c1371c0 0x7fd75c132a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:54.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.042+0000 7fd759d9b700 1 -- 172.21.15.156:0/758600025 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd75c09e870 msgr2=0x7fd75c1c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:54.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.042+0000 7fd759d9b700 1 --2- 172.21.15.156:0/758600025 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd75c09e870 0x7fd75c1c96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.042+0000 7fd759d9b700 1 -- 172.21.15.156:0/758600025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd75c1371c0 msgr2=0x7fd75c132a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:54.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.042+0000 7fd759d9b700 1 --2- 172.21.15.156:0/758600025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd75c1371c0 0x7fd75c132a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.042+0000 7fd759d9b700 1 -- 172.21.15.156:0/758600025 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd754009a70 con 0x7fd75c09f350 2023-09-30T22:25:54.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.042+0000 7fd759d9b700 1 --2- 172.21.15.156:0/758600025 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd75c09f350 0x7fd75c1c9c00 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fd74c00b530 tx=0x7fd74c00b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:54.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.043+0000 7f07bf7fe700 1 -- 172.21.15.156:0/3564861267 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f07b0015020 con 0x7f07c809f350 2023-09-30T22:25:54.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.043+0000 7fd74affd700 1 -- 172.21.15.156:0/758600025 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c011830 con 0x7fd75c09f350 2023-09-30T22:25:54.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.043+0000 7fd74affd700 1 -- 172.21.15.156:0/758600025 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74c011990 con 0x7fd75c09f350 2023-09-30T22:25:54.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.043+0000 7fd74affd700 1 -- 172.21.15.156:0/758600025 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c011d40 con 0x7fd75c09f350 2023-09-30T22:25:54.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.043+0000 7fd760e31700 1 -- 172.21.15.156:0/758600025 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd75c133ca0 con 0x7fd75c09f350 2023-09-30T22:25:54.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.043+0000 7fd760e31700 1 -- 172.21.15.156:0/758600025 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75c136790 con 0x7fd75c09f350 2023-09-30T22:25:54.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.044+0000 7fd760e31700 1 -- 172.21.15.156:0/758600025 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd75c04f2a0 con 0x7fd75c09f350 2023-09-30T22:25:54.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.044+0000 7fd74affd700 1 -- 172.21.15.156:0/758600025 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd74c01a400 con 0x7fd75c09f350 2023-09-30T22:25:54.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.044+0000 7fd74affd700 1 -- 172.21.15.156:0/758600025 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd74c040bd0 con 0x7fd75c09f350 2023-09-30T22:25:54.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.049+0000 7fd74affd700 1 -- 172.21.15.156:0/758600025 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd74c044060 con 0x7fd75c09f350 2023-09-30T22:25:54.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.078+0000 7f0fb041f700 1 Processor -- start 2023-09-30T22:25:54.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.078+0000 7f0fb041f700 1 -- start start 2023-09-30T22:25:54.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.079+0000 7f0fb041f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0fa809e870 0x7f0fa809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:54.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.079+0000 7f0fb041f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0fa8131f40 0x7f0fa8139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:54.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.079+0000 7f0fb041f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa809c970 con 0x7f0fa809f180 2023-09-30T22:25:54.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.079+0000 7f0fb041f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa80a0920 con 0x7f0fa8131f40 2023-09-30T22:25:54.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.079+0000 7f0fb041f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa809f9c0 con 0x7f0fa809e870 2023-09-30T22:25:54.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.079+0000 7f0fae1bb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0fa809e870 0x7f0fa809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:54.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.079+0000 7f0fae1bb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0fa809e870 0x7f0fa809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43506/0 (socket says 172.21.15.156:43506) 2023-09-30T22:25:54.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.079+0000 7f0fae1bb700 1 -- 172.21.15.156:0/886589388 learned_addr learned my addr 172.21.15.156:0/886589388 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:54.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.079+0000 7f0fae9bc700 1 --2- 172.21.15.156:0/886589388 >> v2:172.21.15.156:3300/0 conn(0x7f0fa8131f40 0x7f0fa8139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:54.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.080+0000 7f0fae1bb700 1 -- 172.21.15.156:0/886589388 >> v2:172.21.15.156:3300/0 conn(0x7f0fa8131f40 msgr2=0x7f0fa8139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:54.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.080+0000 7f0fae1bb700 1 --2- 172.21.15.156:0/886589388 >> v2:172.21.15.156:3300/0 conn(0x7f0fa8131f40 0x7f0fa8139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.080+0000 7f0fad1b9700 1 -- 172.21.15.156:0/886589388 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 271074362 0 0) 0x7f0fa809c970 con 0x7f0fa809f180 2023-09-30T22:25:54.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.080+0000 7f0fae1bb700 1 -- 172.21.15.156:0/886589388 >> v1:172.21.15.156:6789/0 conn(0x7f0fa809f180 legacy=0x7f0fa8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:54.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.080+0000 7f0fae1bb700 1 -- 172.21.15.156:0/886589388 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa809bab0 con 0x7f0fa809e870 2023-09-30T22:25:54.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.080+0000 7f0fae9bc700 1 --2- 172.21.15.156:0/886589388 >> v2:172.21.15.156:3300/0 conn(0x7f0fa8131f40 0x7f0fa8139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:54.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.080+0000 7f0fae1bb700 1 --2- 172.21.15.156:0/886589388 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0fa809e870 0x7f0fa809ec40 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f0fa40098f0 tx=0x7f0fa4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfb9b003b0c26322 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:54.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.080+0000 7f0fad1b9700 1 -- 172.21.15.156:0/886589388 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4011830 con 0x7f0fa809e870 2023-09-30T22:25:54.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.080+0000 7f0fad1b9700 1 -- 172.21.15.156:0/886589388 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa4011990 con 0x7f0fa809e870 2023-09-30T22:25:54.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.080+0000 7f0fad1b9700 1 -- 172.21.15.156:0/886589388 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4011d20 con 0x7f0fa809e870 2023-09-30T22:25:54.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.081+0000 7f0fb041f700 1 -- 172.21.15.156:0/886589388 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0fa809e870 msgr2=0x7f0fa809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:54.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.081+0000 7f0fb041f700 1 --2- 172.21.15.156:0/886589388 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0fa809e870 0x7f0fa809ec40 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f0fa40098f0 tx=0x7f0fa4009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:54.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.081+0000 7f0fb041f700 1 -- 172.21.15.156:0/886589388 shutdown_connections 2023-09-30T22:25:54.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.081+0000 7f0fb041f700 1 --2- 172.21.15.156:0/886589388 >> v2:172.21.15.156:3300/0 conn(0x7f0fa8131f40 0x7f0fa8139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.081+0000 7f0fb041f700 1 --2- 172.21.15.156:0/886589388 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0fa809e870 0x7f0fa809ec40 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.081+0000 7f0fb041f700 1 -- 172.21.15.156:0/886589388 >> 172.21.15.156:0/886589388 conn(0x7f0fa80a4430 msgr2=0x7f0fa80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:54.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.081+0000 7f0fb041f700 1 -- 172.21.15.156:0/886589388 shutdown_connections 2023-09-30T22:25:54.084 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.081+0000 7f0fb041f700 1 -- 172.21.15.156:0/886589388 wait complete. 2023-09-30T22:25:54.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.082+0000 7f0fb041f700 1 Processor -- start 2023-09-30T22:25:54.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.082+0000 7f0fb041f700 1 -- start start 2023-09-30T22:25:54.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.083+0000 7f0fb041f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fa809e870 0x7f0fa806c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:54.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.083+0000 7f0fb041f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0fa809f180 0x7f0fa81c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:54.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.083+0000 7f0fb041f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0fa8131f40 0x7f0fa81c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:54.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.083+0000 7f0fb041f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa806c100 con 0x7f0fa809e870 2023-09-30T22:25:54.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.083+0000 7f0fb041f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa809dba0 con 0x7f0fa809f180 2023-09-30T22:25:54.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.083+0000 7f0fb041f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa81215e0 con 0x7f0fa8131f40 2023-09-30T22:25:54.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.083+0000 7f0fae9bc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0fa8131f40 0x7f0fa81c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:54.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.083+0000 7f0fae1bb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fa809e870 0x7f0fa806c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:54.087 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.083+0000 7f0fae9bc700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0fa8131f40 0x7f0fa81c87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43518/0 (socket says 172.21.15.156:43518) 2023-09-30T22:25:54.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.083+0000 7f0fae9bc700 1 -- 172.21.15.156:0/3475453412 learned_addr learned my addr 172.21.15.156:0/3475453412 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:54.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.083+0000 7f0fae1bb700 1 -- 172.21.15.156:0/3475453412 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0fa8131f40 msgr2=0x7f0fa81c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:54.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.083+0000 7f0fae1bb700 1 --2- 172.21.15.156:0/3475453412 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0fa8131f40 0x7f0fa81c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.083+0000 7f0fae1bb700 1 -- 172.21.15.156:0/3475453412 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0fa809f180 msgr2=0x7f0fa81c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:54.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.083+0000 7f0fae1bb700 1 --2- 172.21.15.156:0/3475453412 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0fa809f180 0x7f0fa81c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.083+0000 7f0fae1bb700 1 -- 172.21.15.156:0/3475453412 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa0009a70 con 0x7f0fa809e870 2023-09-30T22:25:54.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.083+0000 7f0fae1bb700 1 --2- 172.21.15.156:0/3475453412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fa809e870 0x7f0fa806c530 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4016000 tx=0x7f0fa4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:54.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.084+0000 7f0f9effd700 1 -- 172.21.15.156:0/3475453412 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4004590 con 0x7f0fa809e870 2023-09-30T22:25:54.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.084+0000 7f0f9effd700 1 -- 172.21.15.156:0/3475453412 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa401e070 con 0x7f0fa809e870 2023-09-30T22:25:54.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.084+0000 7f0fb041f700 1 -- 172.21.15.156:0/3475453412 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa4009550 con 0x7f0fa809e870 2023-09-30T22:25:54.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.084+0000 7f0f9effd700 1 -- 172.21.15.156:0/3475453412 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa40038c0 con 0x7f0fa809e870 2023-09-30T22:25:54.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.084+0000 7f0fb041f700 1 -- 172.21.15.156:0/3475453412 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa806d5a0 con 0x7f0fa809e870 2023-09-30T22:25:54.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.085+0000 7f0fb041f700 1 -- 172.21.15.156:0/3475453412 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa8122400 con 0x7f0fa809e870 2023-09-30T22:25:54.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.085+0000 7f0f9effd700 1 -- 172.21.15.156:0/3475453412 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0fa4003a20 con 0x7f0fa809e870 2023-09-30T22:25:54.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.086+0000 7f0f9effd700 1 -- 172.21.15.156:0/3475453412 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0fa4040a00 con 0x7f0fa809e870 2023-09-30T22:25:54.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.094+0000 7f0f9effd700 1 -- 172.21.15.156:0/3475453412 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0fa402d450 con 0x7f0fa809e870 2023-09-30T22:25:54.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.116+0000 7f4f48f25700 1 -- 172.21.15.156:0/3971823557 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4f4411c1b0 con 0x7f4f44133900 2023-09-30T22:25:54.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.116+0000 7f4f3affd700 1 -- 172.21.15.156:0/3971823557 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4f2c017020 con 0x7f4f44133900 2023-09-30T22:25:54.117 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:54.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.119+0000 7f4f48f25700 1 -- 172.21.15.156:0/3971823557 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f44133900 msgr2=0x7f4f44119da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:54.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.119+0000 7f4f48f25700 1 --2- 172.21.15.156:0/3971823557 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f44133900 0x7f4f44119da0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00c6d0 tx=0x7f4f2c00c9e0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.119+0000 7f4f48f25700 1 -- 172.21.15.156:0/3971823557 shutdown_connections 2023-09-30T22:25:54.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.119+0000 7f4f48f25700 1 --2- 172.21.15.156:0/3971823557 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4f44139200 0x7f4f4411a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.119+0000 7f4f48f25700 1 --2- 172.21.15.156:0/3971823557 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4f44133900 0x7f4f44119da0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.119+0000 7f4f48f25700 1 --2- 172.21.15.156:0/3971823557 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f441368e0 0x7f4f4411a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.119+0000 7f4f48f25700 1 -- 172.21.15.156:0/3971823557 >> 172.21.15.156:0/3971823557 conn(0x7f4f440a2980 msgr2=0x7f4f440a0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:54.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.120+0000 7f4f48f25700 1 -- 172.21.15.156:0/3971823557 shutdown_connections 2023-09-30T22:25:54.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.120+0000 7f4f48f25700 1 -- 172.21.15.156:0/3971823557 wait complete. 2023-09-30T22:25:54.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:54.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.244+0000 7fd760e31700 1 -- 172.21.15.156:0/758600025 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd75c135810 con 0x7fd75c09f350 2023-09-30T22:25:54.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.245+0000 7fd74affd700 1 -- 172.21.15.156:0/758600025 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd75c135810 con 0x7fd75c09f350 2023-09-30T22:25:54.246 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:54.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.246+0000 7f07cd7b3700 1 -- 172.21.15.156:0/3564861267 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f07c80721c0 con 0x7f07c809f350 2023-09-30T22:25:54.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.247+0000 7f07bf7fe700 1 -- 172.21.15.156:0/3564861267 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f07b0010380 con 0x7f07c809f350 2023-09-30T22:25:54.247 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:54.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.247+0000 7fd760e31700 1 -- 172.21.15.156:0/758600025 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd75c09f350 msgr2=0x7fd75c1c9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:54.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.247+0000 7fd760e31700 1 --2- 172.21.15.156:0/758600025 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd75c09f350 0x7fd75c1c9c00 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fd74c00b530 tx=0x7fd74c00b840 comp rx=0 tx=0).stop 2023-09-30T22:25:54.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.247+0000 7fd760e31700 1 -- 172.21.15.156:0/758600025 shutdown_connections 2023-09-30T22:25:54.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.247+0000 7fd760e31700 1 --2- 172.21.15.156:0/758600025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd75c1371c0 0x7fd75c132a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.247+0000 7fd760e31700 1 --2- 172.21.15.156:0/758600025 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd75c09e870 0x7fd75c1c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.247+0000 7fd760e31700 1 --2- 172.21.15.156:0/758600025 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd75c09f350 0x7fd75c1c9c00 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.247+0000 7fd760e31700 1 -- 172.21.15.156:0/758600025 >> 172.21.15.156:0/758600025 conn(0x7fd75c0a4430 msgr2=0x7fd75c0a2920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:54.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.247+0000 7fd760e31700 1 -- 172.21.15.156:0/758600025 shutdown_connections 2023-09-30T22:25:54.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.247+0000 7fd760e31700 1 -- 172.21.15.156:0/758600025 wait complete. 2023-09-30T22:25:54.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.249+0000 7f07cd7b3700 1 -- 172.21.15.156:0/3564861267 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07c809f350 msgr2=0x7f07c81c8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:54.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.249+0000 7f07cd7b3700 1 --2- 172.21.15.156:0/3564861267 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07c809f350 0x7f07c81c8b10 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f07b0000c00 tx=0x7f07b0004750 comp rx=0 tx=0).stop 2023-09-30T22:25:54.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.249+0000 7f07cd7b3700 1 -- 172.21.15.156:0/3564861267 shutdown_connections 2023-09-30T22:25:54.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.249+0000 7f07cd7b3700 1 --2- 172.21.15.156:0/3564861267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07c81371c0 0x7f07c806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.249+0000 7f07cd7b3700 1 --2- 172.21.15.156:0/3564861267 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f07c809e870 0x7f07c81c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.249+0000 7f07cd7b3700 1 --2- 172.21.15.156:0/3564861267 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f07c809f350 0x7f07c81c8b10 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.249+0000 7f07cd7b3700 1 -- 172.21.15.156:0/3564861267 >> 172.21.15.156:0/3564861267 conn(0x7f07c80a4430 msgr2=0x7f07c80a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:54.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.249+0000 7f07cd7b3700 1 -- 172.21.15.156:0/3564861267 shutdown_connections 2023-09-30T22:25:54.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.249+0000 7f07cd7b3700 1 -- 172.21.15.156:0/3564861267 wait complete. 2023-09-30T22:25:54.263 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:54.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:54.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.301+0000 7f0fb041f700 1 -- 172.21.15.156:0/3475453412 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0fa804f2a0 con 0x7f0fa809e870 2023-09-30T22:25:54.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.301+0000 7f0f9effd700 1 -- 172.21.15.156:0/3475453412 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0fa4015030 con 0x7f0fa809e870 2023-09-30T22:25:54.302 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:54.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.303+0000 7f0fb041f700 1 -- 172.21.15.156:0/3475453412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fa809e870 msgr2=0x7f0fa806c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:54.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.303+0000 7f0fb041f700 1 --2- 172.21.15.156:0/3475453412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fa809e870 0x7f0fa806c530 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4016000 tx=0x7f0fa4004750 comp rx=0 tx=0).stop 2023-09-30T22:25:54.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.303+0000 7f0fb041f700 1 -- 172.21.15.156:0/3475453412 shutdown_connections 2023-09-30T22:25:54.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.303+0000 7f0fb041f700 1 --2- 172.21.15.156:0/3475453412 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0fa8131f40 0x7f0fa81c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.303+0000 7f0fb041f700 1 --2- 172.21.15.156:0/3475453412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fa809e870 0x7f0fa806c530 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.303+0000 7f0fb041f700 1 --2- 172.21.15.156:0/3475453412 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0fa809f180 0x7f0fa81c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.303+0000 7f0fb041f700 1 -- 172.21.15.156:0/3475453412 >> 172.21.15.156:0/3475453412 conn(0x7f0fa80a4430 msgr2=0x7f0fa809c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:54.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.304+0000 7f0fb041f700 1 -- 172.21.15.156:0/3475453412 shutdown_connections 2023-09-30T22:25:54.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:54.304+0000 7f0fb041f700 1 -- 172.21.15.156:0/3475453412 wait complete. 2023-09-30T22:25:54.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:55.135 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:55.264 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:55.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.264+0000 7fc497493700 1 Processor -- start 2023-09-30T22:25:55.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.265+0000 7fc497493700 1 -- start start 2023-09-30T22:25:55.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.265+0000 7fc497493700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc49009f350 0x7fc490136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.265+0000 7fc497493700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4901371c0 0x7fc4901395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.265+0000 7fc497493700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc49009c970 con 0x7fc49009e870 2023-09-30T22:25:55.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.265+0000 7fc497493700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4900a0920 con 0x7fc49009f350 2023-09-30T22:25:55.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.265+0000 7fc497493700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49009f9c0 con 0x7fc4901371c0 2023-09-30T22:25:55.267 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:55.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.265+0000 7fc494a2e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc49009f350 0x7fc490136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.265+0000 7fc495a30700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4901371c0 0x7fc4901395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.265+0000 7fc49522f700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc49009e870 0x7fc49009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38558/0 (socket says 172.21.15.156:38558) 2023-09-30T22:25:55.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.265+0000 7fc49522f700 1 -- 172.21.15.156:0/242619168 learned_addr learned my addr 172.21.15.156:0/242619168 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:55.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.265+0000 7fc495a30700 1 -- 172.21.15.156:0/242619168 >> v2:172.21.15.156:3300/0 conn(0x7fc49009f350 msgr2=0x7fc490136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:55.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.265+0000 7fc495a30700 1 --2- 172.21.15.156:0/242619168 >> v2:172.21.15.156:3300/0 conn(0x7fc49009f350 0x7fc490136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.265+0000 7fc495a30700 1 -- 172.21.15.156:0/242619168 >> v1:172.21.15.156:6789/0 conn(0x7fc49009e870 legacy=0x7fc49009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.265+0000 7fc495a30700 1 -- 172.21.15.156:0/242619168 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49009bab0 con 0x7fc4901371c0 2023-09-30T22:25:55.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.265+0000 7fc494a2e700 1 --2- 172.21.15.156:0/242619168 >> v2:172.21.15.156:3300/0 conn(0x7fc49009f350 0x7fc490136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:55.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.265+0000 7fc487fff700 1 -- 172.21.15.156:0/242619168 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2404671579 0 0) 0x7fc49009c970 con 0x7fc49009e870 2023-09-30T22:25:55.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.266+0000 7fc495a30700 1 --2- 172.21.15.156:0/242619168 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4901371c0 0x7fc4901395a0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fc488009d90 tx=0x7fc48800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55b1a7faae52e80 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:55.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.266+0000 7fc487fff700 1 -- 172.21.15.156:0/242619168 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48800e070 con 0x7fc4901371c0 2023-09-30T22:25:55.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.266+0000 7fc487fff700 1 -- 172.21.15.156:0/242619168 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48800bb20 con 0x7fc4901371c0 2023-09-30T22:25:55.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.266+0000 7fc487fff700 1 -- 172.21.15.156:0/242619168 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc488012430 con 0x7fc4901371c0 2023-09-30T22:25:55.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.266+0000 7fc497493700 1 -- 172.21.15.156:0/242619168 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4901371c0 msgr2=0x7fc4901395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.266+0000 7fc497493700 1 --2- 172.21.15.156:0/242619168 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4901371c0 0x7fc4901395a0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fc488009d90 tx=0x7fc48800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:55.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.266+0000 7fc497493700 1 -- 172.21.15.156:0/242619168 shutdown_connections 2023-09-30T22:25:55.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.266+0000 7fc497493700 1 --2- 172.21.15.156:0/242619168 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4901371c0 0x7fc4901395a0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.272 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.266+0000 7fc497493700 1 --2- 172.21.15.156:0/242619168 >> v2:172.21.15.156:3300/0 conn(0x7fc49009f350 0x7fc490136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.266+0000 7fc497493700 1 -- 172.21.15.156:0/242619168 >> 172.21.15.156:0/242619168 conn(0x7fc4900a4430 msgr2=0x7fc4900a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:55.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.266+0000 7fc497493700 1 -- 172.21.15.156:0/242619168 shutdown_connections 2023-09-30T22:25:55.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.267+0000 7fc497493700 1 -- 172.21.15.156:0/242619168 wait complete. 2023-09-30T22:25:55.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.267+0000 7fc497493700 1 Processor -- start 2023-09-30T22:25:55.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.267+0000 7fc497493700 1 -- start start 2023-09-30T22:25:55.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.268+0000 7fc497493700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc49009e870 0x7fc49006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.268+0000 7fc497493700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc49009f350 0x7fc49006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.268+0000 7fc497493700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4901371c0 0x7fc49006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.268+0000 7fc497493700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49006d540 con 0x7fc4901371c0 2023-09-30T22:25:55.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.268+0000 7fc497493700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc490126150 con 0x7fc49009e870 2023-09-30T22:25:55.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.268+0000 7fc497493700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc490072200 con 0x7fc49009f350 2023-09-30T22:25:55.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.268+0000 7fc495a30700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4901371c0 0x7fc49006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.268+0000 7fc49522f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc49009e870 0x7fc49006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.268+0000 7fc494a2e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc49009f350 0x7fc49006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.268+0000 7fc495a30700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4901371c0 0x7fc49006c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:49944/0 (socket says 172.21.15.156:49944) 2023-09-30T22:25:55.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.268+0000 7fc495a30700 1 -- 172.21.15.156:0/2209452268 learned_addr learned my addr 172.21.15.156:0/2209452268 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:55.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.268+0000 7fc49522f700 1 -- 172.21.15.156:0/2209452268 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc49009f350 msgr2=0x7fc49006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.268+0000 7fc49522f700 1 --2- 172.21.15.156:0/2209452268 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc49009f350 0x7fc49006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.268+0000 7fc49522f700 1 -- 172.21.15.156:0/2209452268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4901371c0 msgr2=0x7fc49006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.268+0000 7fc49522f700 1 --2- 172.21.15.156:0/2209452268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4901371c0 0x7fc49006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.268+0000 7fc49522f700 1 -- 172.21.15.156:0/2209452268 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c0094a0 con 0x7fc49009e870 2023-09-30T22:25:55.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.268+0000 7fc495a30700 1 --2- 172.21.15.156:0/2209452268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4901371c0 0x7fc49006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:55.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.268+0000 7fc494a2e700 1 --2- 172.21.15.156:0/2209452268 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc49009f350 0x7fc49006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:55.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.269+0000 7fc49522f700 1 --2- 172.21.15.156:0/2209452268 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc49009e870 0x7fc49006b8b0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fc48000c470 tx=0x7fc48000c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:55.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.269+0000 7fc485ffb700 1 -- 172.21.15.156:0/2209452268 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc480004c80 con 0x7fc49009e870 2023-09-30T22:25:55.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.269+0000 7fc485ffb700 1 -- 172.21.15.156:0/2209452268 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc480004de0 con 0x7fc49009e870 2023-09-30T22:25:55.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.269+0000 7fc497493700 1 -- 172.21.15.156:0/2209452268 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc488009a70 con 0x7fc49009e870 2023-09-30T22:25:55.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.269+0000 7fc485ffb700 1 -- 172.21.15.156:0/2209452268 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc480007310 con 0x7fc49009e870 2023-09-30T22:25:55.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.269+0000 7fc497493700 1 -- 172.21.15.156:0/2209452268 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc490124f10 con 0x7fc49009e870 2023-09-30T22:25:55.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.270+0000 7fc485ffb700 1 -- 172.21.15.156:0/2209452268 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc480007470 con 0x7fc49009e870 2023-09-30T22:25:55.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.270+0000 7fc485ffb700 1 -- 172.21.15.156:0/2209452268 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc48003f250 con 0x7fc49009e870 2023-09-30T22:25:55.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.270+0000 7fc497493700 1 -- 172.21.15.156:0/2209452268 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc49004f2a0 con 0x7fc49009e870 2023-09-30T22:25:55.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.276+0000 7fc485ffb700 1 -- 172.21.15.156:0/2209452268 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc480007720 con 0x7fc49009e870 2023-09-30T22:25:55.317 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:55.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.394+0000 7f4aefab8700 1 Processor -- start 2023-09-30T22:25:55.395 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.394+0000 7f4aefab8700 1 -- start start 2023-09-30T22:25:55.397 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.395+0000 7f4aefab8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4ae8133660 0x7f4ae8135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.395+0000 7f4aefab8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ae8135f80 0x7f4ae8138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.395+0000 7f4aefab8700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae8099a60 con 0x7f4ae8099e20 2023-09-30T22:25:55.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.395+0000 7f4aefab8700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ae809bf50 con 0x7f4ae8133660 2023-09-30T22:25:55.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.395+0000 7f4aefab8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae809b230 con 0x7f4ae8135f80 2023-09-30T22:25:55.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.395+0000 7f4aed053700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4ae8133660 0x7f4ae8135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.395+0000 7f4aed854700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4ae8099e20 0x7f4ae809a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38560/0 (socket says 172.21.15.156:38560) 2023-09-30T22:25:55.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.395+0000 7f4aed854700 1 -- 172.21.15.156:0/2756331755 learned_addr learned my addr 172.21.15.156:0/2756331755 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:55.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.395+0000 7f4aee055700 1 --2- 172.21.15.156:0/2756331755 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ae8135f80 0x7f4ae8138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.395+0000 7f4aee055700 1 -- 172.21.15.156:0/2756331755 >> v2:172.21.15.156:3300/0 conn(0x7f4ae8133660 msgr2=0x7f4ae8135a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:55.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.395+0000 7f4aee055700 1 --2- 172.21.15.156:0/2756331755 >> v2:172.21.15.156:3300/0 conn(0x7f4ae8133660 0x7f4ae8135a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.395+0000 7f4aec852700 1 -- 172.21.15.156:0/2756331755 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101781226 0 0) 0x7f4ae8099a60 con 0x7f4ae8099e20 2023-09-30T22:25:55.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.395+0000 7f4aee055700 1 -- 172.21.15.156:0/2756331755 >> v1:172.21.15.156:6789/0 conn(0x7f4ae8099e20 legacy=0x7f4ae809a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.395+0000 7f4aee055700 1 -- 172.21.15.156:0/2756331755 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae809bb90 con 0x7f4ae8135f80 2023-09-30T22:25:55.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.395+0000 7f4aee055700 1 --2- 172.21.15.156:0/2756331755 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ae8135f80 0x7f4ae8138360 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009d90 tx=0x7f4ae000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=219a9d23d51b3c87 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:55.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.396+0000 7f4aec852700 1 -- 172.21.15.156:0/2756331755 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae000e070 con 0x7f4ae8135f80 2023-09-30T22:25:55.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.396+0000 7f4aec852700 1 -- 172.21.15.156:0/2756331755 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae000bb20 con 0x7f4ae8135f80 2023-09-30T22:25:55.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.396+0000 7f4aec852700 1 -- 172.21.15.156:0/2756331755 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0012430 con 0x7f4ae8135f80 2023-09-30T22:25:55.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.396+0000 7f4aefab8700 1 -- 172.21.15.156:0/2756331755 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ae8135f80 msgr2=0x7f4ae8138360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.396+0000 7f4aefab8700 1 --2- 172.21.15.156:0/2756331755 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ae8135f80 0x7f4ae8138360 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009d90 tx=0x7f4ae000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:55.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.397+0000 7f4aefab8700 1 -- 172.21.15.156:0/2756331755 shutdown_connections 2023-09-30T22:25:55.399 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.397+0000 7f4aefab8700 1 --2- 172.21.15.156:0/2756331755 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ae8135f80 0x7f4ae8138360 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.397+0000 7f4aefab8700 1 --2- 172.21.15.156:0/2756331755 >> v2:172.21.15.156:3300/0 conn(0x7f4ae8133660 0x7f4ae8135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.397+0000 7f4aefab8700 1 -- 172.21.15.156:0/2756331755 >> 172.21.15.156:0/2756331755 conn(0x7f4ae80a2980 msgr2=0x7f4ae80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:55.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.397+0000 7f4aefab8700 1 -- 172.21.15.156:0/2756331755 shutdown_connections 2023-09-30T22:25:55.400 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.397+0000 7f4aefab8700 1 -- 172.21.15.156:0/2756331755 wait complete. 2023-09-30T22:25:55.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.398+0000 7f4aefab8700 1 Processor -- start 2023-09-30T22:25:55.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.398+0000 7f4aefab8700 1 -- start start 2023-09-30T22:25:55.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.399+0000 7f4aefab8700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ae8099e20 0x7f4ae8070070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.399+0000 7f4aefab8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ae8133660 0x7f4ae80705b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.399+0000 7f4aefab8700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ae8135f80 0x7f4ae8070af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.399+0000 7f4aefab8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae8071b00 con 0x7f4ae8133660 2023-09-30T22:25:55.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.399+0000 7f4aefab8700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae8119ae0 con 0x7f4ae8099e20 2023-09-30T22:25:55.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.399+0000 7f4aefab8700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae809b4e0 con 0x7f4ae8135f80 2023-09-30T22:25:55.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.399+0000 7f4aee055700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ae8135f80 0x7f4ae8070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.399+0000 7f4aed854700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ae8099e20 0x7f4ae8070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.399+0000 7f4aee055700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ae8135f80 0x7f4ae8070af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43558/0 (socket says 172.21.15.156:43558) 2023-09-30T22:25:55.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.399+0000 7f4aee055700 1 -- 172.21.15.156:0/1173300075 learned_addr learned my addr 172.21.15.156:0/1173300075 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:55.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.399+0000 7f4aed053700 1 --2- 172.21.15.156:0/1173300075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ae8133660 0x7f4ae80705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.399+0000 7f4aee055700 1 -- 172.21.15.156:0/1173300075 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ae8099e20 msgr2=0x7f4ae8070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.399+0000 7f4aee055700 1 --2- 172.21.15.156:0/1173300075 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ae8099e20 0x7f4ae8070070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.399+0000 7f4aee055700 1 -- 172.21.15.156:0/1173300075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ae8133660 msgr2=0x7f4ae80705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.399+0000 7f4aee055700 1 --2- 172.21.15.156:0/1173300075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ae8133660 0x7f4ae80705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.399+0000 7f4aee055700 1 -- 172.21.15.156:0/1173300075 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae0009a70 con 0x7f4ae8135f80 2023-09-30T22:25:55.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.399+0000 7f4aee055700 1 --2- 172.21.15.156:0/1173300075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ae8135f80 0x7f4ae8070af0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f4ae809b370 tx=0x7f4ae0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:55.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.400+0000 7f4ade7fc700 1 -- 172.21.15.156:0/1173300075 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0012430 con 0x7f4ae8135f80 2023-09-30T22:25:55.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.400+0000 7f4ade7fc700 1 -- 172.21.15.156:0/1173300075 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae0020070 con 0x7f4ae8135f80 2023-09-30T22:25:55.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.400+0000 7f4ade7fc700 1 -- 172.21.15.156:0/1173300075 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0004280 con 0x7f4ae8135f80 2023-09-30T22:25:55.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.400+0000 7f4aefab8700 1 -- 172.21.15.156:0/1173300075 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae80714d0 con 0x7f4ae8135f80 2023-09-30T22:25:55.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.400+0000 7f4aefab8700 1 -- 172.21.15.156:0/1173300075 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae811a4c0 con 0x7f4ae8135f80 2023-09-30T22:25:55.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.401+0000 7f4aefab8700 1 -- 172.21.15.156:0/1173300075 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae8072480 con 0x7f4ae8135f80 2023-09-30T22:25:55.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.403+0000 7f4ade7fc700 1 -- 172.21.15.156:0/1173300075 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4ae00043e0 con 0x7f4ae8135f80 2023-09-30T22:25:55.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.403+0000 7f4ade7fc700 1 -- 172.21.15.156:0/1173300075 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4ae0022070 con 0x7f4ae8135f80 2023-09-30T22:25:55.404 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.403+0000 7f907ce86700 1 Processor -- start 2023-09-30T22:25:55.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.404+0000 7f907ce86700 1 -- start start 2023-09-30T22:25:55.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.404+0000 7f907ce86700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90780a0a70 0x7f90780a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.404+0000 7f907ce86700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9078134120 0x7f907813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.404+0000 7f907ce86700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f907809dc00 con 0x7f90780a1380 2023-09-30T22:25:55.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.404+0000 7f907ce86700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907809ea90 con 0x7f90780a0a70 2023-09-30T22:25:55.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.404+0000 7f907ce86700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f907809dec0 con 0x7f9078134120 2023-09-30T22:25:55.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.404+0000 7f906ffff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f90780a1380 0x7f9078133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38568/0 (socket says 172.21.15.156:38568) 2023-09-30T22:25:55.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.404+0000 7f906ffff700 1 -- 172.21.15.156:0/2705783610 learned_addr learned my addr 172.21.15.156:0/2705783610 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:55.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.404+0000 7f9075d9b700 1 -- 172.21.15.156:0/2705783610 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028354717 0 0) 0x7f907809dc00 con 0x7f90780a1380 2023-09-30T22:25:55.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.404+0000 7f9075d9b700 1 -- 172.21.15.156:0/2705783610 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90640035b0 con 0x7f90780a1380 2023-09-30T22:25:55.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.405+0000 7f9076d9d700 1 --2- 172.21.15.156:0/2705783610 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9078134120 0x7f907813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.405+0000 7f9075d9b700 1 -- 172.21.15.156:0/2705783610 <== mon.0 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2830418293 0 0) 0x7f90640035b0 con 0x7f90780a1380 2023-09-30T22:25:55.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.405+0000 7f9075d9b700 1 -- 172.21.15.156:0/2705783610 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9078134120 msgr2=0x7f907813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:55.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.405+0000 7f9075d9b700 1 --2- 172.21.15.156:0/2705783610 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9078134120 0x7f907813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.405+0000 7f9075d9b700 1 -- 172.21.15.156:0/2705783610 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90780a0a70 msgr2=0x7f90780a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:55.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.405+0000 7f9075d9b700 1 --2- 172.21.15.156:0/2705783610 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f90780a0a70 0x7f90780a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.405+0000 7f9075d9b700 1 -- 172.21.15.156:0/2705783610 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f907809e6a0 con 0x7f90780a1380 2023-09-30T22:25:55.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.405+0000 7f9075d9b700 1 -- 172.21.15.156:0/2705783610 <== mon.0 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2864602571 0 0) 0x7f9060001670 con 0x7f90780a1380 2023-09-30T22:25:55.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.405+0000 7f9075d9b700 1 -- 172.21.15.156:0/2705783610 >> v1:172.21.15.156:6789/0 conn(0x7f90780a1380 legacy=0x7f9078133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.405+0000 7f9075d9b700 1 --2- 172.21.15.156:0/2705783610 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9064003a70 0x7f9064003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.405+0000 7f9075d9b700 1 --2- 172.21.15.156:0/2705783610 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9064004400 0x7f90640048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.405+0000 7f9075d9b700 1 --2- 172.21.15.156:0/2705783610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90640050d0 0x7f9064014220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.405+0000 7f9075d9b700 1 -- 172.21.15.156:0/2705783610 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907809ea90 con 0x7f90640050d0 2023-09-30T22:25:55.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.405+0000 7f9075d9b700 1 -- 172.21.15.156:0/2705783610 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907809dec0 con 0x7f9064004400 2023-09-30T22:25:55.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.405+0000 7f9075d9b700 1 -- 172.21.15.156:0/2705783610 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90640059e0 con 0x7f9064003a70 2023-09-30T22:25:55.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.405+0000 7f906ffff700 1 --2- 172.21.15.156:0/2705783610 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9064004400 0x7f90640048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.405+0000 7f9076d9d700 1 --2- 172.21.15.156:0/2705783610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90640050d0 0x7f9064014220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.405+0000 7f906ffff700 1 -- 172.21.15.156:0/2705783610 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9064003a70 msgr2=0x7f9064003e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:25:55.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.405+0000 7f906ffff700 1 --2- 172.21.15.156:0/2705783610 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9064003a70 0x7f9064003e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.405+0000 7f906ffff700 1 -- 172.21.15.156:0/2705783610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90640050d0 msgr2=0x7f9064014220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:55.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.405+0000 7f906ffff700 1 --2- 172.21.15.156:0/2705783610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90640050d0 0x7f9064014220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.405+0000 7f906ffff700 1 -- 172.21.15.156:0/2705783610 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90640035b0 con 0x7f9064004400 2023-09-30T22:25:55.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.406+0000 7f906ffff700 1 --2- 172.21.15.156:0/2705783610 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9064004400 0x7f90640048d0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f906000c2f0 tx=0x7f9064005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e677eedafde8dad8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:55.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.406+0000 7f9075d9b700 1 -- 172.21.15.156:0/2705783610 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906000ce30 con 0x7f9064004400 2023-09-30T22:25:55.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.406+0000 7f9075d9b700 1 -- 172.21.15.156:0/2705783610 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9060005960 con 0x7f9064004400 2023-09-30T22:25:55.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.406+0000 7f9075d9b700 1 -- 172.21.15.156:0/2705783610 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9060005d10 con 0x7f9064004400 2023-09-30T22:25:55.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.406+0000 7f907ce86700 1 -- 172.21.15.156:0/2705783610 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9064004400 msgr2=0x7f90640048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.406+0000 7f907ce86700 1 --2- 172.21.15.156:0/2705783610 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9064004400 0x7f90640048d0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f906000c2f0 tx=0x7f9064005880 comp rx=0 tx=0).stop 2023-09-30T22:25:55.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.406+0000 7f907ce86700 1 -- 172.21.15.156:0/2705783610 shutdown_connections 2023-09-30T22:25:55.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.406+0000 7f907ce86700 1 --2- 172.21.15.156:0/2705783610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90640050d0 0x7f9064014220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.406+0000 7f907ce86700 1 --2- 172.21.15.156:0/2705783610 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9064004400 0x7f90640048d0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.406+0000 7f907ce86700 1 --2- 172.21.15.156:0/2705783610 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9064003a70 0x7f9064003e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.406+0000 7f907ce86700 1 -- 172.21.15.156:0/2705783610 >> 172.21.15.156:0/2705783610 conn(0x7f90780a6610 msgr2=0x7f90780a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:55.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.406+0000 7f907ce86700 1 -- 172.21.15.156:0/2705783610 shutdown_connections 2023-09-30T22:25:55.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.407+0000 7f907ce86700 1 -- 172.21.15.156:0/2705783610 wait complete. 2023-09-30T22:25:55.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.407+0000 7f4ade7fc700 1 -- 172.21.15.156:0/1173300075 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ae0011980 con 0x7f4ae8135f80 2023-09-30T22:25:55.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.408+0000 7f907ce86700 1 Processor -- start 2023-09-30T22:25:55.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.410+0000 7f907ce86700 1 -- start start 2023-09-30T22:25:55.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.410+0000 7f907ce86700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9064003a70 0x7f907811e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.410+0000 7f907ce86700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9064004400 0x7f907811e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.410+0000 7f907ce86700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90640050d0 0x7f907811eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.410+0000 7f907ce86700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9078120670 con 0x7f90640050d0 2023-09-30T22:25:55.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.410+0000 7f907ce86700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90780a0450 con 0x7f9064004400 2023-09-30T22:25:55.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.410+0000 7f907ce86700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f907809c960 con 0x7f9064003a70 2023-09-30T22:25:55.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.410+0000 7f906ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9064004400 0x7f907811e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.410+0000 7f906ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9064004400 0x7f907811e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54358/0 (socket says 172.21.15.156:54358) 2023-09-30T22:25:55.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.410+0000 7f906ffff700 1 -- 172.21.15.156:0/2437077995 learned_addr learned my addr 172.21.15.156:0/2437077995 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:55.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.410+0000 7f907659c700 1 --2- 172.21.15.156:0/2437077995 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9064003a70 0x7f907811e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.410+0000 7f9076d9d700 1 --2- 172.21.15.156:0/2437077995 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90640050d0 0x7f907811eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.410+0000 7f906ffff700 1 -- 172.21.15.156:0/2437077995 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9064003a70 msgr2=0x7f907811e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.410+0000 7f906ffff700 1 --2- 172.21.15.156:0/2437077995 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9064003a70 0x7f907811e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.410+0000 7f906ffff700 1 -- 172.21.15.156:0/2437077995 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90640050d0 msgr2=0x7f907811eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.410+0000 7f906ffff700 1 --2- 172.21.15.156:0/2437077995 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90640050d0 0x7f907811eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.413 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.411+0000 7f906ffff700 1 -- 172.21.15.156:0/2437077995 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90781219c0 con 0x7f9064004400 2023-09-30T22:25:55.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.411+0000 7f906ffff700 1 --2- 172.21.15.156:0/2437077995 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9064004400 0x7f907811e980 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f9060000c00 tx=0x7f9060001a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:55.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.411+0000 7f906effd700 1 -- 172.21.15.156:0/2437077995 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9060004870 con 0x7f9064004400 2023-09-30T22:25:55.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.411+0000 7f906effd700 1 -- 172.21.15.156:0/2437077995 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90600049d0 con 0x7f9064004400 2023-09-30T22:25:55.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.411+0000 7f906effd700 1 -- 172.21.15.156:0/2437077995 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9060004d60 con 0x7f9064004400 2023-09-30T22:25:55.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.411+0000 7f907ce86700 1 -- 172.21.15.156:0/2437077995 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90781216f0 con 0x7f9064004400 2023-09-30T22:25:55.414 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.412+0000 7f907ce86700 1 -- 172.21.15.156:0/2437077995 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90781226f0 con 0x7f9064004400 2023-09-30T22:25:55.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.412+0000 7f906effd700 1 -- 172.21.15.156:0/2437077995 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9060007070 con 0x7f9064004400 2023-09-30T22:25:55.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.413+0000 7f906effd700 1 -- 172.21.15.156:0/2437077995 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9060040770 con 0x7f9064004400 2023-09-30T22:25:55.415 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.412+0000 7f907ce86700 1 -- 172.21.15.156:0/2437077995 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f907804f2a0 con 0x7f9064004400 2023-09-30T22:25:55.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.417+0000 7f906effd700 1 -- 172.21.15.156:0/2437077995 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9060017070 con 0x7f9064004400 2023-09-30T22:25:55.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.469+0000 7f51aa7ac700 1 Processor -- start 2023-09-30T22:25:55.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.469+0000 7f51aa7ac700 1 -- start start 2023-09-30T22:25:55.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.470+0000 7f51aa7ac700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a409d860 0x7f51a409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.470+0000 7f51aa7ac700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f51a409e170 0x7f51a41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.470+0000 7f51aa7ac700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51a409aaa0 con 0x7f51a4130ce0 2023-09-30T22:25:55.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.470+0000 7f51aa7ac700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a409f870 con 0x7f51a409e170 2023-09-30T22:25:55.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.470+0000 7f51aa7ac700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a409b360 con 0x7f51a409d860 2023-09-30T22:25:55.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.470+0000 7f51a37fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f51a409e170 0x7f51a41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.470+0000 7f51a8d49700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f51a4130ce0 0x7f51a41379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38574/0 (socket says 172.21.15.156:38574) 2023-09-30T22:25:55.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.470+0000 7f51a8d49700 1 -- 172.21.15.156:0/3709074044 learned_addr learned my addr 172.21.15.156:0/3709074044 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:55.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.470+0000 7f51a3fff700 1 --2- 172.21.15.156:0/3709074044 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a409d860 0x7f51a409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.470+0000 7f51a2ffd700 1 -- 172.21.15.156:0/3709074044 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4065556456 0 0) 0x7f51a409aaa0 con 0x7f51a4130ce0 2023-09-30T22:25:55.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.470+0000 7f51a2ffd700 1 -- 172.21.15.156:0/3709074044 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f518c0035b0 con 0x7f51a4130ce0 2023-09-30T22:25:55.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.470+0000 7f51a37fe700 1 -- 172.21.15.156:0/3709074044 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a409d860 msgr2=0x7f51a409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:55.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.471+0000 7f51a37fe700 1 --2- 172.21.15.156:0/3709074044 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a409d860 0x7f51a409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.471+0000 7f51a37fe700 1 -- 172.21.15.156:0/3709074044 >> v1:172.21.15.156:6789/0 conn(0x7f51a4130ce0 legacy=0x7f51a41379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.471+0000 7f51a37fe700 1 -- 172.21.15.156:0/3709074044 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a409b620 con 0x7f51a409e170 2023-09-30T22:25:55.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.471+0000 7f51a37fe700 1 --2- 172.21.15.156:0/3709074044 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51a409e170 0x7f51a41307a0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f519800bae0 tx=0x7f519800bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c219d19f51c6815 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:55.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.471+0000 7f51a2ffd700 1 -- 172.21.15.156:0/3709074044 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519800dc70 con 0x7f51a409e170 2023-09-30T22:25:55.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.471+0000 7f51a2ffd700 1 -- 172.21.15.156:0/3709074044 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519800ddd0 con 0x7f51a409e170 2023-09-30T22:25:55.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.471+0000 7f51a2ffd700 1 -- 172.21.15.156:0/3709074044 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5198010670 con 0x7f51a409e170 2023-09-30T22:25:55.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.472+0000 7f51aa7ac700 1 -- 172.21.15.156:0/3709074044 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51a409e170 msgr2=0x7f51a41307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.472+0000 7f51aa7ac700 1 --2- 172.21.15.156:0/3709074044 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51a409e170 0x7f51a41307a0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f519800bae0 tx=0x7f519800bdf0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.472+0000 7f51aa7ac700 1 -- 172.21.15.156:0/3709074044 shutdown_connections 2023-09-30T22:25:55.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.472+0000 7f51aa7ac700 1 --2- 172.21.15.156:0/3709074044 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a409d860 0x7f51a409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.472+0000 7f51aa7ac700 1 --2- 172.21.15.156:0/3709074044 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51a409e170 0x7f51a41307a0 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.472+0000 7f51aa7ac700 1 -- 172.21.15.156:0/3709074044 >> 172.21.15.156:0/3709074044 conn(0x7f51a4099c40 msgr2=0x7f51a40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:55.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.472+0000 7f51aa7ac700 1 -- 172.21.15.156:0/3709074044 shutdown_connections 2023-09-30T22:25:55.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.472+0000 7f51aa7ac700 1 -- 172.21.15.156:0/3709074044 wait complete. 2023-09-30T22:25:55.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.473+0000 7f51aa7ac700 1 Processor -- start 2023-09-30T22:25:55.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.473+0000 7f51aa7ac700 1 -- start start 2023-09-30T22:25:55.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.474+0000 7f51aa7ac700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a409d860 0x7f51a41231a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.474+0000 7f51aa7ac700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51a409e170 0x7f51a41236e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.474+0000 7f51aa7ac700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f51a4130ce0 0x7f51a41c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.474+0000 7f51aa7ac700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a4122df0 con 0x7f51a409e170 2023-09-30T22:25:55.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.474+0000 7f51aa7ac700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a4125e90 con 0x7f51a409d860 2023-09-30T22:25:55.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.474+0000 7f51aa7ac700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51a4126530 con 0x7f51a4130ce0 2023-09-30T22:25:55.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.474+0000 7f51a3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a409d860 0x7f51a41231a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.474+0000 7f51a3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a409d860 0x7f51a41231a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54372/0 (socket says 172.21.15.156:54372) 2023-09-30T22:25:55.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.474+0000 7f51a3fff700 1 -- 172.21.15.156:0/1562884959 learned_addr learned my addr 172.21.15.156:0/1562884959 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:55.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.474+0000 7f51a37fe700 1 --2- 172.21.15.156:0/1562884959 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51a409e170 0x7f51a41236e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.475+0000 7f51a8d49700 1 --2- 172.21.15.156:0/1562884959 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f51a4130ce0 0x7f51a41c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.475+0000 7f51a3fff700 1 -- 172.21.15.156:0/1562884959 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f51a4130ce0 msgr2=0x7f51a41c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.475+0000 7f51a3fff700 1 --2- 172.21.15.156:0/1562884959 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f51a4130ce0 0x7f51a41c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.475+0000 7f51a3fff700 1 -- 172.21.15.156:0/1562884959 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51a409e170 msgr2=0x7f51a41236e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.475+0000 7f51a3fff700 1 --2- 172.21.15.156:0/1562884959 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51a409e170 0x7f51a41236e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.475+0000 7f51a3fff700 1 -- 172.21.15.156:0/1562884959 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519800b740 con 0x7f51a409d860 2023-09-30T22:25:55.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.475+0000 7f51a37fe700 1 --2- 172.21.15.156:0/1562884959 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51a409e170 0x7f51a41236e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:55.478 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.475+0000 7f51a3fff700 1 --2- 172.21.15.156:0/1562884959 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a409d860 0x7f51a41231a0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f519400ea10 tx=0x7f519400ed20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:55.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.475+0000 7f51a0ff9700 1 -- 172.21.15.156:0/1562884959 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519400eeb0 con 0x7f51a409d860 2023-09-30T22:25:55.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.475+0000 7f51a0ff9700 1 -- 172.21.15.156:0/1562884959 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519400c850 con 0x7f51a409d860 2023-09-30T22:25:55.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.475+0000 7f51aa7ac700 1 -- 172.21.15.156:0/1562884959 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a40a26d0 con 0x7f51a409d860 2023-09-30T22:25:55.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.476+0000 7f51aa7ac700 1 -- 172.21.15.156:0/1562884959 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a4125190 con 0x7f51a409d860 2023-09-30T22:25:55.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.476+0000 7f51a0ff9700 1 -- 172.21.15.156:0/1562884959 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519400cbc0 con 0x7f51a409d860 2023-09-30T22:25:55.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.477+0000 7f51a0ff9700 1 -- 172.21.15.156:0/1562884959 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f519400cd20 con 0x7f51a409d860 2023-09-30T22:25:55.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.477+0000 7f51aa7ac700 1 -- 172.21.15.156:0/1562884959 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51840052e0 con 0x7f51a409d860 2023-09-30T22:25:55.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.477+0000 7f51a0ff9700 1 -- 172.21.15.156:0/1562884959 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5194013990 con 0x7f51a409d860 2023-09-30T22:25:55.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.481+0000 7fc497493700 1 -- 172.21.15.156:0/2209452268 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc4901264f0 con 0x7fc49009e870 2023-09-30T22:25:55.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.484+0000 7fc485ffb700 1 -- 172.21.15.156:0/2209452268 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc480011e80 con 0x7fc49009e870 2023-09-30T22:25:55.484 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:55.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.484+0000 7f51a0ff9700 1 -- 172.21.15.156:0/1562884959 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5194044060 con 0x7f51a409d860 2023-09-30T22:25:55.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.487+0000 7fc497493700 1 -- 172.21.15.156:0/2209452268 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc49009e870 msgr2=0x7fc49006b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.487+0000 7fc497493700 1 --2- 172.21.15.156:0/2209452268 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc49009e870 0x7fc49006b8b0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fc48000c470 tx=0x7fc48000c780 comp rx=0 tx=0).stop 2023-09-30T22:25:55.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.487+0000 7fc497493700 1 -- 172.21.15.156:0/2209452268 shutdown_connections 2023-09-30T22:25:55.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.487+0000 7fc497493700 1 --2- 172.21.15.156:0/2209452268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4901371c0 0x7fc49006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.487+0000 7fc497493700 1 --2- 172.21.15.156:0/2209452268 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc49009e870 0x7fc49006b8b0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.487+0000 7fc497493700 1 --2- 172.21.15.156:0/2209452268 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc49009f350 0x7fc49006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.487+0000 7fc497493700 1 -- 172.21.15.156:0/2209452268 >> 172.21.15.156:0/2209452268 conn(0x7fc4900a4430 msgr2=0x7fc490070530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:55.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.487+0000 7fc497493700 1 -- 172.21.15.156:0/2209452268 shutdown_connections 2023-09-30T22:25:55.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.487+0000 7fc497493700 1 -- 172.21.15.156:0/2209452268 wait complete. 2023-09-30T22:25:55.505 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:55.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.614+0000 7f907ce86700 1 -- 172.21.15.156:0/2437077995 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9078072980 con 0x7f9064004400 2023-09-30T22:25:55.615 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.614+0000 7f906effd700 1 -- 172.21.15.156:0/2437077995 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9060007dc0 con 0x7f9064004400 2023-09-30T22:25:55.615 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:55.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.616+0000 7f907ce86700 1 -- 172.21.15.156:0/2437077995 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9064004400 msgr2=0x7f907811e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.616+0000 7f907ce86700 1 --2- 172.21.15.156:0/2437077995 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9064004400 0x7f907811e980 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f9060000c00 tx=0x7f9060001a00 comp rx=0 tx=0).stop 2023-09-30T22:25:55.617 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.616+0000 7f907ce86700 1 -- 172.21.15.156:0/2437077995 shutdown_connections 2023-09-30T22:25:55.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.616+0000 7f907ce86700 1 --2- 172.21.15.156:0/2437077995 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90640050d0 0x7f907811eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.616+0000 7f907ce86700 1 --2- 172.21.15.156:0/2437077995 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9064003a70 0x7f907811e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.616+0000 7f907ce86700 1 --2- 172.21.15.156:0/2437077995 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9064004400 0x7f907811e980 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.616+0000 7f907ce86700 1 -- 172.21.15.156:0/2437077995 >> 172.21.15.156:0/2437077995 conn(0x7f90780a6610 msgr2=0x7f90780a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:55.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.616+0000 7f907ce86700 1 -- 172.21.15.156:0/2437077995 shutdown_connections 2023-09-30T22:25:55.618 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.616+0000 7f907ce86700 1 -- 172.21.15.156:0/2437077995 wait complete. 2023-09-30T22:25:55.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.625+0000 7f4aefab8700 1 -- 172.21.15.156:0/1173300075 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4ae8072480 con 0x7f4ae8135f80 2023-09-30T22:25:55.626 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.625+0000 7f4ade7fc700 1 -- 172.21.15.156:0/1173300075 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ae8072480 con 0x7f4ae8135f80 2023-09-30T22:25:55.626 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:55.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.627+0000 7f4aefab8700 1 -- 172.21.15.156:0/1173300075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ae8135f80 msgr2=0x7f4ae8070af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.627+0000 7f4aefab8700 1 --2- 172.21.15.156:0/1173300075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ae8135f80 0x7f4ae8070af0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f4ae809b370 tx=0x7f4ae0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.627+0000 7f4aefab8700 1 -- 172.21.15.156:0/1173300075 shutdown_connections 2023-09-30T22:25:55.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.627+0000 7f4aefab8700 1 --2- 172.21.15.156:0/1173300075 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f4ae8135f80 0x7f4ae8070af0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.627+0000 7f4aefab8700 1 --2- 172.21.15.156:0/1173300075 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f4ae8099e20 0x7f4ae8070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.627+0000 7f4aefab8700 1 --2- 172.21.15.156:0/1173300075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ae8133660 0x7f4ae80705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.628+0000 7f4aefab8700 1 -- 172.21.15.156:0/1173300075 >> 172.21.15.156:0/1173300075 conn(0x7f4ae80a2980 msgr2=0x7f4ae81324e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:55.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.628+0000 7f4aefab8700 1 -- 172.21.15.156:0/1173300075 shutdown_connections 2023-09-30T22:25:55.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.628+0000 7f4aefab8700 1 -- 172.21.15.156:0/1173300075 wait complete. 2023-09-30T22:25:55.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:55.640 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:55.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.686+0000 7f51aa7ac700 1 -- 172.21.15.156:0/1562884959 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5184005590 con 0x7f51a409d860 2023-09-30T22:25:55.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.687+0000 7f51a0ff9700 1 -- 172.21.15.156:0/1562884959 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f519401ab50 con 0x7f51a409d860 2023-09-30T22:25:55.688 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:55.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.689+0000 7f51aa7ac700 1 -- 172.21.15.156:0/1562884959 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a409d860 msgr2=0x7f51a41231a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.689+0000 7f51aa7ac700 1 --2- 172.21.15.156:0/1562884959 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a409d860 0x7f51a41231a0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f519400ea10 tx=0x7f519400ed20 comp rx=0 tx=0).stop 2023-09-30T22:25:55.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.689+0000 7f51aa7ac700 1 -- 172.21.15.156:0/1562884959 shutdown_connections 2023-09-30T22:25:55.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.689+0000 7f51aa7ac700 1 --2- 172.21.15.156:0/1562884959 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f51a4130ce0 0x7f51a41c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.689+0000 7f51aa7ac700 1 --2- 172.21.15.156:0/1562884959 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a409d860 0x7f51a41231a0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.689+0000 7f51aa7ac700 1 --2- 172.21.15.156:0/1562884959 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51a409e170 0x7f51a41236e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.689+0000 7f51aa7ac700 1 -- 172.21.15.156:0/1562884959 >> 172.21.15.156:0/1562884959 conn(0x7f51a4099c40 msgr2=0x7f51a4070da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:55.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.689+0000 7f51aa7ac700 1 -- 172.21.15.156:0/1562884959 shutdown_connections 2023-09-30T22:25:55.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:55.689+0000 7f51aa7ac700 1 -- 172.21.15.156:0/1562884959 wait complete. 2023-09-30T22:25:55.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:56.506 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:56.632 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:56.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.639+0000 7f0de6cb4700 1 Processor -- start 2023-09-30T22:25:56.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.639+0000 7f0de6cb4700 1 -- start start 2023-09-30T22:25:56.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.640+0000 7f0de6cb4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0de009e340 0x7f0de01359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.640+0000 7f0de6cb4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0de0135f20 0x7f0de0138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.640+0000 7f0de6cb4700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de009aaa0 con 0x7f0de009d860 2023-09-30T22:25:56.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.640+0000 7f0de6cb4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de009e730 con 0x7f0de009e340 2023-09-30T22:25:56.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.640+0000 7f0de6cb4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0de009f870 con 0x7f0de0135f20 2023-09-30T22:25:56.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.640+0000 7f0de5251700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0de0135f20 0x7f0de0138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.640+0000 7f0ddffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0de009e340 0x7f0de01359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.640+0000 7f0de4a50700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f0de009d860 0x7f0de009dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38590/0 (socket says 172.21.15.156:38590) 2023-09-30T22:25:56.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.640+0000 7f0de4a50700 1 -- 172.21.15.156:0/1177760205 learned_addr learned my addr 172.21.15.156:0/1177760205 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:56.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.640+0000 7f0de5251700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0de0135f20 0x7f0de0138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43616/0 (socket says 172.21.15.156:43616) 2023-09-30T22:25:56.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.640+0000 7f0ddffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0de009e340 0x7f0de01359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54386/0 (socket says 172.21.15.156:54386) 2023-09-30T22:25:56.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.640+0000 7f0ddf7fe700 1 -- 172.21.15.156:0/1177760205 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3388278439 0 0) 0x7f0de009aaa0 con 0x7f0de009d860 2023-09-30T22:25:56.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.640+0000 7f0ddf7fe700 1 -- 172.21.15.156:0/1177760205 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dd00035b0 con 0x7f0de009d860 2023-09-30T22:25:56.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.640+0000 7f0ddffff700 1 -- 172.21.15.156:0/1177760205 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0de0135f20 msgr2=0x7f0de0138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:56.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.640+0000 7f0ddffff700 1 --2- 172.21.15.156:0/1177760205 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0de0135f20 0x7f0de0138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.640+0000 7f0ddffff700 1 -- 172.21.15.156:0/1177760205 >> v1:172.21.15.156:6789/0 conn(0x7f0de009d860 legacy=0x7f0de009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.640+0000 7f0ddffff700 1 -- 172.21.15.156:0/1177760205 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de009b360 con 0x7f0de009e340 2023-09-30T22:25:56.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.640+0000 7f0de5251700 1 --2- 172.21.15.156:0/1177760205 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0de0135f20 0x7f0de0138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:56.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.640+0000 7f0ddffff700 1 --2- 172.21.15.156:0/1177760205 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0de009e340 0x7f0de01359e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc009870 tx=0x7f0dcc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=439c3d367e7de134 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:56.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.640+0000 7f0ddf7fe700 1 -- 172.21.15.156:0/1177760205 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc011830 con 0x7f0de009e340 2023-09-30T22:25:56.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.641+0000 7f0ddf7fe700 1 -- 172.21.15.156:0/1177760205 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dcc011990 con 0x7f0de009e340 2023-09-30T22:25:56.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.641+0000 7f0ddf7fe700 1 -- 172.21.15.156:0/1177760205 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc011d20 con 0x7f0de009e340 2023-09-30T22:25:56.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.641+0000 7f0de6cb4700 1 -- 172.21.15.156:0/1177760205 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0de009e340 msgr2=0x7f0de01359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.641+0000 7f0de6cb4700 1 --2- 172.21.15.156:0/1177760205 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0de009e340 0x7f0de01359e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc009870 tx=0x7f0dcc009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:56.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.641+0000 7f0de6cb4700 1 -- 172.21.15.156:0/1177760205 shutdown_connections 2023-09-30T22:25:56.644 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.641+0000 7f0de6cb4700 1 --2- 172.21.15.156:0/1177760205 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0de0135f20 0x7f0de0138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.641+0000 7f0de6cb4700 1 --2- 172.21.15.156:0/1177760205 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0de009e340 0x7f0de01359e0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.641+0000 7f0de6cb4700 1 -- 172.21.15.156:0/1177760205 >> 172.21.15.156:0/1177760205 conn(0x7f0de0099c40 msgr2=0x7f0de00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:56.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.641+0000 7f0de6cb4700 1 -- 172.21.15.156:0/1177760205 shutdown_connections 2023-09-30T22:25:56.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.641+0000 7f0de6cb4700 1 -- 172.21.15.156:0/1177760205 wait complete. 2023-09-30T22:25:56.645 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:56.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.642+0000 7f0de6cb4700 1 Processor -- start 2023-09-30T22:25:56.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.642+0000 7f0de6cb4700 1 -- start start 2023-09-30T22:25:56.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.643+0000 7f0de6cb4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0de009d860 0x7f0de011f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.643+0000 7f0de6cb4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0de009e340 0x7f0de011fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.643+0000 7f0de6cb4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0de0135f20 0x7f0de0120200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.643+0000 7f0de6cb4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de0121c10 con 0x7f0de0135f20 2023-09-30T22:25:56.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.643+0000 7f0de6cb4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de01218f0 con 0x7f0de009e340 2023-09-30T22:25:56.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.643+0000 7f0de6cb4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0de00a2020 con 0x7f0de009d860 2023-09-30T22:25:56.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.643+0000 7f0de4a50700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0de009d860 0x7f0de011f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.643+0000 7f0de5251700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0de0135f20 0x7f0de0120200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.643+0000 7f0de4a50700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0de009d860 0x7f0de011f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43628/0 (socket says 172.21.15.156:43628) 2023-09-30T22:25:56.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.643+0000 7f0de4a50700 1 -- 172.21.15.156:0/3780283184 learned_addr learned my addr 172.21.15.156:0/3780283184 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:56.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.643+0000 7f0ddffff700 1 --2- 172.21.15.156:0/3780283184 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0de009e340 0x7f0de011fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.643+0000 7f0de4a50700 1 -- 172.21.15.156:0/3780283184 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0de009e340 msgr2=0x7f0de011fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.643+0000 7f0de4a50700 1 --2- 172.21.15.156:0/3780283184 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0de009e340 0x7f0de011fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.643+0000 7f0de4a50700 1 -- 172.21.15.156:0/3780283184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0de0135f20 msgr2=0x7f0de0120200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.643+0000 7f0de4a50700 1 --2- 172.21.15.156:0/3780283184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0de0135f20 0x7f0de0120200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.643+0000 7f0de4a50700 1 -- 172.21.15.156:0/3780283184 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd800bc80 con 0x7f0de009d860 2023-09-30T22:25:56.649 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.643+0000 7f0de5251700 1 --2- 172.21.15.156:0/3780283184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0de0135f20 0x7f0de0120200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:56.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.643+0000 7f0de4a50700 1 --2- 172.21.15.156:0/3780283184 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0de009d860 0x7f0de011f780 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4001eb0 tx=0x7f0dd400c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:56.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.644+0000 7f0ddd7fa700 1 -- 172.21.15.156:0/3780283184 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4005d70 con 0x7f0de009d860 2023-09-30T22:25:56.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.644+0000 7f0ddd7fa700 1 -- 172.21.15.156:0/3780283184 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd40070d0 con 0x7f0de009d860 2023-09-30T22:25:56.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.644+0000 7f0de6cb4700 1 -- 172.21.15.156:0/3780283184 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dcc0094a0 con 0x7f0de009d860 2023-09-30T22:25:56.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.644+0000 7f0ddd7fa700 1 -- 172.21.15.156:0/3780283184 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4007460 con 0x7f0de009d860 2023-09-30T22:25:56.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.644+0000 7f0de6cb4700 1 -- 172.21.15.156:0/3780283184 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de0122f70 con 0x7f0de009d860 2023-09-30T22:25:56.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.645+0000 7f0ddd7fa700 1 -- 172.21.15.156:0/3780283184 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0dd40075c0 con 0x7f0de009d860 2023-09-30T22:25:56.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.645+0000 7f0de6cb4700 1 -- 172.21.15.156:0/3780283184 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de004f2a0 con 0x7f0de009d860 2023-09-30T22:25:56.650 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.645+0000 7f0ddd7fa700 1 -- 172.21.15.156:0/3780283184 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0dd403ead0 con 0x7f0de009d860 2023-09-30T22:25:56.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.650+0000 7f0ddd7fa700 1 -- 172.21.15.156:0/3780283184 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0dd4017020 con 0x7f0de009d860 2023-09-30T22:25:56.702 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:56.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.762+0000 7f34ba81e700 1 Processor -- start 2023-09-30T22:25:56.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.762+0000 7f34ba81e700 1 -- start start 2023-09-30T22:25:56.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.763+0000 7f34ba81e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34b4131980 0x7f34b4131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.763+0000 7f34ba81e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f34b409bc70 0x7f34b409c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.763+0000 7f34ba81e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b40a1640 con 0x7f34b409c5c0 2023-09-30T22:25:56.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.763+0000 7f34ba81e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b406eb30 con 0x7f34b4131980 2023-09-30T22:25:56.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.763+0000 7f34ba81e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34b40a22d0 con 0x7f34b409bc70 2023-09-30T22:25:56.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.763+0000 7f34b37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f34b409bc70 0x7f34b409c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.763+0000 7f34b8dbb700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f34b409c5c0 0x7f34b4138700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38606/0 (socket says 172.21.15.156:38606) 2023-09-30T22:25:56.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.763+0000 7f34b8dbb700 1 -- 172.21.15.156:0/1817960879 learned_addr learned my addr 172.21.15.156:0/1817960879 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:56.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.763+0000 7f34b3fff700 1 --2- 172.21.15.156:0/1817960879 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34b4131980 0x7f34b4131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.763+0000 7f34b37fe700 1 -- 172.21.15.156:0/1817960879 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34b4131980 msgr2=0x7f34b4131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:56.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.763+0000 7f34b37fe700 1 --2- 172.21.15.156:0/1817960879 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34b4131980 0x7f34b4131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.763+0000 7f34b37fe700 1 -- 172.21.15.156:0/1817960879 >> v1:172.21.15.156:6789/0 conn(0x7f34b409c5c0 legacy=0x7f34b4138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.763+0000 7f34b37fe700 1 -- 172.21.15.156:0/1817960879 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b4131550 con 0x7f34b409bc70 2023-09-30T22:25:56.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.764+0000 7f34b37fe700 1 --2- 172.21.15.156:0/1817960879 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f34b409bc70 0x7f34b409c080 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f34a8009870 tx=0x7f34a8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16c19273a1e7d62 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:56.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.764+0000 7f34b2ffd700 1 -- 172.21.15.156:0/1817960879 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a8010a90 con 0x7f34b409bc70 2023-09-30T22:25:56.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.764+0000 7f34b2ffd700 1 -- 172.21.15.156:0/1817960879 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a8010bf0 con 0x7f34b409bc70 2023-09-30T22:25:56.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.764+0000 7f34b2ffd700 1 -- 172.21.15.156:0/1817960879 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a8018440 con 0x7f34b409bc70 2023-09-30T22:25:56.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.764+0000 7f34ba81e700 1 -- 172.21.15.156:0/1817960879 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f34b409bc70 msgr2=0x7f34b409c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.764+0000 7f34ba81e700 1 --2- 172.21.15.156:0/1817960879 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f34b409bc70 0x7f34b409c080 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f34a8009870 tx=0x7f34a8009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:56.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.764+0000 7f34ba81e700 1 -- 172.21.15.156:0/1817960879 shutdown_connections 2023-09-30T22:25:56.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.764+0000 7f34ba81e700 1 --2- 172.21.15.156:0/1817960879 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34b4131980 0x7f34b4131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.764+0000 7f34ba81e700 1 --2- 172.21.15.156:0/1817960879 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f34b409bc70 0x7f34b409c080 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.764+0000 7f34ba81e700 1 -- 172.21.15.156:0/1817960879 >> 172.21.15.156:0/1817960879 conn(0x7f34b40a2980 msgr2=0x7f34b40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:56.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.765+0000 7f34ba81e700 1 -- 172.21.15.156:0/1817960879 shutdown_connections 2023-09-30T22:25:56.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.765+0000 7f34ba81e700 1 -- 172.21.15.156:0/1817960879 wait complete. 2023-09-30T22:25:56.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.766+0000 7f34ba81e700 1 Processor -- start 2023-09-30T22:25:56.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.766+0000 7f34ba81e700 1 -- start start 2023-09-30T22:25:56.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.767+0000 7f34ba81e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34b409bc70 0x7f34b411b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.767+0000 7f34ba81e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f34b409c5c0 0x7f34b411be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.767+0000 7f34ba81e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34b4131980 0x7f34b411c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.767+0000 7f34ba81e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b411ce10 con 0x7f34b409bc70 2023-09-30T22:25:56.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.767+0000 7f34ba81e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b411f460 con 0x7f34b4131980 2023-09-30T22:25:56.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.767+0000 7f34ba81e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34b411db70 con 0x7f34b409c5c0 2023-09-30T22:25:56.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.767+0000 7f34b37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f34b409c5c0 0x7f34b411be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.767+0000 7f34b37fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f34b409c5c0 0x7f34b411be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43652/0 (socket says 172.21.15.156:43652) 2023-09-30T22:25:56.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.767+0000 7f34b37fe700 1 -- 172.21.15.156:0/2440156272 learned_addr learned my addr 172.21.15.156:0/2440156272 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:56.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.767+0000 7f34b8dbb700 1 --2- 172.21.15.156:0/2440156272 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34b4131980 0x7f34b411c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.767+0000 7f34b37fe700 1 -- 172.21.15.156:0/2440156272 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34b4131980 msgr2=0x7f34b411c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.767+0000 7f34b37fe700 1 --2- 172.21.15.156:0/2440156272 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34b4131980 0x7f34b411c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.767+0000 7f34b37fe700 1 -- 172.21.15.156:0/2440156272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34b409bc70 msgr2=0x7f34b411b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.771 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.767+0000 7f34b37fe700 1 --2- 172.21.15.156:0/2440156272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34b409bc70 0x7f34b411b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.767+0000 7f34b37fe700 1 -- 172.21.15.156:0/2440156272 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a80094a0 con 0x7f34b409c5c0 2023-09-30T22:25:56.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.768+0000 7f34b37fe700 1 --2- 172.21.15.156:0/2440156272 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f34b409c5c0 0x7f34b411be80 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f34a8000c00 tx=0x7f34a8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:56.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.768+0000 7f34b0ff9700 1 -- 172.21.15.156:0/2440156272 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a8003ab0 con 0x7f34b409c5c0 2023-09-30T22:25:56.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.768+0000 7f34b0ff9700 1 -- 172.21.15.156:0/2440156272 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a8003c10 con 0x7f34b409c5c0 2023-09-30T22:25:56.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.768+0000 7f34ba81e700 1 -- 172.21.15.156:0/2440156272 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b411e830 con 0x7f34b409c5c0 2023-09-30T22:25:56.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.768+0000 7f34b0ff9700 1 -- 172.21.15.156:0/2440156272 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a8018680 con 0x7f34b409c5c0 2023-09-30T22:25:56.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.768+0000 7f34ba81e700 1 -- 172.21.15.156:0/2440156272 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b411ebf0 con 0x7f34b409c5c0 2023-09-30T22:25:56.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.769+0000 7f34b0ff9700 1 -- 172.21.15.156:0/2440156272 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f34a801f070 con 0x7f34b409c5c0 2023-09-30T22:25:56.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.769+0000 7f34b0ff9700 1 -- 172.21.15.156:0/2440156272 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f34a8045170 con 0x7f34b409c5c0 2023-09-30T22:25:56.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.769+0000 7f34ba81e700 1 -- 172.21.15.156:0/2440156272 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b411ede0 con 0x7f34b409c5c0 2023-09-30T22:25:56.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.778+0000 7f34b0ff9700 1 -- 172.21.15.156:0/2440156272 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f34a801d080 con 0x7f34b409c5c0 2023-09-30T22:25:56.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.782+0000 7f0915cd7700 1 Processor -- start 2023-09-30T22:25:56.782 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.782+0000 7f0915cd7700 1 -- start start 2023-09-30T22:25:56.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.782+0000 7f0915cd7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f091009d860 0x7f091009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.782+0000 7f0915cd7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f091009e170 0x7f09101307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.782+0000 7f0915cd7700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f091009aaa0 con 0x7f0910130ce0 2023-09-30T22:25:56.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.782+0000 7f0915cd7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f091009f870 con 0x7f091009e170 2023-09-30T22:25:56.783 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.782+0000 7f0915cd7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f091009b360 con 0x7f091009d860 2023-09-30T22:25:56.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.783+0000 7f090f7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f091009d860 0x7f091009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.783+0000 7f090ffff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f0910130ce0 0x7f09101379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38616/0 (socket says 172.21.15.156:38616) 2023-09-30T22:25:56.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.783+0000 7f090effd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f091009e170 0x7f09101307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.784 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.783+0000 7f090ffff700 1 -- 172.21.15.156:0/1320904464 learned_addr learned my addr 172.21.15.156:0/1320904464 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:56.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.783+0000 7f090effd700 1 -- 172.21.15.156:0/1320904464 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f091009d860 msgr2=0x7f091009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:56.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.783+0000 7f090e7fc700 1 -- 172.21.15.156:0/1320904464 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436431906 0 0) 0x7f091009aaa0 con 0x7f0910130ce0 2023-09-30T22:25:56.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.783+0000 7f090effd700 1 --2- 172.21.15.156:0/1320904464 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f091009d860 0x7f091009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.783+0000 7f090effd700 1 -- 172.21.15.156:0/1320904464 >> v1:172.21.15.156:6789/0 conn(0x7f0910130ce0 legacy=0x7f09101379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.783+0000 7f090effd700 1 -- 172.21.15.156:0/1320904464 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091009b620 con 0x7f091009e170 2023-09-30T22:25:56.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.783+0000 7f090effd700 1 --2- 172.21.15.156:0/1320904464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f091009e170 0x7f09101307a0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f090400bb10 tx=0x7f090400be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2345863e45cb2f66 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:56.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.783+0000 7f090e7fc700 1 -- 172.21.15.156:0/1320904464 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090400dc70 con 0x7f091009e170 2023-09-30T22:25:56.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.783+0000 7f090e7fc700 1 -- 172.21.15.156:0/1320904464 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090400ddd0 con 0x7f091009e170 2023-09-30T22:25:56.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.783+0000 7f090e7fc700 1 -- 172.21.15.156:0/1320904464 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0904012990 con 0x7f091009e170 2023-09-30T22:25:56.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.784+0000 7f0915cd7700 1 -- 172.21.15.156:0/1320904464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f091009e170 msgr2=0x7f09101307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.784+0000 7f0915cd7700 1 --2- 172.21.15.156:0/1320904464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f091009e170 0x7f09101307a0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f090400bb10 tx=0x7f090400be20 comp rx=0 tx=0).stop 2023-09-30T22:25:56.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.784+0000 7f0915cd7700 1 -- 172.21.15.156:0/1320904464 shutdown_connections 2023-09-30T22:25:56.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.784+0000 7f0915cd7700 1 --2- 172.21.15.156:0/1320904464 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f091009d860 0x7f091009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.784+0000 7f0915cd7700 1 --2- 172.21.15.156:0/1320904464 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f091009e170 0x7f09101307a0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.784+0000 7f0915cd7700 1 -- 172.21.15.156:0/1320904464 >> 172.21.15.156:0/1320904464 conn(0x7f0910099c40 msgr2=0x7f09100a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:56.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.784+0000 7f0915cd7700 1 -- 172.21.15.156:0/1320904464 shutdown_connections 2023-09-30T22:25:56.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.784+0000 7f0915cd7700 1 -- 172.21.15.156:0/1320904464 wait complete. 2023-09-30T22:25:56.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.785+0000 7f0915cd7700 1 Processor -- start 2023-09-30T22:25:56.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.786+0000 7f0915cd7700 1 -- start start 2023-09-30T22:25:56.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.786+0000 7f0915cd7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f091009d860 0x7f091011e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.786+0000 7f0915cd7700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f091009e170 0x7f091011ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.786+0000 7f0915cd7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0910130ce0 0x7f091011efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.786+0000 7f0915cd7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0910120160 con 0x7f0910130ce0 2023-09-30T22:25:56.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.786+0000 7f0915cd7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0910120780 con 0x7f091009d860 2023-09-30T22:25:56.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.786+0000 7f0915cd7700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09101304b0 con 0x7f091009e170 2023-09-30T22:25:56.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.786+0000 7f090ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0910130ce0 0x7f091011efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.786+0000 7f090ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0910130ce0 0x7f091011efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50022/0 (socket says 172.21.15.156:50022) 2023-09-30T22:25:56.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.786+0000 7f090ffff700 1 -- 172.21.15.156:0/663851137 learned_addr learned my addr 172.21.15.156:0/663851137 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:56.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.786+0000 7f090effd700 1 --2- 172.21.15.156:0/663851137 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f091009e170 0x7f091011ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.786+0000 7f090f7fe700 1 --2- 172.21.15.156:0/663851137 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f091009d860 0x7f091011e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.787+0000 7f090ffff700 1 -- 172.21.15.156:0/663851137 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f091009e170 msgr2=0x7f091011ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.787+0000 7f090ffff700 1 --2- 172.21.15.156:0/663851137 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f091009e170 0x7f091011ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.787+0000 7f090ffff700 1 -- 172.21.15.156:0/663851137 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f091009d860 msgr2=0x7f091011e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.787+0000 7f090ffff700 1 --2- 172.21.15.156:0/663851137 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f091009d860 0x7f091011e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.787+0000 7f090ffff700 1 -- 172.21.15.156:0/663851137 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090400b740 con 0x7f0910130ce0 2023-09-30T22:25:56.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.787+0000 7f090effd700 1 --2- 172.21.15.156:0/663851137 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f091009e170 0x7f091011ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:56.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.787+0000 7f090f7fe700 1 --2- 172.21.15.156:0/663851137 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f091009d860 0x7f091011e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:56.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.787+0000 7f090ffff700 1 --2- 172.21.15.156:0/663851137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0910130ce0 0x7f091011efd0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f090800ccd0 tx=0x7f090800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:56.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.787+0000 7f08f7fff700 1 -- 172.21.15.156:0/663851137 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090800ab30 con 0x7f0910130ce0 2023-09-30T22:25:56.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.787+0000 7f08f7fff700 1 -- 172.21.15.156:0/663851137 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090800ac90 con 0x7f0910130ce0 2023-09-30T22:25:56.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.787+0000 7f0915cd7700 1 -- 172.21.15.156:0/663851137 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09100a1f70 con 0x7f0910130ce0 2023-09-30T22:25:56.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.787+0000 7f08f7fff700 1 -- 172.21.15.156:0/663851137 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09080070d0 con 0x7f0910130ce0 2023-09-30T22:25:56.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.787+0000 7f0915cd7700 1 -- 172.21.15.156:0/663851137 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0910121d90 con 0x7f0910130ce0 2023-09-30T22:25:56.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.788+0000 7f0915cd7700 1 -- 172.21.15.156:0/663851137 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0910121f80 con 0x7f0910130ce0 2023-09-30T22:25:56.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.789+0000 7f08f7fff700 1 -- 172.21.15.156:0/663851137 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0908007230 con 0x7f0910130ce0 2023-09-30T22:25:56.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.789+0000 7f08f7fff700 1 -- 172.21.15.156:0/663851137 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f090803f840 con 0x7f0910130ce0 2023-09-30T22:25:56.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.793+0000 7f08f7fff700 1 -- 172.21.15.156:0/663851137 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09080074e0 con 0x7f0910130ce0 2023-09-30T22:25:56.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.835+0000 7efca9179700 1 Processor -- start 2023-09-30T22:25:56.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.835+0000 7efca9179700 1 -- start start 2023-09-30T22:25:56.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.835+0000 7efca9179700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efca406a770 0x7efca41349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.835+0000 7efca9179700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7efca409e070 0x7efca413fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.835+0000 7efca9179700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca409eca0 con 0x7efca4134f00 2023-09-30T22:25:56.836 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.835+0000 7efca9179700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca409f720 con 0x7efca409e070 2023-09-30T22:25:56.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.835+0000 7efca9179700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca406b480 con 0x7efca406a770 2023-09-30T22:25:56.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.836+0000 7efca259c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7efca4134f00 0x7efca409d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38626/0 (socket says 172.21.15.156:38626) 2023-09-30T22:25:56.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.836+0000 7efca259c700 1 -- 172.21.15.156:0/273967378 learned_addr learned my addr 172.21.15.156:0/273967378 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:56.837 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.836+0000 7efca359e700 1 --2- 172.21.15.156:0/273967378 >> v2:172.21.15.156:3300/0 conn(0x7efca409e070 0x7efca413fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.836+0000 7efca1d9b700 1 -- 172.21.15.156:0/273967378 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2046497075 0 0) 0x7efca409eca0 con 0x7efca4134f00 2023-09-30T22:25:56.838 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.836+0000 7efca1d9b700 1 -- 172.21.15.156:0/273967378 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc8c0035b0 con 0x7efca4134f00 2023-09-30T22:25:56.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.836+0000 7efca2d9d700 1 --2- 172.21.15.156:0/273967378 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efca406a770 0x7efca41349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.836+0000 7efca359e700 1 -- 172.21.15.156:0/273967378 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efca406a770 msgr2=0x7efca41349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:56.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.836+0000 7efca359e700 1 --2- 172.21.15.156:0/273967378 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efca406a770 0x7efca41349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.836+0000 7efca359e700 1 -- 172.21.15.156:0/273967378 >> v1:172.21.15.156:6789/0 conn(0x7efca4134f00 legacy=0x7efca409d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.836+0000 7efca359e700 1 -- 172.21.15.156:0/273967378 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca41352d0 con 0x7efca409e070 2023-09-30T22:25:56.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.836+0000 7efca2d9d700 1 --2- 172.21.15.156:0/273967378 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efca406a770 0x7efca41349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:56.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.836+0000 7efca359e700 1 --2- 172.21.15.156:0/273967378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efca409e070 0x7efca413fcf0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009d90 tx=0x7efc9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a4afe0259e8994 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:56.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.836+0000 7efca1d9b700 1 -- 172.21.15.156:0/273967378 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c00e070 con 0x7efca409e070 2023-09-30T22:25:56.839 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.837+0000 7efca1d9b700 1 -- 172.21.15.156:0/273967378 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9c00bb20 con 0x7efca409e070 2023-09-30T22:25:56.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.837+0000 7efca1d9b700 1 -- 172.21.15.156:0/273967378 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c012430 con 0x7efca409e070 2023-09-30T22:25:56.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.837+0000 7efca9179700 1 -- 172.21.15.156:0/273967378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efca409e070 msgr2=0x7efca413fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.837+0000 7efca9179700 1 --2- 172.21.15.156:0/273967378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efca409e070 0x7efca413fcf0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009d90 tx=0x7efc9c00b330 comp rx=0 tx=0).stop 2023-09-30T22:25:56.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.837+0000 7efca9179700 1 -- 172.21.15.156:0/273967378 shutdown_connections 2023-09-30T22:25:56.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.837+0000 7efca9179700 1 --2- 172.21.15.156:0/273967378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efca409e070 0x7efca413fcf0 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.837+0000 7efca9179700 1 --2- 172.21.15.156:0/273967378 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efca406a770 0x7efca41349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.837+0000 7efca9179700 1 -- 172.21.15.156:0/273967378 >> 172.21.15.156:0/273967378 conn(0x7efca4099c40 msgr2=0x7efca40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:56.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.837+0000 7efca9179700 1 -- 172.21.15.156:0/273967378 shutdown_connections 2023-09-30T22:25:56.840 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.837+0000 7efca9179700 1 -- 172.21.15.156:0/273967378 wait complete. 2023-09-30T22:25:56.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.839+0000 7efca9179700 1 Processor -- start 2023-09-30T22:25:56.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.839+0000 7efca9179700 1 -- start start 2023-09-30T22:25:56.842 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.839+0000 7efca9179700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efca406a770 0x7efca406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.839+0000 7efca9179700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efca409e070 0x7efca406f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.839+0000 7efca9179700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efca4134f00 0x7efca406fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.839+0000 7efca9179700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca40720b0 con 0x7efca406a770 2023-09-30T22:25:56.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.839+0000 7efca9179700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca4140ec0 con 0x7efca409e070 2023-09-30T22:25:56.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.839+0000 7efca9179700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efca409f220 con 0x7efca4134f00 2023-09-30T22:25:56.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.839+0000 7efca259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efca409e070 0x7efca406f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.839+0000 7efca259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efca409e070 0x7efca406f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54452/0 (socket says 172.21.15.156:54452) 2023-09-30T22:25:56.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.839+0000 7efca259c700 1 -- 172.21.15.156:0/975557413 learned_addr learned my addr 172.21.15.156:0/975557413 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:56.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.839+0000 7efca359e700 1 --2- 172.21.15.156:0/975557413 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efca4134f00 0x7efca406fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.843 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.839+0000 7efca2d9d700 1 --2- 172.21.15.156:0/975557413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efca406a770 0x7efca406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.840+0000 7efca259c700 1 -- 172.21.15.156:0/975557413 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efca4134f00 msgr2=0x7efca406fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.840+0000 7efca259c700 1 --2- 172.21.15.156:0/975557413 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efca4134f00 0x7efca406fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.840+0000 7efca259c700 1 -- 172.21.15.156:0/975557413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efca406a770 msgr2=0x7efca406f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.840+0000 7efca259c700 1 --2- 172.21.15.156:0/975557413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efca406a770 0x7efca406f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.840+0000 7efca259c700 1 -- 172.21.15.156:0/975557413 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c009a70 con 0x7efca409e070 2023-09-30T22:25:56.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.840+0000 7efca2d9d700 1 --2- 172.21.15.156:0/975557413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efca406a770 0x7efca406f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:56.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.840+0000 7efca259c700 1 --2- 172.21.15.156:0/975557413 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efca409e070 0x7efca406f6f0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7efc98005910 tx=0x7efc9800c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:56.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.840+0000 7efc8b7fe700 1 -- 172.21.15.156:0/975557413 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc98005d70 con 0x7efca409e070 2023-09-30T22:25:56.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.840+0000 7efc8b7fe700 1 -- 172.21.15.156:0/975557413 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc980070d0 con 0x7efca409e070 2023-09-30T22:25:56.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.840+0000 7efca9179700 1 -- 172.21.15.156:0/975557413 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca4070e90 con 0x7efca409e070 2023-09-30T22:25:56.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.840+0000 7efc8b7fe700 1 -- 172.21.15.156:0/975557413 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc98007440 con 0x7efca409e070 2023-09-30T22:25:56.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.840+0000 7efca9179700 1 -- 172.21.15.156:0/975557413 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca4072420 con 0x7efca409e070 2023-09-30T22:25:56.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.841+0000 7efc8b7fe700 1 -- 172.21.15.156:0/975557413 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efc980075a0 con 0x7efca409e070 2023-09-30T22:25:56.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.841+0000 7efc8b7fe700 1 -- 172.21.15.156:0/975557413 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efc9803eb70 con 0x7efca409e070 2023-09-30T22:25:56.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.841+0000 7efca9179700 1 -- 172.21.15.156:0/975557413 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca404f2a0 con 0x7efca409e070 2023-09-30T22:25:56.846 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.846+0000 7efc8b7fe700 1 -- 172.21.15.156:0/975557413 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efc98017080 con 0x7efca409e070 2023-09-30T22:25:56.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.874+0000 7f0de6cb4700 1 -- 172.21.15.156:0/3780283184 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0de0123aa0 con 0x7f0de009d860 2023-09-30T22:25:56.875 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.874+0000 7f0ddd7fa700 1 -- 172.21.15.156:0/3780283184 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0dd400f260 con 0x7f0de009d860 2023-09-30T22:25:56.875 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:56.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.877+0000 7f0de6cb4700 1 -- 172.21.15.156:0/3780283184 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0de009d860 msgr2=0x7f0de011f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.877+0000 7f0de6cb4700 1 --2- 172.21.15.156:0/3780283184 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0de009d860 0x7f0de011f780 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4001eb0 tx=0x7f0dd400c7b0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.877+0000 7f0de6cb4700 1 -- 172.21.15.156:0/3780283184 shutdown_connections 2023-09-30T22:25:56.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.877+0000 7f0de6cb4700 1 --2- 172.21.15.156:0/3780283184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0de0135f20 0x7f0de0120200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.877+0000 7f0de6cb4700 1 --2- 172.21.15.156:0/3780283184 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f0de009d860 0x7f0de011f780 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.877+0000 7f0de6cb4700 1 --2- 172.21.15.156:0/3780283184 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0de009e340 0x7f0de011fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.877+0000 7f0de6cb4700 1 -- 172.21.15.156:0/3780283184 >> 172.21.15.156:0/3780283184 conn(0x7f0de0099c40 msgr2=0x7f0de00a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:56.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.877+0000 7f0de6cb4700 1 -- 172.21.15.156:0/3780283184 shutdown_connections 2023-09-30T22:25:56.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.877+0000 7f0de6cb4700 1 -- 172.21.15.156:0/3780283184 wait complete. 2023-09-30T22:25:56.895 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:56.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.985+0000 7f34ba81e700 1 -- 172.21.15.156:0/2440156272 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f34b411efe0 con 0x7f34b409c5c0 2023-09-30T22:25:56.986 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.985+0000 7f34b0ff9700 1 -- 172.21.15.156:0/2440156272 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f34b411efe0 con 0x7f34b409c5c0 2023-09-30T22:25:56.986 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:56.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.987+0000 7f34ba81e700 1 -- 172.21.15.156:0/2440156272 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f34b409c5c0 msgr2=0x7f34b411be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.987+0000 7f34ba81e700 1 --2- 172.21.15.156:0/2440156272 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f34b409c5c0 0x7f34b411be80 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f34a8000c00 tx=0x7f34a8004750 comp rx=0 tx=0).stop 2023-09-30T22:25:56.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.987+0000 7f34ba81e700 1 -- 172.21.15.156:0/2440156272 shutdown_connections 2023-09-30T22:25:56.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.987+0000 7f34ba81e700 1 --2- 172.21.15.156:0/2440156272 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f34b4131980 0x7f34b411c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.987+0000 7f34ba81e700 1 --2- 172.21.15.156:0/2440156272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34b409bc70 0x7f34b411b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.987+0000 7f34ba81e700 1 --2- 172.21.15.156:0/2440156272 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f34b409c5c0 0x7f34b411be80 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.987+0000 7f34ba81e700 1 -- 172.21.15.156:0/2440156272 >> 172.21.15.156:0/2440156272 conn(0x7f34b40a2980 msgr2=0x7f34b409cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:56.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.987+0000 7f34ba81e700 1 -- 172.21.15.156:0/2440156272 shutdown_connections 2023-09-30T22:25:56.989 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:56.987+0000 7f34ba81e700 1 -- 172.21.15.156:0/2440156272 wait complete. 2023-09-30T22:25:57.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:57.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:57.009+0000 7f0915cd7700 1 -- 172.21.15.156:0/663851137 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f091004f2a0 con 0x7f0910130ce0 2023-09-30T22:25:57.010 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:57.009+0000 7f08f7fff700 1 -- 172.21.15.156:0/663851137 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0908018070 con 0x7f0910130ce0 2023-09-30T22:25:57.010 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:57.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:57.011+0000 7f0915cd7700 1 -- 172.21.15.156:0/663851137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0910130ce0 msgr2=0x7f091011efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:57.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:57.011+0000 7f0915cd7700 1 --2- 172.21.15.156:0/663851137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0910130ce0 0x7f091011efd0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f090800ccd0 tx=0x7f090800a060 comp rx=0 tx=0).stop 2023-09-30T22:25:57.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:57.011+0000 7f0915cd7700 1 -- 172.21.15.156:0/663851137 shutdown_connections 2023-09-30T22:25:57.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:57.011+0000 7f0915cd7700 1 --2- 172.21.15.156:0/663851137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0910130ce0 0x7f091011efd0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:57.011+0000 7f0915cd7700 1 --2- 172.21.15.156:0/663851137 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f091009d860 0x7f091011e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:57.011+0000 7f0915cd7700 1 --2- 172.21.15.156:0/663851137 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f091009e170 0x7f091011ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:57.011+0000 7f0915cd7700 1 -- 172.21.15.156:0/663851137 >> 172.21.15.156:0/663851137 conn(0x7f0910099c40 msgr2=0x7f09100a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:57.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:57.012+0000 7f0915cd7700 1 -- 172.21.15.156:0/663851137 shutdown_connections 2023-09-30T22:25:57.013 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:57.012+0000 7f0915cd7700 1 -- 172.21.15.156:0/663851137 wait complete. 2023-09-30T22:25:57.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:57.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:57.040+0000 7efca9179700 1 -- 172.21.15.156:0/975557413 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efca4138d50 con 0x7efca409e070 2023-09-30T22:25:57.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:57.041+0000 7efc8b7fe700 1 -- 172.21.15.156:0/975557413 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efc98019d20 con 0x7efca409e070 2023-09-30T22:25:57.042 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:57.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:57.043+0000 7efca9179700 1 -- 172.21.15.156:0/975557413 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efca409e070 msgr2=0x7efca406f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:57.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:57.043+0000 7efca9179700 1 --2- 172.21.15.156:0/975557413 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efca409e070 0x7efca406f6f0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7efc98005910 tx=0x7efc9800c9e0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:57.043+0000 7efca9179700 1 -- 172.21.15.156:0/975557413 shutdown_connections 2023-09-30T22:25:57.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:57.043+0000 7efca9179700 1 --2- 172.21.15.156:0/975557413 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7efca4134f00 0x7efca406fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:57.043+0000 7efca9179700 1 --2- 172.21.15.156:0/975557413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efca406a770 0x7efca406f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:57.043+0000 7efca9179700 1 --2- 172.21.15.156:0/975557413 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7efca409e070 0x7efca406f6f0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:57.043+0000 7efca9179700 1 -- 172.21.15.156:0/975557413 >> 172.21.15.156:0/975557413 conn(0x7efca4099c40 msgr2=0x7efca4137fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:57.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:57.043+0000 7efca9179700 1 -- 172.21.15.156:0/975557413 shutdown_connections 2023-09-30T22:25:57.045 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:57.043+0000 7efca9179700 1 -- 172.21.15.156:0/975557413 wait complete. 2023-09-30T22:25:57.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:57.896 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:58.001 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:58.026 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:58.033 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.033+0000 7f98f0ad4700 1 Processor -- start 2023-09-30T22:25:58.034 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.033+0000 7f98f0ad4700 1 -- start start 2023-09-30T22:25:58.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.034+0000 7f98f0ad4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f98ec0a0a70 0x7f98ec0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:58.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.034+0000 7f98f0ad4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98ec134120 0x7f98ec13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:58.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.034+0000 7f98f0ad4700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98ec09dc00 con 0x7f98ec0a1380 2023-09-30T22:25:58.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.034+0000 7f98f0ad4700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ec09ea90 con 0x7f98ec0a0a70 2023-09-30T22:25:58.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.034+0000 7f98f0ad4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec09dec0 con 0x7f98ec134120 2023-09-30T22:25:58.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.034+0000 7f98ea59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f98ec0a0a70 0x7f98ec0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:58.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.034+0000 7f98e9d9b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f98ec0a1380 0x7f98ec133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38632/0 (socket says 172.21.15.156:38632) 2023-09-30T22:25:58.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.034+0000 7f98ea59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f98ec0a0a70 0x7f98ec0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50044/0 (socket says 172.21.15.156:50044) 2023-09-30T22:25:58.035 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.034+0000 7f98e9d9b700 1 -- 172.21.15.156:0/2553295910 learned_addr learned my addr 172.21.15.156:0/2553295910 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:58.036 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.034+0000 7f98ead9d700 1 --2- 172.21.15.156:0/2553295910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98ec134120 0x7f98ec13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:58.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.034+0000 7f98ead9d700 1 -- 172.21.15.156:0/2553295910 >> v2:172.21.15.156:3300/0 conn(0x7f98ec0a0a70 msgr2=0x7f98ec0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:58.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.034+0000 7f98ead9d700 1 --2- 172.21.15.156:0/2553295910 >> v2:172.21.15.156:3300/0 conn(0x7f98ec0a0a70 0x7f98ec0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.034+0000 7f98ead9d700 1 -- 172.21.15.156:0/2553295910 >> v1:172.21.15.156:6789/0 conn(0x7f98ec0a1380 legacy=0x7f98ec133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.034+0000 7f98e959a700 1 -- 172.21.15.156:0/2553295910 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3854747172 0 0) 0x7f98ec09dc00 con 0x7f98ec0a1380 2023-09-30T22:25:58.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.034+0000 7f98ead9d700 1 -- 172.21.15.156:0/2553295910 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ec09e6a0 con 0x7f98ec134120 2023-09-30T22:25:58.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.034+0000 7f98ead9d700 1 --2- 172.21.15.156:0/2553295910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98ec134120 0x7f98ec13bce0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f98e4009d90 tx=0x7f98e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39d42e5dcb103fca server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:58.037 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.034+0000 7f98e959a700 1 -- 172.21.15.156:0/2553295910 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e400e070 con 0x7f98ec134120 2023-09-30T22:25:58.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.035+0000 7f98e959a700 1 -- 172.21.15.156:0/2553295910 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e400bb20 con 0x7f98ec134120 2023-09-30T22:25:58.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.035+0000 7f98e959a700 1 -- 172.21.15.156:0/2553295910 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4012430 con 0x7f98ec134120 2023-09-30T22:25:58.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.035+0000 7f98f0ad4700 1 -- 172.21.15.156:0/2553295910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98ec134120 msgr2=0x7f98ec13bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.035+0000 7f98f0ad4700 1 --2- 172.21.15.156:0/2553295910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98ec134120 0x7f98ec13bce0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f98e4009d90 tx=0x7f98e400b330 comp rx=0 tx=0).stop 2023-09-30T22:25:58.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.036+0000 7f98f0ad4700 1 -- 172.21.15.156:0/2553295910 shutdown_connections 2023-09-30T22:25:58.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.036+0000 7f98f0ad4700 1 --2- 172.21.15.156:0/2553295910 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98ec134120 0x7f98ec13bce0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.036+0000 7f98f0ad4700 1 --2- 172.21.15.156:0/2553295910 >> v2:172.21.15.156:3300/0 conn(0x7f98ec0a0a70 0x7f98ec0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.036+0000 7f98f0ad4700 1 -- 172.21.15.156:0/2553295910 >> 172.21.15.156:0/2553295910 conn(0x7f98ec0a6610 msgr2=0x7f98ec0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:58.038 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.036+0000 7f98f0ad4700 1 -- 172.21.15.156:0/2553295910 shutdown_connections 2023-09-30T22:25:58.039 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.036+0000 7f98f0ad4700 1 -- 172.21.15.156:0/2553295910 wait complete. 2023-09-30T22:25:58.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.037+0000 7f98f0ad4700 1 Processor -- start 2023-09-30T22:25:58.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.037+0000 7f98f0ad4700 1 -- start start 2023-09-30T22:25:58.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.037+0000 7f98f0ad4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98ec0a0a70 0x7f98ec122880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:58.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.037+0000 7f98f0ad4700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98ec0a1380 0x7f98ec122dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:58.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.037+0000 7f98f0ad4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98ec134120 0x7f98ec123300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:58.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.037+0000 7f98f0ad4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec1260c0 con 0x7f98ec0a0a70 2023-09-30T22:25:58.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.037+0000 7f98f0ad4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec1245a0 con 0x7f98ec134120 2023-09-30T22:25:58.041 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.037+0000 7f98f0ad4700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec0a5640 con 0x7f98ec0a1380 2023-09-30T22:25:58.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.037+0000 7f98e9d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98ec0a1380 0x7f98ec122dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:58.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.037+0000 7f98ea59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98ec0a0a70 0x7f98ec122880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:58.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.038+0000 7f98e9d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98ec0a1380 0x7f98ec122dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43704/0 (socket says 172.21.15.156:43704) 2023-09-30T22:25:58.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.038+0000 7f98e9d9b700 1 -- 172.21.15.156:0/3300940060 learned_addr learned my addr 172.21.15.156:0/3300940060 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:58.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.038+0000 7f98ea59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98ec0a0a70 0x7f98ec122880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50060/0 (socket says 172.21.15.156:50060) 2023-09-30T22:25:58.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.038+0000 7f98ead9d700 1 --2- 172.21.15.156:0/3300940060 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98ec134120 0x7f98ec123300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:58.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.038+0000 7f98e9d9b700 1 -- 172.21.15.156:0/3300940060 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98ec134120 msgr2=0x7f98ec123300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.038+0000 7f98e9d9b700 1 --2- 172.21.15.156:0/3300940060 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98ec134120 0x7f98ec123300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.038+0000 7f98e9d9b700 1 -- 172.21.15.156:0/3300940060 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98ec0a0a70 msgr2=0x7f98ec122880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.038+0000 7f98e9d9b700 1 --2- 172.21.15.156:0/3300940060 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98ec0a0a70 0x7f98ec122880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.042 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.038+0000 7f98e9d9b700 1 -- 172.21.15.156:0/3300940060 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e4009a70 con 0x7f98ec0a1380 2023-09-30T22:25:58.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.038+0000 7f98e9d9b700 1 --2- 172.21.15.156:0/3300940060 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98ec0a1380 0x7f98ec122dc0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f98e000c550 tx=0x7f98e000c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:58.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.038+0000 7f98daffd700 1 -- 172.21.15.156:0/3300940060 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e0004c80 con 0x7f98ec0a1380 2023-09-30T22:25:58.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.038+0000 7f98daffd700 1 -- 172.21.15.156:0/3300940060 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e0004de0 con 0x7f98ec0a1380 2023-09-30T22:25:58.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.038+0000 7f98f0ad4700 1 -- 172.21.15.156:0/3300940060 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98ec0a03e0 con 0x7f98ec0a1380 2023-09-30T22:25:58.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.038+0000 7f98daffd700 1 -- 172.21.15.156:0/3300940060 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e0007310 con 0x7f98ec0a1380 2023-09-30T22:25:58.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.039+0000 7f98f0ad4700 1 -- 172.21.15.156:0/3300940060 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ec126b30 con 0x7f98ec0a1380 2023-09-30T22:25:58.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.039+0000 7f98daffd700 1 -- 172.21.15.156:0/3300940060 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f98e0007470 con 0x7f98ec0a1380 2023-09-30T22:25:58.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.040+0000 7f98daffd700 1 -- 172.21.15.156:0/3300940060 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f98e0013890 con 0x7f98ec0a1380 2023-09-30T22:25:58.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.040+0000 7f98f0ad4700 1 -- 172.21.15.156:0/3300940060 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98ec126200 con 0x7f98ec0a1380 2023-09-30T22:25:58.049 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.049+0000 7f98daffd700 1 -- 172.21.15.156:0/3300940060 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f98ec126200 con 0x7f98ec0a1380 2023-09-30T22:25:58.057 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:58.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.137+0000 7f7a96724700 1 Processor -- start 2023-09-30T22:25:58.138 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.137+0000 7f7a96724700 1 -- start start 2023-09-30T22:25:58.139 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.138+0000 7f7a96724700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a90133660 0x7f7a90135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:58.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.138+0000 7f7a96724700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a90135f80 0x7f7a90138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:58.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.138+0000 7f7a96724700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a90099a60 con 0x7f7a90099e20 2023-09-30T22:25:58.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.138+0000 7f7a96724700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9009bf50 con 0x7f7a90133660 2023-09-30T22:25:58.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.138+0000 7f7a96724700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9009b230 con 0x7f7a90135f80 2023-09-30T22:25:58.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.138+0000 7f7a94cc1700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a90135f80 0x7f7a90138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:58.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.138+0000 7f7a8ffff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f7a90099e20 0x7f7a9009a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38644/0 (socket says 172.21.15.156:38644) 2023-09-30T22:25:58.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.138+0000 7f7a8ffff700 1 -- 172.21.15.156:0/4164530673 learned_addr learned my addr 172.21.15.156:0/4164530673 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:58.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.138+0000 7f7a8f7fe700 1 --2- 172.21.15.156:0/4164530673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a90133660 0x7f7a90135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:58.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.138+0000 7f7a94cc1700 1 -- 172.21.15.156:0/4164530673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a90133660 msgr2=0x7f7a90135a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:58.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.138+0000 7f7a94cc1700 1 --2- 172.21.15.156:0/4164530673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a90133660 0x7f7a90135a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.138+0000 7f7a94cc1700 1 -- 172.21.15.156:0/4164530673 >> v1:172.21.15.156:6789/0 conn(0x7f7a90099e20 legacy=0x7f7a9009a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.138+0000 7f7a94cc1700 1 -- 172.21.15.156:0/4164530673 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a9009bb90 con 0x7f7a90135f80 2023-09-30T22:25:58.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.139+0000 7f7a94cc1700 1 --2- 172.21.15.156:0/4164530673 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a90135f80 0x7f7a90138360 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800bfd0 tx=0x7f7a8800d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3883d1d9caa885f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:58.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.139+0000 7f7a8effd700 1 -- 172.21.15.156:0/4164530673 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a88010070 con 0x7f7a90135f80 2023-09-30T22:25:58.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.139+0000 7f7a8effd700 1 -- 172.21.15.156:0/4164530673 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8800b2e0 con 0x7f7a90135f80 2023-09-30T22:25:58.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.139+0000 7f7a8effd700 1 -- 172.21.15.156:0/4164530673 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8800dc70 con 0x7f7a90135f80 2023-09-30T22:25:58.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.139+0000 7f7a96724700 1 -- 172.21.15.156:0/4164530673 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a90135f80 msgr2=0x7f7a90138360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.139+0000 7f7a96724700 1 --2- 172.21.15.156:0/4164530673 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a90135f80 0x7f7a90138360 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800bfd0 tx=0x7f7a8800d330 comp rx=0 tx=0).stop 2023-09-30T22:25:58.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.140+0000 7f7a96724700 1 -- 172.21.15.156:0/4164530673 shutdown_connections 2023-09-30T22:25:58.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.140+0000 7f7a96724700 1 --2- 172.21.15.156:0/4164530673 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a90135f80 0x7f7a90138360 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.140+0000 7f7a96724700 1 --2- 172.21.15.156:0/4164530673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a90133660 0x7f7a90135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.140+0000 7f7a96724700 1 -- 172.21.15.156:0/4164530673 >> 172.21.15.156:0/4164530673 conn(0x7f7a900a2980 msgr2=0x7f7a900a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:58.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.140+0000 7f7a96724700 1 -- 172.21.15.156:0/4164530673 shutdown_connections 2023-09-30T22:25:58.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.140+0000 7f7a96724700 1 -- 172.21.15.156:0/4164530673 wait complete. 2023-09-30T22:25:58.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.141+0000 7f7a96724700 1 Processor -- start 2023-09-30T22:25:58.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.141+0000 7f7a96724700 1 -- start start 2023-09-30T22:25:58.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.142+0000 7f7a96724700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a90099e20 0x7f7a9012cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:58.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.142+0000 7f7a96724700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a90133660 0x7f7a9012d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:58.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.142+0000 7f7a96724700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a90135f80 0x7f7a9006fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:58.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.142+0000 7f7a96724700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a90071a70 con 0x7f7a90099e20 2023-09-30T22:25:58.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.142+0000 7f7a96724700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a90133a30 con 0x7f7a90133660 2023-09-30T22:25:58.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.142+0000 7f7a96724700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9009b470 con 0x7f7a90135f80 2023-09-30T22:25:58.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.142+0000 7f7a8ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a90099e20 0x7f7a9012cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:58.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.142+0000 7f7a8ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a90099e20 0x7f7a9012cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50074/0 (socket says 172.21.15.156:50074) 2023-09-30T22:25:58.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.142+0000 7f7a8ffff700 1 -- 172.21.15.156:0/1399311128 learned_addr learned my addr 172.21.15.156:0/1399311128 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:58.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.142+0000 7f7a8f7fe700 1 --2- 172.21.15.156:0/1399311128 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a90133660 0x7f7a9012d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:58.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.142+0000 7f7a8ffff700 1 -- 172.21.15.156:0/1399311128 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a90135f80 msgr2=0x7f7a9006fe60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:58.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.142+0000 7f7a8ffff700 1 --2- 172.21.15.156:0/1399311128 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a90135f80 0x7f7a9006fe60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.142+0000 7f7a8ffff700 1 -- 172.21.15.156:0/1399311128 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a90133660 msgr2=0x7f7a9012d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.142+0000 7f7a8ffff700 1 --2- 172.21.15.156:0/1399311128 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a90133660 0x7f7a9012d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.142+0000 7f7a8ffff700 1 -- 172.21.15.156:0/1399311128 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8800bc80 con 0x7f7a90099e20 2023-09-30T22:25:58.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.143+0000 7f7a8ffff700 1 --2- 172.21.15.156:0/1399311128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a90099e20 0x7f7a9012cde0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f7a8000c700 tx=0x7f7a8000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:58.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.143+0000 7f7a8cff9700 1 -- 172.21.15.156:0/1399311128 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a800074e0 con 0x7f7a90099e20 2023-09-30T22:25:58.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.143+0000 7f7a8cff9700 1 -- 172.21.15.156:0/1399311128 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a80007640 con 0x7f7a90099e20 2023-09-30T22:25:58.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.143+0000 7f7a96724700 1 -- 172.21.15.156:0/1399311128 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a9011e580 con 0x7f7a90099e20 2023-09-30T22:25:58.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.143+0000 7f7a8cff9700 1 -- 172.21.15.156:0/1399311128 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a80005a30 con 0x7f7a90099e20 2023-09-30T22:25:58.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.143+0000 7f7a96724700 1 -- 172.21.15.156:0/1399311128 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a9011f2b0 con 0x7f7a90099e20 2023-09-30T22:25:58.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.144+0000 7f7a8cff9700 1 -- 172.21.15.156:0/1399311128 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7a80005b90 con 0x7f7a90099e20 2023-09-30T22:25:58.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.144+0000 7f7a8cff9700 1 -- 172.21.15.156:0/1399311128 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7a8003eb10 con 0x7f7a90099e20 2023-09-30T22:25:58.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.144+0000 7f7a96724700 1 -- 172.21.15.156:0/1399311128 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a90072480 con 0x7f7a90099e20 2023-09-30T22:25:58.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.149+0000 7f7a8cff9700 1 -- 172.21.15.156:0/1399311128 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7a90072480 con 0x7f7a90099e20 2023-09-30T22:25:58.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.167+0000 7fe622d4d700 1 Processor -- start 2023-09-30T22:25:58.167 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.167+0000 7fe622d4d700 1 -- start start 2023-09-30T22:25:58.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.167+0000 7fe622d4d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe61c0a1510 0x7fe61c1351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:58.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.167+0000 7fe622d4d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe61c1356e0 0x7fe61c137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:58.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.167+0000 7fe622d4d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe61c0a1e70 con 0x7fe61c0a0a30 2023-09-30T22:25:58.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.167+0000 7fe622d4d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c09a720 con 0x7fe61c0a1510 2023-09-30T22:25:58.168 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.167+0000 7fe622d4d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c09b300 con 0x7fe61c1356e0 2023-09-30T22:25:58.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.168+0000 7fe6212ea700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe61c1356e0 0x7fe61c137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:58.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.168+0000 7fe61bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe61c0a1510 0x7fe61c1351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:58.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.168+0000 7fe6212ea700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe61c1356e0 0x7fe61c137ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43714/0 (socket says 172.21.15.156:43714) 2023-09-30T22:25:58.169 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.168+0000 7fe6212ea700 1 -- 172.21.15.156:0/1397648726 learned_addr learned my addr 172.21.15.156:0/1397648726 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:58.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.168+0000 7fe6212ea700 1 -- 172.21.15.156:0/1397648726 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe61c0a1510 msgr2=0x7fe61c1351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:58.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.168+0000 7fe6212ea700 1 --2- 172.21.15.156:0/1397648726 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe61c0a1510 0x7fe61c1351a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.168+0000 7fe6212ea700 1 -- 172.21.15.156:0/1397648726 >> v1:172.21.15.156:6789/0 conn(0x7fe61c0a0a30 legacy=0x7fe61c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.170 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.168+0000 7fe6212ea700 1 -- 172.21.15.156:0/1397648726 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61c09abc0 con 0x7fe61c1356e0 2023-09-30T22:25:58.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.168+0000 7fe6212ea700 1 --2- 172.21.15.156:0/1397648726 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe61c1356e0 0x7fe61c137ac0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fe614009e80 tx=0x7fe61400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5516dec74cc82a1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:58.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.168+0000 7fe61b7fe700 1 -- 172.21.15.156:0/1397648726 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61400e070 con 0x7fe61c1356e0 2023-09-30T22:25:58.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.168+0000 7fe61b7fe700 1 -- 172.21.15.156:0/1397648726 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61400b910 con 0x7fe61c1356e0 2023-09-30T22:25:58.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.168+0000 7fe61b7fe700 1 -- 172.21.15.156:0/1397648726 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61400bcc0 con 0x7fe61c1356e0 2023-09-30T22:25:58.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.169+0000 7fe622d4d700 1 -- 172.21.15.156:0/1397648726 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe61c1356e0 msgr2=0x7fe61c137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.169+0000 7fe622d4d700 1 --2- 172.21.15.156:0/1397648726 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe61c1356e0 0x7fe61c137ac0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fe614009e80 tx=0x7fe61400b330 comp rx=0 tx=0).stop 2023-09-30T22:25:58.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.169+0000 7fe622d4d700 1 -- 172.21.15.156:0/1397648726 shutdown_connections 2023-09-30T22:25:58.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.169+0000 7fe622d4d700 1 --2- 172.21.15.156:0/1397648726 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe61c1356e0 0x7fe61c137ac0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.169+0000 7fe622d4d700 1 --2- 172.21.15.156:0/1397648726 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe61c0a1510 0x7fe61c1351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.169+0000 7fe622d4d700 1 -- 172.21.15.156:0/1397648726 >> 172.21.15.156:0/1397648726 conn(0x7fe61c0a2980 msgr2=0x7fe61c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:58.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.169+0000 7fe622d4d700 1 -- 172.21.15.156:0/1397648726 shutdown_connections 2023-09-30T22:25:58.171 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.169+0000 7fe622d4d700 1 -- 172.21.15.156:0/1397648726 wait complete. 2023-09-30T22:25:58.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.171+0000 7fe622d4d700 1 Processor -- start 2023-09-30T22:25:58.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.171+0000 7fe622d4d700 1 -- start start 2023-09-30T22:25:58.173 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.172+0000 7fe622d4d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe61c0a0a30 0x7fe61c139e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:58.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.172+0000 7fe622d4d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe61c0a1510 0x7fe61c13a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:58.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.172+0000 7fe622d4d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe61c1356e0 0x7fe61c13a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:58.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.172+0000 7fe622d4d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c09f660 con 0x7fe61c0a1510 2023-09-30T22:25:58.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.172+0000 7fe622d4d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c09ae00 con 0x7fe61c1356e0 2023-09-30T22:25:58.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.172+0000 7fe622d4d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c12d5b0 con 0x7fe61c0a0a30 2023-09-30T22:25:58.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.172+0000 7fe620ae9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe61c0a0a30 0x7fe61c139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:58.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.172+0000 7fe620ae9700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe61c0a0a30 0x7fe61c139e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43724/0 (socket says 172.21.15.156:43724) 2023-09-30T22:25:58.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.172+0000 7fe620ae9700 1 -- 172.21.15.156:0/2939163150 learned_addr learned my addr 172.21.15.156:0/2939163150 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:58.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.172+0000 7fe6212ea700 1 --2- 172.21.15.156:0/2939163150 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe61c1356e0 0x7fe61c13a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:58.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.172+0000 7fe61bfff700 1 --2- 172.21.15.156:0/2939163150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe61c0a1510 0x7fe61c13a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:58.174 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.172+0000 7fe620ae9700 1 -- 172.21.15.156:0/2939163150 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe61c1356e0 msgr2=0x7fe61c13a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.172+0000 7fe620ae9700 1 --2- 172.21.15.156:0/2939163150 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe61c1356e0 0x7fe61c13a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.172+0000 7fe620ae9700 1 -- 172.21.15.156:0/2939163150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe61c0a1510 msgr2=0x7fe61c13a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.172+0000 7fe620ae9700 1 --2- 172.21.15.156:0/2939163150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe61c0a1510 0x7fe61c13a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.172+0000 7fe620ae9700 1 -- 172.21.15.156:0/2939163150 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe614009b30 con 0x7fe61c0a0a30 2023-09-30T22:25:58.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.173+0000 7fe620ae9700 1 --2- 172.21.15.156:0/2939163150 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe61c0a0a30 0x7fe61c139e10 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fe61000c430 tx=0x7fe61000c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:58.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.173+0000 7fe6197fa700 1 -- 172.21.15.156:0/2939163150 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6100054e0 con 0x7fe61c0a0a30 2023-09-30T22:25:58.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.173+0000 7fe6197fa700 1 -- 172.21.15.156:0/2939163150 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe610003680 con 0x7fe61c0a0a30 2023-09-30T22:25:58.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.173+0000 7fe622d4d700 1 -- 172.21.15.156:0/2939163150 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe61c12d340 con 0x7fe61c0a0a30 2023-09-30T22:25:58.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.173+0000 7fe6197fa700 1 -- 172.21.15.156:0/2939163150 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe610003a10 con 0x7fe61c0a0a30 2023-09-30T22:25:58.175 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.173+0000 7fe622d4d700 1 -- 172.21.15.156:0/2939163150 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe61c12da00 con 0x7fe61c0a0a30 2023-09-30T22:25:58.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.174+0000 7fe6197fa700 1 -- 172.21.15.156:0/2939163150 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe610003b70 con 0x7fe61c0a0a30 2023-09-30T22:25:58.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.174+0000 7fe622d4d700 1 -- 172.21.15.156:0/2939163150 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe61c12eac0 con 0x7fe61c0a0a30 2023-09-30T22:25:58.176 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.174+0000 7fe6197fa700 1 -- 172.21.15.156:0/2939163150 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe61003ea50 con 0x7fe61c0a0a30 2023-09-30T22:25:58.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.182+0000 7fe6197fa700 1 -- 172.21.15.156:0/2939163150 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe610017070 con 0x7fe61c0a0a30 2023-09-30T22:25:58.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.190+0000 7fb38c64f700 1 Processor -- start 2023-09-30T22:25:58.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.190+0000 7fb38c64f700 1 -- start start 2023-09-30T22:25:58.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.191+0000 7fb38c64f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb38406cc70 0x7fb3840a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:58.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.191+0000 7fb38c64f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb3840a0fb0 0x7fb3840a13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:58.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.191+0000 7fb38c64f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb38409df50 con 0x7fb38413c200 2023-09-30T22:25:58.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.191+0000 7fb38c64f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3840a1920 con 0x7fb3840a0fb0 2023-09-30T22:25:58.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.191+0000 7fb38c64f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb38409cf30 con 0x7fb38406cc70 2023-09-30T22:25:58.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.191+0000 7fb38abec700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb38413c200 0x7fb38413e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38656/0 (socket says 172.21.15.156:38656) 2023-09-30T22:25:58.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.191+0000 7fb38abec700 1 -- 172.21.15.156:0/1783393326 learned_addr learned my addr 172.21.15.156:0/1783393326 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:58.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.191+0000 7fb389bea700 1 --2- 172.21.15.156:0/1783393326 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb3840a0fb0 0x7fb3840a13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:58.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.191+0000 7fb38a3eb700 1 --2- 172.21.15.156:0/1783393326 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb38406cc70 0x7fb3840a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:58.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.192+0000 7fb3893e9700 1 -- 172.21.15.156:0/1783393326 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3116019373 0 0) 0x7fb38409df50 con 0x7fb38413c200 2023-09-30T22:25:58.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.192+0000 7fb3893e9700 1 -- 172.21.15.156:0/1783393326 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3700035b0 con 0x7fb38413c200 2023-09-30T22:25:58.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.192+0000 7fb389bea700 1 -- 172.21.15.156:0/1783393326 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb38406cc70 msgr2=0x7fb3840a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:58.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.192+0000 7fb389bea700 1 --2- 172.21.15.156:0/1783393326 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb38406cc70 0x7fb3840a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.192+0000 7fb389bea700 1 -- 172.21.15.156:0/1783393326 >> v1:172.21.15.156:6789/0 conn(0x7fb38413c200 legacy=0x7fb38413e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.192+0000 7fb389bea700 1 -- 172.21.15.156:0/1783393326 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3840a24a0 con 0x7fb3840a0fb0 2023-09-30T22:25:58.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.192+0000 7fb389bea700 1 --2- 172.21.15.156:0/1783393326 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb3840a0fb0 0x7fb3840a13e0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fb374009870 tx=0x7fb374009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d648d7e937a5a85 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:58.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.192+0000 7fb3893e9700 1 -- 172.21.15.156:0/1783393326 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb374011830 con 0x7fb3840a0fb0 2023-09-30T22:25:58.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.192+0000 7fb3893e9700 1 -- 172.21.15.156:0/1783393326 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb374011990 con 0x7fb3840a0fb0 2023-09-30T22:25:58.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.192+0000 7fb3893e9700 1 -- 172.21.15.156:0/1783393326 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb374011d00 con 0x7fb3840a0fb0 2023-09-30T22:25:58.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.193+0000 7fb38c64f700 1 -- 172.21.15.156:0/1783393326 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb3840a0fb0 msgr2=0x7fb3840a13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.193+0000 7fb38c64f700 1 --2- 172.21.15.156:0/1783393326 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb3840a0fb0 0x7fb3840a13e0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fb374009870 tx=0x7fb374009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:58.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.193+0000 7fb38c64f700 1 -- 172.21.15.156:0/1783393326 shutdown_connections 2023-09-30T22:25:58.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.193+0000 7fb38c64f700 1 --2- 172.21.15.156:0/1783393326 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb38406cc70 0x7fb3840a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.193+0000 7fb38c64f700 1 --2- 172.21.15.156:0/1783393326 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb3840a0fb0 0x7fb3840a13e0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.193+0000 7fb38c64f700 1 -- 172.21.15.156:0/1783393326 >> 172.21.15.156:0/1783393326 conn(0x7fb3840a6610 msgr2=0x7fb3840a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:58.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.193+0000 7fb38c64f700 1 -- 172.21.15.156:0/1783393326 shutdown_connections 2023-09-30T22:25:58.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.193+0000 7fb38c64f700 1 -- 172.21.15.156:0/1783393326 wait complete. 2023-09-30T22:25:58.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.194+0000 7fb38c64f700 1 Processor -- start 2023-09-30T22:25:58.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.195+0000 7fb38c64f700 1 -- start start 2023-09-30T22:25:58.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.195+0000 7fb38c64f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb38406cc70 0x7fb384070320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:58.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.195+0000 7fb38c64f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3840a0fb0 0x7fb384070860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:58.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.195+0000 7fb38c64f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb38413c200 0x7fb384070da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:58.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.195+0000 7fb38c64f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb384127220 con 0x7fb3840a0fb0 2023-09-30T22:25:58.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.195+0000 7fb38c64f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3840a0020 con 0x7fb38406cc70 2023-09-30T22:25:58.197 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.195+0000 7fb38c64f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb384125540 con 0x7fb38413c200 2023-09-30T22:25:58.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.195+0000 7fb389bea700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3840a0fb0 0x7fb384070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:58.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.195+0000 7fb38abec700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb38413c200 0x7fb384070da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:58.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.195+0000 7fb389bea700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3840a0fb0 0x7fb384070860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50092/0 (socket says 172.21.15.156:50092) 2023-09-30T22:25:58.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.196+0000 7fb389bea700 1 -- 172.21.15.156:0/2012399641 learned_addr learned my addr 172.21.15.156:0/2012399641 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:58.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.196+0000 7fb38a3eb700 1 --2- 172.21.15.156:0/2012399641 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb38406cc70 0x7fb384070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:58.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.196+0000 7fb38abec700 1 -- 172.21.15.156:0/2012399641 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb38406cc70 msgr2=0x7fb384070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.196+0000 7fb38abec700 1 --2- 172.21.15.156:0/2012399641 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb38406cc70 0x7fb384070320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.196+0000 7fb38abec700 1 -- 172.21.15.156:0/2012399641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3840a0fb0 msgr2=0x7fb384070860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.196+0000 7fb38abec700 1 --2- 172.21.15.156:0/2012399641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3840a0fb0 0x7fb384070860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.196+0000 7fb38abec700 1 -- 172.21.15.156:0/2012399641 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3740094a0 con 0x7fb38413c200 2023-09-30T22:25:58.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.196+0000 7fb38a3eb700 1 --2- 172.21.15.156:0/2012399641 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb38406cc70 0x7fb384070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:58.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.196+0000 7fb38abec700 1 --2- 172.21.15.156:0/2012399641 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb38413c200 0x7fb384070da0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fb37c00cab0 tx=0x7fb37c00cdc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:58.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.196+0000 7fb37affd700 1 -- 172.21.15.156:0/2012399641 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c00a9a0 con 0x7fb38413c200 2023-09-30T22:25:58.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.196+0000 7fb38c64f700 1 -- 172.21.15.156:0/2012399641 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb384127420 con 0x7fb38413c200 2023-09-30T22:25:58.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.196+0000 7fb38c64f700 1 -- 172.21.15.156:0/2012399641 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb38413fb00 con 0x7fb38413c200 2023-09-30T22:25:58.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.197+0000 7fb37affd700 1 -- 172.21.15.156:0/2012399641 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37c00ab00 con 0x7fb38413c200 2023-09-30T22:25:58.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.197+0000 7fb37affd700 1 -- 172.21.15.156:0/2012399641 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c00ae70 con 0x7fb38413c200 2023-09-30T22:25:58.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.198+0000 7fb37affd700 1 -- 172.21.15.156:0/2012399641 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb37c01b3b0 con 0x7fb38413c200 2023-09-30T22:25:58.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.198+0000 7fb37affd700 1 -- 172.21.15.156:0/2012399641 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb37c03f330 con 0x7fb38413c200 2023-09-30T22:25:58.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.198+0000 7fb38c64f700 1 -- 172.21.15.156:0/2012399641 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb36c0052e0 con 0x7fb38413c200 2023-09-30T22:25:58.207 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.207+0000 7fb37affd700 1 -- 172.21.15.156:0/2012399641 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb37c0192c0 con 0x7fb38413c200 2023-09-30T22:25:58.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.259+0000 7f98f0ad4700 1 -- 172.21.15.156:0/3300940060 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f98ec126200 con 0x7f98ec0a1380 2023-09-30T22:25:58.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.259+0000 7f98daffd700 1 -- 172.21.15.156:0/3300940060 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f98ec126200 con 0x7f98ec0a1380 2023-09-30T22:25:58.260 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:58.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.262+0000 7f98f0ad4700 1 -- 172.21.15.156:0/3300940060 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98ec0a1380 msgr2=0x7f98ec122dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.262+0000 7f98f0ad4700 1 --2- 172.21.15.156:0/3300940060 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98ec0a1380 0x7f98ec122dc0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f98e000c550 tx=0x7f98e000c860 comp rx=0 tx=0).stop 2023-09-30T22:25:58.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.262+0000 7f98f0ad4700 1 -- 172.21.15.156:0/3300940060 shutdown_connections 2023-09-30T22:25:58.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.262+0000 7f98f0ad4700 1 --2- 172.21.15.156:0/3300940060 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98ec134120 0x7f98ec123300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.262+0000 7f98f0ad4700 1 --2- 172.21.15.156:0/3300940060 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98ec0a0a70 0x7f98ec122880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.262+0000 7f98f0ad4700 1 --2- 172.21.15.156:0/3300940060 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f98ec0a1380 0x7f98ec122dc0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.262+0000 7f98f0ad4700 1 -- 172.21.15.156:0/3300940060 >> 172.21.15.156:0/3300940060 conn(0x7f98ec0a6610 msgr2=0x7f98ec0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:58.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.262+0000 7f98f0ad4700 1 -- 172.21.15.156:0/3300940060 shutdown_connections 2023-09-30T22:25:58.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.262+0000 7f98f0ad4700 1 -- 172.21.15.156:0/3300940060 wait complete. 2023-09-30T22:25:58.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:58.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.351+0000 7f7a96724700 1 -- 172.21.15.156:0/1399311128 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7a90072480 con 0x7f7a90099e20 2023-09-30T22:25:58.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.352+0000 7f7a8cff9700 1 -- 172.21.15.156:0/1399311128 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7a90072480 con 0x7f7a90099e20 2023-09-30T22:25:58.353 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:58.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.354+0000 7f7a96724700 1 -- 172.21.15.156:0/1399311128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a90099e20 msgr2=0x7f7a9012cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.354+0000 7f7a96724700 1 --2- 172.21.15.156:0/1399311128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a90099e20 0x7f7a9012cde0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f7a8000c700 tx=0x7f7a8000ca10 comp rx=0 tx=0).stop 2023-09-30T22:25:58.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.354+0000 7f7a96724700 1 -- 172.21.15.156:0/1399311128 shutdown_connections 2023-09-30T22:25:58.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.354+0000 7f7a96724700 1 --2- 172.21.15.156:0/1399311128 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f7a90135f80 0x7f7a9006fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.354+0000 7f7a96724700 1 --2- 172.21.15.156:0/1399311128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a90099e20 0x7f7a9012cde0 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.354+0000 7f7a96724700 1 --2- 172.21.15.156:0/1399311128 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7a90133660 0x7f7a9012d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.354+0000 7f7a96724700 1 -- 172.21.15.156:0/1399311128 >> 172.21.15.156:0/1399311128 conn(0x7f7a900a2980 msgr2=0x7f7a901324e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:58.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.354+0000 7f7a96724700 1 -- 172.21.15.156:0/1399311128 shutdown_connections 2023-09-30T22:25:58.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.354+0000 7f7a96724700 1 -- 172.21.15.156:0/1399311128 wait complete. 2023-09-30T22:25:58.367 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:58.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.398+0000 7fe622d4d700 1 -- 172.21.15.156:0/2939163150 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe61c04f2a0 con 0x7fe61c0a0a30 2023-09-30T22:25:58.398 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.398+0000 7fe6197fa700 1 -- 172.21.15.156:0/2939163150 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe610012400 con 0x7fe61c0a0a30 2023-09-30T22:25:58.399 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:58.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.400+0000 7fe622d4d700 1 -- 172.21.15.156:0/2939163150 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe61c0a0a30 msgr2=0x7fe61c139e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.400+0000 7fe622d4d700 1 --2- 172.21.15.156:0/2939163150 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe61c0a0a30 0x7fe61c139e10 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fe61000c430 tx=0x7fe61000c740 comp rx=0 tx=0).stop 2023-09-30T22:25:58.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.400+0000 7fe622d4d700 1 -- 172.21.15.156:0/2939163150 shutdown_connections 2023-09-30T22:25:58.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.400+0000 7fe622d4d700 1 --2- 172.21.15.156:0/2939163150 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe61c1356e0 0x7fe61c13a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.400+0000 7fe622d4d700 1 --2- 172.21.15.156:0/2939163150 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fe61c0a0a30 0x7fe61c139e10 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.400+0000 7fe622d4d700 1 --2- 172.21.15.156:0/2939163150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe61c0a1510 0x7fe61c13a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.400+0000 7fe622d4d700 1 -- 172.21.15.156:0/2939163150 >> 172.21.15.156:0/2939163150 conn(0x7fe61c0a2980 msgr2=0x7fe61c070e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:58.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.400+0000 7fe622d4d700 1 -- 172.21.15.156:0/2939163150 shutdown_connections 2023-09-30T22:25:58.401 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.400+0000 7fe622d4d700 1 -- 172.21.15.156:0/2939163150 wait complete. 2023-09-30T22:25:58.413 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:58.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.419+0000 7fb38c64f700 1 -- 172.21.15.156:0/2012399641 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb36c005590 con 0x7fb38413c200 2023-09-30T22:25:58.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.419+0000 7fb37affd700 1 -- 172.21.15.156:0/2012399641 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb37c017030 con 0x7fb38413c200 2023-09-30T22:25:58.420 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:58.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.421+0000 7fb38c64f700 1 -- 172.21.15.156:0/2012399641 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb38413c200 msgr2=0x7fb384070da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.421+0000 7fb38c64f700 1 --2- 172.21.15.156:0/2012399641 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb38413c200 0x7fb384070da0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fb37c00cab0 tx=0x7fb37c00cdc0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.421+0000 7fb38c64f700 1 -- 172.21.15.156:0/2012399641 shutdown_connections 2023-09-30T22:25:58.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.421+0000 7fb38c64f700 1 --2- 172.21.15.156:0/2012399641 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fb38413c200 0x7fb384070da0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.421+0000 7fb38c64f700 1 --2- 172.21.15.156:0/2012399641 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb38406cc70 0x7fb384070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.421+0000 7fb38c64f700 1 --2- 172.21.15.156:0/2012399641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3840a0fb0 0x7fb384070860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.421+0000 7fb38c64f700 1 -- 172.21.15.156:0/2012399641 >> 172.21.15.156:0/2012399641 conn(0x7fb3840a6610 msgr2=0x7fb38409c050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:58.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.421+0000 7fb38c64f700 1 -- 172.21.15.156:0/2012399641 shutdown_connections 2023-09-30T22:25:58.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:58.421+0000 7fb38c64f700 1 -- 172.21.15.156:0/2012399641 wait complete. 2023-09-30T22:25:58.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:25:59.276 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:59.368 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:59.402 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.402+0000 7f5a8cf3d700 1 Processor -- start 2023-09-30T22:25:59.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.402+0000 7f5a8cf3d700 1 -- start start 2023-09-30T22:25:59.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.402+0000 7f5a8cf3d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a8809a150 0x7f5a8809e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.402+0000 7f5a8cf3d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5a8809edb0 0x7f5a8809f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.402+0000 7f5a8cf3d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a88133c20 0x7f5a881340a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.402+0000 7f5a8cf3d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a8809a520 con 0x7f5a8809edb0 2023-09-30T22:25:59.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.402+0000 7f5a8cf3d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8809fe00 con 0x7f5a8809a150 2023-09-30T22:25:59.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.402+0000 7f5a8cf3d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8806bec0 con 0x7f5a88133c20 2023-09-30T22:25:59.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.403+0000 7f5a8659c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a8809a150 0x7f5a8809e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.403+0000 7f5a86d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a88133c20 0x7f5a881340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.403+0000 7f5a86d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a88133c20 0x7f5a881340a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43758/0 (socket says 172.21.15.156:43758) 2023-09-30T22:25:59.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.403+0000 7f5a8659c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a8809a150 0x7f5a8809e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54548/0 (socket says 172.21.15.156:54548) 2023-09-30T22:25:59.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.403+0000 7f5a86d9d700 1 -- 172.21.15.156:0/4262930249 learned_addr learned my addr 172.21.15.156:0/4262930249 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:59.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.403+0000 7f5a85d9b700 1 --2- 172.21.15.156:0/4262930249 >> v2:172.21.15.156:3300/0 conn(0x7f5a8809edb0 0x7f5a8809f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.403+0000 7f5a86d9d700 1 -- 172.21.15.156:0/4262930249 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a8809a150 msgr2=0x7f5a8809e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:59.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.403+0000 7f5a86d9d700 1 --2- 172.21.15.156:0/4262930249 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a8809a150 0x7f5a8809e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.403+0000 7f5a86d9d700 1 -- 172.21.15.156:0/4262930249 >> v2:172.21.15.156:3300/0 conn(0x7f5a8809edb0 msgr2=0x7f5a8809f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:59.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.403+0000 7f5a86d9d700 1 --2- 172.21.15.156:0/4262930249 >> v2:172.21.15.156:3300/0 conn(0x7f5a8809edb0 0x7f5a8809f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.403+0000 7f5a86d9d700 1 -- 172.21.15.156:0/4262930249 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8809af80 con 0x7f5a88133c20 2023-09-30T22:25:59.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.403+0000 7f5a85d9b700 1 --2- 172.21.15.156:0/4262930249 >> v2:172.21.15.156:3300/0 conn(0x7f5a8809edb0 0x7f5a8809f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:59.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.403+0000 7f5a8659c700 1 --2- 172.21.15.156:0/4262930249 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a8809a150 0x7f5a8809e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:59.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.403+0000 7f5a86d9d700 1 --2- 172.21.15.156:0/4262930249 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a88133c20 0x7f5a881340a0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f5a80009e80 tx=0x7f5a8000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64878b806b92825c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:59.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.403+0000 7f5a8559a700 1 -- 172.21.15.156:0/4262930249 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8000e070 con 0x7f5a88133c20 2023-09-30T22:25:59.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.403+0000 7f5a8559a700 1 -- 172.21.15.156:0/4262930249 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8000b8d0 con 0x7f5a88133c20 2023-09-30T22:25:59.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.403+0000 7f5a8559a700 1 -- 172.21.15.156:0/4262930249 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8000bc80 con 0x7f5a88133c20 2023-09-30T22:25:59.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.404+0000 7f5a8cf3d700 1 -- 172.21.15.156:0/4262930249 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a88133c20 msgr2=0x7f5a881340a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.404+0000 7f5a8cf3d700 1 --2- 172.21.15.156:0/4262930249 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a88133c20 0x7f5a881340a0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f5a80009e80 tx=0x7f5a8000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:59.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.404+0000 7f5a8cf3d700 1 -- 172.21.15.156:0/4262930249 shutdown_connections 2023-09-30T22:25:59.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.404+0000 7f5a8cf3d700 1 --2- 172.21.15.156:0/4262930249 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a88133c20 0x7f5a881340a0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.404+0000 7f5a8cf3d700 1 --2- 172.21.15.156:0/4262930249 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a8809a150 0x7f5a8809e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.404+0000 7f5a8cf3d700 1 --2- 172.21.15.156:0/4262930249 >> v2:172.21.15.156:3300/0 conn(0x7f5a8809edb0 0x7f5a8809f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.404+0000 7f5a8cf3d700 1 -- 172.21.15.156:0/4262930249 >> 172.21.15.156:0/4262930249 conn(0x7f5a880a4430 msgr2=0x7f5a880a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:59.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.404+0000 7f5a8cf3d700 1 -- 172.21.15.156:0/4262930249 shutdown_connections 2023-09-30T22:25:59.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.404+0000 7f5a8cf3d700 1 -- 172.21.15.156:0/4262930249 wait complete. 2023-09-30T22:25:59.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.405+0000 7f5a8cf3d700 1 Processor -- start 2023-09-30T22:25:59.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.405+0000 7f5a8cf3d700 1 -- start start 2023-09-30T22:25:59.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.405+0000 7f5a8cf3d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a8809a150 0x7f5a8811ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.406+0000 7f5a8cf3d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a8809edb0 0x7f5a8811f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.406+0000 7f5a8cf3d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a88133c20 0x7f5a8811f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.406+0000 7f5a8cf3d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a88120c40 con 0x7f5a88133c20 2023-09-30T22:25:59.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.406+0000 7f5a8cf3d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a88122500 con 0x7f5a8809edb0 2023-09-30T22:25:59.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.406+0000 7f5a8cf3d700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8809b160 con 0x7f5a8809a150 2023-09-30T22:25:59.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.406+0000 7f5a8659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a8809a150 0x7f5a8811ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.406+0000 7f5a85d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a8809edb0 0x7f5a8811f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.406+0000 7f5a8659c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a8809a150 0x7f5a8811ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43772/0 (socket says 172.21.15.156:43772) 2023-09-30T22:25:59.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.406+0000 7f5a8659c700 1 -- 172.21.15.156:0/2922654 learned_addr learned my addr 172.21.15.156:0/2922654 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:59.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.406+0000 7f5a86d9d700 1 --2- 172.21.15.156:0/2922654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a88133c20 0x7f5a8811f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.406+0000 7f5a85d9b700 1 -- 172.21.15.156:0/2922654 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a8809a150 msgr2=0x7f5a8811ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.406+0000 7f5a85d9b700 1 --2- 172.21.15.156:0/2922654 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a8809a150 0x7f5a8811ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.406+0000 7f5a85d9b700 1 -- 172.21.15.156:0/2922654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a88133c20 msgr2=0x7f5a8811f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.406+0000 7f5a85d9b700 1 --2- 172.21.15.156:0/2922654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a88133c20 0x7f5a8811f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.406+0000 7f5a85d9b700 1 -- 172.21.15.156:0/2922654 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a780094a0 con 0x7f5a8809edb0 2023-09-30T22:25:59.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.406+0000 7f5a8659c700 1 --2- 172.21.15.156:0/2922654 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a8809a150 0x7f5a8811ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:59.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.406+0000 7f5a86d9d700 1 --2- 172.21.15.156:0/2922654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a88133c20 0x7f5a8811f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:59.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.406+0000 7f5a85d9b700 1 --2- 172.21.15.156:0/2922654 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a8809edb0 0x7f5a8811f010 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c00e980 tx=0x7f5a7c00ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:59.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.406+0000 7f5a76ffd700 1 -- 172.21.15.156:0/2922654 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c00c690 con 0x7f5a8809edb0 2023-09-30T22:25:59.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.406+0000 7f5a76ffd700 1 -- 172.21.15.156:0/2922654 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7c00c7f0 con 0x7f5a8809edb0 2023-09-30T22:25:59.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.406+0000 7f5a8cf3d700 1 -- 172.21.15.156:0/2922654 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a7c0094a0 con 0x7f5a8809edb0 2023-09-30T22:25:59.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.406+0000 7f5a76ffd700 1 -- 172.21.15.156:0/2922654 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c00cb80 con 0x7f5a8809edb0 2023-09-30T22:25:59.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.406+0000 7f5a8cf3d700 1 -- 172.21.15.156:0/2922654 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a80009b30 con 0x7f5a8809edb0 2023-09-30T22:25:59.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.407+0000 7f5a76ffd700 1 -- 172.21.15.156:0/2922654 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5a7c00cce0 con 0x7f5a8809edb0 2023-09-30T22:25:59.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.407+0000 7f5a76ffd700 1 -- 172.21.15.156:0/2922654 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5a7c03fa30 con 0x7f5a8809edb0 2023-09-30T22:25:59.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.407+0000 7f5a8cf3d700 1 -- 172.21.15.156:0/2922654 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a88133a00 con 0x7f5a8809edb0 2023-09-30T22:25:59.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.412+0000 7f5a76ffd700 1 -- 172.21.15.156:0/2922654 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5a7c01b3b0 con 0x7f5a8809edb0 2023-09-30T22:25:59.414 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:59.434 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:59.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.501+0000 7f3268a09700 1 Processor -- start 2023-09-30T22:25:59.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.501+0000 7f3268a09700 1 -- start start 2023-09-30T22:25:59.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.502+0000 7f3268a09700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f326409d860 0x7f326409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.502+0000 7f3268a09700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3264130eb0 0x7f3264138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.502+0000 7f3268a09700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f326409aaa0 con 0x7f326409e170 2023-09-30T22:25:59.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.502+0000 7f3268a09700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f326409f870 con 0x7f326409d860 2023-09-30T22:25:59.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.502+0000 7f3268a09700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f326409b360 con 0x7f3264130eb0 2023-09-30T22:25:59.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.502+0000 7f326259c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f326409d860 0x7f326409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.502+0000 7f3261d9b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f326409e170 0x7f32641307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38666/0 (socket says 172.21.15.156:38666) 2023-09-30T22:25:59.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.502+0000 7f3261d9b700 1 -- 172.21.15.156:0/4129901705 learned_addr learned my addr 172.21.15.156:0/4129901705 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:25:59.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.502+0000 7f326259c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f326409d860 0x7f326409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50120/0 (socket says 172.21.15.156:50120) 2023-09-30T22:25:59.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.503+0000 7f3262d9d700 1 --2- 172.21.15.156:0/4129901705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3264130eb0 0x7f3264138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.503+0000 7f326159a700 1 -- 172.21.15.156:0/4129901705 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3233542330 0 0) 0x7f326409aaa0 con 0x7f326409e170 2023-09-30T22:25:59.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.503+0000 7f326259c700 1 -- 172.21.15.156:0/4129901705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3264130eb0 msgr2=0x7f3264138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:59.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.503+0000 7f326259c700 1 --2- 172.21.15.156:0/4129901705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3264130eb0 0x7f3264138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.503+0000 7f326259c700 1 -- 172.21.15.156:0/4129901705 >> v1:172.21.15.156:6789/0 conn(0x7f326409e170 legacy=0x7f32641307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.503+0000 7f326259c700 1 -- 172.21.15.156:0/4129901705 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326409b620 con 0x7f326409d860 2023-09-30T22:25:59.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.503+0000 7f3262d9d700 1 --2- 172.21.15.156:0/4129901705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3264130eb0 0x7f3264138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:59.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.503+0000 7f326259c700 1 --2- 172.21.15.156:0/4129901705 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f326409d860 0x7f326409dc30 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f3254009870 tx=0x7f3254009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722ec6aa71306a27 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:59.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.503+0000 7f326159a700 1 -- 172.21.15.156:0/4129901705 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3254011830 con 0x7f326409d860 2023-09-30T22:25:59.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.503+0000 7f326159a700 1 -- 172.21.15.156:0/4129901705 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3254011990 con 0x7f326409d860 2023-09-30T22:25:59.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.503+0000 7f326159a700 1 -- 172.21.15.156:0/4129901705 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3254011d20 con 0x7f326409d860 2023-09-30T22:25:59.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.504+0000 7f3268a09700 1 -- 172.21.15.156:0/4129901705 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f326409d860 msgr2=0x7f326409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.504+0000 7f3268a09700 1 --2- 172.21.15.156:0/4129901705 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f326409d860 0x7f326409dc30 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f3254009870 tx=0x7f3254009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:59.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.504+0000 7f3268a09700 1 -- 172.21.15.156:0/4129901705 shutdown_connections 2023-09-30T22:25:59.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.504+0000 7f3268a09700 1 --2- 172.21.15.156:0/4129901705 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3264130eb0 0x7f3264138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.504+0000 7f3268a09700 1 --2- 172.21.15.156:0/4129901705 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f326409d860 0x7f326409dc30 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.504+0000 7f3268a09700 1 -- 172.21.15.156:0/4129901705 >> 172.21.15.156:0/4129901705 conn(0x7f3264099c40 msgr2=0x7f32640a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:59.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.504+0000 7f3268a09700 1 -- 172.21.15.156:0/4129901705 shutdown_connections 2023-09-30T22:25:59.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.504+0000 7f3268a09700 1 -- 172.21.15.156:0/4129901705 wait complete. 2023-09-30T22:25:59.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.505+0000 7f3268a09700 1 Processor -- start 2023-09-30T22:25:59.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.505+0000 7f3268a09700 1 -- start start 2023-09-30T22:25:59.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.506+0000 7f3268a09700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f326409d860 0x7f326411a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.506+0000 7f3268a09700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f326409e170 0x7f326411a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.506+0000 7f3268a09700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3264130eb0 0x7f326411ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.506+0000 7f3268a09700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326411dcd0 con 0x7f326409e170 2023-09-30T22:25:59.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.506+0000 7f3268a09700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f326409c920 con 0x7f3264130eb0 2023-09-30T22:25:59.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.506+0000 7f3268a09700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3264071fc0 con 0x7f326409d860 2023-09-30T22:25:59.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.506+0000 7f3262d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3264130eb0 0x7f326411ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.506+0000 7f3262d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3264130eb0 0x7f326411ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54578/0 (socket says 172.21.15.156:54578) 2023-09-30T22:25:59.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.506+0000 7f3262d9d700 1 -- 172.21.15.156:0/849328697 learned_addr learned my addr 172.21.15.156:0/849328697 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:59.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.506+0000 7f3261d9b700 1 --2- 172.21.15.156:0/849328697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f326409e170 0x7f326411a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.506+0000 7f3262d9d700 1 -- 172.21.15.156:0/849328697 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f326409d860 msgr2=0x7f326411a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.506+0000 7f3262d9d700 1 --2- 172.21.15.156:0/849328697 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f326409d860 0x7f326411a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.506+0000 7f3262d9d700 1 -- 172.21.15.156:0/849328697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f326409e170 msgr2=0x7f326411a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.506+0000 7f3262d9d700 1 --2- 172.21.15.156:0/849328697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f326409e170 0x7f326411a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.506+0000 7f3262d9d700 1 -- 172.21.15.156:0/849328697 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325c009a70 con 0x7f3264130eb0 2023-09-30T22:25:59.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.506+0000 7f3262d9d700 1 --2- 172.21.15.156:0/849328697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3264130eb0 0x7f326411ac30 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f325c00efc0 tx=0x7f325c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:59.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.507+0000 7f3252ffd700 1 -- 172.21.15.156:0/849328697 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c00cb40 con 0x7f3264130eb0 2023-09-30T22:25:59.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.507+0000 7f3252ffd700 1 -- 172.21.15.156:0/849328697 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325c00f040 con 0x7f3264130eb0 2023-09-30T22:25:59.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.507+0000 7f3252ffd700 1 -- 172.21.15.156:0/849328697 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c003a20 con 0x7f3264130eb0 2023-09-30T22:25:59.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.507+0000 7f3268a09700 1 -- 172.21.15.156:0/849328697 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32540094a0 con 0x7f3264130eb0 2023-09-30T22:25:59.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.507+0000 7f3268a09700 1 -- 172.21.15.156:0/849328697 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f326411d730 con 0x7f3264130eb0 2023-09-30T22:25:59.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.508+0000 7f3252ffd700 1 -- 172.21.15.156:0/849328697 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f325c014480 con 0x7f3264130eb0 2023-09-30T22:25:59.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.508+0000 7f3268a09700 1 -- 172.21.15.156:0/849328697 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f326404f2a0 con 0x7f3264130eb0 2023-09-30T22:25:59.512 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.509+0000 7f3252ffd700 1 -- 172.21.15.156:0/849328697 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f325c0401b0 con 0x7f3264130eb0 2023-09-30T22:25:59.518 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.517+0000 7f3252ffd700 1 -- 172.21.15.156:0/849328697 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f325c012930 con 0x7f3264130eb0 2023-09-30T22:25:59.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.553+0000 7f8debf56700 1 Processor -- start 2023-09-30T22:25:59.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.554+0000 7f8debf56700 1 -- start start 2023-09-30T22:25:59.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.554+0000 7f8debf56700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8de4131980 0x7f8de4131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.554+0000 7f8debf56700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8de409c790 0x7f8de4139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.554+0000 7f8debf56700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8de40a1640 con 0x7f8de409bc70 2023-09-30T22:25:59.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.554+0000 7f8debf56700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8de406eb30 con 0x7f8de409c790 2023-09-30T22:25:59.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.554+0000 7f8debf56700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8de40a22d0 con 0x7f8de4131980 2023-09-30T22:25:59.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.555+0000 7f8de9cf2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8de4131980 0x7f8de4131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.555+0000 7f8dea4f3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8de409c790 0x7f8de4139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.555+0000 7f8de9cf2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8de4131980 0x7f8de4131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43792/0 (socket says 172.21.15.156:43792) 2023-09-30T22:25:59.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.555+0000 7f8de9cf2700 1 -- 172.21.15.156:0/3763678686 learned_addr learned my addr 172.21.15.156:0/3763678686 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:59.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.555+0000 7f8de9cf2700 1 -- 172.21.15.156:0/3763678686 >> v2:172.21.15.156:3300/0 conn(0x7f8de409c790 msgr2=0x7f8de4139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:59.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.555+0000 7f8de9cf2700 1 --2- 172.21.15.156:0/3763678686 >> v2:172.21.15.156:3300/0 conn(0x7f8de409c790 0x7f8de4139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.555+0000 7f8de9cf2700 1 -- 172.21.15.156:0/3763678686 >> v1:172.21.15.156:6789/0 conn(0x7f8de409bc70 legacy=0x7f8de409c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.555+0000 7f8de8cf0700 1 -- 172.21.15.156:0/3763678686 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2187616953 0 0) 0x7f8de40a1640 con 0x7f8de409bc70 2023-09-30T22:25:59.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.555+0000 7f8de9cf2700 1 -- 172.21.15.156:0/3763678686 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de4131550 con 0x7f8de4131980 2023-09-30T22:25:59.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.555+0000 7f8dea4f3700 1 --2- 172.21.15.156:0/3763678686 >> v2:172.21.15.156:3300/0 conn(0x7f8de409c790 0x7f8de4139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:59.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.555+0000 7f8de9cf2700 1 --2- 172.21.15.156:0/3763678686 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8de4131980 0x7f8de4131d50 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f8de0006fd0 tx=0x7f8de0009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3e413ae3603c840 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:59.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.555+0000 7f8de8cf0700 1 -- 172.21.15.156:0/3763678686 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de0005e30 con 0x7f8de4131980 2023-09-30T22:25:59.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.555+0000 7f8de8cf0700 1 -- 172.21.15.156:0/3763678686 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de0004030 con 0x7f8de4131980 2023-09-30T22:25:59.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.555+0000 7f8de8cf0700 1 -- 172.21.15.156:0/3763678686 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de00043e0 con 0x7f8de4131980 2023-09-30T22:25:59.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.556+0000 7f8debf56700 1 -- 172.21.15.156:0/3763678686 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8de4131980 msgr2=0x7f8de4131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.556+0000 7f8debf56700 1 --2- 172.21.15.156:0/3763678686 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8de4131980 0x7f8de4131d50 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f8de0006fd0 tx=0x7f8de0009bd0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.556+0000 7f8debf56700 1 -- 172.21.15.156:0/3763678686 shutdown_connections 2023-09-30T22:25:59.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.556+0000 7f8debf56700 1 --2- 172.21.15.156:0/3763678686 >> v2:172.21.15.156:3300/0 conn(0x7f8de409c790 0x7f8de4139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.556+0000 7f8debf56700 1 --2- 172.21.15.156:0/3763678686 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8de4131980 0x7f8de4131d50 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.556+0000 7f8debf56700 1 -- 172.21.15.156:0/3763678686 >> 172.21.15.156:0/3763678686 conn(0x7f8de40a2980 msgr2=0x7f8de40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:59.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.556+0000 7f8debf56700 1 -- 172.21.15.156:0/3763678686 shutdown_connections 2023-09-30T22:25:59.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.557+0000 7f8debf56700 1 -- 172.21.15.156:0/3763678686 wait complete. 2023-09-30T22:25:59.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.558+0000 7f8debf56700 1 Processor -- start 2023-09-30T22:25:59.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.558+0000 7f8debf56700 1 -- start start 2023-09-30T22:25:59.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.558+0000 7f8debf56700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8de409bc70 0x7f8de411b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.558+0000 7f8debf56700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8de409c790 0x7f8de411bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.558+0000 7f8debf56700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8de4131980 0x7f8de411c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.558+0000 7f8debf56700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de411d230 con 0x7f8de409bc70 2023-09-30T22:25:59.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.558+0000 7f8debf56700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de411e480 con 0x7f8de409c790 2023-09-30T22:25:59.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.558+0000 7f8debf56700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8de412eeb0 con 0x7f8de4131980 2023-09-30T22:25:59.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.559+0000 7f8dea4f3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8de4131980 0x7f8de411c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.559+0000 7f8dea4f3700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8de4131980 0x7f8de411c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43794/0 (socket says 172.21.15.156:43794) 2023-09-30T22:25:59.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.559+0000 7f8de9cf2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8de409bc70 0x7f8de411b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.559+0000 7f8dea4f3700 1 -- 172.21.15.156:0/1802875796 learned_addr learned my addr 172.21.15.156:0/1802875796 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:59.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.559+0000 7f8de94f1700 1 --2- 172.21.15.156:0/1802875796 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8de409c790 0x7f8de411bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.559+0000 7f8de9cf2700 1 -- 172.21.15.156:0/1802875796 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8de4131980 msgr2=0x7f8de411c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.559+0000 7f8de9cf2700 1 --2- 172.21.15.156:0/1802875796 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8de4131980 0x7f8de411c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.559+0000 7f8de9cf2700 1 -- 172.21.15.156:0/1802875796 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8de409c790 msgr2=0x7f8de411bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.559+0000 7f8de9cf2700 1 --2- 172.21.15.156:0/1802875796 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8de409c790 0x7f8de411bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.559+0000 7f8de9cf2700 1 -- 172.21.15.156:0/1802875796 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ddc009a70 con 0x7f8de409bc70 2023-09-30T22:25:59.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.559+0000 7f8de9cf2700 1 --2- 172.21.15.156:0/1802875796 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8de409bc70 0x7f8de411b620 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f8de0013000 tx=0x7f8de0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:59.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.559+0000 7f8dda7fc700 1 -- 172.21.15.156:0/1802875796 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de001d430 con 0x7f8de409bc70 2023-09-30T22:25:59.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.559+0000 7f8dda7fc700 1 -- 172.21.15.156:0/1802875796 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de001d590 con 0x7f8de409bc70 2023-09-30T22:25:59.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.559+0000 7f8debf56700 1 -- 172.21.15.156:0/1802875796 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de0009500 con 0x7f8de409bc70 2023-09-30T22:25:59.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.559+0000 7f8dda7fc700 1 -- 172.21.15.156:0/1802875796 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de001d940 con 0x7f8de409bc70 2023-09-30T22:25:59.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.559+0000 7f8debf56700 1 -- 172.21.15.156:0/1802875796 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de4130a60 con 0x7f8de409bc70 2023-09-30T22:25:59.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.560+0000 7f8debf56700 1 -- 172.21.15.156:0/1802875796 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de40a1c40 con 0x7f8de409bc70 2023-09-30T22:25:59.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.561+0000 7f8dda7fc700 1 -- 172.21.15.156:0/1802875796 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8de001daa0 con 0x7f8de409bc70 2023-09-30T22:25:59.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.561+0000 7f8dda7fc700 1 -- 172.21.15.156:0/1802875796 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8de0040ff0 con 0x7f8de409bc70 2023-09-30T22:25:59.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.570+0000 7f8dda7fc700 1 -- 172.21.15.156:0/1802875796 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8de001dd50 con 0x7f8de409bc70 2023-09-30T22:25:59.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.596+0000 7f338f9b6700 1 Processor -- start 2023-09-30T22:25:59.597 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.596+0000 7f338f9b6700 1 -- start start 2023-09-30T22:25:59.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.597+0000 7f338f9b6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f338809d860 0x7f338809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.597+0000 7f338f9b6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3388130eb0 0x7f3388138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.597+0000 7f338f9b6700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f338809aaa0 con 0x7f338809e170 2023-09-30T22:25:59.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.597+0000 7f338f9b6700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f338809f870 con 0x7f338809d860 2023-09-30T22:25:59.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.597+0000 7f338f9b6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f338809b360 con 0x7f3388130eb0 2023-09-30T22:25:59.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.597+0000 7f338df53700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3388130eb0 0x7f3388138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.597+0000 7f338df53700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3388130eb0 0x7f3388138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43804/0 (socket says 172.21.15.156:43804) 2023-09-30T22:25:59.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.597+0000 7f338df53700 1 -- 172.21.15.156:0/3536173441 learned_addr learned my addr 172.21.15.156:0/3536173441 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:59.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.597+0000 7f338d752700 1 --2- 172.21.15.156:0/3536173441 >> v2:172.21.15.156:3300/0 conn(0x7f338809d860 0x7f338809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.597+0000 7f338df53700 1 -- 172.21.15.156:0/3536173441 >> v2:172.21.15.156:3300/0 conn(0x7f338809d860 msgr2=0x7f338809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:59.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.597+0000 7f338df53700 1 --2- 172.21.15.156:0/3536173441 >> v2:172.21.15.156:3300/0 conn(0x7f338809d860 0x7f338809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.597+0000 7f338df53700 1 -- 172.21.15.156:0/3536173441 >> v1:172.21.15.156:6789/0 conn(0x7f338809e170 legacy=0x7f33881307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.597+0000 7f338df53700 1 -- 172.21.15.156:0/3536173441 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338809b620 con 0x7f3388130eb0 2023-09-30T22:25:59.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.597+0000 7f338df53700 1 --2- 172.21.15.156:0/3536173441 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3388130eb0 0x7f3388138a00 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f3380009e50 tx=0x7f338000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=341dc84d4e1c47a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:59.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.598+0000 7f337ffff700 1 -- 172.21.15.156:0/3536173441 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338000e070 con 0x7f3388130eb0 2023-09-30T22:25:59.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.598+0000 7f337ffff700 1 -- 172.21.15.156:0/3536173441 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338000b910 con 0x7f3388130eb0 2023-09-30T22:25:59.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.598+0000 7f337ffff700 1 -- 172.21.15.156:0/3536173441 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338000bcc0 con 0x7f3388130eb0 2023-09-30T22:25:59.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.598+0000 7f338f9b6700 1 -- 172.21.15.156:0/3536173441 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3388130eb0 msgr2=0x7f3388138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.602 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.598+0000 7f338f9b6700 1 --2- 172.21.15.156:0/3536173441 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3388130eb0 0x7f3388138a00 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f3380009e50 tx=0x7f338000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:59.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.598+0000 7f338f9b6700 1 -- 172.21.15.156:0/3536173441 shutdown_connections 2023-09-30T22:25:59.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.598+0000 7f338f9b6700 1 --2- 172.21.15.156:0/3536173441 >> v2:172.21.15.156:3300/0 conn(0x7f338809d860 0x7f338809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.598+0000 7f338f9b6700 1 --2- 172.21.15.156:0/3536173441 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f3388130eb0 0x7f3388138a00 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.598+0000 7f338f9b6700 1 -- 172.21.15.156:0/3536173441 >> 172.21.15.156:0/3536173441 conn(0x7f3388099c40 msgr2=0x7f33880a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:59.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.598+0000 7f338f9b6700 1 -- 172.21.15.156:0/3536173441 shutdown_connections 2023-09-30T22:25:59.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.599+0000 7f338f9b6700 1 -- 172.21.15.156:0/3536173441 wait complete. 2023-09-30T22:25:59.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.599+0000 7f338f9b6700 1 Processor -- start 2023-09-30T22:25:59.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.599+0000 7f338f9b6700 1 -- start start 2023-09-30T22:25:59.603 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.600+0000 7f338f9b6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f338809d860 0x7f338811e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.600+0000 7f338f9b6700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f338809e170 0x7f338811e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.600+0000 7f338f9b6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3388130eb0 0x7f338811ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.600+0000 7f338f9b6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3388121be0 con 0x7f3388130eb0 2023-09-30T22:25:59.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.600+0000 7f338f9b6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33880a2170 con 0x7f338809d860 2023-09-30T22:25:59.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.600+0000 7f338f9b6700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33881200c0 con 0x7f338809e170 2023-09-30T22:25:59.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.600+0000 7f338cf51700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f338809e170 0x7f338811e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.600+0000 7f338cf51700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f338809e170 0x7f338811e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43806/0 (socket says 172.21.15.156:43806) 2023-09-30T22:25:59.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.600+0000 7f338cf51700 1 -- 172.21.15.156:0/387289673 learned_addr learned my addr 172.21.15.156:0/387289673 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:25:59.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.600+0000 7f338d752700 1 --2- 172.21.15.156:0/387289673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f338809d860 0x7f338811e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.604 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.600+0000 7f338cf51700 1 -- 172.21.15.156:0/387289673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f338809d860 msgr2=0x7f338811e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.600+0000 7f338cf51700 1 --2- 172.21.15.156:0/387289673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f338809d860 0x7f338811e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.600+0000 7f338df53700 1 --2- 172.21.15.156:0/387289673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3388130eb0 0x7f338811ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.600+0000 7f338cf51700 1 -- 172.21.15.156:0/387289673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3388130eb0 msgr2=0x7f338811ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.600+0000 7f338cf51700 1 --2- 172.21.15.156:0/387289673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3388130eb0 0x7f338811ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.600+0000 7f338cf51700 1 -- 172.21.15.156:0/387289673 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3380009b30 con 0x7f338809e170 2023-09-30T22:25:59.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.600+0000 7f338df53700 1 --2- 172.21.15.156:0/387289673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3388130eb0 0x7f338811ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:59.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.600+0000 7f338cf51700 1 --2- 172.21.15.156:0/387289673 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f338809e170 0x7f338811e930 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f337800c4e0 tx=0x7f337800c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:59.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.601+0000 7f337dffb700 1 -- 172.21.15.156:0/387289673 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33780052d0 con 0x7f338809e170 2023-09-30T22:25:59.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.601+0000 7f337dffb700 1 -- 172.21.15.156:0/387289673 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3378005430 con 0x7f338809e170 2023-09-30T22:25:59.605 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.601+0000 7f338f9b6700 1 -- 172.21.15.156:0/387289673 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33881207d0 con 0x7f338809e170 2023-09-30T22:25:59.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.601+0000 7f337dffb700 1 -- 172.21.15.156:0/387289673 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33780038c0 con 0x7f338809e170 2023-09-30T22:25:59.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.601+0000 7f338f9b6700 1 -- 172.21.15.156:0/387289673 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3388122650 con 0x7f338809e170 2023-09-30T22:25:59.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.602+0000 7f337dffb700 1 -- 172.21.15.156:0/387289673 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3378003a20 con 0x7f338809e170 2023-09-30T22:25:59.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.602+0000 7f338f9b6700 1 -- 172.21.15.156:0/387289673 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f338804f2a0 con 0x7f338809e170 2023-09-30T22:25:59.606 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.602+0000 7f337dffb700 1 -- 172.21.15.156:0/387289673 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f337803ec90 con 0x7f338809e170 2023-09-30T22:25:59.611 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.611+0000 7f337dffb700 1 -- 172.21.15.156:0/387289673 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3378019e60 con 0x7f338809e170 2023-09-30T22:25:59.629 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.629+0000 7f5a8cf3d700 1 -- 172.21.15.156:0/2922654 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5a8809fa30 con 0x7f5a8809edb0 2023-09-30T22:25:59.630 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.629+0000 7f5a76ffd700 1 -- 172.21.15.156:0/2922654 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5a7c021020 con 0x7f5a8809edb0 2023-09-30T22:25:59.630 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:25:59.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.632+0000 7f5a8cf3d700 1 -- 172.21.15.156:0/2922654 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a8809edb0 msgr2=0x7f5a8811f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.632+0000 7f5a8cf3d700 1 --2- 172.21.15.156:0/2922654 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a8809edb0 0x7f5a8811f010 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c00e980 tx=0x7f5a7c00ec90 comp rx=0 tx=0).stop 2023-09-30T22:25:59.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.632+0000 7f5a8cf3d700 1 -- 172.21.15.156:0/2922654 shutdown_connections 2023-09-30T22:25:59.633 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.632+0000 7f5a8cf3d700 1 --2- 172.21.15.156:0/2922654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a88133c20 0x7f5a8811f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.632+0000 7f5a8cf3d700 1 --2- 172.21.15.156:0/2922654 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5a8809a150 0x7f5a8811ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.632+0000 7f5a8cf3d700 1 --2- 172.21.15.156:0/2922654 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5a8809edb0 0x7f5a8811f010 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.632+0000 7f5a8cf3d700 1 -- 172.21.15.156:0/2922654 >> 172.21.15.156:0/2922654 conn(0x7f5a880a4430 msgr2=0x7f5a88071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:59.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.632+0000 7f5a8cf3d700 1 -- 172.21.15.156:0/2922654 shutdown_connections 2023-09-30T22:25:59.634 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.632+0000 7f5a8cf3d700 1 -- 172.21.15.156:0/2922654 wait complete. 2023-09-30T22:25:59.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:25:59.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.735+0000 7f3268a09700 1 -- 172.21.15.156:0/849328697 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f326406c3b0 con 0x7f3264130eb0 2023-09-30T22:25:59.737 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.736+0000 7f3252ffd700 1 -- 172.21.15.156:0/849328697 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f325c012340 con 0x7f3264130eb0 2023-09-30T22:25:59.737 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:25:59.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.738+0000 7f3268a09700 1 -- 172.21.15.156:0/849328697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3264130eb0 msgr2=0x7f326411ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.738+0000 7f3268a09700 1 --2- 172.21.15.156:0/849328697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3264130eb0 0x7f326411ac30 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f325c00efc0 tx=0x7f325c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.738+0000 7f3268a09700 1 -- 172.21.15.156:0/849328697 shutdown_connections 2023-09-30T22:25:59.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.738+0000 7f3268a09700 1 --2- 172.21.15.156:0/849328697 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3264130eb0 0x7f326411ac30 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.738+0000 7f3268a09700 1 --2- 172.21.15.156:0/849328697 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f326409d860 0x7f326411a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.738+0000 7f3268a09700 1 --2- 172.21.15.156:0/849328697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f326409e170 0x7f326411a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.738+0000 7f3268a09700 1 -- 172.21.15.156:0/849328697 >> 172.21.15.156:0/849328697 conn(0x7f3264099c40 msgr2=0x7f32640721d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:59.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.739+0000 7f3268a09700 1 -- 172.21.15.156:0/849328697 shutdown_connections 2023-09-30T22:25:59.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.740+0000 7f3268a09700 1 -- 172.21.15.156:0/849328697 wait complete. 2023-09-30T22:25:59.752 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:25:59.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.768+0000 7f8debf56700 1 -- 172.21.15.156:0/1802875796 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8de404f2a0 con 0x7f8de409bc70 2023-09-30T22:25:59.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.769+0000 7f8dda7fc700 1 -- 172.21.15.156:0/1802875796 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8de0016030 con 0x7f8de409bc70 2023-09-30T22:25:59.770 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:25:59.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.771+0000 7f8debf56700 1 -- 172.21.15.156:0/1802875796 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8de409bc70 msgr2=0x7f8de411b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.771+0000 7f8debf56700 1 --2- 172.21.15.156:0/1802875796 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8de409bc70 0x7f8de411b620 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f8de0013000 tx=0x7f8de0004750 comp rx=0 tx=0).stop 2023-09-30T22:25:59.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.771+0000 7f8debf56700 1 -- 172.21.15.156:0/1802875796 shutdown_connections 2023-09-30T22:25:59.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.771+0000 7f8debf56700 1 --2- 172.21.15.156:0/1802875796 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f8de4131980 0x7f8de411c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.771+0000 7f8debf56700 1 --2- 172.21.15.156:0/1802875796 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8de409bc70 0x7f8de411b620 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.771+0000 7f8debf56700 1 --2- 172.21.15.156:0/1802875796 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8de409c790 0x7f8de411bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.771+0000 7f8debf56700 1 -- 172.21.15.156:0/1802875796 >> 172.21.15.156:0/1802875796 conn(0x7f8de40a2980 msgr2=0x7f8de41b8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:59.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.771+0000 7f8debf56700 1 -- 172.21.15.156:0/1802875796 shutdown_connections 2023-09-30T22:25:59.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.771+0000 7f8debf56700 1 -- 172.21.15.156:0/1802875796 wait complete. 2023-09-30T22:25:59.784 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:25:59.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.808+0000 7f338f9b6700 1 -- 172.21.15.156:0/387289673 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f338806c3b0 con 0x7f338809e170 2023-09-30T22:25:59.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.808+0000 7f337dffb700 1 -- 172.21.15.156:0/387289673 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3378017070 con 0x7f338809e170 2023-09-30T22:25:59.809 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:25:59.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.811+0000 7f338f9b6700 1 -- 172.21.15.156:0/387289673 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f338809e170 msgr2=0x7f338811e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.811+0000 7f338f9b6700 1 --2- 172.21.15.156:0/387289673 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f338809e170 0x7f338811e930 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f337800c4e0 tx=0x7f337800c8a0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.811+0000 7f338f9b6700 1 -- 172.21.15.156:0/387289673 shutdown_connections 2023-09-30T22:25:59.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.811+0000 7f338f9b6700 1 --2- 172.21.15.156:0/387289673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3388130eb0 0x7f338811ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.811+0000 7f338f9b6700 1 --2- 172.21.15.156:0/387289673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f338809d860 0x7f338811e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.811+0000 7f338f9b6700 1 --2- 172.21.15.156:0/387289673 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f338809e170 0x7f338811e930 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.811+0000 7f338f9b6700 1 -- 172.21.15.156:0/387289673 >> 172.21.15.156:0/387289673 conn(0x7f3388099c40 msgr2=0x7f33880a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:59.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.811+0000 7f338f9b6700 1 -- 172.21.15.156:0/387289673 shutdown_connections 2023-09-30T22:25:59.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:25:59.811+0000 7f338f9b6700 1 -- 172.21.15.156:0/387289673 wait complete. 2023-09-30T22:25:59.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:26:00.651 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:00.753 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:00.784 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:00.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.788+0000 7fef64161700 1 Processor -- start 2023-09-30T22:26:00.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.788+0000 7fef64161700 1 -- start start 2023-09-30T22:26:00.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.789+0000 7fef64161700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef5c098720 0x7fef5c1368b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.789+0000 7fef64161700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef5c136df0 0x7fef5c1391d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.789+0000 7fef64161700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5c098cb0 con 0x7fef5c131a20 2023-09-30T22:26:00.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.789+0000 7fef64161700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c132500 con 0x7fef5c098720 2023-09-30T22:26:00.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.789+0000 7fef64161700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c131630 con 0x7fef5c136df0 2023-09-30T22:26:00.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.789+0000 7fef61efd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fef5c131a20 0x7fef5c131df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38690/0 (socket says 172.21.15.156:38690) 2023-09-30T22:26:00.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.789+0000 7fef61efd700 1 -- 172.21.15.156:0/536171093 learned_addr learned my addr 172.21.15.156:0/536171093 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:26:00.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.789+0000 7fef626fe700 1 --2- 172.21.15.156:0/536171093 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef5c136df0 0x7fef5c1391d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.789+0000 7fef616fc700 1 --2- 172.21.15.156:0/536171093 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef5c098720 0x7fef5c1368b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.789+0000 7fef60efb700 1 -- 172.21.15.156:0/536171093 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231647490 0 0) 0x7fef5c098cb0 con 0x7fef5c131a20 2023-09-30T22:26:00.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.789+0000 7fef60efb700 1 -- 172.21.15.156:0/536171093 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef480035b0 con 0x7fef5c131a20 2023-09-30T22:26:00.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.789+0000 7fef626fe700 1 -- 172.21.15.156:0/536171093 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef5c098720 msgr2=0x7fef5c1368b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:00.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.789+0000 7fef626fe700 1 --2- 172.21.15.156:0/536171093 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef5c098720 0x7fef5c1368b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.789+0000 7fef626fe700 1 -- 172.21.15.156:0/536171093 >> v1:172.21.15.156:6789/0 conn(0x7fef5c131a20 legacy=0x7fef5c131df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.789+0000 7fef626fe700 1 -- 172.21.15.156:0/536171093 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c099d50 con 0x7fef5c136df0 2023-09-30T22:26:00.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.790+0000 7fef626fe700 1 --2- 172.21.15.156:0/536171093 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef5c136df0 0x7fef5c1391d0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fef54009dc0 tx=0x7fef5400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1874f1cae9bcabd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:00.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.790+0000 7fef60efb700 1 -- 172.21.15.156:0/536171093 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5400e070 con 0x7fef5c136df0 2023-09-30T22:26:00.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.790+0000 7fef60efb700 1 -- 172.21.15.156:0/536171093 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5400bb20 con 0x7fef5c136df0 2023-09-30T22:26:00.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.790+0000 7fef616fc700 1 --2- 172.21.15.156:0/536171093 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef5c098720 0x7fef5c1368b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:00.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.790+0000 7fef60efb700 1 -- 172.21.15.156:0/536171093 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54012430 con 0x7fef5c136df0 2023-09-30T22:26:00.793 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.791+0000 7fef64161700 1 -- 172.21.15.156:0/536171093 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef5c136df0 msgr2=0x7fef5c1391d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.791+0000 7fef64161700 1 --2- 172.21.15.156:0/536171093 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef5c136df0 0x7fef5c1391d0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fef54009dc0 tx=0x7fef5400b330 comp rx=0 tx=0).stop 2023-09-30T22:26:00.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.791+0000 7fef64161700 1 -- 172.21.15.156:0/536171093 shutdown_connections 2023-09-30T22:26:00.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.791+0000 7fef64161700 1 --2- 172.21.15.156:0/536171093 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef5c136df0 0x7fef5c1391d0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.791+0000 7fef64161700 1 --2- 172.21.15.156:0/536171093 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef5c098720 0x7fef5c1368b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.791+0000 7fef64161700 1 -- 172.21.15.156:0/536171093 >> 172.21.15.156:0/536171093 conn(0x7fef5c09eda0 msgr2=0x7fef5c09f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:00.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.791+0000 7fef64161700 1 -- 172.21.15.156:0/536171093 shutdown_connections 2023-09-30T22:26:00.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.791+0000 7fef64161700 1 -- 172.21.15.156:0/536171093 wait complete. 2023-09-30T22:26:00.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.792+0000 7fef64161700 1 Processor -- start 2023-09-30T22:26:00.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.792+0000 7fef64161700 1 -- start start 2023-09-30T22:26:00.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.793+0000 7fef64161700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef5c098720 0x7fef5c06fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.793+0000 7fef64161700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef5c131a20 0x7fef5c070180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.793+0000 7fef64161700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef5c136df0 0x7fef5c0706c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.797 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.793+0000 7fef64161700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c0723c0 con 0x7fef5c098720 2023-09-30T22:26:00.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.793+0000 7fef64161700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c071650 con 0x7fef5c131a20 2023-09-30T22:26:00.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.793+0000 7fef64161700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c0728f0 con 0x7fef5c136df0 2023-09-30T22:26:00.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.793+0000 7fef616fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef5c131a20 0x7fef5c070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.793+0000 7fef61efd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef5c098720 0x7fef5c06fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.793+0000 7fef61efd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef5c098720 0x7fef5c06fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50162/0 (socket says 172.21.15.156:50162) 2023-09-30T22:26:00.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.793+0000 7fef616fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef5c131a20 0x7fef5c070180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54610/0 (socket says 172.21.15.156:54610) 2023-09-30T22:26:00.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.793+0000 7fef61efd700 1 -- 172.21.15.156:0/1771760744 learned_addr learned my addr 172.21.15.156:0/1771760744 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:26:00.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.793+0000 7fef626fe700 1 --2- 172.21.15.156:0/1771760744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef5c136df0 0x7fef5c0706c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.798 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.793+0000 7fef61efd700 1 -- 172.21.15.156:0/1771760744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef5c136df0 msgr2=0x7fef5c0706c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.793+0000 7fef61efd700 1 --2- 172.21.15.156:0/1771760744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef5c136df0 0x7fef5c0706c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.793+0000 7fef61efd700 1 -- 172.21.15.156:0/1771760744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef5c131a20 msgr2=0x7fef5c070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.793+0000 7fef61efd700 1 --2- 172.21.15.156:0/1771760744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef5c131a20 0x7fef5c070180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.793+0000 7fef61efd700 1 -- 172.21.15.156:0/1771760744 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4c0094a0 con 0x7fef5c098720 2023-09-30T22:26:00.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.793+0000 7fef616fc700 1 --2- 172.21.15.156:0/1771760744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef5c131a20 0x7fef5c070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:00.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.793+0000 7fef61efd700 1 --2- 172.21.15.156:0/1771760744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef5c098720 0x7fef5c06fc40 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7fef5800c730 tx=0x7fef5800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:00.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.794+0000 7fef527fc700 1 -- 172.21.15.156:0/1771760744 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef58005d70 con 0x7fef5c098720 2023-09-30T22:26:00.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.794+0000 7fef527fc700 1 -- 172.21.15.156:0/1771760744 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef580070d0 con 0x7fef5c098720 2023-09-30T22:26:00.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.794+0000 7fef64161700 1 -- 172.21.15.156:0/1771760744 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef54009a70 con 0x7fef5c098720 2023-09-30T22:26:00.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.794+0000 7fef527fc700 1 -- 172.21.15.156:0/1771760744 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef58007440 con 0x7fef5c098720 2023-09-30T22:26:00.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.794+0000 7fef64161700 1 -- 172.21.15.156:0/1771760744 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5c1279c0 con 0x7fef5c098720 2023-09-30T22:26:00.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.795+0000 7fef64161700 1 -- 172.21.15.156:0/1771760744 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5c1382e0 con 0x7fef5c098720 2023-09-30T22:26:00.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.795+0000 7fef527fc700 1 -- 172.21.15.156:0/1771760744 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef580075a0 con 0x7fef5c098720 2023-09-30T22:26:00.800 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.795+0000 7fef527fc700 1 -- 172.21.15.156:0/1771760744 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fef5803eb20 con 0x7fef5c098720 2023-09-30T22:26:00.801 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.801+0000 7fef527fc700 1 -- 172.21.15.156:0/1771760744 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef58019b40 con 0x7fef5c098720 2023-09-30T22:26:00.824 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:00.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.899+0000 7f41d5897700 1 Processor -- start 2023-09-30T22:26:00.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.899+0000 7f41d5897700 1 -- start start 2023-09-30T22:26:00.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.900+0000 7f41d5897700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41d009ef80 0x7f41d0138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.900+0000 7f41d5897700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f41d009f370 0x7f41d013b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.900+0000 7f41d5897700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d009af80 con 0x7f41d009a150 2023-09-30T22:26:00.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.900+0000 7f41d5897700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d009fe00 con 0x7f41d009f370 2023-09-30T22:26:00.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.900+0000 7f41d5897700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41d006bec0 con 0x7f41d009ef80 2023-09-30T22:26:00.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.900+0000 7f41ceffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f41d009a150 0x7f41d009e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38704/0 (socket says 172.21.15.156:38704) 2023-09-30T22:26:00.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.900+0000 7f41ceffd700 1 -- 172.21.15.156:0/3008442034 learned_addr learned my addr 172.21.15.156:0/3008442034 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:26:00.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.900+0000 7f41ce7fc700 1 --2- 172.21.15.156:0/3008442034 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41d009ef80 0x7f41d0138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.900+0000 7f41cf7fe700 1 --2- 172.21.15.156:0/3008442034 >> v2:172.21.15.156:3300/0 conn(0x7f41d009f370 0x7f41d013b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.901+0000 7f41ce7fc700 1 -- 172.21.15.156:0/3008442034 >> v2:172.21.15.156:3300/0 conn(0x7f41d009f370 msgr2=0x7f41d013b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:00.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.901+0000 7f41ce7fc700 1 --2- 172.21.15.156:0/3008442034 >> v2:172.21.15.156:3300/0 conn(0x7f41d009f370 0x7f41d013b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.901+0000 7f41ce7fc700 1 -- 172.21.15.156:0/3008442034 >> v1:172.21.15.156:6789/0 conn(0x7f41d009a150 legacy=0x7f41d009e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.901+0000 7f41ce7fc700 1 -- 172.21.15.156:0/3008442034 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d006bc20 con 0x7f41d009ef80 2023-09-30T22:26:00.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.901+0000 7f41cdffb700 1 -- 172.21.15.156:0/3008442034 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1376231472 0 0) 0x7f41d009af80 con 0x7f41d009a150 2023-09-30T22:26:00.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.901+0000 7f41ce7fc700 1 --2- 172.21.15.156:0/3008442034 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41d009ef80 0x7f41d0138e60 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009840 tx=0x7f41c4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90d83b7204eee512 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:00.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.901+0000 7f41cdffb700 1 -- 172.21.15.156:0/3008442034 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c4011830 con 0x7f41d009ef80 2023-09-30T22:26:00.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.901+0000 7f41cdffb700 1 -- 172.21.15.156:0/3008442034 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c4011990 con 0x7f41d009ef80 2023-09-30T22:26:00.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.901+0000 7f41cdffb700 1 -- 172.21.15.156:0/3008442034 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c4011d20 con 0x7f41d009ef80 2023-09-30T22:26:00.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.902+0000 7f41d5897700 1 -- 172.21.15.156:0/3008442034 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41d009ef80 msgr2=0x7f41d0138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.902+0000 7f41d5897700 1 --2- 172.21.15.156:0/3008442034 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41d009ef80 0x7f41d0138e60 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009840 tx=0x7f41c4009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:00.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.902+0000 7f41d5897700 1 -- 172.21.15.156:0/3008442034 shutdown_connections 2023-09-30T22:26:00.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.902+0000 7f41d5897700 1 --2- 172.21.15.156:0/3008442034 >> v2:172.21.15.156:3300/0 conn(0x7f41d009f370 0x7f41d013b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.902+0000 7f41d5897700 1 --2- 172.21.15.156:0/3008442034 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41d009ef80 0x7f41d0138e60 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.902+0000 7f41d5897700 1 -- 172.21.15.156:0/3008442034 >> 172.21.15.156:0/3008442034 conn(0x7f41d00a4430 msgr2=0x7f41d00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:00.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.902+0000 7f41d5897700 1 -- 172.21.15.156:0/3008442034 shutdown_connections 2023-09-30T22:26:00.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.902+0000 7f41d5897700 1 -- 172.21.15.156:0/3008442034 wait complete. 2023-09-30T22:26:00.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.904+0000 7f41d5897700 1 Processor -- start 2023-09-30T22:26:00.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.904+0000 7f41d5897700 1 -- start start 2023-09-30T22:26:00.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.904+0000 7f41d5897700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41d009a150 0x7f41d0139580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.904+0000 7f41d5897700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41d009ef80 0x7f41d0139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.904+0000 7f41d5897700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41d009f370 0x7f41d013a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.904+0000 7f41d5897700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d01201b0 con 0x7f41d009ef80 2023-09-30T22:26:00.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.905+0000 7f41d5897700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d009b720 con 0x7f41d009f370 2023-09-30T22:26:00.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.905+0000 7f41d5897700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41d00a0440 con 0x7f41d009a150 2023-09-30T22:26:00.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.905+0000 7f41cf7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41d009f370 0x7f41d013a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.905+0000 7f41cf7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41d009f370 0x7f41d013a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54626/0 (socket says 172.21.15.156:54626) 2023-09-30T22:26:00.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.905+0000 7f41ce7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41d009ef80 0x7f41d0139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.905+0000 7f41cf7fe700 1 -- 172.21.15.156:0/2874164718 learned_addr learned my addr 172.21.15.156:0/2874164718 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:26:00.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.905+0000 7f41ceffd700 1 --2- 172.21.15.156:0/2874164718 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41d009a150 0x7f41d0139580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.905+0000 7f41cf7fe700 1 -- 172.21.15.156:0/2874164718 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41d009a150 msgr2=0x7f41d0139580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.905+0000 7f41cf7fe700 1 --2- 172.21.15.156:0/2874164718 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41d009a150 0x7f41d0139580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.905+0000 7f41cf7fe700 1 -- 172.21.15.156:0/2874164718 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41d009ef80 msgr2=0x7f41d0139ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.905+0000 7f41cf7fe700 1 --2- 172.21.15.156:0/2874164718 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41d009ef80 0x7f41d0139ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.905+0000 7f41cf7fe700 1 -- 172.21.15.156:0/2874164718 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c40094a0 con 0x7f41d009f370 2023-09-30T22:26:00.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.905+0000 7f41cf7fe700 1 --2- 172.21.15.156:0/2874164718 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41d009f370 0x7f41d013a000 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f41c800efc0 tx=0x7f41c800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:00.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.906+0000 7f41b7fff700 1 -- 172.21.15.156:0/2874164718 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c8009ea0 con 0x7f41d009f370 2023-09-30T22:26:00.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.906+0000 7f41b7fff700 1 -- 172.21.15.156:0/2874164718 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c800f040 con 0x7f41d009f370 2023-09-30T22:26:00.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.906+0000 7f41d5897700 1 -- 172.21.15.156:0/2874164718 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d011f940 con 0x7f41d009f370 2023-09-30T22:26:00.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.906+0000 7f41b7fff700 1 -- 172.21.15.156:0/2874164718 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c800ced0 con 0x7f41d009f370 2023-09-30T22:26:00.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.906+0000 7f41d5897700 1 -- 172.21.15.156:0/2874164718 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d011f4f0 con 0x7f41d009f370 2023-09-30T22:26:00.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.907+0000 7f41b7fff700 1 -- 172.21.15.156:0/2874164718 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f41c8014480 con 0x7f41d009f370 2023-09-30T22:26:00.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.907+0000 7f41b7fff700 1 -- 172.21.15.156:0/2874164718 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f41c803fe90 con 0x7f41d009f370 2023-09-30T22:26:00.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.908+0000 7f41d5897700 1 -- 172.21.15.156:0/2874164718 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41d009fa30 con 0x7f41d009f370 2023-09-30T22:26:00.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.916+0000 7f41b7fff700 1 -- 172.21.15.156:0/2874164718 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f41c806b750 con 0x7f41d009f370 2023-09-30T22:26:00.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.945+0000 7f5b03367700 1 Processor -- start 2023-09-30T22:26:00.946 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.945+0000 7f5b03367700 1 -- start start 2023-09-30T22:26:00.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.946+0000 7f5b03367700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5afc09ef80 0x7f5afc138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.946+0000 7f5b03367700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5afc09f370 0x7f5afc13b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.946+0000 7f5b03367700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5afc09af80 con 0x7f5afc09a150 2023-09-30T22:26:00.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.946+0000 7f5b03367700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc09a520 con 0x7f5afc09ef80 2023-09-30T22:26:00.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.946+0000 7f5b03367700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc09fe00 con 0x7f5afc09f370 2023-09-30T22:26:00.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.946+0000 7f5b00902700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5afc09ef80 0x7f5afc138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.946+0000 7f5b01103700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f5afc09a150 0x7f5afc09e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:38720/0 (socket says 172.21.15.156:38720) 2023-09-30T22:26:00.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.946+0000 7f5b01103700 1 -- 172.21.15.156:0/1046847743 learned_addr learned my addr 172.21.15.156:0/1046847743 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:26:00.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.946+0000 7f5b01904700 1 --2- 172.21.15.156:0/1046847743 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5afc09f370 0x7f5afc13b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.947+0000 7f5af3fff700 1 -- 172.21.15.156:0/1046847743 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 629609114 0 0) 0x7f5afc09af80 con 0x7f5afc09a150 2023-09-30T22:26:00.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.947+0000 7f5b00902700 1 -- 172.21.15.156:0/1046847743 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5afc09f370 msgr2=0x7f5afc13b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:00.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.947+0000 7f5b00902700 1 --2- 172.21.15.156:0/1046847743 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5afc09f370 0x7f5afc13b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.947+0000 7f5b00902700 1 -- 172.21.15.156:0/1046847743 >> v1:172.21.15.156:6789/0 conn(0x7f5afc09a150 legacy=0x7f5afc09e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.947+0000 7f5b00902700 1 -- 172.21.15.156:0/1046847743 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc06bc20 con 0x7f5afc09ef80 2023-09-30T22:26:00.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.947+0000 7f5b00902700 1 --2- 172.21.15.156:0/1046847743 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5afc09ef80 0x7f5afc138e60 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f5aec009870 tx=0x7f5aec009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39171d70d4c01386 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:00.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.947+0000 7f5af3fff700 1 -- 172.21.15.156:0/1046847743 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec011830 con 0x7f5afc09ef80 2023-09-30T22:26:00.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.947+0000 7f5af3fff700 1 -- 172.21.15.156:0/1046847743 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec011990 con 0x7f5afc09ef80 2023-09-30T22:26:00.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.947+0000 7f5af3fff700 1 -- 172.21.15.156:0/1046847743 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec011d20 con 0x7f5afc09ef80 2023-09-30T22:26:00.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.948+0000 7f5b03367700 1 -- 172.21.15.156:0/1046847743 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5afc09ef80 msgr2=0x7f5afc138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.948+0000 7f5b03367700 1 --2- 172.21.15.156:0/1046847743 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5afc09ef80 0x7f5afc138e60 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f5aec009870 tx=0x7f5aec009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:00.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.948+0000 7f5b03367700 1 -- 172.21.15.156:0/1046847743 shutdown_connections 2023-09-30T22:26:00.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.948+0000 7f5b03367700 1 --2- 172.21.15.156:0/1046847743 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5afc09f370 0x7f5afc13b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.948+0000 7f5b03367700 1 --2- 172.21.15.156:0/1046847743 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5afc09ef80 0x7f5afc138e60 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.948+0000 7f5b03367700 1 -- 172.21.15.156:0/1046847743 >> 172.21.15.156:0/1046847743 conn(0x7f5afc0a4430 msgr2=0x7f5afc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:00.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.948+0000 7f5b03367700 1 -- 172.21.15.156:0/1046847743 shutdown_connections 2023-09-30T22:26:00.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.948+0000 7f5b03367700 1 -- 172.21.15.156:0/1046847743 wait complete. 2023-09-30T22:26:00.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.949+0000 7f5b03367700 1 Processor -- start 2023-09-30T22:26:00.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.949+0000 7f5b03367700 1 -- start start 2023-09-30T22:26:00.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.950+0000 7f5b03367700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5afc09a150 0x7f5afc1cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.950+0000 7f5b03367700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5afc09ef80 0x7f5afc1ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.950+0000 7f5b03367700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5afc09f370 0x7f5afc1cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.950+0000 7f5b03367700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc128bc0 con 0x7f5afc09f370 2023-09-30T22:26:00.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.950+0000 7f5b03367700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc11e630 con 0x7f5afc09ef80 2023-09-30T22:26:00.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.950+0000 7f5b03367700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc127540 con 0x7f5afc09a150 2023-09-30T22:26:00.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.950+0000 7f5b01103700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5afc09a150 0x7f5afc1cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.950+0000 7f5b01103700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5afc09a150 0x7f5afc1cc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43852/0 (socket says 172.21.15.156:43852) 2023-09-30T22:26:00.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.950+0000 7f5b01103700 1 -- 172.21.15.156:0/774450743 learned_addr learned my addr 172.21.15.156:0/774450743 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:26:00.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.950+0000 7f5b00902700 1 --2- 172.21.15.156:0/774450743 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5afc09ef80 0x7f5afc1ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.950+0000 7f5b01904700 1 --2- 172.21.15.156:0/774450743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5afc09f370 0x7f5afc1cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.950+0000 7f5b00902700 1 -- 172.21.15.156:0/774450743 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5afc09a150 msgr2=0x7f5afc1cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.950+0000 7f5b00902700 1 --2- 172.21.15.156:0/774450743 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5afc09a150 0x7f5afc1cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.950+0000 7f5b00902700 1 -- 172.21.15.156:0/774450743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5afc09f370 msgr2=0x7f5afc1cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.950+0000 7f5b00902700 1 --2- 172.21.15.156:0/774450743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5afc09f370 0x7f5afc1cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.950+0000 7f5b00902700 1 -- 172.21.15.156:0/774450743 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aec0094a0 con 0x7f5afc09ef80 2023-09-30T22:26:00.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.951+0000 7f5b00902700 1 --2- 172.21.15.156:0/774450743 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5afc09ef80 0x7f5afc1ccd90 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f5aec009870 tx=0x7f5aec004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:00.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.951+0000 7f5af1ffb700 1 -- 172.21.15.156:0/774450743 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec0043c0 con 0x7f5afc09ef80 2023-09-30T22:26:00.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.951+0000 7f5af1ffb700 1 -- 172.21.15.156:0/774450743 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec01f070 con 0x7f5afc09ef80 2023-09-30T22:26:00.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.951+0000 7f5b03367700 1 -- 172.21.15.156:0/774450743 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5afc09b990 con 0x7f5afc09ef80 2023-09-30T22:26:00.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.951+0000 7f5af1ffb700 1 -- 172.21.15.156:0/774450743 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec0036a0 con 0x7f5afc09ef80 2023-09-30T22:26:00.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.952+0000 7f5b03367700 1 -- 172.21.15.156:0/774450743 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5afc1295a0 con 0x7f5afc09ef80 2023-09-30T22:26:00.954 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.952+0000 7f5af1ffb700 1 -- 172.21.15.156:0/774450743 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5aec021030 con 0x7f5afc09ef80 2023-09-30T22:26:00.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.953+0000 7f5af1ffb700 1 -- 172.21.15.156:0/774450743 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5aec0407d0 con 0x7f5afc09ef80 2023-09-30T22:26:00.955 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.953+0000 7f5b03367700 1 -- 172.21.15.156:0/774450743 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5afc09fa30 con 0x7f5afc09ef80 2023-09-30T22:26:00.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.960+0000 7f3605e84700 1 Processor -- start 2023-09-30T22:26:00.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.960+0000 7f3605e84700 1 -- start start 2023-09-30T22:26:00.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.961+0000 7f3605e84700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f360009e870 0x7f360009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.961+0000 7f3605e84700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f360009f180 0x7f3600131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.961+0000 7f3605e84700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f360009c970 con 0x7f3600131d70 2023-09-30T22:26:00.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.961+0000 7f3605e84700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36000a0920 con 0x7f360009f180 2023-09-30T22:26:00.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.961+0000 7f3605e84700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f360009f9c0 con 0x7f360009e870 2023-09-30T22:26:00.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.961+0000 7f35ff7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f360009e870 0x7f360009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.961+0000 7f35ff7fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f360009e870 0x7f360009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:43856/0 (socket says 172.21.15.156:43856) 2023-09-30T22:26:00.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.961+0000 7f35ff7fe700 1 -- 172.21.15.156:0/371639707 learned_addr learned my addr 172.21.15.156:0/371639707 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:26:00.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.961+0000 7f35feffd700 1 --2- 172.21.15.156:0/371639707 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f360009f180 0x7f3600131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.962+0000 7f35feffd700 1 -- 172.21.15.156:0/371639707 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f360009e870 msgr2=0x7f360009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:00.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.962+0000 7f35feffd700 1 --2- 172.21.15.156:0/371639707 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f360009e870 0x7f360009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.962+0000 7f35feffd700 1 -- 172.21.15.156:0/371639707 >> v1:172.21.15.156:6789/0 conn(0x7f3600131d70 legacy=0x7f3600138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.962+0000 7f35feffd700 1 -- 172.21.15.156:0/371639707 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360009bab0 con 0x7f360009f180 2023-09-30T22:26:00.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.962+0000 7f35feffd700 1 --2- 172.21.15.156:0/371639707 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f360009f180 0x7f3600131830 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009870 tx=0x7f35f4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6faaf7b6442fb90b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:00.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.962+0000 7f5af1ffb700 1 -- 172.21.15.156:0/774450743 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5aec015080 con 0x7f5afc09ef80 2023-09-30T22:26:00.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.962+0000 7f35fe7fc700 1 -- 172.21.15.156:0/371639707 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4010a90 con 0x7f360009f180 2023-09-30T22:26:00.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.963+0000 7f35fe7fc700 1 -- 172.21.15.156:0/371639707 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f4010bf0 con 0x7f360009f180 2023-09-30T22:26:00.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.963+0000 7f35fe7fc700 1 -- 172.21.15.156:0/371639707 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4018440 con 0x7f360009f180 2023-09-30T22:26:00.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.963+0000 7f3605e84700 1 -- 172.21.15.156:0/371639707 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f360009f180 msgr2=0x7f3600131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.963+0000 7f3605e84700 1 --2- 172.21.15.156:0/371639707 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f360009f180 0x7f3600131830 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009870 tx=0x7f35f4009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:00.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.963+0000 7f3605e84700 1 -- 172.21.15.156:0/371639707 shutdown_connections 2023-09-30T22:26:00.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.963+0000 7f3605e84700 1 --2- 172.21.15.156:0/371639707 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f360009e870 0x7f360009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.963+0000 7f3605e84700 1 --2- 172.21.15.156:0/371639707 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f360009f180 0x7f3600131830 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.963+0000 7f3605e84700 1 -- 172.21.15.156:0/371639707 >> 172.21.15.156:0/371639707 conn(0x7f36000a4430 msgr2=0x7f36000a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:00.965 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.963+0000 7f3605e84700 1 -- 172.21.15.156:0/371639707 shutdown_connections 2023-09-30T22:26:00.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.963+0000 7f3605e84700 1 -- 172.21.15.156:0/371639707 wait complete. 2023-09-30T22:26:00.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.964+0000 7f3605e84700 1 Processor -- start 2023-09-30T22:26:00.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.964+0000 7f3605e84700 1 -- start start 2023-09-30T22:26:00.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.965+0000 7f3605e84700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f360009e870 0x7f360011bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.965+0000 7f3605e84700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f360009f180 0x7f360011c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.965+0000 7f3605e84700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3600131d70 0x7f360011ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.965+0000 7f3605e84700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360011e120 con 0x7f360009f180 2023-09-30T22:26:00.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.965+0000 7f3605e84700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360011f1e0 con 0x7f3600131d70 2023-09-30T22:26:00.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.965+0000 7f3605e84700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f360009dba0 con 0x7f360009e870 2023-09-30T22:26:00.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.965+0000 7f35fffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3600131d70 0x7f360011ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.965+0000 7f35fffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3600131d70 0x7f360011ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:54668/0 (socket says 172.21.15.156:54668) 2023-09-30T22:26:00.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.965+0000 7f35fffff700 1 -- 172.21.15.156:0/4278108528 learned_addr learned my addr 172.21.15.156:0/4278108528 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:26:00.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.966+0000 7f35fffff700 1 -- 172.21.15.156:0/4278108528 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f360009e870 msgr2=0x7f360011bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.966+0000 7f35fffff700 1 --2- 172.21.15.156:0/4278108528 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f360009e870 0x7f360011bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.966+0000 7f35fffff700 1 -- 172.21.15.156:0/4278108528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f360009f180 msgr2=0x7f360011c4c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:26:00.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.966+0000 7f35fffff700 1 --2- 172.21.15.156:0/4278108528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f360009f180 0x7f360011c4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.966+0000 7f35fffff700 1 -- 172.21.15.156:0/4278108528 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f40094a0 con 0x7f3600131d70 2023-09-30T22:26:00.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.966+0000 7f35fffff700 1 --2- 172.21.15.156:0/4278108528 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3600131d70 0x7f360011ca00 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f35f800cc50 tx=0x7f35f800a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:00.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.966+0000 7f35e7fff700 1 -- 172.21.15.156:0/4278108528 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f800ad80 con 0x7f3600131d70 2023-09-30T22:26:00.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.966+0000 7f35e7fff700 1 -- 172.21.15.156:0/4278108528 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f800ce50 con 0x7f3600131d70 2023-09-30T22:26:00.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.966+0000 7f3605e84700 1 -- 172.21.15.156:0/4278108528 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36000a2ca0 con 0x7f3600131d70 2023-09-30T22:26:00.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.966+0000 7f35e7fff700 1 -- 172.21.15.156:0/4278108528 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f8003c40 con 0x7f3600131d70 2023-09-30T22:26:00.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.966+0000 7f3605e84700 1 -- 172.21.15.156:0/4278108528 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f360011ed90 con 0x7f3600131d70 2023-09-30T22:26:00.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.967+0000 7f3605e84700 1 -- 172.21.15.156:0/4278108528 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f360004f2a0 con 0x7f3600131d70 2023-09-30T22:26:00.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.968+0000 7f35e7fff700 1 -- 172.21.15.156:0/4278108528 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f35f80050d0 con 0x7f3600131d70 2023-09-30T22:26:00.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.968+0000 7f35e7fff700 1 -- 172.21.15.156:0/4278108528 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f35f8040410 con 0x7f3600131d70 2023-09-30T22:26:00.977 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:00.976+0000 7f35e7fff700 1 -- 172.21.15.156:0/4278108528 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f35f8003da0 con 0x7f3600131d70 2023-09-30T22:26:01.043 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.042+0000 7fef64161700 1 -- 172.21.15.156:0/1771760744 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fef5c04f2a0 con 0x7fef5c098720 2023-09-30T22:26:01.044 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.043+0000 7fef527fc700 1 -- 172.21.15.156:0/1771760744 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef58017030 con 0x7fef5c098720 2023-09-30T22:26:01.044 INFO:teuthology.orchestra.run.smithi156.stdout:124554051586 2023-09-30T22:26:01.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.045+0000 7fef64161700 1 -- 172.21.15.156:0/1771760744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef5c098720 msgr2=0x7fef5c06fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:01.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.045+0000 7fef64161700 1 --2- 172.21.15.156:0/1771760744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef5c098720 0x7fef5c06fc40 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7fef5800c730 tx=0x7fef5800ca40 comp rx=0 tx=0).stop 2023-09-30T22:26:01.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.045+0000 7fef64161700 1 -- 172.21.15.156:0/1771760744 shutdown_connections 2023-09-30T22:26:01.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.045+0000 7fef64161700 1 --2- 172.21.15.156:0/1771760744 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fef5c136df0 0x7fef5c0706c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:01.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.045+0000 7fef64161700 1 --2- 172.21.15.156:0/1771760744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef5c098720 0x7fef5c06fc40 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:01.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.045+0000 7fef64161700 1 --2- 172.21.15.156:0/1771760744 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fef5c131a20 0x7fef5c070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:01.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.045+0000 7fef64161700 1 -- 172.21.15.156:0/1771760744 >> 172.21.15.156:0/1771760744 conn(0x7fef5c09eda0 msgr2=0x7fef5c130390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:01.046 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.046+0000 7fef64161700 1 -- 172.21.15.156:0/1771760744 shutdown_connections 2023-09-30T22:26:01.048 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.048+0000 7fef64161700 1 -- 172.21.15.156:0/1771760744 wait complete. 2023-09-30T22:26:01.066 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.1 2023-09-30T22:26:01.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.130+0000 7f41d5897700 1 -- 172.21.15.156:0/2874164718 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f41d011fb70 con 0x7f41d009f370 2023-09-30T22:26:01.131 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.131+0000 7f41b7fff700 1 -- 172.21.15.156:0/2874164718 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f41d011fb70 con 0x7f41d009f370 2023-09-30T22:26:01.131 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:26:01.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.133+0000 7f41d5897700 1 -- 172.21.15.156:0/2874164718 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41d009f370 msgr2=0x7f41d013a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:01.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.133+0000 7f41d5897700 1 --2- 172.21.15.156:0/2874164718 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41d009f370 0x7f41d013a000 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f41c800efc0 tx=0x7f41c800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:26:01.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.133+0000 7f41d5897700 1 -- 172.21.15.156:0/2874164718 shutdown_connections 2023-09-30T22:26:01.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.133+0000 7f41d5897700 1 --2- 172.21.15.156:0/2874164718 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f41d009f370 0x7f41d013a000 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:01.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.133+0000 7f41d5897700 1 --2- 172.21.15.156:0/2874164718 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f41d009a150 0x7f41d0139580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:01.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.133+0000 7f41d5897700 1 --2- 172.21.15.156:0/2874164718 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41d009ef80 0x7f41d0139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:01.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.133+0000 7f41d5897700 1 -- 172.21.15.156:0/2874164718 >> 172.21.15.156:0/2874164718 conn(0x7f41d00a4430 msgr2=0x7f41d009d100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:01.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.133+0000 7f41d5897700 1 -- 172.21.15.156:0/2874164718 shutdown_connections 2023-09-30T22:26:01.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.133+0000 7f41d5897700 1 -- 172.21.15.156:0/2874164718 wait complete. 2023-09-30T22:26:01.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:26:01.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.178+0000 7f3605e84700 1 -- 172.21.15.156:0/4278108528 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f360006b2a0 con 0x7f3600131d70 2023-09-30T22:26:01.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.179+0000 7f35e7fff700 1 -- 172.21.15.156:0/4278108528 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f35f8029090 con 0x7f3600131d70 2023-09-30T22:26:01.180 INFO:teuthology.orchestra.run.smithi156.stdout:133143986178 2023-09-30T22:26:01.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.182+0000 7f3605e84700 1 -- 172.21.15.156:0/4278108528 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3600131d70 msgr2=0x7f360011ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:01.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.182+0000 7f3605e84700 1 --2- 172.21.15.156:0/4278108528 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3600131d70 0x7f360011ca00 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f35f800cc50 tx=0x7f35f800a340 comp rx=0 tx=0).stop 2023-09-30T22:26:01.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.182+0000 7f3605e84700 1 -- 172.21.15.156:0/4278108528 shutdown_connections 2023-09-30T22:26:01.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.182+0000 7f3605e84700 1 --2- 172.21.15.156:0/4278108528 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3600131d70 0x7f360011ca00 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:01.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.182+0000 7f3605e84700 1 --2- 172.21.15.156:0/4278108528 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f360009e870 0x7f360011bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:01.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.182+0000 7f3605e84700 1 --2- 172.21.15.156:0/4278108528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f360009f180 0x7f360011c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:01.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.182+0000 7f3605e84700 1 -- 172.21.15.156:0/4278108528 >> 172.21.15.156:0/4278108528 conn(0x7f36000a4430 msgr2=0x7f3600130f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:01.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.182+0000 7f3605e84700 1 -- 172.21.15.156:0/4278108528 shutdown_connections 2023-09-30T22:26:01.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.182+0000 7f3605e84700 1 -- 172.21.15.156:0/4278108528 wait complete. 2023-09-30T22:26:01.192 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.192+0000 7f5b03367700 1 -- 172.21.15.156:0/774450743 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5afc04f2a0 con 0x7f5afc09ef80 2023-09-30T22:26:01.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.192+0000 7f5af1ffb700 1 -- 172.21.15.156:0/774450743 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5aec0239c0 con 0x7f5afc09ef80 2023-09-30T22:26:01.193 INFO:teuthology.orchestra.run.smithi156.stdout:128849018882 2023-09-30T22:26:01.195 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.3 2023-09-30T22:26:01.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.194+0000 7f5b03367700 1 -- 172.21.15.156:0/774450743 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5afc09ef80 msgr2=0x7f5afc1ccd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:01.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.194+0000 7f5b03367700 1 --2- 172.21.15.156:0/774450743 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5afc09ef80 0x7f5afc1ccd90 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f5aec009870 tx=0x7f5aec004750 comp rx=0 tx=0).stop 2023-09-30T22:26:01.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.194+0000 7f5b03367700 1 -- 172.21.15.156:0/774450743 shutdown_connections 2023-09-30T22:26:01.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.194+0000 7f5b03367700 1 --2- 172.21.15.156:0/774450743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5afc09f370 0x7f5afc1cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:01.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.194+0000 7f5b03367700 1 --2- 172.21.15.156:0/774450743 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f5afc09a150 0x7f5afc1cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:01.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.194+0000 7f5b03367700 1 --2- 172.21.15.156:0/774450743 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f5afc09ef80 0x7f5afc1ccd90 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:01.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.194+0000 7f5b03367700 1 -- 172.21.15.156:0/774450743 >> 172.21.15.156:0/774450743 conn(0x7f5afc0a4430 msgr2=0x7f5afc09c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:01.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.194+0000 7f5b03367700 1 -- 172.21.15.156:0/774450743 shutdown_connections 2023-09-30T22:26:01.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:01.194+0000 7f5b03367700 1 -- 172.21.15.156:0/774450743 wait complete. 2023-09-30T22:26:01.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.2 2023-09-30T22:26:02.066 INFO:tasks.ceph:ignoring flush pg stats error, probably testing upgrade: timed out waiting for mon to be updated with osd.1: 124554051586 < 124554051588 2023-09-30T22:26:02.067 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-30T22:26:02.067 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:26:02.147 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:02.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.198+0000 7f25d77a2700 1 Processor -- start 2023-09-30T22:26:02.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.198+0000 7f25d77a2700 1 -- start start 2023-09-30T22:26:02.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.198+0000 7f25d77a2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25d00a0a70 0x7f25d00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.199+0000 7f25d77a2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f25d00a1380 0x7f25d0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.199+0000 7f25d77a2700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d009dc00 con 0x7f25d0133f50 2023-09-30T22:26:02.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.199+0000 7f25d77a2700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d009ea60 con 0x7f25d00a1380 2023-09-30T22:26:02.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.199+0000 7f25d77a2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d009dec0 con 0x7f25d00a0a70 2023-09-30T22:26:02.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.199+0000 7f25d553e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25d00a0a70 0x7f25d00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.199+0000 7f25d4d3d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f25d00a1380 0x7f25d0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.199+0000 7f25d553e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25d00a0a70 0x7f25d00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:58296/0 (socket says 172.21.15.156:58296) 2023-09-30T22:26:02.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.199+0000 7f25d553e700 1 -- 172.21.15.156:0/1781341299 learned_addr learned my addr 172.21.15.156:0/1781341299 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:26:02.202 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.199+0000 7f25d553e700 1 -- 172.21.15.156:0/1781341299 >> v2:172.21.15.156:3300/0 conn(0x7f25d00a1380 msgr2=0x7f25d0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.199+0000 7f25d553e700 1 --2- 172.21.15.156:0/1781341299 >> v2:172.21.15.156:3300/0 conn(0x7f25d00a1380 0x7f25d0133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.199+0000 7f25d553e700 1 -- 172.21.15.156:0/1781341299 >> v1:172.21.15.156:6789/0 conn(0x7f25d0133f50 legacy=0x7f25d013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.199+0000 7f25c7fff700 1 -- 172.21.15.156:0/1781341299 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2907195090 0 0) 0x7f25d009dc00 con 0x7f25d0133f50 2023-09-30T22:26:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.199+0000 7f25d553e700 1 -- 172.21.15.156:0/1781341299 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d009e6a0 con 0x7f25d00a0a70 2023-09-30T22:26:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.199+0000 7f25d4d3d700 1 --2- 172.21.15.156:0/1781341299 >> v2:172.21.15.156:3300/0 conn(0x7f25d00a1380 0x7f25d0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.199+0000 7f25d553e700 1 --2- 172.21.15.156:0/1781341299 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25d00a0a70 0x7f25d00a0e40 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0098f0 tx=0x7f25cc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8cfb033933603bc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.199+0000 7f25c7fff700 1 -- 172.21.15.156:0/1781341299 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc011830 con 0x7f25d00a0a70 2023-09-30T22:26:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.199+0000 7f25c7fff700 1 -- 172.21.15.156:0/1781341299 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25cc011990 con 0x7f25d00a0a70 2023-09-30T22:26:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.199+0000 7f25c7fff700 1 -- 172.21.15.156:0/1781341299 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc011d20 con 0x7f25d00a0a70 2023-09-30T22:26:02.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.200+0000 7f25d77a2700 1 -- 172.21.15.156:0/1781341299 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25d00a0a70 msgr2=0x7f25d00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.200+0000 7f25d77a2700 1 --2- 172.21.15.156:0/1781341299 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25d00a0a70 0x7f25d00a0e40 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0098f0 tx=0x7f25cc009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.200+0000 7f25d77a2700 1 -- 172.21.15.156:0/1781341299 shutdown_connections 2023-09-30T22:26:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.200+0000 7f25d77a2700 1 --2- 172.21.15.156:0/1781341299 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25d00a0a70 0x7f25d00a0e40 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.200+0000 7f25d77a2700 1 --2- 172.21.15.156:0/1781341299 >> v2:172.21.15.156:3300/0 conn(0x7f25d00a1380 0x7f25d0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.200+0000 7f25d77a2700 1 -- 172.21.15.156:0/1781341299 >> 172.21.15.156:0/1781341299 conn(0x7f25d00a6610 msgr2=0x7f25d00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.200+0000 7f25d77a2700 1 -- 172.21.15.156:0/1781341299 shutdown_connections 2023-09-30T22:26:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.200+0000 7f25d77a2700 1 -- 172.21.15.156:0/1781341299 wait complete. 2023-09-30T22:26:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.201+0000 7f25d77a2700 1 Processor -- start 2023-09-30T22:26:02.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.201+0000 7f25d77a2700 1 -- start start 2023-09-30T22:26:02.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.201+0000 7f25d77a2700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25d00a0a70 0x7f25d01228b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.201+0000 7f25d77a2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25d00a1380 0x7f25d0122df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.201+0000 7f25d77a2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25d0133f50 0x7f25d0123330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.201+0000 7f25d77a2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d0126060 con 0x7f25d00a1380 2023-09-30T22:26:02.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.201+0000 7f25d77a2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d0124540 con 0x7f25d0133f50 2023-09-30T22:26:02.208 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.201+0000 7f25d77a2700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25d0133aa0 con 0x7f25d00a0a70 2023-09-30T22:26:02.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.202+0000 7f25d4d3d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25d00a1380 0x7f25d0122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.202+0000 7f25d4d3d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25d00a1380 0x7f25d0122df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38278/0 (socket says 172.21.15.156:38278) 2023-09-30T22:26:02.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.202+0000 7f25d4d3d700 1 -- 172.21.15.156:0/3418234570 learned_addr learned my addr 172.21.15.156:0/3418234570 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:26:02.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.202+0000 7f25d553e700 1 --2- 172.21.15.156:0/3418234570 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25d00a0a70 0x7f25d01228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.202+0000 7f25d5d3f700 1 --2- 172.21.15.156:0/3418234570 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25d0133f50 0x7f25d0123330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.202+0000 7f25d4d3d700 1 -- 172.21.15.156:0/3418234570 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25d00a0a70 msgr2=0x7f25d01228b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.202+0000 7f25d4d3d700 1 --2- 172.21.15.156:0/3418234570 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f25d00a0a70 0x7f25d01228b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.202+0000 7f25d4d3d700 1 -- 172.21.15.156:0/3418234570 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25d0133f50 msgr2=0x7f25d0123330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.209 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.202+0000 7f25d4d3d700 1 --2- 172.21.15.156:0/3418234570 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f25d0133f50 0x7f25d0123330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.202+0000 7f25d4d3d700 1 -- 172.21.15.156:0/3418234570 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c00094a0 con 0x7f25d00a1380 2023-09-30T22:26:02.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.202+0000 7f25d4d3d700 1 --2- 172.21.15.156:0/3418234570 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25d00a1380 0x7f25d0122df0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f25c000ebb0 tx=0x7f25c000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:02.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.202+0000 7f25c5ffb700 1 -- 172.21.15.156:0/3418234570 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c000c850 con 0x7f25d00a1380 2023-09-30T22:26:02.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.202+0000 7f25c5ffb700 1 -- 172.21.15.156:0/3418234570 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c000c9b0 con 0x7f25d00a1380 2023-09-30T22:26:02.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.202+0000 7f25d77a2700 1 -- 172.21.15.156:0/3418234570 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25cc009550 con 0x7f25d00a1380 2023-09-30T22:26:02.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.202+0000 7f25c5ffb700 1 -- 172.21.15.156:0/3418234570 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c000cd40 con 0x7f25d00a1380 2023-09-30T22:26:02.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.202+0000 7f25d77a2700 1 -- 172.21.15.156:0/3418234570 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d0133340 con 0x7f25d00a1380 2023-09-30T22:26:02.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.203+0000 7f25c5ffb700 1 -- 172.21.15.156:0/3418234570 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25c0013470 con 0x7f25d00a1380 2023-09-30T22:26:02.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.203+0000 7f25c5ffb700 1 -- 172.21.15.156:0/3418234570 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f25c003fb60 con 0x7f25d00a1380 2023-09-30T22:26:02.210 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.203+0000 7f25d77a2700 1 -- 172.21.15.156:0/3418234570 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d0126b90 con 0x7f25d00a1380 2023-09-30T22:26:02.211 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.208+0000 7f25c5ffb700 1 -- 172.21.15.156:0/3418234570 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25c001b3b0 con 0x7f25d00a1380 2023-09-30T22:26:02.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.274+0000 7fce4d0ac700 1 Processor -- start 2023-09-30T22:26:02.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.274+0000 7fce4d0ac700 1 -- start start 2023-09-30T22:26:02.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.275+0000 7fce4d0ac700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce4809ad40 0x7fce48133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.275+0000 7fce4d0ac700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce48133f70 0x7fce481343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.275+0000 7fce4d0ac700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce4809b110 con 0x7fce480a0a70 2023-09-30T22:26:02.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.275+0000 7fce4d0ac700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce480a3b60 con 0x7fce48133f70 2023-09-30T22:26:02.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.275+0000 7fce4d0ac700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce481348e0 con 0x7fce4809ad40 2023-09-30T22:26:02.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.275+0000 7fce46d9d700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce4809ad40 0x7fce48133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.275+0000 7fce4759e700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fce480a0a70 0x7fce480a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:33490/0 (socket says 172.21.15.156:33490) 2023-09-30T22:26:02.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.275+0000 7fce4759e700 1 -- 172.21.15.156:0/3735709843 learned_addr learned my addr 172.21.15.156:0/3735709843 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:26:02.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.275+0000 7fce4659c700 1 --2- 172.21.15.156:0/3735709843 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce48133f70 0x7fce481343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.276+0000 7fce45d9b700 1 -- 172.21.15.156:0/3735709843 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937975699 0 0) 0x7fce4809b110 con 0x7fce480a0a70 2023-09-30T22:26:02.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.276+0000 7fce45d9b700 1 -- 172.21.15.156:0/3735709843 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce300035b0 con 0x7fce480a0a70 2023-09-30T22:26:02.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.276+0000 7fce4659c700 1 -- 172.21.15.156:0/3735709843 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce4809ad40 msgr2=0x7fce48133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:02.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.276+0000 7fce4659c700 1 --2- 172.21.15.156:0/3735709843 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce4809ad40 0x7fce48133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.276+0000 7fce4659c700 1 -- 172.21.15.156:0/3735709843 >> v1:172.21.15.156:6789/0 conn(0x7fce480a0a70 legacy=0x7fce480a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.276+0000 7fce4659c700 1 -- 172.21.15.156:0/3735709843 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce480a2fa0 con 0x7fce48133f70 2023-09-30T22:26:02.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.276+0000 7fce46d9d700 1 --2- 172.21.15.156:0/3735709843 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce4809ad40 0x7fce48133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:02.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.276+0000 7fce4659c700 1 --2- 172.21.15.156:0/3735709843 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce48133f70 0x7fce481343a0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fce3c009870 tx=0x7fce3c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83ab4cceb7d745a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:02.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.276+0000 7fce45d9b700 1 -- 172.21.15.156:0/3735709843 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c011830 con 0x7fce48133f70 2023-09-30T22:26:02.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.276+0000 7fce45d9b700 1 -- 172.21.15.156:0/3735709843 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3c011990 con 0x7fce48133f70 2023-09-30T22:26:02.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.276+0000 7fce45d9b700 1 -- 172.21.15.156:0/3735709843 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c011d20 con 0x7fce48133f70 2023-09-30T22:26:02.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.276+0000 7fce4d0ac700 1 -- 172.21.15.156:0/3735709843 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce48133f70 msgr2=0x7fce481343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.276+0000 7fce4d0ac700 1 --2- 172.21.15.156:0/3735709843 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce48133f70 0x7fce481343a0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fce3c009870 tx=0x7fce3c009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:02.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.276+0000 7fce4d0ac700 1 -- 172.21.15.156:0/3735709843 shutdown_connections 2023-09-30T22:26:02.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.276+0000 7fce4d0ac700 1 --2- 172.21.15.156:0/3735709843 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce4809ad40 0x7fce48133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.276+0000 7fce4d0ac700 1 --2- 172.21.15.156:0/3735709843 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce48133f70 0x7fce481343a0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.276+0000 7fce4d0ac700 1 -- 172.21.15.156:0/3735709843 >> 172.21.15.156:0/3735709843 conn(0x7fce48099c40 msgr2=0x7fce4806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:02.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.277+0000 7fce4d0ac700 1 -- 172.21.15.156:0/3735709843 shutdown_connections 2023-09-30T22:26:02.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.277+0000 7fce4d0ac700 1 -- 172.21.15.156:0/3735709843 wait complete. 2023-09-30T22:26:02.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.278+0000 7fce4d0ac700 1 Processor -- start 2023-09-30T22:26:02.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.278+0000 7fce4d0ac700 1 -- start start 2023-09-30T22:26:02.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.279+0000 7fce4d0ac700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce4809ad40 0x7fce4811f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.279+0000 7fce4d0ac700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce480a0a70 0x7fce4811fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.279+0000 7fce4d0ac700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce48133f70 0x7fce481c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.279+0000 7fce4d0ac700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce48121340 con 0x7fce4809ad40 2023-09-30T22:26:02.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.279+0000 7fce4d0ac700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce48122020 con 0x7fce480a0a70 2023-09-30T22:26:02.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.279+0000 7fce4d0ac700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce481333a0 con 0x7fce48133f70 2023-09-30T22:26:02.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.279+0000 7fce46d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce4809ad40 0x7fce4811f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.279+0000 7fce4759e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce48133f70 0x7fce481c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.279+0000 7fce46d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce4809ad40 0x7fce4811f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:38286/0 (socket says 172.21.15.156:38286) 2023-09-30T22:26:02.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.279+0000 7fce46d9d700 1 -- 172.21.15.156:0/3129929156 learned_addr learned my addr 172.21.15.156:0/3129929156 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:26:02.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.279+0000 7fce4659c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce480a0a70 0x7fce4811fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.283 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.279+0000 7fce4759e700 1 -- 172.21.15.156:0/3129929156 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce480a0a70 msgr2=0x7fce4811fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.279+0000 7fce4759e700 1 --2- 172.21.15.156:0/3129929156 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce480a0a70 0x7fce4811fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.279+0000 7fce4759e700 1 -- 172.21.15.156:0/3129929156 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce4809ad40 msgr2=0x7fce4811f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.279+0000 7fce4759e700 1 --2- 172.21.15.156:0/3129929156 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce4809ad40 0x7fce4811f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.279+0000 7fce4759e700 1 -- 172.21.15.156:0/3129929156 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce380094a0 con 0x7fce48133f70 2023-09-30T22:26:02.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.279+0000 7fce46d9d700 1 --2- 172.21.15.156:0/3129929156 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce4809ad40 0x7fce4811f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:02.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.279+0000 7fce4759e700 1 --2- 172.21.15.156:0/3129929156 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce48133f70 0x7fce481c8190 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fce4000cab0 tx=0x7fce4000cdc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:02.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.279+0000 7fce2f7fe700 1 -- 172.21.15.156:0/3129929156 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4000a9a0 con 0x7fce48133f70 2023-09-30T22:26:02.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.280+0000 7fce2f7fe700 1 -- 172.21.15.156:0/3129929156 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4000ab00 con 0x7fce48133f70 2023-09-30T22:26:02.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.280+0000 7fce4d0ac700 1 -- 172.21.15.156:0/3129929156 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce3c0094a0 con 0x7fce48133f70 2023-09-30T22:26:02.284 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.280+0000 7fce2f7fe700 1 -- 172.21.15.156:0/3129929156 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4000ae70 con 0x7fce48133f70 2023-09-30T22:26:02.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.280+0000 7fce4d0ac700 1 -- 172.21.15.156:0/3129929156 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce48120620 con 0x7fce48133f70 2023-09-30T22:26:02.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.280+0000 7fce2f7fe700 1 -- 172.21.15.156:0/3129929156 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fce4001b3b0 con 0x7fce48133f70 2023-09-30T22:26:02.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.280+0000 7fce2f7fe700 1 -- 172.21.15.156:0/3129929156 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fce4003f280 con 0x7fce48133f70 2023-09-30T22:26:02.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.281+0000 7fce4d0ac700 1 -- 172.21.15.156:0/3129929156 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce4804f2a0 con 0x7fce48133f70 2023-09-30T22:26:02.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.285+0000 7fce2f7fe700 1 -- 172.21.15.156:0/3129929156 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fce400192c0 con 0x7fce48133f70 2023-09-30T22:26:02.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.475+0000 7fce4d0ac700 1 -- 172.21.15.156:0/3129929156 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fce48120b90 con 0x7fce48133f70 2023-09-30T22:26:02.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.476+0000 7fce2f7fe700 1 -- 172.21.15.156:0/3129929156 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fce40017020 con 0x7fce48133f70 2023-09-30T22:26:02.476 INFO:teuthology.orchestra.run.smithi156.stdout:120259084290 2023-09-30T22:26:02.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.478+0000 7fce4d0ac700 1 -- 172.21.15.156:0/3129929156 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce48133f70 msgr2=0x7fce481c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.478+0000 7fce4d0ac700 1 --2- 172.21.15.156:0/3129929156 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce48133f70 0x7fce481c8190 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fce4000cab0 tx=0x7fce4000cdc0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.478+0000 7fce4d0ac700 1 -- 172.21.15.156:0/3129929156 shutdown_connections 2023-09-30T22:26:02.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.478+0000 7fce4d0ac700 1 --2- 172.21.15.156:0/3129929156 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fce48133f70 0x7fce481c8190 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.478+0000 7fce4d0ac700 1 --2- 172.21.15.156:0/3129929156 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce4809ad40 0x7fce4811f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.478+0000 7fce4d0ac700 1 --2- 172.21.15.156:0/3129929156 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fce480a0a70 0x7fce4811fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.478+0000 7fce4d0ac700 1 -- 172.21.15.156:0/3129929156 >> 172.21.15.156:0/3129929156 conn(0x7fce48099c40 msgr2=0x7fce481bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:02.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.478+0000 7fce4d0ac700 1 -- 172.21.15.156:0/3129929156 shutdown_connections 2023-09-30T22:26:02.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:26:02.478+0000 7fce4d0ac700 1 -- 172.21.15.156:0/3129929156 wait complete. 2023-09-30T22:26:02.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084290 for osd.0 2023-09-30T22:28:02.104 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-09-30T22:28:02.105 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1496, in healthy manager.wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-09-30T22:28:02.175 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=cc8df17f6dcf4b4ba620388a8bdb3c08 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1496, in healthy manager.wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-09-30T22:28:02.180 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-09-30T22:28:02.191 DEBUG:teuthology.run_tasks:Unwinding manager ceph.stop 2023-09-30T22:28:02.212 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-09-30T22:28:02.224 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-09-30T22:28:02.235 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2023-09-30T22:28:02.245 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-09-30T22:28:02.256 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-09-30T22:28:02.257 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-09-30T22:28:02.257 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T22:28:02.287 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-09-30T22:28:02.288 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T22:28:02.349 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:28:02.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.483+0000 7f6af1e84700 1 Processor -- start 2023-09-30T22:28:02.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.483+0000 7f6af1e84700 1 -- start start 2023-09-30T22:28:02.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.483+0000 7f6af1e84700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aec06a770 0x7f6aec06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.483+0000 7f6af1e84700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aec131ec0 0x7f6aec139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.483+0000 7f6af1e84700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aec09da80 con 0x7f6aec06b080 2023-09-30T22:28:02.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.483+0000 7f6af1e84700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec09dce0 con 0x7f6aec06a770 2023-09-30T22:28:02.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.483+0000 7f6af1e84700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec09eb20 con 0x7f6aec131ec0 2023-09-30T22:28:02.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.483+0000 7f6aebfff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aec131ec0 0x7f6aec139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.483+0000 7f6aeb7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aec06a770 0x7f6aec06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.483+0000 7f6aeaffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6aec06b080 0x7f6aec1317b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53110/0 (socket says 172.21.15.156:53110) 2023-09-30T22:28:02.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.483+0000 7f6aeaffd700 1 -- 172.21.15.156:0/3131058897 learned_addr learned my addr 172.21.15.156:0/3131058897 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:28:02.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.484+0000 7f6aebfff700 1 -- 172.21.15.156:0/3131058897 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aec06a770 msgr2=0x7f6aec06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:02.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.484+0000 7f6aebfff700 1 --2- 172.21.15.156:0/3131058897 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aec06a770 0x7f6aec06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.484+0000 7f6aebfff700 1 -- 172.21.15.156:0/3131058897 >> v1:172.21.15.156:6789/0 conn(0x7f6aec06b080 legacy=0x7f6aec1317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.484+0000 7f6aea7fc700 1 -- 172.21.15.156:0/3131058897 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106710303 0 0) 0x7f6aec09da80 con 0x7f6aec06b080 2023-09-30T22:28:02.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.484+0000 7f6aebfff700 1 -- 172.21.15.156:0/3131058897 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aec09d860 con 0x7f6aec131ec0 2023-09-30T22:28:02.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.484+0000 7f6aeb7fe700 1 --2- 172.21.15.156:0/3131058897 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aec06a770 0x7f6aec06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:02.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.484+0000 7f6aebfff700 1 --2- 172.21.15.156:0/3131058897 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aec131ec0 0x7f6aec139c20 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4009dc0 tx=0x7f6ae400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8662b5915b9dd10 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:02.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.484+0000 7f6aea7fc700 1 -- 172.21.15.156:0/3131058897 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae400e070 con 0x7f6aec131ec0 2023-09-30T22:28:02.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.484+0000 7f6aea7fc700 1 -- 172.21.15.156:0/3131058897 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae400bb20 con 0x7f6aec131ec0 2023-09-30T22:28:02.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.484+0000 7f6aea7fc700 1 -- 172.21.15.156:0/3131058897 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4012430 con 0x7f6aec131ec0 2023-09-30T22:28:02.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.484+0000 7f6af1e84700 1 -- 172.21.15.156:0/3131058897 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aec131ec0 msgr2=0x7f6aec139c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.484+0000 7f6af1e84700 1 --2- 172.21.15.156:0/3131058897 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aec131ec0 0x7f6aec139c20 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4009dc0 tx=0x7f6ae400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:02.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.484+0000 7f6af1e84700 1 -- 172.21.15.156:0/3131058897 shutdown_connections 2023-09-30T22:28:02.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.484+0000 7f6af1e84700 1 --2- 172.21.15.156:0/3131058897 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aec06a770 0x7f6aec06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.484+0000 7f6af1e84700 1 --2- 172.21.15.156:0/3131058897 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aec131ec0 0x7f6aec139c20 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.484+0000 7f6af1e84700 1 -- 172.21.15.156:0/3131058897 >> 172.21.15.156:0/3131058897 conn(0x7f6aec099c40 msgr2=0x7f6aec0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:02.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.485+0000 7f6af1e84700 1 -- 172.21.15.156:0/3131058897 shutdown_connections 2023-09-30T22:28:02.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.485+0000 7f6af1e84700 1 -- 172.21.15.156:0/3131058897 wait complete. 2023-09-30T22:28:02.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.485+0000 7f6af1e84700 1 Processor -- start 2023-09-30T22:28:02.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.486+0000 7f6af1e84700 1 -- start start 2023-09-30T22:28:02.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.486+0000 7f6af1e84700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6aec06a770 0x7f6aec09aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.486+0000 7f6af1e84700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aec06b080 0x7f6aec09b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.486+0000 7f6af1e84700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aec131ec0 0x7f6aec1c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.486+0000 7f6af1e84700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec071e10 con 0x7f6aec06a770 2023-09-30T22:28:02.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.486+0000 7f6af1e84700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec121250 con 0x7f6aec131ec0 2023-09-30T22:28:02.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.486+0000 7f6af1e84700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec130380 con 0x7f6aec06b080 2023-09-30T22:28:02.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.486+0000 7f6aebfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aec131ec0 0x7f6aec1c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.486+0000 7f6aeaffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aec06b080 0x7f6aec09b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.486+0000 7f6aeaffd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aec06b080 0x7f6aec09b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55902/0 (socket says 172.21.15.156:55902) 2023-09-30T22:28:02.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.486+0000 7f6aebfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aec131ec0 0x7f6aec1c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:34872/0 (socket says 172.21.15.156:34872) 2023-09-30T22:28:02.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.486+0000 7f6aeaffd700 1 -- 172.21.15.156:0/885824964 learned_addr learned my addr 172.21.15.156:0/885824964 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:28:02.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.486+0000 7f6aeb7fe700 1 --2- 172.21.15.156:0/885824964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6aec06a770 0x7f6aec09aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.486+0000 7f6aeaffd700 1 -- 172.21.15.156:0/885824964 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aec131ec0 msgr2=0x7f6aec1c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.486+0000 7f6aeaffd700 1 --2- 172.21.15.156:0/885824964 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aec131ec0 0x7f6aec1c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.486+0000 7f6aeaffd700 1 -- 172.21.15.156:0/885824964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6aec06a770 msgr2=0x7f6aec09aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.486+0000 7f6aeaffd700 1 --2- 172.21.15.156:0/885824964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6aec06a770 0x7f6aec09aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.486+0000 7f6aeaffd700 1 -- 172.21.15.156:0/885824964 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae00094a0 con 0x7f6aec06b080 2023-09-30T22:28:02.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.487+0000 7f6aeaffd700 1 --2- 172.21.15.156:0/885824964 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aec06b080 0x7f6aec09b430 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f6adc00c520 tx=0x7f6adc00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:02.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.487+0000 7f6ad3fff700 1 -- 172.21.15.156:0/885824964 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc004c80 con 0x7f6aec06b080 2023-09-30T22:28:02.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.487+0000 7f6ad3fff700 1 -- 172.21.15.156:0/885824964 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6adc004de0 con 0x7f6aec06b080 2023-09-30T22:28:02.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.487+0000 7f6af1e84700 1 -- 172.21.15.156:0/885824964 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae4009a70 con 0x7f6aec06b080 2023-09-30T22:28:02.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.487+0000 7f6ad3fff700 1 -- 172.21.15.156:0/885824964 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc007310 con 0x7f6aec06b080 2023-09-30T22:28:02.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.487+0000 7f6af1e84700 1 -- 172.21.15.156:0/885824964 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aec0a2b70 con 0x7f6aec06b080 2023-09-30T22:28:02.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.487+0000 7f6ad3fff700 1 -- 172.21.15.156:0/885824964 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6adc007470 con 0x7f6aec06b080 2023-09-30T22:28:02.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.488+0000 7f6ad3fff700 1 -- 172.21.15.156:0/885824964 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6adc03f270 con 0x7f6aec06b080 2023-09-30T22:28:02.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.488+0000 7f6af1e84700 1 -- 172.21.15.156:0/885824964 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aec121390 con 0x7f6aec06b080 2023-09-30T22:28:02.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.492+0000 7f6ad3fff700 1 -- 172.21.15.156:0/885824964 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6aec121390 con 0x7f6aec06b080 2023-09-30T22:28:02.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.676+0000 7f6af1e84700 1 -- 172.21.15.156:0/885824964 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6aec121390 con 0x7f6aec06b080 2023-09-30T22:28:02.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.677+0000 7f6ad3fff700 1 -- 172.21.15.156:0/885824964 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+13483 (secure 0 0 0) 0x7f6aec121390 con 0x7f6aec06b080 2023-09-30T22:28:02.678 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:28:02.678 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":39,"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","created":"2023-09-30T22:16:15.239992+0000","modified":"2023-09-30T22:19:32.500244+0000","last_up_change":"2023-09-30T22:18:55.822352+0000","last_in_change":"2023-09-30T22:16:16.474206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:16:23.433906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:16:24.367795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:16:28.204677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:16:28.762804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ec2e78a-c61f-473a-bfcb-f956cffe4095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6803","nonce":129485}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6805","nonce":129485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6807","nonce":129485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6806","nonce":129485}]},"public_addr":"172.21.15.156:6803/129485","cluster_addr":"172.21.15.156:6805/129485","heartbeat_back_addr":"172.21.15.156:6807/129485","heartbeat_front_addr":"172.21.15.156:6806/129485","state":["exists","up"]},{"osd":1,"uuid":"b682e683-c15a-4bd9-8712-8af96454e9ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6808","nonce":129583}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6809","nonce":129583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6811","nonce":129583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6810","nonce":129583}]},"public_addr":"172.21.15.156:6808/129583","cluster_addr":"172.21.15.156:6809/129583","heartbeat_back_addr":"172.21.15.156:6811/129583","heartbeat_front_addr":"172.21.15.156:6810/129583","state":["exists","up"]},{"osd":2,"uuid":"960dbaf0-2e0c-437e-9114-bc22ce522b26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6800","nonce":129693}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6801","nonce":129693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6804","nonce":129693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6802","nonce":129693}]},"public_addr":"172.21.15.156:6800/129693","cluster_addr":"172.21.15.156:6801/129693","heartbeat_back_addr":"172.21.15.156:6804/129693","heartbeat_front_addr":"172.21.15.156:6802/129693","state":["exists","up"]},{"osd":3,"uuid":"c1b19714-78b1-4869-8721-2f6352a64a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6812","nonce":129849}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6813","nonce":129849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6815","nonce":129849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6814","nonce":129849}]},"public_addr":"172.21.15.156:6812/129849","cluster_addr":"172.21.15.156:6813/129849","heartbeat_back_addr":"172.21.15.156:6815/129849","heartbeat_front_addr":"172.21.15.156:6814/129849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.663343+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.827397+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.806655+0000","dead_epoch":25},{"osd":3,"down_stamp":"2023-09-30T22:18:49.807414+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.634746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.2","mappings":[{"from":3,"to":0}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.156:6816/126965":"2023-10-01T22:19:32.500218+0000","172.21.15.156:0/1669701082":"2023-10-01T22:19:32.500218+0000","172.21.15.156:0/1136044187":"2023-10-01T22:19:32.500218+0000","172.21.15.156:0/2593263545":"2023-10-01T22:18:37.767496+0000","172.21.15.156:0/3331241925":"2023-10-01T22:19:32.500218+0000","172.21.15.156:0/1464735255":"2023-10-01T22:18:37.767496+0000","172.21.15.156:0/417912451":"2023-10-01T22:19:32.500218+0000","172.21.15.156:0/1153199602":"2023-10-01T22:19:32.500218+0000","172.21.15.156:6816/118236":"2023-10-01T22:18:37.767496+0000","172.21.15.156:6817/3817969673":"2023-10-01T22:19:00.677676+0000","172.21.15.156:0/1695265592":"2023-10-01T22:19:32.500218+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:28:02.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.679+0000 7f6af1e84700 1 -- 172.21.15.156:0/885824964 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aec06b080 msgr2=0x7f6aec09b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.679+0000 7f6af1e84700 1 --2- 172.21.15.156:0/885824964 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aec06b080 0x7f6aec09b430 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f6adc00c520 tx=0x7f6adc00c830 comp rx=0 tx=0).stop 2023-09-30T22:28:02.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.679+0000 7f6af1e84700 1 -- 172.21.15.156:0/885824964 shutdown_connections 2023-09-30T22:28:02.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.679+0000 7f6af1e84700 1 --2- 172.21.15.156:0/885824964 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6aec131ec0 0x7f6aec1c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.679+0000 7f6af1e84700 1 --2- 172.21.15.156:0/885824964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6aec06a770 0x7f6aec09aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.679+0000 7f6af1e84700 1 --2- 172.21.15.156:0/885824964 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f6aec06b080 0x7f6aec09b430 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.679+0000 7f6af1e84700 1 -- 172.21.15.156:0/885824964 >> 172.21.15.156:0/885824964 conn(0x7f6aec099c40 msgr2=0x7f6aec0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:02.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.679+0000 7f6af1e84700 1 -- 172.21.15.156:0/885824964 shutdown_connections 2023-09-30T22:28:02.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.679+0000 7f6af1e84700 1 -- 172.21.15.156:0/885824964 wait complete. 2023-09-30T22:28:02.692 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:16:23.433906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:16:24.367795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:16:28.204677+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:16:28.762804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.059999942779541, 'score_stable': 1.059999942779541, 'optimal_score': 1, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T22:28:02.693 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:28:02.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.816+0000 7f8495c2c700 1 Processor -- start 2023-09-30T22:28:02.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.817+0000 7f8495c2c700 1 -- start start 2023-09-30T22:28:02.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.817+0000 7f8495c2c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f849009d780 0x7f849009db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.817+0000 7f8495c2c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f849009e090 0x7f8490134190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.817+0000 7f8495c2c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f849009a590 con 0x7f849009ad70 2023-09-30T22:28:02.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.817+0000 7f8495c2c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849006b450 con 0x7f849009d780 2023-09-30T22:28:02.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.817+0000 7f8495c2c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f849009e510 con 0x7f849009e090 2023-09-30T22:28:02.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.817+0000 7f848f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f849009d780 0x7f849009db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.817+0000 7f848effd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f849009ad70 0x7f8490133a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53114/0 (socket says 172.21.15.156:53114) 2023-09-30T22:28:02.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.817+0000 7f848effd700 1 -- 172.21.15.156:0/1806705950 learned_addr learned my addr 172.21.15.156:0/1806705950 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:28:02.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.817+0000 7f848ffff700 1 --2- 172.21.15.156:0/1806705950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f849009e090 0x7f8490134190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.817+0000 7f848e7fc700 1 -- 172.21.15.156:0/1806705950 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3993155860 0 0) 0x7f849009a590 con 0x7f849009ad70 2023-09-30T22:28:02.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.817+0000 7f848e7fc700 1 -- 172.21.15.156:0/1806705950 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84780035b0 con 0x7f849009ad70 2023-09-30T22:28:02.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.817+0000 7f848ffff700 1 -- 172.21.15.156:0/1806705950 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f849009d780 msgr2=0x7f849009db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:02.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.817+0000 7f848ffff700 1 --2- 172.21.15.156:0/1806705950 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f849009d780 0x7f849009db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.817+0000 7f848ffff700 1 -- 172.21.15.156:0/1806705950 >> v1:172.21.15.156:6789/0 conn(0x7f849009ad70 legacy=0x7f8490133a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.818+0000 7f848ffff700 1 -- 172.21.15.156:0/1806705950 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849006a9e0 con 0x7f849009e090 2023-09-30T22:28:02.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.818+0000 7f848f7fe700 1 --2- 172.21.15.156:0/1806705950 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f849009d780 0x7f849009db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:02.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.818+0000 7f848ffff700 1 --2- 172.21.15.156:0/1806705950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f849009e090 0x7f8490134190 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f8488009dc0 tx=0x7f848800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8d1f94d5f4783ac server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:02.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.818+0000 7f848e7fc700 1 -- 172.21.15.156:0/1806705950 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848800e070 con 0x7f849009e090 2023-09-30T22:28:02.823 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.818+0000 7f848e7fc700 1 -- 172.21.15.156:0/1806705950 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848800bb20 con 0x7f849009e090 2023-09-30T22:28:02.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.818+0000 7f848e7fc700 1 -- 172.21.15.156:0/1806705950 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488012430 con 0x7f849009e090 2023-09-30T22:28:02.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.818+0000 7f8495c2c700 1 -- 172.21.15.156:0/1806705950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f849009e090 msgr2=0x7f8490134190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.818+0000 7f8495c2c700 1 --2- 172.21.15.156:0/1806705950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f849009e090 0x7f8490134190 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f8488009dc0 tx=0x7f848800b330 comp rx=0 tx=0).stop 2023-09-30T22:28:02.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.818+0000 7f8495c2c700 1 -- 172.21.15.156:0/1806705950 shutdown_connections 2023-09-30T22:28:02.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.818+0000 7f8495c2c700 1 --2- 172.21.15.156:0/1806705950 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f849009d780 0x7f849009db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.824 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.818+0000 7f8495c2c700 1 --2- 172.21.15.156:0/1806705950 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f849009e090 0x7f8490134190 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.818+0000 7f8495c2c700 1 -- 172.21.15.156:0/1806705950 >> 172.21.15.156:0/1806705950 conn(0x7f849009f980 msgr2=0x7f849009fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:02.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.818+0000 7f8495c2c700 1 -- 172.21.15.156:0/1806705950 shutdown_connections 2023-09-30T22:28:02.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.818+0000 7f8495c2c700 1 -- 172.21.15.156:0/1806705950 wait complete. 2023-09-30T22:28:02.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.819+0000 7f8495c2c700 1 Processor -- start 2023-09-30T22:28:02.825 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.819+0000 7f8495c2c700 1 -- start start 2023-09-30T22:28:02.827 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.820+0000 7f8495c2c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f849009ad70 0x7f8490122290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.820+0000 7f8495c2c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f849009d780 0x7f84901227d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.820+0000 7f8495c2c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f849009e090 0x7f8490122d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.820+0000 7f8495c2c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8490125db0 con 0x7f849009d780 2023-09-30T22:28:02.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.820+0000 7f8495c2c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84901258a0 con 0x7f849009ad70 2023-09-30T22:28:02.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.820+0000 7f8495c2c700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8490124d30 con 0x7f849009e090 2023-09-30T22:28:02.828 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.820+0000 7f848effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f849009d780 0x7f84901227d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.820+0000 7f848f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f849009ad70 0x7f8490122290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.820+0000 7f848ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f849009e090 0x7f8490122d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.820+0000 7f848f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f849009ad70 0x7f8490122290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:34888/0 (socket says 172.21.15.156:34888) 2023-09-30T22:28:02.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.820+0000 7f848ffff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f849009e090 0x7f8490122d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55912/0 (socket says 172.21.15.156:55912) 2023-09-30T22:28:02.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.820+0000 7f848effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f849009d780 0x7f84901227d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52922/0 (socket says 172.21.15.156:52922) 2023-09-30T22:28:02.829 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.820+0000 7f848f7fe700 1 -- 172.21.15.156:0/273490125 learned_addr learned my addr 172.21.15.156:0/273490125 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:28:02.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.820+0000 7f848effd700 1 -- 172.21.15.156:0/273490125 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f849009e090 msgr2=0x7f8490122d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.820+0000 7f848effd700 1 --2- 172.21.15.156:0/273490125 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f849009e090 0x7f8490122d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.820+0000 7f848effd700 1 -- 172.21.15.156:0/273490125 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f849009ad70 msgr2=0x7f8490122290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.820+0000 7f848effd700 1 --2- 172.21.15.156:0/273490125 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f849009ad70 0x7f8490122290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.830 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.820+0000 7f848effd700 1 -- 172.21.15.156:0/273490125 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84840094a0 con 0x7f849009d780 2023-09-30T22:28:02.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.820+0000 7f848f7fe700 1 --2- 172.21.15.156:0/273490125 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f849009ad70 0x7f8490122290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:02.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.820+0000 7f848effd700 1 --2- 172.21.15.156:0/273490125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f849009d780 0x7f84901227d0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f848000c460 tx=0x7f848000c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:02.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.821+0000 7f8477fff700 1 -- 172.21.15.156:0/273490125 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8480005d70 con 0x7f849009d780 2023-09-30T22:28:02.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.821+0000 7f8477fff700 1 -- 172.21.15.156:0/273490125 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84800070d0 con 0x7f849009d780 2023-09-30T22:28:02.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.821+0000 7f8477fff700 1 -- 172.21.15.156:0/273490125 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8480007440 con 0x7f849009d780 2023-09-30T22:28:02.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.821+0000 7f8495c2c700 1 -- 172.21.15.156:0/273490125 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8488009a70 con 0x7f849009d780 2023-09-30T22:28:02.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.821+0000 7f8495c2c700 1 -- 172.21.15.156:0/273490125 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84900a2c20 con 0x7f849009d780 2023-09-30T22:28:02.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.821+0000 7f8477fff700 1 -- 172.21.15.156:0/273490125 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f84800075a0 con 0x7f849009d780 2023-09-30T22:28:02.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.821+0000 7f8477fff700 1 -- 172.21.15.156:0/273490125 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f848003e720 con 0x7f849009d780 2023-09-30T22:28:02.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.822+0000 7f8495c2c700 1 -- 172.21.15.156:0/273490125 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f849011f0c0 con 0x7f849009d780 2023-09-30T22:28:02.832 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:02.827+0000 7f8477fff700 1 -- 172.21.15.156:0/273490125 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8480018af0 con 0x7f849009d780 2023-09-30T22:28:03.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.008+0000 7f8495c2c700 1 -- 172.21.15.156:0/273490125 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f849004f2a0 con 0x7f849009d780 2023-09-30T22:28:03.009 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.008+0000 7f8477fff700 1 -- 172.21.15.156:0/273490125 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8480017020 con 0x7f849009d780 2023-09-30T22:28:03.009 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 1 2023-09-30T22:28:03.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.010+0000 7f8495c2c700 1 -- 172.21.15.156:0/273490125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f849009d780 msgr2=0x7f84901227d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.010+0000 7f8495c2c700 1 --2- 172.21.15.156:0/273490125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f849009d780 0x7f84901227d0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f848000c460 tx=0x7f848000c770 comp rx=0 tx=0).stop 2023-09-30T22:28:03.011 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.010+0000 7f8495c2c700 1 -- 172.21.15.156:0/273490125 shutdown_connections 2023-09-30T22:28:03.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.010+0000 7f8495c2c700 1 --2- 172.21.15.156:0/273490125 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f849009e090 0x7f8490122d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.010+0000 7f8495c2c700 1 --2- 172.21.15.156:0/273490125 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f849009ad70 0x7f8490122290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.010+0000 7f8495c2c700 1 --2- 172.21.15.156:0/273490125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f849009d780 0x7f84901227d0 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.010+0000 7f8495c2c700 1 -- 172.21.15.156:0/273490125 >> 172.21.15.156:0/273490125 conn(0x7f849009f980 msgr2=0x7f8490133fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:03.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.010+0000 7f8495c2c700 1 -- 172.21.15.156:0/273490125 shutdown_connections 2023-09-30T22:28:03.012 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.010+0000 7f8495c2c700 1 -- 172.21.15.156:0/273490125 wait complete. 2023-09-30T22:28:03.024 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:28:03.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.148+0000 7fec6ebc5700 1 Processor -- start 2023-09-30T22:28:03.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.148+0000 7fec6ebc5700 1 -- start start 2023-09-30T22:28:03.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.149+0000 7fec6ebc5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fec6809d780 0x7fec6809db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.149+0000 7fec6ebc5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec6809ad70 0x7fec6809e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.149+0000 7fec6ebc5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec6809a590 con 0x7fec68133a80 2023-09-30T22:28:03.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.149+0000 7fec6ebc5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec6809e5d0 con 0x7fec6809d780 2023-09-30T22:28:03.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.149+0000 7fec6ebc5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec6806b450 con 0x7fec6809ad70 2023-09-30T22:28:03.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.149+0000 7fec67fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec6809ad70 0x7fec6809e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.149+0000 7fec67fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec6809ad70 0x7fec6809e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55920/0 (socket says 172.21.15.156:55920) 2023-09-30T22:28:03.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.149+0000 7fec6c961700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fec6809d780 0x7fec6809db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.149+0000 7fec67fff700 1 -- 172.21.15.156:0/1767230161 learned_addr learned my addr 172.21.15.156:0/1767230161 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:28:03.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.149+0000 7fec67fff700 1 -- 172.21.15.156:0/1767230161 >> v2:172.21.15.156:3300/0 conn(0x7fec6809d780 msgr2=0x7fec6809db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:03.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.149+0000 7fec67fff700 1 --2- 172.21.15.156:0/1767230161 >> v2:172.21.15.156:3300/0 conn(0x7fec6809d780 0x7fec6809db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.152 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.149+0000 7fec67fff700 1 -- 172.21.15.156:0/1767230161 >> v1:172.21.15.156:6789/0 conn(0x7fec68133a80 legacy=0x7fec68133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.149+0000 7fec67fff700 1 -- 172.21.15.156:0/1767230161 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6806a9e0 con 0x7fec6809ad70 2023-09-30T22:28:03.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.149+0000 7fec6c961700 1 --2- 172.21.15.156:0/1767230161 >> v2:172.21.15.156:3300/0 conn(0x7fec6809d780 0x7fec6809db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:03.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.149+0000 7fec67fff700 1 --2- 172.21.15.156:0/1767230161 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec6809ad70 0x7fec6809e090 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fec540098f0 tx=0x7fec54009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aef8be45dd4792e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:03.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.149+0000 7fec677fe700 1 -- 172.21.15.156:0/1767230161 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec54011830 con 0x7fec6809ad70 2023-09-30T22:28:03.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.149+0000 7fec677fe700 1 -- 172.21.15.156:0/1767230161 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec54011990 con 0x7fec6809ad70 2023-09-30T22:28:03.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.149+0000 7fec677fe700 1 -- 172.21.15.156:0/1767230161 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec54011d20 con 0x7fec6809ad70 2023-09-30T22:28:03.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.150+0000 7fec6ebc5700 1 -- 172.21.15.156:0/1767230161 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec6809ad70 msgr2=0x7fec6809e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.153 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.150+0000 7fec6ebc5700 1 --2- 172.21.15.156:0/1767230161 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec6809ad70 0x7fec6809e090 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fec540098f0 tx=0x7fec54009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:03.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.150+0000 7fec6ebc5700 1 -- 172.21.15.156:0/1767230161 shutdown_connections 2023-09-30T22:28:03.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.150+0000 7fec6ebc5700 1 --2- 172.21.15.156:0/1767230161 >> v2:172.21.15.156:3300/0 conn(0x7fec6809d780 0x7fec6809db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.150+0000 7fec6ebc5700 1 --2- 172.21.15.156:0/1767230161 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec6809ad70 0x7fec6809e090 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.150+0000 7fec6ebc5700 1 -- 172.21.15.156:0/1767230161 >> 172.21.15.156:0/1767230161 conn(0x7fec6809f980 msgr2=0x7fec6809fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:03.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.150+0000 7fec6ebc5700 1 -- 172.21.15.156:0/1767230161 shutdown_connections 2023-09-30T22:28:03.154 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.150+0000 7fec6ebc5700 1 -- 172.21.15.156:0/1767230161 wait complete. 2023-09-30T22:28:03.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.151+0000 7fec6ebc5700 1 Processor -- start 2023-09-30T22:28:03.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.151+0000 7fec6ebc5700 1 -- start start 2023-09-30T22:28:03.156 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.151+0000 7fec6ebc5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec6809ad70 0x7fec68120170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.151+0000 7fec6ebc5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec6809d780 0x7fec681206b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.151+0000 7fec6ebc5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fec68133a80 0x7fec68120bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.151+0000 7fec6ebc5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec68123500 con 0x7fec6809ad70 2023-09-30T22:28:03.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.151+0000 7fec6ebc5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec68121e20 con 0x7fec68133a80 2023-09-30T22:28:03.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.151+0000 7fec6ebc5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec681239b0 con 0x7fec6809d780 2023-09-30T22:28:03.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.152+0000 7fec6c961700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec6809ad70 0x7fec68120170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.152+0000 7fec6c961700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec6809ad70 0x7fec68120170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52936/0 (socket says 172.21.15.156:52936) 2023-09-30T22:28:03.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.152+0000 7fec67fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec6809d780 0x7fec681206b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.152+0000 7fec6c961700 1 -- 172.21.15.156:0/3048912817 learned_addr learned my addr 172.21.15.156:0/3048912817 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:28:03.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.152+0000 7fec6d162700 1 --2- 172.21.15.156:0/3048912817 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fec68133a80 0x7fec68120bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.152+0000 7fec67fff700 1 -- 172.21.15.156:0/3048912817 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fec68133a80 msgr2=0x7fec68120bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.152+0000 7fec67fff700 1 --2- 172.21.15.156:0/3048912817 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fec68133a80 0x7fec68120bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.152+0000 7fec67fff700 1 -- 172.21.15.156:0/3048912817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec6809ad70 msgr2=0x7fec68120170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.152+0000 7fec67fff700 1 --2- 172.21.15.156:0/3048912817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec6809ad70 0x7fec68120170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.152+0000 7fec67fff700 1 -- 172.21.15.156:0/3048912817 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c0094a0 con 0x7fec6809d780 2023-09-30T22:28:03.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.152+0000 7fec6c961700 1 --2- 172.21.15.156:0/3048912817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec6809ad70 0x7fec68120170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:03.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.152+0000 7fec67fff700 1 --2- 172.21.15.156:0/3048912817 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec6809d780 0x7fec681206b0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fec6809a4a0 tx=0x7fec54004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:03.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.152+0000 7fec657fa700 1 -- 172.21.15.156:0/3048912817 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec54004510 con 0x7fec6809d780 2023-09-30T22:28:03.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.152+0000 7fec657fa700 1 -- 172.21.15.156:0/3048912817 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5401e070 con 0x7fec6809d780 2023-09-30T22:28:03.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.152+0000 7fec657fa700 1 -- 172.21.15.156:0/3048912817 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec540038a0 con 0x7fec6809d780 2023-09-30T22:28:03.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.152+0000 7fec6ebc5700 1 -- 172.21.15.156:0/3048912817 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec54009550 con 0x7fec6809d780 2023-09-30T22:28:03.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.152+0000 7fec6ebc5700 1 -- 172.21.15.156:0/3048912817 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec680a1790 con 0x7fec6809d780 2023-09-30T22:28:03.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.153+0000 7fec657fa700 1 -- 172.21.15.156:0/3048912817 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fec54003a00 con 0x7fec6809d780 2023-09-30T22:28:03.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.153+0000 7fec657fa700 1 -- 172.21.15.156:0/3048912817 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fec54020070 con 0x7fec6809d780 2023-09-30T22:28:03.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.153+0000 7fec6ebc5700 1 -- 172.21.15.156:0/3048912817 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec68072080 con 0x7fec6809d780 2023-09-30T22:28:03.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.158+0000 7fec657fa700 1 -- 172.21.15.156:0/3048912817 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fec5402a020 con 0x7fec6809d780 2023-09-30T22:28:03.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.339+0000 7fec6ebc5700 1 -- 172.21.15.156:0/3048912817 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fec6804f2a0 con 0x7fec6809d780 2023-09-30T22:28:03.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.340+0000 7fec657fa700 1 -- 172.21.15.156:0/3048912817 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v39) v1 ==== 92+0+10 (secure 0 0 0) 0x7fec54015070 con 0x7fec6809d780 2023-09-30T22:28:03.341 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 8 2023-09-30T22:28:03.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.342+0000 7fec6ebc5700 1 -- 172.21.15.156:0/3048912817 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec6809d780 msgr2=0x7fec681206b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.342+0000 7fec6ebc5700 1 --2- 172.21.15.156:0/3048912817 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec6809d780 0x7fec681206b0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fec6809a4a0 tx=0x7fec54004750 comp rx=0 tx=0).stop 2023-09-30T22:28:03.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.342+0000 7fec6ebc5700 1 -- 172.21.15.156:0/3048912817 shutdown_connections 2023-09-30T22:28:03.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.342+0000 7fec6ebc5700 1 --2- 172.21.15.156:0/3048912817 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fec68133a80 0x7fec68120bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.342+0000 7fec6ebc5700 1 --2- 172.21.15.156:0/3048912817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec6809ad70 0x7fec68120170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.342+0000 7fec6ebc5700 1 --2- 172.21.15.156:0/3048912817 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fec6809d780 0x7fec681206b0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.343 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.342+0000 7fec6ebc5700 1 -- 172.21.15.156:0/3048912817 >> 172.21.15.156:0/3048912817 conn(0x7fec6809f980 msgr2=0x7fec681bb030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:03.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.342+0000 7fec6ebc5700 1 -- 172.21.15.156:0/3048912817 shutdown_connections 2023-09-30T22:28:03.344 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.342+0000 7fec6ebc5700 1 -- 172.21.15.156:0/3048912817 wait complete. 2023-09-30T22:28:03.355 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:28:03.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.479+0000 7fc4afeeb700 1 Processor -- start 2023-09-30T22:28:03.482 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.479+0000 7fc4afeeb700 1 -- start start 2023-09-30T22:28:03.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.479+0000 7fc4afeeb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a809d780 0x7fc4a809db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.479+0000 7fc4afeeb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a809e090 0x7fc4a8130680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.479+0000 7fc4afeeb700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a809e910 con 0x7fc4a8130bc0 2023-09-30T22:28:03.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.479+0000 7fc4afeeb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a809d430 con 0x7fc4a809d780 2023-09-30T22:28:03.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.479+0000 7fc4afeeb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a809b380 con 0x7fc4a809e090 2023-09-30T22:28:03.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.480+0000 7fc4adc87700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a809d780 0x7fc4a809db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.480+0000 7fc4ae488700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc4a8130bc0 0x7fc4a8137ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53136/0 (socket says 172.21.15.156:53136) 2023-09-30T22:28:03.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.480+0000 7fc4ad486700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a809e090 0x7fc4a8130680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.480+0000 7fc4ae488700 1 -- 172.21.15.156:0/1647411723 learned_addr learned my addr 172.21.15.156:0/1647411723 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:28:03.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.480+0000 7fc4acc85700 1 -- 172.21.15.156:0/1647411723 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313924418 0 0) 0x7fc4a809e910 con 0x7fc4a8130bc0 2023-09-30T22:28:03.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.480+0000 7fc4acc85700 1 -- 172.21.15.156:0/1647411723 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4940035b0 con 0x7fc4a8130bc0 2023-09-30T22:28:03.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.480+0000 7fc4ad486700 1 -- 172.21.15.156:0/1647411723 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a809d780 msgr2=0x7fc4a809db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:03.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.480+0000 7fc4ad486700 1 --2- 172.21.15.156:0/1647411723 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a809d780 0x7fc4a809db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.480+0000 7fc4ad486700 1 -- 172.21.15.156:0/1647411723 >> v1:172.21.15.156:6789/0 conn(0x7fc4a8130bc0 legacy=0x7fc4a8137ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.480+0000 7fc4ad486700 1 -- 172.21.15.156:0/1647411723 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a809f570 con 0x7fc4a809e090 2023-09-30T22:28:03.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.480+0000 7fc4adc87700 1 --2- 172.21.15.156:0/1647411723 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a809d780 0x7fc4a809db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:03.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.480+0000 7fc4ad486700 1 --2- 172.21.15.156:0/1647411723 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a809e090 0x7fc4a8130680 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc498009870 tx=0x7fc498009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9eea28f942a9f32c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:03.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.480+0000 7fc4acc85700 1 -- 172.21.15.156:0/1647411723 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc498011830 con 0x7fc4a809e090 2023-09-30T22:28:03.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.480+0000 7fc4acc85700 1 -- 172.21.15.156:0/1647411723 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc498011990 con 0x7fc4a809e090 2023-09-30T22:28:03.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.480+0000 7fc4acc85700 1 -- 172.21.15.156:0/1647411723 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc498011d20 con 0x7fc4a809e090 2023-09-30T22:28:03.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.481+0000 7fc4afeeb700 1 -- 172.21.15.156:0/1647411723 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a809e090 msgr2=0x7fc4a8130680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.486 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.481+0000 7fc4afeeb700 1 --2- 172.21.15.156:0/1647411723 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a809e090 0x7fc4a8130680 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc498009870 tx=0x7fc498009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:03.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.481+0000 7fc4afeeb700 1 -- 172.21.15.156:0/1647411723 shutdown_connections 2023-09-30T22:28:03.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.481+0000 7fc4afeeb700 1 --2- 172.21.15.156:0/1647411723 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a809d780 0x7fc4a809db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.481+0000 7fc4afeeb700 1 --2- 172.21.15.156:0/1647411723 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a809e090 0x7fc4a8130680 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.481+0000 7fc4afeeb700 1 -- 172.21.15.156:0/1647411723 >> 172.21.15.156:0/1647411723 conn(0x7fc4a809f980 msgr2=0x7fc4a809fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:03.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.481+0000 7fc4afeeb700 1 -- 172.21.15.156:0/1647411723 shutdown_connections 2023-09-30T22:28:03.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.481+0000 7fc4afeeb700 1 -- 172.21.15.156:0/1647411723 wait complete. 2023-09-30T22:28:03.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.482+0000 7fc4afeeb700 1 Processor -- start 2023-09-30T22:28:03.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.482+0000 7fc4afeeb700 1 -- start start 2023-09-30T22:28:03.490 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.482+0000 7fc4afeeb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4a809d780 0x7fc4a8121000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.482+0000 7fc4afeeb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a809e090 0x7fc4a8121540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.482+0000 7fc4afeeb700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a8130bc0 0x7fc4a8121a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.482+0000 7fc4afeeb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a812f3a0 con 0x7fc4a809d780 2023-09-30T22:28:03.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.482+0000 7fc4afeeb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a8124580 con 0x7fc4a809e090 2023-09-30T22:28:03.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.482+0000 7fc4afeeb700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a8123470 con 0x7fc4a8130bc0 2023-09-30T22:28:03.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.482+0000 7fc4adc87700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4a809d780 0x7fc4a8121000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.482+0000 7fc4ae488700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a8130bc0 0x7fc4a8121a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.482+0000 7fc4adc87700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4a809d780 0x7fc4a8121000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52940/0 (socket says 172.21.15.156:52940) 2023-09-30T22:28:03.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.482+0000 7fc4adc87700 1 -- 172.21.15.156:0/406382536 learned_addr learned my addr 172.21.15.156:0/406382536 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:28:03.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.482+0000 7fc4ad486700 1 --2- 172.21.15.156:0/406382536 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a809e090 0x7fc4a8121540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.483+0000 7fc4adc87700 1 -- 172.21.15.156:0/406382536 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a8130bc0 msgr2=0x7fc4a8121a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.483+0000 7fc4adc87700 1 --2- 172.21.15.156:0/406382536 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a8130bc0 0x7fc4a8121a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.483+0000 7fc4adc87700 1 -- 172.21.15.156:0/406382536 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a809e090 msgr2=0x7fc4a8121540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.483+0000 7fc4adc87700 1 --2- 172.21.15.156:0/406382536 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a809e090 0x7fc4a8121540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.483+0000 7fc4adc87700 1 -- 172.21.15.156:0/406382536 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a40094a0 con 0x7fc4a809d780 2023-09-30T22:28:03.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.483+0000 7fc4ae488700 1 --2- 172.21.15.156:0/406382536 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a8130bc0 0x7fc4a8121a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:03.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.483+0000 7fc4adc87700 1 --2- 172.21.15.156:0/406382536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4a809d780 0x7fc4a8121000 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fc4a400ec10 tx=0x7fc4a400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:03.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.483+0000 7fc49e7fc700 1 -- 172.21.15.156:0/406382536 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4009760 con 0x7fc4a809d780 2023-09-30T22:28:03.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.483+0000 7fc49e7fc700 1 -- 172.21.15.156:0/406382536 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a400c850 con 0x7fc4a809d780 2023-09-30T22:28:03.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.483+0000 7fc4afeeb700 1 -- 172.21.15.156:0/406382536 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4980094a0 con 0x7fc4a809d780 2023-09-30T22:28:03.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.483+0000 7fc49e7fc700 1 -- 172.21.15.156:0/406382536 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a400cbe0 con 0x7fc4a809d780 2023-09-30T22:28:03.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.483+0000 7fc4afeeb700 1 -- 172.21.15.156:0/406382536 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a809c8d0 con 0x7fc4a809d780 2023-09-30T22:28:03.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.484+0000 7fc49e7fc700 1 -- 172.21.15.156:0/406382536 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc4a400cd40 con 0x7fc4a809d780 2023-09-30T22:28:03.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.484+0000 7fc49e7fc700 1 -- 172.21.15.156:0/406382536 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc4a403f880 con 0x7fc4a809d780 2023-09-30T22:28:03.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.484+0000 7fc4afeeb700 1 -- 172.21.15.156:0/406382536 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a81248a0 con 0x7fc4a809d780 2023-09-30T22:28:03.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.489+0000 7fc49e7fc700 1 -- 172.21.15.156:0/406382536 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc4a40232f0 con 0x7fc4a809d780 2023-09-30T22:28:03.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.671+0000 7fc4afeeb700 1 -- 172.21.15.156:0/406382536 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc4a81246c0 con 0x7fc4a809d780 2023-09-30T22:28:03.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.672+0000 7fc49e7fc700 1 -- 172.21.15.156:0/406382536 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc4a401bba0 con 0x7fc4a809d780 2023-09-30T22:28:03.673 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 32 2023-09-30T22:28:03.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.674+0000 7fc4afeeb700 1 -- 172.21.15.156:0/406382536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4a809d780 msgr2=0x7fc4a8121000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.674+0000 7fc4afeeb700 1 --2- 172.21.15.156:0/406382536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4a809d780 0x7fc4a8121000 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fc4a400ec10 tx=0x7fc4a400ef20 comp rx=0 tx=0).stop 2023-09-30T22:28:03.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.674+0000 7fc4afeeb700 1 -- 172.21.15.156:0/406382536 shutdown_connections 2023-09-30T22:28:03.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.674+0000 7fc4afeeb700 1 --2- 172.21.15.156:0/406382536 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fc4a8130bc0 0x7fc4a8121a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.674+0000 7fc4afeeb700 1 --2- 172.21.15.156:0/406382536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4a809d780 0x7fc4a8121000 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.674+0000 7fc4afeeb700 1 --2- 172.21.15.156:0/406382536 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4a809e090 0x7fc4a8121540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.674+0000 7fc4afeeb700 1 -- 172.21.15.156:0/406382536 >> 172.21.15.156:0/406382536 conn(0x7fc4a809f980 msgr2=0x7fc4a812fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:03.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.674+0000 7fc4afeeb700 1 -- 172.21.15.156:0/406382536 shutdown_connections 2023-09-30T22:28:03.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.674+0000 7fc4afeeb700 1 -- 172.21.15.156:0/406382536 wait complete. 2023-09-30T22:28:03.687 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:28:03.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.809+0000 7f835cc5b700 1 Processor -- start 2023-09-30T22:28:03.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.809+0000 7f835cc5b700 1 -- start start 2023-09-30T22:28:03.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.809+0000 7f835cc5b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f835809d780 0x7f835809db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.809+0000 7f835cc5b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f835809e090 0x7f8358130680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.809+0000 7f835cc5b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8358130bc0 0x7f8358131060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.809+0000 7f835cc5b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f835809d430 con 0x7f8358130bc0 2023-09-30T22:28:03.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.809+0000 7f835cc5b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835809e910 con 0x7f835809d780 2023-09-30T22:28:03.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.809+0000 7f835cc5b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f835809b380 con 0x7f835809e090 2023-09-30T22:28:03.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.809+0000 7f835659c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f835809d780 0x7f835809db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.809+0000 7f8356d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8358130bc0 0x7f8358131060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.809+0000 7f8355d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f835809e090 0x7f8358130680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.809+0000 7f8356d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8358130bc0 0x7f8358131060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52956/0 (socket says 172.21.15.156:52956) 2023-09-30T22:28:03.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.809+0000 7f8355d9b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f835809e090 0x7f8358130680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:55966/0 (socket says 172.21.15.156:55966) 2023-09-30T22:28:03.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.809+0000 7f835659c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f835809d780 0x7f835809db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:34924/0 (socket says 172.21.15.156:34924) 2023-09-30T22:28:03.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.809+0000 7f8356d9d700 1 -- 172.21.15.156:0/1524636169 learned_addr learned my addr 172.21.15.156:0/1524636169 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:28:03.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.810+0000 7f8356d9d700 1 -- 172.21.15.156:0/1524636169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f835809e090 msgr2=0x7f8358130680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:03.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.810+0000 7f8356d9d700 1 --2- 172.21.15.156:0/1524636169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f835809e090 0x7f8358130680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.810+0000 7f8356d9d700 1 -- 172.21.15.156:0/1524636169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f835809d780 msgr2=0x7f835809db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:03.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.810+0000 7f8356d9d700 1 --2- 172.21.15.156:0/1524636169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f835809d780 0x7f835809db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.810+0000 7f8356d9d700 1 -- 172.21.15.156:0/1524636169 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835809f570 con 0x7f8358130bc0 2023-09-30T22:28:03.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.810+0000 7f8355d9b700 1 --2- 172.21.15.156:0/1524636169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f835809e090 0x7f8358130680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:03.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.810+0000 7f835659c700 1 --2- 172.21.15.156:0/1524636169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f835809d780 0x7f835809db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:03.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.810+0000 7f8356d9d700 1 --2- 172.21.15.156:0/1524636169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8358130bc0 0x7f8358131060 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f835000d150 tx=0x7f835000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0e365a8bee61e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:03.814 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.810+0000 7f835559a700 1 -- 172.21.15.156:0/1524636169 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8350010070 con 0x7f8358130bc0 2023-09-30T22:28:03.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.810+0000 7f835559a700 1 -- 172.21.15.156:0/1524636169 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835000dd10 con 0x7f8358130bc0 2023-09-30T22:28:03.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.810+0000 7f835559a700 1 -- 172.21.15.156:0/1524636169 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835000b310 con 0x7f8358130bc0 2023-09-30T22:28:03.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.811+0000 7f835cc5b700 1 -- 172.21.15.156:0/1524636169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8358130bc0 msgr2=0x7f8358131060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.811+0000 7f835cc5b700 1 --2- 172.21.15.156:0/1524636169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8358130bc0 0x7f8358131060 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f835000d150 tx=0x7f835000d460 comp rx=0 tx=0).stop 2023-09-30T22:28:03.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.811+0000 7f835cc5b700 1 -- 172.21.15.156:0/1524636169 shutdown_connections 2023-09-30T22:28:03.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.811+0000 7f835cc5b700 1 --2- 172.21.15.156:0/1524636169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8358130bc0 0x7f8358131060 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.811+0000 7f835cc5b700 1 --2- 172.21.15.156:0/1524636169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f835809d780 0x7f835809db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.811+0000 7f835cc5b700 1 --2- 172.21.15.156:0/1524636169 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f835809e090 0x7f8358130680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.811+0000 7f835cc5b700 1 -- 172.21.15.156:0/1524636169 >> 172.21.15.156:0/1524636169 conn(0x7f835809f980 msgr2=0x7f835809fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:03.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.811+0000 7f835cc5b700 1 -- 172.21.15.156:0/1524636169 shutdown_connections 2023-09-30T22:28:03.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.811+0000 7f835cc5b700 1 -- 172.21.15.156:0/1524636169 wait complete. 2023-09-30T22:28:03.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.812+0000 7f835cc5b700 1 Processor -- start 2023-09-30T22:28:03.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.812+0000 7f835cc5b700 1 -- start start 2023-09-30T22:28:03.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.812+0000 7f835cc5b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f835809d780 0x7f835811f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.812+0000 7f835cc5b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f835809e090 0x7f835811f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.818 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.812+0000 7f835cc5b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8358130bc0 0x7f835811fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.812+0000 7f835cc5b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8358120570 con 0x7f835809e090 2023-09-30T22:28:03.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.812+0000 7f835cc5b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835812d3d0 con 0x7f8358130bc0 2023-09-30T22:28:03.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.812+0000 7f835cc5b700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83581214d0 con 0x7f835809d780 2023-09-30T22:28:03.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.812+0000 7f8356d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8358130bc0 0x7f835811fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.812+0000 7f8355d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f835809e090 0x7f835811f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.812+0000 7f8356d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8358130bc0 0x7f835811fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:34928/0 (socket says 172.21.15.156:34928) 2023-09-30T22:28:03.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.812+0000 7f8356d9d700 1 -- 172.21.15.156:0/2424448105 learned_addr learned my addr 172.21.15.156:0/2424448105 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:28:03.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.812+0000 7f835659c700 1 --2- 172.21.15.156:0/2424448105 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f835809d780 0x7f835811f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.813+0000 7f8355d9b700 1 -- 172.21.15.156:0/2424448105 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f835809d780 msgr2=0x7f835811f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.813+0000 7f8355d9b700 1 --2- 172.21.15.156:0/2424448105 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f835809d780 0x7f835811f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.813+0000 7f8355d9b700 1 -- 172.21.15.156:0/2424448105 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8358130bc0 msgr2=0x7f835811fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.813+0000 7f8355d9b700 1 --2- 172.21.15.156:0/2424448105 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8358130bc0 0x7f835811fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.813+0000 7f8355d9b700 1 -- 172.21.15.156:0/2424448105 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83480094a0 con 0x7f835809e090 2023-09-30T22:28:03.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.813+0000 7f8356d9d700 1 --2- 172.21.15.156:0/2424448105 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8358130bc0 0x7f835811fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:03.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.813+0000 7f835659c700 1 --2- 172.21.15.156:0/2424448105 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f835809d780 0x7f835811f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:03.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.813+0000 7f8355d9b700 1 --2- 172.21.15.156:0/2424448105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f835809e090 0x7f835811f650 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f834c00e9b0 tx=0x7f834c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:03.820 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.813+0000 7f8346ffd700 1 -- 172.21.15.156:0/2424448105 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c00ee50 con 0x7f835809e090 2023-09-30T22:28:03.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.813+0000 7f8346ffd700 1 -- 172.21.15.156:0/2424448105 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834c00c7f0 con 0x7f835809e090 2023-09-30T22:28:03.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.813+0000 7f835cc5b700 1 -- 172.21.15.156:0/2424448105 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f834c0094a0 con 0x7f835809e090 2023-09-30T22:28:03.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.813+0000 7f8346ffd700 1 -- 172.21.15.156:0/2424448105 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c00cb80 con 0x7f835809e090 2023-09-30T22:28:03.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.813+0000 7f835cc5b700 1 -- 172.21.15.156:0/2424448105 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f835000bd40 con 0x7f835809e090 2023-09-30T22:28:03.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.814+0000 7f8346ffd700 1 -- 172.21.15.156:0/2424448105 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f834c00cce0 con 0x7f835809e090 2023-09-30T22:28:03.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.814+0000 7f8346ffd700 1 -- 172.21.15.156:0/2424448105 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f834c03f680 con 0x7f835809e090 2023-09-30T22:28:03.821 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.814+0000 7f835cc5b700 1 -- 172.21.15.156:0/2424448105 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8358071080 con 0x7f835809e090 2023-09-30T22:28:03.822 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:03.819+0000 7f8346ffd700 1 -- 172.21.15.156:0/2424448105 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f834c017020 con 0x7f835809e090 2023-09-30T22:28:04.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.001+0000 7f835cc5b700 1 -- 172.21.15.156:0/2424448105 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f835804f2a0 con 0x7f835809e090 2023-09-30T22:28:04.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.002+0000 7f8346ffd700 1 -- 172.21.15.156:0/2424448105 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7f834c0232f0 con 0x7f835809e090 2023-09-30T22:28:04.003 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 64 2023-09-30T22:28:04.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.004+0000 7f835cc5b700 1 -- 172.21.15.156:0/2424448105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f835809e090 msgr2=0x7f835811f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.004+0000 7f835cc5b700 1 --2- 172.21.15.156:0/2424448105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f835809e090 0x7f835811f650 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f834c00e9b0 tx=0x7f834c00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.004+0000 7f835cc5b700 1 -- 172.21.15.156:0/2424448105 shutdown_connections 2023-09-30T22:28:04.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.004+0000 7f835cc5b700 1 --2- 172.21.15.156:0/2424448105 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8358130bc0 0x7f835811fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.004+0000 7f835cc5b700 1 --2- 172.21.15.156:0/2424448105 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f835809d780 0x7f835811f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.004+0000 7f835cc5b700 1 --2- 172.21.15.156:0/2424448105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f835809e090 0x7f835811f650 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.004+0000 7f835cc5b700 1 -- 172.21.15.156:0/2424448105 >> 172.21.15.156:0/2424448105 conn(0x7f835809f980 msgr2=0x7f835812dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:04.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.004+0000 7f835cc5b700 1 -- 172.21.15.156:0/2424448105 shutdown_connections 2023-09-30T22:28:04.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.004+0000 7f835cc5b700 1 -- 172.21.15.156:0/2424448105 wait complete. 2023-09-30T22:28:04.017 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T22:28:04.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.138+0000 7fde88341700 1 Processor -- start 2023-09-30T22:28:04.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.138+0000 7fde88341700 1 -- start start 2023-09-30T22:28:04.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.139+0000 7fde88341700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fde80133ad0 0x7fde80133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.139+0000 7fde88341700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fde80130bc0 0x7fde8013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.139+0000 7fde88341700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde8006b2d0 con 0x7fde801300a0 2023-09-30T22:28:04.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.139+0000 7fde88341700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde80133610 con 0x7fde80130bc0 2023-09-30T22:28:04.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.139+0000 7fde88341700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde8009a500 con 0x7fde80133ad0 2023-09-30T22:28:04.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.139+0000 7fde858dc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fde801300a0 0x7fde801304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53138/0 (socket says 172.21.15.156:53138) 2023-09-30T22:28:04.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.139+0000 7fde860dd700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fde80133ad0 0x7fde80133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.139+0000 7fde868de700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fde80130bc0 0x7fde8013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.139+0000 7fde858dc700 1 -- 172.21.15.156:0/3716273047 learned_addr learned my addr 172.21.15.156:0/3716273047 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:28:04.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.140+0000 7fde850db700 1 -- 172.21.15.156:0/3716273047 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 758139163 0 0) 0x7fde8006b2d0 con 0x7fde801300a0 2023-09-30T22:28:04.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.140+0000 7fde868de700 1 -- 172.21.15.156:0/3716273047 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fde80133ad0 msgr2=0x7fde80133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:04.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.140+0000 7fde868de700 1 --2- 172.21.15.156:0/3716273047 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fde80133ad0 0x7fde80133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.140+0000 7fde868de700 1 -- 172.21.15.156:0/3716273047 >> v1:172.21.15.156:6789/0 conn(0x7fde801300a0 legacy=0x7fde801304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.140+0000 7fde868de700 1 -- 172.21.15.156:0/3716273047 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde801338b0 con 0x7fde80130bc0 2023-09-30T22:28:04.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.140+0000 7fde860dd700 1 --2- 172.21.15.156:0/3716273047 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fde80133ad0 0x7fde80133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:04.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.140+0000 7fde868de700 1 --2- 172.21.15.156:0/3716273047 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fde80130bc0 0x7fde8013b990 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fde78009dc0 tx=0x7fde7800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85c0388786800268 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:04.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.140+0000 7fde850db700 1 -- 172.21.15.156:0/3716273047 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7800e070 con 0x7fde80130bc0 2023-09-30T22:28:04.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.140+0000 7fde850db700 1 -- 172.21.15.156:0/3716273047 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7800bb20 con 0x7fde80130bc0 2023-09-30T22:28:04.143 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.140+0000 7fde850db700 1 -- 172.21.15.156:0/3716273047 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde78012430 con 0x7fde80130bc0 2023-09-30T22:28:04.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.140+0000 7fde88341700 1 -- 172.21.15.156:0/3716273047 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fde80130bc0 msgr2=0x7fde8013b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.140+0000 7fde88341700 1 --2- 172.21.15.156:0/3716273047 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fde80130bc0 0x7fde8013b990 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fde78009dc0 tx=0x7fde7800b330 comp rx=0 tx=0).stop 2023-09-30T22:28:04.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.140+0000 7fde88341700 1 -- 172.21.15.156:0/3716273047 shutdown_connections 2023-09-30T22:28:04.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.140+0000 7fde88341700 1 --2- 172.21.15.156:0/3716273047 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fde80130bc0 0x7fde8013b990 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.140+0000 7fde88341700 1 --2- 172.21.15.156:0/3716273047 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fde80133ad0 0x7fde80133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.140+0000 7fde88341700 1 -- 172.21.15.156:0/3716273047 >> 172.21.15.156:0/3716273047 conn(0x7fde80099c40 msgr2=0x7fde800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:04.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.140+0000 7fde88341700 1 -- 172.21.15.156:0/3716273047 shutdown_connections 2023-09-30T22:28:04.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.140+0000 7fde88341700 1 -- 172.21.15.156:0/3716273047 wait complete. 2023-09-30T22:28:04.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.141+0000 7fde88341700 1 Processor -- start 2023-09-30T22:28:04.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.141+0000 7fde88341700 1 -- start start 2023-09-30T22:28:04.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.142+0000 7fde88341700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde801300a0 0x7fde8011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.147 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.142+0000 7fde88341700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fde80130bc0 0x7fde8011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.142+0000 7fde88341700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fde80133ad0 0x7fde8011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.142+0000 7fde88341700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde80120050 con 0x7fde801300a0 2023-09-30T22:28:04.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.142+0000 7fde88341700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde801209c0 con 0x7fde80130bc0 2023-09-30T22:28:04.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.142+0000 7fde88341700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde80072060 con 0x7fde80133ad0 2023-09-30T22:28:04.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.142+0000 7fde858dc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fde80130bc0 0x7fde8011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.142+0000 7fde860dd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde801300a0 0x7fde8011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.142+0000 7fde858dc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fde80130bc0 0x7fde8011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:34952/0 (socket says 172.21.15.156:34952) 2023-09-30T22:28:04.148 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.142+0000 7fde858dc700 1 -- 172.21.15.156:0/3766505080 learned_addr learned my addr 172.21.15.156:0/3766505080 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:28:04.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.142+0000 7fde860dd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde801300a0 0x7fde8011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52970/0 (socket says 172.21.15.156:52970) 2023-09-30T22:28:04.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.142+0000 7fde868de700 1 --2- 172.21.15.156:0/3766505080 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fde80133ad0 0x7fde8011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.142+0000 7fde858dc700 1 -- 172.21.15.156:0/3766505080 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fde80133ad0 msgr2=0x7fde8011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.142+0000 7fde858dc700 1 --2- 172.21.15.156:0/3766505080 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fde80133ad0 0x7fde8011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.142+0000 7fde858dc700 1 -- 172.21.15.156:0/3766505080 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde801300a0 msgr2=0x7fde8011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.142+0000 7fde858dc700 1 --2- 172.21.15.156:0/3766505080 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde801300a0 0x7fde8011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.149 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.142+0000 7fde858dc700 1 -- 172.21.15.156:0/3766505080 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde700094a0 con 0x7fde80130bc0 2023-09-30T22:28:04.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.142+0000 7fde858dc700 1 --2- 172.21.15.156:0/3766505080 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fde80130bc0 0x7fde8011df80 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fde7c00c450 tx=0x7fde7c00c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:04.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.142+0000 7fde76ffd700 1 -- 172.21.15.156:0/3766505080 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c004c80 con 0x7fde80130bc0 2023-09-30T22:28:04.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.142+0000 7fde76ffd700 1 -- 172.21.15.156:0/3766505080 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7c004e00 con 0x7fde80130bc0 2023-09-30T22:28:04.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.142+0000 7fde88341700 1 -- 172.21.15.156:0/3766505080 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde78009a70 con 0x7fde80130bc0 2023-09-30T22:28:04.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.142+0000 7fde76ffd700 1 -- 172.21.15.156:0/3766505080 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c007310 con 0x7fde80130bc0 2023-09-30T22:28:04.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.143+0000 7fde88341700 1 -- 172.21.15.156:0/3766505080 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8011f2e0 con 0x7fde80130bc0 2023-09-30T22:28:04.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.143+0000 7fde76ffd700 1 -- 172.21.15.156:0/3766505080 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fde7c007470 con 0x7fde80130bc0 2023-09-30T22:28:04.150 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.143+0000 7fde88341700 1 -- 172.21.15.156:0/3766505080 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde8011fa10 con 0x7fde80130bc0 2023-09-30T22:28:04.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.143+0000 7fde76ffd700 1 -- 172.21.15.156:0/3766505080 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fde7c03f300 con 0x7fde80130bc0 2023-09-30T22:28:04.151 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.148+0000 7fde76ffd700 1 -- 172.21.15.156:0/3766505080 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fde8011fa10 con 0x7fde80130bc0 2023-09-30T22:28:04.345 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.345+0000 7fde88341700 1 -- 172.21.15.156:0/3766505080 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fde8011fa10 con 0x7fde80130bc0 2023-09-30T22:28:04.346 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.345+0000 7fde76ffd700 1 -- 172.21.15.156:0/3766505080 <== mon.1 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 11 entries v39) v1 ==== 81+0+649 (secure 0 0 0) 0x7fde8011fa10 con 0x7fde80130bc0 2023-09-30T22:28:04.346 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156:6816/126965 2023-10-01T22:19:32.500218+0000 2023-09-30T22:28:04.346 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156:0/1669701082 2023-10-01T22:19:32.500218+0000 2023-09-30T22:28:04.346 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156:0/1136044187 2023-10-01T22:19:32.500218+0000 2023-09-30T22:28:04.347 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156:0/2593263545 2023-10-01T22:18:37.767496+0000 2023-09-30T22:28:04.347 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156:0/3331241925 2023-10-01T22:19:32.500218+0000 2023-09-30T22:28:04.347 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156:0/1464735255 2023-10-01T22:18:37.767496+0000 2023-09-30T22:28:04.347 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156:0/417912451 2023-10-01T22:19:32.500218+0000 2023-09-30T22:28:04.347 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156:0/1153199602 2023-10-01T22:19:32.500218+0000 2023-09-30T22:28:04.347 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156:6816/118236 2023-10-01T22:18:37.767496+0000 2023-09-30T22:28:04.347 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156:6817/3817969673 2023-10-01T22:19:00.677676+0000 2023-09-30T22:28:04.347 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156:0/1695265592 2023-10-01T22:19:32.500218+0000 2023-09-30T22:28:04.348 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.347+0000 7fde88341700 1 -- 172.21.15.156:0/3766505080 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fde80130bc0 msgr2=0x7fde8011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.347+0000 7fde88341700 1 --2- 172.21.15.156:0/3766505080 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fde80130bc0 0x7fde8011df80 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fde7c00c450 tx=0x7fde7c00c760 comp rx=0 tx=0).stop 2023-09-30T22:28:04.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.347+0000 7fde88341700 1 -- 172.21.15.156:0/3766505080 shutdown_connections 2023-09-30T22:28:04.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.347+0000 7fde88341700 1 --2- 172.21.15.156:0/3766505080 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fde80133ad0 0x7fde8011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.347+0000 7fde88341700 1 --2- 172.21.15.156:0/3766505080 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde801300a0 0x7fde8011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.347+0000 7fde88341700 1 --2- 172.21.15.156:0/3766505080 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fde80130bc0 0x7fde8011df80 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.347+0000 7fde88341700 1 -- 172.21.15.156:0/3766505080 >> 172.21.15.156:0/3766505080 conn(0x7fde80099c40 msgr2=0x7fde80132c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:04.349 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.347+0000 7fde88341700 1 -- 172.21.15.156:0/3766505080 shutdown_connections 2023-09-30T22:28:04.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.347+0000 7fde88341700 1 -- 172.21.15.156:0/3766505080 wait complete. 2023-09-30T22:28:04.350 INFO:teuthology.orchestra.run.smithi156.stderr:listed 11 entries 2023-09-30T22:28:04.361 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-09-30T22:28:04.416 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T22:28:04.439 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:28:04.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.559+0000 7fd543d2e700 1 Processor -- start 2023-09-30T22:28:04.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.559+0000 7fd543d2e700 1 -- start start 2023-09-30T22:28:04.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.560+0000 7fd543d2e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd53c131980 0x7fd53c131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.560+0000 7fd543d2e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd53c09c790 0x7fd53c139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.560+0000 7fd543d2e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd53c0a1640 con 0x7fd53c09bc70 2023-09-30T22:28:04.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.560+0000 7fd543d2e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c06eb30 con 0x7fd53c09c790 2023-09-30T22:28:04.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.560+0000 7fd543d2e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0a22d0 con 0x7fd53c131980 2023-09-30T22:28:04.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.560+0000 7fd5422cb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd53c09c790 0x7fd53c139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.560+0000 7fd5412c9700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fd53c09bc70 0x7fd53c09c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53150/0 (socket says 172.21.15.156:53150) 2023-09-30T22:28:04.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.560+0000 7fd5412c9700 1 -- 172.21.15.156:0/437798551 learned_addr learned my addr 172.21.15.156:0/437798551 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-30T22:28:04.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.560+0000 7fd541aca700 1 --2- 172.21.15.156:0/437798551 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd53c131980 0x7fd53c131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.560+0000 7fd540ac8700 1 -- 172.21.15.156:0/437798551 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3418207764 0 0) 0x7fd53c0a1640 con 0x7fd53c09bc70 2023-09-30T22:28:04.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.560+0000 7fd540ac8700 1 -- 172.21.15.156:0/437798551 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5280035b0 con 0x7fd53c09bc70 2023-09-30T22:28:04.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.560+0000 7fd5422cb700 1 -- 172.21.15.156:0/437798551 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd53c131980 msgr2=0x7fd53c131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:04.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.560+0000 7fd5422cb700 1 --2- 172.21.15.156:0/437798551 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd53c131980 0x7fd53c131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.560+0000 7fd5422cb700 1 -- 172.21.15.156:0/437798551 >> v1:172.21.15.156:6789/0 conn(0x7fd53c09bc70 legacy=0x7fd53c09c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.560+0000 7fd5422cb700 1 -- 172.21.15.156:0/437798551 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c131550 con 0x7fd53c09c790 2023-09-30T22:28:04.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.560+0000 7fd5422cb700 1 --2- 172.21.15.156:0/437798551 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd53c09c790 0x7fd53c139710 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fd534009dc0 tx=0x7fd53400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc9dbd5a3d81e0eb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:04.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.560+0000 7fd540ac8700 1 -- 172.21.15.156:0/437798551 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53400e070 con 0x7fd53c09c790 2023-09-30T22:28:04.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.561+0000 7fd540ac8700 1 -- 172.21.15.156:0/437798551 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53400bb20 con 0x7fd53c09c790 2023-09-30T22:28:04.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.561+0000 7fd540ac8700 1 -- 172.21.15.156:0/437798551 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534012430 con 0x7fd53c09c790 2023-09-30T22:28:04.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.561+0000 7fd543d2e700 1 -- 172.21.15.156:0/437798551 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd53c09c790 msgr2=0x7fd53c139710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.561+0000 7fd543d2e700 1 --2- 172.21.15.156:0/437798551 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd53c09c790 0x7fd53c139710 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fd534009dc0 tx=0x7fd53400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:04.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.561+0000 7fd543d2e700 1 -- 172.21.15.156:0/437798551 shutdown_connections 2023-09-30T22:28:04.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.561+0000 7fd543d2e700 1 --2- 172.21.15.156:0/437798551 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd53c09c790 0x7fd53c139710 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.561+0000 7fd543d2e700 1 --2- 172.21.15.156:0/437798551 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd53c131980 0x7fd53c131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.561+0000 7fd543d2e700 1 -- 172.21.15.156:0/437798551 >> 172.21.15.156:0/437798551 conn(0x7fd53c0a2980 msgr2=0x7fd53c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:04.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.561+0000 7fd543d2e700 1 -- 172.21.15.156:0/437798551 shutdown_connections 2023-09-30T22:28:04.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.561+0000 7fd543d2e700 1 -- 172.21.15.156:0/437798551 wait complete. 2023-09-30T22:28:04.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.562+0000 7fd543d2e700 1 Processor -- start 2023-09-30T22:28:04.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.562+0000 7fd543d2e700 1 -- start start 2023-09-30T22:28:04.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.562+0000 7fd543d2e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd53c09bc70 0x7fd53c11b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.562+0000 7fd543d2e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd53c09c790 0x7fd53c11bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.562+0000 7fd543d2e700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd53c131980 0x7fd53c11c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.562+0000 7fd543d2e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c11da40 con 0x7fd53c09bc70 2023-09-30T22:28:04.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.562+0000 7fd543d2e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c11f300 con 0x7fd53c09c790 2023-09-30T22:28:04.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.562+0000 7fd543d2e700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c11e6d0 con 0x7fd53c131980 2023-09-30T22:28:04.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.563+0000 7fd5412c9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd53c09c790 0x7fd53c11bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.563+0000 7fd541aca700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd53c09bc70 0x7fd53c11b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.563+0000 7fd5412c9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd53c09c790 0x7fd53c11bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:34982/0 (socket says 172.21.15.156:34982) 2023-09-30T22:28:04.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.563+0000 7fd5412c9700 1 -- 172.21.15.156:0/1398531029 learned_addr learned my addr 172.21.15.156:0/1398531029 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:28:04.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.563+0000 7fd5422cb700 1 --2- 172.21.15.156:0/1398531029 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd53c131980 0x7fd53c11c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.563+0000 7fd5422cb700 1 -- 172.21.15.156:0/1398531029 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd53c09c790 msgr2=0x7fd53c11bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.563+0000 7fd5422cb700 1 --2- 172.21.15.156:0/1398531029 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd53c09c790 0x7fd53c11bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.563+0000 7fd5422cb700 1 -- 172.21.15.156:0/1398531029 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd53c09bc70 msgr2=0x7fd53c11b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.563+0000 7fd5422cb700 1 --2- 172.21.15.156:0/1398531029 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd53c09bc70 0x7fd53c11b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.563+0000 7fd5422cb700 1 -- 172.21.15.156:0/1398531029 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd534009a70 con 0x7fd53c131980 2023-09-30T22:28:04.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.563+0000 7fd5412c9700 1 --2- 172.21.15.156:0/1398531029 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd53c09c790 0x7fd53c11bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:04.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.563+0000 7fd541aca700 1 --2- 172.21.15.156:0/1398531029 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd53c09bc70 0x7fd53c11b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:04.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.563+0000 7fd5422cb700 1 --2- 172.21.15.156:0/1398531029 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd53c131980 0x7fd53c11c260 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fd534016000 tx=0x7fd534004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:04.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.563+0000 7fd5327fc700 1 -- 172.21.15.156:0/1398531029 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534012430 con 0x7fd53c131980 2023-09-30T22:28:04.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.563+0000 7fd5327fc700 1 -- 172.21.15.156:0/1398531029 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd534020070 con 0x7fd53c131980 2023-09-30T22:28:04.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.563+0000 7fd543d2e700 1 -- 172.21.15.156:0/1398531029 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53c11cc40 con 0x7fd53c131980 2023-09-30T22:28:04.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.563+0000 7fd5327fc700 1 -- 172.21.15.156:0/1398531029 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534004280 con 0x7fd53c131980 2023-09-30T22:28:04.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.563+0000 7fd543d2e700 1 -- 172.21.15.156:0/1398531029 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53c11d3f0 con 0x7fd53c131980 2023-09-30T22:28:04.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.564+0000 7fd5327fc700 1 -- 172.21.15.156:0/1398531029 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd5340043e0 con 0x7fd53c131980 2023-09-30T22:28:04.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.564+0000 7fd5327fc700 1 -- 172.21.15.156:0/1398531029 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd534022070 con 0x7fd53c131980 2023-09-30T22:28:04.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.564+0000 7fd543d2e700 1 -- 172.21.15.156:0/1398531029 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53c0a3000 con 0x7fd53c131980 2023-09-30T22:28:04.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.569+0000 7fd5327fc700 1 -- 172.21.15.156:0/1398531029 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd53401a970 con 0x7fd53c131980 2023-09-30T22:28:04.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.754+0000 7fd543d2e700 1 -- 172.21.15.156:0/1398531029 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd53c04f2a0 con 0x7fd53c131980 2023-09-30T22:28:04.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.755+0000 7fd5327fc700 1 -- 172.21.15.156:0/1398531029 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+13483 (secure 0 0 0) 0x7fd534035090 con 0x7fd53c131980 2023-09-30T22:28:04.756 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-30T22:28:04.757 INFO:teuthology.orchestra.run.smithi156.stdout:{"epoch":39,"fsid":"bf403786-ca20-4e4a-92c0-a0a997d43bba","created":"2023-09-30T22:16:15.239992+0000","modified":"2023-09-30T22:19:32.500244+0000","last_up_change":"2023-09-30T22:18:55.822352+0000","last_in_change":"2023-09-30T22:16:16.474206+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:16:23.433906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:16:24.367795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:16:28.204677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:16:28.762804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ec2e78a-c61f-473a-bfcb-f956cffe4095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6803","nonce":129485}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6805","nonce":129485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6807","nonce":129485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6806","nonce":129485}]},"public_addr":"172.21.15.156:6803/129485","cluster_addr":"172.21.15.156:6805/129485","heartbeat_back_addr":"172.21.15.156:6807/129485","heartbeat_front_addr":"172.21.15.156:6806/129485","state":["exists","up"]},{"osd":1,"uuid":"b682e683-c15a-4bd9-8712-8af96454e9ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6808","nonce":129583}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6809","nonce":129583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6811","nonce":129583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6810","nonce":129583}]},"public_addr":"172.21.15.156:6808/129583","cluster_addr":"172.21.15.156:6809/129583","heartbeat_back_addr":"172.21.15.156:6811/129583","heartbeat_front_addr":"172.21.15.156:6810/129583","state":["exists","up"]},{"osd":2,"uuid":"960dbaf0-2e0c-437e-9114-bc22ce522b26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6800","nonce":129693}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6801","nonce":129693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6804","nonce":129693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6802","nonce":129693}]},"public_addr":"172.21.15.156:6800/129693","cluster_addr":"172.21.15.156:6801/129693","heartbeat_back_addr":"172.21.15.156:6804/129693","heartbeat_front_addr":"172.21.15.156:6802/129693","state":["exists","up"]},{"osd":3,"uuid":"c1b19714-78b1-4869-8721-2f6352a64a05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6812","nonce":129849}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6813","nonce":129849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6815","nonce":129849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.156:6814","nonce":129849}]},"public_addr":"172.21.15.156:6812/129849","cluster_addr":"172.21.15.156:6813/129849","heartbeat_back_addr":"172.21.15.156:6815/129849","heartbeat_front_addr":"172.21.15.156:6814/129849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.663343+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.827397+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.806655+0000","dead_epoch":25},{"osd":3,"down_stamp":"2023-09-30T22:18:49.807414+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:16:21.634746+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.2","mappings":[{"from":3,"to":0}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.156:6816/126965":"2023-10-01T22:19:32.500218+0000","172.21.15.156:0/1669701082":"2023-10-01T22:19:32.500218+0000","172.21.15.156:0/1136044187":"2023-10-01T22:19:32.500218+0000","172.21.15.156:0/2593263545":"2023-10-01T22:18:37.767496+0000","172.21.15.156:0/3331241925":"2023-10-01T22:19:32.500218+0000","172.21.15.156:0/1464735255":"2023-10-01T22:18:37.767496+0000","172.21.15.156:0/417912451":"2023-10-01T22:19:32.500218+0000","172.21.15.156:0/1153199602":"2023-10-01T22:19:32.500218+0000","172.21.15.156:6816/118236":"2023-10-01T22:18:37.767496+0000","172.21.15.156:6817/3817969673":"2023-10-01T22:19:00.677676+0000","172.21.15.156:0/1695265592":"2023-10-01T22:19:32.500218+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:28:04.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.758+0000 7fd543d2e700 1 -- 172.21.15.156:0/1398531029 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd53c131980 msgr2=0x7fd53c11c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.758+0000 7fd543d2e700 1 --2- 172.21.15.156:0/1398531029 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd53c131980 0x7fd53c11c260 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fd534016000 tx=0x7fd534004ad0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.758+0000 7fd543d2e700 1 -- 172.21.15.156:0/1398531029 shutdown_connections 2023-09-30T22:28:04.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.758+0000 7fd543d2e700 1 --2- 172.21.15.156:0/1398531029 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7fd53c131980 0x7fd53c11c260 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.758+0000 7fd543d2e700 1 --2- 172.21.15.156:0/1398531029 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd53c09bc70 0x7fd53c11b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.758+0000 7fd543d2e700 1 --2- 172.21.15.156:0/1398531029 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd53c09c790 0x7fd53c11bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.758+0000 7fd543d2e700 1 -- 172.21.15.156:0/1398531029 >> 172.21.15.156:0/1398531029 conn(0x7fd53c0a2980 msgr2=0x7fd53c09f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:04.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.758+0000 7fd543d2e700 1 -- 172.21.15.156:0/1398531029 shutdown_connections 2023-09-30T22:28:04.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.758+0000 7fd543d2e700 1 -- 172.21.15.156:0/1398531029 wait complete. 2023-09-30T22:28:04.771 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:16:23.433906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:16:24.367795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:16:28.204677+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:16:28.762804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.059999942779541, 'score_stable': 1.059999942779541, 'optimal_score': 1, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T22:28:04.772 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:28:04.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.896+0000 7f87dfa7f700 1 Processor -- start 2023-09-30T22:28:04.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.896+0000 7f87dfa7f700 1 -- start start 2023-09-30T22:28:04.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.896+0000 7f87dfa7f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87d809d780 0x7f87d809db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.896+0000 7f87dfa7f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87d809e090 0x7f87d8130680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.896+0000 7f87dfa7f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f87d8130bc0 0x7f87d8131060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.896+0000 7f87dfa7f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d809d430 con 0x7f87d8130bc0 2023-09-30T22:28:04.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.896+0000 7f87dfa7f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d809e910 con 0x7f87d809e090 2023-09-30T22:28:04.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.896+0000 7f87dfa7f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87d809b380 con 0x7f87d809d780 2023-09-30T22:28:04.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.896+0000 7f87de01c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f87d8130bc0 0x7f87d8131060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.897+0000 7f87dd81b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87d809d780 0x7f87d809db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.896+0000 7f87dd01a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87d809e090 0x7f87d8130680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.897+0000 7f87dd81b700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87d809d780 0x7f87d809db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56036/0 (socket says 172.21.15.156:56036) 2023-09-30T22:28:04.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.897+0000 7f87de01c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f87d8130bc0 0x7f87d8131060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52980/0 (socket says 172.21.15.156:52980) 2023-09-30T22:28:04.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.897+0000 7f87dd81b700 1 -- 172.21.15.156:0/3575051467 learned_addr learned my addr 172.21.15.156:0/3575051467 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:28:04.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.897+0000 7f87de01c700 1 -- 172.21.15.156:0/3575051467 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87d809d780 msgr2=0x7f87d809db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:04.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.897+0000 7f87de01c700 1 --2- 172.21.15.156:0/3575051467 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87d809d780 0x7f87d809db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.897+0000 7f87de01c700 1 -- 172.21.15.156:0/3575051467 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87d809e090 msgr2=0x7f87d8130680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:04.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.897+0000 7f87de01c700 1 --2- 172.21.15.156:0/3575051467 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87d809e090 0x7f87d8130680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.897+0000 7f87de01c700 1 -- 172.21.15.156:0/3575051467 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d809f570 con 0x7f87d8130bc0 2023-09-30T22:28:04.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.897+0000 7f87dd81b700 1 --2- 172.21.15.156:0/3575051467 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87d809d780 0x7f87d809db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:04.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.897+0000 7f87dd01a700 1 --2- 172.21.15.156:0/3575051467 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87d809e090 0x7f87d8130680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:04.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.897+0000 7f87de01c700 1 --2- 172.21.15.156:0/3575051467 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87d8130bc0 0x7f87d8131060 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f87d0009d90 tx=0x7f87d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32751f688522d6c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:04.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.897+0000 7f87dc819700 1 -- 172.21.15.156:0/3575051467 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d000e070 con 0x7f87d8130bc0 2023-09-30T22:28:04.905 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.897+0000 7f87dc819700 1 -- 172.21.15.156:0/3575051467 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d000bb20 con 0x7f87d8130bc0 2023-09-30T22:28:04.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.897+0000 7f87dc819700 1 -- 172.21.15.156:0/3575051467 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d0012430 con 0x7f87d8130bc0 2023-09-30T22:28:04.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.898+0000 7f87dfa7f700 1 -- 172.21.15.156:0/3575051467 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87d8130bc0 msgr2=0x7f87d8131060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.898+0000 7f87dfa7f700 1 --2- 172.21.15.156:0/3575051467 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87d8130bc0 0x7f87d8131060 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f87d0009d90 tx=0x7f87d000b330 comp rx=0 tx=0).stop 2023-09-30T22:28:04.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.898+0000 7f87dfa7f700 1 -- 172.21.15.156:0/3575051467 shutdown_connections 2023-09-30T22:28:04.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.898+0000 7f87dfa7f700 1 --2- 172.21.15.156:0/3575051467 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87d8130bc0 0x7f87d8131060 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.898+0000 7f87dfa7f700 1 --2- 172.21.15.156:0/3575051467 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87d809d780 0x7f87d809db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.898+0000 7f87dfa7f700 1 --2- 172.21.15.156:0/3575051467 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87d809e090 0x7f87d8130680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.898+0000 7f87dfa7f700 1 -- 172.21.15.156:0/3575051467 >> 172.21.15.156:0/3575051467 conn(0x7f87d809f980 msgr2=0x7f87d809fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:04.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.898+0000 7f87dfa7f700 1 -- 172.21.15.156:0/3575051467 shutdown_connections 2023-09-30T22:28:04.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.898+0000 7f87dfa7f700 1 -- 172.21.15.156:0/3575051467 wait complete. 2023-09-30T22:28:04.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.899+0000 7f87dfa7f700 1 Processor -- start 2023-09-30T22:28:04.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.899+0000 7f87dfa7f700 1 -- start start 2023-09-30T22:28:04.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.899+0000 7f87dfa7f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87d809d780 0x7f87d81200d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.899+0000 7f87dfa7f700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87d809e090 0x7f87d8120610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.899+0000 7f87dfa7f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87d8130bc0 0x7f87d8120b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.908 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.899+0000 7f87dfa7f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d81212e0 con 0x7f87d809d780 2023-09-30T22:28:04.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.899+0000 7f87dfa7f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d809c8d0 con 0x7f87d8130bc0 2023-09-30T22:28:04.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.899+0000 7f87dfa7f700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87d809a0e0 con 0x7f87d809e090 2023-09-30T22:28:04.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.899+0000 7f87dd81b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87d809d780 0x7f87d81200d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.899+0000 7f87dd81b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87d809d780 0x7f87d81200d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:52990/0 (socket says 172.21.15.156:52990) 2023-09-30T22:28:04.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.899+0000 7f87dd01a700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87d809e090 0x7f87d8120610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.899+0000 7f87dd81b700 1 -- 172.21.15.156:0/2833701823 learned_addr learned my addr 172.21.15.156:0/2833701823 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:28:04.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.899+0000 7f87de01c700 1 --2- 172.21.15.156:0/2833701823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87d8130bc0 0x7f87d8120b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.900+0000 7f87dd01a700 1 -- 172.21.15.156:0/2833701823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87d8130bc0 msgr2=0x7f87d8120b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.900+0000 7f87dd01a700 1 --2- 172.21.15.156:0/2833701823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87d8130bc0 0x7f87d8120b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.900+0000 7f87dd01a700 1 -- 172.21.15.156:0/2833701823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87d809d780 msgr2=0x7f87d81200d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.900+0000 7f87dd01a700 1 --2- 172.21.15.156:0/2833701823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87d809d780 0x7f87d81200d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.900+0000 7f87dd01a700 1 -- 172.21.15.156:0/2833701823 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d4009550 con 0x7f87d809e090 2023-09-30T22:28:04.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.900+0000 7f87de01c700 1 --2- 172.21.15.156:0/2833701823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87d8130bc0 0x7f87d8120b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:04.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.900+0000 7f87dd01a700 1 --2- 172.21.15.156:0/2833701823 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87d809e090 0x7f87d8120610 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f87c800e980 tx=0x7f87c800ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:04.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.900+0000 7f87ce7fc700 1 -- 172.21.15.156:0/2833701823 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c800c690 con 0x7f87d809e090 2023-09-30T22:28:04.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.900+0000 7f87ce7fc700 1 -- 172.21.15.156:0/2833701823 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c800c7f0 con 0x7f87d809e090 2023-09-30T22:28:04.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.900+0000 7f87dfa7f700 1 -- 172.21.15.156:0/2833701823 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c80094a0 con 0x7f87d809e090 2023-09-30T22:28:04.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.900+0000 7f87ce7fc700 1 -- 172.21.15.156:0/2833701823 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c800cb80 con 0x7f87d809e090 2023-09-30T22:28:04.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.900+0000 7f87dfa7f700 1 -- 172.21.15.156:0/2833701823 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d0009a70 con 0x7f87d809e090 2023-09-30T22:28:04.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.901+0000 7f87ce7fc700 1 -- 172.21.15.156:0/2833701823 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f87c800cce0 con 0x7f87d809e090 2023-09-30T22:28:04.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.901+0000 7f87ce7fc700 1 -- 172.21.15.156:0/2833701823 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f87c803f9f0 con 0x7f87d809e090 2023-09-30T22:28:04.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.901+0000 7f87dfa7f700 1 -- 172.21.15.156:0/2833701823 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87d804f2a0 con 0x7f87d809e090 2023-09-30T22:28:04.913 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:04.905+0000 7f87ce7fc700 1 -- 172.21.15.156:0/2833701823 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f87c8017070 con 0x7f87d809e090 2023-09-30T22:28:05.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.088+0000 7f87dfa7f700 1 -- 172.21.15.156:0/2833701823 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f87d809b5a0 con 0x7f87d809e090 2023-09-30T22:28:05.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.089+0000 7f87ce7fc700 1 -- 172.21.15.156:0/2833701823 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f87c802a0a0 con 0x7f87d809e090 2023-09-30T22:28:05.090 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 1 2023-09-30T22:28:05.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.091+0000 7f87dfa7f700 1 -- 172.21.15.156:0/2833701823 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87d809e090 msgr2=0x7f87d8120610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.091+0000 7f87dfa7f700 1 --2- 172.21.15.156:0/2833701823 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87d809e090 0x7f87d8120610 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f87c800e980 tx=0x7f87c800ec90 comp rx=0 tx=0).stop 2023-09-30T22:28:05.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.091+0000 7f87dfa7f700 1 -- 172.21.15.156:0/2833701823 shutdown_connections 2023-09-30T22:28:05.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.091+0000 7f87dfa7f700 1 --2- 172.21.15.156:0/2833701823 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f87d8130bc0 0x7f87d8120b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.091+0000 7f87dfa7f700 1 --2- 172.21.15.156:0/2833701823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87d809d780 0x7f87d81200d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.091+0000 7f87dfa7f700 1 --2- 172.21.15.156:0/2833701823 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f87d809e090 0x7f87d8120610 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.091+0000 7f87dfa7f700 1 -- 172.21.15.156:0/2833701823 >> 172.21.15.156:0/2833701823 conn(0x7f87d809f980 msgr2=0x7f87d80a2360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:05.092 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.091+0000 7f87dfa7f700 1 -- 172.21.15.156:0/2833701823 shutdown_connections 2023-09-30T22:28:05.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.091+0000 7f87dfa7f700 1 -- 172.21.15.156:0/2833701823 wait complete. 2023-09-30T22:28:05.103 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:28:05.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.227+0000 7f725e148700 1 Processor -- start 2023-09-30T22:28:05.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.227+0000 7f725e148700 1 -- start start 2023-09-30T22:28:05.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.227+0000 7f725e148700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f725809e870 0x7f725809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.227+0000 7f725e148700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f725809f180 0x7f7258133b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.227+0000 7f725e148700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f72581340c0 0x7f7258134560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.227+0000 7f725e148700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f725809af40 con 0x7f72581340c0 2023-09-30T22:28:05.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.227+0000 7f725e148700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725806b990 con 0x7f725809f180 2023-09-30T22:28:05.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.227+0000 7f725e148700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f725806bec0 con 0x7f725809e870 2023-09-30T22:28:05.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.227+0000 7f7257fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f72581340c0 0x7f7258134560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.227+0000 7f72577fe700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f725809e870 0x7f725809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.227+0000 7f7257fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f72581340c0 0x7f7258134560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:53006/0 (socket says 172.21.15.156:53006) 2023-09-30T22:28:05.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.227+0000 7f7256ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f725809f180 0x7f7258133b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.227+0000 7f7257fff700 1 -- 172.21.15.156:0/123686059 learned_addr learned my addr 172.21.15.156:0/123686059 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:28:05.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.228+0000 7f72577fe700 1 -- 172.21.15.156:0/123686059 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f725809f180 msgr2=0x7f7258133b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:05.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.228+0000 7f72577fe700 1 --2- 172.21.15.156:0/123686059 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f725809f180 0x7f7258133b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.228+0000 7f72577fe700 1 -- 172.21.15.156:0/123686059 >> v2:172.21.15.156:3300/0 conn(0x7f72581340c0 msgr2=0x7f7258134560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:05.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.228+0000 7f72577fe700 1 --2- 172.21.15.156:0/123686059 >> v2:172.21.15.156:3300/0 conn(0x7f72581340c0 0x7f7258134560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.228+0000 7f72577fe700 1 -- 172.21.15.156:0/123686059 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72580a0870 con 0x7f725809e870 2023-09-30T22:28:05.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.228+0000 7f7256ffd700 1 --2- 172.21.15.156:0/123686059 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f725809f180 0x7f7258133b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:05.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.228+0000 7f7257fff700 1 --2- 172.21.15.156:0/123686059 >> v2:172.21.15.156:3300/0 conn(0x7f72581340c0 0x7f7258134560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:05.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.228+0000 7f72577fe700 1 --2- 172.21.15.156:0/123686059 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f725809e870 0x7f725809ec40 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7248009820 tx=0x7f7248009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fa71cceea0e0c05 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:05.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.228+0000 7f72567fc700 1 -- 172.21.15.156:0/123686059 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7248005e30 con 0x7f725809e870 2023-09-30T22:28:05.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.228+0000 7f72567fc700 1 -- 172.21.15.156:0/123686059 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7248006030 con 0x7f725809e870 2023-09-30T22:28:05.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.228+0000 7f72567fc700 1 -- 172.21.15.156:0/123686059 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72480063c0 con 0x7f725809e870 2023-09-30T22:28:05.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.228+0000 7f725e148700 1 -- 172.21.15.156:0/123686059 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f725809e870 msgr2=0x7f725809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.228+0000 7f725e148700 1 --2- 172.21.15.156:0/123686059 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f725809e870 0x7f725809ec40 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7248009820 tx=0x7f7248009b30 comp rx=0 tx=0).stop 2023-09-30T22:28:05.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.228+0000 7f725e148700 1 -- 172.21.15.156:0/123686059 shutdown_connections 2023-09-30T22:28:05.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.228+0000 7f725e148700 1 --2- 172.21.15.156:0/123686059 >> v2:172.21.15.156:3300/0 conn(0x7f72581340c0 0x7f7258134560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.228+0000 7f725e148700 1 --2- 172.21.15.156:0/123686059 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f725809e870 0x7f725809ec40 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.228+0000 7f725e148700 1 --2- 172.21.15.156:0/123686059 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f725809f180 0x7f7258133b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.228+0000 7f725e148700 1 -- 172.21.15.156:0/123686059 >> 172.21.15.156:0/123686059 conn(0x7f72580a4390 msgr2=0x7f72580a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:05.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.228+0000 7f725e148700 1 -- 172.21.15.156:0/123686059 shutdown_connections 2023-09-30T22:28:05.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.228+0000 7f725e148700 1 -- 172.21.15.156:0/123686059 wait complete. 2023-09-30T22:28:05.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.230+0000 7f725e148700 1 Processor -- start 2023-09-30T22:28:05.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.230+0000 7f725e148700 1 -- start start 2023-09-30T22:28:05.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.230+0000 7f725e148700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f725809e870 0x7f7258122780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.230+0000 7f725e148700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f725809f180 0x7f7258122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.230+0000 7f725e148700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72581340c0 0x7f7258123200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.230+0000 7f725e148700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7258123c50 con 0x7f725809e870 2023-09-30T22:28:05.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.230+0000 7f725e148700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7258124300 con 0x7f725809f180 2023-09-30T22:28:05.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.230+0000 7f725e148700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72580a04b0 con 0x7f72581340c0 2023-09-30T22:28:05.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.231+0000 7f7256ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f725809f180 0x7f7258122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.231+0000 7f7257fff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72581340c0 0x7f7258123200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.231+0000 7f7256ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f725809f180 0x7f7258122cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:35016/0 (socket says 172.21.15.156:35016) 2023-09-30T22:28:05.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.231+0000 7f7256ffd700 1 -- 172.21.15.156:0/2783122455 learned_addr learned my addr 172.21.15.156:0/2783122455 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:28:05.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.231+0000 7f72577fe700 1 --2- 172.21.15.156:0/2783122455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f725809e870 0x7f7258122780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.231+0000 7f7257fff700 1 -- 172.21.15.156:0/2783122455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f725809f180 msgr2=0x7f7258122cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.231+0000 7f7257fff700 1 --2- 172.21.15.156:0/2783122455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f725809f180 0x7f7258122cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.231+0000 7f7257fff700 1 -- 172.21.15.156:0/2783122455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f725809e870 msgr2=0x7f7258122780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.231+0000 7f7257fff700 1 --2- 172.21.15.156:0/2783122455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f725809e870 0x7f7258122780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.231+0000 7f7257fff700 1 -- 172.21.15.156:0/2783122455 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72400094a0 con 0x7f72581340c0 2023-09-30T22:28:05.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.231+0000 7f7257fff700 1 --2- 172.21.15.156:0/2783122455 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72581340c0 0x7f7258123200 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f7250009e50 tx=0x7f725000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:05.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.231+0000 7f724ffff700 1 -- 172.21.15.156:0/2783122455 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7250018070 con 0x7f72581340c0 2023-09-30T22:28:05.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.231+0000 7f724ffff700 1 -- 172.21.15.156:0/2783122455 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725000f040 con 0x7f72581340c0 2023-09-30T22:28:05.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.231+0000 7f725e148700 1 -- 172.21.15.156:0/2783122455 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7250009b30 con 0x7f72581340c0 2023-09-30T22:28:05.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.231+0000 7f724ffff700 1 -- 172.21.15.156:0/2783122455 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7250003c40 con 0x7f72581340c0 2023-09-30T22:28:05.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.231+0000 7f725e148700 1 -- 172.21.15.156:0/2783122455 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7248009430 con 0x7f72581340c0 2023-09-30T22:28:05.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.232+0000 7f724ffff700 1 -- 172.21.15.156:0/2783122455 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f725000c880 con 0x7f72581340c0 2023-09-30T22:28:05.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.232+0000 7f724ffff700 1 -- 172.21.15.156:0/2783122455 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f725003f730 con 0x7f72581340c0 2023-09-30T22:28:05.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.232+0000 7f725e148700 1 -- 172.21.15.156:0/2783122455 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72580a3ae0 con 0x7f72581340c0 2023-09-30T22:28:05.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.237+0000 7f724ffff700 1 -- 172.21.15.156:0/2783122455 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7250012340 con 0x7f72581340c0 2023-09-30T22:28:05.420 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.420+0000 7f725e148700 1 -- 172.21.15.156:0/2783122455 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7258070f70 con 0x7f72581340c0 2023-09-30T22:28:05.421 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.420+0000 7f724ffff700 1 -- 172.21.15.156:0/2783122455 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v39) v1 ==== 92+0+10 (secure 0 0 0) 0x7f725001de00 con 0x7f72581340c0 2023-09-30T22:28:05.421 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 8 2023-09-30T22:28:05.423 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.422+0000 7f725e148700 1 -- 172.21.15.156:0/2783122455 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72581340c0 msgr2=0x7f7258123200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.422+0000 7f725e148700 1 --2- 172.21.15.156:0/2783122455 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72581340c0 0x7f7258123200 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f7250009e50 tx=0x7f725000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.423+0000 7f725e148700 1 -- 172.21.15.156:0/2783122455 shutdown_connections 2023-09-30T22:28:05.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.423+0000 7f725e148700 1 --2- 172.21.15.156:0/2783122455 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f72581340c0 0x7f7258123200 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.423+0000 7f725e148700 1 --2- 172.21.15.156:0/2783122455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f725809e870 0x7f7258122780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.423+0000 7f725e148700 1 --2- 172.21.15.156:0/2783122455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f725809f180 0x7f7258122cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.423+0000 7f725e148700 1 -- 172.21.15.156:0/2783122455 >> 172.21.15.156:0/2783122455 conn(0x7f72580a4390 msgr2=0x7f725809d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:05.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.423+0000 7f725e148700 1 -- 172.21.15.156:0/2783122455 shutdown_connections 2023-09-30T22:28:05.424 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.423+0000 7f725e148700 1 -- 172.21.15.156:0/2783122455 wait complete. 2023-09-30T22:28:05.436 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:28:05.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.558+0000 7f830f6d5700 1 Processor -- start 2023-09-30T22:28:05.559 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.558+0000 7f830f6d5700 1 -- start start 2023-09-30T22:28:05.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.558+0000 7f830f6d5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f830809ad70 0x7f8308138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.558+0000 7f830f6d5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f830809e260 0x7f830813b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.558+0000 7f830f6d5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f830809a590 con 0x7f830809d780 2023-09-30T22:28:05.564 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.558+0000 7f830f6d5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f830806b450 con 0x7f830809ad70 2023-09-30T22:28:05.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.558+0000 7f830f6d5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f830806a9e0 con 0x7f830809e260 2023-09-30T22:28:05.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.558+0000 7f830cc70700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f830809ad70 0x7f8308138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.559+0000 7f830dc72700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f830809e260 0x7f830813b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.559+0000 7f830cc70700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f830809ad70 0x7f8308138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:53018/0 (socket says 172.21.15.156:53018) 2023-09-30T22:28:05.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.559+0000 7f830d471700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f830809d780 0x7f830809db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53158/0 (socket says 172.21.15.156:53158) 2023-09-30T22:28:05.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.559+0000 7f830cc70700 1 -- 172.21.15.156:0/2252353771 learned_addr learned my addr 172.21.15.156:0/2252353771 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:28:05.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.559+0000 7f830cc70700 1 -- 172.21.15.156:0/2252353771 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f830809e260 msgr2=0x7f830813b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:05.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.559+0000 7f830cc70700 1 --2- 172.21.15.156:0/2252353771 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f830809e260 0x7f830813b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.559+0000 7f830cc70700 1 -- 172.21.15.156:0/2252353771 >> v1:172.21.15.156:6789/0 conn(0x7f830809d780 legacy=0x7f830809db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.566 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.559+0000 7f830cc70700 1 -- 172.21.15.156:0/2252353771 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830809a870 con 0x7f830809ad70 2023-09-30T22:28:05.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.559+0000 7f82fffff700 1 -- 172.21.15.156:0/2252353771 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1660954933 0 0) 0x7f830809a590 con 0x7f830809d780 2023-09-30T22:28:05.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.559+0000 7f830dc72700 1 --2- 172.21.15.156:0/2252353771 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f830809e260 0x7f830813b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:05.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.559+0000 7f830cc70700 1 --2- 172.21.15.156:0/2252353771 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f830809ad70 0x7f8308138cc0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f82f80098f0 tx=0x7f82f8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3bc34f123825c66 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:05.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.559+0000 7f82fffff700 1 -- 172.21.15.156:0/2252353771 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f8011830 con 0x7f830809ad70 2023-09-30T22:28:05.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.559+0000 7f82fffff700 1 -- 172.21.15.156:0/2252353771 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f8011990 con 0x7f830809ad70 2023-09-30T22:28:05.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.559+0000 7f82fffff700 1 -- 172.21.15.156:0/2252353771 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f8011d20 con 0x7f830809ad70 2023-09-30T22:28:05.567 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.560+0000 7f830f6d5700 1 -- 172.21.15.156:0/2252353771 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f830809ad70 msgr2=0x7f8308138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.560+0000 7f830f6d5700 1 --2- 172.21.15.156:0/2252353771 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f830809ad70 0x7f8308138cc0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f82f80098f0 tx=0x7f82f8009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:05.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.560+0000 7f830f6d5700 1 -- 172.21.15.156:0/2252353771 shutdown_connections 2023-09-30T22:28:05.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.560+0000 7f830f6d5700 1 --2- 172.21.15.156:0/2252353771 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f830809e260 0x7f830813b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.560+0000 7f830f6d5700 1 --2- 172.21.15.156:0/2252353771 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f830809ad70 0x7f8308138cc0 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.568 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.560+0000 7f830f6d5700 1 -- 172.21.15.156:0/2252353771 >> 172.21.15.156:0/2252353771 conn(0x7f830809f980 msgr2=0x7f830809fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:05.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.560+0000 7f830f6d5700 1 -- 172.21.15.156:0/2252353771 shutdown_connections 2023-09-30T22:28:05.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.560+0000 7f830f6d5700 1 -- 172.21.15.156:0/2252353771 wait complete. 2023-09-30T22:28:05.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.561+0000 7f830f6d5700 1 Processor -- start 2023-09-30T22:28:05.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.561+0000 7f830f6d5700 1 -- start start 2023-09-30T22:28:05.569 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.561+0000 7f830f6d5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f830809ad70 0x7f830811e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.561+0000 7f830f6d5700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f830809d780 0x7f830811e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.561+0000 7f830f6d5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f830809e260 0x7f830811eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.561+0000 7f830f6d5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83081225f0 con 0x7f830809ad70 2023-09-30T22:28:05.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.561+0000 7f830f6d5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8308072270 con 0x7f830809e260 2023-09-30T22:28:05.570 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.561+0000 7f830f6d5700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f830811fdc0 con 0x7f830809d780 2023-09-30T22:28:05.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.561+0000 7f830cc70700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f830809d780 0x7f830811e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.561+0000 7f830d471700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f830809ad70 0x7f830811e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.561+0000 7f830cc70700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f830809d780 0x7f830811e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56080/0 (socket says 172.21.15.156:56080) 2023-09-30T22:28:05.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.561+0000 7f830cc70700 1 -- 172.21.15.156:0/3268458407 learned_addr learned my addr 172.21.15.156:0/3268458407 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:28:05.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.561+0000 7f830dc72700 1 --2- 172.21.15.156:0/3268458407 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f830809e260 0x7f830811eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.571 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.561+0000 7f830d471700 1 -- 172.21.15.156:0/3268458407 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f830809d780 msgr2=0x7f830811e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.561+0000 7f830d471700 1 --2- 172.21.15.156:0/3268458407 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f830809d780 0x7f830811e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.561+0000 7f830d471700 1 -- 172.21.15.156:0/3268458407 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f830809e260 msgr2=0x7f830811eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.561+0000 7f830d471700 1 --2- 172.21.15.156:0/3268458407 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f830809e260 0x7f830811eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.561+0000 7f830d471700 1 -- 172.21.15.156:0/3268458407 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8300009a70 con 0x7f830809ad70 2023-09-30T22:28:05.572 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.562+0000 7f830d471700 1 --2- 172.21.15.156:0/3268458407 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f830809ad70 0x7f830811e110 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f830400c470 tx=0x7f830400c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:05.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.562+0000 7f82fdffb700 1 -- 172.21.15.156:0/3268458407 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8304004c80 con 0x7f830809ad70 2023-09-30T22:28:05.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.562+0000 7f82fdffb700 1 -- 172.21.15.156:0/3268458407 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8304004de0 con 0x7f830809ad70 2023-09-30T22:28:05.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.562+0000 7f830f6d5700 1 -- 172.21.15.156:0/3268458407 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f8009550 con 0x7f830809ad70 2023-09-30T22:28:05.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.562+0000 7f82fdffb700 1 -- 172.21.15.156:0/3268458407 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8304007310 con 0x7f830809ad70 2023-09-30T22:28:05.573 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.562+0000 7f830f6d5700 1 -- 172.21.15.156:0/3268458407 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8308120f70 con 0x7f830809ad70 2023-09-30T22:28:05.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.563+0000 7f82fdffb700 1 -- 172.21.15.156:0/3268458407 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8304007470 con 0x7f830809ad70 2023-09-30T22:28:05.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.563+0000 7f82fdffb700 1 -- 172.21.15.156:0/3268458407 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f830403f210 con 0x7f830809ad70 2023-09-30T22:28:05.574 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.563+0000 7f830f6d5700 1 -- 172.21.15.156:0/3268458407 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8308121820 con 0x7f830809ad70 2023-09-30T22:28:05.575 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.568+0000 7f82fdffb700 1 -- 172.21.15.156:0/3268458407 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8304007720 con 0x7f830809ad70 2023-09-30T22:28:05.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.749+0000 7f830f6d5700 1 -- 172.21.15.156:0/3268458407 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f830804f2a0 con 0x7f830809ad70 2023-09-30T22:28:05.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.750+0000 7f82fdffb700 1 -- 172.21.15.156:0/3268458407 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8304011360 con 0x7f830809ad70 2023-09-30T22:28:05.751 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 32 2023-09-30T22:28:05.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.752+0000 7f830f6d5700 1 -- 172.21.15.156:0/3268458407 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f830809ad70 msgr2=0x7f830811e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.752+0000 7f830f6d5700 1 --2- 172.21.15.156:0/3268458407 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f830809ad70 0x7f830811e110 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f830400c470 tx=0x7f830400c780 comp rx=0 tx=0).stop 2023-09-30T22:28:05.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.752+0000 7f830f6d5700 1 -- 172.21.15.156:0/3268458407 shutdown_connections 2023-09-30T22:28:05.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.752+0000 7f830f6d5700 1 --2- 172.21.15.156:0/3268458407 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f830809e260 0x7f830811eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.752+0000 7f830f6d5700 1 --2- 172.21.15.156:0/3268458407 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f830809ad70 0x7f830811e110 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.752+0000 7f830f6d5700 1 --2- 172.21.15.156:0/3268458407 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f830809d780 0x7f830811e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.752+0000 7f830f6d5700 1 -- 172.21.15.156:0/3268458407 >> 172.21.15.156:0/3268458407 conn(0x7f830809f980 msgr2=0x7f8308136b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:05.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.752+0000 7f830f6d5700 1 -- 172.21.15.156:0/3268458407 shutdown_connections 2023-09-30T22:28:05.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.752+0000 7f830f6d5700 1 -- 172.21.15.156:0/3268458407 wait complete. 2023-09-30T22:28:05.765 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:28:05.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.888+0000 7f9c190ff700 1 Processor -- start 2023-09-30T22:28:05.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.888+0000 7f9c190ff700 1 -- start start 2023-09-30T22:28:05.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.888+0000 7f9c190ff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c14131ae0 0x7f9c14131eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.888+0000 7f9c190ff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9c1409f3b0 0x7f9c141399f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.888+0000 7f9c190ff700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c1409add0 con 0x7f9c1409e870 2023-09-30T22:28:05.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.888+0000 7f9c190ff700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c1409bd90 con 0x7f9c1409f3b0 2023-09-30T22:28:05.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.888+0000 7f9c190ff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1409b680 con 0x7f9c14131ae0 2023-09-30T22:28:05.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.888+0000 7f9c12d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c14131ae0 0x7f9c14131eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.888+0000 7f9c1359e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9c1409f3b0 0x7f9c141399f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.888+0000 7f9c1359e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9c1409f3b0 0x7f9c141399f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:53034/0 (socket says 172.21.15.156:53034) 2023-09-30T22:28:05.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.888+0000 7f9c12d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c14131ae0 0x7f9c14131eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:35030/0 (socket says 172.21.15.156:35030) 2023-09-30T22:28:05.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.888+0000 7f9c1359e700 1 -- 172.21.15.156:0/1790419678 learned_addr learned my addr 172.21.15.156:0/1790419678 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:28:05.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.888+0000 7f9c1259c700 1 --1- 172.21.15.156:0/1790419678 >> v1:172.21.15.156:6789/0 conn(0x7f9c1409e870 0x7f9c1409eca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53166/0 (socket says 172.21.15.156:53166) 2023-09-30T22:28:05.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.889+0000 7f9c1359e700 1 -- 172.21.15.156:0/1790419678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c14131ae0 msgr2=0x7f9c14131eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:05.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.889+0000 7f9c1359e700 1 --2- 172.21.15.156:0/1790419678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c14131ae0 0x7f9c14131eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.889+0000 7f9c1359e700 1 -- 172.21.15.156:0/1790419678 >> v1:172.21.15.156:6789/0 conn(0x7f9c1409e870 legacy=0x7f9c1409eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.889+0000 7f9c1359e700 1 -- 172.21.15.156:0/1790419678 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1409c970 con 0x7f9c1409f3b0 2023-09-30T22:28:05.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.889+0000 7f9c11d9b700 1 -- 172.21.15.156:0/1790419678 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821983827 0 0) 0x7f9c1409add0 con 0x7f9c1409e870 2023-09-30T22:28:05.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.889+0000 7f9c12d9d700 1 --2- 172.21.15.156:0/1790419678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c14131ae0 0x7f9c14131eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:05.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.889+0000 7f9c1359e700 1 --2- 172.21.15.156:0/1790419678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c1409f3b0 0x7f9c141399f0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c009e50 tx=0x7f9c0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90931e2b12f91945 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:05.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.889+0000 7f9c11d9b700 1 -- 172.21.15.156:0/1790419678 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c00e070 con 0x7f9c1409f3b0 2023-09-30T22:28:05.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.889+0000 7f9c11d9b700 1 -- 172.21.15.156:0/1790419678 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0c00b910 con 0x7f9c1409f3b0 2023-09-30T22:28:05.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.889+0000 7f9c11d9b700 1 -- 172.21.15.156:0/1790419678 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c00bcc0 con 0x7f9c1409f3b0 2023-09-30T22:28:05.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.889+0000 7f9c190ff700 1 -- 172.21.15.156:0/1790419678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c1409f3b0 msgr2=0x7f9c141399f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.889+0000 7f9c190ff700 1 --2- 172.21.15.156:0/1790419678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c1409f3b0 0x7f9c141399f0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c009e50 tx=0x7f9c0c00b330 comp rx=0 tx=0).stop 2023-09-30T22:28:05.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.889+0000 7f9c190ff700 1 -- 172.21.15.156:0/1790419678 shutdown_connections 2023-09-30T22:28:05.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.889+0000 7f9c190ff700 1 --2- 172.21.15.156:0/1790419678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c1409f3b0 0x7f9c141399f0 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.889+0000 7f9c190ff700 1 --2- 172.21.15.156:0/1790419678 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c14131ae0 0x7f9c14131eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.889+0000 7f9c190ff700 1 -- 172.21.15.156:0/1790419678 >> 172.21.15.156:0/1790419678 conn(0x7f9c140a4390 msgr2=0x7f9c140a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:05.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.890+0000 7f9c190ff700 1 -- 172.21.15.156:0/1790419678 shutdown_connections 2023-09-30T22:28:05.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.890+0000 7f9c190ff700 1 -- 172.21.15.156:0/1790419678 wait complete. 2023-09-30T22:28:05.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.891+0000 7f9c190ff700 1 Processor -- start 2023-09-30T22:28:05.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.891+0000 7f9c190ff700 1 -- start start 2023-09-30T22:28:05.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.891+0000 7f9c190ff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c1409e870 0x7f9c141c3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.891+0000 7f9c190ff700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9c1409f3b0 0x7f9c141c35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.891+0000 7f9c190ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c14131ae0 0x7f9c141c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.891+0000 7f9c190ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1411e7c0 con 0x7f9c14131ae0 2023-09-30T22:28:05.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.891+0000 7f9c190ff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1411eb80 con 0x7f9c1409e870 2023-09-30T22:28:05.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.891+0000 7f9c190ff700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1411f2c0 con 0x7f9c1409f3b0 2023-09-30T22:28:05.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.891+0000 7f9c12d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c1409e870 0x7f9c141c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.891+0000 7f9c12d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c1409e870 0x7f9c141c3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:35034/0 (socket says 172.21.15.156:35034) 2023-09-30T22:28:05.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.891+0000 7f9c12d9d700 1 -- 172.21.15.156:0/222188155 learned_addr learned my addr 172.21.15.156:0/222188155 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:28:05.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.891+0000 7f9c1259c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9c1409f3b0 0x7f9c141c35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.891+0000 7f9c1359e700 1 --2- 172.21.15.156:0/222188155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c14131ae0 0x7f9c141c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.892+0000 7f9c1259c700 1 -- 172.21.15.156:0/222188155 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c1409e870 msgr2=0x7f9c141c3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.892+0000 7f9c1259c700 1 --2- 172.21.15.156:0/222188155 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c1409e870 0x7f9c141c3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.892+0000 7f9c1259c700 1 -- 172.21.15.156:0/222188155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c14131ae0 msgr2=0x7f9c141c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.892+0000 7f9c1259c700 1 --2- 172.21.15.156:0/222188155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c14131ae0 0x7f9c141c5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.892+0000 7f9c1259c700 1 -- 172.21.15.156:0/222188155 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c04009430 con 0x7f9c1409f3b0 2023-09-30T22:28:05.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.892+0000 7f9c1359e700 1 --2- 172.21.15.156:0/222188155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c14131ae0 0x7f9c141c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:05.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.892+0000 7f9c12d9d700 1 --2- 172.21.15.156:0/222188155 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c1409e870 0x7f9c141c3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:05.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.892+0000 7f9c1259c700 1 --2- 172.21.15.156:0/222188155 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9c1409f3b0 0x7f9c141c35c0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f9c140673f0 tx=0x7f9c0800c750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:05.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.892+0000 7f9bfb7fe700 1 -- 172.21.15.156:0/222188155 <== mon.2 v2:172.21.15.156:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08004c80 con 0x7f9c1409f3b0 2023-09-30T22:28:05.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.892+0000 7f9bfb7fe700 1 -- 172.21.15.156:0/222188155 <== mon.2 v2:172.21.15.156:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c08004de0 con 0x7f9c1409f3b0 2023-09-30T22:28:05.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.892+0000 7f9bfb7fe700 1 -- 172.21.15.156:0/222188155 <== mon.2 v2:172.21.15.156:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08007310 con 0x7f9c1409f3b0 2023-09-30T22:28:05.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.892+0000 7f9c190ff700 1 -- 172.21.15.156:0/222188155 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c0c009b30 con 0x7f9c1409f3b0 2023-09-30T22:28:05.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.892+0000 7f9c190ff700 1 -- 172.21.15.156:0/222188155 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c1411d950 con 0x7f9c1409f3b0 2023-09-30T22:28:05.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.893+0000 7f9bfb7fe700 1 -- 172.21.15.156:0/222188155 <== mon.2 v2:172.21.15.156:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c08007470 con 0x7f9c1409f3b0 2023-09-30T22:28:05.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.893+0000 7f9bfb7fe700 1 -- 172.21.15.156:0/222188155 <== mon.2 v2:172.21.15.156:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9c0803f320 con 0x7f9c1409f3b0 2023-09-30T22:28:05.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.893+0000 7f9c190ff700 1 -- 172.21.15.156:0/222188155 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c1404f2a0 con 0x7f9c1409f3b0 2023-09-30T22:28:05.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:05.897+0000 7f9bfb7fe700 1 -- 172.21.15.156:0/222188155 <== mon.2 v2:172.21.15.156:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c08007720 con 0x7f9c1409f3b0 2023-09-30T22:28:06.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.078+0000 7f9c190ff700 1 -- 172.21.15.156:0/222188155 --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9c1406b2e0 con 0x7f9c1409f3b0 2023-09-30T22:28:06.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.079+0000 7f9bfb7fe700 1 -- 172.21.15.156:0/222188155 <== mon.2 v2:172.21.15.156:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9c0801ce50 con 0x7f9c1409f3b0 2023-09-30T22:28:06.080 INFO:teuthology.orchestra.run.smithi156.stdout:pg_num: 64 2023-09-30T22:28:06.081 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.081+0000 7f9c190ff700 1 -- 172.21.15.156:0/222188155 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9c1409f3b0 msgr2=0x7f9c141c35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.081+0000 7f9c190ff700 1 --2- 172.21.15.156:0/222188155 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9c1409f3b0 0x7f9c141c35c0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f9c140673f0 tx=0x7f9c0800c750 comp rx=0 tx=0).stop 2023-09-30T22:28:06.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.081+0000 7f9c190ff700 1 -- 172.21.15.156:0/222188155 shutdown_connections 2023-09-30T22:28:06.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.081+0000 7f9c190ff700 1 --2- 172.21.15.156:0/222188155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c14131ae0 0x7f9c141c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.081+0000 7f9c190ff700 1 --2- 172.21.15.156:0/222188155 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9c1409e870 0x7f9c141c3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.081+0000 7f9c190ff700 1 --2- 172.21.15.156:0/222188155 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f9c1409f3b0 0x7f9c141c35c0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.082 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.081+0000 7f9c190ff700 1 -- 172.21.15.156:0/222188155 >> 172.21.15.156:0/222188155 conn(0x7f9c140a4390 msgr2=0x7f9c14130ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:06.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.081+0000 7f9c190ff700 1 -- 172.21.15.156:0/222188155 shutdown_connections 2023-09-30T22:28:06.083 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.081+0000 7f9c190ff700 1 -- 172.21.15.156:0/222188155 wait complete. 2023-09-30T22:28:06.094 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T22:28:06.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.215+0000 7ff4f3080700 1 Processor -- start 2023-09-30T22:28:06.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.215+0000 7ff4f3080700 1 -- start start 2023-09-30T22:28:06.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.215+0000 7ff4f3080700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4ec133ad0 0x7ff4ec133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.218 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.215+0000 7ff4f3080700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff4ec1300a0 0x7ff4ec1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.215+0000 7ff4f3080700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4ec06b2d0 con 0x7ff4ec1309f0 2023-09-30T22:28:06.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.215+0000 7ff4f3080700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4ec133610 con 0x7ff4ec1300a0 2023-09-30T22:28:06.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.215+0000 7ff4f3080700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec09a500 con 0x7ff4ec133ad0 2023-09-30T22:28:06.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.216+0000 7ff4f0e1c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4ec133ad0 0x7ff4ec133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.216+0000 7ff4ebfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff4ec1300a0 0x7ff4ec1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.216+0000 7ff4f0e1c700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4ec133ad0 0x7ff4ec133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3302/0 says I am v2:172.21.15.156:56096/0 (socket says 172.21.15.156:56096) 2023-09-30T22:28:06.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.216+0000 7ff4f161d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff4ec1309f0 0x7ff4ec13a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:53176/0 (socket says 172.21.15.156:53176) 2023-09-30T22:28:06.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.216+0000 7ff4ebfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff4ec1300a0 0x7ff4ec1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:53046/0 (socket says 172.21.15.156:53046) 2023-09-30T22:28:06.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.216+0000 7ff4f0e1c700 1 -- 172.21.15.156:0/3623720384 learned_addr learned my addr 172.21.15.156:0/3623720384 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:28:06.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.216+0000 7ff4ebfff700 1 -- 172.21.15.156:0/3623720384 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4ec133ad0 msgr2=0x7ff4ec133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:06.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.216+0000 7ff4ebfff700 1 --2- 172.21.15.156:0/3623720384 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4ec133ad0 0x7ff4ec133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.216+0000 7ff4ebfff700 1 -- 172.21.15.156:0/3623720384 >> v1:172.21.15.156:6789/0 conn(0x7ff4ec1309f0 legacy=0x7ff4ec13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.216+0000 7ff4ebfff700 1 -- 172.21.15.156:0/3623720384 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ec1338b0 con 0x7ff4ec1300a0 2023-09-30T22:28:06.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.216+0000 7ff4eb7fe700 1 -- 172.21.15.156:0/3623720384 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1111017645 0 0) 0x7ff4ec06b2d0 con 0x7ff4ec1309f0 2023-09-30T22:28:06.220 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.216+0000 7ff4f0e1c700 1 --2- 172.21.15.156:0/3623720384 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4ec133ad0 0x7ff4ec133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:06.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.216+0000 7ff4ebfff700 1 --2- 172.21.15.156:0/3623720384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4ec1300a0 0x7ff4ec1304b0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8009840 tx=0x7ff4d8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c78cd754c0f45cb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:06.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.216+0000 7ff4eb7fe700 1 -- 172.21.15.156:0/3623720384 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d8011830 con 0x7ff4ec1300a0 2023-09-30T22:28:06.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.216+0000 7ff4eb7fe700 1 -- 172.21.15.156:0/3623720384 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d8011990 con 0x7ff4ec1300a0 2023-09-30T22:28:06.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.216+0000 7ff4eb7fe700 1 -- 172.21.15.156:0/3623720384 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d8011d20 con 0x7ff4ec1300a0 2023-09-30T22:28:06.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.217+0000 7ff4f3080700 1 -- 172.21.15.156:0/3623720384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4ec1300a0 msgr2=0x7ff4ec1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.217+0000 7ff4f3080700 1 --2- 172.21.15.156:0/3623720384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4ec1300a0 0x7ff4ec1304b0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8009840 tx=0x7ff4d8009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:06.221 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.217+0000 7ff4f3080700 1 -- 172.21.15.156:0/3623720384 shutdown_connections 2023-09-30T22:28:06.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.217+0000 7ff4f3080700 1 --2- 172.21.15.156:0/3623720384 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4ec133ad0 0x7ff4ec133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.217+0000 7ff4f3080700 1 --2- 172.21.15.156:0/3623720384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4ec1300a0 0x7ff4ec1304b0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.217+0000 7ff4f3080700 1 -- 172.21.15.156:0/3623720384 >> 172.21.15.156:0/3623720384 conn(0x7ff4ec099c40 msgr2=0x7ff4ec0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:06.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.217+0000 7ff4f3080700 1 -- 172.21.15.156:0/3623720384 shutdown_connections 2023-09-30T22:28:06.222 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.217+0000 7ff4f3080700 1 -- 172.21.15.156:0/3623720384 wait complete. 2023-09-30T22:28:06.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.218+0000 7ff4f3080700 1 Processor -- start 2023-09-30T22:28:06.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.218+0000 7ff4f3080700 1 -- start start 2023-09-30T22:28:06.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.218+0000 7ff4f3080700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4ec1300a0 0x7ff4ec0712a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.218+0000 7ff4f3080700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4ec1309f0 0x7ff4ec0717e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.218+0000 7ff4f3080700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4ec133ad0 0x7ff4ec071d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.218+0000 7ff4f3080700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec0a3470 con 0x7ff4ec1309f0 2023-09-30T22:28:06.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.218+0000 7ff4f3080700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec11e100 con 0x7ff4ec1300a0 2023-09-30T22:28:06.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.218+0000 7ff4f3080700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec11f1b0 con 0x7ff4ec133ad0 2023-09-30T22:28:06.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.218+0000 7ff4ebfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4ec1309f0 0x7ff4ec0717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.218+0000 7ff4ebfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4ec1309f0 0x7ff4ec0717e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:53058/0 (socket says 172.21.15.156:53058) 2023-09-30T22:28:06.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.218+0000 7ff4ebfff700 1 -- 172.21.15.156:0/1687533206 learned_addr learned my addr 172.21.15.156:0/1687533206 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:28:06.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.218+0000 7ff4f161d700 1 --2- 172.21.15.156:0/1687533206 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4ec133ad0 0x7ff4ec071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.218+0000 7ff4f0e1c700 1 --2- 172.21.15.156:0/1687533206 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4ec1300a0 0x7ff4ec0712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.219+0000 7ff4ebfff700 1 -- 172.21.15.156:0/1687533206 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4ec133ad0 msgr2=0x7ff4ec071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.219+0000 7ff4ebfff700 1 --2- 172.21.15.156:0/1687533206 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4ec133ad0 0x7ff4ec071d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.219+0000 7ff4ebfff700 1 -- 172.21.15.156:0/1687533206 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4ec1300a0 msgr2=0x7ff4ec0712a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.219+0000 7ff4ebfff700 1 --2- 172.21.15.156:0/1687533206 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4ec1300a0 0x7ff4ec0712a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.226 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.219+0000 7ff4ebfff700 1 -- 172.21.15.156:0/1687533206 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e0009550 con 0x7ff4ec1309f0 2023-09-30T22:28:06.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.219+0000 7ff4ebfff700 1 --2- 172.21.15.156:0/1687533206 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4ec1309f0 0x7ff4ec0717e0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7ff4d80090b0 tx=0x7ff4d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:06.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.219+0000 7ff4e97fa700 1 -- 172.21.15.156:0/1687533206 <== mon.0 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d8004400 con 0x7ff4ec1309f0 2023-09-30T22:28:06.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.219+0000 7ff4e97fa700 1 -- 172.21.15.156:0/1687533206 <== mon.0 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d801f070 con 0x7ff4ec1309f0 2023-09-30T22:28:06.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.219+0000 7ff4e97fa700 1 -- 172.21.15.156:0/1687533206 <== mon.0 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d80038e0 con 0x7ff4ec1309f0 2023-09-30T22:28:06.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.219+0000 7ff4f3080700 1 -- 172.21.15.156:0/1687533206 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d80094a0 con 0x7ff4ec1309f0 2023-09-30T22:28:06.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.219+0000 7ff4f3080700 1 -- 172.21.15.156:0/1687533206 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4ec11f8f0 con 0x7ff4ec1309f0 2023-09-30T22:28:06.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.220+0000 7ff4e97fa700 1 -- 172.21.15.156:0/1687533206 <== mon.0 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff4d8021030 con 0x7ff4ec1309f0 2023-09-30T22:28:06.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.220+0000 7ff4e97fa700 1 -- 172.21.15.156:0/1687533206 <== mon.0 v2:172.21.15.156:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff4d8040780 con 0x7ff4ec1309f0 2023-09-30T22:28:06.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.220+0000 7ff4f3080700 1 -- 172.21.15.156:0/1687533206 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4ec0a2620 con 0x7ff4ec1309f0 2023-09-30T22:28:06.228 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.225+0000 7ff4e97fa700 1 -- 172.21.15.156:0/1687533206 <== mon.0 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff4d8004560 con 0x7ff4ec1309f0 2023-09-30T22:28:06.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.420+0000 7ff4f3080700 1 -- 172.21.15.156:0/1687533206 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff4ec04f2a0 con 0x7ff4ec1309f0 2023-09-30T22:28:06.422 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.421+0000 7ff4e97fa700 1 -- 172.21.15.156:0/1687533206 <== mon.0 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 11 entries v39) v1 ==== 81+0+649 (secure 0 0 0) 0x7ff4d8015020 con 0x7ff4ec1309f0 2023-09-30T22:28:06.422 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156:6816/126965 2023-10-01T22:19:32.500218+0000 2023-09-30T22:28:06.422 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156:0/1669701082 2023-10-01T22:19:32.500218+0000 2023-09-30T22:28:06.423 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156:0/1136044187 2023-10-01T22:19:32.500218+0000 2023-09-30T22:28:06.423 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156:0/2593263545 2023-10-01T22:18:37.767496+0000 2023-09-30T22:28:06.423 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156:0/3331241925 2023-10-01T22:19:32.500218+0000 2023-09-30T22:28:06.423 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156:0/1464735255 2023-10-01T22:18:37.767496+0000 2023-09-30T22:28:06.423 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156:0/417912451 2023-10-01T22:19:32.500218+0000 2023-09-30T22:28:06.424 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156:0/1153199602 2023-10-01T22:19:32.500218+0000 2023-09-30T22:28:06.424 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156:6816/118236 2023-10-01T22:18:37.767496+0000 2023-09-30T22:28:06.424 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156:6817/3817969673 2023-10-01T22:19:00.677676+0000 2023-09-30T22:28:06.424 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156:0/1695265592 2023-10-01T22:19:32.500218+0000 2023-09-30T22:28:06.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.422+0000 7ff4f3080700 1 -- 172.21.15.156:0/1687533206 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4ec1309f0 msgr2=0x7ff4ec0717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.422+0000 7ff4f3080700 1 --2- 172.21.15.156:0/1687533206 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4ec1309f0 0x7ff4ec0717e0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7ff4d80090b0 tx=0x7ff4d8004750 comp rx=0 tx=0).stop 2023-09-30T22:28:06.425 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.423+0000 7ff4f3080700 1 -- 172.21.15.156:0/1687533206 shutdown_connections 2023-09-30T22:28:06.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.423+0000 7ff4f3080700 1 --2- 172.21.15.156:0/1687533206 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7ff4ec133ad0 0x7ff4ec071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.423+0000 7ff4f3080700 1 --2- 172.21.15.156:0/1687533206 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff4ec1300a0 0x7ff4ec0712a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.423+0000 7ff4f3080700 1 --2- 172.21.15.156:0/1687533206 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4ec1309f0 0x7ff4ec0717e0 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.423+0000 7ff4f3080700 1 -- 172.21.15.156:0/1687533206 >> 172.21.15.156:0/1687533206 conn(0x7ff4ec099c40 msgr2=0x7ff4ec1329b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:06.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.423+0000 7ff4f3080700 1 -- 172.21.15.156:0/1687533206 shutdown_connections 2023-09-30T22:28:06.426 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:06.423+0000 7ff4f3080700 1 -- 172.21.15.156:0/1687533206 wait complete. 2023-09-30T22:28:06.427 INFO:teuthology.orchestra.run.smithi156.stderr:listed 11 entries 2023-09-30T22:28:06.436 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi194.front.sepia.ceph.com... 2023-09-30T22:28:06.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:28:06.437 DEBUG:teuthology.orchestra.run.smithi194:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-09-30T22:28:06.484 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi194.stderr:ceph-fuse[112280]: fuse finished with error 0 and tester_r 0 2023-09-30T22:28:06.486 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:28:12.588 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi194.front.sepia.ceph.com 2023-09-30T22:28:12.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:28:12.588 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-30T22:28:12.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:28:12.636 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2023-09-30T22:28:12.657 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-30T22:28:12.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:28:12.658 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:28:12.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:28:12.740 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link delete ceph-brx 2023-09-30T22:28:12.847 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-09-30T22:28:12.860 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-30T22:28:12.860 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:28:12.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.994+0000 7f67ff142700 1 Processor -- start 2023-09-30T22:28:12.995 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.994+0000 7f67ff142700 1 -- start start 2023-09-30T22:28:12.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.995+0000 7f67ff142700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f67f81346e0 0x7f67f8136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:12.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.995+0000 7f67ff142700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67f8137000 0x7f67f81393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:12.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.995+0000 7f67ff142700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f80a1640 con 0x7f67f8131980 2023-09-30T22:28:12.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.995+0000 7f67ff142700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f806eb30 con 0x7f67f81346e0 2023-09-30T22:28:12.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.995+0000 7f67ff142700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f80a22d0 con 0x7f67f8137000 2023-09-30T22:28:12.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.995+0000 7f67fd6df700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67f8137000 0x7f67f81393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:12.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.995+0000 7f67fd6df700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67f8137000 0x7f67f81393e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38710/0 (socket says 172.21.15.156:38710) 2023-09-30T22:28:12.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.995+0000 7f67fcede700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f67f8131980 0x7f67f8131d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:57608/0 (socket says 172.21.15.156:57608) 2023-09-30T22:28:12.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.995+0000 7f67fd6df700 1 -- 172.21.15.156:0/148478445 learned_addr learned my addr 172.21.15.156:0/148478445 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:28:12.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.995+0000 7f67f7fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f67f81346e0 0x7f67f8136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:12.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.995+0000 7f67fd6df700 1 -- 172.21.15.156:0/148478445 >> v2:172.21.15.156:3300/0 conn(0x7f67f81346e0 msgr2=0x7f67f8136ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:12.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.995+0000 7f67fd6df700 1 --2- 172.21.15.156:0/148478445 >> v2:172.21.15.156:3300/0 conn(0x7f67f81346e0 0x7f67f8136ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.999 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.995+0000 7f67fd6df700 1 -- 172.21.15.156:0/148478445 >> v1:172.21.15.156:6789/0 conn(0x7f67f8131980 legacy=0x7f67f8131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.995+0000 7f67fd6df700 1 -- 172.21.15.156:0/148478445 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f8131550 con 0x7f67f8137000 2023-09-30T22:28:13.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.995+0000 7f67f7fff700 1 --2- 172.21.15.156:0/148478445 >> v2:172.21.15.156:3300/0 conn(0x7f67f81346e0 0x7f67f8136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:13.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.995+0000 7f67f77fe700 1 -- 172.21.15.156:0/148478445 <== mon.0 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372439423 0 0) 0x7f67f80a1640 con 0x7f67f8131980 2023-09-30T22:28:13.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.996+0000 7f67fd6df700 1 --2- 172.21.15.156:0/148478445 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67f8137000 0x7f67f81393e0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009e50 tx=0x7f67f000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6df6c9e992aa9309 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:13.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.996+0000 7f67f77fe700 1 -- 172.21.15.156:0/148478445 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f000e070 con 0x7f67f8137000 2023-09-30T22:28:13.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.996+0000 7f67f77fe700 1 -- 172.21.15.156:0/148478445 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f000b910 con 0x7f67f8137000 2023-09-30T22:28:13.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.996+0000 7f67f77fe700 1 -- 172.21.15.156:0/148478445 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f000bcc0 con 0x7f67f8137000 2023-09-30T22:28:13.000 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.996+0000 7f67ff142700 1 -- 172.21.15.156:0/148478445 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67f8137000 msgr2=0x7f67f81393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.996+0000 7f67ff142700 1 --2- 172.21.15.156:0/148478445 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67f8137000 0x7f67f81393e0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009e50 tx=0x7f67f000b330 comp rx=0 tx=0).stop 2023-09-30T22:28:13.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.996+0000 7f67ff142700 1 -- 172.21.15.156:0/148478445 shutdown_connections 2023-09-30T22:28:13.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.996+0000 7f67ff142700 1 --2- 172.21.15.156:0/148478445 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67f8137000 0x7f67f81393e0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.996+0000 7f67ff142700 1 --2- 172.21.15.156:0/148478445 >> v2:172.21.15.156:3300/0 conn(0x7f67f81346e0 0x7f67f8136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.996+0000 7f67ff142700 1 -- 172.21.15.156:0/148478445 >> 172.21.15.156:0/148478445 conn(0x7f67f80a2980 msgr2=0x7f67f80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:13.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.996+0000 7f67ff142700 1 -- 172.21.15.156:0/148478445 shutdown_connections 2023-09-30T22:28:13.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.996+0000 7f67ff142700 1 -- 172.21.15.156:0/148478445 wait complete. 2023-09-30T22:28:13.001 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.997+0000 7f67ff142700 1 Processor -- start 2023-09-30T22:28:13.002 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.997+0000 7f67ff142700 1 -- start start 2023-09-30T22:28:13.003 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.998+0000 7f67ff142700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67f8131980 0x7f67f8118e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:13.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.998+0000 7f67ff142700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67f81346e0 0x7f67f8119380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:13.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.998+0000 7f67ff142700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67f8137000 0x7f67f81198c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:13.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.998+0000 7f67ff142700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f811c4a0 con 0x7f67f8137000 2023-09-30T22:28:13.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.998+0000 7f67ff142700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f80a1c40 con 0x7f67f81346e0 2023-09-30T22:28:13.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.998+0000 7f67ff142700 1 -- --> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67f811ab60 con 0x7f67f8131980 2023-09-30T22:28:13.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.998+0000 7f67f7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67f81346e0 0x7f67f8119380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:13.004 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.998+0000 7f67fcede700 1 --2- >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67f8131980 0x7f67f8118e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:13.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.998+0000 7f67fd6df700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67f8137000 0x7f67f81198c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:13.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.998+0000 7f67f7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67f81346e0 0x7f67f8119380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:38718/0 (socket says 172.21.15.156:38718) 2023-09-30T22:28:13.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.998+0000 7f67f7fff700 1 -- 172.21.15.156:0/3687635952 learned_addr learned my addr 172.21.15.156:0/3687635952 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-30T22:28:13.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.998+0000 7f67f7fff700 1 -- 172.21.15.156:0/3687635952 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67f8131980 msgr2=0x7f67f8118e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.998+0000 7f67f7fff700 1 --2- 172.21.15.156:0/3687635952 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67f8131980 0x7f67f8118e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.998+0000 7f67f7fff700 1 -- 172.21.15.156:0/3687635952 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67f8137000 msgr2=0x7f67f81198c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.998+0000 7f67f7fff700 1 --2- 172.21.15.156:0/3687635952 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67f8137000 0x7f67f81198c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.998+0000 7f67f7fff700 1 -- 172.21.15.156:0/3687635952 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e40094a0 con 0x7f67f81346e0 2023-09-30T22:28:13.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.998+0000 7f67fd6df700 1 --2- 172.21.15.156:0/3687635952 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67f8137000 0x7f67f81198c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:13.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.998+0000 7f67fcede700 1 --2- 172.21.15.156:0/3687635952 >> [v2:172.21.15.156:3302/0,v1:172.21.15.156:6791/0] conn(0x7f67f8131980 0x7f67f8118e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:13.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.998+0000 7f67f7fff700 1 --2- 172.21.15.156:0/3687635952 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f67f81346e0 0x7f67f8119380 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f67e400ebe0 tx=0x7f67e400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:13.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.999+0000 7f67f57fa700 1 -- 172.21.15.156:0/3687635952 <== mon.1 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e400c850 con 0x7f67f81346e0 2023-09-30T22:28:13.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.999+0000 7f67f57fa700 1 -- 172.21.15.156:0/3687635952 <== mon.1 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e400c9b0 con 0x7f67f81346e0 2023-09-30T22:28:13.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.999+0000 7f67f57fa700 1 -- 172.21.15.156:0/3687635952 <== mon.1 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e400cd40 con 0x7f67f81346e0 2023-09-30T22:28:13.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.999+0000 7f67ff142700 1 -- 172.21.15.156:0/3687635952 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f0009b30 con 0x7f67f81346e0 2023-09-30T22:28:13.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.999+0000 7f67ff142700 1 -- 172.21.15.156:0/3687635952 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f811c680 con 0x7f67f81346e0 2023-09-30T22:28:13.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.999+0000 7f67f57fa700 1 -- 172.21.15.156:0/3687635952 <== mon.1 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f67e4013470 con 0x7f67f81346e0 2023-09-30T22:28:13.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:12.999+0000 7f67f57fa700 1 -- 172.21.15.156:0/3687635952 <== mon.1 v2:172.21.15.156:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f67e403f770 con 0x7f67f81346e0 2023-09-30T22:28:13.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:13.000+0000 7f67ff142700 1 -- 172.21.15.156:0/3687635952 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f811c2d0 con 0x7f67f81346e0 2023-09-30T22:28:13.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-30T22:28:13.004+0000 7f67f57fa700 1 -- 172.21.15.156:0/3687635952 <== mon.1 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f67e4017020 con 0x7f67f81346e0 2023-09-30T22:30:12.900 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-09-30T22:30:12.901 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-09-30T22:30:12.910 INFO:teuthology.misc:Shutting down mds daemons... 2023-09-30T22:30:12.910 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-30T22:30:12.911 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:30:12.925 INFO:tasks.ceph.mds.a:Stopped 2023-09-30T22:30:12.925 INFO:teuthology.misc:Shutting down osd daemons... 2023-09-30T22:30:12.925 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-09-30T22:30:12.925 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:30:12.997 INFO:tasks.ceph.osd.0:Stopped 2023-09-30T22:30:12.998 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-09-30T22:30:12.998 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:30:13.067 INFO:tasks.ceph.osd.1:Stopped 2023-09-30T22:30:13.067 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-09-30T22:30:13.067 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:30:13.137 INFO:tasks.ceph.osd.2:Stopped 2023-09-30T22:30:13.138 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-09-30T22:30:13.138 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:30:13.203 INFO:tasks.ceph.osd.3:Stopped 2023-09-30T22:30:13.203 INFO:teuthology.misc:Shutting down mgr daemons... 2023-09-30T22:30:13.204 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-09-30T22:30:13.204 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:30:13.204 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:30:13.204 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2023-09-30T22:30:13.218 INFO:tasks.ceph.mgr.x:Stopped 2023-09-30T22:30:13.218 INFO:teuthology.misc:Shutting down mon daemons... 2023-09-30T22:30:13.219 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-09-30T22:30:13.219 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:30:13.255 INFO:tasks.ceph.mon.a:Stopped 2023-09-30T22:30:13.255 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-09-30T22:30:13.256 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:30:13.308 INFO:tasks.ceph.mon.b:Stopped 2023-09-30T22:30:13.308 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-09-30T22:30:13.308 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:30:13.362 INFO:tasks.ceph.mon.c:Stopped 2023-09-30T22:30:13.362 INFO:tasks.ceph:Checking cluster log for badness... 2023-09-30T22:30:13.363 DEBUG:teuthology.orchestra.run.smithi156:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(FS_' | egrep -v '\(MDS_' | egrep -v '\(OSD_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(CACHE_POOL_' | egrep -v '\(POOL_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'Monitor daemon marked osd' | egrep -v 'Behind on trimming' | egrep -v 'Manager daemon' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'scrub mismatch' | egrep -v ScrubResult | egrep -v 'wrongly marked' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_MSGR2_NOT_ENABLED\)' | egrep -v 'slow request' | head -n 1 2023-09-30T22:30:13.447 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi156.front.sepia.ceph.com 2023-09-30T22:30:13.447 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-09-30T22:30:13.592 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi156.front.sepia.ceph.com 2023-09-30T22:30:13.592 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-09-30T22:30:13.673 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi156.front.sepia.ceph.com 2023-09-30T22:30:13.673 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-09-30T22:30:13.771 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi156.front.sepia.ceph.com 2023-09-30T22:30:13.771 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-09-30T22:30:13.841 INFO:tasks.ceph:Archiving mon data... 2023-09-30T22:30:13.842 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408038/data/mon.a.tgz 2023-09-30T22:30:13.842 DEBUG:teuthology.orchestra.run.smithi156:> mktemp 2023-09-30T22:30:13.861 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.RG4I0aDenf 2023-09-30T22:30:13.861 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.RG4I0aDenf 2023-09-30T22:30:13.989 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.RG4I0aDenf 2023-09-30T22:30:14.076 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.RG4I0aDenf is 306KB 2023-09-30T22:30:14.171 DEBUG:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.RG4I0aDenf 2023-09-30T22:30:14.188 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408038/data/mon.b.tgz 2023-09-30T22:30:14.188 DEBUG:teuthology.orchestra.run.smithi156:> mktemp 2023-09-30T22:30:14.245 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.fCfwX6Ky8E 2023-09-30T22:30:14.246 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.fCfwX6Ky8E 2023-09-30T22:30:14.370 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.fCfwX6Ky8E 2023-09-30T22:30:14.458 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.fCfwX6Ky8E is 307KB 2023-09-30T22:30:14.527 DEBUG:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.fCfwX6Ky8E 2023-09-30T22:30:14.545 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408038/data/mon.c.tgz 2023-09-30T22:30:14.545 DEBUG:teuthology.orchestra.run.smithi156:> mktemp 2023-09-30T22:30:14.602 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.EHWKtBJpvZ 2023-09-30T22:30:14.603 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.EHWKtBJpvZ 2023-09-30T22:30:14.725 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.EHWKtBJpvZ 2023-09-30T22:30:14.814 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.EHWKtBJpvZ is 307KB 2023-09-30T22:30:14.909 DEBUG:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.EHWKtBJpvZ 2023-09-30T22:30:14.926 INFO:tasks.ceph:Cleaning ceph cluster... 2023-09-30T22:30:14.926 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-30T22:30:14.968 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-30T22:30:15.004 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-09-30T22:30:15.004 DEBUG:teuthology.orchestra.run.smithi156:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-30T22:30:15.035 DEBUG:teuthology.orchestra.run.smithi194:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-30T22:30:15.060 INFO:teuthology.orchestra.run.smithi156.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-30T22:30:15.076 INFO:teuthology.orchestra.run.smithi194.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-30T22:30:15.083 INFO:tasks.ceph:Archiving crash dumps... 2023-09-30T22:30:15.085 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408038/remote/smithi156/crash 2023-09-30T22:30:15.086 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-30T22:30:15.133 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408038/remote/smithi194/crash 2023-09-30T22:30:15.134 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-30T22:30:15.175 INFO:tasks.ceph:Compressing logs... 2023-09-30T22:30:15.175 DEBUG:teuthology.orchestra.run.smithi156:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-30T22:30:15.178 DEBUG:teuthology.orchestra.run.smithi194:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-30T22:30:15.203 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167593.log 2023-09-30T22:30:15.204 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194096.log 2023-09-30T22:30:15.204 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.167593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134545.log 2023-09-30T22:30:15.250 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112280.log 2023-09-30T22:30:15.257 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.112280.log: 96.6% -- replaced with /var/log/ceph/ceph-client.0.112280.log.gz 2023-09-30T22:30:15.258 INFO:teuthology.orchestra.run.smithi194.stderr: 2023-09-30T22:30:15.258 INFO:teuthology.orchestra.run.smithi194.stderr:real 0m0.019s 2023-09-30T22:30:15.258 INFO:teuthology.orchestra.run.smithi194.stderr:user 0m0.019s 2023-09-30T22:30:15.258 INFO:teuthology.orchestra.run.smithi194.stderr:sys 0m0.008s 2023-09-30T22:30:15.344 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.167593.log.gz 2023-09-30T22:30:15.344 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.194096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175381.log 2023-09-30T22:30:15.344 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124177.log 2023-09-30T22:30:15.344 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.134545.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.194096.log.gz 2023-09-30T22:30:15.344 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.175381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164201.log 2023-09-30T22:30:15.344 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.134545.log.gz 2023-09-30T22:30:15.345 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175381.log.gz 2023-09-30T22:30:15.345 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.124177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184502.log 2023-09-30T22:30:15.345 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.124177.log.gz 2023-09-30T22:30:15.345 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149047.log 2023-09-30T22:30:15.345 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.164201.log: /var/log/ceph/ceph-client.admin.184502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152131.log 2023-09-30T22:30:15.345 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.164201.log.gz 2023-09-30T22:30:15.345 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.184502.log.gz 2023-09-30T22:30:15.345 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151616.log 2023-09-30T22:30:15.346 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.149047.log: /var/log/ceph/ceph-client.admin.152131.log: gzip -5 --verbose 88.5%-- /var/log/ceph/ceph-client.admin.190565.log 2023-09-30T22:30:15.346 INFO:teuthology.orchestra.run.smithi156.stderr: -- replaced with /var/log/ceph/ceph-client.admin.149047.log.gz 2023-09-30T22:30:15.346 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.151616.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.152131.log.gz 2023-09-30T22:30:15.346 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189220.log 2023-09-30T22:30:15.346 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151616.log.gz 2023-09-30T22:30:15.346 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163613.log 2023-09-30T22:30:15.346 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.190565.log: /var/log/ceph/ceph-client.admin.189220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137019.log 2023-09-30T22:30:15.346 INFO:teuthology.orchestra.run.smithi156.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.190565.log.gz 2023-09-30T22:30:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.163613.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.189220.log.gz 2023-09-30T22:30:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160739.log 2023-09-30T22:30:15.347 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.163613.log.gz 2023-09-30T22:30:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.137019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183475.log 2023-09-30T22:30:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.160739.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.137019.log.gz 2023-09-30T22:30:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137518.log 2023-09-30T22:30:15.347 INFO:teuthology.orchestra.run.smithi156.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.160739.log.gz 2023-09-30T22:30:15.347 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.183475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122521.log 2023-09-30T22:30:15.348 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.137518.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.183475.log.gz 2023-09-30T22:30:15.348 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143544.log 2023-09-30T22:30:15.348 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.137518.log.gz 2023-09-30T22:30:15.348 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.122521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169545.log 2023-09-30T22:30:15.348 INFO:teuthology.orchestra.run.smithi156.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.122521.log.gz 2023-09-30T22:30:15.348 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173520.log 2023-09-30T22:30:15.348 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.143544.log: /var/log/ceph/ceph-client.admin.169545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144577.log 2023-09-30T22:30:15.348 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.143544.log.gz 2023-09-30T22:30:15.349 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.169545.log.gz 2023-09-30T22:30:15.349 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.173520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157235.log 2023-09-30T22:30:15.349 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.144577.log: 89.2%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.173520.log.gz--verbose -- /var/log/ceph/ceph-client.admin.161130.log 2023-09-30T22:30:15.349 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-09-30T22:30:15.349 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.157235.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.144577.log.gz 2023-09-30T22:30:15.349 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159320.log 2023-09-30T22:30:15.349 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.157235.log.gz 2023-09-30T22:30:15.349 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140412.log 2023-09-30T22:30:15.349 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.161130.log: /var/log/ceph/ceph-client.admin.159320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136896.log 2023-09-30T22:30:15.350 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.161130.log.gz 2023-09-30T22:30:15.350 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.140412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165863.log 2023-09-30T22:30:15.350 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.159320.log.gz 2023-09-30T22:30:15.350 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.136896.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.140412.log.gz 2023-09-30T22:30:15.350 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151002.log 2023-09-30T22:30:15.350 INFO:teuthology.orchestra.run.smithi156.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.136896.log.gz 2023-09-30T22:30:15.350 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127424.log 2023-09-30T22:30:15.350 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.165863.log: /var/log/ceph/ceph-client.admin.151002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192306.log 2023-09-30T22:30:15.351 INFO:teuthology.orchestra.run.smithi156.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.165863.log.gz 2023-09-30T22:30:15.351 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.151002.log.gz 2023-09-30T22:30:15.351 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.127424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137066.log 2023-09-30T22:30:15.351 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.192306.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.127424.log.gz 2023-09-30T22:30:15.351 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186299.log 2023-09-30T22:30:15.351 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.137066.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.192306.log.gz 2023-09-30T22:30:15.351 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152719.log 2023-09-30T22:30:15.351 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.137066.log.gz 2023-09-30T22:30:15.352 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175015.log 2023-09-30T22:30:15.352 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.186299.log: /var/log/ceph/ceph-client.admin.152719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157527.log 2023-09-30T22:30:15.352 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.186299.log.gz 2023-09-30T22:30:15.352 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.175015.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.152719.log.gz 2023-09-30T22:30:15.352 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172049.log 2023-09-30T22:30:15.352 INFO:teuthology.orchestra.run.smithi156.stderr: 87.4%/var/log/ceph/ceph-client.admin.157527.log: -- replaced with /var/log/ceph/ceph-client.admin.175015.log.gz 2023-09-30T22:30:15.352 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164841.log 2023-09-30T22:30:15.352 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.157527.log.gz 2023-09-30T22:30:15.352 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193947.log 2023-09-30T22:30:15.353 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.172049.log: /var/log/ceph/ceph-client.admin.164841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186858.log 2023-09-30T22:30:15.353 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.172049.log.gz 2023-09-30T22:30:15.353 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.193947.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.164841.log.gz 2023-09-30T22:30:15.353 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143914.log 2023-09-30T22:30:15.353 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.193947.log.gz 2023-09-30T22:30:15.353 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.186858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186689.log 2023-09-30T22:30:15.353 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.143914.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.186858.log.gz 2023-09-30T22:30:15.353 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146302.log 2023-09-30T22:30:15.354 INFO:teuthology.orchestra.run.smithi156.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.143914.log.gz 2023-09-30T22:30:15.354 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.186689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154883.log 2023-09-30T22:30:15.354 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.146302.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.186689.log.gz 2023-09-30T22:30:15.354 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158852.log 2023-09-30T22:30:15.354 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.154883.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.146302.log.gz 2023-09-30T22:30:15.354 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178714.log 2023-09-30T22:30:15.354 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.154883.log.gz 2023-09-30T22:30:15.354 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.158852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159711.log 2023-09-30T22:30:15.355 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.178714.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158852.log.gz 2023-09-30T22:30:15.355 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179547.log 2023-09-30T22:30:15.355 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.159711.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.178714.log.gz 2023-09-30T22:30:15.355 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167925.log 2023-09-30T22:30:15.355 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.159711.log.gz 2023-09-30T22:30:15.355 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.179547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149465.log 2023-09-30T22:30:15.355 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179547.log.gz 2023-09-30T22:30:15.355 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.167925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180190.log 2023-09-30T22:30:15.356 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.149465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124425.log 2023-09-30T22:30:15.356 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.167925.log.gz 2023-09-30T22:30:15.356 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.180190.log: gzip 88.7%-5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.149465.log.gz/var/log/ceph/ceph-client.admin.162110.log 2023-09-30T22:30:15.356 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-09-30T22:30:15.356 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180190.log.gz 2023-09-30T22:30:15.356 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.124425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170277.log 2023-09-30T22:30:15.356 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.162110.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.124425.log.gz 2023-09-30T22:30:15.356 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167806.log 2023-09-30T22:30:15.357 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.162110.log.gz 2023-09-30T22:30:15.357 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.170277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125083.log 2023-09-30T22:30:15.357 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.170277.log.gz 2023-09-30T22:30:15.357 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.167806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181123.log 2023-09-30T22:30:15.357 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.125083.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167806.log.gz 2023-09-30T22:30:15.357 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171344.log 2023-09-30T22:30:15.357 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125083.log.gz 2023-09-30T22:30:15.357 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.181123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169963.log 2023-09-30T22:30:15.358 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.181123.log.gz 2023-09-30T22:30:15.358 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.171344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182050.log 2023-09-30T22:30:15.358 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.169963.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.171344.log.gz 2023-09-30T22:30:15.358 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152766.log 2023-09-30T22:30:15.358 INFO:teuthology.orchestra.run.smithi156.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.169963.log.gz 2023-09-30T22:30:15.358 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140018.log 2023-09-30T22:30:15.358 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.182050.log: /var/log/ceph/ceph-client.admin.152766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125889.log 2023-09-30T22:30:15.358 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.182050.log.gz 2023-09-30T22:30:15.359 INFO:teuthology.orchestra.run.smithi156.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.152766.log.gz 2023-09-30T22:30:15.359 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180143.log 2023-09-30T22:30:15.359 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.140018.log: /var/log/ceph/ceph-client.admin.125889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178567.log 2023-09-30T22:30:15.359 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140018.log.gz 2023-09-30T22:30:15.359 INFO:teuthology.orchestra.run.smithi156.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.125889.log.gz 2023-09-30T22:30:15.359 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.180143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154417.log 2023-09-30T22:30:15.359 INFO:teuthology.orchestra.run.smithi156.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.180143.log.gz 2023-09-30T22:30:15.359 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143395.log 2023-09-30T22:30:15.360 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.178567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165403.log 2023-09-30T22:30:15.360 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.154417.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.178567.log.gz 2023-09-30T22:30:15.360 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.143395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135843.log 2023-09-30T22:30:15.360 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.154417.log.gz 2023-09-30T22:30:15.360 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.165403.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.143395.log.gz 2023-09-30T22:30:15.360 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160273.log 2023-09-30T22:30:15.360 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.135843.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.165403.log.gz 2023-09-30T22:30:15.360 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148041.log 2023-09-30T22:30:15.361 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.160273.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.135843.log.gz 2023-09-30T22:30:15.361 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127883.log 2023-09-30T22:30:15.361 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160273.log.gz 2023-09-30T22:30:15.361 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.148041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178614.log 2023-09-30T22:30:15.361 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.148041.log.gz 2023-09-30T22:30:15.361 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.127883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157088.log 2023-09-30T22:30:15.361 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.178614.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.127883.log.gz 2023-09-30T22:30:15.361 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146303.log 2023-09-30T22:30:15.361 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.178614.log.gz 2023-09-30T22:30:15.362 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.157088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143719.log 2023-09-30T22:30:15.362 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.146303.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.157088.log.gz 2023-09-30T22:30:15.362 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123466.log 2023-09-30T22:30:15.362 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178518.log /var/log/ceph/ceph-client.admin.143719.log: 2023-09-30T22:30:15.362 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.146303.log.gz 2023-09-30T22:30:15.362 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.123466.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.143719.log.gz 2023-09-30T22:30:15.362 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176558.log 2023-09-30T22:30:15.362 INFO:teuthology.orchestra.run.smithi156.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123466.log.gz 2023-09-30T22:30:15.363 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164540.log 2023-09-30T22:30:15.363 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.178518.log: /var/log/ceph/ceph-client.admin.176558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169375.log 2023-09-30T22:30:15.363 INFO:teuthology.orchestra.run.smithi156.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.178518.log.gz 2023-09-30T22:30:15.363 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.176558.log.gz 2023-09-30T22:30:15.363 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.164540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171657.log 2023-09-30T22:30:15.363 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.169375.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.164540.log.gz 2023-09-30T22:30:15.363 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184847.log 2023-09-30T22:30:15.363 INFO:teuthology.orchestra.run.smithi156.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.169375.log.gz 2023-09-30T22:30:15.364 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.171657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172833.log 2023-09-30T22:30:15.364 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.184847.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.171657.log.gz 2023-09-30T22:30:15.364 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127787.log 2023-09-30T22:30:15.364 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.184847.log.gz 2023-09-30T22:30:15.364 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.172833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183548.log 2023-09-30T22:30:15.364 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.172833.log.gz 2023-09-30T22:30:15.364 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.127787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141582.log 2023-09-30T22:30:15.364 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.183548.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.127787.log.gz 2023-09-30T22:30:15.364 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149609.log 2023-09-30T22:30:15.365 INFO:teuthology.orchestra.run.smithi156.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.183548.log.gz 2023-09-30T22:30:15.365 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.141582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142956.log 2023-09-30T22:30:15.365 INFO:teuthology.orchestra.run.smithi156.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.141582.log.gz 2023-09-30T22:30:15.365 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.149609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122915.log 2023-09-30T22:30:15.365 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.142956.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.149609.log.gz 2023-09-30T22:30:15.365 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182442.log 2023-09-30T22:30:15.365 INFO:teuthology.orchestra.run.smithi156.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.142956.log.gz 2023-09-30T22:30:15.365 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.122915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125230.log 2023-09-30T22:30:15.366 INFO:teuthology.orchestra.run.smithi156.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122915.log.gz 2023-09-30T22:30:15.366 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.182442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129069.log 2023-09-30T22:30:15.366 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.125230.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.182442.log.gz 2023-09-30T22:30:15.366 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176287.log 2023-09-30T22:30:15.366 INFO:teuthology.orchestra.run.smithi156.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125230.log.gz 2023-09-30T22:30:15.366 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.129069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164593.log 2023-09-30T22:30:15.366 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129069.log.gz 2023-09-30T22:30:15.366 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.176287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185094.log 2023-09-30T22:30:15.367 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.176287.log.gz 2023-09-30T22:30:15.367 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.164593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171879.log 2023-09-30T22:30:15.367 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1%/var/log/ceph/ceph-client.admin.185094.log: -- replaced with /var/log/ceph/ceph-client.admin.164593.log.gz 2023-09-30T22:30:15.367 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182568.log 2023-09-30T22:30:15.367 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.185094.log.gz 2023-09-30T22:30:15.367 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.171879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137296.log 2023-09-30T22:30:15.367 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.182568.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.171879.log.gz 2023-09-30T22:30:15.367 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190049.log 2023-09-30T22:30:15.368 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.182568.log.gz 2023-09-30T22:30:15.368 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.137296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140555.log 2023-09-30T22:30:15.368 INFO:teuthology.orchestra.run.smithi156.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.137296.log.gz 2023-09-30T22:30:15.368 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.190049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167976.log 2023-09-30T22:30:15.368 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.190049.log.gz 2023-09-30T22:30:15.368 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149387.log 2023-09-30T22:30:15.368 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.140555.log: /var/log/ceph/ceph-client.admin.167976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147454.log 2023-09-30T22:30:15.368 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140555.log.gz 2023-09-30T22:30:15.369 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.167976.log.gz 2023-09-30T22:30:15.369 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.149387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149020.log 2023-09-30T22:30:15.369 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.149387.log.gz 2023-09-30T22:30:15.369 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.147454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186807.log 2023-09-30T22:30:15.369 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.147454.log.gz 2023-09-30T22:30:15.369 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.149020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135916.log 2023-09-30T22:30:15.369 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.149020.log.gz 2023-09-30T22:30:15.369 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.186807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123172.log 2023-09-30T22:30:15.369 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.135916.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.186807.log.gz 2023-09-30T22:30:15.370 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128677.log 2023-09-30T22:30:15.370 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.123172.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.135916.log.gz 2023-09-30T22:30:15.370 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169885.log 2023-09-30T22:30:15.370 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.123172.log.gz 2023-09-30T22:30:15.370 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141758.log 2023-09-30T22:30:15.370 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.128677.log: /var/log/ceph/ceph-client.admin.169885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137913.log 2023-09-30T22:30:15.370 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.128677.log.gz 2023-09-30T22:30:15.370 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.141758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140973.log 2023-09-30T22:30:15.371 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.169885.log.gz 2023-09-30T22:30:15.371 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141758.log.gz 2023-09-30T22:30:15.371 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.137913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183791.log 2023-09-30T22:30:15.371 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.140973.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.137913.log.gz 2023-09-30T22:30:15.371 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162625.log 2023-09-30T22:30:15.371 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.183791.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.140973.log.gz 2023-09-30T22:30:15.371 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168591.log 2023-09-30T22:30:15.371 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.183791.log.gz 2023-09-30T22:30:15.372 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188679.log 2023-09-30T22:30:15.372 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.162625.log: gzip /var/log/ceph/ceph-client.admin.168591.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.191775.log 2023-09-30T22:30:15.372 INFO:teuthology.orchestra.run.smithi156.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.162625.log.gz 2023-09-30T22:30:15.372 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.188679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149075.log 2023-09-30T22:30:15.372 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168591.log.gz 2023-09-30T22:30:15.372 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.191775.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.188679.log.gz 2023-09-30T22:30:15.372 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143915.log 2023-09-30T22:30:15.372 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.191775.log.gz 2023-09-30T22:30:15.373 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146055.log 2023-09-30T22:30:15.373 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.149075.log: /var/log/ceph/ceph-client.admin.143915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185487.log 2023-09-30T22:30:15.373 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.149075.log.gz 2023-09-30T22:30:15.373 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143915.log.gz 2023-09-30T22:30:15.373 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.146055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181758.log 2023-09-30T22:30:15.373 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.185487.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.146055.log.gz 2023-09-30T22:30:15.373 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182542.log 2023-09-30T22:30:15.373 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.181758.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.185487.log.gz 2023-09-30T22:30:15.374 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188009.log 2023-09-30T22:30:15.374 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.181758.log.gz 2023-09-30T22:30:15.374 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.182542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165126.log 2023-09-30T22:30:15.374 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.182542.log.gz 2023-09-30T22:30:15.374 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.188009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140241.log 2023-09-30T22:30:15.374 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.165126.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.188009.log.gz 2023-09-30T22:30:15.374 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193902.log 2023-09-30T22:30:15.374 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.165126.log.gz 2023-09-30T22:30:15.375 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.140241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163368.log 2023-09-30T22:30:15.375 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140241.log.gz 2023-09-30T22:30:15.375 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.193902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157135.log 2023-09-30T22:30:15.375 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.163368.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.193902.log.gz 2023-09-30T22:30:15.375 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173734.log 2023-09-30T22:30:15.375 INFO:teuthology.orchestra.run.smithi156.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.163368.log.gz 2023-09-30T22:30:15.375 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.157135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191033.log 2023-09-30T22:30:15.375 INFO:teuthology.orchestra.run.smithi156.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.157135.log.gz 2023-09-30T22:30:15.375 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.173734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147918.log 2023-09-30T22:30:15.376 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.191033.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.173734.log.gz 2023-09-30T22:30:15.376 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180731.log 2023-09-30T22:30:15.376 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.191033.log.gz 2023-09-30T22:30:15.376 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.147918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172297.log 2023-09-30T22:30:15.376 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.147918.log.gz 2023-09-30T22:30:15.376 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.180731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128365.log 2023-09-30T22:30:15.376 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.172297.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.180731.log.gz 2023-09-30T22:30:15.376 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154540.log 2023-09-30T22:30:15.377 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.128365.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.172297.log.gz 2023-09-30T22:30:15.377 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125693.log 2023-09-30T22:30:15.377 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.128365.log.gz 2023-09-30T22:30:15.377 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.154540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171561.log 2023-09-30T22:30:15.377 INFO:teuthology.orchestra.run.smithi156.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.154540.log.gz 2023-09-30T22:30:15.377 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.125693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183987.log 2023-09-30T22:30:15.377 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.171561.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.125693.log.gz 2023-09-30T22:30:15.377 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139850.log 2023-09-30T22:30:15.378 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.171561.log.gz 2023-09-30T22:30:15.378 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.183987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192157.log 2023-09-30T22:30:15.378 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.183987.log.gz 2023-09-30T22:30:15.378 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.139850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184677.log 2023-09-30T22:30:15.378 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.192157.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139850.log.gz 2023-09-30T22:30:15.378 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143152.log 2023-09-30T22:30:15.378 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.192157.log.gz 2023-09-30T22:30:15.378 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182834.log 2023-09-30T22:30:15.379 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.184677.log: /var/log/ceph/ceph-client.admin.143152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177660.log 2023-09-30T22:30:15.379 INFO:teuthology.orchestra.run.smithi156.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.184677.log.gz 2023-09-30T22:30:15.379 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.182834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187591.log 2023-09-30T22:30:15.379 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143152.log.gz 2023-09-30T22:30:15.379 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.182834.log.gz 2023-09-30T22:30:15.379 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.177660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134471.log 2023-09-30T22:30:15.379 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.187591.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.177660.log.gz 2023-09-30T22:30:15.379 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144532.log 2023-09-30T22:30:15.379 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.187591.log.gz 2023-09-30T22:30:15.380 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.134471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172467.log 2023-09-30T22:30:15.380 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.144532.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.134471.log.gz 2023-09-30T22:30:15.380 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141365.log 2023-09-30T22:30:15.380 INFO:teuthology.orchestra.run.smithi156.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.144532.log.gz 2023-09-30T22:30:15.380 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.172467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194379.log 2023-09-30T22:30:15.380 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.172467.log.gz 2023-09-30T22:30:15.380 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.141365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187617.log 2023-09-30T22:30:15.380 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.194379.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.141365.log.gz 2023-09-30T22:30:15.381 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187888.log 2023-09-30T22:30:15.381 INFO:teuthology.orchestra.run.smithi156.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.194379.log.gz 2023-09-30T22:30:15.381 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.187617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152401.log 2023-09-30T22:30:15.381 INFO:teuthology.orchestra.run.smithi156.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.187617.log.gz 2023-09-30T22:30:15.381 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.187888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160469.log 2023-09-30T22:30:15.381 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.187888.log.gz 2023-09-30T22:30:15.381 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.152401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153233.log 2023-09-30T22:30:15.381 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.152401.log.gz 2023-09-30T22:30:15.382 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.160469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124691.log 2023-09-30T22:30:15.382 INFO:teuthology.orchestra.run.smithi156.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.160469.log.gz 2023-09-30T22:30:15.382 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.153233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163294.log 2023-09-30T22:30:15.382 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.153233.log.gz 2023-09-30T22:30:15.382 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.124691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191350.log 2023-09-30T22:30:15.382 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.124691.log.gz 2023-09-30T22:30:15.382 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.163294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153356.log 2023-09-30T22:30:15.382 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.163294.log.gz 2023-09-30T22:30:15.383 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.191350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189167.log 2023-09-30T22:30:15.383 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.191350.log.gz 2023-09-30T22:30:15.383 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.153356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163956.log 2023-09-30T22:30:15.383 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.153356.log.gz 2023-09-30T22:30:15.383 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.189167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193286.log 2023-09-30T22:30:15.383 INFO:teuthology.orchestra.run.smithi156.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.189167.log.gz 2023-09-30T22:30:15.383 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.163956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174009.log 2023-09-30T22:30:15.383 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.163956.log.gz 2023-09-30T22:30:15.384 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.193286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139379.log 2023-09-30T22:30:15.384 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.193286.log.gz 2023-09-30T22:30:15.384 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.174009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122619.log 2023-09-30T22:30:15.384 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.174009.log.gz 2023-09-30T22:30:15.384 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.139379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125742.log 2023-09-30T22:30:15.384 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139379.log.gz 2023-09-30T22:30:15.384 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.122619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162233.log 2023-09-30T22:30:15.384 INFO:teuthology.orchestra.run.smithi156.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122619.log.gz 2023-09-30T22:30:15.385 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.125742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191154.log 2023-09-30T22:30:15.385 INFO:teuthology.orchestra.run.smithi156.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.125742.log.gz 2023-09-30T22:30:15.385 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118497.log 2023-09-30T22:30:15.385 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.162233.log: /var/log/ceph/ceph-client.admin.191154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156647.log 2023-09-30T22:30:15.385 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162233.log.gz 2023-09-30T22:30:15.385 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.191154.log.gz 2023-09-30T22:30:15.385 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.118497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141413.log 2023-09-30T22:30:15.385 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.156647.log: gzip -5 --verbose -- 89.1%/var/log/ceph/ceph-client.admin.178232.log 2023-09-30T22:30:15.385 INFO:teuthology.orchestra.run.smithi156.stderr: -- replaced with /var/log/ceph/ceph-client.admin.118497.log.gz 2023-09-30T22:30:15.386 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.141413.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156647.log.gz 2023-09-30T22:30:15.386 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151786.log 2023-09-30T22:30:15.386 INFO:teuthology.orchestra.run.smithi156.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.141413.log.gz 2023-09-30T22:30:15.386 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.178232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188435.log 2023-09-30T22:30:15.386 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.178232.log.gz 2023-09-30T22:30:15.386 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.151786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136529.log 2023-09-30T22:30:15.386 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.188435.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.151786.log.gz 2023-09-30T22:30:15.386 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167559.log 2023-09-30T22:30:15.387 INFO:teuthology.orchestra.run.smithi156.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.188435.log.gz 2023-09-30T22:30:15.387 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.136529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190147.log 2023-09-30T22:30:15.387 INFO:teuthology.orchestra.run.smithi156.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.136529.log.gz 2023-09-30T22:30:15.387 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.167559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145540.log 2023-09-30T22:30:15.387 INFO:teuthology.orchestra.run.smithi156.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.167559.log.gz 2023-09-30T22:30:15.387 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.190147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163098.log 2023-09-30T22:30:15.387 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.190147.log.gz 2023-09-30T22:30:15.387 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.145540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190616.log 2023-09-30T22:30:15.388 INFO:teuthology.orchestra.run.smithi156.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.145540.log.gz 2023-09-30T22:30:15.388 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.163098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128339.log 2023-09-30T22:30:15.388 INFO:teuthology.orchestra.run.smithi156.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.163098.log.gz 2023-09-30T22:30:15.388 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.190616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138054.log 2023-09-30T22:30:15.388 INFO:teuthology.orchestra.run.smithi156.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.190616.log.gz 2023-09-30T22:30:15.388 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.128339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152624.log 2023-09-30T22:30:15.388 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.128339.log.gz 2023-09-30T22:30:15.388 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.138054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158068.log 2023-09-30T22:30:15.389 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.138054.log.gz 2023-09-30T22:30:15.389 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.152624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168538.log 2023-09-30T22:30:15.389 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.152624.log.gz 2023-09-30T22:30:15.389 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.158068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191323.log 2023-09-30T22:30:15.389 INFO:teuthology.orchestra.run.smithi156.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.158068.log.gz 2023-09-30T22:30:15.389 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.168538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182691.log 2023-09-30T22:30:15.389 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.191323.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.168538.log.gz 2023-09-30T22:30:15.389 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168983.log 2023-09-30T22:30:15.390 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.191323.log.gz 2023-09-30T22:30:15.390 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.182691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185827.log 2023-09-30T22:30:15.390 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.182691.log.gz 2023-09-30T22:30:15.390 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.168983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152233.log 2023-09-30T22:30:15.390 INFO:teuthology.orchestra.run.smithi156.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.168983.log.gz/var/log/ceph/ceph-client.admin.185827.log: 2023-09-30T22:30:15.390 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165037.log 2023-09-30T22:30:15.390 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.185827.log.gz 2023-09-30T22:30:15.390 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.152233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144969.log 2023-09-30T22:30:15.391 INFO:teuthology.orchestra.run.smithi156.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.152233.log.gz 2023-09-30T22:30:15.391 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.165037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194477.log 2023-09-30T22:30:15.391 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.144969.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.165037.log.gz 2023-09-30T22:30:15.391 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182738.log 2023-09-30T22:30:15.391 INFO:teuthology.orchestra.run.smithi156.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.144969.log.gz 2023-09-30T22:30:15.391 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.194477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191549.log 2023-09-30T22:30:15.391 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.182738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192894.log 2023-09-30T22:30:15.391 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.194477.log.gz 2023-09-30T22:30:15.392 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.191549.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.182738.log.gz 2023-09-30T22:30:15.392 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177046.log 2023-09-30T22:30:15.392 INFO:teuthology.orchestra.run.smithi156.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.191549.log.gz 2023-09-30T22:30:15.392 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.192894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171061.log 2023-09-30T22:30:15.392 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.177046.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.192894.log.gz 2023-09-30T22:30:15.392 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135334.log 2023-09-30T22:30:15.392 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.177046.log.gz 2023-09-30T22:30:15.392 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.171061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152008.log 2023-09-30T22:30:15.393 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171061.log.gz 2023-09-30T22:30:15.393 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.135334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175675.log 2023-09-30T22:30:15.393 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.152008.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.135334.log.gz 2023-09-30T22:30:15.393 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189463.log 2023-09-30T22:30:15.393 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.152008.log.gz 2023-09-30T22:30:15.393 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.175675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153037.log 2023-09-30T22:30:15.393 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.175675.log.gz 2023-09-30T22:30:15.393 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.189463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192771.log 2023-09-30T22:30:15.394 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.189463.log.gz 2023-09-30T22:30:15.394 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.153037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124032.log 2023-09-30T22:30:15.394 INFO:teuthology.orchestra.run.smithi156.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.153037.log.gz 2023-09-30T22:30:15.394 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.192771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176754.log 2023-09-30T22:30:15.394 INFO:teuthology.orchestra.run.smithi156.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.192771.log.gz 2023-09-30T22:30:15.394 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.124032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183914.log 2023-09-30T22:30:15.394 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.176754.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.124032.log.gz 2023-09-30T22:30:15.394 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186885.log 2023-09-30T22:30:15.395 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.176754.log.gz 2023-09-30T22:30:15.395 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.183914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125181.log 2023-09-30T22:30:15.395 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.183914.log.gz 2023-09-30T22:30:15.395 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.186885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125377.log 2023-09-30T22:30:15.395 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.125181.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.186885.log.gz 2023-09-30T22:30:15.395 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156843.log 2023-09-30T22:30:15.395 INFO:teuthology.orchestra.run.smithi156.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.125181.log.gz 2023-09-30T22:30:15.395 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.125377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166634.log 2023-09-30T22:30:15.396 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.156843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186662.log 2023-09-30T22:30:15.396 INFO:teuthology.orchestra.run.smithi156.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.125377.log.gz 2023-09-30T22:30:15.396 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156843.log.gz 2023-09-30T22:30:15.396 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.166634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158115.log 2023-09-30T22:30:15.396 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.186662.log: gzip -5 89.3%--verbose -- /var/log/ceph/ceph-client.admin.136923.log -- replaced with /var/log/ceph/ceph-client.admin.166634.log.gz 2023-09-30T22:30:15.396 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-09-30T22:30:15.396 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.158115.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.186662.log.gz 2023-09-30T22:30:15.396 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143105.log 2023-09-30T22:30:15.396 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.158115.log.gz 2023-09-30T22:30:15.397 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.136923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142123.log 2023-09-30T22:30:15.397 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136923.log.gz 2023-09-30T22:30:15.397 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.143105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156696.log 2023-09-30T22:30:15.397 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.142123.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143105.log.gz 2023-09-30T22:30:15.397 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148682.log 2023-09-30T22:30:15.397 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.142123.log.gz 2023-09-30T22:30:15.397 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.156696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145262.log 2023-09-30T22:30:15.397 INFO:teuthology.orchestra.run.smithi156.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.156696.log.gz 2023-09-30T22:30:15.398 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.148682.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-09-30T22:30:15.398 INFO:teuthology.orchestra.run.smithi156.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.148682.log.gz 2023-09-30T22:30:15.398 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.145262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148459.log 2023-09-30T22:30:15.398 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.145262.log.gz 2023-09-30T22:30:15.398 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123711.log 2023-09-30T22:30:15.398 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.148459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123838.log 2023-09-30T22:30:15.398 INFO:teuthology.orchestra.run.smithi156.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.148459.log.gz 2023-09-30T22:30:15.398 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.123711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159244.log 2023-09-30T22:30:15.399 INFO:teuthology.orchestra.run.smithi156.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123711.log.gz 2023-09-30T22:30:15.399 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.123838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174278.log 2023-09-30T22:30:15.399 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.123838.log.gz 2023-09-30T22:30:15.399 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.159244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164470.log 2023-09-30T22:30:15.399 INFO:teuthology.orchestra.run.smithi156.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.159244.log.gz 2023-09-30T22:30:15.399 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.174278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168395.log 2023-09-30T22:30:15.399 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.174278.log.gz 2023-09-30T22:30:15.399 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.164470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159293.log 2023-09-30T22:30:15.400 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.168395.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.164470.log.gz 2023-09-30T22:30:15.400 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164930.log 2023-09-30T22:30:15.400 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.168395.log.gz 2023-09-30T22:30:15.400 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140214.log 2023-09-30T22:30:15.400 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.159293.log: /var/log/ceph/ceph-client.admin.164930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155079.log 2023-09-30T22:30:15.400 INFO:teuthology.orchestra.run.smithi156.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.159293.log.gz 2023-09-30T22:30:15.400 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.164930.log.gz 2023-09-30T22:30:15.400 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.140214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134863.log 2023-09-30T22:30:15.401 INFO:teuthology.orchestra.run.smithi156.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140214.log.gz 2023-09-30T22:30:15.401 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150244.log 2023-09-30T22:30:15.401 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.155079.log: /var/log/ceph/ceph-client.admin.134863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182299.log 2023-09-30T22:30:15.401 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.155079.log.gz 2023-09-30T22:30:15.401 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.150244.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.134863.log.gz 2023-09-30T22:30:15.401 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163025.log 2023-09-30T22:30:15.401 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156181.log 2023-09-30T22:30:15.401 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.182299.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.150244.log.gz 2023-09-30T22:30:15.402 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.163025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135477.log 2023-09-30T22:30:15.402 INFO:teuthology.orchestra.run.smithi156.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.182299.log.gz 2023-09-30T22:30:15.402 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.156181.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.163025.log.gz 2023-09-30T22:30:15.402 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187841.log 2023-09-30T22:30:15.402 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.135477.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.156181.log.gz 2023-09-30T22:30:15.402 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189415.log 2023-09-30T22:30:15.402 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.135477.log.gz 2023-09-30T22:30:15.403 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.187841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183940.log 2023-09-30T22:30:15.403 INFO:teuthology.orchestra.run.smithi156.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.187841.log.gz 2023-09-30T22:30:15.403 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.189415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181954.log 2023-09-30T22:30:15.403 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.183940.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.189415.log.gz 2023-09-30T22:30:15.403 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179202.log 2023-09-30T22:30:15.403 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.183940.log.gz 2023-09-30T22:30:15.403 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.181954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172859.log 2023-09-30T22:30:15.403 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.181954.log.gz 2023-09-30T22:30:15.404 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.179202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151271.log 2023-09-30T22:30:15.404 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.172859.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.179202.log.gz 2023-09-30T22:30:15.404 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177734.log 2023-09-30T22:30:15.404 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.172859.log.gz 2023-09-30T22:30:15.404 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.151271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128097.log 2023-09-30T22:30:15.404 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.177734.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.151271.log.gz 2023-09-30T22:30:15.404 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165233.log 2023-09-30T22:30:15.404 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.128097.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.177734.log.gz 2023-09-30T22:30:15.404 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141067.log 2023-09-30T22:30:15.405 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.128097.log.gz 2023-09-30T22:30:15.405 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.165233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173474.log 2023-09-30T22:30:15.405 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.165233.log.gz 2023-09-30T22:30:15.405 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.141067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138007.log 2023-09-30T22:30:15.405 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.173474.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.141067.log.gzgzip 2023-09-30T22:30:15.405 INFO:teuthology.orchestra.run.smithi156.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.127582.log 2023-09-30T22:30:15.405 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.138007.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.173474.log.gz 2023-09-30T22:30:15.405 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144503.log 2023-09-30T22:30:15.406 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138007.log.gz 2023-09-30T22:30:15.406 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.127582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180927.log 2023-09-30T22:30:15.406 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.144503.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.127582.log.gz 2023-09-30T22:30:15.406 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173251.log 2023-09-30T22:30:15.406 INFO:teuthology.orchestra.run.smithi156.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.144503.log.gz 2023-09-30T22:30:15.406 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181907.log 2023-09-30T22:30:15.406 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.180927.log: /var/log/ceph/ceph-client.admin.173251.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.180927.log.gz 2023-09-30T22:30:15.406 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169767.log 2023-09-30T22:30:15.407 INFO:teuthology.orchestra.run.smithi156.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.173251.log.gz 2023-09-30T22:30:15.410 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.181907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151151.log 2023-09-30T22:30:15.410 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.181907.log.gz 2023-09-30T22:30:15.410 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.169767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180412.log 2023-09-30T22:30:15.410 INFO:teuthology.orchestra.run.smithi156.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.169767.log.gz 2023-09-30T22:30:15.410 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.151151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162280.log 2023-09-30T22:30:15.411 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.180412.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.151151.log.gz 2023-09-30T22:30:15.411 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188036.log 2023-09-30T22:30:15.411 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180412.log.gz 2023-09-30T22:30:15.411 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.162280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185043.log 2023-09-30T22:30:15.411 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.188036.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.162280.log.gz 2023-09-30T22:30:15.411 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174597.log 2023-09-30T22:30:15.411 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.185043.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.188036.log.gz 2023-09-30T22:30:15.411 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150001.log 2023-09-30T22:30:15.412 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.174597.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.185043.log.gz 2023-09-30T22:30:15.412 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170669.log 2023-09-30T22:30:15.412 INFO:teuthology.orchestra.run.smithi156.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.174597.log.gz 2023-09-30T22:30:15.412 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.150001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127761.log 2023-09-30T22:30:15.412 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.170669.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.150001.log.gz 2023-09-30T22:30:15.412 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164734.log 2023-09-30T22:30:15.412 INFO:teuthology.orchestra.run.smithi156.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.170669.log.gz 2023-09-30T22:30:15.412 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.127761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142152.log 2023-09-30T22:30:15.413 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.127761.log.gz 2023-09-30T22:30:15.413 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.164734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164248.log 2023-09-30T22:30:15.413 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.142152.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.164734.log.gz 2023-09-30T22:30:15.413 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159387.log 2023-09-30T22:30:15.413 INFO:teuthology.orchestra.run.smithi156.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.142152.log.gz 2023-09-30T22:30:15.413 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.164248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158213.log 2023-09-30T22:30:15.413 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.159387.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.164248.log.gz 2023-09-30T22:30:15.413 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139430.log 2023-09-30T22:30:15.414 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.158213.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.159387.log.gz 2023-09-30T22:30:15.414 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158927.log 2023-09-30T22:30:15.414 INFO:teuthology.orchestra.run.smithi156.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.158213.log.gz 2023-09-30T22:30:15.414 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.139430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138521.log 2023-09-30T22:30:15.414 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139430.log.gz 2023-09-30T22:30:15.414 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.158927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150955.log 2023-09-30T22:30:15.414 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.138521.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158927.log.gz 2023-09-30T22:30:15.414 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179228.log 2023-09-30T22:30:15.415 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.138521.log.gz 2023-09-30T22:30:15.415 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.150955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137092.log 2023-09-30T22:30:15.415 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.150955.log.gz 2023-09-30T22:30:15.415 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.179228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179398.log 2023-09-30T22:30:15.415 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.137092.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.179228.log.gz 2023-09-30T22:30:15.415 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172715.log 2023-09-30T22:30:15.415 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.137092.log.gz 2023-09-30T22:30:15.415 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.179398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170865.log 2023-09-30T22:30:15.415 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.172715.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.179398.log.gz 2023-09-30T22:30:15.416 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136039.log 2023-09-30T22:30:15.416 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.172715.log.gz 2023-09-30T22:30:15.416 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.170865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162672.log 2023-09-30T22:30:15.416 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.170865.log.gz 2023-09-30T22:30:15.416 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.136039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161008.log 2023-09-30T22:30:15.416 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.162672.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.136039.log.gz 2023-09-30T22:30:15.416 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141263.log 2023-09-30T22:30:15.416 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.161008.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.162672.log.gz 2023-09-30T22:30:15.417 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158141.log 2023-09-30T22:30:15.417 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161008.log.gz 2023-09-30T22:30:15.417 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.141263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146865.log 2023-09-30T22:30:15.417 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.158141.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141263.log.gz 2023-09-30T22:30:15.417 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190247.log 2023-09-30T22:30:15.417 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.158141.log.gz 2023-09-30T22:30:15.417 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.146865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135747.log 2023-09-30T22:30:15.417 INFO:teuthology.orchestra.run.smithi156.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.146865.log.gz 2023-09-30T22:30:15.418 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.190247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174697.log 2023-09-30T22:30:15.418 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.135747.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.190247.log.gz 2023-09-30T22:30:15.418 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125595.log 2023-09-30T22:30:15.418 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.174697.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.135747.log.gz 2023-09-30T22:30:15.418 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161300.log 2023-09-30T22:30:15.418 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174697.log.gz 2023-09-30T22:30:15.418 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.125595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183596.log 2023-09-30T22:30:15.418 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.161300.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.125595.log.gz 2023-09-30T22:30:15.419 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143966.log 2023-09-30T22:30:15.419 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161300.log.gz 2023-09-30T22:30:15.419 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.183596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147035.log 2023-09-30T22:30:15.419 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.183596.log.gz 2023-09-30T22:30:15.419 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.143966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129848.log 2023-09-30T22:30:15.419 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.143966.log.gz 2023-09-30T22:30:15.419 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.147035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123662.log 2023-09-30T22:30:15.419 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.129848.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.147035.log.gz 2023-09-30T22:30:15.420 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124034.log 2023-09-30T22:30:15.420 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.129848.log.gz 2023-09-30T22:30:15.420 INFO:teuthology.orchestra.run.smithi156.stderr:gzip /var/log/ceph/ceph-client.admin.123662.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.152570.log 2023-09-30T22:30:15.420 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.124034.log: gzip 87.6%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.123662.log.gz-- 2023-09-30T22:30:15.420 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.127226.log 2023-09-30T22:30:15.420 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124034.log.gz 2023-09-30T22:30:15.420 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.152570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172245.log 2023-09-30T22:30:15.420 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.152570.log.gz 2023-09-30T22:30:15.421 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.127226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166838.log 2023-09-30T22:30:15.421 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.127226.log.gz 2023-09-30T22:30:15.421 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.172245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171461.log 2023-09-30T22:30:15.421 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.166838.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.172245.log.gz 2023-09-30T22:30:15.421 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184332.log 2023-09-30T22:30:15.421 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.166838.log.gz 2023-09-30T22:30:15.421 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.171461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142909.log 2023-09-30T22:30:15.421 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.184332.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.171461.log.gz 2023-09-30T22:30:15.422 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138129.log 2023-09-30T22:30:15.422 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.184332.log.gz 2023-09-30T22:30:15.422 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.142909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164789.log 2023-09-30T22:30:15.422 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.142909.log.gz 2023-09-30T22:30:15.422 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.138129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140215.log 2023-09-30T22:30:15.422 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.164789.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.138129.log.gz 2023-09-30T22:30:15.422 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137517.log 2023-09-30T22:30:15.422 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.164789.log.gz 2023-09-30T22:30:15.423 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.140215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170499.log 2023-09-30T22:30:15.423 INFO:teuthology.orchestra.run.smithi156.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.140215.log.gz 2023-09-30T22:30:15.423 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.137517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149779.log 2023-09-30T22:30:15.423 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.170499.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.137517.log.gz 2023-09-30T22:30:15.423 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143225.log 2023-09-30T22:30:15.423 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.170499.log.gz 2023-09-30T22:30:15.423 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.149779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186244.log 2023-09-30T22:30:15.423 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149779.log.gz 2023-09-30T22:30:15.424 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.143225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162829.log 2023-09-30T22:30:15.424 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143225.log.gz 2023-09-30T22:30:15.424 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154809.log 2023-09-30T22:30:15.424 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.186244.log: /var/log/ceph/ceph-client.admin.162829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162037.log 2023-09-30T22:30:15.424 INFO:teuthology.orchestra.run.smithi156.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.186244.log.gz 2023-09-30T22:30:15.424 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.154809.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.162829.log.gz 2023-09-30T22:30:15.424 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184306.log 2023-09-30T22:30:15.424 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.154809.log.gz 2023-09-30T22:30:15.424 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.162037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138203.log 2023-09-30T22:30:15.425 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162037.log.gz 2023-09-30T22:30:15.425 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166997.log 2023-09-30T22:30:15.425 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.184306.log: /var/log/ceph/ceph-client.admin.138203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160694.log 2023-09-30T22:30:15.425 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.184306.log.gz 2023-09-30T22:30:15.425 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.166997.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.138203.log.gz 2023-09-30T22:30:15.425 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136137.log 2023-09-30T22:30:15.425 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.166997.log.gz 2023-09-30T22:30:15.425 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.160694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144085.log 2023-09-30T22:30:15.426 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.136137.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.160694.log.gzgzip 2023-09-30T22:30:15.426 INFO:teuthology.orchestra.run.smithi156.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.176437.log 2023-09-30T22:30:15.426 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.136137.log.gz 2023-09-30T22:30:15.426 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.144085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156059.log 2023-09-30T22:30:15.426 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.144085.log.gz 2023-09-30T22:30:15.426 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.176437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165430.log 2023-09-30T22:30:15.426 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.176437.log.gz 2023-09-30T22:30:15.426 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.156059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161326.log 2023-09-30T22:30:15.427 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.165430.log: gzip -5 --verbose 88.2%-- /var/log/ceph/ceph-client.admin.125546.log 2023-09-30T22:30:15.427 INFO:teuthology.orchestra.run.smithi156.stderr: -- replaced with /var/log/ceph/ceph-client.admin.156059.log.gz 2023-09-30T22:30:15.427 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.161326.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165430.log.gz 2023-09-30T22:30:15.427 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125132.log 2023-09-30T22:30:15.427 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.161326.log.gz 2023-09-30T22:30:15.427 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.125546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152598.log 2023-09-30T22:30:15.427 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.125132.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125546.log.gz 2023-09-30T22:30:15.427 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191200.log 2023-09-30T22:30:15.428 INFO:teuthology.orchestra.run.smithi156.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.125132.log.gz 2023-09-30T22:30:15.428 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.152598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137714.log 2023-09-30T22:30:15.428 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.152598.log.gz 2023-09-30T22:30:15.428 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.191200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168760.log 2023-09-30T22:30:15.428 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.137714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122717.log 2023-09-30T22:30:15.428 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.191200.log.gz 2023-09-30T22:30:15.428 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.137714.log.gz 2023-09-30T22:30:15.428 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.168760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139820.log 2023-09-30T22:30:15.429 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.168760.log.gz 2023-09-30T22:30:15.429 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.122717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138644.log 2023-09-30T22:30:15.429 INFO:teuthology.orchestra.run.smithi156.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122717.log.gz 2023-09-30T22:30:15.429 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.139820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176634.log 2023-09-30T22:30:15.429 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.138644.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.139820.log.gz 2023-09-30T22:30:15.429 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124544.log 2023-09-30T22:30:15.429 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.138644.log.gz 2023-09-30T22:30:15.429 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.176634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179106.log 2023-09-30T22:30:15.429 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.176634.log.gz 2023-09-30T22:30:15.430 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.124544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188579.log 2023-09-30T22:30:15.430 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.179106.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.124544.log.gz 2023-09-30T22:30:15.430 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168343.log 2023-09-30T22:30:15.430 INFO:teuthology.orchestra.run.smithi156.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.179106.log.gz 2023-09-30T22:30:15.430 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.188579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189611.log 2023-09-30T22:30:15.430 INFO:teuthology.orchestra.run.smithi156.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.188579.log.gz 2023-09-30T22:30:15.430 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.168343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174793.log 2023-09-30T22:30:15.430 INFO:teuthology.orchestra.run.smithi156.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.168343.log.gz 2023-09-30T22:30:15.431 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.189611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191402.log 2023-09-30T22:30:15.431 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.189611.log.gz 2023-09-30T22:30:15.431 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.174793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169348.log 2023-09-30T22:30:15.431 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174793.log.gz 2023-09-30T22:30:15.431 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.191402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122864.log 2023-09-30T22:30:15.431 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.191402.log.gz 2023-09-30T22:30:15.431 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.169348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179694.log 2023-09-30T22:30:15.431 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.122864.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.169348.log.gz 2023-09-30T22:30:15.432 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128971.log 2023-09-30T22:30:15.432 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.179694.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122864.log.gz 2023-09-30T22:30:15.432 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142392.log 2023-09-30T22:30:15.432 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.179694.log.gz 2023-09-30T22:30:15.432 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.128971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176999.log 2023-09-30T22:30:15.432 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.142392.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.128971.log.gz 2023-09-30T22:30:15.432 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157919.log 2023-09-30T22:30:15.432 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.176999.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.142392.log.gz 2023-09-30T22:30:15.433 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151394.log 2023-09-30T22:30:15.433 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.176999.log.gz 2023-09-30T22:30:15.433 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.157919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193706.log 2023-09-30T22:30:15.433 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157919.log.gz 2023-09-30T22:30:15.433 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.151394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172911.log 2023-09-30T22:30:15.433 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.193706.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151394.log.gz 2023-09-30T22:30:15.433 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146329.log 2023-09-30T22:30:15.433 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.172911.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.193706.log.gz 2023-09-30T22:30:15.434 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141953.log 2023-09-30T22:30:15.434 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.146329.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.172911.log.gz 2023-09-30T22:30:15.434 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191914.log 2023-09-30T22:30:15.434 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.146329.log.gz 2023-09-30T22:30:15.434 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.141953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173029.log 2023-09-30T22:30:15.434 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141953.log.gz 2023-09-30T22:30:15.434 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.191914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141655.log 2023-09-30T22:30:15.434 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.191914.log.gz 2023-09-30T22:30:15.435 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.173029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149583.log 2023-09-30T22:30:15.435 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.141655.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.173029.log.gz 2023-09-30T22:30:15.435 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146251.log 2023-09-30T22:30:15.435 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141655.log.gz 2023-09-30T22:30:15.435 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.149583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165769.log 2023-09-30T22:30:15.435 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.149583.log.gz 2023-09-30T22:30:15.435 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.146251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156743.log 2023-09-30T22:30:15.435 INFO:teuthology.orchestra.run.smithi156.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.146251.log.gz 2023-09-30T22:30:15.436 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.165769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146668.log 2023-09-30T22:30:15.436 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.156743.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.165769.log.gz 2023-09-30T22:30:15.436 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184528.log 2023-09-30T22:30:15.436 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.156743.log.gz 2023-09-30T22:30:15.436 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.146668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181366.log 2023-09-30T22:30:15.436 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.184528.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.146668.log.gz 2023-09-30T22:30:15.436 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162902.log 2023-09-30T22:30:15.436 INFO:teuthology.orchestra.run.smithi156.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.184528.log.gz 2023-09-30T22:30:15.437 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.181366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189585.log 2023-09-30T22:30:15.437 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.162902.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.181366.log.gz 2023-09-30T22:30:15.437 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161400.log 2023-09-30T22:30:15.437 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.162902.log.gz 2023-09-30T22:30:15.437 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.189585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191127.log 2023-09-30T22:30:15.437 INFO:teuthology.orchestra.run.smithi156.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.189585.log.gz 2023-09-30T22:30:15.437 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.161400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168709.log 2023-09-30T22:30:15.437 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.161400.log.gz 2023-09-30T22:30:15.438 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.191127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164150.log 2023-09-30T22:30:15.438 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.168709.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.191127.log.gz 2023-09-30T22:30:15.438 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154613.log 2023-09-30T22:30:15.438 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168709.log.gz 2023-09-30T22:30:15.438 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.164150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169544.log 2023-09-30T22:30:15.438 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.154613.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.164150.log.gz 2023-09-30T22:30:15.438 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-09-30T22:30:15.438 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.169544.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.154613.log.gz 2023-09-30T22:30:15.439 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157945.log 2023-09-30T22:30:15.439 INFO:teuthology.orchestra.run.smithi156.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.169544.log.gz 2023-09-30T22:30:15.439 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165868.log 2023-09-30T22:30:15.439 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.157945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148655.log 2023-09-30T22:30:15.439 INFO:teuthology.orchestra.run.smithi156.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.157945.log.gz 2023-09-30T22:30:15.439 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.165868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139575.log 2023-09-30T22:30:15.439 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140825.log 2023-09-30T22:30:15.439 INFO:teuthology.orchestra.run.smithi156.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.165868.log.gz 2023-09-30T22:30:15.440 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.148655.log: /var/log/ceph/ceph-client.admin.139575.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.148655.log.gz 2023-09-30T22:30:15.440 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188463.log 2023-09-30T22:30:15.440 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.140825.log: gzip -5 --verbose -- 88.4%/var/log/ceph/ceph-client.admin.155371.log 2023-09-30T22:30:15.440 INFO:teuthology.orchestra.run.smithi156.stderr: -- replaced with /var/log/ceph/ceph-client.admin.139575.log.gz 2023-09-30T22:30:15.440 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.188463.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.140825.log.gz 2023-09-30T22:30:15.440 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145091.log 2023-09-30T22:30:15.440 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.188463.log.gz 2023-09-30T22:30:15.440 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.155371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187278.log 2023-09-30T22:30:15.441 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.145091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137419.log 2023-09-30T22:30:15.441 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.155371.log.gz 2023-09-30T22:30:15.441 INFO:teuthology.orchestra.run.smithi156.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.145091.log.gz 2023-09-30T22:30:15.441 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.187278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176042.log 2023-09-30T22:30:15.441 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177979.log 2023-09-30T22:30:15.441 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.187278.log.gz 2023-09-30T22:30:15.441 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.137419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137119.log 2023-09-30T22:30:15.441 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.176042.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.137419.log.gz 2023-09-30T22:30:15.442 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.177979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123835.log 2023-09-30T22:30:15.442 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.176042.log.gz 2023-09-30T22:30:15.442 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.177979.log.gz 2023-09-30T22:30:15.442 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.137119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175773.log 2023-09-30T22:30:15.442 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.123835.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.137119.log.gz 2023-09-30T22:30:15.442 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141608.log 2023-09-30T22:30:15.442 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.175773.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.123835.log.gz 2023-09-30T22:30:15.442 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179032.log 2023-09-30T22:30:15.443 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.175773.log.gz 2023-09-30T22:30:15.443 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.141608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173421.log 2023-09-30T22:30:15.443 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151225.log 2023-09-30T22:30:15.443 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141608.log.gz 2023-09-30T22:30:15.443 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.179032.log: /var/log/ceph/ceph-client.admin.173421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170356.log 2023-09-30T22:30:15.443 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.179032.log.gz 2023-09-30T22:30:15.443 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.151225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158703.log 2023-09-30T22:30:15.443 INFO:teuthology.orchestra.run.smithi156.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.173421.log.gz 2023-09-30T22:30:15.444 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.151225.log.gz 2023-09-30T22:30:15.444 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.170356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176950.log 2023-09-30T22:30:15.444 INFO:teuthology.orchestra.run.smithi156.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.170356.log.gz 2023-09-30T22:30:15.444 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185339.log 2023-09-30T22:30:15.444 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.158703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194526.log 2023-09-30T22:30:15.444 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.176950.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.158703.log.gz 2023-09-30T22:30:15.444 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124031.log 2023-09-30T22:30:15.444 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.185339.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176950.log.gz 2023-09-30T22:30:15.445 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.194526.log: gzip 89.2%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.185339.log.gz-- 2023-09-30T22:30:15.445 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.142000.log 2023-09-30T22:30:15.445 INFO:teuthology.orchestra.run.smithi156.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.194526.log.gz 2023-09-30T22:30:15.445 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.124031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186049.log 2023-09-30T22:30:15.445 INFO:teuthology.orchestra.run.smithi156.stderr: 95.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-09-30T22:30:15.445 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162306.log 2023-09-30T22:30:15.445 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.142000.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.124031.log.gz 2023-09-30T22:30:15.445 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.186049.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142000.log.gz 2023-09-30T22:30:15.446 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170891.log 2023-09-30T22:30:15.446 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.162306.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.186049.log.gz 2023-09-30T22:30:15.446 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148211.log 2023-09-30T22:30:15.446 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162306.log.gz 2023-09-30T22:30:15.446 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.170891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151543.log 2023-09-30T22:30:15.446 INFO:teuthology.orchestra.run.smithi156.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.170891.log.gz 2023-09-30T22:30:15.446 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.148211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189559.log 2023-09-30T22:30:15.446 INFO:teuthology.orchestra.run.smithi156.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.148211.log.gz 2023-09-30T22:30:15.446 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.151543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188801.log 2023-09-30T22:30:15.447 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.189559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129216.log 2023-09-30T22:30:15.447 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151543.log.gz 2023-09-30T22:30:15.447 INFO:teuthology.orchestra.run.smithi156.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.189559.log.gz 2023-09-30T22:30:15.447 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.188801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141852.log 2023-09-30T22:30:15.447 INFO:teuthology.orchestra.run.smithi156.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.188801.log.gz 2023-09-30T22:30:15.447 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.129216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187447.log 2023-09-30T22:30:15.447 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.129216.log.gz 2023-09-30T22:30:15.447 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.141852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161204.log 2023-09-30T22:30:15.448 INFO:teuthology.orchestra.run.smithi156.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.141852.log.gz 2023-09-30T22:30:15.448 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.187447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179155.log 2023-09-30T22:30:15.448 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.161204.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.187447.log.gz 2023-09-30T22:30:15.448 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180020.log 2023-09-30T22:30:15.448 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.179155.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161204.log.gz 2023-09-30T22:30:15.448 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140608.log 2023-09-30T22:30:15.448 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179155.log.gz 2023-09-30T22:30:15.448 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.180020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183225.log 2023-09-30T22:30:15.449 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.140608.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.180020.log.gz 2023-09-30T22:30:15.449 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174307.log 2023-09-30T22:30:15.449 INFO:teuthology.orchestra.run.smithi156.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140608.log.gz 2023-09-30T22:30:15.449 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.183225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129118.log 2023-09-30T22:30:15.449 INFO:teuthology.orchestra.run.smithi156.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.183225.log.gz 2023-09-30T22:30:15.449 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.174307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146669.log 2023-09-30T22:30:15.449 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.129118.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.174307.log.gz 2023-09-30T22:30:15.449 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135871.log 2023-09-30T22:30:15.449 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129118.log.gz 2023-09-30T22:30:15.450 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.146669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181000.log 2023-09-30T22:30:15.450 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.146669.log.gz 2023-09-30T22:30:15.450 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.135871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182372.log 2023-09-30T22:30:15.450 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.181000.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.135871.log.gz 2023-09-30T22:30:15.450 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171265.log 2023-09-30T22:30:15.450 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.181000.log.gz 2023-09-30T22:30:15.450 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.182372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148899.log 2023-09-30T22:30:15.450 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.182372.log.gz 2023-09-30T22:30:15.451 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.171265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173617.log 2023-09-30T22:30:15.451 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.148899.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.171265.log.gz 2023-09-30T22:30:15.451 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167632.log 2023-09-30T22:30:15.451 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.173617.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.148899.log.gz 2023-09-30T22:30:15.451 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184575.log 2023-09-30T22:30:15.451 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173617.log.gz 2023-09-30T22:30:15.451 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.167632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186101.log 2023-09-30T22:30:15.451 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.184575.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.167632.log.gz 2023-09-30T22:30:15.452 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188383.log 2023-09-30T22:30:15.452 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.186101.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.184575.log.gz 2023-09-30T22:30:15.452 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185657.log 2023-09-30T22:30:15.452 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.186101.log.gz 2023-09-30T22:30:15.452 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.188383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129314.log 2023-09-30T22:30:15.452 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.185657.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.188383.log.gz 2023-09-30T22:30:15.452 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173886.log 2023-09-30T22:30:15.452 INFO:teuthology.orchestra.run.smithi156.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.185657.log.gz/var/log/ceph/ceph-client.admin.129314.log: 2023-09-30T22:30:15.453 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180608.log 2023-09-30T22:30:15.453 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.129314.log.gz 2023-09-30T22:30:15.453 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.173886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139013.log 2023-09-30T22:30:15.453 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.180608.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.173886.log.gz 2023-09-30T22:30:15.453 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160665.log 2023-09-30T22:30:15.453 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.180608.log.gz 2023-09-30T22:30:15.453 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168024.log 2023-09-30T22:30:15.453 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.139013.log: /var/log/ceph/ceph-client.admin.160665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153552.log 2023-09-30T22:30:15.453 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.139013.log.gz 2023-09-30T22:30:15.454 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.168024.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160665.log.gz 2023-09-30T22:30:15.454 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154491.log 2023-09-30T22:30:15.454 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168024.log.gz 2023-09-30T22:30:15.454 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.153552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155128.log 2023-09-30T22:30:15.454 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.153552.log.gz 2023-09-30T22:30:15.454 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.154491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176240.log 2023-09-30T22:30:15.454 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.155128.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.154491.log.gz 2023-09-30T22:30:15.454 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128292.log 2023-09-30T22:30:15.455 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.176240.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.155128.log.gz 2023-09-30T22:30:15.455 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153699.log 2023-09-30T22:30:15.455 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.176240.log.gz 2023-09-30T22:30:15.455 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.128292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164815.log 2023-09-30T22:30:15.455 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.153699.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.128292.log.gz 2023-09-30T22:30:15.455 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164344.log 2023-09-30T22:30:15.455 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.153699.log.gz 2023-09-30T22:30:15.455 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.164815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172494.log 2023-09-30T22:30:15.456 INFO:teuthology.orchestra.run.smithi156.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.164815.log.gz 2023-09-30T22:30:15.456 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.164344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128579.log 2023-09-30T22:30:15.456 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.172494.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164344.log.gz 2023-09-30T22:30:15.456 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170160.log 2023-09-30T22:30:15.456 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.172494.log.gz 2023-09-30T22:30:15.456 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.128579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156769.log 2023-09-30T22:30:15.456 INFO:teuthology.orchestra.run.smithi156.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.128579.log.gz 2023-09-30T22:30:15.456 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.170160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149021.log 2023-09-30T22:30:15.457 INFO:teuthology.orchestra.run.smithi156.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.170160.log.gz 2023-09-30T22:30:15.457 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.156769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152794.log 2023-09-30T22:30:15.457 INFO:teuthology.orchestra.run.smithi156.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.156769.log.gz 2023-09-30T22:30:15.457 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.149021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167533.log 2023-09-30T22:30:15.457 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149021.log.gz 2023-09-30T22:30:15.457 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.152794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165181.log 2023-09-30T22:30:15.457 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.167533.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.152794.log.gz 2023-09-30T22:30:15.457 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166553.log 2023-09-30T22:30:15.457 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167533.log.gz 2023-09-30T22:30:15.458 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.165181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150367.log 2023-09-30T22:30:15.458 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188231.log 2023-09-30T22:30:15.458 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.165181.log.gz/var/log/ceph/ceph-client.admin.166553.log: 2023-09-30T22:30:15.458 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.150367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188827.log 2023-09-30T22:30:15.458 INFO:teuthology.orchestra.run.smithi156.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.166553.log.gz 2023-09-30T22:30:15.458 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.188231.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.150367.log.gz 2023-09-30T22:30:15.458 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161792.log 2023-09-30T22:30:15.459 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.188827.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.188231.log.gz 2023-09-30T22:30:15.459 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162502.log 2023-09-30T22:30:15.459 INFO:teuthology.orchestra.run.smithi156.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.188827.log.gz 2023-09-30T22:30:15.459 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.161792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179006.log 2023-09-30T22:30:15.459 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.161792.log.gz 2023-09-30T22:30:15.459 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.162502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173055.log 2023-09-30T22:30:15.459 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.179006.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.162502.log.gz 2023-09-30T22:30:15.459 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171683.log 2023-09-30T22:30:15.459 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.179006.log.gz 2023-09-30T22:30:15.460 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.173055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172541.log 2023-09-30T22:30:15.460 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.173055.log.gz 2023-09-30T22:30:15.460 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.171683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138671.log 2023-09-30T22:30:15.460 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.172541.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.171683.log.gz 2023-09-30T22:30:15.460 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187081.log 2023-09-30T22:30:15.460 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.172541.log.gz 2023-09-30T22:30:15.460 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.138671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144306.log 2023-09-30T22:30:15.460 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.138671.log.gz 2023-09-30T22:30:15.461 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.187081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160516.log 2023-09-30T22:30:15.461 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.187081.log.gz 2023-09-30T22:30:15.461 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.144306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148015.log 2023-09-30T22:30:15.461 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.144306.log.gz 2023-09-30T22:30:15.461 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.160516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166213.log 2023-09-30T22:30:15.461 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.160516.log.gz 2023-09-30T22:30:15.461 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.148015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190931.log 2023-09-30T22:30:15.461 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.166213.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148015.log.gz 2023-09-30T22:30:15.462 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147651.log 2023-09-30T22:30:15.462 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.190931.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.166213.log.gz 2023-09-30T22:30:15.462 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151347.log 2023-09-30T22:30:15.462 INFO:teuthology.orchestra.run.smithi156.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.190931.log.gz 2023-09-30T22:30:15.462 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.147651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149438.log 2023-09-30T22:30:15.462 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.147651.log.gz 2023-09-30T22:30:15.462 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.151347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135720.log 2023-09-30T22:30:15.462 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.149438.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.151347.log.gz 2023-09-30T22:30:15.463 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193163.log 2023-09-30T22:30:15.463 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.149438.log.gz 2023-09-30T22:30:15.463 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.135720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169127.log 2023-09-30T22:30:15.463 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.135720.log.gz 2023-09-30T22:30:15.463 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.193163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166016.log 2023-09-30T22:30:15.463 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.169127.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.193163.log.gz 2023-09-30T22:30:15.463 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176680.log 2023-09-30T22:30:15.463 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.166016.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.169127.log.gz 2023-09-30T22:30:15.464 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181319.log 2023-09-30T22:30:15.464 INFO:teuthology.orchestra.run.smithi156.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.166016.log.gz 2023-09-30T22:30:15.464 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.176680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155324.log 2023-09-30T22:30:15.464 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.181319.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.176680.log.gz 2023-09-30T22:30:15.464 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145937.log 2023-09-30T22:30:15.464 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.155324.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.181319.log.gz 2023-09-30T22:30:15.464 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165011.log 2023-09-30T22:30:15.464 INFO:teuthology.orchestra.run.smithi156.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.155324.log.gz 2023-09-30T22:30:15.465 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.145937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127228.log 2023-09-30T22:30:15.465 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.165011.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.145937.log.gz 2023-09-30T22:30:15.465 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180582.log 2023-09-30T22:30:15.465 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.165011.log.gz 2023-09-30T22:30:15.465 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.127228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193751.log 2023-09-30T22:30:15.465 INFO:teuthology.orchestra.run.smithi156.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.127228.log.gz 2023-09-30T22:30:15.465 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.180582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162429.log 2023-09-30T22:30:15.465 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.193751.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.180582.log.gz 2023-09-30T22:30:15.466 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139012.log 2023-09-30T22:30:15.466 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.162429.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.193751.log.gz 2023-09-30T22:30:15.466 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118175.log 2023-09-30T22:30:15.466 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.162429.log.gz 2023-09-30T22:30:15.466 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.139012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123221.log 2023-09-30T22:30:15.466 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.118175.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.139012.log.gz 2023-09-30T22:30:15.466 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-09-30T22:30:15.466 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.123221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192993.log 2023-09-30T22:30:15.467 INFO:teuthology.orchestra.run.smithi156.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.118175.log.gz 2023-09-30T22:30:15.467 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.123221.log.gz 2023-09-30T22:30:15.467 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135451.log 2023-09-30T22:30:15.467 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.192993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168369.log 2023-09-30T22:30:15.467 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.192993.log.gz 2023-09-30T22:30:15.467 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.135451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145314.log 2023-09-30T22:30:15.467 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.168369.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.135451.log.gz 2023-09-30T22:30:15.467 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139626.log 2023-09-30T22:30:15.468 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.168369.log.gz 2023-09-30T22:30:15.468 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.145314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175870.log 2023-09-30T22:30:15.468 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.139626.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145314.log.gz 2023-09-30T22:30:15.468 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192797.log 2023-09-30T22:30:15.468 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139626.log.gz 2023-09-30T22:30:15.468 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.175870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122570.log 2023-09-30T22:30:15.468 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose 88.5%-- /var/log/ceph/ceph-client.admin.194183.log 2023-09-30T22:30:15.468 INFO:teuthology.orchestra.run.smithi156.stderr: -- replaced with /var/log/ceph/ceph-client.admin.175870.log.gz 2023-09-30T22:30:15.469 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.192797.log: /var/log/ceph/ceph-client.admin.122570.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.192797.log.gz 2023-09-30T22:30:15.469 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177841.log 2023-09-30T22:30:15.469 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127099.log 2023-09-30T22:30:15.469 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.194183.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.122570.log.gz 2023-09-30T22:30:15.469 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.177841.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.194183.log.gz 2023-09-30T22:30:15.469 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144922.log 2023-09-30T22:30:15.469 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.177841.log.gz 2023-09-30T22:30:15.469 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159123.log 2023-09-30T22:30:15.470 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.127099.log: /var/log/ceph/ceph-client.admin.144922.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.127099.log.gz 2023-09-30T22:30:15.470 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.144922.log.gz 2023-09-30T22:30:15.470 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.159123.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.159123.log.gz 2023-09-30T22:30:15.470 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134622.log 2023-09-30T22:30:15.470 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155520.log 2023-09-30T22:30:15.470 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.134622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153624.log 2023-09-30T22:30:15.470 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.155520.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.134622.log.gz 2023-09-30T22:30:15.470 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143693.log 2023-09-30T22:30:15.470 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.155520.log.gz 2023-09-30T22:30:15.471 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.153624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140655.log 2023-09-30T22:30:15.471 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.153624.log.gz 2023-09-30T22:30:15.471 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129733.log 2023-09-30T22:30:15.471 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.143693.log: /var/log/ceph/ceph-client.admin.140655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144307.log 2023-09-30T22:30:15.471 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143693.log.gz 2023-09-30T22:30:15.471 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.129733.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.140655.log.gz 2023-09-30T22:30:15.471 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154807.log 2023-09-30T22:30:15.472 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.129733.log.gz 2023-09-30T22:30:15.472 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.144307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123417.log 2023-09-30T22:30:15.472 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122815.log 2023-09-30T22:30:15.472 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2%/var/log/ceph/ceph-client.admin.154807.log: -- replaced with /var/log/ceph/ceph-client.admin.144307.log.gz 2023-09-30T22:30:15.472 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.123417.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.154807.log.gz 2023-09-30T22:30:15.472 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180290.log 2023-09-30T22:30:15.472 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171317.log 2023-09-30T22:30:15.472 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.122815.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123417.log.gz 2023-09-30T22:30:15.473 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.180290.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122815.log.gz 2023-09-30T22:30:15.473 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157723.log 2023-09-30T22:30:15.473 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185461.log 2023-09-30T22:30:15.473 INFO:teuthology.orchestra.run.smithi156.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.180290.log.gz/var/log/ceph/ceph-client.admin.171317.log: 2023-09-30T22:30:15.473 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.157723.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.171317.log.gz 2023-09-30T22:30:15.473 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157723.log.gz 2023-09-30T22:30:15.473 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.185461.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.185461.log.gz 2023-09-30T22:30:15.473 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159515.log 2023-09-30T22:30:15.474 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146498.log 2023-09-30T22:30:15.474 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.159515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144359.log 2023-09-30T22:30:15.474 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.159515.log.gz 2023-09-30T22:30:15.474 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.146498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180486.log 2023-09-30T22:30:15.474 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.146498.log.gz 2023-09-30T22:30:15.474 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.144359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158799.log 2023-09-30T22:30:15.474 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.144359.log.gz 2023-09-30T22:30:15.474 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192183.log 2023-09-30T22:30:15.474 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.180486.log: /var/log/ceph/ceph-client.admin.158799.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.180486.log.gz 2023-09-30T22:30:15.475 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126953.log 2023-09-30T22:30:15.475 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177634.log 2023-09-30T22:30:15.475 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.192183.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.158799.log.gz 2023-09-30T22:30:15.475 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.126953.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.192183.log.gz 2023-09-30T22:30:15.475 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.126953.log.gz 2023-09-30T22:30:15.475 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.177634.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.177634.log.gz 2023-09-30T22:30:15.475 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157553.log 2023-09-30T22:30:15.475 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184727.log 2023-09-30T22:30:15.476 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.157553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185683.log 2023-09-30T22:30:15.476 INFO:teuthology.orchestra.run.smithi156.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.157553.log.gz 2023-09-30T22:30:15.476 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.184727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155667.log 2023-09-30T22:30:15.476 INFO:teuthology.orchestra.run.smithi156.stderr: 89.5%/var/log/ceph/ceph-client.admin.185683.log: -- replaced with /var/log/ceph/ceph-client.admin.184727.log.gz 2023-09-30T22:30:15.476 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189755.log 2023-09-30T22:30:15.581 INFO:teuthology.orchestra.run.smithi156.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.185683.log.gz 2023-09-30T22:30:15.581 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.155667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158460.log 2023-09-30T22:30:15.581 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.155667.log.gz 2023-09-30T22:30:15.581 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.189755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162084.log 2023-09-30T22:30:15.581 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191817.log 2023-09-30T22:30:15.581 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.158460.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.189755.log.gz 2023-09-30T22:30:15.581 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.162084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173840.log 2023-09-30T22:30:15.582 INFO:teuthology.orchestra.run.smithi156.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.158460.log.gz 2023-09-30T22:30:15.582 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.162084.log.gz 2023-09-30T22:30:15.582 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.191817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188875.log 2023-09-30T22:30:15.582 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176607.log 2023-09-30T22:30:15.582 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.173840.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.191817.log.gz 2023-09-30T22:30:15.582 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.188875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160152.log 2023-09-30T22:30:15.582 INFO:teuthology.orchestra.run.smithi156.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.173840.log.gz 2023-09-30T22:30:15.583 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.176607.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.188875.log.gz 2023-09-30T22:30:15.583 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150832.log 2023-09-30T22:30:15.583 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176607.log.gz 2023-09-30T22:30:15.583 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165694.log 2023-09-30T22:30:15.583 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.160152.log: /var/log/ceph/ceph-client.admin.150832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159583.log 2023-09-30T22:30:15.583 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160152.log.gz 2023-09-30T22:30:15.583 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.150832.log.gz 2023-09-30T22:30:15.583 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.165694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187495.log 2023-09-30T22:30:15.584 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164078.log 2023-09-30T22:30:15.584 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.165694.log.gz 2023-09-30T22:30:15.584 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.159583.log: /var/log/ceph/ceph-client.admin.187495.log: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.159583.log.gz-5 2023-09-30T22:30:15.584 INFO:teuthology.orchestra.run.smithi156.stderr:--verbose -- /var/log/ceph/ceph-client.admin.179424.log 2023-09-30T22:30:15.584 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.187495.log.gz 2023-09-30T22:30:15.584 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180778.log 2023-09-30T22:30:15.584 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.164078.log: /var/log/ceph/ceph-client.admin.179424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150273.log 2023-09-30T22:30:15.584 INFO:teuthology.orchestra.run.smithi156.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.164078.log.gz 2023-09-30T22:30:15.585 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.180778.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.179424.log.gz 2023-09-30T22:30:15.585 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171139.log 2023-09-30T22:30:15.585 INFO:teuthology.orchestra.run.smithi156.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.180778.log.gz 2023-09-30T22:30:15.585 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.150273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184676.log 2023-09-30T22:30:15.585 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 88.5%--verbose -- /var/log/ceph/ceph-osd.0.log -- replaced with /var/log/ceph/ceph-client.admin.150273.log.gz 2023-09-30T22:30:15.585 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-09-30T22:30:15.585 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.171139.log: /var/log/ceph/ceph-client.admin.184676.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.171139.log.gz 2023-09-30T22:30:15.585 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168199.log 2023-09-30T22:30:15.586 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163856.log 2023-09-30T22:30:15.586 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.184676.log.gz 2023-09-30T22:30:15.586 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.168199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139653.log 2023-09-30T22:30:15.586 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168199.log.gz 2023-09-30T22:30:15.586 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.163856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178810.log 2023-09-30T22:30:15.586 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157676.log 2023-09-30T22:30:15.586 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.139653.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.163856.log.gz 2023-09-30T22:30:15.586 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.178810.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139653.log.gz 2023-09-30T22:30:15.587 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.178810.log.gz 2023-09-30T22:30:15.587 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.157676.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157676.log.gz 2023-09-30T22:30:15.587 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182103.log 2023-09-30T22:30:15.587 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166212.log 2023-09-30T22:30:15.587 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.182103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145459.log 2023-09-30T22:30:15.587 INFO:teuthology.orchestra.run.smithi156.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.182103.log.gz 2023-09-30T22:30:15.587 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.166212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183130.log 2023-09-30T22:30:15.587 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193359.log 2023-09-30T22:30:15.588 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.166212.log.gz 2023-09-30T22:30:15.588 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.145459.log: /var/log/ceph/ceph-client.admin.183130.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.145459.log.gz 2023-09-30T22:30:15.588 INFO:teuthology.orchestra.run.smithi156.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.183130.log.gz 2023-09-30T22:30:15.588 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.193359.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.193359.log.gz 2023-09-30T22:30:15.588 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159832.log 2023-09-30T22:30:15.588 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184110.log 2023-09-30T22:30:15.588 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.159832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124642.log 2023-09-30T22:30:15.588 INFO:teuthology.orchestra.run.smithi156.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.159832.log.gz 2023-09-30T22:30:15.589 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.184110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160934.log 2023-09-30T22:30:15.589 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188082.log 2023-09-30T22:30:15.589 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.124642.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.184110.log.gz 2023-09-30T22:30:15.589 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.160934.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.124642.log.gz 2023-09-30T22:30:15.589 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.160934.log.gz 2023-09-30T22:30:15.589 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.188082.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.188082.log.gz 2023-09-30T22:30:15.589 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155959.log 2023-09-30T22:30:15.589 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137712.log 2023-09-30T22:30:15.590 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.155959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178763.log 2023-09-30T22:30:15.590 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.155959.log.gz 2023-09-30T22:30:15.590 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.137712.log: /var/log/ceph/ceph-client.admin.178763.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.137712.log.gz 2023-09-30T22:30:15.590 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.178763.log.gz 2023-09-30T22:30:15.590 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194673.log 2023-09-30T22:30:15.590 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194771.log 2023-09-30T22:30:15.590 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.194673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164274.log 2023-09-30T22:30:15.590 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.194771.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.194673.log.gz 2023-09-30T22:30:15.590 INFO:teuthology.orchestra.run.smithi156.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.194771.log.gz 2023-09-30T22:30:15.591 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.164274.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.164274.log.gz 2023-09-30T22:30:15.591 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185731.log 2023-09-30T22:30:15.591 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178371.log 2023-09-30T22:30:15.591 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.185731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173302.log 2023-09-30T22:30:15.591 INFO:teuthology.orchestra.run.smithi156.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.185731.log.gz/var/log/ceph/ceph-client.admin.178371.log: 2023-09-30T22:30:15.591 INFO:teuthology.orchestra.run.smithi156.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.178371.log.gz 2023-09-30T22:30:15.591 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.173302.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.173302.log.gz 2023-09-30T22:30:15.591 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182638.log 2023-09-30T22:30:15.592 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137223.log 2023-09-30T22:30:15.592 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.182638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179947.log 2023-09-30T22:30:15.592 INFO:teuthology.orchestra.run.smithi156.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.182638.log.gz 2023-09-30T22:30:15.592 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.137223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125791.log 2023-09-30T22:30:15.592 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.179947.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.137223.log.gz 2023-09-30T22:30:15.592 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.125791.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.179947.log.gz 2023-09-30T22:30:15.592 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.125791.log.gz 2023-09-30T22:30:15.592 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139039.log 2023-09-30T22:30:15.593 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184729.log 2023-09-30T22:30:15.593 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.139039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173447.log 2023-09-30T22:30:15.593 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.184729.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139039.log.gz 2023-09-30T22:30:15.593 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149191.log 2023-09-30T22:30:15.593 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.184729.log.gz 2023-09-30T22:30:15.593 INFO:teuthology.orchestra.run.smithi156.stderr:gzip /var/log/ceph/ceph-client.admin.173447.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.136530.log 2023-09-30T22:30:15.593 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174626.log 2023-09-30T22:30:15.593 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.149191.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.173447.log.gz 2023-09-30T22:30:15.594 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.136530.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.149191.log.gz 2023-09-30T22:30:15.594 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165599.log 2023-09-30T22:30:15.594 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.136530.log.gz 2023-09-30T22:30:15.594 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.174626.log: /var/log/ceph/ceph-client.admin.165599.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.174626.log.gz 2023-09-30T22:30:15.594 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.165599.log.gz 2023-09-30T22:30:15.594 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180535.log 2023-09-30T22:30:15.594 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194624.log 2023-09-30T22:30:15.594 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.180535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163221.log 2023-09-30T22:30:15.595 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.180535.log.gz 2023-09-30T22:30:15.595 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.194624.log: /var/log/ceph/ceph-client.admin.163221.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.194624.log.gz 2023-09-30T22:30:15.595 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.163221.log.gz 2023-09-30T22:30:15.595 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162698.log 2023-09-30T22:30:15.595 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149661.log 2023-09-30T22:30:15.595 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.162698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153307.log 2023-09-30T22:30:15.595 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.162698.log.gz 2023-09-30T22:30:15.595 INFO:teuthology.orchestra.run.smithi156.stderr:gzip /var/log/ceph/ceph-client.admin.149661.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.193581.log 2023-09-30T22:30:15.596 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.153307.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.149661.log.gz 2023-09-30T22:30:15.596 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.193581.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.153307.log.gz 2023-09-30T22:30:15.596 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.193581.log.gz 2023-09-30T22:30:15.596 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172637.log 2023-09-30T22:30:15.596 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187225.log 2023-09-30T22:30:15.596 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.172637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155005.log 2023-09-30T22:30:15.596 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.187225.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.172637.log.gz 2023-09-30T22:30:15.596 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190735.log 2023-09-30T22:30:15.597 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.187225.log.gz 2023-09-30T22:30:15.597 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.155005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177242.log 2023-09-30T22:30:15.597 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.155005.log.gz 2023-09-30T22:30:15.597 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.190735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156255.log 2023-09-30T22:30:15.597 INFO:teuthology.orchestra.run.smithi156.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.190735.log.gz 2023-09-30T22:30:15.597 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.177242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174989.log 2023-09-30T22:30:15.597 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151420.log 2023-09-30T22:30:15.597 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.177242.log.gz 2023-09-30T22:30:15.598 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.156255.log: /var/log/ceph/ceph-client.admin.174989.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.156255.log.gz 2023-09-30T22:30:15.598 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.174989.log.gz 2023-09-30T22:30:15.598 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.151420.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.151420.log.gz 2023-09-30T22:30:15.598 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180216.log 2023-09-30T22:30:15.598 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155716.log 2023-09-30T22:30:15.598 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.180216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179351.log 2023-09-30T22:30:15.598 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.155716.log: gzip -5 --verbose -- 89.5%/var/log/ceph/ceph-client.admin.147819.log 2023-09-30T22:30:15.598 INFO:teuthology.orchestra.run.smithi156.stderr: -- replaced with /var/log/ceph/ceph-client.admin.180216.log.gz 2023-09-30T22:30:15.599 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.179351.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.155716.log.gz 2023-09-30T22:30:15.599 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153207.log 2023-09-30T22:30:15.599 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.179351.log.gz 2023-09-30T22:30:15.599 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.147819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142812.log 2023-09-30T22:30:15.599 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153625.log 2023-09-30T22:30:15.599 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.153207.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.147819.log.gz 2023-09-30T22:30:15.599 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.142812.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.153207.log.gz 2023-09-30T22:30:15.599 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142515.log 2023-09-30T22:30:15.599 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142812.log.gz 2023-09-30T22:30:15.600 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.153625.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.153625.log.gz 2023-09-30T22:30:15.600 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.142515.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.142515.log.gz 2023-09-30T22:30:15.600 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160224.log 2023-09-30T22:30:15.600 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167755.log 2023-09-30T22:30:15.600 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.160224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175475.log 2023-09-30T22:30:15.600 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.167755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135674.log 2023-09-30T22:30:15.600 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.160224.log.gz 2023-09-30T22:30:15.600 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.175475.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.167755.log.gz 2023-09-30T22:30:15.601 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134961.log 2023-09-30T22:30:15.601 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175475.log.gz 2023-09-30T22:30:15.601 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.135674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162780.log 2023-09-30T22:30:15.601 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136727.log 2023-09-30T22:30:15.601 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135674.log.gz 2023-09-30T22:30:15.601 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.134961.log: /var/log/ceph/ceph-client.admin.162780.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.134961.log.gz 2023-09-30T22:30:15.601 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1%/var/log/ceph/ceph-client.admin.136727.log: -- replaced with /var/log/ceph/ceph-client.admin.162780.log.gz 2023-09-30T22:30:15.602 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.136727.log.gz 2023-09-30T22:30:15.602 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189781.log 2023-09-30T22:30:15.602 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159685.log 2023-09-30T22:30:15.602 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.189781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167337.log 2023-09-30T22:30:15.602 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.159685.log: gzip 88.7%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.189781.log.gz-- 2023-09-30T22:30:15.602 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.179620.log 2023-09-30T22:30:15.602 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.167337.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.159685.log.gz 2023-09-30T22:30:15.603 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160104.log 2023-09-30T22:30:15.603 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.167337.log.gz 2023-09-30T22:30:15.603 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.179620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164005.log 2023-09-30T22:30:15.603 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 87.9%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.179620.log.gz/var/log/ceph/ceph-client.admin.170943.log 2023-09-30T22:30:15.603 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-09-30T22:30:15.603 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.160104.log: /var/log/ceph/ceph-client.admin.164005.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160104.log.gz 2023-09-30T22:30:15.603 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.164005.log.gz 2023-09-30T22:30:15.603 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.170943.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.170943.log.gz 2023-09-30T22:30:15.604 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165322.log 2023-09-30T22:30:15.604 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176803.log 2023-09-30T22:30:15.604 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.165322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136478.log 2023-09-30T22:30:15.604 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.165322.log.gz 2023-09-30T22:30:15.604 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.176803.log: /var/log/ceph/ceph-client.admin.136478.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.176803.log.gz 2023-09-30T22:30:15.604 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137270.log 2023-09-30T22:30:15.604 INFO:teuthology.orchestra.run.smithi156.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.136478.log.gz 2023-09-30T22:30:15.605 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179824.log 2023-09-30T22:30:15.605 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.137270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135255.log 2023-09-30T22:30:15.605 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.137270.log.gz 2023-09-30T22:30:15.605 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.179824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152523.log 2023-09-30T22:30:15.605 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178175.log 2023-09-30T22:30:15.605 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.135255.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.179824.log.gz 2023-09-30T22:30:15.605 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.152523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150171.log 2023-09-30T22:30:15.605 INFO:teuthology.orchestra.run.smithi156.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.135255.log.gz 2023-09-30T22:30:15.606 INFO:teuthology.orchestra.run.smithi156.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.152523.log.gz 2023-09-30T22:30:15.606 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.178175.log: /var/log/ceph/ceph-client.admin.150171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180974.log 2023-09-30T22:30:15.606 INFO:teuthology.orchestra.run.smithi156.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.178175.log.gz 2023-09-30T22:30:15.606 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.150171.log.gz 2023-09-30T22:30:15.606 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166605.log 2023-09-30T22:30:15.606 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129436.log 2023-09-30T22:30:15.606 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.180974.log: /var/log/ceph/ceph-client.admin.166605.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.180974.log.gz 2023-09-30T22:30:15.606 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.129436.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.166605.log.gz 2023-09-30T22:30:15.607 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.129436.log.gz 2023-09-30T22:30:15.607 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188605.log 2023-09-30T22:30:15.607 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146912.log 2023-09-30T22:30:15.607 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.188605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166996.log 2023-09-30T22:30:15.607 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.188605.log.gz 2023-09-30T22:30:15.607 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.146912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192698.log 2023-09-30T22:30:15.607 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.146912.log.gz 2023-09-30T22:30:15.607 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.166996.log: /var/log/ceph/ceph-client.admin.192698.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.166996.log.gz 2023-09-30T22:30:15.608 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.192698.log.gz--verbose 2023-09-30T22:30:15.608 INFO:teuthology.orchestra.run.smithi156.stderr:-- /var/log/ceph/ceph-client.admin.155275.log 2023-09-30T22:30:15.608 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192353.log 2023-09-30T22:30:15.608 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.155275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124426.log 2023-09-30T22:30:15.608 INFO:teuthology.orchestra.run.smithi156.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.155275.log.gz 2023-09-30T22:30:15.608 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.192353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181784.log 2023-09-30T22:30:15.608 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173107.log 2023-09-30T22:30:15.608 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.124426.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.192353.log.gz 2023-09-30T22:30:15.609 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.181784.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.124426.log.gz-5 2023-09-30T22:30:15.609 INFO:teuthology.orchestra.run.smithi156.stderr:--verbose -- /var/log/ceph/ceph-client.admin.161596.log 2023-09-30T22:30:15.609 INFO:teuthology.orchestra.run.smithi156.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.181784.log.gz 2023-09-30T22:30:15.609 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.173107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128491.log 2023-09-30T22:30:15.609 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.161596.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.173107.log.gz 2023-09-30T22:30:15.609 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194330.log 2023-09-30T22:30:15.609 INFO:teuthology.orchestra.run.smithi156.stderr: 89.7%/var/log/ceph/ceph-client.admin.128491.log: -- replaced with /var/log/ceph/ceph-client.admin.161596.log.gz 2023-09-30T22:30:15.609 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123836.log 2023-09-30T22:30:15.610 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.194330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165377.log 2023-09-30T22:30:15.610 INFO:teuthology.orchestra.run.smithi156.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.128491.log.gz 2023-09-30T22:30:15.610 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.194330.log.gz 2023-09-30T22:30:15.610 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.123836.log: /var/log/ceph/ceph-client.admin.165377.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.123836.log.gz 2023-09-30T22:30:15.610 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.165377.log.gz 2023-09-30T22:30:15.610 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193349.log 2023-09-30T22:30:15.610 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147330.log 2023-09-30T22:30:15.610 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.193349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156451.log 2023-09-30T22:30:15.611 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.193349.log.gz 2023-09-30T22:30:15.611 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.147330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138279.log 2023-09-30T22:30:15.611 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191603.log 2023-09-30T22:30:15.611 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.147330.log.gz 2023-09-30T22:30:15.611 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.156451.log: /var/log/ceph/ceph-client.admin.138279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144773.log 2023-09-30T22:30:15.611 INFO:teuthology.orchestra.run.smithi156.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.156451.log.gz 2023-09-30T22:30:15.611 INFO:teuthology.orchestra.run.smithi156.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.138279.log.gz 2023-09-30T22:30:15.611 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.191603.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.191603.log.gz 2023-09-30T22:30:15.612 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.144773.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.144773.log.gz 2023-09-30T22:30:15.612 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165625.log 2023-09-30T22:30:15.612 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173303.log 2023-09-30T22:30:15.612 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.165625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192967.log 2023-09-30T22:30:15.612 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.173303.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.165625.log.gz 2023-09-30T22:30:15.612 INFO:teuthology.orchestra.run.smithi156.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.173303.log.gz 2023-09-30T22:30:15.612 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.192967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127672.log 2023-09-30T22:30:15.613 INFO:teuthology.orchestra.run.smithi156.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.192967.log.gz 2023-09-30T22:30:15.613 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175480.log 2023-09-30T22:30:15.613 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.127672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166749.log 2023-09-30T22:30:15.613 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.127672.log.gz 2023-09-30T22:30:15.613 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.175480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124838.log 2023-09-30T22:30:15.613 INFO:teuthology.orchestra.run.smithi156.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.175480.log.gz 2023-09-30T22:30:15.613 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.166749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158336.log 2023-09-30T22:30:15.613 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166749.log.gz 2023-09-30T22:30:15.614 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.124838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118610.log 2023-09-30T22:30:15.614 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.158336.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.124838.log.gz 2023-09-30T22:30:15.614 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136333.log 2023-09-30T22:30:15.614 INFO:teuthology.orchestra.run.smithi156.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.158336.log.gz 2023-09-30T22:30:15.614 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.118610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139431.log 2023-09-30T22:30:15.614 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.136333.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.118610.log.gz 2023-09-30T22:30:15.614 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180804.log 2023-09-30T22:30:15.614 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.139431.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.136333.log.gz 2023-09-30T22:30:15.615 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.139431.log.gz 2023-09-30T22:30:15.615 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.180804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124936.log 2023-09-30T22:30:15.615 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182764.log 2023-09-30T22:30:15.615 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.180804.log.gz 2023-09-30T22:30:15.615 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.124936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174448.log 2023-09-30T22:30:15.615 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.124936.log.gz 2023-09-30T22:30:15.615 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.182764.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.182764.log.gz 2023-09-30T22:30:15.615 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.174448.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.174448.log.gz 2023-09-30T22:30:15.617 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127047.log 2023-09-30T22:30:15.617 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178959.log 2023-09-30T22:30:15.618 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.127047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151812.log 2023-09-30T22:30:15.618 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.178959.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.127047.log.gz 2023-09-30T22:30:15.618 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176876.log 2023-09-30T22:30:15.618 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.178959.log.gz 2023-09-30T22:30:15.618 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.151812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143301.log 2023-09-30T22:30:15.618 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9%gzip -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.151812.log.gz-- 2023-09-30T22:30:15.618 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.124887.log 2023-09-30T22:30:15.619 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.176876.log: /var/log/ceph/ceph-client.admin.143301.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.176876.log.gz 2023-09-30T22:30:15.619 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146721.log 2023-09-30T22:30:15.619 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190539.log 2023-09-30T22:30:15.619 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.124887.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143301.log.gz 2023-09-30T22:30:15.619 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.146721.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.124887.log.gz 2023-09-30T22:30:15.619 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.146721.log.gz/var/log/ceph/ceph-client.admin.190539.log: 2023-09-30T22:30:15.619 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156377.log 2023-09-30T22:30:15.619 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.190539.log.gz 2023-09-30T22:30:15.620 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122260.log 2023-09-30T22:30:15.620 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.156377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193090.log 2023-09-30T22:30:15.620 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.122260.log: gzip 89.7%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.156377.log.gz-- 2023-09-30T22:30:15.620 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.182960.log 2023-09-30T22:30:15.620 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.193090.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.122260.log.gz 2023-09-30T22:30:15.620 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.193090.log.gz 2023-09-30T22:30:15.620 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.182960.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.182960.log.gz 2023-09-30T22:30:15.620 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148116.log 2023-09-30T22:30:15.621 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147696.log 2023-09-30T22:30:15.621 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.148116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185239.log 2023-09-30T22:30:15.621 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.147696.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.148116.log.gz 2023-09-30T22:30:15.621 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147623.log 2023-09-30T22:30:15.621 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.147696.log.gz 2023-09-30T22:30:15.621 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.185239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138250.log 2023-09-30T22:30:15.621 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183402.log 2023-09-30T22:30:15.621 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.147623.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.185239.log.gz 2023-09-30T22:30:15.622 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147623.log.gz 2023-09-30T22:30:15.622 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.138250.log: /var/log/ceph/ceph-client.admin.183402.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.138250.log.gz 2023-09-30T22:30:15.622 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.183402.log.gz 2023-09-30T22:30:15.622 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135135.log 2023-09-30T22:30:15.622 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140163.log 2023-09-30T22:30:15.622 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.135135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163490.log 2023-09-30T22:30:15.622 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.140163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138717.log 2023-09-30T22:30:15.622 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.135135.log.gz 2023-09-30T22:30:15.623 INFO:teuthology.orchestra.run.smithi156.stderr: 87.7%/var/log/ceph/ceph-client.admin.163490.log: -- replaced with /var/log/ceph/ceph-client.admin.140163.log.gz 2023-09-30T22:30:15.623 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155201.log 2023-09-30T22:30:15.623 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163490.log.gz 2023-09-30T22:30:15.623 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.138717.log: /var/log/ceph/ceph-client.admin.155201.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.138717.log.gz 2023-09-30T22:30:15.623 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.155201.log.gz 2023-09-30T22:30:15.623 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140947.log 2023-09-30T22:30:15.623 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186023.log 2023-09-30T22:30:15.623 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.140947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147846.log 2023-09-30T22:30:15.624 INFO:teuthology.orchestra.run.smithi156.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140947.log.gz 2023-09-30T22:30:15.624 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.186023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118875.log 2023-09-30T22:30:15.624 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177783.log 2023-09-30T22:30:15.624 INFO:teuthology.orchestra.run.smithi156.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.186023.log.gz 2023-09-30T22:30:15.624 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.147846.log: /var/log/ceph/ceph-client.admin.118875.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.147846.log.gz 2023-09-30T22:30:15.624 INFO:teuthology.orchestra.run.smithi156.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.118875.log.gz/var/log/ceph/ceph-client.admin.177783.log: 2023-09-30T22:30:15.624 INFO:teuthology.orchestra.run.smithi156.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.177783.log.gz 2023-09-30T22:30:15.624 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166357.log 2023-09-30T22:30:15.625 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158407.log 2023-09-30T22:30:15.625 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.166357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163642.log 2023-09-30T22:30:15.625 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.158407.log: 88.5%gzip -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.166357.log.gz-- 2023-09-30T22:30:15.625 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.136823.log 2023-09-30T22:30:15.625 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5%/var/log/ceph/ceph-client.admin.163642.log: -- replaced with /var/log/ceph/ceph-client.admin.158407.log.gz 2023-09-30T22:30:15.625 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.163642.log.gz 2023-09-30T22:30:15.625 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.136823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194428.log 2023-09-30T22:30:15.625 INFO:teuthology.orchestra.run.smithi156.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.136823.log.gz 2023-09-30T22:30:15.626 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147914.log 2023-09-30T22:30:15.626 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.194428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185905.log 2023-09-30T22:30:15.626 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.147914.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.194428.log.gz 2023-09-30T22:30:15.626 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128775.log 2023-09-30T22:30:15.626 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147914.log.gz 2023-09-30T22:30:15.626 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.185905.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.185905.log.gz 2023-09-30T22:30:15.626 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.128775.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128775.log.gz 2023-09-30T22:30:15.626 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136235.log 2023-09-30T22:30:15.627 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163809.log 2023-09-30T22:30:15.627 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.136235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164619.log 2023-09-30T22:30:15.627 INFO:teuthology.orchestra.run.smithi156.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.136235.log.gz 2023-09-30T22:30:15.627 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.163809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166064.log 2023-09-30T22:30:15.627 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153748.log 2023-09-30T22:30:15.627 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.163809.log.gz 2023-09-30T22:30:15.627 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.164619.log: /var/log/ceph/ceph-client.admin.166064.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164619.log.gz 2023-09-30T22:30:15.627 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164423.log 2023-09-30T22:30:15.628 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156573.log 2023-09-30T22:30:15.628 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.153748.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.166064.log.gz 2023-09-30T22:30:15.628 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.164423.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.153748.log.gz 2023-09-30T22:30:15.628 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.156573.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.164423.log.gz 2023-09-30T22:30:15.628 INFO:teuthology.orchestra.run.smithi156.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.156573.log.gz 2023-09-30T22:30:15.628 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128726.log 2023-09-30T22:30:15.628 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190808.log 2023-09-30T22:30:15.628 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.128726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155471.log 2023-09-30T22:30:15.629 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.190808.log: gzip 89.3%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.128726.log.gz-- 2023-09-30T22:30:15.629 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.156939.log 2023-09-30T22:30:15.629 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.155471.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.190808.log.gz 2023-09-30T22:30:15.629 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158337.log 2023-09-30T22:30:15.629 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.155471.log.gz 2023-09-30T22:30:15.629 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.156939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171931.log 2023-09-30T22:30:15.629 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187787.log 2023-09-30T22:30:15.629 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156939.log.gz 2023-09-30T22:30:15.630 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.158337.log: /var/log/ceph/ceph-client.admin.171931.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.158337.log.gz 2023-09-30T22:30:15.630 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.187787.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.171931.log.gz 2023-09-30T22:30:15.630 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.187787.log.gz 2023-09-30T22:30:15.630 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170747.log 2023-09-30T22:30:15.630 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123515.log 2023-09-30T22:30:15.630 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128628.log 2023-09-30T22:30:15.630 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.170747.log: /var/log/ceph/ceph-client.admin.123515.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.170747.log.gz 2023-09-30T22:30:15.630 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138325.log 2023-09-30T22:30:15.631 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.123515.log.gz 2023-09-30T22:30:15.631 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.128628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128922.log 2023-09-30T22:30:15.631 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.128628.log.gz 2023-09-30T22:30:15.631 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.138325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171316.log 2023-09-30T22:30:15.631 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142319.log 2023-09-30T22:30:15.631 INFO:teuthology.orchestra.run.smithi156.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.138325.log.gz 2023-09-30T22:30:15.631 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.128922.log: /var/log/ceph/ceph-client.admin.171316.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.128922.log.gz 2023-09-30T22:30:15.631 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.142319.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.171316.log.gz 2023-09-30T22:30:15.632 INFO:teuthology.orchestra.run.smithi156.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.142319.log.gz 2023-09-30T22:30:15.632 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187983.log 2023-09-30T22:30:15.632 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147108.log 2023-09-30T22:30:15.632 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.187983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143009.log 2023-09-30T22:30:15.632 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.187983.log.gz 2023-09-30T22:30:15.632 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.147108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156500.log 2023-09-30T22:30:15.632 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183083.log 2023-09-30T22:30:15.632 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147108.log.gz 2023-09-30T22:30:15.633 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.143009.log: /var/log/ceph/ceph-client.admin.156500.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.143009.log.gz 2023-09-30T22:30:15.633 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185265.log 2023-09-30T22:30:15.633 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161496.log 2023-09-30T22:30:15.633 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.183083.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.156500.log.gz 2023-09-30T22:30:15.633 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.185265.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.183083.log.gz 2023-09-30T22:30:15.633 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8%/var/log/ceph/ceph-client.admin.161496.log: -- replaced with /var/log/ceph/ceph-client.admin.185265.log.gz 2023-09-30T22:30:15.633 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161496.log.gz 2023-09-30T22:30:15.633 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159440.log 2023-09-30T22:30:15.634 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192502.log 2023-09-30T22:30:15.634 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.159440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151935.log 2023-09-30T22:30:15.634 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.192502.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159440.log.gz 2023-09-30T22:30:15.634 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.192502.log.gz 2023-09-30T22:30:15.634 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.151935.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.151935.log.gz 2023-09-30T22:30:15.634 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189193.log 2023-09-30T22:30:15.634 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137615.log 2023-09-30T22:30:15.634 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.189193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189951.log 2023-09-30T22:30:15.635 INFO:teuthology.orchestra.run.smithi156.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.189193.log.gz 2023-09-30T22:30:15.635 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.137615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139967.log 2023-09-30T22:30:15.635 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170159.log 2023-09-30T22:30:15.635 INFO:teuthology.orchestra.run.smithi156.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.137615.log.gz 2023-09-30T22:30:15.635 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.189951.log: /var/log/ceph/ceph-client.admin.139967.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.189951.log.gz 2023-09-30T22:30:15.635 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.170159.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.139967.log.gz 2023-09-30T22:30:15.635 INFO:teuthology.orchestra.run.smithi156.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.170159.log.gz 2023-09-30T22:30:15.635 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134766.log 2023-09-30T22:30:15.636 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161988.log 2023-09-30T22:30:15.636 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.134766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123121.log 2023-09-30T22:30:15.636 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.134766.log.gz 2023-09-30T22:30:15.636 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.161988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151055.log 2023-09-30T22:30:15.636 INFO:teuthology.orchestra.run.smithi156.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.161988.log.gz 2023-09-30T22:30:15.636 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.123121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164648.log 2023-09-30T22:30:15.636 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189658.log 2023-09-30T22:30:15.636 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.151055.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123121.log.gz 2023-09-30T22:30:15.637 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.164648.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.151055.log.gz 2023-09-30T22:30:15.637 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.189658.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.164648.log.gz 2023-09-30T22:30:15.637 INFO:teuthology.orchestra.run.smithi156.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.189658.log.gz 2023-09-30T22:30:15.637 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167436.log 2023-09-30T22:30:15.637 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125987.log 2023-09-30T22:30:15.637 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.167436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153429.log 2023-09-30T22:30:15.637 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.125987.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.167436.log.gz 2023-09-30T22:30:15.637 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161253.log 2023-09-30T22:30:15.638 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.153429.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.125987.log.gz 2023-09-30T22:30:15.638 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.161253.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.153429.log.gz 2023-09-30T22:30:15.638 INFO:teuthology.orchestra.run.smithi156.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.161253.log.gz 2023-09-30T22:30:15.638 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148603.log 2023-09-30T22:30:15.638 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124178.log 2023-09-30T22:30:15.638 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.148603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168173.log 2023-09-30T22:30:15.638 INFO:teuthology.orchestra.run.smithi156.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.148603.log.gz 2023-09-30T22:30:15.638 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.124178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192959.log 2023-09-30T22:30:15.639 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183030.log 2023-09-30T22:30:15.639 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.168173.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.124178.log.gz 2023-09-30T22:30:15.639 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.192959.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.168173.log.gz 2023-09-30T22:30:15.639 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.183030.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.192959.log.gz 2023-09-30T22:30:15.639 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.183030.log.gz 2023-09-30T22:30:15.639 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191621.log 2023-09-30T22:30:15.639 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186859.log 2023-09-30T22:30:15.639 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.191621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189024.log 2023-09-30T22:30:15.640 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.186859.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.191621.log.gz 2023-09-30T22:30:15.640 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169297.log 2023-09-30T22:30:15.640 INFO:teuthology.orchestra.run.smithi156.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.186859.log.gz 2023-09-30T22:30:15.640 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.189024.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.189024.log.gz 2023-09-30T22:30:15.640 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.169297.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.169297.log.gz 2023-09-30T22:30:15.640 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155912.log 2023-09-30T22:30:15.640 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188434.log 2023-09-30T22:30:15.640 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.155912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184164.log 2023-09-30T22:30:15.641 INFO:teuthology.orchestra.run.smithi156.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.155912.log.gz 2023-09-30T22:30:15.641 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.188434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137884.log 2023-09-30T22:30:15.641 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157431.log 2023-09-30T22:30:15.641 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.188434.log.gz 2023-09-30T22:30:15.641 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.184164.log: /var/log/ceph/ceph-client.admin.137884.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.184164.log.gz 2023-09-30T22:30:15.641 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.157431.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.137884.log.gz 2023-09-30T22:30:15.641 INFO:teuthology.orchestra.run.smithi156.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.157431.log.gz 2023-09-30T22:30:15.641 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172441.log 2023-09-30T22:30:15.642 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155567.log 2023-09-30T22:30:15.642 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.172441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135504.log 2023-09-30T22:30:15.642 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.155567.log: 88.1%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.172441.log.gz--verbose 2023-09-30T22:30:15.642 INFO:teuthology.orchestra.run.smithi156.stderr:-- /var/log/ceph/ceph-client.admin.153944.log 2023-09-30T22:30:15.642 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.135504.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.155567.log.gz 2023-09-30T22:30:15.642 INFO:teuthology.orchestra.run.smithi156.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.135504.log.gz 2023-09-30T22:30:15.642 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.153944.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.153944.log.gz 2023-09-30T22:30:15.643 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122668.log 2023-09-30T22:30:15.643 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176016.log 2023-09-30T22:30:15.643 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.122668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166945.log 2023-09-30T22:30:15.643 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.176016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170107.log 2023-09-30T22:30:15.643 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.122668.log.gz 2023-09-30T22:30:15.643 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.176016.log.gz 2023-09-30T22:30:15.643 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.166945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190343.log 2023-09-30T22:30:15.643 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.166945.log.gz 2023-09-30T22:30:15.643 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.170107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123564.log 2023-09-30T22:30:15.644 INFO:teuthology.orchestra.run.smithi156.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.170107.log.gz 2023-09-30T22:30:15.644 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.190343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188971.log 2023-09-30T22:30:15.644 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.190343.log.gz 2023-09-30T22:30:15.644 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.123564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147722.log 2023-09-30T22:30:15.644 INFO:teuthology.orchestra.run.smithi156.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.123564.log.gz 2023-09-30T22:30:15.644 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.188971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190173.log 2023-09-30T22:30:15.644 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177391.log 2023-09-30T22:30:15.644 INFO:teuthology.orchestra.run.smithi156.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.188971.log.gz 2023-09-30T22:30:15.645 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.147722.log: /var/log/ceph/ceph-client.admin.190173.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.147722.log.gz 2023-09-30T22:30:15.645 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2%/var/log/ceph/ceph-client.admin.177391.log: -- replaced with /var/log/ceph/ceph-client.admin.190173.log.gz 2023-09-30T22:30:15.645 INFO:teuthology.orchestra.run.smithi156.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.177391.log.gz 2023-09-30T22:30:15.645 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181711.log 2023-09-30T22:30:15.645 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146525.log 2023-09-30T22:30:15.645 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.181711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143967.log 2023-09-30T22:30:15.645 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.146525.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.181711.log.gz 2023-09-30T22:30:15.645 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152374.log 2023-09-30T22:30:15.646 INFO:teuthology.orchestra.run.smithi156.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.146525.log.gz 2023-09-30T22:30:15.646 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.143967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153895.log 2023-09-30T22:30:15.646 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.143967.log.gz 2023-09-30T22:30:15.646 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.152374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147135.log 2023-09-30T22:30:15.646 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1%/var/log/ceph/ceph-client.admin.153895.log: -- replaced with /var/log/ceph/ceph-client.admin.152374.log.gz 2023-09-30T22:30:15.646 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178126.log 2023-09-30T22:30:15.646 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.153895.log.gz 2023-09-30T22:30:15.646 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.147135.log: /var/log/ceph/ceph-client.admin.178126.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.147135.log.gz 2023-09-30T22:30:15.647 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.178126.log.gz 2023-09-30T22:30:15.647 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163760.log 2023-09-30T22:30:15.647 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141339.log 2023-09-30T22:30:15.647 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.163760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151590.log 2023-09-30T22:30:15.647 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.141339.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-09-30T22:30:15.647 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.163760.log.gz 2023-09-30T22:30:15.647 INFO:teuthology.orchestra.run.smithi156.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.141339.log.gz 2023-09-30T22:30:15.647 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.151590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149879.log 2023-09-30T22:30:15.648 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151590.log.gz 2023-09-30T22:30:15.648 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156304.log 2023-09-30T22:30:15.648 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.149879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181562.log 2023-09-30T22:30:15.648 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.156304.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.149879.log.gz 2023-09-30T22:30:15.648 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.181562.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.156304.log.gz 2023-09-30T22:30:15.648 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.181562.log.gz 2023-09-30T22:30:15.648 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139771.log 2023-09-30T22:30:15.648 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194232.log 2023-09-30T22:30:15.649 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.139771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142783.log 2023-09-30T22:30:15.649 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.139771.log.gz 2023-09-30T22:30:15.649 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.194232.log: /var/log/ceph/ceph-client.admin.142783.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.194232.log.gz 2023-09-30T22:30:15.649 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142783.log.gz 2023-09-30T22:30:15.649 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194575.log 2023-09-30T22:30:15.649 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184259.log 2023-09-30T22:30:15.649 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.194575.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.194575.log.gz 2023-09-30T22:30:15.649 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.184259.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.184259.log.gz 2023-09-30T22:30:15.650 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179743.log 2023-09-30T22:30:15.650 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154344.log 2023-09-30T22:30:15.650 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.179743.log: /var/log/ceph/ceph-client.admin.154344.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.179743.log.gz 2023-09-30T22:30:15.650 INFO:teuthology.orchestra.run.smithi156.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.154344.log.gz 2023-09-30T22:30:15.650 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180682.log 2023-09-30T22:30:15.650 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148825.log 2023-09-30T22:30:15.650 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.180682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185131.log 2023-09-30T22:30:15.650 INFO:teuthology.orchestra.run.smithi156.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.180682.log.gz 2023-09-30T22:30:15.651 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.148825.log: /var/log/ceph/ceph-client.admin.185131.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.148825.log.gz 2023-09-30T22:30:15.651 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.185131.log.gz 2023-09-30T22:30:15.651 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129020.log 2023-09-30T22:30:15.651 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150440.log 2023-09-30T22:30:15.651 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.129020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164985.log 2023-09-30T22:30:15.651 INFO:teuthology.orchestra.run.smithi156.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.129020.log.gz 2023-09-30T22:30:15.651 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.150440.log: /var/log/ceph/ceph-client.admin.164985.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.150440.log.gz 2023-09-30T22:30:15.651 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164985.log.gz 2023-09-30T22:30:15.652 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179594.log 2023-09-30T22:30:15.652 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174082.log 2023-09-30T22:30:15.652 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.179594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179498.log 2023-09-30T22:30:15.652 INFO:teuthology.orchestra.run.smithi156.stderr: 89.5%/var/log/ceph/ceph-client.admin.174082.log: -- replaced with /var/log/ceph/ceph-client.admin.179594.log.gz 2023-09-30T22:30:15.652 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.179498.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174082.log.gz 2023-09-30T22:30:15.652 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179498.log.gz 2023-09-30T22:30:15.652 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148654.log 2023-09-30T22:30:15.652 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183671.log 2023-09-30T22:30:15.652 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.148654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160861.log 2023-09-30T22:30:15.653 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.148654.log.gz 2023-09-30T22:30:15.653 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.183671.log: /var/log/ceph/ceph-client.admin.160861.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.183671.log.gz 2023-09-30T22:30:15.653 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.160861.log.gz 2023-09-30T22:30:15.653 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122329.log 2023-09-30T22:30:15.653 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125938.log 2023-09-30T22:30:15.653 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.122329.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.122329.log.gz 2023-09-30T22:30:15.653 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.125938.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125938.log.gz 2023-09-30T22:30:15.653 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154736.log 2023-09-30T22:30:15.654 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157284.log 2023-09-30T22:30:15.654 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.154736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180878.log 2023-09-30T22:30:15.654 INFO:teuthology.orchestra.run.smithi156.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.154736.log.gz 2023-09-30T22:30:15.654 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.157284.log: /var/log/ceph/ceph-client.admin.180878.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.157284.log.gz 2023-09-30T22:30:15.654 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180878.log.gz 2023-09-30T22:30:15.654 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169961.log 2023-09-30T22:30:15.654 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173643.log 2023-09-30T22:30:15.654 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.169961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162380.log 2023-09-30T22:30:15.655 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.169961.log.gz 2023-09-30T22:30:15.655 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.173643.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.173643.log.gz 2023-09-30T22:30:15.655 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.162380.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.162380.log.gz 2023-09-30T22:30:15.655 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186494.log 2023-09-30T22:30:15.655 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137811.log 2023-09-30T22:30:15.655 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.186494.log: /var/log/ceph/ceph-client.admin.137811.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.186494.log.gz 2023-09-30T22:30:15.655 INFO:teuthology.orchestra.run.smithi156.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.137811.log.gz 2023-09-30T22:30:15.655 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.111898.log 2023-09-30T22:30:15.656 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163266.log 2023-09-30T22:30:15.656 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph.tmp-client.admin.111898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189977.log 2023-09-30T22:30:15.656 INFO:teuthology.orchestra.run.smithi156.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.111898.log.gz 2023-09-30T22:30:15.656 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.163266.log: -- /var/log/ceph/ceph-client.admin.142196.log 2023-09-30T22:30:15.656 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.189977.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.163266.log.gz 2023-09-30T22:30:15.656 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.189977.log.gz 2023-09-30T22:30:15.656 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.142196.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142196.log.gz 2023-09-30T22:30:15.656 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165796.log 2023-09-30T22:30:15.656 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151028.log 2023-09-30T22:30:15.657 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.165796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161645.log 2023-09-30T22:30:15.657 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.151028.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.165796.log.gz 2023-09-30T22:30:15.657 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.161645.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.151028.log.gz 2023-09-30T22:30:15.657 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161645.log.gz 2023-09-30T22:30:15.657 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154220.log 2023-09-30T22:30:15.657 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167977.log 2023-09-30T22:30:15.657 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.154220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178322.log 2023-09-30T22:30:15.657 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.167977.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.154220.log.gz 2023-09-30T22:30:15.658 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155763.log 2023-09-30T22:30:15.658 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.178322.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167977.log.gz 2023-09-30T22:30:15.658 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.178322.log.gz 2023-09-30T22:30:15.658 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.155763.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.155763.log.gz 2023-09-30T22:30:15.658 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191718.log 2023-09-30T22:30:15.658 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145117.log 2023-09-30T22:30:15.658 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.191718.log: /var/log/ceph/ceph-client.admin.145117.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.191718.log.gz 2023-09-30T22:30:15.658 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.145117.log.gz 2023-09-30T22:30:15.659 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173813.log 2023-09-30T22:30:15.659 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145065.log 2023-09-30T22:30:15.659 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159636.log 2023-09-30T22:30:15.659 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.173813.log: /var/log/ceph/ceph-client.admin.145065.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.173813.log.gz 2023-09-30T22:30:15.659 INFO:teuthology.orchestra.run.smithi156.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.145065.log.gz 2023-09-30T22:30:15.659 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.159636.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.159636.log.gz 2023-09-30T22:30:15.659 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152428.log 2023-09-30T22:30:15.659 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147528.log 2023-09-30T22:30:15.660 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.152428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124374.log 2023-09-30T22:30:15.660 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.147528.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.152428.log.gz 2023-09-30T22:30:15.660 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.124374.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.147528.log.gz 2023-09-30T22:30:15.660 INFO:teuthology.orchestra.run.smithi156.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.124374.log.gz 2023-09-30T22:30:15.660 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143617.log 2023-09-30T22:30:15.660 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170081.log 2023-09-30T22:30:15.660 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.143617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141170.log 2023-09-30T22:30:15.660 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2%/var/log/ceph/ceph-client.admin.170081.log: -- replaced with /var/log/ceph/ceph-client.admin.143617.log.gz 2023-09-30T22:30:15.661 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.141170.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.170081.log.gz 2023-09-30T22:30:15.661 INFO:teuthology.orchestra.run.smithi156.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.141170.log.gz 2023-09-30T22:30:15.661 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161841.log 2023-09-30T22:30:15.661 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181392.log 2023-09-30T22:30:15.661 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.161841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177538.log 2023-09-30T22:30:15.661 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.181392.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161841.log.gz 2023-09-30T22:30:15.661 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.177538.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.181392.log.gz 2023-09-30T22:30:15.661 INFO:teuthology.orchestra.run.smithi156.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.177538.log.gz 2023-09-30T22:30:15.662 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189854.log 2023-09-30T22:30:15.662 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186467.log 2023-09-30T22:30:15.662 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.189854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169689.log 2023-09-30T22:30:15.662 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.186467.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.189854.log.gz 2023-09-30T22:30:15.662 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.186467.log.gz 2023-09-30T22:30:15.662 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.169689.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.169689.log.gz 2023-09-30T22:30:15.662 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151843.log 2023-09-30T22:30:15.662 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148799.log 2023-09-30T22:30:15.663 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.151843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171758.log 2023-09-30T22:30:15.663 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.151843.log.gz 2023-09-30T22:30:15.663 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.148799.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.148799.log.gz 2023-09-30T22:30:15.663 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.171758.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.171758.log.gz 2023-09-30T22:30:15.663 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127373.log 2023-09-30T22:30:15.663 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167729.log 2023-09-30T22:30:15.663 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.127373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144726.log 2023-09-30T22:30:15.663 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.167729.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.127373.log.gz 2023-09-30T22:30:15.664 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.144726.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.167729.log.gz 2023-09-30T22:30:15.664 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.144726.log.gz 2023-09-30T22:30:15.664 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193561.log 2023-09-30T22:30:15.664 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190958.log 2023-09-30T22:30:15.664 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.193561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141927.log 2023-09-30T22:30:15.664 INFO:teuthology.orchestra.run.smithi156.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.193561.log.gz/var/log/ceph/ceph-client.admin.190958.log: 2023-09-30T22:30:15.664 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.141927.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.190958.log.gz 2023-09-30T22:30:15.664 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141927.log.gz 2023-09-30T22:30:15.664 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152204.log 2023-09-30T22:30:15.665 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140459.log 2023-09-30T22:30:15.665 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.152204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172912.log 2023-09-30T22:30:15.665 INFO:teuthology.orchestra.run.smithi156.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.152204.log.gz 2023-09-30T22:30:15.665 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.140459.log: /var/log/ceph/ceph-client.admin.172912.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140459.log.gz 2023-09-30T22:30:15.665 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.172912.log.gz 2023-09-30T22:30:15.665 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161057.log 2023-09-30T22:30:15.665 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160420.log 2023-09-30T22:30:15.665 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.161057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128873.log 2023-09-30T22:30:15.666 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.161057.log.gz 2023-09-30T22:30:15.666 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.160420.log: /var/log/ceph/ceph-client.admin.128873.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.160420.log.gz 2023-09-30T22:30:15.666 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.128873.log.gz 2023-09-30T22:30:15.666 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138082.log 2023-09-30T22:30:15.666 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156351.log 2023-09-30T22:30:15.666 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.138082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174502.log 2023-09-30T22:30:15.666 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.138082.log.gz 2023-09-30T22:30:15.666 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.156351.log: /var/log/ceph/ceph-client.admin.174502.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156351.log.gz 2023-09-30T22:30:15.667 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.174502.log.gz 2023-09-30T22:30:15.667 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186100.log 2023-09-30T22:30:15.667 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136282.log 2023-09-30T22:30:15.667 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.186100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141216.log 2023-09-30T22:30:15.667 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3%/var/log/ceph/ceph-client.admin.136282.log: -- replaced with /var/log/ceph/ceph-client.admin.186100.log.gz 2023-09-30T22:30:15.667 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.141216.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.136282.log.gz 2023-09-30T22:30:15.667 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.141216.log.gz 2023-09-30T22:30:15.667 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188631.log 2023-09-30T22:30:15.668 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146447.log 2023-09-30T22:30:15.668 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.188631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149269.log 2023-09-30T22:30:15.668 INFO:teuthology.orchestra.run.smithi156.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.188631.log.gz 2023-09-30T22:30:15.668 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.146447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142982.log 2023-09-30T22:30:15.668 INFO:teuthology.orchestra.run.smithi156.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.146447.log.gz 2023-09-30T22:30:15.668 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184924.log 2023-09-30T22:30:15.668 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.149269.log: /var/log/ceph/ceph-client.admin.142982.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.149269.log.gz 2023-09-30T22:30:15.668 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.184924.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.142982.log.gz 2023-09-30T22:30:15.669 INFO:teuthology.orchestra.run.smithi156.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.184924.log.gz 2023-09-30T22:30:15.669 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128070.log 2023-09-30T22:30:15.669 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158731.log 2023-09-30T22:30:15.669 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.128070.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.128070.log.gz 2023-09-30T22:30:15.669 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.158731.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158731.log.gz 2023-09-30T22:30:15.669 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149975.log 2023-09-30T22:30:15.669 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177072.log 2023-09-30T22:30:15.669 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.149975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176212.log 2023-09-30T22:30:15.669 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.177072.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.149975.log.gz 2023-09-30T22:30:15.670 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.176212.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.177072.log.gz 2023-09-30T22:30:15.670 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.176212.log.gz 2023-09-30T22:30:15.670 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184925.log 2023-09-30T22:30:15.670 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169962.log 2023-09-30T22:30:15.670 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.184925.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.184925.log.gz 2023-09-30T22:30:15.670 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.169962.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.169962.log.gz 2023-09-30T22:30:15.670 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158533.log 2023-09-30T22:30:15.670 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185853.log 2023-09-30T22:30:15.671 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.158533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139458.log 2023-09-30T22:30:15.671 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.158533.log.gz 2023-09-30T22:30:15.671 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.185853.log: 90.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-09-30T22:30:15.671 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.185853.log.gz 2023-09-30T22:30:15.671 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.139458.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139458.log.gz 2023-09-30T22:30:15.671 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185292.log 2023-09-30T22:30:15.671 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118762.log 2023-09-30T22:30:15.671 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.185292.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.185292.log.gz 2023-09-30T22:30:15.672 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.118762.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118762.log.gz 2023-09-30T22:30:15.672 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136086.log 2023-09-30T22:30:15.672 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191522.log 2023-09-30T22:30:15.672 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.136086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189070.log 2023-09-30T22:30:15.672 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.191522.log: gzip 88.3%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.136086.log.gz-- 2023-09-30T22:30:15.672 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.134669.log 2023-09-30T22:30:15.672 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.189070.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.191522.log.gz 2023-09-30T22:30:15.672 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128824.log 2023-09-30T22:30:15.673 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.189070.log.gz 2023-09-30T22:30:15.673 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.134669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147267.log 2023-09-30T22:30:15.673 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157872.log 2023-09-30T22:30:15.673 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.128824.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.134669.log.gz 2023-09-30T22:30:15.673 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.147267.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.128824.log.gz 2023-09-30T22:30:15.673 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163172.log 2023-09-30T22:30:15.673 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.147267.log.gz 2023-09-30T22:30:15.673 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.157872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157627.log 2023-09-30T22:30:15.674 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.163172.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.157872.log.gz 2023-09-30T22:30:15.674 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174401.log 2023-09-30T22:30:15.674 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.163172.log.gz 2023-09-30T22:30:15.674 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.157627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157331.log 2023-09-30T22:30:15.674 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149832.log 2023-09-30T22:30:15.674 INFO:teuthology.orchestra.run.smithi156.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.157627.log.gz 2023-09-30T22:30:15.674 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.174401.log: /var/log/ceph/ceph-client.admin.157331.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.174401.log.gz 2023-09-30T22:30:15.674 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124033.log 2023-09-30T22:30:15.675 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169101.log 2023-09-30T22:30:15.675 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.149832.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.157331.log.gz 2023-09-30T22:30:15.675 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.124033.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.149832.log.gz 2023-09-30T22:30:15.675 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.169101.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.124033.log.gz 2023-09-30T22:30:15.675 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184359.log 2023-09-30T22:30:15.675 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.169101.log.gz 2023-09-30T22:30:15.675 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179798.log 2023-09-30T22:30:15.675 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.184359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181464.log 2023-09-30T22:30:15.676 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.179798.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.184359.log.gz 2023-09-30T22:30:15.676 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167167.log 2023-09-30T22:30:15.676 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.179798.log.gz 2023-09-30T22:30:15.676 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.181464.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.181464.log.gz 2023-09-30T22:30:15.676 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.167167.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.167167.log.gz 2023-09-30T22:30:15.676 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179994.log 2023-09-30T22:30:15.676 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144477.log 2023-09-30T22:30:15.676 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.179994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146839.log 2023-09-30T22:30:15.677 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.144477.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179994.log.gz 2023-09-30T22:30:15.677 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141535.log 2023-09-30T22:30:15.677 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.144477.log.gz 2023-09-30T22:30:15.677 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.146839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193779.log 2023-09-30T22:30:15.677 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152915.log 2023-09-30T22:30:15.677 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.141535.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.146839.log.gz 2023-09-30T22:30:15.677 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.193779.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141535.log.gz 2023-09-30T22:30:15.677 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135136.log 2023-09-30T22:30:15.678 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190761.log 2023-09-30T22:30:15.678 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.193779.log.gz 2023-09-30T22:30:15.678 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.152915.log: /var/log/ceph/ceph-client.admin.135136.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.152915.log.gz 2023-09-30T22:30:15.678 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.190761.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.135136.log.gz 2023-09-30T22:30:15.678 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.190761.log.gz 2023-09-30T22:30:15.678 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184063.log 2023-09-30T22:30:15.678 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142786.log 2023-09-30T22:30:15.679 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.184063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150563.log 2023-09-30T22:30:15.679 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.142786.log: 88.4%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.184063.log.gz--verbose 2023-09-30T22:30:15.679 INFO:teuthology.orchestra.run.smithi156.stderr:-- /var/log/ceph/ceph-client.admin.148407.log 2023-09-30T22:30:15.679 INFO:teuthology.orchestra.run.smithi156.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.142786.log.gz 2023-09-30T22:30:15.679 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.150563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162184.log 2023-09-30T22:30:15.679 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150563.log.gz 2023-09-30T22:30:15.679 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.148407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166435.log 2023-09-30T22:30:15.679 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188775.log 2023-09-30T22:30:15.679 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.162184.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148407.log.gz 2023-09-30T22:30:15.680 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.166435.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.162184.log.gz 2023-09-30T22:30:15.680 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.166435.log.gz 2023-09-30T22:30:15.680 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.188775.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.188775.log.gz 2023-09-30T22:30:15.680 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178033.log 2023-09-30T22:30:15.680 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182246.log 2023-09-30T22:30:15.680 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.178033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169764.log 2023-09-30T22:30:15.680 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.182246.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.178033.log.gz 2023-09-30T22:30:15.680 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.182246.log.gz 2023-09-30T22:30:15.681 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.169764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168956.log 2023-09-30T22:30:15.681 INFO:teuthology.orchestra.run.smithi156.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.169764.log.gz 2023-09-30T22:30:15.681 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146499.log 2023-09-30T22:30:15.681 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169349.log 2023-09-30T22:30:15.681 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.168956.log: /var/log/ceph/ceph-client.admin.146499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169154.log 2023-09-30T22:30:15.681 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.168956.log.gz 2023-09-30T22:30:15.681 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.146499.log.gz 2023-09-30T22:30:15.681 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.169349.log: /var/log/ceph/ceph-client.admin.169154.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.169349.log.gz 2023-09-30T22:30:15.682 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.169154.log.gz 2023-09-30T22:30:15.682 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160908.log 2023-09-30T22:30:15.682 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186611.log 2023-09-30T22:30:15.682 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.160908.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-09-30T22:30:15.682 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.160908.log.gz 2023-09-30T22:30:15.682 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.186611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154416.log 2023-09-30T22:30:15.682 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128169.log 2023-09-30T22:30:15.682 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-mon.b.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.186611.log.gz 2023-09-30T22:30:15.683 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.154416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167219.log 2023-09-30T22:30:15.683 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.154416.log.gz 2023-09-30T22:30:15.683 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.128169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142613.log 2023-09-30T22:30:15.683 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.128169.log.gz 2023-09-30T22:30:15.683 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.167219.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.167219.log.gz 2023-09-30T22:30:15.683 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.142613.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.142613.log.gz 2023-09-30T22:30:15.683 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179898.log 2023-09-30T22:30:15.683 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125034.log 2023-09-30T22:30:15.684 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.179898.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179898.log.gz 2023-09-30T22:30:15.684 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193678.log 2023-09-30T22:30:15.684 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.125034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168905.log 2023-09-30T22:30:15.684 INFO:teuthology.orchestra.run.smithi156.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.125034.log.gz 2023-09-30T22:30:15.684 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.193678.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.193678.log.gz 2023-09-30T22:30:15.684 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.168905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158656.log 2023-09-30T22:30:15.684 INFO:teuthology.orchestra.run.smithi156.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.168905.log.gz 2023-09-30T22:30:15.684 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150467.log 2023-09-30T22:30:15.685 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167141.log 2023-09-30T22:30:15.685 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.158656.log: /var/log/ceph/ceph-client.admin.150467.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158656.log.gz 2023-09-30T22:30:15.685 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.150467.log.gz 2023-09-30T22:30:15.685 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.167141.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.167141.log.gz 2023-09-30T22:30:15.685 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-09-30T22:30:15.685 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-09-30T22:30:15.685 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159881.log 2023-09-30T22:30:15.685 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.159881.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.159881.log.gz 2023-09-30T22:30:15.686 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166408.log 2023-09-30T22:30:15.686 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.166408.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.166408.log.gz 2023-09-30T22:30:15.686 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149805.log 2023-09-30T22:30:15.686 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.149805.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.149805.log.gz 2023-09-30T22:30:15.686 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185435.log 2023-09-30T22:30:15.686 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.185435.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.185435.log.gz 2023-09-30T22:30:15.686 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175280.log 2023-09-30T22:30:15.686 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.175280.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.175280.log.gz 2023-09-30T22:30:15.687 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178052.log 2023-09-30T22:30:15.687 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.178052.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.178052.log.gz 2023-09-30T22:30:15.687 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158603.log 2023-09-30T22:30:15.687 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.158603.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.158603.log.gz 2023-09-30T22:30:15.687 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158995.log 2023-09-30T22:30:15.687 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.158995.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158995.log.gz 2023-09-30T22:30:15.687 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180339.log 2023-09-30T22:30:15.687 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.180339.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.180339.log.gz 2023-09-30T22:30:15.688 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185535.log 2023-09-30T22:30:15.688 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.185535.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.185535.log.gz 2023-09-30T22:30:15.688 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181196.log 2023-09-30T22:30:15.688 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.181196.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.181196.log.gz 2023-09-30T22:30:15.688 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129623.log 2023-09-30T22:30:15.688 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.129623.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.129623.log.gz 2023-09-30T22:30:15.688 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174892.log 2023-09-30T22:30:15.688 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.174892.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.174892.log.gz 2023-09-30T22:30:15.689 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127555.log 2023-09-30T22:30:15.689 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.127555.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.127555.log.gz 2023-09-30T22:30:15.689 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155593.log 2023-09-30T22:30:15.689 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.155593.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.155593.log.gz 2023-09-30T22:30:15.689 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174670.log 2023-09-30T22:30:15.689 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.174670.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.174670.log.gz 2023-09-30T22:30:15.689 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155175.log 2023-09-30T22:30:15.689 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.155175.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.155175.log.gz 2023-09-30T22:30:15.690 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179302.log 2023-09-30T22:30:15.690 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.179302.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.179302.log.gz 2023-09-30T22:30:15.690 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145936.log 2023-09-30T22:30:15.690 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177268.log 2023-09-30T22:30:15.690 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.145936.log: /var/log/ceph/ceph-client.admin.177268.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.145936.log.gz 2023-09-30T22:30:15.690 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.177268.log.gz 2023-09-30T22:30:15.690 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159957.log 2023-09-30T22:30:15.691 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.159957.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159957.log.gz 2023-09-30T22:30:15.691 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159779.log 2023-09-30T22:30:15.691 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.159779.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.159779.log.gz 2023-09-30T22:30:15.691 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164397.log 2023-09-30T22:30:15.691 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.164397.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.164397.log.gz 2023-09-30T22:30:15.691 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139261.log 2023-09-30T22:30:15.691 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.139261.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.139261.log.gz 2023-09-30T22:30:15.691 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148263.log 2023-09-30T22:30:15.692 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.148263.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148263.log.gz 2023-09-30T22:30:15.692 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149243.log 2023-09-30T22:30:15.692 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.149243.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.149243.log.gz 2023-09-30T22:30:15.692 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127227.log 2023-09-30T22:30:15.692 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.127227.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.127227.log.gz 2023-09-30T22:30:15.692 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160028.log 2023-09-30T22:30:15.692 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122452.log 2023-09-30T22:30:15.692 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.160028.log: /var/log/ceph/ceph-client.admin.122452.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.160028.log.gz 2023-09-30T22:30:15.692 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.122452.log.gz 2023-09-30T22:30:15.693 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141459.log 2023-09-30T22:30:15.693 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.141459.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141459.log.gz 2023-09-30T22:30:15.693 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173225.log 2023-09-30T22:30:15.693 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.173225.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.173225.log.gz 2023-09-30T22:30:15.693 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153821.log 2023-09-30T22:30:15.693 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.153821.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.153821.log.gz 2023-09-30T22:30:15.693 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188179.log 2023-09-30T22:30:15.693 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.188179.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.188179.log.gz 2023-09-30T22:30:15.694 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127225.log 2023-09-30T22:30:15.694 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.127225.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127225.log.gz 2023-09-30T22:30:15.694 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193973.log 2023-09-30T22:30:15.694 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183744.log 2023-09-30T22:30:15.694 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.193973.log: /var/log/ceph/ceph-client.admin.183744.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.193973.log.gz 2023-09-30T22:30:15.694 INFO:teuthology.orchestra.run.smithi156.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.183744.log.gz 2023-09-30T22:30:15.694 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156155.log 2023-09-30T22:30:15.694 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.156155.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.156155.log.gz 2023-09-30T22:30:15.695 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122966.log 2023-09-30T22:30:15.695 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.122966.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122966.log.gz 2023-09-30T22:30:15.695 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157039.log 2023-09-30T22:30:15.695 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.157039.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.157039.log.gz 2023-09-30T22:30:15.695 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165573.log 2023-09-30T22:30:15.695 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.165573.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165573.log.gz 2023-09-30T22:30:15.695 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169766.log 2023-09-30T22:30:15.695 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.169766.log: 94.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-09-30T22:30:15.696 INFO:teuthology.orchestra.run.smithi156.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.169766.log.gz 2023-09-30T22:30:15.696 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183522.log 2023-09-30T22:30:15.696 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134792.log 2023-09-30T22:30:15.696 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.183522.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.183522.log.gz/var/log/ceph/ceph-client.admin.134792.log: 2023-09-30T22:30:15.696 INFO:teuthology.orchestra.run.smithi156.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.134792.log.gz 2023-09-30T22:30:15.696 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164052.log 2023-09-30T22:30:15.696 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170942.log 2023-09-30T22:30:15.696 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.164052.log: /var/log/ceph/ceph-client.admin.170942.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164052.log.gz 2023-09-30T22:30:15.697 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134816.log 2023-09-30T22:30:15.697 INFO:teuthology.orchestra.run.smithi156.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.170942.log.gz 2023-09-30T22:30:15.697 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152992.log 2023-09-30T22:30:15.697 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.134816.log: /var/log/ceph/ceph-client.admin.152992.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.134816.log.gz 2023-09-30T22:30:15.697 INFO:teuthology.orchestra.run.smithi156.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.152992.log.gz 2023-09-30T22:30:15.697 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142614.log 2023-09-30T22:30:15.697 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168790.log 2023-09-30T22:30:15.697 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.142614.log: /var/log/ceph/ceph-client.admin.168790.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142614.log.gz 2023-09-30T22:30:15.698 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.168790.log.gz 2023-09-30T22:30:15.698 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154932.log 2023-09-30T22:30:15.698 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160812.log 2023-09-30T22:30:15.698 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.154932.log: 88.2%/var/log/ceph/ceph-client.admin.160812.log: -- replaced with /var/log/ceph/ceph-client.admin.154932.log.gz 2023-09-30T22:30:15.698 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.160812.log.gz 2023-09-30T22:30:15.698 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154612.log 2023-09-30T22:30:15.698 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124593.log 2023-09-30T22:30:15.698 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.154612.log: /var/log/ceph/ceph-client.admin.124593.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.154612.log.gz 2023-09-30T22:30:15.699 INFO:teuthology.orchestra.run.smithi156.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.124593.log.gz 2023-09-30T22:30:15.699 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161692.log 2023-09-30T22:30:15.699 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191791.log 2023-09-30T22:30:15.699 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.161692.log: /var/log/ceph/ceph-client.admin.191791.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.161692.log.gz 2023-09-30T22:30:15.699 INFO:teuthology.orchestra.run.smithi156.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.191791.log.gz 2023-09-30T22:30:15.699 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-09-30T22:30:15.699 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168172.log 2023-09-30T22:30:15.699 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.168172.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.168172.log.gz 2023-09-30T22:30:15.700 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159097.log 2023-09-30T22:30:15.700 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.159097.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.159097.log.gz 2023-09-30T22:30:15.700 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192013.log 2023-09-30T22:30:15.700 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.192013.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.192013.log.gz 2023-09-30T22:30:15.700 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178836.log 2023-09-30T22:30:15.700 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.178836.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.178836.log.gz 2023-09-30T22:30:15.700 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138816.log 2023-09-30T22:30:15.700 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.138816.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.138816.log.gz 2023-09-30T22:30:15.701 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143421.log 2023-09-30T22:30:15.701 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.143421.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.143421.log.gz 2023-09-30T22:30:15.701 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161104.log 2023-09-30T22:30:15.701 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.161104.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.161104.log.gz 2023-09-30T22:30:15.701 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146720.log 2023-09-30T22:30:15.701 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.146720.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.146720.log.gz 2023-09-30T22:30:15.701 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174866.log 2023-09-30T22:30:15.701 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.174866.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174866.log.gz 2023-09-30T22:30:15.702 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160300.log 2023-09-30T22:30:15.702 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.160300.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.160300.log.gz 2023-09-30T22:30:15.702 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180094.log 2023-09-30T22:30:15.702 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.180094.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.180094.log.gz 2023-09-30T22:30:15.702 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175476.log 2023-09-30T22:30:15.702 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.175476.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175476.log.gz 2023-09-30T22:30:15.702 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134912.log 2023-09-30T22:30:15.702 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.134912.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.134912.log.gz 2023-09-30T22:30:15.703 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166409.log 2023-09-30T22:30:15.703 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.166409.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.166409.log.gz 2023-09-30T22:30:15.703 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146959.log 2023-09-30T22:30:15.703 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.146959.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.146959.log.gz 2023-09-30T22:30:15.703 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176361.log 2023-09-30T22:30:15.703 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.176361.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.176361.log.gz 2023-09-30T22:30:15.703 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163564.log 2023-09-30T22:30:15.703 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.163564.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.163564.log.gz 2023-09-30T22:30:15.704 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124789.log 2023-09-30T22:30:15.704 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.124789.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124789.log.gz 2023-09-30T22:30:15.704 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191004.log 2023-09-30T22:30:15.738 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.191004.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.191004.log.gz 2023-09-30T22:30:15.739 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150197.log 2023-09-30T22:30:15.739 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.150197.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.150197.log.gz 2023-09-30T22:30:15.739 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167023.log 2023-09-30T22:30:15.739 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.167023.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.167023.log.gz 2023-09-30T22:30:15.739 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146081.log 2023-09-30T22:30:15.739 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.146081.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.146081.log.gz 2023-09-30T22:30:15.739 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152839.log 2023-09-30T22:30:15.740 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.152839.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152839.log.gz 2023-09-30T22:30:15.740 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148851.log 2023-09-30T22:30:15.740 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.148851.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.148851.log.gz 2023-09-30T22:30:15.740 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187028.log 2023-09-30T22:30:15.740 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.187028.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.187028.log.gz 2023-09-30T22:30:15.740 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158264.log 2023-09-30T22:30:15.740 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.158264.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.158264.log.gz 2023-09-30T22:30:15.740 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135943.log 2023-09-30T22:30:15.741 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.135943.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.135943.log.gz 2023-09-30T22:30:15.741 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122378.log 2023-09-30T22:30:15.741 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.122378.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.122378.log.gz 2023-09-30T22:30:15.741 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172663.log 2023-09-30T22:30:15.741 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.172663.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.172663.log.gz 2023-09-30T22:30:15.741 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125279.log 2023-09-30T22:30:15.741 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.125279.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.125279.log.gz 2023-09-30T22:30:15.741 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123270.log 2023-09-30T22:30:15.742 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.123270.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.123270.log.gz 2023-09-30T22:30:15.742 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145741.log 2023-09-30T22:30:15.742 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.145741.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.145741.log.gz 2023-09-30T22:30:15.742 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145164.log 2023-09-30T22:30:15.742 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.145164.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.145164.log.gz 2023-09-30T22:30:15.742 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136700.log 2023-09-30T22:30:15.742 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.136700.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.136700.log.gz 2023-09-30T22:30:15.743 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152038.log 2023-09-30T22:30:15.743 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.152038.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.152038.log.gz 2023-09-30T22:30:15.743 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193162.log 2023-09-30T22:30:15.743 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.193162.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.193162.log.gz 2023-09-30T22:30:15.743 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192210.log 2023-09-30T22:30:15.743 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.192210.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.192210.log.gz 2023-09-30T22:30:15.743 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173106.log 2023-09-30T22:30:15.744 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.173106.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.173106.log.gz 2023-09-30T22:30:15.744 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127425.log 2023-09-30T22:30:15.744 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.127425.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.127425.log.gz 2023-09-30T22:30:15.744 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124230.log 2023-09-30T22:30:15.744 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.124230.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.124230.log.gz 2023-09-30T22:30:15.744 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127814.log 2023-09-30T22:30:15.744 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.127814.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127814.log.gz 2023-09-30T22:30:15.745 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175872.log 2023-09-30T22:30:15.745 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.175872.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.175872.log.gz 2023-09-30T22:30:15.745 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163473.log 2023-09-30T22:30:15.745 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.163473.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.163473.log.gz 2023-09-30T22:30:15.745 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154148.log 2023-09-30T22:30:15.745 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.154148.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.154148.log.gz 2023-09-30T22:30:15.745 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145313.log 2023-09-30T22:30:15.746 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.145313.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.145313.log.gz 2023-09-30T22:30:15.746 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153428.log 2023-09-30T22:30:15.746 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.153428.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.153428.log.gz 2023-09-30T22:30:15.746 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140871.log 2023-09-30T22:30:15.746 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.140871.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140871.log.gz 2023-09-30T22:30:15.746 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186271.log 2023-09-30T22:30:15.746 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.186271.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.186271.log.gz 2023-09-30T22:30:15.747 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171113.log 2023-09-30T22:30:15.747 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.171113.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.171113.log.gz 2023-09-30T22:30:15.747 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166161.log 2023-09-30T22:30:15.747 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.166161.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.166161.log.gz 2023-09-30T22:30:15.747 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146132.log 2023-09-30T22:30:15.747 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.146132.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.146132.log.gz 2023-09-30T22:30:15.747 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182887.log 2023-09-30T22:30:15.748 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.182887.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.182887.log.gz 2023-09-30T22:30:15.748 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191987.log 2023-09-30T22:30:15.748 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.191987.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.191987.log.gz 2023-09-30T22:30:15.748 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190200.log 2023-09-30T22:30:15.748 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.190200.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.190200.log.gz 2023-09-30T22:30:15.748 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147061.log 2023-09-30T22:30:15.748 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.147061.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147061.log.gz 2023-09-30T22:30:15.748 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136334.log 2023-09-30T22:30:15.749 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.136334.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.136334.log.gz 2023-09-30T22:30:15.749 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173933.log 2023-09-30T22:30:15.749 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.173933.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.173933.log.gz 2023-09-30T22:30:15.749 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175969.log 2023-09-30T22:30:15.749 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.175969.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.175969.log.gz 2023-09-30T22:30:15.749 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140045.log 2023-09-30T22:30:15.749 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.140045.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140045.log.gz 2023-09-30T22:30:15.749 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181074.log 2023-09-30T22:30:15.750 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.181074.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.181074.log.gz 2023-09-30T22:30:15.750 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136870.log 2023-09-30T22:30:15.750 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.136870.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.136870.log.gz 2023-09-30T22:30:15.750 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165207.log 2023-09-30T22:30:15.750 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.165207.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.165207.log.gz 2023-09-30T22:30:15.750 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123072.log 2023-09-30T22:30:15.750 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.123072.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.123072.log.gz 2023-09-30T22:30:15.750 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177146.log 2023-09-30T22:30:15.751 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.177146.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.177146.log.gz 2023-09-30T22:30:15.751 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137858.log 2023-09-30T22:30:15.751 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.137858.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.137858.log.gz 2023-09-30T22:30:15.751 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191422.log 2023-09-30T22:30:15.751 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-09-30T22:30:15.751 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.191422.log: /var/log/ceph/ceph.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.191422.log.gz 2023-09-30T22:30:15.751 INFO:teuthology.orchestra.run.smithi156.stderr: 94.2% -- replaced with /var/log/ceph/ceph.log.gz 2023-09-30T22:30:15.751 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127348.log 2023-09-30T22:30:15.752 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.127348.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.127348.log.gz 2023-09-30T22:30:15.752 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145859.log 2023-09-30T22:30:15.752 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.145859.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.145859.log.gz 2023-09-30T22:30:15.752 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144358.log 2023-09-30T22:30:15.752 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.144358.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.144358.log.gz 2023-09-30T22:30:15.752 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184136.log 2023-09-30T22:30:15.752 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.184136.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.184136.log.gz 2023-09-30T22:30:15.752 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150858.log 2023-09-30T22:30:15.753 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.150858.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150858.log.gz 2023-09-30T22:30:15.753 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147427.log 2023-09-30T22:30:15.753 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.147427.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147427.log.gz 2023-09-30T22:30:15.753 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134718.log 2023-09-30T22:30:15.753 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.134718.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.134718.log.gz 2023-09-30T22:30:15.753 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177195.log 2023-09-30T22:30:15.753 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.177195.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.177195.log.gz 2023-09-30T22:30:15.754 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129167.log 2023-09-30T22:30:15.754 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.129167.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.129167.log.gz 2023-09-30T22:30:15.754 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166240.log 2023-09-30T22:30:15.754 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.166240.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.166240.log.gz 2023-09-30T22:30:15.754 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140385.log 2023-09-30T22:30:15.754 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.140385.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140385.log.gz 2023-09-30T22:30:15.754 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190836.log 2023-09-30T22:30:15.754 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.190836.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.190836.log.gz 2023-09-30T22:30:15.755 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140019.log 2023-09-30T22:30:15.755 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.140019.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140019.log.gz 2023-09-30T22:30:15.755 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183156.log 2023-09-30T22:30:15.755 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.183156.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.183156.log.gz 2023-09-30T22:30:15.755 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186663.log 2023-09-30T22:30:15.755 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.186663.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.186663.log.gz 2023-09-30T22:30:15.755 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163072.log 2023-09-30T22:30:15.755 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.163072.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.163072.log.gz 2023-09-30T22:30:15.756 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168957.log 2023-09-30T22:30:15.756 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.168957.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.168957.log.gz 2023-09-30T22:30:15.756 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144673.log 2023-09-30T22:30:15.756 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.144673.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.144673.log.gz 2023-09-30T22:30:15.756 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155863.log 2023-09-30T22:30:15.756 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.155863.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.155863.log.gz 2023-09-30T22:30:15.756 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184455.log 2023-09-30T22:30:15.756 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.184455.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.184455.log.gz 2023-09-30T22:30:15.757 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171513.log 2023-09-30T22:30:15.757 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.171513.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.171513.log.gz 2023-09-30T22:30:15.757 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168539.log 2023-09-30T22:30:15.757 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.168539.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.168539.log.gz 2023-09-30T22:30:15.757 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172714.log 2023-09-30T22:30:15.757 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.172714.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.172714.log.gz 2023-09-30T22:30:15.757 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175240.log 2023-09-30T22:30:15.757 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.175240.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.175240.log.gz 2023-09-30T22:30:15.758 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166017.log 2023-09-30T22:30:15.758 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.166017.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.166017.log.gz 2023-09-30T22:30:15.758 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135306.log 2023-09-30T22:30:15.758 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.135306.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135306.log.gz 2023-09-30T22:30:15.758 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144869.log 2023-09-30T22:30:15.758 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.144869.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.144869.log.gz 2023-09-30T22:30:15.758 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153820.log 2023-09-30T22:30:15.758 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.153820.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.153820.log.gz 2023-09-30T22:30:15.759 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134742.log 2023-09-30T22:30:15.759 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.134742.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.134742.log.gz 2023-09-30T22:30:15.759 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171487.log 2023-09-30T22:30:15.759 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.171487.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.171487.log.gz 2023-09-30T22:30:15.759 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143793.log 2023-09-30T22:30:15.759 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145485.log 2023-09-30T22:30:15.759 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.143793.log: /var/log/ceph/ceph-client.admin.145485.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143793.log.gz 2023-09-30T22:30:15.759 INFO:teuthology.orchestra.run.smithi156.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.145485.log.gz 2023-09-30T22:30:15.759 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163882.log 2023-09-30T22:30:15.760 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.163882.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.163882.log.gz 2023-09-30T22:30:15.760 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183867.log 2023-09-30T22:30:15.760 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.183867.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.183867.log.gz 2023-09-30T22:30:15.760 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154099.log 2023-09-30T22:30:15.760 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.154099.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.154099.log.gz 2023-09-30T22:30:15.760 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124740.log 2023-09-30T22:30:15.760 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.124740.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124740.log.gz 2023-09-30T22:30:15.760 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176484.log 2023-09-30T22:30:15.761 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.176484.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.176484.log.gz 2023-09-30T22:30:15.761 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169200.log 2023-09-30T22:30:15.761 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.169200.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.169200.log.gz 2023-09-30T22:30:15.761 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166801.log 2023-09-30T22:30:15.761 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.166801.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.166801.log.gz 2023-09-30T22:30:15.761 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183352.log 2023-09-30T22:30:15.761 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.183352.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.183352.log.gz 2023-09-30T22:30:15.761 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172075.log 2023-09-30T22:30:15.762 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.172075.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.172075.log.gz 2023-09-30T22:30:15.762 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149662.log 2023-09-30T22:30:15.762 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.149662.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.149662.log.gz 2023-09-30T22:30:15.762 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168121.log 2023-09-30T22:30:15.762 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.168121.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.168121.log.gz 2023-09-30T22:30:15.762 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182150.log 2023-09-30T22:30:15.762 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.182150.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.182150.log.gz 2023-09-30T22:30:15.762 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150635.log 2023-09-30T22:30:15.763 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156547.log 2023-09-30T22:30:15.763 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.150635.log: /var/log/ceph/ceph-client.admin.156547.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.150635.log.gz 2023-09-30T22:30:15.763 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156547.log.gz 2023-09-30T22:30:15.763 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172148.log 2023-09-30T22:30:15.763 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.172148.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.172148.log.gz 2023-09-30T22:30:15.763 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194722.log 2023-09-30T22:30:15.763 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.194722.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.194722.log.gz 2023-09-30T22:30:15.763 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159191.log 2023-09-30T22:30:15.764 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.159191.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159191.log.gz 2023-09-30T22:30:15.764 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155985.log 2023-09-30T22:30:15.764 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.155985.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.155985.log.gz 2023-09-30T22:30:15.764 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137466.log 2023-09-30T22:30:15.764 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.137466.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.137466.log.gz 2023-09-30T22:30:15.764 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152178.log 2023-09-30T22:30:15.764 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.152178.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.152178.log.gz 2023-09-30T22:30:15.764 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178910.log 2023-09-30T22:30:15.765 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.178910.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.178910.log.gz 2023-09-30T22:30:15.765 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122766.log 2023-09-30T22:30:15.765 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.122766.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122766.log.gz 2023-09-30T22:30:15.765 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187421.log 2023-09-30T22:30:15.765 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.187421.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.187421.log.gz 2023-09-30T22:30:15.765 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174474.log 2023-09-30T22:30:15.765 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.174474.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.174474.log.gz 2023-09-30T22:30:15.765 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125497.log 2023-09-30T22:30:15.766 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.125497.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125497.log.gz 2023-09-30T22:30:15.766 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129363.log 2023-09-30T22:30:15.766 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.129363.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.129363.log.gz 2023-09-30T22:30:15.766 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135137.log 2023-09-30T22:30:15.766 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.135137.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.135137.log.gz 2023-09-30T22:30:15.766 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136138.log 2023-09-30T22:30:15.766 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.136138.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.136138.log.gz 2023-09-30T22:30:15.766 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144699.log 2023-09-30T22:30:15.767 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.144699.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.144699.log.gz 2023-09-30T22:30:15.767 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149439.log 2023-09-30T22:30:15.767 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.149439.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.149439.log.gz 2023-09-30T22:30:15.767 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139209.log 2023-09-30T22:30:15.767 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.139209.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139209.log.gz 2023-09-30T22:30:15.767 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171710.log 2023-09-30T22:30:15.767 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.171710.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.171710.log.gz 2023-09-30T22:30:15.767 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129525.log 2023-09-30T22:30:15.768 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.129525.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.129525.log.gz 2023-09-30T22:30:15.768 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177930.log 2023-09-30T22:30:15.768 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.177930.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.177930.log.gz 2023-09-30T22:30:15.768 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141143.log 2023-09-30T22:30:15.768 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.141143.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141143.log.gz 2023-09-30T22:30:15.768 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161914.log 2023-09-30T22:30:15.768 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.161914.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161914.log.gz 2023-09-30T22:30:15.768 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139068.log 2023-09-30T22:30:15.769 INFO:teuthology.orchestra.run.smithi156.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-09-30T22:30:15.769 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.139068.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139068.log.gz 2023-09-30T22:30:15.769 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192379.log 2023-09-30T22:30:15.769 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140359.log 2023-09-30T22:30:15.769 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.192379.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.192379.log.gz 2023-09-30T22:30:15.769 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.140359.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140359.log.gz 2023-09-30T22:30:15.769 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170553.log 2023-09-30T22:30:15.770 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176071.log 2023-09-30T22:30:15.770 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.170553.log: /var/log/ceph/ceph-client.admin.176071.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.170553.log.gz 2023-09-30T22:30:15.770 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.176071.log.gz 2023-09-30T22:30:15.770 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187277.log 2023-09-30T22:30:15.770 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142241.log 2023-09-30T22:30:15.770 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.187277.log: /var/log/ceph/ceph-client.admin.142241.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.187277.log.gz 2023-09-30T22:30:15.770 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142241.log.gz 2023-09-30T22:30:15.770 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172271.log 2023-09-30T22:30:15.771 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187813.log 2023-09-30T22:30:15.771 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.172271.log: /var/log/ceph/ceph-client.admin.187813.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.172271.log.gz 2023-09-30T22:30:15.771 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.187813.log.gz 2023-09-30T22:30:15.771 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138595.log 2023-09-30T22:30:15.771 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156108.log 2023-09-30T22:30:15.771 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.138595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151467.log 2023-09-30T22:30:15.771 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.138595.log.gz 2023-09-30T22:30:15.771 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.156108.log: /var/log/ceph/ceph-client.admin.151467.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.156108.log.gz 2023-09-30T22:30:15.772 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.151467.log.gz 2023-09-30T22:30:15.772 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192602.log 2023-09-30T22:30:15.772 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160543.log 2023-09-30T22:30:15.772 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.192602.log: /var/log/ceph/ceph-client.admin.160543.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.192602.log.gz 2023-09-30T22:30:15.772 INFO:teuthology.orchestra.run.smithi156.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.160543.log.gz 2023-09-30T22:30:15.772 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139823.log 2023-09-30T22:30:15.772 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174129.log 2023-09-30T22:30:15.772 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.139823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150636.log 2023-09-30T22:30:15.773 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.139823.log.gz 2023-09-30T22:30:15.773 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.174129.log: /var/log/ceph/ceph-client.admin.150636.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.174129.log.gz 2023-09-30T22:30:15.773 INFO:teuthology.orchestra.run.smithi156.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.150636.log.gz 2023-09-30T22:30:15.773 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186245.log 2023-09-30T22:30:15.773 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181270.log 2023-09-30T22:30:15.773 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.186245.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.186245.log.gz 2023-09-30T22:30:15.773 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.181270.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.181270.log.gz 2023-09-30T22:30:15.773 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192549.log 2023-09-30T22:30:15.774 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166604.log 2023-09-30T22:30:15.774 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.192549.log: /var/log/ceph/ceph-client.admin.166604.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.192549.log.gz 2023-09-30T22:30:15.774 INFO:teuthology.orchestra.run.smithi156.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.166604.log.gz 2023-09-30T22:30:15.774 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177464.log 2023-09-30T22:30:15.774 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151739.log 2023-09-30T22:30:15.774 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.177464.log: /var/log/ceph/ceph-client.admin.151739.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.177464.log.gz 2023-09-30T22:30:15.775 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151739.log.gz 2023-09-30T22:30:15.775 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193385.log 2023-09-30T22:30:15.775 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135647.log 2023-09-30T22:30:15.775 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.193385.log: /var/log/ceph/ceph-client.admin.135647.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.193385.log.gz 2023-09-30T22:30:15.775 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.135647.log.gz 2023-09-30T22:30:15.775 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153160.log 2023-09-30T22:30:15.775 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152962.log 2023-09-30T22:30:15.775 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.153160.log: /var/log/ceph/ceph-client.admin.152962.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.153160.log.gz 2023-09-30T22:30:15.776 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.152962.log.gz 2023-09-30T22:30:15.776 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125448.log 2023-09-30T22:30:15.776 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145341.log 2023-09-30T22:30:15.776 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.125448.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.125448.log.gz 2023-09-30T22:30:15.776 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.145341.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.145341.log.gz 2023-09-30T22:30:15.776 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145689.log 2023-09-30T22:30:15.776 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141731.log 2023-09-30T22:30:15.776 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.145689.log: /var/log/ceph/ceph-client.admin.141731.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.145689.log.gz 2023-09-30T22:30:15.777 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141731.log.gz 2023-09-30T22:30:15.777 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181660.log 2023-09-30T22:30:15.777 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169571.log 2023-09-30T22:30:15.777 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.181660.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.181660.log.gz 2023-09-30T22:30:15.777 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.169571.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.169571.log.gz 2023-09-30T22:30:15.777 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171112.log 2023-09-30T22:30:15.777 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138817.log 2023-09-30T22:30:15.777 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.171112.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.171112.log.gz 2023-09-30T22:30:15.778 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.138817.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.138817.log.gz 2023-09-30T22:30:15.778 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175284.log 2023-09-30T22:30:15.778 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172345.log 2023-09-30T22:30:15.778 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.175284.log: /var/log/ceph/ceph-client.admin.172345.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.175284.log.gz 2023-09-30T22:30:15.778 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172345.log.gz 2023-09-30T22:30:15.778 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187691.log 2023-09-30T22:30:15.778 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123837.log 2023-09-30T22:30:15.778 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.187691.log: /var/log/ceph/ceph-client.admin.123837.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.187691.log.gz 2023-09-30T22:30:15.779 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.123837.log.gz 2023-09-30T22:30:15.779 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153503.log 2023-09-30T22:30:15.779 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167424.log 2023-09-30T22:30:15.779 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.153503.log: /var/log/ceph/ceph-client.admin.167424.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.153503.log.gz 2023-09-30T22:30:15.779 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.167424.log.gz 2023-09-30T22:30:15.779 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193874.log 2023-09-30T22:30:15.779 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125328.log 2023-09-30T22:30:15.779 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.193874.log: 88.0%/var/log/ceph/ceph-client.admin.125328.log: -- replaced with /var/log/ceph/ceph-client.admin.193874.log.gz 2023-09-30T22:30:15.780 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.125328.log.gz 2023-09-30T22:30:15.780 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173690.log 2023-09-30T22:30:15.780 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144163.log 2023-09-30T22:30:15.780 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.173690.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.173690.log.gz 2023-09-30T22:30:15.780 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.144163.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.144163.log.gz 2023-09-30T22:30:15.780 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124373.log 2023-09-30T22:30:15.780 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165965.log 2023-09-30T22:30:15.780 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.124373.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.124373.log.gz 2023-09-30T22:30:15.780 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.165965.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.165965.log.gz 2023-09-30T22:30:15.781 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171932.log 2023-09-30T22:30:15.781 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170748.log 2023-09-30T22:30:15.781 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.171932.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.171932.log.gz 2023-09-30T22:30:15.781 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.170748.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.170748.log.gz 2023-09-30T22:30:15.781 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150414.log 2023-09-30T22:30:15.781 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174036.log 2023-09-30T22:30:15.781 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.150414.log: /var/log/ceph/ceph-client.admin.174036.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.150414.log.gz 2023-09-30T22:30:15.781 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.174036.log.gz 2023-09-30T22:30:15.782 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140751.log 2023-09-30T22:30:15.782 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135010.log 2023-09-30T22:30:15.791 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.140751.log: /var/log/ceph/ceph-client.admin.135010.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140751.log.gz 2023-09-30T22:30:15.791 INFO:teuthology.orchestra.run.smithi156.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.135010.log.gz 2023-09-30T22:30:15.791 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187029.log 2023-09-30T22:30:15.791 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140777.log 2023-09-30T22:30:15.791 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.187029.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.187029.log.gz 2023-09-30T22:30:15.792 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.140777.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140777.log.gz 2023-09-30T22:30:15.792 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163686.log 2023-09-30T22:30:15.792 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177438.log 2023-09-30T22:30:15.792 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.163686.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.163686.log.gz 2023-09-30T22:30:15.792 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.177438.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.177438.log.gz 2023-09-30T22:30:15.792 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190369.log 2023-09-30T22:30:15.792 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170473.log 2023-09-30T22:30:15.792 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.190369.log: /var/log/ceph/ceph-client.admin.170473.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.190369.log.gz 2023-09-30T22:30:15.792 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.170473.log.gz 2023-09-30T22:30:15.793 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156892.log 2023-09-30T22:30:15.793 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125644.log 2023-09-30T22:30:15.793 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.156892.log: /var/log/ceph/ceph-client.admin.125644.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.156892.log.gz 2023-09-30T22:30:15.793 INFO:teuthology.orchestra.run.smithi156.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125644.log.gz 2023-09-30T22:30:15.793 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148262.log 2023-09-30T22:30:15.793 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154016.log 2023-09-30T22:30:15.793 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.148262.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148262.log.gz 2023-09-30T22:30:15.793 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.154016.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.154016.log.gz 2023-09-30T22:30:15.794 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148067.log 2023-09-30T22:30:15.794 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123368.log 2023-09-30T22:30:15.794 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.148067.log: /var/log/ceph/ceph-client.admin.123368.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.148067.log.gz 2023-09-30T22:30:15.794 INFO:teuthology.orchestra.run.smithi156.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.123368.log.gz 2023-09-30T22:30:15.794 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165508.log 2023-09-30T22:30:15.794 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145544.log 2023-09-30T22:30:15.794 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.165508.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.165508.log.gz 2023-09-30T22:30:15.794 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.145544.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.145544.log.gz 2023-09-30T22:30:15.795 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139263.log 2023-09-30T22:30:15.795 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167807.log 2023-09-30T22:30:15.795 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.139263.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139263.log.gz 2023-09-30T22:30:15.795 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.167807.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.167807.log.gz 2023-09-30T22:30:15.795 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148289.log 2023-09-30T22:30:15.795 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167221.log 2023-09-30T22:30:15.795 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.148289.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148289.log.gz 2023-09-30T22:30:15.795 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.167221.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.167221.log.gz 2023-09-30T22:30:15.796 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181588.log 2023-09-30T22:30:15.796 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168565.log 2023-09-30T22:30:15.796 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.181588.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.181588.log.gz 2023-09-30T22:30:15.796 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.168565.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.168565.log.gz 2023-09-30T22:30:15.796 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178640.log 2023-09-30T22:30:15.796 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155397.log 2023-09-30T22:30:15.796 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.178640.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.178640.log.gz 2023-09-30T22:30:15.796 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.155397.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.155397.log.gz 2023-09-30T22:30:15.797 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133324.log 2023-09-30T22:30:15.797 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142366.log 2023-09-30T22:30:15.797 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.133324.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.133324.log.gz 2023-09-30T22:30:15.797 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.142366.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142366.log.gz 2023-09-30T22:30:15.797 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158532.log 2023-09-30T22:30:15.797 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190456.log 2023-09-30T22:30:15.797 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.158532.log: /var/log/ceph/ceph-client.admin.190456.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.158532.log.gz 2023-09-30T22:30:15.797 INFO:teuthology.orchestra.run.smithi156.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.190456.log.gz 2023-09-30T22:30:15.798 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168342.log 2023-09-30T22:30:15.798 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150662.log 2023-09-30T22:30:15.798 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.168342.log: /var/log/ceph/ceph-client.admin.150662.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.168342.log.gz 2023-09-30T22:30:15.798 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.150662.log.gz 2023-09-30T22:30:15.798 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153111.log 2023-09-30T22:30:15.798 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141021.log 2023-09-30T22:30:15.798 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.153111.log: /var/log/ceph/ceph-client.admin.141021.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.153111.log.gz 2023-09-30T22:30:15.798 INFO:teuthology.orchestra.run.smithi156.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.141021.log.gz 2023-09-30T22:30:15.799 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154979.log 2023-09-30T22:30:15.799 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148485.log 2023-09-30T22:30:15.799 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.154979.log: /var/log/ceph/ceph-client.admin.148485.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.154979.log.gz 2023-09-30T22:30:15.799 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.148485.log.gz 2023-09-30T22:30:15.799 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178248.log 2023-09-30T22:30:15.799 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123319.log 2023-09-30T22:30:15.799 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.178248.log: /var/log/ceph/ceph-client.admin.123319.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.178248.log.gz 2023-09-30T22:30:15.799 INFO:teuthology.orchestra.run.smithi156.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.123319.log.gz 2023-09-30T22:30:15.800 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163417.log 2023-09-30T22:30:15.800 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143766.log 2023-09-30T22:30:15.800 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.163417.log: /var/log/ceph/ceph-client.admin.143766.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.163417.log.gz 2023-09-30T22:30:15.800 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.143766.log.gz 2023-09-30T22:30:15.800 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178418.log 2023-09-30T22:30:15.800 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149242.log 2023-09-30T22:30:15.800 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.178418.log: /var/log/ceph/ceph-client.admin.149242.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.178418.log.gz 2023-09-30T22:30:15.800 INFO:teuthology.orchestra.run.smithi156.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.149242.log.gz 2023-09-30T22:30:15.801 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161718.log 2023-09-30T22:30:15.801 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161522.log 2023-09-30T22:30:15.801 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.161718.log: /var/log/ceph/ceph-client.admin.161522.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.161718.log.gz 2023-09-30T22:30:15.801 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.161522.log.gz 2023-09-30T22:30:15.801 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172130.log 2023-09-30T22:30:15.801 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190659.log 2023-09-30T22:30:15.801 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.172130.log: /var/log/ceph/ceph-client.admin.190659.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.172130.log.gz 2023-09-30T22:30:15.801 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.190659.log.gz 2023-09-30T22:30:15.802 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157480.log 2023-09-30T22:30:15.802 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145885.log 2023-09-30T22:30:15.802 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.157480.log: /var/log/ceph/ceph-client.admin.145885.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157480.log.gz 2023-09-30T22:30:15.802 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145885.log.gz 2023-09-30T22:30:15.802 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150831.log 2023-09-30T22:30:15.802 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126036.log 2023-09-30T22:30:15.802 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.150831.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.150831.log.gz 2023-09-30T22:30:15.802 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.126036.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.126036.log.gz 2023-09-30T22:30:15.803 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161449.log 2023-09-30T22:30:15.803 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187055.log 2023-09-30T22:30:15.803 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.161449.log: /var/log/ceph/ceph-client.admin.187055.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161449.log.gz 2023-09-30T22:30:15.803 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.187055.log.gz 2023-09-30T22:30:15.803 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145663.log 2023-09-30T22:30:15.803 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142562.log 2023-09-30T22:30:15.803 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.145663.log: /var/log/ceph/ceph-client.admin.142562.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.145663.log.gz 2023-09-30T22:30:15.803 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142562.log.gz 2023-09-30T22:30:15.804 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142418.log 2023-09-30T22:30:15.804 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155789.log 2023-09-30T22:30:15.804 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.142418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191226.log 2023-09-30T22:30:15.804 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.142418.log.gz 2023-09-30T22:30:15.804 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.155789.log: /var/log/ceph/ceph-client.admin.191226.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.155789.log.gz 2023-09-30T22:30:15.804 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.191226.log.gz 2023-09-30T22:30:15.804 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158901.log 2023-09-30T22:30:15.804 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139627.log 2023-09-30T22:30:15.804 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.158901.log: /var/log/ceph/ceph-client.admin.139627.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.158901.log.gz 2023-09-30T22:30:15.805 INFO:teuthology.orchestra.run.smithi156.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.139627.log.gz 2023-09-30T22:30:15.805 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136674.log 2023-09-30T22:30:15.805 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140581.log 2023-09-30T22:30:15.805 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.136674.log: /var/log/ceph/ceph-client.admin.140581.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.136674.log.gz 2023-09-30T22:30:15.805 INFO:teuthology.orchestra.run.smithi156.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.140581.log.gz 2023-09-30T22:30:15.805 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144895.log 2023-09-30T22:30:15.805 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193511.log 2023-09-30T22:30:15.805 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.144895.log: /var/log/ceph/ceph-client.admin.193511.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.144895.log.gz 2023-09-30T22:30:15.806 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.193511.log.gz 2023-09-30T22:30:15.806 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138843.log 2023-09-30T22:30:15.806 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157823.log 2023-09-30T22:30:15.806 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.138843.log: /var/log/ceph/ceph-client.admin.157823.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.138843.log.gz 2023-09-30T22:30:15.806 INFO:teuthology.orchestra.run.smithi156.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.157823.log.gz 2023-09-30T22:30:15.806 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147500.log 2023-09-30T22:30:15.806 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174205.log 2023-09-30T22:30:15.806 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.147500.log: /var/log/ceph/ceph-client.admin.174205.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.147500.log.gz 2023-09-30T22:30:15.807 INFO:teuthology.orchestra.run.smithi156.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.174205.log.gz 2023-09-30T22:30:15.807 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160347.log 2023-09-30T22:30:15.807 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151663.log 2023-09-30T22:30:15.807 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.160347.log: /var/log/ceph/ceph-client.admin.151663.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.160347.log.gz 2023-09-30T22:30:15.807 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.151663.log.gz 2023-09-30T22:30:15.807 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183326.log 2023-09-30T22:30:15.807 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175068.log 2023-09-30T22:30:15.807 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.183326.log: /var/log/ceph/ceph-client.admin.175068.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.183326.log.gz 2023-09-30T22:30:15.808 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.175068.log.gz 2023-09-30T22:30:15.808 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171853.log 2023-09-30T22:30:15.808 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175624.log 2023-09-30T22:30:15.808 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.171853.log: /var/log/ceph/ceph-client.admin.175624.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.171853.log.gz 2023-09-30T22:30:15.808 INFO:teuthology.orchestra.run.smithi156.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.175624.log.gz 2023-09-30T22:30:15.808 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162476.log 2023-09-30T22:30:15.808 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186415.log 2023-09-30T22:30:15.808 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.162476.log: /var/log/ceph/ceph-client.admin.186415.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.162476.log.gz 2023-09-30T22:30:15.809 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.186415.log.gz 2023-09-30T22:30:15.809 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186466.log 2023-09-30T22:30:15.809 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151982.log 2023-09-30T22:30:15.809 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.186466.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.186466.log.gz 2023-09-30T22:30:15.809 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.151982.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.151982.log.gz 2023-09-30T22:30:15.809 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147304.log 2023-09-30T22:30:15.814 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167363.log 2023-09-30T22:30:15.814 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.147304.log: /var/log/ceph/ceph-client.admin.167363.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.147304.log.gz 2023-09-30T22:30:15.814 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.167363.log.gz 2023-09-30T22:30:15.814 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124985.log 2023-09-30T22:30:15.815 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118560.log 2023-09-30T22:30:15.815 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.124985.log: /var/log/ceph/ceph-client.admin.118560.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124985.log.gz 2023-09-30T22:30:15.815 INFO:teuthology.orchestra.run.smithi156.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.118560.log.gz 2023-09-30T22:30:15.815 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142713.log 2023-09-30T22:30:15.815 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187199.log 2023-09-30T22:30:15.815 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.142713.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.142713.log.gz 2023-09-30T22:30:15.815 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.187199.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.187199.log.gz 2023-09-30T22:30:15.815 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138399.log 2023-09-30T22:30:15.816 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189389.log 2023-09-30T22:30:15.816 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.138399.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.138399.log.gz 2023-09-30T22:30:15.816 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.189389.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.189389.log.gz 2023-09-30T22:30:15.816 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176409.log 2023-09-30T22:30:15.816 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176850.log 2023-09-30T22:30:15.816 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.176409.log: /var/log/ceph/ceph-client.admin.176850.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.176409.log.gz 2023-09-30T22:30:15.816 INFO:teuthology.orchestra.run.smithi156.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.176850.log.gz 2023-09-30T22:30:15.816 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162876.log 2023-09-30T22:30:15.817 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193189.log 2023-09-30T22:30:15.817 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.162876.log: /var/log/ceph/ceph-client.admin.193189.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162876.log.gz 2023-09-30T22:30:15.817 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.193189.log.gz 2023-09-30T22:30:15.817 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174233.log 2023-09-30T22:30:15.817 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148458.log 2023-09-30T22:30:15.817 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.174233.log: /var/log/ceph/ceph-client.admin.148458.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174233.log.gz 2023-09-30T22:30:15.817 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.148458.log.gz 2023-09-30T22:30:15.817 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175088.log 2023-09-30T22:30:15.818 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162976.log 2023-09-30T22:30:15.818 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.175088.log: /var/log/ceph/ceph-client.admin.162976.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.175088.log.gz 2023-09-30T22:30:15.818 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.162976.log.gz 2023-09-30T22:30:15.818 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188278.log 2023-09-30T22:30:15.818 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135134.log 2023-09-30T22:30:15.818 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.188278.log: /var/log/ceph/ceph-client.admin.135134.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.188278.log.gz 2023-09-30T22:30:15.818 INFO:teuthology.orchestra.run.smithi156.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.135134.log.gz 2023-09-30T22:30:15.818 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181854.log 2023-09-30T22:30:15.819 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187395.log 2023-09-30T22:30:15.819 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.181854.log: /var/log/ceph/ceph-client.admin.187395.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.181854.log.gz 2023-09-30T22:30:15.819 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.187395.log.gz 2023-09-30T22:30:15.819 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181980.log 2023-09-30T22:30:15.819 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143591.log 2023-09-30T22:30:15.819 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.181980.log: /var/log/ceph/ceph-client.admin.143591.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.181980.log.gz 2023-09-30T22:30:15.819 INFO:teuthology.orchestra.run.smithi156.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.143591.log.gz 2023-09-30T22:30:15.819 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170695.log 2023-09-30T22:30:15.821 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185631.log 2023-09-30T22:30:15.821 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.170695.log: /var/log/ceph/ceph-client.admin.185631.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.170695.log.gz 2023-09-30T22:30:15.821 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.185631.log.gz 2023-09-30T22:30:15.821 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183279.log 2023-09-30T22:30:15.821 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144161.log 2023-09-30T22:30:15.821 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.183279.log: /var/log/ceph/ceph-client.admin.144161.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.183279.log.gz 2023-09-30T22:30:15.822 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.144161.log.gz 2023-09-30T22:30:15.822 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181170.log 2023-09-30T22:30:15.822 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192110.log 2023-09-30T22:30:15.822 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.181170.log: /var/log/ceph/ceph-client.admin.192110.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.181170.log.gz 2023-09-30T22:30:15.822 INFO:teuthology.orchestra.run.smithi156.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.192110.log.gz 2023-09-30T22:30:15.822 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190462.log 2023-09-30T22:30:15.822 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183718.log 2023-09-30T22:30:15.822 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.190462.log: /var/log/ceph/ceph-client.admin.183718.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.190462.log.gz 2023-09-30T22:30:15.823 INFO:teuthology.orchestra.run.smithi156.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.183718.log.gz 2023-09-30T22:30:15.823 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169493.log 2023-09-30T22:30:15.823 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175185.log 2023-09-30T22:30:15.823 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.169493.log: /var/log/ceph/ceph-client.admin.175185.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.169493.log.gz 2023-09-30T22:30:15.823 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.175185.log.gz 2023-09-30T22:30:15.824 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135551.log 2023-09-30T22:30:15.824 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.135551.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.135551.log.gz 2023-09-30T22:30:15.824 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-09-30T22:30:15.824 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170552.log 2023-09-30T22:30:15.825 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.170552.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.170552.log.gz 2023-09-30T22:30:15.825 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127628.log 2023-09-30T22:30:15.825 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.127628.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127628.log.gz 2023-09-30T22:30:15.825 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125840.log 2023-09-30T22:30:15.825 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.125840.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.125840.log.gz 2023-09-30T22:30:15.825 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160616.log 2023-09-30T22:30:15.825 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.160616.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160616.log.gz 2023-09-30T22:30:15.826 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159907.log 2023-09-30T22:30:15.826 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.159907.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.159907.log.gz 2023-09-30T22:30:15.826 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123023.log 2023-09-30T22:30:15.830 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.123023.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123023.log.gz 2023-09-30T22:30:15.830 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123613.log 2023-09-30T22:30:15.830 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.123613.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123613.log.gz 2023-09-30T22:30:15.830 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188997.log 2023-09-30T22:30:15.830 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.188997.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.188997.log.gz 2023-09-30T22:30:15.831 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154687.log 2023-09-30T22:30:15.831 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.154687.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.154687.log.gz 2023-09-30T22:30:15.831 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162576.log 2023-09-30T22:30:15.831 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.162576.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162576.log.gz 2023-09-30T22:30:15.831 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128266.log 2023-09-30T22:30:15.831 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.128266.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.128266.log.gz 2023-09-30T22:30:15.831 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181515.log 2023-09-30T22:30:15.831 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.181515.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.181515.log.gz 2023-09-30T22:30:15.832 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176165.log 2023-09-30T22:30:15.832 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.176165.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.176165.log.gz 2023-09-30T22:30:15.832 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143179.log 2023-09-30T22:30:15.832 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.143179.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143179.log.gz 2023-09-30T22:30:15.832 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151198.log 2023-09-30T22:30:15.832 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.151198.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.151198.log.gz 2023-09-30T22:30:15.832 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146133.log 2023-09-30T22:30:15.841 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.146133.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.146133.log.gz 2023-09-30T22:30:15.841 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143348.log 2023-09-30T22:30:15.841 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.143348.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143348.log.gz 2023-09-30T22:30:15.841 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189853.log 2023-09-30T22:30:15.841 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.189853.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.189853.log.gz 2023-09-30T22:30:15.842 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166800.log 2023-09-30T22:30:15.842 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.166800.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.166800.log.gz 2023-09-30T22:30:15.842 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159489.log 2023-09-30T22:30:15.842 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.159489.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159489.log.gz 2023-09-30T22:30:15.842 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136627.log 2023-09-30T22:30:15.842 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.136627.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.136627.log.gz 2023-09-30T22:30:15.842 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182346.log 2023-09-30T22:30:15.843 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.182346.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.182346.log.gz 2023-09-30T22:30:15.843 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157161.log 2023-09-30T22:30:15.843 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.157161.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.157161.log.gz 2023-09-30T22:30:15.843 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170355.log 2023-09-30T22:30:15.843 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.170355.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.170355.log.gz 2023-09-30T22:30:15.843 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128143.log 2023-09-30T22:30:15.843 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.128143.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.128143.log.gz 2023-09-30T22:30:15.843 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142047.log 2023-09-30T22:30:15.844 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.142047.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.142047.log.gz 2023-09-30T22:30:15.844 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154221.log 2023-09-30T22:30:15.852 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.154221.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.154221.log.gz 2023-09-30T22:30:15.852 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160077.log 2023-09-30T22:30:15.852 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157357.log 2023-09-30T22:30:15.852 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.160077.log: /var/log/ceph/ceph-client.admin.157357.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.160077.log.gz 2023-09-30T22:30:15.853 INFO:teuthology.orchestra.run.smithi156.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.157357.log.gz 2023-09-30T22:30:15.853 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147231.log 2023-09-30T22:30:15.853 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.147231.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.147231.log.gz 2023-09-30T22:30:15.853 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138446.log 2023-09-30T22:30:15.853 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.138446.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.138446.log.gz 2023-09-30T22:30:15.853 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194070.log 2023-09-30T22:30:15.853 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.194070.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.194070.log.gz 2023-09-30T22:30:15.853 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139183.log 2023-09-30T22:30:15.854 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.139183.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139183.log.gz 2023-09-30T22:30:15.854 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193482.log 2023-09-30T22:30:15.854 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.193482.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.193482.log.gz 2023-09-30T22:30:15.854 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180386.log 2023-09-30T22:30:15.854 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.180386.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.180386.log.gz 2023-09-30T22:30:15.854 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137662.log 2023-09-30T22:30:15.854 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.137662.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.137662.log.gz 2023-09-30T22:30:15.855 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177587.log 2023-09-30T22:30:15.860 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.177587.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.177587.log.gz 2023-09-30T22:30:15.860 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124229.log 2023-09-30T22:30:15.860 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.124229.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.124229.log.gz 2023-09-30T22:30:15.861 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141804.log 2023-09-30T22:30:15.861 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.141804.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.141804.log.gz 2023-09-30T22:30:15.861 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136431.log 2023-09-30T22:30:15.861 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.136431.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.136431.log.gz 2023-09-30T22:30:15.862 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145740.log 2023-09-30T22:30:15.862 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.145740.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.145740.log.gz 2023-09-30T22:30:15.862 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168761.log 2023-09-30T22:30:15.862 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.168761.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.168761.log.gz 2023-09-30T22:30:15.863 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187644.log 2023-09-30T22:30:15.863 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.187644.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.187644.log.gz 2023-09-30T22:30:15.863 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137323.log 2023-09-30T22:30:15.863 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.137323.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.137323.log.gz 2023-09-30T22:30:15.863 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194281.log 2023-09-30T22:30:15.865 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.194281.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.194281.log.gz 2023-09-30T22:30:15.865 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158017.log 2023-09-30T22:30:15.866 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.158017.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158017.log.gz 2023-09-30T22:30:15.866 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192575.log 2023-09-30T22:30:15.866 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.192575.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.192575.log.gz 2023-09-30T22:30:15.866 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189363.log 2023-09-30T22:30:15.866 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.189363.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.189363.log.gz 2023-09-30T22:30:15.866 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138476.log 2023-09-30T22:30:15.867 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.138476.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.138476.log.gz 2023-09-30T22:30:15.867 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191982.log 2023-09-30T22:30:15.869 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.191982.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.191982.log.gz 2023-09-30T22:30:15.869 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175577.log 2023-09-30T22:30:15.869 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.175577.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.175577.log.gz 2023-09-30T22:30:15.870 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177856.log 2023-09-30T22:30:15.870 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.177856.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.177856.log.gz 2023-09-30T22:30:15.870 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182176.log 2023-09-30T22:30:15.871 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.182176.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.182176.log.gz 2023-09-30T22:30:15.871 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178444.log 2023-09-30T22:30:15.872 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185904.log 2023-09-30T22:30:15.872 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.178444.log: /var/log/ceph/ceph-client.admin.185904.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.178444.log.gz 2023-09-30T22:30:15.872 INFO:teuthology.orchestra.run.smithi156.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.185904.log.gz 2023-09-30T22:30:15.872 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135307.log 2023-09-30T22:30:15.873 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.135307.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135307.log.gz 2023-09-30T22:30:15.873 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156965.log 2023-09-30T22:30:15.874 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.156965.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.156965.log.gz 2023-09-30T22:30:15.874 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150075.log 2023-09-30T22:30:15.874 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.150075.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.150075.log.gz 2023-09-30T22:30:15.875 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182934.log 2023-09-30T22:30:15.876 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.182934.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.182934.log.gz 2023-09-30T22:30:15.876 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192761.log 2023-09-30T22:30:15.876 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.192761.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.192761.log.gz 2023-09-30T22:30:15.876 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118450.log 2023-09-30T22:30:15.878 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.118450.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.118450.log.gz 2023-09-30T22:30:15.878 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144162.log 2023-09-30T22:30:15.878 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.144162.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.144162.log.gz 2023-09-30T22:30:15.879 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170303.log 2023-09-30T22:30:15.879 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161888.log 2023-09-30T22:30:15.879 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.170303.log: /var/log/ceph/ceph-client.admin.161888.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.170303.log.gz 2023-09-30T22:30:15.879 INFO:teuthology.orchestra.run.smithi156.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.161888.log.gz 2023-09-30T22:30:15.880 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174819.log 2023-09-30T22:30:15.881 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.174819.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174819.log.gz 2023-09-30T22:30:15.881 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182495.log 2023-09-30T22:30:15.882 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.182495.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.182495.log.gz 2023-09-30T22:30:15.882 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157749.log 2023-09-30T22:30:15.883 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.157749.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.157749.log.gz 2023-09-30T22:30:15.883 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154295.log 2023-09-30T22:30:15.884 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.154295.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.154295.log.gz 2023-09-30T22:30:15.884 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150048.log 2023-09-30T22:30:15.886 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.150048.log: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-09-30T22:30:15.886 INFO:teuthology.orchestra.run.smithi156.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.150048.log.gz 2023-09-30T22:30:15.887 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154017.log 2023-09-30T22:30:15.887 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189267.log 2023-09-30T22:30:15.887 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.154017.log: /var/log/ceph/ceph-client.admin.189267.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.154017.log.gz 2023-09-30T22:30:15.887 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.189267.log.gz 2023-09-30T22:30:15.888 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138869.log 2023-09-30T22:30:15.892 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177342.log 2023-09-30T22:30:15.892 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.138869.log: /var/log/ceph/ceph-client.admin.177342.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.138869.log.gz 2023-09-30T22:30:15.892 INFO:teuthology.orchestra.run.smithi156.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.177342.log.gz 2023-09-30T22:30:15.892 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143497.log 2023-09-30T22:30:15.893 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175676.log 2023-09-30T22:30:15.893 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.143497.log: /var/log/ceph/ceph-client.admin.175676.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143497.log.gz 2023-09-30T22:30:15.893 INFO:teuthology.orchestra.run.smithi156.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.175676.log.gz 2023-09-30T22:30:15.893 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175820.log 2023-09-30T22:30:15.893 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129265.log 2023-09-30T22:30:15.894 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.175820.log: /var/log/ceph/ceph-client.admin.129265.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.175820.log.gz 2023-09-30T22:30:15.894 INFO:teuthology.orchestra.run.smithi156.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129265.log.gz 2023-09-30T22:30:15.894 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192406.log 2023-09-30T22:30:15.894 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159048.log 2023-09-30T22:30:15.894 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.192406.log: /var/log/ceph/ceph-client.admin.159048.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.192406.log.gz 2023-09-30T22:30:15.895 INFO:teuthology.orchestra.run.smithi156.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.159048.log.gz 2023-09-30T22:30:15.895 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185095.log 2023-09-30T22:30:15.895 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188230.log 2023-09-30T22:30:15.895 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.185095.log: /var/log/ceph/ceph-client.admin.188230.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.185095.log.gz 2023-09-30T22:30:15.896 INFO:teuthology.orchestra.run.smithi156.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.188230.log.gz 2023-09-30T22:30:15.896 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152327.log 2023-09-30T22:30:15.896 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184923.log 2023-09-30T22:30:15.898 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.152327.log: /var/log/ceph/ceph-client.admin.184923.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152327.log.gz 2023-09-30T22:30:15.898 INFO:teuthology.orchestra.run.smithi156.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.184923.log.gz 2023-09-30T22:30:15.899 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190050.log 2023-09-30T22:30:15.899 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150759.log 2023-09-30T22:30:15.899 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.190050.log: /var/log/ceph/ceph-client.admin.150759.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.190050.log.gz 2023-09-30T22:30:15.899 INFO:teuthology.orchestra.run.smithi156.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150759.log.gz 2023-09-30T22:30:15.928 INFO:teuthology.orchestra.run.smithi156.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-09-30T22:30:15.957 INFO:teuthology.orchestra.run.smithi156.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-09-30T22:30:15.979 INFO:teuthology.orchestra.run.smithi156.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-09-30T22:30:16.026 INFO:teuthology.orchestra.run.smithi156.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-09-30T22:30:16.254 INFO:teuthology.orchestra.run.smithi156.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-09-30T22:30:16.255 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-09-30T22:30:16.256 INFO:teuthology.orchestra.run.smithi156.stderr:real 0m1.063s 2023-09-30T22:30:16.256 INFO:teuthology.orchestra.run.smithi156.stderr:user 0m4.011s 2023-09-30T22:30:16.256 INFO:teuthology.orchestra.run.smithi156.stderr:sys 0m0.723s 2023-09-30T22:30:16.256 INFO:tasks.ceph:Archiving logs... 2023-09-30T22:30:16.256 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/log/ceph to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408038/remote/smithi156/log 2023-09-30T22:30:16.258 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-30T22:30:17.882 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/log/ceph to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408038/remote/smithi194/log 2023-09-30T22:30:17.883 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-30T22:30:17.918 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-09-30T22:30:17.928 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-09-30T22:30:17.950 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-09-30T22:30:17.955 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-09-30T22:30:17.955 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-30T22:30:17.961 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-30T22:30:18.074 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-09-30T22:30:18.093 INFO:teuthology.task.clock:Checking final clock skew... 2023-09-30T22:30:18.093 DEBUG:teuthology.orchestra.run.smithi156:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T22:30:18.096 DEBUG:teuthology.orchestra.run.smithi194:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T22:30:18.114 INFO:teuthology.orchestra.run.smithi156.stderr:bash: ntpq: command not found 2023-09-30T22:30:18.115 INFO:teuthology.orchestra.run.smithi194.stderr:bash: ntpq: command not found 2023-09-30T22:30:18.118 INFO:teuthology.orchestra.run.smithi156.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T22:30:18.119 INFO:teuthology.orchestra.run.smithi156.stdout:=============================================================================== 2023-09-30T22:30:18.119 INFO:teuthology.orchestra.run.smithi156.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 25 -50us[ -50us] +/- 71ms 2023-09-30T22:30:18.119 INFO:teuthology.orchestra.run.smithi156.stdout:^* hv02.front.sepia.ceph.com 3 6 377 27 -445us[ -433us] +/- 51ms 2023-09-30T22:30:18.119 INFO:teuthology.orchestra.run.smithi156.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 25 +807us[ +807us] +/- 85ms 2023-09-30T22:30:18.119 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:30:18.121 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T22:30:18.121 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2023-09-30T22:30:18.121 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 25 -66us[ -66us] +/- 71ms 2023-09-30T22:30:18.122 INFO:teuthology.orchestra.run.smithi194.stdout:^* hv02.front.sepia.ceph.com 3 6 377 26 -441us[ -446us] +/- 51ms 2023-09-30T22:30:18.122 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 28 +817us[ +812us] +/- 85ms 2023-09-30T22:30:18.122 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:30:18.122 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-09-30T22:30:18.210 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-09-30T22:30:18.210 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-09-30T22:30:18.223 DEBUG:teuthology.orchestra.run.smithi156:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-30T22:30:18.277 DEBUG:teuthology.orchestra.run.smithi194:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-30T22:30:18.371 DEBUG:teuthology.orchestra.run.smithi156:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T22:30:18.403 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:30:18.404 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T22:30:18.437 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:30:18.437 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-09-30T22:30:18.451 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-09-30T22:30:18.463 INFO:teuthology.task.internal:Duration was 1448.238467 seconds 2023-09-30T22:30:18.464 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-09-30T22:30:18.476 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-09-30T22:30:18.476 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-30T22:30:18.479 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-30T22:30:18.527 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T22:30:18.528 INFO:teuthology.orchestra.run.smithi156.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T22:30:18.967 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-09-30T22:30:18.968 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi156.front.sepia.ceph.com 2023-09-30T22:30:18.968 DEBUG:teuthology.orchestra.run.smithi156:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-30T22:30:18.994 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi194.front.sepia.ceph.com 2023-09-30T22:30:18.994 DEBUG:teuthology.orchestra.run.smithi194:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-30T22:30:19.018 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-09-30T22:30:19.018 DEBUG:teuthology.orchestra.run.smithi156:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-30T22:30:19.037 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-30T22:30:19.097 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-09-30T22:30:19.097 DEBUG:teuthology.orchestra.run.smithi156:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-30T22:30:19.102 DEBUG:teuthology.orchestra.run.smithi194:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-30T22:30:19.213 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-09-30T22:30:19.227 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-09-30T22:30:19.228 DEBUG:teuthology.orchestra.run.smithi156:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-30T22:30:19.255 DEBUG:teuthology.orchestra.run.smithi194:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-30T22:30:19.282 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-09-30T22:30:19.295 DEBUG:teuthology.orchestra.run.smithi156:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-30T22:30:19.297 DEBUG:teuthology.orchestra.run.smithi194:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-30T22:30:19.322 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = core 2023-09-30T22:30:19.348 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = core 2023-09-30T22:30:19.362 DEBUG:teuthology.orchestra.run.smithi156:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-30T22:30:19.400 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi156.front.sepia.ceph.com, flagging run as failed 2023-09-30T22:30:19.400 DEBUG:teuthology.orchestra.run.smithi194:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-30T22:30:19.419 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:30:19.420 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-09-30T22:30:19.433 INFO:teuthology.task.internal:Transferring archived files... 2023-09-30T22:30:19.433 DEBUG:teuthology.misc:Transferring archived files from smithi156:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408038/remote/smithi156 2023-09-30T22:30:19.434 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-30T22:31:48.154 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2023-09-30T22:31:48.165 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408038/remote/smithi156/coredump/1696112342.126965.core.gz: gzip compressed data, was "1696112342.126965.core", last modified: Sat Sep 30 22:30:19 2023, max compression, original size modulo 2^32 1364242432 2023-09-30T22:31:48.166 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2023-09-30T22:31:53.836 INFO:teuthology.task.internal: core looks like: /tmp/tmp1t1exi1w: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mgr -f --cluster ceph -i x', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mgr', platform: 'x86_64' 2023-09-30T22:31:53.970 INFO:teuthology.task.internal: dump_program: ceph-mgr -f --cluster ceph -i x 2023-09-30T22:31:53.971 DEBUG:teuthology.orchestra.run.smithi156:> which 'ceph-mgr -f --cluster ceph -i x' 2023-09-30T22:31:53.993 INFO:teuthology.orchestra.run.smithi156.stderr:/usr/bin/which: invalid option -- 'f' 2023-09-30T22:31:53.994 INFO:teuthology.orchestra.run.smithi156.stderr:/usr/bin/which: unrecognized option '--cluster' 2023-09-30T22:31:53.994 INFO:teuthology.orchestra.run.smithi156.stderr:/usr/bin/which: no x in (/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin) 2023-09-30T22:31:53.994 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:31:53.995 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/bin/ceph-mgr 2023-09-30T22:31:53.995 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/bin/ceph 2023-09-30T22:31:53.996 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 392, in archive yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 96, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 1: "which 'ceph-mgr -f --cluster ceph -i x'" 2023-09-30T22:31:54.014 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-09-30T22:31:54.027 INFO:teuthology.task.internal:Not uploading archives. 2023-09-30T22:31:54.027 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-09-30T22:31:54.040 INFO:teuthology.task.internal:Tidying up after the test... 2023-09-30T22:31:54.040 DEBUG:teuthology.orchestra.run.smithi156:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-30T22:31:54.055 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-30T22:31:54.067 INFO:teuthology.orchestra.run.smithi156.stdout: 393225 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 30 22:30 /home/ubuntu/cephtest 2023-09-30T22:31:54.067 INFO:teuthology.orchestra.run.smithi156.stdout: 393226 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Sep 30 22:30 /home/ubuntu/cephtest/archive 2023-09-30T22:31:54.067 INFO:teuthology.orchestra.run.smithi156.stdout: 393227 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 30 22:19 /home/ubuntu/cephtest/archive/coredump 2023-09-30T22:31:54.067 INFO:teuthology.orchestra.run.smithi156.stdout: 393232 361740 -rw------- 1 root root 1364242432 Sep 30 22:19 /home/ubuntu/cephtest/archive/coredump/1696112342.126965.core 2023-09-30T22:31:54.067 INFO:teuthology.orchestra.run.smithi156.stdout: 393253 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Sep 30 22:30 /home/ubuntu/cephtest/archive/audit 2023-09-30T22:31:54.067 INFO:teuthology.orchestra.run.smithi156.stdout: 393255 28 -rw------- 1 ubuntu ubuntu 25489 Sep 30 22:30 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-09-30T22:31:54.068 INFO:teuthology.orchestra.run.smithi156.stdout: 393228 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 30 22:30 /home/ubuntu/cephtest/archive/syslog 2023-09-30T22:31:54.068 INFO:teuthology.orchestra.run.smithi156.stdout: 393254 4 -rw-rw-rw- 1 ubuntu ubuntu 772 Sep 30 22:30 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-09-30T22:31:54.068 INFO:teuthology.orchestra.run.smithi156.stdout: 393258 112 -rw-rw-r-- 1 ubuntu ubuntu 112738 Sep 30 22:30 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-30T22:31:54.068 INFO:teuthology.orchestra.run.smithi156.stdout: 393256 132 -rw-rw-rw- 1 ubuntu ubuntu 133122 Sep 30 22:30 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-09-30T22:31:54.069 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:31:54.069 INFO:teuthology.orchestra.run.smithi156.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-09-30T22:31:54.070 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-09-30T22:31:54.082 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-09-30T22:31:54.095 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-09-30T22:31:54.109 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi156 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-09-30T22:31:54.109 INFO:teuthology.nuke:Checking targets against current locks 2023-09-30T22:31:54.117 INFO:teuthology.orchestra.run.smithi194.stdout: 393225 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 30 22:30 /home/ubuntu/cephtest 2023-09-30T22:31:54.117 INFO:teuthology.orchestra.run.smithi194.stdout: 393226 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Sep 30 22:30 /home/ubuntu/cephtest/archive 2023-09-30T22:31:54.117 INFO:teuthology.orchestra.run.smithi194.stdout: 655785 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Sep 30 22:30 /home/ubuntu/cephtest/archive/audit 2023-09-30T22:31:54.117 INFO:teuthology.orchestra.run.smithi194.stdout: 655787 220 -rw------- 1 ubuntu ubuntu 224026 Sep 30 22:30 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-09-30T22:31:54.117 INFO:teuthology.orchestra.run.smithi194.stdout: 393228 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 30 22:30 /home/ubuntu/cephtest/archive/syslog 2023-09-30T22:31:54.118 INFO:teuthology.orchestra.run.smithi194.stdout: 393264 4 -rw-rw-rw- 1 ubuntu ubuntu 890 Sep 30 22:28 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-09-30T22:31:54.118 INFO:teuthology.orchestra.run.smithi194.stdout: 393266 92 -rw-rw-r-- 1 ubuntu ubuntu 92248 Sep 30 22:30 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-30T22:31:54.118 INFO:teuthology.orchestra.run.smithi194.stdout: 393265 88 -rw-rw-rw- 1 ubuntu ubuntu 86514 Sep 30 22:30 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-09-30T22:31:54.119 INFO:teuthology.orchestra.run.smithi194.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-09-30T22:31:54.144 DEBUG:teuthology.nuke:shortname: smithi156 2023-09-30T22:31:54.144 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T22:31:54.169 DEBUG:teuthology.nuke:shortname: smithi194 2023-09-30T22:31:54.169 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T22:31:54.173 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408038', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 21:57:20.157341', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKu1vwmDNztN6iyHkLdMoF4JU3fFqSvEbgNut54CiIbYLIGEkyLnfI6Q6M1CRI9Zy3xuhuBCzEm5Vvf0KJCtdhg='} 2023-09-30T22:31:54.198 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408038', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 21:57:20.155347', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMmJLqcddXk/AaOZYQx7nzY46fZFwoxkcZ/WDHE/6qEHmlhvokKuJs5Iu1YxoZNW2xMZJGUjh5pXEYZwHN8RZxs='} 2023-09-30T22:31:54.222 INFO:teuthology.orchestra.console.smithi156:Power off 2023-09-30T22:31:54.223 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T22:31:54.246 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-09-30T22:31:54.246 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T22:31:54.263 INFO:teuthology.orchestra.console.smithi194:Power off 2023-09-30T22:31:54.264 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T22:31:54.273 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-09-30T22:31:54.286 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2023-09-30T22:31:54.286 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T22:31:54.310 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2023-09-30T22:31:58.275 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T22:31:58.311 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T22:31:58.386 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-09-30T22:31:58.424 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2023-09-30T22:32:02.390 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T22:32:02.425 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T22:32:02.501 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-09-30T22:32:02.535 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-09-30T22:32:02.603 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-09-30T22:32:02.636 INFO:teuthology.orchestra.console.smithi194:Power off completed 2023-09-30T22:32:02.742 INFO:teuthology.run:Summary data: description: fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/dbench}}} duration: 1448.2384674549103 failure_reason: 'Command failed on smithi156 with status 124: ''sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json''' flavor: default owner: scheduled_dparmar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=cc8df17f6dcf4b4ba620388a8bdb3c08 status: fail success: false 2023-09-30T22:32:02.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T22:32:02.829 INFO:teuthology.run:FAIL